2023-08-25T03:46:51.241 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-25T03:46:51.242 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379036 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} --name rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi --owner scheduled_rishabh@teuthology --verbose -- /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379036/orig.config.yaml 2023-08-25T03:46:51.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T03:46:51.380 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379036 branch: wip-rishabh-2023aug3-b5 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: null first_in_suite: false job_id: '7379036' kernel: client: branch: testing flavor: default kdb: true sha1: a6a69670761025e039dc5ae86619b0cf04c46dc2 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-2023aug3-b5 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023aug3-b5 sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023aug3-b5 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ba6b39e4f4f77fb95c747099b53db0467d435f56/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi055.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCbSExc0/U0hdNt/KP9I42BESUbsI38oGqLfrdMpP88j4nIcB9jNfBW9vGqukDfdZ9bWp4UT/JYpYltO7n++MXY= smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLy9V2QndWWs7FahLdZ2TMHZaau2Xc5gQJcPaEif4xti/5076p9YL2e6ua5Am6ZYj1ULbJVIOmyP/RzlEsbGmWU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 449a1bc2027504e7b3c3d7b30fa4178906581da7 timestamp: 2023-08-25_01:50:32 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2224 2023-08-25T03:46:51.381 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ba6b39e4f4f77fb95c747099b53db0467d435f56/qa; will attempt to use it 2023-08-25T03:46:51.382 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ba6b39e4f4f77fb95c747099b53db0467d435f56/qa/tasks 2023-08-25T03:46:51.382 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-25T03:46:51.386 INFO:teuthology.task.internal:Checking packages... 2023-08-25T03:46:51.420 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'ba6b39e4f4f77fb95c747099b53db0467d435f56' 2023-08-25T03:46:51.421 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-25T03:46:51.421 INFO:teuthology.packaging:ref: None 2023-08-25T03:46:51.422 INFO:teuthology.packaging:tag: None 2023-08-25T03:46:51.422 INFO:teuthology.packaging:branch: wip-rishabh-2023aug3-b5 2023-08-25T03:46:51.423 INFO:teuthology.packaging:sha1: ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T03:46:51.423 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-2023aug3-b5 2023-08-25T03:46:51.562 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5703-gba6b39e4-1jammy 2023-08-25T03:46:51.563 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-25T03:46:51.569 INFO:teuthology.task.internal:no buildpackages task found 2023-08-25T03:46:51.570 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-25T03:46:51.583 INFO:teuthology.task.internal:Saving configuration 2023-08-25T03:46:51.600 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-25T03:46:51.625 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T03:46:51.652 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379036', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 03:41:17.791604', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKrPhNItg19xVi2065zH+H9KNbuZ0q/GOasJQ0nAGNOW'} 2023-08-25T03:46:51.675 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379036', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 03:41:17.793165', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINkXzJr5NqX5ej/64yN78YeJqmESWWRR3DTeXNb3Cxi9'} 2023-08-25T03:46:51.675 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-25T03:46:51.684 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-08-25T03:46:51.684 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-08-25T03:46:51.685 INFO:teuthology.run_tasks:Running task console_log... 2023-08-25T03:46:51.796 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f41e54adf70>, signals=[15]) 2023-08-25T03:46:51.797 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-25T03:46:51.804 INFO:teuthology.task.internal:Opening connections... 2023-08-25T03:46:51.804 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T03:46:51.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:46:51.884 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2023-08-25T03:46:51.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:46:51.961 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-25T03:46:51.967 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2023-08-25T03:46:51.972 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2023-08-25T03:46:51.973 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2023-08-25T03:46:52.017 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-25T03:46:52.017 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Ubuntu" 2023-08-25T03:46:52.017 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="22.04" 2023-08-25T03:46:52.017 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-25T03:46:52.018 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_CODENAME=jammy 2023-08-25T03:46:52.018 INFO:teuthology.orchestra.run.smithi055.stdout:ID=ubuntu 2023-08-25T03:46:52.018 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE=debian 2023-08-25T03:46:52.018 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-25T03:46:52.018 INFO:teuthology.orchestra.run.smithi055.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-25T03:46:52.018 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-25T03:46:52.018 INFO:teuthology.orchestra.run.smithi055.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-25T03:46:52.019 INFO:teuthology.orchestra.run.smithi055.stdout:UBUNTU_CODENAME=jammy 2023-08-25T03:46:52.019 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-08-25T03:46:52.047 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2023-08-25T03:46:52.052 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2023-08-25T03:46:52.053 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-08-25T03:46:52.100 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-25T03:46:52.100 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Ubuntu" 2023-08-25T03:46:52.101 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="22.04" 2023-08-25T03:46:52.101 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-25T03:46:52.101 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_CODENAME=jammy 2023-08-25T03:46:52.101 INFO:teuthology.orchestra.run.smithi110.stdout:ID=ubuntu 2023-08-25T03:46:52.101 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE=debian 2023-08-25T03:46:52.101 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-25T03:46:52.101 INFO:teuthology.orchestra.run.smithi110.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-25T03:46:52.102 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-25T03:46:52.102 INFO:teuthology.orchestra.run.smithi110.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-25T03:46:52.102 INFO:teuthology.orchestra.run.smithi110.stdout:UBUNTU_CODENAME=jammy 2023-08-25T03:46:52.102 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-08-25T03:46:52.121 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-25T03:46:52.131 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-25T03:46:52.153 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-25T03:46:52.153 DEBUG:teuthology.orchestra.run.smithi055:> test '!' -e /home/ubuntu/cephtest 2023-08-25T03:46:52.156 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2023-08-25T03:46:52.160 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-25T03:46:52.224 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-25T03:46:52.225 DEBUG:teuthology.orchestra.run.smithi055:> test -z $(ls -A /var/lib/ceph) 2023-08-25T03:46:52.227 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2023-08-25T03:46:52.241 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-25T03:46:52.327 INFO:teuthology.run_tasks:Running task kernel... 2023-08-25T03:46:52.344 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a6a69670761025e039dc5ae86619b0cf04c46dc2'} 2023-08-25T03:46:52.345 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-08-25T03:46:52.346 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-08-25T03:46:52.346 DEBUG:teuthology.orchestra.run.smithi055:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-25T03:46:52.347 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-25T03:46:52.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T03:46:52.352 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-08-25T03:46:52.354 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T03:46:52.355 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-08-25T03:46:52.560 DEBUG:teuthology.task.kernel:sha1 for client.1 is a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-25T03:46:52.561 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "a6a69670761025e039dc5ae86619b0cf04c46dc2"... 2023-08-25T03:46:52.562 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2023-08-25T03:46:52.568 INFO:teuthology.orchestra.run.smithi110.stdout:5.15.0-56-generic 2023-08-25T03:46:52.568 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-25T03:46:52.568 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-25T03:46:52.569 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-08-25T03:46:52.569 DEBUG:teuthology.orchestra.run.smithi110:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-08-25T03:46:52.634 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-08-25T03:46:52.674 DEBUG:teuthology.task.kernel:sha1 for client.0 is a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-25T03:46:52.674 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "a6a69670761025e039dc5ae86619b0cf04c46dc2"... 2023-08-25T03:46:52.674 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2023-08-25T03:46:52.680 INFO:teuthology.orchestra.run.smithi055.stdout:5.15.0-56-generic 2023-08-25T03:46:52.680 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-25T03:46:52.681 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-25T03:46:52.681 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-08-25T03:46:52.681 DEBUG:teuthology.orchestra.run.smithi055:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-08-25T03:46:52.731 INFO:teuthology.orchestra.run.smithi055.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-08-25T03:46:52.752 INFO:teuthology.orchestra.run.smithi110.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-08-25T03:46:52.752 INFO:teuthology.orchestra.run.smithi110.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-08-25T03:46:52.752 INFO:teuthology.orchestra.run.smithi110.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-08-25T03:46:52.752 INFO:teuthology.orchestra.run.smithi110.stderr:hint: 2023-08-25T03:46:52.752 INFO:teuthology.orchestra.run.smithi110.stderr:hint: git config --global init.defaultBranch 2023-08-25T03:46:52.753 INFO:teuthology.orchestra.run.smithi110.stderr:hint: 2023-08-25T03:46:52.753 INFO:teuthology.orchestra.run.smithi110.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-08-25T03:46:52.753 INFO:teuthology.orchestra.run.smithi110.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-08-25T03:46:52.753 INFO:teuthology.orchestra.run.smithi110.stderr:hint: 2023-08-25T03:46:52.753 INFO:teuthology.orchestra.run.smithi110.stderr:hint: git branch -m 2023-08-25T03:46:52.754 INFO:teuthology.orchestra.run.smithi110.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-08-25T03:46:52.754 DEBUG:teuthology.orchestra.run.smithi110:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-08-25T03:46:52.825 DEBUG:teuthology.orchestra.run.smithi110:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-08-25T03:46:52.864 INFO:teuthology.orchestra.run.smithi055.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-08-25T03:46:52.864 INFO:teuthology.orchestra.run.smithi055.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-08-25T03:46:52.865 INFO:teuthology.orchestra.run.smithi055.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-08-25T03:46:52.865 INFO:teuthology.orchestra.run.smithi055.stderr:hint: 2023-08-25T03:46:52.865 INFO:teuthology.orchestra.run.smithi055.stderr:hint: git config --global init.defaultBranch 2023-08-25T03:46:52.865 INFO:teuthology.orchestra.run.smithi055.stderr:hint: 2023-08-25T03:46:52.865 INFO:teuthology.orchestra.run.smithi055.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-08-25T03:46:52.865 INFO:teuthology.orchestra.run.smithi055.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-08-25T03:46:52.866 INFO:teuthology.orchestra.run.smithi055.stderr:hint: 2023-08-25T03:46:52.866 INFO:teuthology.orchestra.run.smithi055.stderr:hint: git branch -m 2023-08-25T03:46:52.866 INFO:teuthology.orchestra.run.smithi055.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-08-25T03:46:52.867 DEBUG:teuthology.orchestra.run.smithi055:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-08-25T03:46:52.882 DEBUG:teuthology.orchestra.run.smithi110:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-08-25T03:46:52.934 DEBUG:teuthology.orchestra.run.smithi055:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-08-25T03:46:52.994 DEBUG:teuthology.orchestra.run.smithi055:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-08-25T03:47:34.610 INFO:teuthology.orchestra.run.smithi110.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-08-25T03:47:34.610 INFO:teuthology.orchestra.run.smithi110.stderr: * [new branch] main -> origin/main 2023-08-25T03:47:34.630 INFO:teuthology.orchestra.run.smithi055.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-08-25T03:47:34.631 INFO:teuthology.orchestra.run.smithi055.stderr: * [new branch] main -> origin/main 2023-08-25T03:47:34.638 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190312 -> 20190312 2023-08-25T03:47:34.639 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190416 -> 20190416 2023-08-25T03:47:34.639 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190514 -> 20190514 2023-08-25T03:47:34.639 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190618 -> 20190618 2023-08-25T03:47:34.639 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190717 -> 20190717 2023-08-25T03:47:34.640 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190815 -> 20190815 2023-08-25T03:47:34.641 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20190923 -> 20190923 2023-08-25T03:47:34.641 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20191022 -> 20191022 2023-08-25T03:47:34.641 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20191215 -> 20191215 2023-08-25T03:47:34.641 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200122 -> 20200122 2023-08-25T03:47:34.641 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200316 -> 20200316 2023-08-25T03:47:34.641 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200421 -> 20200421 2023-08-25T03:47:34.641 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200519 -> 20200519 2023-08-25T03:47:34.642 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200619 -> 20200619 2023-08-25T03:47:34.642 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200721 -> 20200721 2023-08-25T03:47:34.642 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200817 -> 20200817 2023-08-25T03:47:34.642 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20200918 -> 20200918 2023-08-25T03:47:34.642 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20201022 -> 20201022 2023-08-25T03:47:34.642 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20201118 -> 20201118 2023-08-25T03:47:34.642 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20201218 -> 20201218 2023-08-25T03:47:34.644 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20210208 -> 20210208 2023-08-25T03:47:34.645 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20210315 -> 20210315 2023-08-25T03:47:34.645 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20210511 -> 20210511 2023-08-25T03:47:34.645 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20210716 -> 20210716 2023-08-25T03:47:34.645 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20210818 -> 20210818 2023-08-25T03:47:34.645 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20210919 -> 20210919 2023-08-25T03:47:34.645 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20211027 -> 20211027 2023-08-25T03:47:34.645 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20211216 -> 20211216 2023-08-25T03:47:34.645 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220209 -> 20220209 2023-08-25T03:47:34.646 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220310 -> 20220310 2023-08-25T03:47:34.646 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220411 -> 20220411 2023-08-25T03:47:34.646 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220509 -> 20220509 2023-08-25T03:47:34.646 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220610 -> 20220610 2023-08-25T03:47:34.646 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220708 -> 20220708 2023-08-25T03:47:34.646 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220815 -> 20220815 2023-08-25T03:47:34.646 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20220913 -> 20220913 2023-08-25T03:47:34.647 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20221012 -> 20221012 2023-08-25T03:47:34.647 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20221109 -> 20221109 2023-08-25T03:47:34.647 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20221214 -> 20221214 2023-08-25T03:47:34.647 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230117 -> 20230117 2023-08-25T03:47:34.647 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230210 -> 20230210 2023-08-25T03:47:34.647 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230310 -> 20230310 2023-08-25T03:47:34.647 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230404 -> 20230404 2023-08-25T03:47:34.648 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230515 -> 20230515 2023-08-25T03:47:34.648 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230625 -> 20230625 2023-08-25T03:47:34.648 INFO:teuthology.orchestra.run.smithi110.stderr: * [new tag] 20230804 -> 20230804 2023-08-25T03:47:34.660 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190312 -> 20190312 2023-08-25T03:47:34.660 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190416 -> 20190416 2023-08-25T03:47:34.660 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190514 -> 20190514 2023-08-25T03:47:34.661 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190618 -> 20190618 2023-08-25T03:47:34.661 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190717 -> 20190717 2023-08-25T03:47:34.662 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190815 -> 20190815 2023-08-25T03:47:34.662 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190923 -> 20190923 2023-08-25T03:47:34.662 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20191022 -> 20191022 2023-08-25T03:47:34.662 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20191215 -> 20191215 2023-08-25T03:47:34.662 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200122 -> 20200122 2023-08-25T03:47:34.662 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200316 -> 20200316 2023-08-25T03:47:34.663 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200421 -> 20200421 2023-08-25T03:47:34.663 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200519 -> 20200519 2023-08-25T03:47:34.664 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200619 -> 20200619 2023-08-25T03:47:34.664 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200721 -> 20200721 2023-08-25T03:47:34.664 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200817 -> 20200817 2023-08-25T03:47:34.664 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200918 -> 20200918 2023-08-25T03:47:34.665 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20201022 -> 20201022 2023-08-25T03:47:34.665 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20201118 -> 20201118 2023-08-25T03:47:34.665 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20201218 -> 20201218 2023-08-25T03:47:34.665 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20210208 -> 20210208 2023-08-25T03:47:34.665 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20210315 -> 20210315 2023-08-25T03:47:34.665 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20210511 -> 20210511 2023-08-25T03:47:34.665 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20210716 -> 20210716 2023-08-25T03:47:34.666 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20210818 -> 20210818 2023-08-25T03:47:34.666 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20210919 -> 20210919 2023-08-25T03:47:34.666 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20211027 -> 20211027 2023-08-25T03:47:34.666 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20211216 -> 20211216 2023-08-25T03:47:34.667 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220209 -> 20220209 2023-08-25T03:47:34.668 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220310 -> 20220310 2023-08-25T03:47:34.668 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220411 -> 20220411 2023-08-25T03:47:34.668 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220509 -> 20220509 2023-08-25T03:47:34.668 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220610 -> 20220610 2023-08-25T03:47:34.668 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220708 -> 20220708 2023-08-25T03:47:34.668 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220815 -> 20220815 2023-08-25T03:47:34.668 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220913 -> 20220913 2023-08-25T03:47:34.669 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20221012 -> 20221012 2023-08-25T03:47:34.669 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20221109 -> 20221109 2023-08-25T03:47:34.669 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20221214 -> 20221214 2023-08-25T03:47:34.669 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230117 -> 20230117 2023-08-25T03:47:34.669 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230210 -> 20230210 2023-08-25T03:47:34.669 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230310 -> 20230310 2023-08-25T03:47:34.669 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230404 -> 20230404 2023-08-25T03:47:34.669 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230515 -> 20230515 2023-08-25T03:47:34.670 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230625 -> 20230625 2023-08-25T03:47:34.670 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230804 -> 20230804 2023-08-25T03:47:37.938 INFO:teuthology.orchestra.run.smithi110.stderr:Updating files: 52% (1618/3107) Updating files: 53% (1647/3107) Updating files: 54% (1678/3107) Updating files: 55% (1709/3107) Updating files: 56% (1740/3107) Updating files: 57% (1771/3107) Updating files: 58% (1803/3107) Updating files: 59% (1834/3107) Updating files: 60% (1865/3107) Updating files: 61% (1896/3107) Updating files: 62% (1927/3107) Updating files: 63% (1958/3107) Updating files: 64% (1989/3107) Updating files: 65% (2020/3107) Updating files: 66% (2051/3107) Updating files: 66% (2079/3107) Updating files: 67% (2082/3107) Updating files: 68% (2113/3107) Updating files: 69% (2144/3107) Updating files: 70% (2175/3107) Updating files: 71% (2206/3107) Updating files: 72% (2238/3107) Updating files: 73% (2269/3107) Updating files: 74% (2300/3107) Updating files: 75% (2331/3107) Updating files: 76% (2362/3107) Updating files: 77% (2393/3107) Updating files: 78% (2424/3107) Updating files: 79% (2455/3107) Updating files: 80% (2486/3107) Updating files: 81% (2517/3107) Updating files: 82% (2548/3107) Updating files: 82% (2568/3107) Updating files: 83% (2579/3107) Updating files: 84% (2610/3107) Updating files: 85% (2641/3107) Updating files: 86% (2673/3107) Updating files: 87% (2704/3107) Updating files: 88% (2735/3107) Updating files: 89% (2766/3107) Updating files: 90% (2797/3107) Updating files: 91% (2828/3107) Updating files: 92% (2859/3107) Updating files: 93% (2890/3107) Updating files: 94% (2921/3107) Updating files: 95% (2952/3107) Updating files: 96% (2983/3107) Updating files: 97% (3014/3107) Updating files: 98% (3045/3107) Updating files: 99% (3076/3107) Updating files: 100% (3107/3107) Updating files: 100% (3107/3107), done. 2023-08-25T03:47:37.943 INFO:teuthology.orchestra.run.smithi110.stdout:HEAD is now at 0e048b06 Merge branch 'for-upstream' of https://github.com/CirrusLogic/linux-firmware 2023-08-25T03:47:37.961 INFO:teuthology.task.kernel:Downloading kernel a6a69670761025e039dc5ae86619b0cf04c46dc2 on client.1... 2023-08-25T03:47:37.961 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-25T03:47:38.149 INFO:teuthology.orchestra.run.smithi055.stderr:Updating files: 49% (1531/3107) Updating files: 50% (1554/3107) Updating files: 51% (1585/3107) Updating files: 52% (1616/3107) Updating files: 53% (1647/3107) Updating files: 54% (1678/3107) Updating files: 55% (1709/3107) Updating files: 56% (1740/3107) Updating files: 57% (1771/3107) Updating files: 58% (1803/3107) Updating files: 59% (1834/3107) Updating files: 60% (1865/3107) Updating files: 61% (1896/3107) Updating files: 62% (1927/3107) Updating files: 63% (1958/3107) Updating files: 64% (1989/3107) Updating files: 65% (2020/3107) Updating files: 66% (2051/3107) Updating files: 66% (2075/3107) Updating files: 67% (2082/3107) Updating files: 68% (2113/3107) Updating files: 69% (2144/3107) Updating files: 70% (2175/3107) Updating files: 71% (2206/3107) Updating files: 72% (2238/3107) Updating files: 73% (2269/3107) Updating files: 74% (2300/3107) Updating files: 75% (2331/3107) Updating files: 76% (2362/3107) Updating files: 77% (2393/3107) Updating files: 78% (2424/3107) Updating files: 79% (2455/3107) Updating files: 80% (2486/3107) Updating files: 81% (2517/3107) Updating files: 82% (2548/3107) Updating files: 82% (2554/3107) Updating files: 83% (2579/3107) Updating files: 84% (2610/3107) Updating files: 85% (2641/3107) Updating files: 86% (2673/3107) Updating files: 87% (2704/3107) Updating files: 88% (2735/3107) Updating files: 89% (2766/3107) Updating files: 90% (2797/3107) Updating files: 91% (2828/3107) Updating files: 92% (2859/3107) Updating files: 93% (2890/3107) Updating files: 94% (2921/3107) Updating files: 95% (2952/3107) Updating files: 96% (2983/3107) Updating files: 97% (3014/3107) Updating files: 98% (3045/3107) Updating files: 99% (3076/3107) Updating files: 100% (3107/3107) Updating files: 100% (3107/3107), done. 2023-08-25T03:47:38.154 INFO:teuthology.orchestra.run.smithi055.stdout:HEAD is now at 0e048b06 Merge branch 'for-upstream' of https://github.com/CirrusLogic/linux-firmware 2023-08-25T03:47:38.173 INFO:teuthology.task.kernel:Downloading kernel a6a69670761025e039dc5ae86619b0cf04c46dc2 on client.0... 2023-08-25T03:47:38.174 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a6a69670761025e039dc5ae86619b0cf04c46dc2 2023-08-25T03:47:38.181 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc7-ga6a696707610/ 2023-08-25T03:47:38.182 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc7-ga6a696707610_6.5.0-rc7-ga6a696707610-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc7-ga6a696707610/ --input-file=- 2023-08-25T03:47:38.185 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi110.front.sepia.ceph.com to complete... 2023-08-25T03:47:38.312 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc7-ga6a696707610/ 2023-08-25T03:47:38.313 DEBUG:teuthology.orchestra.run.smithi055:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc7-ga6a696707610_6.5.0-rc7-ga6a696707610-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc7-ga6a696707610/ --input-file=- 2023-08-25T03:47:38.315 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi055.front.sepia.ceph.com to complete... 2023-08-25T03:47:39.743 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25 03:47:39 URL:https://4.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc7-ga6a696707610/linux-image-6.5.0-rc7-ga6a696707610_6.5.0-rc7-ga6a696707610-1_amd64.deb [38887456/38887456] -> "/tmp/linux-image.deb" [1] 2023-08-25T03:47:39.743 INFO:teuthology.orchestra.run.smithi110.stderr:FINISHED --2023-08-25 03:47:39-- 2023-08-25T03:47:39.743 INFO:teuthology.orchestra.run.smithi110.stderr:Total wall clock time: 1.5s 2023-08-25T03:47:39.743 INFO:teuthology.orchestra.run.smithi110.stderr:Downloaded: 1 files, 37M in 1.4s (26.4 MB/s) 2023-08-25T03:47:39.746 INFO:teuthology.task.kernel:Installing kernel a6a69670761025e039dc5ae86619b0cf04c46dc2 on client.1... 2023-08-25T03:47:39.746 DEBUG:teuthology.orchestra.run.smithi110:> sudo dpkg -i /tmp/linux-image.deb 2023-08-25T03:47:40.083 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-image-6.5.0-rc7-ga6a696707610. 2023-08-25T03:47:42.052 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-08-25T03:47:42.057 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-08-25T03:47:42.157 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-image-6.5.0-rc7-ga6a696707610 (6.5.0-rc7-ga6a696707610-1) ... 2023-08-25T03:47:45.704 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-image-6.5.0-rc7-ga6a696707610 (6.5.0-rc7-ga6a696707610-1) ... 2023-08-25T03:47:45.877 INFO:teuthology.orchestra.run.smithi110.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc7-ga6a696707610 2023-08-25T03:47:47.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25 03:47:48 URL:https://4.chacra.ceph.com/r/kernel/testing/a6a69670761025e039dc5ae86619b0cf04c46dc2/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc7-ga6a696707610/linux-image-6.5.0-rc7-ga6a696707610_6.5.0-rc7-ga6a696707610-1_amd64.deb [38887456/38887456] -> "/tmp/linux-image.deb" [1] 2023-08-25T03:47:47.152 INFO:teuthology.orchestra.run.smithi055.stderr:FINISHED --2023-08-25 03:47:48-- 2023-08-25T03:47:47.152 INFO:teuthology.orchestra.run.smithi055.stderr:Total wall clock time: 8.8s 2023-08-25T03:47:47.153 INFO:teuthology.orchestra.run.smithi055.stderr:Downloaded: 1 files, 37M in 8.6s (4.31 MB/s) 2023-08-25T03:47:47.155 INFO:teuthology.task.kernel:Installing kernel a6a69670761025e039dc5ae86619b0cf04c46dc2 on client.0... 2023-08-25T03:47:47.155 DEBUG:teuthology.orchestra.run.smithi055:> sudo dpkg -i /tmp/linux-image.deb 2023-08-25T03:47:47.393 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package linux-image-6.5.0-rc7-ga6a696707610. 2023-08-25T03:47:49.413 INFO:teuthology.orchestra.run.smithi055.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-08-25T03:47:49.417 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-08-25T03:47:49.538 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking linux-image-6.5.0-rc7-ga6a696707610 (6.5.0-rc7-ga6a696707610-1) ... 2023-08-25T03:47:52.618 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up linux-image-6.5.0-rc7-ga6a696707610 (6.5.0-rc7-ga6a696707610-1) ... 2023-08-25T03:47:52.728 INFO:teuthology.orchestra.run.smithi055.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc7-ga6a696707610 2023-08-25T03:48:05.184 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub' 2023-08-25T03:48:05.195 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-08-25T03:48:05.219 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2023-08-25T03:48:05.517 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc7-ga6a696707610 2023-08-25T03:48:05.534 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc7-ga6a696707610 2023-08-25T03:48:05.811 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-08-25T03:48:05.819 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-08-25T03:48:05.885 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-08-25T03:48:05.890 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-08-25T03:48:06.027 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-08-25T03:48:06.028 INFO:teuthology.orchestra.run.smithi110.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-08-25T03:48:06.028 INFO:teuthology.orchestra.run.smithi110.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-08-25T03:48:06.081 INFO:teuthology.orchestra.run.smithi110.stderr:done 2023-08-25T03:48:06.261 DEBUG:teuthology.orchestra.run.smithi110:> dpkg-deb -c /tmp/linux-image.deb 2023-08-25T03:48:06.268 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./ 2023-08-25T03:48:06.269 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./boot/ 2023-08-25T03:48:06.269 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 4382168 2023-08-24 10:28 ./boot/System.map-6.5.0-rc7-ga6a696707610 2023-08-25T03:48:06.280 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 168459 2023-08-24 10:28 ./boot/config-6.5.0-rc7-ga6a696707610 2023-08-25T03:48:06.281 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11293952 2023-08-24 10:28 ./boot/vmlinuz-6.5.0-rc7-ga6a696707610 2023-08-25T03:48:06.299 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./etc/ 2023-08-25T03:48:06.299 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./etc/kernel/ 2023-08-25T03:48:06.299 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./etc/kernel/postinst.d/ 2023-08-25T03:48:06.299 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./etc/kernel/postrm.d/ 2023-08-25T03:48:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./etc/kernel/preinst.d/ 2023-08-25T03:48:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./etc/kernel/prerm.d/ 2023-08-25T03:48:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/ 2023-08-25T03:48:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/ 2023-08-25T03:48:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/ 2023-08-25T03:48:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/ 2023-08-25T03:48:06.300 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/ 2023-08-25T03:48:06.301 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/ 2023-08-25T03:48:06.301 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/ 2023-08-25T03:48:06.301 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 490393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/aesni-intel.ko 2023-08-25T03:48:06.303 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-25T03:48:06.303 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-25T03:48:06.303 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-25T03:48:06.303 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 93121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-25T03:48:06.303 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 106737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-25T03:48:06.304 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 152249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-25T03:48:06.304 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-25T03:48:06.304 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13785 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-25T03:48:06.304 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 83897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-25T03:48:06.304 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-25T03:48:06.304 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-25T03:48:06.304 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-25T03:48:06.305 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-25T03:48:06.305 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-25T03:48:06.305 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-25T03:48:06.305 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-25T03:48:06.305 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-25T03:48:06.305 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-25T03:48:06.305 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-25T03:48:06.306 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/ 2023-08-25T03:48:06.306 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu/ 2023-08-25T03:48:06.306 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu/mce/ 2023-08-25T03:48:06.306 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-25T03:48:06.306 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpuid.ko 2023-08-25T03:48:06.306 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/msr.ko 2023-08-25T03:48:06.306 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/ 2023-08-25T03:48:06.306 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 348241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-25T03:48:06.307 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 882137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-25T03:48:06.307 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 2277521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm.ko 2023-08-25T03:48:06.307 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/ 2023-08-25T03:48:06.308 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/af_alg.ko 2023-08-25T03:48:06.308 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/algif_hash.ko 2023-08-25T03:48:06.316 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/algif_skcipher.ko 2023-08-25T03:48:06.316 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/ansi_cprng.ko 2023-08-25T03:48:06.317 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19649 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/anubis.ko 2023-08-25T03:48:06.317 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/arc4.ko 2023-08-25T03:48:06.317 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/asymmetric_keys/ 2023-08-25T03:48:06.317 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-08-25T03:48:06.317 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/ 2023-08-25T03:48:06.317 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_memcpy.ko 2023-08-25T03:48:06.318 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_pq.ko 2023-08-25T03:48:06.318 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-25T03:48:06.318 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_tx.ko 2023-08-25T03:48:06.318 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_xor.ko 2023-08-25T03:48:06.318 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/raid6test.ko 2023-08-25T03:48:06.318 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/authenc.ko 2023-08-25T03:48:06.319 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22649 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/authencesn.ko 2023-08-25T03:48:06.319 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blake2b_generic.ko 2023-08-25T03:48:06.319 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blowfish_common.ko 2023-08-25T03:48:06.319 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blowfish_generic.ko 2023-08-25T03:48:06.319 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/camellia_generic.ko 2023-08-25T03:48:06.319 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast5_generic.ko 2023-08-25T03:48:06.319 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast6_generic.ko 2023-08-25T03:48:06.319 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast_common.ko 2023-08-25T03:48:06.320 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/ccm.ko 2023-08-25T03:48:06.320 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cmac.ko 2023-08-25T03:48:06.320 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crc32_generic.ko 2023-08-25T03:48:06.320 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cryptd.ko 2023-08-25T03:48:06.320 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crypto_engine.ko 2023-08-25T03:48:06.320 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crypto_simd.ko 2023-08-25T03:48:06.320 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crypto_user.ko 2023-08-25T03:48:06.321 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cts.ko 2023-08-25T03:48:06.321 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/des_generic.ko 2023-08-25T03:48:06.321 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/dh_generic.ko 2023-08-25T03:48:06.321 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/echainiv.ko 2023-08-25T03:48:06.321 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/essiv.ko 2023-08-25T03:48:06.321 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/fcrypt.ko 2023-08-25T03:48:06.321 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/khazad.ko 2023-08-25T03:48:06.322 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/lrw.ko 2023-08-25T03:48:06.322 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/lz4.ko 2023-08-25T03:48:06.322 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/lz4hc.ko 2023-08-25T03:48:06.322 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11769 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/md4.ko 2023-08-25T03:48:06.322 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/michael_mic.ko 2023-08-25T03:48:06.322 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/pcbc.ko 2023-08-25T03:48:06.322 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/pcrypt.ko 2023-08-25T03:48:06.322 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/rmd160.ko 2023-08-25T03:48:06.323 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/seed.ko 2023-08-25T03:48:06.323 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/serpent_generic.ko 2023-08-25T03:48:06.323 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 149201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/tcrypt.ko 2023-08-25T03:48:06.323 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/tea.ko 2023-08-25T03:48:06.323 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28785 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/twofish_common.ko 2023-08-25T03:48:06.323 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/twofish_generic.ko 2023-08-25T03:48:06.323 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/vmac.ko 2023-08-25T03:48:06.324 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/wp512.ko 2023-08-25T03:48:06.324 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xcbc.ko 2023-08-25T03:48:06.324 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xor.ko 2023-08-25T03:48:06.324 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xts.ko 2023-08-25T03:48:06.324 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xxhash_generic.ko 2023-08-25T03:48:06.324 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ 2023-08-25T03:48:06.324 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/ 2023-08-25T03:48:06.324 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/acpi_extlog.ko 2023-08-25T03:48:06.325 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-25T03:48:06.325 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/acpi_pad.ko 2023-08-25T03:48:06.325 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/apei/ 2023-08-25T03:48:06.325 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/apei/einj.ko 2023-08-25T03:48:06.325 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/ec_sys.ko 2023-08-25T03:48:06.325 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/platform_profile.ko 2023-08-25T03:48:06.325 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/sbs.ko 2023-08-25T03:48:06.326 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/sbshc.ko 2023-08-25T03:48:06.326 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 100417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/video.ko 2023-08-25T03:48:06.326 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/ 2023-08-25T03:48:06.326 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/acard-ahci.ko 2023-08-25T03:48:06.326 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 88633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/ahci.ko 2023-08-25T03:48:06.326 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/ahci_platform.ko 2023-08-25T03:48:06.326 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 87849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/libahci.ko 2023-08-25T03:48:06.326 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/libahci_platform.ko 2023-08-25T03:48:06.327 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_acpi.ko 2023-08-25T03:48:06.327 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ali.ko 2023-08-25T03:48:06.327 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_amd.ko 2023-08-25T03:48:06.327 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_artop.ko 2023-08-25T03:48:06.327 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_atiixp.ko 2023-08-25T03:48:06.327 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_atp867x.ko 2023-08-25T03:48:06.327 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cmd640.ko 2023-08-25T03:48:06.327 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cmd64x.ko 2023-08-25T03:48:06.328 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cypress.ko 2023-08-25T03:48:06.328 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_efar.ko 2023-08-25T03:48:06.328 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt366.ko 2023-08-25T03:48:06.328 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt37x.ko 2023-08-25T03:48:06.328 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-25T03:48:06.328 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-25T03:48:06.328 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_it8213.ko 2023-08-25T03:48:06.329 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_it821x.ko 2023-08-25T03:48:06.329 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_jmicron.ko 2023-08-25T03:48:06.329 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_legacy.ko 2023-08-25T03:48:06.329 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_marvell.ko 2023-08-25T03:48:06.329 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_mpiix.ko 2023-08-25T03:48:06.329 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_netcell.ko 2023-08-25T03:48:06.329 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ninja32.ko 2023-08-25T03:48:06.329 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ns87410.ko 2023-08-25T03:48:06.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ns87415.ko 2023-08-25T03:48:06.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_oldpiix.ko 2023-08-25T03:48:06.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_opti.ko 2023-08-25T03:48:06.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_optidma.ko 2023-08-25T03:48:06.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pcmcia.ko 2023-08-25T03:48:06.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-25T03:48:06.330 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-25T03:48:06.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_piccolo.ko 2023-08-25T03:48:06.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_radisys.ko 2023-08-25T03:48:06.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_rdc.ko 2023-08-25T03:48:06.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_rz1000.ko 2023-08-25T03:48:06.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sch.ko 2023-08-25T03:48:06.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_serverworks.ko 2023-08-25T03:48:06.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sil680.ko 2023-08-25T03:48:06.331 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19577 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sl82c105.ko 2023-08-25T03:48:06.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_triflex.ko 2023-08-25T03:48:06.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_via.ko 2023-08-25T03:48:06.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pdc_adma.ko 2023-08-25T03:48:06.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_inic162x.ko 2023-08-25T03:48:06.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 83233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_mv.ko 2023-08-25T03:48:06.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_nv.ko 2023-08-25T03:48:06.332 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37377 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_promise.ko 2023-08-25T03:48:06.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_qstor.ko 2023-08-25T03:48:06.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sil.ko 2023-08-25T03:48:06.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sil24.ko 2023-08-25T03:48:06.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sis.ko 2023-08-25T03:48:06.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_svw.ko 2023-08-25T03:48:06.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sx4.ko 2023-08-25T03:48:06.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_uli.ko 2023-08-25T03:48:06.333 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_via.ko 2023-08-25T03:48:06.334 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_vsc.ko 2023-08-25T03:48:06.334 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/auxdisplay/ 2023-08-25T03:48:06.334 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/auxdisplay/ks0108.ko 2023-08-25T03:48:06.334 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/bcma/ 2023-08-25T03:48:06.334 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 124529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/bcma/bcma.ko 2023-08-25T03:48:06.334 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/ 2023-08-25T03:48:06.334 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/aoe/ 2023-08-25T03:48:06.334 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 113737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/aoe/aoe.ko 2023-08-25T03:48:06.335 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/drbd/ 2023-08-25T03:48:06.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 968505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/drbd/drbd.ko 2023-08-25T03:48:06.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 173209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/floppy.ko 2023-08-25T03:48:06.335 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/mtip32xx/ 2023-08-25T03:48:06.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 94305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-25T03:48:06.335 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 115353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/nbd.ko 2023-08-25T03:48:06.374 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/null_blk/ 2023-08-25T03:48:06.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 110369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/null_blk/null_blk.ko 2023-08-25T03:48:06.374 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 98233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/pktcdvd.ko 2023-08-25T03:48:06.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 259409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/rbd.ko 2023-08-25T03:48:06.375 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkback/ 2023-08-25T03:48:06.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 98137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-25T03:48:06.375 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/zram/ 2023-08-25T03:48:06.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/zram/zram.ko 2023-08-25T03:48:06.375 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ 2023-08-25T03:48:06.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/applicom.ko 2023-08-25T03:48:06.375 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hangcheck-timer.ko 2023-08-25T03:48:06.376 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/ 2023-08-25T03:48:06.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-25T03:48:06.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-25T03:48:06.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-25T03:48:06.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/via-rng.ko 2023-08-25T03:48:06.376 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15641 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-25T03:48:06.376 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ 2023-08-25T03:48:06.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-25T03:48:06.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 150673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-25T03:48:06.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-25T03:48:06.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 139113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-25T03:48:06.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-25T03:48:06.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-25T03:48:06.377 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/lp.ko 2023-08-25T03:48:06.378 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/mwave/ 2023-08-25T03:48:06.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 84145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/mwave/mwave.ko 2023-08-25T03:48:06.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/nvram.ko 2023-08-25T03:48:06.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ppdev.ko 2023-08-25T03:48:06.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tlclk.ko 2023-08-25T03:48:06.378 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/ 2023-08-25T03:48:06.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-25T03:48:06.378 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-08-25T03:48:06.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-08-25T03:48:06.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-08-25T03:48:06.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-25T03:48:06.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-25T03:48:06.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-08-25T03:48:06.379 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/xillybus/ 2023-08-25T03:48:06.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/xillybus/xillybus_class.ko 2023-08-25T03:48:06.379 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/xillybus/xillybus_core.ko 2023-08-25T03:48:06.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-08-25T03:48:06.380 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/clk/ 2023-08-25T03:48:06.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/clk/clk-palmas.ko 2023-08-25T03:48:06.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/clk/clk-si5351.ko 2023-08-25T03:48:06.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/clk/clk-twl6040.ko 2023-08-25T03:48:06.380 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/clk/clk-wm831x.ko 2023-08-25T03:48:06.380 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/ 2023-08-25T03:48:06.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-25T03:48:06.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-25T03:48:06.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-25T03:48:06.381 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ 2023-08-25T03:48:06.381 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp/ 2023-08-25T03:48:06.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-25T03:48:06.381 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 234537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp/ccp.ko 2023-08-25T03:48:06.381 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/ 2023-08-25T03:48:06.382 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/ 2023-08-25T03:48:06.382 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_common/ 2023-08-25T03:48:06.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 408681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-25T03:48:06.382 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-08-25T03:48:06.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-25T03:48:06.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/padlock-aes.ko 2023-08-25T03:48:06.382 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/padlock-sha.ko 2023-08-25T03:48:06.383 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/virtio/ 2023-08-25T03:48:06.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 68961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-25T03:48:06.383 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dca/ 2023-08-25T03:48:06.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dca/dca.ko 2023-08-25T03:48:06.383 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/ 2023-08-25T03:48:06.383 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/dw/ 2023-08-25T03:48:06.383 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-25T03:48:06.383 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/ioat/ 2023-08-25T03:48:06.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 122665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-25T03:48:06.384 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/ 2023-08-25T03:48:06.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 80281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/amd64_edac.ko 2023-08-25T03:48:06.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/e752x_edac.ko 2023-08-25T03:48:06.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 63625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/edac_mce_amd.ko 2023-08-25T03:48:06.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i3000_edac.ko 2023-08-25T03:48:06.384 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i3200_edac.ko 2023-08-25T03:48:06.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i5100_edac.ko 2023-08-25T03:48:06.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i5400_edac.ko 2023-08-25T03:48:06.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i7300_edac.ko 2023-08-25T03:48:06.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i7core_edac.ko 2023-08-25T03:48:06.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i82975x_edac.ko 2023-08-25T03:48:06.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/ie31200_edac.ko 2023-08-25T03:48:06.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 56817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/sb_edac.ko 2023-08-25T03:48:06.385 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/x38_edac.ko 2023-08-25T03:48:06.386 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/extcon/ 2023-08-25T03:48:06.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/extcon/extcon-gpio.ko 2023-08-25T03:48:06.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/extcon/extcon-max14577.ko 2023-08-25T03:48:06.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29577 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/extcon/extcon-max77693.ko 2023-08-25T03:48:06.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/extcon/extcon-max8997.ko 2023-08-25T03:48:06.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/extcon/extcon-palmas.ko 2023-08-25T03:48:06.386 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/extcon/extcon-rt8973a.ko 2023-08-25T03:48:06.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/extcon/extcon-sm5502.ko 2023-08-25T03:48:06.387 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/ 2023-08-25T03:48:06.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/dmi-sysfs.ko 2023-08-25T03:48:06.387 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/efi/ 2023-08-25T03:48:06.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/efi/efi-pstore.ko 2023-08-25T03:48:06.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-25T03:48:06.387 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/ 2023-08-25T03:48:06.387 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-adp5520.ko 2023-08-25T03:48:06.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-amd8111.ko 2023-08-25T03:48:06.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-arizona.ko 2023-08-25T03:48:06.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-da9052.ko 2023-08-25T03:48:06.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-da9055.ko 2023-08-25T03:48:06.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-dln2.ko 2023-08-25T03:48:06.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 77857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-f7188x.ko 2023-08-25T03:48:06.388 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-generic.ko 2023-08-25T03:48:06.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19577 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-ich.ko 2023-08-25T03:48:06.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-08-25T03:48:06.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-kempld.ko 2023-08-25T03:48:06.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-lp3943.ko 2023-08-25T03:48:06.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-max7300.ko 2023-08-25T03:48:06.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-max730x.ko 2023-08-25T03:48:06.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-max732x.ko 2023-08-25T03:48:06.389 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-08-25T03:48:06.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46769 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-pca953x.ko 2023-08-25T03:48:06.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-pcf857x.ko 2023-08-25T03:48:06.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-rdc321x.ko 2023-08-25T03:48:06.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-sch.ko 2023-08-25T03:48:06.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-sch311x.ko 2023-08-25T03:48:06.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-tps65912.ko 2023-08-25T03:48:06.390 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-twl4030.ko 2023-08-25T03:48:06.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-twl6040.ko 2023-08-25T03:48:06.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-25T03:48:06.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-vx855.ko 2023-08-25T03:48:06.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-wm831x.ko 2023-08-25T03:48:06.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-wm8350.ko 2023-08-25T03:48:06.391 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-wm8994.ko 2023-08-25T03:48:06.391 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/ 2023-08-25T03:48:06.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-a4tech.ko 2023-08-25T03:48:06.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-apple.ko 2023-08-25T03:48:06.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-appleir.ko 2023-08-25T03:48:06.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-aureal.ko 2023-08-25T03:48:06.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-axff.ko 2023-08-25T03:48:06.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-belkin.ko 2023-08-25T03:48:06.392 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-cherry.ko 2023-08-25T03:48:06.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-chicony.ko 2023-08-25T03:48:06.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-cp2112.ko 2023-08-25T03:48:06.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-cypress.ko 2023-08-25T03:48:06.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-dr.ko 2023-08-25T03:48:06.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-elecom.ko 2023-08-25T03:48:06.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-elo.ko 2023-08-25T03:48:06.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-emsff.ko 2023-08-25T03:48:06.393 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-ezkey.ko 2023-08-25T03:48:06.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gaff.ko 2023-08-25T03:48:06.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-generic.ko 2023-08-25T03:48:06.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gt683r.ko 2023-08-25T03:48:06.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gyration.ko 2023-08-25T03:48:06.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-25T03:48:06.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-25T03:48:06.394 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtekff.ko 2023-08-25T03:48:06.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-hyperv.ko 2023-08-25T03:48:06.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-icade.ko 2023-08-25T03:48:06.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-kensington.ko 2023-08-25T03:48:06.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-keytouch.ko 2023-08-25T03:48:06.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-kye.ko 2023-08-25T03:48:06.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-lcpower.ko 2023-08-25T03:48:06.395 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-led.ko 2023-08-25T03:48:06.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-lenovo.ko 2023-08-25T03:48:06.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30769 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-lg-g15.ko 2023-08-25T03:48:06.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-25T03:48:06.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 101017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-25T03:48:06.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 81025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-logitech.ko 2023-08-25T03:48:06.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-magicmouse.ko 2023-08-25T03:48:06.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-microsoft.ko 2023-08-25T03:48:06.396 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-monterey.ko 2023-08-25T03:48:06.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-multitouch.ko 2023-08-25T03:48:06.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-ntrig.ko 2023-08-25T03:48:06.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-ortek.ko 2023-08-25T03:48:06.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-penmount.ko 2023-08-25T03:48:06.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-petalynx.ko 2023-08-25T03:48:06.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 72969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-picolcd.ko 2023-08-25T03:48:06.397 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-pl.ko 2023-08-25T03:48:06.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-plantronics.ko 2023-08-25T03:48:06.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-primax.ko 2023-08-25T03:48:06.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-rmi.ko 2023-08-25T03:48:06.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20769 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-25T03:48:06.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-common.ko 2023-08-25T03:48:06.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-25T03:48:06.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-25T03:48:06.398 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-25T03:48:06.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-25T03:48:06.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-25T03:48:06.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-25T03:48:06.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-25T03:48:06.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-25T03:48:06.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-25T03:48:06.399 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat.ko 2023-08-25T03:48:06.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-saitek.ko 2023-08-25T03:48:06.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-samsung.ko 2023-08-25T03:48:06.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-25T03:48:06.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sjoy.ko 2023-08-25T03:48:06.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sony.ko 2023-08-25T03:48:06.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-speedlink.ko 2023-08-25T03:48:06.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-steelseries.ko 2023-08-25T03:48:06.400 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sunplus.ko 2023-08-25T03:48:06.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-25T03:48:06.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-tivo.ko 2023-08-25T03:48:06.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-tmff.ko 2023-08-25T03:48:06.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-topseed.ko 2023-08-25T03:48:06.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-twinhan.ko 2023-08-25T03:48:06.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 71481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-uclogic.ko 2023-08-25T03:48:06.401 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-waltop.ko 2023-08-25T03:48:06.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 143609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-wiimote.ko 2023-08-25T03:48:06.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-xinmo.ko 2023-08-25T03:48:06.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-zpff.ko 2023-08-25T03:48:06.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-zydacron.ko 2023-08-25T03:48:06.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 267721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid.ko 2023-08-25T03:48:06.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/uhid.ko 2023-08-25T03:48:06.402 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/usbhid/ 2023-08-25T03:48:06.402 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 125737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/usbhid/usbhid.ko 2023-08-25T03:48:06.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/usbhid/usbkbd.ko 2023-08-25T03:48:06.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/usbhid/usbmouse.ko 2023-08-25T03:48:06.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 217417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/wacom.ko 2023-08-25T03:48:06.403 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/ 2023-08-25T03:48:06.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 63505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_balloon.ko 2023-08-25T03:48:06.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_utils.ko 2023-08-25T03:48:06.403 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 301489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_vmbus.ko 2023-08-25T03:48:06.403 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ 2023-08-25T03:48:06.404 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/abituguru.ko 2023-08-25T03:48:06.404 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/abituguru3.ko 2023-08-25T03:48:06.404 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-25T03:48:06.404 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ad7414.ko 2023-08-25T03:48:06.404 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ad7418.ko 2023-08-25T03:48:06.404 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adc128d818.ko 2023-08-25T03:48:06.404 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1025.ko 2023-08-25T03:48:06.405 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 97985 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1026.ko 2023-08-25T03:48:06.405 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1029.ko 2023-08-25T03:48:06.405 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1031.ko 2023-08-25T03:48:06.405 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm9240.ko 2023-08-25T03:48:06.405 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ads7828.ko 2023-08-25T03:48:06.405 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7410.ko 2023-08-25T03:48:06.405 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7411.ko 2023-08-25T03:48:06.405 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 74441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7462.ko 2023-08-25T03:48:06.406 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7470.ko 2023-08-25T03:48:06.406 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7475.ko 2023-08-25T03:48:06.406 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7x10.ko 2023-08-25T03:48:06.406 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/amc6821.ko 2023-08-25T03:48:06.406 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/applesmc.ko 2023-08-25T03:48:06.406 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asb100.ko 2023-08-25T03:48:06.406 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asc7621.ko 2023-08-25T03:48:06.407 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-25T03:48:06.407 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/atxp1.ko 2023-08-25T03:48:06.407 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/coretemp.ko 2023-08-25T03:48:06.407 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/da9052-hwmon.ko 2023-08-25T03:48:06.407 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/da9055-hwmon.ko 2023-08-25T03:48:06.407 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-25T03:48:06.407 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 99609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/dme1737.ko 2023-08-25T03:48:06.407 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ds1621.ko 2023-08-25T03:48:06.408 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ds620.ko 2023-08-25T03:48:06.408 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29785 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/emc1403.ko 2023-08-25T03:48:06.408 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/emc2103.ko 2023-08-25T03:48:06.408 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/emc6w201.ko 2023-08-25T03:48:06.408 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f71805f.ko 2023-08-25T03:48:06.408 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 94465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f71882fg.ko 2023-08-25T03:48:06.408 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f75375s.ko 2023-08-25T03:48:06.409 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/fam15h_power.ko 2023-08-25T03:48:06.409 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/fschmd.ko 2023-08-25T03:48:06.409 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/g760a.ko 2023-08-25T03:48:06.409 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/g762.ko 2023-08-25T03:48:06.409 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/gl518sm.ko 2023-08-25T03:48:06.409 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/gl520sm.ko 2023-08-25T03:48:06.409 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/hih6130.ko 2023-08-25T03:48:06.409 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-25T03:48:06.410 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/i5500_temp.ko 2023-08-25T03:48:06.410 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/i5k_amb.ko 2023-08-25T03:48:06.410 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ibmaem.ko 2023-08-25T03:48:06.410 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ibmpex.ko 2023-08-25T03:48:06.410 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ina209.ko 2023-08-25T03:48:06.410 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ina2xx.ko 2023-08-25T03:48:06.410 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 129225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/it87.ko 2023-08-25T03:48:06.411 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/jc42.ko 2023-08-25T03:48:06.411 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/k10temp.ko 2023-08-25T03:48:06.411 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/k8temp.ko 2023-08-25T03:48:06.411 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lineage-pem.ko 2023-08-25T03:48:06.411 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm63.ko 2023-08-25T03:48:06.411 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16769 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm73.ko 2023-08-25T03:48:06.411 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36785 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm75.ko 2023-08-25T03:48:06.411 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm77.ko 2023-08-25T03:48:06.412 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm78.ko 2023-08-25T03:48:06.412 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm80.ko 2023-08-25T03:48:06.412 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm83.ko 2023-08-25T03:48:06.412 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 72841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm85.ko 2023-08-25T03:48:06.412 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm87.ko 2023-08-25T03:48:06.412 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm90.ko 2023-08-25T03:48:06.412 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm92.ko 2023-08-25T03:48:06.412 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 108849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm93.ko 2023-08-25T03:48:06.413 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95234.ko 2023-08-25T03:48:06.413 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95241.ko 2023-08-25T03:48:06.413 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95245.ko 2023-08-25T03:48:06.413 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc2945.ko 2023-08-25T03:48:06.413 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4151.ko 2023-08-25T03:48:06.413 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4215.ko 2023-08-25T03:48:06.413 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4222.ko 2023-08-25T03:48:06.414 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4245.ko 2023-08-25T03:48:06.414 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4260.ko 2023-08-25T03:48:06.414 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4261.ko 2023-08-25T03:48:06.414 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max16065.ko 2023-08-25T03:48:06.414 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max1619.ko 2023-08-25T03:48:06.414 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max1668.ko 2023-08-25T03:48:06.414 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max197.ko 2023-08-25T03:48:06.414 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6639.ko 2023-08-25T03:48:06.415 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6650.ko 2023-08-25T03:48:06.415 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35785 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6697.ko 2023-08-25T03:48:06.415 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/mc13783-adc.ko 2023-08-25T03:48:06.415 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/mcp3021.ko 2023-08-25T03:48:06.415 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-08-25T03:48:06.415 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6683.ko 2023-08-25T03:48:06.415 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 116705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6775-core.ko 2023-08-25T03:48:06.415 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6775.ko 2023-08-25T03:48:06.416 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct7802.ko 2023-08-25T03:48:06.416 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 82345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pc87360.ko 2023-08-25T03:48:06.416 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pc87427.ko 2023-08-25T03:48:06.416 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pcf8591.ko 2023-08-25T03:48:06.416 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ 2023-08-25T03:48:06.416 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-25T03:48:06.416 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-25T03:48:06.417 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-25T03:48:06.417 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-25T03:48:06.417 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-25T03:48:06.417 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-25T03:48:06.417 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-25T03:48:06.417 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 81849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-25T03:48:06.417 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-25T03:48:06.417 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-25T03:48:06.418 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-25T03:48:06.418 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-25T03:48:06.418 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/powr1220.ko 2023-08-25T03:48:06.418 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch5627.ko 2023-08-25T03:48:06.418 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch5636.ko 2023-08-25T03:48:06.418 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-25T03:48:06.418 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sht15.ko 2023-08-25T03:48:06.419 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sht21.ko 2023-08-25T03:48:06.419 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/shtc1.ko 2023-08-25T03:48:06.419 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sis5595.ko 2023-08-25T03:48:06.419 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smm665.ko 2023-08-25T03:48:06.419 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47b397.ko 2023-08-25T03:48:06.419 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47m1.ko 2023-08-25T03:48:06.419 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47m192.ko 2023-08-25T03:48:06.419 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/thmc50.ko 2023-08-25T03:48:06.420 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp102.ko 2023-08-25T03:48:06.420 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp103.ko 2023-08-25T03:48:06.420 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp401.ko 2023-08-25T03:48:06.420 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp421.ko 2023-08-25T03:48:06.420 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/via-cputemp.ko 2023-08-25T03:48:06.420 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/via686a.ko 2023-08-25T03:48:06.420 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/vt1211.ko 2023-08-25T03:48:06.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/vt8231.ko 2023-08-25T03:48:06.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83627ehf.ko 2023-08-25T03:48:06.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83627hf.ko 2023-08-25T03:48:06.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 71353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83781d.ko 2023-08-25T03:48:06.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 63297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83791d.ko 2023-08-25T03:48:06.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 71329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83792d.ko 2023-08-25T03:48:06.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 101465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83793.ko 2023-08-25T03:48:06.421 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 119513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83795.ko 2023-08-25T03:48:06.422 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83l785ts.ko 2023-08-25T03:48:06.422 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83l786ng.ko 2023-08-25T03:48:06.422 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-08-25T03:48:06.422 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-08-25T03:48:06.422 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/ 2023-08-25T03:48:06.422 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos/ 2023-08-25T03:48:06.422 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-25T03:48:06.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-25T03:48:06.423 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/ 2023-08-25T03:48:06.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-08-25T03:48:06.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-08-25T03:48:06.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27785 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-08-25T03:48:06.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-25T03:48:06.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-25T03:48:06.423 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-25T03:48:06.424 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-08-25T03:48:06.424 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 6937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-25T03:48:06.424 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-08-25T03:48:06.424 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48649 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-25T03:48:06.424 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-25T03:48:06.424 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-25T03:48:06.424 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-25T03:48:06.425 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-08-25T03:48:06.425 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-08-25T03:48:06.425 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 62737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-25T03:48:06.425 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-25T03:48:06.425 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-25T03:48:06.425 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17377 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-08-25T03:48:06.425 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-25T03:48:06.425 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-25T03:48:06.426 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-08-25T03:48:06.426 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-25T03:48:06.426 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-25T03:48:06.426 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-25T03:48:06.426 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-08-25T03:48:06.426 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-25T03:48:06.426 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-25T03:48:06.427 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-08-25T03:48:06.427 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-08-25T03:48:06.427 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-25T03:48:06.427 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-08-25T03:48:06.427 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-25T03:48:06.427 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-25T03:48:06.427 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-25T03:48:06.427 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-25T03:48:06.428 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-08-25T03:48:06.428 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-mux.ko 2023-08-25T03:48:06.428 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-smbus.ko 2023-08-25T03:48:06.428 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-stub.ko 2023-08-25T03:48:06.428 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/muxes/ 2023-08-25T03:48:06.428 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-08-25T03:48:06.428 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-08-25T03:48:06.429 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-08-25T03:48:06.429 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ 2023-08-25T03:48:06.429 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ 2023-08-25T03:48:06.429 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 273657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-25T03:48:06.429 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 877041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_core.ko 2023-08-25T03:48:06.429 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 69329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-25T03:48:06.429 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 324249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-25T03:48:06.430 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 97977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-25T03:48:06.430 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 279361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-25T03:48:06.430 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-25T03:48:06.430 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/ 2023-08-25T03:48:06.430 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/cxgb4/ 2023-08-25T03:48:06.430 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 492625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-25T03:48:06.430 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx4/ 2023-08-25T03:48:06.430 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 419257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-25T03:48:06.431 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx5/ 2023-08-25T03:48:06.431 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 739833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-25T03:48:06.431 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mthca/ 2023-08-25T03:48:06.431 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 296745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-25T03:48:06.431 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/ocrdma/ 2023-08-25T03:48:06.431 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 153705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-08-25T03:48:06.431 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/usnic/ 2023-08-25T03:48:06.431 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 169065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-08-25T03:48:06.432 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/ 2023-08-25T03:48:06.432 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/ipoib/ 2023-08-25T03:48:06.432 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 263225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-25T03:48:06.432 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/iser/ 2023-08-25T03:48:06.432 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 100249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-25T03:48:06.432 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/isert/ 2023-08-25T03:48:06.432 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 112001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-25T03:48:06.433 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srp/ 2023-08-25T03:48:06.433 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 129089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-25T03:48:06.433 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srpt/ 2023-08-25T03:48:06.433 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 129561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-25T03:48:06.433 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/ 2023-08-25T03:48:06.433 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/evbug.ko 2023-08-25T03:48:06.433 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/ff-memless.ko 2023-08-25T03:48:06.433 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/ 2023-08-25T03:48:06.434 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-25T03:48:06.434 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-25T03:48:06.434 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/gameport.ko 2023-08-25T03:48:06.434 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/lightning.ko 2023-08-25T03:48:06.434 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/ns558.ko 2023-08-25T03:48:06.434 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/joydev.ko 2023-08-25T03:48:06.434 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/ 2023-08-25T03:48:06.435 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-08-25T03:48:06.435 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-08-25T03:48:06.435 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-08-25T03:48:06.435 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24769 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-08-25T03:48:06.435 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-25T03:48:06.435 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-08-25T03:48:06.435 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/lkkbd.ko 2023-08-25T03:48:06.435 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/lm8323.ko 2023-08-25T03:48:06.436 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/lm8333.ko 2023-08-25T03:48:06.436 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-08-25T03:48:06.436 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-08-25T03:48:06.436 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-08-25T03:48:06.436 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-08-25T03:48:06.436 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/newtonkbd.ko 2023-08-25T03:48:06.436 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-08-25T03:48:06.436 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/qt1070.ko 2023-08-25T03:48:06.437 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/qt2160.ko 2023-08-25T03:48:06.437 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-08-25T03:48:06.437 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/stowaway.ko 2023-08-25T03:48:06.437 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/sunkbd.ko 2023-08-25T03:48:06.437 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-08-25T03:48:06.437 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-08-25T03:48:06.437 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-08-25T03:48:06.438 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/xtkbd.ko 2023-08-25T03:48:06.438 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/matrix-keymap.ko 2023-08-25T03:48:06.438 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/ 2023-08-25T03:48:06.438 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/appletouch.ko 2023-08-25T03:48:06.438 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/bcm5974.ko 2023-08-25T03:48:06.438 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 123705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/cyapatp.ko 2023-08-25T03:48:06.438 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-25T03:48:06.438 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/gpio_mouse.ko 2023-08-25T03:48:06.439 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 335913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/psmouse.ko 2023-08-25T03:48:06.439 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/sermouse.ko 2023-08-25T03:48:06.439 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-25T03:48:06.439 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22577 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-25T03:48:06.439 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-25T03:48:06.439 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/rmi4/ 2023-08-25T03:48:06.439 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 109897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-25T03:48:06.440 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/ 2023-08-25T03:48:06.440 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/altera_ps2.ko 2023-08-25T03:48:06.440 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/arc_ps2.ko 2023-08-25T03:48:06.440 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/ct82c710.ko 2023-08-25T03:48:06.440 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-25T03:48:06.440 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/parkbd.ko 2023-08-25T03:48:06.440 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/pcips2.ko 2023-08-25T03:48:06.440 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/ps2mult.ko 2023-08-25T03:48:06.441 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/serio_raw.ko 2023-08-25T03:48:06.441 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17985 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/serport.ko 2023-08-25T03:48:06.441 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/sparse-keymap.ko 2023-08-25T03:48:06.441 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu/ 2023-08-25T03:48:06.441 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu/amd/ 2023-08-25T03:48:06.441 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-25T03:48:06.441 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/ 2023-08-25T03:48:06.441 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-88pm860x.ko 2023-08-25T03:48:06.442 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-adp5520.ko 2023-08-25T03:48:06.442 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-bd2802.ko 2023-08-25T03:48:06.442 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-blinkm.ko 2023-08-25T03:48:06.442 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-da903x.ko 2023-08-25T03:48:06.442 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-da9052.ko 2023-08-25T03:48:06.442 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-gpio.ko 2023-08-25T03:48:06.442 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lm3530.ko 2023-08-25T03:48:06.443 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lm3533.ko 2023-08-25T03:48:06.443 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lm355x.ko 2023-08-25T03:48:06.443 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lm3642.ko 2023-08-25T03:48:06.443 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lp3944.ko 2023-08-25T03:48:06.443 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lp8788.ko 2023-08-25T03:48:06.443 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-max8997.ko 2023-08-25T03:48:06.443 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-mc13783.ko 2023-08-25T03:48:06.443 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-menf21bmc.ko 2023-08-25T03:48:06.444 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-pca9532.ko 2023-08-25T03:48:06.444 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-pca955x.ko 2023-08-25T03:48:06.444 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-pca963x.ko 2023-08-25T03:48:06.444 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-ss4200.ko 2023-08-25T03:48:06.444 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-tca6507.ko 2023-08-25T03:48:06.444 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-wm831x-status.ko 2023-08-25T03:48:06.444 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-wm8350.ko 2023-08-25T03:48:06.444 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ 2023-08-25T03:48:06.445 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-25T03:48:06.445 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-25T03:48:06.445 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-25T03:48:06.445 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-25T03:48:06.445 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-25T03:48:06.445 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-25T03:48:06.445 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-25T03:48:06.446 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-25T03:48:06.446 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/ 2023-08-25T03:48:06.446 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/bcache/ 2023-08-25T03:48:06.446 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 655561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/bcache/bcache.ko 2023-08-25T03:48:06.446 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-bio-prison.ko 2023-08-25T03:48:06.446 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-bufio.ko 2023-08-25T03:48:06.446 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-cache-smq.ko 2023-08-25T03:48:06.446 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 156017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-cache.ko 2023-08-25T03:48:06.447 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 107057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-crypt.ko 2023-08-25T03:48:06.447 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-delay.ko 2023-08-25T03:48:06.447 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-era.ko 2023-08-25T03:48:06.447 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-flakey.ko 2023-08-25T03:48:06.447 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-log-userspace.ko 2023-08-25T03:48:06.447 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-log.ko 2023-08-25T03:48:06.447 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-mirror.ko 2023-08-25T03:48:06.448 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-multipath.ko 2023-08-25T03:48:06.448 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-queue-length.ko 2023-08-25T03:48:06.448 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-raid.ko 2023-08-25T03:48:06.449 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-region-hash.ko 2023-08-25T03:48:06.449 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-round-robin.ko 2023-08-25T03:48:06.449 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-service-time.ko 2023-08-25T03:48:06.449 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 109617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-snapshot.ko 2023-08-25T03:48:06.449 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-switch.ko 2023-08-25T03:48:06.449 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 181593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-thin-pool.ko 2023-08-25T03:48:06.449 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-verity.ko 2023-08-25T03:48:06.449 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-zero.ko 2023-08-25T03:48:06.450 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/faulty.ko 2023-08-25T03:48:06.450 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/linear.ko 2023-08-25T03:48:06.450 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/multipath.ko 2023-08-25T03:48:06.450 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/persistent-data/ 2023-08-25T03:48:06.450 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 199985 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-25T03:48:06.450 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid0.ko 2023-08-25T03:48:06.450 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 112617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid1.ko 2023-08-25T03:48:06.451 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 160561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid10.ko 2023-08-25T03:48:06.451 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 396169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid456.ko 2023-08-25T03:48:06.451 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/ 2023-08-25T03:48:06.451 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/ 2023-08-25T03:48:06.451 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 178121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptbase.ko 2023-08-25T03:48:06.451 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 63393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptctl.ko 2023-08-25T03:48:06.451 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptfc.ko 2023-08-25T03:48:06.451 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptlan.ko 2023-08-25T03:48:06.452 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 123361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptsas.ko 2023-08-25T03:48:06.452 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 79025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptscsih.ko 2023-08-25T03:48:06.452 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptspi.ko 2023-08-25T03:48:06.452 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/ 2023-08-25T03:48:06.452 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/88pm800.ko 2023-08-25T03:48:06.453 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12769 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/88pm805.ko 2023-08-25T03:48:06.453 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/88pm80x.ko 2023-08-25T03:48:06.453 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/arizona-i2c.ko 2023-08-25T03:48:06.453 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 123745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/arizona.ko 2023-08-25T03:48:06.453 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/bcm590xx.ko 2023-08-25T03:48:06.453 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/cros_ec_dev.ko 2023-08-25T03:48:06.454 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/dln2.ko 2023-08-25T03:48:06.454 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/janz-cmodio.ko 2023-08-25T03:48:06.454 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/kempld-core.ko 2023-08-25T03:48:06.454 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lm3533-core.ko 2023-08-25T03:48:06.454 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-08-25T03:48:06.454 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lp3943.ko 2023-08-25T03:48:06.454 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54577 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lpc_ich.ko 2023-08-25T03:48:06.454 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lpc_sch.ko 2023-08-25T03:48:06.455 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/max8907.ko 2023-08-25T03:48:06.455 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/mc13xxx-core.ko 2023-08-25T03:48:06.455 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-08-25T03:48:06.455 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/menf21bmc.ko 2023-08-25T03:48:06.455 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/pcf50633-adc.ko 2023-08-25T03:48:06.455 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/pcf50633-gpio.ko 2023-08-25T03:48:06.455 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/pcf50633.ko 2023-08-25T03:48:06.455 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-08-25T03:48:06.456 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/retu-mfd.ko 2023-08-25T03:48:06.456 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 80449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/si476x-core.ko 2023-08-25T03:48:06.456 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/sm501.ko 2023-08-25T03:48:06.456 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-08-25T03:48:06.456 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/tps65010.ko 2023-08-25T03:48:06.456 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/tps6507x.ko 2023-08-25T03:48:06.456 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/viperboard.ko 2023-08-25T03:48:06.457 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/vx855.ko 2023-08-25T03:48:06.457 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/wl1273-core.ko 2023-08-25T03:48:06.457 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/wm8994.ko 2023-08-25T03:48:06.457 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/ 2023-08-25T03:48:06.457 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-08-25T03:48:06.457 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/ad525x_dpot.ko 2023-08-25T03:48:06.457 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/altera-stapl/ 2023-08-25T03:48:06.457 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-25T03:48:06.458 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/apds9802als.ko 2023-08-25T03:48:06.458 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/apds990x.ko 2023-08-25T03:48:06.458 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/bh1770glc.ko 2023-08-25T03:48:06.458 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/c2port/ 2023-08-25T03:48:06.458 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-08-25T03:48:06.458 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/c2port/core.ko 2023-08-25T03:48:06.458 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/cb710/ 2023-08-25T03:48:06.458 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/cb710/cb710.ko 2023-08-25T03:48:06.459 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/ds1682.ko 2023-08-25T03:48:06.459 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/dummy-irq.ko 2023-08-25T03:48:06.459 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/echo/ 2023-08-25T03:48:06.459 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/echo/echo.ko 2023-08-25T03:48:06.459 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/ 2023-08-25T03:48:06.459 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/at24.ko 2023-08-25T03:48:06.459 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-25T03:48:06.460 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-25T03:48:06.460 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/max6875.ko 2023-08-25T03:48:06.460 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/enclosure.ko 2023-08-25T03:48:06.460 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/genwqe/ 2023-08-25T03:48:06.460 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 152169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-08-25T03:48:06.460 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/hmc6352.ko 2023-08-25T03:48:06.460 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/hpilo.ko 2023-08-25T03:48:06.460 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/ibmasm/ 2023-08-25T03:48:06.461 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 72657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-08-25T03:48:06.461 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/ics932s401.ko 2023-08-25T03:48:06.461 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/isl29003.ko 2023-08-25T03:48:06.461 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/isl29020.ko 2023-08-25T03:48:06.461 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d/ 2023-08-25T03:48:06.461 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-25T03:48:06.461 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-25T03:48:06.462 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/ 2023-08-25T03:48:06.462 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 125225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei-me.ko 2023-08-25T03:48:06.462 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 56537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei-txe.ko 2023-08-25T03:48:06.462 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 309905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei.ko 2023-08-25T03:48:06.462 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/phantom.ko 2023-08-25T03:48:06.462 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/ti-st/ 2023-08-25T03:48:06.462 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 74921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/ti-st/st_drv.ko 2023-08-25T03:48:06.462 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tifm_7xx1.ko 2023-08-25T03:48:06.463 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tifm_core.ko 2023-08-25T03:48:06.463 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tsl2550.ko 2023-08-25T03:48:06.463 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_balloon.ko 2023-08-25T03:48:06.463 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_vmci/ 2023-08-25T03:48:06.463 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 183913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-25T03:48:06.463 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ 2023-08-25T03:48:06.463 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/bonding/ 2023-08-25T03:48:06.464 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 487913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/bonding/bonding.ko 2023-08-25T03:48:06.464 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/ 2023-08-25T03:48:06.464 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/b53/ 2023-08-25T03:48:06.464 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 106017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-25T03:48:06.464 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-25T03:48:06.464 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-25T03:48:06.464 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6xxx/ 2023-08-25T03:48:06.464 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 452761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-25T03:48:06.465 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dummy.ko 2023-08-25T03:48:06.465 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/eql.ko 2023-08-25T03:48:06.465 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ 2023-08-25T03:48:06.465 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/ 2023-08-25T03:48:06.465 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-25T03:48:06.465 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-25T03:48:06.465 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 130497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-25T03:48:06.466 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 68793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-25T03:48:06.466 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/ 2023-08-25T03:48:06.466 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-25T03:48:06.466 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-25T03:48:06.466 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-25T03:48:06.466 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 99121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-25T03:48:06.466 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/adaptec/ 2023-08-25T03:48:06.466 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-25T03:48:06.467 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/agere/ 2023-08-25T03:48:06.467 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 69153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-25T03:48:06.467 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/alteon/ 2023-08-25T03:48:06.467 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-25T03:48:06.467 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/altera/ 2023-08-25T03:48:06.467 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-25T03:48:06.467 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/ 2023-08-25T03:48:06.468 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-25T03:48:06.468 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-25T03:48:06.468 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 87353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-25T03:48:06.468 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/ 2023-08-25T03:48:06.468 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/alx/ 2023-08-25T03:48:06.468 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 97345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-25T03:48:06.468 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-08-25T03:48:06.468 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 104625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-25T03:48:06.469 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-08-25T03:48:06.469 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 90281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-25T03:48:06.469 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx/ 2023-08-25T03:48:06.469 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 81513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-25T03:48:06.469 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 69721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-25T03:48:06.469 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/ 2023-08-25T03:48:06.469 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-25T03:48:06.469 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 176889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-25T03:48:06.470 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-08-25T03:48:06.470 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1422265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-25T03:48:06.524 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 128385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-25T03:48:06.524 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/genet/ 2023-08-25T03:48:06.524 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 132305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-25T03:48:06.525 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 312153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-25T03:48:06.525 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade/ 2023-08-25T03:48:06.525 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade/bna/ 2023-08-25T03:48:06.525 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 323601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-25T03:48:06.525 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/ 2023-08-25T03:48:06.525 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-08-25T03:48:06.525 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 193481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-25T03:48:06.526 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-08-25T03:48:06.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 347697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-25T03:48:06.526 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-08-25T03:48:06.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1044273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-25T03:48:06.526 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-08-25T03:48:06.526 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 166129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-25T03:48:06.526 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-08-25T03:48:06.527 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-25T03:48:06.527 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco/ 2023-08-25T03:48:06.527 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco/enic/ 2023-08-25T03:48:06.527 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 204401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-25T03:48:06.527 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/ 2023-08-25T03:48:06.527 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/ 2023-08-25T03:48:06.527 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 69457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-25T03:48:06.527 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-25T03:48:06.528 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 141209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-25T03:48:06.528 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-25T03:48:06.528 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 62873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-25T03:48:06.529 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-25T03:48:06.529 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink/ 2023-08-25T03:48:06.529 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-25T03:48:06.529 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 62841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-25T03:48:06.529 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dnet.ko 2023-08-25T03:48:06.529 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ec_bhf.ko 2023-08-25T03:48:06.529 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex/ 2023-08-25T03:48:06.530 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex/benet/ 2023-08-25T03:48:06.530 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 281353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-25T03:48:06.530 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ethoc.ko 2023-08-25T03:48:06.530 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/fealnx.ko 2023-08-25T03:48:06.530 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/fujitsu/ 2023-08-25T03:48:06.530 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-08-25T03:48:06.530 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ 2023-08-25T03:48:06.530 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 90473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-25T03:48:06.531 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000/ 2023-08-25T03:48:06.531 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 295737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-25T03:48:06.531 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000e/ 2023-08-25T03:48:06.531 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 584305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-25T03:48:06.531 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/fm10k/ 2023-08-25T03:48:06.531 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 246385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-25T03:48:06.531 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/i40e/ 2023-08-25T03:48:06.531 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 924105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-25T03:48:06.532 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/iavf/ 2023-08-25T03:48:06.532 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 302625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-25T03:48:06.532 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igb/ 2023-08-25T03:48:06.532 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 514937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-25T03:48:06.532 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igbvf/ 2023-08-25T03:48:06.532 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 93617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-25T03:48:06.532 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-08-25T03:48:06.533 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 734401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-25T03:48:06.533 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-08-25T03:48:06.533 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 151865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-25T03:48:06.533 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 86929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/jme.ko 2023-08-25T03:48:06.533 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/ 2023-08-25T03:48:06.533 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20985 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-25T03:48:06.533 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 102393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-25T03:48:06.534 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 122689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-25T03:48:06.534 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/ 2023-08-25T03:48:06.534 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-08-25T03:48:06.534 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 727545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-25T03:48:06.534 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 280569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-25T03:48:06.534 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-08-25T03:48:06.534 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-08-25T03:48:06.534 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1097769 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-25T03:48:06.535 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel/ 2023-08-25T03:48:06.535 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-08-25T03:48:06.535 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-08-25T03:48:06.535 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-08-25T03:48:06.535 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 95673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-25T03:48:06.535 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom/ 2023-08-25T03:48:06.535 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-08-25T03:48:06.536 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 108817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-25T03:48:06.536 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi/ 2023-08-25T03:48:06.536 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-25T03:48:06.536 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-25T03:48:06.536 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/neterion/ 2023-08-25T03:48:06.536 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 150913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-25T03:48:06.536 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/nvidia/ 2023-08-25T03:48:06.536 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 136793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-25T03:48:06.537 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines/ 2023-08-25T03:48:06.537 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-25T03:48:06.537 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-25T03:48:06.537 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/ 2023-08-25T03:48:06.537 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-08-25T03:48:06.537 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 227145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-25T03:48:06.537 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 87089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-25T03:48:06.537 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-08-25T03:48:06.538 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 671465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-25T03:48:06.538 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rdc/ 2023-08-25T03:48:06.538 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-25T03:48:06.538 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/ 2023-08-25T03:48:06.538 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-25T03:48:06.538 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 83929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-25T03:48:06.538 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-25T03:48:06.539 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 189833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-25T03:48:06.539 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/samsung/ 2023-08-25T03:48:06.539 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-08-25T03:48:06.539 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 104289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-08-25T03:48:06.539 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sfc/ 2023-08-25T03:48:06.539 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 953113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-25T03:48:06.539 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/silan/ 2023-08-25T03:48:06.539 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-25T03:48:06.540 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis/ 2023-08-25T03:48:06.540 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-25T03:48:06.540 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 63281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-25T03:48:06.540 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/ 2023-08-25T03:48:06.540 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-25T03:48:06.540 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-25T03:48:06.540 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-25T03:48:06.541 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 68217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-25T03:48:06.541 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/ 2023-08-25T03:48:06.541 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-08-25T03:48:06.541 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-08-25T03:48:06.541 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-25T03:48:06.541 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-08-25T03:48:06.541 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 481817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-25T03:48:06.541 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/ 2023-08-25T03:48:06.542 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 103329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-25T03:48:06.542 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 166129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-25T03:48:06.542 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-25T03:48:06.542 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-25T03:48:06.542 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/tehuti/ 2023-08-25T03:48:06.542 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-25T03:48:06.542 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ti/ 2023-08-25T03:48:06.543 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 86473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-25T03:48:06.543 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via/ 2023-08-25T03:48:06.543 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 80265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-25T03:48:06.543 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 83689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-25T03:48:06.543 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet/ 2023-08-25T03:48:06.543 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-25T03:48:06.543 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-25T03:48:06.543 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/xircom/ 2023-08-25T03:48:06.544 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-25T03:48:06.544 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/fddi/ 2023-08-25T03:48:06.544 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/fddi/defxx.ko 2023-08-25T03:48:06.544 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/fddi/skfp/ 2023-08-25T03:48:06.544 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 217065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/fddi/skfp/skfp.ko 2023-08-25T03:48:06.544 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 77409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/geneve.ko 2023-08-25T03:48:06.544 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/hyperv/ 2023-08-25T03:48:06.545 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 235625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-25T03:48:06.545 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ieee802154/ 2023-08-25T03:48:06.545 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-25T03:48:06.545 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ifb.ko 2023-08-25T03:48:06.545 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ipvlan/ 2023-08-25T03:48:06.545 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 84009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-25T03:48:06.545 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 62073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/macvlan.ko 2023-08-25T03:48:06.545 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/macvtap.ko 2023-08-25T03:48:06.546 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/ 2023-08-25T03:48:06.546 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-25T03:48:06.546 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-25T03:48:06.546 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-gpio.ko 2023-08-25T03:48:06.546 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-25T03:48:06.546 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio.ko 2023-08-25T03:48:06.546 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mii.ko 2023-08-25T03:48:06.546 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/netconsole.ko 2023-08-25T03:48:06.547 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/nlmon.ko 2023-08-25T03:48:06.547 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs/ 2023-08-25T03:48:06.547 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-25T03:48:06.547 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-25T03:48:06.547 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/ 2023-08-25T03:48:06.547 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/amd.ko 2023-08-25T03:48:06.547 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-25T03:48:06.548 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-25T03:48:06.548 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm87xx.ko 2023-08-25T03:48:06.548 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/broadcom.ko 2023-08-25T03:48:06.548 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/cicada.ko 2023-08-25T03:48:06.548 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/davicom.ko 2023-08-25T03:48:06.549 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/et1011c.ko 2023-08-25T03:48:06.550 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/icplus.ko 2023-08-25T03:48:06.550 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/lxt.ko 2023-08-25T03:48:06.550 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/marvell.ko 2023-08-25T03:48:06.550 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 75721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/micrel.ko 2023-08-25T03:48:06.550 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/national.ko 2023-08-25T03:48:06.550 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 97273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/phylink.ko 2023-08-25T03:48:06.551 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/qsemi.ko 2023-08-25T03:48:06.551 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/realtek.ko 2023-08-25T03:48:06.551 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/smsc.ko 2023-08-25T03:48:06.551 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/ste10Xp.ko 2023-08-25T03:48:06.551 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/vitesse.ko 2023-08-25T03:48:06.551 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/plip/ 2023-08-25T03:48:06.551 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/plip/plip.ko 2023-08-25T03:48:06.552 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ 2023-08-25T03:48:06.552 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-25T03:48:06.552 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_async.ko 2023-08-25T03:48:06.552 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-25T03:48:06.552 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-25T03:48:06.552 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-25T03:48:06.553 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pppoe.ko 2023-08-25T03:48:06.553 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pppox.ko 2023-08-25T03:48:06.553 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pptp.ko 2023-08-25T03:48:06.553 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/sb1000.ko 2023-08-25T03:48:06.553 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip/ 2023-08-25T03:48:06.553 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip/slip.ko 2023-08-25T03:48:06.554 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/sungem_phy.ko 2023-08-25T03:48:06.554 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 64945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/tap.ko 2023-08-25T03:48:06.554 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/ 2023-08-25T03:48:06.554 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 106033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team.ko 2023-08-25T03:48:06.554 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-25T03:48:06.554 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-25T03:48:06.554 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-25T03:48:06.555 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9649 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_random.ko 2023-08-25T03:48:06.555 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-25T03:48:06.555 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 88265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/veth.ko 2023-08-25T03:48:06.555 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vmxnet3/ 2023-08-25T03:48:06.555 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 120513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-25T03:48:06.555 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vxlan/ 2023-08-25T03:48:06.556 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 293465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vxlan/vxlan.ko 2023-08-25T03:48:06.556 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netback/ 2023-08-25T03:48:06.556 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 143921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-25T03:48:06.556 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ntb/ 2023-08-25T03:48:06.556 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ntb/ntb.ko 2023-08-25T03:48:06.556 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/ 2023-08-25T03:48:06.556 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host/ 2023-08-25T03:48:06.557 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 264617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host/nvme-core.ko 2023-08-25T03:48:06.557 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 102401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host/nvme.ko 2023-08-25T03:48:06.557 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/ 2023-08-25T03:48:06.558 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 133849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport.ko 2023-08-25T03:48:06.558 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_cs.ko 2023-08-25T03:48:06.558 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 84345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_pc.ko 2023-08-25T03:48:06.558 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_serial.ko 2023-08-25T03:48:06.558 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/ 2023-08-25T03:48:06.558 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/hotplug/ 2023-08-25T03:48:06.559 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-25T03:48:06.559 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-08-25T03:48:06.559 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-08-25T03:48:06.559 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/pci-stub.ko 2023-08-25T03:48:06.559 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/xen-pcifront.ko 2023-08-25T03:48:06.559 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/ 2023-08-25T03:48:06.559 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/i82092.ko 2023-08-25T03:48:06.560 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 145809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/pcmcia.ko 2023-08-25T03:48:06.560 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 62105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/pcmcia_core.ko 2023-08-25T03:48:06.560 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-08-25T03:48:06.560 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/pd6729.ko 2023-08-25T03:48:06.560 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 112921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-25T03:48:06.560 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/phy/ 2023-08-25T03:48:06.561 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/phy/broadcom/ 2023-08-25T03:48:06.561 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-08-25T03:48:06.561 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/phy/samsung/ 2023-08-25T03:48:06.561 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-08-25T03:48:06.561 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl/ 2023-08-25T03:48:06.561 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl/intel/ 2023-08-25T03:48:06.561 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 71529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-25T03:48:06.562 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/ 2023-08-25T03:48:06.562 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/chrome/ 2023-08-25T03:48:06.562 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-08-25T03:48:06.562 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/chrome/cros_ec.ko 2023-08-25T03:48:06.562 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-08-25T03:48:06.562 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-08-25T03:48:06.562 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-08-25T03:48:06.563 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-08-25T03:48:06.563 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-08-25T03:48:06.563 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/ 2023-08-25T03:48:06.563 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-25T03:48:06.563 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/acerhdf.ko 2023-08-25T03:48:06.564 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-25T03:48:06.564 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-25T03:48:06.564 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-25T03:48:06.564 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 106881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-25T03:48:06.564 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-25T03:48:06.564 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-25T03:48:06.565 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-25T03:48:06.565 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-25T03:48:06.565 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-25T03:48:06.565 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/hdaps.ko 2023-08-25T03:48:06.565 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/ibm_rtl.ko 2023-08-25T03:48:06.565 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel/ 2023-08-25T03:48:06.566 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-25T03:48:06.566 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-08-25T03:48:06.566 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel_ips.ko 2023-08-25T03:48:06.566 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-25T03:48:06.566 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-25T03:48:06.566 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-25T03:48:06.566 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-25T03:48:06.567 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-25T03:48:06.567 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-25T03:48:06.567 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-25T03:48:06.567 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-25T03:48:06.568 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-25T03:48:06.568 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/wmi.ko 2023-08-25T03:48:06.568 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/ 2023-08-25T03:48:06.568 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/ 2023-08-25T03:48:06.568 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/88pm860x_battery.ko 2023-08-25T03:48:06.569 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/88pm860x_charger.ko 2023-08-25T03:48:06.569 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/bq2415x_charger.ko 2023-08-25T03:48:06.569 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/bq24190_charger.ko 2023-08-25T03:48:06.569 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/bq24735-charger.ko 2023-08-25T03:48:06.569 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-08-25T03:48:06.569 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/da9030_battery.ko 2023-08-25T03:48:06.570 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/da9052-battery.ko 2023-08-25T03:48:06.570 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/ds2760_battery.ko 2023-08-25T03:48:06.570 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/ds2780_battery.ko 2023-08-25T03:48:06.570 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/ds2781_battery.ko 2023-08-25T03:48:06.571 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/ds2782_battery.ko 2023-08-25T03:48:06.571 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/gpio-charger.ko 2023-08-25T03:48:06.571 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/isp1704_charger.ko 2023-08-25T03:48:06.571 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/lp8727_charger.ko 2023-08-25T03:48:06.571 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/max14577_charger.ko 2023-08-25T03:48:06.571 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/max17040_battery.ko 2023-08-25T03:48:06.572 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/max17042_battery.ko 2023-08-25T03:48:06.572 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/max8903_charger.ko 2023-08-25T03:48:06.572 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/max8925_power.ko 2023-08-25T03:48:06.572 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/pcf50633-charger.ko 2023-08-25T03:48:06.572 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/sbs-battery.ko 2023-08-25T03:48:06.572 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/test_power.ko 2023-08-25T03:48:06.573 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/tps65090-charger.ko 2023-08-25T03:48:06.573 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/wm831x_backup.ko 2023-08-25T03:48:06.573 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/wm831x_power.ko 2023-08-25T03:48:06.573 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/wm8350_power.ko 2023-08-25T03:48:06.573 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap/ 2023-08-25T03:48:06.573 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-25T03:48:06.573 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-25T03:48:06.573 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/ 2023-08-25T03:48:06.574 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/ 2023-08-25T03:48:06.574 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-25T03:48:06.574 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-25T03:48:06.574 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps_parport.ko 2023-08-25T03:48:06.574 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/pps_core.ko 2023-08-25T03:48:06.574 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp/ 2023-08-25T03:48:06.575 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp/ptp.ko 2023-08-25T03:48:06.575 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp/ptp_kvm.ko 2023-08-25T03:48:06.575 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/ 2023-08-25T03:48:06.575 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-88pm80x.ko 2023-08-25T03:48:06.575 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-88pm860x.ko 2023-08-25T03:48:06.575 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-25T03:48:06.575 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-25T03:48:06.576 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-da9052.ko 2023-08-25T03:48:06.576 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-da9055.ko 2023-08-25T03:48:06.576 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-da9063.ko 2023-08-25T03:48:06.576 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-25T03:48:06.576 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 68585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-25T03:48:06.576 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-25T03:48:06.576 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-25T03:48:06.577 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-25T03:48:06.577 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-25T03:48:06.577 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13377 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-25T03:48:06.577 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-25T03:48:06.577 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-25T03:48:06.577 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-em3027.ko 2023-08-25T03:48:06.577 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-25T03:48:06.578 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-25T03:48:06.578 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-25T03:48:06.578 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-lp8788.ko 2023-08-25T03:48:06.578 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-25T03:48:06.578 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-25T03:48:06.578 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-25T03:48:06.578 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m48t86.ko 2023-08-25T03:48:06.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11641 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-max6900.ko 2023-08-25T03:48:06.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-max8907.ko 2023-08-25T03:48:06.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-max8925.ko 2023-08-25T03:48:06.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-max8997.ko 2023-08-25T03:48:06.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-max8998.ko 2023-08-25T03:48:06.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-08-25T03:48:06.579 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-25T03:48:06.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-palmas.ko 2023-08-25T03:48:06.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-25T03:48:06.580 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17985 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf50633.ko 2023-08-25T03:48:06.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-25T03:48:06.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-25T03:48:06.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-25T03:48:06.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-25T03:48:06.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rc5t583.ko 2023-08-25T03:48:06.581 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-25T03:48:06.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-25T03:48:06.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-25T03:48:06.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-25T03:48:06.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-25T03:48:06.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-s35390a.ko 2023-08-25T03:48:06.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-25T03:48:06.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-tps6586x.ko 2023-08-25T03:48:06.582 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-tps65910.ko 2023-08-25T03:48:06.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-wm831x.ko 2023-08-25T03:48:06.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-wm8350.ko 2023-08-25T03:48:06.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-x1205.ko 2023-08-25T03:48:06.583 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ 2023-08-25T03:48:06.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 77625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-9xxx.ko 2023-08-25T03:48:06.583 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-sas.ko 2023-08-25T03:48:06.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-xxxx.ko 2023-08-25T03:48:06.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 135177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/BusLogic.ko 2023-08-25T03:48:06.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/a100u2w.ko 2023-08-25T03:48:06.584 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aacraid/ 2023-08-25T03:48:06.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 272409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-25T03:48:06.584 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 100625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/advansys.ko 2023-08-25T03:48:06.585 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx/ 2023-08-25T03:48:06.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 356297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-25T03:48:06.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 295841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-25T03:48:06.585 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic94xx/ 2023-08-25T03:48:06.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 189377 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-08-25T03:48:06.585 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/am53c974.ko 2023-08-25T03:48:06.586 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/arcmsr/ 2023-08-25T03:48:06.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 106585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-25T03:48:06.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/atp870u.ko 2023-08-25T03:48:06.586 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/be2iscsi/ 2023-08-25T03:48:06.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 246921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-25T03:48:06.586 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bfa/ 2023-08-25T03:48:06.586 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1172289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bfa/bfa.ko 2023-08-25T03:48:06.587 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2fc/ 2023-08-25T03:48:06.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 237201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-25T03:48:06.587 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2i/ 2023-08-25T03:48:06.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 115417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-25T03:48:06.587 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ch.ko 2023-08-25T03:48:06.587 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/csiostor/ 2023-08-25T03:48:06.588 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 308945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-25T03:48:06.588 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/ 2023-08-25T03:48:06.588 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-08-25T03:48:06.588 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 76201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-25T03:48:06.588 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-08-25T03:48:06.588 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 101457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-25T03:48:06.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 146793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-25T03:48:06.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 75537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/dc395x.ko 2023-08-25T03:48:06.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/dmx3191d.ko 2023-08-25T03:48:06.589 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esas2r/ 2023-08-25T03:48:06.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 212457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-25T03:48:06.589 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esp_scsi.ko 2023-08-25T03:48:06.590 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe/ 2023-08-25T03:48:06.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-25T03:48:06.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 158209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-25T03:48:06.590 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fdomain.ko 2023-08-25T03:48:06.591 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fnic/ 2023-08-25T03:48:06.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 262801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fnic/fnic.ko 2023-08-25T03:48:06.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 201801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hpsa.ko 2023-08-25T03:48:06.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hptiop.ko 2023-08-25T03:48:06.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hv_storvsc.ko 2023-08-25T03:48:06.591 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/imm.ko 2023-08-25T03:48:06.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/initio.ko 2023-08-25T03:48:06.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 266529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ipr.ko 2023-08-25T03:48:06.592 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 101889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ips.ko 2023-08-25T03:48:06.592 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/isci/ 2023-08-25T03:48:06.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 317313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/isci/isci.ko 2023-08-25T03:48:06.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-25T03:48:06.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-25T03:48:06.593 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libfc/ 2023-08-25T03:48:06.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 315009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libfc/libfc.ko 2023-08-25T03:48:06.593 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 145577 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libiscsi.ko 2023-08-25T03:48:06.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-25T03:48:06.594 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libsas/ 2023-08-25T03:48:06.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 217265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libsas/libsas.ko 2023-08-25T03:48:06.594 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/lpfc/ 2023-08-25T03:48:06.594 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 2192665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-25T03:48:06.595 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/ 2023-08-25T03:48:06.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-25T03:48:06.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-25T03:48:06.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 310753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-25T03:48:06.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 84705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid.ko 2023-08-25T03:48:06.595 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mpt3sas/ 2023-08-25T03:48:06.595 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 659561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-25T03:48:06.596 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvsas/ 2023-08-25T03:48:06.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 119953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-25T03:48:06.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvumi.ko 2023-08-25T03:48:06.596 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pcmcia/ 2023-08-25T03:48:06.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 81609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-08-25T03:48:06.596 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-08-25T03:48:06.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-08-25T03:48:06.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-08-25T03:48:06.597 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pm8001/ 2023-08-25T03:48:06.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 364289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-25T03:48:06.597 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 123497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pmcraid.ko 2023-08-25T03:48:06.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ppa.ko 2023-08-25T03:48:06.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla1280.ko 2023-08-25T03:48:06.598 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx/ 2023-08-25T03:48:06.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1860289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-25T03:48:06.598 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 85321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-25T03:48:06.599 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla4xxx/ 2023-08-25T03:48:06.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 558921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-25T03:48:06.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qlogicfas408.ko 2023-08-25T03:48:06.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/raid_class.ko 2023-08-25T03:48:06.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 238809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_debug.ko 2023-08-25T03:48:06.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 173929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-25T03:48:06.599 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 278873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-25T03:48:06.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 97713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-25T03:48:06.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-25T03:48:06.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-25T03:48:06.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ses.ko 2023-08-25T03:48:06.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 115857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/st.ko 2023-08-25T03:48:06.600 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/stex.ko 2023-08-25T03:48:06.600 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/sym53c8xx_2/ 2023-08-25T03:48:06.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 162153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-25T03:48:06.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/virtio_scsi.ko 2023-08-25T03:48:06.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-25T03:48:06.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/wd719x.ko 2023-08-25T03:48:06.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/xen-scsifront.ko 2023-08-25T03:48:06.601 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ssb/ 2023-08-25T03:48:06.601 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 129465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ssb/ssb.ko 2023-08-25T03:48:06.602 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/ 2023-08-25T03:48:06.602 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/iscsi/ 2023-08-25T03:48:06.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 739185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-25T03:48:06.602 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/loopback/ 2023-08-25T03:48:06.602 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-25T03:48:06.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_file.ko 2023-08-25T03:48:06.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_iblock.ko 2023-08-25T03:48:06.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 931809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_mod.ko 2023-08-25T03:48:06.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_pscsi.ko 2023-08-25T03:48:06.603 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 122553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_user.ko 2023-08-25T03:48:06.603 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/tcm_fc/ 2023-08-25T03:48:06.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 75665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-25T03:48:06.604 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/ 2023-08-25T03:48:06.604 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/ 2023-08-25T03:48:06.604 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/ 2023-08-25T03:48:06.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-25T03:48:06.604 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-25T03:48:06.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-25T03:48:06.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-25T03:48:06.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-25T03:48:06.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-25T03:48:06.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-25T03:48:06.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-25T03:48:06.605 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-25T03:48:06.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-25T03:48:06.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-25T03:48:06.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-25T03:48:06.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-08-25T03:48:06.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-25T03:48:06.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-25T03:48:06.606 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-25T03:48:06.607 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/ 2023-08-25T03:48:06.607 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/ipwireless/ 2023-08-25T03:48:06.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-25T03:48:06.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/moxa.ko 2023-08-25T03:48:06.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 50801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/mxser.ko 2023-08-25T03:48:06.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 107553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/n_gsm.ko 2023-08-25T03:48:06.607 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/n_hdlc.ko 2023-08-25T03:48:06.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 68145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/nozomi.ko 2023-08-25T03:48:06.608 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/ 2023-08-25T03:48:06.608 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/8250/ 2023-08-25T03:48:06.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-08-25T03:48:06.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-25T03:48:06.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-08-25T03:48:06.608 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/altera_uart.ko 2023-08-25T03:48:06.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/arc_uart.ko 2023-08-25T03:48:06.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 72201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-08-25T03:48:06.609 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/jsm/ 2023-08-25T03:48:06.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 103041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-25T03:48:06.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/rp2.ko 2023-08-25T03:48:06.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/sc16is7xx.ko 2023-08-25T03:48:06.609 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 100193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/synclink_gt.ko 2023-08-25T03:48:06.610 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/ 2023-08-25T03:48:06.610 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/core/ 2023-08-25T03:48:06.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 536833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-25T03:48:06.610 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/host/ 2023-08-25T03:48:06.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-25T03:48:06.610 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-08-25T03:48:06.610 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/ 2023-08-25T03:48:06.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio.ko 2023-08-25T03:48:06.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_aec.ko 2023-08-25T03:48:06.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_cif.ko 2023-08-25T03:48:06.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_dmem_genirq.ko 2023-08-25T03:48:06.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_mf624.ko 2023-08-25T03:48:06.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_netx.ko 2023-08-25T03:48:06.611 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_pci_generic.ko 2023-08-25T03:48:06.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-08-25T03:48:06.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13641 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_sercos3.ko 2023-08-25T03:48:06.612 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/ 2023-08-25T03:48:06.612 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/c67x00/ 2023-08-25T03:48:06.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/c67x00/c67x00.ko 2023-08-25T03:48:06.612 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/chipidea/ 2023-08-25T03:48:06.612 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 143825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-08-25T03:48:06.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-08-25T03:48:06.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-08-25T03:48:06.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-08-25T03:48:06.613 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/ 2023-08-25T03:48:06.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 85465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/cdc-acm.ko 2023-08-25T03:48:06.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-25T03:48:06.613 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/usblp.ko 2023-08-25T03:48:06.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/usbtmc.ko 2023-08-25T03:48:06.614 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/common/ 2023-08-25T03:48:06.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/common/ulpi.ko 2023-08-25T03:48:06.614 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/dwc2/ 2023-08-25T03:48:06.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-08-25T03:48:06.614 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/dwc3/ 2023-08-25T03:48:06.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-08-25T03:48:06.614 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-08-25T03:48:06.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 445257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/dwc3/dwc3.ko 2023-08-25T03:48:06.615 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/ 2023-08-25T03:48:06.615 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/ 2023-08-25T03:48:06.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/u_ether.ko 2023-08-25T03:48:06.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/u_serial.ko 2023-08-25T03:48:06.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-08-25T03:48:06.615 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-08-25T03:48:06.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-08-25T03:48:06.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-08-25T03:48:06.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 92385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-08-25T03:48:06.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-08-25T03:48:06.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 122081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-08-25T03:48:06.616 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-08-25T03:48:06.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-08-25T03:48:06.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-08-25T03:48:06.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-08-25T03:48:06.617 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 85849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-08-25T03:48:06.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-08-25T03:48:06.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-08-25T03:48:06.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-08-25T03:48:06.618 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/ 2023-08-25T03:48:06.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-08-25T03:48:06.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-08-25T03:48:06.618 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-08-25T03:48:06.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-08-25T03:48:06.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-08-25T03:48:06.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-08-25T03:48:06.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-08-25T03:48:06.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16985 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-08-25T03:48:06.619 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-08-25T03:48:06.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-08-25T03:48:06.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-08-25T03:48:06.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-08-25T03:48:06.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 62161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-08-25T03:48:06.620 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-08-25T03:48:06.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 161361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/libcomposite.ko 2023-08-25T03:48:06.621 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/ 2023-08-25T03:48:06.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-08-25T03:48:06.621 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/bdc/ 2023-08-25T03:48:06.621 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 157689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-08-25T03:48:06.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-08-25T03:48:06.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-08-25T03:48:06.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 69697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-08-25T03:48:06.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 56017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-08-25T03:48:06.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 76041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/net2272.ko 2023-08-25T03:48:06.622 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 75065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/net2280.ko 2023-08-25T03:48:06.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-08-25T03:48:06.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 65801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-08-25T03:48:06.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-08-25T03:48:06.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 81497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-08-25T03:48:06.623 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 156073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-08-25T03:48:06.623 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/ 2023-08-25T03:48:06.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/bcma-hcd.ko 2023-08-25T03:48:06.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 80105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/isp116x-hcd.ko 2023-08-25T03:48:06.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 87345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-08-25T03:48:06.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-08-25T03:48:06.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-25T03:48:06.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/sl811_cs.ko 2023-08-25T03:48:06.624 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/ssb-hcd.ko 2023-08-25T03:48:06.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-08-25T03:48:06.625 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image/ 2023-08-25T03:48:06.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image/mdc800.ko 2023-08-25T03:48:06.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image/microtek.ko 2023-08-25T03:48:06.625 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/ 2023-08-25T03:48:06.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/adutux.ko 2023-08-25T03:48:06.625 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/appledisplay.ko 2023-08-25T03:48:06.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-08-25T03:48:06.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/cytherm.ko 2023-08-25T03:48:06.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/ehset.ko 2023-08-25T03:48:06.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/emi26.ko 2023-08-25T03:48:06.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/emi62.ko 2023-08-25T03:48:06.626 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/ezusb.ko 2023-08-25T03:48:06.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/idmouse.ko 2023-08-25T03:48:06.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/iowarrior.ko 2023-08-25T03:48:06.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-25T03:48:06.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/ldusb.ko 2023-08-25T03:48:06.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/legousbtower.ko 2023-08-25T03:48:06.627 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/lvstest.ko 2023-08-25T03:48:06.628 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/sisusbvga/ 2023-08-25T03:48:06.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 64849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-25T03:48:06.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-25T03:48:06.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usb3503.ko 2023-08-25T03:48:06.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usblcd.ko 2023-08-25T03:48:06.628 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-25T03:48:06.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usbtest.ko 2023-08-25T03:48:06.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/uss720.ko 2023-08-25T03:48:06.629 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/yurex.ko 2023-08-25T03:48:06.629 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/mon/ 2023-08-25T03:48:06.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/mon/usbmon.ko 2023-08-25T03:48:06.630 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/musb/ 2023-08-25T03:48:06.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 301561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/musb/musb_hdrc.ko 2023-08-25T03:48:06.630 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy/ 2023-08-25T03:48:06.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy/phy-generic.ko 2023-08-25T03:48:06.630 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-08-25T03:48:06.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy/phy-isp1301.ko 2023-08-25T03:48:06.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy/phy-tahvo.ko 2023-08-25T03:48:06.631 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ 2023-08-25T03:48:06.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/aircable.ko 2023-08-25T03:48:06.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ark3116.ko 2023-08-25T03:48:06.631 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-25T03:48:06.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ch341.ko 2023-08-25T03:48:06.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 70217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cp210x.ko 2023-08-25T03:48:06.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cyberjack.ko 2023-08-25T03:48:06.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-25T03:48:06.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-25T03:48:06.632 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/empeg.ko 2023-08-25T03:48:06.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/f81232.ko 2023-08-25T03:48:06.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 175153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-25T03:48:06.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-25T03:48:06.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 137113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-25T03:48:06.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 124681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/io_ti.ko 2023-08-25T03:48:06.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ipaq.ko 2023-08-25T03:48:06.633 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ipw.ko 2023-08-25T03:48:06.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ir-usb.ko 2023-08-25T03:48:06.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 57945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-25T03:48:06.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 107425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/keyspan.ko 2023-08-25T03:48:06.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-25T03:48:06.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-25T03:48:06.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-25T03:48:06.634 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mct_u232.ko 2023-08-25T03:48:06.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/metro-usb.ko 2023-08-25T03:48:06.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mos7720.ko 2023-08-25T03:48:06.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 78121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mos7840.ko 2023-08-25T03:48:06.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 56601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mxuport.ko 2023-08-25T03:48:06.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/navman.ko 2023-08-25T03:48:06.635 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/omninet.ko 2023-08-25T03:48:06.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/opticon.ko 2023-08-25T03:48:06.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 190241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/option.ko 2023-08-25T03:48:06.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/oti6858.ko 2023-08-25T03:48:06.636 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/pl2303.ko 2023-08-25T03:48:06.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/qcaux.ko 2023-08-25T03:48:06.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/qcserial.ko 2023-08-25T03:48:06.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/quatech2.ko 2023-08-25T03:48:06.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/safe_serial.ko 2023-08-25T03:48:06.637 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 51305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/sierra.ko 2023-08-25T03:48:06.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-25T03:48:06.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ssu100.ko 2023-08-25T03:48:06.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/symbolserial.ko 2023-08-25T03:48:06.638 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-25T03:48:06.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-25T03:48:06.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb_debug.ko 2023-08-25T03:48:06.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-25T03:48:06.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 125529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usbserial.ko 2023-08-25T03:48:06.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/visor.ko 2023-08-25T03:48:06.639 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/whiteheat.ko 2023-08-25T03:48:06.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/wishbone-serial.ko 2023-08-25T03:48:06.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-25T03:48:06.640 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ 2023-08-25T03:48:06.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/uas.ko 2023-08-25T03:48:06.640 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-25T03:48:06.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-25T03:48:06.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-25T03:48:06.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-25T03:48:06.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-25T03:48:06.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-25T03:48:06.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-25T03:48:06.641 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-karma.ko 2023-08-25T03:48:06.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-25T03:48:06.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-25T03:48:06.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-25T03:48:06.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-25T03:48:06.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-25T03:48:06.642 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 180057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/usb-storage.ko 2023-08-25T03:48:06.643 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/ 2023-08-25T03:48:06.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-25T03:48:06.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 71369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-25T03:48:06.643 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 105425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-25T03:48:06.644 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/ 2023-08-25T03:48:06.644 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci/ 2023-08-25T03:48:06.644 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 153721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-25T03:48:06.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-25T03:48:06.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 100601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/vfio.ko 2023-08-25T03:48:06.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 75145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-25T03:48:06.645 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/ 2023-08-25T03:48:06.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 113897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost.ko 2023-08-25T03:48:06.645 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-25T03:48:06.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_net.ko 2023-08-25T03:48:06.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_scsi.ko 2023-08-25T03:48:06.646 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/ 2023-08-25T03:48:06.646 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/ 2023-08-25T03:48:06.646 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-08-25T03:48:06.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/aat2870_bl.ko 2023-08-25T03:48:06.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/adp5520_bl.ko 2023-08-25T03:48:06.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/adp8860_bl.ko 2023-08-25T03:48:06.647 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/adp8870_bl.ko 2023-08-25T03:48:06.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/apple_bl.ko 2023-08-25T03:48:06.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16785 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/as3711_bl.ko 2023-08-25T03:48:06.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/bd6107.ko 2023-08-25T03:48:06.648 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/da903x_bl.ko 2023-08-25T03:48:06.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/da9052_bl.ko 2023-08-25T03:48:06.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/gpio_backlight.ko 2023-08-25T03:48:06.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/kb3886_bl.ko 2023-08-25T03:48:06.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/lcd.ko 2023-08-25T03:48:06.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/lm3533_bl.ko 2023-08-25T03:48:06.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/lm3639_bl.ko 2023-08-25T03:48:06.649 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/lv5207lp.ko 2023-08-25T03:48:06.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/max8925_bl.ko 2023-08-25T03:48:06.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/pandora_bl.ko 2023-08-25T03:48:06.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-08-25T03:48:06.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-25T03:48:06.650 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/wm831x_bl.ko 2023-08-25T03:48:06.650 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/ 2023-08-25T03:48:06.650 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/ 2023-08-25T03:48:06.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/ds2482.ko 2023-08-25T03:48:06.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/ds2490.ko 2023-08-25T03:48:06.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/matrox_w1.ko 2023-08-25T03:48:06.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/w1-gpio.ko 2023-08-25T03:48:06.651 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/ 2023-08-25T03:48:06.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-25T03:48:06.651 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-25T03:48:06.652 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-25T03:48:06.652 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-25T03:48:06.652 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-25T03:48:06.652 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-25T03:48:06.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-25T03:48:06.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-25T03:48:06.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-25T03:48:06.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-25T03:48:06.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 56433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-25T03:48:06.653 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 102689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/wire.ko 2023-08-25T03:48:06.654 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ 2023-08-25T03:48:06.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/acquirewdt.ko 2023-08-25T03:48:06.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19985 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/advantechwdt.ko 2023-08-25T03:48:06.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-25T03:48:06.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-25T03:48:06.654 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/cpu5wdt.ko 2023-08-25T03:48:06.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/da9052_wdt.ko 2023-08-25T03:48:06.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12785 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/da9055_wdt.ko 2023-08-25T03:48:06.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/da9063_wdt.ko 2023-08-25T03:48:06.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/dw_wdt.ko 2023-08-25T03:48:06.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/eurotechwdt.ko 2023-08-25T03:48:06.655 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-25T03:48:06.656 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/hpwdt.ko 2023-08-25T03:48:06.656 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/i6300esb.ko 2023-08-25T03:48:06.656 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-25T03:48:06.656 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-25T03:48:06.656 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ib700wdt.ko 2023-08-25T03:48:06.656 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ibmasr.ko 2023-08-25T03:48:06.657 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-25T03:48:06.657 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-25T03:48:06.657 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/it87_wdt.ko 2023-08-25T03:48:06.657 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/kempld_wdt.ko 2023-08-25T03:48:06.657 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/machzwd.ko 2023-08-25T03:48:06.658 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/mena21_wdt.ko 2023-08-25T03:48:06.658 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-08-25T03:48:06.658 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/nv_tco.ko 2023-08-25T03:48:06.658 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-08-25T03:48:06.658 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/pc87413_wdt.ko 2023-08-25T03:48:06.659 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-25T03:48:06.659 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-25T03:48:06.659 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/retu_wdt.ko 2023-08-25T03:48:06.659 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-08-25T03:48:06.659 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-08-25T03:48:06.660 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-25T03:48:06.660 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sc1200wdt.ko 2023-08-25T03:48:06.660 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-25T03:48:06.660 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-08-25T03:48:06.660 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/softdog.ko 2023-08-25T03:48:06.660 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-25T03:48:06.660 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/twl4030_wdt.ko 2023-08-25T03:48:06.661 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/via_wdt.ko 2023-08-25T03:48:06.661 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-25T03:48:06.661 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-25T03:48:06.661 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-25T03:48:06.662 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/wafer5823wdt.ko 2023-08-25T03:48:06.662 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/wdt_pci.ko 2023-08-25T03:48:06.662 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/wm831x_wdt.ko 2023-08-25T03:48:06.662 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/wm8350_wdt.ko 2023-08-25T03:48:06.662 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/xen_wdt.ko 2023-08-25T03:48:06.663 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/ 2023-08-25T03:48:06.663 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-evtchn.ko 2023-08-25T03:48:06.663 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-gntalloc.ko 2023-08-25T03:48:06.663 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-gntdev.ko 2023-08-25T03:48:06.663 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-pciback/ 2023-08-25T03:48:06.664 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 176465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-25T03:48:06.664 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-privcmd.ko 2023-08-25T03:48:06.664 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 71329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-scsiback.ko 2023-08-25T03:48:06.664 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xenfs/ 2023-08-25T03:48:06.664 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-25T03:48:06.665 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ 2023-08-25T03:48:06.665 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/9p/ 2023-08-25T03:48:06.665 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 165689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/9p/9p.ko 2023-08-25T03:48:06.665 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/adfs/ 2023-08-25T03:48:06.665 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/adfs/adfs.ko 2023-08-25T03:48:06.666 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/affs/ 2023-08-25T03:48:06.666 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 162657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/affs/affs.ko 2023-08-25T03:48:06.666 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/afs/ 2023-08-25T03:48:06.666 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 932105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/afs/kafs.ko 2023-08-25T03:48:06.666 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/autofs/ 2023-08-25T03:48:06.667 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 100977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/autofs/autofs4.ko 2023-08-25T03:48:06.667 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/befs/ 2023-08-25T03:48:06.667 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 64521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/befs/befs.ko 2023-08-25T03:48:06.667 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/bfs/ 2023-08-25T03:48:06.667 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/bfs/bfs.ko 2023-08-25T03:48:06.667 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/binfmt_misc.ko 2023-08-25T03:48:06.668 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/btrfs/ 2023-08-25T03:48:06.668 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 3474545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/btrfs/btrfs.ko 2023-08-25T03:48:06.668 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cachefiles/ 2023-08-25T03:48:06.669 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 305793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cachefiles/cachefiles.ko 2023-08-25T03:48:06.669 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ceph/ 2023-08-25T03:48:06.669 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1316241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ceph/ceph.ko 2023-08-25T03:48:06.669 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/coda/ 2023-08-25T03:48:06.669 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 100561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/coda/coda.ko 2023-08-25T03:48:06.669 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/configfs/ 2023-08-25T03:48:06.669 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 108105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/configfs/configfs.ko 2023-08-25T03:48:06.670 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cramfs/ 2023-08-25T03:48:06.670 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 29289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cramfs/cramfs.ko 2023-08-25T03:48:06.670 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/dlm/ 2023-08-25T03:48:06.670 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 633913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/dlm/dlm.ko 2023-08-25T03:48:06.670 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/efs/ 2023-08-25T03:48:06.670 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/efs/efs.ko 2023-08-25T03:48:06.670 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/f2fs/ 2023-08-25T03:48:06.671 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1500617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/f2fs/f2fs.ko 2023-08-25T03:48:06.671 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/ 2023-08-25T03:48:06.671 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/msdos.ko 2023-08-25T03:48:06.671 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/freevxfs/ 2023-08-25T03:48:06.671 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/freevxfs/freevxfs.ko 2023-08-25T03:48:06.671 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fscache/ 2023-08-25T03:48:06.671 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 226545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fscache/fscache.ko 2023-08-25T03:48:06.671 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse/ 2023-08-25T03:48:06.672 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse/cuse.ko 2023-08-25T03:48:06.672 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/gfs2/ 2023-08-25T03:48:06.672 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1226505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/gfs2/gfs2.ko 2023-08-25T03:48:06.672 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfs/ 2023-08-25T03:48:06.672 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 141321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfs/hfs.ko 2023-08-25T03:48:06.672 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfsplus/ 2023-08-25T03:48:06.672 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 221657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfsplus/hfsplus.ko 2023-08-25T03:48:06.673 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hpfs/ 2023-08-25T03:48:06.673 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 193649 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hpfs/hpfs.ko 2023-08-25T03:48:06.673 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/isofs/ 2023-08-25T03:48:06.673 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 74441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/isofs/isofs.ko 2023-08-25T03:48:06.673 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/jfs/ 2023-08-25T03:48:06.673 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 421217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/jfs/jfs.ko 2023-08-25T03:48:06.673 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/lockd/ 2023-08-25T03:48:06.674 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 279129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/lockd/lockd.ko 2023-08-25T03:48:06.674 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/minix/ 2023-08-25T03:48:06.674 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 87873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/minix/minix.ko 2023-08-25T03:48:06.674 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/netfs/ 2023-08-25T03:48:06.674 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 124729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/netfs/netfs.ko 2023-08-25T03:48:06.674 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/ 2023-08-25T03:48:06.674 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/blocklayout/ 2023-08-25T03:48:06.675 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 81545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-25T03:48:06.675 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/filelayout/ 2023-08-25T03:48:06.675 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-25T03:48:06.675 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/flexfilelayout/ 2023-08-25T03:48:06.675 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 117713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-25T03:48:06.675 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1054001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfs.ko 2023-08-25T03:48:06.675 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfsv2.ko 2023-08-25T03:48:06.676 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 119825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfsv3.ko 2023-08-25T03:48:06.676 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 2041929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfsv4.ko 2023-08-25T03:48:06.676 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common/ 2023-08-25T03:48:06.676 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common/grace.ko 2023-08-25T03:48:06.676 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common/nfs_acl.ko 2023-08-25T03:48:06.676 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfsd/ 2023-08-25T03:48:06.676 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1505041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfsd/nfsd.ko 2023-08-25T03:48:06.677 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nilfs2/ 2023-08-25T03:48:06.677 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 591521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nilfs2/nilfs2.ko 2023-08-25T03:48:06.677 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/ 2023-08-25T03:48:06.677 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-celtic.ko 2023-08-25T03:48:06.677 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-centeuro.ko 2023-08-25T03:48:06.677 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-croatian.ko 2023-08-25T03:48:06.677 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-cyrillic.ko 2023-08-25T03:48:06.678 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-gaelic.ko 2023-08-25T03:48:06.678 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-greek.ko 2023-08-25T03:48:06.678 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-iceland.ko 2023-08-25T03:48:06.678 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-inuit.ko 2023-08-25T03:48:06.678 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-roman.ko 2023-08-25T03:48:06.678 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-romanian.ko 2023-08-25T03:48:06.678 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-turkish.ko 2023-08-25T03:48:06.678 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_ascii.ko 2023-08-25T03:48:06.679 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1250.ko 2023-08-25T03:48:06.679 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1251.ko 2023-08-25T03:48:06.679 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1255.ko 2023-08-25T03:48:06.679 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp737.ko 2023-08-25T03:48:06.679 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp775.ko 2023-08-25T03:48:06.679 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp850.ko 2023-08-25T03:48:06.679 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp852.ko 2023-08-25T03:48:06.680 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp855.ko 2023-08-25T03:48:06.680 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp857.ko 2023-08-25T03:48:06.680 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp860.ko 2023-08-25T03:48:06.680 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp861.ko 2023-08-25T03:48:06.681 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp862.ko 2023-08-25T03:48:06.681 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp863.ko 2023-08-25T03:48:06.681 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp864.ko 2023-08-25T03:48:06.681 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp865.ko 2023-08-25T03:48:06.681 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp866.ko 2023-08-25T03:48:06.681 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp869.ko 2023-08-25T03:48:06.681 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp874.ko 2023-08-25T03:48:06.682 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 94145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp932.ko 2023-08-25T03:48:06.682 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 142681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp936.ko 2023-08-25T03:48:06.682 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 165753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp949.ko 2023-08-25T03:48:06.682 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 118129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp950.ko 2023-08-25T03:48:06.682 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_euc-jp.ko 2023-08-25T03:48:06.682 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-1.ko 2023-08-25T03:48:06.682 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-13.ko 2023-08-25T03:48:06.683 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-14.ko 2023-08-25T03:48:06.683 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-15.ko 2023-08-25T03:48:06.683 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-2.ko 2023-08-25T03:48:06.683 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-3.ko 2023-08-25T03:48:06.683 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-4.ko 2023-08-25T03:48:06.683 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-5.ko 2023-08-25T03:48:06.683 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-6.ko 2023-08-25T03:48:06.683 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-7.ko 2023-08-25T03:48:06.684 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-9.ko 2023-08-25T03:48:06.684 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-r.ko 2023-08-25T03:48:06.684 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-ru.ko 2023-08-25T03:48:06.684 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-u.ko 2023-08-25T03:48:06.684 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_utf8.ko 2023-08-25T03:48:06.684 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ntfs/ 2023-08-25T03:48:06.684 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 219449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ntfs/ntfs.ko 2023-08-25T03:48:06.684 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ 2023-08-25T03:48:06.685 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/cluster/ 2023-08-25T03:48:06.685 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 244217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-25T03:48:06.685 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlm/ 2023-08-25T03:48:06.685 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 440833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-25T03:48:06.685 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlmfs/ 2023-08-25T03:48:06.685 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-25T03:48:06.685 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 2590041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2.ko 2023-08-25T03:48:06.686 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-25T03:48:06.686 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-25T03:48:06.686 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-25T03:48:06.686 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/omfs/ 2023-08-25T03:48:06.686 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 52593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/omfs/omfs.ko 2023-08-25T03:48:06.686 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/overlayfs/ 2023-08-25T03:48:06.686 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 336945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/overlayfs/overlay.ko 2023-08-25T03:48:06.686 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/pstore/ 2023-08-25T03:48:06.687 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/pstore/ramoops.ko 2023-08-25T03:48:06.687 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/qnx4/ 2023-08-25T03:48:06.687 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/qnx4/qnx4.ko 2023-08-25T03:48:06.687 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/qnx6/ 2023-08-25T03:48:06.687 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 46673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/qnx6/qnx6.ko 2023-08-25T03:48:06.688 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/quota/ 2023-08-25T03:48:06.688 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/quota/quota_tree.ko 2023-08-25T03:48:06.688 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/quota/quota_v1.ko 2023-08-25T03:48:06.688 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/quota/quota_v2.ko 2023-08-25T03:48:06.688 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/reiserfs/ 2023-08-25T03:48:06.688 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 530825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/reiserfs/reiserfs.ko 2023-08-25T03:48:06.688 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/romfs/ 2023-08-25T03:48:06.689 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/romfs/romfs.ko 2023-08-25T03:48:06.689 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/ 2023-08-25T03:48:06.689 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/client/ 2023-08-25T03:48:06.689 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 2661417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/client/cifs.ko 2023-08-25T03:48:06.689 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common/ 2023-08-25T03:48:06.689 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common/cifs_arc4.ko 2023-08-25T03:48:06.689 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common/cifs_md4.ko 2023-08-25T03:48:06.689 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/squashfs/ 2023-08-25T03:48:06.690 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 134417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/squashfs/squashfs.ko 2023-08-25T03:48:06.690 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/sysv/ 2023-08-25T03:48:06.690 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/sysv/sysv.ko 2023-08-25T03:48:06.690 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/udf/ 2023-08-25T03:48:06.690 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 248129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/udf/udf.ko 2023-08-25T03:48:06.690 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ufs/ 2023-08-25T03:48:06.690 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 160905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ufs/ufs.ko 2023-08-25T03:48:06.690 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/xfs/ 2023-08-25T03:48:06.691 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 3998649 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/xfs/xfs.ko 2023-08-25T03:48:06.717 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/ 2023-08-25T03:48:06.718 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/locking/ 2023-08-25T03:48:06.718 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 74873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/locking/locktorture.ko 2023-08-25T03:48:06.718 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/time/ 2023-08-25T03:48:06.718 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/time/test_udelay.ko 2023-08-25T03:48:06.718 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 58481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/torture.ko 2023-08-25T03:48:06.718 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ 2023-08-25T03:48:06.718 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 6841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crc-itu-t.ko 2023-08-25T03:48:06.718 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 6537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crc7.ko 2023-08-25T03:48:06.719 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crc8.ko 2023-08-25T03:48:06.719 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto/ 2023-08-25T03:48:06.719 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto/libarc4.ko 2023-08-25T03:48:06.719 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto/libdes.ko 2023-08-25T03:48:06.719 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/interval_tree_test.ko 2023-08-25T03:48:06.719 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/libcrc32c.ko 2023-08-25T03:48:06.719 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lru_cache.ko 2023-08-25T03:48:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4/ 2023-08-25T03:48:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4/lz4_compress.ko 2023-08-25T03:48:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22641 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4/lz4hc_compress.ko 2023-08-25T03:48:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/math/ 2023-08-25T03:48:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 6625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/math/cordic.ko 2023-08-25T03:48:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/memory-notifier-error-inject.ko 2023-08-25T03:48:06.720 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/notifier-error-inject.ko 2023-08-25T03:48:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/percpu_test.ko 2023-08-25T03:48:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/pm-notifier-error-inject.ko 2023-08-25T03:48:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/raid6/ 2023-08-25T03:48:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 143521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/raid6/raid6_pq.ko 2023-08-25T03:48:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/rbtree_test.ko 2023-08-25T03:48:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/reed_solomon/ 2023-08-25T03:48:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-25T03:48:06.721 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/test-kstrtox.ko 2023-08-25T03:48:06.722 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/test-string_helpers.ko 2023-08-25T03:48:06.722 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 4760833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/test_bpf.ko 2023-08-25T03:48:06.722 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/test_firmware.ko 2023-08-25T03:48:06.722 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 6377 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/test_module.ko 2023-08-25T03:48:06.722 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/test_user_copy.ko 2023-08-25T03:48:06.722 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_bm.ko 2023-08-25T03:48:06.722 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_fsm.ko 2023-08-25T03:48:06.722 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_kmp.ko 2023-08-25T03:48:06.723 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/xz/ 2023-08-25T03:48:06.723 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/xz/xz_dec_test.ko 2023-08-25T03:48:06.723 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/mm/ 2023-08-25T03:48:06.723 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/mm/hwpoison-inject.ko 2023-08-25T03:48:06.723 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ 2023-08-25T03:48:06.723 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/ 2023-08-25T03:48:06.723 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/6lowpan.ko 2023-08-25T03:48:06.723 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_dest.ko 2023-08-25T03:48:06.724 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_fragment.ko 2023-08-25T03:48:06.724 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_hop.ko 2023-08-25T03:48:06.724 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 6993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-25T03:48:06.724 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_mobility.ko 2023-08-25T03:48:06.724 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_routing.ko 2023-08-25T03:48:06.724 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_udp.ko 2023-08-25T03:48:06.724 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/ 2023-08-25T03:48:06.725 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/garp.ko 2023-08-25T03:48:06.725 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/mrp.ko 2023-08-25T03:48:06.725 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/p8022.ko 2023-08-25T03:48:06.725 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/psnap.ko 2023-08-25T03:48:06.725 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/stp.ko 2023-08-25T03:48:06.725 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/8021q/ 2023-08-25T03:48:06.725 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 81049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/8021q/8021q.ko 2023-08-25T03:48:06.726 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/ 2023-08-25T03:48:06.726 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 198489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet.ko 2023-08-25T03:48:06.726 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_fd.ko 2023-08-25T03:48:06.726 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_rdma.ko 2023-08-25T03:48:06.726 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_virtio.ko 2023-08-25T03:48:06.726 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/batman-adv/ 2023-08-25T03:48:06.726 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 652673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/batman-adv/batman-adv.ko 2023-08-25T03:48:06.726 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/ 2023-08-25T03:48:06.727 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 63833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/br_netfilter.ko 2023-08-25T03:48:06.727 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 772633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/bridge.ko 2023-08-25T03:48:06.727 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ 2023-08-25T03:48:06.727 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-25T03:48:06.727 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-25T03:48:06.727 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-25T03:48:06.727 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-25T03:48:06.727 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-25T03:48:06.728 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-25T03:48:06.728 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-25T03:48:06.728 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-25T03:48:06.728 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-25T03:48:06.728 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-25T03:48:06.728 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-25T03:48:06.728 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-25T03:48:06.729 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-25T03:48:06.729 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-25T03:48:06.729 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-25T03:48:06.729 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-25T03:48:06.729 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-25T03:48:06.729 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-25T03:48:06.729 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-25T03:48:06.729 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-25T03:48:06.730 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 55945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtables.ko 2023-08-25T03:48:06.730 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-25T03:48:06.730 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-25T03:48:06.730 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ceph/ 2023-08-25T03:48:06.730 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1047057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ceph/libceph.ko 2023-08-25T03:48:06.730 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core/ 2023-08-25T03:48:06.730 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 124801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core/pktgen.ko 2023-08-25T03:48:06.731 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/ 2023-08-25T03:48:06.731 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 194385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp.ko 2023-08-25T03:48:06.731 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_diag.ko 2023-08-25T03:48:06.731 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 56953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_ipv4.ko 2023-08-25T03:48:06.731 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 59465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_ipv6.ko 2023-08-25T03:48:06.731 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/ 2023-08-25T03:48:06.731 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 390353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/dsa_core.ko 2023-08-25T03:48:06.731 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_brcm.ko 2023-08-25T03:48:06.732 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_dsa.ko 2023-08-25T03:48:06.732 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_none.ko 2023-08-25T03:48:06.732 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_trailer.ko 2023-08-25T03:48:06.732 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/hsr/ 2023-08-25T03:48:06.732 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 100297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/hsr/hsr.ko 2023-08-25T03:48:06.732 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/ 2023-08-25T03:48:06.732 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/6lowpan/ 2023-08-25T03:48:06.732 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 45193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-25T03:48:06.733 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 254649 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/ieee802154.ko 2023-08-25T03:48:06.733 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-25T03:48:06.733 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ 2023-08-25T03:48:06.733 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ah4.ko 2023-08-25T03:48:06.733 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/esp4.ko 2023-08-25T03:48:06.733 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/fou.ko 2023-08-25T03:48:06.733 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/gre.ko 2023-08-25T03:48:06.734 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/inet_diag.ko 2023-08-25T03:48:06.734 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 60601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_gre.ko 2023-08-25T03:48:06.734 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_tunnel.ko 2023-08-25T03:48:06.734 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_vti.ko 2023-08-25T03:48:06.734 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ipcomp.ko 2023-08-25T03:48:06.734 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ipip.ko 2023-08-25T03:48:06.734 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ 2023-08-25T03:48:06.734 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-25T03:48:06.735 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-25T03:48:06.735 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-25T03:48:06.735 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ip_tables.ko 2023-08-25T03:48:06.735 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-25T03:48:06.735 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-08-25T03:48:06.735 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-25T03:48:06.735 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-25T03:48:06.735 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-25T03:48:06.736 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-08-25T03:48:06.736 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-25T03:48:06.736 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-25T03:48:06.736 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-25T03:48:06.736 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-25T03:48:06.736 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-25T03:48:06.736 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-25T03:48:06.737 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-25T03:48:06.737 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-25T03:48:06.737 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-25T03:48:06.737 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-08-25T03:48:06.737 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-25T03:48:06.737 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-25T03:48:06.737 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-25T03:48:06.737 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-25T03:48:06.738 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-25T03:48:06.738 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_bic.ko 2023-08-25T03:48:06.738 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_dctcp.ko 2023-08-25T03:48:06.738 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_diag.ko 2023-08-25T03:48:06.738 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_highspeed.ko 2023-08-25T03:48:06.738 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_htcp.ko 2023-08-25T03:48:06.738 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_hybla.ko 2023-08-25T03:48:06.739 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_illinois.ko 2023-08-25T03:48:06.739 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_lp.ko 2023-08-25T03:48:06.739 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_scalable.ko 2023-08-25T03:48:06.739 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_vegas.ko 2023-08-25T03:48:06.739 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_veno.ko 2023-08-25T03:48:06.739 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_westwood.ko 2023-08-25T03:48:06.739 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_yeah.ko 2023-08-25T03:48:06.739 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tunnel4.ko 2023-08-25T03:48:06.740 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/udp_diag.ko 2023-08-25T03:48:06.740 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 41585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/udp_tunnel.ko 2023-08-25T03:48:06.740 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-25T03:48:06.740 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ 2023-08-25T03:48:06.740 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ah6.ko 2023-08-25T03:48:06.740 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/esp6.ko 2023-08-25T03:48:06.740 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/fou6.ko 2023-08-25T03:48:06.741 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 80801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_gre.ko 2023-08-25T03:48:06.741 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 92825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_tunnel.ko 2023-08-25T03:48:06.741 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-25T03:48:06.741 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_vti.ko 2023-08-25T03:48:06.741 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ipcomp6.ko 2023-08-25T03:48:06.741 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/mip6.ko 2023-08-25T03:48:06.741 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ 2023-08-25T03:48:06.741 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 42217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-25T03:48:06.742 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-08-25T03:48:06.742 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-25T03:48:06.742 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-25T03:48:06.742 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-25T03:48:06.742 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-25T03:48:06.742 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-25T03:48:06.742 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-25T03:48:06.743 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-25T03:48:06.743 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-25T03:48:06.743 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-25T03:48:06.743 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-25T03:48:06.743 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-25T03:48:06.743 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-25T03:48:06.743 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-25T03:48:06.743 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-25T03:48:06.744 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-25T03:48:06.744 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-25T03:48:06.744 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-25T03:48:06.744 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-25T03:48:06.744 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-25T03:48:06.744 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-25T03:48:06.744 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9641 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-25T03:48:06.744 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-25T03:48:06.745 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-25T03:48:06.745 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 73169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/sit.ko 2023-08-25T03:48:06.745 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/tunnel6.ko 2023-08-25T03:48:06.745 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-25T03:48:06.745 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/key/ 2023-08-25T03:48:06.745 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 82937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/key/af_key.ko 2023-08-25T03:48:06.745 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/ 2023-08-25T03:48:06.746 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 125881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_core.ko 2023-08-25T03:48:06.746 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-25T03:48:06.746 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 25873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_eth.ko 2023-08-25T03:48:06.746 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ip.ko 2023-08-25T03:48:06.746 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ip6.ko 2023-08-25T03:48:06.746 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_netlink.ko 2023-08-25T03:48:06.746 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 53161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ppp.ko 2023-08-25T03:48:06.746 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/lapb/ 2023-08-25T03:48:06.747 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/lapb/lapb.ko 2023-08-25T03:48:06.747 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/llc/ 2023-08-25T03:48:06.747 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/llc/llc.ko 2023-08-25T03:48:06.747 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 267329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/llc/llc2.ko 2023-08-25T03:48:06.747 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mac802154/ 2023-08-25T03:48:06.747 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 291105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mac802154/mac802154.ko 2023-08-25T03:48:06.747 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mpls/ 2023-08-25T03:48:06.747 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mpls/mpls_gso.ko 2023-08-25T03:48:06.748 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ 2023-08-25T03:48:06.748 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ 2023-08-25T03:48:06.748 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 119665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set.ko 2023-08-25T03:48:06.748 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-25T03:48:06.748 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-25T03:48:06.748 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-25T03:48:06.748 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 102041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-25T03:48:06.749 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 103129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-25T03:48:06.749 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 104601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-25T03:48:06.749 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 105137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-25T03:48:06.749 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 114401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-25T03:48:06.749 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-25T03:48:06.749 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 111169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-25T03:48:06.749 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 114681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-25T03:48:06.749 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 114337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-25T03:48:06.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 113225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-25T03:48:06.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 116225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-25T03:48:06.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-25T03:48:06.750 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ 2023-08-25T03:48:06.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 412969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-25T03:48:06.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-25T03:48:06.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-25T03:48:06.750 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-25T03:48:06.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-25T03:48:06.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-25T03:48:06.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-25T03:48:06.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-25T03:48:06.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-25T03:48:06.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-25T03:48:06.751 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-25T03:48:06.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-25T03:48:06.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-25T03:48:06.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-25T03:48:06.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conncount.ko 2023-08-25T03:48:06.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 408777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack.ko 2023-08-25T03:48:06.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-25T03:48:06.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-25T03:48:06.752 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33769 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-25T03:48:06.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 118153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-25T03:48:06.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-25T03:48:06.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-25T03:48:06.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 108401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-25T03:48:06.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-25T03:48:06.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-25T03:48:06.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 66649 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-25T03:48:06.753 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-25T03:48:06.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-25T03:48:06.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-25T03:48:06.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 88529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_flow_table.ko 2023-08-25T03:48:06.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-25T03:48:06.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 37137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_log_syslog.ko 2023-08-25T03:48:06.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 95385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat.ko 2023-08-25T03:48:06.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-25T03:48:06.754 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-25T03:48:06.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_irc.ko 2023-08-25T03:48:06.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_sip.ko 2023-08-25T03:48:06.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-25T03:48:06.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 44033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-25T03:48:06.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 609385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_tables.ko 2023-08-25T03:48:06.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink.ko 2023-08-25T03:48:06.755 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-25T03:48:06.756 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-08-25T03:48:06.756 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 39913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_log.ko 2023-08-25T03:48:06.756 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-25T03:48:06.756 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 49681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-25T03:48:06.756 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_chain_nat.ko 2023-08-25T03:48:06.756 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_compat.ko 2023-08-25T03:48:06.756 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 40729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_ct.ko 2023-08-25T03:48:06.756 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-25T03:48:06.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_fib.ko 2023-08-25T03:48:06.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-25T03:48:06.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_hash.ko 2023-08-25T03:48:06.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_limit.ko 2023-08-25T03:48:06.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_log.ko 2023-08-25T03:48:06.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_masq.ko 2023-08-25T03:48:06.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_nat.ko 2023-08-25T03:48:06.757 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_numgen.ko 2023-08-25T03:48:06.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_osf.ko 2023-08-25T03:48:06.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_queue.ko 2023-08-25T03:48:06.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_redir.ko 2023-08-25T03:48:06.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_reject.ko 2023-08-25T03:48:06.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_reject_inet.ko 2023-08-25T03:48:06.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_socket.ko 2023-08-25T03:48:06.758 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_synproxy.ko 2023-08-25T03:48:06.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_tproxy.ko 2023-08-25T03:48:06.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 89337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/x_tables.ko 2023-08-25T03:48:06.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_AUDIT.ko 2023-08-25T03:48:06.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9641 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-25T03:48:06.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-25T03:48:06.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-25T03:48:06.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 18177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CT.ko 2023-08-25T03:48:06.759 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_DSCP.ko 2023-08-25T03:48:06.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_HL.ko 2023-08-25T03:48:06.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_HMARK.ko 2023-08-25T03:48:06.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-25T03:48:06.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_LED.ko 2023-08-25T03:48:06.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_LOG.ko 2023-08-25T03:48:06.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-25T03:48:06.760 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NETMAP.ko 2023-08-25T03:48:06.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NFLOG.ko 2023-08-25T03:48:06.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-25T03:48:06.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_RATEEST.ko 2023-08-25T03:48:06.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-25T03:48:06.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 14345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_SECMARK.ko 2023-08-25T03:48:06.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-25T03:48:06.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-25T03:48:06.761 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17377 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TEE.ko 2023-08-25T03:48:06.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TPROXY.ko 2023-08-25T03:48:06.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TRACE.ko 2023-08-25T03:48:06.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_addrtype.ko 2023-08-25T03:48:06.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_bpf.ko 2023-08-25T03:48:06.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cgroup.ko 2023-08-25T03:48:06.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cluster.ko 2023-08-25T03:48:06.762 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_comment.ko 2023-08-25T03:48:06.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connbytes.ko 2023-08-25T03:48:06.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connlabel.ko 2023-08-25T03:48:06.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connlimit.ko 2023-08-25T03:48:06.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connmark.ko 2023-08-25T03:48:06.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_conntrack.ko 2023-08-25T03:48:06.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cpu.ko 2023-08-25T03:48:06.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_dccp.ko 2023-08-25T03:48:06.763 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_devgroup.ko 2023-08-25T03:48:06.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_dscp.ko 2023-08-25T03:48:06.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ecn.ko 2023-08-25T03:48:06.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_esp.ko 2023-08-25T03:48:06.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_hashlimit.ko 2023-08-25T03:48:06.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_helper.ko 2023-08-25T03:48:06.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_hl.ko 2023-08-25T03:48:06.764 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ipcomp.ko 2023-08-25T03:48:06.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_iprange.ko 2023-08-25T03:48:06.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ipvs.ko 2023-08-25T03:48:06.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_l2tp.ko 2023-08-25T03:48:06.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_length.ko 2023-08-25T03:48:06.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_limit.ko 2023-08-25T03:48:06.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_mac.ko 2023-08-25T03:48:06.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8649 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_mark.ko 2023-08-25T03:48:06.765 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_multiport.ko 2023-08-25T03:48:06.766 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_nat.ko 2023-08-25T03:48:06.766 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_nfacct.ko 2023-08-25T03:48:06.766 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_osf.ko 2023-08-25T03:48:06.766 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_owner.ko 2023-08-25T03:48:06.766 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_physdev.ko 2023-08-25T03:48:06.766 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7641 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_pkttype.ko 2023-08-25T03:48:06.766 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_policy.ko 2023-08-25T03:48:06.766 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_quota.ko 2023-08-25T03:48:06.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_rateest.ko 2023-08-25T03:48:06.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_realm.ko 2023-08-25T03:48:06.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_recent.ko 2023-08-25T03:48:06.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_sctp.ko 2023-08-25T03:48:06.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_set.ko 2023-08-25T03:48:06.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_socket.ko 2023-08-25T03:48:06.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_state.ko 2023-08-25T03:48:06.767 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_statistic.ko 2023-08-25T03:48:06.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_string.ko 2023-08-25T03:48:06.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 8561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_tcpmss.ko 2023-08-25T03:48:06.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15785 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_tcpudp.ko 2023-08-25T03:48:06.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_time.ko 2023-08-25T03:48:06.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_u32.ko 2023-08-25T03:48:06.768 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netlink/ 2023-08-25T03:48:06.768 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netlink/netlink_diag.ko 2023-08-25T03:48:06.769 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/nsh/ 2023-08-25T03:48:06.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 12433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/nsh/nsh.ko 2023-08-25T03:48:06.769 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/ 2023-08-25T03:48:06.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 379609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/openvswitch.ko 2023-08-25T03:48:06.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-geneve.ko 2023-08-25T03:48:06.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-gre.ko 2023-08-25T03:48:06.769 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 11801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-vxlan.ko 2023-08-25T03:48:06.769 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/packet/ 2023-08-25T03:48:06.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/packet/af_packet_diag.ko 2023-08-25T03:48:06.770 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/phonet/ 2023-08-25T03:48:06.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 109993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/phonet/phonet.ko 2023-08-25T03:48:06.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 54777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/phonet/pn_pep.ko 2023-08-25T03:48:06.770 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/ 2023-08-25T03:48:06.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 252969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds.ko 2023-08-25T03:48:06.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 165137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds_rdma.ko 2023-08-25T03:48:06.770 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 67273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds_tcp.ko 2023-08-25T03:48:06.771 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rxrpc/ 2023-08-25T03:48:06.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 820289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rxrpc/rxrpc.ko 2023-08-25T03:48:06.771 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/ 2023-08-25T03:48:06.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_csum.ko 2023-08-25T03:48:06.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_gact.ko 2023-08-25T03:48:06.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_ipt.ko 2023-08-25T03:48:06.771 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 34065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_mirred.ko 2023-08-25T03:48:06.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_nat.ko 2023-08-25T03:48:06.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 43825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_pedit.ko 2023-08-25T03:48:06.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_police.ko 2023-08-25T03:48:06.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_simple.ko 2023-08-25T03:48:06.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_skbedit.ko 2023-08-25T03:48:06.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 36065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_vlan.ko 2023-08-25T03:48:06.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_basic.ko 2023-08-25T03:48:06.772 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_bpf.ko 2023-08-25T03:48:06.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_cgroup.ko 2023-08-25T03:48:06.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_flow.ko 2023-08-25T03:48:06.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_fw.ko 2023-08-25T03:48:06.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 38497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_route.ko 2023-08-25T03:48:06.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_u32.ko 2023-08-25T03:48:06.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_cmp.ko 2023-08-25T03:48:06.773 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 13465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_ipset.ko 2023-08-25T03:48:06.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_meta.ko 2023-08-25T03:48:06.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_nbyte.ko 2023-08-25T03:48:06.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_text.ko 2023-08-25T03:48:06.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_u32.ko 2023-08-25T03:48:06.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 21657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_choke.ko 2023-08-25T03:48:06.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_codel.ko 2023-08-25T03:48:06.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_drr.ko 2023-08-25T03:48:06.774 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 33617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_fq.ko 2023-08-25T03:48:06.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_fq_codel.ko 2023-08-25T03:48:06.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_gred.ko 2023-08-25T03:48:06.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 48417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_hfsc.ko 2023-08-25T03:48:06.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_hhf.ko 2023-08-25T03:48:06.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 65801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_htb.ko 2023-08-25T03:48:06.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 16073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_ingress.ko 2023-08-25T03:48:06.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 30281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_mqprio.ko 2023-08-25T03:48:06.775 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_mqprio_lib.ko 2023-08-25T03:48:06.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_multiq.ko 2023-08-25T03:48:06.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 35609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_netem.ko 2023-08-25T03:48:06.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_pie.ko 2023-08-25T03:48:06.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_plug.ko 2023-08-25T03:48:06.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 24737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_prio.ko 2023-08-25T03:48:06.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 47857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_qfq.ko 2023-08-25T03:48:06.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 32961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_red.ko 2023-08-25T03:48:06.776 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 26889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_sfb.ko 2023-08-25T03:48:06.777 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 31433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_sfq.ko 2023-08-25T03:48:06.777 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 28905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_tbf.ko 2023-08-25T03:48:06.777 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 27737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_teql.ko 2023-08-25T03:48:06.777 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp/ 2023-08-25T03:48:06.777 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 930529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp/sctp.ko 2023-08-25T03:48:06.777 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 19041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp/sctp_diag.ko 2023-08-25T03:48:06.777 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/ 2023-08-25T03:48:06.778 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss/ 2023-08-25T03:48:06.778 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 335609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-25T03:48:06.778 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 61873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-25T03:48:06.778 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 1514809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/sunrpc.ko 2023-08-25T03:48:06.778 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/xprtrdma/ 2023-08-25T03:48:06.778 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 707465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-25T03:48:06.778 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc/ 2023-08-25T03:48:06.779 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc/diag.ko 2023-08-25T03:48:06.779 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 862505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc/tipc.ko 2023-08-25T03:48:06.779 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/unix/ 2023-08-25T03:48:06.779 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/unix/unix_diag.ko 2023-08-25T03:48:06.779 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/ 2023-08-25T03:48:06.779 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 84849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-25T03:48:06.779 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 68049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-25T03:48:06.779 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 96009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock.ko 2023-08-25T03:48:06.780 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 10713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-25T03:48:06.780 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 17529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-25T03:48:06.780 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/x25/ 2023-08-25T03:48:06.780 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 125161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/x25/x25.ko 2023-08-25T03:48:06.780 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/xfrm/ 2023-08-25T03:48:06.780 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 22665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/xfrm/xfrm_algo.ko 2023-08-25T03:48:06.780 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 20713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-25T03:48:06.780 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 102361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/xfrm/xfrm_user.ko 2023-08-25T03:48:06.781 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt/ 2023-08-25T03:48:06.781 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt/lib/ 2023-08-25T03:48:06.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 15521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt/lib/irqbypass.ko 2023-08-25T03:48:06.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 638591 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.alias 2023-08-25T03:48:06.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 624324 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.alias.bin 2023-08-25T03:48:06.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 7656 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin 2023-08-25T03:48:06.781 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 23361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin.alias.bin 2023-08-25T03:48:06.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 9821 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin.bin 2023-08-25T03:48:06.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 69921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin.modinfo 2023-08-25T03:48:06.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 146449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.dep 2023-08-25T03:48:06.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 232695 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.dep.bin 2023-08-25T03:48:06.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 210 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.devname 2023-08-25T03:48:06.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 72754 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.order 2023-08-25T03:48:06.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 879 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.softdep 2023-08-25T03:48:06.782 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 252880 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.symbols 2023-08-25T03:48:06.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 307898 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.symbols.bin 2023-08-25T03:48:06.783 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./usr/ 2023-08-25T03:48:06.783 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./usr/share/ 2023-08-25T03:48:06.783 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./usr/share/doc/ 2023-08-25T03:48:06.783 INFO:teuthology.orchestra.run.smithi110.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./usr/share/doc/linux-image-6.5.0-rc7-ga6a696707610/ 2023-08-25T03:48:06.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 173 2023-08-24 10:28 ./usr/share/doc/linux-image-6.5.0-rc7-ga6a696707610/changelog.Debian.gz 2023-08-25T03:48:06.783 INFO:teuthology.orchestra.run.smithi110.stdout:-rw-r--r-- root/root 691 2023-08-24 10:28 ./usr/share/doc/linux-image-6.5.0-rc7-ga6a696707610/copyright 2023-08-25T03:48:06.784 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-ga6a696707610 2023-08-25T03:48:06.785 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc7-ga6a696707610 2023-08-25T03:48:06.785 DEBUG:teuthology.orchestra.run.smithi110:> egrep '(submenu|menuentry.*6.5.0-rc7-ga6a696707610).*{' /boot/grub/grub.cfg 2023-08-25T03:48:06.792 INFO:teuthology.orchestra.run.smithi110.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-08-25T03:48:06.792 INFO:teuthology.orchestra.run.smithi110.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc7-ga6a696707610' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc7-ga6a696707610-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-08-25T03:48:06.792 INFO:teuthology.orchestra.run.smithi110.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc7-ga6a696707610 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc7-ga6a696707610-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-08-25T03:48:06.793 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-08-25T03:48:06.793 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc7-ga6a696707610 2023-08-25T03:48:06.794 DEBUG:teuthology.orchestra.run.smithi110:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-08-25T03:48:06.838 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi110.front.sepia.ceph.com to complete... 2023-08-25T03:48:07.229 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub' 2023-08-25T03:48:07.230 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-08-25T03:48:07.258 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2023-08-25T03:48:07.461 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc7-ga6a696707610 2023-08-25T03:48:07.467 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc7-ga6a696707610 2023-08-25T03:48:07.696 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-08-25T03:48:07.701 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-08-25T03:48:07.748 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-08-25T03:48:07.753 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-08-25T03:48:07.882 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-08-25T03:48:07.882 INFO:teuthology.orchestra.run.smithi110.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-08-25T03:48:07.882 INFO:teuthology.orchestra.run.smithi110.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-08-25T03:48:07.892 INFO:teuthology.orchestra.run.smithi110.stderr:done 2023-08-25T03:48:12.084 INFO:teuthology.orchestra.run.smithi055.stderr:Sourcing file `/etc/default/grub' 2023-08-25T03:48:12.096 INFO:teuthology.orchestra.run.smithi055.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-08-25T03:48:12.121 INFO:teuthology.orchestra.run.smithi055.stderr:Generating grub configuration file ... 2023-08-25T03:48:12.398 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc7-ga6a696707610 2023-08-25T03:48:12.418 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc7-ga6a696707610 2023-08-25T03:48:12.705 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-08-25T03:48:12.716 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-08-25T03:48:12.779 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-08-25T03:48:12.784 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-08-25T03:48:12.934 INFO:teuthology.orchestra.run.smithi055.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-08-25T03:48:12.934 INFO:teuthology.orchestra.run.smithi055.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-08-25T03:48:12.934 INFO:teuthology.orchestra.run.smithi055.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-08-25T03:48:13.090 INFO:teuthology.orchestra.run.smithi055.stderr:done 2023-08-25T03:48:13.274 DEBUG:teuthology.orchestra.run.smithi055:> dpkg-deb -c /tmp/linux-image.deb 2023-08-25T03:48:13.282 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./ 2023-08-25T03:48:13.283 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./boot/ 2023-08-25T03:48:13.283 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 4382168 2023-08-24 10:28 ./boot/System.map-6.5.0-rc7-ga6a696707610 2023-08-25T03:48:13.295 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 168459 2023-08-24 10:28 ./boot/config-6.5.0-rc7-ga6a696707610 2023-08-25T03:48:13.296 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11293952 2023-08-24 10:28 ./boot/vmlinuz-6.5.0-rc7-ga6a696707610 2023-08-25T03:48:13.315 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./etc/ 2023-08-25T03:48:13.315 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./etc/kernel/ 2023-08-25T03:48:13.315 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./etc/kernel/postinst.d/ 2023-08-25T03:48:13.315 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./etc/kernel/postrm.d/ 2023-08-25T03:48:13.316 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./etc/kernel/preinst.d/ 2023-08-25T03:48:13.316 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./etc/kernel/prerm.d/ 2023-08-25T03:48:13.316 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/ 2023-08-25T03:48:13.316 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/ 2023-08-25T03:48:13.316 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/ 2023-08-25T03:48:13.317 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/ 2023-08-25T03:48:13.317 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/ 2023-08-25T03:48:13.317 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/ 2023-08-25T03:48:13.317 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/ 2023-08-25T03:48:13.317 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 490393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/aesni-intel.ko 2023-08-25T03:48:13.317 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-25T03:48:13.318 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-25T03:48:13.318 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-25T03:48:13.318 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 93121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-25T03:48:13.318 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 106737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-25T03:48:13.318 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 152249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-25T03:48:13.320 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-25T03:48:13.320 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13785 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-25T03:48:13.320 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 83897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-25T03:48:13.321 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-25T03:48:13.321 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-25T03:48:13.321 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-25T03:48:13.321 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-25T03:48:13.321 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-25T03:48:13.321 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-25T03:48:13.321 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-25T03:48:13.322 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-25T03:48:13.322 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-25T03:48:13.322 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-25T03:48:13.322 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/ 2023-08-25T03:48:13.322 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu/ 2023-08-25T03:48:13.322 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu/mce/ 2023-08-25T03:48:13.322 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-25T03:48:13.322 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/cpuid.ko 2023-08-25T03:48:13.323 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kernel/msr.ko 2023-08-25T03:48:13.323 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/ 2023-08-25T03:48:13.323 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 348241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-25T03:48:13.323 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 882137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-25T03:48:13.323 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 2277521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/arch/x86/kvm/kvm.ko 2023-08-25T03:48:13.324 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/ 2023-08-25T03:48:13.324 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/af_alg.ko 2023-08-25T03:48:13.324 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/algif_hash.ko 2023-08-25T03:48:13.325 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/algif_skcipher.ko 2023-08-25T03:48:13.325 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/ansi_cprng.ko 2023-08-25T03:48:13.325 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19649 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/anubis.ko 2023-08-25T03:48:13.325 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/arc4.ko 2023-08-25T03:48:13.325 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/asymmetric_keys/ 2023-08-25T03:48:13.325 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-08-25T03:48:13.325 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/ 2023-08-25T03:48:13.326 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_memcpy.ko 2023-08-25T03:48:13.326 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_pq.ko 2023-08-25T03:48:13.326 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-25T03:48:13.326 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_tx.ko 2023-08-25T03:48:13.326 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/async_xor.ko 2023-08-25T03:48:13.326 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/async_tx/raid6test.ko 2023-08-25T03:48:13.326 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/authenc.ko 2023-08-25T03:48:13.326 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22649 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/authencesn.ko 2023-08-25T03:48:13.327 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blake2b_generic.ko 2023-08-25T03:48:13.332 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blowfish_common.ko 2023-08-25T03:48:13.332 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/blowfish_generic.ko 2023-08-25T03:48:13.332 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/camellia_generic.ko 2023-08-25T03:48:13.332 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast5_generic.ko 2023-08-25T03:48:13.333 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast6_generic.ko 2023-08-25T03:48:13.333 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cast_common.ko 2023-08-25T03:48:13.333 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/ccm.ko 2023-08-25T03:48:13.333 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cmac.ko 2023-08-25T03:48:13.333 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crc32_generic.ko 2023-08-25T03:48:13.333 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cryptd.ko 2023-08-25T03:48:13.333 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crypto_engine.ko 2023-08-25T03:48:13.334 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crypto_simd.ko 2023-08-25T03:48:13.334 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/crypto_user.ko 2023-08-25T03:48:13.334 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/cts.ko 2023-08-25T03:48:13.334 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/des_generic.ko 2023-08-25T03:48:13.334 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/dh_generic.ko 2023-08-25T03:48:13.334 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/echainiv.ko 2023-08-25T03:48:13.334 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/essiv.ko 2023-08-25T03:48:13.334 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/fcrypt.ko 2023-08-25T03:48:13.335 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/khazad.ko 2023-08-25T03:48:13.335 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/lrw.ko 2023-08-25T03:48:13.335 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/lz4.ko 2023-08-25T03:48:13.335 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/lz4hc.ko 2023-08-25T03:48:13.335 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11769 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/md4.ko 2023-08-25T03:48:13.336 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/michael_mic.ko 2023-08-25T03:48:13.336 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/pcbc.ko 2023-08-25T03:48:13.336 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/pcrypt.ko 2023-08-25T03:48:13.336 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/rmd160.ko 2023-08-25T03:48:13.336 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/seed.ko 2023-08-25T03:48:13.336 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/serpent_generic.ko 2023-08-25T03:48:13.337 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 149201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/tcrypt.ko 2023-08-25T03:48:13.337 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/tea.ko 2023-08-25T03:48:13.337 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28785 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/twofish_common.ko 2023-08-25T03:48:13.337 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/twofish_generic.ko 2023-08-25T03:48:13.338 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/vmac.ko 2023-08-25T03:48:13.338 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/wp512.ko 2023-08-25T03:48:13.338 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xcbc.ko 2023-08-25T03:48:13.338 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xor.ko 2023-08-25T03:48:13.339 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xts.ko 2023-08-25T03:48:13.339 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/crypto/xxhash_generic.ko 2023-08-25T03:48:13.339 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ 2023-08-25T03:48:13.339 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/ 2023-08-25T03:48:13.340 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/acpi_extlog.ko 2023-08-25T03:48:13.340 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-25T03:48:13.341 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/acpi_pad.ko 2023-08-25T03:48:13.341 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/apei/ 2023-08-25T03:48:13.342 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/apei/einj.ko 2023-08-25T03:48:13.342 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/ec_sys.ko 2023-08-25T03:48:13.342 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/platform_profile.ko 2023-08-25T03:48:13.343 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/sbs.ko 2023-08-25T03:48:13.343 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/sbshc.ko 2023-08-25T03:48:13.343 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 100417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/acpi/video.ko 2023-08-25T03:48:13.343 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/ 2023-08-25T03:48:13.344 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/acard-ahci.ko 2023-08-25T03:48:13.344 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 88633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/ahci.ko 2023-08-25T03:48:13.345 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/ahci_platform.ko 2023-08-25T03:48:13.345 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 87849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/libahci.ko 2023-08-25T03:48:13.345 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/libahci_platform.ko 2023-08-25T03:48:13.345 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_acpi.ko 2023-08-25T03:48:13.345 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ali.ko 2023-08-25T03:48:13.346 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_amd.ko 2023-08-25T03:48:13.346 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_artop.ko 2023-08-25T03:48:13.346 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_atiixp.ko 2023-08-25T03:48:13.346 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_atp867x.ko 2023-08-25T03:48:13.346 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cmd640.ko 2023-08-25T03:48:13.346 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cmd64x.ko 2023-08-25T03:48:13.347 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_cypress.ko 2023-08-25T03:48:13.347 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_efar.ko 2023-08-25T03:48:13.347 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt366.ko 2023-08-25T03:48:13.347 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt37x.ko 2023-08-25T03:48:13.347 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-25T03:48:13.347 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-25T03:48:13.348 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_it8213.ko 2023-08-25T03:48:13.348 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_it821x.ko 2023-08-25T03:48:13.348 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_jmicron.ko 2023-08-25T03:48:13.348 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_legacy.ko 2023-08-25T03:48:13.349 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_marvell.ko 2023-08-25T03:48:13.349 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_mpiix.ko 2023-08-25T03:48:13.349 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_netcell.ko 2023-08-25T03:48:13.349 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ninja32.ko 2023-08-25T03:48:13.350 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ns87410.ko 2023-08-25T03:48:13.350 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_ns87415.ko 2023-08-25T03:48:13.350 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_oldpiix.ko 2023-08-25T03:48:13.350 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_opti.ko 2023-08-25T03:48:13.350 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_optidma.ko 2023-08-25T03:48:13.350 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pcmcia.ko 2023-08-25T03:48:13.351 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-25T03:48:13.351 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-25T03:48:13.351 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_piccolo.ko 2023-08-25T03:48:13.351 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_radisys.ko 2023-08-25T03:48:13.351 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_rdc.ko 2023-08-25T03:48:13.351 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_rz1000.ko 2023-08-25T03:48:13.351 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sch.ko 2023-08-25T03:48:13.351 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_serverworks.ko 2023-08-25T03:48:13.352 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sil680.ko 2023-08-25T03:48:13.352 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19577 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_sl82c105.ko 2023-08-25T03:48:13.352 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_triflex.ko 2023-08-25T03:48:13.352 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pata_via.ko 2023-08-25T03:48:13.352 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/pdc_adma.ko 2023-08-25T03:48:13.352 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_inic162x.ko 2023-08-25T03:48:13.353 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 83233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_mv.ko 2023-08-25T03:48:13.353 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_nv.ko 2023-08-25T03:48:13.353 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37377 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_promise.ko 2023-08-25T03:48:13.353 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_qstor.ko 2023-08-25T03:48:13.353 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sil.ko 2023-08-25T03:48:13.353 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sil24.ko 2023-08-25T03:48:13.353 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sis.ko 2023-08-25T03:48:13.354 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_svw.ko 2023-08-25T03:48:13.354 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_sx4.ko 2023-08-25T03:48:13.354 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_uli.ko 2023-08-25T03:48:13.354 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_via.ko 2023-08-25T03:48:13.354 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ata/sata_vsc.ko 2023-08-25T03:48:13.354 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/auxdisplay/ 2023-08-25T03:48:13.355 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/auxdisplay/ks0108.ko 2023-08-25T03:48:13.355 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/bcma/ 2023-08-25T03:48:13.355 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 124529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/bcma/bcma.ko 2023-08-25T03:48:13.355 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/ 2023-08-25T03:48:13.355 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/aoe/ 2023-08-25T03:48:13.355 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 113737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/aoe/aoe.ko 2023-08-25T03:48:13.355 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/drbd/ 2023-08-25T03:48:13.355 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 968505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/drbd/drbd.ko 2023-08-25T03:48:13.399 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 173209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/floppy.ko 2023-08-25T03:48:13.399 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/mtip32xx/ 2023-08-25T03:48:13.400 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 94305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-25T03:48:13.400 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 115353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/nbd.ko 2023-08-25T03:48:13.400 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/null_blk/ 2023-08-25T03:48:13.400 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 110369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/null_blk/null_blk.ko 2023-08-25T03:48:13.400 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 98233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/pktcdvd.ko 2023-08-25T03:48:13.401 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 259409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/rbd.ko 2023-08-25T03:48:13.401 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkback/ 2023-08-25T03:48:13.401 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 98137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-25T03:48:13.401 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/zram/ 2023-08-25T03:48:13.401 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/block/zram/zram.ko 2023-08-25T03:48:13.402 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ 2023-08-25T03:48:13.402 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/applicom.ko 2023-08-25T03:48:13.402 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hangcheck-timer.ko 2023-08-25T03:48:13.402 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/ 2023-08-25T03:48:13.402 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-25T03:48:13.402 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-25T03:48:13.402 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-25T03:48:13.403 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/via-rng.ko 2023-08-25T03:48:13.403 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15641 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-25T03:48:13.403 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ 2023-08-25T03:48:13.403 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-25T03:48:13.403 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 150673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-25T03:48:13.403 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-25T03:48:13.403 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 139113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-25T03:48:13.403 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-25T03:48:13.404 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-25T03:48:13.404 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/lp.ko 2023-08-25T03:48:13.404 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/mwave/ 2023-08-25T03:48:13.404 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 84145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/mwave/mwave.ko 2023-08-25T03:48:13.404 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/nvram.ko 2023-08-25T03:48:13.404 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/ppdev.ko 2023-08-25T03:48:13.405 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tlclk.ko 2023-08-25T03:48:13.405 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/ 2023-08-25T03:48:13.405 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-25T03:48:13.405 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-08-25T03:48:13.405 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-08-25T03:48:13.406 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-08-25T03:48:13.406 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-25T03:48:13.406 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-25T03:48:13.406 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-08-25T03:48:13.406 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/xillybus/ 2023-08-25T03:48:13.406 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/xillybus/xillybus_class.ko 2023-08-25T03:48:13.406 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/xillybus/xillybus_core.ko 2023-08-25T03:48:13.407 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-08-25T03:48:13.407 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/clk/ 2023-08-25T03:48:13.407 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/clk/clk-palmas.ko 2023-08-25T03:48:13.407 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/clk/clk-si5351.ko 2023-08-25T03:48:13.407 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/clk/clk-twl6040.ko 2023-08-25T03:48:13.407 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/clk/clk-wm831x.ko 2023-08-25T03:48:13.407 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/ 2023-08-25T03:48:13.408 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-25T03:48:13.408 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-25T03:48:13.408 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-25T03:48:13.408 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ 2023-08-25T03:48:13.408 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp/ 2023-08-25T03:48:13.408 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-25T03:48:13.408 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 234537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/ccp/ccp.ko 2023-08-25T03:48:13.409 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/ 2023-08-25T03:48:13.409 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/ 2023-08-25T03:48:13.409 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_common/ 2023-08-25T03:48:13.409 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 408681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-25T03:48:13.409 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-08-25T03:48:13.409 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-25T03:48:13.409 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/padlock-aes.ko 2023-08-25T03:48:13.410 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/padlock-sha.ko 2023-08-25T03:48:13.410 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/virtio/ 2023-08-25T03:48:13.410 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 68961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-25T03:48:13.410 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dca/ 2023-08-25T03:48:13.410 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dca/dca.ko 2023-08-25T03:48:13.410 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/ 2023-08-25T03:48:13.411 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/dw/ 2023-08-25T03:48:13.411 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-25T03:48:13.411 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/ioat/ 2023-08-25T03:48:13.411 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 122665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-25T03:48:13.411 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/ 2023-08-25T03:48:13.411 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 80281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/amd64_edac.ko 2023-08-25T03:48:13.411 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/e752x_edac.ko 2023-08-25T03:48:13.412 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 63625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/edac_mce_amd.ko 2023-08-25T03:48:13.412 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i3000_edac.ko 2023-08-25T03:48:13.412 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i3200_edac.ko 2023-08-25T03:48:13.412 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i5100_edac.ko 2023-08-25T03:48:13.412 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i5400_edac.ko 2023-08-25T03:48:13.412 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i7300_edac.ko 2023-08-25T03:48:13.412 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i7core_edac.ko 2023-08-25T03:48:13.413 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/i82975x_edac.ko 2023-08-25T03:48:13.413 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/ie31200_edac.ko 2023-08-25T03:48:13.413 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 56817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/sb_edac.ko 2023-08-25T03:48:13.413 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/edac/x38_edac.ko 2023-08-25T03:48:13.413 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/extcon/ 2023-08-25T03:48:13.414 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/extcon/extcon-gpio.ko 2023-08-25T03:48:13.414 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/extcon/extcon-max14577.ko 2023-08-25T03:48:13.414 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29577 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/extcon/extcon-max77693.ko 2023-08-25T03:48:13.414 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/extcon/extcon-max8997.ko 2023-08-25T03:48:13.414 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/extcon/extcon-palmas.ko 2023-08-25T03:48:13.414 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/extcon/extcon-rt8973a.ko 2023-08-25T03:48:13.414 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/extcon/extcon-sm5502.ko 2023-08-25T03:48:13.414 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/ 2023-08-25T03:48:13.415 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/dmi-sysfs.ko 2023-08-25T03:48:13.415 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/efi/ 2023-08-25T03:48:13.415 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/efi/efi-pstore.ko 2023-08-25T03:48:13.415 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-25T03:48:13.415 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/ 2023-08-25T03:48:13.415 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-adp5520.ko 2023-08-25T03:48:13.416 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-amd8111.ko 2023-08-25T03:48:13.416 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-arizona.ko 2023-08-25T03:48:13.416 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-da9052.ko 2023-08-25T03:48:13.416 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-da9055.ko 2023-08-25T03:48:13.416 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-dln2.ko 2023-08-25T03:48:13.416 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 77857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-f7188x.ko 2023-08-25T03:48:13.416 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-generic.ko 2023-08-25T03:48:13.416 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19577 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-ich.ko 2023-08-25T03:48:13.417 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-08-25T03:48:13.417 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-kempld.ko 2023-08-25T03:48:13.417 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-lp3943.ko 2023-08-25T03:48:13.417 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-max7300.ko 2023-08-25T03:48:13.417 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-max730x.ko 2023-08-25T03:48:13.417 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-max732x.ko 2023-08-25T03:48:13.417 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-08-25T03:48:13.418 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46769 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-pca953x.ko 2023-08-25T03:48:13.418 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-pcf857x.ko 2023-08-25T03:48:13.418 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-rdc321x.ko 2023-08-25T03:48:13.418 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-sch.ko 2023-08-25T03:48:13.418 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-sch311x.ko 2023-08-25T03:48:13.418 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-tps65912.ko 2023-08-25T03:48:13.418 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-twl4030.ko 2023-08-25T03:48:13.419 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-twl6040.ko 2023-08-25T03:48:13.419 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-25T03:48:13.419 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-vx855.ko 2023-08-25T03:48:13.419 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-wm831x.ko 2023-08-25T03:48:13.419 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-wm8350.ko 2023-08-25T03:48:13.419 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/gpio/gpio-wm8994.ko 2023-08-25T03:48:13.419 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/ 2023-08-25T03:48:13.420 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-a4tech.ko 2023-08-25T03:48:13.420 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-apple.ko 2023-08-25T03:48:13.420 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-appleir.ko 2023-08-25T03:48:13.420 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-aureal.ko 2023-08-25T03:48:13.420 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-axff.ko 2023-08-25T03:48:13.420 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-belkin.ko 2023-08-25T03:48:13.421 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-cherry.ko 2023-08-25T03:48:13.421 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-chicony.ko 2023-08-25T03:48:13.421 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-cp2112.ko 2023-08-25T03:48:13.421 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-cypress.ko 2023-08-25T03:48:13.421 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-dr.ko 2023-08-25T03:48:13.422 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-elecom.ko 2023-08-25T03:48:13.422 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-elo.ko 2023-08-25T03:48:13.422 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-emsff.ko 2023-08-25T03:48:13.422 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-ezkey.ko 2023-08-25T03:48:13.423 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gaff.ko 2023-08-25T03:48:13.423 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-generic.ko 2023-08-25T03:48:13.423 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gt683r.ko 2023-08-25T03:48:13.423 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-gyration.ko 2023-08-25T03:48:13.423 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-25T03:48:13.423 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-25T03:48:13.423 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-holtekff.ko 2023-08-25T03:48:13.424 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-hyperv.ko 2023-08-25T03:48:13.424 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-icade.ko 2023-08-25T03:48:13.424 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-kensington.ko 2023-08-25T03:48:13.424 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-keytouch.ko 2023-08-25T03:48:13.424 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-kye.ko 2023-08-25T03:48:13.424 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-lcpower.ko 2023-08-25T03:48:13.425 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-led.ko 2023-08-25T03:48:13.425 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-lenovo.ko 2023-08-25T03:48:13.425 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30769 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-lg-g15.ko 2023-08-25T03:48:13.425 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-25T03:48:13.425 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 101017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-25T03:48:13.425 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 81025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-logitech.ko 2023-08-25T03:48:13.426 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-magicmouse.ko 2023-08-25T03:48:13.426 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-microsoft.ko 2023-08-25T03:48:13.426 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-monterey.ko 2023-08-25T03:48:13.426 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-multitouch.ko 2023-08-25T03:48:13.426 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-ntrig.ko 2023-08-25T03:48:13.426 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-ortek.ko 2023-08-25T03:48:13.426 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-penmount.ko 2023-08-25T03:48:13.427 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-petalynx.ko 2023-08-25T03:48:13.427 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 72969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-picolcd.ko 2023-08-25T03:48:13.427 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-pl.ko 2023-08-25T03:48:13.427 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-plantronics.ko 2023-08-25T03:48:13.427 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-primax.ko 2023-08-25T03:48:13.427 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-rmi.ko 2023-08-25T03:48:13.428 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20769 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-25T03:48:13.428 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-common.ko 2023-08-25T03:48:13.428 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-25T03:48:13.428 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-25T03:48:13.428 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-25T03:48:13.429 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-25T03:48:13.429 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-25T03:48:13.429 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-25T03:48:13.429 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-25T03:48:13.429 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-25T03:48:13.429 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-25T03:48:13.430 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-roccat.ko 2023-08-25T03:48:13.430 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-saitek.ko 2023-08-25T03:48:13.430 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-samsung.ko 2023-08-25T03:48:13.430 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-25T03:48:13.430 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sjoy.ko 2023-08-25T03:48:13.430 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sony.ko 2023-08-25T03:48:13.431 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-speedlink.ko 2023-08-25T03:48:13.431 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-steelseries.ko 2023-08-25T03:48:13.431 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-sunplus.ko 2023-08-25T03:48:13.431 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-25T03:48:13.432 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-tivo.ko 2023-08-25T03:48:13.432 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-tmff.ko 2023-08-25T03:48:13.432 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-topseed.ko 2023-08-25T03:48:13.432 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-twinhan.ko 2023-08-25T03:48:13.433 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 71481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-uclogic.ko 2023-08-25T03:48:13.433 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-waltop.ko 2023-08-25T03:48:13.433 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 143609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-wiimote.ko 2023-08-25T03:48:13.433 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-xinmo.ko 2023-08-25T03:48:13.433 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-zpff.ko 2023-08-25T03:48:13.433 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid-zydacron.ko 2023-08-25T03:48:13.434 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 267721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/hid.ko 2023-08-25T03:48:13.434 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/uhid.ko 2023-08-25T03:48:13.434 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/usbhid/ 2023-08-25T03:48:13.434 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 125737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/usbhid/usbhid.ko 2023-08-25T03:48:13.434 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/usbhid/usbkbd.ko 2023-08-25T03:48:13.434 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/usbhid/usbmouse.ko 2023-08-25T03:48:13.434 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 217417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hid/wacom.ko 2023-08-25T03:48:13.435 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/ 2023-08-25T03:48:13.435 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 63505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_balloon.ko 2023-08-25T03:48:13.435 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 89633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_utils.ko 2023-08-25T03:48:13.435 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 301489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hv/hv_vmbus.ko 2023-08-25T03:48:13.435 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ 2023-08-25T03:48:13.435 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/abituguru.ko 2023-08-25T03:48:13.435 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/abituguru3.ko 2023-08-25T03:48:13.436 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-25T03:48:13.436 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ad7414.ko 2023-08-25T03:48:13.436 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ad7418.ko 2023-08-25T03:48:13.436 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adc128d818.ko 2023-08-25T03:48:13.436 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1025.ko 2023-08-25T03:48:13.437 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 97985 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1026.ko 2023-08-25T03:48:13.437 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1029.ko 2023-08-25T03:48:13.437 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm1031.ko 2023-08-25T03:48:13.437 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adm9240.ko 2023-08-25T03:48:13.437 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ads7828.ko 2023-08-25T03:48:13.437 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7410.ko 2023-08-25T03:48:13.437 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7411.ko 2023-08-25T03:48:13.438 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 74441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7462.ko 2023-08-25T03:48:13.438 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7470.ko 2023-08-25T03:48:13.438 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7475.ko 2023-08-25T03:48:13.438 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/adt7x10.ko 2023-08-25T03:48:13.438 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/amc6821.ko 2023-08-25T03:48:13.438 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/applesmc.ko 2023-08-25T03:48:13.439 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asb100.ko 2023-08-25T03:48:13.439 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asc7621.ko 2023-08-25T03:48:13.439 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-25T03:48:13.439 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/atxp1.ko 2023-08-25T03:48:13.439 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/coretemp.ko 2023-08-25T03:48:13.440 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/da9052-hwmon.ko 2023-08-25T03:48:13.440 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/da9055-hwmon.ko 2023-08-25T03:48:13.440 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-25T03:48:13.440 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 99609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/dme1737.ko 2023-08-25T03:48:13.440 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ds1621.ko 2023-08-25T03:48:13.440 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ds620.ko 2023-08-25T03:48:13.441 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29785 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/emc1403.ko 2023-08-25T03:48:13.441 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/emc2103.ko 2023-08-25T03:48:13.441 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/emc6w201.ko 2023-08-25T03:48:13.441 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f71805f.ko 2023-08-25T03:48:13.441 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 94465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f71882fg.ko 2023-08-25T03:48:13.441 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/f75375s.ko 2023-08-25T03:48:13.441 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/fam15h_power.ko 2023-08-25T03:48:13.442 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/fschmd.ko 2023-08-25T03:48:13.442 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/g760a.ko 2023-08-25T03:48:13.442 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/g762.ko 2023-08-25T03:48:13.442 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/gl518sm.ko 2023-08-25T03:48:13.442 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/gl520sm.ko 2023-08-25T03:48:13.442 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/hih6130.ko 2023-08-25T03:48:13.443 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-25T03:48:13.443 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/i5500_temp.ko 2023-08-25T03:48:13.443 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/i5k_amb.ko 2023-08-25T03:48:13.443 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ibmaem.ko 2023-08-25T03:48:13.443 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ibmpex.ko 2023-08-25T03:48:13.443 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ina209.ko 2023-08-25T03:48:13.444 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ina2xx.ko 2023-08-25T03:48:13.444 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 129225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/it87.ko 2023-08-25T03:48:13.444 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/jc42.ko 2023-08-25T03:48:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/k10temp.ko 2023-08-25T03:48:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/k8temp.ko 2023-08-25T03:48:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lineage-pem.ko 2023-08-25T03:48:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm63.ko 2023-08-25T03:48:13.445 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16769 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm73.ko 2023-08-25T03:48:13.446 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36785 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm75.ko 2023-08-25T03:48:13.446 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm77.ko 2023-08-25T03:48:13.446 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm78.ko 2023-08-25T03:48:13.446 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm80.ko 2023-08-25T03:48:13.446 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm83.ko 2023-08-25T03:48:13.446 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 72841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm85.ko 2023-08-25T03:48:13.447 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm87.ko 2023-08-25T03:48:13.447 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm90.ko 2023-08-25T03:48:13.447 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm92.ko 2023-08-25T03:48:13.447 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 108849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm93.ko 2023-08-25T03:48:13.447 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95234.ko 2023-08-25T03:48:13.447 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95241.ko 2023-08-25T03:48:13.447 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/lm95245.ko 2023-08-25T03:48:13.447 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc2945.ko 2023-08-25T03:48:13.448 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4151.ko 2023-08-25T03:48:13.448 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4215.ko 2023-08-25T03:48:13.448 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4222.ko 2023-08-25T03:48:13.448 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4245.ko 2023-08-25T03:48:13.448 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4260.ko 2023-08-25T03:48:13.449 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/ltc4261.ko 2023-08-25T03:48:13.449 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max16065.ko 2023-08-25T03:48:13.449 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max1619.ko 2023-08-25T03:48:13.449 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max1668.ko 2023-08-25T03:48:13.449 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max197.ko 2023-08-25T03:48:13.450 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6639.ko 2023-08-25T03:48:13.450 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6650.ko 2023-08-25T03:48:13.450 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35785 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/max6697.ko 2023-08-25T03:48:13.450 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/mc13783-adc.ko 2023-08-25T03:48:13.450 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/mcp3021.ko 2023-08-25T03:48:13.450 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-08-25T03:48:13.450 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6683.ko 2023-08-25T03:48:13.451 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 116705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6775-core.ko 2023-08-25T03:48:13.451 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct6775.ko 2023-08-25T03:48:13.451 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/nct7802.ko 2023-08-25T03:48:13.451 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 82345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pc87360.ko 2023-08-25T03:48:13.451 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pc87427.ko 2023-08-25T03:48:13.452 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pcf8591.ko 2023-08-25T03:48:13.452 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ 2023-08-25T03:48:13.452 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-25T03:48:13.453 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-25T03:48:13.453 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-25T03:48:13.453 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-25T03:48:13.453 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-25T03:48:13.453 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-25T03:48:13.454 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-25T03:48:13.454 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 81849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-25T03:48:13.454 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-25T03:48:13.454 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-25T03:48:13.454 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-25T03:48:13.454 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-25T03:48:13.455 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/powr1220.ko 2023-08-25T03:48:13.455 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch5627.ko 2023-08-25T03:48:13.455 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch5636.ko 2023-08-25T03:48:13.455 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-25T03:48:13.455 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sht15.ko 2023-08-25T03:48:13.455 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sht21.ko 2023-08-25T03:48:13.456 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/shtc1.ko 2023-08-25T03:48:13.456 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/sis5595.ko 2023-08-25T03:48:13.456 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smm665.ko 2023-08-25T03:48:13.456 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47b397.ko 2023-08-25T03:48:13.456 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47m1.ko 2023-08-25T03:48:13.457 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/smsc47m192.ko 2023-08-25T03:48:13.457 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/thmc50.ko 2023-08-25T03:48:13.457 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp102.ko 2023-08-25T03:48:13.457 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp103.ko 2023-08-25T03:48:13.457 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp401.ko 2023-08-25T03:48:13.457 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/tmp421.ko 2023-08-25T03:48:13.458 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/via-cputemp.ko 2023-08-25T03:48:13.458 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/via686a.ko 2023-08-25T03:48:13.458 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/vt1211.ko 2023-08-25T03:48:13.458 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/vt8231.ko 2023-08-25T03:48:13.458 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83627ehf.ko 2023-08-25T03:48:13.458 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83627hf.ko 2023-08-25T03:48:13.459 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 71353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83781d.ko 2023-08-25T03:48:13.459 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 63297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83791d.ko 2023-08-25T03:48:13.459 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 71329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83792d.ko 2023-08-25T03:48:13.459 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 101465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83793.ko 2023-08-25T03:48:13.460 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 119513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83795.ko 2023-08-25T03:48:13.460 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83l785ts.ko 2023-08-25T03:48:13.460 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/w83l786ng.ko 2023-08-25T03:48:13.460 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-08-25T03:48:13.460 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-08-25T03:48:13.460 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/ 2023-08-25T03:48:13.461 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos/ 2023-08-25T03:48:13.461 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-25T03:48:13.461 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-25T03:48:13.461 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/ 2023-08-25T03:48:13.461 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-08-25T03:48:13.461 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-08-25T03:48:13.461 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27785 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-08-25T03:48:13.462 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-25T03:48:13.462 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-25T03:48:13.462 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-25T03:48:13.462 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-08-25T03:48:13.462 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-25T03:48:13.462 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-08-25T03:48:13.462 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48649 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-25T03:48:13.463 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-25T03:48:13.463 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-25T03:48:13.463 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-25T03:48:13.463 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-08-25T03:48:13.463 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-08-25T03:48:13.463 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 62737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-25T03:48:13.463 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-25T03:48:13.463 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-25T03:48:13.464 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17377 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-08-25T03:48:13.464 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-25T03:48:13.464 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-25T03:48:13.464 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-08-25T03:48:13.464 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-25T03:48:13.464 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-25T03:48:13.464 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-25T03:48:13.464 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-08-25T03:48:13.465 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-25T03:48:13.465 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-25T03:48:13.465 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-08-25T03:48:13.465 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-08-25T03:48:13.465 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-25T03:48:13.465 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-08-25T03:48:13.465 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-25T03:48:13.466 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-25T03:48:13.466 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-25T03:48:13.466 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-25T03:48:13.466 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-08-25T03:48:13.466 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-mux.ko 2023-08-25T03:48:13.466 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-smbus.ko 2023-08-25T03:48:13.466 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/i2c-stub.ko 2023-08-25T03:48:13.467 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/muxes/ 2023-08-25T03:48:13.467 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-08-25T03:48:13.467 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-08-25T03:48:13.467 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-08-25T03:48:13.467 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ 2023-08-25T03:48:13.467 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ 2023-08-25T03:48:13.467 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 273657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-25T03:48:13.467 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 877041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_core.ko 2023-08-25T03:48:13.468 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 69329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-25T03:48:13.468 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 324249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-25T03:48:13.468 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 97977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-25T03:48:13.468 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 279361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-25T03:48:13.468 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-25T03:48:13.468 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/ 2023-08-25T03:48:13.468 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/cxgb4/ 2023-08-25T03:48:13.469 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 492625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-25T03:48:13.469 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx4/ 2023-08-25T03:48:13.469 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 419257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-25T03:48:13.469 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx5/ 2023-08-25T03:48:13.469 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 739833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-25T03:48:13.469 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mthca/ 2023-08-25T03:48:13.469 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 296745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-25T03:48:13.469 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/ocrdma/ 2023-08-25T03:48:13.470 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 153705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-08-25T03:48:13.470 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/usnic/ 2023-08-25T03:48:13.470 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 169065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-08-25T03:48:13.470 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/ 2023-08-25T03:48:13.470 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/ipoib/ 2023-08-25T03:48:13.470 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 263225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-25T03:48:13.470 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/iser/ 2023-08-25T03:48:13.470 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 100249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-25T03:48:13.471 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/isert/ 2023-08-25T03:48:13.471 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 112001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-25T03:48:13.471 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srp/ 2023-08-25T03:48:13.471 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 129089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-25T03:48:13.471 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srpt/ 2023-08-25T03:48:13.471 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 129561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-25T03:48:13.471 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/ 2023-08-25T03:48:13.472 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/evbug.ko 2023-08-25T03:48:13.472 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/ff-memless.ko 2023-08-25T03:48:13.472 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/ 2023-08-25T03:48:13.472 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-25T03:48:13.472 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-25T03:48:13.472 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/gameport.ko 2023-08-25T03:48:13.472 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/lightning.ko 2023-08-25T03:48:13.472 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/gameport/ns558.ko 2023-08-25T03:48:13.473 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/joydev.ko 2023-08-25T03:48:13.473 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/ 2023-08-25T03:48:13.473 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-08-25T03:48:13.473 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-08-25T03:48:13.473 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-08-25T03:48:13.473 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24769 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-08-25T03:48:13.473 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-25T03:48:13.473 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-08-25T03:48:13.474 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/lkkbd.ko 2023-08-25T03:48:13.474 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/lm8323.ko 2023-08-25T03:48:13.474 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/lm8333.ko 2023-08-25T03:48:13.474 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-08-25T03:48:13.474 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-08-25T03:48:13.474 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-08-25T03:48:13.474 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-08-25T03:48:13.475 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/newtonkbd.ko 2023-08-25T03:48:13.475 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-08-25T03:48:13.475 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/qt1070.ko 2023-08-25T03:48:13.475 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/qt2160.ko 2023-08-25T03:48:13.475 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-08-25T03:48:13.475 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/stowaway.ko 2023-08-25T03:48:13.475 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/sunkbd.ko 2023-08-25T03:48:13.476 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-08-25T03:48:13.476 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-08-25T03:48:13.476 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-08-25T03:48:13.476 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/keyboard/xtkbd.ko 2023-08-25T03:48:13.476 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/matrix-keymap.ko 2023-08-25T03:48:13.477 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/ 2023-08-25T03:48:13.477 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/appletouch.ko 2023-08-25T03:48:13.477 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/bcm5974.ko 2023-08-25T03:48:13.477 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 123705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/cyapatp.ko 2023-08-25T03:48:13.477 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 89465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-25T03:48:13.477 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/gpio_mouse.ko 2023-08-25T03:48:13.477 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 335913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/psmouse.ko 2023-08-25T03:48:13.478 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/sermouse.ko 2023-08-25T03:48:13.478 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-25T03:48:13.478 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22577 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-25T03:48:13.478 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-25T03:48:13.478 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/rmi4/ 2023-08-25T03:48:13.478 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 109897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-25T03:48:13.479 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/ 2023-08-25T03:48:13.479 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/altera_ps2.ko 2023-08-25T03:48:13.479 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/arc_ps2.ko 2023-08-25T03:48:13.479 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/ct82c710.ko 2023-08-25T03:48:13.479 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-25T03:48:13.479 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/parkbd.ko 2023-08-25T03:48:13.479 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/pcips2.ko 2023-08-25T03:48:13.479 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/ps2mult.ko 2023-08-25T03:48:13.480 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/serio_raw.ko 2023-08-25T03:48:13.480 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17985 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/serio/serport.ko 2023-08-25T03:48:13.480 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/input/sparse-keymap.ko 2023-08-25T03:48:13.480 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu/ 2023-08-25T03:48:13.480 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu/amd/ 2023-08-25T03:48:13.480 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-25T03:48:13.480 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/ 2023-08-25T03:48:13.481 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-88pm860x.ko 2023-08-25T03:48:13.481 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-adp5520.ko 2023-08-25T03:48:13.481 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-bd2802.ko 2023-08-25T03:48:13.481 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-blinkm.ko 2023-08-25T03:48:13.481 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-da903x.ko 2023-08-25T03:48:13.481 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-da9052.ko 2023-08-25T03:48:13.481 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-gpio.ko 2023-08-25T03:48:13.481 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lm3530.ko 2023-08-25T03:48:13.482 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lm3533.ko 2023-08-25T03:48:13.482 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lm355x.ko 2023-08-25T03:48:13.482 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lm3642.ko 2023-08-25T03:48:13.482 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lp3944.ko 2023-08-25T03:48:13.482 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-lp8788.ko 2023-08-25T03:48:13.482 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-max8997.ko 2023-08-25T03:48:13.483 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-mc13783.ko 2023-08-25T03:48:13.483 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-menf21bmc.ko 2023-08-25T03:48:13.483 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-pca9532.ko 2023-08-25T03:48:13.483 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-pca955x.ko 2023-08-25T03:48:13.483 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-pca963x.ko 2023-08-25T03:48:13.484 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-ss4200.ko 2023-08-25T03:48:13.484 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-tca6507.ko 2023-08-25T03:48:13.484 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-wm831x-status.ko 2023-08-25T03:48:13.484 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/leds-wm8350.ko 2023-08-25T03:48:13.485 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ 2023-08-25T03:48:13.485 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-25T03:48:13.485 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-25T03:48:13.486 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-25T03:48:13.486 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-25T03:48:13.486 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-25T03:48:13.486 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-25T03:48:13.487 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-25T03:48:13.487 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-25T03:48:13.487 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/ 2023-08-25T03:48:13.488 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/bcache/ 2023-08-25T03:48:13.488 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 655561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/bcache/bcache.ko 2023-08-25T03:48:13.488 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-bio-prison.ko 2023-08-25T03:48:13.489 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 89609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-bufio.ko 2023-08-25T03:48:13.489 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-cache-smq.ko 2023-08-25T03:48:13.489 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 156017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-cache.ko 2023-08-25T03:48:13.489 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 107057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-crypt.ko 2023-08-25T03:48:13.490 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-delay.ko 2023-08-25T03:48:13.490 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-era.ko 2023-08-25T03:48:13.490 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-flakey.ko 2023-08-25T03:48:13.490 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-log-userspace.ko 2023-08-25T03:48:13.491 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-log.ko 2023-08-25T03:48:13.491 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-mirror.ko 2023-08-25T03:48:13.491 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-multipath.ko 2023-08-25T03:48:13.491 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-queue-length.ko 2023-08-25T03:48:13.492 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-raid.ko 2023-08-25T03:48:13.492 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-region-hash.ko 2023-08-25T03:48:13.492 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-round-robin.ko 2023-08-25T03:48:13.493 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-service-time.ko 2023-08-25T03:48:13.493 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 109617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-snapshot.ko 2023-08-25T03:48:13.493 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-switch.ko 2023-08-25T03:48:13.493 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 181593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-thin-pool.ko 2023-08-25T03:48:13.493 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-verity.ko 2023-08-25T03:48:13.493 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/dm-zero.ko 2023-08-25T03:48:13.493 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/faulty.ko 2023-08-25T03:48:13.494 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/linear.ko 2023-08-25T03:48:13.494 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/multipath.ko 2023-08-25T03:48:13.494 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/persistent-data/ 2023-08-25T03:48:13.494 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 199985 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-25T03:48:13.494 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid0.ko 2023-08-25T03:48:13.494 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 112617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid1.ko 2023-08-25T03:48:13.494 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 160561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid10.ko 2023-08-25T03:48:13.495 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 396169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/md/raid456.ko 2023-08-25T03:48:13.495 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/ 2023-08-25T03:48:13.495 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/ 2023-08-25T03:48:13.495 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 178121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptbase.ko 2023-08-25T03:48:13.495 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 63393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptctl.ko 2023-08-25T03:48:13.495 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptfc.ko 2023-08-25T03:48:13.495 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptlan.ko 2023-08-25T03:48:13.495 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 123361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptsas.ko 2023-08-25T03:48:13.496 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 79025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptscsih.ko 2023-08-25T03:48:13.496 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/message/fusion/mptspi.ko 2023-08-25T03:48:13.496 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/ 2023-08-25T03:48:13.496 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/88pm800.ko 2023-08-25T03:48:13.496 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12769 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/88pm805.ko 2023-08-25T03:48:13.496 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/88pm80x.ko 2023-08-25T03:48:13.496 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/arizona-i2c.ko 2023-08-25T03:48:13.497 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 123745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/arizona.ko 2023-08-25T03:48:13.497 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/bcm590xx.ko 2023-08-25T03:48:13.497 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/cros_ec_dev.ko 2023-08-25T03:48:13.497 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/dln2.ko 2023-08-25T03:48:13.497 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/janz-cmodio.ko 2023-08-25T03:48:13.497 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/kempld-core.ko 2023-08-25T03:48:13.497 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lm3533-core.ko 2023-08-25T03:48:13.498 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-08-25T03:48:13.498 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lp3943.ko 2023-08-25T03:48:13.498 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54577 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lpc_ich.ko 2023-08-25T03:48:13.498 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/lpc_sch.ko 2023-08-25T03:48:13.498 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/max8907.ko 2023-08-25T03:48:13.498 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/mc13xxx-core.ko 2023-08-25T03:48:13.499 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-08-25T03:48:13.499 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/menf21bmc.ko 2023-08-25T03:48:13.499 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/pcf50633-adc.ko 2023-08-25T03:48:13.499 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/pcf50633-gpio.ko 2023-08-25T03:48:13.500 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/pcf50633.ko 2023-08-25T03:48:13.500 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-08-25T03:48:13.500 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/retu-mfd.ko 2023-08-25T03:48:13.500 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 80449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/si476x-core.ko 2023-08-25T03:48:13.500 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/sm501.ko 2023-08-25T03:48:13.500 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-08-25T03:48:13.501 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/tps65010.ko 2023-08-25T03:48:13.501 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/tps6507x.ko 2023-08-25T03:48:13.501 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/viperboard.ko 2023-08-25T03:48:13.501 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/vx855.ko 2023-08-25T03:48:13.501 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/wl1273-core.ko 2023-08-25T03:48:13.501 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/mfd/wm8994.ko 2023-08-25T03:48:13.501 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/ 2023-08-25T03:48:13.501 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-08-25T03:48:13.502 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/ad525x_dpot.ko 2023-08-25T03:48:13.502 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/altera-stapl/ 2023-08-25T03:48:13.502 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-25T03:48:13.502 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/apds9802als.ko 2023-08-25T03:48:13.502 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/apds990x.ko 2023-08-25T03:48:13.502 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/bh1770glc.ko 2023-08-25T03:48:13.502 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/c2port/ 2023-08-25T03:48:13.502 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-08-25T03:48:13.503 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/c2port/core.ko 2023-08-25T03:48:13.503 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/cb710/ 2023-08-25T03:48:13.503 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/cb710/cb710.ko 2023-08-25T03:48:13.503 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/ds1682.ko 2023-08-25T03:48:13.503 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/dummy-irq.ko 2023-08-25T03:48:13.503 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/echo/ 2023-08-25T03:48:13.503 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/echo/echo.ko 2023-08-25T03:48:13.503 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/ 2023-08-25T03:48:13.504 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/at24.ko 2023-08-25T03:48:13.504 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-25T03:48:13.504 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-25T03:48:13.504 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/eeprom/max6875.ko 2023-08-25T03:48:13.504 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/enclosure.ko 2023-08-25T03:48:13.504 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/genwqe/ 2023-08-25T03:48:13.504 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 152169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-08-25T03:48:13.505 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/hmc6352.ko 2023-08-25T03:48:13.505 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/hpilo.ko 2023-08-25T03:48:13.505 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/ibmasm/ 2023-08-25T03:48:13.505 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 72657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-08-25T03:48:13.505 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/ics932s401.ko 2023-08-25T03:48:13.505 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/isl29003.ko 2023-08-25T03:48:13.505 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/isl29020.ko 2023-08-25T03:48:13.505 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d/ 2023-08-25T03:48:13.506 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-25T03:48:13.506 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-25T03:48:13.506 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/ 2023-08-25T03:48:13.506 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 125225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei-me.ko 2023-08-25T03:48:13.506 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 56537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei-txe.ko 2023-08-25T03:48:13.506 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 309905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/mei/mei.ko 2023-08-25T03:48:13.507 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/phantom.ko 2023-08-25T03:48:13.507 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/ti-st/ 2023-08-25T03:48:13.507 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 74921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/ti-st/st_drv.ko 2023-08-25T03:48:13.507 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tifm_7xx1.ko 2023-08-25T03:48:13.507 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tifm_core.ko 2023-08-25T03:48:13.507 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/tsl2550.ko 2023-08-25T03:48:13.508 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_balloon.ko 2023-08-25T03:48:13.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_vmci/ 2023-08-25T03:48:13.508 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 183913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-25T03:48:13.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ 2023-08-25T03:48:13.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/bonding/ 2023-08-25T03:48:13.508 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 487913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/bonding/bonding.ko 2023-08-25T03:48:13.509 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/ 2023-08-25T03:48:13.509 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/b53/ 2023-08-25T03:48:13.509 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 106017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-25T03:48:13.509 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-25T03:48:13.509 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-25T03:48:13.509 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6xxx/ 2023-08-25T03:48:13.510 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 452761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-25T03:48:13.510 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/dummy.ko 2023-08-25T03:48:13.510 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/eql.ko 2023-08-25T03:48:13.510 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ 2023-08-25T03:48:13.510 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/ 2023-08-25T03:48:13.510 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-25T03:48:13.511 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-25T03:48:13.511 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 130497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-25T03:48:13.511 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 68793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-25T03:48:13.511 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/ 2023-08-25T03:48:13.511 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-25T03:48:13.511 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-25T03:48:13.511 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-25T03:48:13.512 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 99121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-25T03:48:13.512 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/adaptec/ 2023-08-25T03:48:13.512 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-25T03:48:13.513 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/agere/ 2023-08-25T03:48:13.513 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 69153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-25T03:48:13.513 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/alteon/ 2023-08-25T03:48:13.513 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-25T03:48:13.513 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/altera/ 2023-08-25T03:48:13.514 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-25T03:48:13.514 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/ 2023-08-25T03:48:13.514 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-25T03:48:13.514 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-25T03:48:13.515 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 87353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-25T03:48:13.515 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/ 2023-08-25T03:48:13.515 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/alx/ 2023-08-25T03:48:13.515 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 97345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-25T03:48:13.515 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-08-25T03:48:13.515 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 104625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-25T03:48:13.516 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-08-25T03:48:13.516 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 90281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-25T03:48:13.516 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx/ 2023-08-25T03:48:13.516 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 81513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-25T03:48:13.516 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 69721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-25T03:48:13.517 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/ 2023-08-25T03:48:13.517 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-25T03:48:13.517 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 176889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-25T03:48:13.517 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-08-25T03:48:13.517 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1422265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-25T03:48:13.602 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 128385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-25T03:48:13.603 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/genet/ 2023-08-25T03:48:13.603 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 132305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-25T03:48:13.603 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 312153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-25T03:48:13.603 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade/ 2023-08-25T03:48:13.604 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade/bna/ 2023-08-25T03:48:13.604 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 323601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-25T03:48:13.604 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/ 2023-08-25T03:48:13.604 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-08-25T03:48:13.604 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 193481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-25T03:48:13.604 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-08-25T03:48:13.605 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 347697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-25T03:48:13.605 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-08-25T03:48:13.605 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1044273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-25T03:48:13.605 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-08-25T03:48:13.605 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 166129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-25T03:48:13.605 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-08-25T03:48:13.605 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-25T03:48:13.605 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco/ 2023-08-25T03:48:13.606 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco/enic/ 2023-08-25T03:48:13.606 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 204401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-25T03:48:13.606 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/ 2023-08-25T03:48:13.606 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/ 2023-08-25T03:48:13.606 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 69457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-25T03:48:13.606 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-25T03:48:13.606 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 141209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-25T03:48:13.607 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-25T03:48:13.607 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 62873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-25T03:48:13.607 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-25T03:48:13.607 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink/ 2023-08-25T03:48:13.607 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-25T03:48:13.607 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 62841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-25T03:48:13.607 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/dnet.ko 2023-08-25T03:48:13.608 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ec_bhf.ko 2023-08-25T03:48:13.608 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex/ 2023-08-25T03:48:13.608 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex/benet/ 2023-08-25T03:48:13.608 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 281353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-25T03:48:13.608 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ethoc.ko 2023-08-25T03:48:13.608 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/fealnx.ko 2023-08-25T03:48:13.608 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/fujitsu/ 2023-08-25T03:48:13.609 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-08-25T03:48:13.609 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ 2023-08-25T03:48:13.609 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 90473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-25T03:48:13.609 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000/ 2023-08-25T03:48:13.609 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 295737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-25T03:48:13.609 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000e/ 2023-08-25T03:48:13.609 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 584305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-25T03:48:13.610 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/fm10k/ 2023-08-25T03:48:13.610 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 246385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-25T03:48:13.610 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/i40e/ 2023-08-25T03:48:13.610 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 924105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-25T03:48:13.610 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/iavf/ 2023-08-25T03:48:13.610 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 302625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-25T03:48:13.611 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igb/ 2023-08-25T03:48:13.611 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 514937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-25T03:48:13.611 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igbvf/ 2023-08-25T03:48:13.611 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 93617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-25T03:48:13.611 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-08-25T03:48:13.611 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 734401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-25T03:48:13.611 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-08-25T03:48:13.612 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 151865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-25T03:48:13.612 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 86929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/jme.ko 2023-08-25T03:48:13.612 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/ 2023-08-25T03:48:13.612 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20985 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-25T03:48:13.612 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 102393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-25T03:48:13.612 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 122689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-25T03:48:13.612 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/ 2023-08-25T03:48:13.613 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-08-25T03:48:13.613 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 727545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-25T03:48:13.613 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 280569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-25T03:48:13.613 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-08-25T03:48:13.613 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-08-25T03:48:13.613 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1097769 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-25T03:48:13.613 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel/ 2023-08-25T03:48:13.614 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-08-25T03:48:13.614 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-08-25T03:48:13.614 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-08-25T03:48:13.614 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 95673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-25T03:48:13.614 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom/ 2023-08-25T03:48:13.614 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-08-25T03:48:13.614 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 108817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-25T03:48:13.614 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi/ 2023-08-25T03:48:13.615 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-25T03:48:13.615 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-25T03:48:13.615 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/neterion/ 2023-08-25T03:48:13.615 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 150913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-25T03:48:13.615 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/nvidia/ 2023-08-25T03:48:13.615 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 136793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-25T03:48:13.615 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines/ 2023-08-25T03:48:13.616 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-25T03:48:13.616 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-25T03:48:13.616 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/ 2023-08-25T03:48:13.616 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-08-25T03:48:13.616 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 227145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-25T03:48:13.616 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 87089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-25T03:48:13.616 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-08-25T03:48:13.617 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 671465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-25T03:48:13.617 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rdc/ 2023-08-25T03:48:13.617 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-25T03:48:13.617 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/ 2023-08-25T03:48:13.617 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-25T03:48:13.617 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 83929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-25T03:48:13.617 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-25T03:48:13.617 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 189833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-25T03:48:13.618 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/samsung/ 2023-08-25T03:48:13.618 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-08-25T03:48:13.618 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 104289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-08-25T03:48:13.618 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sfc/ 2023-08-25T03:48:13.618 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 953113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-25T03:48:13.618 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/silan/ 2023-08-25T03:48:13.618 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-25T03:48:13.618 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis/ 2023-08-25T03:48:13.619 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-25T03:48:13.619 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 63281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-25T03:48:13.619 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/ 2023-08-25T03:48:13.619 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-25T03:48:13.619 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-25T03:48:13.619 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-25T03:48:13.619 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 68217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-25T03:48:13.620 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/ 2023-08-25T03:48:13.620 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-08-25T03:48:13.620 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-08-25T03:48:13.620 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-25T03:48:13.620 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-08-25T03:48:13.620 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 481817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-25T03:48:13.621 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/ 2023-08-25T03:48:13.621 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 103329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-25T03:48:13.621 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 166129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-25T03:48:13.621 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-25T03:48:13.621 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-25T03:48:13.621 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/tehuti/ 2023-08-25T03:48:13.621 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-25T03:48:13.622 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ti/ 2023-08-25T03:48:13.622 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 86473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-25T03:48:13.622 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via/ 2023-08-25T03:48:13.622 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 80265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-25T03:48:13.622 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 83689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-25T03:48:13.622 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet/ 2023-08-25T03:48:13.623 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-25T03:48:13.623 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-25T03:48:13.623 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/xircom/ 2023-08-25T03:48:13.623 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-25T03:48:13.623 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/fddi/ 2023-08-25T03:48:13.623 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/fddi/defxx.ko 2023-08-25T03:48:13.623 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/fddi/skfp/ 2023-08-25T03:48:13.624 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 217065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/fddi/skfp/skfp.ko 2023-08-25T03:48:13.624 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 77409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/geneve.ko 2023-08-25T03:48:13.624 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/hyperv/ 2023-08-25T03:48:13.624 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 235625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-25T03:48:13.624 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ieee802154/ 2023-08-25T03:48:13.624 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-25T03:48:13.625 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ifb.ko 2023-08-25T03:48:13.625 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ipvlan/ 2023-08-25T03:48:13.625 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 84009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-25T03:48:13.625 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 62073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/macvlan.ko 2023-08-25T03:48:13.625 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/macvtap.ko 2023-08-25T03:48:13.625 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/ 2023-08-25T03:48:13.626 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-25T03:48:13.626 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-25T03:48:13.626 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-gpio.ko 2023-08-25T03:48:13.626 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-25T03:48:13.626 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mdio.ko 2023-08-25T03:48:13.627 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/mii.ko 2023-08-25T03:48:13.627 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/netconsole.ko 2023-08-25T03:48:13.627 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/nlmon.ko 2023-08-25T03:48:13.627 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs/ 2023-08-25T03:48:13.627 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-25T03:48:13.628 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-25T03:48:13.628 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/ 2023-08-25T03:48:13.628 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/amd.ko 2023-08-25T03:48:13.628 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-25T03:48:13.628 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-25T03:48:13.628 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/bcm87xx.ko 2023-08-25T03:48:13.629 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/broadcom.ko 2023-08-25T03:48:13.629 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/cicada.ko 2023-08-25T03:48:13.629 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/davicom.ko 2023-08-25T03:48:13.629 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/et1011c.ko 2023-08-25T03:48:13.629 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/icplus.ko 2023-08-25T03:48:13.629 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/lxt.ko 2023-08-25T03:48:13.630 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/marvell.ko 2023-08-25T03:48:13.630 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 75721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/micrel.ko 2023-08-25T03:48:13.630 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/national.ko 2023-08-25T03:48:13.630 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 97273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/phylink.ko 2023-08-25T03:48:13.630 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/qsemi.ko 2023-08-25T03:48:13.630 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/realtek.ko 2023-08-25T03:48:13.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/smsc.ko 2023-08-25T03:48:13.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/ste10Xp.ko 2023-08-25T03:48:13.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/phy/vitesse.ko 2023-08-25T03:48:13.631 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/plip/ 2023-08-25T03:48:13.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/plip/plip.ko 2023-08-25T03:48:13.631 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ 2023-08-25T03:48:13.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-25T03:48:13.632 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_async.ko 2023-08-25T03:48:13.632 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-25T03:48:13.632 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-25T03:48:13.632 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-25T03:48:13.632 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pppoe.ko 2023-08-25T03:48:13.632 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pppox.ko 2023-08-25T03:48:13.633 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/ppp/pptp.ko 2023-08-25T03:48:13.633 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/sb1000.ko 2023-08-25T03:48:13.633 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip/ 2023-08-25T03:48:13.633 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/slip/slip.ko 2023-08-25T03:48:13.633 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/sungem_phy.ko 2023-08-25T03:48:13.633 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 64945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/tap.ko 2023-08-25T03:48:13.634 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/ 2023-08-25T03:48:13.634 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 106033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team.ko 2023-08-25T03:48:13.634 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-25T03:48:13.634 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-25T03:48:13.634 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-25T03:48:13.634 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9649 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_random.ko 2023-08-25T03:48:13.634 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-25T03:48:13.635 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 88265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/veth.ko 2023-08-25T03:48:13.635 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vmxnet3/ 2023-08-25T03:48:13.635 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 120513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-25T03:48:13.635 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vxlan/ 2023-08-25T03:48:13.635 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 293465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/vxlan/vxlan.ko 2023-08-25T03:48:13.635 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netback/ 2023-08-25T03:48:13.635 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 143921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-25T03:48:13.636 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ntb/ 2023-08-25T03:48:13.636 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ntb/ntb.ko 2023-08-25T03:48:13.636 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/ 2023-08-25T03:48:13.636 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host/ 2023-08-25T03:48:13.636 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 264617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host/nvme-core.ko 2023-08-25T03:48:13.636 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 102401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/nvme/host/nvme.ko 2023-08-25T03:48:13.636 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/ 2023-08-25T03:48:13.636 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 133849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport.ko 2023-08-25T03:48:13.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_cs.ko 2023-08-25T03:48:13.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 84345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_pc.ko 2023-08-25T03:48:13.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/parport/parport_serial.ko 2023-08-25T03:48:13.637 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/ 2023-08-25T03:48:13.637 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/hotplug/ 2023-08-25T03:48:13.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-25T03:48:13.638 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-08-25T03:48:13.638 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-08-25T03:48:13.638 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/pci-stub.ko 2023-08-25T03:48:13.638 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pci/xen-pcifront.ko 2023-08-25T03:48:13.638 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/ 2023-08-25T03:48:13.638 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/i82092.ko 2023-08-25T03:48:13.638 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 145809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/pcmcia.ko 2023-08-25T03:48:13.638 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 62105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/pcmcia_core.ko 2023-08-25T03:48:13.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-08-25T03:48:13.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/pd6729.ko 2023-08-25T03:48:13.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 112921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-25T03:48:13.639 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/phy/ 2023-08-25T03:48:13.639 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/phy/broadcom/ 2023-08-25T03:48:13.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-08-25T03:48:13.639 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/phy/samsung/ 2023-08-25T03:48:13.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-08-25T03:48:13.640 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl/ 2023-08-25T03:48:13.640 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl/intel/ 2023-08-25T03:48:13.640 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 71529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-25T03:48:13.640 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/ 2023-08-25T03:48:13.640 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/chrome/ 2023-08-25T03:48:13.640 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-08-25T03:48:13.640 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/chrome/cros_ec.ko 2023-08-25T03:48:13.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-08-25T03:48:13.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-08-25T03:48:13.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-08-25T03:48:13.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-08-25T03:48:13.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-08-25T03:48:13.641 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/ 2023-08-25T03:48:13.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-25T03:48:13.642 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/acerhdf.ko 2023-08-25T03:48:13.642 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-25T03:48:13.642 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-25T03:48:13.642 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-25T03:48:13.642 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 106881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-25T03:48:13.642 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-25T03:48:13.643 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-25T03:48:13.643 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-25T03:48:13.643 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-25T03:48:13.643 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-25T03:48:13.643 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/hdaps.ko 2023-08-25T03:48:13.643 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/ibm_rtl.ko 2023-08-25T03:48:13.643 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel/ 2023-08-25T03:48:13.643 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-25T03:48:13.644 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-08-25T03:48:13.644 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/intel_ips.ko 2023-08-25T03:48:13.644 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-25T03:48:13.644 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-25T03:48:13.644 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-25T03:48:13.645 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-25T03:48:13.645 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-25T03:48:13.645 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-25T03:48:13.645 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-25T03:48:13.646 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-25T03:48:13.646 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-25T03:48:13.646 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/platform/x86/wmi.ko 2023-08-25T03:48:13.646 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/ 2023-08-25T03:48:13.646 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/ 2023-08-25T03:48:13.647 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/88pm860x_battery.ko 2023-08-25T03:48:13.647 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/88pm860x_charger.ko 2023-08-25T03:48:13.647 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/bq2415x_charger.ko 2023-08-25T03:48:13.647 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/bq24190_charger.ko 2023-08-25T03:48:13.647 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/bq24735-charger.ko 2023-08-25T03:48:13.647 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-08-25T03:48:13.647 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/da9030_battery.ko 2023-08-25T03:48:13.648 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/da9052-battery.ko 2023-08-25T03:48:13.648 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/ds2760_battery.ko 2023-08-25T03:48:13.648 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/ds2780_battery.ko 2023-08-25T03:48:13.648 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/ds2781_battery.ko 2023-08-25T03:48:13.649 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/ds2782_battery.ko 2023-08-25T03:48:13.649 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/gpio-charger.ko 2023-08-25T03:48:13.649 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/isp1704_charger.ko 2023-08-25T03:48:13.649 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/lp8727_charger.ko 2023-08-25T03:48:13.649 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/max14577_charger.ko 2023-08-25T03:48:13.650 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/max17040_battery.ko 2023-08-25T03:48:13.650 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/max17042_battery.ko 2023-08-25T03:48:13.650 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/max8903_charger.ko 2023-08-25T03:48:13.650 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/max8925_power.ko 2023-08-25T03:48:13.650 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/pcf50633-charger.ko 2023-08-25T03:48:13.651 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/sbs-battery.ko 2023-08-25T03:48:13.651 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/test_power.ko 2023-08-25T03:48:13.651 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/tps65090-charger.ko 2023-08-25T03:48:13.651 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/wm831x_backup.ko 2023-08-25T03:48:13.651 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/wm831x_power.ko 2023-08-25T03:48:13.652 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/power/supply/wm8350_power.ko 2023-08-25T03:48:13.652 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap/ 2023-08-25T03:48:13.652 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-25T03:48:13.652 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-25T03:48:13.652 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/ 2023-08-25T03:48:13.652 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/ 2023-08-25T03:48:13.653 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-25T03:48:13.653 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-25T03:48:13.653 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/clients/pps_parport.ko 2023-08-25T03:48:13.653 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/pps/pps_core.ko 2023-08-25T03:48:13.653 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp/ 2023-08-25T03:48:13.654 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp/ptp.ko 2023-08-25T03:48:13.654 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ptp/ptp_kvm.ko 2023-08-25T03:48:13.654 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/ 2023-08-25T03:48:13.654 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-88pm80x.ko 2023-08-25T03:48:13.654 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-88pm860x.ko 2023-08-25T03:48:13.654 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-25T03:48:13.655 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-25T03:48:13.655 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-da9052.ko 2023-08-25T03:48:13.655 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-da9055.ko 2023-08-25T03:48:13.655 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-da9063.ko 2023-08-25T03:48:13.655 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-25T03:48:13.655 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 68585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-25T03:48:13.655 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-25T03:48:13.655 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-25T03:48:13.656 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-25T03:48:13.656 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-25T03:48:13.656 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13377 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-25T03:48:13.656 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-25T03:48:13.656 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-25T03:48:13.656 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-em3027.ko 2023-08-25T03:48:13.656 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-25T03:48:13.656 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-25T03:48:13.657 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-25T03:48:13.657 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-lp8788.ko 2023-08-25T03:48:13.657 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-25T03:48:13.657 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-25T03:48:13.657 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-25T03:48:13.657 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-m48t86.ko 2023-08-25T03:48:13.657 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11641 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-max6900.ko 2023-08-25T03:48:13.658 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-max8907.ko 2023-08-25T03:48:13.658 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-max8925.ko 2023-08-25T03:48:13.658 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-max8997.ko 2023-08-25T03:48:13.658 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-max8998.ko 2023-08-25T03:48:13.658 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-08-25T03:48:13.658 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-25T03:48:13.659 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-palmas.ko 2023-08-25T03:48:13.659 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-25T03:48:13.659 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17985 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf50633.ko 2023-08-25T03:48:13.659 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-25T03:48:13.659 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-25T03:48:13.659 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-25T03:48:13.660 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-25T03:48:13.660 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rc5t583.ko 2023-08-25T03:48:13.660 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-25T03:48:13.660 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-25T03:48:13.660 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-25T03:48:13.660 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-25T03:48:13.661 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-25T03:48:13.661 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-s35390a.ko 2023-08-25T03:48:13.661 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-25T03:48:13.661 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-tps6586x.ko 2023-08-25T03:48:13.661 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-tps65910.ko 2023-08-25T03:48:13.661 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-wm831x.ko 2023-08-25T03:48:13.661 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-wm8350.ko 2023-08-25T03:48:13.662 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/rtc/rtc-x1205.ko 2023-08-25T03:48:13.662 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ 2023-08-25T03:48:13.662 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 77625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-9xxx.ko 2023-08-25T03:48:13.662 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-sas.ko 2023-08-25T03:48:13.662 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/3w-xxxx.ko 2023-08-25T03:48:13.662 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 135177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/BusLogic.ko 2023-08-25T03:48:13.662 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/a100u2w.ko 2023-08-25T03:48:13.663 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aacraid/ 2023-08-25T03:48:13.663 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 272409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-25T03:48:13.663 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 100625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/advansys.ko 2023-08-25T03:48:13.663 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx/ 2023-08-25T03:48:13.663 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 356297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-25T03:48:13.663 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 295841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-25T03:48:13.663 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic94xx/ 2023-08-25T03:48:13.664 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 189377 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-08-25T03:48:13.664 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/am53c974.ko 2023-08-25T03:48:13.664 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/arcmsr/ 2023-08-25T03:48:13.664 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 106585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-25T03:48:13.664 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/atp870u.ko 2023-08-25T03:48:13.664 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/be2iscsi/ 2023-08-25T03:48:13.664 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 246921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-25T03:48:13.665 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bfa/ 2023-08-25T03:48:13.665 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1172289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bfa/bfa.ko 2023-08-25T03:48:13.665 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2fc/ 2023-08-25T03:48:13.665 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 237201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-25T03:48:13.666 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2i/ 2023-08-25T03:48:13.666 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 115417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-25T03:48:13.666 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ch.ko 2023-08-25T03:48:13.666 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/csiostor/ 2023-08-25T03:48:13.667 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 308945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-25T03:48:13.667 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/ 2023-08-25T03:48:13.667 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-08-25T03:48:13.667 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 76201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-25T03:48:13.667 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-08-25T03:48:13.667 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 101457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-25T03:48:13.668 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 146793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-25T03:48:13.668 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 75537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/dc395x.ko 2023-08-25T03:48:13.668 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/dmx3191d.ko 2023-08-25T03:48:13.668 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esas2r/ 2023-08-25T03:48:13.668 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 212457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-25T03:48:13.669 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/esp_scsi.ko 2023-08-25T03:48:13.669 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe/ 2023-08-25T03:48:13.669 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-25T03:48:13.669 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 158209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-25T03:48:13.669 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fdomain.ko 2023-08-25T03:48:13.669 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fnic/ 2023-08-25T03:48:13.670 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 262801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/fnic/fnic.ko 2023-08-25T03:48:13.670 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 201801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hpsa.ko 2023-08-25T03:48:13.670 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hptiop.ko 2023-08-25T03:48:13.670 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/hv_storvsc.ko 2023-08-25T03:48:13.670 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/imm.ko 2023-08-25T03:48:13.670 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/initio.ko 2023-08-25T03:48:13.670 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 266529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ipr.ko 2023-08-25T03:48:13.671 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 101889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ips.ko 2023-08-25T03:48:13.671 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/isci/ 2023-08-25T03:48:13.671 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 317313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/isci/isci.ko 2023-08-25T03:48:13.671 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-25T03:48:13.671 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-25T03:48:13.671 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libfc/ 2023-08-25T03:48:13.672 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 315009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libfc/libfc.ko 2023-08-25T03:48:13.672 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 145577 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libiscsi.ko 2023-08-25T03:48:13.672 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-25T03:48:13.672 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libsas/ 2023-08-25T03:48:13.672 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 217265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/libsas/libsas.ko 2023-08-25T03:48:13.673 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/lpfc/ 2023-08-25T03:48:13.673 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 2192665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-25T03:48:13.673 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/ 2023-08-25T03:48:13.673 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-25T03:48:13.673 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-25T03:48:13.673 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 310753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-25T03:48:13.674 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 84705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/megaraid.ko 2023-08-25T03:48:13.674 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mpt3sas/ 2023-08-25T03:48:13.674 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 659561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-25T03:48:13.674 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvsas/ 2023-08-25T03:48:13.674 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 119953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-25T03:48:13.674 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/mvumi.ko 2023-08-25T03:48:13.675 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pcmcia/ 2023-08-25T03:48:13.675 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 81609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-08-25T03:48:13.675 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-08-25T03:48:13.675 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-08-25T03:48:13.675 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-08-25T03:48:13.676 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pm8001/ 2023-08-25T03:48:13.676 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 364289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-25T03:48:13.676 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 123497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/pmcraid.ko 2023-08-25T03:48:13.677 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ppa.ko 2023-08-25T03:48:13.677 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla1280.ko 2023-08-25T03:48:13.677 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx/ 2023-08-25T03:48:13.677 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1860289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-25T03:48:13.678 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 85321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-25T03:48:13.678 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla4xxx/ 2023-08-25T03:48:13.678 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 558921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-25T03:48:13.679 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/qlogicfas408.ko 2023-08-25T03:48:13.679 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/raid_class.ko 2023-08-25T03:48:13.679 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 238809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_debug.ko 2023-08-25T03:48:13.679 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 173929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-25T03:48:13.679 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 278873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-25T03:48:13.679 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 97713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-25T03:48:13.680 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-25T03:48:13.680 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-25T03:48:13.680 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/ses.ko 2023-08-25T03:48:13.681 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 115857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/st.ko 2023-08-25T03:48:13.681 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/stex.ko 2023-08-25T03:48:13.681 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/sym53c8xx_2/ 2023-08-25T03:48:13.681 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 162153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-25T03:48:13.682 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/virtio_scsi.ko 2023-08-25T03:48:13.682 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-25T03:48:13.682 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/wd719x.ko 2023-08-25T03:48:13.682 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/scsi/xen-scsifront.ko 2023-08-25T03:48:13.683 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ssb/ 2023-08-25T03:48:13.683 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 129465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ssb/ssb.ko 2023-08-25T03:48:13.683 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/ 2023-08-25T03:48:13.683 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/iscsi/ 2023-08-25T03:48:13.683 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 739185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-25T03:48:13.683 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/loopback/ 2023-08-25T03:48:13.684 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-25T03:48:13.684 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_file.ko 2023-08-25T03:48:13.684 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_iblock.ko 2023-08-25T03:48:13.684 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 931809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_mod.ko 2023-08-25T03:48:13.685 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_pscsi.ko 2023-08-25T03:48:13.685 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 122553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/target_core_user.ko 2023-08-25T03:48:13.685 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/tcm_fc/ 2023-08-25T03:48:13.685 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 75665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-25T03:48:13.685 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/ 2023-08-25T03:48:13.685 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/ 2023-08-25T03:48:13.686 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/ 2023-08-25T03:48:13.686 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-25T03:48:13.686 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-25T03:48:13.686 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-25T03:48:13.686 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-25T03:48:13.687 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-25T03:48:13.687 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-25T03:48:13.687 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-25T03:48:13.687 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-25T03:48:13.687 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-25T03:48:13.687 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-25T03:48:13.687 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-25T03:48:13.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-25T03:48:13.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-08-25T03:48:13.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-25T03:48:13.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-25T03:48:13.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-25T03:48:13.688 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/ 2023-08-25T03:48:13.688 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/ipwireless/ 2023-08-25T03:48:13.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-25T03:48:13.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/moxa.ko 2023-08-25T03:48:13.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/mxser.ko 2023-08-25T03:48:13.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 107553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/n_gsm.ko 2023-08-25T03:48:13.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/n_hdlc.ko 2023-08-25T03:48:13.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 68145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/nozomi.ko 2023-08-25T03:48:13.689 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/ 2023-08-25T03:48:13.690 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/8250/ 2023-08-25T03:48:13.690 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-08-25T03:48:13.690 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-25T03:48:13.690 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-08-25T03:48:13.690 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/altera_uart.ko 2023-08-25T03:48:13.690 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/arc_uart.ko 2023-08-25T03:48:13.690 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 72201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-08-25T03:48:13.690 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/jsm/ 2023-08-25T03:48:13.691 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 103041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-25T03:48:13.691 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/rp2.ko 2023-08-25T03:48:13.691 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/serial/sc16is7xx.ko 2023-08-25T03:48:13.691 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 100193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/tty/synclink_gt.ko 2023-08-25T03:48:13.691 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/ 2023-08-25T03:48:13.691 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/core/ 2023-08-25T03:48:13.691 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 536833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-25T03:48:13.692 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/host/ 2023-08-25T03:48:13.692 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-25T03:48:13.692 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-08-25T03:48:13.692 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/ 2023-08-25T03:48:13.692 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio.ko 2023-08-25T03:48:13.692 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_aec.ko 2023-08-25T03:48:13.693 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_cif.ko 2023-08-25T03:48:13.693 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_dmem_genirq.ko 2023-08-25T03:48:13.693 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_mf624.ko 2023-08-25T03:48:13.693 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_netx.ko 2023-08-25T03:48:13.693 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_pci_generic.ko 2023-08-25T03:48:13.693 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-08-25T03:48:13.693 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13641 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/uio/uio_sercos3.ko 2023-08-25T03:48:13.693 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/ 2023-08-25T03:48:13.694 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/c67x00/ 2023-08-25T03:48:13.694 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/c67x00/c67x00.ko 2023-08-25T03:48:13.694 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/chipidea/ 2023-08-25T03:48:13.694 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 143825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-08-25T03:48:13.695 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-08-25T03:48:13.695 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-08-25T03:48:13.695 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-08-25T03:48:13.695 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/ 2023-08-25T03:48:13.695 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 85465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/cdc-acm.ko 2023-08-25T03:48:13.695 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-25T03:48:13.696 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/usblp.ko 2023-08-25T03:48:13.696 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 89841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/class/usbtmc.ko 2023-08-25T03:48:13.696 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/common/ 2023-08-25T03:48:13.696 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/common/ulpi.ko 2023-08-25T03:48:13.696 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/dwc2/ 2023-08-25T03:48:13.696 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-08-25T03:48:13.696 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/dwc3/ 2023-08-25T03:48:13.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-08-25T03:48:13.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-08-25T03:48:13.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 445257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/dwc3/dwc3.ko 2023-08-25T03:48:13.697 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/ 2023-08-25T03:48:13.697 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/ 2023-08-25T03:48:13.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/u_ether.ko 2023-08-25T03:48:13.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/u_serial.ko 2023-08-25T03:48:13.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-08-25T03:48:13.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-08-25T03:48:13.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-08-25T03:48:13.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-08-25T03:48:13.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 92385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-08-25T03:48:13.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-08-25T03:48:13.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 122081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-08-25T03:48:13.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-08-25T03:48:13.699 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-08-25T03:48:13.699 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-08-25T03:48:13.699 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-08-25T03:48:13.699 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 85849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-08-25T03:48:13.699 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-08-25T03:48:13.699 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-08-25T03:48:13.699 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-08-25T03:48:13.700 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/ 2023-08-25T03:48:13.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-08-25T03:48:13.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-08-25T03:48:13.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-08-25T03:48:13.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-08-25T03:48:13.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-08-25T03:48:13.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-08-25T03:48:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-08-25T03:48:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16985 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-08-25T03:48:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-08-25T03:48:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-08-25T03:48:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-08-25T03:48:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-08-25T03:48:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 62161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-08-25T03:48:13.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-08-25T03:48:13.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 161361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/libcomposite.ko 2023-08-25T03:48:13.702 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/ 2023-08-25T03:48:13.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-08-25T03:48:13.702 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/bdc/ 2023-08-25T03:48:13.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 157689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-08-25T03:48:13.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-08-25T03:48:13.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-08-25T03:48:13.703 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 69697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-08-25T03:48:13.703 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 56017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-08-25T03:48:13.703 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 76041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/net2272.ko 2023-08-25T03:48:13.703 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 75065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/net2280.ko 2023-08-25T03:48:13.703 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-08-25T03:48:13.704 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 65801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-08-25T03:48:13.704 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-08-25T03:48:13.704 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 81497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-08-25T03:48:13.705 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 156073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-08-25T03:48:13.706 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/ 2023-08-25T03:48:13.706 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/bcma-hcd.ko 2023-08-25T03:48:13.706 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 80105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/isp116x-hcd.ko 2023-08-25T03:48:13.706 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 87345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-08-25T03:48:13.707 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-08-25T03:48:13.707 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-25T03:48:13.707 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/sl811_cs.ko 2023-08-25T03:48:13.707 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/ssb-hcd.ko 2023-08-25T03:48:13.709 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-08-25T03:48:13.709 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image/ 2023-08-25T03:48:13.709 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image/mdc800.ko 2023-08-25T03:48:13.709 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/image/microtek.ko 2023-08-25T03:48:13.709 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/ 2023-08-25T03:48:13.709 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/adutux.ko 2023-08-25T03:48:13.710 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/appledisplay.ko 2023-08-25T03:48:13.710 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-08-25T03:48:13.710 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/cytherm.ko 2023-08-25T03:48:13.710 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/ehset.ko 2023-08-25T03:48:13.710 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/emi26.ko 2023-08-25T03:48:13.710 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/emi62.ko 2023-08-25T03:48:13.711 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/ezusb.ko 2023-08-25T03:48:13.711 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/idmouse.ko 2023-08-25T03:48:13.711 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/iowarrior.ko 2023-08-25T03:48:13.711 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-25T03:48:13.711 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/ldusb.ko 2023-08-25T03:48:13.712 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/legousbtower.ko 2023-08-25T03:48:13.712 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/lvstest.ko 2023-08-25T03:48:13.712 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/sisusbvga/ 2023-08-25T03:48:13.712 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 64849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-25T03:48:13.713 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-25T03:48:13.713 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usb3503.ko 2023-08-25T03:48:13.713 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usblcd.ko 2023-08-25T03:48:13.713 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-25T03:48:13.713 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/usbtest.ko 2023-08-25T03:48:13.713 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/uss720.ko 2023-08-25T03:48:13.713 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/misc/yurex.ko 2023-08-25T03:48:13.714 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/mon/ 2023-08-25T03:48:13.714 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73209 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/mon/usbmon.ko 2023-08-25T03:48:13.714 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/musb/ 2023-08-25T03:48:13.714 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 301561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/musb/musb_hdrc.ko 2023-08-25T03:48:13.714 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy/ 2023-08-25T03:48:13.715 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy/phy-generic.ko 2023-08-25T03:48:13.715 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-08-25T03:48:13.715 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy/phy-isp1301.ko 2023-08-25T03:48:13.715 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/phy/phy-tahvo.ko 2023-08-25T03:48:13.715 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ 2023-08-25T03:48:13.715 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/aircable.ko 2023-08-25T03:48:13.715 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ark3116.ko 2023-08-25T03:48:13.715 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-25T03:48:13.716 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ch341.ko 2023-08-25T03:48:13.716 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cp210x.ko 2023-08-25T03:48:13.716 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cyberjack.ko 2023-08-25T03:48:13.716 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-25T03:48:13.716 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-25T03:48:13.717 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/empeg.ko 2023-08-25T03:48:13.717 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/f81232.ko 2023-08-25T03:48:13.717 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 175153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-25T03:48:13.718 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-25T03:48:13.718 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 137113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-25T03:48:13.718 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 124681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/io_ti.ko 2023-08-25T03:48:13.718 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ipaq.ko 2023-08-25T03:48:13.718 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ipw.ko 2023-08-25T03:48:13.718 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ir-usb.ko 2023-08-25T03:48:13.718 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-25T03:48:13.718 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 107425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/keyspan.ko 2023-08-25T03:48:13.719 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-25T03:48:13.719 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-25T03:48:13.719 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-25T03:48:13.719 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mct_u232.ko 2023-08-25T03:48:13.719 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/metro-usb.ko 2023-08-25T03:48:13.719 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mos7720.ko 2023-08-25T03:48:13.720 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mos7840.ko 2023-08-25T03:48:13.720 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 56601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/mxuport.ko 2023-08-25T03:48:13.720 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/navman.ko 2023-08-25T03:48:13.720 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/omninet.ko 2023-08-25T03:48:13.720 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/opticon.ko 2023-08-25T03:48:13.720 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 190241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/option.ko 2023-08-25T03:48:13.721 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/oti6858.ko 2023-08-25T03:48:13.721 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/pl2303.ko 2023-08-25T03:48:13.721 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/qcaux.ko 2023-08-25T03:48:13.721 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/qcserial.ko 2023-08-25T03:48:13.722 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/quatech2.ko 2023-08-25T03:48:13.722 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/safe_serial.ko 2023-08-25T03:48:13.722 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/sierra.ko 2023-08-25T03:48:13.722 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-25T03:48:13.722 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ssu100.ko 2023-08-25T03:48:13.722 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/symbolserial.ko 2023-08-25T03:48:13.723 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-25T03:48:13.723 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-25T03:48:13.723 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb_debug.ko 2023-08-25T03:48:13.723 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-25T03:48:13.723 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 125529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/usbserial.ko 2023-08-25T03:48:13.724 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/visor.ko 2023-08-25T03:48:13.724 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/whiteheat.ko 2023-08-25T03:48:13.724 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/wishbone-serial.ko 2023-08-25T03:48:13.724 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-25T03:48:13.724 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ 2023-08-25T03:48:13.725 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/uas.ko 2023-08-25T03:48:13.725 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-25T03:48:13.725 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-25T03:48:13.725 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-25T03:48:13.725 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-25T03:48:13.725 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-25T03:48:13.725 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-25T03:48:13.726 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-25T03:48:13.726 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-karma.ko 2023-08-25T03:48:13.726 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-25T03:48:13.726 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-25T03:48:13.726 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-25T03:48:13.726 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-25T03:48:13.726 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-25T03:48:13.726 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 180057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/storage/usb-storage.ko 2023-08-25T03:48:13.727 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/ 2023-08-25T03:48:13.727 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-25T03:48:13.727 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 71369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-25T03:48:13.727 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 105425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-25T03:48:13.727 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/ 2023-08-25T03:48:13.727 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci/ 2023-08-25T03:48:13.728 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 153721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-25T03:48:13.728 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-25T03:48:13.728 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 100601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/vfio.ko 2023-08-25T03:48:13.728 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 75145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-25T03:48:13.728 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/ 2023-08-25T03:48:13.729 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 113897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost.ko 2023-08-25T03:48:13.729 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-25T03:48:13.729 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_net.ko 2023-08-25T03:48:13.729 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 89297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/vhost/vhost_scsi.ko 2023-08-25T03:48:13.730 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/ 2023-08-25T03:48:13.730 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/ 2023-08-25T03:48:13.730 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-08-25T03:48:13.730 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/aat2870_bl.ko 2023-08-25T03:48:13.730 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/adp5520_bl.ko 2023-08-25T03:48:13.731 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/adp8860_bl.ko 2023-08-25T03:48:13.731 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/adp8870_bl.ko 2023-08-25T03:48:13.731 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/apple_bl.ko 2023-08-25T03:48:13.731 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16785 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/as3711_bl.ko 2023-08-25T03:48:13.731 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/bd6107.ko 2023-08-25T03:48:13.732 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/da903x_bl.ko 2023-08-25T03:48:13.732 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/da9052_bl.ko 2023-08-25T03:48:13.732 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/gpio_backlight.ko 2023-08-25T03:48:13.732 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/kb3886_bl.ko 2023-08-25T03:48:13.732 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/lcd.ko 2023-08-25T03:48:13.732 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/lm3533_bl.ko 2023-08-25T03:48:13.732 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/lm3639_bl.ko 2023-08-25T03:48:13.733 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/lv5207lp.ko 2023-08-25T03:48:13.733 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/max8925_bl.ko 2023-08-25T03:48:13.733 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/pandora_bl.ko 2023-08-25T03:48:13.733 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-08-25T03:48:13.733 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-25T03:48:13.733 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/video/backlight/wm831x_bl.ko 2023-08-25T03:48:13.733 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/ 2023-08-25T03:48:13.734 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/ 2023-08-25T03:48:13.734 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/ds2482.ko 2023-08-25T03:48:13.734 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/ds2490.ko 2023-08-25T03:48:13.734 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/matrox_w1.ko 2023-08-25T03:48:13.734 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12425 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/masters/w1-gpio.ko 2023-08-25T03:48:13.734 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/ 2023-08-25T03:48:13.734 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-25T03:48:13.735 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-25T03:48:13.735 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-25T03:48:13.735 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-25T03:48:13.735 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-25T03:48:13.736 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-25T03:48:13.736 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-25T03:48:13.736 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-25T03:48:13.736 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-25T03:48:13.736 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-25T03:48:13.736 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 56433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-25T03:48:13.737 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 102689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/w1/wire.ko 2023-08-25T03:48:13.737 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ 2023-08-25T03:48:13.737 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/acquirewdt.ko 2023-08-25T03:48:13.737 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19985 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/advantechwdt.ko 2023-08-25T03:48:13.737 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-25T03:48:13.737 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-25T03:48:13.738 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/cpu5wdt.ko 2023-08-25T03:48:13.738 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/da9052_wdt.ko 2023-08-25T03:48:13.738 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12785 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/da9055_wdt.ko 2023-08-25T03:48:13.738 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/da9063_wdt.ko 2023-08-25T03:48:13.738 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/dw_wdt.ko 2023-08-25T03:48:13.738 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/eurotechwdt.ko 2023-08-25T03:48:13.738 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-25T03:48:13.739 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/hpwdt.ko 2023-08-25T03:48:13.739 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/i6300esb.ko 2023-08-25T03:48:13.739 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-25T03:48:13.739 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-25T03:48:13.739 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ib700wdt.ko 2023-08-25T03:48:13.739 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ibmasr.ko 2023-08-25T03:48:13.740 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-25T03:48:13.740 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-25T03:48:13.740 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/it87_wdt.ko 2023-08-25T03:48:13.740 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/kempld_wdt.ko 2023-08-25T03:48:13.740 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/machzwd.ko 2023-08-25T03:48:13.740 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/mena21_wdt.ko 2023-08-25T03:48:13.741 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-08-25T03:48:13.741 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/nv_tco.ko 2023-08-25T03:48:13.741 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-08-25T03:48:13.741 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/pc87413_wdt.ko 2023-08-25T03:48:13.741 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-25T03:48:13.741 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-25T03:48:13.742 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/retu_wdt.ko 2023-08-25T03:48:13.742 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-08-25T03:48:13.742 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-08-25T03:48:13.742 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-25T03:48:13.742 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sc1200wdt.ko 2023-08-25T03:48:13.743 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-25T03:48:13.743 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-08-25T03:48:13.743 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/softdog.ko 2023-08-25T03:48:13.743 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-25T03:48:13.743 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/twl4030_wdt.ko 2023-08-25T03:48:13.743 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/via_wdt.ko 2023-08-25T03:48:13.744 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-25T03:48:13.744 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-25T03:48:13.744 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-25T03:48:13.744 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/wafer5823wdt.ko 2023-08-25T03:48:13.744 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/wdt_pci.ko 2023-08-25T03:48:13.745 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/wm831x_wdt.ko 2023-08-25T03:48:13.745 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/wm8350_wdt.ko 2023-08-25T03:48:13.745 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/watchdog/xen_wdt.ko 2023-08-25T03:48:13.745 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/ 2023-08-25T03:48:13.745 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-evtchn.ko 2023-08-25T03:48:13.745 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-gntalloc.ko 2023-08-25T03:48:13.746 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-gntdev.ko 2023-08-25T03:48:13.746 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-pciback/ 2023-08-25T03:48:13.746 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 176465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-25T03:48:13.746 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-privcmd.ko 2023-08-25T03:48:13.746 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 71329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xen-scsiback.ko 2023-08-25T03:48:13.746 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xenfs/ 2023-08-25T03:48:13.746 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-25T03:48:13.747 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ 2023-08-25T03:48:13.747 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/9p/ 2023-08-25T03:48:13.747 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 165689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/9p/9p.ko 2023-08-25T03:48:13.747 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/adfs/ 2023-08-25T03:48:13.747 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/adfs/adfs.ko 2023-08-25T03:48:13.747 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/affs/ 2023-08-25T03:48:13.747 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 162657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/affs/affs.ko 2023-08-25T03:48:13.748 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/afs/ 2023-08-25T03:48:13.748 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 932105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/afs/kafs.ko 2023-08-25T03:48:13.748 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/autofs/ 2023-08-25T03:48:13.748 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 100977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/autofs/autofs4.ko 2023-08-25T03:48:13.748 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/befs/ 2023-08-25T03:48:13.748 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 64521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/befs/befs.ko 2023-08-25T03:48:13.748 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/bfs/ 2023-08-25T03:48:13.748 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/bfs/bfs.ko 2023-08-25T03:48:13.749 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/binfmt_misc.ko 2023-08-25T03:48:13.749 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/btrfs/ 2023-08-25T03:48:13.749 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 3474545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/btrfs/btrfs.ko 2023-08-25T03:48:13.749 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cachefiles/ 2023-08-25T03:48:13.749 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 305793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cachefiles/cachefiles.ko 2023-08-25T03:48:13.749 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ceph/ 2023-08-25T03:48:13.749 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1316241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ceph/ceph.ko 2023-08-25T03:48:13.749 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/coda/ 2023-08-25T03:48:13.750 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 100561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/coda/coda.ko 2023-08-25T03:48:13.750 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/configfs/ 2023-08-25T03:48:13.750 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 108105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/configfs/configfs.ko 2023-08-25T03:48:13.750 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cramfs/ 2023-08-25T03:48:13.750 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/cramfs/cramfs.ko 2023-08-25T03:48:13.750 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/dlm/ 2023-08-25T03:48:13.751 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 633913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/dlm/dlm.ko 2023-08-25T03:48:13.751 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/efs/ 2023-08-25T03:48:13.751 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/efs/efs.ko 2023-08-25T03:48:13.751 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/f2fs/ 2023-08-25T03:48:13.752 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1500617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/f2fs/f2fs.ko 2023-08-25T03:48:13.752 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/ 2023-08-25T03:48:13.753 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fat/msdos.ko 2023-08-25T03:48:13.753 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/freevxfs/ 2023-08-25T03:48:13.753 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/freevxfs/freevxfs.ko 2023-08-25T03:48:13.753 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fscache/ 2023-08-25T03:48:13.753 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 226545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fscache/fscache.ko 2023-08-25T03:48:13.754 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse/ 2023-08-25T03:48:13.754 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/fuse/cuse.ko 2023-08-25T03:48:13.754 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/gfs2/ 2023-08-25T03:48:13.754 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1226505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/gfs2/gfs2.ko 2023-08-25T03:48:13.754 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfs/ 2023-08-25T03:48:13.754 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 141321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfs/hfs.ko 2023-08-25T03:48:13.754 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfsplus/ 2023-08-25T03:48:13.755 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 221657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hfsplus/hfsplus.ko 2023-08-25T03:48:13.755 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hpfs/ 2023-08-25T03:48:13.755 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 193649 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/hpfs/hpfs.ko 2023-08-25T03:48:13.755 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/isofs/ 2023-08-25T03:48:13.755 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 74441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/isofs/isofs.ko 2023-08-25T03:48:13.755 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/jfs/ 2023-08-25T03:48:13.755 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 421217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/jfs/jfs.ko 2023-08-25T03:48:13.756 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/lockd/ 2023-08-25T03:48:13.756 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 279129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/lockd/lockd.ko 2023-08-25T03:48:13.756 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/minix/ 2023-08-25T03:48:13.756 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 87873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/minix/minix.ko 2023-08-25T03:48:13.756 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/netfs/ 2023-08-25T03:48:13.756 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 124729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/netfs/netfs.ko 2023-08-25T03:48:13.756 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/ 2023-08-25T03:48:13.756 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/blocklayout/ 2023-08-25T03:48:13.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 81545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-25T03:48:13.757 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/filelayout/ 2023-08-25T03:48:13.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-25T03:48:13.757 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/flexfilelayout/ 2023-08-25T03:48:13.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 117713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-25T03:48:13.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1054001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfs.ko 2023-08-25T03:48:13.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfsv2.ko 2023-08-25T03:48:13.758 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 119825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfsv3.ko 2023-08-25T03:48:13.758 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 2041929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs/nfsv4.ko 2023-08-25T03:48:13.758 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common/ 2023-08-25T03:48:13.758 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common/grace.ko 2023-08-25T03:48:13.758 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfs_common/nfs_acl.ko 2023-08-25T03:48:13.758 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfsd/ 2023-08-25T03:48:13.758 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1505041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nfsd/nfsd.ko 2023-08-25T03:48:13.759 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nilfs2/ 2023-08-25T03:48:13.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 591521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nilfs2/nilfs2.ko 2023-08-25T03:48:13.759 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/ 2023-08-25T03:48:13.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-celtic.ko 2023-08-25T03:48:13.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-centeuro.ko 2023-08-25T03:48:13.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-croatian.ko 2023-08-25T03:48:13.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-cyrillic.ko 2023-08-25T03:48:13.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-gaelic.ko 2023-08-25T03:48:13.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-greek.ko 2023-08-25T03:48:13.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-iceland.ko 2023-08-25T03:48:13.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-inuit.ko 2023-08-25T03:48:13.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-roman.ko 2023-08-25T03:48:13.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-romanian.ko 2023-08-25T03:48:13.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/mac-turkish.ko 2023-08-25T03:48:13.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_ascii.ko 2023-08-25T03:48:13.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1250.ko 2023-08-25T03:48:13.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1251.ko 2023-08-25T03:48:13.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp1255.ko 2023-08-25T03:48:13.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp737.ko 2023-08-25T03:48:13.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp775.ko 2023-08-25T03:48:13.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp850.ko 2023-08-25T03:48:13.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp852.ko 2023-08-25T03:48:13.762 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp855.ko 2023-08-25T03:48:13.762 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp857.ko 2023-08-25T03:48:13.762 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp860.ko 2023-08-25T03:48:13.762 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp861.ko 2023-08-25T03:48:13.762 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp862.ko 2023-08-25T03:48:13.762 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp863.ko 2023-08-25T03:48:13.762 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp864.ko 2023-08-25T03:48:13.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp865.ko 2023-08-25T03:48:13.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp866.ko 2023-08-25T03:48:13.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp869.ko 2023-08-25T03:48:13.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp874.ko 2023-08-25T03:48:13.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 94145 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp932.ko 2023-08-25T03:48:13.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 142681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp936.ko 2023-08-25T03:48:13.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 165753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp949.ko 2023-08-25T03:48:13.764 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 118129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_cp950.ko 2023-08-25T03:48:13.764 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_euc-jp.ko 2023-08-25T03:48:13.764 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-1.ko 2023-08-25T03:48:13.764 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-13.ko 2023-08-25T03:48:13.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-14.ko 2023-08-25T03:48:13.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-15.ko 2023-08-25T03:48:13.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-2.ko 2023-08-25T03:48:13.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-3.ko 2023-08-25T03:48:13.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-4.ko 2023-08-25T03:48:13.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-5.ko 2023-08-25T03:48:13.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-6.ko 2023-08-25T03:48:13.766 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-7.ko 2023-08-25T03:48:13.766 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_iso8859-9.ko 2023-08-25T03:48:13.766 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-r.ko 2023-08-25T03:48:13.766 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-ru.ko 2023-08-25T03:48:13.766 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_koi8-u.ko 2023-08-25T03:48:13.766 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/nls/nls_utf8.ko 2023-08-25T03:48:13.766 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ntfs/ 2023-08-25T03:48:13.767 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 219449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ntfs/ntfs.ko 2023-08-25T03:48:13.767 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ 2023-08-25T03:48:13.767 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/cluster/ 2023-08-25T03:48:13.767 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 244217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-25T03:48:13.768 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlm/ 2023-08-25T03:48:13.768 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 440833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-25T03:48:13.768 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlmfs/ 2023-08-25T03:48:13.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-25T03:48:13.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 2590041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2.ko 2023-08-25T03:48:13.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-25T03:48:13.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-25T03:48:13.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-25T03:48:13.769 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/omfs/ 2023-08-25T03:48:13.770 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/omfs/omfs.ko 2023-08-25T03:48:13.770 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/overlayfs/ 2023-08-25T03:48:13.770 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 336945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/overlayfs/overlay.ko 2023-08-25T03:48:13.770 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/pstore/ 2023-08-25T03:48:13.770 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/pstore/ramoops.ko 2023-08-25T03:48:13.771 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/qnx4/ 2023-08-25T03:48:13.771 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/qnx4/qnx4.ko 2023-08-25T03:48:13.771 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/qnx6/ 2023-08-25T03:48:13.771 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/qnx6/qnx6.ko 2023-08-25T03:48:13.771 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/quota/ 2023-08-25T03:48:13.771 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/quota/quota_tree.ko 2023-08-25T03:48:13.772 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/quota/quota_v1.ko 2023-08-25T03:48:13.772 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/quota/quota_v2.ko 2023-08-25T03:48:13.772 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/reiserfs/ 2023-08-25T03:48:13.772 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 530825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/reiserfs/reiserfs.ko 2023-08-25T03:48:13.772 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/romfs/ 2023-08-25T03:48:13.772 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/romfs/romfs.ko 2023-08-25T03:48:13.773 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/ 2023-08-25T03:48:13.773 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/client/ 2023-08-25T03:48:13.773 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 2661417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/client/cifs.ko 2023-08-25T03:48:13.773 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common/ 2023-08-25T03:48:13.773 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common/cifs_arc4.ko 2023-08-25T03:48:13.773 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/smb/common/cifs_md4.ko 2023-08-25T03:48:13.773 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/squashfs/ 2023-08-25T03:48:13.774 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 134417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/squashfs/squashfs.ko 2023-08-25T03:48:13.774 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/sysv/ 2023-08-25T03:48:13.774 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 89777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/sysv/sysv.ko 2023-08-25T03:48:13.774 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/udf/ 2023-08-25T03:48:13.774 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 248129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/udf/udf.ko 2023-08-25T03:48:13.774 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ufs/ 2023-08-25T03:48:13.774 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 160905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/ufs/ufs.ko 2023-08-25T03:48:13.775 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/xfs/ 2023-08-25T03:48:13.775 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 3998649 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/fs/xfs/xfs.ko 2023-08-25T03:48:13.775 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/ 2023-08-25T03:48:13.775 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/locking/ 2023-08-25T03:48:13.775 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 74873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/locking/locktorture.ko 2023-08-25T03:48:13.775 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/time/ 2023-08-25T03:48:13.775 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/time/test_udelay.ko 2023-08-25T03:48:13.776 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/kernel/torture.ko 2023-08-25T03:48:13.776 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ 2023-08-25T03:48:13.776 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6841 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crc-itu-t.ko 2023-08-25T03:48:13.776 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crc7.ko 2023-08-25T03:48:13.776 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crc8.ko 2023-08-25T03:48:13.776 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto/ 2023-08-25T03:48:13.776 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto/libarc4.ko 2023-08-25T03:48:13.777 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/crypto/libdes.ko 2023-08-25T03:48:13.777 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/interval_tree_test.ko 2023-08-25T03:48:13.777 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/libcrc32c.ko 2023-08-25T03:48:13.777 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lru_cache.ko 2023-08-25T03:48:13.777 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4/ 2023-08-25T03:48:13.777 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4/lz4_compress.ko 2023-08-25T03:48:13.777 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22641 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/lz4/lz4hc_compress.ko 2023-08-25T03:48:13.777 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/math/ 2023-08-25T03:48:13.778 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/math/cordic.ko 2023-08-25T03:48:13.778 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/memory-notifier-error-inject.ko 2023-08-25T03:48:13.778 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/notifier-error-inject.ko 2023-08-25T03:48:13.778 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/percpu_test.ko 2023-08-25T03:48:13.778 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/pm-notifier-error-inject.ko 2023-08-25T03:48:13.778 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/raid6/ 2023-08-25T03:48:13.778 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 143521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/raid6/raid6_pq.ko 2023-08-25T03:48:13.778 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/rbtree_test.ko 2023-08-25T03:48:13.779 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/reed_solomon/ 2023-08-25T03:48:13.779 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-25T03:48:13.779 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/test-kstrtox.ko 2023-08-25T03:48:13.779 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/test-string_helpers.ko 2023-08-25T03:48:13.779 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 4760833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/test_bpf.ko 2023-08-25T03:48:13.779 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/test_firmware.ko 2023-08-25T03:48:13.779 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6377 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/test_module.ko 2023-08-25T03:48:13.780 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/test_user_copy.ko 2023-08-25T03:48:13.780 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_bm.ko 2023-08-25T03:48:13.780 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_fsm.ko 2023-08-25T03:48:13.780 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/ts_kmp.ko 2023-08-25T03:48:13.780 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/xz/ 2023-08-25T03:48:13.780 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/lib/xz/xz_dec_test.ko 2023-08-25T03:48:13.781 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/mm/ 2023-08-25T03:48:13.781 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/mm/hwpoison-inject.ko 2023-08-25T03:48:13.781 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ 2023-08-25T03:48:13.781 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/ 2023-08-25T03:48:13.781 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/6lowpan.ko 2023-08-25T03:48:13.781 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_dest.ko 2023-08-25T03:48:13.781 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_fragment.ko 2023-08-25T03:48:13.782 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_hop.ko 2023-08-25T03:48:13.782 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-25T03:48:13.782 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_mobility.ko 2023-08-25T03:48:13.782 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_routing.ko 2023-08-25T03:48:13.782 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/6lowpan/nhc_udp.ko 2023-08-25T03:48:13.782 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/ 2023-08-25T03:48:13.783 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/garp.ko 2023-08-25T03:48:13.783 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/mrp.ko 2023-08-25T03:48:13.783 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/p8022.ko 2023-08-25T03:48:13.783 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/psnap.ko 2023-08-25T03:48:13.783 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/802/stp.ko 2023-08-25T03:48:13.783 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/8021q/ 2023-08-25T03:48:13.783 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 81049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/8021q/8021q.ko 2023-08-25T03:48:13.783 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/ 2023-08-25T03:48:13.784 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 198489 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet.ko 2023-08-25T03:48:13.784 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_fd.ko 2023-08-25T03:48:13.784 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_rdma.ko 2023-08-25T03:48:13.784 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/9p/9pnet_virtio.ko 2023-08-25T03:48:13.784 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/batman-adv/ 2023-08-25T03:48:13.784 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 652673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/batman-adv/batman-adv.ko 2023-08-25T03:48:13.784 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/ 2023-08-25T03:48:13.784 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 63833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/br_netfilter.ko 2023-08-25T03:48:13.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 772633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/bridge.ko 2023-08-25T03:48:13.785 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ 2023-08-25T03:48:13.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-25T03:48:13.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-25T03:48:13.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-25T03:48:13.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-25T03:48:13.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-25T03:48:13.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-25T03:48:13.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-25T03:48:13.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-25T03:48:13.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-25T03:48:13.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7593 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-25T03:48:13.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-25T03:48:13.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8393 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-25T03:48:13.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-25T03:48:13.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-25T03:48:13.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-25T03:48:13.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-25T03:48:13.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-25T03:48:13.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-25T03:48:13.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-25T03:48:13.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-25T03:48:13.788 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/ebtables.ko 2023-08-25T03:48:13.788 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-25T03:48:13.788 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-25T03:48:13.788 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ceph/ 2023-08-25T03:48:13.788 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1047057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ceph/libceph.ko 2023-08-25T03:48:13.788 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core/ 2023-08-25T03:48:13.788 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 124801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/core/pktgen.ko 2023-08-25T03:48:13.788 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/ 2023-08-25T03:48:13.789 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 194385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp.ko 2023-08-25T03:48:13.789 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8673 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_diag.ko 2023-08-25T03:48:13.789 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 56953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_ipv4.ko 2023-08-25T03:48:13.789 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dccp/dccp_ipv6.ko 2023-08-25T03:48:13.789 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/ 2023-08-25T03:48:13.789 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 390353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/dsa_core.ko 2023-08-25T03:48:13.789 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_brcm.ko 2023-08-25T03:48:13.789 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_dsa.ko 2023-08-25T03:48:13.790 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_none.ko 2023-08-25T03:48:13.790 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/dsa/tag_trailer.ko 2023-08-25T03:48:13.790 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/hsr/ 2023-08-25T03:48:13.790 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 100297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/hsr/hsr.ko 2023-08-25T03:48:13.790 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/ 2023-08-25T03:48:13.790 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/6lowpan/ 2023-08-25T03:48:13.791 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-25T03:48:13.791 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 254649 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/ieee802154.ko 2023-08-25T03:48:13.791 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-25T03:48:13.791 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ 2023-08-25T03:48:13.791 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ah4.ko 2023-08-25T03:48:13.791 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/esp4.ko 2023-08-25T03:48:13.791 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/fou.ko 2023-08-25T03:48:13.791 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/gre.ko 2023-08-25T03:48:13.792 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48537 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/inet_diag.ko 2023-08-25T03:48:13.792 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_gre.ko 2023-08-25T03:48:13.792 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_tunnel.ko 2023-08-25T03:48:13.792 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ip_vti.ko 2023-08-25T03:48:13.792 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ipcomp.ko 2023-08-25T03:48:13.793 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28897 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/ipip.ko 2023-08-25T03:48:13.793 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ 2023-08-25T03:48:13.793 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-25T03:48:13.793 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-25T03:48:13.793 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-25T03:48:13.793 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ip_tables.ko 2023-08-25T03:48:13.794 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-25T03:48:13.794 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-08-25T03:48:13.794 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-25T03:48:13.794 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-25T03:48:13.794 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-25T03:48:13.795 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-08-25T03:48:13.795 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-25T03:48:13.795 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-25T03:48:13.795 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-25T03:48:13.795 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-25T03:48:13.795 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-25T03:48:13.795 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-25T03:48:13.796 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-25T03:48:13.796 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-25T03:48:13.796 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-25T03:48:13.796 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20569 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-08-25T03:48:13.796 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-25T03:48:13.797 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15233 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-25T03:48:13.797 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-25T03:48:13.798 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-25T03:48:13.798 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-25T03:48:13.798 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_bic.ko 2023-08-25T03:48:13.799 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_dctcp.ko 2023-08-25T03:48:13.799 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_diag.ko 2023-08-25T03:48:13.801 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_highspeed.ko 2023-08-25T03:48:13.801 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_htcp.ko 2023-08-25T03:48:13.801 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_hybla.ko 2023-08-25T03:48:13.802 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_illinois.ko 2023-08-25T03:48:13.802 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_lp.ko 2023-08-25T03:48:13.802 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_scalable.ko 2023-08-25T03:48:13.802 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_vegas.ko 2023-08-25T03:48:13.802 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_veno.ko 2023-08-25T03:48:13.802 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_westwood.ko 2023-08-25T03:48:13.803 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tcp_yeah.ko 2023-08-25T03:48:13.803 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/tunnel4.ko 2023-08-25T03:48:13.803 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16369 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/udp_diag.ko 2023-08-25T03:48:13.803 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/udp_tunnel.ko 2023-08-25T03:48:13.803 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-25T03:48:13.803 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ 2023-08-25T03:48:13.804 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ah6.ko 2023-08-25T03:48:13.804 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/esp6.ko 2023-08-25T03:48:13.804 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/fou6.ko 2023-08-25T03:48:13.804 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 80801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_gre.ko 2023-08-25T03:48:13.804 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 92825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_tunnel.ko 2023-08-25T03:48:13.804 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-25T03:48:13.805 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ip6_vti.ko 2023-08-25T03:48:13.805 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/ipcomp6.ko 2023-08-25T03:48:13.805 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19025 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/mip6.ko 2023-08-25T03:48:13.805 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ 2023-08-25T03:48:13.805 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-25T03:48:13.805 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-08-25T03:48:13.805 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-25T03:48:13.806 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-25T03:48:13.806 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-25T03:48:13.806 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-25T03:48:13.806 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-25T03:48:13.806 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-25T03:48:13.806 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-25T03:48:13.806 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-25T03:48:13.806 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10945 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-25T03:48:13.807 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-25T03:48:13.807 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-25T03:48:13.807 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-25T03:48:13.807 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-25T03:48:13.807 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11625 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-25T03:48:13.807 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-25T03:48:13.807 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-25T03:48:13.808 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-25T03:48:13.808 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-25T03:48:13.808 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-25T03:48:13.808 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-25T03:48:13.808 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9641 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-25T03:48:13.808 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-25T03:48:13.808 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9017 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-25T03:48:13.808 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/sit.ko 2023-08-25T03:48:13.809 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24201 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/tunnel6.ko 2023-08-25T03:48:13.809 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23313 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-25T03:48:13.809 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/key/ 2023-08-25T03:48:13.809 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 82937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/key/af_key.ko 2023-08-25T03:48:13.809 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/ 2023-08-25T03:48:13.809 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 125881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_core.ko 2023-08-25T03:48:13.809 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-25T03:48:13.809 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_eth.ko 2023-08-25T03:48:13.810 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35057 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ip.ko 2023-08-25T03:48:13.810 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ip6.ko 2023-08-25T03:48:13.810 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_netlink.ko 2023-08-25T03:48:13.810 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/l2tp/l2tp_ppp.ko 2023-08-25T03:48:13.810 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/lapb/ 2023-08-25T03:48:13.810 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/lapb/lapb.ko 2023-08-25T03:48:13.811 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/llc/ 2023-08-25T03:48:13.811 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23249 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/llc/llc.ko 2023-08-25T03:48:13.811 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 267329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/llc/llc2.ko 2023-08-25T03:48:13.811 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mac802154/ 2023-08-25T03:48:13.811 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 291105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mac802154/mac802154.ko 2023-08-25T03:48:13.811 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mpls/ 2023-08-25T03:48:13.811 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/mpls/mpls_gso.ko 2023-08-25T03:48:13.812 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ 2023-08-25T03:48:13.812 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ 2023-08-25T03:48:13.812 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 119665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set.ko 2023-08-25T03:48:13.812 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-25T03:48:13.812 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-25T03:48:13.812 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-25T03:48:13.813 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 102041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-25T03:48:13.813 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 103129 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-25T03:48:13.813 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 104601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-25T03:48:13.813 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 105137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-25T03:48:13.813 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 114401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-25T03:48:13.813 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-25T03:48:13.813 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 111169 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-25T03:48:13.814 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 114681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-25T03:48:13.814 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 114337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-25T03:48:13.814 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 113225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-25T03:48:13.814 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 116225 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-25T03:48:13.814 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-25T03:48:13.814 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ 2023-08-25T03:48:13.814 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 412969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-25T03:48:13.814 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-25T03:48:13.815 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-25T03:48:13.815 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-25T03:48:13.815 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-25T03:48:13.815 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-25T03:48:13.815 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-25T03:48:13.815 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-25T03:48:13.816 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10689 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-25T03:48:13.816 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-25T03:48:13.816 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-25T03:48:13.816 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-25T03:48:13.816 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7705 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-25T03:48:13.816 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11001 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-25T03:48:13.816 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conncount.ko 2023-08-25T03:48:13.816 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 408777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack.ko 2023-08-25T03:48:13.817 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-25T03:48:13.817 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10185 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-25T03:48:13.817 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33769 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-25T03:48:13.817 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 118153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-25T03:48:13.817 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-25T03:48:13.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-25T03:48:13.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 108401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-25T03:48:13.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-25T03:48:13.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-25T03:48:13.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66649 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-25T03:48:13.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-25T03:48:13.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-25T03:48:13.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10121 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-25T03:48:13.819 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 88529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_flow_table.ko 2023-08-25T03:48:13.819 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9601 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-25T03:48:13.819 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_log_syslog.ko 2023-08-25T03:48:13.819 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 95385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat.ko 2023-08-25T03:48:13.819 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-25T03:48:13.819 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-25T03:48:13.820 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_irc.ko 2023-08-25T03:48:13.820 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28937 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_sip.ko 2023-08-25T03:48:13.820 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-25T03:48:13.820 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-25T03:48:13.820 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 609385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nf_tables.ko 2023-08-25T03:48:13.820 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink.ko 2023-08-25T03:48:13.821 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-25T03:48:13.821 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-08-25T03:48:13.821 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39913 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_log.ko 2023-08-25T03:48:13.821 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22721 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-25T03:48:13.821 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-25T03:48:13.821 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_chain_nat.ko 2023-08-25T03:48:13.821 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_compat.ko 2023-08-25T03:48:13.822 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40729 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_ct.ko 2023-08-25T03:48:13.822 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-25T03:48:13.822 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11353 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_fib.ko 2023-08-25T03:48:13.822 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13753 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-25T03:48:13.822 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14193 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_hash.ko 2023-08-25T03:48:13.822 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_limit.ko 2023-08-25T03:48:13.822 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_log.ko 2023-08-25T03:48:13.823 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_masq.ko 2023-08-25T03:48:13.823 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_nat.ko 2023-08-25T03:48:13.823 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13681 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_numgen.ko 2023-08-25T03:48:13.823 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_osf.ko 2023-08-25T03:48:13.823 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_queue.ko 2023-08-25T03:48:13.824 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_redir.ko 2023-08-25T03:48:13.824 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_reject.ko 2023-08-25T03:48:13.824 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_reject_inet.ko 2023-08-25T03:48:13.824 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12745 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_socket.ko 2023-08-25T03:48:13.824 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20401 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_synproxy.ko 2023-08-25T03:48:13.825 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/nft_tproxy.ko 2023-08-25T03:48:13.825 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 89337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/x_tables.ko 2023-08-25T03:48:13.825 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12105 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_AUDIT.ko 2023-08-25T03:48:13.825 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9641 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-25T03:48:13.825 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-25T03:48:13.825 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-25T03:48:13.826 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18177 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_CT.ko 2023-08-25T03:48:13.826 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_DSCP.ko 2023-08-25T03:48:13.826 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_HL.ko 2023-08-25T03:48:13.826 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_HMARK.ko 2023-08-25T03:48:13.827 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38865 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-25T03:48:13.827 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13881 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_LED.ko 2023-08-25T03:48:13.827 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_LOG.ko 2023-08-25T03:48:13.827 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-25T03:48:13.827 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NETMAP.ko 2023-08-25T03:48:13.828 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NFLOG.ko 2023-08-25T03:48:13.828 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13297 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-25T03:48:13.828 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19697 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_RATEEST.ko 2023-08-25T03:48:13.828 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-25T03:48:13.828 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_SECMARK.ko 2023-08-25T03:48:13.828 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-25T03:48:13.829 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-25T03:48:13.829 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17377 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TEE.ko 2023-08-25T03:48:13.829 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TPROXY.ko 2023-08-25T03:48:13.829 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_TRACE.ko 2023-08-25T03:48:13.829 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_addrtype.ko 2023-08-25T03:48:13.830 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_bpf.ko 2023-08-25T03:48:13.830 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15585 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cgroup.ko 2023-08-25T03:48:13.830 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11217 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cluster.ko 2023-08-25T03:48:13.830 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_comment.ko 2023-08-25T03:48:13.830 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10473 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connbytes.ko 2023-08-25T03:48:13.830 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11089 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connlabel.ko 2023-08-25T03:48:13.831 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connlimit.ko 2023-08-25T03:48:13.831 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_connmark.ko 2023-08-25T03:48:13.831 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12409 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_conntrack.ko 2023-08-25T03:48:13.831 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_cpu.ko 2023-08-25T03:48:13.831 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_dccp.ko 2023-08-25T03:48:13.831 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_devgroup.ko 2023-08-25T03:48:13.831 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_dscp.ko 2023-08-25T03:48:13.832 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ecn.ko 2023-08-25T03:48:13.832 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_esp.ko 2023-08-25T03:48:13.832 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_hashlimit.ko 2023-08-25T03:48:13.832 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_helper.ko 2023-08-25T03:48:13.832 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_hl.ko 2023-08-25T03:48:13.832 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11929 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ipcomp.ko 2023-08-25T03:48:13.832 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_iprange.ko 2023-08-25T03:48:13.832 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11793 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_ipvs.ko 2023-08-25T03:48:13.833 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_l2tp.ko 2023-08-25T03:48:13.833 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_length.ko 2023-08-25T03:48:13.833 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_limit.ko 2023-08-25T03:48:13.833 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_mac.ko 2023-08-25T03:48:13.833 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8649 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_mark.ko 2023-08-25T03:48:13.833 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11833 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_multiport.ko 2023-08-25T03:48:13.833 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_nat.ko 2023-08-25T03:48:13.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_nfacct.ko 2023-08-25T03:48:13.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8305 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_osf.ko 2023-08-25T03:48:13.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_owner.ko 2023-08-25T03:48:13.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_physdev.ko 2023-08-25T03:48:13.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7641 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_pkttype.ko 2023-08-25T03:48:13.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_policy.ko 2023-08-25T03:48:13.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_quota.ko 2023-08-25T03:48:13.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_rateest.ko 2023-08-25T03:48:13.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8265 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_realm.ko 2023-08-25T03:48:13.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_recent.ko 2023-08-25T03:48:13.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13337 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_sctp.ko 2023-08-25T03:48:13.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_set.ko 2023-08-25T03:48:13.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16097 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_socket.ko 2023-08-25T03:48:13.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9513 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_state.ko 2023-08-25T03:48:13.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9481 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_statistic.ko 2023-08-25T03:48:13.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8817 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_string.ko 2023-08-25T03:48:13.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8561 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_tcpmss.ko 2023-08-25T03:48:13.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15785 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_tcpudp.ko 2023-08-25T03:48:13.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_time.ko 2023-08-25T03:48:13.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9113 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netfilter/xt_u32.ko 2023-08-25T03:48:13.836 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netlink/ 2023-08-25T03:48:13.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13977 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/netlink/netlink_diag.ko 2023-08-25T03:48:13.836 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/nsh/ 2023-08-25T03:48:13.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/nsh/nsh.ko 2023-08-25T03:48:13.837 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/ 2023-08-25T03:48:13.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 379609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/openvswitch.ko 2023-08-25T03:48:13.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10329 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-geneve.ko 2023-08-25T03:48:13.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9457 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-gre.ko 2023-08-25T03:48:13.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/openvswitch/vport-vxlan.ko 2023-08-25T03:48:13.837 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/packet/ 2023-08-25T03:48:13.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/packet/af_packet_diag.ko 2023-08-25T03:48:13.838 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/phonet/ 2023-08-25T03:48:13.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 109993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/phonet/phonet.ko 2023-08-25T03:48:13.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/phonet/pn_pep.ko 2023-08-25T03:48:13.838 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/ 2023-08-25T03:48:13.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 252969 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds.ko 2023-08-25T03:48:13.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 165137 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds_rdma.ko 2023-08-25T03:48:13.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rds/rds_tcp.ko 2023-08-25T03:48:13.838 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rxrpc/ 2023-08-25T03:48:13.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 820289 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/rxrpc/rxrpc.ko 2023-08-25T03:48:13.839 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/ 2023-08-25T03:48:13.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_csum.ko 2023-08-25T03:48:13.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23545 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_gact.ko 2023-08-25T03:48:13.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_ipt.ko 2023-08-25T03:48:13.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_mirred.ko 2023-08-25T03:48:13.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_nat.ko 2023-08-25T03:48:13.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43825 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_pedit.ko 2023-08-25T03:48:13.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31993 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_police.ko 2023-08-25T03:48:13.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20321 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_simple.ko 2023-08-25T03:48:13.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_skbedit.ko 2023-08-25T03:48:13.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36065 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/act_vlan.ko 2023-08-25T03:48:13.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26153 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_basic.ko 2023-08-25T03:48:13.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33953 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_bpf.ko 2023-08-25T03:48:13.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19241 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_cgroup.ko 2023-08-25T03:48:13.841 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31385 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_flow.ko 2023-08-25T03:48:13.841 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31777 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_fw.ko 2023-08-25T03:48:13.841 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38497 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_route.ko 2023-08-25T03:48:13.841 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/cls_u32.ko 2023-08-25T03:48:13.841 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_cmp.ko 2023-08-25T03:48:13.841 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_ipset.ko 2023-08-25T03:48:13.841 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33345 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_meta.ko 2023-08-25T03:48:13.841 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_nbyte.ko 2023-08-25T03:48:13.842 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10633 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_text.ko 2023-08-25T03:48:13.842 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7257 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/em_u32.ko 2023-08-25T03:48:13.842 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21657 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_choke.ko 2023-08-25T03:48:13.842 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_codel.ko 2023-08-25T03:48:13.842 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33761 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_drr.ko 2023-08-25T03:48:13.842 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33617 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_fq.ko 2023-08-25T03:48:13.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_fq_codel.ko 2023-08-25T03:48:13.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35441 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_gred.ko 2023-08-25T03:48:13.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48417 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_hfsc.ko 2023-08-25T03:48:13.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22081 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_hhf.ko 2023-08-25T03:48:13.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 65801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_htb.ko 2023-08-25T03:48:13.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_ingress.ko 2023-08-25T03:48:13.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30281 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_mqprio.ko 2023-08-25T03:48:13.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10801 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_mqprio_lib.ko 2023-08-25T03:48:13.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26073 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_multiq.ko 2023-08-25T03:48:13.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_netem.ko 2023-08-25T03:48:13.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27553 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_pie.ko 2023-08-25T03:48:13.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10273 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_plug.ko 2023-08-25T03:48:13.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_prio.ko 2023-08-25T03:48:13.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47857 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_qfq.ko 2023-08-25T03:48:13.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32961 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_red.ko 2023-08-25T03:48:13.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26889 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_sfb.ko 2023-08-25T03:48:13.845 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31433 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_sfq.ko 2023-08-25T03:48:13.845 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28905 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_tbf.ko 2023-08-25T03:48:13.845 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sched/sch_teql.ko 2023-08-25T03:48:13.845 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp/ 2023-08-25T03:48:13.845 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 930529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp/sctp.ko 2023-08-25T03:48:13.845 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19041 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sctp/sctp_diag.ko 2023-08-25T03:48:13.846 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/ 2023-08-25T03:48:13.846 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss/ 2023-08-25T03:48:13.846 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 335609 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-25T03:48:13.846 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61873 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-25T03:48:13.846 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1514809 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/sunrpc.ko 2023-08-25T03:48:13.849 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/xprtrdma/ 2023-08-25T03:48:13.850 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 707465 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-25T03:48:13.850 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc/ 2023-08-25T03:48:13.850 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10033 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc/diag.ko 2023-08-25T03:48:13.850 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 862505 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/tipc/tipc.ko 2023-08-25T03:48:13.850 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/unix/ 2023-08-25T03:48:13.850 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15737 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/unix/unix_diag.ko 2023-08-25T03:48:13.850 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/ 2023-08-25T03:48:13.851 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 84849 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-25T03:48:13.851 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 68049 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-25T03:48:13.851 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 96009 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock.ko 2023-08-25T03:48:13.851 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-25T03:48:13.851 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17529 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-25T03:48:13.851 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/x25/ 2023-08-25T03:48:13.851 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 125161 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/x25/x25.ko 2023-08-25T03:48:13.851 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/xfrm/ 2023-08-25T03:48:13.852 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22665 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/xfrm/xfrm_algo.ko 2023-08-25T03:48:13.852 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20713 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-25T03:48:13.852 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 102361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/net/xfrm/xfrm_user.ko 2023-08-25T03:48:13.852 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt/ 2023-08-25T03:48:13.852 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt/lib/ 2023-08-25T03:48:13.852 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15521 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/kernel/virt/lib/irqbypass.ko 2023-08-25T03:48:13.852 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 638591 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.alias 2023-08-25T03:48:13.853 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 624324 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.alias.bin 2023-08-25T03:48:13.853 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7656 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin 2023-08-25T03:48:13.853 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23361 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin.alias.bin 2023-08-25T03:48:13.853 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9821 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin.bin 2023-08-25T03:48:13.853 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 69921 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.builtin.modinfo 2023-08-25T03:48:13.853 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 146449 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.dep 2023-08-25T03:48:13.853 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 232695 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.dep.bin 2023-08-25T03:48:13.854 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 210 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.devname 2023-08-25T03:48:13.854 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 72754 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.order 2023-08-25T03:48:13.854 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 879 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.softdep 2023-08-25T03:48:13.854 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 252880 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.symbols 2023-08-25T03:48:13.854 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 307898 2023-08-24 10:28 ./lib/modules/6.5.0-rc7-ga6a696707610/modules.symbols.bin 2023-08-25T03:48:13.854 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./usr/ 2023-08-25T03:48:13.855 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./usr/share/ 2023-08-25T03:48:13.855 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./usr/share/doc/ 2023-08-25T03:48:13.855 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2023-08-24 10:28 ./usr/share/doc/linux-image-6.5.0-rc7-ga6a696707610/ 2023-08-25T03:48:13.855 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 173 2023-08-24 10:28 ./usr/share/doc/linux-image-6.5.0-rc7-ga6a696707610/changelog.Debian.gz 2023-08-25T03:48:13.855 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 691 2023-08-24 10:28 ./usr/share/doc/linux-image-6.5.0-rc7-ga6a696707610/copyright 2023-08-25T03:48:13.856 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-ga6a696707610 2023-08-25T03:48:13.857 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc7-ga6a696707610 2023-08-25T03:48:13.857 DEBUG:teuthology.orchestra.run.smithi055:> egrep '(submenu|menuentry.*6.5.0-rc7-ga6a696707610).*{' /boot/grub/grub.cfg 2023-08-25T03:48:13.864 INFO:teuthology.orchestra.run.smithi055.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-08-25T03:48:13.865 INFO:teuthology.orchestra.run.smithi055.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc7-ga6a696707610' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc7-ga6a696707610-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-08-25T03:48:13.865 INFO:teuthology.orchestra.run.smithi055.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc7-ga6a696707610 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc7-ga6a696707610-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-08-25T03:48:13.865 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-08-25T03:48:13.866 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc7-ga6a696707610 2023-08-25T03:48:13.866 DEBUG:teuthology.orchestra.run.smithi055:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-08-25T03:48:13.910 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi055.front.sepia.ceph.com to complete... 2023-08-25T03:48:14.349 INFO:teuthology.orchestra.run.smithi055.stderr:Sourcing file `/etc/default/grub' 2023-08-25T03:48:14.350 INFO:teuthology.orchestra.run.smithi055.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-08-25T03:48:14.367 INFO:teuthology.orchestra.run.smithi055.stderr:Generating grub configuration file ... 2023-08-25T03:48:14.553 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc7-ga6a696707610 2023-08-25T03:48:14.559 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc7-ga6a696707610 2023-08-25T03:48:14.842 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-08-25T03:48:14.848 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-08-25T03:48:14.894 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-08-25T03:48:14.900 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-08-25T03:48:15.031 INFO:teuthology.orchestra.run.smithi055.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-08-25T03:48:15.031 INFO:teuthology.orchestra.run.smithi055.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-08-25T03:48:15.032 INFO:teuthology.orchestra.run.smithi055.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-08-25T03:48:15.050 INFO:teuthology.orchestra.run.smithi055.stderr:done 2023-08-25T03:48:39.052 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-08-25T03:48:39.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-08-25T03:48:39.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:48:46.164 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-08-25T03:48:46.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-08-25T03:48:46.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:49:13.716 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-08-25T03:49:22.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-08-25T03:49:22.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:49:41.104 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-08-25T03:49:46.168 DEBUG:teuthology.orchestra.remote:timed out 2023-08-25T03:49:53.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-08-25T03:49:53.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:49:53.399 DEBUG:teuthology.orchestra.run.smithi110:> true 2023-08-25T03:49:54.318 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-08-25T03:49:54.319 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc7-ga6a696707610"... 2023-08-25T03:49:54.319 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2023-08-25T03:49:54.371 INFO:teuthology.orchestra.run.smithi110.stdout:6.5.0-rc7-ga6a696707610 2023-08-25T03:49:54.371 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-ga6a696707610 vs 6.5.0-rc7-ga6a696707610 2023-08-25T03:49:54.371 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-25T03:49:54.371 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-08-25T03:49:55.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-08-25T03:49:55.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:49:55.373 DEBUG:teuthology.parallel:result is None 2023-08-25T03:49:55.505 DEBUG:teuthology.orchestra.run.smithi055:> true 2023-08-25T03:49:56.232 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-08-25T03:49:56.232 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-ga6a696707610"... 2023-08-25T03:49:56.232 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2023-08-25T03:49:56.283 INFO:teuthology.orchestra.run.smithi055.stdout:6.5.0-rc7-ga6a696707610 2023-08-25T03:49:56.284 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-ga6a696707610 vs 6.5.0-rc7-ga6a696707610 2023-08-25T03:49:56.284 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-25T03:49:56.284 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-08-25T03:49:57.285 DEBUG:teuthology.parallel:result is None 2023-08-25T03:49:57.285 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-25T03:49:57.292 INFO:teuthology.task.internal:Creating test directory... 2023-08-25T03:49:57.293 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-25T03:49:57.297 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-25T03:49:57.305 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-25T03:49:57.313 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-25T03:49:57.321 INFO:teuthology.task.internal:Creating archive directory... 2023-08-25T03:49:57.321 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-25T03:49:57.347 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-25T03:49:57.372 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-25T03:49:57.379 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-25T03:49:57.379 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-25T03:49:57.403 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-25T03:49:57.499 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-25T03:49:57.518 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-25T03:49:57.544 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-25T03:49:57.587 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-25T03:49:57.590 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-25T03:49:57.597 INFO:teuthology.task.internal:Configuring sudo... 2023-08-25T03:49:57.598 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-25T03:49:57.601 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-25T03:49:57.623 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-25T03:49:57.633 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-25T03:49:57.633 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-25T03:49:57.667 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-25T03:49:57.676 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-25T03:49:57.725 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-25T03:49:57.777 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T03:49:57.778 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-25T03:49:57.853 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-25T03:49:57.862 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-25T03:49:57.911 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T03:49:57.912 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-25T03:49:57.986 DEBUG:teuthology.orchestra.run.smithi055:> sudo service rsyslog restart 2023-08-25T03:49:57.990 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2023-08-25T03:49:58.109 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-25T03:49:58.124 INFO:teuthology.task.internal:Starting timer... 2023-08-25T03:49:58.125 INFO:teuthology.run_tasks:Running task pcp... 2023-08-25T03:49:58.142 INFO:teuthology.run_tasks:Running task selinux... 2023-08-25T03:49:58.151 DEBUG:teuthology.task.selinux:Excluding smithi055: OS 'ubuntu' does not support SELinux 2023-08-25T03:49:58.151 DEBUG:teuthology.task.selinux:Excluding smithi110: OS 'ubuntu' does not support SELinux 2023-08-25T03:49:58.152 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-25T03:49:58.152 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-08-25T03:49:58.152 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-25T03:49:58.152 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-25T03:49:58.161 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-08-25T03:49:58.167 INFO:teuthology.repo_utils:Fetching main from origin 2023-08-25T03:49:58.303 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-25T03:49:58.325 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-25T03:49:58.327 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi055.front.sepia.ceph.com,smithi110.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-25T03:59:07.034 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi055.front.sepia.ceph.com'), Remote(name='ubuntu@smithi110.front.sepia.ceph.com')] 2023-08-25T03:59:07.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-08-25T03:59:07.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:59:07.114 DEBUG:teuthology.orchestra.run.smithi055:> true 2023-08-25T03:59:07.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-08-25T03:59:07.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-08-25T03:59:07.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T03:59:07.363 DEBUG:teuthology.orchestra.run.smithi110:> true 2023-08-25T03:59:07.475 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-08-25T03:59:07.475 INFO:teuthology.run_tasks:Running task clock... 2023-08-25T03:59:07.490 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-25T03:59:07.491 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-25T03:59:07.491 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-25T03:59:07.495 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-25T03:59:07.495 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-25T03:59:07.533 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-08-25T03:59:07.534 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: Command line: ntpd -gq 2023-08-25T03:59:07.534 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: ---------------------------------------------------- 2023-08-25T03:59:07.534 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: ntp-4 is maintained by Network Time Foundation, 2023-08-25T03:59:07.534 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-08-25T03:59:07.534 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: corporation. Support and training for ntp-4 are 2023-08-25T03:59:07.534 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: available at https://www.nwtime.org/support 2023-08-25T03:59:07.534 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: ---------------------------------------------------- 2023-08-25T03:59:07.535 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: proto: precision = 0.043 usec (-24) 2023-08-25T03:59:07.535 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: basedate set to 2022-02-04 2023-08-25T03:59:07.535 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: gps base set to 2022-02-06 (week 2196) 2023-08-25T03:59:07.536 INFO:teuthology.orchestra.run.smithi055.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-08-25T03:59:07.536 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-08-25T03:59:07.537 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: restrict ::: KOD does nothing without LIMITED. 2023-08-25T03:59:07.537 INFO:teuthology.orchestra.run.smithi055.stderr:restrict ::: KOD does nothing without LIMITED. 2023-08-25T03:59:07.538 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: Listen and drop on 0 v6wildcard [::]:123 2023-08-25T03:59:07.538 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-08-25T03:59:07.538 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: Listen normally on 2 lo 127.0.0.1:123 2023-08-25T03:59:07.538 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: Listen normally on 3 ens1f0 172.21.15.55:123 2023-08-25T03:59:07.539 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: Listen normally on 4 lo [::1]:123 2023-08-25T03:59:07.539 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:2606%4]:123 2023-08-25T03:59:07.539 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:07 ntpd[27671]: Listening on routing socket on fd #22 for interface updates 2023-08-25T03:59:07.559 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-08-25T03:59:07.559 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: Command line: ntpd -gq 2023-08-25T03:59:07.560 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: ---------------------------------------------------- 2023-08-25T03:59:07.560 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: ntp-4 is maintained by Network Time Foundation, 2023-08-25T03:59:07.560 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-08-25T03:59:07.561 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: corporation. Support and training for ntp-4 are 2023-08-25T03:59:07.561 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: available at https://www.nwtime.org/support 2023-08-25T03:59:07.561 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: ---------------------------------------------------- 2023-08-25T03:59:07.562 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: proto: precision = 0.040 usec (-24) 2023-08-25T03:59:07.562 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: basedate set to 2022-02-04 2023-08-25T03:59:07.562 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: gps base set to 2022-02-06 (week 2196) 2023-08-25T03:59:07.563 INFO:teuthology.orchestra.run.smithi110.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-08-25T03:59:07.564 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-08-25T03:59:07.564 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: restrict ::: KOD does nothing without LIMITED. 2023-08-25T03:59:07.565 INFO:teuthology.orchestra.run.smithi110.stderr:restrict ::: KOD does nothing without LIMITED. 2023-08-25T03:59:07.566 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: Listen and drop on 0 v6wildcard [::]:123 2023-08-25T03:59:07.566 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-08-25T03:59:07.567 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: Listen normally on 2 lo 127.0.0.1:123 2023-08-25T03:59:07.568 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: Listen normally on 3 enp3s0f1 172.21.15.110:123 2023-08-25T03:59:07.568 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: Listen normally on 4 lo [::1]:123 2023-08-25T03:59:07.569 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc35%5]:123 2023-08-25T03:59:07.569 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:07 ntpd[27790]: Listening on routing socket on fd #22 for interface updates 2023-08-25T03:59:08.534 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:08 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:08.535 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:08 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:08.535 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:08 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:08.535 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:08 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:08.535 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:08 ntpd[27671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-25T03:59:08.536 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:08 ntpd[27671]: can't open /var/log/ntpstats/peerstats.20230825: Permission denied 2023-08-25T03:59:08.561 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:08 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:08.562 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:08 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:08.562 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:08 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:08.562 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:08 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:08.562 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:08 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:08.562 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:08 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:08.563 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:08 ntpd[27790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-25T03:59:08.563 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:08 ntpd[27790]: can't open /var/log/ntpstats/peerstats.20230825: Permission denied 2023-08-25T03:59:08.563 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:08 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:08.563 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:08 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:08.563 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:08 ntpd[27790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-25T03:59:08.564 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:08 ntpd[27790]: can't open /var/log/ntpstats/peerstats.20230825: Permission denied 2023-08-25T03:59:09.559 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:09 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:09.559 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:09 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:10.537 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:10 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:10.537 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:10 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:10.538 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:10 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:10.538 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:10 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:10.538 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:10 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:10.538 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:10 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:10.538 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:10 ntpd[27671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-25T03:59:10.539 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:10 ntpd[27671]: can't open /var/log/ntpstats/peerstats.20230825: Permission denied 2023-08-25T03:59:10.539 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:10 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:10.539 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:10 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:10.539 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:10 ntpd[27671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-25T03:59:10.540 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:10 ntpd[27671]: can't open /var/log/ntpstats/peerstats.20230825: Permission denied 2023-08-25T03:59:10.562 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:10 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:10.563 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:10 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:10.563 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:10 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:10.563 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:10 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:10.564 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:10 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:10.565 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:10 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:10.566 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:10 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:10.567 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:10 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:10.568 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:10 ntpd[27790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-25T03:59:10.568 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:10 ntpd[27790]: can't open /var/log/ntpstats/peerstats.20230825: Permission denied 2023-08-25T03:59:10.568 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:10 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:10.569 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:10 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:10.569 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:10 ntpd[27790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-25T03:59:10.570 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:10 ntpd[27790]: can't open /var/log/ntpstats/peerstats.20230825: Permission denied 2023-08-25T03:59:10.570 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:10 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:10.570 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:10 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:10.570 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:10 ntpd[27790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-25T03:59:10.571 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:10 ntpd[27790]: can't open /var/log/ntpstats/peerstats.20230825: Permission denied 2023-08-25T03:59:11.534 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:11 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:11.534 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:11 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:11.534 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:11 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:11.534 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:11 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:11.535 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:11 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:11.535 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:11 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:11.535 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:11 ntpd[27671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-25T03:59:11.535 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:11 ntpd[27671]: can't open /var/log/ntpstats/peerstats.20230825: Permission denied 2023-08-25T03:59:12.534 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:12 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:12.591 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:12 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:12.592 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:12 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:12.592 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:12 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:12.592 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:12 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:12.592 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:12 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:12.592 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:12 ntpd[27671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-25T03:59:12.593 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:12 ntpd[27671]: can't open /var/log/ntpstats/peerstats.20230825: Permission denied 2023-08-25T03:59:12.593 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:12 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:12.593 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:12 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:12.593 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:12 ntpd[27671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-25T03:59:12.593 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:12 ntpd[27671]: can't open /var/log/ntpstats/peerstats.20230825: Permission denied 2023-08-25T03:59:12.595 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:12 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:12.595 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:12 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:12.595 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:12 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:12.595 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:12 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:12.596 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:12 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:12.596 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:12 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:12.596 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:12 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:12.596 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:12 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:12.596 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:12 ntpd[27790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-25T03:59:12.596 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:12 ntpd[27790]: can't open /var/log/ntpstats/peerstats.20230825: Permission denied 2023-08-25T03:59:12.597 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:12 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:12.597 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:12 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:12.597 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:12 ntpd[27790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-25T03:59:12.597 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:12 ntpd[27790]: can't open /var/log/ntpstats/peerstats.20230825: Permission denied 2023-08-25T03:59:12.597 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:12 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:12.597 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:12 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:12.597 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:12 ntpd[27790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-25T03:59:12.597 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:12 ntpd[27790]: can't open /var/log/ntpstats/peerstats.20230825: Permission denied 2023-08-25T03:59:13.534 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:13 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:13.534 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:13 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:13.534 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:13 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:13.534 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:13 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:13.534 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:13 ntpd[27671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-25T03:59:13.534 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:13 ntpd[27671]: can't open /var/log/ntpstats/peerstats.20230825: Permission denied 2023-08-25T03:59:14.535 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:14 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:14.535 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:14 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:14.535 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:14 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:14.535 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:14 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:14.536 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:14 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:14.536 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:14 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:14.536 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:14 ntpd[27671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-25T03:59:14.537 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:14 ntpd[27671]: can't open /var/log/ntpstats/peerstats.20230825: Permission denied 2023-08-25T03:59:14.537 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:14 ntpd[27671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:14.537 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:14 ntpd[27671]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:14.537 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:14 ntpd[27671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-25T03:59:14.537 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:14 ntpd[27671]: can't open /var/log/ntpstats/peerstats.20230825: Permission denied 2023-08-25T03:59:14.538 INFO:teuthology.orchestra.run.smithi055.stdout:25 Aug 03:59:14 ntpd[27671]: ntpd: time slew -0.002341 s 2023-08-25T03:59:14.538 INFO:teuthology.orchestra.run.smithi055.stdout:ntpd: time slew -0.002341s 2023-08-25T03:59:14.539 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:14 ntpd[27671]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-08-25T03:59:14.539 INFO:teuthology.orchestra.run.smithi055.stderr:25 Aug 03:59:14 ntpd[27671]: can't open /var/log/ntpstats/loopstats.20230825: Permission denied 2023-08-25T03:59:14.560 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:14 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:14.561 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:14 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:14.561 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:14 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:14.561 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:14 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:14.562 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:14 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:14.562 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:14 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:14.562 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:14 ntpd[27790]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-25T03:59:14.562 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:14 ntpd[27790]: can't open /var/log/ntpstats/rawstats.20230825: Permission denied 2023-08-25T03:59:14.562 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:14 ntpd[27790]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-25T03:59:14.563 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:14 ntpd[27790]: can't open /var/log/ntpstats/peerstats.20230825: Permission denied 2023-08-25T03:59:14.563 INFO:teuthology.orchestra.run.smithi110.stdout:25 Aug 03:59:14 ntpd[27790]: ntpd: time slew -0.001368 s 2023-08-25T03:59:14.564 INFO:teuthology.orchestra.run.smithi110.stdout:ntpd: time slew -0.001368s 2023-08-25T03:59:14.564 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:14 ntpd[27790]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-08-25T03:59:14.565 INFO:teuthology.orchestra.run.smithi110.stderr:25 Aug 03:59:14 ntpd[27790]: can't open /var/log/ntpstats/loopstats.20230825: Permission denied 2023-08-25T03:59:14.673 INFO:teuthology.orchestra.run.smithi055.stdout: remote refid st t when poll reach delay offset jitter 2023-08-25T03:59:14.673 INFO:teuthology.orchestra.run.smithi055.stdout:============================================================================== 2023-08-25T03:59:14.674 INFO:teuthology.orchestra.run.smithi055.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-08-25T03:59:14.674 INFO:teuthology.orchestra.run.smithi055.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-08-25T03:59:14.674 INFO:teuthology.orchestra.run.smithi055.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-08-25T03:59:14.674 INFO:teuthology.orchestra.run.smithi055.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-08-25T03:59:14.691 INFO:teuthology.orchestra.run.smithi110.stdout: remote refid st t when poll reach delay offset jitter 2023-08-25T03:59:14.691 INFO:teuthology.orchestra.run.smithi110.stdout:============================================================================== 2023-08-25T03:59:14.692 INFO:teuthology.orchestra.run.smithi110.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-08-25T03:59:14.692 INFO:teuthology.orchestra.run.smithi110.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-08-25T03:59:14.692 INFO:teuthology.orchestra.run.smithi110.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-08-25T03:59:14.692 INFO:teuthology.orchestra.run.smithi110.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-08-25T03:59:14.693 INFO:teuthology.run_tasks:Running task install... 2023-08-25T03:59:14.706 DEBUG:teuthology.task.install:project ceph 2023-08-25T03:59:14.707 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}} 2023-08-25T03:59:14.707 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'} 2023-08-25T03:59:14.707 INFO:teuthology.task.install:Using flavor: default 2023-08-25T03:59:14.715 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-25T03:59:14.715 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-25T03:59:14.716 DEBUG:teuthology.orchestra.run.smithi055:> sudo apt-key list | grep Ceph 2023-08-25T03:59:14.717 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-key list | grep Ceph 2023-08-25T03:59:14.832 INFO:teuthology.orchestra.run.smithi055.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-08-25T03:59:14.846 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-08-25T03:59:14.888 INFO:teuthology.orchestra.run.smithi055.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-08-25T03:59:14.888 INFO:teuthology.orchestra.run.smithi055.stdout:uid [ unknown] Ceph.com (release key) 2023-08-25T03:59:14.890 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-08-25T03:59:14.890 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-08-25T03:59:14.890 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T03:59:14.906 INFO:teuthology.orchestra.run.smithi110.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-08-25T03:59:14.906 INFO:teuthology.orchestra.run.smithi110.stdout:uid [ unknown] Ceph.com (release key) 2023-08-25T03:59:14.907 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-08-25T03:59:14.907 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-08-25T03:59:14.908 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T03:59:15.046 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default/ 2023-08-25T03:59:15.046 INFO:teuthology.task.install.deb:Package version is 18.0.0-5703-gba6b39e4-1jammy 2023-08-25T03:59:15.054 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default/ 2023-08-25T03:59:15.054 INFO:teuthology.task.install.deb:Package version is 18.0.0-5703-gba6b39e4-1jammy 2023-08-25T03:59:15.215 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T03:59:15.216 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-08-25T03:59:15.221 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T03:59:15.222 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-08-25T03:59:15.244 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2023-08-25T03:59:15.270 DEBUG:teuthology.orchestra.run.smithi055:> sudo apt-get update 2023-08-25T03:59:15.452 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-08-25T03:59:15.452 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-08-25T03:59:15.458 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-08-25T03:59:15.463 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-08-25T03:59:15.464 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-08-25T03:59:15.469 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-08-25T03:59:15.474 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-08-25T03:59:15.483 INFO:teuthology.orchestra.run.smithi110.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy InRelease 2023-08-25T03:59:15.485 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-08-25T03:59:15.505 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-08-25T03:59:15.527 INFO:teuthology.orchestra.run.smithi110.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy Release.gpg 2023-08-25T03:59:15.548 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2023-08-25T03:59:15.572 INFO:teuthology.orchestra.run.smithi055.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy InRelease 2023-08-25T03:59:15.581 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-08-25T03:59:15.609 INFO:teuthology.orchestra.run.smithi055.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-08-25T03:59:15.646 INFO:teuthology.orchestra.run.smithi055.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy Release.gpg 2023-08-25T03:59:15.682 INFO:teuthology.orchestra.run.smithi055.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-08-25T03:59:15.730 INFO:teuthology.orchestra.run.smithi055.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2023-08-25T03:59:16.081 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 28.5 kB in 1s (46.6 kB/s) 2023-08-25T03:59:16.115 INFO:teuthology.orchestra.run.smithi055.stdout:Fetched 28.5 kB in 1s (46.3 kB/s) 2023-08-25T03:59:16.994 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2023-08-25T03:59:17.008 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-5703-gba6b39e4-1jammy cephadm=18.0.0-5703-gba6b39e4-1jammy ceph-mds=18.0.0-5703-gba6b39e4-1jammy ceph-mgr=18.0.0-5703-gba6b39e4-1jammy ceph-common=18.0.0-5703-gba6b39e4-1jammy ceph-fuse=18.0.0-5703-gba6b39e4-1jammy ceph-test=18.0.0-5703-gba6b39e4-1jammy ceph-volume=18.0.0-5703-gba6b39e4-1jammy radosgw=18.0.0-5703-gba6b39e4-1jammy python3-rados=18.0.0-5703-gba6b39e4-1jammy python3-rgw=18.0.0-5703-gba6b39e4-1jammy python3-cephfs=18.0.0-5703-gba6b39e4-1jammy python3-rbd=18.0.0-5703-gba6b39e4-1jammy libcephfs2=18.0.0-5703-gba6b39e4-1jammy libcephfs-dev=18.0.0-5703-gba6b39e4-1jammy librados2=18.0.0-5703-gba6b39e4-1jammy librbd1=18.0.0-5703-gba6b39e4-1jammy rbd-fuse=18.0.0-5703-gba6b39e4-1jammy python3-cephfs=18.0.0-5703-gba6b39e4-1jammy cephfs-shell=18.0.0-5703-gba6b39e4-1jammy cephfs-top=18.0.0-5703-gba6b39e4-1jammy cephfs-mirror=18.0.0-5703-gba6b39e4-1jammy 2023-08-25T03:59:17.062 INFO:teuthology.orchestra.run.smithi055.stdout:Reading package lists... 2023-08-25T03:59:17.076 DEBUG:teuthology.orchestra.run.smithi055:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-5703-gba6b39e4-1jammy cephadm=18.0.0-5703-gba6b39e4-1jammy ceph-mds=18.0.0-5703-gba6b39e4-1jammy ceph-mgr=18.0.0-5703-gba6b39e4-1jammy ceph-common=18.0.0-5703-gba6b39e4-1jammy ceph-fuse=18.0.0-5703-gba6b39e4-1jammy ceph-test=18.0.0-5703-gba6b39e4-1jammy ceph-volume=18.0.0-5703-gba6b39e4-1jammy radosgw=18.0.0-5703-gba6b39e4-1jammy python3-rados=18.0.0-5703-gba6b39e4-1jammy python3-rgw=18.0.0-5703-gba6b39e4-1jammy python3-cephfs=18.0.0-5703-gba6b39e4-1jammy python3-rbd=18.0.0-5703-gba6b39e4-1jammy libcephfs2=18.0.0-5703-gba6b39e4-1jammy libcephfs-dev=18.0.0-5703-gba6b39e4-1jammy librados2=18.0.0-5703-gba6b39e4-1jammy librbd1=18.0.0-5703-gba6b39e4-1jammy rbd-fuse=18.0.0-5703-gba6b39e4-1jammy python3-cephfs=18.0.0-5703-gba6b39e4-1jammy cephfs-shell=18.0.0-5703-gba6b39e4-1jammy cephfs-top=18.0.0-5703-gba6b39e4-1jammy cephfs-mirror=18.0.0-5703-gba6b39e4-1jammy 2023-08-25T03:59:17.083 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2023-08-25T03:59:17.155 INFO:teuthology.orchestra.run.smithi055.stdout:Reading package lists... 2023-08-25T03:59:17.242 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2023-08-25T03:59:17.244 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2023-08-25T03:59:17.317 INFO:teuthology.orchestra.run.smithi055.stdout:Building dependency tree... 2023-08-25T03:59:17.318 INFO:teuthology.orchestra.run.smithi055.stdout:Reading state information... 2023-08-25T03:59:17.391 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2023-08-25T03:59:17.392 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-08-25T03:59:17.392 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-08-25T03:59:17.392 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-08-25T03:59:17.392 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-08-25T03:59:17.392 INFO:teuthology.orchestra.run.smithi110.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-08-25T03:59:17.393 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2023-08-25T03:59:17.393 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2023-08-25T03:59:17.393 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-08-25T03:59:17.393 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-08-25T03:59:17.393 INFO:teuthology.orchestra.run.smithi110.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-08-25T03:59:17.393 INFO:teuthology.orchestra.run.smithi110.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-08-25T03:59:17.393 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-08-25T03:59:17.394 INFO:teuthology.orchestra.run.smithi110.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-08-25T03:59:17.394 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-08-25T03:59:17.394 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-08-25T03:59:17.394 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-08-25T03:59:17.394 INFO:teuthology.orchestra.run.smithi110.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-08-25T03:59:17.394 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-08-25T03:59:17.394 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-08-25T03:59:17.395 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-08-25T03:59:17.395 INFO:teuthology.orchestra.run.smithi110.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-08-25T03:59:17.395 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-08-25T03:59:17.395 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-08-25T03:59:17.395 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-08-25T03:59:17.395 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-08-25T03:59:17.395 INFO:teuthology.orchestra.run.smithi110.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-08-25T03:59:17.395 INFO:teuthology.orchestra.run.smithi110.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-08-25T03:59:17.396 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-08-25T03:59:17.396 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-08-25T03:59:17.396 INFO:teuthology.orchestra.run.smithi110.stdout: qttranslations5-l10n socat xmlstarlet 2023-08-25T03:59:17.396 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2023-08-25T03:59:17.397 INFO:teuthology.orchestra.run.smithi110.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-08-25T03:59:17.397 INFO:teuthology.orchestra.run.smithi110.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-08-25T03:59:17.397 INFO:teuthology.orchestra.run.smithi110.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-08-25T03:59:17.397 INFO:teuthology.orchestra.run.smithi110.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-08-25T03:59:17.398 INFO:teuthology.orchestra.run.smithi110.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-08-25T03:59:17.398 INFO:teuthology.orchestra.run.smithi110.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-08-25T03:59:17.398 INFO:teuthology.orchestra.run.smithi110.stdout: python3-watchdog 2023-08-25T03:59:17.398 INFO:teuthology.orchestra.run.smithi110.stdout:Recommended packages: 2023-08-25T03:59:17.399 INFO:teuthology.orchestra.run.smithi110.stdout: btrfs-tools 2023-08-25T03:59:17.469 INFO:teuthology.orchestra.run.smithi055.stdout:The following packages were automatically installed and are no longer required: 2023-08-25T03:59:17.469 INFO:teuthology.orchestra.run.smithi055.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-08-25T03:59:17.469 INFO:teuthology.orchestra.run.smithi055.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-08-25T03:59:17.469 INFO:teuthology.orchestra.run.smithi055.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-08-25T03:59:17.471 INFO:teuthology.orchestra.run.smithi055.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-08-25T03:59:17.471 INFO:teuthology.orchestra.run.smithi055.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-08-25T03:59:17.471 INFO:teuthology.orchestra.run.smithi055.stdout:Use 'sudo apt autoremove' to remove them. 2023-08-25T03:59:17.472 INFO:teuthology.orchestra.run.smithi055.stdout:The following additional packages will be installed: 2023-08-25T03:59:17.472 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-08-25T03:59:17.472 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-08-25T03:59:17.472 INFO:teuthology.orchestra.run.smithi055.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-08-25T03:59:17.472 INFO:teuthology.orchestra.run.smithi055.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-08-25T03:59:17.473 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-08-25T03:59:17.473 INFO:teuthology.orchestra.run.smithi055.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-08-25T03:59:17.473 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-08-25T03:59:17.473 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-08-25T03:59:17.473 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-08-25T03:59:17.474 INFO:teuthology.orchestra.run.smithi055.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-08-25T03:59:17.474 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-08-25T03:59:17.474 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-08-25T03:59:17.474 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-08-25T03:59:17.474 INFO:teuthology.orchestra.run.smithi055.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-08-25T03:59:17.474 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-08-25T03:59:17.474 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-08-25T03:59:17.475 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-08-25T03:59:17.475 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-08-25T03:59:17.475 INFO:teuthology.orchestra.run.smithi055.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-08-25T03:59:17.475 INFO:teuthology.orchestra.run.smithi055.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-08-25T03:59:17.475 INFO:teuthology.orchestra.run.smithi055.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-08-25T03:59:17.475 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-08-25T03:59:17.476 INFO:teuthology.orchestra.run.smithi055.stdout: qttranslations5-l10n socat xmlstarlet 2023-08-25T03:59:17.478 INFO:teuthology.orchestra.run.smithi055.stdout:Suggested packages: 2023-08-25T03:59:17.478 INFO:teuthology.orchestra.run.smithi055.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-08-25T03:59:17.478 INFO:teuthology.orchestra.run.smithi055.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-08-25T03:59:17.478 INFO:teuthology.orchestra.run.smithi055.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-08-25T03:59:17.478 INFO:teuthology.orchestra.run.smithi055.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-08-25T03:59:17.479 INFO:teuthology.orchestra.run.smithi055.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-08-25T03:59:17.479 INFO:teuthology.orchestra.run.smithi055.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-08-25T03:59:17.479 INFO:teuthology.orchestra.run.smithi055.stdout: python3-watchdog 2023-08-25T03:59:17.479 INFO:teuthology.orchestra.run.smithi055.stdout:Recommended packages: 2023-08-25T03:59:17.479 INFO:teuthology.orchestra.run.smithi055.stdout: btrfs-tools 2023-08-25T03:59:17.532 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2023-08-25T03:59:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-08-25T03:59:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-08-25T03:59:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-08-25T03:59:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-08-25T03:59:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-08-25T03:59:17.533 INFO:teuthology.orchestra.run.smithi110.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-08-25T03:59:17.534 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-08-25T03:59:17.535 INFO:teuthology.orchestra.run.smithi110.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-08-25T03:59:17.535 INFO:teuthology.orchestra.run.smithi110.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-08-25T03:59:17.535 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-08-25T03:59:17.536 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-08-25T03:59:17.536 INFO:teuthology.orchestra.run.smithi110.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-08-25T03:59:17.536 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-08-25T03:59:17.536 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-08-25T03:59:17.537 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-08-25T03:59:17.537 INFO:teuthology.orchestra.run.smithi110.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-08-25T03:59:17.537 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-08-25T03:59:17.537 INFO:teuthology.orchestra.run.smithi110.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-08-25T03:59:17.538 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-08-25T03:59:17.538 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-08-25T03:59:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-08-25T03:59:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-08-25T03:59:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-08-25T03:59:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-08-25T03:59:17.539 INFO:teuthology.orchestra.run.smithi110.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-08-25T03:59:17.540 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-08-25T03:59:17.540 INFO:teuthology.orchestra.run.smithi110.stdout: socat xmlstarlet 2023-08-25T03:59:17.625 INFO:teuthology.orchestra.run.smithi055.stdout:The following NEW packages will be installed: 2023-08-25T03:59:17.625 INFO:teuthology.orchestra.run.smithi055.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-08-25T03:59:17.626 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-08-25T03:59:17.626 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-08-25T03:59:17.626 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-08-25T03:59:17.626 INFO:teuthology.orchestra.run.smithi055.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-08-25T03:59:17.626 INFO:teuthology.orchestra.run.smithi055.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-08-25T03:59:17.627 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-08-25T03:59:17.627 INFO:teuthology.orchestra.run.smithi055.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-08-25T03:59:17.627 INFO:teuthology.orchestra.run.smithi055.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-08-25T03:59:17.627 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-08-25T03:59:17.627 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-08-25T03:59:17.627 INFO:teuthology.orchestra.run.smithi055.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-08-25T03:59:17.628 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-08-25T03:59:17.628 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-08-25T03:59:17.628 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-08-25T03:59:17.628 INFO:teuthology.orchestra.run.smithi055.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-08-25T03:59:17.629 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-08-25T03:59:17.629 INFO:teuthology.orchestra.run.smithi055.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-08-25T03:59:17.629 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-08-25T03:59:17.629 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-08-25T03:59:17.629 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-08-25T03:59:17.630 INFO:teuthology.orchestra.run.smithi055.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-08-25T03:59:17.630 INFO:teuthology.orchestra.run.smithi055.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-08-25T03:59:17.630 INFO:teuthology.orchestra.run.smithi055.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-08-25T03:59:17.630 INFO:teuthology.orchestra.run.smithi055.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-08-25T03:59:17.630 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-08-25T03:59:17.631 INFO:teuthology.orchestra.run.smithi055.stdout: socat xmlstarlet 2023-08-25T03:59:17.683 INFO:teuthology.orchestra.run.smithi110.stdout:0 upgraded, 115 newly installed, 0 to remove and 243 not upgraded. 2023-08-25T03:59:17.684 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 183 MB of archives. 2023-08-25T03:59:17.684 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 823 MB of additional disk space will be used. 2023-08-25T03:59:17.684 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-5703-gba6b39e4-1jammy [3,414 kB] 2023-08-25T03:59:17.730 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-08-25T03:59:17.771 INFO:teuthology.orchestra.run.smithi055.stdout:0 upgraded, 115 newly installed, 0 to remove and 243 not upgraded. 2023-08-25T03:59:17.772 INFO:teuthology.orchestra.run.smithi055.stdout:Need to get 183 MB of archives. 2023-08-25T03:59:17.772 INFO:teuthology.orchestra.run.smithi055.stdout:After this operation, 823 MB of additional disk space will be used. 2023-08-25T03:59:17.772 INFO:teuthology.orchestra.run.smithi055.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-5703-gba6b39e4-1jammy [3,414 kB] 2023-08-25T03:59:17.816 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-08-25T03:59:17.818 INFO:teuthology.orchestra.run.smithi055.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-08-25T03:59:17.856 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-08-25T03:59:17.901 INFO:teuthology.orchestra.run.smithi055.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-08-25T03:59:17.949 INFO:teuthology.orchestra.run.smithi055.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-08-25T03:59:17.950 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-5703-gba6b39e4-1jammy [3,118 kB] 2023-08-25T03:59:18.052 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-08-25T03:59:18.089 INFO:teuthology.orchestra.run.smithi055.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-5703-gba6b39e4-1jammy [3,118 kB] 2023-08-25T03:59:18.095 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-08-25T03:59:18.114 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-5703-gba6b39e4-1jammy [672 kB] 2023-08-25T03:59:18.141 INFO:teuthology.orchestra.run.smithi055.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-08-25T03:59:18.151 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-5703-gba6b39e4-1jammy [345 kB] 2023-08-25T03:59:18.162 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-5703-gba6b39e4-1jammy [22.9 kB] 2023-08-25T03:59:18.163 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-5703-gba6b39e4-1jammy [170 kB] 2023-08-25T03:59:18.170 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-08-25T03:59:18.181 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-08-25T03:59:18.184 INFO:teuthology.orchestra.run.smithi055.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-08-25T03:59:18.190 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-5703-gba6b39e4-1jammy [52.4 kB] 2023-08-25T03:59:18.190 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-5703-gba6b39e4-1jammy [318 kB] 2023-08-25T03:59:18.200 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-5703-gba6b39e4-1jammy [6,100 kB] 2023-08-25T03:59:18.227 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-08-25T03:59:18.259 INFO:teuthology.orchestra.run.smithi055.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-08-25T03:59:18.270 INFO:teuthology.orchestra.run.smithi055.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-08-25T03:59:18.308 INFO:teuthology.orchestra.run.smithi055.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-5703-gba6b39e4-1jammy [672 kB] 2023-08-25T03:59:18.316 INFO:teuthology.orchestra.run.smithi055.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-08-25T03:59:18.356 INFO:teuthology.orchestra.run.smithi055.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-5703-gba6b39e4-1jammy [345 kB] 2023-08-25T03:59:18.392 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-08-25T03:59:18.396 INFO:teuthology.orchestra.run.smithi055.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-5703-gba6b39e4-1jammy [22.9 kB] 2023-08-25T03:59:18.396 INFO:teuthology.orchestra.run.smithi055.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-5703-gba6b39e4-1jammy [170 kB] 2023-08-25T03:59:18.402 INFO:teuthology.orchestra.run.smithi055.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-5703-gba6b39e4-1jammy [52.4 kB] 2023-08-25T03:59:18.406 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-08-25T03:59:18.409 INFO:teuthology.orchestra.run.smithi055.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-5703-gba6b39e4-1jammy [318 kB] 2023-08-25T03:59:18.428 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-08-25T03:59:18.444 INFO:teuthology.orchestra.run.smithi055.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-5703-gba6b39e4-1jammy [6,100 kB] 2023-08-25T03:59:18.483 INFO:teuthology.orchestra.run.smithi055.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-08-25T03:59:18.490 INFO:teuthology.orchestra.run.smithi055.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-08-25T03:59:18.516 INFO:teuthology.orchestra.run.smithi055.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-08-25T03:59:18.552 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-5703-gba6b39e4-1jammy [102 kB] 2023-08-25T03:59:18.553 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-5703-gba6b39e4-1jammy [428 kB] 2023-08-25T03:59:18.593 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-5703-gba6b39e4-1jammy [22.3 MB] 2023-08-25T03:59:18.599 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-08-25T03:59:18.689 INFO:teuthology.orchestra.run.smithi055.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-08-25T03:59:18.794 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-08-25T03:59:18.884 INFO:teuthology.orchestra.run.smithi055.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-08-25T03:59:18.900 INFO:teuthology.orchestra.run.smithi055.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-5703-gba6b39e4-1jammy [102 kB] 2023-08-25T03:59:18.901 INFO:teuthology.orchestra.run.smithi055.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-5703-gba6b39e4-1jammy [428 kB] 2023-08-25T03:59:18.917 INFO:teuthology.orchestra.run.smithi055.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-5703-gba6b39e4-1jammy [22.3 MB] 2023-08-25T03:59:19.158 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-08-25T03:59:19.166 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-08-25T03:59:19.168 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-08-25T03:59:19.180 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-08-25T03:59:19.181 INFO:teuthology.orchestra.run.smithi110.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-08-25T03:59:19.183 INFO:teuthology.orchestra.run.smithi110.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-08-25T03:59:19.184 INFO:teuthology.orchestra.run.smithi110.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-08-25T03:59:19.186 INFO:teuthology.orchestra.run.smithi110.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-08-25T03:59:19.188 INFO:teuthology.orchestra.run.smithi110.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-08-25T03:59:19.248 INFO:teuthology.orchestra.run.smithi055.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-08-25T03:59:19.256 INFO:teuthology.orchestra.run.smithi055.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-08-25T03:59:19.258 INFO:teuthology.orchestra.run.smithi055.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-08-25T03:59:19.270 INFO:teuthology.orchestra.run.smithi055.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-08-25T03:59:19.271 INFO:teuthology.orchestra.run.smithi055.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-08-25T03:59:19.272 INFO:teuthology.orchestra.run.smithi055.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-08-25T03:59:19.274 INFO:teuthology.orchestra.run.smithi055.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-08-25T03:59:19.277 INFO:teuthology.orchestra.run.smithi055.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-08-25T03:59:19.277 INFO:teuthology.orchestra.run.smithi055.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-08-25T03:59:19.352 INFO:teuthology.orchestra.run.smithi110.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-08-25T03:59:19.444 INFO:teuthology.orchestra.run.smithi055.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-08-25T03:59:19.784 INFO:teuthology.orchestra.run.smithi110.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-08-25T03:59:19.793 INFO:teuthology.orchestra.run.smithi110.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-08-25T03:59:19.800 INFO:teuthology.orchestra.run.smithi110.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-08-25T03:59:19.802 INFO:teuthology.orchestra.run.smithi110.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-08-25T03:59:19.821 INFO:teuthology.orchestra.run.smithi110.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-08-25T03:59:19.823 INFO:teuthology.orchestra.run.smithi110.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-08-25T03:59:19.826 INFO:teuthology.orchestra.run.smithi110.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-08-25T03:59:19.869 INFO:teuthology.orchestra.run.smithi110.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-08-25T03:59:19.877 INFO:teuthology.orchestra.run.smithi055.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-08-25T03:59:19.881 INFO:teuthology.orchestra.run.smithi110.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-08-25T03:59:19.886 INFO:teuthology.orchestra.run.smithi110.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-08-25T03:59:19.887 INFO:teuthology.orchestra.run.smithi055.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-08-25T03:59:19.892 INFO:teuthology.orchestra.run.smithi055.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-08-25T03:59:19.896 INFO:teuthology.orchestra.run.smithi055.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-08-25T03:59:19.908 INFO:teuthology.orchestra.run.smithi110.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-5703-gba6b39e4-1jammy [6,819 kB] 2023-08-25T03:59:19.915 INFO:teuthology.orchestra.run.smithi055.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-08-25T03:59:19.917 INFO:teuthology.orchestra.run.smithi055.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-08-25T03:59:19.919 INFO:teuthology.orchestra.run.smithi055.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-08-25T03:59:19.962 INFO:teuthology.orchestra.run.smithi055.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-08-25T03:59:19.975 INFO:teuthology.orchestra.run.smithi055.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-08-25T03:59:19.980 INFO:teuthology.orchestra.run.smithi055.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-08-25T03:59:20.139 INFO:teuthology.orchestra.run.smithi110.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-08-25T03:59:20.222 INFO:teuthology.orchestra.run.smithi110.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-08-25T03:59:20.234 INFO:teuthology.orchestra.run.smithi055.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-08-25T03:59:20.301 INFO:teuthology.orchestra.run.smithi110.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-5703-gba6b39e4-1jammy [227 kB] 2023-08-25T03:59:20.306 INFO:teuthology.orchestra.run.smithi110.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-5703-gba6b39e4-1jammy [117 kB] 2023-08-25T03:59:20.309 INFO:teuthology.orchestra.run.smithi110.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-5703-gba6b39e4-1jammy [1,482 kB] 2023-08-25T03:59:20.311 INFO:teuthology.orchestra.run.smithi110.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-08-25T03:59:20.316 INFO:teuthology.orchestra.run.smithi055.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-08-25T03:59:20.369 INFO:teuthology.orchestra.run.smithi110.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-08-25T03:59:20.401 INFO:teuthology.orchestra.run.smithi110.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-5703-gba6b39e4-1jammy [9,849 kB] 2023-08-25T03:59:20.406 INFO:teuthology.orchestra.run.smithi055.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-08-25T03:59:20.463 INFO:teuthology.orchestra.run.smithi055.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-08-25T03:59:20.490 INFO:teuthology.orchestra.run.smithi110.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-08-25T03:59:20.578 INFO:teuthology.orchestra.run.smithi110.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-08-25T03:59:20.584 INFO:teuthology.orchestra.run.smithi055.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-08-25T03:59:20.596 INFO:teuthology.orchestra.run.smithi110.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-08-25T03:59:20.605 INFO:teuthology.orchestra.run.smithi055.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-5703-gba6b39e4-1jammy [6,819 kB] 2023-08-25T03:59:20.625 INFO:teuthology.orchestra.run.smithi110.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-08-25T03:59:20.638 INFO:teuthology.orchestra.run.smithi110.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-08-25T03:59:20.671 INFO:teuthology.orchestra.run.smithi055.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-08-25T03:59:20.676 INFO:teuthology.orchestra.run.smithi110.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-08-25T03:59:20.684 INFO:teuthology.orchestra.run.smithi110.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-08-25T03:59:20.690 INFO:teuthology.orchestra.run.smithi055.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-08-25T03:59:20.718 INFO:teuthology.orchestra.run.smithi055.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-08-25T03:59:20.731 INFO:teuthology.orchestra.run.smithi055.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-08-25T03:59:20.768 INFO:teuthology.orchestra.run.smithi055.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-08-25T03:59:20.776 INFO:teuthology.orchestra.run.smithi055.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-08-25T03:59:20.875 INFO:teuthology.orchestra.run.smithi110.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-08-25T03:59:20.967 INFO:teuthology.orchestra.run.smithi055.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-08-25T03:59:20.991 INFO:teuthology.orchestra.run.smithi110.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-5703-gba6b39e4-1jammy [31.7 MB] 2023-08-25T03:59:21.101 INFO:teuthology.orchestra.run.smithi055.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-5703-gba6b39e4-1jammy [227 kB] 2023-08-25T03:59:21.106 INFO:teuthology.orchestra.run.smithi055.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-5703-gba6b39e4-1jammy [117 kB] 2023-08-25T03:59:21.110 INFO:teuthology.orchestra.run.smithi055.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-5703-gba6b39e4-1jammy [1,482 kB] 2023-08-25T03:59:21.240 INFO:teuthology.orchestra.run.smithi055.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-5703-gba6b39e4-1jammy [9,849 kB] 2023-08-25T03:59:21.686 INFO:teuthology.orchestra.run.smithi110.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-08-25T03:59:21.687 INFO:teuthology.orchestra.run.smithi110.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-08-25T03:59:21.689 INFO:teuthology.orchestra.run.smithi110.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-08-25T03:59:21.690 INFO:teuthology.orchestra.run.smithi110.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-08-25T03:59:21.690 INFO:teuthology.orchestra.run.smithi110.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-08-25T03:59:21.691 INFO:teuthology.orchestra.run.smithi110.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-08-25T03:59:21.714 INFO:teuthology.orchestra.run.smithi110.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-08-25T03:59:21.716 INFO:teuthology.orchestra.run.smithi110.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-08-25T03:59:21.717 INFO:teuthology.orchestra.run.smithi110.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-08-25T03:59:21.776 INFO:teuthology.orchestra.run.smithi055.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-08-25T03:59:21.777 INFO:teuthology.orchestra.run.smithi055.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-08-25T03:59:21.778 INFO:teuthology.orchestra.run.smithi055.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-08-25T03:59:21.779 INFO:teuthology.orchestra.run.smithi055.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-08-25T03:59:21.779 INFO:teuthology.orchestra.run.smithi055.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-08-25T03:59:21.780 INFO:teuthology.orchestra.run.smithi055.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-08-25T03:59:21.787 INFO:teuthology.orchestra.run.smithi110.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-08-25T03:59:21.804 INFO:teuthology.orchestra.run.smithi055.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-08-25T03:59:21.806 INFO:teuthology.orchestra.run.smithi055.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-08-25T03:59:21.806 INFO:teuthology.orchestra.run.smithi055.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-08-25T03:59:21.877 INFO:teuthology.orchestra.run.smithi055.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-08-25T03:59:21.954 INFO:teuthology.orchestra.run.smithi110.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-08-25T03:59:21.977 INFO:teuthology.orchestra.run.smithi055.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-5703-gba6b39e4-1jammy [31.7 MB] 2023-08-25T03:59:22.040 INFO:teuthology.orchestra.run.smithi055.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-08-25T03:59:22.210 INFO:teuthology.orchestra.run.smithi110.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-08-25T03:59:22.243 INFO:teuthology.orchestra.run.smithi110.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-08-25T03:59:22.269 INFO:teuthology.orchestra.run.smithi110.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-08-25T03:59:22.295 INFO:teuthology.orchestra.run.smithi055.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-08-25T03:59:22.320 INFO:teuthology.orchestra.run.smithi110.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-08-25T03:59:22.328 INFO:teuthology.orchestra.run.smithi055.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-08-25T03:59:22.341 INFO:teuthology.orchestra.run.smithi110.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-08-25T03:59:22.354 INFO:teuthology.orchestra.run.smithi055.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-08-25T03:59:22.368 INFO:teuthology.orchestra.run.smithi110.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-08-25T03:59:22.405 INFO:teuthology.orchestra.run.smithi055.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-08-25T03:59:22.425 INFO:teuthology.orchestra.run.smithi055.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-08-25T03:59:22.453 INFO:teuthology.orchestra.run.smithi055.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-08-25T03:59:22.498 INFO:teuthology.orchestra.run.smithi110.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-08-25T03:59:22.529 INFO:teuthology.orchestra.run.smithi110.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-08-25T03:59:22.549 INFO:teuthology.orchestra.run.smithi110.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-08-25T03:59:22.555 INFO:teuthology.orchestra.run.smithi110.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-08-25T03:59:22.580 INFO:teuthology.orchestra.run.smithi055.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-08-25T03:59:22.611 INFO:teuthology.orchestra.run.smithi055.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-08-25T03:59:22.632 INFO:teuthology.orchestra.run.smithi055.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-08-25T03:59:22.639 INFO:teuthology.orchestra.run.smithi055.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-08-25T03:59:22.760 INFO:teuthology.orchestra.run.smithi110.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-08-25T03:59:22.839 INFO:teuthology.orchestra.run.smithi110.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-5703-gba6b39e4-1jammy [3,592 B] 2023-08-25T03:59:22.840 INFO:teuthology.orchestra.run.smithi110.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-5703-gba6b39e4-1jammy [821 kB] 2023-08-25T03:59:22.842 INFO:teuthology.orchestra.run.smithi055.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-08-25T03:59:22.890 INFO:teuthology.orchestra.run.smithi110.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-5703-gba6b39e4-1jammy [2,158 kB] 2023-08-25T03:59:23.032 INFO:teuthology.orchestra.run.smithi110.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-5703-gba6b39e4-1jammy [228 kB] 2023-08-25T03:59:23.038 INFO:teuthology.orchestra.run.smithi110.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-5703-gba6b39e4-1jammy [128 kB] 2023-08-25T03:59:23.042 INFO:teuthology.orchestra.run.smithi110.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-5703-gba6b39e4-1jammy [1,883 kB] 2023-08-25T03:59:23.140 INFO:teuthology.orchestra.run.smithi110.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-5703-gba6b39e4-1jammy [8,615 kB] 2023-08-25T03:59:23.220 INFO:teuthology.orchestra.run.smithi110.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-08-25T03:59:23.226 INFO:teuthology.orchestra.run.smithi110.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-08-25T03:59:23.304 INFO:teuthology.orchestra.run.smithi055.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-08-25T03:59:23.309 INFO:teuthology.orchestra.run.smithi055.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-08-25T03:59:23.352 INFO:teuthology.orchestra.run.smithi110.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-08-25T03:59:23.399 INFO:teuthology.orchestra.run.smithi110.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-08-25T03:59:23.400 INFO:teuthology.orchestra.run.smithi110.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-08-25T03:59:23.405 INFO:teuthology.orchestra.run.smithi110.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-08-25T03:59:23.407 INFO:teuthology.orchestra.run.smithi110.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-08-25T03:59:23.423 INFO:teuthology.orchestra.run.smithi110.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-08-25T03:59:23.430 INFO:teuthology.orchestra.run.smithi110.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-08-25T03:59:23.436 INFO:teuthology.orchestra.run.smithi055.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-08-25T03:59:23.483 INFO:teuthology.orchestra.run.smithi055.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-08-25T03:59:23.483 INFO:teuthology.orchestra.run.smithi055.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-08-25T03:59:23.489 INFO:teuthology.orchestra.run.smithi055.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-08-25T03:59:23.491 INFO:teuthology.orchestra.run.smithi110.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-08-25T03:59:23.491 INFO:teuthology.orchestra.run.smithi055.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-08-25T03:59:23.507 INFO:teuthology.orchestra.run.smithi055.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-08-25T03:59:23.515 INFO:teuthology.orchestra.run.smithi055.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-08-25T03:59:23.575 INFO:teuthology.orchestra.run.smithi055.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-08-25T03:59:23.606 INFO:teuthology.orchestra.run.smithi110.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-5703-gba6b39e4-1jammy [3,722 B] 2023-08-25T03:59:23.606 INFO:teuthology.orchestra.run.smithi110.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-5703-gba6b39e4-1jammy [47.6 MB] 2023-08-25T03:59:23.655 INFO:teuthology.orchestra.run.smithi110.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-08-25T03:59:23.739 INFO:teuthology.orchestra.run.smithi055.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-08-25T03:59:23.821 INFO:teuthology.orchestra.run.smithi110.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-08-25T03:59:23.904 INFO:teuthology.orchestra.run.smithi055.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-08-25T03:59:24.096 INFO:teuthology.orchestra.run.smithi110.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-08-25T03:59:24.120 INFO:teuthology.orchestra.run.smithi110.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-08-25T03:59:24.176 INFO:teuthology.orchestra.run.smithi055.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-08-25T03:59:24.201 INFO:teuthology.orchestra.run.smithi055.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-08-25T03:59:24.548 INFO:teuthology.orchestra.run.smithi055.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-5703-gba6b39e4-1jammy [3,592 B] 2023-08-25T03:59:24.549 INFO:teuthology.orchestra.run.smithi055.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-5703-gba6b39e4-1jammy [821 kB] 2023-08-25T03:59:24.610 INFO:teuthology.orchestra.run.smithi055.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-5703-gba6b39e4-1jammy [2,158 kB] 2023-08-25T03:59:24.821 INFO:teuthology.orchestra.run.smithi055.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-5703-gba6b39e4-1jammy [228 kB] 2023-08-25T03:59:24.828 INFO:teuthology.orchestra.run.smithi055.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-5703-gba6b39e4-1jammy [128 kB] 2023-08-25T03:59:24.832 INFO:teuthology.orchestra.run.smithi055.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-5703-gba6b39e4-1jammy [1,883 kB] 2023-08-25T03:59:25.032 INFO:teuthology.orchestra.run.smithi055.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-5703-gba6b39e4-1jammy [8,615 kB] 2023-08-25T03:59:25.889 INFO:teuthology.orchestra.run.smithi055.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-5703-gba6b39e4-1jammy [3,722 B] 2023-08-25T03:59:25.890 INFO:teuthology.orchestra.run.smithi055.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-5703-gba6b39e4-1jammy [47.6 MB] 2023-08-25T03:59:26.252 INFO:teuthology.orchestra.run.smithi110.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-5703-gba6b39e4-1jammy [234 kB] 2023-08-25T03:59:26.254 INFO:teuthology.orchestra.run.smithi110.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-5703-gba6b39e4-1jammy [215 kB] 2023-08-25T03:59:26.259 INFO:teuthology.orchestra.run.smithi110.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-5703-gba6b39e4-1jammy [23.8 kB] 2023-08-25T03:59:26.259 INFO:teuthology.orchestra.run.smithi110.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-5703-gba6b39e4-1jammy [13.2 kB] 2023-08-25T03:59:26.260 INFO:teuthology.orchestra.run.smithi110.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-5703-gba6b39e4-1jammy [28.4 kB] 2023-08-25T03:59:26.262 INFO:teuthology.orchestra.run.smithi110.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-5703-gba6b39e4-1jammy [12.1 MB] 2023-08-25T03:59:27.127 INFO:teuthology.orchestra.run.smithi110.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-5703-gba6b39e4-1jammy [81.0 kB] 2023-08-25T03:59:27.694 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 183 MB in 10s (19.1 MB/s) 2023-08-25T03:59:27.821 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyperclip. 2023-08-25T03:59:27.888 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132933 files and directories currently installed.) 2023-08-25T03:59:27.893 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-08-25T03:59:27.936 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-08-25T03:59:28.247 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-wcwidth. 2023-08-25T03:59:28.259 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-08-25T03:59:28.297 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-08-25T03:59:28.624 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cmd2. 2023-08-25T03:59:28.637 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-08-25T03:59:28.675 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-08-25T03:59:29.003 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libfmt8:amd64. 2023-08-25T03:59:29.015 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-08-25T03:59:29.095 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-08-25T03:59:29.389 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-08-25T03:59:29.402 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-08-25T03:59:29.431 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-08-25T03:59:29.768 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-08-25T03:59:29.781 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-08-25T03:59:29.818 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-08-25T03:59:30.129 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-08-25T03:59:30.143 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-08-25T03:59:30.179 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-08-25T03:59:30.393 INFO:teuthology.orchestra.run.smithi055.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-5703-gba6b39e4-1jammy [234 kB] 2023-08-25T03:59:30.417 INFO:teuthology.orchestra.run.smithi055.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-5703-gba6b39e4-1jammy [215 kB] 2023-08-25T03:59:30.425 INFO:teuthology.orchestra.run.smithi055.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-5703-gba6b39e4-1jammy [23.8 kB] 2023-08-25T03:59:30.428 INFO:teuthology.orchestra.run.smithi055.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-5703-gba6b39e4-1jammy [13.2 kB] 2023-08-25T03:59:30.428 INFO:teuthology.orchestra.run.smithi055.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-5703-gba6b39e4-1jammy [28.4 kB] 2023-08-25T03:59:30.430 INFO:teuthology.orchestra.run.smithi055.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-5703-gba6b39e4-1jammy [12.1 MB] 2023-08-25T03:59:30.624 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-08-25T03:59:30.639 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-08-25T03:59:30.691 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-08-25T03:59:31.128 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-08-25T03:59:31.142 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-08-25T03:59:31.186 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-08-25T03:59:31.497 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-08-25T03:59:31.512 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-08-25T03:59:31.547 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-08-25T03:59:31.595 INFO:teuthology.orchestra.run.smithi055.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023aug3-b5/ba6b39e4f4f77fb95c747099b53db0467d435f56/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-5703-gba6b39e4-1jammy [81.0 kB] 2023-08-25T03:59:31.892 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-08-25T03:59:31.906 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-08-25T03:59:31.950 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-08-25T03:59:32.212 INFO:teuthology.orchestra.run.smithi055.stdout:Fetched 183 MB in 14s (13.1 MB/s) 2023-08-25T03:59:32.287 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librados2. 2023-08-25T03:59:32.301 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../011-librados2_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:32.336 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pyperclip. 2023-08-25T03:59:32.345 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librados2 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:32.408 INFO:teuthology.orchestra.run.smithi055.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132933 files and directories currently installed.) 2023-08-25T03:59:32.411 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-08-25T03:59:32.443 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-08-25T03:59:32.754 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-wcwidth. 2023-08-25T03:59:32.756 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librbd1. 2023-08-25T03:59:32.768 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-08-25T03:59:32.771 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../012-librbd1_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:32.804 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-08-25T03:59:32.806 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librbd1 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:33.132 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cmd2. 2023-08-25T03:59:33.146 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-08-25T03:59:33.191 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-08-25T03:59:33.209 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libcephfs2. 2023-08-25T03:59:33.223 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:33.267 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libcephfs2 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:33.510 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libfmt8:amd64. 2023-08-25T03:59:33.524 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-08-25T03:59:33.553 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rados. 2023-08-25T03:59:33.567 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../014-python3-rados_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:33.611 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-08-25T03:59:33.611 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rados (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:33.897 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-08-25T03:59:33.911 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-08-25T03:59:33.914 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-08-25T03:59:33.928 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T03:59:33.947 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-08-25T03:59:33.964 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-ceph-argparse (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:34.200 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cephfs. 2023-08-25T03:59:34.214 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:34.250 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cephfs (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:34.350 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-08-25T03:59:34.365 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-08-25T03:59:34.567 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-08-25T03:59:34.578 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-ceph-common. 2023-08-25T03:59:34.592 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T03:59:34.636 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-ceph-common (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:34.964 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-prettytable. 2023-08-25T03:59:34.978 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-08-25T03:59:35.022 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-08-25T03:59:35.087 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-08-25T03:59:35.102 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-08-25T03:59:35.154 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-08-25T03:59:35.582 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-08-25T03:59:35.592 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rbd. 2023-08-25T03:59:35.597 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-08-25T03:59:35.607 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:35.642 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rbd (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:35.649 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-08-25T03:59:35.929 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-08-25T03:59:35.943 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-08-25T03:59:35.986 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-08-25T03:59:36.154 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-08-25T03:59:36.166 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-08-25T03:59:36.235 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-08-25T03:59:36.323 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librgw2. 2023-08-25T03:59:36.337 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../021-librgw2_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:36.381 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librgw2 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:36.530 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-08-25T03:59:36.545 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-08-25T03:59:36.580 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-08-25T03:59:36.858 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rgw. 2023-08-25T03:59:36.873 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:36.917 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rgw (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:36.925 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-08-25T03:59:36.939 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-08-25T03:59:36.983 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-08-25T03:59:37.245 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liboath0:amd64. 2023-08-25T03:59:37.259 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-08-25T03:59:37.295 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-08-25T03:59:37.319 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package librados2. 2023-08-25T03:59:37.334 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../011-librados2_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:37.377 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking librados2 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:37.597 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libradosstriper1. 2023-08-25T03:59:37.612 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:37.656 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libradosstriper1 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:37.772 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package librbd1. 2023-08-25T03:59:37.787 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../012-librbd1_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:37.823 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking librbd1 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:38.084 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-common. 2023-08-25T03:59:38.099 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../025-ceph-common_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:38.145 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-common (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:38.225 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libcephfs2. 2023-08-25T03:59:38.239 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:38.283 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libcephfs2 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:38.610 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-rados. 2023-08-25T03:59:38.628 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../014-python3-rados_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:38.668 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-rados (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:38.996 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-08-25T03:59:39.013 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T03:59:39.046 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-ceph-argparse (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:39.265 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cephfs. 2023-08-25T03:59:39.280 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:39.281 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-base. 2023-08-25T03:59:39.296 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../026-ceph-base_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:39.315 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cephfs (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:39.341 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-base (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:39.626 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-ceph-common. 2023-08-25T03:59:39.641 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T03:59:39.684 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-ceph-common (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:40.011 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-08-25T03:59:40.026 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-08-25T03:59:40.102 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-08-25T03:59:40.121 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-prettytable. 2023-08-25T03:59:40.136 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-08-25T03:59:40.179 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-08-25T03:59:40.405 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cheroot. 2023-08-25T03:59:40.420 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-08-25T03:59:40.440 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-rbd. 2023-08-25T03:59:40.455 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:40.463 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-08-25T03:59:40.499 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-rbd (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:40.800 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-08-25T03:59:40.801 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-08-25T03:59:40.814 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-08-25T03:59:40.816 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-08-25T03:59:40.858 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-08-25T03:59:40.859 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-08-25T03:59:41.161 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.text. 2023-08-25T03:59:41.163 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package librgw2. 2023-08-25T03:59:41.176 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-08-25T03:59:41.177 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../021-librgw2_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:41.211 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-08-25T03:59:41.221 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking librgw2 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:41.481 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-08-25T03:59:41.496 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-08-25T03:59:41.539 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-08-25T03:59:41.690 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-rgw. 2023-08-25T03:59:41.704 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:41.748 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-rgw (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:41.875 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-tempora. 2023-08-25T03:59:41.890 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-08-25T03:59:41.933 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-08-25T03:59:42.051 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package liboath0:amd64. 2023-08-25T03:59:42.066 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-08-25T03:59:42.101 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-08-25T03:59:42.245 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-portend. 2023-08-25T03:59:42.259 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-08-25T03:59:42.303 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-08-25T03:59:42.387 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libradosstriper1. 2023-08-25T03:59:42.405 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:42.447 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libradosstriper1 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:42.572 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-08-25T03:59:42.587 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-08-25T03:59:42.622 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-08-25T03:59:42.890 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-common. 2023-08-25T03:59:42.905 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../025-ceph-common_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:42.917 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cherrypy3. 2023-08-25T03:59:42.931 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-08-25T03:59:42.948 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-common (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:42.975 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-08-25T03:59:43.504 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-natsort. 2023-08-25T03:59:43.519 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-08-25T03:59:43.562 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-08-25T03:59:43.866 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-logutils. 2023-08-25T03:59:43.880 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-08-25T03:59:43.916 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-08-25T03:59:44.047 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-base. 2023-08-25T03:59:44.061 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../026-ceph-base_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:44.115 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-base (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:44.193 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-markupsafe. 2023-08-25T03:59:44.207 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-08-25T03:59:44.251 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-08-25T03:59:44.563 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-mako. 2023-08-25T03:59:44.577 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-08-25T03:59:44.630 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-08-25T03:59:44.941 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-simplegeneric. 2023-08-25T03:59:44.956 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-08-25T03:59:44.999 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-08-25T03:59:45.125 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-08-25T03:59:45.140 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-08-25T03:59:45.175 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-08-25T03:59:45.260 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-singledispatch. 2023-08-25T03:59:45.275 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-08-25T03:59:45.310 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-08-25T03:59:45.511 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cheroot. 2023-08-25T03:59:45.526 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-08-25T03:59:45.587 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-08-25T03:59:45.613 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-webob. 2023-08-25T03:59:45.628 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-08-25T03:59:45.671 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-08-25T03:59:46.003 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-08-25T03:59:46.018 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-08-25T03:59:46.024 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-waitress. 2023-08-25T03:59:46.043 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-08-25T03:59:46.069 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-08-25T03:59:46.103 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-08-25T03:59:46.419 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-tempita. 2023-08-25T03:59:46.433 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-08-25T03:59:46.434 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-jaraco.text. 2023-08-25T03:59:46.449 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-08-25T03:59:46.477 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-08-25T03:59:46.501 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-08-25T03:59:46.780 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-paste. 2023-08-25T03:59:46.795 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-08-25T03:59:46.839 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-08-25T03:59:46.846 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-08-25T03:59:46.860 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-08-25T03:59:46.903 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-08-25T03:59:47.141 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-08-25T03:59:47.156 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-08-25T03:59:47.200 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-08-25T03:59:47.256 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-tempora. 2023-08-25T03:59:47.271 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-08-25T03:59:47.323 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-08-25T03:59:47.502 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pastedeploy. 2023-08-25T03:59:47.517 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-08-25T03:59:47.561 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-08-25T03:59:47.676 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-portend. 2023-08-25T03:59:47.691 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-08-25T03:59:47.742 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-08-25T03:59:47.889 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-webtest. 2023-08-25T03:59:47.904 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-08-25T03:59:47.947 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-08-25T03:59:48.120 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-08-25T03:59:48.136 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-08-25T03:59:48.212 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-08-25T03:59:48.234 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pecan. 2023-08-25T03:59:48.248 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-08-25T03:59:48.284 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-08-25T03:59:48.498 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cherrypy3. 2023-08-25T03:59:48.513 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-08-25T03:59:48.565 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-08-25T03:59:48.665 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-certifi. 2023-08-25T03:59:48.678 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-08-25T03:59:48.730 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-08-25T03:59:48.927 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-natsort. 2023-08-25T03:59:48.941 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-08-25T03:59:48.985 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-08-25T03:59:49.008 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-idna. 2023-08-25T03:59:49.022 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-08-25T03:59:49.066 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-idna (3.3-1) ... 2023-08-25T03:59:49.330 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-logutils. 2023-08-25T03:59:49.345 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-08-25T03:59:49.388 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-08-25T03:59:49.419 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-urllib3. 2023-08-25T03:59:49.434 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-08-25T03:59:49.477 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-08-25T03:59:49.674 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-markupsafe. 2023-08-25T03:59:49.689 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-08-25T03:59:49.732 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-08-25T03:59:49.789 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-requests. 2023-08-25T03:59:49.803 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-08-25T03:59:49.848 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-08-25T03:59:49.985 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-mako. 2023-08-25T03:59:50.002 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-08-25T03:59:50.052 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-08-25T03:59:50.158 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-werkzeug. 2023-08-25T03:59:50.172 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-08-25T03:59:50.216 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-08-25T03:59:50.397 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-simplegeneric. 2023-08-25T03:59:50.412 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-08-25T03:59:50.455 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-08-25T03:59:51.362 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-08-25T03:59:51.376 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T03:59:51.383 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-singledispatch. 2023-08-25T03:59:51.398 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-08-25T03:59:51.420 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-modules-core (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:51.458 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-08-25T03:59:51.744 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-webob. 2023-08-25T03:59:51.759 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-08-25T03:59:51.794 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-08-25T03:59:51.849 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-08-25T03:59:51.864 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:51.908 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:52.114 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-waitress. 2023-08-25T03:59:52.129 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-08-25T03:59:52.167 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-08-25T03:59:52.227 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-openssl. 2023-08-25T03:59:52.242 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-08-25T03:59:52.286 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-08-25T03:59:52.408 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-tempita. 2023-08-25T03:59:52.423 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-08-25T03:59:52.467 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-08-25T03:59:52.614 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr. 2023-08-25T03:59:52.628 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:52.663 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:52.753 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-paste. 2023-08-25T03:59:52.768 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-08-25T03:59:52.811 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-08-25T03:59:53.058 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mon. 2023-08-25T03:59:53.072 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:53.116 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mon (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:53.131 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-08-25T03:59:53.146 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-08-25T03:59:53.181 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-08-25T03:59:53.417 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pastedeploy. 2023-08-25T03:59:53.432 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-08-25T03:59:53.468 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-08-25T03:59:53.803 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-webtest. 2023-08-25T03:59:53.819 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-08-25T03:59:53.861 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-08-25T03:59:53.929 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-osd. 2023-08-25T03:59:53.943 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:53.987 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-osd (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:54.173 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pecan. 2023-08-25T03:59:54.188 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-08-25T03:59:54.231 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-08-25T03:59:54.594 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-certifi. 2023-08-25T03:59:54.610 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-08-25T03:59:54.653 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-08-25T03:59:54.981 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-idna. 2023-08-25T03:59:54.996 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-08-25T03:59:55.030 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-idna (3.3-1) ... 2023-08-25T03:59:55.232 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph. 2023-08-25T03:59:55.246 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../061-ceph_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:55.282 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:55.467 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-urllib3. 2023-08-25T03:59:55.482 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-08-25T03:59:55.525 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-08-25T03:59:55.618 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-fuse. 2023-08-25T03:59:55.636 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:55.676 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-fuse (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:55.861 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-requests. 2023-08-25T03:59:55.876 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-08-25T03:59:55.912 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-08-25T03:59:56.038 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mds. 2023-08-25T03:59:56.052 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:56.110 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mds (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:56.173 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-werkzeug. 2023-08-25T03:59:56.188 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-08-25T03:59:56.231 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-08-25T03:59:56.483 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephadm. 2023-08-25T03:59:56.484 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-08-25T03:59:56.499 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T03:59:56.499 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../064-cephadm_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:56.532 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephadm (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:56.534 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-modules-core (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:56.844 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-asyncssh. 2023-08-25T03:59:56.859 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-08-25T03:59:56.902 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-08-25T03:59:56.947 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-08-25T03:59:56.962 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:57.005 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:57.247 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-babel-localedata. 2023-08-25T03:59:57.262 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-08-25T03:59:57.275 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-openssl. 2023-08-25T03:59:57.289 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-08-25T03:59:57.305 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-08-25T03:59:57.333 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-08-25T03:59:57.611 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr. 2023-08-25T03:59:57.626 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:57.669 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:58.081 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mon. 2023-08-25T03:59:58.096 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:58.139 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mon (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:58.326 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-babel. 2023-08-25T03:59:58.341 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-08-25T03:59:58.385 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-08-25T03:59:58.740 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jinja2. 2023-08-25T03:59:58.753 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-08-25T03:59:58.790 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-08-25T03:59:59.059 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-osd. 2023-08-25T03:59:59.074 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T03:59:59.110 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-osd (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:59.126 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-08-25T03:59:59.139 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T03:59:59.176 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-cephadm (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T03:59:59.513 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-bcrypt. 2023-08-25T03:59:59.526 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-08-25T03:59:59.563 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-08-25T03:59:59.866 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-repoze.lru. 2023-08-25T03:59:59.879 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-08-25T03:59:59.924 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-08-25T04:00:00.254 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-routes. 2023-08-25T04:00:00.266 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-08-25T04:00:00.310 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-08-25T04:00:00.345 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph. 2023-08-25T04:00:00.360 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../061-ceph_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T04:00:00.404 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:00.655 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-08-25T04:00:00.669 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T04:00:00.713 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-dashboard (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:00.831 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-fuse. 2023-08-25T04:00:00.847 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T04:00:00.890 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-fuse (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:01.142 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-08-25T04:00:01.155 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-08-25T04:00:01.192 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-08-25T04:00:01.260 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mds. 2023-08-25T04:00:01.275 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T04:00:01.309 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mds (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:01.646 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package cephadm. 2023-08-25T04:00:01.661 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../064-cephadm_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T04:00:01.704 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking cephadm (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:01.971 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-joblib. 2023-08-25T04:00:01.985 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-08-25T04:00:02.016 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-asyncssh. 2023-08-25T04:00:02.029 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-08-25T04:00:02.031 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-08-25T04:00:02.074 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-08-25T04:00:02.383 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-08-25T04:00:02.394 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python-babel-localedata. 2023-08-25T04:00:02.397 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-08-25T04:00:02.409 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-08-25T04:00:02.441 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-08-25T04:00:02.452 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-08-25T04:00:02.753 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-sklearn. 2023-08-25T04:00:02.767 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-08-25T04:00:02.811 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-08-25T04:00:03.449 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-babel. 2023-08-25T04:00:03.463 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-08-25T04:00:03.507 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-08-25T04:00:03.507 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-08-25T04:00:03.517 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T04:00:03.553 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:03.810 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-jinja2. 2023-08-25T04:00:03.824 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-08-25T04:00:03.860 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-08-25T04:00:04.188 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-08-25T04:00:04.202 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T04:00:04.238 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-cephadm (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:04.522 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cachetools. 2023-08-25T04:00:04.537 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-08-25T04:00:04.572 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-08-25T04:00:04.575 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-bcrypt. 2023-08-25T04:00:04.590 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-08-25T04:00:04.625 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-08-25T04:00:04.894 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-repoze.lru. 2023-08-25T04:00:04.910 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-08-25T04:00:04.917 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyasn1. 2023-08-25T04:00:04.932 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-08-25T04:00:04.952 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-08-25T04:00:04.975 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-08-25T04:00:05.272 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-routes. 2023-08-25T04:00:05.288 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-08-25T04:00:05.329 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-08-25T04:00:05.330 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-08-25T04:00:05.344 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-08-25T04:00:05.387 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-08-25T04:00:05.682 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rsa. 2023-08-25T04:00:05.696 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-08-25T04:00:05.740 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rsa (4.8-1) ... 2023-08-25T04:00:05.800 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-08-25T04:00:05.816 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T04:00:05.858 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-dashboard (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:06.095 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-google-auth. 2023-08-25T04:00:06.112 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-08-25T04:00:06.145 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-08-25T04:00:06.220 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-08-25T04:00:06.234 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-08-25T04:00:06.278 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-08-25T04:00:06.482 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-08-25T04:00:06.497 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-08-25T04:00:06.540 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-08-25T04:00:06.833 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-joblib. 2023-08-25T04:00:06.848 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-08-25T04:00:06.868 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-websocket. 2023-08-25T04:00:06.883 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-08-25T04:00:06.891 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-08-25T04:00:06.918 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-08-25T04:00:07.211 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-08-25T04:00:07.221 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-kubernetes. 2023-08-25T04:00:07.226 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-08-25T04:00:07.236 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-08-25T04:00:07.261 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-08-25T04:00:07.271 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-08-25T04:00:07.531 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-sklearn. 2023-08-25T04:00:07.546 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-08-25T04:00:07.589 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-08-25T04:00:08.018 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-08-25T04:00:08.032 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T04:00:08.077 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:08.239 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-08-25T04:00:08.253 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T04:00:08.297 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:08.371 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libonig5:amd64. 2023-08-25T04:00:08.385 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-08-25T04:00:08.429 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-08-25T04:00:08.783 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libjq1:amd64. 2023-08-25T04:00:08.797 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-08-25T04:00:08.843 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-08-25T04:00:09.102 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package jq. 2023-08-25T04:00:09.116 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-08-25T04:00:09.153 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-08-25T04:00:09.261 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cachetools. 2023-08-25T04:00:09.274 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-08-25T04:00:09.317 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-08-25T04:00:09.396 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package socat. 2023-08-25T04:00:09.411 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-08-25T04:00:09.446 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-08-25T04:00:09.620 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pyasn1. 2023-08-25T04:00:09.635 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-08-25T04:00:09.678 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-08-25T04:00:09.759 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package xmlstarlet. 2023-08-25T04:00:09.774 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-08-25T04:00:09.817 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-08-25T04:00:10.032 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-08-25T04:00:10.047 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-08-25T04:00:10.131 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-08-25T04:00:10.170 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-test. 2023-08-25T04:00:10.185 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../093-ceph-test_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T04:00:10.223 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-test (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:10.443 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-rsa. 2023-08-25T04:00:10.458 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-08-25T04:00:10.501 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-rsa (4.8-1) ... 2023-08-25T04:00:10.873 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-google-auth. 2023-08-25T04:00:10.889 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-08-25T04:00:10.931 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-08-25T04:00:11.268 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-08-25T04:00:11.283 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-08-25T04:00:11.326 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-08-25T04:00:11.637 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-websocket. 2023-08-25T04:00:11.653 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-08-25T04:00:11.695 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-08-25T04:00:11.992 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-kubernetes. 2023-08-25T04:00:12.008 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-08-25T04:00:12.042 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-08-25T04:00:12.366 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-volume. 2023-08-25T04:00:12.381 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T04:00:12.424 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-volume (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:12.747 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-08-25T04:00:12.762 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T04:00:12.804 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephfs-mirror. 2023-08-25T04:00:12.805 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:12.819 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T04:00:12.854 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephfs-mirror (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:13.117 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libonig5:amd64. 2023-08-25T04:00:13.131 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-08-25T04:00:13.166 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-colorama. 2023-08-25T04:00:13.181 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-08-25T04:00:13.200 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-08-25T04:00:13.224 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-08-25T04:00:13.479 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libjq1:amd64. 2023-08-25T04:00:13.485 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephfs-shell. 2023-08-25T04:00:13.494 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-08-25T04:00:13.500 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T04:00:13.528 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-08-25T04:00:13.544 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephfs-shell (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:13.764 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package jq. 2023-08-25T04:00:13.780 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-08-25T04:00:13.821 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephfs-top. 2023-08-25T04:00:13.822 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-08-25T04:00:13.836 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T04:00:13.879 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephfs-top (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:14.092 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package socat. 2023-08-25T04:00:14.098 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libcephfs-dev. 2023-08-25T04:00:14.107 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-08-25T04:00:14.114 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T04:00:14.150 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-08-25T04:00:14.157 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libcephfs-dev (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:14.487 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package xmlstarlet. 2023-08-25T04:00:14.503 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-08-25T04:00:14.544 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package nvme-cli. 2023-08-25T04:00:14.548 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-08-25T04:00:14.556 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-08-25T04:00:14.595 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-08-25T04:00:14.899 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-test. 2023-08-25T04:00:15.379 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../093-ceph-test_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T04:00:15.380 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-test (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:15.380 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-08-25T04:00:15.380 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-08-25T04:00:15.380 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-08-25T04:00:15.451 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-iniconfig. 2023-08-25T04:00:15.467 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-08-25T04:00:15.510 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-08-25T04:00:15.812 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pastescript. 2023-08-25T04:00:15.828 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-08-25T04:00:15.870 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-08-25T04:00:16.249 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pluggy. 2023-08-25T04:00:16.264 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-08-25T04:00:16.316 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-08-25T04:00:16.585 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-psutil. 2023-08-25T04:00:16.600 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-08-25T04:00:16.643 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-08-25T04:00:17.021 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-py. 2023-08-25T04:00:17.036 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-volume. 2023-08-25T04:00:17.037 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-08-25T04:00:17.052 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T04:00:17.079 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-py (1.10.0-1) ... 2023-08-25T04:00:17.094 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-volume (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:17.416 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pygments. 2023-08-25T04:00:17.432 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-08-25T04:00:17.475 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-08-25T04:00:17.482 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package cephfs-mirror. 2023-08-25T04:00:17.498 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T04:00:17.540 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking cephfs-mirror (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:17.844 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-colorama. 2023-08-25T04:00:17.860 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-08-25T04:00:17.904 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyinotify. 2023-08-25T04:00:17.918 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-08-25T04:00:17.927 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-08-25T04:00:17.953 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-08-25T04:00:18.188 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package cephfs-shell. 2023-08-25T04:00:18.204 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T04:00:18.238 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking cephfs-shell (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:18.239 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-toml. 2023-08-25T04:00:18.254 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-08-25T04:00:18.331 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-08-25T04:00:18.449 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package cephfs-top. 2023-08-25T04:00:18.465 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-5703-gba6b39e4-1jammy_all.deb ... 2023-08-25T04:00:18.499 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking cephfs-top (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:18.625 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pytest. 2023-08-25T04:00:18.640 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-08-25T04:00:18.684 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-08-25T04:00:18.752 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libcephfs-dev. 2023-08-25T04:00:18.768 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T04:00:18.810 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libcephfs-dev (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:19.012 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-simplejson. 2023-08-25T04:00:19.027 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-08-25T04:00:19.070 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-08-25T04:00:19.222 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package nvme-cli. 2023-08-25T04:00:19.237 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-08-25T04:00:19.280 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-08-25T04:00:19.323 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-08-25T04:00:19.339 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-08-25T04:00:19.381 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-08-25T04:00:19.618 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-08-25T04:00:19.634 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-08-25T04:00:19.676 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-08-25T04:00:20.119 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package radosgw. 2023-08-25T04:00:20.121 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-iniconfig. 2023-08-25T04:00:20.133 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../113-radosgw_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T04:00:20.138 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-08-25T04:00:20.180 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-08-25T04:00:20.186 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking radosgw (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:20.441 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pastescript. 2023-08-25T04:00:20.457 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-08-25T04:00:20.490 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-08-25T04:00:20.802 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pluggy. 2023-08-25T04:00:20.805 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package rbd-fuse. 2023-08-25T04:00:20.818 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-08-25T04:00:20.820 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T04:00:20.860 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-08-25T04:00:20.863 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking rbd-fuse (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:21.157 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-08-25T04:00:21.196 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-psutil. 2023-08-25T04:00:21.212 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-08-25T04:00:21.263 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-08-25T04:00:21.411 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-08-25T04:00:21.520 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-08-25T04:00:21.574 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-py. 2023-08-25T04:00:21.590 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-08-25T04:00:21.632 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-py (1.10.0-1) ... 2023-08-25T04:00:21.778 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-08-25T04:00:21.953 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pygments. 2023-08-25T04:00:21.969 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-08-25T04:00:22.011 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-08-25T04:00:22.200 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-08-25T04:00:22.456 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pyinotify. 2023-08-25T04:00:22.472 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-08-25T04:00:22.506 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-08-25T04:00:22.776 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-toml. 2023-08-25T04:00:22.791 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-08-25T04:00:22.808 INFO:teuthology.orchestra.run.smithi110.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-08-25T04:00:22.826 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-08-25T04:00:22.861 INFO:teuthology.orchestra.run.smithi110.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-08-25T04:00:22.906 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephadm (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:23.078 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pytest. 2023-08-25T04:00:23.094 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-08-25T04:00:23.136 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-08-25T04:00:23.449 INFO:teuthology.orchestra.run.smithi110.stdout:Adding system user cephadm....done 2023-08-25T04:00:23.474 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-simplejson. 2023-08-25T04:00:23.496 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-08-25T04:00:23.531 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-08-25T04:00:23.586 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-08-25T04:00:23.793 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-08-25T04:00:23.809 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-08-25T04:00:23.851 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-08-25T04:00:23.862 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-08-25T04:00:24.122 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-08-25T04:00:24.247 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-08-25T04:00:24.532 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-08-25T04:00:24.546 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package radosgw. 2023-08-25T04:00:24.561 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../113-radosgw_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T04:00:24.604 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking radosgw (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:24.783 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-08-25T04:00:24.884 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-py (1.10.0-1) ... 2023-08-25T04:00:25.194 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-08-25T04:00:25.341 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package rbd-fuse. 2023-08-25T04:00:25.356 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-5703-gba6b39e4-1jammy_amd64.deb ... 2023-08-25T04:00:25.391 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking rbd-fuse (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:25.564 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-08-25T04:00:25.702 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-08-25T04:00:25.850 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-08-25T04:00:25.979 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-08-25T04:00:26.105 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-08-25T04:00:26.115 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-08-25T04:00:26.374 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-08-25T04:00:26.384 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-08-25T04:00:26.626 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-08-25T04:00:26.796 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-08-25T04:00:26.885 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-08-25T04:00:27.154 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-ceph-argparse (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:27.421 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-08-25T04:00:27.470 INFO:teuthology.orchestra.run.smithi055.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-08-25T04:00:27.508 INFO:teuthology.orchestra.run.smithi055.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-08-25T04:00:27.547 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-08-25T04:00:27.649 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up cephadm (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:27.806 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-08-25T04:00:28.083 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-08-25T04:00:28.192 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-08-25T04:00:28.253 INFO:teuthology.orchestra.run.smithi055.stdout:Adding system user cephadm....done 2023-08-25T04:00:28.380 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-08-25T04:00:28.535 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-08-25T04:00:28.660 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-08-25T04:00:28.707 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-08-25T04:00:28.937 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-08-25T04:00:28.991 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-08-25T04:00:29.109 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-08-25T04:00:29.213 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-08-25T04:00:29.360 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-08-25T04:00:29.539 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-08-25T04:00:29.620 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-08-25T04:00:29.746 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-py (1.10.0-1) ... 2023-08-25T04:00:30.064 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-08-25T04:00:30.233 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-08-25T04:00:30.441 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-08-25T04:00:30.484 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-08-25T04:00:30.604 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-08-25T04:00:30.709 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-08-25T04:00:30.728 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-08-25T04:00:30.977 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-08-25T04:00:31.046 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-08-25T04:00:31.255 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-08-25T04:00:31.447 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-08-25T04:00:31.504 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-08-25T04:00:31.714 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-08-25T04:00:31.780 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-08-25T04:00:32.064 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-ceph-argparse (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:32.108 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-08-25T04:00:32.341 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-08-25T04:00:32.401 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-08-25T04:00:32.467 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-08-25T04:00:32.711 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-08-25T04:00:32.735 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-08-25T04:00:32.994 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-08-25T04:00:33.062 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-08-25T04:00:33.128 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-08-25T04:00:33.321 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-08-25T04:00:33.472 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-ceph-common (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:33.496 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-08-25T04:00:33.610 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-08-25T04:00:33.774 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-idna (3.3-1) ... 2023-08-25T04:00:33.873 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-08-25T04:00:34.100 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-08-25T04:00:34.149 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-08-25T04:00:34.509 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-08-25T04:00:35.228 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-08-25T04:00:35.315 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-08-25T04:00:35.451 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-toml (0.10.2-1) ... 2023-08-25T04:00:35.529 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-08-25T04:00:35.629 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-08-25T04:00:35.720 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-08-25T04:00:35.730 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-08-25T04:00:35.817 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-08-25T04:00:35.927 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-08-25T04:00:36.040 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-08-25T04:00:36.228 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-08-25T04:00:36.458 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-08-25T04:00:36.496 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-08-25T04:00:36.755 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-08-25T04:00:36.801 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-08-25T04:00:36.881 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-08-25T04:00:37.000 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-08-25T04:00:37.194 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-08-25T04:00:37.292 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-08-25T04:00:37.512 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-08-25T04:00:37.569 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-08-25T04:00:37.837 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-08-25T04:00:37.838 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-08-25T04:00:38.129 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-08-25T04:00:38.198 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-08-25T04:00:38.389 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-08-25T04:00:38.474 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-08-25T04:00:38.625 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-ceph-common (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:38.665 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-08-25T04:00:38.799 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-08-25T04:00:38.951 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-idna (3.3-1) ... 2023-08-25T04:00:39.059 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-08-25T04:00:39.176 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-08-25T04:00:39.303 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-08-25T04:00:39.478 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-08-25T04:00:39.787 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-08-25T04:00:40.055 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-08-25T04:00:40.440 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-08-25T04:00:40.608 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-08-25T04:00:40.683 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-08-25T04:00:40.776 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-toml (0.10.2-1) ... 2023-08-25T04:00:40.787 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-08-25T04:00:41.052 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-08-25T04:00:41.161 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-08-25T04:00:41.178 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-08-25T04:00:41.296 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-08-25T04:00:41.437 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-portend (3.0.0-1) ... 2023-08-25T04:00:41.589 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-08-25T04:00:41.772 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-08-25T04:00:41.865 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-08-25T04:00:41.897 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-08-25T04:00:42.132 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-08-25T04:00:42.224 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-08-25T04:00:42.267 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-08-25T04:00:42.369 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-08-25T04:00:42.525 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-08-25T04:00:42.669 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-08-25T04:00:42.793 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-08-25T04:00:42.902 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rsa (4.8-1) ... 2023-08-25T04:00:42.954 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-08-25T04:00:43.179 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-08-25T04:00:43.222 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-08-25T04:00:43.479 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-08-25T04:00:43.481 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-08-25T04:00:43.747 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-08-25T04:00:43.748 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-08-25T04:00:44.049 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-08-25T04:00:44.141 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-08-25T04:00:44.185 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-08-25T04:00:44.436 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-08-25T04:00:44.478 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-08-25T04:00:44.606 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-08-25T04:00:44.788 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-08-25T04:00:45.212 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-08-25T04:00:45.212 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-08-25T04:00:45.213 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librados2 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:45.213 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librgw2 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:45.251 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libsqlite3-mod-ceph (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:45.427 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libcephfs2 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:45.465 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-08-25T04:00:45.578 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libradosstriper1 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:45.729 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-08-25T04:00:45.865 INFO:teuthology.orchestra.run.smithi055.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-08-25T04:00:46.061 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librbd1 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:46.127 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-08-25T04:00:46.207 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-modules-core (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:46.277 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-08-25T04:00:46.357 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-fuse (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:46.596 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-08-25T04:00:46.597 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-08-25T04:00:46.687 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-08-25T04:00:47.055 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-portend (3.0.0-1) ... 2023-08-25T04:00:47.234 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libcephfs-dev (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:47.306 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-08-25T04:00:47.377 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rados (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:47.415 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-08-25T04:00:47.528 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephfs-top (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:47.679 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-08-25T04:00:47.749 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-08-25T04:00:48.067 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-08-25T04:00:48.393 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-08-25T04:00:48.519 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-rsa (4.8-1) ... 2023-08-25T04:00:48.804 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-08-25T04:00:48.983 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rbd (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:49.071 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-08-25T04:00:49.092 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up rbd-fuse (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:49.227 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rgw (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:49.331 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-08-25T04:00:49.353 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cephfs (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:49.479 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephfs-shell (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:49.605 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-common (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:49.716 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-08-25T04:00:50.018 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-08-25T04:00:50.158 INFO:teuthology.orchestra.run.smithi110.stdout:Adding group ceph....done 2023-08-25T04:00:50.387 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-08-25T04:00:50.548 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up librados2 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:50.584 INFO:teuthology.orchestra.run.smithi110.stdout:Adding system user ceph....done 2023-08-25T04:00:50.655 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up librgw2 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:50.773 INFO:teuthology.orchestra.run.smithi110.stdout:Setting system user ceph properties....done 2023-08-25T04:00:50.793 INFO:teuthology.orchestra.run.smithi110.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-08-25T04:00:50.850 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libsqlite3-mod-ceph (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:50.928 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-08-25T04:00:50.984 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libcephfs2 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:51.110 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libradosstriper1 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:51.236 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-08-25T04:00:51.334 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-08-25T04:00:51.546 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up librbd1 (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:51.664 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-modules-core (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:51.765 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-fuse (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:51.984 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-08-25T04:00:51.985 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-08-25T04:00:52.064 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephfs-mirror (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:52.275 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-08-25T04:00:52.275 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-08-25T04:00:52.633 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libcephfs-dev (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:52.801 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-rados (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:52.928 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up cephfs-top (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:53.054 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-08-25T04:00:53.280 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-test (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:53.512 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up radosgw (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:53.860 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-08-25T04:00:53.861 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-08-25T04:00:54.416 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-rbd (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:54.542 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up rbd-fuse (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:54.668 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-rgw (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:54.786 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cephfs (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:54.827 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-base (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:54.912 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up cephfs-shell (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:55.013 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-common (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:55.178 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-08-25T04:00:55.567 INFO:teuthology.orchestra.run.smithi055.stdout:Adding group ceph....done 2023-08-25T04:00:55.859 INFO:teuthology.orchestra.run.smithi055.stdout:Adding system user ceph....done 2023-08-25T04:00:55.862 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mds (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:56.037 INFO:teuthology.orchestra.run.smithi055.stdout:Setting system user ceph properties....done 2023-08-25T04:00:56.056 INFO:teuthology.orchestra.run.smithi055.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-08-25T04:00:56.112 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-08-25T04:00:56.113 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-08-25T04:00:56.205 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-08-25T04:00:56.612 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-08-25T04:00:56.762 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:56.952 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-08-25T04:00:56.953 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-08-25T04:00:57.331 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up cephfs-mirror (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:57.547 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-08-25T04:00:57.547 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-08-25T04:00:57.615 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-osd (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:57.891 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-08-25T04:00:57.892 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-08-25T04:00:58.191 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-test (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:58.291 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up radosgw (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:58.516 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-k8sevents (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:58.538 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-08-25T04:00:58.539 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-08-25T04:00:58.626 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:58.768 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mon (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:58.977 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-08-25T04:00:58.977 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-08-25T04:00:59.443 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-base (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:59.628 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-cephadm (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:59.771 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:00:59.775 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-08-25T04:00:59.897 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-dashboard (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:01:00.032 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-volume (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:01:00.133 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-08-25T04:01:00.428 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mds (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:01:00.667 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-08-25T04:01:00.667 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-08-25T04:01:00.891 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-08-25T04:01:01.296 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:01:01.366 INFO:teuthology.orchestra.run.smithi110.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-08-25T04:01:01.371 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-08-25T04:01:01.447 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2023-08-25T04:01:01.517 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-08-25T04:01:01.518 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-08-25T04:01:01.607 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2023-08-25T04:01:01.607 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2023-08-25T04:01:01.750 INFO:teuthology.orchestra.run.smithi110.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-08-25T04:01:01.750 INFO:teuthology.orchestra.run.smithi110.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-08-25T04:01:01.750 INFO:teuthology.orchestra.run.smithi110.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-08-25T04:01:01.750 INFO:teuthology.orchestra.run.smithi110.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-08-25T04:01:01.750 INFO:teuthology.orchestra.run.smithi110.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-08-25T04:01:01.751 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2023-08-25T04:01:01.751 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-08-25T04:01:01.751 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-08-25T04:01:01.751 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-08-25T04:01:01.751 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-08-25T04:01:01.752 INFO:teuthology.orchestra.run.smithi110.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-08-25T04:01:01.752 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2023-08-25T04:01:01.752 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2023-08-25T04:01:01.752 INFO:teuthology.orchestra.run.smithi110.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-08-25T04:01:01.753 INFO:teuthology.orchestra.run.smithi110.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-08-25T04:01:01.753 INFO:teuthology.orchestra.run.smithi110.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-08-25T04:01:01.753 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-08-25T04:01:01.753 INFO:teuthology.orchestra.run.smithi110.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-08-25T04:01:01.753 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2023-08-25T04:01:01.754 INFO:teuthology.orchestra.run.smithi110.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-08-25T04:01:01.754 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-08-25T04:01:01.754 INFO:teuthology.orchestra.run.smithi110.stdout: libengine-pkcs11-openssl 2023-08-25T04:01:01.800 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2023-08-25T04:01:01.800 INFO:teuthology.orchestra.run.smithi110.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-08-25T04:01:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-08-25T04:01:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-08-25T04:01:01.801 INFO:teuthology.orchestra.run.smithi110.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-08-25T04:01:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-08-25T04:01:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-08-25T04:01:01.802 INFO:teuthology.orchestra.run.smithi110.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-08-25T04:01:01.802 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages will be upgraded: 2023-08-25T04:01:01.803 INFO:teuthology.orchestra.run.smithi110.stdout: libssl3 2023-08-25T04:01:01.940 INFO:teuthology.orchestra.run.smithi110.stdout:1 upgraded, 39 newly installed, 0 to remove and 242 not upgraded. 2023-08-25T04:01:01.940 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 54.6 MB of archives. 2023-08-25T04:01:01.940 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 202 MB of additional disk space will be used. 2023-08-25T04:01:01.941 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-08-25T04:01:02.038 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-08-25T04:01:02.093 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-08-25T04:01:02.102 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-08-25T04:01:02.102 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-08-25T04:01:02.104 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-08-25T04:01:02.105 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-08-25T04:01:02.106 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-08-25T04:01:02.106 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-08-25T04:01:02.108 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-08-25T04:01:02.108 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-08-25T04:01:02.113 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-08-25T04:01:02.126 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-08-25T04:01:02.173 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-osd (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:01:02.354 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-08-25T04:01:02.356 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-08-25T04:01:02.356 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-08-25T04:01:02.359 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-08-25T04:01:02.360 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-08-25T04:01:02.364 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-08-25T04:01:02.366 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-08-25T04:01:02.374 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-08-25T04:01:02.374 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-08-25T04:01:02.396 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-08-25T04:01:02.397 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-08-25T04:01:02.408 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-08-25T04:01:02.429 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-08-25T04:01:02.433 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-08-25T04:01:02.433 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-08-25T04:01:02.434 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-08-25T04:01:02.434 INFO:teuthology.orchestra.run.smithi110.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-08-25T04:01:02.447 INFO:teuthology.orchestra.run.smithi110.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-08-25T04:01:02.449 INFO:teuthology.orchestra.run.smithi110.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-08-25T04:01:02.602 INFO:teuthology.orchestra.run.smithi110.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-08-25T04:01:02.602 INFO:teuthology.orchestra.run.smithi110.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-08-25T04:01:02.602 INFO:teuthology.orchestra.run.smithi110.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-08-25T04:01:02.603 INFO:teuthology.orchestra.run.smithi110.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-08-25T04:01:02.604 INFO:teuthology.orchestra.run.smithi110.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-08-25T04:01:02.604 INFO:teuthology.orchestra.run.smithi110.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-08-25T04:01:02.616 INFO:teuthology.orchestra.run.smithi110.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-08-25T04:01:02.617 INFO:teuthology.orchestra.run.smithi110.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-08-25T04:01:02.961 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-08-25T04:01:02.961 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-08-25T04:01:02.989 INFO:teuthology.orchestra.run.smithi110.stdout:Preconfiguring packages ... 2023-08-25T04:01:03.152 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 54.6 MB in 1s (67.6 MB/s) 2023-08-25T04:01:03.289 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package flex. 2023-08-25T04:01:03.363 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139909 files and directories currently installed.) 2023-08-25T04:01:03.367 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-08-25T04:01:03.405 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking flex (2.6.4-8build2) ... 2023-08-25T04:01:03.605 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-k8sevents (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:01:03.764 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:01:03.916 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mon (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:01:04.007 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-08-25T04:01:04.134 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-08-25T04:01:04.134 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-08-25T04:01:04.186 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-08-25T04:01:04.661 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-08-25T04:01:04.800 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-cephadm (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:01:04.935 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:01:05.062 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-dashboard (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:01:05.203 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-volume (18.0.0-5703-gba6b39e4-1jammy) ... 2023-08-25T04:01:05.253 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package bison. 2023-08-25T04:01:05.327 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139982 files and directories currently installed.) 2023-08-25T04:01:05.331 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-08-25T04:01:05.338 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-08-25T04:01:05.381 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-08-25T04:01:05.765 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-08-25T04:01:05.778 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-08-25T04:01:05.823 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-08-25T04:01:06.159 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package dump. 2023-08-25T04:01:06.173 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-08-25T04:01:06.218 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking dump (0.4b47-3) ... 2023-08-25T04:01:06.489 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-08-25T04:01:06.538 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package indent. 2023-08-25T04:01:06.552 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-08-25T04:01:06.596 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking indent (2.2.12-1build2) ... 2023-08-25T04:01:06.865 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-08-25T04:01:06.879 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-08-25T04:01:06.923 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-08-25T04:01:07.014 INFO:teuthology.orchestra.run.smithi055.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-08-25T04:01:07.019 DEBUG:teuthology.orchestra.run.smithi055:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-08-25T04:01:07.097 INFO:teuthology.orchestra.run.smithi055.stdout:Reading package lists... 2023-08-25T04:01:07.235 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-08-25T04:01:07.249 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-08-25T04:01:07.261 INFO:teuthology.orchestra.run.smithi055.stdout:Building dependency tree... 2023-08-25T04:01:07.262 INFO:teuthology.orchestra.run.smithi055.stdout:Reading state information... 2023-08-25T04:01:07.302 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-08-25T04:01:07.411 INFO:teuthology.orchestra.run.smithi055.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-08-25T04:01:07.412 INFO:teuthology.orchestra.run.smithi055.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-08-25T04:01:07.412 INFO:teuthology.orchestra.run.smithi055.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-08-25T04:01:07.412 INFO:teuthology.orchestra.run.smithi055.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-08-25T04:01:07.412 INFO:teuthology.orchestra.run.smithi055.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-08-25T04:01:07.413 INFO:teuthology.orchestra.run.smithi055.stdout:The following packages were automatically installed and are no longer required: 2023-08-25T04:01:07.413 INFO:teuthology.orchestra.run.smithi055.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-08-25T04:01:07.413 INFO:teuthology.orchestra.run.smithi055.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-08-25T04:01:07.413 INFO:teuthology.orchestra.run.smithi055.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-08-25T04:01:07.413 INFO:teuthology.orchestra.run.smithi055.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-08-25T04:01:07.415 INFO:teuthology.orchestra.run.smithi055.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-08-25T04:01:07.415 INFO:teuthology.orchestra.run.smithi055.stdout:Use 'sudo apt autoremove' to remove them. 2023-08-25T04:01:07.415 INFO:teuthology.orchestra.run.smithi055.stdout:The following additional packages will be installed: 2023-08-25T04:01:07.416 INFO:teuthology.orchestra.run.smithi055.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-08-25T04:01:07.416 INFO:teuthology.orchestra.run.smithi055.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-08-25T04:01:07.416 INFO:teuthology.orchestra.run.smithi055.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-08-25T04:01:07.416 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-08-25T04:01:07.416 INFO:teuthology.orchestra.run.smithi055.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-08-25T04:01:07.417 INFO:teuthology.orchestra.run.smithi055.stdout:Suggested packages: 2023-08-25T04:01:07.417 INFO:teuthology.orchestra.run.smithi055.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-08-25T04:01:07.417 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-08-25T04:01:07.417 INFO:teuthology.orchestra.run.smithi055.stdout: libengine-pkcs11-openssl 2023-08-25T04:01:07.463 INFO:teuthology.orchestra.run.smithi055.stdout:The following NEW packages will be installed: 2023-08-25T04:01:07.463 INFO:teuthology.orchestra.run.smithi055.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-08-25T04:01:07.464 INFO:teuthology.orchestra.run.smithi055.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-08-25T04:01:07.464 INFO:teuthology.orchestra.run.smithi055.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-08-25T04:01:07.464 INFO:teuthology.orchestra.run.smithi055.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-08-25T04:01:07.464 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-08-25T04:01:07.465 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-08-25T04:01:07.465 INFO:teuthology.orchestra.run.smithi055.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-08-25T04:01:07.465 INFO:teuthology.orchestra.run.smithi055.stdout:The following packages will be upgraded: 2023-08-25T04:01:07.466 INFO:teuthology.orchestra.run.smithi055.stdout: libssl3 2023-08-25T04:01:07.546 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-08-25T04:01:07.561 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-08-25T04:01:07.596 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-08-25T04:01:07.650 INFO:teuthology.orchestra.run.smithi055.stdout:1 upgraded, 39 newly installed, 0 to remove and 242 not upgraded. 2023-08-25T04:01:07.651 INFO:teuthology.orchestra.run.smithi055.stdout:Need to get 54.6 MB of archives. 2023-08-25T04:01:07.651 INFO:teuthology.orchestra.run.smithi055.stdout:After this operation, 202 MB of additional disk space will be used. 2023-08-25T04:01:07.651 INFO:teuthology.orchestra.run.smithi055.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-08-25T04:01:07.966 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libfl2:amd64. 2023-08-25T04:01:07.981 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-08-25T04:01:08.024 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-08-25T04:01:08.133 INFO:teuthology.orchestra.run.smithi055.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-08-25T04:01:08.276 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-08-25T04:01:08.291 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-08-25T04:01:08.335 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-08-25T04:01:08.388 INFO:teuthology.orchestra.run.smithi055.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-08-25T04:01:08.423 INFO:teuthology.orchestra.run.smithi055.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-08-25T04:01:08.425 INFO:teuthology.orchestra.run.smithi055.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-08-25T04:01:08.430 INFO:teuthology.orchestra.run.smithi055.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-08-25T04:01:08.434 INFO:teuthology.orchestra.run.smithi055.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-08-25T04:01:08.434 INFO:teuthology.orchestra.run.smithi055.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-08-25T04:01:08.437 INFO:teuthology.orchestra.run.smithi055.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-08-25T04:01:08.440 INFO:teuthology.orchestra.run.smithi055.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-08-25T04:01:08.571 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libjson-perl. 2023-08-25T04:01:08.589 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-08-25T04:01:08.610 INFO:teuthology.orchestra.run.smithi055.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-08-25T04:01:08.610 INFO:teuthology.orchestra.run.smithi055.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-08-25T04:01:08.622 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-08-25T04:01:08.850 INFO:teuthology.orchestra.run.smithi055.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-08-25T04:01:08.890 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libllvm14:amd64. 2023-08-25T04:01:08.906 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-08-25T04:01:08.940 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-08-25T04:01:09.861 INFO:teuthology.orchestra.run.smithi055.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-08-25T04:01:09.863 INFO:teuthology.orchestra.run.smithi055.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-08-25T04:01:09.863 INFO:teuthology.orchestra.run.smithi055.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-08-25T04:01:09.866 INFO:teuthology.orchestra.run.smithi055.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-08-25T04:01:09.868 INFO:teuthology.orchestra.run.smithi055.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-08-25T04:01:09.895 INFO:teuthology.orchestra.run.smithi055.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-08-25T04:01:09.898 INFO:teuthology.orchestra.run.smithi055.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-08-25T04:01:09.906 INFO:teuthology.orchestra.run.smithi055.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-08-25T04:01:10.070 INFO:teuthology.orchestra.run.smithi055.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-08-25T04:01:10.385 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-08-25T04:01:10.400 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-08-25T04:01:10.443 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-08-25T04:01:10.714 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libmbim-proxy. 2023-08-25T04:01:10.729 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-08-25T04:01:10.771 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-08-25T04:01:10.791 INFO:teuthology.orchestra.run.smithi055.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-08-25T04:01:10.792 INFO:teuthology.orchestra.run.smithi055.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-08-25T04:01:10.818 INFO:teuthology.orchestra.run.smithi055.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-08-25T04:01:10.895 INFO:teuthology.orchestra.run.smithi055.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-08-25T04:01:10.905 INFO:teuthology.orchestra.run.smithi055.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-08-25T04:01:10.905 INFO:teuthology.orchestra.run.smithi055.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-08-25T04:01:10.906 INFO:teuthology.orchestra.run.smithi055.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-08-25T04:01:10.906 INFO:teuthology.orchestra.run.smithi055.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-08-25T04:01:10.934 INFO:teuthology.orchestra.run.smithi055.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-08-25T04:01:10.937 INFO:teuthology.orchestra.run.smithi055.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-08-25T04:01:11.065 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-08-25T04:01:11.080 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-08-25T04:01:11.115 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-08-25T04:01:11.451 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libndp0:amd64. 2023-08-25T04:01:11.466 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-08-25T04:01:11.509 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-08-25T04:01:11.564 INFO:teuthology.orchestra.run.smithi055.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-08-25T04:01:11.646 INFO:teuthology.orchestra.run.smithi055.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-08-25T04:01:11.646 INFO:teuthology.orchestra.run.smithi055.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-08-25T04:01:11.647 INFO:teuthology.orchestra.run.smithi055.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-08-25T04:01:11.737 INFO:teuthology.orchestra.run.smithi055.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-08-25T04:01:11.742 INFO:teuthology.orchestra.run.smithi055.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-08-25T04:01:11.862 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libnm0:amd64. 2023-08-25T04:01:11.877 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-08-25T04:01:11.920 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-08-25T04:01:12.199 INFO:teuthology.orchestra.run.smithi055.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-08-25T04:01:12.202 INFO:teuthology.orchestra.run.smithi055.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-08-25T04:01:12.273 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libpq5:amd64. 2023-08-25T04:01:12.288 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-08-25T04:01:12.332 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-08-25T04:01:12.609 INFO:teuthology.orchestra.run.smithi055.stdout:Preconfiguring packages ... 2023-08-25T04:01:12.633 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-08-25T04:01:12.649 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-08-25T04:01:12.692 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-08-25T04:01:12.779 INFO:teuthology.orchestra.run.smithi055.stdout:Fetched 54.6 MB in 5s (11.5 MB/s) 2023-08-25T04:01:12.923 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package flex. 2023-08-25T04:01:12.997 INFO:teuthology.orchestra.run.smithi055.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139909 files and directories currently installed.) 2023-08-25T04:01:13.001 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-08-25T04:01:13.003 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqmi-proxy. 2023-08-25T04:01:13.018 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-08-25T04:01:13.038 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking flex (2.6.4-8build2) ... 2023-08-25T04:01:13.086 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-08-25T04:01:13.338 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-08-25T04:01:13.353 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-08-25T04:01:13.396 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-08-25T04:01:13.594 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-08-25T04:01:13.738 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-08-25T04:01:13.933 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-08-25T04:01:13.947 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-08-25T04:01:13.991 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-08-25T04:01:14.129 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-08-25T04:01:14.269 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package modemmanager. 2023-08-25T04:01:14.284 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-08-25T04:01:14.319 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-08-25T04:01:14.723 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package bison. 2023-08-25T04:01:14.799 INFO:teuthology.orchestra.run.smithi055.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139982 files and directories currently installed.) 2023-08-25T04:01:14.802 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-08-25T04:01:14.858 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-08-25T04:01:15.042 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package network-manager. 2023-08-25T04:01:15.058 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-08-25T04:01:15.100 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-08-25T04:01:15.344 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-08-25T04:01:15.357 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-08-25T04:01:15.410 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-08-25T04:01:15.791 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ppp. 2023-08-25T04:01:15.806 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-08-25T04:01:15.871 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package dump. 2023-08-25T04:01:15.887 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-08-25T04:01:15.938 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking dump (0.4b47-3) ... 2023-08-25T04:01:16.162 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-08-25T04:01:16.242 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package indent. 2023-08-25T04:01:16.258 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-08-25T04:01:16.300 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking indent (2.2.12-1build2) ... 2023-08-25T04:01:16.470 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package pptp-linux. 2023-08-25T04:01:16.484 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-08-25T04:01:16.520 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-08-25T04:01:16.620 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-08-25T04:01:16.636 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-08-25T04:01:16.695 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-08-25T04:01:16.773 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package network-manager-pptp. 2023-08-25T04:01:16.786 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-08-25T04:01:16.831 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-08-25T04:01:17.133 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-08-25T04:01:17.137 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-client-common. 2023-08-25T04:01:17.147 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-08-25T04:01:17.149 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-08-25T04:01:17.191 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-client-common (238) ... 2023-08-25T04:01:17.200 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-08-25T04:01:17.485 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-08-25T04:01:17.501 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-08-25T04:01:17.504 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-client-14. 2023-08-25T04:01:17.520 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-08-25T04:01:17.544 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-08-25T04:01:17.554 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-08-25T04:01:17.981 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libfl2:amd64. 2023-08-25T04:01:17.997 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-08-25T04:01:18.048 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-08-25T04:01:18.142 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-common. 2023-08-25T04:01:18.161 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-08-25T04:01:18.217 INFO:teuthology.orchestra.run.smithi110.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-08-25T04:01:18.256 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-common (238) ... 2023-08-25T04:01:18.584 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-08-25T04:01:18.599 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-08-25T04:01:18.650 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-08-25T04:01:18.723 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-14. 2023-08-25T04:01:18.737 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-08-25T04:01:18.784 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-08-25T04:01:18.970 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libjson-perl. 2023-08-25T04:01:18.989 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-08-25T04:01:19.029 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-08-25T04:01:19.348 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libllvm14:amd64. 2023-08-25T04:01:19.368 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-08-25T04:01:19.401 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-08-25T04:01:20.119 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql. 2023-08-25T04:01:20.134 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-08-25T04:01:20.177 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql (14+238) ... 2023-08-25T04:01:20.380 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-client. 2023-08-25T04:01:20.394 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-08-25T04:01:20.430 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-client (14+238) ... 2023-08-25T04:01:20.649 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package postgresql-contrib. 2023-08-25T04:01:20.662 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-08-25T04:01:20.707 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking postgresql-contrib (14+238) ... 2023-08-25T04:01:20.794 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-08-25T04:01:20.809 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-08-25T04:01:20.851 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-08-25T04:01:21.025 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package tcl8.6. 2023-08-25T04:01:21.039 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-08-25T04:01:21.084 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-08-25T04:01:21.096 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libmbim-proxy. 2023-08-25T04:01:21.112 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-08-25T04:01:21.154 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-08-25T04:01:21.353 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package tcl. 2023-08-25T04:01:21.367 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-08-25T04:01:21.424 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-08-25T04:01:21.474 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-08-25T04:01:21.489 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-08-25T04:01:21.532 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-08-25T04:01:21.773 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package wpasupplicant. 2023-08-25T04:01:21.786 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-08-25T04:01:21.830 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-08-25T04:01:21.869 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libndp0:amd64. 2023-08-25T04:01:21.884 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-08-25T04:01:21.927 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-08-25T04:01:22.236 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-08-25T04:01:22.246 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libnm0:amd64. 2023-08-25T04:01:22.249 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-08-25T04:01:22.262 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-08-25T04:01:22.295 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-08-25T04:01:22.308 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-08-25T04:01:22.705 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libpq5:amd64. 2023-08-25T04:01:22.722 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-08-25T04:01:22.763 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package usb-modeswitch. 2023-08-25T04:01:22.766 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-08-25T04:01:22.777 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-08-25T04:01:22.829 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-08-25T04:01:23.069 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-08-25T04:01:23.085 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-08-25T04:01:23.102 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-client-common (238) ... 2023-08-25T04:01:23.127 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-08-25T04:01:23.319 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up flex (2.6.4-8build2) ... 2023-08-25T04:01:23.422 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libqmi-proxy. 2023-08-25T04:01:23.438 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-08-25T04:01:23.445 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-08-25T04:01:23.482 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-08-25T04:01:23.621 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-08-25T04:01:23.768 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-08-25T04:01:23.772 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-08-25T04:01:23.785 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-08-25T04:01:23.835 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-08-25T04:01:23.922 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-08-25T04:01:24.074 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-08-25T04:01:24.320 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-08-25T04:01:24.335 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-08-25T04:01:24.379 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-08-25T04:01:24.733 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package modemmanager. 2023-08-25T04:01:24.747 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-08-25T04:01:24.792 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-08-25T04:01:25.101 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-08-25T04:01:25.213 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-08-25T04:01:25.430 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package network-manager. 2023-08-25T04:01:25.446 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-08-25T04:01:25.497 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-08-25T04:01:25.573 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-08-25T04:01:25.573 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-08-25T04:01:26.113 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ppp. 2023-08-25T04:01:26.129 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-08-25T04:01:26.332 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-08-25T04:01:26.484 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-08-25T04:01:26.487 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-08-25T04:01:26.651 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-08-25T04:01:26.777 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-08-25T04:01:26.860 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package pptp-linux. 2023-08-25T04:01:26.874 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-08-25T04:01:26.903 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-08-25T04:01:26.918 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-08-25T04:01:27.054 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-08-25T04:01:27.205 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-08-25T04:01:27.213 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package network-manager-pptp. 2023-08-25T04:01:27.227 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-08-25T04:01:27.271 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-08-25T04:01:27.549 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql-client-common. 2023-08-25T04:01:27.564 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-08-25T04:01:27.599 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql-client-common (238) ... 2023-08-25T04:01:27.903 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql-client-14. 2023-08-25T04:01:27.919 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-08-25T04:01:27.962 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-08-25T04:01:27.970 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-08-25T04:01:28.131 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up dump (0.4b47-3) ... 2023-08-25T04:01:28.249 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-08-25T04:01:28.313 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-08-25T04:01:28.464 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-08-25T04:01:28.567 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql-common. 2023-08-25T04:01:28.583 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-08-25T04:01:28.615 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up tcl (8.6.11+1build2) ... 2023-08-25T04:01:28.644 INFO:teuthology.orchestra.run.smithi055.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-08-25T04:01:28.675 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql-common (238) ... 2023-08-25T04:01:28.766 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libjson-perl (4.04000-1) ... 2023-08-25T04:01:28.917 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-08-25T04:01:29.023 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-08-25T04:01:29.093 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up indent (2.2.12-1build2) ... 2023-08-25T04:01:29.142 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql-14. 2023-08-25T04:01:29.158 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-08-25T04:01:29.219 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-08-25T04:01:29.228 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-08-25T04:01:29.423 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-08-25T04:01:29.574 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-08-25T04:01:29.742 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-08-25T04:01:29.943 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-client (14+238) ... 2023-08-25T04:01:30.086 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-08-25T04:01:30.321 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql. 2023-08-25T04:01:30.336 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-08-25T04:01:30.371 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql (14+238) ... 2023-08-25T04:01:30.598 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql-client. 2023-08-25T04:01:30.613 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-08-25T04:01:30.657 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql-client (14+238) ... 2023-08-25T04:01:30.739 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:30.740 INFO:teuthology.orchestra.run.smithi110.stdout:The following network interfaces were found in /etc/network/interfaces 2023-08-25T04:01:30.740 INFO:teuthology.orchestra.run.smithi110.stdout:which means they are currently configured by ifupdown: 2023-08-25T04:01:30.740 INFO:teuthology.orchestra.run.smithi110.stdout:- enp3s0f1 2023-08-25T04:01:30.740 INFO:teuthology.orchestra.run.smithi110.stdout:If you want to manage those interfaces with NetworkManager instead 2023-08-25T04:01:30.740 INFO:teuthology.orchestra.run.smithi110.stdout:remove their configuration from /etc/network/interfaces. 2023-08-25T04:01:30.740 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:30.874 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-08-25T04:01:30.901 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql-contrib. 2023-08-25T04:01:30.916 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-08-25T04:01:30.960 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql-contrib (14+238) ... 2023-08-25T04:01:31.273 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-08-25T04:01:31.279 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package tcl8.6. 2023-08-25T04:01:31.295 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-08-25T04:01:31.337 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-08-25T04:01:31.626 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package tcl. 2023-08-25T04:01:31.640 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-08-25T04:01:31.676 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-08-25T04:01:31.688 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-08-25T04:01:32.035 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package wpasupplicant. 2023-08-25T04:01:32.051 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-08-25T04:01:32.093 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-08-25T04:01:32.356 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-08-25T04:01:32.516 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-08-25T04:01:32.548 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-08-25T04:01:32.567 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-08-25T04:01:32.598 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-08-25T04:01:32.692 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-08-25T04:01:32.843 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-common (238) ... 2023-08-25T04:01:32.961 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package usb-modeswitch. 2023-08-25T04:01:32.977 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-08-25T04:01:33.027 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-08-25T04:01:33.320 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql-client-common (238) ... 2023-08-25T04:01:33.543 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up flex (2.6.4-8build2) ... 2023-08-25T04:01:33.659 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-08-25T04:01:33.786 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-08-25T04:01:33.912 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-08-25T04:01:33.922 INFO:teuthology.orchestra.run.smithi110.stdout:Adding user postgres to group ssl-cert 2023-08-25T04:01:34.046 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-08-25T04:01:34.172 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-08-25T04:01:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:34.241 INFO:teuthology.orchestra.run.smithi110.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-08-25T04:01:34.525 INFO:teuthology.orchestra.run.smithi110.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-08-25T04:01:34.526 INFO:teuthology.orchestra.run.smithi110.stdout:Removing obsolete dictionary files: 2023-08-25T04:01:35.207 INFO:teuthology.orchestra.run.smithi055.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-08-25T04:01:35.245 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-08-25T04:01:35.311 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-08-25T04:01:35.705 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-08-25T04:01:35.705 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-08-25T04:01:35.753 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-08-25T04:01:36.097 INFO:teuthology.orchestra.run.smithi110.stdout:Creating new PostgreSQL cluster 14/main ... 2023-08-25T04:01:36.122 INFO:teuthology.orchestra.run.smithi110.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-08-25T04:01:36.189 INFO:teuthology.orchestra.run.smithi110.stdout:The files belonging to this database system will be owned by user "postgres". 2023-08-25T04:01:36.190 INFO:teuthology.orchestra.run.smithi110.stdout:This user must also own the server process. 2023-08-25T04:01:36.190 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:36.190 INFO:teuthology.orchestra.run.smithi110.stdout:The database cluster will be initialized with locale "en_US". 2023-08-25T04:01:36.190 INFO:teuthology.orchestra.run.smithi110.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-08-25T04:01:36.190 INFO:teuthology.orchestra.run.smithi110.stdout:The default text search configuration will be set to "english". 2023-08-25T04:01:36.190 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:36.191 INFO:teuthology.orchestra.run.smithi110.stdout:Data page checksums are disabled. 2023-08-25T04:01:36.191 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:36.191 INFO:teuthology.orchestra.run.smithi110.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-08-25T04:01:36.191 INFO:teuthology.orchestra.run.smithi110.stdout:creating subdirectories ... ok 2023-08-25T04:01:36.192 INFO:teuthology.orchestra.run.smithi110.stdout:selecting dynamic shared memory implementation ... posix 2023-08-25T04:01:36.214 INFO:teuthology.orchestra.run.smithi110.stdout:selecting default max_connections ... 100 2023-08-25T04:01:36.248 INFO:teuthology.orchestra.run.smithi110.stdout:selecting default shared_buffers ... 128MB 2023-08-25T04:01:36.263 INFO:teuthology.orchestra.run.smithi110.stdout:selecting default time zone ... Etc/UTC 2023-08-25T04:01:36.263 INFO:teuthology.orchestra.run.smithi110.stdout:creating configuration files ... ok 2023-08-25T04:01:36.397 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-08-25T04:01:36.437 INFO:teuthology.orchestra.run.smithi110.stdout:running bootstrap script ... ok 2023-08-25T04:01:36.523 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-08-25T04:01:36.652 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-08-25T04:01:36.759 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-08-25T04:01:36.893 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-08-25T04:01:37.019 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-08-25T04:01:37.056 INFO:teuthology.orchestra.run.smithi110.stdout:performing post-bootstrap initialization ... ok 2023-08-25T04:01:37.120 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-08-25T04:01:37.643 INFO:teuthology.orchestra.run.smithi110.stdout:syncing data to disk ... ok 2023-08-25T04:01:37.777 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-08-25T04:01:37.919 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up dump (0.4b47-3) ... 2023-08-25T04:01:38.015 INFO:teuthology.orchestra.run.smithi055.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-08-25T04:01:38.072 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-08-25T04:01:38.162 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-08-25T04:01:38.199 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-08-25T04:01:38.323 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up tcl (8.6.11+1build2) ... 2023-08-25T04:01:38.450 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libjson-perl (4.04000-1) ... 2023-08-25T04:01:38.901 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-08-25T04:01:39.016 INFO:teuthology.orchestra.run.smithi055.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-08-25T04:01:39.086 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up indent (2.2.12-1build2) ... 2023-08-25T04:01:39.204 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-08-25T04:01:39.364 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-08-25T04:01:39.482 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-08-25T04:01:39.608 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-08-25T04:01:39.776 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql-client (14+238) ... 2023-08-25T04:01:39.902 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-08-25T04:01:40.525 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:40.526 INFO:teuthology.orchestra.run.smithi055.stdout:The following network interfaces were found in /etc/network/interfaces 2023-08-25T04:01:40.526 INFO:teuthology.orchestra.run.smithi055.stdout:which means they are currently configured by ifupdown: 2023-08-25T04:01:40.526 INFO:teuthology.orchestra.run.smithi055.stdout:- ens1f0 2023-08-25T04:01:40.526 INFO:teuthology.orchestra.run.smithi055.stdout:If you want to manage those interfaces with NetworkManager instead 2023-08-25T04:01:40.526 INFO:teuthology.orchestra.run.smithi055.stdout:remove their configuration from /etc/network/interfaces. 2023-08-25T04:01:40.527 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:40.666 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-08-25T04:01:41.080 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-08-25T04:01:41.507 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-08-25T04:01:41.594 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-08-25T04:01:41.737 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql-contrib (14+238) ... 2023-08-25T04:01:41.879 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up postgresql (14+238) ... 2023-08-25T04:01:42.031 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-08-25T04:01:42.182 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-08-25T04:01:42.205 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-08-25T04:01:42.365 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-08-25T04:01:42.466 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-08-25T04:01:42.467 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-08-25T04:01:42.483 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-08-25T04:01:42.584 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql-common (238) ... 2023-08-25T04:01:43.276 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-08-25T04:01:43.526 INFO:teuthology.orchestra.run.smithi055.stdout:Adding user postgres to group ssl-cert 2023-08-25T04:01:43.595 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-08-25T04:01:43.756 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-08-25T04:01:43.775 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:43.776 INFO:teuthology.orchestra.run.smithi055.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-08-25T04:01:44.027 INFO:teuthology.orchestra.run.smithi055.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-08-25T04:01:44.027 INFO:teuthology.orchestra.run.smithi055.stdout:Removing obsolete dictionary files: 2023-08-25T04:01:44.751 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-08-25T04:01:45.191 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-08-25T04:01:45.246 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-08-25T04:01:45.300 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-08-25T04:01:45.600 INFO:teuthology.orchestra.run.smithi055.stdout:Creating new PostgreSQL cluster 14/main ... 2023-08-25T04:01:45.620 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-08-25T04:01:45.666 INFO:teuthology.orchestra.run.smithi055.stdout:The files belonging to this database system will be owned by user "postgres". 2023-08-25T04:01:45.666 INFO:teuthology.orchestra.run.smithi055.stdout:This user must also own the server process. 2023-08-25T04:01:45.667 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:45.667 INFO:teuthology.orchestra.run.smithi055.stdout:The database cluster will be initialized with locale "en_US". 2023-08-25T04:01:45.667 INFO:teuthology.orchestra.run.smithi055.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-08-25T04:01:45.667 INFO:teuthology.orchestra.run.smithi055.stdout:The default text search configuration will be set to "english". 2023-08-25T04:01:45.667 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:45.667 INFO:teuthology.orchestra.run.smithi055.stdout:Data page checksums are disabled. 2023-08-25T04:01:45.668 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:45.668 INFO:teuthology.orchestra.run.smithi055.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-08-25T04:01:45.668 INFO:teuthology.orchestra.run.smithi055.stdout:creating subdirectories ... ok 2023-08-25T04:01:45.668 INFO:teuthology.orchestra.run.smithi055.stdout:selecting dynamic shared memory implementation ... posix 2023-08-25T04:01:45.692 INFO:teuthology.orchestra.run.smithi055.stdout:selecting default max_connections ... 100 2023-08-25T04:01:45.726 INFO:teuthology.orchestra.run.smithi055.stdout:selecting default shared_buffers ... 128MB 2023-08-25T04:01:45.741 INFO:teuthology.orchestra.run.smithi055.stdout:selecting default time zone ... Etc/UTC 2023-08-25T04:01:45.742 INFO:teuthology.orchestra.run.smithi055.stdout:creating configuration files ... ok 2023-08-25T04:01:45.926 INFO:teuthology.orchestra.run.smithi055.stdout:running bootstrap script ... ok 2023-08-25T04:01:45.991 INFO:teuthology.orchestra.run.smithi110.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-08-25T04:01:45.996 DEBUG:teuthology.parallel:result is None 2023-08-25T04:01:46.603 INFO:teuthology.orchestra.run.smithi055.stdout:performing post-bootstrap initialization ... ok 2023-08-25T04:01:47.109 INFO:teuthology.orchestra.run.smithi055.stdout:syncing data to disk ... ok 2023-08-25T04:01:47.636 INFO:teuthology.orchestra.run.smithi055.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-08-25T04:01:50.737 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-08-25T04:01:50.855 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql-contrib (14+238) ... 2023-08-25T04:01:50.998 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql (14+238) ... 2023-08-25T04:01:51.124 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-08-25T04:01:51.250 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-08-25T04:01:51.519 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-08-25T04:01:51.520 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-08-25T04:01:52.311 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-08-25T04:01:52.605 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-08-25T04:01:52.740 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-08-25T04:01:54.427 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-08-25T04:01:54.527 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-08-25T04:01:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-08-25T04:01:55.228 DEBUG:teuthology.parallel:result is None 2023-08-25T04:01:55.229 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T04:01:55.369 DEBUG:teuthology.orchestra.run.smithi055:> dpkg-query -W -f '${Version}' ceph 2023-08-25T04:01:55.392 INFO:teuthology.orchestra.run.smithi055.stdout:18.0.0-5703-gba6b39e4-1jammy 2023-08-25T04:01:55.392 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5703-gba6b39e4-1jammy 2023-08-25T04:01:55.393 INFO:teuthology.task.install:The correct ceph version 18.0.0-5703-gba6b39e4-1jammy is installed. 2023-08-25T04:01:55.393 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ba6b39e4f4f77fb95c747099b53db0467d435f56 2023-08-25T04:01:55.605 DEBUG:teuthology.orchestra.run.smithi110:> dpkg-query -W -f '${Version}' ceph 2023-08-25T04:01:55.636 INFO:teuthology.orchestra.run.smithi110.stdout:18.0.0-5703-gba6b39e4-1jammy 2023-08-25T04:01:55.636 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5703-gba6b39e4-1jammy 2023-08-25T04:01:55.637 INFO:teuthology.task.install:The correct ceph version 18.0.0-5703-gba6b39e4-1jammy is installed. 2023-08-25T04:01:55.637 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-25T04:01:55.638 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:01:55.638 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-25T04:01:55.660 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:01:55.661 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-25T04:01:55.700 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-25T04:01:55.701 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:01:55.701 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/daemon-helper 2023-08-25T04:01:55.728 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-25T04:01:55.796 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:01:55.796 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2023-08-25T04:01:55.818 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-25T04:01:55.879 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-25T04:01:55.880 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:01:55.880 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-25T04:01:55.902 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-25T04:01:55.965 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:01:55.965 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-25T04:01:55.986 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-25T04:01:56.047 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-25T04:01:56.049 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:01:56.050 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/stdin-killer 2023-08-25T04:01:56.074 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-25T04:01:56.137 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:01:56.137 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2023-08-25T04:01:56.158 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-25T04:01:56.222 INFO:teuthology.run_tasks:Running task ceph... 2023-08-25T04:01:56.319 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-25T04:01:56.320 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 777 /var/log/ceph 2023-08-25T04:01:56.324 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2023-08-25T04:01:56.346 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-25T04:01:56.346 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-25T04:01:56.391 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-25T04:01:56.411 INFO:tasks.ceph:Creating extra log directories... 2023-08-25T04:01:56.412 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-25T04:01:56.455 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-25T04:01:56.489 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-25T04:01:56.490 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-25T04:01:56.490 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-25T04:01:56.490 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:01:56.490 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-25T04:01:56.529 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-25T04:01:56.629 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:01:56.629 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-25T04:01:56.638 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-25T04:01:56.740 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-25T04:01:56.741 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-25T04:01:56.741 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379036', 'branch': 'wip-rishabh-2023aug3-b5', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': None, 'first_in_suite': False, 'job_id': '7379036', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a6a69670761025e039dc5ae86619b0cf04c46dc2'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023aug3-b5'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023aug3-b5', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023aug3-b5', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ba6b39e4f4f77fb95c747099b53db0467d435f56/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi055.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCbSExc0/U0hdNt/KP9I42BESUbsI38oGqLfrdMpP88j4nIcB9jNfBW9vGqukDfdZ9bWp4UT/JYpYltO7n++MXY=', 'smithi110.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLy9V2QndWWs7FahLdZ2TMHZaau2Xc5gQJcPaEif4xti/5076p9YL2e6ua5Am6ZYj1ULbJVIOmyP/RzlEsbGmWU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a6a69670761025e039dc5ae86619b0cf04c46dc2'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ba6b39e4f4f77fb95c747099b53db0467d435f56'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '449a1bc2027504e7b3c3d7b30fa4178906581da7', 'timestamp': '2023-08-25_01:50:32', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2224'} 2023-08-25T04:01:56.742 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-25T04:01:56.746 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-25T04:01:56.756 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/run/ceph 2023-08-25T04:01:56.799 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2023-08-25T04:01:56.823 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:01:56.823 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/scratch_devs of=/dev/stdout 2023-08-25T04:01:56.870 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-25T04:01:56.870 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_1 2023-08-25T04:01:56.921 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-25T04:01:56.921 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:01:56.921 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 881 Links: 1 2023-08-25T04:01:56.922 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:01:56.922 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2023-08-25 03:55:18.935114891 +0000 2023-08-25T04:01:56.922 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2023-08-25 03:55:18.483118924 +0000 2023-08-25T04:01:56.922 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2023-08-25 03:55:18.483118924 +0000 2023-08-25T04:01:56.922 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2023-08-25 03:55:18.483118924 +0000 2023-08-25T04:01:56.923 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-25T04:01:56.985 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2023-08-25T04:01:56.986 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2023-08-25T04:01:56.986 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000508689 s, 1.0 MB/s 2023-08-25T04:01:56.987 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-25T04:01:57.039 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_2 2023-08-25T04:01:57.089 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-25T04:01:57.090 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:01:57.090 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 897 Links: 1 2023-08-25T04:01:57.090 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:01:57.090 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2023-08-25 03:55:19.615108826 +0000 2023-08-25T04:01:57.090 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2023-08-25 03:55:19.211112429 +0000 2023-08-25T04:01:57.091 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2023-08-25 03:55:19.211112429 +0000 2023-08-25T04:01:57.091 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2023-08-25 03:55:19.211112429 +0000 2023-08-25T04:01:57.091 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-25T04:01:57.157 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2023-08-25T04:01:57.157 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2023-08-25T04:01:57.157 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000444547 s, 1.2 MB/s 2023-08-25T04:01:57.159 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-25T04:01:57.212 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_3 2023-08-25T04:01:57.268 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-25T04:01:57.268 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:01:57.268 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 913 Links: 1 2023-08-25T04:01:57.269 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:01:57.269 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2023-08-25 03:55:20.263103045 +0000 2023-08-25T04:01:57.269 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2023-08-25 03:55:19.887106398 +0000 2023-08-25T04:01:57.269 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2023-08-25 03:55:19.887106398 +0000 2023-08-25T04:01:57.269 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2023-08-25 03:55:19.887106398 +0000 2023-08-25T04:01:57.269 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-25T04:01:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2023-08-25T04:01:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2023-08-25T04:01:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000421108 s, 1.2 MB/s 2023-08-25T04:01:57.336 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-25T04:01:57.388 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_4 2023-08-25T04:01:57.446 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-25T04:01:57.446 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:01:57.446 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 929 Links: 1 2023-08-25T04:01:57.447 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:01:57.447 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2023-08-25 03:55:20.547100511 +0000 2023-08-25T04:01:57.447 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2023-08-25 03:55:20.543100547 +0000 2023-08-25T04:01:57.447 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2023-08-25 03:55:20.543100547 +0000 2023-08-25T04:01:57.447 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2023-08-25 03:55:20.543100547 +0000 2023-08-25T04:01:57.448 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-25T04:01:57.509 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2023-08-25T04:01:57.509 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2023-08-25T04:01:57.510 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000454027 s, 1.1 MB/s 2023-08-25T04:01:57.511 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-25T04:01:57.568 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T04:01:57.568 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:01:57.569 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2023-08-25T04:01:57.579 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-25T04:01:57.580 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2023-08-25T04:01:57.636 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-25T04:01:57.637 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:01:57.637 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 902 Links: 1 2023-08-25T04:01:57.637 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:01:57.637 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2023-08-25 03:55:14.401516161 +0000 2023-08-25T04:01:57.637 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2023-08-25 03:55:14.397516195 +0000 2023-08-25T04:01:57.637 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2023-08-25 03:55:14.397516195 +0000 2023-08-25T04:01:57.638 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2023-08-25 03:55:14.397516195 +0000 2023-08-25T04:01:57.638 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-25T04:01:57.703 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2023-08-25T04:01:57.703 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2023-08-25T04:01:57.703 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000283081 s, 1.8 MB/s 2023-08-25T04:01:57.705 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-25T04:01:57.758 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2023-08-25T04:01:57.809 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-25T04:01:57.809 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:01:57.809 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 918 Links: 1 2023-08-25T04:01:57.809 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:01:57.810 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2023-08-25 03:55:15.493506407 +0000 2023-08-25T04:01:57.810 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2023-08-25 03:55:15.057510300 +0000 2023-08-25T04:01:57.810 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2023-08-25 03:55:15.057510300 +0000 2023-08-25T04:01:57.810 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2023-08-25 03:55:15.057510300 +0000 2023-08-25T04:01:57.810 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-25T04:01:57.874 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2023-08-25T04:01:57.875 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2023-08-25T04:01:57.875 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000271347 s, 1.9 MB/s 2023-08-25T04:01:57.876 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-25T04:01:57.934 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2023-08-25T04:01:57.983 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-25T04:01:57.984 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:01:57.984 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 936 Links: 1 2023-08-25T04:01:57.984 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:01:57.984 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2023-08-25 03:55:16.181500262 +0000 2023-08-25T04:01:57.985 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2023-08-25 03:55:15.765503977 +0000 2023-08-25T04:01:57.985 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2023-08-25 03:55:15.765503977 +0000 2023-08-25T04:01:57.985 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2023-08-25 03:55:15.765503977 +0000 2023-08-25T04:01:57.985 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-25T04:01:58.046 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2023-08-25T04:01:58.047 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2023-08-25T04:01:58.047 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000274581 s, 1.9 MB/s 2023-08-25T04:01:58.048 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-25T04:01:58.102 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2023-08-25T04:01:58.152 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-25T04:01:58.152 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-25T04:01:58.152 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 952 Links: 1 2023-08-25T04:01:58.152 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-25T04:01:58.153 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2023-08-25 03:55:16.913493723 +0000 2023-08-25T04:01:58.153 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2023-08-25 03:55:16.477497617 +0000 2023-08-25T04:01:58.153 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2023-08-25 03:55:16.477497617 +0000 2023-08-25T04:01:58.153 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2023-08-25 03:55:16.477497617 +0000 2023-08-25T04:01:58.153 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-25T04:01:58.215 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2023-08-25T04:01:58.215 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2023-08-25T04:01:58.216 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000275931 s, 1.9 MB/s 2023-08-25T04:01:58.217 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-25T04:01:58.269 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T04:01:58.269 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-25T04:01:58.270 INFO:tasks.ceph:Generating config... 2023-08-25T04:01:58.271 INFO:tasks.ceph:[client] client mount timeout = 600 2023-08-25T04:01:58.272 INFO:tasks.ceph:[client] debug client = 20 2023-08-25T04:01:58.272 INFO:tasks.ceph:[client] debug ms = 1 2023-08-25T04:01:58.272 INFO:tasks.ceph:[client] pid file = 2023-08-25T04:01:58.272 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-08-25T04:01:58.272 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-08-25T04:01:58.273 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-08-25T04:01:58.273 INFO:tasks.ceph:[mds] debug mds = 20 2023-08-25T04:01:58.273 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-08-25T04:01:58.274 INFO:tasks.ceph:[mds] debug ms = 1 2023-08-25T04:01:58.274 INFO:tasks.ceph:[mds] mds debug frag = True 2023-08-25T04:01:58.274 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-08-25T04:01:58.274 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-08-25T04:01:58.275 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-08-25T04:01:58.275 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-08-25T04:01:58.275 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-08-25T04:01:58.275 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-08-25T04:01:58.276 INFO:tasks.ceph:[mgr] debug client = 20 2023-08-25T04:01:58.276 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-08-25T04:01:58.276 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-25T04:01:58.276 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-25T04:01:58.277 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-25T04:01:58.277 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-25T04:01:58.277 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-25T04:01:58.277 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-08-25T04:01:58.277 INFO:tasks.ceph:[osd] bdev async discard = True 2023-08-25T04:01:58.278 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-08-25T04:01:58.278 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-08-25T04:01:58.278 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-25T04:01:58.280 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-25T04:01:58.280 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-08-25T04:01:58.280 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-08-25T04:01:58.280 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-25T04:01:58.280 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-25T04:01:58.281 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-08-25T04:01:58.281 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-25T04:01:58.281 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-25T04:01:58.281 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-25T04:01:58.281 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-25T04:01:58.282 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-25T04:01:58.282 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-08-25T04:01:58.282 INFO:tasks.ceph:Setting up mon.a... 2023-08-25T04:01:58.282 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-25T04:01:58.331 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.keyring 2023-08-25T04:01:58.349 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-25T04:01:58.400 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-25T04:01:58.423 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.55'), ('mon.b', '172.21.15.110'), ('mon.c', '[v2:172.21.15.110:3301,v1:172.21.15.110:6790]')] 2023-08-25T04:01:58.424 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.55,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-08-25T04:01:58.425 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:01:58.425 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-25T04:01:58.472 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.55 --add b 172.21.15.110 --addv c '[v2:172.21.15.110:3301,v1:172.21.15.110:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:01:58.568 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:01:58.569 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: generated fsid 2d2a9024-b152-4d40-880c-1686d1810590 2023-08-25T04:01:58.569 INFO:teuthology.orchestra.run.smithi055.stdout:setting min_mon_release = pacific 2023-08-25T04:01:58.569 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 0 2023-08-25T04:01:58.569 INFO:teuthology.orchestra.run.smithi055.stdout:fsid 2d2a9024-b152-4d40-880c-1686d1810590 2023-08-25T04:01:58.569 INFO:teuthology.orchestra.run.smithi055.stdout:last_changed 2023-08-25T04:01:58.568678+0000 2023-08-25T04:01:58.570 INFO:teuthology.orchestra.run.smithi055.stdout:created 2023-08-25T04:01:58.568678+0000 2023-08-25T04:01:58.570 INFO:teuthology.orchestra.run.smithi055.stdout:min_mon_release 16 (pacific) 2023-08-25T04:01:58.570 INFO:teuthology.orchestra.run.smithi055.stdout:election_strategy: 1 2023-08-25T04:01:58.570 INFO:teuthology.orchestra.run.smithi055.stdout:0: [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] mon.a 2023-08-25T04:01:58.570 INFO:teuthology.orchestra.run.smithi055.stdout:1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2023-08-25T04:01:58.570 INFO:teuthology.orchestra.run.smithi055.stdout:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2023-08-25T04:01:58.570 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-25T04:01:58.572 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-25T04:01:58.580 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2d2a9024-b152-4d40-880c-1686d1810590... 2023-08-25T04:01:58.581 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-25T04:01:58.627 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-25T04:01:58.671 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2023-08-25T04:01:58.672 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2023-08-25T04:01:58.672 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-25T04:01:58.672 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2023-08-25T04:01:58.672 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.672 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2023-08-25T04:01:58.672 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.673 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2023-08-25T04:01:58.673 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.673 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2023-08-25T04:01:58.673 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2023-08-25T04:01:58.673 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.673 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2023-08-25T04:01:58.673 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2023-08-25T04:01:58.673 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.674 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-25T04:01:58.674 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2023-08-25T04:01:58.674 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.674 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2023-08-25T04:01:58.674 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-25T04:01:58.674 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.674 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2023-08-25T04:01:58.675 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.675 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2023-08-25T04:01:58.675 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2023-08-25T04:01:58.675 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2023-08-25T04:01:58.675 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2023-08-25T04:01:58.675 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2023-08-25T04:01:58.675 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2023-08-25T04:01:58.675 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2023-08-25T04:01:58.676 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-25T04:01:58.676 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-25T04:01:58.676 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2023-08-25T04:01:58.676 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.678 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-25T04:01:58.678 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.678 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2023-08-25T04:01:58.678 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.679 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2023-08-25T04:01:58.679 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.679 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2023-08-25T04:01:58.679 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2023-08-25T04:01:58.679 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2023-08-25T04:01:58.679 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.55,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2023-08-25T04:01:58.680 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2023-08-25T04:01:58.680 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = 2d2a9024-b152-4d40-880c-1686d1810590 2023-08-25T04:01:58.680 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.680 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2023-08-25T04:01:58.680 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2023-08-25T04:01:58.681 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.681 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2023-08-25T04:01:58.681 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2023-08-25T04:01:58.682 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2023-08-25T04:01:58.682 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.682 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2023-08-25T04:01:58.682 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2023-08-25T04:01:58.682 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.682 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2023-08-25T04:01:58.682 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2023-08-25T04:01:58.682 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2023-08-25T04:01:58.683 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.683 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2023-08-25T04:01:58.683 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2023-08-25T04:01:58.683 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.683 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2023-08-25T04:01:58.683 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.683 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2023-08-25T04:01:58.683 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.684 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2023-08-25T04:01:58.684 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.684 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2023-08-25T04:01:58.684 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2023-08-25T04:01:58.684 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.684 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2023-08-25T04:01:58.684 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2023-08-25T04:01:58.685 INFO:teuthology.orchestra.run.smithi055.stdout: bdev async discard = True 2023-08-25T04:01:58.685 INFO:teuthology.orchestra.run.smithi055.stdout: bdev enable discard = True 2023-08-25T04:01:58.685 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore allocator = bitmap 2023-08-25T04:01:58.685 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2023-08-25T04:01:58.685 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2023-08-25T04:01:58.685 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 1/20 2023-08-25T04:01:58.685 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 1/20 2023-08-25T04:01:58.686 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-08-25T04:01:58.686 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2023-08-25T04:01:58.686 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 4/10 2023-08-25T04:01:58.686 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2023-08-25T04:01:58.686 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2023-08-25T04:01:58.686 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2023-08-25T04:01:58.686 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2023-08-25T04:01:58.686 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2023-08-25T04:01:58.687 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2023-08-25T04:01:58.687 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.687 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2023-08-25T04:01:58.687 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-08-25T04:01:58.687 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2023-08-25T04:01:58.687 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2023-08-25T04:01:58.687 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2023-08-25T04:01:58.687 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2023-08-25T04:01:58.688 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2023-08-25T04:01:58.688 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2023-08-25T04:01:58.688 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2023-08-25T04:01:58.688 INFO:teuthology.orchestra.run.smithi055.stdout: debug finisher = 20 2023-08-25T04:01:58.688 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.688 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2023-08-25T04:01:58.688 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-08-25T04:01:58.688 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2023-08-25T04:01:58.689 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2023-08-25T04:01:58.689 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2023-08-25T04:01:58.689 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2023-08-25T04:01:58.689 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2023-08-25T04:01:58.689 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2023-08-25T04:01:58.689 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2023-08-25T04:01:58.689 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2023-08-25T04:01:58.690 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2023-08-25T04:01:58.690 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.690 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-25T04:01:58.690 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2023-08-25T04:01:58.690 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2023-08-25T04:01:58.690 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.690 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2023-08-25T04:01:58.690 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-25T04:01:58.691 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-25T04:01:58.691 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.691 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2023-08-25T04:01:58.691 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2023-08-25T04:01:58.691 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.691 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2023-08-25T04:01:58.691 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2023-08-25T04:01:58.691 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:01:58.692 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2023-08-25T04:01:58.692 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2023-08-25T04:01:58.692 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2023-08-25T04:01:58.692 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2023-08-25T04:01:58.692 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-25T04:01:58.692 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-25T04:01:58.692 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2023-08-25T04:01:58.692 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2023-08-25T04:01:58.693 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-08-25T04:01:58.693 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2023-08-25T04:01:58.693 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2023-08-25T04:01:58.693 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2023-08-25T04:01:58.693 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2023-08-25T04:01:58.693 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2023-08-25T04:01:58.693 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2023-08-25T04:01:58.694 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2023-08-25T04:01:58.694 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2023-08-25T04:01:58.694 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2023-08-25T04:01:58.694 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2023-08-25T04:01:58.694 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2023-08-25T04:01:58.694 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2023-08-25T04:01:58.694 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2023-08-25T04:01:58.694 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-08-25T04:01:58.695 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2023-08-25T04:01:58.695 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = True 2023-08-25T04:01:58.695 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2023-08-25T04:01:58.695 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = True 2023-08-25T04:01:58.695 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2023-08-25T04:01:58.695 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2023-08-25T04:01:58.695 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2023-08-25T04:01:58.697 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2023-08-25T04:01:58.697 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2023-08-25T04:01:58.697 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-25T04:01:58.697 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2023-08-25T04:01:58.697 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.697 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2023-08-25T04:01:58.698 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.698 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2023-08-25T04:01:58.698 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.698 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2023-08-25T04:01:58.698 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2023-08-25T04:01:58.698 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.698 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2023-08-25T04:01:58.698 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2023-08-25T04:01:58.699 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.699 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-25T04:01:58.699 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2023-08-25T04:01:58.699 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.699 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2023-08-25T04:01:58.699 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-25T04:01:58.699 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.699 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2023-08-25T04:01:58.700 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.700 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2023-08-25T04:01:58.700 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2023-08-25T04:01:58.700 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2023-08-25T04:01:58.700 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2023-08-25T04:01:58.700 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2023-08-25T04:01:58.700 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2023-08-25T04:01:58.701 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2023-08-25T04:01:58.701 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-25T04:01:58.701 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-25T04:01:58.701 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2023-08-25T04:01:58.701 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.701 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-25T04:01:58.701 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.701 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2023-08-25T04:01:58.702 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.702 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2023-08-25T04:01:58.702 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.702 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2023-08-25T04:01:58.702 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2023-08-25T04:01:58.702 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2023-08-25T04:01:58.702 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.55,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2023-08-25T04:01:58.702 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on skipped message = False 2023-08-25T04:01:58.703 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = 2d2a9024-b152-4d40-880c-1686d1810590 2023-08-25T04:01:58.703 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.703 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2023-08-25T04:01:58.703 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2023-08-25T04:01:58.703 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.703 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2023-08-25T04:01:58.703 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2023-08-25T04:01:58.704 INFO:teuthology.orchestra.run.smithi110.stdout: osd mclock profile = high_recovery_ops 2023-08-25T04:01:58.704 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.704 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2023-08-25T04:01:58.704 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2023-08-25T04:01:58.704 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.704 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2023-08-25T04:01:58.704 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2023-08-25T04:01:58.704 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2023-08-25T04:01:58.705 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.705 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2023-08-25T04:01:58.705 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2023-08-25T04:01:58.705 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.705 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2023-08-25T04:01:58.705 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.705 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2023-08-25T04:01:58.705 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.706 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2023-08-25T04:01:58.706 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.706 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2023-08-25T04:01:58.706 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2023-08-25T04:01:58.706 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.706 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2023-08-25T04:01:58.706 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2023-08-25T04:01:58.706 INFO:teuthology.orchestra.run.smithi110.stdout: bdev async discard = True 2023-08-25T04:01:58.707 INFO:teuthology.orchestra.run.smithi110.stdout: bdev enable discard = True 2023-08-25T04:01:58.707 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore allocator = bitmap 2023-08-25T04:01:58.707 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2023-08-25T04:01:58.707 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2023-08-25T04:01:58.707 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 1/20 2023-08-25T04:01:58.707 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 1/20 2023-08-25T04:01:58.707 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2023-08-25T04:01:58.707 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2023-08-25T04:01:58.708 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 4/10 2023-08-25T04:01:58.708 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2023-08-25T04:01:58.708 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2023-08-25T04:01:58.708 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2023-08-25T04:01:58.708 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2023-08-25T04:01:58.708 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2023-08-25T04:01:58.708 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2023-08-25T04:01:58.709 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.709 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2023-08-25T04:01:58.709 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2023-08-25T04:01:58.709 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2023-08-25T04:01:58.709 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2023-08-25T04:01:58.709 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2023-08-25T04:01:58.709 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2023-08-25T04:01:58.709 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2023-08-25T04:01:58.710 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2023-08-25T04:01:58.710 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2023-08-25T04:01:58.710 INFO:teuthology.orchestra.run.smithi110.stdout: debug finisher = 20 2023-08-25T04:01:58.710 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.710 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2023-08-25T04:01:58.710 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2023-08-25T04:01:58.710 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2023-08-25T04:01:58.710 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2023-08-25T04:01:58.711 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2023-08-25T04:01:58.711 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2023-08-25T04:01:58.711 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2023-08-25T04:01:58.711 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2023-08-25T04:01:58.711 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2023-08-25T04:01:58.711 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2023-08-25T04:01:58.711 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2023-08-25T04:01:58.711 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.712 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-25T04:01:58.712 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2023-08-25T04:01:58.712 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2023-08-25T04:01:58.712 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.712 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2023-08-25T04:01:58.712 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-25T04:01:58.712 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-25T04:01:58.712 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.713 INFO:teuthology.orchestra.run.smithi110.stdout: # 1m isn't quite enough 2023-08-25T04:01:58.713 INFO:teuthology.orchestra.run.smithi110.stdout: mon_down_mkfs_grace = 2m 2023-08-25T04:01:58.713 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.713 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_filestore_osds = false 2023-08-25T04:01:58.713 INFO:teuthology.orchestra.run.smithi110.stdout: mon op complaint time = 120 2023-08-25T04:01:58.714 INFO:teuthology.orchestra.run.smithi110.stdout: 2023-08-25T04:01:58.714 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2023-08-25T04:01:58.714 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2023-08-25T04:01:58.714 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2023-08-25T04:01:58.714 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2023-08-25T04:01:58.714 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-25T04:01:58.714 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-25T04:01:58.714 INFO:teuthology.orchestra.run.smithi110.stdout: client mount timeout = 600 2023-08-25T04:01:58.715 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2023-08-25T04:01:58.715 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2023-08-25T04:01:58.715 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = "" 2023-08-25T04:01:58.715 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2023-08-25T04:01:58.715 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2023-08-25T04:01:58.715 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2023-08-25T04:01:58.715 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2023-08-25T04:01:58.715 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2023-08-25T04:01:58.716 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2023-08-25T04:01:58.716 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2023-08-25T04:01:58.716 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2023-08-25T04:01:58.716 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2023-08-25T04:01:58.716 INFO:teuthology.orchestra.run.smithi110.stdout:[mds] 2023-08-25T04:01:58.716 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds = 20 2023-08-25T04:01:58.716 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds balancer = 20 2023-08-25T04:01:58.716 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2023-08-25T04:01:58.717 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug frag = True 2023-08-25T04:01:58.717 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug scatterstat = True 2023-08-25T04:01:58.717 INFO:teuthology.orchestra.run.smithi110.stdout: mds op complaint time = 180 2023-08-25T04:01:58.717 INFO:teuthology.orchestra.run.smithi110.stdout: mds verify scatter = True 2023-08-25T04:01:58.717 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2023-08-25T04:01:58.717 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2023-08-25T04:01:58.717 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2023-08-25T04:01:58.718 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-25T04:01:58.718 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-25T04:01:58.798 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-25T04:01:58.799 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:01:58.799 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-25T04:01:58.809 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:01:58.809 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-25T04:01:58.864 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T04:01:58.865 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:01:58.865 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-25T04:01:58.865 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-25T04:01:58.942 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:01:58.943 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:01:58.993 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2023-08-25T04:01:58.994 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:01:58.994 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-25T04:01:58.995 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-25T04:01:59.030 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:01:59.031 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:01:59.079 INFO:tasks.ceph:Setting up mon nodes... 2023-08-25T04:01:59.079 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-25T04:01:59.080 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-25T04:01:59.139 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-25T04:01:59.144 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-25T04:01:59.202 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-25T04:01:59.222 INFO:tasks.ceph:Setting up mds nodes... 2023-08-25T04:01:59.222 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-25T04:01:59.282 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-25T04:01:59.286 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-25T04:01:59.307 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-25T04:01:59.407 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-25T04:01:59.411 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-25T04:01:59.433 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-25T04:01:59.490 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-25T04:01:59.494 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-25T04:01:59.517 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-08-25T04:01:59.617 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-08-25T04:01:59.622 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-08-25T04:01:59.642 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-25T04:01:59.643 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-25T04:01:59.689 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-25T04:01:59.707 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-08-25T04:01:59.792 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-08-25T04:01:59.810 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-08-25T04:01:59.855 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-08-25T04:01:59.872 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-08-25T04:01:59.958 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-08-25T04:01:59.975 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-25T04:01:59.975 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-25T04:01:59.976 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-25T04:01:59.997 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T04:01:59.997 INFO:tasks.ceph:role: osd.0 2023-08-25T04:01:59.997 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T04:01:59.998 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-25T04:02:00.088 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:02:00.089 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:02:00.089 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:02:00.089 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:02:00.089 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:02:00.089 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:02:00.089 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:02:00.089 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:02:00.090 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:02:00.090 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:02:01.399 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2023-08-25T04:02:01.402 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2023-08-25T04:02:01.403 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-25T04:02:01.440 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-25T04:02:01.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:02:01.500 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: /sbin/restorecon: command not found 2023-08-25T04:02:01.500 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-25T04:02:01.570 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T04:02:01.570 INFO:tasks.ceph:role: osd.1 2023-08-25T04:02:01.570 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T04:02:01.571 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-25T04:02:01.663 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:02:01.663 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:02:01.663 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:02:01.663 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:02:01.663 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:02:01.664 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:02:01.664 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:02:01.664 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:02:01.664 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:02:01.664 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:02:02.958 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2023-08-25T04:02:02.961 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2023-08-25T04:02:02.962 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-25T04:02:02.993 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-25T04:02:03.055 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: /sbin/restorecon: command not found 2023-08-25T04:02:03.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:02:03.058 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-25T04:02:03.125 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T04:02:03.125 INFO:tasks.ceph:role: osd.2 2023-08-25T04:02:03.126 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T04:02:03.126 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-25T04:02:03.218 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:02:03.219 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:02:03.219 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:02:03.219 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:02:03.219 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:02:03.219 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:02:03.220 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:02:03.220 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:02:03.220 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:02:03.220 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:02:04.518 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2023-08-25T04:02:04.522 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2023-08-25T04:02:04.523 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-25T04:02:04.601 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-25T04:02:04.662 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: /sbin/restorecon: command not found 2023-08-25T04:02:04.662 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:02:04.663 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-25T04:02:04.725 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-25T04:02:04.726 INFO:tasks.ceph:role: osd.3 2023-08-25T04:02:04.726 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T04:02:04.727 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-25T04:02:04.818 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:02:04.818 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:02:04.818 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:02:04.819 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:02:04.819 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:02:04.819 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:02:04.819 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:02:04.820 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:02:04.820 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:02:04.820 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:02:06.117 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2023-08-25T04:02:06.120 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2023-08-25T04:02:06.121 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-25T04:02:06.155 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-25T04:02:06.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:02:06.219 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: /sbin/restorecon: command not found 2023-08-25T04:02:06.220 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:02:06.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:06.335+0000 7fd2aea2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-25T04:02:06.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:06.339+0000 7fd2aea2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-25T04:02:06.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:06.339+0000 7fd2aea2b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-25T04:02:06.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:06.339+0000 7fd2aea2b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-25T04:02:06.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:06.339+0000 7fd2aea2b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-25T04:02:06.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:06.339+0000 7fd2aea2b640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-25T04:02:09.361 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-25T04:02:09.384 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:02:09.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:09.487+0000 7f44371bf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-25T04:02:09.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:09.487+0000 7f44371bf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-25T04:02:09.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:09.487+0000 7f44371bf640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-25T04:02:09.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:09.487+0000 7f44371bf640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-25T04:02:09.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:09.487+0000 7f44371bf640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-25T04:02:09.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:09.491+0000 7f44371bf640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-25T04:02:12.567 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-25T04:02:12.589 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:02:12.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:12.687+0000 7f9c9453c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-25T04:02:12.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:12.691+0000 7f9c9453c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-25T04:02:12.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:12.691+0000 7f9c9453c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-25T04:02:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:12.691+0000 7f9c9453c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-25T04:02:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:12.691+0000 7f9c9453c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-25T04:02:12.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:12.691+0000 7f9c9453c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-25T04:02:15.695 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-25T04:02:15.718 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:02:15.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:15.819+0000 7fbe4da2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-25T04:02:15.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:15.819+0000 7fbe4da2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-25T04:02:15.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:15.819+0000 7fbe4da2b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-25T04:02:15.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:15.819+0000 7fbe4da2b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-25T04:02:15.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:15.819+0000 7fbe4da2b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-25T04:02:15.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:15.823+0000 7fbe4da2b640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-08-25T04:02:18.815 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-25T04:02:18.838 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-25T04:02:18.863 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T04:02:18.863 INFO:tasks.ceph:role: osd.4 2023-08-25T04:02:18.863 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2023-08-25T04:02:18.864 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-25T04:02:18.929 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:02:18.929 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:02:18.930 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:02:18.930 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:02:18.930 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:02:18.930 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:02:18.931 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:02:18.932 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:02:18.932 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:02:18.932 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:02:18.954 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2023-08-25T04:02:18.957 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2023-08-25T04:02:18.957 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-25T04:02:19.034 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-25T04:02:19.091 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2023-08-25T04:02:19.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:02:19.093 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-25T04:02:19.159 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T04:02:19.159 INFO:tasks.ceph:role: osd.5 2023-08-25T04:02:19.159 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com 2023-08-25T04:02:19.160 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-25T04:02:19.223 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:02:19.223 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:02:19.223 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:02:19.224 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:02:19.224 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:02:19.224 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:02:19.224 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:02:19.224 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:02:19.224 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:02:19.224 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:02:19.248 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2023-08-25T04:02:19.252 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2023-08-25T04:02:19.253 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-25T04:02:19.322 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-25T04:02:19.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:02:19.384 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2023-08-25T04:02:19.385 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-25T04:02:19.446 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T04:02:19.447 INFO:tasks.ceph:role: osd.6 2023-08-25T04:02:19.448 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com 2023-08-25T04:02:19.448 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-25T04:02:19.510 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:02:19.510 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:02:19.510 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:02:19.510 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:02:19.511 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:02:19.511 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:02:19.511 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:02:19.511 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:02:19.511 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:02:19.511 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:02:19.534 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2023-08-25T04:02:19.537 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2023-08-25T04:02:19.537 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-25T04:02:19.607 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-25T04:02:19.670 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2023-08-25T04:02:19.671 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:02:19.671 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-25T04:02:19.738 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-25T04:02:19.738 INFO:tasks.ceph:role: osd.7 2023-08-25T04:02:19.738 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com 2023-08-25T04:02:19.739 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-25T04:02:19.798 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-25T04:02:19.798 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-25T04:02:19.798 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-25T04:02:19.798 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-25T04:02:19.798 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-25T04:02:19.799 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2023-08-25T04:02:19.799 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-25T04:02:19.799 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-25T04:02:19.799 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-25T04:02:19.799 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-25T04:02:19.823 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2023-08-25T04:02:19.825 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2023-08-25T04:02:19.826 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-25T04:02:19.892 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-25T04:02:19.951 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2023-08-25T04:02:19.952 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:02:19.953 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:02:20.151 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:20.148+0000 7fba23377640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-25T04:02:20.152 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:20.148+0000 7fba23377640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-25T04:02:20.152 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:20.148+0000 7fba23377640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-25T04:02:20.152 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:20.148+0000 7fba23377640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-25T04:02:20.152 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:20.148+0000 7fba23377640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-25T04:02:20.153 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:20.148+0000 7fba23377640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-08-25T04:02:23.126 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-25T04:02:23.147 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:02:23.243 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:23.240+0000 7fc778d19640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-25T04:02:23.244 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:23.240+0000 7fc778d19640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-25T04:02:23.244 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:23.240+0000 7fc778d19640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-25T04:02:23.244 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:23.240+0000 7fc778d19640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-25T04:02:23.244 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:23.240+0000 7fc778d19640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-25T04:02:23.245 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:23.240+0000 7fc778d19640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-08-25T04:02:26.222 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-25T04:02:26.244 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:02:26.346 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:26.340+0000 7fc3e72a2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-25T04:02:26.347 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:26.340+0000 7fc3e72a2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-25T04:02:26.347 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:26.340+0000 7fc3e72a2640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-25T04:02:26.347 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:26.340+0000 7fc3e72a2640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-25T04:02:26.347 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:26.340+0000 7fc3e72a2640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-25T04:02:26.347 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:26.344+0000 7fc3e72a2640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-08-25T04:02:26.743 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:02:26.748 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:02:29.345 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-25T04:02:29.367 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:02:29.465 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:29.460+0000 7f2f77e80640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-25T04:02:29.465 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:29.460+0000 7f2f77e80640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-25T04:02:29.466 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:29.460+0000 7f2f77e80640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-25T04:02:29.466 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:29.460+0000 7f2f77e80640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-25T04:02:29.466 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:29.460+0000 7f2f77e80640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-25T04:02:29.467 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:29.464+0000 7f2f77e80640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-08-25T04:02:32.464 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-25T04:02:32.485 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-25T04:02:32.486 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:02:32.486 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-25T04:02:32.510 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:02:32.510 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-25T04:02:32.578 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:02:32.579 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-25T04:02:32.646 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:02:32.646 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-25T04:02:32.714 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:02:32.715 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-25T04:02:32.782 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:02:32.782 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-25T04:02:32.850 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:02:32.851 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-25T04:02:32.918 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:02:32.919 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-25T04:02:32.945 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:02:32.945 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-25T04:02:33.010 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:02:33.011 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-08-25T04:02:33.078 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:02:33.078 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-25T04:02:33.138 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:02:33.138 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-25T04:02:33.197 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:02:33.198 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-25T04:02:33.258 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:02:33.258 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-25T04:02:33.318 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:02:33.318 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-25T04:02:33.329 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:02:33.329 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-08-25T04:02:33.381 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:02:33.381 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-08-25T04:02:33.390 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:02:33.390 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-08-25T04:02:33.442 INFO:tasks.ceph:Adding keys to all mons... 2023-08-25T04:02:33.443 DEBUG:teuthology.orchestra.run.smithi055:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-25T04:02:33.447 DEBUG:teuthology.orchestra.run.smithi110:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-25T04:02:33.490 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.y] 2023-08-25T04:02:33.490 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hkjr9KCBAApSqjtFhLnjHduMBu/eaaKw== 2023-08-25T04:02:33.491 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2023-08-25T04:02:33.491 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hkgFrTEBAAoan9rk8Q+qPyMjb2vGUHhA== 2023-08-25T04:02:33.491 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2023-08-25T04:02:33.491 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hkLF9CGBAAqxgRU/02SsZfWuZPSYxuZA== 2023-08-25T04:02:33.491 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.0] 2023-08-25T04:02:33.491 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC+J+hkY1tDFBAAVQY5Xl8On9pN3jLWwKWGTA== 2023-08-25T04:02:33.491 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.1] 2023-08-25T04:02:33.492 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDBJ+hkpdBCHRAADyMAxTsnQfkD9G0p48H4zQ== 2023-08-25T04:02:33.492 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.2] 2023-08-25T04:02:33.492 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDEJ+hkOR49KRAAudbqAxLItsoczide8ybzAg== 2023-08-25T04:02:33.492 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.3] 2023-08-25T04:02:33.492 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDHJ+hkxun5MBAAAhGtJYVeL3ogL3TQV67diw== 2023-08-25T04:02:33.492 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.x] 2023-08-25T04:02:33.492 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hkYGUZDBAAiuDo9hqavWq7zQlGd6x4YQ== 2023-08-25T04:02:33.493 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2023-08-25T04:02:33.493 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hk18hNHRAAzXuhzQEONXRzRXTeCH9fKQ== 2023-08-25T04:02:33.493 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2023-08-25T04:02:33.493 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hky6HiJBAAsrXlTDn2cxbk7PnqSgNNkA== 2023-08-25T04:02:33.494 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.4] 2023-08-25T04:02:33.494 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDMJ+hkuosTCRAAqCuwHFZFBVR/7nFtHHByNg== 2023-08-25T04:02:33.494 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.5] 2023-08-25T04:02:33.495 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDPJ+hkJa+SDhAAllo6biVE99BZWvv5K/gXGw== 2023-08-25T04:02:33.495 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.6] 2023-08-25T04:02:33.495 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDSJ+hkUPywFBAA4jua1Eu1nRl2L6hX/mycfw== 2023-08-25T04:02:33.495 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.7] 2023-08-25T04:02:33.495 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDVJ+hkhyDMGxAAmcSWLzJqIE5w5H/E4wIurQ== 2023-08-25T04:02:33.495 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2023-08-25T04:02:33.495 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g== 2023-08-25T04:02:33.496 INFO:teuthology.orchestra.run.smithi055.stdout:[client.2] 2023-08-25T04:02:33.496 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hkjSA4LxAAxzbnHeV85qYZYhSqTOT2rw== 2023-08-25T04:02:33.496 INFO:teuthology.orchestra.run.smithi055.stdout:[client.1] 2023-08-25T04:02:33.496 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hk8KsDMxAAKyK4jMKflYNnJXYIbr2OBQ== 2023-08-25T04:02:33.496 INFO:teuthology.orchestra.run.smithi055.stdout:[client.3] 2023-08-25T04:02:33.496 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hkl9AoORAARYZcPObsM/HT/yrTmneZrw== 2023-08-25T04:02:33.504 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.y] 2023-08-25T04:02:33.504 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQC3J+hkjr9KCBAApSqjtFhLnjHduMBu/eaaKw== 2023-08-25T04:02:33.504 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2023-08-25T04:02:33.504 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQC3J+hkgFrTEBAAoan9rk8Q+qPyMjb2vGUHhA== 2023-08-25T04:02:33.504 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2023-08-25T04:02:33.505 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQC3J+hkLF9CGBAAqxgRU/02SsZfWuZPSYxuZA== 2023-08-25T04:02:33.505 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.0] 2023-08-25T04:02:33.505 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQC+J+hkY1tDFBAAVQY5Xl8On9pN3jLWwKWGTA== 2023-08-25T04:02:33.505 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.1] 2023-08-25T04:02:33.505 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDBJ+hkpdBCHRAADyMAxTsnQfkD9G0p48H4zQ== 2023-08-25T04:02:33.505 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.2] 2023-08-25T04:02:33.505 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDEJ+hkOR49KRAAudbqAxLItsoczide8ybzAg== 2023-08-25T04:02:33.505 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.3] 2023-08-25T04:02:33.506 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDHJ+hkxun5MBAAAhGtJYVeL3ogL3TQV67diw== 2023-08-25T04:02:33.506 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.x] 2023-08-25T04:02:33.506 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQC3J+hkYGUZDBAAiuDo9hqavWq7zQlGd6x4YQ== 2023-08-25T04:02:33.506 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2023-08-25T04:02:33.506 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQC3J+hk18hNHRAAzXuhzQEONXRzRXTeCH9fKQ== 2023-08-25T04:02:33.506 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2023-08-25T04:02:33.506 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQC3J+hky6HiJBAAsrXlTDn2cxbk7PnqSgNNkA== 2023-08-25T04:02:33.506 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.4] 2023-08-25T04:02:33.507 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDMJ+hkuosTCRAAqCuwHFZFBVR/7nFtHHByNg== 2023-08-25T04:02:33.507 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.5] 2023-08-25T04:02:33.507 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDPJ+hkJa+SDhAAllo6biVE99BZWvv5K/gXGw== 2023-08-25T04:02:33.507 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.6] 2023-08-25T04:02:33.507 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDSJ+hkUPywFBAA4jua1Eu1nRl2L6hX/mycfw== 2023-08-25T04:02:33.507 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.7] 2023-08-25T04:02:33.507 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDVJ+hkhyDMGxAAmcSWLzJqIE5w5H/E4wIurQ== 2023-08-25T04:02:33.507 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2023-08-25T04:02:33.508 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g== 2023-08-25T04:02:33.508 INFO:teuthology.orchestra.run.smithi110.stdout:[client.2] 2023-08-25T04:02:33.508 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQC3J+hkjSA4LxAAxzbnHeV85qYZYhSqTOT2rw== 2023-08-25T04:02:33.508 INFO:teuthology.orchestra.run.smithi110.stdout:[client.1] 2023-08-25T04:02:33.508 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQC3J+hk8KsDMxAAKyK4jMKflYNnJXYIbr2OBQ== 2023-08-25T04:02:33.508 INFO:teuthology.orchestra.run.smithi110.stdout:[client.3] 2023-08-25T04:02:33.508 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQC3J+hkl9AoORAARYZcPObsM/HT/yrTmneZrw== 2023-08-25T04:02:33.509 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-25T04:02:33.543 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-25T04:02:33.604 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:02:33.608 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:02:33.667 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:02:33.671 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:02:33.730 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:02:33.733 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:02:33.789 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:02:33.793 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:02:33.848 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:02:33.852 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:02:33.906 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:02:33.910 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:02:33.965 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-25T04:02:33.969 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-25T04:02:34.023 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:02:34.027 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:02:34.084 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:02:34.088 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-25T04:02:34.146 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:02:34.150 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:02:34.205 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:02:34.210 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:02:34.266 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:02:34.269 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:02:34.325 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:02:34.329 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-25T04:02:34.385 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:02:34.390 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:02:34.448 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:02:34.452 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:02:34.511 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:02:34.516 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:02:34.575 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:02:34.579 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-25T04:02:34.638 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-25T04:02:34.639 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-25T04:02:34.661 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-25T04:02:34.781 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-25T04:02:34.803 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-25T04:02:34.824 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-25T04:02:34.939 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-25T04:02:34.960 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-25T04:02:35.022 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-25T04:02:35.135 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-25T04:02:35.157 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:02:35.160 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-25T04:02:35.206 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-25T04:02:35.207 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-25T04:02:35.208 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-25T04:02:35.212 INFO:tasks.ceph.mon.a:Started 2023-08-25T04:02:35.213 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-25T04:02:35.213 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-25T04:02:35.249 INFO:tasks.ceph.mon.b:Started 2023-08-25T04:02:35.249 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-25T04:02:35.250 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-25T04:02:35.253 INFO:tasks.ceph.mon.c:Started 2023-08-25T04:02:35.254 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-25T04:02:35.254 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-25T04:02:35.254 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-25T04:02:35.258 INFO:tasks.ceph.mgr.y:Started 2023-08-25T04:02:35.258 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-25T04:02:35.258 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-25T04:02:35.262 INFO:tasks.ceph.mgr.x:Started 2023-08-25T04:02:35.263 INFO:tasks.ceph:Setting crush tunables to default 2023-08-25T04:02:35.263 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd crush tunables default 2023-08-25T04:02:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.403+0000 7f233ce93640 1 Processor -- start 2023-08-25T04:02:35.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.403+0000 7f233ce93640 1 -- start start 2023-08-25T04:02:35.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.407+0000 7f233ce93640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23380cb020 0x7f23380c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:35.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.407+0000 7f233ce93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23380cdd50 0x7f23380cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:35.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.407+0000 7f233ce93640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23380cbca0 con 0x7f233806c720 2023-08-25T04:02:35.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.407+0000 7f233ce93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23380c9470 con 0x7f23380cdd50 2023-08-25T04:02:35.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.407+0000 7f233ce93640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23380ce1e0 con 0x7f23380cb020 2023-08-25T04:02:35.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.407+0000 7f232dd9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23380cdd50 0x7f23380cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:35.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.407+0000 7f2336d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f233806c720 0x7f233806cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33184/0 (socket says 172.21.15.55:33184) 2023-08-25T04:02:35.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.407+0000 7f2336d9d640 1 -- 172.21.15.55:0/270152331 learned_addr learned my addr 172.21.15.55:0/270152331 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:02:35.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.407+0000 7f232dd9b640 1 -- 172.21.15.55:0/270152331 >> v2:172.21.15.55:3300/0 conn(0x7f23380cdd50 msgr2=0x7f23380cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-25T04:02:35.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.407+0000 7f232dd9b640 1 -- 172.21.15.55:0/270152331 >> v2:172.21.15.55:3300/0 conn(0x7f23380cdd50 msgr2=0x7f23380cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-25T04:02:35.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.407+0000 7f232dd9b640 1 --2- 172.21.15.55:0/270152331 >> v2:172.21.15.55:3300/0 conn(0x7f23380cdd50 0x7f23380cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-25T04:02:35.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.407+0000 7f232dd9b640 1 --2- 172.21.15.55:0/270152331 >> v2:172.21.15.55:3300/0 conn(0x7f23380cdd50 0x7f23380cb400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:02:35.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.407+0000 7f233659c640 1 --2- 172.21.15.55:0/270152331 >> v2:172.21.15.110:3300/0 conn(0x7f23380cb020 0x7f23380c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:35.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.407+0000 7f233659c640 1 -- 172.21.15.55:0/270152331 >> v2:172.21.15.110:3300/0 conn(0x7f23380cb020 msgr2=0x7f23380c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-25T04:02:35.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.407+0000 7f233659c640 1 -- 172.21.15.55:0/270152331 >> v2:172.21.15.110:3300/0 conn(0x7f23380cb020 msgr2=0x7f23380c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-25T04:02:35.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.407+0000 7f233659c640 1 --2- 172.21.15.55:0/270152331 >> v2:172.21.15.110:3300/0 conn(0x7f23380cb020 0x7f23380c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-25T04:02:35.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.407+0000 7f233659c640 1 --2- 172.21.15.55:0/270152331 >> v2:172.21.15.110:3300/0 conn(0x7f23380cb020 0x7f23380c9900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:02:35.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.575+0000 7f2335d9b640 1 -- 172.21.15.55:0/270152331 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627234180 0 0) 0x7f23380cbca0 con 0x7f233806c720 2023-08-25T04:02:35.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.575+0000 7f2335d9b640 1 -- 172.21.15.55:0/270152331 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2324003530 con 0x7f233806c720 2023-08-25T04:02:35.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2335d9b640 1 -- 172.21.15.55:0/270152331 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 919841441 0 0) 0x7f2324003530 con 0x7f233806c720 2023-08-25T04:02:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2335d9b640 1 -- 172.21.15.55:0/270152331 >> v2:172.21.15.110:3300/0 conn(0x7f23380cb020 msgr2=0x7f23380c9900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:02:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2335d9b640 1 --2- 172.21.15.55:0/270152331 >> v2:172.21.15.110:3300/0 conn(0x7f23380cb020 0x7f23380c9900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2335d9b640 1 -- 172.21.15.55:0/270152331 >> v2:172.21.15.55:3300/0 conn(0x7f23380cdd50 msgr2=0x7f23380cb400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:02:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2335d9b640 1 --2- 172.21.15.55:0/270152331 >> v2:172.21.15.55:3300/0 conn(0x7f23380cdd50 0x7f23380cb400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2335d9b640 1 -- 172.21.15.55:0/270152331 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23380c8b40 con 0x7f233806c720 2023-08-25T04:02:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2335d9b640 1 -- 172.21.15.55:0/270152331 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f2330001a00 con 0x7f233806c720 2023-08-25T04:02:35.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2335d9b640 1 -- 172.21.15.55:0/270152331 >> v1:172.21.15.55:6789/0 conn(0x7f233806c720 legacy=0x7f233806cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:35.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2335d9b640 1 --2- 172.21.15.55:0/270152331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2324003980 0x7f2324003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:35.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2335d9b640 1 --2- 172.21.15.55:0/270152331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23240047d0 0x7f2324004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:35.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2335d9b640 1 --2- 172.21.15.55:0/270152331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2324005190 0x7f232400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:35.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2335d9b640 1 -- 172.21.15.55:0/270152331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23380c9470 con 0x7f2324005190 2023-08-25T04:02:35.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2335d9b640 1 -- 172.21.15.55:0/270152331 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23380ce1e0 con 0x7f23240047d0 2023-08-25T04:02:35.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2335d9b640 1 -- 172.21.15.55:0/270152331 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232400e2f0 con 0x7f2324003980 2023-08-25T04:02:35.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2336d9d640 1 --2- 172.21.15.55:0/270152331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2324005190 0x7f232400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:35.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f232dd9b640 1 --2- 172.21.15.55:0/270152331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23240047d0 0x7f2324004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:35.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2336d9d640 1 -- 172.21.15.55:0/270152331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2324003980 msgr2=0x7f2324003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:35.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2336d9d640 1 --2- 172.21.15.55:0/270152331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2324003980 0x7f2324003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:35.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2336d9d640 1 -- 172.21.15.55:0/270152331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23240047d0 msgr2=0x7f2324004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:35.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2336d9d640 1 --2- 172.21.15.55:0/270152331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23240047d0 0x7f2324004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:35.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.579+0000 7f2336d9d640 1 -- 172.21.15.55:0/270152331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23380c8b40 con 0x7f2324005190 2023-08-25T04:02:35.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.583+0000 7f2336d9d640 1 -- 172.21.15.55:0/270152331 reap_dead start 2023-08-25T04:02:35.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.583+0000 7f2336d9d640 1 --2- 172.21.15.55:0/270152331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2324005190 0x7f232400dba0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f233000a970 tx=0x7f233001fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f356d03443a6d86b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:35.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.583+0000 7f2335d9b640 1 -- 172.21.15.55:0/270152331 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23300a97c0 con 0x7f2324005190 2023-08-25T04:02:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.583+0000 7f2335d9b640 1 -- 172.21.15.55:0/270152331 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23300ad070 con 0x7f2324005190 2023-08-25T04:02:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.583+0000 7f2335d9b640 1 -- 172.21.15.55:0/270152331 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23300a9b80 con 0x7f2324005190 2023-08-25T04:02:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.583+0000 7f233ce93640 1 -- 172.21.15.55:0/270152331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2324005190 msgr2=0x7f232400dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.583+0000 7f233ce93640 1 --2- 172.21.15.55:0/270152331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2324005190 0x7f232400dba0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f233000a970 tx=0x7f233001fba0 comp rx=0 tx=0).stop 2023-08-25T04:02:35.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.583+0000 7f233ce93640 1 -- 172.21.15.55:0/270152331 shutdown_connections 2023-08-25T04:02:35.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.583+0000 7f233ce93640 1 --2- 172.21.15.55:0/270152331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2324005190 0x7f232400dba0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:35.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.583+0000 7f233ce93640 1 -- 172.21.15.55:0/270152331 >> 172.21.15.55:0/270152331 conn(0x7f2338069900 msgr2=0x7f2338069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:35.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.583+0000 7f233ce93640 1 -- 172.21.15.55:0/270152331 shutdown_connections 2023-08-25T04:02:35.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.583+0000 7f233ce93640 1 -- 172.21.15.55:0/270152331 wait complete. 2023-08-25T04:02:35.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f233ce93640 1 Processor -- start 2023-08-25T04:02:35.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f233ce93640 1 -- start start 2023-08-25T04:02:35.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f233ce93640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2324005190 0x7f233815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:35.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f233ce93640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23380c6420 0x7f23380c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:35.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f233ce93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23380c7b00 0x7f23380c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:35.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f233ce93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23380c8640 con 0x7f23380c7b00 2023-08-25T04:02:35.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f233ce93640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23380c5940 con 0x7f23380c6420 2023-08-25T04:02:35.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f233ce93640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23380c5c20 con 0x7f2324005190 2023-08-25T04:02:35.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f233659c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2324005190 0x7f233815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:35.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f232dd9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23380c6420 0x7f23380c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:35.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f233659c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2324005190 0x7f233815baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:51892/0 (socket says 172.21.15.55:51892) 2023-08-25T04:02:35.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f233659c640 1 -- 172.21.15.55:0/1756119808 learned_addr learned my addr 172.21.15.55:0/1756119808 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:35.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f2336d9d640 1 --2- 172.21.15.55:0/1756119808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23380c7b00 0x7f23380c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:35.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f233659c640 1 -- 172.21.15.55:0/1756119808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23380c6420 msgr2=0x7f23380c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:35.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f233659c640 1 --2- 172.21.15.55:0/1756119808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23380c6420 0x7f23380c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:35.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f233659c640 1 -- 172.21.15.55:0/1756119808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23380c7b00 msgr2=0x7f23380c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:35.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f233659c640 1 --2- 172.21.15.55:0/1756119808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23380c7b00 0x7f23380c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:35.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f233659c640 1 -- 172.21.15.55:0/1756119808 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23380c5f00 con 0x7f2324005190 2023-08-25T04:02:35.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.587+0000 7f232dd9b640 1 --2- 172.21.15.55:0/1756119808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23380c6420 0x7f23380c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:02:35.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.591+0000 7f233659c640 1 --2- 172.21.15.55:0/1756119808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2324005190 0x7f233815baa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f232800d5a0 tx=0x7f232800da60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:35.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.591+0000 7f232f7fe640 1 -- 172.21.15.55:0/1756119808 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328014620 con 0x7f2324005190 2023-08-25T04:02:35.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.591+0000 7f232f7fe640 1 -- 172.21.15.55:0/1756119808 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23280147a0 con 0x7f2324005190 2023-08-25T04:02:35.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.591+0000 7f232f7fe640 1 -- 172.21.15.55:0/1756119808 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328014b90 con 0x7f2324005190 2023-08-25T04:02:35.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.591+0000 7f233ce93640 1 -- 172.21.15.55:0/1756119808 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23380c5640 con 0x7f2324005190 2023-08-25T04:02:35.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.591+0000 7f233ce93640 1 -- 172.21.15.55:0/1756119808 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233815bfe0 con 0x7f2324005190 2023-08-25T04:02:35.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.591+0000 7f232f7fe640 1 -- 172.21.15.55:0/1756119808 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f232801d400 con 0x7f2324005190 2023-08-25T04:02:35.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.591+0000 7f232f7fe640 1 -- 172.21.15.55:0/1756119808 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2328012600 con 0x7f2324005190 2023-08-25T04:02:35.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.591+0000 7f233ce93640 1 -- 172.21.15.55:0/1756119808 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2338073ec0 con 0x7f2324005190 2023-08-25T04:02:35.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.603+0000 7f232f7fe640 1 -- 172.21.15.55:0/1756119808 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f232803cb00 con 0x7f2324005190 2023-08-25T04:02:35.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.667+0000 7f233ce93640 1 -- 172.21.15.55:0/1756119808 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f23380c90d0 con 0x7f2324005190 2023-08-25T04:02:35.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.671+0000 7f232f7fe640 1 -- 172.21.15.55:0/1756119808 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f232802b020 con 0x7f2324005190 2023-08-25T04:02:35.675 INFO:teuthology.orchestra.run.smithi055.stderr:adjusted tunables profile to default 2023-08-25T04:02:35.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.675+0000 7f233ce93640 1 -- 172.21.15.55:0/1756119808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2324005190 msgr2=0x7f233815baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:35.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.675+0000 7f233ce93640 1 --2- 172.21.15.55:0/1756119808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2324005190 0x7f233815baa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f232800d5a0 tx=0x7f232800da60 comp rx=0 tx=0).stop 2023-08-25T04:02:35.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.675+0000 7f233ce93640 1 -- 172.21.15.55:0/1756119808 shutdown_connections 2023-08-25T04:02:35.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.675+0000 7f233ce93640 1 --2- 172.21.15.55:0/1756119808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23380c7b00 0x7f23380c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:35.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.675+0000 7f233ce93640 1 --2- 172.21.15.55:0/1756119808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23380c6420 0x7f23380c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:35.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.675+0000 7f233ce93640 1 --2- 172.21.15.55:0/1756119808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2324005190 0x7f233815baa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:35.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.675+0000 7f233ce93640 1 -- 172.21.15.55:0/1756119808 >> 172.21.15.55:0/1756119808 conn(0x7f2338069900 msgr2=0x7f23380abdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:35.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.675+0000 7f233ce93640 1 -- 172.21.15.55:0/1756119808 shutdown_connections 2023-08-25T04:02:35.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:35.675+0000 7f233ce93640 1 -- 172.21.15.55:0/1756119808 wait complete. 2023-08-25T04:02:35.696 INFO:tasks.ceph:check_enable_crimson: False 2023-08-25T04:02:35.696 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-25T04:02:35.697 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:02:35.698 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-25T04:02:35.724 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:02:35.725 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-25T04:02:35.783 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:35.779+0000 7f5be8446180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:02:35.788 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:35.784+0000 7f8aaddff180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:02:35.789 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:02:35.789 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-25T04:02:35.853 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:02:35.853 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-25T04:02:35.916 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:02:35.917 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-25T04:02:35.938 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:02:35.938 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-25T04:02:35.999 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:02:35.999 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-25T04:02:36.068 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:02:36.068 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-25T04:02:36.137 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new bcc0f659-64ac-44ee-b885-fa842e94819d 0 2023-08-25T04:02:36.326 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.316+0000 7f56146f9640 1 Processor -- start 2023-08-25T04:02:36.326 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.316+0000 7f56146f9640 1 -- start start 2023-08-25T04:02:36.326 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.316+0000 7f56146f9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f560c1601f0 0x7f560c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:36.326 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.316+0000 7f56146f9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560c0cd5a0 con 0x7f560c15e3c0 2023-08-25T04:02:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.316+0000 7f56146f9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560c0cd880 con 0x7f560c0d1290 2023-08-25T04:02:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.316+0000 7f56146f9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560c0cdb60 con 0x7f560c1601f0 2023-08-25T04:02:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.316+0000 7f5612495640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f560c1601f0 0x7f560c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.316+0000 7f5612c96640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f560c0d1290 0x7f560c15e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:45546/0 (socket says 172.21.15.110:45546) 2023-08-25T04:02:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.316+0000 7f5612c96640 1 -- 172.21.15.110:0/168172240 learned_addr learned my addr 172.21.15.110:0/168172240 (peer_addr_for_me v1:172.21.15.110:0/0) 2023-08-25T04:02:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.316+0000 7f5612495640 1 -- 172.21.15.110:0/168172240 >> v1:172.21.15.110:6789/0 conn(0x7f560c0d1290 legacy=0x7f560c15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:36.327 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.316+0000 7f5612495640 1 -- 172.21.15.110:0/168172240 >> v1:172.21.15.55:6789/0 conn(0x7f560c15e3c0 legacy=0x7f560c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:36.328 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.316+0000 7f5612495640 1 -- 172.21.15.110:0/168172240 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c0cde40 con 0x7f560c1601f0 2023-08-25T04:02:36.328 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.316+0000 7f5611493640 1 -- 172.21.15.110:0/168172240 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413646170 0 0) 0x7f560c0cd880 con 0x7f560c0d1290 2023-08-25T04:02:36.328 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.320+0000 7f5612495640 1 --2- 172.21.15.110:0/168172240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f560c1601f0 0x7f560c15d430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f56080097a0 tx=0x7f560801c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fc267f1e963a6a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:36.328 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.320+0000 7f5611493640 1 -- 172.21.15.110:0/168172240 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608004230 con 0x7f560c1601f0 2023-08-25T04:02:36.328 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.320+0000 7f5611493640 1 -- 172.21.15.110:0/168172240 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56080a7050 con 0x7f560c1601f0 2023-08-25T04:02:36.328 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.320+0000 7f5611493640 1 -- 172.21.15.110:0/168172240 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608003620 con 0x7f560c1601f0 2023-08-25T04:02:36.328 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.320+0000 7f56146f9640 1 -- 172.21.15.110:0/168172240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f560c1601f0 msgr2=0x7f560c15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:36.329 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.320+0000 7f56146f9640 1 --2- 172.21.15.110:0/168172240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f560c1601f0 0x7f560c15d430 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f56080097a0 tx=0x7f560801c430 comp rx=0 tx=0).stop 2023-08-25T04:02:36.329 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.320+0000 7f56146f9640 1 -- 172.21.15.110:0/168172240 shutdown_connections 2023-08-25T04:02:36.329 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.320+0000 7f56146f9640 1 --2- 172.21.15.110:0/168172240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f560c1601f0 0x7f560c15d430 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.329 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.320+0000 7f56146f9640 1 -- 172.21.15.110:0/168172240 >> 172.21.15.110:0/168172240 conn(0x7f560c0d27d0 msgr2=0x7f560c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:36.329 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.320+0000 7f56146f9640 1 -- 172.21.15.110:0/168172240 shutdown_connections 2023-08-25T04:02:36.329 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.320+0000 7f56146f9640 1 -- 172.21.15.110:0/168172240 wait complete. 2023-08-25T04:02:36.331 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f56146f9640 1 Processor -- start 2023-08-25T04:02:36.332 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f56146f9640 1 -- start start 2023-08-25T04:02:36.332 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f56146f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f560c0d1290 0x7f560c14bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:36.332 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f56146f9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f560c15e3c0 0x7f560c152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:36.332 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f56146f9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f560c1601f0 0x7f560c1527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:36.332 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f56146f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0c7fc0 con 0x7f560c0d1290 2023-08-25T04:02:36.333 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f56146f9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c14c5d0 con 0x7f560c1601f0 2023-08-25T04:02:36.333 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f56146f9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0c8210 con 0x7f560c15e3c0 2023-08-25T04:02:36.333 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f5612c96640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f560c1601f0 0x7f560c1527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:36.333 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f5611c94640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f560c15e3c0 0x7f560c152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:36.333 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f5612c96640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f560c1601f0 0x7f560c1527d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53348/0 (socket says 172.21.15.110:53348) 2023-08-25T04:02:36.333 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f5612c96640 1 -- 172.21.15.110:0/3259048851 learned_addr learned my addr 172.21.15.110:0/3259048851 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-08-25T04:02:36.333 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f5612495640 1 --2- 172.21.15.110:0/3259048851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f560c0d1290 0x7f560c14bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:36.334 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f5612c96640 1 -- 172.21.15.110:0/3259048851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f560c15e3c0 msgr2=0x7f560c152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:36.334 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f5612c96640 1 --2- 172.21.15.110:0/3259048851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f560c15e3c0 0x7f560c152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.334 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f5612c96640 1 -- 172.21.15.110:0/3259048851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f560c0d1290 msgr2=0x7f560c14bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:36.334 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f5612c96640 1 --2- 172.21.15.110:0/3259048851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f560c0d1290 0x7f560c14bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.334 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f5612c96640 1 -- 172.21.15.110:0/3259048851 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56080093b0 con 0x7f560c1601f0 2023-08-25T04:02:36.334 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f5611c94640 1 --2- 172.21.15.110:0/3259048851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f560c15e3c0 0x7f560c152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:02:36.334 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f5612c96640 1 --2- 172.21.15.110:0/3259048851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f560c1601f0 0x7f560c1527d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f560400c780 tx=0x7f560400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:36.335 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f5602ffd640 1 -- 172.21.15.110:0/3259048851 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560400ce90 con 0x7f560c1601f0 2023-08-25T04:02:36.335 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f5602ffd640 1 -- 172.21.15.110:0/3259048851 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560400a640 con 0x7f560c1601f0 2023-08-25T04:02:36.335 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f5602ffd640 1 -- 172.21.15.110:0/3259048851 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560400a9d0 con 0x7f560c1601f0 2023-08-25T04:02:36.335 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f56146f9640 1 -- 172.21.15.110:0/3259048851 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560c0c84f0 con 0x7f560c1601f0 2023-08-25T04:02:36.335 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f56146f9640 1 -- 172.21.15.110:0/3259048851 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560c14c2c0 con 0x7f560c1601f0 2023-08-25T04:02:36.335 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f5602ffd640 1 -- 172.21.15.110:0/3259048851 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f56040070d0 con 0x7f560c1601f0 2023-08-25T04:02:36.335 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f5602ffd640 1 -- 172.21.15.110:0/3259048851 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5604012400 con 0x7f560c1601f0 2023-08-25T04:02:36.336 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.324+0000 7f56146f9640 1 -- 172.21.15.110:0/3259048851 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560c0b5260 con 0x7f560c1601f0 2023-08-25T04:02:36.336 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.328+0000 7f5602ffd640 1 -- 172.21.15.110:0/3259048851 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f5604018070 con 0x7f560c1601f0 2023-08-25T04:02:36.349 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:36.344+0000 7f8aaddff180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:02:36.350 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:36.347+0000 7f5be8446180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:02:36.399 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.396+0000 7f56146f9640 1 -- 172.21.15.110:0/3259048851 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bcc0f659-64ac-44ee-b885-fa842e94819d", "id": 0} v 0) v1 -- 0x7f560c073ec0 con 0x7f560c1601f0 2023-08-25T04:02:36.407 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.404+0000 7f5602ffd640 1 -- 172.21.15.110:0/3259048851 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bcc0f659-64ac-44ee-b885-fa842e94819d", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5604007690 con 0x7f560c1601f0 2023-08-25T04:02:36.408 INFO:teuthology.orchestra.run.smithi110.stdout:0 2023-08-25T04:02:36.409 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.404+0000 7f56146f9640 1 -- 172.21.15.110:0/3259048851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f560c1601f0 msgr2=0x7f560c1527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:36.409 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.404+0000 7f56146f9640 1 --2- 172.21.15.110:0/3259048851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f560c1601f0 0x7f560c1527d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f560400c780 tx=0x7f560400cc40 comp rx=0 tx=0).stop 2023-08-25T04:02:36.409 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.404+0000 7f56146f9640 1 -- 172.21.15.110:0/3259048851 shutdown_connections 2023-08-25T04:02:36.409 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.404+0000 7f56146f9640 1 --2- 172.21.15.110:0/3259048851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f560c1601f0 0x7f560c1527d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.409 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.404+0000 7f56146f9640 1 --2- 172.21.15.110:0/3259048851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f560c15e3c0 0x7f560c152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.409 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.404+0000 7f56146f9640 1 --2- 172.21.15.110:0/3259048851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f560c0d1290 0x7f560c14bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.410 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.404+0000 7f56146f9640 1 -- 172.21.15.110:0/3259048851 >> 172.21.15.110:0/3259048851 conn(0x7f560c0d27d0 msgr2=0x7f560c06bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:36.410 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.404+0000 7f56146f9640 1 -- 172.21.15.110:0/3259048851 shutdown_connections 2023-08-25T04:02:36.410 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.404+0000 7f56146f9640 1 -- 172.21.15.110:0/3259048851 wait complete. 2023-08-25T04:02:36.427 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 6c684da9-6f70-4db5-8367-4e023636bd8b 1 2023-08-25T04:02:36.547 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:36.544+0000 7f8aaddff180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:02:36.562 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:36.559+0000 7f5be8446180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:02:36.565 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.560+0000 7f17572ec640 1 Processor -- start 2023-08-25T04:02:36.565 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.560+0000 7f17572ec640 1 -- start start 2023-08-25T04:02:36.567 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.560+0000 7f17572ec640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f17501601f0 0x7f175015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:36.567 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.560+0000 7f17572ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17500d1290 0x7f175015e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:36.567 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.560+0000 7f17572ec640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17500cd5a0 con 0x7f175015e3c0 2023-08-25T04:02:36.567 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.564+0000 7f17572ec640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17500cd880 con 0x7f17501601f0 2023-08-25T04:02:36.567 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.564+0000 7f17572ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17500cdb60 con 0x7f17500d1290 2023-08-25T04:02:36.568 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.564+0000 7f1754887640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f175015e3c0 0x7f17500d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:45560/0 (socket says 172.21.15.110:45560) 2023-08-25T04:02:36.568 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.564+0000 7f1754887640 1 -- 172.21.15.110:0/3891127285 learned_addr learned my addr 172.21.15.110:0/3891127285 (peer_addr_for_me v1:172.21.15.110:0/0) 2023-08-25T04:02:36.568 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.564+0000 7f1755088640 1 --2- 172.21.15.110:0/3891127285 >> v2:172.21.15.55:3300/0 conn(0x7f17501601f0 0x7f175015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:36.568 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.564+0000 7f1755889640 1 --2- 172.21.15.110:0/3891127285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17500d1290 0x7f175015e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:36.569 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.564+0000 7f1747fff640 1 -- 172.21.15.110:0/3891127285 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671956163 0 0) 0x7f17500cd5a0 con 0x7f175015e3c0 2023-08-25T04:02:36.569 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.564+0000 7f1755088640 1 -- 172.21.15.110:0/3891127285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17500d1290 msgr2=0x7f175015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:36.569 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.564+0000 7f1755088640 1 --2- 172.21.15.110:0/3891127285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17500d1290 0x7f175015e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.569 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.564+0000 7f1755088640 1 -- 172.21.15.110:0/3891127285 >> v1:172.21.15.110:6789/0 conn(0x7f175015e3c0 legacy=0x7f17500d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:36.570 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.564+0000 7f1755088640 1 -- 172.21.15.110:0/3891127285 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17500cde40 con 0x7f17501601f0 2023-08-25T04:02:36.570 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.564+0000 7f1755889640 1 --2- 172.21.15.110:0/3891127285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17500d1290 0x7f175015e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:02:36.570 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.564+0000 7f1755088640 1 --2- 172.21.15.110:0/3891127285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17501601f0 0x7f175015d430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f174c0097a0 tx=0x7f174c01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572cb7c314f74762 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:36.570 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.564+0000 7f1747fff640 1 -- 172.21.15.110:0/3891127285 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c0a8950 con 0x7f17501601f0 2023-08-25T04:02:36.571 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.568+0000 7f1747fff640 1 -- 172.21.15.110:0/3891127285 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c0a8ab0 con 0x7f17501601f0 2023-08-25T04:02:36.571 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.568+0000 7f1747fff640 1 -- 172.21.15.110:0/3891127285 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c0a8e40 con 0x7f17501601f0 2023-08-25T04:02:36.572 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.568+0000 7f17572ec640 1 -- 172.21.15.110:0/3891127285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17501601f0 msgr2=0x7f175015d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:36.572 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.568+0000 7f17572ec640 1 --2- 172.21.15.110:0/3891127285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17501601f0 0x7f175015d430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f174c0097a0 tx=0x7f174c01ec50 comp rx=0 tx=0).stop 2023-08-25T04:02:36.572 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.568+0000 7f17572ec640 1 -- 172.21.15.110:0/3891127285 shutdown_connections 2023-08-25T04:02:36.572 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.568+0000 7f17572ec640 1 --2- 172.21.15.110:0/3891127285 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17500d1290 0x7f175015e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.572 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.568+0000 7f17572ec640 1 --2- 172.21.15.110:0/3891127285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17501601f0 0x7f175015d430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.573 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.568+0000 7f17572ec640 1 -- 172.21.15.110:0/3891127285 >> 172.21.15.110:0/3891127285 conn(0x7f17500d27d0 msgr2=0x7f17500d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:36.573 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.568+0000 7f17572ec640 1 -- 172.21.15.110:0/3891127285 shutdown_connections 2023-08-25T04:02:36.573 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.568+0000 7f17572ec640 1 -- 172.21.15.110:0/3891127285 wait complete. 2023-08-25T04:02:36.573 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.568+0000 7f17572ec640 1 Processor -- start 2023-08-25T04:02:36.574 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.568+0000 7f17572ec640 1 -- start start 2023-08-25T04:02:36.575 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.568+0000 7f17572ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17500d1290 0x7f17501f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:36.575 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.568+0000 7f17572ec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f175015e3c0 0x7f175006b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:36.575 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.568+0000 7f17572ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17501601f0 0x7f175006bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:36.576 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.568+0000 7f17572ec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175015b320 con 0x7f17500d1290 2023-08-25T04:02:36.576 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.572+0000 7f17572ec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17500cb330 con 0x7f175015e3c0 2023-08-25T04:02:36.576 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.572+0000 7f17572ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17500c8f40 con 0x7f17501601f0 2023-08-25T04:02:36.576 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.572+0000 7f1755088640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17500d1290 0x7f17501f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:36.576 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.572+0000 7f1755088640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17500d1290 0x7f17501f19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.110:51030/0 (socket says 172.21.15.110:51030) 2023-08-25T04:02:36.577 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.572+0000 7f1755088640 1 -- 172.21.15.110:0/3902076619 learned_addr learned my addr 172.21.15.110:0/3902076619 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-08-25T04:02:36.577 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.572+0000 7f1755889640 1 --2- 172.21.15.110:0/3902076619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17501601f0 0x7f175006bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:36.577 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.572+0000 7f1754887640 1 --2- 172.21.15.110:0/3902076619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f175015e3c0 0x7f175006b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:36.578 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.572+0000 7f1755088640 1 -- 172.21.15.110:0/3902076619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17501601f0 msgr2=0x7f175006bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:36.578 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.572+0000 7f1755088640 1 --2- 172.21.15.110:0/3902076619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17501601f0 0x7f175006bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.578 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.572+0000 7f1755088640 1 -- 172.21.15.110:0/3902076619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f175015e3c0 msgr2=0x7f175006b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:36.578 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.572+0000 7f1755088640 1 --2- 172.21.15.110:0/3902076619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f175015e3c0 0x7f175006b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.579 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.572+0000 7f1755088640 1 -- 172.21.15.110:0/3902076619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1748009a70 con 0x7f17500d1290 2023-08-25T04:02:36.579 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.572+0000 7f1755088640 1 --2- 172.21.15.110:0/3902076619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17500d1290 0x7f17501f19c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f174c0b3040 tx=0x7f174c01b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:36.580 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.572+0000 7f1745ffb640 1 -- 172.21.15.110:0/3902076619 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c0b0dd0 con 0x7f17500d1290 2023-08-25T04:02:36.580 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.572+0000 7f17572ec640 1 -- 172.21.15.110:0/3902076619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174c0093b0 con 0x7f17500d1290 2023-08-25T04:02:36.580 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.576+0000 7f17572ec640 1 -- 172.21.15.110:0/3902076619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17500cace0 con 0x7f17500d1290 2023-08-25T04:02:36.580 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.576+0000 7f1745ffb640 1 -- 172.21.15.110:0/3902076619 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c006dc0 con 0x7f17500d1290 2023-08-25T04:02:36.580 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.576+0000 7f1745ffb640 1 -- 172.21.15.110:0/3902076619 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c0c3660 con 0x7f17500d1290 2023-08-25T04:02:36.581 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.576+0000 7f1745ffb640 1 -- 172.21.15.110:0/3902076619 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f174c0b7040 con 0x7f17500d1290 2023-08-25T04:02:36.581 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.576+0000 7f1745ffb640 1 -- 172.21.15.110:0/3902076619 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f174c0b9a10 con 0x7f17500d1290 2023-08-25T04:02:36.581 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.576+0000 7f17572ec640 1 -- 172.21.15.110:0/3902076619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1730005260 con 0x7f17500d1290 2023-08-25T04:02:36.592 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.588+0000 7f1745ffb640 1 -- 172.21.15.110:0/3902076619 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f174c0b5070 con 0x7f17500d1290 2023-08-25T04:02:36.657 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.652+0000 7f17572ec640 1 -- 172.21.15.110:0/3902076619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6c684da9-6f70-4db5-8367-4e023636bd8b", "id": 1} v 0) v1 -- 0x7f17300055b0 con 0x7f17500d1290 2023-08-25T04:02:36.662 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.656+0000 7f1745ffb640 1 -- 172.21.15.110:0/3902076619 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6c684da9-6f70-4db5-8367-4e023636bd8b", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f174c0b9bd0 con 0x7f17500d1290 2023-08-25T04:02:36.662 INFO:teuthology.orchestra.run.smithi110.stdout:1 2023-08-25T04:02:36.663 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.660+0000 7f17572ec640 1 -- 172.21.15.110:0/3902076619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17500d1290 msgr2=0x7f17501f19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:36.663 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.660+0000 7f17572ec640 1 --2- 172.21.15.110:0/3902076619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17500d1290 0x7f17501f19c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f174c0b3040 tx=0x7f174c01b9f0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.664 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.660+0000 7f17572ec640 1 -- 172.21.15.110:0/3902076619 shutdown_connections 2023-08-25T04:02:36.664 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.660+0000 7f17572ec640 1 --2- 172.21.15.110:0/3902076619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17501601f0 0x7f175006bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.664 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.660+0000 7f17572ec640 1 --2- 172.21.15.110:0/3902076619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f175015e3c0 0x7f175006b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.664 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.660+0000 7f17572ec640 1 --2- 172.21.15.110:0/3902076619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17500d1290 0x7f17501f19c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.664 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.660+0000 7f17572ec640 1 -- 172.21.15.110:0/3902076619 >> 172.21.15.110:0/3902076619 conn(0x7f17500d27d0 msgr2=0x7f175015dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:36.664 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.660+0000 7f17572ec640 1 -- 172.21.15.110:0/3902076619 shutdown_connections 2023-08-25T04:02:36.665 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.660+0000 7f17572ec640 1 -- 172.21.15.110:0/3902076619 wait complete. 2023-08-25T04:02:36.681 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new b76dbb66-f3d4-4b34-bb99-c917bc154f30 2 2023-08-25T04:02:36.816 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.812+0000 7fa48bfe1640 1 Processor -- start 2023-08-25T04:02:36.816 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.812+0000 7fa48bfe1640 1 -- start start 2023-08-25T04:02:36.817 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.812+0000 7fa48bfe1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa4840d14c0 0x7fa4840ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:36.817 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.812+0000 7fa48bfe1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4840cd3e0 con 0x7fa48415cb40 2023-08-25T04:02:36.817 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.812+0000 7fa48bfe1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4840cd680 con 0x7fa4840d32f0 2023-08-25T04:02:36.817 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.812+0000 7fa48bfe1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4840d0c40 con 0x7fa4840d14c0 2023-08-25T04:02:36.818 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.812+0000 7fa48a57e640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa4840d32f0 0x7fa4840b1c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:45576/0 (socket says 172.21.15.110:45576) 2023-08-25T04:02:36.818 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.812+0000 7fa48a57e640 1 -- 172.21.15.110:0/2182952037 learned_addr learned my addr 172.21.15.110:0/2182952037 (peer_addr_for_me v1:172.21.15.110:0/0) 2023-08-25T04:02:36.819 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.812+0000 7fa48957c640 1 --2- 172.21.15.110:0/2182952037 >> v2:172.21.15.55:3300/0 conn(0x7fa4840d14c0 0x7fa4840ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:36.819 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.812+0000 7fa488d7b640 1 -- 172.21.15.110:0/2182952037 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572475631 0 0) 0x7fa4840cd680 con 0x7fa4840d32f0 2023-08-25T04:02:36.819 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.812+0000 7fa488d7b640 1 -- 172.21.15.110:0/2182952037 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa470003530 con 0x7fa4840d32f0 2023-08-25T04:02:36.819 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.812+0000 7fa488d7b640 1 -- 172.21.15.110:0/2182952037 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046024654 0 0) 0x7fa4840cd3e0 con 0x7fa48415cb40 2023-08-25T04:02:36.819 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.812+0000 7fa488d7b640 1 -- 172.21.15.110:0/2182952037 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4840cd680 con 0x7fa48415cb40 2023-08-25T04:02:36.820 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.812+0000 7fa48957c640 1 -- 172.21.15.110:0/2182952037 >> v1:172.21.15.110:6789/0 conn(0x7fa4840d32f0 legacy=0x7fa4840b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:36.820 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.812+0000 7fa48957c640 1 -- 172.21.15.110:0/2182952037 >> v1:172.21.15.55:6789/0 conn(0x7fa48415cb40 legacy=0x7fa4840d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:36.820 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.812+0000 7fa48957c640 1 -- 172.21.15.110:0/2182952037 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4840cd960 con 0x7fa4840d14c0 2023-08-25T04:02:36.820 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.816+0000 7fa48957c640 1 --2- 172.21.15.110:0/2182952037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4840d14c0 0x7fa4840ce440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa4740097c0 tx=0x7fa4840b2bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1876aeb34db4b522 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:36.821 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.816+0000 7fa488d7b640 1 -- 172.21.15.110:0/2182952037 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4740ab600 con 0x7fa4840d14c0 2023-08-25T04:02:36.821 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.816+0000 7fa488d7b640 1 -- 172.21.15.110:0/2182952037 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4740a7050 con 0x7fa4840d14c0 2023-08-25T04:02:36.821 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.816+0000 7fa488d7b640 1 -- 172.21.15.110:0/2182952037 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4740ab980 con 0x7fa4840d14c0 2023-08-25T04:02:36.822 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.816+0000 7fa48bfe1640 1 -- 172.21.15.110:0/2182952037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4840d14c0 msgr2=0x7fa4840ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:36.822 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.816+0000 7fa48bfe1640 1 --2- 172.21.15.110:0/2182952037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4840d14c0 0x7fa4840ce440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa4740097c0 tx=0x7fa4840b2bb0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.822 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.816+0000 7fa48bfe1640 1 -- 172.21.15.110:0/2182952037 shutdown_connections 2023-08-25T04:02:36.823 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.816+0000 7fa48bfe1640 1 --2- 172.21.15.110:0/2182952037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4840d14c0 0x7fa4840ce440 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.823 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.816+0000 7fa48bfe1640 1 -- 172.21.15.110:0/2182952037 >> 172.21.15.110:0/2182952037 conn(0x7fa4840d27d0 msgr2=0x7fa4840d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:36.823 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.816+0000 7fa48bfe1640 1 -- 172.21.15.110:0/2182952037 shutdown_connections 2023-08-25T04:02:36.823 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.816+0000 7fa48bfe1640 1 -- 172.21.15.110:0/2182952037 wait complete. 2023-08-25T04:02:36.824 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa48bfe1640 1 Processor -- start 2023-08-25T04:02:36.824 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa48bfe1640 1 -- start start 2023-08-25T04:02:36.825 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa48bfe1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4840d14c0 0x7fa48415f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:36.825 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa48bfe1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4840d32f0 0x7fa48415e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:36.825 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa48bfe1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa48415cb40 0x7fa48414e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:36.825 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa48bfe1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48415e5d0 con 0x7fa4840d32f0 2023-08-25T04:02:36.825 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa48bfe1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48414e570 con 0x7fa48415cb40 2023-08-25T04:02:36.825 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa48bfe1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48415ff60 con 0x7fa4840d14c0 2023-08-25T04:02:36.826 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa48a57e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa48415cb40 0x7fa48414e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:36.827 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa489d7d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4840d14c0 0x7fa48415f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:36.827 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa48a57e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa48415cb40 0x7fa48414e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53364/0 (socket says 172.21.15.110:53364) 2023-08-25T04:02:36.827 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa48a57e640 1 -- 172.21.15.110:0/2022995212 learned_addr learned my addr 172.21.15.110:0/2022995212 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-08-25T04:02:36.827 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa48957c640 1 --2- 172.21.15.110:0/2022995212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4840d32f0 0x7fa48415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:36.828 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa489d7d640 1 -- 172.21.15.110:0/2022995212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa48415cb40 msgr2=0x7fa48414e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:36.828 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa489d7d640 1 --2- 172.21.15.110:0/2022995212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa48415cb40 0x7fa48414e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.828 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa489d7d640 1 -- 172.21.15.110:0/2022995212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4840d32f0 msgr2=0x7fa48415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:36.828 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa489d7d640 1 --2- 172.21.15.110:0/2022995212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4840d32f0 0x7fa48415e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.828 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa489d7d640 1 -- 172.21.15.110:0/2022995212 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa474009420 con 0x7fa4840d14c0 2023-08-25T04:02:36.828 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa489d7d640 1 --2- 172.21.15.110:0/2022995212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4840d14c0 0x7fa48415f980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa48000c3c0 tx=0x7fa480001ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:36.828 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa47a7fc640 1 -- 172.21.15.110:0/2022995212 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4800052d0 con 0x7fa4840d14c0 2023-08-25T04:02:36.829 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa47a7fc640 1 -- 172.21.15.110:0/2022995212 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa480005430 con 0x7fa4840d14c0 2023-08-25T04:02:36.829 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa47a7fc640 1 -- 172.21.15.110:0/2022995212 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa480003890 con 0x7fa4840d14c0 2023-08-25T04:02:36.829 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa48bfe1640 1 -- 172.21.15.110:0/2022995212 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48415dc30 con 0x7fa4840d14c0 2023-08-25T04:02:36.829 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa48bfe1640 1 -- 172.21.15.110:0/2022995212 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48415e1f0 con 0x7fa4840d14c0 2023-08-25T04:02:36.829 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa47a7fc640 1 -- 172.21.15.110:0/2022995212 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa480003cf0 con 0x7fa4840d14c0 2023-08-25T04:02:36.829 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.820+0000 7fa47a7fc640 1 -- 172.21.15.110:0/2022995212 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fa4800119b0 con 0x7fa4840d14c0 2023-08-25T04:02:36.830 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.824+0000 7fa48bfe1640 1 -- 172.21.15.110:0/2022995212 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48415e840 con 0x7fa4840d14c0 2023-08-25T04:02:36.830 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.824+0000 7fa47a7fc640 1 -- 172.21.15.110:0/2022995212 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa480017070 con 0x7fa4840d14c0 2023-08-25T04:02:36.895 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.892+0000 7fa48bfe1640 1 -- 172.21.15.110:0/2022995212 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b76dbb66-f3d4-4b34-bb99-c917bc154f30", "id": 2} v 0) v1 -- 0x7fa484073ec0 con 0x7fa4840d14c0 2023-08-25T04:02:36.901 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.896+0000 7fa47a7fc640 1 -- 172.21.15.110:0/2022995212 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b76dbb66-f3d4-4b34-bb99-c917bc154f30", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa480011590 con 0x7fa4840d14c0 2023-08-25T04:02:36.901 INFO:teuthology.orchestra.run.smithi110.stdout:2 2023-08-25T04:02:36.902 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.896+0000 7fa48bfe1640 1 -- 172.21.15.110:0/2022995212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4840d14c0 msgr2=0x7fa48415f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:36.902 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.896+0000 7fa48bfe1640 1 --2- 172.21.15.110:0/2022995212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4840d14c0 0x7fa48415f980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa48000c3c0 tx=0x7fa480001ed0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.902 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.896+0000 7fa48bfe1640 1 -- 172.21.15.110:0/2022995212 shutdown_connections 2023-08-25T04:02:36.902 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.896+0000 7fa48bfe1640 1 --2- 172.21.15.110:0/2022995212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa48415cb40 0x7fa48414e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.903 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.896+0000 7fa48bfe1640 1 --2- 172.21.15.110:0/2022995212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4840d32f0 0x7fa48415e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.903 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.896+0000 7fa48bfe1640 1 --2- 172.21.15.110:0/2022995212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4840d14c0 0x7fa48415f980 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:36.903 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.896+0000 7fa48bfe1640 1 -- 172.21.15.110:0/2022995212 >> 172.21.15.110:0/2022995212 conn(0x7fa4840d27d0 msgr2=0x7fa4840d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:36.903 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.896+0000 7fa48bfe1640 1 -- 172.21.15.110:0/2022995212 shutdown_connections 2023-08-25T04:02:36.903 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:36.896+0000 7fa48bfe1640 1 -- 172.21.15.110:0/2022995212 wait complete. 2023-08-25T04:02:36.921 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 5ba7d683-f07a-4e97-b299-4ba11d9a1140 3 2023-08-25T04:02:37.056 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.052+0000 7f2d11288640 1 Processor -- start 2023-08-25T04:02:37.057 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.052+0000 7f2d11288640 1 -- start start 2023-08-25T04:02:37.058 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.052+0000 7f2d11288640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d0c1601f0 0x7f2d0c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.058 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.052+0000 7f2d11288640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2d0c0d1290 0x7f2d0c15e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.058 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.052+0000 7f2d11288640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0c0cd5a0 con 0x7f2d0c15e3c0 2023-08-25T04:02:37.058 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.052+0000 7f2d11288640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0c0cd880 con 0x7f2d0c0d1290 2023-08-25T04:02:37.058 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.052+0000 7f2d11288640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c0cdb60 con 0x7f2d0c1601f0 2023-08-25T04:02:37.059 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.052+0000 7f2d0affd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d0c1601f0 0x7f2d0c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.059 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.052+0000 7f2d0affd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d0c1601f0 0x7f2d0c15d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:45538/0 (socket says 172.21.15.110:45538) 2023-08-25T04:02:37.059 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.052+0000 7f2d0affd640 1 -- 172.21.15.110:0/1318138343 learned_addr learned my addr 172.21.15.110:0/1318138343 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-08-25T04:02:37.059 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.052+0000 7f2d0b7fe640 1 --2- 172.21.15.110:0/1318138343 >> v2:172.21.15.110:3300/0 conn(0x7f2d0c0d1290 0x7f2d0c15e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.060 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.052+0000 7f2d0affd640 1 -- 172.21.15.110:0/1318138343 >> v2:172.21.15.110:3300/0 conn(0x7f2d0c0d1290 msgr2=0x7f2d0c15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:37.060 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.052+0000 7f2d0affd640 1 --2- 172.21.15.110:0/1318138343 >> v2:172.21.15.110:3300/0 conn(0x7f2d0c0d1290 0x7f2d0c15e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.060 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.052+0000 7f2d0affd640 1 -- 172.21.15.110:0/1318138343 >> v1:172.21.15.110:6789/0 conn(0x7f2d0c15e3c0 legacy=0x7f2d0c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:37.060 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.052+0000 7f2d0affd640 1 -- 172.21.15.110:0/1318138343 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c0cde40 con 0x7f2d0c1601f0 2023-08-25T04:02:37.062 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.056+0000 7f2d0affd640 1 --2- 172.21.15.110:0/1318138343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d0c1601f0 0x7f2d0c15d430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc006fd0 tx=0x7f2cfc01ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=982b950bc9e0a11a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:37.062 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.056+0000 7f2d0a7fc640 1 -- 172.21.15.110:0/1318138343 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0a8990 con 0x7f2d0c1601f0 2023-08-25T04:02:37.062 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.056+0000 7f2d0a7fc640 1 -- 172.21.15.110:0/1318138343 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc0a8af0 con 0x7f2d0c1601f0 2023-08-25T04:02:37.062 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.056+0000 7f2d0a7fc640 1 -- 172.21.15.110:0/1318138343 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0a8e80 con 0x7f2d0c1601f0 2023-08-25T04:02:37.063 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.056+0000 7f2d11288640 1 -- 172.21.15.110:0/1318138343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d0c1601f0 msgr2=0x7f2d0c15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.063 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.056+0000 7f2d11288640 1 --2- 172.21.15.110:0/1318138343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d0c1601f0 0x7f2d0c15d430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc006fd0 tx=0x7f2cfc01ecd0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.064 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d11288640 1 -- 172.21.15.110:0/1318138343 shutdown_connections 2023-08-25T04:02:37.064 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d11288640 1 --2- 172.21.15.110:0/1318138343 >> v2:172.21.15.110:3300/0 conn(0x7f2d0c0d1290 0x7f2d0c15e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.064 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d11288640 1 --2- 172.21.15.110:0/1318138343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d0c1601f0 0x7f2d0c15d430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.064 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d11288640 1 -- 172.21.15.110:0/1318138343 >> 172.21.15.110:0/1318138343 conn(0x7f2d0c0d27d0 msgr2=0x7f2d0c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:37.064 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d11288640 1 -- 172.21.15.110:0/1318138343 shutdown_connections 2023-08-25T04:02:37.064 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d11288640 1 -- 172.21.15.110:0/1318138343 wait complete. 2023-08-25T04:02:37.065 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d11288640 1 Processor -- start 2023-08-25T04:02:37.066 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d11288640 1 -- start start 2023-08-25T04:02:37.066 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d11288640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d0c0d1290 0x7f2d0c0ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.066 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d11288640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d0c15e3c0 0x7f2d0c1f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.066 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d11288640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d0c1601f0 0x7f2d0c0cf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.066 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d11288640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c1f6780 con 0x7f2d0c15e3c0 2023-08-25T04:02:37.066 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d11288640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c09d090 con 0x7f2d0c0d1290 2023-08-25T04:02:37.067 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d11288640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c09d370 con 0x7f2d0c1601f0 2023-08-25T04:02:37.067 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d0affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d0c0d1290 0x7f2d0c0ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.067 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d0b7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d0c1601f0 0x7f2d0c0cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.067 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d0affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d0c0d1290 0x7f2d0c0ca820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53376/0 (socket says 172.21.15.110:53376) 2023-08-25T04:02:37.067 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d0affd640 1 -- 172.21.15.110:0/104117908 learned_addr learned my addr 172.21.15.110:0/104117908 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-08-25T04:02:37.067 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d03fff640 1 --2- 172.21.15.110:0/104117908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d0c15e3c0 0x7f2d0c1f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.069 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d0b7fe640 1 -- 172.21.15.110:0/104117908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d0c0d1290 msgr2=0x7f2d0c0ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.069 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d0b7fe640 1 --2- 172.21.15.110:0/104117908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d0c0d1290 0x7f2d0c0ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.069 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d0b7fe640 1 -- 172.21.15.110:0/104117908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d0c15e3c0 msgr2=0x7f2d0c1f6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.069 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d0b7fe640 1 --2- 172.21.15.110:0/104117908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d0c15e3c0 0x7f2d0c1f6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.070 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d0b7fe640 1 -- 172.21.15.110:0/104117908 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc009480 con 0x7f2d0c1601f0 2023-08-25T04:02:37.070 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d0affd640 1 --2- 172.21.15.110:0/104117908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d0c0d1290 0x7f2d0c0ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:02:37.070 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d03fff640 1 --2- 172.21.15.110:0/104117908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d0c15e3c0 0x7f2d0c1f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:02:37.070 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.060+0000 7f2d0b7fe640 1 --2- 172.21.15.110:0/104117908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d0c1601f0 0x7f2d0c0cf440 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2d04007d90 tx=0x7f2d0400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:37.070 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.064+0000 7f2d037fe640 1 -- 172.21.15.110:0/104117908 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04018070 con 0x7f2d0c1601f0 2023-08-25T04:02:37.071 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.064+0000 7f2d037fe640 1 -- 172.21.15.110:0/104117908 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0400edd0 con 0x7f2d0c1601f0 2023-08-25T04:02:37.071 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.064+0000 7f2d037fe640 1 -- 172.21.15.110:0/104117908 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04003bc0 con 0x7f2d0c1601f0 2023-08-25T04:02:37.071 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.064+0000 7f2d11288640 1 -- 172.21.15.110:0/104117908 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0c0ce7c0 con 0x7f2d0c1601f0 2023-08-25T04:02:37.071 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.064+0000 7f2d11288640 1 -- 172.21.15.110:0/104117908 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0c09ed80 con 0x7f2d0c1601f0 2023-08-25T04:02:37.071 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.064+0000 7f2d037fe640 1 -- 172.21.15.110:0/104117908 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2d04014720 con 0x7f2d0c1601f0 2023-08-25T04:02:37.071 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.064+0000 7f2d037fe640 1 -- 172.21.15.110:0/104117908 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f2d0401d410 con 0x7f2d0c1601f0 2023-08-25T04:02:37.071 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.064+0000 7f2d11288640 1 -- 172.21.15.110:0/104117908 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0c0b5260 con 0x7f2d0c1601f0 2023-08-25T04:02:37.072 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.064+0000 7f2d037fe640 1 -- 172.21.15.110:0/104117908 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2d040149d0 con 0x7f2d0c1601f0 2023-08-25T04:02:37.136 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.132+0000 7f2d11288640 1 -- 172.21.15.110:0/104117908 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5ba7d683-f07a-4e97-b299-4ba11d9a1140", "id": 3} v 0) v1 -- 0x7f2d0c09e900 con 0x7f2d0c1601f0 2023-08-25T04:02:37.144 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.140+0000 7f2d037fe640 1 -- 172.21.15.110:0/104117908 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5ba7d683-f07a-4e97-b299-4ba11d9a1140", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2d0c09e900 con 0x7f2d0c1601f0 2023-08-25T04:02:37.145 INFO:teuthology.orchestra.run.smithi110.stdout:3 2023-08-25T04:02:37.145 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.140+0000 7f2d11288640 1 -- 172.21.15.110:0/104117908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d0c1601f0 msgr2=0x7f2d0c0cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.146 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.140+0000 7f2d11288640 1 --2- 172.21.15.110:0/104117908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d0c1601f0 0x7f2d0c0cf440 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2d04007d90 tx=0x7f2d0400e4b0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.146 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.140+0000 7f2d11288640 1 -- 172.21.15.110:0/104117908 shutdown_connections 2023-08-25T04:02:37.146 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.140+0000 7f2d11288640 1 --2- 172.21.15.110:0/104117908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d0c1601f0 0x7f2d0c0cf440 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.146 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.140+0000 7f2d11288640 1 --2- 172.21.15.110:0/104117908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d0c15e3c0 0x7f2d0c1f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.146 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.140+0000 7f2d11288640 1 --2- 172.21.15.110:0/104117908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d0c0d1290 0x7f2d0c0ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.146 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.140+0000 7f2d11288640 1 -- 172.21.15.110:0/104117908 >> 172.21.15.110:0/104117908 conn(0x7f2d0c0d27d0 msgr2=0x7f2d0c06be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:37.147 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.140+0000 7f2d11288640 1 -- 172.21.15.110:0/104117908 shutdown_connections 2023-08-25T04:02:37.147 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.140+0000 7f2d11288640 1 -- 172.21.15.110:0/104117908 wait complete. 2023-08-25T04:02:37.164 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc 4 2023-08-25T04:02:37.216 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:37.212+0000 7f8aaddff180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:02:37.241 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:37.239+0000 7f5be8446180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:02:37.280 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:37.276+0000 7f8aaddff180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:02:37.300 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.296+0000 7f36f05e9640 1 Processor -- start 2023-08-25T04:02:37.301 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.296+0000 7f36f05e9640 1 -- start start 2023-08-25T04:02:37.302 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.296+0000 7f36f05e9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36e81601f0 0x7f36e815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.302 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.296+0000 7f36f05e9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f36e80d1290 0x7f36e815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.303 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.296+0000 7f36f05e9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e80cd5a0 con 0x7f36e815e3c0 2023-08-25T04:02:37.303 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.296+0000 7f36f05e9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e80cd880 con 0x7f36e80d1290 2023-08-25T04:02:37.303 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.296+0000 7f36f05e9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e80cdb60 con 0x7f36e81601f0 2023-08-25T04:02:37.303 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.296+0000 7f36ee385640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36e81601f0 0x7f36e815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.304 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.296+0000 7f36ee385640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36e81601f0 0x7f36e815d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:45560/0 (socket says 172.21.15.110:45560) 2023-08-25T04:02:37.304 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.296+0000 7f36ee385640 1 -- 172.21.15.110:0/2528488057 learned_addr learned my addr 172.21.15.110:0/2528488057 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-08-25T04:02:37.304 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.296+0000 7f36eeb86640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f36e80d1290 0x7f36e815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.305 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.300+0000 7f36ee385640 1 -- 172.21.15.110:0/2528488057 >> v2:172.21.15.110:3300/0 conn(0x7f36e80d1290 msgr2=0x7f36e815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:37.305 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.300+0000 7f36ee385640 1 --2- 172.21.15.110:0/2528488057 >> v2:172.21.15.110:3300/0 conn(0x7f36e80d1290 0x7f36e815e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.305 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.300+0000 7f36ee385640 1 -- 172.21.15.110:0/2528488057 >> v1:172.21.15.55:6789/0 conn(0x7f36e815e3c0 legacy=0x7f36e80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.306 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.300+0000 7f36ee385640 1 -- 172.21.15.110:0/2528488057 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e80cde40 con 0x7f36e81601f0 2023-08-25T04:02:37.307 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.300+0000 7f36ee385640 1 --2- 172.21.15.110:0/2528488057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36e81601f0 0x7f36e815d430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f36e4006fd0 tx=0x7f36e401ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75d6bb9e7216186f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:37.308 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.300+0000 7f36ed383640 1 -- 172.21.15.110:0/2528488057 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e40a8a10 con 0x7f36e81601f0 2023-08-25T04:02:37.308 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.300+0000 7f36ed383640 1 -- 172.21.15.110:0/2528488057 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e40a8b70 con 0x7f36e81601f0 2023-08-25T04:02:37.308 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.300+0000 7f36ed383640 1 -- 172.21.15.110:0/2528488057 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e40b0440 con 0x7f36e81601f0 2023-08-25T04:02:37.309 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.300+0000 7f36f05e9640 1 -- 172.21.15.110:0/2528488057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36e81601f0 msgr2=0x7f36e815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.309 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.300+0000 7f36f05e9640 1 --2- 172.21.15.110:0/2528488057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36e81601f0 0x7f36e815d430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f36e4006fd0 tx=0x7f36e401ed10 comp rx=0 tx=0).stop 2023-08-25T04:02:37.309 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36f05e9640 1 -- 172.21.15.110:0/2528488057 shutdown_connections 2023-08-25T04:02:37.310 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36f05e9640 1 --2- 172.21.15.110:0/2528488057 >> v2:172.21.15.110:3300/0 conn(0x7f36e80d1290 0x7f36e815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.310 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36f05e9640 1 --2- 172.21.15.110:0/2528488057 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36e81601f0 0x7f36e815d430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.310 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36f05e9640 1 -- 172.21.15.110:0/2528488057 >> 172.21.15.110:0/2528488057 conn(0x7f36e80d27d0 msgr2=0x7f36e80d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:37.310 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36f05e9640 1 -- 172.21.15.110:0/2528488057 shutdown_connections 2023-08-25T04:02:37.311 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36f05e9640 1 -- 172.21.15.110:0/2528488057 wait complete. 2023-08-25T04:02:37.314 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36f05e9640 1 Processor -- start 2023-08-25T04:02:37.314 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36f05e9640 1 -- start start 2023-08-25T04:02:37.314 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36f05e9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36e80d1290 0x7f36e8159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.315 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36f05e9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36e815e3c0 0x7f36e8156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.315 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36f05e9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36e81601f0 0x7f36e8144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.315 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36f05e9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e8143ff0 con 0x7f36e81601f0 2023-08-25T04:02:37.315 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36f05e9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e8159980 con 0x7f36e815e3c0 2023-08-25T04:02:37.315 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36f05e9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e8143390 con 0x7f36e80d1290 2023-08-25T04:02:37.316 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36ee385640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36e80d1290 0x7f36e8159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.316 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36ee385640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36e80d1290 0x7f36e8159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:45568/0 (socket says 172.21.15.110:45568) 2023-08-25T04:02:37.316 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36ee385640 1 -- 172.21.15.110:0/997651965 learned_addr learned my addr 172.21.15.110:0/997651965 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-08-25T04:02:37.316 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36edb84640 1 --2- 172.21.15.110:0/997651965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36e815e3c0 0x7f36e8156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.316 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36eeb86640 1 --2- 172.21.15.110:0/997651965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36e81601f0 0x7f36e8144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.316 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36ee385640 1 -- 172.21.15.110:0/997651965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36e815e3c0 msgr2=0x7f36e8156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.316 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36ee385640 1 --2- 172.21.15.110:0/997651965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36e815e3c0 0x7f36e8156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.317 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36ee385640 1 -- 172.21.15.110:0/997651965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36e81601f0 msgr2=0x7f36e8144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.317 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36ee385640 1 --2- 172.21.15.110:0/997651965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36e81601f0 0x7f36e8144410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.317 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36ee385640 1 -- 172.21.15.110:0/997651965 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e4009480 con 0x7f36e80d1290 2023-08-25T04:02:37.317 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.304+0000 7f36ee385640 1 --2- 172.21.15.110:0/997651965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36e80d1290 0x7f36e8159440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f36e401c940 tx=0x7f36e401bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:37.317 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.308+0000 7f36deffd640 1 -- 172.21.15.110:0/997651965 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4005ba0 con 0x7f36e80d1290 2023-08-25T04:02:37.317 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.308+0000 7f36deffd640 1 -- 172.21.15.110:0/997651965 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e4005d00 con 0x7f36e80d1290 2023-08-25T04:02:37.317 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.308+0000 7f36f05e9640 1 -- 172.21.15.110:0/997651965 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e80ce7c0 con 0x7f36e80d1290 2023-08-25T04:02:37.318 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.308+0000 7f36deffd640 1 -- 172.21.15.110:0/997651965 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4003820 con 0x7f36e80d1290 2023-08-25T04:02:37.318 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.308+0000 7f36f05e9640 1 -- 172.21.15.110:0/997651965 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e8143930 con 0x7f36e80d1290 2023-08-25T04:02:37.318 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.308+0000 7f36deffd640 1 -- 172.21.15.110:0/997651965 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f36e40b7070 con 0x7f36e80d1290 2023-08-25T04:02:37.318 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.308+0000 7f36deffd640 1 -- 172.21.15.110:0/997651965 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f36e4003c80 con 0x7f36e80d1290 2023-08-25T04:02:37.318 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.308+0000 7f36f05e9640 1 -- 172.21.15.110:0/997651965 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e80b5260 con 0x7f36e80d1290 2023-08-25T04:02:37.318 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.308+0000 7f36deffd640 1 -- 172.21.15.110:0/997651965 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f36e40be070 con 0x7f36e80d1290 2023-08-25T04:02:37.331 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:37.327+0000 7f5be8446180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:02:37.353 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:37.348+0000 7f8aaddff180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:02:37.389 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.384+0000 7f36f05e9640 1 -- 172.21.15.110:0/997651965 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc", "id": 4} v 0) v1 -- 0x7f36e8144260 con 0x7f36e80d1290 2023-08-25T04:02:37.397 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:37.391+0000 7f5be8446180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:02:37.397 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.392+0000 7f36deffd640 1 -- 172.21.15.110:0/997651965 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f36e40b5070 con 0x7f36e80d1290 2023-08-25T04:02:37.397 INFO:teuthology.orchestra.run.smithi110.stdout:4 2023-08-25T04:02:37.398 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.392+0000 7f36f05e9640 1 -- 172.21.15.110:0/997651965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36e80d1290 msgr2=0x7f36e8159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.398 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.392+0000 7f36f05e9640 1 --2- 172.21.15.110:0/997651965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36e80d1290 0x7f36e8159440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f36e401c940 tx=0x7f36e401bab0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.392+0000 7f36f05e9640 1 -- 172.21.15.110:0/997651965 shutdown_connections 2023-08-25T04:02:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.392+0000 7f36f05e9640 1 --2- 172.21.15.110:0/997651965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36e81601f0 0x7f36e8144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.392+0000 7f36f05e9640 1 --2- 172.21.15.110:0/997651965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36e815e3c0 0x7f36e8156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.392+0000 7f36f05e9640 1 --2- 172.21.15.110:0/997651965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36e80d1290 0x7f36e8159440 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.392+0000 7f36f05e9640 1 -- 172.21.15.110:0/997651965 >> 172.21.15.110:0/997651965 conn(0x7f36e80d27d0 msgr2=0x7f36e80d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.392+0000 7f36f05e9640 1 -- 172.21.15.110:0/997651965 shutdown_connections 2023-08-25T04:02:37.399 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.392+0000 7f36f05e9640 1 -- 172.21.15.110:0/997651965 wait complete. 2023-08-25T04:02:37.417 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new d6f227fc-9a06-414b-84bd-97df8850ebae 5 2023-08-25T04:02:37.445 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:37.440+0000 7f8aaddff180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:02:37.489 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:37.487+0000 7f5be8446180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:02:37.507 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:37.504+0000 7f8aaddff180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:02:37.552 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:37.551+0000 7f5be8446180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:02:37.553 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.548+0000 7f472b8ec640 1 Processor -- start 2023-08-25T04:02:37.554 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.548+0000 7f472b8ec640 1 -- start start 2023-08-25T04:02:37.555 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.552+0000 7f472b8ec640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f472415e3c0 0x7f472415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.556 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.552+0000 7f472b8ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47240d1290 0x7f472415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.556 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.552+0000 7f472b8ec640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47240cd5a0 con 0x7f47241601f0 2023-08-25T04:02:37.556 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.552+0000 7f472b8ec640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47240cd880 con 0x7f472415e3c0 2023-08-25T04:02:37.556 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.552+0000 7f472b8ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47240cdb60 con 0x7f47240d1290 2023-08-25T04:02:37.557 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.552+0000 7f4729e89640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47240d1290 0x7f472415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.557 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.552+0000 7f4728e87640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f472415e3c0 0x7f472415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.557 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.552+0000 7f4729e89640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47240d1290 0x7f472415e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:45574/0 (socket says 172.21.15.110:45574) 2023-08-25T04:02:37.557 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.552+0000 7f4729688640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f47241601f0 0x7f47240d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.110:53460/0 (socket says 172.21.15.110:53460) 2023-08-25T04:02:37.558 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.552+0000 7f4729e89640 1 -- 172.21.15.110:0/2280281110 learned_addr learned my addr 172.21.15.110:0/2280281110 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-08-25T04:02:37.558 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.552+0000 7f4729e89640 1 -- 172.21.15.110:0/2280281110 >> v2:172.21.15.110:3300/0 conn(0x7f472415e3c0 msgr2=0x7f472415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:37.558 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.552+0000 7f4729e89640 1 --2- 172.21.15.110:0/2280281110 >> v2:172.21.15.110:3300/0 conn(0x7f472415e3c0 0x7f472415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.558 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.552+0000 7f4729e89640 1 -- 172.21.15.110:0/2280281110 >> v1:172.21.15.55:6789/0 conn(0x7f47241601f0 legacy=0x7f47240d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.558 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.552+0000 7f4729e89640 1 -- 172.21.15.110:0/2280281110 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47240cde40 con 0x7f47240d1290 2023-08-25T04:02:37.558 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.552+0000 7f471bfff640 1 -- 172.21.15.110:0/2280281110 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813877789 0 0) 0x7f47240cd5a0 con 0x7f47241601f0 2023-08-25T04:02:37.559 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.556+0000 7f4729e89640 1 --2- 172.21.15.110:0/2280281110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47240d1290 0x7f472415e8a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f471c009e50 tx=0x7f471c01f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a435d39702fb87d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:37.559 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.556+0000 7f471bfff640 1 -- 172.21.15.110:0/2280281110 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c0af400 con 0x7f47240d1290 2023-08-25T04:02:37.559 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.556+0000 7f471bfff640 1 -- 172.21.15.110:0/2280281110 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c0ab050 con 0x7f47240d1290 2023-08-25T04:02:37.560 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.556+0000 7f471bfff640 1 -- 172.21.15.110:0/2280281110 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c0af780 con 0x7f47240d1290 2023-08-25T04:02:37.560 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.556+0000 7f472b8ec640 1 -- 172.21.15.110:0/2280281110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47240d1290 msgr2=0x7f472415e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.560 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.556+0000 7f472b8ec640 1 --2- 172.21.15.110:0/2280281110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47240d1290 0x7f472415e8a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f471c009e50 tx=0x7f471c01f1f0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.561 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.556+0000 7f472b8ec640 1 -- 172.21.15.110:0/2280281110 shutdown_connections 2023-08-25T04:02:37.561 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.556+0000 7f472b8ec640 1 --2- 172.21.15.110:0/2280281110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47240d1290 0x7f472415e8a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.561 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.556+0000 7f472b8ec640 1 --2- 172.21.15.110:0/2280281110 >> v2:172.21.15.110:3300/0 conn(0x7f472415e3c0 0x7f472415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.561 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.556+0000 7f472b8ec640 1 -- 172.21.15.110:0/2280281110 >> 172.21.15.110:0/2280281110 conn(0x7f47240d27d0 msgr2=0x7f47240d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:37.561 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.556+0000 7f472b8ec640 1 -- 172.21.15.110:0/2280281110 shutdown_connections 2023-08-25T04:02:37.561 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.556+0000 7f472b8ec640 1 -- 172.21.15.110:0/2280281110 wait complete. 2023-08-25T04:02:37.563 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f472b8ec640 1 Processor -- start 2023-08-25T04:02:37.563 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f472b8ec640 1 -- start start 2023-08-25T04:02:37.565 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f472b8ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47240d1290 0x7f47241f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.565 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f472b8ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f472415e3c0 0x7f47241587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.565 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f472b8ec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47241601f0 0x7f472414a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.565 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f472b8ec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47240c7360 con 0x7f472415e3c0 2023-08-25T04:02:37.565 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f472b8ec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472414b590 con 0x7f47241601f0 2023-08-25T04:02:37.566 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f472b8ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472415b1d0 con 0x7f47240d1290 2023-08-25T04:02:37.566 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f4729688640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47240d1290 0x7f47241f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.566 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f4729688640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47240d1290 0x7f47241f1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:45582/0 (socket says 172.21.15.110:45582) 2023-08-25T04:02:37.566 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f4729688640 1 -- 172.21.15.110:0/559945164 learned_addr learned my addr 172.21.15.110:0/559945164 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-08-25T04:02:37.566 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f4729e89640 1 --2- 172.21.15.110:0/559945164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47241601f0 0x7f472414a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.566 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f4728e87640 1 --2- 172.21.15.110:0/559945164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f472415e3c0 0x7f47241587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.567 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f4729688640 1 -- 172.21.15.110:0/559945164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47241601f0 msgr2=0x7f472414a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.568 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f4729688640 1 --2- 172.21.15.110:0/559945164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47241601f0 0x7f472414a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.568 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f4729688640 1 -- 172.21.15.110:0/559945164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f472415e3c0 msgr2=0x7f47241587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.568 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f4729688640 1 --2- 172.21.15.110:0/559945164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f472415e3c0 0x7f47241587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.568 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f4729688640 1 -- 172.21.15.110:0/559945164 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c009b30 con 0x7f47240d1290 2023-08-25T04:02:37.568 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f4729e89640 1 --2- 172.21.15.110:0/559945164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47241601f0 0x7f472414a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:02:37.568 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f4729688640 1 --2- 172.21.15.110:0/559945164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47240d1290 0x7f47241f1b60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f472000c430 tx=0x7f472000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:37.568 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f4719ffb640 1 -- 172.21.15.110:0/559945164 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47200074e0 con 0x7f47240d1290 2023-08-25T04:02:37.569 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f4719ffb640 1 -- 172.21.15.110:0/559945164 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4720007640 con 0x7f47240d1290 2023-08-25T04:02:37.569 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f472b8ec640 1 -- 172.21.15.110:0/559945164 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472415b4b0 con 0x7f47240d1290 2023-08-25T04:02:37.569 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f4719ffb640 1 -- 172.21.15.110:0/559945164 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720004a40 con 0x7f47240d1290 2023-08-25T04:02:37.569 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f4719ffb640 1 -- 172.21.15.110:0/559945164 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f47200133c0 con 0x7f47240d1290 2023-08-25T04:02:37.569 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f472b8ec640 1 -- 172.21.15.110:0/559945164 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472415ba70 con 0x7f47240d1290 2023-08-25T04:02:37.569 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.560+0000 7f4719ffb640 1 -- 172.21.15.110:0/559945164 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f4720013c50 con 0x7f47240d1290 2023-08-25T04:02:37.569 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.564+0000 7f472b8ec640 1 -- 172.21.15.110:0/559945164 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47240b5260 con 0x7f47240d1290 2023-08-25T04:02:37.570 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.564+0000 7f4719ffb640 1 -- 172.21.15.110:0/559945164 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4720013e10 con 0x7f47240d1290 2023-08-25T04:02:37.602 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:37.600+0000 7f8aaddff180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:02:37.636 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.632+0000 7f472b8ec640 1 -- 172.21.15.110:0/559945164 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d6f227fc-9a06-414b-84bd-97df8850ebae", "id": 5} v 0) v1 -- 0x7f47240c7530 con 0x7f47240d1290 2023-08-25T04:02:37.641 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.636+0000 7f4719ffb640 1 -- 172.21.15.110:0/559945164 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6f227fc-9a06-414b-84bd-97df8850ebae", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f47240c7530 con 0x7f47240d1290 2023-08-25T04:02:37.641 INFO:teuthology.orchestra.run.smithi110.stdout:5 2023-08-25T04:02:37.642 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.636+0000 7f472b8ec640 1 -- 172.21.15.110:0/559945164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47240d1290 msgr2=0x7f47241f1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.642 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.636+0000 7f472b8ec640 1 --2- 172.21.15.110:0/559945164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47240d1290 0x7f47241f1b60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f472000c430 tx=0x7f472000c8f0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.642 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.636+0000 7f472b8ec640 1 -- 172.21.15.110:0/559945164 shutdown_connections 2023-08-25T04:02:37.643 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.636+0000 7f472b8ec640 1 --2- 172.21.15.110:0/559945164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47241601f0 0x7f472414a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.643 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.636+0000 7f472b8ec640 1 --2- 172.21.15.110:0/559945164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f472415e3c0 0x7f47241587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.643 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.636+0000 7f472b8ec640 1 --2- 172.21.15.110:0/559945164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47240d1290 0x7f47241f1b60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.643 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.636+0000 7f472b8ec640 1 -- 172.21.15.110:0/559945164 >> 172.21.15.110:0/559945164 conn(0x7f47240d27d0 msgr2=0x7f472406aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:37.643 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.636+0000 7f472b8ec640 1 -- 172.21.15.110:0/559945164 shutdown_connections 2023-08-25T04:02:37.643 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.636+0000 7f472b8ec640 1 -- 172.21.15.110:0/559945164 wait complete. 2023-08-25T04:02:37.647 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:37.643+0000 7f5be8446180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:02:37.661 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 67454445-1277-4135-8362-fc13874c1c55 6 2023-08-25T04:02:37.665 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:37.660+0000 7f8aaddff180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:02:37.710 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:37.707+0000 7f5be8446180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:02:37.800 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.796+0000 7f271e85c640 1 Processor -- start 2023-08-25T04:02:37.801 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.796+0000 7f271e85c640 1 -- start start 2023-08-25T04:02:37.802 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.796+0000 7f271e85c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f271815d430 0x7f27181679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.802 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.796+0000 7f271e85c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271815f8b0 con 0x7f271815e3c0 2023-08-25T04:02:37.802 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.796+0000 7f271e85c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27180cd5a0 con 0x7f27181601f0 2023-08-25T04:02:37.802 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.796+0000 7f271e85c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27180cd880 con 0x7f271815d430 2023-08-25T04:02:37.802 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.796+0000 7f2717fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f27181601f0 0x7f27180d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:45590/0 (socket says 172.21.15.110:45590) 2023-08-25T04:02:37.802 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.796+0000 7f2717fff640 1 -- 172.21.15.110:0/3261291387 learned_addr learned my addr 172.21.15.110:0/3261291387 (peer_addr_for_me v1:172.21.15.110:0/0) 2023-08-25T04:02:37.803 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.796+0000 7f271cdf9640 1 --2- 172.21.15.110:0/3261291387 >> v2:172.21.15.55:3300/0 conn(0x7f271815d430 0x7f27181679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.804 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.796+0000 7f2716ffd640 1 -- 172.21.15.110:0/3261291387 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325274970 0 0) 0x7f27180cd5a0 con 0x7f27181601f0 2023-08-25T04:02:37.804 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.796+0000 7f2716ffd640 1 -- 172.21.15.110:0/3261291387 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2700003530 con 0x7f27181601f0 2023-08-25T04:02:37.804 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.796+0000 7f2716ffd640 1 -- 172.21.15.110:0/3261291387 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770493135 0 0) 0x7f271815f8b0 con 0x7f271815e3c0 2023-08-25T04:02:37.804 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.800+0000 7f2716ffd640 1 -- 172.21.15.110:0/3261291387 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27180cd5a0 con 0x7f271815e3c0 2023-08-25T04:02:37.804 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.800+0000 7f271cdf9640 1 -- 172.21.15.110:0/3261291387 >> v1:172.21.15.110:6789/0 conn(0x7f27181601f0 legacy=0x7f27180d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.804 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.800+0000 7f271cdf9640 1 -- 172.21.15.110:0/3261291387 >> v1:172.21.15.55:6789/0 conn(0x7f271815e3c0 legacy=0x7f27180d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.804 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.800+0000 7f271cdf9640 1 -- 172.21.15.110:0/3261291387 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27180cdb60 con 0x7f271815d430 2023-08-25T04:02:37.806 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.800+0000 7f271cdf9640 1 --2- 172.21.15.110:0/3261291387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f271815d430 0x7f27181679e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2710009dc0 tx=0x7f271001f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6595fb1b1e8403 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:37.806 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.800+0000 7f2716ffd640 1 -- 172.21.15.110:0/3261291387 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100af600 con 0x7f271815d430 2023-08-25T04:02:37.806 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.800+0000 7f2716ffd640 1 -- 172.21.15.110:0/3261291387 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27100ab050 con 0x7f271815d430 2023-08-25T04:02:37.806 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.800+0000 7f2716ffd640 1 -- 172.21.15.110:0/3261291387 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100af980 con 0x7f271815d430 2023-08-25T04:02:37.807 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.800+0000 7f271e85c640 1 -- 172.21.15.110:0/3261291387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f271815d430 msgr2=0x7f27181679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.808 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.800+0000 7f271e85c640 1 --2- 172.21.15.110:0/3261291387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f271815d430 0x7f27181679e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2710009dc0 tx=0x7f271001f120 comp rx=0 tx=0).stop 2023-08-25T04:02:37.808 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.800+0000 7f271e85c640 1 -- 172.21.15.110:0/3261291387 shutdown_connections 2023-08-25T04:02:37.808 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.800+0000 7f271e85c640 1 --2- 172.21.15.110:0/3261291387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f271815d430 0x7f27181679e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.809 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.800+0000 7f271e85c640 1 -- 172.21.15.110:0/3261291387 >> 172.21.15.110:0/3261291387 conn(0x7f27180d27d0 msgr2=0x7f27180d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:37.809 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f271e85c640 1 -- 172.21.15.110:0/3261291387 shutdown_connections 2023-08-25T04:02:37.809 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f271e85c640 1 -- 172.21.15.110:0/3261291387 wait complete. 2023-08-25T04:02:37.811 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f271e85c640 1 Processor -- start 2023-08-25T04:02:37.811 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f271e85c640 1 -- start start 2023-08-25T04:02:37.811 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f271e85c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f271815d430 0x7f2718157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.811 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f271e85c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f271815e3c0 0x7f27180c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.811 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f271e85c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27181601f0 0x7f27180cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:37.812 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f271e85c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180c6b50 con 0x7f27181601f0 2023-08-25T04:02:37.812 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f271e85c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180c6e30 con 0x7f271815d430 2023-08-25T04:02:37.812 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f271e85c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27180c7110 con 0x7f271815e3c0 2023-08-25T04:02:37.812 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f2717fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f271815d430 0x7f2718157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.812 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f27177fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f271815e3c0 0x7f27180c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.812 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f2717fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f271815d430 0x7f2718157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:53422/0 (socket says 172.21.15.110:53422) 2023-08-25T04:02:37.812 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f2717fff640 1 -- 172.21.15.110:0/1958380463 learned_addr learned my addr 172.21.15.110:0/1958380463 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-08-25T04:02:37.813 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f271cdf9640 1 --2- 172.21.15.110:0/1958380463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27181601f0 0x7f27180cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:37.813 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f2717fff640 1 -- 172.21.15.110:0/1958380463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f271815e3c0 msgr2=0x7f27180c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.813 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f2717fff640 1 --2- 172.21.15.110:0/1958380463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f271815e3c0 0x7f27180c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.813 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f2717fff640 1 -- 172.21.15.110:0/1958380463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27181601f0 msgr2=0x7f27180cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.813 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f2717fff640 1 --2- 172.21.15.110:0/1958380463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27181601f0 0x7f27180cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.813 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f2717fff640 1 -- 172.21.15.110:0/1958380463 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2710009a70 con 0x7f271815d430 2023-08-25T04:02:37.813 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f27177fe640 1 --2- 172.21.15.110:0/1958380463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f271815e3c0 0x7f27180c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:02:37.814 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.804+0000 7f271cdf9640 1 --2- 172.21.15.110:0/1958380463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27181601f0 0x7f27180cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:02:37.814 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.808+0000 7f2717fff640 1 --2- 172.21.15.110:0/1958380463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f271815d430 0x7f2718157280 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2708001ec0 tx=0x7f270800c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:37.814 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.808+0000 7f2714ff9640 1 -- 172.21.15.110:0/1958380463 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080074e0 con 0x7f271815d430 2023-08-25T04:02:37.814 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.808+0000 7f2714ff9640 1 -- 172.21.15.110:0/1958380463 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2708007640 con 0x7f271815d430 2023-08-25T04:02:37.814 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.808+0000 7f2714ff9640 1 -- 172.21.15.110:0/1958380463 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080059b0 con 0x7f271815d430 2023-08-25T04:02:37.814 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.808+0000 7f271e85c640 1 -- 172.21.15.110:0/1958380463 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27180c73f0 con 0x7f271815d430 2023-08-25T04:02:37.815 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.808+0000 7f2714ff9640 1 -- 172.21.15.110:0/1958380463 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2708012400 con 0x7f271815d430 2023-08-25T04:02:37.815 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.808+0000 7f271e85c640 1 -- 172.21.15.110:0/1958380463 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27180c67b0 con 0x7f271815d430 2023-08-25T04:02:37.815 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.808+0000 7f2714ff9640 1 -- 172.21.15.110:0/1958380463 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f270801b9f0 con 0x7f271815d430 2023-08-25T04:02:37.816 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.808+0000 7f271e85c640 1 -- 172.21.15.110:0/1958380463 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27180b5260 con 0x7f271815d430 2023-08-25T04:02:37.816 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.812+0000 7f2714ff9640 1 -- 172.21.15.110:0/1958380463 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2708017070 con 0x7f271815d430 2023-08-25T04:02:37.827 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:37.824+0000 7f8aaddff180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:02:37.874 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:37.871+0000 7f5be8446180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:02:37.880 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.876+0000 7f271e85c640 1 -- 172.21.15.110:0/1958380463 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "67454445-1277-4135-8362-fc13874c1c55", "id": 6} v 0) v1 -- 0x7f27180c7910 con 0x7f271815d430 2023-08-25T04:02:37.888 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.884+0000 7f2714ff9640 1 -- 172.21.15.110:0/1958380463 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "67454445-1277-4135-8362-fc13874c1c55", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f27180c7910 con 0x7f271815d430 2023-08-25T04:02:37.888 INFO:teuthology.orchestra.run.smithi110.stdout:6 2023-08-25T04:02:37.889 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.884+0000 7f271e85c640 1 -- 172.21.15.110:0/1958380463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f271815d430 msgr2=0x7f2718157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:37.889 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.884+0000 7f271e85c640 1 --2- 172.21.15.110:0/1958380463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f271815d430 0x7f2718157280 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2708001ec0 tx=0x7f270800c960 comp rx=0 tx=0).stop 2023-08-25T04:02:37.889 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.884+0000 7f271e85c640 1 -- 172.21.15.110:0/1958380463 shutdown_connections 2023-08-25T04:02:37.890 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.884+0000 7f271e85c640 1 --2- 172.21.15.110:0/1958380463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27181601f0 0x7f27180cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.890 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.884+0000 7f271e85c640 1 --2- 172.21.15.110:0/1958380463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f271815e3c0 0x7f27180c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.890 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.884+0000 7f271e85c640 1 --2- 172.21.15.110:0/1958380463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f271815d430 0x7f2718157280 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:37.890 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.884+0000 7f271e85c640 1 -- 172.21.15.110:0/1958380463 >> 172.21.15.110:0/1958380463 conn(0x7f27180d27d0 msgr2=0x7f271806aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:37.891 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.884+0000 7f271e85c640 1 -- 172.21.15.110:0/1958380463 shutdown_connections 2023-08-25T04:02:37.891 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:37.884+0000 7f271e85c640 1 -- 172.21.15.110:0/1958380463 wait complete. 2023-08-25T04:02:37.897 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:37.892+0000 7f8aaddff180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:02:37.908 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new b9cf8dda-12c0-441f-bcc5-429f79e5fece 7 2023-08-25T04:02:37.947 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:37.943+0000 7f5be8446180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:02:38.045 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.040+0000 7f44bebac640 1 Processor -- start 2023-08-25T04:02:38.046 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.040+0000 7f44bebac640 1 -- start start 2023-08-25T04:02:38.048 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.044+0000 7f44bebac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b815cb40 0x7f44b80ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:38.048 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.044+0000 7f44bebac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44b80d14c0 0x7f44b80d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:38.049 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.044+0000 7f44bebac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b80cd3e0 con 0x7f44b80d32f0 2023-08-25T04:02:38.049 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.044+0000 7f44bebac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b80d0c40 con 0x7f44b80d14c0 2023-08-25T04:02:38.049 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.044+0000 7f44bebac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80cd680 con 0x7f44b815cb40 2023-08-25T04:02:38.049 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.044+0000 7f44bc948640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b815cb40 0x7f44b80ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:38.050 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.044+0000 7f44bc948640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b815cb40 0x7f44b80ce440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:45588/0 (socket says 172.21.15.110:45588) 2023-08-25T04:02:38.050 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.044+0000 7f44bc948640 1 -- 172.21.15.110:0/2459860920 learned_addr learned my addr 172.21.15.110:0/2459860920 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-08-25T04:02:38.050 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.044+0000 7f44bd149640 1 --2- 172.21.15.110:0/2459860920 >> v2:172.21.15.55:3300/0 conn(0x7f44b80d14c0 0x7f44b80d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:38.051 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.044+0000 7f44bc948640 1 -- 172.21.15.110:0/2459860920 >> v2:172.21.15.55:3300/0 conn(0x7f44b80d14c0 msgr2=0x7f44b80d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:38.051 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.044+0000 7f44bc948640 1 --2- 172.21.15.110:0/2459860920 >> v2:172.21.15.55:3300/0 conn(0x7f44b80d14c0 0x7f44b80d05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:38.051 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.044+0000 7f44bc948640 1 -- 172.21.15.110:0/2459860920 >> v1:172.21.15.55:6789/0 conn(0x7f44b80d32f0 legacy=0x7f44b80d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:38.052 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.044+0000 7f44bc948640 1 -- 172.21.15.110:0/2459860920 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b80cd960 con 0x7f44b815cb40 2023-08-25T04:02:38.053 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.044+0000 7f44bc948640 1 --2- 172.21.15.110:0/2459860920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b815cb40 0x7f44b80ce440 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f44ac006fd0 tx=0x7f44ac01c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73c179a4f72e57ad server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:38.054 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44b77fe640 1 -- 172.21.15.110:0/2459860920 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0ab660 con 0x7f44b815cb40 2023-08-25T04:02:38.054 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44b77fe640 1 -- 172.21.15.110:0/2459860920 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac0ab7c0 con 0x7f44b815cb40 2023-08-25T04:02:38.054 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44b77fe640 1 -- 172.21.15.110:0/2459860920 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0abb50 con 0x7f44b815cb40 2023-08-25T04:02:38.054 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bebac640 1 -- 172.21.15.110:0/2459860920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b815cb40 msgr2=0x7f44b80ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:38.055 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bebac640 1 --2- 172.21.15.110:0/2459860920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b815cb40 0x7f44b80ce440 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f44ac006fd0 tx=0x7f44ac01c460 comp rx=0 tx=0).stop 2023-08-25T04:02:38.055 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bebac640 1 -- 172.21.15.110:0/2459860920 shutdown_connections 2023-08-25T04:02:38.055 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bebac640 1 --2- 172.21.15.110:0/2459860920 >> v2:172.21.15.55:3300/0 conn(0x7f44b80d14c0 0x7f44b80d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:38.055 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bebac640 1 --2- 172.21.15.110:0/2459860920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b815cb40 0x7f44b80ce440 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:38.055 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bebac640 1 -- 172.21.15.110:0/2459860920 >> 172.21.15.110:0/2459860920 conn(0x7f44b80d27d0 msgr2=0x7f44b80d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:38.056 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bebac640 1 -- 172.21.15.110:0/2459860920 shutdown_connections 2023-08-25T04:02:38.056 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bebac640 1 -- 172.21.15.110:0/2459860920 wait complete. 2023-08-25T04:02:38.056 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bebac640 1 Processor -- start 2023-08-25T04:02:38.057 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bebac640 1 -- start start 2023-08-25T04:02:38.060 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bebac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b80d14c0 0x7f44b80b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:38.060 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bebac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44b80d32f0 0x7f44b806b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:38.060 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bebac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44b815cb40 0x7f44b815e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:38.060 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bebac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80b0440 con 0x7f44b815cb40 2023-08-25T04:02:38.061 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bebac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80b0720 con 0x7f44b80d32f0 2023-08-25T04:02:38.061 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bebac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b80b0a00 con 0x7f44b80d14c0 2023-08-25T04:02:38.061 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bc948640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b80d14c0 0x7f44b80b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:38.061 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bc948640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b80d14c0 0x7f44b80b14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:45602/0 (socket says 172.21.15.110:45602) 2023-08-25T04:02:38.062 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bc948640 1 -- 172.21.15.110:0/3077550972 learned_addr learned my addr 172.21.15.110:0/3077550972 (peer_addr_for_me v2:172.21.15.110:0/0) 2023-08-25T04:02:38.062 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44bd149640 1 --2- 172.21.15.110:0/3077550972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44b815cb40 0x7f44b815e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:38.062 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.048+0000 7f44b7fff640 1 --2- 172.21.15.110:0/3077550972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44b80d32f0 0x7f44b806b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:38.063 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.052+0000 7f44bc948640 1 -- 172.21.15.110:0/3077550972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44b80d32f0 msgr2=0x7f44b806b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:38.063 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.052+0000 7f44bc948640 1 --2- 172.21.15.110:0/3077550972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44b80d32f0 0x7f44b806b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:38.063 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.052+0000 7f44bc948640 1 -- 172.21.15.110:0/3077550972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44b815cb40 msgr2=0x7f44b815e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:38.063 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.052+0000 7f44bc948640 1 --2- 172.21.15.110:0/3077550972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44b815cb40 0x7f44b815e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:38.064 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.052+0000 7f44bc948640 1 -- 172.21.15.110:0/3077550972 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac009480 con 0x7f44b80d14c0 2023-08-25T04:02:38.064 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.052+0000 7f44bc948640 1 --2- 172.21.15.110:0/3077550972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b80d14c0 0x7f44b80b14e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f44ac01a090 tx=0x7f44ac019200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:38.064 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.052+0000 7f44b57fa640 1 -- 172.21.15.110:0/3077550972 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac005ba0 con 0x7f44b80d14c0 2023-08-25T04:02:38.064 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.052+0000 7f44b57fa640 1 -- 172.21.15.110:0/3077550972 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac005d00 con 0x7f44b80d14c0 2023-08-25T04:02:38.065 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.052+0000 7f44b57fa640 1 -- 172.21.15.110:0/3077550972 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0abb70 con 0x7f44b80d14c0 2023-08-25T04:02:38.065 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.052+0000 7f44bebac640 1 -- 172.21.15.110:0/3077550972 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b80b0ce0 con 0x7f44b80d14c0 2023-08-25T04:02:38.065 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.052+0000 7f44bebac640 1 -- 172.21.15.110:0/3077550972 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b806bc30 con 0x7f44b80d14c0 2023-08-25T04:02:38.065 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.052+0000 7f44b57fa640 1 -- 172.21.15.110:0/3077550972 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f44ac0a9070 con 0x7f44b80d14c0 2023-08-25T04:02:38.066 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.052+0000 7f44b57fa640 1 -- 172.21.15.110:0/3077550972 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f44ac006000 con 0x7f44b80d14c0 2023-08-25T04:02:38.066 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.052+0000 7f44bebac640 1 -- 172.21.15.110:0/3077550972 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b806be20 con 0x7f44b80d14c0 2023-08-25T04:02:38.066 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.056+0000 7f44b57fa640 1 -- 172.21.15.110:0/3077550972 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f44ac0ddb00 con 0x7f44b80d14c0 2023-08-25T04:02:38.123 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.120+0000 7f44bebac640 1 -- 172.21.15.110:0/3077550972 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b9cf8dda-12c0-441f-bcc5-429f79e5fece", "id": 7} v 0) v1 -- 0x7f44b8073ec0 con 0x7f44b80d14c0 2023-08-25T04:02:38.130 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.124+0000 7f44b57fa640 1 -- 172.21.15.110:0/3077550972 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b9cf8dda-12c0-441f-bcc5-429f79e5fece", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f44ac0cc030 con 0x7f44b80d14c0 2023-08-25T04:02:38.130 INFO:teuthology.orchestra.run.smithi110.stdout:7 2023-08-25T04:02:38.131 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.128+0000 7f44bebac640 1 -- 172.21.15.110:0/3077550972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b80d14c0 msgr2=0x7f44b80b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:38.132 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.128+0000 7f44bebac640 1 --2- 172.21.15.110:0/3077550972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b80d14c0 0x7f44b80b14e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f44ac01a090 tx=0x7f44ac019200 comp rx=0 tx=0).stop 2023-08-25T04:02:38.132 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.128+0000 7f44bebac640 1 -- 172.21.15.110:0/3077550972 shutdown_connections 2023-08-25T04:02:38.132 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.128+0000 7f44bebac640 1 --2- 172.21.15.110:0/3077550972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44b815cb40 0x7f44b815e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:38.132 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.128+0000 7f44bebac640 1 --2- 172.21.15.110:0/3077550972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44b80d32f0 0x7f44b806b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:38.132 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.128+0000 7f44bebac640 1 --2- 172.21.15.110:0/3077550972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44b80d14c0 0x7f44b80b14e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:38.133 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.128+0000 7f44bebac640 1 -- 172.21.15.110:0/3077550972 >> 172.21.15.110:0/3077550972 conn(0x7f44b80d27d0 msgr2=0x7f44b815be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:38.133 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.128+0000 7f44bebac640 1 -- 172.21.15.110:0/3077550972 shutdown_connections 2023-08-25T04:02:38.133 INFO:teuthology.orchestra.run.smithi110.stderr:2023-08-25T04:02:38.128+0000 7f44bebac640 1 -- 172.21.15.110:0/3077550972 wait complete. 2023-08-25T04:02:38.149 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-25T04:02:38.149 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-25T04:02:38.153 INFO:tasks.ceph.osd.0:Started 2023-08-25T04:02:38.154 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-25T04:02:38.154 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-25T04:02:38.158 INFO:tasks.ceph.osd.1:Started 2023-08-25T04:02:38.158 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-25T04:02:38.158 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-25T04:02:38.162 INFO:tasks.ceph.osd.2:Started 2023-08-25T04:02:38.162 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-25T04:02:38.162 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-25T04:02:38.167 INFO:tasks.ceph.osd.3:Started 2023-08-25T04:02:38.167 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-25T04:02:38.168 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-25T04:02:38.172 INFO:tasks.ceph.osd.4:Started 2023-08-25T04:02:38.173 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-25T04:02:38.173 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-25T04:02:38.176 INFO:tasks.ceph.osd.5:Started 2023-08-25T04:02:38.176 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-25T04:02:38.177 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-25T04:02:38.180 INFO:tasks.ceph.osd.6:Started 2023-08-25T04:02:38.180 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-25T04:02:38.181 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-25T04:02:38.185 INFO:tasks.ceph.osd.7:Started 2023-08-25T04:02:38.186 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:02:38.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.391+0000 7fa748bd2640 1 Processor -- start 2023-08-25T04:02:38.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.395+0000 7fa748bd2640 1 -- start start 2023-08-25T04:02:38.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.395+0000 7fa748bd2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa7440d0da0 0x7fa7440d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:38.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.395+0000 7fa748bd2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7440b3e50 0x7fa7440ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:38.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.395+0000 7fa748bd2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7440b29b0 con 0x7fa7440cdde0 2023-08-25T04:02:38.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.395+0000 7fa748bd2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7440ce760 con 0x7fa7440d0da0 2023-08-25T04:02:38.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.395+0000 7fa748bd2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7440d16c0 con 0x7fa7440b3e50 2023-08-25T04:02:38.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.395+0000 7fa74259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa7440d0da0 0x7fa7440d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:38.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.395+0000 7fa74259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa7440d0da0 0x7fa7440d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58352/0 (socket says 172.21.15.55:58352) 2023-08-25T04:02:38.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.395+0000 7fa74259c640 1 -- 172.21.15.55:0/197560914 learned_addr learned my addr 172.21.15.55:0/197560914 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:38.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.395+0000 7fa742d9d640 1 --2- 172.21.15.55:0/197560914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7440b3e50 0x7fa7440ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:38.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.395+0000 7fa74259c640 1 -- 172.21.15.55:0/197560914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7440b3e50 msgr2=0x7fa7440ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:38.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.395+0000 7fa74259c640 1 --2- 172.21.15.55:0/197560914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7440b3e50 0x7fa7440ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:38.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.395+0000 7fa74259c640 1 -- 172.21.15.55:0/197560914 >> v1:172.21.15.110:6789/0 conn(0x7fa7440cdde0 legacy=0x7fa7440cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:38.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.395+0000 7fa74259c640 1 -- 172.21.15.55:0/197560914 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7440b1dc0 con 0x7fa7440d0da0 2023-08-25T04:02:38.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.395+0000 7fa742d9d640 1 --2- 172.21.15.55:0/197560914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7440b3e50 0x7fa7440ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:02:38.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.399+0000 7fa74259c640 1 --2- 172.21.15.55:0/197560914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7440d0da0 0x7fa7440d1180 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa734006fd0 tx=0x7fa73401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a2310195f79e67 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:38.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.399+0000 7fa741d9b640 1 -- 172.21.15.55:0/197560914 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7340a8a10 con 0x7fa7440d0da0 2023-08-25T04:02:38.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.399+0000 7fa741d9b640 1 -- 172.21.15.55:0/197560914 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7340a8b70 con 0x7fa7440d0da0 2023-08-25T04:02:38.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.399+0000 7fa741d9b640 1 -- 172.21.15.55:0/197560914 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7340b0440 con 0x7fa7440d0da0 2023-08-25T04:02:38.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.399+0000 7fa748bd2640 1 -- 172.21.15.55:0/197560914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7440d0da0 msgr2=0x7fa7440d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:38.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.399+0000 7fa748bd2640 1 --2- 172.21.15.55:0/197560914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7440d0da0 0x7fa7440d1180 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa734006fd0 tx=0x7fa73401ed10 comp rx=0 tx=0).stop 2023-08-25T04:02:38.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.399+0000 7fa748bd2640 1 -- 172.21.15.55:0/197560914 shutdown_connections 2023-08-25T04:02:38.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.399+0000 7fa748bd2640 1 --2- 172.21.15.55:0/197560914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7440b3e50 0x7fa7440ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:38.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.399+0000 7fa748bd2640 1 --2- 172.21.15.55:0/197560914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7440d0da0 0x7fa7440d1180 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:38.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.399+0000 7fa748bd2640 1 -- 172.21.15.55:0/197560914 >> 172.21.15.55:0/197560914 conn(0x7fa74409bae0 msgr2=0x7fa7440d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:38.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.399+0000 7fa748bd2640 1 -- 172.21.15.55:0/197560914 shutdown_connections 2023-08-25T04:02:38.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.399+0000 7fa748bd2640 1 -- 172.21.15.55:0/197560914 wait complete. 2023-08-25T04:02:38.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.399+0000 7fa748bd2640 1 Processor -- start 2023-08-25T04:02:38.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa748bd2640 1 -- start start 2023-08-25T04:02:38.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa748bd2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7440b3e50 0x7fa7440b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:38.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa748bd2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7440cdde0 0x7fa7441f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:38.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa748bd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7440d0da0 0x7fa744151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:38.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa748bd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7441f6530 con 0x7fa7440d0da0 2023-08-25T04:02:38.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa748bd2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7440c99c0 con 0x7fa7440b3e50 2023-08-25T04:02:38.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa748bd2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7440c9ca0 con 0x7fa7440cdde0 2023-08-25T04:02:38.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa742d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7440d0da0 0x7fa744151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:38.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa742d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7440d0da0 0x7fa744151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58360/0 (socket says 172.21.15.55:58360) 2023-08-25T04:02:38.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa742d9d640 1 -- 172.21.15.55:0/3264308357 learned_addr learned my addr 172.21.15.55:0/3264308357 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:38.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa74259c640 1 --2- 172.21.15.55:0/3264308357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7440b3e50 0x7fa7440b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:38.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa73bfff640 1 --2- 172.21.15.55:0/3264308357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7440cdde0 0x7fa7441f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:38.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa742d9d640 1 -- 172.21.15.55:0/3264308357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7440cdde0 msgr2=0x7fa7441f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:38.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa742d9d640 1 --2- 172.21.15.55:0/3264308357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7440cdde0 0x7fa7441f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:38.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa742d9d640 1 -- 172.21.15.55:0/3264308357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7440b3e50 msgr2=0x7fa7440b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:38.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa742d9d640 1 --2- 172.21.15.55:0/3264308357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7440b3e50 0x7fa7440b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:38.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa742d9d640 1 -- 172.21.15.55:0/3264308357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa734009480 con 0x7fa7440d0da0 2023-08-25T04:02:38.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa742d9d640 1 --2- 172.21.15.55:0/3264308357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7440d0da0 0x7fa744151c90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00ccf0 tx=0x7fa73c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:38.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa73affd640 1 -- 172.21.15.55:0/3264308357 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c00f680 con 0x7fa7440d0da0 2023-08-25T04:02:38.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa73affd640 1 -- 172.21.15.55:0/3264308357 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c00f800 con 0x7fa7440d0da0 2023-08-25T04:02:38.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa73affd640 1 -- 172.21.15.55:0/3264308357 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c00fbb0 con 0x7fa7440d0da0 2023-08-25T04:02:38.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa748bd2640 1 -- 172.21.15.55:0/3264308357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7440c9f80 con 0x7fa7440d0da0 2023-08-25T04:02:38.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa748bd2640 1 -- 172.21.15.55:0/3264308357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7440ca540 con 0x7fa7440d0da0 2023-08-25T04:02:38.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa73affd640 1 -- 172.21.15.55:0/3264308357 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa73c00b040 con 0x7fa7440d0da0 2023-08-25T04:02:38.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa73affd640 1 -- 172.21.15.55:0/3264308357 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa73c00fd10 con 0x7fa7440d0da0 2023-08-25T04:02:38.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.403+0000 7fa748bd2640 1 -- 172.21.15.55:0/3264308357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74404dbe0 con 0x7fa7440d0da0 2023-08-25T04:02:38.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.407+0000 7fa73affd640 1 -- 172.21.15.55:0/3264308357 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa73c01d020 con 0x7fa7440d0da0 2023-08-25T04:02:38.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.463+0000 7fa748bd2640 1 -- 172.21.15.55:0/3264308357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7440d0b80 con 0x7fa7440d0da0 2023-08-25T04:02:38.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.467+0000 7fa73affd640 1 -- 172.21.15.55:0/3264308357 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa73c018700 con 0x7fa7440d0da0 2023-08-25T04:02:38.469 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:02:38.469 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":10,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:02:38.124953+0000","last_up_change":"0.000000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:02:38.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.467+0000 7fa748bd2640 1 -- 172.21.15.55:0/3264308357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7440d0da0 msgr2=0x7fa744151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:38.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.467+0000 7fa748bd2640 1 --2- 172.21.15.55:0/3264308357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7440d0da0 0x7fa744151c90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00ccf0 tx=0x7fa73c00a650 comp rx=0 tx=0).stop 2023-08-25T04:02:38.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.467+0000 7fa748bd2640 1 -- 172.21.15.55:0/3264308357 shutdown_connections 2023-08-25T04:02:38.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.467+0000 7fa748bd2640 1 --2- 172.21.15.55:0/3264308357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7440d0da0 0x7fa744151c90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:38.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.467+0000 7fa748bd2640 1 --2- 172.21.15.55:0/3264308357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7440cdde0 0x7fa7441f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:38.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.467+0000 7fa748bd2640 1 --2- 172.21.15.55:0/3264308357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7440b3e50 0x7fa7440b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:38.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.467+0000 7fa748bd2640 1 -- 172.21.15.55:0/3264308357 >> 172.21.15.55:0/3264308357 conn(0x7fa74409bae0 msgr2=0x7fa7440cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:38.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.467+0000 7fa748bd2640 1 -- 172.21.15.55:0/3264308357 shutdown_connections 2023-08-25T04:02:38.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:38.467+0000 7fa748bd2640 1 -- 172.21.15.55:0/3264308357 wait complete. 2023-08-25T04:02:38.498 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-25T04:02:38.498 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-25T04:02:38.562 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:02:38.562 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:02:38.563 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:02:38.581 INFO:tasks.ceph.osd.1.smithi055.stderr:2023-08-25T04:02:38.579+0000 7f27d45c2640 -1 Falling back to public interface 2023-08-25T04:02:38.589 INFO:tasks.ceph.osd.2.smithi055.stderr:2023-08-25T04:02:38.587+0000 7f29a722b640 -1 Falling back to public interface 2023-08-25T04:02:38.591 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:02:38.591 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:02:38.592 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:02:38.601 INFO:tasks.ceph.osd.3.smithi055.stderr:2023-08-25T04:02:38.599+0000 7f87ad16e640 -1 Falling back to public interface 2023-08-25T04:02:38.622 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:38.616+0000 7f8aaddff180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:02:38.627 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:38.623+0000 7f5be8446180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:02:38.757 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:38.752+0000 7f8aaddff180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:02:38.768 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:38.767+0000 7f5be8446180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:02:38.809 INFO:tasks.ceph.osd.0.smithi055.stderr:2023-08-25T04:02:38.807+0000 7f103a0f5640 -1 Falling back to public interface 2023-08-25T04:02:38.860 INFO:tasks.ceph.osd.6.smithi110.stderr:2023-08-25T04:02:38.856+0000 7f2ce4dda640 -1 Falling back to public interface 2023-08-25T04:02:38.868 INFO:tasks.ceph.osd.7.smithi110.stderr:2023-08-25T04:02:38.864+0000 7fdaf4a26640 -1 Falling back to public interface 2023-08-25T04:02:38.872 INFO:tasks.ceph.osd.4.smithi110.stderr:2023-08-25T04:02:38.868+0000 7fe83a830640 -1 Falling back to public interface 2023-08-25T04:02:38.896 INFO:tasks.ceph.osd.5.smithi110.stderr:2023-08-25T04:02:38.892+0000 7f077c14c640 -1 Falling back to public interface 2023-08-25T04:02:38.937 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:38.932+0000 7f8aaddff180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:02:38.960 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:38.955+0000 7f5be8446180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:02:39.009 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:39.004+0000 7f8aaddff180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:02:39.036 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:39.031+0000 7f5be8446180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:02:39.146 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:39.140+0000 7f8aaddff180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:02:39.181 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:39.179+0000 7f5be8446180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:02:39.303 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-25T04:02:39.437 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.435+0000 7f79c5db7640 1 Processor -- start 2023-08-25T04:02:39.437 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.435+0000 7f79c5db7640 1 -- start start 2023-08-25T04:02:39.438 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.435+0000 7f79c5db7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f79c00b8240 0x7f79c00cd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:39.438 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.435+0000 7f79c5db7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c00cdd80 con 0x7f79c00cd950 2023-08-25T04:02:39.439 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.435+0000 7f79c5db7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c00d11f0 con 0x7f79c015c790 2023-08-25T04:02:39.439 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.435+0000 7f79c5db7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c00d14d0 con 0x7f79c00b8240 2023-08-25T04:02:39.439 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.435+0000 7f79bffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f79c00b8240 0x7f79c00cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:39.439 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.435+0000 7f79c55b6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f79c00cd950 0x7f79c00b5770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33210/0 (socket says 172.21.15.55:33210) 2023-08-25T04:02:39.440 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.435+0000 7f79c55b6640 1 -- 172.21.15.55:0/3913325482 learned_addr learned my addr 172.21.15.55:0/3913325482 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:02:39.440 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.435+0000 7f79bffff640 1 -- 172.21.15.55:0/3913325482 >> v1:172.21.15.110:6789/0 conn(0x7f79c015c790 legacy=0x7f79c00d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:39.440 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.435+0000 7f79bffff640 1 -- 172.21.15.55:0/3913325482 >> v1:172.21.15.55:6789/0 conn(0x7f79c00cd950 legacy=0x7f79c00b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:39.440 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.435+0000 7f79bffff640 1 -- 172.21.15.55:0/3913325482 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c00d17b0 con 0x7f79c00b8240 2023-08-25T04:02:39.440 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.435+0000 7f79bf7fe640 1 -- 172.21.15.55:0/3913325482 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609442780 0 0) 0x7f79c00cdd80 con 0x7f79c00cd950 2023-08-25T04:02:39.441 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.439+0000 7f79bffff640 1 --2- 172.21.15.55:0/3913325482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c00b8240 0x7f79c00cd410 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0097c0 tx=0x7f79ac01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161fcec92c033b18 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:39.442 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.439+0000 7f79bf7fe640 1 -- 172.21.15.55:0/3913325482 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac0ab600 con 0x7f79c00b8240 2023-08-25T04:02:39.442 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.439+0000 7f79bf7fe640 1 -- 172.21.15.55:0/3913325482 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac0a7050 con 0x7f79c00b8240 2023-08-25T04:02:39.442 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.439+0000 7f79bf7fe640 1 -- 172.21.15.55:0/3913325482 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac0ab980 con 0x7f79c00b8240 2023-08-25T04:02:39.443 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.439+0000 7f79c5db7640 1 -- 172.21.15.55:0/3913325482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c00b8240 msgr2=0x7f79c00cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:39.443 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.439+0000 7f79c5db7640 1 --2- 172.21.15.55:0/3913325482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c00b8240 0x7f79c00cd410 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0097c0 tx=0x7f79ac01c480 comp rx=0 tx=0).stop 2023-08-25T04:02:39.443 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.439+0000 7f79c5db7640 1 -- 172.21.15.55:0/3913325482 shutdown_connections 2023-08-25T04:02:39.443 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.439+0000 7f79c5db7640 1 --2- 172.21.15.55:0/3913325482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c00b8240 0x7f79c00cd410 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:39.444 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.439+0000 7f79c5db7640 1 -- 172.21.15.55:0/3913325482 >> 172.21.15.55:0/3913325482 conn(0x7f79c006a930 msgr2=0x7f79c006ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:39.444 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.439+0000 7f79c5db7640 1 -- 172.21.15.55:0/3913325482 shutdown_connections 2023-08-25T04:02:39.444 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.439+0000 7f79c5db7640 1 -- 172.21.15.55:0/3913325482 wait complete. 2023-08-25T04:02:39.444 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79c5db7640 1 Processor -- start 2023-08-25T04:02:39.445 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79c5db7640 1 -- start start 2023-08-25T04:02:39.447 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79c5db7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c00b8240 0x7f79c00c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:39.447 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79c5db7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c00cd950 0x7f79c014b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:39.447 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79c5db7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79c015c790 0x7f79c015b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:39.447 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79c5db7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c00cac60 con 0x7f79c00b8240 2023-08-25T04:02:39.447 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79c5db7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c00caeb0 con 0x7f79c00cd950 2023-08-25T04:02:39.448 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79c5db7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c00cb190 con 0x7f79c015c790 2023-08-25T04:02:39.449 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79c4db5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c00b8240 0x7f79c00c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:39.449 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79bffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c00cd950 0x7f79c014b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:39.449 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79bffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c00cd950 0x7f79c014b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:46696/0 (socket says 172.21.15.55:46696) 2023-08-25T04:02:39.450 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79c4db5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c00b8240 0x7f79c00c8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58390/0 (socket says 172.21.15.55:58390) 2023-08-25T04:02:39.451 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79bffff640 1 -- 172.21.15.55:0/840538945 learned_addr learned my addr 172.21.15.55:0/840538945 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:39.451 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79c55b6640 1 --2- 172.21.15.55:0/840538945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79c015c790 0x7f79c015b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:39.452 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79bffff640 1 -- 172.21.15.55:0/840538945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79c015c790 msgr2=0x7f79c015b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:39.453 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79bffff640 1 --2- 172.21.15.55:0/840538945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79c015c790 0x7f79c015b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:39.453 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79bffff640 1 -- 172.21.15.55:0/840538945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c00b8240 msgr2=0x7f79c00c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:39.453 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79bffff640 1 --2- 172.21.15.55:0/840538945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c00b8240 0x7f79c00c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:39.454 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79bffff640 1 -- 172.21.15.55:0/840538945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac009420 con 0x7f79c00cd950 2023-08-25T04:02:39.454 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.443+0000 7f79bffff640 1 --2- 172.21.15.55:0/840538945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c00cd950 0x7f79c014b810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f79ac019090 tx=0x7f79ac019220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:39.454 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.447+0000 7f79bd7fa640 1 -- 172.21.15.55:0/840538945 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac0b4610 con 0x7f79c00cd950 2023-08-25T04:02:39.455 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.447+0000 7f79bd7fa640 1 -- 172.21.15.55:0/840538945 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ac0abe90 con 0x7f79c00cd950 2023-08-25T04:02:39.455 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.447+0000 7f79bd7fa640 1 -- 172.21.15.55:0/840538945 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ac0b49d0 con 0x7f79c00cd950 2023-08-25T04:02:39.455 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.447+0000 7f79c5db7640 1 -- 172.21.15.55:0/840538945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c00cb470 con 0x7f79c00cd950 2023-08-25T04:02:39.455 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.447+0000 7f79c5db7640 1 -- 172.21.15.55:0/840538945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c00cba30 con 0x7f79c00cd950 2023-08-25T04:02:39.456 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.447+0000 7f79bd7fa640 1 -- 172.21.15.55:0/840538945 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f79ac0b2040 con 0x7f79c00cd950 2023-08-25T04:02:39.456 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.447+0000 7f79bd7fa640 1 -- 172.21.15.55:0/840538945 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f79ac0b4e30 con 0x7f79c00cd950 2023-08-25T04:02:39.456 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.447+0000 7f79c5db7640 1 -- 172.21.15.55:0/840538945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c004e430 con 0x7f79c00cd950 2023-08-25T04:02:39.457 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.451+0000 7f79bd7fa640 1 -- 172.21.15.55:0/840538945 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f79ac0c2060 con 0x7f79c00cd950 2023-08-25T04:02:39.510 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.507+0000 7f79c5db7640 1 -- 172.21.15.55:0/840538945 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79c00ce320 con 0x7f79c00cd950 2023-08-25T04:02:39.512 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.507+0000 7f79bd7fa640 1 -- 172.21.15.55:0/840538945 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f79ac0b8070 con 0x7f79c00cd950 2023-08-25T04:02:39.513 INFO:teuthology.misc.health.smithi055.stdout: 2023-08-25T04:02:39.513 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":10,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:02:38.124953+0000","last_up_change":"0.000000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:02:39.515 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.511+0000 7f79c5db7640 1 -- 172.21.15.55:0/840538945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c00cd950 msgr2=0x7f79c014b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:39.515 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.511+0000 7f79c5db7640 1 --2- 172.21.15.55:0/840538945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c00cd950 0x7f79c014b810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f79ac019090 tx=0x7f79ac019220 comp rx=0 tx=0).stop 2023-08-25T04:02:39.515 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.511+0000 7f79c5db7640 1 -- 172.21.15.55:0/840538945 shutdown_connections 2023-08-25T04:02:39.516 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.511+0000 7f79c5db7640 1 --2- 172.21.15.55:0/840538945 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79c015c790 0x7f79c015b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:39.516 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.511+0000 7f79c5db7640 1 --2- 172.21.15.55:0/840538945 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c00cd950 0x7f79c014b810 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:39.517 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.511+0000 7f79c5db7640 1 --2- 172.21.15.55:0/840538945 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c00b8240 0x7f79c00c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:39.517 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.511+0000 7f79c5db7640 1 -- 172.21.15.55:0/840538945 >> 172.21.15.55:0/840538945 conn(0x7f79c006a930 msgr2=0x7f79c00b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:39.518 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.511+0000 7f79c5db7640 1 -- 172.21.15.55:0/840538945 shutdown_connections 2023-08-25T04:02:39.518 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:39.511+0000 7f79c5db7640 1 -- 172.21.15.55:0/840538945 wait complete. 2023-08-25T04:02:39.537 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-25T04:02:39.829 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:39.828+0000 7f8aaddff180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:02:39.909 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:39.907+0000 7f5be8446180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:02:39.914 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:39.912+0000 7f8aaddff180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:02:40.000 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:39.999+0000 7f5be8446180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:02:40.104 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:40.104+0000 7f8aaddff180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:02:40.189 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:40.187+0000 7f8aaddff180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:02:40.200 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:40.199+0000 7f5be8446180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:02:40.289 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:40.287+0000 7f5be8446180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:02:40.517 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:40.515+0000 7f8aaddff180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:02:40.585 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:40.583+0000 7f8aaddff180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:02:40.646 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:40.643+0000 7f5be8446180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:02:40.717 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:02:40.715+0000 7f5be8446180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:02:41.609 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:41.607+0000 7f8a55469640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-25T04:02:41.611 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:02:41.607+0000 7f8a55469640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-25T04:02:42.550 INFO:tasks.ceph.osd.2.smithi055.stderr:2023-08-25T04:02:42.547+0000 7f29a722b640 -1 osd.2 0 log_to_monitors true 2023-08-25T04:02:42.563 INFO:tasks.ceph.osd.1.smithi055.stderr:2023-08-25T04:02:42.559+0000 7f27d45c2640 -1 osd.1 0 log_to_monitors true 2023-08-25T04:02:42.565 INFO:tasks.ceph.osd.3.smithi055.stderr:2023-08-25T04:02:42.563+0000 7f87ad16e640 -1 osd.3 0 log_to_monitors true 2023-08-25T04:02:42.647 INFO:tasks.ceph.osd.0.smithi055.stderr:2023-08-25T04:02:42.643+0000 7f103a0f5640 -1 osd.0 0 log_to_monitors true 2023-08-25T04:02:42.814 INFO:tasks.ceph.osd.6.smithi110.stderr:2023-08-25T04:02:42.811+0000 7f2ce4dda640 -1 osd.6 0 log_to_monitors true 2023-08-25T04:02:42.900 INFO:tasks.ceph.osd.5.smithi110.stderr:2023-08-25T04:02:42.899+0000 7f077c14c640 -1 osd.5 0 log_to_monitors true 2023-08-25T04:02:42.910 INFO:tasks.ceph.osd.7.smithi110.stderr:2023-08-25T04:02:42.907+0000 7fdaf4a26640 -1 osd.7 0 log_to_monitors true 2023-08-25T04:02:42.923 INFO:tasks.ceph.osd.4.smithi110.stderr:2023-08-25T04:02:42.923+0000 7fe83a830640 -1 osd.4 0 log_to_monitors true 2023-08-25T04:02:45.575 INFO:tasks.ceph.osd.3.smithi055.stderr:2023-08-25T04:02:45.571+0000 7f87a88f5640 -1 osd.3 0 waiting for initial osdmap 2023-08-25T04:02:45.604 INFO:tasks.ceph.osd.3.smithi055.stderr:2023-08-25T04:02:45.603+0000 7f87a0f3c640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:02:45.650 INFO:tasks.ceph.osd.1.smithi055.stderr:2023-08-25T04:02:45.647+0000 7f27cfd47640 -1 osd.1 0 waiting for initial osdmap 2023-08-25T04:02:45.683 INFO:tasks.ceph.osd.2.smithi055.stderr:2023-08-25T04:02:45.679+0000 7f29a1f73640 -1 osd.2 0 waiting for initial osdmap 2023-08-25T04:02:45.684 INFO:tasks.ceph.osd.1.smithi055.stderr:2023-08-25T04:02:45.683+0000 7f27c838e640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:02:45.724 INFO:tasks.ceph.osd.2.smithi055.stderr:2023-08-25T04:02:45.723+0000 7f299a5ba640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:02:46.089 INFO:tasks.ceph.osd.0.smithi055.stderr:2023-08-25T04:02:46.087+0000 7f103587a640 -1 osd.0 0 waiting for initial osdmap 2023-08-25T04:02:46.112 INFO:tasks.ceph.osd.0.smithi055.stderr:2023-08-25T04:02:46.111+0000 7f102dec1640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:02:46.342 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-25T04:02:46.447 INFO:tasks.ceph.osd.5.smithi110.stderr:2023-08-25T04:02:46.447+0000 7f07778d1640 -1 osd.5 0 waiting for initial osdmap 2023-08-25T04:02:46.476 INFO:tasks.ceph.osd.5.smithi110.stderr:2023-08-25T04:02:46.475+0000 7f076ff18640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:02:46.477 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.475+0000 7efc0191e640 1 Processor -- start 2023-08-25T04:02:46.477 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.475+0000 7efc0191e640 1 -- start start 2023-08-25T04:02:46.478 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.475+0000 7efc0191e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efbfc15c8d0 0x7efbfc06aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:46.478 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.475+0000 7efc0191e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efbfc0d1520 0x7efbfc0cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:46.478 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.475+0000 7efc0191e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbfc0ce380 con 0x7efbfc06af70 2023-08-25T04:02:46.478 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.475+0000 7efc0191e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbfc0ce660 con 0x7efbfc15c8d0 2023-08-25T04:02:46.479 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.475+0000 7efc0191e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbfc0d0330 con 0x7efbfc0d1520 2023-08-25T04:02:46.479 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.475+0000 7efbfaffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efbfc15c8d0 0x7efbfc06aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:46.479 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.475+0000 7efbfaffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efbfc15c8d0 0x7efbfc06aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40444/0 (socket says 172.21.15.55:40444) 2023-08-25T04:02:46.480 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.475+0000 7efbfaffd640 1 -- 172.21.15.55:0/1582179101 learned_addr learned my addr 172.21.15.55:0/1582179101 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:46.480 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.475+0000 7efbfb7fe640 1 --2- 172.21.15.55:0/1582179101 >> v2:172.21.15.110:3300/0 conn(0x7efbfc0d1520 0x7efbfc0cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:46.480 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.475+0000 7efbfaffd640 1 -- 172.21.15.55:0/1582179101 >> v2:172.21.15.110:3300/0 conn(0x7efbfc0d1520 msgr2=0x7efbfc0cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:46.480 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.475+0000 7efbfaffd640 1 --2- 172.21.15.55:0/1582179101 >> v2:172.21.15.110:3300/0 conn(0x7efbfc0d1520 0x7efbfc0cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:46.480 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.475+0000 7efbfaffd640 1 -- 172.21.15.55:0/1582179101 >> v1:172.21.15.110:6789/0 conn(0x7efbfc06af70 legacy=0x7efbfc0d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:46.481 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.475+0000 7efbfaffd640 1 -- 172.21.15.55:0/1582179101 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc0d0610 con 0x7efbfc15c8d0 2023-08-25T04:02:46.481 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.479+0000 7efbfaffd640 1 --2- 172.21.15.55:0/1582179101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbfc15c8d0 0x7efbfc06aa30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efbfc06a930 tx=0x7efbec01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e642d7bec3df78 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:46.481 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.479+0000 7efbfa7fc640 1 -- 172.21.15.55:0/1582179101 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec0ac600 con 0x7efbfc15c8d0 2023-08-25T04:02:46.481 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.479+0000 7efbfa7fc640 1 -- 172.21.15.55:0/1582179101 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbec0a8050 con 0x7efbfc15c8d0 2023-08-25T04:02:46.482 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.479+0000 7efbfa7fc640 1 -- 172.21.15.55:0/1582179101 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec0ac980 con 0x7efbfc15c8d0 2023-08-25T04:02:46.482 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.479+0000 7efc0191e640 1 -- 172.21.15.55:0/1582179101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbfc15c8d0 msgr2=0x7efbfc06aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:46.482 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.479+0000 7efc0191e640 1 --2- 172.21.15.55:0/1582179101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbfc15c8d0 0x7efbfc06aa30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efbfc06a930 tx=0x7efbec01c490 comp rx=0 tx=0).stop 2023-08-25T04:02:46.483 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.479+0000 7efc0191e640 1 -- 172.21.15.55:0/1582179101 shutdown_connections 2023-08-25T04:02:46.483 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.479+0000 7efc0191e640 1 --2- 172.21.15.55:0/1582179101 >> v2:172.21.15.110:3300/0 conn(0x7efbfc0d1520 0x7efbfc0cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:46.483 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.479+0000 7efc0191e640 1 --2- 172.21.15.55:0/1582179101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbfc15c8d0 0x7efbfc06aa30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:46.484 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.479+0000 7efc0191e640 1 -- 172.21.15.55:0/1582179101 >> 172.21.15.55:0/1582179101 conn(0x7efbfc089f90 msgr2=0x7efbfc0d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:46.484 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.479+0000 7efc0191e640 1 -- 172.21.15.55:0/1582179101 shutdown_connections 2023-08-25T04:02:46.485 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.479+0000 7efc0191e640 1 -- 172.21.15.55:0/1582179101 wait complete. 2023-08-25T04:02:46.488 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.479+0000 7efc0191e640 1 Processor -- start 2023-08-25T04:02:46.488 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efc0191e640 1 -- start start 2023-08-25T04:02:46.488 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efc0191e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbfc06af70 0x7efbfc0b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:46.489 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efc0191e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efbfc0d1520 0x7efbfc15a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:46.489 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efc0191e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efbfc15c8d0 0x7efbfc1523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:46.489 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efc0191e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc15ac30 con 0x7efbfc06af70 2023-08-25T04:02:46.489 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efc0191e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc15af10 con 0x7efbfc0d1520 2023-08-25T04:02:46.490 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efc0191e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc15b1f0 con 0x7efbfc15c8d0 2023-08-25T04:02:46.490 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efbfaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbfc06af70 0x7efbfc0b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:46.490 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efbfaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbfc06af70 0x7efbfc0b0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40450/0 (socket says 172.21.15.55:40450) 2023-08-25T04:02:46.491 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efbfaffd640 1 -- 172.21.15.55:0/245966459 learned_addr learned my addr 172.21.15.55:0/245966459 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:46.491 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efbf27fc640 1 --2- 172.21.15.55:0/245966459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efbfc0d1520 0x7efbfc15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:46.491 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efbfb7fe640 1 --2- 172.21.15.55:0/245966459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efbfc15c8d0 0x7efbfc1523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:46.491 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efbfaffd640 1 -- 172.21.15.55:0/245966459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efbfc15c8d0 msgr2=0x7efbfc1523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:46.491 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efbfaffd640 1 --2- 172.21.15.55:0/245966459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efbfc15c8d0 0x7efbfc1523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:46.492 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efbfaffd640 1 -- 172.21.15.55:0/245966459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efbfc0d1520 msgr2=0x7efbfc15a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:46.492 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efbfaffd640 1 --2- 172.21.15.55:0/245966459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efbfc0d1520 0x7efbfc15a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:46.492 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efbfaffd640 1 -- 172.21.15.55:0/245966459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbec009480 con 0x7efbfc06af70 2023-08-25T04:02:46.492 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efbf27fc640 1 --2- 172.21.15.55:0/245966459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efbfc0d1520 0x7efbfc15a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:02:46.493 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efbfaffd640 1 --2- 172.21.15.55:0/245966459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbfc06af70 0x7efbfc0b0370 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efbec01a0c0 tx=0x7efbec019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:46.493 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efbf8ff9640 1 -- 172.21.15.55:0/245966459 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec003b70 con 0x7efbfc06af70 2023-08-25T04:02:46.493 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efbf8ff9640 1 -- 172.21.15.55:0/245966459 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbec003cd0 con 0x7efbfc06af70 2023-08-25T04:02:46.493 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efbf8ff9640 1 -- 172.21.15.55:0/245966459 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbec0b5620 con 0x7efbfc06af70 2023-08-25T04:02:46.493 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efc0191e640 1 -- 172.21.15.55:0/245966459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbfc15b4d0 con 0x7efbfc06af70 2023-08-25T04:02:46.493 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efc0191e640 1 -- 172.21.15.55:0/245966459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbfc152920 con 0x7efbfc06af70 2023-08-25T04:02:46.494 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.483+0000 7efc0191e640 1 -- 172.21.15.55:0/245966459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbfc04dbe0 con 0x7efbfc06af70 2023-08-25T04:02:46.494 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.487+0000 7efbf8ff9640 1 -- 172.21.15.55:0/245966459 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 4) v1 ==== 84906+0+0 (secure 0 0 0) 0x7efbec0b3070 con 0x7efbfc06af70 2023-08-25T04:02:46.494 INFO:tasks.ceph.osd.4.smithi110.stderr:2023-08-25T04:02:46.491+0000 7fe835191640 -1 osd.4 0 waiting for initial osdmap 2023-08-25T04:02:46.495 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.487+0000 7efbf8ff9640 1 --2- 172.21.15.55:0/245966459 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7efbdc0655f0 0x7efbdc067ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:46.495 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.487+0000 7efbf8ff9640 1 -- 172.21.15.55:0/245966459 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2231+0+0 (secure 0 0 0) 0x7efbec11b070 con 0x7efbfc06af70 2023-08-25T04:02:46.495 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.487+0000 7efbf27fc640 1 --2- 172.21.15.55:0/245966459 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7efbdc0655f0 0x7efbdc067ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:46.496 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.487+0000 7efbf27fc640 1 --2- 172.21.15.55:0/245966459 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7efbdc0655f0 0x7efbdc067ab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0c97a0 tx=0x7efbe4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:46.496 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.491+0000 7efbf8ff9640 1 -- 172.21.15.55:0/245966459 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7efbec0e9a60 con 0x7efbfc06af70 2023-08-25T04:02:46.532 INFO:tasks.ceph.osd.4.smithi110.stderr:2023-08-25T04:02:46.531+0000 7fe82d7d8640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:02:46.571 INFO:tasks.ceph.osd.7.smithi110.stderr:2023-08-25T04:02:46.571+0000 7fdaf01ab640 -1 osd.7 0 waiting for initial osdmap 2023-08-25T04:02:46.603 INFO:tasks.ceph.osd.6.smithi110.stderr:2023-08-25T04:02:46.603+0000 7f2ce055f640 -1 osd.6 0 waiting for initial osdmap 2023-08-25T04:02:46.615 INFO:tasks.ceph.osd.7.smithi110.stderr:2023-08-25T04:02:46.615+0000 7fdae87f2640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:02:46.635 INFO:tasks.ceph.osd.6.smithi110.stderr:2023-08-25T04:02:46.635+0000 7f2cd8ba6640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-25T04:02:46.666 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.663+0000 7efc0191e640 1 -- 172.21.15.55:0/245966459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efbfc0cc8f0 con 0x7efbfc06af70 2023-08-25T04:02:46.669 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.667+0000 7efbf8ff9640 1 -- 172.21.15.55:0/245966459 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9948 (secure 0 0 0) 0x7efbec0b1090 con 0x7efbfc06af70 2023-08-25T04:02:46.670 INFO:teuthology.misc.health.smithi055.stdout: 2023-08-25T04:02:46.670 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":14,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:02:46.580331+0000","last_up_change":"2023-08-25T04:02:46.580331+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:02:46.672 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.667+0000 7efc0191e640 1 -- 172.21.15.55:0/245966459 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7efbdc0655f0 msgr2=0x7efbdc067ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:46.672 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.667+0000 7efc0191e640 1 --2- 172.21.15.55:0/245966459 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7efbdc0655f0 0x7efbdc067ab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efbfc0c97a0 tx=0x7efbe4009040 comp rx=0 tx=0).stop 2023-08-25T04:02:46.672 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.667+0000 7efc0191e640 1 -- 172.21.15.55:0/245966459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbfc06af70 msgr2=0x7efbfc0b0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:46.673 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.667+0000 7efc0191e640 1 --2- 172.21.15.55:0/245966459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbfc06af70 0x7efbfc0b0370 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efbec01a0c0 tx=0x7efbec019230 comp rx=0 tx=0).stop 2023-08-25T04:02:46.673 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.667+0000 7efc0191e640 1 -- 172.21.15.55:0/245966459 shutdown_connections 2023-08-25T04:02:46.673 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.667+0000 7efc0191e640 1 --2- 172.21.15.55:0/245966459 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7efbdc0655f0 0x7efbdc067ab0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:46.674 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.667+0000 7efc0191e640 1 --2- 172.21.15.55:0/245966459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efbfc15c8d0 0x7efbfc1523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:46.674 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.667+0000 7efc0191e640 1 --2- 172.21.15.55:0/245966459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efbfc0d1520 0x7efbfc15a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:46.674 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.667+0000 7efc0191e640 1 --2- 172.21.15.55:0/245966459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efbfc06af70 0x7efbfc0b0370 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:46.674 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.667+0000 7efc0191e640 1 -- 172.21.15.55:0/245966459 >> 172.21.15.55:0/245966459 conn(0x7efbfc089f90 msgr2=0x7efbfc15dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:46.675 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.667+0000 7efc0191e640 1 -- 172.21.15.55:0/245966459 shutdown_connections 2023-08-25T04:02:46.675 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:46.667+0000 7efc0191e640 1 -- 172.21.15.55:0/245966459 wait complete. 2023-08-25T04:02:46.689 DEBUG:teuthology.misc:6 of 8 OSDs are up 2023-08-25T04:02:53.497 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-25T04:02:53.641 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.639+0000 7f70595ba640 1 Processor -- start 2023-08-25T04:02:53.641 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.639+0000 7f70595ba640 1 -- start start 2023-08-25T04:02:53.642 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.639+0000 7f70595ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70540d2ec0 0x7f70540d3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:53.643 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.639+0000 7f70595ba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f705406aac0 con 0x7f70540cf1c0 2023-08-25T04:02:53.643 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.639+0000 7f70595ba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70540d1630 con 0x7f705406b230 2023-08-25T04:02:53.643 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.639+0000 7f70595ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70540cdf50 con 0x7f70540d2ec0 2023-08-25T04:02:53.645 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.639+0000 7f7052ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f70540cf1c0 0x7f70540cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58896/0 (socket says 172.21.15.55:58896) 2023-08-25T04:02:53.645 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.639+0000 7f7052ffd640 1 -- 172.21.15.55:0/1170822561 learned_addr learned my addr 172.21.15.55:0/1170822561 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:02:53.647 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.639+0000 7f704bfff640 1 --2- 172.21.15.55:0/1170822561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70540d2ec0 0x7f70540d3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:53.647 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.639+0000 7f70527fc640 1 -- 172.21.15.55:0/1170822561 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352139112 0 0) 0x7f705406aac0 con 0x7f70540cf1c0 2023-08-25T04:02:53.647 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.639+0000 7f70527fc640 1 -- 172.21.15.55:0/1170822561 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7040003530 con 0x7f70540cf1c0 2023-08-25T04:02:53.647 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.639+0000 7f70527fc640 1 -- 172.21.15.55:0/1170822561 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511538372 0 0) 0x7f70540d1630 con 0x7f705406b230 2023-08-25T04:02:53.648 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.639+0000 7f70527fc640 1 -- 172.21.15.55:0/1170822561 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f705406aac0 con 0x7f705406b230 2023-08-25T04:02:53.648 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.639+0000 7f70527fc640 1 -- 172.21.15.55:0/1170822561 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3339227210 0 0) 0x7f7040003530 con 0x7f70540cf1c0 2023-08-25T04:02:53.648 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.639+0000 7f70527fc640 1 -- 172.21.15.55:0/1170822561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70540d2ec0 msgr2=0x7f70540d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:53.649 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.639+0000 7f70527fc640 1 --2- 172.21.15.55:0/1170822561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70540d2ec0 0x7f70540d3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:53.649 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70527fc640 1 -- 172.21.15.55:0/1170822561 >> v1:172.21.15.110:6789/0 conn(0x7f705406b230 legacy=0x7f705406b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:53.649 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70527fc640 1 -- 172.21.15.55:0/1170822561 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70540ce230 con 0x7f70540cf1c0 2023-08-25T04:02:53.649 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70527fc640 1 -- 172.21.15.55:0/1170822561 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f7044001680 con 0x7f70540cf1c0 2023-08-25T04:02:53.649 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70527fc640 1 -- 172.21.15.55:0/1170822561 >> v1:172.21.15.55:6789/0 conn(0x7f70540cf1c0 legacy=0x7f70540cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:53.649 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70527fc640 1 --2- 172.21.15.55:0/1170822561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70540d2ec0 0x7f7040003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:53.649 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70527fc640 1 --2- 172.21.15.55:0/1170822561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70400040a0 0x7f70400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:53.650 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70527fc640 1 --2- 172.21.15.55:0/1170822561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7040004d10 0x7f7040005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:53.651 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70527fc640 1 -- 172.21.15.55:0/1170822561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70540cdf50 con 0x7f7040004d10 2023-08-25T04:02:53.651 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70527fc640 1 -- 172.21.15.55:0/1170822561 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704000ba70 con 0x7f70400040a0 2023-08-25T04:02:53.651 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70527fc640 1 -- 172.21.15.55:0/1170822561 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704000bc30 con 0x7f70540d2ec0 2023-08-25T04:02:53.651 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70537fe640 1 --2- 172.21.15.55:0/1170822561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7040004d10 0x7f7040005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:53.651 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f704bfff640 1 --2- 172.21.15.55:0/1170822561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70400040a0 0x7f70400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:53.651 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f7052ffd640 1 --2- 172.21.15.55:0/1170822561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70540d2ec0 0x7f7040003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:53.651 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70537fe640 1 -- 172.21.15.55:0/1170822561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70540d2ec0 msgr2=0x7f7040003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:53.652 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70537fe640 1 --2- 172.21.15.55:0/1170822561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70540d2ec0 0x7f7040003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:53.652 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70537fe640 1 -- 172.21.15.55:0/1170822561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70400040a0 msgr2=0x7f70400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:53.652 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70537fe640 1 --2- 172.21.15.55:0/1170822561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70400040a0 0x7f70400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:53.652 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70537fe640 1 -- 172.21.15.55:0/1170822561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7040003530 con 0x7f7040004d10 2023-08-25T04:02:53.652 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70537fe640 1 --2- 172.21.15.55:0/1170822561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7040004d10 0x7f7040005190 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f704c001fd0 tx=0x7f704c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a105b96a79a841a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:53.657 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70527fc640 1 -- 172.21.15.55:0/1170822561 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c003b80 con 0x7f7040004d10 2023-08-25T04:02:53.658 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70527fc640 1 -- 172.21.15.55:0/1170822561 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704c003d00 con 0x7f7040004d10 2023-08-25T04:02:53.658 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.643+0000 7f70527fc640 1 -- 172.21.15.55:0/1170822561 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c005310 con 0x7f7040004d10 2023-08-25T04:02:53.658 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f70595ba640 1 -- 172.21.15.55:0/1170822561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7040004d10 msgr2=0x7f7040005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:53.658 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f70595ba640 1 --2- 172.21.15.55:0/1170822561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7040004d10 0x7f7040005190 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f704c001fd0 tx=0x7f704c01c8e0 comp rx=0 tx=0).stop 2023-08-25T04:02:53.658 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f70537fe640 1 -- 172.21.15.55:0/1170822561 reap_dead start 2023-08-25T04:02:53.658 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f70595ba640 1 -- 172.21.15.55:0/1170822561 shutdown_connections 2023-08-25T04:02:53.658 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f70595ba640 1 -- 172.21.15.55:0/1170822561 >> 172.21.15.55:0/1170822561 conn(0x7f7054089f90 msgr2=0x7f70540d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:53.659 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f70595ba640 1 -- 172.21.15.55:0/1170822561 shutdown_connections 2023-08-25T04:02:53.659 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f70595ba640 1 -- 172.21.15.55:0/1170822561 wait complete. 2023-08-25T04:02:53.659 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f70595ba640 1 Processor -- start 2023-08-25T04:02:53.659 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f70595ba640 1 -- start start 2023-08-25T04:02:53.659 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f70595ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7040004d10 0x7f705415dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:53.659 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f70595ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70540b6330 0x7f705414ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:53.659 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f70595ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70540cbb90 0x7f70540b7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:53.659 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f70595ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70540cc770 con 0x7f7040004d10 2023-08-25T04:02:53.660 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f70595ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705415e110 con 0x7f70540b6330 2023-08-25T04:02:53.660 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f70595ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70540ca070 con 0x7f70540cbb90 2023-08-25T04:02:53.660 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f7052ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7040004d10 0x7f705415dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:53.660 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f7052ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7040004d10 0x7f705415dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48608/0 (socket says 172.21.15.55:48608) 2023-08-25T04:02:53.660 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f7052ffd640 1 -- 172.21.15.55:0/1941297339 learned_addr learned my addr 172.21.15.55:0/1941297339 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:53.660 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.647+0000 7f704bfff640 1 --2- 172.21.15.55:0/1941297339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70540b6330 0x7f705414ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:53.661 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.651+0000 7f70537fe640 1 --2- 172.21.15.55:0/1941297339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70540cbb90 0x7f70540b7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:53.661 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.651+0000 7f7052ffd640 1 -- 172.21.15.55:0/1941297339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70540cbb90 msgr2=0x7f70540b7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:53.662 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.651+0000 7f7052ffd640 1 --2- 172.21.15.55:0/1941297339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70540cbb90 0x7f70540b7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:53.662 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.651+0000 7f7052ffd640 1 -- 172.21.15.55:0/1941297339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70540b6330 msgr2=0x7f705414ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:53.662 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.651+0000 7f7052ffd640 1 --2- 172.21.15.55:0/1941297339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70540b6330 0x7f705414ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:53.662 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.651+0000 7f7052ffd640 1 -- 172.21.15.55:0/1941297339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70540cc490 con 0x7f7040004d10 2023-08-25T04:02:53.662 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.651+0000 7f70537fe640 1 --2- 172.21.15.55:0/1941297339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70540cbb90 0x7f70540b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:02:53.662 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.651+0000 7f7052ffd640 1 --2- 172.21.15.55:0/1941297339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7040004d10 0x7f705415dbd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7044007370 tx=0x7f7044007770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:53.663 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.651+0000 7f704b7fe640 1 -- 172.21.15.55:0/1941297339 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704400f960 con 0x7f7040004d10 2023-08-25T04:02:53.663 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.651+0000 7f704b7fe640 1 -- 172.21.15.55:0/1941297339 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704400fac0 con 0x7f7040004d10 2023-08-25T04:02:53.663 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.651+0000 7f70595ba640 1 -- 172.21.15.55:0/1941297339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70540c9a20 con 0x7f7040004d10 2023-08-25T04:02:53.663 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.651+0000 7f704b7fe640 1 -- 172.21.15.55:0/1941297339 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704400fe70 con 0x7f7040004d10 2023-08-25T04:02:53.663 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.651+0000 7f70595ba640 1 -- 172.21.15.55:0/1941297339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705414f010 con 0x7f7040004d10 2023-08-25T04:02:53.663 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.651+0000 7f70595ba640 1 -- 172.21.15.55:0/1941297339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70540c9860 con 0x7f7040004d10 2023-08-25T04:02:53.664 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.651+0000 7f704b7fe640 1 -- 172.21.15.55:0/1941297339 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f704401e3b0 con 0x7f7040004d10 2023-08-25T04:02:53.664 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.651+0000 7f704b7fe640 1 --2- 172.21.15.55:0/1941297339 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7034065680 0x7f7034067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:53.664 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.651+0000 7f704b7fe640 1 -- 172.21.15.55:0/1941297339 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f70440825c0 con 0x7f7040004d10 2023-08-25T04:02:53.664 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.651+0000 7f704bfff640 1 --2- 172.21.15.55:0/1941297339 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7034065680 0x7f7034067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:53.664 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.655+0000 7f704bfff640 1 --2- 172.21.15.55:0/1941297339 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7034065680 0x7f7034067b40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f70541f51c0 tx=0x7f703c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:53.665 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.659+0000 7f704b7fe640 1 -- 172.21.15.55:0/1941297339 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7044050490 con 0x7f7040004d10 2023-08-25T04:02:53.816 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.815+0000 7f70595ba640 1 -- 172.21.15.55:0/1941297339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7054066d20 con 0x7f7040004d10 2023-08-25T04:02:53.817 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.815+0000 7f704b7fe640 1 -- 172.21.15.55:0/1941297339 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12862 (secure 0 0 0) 0x7f704401a090 con 0x7f7040004d10 2023-08-25T04:02:53.818 INFO:teuthology.misc.health.smithi055.stdout: 2023-08-25T04:02:53.818 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":17,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:02:49.669078+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:02:53.819 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.815+0000 7f70595ba640 1 -- 172.21.15.55:0/1941297339 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7034065680 msgr2=0x7f7034067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:53.820 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.815+0000 7f70595ba640 1 --2- 172.21.15.55:0/1941297339 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7034065680 0x7f7034067b40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f70541f51c0 tx=0x7f703c009190 comp rx=0 tx=0).stop 2023-08-25T04:02:53.820 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.815+0000 7f70595ba640 1 -- 172.21.15.55:0/1941297339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7040004d10 msgr2=0x7f705415dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:53.821 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.815+0000 7f70595ba640 1 --2- 172.21.15.55:0/1941297339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7040004d10 0x7f705415dbd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7044007370 tx=0x7f7044007770 comp rx=0 tx=0).stop 2023-08-25T04:02:53.821 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.819+0000 7f70595ba640 1 -- 172.21.15.55:0/1941297339 shutdown_connections 2023-08-25T04:02:53.821 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.819+0000 7f70595ba640 1 --2- 172.21.15.55:0/1941297339 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7034065680 0x7f7034067b40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:53.821 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.819+0000 7f70595ba640 1 --2- 172.21.15.55:0/1941297339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70540cbb90 0x7f70540b7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:53.821 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.819+0000 7f70595ba640 1 --2- 172.21.15.55:0/1941297339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70540b6330 0x7f705414ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:53.821 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.819+0000 7f70595ba640 1 --2- 172.21.15.55:0/1941297339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7040004d10 0x7f705415dbd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:53.822 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.819+0000 7f70595ba640 1 -- 172.21.15.55:0/1941297339 >> 172.21.15.55:0/1941297339 conn(0x7f7054089f90 msgr2=0x7f70540d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:53.822 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.819+0000 7f70595ba640 1 -- 172.21.15.55:0/1941297339 shutdown_connections 2023-08-25T04:02:53.822 INFO:teuthology.misc.health.smithi055.stderr:2023-08-25T04:02:53.819+0000 7f70595ba640 1 -- 172.21.15.55:0/1941297339 wait complete. 2023-08-25T04:02:53.837 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-25T04:02:53.837 INFO:tasks.ceph:Creating RBD pool 2023-08-25T04:02:53.838 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd pool create rbd 8 2023-08-25T04:02:53.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.975+0000 7f3197093640 1 Processor -- start 2023-08-25T04:02:53.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.975+0000 7f3197093640 1 -- start start 2023-08-25T04:02:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.979+0000 7f3197093640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f319006e5a0 0x7f31900cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.979+0000 7f3197093640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f319006c790 0x7f31900ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.979+0000 7f3197093640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31900cab90 con 0x7f319006c3b0 2023-08-25T04:02:53.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.979+0000 7f3197093640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319006dbb0 con 0x7f319006c790 2023-08-25T04:02:53.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.979+0000 7f3197093640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31900cae50 con 0x7f319006e5a0 2023-08-25T04:02:53.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.979+0000 7f3195630640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f319006c790 0x7f31900ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:53.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.979+0000 7f3195630640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f319006c790 0x7f31900ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48616/0 (socket says 172.21.15.55:48616) 2023-08-25T04:02:53.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.979+0000 7f3195630640 1 -- 172.21.15.55:0/1731186378 learned_addr learned my addr 172.21.15.55:0/1731186378 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:53.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.979+0000 7f3187fff640 1 --2- 172.21.15.55:0/1731186378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f319006e5a0 0x7f31900cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:53.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.979+0000 7f3195630640 1 -- 172.21.15.55:0/1731186378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f319006e5a0 msgr2=0x7f31900cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:53.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.979+0000 7f3195630640 1 --2- 172.21.15.55:0/1731186378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f319006e5a0 0x7f31900cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:53.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.979+0000 7f3195630640 1 -- 172.21.15.55:0/1731186378 >> v1:172.21.15.55:6789/0 conn(0x7f319006c3b0 legacy=0x7f319006de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:53.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.979+0000 7f31877fe640 1 -- 172.21.15.55:0/1731186378 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239453852 0 0) 0x7f31900cab90 con 0x7f319006c3b0 2023-08-25T04:02:53.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.979+0000 7f3195630640 1 -- 172.21.15.55:0/1731186378 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31900cb130 con 0x7f319006c790 2023-08-25T04:02:54.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.979+0000 7f3195630640 1 --2- 172.21.15.55:0/1731186378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f319006c790 0x7f31900ce8b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3188009e50 tx=0x7f318801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8cecb83be14609 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:54.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.979+0000 7f31877fe640 1 -- 172.21.15.55:0/1731186378 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31880a5890 con 0x7f319006c790 2023-08-25T04:02:54.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f31877fe640 1 -- 172.21.15.55:0/1731186378 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31880a59f0 con 0x7f319006c790 2023-08-25T04:02:54.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f31877fe640 1 -- 172.21.15.55:0/1731186378 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31880a5d80 con 0x7f319006c790 2023-08-25T04:02:54.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3197093640 1 -- 172.21.15.55:0/1731186378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f319006c790 msgr2=0x7f31900ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:54.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3197093640 1 --2- 172.21.15.55:0/1731186378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f319006c790 0x7f31900ce8b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3188009e50 tx=0x7f318801c9e0 comp rx=0 tx=0).stop 2023-08-25T04:02:54.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3197093640 1 -- 172.21.15.55:0/1731186378 shutdown_connections 2023-08-25T04:02:54.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3197093640 1 --2- 172.21.15.55:0/1731186378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f319006e5a0 0x7f31900cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:54.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3197093640 1 --2- 172.21.15.55:0/1731186378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f319006c790 0x7f31900ce8b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:54.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3197093640 1 -- 172.21.15.55:0/1731186378 >> 172.21.15.55:0/1731186378 conn(0x7f31900d0540 msgr2=0x7f31900d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:54.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3197093640 1 -- 172.21.15.55:0/1731186378 shutdown_connections 2023-08-25T04:02:54.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3197093640 1 -- 172.21.15.55:0/1731186378 wait complete. 2023-08-25T04:02:54.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3197093640 1 Processor -- start 2023-08-25T04:02:54.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3197093640 1 -- start start 2023-08-25T04:02:54.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3197093640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f319006c3b0 0x7f31900c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:54.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3197093640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f319006c790 0x7f319015e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:54.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3197093640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f319006e5a0 0x7f3190158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:54.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3197093640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319015d230 con 0x7f319006c3b0 2023-08-25T04:02:54.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3197093640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31900c5fe0 con 0x7f319006c790 2023-08-25T04:02:54.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3197093640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319015d440 con 0x7f319006e5a0 2023-08-25T04:02:54.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3194e2f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f319006c3b0 0x7f31900c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:54.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3194e2f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f319006c3b0 0x7f31900c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48624/0 (socket says 172.21.15.55:48624) 2023-08-25T04:02:54.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3194e2f640 1 -- 172.21.15.55:0/975682610 learned_addr learned my addr 172.21.15.55:0/975682610 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:54.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.983+0000 7f3187fff640 1 --2- 172.21.15.55:0/975682610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f319006c790 0x7f319015e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:54.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.987+0000 7f3195630640 1 --2- 172.21.15.55:0/975682610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f319006e5a0 0x7f3190158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:54.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.987+0000 7f3194e2f640 1 -- 172.21.15.55:0/975682610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f319006e5a0 msgr2=0x7f3190158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:54.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.987+0000 7f3194e2f640 1 --2- 172.21.15.55:0/975682610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f319006e5a0 0x7f3190158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:54.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.987+0000 7f3194e2f640 1 -- 172.21.15.55:0/975682610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f319006c790 msgr2=0x7f319015e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:54.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.987+0000 7f3194e2f640 1 --2- 172.21.15.55:0/975682610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f319006c790 0x7f319015e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:54.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.987+0000 7f3194e2f640 1 -- 172.21.15.55:0/975682610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3188009b30 con 0x7f319006c3b0 2023-08-25T04:02:54.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.987+0000 7f3195630640 1 --2- 172.21.15.55:0/975682610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f319006e5a0 0x7f3190158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:02:54.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.987+0000 7f3194e2f640 1 --2- 172.21.15.55:0/975682610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f319006c3b0 0x7f31900c68d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f318c00c450 tx=0x7f318c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:54.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.987+0000 7f31857fa640 1 -- 172.21.15.55:0/975682610 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c005480 con 0x7f319006c3b0 2023-08-25T04:02:54.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.987+0000 7f31857fa640 1 -- 172.21.15.55:0/975682610 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318c003600 con 0x7f319006c3b0 2023-08-25T04:02:54.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.987+0000 7f31857fa640 1 -- 172.21.15.55:0/975682610 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c0039b0 con 0x7f319006c3b0 2023-08-25T04:02:54.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.987+0000 7f3197093640 1 -- 172.21.15.55:0/975682610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319015d720 con 0x7f319006c3b0 2023-08-25T04:02:54.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.987+0000 7f3197093640 1 -- 172.21.15.55:0/975682610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319015dce0 con 0x7f319006c3b0 2023-08-25T04:02:54.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.987+0000 7f3197093640 1 -- 172.21.15.55:0/975682610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319015ded0 con 0x7f319006c3b0 2023-08-25T04:02:54.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.987+0000 7f31857fa640 1 -- 172.21.15.55:0/975682610 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f318c003b10 con 0x7f319006c3b0 2023-08-25T04:02:54.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.987+0000 7f31857fa640 1 --2- 172.21.15.55:0/975682610 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f317c065680 0x7f317c067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:54.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.987+0000 7f31857fa640 1 -- 172.21.15.55:0/975682610 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f318c081ee0 con 0x7f319006c3b0 2023-08-25T04:02:54.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.991+0000 7f3187fff640 1 --2- 172.21.15.55:0/975682610 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f317c065680 0x7f317c067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:54.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.991+0000 7f3187fff640 1 --2- 172.21.15.55:0/975682610 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f317c065680 0x7f317c067b40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f31800079c0 tx=0x7f3180008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:54.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:53.995+0000 7f31857fa640 1 -- 172.21.15.55:0/975682610 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f318c0538f0 con 0x7f319006c3b0 2023-08-25T04:02:54.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.155+0000 7f3197093640 1 -- 172.21.15.55:0/975682610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f3190073ec0 con 0x7f319006c3b0 2023-08-25T04:02:54.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.647+0000 7f31857fa640 1 -- 172.21.15.55:0/975682610 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f318c017020 con 0x7f319006c3b0 2023-08-25T04:02:54.649 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'rbd' created 2023-08-25T04:02:54.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.651+0000 7f3197093640 1 -- 172.21.15.55:0/975682610 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f317c065680 msgr2=0x7f317c067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:54.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.651+0000 7f3197093640 1 --2- 172.21.15.55:0/975682610 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f317c065680 0x7f317c067b40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f31800079c0 tx=0x7f3180008040 comp rx=0 tx=0).stop 2023-08-25T04:02:54.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.651+0000 7f3197093640 1 -- 172.21.15.55:0/975682610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f319006c3b0 msgr2=0x7f31900c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:54.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.651+0000 7f3197093640 1 --2- 172.21.15.55:0/975682610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f319006c3b0 0x7f31900c68d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f318c00c450 tx=0x7f318c00c910 comp rx=0 tx=0).stop 2023-08-25T04:02:54.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.651+0000 7f3197093640 1 -- 172.21.15.55:0/975682610 shutdown_connections 2023-08-25T04:02:54.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.651+0000 7f3197093640 1 --2- 172.21.15.55:0/975682610 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f317c065680 0x7f317c067b40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:54.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.651+0000 7f3197093640 1 --2- 172.21.15.55:0/975682610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f319006e5a0 0x7f3190158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:54.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.651+0000 7f3197093640 1 --2- 172.21.15.55:0/975682610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f319006c790 0x7f319015e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:54.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.651+0000 7f3197093640 1 --2- 172.21.15.55:0/975682610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f319006c3b0 0x7f31900c68d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:54.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.651+0000 7f3197093640 1 -- 172.21.15.55:0/975682610 >> 172.21.15.55:0/975682610 conn(0x7f31900d0540 msgr2=0x7f31900d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:54.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.651+0000 7f3197093640 1 -- 172.21.15.55:0/975682610 shutdown_connections 2023-08-25T04:02:54.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.651+0000 7f3197093640 1 -- 172.21.15.55:0/975682610 wait complete. 2023-08-25T04:02:54.675 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-08-25T04:02:54.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.823+0000 7fcf00759640 1 Processor -- start 2023-08-25T04:02:54.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.823+0000 7fcf00759640 1 -- start start 2023-08-25T04:02:54.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.827+0000 7fcf00759640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcef815cb40 0x7fcef80d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:54.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.827+0000 7fcf00759640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef80d1970 con 0x7fcef80cf340 2023-08-25T04:02:54.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.827+0000 7fcf00759640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef80d0d80 con 0x7fcef80b59f0 2023-08-25T04:02:54.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.827+0000 7fcf00759640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80d1040 con 0x7fcef815cb40 2023-08-25T04:02:54.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.827+0000 7fcefdcf4640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcef80cf340 0x7fcef80cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58904/0 (socket says 172.21.15.55:58904) 2023-08-25T04:02:54.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.827+0000 7fcefdcf4640 1 -- 172.21.15.55:0/819442479 learned_addr learned my addr 172.21.15.55:0/819442479 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:02:54.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.827+0000 7fcefe4f5640 1 --2- 172.21.15.55:0/819442479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcef815cb40 0x7fcef80d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:54.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.827+0000 7fcefd4f3640 1 -- 172.21.15.55:0/819442479 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111982972 0 0) 0x7fcef80d1970 con 0x7fcef80cf340 2023-08-25T04:02:54.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.827+0000 7fcefd4f3640 1 -- 172.21.15.55:0/819442479 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcee4003530 con 0x7fcef80cf340 2023-08-25T04:02:54.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.827+0000 7fcefd4f3640 1 -- 172.21.15.55:0/819442479 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627999564 0 0) 0x7fcef80d0d80 con 0x7fcef80b59f0 2023-08-25T04:02:54.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.827+0000 7fcefe4f5640 1 -- 172.21.15.55:0/819442479 >> v1:172.21.15.110:6789/0 conn(0x7fcef80b59f0 legacy=0x7fcef80b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:54.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.827+0000 7fcefe4f5640 1 -- 172.21.15.55:0/819442479 >> v1:172.21.15.55:6789/0 conn(0x7fcef80cf340 legacy=0x7fcef80cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:54.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.827+0000 7fcefe4f5640 1 -- 172.21.15.55:0/819442479 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef80d1320 con 0x7fcef815cb40 2023-08-25T04:02:54.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcefe4f5640 1 --2- 172.21.15.55:0/819442479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcef815cb40 0x7fcef80d2080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcef40097f0 tx=0x7fcef401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=443b95a536cdfd48 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:54.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcefd4f3640 1 -- 172.21.15.55:0/819442479 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef40a89b0 con 0x7fcef815cb40 2023-08-25T04:02:54.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcefd4f3640 1 -- 172.21.15.55:0/819442479 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef40a8b10 con 0x7fcef815cb40 2023-08-25T04:02:54.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcefd4f3640 1 -- 172.21.15.55:0/819442479 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef40a8ea0 con 0x7fcef815cb40 2023-08-25T04:02:54.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcf00759640 1 -- 172.21.15.55:0/819442479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcef815cb40 msgr2=0x7fcef80d2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:54.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcf00759640 1 --2- 172.21.15.55:0/819442479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcef815cb40 0x7fcef80d2080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcef40097f0 tx=0x7fcef401ecb0 comp rx=0 tx=0).stop 2023-08-25T04:02:54.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcf00759640 1 -- 172.21.15.55:0/819442479 shutdown_connections 2023-08-25T04:02:54.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcf00759640 1 --2- 172.21.15.55:0/819442479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcef815cb40 0x7fcef80d2080 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:54.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcf00759640 1 -- 172.21.15.55:0/819442479 >> 172.21.15.55:0/819442479 conn(0x7fcef806aae0 msgr2=0x7fcef806aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:54.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcf00759640 1 -- 172.21.15.55:0/819442479 shutdown_connections 2023-08-25T04:02:54.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcf00759640 1 -- 172.21.15.55:0/819442479 wait complete. 2023-08-25T04:02:54.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcf00759640 1 Processor -- start 2023-08-25T04:02:54.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcf00759640 1 -- start start 2023-08-25T04:02:54.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcf00759640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcef80b59f0 0x7fcef815c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:54.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcf00759640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcef80cf340 0x7fcef815ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:54.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcf00759640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcef815cb40 0x7fcef81f2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:54.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcf00759640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80b4590 con 0x7fcef80b59f0 2023-08-25T04:02:54.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcf00759640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80c76b0 con 0x7fcef80cf340 2023-08-25T04:02:54.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.831+0000 7fcf00759640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef81f2e60 con 0x7fcef815cb40 2023-08-25T04:02:54.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fcefe4f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcef80b59f0 0x7fcef815c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:54.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fcefe4f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcef80b59f0 0x7fcef815c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48640/0 (socket says 172.21.15.55:48640) 2023-08-25T04:02:54.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fcefe4f5640 1 -- 172.21.15.55:0/1260712786 learned_addr learned my addr 172.21.15.55:0/1260712786 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:54.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fcefdcf4640 1 --2- 172.21.15.55:0/1260712786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcef80cf340 0x7fcef815ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:54.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fcefecf6640 1 --2- 172.21.15.55:0/1260712786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcef815cb40 0x7fcef81f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:54.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fcefe4f5640 1 -- 172.21.15.55:0/1260712786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcef815cb40 msgr2=0x7fcef81f2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:54.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fcefe4f5640 1 --2- 172.21.15.55:0/1260712786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcef815cb40 0x7fcef81f2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:54.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fcefe4f5640 1 -- 172.21.15.55:0/1260712786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcef80cf340 msgr2=0x7fcef815ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:54.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fcefe4f5640 1 --2- 172.21.15.55:0/1260712786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcef80cf340 0x7fcef815ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:54.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fcefe4f5640 1 -- 172.21.15.55:0/1260712786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef4009420 con 0x7fcef80b59f0 2023-08-25T04:02:54.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fcefdcf4640 1 --2- 172.21.15.55:0/1260712786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcef80cf340 0x7fcef815ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:02:54.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fcefe4f5640 1 --2- 172.21.15.55:0/1260712786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcef80b59f0 0x7fcef815c060 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009740 tx=0x7fcef401ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:54.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fceeeffd640 1 -- 172.21.15.55:0/1260712786 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef40bf070 con 0x7fcef80b59f0 2023-08-25T04:02:54.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fceeeffd640 1 -- 172.21.15.55:0/1260712786 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef40b0bf0 con 0x7fcef80b59f0 2023-08-25T04:02:54.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fceeeffd640 1 -- 172.21.15.55:0/1260712786 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef40b9410 con 0x7fcef80b59f0 2023-08-25T04:02:54.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fcf00759640 1 -- 172.21.15.55:0/1260712786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef80b47e0 con 0x7fcef80b59f0 2023-08-25T04:02:54.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fcf00759640 1 -- 172.21.15.55:0/1260712786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef80c7900 con 0x7fcef80b59f0 2023-08-25T04:02:54.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fcf00759640 1 -- 172.21.15.55:0/1260712786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef8071f80 con 0x7fcef80b59f0 2023-08-25T04:02:54.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fceeeffd640 1 -- 172.21.15.55:0/1260712786 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fcef40b7040 con 0x7fcef80b59f0 2023-08-25T04:02:54.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.835+0000 7fceeeffd640 1 --2- 172.21.15.55:0/1260712786 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcedc065680 0x7fcedc067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:54.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.839+0000 7fceeeffd640 1 -- 172.21.15.55:0/1260712786 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fcef411fdd0 con 0x7fcef80b59f0 2023-08-25T04:02:54.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.839+0000 7fcefdcf4640 1 --2- 172.21.15.55:0/1260712786 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcedc065680 0x7fcedc067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:54.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.839+0000 7fcefdcf4640 1 --2- 172.21.15.55:0/1260712786 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcedc065680 0x7fcedc067b40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcef80b3eb0 tx=0x7fcee8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:54.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.843+0000 7fceeeffd640 1 -- 172.21.15.55:0/1260712786 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fcef40edb50 con 0x7fcef80b59f0 2023-08-25T04:02:55.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:54.999+0000 7fcf00759640 1 -- 172.21.15.55:0/1260712786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcef804dbe0 con 0x7fcef80b59f0 2023-08-25T04:02:55.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.651+0000 7fceeeffd640 1 -- 172.21.15.55:0/1260712786 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7fcef40b5020 con 0x7fcef80b59f0 2023-08-25T04:02:55.653 INFO:teuthology.orchestra.run.smithi055.stderr:enabled application 'rbd' on pool 'rbd' 2023-08-25T04:02:55.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.655+0000 7fcf00759640 1 -- 172.21.15.55:0/1260712786 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcedc065680 msgr2=0x7fcedc067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:55.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.655+0000 7fcf00759640 1 --2- 172.21.15.55:0/1260712786 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcedc065680 0x7fcedc067b40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcef80b3eb0 tx=0x7fcee8009040 comp rx=0 tx=0).stop 2023-08-25T04:02:55.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.655+0000 7fcf00759640 1 -- 172.21.15.55:0/1260712786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcef80b59f0 msgr2=0x7fcef815c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:55.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.655+0000 7fcf00759640 1 --2- 172.21.15.55:0/1260712786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcef80b59f0 0x7fcef815c060 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009740 tx=0x7fcef401ba50 comp rx=0 tx=0).stop 2023-08-25T04:02:55.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.655+0000 7fcf00759640 1 -- 172.21.15.55:0/1260712786 shutdown_connections 2023-08-25T04:02:55.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.655+0000 7fcf00759640 1 --2- 172.21.15.55:0/1260712786 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcedc065680 0x7fcedc067b40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:55.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.655+0000 7fcf00759640 1 --2- 172.21.15.55:0/1260712786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcef815cb40 0x7fcef81f2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:55.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.655+0000 7fcf00759640 1 --2- 172.21.15.55:0/1260712786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcef80cf340 0x7fcef815ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:55.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.655+0000 7fcf00759640 1 --2- 172.21.15.55:0/1260712786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcef80b59f0 0x7fcef815c060 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:55.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.655+0000 7fcf00759640 1 -- 172.21.15.55:0/1260712786 >> 172.21.15.55:0/1260712786 conn(0x7fcef806aae0 msgr2=0x7fcef81e6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:55.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.655+0000 7fcf00759640 1 -- 172.21.15.55:0/1260712786 shutdown_connections 2023-08-25T04:02:55.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.655+0000 7fcf00759640 1 -- 172.21.15.55:0/1260712786 wait complete. 2023-08-25T04:02:55.680 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-25T04:02:55.681 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-25T04:02:55.681 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-25T04:02:55.684 INFO:tasks.ceph.mds.a:Started 2023-08-25T04:02:55.685 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-25T04:02:55.685 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-25T04:02:55.689 INFO:tasks.ceph.mds.c:Started 2023-08-25T04:02:55.689 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-25T04:02:55.689 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-25T04:02:55.694 INFO:tasks.ceph.mds.b:Started 2023-08-25T04:02:55.695 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-25T04:02:55.695 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-25T04:02:55.699 INFO:tasks.ceph.mds.d:Started 2023-08-25T04:02:55.700 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-25T04:02:55.701 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:02:55.791 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-08-25T04:02:55.792 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T04:02:55.797 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2023-08-25T04:02:55.798 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2023-08-25T04:02:55.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.859+0000 7f47add96640 1 Processor -- start 2023-08-25T04:02:55.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.859+0000 7f47add96640 1 -- start start 2023-08-25T04:02:55.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.859+0000 7f47add96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47a80d0da0 0x7f47a80d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:55.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.859+0000 7f47add96640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a80b3e50 0x7f47a80ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:55.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.859+0000 7f47add96640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a80b29b0 con 0x7f47a80cdde0 2023-08-25T04:02:55.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.859+0000 7f47add96640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a80ce760 con 0x7f47a80d0da0 2023-08-25T04:02:55.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.859+0000 7f47add96640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80d16c0 con 0x7f47a80b3e50 2023-08-25T04:02:55.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.859+0000 7f47a77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47a80d0da0 0x7f47a80d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:55.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.859+0000 7f47a6ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f47a80cdde0 0x7f47a80cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58926/0 (socket says 172.21.15.55:58926) 2023-08-25T04:02:55.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.859+0000 7f47a6ffd640 1 -- 172.21.15.55:0/2589039430 learned_addr learned my addr 172.21.15.55:0/2589039430 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:02:55.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.859+0000 7f47a7fff640 1 --2- 172.21.15.55:0/2589039430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a80b3e50 0x7f47a80ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:55.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.859+0000 7f47a77fe640 1 -- 172.21.15.55:0/2589039430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a80b3e50 msgr2=0x7f47a80ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:55.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.859+0000 7f47a77fe640 1 --2- 172.21.15.55:0/2589039430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a80b3e50 0x7f47a80ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:55.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.859+0000 7f47a77fe640 1 -- 172.21.15.55:0/2589039430 >> v1:172.21.15.55:6789/0 conn(0x7f47a80cdde0 legacy=0x7f47a80cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:55.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.859+0000 7f47a77fe640 1 -- 172.21.15.55:0/2589039430 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a80b1dc0 con 0x7f47a80d0da0 2023-08-25T04:02:55.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.859+0000 7f47a67fc640 1 -- 172.21.15.55:0/2589039430 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095724165 0 0) 0x7f47a80b29b0 con 0x7f47a80cdde0 2023-08-25T04:02:55.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.863+0000 7f47a77fe640 1 --2- 172.21.15.55:0/2589039430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47a80d0da0 0x7f47a80d1180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f47980097b0 tx=0x7f479801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f933f1169d664768 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:55.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.863+0000 7f47a67fc640 1 -- 172.21.15.55:0/2589039430 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47980a8970 con 0x7f47a80d0da0 2023-08-25T04:02:55.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.863+0000 7f47a67fc640 1 -- 172.21.15.55:0/2589039430 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47980a8ad0 con 0x7f47a80d0da0 2023-08-25T04:02:55.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.863+0000 7f47a67fc640 1 -- 172.21.15.55:0/2589039430 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47980a8e60 con 0x7f47a80d0da0 2023-08-25T04:02:55.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.863+0000 7f47add96640 1 -- 172.21.15.55:0/2589039430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47a80d0da0 msgr2=0x7f47a80d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:55.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.863+0000 7f47add96640 1 --2- 172.21.15.55:0/2589039430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47a80d0da0 0x7f47a80d1180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f47980097b0 tx=0x7f479801ec70 comp rx=0 tx=0).stop 2023-08-25T04:02:55.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.863+0000 7f47add96640 1 -- 172.21.15.55:0/2589039430 shutdown_connections 2023-08-25T04:02:55.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.863+0000 7f47add96640 1 --2- 172.21.15.55:0/2589039430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a80b3e50 0x7f47a80ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:55.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.863+0000 7f47add96640 1 --2- 172.21.15.55:0/2589039430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47a80d0da0 0x7f47a80d1180 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:55.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.863+0000 7f47add96640 1 -- 172.21.15.55:0/2589039430 >> 172.21.15.55:0/2589039430 conn(0x7f47a809bae0 msgr2=0x7f47a80d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:55.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.863+0000 7f47add96640 1 -- 172.21.15.55:0/2589039430 shutdown_connections 2023-08-25T04:02:55.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.863+0000 7f47add96640 1 -- 172.21.15.55:0/2589039430 wait complete. 2023-08-25T04:02:55.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47add96640 1 Processor -- start 2023-08-25T04:02:55.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47add96640 1 -- start start 2023-08-25T04:02:55.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47add96640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a80b3e50 0x7f47a80c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:55.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47add96640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47a80cdde0 0x7f47a8152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:55.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47add96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47a80d0da0 0x7f47a8153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:55.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47add96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a8155320 con 0x7f47a80d0da0 2023-08-25T04:02:55.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47add96640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a81525a0 con 0x7f47a80cdde0 2023-08-25T04:02:55.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47add96640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a81546a0 con 0x7f47a80b3e50 2023-08-25T04:02:55.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47a7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47a80d0da0 0x7f47a8153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:55.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47a7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47a80d0da0 0x7f47a8153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48674/0 (socket says 172.21.15.55:48674) 2023-08-25T04:02:55.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47a7fff640 1 -- 172.21.15.55:0/792714889 learned_addr learned my addr 172.21.15.55:0/792714889 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:55.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47a77fe640 1 --2- 172.21.15.55:0/792714889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a80b3e50 0x7f47a80c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:55.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47a6ffd640 1 --2- 172.21.15.55:0/792714889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47a80cdde0 0x7f47a8152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:55.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47a7fff640 1 -- 172.21.15.55:0/792714889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a80b3e50 msgr2=0x7f47a80c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:55.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47a7fff640 1 --2- 172.21.15.55:0/792714889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a80b3e50 0x7f47a80c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:55.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47a7fff640 1 -- 172.21.15.55:0/792714889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47a80cdde0 msgr2=0x7f47a8152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:55.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47a7fff640 1 --2- 172.21.15.55:0/792714889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47a80cdde0 0x7f47a8152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:55.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47a7fff640 1 -- 172.21.15.55:0/792714889 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47980093c0 con 0x7f47a80d0da0 2023-08-25T04:02:55.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47a6ffd640 1 --2- 172.21.15.55:0/792714889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47a80cdde0 0x7f47a8152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:02:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47a7fff640 1 --2- 172.21.15.55:0/792714889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47a80d0da0 0x7f47a8153e30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f47a000ef90 tx=0x7f47a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f478ffff640 1 -- 172.21.15.55:0/792714889 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0009b20 con 0x7f47a80d0da0 2023-08-25T04:02:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f478ffff640 1 -- 172.21.15.55:0/792714889 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a000f040 con 0x7f47a80d0da0 2023-08-25T04:02:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f478ffff640 1 -- 172.21.15.55:0/792714889 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a00146c0 con 0x7f47a80d0da0 2023-08-25T04:02:55.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47add96640 1 -- 172.21.15.55:0/792714889 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a8154980 con 0x7f47a80d0da0 2023-08-25T04:02:55.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.867+0000 7f47add96640 1 -- 172.21.15.55:0/792714889 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a8154f40 con 0x7f47a80d0da0 2023-08-25T04:02:55.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.871+0000 7f47add96640 1 -- 172.21.15.55:0/792714889 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a8155460 con 0x7f47a80d0da0 2023-08-25T04:02:55.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.871+0000 7f478ffff640 1 -- 172.21.15.55:0/792714889 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f47a0014820 con 0x7f47a80d0da0 2023-08-25T04:02:55.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.871+0000 7f478ffff640 1 --2- 172.21.15.55:0/792714889 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f47940656b0 0x7f4794067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:55.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.871+0000 7f478ffff640 1 -- 172.21.15.55:0/792714889 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f47a0083700 con 0x7f47a80d0da0 2023-08-25T04:02:55.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.871+0000 7f47a77fe640 1 --2- 172.21.15.55:0/792714889 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f47940656b0 0x7f4794067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:55.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.871+0000 7f47a77fe640 1 --2- 172.21.15.55:0/792714889 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f47940656b0 0x7f4794067b70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f47980b2000 tx=0x7f4798008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:55.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:55.875+0000 7f478ffff640 1 -- 172.21.15.55:0/792714889 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f47a8155460 con 0x7f47a80d0da0 2023-08-25T04:02:56.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.031+0000 7f47add96640 1 -- 172.21.15.55:0/792714889 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47a8155460 con 0x7f47a80d0da0 2023-08-25T04:02:56.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.031+0000 7f478ffff640 1 -- 172.21.15.55:0/792714889 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14661 (secure 0 0 0) 0x7f47a8155460 con 0x7f47a80d0da0 2023-08-25T04:02:56.035 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:02:56.036 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:02:55.645656+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:02:56.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.035+0000 7f47add96640 1 -- 172.21.15.55:0/792714889 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f47940656b0 msgr2=0x7f4794067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.035+0000 7f47add96640 1 --2- 172.21.15.55:0/792714889 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f47940656b0 0x7f4794067b70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f47980b2000 tx=0x7f4798008040 comp rx=0 tx=0).stop 2023-08-25T04:02:56.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.035+0000 7f47add96640 1 -- 172.21.15.55:0/792714889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47a80d0da0 msgr2=0x7f47a8153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.035+0000 7f47add96640 1 --2- 172.21.15.55:0/792714889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47a80d0da0 0x7f47a8153e30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f47a000ef90 tx=0x7f47a000c490 comp rx=0 tx=0).stop 2023-08-25T04:02:56.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.035+0000 7f47add96640 1 -- 172.21.15.55:0/792714889 shutdown_connections 2023-08-25T04:02:56.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.035+0000 7f47add96640 1 --2- 172.21.15.55:0/792714889 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f47940656b0 0x7f4794067b70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.035+0000 7f47add96640 1 --2- 172.21.15.55:0/792714889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47a80d0da0 0x7f47a8153e30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.035+0000 7f47add96640 1 --2- 172.21.15.55:0/792714889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47a80cdde0 0x7f47a8152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.035+0000 7f47add96640 1 --2- 172.21.15.55:0/792714889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a80b3e50 0x7f47a80c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.035+0000 7f47add96640 1 -- 172.21.15.55:0/792714889 >> 172.21.15.55:0/792714889 conn(0x7f47a809bae0 msgr2=0x7f47a806b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:56.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.035+0000 7f47add96640 1 -- 172.21.15.55:0/792714889 shutdown_connections 2023-08-25T04:02:56.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.035+0000 7f47add96640 1 -- 172.21.15.55:0/792714889 wait complete. 2023-08-25T04:02:56.057 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:02:56.058 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:02:56.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.199+0000 7fcfeda34640 1 Processor -- start 2023-08-25T04:02:56.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.199+0000 7fcfeda34640 1 -- start start 2023-08-25T04:02:56.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.203+0000 7fcfeda34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcfe81601f0 0x7fcfe815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:56.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.203+0000 7fcfeda34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfe80d1290 0x7fcfe815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:56.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.203+0000 7fcfeda34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe80cd5a0 con 0x7fcfe815e3c0 2023-08-25T04:02:56.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.203+0000 7fcfeda34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe80cd880 con 0x7fcfe81601f0 2023-08-25T04:02:56.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.203+0000 7fcfeda34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe80cdb60 con 0x7fcfe80d1290 2023-08-25T04:02:56.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.203+0000 7fcfe6ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcfe81601f0 0x7fcfe815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:56.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.203+0000 7fcfdffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcfe815e3c0 0x7fcfe80d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58938/0 (socket says 172.21.15.55:58938) 2023-08-25T04:02:56.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.203+0000 7fcfdffff640 1 -- 172.21.15.55:0/142670710 learned_addr learned my addr 172.21.15.55:0/142670710 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:02:56.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.203+0000 7fcfe77fe640 1 --2- 172.21.15.55:0/142670710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfe80d1290 0x7fcfe815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:56.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.203+0000 7fcfe6ffd640 1 -- 172.21.15.55:0/142670710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfe80d1290 msgr2=0x7fcfe815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:56.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.203+0000 7fcfe6ffd640 1 --2- 172.21.15.55:0/142670710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfe80d1290 0x7fcfe815e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.203+0000 7fcfe6ffd640 1 -- 172.21.15.55:0/142670710 >> v1:172.21.15.55:6789/0 conn(0x7fcfe815e3c0 legacy=0x7fcfe80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.203+0000 7fcfe6ffd640 1 -- 172.21.15.55:0/142670710 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe80cde40 con 0x7fcfe81601f0 2023-08-25T04:02:56.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.203+0000 7fcfe67fc640 1 -- 172.21.15.55:0/142670710 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277239054 0 0) 0x7fcfe80cd5a0 con 0x7fcfe815e3c0 2023-08-25T04:02:56.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.207+0000 7fcfe6ffd640 1 --2- 172.21.15.55:0/142670710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfe81601f0 0x7fcfe815d430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80097a0 tx=0x7fcfd801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a79338c8c6b1f1a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:56.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.207+0000 7fcfe67fc640 1 -- 172.21.15.55:0/142670710 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80a8950 con 0x7fcfe81601f0 2023-08-25T04:02:56.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.207+0000 7fcfe67fc640 1 -- 172.21.15.55:0/142670710 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd80a8ab0 con 0x7fcfe81601f0 2023-08-25T04:02:56.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.207+0000 7fcfe67fc640 1 -- 172.21.15.55:0/142670710 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80a8e40 con 0x7fcfe81601f0 2023-08-25T04:02:56.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.207+0000 7fcfeda34640 1 -- 172.21.15.55:0/142670710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfe81601f0 msgr2=0x7fcfe815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.207+0000 7fcfeda34640 1 --2- 172.21.15.55:0/142670710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfe81601f0 0x7fcfe815d430 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80097a0 tx=0x7fcfd801ec50 comp rx=0 tx=0).stop 2023-08-25T04:02:56.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.207+0000 7fcfeda34640 1 -- 172.21.15.55:0/142670710 shutdown_connections 2023-08-25T04:02:56.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.207+0000 7fcfeda34640 1 --2- 172.21.15.55:0/142670710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfe80d1290 0x7fcfe815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.207+0000 7fcfeda34640 1 --2- 172.21.15.55:0/142670710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfe81601f0 0x7fcfe815d430 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.207+0000 7fcfeda34640 1 -- 172.21.15.55:0/142670710 >> 172.21.15.55:0/142670710 conn(0x7fcfe80d27d0 msgr2=0x7fcfe80d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:56.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.207+0000 7fcfeda34640 1 -- 172.21.15.55:0/142670710 shutdown_connections 2023-08-25T04:02:56.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.207+0000 7fcfeda34640 1 -- 172.21.15.55:0/142670710 wait complete. 2023-08-25T04:02:56.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.207+0000 7fcfeda34640 1 Processor -- start 2023-08-25T04:02:56.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.207+0000 7fcfeda34640 1 -- start start 2023-08-25T04:02:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfeda34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfe80d1290 0x7fcfe80c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfeda34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe815e3c0 0x7fcfe80c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfeda34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfe81601f0 0x7fcfe81573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfeda34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe80cc3b0 con 0x7fcfe80d1290 2023-08-25T04:02:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfeda34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe80cb310 con 0x7fcfe815e3c0 2023-08-25T04:02:56.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfeda34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe80cb5f0 con 0x7fcfe81601f0 2023-08-25T04:02:56.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfe6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfe80d1290 0x7fcfe80c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:56.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfe6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfe80d1290 0x7fcfe80c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48690/0 (socket says 172.21.15.55:48690) 2023-08-25T04:02:56.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfe6ffd640 1 -- 172.21.15.55:0/89633457 learned_addr learned my addr 172.21.15.55:0/89633457 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:56.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfe77fe640 1 --2- 172.21.15.55:0/89633457 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfe81601f0 0x7fcfe81573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:56.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfdffff640 1 --2- 172.21.15.55:0/89633457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe815e3c0 0x7fcfe80c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:56.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfe6ffd640 1 -- 172.21.15.55:0/89633457 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfe81601f0 msgr2=0x7fcfe81573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfe6ffd640 1 --2- 172.21.15.55:0/89633457 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfe81601f0 0x7fcfe81573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfe6ffd640 1 -- 172.21.15.55:0/89633457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe815e3c0 msgr2=0x7fcfe80c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfe6ffd640 1 --2- 172.21.15.55:0/89633457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe815e3c0 0x7fcfe80c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfe6ffd640 1 -- 172.21.15.55:0/89633457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd80093b0 con 0x7fcfe80d1290 2023-08-25T04:02:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfe77fe640 1 --2- 172.21.15.55:0/89633457 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfe81601f0 0x7fcfe81573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:02:56.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfe6ffd640 1 --2- 172.21.15.55:0/89633457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfe80d1290 0x7fcfe80c8740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80b3040 tx=0x7fcfd801b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:56.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfe4ff9640 1 -- 172.21.15.55:0/89633457 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80b0dd0 con 0x7fcfe80d1290 2023-08-25T04:02:56.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfe4ff9640 1 -- 172.21.15.55:0/89633457 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd80b9430 con 0x7fcfe80d1290 2023-08-25T04:02:56.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfeda34640 1 -- 172.21.15.55:0/89633457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe80cb8d0 con 0x7fcfe80d1290 2023-08-25T04:02:56.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfe4ff9640 1 -- 172.21.15.55:0/89633457 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80b97e0 con 0x7fcfe80d1290 2023-08-25T04:02:56.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfeda34640 1 -- 172.21.15.55:0/89633457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe80cbe90 con 0x7fcfe80d1290 2023-08-25T04:02:56.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfeda34640 1 -- 172.21.15.55:0/89633457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe80b5260 con 0x7fcfe80d1290 2023-08-25T04:02:56.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.211+0000 7fcfe4ff9640 1 -- 172.21.15.55:0/89633457 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fcfd80b7040 con 0x7fcfe80d1290 2023-08-25T04:02:56.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.215+0000 7fcfe4ff9640 1 --2- 172.21.15.55:0/89633457 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcfc8065680 0x7fcfc8067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:56.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.215+0000 7fcfe4ff9640 1 -- 172.21.15.55:0/89633457 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcfd8120410 con 0x7fcfe80d1290 2023-08-25T04:02:56.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.215+0000 7fcfdffff640 1 --2- 172.21.15.55:0/89633457 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcfc8065680 0x7fcfc8067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:56.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.215+0000 7fcfdffff640 1 --2- 172.21.15.55:0/89633457 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcfc8065680 0x7fcfc8067b40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcfe81f58f0 tx=0x7fcfd0007b60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:56.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.219+0000 7fcfe4ff9640 1 -- 172.21.15.55:0/89633457 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fcfd80ee180 con 0x7fcfe80d1290 2023-08-25T04:02:56.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.375+0000 7fcfeda34640 1 -- 172.21.15.55:0/89633457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcfe8073ec0 con 0x7fcfe80d1290 2023-08-25T04:02:56.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.375+0000 7fcfe4ff9640 1 -- 172.21.15.55:0/89633457 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcfd80f5e60 con 0x7fcfe80d1290 2023-08-25T04:02:56.377 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:02:56.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.375+0000 7fcfeda34640 1 -- 172.21.15.55:0/89633457 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcfc8065680 msgr2=0x7fcfc8067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.375+0000 7fcfeda34640 1 --2- 172.21.15.55:0/89633457 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcfc8065680 0x7fcfc8067b40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcfe81f58f0 tx=0x7fcfd0007b60 comp rx=0 tx=0).stop 2023-08-25T04:02:56.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.375+0000 7fcfeda34640 1 -- 172.21.15.55:0/89633457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfe80d1290 msgr2=0x7fcfe80c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.375+0000 7fcfeda34640 1 --2- 172.21.15.55:0/89633457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfe80d1290 0x7fcfe80c8740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80b3040 tx=0x7fcfd801b9f0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.375+0000 7fcfeda34640 1 -- 172.21.15.55:0/89633457 shutdown_connections 2023-08-25T04:02:56.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.375+0000 7fcfeda34640 1 --2- 172.21.15.55:0/89633457 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcfc8065680 0x7fcfc8067b40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.375+0000 7fcfeda34640 1 --2- 172.21.15.55:0/89633457 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfe81601f0 0x7fcfe81573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.375+0000 7fcfeda34640 1 --2- 172.21.15.55:0/89633457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfe815e3c0 0x7fcfe80c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.375+0000 7fcfeda34640 1 --2- 172.21.15.55:0/89633457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfe80d1290 0x7fcfe80c8740 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.375+0000 7fcfeda34640 1 -- 172.21.15.55:0/89633457 >> 172.21.15.55:0/89633457 conn(0x7fcfe80d27d0 msgr2=0x7fcfe815dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:56.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.375+0000 7fcfeda34640 1 -- 172.21.15.55:0/89633457 shutdown_connections 2023-08-25T04:02:56.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.375+0000 7fcfeda34640 1 -- 172.21.15.55:0/89633457 wait complete. 2023-08-25T04:02:56.398 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:02:56.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.543+0000 7f366ce19640 1 Processor -- start 2023-08-25T04:02:56.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.543+0000 7f366ce19640 1 -- start start 2023-08-25T04:02:56.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.543+0000 7f366ce19640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f366815ca30 0x7f36680cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:56.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.543+0000 7f366ce19640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36680cd340 con 0x7f36680ce610 2023-08-25T04:02:56.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.543+0000 7f366ce19640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36680ce180 con 0x7f36680d1520 2023-08-25T04:02:56.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.543+0000 7f366ce19640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36680cd570 con 0x7f366815ca30 2023-08-25T04:02:56.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.543+0000 7f366659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f366815ca30 0x7f36680cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:56.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.543+0000 7f366659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f366815ca30 0x7f36680cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48704/0 (socket says 172.21.15.55:48704) 2023-08-25T04:02:56.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.543+0000 7f365dd9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f36680ce610 0x7f36680d0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58940/0 (socket says 172.21.15.55:58940) 2023-08-25T04:02:56.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.543+0000 7f366659c640 1 -- 172.21.15.55:0/2881126886 learned_addr learned my addr 172.21.15.55:0/2881126886 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:56.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.543+0000 7f366659c640 1 -- 172.21.15.55:0/2881126886 >> v1:172.21.15.110:6789/0 conn(0x7f36680d1520 legacy=0x7f366806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:56.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.543+0000 7f3665d9b640 1 -- 172.21.15.55:0/2881126886 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940153324 0 0) 0x7f36680cd340 con 0x7f36680ce610 2023-08-25T04:02:56.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.543+0000 7f366659c640 1 -- 172.21.15.55:0/2881126886 >> v1:172.21.15.55:6789/0 conn(0x7f36680ce610 legacy=0x7f36680d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.543+0000 7f366659c640 1 -- 172.21.15.55:0/2881126886 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36680cd850 con 0x7f366815ca30 2023-08-25T04:02:56.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.547+0000 7f366659c640 1 --2- 172.21.15.55:0/2881126886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f366815ca30 0x7f36680cf190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3658009860 tx=0x7f365801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b980886164f41c27 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:56.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.547+0000 7f3665d9b640 1 -- 172.21.15.55:0/2881126886 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580ab600 con 0x7f366815ca30 2023-08-25T04:02:56.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.547+0000 7f3665d9b640 1 -- 172.21.15.55:0/2881126886 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36580ab760 con 0x7f366815ca30 2023-08-25T04:02:56.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.547+0000 7f3665d9b640 1 -- 172.21.15.55:0/2881126886 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580abaf0 con 0x7f366815ca30 2023-08-25T04:02:56.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.547+0000 7f366ce19640 1 -- 172.21.15.55:0/2881126886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f366815ca30 msgr2=0x7f36680cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.547+0000 7f366ce19640 1 --2- 172.21.15.55:0/2881126886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f366815ca30 0x7f36680cf190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3658009860 tx=0x7f365801c4f0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.547+0000 7f366ce19640 1 -- 172.21.15.55:0/2881126886 shutdown_connections 2023-08-25T04:02:56.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.547+0000 7f366ce19640 1 --2- 172.21.15.55:0/2881126886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f366815ca30 0x7f36680cf190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.547+0000 7f366ce19640 1 -- 172.21.15.55:0/2881126886 >> 172.21.15.55:0/2881126886 conn(0x7f366809bb30 msgr2=0x7f36680d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:56.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.547+0000 7f366ce19640 1 -- 172.21.15.55:0/2881126886 shutdown_connections 2023-08-25T04:02:56.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.547+0000 7f366ce19640 1 -- 172.21.15.55:0/2881126886 wait complete. 2023-08-25T04:02:56.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366ce19640 1 Processor -- start 2023-08-25T04:02:56.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366ce19640 1 -- start start 2023-08-25T04:02:56.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366ce19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36680ce610 0x7f36680b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:56.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366ce19640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36680d1520 0x7f36680cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:56.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366ce19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f366815ca30 0x7f366815e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:56.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366ce19640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36680b15c0 con 0x7f36680ce610 2023-08-25T04:02:56.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366ce19640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36680b4eb0 con 0x7f36680d1520 2023-08-25T04:02:56.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366ce19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3668148920 con 0x7f366815ca30 2023-08-25T04:02:56.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36680ce610 0x7f36680b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:56.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36680ce610 0x7f36680b4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48710/0 (socket says 172.21.15.55:48710) 2023-08-25T04:02:56.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366659c640 1 -- 172.21.15.55:0/2340422378 learned_addr learned my addr 172.21.15.55:0/2340422378 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:56.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f365dd9b640 1 --2- 172.21.15.55:0/2340422378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36680d1520 0x7f36680cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:56.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f3666d9d640 1 --2- 172.21.15.55:0/2340422378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f366815ca30 0x7f366815e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:56.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366659c640 1 -- 172.21.15.55:0/2340422378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f366815ca30 msgr2=0x7f366815e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366659c640 1 --2- 172.21.15.55:0/2340422378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f366815ca30 0x7f366815e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366659c640 1 -- 172.21.15.55:0/2340422378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36680d1520 msgr2=0x7f36680cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366659c640 1 --2- 172.21.15.55:0/2340422378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36680d1520 0x7f36680cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366659c640 1 -- 172.21.15.55:0/2340422378 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3658009470 con 0x7f36680ce610 2023-08-25T04:02:56.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f365dd9b640 1 --2- 172.21.15.55:0/2340422378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36680d1520 0x7f36680cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:02:56.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f3666d9d640 1 --2- 172.21.15.55:0/2340422378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f366815ca30 0x7f366815e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:02:56.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366659c640 1 --2- 172.21.15.55:0/2340422378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36680ce610 0x7f36680b4970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3658019100 tx=0x7f365801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:56.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f365f7fe640 1 -- 172.21.15.55:0/2340422378 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580b4800 con 0x7f36680ce610 2023-08-25T04:02:56.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f365f7fe640 1 -- 172.21.15.55:0/2340422378 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36580b4960 con 0x7f36680ce610 2023-08-25T04:02:56.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f365f7fe640 1 -- 172.21.15.55:0/2340422378 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580b4d10 con 0x7f36680ce610 2023-08-25T04:02:56.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366ce19640 1 -- 172.21.15.55:0/2340422378 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36680cbcb0 con 0x7f36680ce610 2023-08-25T04:02:56.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.551+0000 7f366ce19640 1 -- 172.21.15.55:0/2340422378 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3668148b70 con 0x7f36680ce610 2023-08-25T04:02:56.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.555+0000 7f366ce19640 1 -- 172.21.15.55:0/2340422378 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3668073ec0 con 0x7f36680ce610 2023-08-25T04:02:56.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.555+0000 7f365f7fe640 1 -- 172.21.15.55:0/2340422378 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f36580b3380 con 0x7f36680ce610 2023-08-25T04:02:56.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.555+0000 7f365f7fe640 1 --2- 172.21.15.55:0/2340422378 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f36480656b0 0x7f3648067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:56.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.555+0000 7f365f7fe640 1 -- 172.21.15.55:0/2340422378 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f365811d0a0 con 0x7f36680ce610 2023-08-25T04:02:56.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.555+0000 7f365dd9b640 1 --2- 172.21.15.55:0/2340422378 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f36480656b0 0x7f3648067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:56.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.555+0000 7f365dd9b640 1 --2- 172.21.15.55:0/2340422378 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f36480656b0 0x7f3648067b70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f366814b520 tx=0x7f3650009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:56.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.559+0000 7f365f7fe640 1 -- 172.21.15.55:0/2340422378 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f36580eaff0 con 0x7f36680ce610 2023-08-25T04:02:56.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.719+0000 7f366ce19640 1 -- 172.21.15.55:0/2340422378 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3668154080 con 0x7f36680ce610 2023-08-25T04:02:56.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.719+0000 7f365f7fe640 1 -- 172.21.15.55:0/2340422378 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f36580ee610 con 0x7f36680ce610 2023-08-25T04:02:56.722 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:02:56.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.719+0000 7f366ce19640 1 -- 172.21.15.55:0/2340422378 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f36480656b0 msgr2=0x7f3648067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.719+0000 7f366ce19640 1 --2- 172.21.15.55:0/2340422378 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f36480656b0 0x7f3648067b70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f366814b520 tx=0x7f3650009040 comp rx=0 tx=0).stop 2023-08-25T04:02:56.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.719+0000 7f366ce19640 1 -- 172.21.15.55:0/2340422378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36680ce610 msgr2=0x7f36680b4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.719+0000 7f366ce19640 1 --2- 172.21.15.55:0/2340422378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36680ce610 0x7f36680b4970 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3658019100 tx=0x7f365801ad30 comp rx=0 tx=0).stop 2023-08-25T04:02:56.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.719+0000 7f366ce19640 1 -- 172.21.15.55:0/2340422378 shutdown_connections 2023-08-25T04:02:56.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.719+0000 7f366ce19640 1 --2- 172.21.15.55:0/2340422378 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f36480656b0 0x7f3648067b70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.719+0000 7f366ce19640 1 --2- 172.21.15.55:0/2340422378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f366815ca30 0x7f366815e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.719+0000 7f366ce19640 1 --2- 172.21.15.55:0/2340422378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36680d1520 0x7f36680cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.719+0000 7f366ce19640 1 --2- 172.21.15.55:0/2340422378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36680ce610 0x7f36680b4970 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.719+0000 7f366ce19640 1 -- 172.21.15.55:0/2340422378 >> 172.21.15.55:0/2340422378 conn(0x7f366809bb30 msgr2=0x7f3668157000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.719+0000 7f366ce19640 1 -- 172.21.15.55:0/2340422378 shutdown_connections 2023-08-25T04:02:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.719+0000 7f366ce19640 1 -- 172.21.15.55:0/2340422378 wait complete. 2023-08-25T04:02:56.741 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:02:56.837 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:02:56.841 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:02:56.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.883+0000 7fb34872c640 1 Processor -- start 2023-08-25T04:02:56.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.887+0000 7fb34872c640 1 -- start start 2023-08-25T04:02:56.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.887+0000 7fb34872c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb3400c89f0 0x7fb3400cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:56.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.887+0000 7fb34872c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3400cc880 con 0x7fb3400ceeb0 2023-08-25T04:02:56.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.887+0000 7fb34872c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3400ccb60 con 0x7fb3400ad950 2023-08-25T04:02:56.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.887+0000 7fb34872c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3400b11f0 con 0x7fb3400c89f0 2023-08-25T04:02:56.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.887+0000 7fb345cc7640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb3400ceeb0 0x7fb3400b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58944/0 (socket says 172.21.15.55:58944) 2023-08-25T04:02:56.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.887+0000 7fb345cc7640 1 -- 172.21.15.55:0/745035091 learned_addr learned my addr 172.21.15.55:0/745035091 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:02:56.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.887+0000 7fb346cc9640 1 --2- 172.21.15.55:0/745035091 >> v2:172.21.15.110:3300/0 conn(0x7fb3400c89f0 0x7fb3400cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:56.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.887+0000 7fb3454c6640 1 -- 172.21.15.55:0/745035091 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538765348 0 0) 0x7fb3400cc880 con 0x7fb3400ceeb0 2023-08-25T04:02:56.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.887+0000 7fb3454c6640 1 -- 172.21.15.55:0/745035091 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb32c003530 con 0x7fb3400ceeb0 2023-08-25T04:02:56.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.887+0000 7fb346cc9640 1 -- 172.21.15.55:0/745035091 >> v1:172.21.15.110:6789/0 conn(0x7fb3400ad950 legacy=0x7fb3400ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.887+0000 7fb346cc9640 1 -- 172.21.15.55:0/745035091 >> v1:172.21.15.55:6789/0 conn(0x7fb3400ceeb0 legacy=0x7fb3400b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.887+0000 7fb346cc9640 1 -- 172.21.15.55:0/745035091 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3400cce40 con 0x7fb3400c89f0 2023-08-25T04:02:56.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.891+0000 7fb346cc9640 1 --2- 172.21.15.55:0/745035091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3400c89f0 0x7fb3400cc2a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb338009d90 tx=0x7fb33801c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8854507c8d9150df server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:56.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.891+0000 7fb3454c6640 1 -- 172.21.15.55:0/745035091 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3380a5780 con 0x7fb3400c89f0 2023-08-25T04:02:56.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.891+0000 7fb3454c6640 1 -- 172.21.15.55:0/745035091 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3380a58e0 con 0x7fb3400c89f0 2023-08-25T04:02:56.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.891+0000 7fb3454c6640 1 -- 172.21.15.55:0/745035091 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3380a5c70 con 0x7fb3400c89f0 2023-08-25T04:02:56.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.891+0000 7fb34872c640 1 -- 172.21.15.55:0/745035091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3400c89f0 msgr2=0x7fb3400cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.891+0000 7fb34872c640 1 --2- 172.21.15.55:0/745035091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3400c89f0 0x7fb3400cc2a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb338009d90 tx=0x7fb33801c8c0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.891+0000 7fb34872c640 1 -- 172.21.15.55:0/745035091 shutdown_connections 2023-08-25T04:02:56.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.891+0000 7fb34872c640 1 --2- 172.21.15.55:0/745035091 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3400c89f0 0x7fb3400cc2a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.891+0000 7fb34872c640 1 -- 172.21.15.55:0/745035091 >> 172.21.15.55:0/745035091 conn(0x7fb340069d00 msgr2=0x7fb34006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:56.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.891+0000 7fb34872c640 1 -- 172.21.15.55:0/745035091 shutdown_connections 2023-08-25T04:02:56.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.891+0000 7fb34872c640 1 -- 172.21.15.55:0/745035091 wait complete. 2023-08-25T04:02:56.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.891+0000 7fb34872c640 1 Processor -- start 2023-08-25T04:02:56.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.891+0000 7fb34872c640 1 -- start start 2023-08-25T04:02:56.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb34872c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3400ad950 0x7fb3400c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:56.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb34872c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3400c89f0 0x7fb3400c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:56.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb34872c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3400ceeb0 0x7fb3400c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:56.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb34872c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3400c7910 con 0x7fb3400ceeb0 2023-08-25T04:02:56.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb34872c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3400c6d00 con 0x7fb3400c89f0 2023-08-25T04:02:56.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb34872c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3400c6fe0 con 0x7fb3400ad950 2023-08-25T04:02:56.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb346cc9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3400ceeb0 0x7fb3400c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:56.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb346cc9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3400ceeb0 0x7fb3400c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48726/0 (socket says 172.21.15.55:48726) 2023-08-25T04:02:56.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb346cc9640 1 -- 172.21.15.55:0/3634452111 learned_addr learned my addr 172.21.15.55:0/3634452111 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:56.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb346cc9640 1 -- 172.21.15.55:0/3634452111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3400ad950 msgr2=0x7fb3400c6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb346cc9640 1 --2- 172.21.15.55:0/3634452111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3400ad950 0x7fb3400c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb346cc9640 1 -- 172.21.15.55:0/3634452111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3400c89f0 msgr2=0x7fb3400c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:56.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb346cc9640 1 --2- 172.21.15.55:0/3634452111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3400c89f0 0x7fb3400c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:56.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb346cc9640 1 -- 172.21.15.55:0/3634452111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb338009a70 con 0x7fb3400ceeb0 2023-08-25T04:02:56.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb346cc9640 1 --2- 172.21.15.55:0/3634452111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3400ceeb0 0x7fb3400c9900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb33801a4f0 tx=0x7fb338019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:56.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb336ffd640 1 -- 172.21.15.55:0/3634452111 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3380ad640 con 0x7fb3400ceeb0 2023-08-25T04:02:56.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb336ffd640 1 -- 172.21.15.55:0/3634452111 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3380ad7a0 con 0x7fb3400ceeb0 2023-08-25T04:02:56.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb336ffd640 1 -- 172.21.15.55:0/3634452111 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3380adb10 con 0x7fb3400ceeb0 2023-08-25T04:02:56.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb34872c640 1 -- 172.21.15.55:0/3634452111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3400c72c0 con 0x7fb3400ceeb0 2023-08-25T04:02:56.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb34872c640 1 -- 172.21.15.55:0/3634452111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb340150a20 con 0x7fb3400ceeb0 2023-08-25T04:02:56.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb34872c640 1 -- 172.21.15.55:0/3634452111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3400c7770 con 0x7fb3400ceeb0 2023-08-25T04:02:56.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.895+0000 7fb336ffd640 1 -- 172.21.15.55:0/3634452111 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb3380b4050 con 0x7fb3400ceeb0 2023-08-25T04:02:56.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.899+0000 7fb336ffd640 1 --2- 172.21.15.55:0/3634452111 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb324065680 0x7fb324067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:56.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.899+0000 7fb336ffd640 1 -- 172.21.15.55:0/3634452111 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb33811d780 con 0x7fb3400ceeb0 2023-08-25T04:02:56.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.899+0000 7fb3464c8640 1 --2- 172.21.15.55:0/3634452111 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb324065680 0x7fb324067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:56.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.899+0000 7fb3464c8640 1 --2- 172.21.15.55:0/3634452111 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb324065680 0x7fb324067b40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb33c000f70 tx=0x7fb33c0079c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:56.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:56.903+0000 7fb336ffd640 1 -- 172.21.15.55:0/3634452111 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb3400c7770 con 0x7fb3400ceeb0 2023-08-25T04:02:57.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.091+0000 7fb34872c640 1 -- 172.21.15.55:0/3634452111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3400c7770 con 0x7fb3400ceeb0 2023-08-25T04:02:57.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.091+0000 7fb336ffd640 1 -- 172.21.15.55:0/3634452111 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7fb3380c7e90 con 0x7fb3400ceeb0 2023-08-25T04:02:57.093 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:02:57.093 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3370778281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3370778281},{"type":"v1","addr":"172.21.15.55:6835","nonce":3370778281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/2321139789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2321139789},{"type":"v1","addr":"172.21.15.110:6837","nonce":2321139789}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3825401605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3825401605},{"type":"v1","addr":"172.21.15.110:6836","nonce":3825401605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4299,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2606103809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2606103809},{"type":"v1","addr":"172.21.15.55:6834","nonce":2606103809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-08-25T04:02:57.095 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 3 2023-08-25T04:02:57.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.091+0000 7fb34872c640 1 -- 172.21.15.55:0/3634452111 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb324065680 msgr2=0x7fb324067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:57.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.091+0000 7fb34872c640 1 --2- 172.21.15.55:0/3634452111 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb324065680 0x7fb324067b40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb33c000f70 tx=0x7fb33c0079c0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.091+0000 7fb34872c640 1 -- 172.21.15.55:0/3634452111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3400ceeb0 msgr2=0x7fb3400c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:57.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.091+0000 7fb34872c640 1 --2- 172.21.15.55:0/3634452111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3400ceeb0 0x7fb3400c9900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb33801a4f0 tx=0x7fb338019660 comp rx=0 tx=0).stop 2023-08-25T04:02:57.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.091+0000 7fb34872c640 1 -- 172.21.15.55:0/3634452111 shutdown_connections 2023-08-25T04:02:57.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.091+0000 7fb34872c640 1 --2- 172.21.15.55:0/3634452111 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb324065680 0x7fb324067b40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.091+0000 7fb34872c640 1 --2- 172.21.15.55:0/3634452111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3400ceeb0 0x7fb3400c9900 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.091+0000 7fb34872c640 1 --2- 172.21.15.55:0/3634452111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3400c89f0 0x7fb3400c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.091+0000 7fb34872c640 1 --2- 172.21.15.55:0/3634452111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3400ad950 0x7fb3400c6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.091+0000 7fb34872c640 1 -- 172.21.15.55:0/3634452111 >> 172.21.15.55:0/3634452111 conn(0x7fb340069d00 msgr2=0x7fb34006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:57.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.091+0000 7fb34872c640 1 -- 172.21.15.55:0/3634452111 shutdown_connections 2023-08-25T04:02:57.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.091+0000 7fb34872c640 1 -- 172.21.15.55:0/3634452111 wait complete. 2023-08-25T04:02:57.114 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:02:57.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.303+0000 7f197ee56640 1 Processor -- start 2023-08-25T04:02:57.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.303+0000 7f197ee56640 1 -- start start 2023-08-25T04:02:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.303+0000 7f197ee56640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19780cde20 0x7f19780ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.303+0000 7f197ee56640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19780b1220 0x7f197806be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.303+0000 7f197ee56640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f19780cabf0 0x7f197806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.303+0000 7f197ee56640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197806d2b0 con 0x7f19780b1220 2023-08-25T04:02:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.303+0000 7f197ee56640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19780c9490 con 0x7f19780cabf0 2023-08-25T04:02:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.303+0000 7f197ee56640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19780cb1e0 con 0x7f19780cde20 2023-08-25T04:02:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.303+0000 7f1977fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19780b1220 0x7f197806be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.303+0000 7f1977fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19780b1220 0x7f197806be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48740/0 (socket says 172.21.15.55:48740) 2023-08-25T04:02:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.303+0000 7f1977fff640 1 -- 172.21.15.55:0/2264920388 learned_addr learned my addr 172.21.15.55:0/2264920388 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.303+0000 7f197cbf2640 1 --2- 172.21.15.55:0/2264920388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19780cde20 0x7f19780ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.303+0000 7f197d3f3640 1 --2- 172.21.15.55:0/2264920388 >> v2:172.21.15.110:3300/0 conn(0x7f19780cabf0 0x7f197806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.307+0000 7f1977fff640 1 -- 172.21.15.55:0/2264920388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19780cde20 msgr2=0x7f19780ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.307+0000 7f1977fff640 1 --2- 172.21.15.55:0/2264920388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19780cde20 0x7f19780ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.307+0000 7f1977fff640 1 -- 172.21.15.55:0/2264920388 >> v2:172.21.15.110:3300/0 conn(0x7f19780cabf0 msgr2=0x7f197806c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.307+0000 7f1977fff640 1 --2- 172.21.15.55:0/2264920388 >> v2:172.21.15.110:3300/0 conn(0x7f19780cabf0 0x7f197806c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.307+0000 7f1977fff640 1 -- 172.21.15.55:0/2264920388 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19780cb480 con 0x7f19780b1220 2023-08-25T04:02:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.307+0000 7f197cbf2640 1 --2- 172.21.15.55:0/2264920388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19780cde20 0x7f19780ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:02:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.307+0000 7f1977fff640 1 --2- 172.21.15.55:0/2264920388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19780b1220 0x7f197806be90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1978065a20 tx=0x7f196401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f8719753f1b061 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:57.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.307+0000 7f19777fe640 1 -- 172.21.15.55:0/2264920388 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19640ab600 con 0x7f19780b1220 2023-08-25T04:02:57.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.307+0000 7f19777fe640 1 -- 172.21.15.55:0/2264920388 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19640a7050 con 0x7f19780b1220 2023-08-25T04:02:57.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.307+0000 7f19777fe640 1 -- 172.21.15.55:0/2264920388 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19640ab980 con 0x7f19780b1220 2023-08-25T04:02:57.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.307+0000 7f197ee56640 1 -- 172.21.15.55:0/2264920388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19780b1220 msgr2=0x7f197806be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:57.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.307+0000 7f197ee56640 1 --2- 172.21.15.55:0/2264920388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19780b1220 0x7f197806be90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1978065a20 tx=0x7f196401c240 comp rx=0 tx=0).stop 2023-08-25T04:02:57.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197ee56640 1 -- 172.21.15.55:0/2264920388 shutdown_connections 2023-08-25T04:02:57.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197ee56640 1 --2- 172.21.15.55:0/2264920388 >> v2:172.21.15.110:3300/0 conn(0x7f19780cabf0 0x7f197806c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197ee56640 1 --2- 172.21.15.55:0/2264920388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19780b1220 0x7f197806be90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197ee56640 1 --2- 172.21.15.55:0/2264920388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19780cde20 0x7f19780ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197ee56640 1 -- 172.21.15.55:0/2264920388 >> 172.21.15.55:0/2264920388 conn(0x7f19780b0700 msgr2=0x7f19780b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197ee56640 1 -- 172.21.15.55:0/2264920388 shutdown_connections 2023-08-25T04:02:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197ee56640 1 -- 172.21.15.55:0/2264920388 wait complete. 2023-08-25T04:02:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197ee56640 1 Processor -- start 2023-08-25T04:02:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197ee56640 1 -- start start 2023-08-25T04:02:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197ee56640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19780b1220 0x7f19780adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197ee56640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19780cabf0 0x7f1978158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197ee56640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19780cde20 0x7f1978159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197ee56640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1978154a20 con 0x7f19780cde20 2023-08-25T04:02:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197ee56640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1978153d70 con 0x7f19780cabf0 2023-08-25T04:02:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197ee56640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1978154080 con 0x7f19780b1220 2023-08-25T04:02:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197d3f3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19780cde20 0x7f1978159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197d3f3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19780cde20 0x7f1978159360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48742/0 (socket says 172.21.15.55:48742) 2023-08-25T04:02:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197d3f3640 1 -- 172.21.15.55:0/738493355 learned_addr learned my addr 172.21.15.55:0/738493355 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f1977fff640 1 --2- 172.21.15.55:0/738493355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19780cabf0 0x7f1978158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197cbf2640 1 --2- 172.21.15.55:0/738493355 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19780b1220 0x7f19780adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197d3f3640 1 -- 172.21.15.55:0/738493355 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19780b1220 msgr2=0x7f19780adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197d3f3640 1 --2- 172.21.15.55:0/738493355 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19780b1220 0x7f19780adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197d3f3640 1 -- 172.21.15.55:0/738493355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19780cabf0 msgr2=0x7f1978158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197d3f3640 1 --2- 172.21.15.55:0/738493355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19780cabf0 0x7f1978158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.311+0000 7f197d3f3640 1 -- 172.21.15.55:0/738493355 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c009420 con 0x7f19780cde20 2023-08-25T04:02:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.315+0000 7f197d3f3640 1 --2- 172.21.15.55:0/738493355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19780cde20 0x7f1978159360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f197000eed0 tx=0x7f197000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.315+0000 7f19757fa640 1 -- 172.21.15.55:0/738493355 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1970010040 con 0x7f19780cde20 2023-08-25T04:02:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.315+0000 7f19757fa640 1 -- 172.21.15.55:0/738493355 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197000bd20 con 0x7f19780cde20 2023-08-25T04:02:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.315+0000 7f197ee56640 1 -- 172.21.15.55:0/738493355 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19640094d0 con 0x7f19780cde20 2023-08-25T04:02:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.315+0000 7f19757fa640 1 -- 172.21.15.55:0/738493355 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1970014640 con 0x7f19780cde20 2023-08-25T04:02:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.315+0000 7f197ee56640 1 -- 172.21.15.55:0/738493355 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1978154640 con 0x7f19780cde20 2023-08-25T04:02:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.315+0000 7f197ee56640 1 -- 172.21.15.55:0/738493355 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1978154b60 con 0x7f19780cde20 2023-08-25T04:02:57.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.315+0000 7f19757fa640 1 -- 172.21.15.55:0/738493355 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f19700147a0 con 0x7f19780cde20 2023-08-25T04:02:57.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.315+0000 7f19757fa640 1 --2- 172.21.15.55:0/738493355 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f195c065680 0x7f195c067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:57.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.315+0000 7f19757fa640 1 -- 172.21.15.55:0/738493355 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1970083350 con 0x7f19780cde20 2023-08-25T04:02:57.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.315+0000 7f197cbf2640 1 --2- 172.21.15.55:0/738493355 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f195c065680 0x7f195c067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:57.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.319+0000 7f197cbf2640 1 --2- 172.21.15.55:0/738493355 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f195c065680 0x7f195c067b40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f196c009c50 tx=0x7f196c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:57.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.319+0000 7f19757fa640 1 -- 172.21.15.55:0/738493355 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1978154b60 con 0x7f19780cde20 2023-08-25T04:02:57.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.475+0000 7f197ee56640 1 -- 172.21.15.55:0/738493355 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1978154b60 con 0x7f19780cde20 2023-08-25T04:02:57.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.479+0000 7f19757fa640 1 -- 172.21.15.55:0/738493355 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14648 (secure 0 0 0) 0x7f1978154b60 con 0x7f19780cde20 2023-08-25T04:02:57.482 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:02:57.483 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:02:56.656113+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:02:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.479+0000 7f197ee56640 1 -- 172.21.15.55:0/738493355 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f195c065680 msgr2=0x7f195c067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.479+0000 7f197ee56640 1 --2- 172.21.15.55:0/738493355 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f195c065680 0x7f195c067b40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f196c009c50 tx=0x7f196c009190 comp rx=0 tx=0).stop 2023-08-25T04:02:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.479+0000 7f197ee56640 1 -- 172.21.15.55:0/738493355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19780cde20 msgr2=0x7f1978159360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.479+0000 7f197ee56640 1 --2- 172.21.15.55:0/738493355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19780cde20 0x7f1978159360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f197000eed0 tx=0x7f197000b480 comp rx=0 tx=0).stop 2023-08-25T04:02:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.479+0000 7f197ee56640 1 -- 172.21.15.55:0/738493355 shutdown_connections 2023-08-25T04:02:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.479+0000 7f197ee56640 1 --2- 172.21.15.55:0/738493355 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f195c065680 0x7f195c067b40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.479+0000 7f197ee56640 1 --2- 172.21.15.55:0/738493355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19780cde20 0x7f1978159360 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.479+0000 7f197ee56640 1 --2- 172.21.15.55:0/738493355 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19780cabf0 0x7f1978158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.479+0000 7f197ee56640 1 --2- 172.21.15.55:0/738493355 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19780b1220 0x7f19780adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.479+0000 7f197ee56640 1 -- 172.21.15.55:0/738493355 >> 172.21.15.55:0/738493355 conn(0x7f19780b0700 msgr2=0x7f197815ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:57.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.479+0000 7f197ee56640 1 -- 172.21.15.55:0/738493355 shutdown_connections 2023-08-25T04:02:57.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.479+0000 7f197ee56640 1 -- 172.21.15.55:0/738493355 wait complete. 2023-08-25T04:02:57.501 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:02:57.502 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:02:57.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.647+0000 7f9781a88640 1 Processor -- start 2023-08-25T04:02:57.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.647+0000 7f9781a88640 1 -- start start 2023-08-25T04:02:57.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.647+0000 7f9781a88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f977c0cb020 0x7f977c0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:57.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.647+0000 7f9781a88640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f977c0cdd50 0x7f977c0cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:57.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.647+0000 7f9781a88640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f977c06c720 0x7f977c06cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:57.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.647+0000 7f9781a88640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c06d0b0 con 0x7f977c0cdd50 2023-08-25T04:02:57.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.647+0000 7f9781a88640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977c0cbca0 con 0x7f977c06c720 2023-08-25T04:02:57.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.647+0000 7f9781a88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0c9470 con 0x7f977c0cb020 2023-08-25T04:02:57.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.647+0000 7f9773fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f977c0cdd50 0x7f977c0cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:57.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.647+0000 7f9773fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f977c0cdd50 0x7f977c0cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48754/0 (socket says 172.21.15.55:48754) 2023-08-25T04:02:57.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.647+0000 7f9773fff640 1 -- 172.21.15.55:0/2242841021 learned_addr learned my addr 172.21.15.55:0/2242841021 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:57.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.647+0000 7f9773fff640 1 -- 172.21.15.55:0/2242841021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f977c0cb020 msgr2=0x7f977c0c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:57.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.647+0000 7f9773fff640 1 --2- 172.21.15.55:0/2242841021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f977c0cb020 0x7f977c0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.647+0000 7f9773fff640 1 -- 172.21.15.55:0/2242841021 >> v2:172.21.15.110:3300/0 conn(0x7f977c06c720 msgr2=0x7f977c06cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:57.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.647+0000 7f9773fff640 1 --2- 172.21.15.55:0/2242841021 >> v2:172.21.15.110:3300/0 conn(0x7f977c06c720 0x7f977c06cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.647+0000 7f9773fff640 1 -- 172.21.15.55:0/2242841021 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c0ce1b0 con 0x7f977c0cdd50 2023-08-25T04:02:57.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.651+0000 7f9773fff640 1 --2- 172.21.15.55:0/2242841021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0cdd50 0x7f977c0cb400 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f977c09bdf0 tx=0x7f976401eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25f8d4dd4f38a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:57.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.651+0000 7f977affd640 1 -- 172.21.15.55:0/2242841021 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640a7ac0 con 0x7f977c0cdd50 2023-08-25T04:02:57.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.651+0000 7f977affd640 1 -- 172.21.15.55:0/2242841021 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97640a7c20 con 0x7f977c0cdd50 2023-08-25T04:02:57.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.651+0000 7f977affd640 1 -- 172.21.15.55:0/2242841021 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640af440 con 0x7f977c0cdd50 2023-08-25T04:02:57.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.651+0000 7f9781a88640 1 -- 172.21.15.55:0/2242841021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0cdd50 msgr2=0x7f977c0cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:57.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.651+0000 7f9781a88640 1 --2- 172.21.15.55:0/2242841021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0cdd50 0x7f977c0cb400 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f977c09bdf0 tx=0x7f976401eb40 comp rx=0 tx=0).stop 2023-08-25T04:02:57.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.651+0000 7f9781a88640 1 -- 172.21.15.55:0/2242841021 shutdown_connections 2023-08-25T04:02:57.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.651+0000 7f9781a88640 1 --2- 172.21.15.55:0/2242841021 >> v2:172.21.15.110:3300/0 conn(0x7f977c06c720 0x7f977c06cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.651+0000 7f9781a88640 1 --2- 172.21.15.55:0/2242841021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0cdd50 0x7f977c0cb400 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.651+0000 7f9781a88640 1 --2- 172.21.15.55:0/2242841021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f977c0cb020 0x7f977c0c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.651+0000 7f9781a88640 1 -- 172.21.15.55:0/2242841021 >> 172.21.15.55:0/2242841021 conn(0x7f977c069900 msgr2=0x7f977c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:57.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.651+0000 7f9781a88640 1 -- 172.21.15.55:0/2242841021 shutdown_connections 2023-08-25T04:02:57.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.651+0000 7f9781a88640 1 -- 172.21.15.55:0/2242841021 wait complete. 2023-08-25T04:02:57.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f9781a88640 1 Processor -- start 2023-08-25T04:02:57.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f9781a88640 1 -- start start 2023-08-25T04:02:57.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f9781a88640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f977c06c720 0x7f977c156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:57.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f9781a88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f977c0cb020 0x7f977c0af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:57.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f9781a88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0cdd50 0x7f977c1579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:57.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f9781a88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c1f9820 con 0x7f977c0cdd50 2023-08-25T04:02:57.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f9781a88640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977c0c26e0 con 0x7f977c06c720 2023-08-25T04:02:57.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f9781a88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977c1f9540 con 0x7f977c0cb020 2023-08-25T04:02:57.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f977bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0cdd50 0x7f977c1579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:57.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f977bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0cdd50 0x7f977c1579e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48766/0 (socket says 172.21.15.55:48766) 2023-08-25T04:02:57.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f977b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f977c06c720 0x7f977c156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:57.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f977bfff640 1 -- 172.21.15.55:0/3755710669 learned_addr learned my addr 172.21.15.55:0/3755710669 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:57.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f9773fff640 1 --2- 172.21.15.55:0/3755710669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f977c0cb020 0x7f977c0af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f977bfff640 1 -- 172.21.15.55:0/3755710669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f977c0cb020 msgr2=0x7f977c0af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f977bfff640 1 --2- 172.21.15.55:0/3755710669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f977c0cb020 0x7f977c0af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f977bfff640 1 -- 172.21.15.55:0/3755710669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f977c06c720 msgr2=0x7f977c156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f977bfff640 1 --2- 172.21.15.55:0/3755710669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f977c06c720 0x7f977c156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f977bfff640 1 -- 172.21.15.55:0/3755710669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976400b770 con 0x7f977c0cdd50 2023-08-25T04:02:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f977bfff640 1 --2- 172.21.15.55:0/3755710669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0cdd50 0x7f977c1579e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f977400b970 tx=0x7f977400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:57.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f9778ff9640 1 -- 172.21.15.55:0/3755710669 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977400caa0 con 0x7f977c0cdd50 2023-08-25T04:02:57.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f9778ff9640 1 -- 172.21.15.55:0/3755710669 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977400cc20 con 0x7f977c0cdd50 2023-08-25T04:02:57.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f9778ff9640 1 -- 172.21.15.55:0/3755710669 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774014440 con 0x7f977c0cdd50 2023-08-25T04:02:57.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f9781a88640 1 -- 172.21.15.55:0/3755710669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c0c2090 con 0x7f977c0cdd50 2023-08-25T04:02:57.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.655+0000 7f9781a88640 1 -- 172.21.15.55:0/3755710669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977c0afb80 con 0x7f977c0cdd50 2023-08-25T04:02:57.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.659+0000 7f9781a88640 1 -- 172.21.15.55:0/3755710669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977c073ec0 con 0x7f977c0cdd50 2023-08-25T04:02:57.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.659+0000 7f9778ff9640 1 -- 172.21.15.55:0/3755710669 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f977401d3b0 con 0x7f977c0cdd50 2023-08-25T04:02:57.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.659+0000 7f9778ff9640 1 --2- 172.21.15.55:0/3755710669 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f975c065680 0x7f975c067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:57.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.659+0000 7f9778ff9640 1 -- 172.21.15.55:0/3755710669 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9774082960 con 0x7f977c0cdd50 2023-08-25T04:02:57.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.659+0000 7f977b7fe640 1 --2- 172.21.15.55:0/3755710669 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f975c065680 0x7f975c067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:57.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.659+0000 7f977b7fe640 1 --2- 172.21.15.55:0/3755710669 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f975c065680 0x7f975c067b40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f976c009990 tx=0x7f976c009110 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:57.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.663+0000 7f9778ff9640 1 -- 172.21.15.55:0/3755710669 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9774050780 con 0x7f977c0cdd50 2023-08-25T04:02:57.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.819+0000 7f9781a88640 1 -- 172.21.15.55:0/3755710669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f977c0c2820 con 0x7f977c0cdd50 2023-08-25T04:02:57.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.819+0000 7f9778ff9640 1 -- 172.21.15.55:0/3755710669 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9774019020 con 0x7f977c0cdd50 2023-08-25T04:02:57.822 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:02:57.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.823+0000 7f9781a88640 1 -- 172.21.15.55:0/3755710669 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f975c065680 msgr2=0x7f975c067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:57.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.823+0000 7f9781a88640 1 --2- 172.21.15.55:0/3755710669 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f975c065680 0x7f975c067b40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f976c009990 tx=0x7f976c009110 comp rx=0 tx=0).stop 2023-08-25T04:02:57.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.823+0000 7f9781a88640 1 -- 172.21.15.55:0/3755710669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0cdd50 msgr2=0x7f977c1579e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:57.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.823+0000 7f9781a88640 1 --2- 172.21.15.55:0/3755710669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0cdd50 0x7f977c1579e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f977400b970 tx=0x7f977400bd70 comp rx=0 tx=0).stop 2023-08-25T04:02:57.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.823+0000 7f9781a88640 1 -- 172.21.15.55:0/3755710669 shutdown_connections 2023-08-25T04:02:57.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.823+0000 7f9781a88640 1 --2- 172.21.15.55:0/3755710669 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f975c065680 0x7f975c067b40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.823+0000 7f9781a88640 1 --2- 172.21.15.55:0/3755710669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977c0cdd50 0x7f977c1579e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.823+0000 7f9781a88640 1 --2- 172.21.15.55:0/3755710669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f977c0cb020 0x7f977c0af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.823+0000 7f9781a88640 1 --2- 172.21.15.55:0/3755710669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f977c06c720 0x7f977c156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.823+0000 7f9781a88640 1 -- 172.21.15.55:0/3755710669 >> 172.21.15.55:0/3755710669 conn(0x7f977c069900 msgr2=0x7f977c0ab620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:57.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.823+0000 7f9781a88640 1 -- 172.21.15.55:0/3755710669 shutdown_connections 2023-08-25T04:02:57.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.823+0000 7f9781a88640 1 -- 172.21.15.55:0/3755710669 wait complete. 2023-08-25T04:02:57.843 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:02:57.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.987+0000 7f209cfba640 1 Processor -- start 2023-08-25T04:02:57.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.987+0000 7f209cfba640 1 -- start start 2023-08-25T04:02:57.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.987+0000 7f209cfba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20981601f0 0x7f209815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:57.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.987+0000 7f209cfba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f20980d1290 0x7f209815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:57.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.987+0000 7f209cfba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20980cd5a0 con 0x7f209815e3c0 2023-08-25T04:02:57.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.987+0000 7f209cfba640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20980cd880 con 0x7f20981601f0 2023-08-25T04:02:57.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.987+0000 7f209cfba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20980cdb60 con 0x7f20980d1290 2023-08-25T04:02:57.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.987+0000 7f209659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20981601f0 0x7f209815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:57.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.987+0000 7f208ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f209815e3c0 0x7f20980d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58958/0 (socket says 172.21.15.55:58958) 2023-08-25T04:02:57.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.987+0000 7f208ffff640 1 -- 172.21.15.55:0/2104841702 learned_addr learned my addr 172.21.15.55:0/2104841702 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:02:57.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.987+0000 7f2096d9d640 1 --2- 172.21.15.55:0/2104841702 >> v2:172.21.15.110:3300/0 conn(0x7f20980d1290 0x7f209815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:57.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.987+0000 7f209659c640 1 -- 172.21.15.55:0/2104841702 >> v2:172.21.15.110:3300/0 conn(0x7f20980d1290 msgr2=0x7f209815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:57.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.987+0000 7f209659c640 1 --2- 172.21.15.55:0/2104841702 >> v2:172.21.15.110:3300/0 conn(0x7f20980d1290 0x7f209815e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.987+0000 7f209659c640 1 -- 172.21.15.55:0/2104841702 >> v1:172.21.15.55:6789/0 conn(0x7f209815e3c0 legacy=0x7f20980d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:57.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.987+0000 7f209659c640 1 -- 172.21.15.55:0/2104841702 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20980cde40 con 0x7f20981601f0 2023-08-25T04:02:57.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.991+0000 7f209659c640 1 --2- 172.21.15.55:0/2104841702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20981601f0 0x7f209815d430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f20980d2060 tx=0x7f208801c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23dbb7cb4c90a9c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:57.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.991+0000 7f2095d9b640 1 -- 172.21.15.55:0/2104841702 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20880ab600 con 0x7f20981601f0 2023-08-25T04:02:57.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.991+0000 7f2095d9b640 1 -- 172.21.15.55:0/2104841702 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20880a7050 con 0x7f20981601f0 2023-08-25T04:02:57.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.991+0000 7f2095d9b640 1 -- 172.21.15.55:0/2104841702 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20880ab980 con 0x7f20981601f0 2023-08-25T04:02:57.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.991+0000 7f209cfba640 1 -- 172.21.15.55:0/2104841702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20981601f0 msgr2=0x7f209815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:57.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.991+0000 7f209cfba640 1 --2- 172.21.15.55:0/2104841702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20981601f0 0x7f209815d430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f20980d2060 tx=0x7f208801c2d0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.991+0000 7f209cfba640 1 -- 172.21.15.55:0/2104841702 shutdown_connections 2023-08-25T04:02:57.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.991+0000 7f209cfba640 1 --2- 172.21.15.55:0/2104841702 >> v2:172.21.15.110:3300/0 conn(0x7f20980d1290 0x7f209815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.991+0000 7f209cfba640 1 --2- 172.21.15.55:0/2104841702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20981601f0 0x7f209815d430 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:57.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.991+0000 7f209cfba640 1 -- 172.21.15.55:0/2104841702 >> 172.21.15.55:0/2104841702 conn(0x7f20980d27d0 msgr2=0x7f20980d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:57.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.991+0000 7f209cfba640 1 -- 172.21.15.55:0/2104841702 shutdown_connections 2023-08-25T04:02:57.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.991+0000 7f209cfba640 1 -- 172.21.15.55:0/2104841702 wait complete. 2023-08-25T04:02:58.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f209cfba640 1 Processor -- start 2023-08-25T04:02:58.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f209cfba640 1 -- start start 2023-08-25T04:02:58.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f209cfba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20980d1290 0x7f2098147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:58.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f209cfba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f209815e3c0 0x7f2098158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:58.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f209cfba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20981601f0 0x7f2098159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:58.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f209cfba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20980cc140 con 0x7f209815e3c0 2023-08-25T04:02:58.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f209cfba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20980c6e20 con 0x7f20980d1290 2023-08-25T04:02:58.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f209cfba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20980cb270 con 0x7f20981601f0 2023-08-25T04:02:58.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f208ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f209815e3c0 0x7f2098158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:58.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f208ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f209815e3c0 0x7f2098158be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48786/0 (socket says 172.21.15.55:48786) 2023-08-25T04:02:58.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f208ffff640 1 -- 172.21.15.55:0/209580609 learned_addr learned my addr 172.21.15.55:0/209580609 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:58.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f208ffff640 1 -- 172.21.15.55:0/209580609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20981601f0 msgr2=0x7f2098159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:58.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f209659c640 1 --2- 172.21.15.55:0/209580609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20980d1290 0x7f2098147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:58.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f2096d9d640 1 --2- 172.21.15.55:0/209580609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20981601f0 0x7f2098159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:58.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f208ffff640 1 --2- 172.21.15.55:0/209580609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20981601f0 0x7f2098159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f208ffff640 1 -- 172.21.15.55:0/209580609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20980d1290 msgr2=0x7f2098147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:58.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f208ffff640 1 --2- 172.21.15.55:0/209580609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20980d1290 0x7f2098147910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f208ffff640 1 -- 172.21.15.55:0/209580609 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20880093c0 con 0x7f209815e3c0 2023-08-25T04:02:58.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f209659c640 1 --2- 172.21.15.55:0/209580609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20980d1290 0x7f2098147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:02:58.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f2096d9d640 1 --2- 172.21.15.55:0/209580609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20981601f0 0x7f2098159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:02:58.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f208ffff640 1 --2- 172.21.15.55:0/209580609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f209815e3c0 0x7f2098158be0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2080009f30 tx=0x7f208000c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:58.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f208effd640 1 -- 172.21.15.55:0/209580609 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080007af0 con 0x7f209815e3c0 2023-08-25T04:02:58.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f208effd640 1 -- 172.21.15.55:0/209580609 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2080007c50 con 0x7f209815e3c0 2023-08-25T04:02:58.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f209cfba640 1 -- 172.21.15.55:0/209580609 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20980cb4c0 con 0x7f209815e3c0 2023-08-25T04:02:58.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f208effd640 1 -- 172.21.15.55:0/209580609 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208000ce70 con 0x7f209815e3c0 2023-08-25T04:02:58.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.995+0000 7f209cfba640 1 -- 172.21.15.55:0/209580609 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20980cba80 con 0x7f209815e3c0 2023-08-25T04:02:58.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.999+0000 7f209cfba640 1 -- 172.21.15.55:0/209580609 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20980b5260 con 0x7f209815e3c0 2023-08-25T04:02:58.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.999+0000 7f208effd640 1 -- 172.21.15.55:0/209580609 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2080009070 con 0x7f209815e3c0 2023-08-25T04:02:58.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.999+0000 7f208effd640 1 --2- 172.21.15.55:0/209580609 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2078065680 0x7f2078067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:58.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.999+0000 7f208effd640 1 -- 172.21.15.55:0/209580609 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2080084b90 con 0x7f209815e3c0 2023-08-25T04:02:58.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.999+0000 7f209659c640 1 --2- 172.21.15.55:0/209580609 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2078065680 0x7f2078067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:58.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:57.999+0000 7f209659c640 1 --2- 172.21.15.55:0/209580609 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2078065680 0x7f2078067b40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f20880ad000 tx=0x7f2088008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:58.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.003+0000 7f208effd640 1 -- 172.21.15.55:0/209580609 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2080056390 con 0x7f209815e3c0 2023-08-25T04:02:58.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.159+0000 7f209cfba640 1 -- 172.21.15.55:0/209580609 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2098073ec0 con 0x7f209815e3c0 2023-08-25T04:02:58.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.159+0000 7f208effd640 1 -- 172.21.15.55:0/209580609 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f20800190a0 con 0x7f209815e3c0 2023-08-25T04:02:58.163 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:02:58.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.163+0000 7f209cfba640 1 -- 172.21.15.55:0/209580609 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2078065680 msgr2=0x7f2078067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:58.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.163+0000 7f209cfba640 1 --2- 172.21.15.55:0/209580609 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2078065680 0x7f2078067b40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f20880ad000 tx=0x7f2088008040 comp rx=0 tx=0).stop 2023-08-25T04:02:58.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.163+0000 7f209cfba640 1 -- 172.21.15.55:0/209580609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f209815e3c0 msgr2=0x7f2098158be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:58.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.163+0000 7f209cfba640 1 --2- 172.21.15.55:0/209580609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f209815e3c0 0x7f2098158be0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2080009f30 tx=0x7f208000c4f0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.163+0000 7f209cfba640 1 -- 172.21.15.55:0/209580609 shutdown_connections 2023-08-25T04:02:58.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.163+0000 7f209cfba640 1 --2- 172.21.15.55:0/209580609 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2078065680 0x7f2078067b40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.163+0000 7f209cfba640 1 --2- 172.21.15.55:0/209580609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20981601f0 0x7f2098159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.163+0000 7f209cfba640 1 --2- 172.21.15.55:0/209580609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f209815e3c0 0x7f2098158be0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.163+0000 7f209cfba640 1 --2- 172.21.15.55:0/209580609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20980d1290 0x7f2098147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.163+0000 7f209cfba640 1 -- 172.21.15.55:0/209580609 >> 172.21.15.55:0/209580609 conn(0x7f20980d27d0 msgr2=0x7f209806c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:58.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.163+0000 7f209cfba640 1 -- 172.21.15.55:0/209580609 shutdown_connections 2023-08-25T04:02:58.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.163+0000 7f209cfba640 1 -- 172.21.15.55:0/209580609 wait complete. 2023-08-25T04:02:58.185 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-25T04:02:58.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.327+0000 7f6616ffa640 1 Processor -- start 2023-08-25T04:02:58.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.327+0000 7f6616ffa640 1 -- start start 2023-08-25T04:02:58.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.327+0000 7f6616ffa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f66100cdde0 0x7f66100ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:58.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.327+0000 7f6616ffa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66100b2e40 0x7f66100b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:58.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.327+0000 7f6616ffa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66100b29b0 con 0x7f66100d0da0 2023-08-25T04:02:58.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.327+0000 7f6616ffa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66100ce760 con 0x7f66100b2e40 2023-08-25T04:02:58.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.327+0000 7f6616ffa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66100b1dc0 con 0x7f66100cdde0 2023-08-25T04:02:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.327+0000 7f6615597640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66100b2e40 0x7f66100b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.327+0000 7f6615597640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66100b2e40 0x7f66100b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48792/0 (socket says 172.21.15.55:48792) 2023-08-25T04:02:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.327+0000 7f6615597640 1 -- 172.21.15.55:0/2459588117 learned_addr learned my addr 172.21.15.55:0/2459588117 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.327+0000 7f6614d96640 1 --1- 172.21.15.55:0/2459588117 >> v1:172.21.15.55:6789/0 conn(0x7f66100d0da0 0x7f66100d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58968/0 (socket says 172.21.15.55:58968) 2023-08-25T04:02:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.327+0000 7f6607fff640 1 --2- 172.21.15.55:0/2459588117 >> v2:172.21.15.110:3300/0 conn(0x7f66100cdde0 0x7f66100ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.327+0000 7f6615597640 1 -- 172.21.15.55:0/2459588117 >> v2:172.21.15.110:3300/0 conn(0x7f66100cdde0 msgr2=0x7f66100ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.327+0000 7f6615597640 1 --2- 172.21.15.55:0/2459588117 >> v2:172.21.15.110:3300/0 conn(0x7f66100cdde0 0x7f66100ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.327+0000 7f6615597640 1 -- 172.21.15.55:0/2459588117 >> v1:172.21.15.55:6789/0 conn(0x7f66100d0da0 legacy=0x7f66100d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.327+0000 7f6615597640 1 -- 172.21.15.55:0/2459588117 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66100b2080 con 0x7f66100b2e40 2023-08-25T04:02:58.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.331+0000 7f6615597640 1 --2- 172.21.15.55:0/2459588117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66100b2e40 0x7f66100b32b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f66100d38c0 tx=0x7f660801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efccbbb3153ea2da server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:58.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.331+0000 7f66077fe640 1 -- 172.21.15.55:0/2459588117 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66080af400 con 0x7f66100b2e40 2023-08-25T04:02:58.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.331+0000 7f66077fe640 1 -- 172.21.15.55:0/2459588117 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66080ab050 con 0x7f66100b2e40 2023-08-25T04:02:58.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.331+0000 7f66077fe640 1 -- 172.21.15.55:0/2459588117 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66080af780 con 0x7f66100b2e40 2023-08-25T04:02:58.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.331+0000 7f6616ffa640 1 -- 172.21.15.55:0/2459588117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66100b2e40 msgr2=0x7f66100b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.331+0000 7f6616ffa640 1 --2- 172.21.15.55:0/2459588117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66100b2e40 0x7f66100b32b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f66100d38c0 tx=0x7f660801f1c0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.331+0000 7f6616ffa640 1 -- 172.21.15.55:0/2459588117 shutdown_connections 2023-08-25T04:02:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.331+0000 7f6616ffa640 1 --2- 172.21.15.55:0/2459588117 >> v2:172.21.15.110:3300/0 conn(0x7f66100cdde0 0x7f66100ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.331+0000 7f6616ffa640 1 --2- 172.21.15.55:0/2459588117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66100b2e40 0x7f66100b32b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.331+0000 7f6616ffa640 1 -- 172.21.15.55:0/2459588117 >> 172.21.15.55:0/2459588117 conn(0x7f661009bae0 msgr2=0x7f66100d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.331+0000 7f6616ffa640 1 -- 172.21.15.55:0/2459588117 shutdown_connections 2023-08-25T04:02:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.331+0000 7f6616ffa640 1 -- 172.21.15.55:0/2459588117 wait complete. 2023-08-25T04:02:58.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6616ffa640 1 Processor -- start 2023-08-25T04:02:58.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6616ffa640 1 -- start start 2023-08-25T04:02:58.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6616ffa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66100b2e40 0x7f66100b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:58.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6616ffa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66100cdde0 0x7f66100cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:58.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6616ffa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66100d0da0 0x7f66101f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:58.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6616ffa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66100cbdc0 con 0x7f66100b2e40 2023-08-25T04:02:58.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6616ffa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66101f26a0 con 0x7f66100d0da0 2023-08-25T04:02:58.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6616ffa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66100c9c30 con 0x7f66100cdde0 2023-08-25T04:02:58.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6614d96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66100b2e40 0x7f66100b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:58.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6614d96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66100b2e40 0x7f66100b7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48796/0 (socket says 172.21.15.55:48796) 2023-08-25T04:02:58.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6614d96640 1 -- 172.21.15.55:0/218290515 learned_addr learned my addr 172.21.15.55:0/218290515 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:58.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6607fff640 1 --2- 172.21.15.55:0/218290515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66100cdde0 0x7f66100cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:58.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6615597640 1 --2- 172.21.15.55:0/218290515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66100d0da0 0x7f66101f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:58.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6614d96640 1 -- 172.21.15.55:0/218290515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66100cdde0 msgr2=0x7f66100cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:58.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6614d96640 1 --2- 172.21.15.55:0/218290515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66100cdde0 0x7f66100cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6614d96640 1 -- 172.21.15.55:0/218290515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66100d0da0 msgr2=0x7f66101f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:58.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6614d96640 1 --2- 172.21.15.55:0/218290515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66100d0da0 0x7f66101f5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6614d96640 1 -- 172.21.15.55:0/218290515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6608009b30 con 0x7f66100b2e40 2023-08-25T04:02:58.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6614d96640 1 --2- 172.21.15.55:0/218290515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66100b2e40 0x7f66100b7550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f660c00c430 tx=0x7f660c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:58.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f66057fa640 1 -- 172.21.15.55:0/218290515 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c0074e0 con 0x7f66100b2e40 2023-08-25T04:02:58.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f66057fa640 1 -- 172.21.15.55:0/218290515 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660c007640 con 0x7f66100b2e40 2023-08-25T04:02:58.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f66057fa640 1 -- 172.21.15.55:0/218290515 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c0059d0 con 0x7f66100b2e40 2023-08-25T04:02:58.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6616ffa640 1 -- 172.21.15.55:0/218290515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66100c9f10 con 0x7f66100b2e40 2023-08-25T04:02:58.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.335+0000 7f6616ffa640 1 -- 172.21.15.55:0/218290515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66100ca4d0 con 0x7f66100b2e40 2023-08-25T04:02:58.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.339+0000 7f6616ffa640 1 -- 172.21.15.55:0/218290515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66101f28c0 con 0x7f66100b2e40 2023-08-25T04:02:58.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.339+0000 7f66057fa640 1 -- 172.21.15.55:0/218290515 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f660c005b30 con 0x7f66100b2e40 2023-08-25T04:02:58.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.339+0000 7f66057fa640 1 --2- 172.21.15.55:0/218290515 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f65fc065680 0x7f65fc067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:58.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.339+0000 7f66057fa640 1 -- 172.21.15.55:0/218290515 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f660c081fe0 con 0x7f66100b2e40 2023-08-25T04:02:58.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.339+0000 7f6607fff640 1 --2- 172.21.15.55:0/218290515 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f65fc065680 0x7f65fc067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:58.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.339+0000 7f6607fff640 1 --2- 172.21.15.55:0/218290515 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f65fc065680 0x7f65fc067b40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f66100cb9f0 tx=0x7f6600008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:58.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.343+0000 7f66057fa640 1 -- 172.21.15.55:0/218290515 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f66101f28c0 con 0x7f66100b2e40 2023-08-25T04:02:58.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.499+0000 7f6616ffa640 1 -- 172.21.15.55:0/218290515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f66101f28c0 con 0x7f66100b2e40 2023-08-25T04:02:58.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.499+0000 7f66057fa640 1 -- 172.21.15.55:0/218290515 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f66101f28c0 con 0x7f66100b2e40 2023-08-25T04:02:58.503 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:02:58.503 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T04:02:58.503 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:02:58.503 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-08-25T04:02:58.503 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-08-25T04:02:58.503 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:02:58.503 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:02:58.504 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-08-25T04:02:58.504 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-08-25T04:02:58.504 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:02:58.504 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T04:02:58.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.503+0000 7f6616ffa640 1 -- 172.21.15.55:0/218290515 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f65fc065680 msgr2=0x7f65fc067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:58.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.503+0000 7f6616ffa640 1 --2- 172.21.15.55:0/218290515 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f65fc065680 0x7f65fc067b40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f66100cb9f0 tx=0x7f6600008040 comp rx=0 tx=0).stop 2023-08-25T04:02:58.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.503+0000 7f6616ffa640 1 -- 172.21.15.55:0/218290515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66100b2e40 msgr2=0x7f66100b7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:58.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.503+0000 7f6616ffa640 1 --2- 172.21.15.55:0/218290515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66100b2e40 0x7f66100b7550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f660c00c430 tx=0x7f660c00c8f0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.503+0000 7f6616ffa640 1 -- 172.21.15.55:0/218290515 shutdown_connections 2023-08-25T04:02:58.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.503+0000 7f6616ffa640 1 --2- 172.21.15.55:0/218290515 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f65fc065680 0x7f65fc067b40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.503+0000 7f6616ffa640 1 --2- 172.21.15.55:0/218290515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66100d0da0 0x7f66101f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.503+0000 7f6616ffa640 1 --2- 172.21.15.55:0/218290515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66100cdde0 0x7f66100cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.503+0000 7f6616ffa640 1 --2- 172.21.15.55:0/218290515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66100b2e40 0x7f66100b7550 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.503+0000 7f6616ffa640 1 -- 172.21.15.55:0/218290515 >> 172.21.15.55:0/218290515 conn(0x7f661009bae0 msgr2=0x7f661006b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:58.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.503+0000 7f6616ffa640 1 -- 172.21.15.55:0/218290515 shutdown_connections 2023-08-25T04:02:58.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.503+0000 7f6616ffa640 1 -- 172.21.15.55:0/218290515 wait complete. 2023-08-25T04:02:58.523 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-25T04:02:58.524 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-25T04:02:58.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.667+0000 7f0556488640 1 Processor -- start 2023-08-25T04:02:58.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.667+0000 7f0556488640 1 -- start start 2023-08-25T04:02:58.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.671+0000 7f0556488640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05500afa20 0x7f05500b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:58.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.671+0000 7f0556488640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05500cd870 0x7f05500ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:58.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.671+0000 7f0556488640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05500cae70 con 0x7f05500cf9b0 2023-08-25T04:02:58.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.671+0000 7f0556488640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05500cfe10 con 0x7f05500cd870 2023-08-25T04:02:58.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.671+0000 7f0556488640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05500cb0e0 con 0x7f05500afa20 2023-08-25T04:02:58.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.671+0000 7f0554a25640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05500cd870 0x7f05500ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:58.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.671+0000 7f0554a25640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05500cd870 0x7f05500ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48810/0 (socket says 172.21.15.55:48810) 2023-08-25T04:02:58.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.671+0000 7f0554a25640 1 -- 172.21.15.55:0/1972103073 learned_addr learned my addr 172.21.15.55:0/1972103073 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:58.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.671+0000 7f054ffff640 1 --2- 172.21.15.55:0/1972103073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05500afa20 0x7f05500b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:58.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.671+0000 7f0554a25640 1 -- 172.21.15.55:0/1972103073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05500afa20 msgr2=0x7f05500b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:02:58.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.671+0000 7f0554a25640 1 --2- 172.21.15.55:0/1972103073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05500afa20 0x7f05500b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.671+0000 7f0554a25640 1 -- 172.21.15.55:0/1972103073 >> v1:172.21.15.110:6789/0 conn(0x7f05500cf9b0 legacy=0x7f05500cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:58.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.671+0000 7f0554a25640 1 -- 172.21.15.55:0/1972103073 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05500cb3c0 con 0x7f05500cd870 2023-08-25T04:02:58.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.675+0000 7f0554a25640 1 --2- 172.21.15.55:0/1972103073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05500cd870 0x7f05500ce9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0548009e50 tx=0x7f054801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec53fa114940c076 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:58.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.675+0000 7f054effd640 1 -- 172.21.15.55:0/1972103073 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05480a5810 con 0x7f05500cd870 2023-08-25T04:02:58.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.675+0000 7f054effd640 1 -- 172.21.15.55:0/1972103073 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05480a5970 con 0x7f05500cd870 2023-08-25T04:02:58.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.675+0000 7f054effd640 1 -- 172.21.15.55:0/1972103073 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05480a5d00 con 0x7f05500cd870 2023-08-25T04:02:58.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.675+0000 7f0556488640 1 -- 172.21.15.55:0/1972103073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05500cd870 msgr2=0x7f05500ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:58.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.675+0000 7f0556488640 1 --2- 172.21.15.55:0/1972103073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05500cd870 0x7f05500ce9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0548009e50 tx=0x7f054801c950 comp rx=0 tx=0).stop 2023-08-25T04:02:58.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.675+0000 7f0556488640 1 -- 172.21.15.55:0/1972103073 shutdown_connections 2023-08-25T04:02:58.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.675+0000 7f0556488640 1 --2- 172.21.15.55:0/1972103073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05500cd870 0x7f05500ce9c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.675+0000 7f0556488640 1 --2- 172.21.15.55:0/1972103073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05500afa20 0x7f05500b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.675+0000 7f0556488640 1 -- 172.21.15.55:0/1972103073 >> 172.21.15.55:0/1972103073 conn(0x7f05500d0780 msgr2=0x7f05500d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:58.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.675+0000 7f0556488640 1 -- 172.21.15.55:0/1972103073 shutdown_connections 2023-08-25T04:02:58.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.675+0000 7f0556488640 1 -- 172.21.15.55:0/1972103073 wait complete. 2023-08-25T04:02:58.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f0556488640 1 Processor -- start 2023-08-25T04:02:58.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f0556488640 1 -- start start 2023-08-25T04:02:58.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f0556488640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05500afa20 0x7f05500c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:58.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f0556488640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05500cd870 0x7f05501459a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:58.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f0556488640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05500cf9b0 0x7f05500c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:58.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f0556488640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05500c45a0 con 0x7f05500cf9b0 2023-08-25T04:02:58.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f0556488640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05500c79b0 con 0x7f05500afa20 2023-08-25T04:02:58.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f0556488640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05500c6bf0 con 0x7f05500cd870 2023-08-25T04:02:58.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f0554a25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05500cf9b0 0x7f05500c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:58.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f0554a25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05500cf9b0 0x7f05500c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48818/0 (socket says 172.21.15.55:48818) 2023-08-25T04:02:58.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f0554a25640 1 -- 172.21.15.55:0/735187165 learned_addr learned my addr 172.21.15.55:0/735187165 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:58.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f054ffff640 1 --2- 172.21.15.55:0/735187165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05500afa20 0x7f05500c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:58.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f054f7fe640 1 --2- 172.21.15.55:0/735187165 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05500cd870 0x7f05501459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:58.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f0554a25640 1 -- 172.21.15.55:0/735187165 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05500cd870 msgr2=0x7f05501459a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:58.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f0554a25640 1 --2- 172.21.15.55:0/735187165 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05500cd870 0x7f05501459a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f0554a25640 1 -- 172.21.15.55:0/735187165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05500afa20 msgr2=0x7f05500c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:58.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f0554a25640 1 --2- 172.21.15.55:0/735187165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05500afa20 0x7f05500c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:58.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f0554a25640 1 -- 172.21.15.55:0/735187165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0548009b30 con 0x7f05500cf9b0 2023-08-25T04:02:58.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.679+0000 7f0554a25640 1 --2- 172.21.15.55:0/735187165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05500cf9b0 0x7f05500c9e50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f054801a580 tx=0x7f05480196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:58.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.683+0000 7f054cff9640 1 -- 172.21.15.55:0/735187165 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05480b8670 con 0x7f05500cf9b0 2023-08-25T04:02:58.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.683+0000 7f054cff9640 1 -- 172.21.15.55:0/735187165 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05480b87d0 con 0x7f05500cf9b0 2023-08-25T04:02:58.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.683+0000 7f0556488640 1 -- 172.21.15.55:0/735187165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05500c6ed0 con 0x7f05500cf9b0 2023-08-25T04:02:58.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.683+0000 7f054cff9640 1 -- 172.21.15.55:0/735187165 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05480b8b60 con 0x7f05500cf9b0 2023-08-25T04:02:58.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.683+0000 7f0556488640 1 -- 172.21.15.55:0/735187165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05500c7490 con 0x7f05500cf9b0 2023-08-25T04:02:58.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.683+0000 7f0556488640 1 -- 172.21.15.55:0/735187165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05500c7b20 con 0x7f05500cf9b0 2023-08-25T04:02:58.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.683+0000 7f054cff9640 1 -- 172.21.15.55:0/735187165 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f05480b8cc0 con 0x7f05500cf9b0 2023-08-25T04:02:58.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.683+0000 7f054cff9640 1 --2- 172.21.15.55:0/735187165 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f053c065680 0x7f053c067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:58.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.683+0000 7f054cff9640 1 -- 172.21.15.55:0/735187165 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f054811dff0 con 0x7f05500cf9b0 2023-08-25T04:02:58.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.683+0000 7f054ffff640 1 --2- 172.21.15.55:0/735187165 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f053c065680 0x7f053c067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:58.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.687+0000 7f054ffff640 1 --2- 172.21.15.55:0/735187165 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f053c065680 0x7f053c067b40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0540009b60 tx=0x7f0540009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.687+0000 7f054cff9640 1 -- 172.21.15.55:0/735187165 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f054814ed90 con 0x7f05500cf9b0 2023-08-25T04:02:58.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:58.843+0000 7f0556488640 1 -- 172.21.15.55:0/735187165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f05500cde80 con 0x7f05500cf9b0 2023-08-25T04:02:59.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.687+0000 7f054cff9640 1 -- 172.21.15.55:0/735187165 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f05480ec000 con 0x7f05500cf9b0 2023-08-25T04:02:59.690 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-08-25T04:02:59.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.691+0000 7f0556488640 1 -- 172.21.15.55:0/735187165 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f053c065680 msgr2=0x7f053c067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.691+0000 7f0556488640 1 --2- 172.21.15.55:0/735187165 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f053c065680 0x7f053c067b40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0540009b60 tx=0x7f0540009190 comp rx=0 tx=0).stop 2023-08-25T04:02:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.691+0000 7f0556488640 1 -- 172.21.15.55:0/735187165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05500cf9b0 msgr2=0x7f05500c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.691+0000 7f0556488640 1 --2- 172.21.15.55:0/735187165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05500cf9b0 0x7f05500c9e50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f054801a580 tx=0x7f05480196f0 comp rx=0 tx=0).stop 2023-08-25T04:02:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.691+0000 7f0556488640 1 -- 172.21.15.55:0/735187165 shutdown_connections 2023-08-25T04:02:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.691+0000 7f0556488640 1 --2- 172.21.15.55:0/735187165 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f053c065680 0x7f053c067b40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.691+0000 7f0556488640 1 --2- 172.21.15.55:0/735187165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05500cf9b0 0x7f05500c9e50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.691+0000 7f0556488640 1 --2- 172.21.15.55:0/735187165 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05500cd870 0x7f05501459a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.691+0000 7f0556488640 1 --2- 172.21.15.55:0/735187165 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05500afa20 0x7f05500c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.691+0000 7f0556488640 1 -- 172.21.15.55:0/735187165 >> 172.21.15.55:0/735187165 conn(0x7f05500d0780 msgr2=0x7f05500b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.695+0000 7f0556488640 1 -- 172.21.15.55:0/735187165 shutdown_connections 2023-08-25T04:02:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.695+0000 7f0556488640 1 -- 172.21.15.55:0/735187165 wait complete. 2023-08-25T04:02:59.721 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-25T04:02:59.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.871+0000 7fe3f6234640 1 Processor -- start 2023-08-25T04:02:59.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.875+0000 7fe3f6234640 1 -- start start 2023-08-25T04:02:59.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.875+0000 7fe3f6234640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe3f015e3c0 0x7fe3f015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:59.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.875+0000 7fe3f6234640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f00cd5a0 con 0x7fe3f00d1290 2023-08-25T04:02:59.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.875+0000 7fe3f6234640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f00cd880 con 0x7fe3f01601f0 2023-08-25T04:02:59.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.875+0000 7fe3f6234640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f00cdb60 con 0x7fe3f015e3c0 2023-08-25T04:02:59.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.875+0000 7fe3effff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe3f00d1290 0x7fe3f015e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58970/0 (socket says 172.21.15.55:58970) 2023-08-25T04:02:59.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.875+0000 7fe3effff640 1 -- 172.21.15.55:0/1975764110 learned_addr learned my addr 172.21.15.55:0/1975764110 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:02:59.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.875+0000 7fe3eeffd640 1 --2- 172.21.15.55:0/1975764110 >> v2:172.21.15.110:3300/0 conn(0x7fe3f015e3c0 0x7fe3f015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:59.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.875+0000 7fe3ee7fc640 1 -- 172.21.15.55:0/1975764110 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292153421 0 0) 0x7fe3f00cd5a0 con 0x7fe3f00d1290 2023-08-25T04:02:59.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.875+0000 7fe3ee7fc640 1 -- 172.21.15.55:0/1975764110 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3d8003530 con 0x7fe3f00d1290 2023-08-25T04:02:59.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.875+0000 7fe3eeffd640 1 -- 172.21.15.55:0/1975764110 >> v1:172.21.15.110:6789/0 conn(0x7fe3f01601f0 legacy=0x7fe3f00d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:59.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.875+0000 7fe3ee7fc640 1 -- 172.21.15.55:0/1975764110 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746100433 0 0) 0x7fe3f00cd880 con 0x7fe3f01601f0 2023-08-25T04:02:59.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.875+0000 7fe3eeffd640 1 -- 172.21.15.55:0/1975764110 >> v1:172.21.15.55:6789/0 conn(0x7fe3f00d1290 legacy=0x7fe3f015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:59.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.875+0000 7fe3eeffd640 1 -- 172.21.15.55:0/1975764110 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f00cde40 con 0x7fe3f015e3c0 2023-08-25T04:02:59.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.879+0000 7fe3eeffd640 1 --2- 172.21.15.55:0/1975764110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3f015e3c0 0x7fe3f015d430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40097c0 tx=0x7fe3e401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c2269cf5e197ba5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:59.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.879+0000 7fe3ee7fc640 1 -- 172.21.15.55:0/1975764110 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e40ab600 con 0x7fe3f015e3c0 2023-08-25T04:02:59.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.879+0000 7fe3ee7fc640 1 -- 172.21.15.55:0/1975764110 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e40a7050 con 0x7fe3f015e3c0 2023-08-25T04:02:59.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.879+0000 7fe3ee7fc640 1 -- 172.21.15.55:0/1975764110 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e40ab980 con 0x7fe3f015e3c0 2023-08-25T04:02:59.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.879+0000 7fe3f6234640 1 -- 172.21.15.55:0/1975764110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3f015e3c0 msgr2=0x7fe3f015d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:59.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.879+0000 7fe3f6234640 1 --2- 172.21.15.55:0/1975764110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3f015e3c0 0x7fe3f015d430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40097c0 tx=0x7fe3e401c450 comp rx=0 tx=0).stop 2023-08-25T04:02:59.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.879+0000 7fe3f6234640 1 -- 172.21.15.55:0/1975764110 shutdown_connections 2023-08-25T04:02:59.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.879+0000 7fe3f6234640 1 --2- 172.21.15.55:0/1975764110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3f015e3c0 0x7fe3f015d430 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:59.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.879+0000 7fe3f6234640 1 -- 172.21.15.55:0/1975764110 >> 172.21.15.55:0/1975764110 conn(0x7fe3f00d27d0 msgr2=0x7fe3f00d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:02:59.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.879+0000 7fe3f6234640 1 -- 172.21.15.55:0/1975764110 shutdown_connections 2023-08-25T04:02:59.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.879+0000 7fe3f6234640 1 -- 172.21.15.55:0/1975764110 wait complete. 2023-08-25T04:02:59.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.879+0000 7fe3f6234640 1 Processor -- start 2023-08-25T04:02:59.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.879+0000 7fe3f6234640 1 -- start start 2023-08-25T04:02:59.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3f6234640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3f00d1290 0x7fe3f013a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:59.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3f6234640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3f015e3c0 0x7fe3f0153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:59.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3f6234640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3f01601f0 0x7fe3f0154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:59.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3f6234640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f00c42d0 con 0x7fe3f00d1290 2023-08-25T04:02:59.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3f6234640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f013b160 con 0x7fe3f015e3c0 2023-08-25T04:02:59.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3f6234640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f013a8c0 con 0x7fe3f01601f0 2023-08-25T04:02:59.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3ef7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3f00d1290 0x7fe3f013a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:59.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3ef7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3f00d1290 0x7fe3f013a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48830/0 (socket says 172.21.15.55:48830) 2023-08-25T04:02:59.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3ef7fe640 1 -- 172.21.15.55:0/1301964646 learned_addr learned my addr 172.21.15.55:0/1301964646 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:02:59.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3effff640 1 --2- 172.21.15.55:0/1301964646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3f01601f0 0x7fe3f0154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:59.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3eeffd640 1 --2- 172.21.15.55:0/1301964646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3f015e3c0 0x7fe3f0153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:59.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3ef7fe640 1 -- 172.21.15.55:0/1301964646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3f01601f0 msgr2=0x7fe3f0154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:59.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3ef7fe640 1 --2- 172.21.15.55:0/1301964646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3f01601f0 0x7fe3f0154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:59.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3ef7fe640 1 -- 172.21.15.55:0/1301964646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3f015e3c0 msgr2=0x7fe3f0153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:02:59.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3ef7fe640 1 --2- 172.21.15.55:0/1301964646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3f015e3c0 0x7fe3f0153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:02:59.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3ef7fe640 1 -- 172.21.15.55:0/1301964646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e4009420 con 0x7fe3f00d1290 2023-08-25T04:02:59.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3ef7fe640 1 --2- 172.21.15.55:0/1301964646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3f00d1290 0x7fe3f013a200 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000c440 tx=0x7fe3e000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:59.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3d7fff640 1 -- 172.21.15.55:0/1301964646 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0005480 con 0x7fe3f00d1290 2023-08-25T04:02:59.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3d7fff640 1 -- 172.21.15.55:0/1301964646 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e0003650 con 0x7fe3f00d1290 2023-08-25T04:02:59.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3f6234640 1 -- 172.21.15.55:0/1301964646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f013aba0 con 0x7fe3f00d1290 2023-08-25T04:02:59.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3d7fff640 1 -- 172.21.15.55:0/1301964646 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0003a00 con 0x7fe3f00d1290 2023-08-25T04:02:59.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3f6234640 1 -- 172.21.15.55:0/1301964646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f0154990 con 0x7fe3f00d1290 2023-08-25T04:02:59.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.883+0000 7fe3f6234640 1 -- 172.21.15.55:0/1301964646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f00b5260 con 0x7fe3f00d1290 2023-08-25T04:02:59.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.887+0000 7fe3d7fff640 1 -- 172.21.15.55:0/1301964646 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe3e0003b60 con 0x7fe3f00d1290 2023-08-25T04:02:59.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.887+0000 7fe3d7fff640 1 --2- 172.21.15.55:0/1301964646 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe3dc065680 0x7fe3dc067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:02:59.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.887+0000 7fe3d7fff640 1 -- 172.21.15.55:0/1301964646 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fe3e0082130 con 0x7fe3f00d1290 2023-08-25T04:02:59.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.887+0000 7fe3eeffd640 1 --2- 172.21.15.55:0/1301964646 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe3dc065680 0x7fe3dc067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:02:59.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.887+0000 7fe3eeffd640 1 --2- 172.21.15.55:0/1301964646 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe3dc065680 0x7fe3dc067b40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40ad000 tx=0x7fe3e40a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:02:59.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:02:59.891+0000 7fe3d7fff640 1 -- 172.21.15.55:0/1301964646 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe3e004fde0 con 0x7fe3f00d1290 2023-08-25T04:03:00.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.047+0000 7fe3f6234640 1 -- 172.21.15.55:0/1301964646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe3f0073ec0 con 0x7fe3f00d1290 2023-08-25T04:03:00.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.695+0000 7fe3d7fff640 1 -- 172.21.15.55:0/1301964646 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe3e0053400 con 0x7fe3f00d1290 2023-08-25T04:03:00.700 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-08-25T04:03:00.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.703+0000 7fe3f6234640 1 -- 172.21.15.55:0/1301964646 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe3dc065680 msgr2=0x7fe3dc067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.711+0000 7fe3f6234640 1 --2- 172.21.15.55:0/1301964646 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe3dc065680 0x7fe3dc067b40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40ad000 tx=0x7fe3e40a6000 comp rx=0 tx=0).stop 2023-08-25T04:03:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.711+0000 7fe3f6234640 1 -- 172.21.15.55:0/1301964646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3f00d1290 msgr2=0x7fe3f013a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.711+0000 7fe3f6234640 1 --2- 172.21.15.55:0/1301964646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3f00d1290 0x7fe3f013a200 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000c440 tx=0x7fe3e000c900 comp rx=0 tx=0).stop 2023-08-25T04:03:00.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.715+0000 7fe3f6234640 1 -- 172.21.15.55:0/1301964646 shutdown_connections 2023-08-25T04:03:00.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.715+0000 7fe3f6234640 1 --2- 172.21.15.55:0/1301964646 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe3dc065680 0x7fe3dc067b40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:00.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.715+0000 7fe3f6234640 1 --2- 172.21.15.55:0/1301964646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3f01601f0 0x7fe3f0154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:00.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.715+0000 7fe3f6234640 1 --2- 172.21.15.55:0/1301964646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3f015e3c0 0x7fe3f0153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:00.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.715+0000 7fe3f6234640 1 --2- 172.21.15.55:0/1301964646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3f00d1290 0x7fe3f013a200 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:00.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.715+0000 7fe3f6234640 1 -- 172.21.15.55:0/1301964646 >> 172.21.15.55:0/1301964646 conn(0x7fe3f00d27d0 msgr2=0x7fe3f015e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:00.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.715+0000 7fe3f6234640 1 -- 172.21.15.55:0/1301964646 shutdown_connections 2023-08-25T04:03:00.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.715+0000 7fe3f6234640 1 -- 172.21.15.55:0/1301964646 wait complete. 2023-08-25T04:03:00.744 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-25T04:03:00.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.887+0000 7f3514f8f640 1 Processor -- start 2023-08-25T04:03:00.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.887+0000 7f3514f8f640 1 -- start start 2023-08-25T04:03:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.891+0000 7f3514f8f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f35101601f0 0x7f351015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.891+0000 7f3514f8f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f351015e3c0 0x7f35100d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.891+0000 7f3514f8f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35100d10c0 0x7f35100b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.891+0000 7f3514f8f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35100cd5a0 con 0x7f351015e3c0 2023-08-25T04:03:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.891+0000 7f3514f8f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35100cd880 con 0x7f35101601f0 2023-08-25T04:03:00.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.891+0000 7f3514f8f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35100cdb60 con 0x7f35100d10c0 2023-08-25T04:03:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.891+0000 7f3505d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f351015e3c0 0x7f35100d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.891+0000 7f3505d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f351015e3c0 0x7f35100d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35264/0 (socket says 172.21.15.55:35264) 2023-08-25T04:03:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.891+0000 7f3505d9b640 1 -- 172.21.15.55:0/3327335337 learned_addr learned my addr 172.21.15.55:0/3327335337 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.891+0000 7f350e59c640 1 --2- 172.21.15.55:0/3327335337 >> v2:172.21.15.110:3300/0 conn(0x7f35101601f0 0x7f351015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.891+0000 7f350ed9d640 1 --2- 172.21.15.55:0/3327335337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35100d10c0 0x7f35100b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.891+0000 7f3505d9b640 1 -- 172.21.15.55:0/3327335337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35100d10c0 msgr2=0x7f35100b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:00.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.891+0000 7f3505d9b640 1 --2- 172.21.15.55:0/3327335337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35100d10c0 0x7f35100b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:00.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.891+0000 7f3505d9b640 1 -- 172.21.15.55:0/3327335337 >> v2:172.21.15.110:3300/0 conn(0x7f35101601f0 msgr2=0x7f351015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:00.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.891+0000 7f3505d9b640 1 --2- 172.21.15.55:0/3327335337 >> v2:172.21.15.110:3300/0 conn(0x7f35101601f0 0x7f351015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:00.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.891+0000 7f3505d9b640 1 -- 172.21.15.55:0/3327335337 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35100cde40 con 0x7f351015e3c0 2023-08-25T04:03:00.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.895+0000 7f3505d9b640 1 --2- 172.21.15.55:0/3327335337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f351015e3c0 0x7f35100d0b80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f351008b7f0 tx=0x7f34f801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48352d521591605e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:00.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.895+0000 7f350dd9b640 1 -- 172.21.15.55:0/3327335337 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f80a89b0 con 0x7f351015e3c0 2023-08-25T04:03:00.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.895+0000 7f350dd9b640 1 -- 172.21.15.55:0/3327335337 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f80a8b10 con 0x7f351015e3c0 2023-08-25T04:03:00.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.895+0000 7f350dd9b640 1 -- 172.21.15.55:0/3327335337 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f80a8ea0 con 0x7f351015e3c0 2023-08-25T04:03:00.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.895+0000 7f3514f8f640 1 -- 172.21.15.55:0/3327335337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f351015e3c0 msgr2=0x7f35100d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:00.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.895+0000 7f3514f8f640 1 --2- 172.21.15.55:0/3327335337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f351015e3c0 0x7f35100d0b80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f351008b7f0 tx=0x7f34f801ecf0 comp rx=0 tx=0).stop 2023-08-25T04:03:00.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.895+0000 7f3514f8f640 1 -- 172.21.15.55:0/3327335337 shutdown_connections 2023-08-25T04:03:00.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.895+0000 7f3514f8f640 1 --2- 172.21.15.55:0/3327335337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35100d10c0 0x7f35100b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:00.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.895+0000 7f3514f8f640 1 --2- 172.21.15.55:0/3327335337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f351015e3c0 0x7f35100d0b80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:00.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.895+0000 7f3514f8f640 1 --2- 172.21.15.55:0/3327335337 >> v2:172.21.15.110:3300/0 conn(0x7f35101601f0 0x7f351015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:00.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.895+0000 7f3514f8f640 1 -- 172.21.15.55:0/3327335337 >> 172.21.15.55:0/3327335337 conn(0x7f35100d27d0 msgr2=0x7f35100d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:00.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.895+0000 7f3514f8f640 1 -- 172.21.15.55:0/3327335337 shutdown_connections 2023-08-25T04:03:00.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.895+0000 7f3514f8f640 1 -- 172.21.15.55:0/3327335337 wait complete. 2023-08-25T04:03:00.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.895+0000 7f3514f8f640 1 Processor -- start 2023-08-25T04:03:00.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.895+0000 7f3514f8f640 1 -- start start 2023-08-25T04:03:00.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f3514f8f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35100d10c0 0x7f351015c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:00.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f3514f8f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f351015e3c0 0x7f351009d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:00.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f3514f8f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35101601f0 0x7f35100c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:00.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f3514f8f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351009fc20 con 0x7f35100d10c0 2023-08-25T04:03:00.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f3514f8f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351009ff00 con 0x7f351015e3c0 2023-08-25T04:03:00.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f3514f8f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35100a01e0 con 0x7f35101601f0 2023-08-25T04:03:00.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f350e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35100d10c0 0x7f351015c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:00.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f350e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35100d10c0 0x7f351015c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35270/0 (socket says 172.21.15.55:35270) 2023-08-25T04:03:00.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f350e59c640 1 -- 172.21.15.55:0/3836114375 learned_addr learned my addr 172.21.15.55:0/3836114375 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:00.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f350ed9d640 1 --2- 172.21.15.55:0/3836114375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35101601f0 0x7f35100c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:00.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f3505d9b640 1 --2- 172.21.15.55:0/3836114375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f351015e3c0 0x7f351009d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:00.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f350e59c640 1 -- 172.21.15.55:0/3836114375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35101601f0 msgr2=0x7f35100c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:00.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f350e59c640 1 --2- 172.21.15.55:0/3836114375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35101601f0 0x7f35100c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:00.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f350e59c640 1 -- 172.21.15.55:0/3836114375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f351015e3c0 msgr2=0x7f351009d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:00.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f350e59c640 1 --2- 172.21.15.55:0/3836114375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f351015e3c0 0x7f351009d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:00.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f350e59c640 1 -- 172.21.15.55:0/3836114375 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f80094d0 con 0x7f35100d10c0 2023-08-25T04:03:00.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f3505d9b640 1 --2- 172.21.15.55:0/3836114375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f351015e3c0 0x7f351009d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:00.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f350ed9d640 1 --2- 172.21.15.55:0/3836114375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35101601f0 0x7f35100c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:00.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f350e59c640 1 --2- 172.21.15.55:0/3836114375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35100d10c0 0x7f351015c440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f350000e870 tx=0x7f350000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:00.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f35077fe640 1 -- 172.21.15.55:0/3836114375 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35000095d0 con 0x7f35100d10c0 2023-08-25T04:03:00.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f35077fe640 1 -- 172.21.15.55:0/3836114375 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350000c940 con 0x7f35100d10c0 2023-08-25T04:03:00.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f35077fe640 1 -- 172.21.15.55:0/3836114375 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350000ccb0 con 0x7f35100d10c0 2023-08-25T04:03:00.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f3514f8f640 1 -- 172.21.15.55:0/3836114375 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35100ce7c0 con 0x7f35100d10c0 2023-08-25T04:03:00.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f3514f8f640 1 -- 172.21.15.55:0/3836114375 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35100caf60 con 0x7f35100d10c0 2023-08-25T04:03:00.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f3514f8f640 1 -- 172.21.15.55:0/3836114375 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35100b5260 con 0x7f35100d10c0 2023-08-25T04:03:00.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.899+0000 7f35077fe640 1 -- 172.21.15.55:0/3836114375 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f3500013470 con 0x7f35100d10c0 2023-08-25T04:03:00.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.903+0000 7f35077fe640 1 --2- 172.21.15.55:0/3836114375 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f34f0065680 0x7f34f0067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:00.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.903+0000 7f35077fe640 1 -- 172.21.15.55:0/3836114375 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f3500083390 con 0x7f35100d10c0 2023-08-25T04:03:00.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.903+0000 7f3505d9b640 1 --2- 172.21.15.55:0/3836114375 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f34f0065680 0x7f34f0067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:00.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.903+0000 7f3505d9b640 1 --2- 172.21.15.55:0/3836114375 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f34f0065680 0x7f34f0067b40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f34f80b2000 tx=0x7f34f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:00.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:00.907+0000 7f35077fe640 1 -- 172.21.15.55:0/3836114375 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3500054960 con 0x7f35100d10c0 2023-08-25T04:03:01.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.095+0000 7f3514f8f640 1 -- 172.21.15.55:0/3836114375 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f351009fd60 con 0x7f35100d10c0 2023-08-25T04:03:01.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.695+0000 7f35077fe640 1 -- 172.21.15.55:0/3836114375 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f351009fd60 con 0x7f35100d10c0 2023-08-25T04:03:01.699 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 3 and data pool 4 2023-08-25T04:03:01.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.699+0000 7f3514f8f640 1 -- 172.21.15.55:0/3836114375 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f34f0065680 msgr2=0x7f34f0067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:01.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.699+0000 7f3514f8f640 1 --2- 172.21.15.55:0/3836114375 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f34f0065680 0x7f34f0067b40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f34f80b2000 tx=0x7f34f8008040 comp rx=0 tx=0).stop 2023-08-25T04:03:01.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.699+0000 7f3514f8f640 1 -- 172.21.15.55:0/3836114375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35100d10c0 msgr2=0x7f351015c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:01.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.699+0000 7f3514f8f640 1 --2- 172.21.15.55:0/3836114375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35100d10c0 0x7f351015c440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f350000e870 tx=0x7f350000ed30 comp rx=0 tx=0).stop 2023-08-25T04:03:01.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.699+0000 7f3514f8f640 1 -- 172.21.15.55:0/3836114375 shutdown_connections 2023-08-25T04:03:01.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.699+0000 7f3514f8f640 1 --2- 172.21.15.55:0/3836114375 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f34f0065680 0x7f34f0067b40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:01.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.699+0000 7f3514f8f640 1 --2- 172.21.15.55:0/3836114375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35101601f0 0x7f35100c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:01.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.699+0000 7f3514f8f640 1 --2- 172.21.15.55:0/3836114375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f351015e3c0 0x7f351009d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:01.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.699+0000 7f3514f8f640 1 --2- 172.21.15.55:0/3836114375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35100d10c0 0x7f351015c440 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:01.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.699+0000 7f3514f8f640 1 -- 172.21.15.55:0/3836114375 >> 172.21.15.55:0/3836114375 conn(0x7f35100d27d0 msgr2=0x7f35100d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:01.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.699+0000 7f3514f8f640 1 -- 172.21.15.55:0/3836114375 shutdown_connections 2023-08-25T04:03:01.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.699+0000 7f3514f8f640 1 -- 172.21.15.55:0/3836114375 wait complete. 2023-08-25T04:03:01.728 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:01.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.871+0000 7efd3bb59640 1 Processor -- start 2023-08-25T04:03:01.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.871+0000 7efd3bb59640 1 -- start start 2023-08-25T04:03:01.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.871+0000 7efd3bb59640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd340d0da0 0x7efd340d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:01.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.871+0000 7efd3bb59640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd340cdde0 0x7efd340ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:01.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.871+0000 7efd3bb59640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efd340cee60 0x7efd340cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:01.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.871+0000 7efd3bb59640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd340ce760 con 0x7efd340cdde0 2023-08-25T04:03:01.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.871+0000 7efd3bb59640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd340b29b0 con 0x7efd340cee60 2023-08-25T04:03:01.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.871+0000 7efd3bb59640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd340d16c0 con 0x7efd340d0da0 2023-08-25T04:03:01.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.871+0000 7efd390f4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd340cdde0 0x7efd340ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:01.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.871+0000 7efd390f4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd340cdde0 0x7efd340ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35280/0 (socket says 172.21.15.55:35280) 2023-08-25T04:03:01.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.871+0000 7efd390f4640 1 -- 172.21.15.55:0/3282525980 learned_addr learned my addr 172.21.15.55:0/3282525980 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:01.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.871+0000 7efd398f5640 1 --2- 172.21.15.55:0/3282525980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd340d0da0 0x7efd340d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:01.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.871+0000 7efd3a0f6640 1 --2- 172.21.15.55:0/3282525980 >> v2:172.21.15.110:3300/0 conn(0x7efd340cee60 0x7efd340cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:01.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.871+0000 7efd390f4640 1 -- 172.21.15.55:0/3282525980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd340d0da0 msgr2=0x7efd340d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:01.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.871+0000 7efd390f4640 1 --2- 172.21.15.55:0/3282525980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd340d0da0 0x7efd340d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:01.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.871+0000 7efd390f4640 1 -- 172.21.15.55:0/3282525980 >> v2:172.21.15.110:3300/0 conn(0x7efd340cee60 msgr2=0x7efd340cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:01.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.871+0000 7efd390f4640 1 --2- 172.21.15.55:0/3282525980 >> v2:172.21.15.110:3300/0 conn(0x7efd340cee60 0x7efd340cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:01.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.871+0000 7efd390f4640 1 -- 172.21.15.55:0/3282525980 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd340b1dc0 con 0x7efd340cdde0 2023-08-25T04:03:01.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.875+0000 7efd390f4640 1 --2- 172.21.15.55:0/3282525980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd340cdde0 0x7efd340ce220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd340b1bd0 tx=0x7efd2401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929873f8636c113f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:01.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.875+0000 7efd388f3640 1 -- 172.21.15.55:0/3282525980 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd240a89b0 con 0x7efd340cdde0 2023-08-25T04:03:01.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.875+0000 7efd388f3640 1 -- 172.21.15.55:0/3282525980 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd240a8b10 con 0x7efd340cdde0 2023-08-25T04:03:01.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.875+0000 7efd388f3640 1 -- 172.21.15.55:0/3282525980 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd240a8ea0 con 0x7efd340cdde0 2023-08-25T04:03:01.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.875+0000 7efd3bb59640 1 -- 172.21.15.55:0/3282525980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd340cdde0 msgr2=0x7efd340ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:01.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.875+0000 7efd3bb59640 1 --2- 172.21.15.55:0/3282525980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd340cdde0 0x7efd340ce220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd340b1bd0 tx=0x7efd2401ecf0 comp rx=0 tx=0).stop 2023-08-25T04:03:01.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.875+0000 7efd3bb59640 1 -- 172.21.15.55:0/3282525980 shutdown_connections 2023-08-25T04:03:01.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.875+0000 7efd3bb59640 1 --2- 172.21.15.55:0/3282525980 >> v2:172.21.15.110:3300/0 conn(0x7efd340cee60 0x7efd340cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:01.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.875+0000 7efd3bb59640 1 --2- 172.21.15.55:0/3282525980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd340cdde0 0x7efd340ce220 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:01.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.875+0000 7efd3bb59640 1 --2- 172.21.15.55:0/3282525980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd340d0da0 0x7efd340d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:01.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.875+0000 7efd3bb59640 1 -- 172.21.15.55:0/3282525980 >> 172.21.15.55:0/3282525980 conn(0x7efd3409bae0 msgr2=0x7efd340d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:01.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.875+0000 7efd3bb59640 1 -- 172.21.15.55:0/3282525980 shutdown_connections 2023-08-25T04:03:01.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.875+0000 7efd3bb59640 1 -- 172.21.15.55:0/3282525980 wait complete. 2023-08-25T04:03:01.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3bb59640 1 Processor -- start 2023-08-25T04:03:01.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3bb59640 1 -- start start 2023-08-25T04:03:01.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3bb59640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd340cdde0 0x7efd34151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:01.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3bb59640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd340cee60 0x7efd340b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:01.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3bb59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd340d0da0 0x7efd3415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:01.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3bb59640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd340b57c0 con 0x7efd340d0da0 2023-08-25T04:03:01.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3bb59640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd340b5aa0 con 0x7efd340cee60 2023-08-25T04:03:01.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3bb59640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd340b5d80 con 0x7efd340cdde0 2023-08-25T04:03:01.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3a0f6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd340d0da0 0x7efd3415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:01.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3a0f6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd340d0da0 0x7efd3415aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35282/0 (socket says 172.21.15.55:35282) 2023-08-25T04:03:01.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3a0f6640 1 -- 172.21.15.55:0/1378216437 learned_addr learned my addr 172.21.15.55:0/1378216437 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:01.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd390f4640 1 --2- 172.21.15.55:0/1378216437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd340cee60 0x7efd340b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:01.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd398f5640 1 --2- 172.21.15.55:0/1378216437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd340cdde0 0x7efd34151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:01.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3a0f6640 1 -- 172.21.15.55:0/1378216437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd340cdde0 msgr2=0x7efd34151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:01.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3a0f6640 1 --2- 172.21.15.55:0/1378216437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd340cdde0 0x7efd34151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:01.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3a0f6640 1 -- 172.21.15.55:0/1378216437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd340cee60 msgr2=0x7efd340b6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:01.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3a0f6640 1 --2- 172.21.15.55:0/1378216437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd340cee60 0x7efd340b6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:01.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3a0f6640 1 -- 172.21.15.55:0/1378216437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd240094d0 con 0x7efd340d0da0 2023-08-25T04:03:01.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3a0f6640 1 --2- 172.21.15.55:0/1378216437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd340d0da0 0x7efd3415aaa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd2c007d20 tx=0x7efd2c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:01.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd2a7fc640 1 -- 172.21.15.55:0/1378216437 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c014420 con 0x7efd340d0da0 2023-08-25T04:03:01.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd2a7fc640 1 -- 172.21.15.55:0/1378216437 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2c0145a0 con 0x7efd340d0da0 2023-08-25T04:03:01.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3bb59640 1 -- 172.21.15.55:0/1378216437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd340b6060 con 0x7efd340d0da0 2023-08-25T04:03:01.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd2a7fc640 1 -- 172.21.15.55:0/1378216437 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c014950 con 0x7efd340d0da0 2023-08-25T04:03:01.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.879+0000 7efd3bb59640 1 -- 172.21.15.55:0/1378216437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd340b53e0 con 0x7efd340d0da0 2023-08-25T04:03:01.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.883+0000 7efd3bb59640 1 -- 172.21.15.55:0/1378216437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd340b6510 con 0x7efd340d0da0 2023-08-25T04:03:01.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.883+0000 7efd2a7fc640 1 -- 172.21.15.55:0/1378216437 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7efd2c014ab0 con 0x7efd340d0da0 2023-08-25T04:03:01.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.883+0000 7efd2a7fc640 1 --2- 172.21.15.55:0/1378216437 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7efd18065680 0x7efd18067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:01.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.883+0000 7efd2a7fc640 1 -- 172.21.15.55:0/1378216437 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efd2c083810 con 0x7efd340d0da0 2023-08-25T04:03:01.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.883+0000 7efd398f5640 1 --2- 172.21.15.55:0/1378216437 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7efd18065680 0x7efd18067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:01.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.883+0000 7efd398f5640 1 --2- 172.21.15.55:0/1378216437 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7efd18065680 0x7efd18067b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efd30006fd0 tx=0x7efd30008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:01.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:01.887+0000 7efd2a7fc640 1 -- 172.21.15.55:0/1378216437 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7efd340b6510 con 0x7efd340d0da0 2023-08-25T04:03:02.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.047+0000 7efd3bb59640 1 -- 172.21.15.55:0/1378216437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd340b6510 con 0x7efd340d0da0 2023-08-25T04:03:02.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.047+0000 7efd2a7fc640 1 -- 172.21.15.55:0/1378216437 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18304 (secure 0 0 0) 0x7efd340b6510 con 0x7efd340d0da0 2023-08-25T04:03:02.051 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:02.051 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":23,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:01.098131+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:02.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.047+0000 7efd3bb59640 1 -- 172.21.15.55:0/1378216437 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7efd18065680 msgr2=0x7efd18067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:02.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.047+0000 7efd3bb59640 1 --2- 172.21.15.55:0/1378216437 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7efd18065680 0x7efd18067b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efd30006fd0 tx=0x7efd30008040 comp rx=0 tx=0).stop 2023-08-25T04:03:02.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.047+0000 7efd3bb59640 1 -- 172.21.15.55:0/1378216437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd340d0da0 msgr2=0x7efd3415aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:02.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.047+0000 7efd3bb59640 1 --2- 172.21.15.55:0/1378216437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd340d0da0 0x7efd3415aaa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd2c007d20 tx=0x7efd2c00e4b0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.047+0000 7efd3bb59640 1 -- 172.21.15.55:0/1378216437 shutdown_connections 2023-08-25T04:03:02.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.047+0000 7efd3bb59640 1 --2- 172.21.15.55:0/1378216437 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7efd18065680 0x7efd18067b40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.047+0000 7efd3bb59640 1 --2- 172.21.15.55:0/1378216437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd340d0da0 0x7efd3415aaa0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.047+0000 7efd3bb59640 1 --2- 172.21.15.55:0/1378216437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd340cee60 0x7efd340b6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.047+0000 7efd3bb59640 1 --2- 172.21.15.55:0/1378216437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd340cdde0 0x7efd34151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.047+0000 7efd3bb59640 1 -- 172.21.15.55:0/1378216437 >> 172.21.15.55:0/1378216437 conn(0x7efd3409bae0 msgr2=0x7efd3406c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:02.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.047+0000 7efd3bb59640 1 -- 172.21.15.55:0/1378216437 shutdown_connections 2023-08-25T04:03:02.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.047+0000 7efd3bb59640 1 -- 172.21.15.55:0/1378216437 wait complete. 2023-08-25T04:03:02.070 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:02.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.211+0000 7f493738f640 1 Processor -- start 2023-08-25T04:03:02.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.211+0000 7f493738f640 1 -- start start 2023-08-25T04:03:02.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.211+0000 7f493738f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f493015c9c0 0x7f4930160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:02.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.211+0000 7f493738f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f49300cfa70 0x7f4930160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:02.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.211+0000 7f493738f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493006eaf0 con 0x7f4930160f90 2023-08-25T04:03:02.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.211+0000 7f493738f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493006e530 con 0x7f49300cfa70 2023-08-25T04:03:02.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.211+0000 7f493738f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493006e810 con 0x7f493015c9c0 2023-08-25T04:03:02.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.215+0000 7f493492a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f49300cfa70 0x7f4930160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:02.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.215+0000 7f493492a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f49300cfa70 0x7f4930160a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35290/0 (socket says 172.21.15.55:35290) 2023-08-25T04:03:02.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.215+0000 7f493592c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4930160f90 0x7f49300ce910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50410/0 (socket says 172.21.15.55:50410) 2023-08-25T04:03:02.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.215+0000 7f493492a640 1 -- 172.21.15.55:0/329391473 learned_addr learned my addr 172.21.15.55:0/329391473 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:02.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.215+0000 7f493512b640 1 --2- 172.21.15.55:0/329391473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f493015c9c0 0x7f4930160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:02.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.215+0000 7f493492a640 1 -- 172.21.15.55:0/329391473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f493015c9c0 msgr2=0x7f4930160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:02.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.215+0000 7f493492a640 1 --2- 172.21.15.55:0/329391473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f493015c9c0 0x7f4930160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.215+0000 7f493492a640 1 -- 172.21.15.55:0/329391473 >> v1:172.21.15.55:6789/0 conn(0x7f4930160f90 legacy=0x7f49300ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:02.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.215+0000 7f493492a640 1 -- 172.21.15.55:0/329391473 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493006aab0 con 0x7f49300cfa70 2023-08-25T04:03:02.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.215+0000 7f4927fff640 1 -- 172.21.15.55:0/329391473 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533313455 0 0) 0x7f493006eaf0 con 0x7f4930160f90 2023-08-25T04:03:02.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.215+0000 7f493492a640 1 --2- 172.21.15.55:0/329391473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49300cfa70 0x7f4930160a50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4920009870 tx=0x7f492001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a44b69fc156698 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:02.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.215+0000 7f4927fff640 1 -- 172.21.15.55:0/329391473 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49200ab620 con 0x7f49300cfa70 2023-08-25T04:03:02.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.215+0000 7f4927fff640 1 -- 172.21.15.55:0/329391473 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49200ab780 con 0x7f49300cfa70 2023-08-25T04:03:02.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.215+0000 7f4927fff640 1 -- 172.21.15.55:0/329391473 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49200abb10 con 0x7f49300cfa70 2023-08-25T04:03:02.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493738f640 1 -- 172.21.15.55:0/329391473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49300cfa70 msgr2=0x7f4930160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:02.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493738f640 1 --2- 172.21.15.55:0/329391473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49300cfa70 0x7f4930160a50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4920009870 tx=0x7f492001c510 comp rx=0 tx=0).stop 2023-08-25T04:03:02.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493738f640 1 -- 172.21.15.55:0/329391473 shutdown_connections 2023-08-25T04:03:02.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493738f640 1 --2- 172.21.15.55:0/329391473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49300cfa70 0x7f4930160a50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493738f640 1 --2- 172.21.15.55:0/329391473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f493015c9c0 0x7f4930160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493738f640 1 -- 172.21.15.55:0/329391473 >> 172.21.15.55:0/329391473 conn(0x7f49300d05a0 msgr2=0x7f49300d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:02.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493738f640 1 -- 172.21.15.55:0/329391473 shutdown_connections 2023-08-25T04:03:02.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493738f640 1 -- 172.21.15.55:0/329391473 wait complete. 2023-08-25T04:03:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493738f640 1 Processor -- start 2023-08-25T04:03:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493738f640 1 -- start start 2023-08-25T04:03:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493738f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49300cfa70 0x7f49301563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493738f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f493015c9c0 0x7f4930153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493738f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4930160f90 0x7f493014c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493738f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49300b0f80 con 0x7f4930160f90 2023-08-25T04:03:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493738f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4930151d30 con 0x7f493015c9c0 2023-08-25T04:03:02.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493738f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4930152010 con 0x7f49300cfa70 2023-08-25T04:03:02.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493592c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4930160f90 0x7f493014c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:02.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493592c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4930160f90 0x7f493014c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35306/0 (socket says 172.21.15.55:35306) 2023-08-25T04:03:02.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493592c640 1 -- 172.21.15.55:0/2805547759 learned_addr learned my addr 172.21.15.55:0/2805547759 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:02.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493512b640 1 --2- 172.21.15.55:0/2805547759 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49300cfa70 0x7f49301563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:02.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493492a640 1 --2- 172.21.15.55:0/2805547759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f493015c9c0 0x7f4930153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:02.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493592c640 1 -- 172.21.15.55:0/2805547759 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49300cfa70 msgr2=0x7f49301563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:02.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493592c640 1 --2- 172.21.15.55:0/2805547759 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49300cfa70 0x7f49301563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493592c640 1 -- 172.21.15.55:0/2805547759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f493015c9c0 msgr2=0x7f4930153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493592c640 1 --2- 172.21.15.55:0/2805547759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f493015c9c0 0x7f4930153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.219+0000 7f493592c640 1 -- 172.21.15.55:0/2805547759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49200094d0 con 0x7f4930160f90 2023-08-25T04:03:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.223+0000 7f493592c640 1 --2- 172.21.15.55:0/2805547759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4930160f90 0x7f493014c640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f492800c700 tx=0x7f492800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.223+0000 7f4925ffb640 1 -- 172.21.15.55:0/2805547759 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492800ce10 con 0x7f4930160f90 2023-08-25T04:03:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.223+0000 7f4925ffb640 1 -- 172.21.15.55:0/2805547759 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492800a640 con 0x7f4930160f90 2023-08-25T04:03:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.223+0000 7f4925ffb640 1 -- 172.21.15.55:0/2805547759 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492800aa70 con 0x7f4930160f90 2023-08-25T04:03:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.223+0000 7f493738f640 1 -- 172.21.15.55:0/2805547759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49301522f0 con 0x7f4930160f90 2023-08-25T04:03:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.223+0000 7f493738f640 1 -- 172.21.15.55:0/2805547759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49301528b0 con 0x7f4930160f90 2023-08-25T04:03:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.223+0000 7f493738f640 1 -- 172.21.15.55:0/2805547759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49300b10f0 con 0x7f4930160f90 2023-08-25T04:03:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.223+0000 7f4925ffb640 1 -- 172.21.15.55:0/2805547759 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f492800abd0 con 0x7f4930160f90 2023-08-25T04:03:02.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.223+0000 7f4925ffb640 1 --2- 172.21.15.55:0/2805547759 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f4914065680 0x7f4914067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:02.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.223+0000 7f4925ffb640 1 -- 172.21.15.55:0/2805547759 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4928082300 con 0x7f4930160f90 2023-08-25T04:03:02.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.223+0000 7f493512b640 1 --2- 172.21.15.55:0/2805547759 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f4914065680 0x7f4914067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:02.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.227+0000 7f493512b640 1 --2- 172.21.15.55:0/2805547759 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f4914065680 0x7f4914067b40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f492c009aa0 tx=0x7f492c006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:02.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.227+0000 7f4925ffb640 1 -- 172.21.15.55:0/2805547759 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f492804fdd0 con 0x7f4930160f90 2023-08-25T04:03:02.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.391+0000 7f493738f640 1 -- 172.21.15.55:0/2805547759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f493004dbe0 con 0x7f4930160f90 2023-08-25T04:03:02.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.391+0000 7f4925ffb640 1 -- 172.21.15.55:0/2805547759 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18291 (secure 0 0 0) 0x7f49280533f0 con 0x7f4930160f90 2023-08-25T04:03:02.394 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:02.394 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:02.329010+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:02.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.395+0000 7f493738f640 1 -- 172.21.15.55:0/2805547759 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f4914065680 msgr2=0x7f4914067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:02.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.395+0000 7f493738f640 1 --2- 172.21.15.55:0/2805547759 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f4914065680 0x7f4914067b40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f492c009aa0 tx=0x7f492c006f90 comp rx=0 tx=0).stop 2023-08-25T04:03:02.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.395+0000 7f493738f640 1 -- 172.21.15.55:0/2805547759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4930160f90 msgr2=0x7f493014c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:02.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.395+0000 7f493738f640 1 --2- 172.21.15.55:0/2805547759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4930160f90 0x7f493014c640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f492800c700 tx=0x7f492800cbc0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.395+0000 7f493738f640 1 -- 172.21.15.55:0/2805547759 shutdown_connections 2023-08-25T04:03:02.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.395+0000 7f493738f640 1 --2- 172.21.15.55:0/2805547759 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f4914065680 0x7f4914067b40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.395+0000 7f493738f640 1 --2- 172.21.15.55:0/2805547759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4930160f90 0x7f493014c640 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.395+0000 7f493738f640 1 --2- 172.21.15.55:0/2805547759 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f493015c9c0 0x7f4930153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.395+0000 7f493738f640 1 --2- 172.21.15.55:0/2805547759 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49300cfa70 0x7f49301563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.395+0000 7f493738f640 1 -- 172.21.15.55:0/2805547759 >> 172.21.15.55:0/2805547759 conn(0x7f49300d05a0 msgr2=0x7f4930158820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:02.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.395+0000 7f493738f640 1 -- 172.21.15.55:0/2805547759 shutdown_connections 2023-08-25T04:03:02.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.395+0000 7f493738f640 1 -- 172.21.15.55:0/2805547759 wait complete. 2023-08-25T04:03:02.415 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-25T04:03:02.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.559+0000 7f7edccec640 1 Processor -- start 2023-08-25T04:03:02.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.563+0000 7f7edccec640 1 -- start start 2023-08-25T04:03:02.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.563+0000 7f7edccec640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ed80c9900 0x7f7ed80cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:02.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.563+0000 7f7edccec640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ed806c720 0x7f7ed806cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.563+0000 7f7edccec640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed80c9d90 con 0x7f7ed80cb020 2023-08-25T04:03:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.563+0000 7f7edccec640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed80cbca0 con 0x7f7ed80c9900 2023-08-25T04:03:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.563+0000 7f7edccec640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed80c9470 con 0x7f7ed806c720 2023-08-25T04:03:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.563+0000 7f7ecffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ed80c9900 0x7f7ed80cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.563+0000 7f7ecffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ed80c9900 0x7f7ed80cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35320/0 (socket says 172.21.15.55:35320) 2023-08-25T04:03:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.563+0000 7f7ecffff640 1 -- 172.21.15.55:0/4207229420 learned_addr learned my addr 172.21.15.55:0/4207229420 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.563+0000 7f7ed6d9d640 1 --2- 172.21.15.55:0/4207229420 >> v2:172.21.15.110:3300/0 conn(0x7f7ed806c720 0x7f7ed806cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.563+0000 7f7ecffff640 1 -- 172.21.15.55:0/4207229420 >> v2:172.21.15.110:3300/0 conn(0x7f7ed806c720 msgr2=0x7f7ed806cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:02.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.563+0000 7f7ecffff640 1 --2- 172.21.15.55:0/4207229420 >> v2:172.21.15.110:3300/0 conn(0x7f7ed806c720 0x7f7ed806cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.563+0000 7f7ecffff640 1 -- 172.21.15.55:0/4207229420 >> v1:172.21.15.110:6789/0 conn(0x7f7ed80cb020 legacy=0x7f7ed80cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:02.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.563+0000 7f7ecffff640 1 -- 172.21.15.55:0/4207229420 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed806d040 con 0x7f7ed80c9900 2023-08-25T04:03:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.567+0000 7f7ecffff640 1 --2- 172.21.15.55:0/4207229420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ed80c9900 0x7f7ed80cdd50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80cc1d0 tx=0x7f7ec001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e88fd04ad1375e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.567+0000 7f7ed5d9b640 1 -- 172.21.15.55:0/4207229420 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec00ab600 con 0x7f7ed80c9900 2023-08-25T04:03:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.567+0000 7f7ed5d9b640 1 -- 172.21.15.55:0/4207229420 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec00a7050 con 0x7f7ed80c9900 2023-08-25T04:03:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.567+0000 7f7ed5d9b640 1 -- 172.21.15.55:0/4207229420 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec00ab980 con 0x7f7ed80c9900 2023-08-25T04:03:02.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.567+0000 7f7edccec640 1 -- 172.21.15.55:0/4207229420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ed80c9900 msgr2=0x7f7ed80cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:02.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.567+0000 7f7edccec640 1 --2- 172.21.15.55:0/4207229420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ed80c9900 0x7f7ed80cdd50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80cc1d0 tx=0x7f7ec001c430 comp rx=0 tx=0).stop 2023-08-25T04:03:02.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.567+0000 7f7edccec640 1 -- 172.21.15.55:0/4207229420 shutdown_connections 2023-08-25T04:03:02.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.567+0000 7f7edccec640 1 --2- 172.21.15.55:0/4207229420 >> v2:172.21.15.110:3300/0 conn(0x7f7ed806c720 0x7f7ed806cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.567+0000 7f7edccec640 1 --2- 172.21.15.55:0/4207229420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ed80c9900 0x7f7ed80cdd50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.567+0000 7f7edccec640 1 -- 172.21.15.55:0/4207229420 >> 172.21.15.55:0/4207229420 conn(0x7f7ed8069900 msgr2=0x7f7ed8069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:02.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.567+0000 7f7edccec640 1 -- 172.21.15.55:0/4207229420 shutdown_connections 2023-08-25T04:03:02.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.567+0000 7f7edccec640 1 -- 172.21.15.55:0/4207229420 wait complete. 2023-08-25T04:03:02.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.567+0000 7f7edccec640 1 Processor -- start 2023-08-25T04:03:02.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.567+0000 7f7edccec640 1 -- start start 2023-08-25T04:03:02.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7edccec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ed806c720 0x7f7ed8156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:02.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7edccec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ed80c9900 0x7f7ed806b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:02.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7edccec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ed80cb020 0x7f7ed806bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:02.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7edccec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed80adec0 con 0x7f7ed806c720 2023-08-25T04:03:02.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7edccec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed809a820 con 0x7f7ed80cb020 2023-08-25T04:03:02.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7edccec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed809ab00 con 0x7f7ed80c9900 2023-08-25T04:03:02.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7ed659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ed806c720 0x7f7ed8156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:02.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7ed659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ed806c720 0x7f7ed8156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35326/0 (socket says 172.21.15.55:35326) 2023-08-25T04:03:02.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7ed659c640 1 -- 172.21.15.55:0/864749145 learned_addr learned my addr 172.21.15.55:0/864749145 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:02.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7ecffff640 1 --2- 172.21.15.55:0/864749145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ed80c9900 0x7f7ed806b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:02.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7ed6d9d640 1 --2- 172.21.15.55:0/864749145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ed80cb020 0x7f7ed806bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:02.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7ed659c640 1 -- 172.21.15.55:0/864749145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ed80c9900 msgr2=0x7f7ed806b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:02.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7ed659c640 1 --2- 172.21.15.55:0/864749145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ed80c9900 0x7f7ed806b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7ed659c640 1 -- 172.21.15.55:0/864749145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ed80cb020 msgr2=0x7f7ed806bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:02.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7ed659c640 1 --2- 172.21.15.55:0/864749145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ed80cb020 0x7f7ed806bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:02.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7ed659c640 1 -- 172.21.15.55:0/864749145 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec00094d0 con 0x7f7ed806c720 2023-08-25T04:03:02.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7ed659c640 1 --2- 172.21.15.55:0/864749145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ed806c720 0x7f7ed8156460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800b3f0 tx=0x7f7ec800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:02.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7eceffd640 1 -- 172.21.15.55:0/864749145 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8011830 con 0x7f7ed806c720 2023-08-25T04:03:02.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7eceffd640 1 -- 172.21.15.55:0/864749145 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec80119b0 con 0x7f7ed806c720 2023-08-25T04:03:02.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7eceffd640 1 -- 172.21.15.55:0/864749145 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8011d60 con 0x7f7ed806c720 2023-08-25T04:03:02.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7edccec640 1 -- 172.21.15.55:0/864749145 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed80ae160 con 0x7f7ed806c720 2023-08-25T04:03:02.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7edccec640 1 -- 172.21.15.55:0/864749145 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed81569a0 con 0x7f7ed806c720 2023-08-25T04:03:02.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7edccec640 1 -- 172.21.15.55:0/864749145 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed80ae350 con 0x7f7ed806c720 2023-08-25T04:03:02.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.571+0000 7f7eceffd640 1 -- 172.21.15.55:0/864749145 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7ec801a410 con 0x7f7ed806c720 2023-08-25T04:03:02.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.575+0000 7f7eceffd640 1 --2- 172.21.15.55:0/864749145 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7eb8065680 0x7f7eb8067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:02.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.575+0000 7f7eceffd640 1 -- 172.21.15.55:0/864749145 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7ec8082c90 con 0x7f7ed806c720 2023-08-25T04:03:02.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.575+0000 7f7ecffff640 1 --2- 172.21.15.55:0/864749145 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7eb8065680 0x7f7eb8067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:02.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.575+0000 7f7ecffff640 1 --2- 172.21.15.55:0/864749145 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7eb8065680 0x7f7eb8067b40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00ad000 tx=0x7f7ec0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:02.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.579+0000 7f7eceffd640 1 -- 172.21.15.55:0/864749145 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7ec8050740 con 0x7f7ed806c720 2023-08-25T04:03:02.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:02.767+0000 7f7edccec640 1 -- 172.21.15.55:0/864749145 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7ed8073ec0 con 0x7f7ed806c720 2023-08-25T04:03:03.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.723+0000 7f7eceffd640 1 -- 172.21.15.55:0/864749145 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7ec80150b0 con 0x7f7ed806c720 2023-08-25T04:03:03.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.727+0000 7f7edccec640 1 -- 172.21.15.55:0/864749145 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7eb8065680 msgr2=0x7f7eb8067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:03.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.727+0000 7f7edccec640 1 --2- 172.21.15.55:0/864749145 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7eb8065680 0x7f7eb8067b40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00ad000 tx=0x7f7ec0008040 comp rx=0 tx=0).stop 2023-08-25T04:03:03.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.727+0000 7f7edccec640 1 -- 172.21.15.55:0/864749145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ed806c720 msgr2=0x7f7ed8156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:03.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.727+0000 7f7edccec640 1 --2- 172.21.15.55:0/864749145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ed806c720 0x7f7ed8156460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800b3f0 tx=0x7f7ec800b8b0 comp rx=0 tx=0).stop 2023-08-25T04:03:03.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.727+0000 7f7edccec640 1 -- 172.21.15.55:0/864749145 shutdown_connections 2023-08-25T04:03:03.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.727+0000 7f7edccec640 1 --2- 172.21.15.55:0/864749145 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7eb8065680 0x7f7eb8067b40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:03.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.727+0000 7f7edccec640 1 --2- 172.21.15.55:0/864749145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ed80cb020 0x7f7ed806bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:03.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.727+0000 7f7edccec640 1 --2- 172.21.15.55:0/864749145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ed80c9900 0x7f7ed806b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:03.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.727+0000 7f7edccec640 1 --2- 172.21.15.55:0/864749145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ed806c720 0x7f7ed8156460 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:03.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.727+0000 7f7edccec640 1 -- 172.21.15.55:0/864749145 >> 172.21.15.55:0/864749145 conn(0x7f7ed8069900 msgr2=0x7f7ed815cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:03.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.727+0000 7f7edccec640 1 -- 172.21.15.55:0/864749145 shutdown_connections 2023-08-25T04:03:03.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.727+0000 7f7edccec640 1 -- 172.21.15.55:0/864749145 wait complete. 2023-08-25T04:03:03.751 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-25T04:03:03.751 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-25T04:03:03.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.899+0000 7f72ee06a640 1 Processor -- start 2023-08-25T04:03:03.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.899+0000 7f72ee06a640 1 -- start start 2023-08-25T04:03:03.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.899+0000 7f72ee06a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e806fed0 0x7f72e80702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:03.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.899+0000 7f72ee06a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f72e80cdcc0 0x7f72e80cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:03.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.899+0000 7f72ee06a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e815de30 con 0x7f72e80ce120 2023-08-25T04:03:03.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.899+0000 7f72ee06a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e80cb120 con 0x7f72e80cdcc0 2023-08-25T04:03:03.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.899+0000 7f72ee06a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e815a9f0 con 0x7f72e806fed0 2023-08-25T04:03:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.903+0000 7f72e77fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e806fed0 0x7f72e80702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.903+0000 7f72dffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f72e80cdcc0 0x7f72e80cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.903+0000 7f72e77fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e806fed0 0x7f72e80702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:46668/0 (socket says 172.21.15.55:46668) 2023-08-25T04:03:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.903+0000 7f72e77fe640 1 -- 172.21.15.55:0/2002176668 learned_addr learned my addr 172.21.15.55:0/2002176668 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.903+0000 7f72e7fff640 1 --1- 172.21.15.55:0/2002176668 >> v1:172.21.15.110:6789/0 conn(0x7f72e80ce120 0x7f72e80cc900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:49574/0 (socket says 172.21.15.55:49574) 2023-08-25T04:03:03.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.903+0000 7f72dffff640 1 -- 172.21.15.55:0/2002176668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e806fed0 msgr2=0x7f72e80702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:03.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.903+0000 7f72dffff640 1 --2- 172.21.15.55:0/2002176668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e806fed0 0x7f72e80702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:03.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.903+0000 7f72dffff640 1 -- 172.21.15.55:0/2002176668 >> v1:172.21.15.110:6789/0 conn(0x7f72e80ce120 legacy=0x7f72e80cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:03.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.903+0000 7f72dffff640 1 -- 172.21.15.55:0/2002176668 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e80707f0 con 0x7f72e80cdcc0 2023-08-25T04:03:03.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.903+0000 7f72e6ffd640 1 -- 172.21.15.55:0/2002176668 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166389263 0 0) 0x7f72e815de30 con 0x7f72e80ce120 2023-08-25T04:03:03.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.903+0000 7f72e77fe640 1 --2- 172.21.15.55:0/2002176668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e806fed0 0x7f72e80702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:03.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.903+0000 7f72dffff640 1 --2- 172.21.15.55:0/2002176668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72e80cdcc0 0x7f72e80cc3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f72d00097c0 tx=0x7f72d001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2bf69aade9690a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:03.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72e6ffd640 1 -- 172.21.15.55:0/2002176668 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d00ab660 con 0x7f72e80cdcc0 2023-08-25T04:03:03.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72e6ffd640 1 -- 172.21.15.55:0/2002176668 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d00ab7c0 con 0x7f72e80cdcc0 2023-08-25T04:03:03.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72e6ffd640 1 -- 172.21.15.55:0/2002176668 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d00abb50 con 0x7f72e80cdcc0 2023-08-25T04:03:03.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72ee06a640 1 -- 172.21.15.55:0/2002176668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72e80cdcc0 msgr2=0x7f72e80cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:03.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72ee06a640 1 --2- 172.21.15.55:0/2002176668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72e80cdcc0 0x7f72e80cc3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f72d00097c0 tx=0x7f72d001c460 comp rx=0 tx=0).stop 2023-08-25T04:03:03.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72ee06a640 1 -- 172.21.15.55:0/2002176668 shutdown_connections 2023-08-25T04:03:03.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72ee06a640 1 --2- 172.21.15.55:0/2002176668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72e80cdcc0 0x7f72e80cc3c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:03.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72ee06a640 1 --2- 172.21.15.55:0/2002176668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e806fed0 0x7f72e80702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:03.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72ee06a640 1 -- 172.21.15.55:0/2002176668 >> 172.21.15.55:0/2002176668 conn(0x7f72e80ce7f0 msgr2=0x7f72e80cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:03.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72ee06a640 1 -- 172.21.15.55:0/2002176668 shutdown_connections 2023-08-25T04:03:03.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72ee06a640 1 -- 172.21.15.55:0/2002176668 wait complete. 2023-08-25T04:03:03.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72ee06a640 1 Processor -- start 2023-08-25T04:03:03.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72ee06a640 1 -- start start 2023-08-25T04:03:03.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72ee06a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72e806fed0 0x7f72e80c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:03.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72ee06a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e80cdcc0 0x7f72e81540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:03.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72ee06a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72e80ce120 0x7f72e8147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:03.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72ee06a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8151e00 con 0x7f72e806fed0 2023-08-25T04:03:03.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72ee06a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8151ad0 con 0x7f72e80ce120 2023-08-25T04:03:03.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72ee06a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e80c5f50 con 0x7f72e80cdcc0 2023-08-25T04:03:03.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72e77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72e806fed0 0x7f72e80c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:03.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72e77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72e806fed0 0x7f72e80c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35352/0 (socket says 172.21.15.55:35352) 2023-08-25T04:03:03.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72e77fe640 1 -- 172.21.15.55:0/3778422002 learned_addr learned my addr 172.21.15.55:0/3778422002 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:03.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.907+0000 7f72dffff640 1 --2- 172.21.15.55:0/3778422002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e80cdcc0 0x7f72e81540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:03.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.911+0000 7f72e7fff640 1 --2- 172.21.15.55:0/3778422002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72e80ce120 0x7f72e8147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:03.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.911+0000 7f72e77fe640 1 -- 172.21.15.55:0/3778422002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e80cdcc0 msgr2=0x7f72e81540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:03.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.911+0000 7f72e77fe640 1 --2- 172.21.15.55:0/3778422002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e80cdcc0 0x7f72e81540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:03.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.911+0000 7f72e77fe640 1 -- 172.21.15.55:0/3778422002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72e80ce120 msgr2=0x7f72e8147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:03.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.911+0000 7f72e77fe640 1 --2- 172.21.15.55:0/3778422002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72e80ce120 0x7f72e8147680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:03.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.911+0000 7f72e77fe640 1 -- 172.21.15.55:0/3778422002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d80094d0 con 0x7f72e806fed0 2023-08-25T04:03:03.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.911+0000 7f72e7fff640 1 --2- 172.21.15.55:0/3778422002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72e80ce120 0x7f72e8147680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:03.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.911+0000 7f72e77fe640 1 --2- 172.21.15.55:0/3778422002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72e806fed0 0x7f72e80c58c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f72d800e9d0 tx=0x7f72d800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:03.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.911+0000 7f72e4ff9640 1 -- 172.21.15.55:0/3778422002 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d800ca60 con 0x7f72e806fed0 2023-08-25T04:03:03.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.911+0000 7f72e4ff9640 1 -- 172.21.15.55:0/3778422002 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d800cbc0 con 0x7f72e806fed0 2023-08-25T04:03:03.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.911+0000 7f72ee06a640 1 -- 172.21.15.55:0/3778422002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d0009420 con 0x7f72e806fed0 2023-08-25T04:03:03.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.911+0000 7f72e4ff9640 1 -- 172.21.15.55:0/3778422002 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d8013470 con 0x7f72e806fed0 2023-08-25T04:03:03.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.911+0000 7f72ee06a640 1 -- 172.21.15.55:0/3778422002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e80c6510 con 0x7f72e806fed0 2023-08-25T04:03:03.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.911+0000 7f72ee06a640 1 -- 172.21.15.55:0/3778422002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e8073ec0 con 0x7f72e806fed0 2023-08-25T04:03:03.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.911+0000 7f72e4ff9640 1 -- 172.21.15.55:0/3778422002 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f72d80135d0 con 0x7f72e806fed0 2023-08-25T04:03:03.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.911+0000 7f72e4ff9640 1 --2- 172.21.15.55:0/3778422002 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f72c8065680 0x7f72c8067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:03.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.911+0000 7f72e4ff9640 1 -- 172.21.15.55:0/3778422002 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f72d8083080 con 0x7f72e806fed0 2023-08-25T04:03:03.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.915+0000 7f72dffff640 1 --2- 172.21.15.55:0/3778422002 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f72c8065680 0x7f72c8067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:03.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.915+0000 7f72dffff640 1 --2- 172.21.15.55:0/3778422002 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f72c8065680 0x7f72c8067b40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f72d00af000 tx=0x7f72d00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:03.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:03.915+0000 7f72e4ff9640 1 -- 172.21.15.55:0/3778422002 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f72d8050bf0 con 0x7f72e806fed0 2023-08-25T04:03:04.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.107+0000 7f72ee06a640 1 -- 172.21.15.55:0/3778422002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f72e8070ca0 con 0x7f72e806fed0 2023-08-25T04:03:04.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.735+0000 7f72e4ff9640 1 -- 172.21.15.55:0/3778422002 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f72d8054210 con 0x7f72e806fed0 2023-08-25T04:03:04.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.735+0000 7f72ee06a640 1 -- 172.21.15.55:0/3778422002 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f72c8065680 msgr2=0x7f72c8067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.735+0000 7f72ee06a640 1 --2- 172.21.15.55:0/3778422002 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f72c8065680 0x7f72c8067b40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f72d00af000 tx=0x7f72d00a7000 comp rx=0 tx=0).stop 2023-08-25T04:03:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.735+0000 7f72ee06a640 1 -- 172.21.15.55:0/3778422002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72e806fed0 msgr2=0x7f72e80c58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.735+0000 7f72ee06a640 1 --2- 172.21.15.55:0/3778422002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72e806fed0 0x7f72e80c58c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f72d800e9d0 tx=0x7f72d800ee90 comp rx=0 tx=0).stop 2023-08-25T04:03:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.735+0000 7f72ee06a640 1 -- 172.21.15.55:0/3778422002 shutdown_connections 2023-08-25T04:03:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.735+0000 7f72ee06a640 1 --2- 172.21.15.55:0/3778422002 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f72c8065680 0x7f72c8067b40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:04.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.735+0000 7f72ee06a640 1 --2- 172.21.15.55:0/3778422002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72e80ce120 0x7f72e8147680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.735+0000 7f72ee06a640 1 --2- 172.21.15.55:0/3778422002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e80cdcc0 0x7f72e81540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.735+0000 7f72ee06a640 1 --2- 172.21.15.55:0/3778422002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72e806fed0 0x7f72e80c58c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.735+0000 7f72ee06a640 1 -- 172.21.15.55:0/3778422002 >> 172.21.15.55:0/3778422002 conn(0x7f72e80ce7f0 msgr2=0x7f72e80c3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.735+0000 7f72ee06a640 1 -- 172.21.15.55:0/3778422002 shutdown_connections 2023-08-25T04:03:04.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.735+0000 7f72ee06a640 1 -- 172.21.15.55:0/3778422002 wait complete. 2023-08-25T04:03:04.761 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-25T04:03:04.762 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:03:04.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.907+0000 7f51bdaec640 1 Processor -- start 2023-08-25T04:03:04.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.907+0000 7f51bdaec640 1 -- start start 2023-08-25T04:03:04.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.911+0000 7f51bdaec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b80ad950 0x7f51b80cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:04.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.911+0000 7f51bdaec640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51b80c89f0 0x7f51b80ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:04.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.911+0000 7f51bdaec640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b80b2650 con 0x7f51b806c000 2023-08-25T04:03:04.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.911+0000 7f51bdaec640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b80b11f0 con 0x7f51b80c89f0 2023-08-25T04:03:04.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.911+0000 7f51bdaec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b8159d50 con 0x7f51b80ad950 2023-08-25T04:03:04.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.911+0000 7f51b6ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51b80c89f0 0x7f51b80ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:04.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.911+0000 7f51b6ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51b80c89f0 0x7f51b80ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35364/0 (socket says 172.21.15.55:35364) 2023-08-25T04:03:04.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.911+0000 7f51b6ffd640 1 -- 172.21.15.55:0/4032998560 learned_addr learned my addr 172.21.15.55:0/4032998560 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:04.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.911+0000 7f51b77fe640 1 --2- 172.21.15.55:0/4032998560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b80ad950 0x7f51b80cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:04.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.911+0000 7f51b6ffd640 1 -- 172.21.15.55:0/4032998560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b80ad950 msgr2=0x7f51b80cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:04.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.911+0000 7f51b6ffd640 1 --2- 172.21.15.55:0/4032998560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b80ad950 0x7f51b80cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:04.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.911+0000 7f51b6ffd640 1 -- 172.21.15.55:0/4032998560 >> v1:172.21.15.55:6789/0 conn(0x7f51b806c000 legacy=0x7f51b815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:04.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.911+0000 7f51b6ffd640 1 -- 172.21.15.55:0/4032998560 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b80cc880 con 0x7f51b80c89f0 2023-08-25T04:03:04.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.911+0000 7f51b6ffd640 1 --2- 172.21.15.55:0/4032998560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51b80c89f0 0x7f51b80ce7a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f51ac009870 tx=0x7f51ac01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f424b06559aa3d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:04.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51b67fc640 1 -- 172.21.15.55:0/4032998560 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac0ab600 con 0x7f51b80c89f0 2023-08-25T04:03:04.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51b67fc640 1 -- 172.21.15.55:0/4032998560 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac0a7050 con 0x7f51b80c89f0 2023-08-25T04:03:04.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51b67fc640 1 -- 172.21.15.55:0/4032998560 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac0ab980 con 0x7f51b80c89f0 2023-08-25T04:03:04.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51bdaec640 1 -- 172.21.15.55:0/4032998560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51b80c89f0 msgr2=0x7f51b80ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:04.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51bdaec640 1 --2- 172.21.15.55:0/4032998560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51b80c89f0 0x7f51b80ce7a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f51ac009870 tx=0x7f51ac01c340 comp rx=0 tx=0).stop 2023-08-25T04:03:04.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51bdaec640 1 -- 172.21.15.55:0/4032998560 shutdown_connections 2023-08-25T04:03:04.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51bdaec640 1 --2- 172.21.15.55:0/4032998560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51b80c89f0 0x7f51b80ce7a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:04.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51bdaec640 1 --2- 172.21.15.55:0/4032998560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b80ad950 0x7f51b80cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:04.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51bdaec640 1 -- 172.21.15.55:0/4032998560 >> 172.21.15.55:0/4032998560 conn(0x7f51b8069d00 msgr2=0x7f51b806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:04.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51bdaec640 1 -- 172.21.15.55:0/4032998560 shutdown_connections 2023-08-25T04:03:04.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51bdaec640 1 -- 172.21.15.55:0/4032998560 wait complete. 2023-08-25T04:03:04.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51bdaec640 1 Processor -- start 2023-08-25T04:03:04.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51bdaec640 1 -- start start 2023-08-25T04:03:04.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51bdaec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b806c000 0x7f51b8157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:04.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51bdaec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51b80ad950 0x7f51b80ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:04.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51bdaec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b80c89f0 0x7f51b80cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:04.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51bdaec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b8158110 con 0x7f51b80ad950 2023-08-25T04:03:04.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51bdaec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b80ab610 con 0x7f51b806c000 2023-08-25T04:03:04.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.915+0000 7f51bdaec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b80ab8f0 con 0x7f51b80c89f0 2023-08-25T04:03:04.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.919+0000 7f51b6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51b80ad950 0x7f51b80ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:04.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.919+0000 7f51b6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51b80ad950 0x7f51b80ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35376/0 (socket says 172.21.15.55:35376) 2023-08-25T04:03:04.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.919+0000 7f51b6ffd640 1 -- 172.21.15.55:0/110955741 learned_addr learned my addr 172.21.15.55:0/110955741 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:04.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.919+0000 7f51b77fe640 1 --2- 172.21.15.55:0/110955741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b806c000 0x7f51b8157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:04.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.919+0000 7f51b7fff640 1 --2- 172.21.15.55:0/110955741 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b80c89f0 0x7f51b80cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:04.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.919+0000 7f51b6ffd640 1 -- 172.21.15.55:0/110955741 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b80c89f0 msgr2=0x7f51b80cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:04.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.919+0000 7f51b6ffd640 1 --2- 172.21.15.55:0/110955741 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b80c89f0 0x7f51b80cecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:04.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.919+0000 7f51b6ffd640 1 -- 172.21.15.55:0/110955741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b806c000 msgr2=0x7f51b8157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:04.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.919+0000 7f51b6ffd640 1 --2- 172.21.15.55:0/110955741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b806c000 0x7f51b8157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:04.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.919+0000 7f51b6ffd640 1 -- 172.21.15.55:0/110955741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac0094d0 con 0x7f51b80ad950 2023-08-25T04:03:04.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.919+0000 7f51b6ffd640 1 --2- 172.21.15.55:0/110955741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51b80ad950 0x7f51b80ce770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0ae040 tx=0x7f51ac0190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:04.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.919+0000 7f519ffff640 1 -- 172.21.15.55:0/110955741 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac0b4850 con 0x7f51b80ad950 2023-08-25T04:03:04.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.919+0000 7f519ffff640 1 -- 172.21.15.55:0/110955741 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac0b49b0 con 0x7f51b80ad950 2023-08-25T04:03:04.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.919+0000 7f519ffff640 1 -- 172.21.15.55:0/110955741 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac0b4d60 con 0x7f51b80ad950 2023-08-25T04:03:04.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.919+0000 7f51bdaec640 1 -- 172.21.15.55:0/110955741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b80abbd0 con 0x7f51b80ad950 2023-08-25T04:03:04.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.919+0000 7f51bdaec640 1 -- 172.21.15.55:0/110955741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b80ac190 con 0x7f51b80ad950 2023-08-25T04:03:04.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.919+0000 7f51bdaec640 1 -- 172.21.15.55:0/110955741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b804dbe0 con 0x7f51b80ad950 2023-08-25T04:03:04.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.919+0000 7f519ffff640 1 -- 172.21.15.55:0/110955741 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f51ac0b2070 con 0x7f51b80ad950 2023-08-25T04:03:04.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.923+0000 7f519ffff640 1 --2- 172.21.15.55:0/110955741 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f51a4065680 0x7f51a4067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:04.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.923+0000 7f519ffff640 1 -- 172.21.15.55:0/110955741 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51ac11d1f0 con 0x7f51b80ad950 2023-08-25T04:03:04.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.923+0000 7f51b77fe640 1 --2- 172.21.15.55:0/110955741 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f51a4065680 0x7f51a4067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:04.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.923+0000 7f51b77fe640 1 --2- 172.21.15.55:0/110955741 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f51a4065680 0x7f51a4067b40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f51a8007a60 tx=0x7f51a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:04.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:04.923+0000 7f519ffff640 1 -- 172.21.15.55:0/110955741 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f51ac0eac10 con 0x7f51b80ad950 2023-08-25T04:03:05.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.111+0000 7f51bdaec640 1 -- 172.21.15.55:0/110955741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51b80cba70 con 0x7f51b80ad950 2023-08-25T04:03:05.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.115+0000 7f519ffff640 1 -- 172.21.15.55:0/110955741 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4875 (secure 0 0 0) 0x7f51ac0ee230 con 0x7f51b80ad950 2023-08-25T04:03:05.116 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:05.116 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3370778281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3370778281},{"type":"v1","addr":"172.21.15.55:6835","nonce":3370778281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/2321139789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2321139789},{"type":"v1","addr":"172.21.15.110:6837","nonce":2321139789}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3825401605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3825401605},{"type":"v1","addr":"172.21.15.110:6836","nonce":3825401605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:03:01.098486+0000","modified":"2023-08-25T04:03:04.724648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/2606103809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2606103809},{"type":"v1","addr":"172.21.15.55:6834","nonce":2606103809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:03:05.116 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2023-08-25T04:03:05.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.115+0000 7f51bdaec640 1 -- 172.21.15.55:0/110955741 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f51a4065680 msgr2=0x7f51a4067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:05.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.115+0000 7f51bdaec640 1 --2- 172.21.15.55:0/110955741 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f51a4065680 0x7f51a4067b40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f51a8007a60 tx=0x7f51a8008040 comp rx=0 tx=0).stop 2023-08-25T04:03:05.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.115+0000 7f51bdaec640 1 -- 172.21.15.55:0/110955741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51b80ad950 msgr2=0x7f51b80ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:05.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.115+0000 7f51bdaec640 1 --2- 172.21.15.55:0/110955741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51b80ad950 0x7f51b80ce770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0ae040 tx=0x7f51ac0190e0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.115+0000 7f51bdaec640 1 -- 172.21.15.55:0/110955741 shutdown_connections 2023-08-25T04:03:05.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.115+0000 7f51bdaec640 1 --2- 172.21.15.55:0/110955741 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f51a4065680 0x7f51a4067b40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.115+0000 7f51bdaec640 1 --2- 172.21.15.55:0/110955741 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b80c89f0 0x7f51b80cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.115+0000 7f51bdaec640 1 --2- 172.21.15.55:0/110955741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51b80ad950 0x7f51b80ce770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.115+0000 7f51bdaec640 1 --2- 172.21.15.55:0/110955741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b806c000 0x7f51b8157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.115+0000 7f51bdaec640 1 -- 172.21.15.55:0/110955741 >> 172.21.15.55:0/110955741 conn(0x7f51b8069d00 msgr2=0x7f51b80cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:05.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.115+0000 7f51bdaec640 1 -- 172.21.15.55:0/110955741 shutdown_connections 2023-08-25T04:03:05.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.115+0000 7f51bdaec640 1 -- 172.21.15.55:0/110955741 wait complete. 2023-08-25T04:03:05.137 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:05.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.279+0000 7f2099fac640 1 Processor -- start 2023-08-25T04:03:05.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.279+0000 7f2099fac640 1 -- start start 2023-08-25T04:03:05.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.279+0000 7f2099fac640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f20940cdde0 0x7f20940ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:05.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.279+0000 7f2099fac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20940b2e40 0x7f20940b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:05.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.279+0000 7f2099fac640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20940b29b0 con 0x7f20940d0da0 2023-08-25T04:03:05.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.279+0000 7f2099fac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20940ce760 con 0x7f20940b2e40 2023-08-25T04:03:05.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.279+0000 7f2099fac640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20940b1dc0 con 0x7f20940cdde0 2023-08-25T04:03:05.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.279+0000 7f2093fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20940b2e40 0x7f20940b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:05.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.279+0000 7f2093fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20940b2e40 0x7f20940b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35382/0 (socket says 172.21.15.55:35382) 2023-08-25T04:03:05.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.279+0000 7f2093fff640 1 -- 172.21.15.55:0/4152194531 learned_addr learned my addr 172.21.15.55:0/4152194531 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:05.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.279+0000 7f208bfff640 1 --2- 172.21.15.55:0/4152194531 >> v2:172.21.15.110:3300/0 conn(0x7f20940cdde0 0x7f20940ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:05.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.279+0000 7f2093fff640 1 -- 172.21.15.55:0/4152194531 >> v2:172.21.15.110:3300/0 conn(0x7f20940cdde0 msgr2=0x7f20940ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:05.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.279+0000 7f2093fff640 1 --2- 172.21.15.55:0/4152194531 >> v2:172.21.15.110:3300/0 conn(0x7f20940cdde0 0x7f20940ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.279+0000 7f2093fff640 1 -- 172.21.15.55:0/4152194531 >> v1:172.21.15.110:6789/0 conn(0x7f20940d0da0 legacy=0x7f20940d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:05.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.279+0000 7f2093fff640 1 -- 172.21.15.55:0/4152194531 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20940b2080 con 0x7f20940b2e40 2023-08-25T04:03:05.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.283+0000 7f2093fff640 1 --2- 172.21.15.55:0/4152194531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20940b2e40 0x7f20940b32b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f20940d38c0 tx=0x7f208c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc78a824f8eefc55 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:05.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.283+0000 7f2092ffd640 1 -- 172.21.15.55:0/4152194531 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c0af400 con 0x7f20940b2e40 2023-08-25T04:03:05.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.283+0000 7f2092ffd640 1 -- 172.21.15.55:0/4152194531 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208c0ab050 con 0x7f20940b2e40 2023-08-25T04:03:05.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.283+0000 7f2092ffd640 1 -- 172.21.15.55:0/4152194531 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c0af780 con 0x7f20940b2e40 2023-08-25T04:03:05.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.283+0000 7f2099fac640 1 -- 172.21.15.55:0/4152194531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20940b2e40 msgr2=0x7f20940b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:05.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.283+0000 7f2099fac640 1 --2- 172.21.15.55:0/4152194531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20940b2e40 0x7f20940b32b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f20940d38c0 tx=0x7f208c01f1c0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.283+0000 7f2099fac640 1 -- 172.21.15.55:0/4152194531 shutdown_connections 2023-08-25T04:03:05.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.283+0000 7f2099fac640 1 --2- 172.21.15.55:0/4152194531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20940b2e40 0x7f20940b32b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.283+0000 7f2099fac640 1 --2- 172.21.15.55:0/4152194531 >> v2:172.21.15.110:3300/0 conn(0x7f20940cdde0 0x7f20940ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.283+0000 7f2099fac640 1 -- 172.21.15.55:0/4152194531 >> 172.21.15.55:0/4152194531 conn(0x7f209409bae0 msgr2=0x7f20940d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:05.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.283+0000 7f2099fac640 1 -- 172.21.15.55:0/4152194531 shutdown_connections 2023-08-25T04:03:05.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.283+0000 7f2099fac640 1 -- 172.21.15.55:0/4152194531 wait complete. 2023-08-25T04:03:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2099fac640 1 Processor -- start 2023-08-25T04:03:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2099fac640 1 -- start start 2023-08-25T04:03:05.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2099fac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20940b2e40 0x7f20940c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:05.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2099fac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20940cdde0 0x7f20940b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:05.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2099fac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20940d0da0 0x7f20941f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:05.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2099fac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2094152590 con 0x7f20940d0da0 2023-08-25T04:03:05.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2099fac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20940b78b0 con 0x7f20940b2e40 2023-08-25T04:03:05.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2099fac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20940b65c0 con 0x7f20940cdde0 2023-08-25T04:03:05.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2093fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20940d0da0 0x7f20941f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:05.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2093fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20940d0da0 0x7f20941f1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35390/0 (socket says 172.21.15.55:35390) 2023-08-25T04:03:05.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2093fff640 1 -- 172.21.15.55:0/2316340405 learned_addr learned my addr 172.21.15.55:0/2316340405 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:05.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f208bfff640 1 --2- 172.21.15.55:0/2316340405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20940cdde0 0x7f20940b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:05.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f20937fe640 1 --2- 172.21.15.55:0/2316340405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20940b2e40 0x7f20940c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:05.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2093fff640 1 -- 172.21.15.55:0/2316340405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20940cdde0 msgr2=0x7f20940b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:05.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2093fff640 1 --2- 172.21.15.55:0/2316340405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20940cdde0 0x7f20940b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2093fff640 1 -- 172.21.15.55:0/2316340405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20940b2e40 msgr2=0x7f20940c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:05.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2093fff640 1 --2- 172.21.15.55:0/2316340405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20940b2e40 0x7f20940c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2093fff640 1 -- 172.21.15.55:0/2316340405 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c009b30 con 0x7f20940d0da0 2023-08-25T04:03:05.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f208bfff640 1 --2- 172.21.15.55:0/2316340405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20940cdde0 0x7f20940b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:05.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2093fff640 1 --2- 172.21.15.55:0/2316340405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20940d0da0 0x7f20941f1b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f208c0b2040 tx=0x7f208c01bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:05.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2090ff9640 1 -- 172.21.15.55:0/2316340405 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c0afde0 con 0x7f20940d0da0 2023-08-25T04:03:05.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2090ff9640 1 -- 172.21.15.55:0/2316340405 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208c009510 con 0x7f20940d0da0 2023-08-25T04:03:05.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2090ff9640 1 -- 172.21.15.55:0/2316340405 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208c0ba660 con 0x7f20940d0da0 2023-08-25T04:03:05.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2099fac640 1 -- 172.21.15.55:0/2316340405 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20941f20a0 con 0x7f20940d0da0 2023-08-25T04:03:05.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.287+0000 7f2099fac640 1 -- 172.21.15.55:0/2316340405 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20940b6af0 con 0x7f20940d0da0 2023-08-25T04:03:05.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.291+0000 7f2099fac640 1 -- 172.21.15.55:0/2316340405 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f209404dbe0 con 0x7f20940d0da0 2023-08-25T04:03:05.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.291+0000 7f2090ff9640 1 -- 172.21.15.55:0/2316340405 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f208c0b6040 con 0x7f20940d0da0 2023-08-25T04:03:05.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.291+0000 7f2090ff9640 1 --2- 172.21.15.55:0/2316340405 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2074065680 0x7f2074067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:05.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.291+0000 7f2090ff9640 1 -- 172.21.15.55:0/2316340405 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f208c121070 con 0x7f20940d0da0 2023-08-25T04:03:05.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.291+0000 7f20937fe640 1 --2- 172.21.15.55:0/2316340405 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2074065680 0x7f2074067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:05.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.291+0000 7f20937fe640 1 --2- 172.21.15.55:0/2316340405 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2074065680 0x7f2074067b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2084000fc0 tx=0x7f2084009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:05.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.295+0000 7f2090ff9640 1 -- 172.21.15.55:0/2316340405 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f208c0eeb50 con 0x7f20940d0da0 2023-08-25T04:03:05.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.459+0000 7f2099fac640 1 -- 172.21.15.55:0/2316340405 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20940d0b80 con 0x7f20940d0da0 2023-08-25T04:03:05.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.459+0000 7f2090ff9640 1 -- 172.21.15.55:0/2316340405 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18291 (secure 0 0 0) 0x7f208c0f2170 con 0x7f20940d0da0 2023-08-25T04:03:05.461 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:05.462 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:02.329010+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:05.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.459+0000 7f2099fac640 1 -- 172.21.15.55:0/2316340405 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2074065680 msgr2=0x7f2074067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:05.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.459+0000 7f2099fac640 1 --2- 172.21.15.55:0/2316340405 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2074065680 0x7f2074067b40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2084000fc0 tx=0x7f2084009040 comp rx=0 tx=0).stop 2023-08-25T04:03:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.459+0000 7f2099fac640 1 -- 172.21.15.55:0/2316340405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20940d0da0 msgr2=0x7f20941f1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.459+0000 7f2099fac640 1 --2- 172.21.15.55:0/2316340405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20940d0da0 0x7f20941f1b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f208c0b2040 tx=0x7f208c01bf60 comp rx=0 tx=0).stop 2023-08-25T04:03:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.459+0000 7f2099fac640 1 -- 172.21.15.55:0/2316340405 shutdown_connections 2023-08-25T04:03:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.459+0000 7f2099fac640 1 --2- 172.21.15.55:0/2316340405 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2074065680 0x7f2074067b40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.459+0000 7f2099fac640 1 --2- 172.21.15.55:0/2316340405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20940d0da0 0x7f20941f1b60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.459+0000 7f2099fac640 1 --2- 172.21.15.55:0/2316340405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20940cdde0 0x7f20940b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.459+0000 7f2099fac640 1 --2- 172.21.15.55:0/2316340405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20940b2e40 0x7f20940c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.459+0000 7f2099fac640 1 -- 172.21.15.55:0/2316340405 >> 172.21.15.55:0/2316340405 conn(0x7f209409bae0 msgr2=0x7f20940b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:05.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.459+0000 7f2099fac640 1 -- 172.21.15.55:0/2316340405 shutdown_connections 2023-08-25T04:03:05.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.459+0000 7f2099fac640 1 -- 172.21.15.55:0/2316340405 wait complete. 2023-08-25T04:03:05.483 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-25T04:03:05.484 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:03:05.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.627+0000 7fefe45e8640 1 Processor -- start 2023-08-25T04:03:05.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.627+0000 7fefe45e8640 1 -- start start 2023-08-25T04:03:05.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.627+0000 7fefe45e8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fefdc0ce220 0x7fefdc0b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:05.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.627+0000 7fefe45e8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefdc0b29b0 con 0x7fefdc0cdde0 2023-08-25T04:03:05.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.627+0000 7fefe45e8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefdc0ce690 con 0x7fefdc0d0da0 2023-08-25T04:03:05.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.627+0000 7fefe45e8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefdc0b1dc0 con 0x7fefdc0ce220 2023-08-25T04:03:05.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.627+0000 7fefe1b83640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fefdc0cdde0 0x7fefdc0b2e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50434/0 (socket says 172.21.15.55:50434) 2023-08-25T04:03:05.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.627+0000 7fefe1b83640 1 -- 172.21.15.55:0/3517356026 learned_addr learned my addr 172.21.15.55:0/3517356026 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:05.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.627+0000 7fefe2b85640 1 --2- 172.21.15.55:0/3517356026 >> v2:172.21.15.110:3300/0 conn(0x7fefdc0ce220 0x7fefdc0b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:05.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.627+0000 7fefe1382640 1 -- 172.21.15.55:0/3517356026 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200061237 0 0) 0x7fefdc0b29b0 con 0x7fefdc0cdde0 2023-08-25T04:03:05.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.627+0000 7fefe1382640 1 -- 172.21.15.55:0/3517356026 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefc8003530 con 0x7fefdc0cdde0 2023-08-25T04:03:05.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.627+0000 7fefe2b85640 1 -- 172.21.15.55:0/3517356026 >> v1:172.21.15.110:6789/0 conn(0x7fefdc0d0da0 legacy=0x7fefdc0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:05.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.627+0000 7fefe2b85640 1 -- 172.21.15.55:0/3517356026 >> v1:172.21.15.55:6789/0 conn(0x7fefdc0cdde0 legacy=0x7fefdc0b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:05.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.627+0000 7fefe2b85640 1 -- 172.21.15.55:0/3517356026 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc0b2080 con 0x7fefdc0ce220 2023-08-25T04:03:05.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.631+0000 7fefe2b85640 1 --2- 172.21.15.55:0/3517356026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefdc0ce220 0x7fefdc0b3550 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009d90 tx=0x7fefd401f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a10963b3dabe5ec2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:05.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.631+0000 7fefe1382640 1 -- 172.21.15.55:0/3517356026 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd40af600 con 0x7fefdc0ce220 2023-08-25T04:03:05.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.631+0000 7fefe1382640 1 -- 172.21.15.55:0/3517356026 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd40ab050 con 0x7fefdc0ce220 2023-08-25T04:03:05.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.631+0000 7fefe1382640 1 -- 172.21.15.55:0/3517356026 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd40af980 con 0x7fefdc0ce220 2023-08-25T04:03:05.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.631+0000 7fefe45e8640 1 -- 172.21.15.55:0/3517356026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefdc0ce220 msgr2=0x7fefdc0b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:05.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.631+0000 7fefe45e8640 1 --2- 172.21.15.55:0/3517356026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefdc0ce220 0x7fefdc0b3550 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009d90 tx=0x7fefd401f130 comp rx=0 tx=0).stop 2023-08-25T04:03:05.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.631+0000 7fefe45e8640 1 -- 172.21.15.55:0/3517356026 shutdown_connections 2023-08-25T04:03:05.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.631+0000 7fefe45e8640 1 --2- 172.21.15.55:0/3517356026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefdc0ce220 0x7fefdc0b3550 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.631+0000 7fefe45e8640 1 -- 172.21.15.55:0/3517356026 >> 172.21.15.55:0/3517356026 conn(0x7fefdc09bae0 msgr2=0x7fefdc0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:05.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.631+0000 7fefe45e8640 1 -- 172.21.15.55:0/3517356026 shutdown_connections 2023-08-25T04:03:05.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.631+0000 7fefe45e8640 1 -- 172.21.15.55:0/3517356026 wait complete. 2023-08-25T04:03:05.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe45e8640 1 Processor -- start 2023-08-25T04:03:05.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe45e8640 1 -- start start 2023-08-25T04:03:05.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe45e8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefdc0cdde0 0x7fefdc0cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:05.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe45e8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefdc0ce220 0x7fefdc0b6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:05.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe45e8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefdc0d0da0 0x7fefdc0ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:05.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe45e8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc0c9d10 con 0x7fefdc0ce220 2023-08-25T04:03:05.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe45e8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc0b7b30 con 0x7fefdc0d0da0 2023-08-25T04:03:05.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe45e8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc0b6b40 con 0x7fefdc0cdde0 2023-08-25T04:03:05.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe1b83640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefdc0ce220 0x7fefdc0b6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:05.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe1b83640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefdc0ce220 0x7fefdc0b6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35402/0 (socket says 172.21.15.55:35402) 2023-08-25T04:03:05.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe1b83640 1 -- 172.21.15.55:0/4270728917 learned_addr learned my addr 172.21.15.55:0/4270728917 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:05.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe2b85640 1 --2- 172.21.15.55:0/4270728917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefdc0d0da0 0x7fefdc0ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:05.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe2384640 1 --2- 172.21.15.55:0/4270728917 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefdc0cdde0 0x7fefdc0cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:05.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe1b83640 1 -- 172.21.15.55:0/4270728917 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefdc0cdde0 msgr2=0x7fefdc0cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:05.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe1b83640 1 --2- 172.21.15.55:0/4270728917 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefdc0cdde0 0x7fefdc0cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe1b83640 1 -- 172.21.15.55:0/4270728917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefdc0d0da0 msgr2=0x7fefdc0ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:05.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe1b83640 1 --2- 172.21.15.55:0/4270728917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefdc0d0da0 0x7fefdc0ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe1b83640 1 -- 172.21.15.55:0/4270728917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd4009a70 con 0x7fefdc0ce220 2023-08-25T04:03:05.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe2b85640 1 --2- 172.21.15.55:0/4270728917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefdc0d0da0 0x7fefdc0ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:05.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe1b83640 1 --2- 172.21.15.55:0/4270728917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefdc0ce220 0x7fefdc0b6600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00c420 tx=0x7fefcc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:05.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefd2ffd640 1 -- 172.21.15.55:0/4270728917 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc005cf0 con 0x7fefdc0ce220 2023-08-25T04:03:05.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefd2ffd640 1 -- 172.21.15.55:0/4270728917 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc005e50 con 0x7fefdc0ce220 2023-08-25T04:03:05.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe45e8640 1 -- 172.21.15.55:0/4270728917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefdc0ca670 con 0x7fefdc0ce220 2023-08-25T04:03:05.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefd2ffd640 1 -- 172.21.15.55:0/4270728917 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc0072d0 con 0x7fefdc0ce220 2023-08-25T04:03:05.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe45e8640 1 -- 172.21.15.55:0/4270728917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefdc0cc110 con 0x7fefdc0ce220 2023-08-25T04:03:05.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.635+0000 7fefe45e8640 1 -- 172.21.15.55:0/4270728917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefdc0c9e50 con 0x7fefdc0ce220 2023-08-25T04:03:05.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.639+0000 7fefd2ffd640 1 -- 172.21.15.55:0/4270728917 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fefcc007430 con 0x7fefdc0ce220 2023-08-25T04:03:05.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.639+0000 7fefd2ffd640 1 --2- 172.21.15.55:0/4270728917 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fefc0065680 0x7fefc0067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:05.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.639+0000 7fefd2ffd640 1 -- 172.21.15.55:0/4270728917 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fefcc0823c0 con 0x7fefdc0ce220 2023-08-25T04:03:05.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.639+0000 7fefe2384640 1 --2- 172.21.15.55:0/4270728917 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fefc0065680 0x7fefc0067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:05.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.639+0000 7fefe2384640 1 --2- 172.21.15.55:0/4270728917 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fefc0065680 0x7fefc0067b40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fefd8000fc0 tx=0x7fefd8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:05.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.643+0000 7fefd2ffd640 1 -- 172.21.15.55:0/4270728917 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fefdc0c9e50 con 0x7fefdc0ce220 2023-08-25T04:03:05.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.799+0000 7fefe45e8640 1 -- 172.21.15.55:0/4270728917 --> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fefdc0b2640 con 0x7fefc0065680 2023-08-25T04:03:05.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.811+0000 7fefd2ffd640 1 -- 172.21.15.55:0/4270728917 <== mgr.4102 v2:172.21.15.110:6832/413962747 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286633 (secure 0 0 0) 0x7fefd8001500 con 0x7fefc0065680 2023-08-25T04:03:05.816 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:05.817 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:03:05.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.815+0000 7fefe45e8640 1 -- 172.21.15.55:0/4270728917 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fefc0065680 msgr2=0x7fefc0067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:05.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.815+0000 7fefe45e8640 1 --2- 172.21.15.55:0/4270728917 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fefc0065680 0x7fefc0067b40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fefd8000fc0 tx=0x7fefd8009040 comp rx=0 tx=0).stop 2023-08-25T04:03:05.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.815+0000 7fefe45e8640 1 -- 172.21.15.55:0/4270728917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefdc0ce220 msgr2=0x7fefdc0b6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:05.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.815+0000 7fefe45e8640 1 --2- 172.21.15.55:0/4270728917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefdc0ce220 0x7fefdc0b6600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00c420 tx=0x7fefcc00c8e0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.815+0000 7fefe45e8640 1 -- 172.21.15.55:0/4270728917 shutdown_connections 2023-08-25T04:03:05.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.815+0000 7fefe45e8640 1 --2- 172.21.15.55:0/4270728917 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fefc0065680 0x7fefc0067b40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.815+0000 7fefe45e8640 1 --2- 172.21.15.55:0/4270728917 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefdc0d0da0 0x7fefdc0ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.815+0000 7fefe45e8640 1 --2- 172.21.15.55:0/4270728917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefdc0ce220 0x7fefdc0b6600 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.815+0000 7fefe45e8640 1 --2- 172.21.15.55:0/4270728917 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefdc0cdde0 0x7fefdc0cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.815+0000 7fefe45e8640 1 -- 172.21.15.55:0/4270728917 >> 172.21.15.55:0/4270728917 conn(0x7fefdc09bae0 msgr2=0x7fefdc0b4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.815+0000 7fefe45e8640 1 -- 172.21.15.55:0/4270728917 shutdown_connections 2023-08-25T04:03:05.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:05.815+0000 7fefe45e8640 1 -- 172.21.15.55:0/4270728917 wait complete. 2023-08-25T04:03:05.837 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-25T04:03:04.604858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590584,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":183,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244128,"kb_used_data":2976,"kb_used_omap":13,"kb_used_meta":241010,"kb_avail":754730592,"statfs":{"total":773094113280,"available":772844126208,"internally_reserved":0,"allocated":3047424,"data_stored":1843008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":246794328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.917662"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.348415+0000","last_change":"2023-08-25T04:03:01.345042+0000","last_active":"2023-08-25T04:03:01.348415+0000","last_peered":"2023-08-25T04:03:01.348415+0000","last_clean":"2023-08-25T04:03:01.348415+0000","last_became_active":"2023-08-25T04:03:01.344724+0000","last_became_peered":"2023-08-25T04:03:01.344724+0000","last_unstale":"2023-08-25T04:03:01.348415+0000","last_undegraded":"2023-08-25T04:03:01.348415+0000","last_fullsized":"2023-08-25T04:03:01.348415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:33.754524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.364176+0000","last_change":"2023-08-25T04:03:01.362953+0000","last_active":"2023-08-25T04:03:01.364176+0000","last_peered":"2023-08-25T04:03:01.364176+0000","last_clean":"2023-08-25T04:03:01.364176+0000","last_became_active":"2023-08-25T04:03:01.362672+0000","last_became_peered":"2023-08-25T04:03:01.362672+0000","last_unstale":"2023-08-25T04:03:01.364176+0000","last_undegraded":"2023-08-25T04:03:01.364176+0000","last_fullsized":"2023-08-25T04:03:01.364176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:31:26.575778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.363876+0000","last_change":"2023-08-25T04:03:01.352794+0000","last_active":"2023-08-25T04:03:01.363876+0000","last_peered":"2023-08-25T04:03:01.363876+0000","last_clean":"2023-08-25T04:03:01.363876+0000","last_became_active":"2023-08-25T04:03:01.352520+0000","last_became_peered":"2023-08-25T04:03:01.352520+0000","last_unstale":"2023-08-25T04:03:01.363876+0000","last_undegraded":"2023-08-25T04:03:01.363876+0000","last_fullsized":"2023-08-25T04:03:01.363876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:55.173495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335413+0000","last_change":"2023-08-25T04:03:01.348099+0000","last_active":"2023-08-25T04:03:02.335413+0000","last_peered":"2023-08-25T04:03:02.335413+0000","last_clean":"2023-08-25T04:03:02.335413+0000","last_became_active":"2023-08-25T04:03:01.347798+0000","last_became_peered":"2023-08-25T04:03:01.347798+0000","last_unstale":"2023-08-25T04:03:02.335413+0000","last_undegraded":"2023-08-25T04:03:02.335413+0000","last_fullsized":"2023-08-25T04:03:02.335413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:03.894113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.354480+0000","last_change":"2023-08-25T04:03:01.350578+0000","last_active":"2023-08-25T04:03:01.354480+0000","last_peered":"2023-08-25T04:03:01.354480+0000","last_clean":"2023-08-25T04:03:01.354480+0000","last_became_active":"2023-08-25T04:03:01.350212+0000","last_became_peered":"2023-08-25T04:03:01.350212+0000","last_unstale":"2023-08-25T04:03:01.354480+0000","last_undegraded":"2023-08-25T04:03:01.354480+0000","last_fullsized":"2023-08-25T04:03:01.354480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:45:02.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.363976+0000","last_change":"2023-08-25T04:03:01.353871+0000","last_active":"2023-08-25T04:03:01.363976+0000","last_peered":"2023-08-25T04:03:01.363976+0000","last_clean":"2023-08-25T04:03:01.363976+0000","last_became_active":"2023-08-25T04:03:01.353553+0000","last_became_peered":"2023-08-25T04:03:01.353553+0000","last_unstale":"2023-08-25T04:03:01.363976+0000","last_undegraded":"2023-08-25T04:03:01.363976+0000","last_fullsized":"2023-08-25T04:03:01.363976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:51:01.167062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.365300+0000","last_change":"2023-08-25T04:03:01.364502+0000","last_active":"2023-08-25T04:03:01.365300+0000","last_peered":"2023-08-25T04:03:01.365300+0000","last_clean":"2023-08-25T04:03:01.365300+0000","last_became_active":"2023-08-25T04:03:01.364135+0000","last_became_peered":"2023-08-25T04:03:01.364135+0000","last_unstale":"2023-08-25T04:03:01.365300+0000","last_undegraded":"2023-08-25T04:03:01.365300+0000","last_fullsized":"2023-08-25T04:03:01.365300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:31.298630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.363148+0000","last_change":"2023-08-25T04:03:01.362258+0000","last_active":"2023-08-25T04:03:01.363148+0000","last_peered":"2023-08-25T04:03:01.363148+0000","last_clean":"2023-08-25T04:03:01.363148+0000","last_became_active":"2023-08-25T04:03:01.361897+0000","last_became_peered":"2023-08-25T04:03:01.361897+0000","last_unstale":"2023-08-25T04:03:01.363148+0000","last_undegraded":"2023-08-25T04:03:01.363148+0000","last_fullsized":"2023-08-25T04:03:01.363148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:04:24.406419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.355619+0000","last_change":"2023-08-25T04:03:01.354196+0000","last_active":"2023-08-25T04:03:01.355619+0000","last_peered":"2023-08-25T04:03:01.355619+0000","last_clean":"2023-08-25T04:03:01.355619+0000","last_became_active":"2023-08-25T04:03:01.353929+0000","last_became_peered":"2023-08-25T04:03:01.353929+0000","last_unstale":"2023-08-25T04:03:01.355619+0000","last_undegraded":"2023-08-25T04:03:01.355619+0000","last_fullsized":"2023-08-25T04:03:01.355619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:51:01.167062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.357650+0000","last_change":"2023-08-25T04:03:01.355535+0000","last_active":"2023-08-25T04:03:01.357650+0000","last_peered":"2023-08-25T04:03:01.357650+0000","last_clean":"2023-08-25T04:03:01.357650+0000","last_became_active":"2023-08-25T04:03:01.355233+0000","last_became_peered":"2023-08-25T04:03:01.355233+0000","last_unstale":"2023-08-25T04:03:01.357650+0000","last_undegraded":"2023-08-25T04:03:01.357650+0000","last_fullsized":"2023-08-25T04:03:01.357650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:01:03.763365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.363771+0000","last_change":"2023-08-25T04:03:01.350101+0000","last_active":"2023-08-25T04:03:01.363771+0000","last_peered":"2023-08-25T04:03:01.363771+0000","last_clean":"2023-08-25T04:03:01.363771+0000","last_became_active":"2023-08-25T04:03:01.347061+0000","last_became_peered":"2023-08-25T04:03:01.347061+0000","last_unstale":"2023-08-25T04:03:01.363771+0000","last_undegraded":"2023-08-25T04:03:01.363771+0000","last_fullsized":"2023-08-25T04:03:01.363771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:53:34.243572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.360010+0000","last_change":"2023-08-25T04:03:01.358731+0000","last_active":"2023-08-25T04:03:01.360010+0000","last_peered":"2023-08-25T04:03:01.360010+0000","last_clean":"2023-08-25T04:03:01.360010+0000","last_became_active":"2023-08-25T04:03:01.358447+0000","last_became_peered":"2023-08-25T04:03:01.358447+0000","last_unstale":"2023-08-25T04:03:01.360010+0000","last_undegraded":"2023-08-25T04:03:01.360010+0000","last_fullsized":"2023-08-25T04:03:01.360010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:35:37.283960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.346570+0000","last_change":"2023-08-25T04:03:01.344944+0000","last_active":"2023-08-25T04:03:01.346570+0000","last_peered":"2023-08-25T04:03:01.346570+0000","last_clean":"2023-08-25T04:03:01.346570+0000","last_became_active":"2023-08-25T04:03:01.344660+0000","last_became_peered":"2023-08-25T04:03:01.344660+0000","last_unstale":"2023-08-25T04:03:01.346570+0000","last_undegraded":"2023-08-25T04:03:01.346570+0000","last_fullsized":"2023-08-25T04:03:01.346570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:00:13.178203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.356351+0000","last_change":"2023-08-25T04:03:01.354816+0000","last_active":"2023-08-25T04:03:01.356351+0000","last_peered":"2023-08-25T04:03:01.356351+0000","last_clean":"2023-08-25T04:03:01.356351+0000","last_became_active":"2023-08-25T04:03:01.354525+0000","last_became_peered":"2023-08-25T04:03:01.354525+0000","last_unstale":"2023-08-25T04:03:01.356351+0000","last_undegraded":"2023-08-25T04:03:01.356351+0000","last_fullsized":"2023-08-25T04:03:01.356351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:20:47.107743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.364701+0000","last_change":"2023-08-25T04:03:01.363162+0000","last_active":"2023-08-25T04:03:01.364701+0000","last_peered":"2023-08-25T04:03:01.364701+0000","last_clean":"2023-08-25T04:03:01.364701+0000","last_became_active":"2023-08-25T04:03:01.362765+0000","last_became_peered":"2023-08-25T04:03:01.362765+0000","last_unstale":"2023-08-25T04:03:01.364701+0000","last_undegraded":"2023-08-25T04:03:01.364701+0000","last_fullsized":"2023-08-25T04:03:01.364701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:24:09.920611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.363948+0000","last_change":"2023-08-25T04:03:01.353137+0000","last_active":"2023-08-25T04:03:01.363948+0000","last_peered":"2023-08-25T04:03:01.363948+0000","last_clean":"2023-08-25T04:03:01.363948+0000","last_became_active":"2023-08-25T04:03:01.352866+0000","last_became_peered":"2023-08-25T04:03:01.352866+0000","last_unstale":"2023-08-25T04:03:01.363948+0000","last_undegraded":"2023-08-25T04:03:01.363948+0000","last_fullsized":"2023-08-25T04:03:01.363948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:44:18.660752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.355636+0000","last_change":"2023-08-25T04:03:01.354256+0000","last_active":"2023-08-25T04:03:01.355636+0000","last_peered":"2023-08-25T04:03:01.355636+0000","last_clean":"2023-08-25T04:03:01.355636+0000","last_became_active":"2023-08-25T04:03:01.353982+0000","last_became_peered":"2023-08-25T04:03:01.353982+0000","last_unstale":"2023-08-25T04:03:01.355636+0000","last_undegraded":"2023-08-25T04:03:01.355636+0000","last_fullsized":"2023-08-25T04:03:01.355636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:18:42.967152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.360515+0000","last_change":"2023-08-25T04:03:01.342079+0000","last_active":"2023-08-25T04:03:01.360515+0000","last_peered":"2023-08-25T04:03:01.360515+0000","last_clean":"2023-08-25T04:03:01.360515+0000","last_became_active":"2023-08-25T04:03:01.341556+0000","last_became_peered":"2023-08-25T04:03:01.341556+0000","last_unstale":"2023-08-25T04:03:01.360515+0000","last_undegraded":"2023-08-25T04:03:01.360515+0000","last_fullsized":"2023-08-25T04:03:01.360515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:50:05.939959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.343516+0000","last_change":"2023-08-25T04:03:01.340781+0000","last_active":"2023-08-25T04:03:01.343516+0000","last_peered":"2023-08-25T04:03:01.343516+0000","last_clean":"2023-08-25T04:03:01.343516+0000","last_became_active":"2023-08-25T04:03:01.340444+0000","last_became_peered":"2023-08-25T04:03:01.340444+0000","last_unstale":"2023-08-25T04:03:01.343516+0000","last_undegraded":"2023-08-25T04:03:01.343516+0000","last_fullsized":"2023-08-25T04:03:01.343516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:49:51.444051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.360819+0000","last_change":"2023-08-25T04:03:01.343273+0000","last_active":"2023-08-25T04:03:01.360819+0000","last_peered":"2023-08-25T04:03:01.360819+0000","last_clean":"2023-08-25T04:03:01.360819+0000","last_became_active":"2023-08-25T04:03:01.342978+0000","last_became_peered":"2023-08-25T04:03:01.342978+0000","last_unstale":"2023-08-25T04:03:01.360819+0000","last_undegraded":"2023-08-25T04:03:01.360819+0000","last_fullsized":"2023-08-25T04:03:01.360819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:20:47.107743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.360495+0000","last_change":"2023-08-25T04:03:01.356873+0000","last_active":"2023-08-25T04:03:01.360495+0000","last_peered":"2023-08-25T04:03:01.360495+0000","last_clean":"2023-08-25T04:03:01.360495+0000","last_became_active":"2023-08-25T04:03:01.356524+0000","last_became_peered":"2023-08-25T04:03:01.356524+0000","last_unstale":"2023-08-25T04:03:01.360495+0000","last_undegraded":"2023-08-25T04:03:01.360495+0000","last_fullsized":"2023-08-25T04:03:01.360495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:55:09.171814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.367100+0000","last_change":"2023-08-25T04:03:01.362913+0000","last_active":"2023-08-25T04:03:01.367100+0000","last_peered":"2023-08-25T04:03:01.367100+0000","last_clean":"2023-08-25T04:03:01.367100+0000","last_became_active":"2023-08-25T04:03:01.362630+0000","last_became_peered":"2023-08-25T04:03:01.362630+0000","last_unstale":"2023-08-25T04:03:01.367100+0000","last_undegraded":"2023-08-25T04:03:01.367100+0000","last_fullsized":"2023-08-25T04:03:01.367100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:50:05.939959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.355738+0000","last_change":"2023-08-25T04:03:01.349042+0000","last_active":"2023-08-25T04:03:01.355738+0000","last_peered":"2023-08-25T04:03:01.355738+0000","last_clean":"2023-08-25T04:03:01.355738+0000","last_became_active":"2023-08-25T04:03:01.348683+0000","last_became_peered":"2023-08-25T04:03:01.348683+0000","last_unstale":"2023-08-25T04:03:01.355738+0000","last_undegraded":"2023-08-25T04:03:01.355738+0000","last_fullsized":"2023-08-25T04:03:01.355738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:11:43.886179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.360483+0000","last_change":"2023-08-25T04:03:01.356864+0000","last_active":"2023-08-25T04:03:01.360483+0000","last_peered":"2023-08-25T04:03:01.360483+0000","last_clean":"2023-08-25T04:03:01.360483+0000","last_became_active":"2023-08-25T04:03:01.356507+0000","last_became_peered":"2023-08-25T04:03:01.356507+0000","last_unstale":"2023-08-25T04:03:01.360483+0000","last_undegraded":"2023-08-25T04:03:01.360483+0000","last_fullsized":"2023-08-25T04:03:01.360483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:55.173495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.361321+0000","last_change":"2023-08-25T04:03:01.342638+0000","last_active":"2023-08-25T04:03:01.361321+0000","last_peered":"2023-08-25T04:03:01.361321+0000","last_clean":"2023-08-25T04:03:01.361321+0000","last_became_active":"2023-08-25T04:03:01.342295+0000","last_became_peered":"2023-08-25T04:03:01.342295+0000","last_unstale":"2023-08-25T04:03:01.361321+0000","last_undegraded":"2023-08-25T04:03:01.361321+0000","last_fullsized":"2023-08-25T04:03:01.361321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:06:45.177142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.362028+0000","last_change":"2023-08-25T04:03:01.348390+0000","last_active":"2023-08-25T04:03:01.362028+0000","last_peered":"2023-08-25T04:03:01.362028+0000","last_clean":"2023-08-25T04:03:01.362028+0000","last_became_active":"2023-08-25T04:03:01.347587+0000","last_became_peered":"2023-08-25T04:03:01.347587+0000","last_unstale":"2023-08-25T04:03:01.362028+0000","last_undegraded":"2023-08-25T04:03:01.362028+0000","last_fullsized":"2023-08-25T04:03:01.362028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:02:05.440530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.360013+0000","last_change":"2023-08-25T04:03:01.358436+0000","last_active":"2023-08-25T04:03:01.360013+0000","last_peered":"2023-08-25T04:03:01.360013+0000","last_clean":"2023-08-25T04:03:01.360013+0000","last_became_active":"2023-08-25T04:03:01.356095+0000","last_became_peered":"2023-08-25T04:03:01.356095+0000","last_unstale":"2023-08-25T04:03:01.360013+0000","last_undegraded":"2023-08-25T04:03:01.360013+0000","last_fullsized":"2023-08-25T04:03:01.360013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:53:18.372759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.362319+0000","last_change":"2023-08-25T04:03:01.351628+0000","last_active":"2023-08-25T04:03:01.362319+0000","last_peered":"2023-08-25T04:03:01.362319+0000","last_clean":"2023-08-25T04:03:01.362319+0000","last_became_active":"2023-08-25T04:03:01.350541+0000","last_became_peered":"2023-08-25T04:03:01.350541+0000","last_unstale":"2023-08-25T04:03:01.362319+0000","last_undegraded":"2023-08-25T04:03:01.362319+0000","last_fullsized":"2023-08-25T04:03:01.362319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:42:21.914526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.355680+0000","last_change":"2023-08-25T04:03:01.349534+0000","last_active":"2023-08-25T04:03:01.355680+0000","last_peered":"2023-08-25T04:03:01.355680+0000","last_clean":"2023-08-25T04:03:01.355680+0000","last_became_active":"2023-08-25T04:03:01.348968+0000","last_became_peered":"2023-08-25T04:03:01.348968+0000","last_unstale":"2023-08-25T04:03:01.355680+0000","last_undegraded":"2023-08-25T04:03:01.355680+0000","last_fullsized":"2023-08-25T04:03:01.355680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:50:32.887542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.361114+0000","last_change":"2023-08-25T04:03:01.343257+0000","last_active":"2023-08-25T04:03:01.361114+0000","last_peered":"2023-08-25T04:03:01.361114+0000","last_clean":"2023-08-25T04:03:01.361114+0000","last_became_active":"2023-08-25T04:03:01.342938+0000","last_became_peered":"2023-08-25T04:03:01.342938+0000","last_unstale":"2023-08-25T04:03:01.361114+0000","last_undegraded":"2023-08-25T04:03:01.361114+0000","last_fullsized":"2023-08-25T04:03:01.361114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:03:31.575646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.366336+0000","last_change":"2023-08-25T04:03:01.357291+0000","last_active":"2023-08-25T04:03:01.366336+0000","last_peered":"2023-08-25T04:03:01.366336+0000","last_clean":"2023-08-25T04:03:01.366336+0000","last_became_active":"2023-08-25T04:03:01.356973+0000","last_became_peered":"2023-08-25T04:03:01.356973+0000","last_unstale":"2023-08-25T04:03:01.366336+0000","last_undegraded":"2023-08-25T04:03:01.366336+0000","last_fullsized":"2023-08-25T04:03:01.366336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:33:15.291618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335221+0000","last_change":"2023-08-25T04:03:01.341244+0000","last_active":"2023-08-25T04:03:02.335221+0000","last_peered":"2023-08-25T04:03:02.335221+0000","last_clean":"2023-08-25T04:03:02.335221+0000","last_became_active":"2023-08-25T04:03:01.340907+0000","last_became_peered":"2023-08-25T04:03:01.340907+0000","last_unstale":"2023-08-25T04:03:02.335221+0000","last_undegraded":"2023-08-25T04:03:02.335221+0000","last_fullsized":"2023-08-25T04:03:02.335221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:04:24.406419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.366344+0000","last_change":"2023-08-25T04:03:01.357303+0000","last_active":"2023-08-25T04:03:01.366344+0000","last_peered":"2023-08-25T04:03:01.366344+0000","last_clean":"2023-08-25T04:03:01.366344+0000","last_became_active":"2023-08-25T04:03:01.356965+0000","last_became_peered":"2023-08-25T04:03:01.356965+0000","last_unstale":"2023-08-25T04:03:01.366344+0000","last_undegraded":"2023-08-25T04:03:01.366344+0000","last_fullsized":"2023-08-25T04:03:01.366344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:02:05.440530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.710959+0000","last_change":"2023-08-25T04:03:00.724082+0000","last_active":"2023-08-25T04:03:01.710959+0000","last_peered":"2023-08-25T04:03:01.710959+0000","last_clean":"2023-08-25T04:03:01.710959+0000","last_became_active":"2023-08-25T04:03:00.723792+0000","last_became_peered":"2023-08-25T04:03:00.723792+0000","last_unstale":"2023-08-25T04:03:01.710959+0000","last_undegraded":"2023-08-25T04:03:01.710959+0000","last_fullsized":"2023-08-25T04:03:01.710959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:10:45.831781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.359989+0000","last_change":"2023-08-25T04:03:01.356130+0000","last_active":"2023-08-25T04:03:01.359989+0000","last_peered":"2023-08-25T04:03:01.359989+0000","last_clean":"2023-08-25T04:03:01.359989+0000","last_became_active":"2023-08-25T04:03:01.355561+0000","last_became_peered":"2023-08-25T04:03:01.355561+0000","last_unstale":"2023-08-25T04:03:01.359989+0000","last_undegraded":"2023-08-25T04:03:01.359989+0000","last_fullsized":"2023-08-25T04:03:01.359989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:03.894113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.343851+0000","last_change":"2023-08-25T04:03:00.723608+0000","last_active":"2023-08-25T04:03:01.343851+0000","last_peered":"2023-08-25T04:03:01.343851+0000","last_clean":"2023-08-25T04:03:01.343851+0000","last_became_active":"2023-08-25T04:03:00.723314+0000","last_became_peered":"2023-08-25T04:03:00.723314+0000","last_unstale":"2023-08-25T04:03:01.343851+0000","last_undegraded":"2023-08-25T04:03:01.343851+0000","last_fullsized":"2023-08-25T04:03:01.343851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:02.884193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.354465+0000","last_change":"2023-08-25T04:03:01.350258+0000","last_active":"2023-08-25T04:03:01.354465+0000","last_peered":"2023-08-25T04:03:01.354465+0000","last_clean":"2023-08-25T04:03:01.354465+0000","last_became_active":"2023-08-25T04:03:01.349984+0000","last_became_peered":"2023-08-25T04:03:01.349984+0000","last_unstale":"2023-08-25T04:03:01.354465+0000","last_undegraded":"2023-08-25T04:03:01.354465+0000","last_fullsized":"2023-08-25T04:03:01.354465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:53:34.243572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.350290+0000","last_change":"2023-08-25T04:03:00.725255+0000","last_active":"2023-08-25T04:03:01.350290+0000","last_peered":"2023-08-25T04:03:01.350290+0000","last_clean":"2023-08-25T04:03:01.350290+0000","last_became_active":"2023-08-25T04:03:00.724980+0000","last_became_peered":"2023-08-25T04:03:00.724980+0000","last_unstale":"2023-08-25T04:03:01.350290+0000","last_undegraded":"2023-08-25T04:03:01.350290+0000","last_fullsized":"2023-08-25T04:03:01.350290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:00.993169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.353492+0000","last_change":"2023-08-25T04:03:01.345546+0000","last_active":"2023-08-25T04:03:01.353492+0000","last_peered":"2023-08-25T04:03:01.353492+0000","last_clean":"2023-08-25T04:03:01.353492+0000","last_became_active":"2023-08-25T04:03:01.345316+0000","last_became_peered":"2023-08-25T04:03:01.345316+0000","last_unstale":"2023-08-25T04:03:01.353492+0000","last_undegraded":"2023-08-25T04:03:01.353492+0000","last_fullsized":"2023-08-25T04:03:01.353492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:35:04.841043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335383+0000","last_change":"2023-08-25T04:03:00.716518+0000","last_active":"2023-08-25T04:03:02.335383+0000","last_peered":"2023-08-25T04:03:02.335383+0000","last_clean":"2023-08-25T04:03:02.335383+0000","last_became_active":"2023-08-25T04:03:00.716196+0000","last_became_peered":"2023-08-25T04:03:00.716196+0000","last_unstale":"2023-08-25T04:03:02.335383+0000","last_undegraded":"2023-08-25T04:03:02.335383+0000","last_fullsized":"2023-08-25T04:03:02.335383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:35.759065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.713426+0000","last_change":"2023-08-25T04:03:00.724751+0000","last_active":"2023-08-25T04:03:01.713426+0000","last_peered":"2023-08-25T04:03:01.713426+0000","last_clean":"2023-08-25T04:03:01.713426+0000","last_became_active":"2023-08-25T04:03:00.724484+0000","last_became_peered":"2023-08-25T04:03:00.724484+0000","last_unstale":"2023-08-25T04:03:01.713426+0000","last_undegraded":"2023-08-25T04:03:01.713426+0000","last_fullsized":"2023-08-25T04:03:01.713426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:44.260933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.351603+0000","last_change":"2023-08-25T04:03:01.349649+0000","last_active":"2023-08-25T04:03:01.351603+0000","last_peered":"2023-08-25T04:03:01.351603+0000","last_clean":"2023-08-25T04:03:01.351603+0000","last_became_active":"2023-08-25T04:03:01.349285+0000","last_became_peered":"2023-08-25T04:03:01.349285+0000","last_unstale":"2023-08-25T04:03:01.351603+0000","last_undegraded":"2023-08-25T04:03:01.351603+0000","last_fullsized":"2023-08-25T04:03:01.351603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:50:05.939959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.712552+0000","last_change":"2023-08-25T04:03:00.724274+0000","last_active":"2023-08-25T04:03:01.712552+0000","last_peered":"2023-08-25T04:03:01.712552+0000","last_clean":"2023-08-25T04:03:01.712552+0000","last_became_active":"2023-08-25T04:03:00.723971+0000","last_became_peered":"2023-08-25T04:03:00.723971+0000","last_unstale":"2023-08-25T04:03:01.712552+0000","last_undegraded":"2023-08-25T04:03:01.712552+0000","last_fullsized":"2023-08-25T04:03:01.712552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:16.973270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.364102+0000","last_change":"2023-08-25T04:03:01.352013+0000","last_active":"2023-08-25T04:03:01.364102+0000","last_peered":"2023-08-25T04:03:01.364102+0000","last_clean":"2023-08-25T04:03:01.364102+0000","last_became_active":"2023-08-25T04:03:01.351727+0000","last_became_peered":"2023-08-25T04:03:01.351727+0000","last_unstale":"2023-08-25T04:03:01.364102+0000","last_undegraded":"2023-08-25T04:03:01.364102+0000","last_fullsized":"2023-08-25T04:03:01.364102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:03.894113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.714294+0000","last_change":"2023-08-25T04:03:00.720598+0000","last_active":"2023-08-25T04:03:01.714294+0000","last_peered":"2023-08-25T04:03:01.714294+0000","last_clean":"2023-08-25T04:03:01.714294+0000","last_became_active":"2023-08-25T04:03:00.720316+0000","last_became_peered":"2023-08-25T04:03:00.720316+0000","last_unstale":"2023-08-25T04:03:01.714294+0000","last_undegraded":"2023-08-25T04:03:01.714294+0000","last_fullsized":"2023-08-25T04:03:01.714294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:14.800833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335421+0000","last_change":"2023-08-25T04:03:01.357353+0000","last_active":"2023-08-25T04:03:02.335421+0000","last_peered":"2023-08-25T04:03:02.335421+0000","last_clean":"2023-08-25T04:03:02.335421+0000","last_became_active":"2023-08-25T04:03:01.356994+0000","last_became_peered":"2023-08-25T04:03:01.356994+0000","last_unstale":"2023-08-25T04:03:02.335421+0000","last_undegraded":"2023-08-25T04:03:02.335421+0000","last_fullsized":"2023-08-25T04:03:02.335421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:53:18.372759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.344410+0000","last_change":"2023-08-25T04:03:00.721557+0000","last_active":"2023-08-25T04:03:01.344410+0000","last_peered":"2023-08-25T04:03:01.344410+0000","last_clean":"2023-08-25T04:03:01.344410+0000","last_became_active":"2023-08-25T04:03:00.721111+0000","last_became_peered":"2023-08-25T04:03:00.721111+0000","last_unstale":"2023-08-25T04:03:01.344410+0000","last_undegraded":"2023-08-25T04:03:01.344410+0000","last_fullsized":"2023-08-25T04:03:01.344410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:54.163575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.366595+0000","last_change":"2023-08-25T04:03:01.362147+0000","last_active":"2023-08-25T04:03:01.366595+0000","last_peered":"2023-08-25T04:03:01.366595+0000","last_clean":"2023-08-25T04:03:01.366595+0000","last_became_active":"2023-08-25T04:03:01.361891+0000","last_became_peered":"2023-08-25T04:03:01.361891+0000","last_unstale":"2023-08-25T04:03:01.366595+0000","last_undegraded":"2023-08-25T04:03:01.366595+0000","last_fullsized":"2023-08-25T04:03:01.366595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:04:24.406419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.336054+0000","last_change":"2023-08-25T04:03:00.726270+0000","last_active":"2023-08-25T04:03:01.336054+0000","last_peered":"2023-08-25T04:03:01.336054+0000","last_clean":"2023-08-25T04:03:01.336054+0000","last_became_active":"2023-08-25T04:03:00.725846+0000","last_became_peered":"2023-08-25T04:03:00.725846+0000","last_unstale":"2023-08-25T04:03:01.336054+0000","last_undegraded":"2023-08-25T04:03:01.336054+0000","last_fullsized":"2023-08-25T04:03:01.336054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:39:42.025217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.364017+0000","last_change":"2023-08-25T04:03:01.354419+0000","last_active":"2023-08-25T04:03:01.364017+0000","last_peered":"2023-08-25T04:03:01.364017+0000","last_clean":"2023-08-25T04:03:01.364017+0000","last_became_active":"2023-08-25T04:03:01.354110+0000","last_became_peered":"2023-08-25T04:03:01.354110+0000","last_unstale":"2023-08-25T04:03:01.364017+0000","last_undegraded":"2023-08-25T04:03:01.364017+0000","last_fullsized":"2023-08-25T04:03:01.364017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:30:59.392811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335674+0000","last_change":"2023-08-25T04:03:00.720247+0000","last_active":"2023-08-25T04:03:02.335674+0000","last_peered":"2023-08-25T04:03:02.335674+0000","last_clean":"2023-08-25T04:03:02.335674+0000","last_became_active":"2023-08-25T04:03:00.719941+0000","last_became_peered":"2023-08-25T04:03:00.719941+0000","last_unstale":"2023-08-25T04:03:02.335674+0000","last_undegraded":"2023-08-25T04:03:02.335674+0000","last_fullsized":"2023-08-25T04:03:02.335674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:31:25.565858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.364071+0000","last_change":"2023-08-25T04:03:01.357912+0000","last_active":"2023-08-25T04:03:01.364071+0000","last_peered":"2023-08-25T04:03:01.364071+0000","last_clean":"2023-08-25T04:03:01.364071+0000","last_became_active":"2023-08-25T04:03:01.357568+0000","last_became_peered":"2023-08-25T04:03:01.357568+0000","last_unstale":"2023-08-25T04:03:01.364071+0000","last_undegraded":"2023-08-25T04:03:01.364071+0000","last_fullsized":"2023-08-25T04:03:01.364071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:45:02.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.339791+0000","last_change":"2023-08-25T04:03:00.719201+0000","last_active":"2023-08-25T04:03:01.339791+0000","last_peered":"2023-08-25T04:03:01.339791+0000","last_clean":"2023-08-25T04:03:01.339791+0000","last_became_active":"2023-08-25T04:03:00.718923+0000","last_became_peered":"2023-08-25T04:03:00.718923+0000","last_unstale":"2023-08-25T04:03:01.339791+0000","last_undegraded":"2023-08-25T04:03:01.339791+0000","last_fullsized":"2023-08-25T04:03:01.339791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:01:02.753445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.363852+0000","last_change":"2023-08-25T04:03:01.351447+0000","last_active":"2023-08-25T04:03:01.363852+0000","last_peered":"2023-08-25T04:03:01.363852+0000","last_clean":"2023-08-25T04:03:01.363852+0000","last_became_active":"2023-08-25T04:03:01.351187+0000","last_became_peered":"2023-08-25T04:03:01.351187+0000","last_unstale":"2023-08-25T04:03:01.363852+0000","last_undegraded":"2023-08-25T04:03:01.363852+0000","last_fullsized":"2023-08-25T04:03:01.363852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:18:42.967152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.336197+0000","last_change":"2023-08-25T04:03:00.718022+0000","last_active":"2023-08-25T04:03:01.336197+0000","last_peered":"2023-08-25T04:03:01.336197+0000","last_clean":"2023-08-25T04:03:01.336197+0000","last_became_active":"2023-08-25T04:03:00.717031+0000","last_became_peered":"2023-08-25T04:03:00.717031+0000","last_unstale":"2023-08-25T04:03:01.336197+0000","last_undegraded":"2023-08-25T04:03:01.336197+0000","last_fullsized":"2023-08-25T04:03:01.336197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:09:17.759089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.361900+0000","last_change":"2023-08-25T04:03:01.347111+0000","last_active":"2023-08-25T04:03:01.361900+0000","last_peered":"2023-08-25T04:03:01.361900+0000","last_clean":"2023-08-25T04:03:01.361900+0000","last_became_active":"2023-08-25T04:03:01.346777+0000","last_became_peered":"2023-08-25T04:03:01.346777+0000","last_unstale":"2023-08-25T04:03:01.361900+0000","last_undegraded":"2023-08-25T04:03:01.361900+0000","last_fullsized":"2023-08-25T04:03:01.361900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:39:43.035137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.347042+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:03:01.347042+0000","last_peered":"2023-08-25T04:03:01.347042+0000","last_clean":"2023-08-25T04:03:01.347042+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:03:01.347042+0000","last_undegraded":"2023-08-25T04:03:01.347042+0000","last_fullsized":"2023-08-25T04:03:01.347042+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:31:13.495694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.341506+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:03:01.341506+0000","last_peered":"2023-08-25T04:03:01.341506+0000","last_clean":"2023-08-25T04:03:01.341506+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:03:01.341506+0000","last_undegraded":"2023-08-25T04:03:01.341506+0000","last_fullsized":"2023-08-25T04:03:01.341506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:50:55.119747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.334267+0000","last_change":"2023-08-25T04:03:00.716745+0000","last_active":"2023-08-25T04:03:01.334267+0000","last_peered":"2023-08-25T04:03:01.334267+0000","last_clean":"2023-08-25T04:03:01.334267+0000","last_became_active":"2023-08-25T04:03:00.716419+0000","last_became_peered":"2023-08-25T04:03:00.716419+0000","last_unstale":"2023-08-25T04:03:01.334267+0000","last_undegraded":"2023-08-25T04:03:01.334267+0000","last_fullsized":"2023-08-25T04:03:01.334267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:55:41.108750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335514+0000","last_change":"2023-08-25T04:03:01.359007+0000","last_active":"2023-08-25T04:03:02.335514+0000","last_peered":"2023-08-25T04:03:02.335514+0000","last_clean":"2023-08-25T04:03:02.335514+0000","last_became_active":"2023-08-25T04:03:01.358654+0000","last_became_peered":"2023-08-25T04:03:01.358654+0000","last_unstale":"2023-08-25T04:03:02.335514+0000","last_undegraded":"2023-08-25T04:03:02.335514+0000","last_fullsized":"2023-08-25T04:03:02.335514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:26.962898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.346923+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:03:01.346923+0000","last_peered":"2023-08-25T04:03:01.346923+0000","last_clean":"2023-08-25T04:03:01.346923+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:03:01.346923+0000","last_undegraded":"2023-08-25T04:03:01.346923+0000","last_fullsized":"2023-08-25T04:03:01.346923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:00:57.716050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.344093+0000","last_change":"2023-08-25T04:03:00.724401+0000","last_active":"2023-08-25T04:03:01.344093+0000","last_peered":"2023-08-25T04:03:01.344093+0000","last_clean":"2023-08-25T04:03:01.344093+0000","last_became_active":"2023-08-25T04:03:00.724057+0000","last_became_peered":"2023-08-25T04:03:00.724057+0000","last_unstale":"2023-08-25T04:03:01.344093+0000","last_undegraded":"2023-08-25T04:03:01.344093+0000","last_fullsized":"2023-08-25T04:03:01.344093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:53:17.362839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.366611+0000","last_change":"2023-08-25T04:03:01.362199+0000","last_active":"2023-08-25T04:03:01.366611+0000","last_peered":"2023-08-25T04:03:01.366611+0000","last_clean":"2023-08-25T04:03:01.366611+0000","last_became_active":"2023-08-25T04:03:01.361885+0000","last_became_peered":"2023-08-25T04:03:01.361885+0000","last_unstale":"2023-08-25T04:03:01.366611+0000","last_undegraded":"2023-08-25T04:03:01.366611+0000","last_fullsized":"2023-08-25T04:03:01.366611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:13:18.285083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.331311+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:03:01.331311+0000","last_peered":"2023-08-25T04:03:01.331311+0000","last_clean":"2023-08-25T04:03:01.331311+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:03:01.331311+0000","last_undegraded":"2023-08-25T04:03:01.331311+0000","last_fullsized":"2023-08-25T04:03:01.331311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:45.534210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.334331+0000","last_change":"2023-08-25T04:03:00.715784+0000","last_active":"2023-08-25T04:03:01.334331+0000","last_peered":"2023-08-25T04:03:01.334331+0000","last_clean":"2023-08-25T04:03:01.334331+0000","last_became_active":"2023-08-25T04:03:00.715481+0000","last_became_peered":"2023-08-25T04:03:00.715481+0000","last_unstale":"2023-08-25T04:03:01.334331+0000","last_undegraded":"2023-08-25T04:03:01.334331+0000","last_fullsized":"2023-08-25T04:03:01.334331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:23.316378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.362456+0000","last_change":"2023-08-25T04:03:01.351813+0000","last_active":"2023-08-25T04:03:01.362456+0000","last_peered":"2023-08-25T04:03:01.362456+0000","last_clean":"2023-08-25T04:03:01.362456+0000","last_became_active":"2023-08-25T04:03:01.351168+0000","last_became_peered":"2023-08-25T04:03:01.351168+0000","last_unstale":"2023-08-25T04:03:01.362456+0000","last_undegraded":"2023-08-25T04:03:01.362456+0000","last_fullsized":"2023-08-25T04:03:01.362456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:14:58.886873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.343026+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:03:01.343026+0000","last_peered":"2023-08-25T04:03:01.343026+0000","last_clean":"2023-08-25T04:03:01.343026+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:03:01.343026+0000","last_undegraded":"2023-08-25T04:03:01.343026+0000","last_fullsized":"2023-08-25T04:03:01.343026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:30.721670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.339826+0000","last_change":"2023-08-25T04:03:00.726687+0000","last_active":"2023-08-25T04:03:01.339826+0000","last_peered":"2023-08-25T04:03:01.339826+0000","last_clean":"2023-08-25T04:03:01.339826+0000","last_became_active":"2023-08-25T04:03:00.726151+0000","last_became_peered":"2023-08-25T04:03:00.726151+0000","last_unstale":"2023-08-25T04:03:01.339826+0000","last_undegraded":"2023-08-25T04:03:01.339826+0000","last_fullsized":"2023-08-25T04:03:01.339826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:31:25.565858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.361851+0000","last_change":"2023-08-25T04:03:01.347217+0000","last_active":"2023-08-25T04:03:01.361851+0000","last_peered":"2023-08-25T04:03:01.361851+0000","last_clean":"2023-08-25T04:03:01.361851+0000","last_became_active":"2023-08-25T04:03:01.346945+0000","last_became_peered":"2023-08-25T04:03:01.346945+0000","last_unstale":"2023-08-25T04:03:01.361851+0000","last_undegraded":"2023-08-25T04:03:01.361851+0000","last_fullsized":"2023-08-25T04:03:01.361851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:33:15.291618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.348542+0000","last_change":"2023-08-25T04:03:00.721967+0000","last_active":"2023-08-25T04:03:01.348542+0000","last_peered":"2023-08-25T04:03:01.348542+0000","last_clean":"2023-08-25T04:03:01.348542+0000","last_became_active":"2023-08-25T04:03:00.721550+0000","last_became_peered":"2023-08-25T04:03:00.721550+0000","last_unstale":"2023-08-25T04:03:01.348542+0000","last_undegraded":"2023-08-25T04:03:01.348542+0000","last_fullsized":"2023-08-25T04:03:01.348542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:14.800833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.338486+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:03:01.338486+0000","last_peered":"2023-08-25T04:03:01.338486+0000","last_clean":"2023-08-25T04:03:01.338486+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:03:01.338486+0000","last_undegraded":"2023-08-25T04:03:01.338486+0000","last_fullsized":"2023-08-25T04:03:01.338486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:11:37.838864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.363368+0000","last_change":"2023-08-25T04:03:01.350688+0000","last_active":"2023-08-25T04:03:01.363368+0000","last_peered":"2023-08-25T04:03:01.363368+0000","last_clean":"2023-08-25T04:03:01.363368+0000","last_became_active":"2023-08-25T04:03:01.350333+0000","last_became_peered":"2023-08-25T04:03:01.350333+0000","last_unstale":"2023-08-25T04:03:01.363368+0000","last_undegraded":"2023-08-25T04:03:01.363368+0000","last_fullsized":"2023-08-25T04:03:01.363368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:23:43.578871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.338396+0000","last_change":"2023-08-25T04:03:00.710773+0000","last_active":"2023-08-25T04:03:01.338396+0000","last_peered":"2023-08-25T04:03:01.338396+0000","last_clean":"2023-08-25T04:03:01.338396+0000","last_became_active":"2023-08-25T04:03:00.710376+0000","last_became_peered":"2023-08-25T04:03:00.710376+0000","last_unstale":"2023-08-25T04:03:01.338396+0000","last_undegraded":"2023-08-25T04:03:01.338396+0000","last_fullsized":"2023-08-25T04:03:01.338396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:09:17.759089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.350755+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:03:01.350755+0000","last_peered":"2023-08-25T04:03:01.350755+0000","last_clean":"2023-08-25T04:03:01.350755+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:03:01.350755+0000","last_undegraded":"2023-08-25T04:03:01.350755+0000","last_fullsized":"2023-08-25T04:03:01.350755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:49.842955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.354727+0000","last_change":"2023-08-25T04:03:01.352376+0000","last_active":"2023-08-25T04:03:01.354727+0000","last_peered":"2023-08-25T04:03:01.354727+0000","last_clean":"2023-08-25T04:03:01.354727+0000","last_became_active":"2023-08-25T04:03:01.352104+0000","last_became_peered":"2023-08-25T04:03:01.352104+0000","last_unstale":"2023-08-25T04:03:01.354727+0000","last_undegraded":"2023-08-25T04:03:01.354727+0000","last_fullsized":"2023-08-25T04:03:01.354727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:36.768985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.335589+0000","last_change":"2023-08-25T04:03:00.718260+0000","last_active":"2023-08-25T04:03:01.335589+0000","last_peered":"2023-08-25T04:03:01.335589+0000","last_clean":"2023-08-25T04:03:01.335589+0000","last_became_active":"2023-08-25T04:03:00.717748+0000","last_became_peered":"2023-08-25T04:03:00.717748+0000","last_unstale":"2023-08-25T04:03:01.335589+0000","last_undegraded":"2023-08-25T04:03:01.335589+0000","last_fullsized":"2023-08-25T04:03:01.335589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:19:37.798377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.335096+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:03:01.335096+0000","last_peered":"2023-08-25T04:03:01.335096+0000","last_clean":"2023-08-25T04:03:01.335096+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:03:01.335096+0000","last_undegraded":"2023-08-25T04:03:01.335096+0000","last_fullsized":"2023-08-25T04:03:01.335096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:09:14.818797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.353574+0000","last_change":"2023-08-25T04:03:01.345303+0000","last_active":"2023-08-25T04:03:01.353574+0000","last_peered":"2023-08-25T04:03:01.353574+0000","last_clean":"2023-08-25T04:03:01.353574+0000","last_became_active":"2023-08-25T04:03:01.344815+0000","last_became_peered":"2023-08-25T04:03:01.344815+0000","last_unstale":"2023-08-25T04:03:01.353574+0000","last_undegraded":"2023-08-25T04:03:01.353574+0000","last_fullsized":"2023-08-25T04:03:01.353574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:23:43.578871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.346274+0000","last_change":"2023-08-25T04:03:00.723286+0000","last_active":"2023-08-25T04:03:01.346274+0000","last_peered":"2023-08-25T04:03:01.346274+0000","last_clean":"2023-08-25T04:03:01.346274+0000","last_became_active":"2023-08-25T04:03:00.722952+0000","last_became_peered":"2023-08-25T04:03:00.722952+0000","last_unstale":"2023-08-25T04:03:01.346274+0000","last_undegraded":"2023-08-25T04:03:01.346274+0000","last_fullsized":"2023-08-25T04:03:01.346274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:54.163575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335621+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:03:02.335621+0000","last_peered":"2023-08-25T04:03:02.335621+0000","last_clean":"2023-08-25T04:03:02.335621+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:03:02.335621+0000","last_undegraded":"2023-08-25T04:03:02.335621+0000","last_fullsized":"2023-08-25T04:03:02.335621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:00:57.716050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.364121+0000","last_change":"2023-08-25T04:03:01.358953+0000","last_active":"2023-08-25T04:03:01.364121+0000","last_peered":"2023-08-25T04:03:01.364121+0000","last_clean":"2023-08-25T04:03:01.364121+0000","last_became_active":"2023-08-25T04:03:01.358612+0000","last_became_peered":"2023-08-25T04:03:01.358612+0000","last_unstale":"2023-08-25T04:03:01.364121+0000","last_undegraded":"2023-08-25T04:03:01.364121+0000","last_fullsized":"2023-08-25T04:03:01.364121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:13:18.285083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.364152+0000","last_change":"2023-08-25T04:03:01.358957+0000","last_active":"2023-08-25T04:03:01.364152+0000","last_peered":"2023-08-25T04:03:01.364152+0000","last_clean":"2023-08-25T04:03:01.364152+0000","last_became_active":"2023-08-25T04:03:01.358559+0000","last_became_peered":"2023-08-25T04:03:01.358559+0000","last_unstale":"2023-08-25T04:03:01.364152+0000","last_undegraded":"2023-08-25T04:03:01.364152+0000","last_fullsized":"2023-08-25T04:03:01.364152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:04:24.406419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.339105+0000","last_change":"2023-08-25T04:03:00.719414+0000","last_active":"2023-08-25T04:03:01.339105+0000","last_peered":"2023-08-25T04:03:01.339105+0000","last_clean":"2023-08-25T04:03:01.339105+0000","last_became_active":"2023-08-25T04:03:00.719016+0000","last_became_peered":"2023-08-25T04:03:00.719016+0000","last_unstale":"2023-08-25T04:03:01.339105+0000","last_undegraded":"2023-08-25T04:03:01.339105+0000","last_fullsized":"2023-08-25T04:03:01.339105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:53:17.362839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.363348+0000","last_change":"2023-08-25T04:03:01.348671+0000","last_active":"2023-08-25T04:03:01.363348+0000","last_peered":"2023-08-25T04:03:01.363348+0000","last_clean":"2023-08-25T04:03:01.363348+0000","last_became_active":"2023-08-25T04:03:01.348415+0000","last_became_peered":"2023-08-25T04:03:01.348415+0000","last_unstale":"2023-08-25T04:03:01.363348+0000","last_undegraded":"2023-08-25T04:03:01.363348+0000","last_fullsized":"2023-08-25T04:03:01.363348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:19:38.808296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.713422+0000","last_change":"2023-08-25T04:03:00.721463+0000","last_active":"2023-08-25T04:03:01.713422+0000","last_peered":"2023-08-25T04:03:01.713422+0000","last_clean":"2023-08-25T04:03:01.713422+0000","last_became_active":"2023-08-25T04:03:00.721177+0000","last_became_peered":"2023-08-25T04:03:00.721177+0000","last_unstale":"2023-08-25T04:03:01.713422+0000","last_undegraded":"2023-08-25T04:03:01.713422+0000","last_fullsized":"2023-08-25T04:03:01.713422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:09:39.160220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.345220+0000","last_change":"2023-08-25T04:03:00.719107+0000","last_active":"2023-08-25T04:03:01.345220+0000","last_peered":"2023-08-25T04:03:01.345220+0000","last_clean":"2023-08-25T04:03:01.345220+0000","last_became_active":"2023-08-25T04:03:00.718831+0000","last_became_peered":"2023-08-25T04:03:00.718831+0000","last_unstale":"2023-08-25T04:03:01.345220+0000","last_undegraded":"2023-08-25T04:03:01.345220+0000","last_fullsized":"2023-08-25T04:03:01.345220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:24:08.910691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.355758+0000","last_change":"2023-08-25T04:03:01.349735+0000","last_active":"2023-08-25T04:03:01.355758+0000","last_peered":"2023-08-25T04:03:01.355758+0000","last_clean":"2023-08-25T04:03:01.355758+0000","last_became_active":"2023-08-25T04:03:01.349169+0000","last_became_peered":"2023-08-25T04:03:01.349169+0000","last_unstale":"2023-08-25T04:03:01.355758+0000","last_undegraded":"2023-08-25T04:03:01.355758+0000","last_fullsized":"2023-08-25T04:03:01.355758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:14:58.886873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.346421+0000","last_change":"2023-08-25T04:03:00.722052+0000","last_active":"2023-08-25T04:03:01.346421+0000","last_peered":"2023-08-25T04:03:01.346421+0000","last_clean":"2023-08-25T04:03:01.346421+0000","last_became_active":"2023-08-25T04:03:00.721711+0000","last_became_peered":"2023-08-25T04:03:00.721711+0000","last_unstale":"2023-08-25T04:03:01.346421+0000","last_undegraded":"2023-08-25T04:03:01.346421+0000","last_fullsized":"2023-08-25T04:03:01.346421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:31:25.565858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.353565+0000","last_change":"2023-08-25T04:03:01.345111+0000","last_active":"2023-08-25T04:03:01.353565+0000","last_peered":"2023-08-25T04:03:01.353565+0000","last_clean":"2023-08-25T04:03:01.353565+0000","last_became_active":"2023-08-25T04:03:01.344450+0000","last_became_peered":"2023-08-25T04:03:01.344450+0000","last_unstale":"2023-08-25T04:03:01.353565+0000","last_undegraded":"2023-08-25T04:03:01.353565+0000","last_fullsized":"2023-08-25T04:03:01.353565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:33.754524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335653+0000","last_change":"2023-08-25T04:03:01.354750+0000","last_active":"2023-08-25T04:03:02.335653+0000","last_peered":"2023-08-25T04:03:02.335653+0000","last_clean":"2023-08-25T04:03:02.335653+0000","last_became_active":"2023-08-25T04:03:01.354428+0000","last_became_peered":"2023-08-25T04:03:01.354428+0000","last_unstale":"2023-08-25T04:03:02.335653+0000","last_undegraded":"2023-08-25T04:03:02.335653+0000","last_fullsized":"2023-08-25T04:03:02.335653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:55.173495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.336064+0000","last_change":"2023-08-25T04:03:00.724234+0000","last_active":"2023-08-25T04:03:01.336064+0000","last_peered":"2023-08-25T04:03:01.336064+0000","last_clean":"2023-08-25T04:03:01.336064+0000","last_became_active":"2023-08-25T04:03:00.723532+0000","last_became_peered":"2023-08-25T04:03:00.723532+0000","last_unstale":"2023-08-25T04:03:01.336064+0000","last_undegraded":"2023-08-25T04:03:01.336064+0000","last_fullsized":"2023-08-25T04:03:01.336064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:06:44.167223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.354424+0000","last_change":"2023-08-25T04:03:01.349065+0000","last_active":"2023-08-25T04:03:01.354424+0000","last_peered":"2023-08-25T04:03:01.354424+0000","last_clean":"2023-08-25T04:03:01.354424+0000","last_became_active":"2023-08-25T04:03:01.348789+0000","last_became_peered":"2023-08-25T04:03:01.348789+0000","last_unstale":"2023-08-25T04:03:01.354424+0000","last_undegraded":"2023-08-25T04:03:01.354424+0000","last_fullsized":"2023-08-25T04:03:01.354424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:20:47.107743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.334533+0000","last_change":"2023-08-25T04:03:00.718057+0000","last_active":"2023-08-25T04:03:01.334533+0000","last_peered":"2023-08-25T04:03:01.334533+0000","last_clean":"2023-08-25T04:03:01.334533+0000","last_became_active":"2023-08-25T04:03:00.717736+0000","last_became_peered":"2023-08-25T04:03:00.717736+0000","last_unstale":"2023-08-25T04:03:01.334533+0000","last_undegraded":"2023-08-25T04:03:01.334533+0000","last_fullsized":"2023-08-25T04:03:01.334533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:35:03.831123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.366383+0000","last_change":"2023-08-25T04:03:01.357499+0000","last_active":"2023-08-25T04:03:01.366383+0000","last_peered":"2023-08-25T04:03:01.366383+0000","last_clean":"2023-08-25T04:03:01.366383+0000","last_became_active":"2023-08-25T04:03:01.357124+0000","last_became_peered":"2023-08-25T04:03:01.357124+0000","last_unstale":"2023-08-25T04:03:01.366383+0000","last_undegraded":"2023-08-25T04:03:01.366383+0000","last_fullsized":"2023-08-25T04:03:01.366383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:42:21.914526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.339937+0000","last_change":"2023-08-25T04:03:00.719151+0000","last_active":"2023-08-25T04:03:01.339937+0000","last_peered":"2023-08-25T04:03:01.339937+0000","last_clean":"2023-08-25T04:03:01.339937+0000","last_became_active":"2023-08-25T04:03:00.718851+0000","last_became_peered":"2023-08-25T04:03:00.718851+0000","last_unstale":"2023-08-25T04:03:01.339937+0000","last_undegraded":"2023-08-25T04:03:01.339937+0000","last_fullsized":"2023-08-25T04:03:01.339937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:24:08.910691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.358817+0000","last_change":"2023-08-25T04:03:01.357412+0000","last_active":"2023-08-25T04:03:01.358817+0000","last_peered":"2023-08-25T04:03:01.358817+0000","last_clean":"2023-08-25T04:03:01.358817+0000","last_became_active":"2023-08-25T04:03:01.357136+0000","last_became_peered":"2023-08-25T04:03:01.357136+0000","last_unstale":"2023-08-25T04:03:01.358817+0000","last_undegraded":"2023-08-25T04:03:01.358817+0000","last_fullsized":"2023-08-25T04:03:01.358817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:50:32.887542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.345456+0000","last_change":"2023-08-25T04:03:00.725319+0000","last_active":"2023-08-25T04:03:01.345456+0000","last_peered":"2023-08-25T04:03:01.345456+0000","last_clean":"2023-08-25T04:03:01.345456+0000","last_became_active":"2023-08-25T04:03:00.725047+0000","last_became_peered":"2023-08-25T04:03:00.725047+0000","last_unstale":"2023-08-25T04:03:01.345456+0000","last_undegraded":"2023-08-25T04:03:01.345456+0000","last_fullsized":"2023-08-25T04:03:01.345456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:25.952979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.364171+0000","last_change":"2023-08-25T04:03:01.359175+0000","last_active":"2023-08-25T04:03:01.364171+0000","last_peered":"2023-08-25T04:03:01.364171+0000","last_clean":"2023-08-25T04:03:01.364171+0000","last_became_active":"2023-08-25T04:03:01.358098+0000","last_became_peered":"2023-08-25T04:03:01.358098+0000","last_unstale":"2023-08-25T04:03:01.364171+0000","last_undegraded":"2023-08-25T04:03:01.364171+0000","last_fullsized":"2023-08-25T04:03:01.364171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:26.962898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.344190+0000","last_change":"2023-08-25T04:03:00.724464+0000","last_active":"2023-08-25T04:03:01.344190+0000","last_peered":"2023-08-25T04:03:01.344190+0000","last_clean":"2023-08-25T04:03:01.344190+0000","last_became_active":"2023-08-25T04:03:00.724195+0000","last_became_peered":"2023-08-25T04:03:00.724195+0000","last_unstale":"2023-08-25T04:03:01.344190+0000","last_undegraded":"2023-08-25T04:03:01.344190+0000","last_fullsized":"2023-08-25T04:03:01.344190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:25.952979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.364223+0000","last_change":"2023-08-25T04:03:01.359383+0000","last_active":"2023-08-25T04:03:01.364223+0000","last_peered":"2023-08-25T04:03:01.364223+0000","last_clean":"2023-08-25T04:03:01.364223+0000","last_became_active":"2023-08-25T04:03:01.358081+0000","last_became_peered":"2023-08-25T04:03:01.358081+0000","last_unstale":"2023-08-25T04:03:01.364223+0000","last_undegraded":"2023-08-25T04:03:01.364223+0000","last_fullsized":"2023-08-25T04:03:01.364223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:36.768985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.348407+0000","last_change":"2023-08-25T04:03:00.724403+0000","last_active":"2023-08-25T04:03:01.348407+0000","last_peered":"2023-08-25T04:03:01.348407+0000","last_clean":"2023-08-25T04:03:01.348407+0000","last_became_active":"2023-08-25T04:03:00.724136+0000","last_became_peered":"2023-08-25T04:03:00.724136+0000","last_unstale":"2023-08-25T04:03:01.348407+0000","last_undegraded":"2023-08-25T04:03:01.348407+0000","last_fullsized":"2023-08-25T04:03:01.348407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:00.993169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.353539+0000","last_change":"2023-08-25T04:03:01.348397+0000","last_active":"2023-08-25T04:03:01.353539+0000","last_peered":"2023-08-25T04:03:01.353539+0000","last_clean":"2023-08-25T04:03:01.353539+0000","last_became_active":"2023-08-25T04:03:01.345667+0000","last_became_peered":"2023-08-25T04:03:01.345667+0000","last_unstale":"2023-08-25T04:03:01.353539+0000","last_undegraded":"2023-08-25T04:03:01.353539+0000","last_fullsized":"2023-08-25T04:03:01.353539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:09:20.866112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.334409+0000","last_change":"2023-08-25T04:03:00.718222+0000","last_active":"2023-08-25T04:03:01.334409+0000","last_peered":"2023-08-25T04:03:01.334409+0000","last_clean":"2023-08-25T04:03:01.334409+0000","last_became_active":"2023-08-25T04:03:00.717941+0000","last_became_peered":"2023-08-25T04:03:00.717941+0000","last_unstale":"2023-08-25T04:03:01.334409+0000","last_undegraded":"2023-08-25T04:03:01.334409+0000","last_fullsized":"2023-08-25T04:03:01.334409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:23.316378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.360934+0000","last_change":"2023-08-25T04:03:01.344378+0000","last_active":"2023-08-25T04:03:01.360934+0000","last_peered":"2023-08-25T04:03:01.360934+0000","last_clean":"2023-08-25T04:03:01.360934+0000","last_became_active":"2023-08-25T04:03:01.343370+0000","last_became_peered":"2023-08-25T04:03:01.343370+0000","last_unstale":"2023-08-25T04:03:01.360934+0000","last_undegraded":"2023-08-25T04:03:01.360934+0000","last_fullsized":"2023-08-25T04:03:01.360934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:09.656491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.346296+0000","last_change":"2023-08-25T04:03:00.723428+0000","last_active":"2023-08-25T04:03:01.346296+0000","last_peered":"2023-08-25T04:03:01.346296+0000","last_clean":"2023-08-25T04:03:01.346296+0000","last_became_active":"2023-08-25T04:03:00.722959+0000","last_became_peered":"2023-08-25T04:03:00.722959+0000","last_unstale":"2023-08-25T04:03:01.346296+0000","last_undegraded":"2023-08-25T04:03:01.346296+0000","last_fullsized":"2023-08-25T04:03:01.346296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:01:02.753445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":856064,"data_stored":677361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":85165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":85165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":78037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":85165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":71417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":85165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":827392,"data_stored":675533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:03:05.846 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:03:06.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.023+0000 7fb1441a3640 1 Processor -- start 2023-08-25T04:03:06.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.023+0000 7fb1441a3640 1 -- start start 2023-08-25T04:03:06.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.023+0000 7fb1441a3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb13c15ef80 0x7fb13c0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:06.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.023+0000 7fb1441a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb13c0cece0 0x7fb13c0ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:06.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.023+0000 7fb1441a3640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb13c0ac3a0 con 0x7fb13c15eba0 2023-08-25T04:03:06.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.023+0000 7fb1441a3640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13c0cf170 con 0x7fb13c15ef80 2023-08-25T04:03:06.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.023+0000 7fb1441a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c0b3150 con 0x7fb13c0cece0 2023-08-25T04:03:06.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.023+0000 7fb142740640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb13c0cece0 0x7fb13c0ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:06.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.023+0000 7fb14173e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb13c15ef80 0x7fb13c0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:06.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.027+0000 7fb142740640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb13c0cece0 0x7fb13c0ab0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:46738/0 (socket says 172.21.15.55:46738) 2023-08-25T04:03:06.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.027+0000 7fb142740640 1 -- 172.21.15.55:0/3212123301 learned_addr learned my addr 172.21.15.55:0/3212123301 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:06.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.027+0000 7fb140f3d640 1 -- 172.21.15.55:0/3212123301 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834680378 0 0) 0x7fb13c0ac3a0 con 0x7fb13c15eba0 2023-08-25T04:03:06.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.027+0000 7fb140f3d640 1 -- 172.21.15.55:0/3212123301 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb128003530 con 0x7fb13c15eba0 2023-08-25T04:03:06.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.027+0000 7fb14173e640 1 -- 172.21.15.55:0/3212123301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb13c0cece0 msgr2=0x7fb13c0ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:06.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.027+0000 7fb14173e640 1 --2- 172.21.15.55:0/3212123301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb13c0cece0 0x7fb13c0ab0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.027+0000 7fb14173e640 1 -- 172.21.15.55:0/3212123301 >> v1:172.21.15.110:6789/0 conn(0x7fb13c15eba0 legacy=0x7fb13c0b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:06.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.027+0000 7fb14173e640 1 -- 172.21.15.55:0/3212123301 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c0b1390 con 0x7fb13c15ef80 2023-08-25T04:03:06.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.027+0000 7fb142740640 1 --2- 172.21.15.55:0/3212123301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb13c0cece0 0x7fb13c0ab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.027+0000 7fb14173e640 1 --2- 172.21.15.55:0/3212123301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb13c15ef80 0x7fb13c0ce7a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0097c0 tx=0x7fb12c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f868328b201afe8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.027+0000 7fb140f3d640 1 -- 172.21.15.55:0/3212123301 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0ab650 con 0x7fb13c15ef80 2023-08-25T04:03:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.027+0000 7fb140f3d640 1 -- 172.21.15.55:0/3212123301 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c0ab7b0 con 0x7fb13c15ef80 2023-08-25T04:03:06.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.027+0000 7fb140f3d640 1 -- 172.21.15.55:0/3212123301 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0abb20 con 0x7fb13c15ef80 2023-08-25T04:03:06.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb1441a3640 1 -- 172.21.15.55:0/3212123301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb13c15ef80 msgr2=0x7fb13c0ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:06.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb1441a3640 1 --2- 172.21.15.55:0/3212123301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb13c15ef80 0x7fb13c0ce7a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0097c0 tx=0x7fb12c01c450 comp rx=0 tx=0).stop 2023-08-25T04:03:06.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb1441a3640 1 -- 172.21.15.55:0/3212123301 shutdown_connections 2023-08-25T04:03:06.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb1441a3640 1 --2- 172.21.15.55:0/3212123301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb13c0cece0 0x7fb13c0ab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb1441a3640 1 --2- 172.21.15.55:0/3212123301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb13c15ef80 0x7fb13c0ce7a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb1441a3640 1 -- 172.21.15.55:0/3212123301 >> 172.21.15.55:0/3212123301 conn(0x7fb13c069d00 msgr2=0x7fb13c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:06.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb1441a3640 1 -- 172.21.15.55:0/3212123301 shutdown_connections 2023-08-25T04:03:06.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb1441a3640 1 -- 172.21.15.55:0/3212123301 wait complete. 2023-08-25T04:03:06.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb1441a3640 1 Processor -- start 2023-08-25T04:03:06.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb1441a3640 1 -- start start 2023-08-25T04:03:06.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb1441a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb13c0cece0 0x7fb13c0c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:06.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb1441a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb13c15eba0 0x7fb13c0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:06.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb1441a3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb13c15ef80 0x7fb13c14f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:06.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb1441a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c0c33b0 con 0x7fb13c15eba0 2023-08-25T04:03:06.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb1441a3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c0c2a50 con 0x7fb13c15ef80 2023-08-25T04:03:06.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb1441a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c0ca400 con 0x7fb13c0cece0 2023-08-25T04:03:06.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb14173e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb13c15eba0 0x7fb13c0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:06.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb141f3f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb13c0cece0 0x7fb13c0c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:06.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb14173e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb13c15eba0 0x7fb13c0cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35412/0 (socket says 172.21.15.55:35412) 2023-08-25T04:03:06.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb14173e640 1 -- 172.21.15.55:0/1288148718 learned_addr learned my addr 172.21.15.55:0/1288148718 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:06.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.031+0000 7fb142740640 1 --2- 172.21.15.55:0/1288148718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb13c15ef80 0x7fb13c14f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:06.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.035+0000 7fb14173e640 1 -- 172.21.15.55:0/1288148718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb13c0cece0 msgr2=0x7fb13c0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:06.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.035+0000 7fb14173e640 1 --2- 172.21.15.55:0/1288148718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb13c0cece0 0x7fb13c0c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.035+0000 7fb14173e640 1 -- 172.21.15.55:0/1288148718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb13c15ef80 msgr2=0x7fb13c14f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:06.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.035+0000 7fb14173e640 1 --2- 172.21.15.55:0/1288148718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb13c15ef80 0x7fb13c14f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.035+0000 7fb14173e640 1 -- 172.21.15.55:0/1288148718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb134009b30 con 0x7fb13c15eba0 2023-08-25T04:03:06.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.035+0000 7fb141f3f640 1 --2- 172.21.15.55:0/1288148718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb13c0cece0 0x7fb13c0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:06.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.035+0000 7fb14173e640 1 --2- 172.21.15.55:0/1288148718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb13c15eba0 0x7fb13c0cb1a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb12c01ccf0 tx=0x7fb12c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:06.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.035+0000 7fb1327fc640 1 -- 172.21.15.55:0/1288148718 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0abd30 con 0x7fb13c15eba0 2023-08-25T04:03:06.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.035+0000 7fb1327fc640 1 -- 172.21.15.55:0/1288148718 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c0abe90 con 0x7fb13c15eba0 2023-08-25T04:03:06.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.035+0000 7fb1327fc640 1 -- 172.21.15.55:0/1288148718 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0be630 con 0x7fb13c15eba0 2023-08-25T04:03:06.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.035+0000 7fb1441a3640 1 -- 172.21.15.55:0/1288148718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb12c009420 con 0x7fb13c15eba0 2023-08-25T04:03:06.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.035+0000 7fb1441a3640 1 -- 172.21.15.55:0/1288148718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13c0c2fd0 con 0x7fb13c15eba0 2023-08-25T04:03:06.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.035+0000 7fb1441a3640 1 -- 172.21.15.55:0/1288148718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13c0c34f0 con 0x7fb13c15eba0 2023-08-25T04:03:06.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.035+0000 7fb1327fc640 1 -- 172.21.15.55:0/1288148718 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb12c0be790 con 0x7fb13c15eba0 2023-08-25T04:03:06.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.035+0000 7fb1327fc640 1 --2- 172.21.15.55:0/1288148718 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb1200656b0 0x7fb120067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:06.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.035+0000 7fb1327fc640 1 -- 172.21.15.55:0/1288148718 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb12c11d480 con 0x7fb13c15eba0 2023-08-25T04:03:06.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.035+0000 7fb141f3f640 1 --2- 172.21.15.55:0/1288148718 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb1200656b0 0x7fb120067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:06.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.039+0000 7fb141f3f640 1 --2- 172.21.15.55:0/1288148718 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb1200656b0 0x7fb120067b70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb138001bb0 tx=0x7fb138009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:06.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.039+0000 7fb1327fc640 1 -- 172.21.15.55:0/1288148718 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb13c0c34f0 con 0x7fb13c15eba0 2023-08-25T04:03:06.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.195+0000 7fb1441a3640 1 -- 172.21.15.55:0/1288148718 --> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb13c0b1f10 con 0x7fb1200656b0 2023-08-25T04:03:06.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.203+0000 7fb1327fc640 1 -- 172.21.15.55:0/1288148718 <== mgr.4102 v2:172.21.15.110:6832/413962747 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286633 (secure 0 0 0) 0x7fb138001d00 con 0x7fb1200656b0 2023-08-25T04:03:06.207 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:06.208 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:03:06.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.203+0000 7fb1441a3640 1 -- 172.21.15.55:0/1288148718 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb1200656b0 msgr2=0x7fb120067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:06.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.203+0000 7fb1441a3640 1 --2- 172.21.15.55:0/1288148718 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb1200656b0 0x7fb120067b70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb138001bb0 tx=0x7fb138009040 comp rx=0 tx=0).stop 2023-08-25T04:03:06.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.203+0000 7fb1441a3640 1 -- 172.21.15.55:0/1288148718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb13c15eba0 msgr2=0x7fb13c0cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:06.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.203+0000 7fb1441a3640 1 --2- 172.21.15.55:0/1288148718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb13c15eba0 0x7fb13c0cb1a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb12c01ccf0 tx=0x7fb12c0191f0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.203+0000 7fb1441a3640 1 -- 172.21.15.55:0/1288148718 shutdown_connections 2023-08-25T04:03:06.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.203+0000 7fb1441a3640 1 --2- 172.21.15.55:0/1288148718 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb1200656b0 0x7fb120067b70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.203+0000 7fb1441a3640 1 --2- 172.21.15.55:0/1288148718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb13c15ef80 0x7fb13c14f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.203+0000 7fb1441a3640 1 --2- 172.21.15.55:0/1288148718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb13c15eba0 0x7fb13c0cb1a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.203+0000 7fb1441a3640 1 --2- 172.21.15.55:0/1288148718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb13c0cece0 0x7fb13c0c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.203+0000 7fb1441a3640 1 -- 172.21.15.55:0/1288148718 >> 172.21.15.55:0/1288148718 conn(0x7fb13c069d00 msgr2=0x7fb13c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:06.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.207+0000 7fb1441a3640 1 -- 172.21.15.55:0/1288148718 shutdown_connections 2023-08-25T04:03:06.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.207+0000 7fb1441a3640 1 -- 172.21.15.55:0/1288148718 wait complete. 2023-08-25T04:03:06.226 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-25T04:03:04.604858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590584,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":183,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244128,"kb_used_data":2976,"kb_used_omap":13,"kb_used_meta":241010,"kb_avail":754730592,"statfs":{"total":773094113280,"available":772844126208,"internally_reserved":0,"allocated":3047424,"data_stored":1843008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":246794328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.917662"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.348415+0000","last_change":"2023-08-25T04:03:01.345042+0000","last_active":"2023-08-25T04:03:01.348415+0000","last_peered":"2023-08-25T04:03:01.348415+0000","last_clean":"2023-08-25T04:03:01.348415+0000","last_became_active":"2023-08-25T04:03:01.344724+0000","last_became_peered":"2023-08-25T04:03:01.344724+0000","last_unstale":"2023-08-25T04:03:01.348415+0000","last_undegraded":"2023-08-25T04:03:01.348415+0000","last_fullsized":"2023-08-25T04:03:01.348415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:33.754524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.364176+0000","last_change":"2023-08-25T04:03:01.362953+0000","last_active":"2023-08-25T04:03:01.364176+0000","last_peered":"2023-08-25T04:03:01.364176+0000","last_clean":"2023-08-25T04:03:01.364176+0000","last_became_active":"2023-08-25T04:03:01.362672+0000","last_became_peered":"2023-08-25T04:03:01.362672+0000","last_unstale":"2023-08-25T04:03:01.364176+0000","last_undegraded":"2023-08-25T04:03:01.364176+0000","last_fullsized":"2023-08-25T04:03:01.364176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:31:26.575778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.363876+0000","last_change":"2023-08-25T04:03:01.352794+0000","last_active":"2023-08-25T04:03:01.363876+0000","last_peered":"2023-08-25T04:03:01.363876+0000","last_clean":"2023-08-25T04:03:01.363876+0000","last_became_active":"2023-08-25T04:03:01.352520+0000","last_became_peered":"2023-08-25T04:03:01.352520+0000","last_unstale":"2023-08-25T04:03:01.363876+0000","last_undegraded":"2023-08-25T04:03:01.363876+0000","last_fullsized":"2023-08-25T04:03:01.363876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:55.173495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335413+0000","last_change":"2023-08-25T04:03:01.348099+0000","last_active":"2023-08-25T04:03:02.335413+0000","last_peered":"2023-08-25T04:03:02.335413+0000","last_clean":"2023-08-25T04:03:02.335413+0000","last_became_active":"2023-08-25T04:03:01.347798+0000","last_became_peered":"2023-08-25T04:03:01.347798+0000","last_unstale":"2023-08-25T04:03:02.335413+0000","last_undegraded":"2023-08-25T04:03:02.335413+0000","last_fullsized":"2023-08-25T04:03:02.335413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:03.894113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.354480+0000","last_change":"2023-08-25T04:03:01.350578+0000","last_active":"2023-08-25T04:03:01.354480+0000","last_peered":"2023-08-25T04:03:01.354480+0000","last_clean":"2023-08-25T04:03:01.354480+0000","last_became_active":"2023-08-25T04:03:01.350212+0000","last_became_peered":"2023-08-25T04:03:01.350212+0000","last_unstale":"2023-08-25T04:03:01.354480+0000","last_undegraded":"2023-08-25T04:03:01.354480+0000","last_fullsized":"2023-08-25T04:03:01.354480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:45:02.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.363976+0000","last_change":"2023-08-25T04:03:01.353871+0000","last_active":"2023-08-25T04:03:01.363976+0000","last_peered":"2023-08-25T04:03:01.363976+0000","last_clean":"2023-08-25T04:03:01.363976+0000","last_became_active":"2023-08-25T04:03:01.353553+0000","last_became_peered":"2023-08-25T04:03:01.353553+0000","last_unstale":"2023-08-25T04:03:01.363976+0000","last_undegraded":"2023-08-25T04:03:01.363976+0000","last_fullsized":"2023-08-25T04:03:01.363976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:51:01.167062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.365300+0000","last_change":"2023-08-25T04:03:01.364502+0000","last_active":"2023-08-25T04:03:01.365300+0000","last_peered":"2023-08-25T04:03:01.365300+0000","last_clean":"2023-08-25T04:03:01.365300+0000","last_became_active":"2023-08-25T04:03:01.364135+0000","last_became_peered":"2023-08-25T04:03:01.364135+0000","last_unstale":"2023-08-25T04:03:01.365300+0000","last_undegraded":"2023-08-25T04:03:01.365300+0000","last_fullsized":"2023-08-25T04:03:01.365300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:31.298630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.363148+0000","last_change":"2023-08-25T04:03:01.362258+0000","last_active":"2023-08-25T04:03:01.363148+0000","last_peered":"2023-08-25T04:03:01.363148+0000","last_clean":"2023-08-25T04:03:01.363148+0000","last_became_active":"2023-08-25T04:03:01.361897+0000","last_became_peered":"2023-08-25T04:03:01.361897+0000","last_unstale":"2023-08-25T04:03:01.363148+0000","last_undegraded":"2023-08-25T04:03:01.363148+0000","last_fullsized":"2023-08-25T04:03:01.363148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:04:24.406419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.355619+0000","last_change":"2023-08-25T04:03:01.354196+0000","last_active":"2023-08-25T04:03:01.355619+0000","last_peered":"2023-08-25T04:03:01.355619+0000","last_clean":"2023-08-25T04:03:01.355619+0000","last_became_active":"2023-08-25T04:03:01.353929+0000","last_became_peered":"2023-08-25T04:03:01.353929+0000","last_unstale":"2023-08-25T04:03:01.355619+0000","last_undegraded":"2023-08-25T04:03:01.355619+0000","last_fullsized":"2023-08-25T04:03:01.355619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:51:01.167062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.357650+0000","last_change":"2023-08-25T04:03:01.355535+0000","last_active":"2023-08-25T04:03:01.357650+0000","last_peered":"2023-08-25T04:03:01.357650+0000","last_clean":"2023-08-25T04:03:01.357650+0000","last_became_active":"2023-08-25T04:03:01.355233+0000","last_became_peered":"2023-08-25T04:03:01.355233+0000","last_unstale":"2023-08-25T04:03:01.357650+0000","last_undegraded":"2023-08-25T04:03:01.357650+0000","last_fullsized":"2023-08-25T04:03:01.357650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:01:03.763365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.363771+0000","last_change":"2023-08-25T04:03:01.350101+0000","last_active":"2023-08-25T04:03:01.363771+0000","last_peered":"2023-08-25T04:03:01.363771+0000","last_clean":"2023-08-25T04:03:01.363771+0000","last_became_active":"2023-08-25T04:03:01.347061+0000","last_became_peered":"2023-08-25T04:03:01.347061+0000","last_unstale":"2023-08-25T04:03:01.363771+0000","last_undegraded":"2023-08-25T04:03:01.363771+0000","last_fullsized":"2023-08-25T04:03:01.363771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:53:34.243572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.360010+0000","last_change":"2023-08-25T04:03:01.358731+0000","last_active":"2023-08-25T04:03:01.360010+0000","last_peered":"2023-08-25T04:03:01.360010+0000","last_clean":"2023-08-25T04:03:01.360010+0000","last_became_active":"2023-08-25T04:03:01.358447+0000","last_became_peered":"2023-08-25T04:03:01.358447+0000","last_unstale":"2023-08-25T04:03:01.360010+0000","last_undegraded":"2023-08-25T04:03:01.360010+0000","last_fullsized":"2023-08-25T04:03:01.360010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:35:37.283960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.346570+0000","last_change":"2023-08-25T04:03:01.344944+0000","last_active":"2023-08-25T04:03:01.346570+0000","last_peered":"2023-08-25T04:03:01.346570+0000","last_clean":"2023-08-25T04:03:01.346570+0000","last_became_active":"2023-08-25T04:03:01.344660+0000","last_became_peered":"2023-08-25T04:03:01.344660+0000","last_unstale":"2023-08-25T04:03:01.346570+0000","last_undegraded":"2023-08-25T04:03:01.346570+0000","last_fullsized":"2023-08-25T04:03:01.346570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:00:13.178203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.356351+0000","last_change":"2023-08-25T04:03:01.354816+0000","last_active":"2023-08-25T04:03:01.356351+0000","last_peered":"2023-08-25T04:03:01.356351+0000","last_clean":"2023-08-25T04:03:01.356351+0000","last_became_active":"2023-08-25T04:03:01.354525+0000","last_became_peered":"2023-08-25T04:03:01.354525+0000","last_unstale":"2023-08-25T04:03:01.356351+0000","last_undegraded":"2023-08-25T04:03:01.356351+0000","last_fullsized":"2023-08-25T04:03:01.356351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:20:47.107743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.364701+0000","last_change":"2023-08-25T04:03:01.363162+0000","last_active":"2023-08-25T04:03:01.364701+0000","last_peered":"2023-08-25T04:03:01.364701+0000","last_clean":"2023-08-25T04:03:01.364701+0000","last_became_active":"2023-08-25T04:03:01.362765+0000","last_became_peered":"2023-08-25T04:03:01.362765+0000","last_unstale":"2023-08-25T04:03:01.364701+0000","last_undegraded":"2023-08-25T04:03:01.364701+0000","last_fullsized":"2023-08-25T04:03:01.364701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:24:09.920611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.363948+0000","last_change":"2023-08-25T04:03:01.353137+0000","last_active":"2023-08-25T04:03:01.363948+0000","last_peered":"2023-08-25T04:03:01.363948+0000","last_clean":"2023-08-25T04:03:01.363948+0000","last_became_active":"2023-08-25T04:03:01.352866+0000","last_became_peered":"2023-08-25T04:03:01.352866+0000","last_unstale":"2023-08-25T04:03:01.363948+0000","last_undegraded":"2023-08-25T04:03:01.363948+0000","last_fullsized":"2023-08-25T04:03:01.363948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:44:18.660752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.355636+0000","last_change":"2023-08-25T04:03:01.354256+0000","last_active":"2023-08-25T04:03:01.355636+0000","last_peered":"2023-08-25T04:03:01.355636+0000","last_clean":"2023-08-25T04:03:01.355636+0000","last_became_active":"2023-08-25T04:03:01.353982+0000","last_became_peered":"2023-08-25T04:03:01.353982+0000","last_unstale":"2023-08-25T04:03:01.355636+0000","last_undegraded":"2023-08-25T04:03:01.355636+0000","last_fullsized":"2023-08-25T04:03:01.355636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:18:42.967152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.360515+0000","last_change":"2023-08-25T04:03:01.342079+0000","last_active":"2023-08-25T04:03:01.360515+0000","last_peered":"2023-08-25T04:03:01.360515+0000","last_clean":"2023-08-25T04:03:01.360515+0000","last_became_active":"2023-08-25T04:03:01.341556+0000","last_became_peered":"2023-08-25T04:03:01.341556+0000","last_unstale":"2023-08-25T04:03:01.360515+0000","last_undegraded":"2023-08-25T04:03:01.360515+0000","last_fullsized":"2023-08-25T04:03:01.360515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:50:05.939959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.343516+0000","last_change":"2023-08-25T04:03:01.340781+0000","last_active":"2023-08-25T04:03:01.343516+0000","last_peered":"2023-08-25T04:03:01.343516+0000","last_clean":"2023-08-25T04:03:01.343516+0000","last_became_active":"2023-08-25T04:03:01.340444+0000","last_became_peered":"2023-08-25T04:03:01.340444+0000","last_unstale":"2023-08-25T04:03:01.343516+0000","last_undegraded":"2023-08-25T04:03:01.343516+0000","last_fullsized":"2023-08-25T04:03:01.343516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:49:51.444051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.360819+0000","last_change":"2023-08-25T04:03:01.343273+0000","last_active":"2023-08-25T04:03:01.360819+0000","last_peered":"2023-08-25T04:03:01.360819+0000","last_clean":"2023-08-25T04:03:01.360819+0000","last_became_active":"2023-08-25T04:03:01.342978+0000","last_became_peered":"2023-08-25T04:03:01.342978+0000","last_unstale":"2023-08-25T04:03:01.360819+0000","last_undegraded":"2023-08-25T04:03:01.360819+0000","last_fullsized":"2023-08-25T04:03:01.360819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:20:47.107743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.360495+0000","last_change":"2023-08-25T04:03:01.356873+0000","last_active":"2023-08-25T04:03:01.360495+0000","last_peered":"2023-08-25T04:03:01.360495+0000","last_clean":"2023-08-25T04:03:01.360495+0000","last_became_active":"2023-08-25T04:03:01.356524+0000","last_became_peered":"2023-08-25T04:03:01.356524+0000","last_unstale":"2023-08-25T04:03:01.360495+0000","last_undegraded":"2023-08-25T04:03:01.360495+0000","last_fullsized":"2023-08-25T04:03:01.360495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:55:09.171814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.367100+0000","last_change":"2023-08-25T04:03:01.362913+0000","last_active":"2023-08-25T04:03:01.367100+0000","last_peered":"2023-08-25T04:03:01.367100+0000","last_clean":"2023-08-25T04:03:01.367100+0000","last_became_active":"2023-08-25T04:03:01.362630+0000","last_became_peered":"2023-08-25T04:03:01.362630+0000","last_unstale":"2023-08-25T04:03:01.367100+0000","last_undegraded":"2023-08-25T04:03:01.367100+0000","last_fullsized":"2023-08-25T04:03:01.367100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:50:05.939959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.355738+0000","last_change":"2023-08-25T04:03:01.349042+0000","last_active":"2023-08-25T04:03:01.355738+0000","last_peered":"2023-08-25T04:03:01.355738+0000","last_clean":"2023-08-25T04:03:01.355738+0000","last_became_active":"2023-08-25T04:03:01.348683+0000","last_became_peered":"2023-08-25T04:03:01.348683+0000","last_unstale":"2023-08-25T04:03:01.355738+0000","last_undegraded":"2023-08-25T04:03:01.355738+0000","last_fullsized":"2023-08-25T04:03:01.355738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:11:43.886179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.360483+0000","last_change":"2023-08-25T04:03:01.356864+0000","last_active":"2023-08-25T04:03:01.360483+0000","last_peered":"2023-08-25T04:03:01.360483+0000","last_clean":"2023-08-25T04:03:01.360483+0000","last_became_active":"2023-08-25T04:03:01.356507+0000","last_became_peered":"2023-08-25T04:03:01.356507+0000","last_unstale":"2023-08-25T04:03:01.360483+0000","last_undegraded":"2023-08-25T04:03:01.360483+0000","last_fullsized":"2023-08-25T04:03:01.360483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:55.173495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.361321+0000","last_change":"2023-08-25T04:03:01.342638+0000","last_active":"2023-08-25T04:03:01.361321+0000","last_peered":"2023-08-25T04:03:01.361321+0000","last_clean":"2023-08-25T04:03:01.361321+0000","last_became_active":"2023-08-25T04:03:01.342295+0000","last_became_peered":"2023-08-25T04:03:01.342295+0000","last_unstale":"2023-08-25T04:03:01.361321+0000","last_undegraded":"2023-08-25T04:03:01.361321+0000","last_fullsized":"2023-08-25T04:03:01.361321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:06:45.177142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.362028+0000","last_change":"2023-08-25T04:03:01.348390+0000","last_active":"2023-08-25T04:03:01.362028+0000","last_peered":"2023-08-25T04:03:01.362028+0000","last_clean":"2023-08-25T04:03:01.362028+0000","last_became_active":"2023-08-25T04:03:01.347587+0000","last_became_peered":"2023-08-25T04:03:01.347587+0000","last_unstale":"2023-08-25T04:03:01.362028+0000","last_undegraded":"2023-08-25T04:03:01.362028+0000","last_fullsized":"2023-08-25T04:03:01.362028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:02:05.440530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.360013+0000","last_change":"2023-08-25T04:03:01.358436+0000","last_active":"2023-08-25T04:03:01.360013+0000","last_peered":"2023-08-25T04:03:01.360013+0000","last_clean":"2023-08-25T04:03:01.360013+0000","last_became_active":"2023-08-25T04:03:01.356095+0000","last_became_peered":"2023-08-25T04:03:01.356095+0000","last_unstale":"2023-08-25T04:03:01.360013+0000","last_undegraded":"2023-08-25T04:03:01.360013+0000","last_fullsized":"2023-08-25T04:03:01.360013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:53:18.372759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.362319+0000","last_change":"2023-08-25T04:03:01.351628+0000","last_active":"2023-08-25T04:03:01.362319+0000","last_peered":"2023-08-25T04:03:01.362319+0000","last_clean":"2023-08-25T04:03:01.362319+0000","last_became_active":"2023-08-25T04:03:01.350541+0000","last_became_peered":"2023-08-25T04:03:01.350541+0000","last_unstale":"2023-08-25T04:03:01.362319+0000","last_undegraded":"2023-08-25T04:03:01.362319+0000","last_fullsized":"2023-08-25T04:03:01.362319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:42:21.914526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.355680+0000","last_change":"2023-08-25T04:03:01.349534+0000","last_active":"2023-08-25T04:03:01.355680+0000","last_peered":"2023-08-25T04:03:01.355680+0000","last_clean":"2023-08-25T04:03:01.355680+0000","last_became_active":"2023-08-25T04:03:01.348968+0000","last_became_peered":"2023-08-25T04:03:01.348968+0000","last_unstale":"2023-08-25T04:03:01.355680+0000","last_undegraded":"2023-08-25T04:03:01.355680+0000","last_fullsized":"2023-08-25T04:03:01.355680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:50:32.887542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.361114+0000","last_change":"2023-08-25T04:03:01.343257+0000","last_active":"2023-08-25T04:03:01.361114+0000","last_peered":"2023-08-25T04:03:01.361114+0000","last_clean":"2023-08-25T04:03:01.361114+0000","last_became_active":"2023-08-25T04:03:01.342938+0000","last_became_peered":"2023-08-25T04:03:01.342938+0000","last_unstale":"2023-08-25T04:03:01.361114+0000","last_undegraded":"2023-08-25T04:03:01.361114+0000","last_fullsized":"2023-08-25T04:03:01.361114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:03:31.575646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.366336+0000","last_change":"2023-08-25T04:03:01.357291+0000","last_active":"2023-08-25T04:03:01.366336+0000","last_peered":"2023-08-25T04:03:01.366336+0000","last_clean":"2023-08-25T04:03:01.366336+0000","last_became_active":"2023-08-25T04:03:01.356973+0000","last_became_peered":"2023-08-25T04:03:01.356973+0000","last_unstale":"2023-08-25T04:03:01.366336+0000","last_undegraded":"2023-08-25T04:03:01.366336+0000","last_fullsized":"2023-08-25T04:03:01.366336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:33:15.291618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335221+0000","last_change":"2023-08-25T04:03:01.341244+0000","last_active":"2023-08-25T04:03:02.335221+0000","last_peered":"2023-08-25T04:03:02.335221+0000","last_clean":"2023-08-25T04:03:02.335221+0000","last_became_active":"2023-08-25T04:03:01.340907+0000","last_became_peered":"2023-08-25T04:03:01.340907+0000","last_unstale":"2023-08-25T04:03:02.335221+0000","last_undegraded":"2023-08-25T04:03:02.335221+0000","last_fullsized":"2023-08-25T04:03:02.335221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:04:24.406419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.366344+0000","last_change":"2023-08-25T04:03:01.357303+0000","last_active":"2023-08-25T04:03:01.366344+0000","last_peered":"2023-08-25T04:03:01.366344+0000","last_clean":"2023-08-25T04:03:01.366344+0000","last_became_active":"2023-08-25T04:03:01.356965+0000","last_became_peered":"2023-08-25T04:03:01.356965+0000","last_unstale":"2023-08-25T04:03:01.366344+0000","last_undegraded":"2023-08-25T04:03:01.366344+0000","last_fullsized":"2023-08-25T04:03:01.366344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:02:05.440530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.710959+0000","last_change":"2023-08-25T04:03:00.724082+0000","last_active":"2023-08-25T04:03:01.710959+0000","last_peered":"2023-08-25T04:03:01.710959+0000","last_clean":"2023-08-25T04:03:01.710959+0000","last_became_active":"2023-08-25T04:03:00.723792+0000","last_became_peered":"2023-08-25T04:03:00.723792+0000","last_unstale":"2023-08-25T04:03:01.710959+0000","last_undegraded":"2023-08-25T04:03:01.710959+0000","last_fullsized":"2023-08-25T04:03:01.710959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:10:45.831781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.359989+0000","last_change":"2023-08-25T04:03:01.356130+0000","last_active":"2023-08-25T04:03:01.359989+0000","last_peered":"2023-08-25T04:03:01.359989+0000","last_clean":"2023-08-25T04:03:01.359989+0000","last_became_active":"2023-08-25T04:03:01.355561+0000","last_became_peered":"2023-08-25T04:03:01.355561+0000","last_unstale":"2023-08-25T04:03:01.359989+0000","last_undegraded":"2023-08-25T04:03:01.359989+0000","last_fullsized":"2023-08-25T04:03:01.359989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:03.894113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.343851+0000","last_change":"2023-08-25T04:03:00.723608+0000","last_active":"2023-08-25T04:03:01.343851+0000","last_peered":"2023-08-25T04:03:01.343851+0000","last_clean":"2023-08-25T04:03:01.343851+0000","last_became_active":"2023-08-25T04:03:00.723314+0000","last_became_peered":"2023-08-25T04:03:00.723314+0000","last_unstale":"2023-08-25T04:03:01.343851+0000","last_undegraded":"2023-08-25T04:03:01.343851+0000","last_fullsized":"2023-08-25T04:03:01.343851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:02.884193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.354465+0000","last_change":"2023-08-25T04:03:01.350258+0000","last_active":"2023-08-25T04:03:01.354465+0000","last_peered":"2023-08-25T04:03:01.354465+0000","last_clean":"2023-08-25T04:03:01.354465+0000","last_became_active":"2023-08-25T04:03:01.349984+0000","last_became_peered":"2023-08-25T04:03:01.349984+0000","last_unstale":"2023-08-25T04:03:01.354465+0000","last_undegraded":"2023-08-25T04:03:01.354465+0000","last_fullsized":"2023-08-25T04:03:01.354465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:53:34.243572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.350290+0000","last_change":"2023-08-25T04:03:00.725255+0000","last_active":"2023-08-25T04:03:01.350290+0000","last_peered":"2023-08-25T04:03:01.350290+0000","last_clean":"2023-08-25T04:03:01.350290+0000","last_became_active":"2023-08-25T04:03:00.724980+0000","last_became_peered":"2023-08-25T04:03:00.724980+0000","last_unstale":"2023-08-25T04:03:01.350290+0000","last_undegraded":"2023-08-25T04:03:01.350290+0000","last_fullsized":"2023-08-25T04:03:01.350290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:00.993169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.353492+0000","last_change":"2023-08-25T04:03:01.345546+0000","last_active":"2023-08-25T04:03:01.353492+0000","last_peered":"2023-08-25T04:03:01.353492+0000","last_clean":"2023-08-25T04:03:01.353492+0000","last_became_active":"2023-08-25T04:03:01.345316+0000","last_became_peered":"2023-08-25T04:03:01.345316+0000","last_unstale":"2023-08-25T04:03:01.353492+0000","last_undegraded":"2023-08-25T04:03:01.353492+0000","last_fullsized":"2023-08-25T04:03:01.353492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:35:04.841043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335383+0000","last_change":"2023-08-25T04:03:00.716518+0000","last_active":"2023-08-25T04:03:02.335383+0000","last_peered":"2023-08-25T04:03:02.335383+0000","last_clean":"2023-08-25T04:03:02.335383+0000","last_became_active":"2023-08-25T04:03:00.716196+0000","last_became_peered":"2023-08-25T04:03:00.716196+0000","last_unstale":"2023-08-25T04:03:02.335383+0000","last_undegraded":"2023-08-25T04:03:02.335383+0000","last_fullsized":"2023-08-25T04:03:02.335383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:35.759065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.713426+0000","last_change":"2023-08-25T04:03:00.724751+0000","last_active":"2023-08-25T04:03:01.713426+0000","last_peered":"2023-08-25T04:03:01.713426+0000","last_clean":"2023-08-25T04:03:01.713426+0000","last_became_active":"2023-08-25T04:03:00.724484+0000","last_became_peered":"2023-08-25T04:03:00.724484+0000","last_unstale":"2023-08-25T04:03:01.713426+0000","last_undegraded":"2023-08-25T04:03:01.713426+0000","last_fullsized":"2023-08-25T04:03:01.713426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:44.260933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.351603+0000","last_change":"2023-08-25T04:03:01.349649+0000","last_active":"2023-08-25T04:03:01.351603+0000","last_peered":"2023-08-25T04:03:01.351603+0000","last_clean":"2023-08-25T04:03:01.351603+0000","last_became_active":"2023-08-25T04:03:01.349285+0000","last_became_peered":"2023-08-25T04:03:01.349285+0000","last_unstale":"2023-08-25T04:03:01.351603+0000","last_undegraded":"2023-08-25T04:03:01.351603+0000","last_fullsized":"2023-08-25T04:03:01.351603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:50:05.939959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.712552+0000","last_change":"2023-08-25T04:03:00.724274+0000","last_active":"2023-08-25T04:03:01.712552+0000","last_peered":"2023-08-25T04:03:01.712552+0000","last_clean":"2023-08-25T04:03:01.712552+0000","last_became_active":"2023-08-25T04:03:00.723971+0000","last_became_peered":"2023-08-25T04:03:00.723971+0000","last_unstale":"2023-08-25T04:03:01.712552+0000","last_undegraded":"2023-08-25T04:03:01.712552+0000","last_fullsized":"2023-08-25T04:03:01.712552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:16.973270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.364102+0000","last_change":"2023-08-25T04:03:01.352013+0000","last_active":"2023-08-25T04:03:01.364102+0000","last_peered":"2023-08-25T04:03:01.364102+0000","last_clean":"2023-08-25T04:03:01.364102+0000","last_became_active":"2023-08-25T04:03:01.351727+0000","last_became_peered":"2023-08-25T04:03:01.351727+0000","last_unstale":"2023-08-25T04:03:01.364102+0000","last_undegraded":"2023-08-25T04:03:01.364102+0000","last_fullsized":"2023-08-25T04:03:01.364102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:03.894113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.714294+0000","last_change":"2023-08-25T04:03:00.720598+0000","last_active":"2023-08-25T04:03:01.714294+0000","last_peered":"2023-08-25T04:03:01.714294+0000","last_clean":"2023-08-25T04:03:01.714294+0000","last_became_active":"2023-08-25T04:03:00.720316+0000","last_became_peered":"2023-08-25T04:03:00.720316+0000","last_unstale":"2023-08-25T04:03:01.714294+0000","last_undegraded":"2023-08-25T04:03:01.714294+0000","last_fullsized":"2023-08-25T04:03:01.714294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:14.800833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335421+0000","last_change":"2023-08-25T04:03:01.357353+0000","last_active":"2023-08-25T04:03:02.335421+0000","last_peered":"2023-08-25T04:03:02.335421+0000","last_clean":"2023-08-25T04:03:02.335421+0000","last_became_active":"2023-08-25T04:03:01.356994+0000","last_became_peered":"2023-08-25T04:03:01.356994+0000","last_unstale":"2023-08-25T04:03:02.335421+0000","last_undegraded":"2023-08-25T04:03:02.335421+0000","last_fullsized":"2023-08-25T04:03:02.335421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:53:18.372759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.344410+0000","last_change":"2023-08-25T04:03:00.721557+0000","last_active":"2023-08-25T04:03:01.344410+0000","last_peered":"2023-08-25T04:03:01.344410+0000","last_clean":"2023-08-25T04:03:01.344410+0000","last_became_active":"2023-08-25T04:03:00.721111+0000","last_became_peered":"2023-08-25T04:03:00.721111+0000","last_unstale":"2023-08-25T04:03:01.344410+0000","last_undegraded":"2023-08-25T04:03:01.344410+0000","last_fullsized":"2023-08-25T04:03:01.344410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:54.163575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.366595+0000","last_change":"2023-08-25T04:03:01.362147+0000","last_active":"2023-08-25T04:03:01.366595+0000","last_peered":"2023-08-25T04:03:01.366595+0000","last_clean":"2023-08-25T04:03:01.366595+0000","last_became_active":"2023-08-25T04:03:01.361891+0000","last_became_peered":"2023-08-25T04:03:01.361891+0000","last_unstale":"2023-08-25T04:03:01.366595+0000","last_undegraded":"2023-08-25T04:03:01.366595+0000","last_fullsized":"2023-08-25T04:03:01.366595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:04:24.406419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.336054+0000","last_change":"2023-08-25T04:03:00.726270+0000","last_active":"2023-08-25T04:03:01.336054+0000","last_peered":"2023-08-25T04:03:01.336054+0000","last_clean":"2023-08-25T04:03:01.336054+0000","last_became_active":"2023-08-25T04:03:00.725846+0000","last_became_peered":"2023-08-25T04:03:00.725846+0000","last_unstale":"2023-08-25T04:03:01.336054+0000","last_undegraded":"2023-08-25T04:03:01.336054+0000","last_fullsized":"2023-08-25T04:03:01.336054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:39:42.025217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.364017+0000","last_change":"2023-08-25T04:03:01.354419+0000","last_active":"2023-08-25T04:03:01.364017+0000","last_peered":"2023-08-25T04:03:01.364017+0000","last_clean":"2023-08-25T04:03:01.364017+0000","last_became_active":"2023-08-25T04:03:01.354110+0000","last_became_peered":"2023-08-25T04:03:01.354110+0000","last_unstale":"2023-08-25T04:03:01.364017+0000","last_undegraded":"2023-08-25T04:03:01.364017+0000","last_fullsized":"2023-08-25T04:03:01.364017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:30:59.392811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335674+0000","last_change":"2023-08-25T04:03:00.720247+0000","last_active":"2023-08-25T04:03:02.335674+0000","last_peered":"2023-08-25T04:03:02.335674+0000","last_clean":"2023-08-25T04:03:02.335674+0000","last_became_active":"2023-08-25T04:03:00.719941+0000","last_became_peered":"2023-08-25T04:03:00.719941+0000","last_unstale":"2023-08-25T04:03:02.335674+0000","last_undegraded":"2023-08-25T04:03:02.335674+0000","last_fullsized":"2023-08-25T04:03:02.335674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:31:25.565858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.364071+0000","last_change":"2023-08-25T04:03:01.357912+0000","last_active":"2023-08-25T04:03:01.364071+0000","last_peered":"2023-08-25T04:03:01.364071+0000","last_clean":"2023-08-25T04:03:01.364071+0000","last_became_active":"2023-08-25T04:03:01.357568+0000","last_became_peered":"2023-08-25T04:03:01.357568+0000","last_unstale":"2023-08-25T04:03:01.364071+0000","last_undegraded":"2023-08-25T04:03:01.364071+0000","last_fullsized":"2023-08-25T04:03:01.364071+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:45:02.861975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.339791+0000","last_change":"2023-08-25T04:03:00.719201+0000","last_active":"2023-08-25T04:03:01.339791+0000","last_peered":"2023-08-25T04:03:01.339791+0000","last_clean":"2023-08-25T04:03:01.339791+0000","last_became_active":"2023-08-25T04:03:00.718923+0000","last_became_peered":"2023-08-25T04:03:00.718923+0000","last_unstale":"2023-08-25T04:03:01.339791+0000","last_undegraded":"2023-08-25T04:03:01.339791+0000","last_fullsized":"2023-08-25T04:03:01.339791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:01:02.753445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.363852+0000","last_change":"2023-08-25T04:03:01.351447+0000","last_active":"2023-08-25T04:03:01.363852+0000","last_peered":"2023-08-25T04:03:01.363852+0000","last_clean":"2023-08-25T04:03:01.363852+0000","last_became_active":"2023-08-25T04:03:01.351187+0000","last_became_peered":"2023-08-25T04:03:01.351187+0000","last_unstale":"2023-08-25T04:03:01.363852+0000","last_undegraded":"2023-08-25T04:03:01.363852+0000","last_fullsized":"2023-08-25T04:03:01.363852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:18:42.967152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.336197+0000","last_change":"2023-08-25T04:03:00.718022+0000","last_active":"2023-08-25T04:03:01.336197+0000","last_peered":"2023-08-25T04:03:01.336197+0000","last_clean":"2023-08-25T04:03:01.336197+0000","last_became_active":"2023-08-25T04:03:00.717031+0000","last_became_peered":"2023-08-25T04:03:00.717031+0000","last_unstale":"2023-08-25T04:03:01.336197+0000","last_undegraded":"2023-08-25T04:03:01.336197+0000","last_fullsized":"2023-08-25T04:03:01.336197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:09:17.759089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.361900+0000","last_change":"2023-08-25T04:03:01.347111+0000","last_active":"2023-08-25T04:03:01.361900+0000","last_peered":"2023-08-25T04:03:01.361900+0000","last_clean":"2023-08-25T04:03:01.361900+0000","last_became_active":"2023-08-25T04:03:01.346777+0000","last_became_peered":"2023-08-25T04:03:01.346777+0000","last_unstale":"2023-08-25T04:03:01.361900+0000","last_undegraded":"2023-08-25T04:03:01.361900+0000","last_fullsized":"2023-08-25T04:03:01.361900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:39:43.035137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.347042+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:03:01.347042+0000","last_peered":"2023-08-25T04:03:01.347042+0000","last_clean":"2023-08-25T04:03:01.347042+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:03:01.347042+0000","last_undegraded":"2023-08-25T04:03:01.347042+0000","last_fullsized":"2023-08-25T04:03:01.347042+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:31:13.495694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.341506+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:03:01.341506+0000","last_peered":"2023-08-25T04:03:01.341506+0000","last_clean":"2023-08-25T04:03:01.341506+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:03:01.341506+0000","last_undegraded":"2023-08-25T04:03:01.341506+0000","last_fullsized":"2023-08-25T04:03:01.341506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:50:55.119747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.334267+0000","last_change":"2023-08-25T04:03:00.716745+0000","last_active":"2023-08-25T04:03:01.334267+0000","last_peered":"2023-08-25T04:03:01.334267+0000","last_clean":"2023-08-25T04:03:01.334267+0000","last_became_active":"2023-08-25T04:03:00.716419+0000","last_became_peered":"2023-08-25T04:03:00.716419+0000","last_unstale":"2023-08-25T04:03:01.334267+0000","last_undegraded":"2023-08-25T04:03:01.334267+0000","last_fullsized":"2023-08-25T04:03:01.334267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:55:41.108750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335514+0000","last_change":"2023-08-25T04:03:01.359007+0000","last_active":"2023-08-25T04:03:02.335514+0000","last_peered":"2023-08-25T04:03:02.335514+0000","last_clean":"2023-08-25T04:03:02.335514+0000","last_became_active":"2023-08-25T04:03:01.358654+0000","last_became_peered":"2023-08-25T04:03:01.358654+0000","last_unstale":"2023-08-25T04:03:02.335514+0000","last_undegraded":"2023-08-25T04:03:02.335514+0000","last_fullsized":"2023-08-25T04:03:02.335514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:26.962898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.346923+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:03:01.346923+0000","last_peered":"2023-08-25T04:03:01.346923+0000","last_clean":"2023-08-25T04:03:01.346923+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:03:01.346923+0000","last_undegraded":"2023-08-25T04:03:01.346923+0000","last_fullsized":"2023-08-25T04:03:01.346923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:00:57.716050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.344093+0000","last_change":"2023-08-25T04:03:00.724401+0000","last_active":"2023-08-25T04:03:01.344093+0000","last_peered":"2023-08-25T04:03:01.344093+0000","last_clean":"2023-08-25T04:03:01.344093+0000","last_became_active":"2023-08-25T04:03:00.724057+0000","last_became_peered":"2023-08-25T04:03:00.724057+0000","last_unstale":"2023-08-25T04:03:01.344093+0000","last_undegraded":"2023-08-25T04:03:01.344093+0000","last_fullsized":"2023-08-25T04:03:01.344093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:53:17.362839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.366611+0000","last_change":"2023-08-25T04:03:01.362199+0000","last_active":"2023-08-25T04:03:01.366611+0000","last_peered":"2023-08-25T04:03:01.366611+0000","last_clean":"2023-08-25T04:03:01.366611+0000","last_became_active":"2023-08-25T04:03:01.361885+0000","last_became_peered":"2023-08-25T04:03:01.361885+0000","last_unstale":"2023-08-25T04:03:01.366611+0000","last_undegraded":"2023-08-25T04:03:01.366611+0000","last_fullsized":"2023-08-25T04:03:01.366611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:13:18.285083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.331311+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:03:01.331311+0000","last_peered":"2023-08-25T04:03:01.331311+0000","last_clean":"2023-08-25T04:03:01.331311+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:03:01.331311+0000","last_undegraded":"2023-08-25T04:03:01.331311+0000","last_fullsized":"2023-08-25T04:03:01.331311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:45.534210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.334331+0000","last_change":"2023-08-25T04:03:00.715784+0000","last_active":"2023-08-25T04:03:01.334331+0000","last_peered":"2023-08-25T04:03:01.334331+0000","last_clean":"2023-08-25T04:03:01.334331+0000","last_became_active":"2023-08-25T04:03:00.715481+0000","last_became_peered":"2023-08-25T04:03:00.715481+0000","last_unstale":"2023-08-25T04:03:01.334331+0000","last_undegraded":"2023-08-25T04:03:01.334331+0000","last_fullsized":"2023-08-25T04:03:01.334331+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:23.316378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.362456+0000","last_change":"2023-08-25T04:03:01.351813+0000","last_active":"2023-08-25T04:03:01.362456+0000","last_peered":"2023-08-25T04:03:01.362456+0000","last_clean":"2023-08-25T04:03:01.362456+0000","last_became_active":"2023-08-25T04:03:01.351168+0000","last_became_peered":"2023-08-25T04:03:01.351168+0000","last_unstale":"2023-08-25T04:03:01.362456+0000","last_undegraded":"2023-08-25T04:03:01.362456+0000","last_fullsized":"2023-08-25T04:03:01.362456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:14:58.886873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.343026+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:03:01.343026+0000","last_peered":"2023-08-25T04:03:01.343026+0000","last_clean":"2023-08-25T04:03:01.343026+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:03:01.343026+0000","last_undegraded":"2023-08-25T04:03:01.343026+0000","last_fullsized":"2023-08-25T04:03:01.343026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:30.721670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.339826+0000","last_change":"2023-08-25T04:03:00.726687+0000","last_active":"2023-08-25T04:03:01.339826+0000","last_peered":"2023-08-25T04:03:01.339826+0000","last_clean":"2023-08-25T04:03:01.339826+0000","last_became_active":"2023-08-25T04:03:00.726151+0000","last_became_peered":"2023-08-25T04:03:00.726151+0000","last_unstale":"2023-08-25T04:03:01.339826+0000","last_undegraded":"2023-08-25T04:03:01.339826+0000","last_fullsized":"2023-08-25T04:03:01.339826+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:31:25.565858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.361851+0000","last_change":"2023-08-25T04:03:01.347217+0000","last_active":"2023-08-25T04:03:01.361851+0000","last_peered":"2023-08-25T04:03:01.361851+0000","last_clean":"2023-08-25T04:03:01.361851+0000","last_became_active":"2023-08-25T04:03:01.346945+0000","last_became_peered":"2023-08-25T04:03:01.346945+0000","last_unstale":"2023-08-25T04:03:01.361851+0000","last_undegraded":"2023-08-25T04:03:01.361851+0000","last_fullsized":"2023-08-25T04:03:01.361851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:33:15.291618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.348542+0000","last_change":"2023-08-25T04:03:00.721967+0000","last_active":"2023-08-25T04:03:01.348542+0000","last_peered":"2023-08-25T04:03:01.348542+0000","last_clean":"2023-08-25T04:03:01.348542+0000","last_became_active":"2023-08-25T04:03:00.721550+0000","last_became_peered":"2023-08-25T04:03:00.721550+0000","last_unstale":"2023-08-25T04:03:01.348542+0000","last_undegraded":"2023-08-25T04:03:01.348542+0000","last_fullsized":"2023-08-25T04:03:01.348542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:14.800833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.338486+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:03:01.338486+0000","last_peered":"2023-08-25T04:03:01.338486+0000","last_clean":"2023-08-25T04:03:01.338486+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:03:01.338486+0000","last_undegraded":"2023-08-25T04:03:01.338486+0000","last_fullsized":"2023-08-25T04:03:01.338486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:11:37.838864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.363368+0000","last_change":"2023-08-25T04:03:01.350688+0000","last_active":"2023-08-25T04:03:01.363368+0000","last_peered":"2023-08-25T04:03:01.363368+0000","last_clean":"2023-08-25T04:03:01.363368+0000","last_became_active":"2023-08-25T04:03:01.350333+0000","last_became_peered":"2023-08-25T04:03:01.350333+0000","last_unstale":"2023-08-25T04:03:01.363368+0000","last_undegraded":"2023-08-25T04:03:01.363368+0000","last_fullsized":"2023-08-25T04:03:01.363368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:23:43.578871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.338396+0000","last_change":"2023-08-25T04:03:00.710773+0000","last_active":"2023-08-25T04:03:01.338396+0000","last_peered":"2023-08-25T04:03:01.338396+0000","last_clean":"2023-08-25T04:03:01.338396+0000","last_became_active":"2023-08-25T04:03:00.710376+0000","last_became_peered":"2023-08-25T04:03:00.710376+0000","last_unstale":"2023-08-25T04:03:01.338396+0000","last_undegraded":"2023-08-25T04:03:01.338396+0000","last_fullsized":"2023-08-25T04:03:01.338396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:09:17.759089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.350755+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:03:01.350755+0000","last_peered":"2023-08-25T04:03:01.350755+0000","last_clean":"2023-08-25T04:03:01.350755+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:03:01.350755+0000","last_undegraded":"2023-08-25T04:03:01.350755+0000","last_fullsized":"2023-08-25T04:03:01.350755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:49.842955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.354727+0000","last_change":"2023-08-25T04:03:01.352376+0000","last_active":"2023-08-25T04:03:01.354727+0000","last_peered":"2023-08-25T04:03:01.354727+0000","last_clean":"2023-08-25T04:03:01.354727+0000","last_became_active":"2023-08-25T04:03:01.352104+0000","last_became_peered":"2023-08-25T04:03:01.352104+0000","last_unstale":"2023-08-25T04:03:01.354727+0000","last_undegraded":"2023-08-25T04:03:01.354727+0000","last_fullsized":"2023-08-25T04:03:01.354727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:36.768985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.335589+0000","last_change":"2023-08-25T04:03:00.718260+0000","last_active":"2023-08-25T04:03:01.335589+0000","last_peered":"2023-08-25T04:03:01.335589+0000","last_clean":"2023-08-25T04:03:01.335589+0000","last_became_active":"2023-08-25T04:03:00.717748+0000","last_became_peered":"2023-08-25T04:03:00.717748+0000","last_unstale":"2023-08-25T04:03:01.335589+0000","last_undegraded":"2023-08-25T04:03:01.335589+0000","last_fullsized":"2023-08-25T04:03:01.335589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:19:37.798377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.335096+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:03:01.335096+0000","last_peered":"2023-08-25T04:03:01.335096+0000","last_clean":"2023-08-25T04:03:01.335096+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:03:01.335096+0000","last_undegraded":"2023-08-25T04:03:01.335096+0000","last_fullsized":"2023-08-25T04:03:01.335096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:09:14.818797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.353574+0000","last_change":"2023-08-25T04:03:01.345303+0000","last_active":"2023-08-25T04:03:01.353574+0000","last_peered":"2023-08-25T04:03:01.353574+0000","last_clean":"2023-08-25T04:03:01.353574+0000","last_became_active":"2023-08-25T04:03:01.344815+0000","last_became_peered":"2023-08-25T04:03:01.344815+0000","last_unstale":"2023-08-25T04:03:01.353574+0000","last_undegraded":"2023-08-25T04:03:01.353574+0000","last_fullsized":"2023-08-25T04:03:01.353574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:23:43.578871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.346274+0000","last_change":"2023-08-25T04:03:00.723286+0000","last_active":"2023-08-25T04:03:01.346274+0000","last_peered":"2023-08-25T04:03:01.346274+0000","last_clean":"2023-08-25T04:03:01.346274+0000","last_became_active":"2023-08-25T04:03:00.722952+0000","last_became_peered":"2023-08-25T04:03:00.722952+0000","last_unstale":"2023-08-25T04:03:01.346274+0000","last_undegraded":"2023-08-25T04:03:01.346274+0000","last_fullsized":"2023-08-25T04:03:01.346274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:54.163575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335621+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:03:02.335621+0000","last_peered":"2023-08-25T04:03:02.335621+0000","last_clean":"2023-08-25T04:03:02.335621+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:03:02.335621+0000","last_undegraded":"2023-08-25T04:03:02.335621+0000","last_fullsized":"2023-08-25T04:03:02.335621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:00:57.716050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.364121+0000","last_change":"2023-08-25T04:03:01.358953+0000","last_active":"2023-08-25T04:03:01.364121+0000","last_peered":"2023-08-25T04:03:01.364121+0000","last_clean":"2023-08-25T04:03:01.364121+0000","last_became_active":"2023-08-25T04:03:01.358612+0000","last_became_peered":"2023-08-25T04:03:01.358612+0000","last_unstale":"2023-08-25T04:03:01.364121+0000","last_undegraded":"2023-08-25T04:03:01.364121+0000","last_fullsized":"2023-08-25T04:03:01.364121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:13:18.285083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.364152+0000","last_change":"2023-08-25T04:03:01.358957+0000","last_active":"2023-08-25T04:03:01.364152+0000","last_peered":"2023-08-25T04:03:01.364152+0000","last_clean":"2023-08-25T04:03:01.364152+0000","last_became_active":"2023-08-25T04:03:01.358559+0000","last_became_peered":"2023-08-25T04:03:01.358559+0000","last_unstale":"2023-08-25T04:03:01.364152+0000","last_undegraded":"2023-08-25T04:03:01.364152+0000","last_fullsized":"2023-08-25T04:03:01.364152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:04:24.406419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.339105+0000","last_change":"2023-08-25T04:03:00.719414+0000","last_active":"2023-08-25T04:03:01.339105+0000","last_peered":"2023-08-25T04:03:01.339105+0000","last_clean":"2023-08-25T04:03:01.339105+0000","last_became_active":"2023-08-25T04:03:00.719016+0000","last_became_peered":"2023-08-25T04:03:00.719016+0000","last_unstale":"2023-08-25T04:03:01.339105+0000","last_undegraded":"2023-08-25T04:03:01.339105+0000","last_fullsized":"2023-08-25T04:03:01.339105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:53:17.362839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.363348+0000","last_change":"2023-08-25T04:03:01.348671+0000","last_active":"2023-08-25T04:03:01.363348+0000","last_peered":"2023-08-25T04:03:01.363348+0000","last_clean":"2023-08-25T04:03:01.363348+0000","last_became_active":"2023-08-25T04:03:01.348415+0000","last_became_peered":"2023-08-25T04:03:01.348415+0000","last_unstale":"2023-08-25T04:03:01.363348+0000","last_undegraded":"2023-08-25T04:03:01.363348+0000","last_fullsized":"2023-08-25T04:03:01.363348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:19:38.808296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.713422+0000","last_change":"2023-08-25T04:03:00.721463+0000","last_active":"2023-08-25T04:03:01.713422+0000","last_peered":"2023-08-25T04:03:01.713422+0000","last_clean":"2023-08-25T04:03:01.713422+0000","last_became_active":"2023-08-25T04:03:00.721177+0000","last_became_peered":"2023-08-25T04:03:00.721177+0000","last_unstale":"2023-08-25T04:03:01.713422+0000","last_undegraded":"2023-08-25T04:03:01.713422+0000","last_fullsized":"2023-08-25T04:03:01.713422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:09:39.160220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.345220+0000","last_change":"2023-08-25T04:03:00.719107+0000","last_active":"2023-08-25T04:03:01.345220+0000","last_peered":"2023-08-25T04:03:01.345220+0000","last_clean":"2023-08-25T04:03:01.345220+0000","last_became_active":"2023-08-25T04:03:00.718831+0000","last_became_peered":"2023-08-25T04:03:00.718831+0000","last_unstale":"2023-08-25T04:03:01.345220+0000","last_undegraded":"2023-08-25T04:03:01.345220+0000","last_fullsized":"2023-08-25T04:03:01.345220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:24:08.910691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.355758+0000","last_change":"2023-08-25T04:03:01.349735+0000","last_active":"2023-08-25T04:03:01.355758+0000","last_peered":"2023-08-25T04:03:01.355758+0000","last_clean":"2023-08-25T04:03:01.355758+0000","last_became_active":"2023-08-25T04:03:01.349169+0000","last_became_peered":"2023-08-25T04:03:01.349169+0000","last_unstale":"2023-08-25T04:03:01.355758+0000","last_undegraded":"2023-08-25T04:03:01.355758+0000","last_fullsized":"2023-08-25T04:03:01.355758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:14:58.886873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.346421+0000","last_change":"2023-08-25T04:03:00.722052+0000","last_active":"2023-08-25T04:03:01.346421+0000","last_peered":"2023-08-25T04:03:01.346421+0000","last_clean":"2023-08-25T04:03:01.346421+0000","last_became_active":"2023-08-25T04:03:00.721711+0000","last_became_peered":"2023-08-25T04:03:00.721711+0000","last_unstale":"2023-08-25T04:03:01.346421+0000","last_undegraded":"2023-08-25T04:03:01.346421+0000","last_fullsized":"2023-08-25T04:03:01.346421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:31:25.565858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.353565+0000","last_change":"2023-08-25T04:03:01.345111+0000","last_active":"2023-08-25T04:03:01.353565+0000","last_peered":"2023-08-25T04:03:01.353565+0000","last_clean":"2023-08-25T04:03:01.353565+0000","last_became_active":"2023-08-25T04:03:01.344450+0000","last_became_peered":"2023-08-25T04:03:01.344450+0000","last_unstale":"2023-08-25T04:03:01.353565+0000","last_undegraded":"2023-08-25T04:03:01.353565+0000","last_fullsized":"2023-08-25T04:03:01.353565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:33.754524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335653+0000","last_change":"2023-08-25T04:03:01.354750+0000","last_active":"2023-08-25T04:03:02.335653+0000","last_peered":"2023-08-25T04:03:02.335653+0000","last_clean":"2023-08-25T04:03:02.335653+0000","last_became_active":"2023-08-25T04:03:01.354428+0000","last_became_peered":"2023-08-25T04:03:01.354428+0000","last_unstale":"2023-08-25T04:03:02.335653+0000","last_undegraded":"2023-08-25T04:03:02.335653+0000","last_fullsized":"2023-08-25T04:03:02.335653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:55.173495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.336064+0000","last_change":"2023-08-25T04:03:00.724234+0000","last_active":"2023-08-25T04:03:01.336064+0000","last_peered":"2023-08-25T04:03:01.336064+0000","last_clean":"2023-08-25T04:03:01.336064+0000","last_became_active":"2023-08-25T04:03:00.723532+0000","last_became_peered":"2023-08-25T04:03:00.723532+0000","last_unstale":"2023-08-25T04:03:01.336064+0000","last_undegraded":"2023-08-25T04:03:01.336064+0000","last_fullsized":"2023-08-25T04:03:01.336064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:06:44.167223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.354424+0000","last_change":"2023-08-25T04:03:01.349065+0000","last_active":"2023-08-25T04:03:01.354424+0000","last_peered":"2023-08-25T04:03:01.354424+0000","last_clean":"2023-08-25T04:03:01.354424+0000","last_became_active":"2023-08-25T04:03:01.348789+0000","last_became_peered":"2023-08-25T04:03:01.348789+0000","last_unstale":"2023-08-25T04:03:01.354424+0000","last_undegraded":"2023-08-25T04:03:01.354424+0000","last_fullsized":"2023-08-25T04:03:01.354424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:20:47.107743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.334533+0000","last_change":"2023-08-25T04:03:00.718057+0000","last_active":"2023-08-25T04:03:01.334533+0000","last_peered":"2023-08-25T04:03:01.334533+0000","last_clean":"2023-08-25T04:03:01.334533+0000","last_became_active":"2023-08-25T04:03:00.717736+0000","last_became_peered":"2023-08-25T04:03:00.717736+0000","last_unstale":"2023-08-25T04:03:01.334533+0000","last_undegraded":"2023-08-25T04:03:01.334533+0000","last_fullsized":"2023-08-25T04:03:01.334533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:35:03.831123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.366383+0000","last_change":"2023-08-25T04:03:01.357499+0000","last_active":"2023-08-25T04:03:01.366383+0000","last_peered":"2023-08-25T04:03:01.366383+0000","last_clean":"2023-08-25T04:03:01.366383+0000","last_became_active":"2023-08-25T04:03:01.357124+0000","last_became_peered":"2023-08-25T04:03:01.357124+0000","last_unstale":"2023-08-25T04:03:01.366383+0000","last_undegraded":"2023-08-25T04:03:01.366383+0000","last_fullsized":"2023-08-25T04:03:01.366383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:42:21.914526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.339937+0000","last_change":"2023-08-25T04:03:00.719151+0000","last_active":"2023-08-25T04:03:01.339937+0000","last_peered":"2023-08-25T04:03:01.339937+0000","last_clean":"2023-08-25T04:03:01.339937+0000","last_became_active":"2023-08-25T04:03:00.718851+0000","last_became_peered":"2023-08-25T04:03:00.718851+0000","last_unstale":"2023-08-25T04:03:01.339937+0000","last_undegraded":"2023-08-25T04:03:01.339937+0000","last_fullsized":"2023-08-25T04:03:01.339937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:24:08.910691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.358817+0000","last_change":"2023-08-25T04:03:01.357412+0000","last_active":"2023-08-25T04:03:01.358817+0000","last_peered":"2023-08-25T04:03:01.358817+0000","last_clean":"2023-08-25T04:03:01.358817+0000","last_became_active":"2023-08-25T04:03:01.357136+0000","last_became_peered":"2023-08-25T04:03:01.357136+0000","last_unstale":"2023-08-25T04:03:01.358817+0000","last_undegraded":"2023-08-25T04:03:01.358817+0000","last_fullsized":"2023-08-25T04:03:01.358817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:50:32.887542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.345456+0000","last_change":"2023-08-25T04:03:00.725319+0000","last_active":"2023-08-25T04:03:01.345456+0000","last_peered":"2023-08-25T04:03:01.345456+0000","last_clean":"2023-08-25T04:03:01.345456+0000","last_became_active":"2023-08-25T04:03:00.725047+0000","last_became_peered":"2023-08-25T04:03:00.725047+0000","last_unstale":"2023-08-25T04:03:01.345456+0000","last_undegraded":"2023-08-25T04:03:01.345456+0000","last_fullsized":"2023-08-25T04:03:01.345456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:25.952979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.364171+0000","last_change":"2023-08-25T04:03:01.359175+0000","last_active":"2023-08-25T04:03:01.364171+0000","last_peered":"2023-08-25T04:03:01.364171+0000","last_clean":"2023-08-25T04:03:01.364171+0000","last_became_active":"2023-08-25T04:03:01.358098+0000","last_became_peered":"2023-08-25T04:03:01.358098+0000","last_unstale":"2023-08-25T04:03:01.364171+0000","last_undegraded":"2023-08-25T04:03:01.364171+0000","last_fullsized":"2023-08-25T04:03:01.364171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:26.962898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.344190+0000","last_change":"2023-08-25T04:03:00.724464+0000","last_active":"2023-08-25T04:03:01.344190+0000","last_peered":"2023-08-25T04:03:01.344190+0000","last_clean":"2023-08-25T04:03:01.344190+0000","last_became_active":"2023-08-25T04:03:00.724195+0000","last_became_peered":"2023-08-25T04:03:00.724195+0000","last_unstale":"2023-08-25T04:03:01.344190+0000","last_undegraded":"2023-08-25T04:03:01.344190+0000","last_fullsized":"2023-08-25T04:03:01.344190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:25.952979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.364223+0000","last_change":"2023-08-25T04:03:01.359383+0000","last_active":"2023-08-25T04:03:01.364223+0000","last_peered":"2023-08-25T04:03:01.364223+0000","last_clean":"2023-08-25T04:03:01.364223+0000","last_became_active":"2023-08-25T04:03:01.358081+0000","last_became_peered":"2023-08-25T04:03:01.358081+0000","last_unstale":"2023-08-25T04:03:01.364223+0000","last_undegraded":"2023-08-25T04:03:01.364223+0000","last_fullsized":"2023-08-25T04:03:01.364223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:36.768985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.348407+0000","last_change":"2023-08-25T04:03:00.724403+0000","last_active":"2023-08-25T04:03:01.348407+0000","last_peered":"2023-08-25T04:03:01.348407+0000","last_clean":"2023-08-25T04:03:01.348407+0000","last_became_active":"2023-08-25T04:03:00.724136+0000","last_became_peered":"2023-08-25T04:03:00.724136+0000","last_unstale":"2023-08-25T04:03:01.348407+0000","last_undegraded":"2023-08-25T04:03:01.348407+0000","last_fullsized":"2023-08-25T04:03:01.348407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:00.993169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.353539+0000","last_change":"2023-08-25T04:03:01.348397+0000","last_active":"2023-08-25T04:03:01.353539+0000","last_peered":"2023-08-25T04:03:01.353539+0000","last_clean":"2023-08-25T04:03:01.353539+0000","last_became_active":"2023-08-25T04:03:01.345667+0000","last_became_peered":"2023-08-25T04:03:01.345667+0000","last_unstale":"2023-08-25T04:03:01.353539+0000","last_undegraded":"2023-08-25T04:03:01.353539+0000","last_fullsized":"2023-08-25T04:03:01.353539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:09:20.866112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.334409+0000","last_change":"2023-08-25T04:03:00.718222+0000","last_active":"2023-08-25T04:03:01.334409+0000","last_peered":"2023-08-25T04:03:01.334409+0000","last_clean":"2023-08-25T04:03:01.334409+0000","last_became_active":"2023-08-25T04:03:00.717941+0000","last_became_peered":"2023-08-25T04:03:00.717941+0000","last_unstale":"2023-08-25T04:03:01.334409+0000","last_undegraded":"2023-08-25T04:03:01.334409+0000","last_fullsized":"2023-08-25T04:03:01.334409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:23.316378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.360934+0000","last_change":"2023-08-25T04:03:01.344378+0000","last_active":"2023-08-25T04:03:01.360934+0000","last_peered":"2023-08-25T04:03:01.360934+0000","last_clean":"2023-08-25T04:03:01.360934+0000","last_became_active":"2023-08-25T04:03:01.343370+0000","last_became_peered":"2023-08-25T04:03:01.343370+0000","last_unstale":"2023-08-25T04:03:01.360934+0000","last_undegraded":"2023-08-25T04:03:01.360934+0000","last_fullsized":"2023-08-25T04:03:01.360934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:09.656491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-08-25T04:03:01.346296+0000","last_change":"2023-08-25T04:03:00.723428+0000","last_active":"2023-08-25T04:03:01.346296+0000","last_peered":"2023-08-25T04:03:01.346296+0000","last_clean":"2023-08-25T04:03:01.346296+0000","last_became_active":"2023-08-25T04:03:00.722959+0000","last_became_peered":"2023-08-25T04:03:00.722959+0000","last_unstale":"2023-08-25T04:03:01.346296+0000","last_undegraded":"2023-08-25T04:03:01.346296+0000","last_fullsized":"2023-08-25T04:03:01.346296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:01:02.753445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":856064,"data_stored":677361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":233472,"data_stored":85165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":85165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":78037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":85165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":71417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":85165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":827392,"data_stored":675533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:03:06.232 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-25T04:03:06.233 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-25T04:03:06.233 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-25T04:03:06.233 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-25T04:03:06.234 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-25T04:03:06.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.411+0000 7faf95959640 1 Processor -- start 2023-08-25T04:03:06.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.411+0000 7faf95959640 1 -- start start 2023-08-25T04:03:06.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.411+0000 7faf95959640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faf9015eba0 0x7faf900b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:06.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.411+0000 7faf95959640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf9015ef80 0x7faf900ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:06.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.411+0000 7faf95959640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf900ac100 con 0x7faf900cece0 2023-08-25T04:03:06.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.411+0000 7faf95959640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf900cf170 con 0x7faf9015eba0 2023-08-25T04:03:06.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.411+0000 7faf95959640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf900ac3a0 con 0x7faf9015ef80 2023-08-25T04:03:06.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.411+0000 7faf8effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faf9015eba0 0x7faf900b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:06.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.411+0000 7faf8effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faf9015eba0 0x7faf900b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35428/0 (socket says 172.21.15.55:35428) 2023-08-25T04:03:06.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.411+0000 7faf8effd640 1 -- 172.21.15.55:0/4193964622 learned_addr learned my addr 172.21.15.55:0/4193964622 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:06.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.411+0000 7faf87fff640 1 --2- 172.21.15.55:0/4193964622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf9015ef80 0x7faf900ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:06.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.415+0000 7faf8effd640 1 -- 172.21.15.55:0/4193964622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf9015ef80 msgr2=0x7faf900ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:06.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.415+0000 7faf8effd640 1 --2- 172.21.15.55:0/4193964622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf9015ef80 0x7faf900ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.415+0000 7faf8effd640 1 -- 172.21.15.55:0/4193964622 >> v1:172.21.15.110:6789/0 conn(0x7faf900cece0 legacy=0x7faf900cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:06.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.415+0000 7faf8effd640 1 -- 172.21.15.55:0/4193964622 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf900b1390 con 0x7faf9015eba0 2023-08-25T04:03:06.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.415+0000 7faf8effd640 1 --2- 172.21.15.55:0/4193964622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9015eba0 0x7faf900b2a40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faf80009870 tx=0x7faf8001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d8e9b64e4d6466 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:06.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.415+0000 7faf8e7fc640 1 -- 172.21.15.55:0/4193964622 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf800a7070 con 0x7faf9015eba0 2023-08-25T04:03:06.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.415+0000 7faf8e7fc640 1 -- 172.21.15.55:0/4193964622 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf800ab430 con 0x7faf9015eba0 2023-08-25T04:03:06.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.415+0000 7faf8e7fc640 1 -- 172.21.15.55:0/4193964622 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf800ab7c0 con 0x7faf9015eba0 2023-08-25T04:03:06.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.415+0000 7faf95959640 1 -- 172.21.15.55:0/4193964622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9015eba0 msgr2=0x7faf900b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:06.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.415+0000 7faf95959640 1 --2- 172.21.15.55:0/4193964622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9015eba0 0x7faf900b2a40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faf80009870 tx=0x7faf8001c510 comp rx=0 tx=0).stop 2023-08-25T04:03:06.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.415+0000 7faf95959640 1 -- 172.21.15.55:0/4193964622 shutdown_connections 2023-08-25T04:03:06.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.415+0000 7faf95959640 1 --2- 172.21.15.55:0/4193964622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf9015ef80 0x7faf900ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.415+0000 7faf95959640 1 --2- 172.21.15.55:0/4193964622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9015eba0 0x7faf900b2a40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.415+0000 7faf95959640 1 -- 172.21.15.55:0/4193964622 >> 172.21.15.55:0/4193964622 conn(0x7faf90069d00 msgr2=0x7faf9006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:06.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.415+0000 7faf95959640 1 -- 172.21.15.55:0/4193964622 shutdown_connections 2023-08-25T04:03:06.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.415+0000 7faf95959640 1 -- 172.21.15.55:0/4193964622 wait complete. 2023-08-25T04:03:06.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf95959640 1 Processor -- start 2023-08-25T04:03:06.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf95959640 1 -- start start 2023-08-25T04:03:06.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf95959640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf900cece0 0x7faf901564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:06.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf95959640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9015eba0 0x7faf9006c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:06.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf95959640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf9015ef80 0x7faf9006ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:06.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf95959640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf90156a00 con 0x7faf9015eba0 2023-08-25T04:03:06.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf95959640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf900aed20 con 0x7faf9015ef80 2023-08-25T04:03:06.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf95959640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf900c7d70 con 0x7faf900cece0 2023-08-25T04:03:06.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf87fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9015eba0 0x7faf9006c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:06.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf87fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9015eba0 0x7faf9006c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35444/0 (socket says 172.21.15.55:35444) 2023-08-25T04:03:06.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf87fff640 1 -- 172.21.15.55:0/3083868475 learned_addr learned my addr 172.21.15.55:0/3083868475 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:06.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf8effd640 1 --2- 172.21.15.55:0/3083868475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf900cece0 0x7faf901564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:06.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf8f7fe640 1 --2- 172.21.15.55:0/3083868475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf9015ef80 0x7faf9006ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:06.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf87fff640 1 -- 172.21.15.55:0/3083868475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf900cece0 msgr2=0x7faf901564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:06.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf87fff640 1 --2- 172.21.15.55:0/3083868475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf900cece0 0x7faf901564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf87fff640 1 -- 172.21.15.55:0/3083868475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf9015ef80 msgr2=0x7faf9006ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:06.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf87fff640 1 --2- 172.21.15.55:0/3083868475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf9015ef80 0x7faf9006ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf87fff640 1 -- 172.21.15.55:0/3083868475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf800094d0 con 0x7faf9015eba0 2023-08-25T04:03:06.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf87fff640 1 --2- 172.21.15.55:0/3083868475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9015eba0 0x7faf9006c550 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faf7800d800 tx=0x7faf7800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:06.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf8cff9640 1 -- 172.21.15.55:0/3083868475 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7800b6c0 con 0x7faf9015eba0 2023-08-25T04:03:06.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf8cff9640 1 -- 172.21.15.55:0/3083868475 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7800b820 con 0x7faf9015eba0 2023-08-25T04:03:06.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf8cff9640 1 -- 172.21.15.55:0/3083868475 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7800bb90 con 0x7faf9015eba0 2023-08-25T04:03:06.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.419+0000 7faf95959640 1 -- 172.21.15.55:0/3083868475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf900c8050 con 0x7faf9015eba0 2023-08-25T04:03:06.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.423+0000 7faf95959640 1 -- 172.21.15.55:0/3083868475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf900af000 con 0x7faf9015eba0 2023-08-25T04:03:06.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.423+0000 7faf95959640 1 -- 172.21.15.55:0/3083868475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9004dbe0 con 0x7faf9015eba0 2023-08-25T04:03:06.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.423+0000 7faf8cff9640 1 -- 172.21.15.55:0/3083868475 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7faf7800bcf0 con 0x7faf9015eba0 2023-08-25T04:03:06.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.423+0000 7faf8cff9640 1 --2- 172.21.15.55:0/3083868475 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7faf70065680 0x7faf70067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:06.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.423+0000 7faf8cff9640 1 -- 172.21.15.55:0/3083868475 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faf78083290 con 0x7faf9015eba0 2023-08-25T04:03:06.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.423+0000 7faf8effd640 1 --2- 172.21.15.55:0/3083868475 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7faf70065680 0x7faf70067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:06.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.427+0000 7faf8effd640 1 --2- 172.21.15.55:0/3083868475 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7faf70065680 0x7faf70067b40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faf800af000 tx=0x7faf80008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:06.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.427+0000 7faf8cff9640 1 -- 172.21.15.55:0/3083868475 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7faf780547f0 con 0x7faf9015eba0 2023-08-25T04:03:06.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.623+0000 7faf95959640 1 -- 172.21.15.55:0/3083868475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7faf900c8240 con 0x7faf9015eba0 2023-08-25T04:03:06.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.623+0000 7faf8cff9640 1 -- 172.21.15.55:0/3083868475 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+162896 (secure 0 0 0) 0x7faf78054380 con 0x7faf9015eba0 2023-08-25T04:03:06.630 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:06.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.627+0000 7faf95959640 1 -- 172.21.15.55:0/3083868475 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7faf70065680 msgr2=0x7faf70067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:06.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.627+0000 7faf95959640 1 --2- 172.21.15.55:0/3083868475 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7faf70065680 0x7faf70067b40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faf800af000 tx=0x7faf80008040 comp rx=0 tx=0).stop 2023-08-25T04:03:06.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.627+0000 7faf95959640 1 -- 172.21.15.55:0/3083868475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9015eba0 msgr2=0x7faf9006c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:06.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.627+0000 7faf95959640 1 --2- 172.21.15.55:0/3083868475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9015eba0 0x7faf9006c550 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faf7800d800 tx=0x7faf7800dcc0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.627+0000 7faf95959640 1 -- 172.21.15.55:0/3083868475 shutdown_connections 2023-08-25T04:03:06.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.627+0000 7faf95959640 1 --2- 172.21.15.55:0/3083868475 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7faf70065680 0x7faf70067b40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.627+0000 7faf95959640 1 --2- 172.21.15.55:0/3083868475 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faf9015ef80 0x7faf9006ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.627+0000 7faf95959640 1 --2- 172.21.15.55:0/3083868475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf9015eba0 0x7faf9006c550 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.627+0000 7faf95959640 1 --2- 172.21.15.55:0/3083868475 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faf900cece0 0x7faf901564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.627+0000 7faf95959640 1 -- 172.21.15.55:0/3083868475 >> 172.21.15.55:0/3083868475 conn(0x7faf90069d00 msgr2=0x7faf900cd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:06.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.627+0000 7faf95959640 1 -- 172.21.15.55:0/3083868475 shutdown_connections 2023-08-25T04:03:06.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.627+0000 7faf95959640 1 -- 172.21.15.55:0/3083868475 wait complete. 2023-08-25T04:03:06.649 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":413962747},{"type":"v1","addr":"172.21.15.110:6833","nonce":413962747}]},"active_addr":"172.21.15.110:6833/413962747","active_change":"2023-08-25T04:02:40.588412+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":2105887625}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":3898418887}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":3810476394}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":2576650460}]}]} 2023-08-25T04:03:06.654 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-25T04:03:06.655 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-25T04:03:06.655 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:06.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.795+0000 7f2dfb6d8640 1 Processor -- start 2023-08-25T04:03:06.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.799+0000 7f2dfb6d8640 1 -- start start 2023-08-25T04:03:06.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.799+0000 7f2dfb6d8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2df415c9c0 0x7f2df4160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:06.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.799+0000 7f2dfb6d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2df406b2b0 0x7f2df406b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:06.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.799+0000 7f2dfb6d8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df406eaf0 con 0x7f2df40cfa70 2023-08-25T04:03:06.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.799+0000 7f2dfb6d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df406e530 con 0x7f2df406b2b0 2023-08-25T04:03:06.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.799+0000 7f2dfb6d8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df406e810 con 0x7f2df415c9c0 2023-08-25T04:03:06.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.799+0000 7f2df9c75640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2df406b2b0 0x7f2df406b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:06.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.799+0000 7f2df8c73640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2df40cfa70 0x7f2df4160a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50442/0 (socket says 172.21.15.55:50442) 2023-08-25T04:03:06.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.799+0000 7f2df9c75640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2df406b2b0 0x7f2df406b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35450/0 (socket says 172.21.15.55:35450) 2023-08-25T04:03:06.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.799+0000 7f2df8c73640 1 -- 172.21.15.55:0/352672168 learned_addr learned my addr 172.21.15.55:0/352672168 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:06.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.799+0000 7f2df9474640 1 --2- 172.21.15.55:0/352672168 >> v2:172.21.15.110:3300/0 conn(0x7f2df415c9c0 0x7f2df4160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:06.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.799+0000 7f2df9c75640 1 -- 172.21.15.55:0/352672168 >> v2:172.21.15.110:3300/0 conn(0x7f2df415c9c0 msgr2=0x7f2df4160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:06.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.799+0000 7f2df9c75640 1 --2- 172.21.15.55:0/352672168 >> v2:172.21.15.110:3300/0 conn(0x7f2df415c9c0 0x7f2df4160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.799+0000 7f2df9c75640 1 -- 172.21.15.55:0/352672168 >> v1:172.21.15.55:6789/0 conn(0x7f2df40cfa70 legacy=0x7f2df4160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:06.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.799+0000 7f2debfff640 1 -- 172.21.15.55:0/352672168 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807166257 0 0) 0x7f2df406eaf0 con 0x7f2df40cfa70 2023-08-25T04:03:06.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.799+0000 7f2df9c75640 1 -- 172.21.15.55:0/352672168 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df406aab0 con 0x7f2df406b2b0 2023-08-25T04:03:06.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.799+0000 7f2df9474640 1 --2- 172.21.15.55:0/352672168 >> v2:172.21.15.110:3300/0 conn(0x7f2df415c9c0 0x7f2df4160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.803+0000 7f2df9c75640 1 --2- 172.21.15.55:0/352672168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df406b2b0 0x7f2df406b740 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2df4070600 tx=0x7f2dec01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a03e35c8279712b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.803+0000 7f2debfff640 1 -- 172.21.15.55:0/352672168 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec0a5960 con 0x7f2df406b2b0 2023-08-25T04:03:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.803+0000 7f2debfff640 1 -- 172.21.15.55:0/352672168 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec0a5ac0 con 0x7f2df406b2b0 2023-08-25T04:03:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.803+0000 7f2debfff640 1 -- 172.21.15.55:0/352672168 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec0a5e50 con 0x7f2df406b2b0 2023-08-25T04:03:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.803+0000 7f2dfb6d8640 1 -- 172.21.15.55:0/352672168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df406b2b0 msgr2=0x7f2df406b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:06.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.803+0000 7f2dfb6d8640 1 --2- 172.21.15.55:0/352672168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df406b2b0 0x7f2df406b740 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2df4070600 tx=0x7f2dec01c8e0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.803+0000 7f2dfb6d8640 1 -- 172.21.15.55:0/352672168 shutdown_connections 2023-08-25T04:03:06.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.803+0000 7f2dfb6d8640 1 --2- 172.21.15.55:0/352672168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df406b2b0 0x7f2df406b740 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.803+0000 7f2dfb6d8640 1 --2- 172.21.15.55:0/352672168 >> v2:172.21.15.110:3300/0 conn(0x7f2df415c9c0 0x7f2df4160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.803+0000 7f2dfb6d8640 1 -- 172.21.15.55:0/352672168 >> 172.21.15.55:0/352672168 conn(0x7f2df40d05a0 msgr2=0x7f2df40d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:06.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.803+0000 7f2dfb6d8640 1 -- 172.21.15.55:0/352672168 shutdown_connections 2023-08-25T04:03:06.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.803+0000 7f2dfb6d8640 1 -- 172.21.15.55:0/352672168 wait complete. 2023-08-25T04:03:06.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.803+0000 7f2dfb6d8640 1 Processor -- start 2023-08-25T04:03:06.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.803+0000 7f2dfb6d8640 1 -- start start 2023-08-25T04:03:06.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2dfb6d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2df406b2b0 0x7f2df41596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:06.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2dfb6d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df40cfa70 0x7f2df41f86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:06.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2dfb6d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2df415c9c0 0x7f2df41f8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:06.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2dfb6d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4154ba0 con 0x7f2df40cfa70 2023-08-25T04:03:06.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2dfb6d8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4159dc0 con 0x7f2df406b2b0 2023-08-25T04:03:06.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2dfb6d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df415a0a0 con 0x7f2df415c9c0 2023-08-25T04:03:06.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2df8c73640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df40cfa70 0x7f2df41f86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:06.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2df8c73640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df40cfa70 0x7f2df41f86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35466/0 (socket says 172.21.15.55:35466) 2023-08-25T04:03:06.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2df8c73640 1 -- 172.21.15.55:0/3478172421 learned_addr learned my addr 172.21.15.55:0/3478172421 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:06.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2df9474640 1 --2- 172.21.15.55:0/3478172421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2df406b2b0 0x7f2df41596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:06.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2df9c75640 1 --2- 172.21.15.55:0/3478172421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2df415c9c0 0x7f2df41f8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:06.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2df8c73640 1 -- 172.21.15.55:0/3478172421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2df415c9c0 msgr2=0x7f2df41f8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:06.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2df8c73640 1 --2- 172.21.15.55:0/3478172421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2df415c9c0 0x7f2df41f8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2df8c73640 1 -- 172.21.15.55:0/3478172421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2df406b2b0 msgr2=0x7f2df41596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:06.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2df8c73640 1 --2- 172.21.15.55:0/3478172421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2df406b2b0 0x7f2df41596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2df8c73640 1 -- 172.21.15.55:0/3478172421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec009a70 con 0x7f2df40cfa70 2023-08-25T04:03:06.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2df8c73640 1 --2- 172.21.15.55:0/3478172421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df40cfa70 0x7f2df41f86b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2de40011f0 tx=0x7f2de400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:06.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2de9ffb640 1 -- 172.21.15.55:0/3478172421 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de40074e0 con 0x7f2df40cfa70 2023-08-25T04:03:06.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2de9ffb640 1 -- 172.21.15.55:0/3478172421 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de4007640 con 0x7f2df40cfa70 2023-08-25T04:03:06.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2dfb6d8640 1 -- 172.21.15.55:0/3478172421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df415a380 con 0x7f2df40cfa70 2023-08-25T04:03:06.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2de9ffb640 1 -- 172.21.15.55:0/3478172421 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de4004a10 con 0x7f2df40cfa70 2023-08-25T04:03:06.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2dfb6d8640 1 -- 172.21.15.55:0/3478172421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df415a940 con 0x7f2df40cfa70 2023-08-25T04:03:06.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2dfb6d8640 1 -- 172.21.15.55:0/3478172421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df404dbe0 con 0x7f2df40cfa70 2023-08-25T04:03:06.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.807+0000 7f2de9ffb640 1 -- 172.21.15.55:0/3478172421 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2de4004b70 con 0x7f2df40cfa70 2023-08-25T04:03:06.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.811+0000 7f2de9ffb640 1 --2- 172.21.15.55:0/3478172421 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2dd8065680 0x7f2dd8067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:06.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.811+0000 7f2de9ffb640 1 -- 172.21.15.55:0/3478172421 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2de4082350 con 0x7f2df40cfa70 2023-08-25T04:03:06.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.811+0000 7f2df9474640 1 --2- 172.21.15.55:0/3478172421 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2dd8065680 0x7f2dd8067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:06.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.811+0000 7f2df9474640 1 --2- 172.21.15.55:0/3478172421 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2dd8065680 0x7f2dd8067b40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2df000aac0 tx=0x7f2df0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:06.815 INFO:tasks.ceph.mds.a.smithi055.stderr:2023-08-25T04:03:06.815+0000 7f60f56b9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T04:03:06.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.815+0000 7f2de9ffb640 1 -- 172.21.15.55:0/3478172421 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2de404fe20 con 0x7f2df40cfa70 2023-08-25T04:03:06.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.971+0000 7f2dfb6d8640 1 -- 172.21.15.55:0/3478172421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2df40d0c30 con 0x7f2df40cfa70 2023-08-25T04:03:06.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.971+0000 7f2de9ffb640 1 -- 172.21.15.55:0/3478172421 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18291 (secure 0 0 0) 0x7f2de4053440 con 0x7f2df40cfa70 2023-08-25T04:03:06.974 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:06.974 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:02.329010+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:06.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.975+0000 7f2dfb6d8640 1 -- 172.21.15.55:0/3478172421 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2dd8065680 msgr2=0x7f2dd8067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:06.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.975+0000 7f2dfb6d8640 1 --2- 172.21.15.55:0/3478172421 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2dd8065680 0x7f2dd8067b40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2df000aac0 tx=0x7f2df0008040 comp rx=0 tx=0).stop 2023-08-25T04:03:06.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.975+0000 7f2dfb6d8640 1 -- 172.21.15.55:0/3478172421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df40cfa70 msgr2=0x7f2df41f86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:06.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.975+0000 7f2dfb6d8640 1 --2- 172.21.15.55:0/3478172421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df40cfa70 0x7f2df41f86b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2de40011f0 tx=0x7f2de400c9b0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.975+0000 7f2dfb6d8640 1 -- 172.21.15.55:0/3478172421 shutdown_connections 2023-08-25T04:03:06.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.975+0000 7f2dfb6d8640 1 --2- 172.21.15.55:0/3478172421 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2dd8065680 0x7f2dd8067b40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.975+0000 7f2dfb6d8640 1 --2- 172.21.15.55:0/3478172421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2df415c9c0 0x7f2df41f8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.975+0000 7f2dfb6d8640 1 --2- 172.21.15.55:0/3478172421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2df40cfa70 0x7f2df41f86b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.975+0000 7f2dfb6d8640 1 --2- 172.21.15.55:0/3478172421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2df406b2b0 0x7f2df41596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:06.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.975+0000 7f2dfb6d8640 1 -- 172.21.15.55:0/3478172421 >> 172.21.15.55:0/3478172421 conn(0x7f2df40d05a0 msgr2=0x7f2df415bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:06.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.975+0000 7f2dfb6d8640 1 -- 172.21.15.55:0/3478172421 shutdown_connections 2023-08-25T04:03:06.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:06.975+0000 7f2dfb6d8640 1 -- 172.21.15.55:0/3478172421 wait complete. 2023-08-25T04:03:06.996 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-25T04:03:06.997 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:07.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.135+0000 7fa56c9ba640 1 Processor -- start 2023-08-25T04:03:07.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.135+0000 7fa56c9ba640 1 -- start start 2023-08-25T04:03:07.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.139+0000 7fa56c9ba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa56815c9c0 0x7fa568160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.139+0000 7fa56c9ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa56806b2b0 0x7fa56806b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.139+0000 7fa56c9ba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56806eaf0 con 0x7fa5680cfa70 2023-08-25T04:03:07.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.139+0000 7fa56c9ba640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56806e530 con 0x7fa56815c9c0 2023-08-25T04:03:07.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.139+0000 7fa56c9ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56806e810 con 0x7fa56806b2b0 2023-08-25T04:03:07.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.139+0000 7fa56659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa56815c9c0 0x7fa568160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.139+0000 7fa56659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa56815c9c0 0x7fa568160510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35476/0 (socket says 172.21.15.55:35476) 2023-08-25T04:03:07.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.139+0000 7fa56659c640 1 -- 172.21.15.55:0/4164814966 learned_addr learned my addr 172.21.15.55:0/4164814966 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:07.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.139+0000 7fa566d9d640 1 --2- 172.21.15.55:0/4164814966 >> v2:172.21.15.110:3300/0 conn(0x7fa56806b2b0 0x7fa56806b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.139+0000 7fa56659c640 1 -- 172.21.15.55:0/4164814966 >> v2:172.21.15.110:3300/0 conn(0x7fa56806b2b0 msgr2=0x7fa56806b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:07.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.139+0000 7fa56659c640 1 --2- 172.21.15.55:0/4164814966 >> v2:172.21.15.110:3300/0 conn(0x7fa56806b2b0 0x7fa56806b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.139+0000 7fa56659c640 1 -- 172.21.15.55:0/4164814966 >> v1:172.21.15.110:6789/0 conn(0x7fa5680cfa70 legacy=0x7fa568160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.139+0000 7fa56659c640 1 -- 172.21.15.55:0/4164814966 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56806aab0 con 0x7fa56815c9c0 2023-08-25T04:03:07.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.143+0000 7fa56659c640 1 --2- 172.21.15.55:0/4164814966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56815c9c0 0x7fa568160510 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa568071a60 tx=0x7fa55801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27d8577f3981307 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.143+0000 7fa565d9b640 1 -- 172.21.15.55:0/4164814966 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5580aa5f0 con 0x7fa56815c9c0 2023-08-25T04:03:07.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.143+0000 7fa565d9b640 1 -- 172.21.15.55:0/4164814966 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5580aa750 con 0x7fa56815c9c0 2023-08-25T04:03:07.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.143+0000 7fa565d9b640 1 -- 172.21.15.55:0/4164814966 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5580aaae0 con 0x7fa56815c9c0 2023-08-25T04:03:07.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.143+0000 7fa56c9ba640 1 -- 172.21.15.55:0/4164814966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56815c9c0 msgr2=0x7fa568160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.143+0000 7fa56c9ba640 1 --2- 172.21.15.55:0/4164814966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56815c9c0 0x7fa568160510 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa568071a60 tx=0x7fa55801c4d0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.143+0000 7fa56c9ba640 1 -- 172.21.15.55:0/4164814966 shutdown_connections 2023-08-25T04:03:07.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.143+0000 7fa56c9ba640 1 --2- 172.21.15.55:0/4164814966 >> v2:172.21.15.110:3300/0 conn(0x7fa56806b2b0 0x7fa56806b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.143+0000 7fa56c9ba640 1 --2- 172.21.15.55:0/4164814966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56815c9c0 0x7fa568160510 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.143+0000 7fa56c9ba640 1 -- 172.21.15.55:0/4164814966 >> 172.21.15.55:0/4164814966 conn(0x7fa5680d05a0 msgr2=0x7fa5680d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:07.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.143+0000 7fa56c9ba640 1 -- 172.21.15.55:0/4164814966 shutdown_connections 2023-08-25T04:03:07.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.143+0000 7fa56c9ba640 1 -- 172.21.15.55:0/4164814966 wait complete. 2023-08-25T04:03:07.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.143+0000 7fa56c9ba640 1 Processor -- start 2023-08-25T04:03:07.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.143+0000 7fa56c9ba640 1 -- start start 2023-08-25T04:03:07.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa56c9ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa56806b2b0 0x7fa5680b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa56c9ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5680cfa70 0x7fa5680c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa56c9ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56815c9c0 0x7fa5680c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa56c9ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5680c40b0 con 0x7fa56815c9c0 2023-08-25T04:03:07.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa56c9ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5680c42c0 con 0x7fa5680cfa70 2023-08-25T04:03:07.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa56c9ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5680c45a0 con 0x7fa56806b2b0 2023-08-25T04:03:07.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa566d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56815c9c0 0x7fa5680c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa566d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56815c9c0 0x7fa5680c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35488/0 (socket says 172.21.15.55:35488) 2023-08-25T04:03:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa566d9d640 1 -- 172.21.15.55:0/2953800703 learned_addr learned my addr 172.21.15.55:0/2953800703 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa56659c640 1 --2- 172.21.15.55:0/2953800703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa56806b2b0 0x7fa5680b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa55ffff640 1 --2- 172.21.15.55:0/2953800703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5680cfa70 0x7fa5680c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa566d9d640 1 -- 172.21.15.55:0/2953800703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa56806b2b0 msgr2=0x7fa5680b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa566d9d640 1 --2- 172.21.15.55:0/2953800703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa56806b2b0 0x7fa5680b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa566d9d640 1 -- 172.21.15.55:0/2953800703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5680cfa70 msgr2=0x7fa5680c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa566d9d640 1 --2- 172.21.15.55:0/2953800703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5680cfa70 0x7fa5680c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa566d9d640 1 -- 172.21.15.55:0/2953800703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa558009480 con 0x7fa56815c9c0 2023-08-25T04:03:07.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa566d9d640 1 --2- 172.21.15.55:0/2953800703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56815c9c0 0x7fa5680c6370 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa56000efc0 tx=0x7fa56000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa55effd640 1 -- 172.21.15.55:0/2953800703 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa560014480 con 0x7fa56815c9c0 2023-08-25T04:03:07.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa55effd640 1 -- 172.21.15.55:0/2953800703 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56000f040 con 0x7fa56815c9c0 2023-08-25T04:03:07.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa55effd640 1 -- 172.21.15.55:0/2953800703 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa560014820 con 0x7fa56815c9c0 2023-08-25T04:03:07.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa56c9ba640 1 -- 172.21.15.55:0/2953800703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5680c6990 con 0x7fa56815c9c0 2023-08-25T04:03:07.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa56c9ba640 1 -- 172.21.15.55:0/2953800703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5680b5900 con 0x7fa56815c9c0 2023-08-25T04:03:07.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.147+0000 7fa56c9ba640 1 -- 172.21.15.55:0/2953800703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5680c6eb0 con 0x7fa56815c9c0 2023-08-25T04:03:07.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.151+0000 7fa55effd640 1 -- 172.21.15.55:0/2953800703 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa560014980 con 0x7fa56815c9c0 2023-08-25T04:03:07.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.151+0000 7fa55effd640 1 --2- 172.21.15.55:0/2953800703 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa548065680 0x7fa548067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.151+0000 7fa55effd640 1 -- 172.21.15.55:0/2953800703 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa5600838f0 con 0x7fa56815c9c0 2023-08-25T04:03:07.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.151+0000 7fa56659c640 1 --2- 172.21.15.55:0/2953800703 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa548065680 0x7fa548067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.151+0000 7fa56659c640 1 --2- 172.21.15.55:0/2953800703 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa548065680 0x7fa548067b40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa5580ae000 tx=0x7fa5580a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.155+0000 7fa55effd640 1 -- 172.21.15.55:0/2953800703 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa5680c6eb0 con 0x7fa56815c9c0 2023-08-25T04:03:07.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.311+0000 7fa56c9ba640 1 -- 172.21.15.55:0/2953800703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5680c6eb0 con 0x7fa56815c9c0 2023-08-25T04:03:07.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.311+0000 7fa55effd640 1 -- 172.21.15.55:0/2953800703 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18291 (secure 0 0 0) 0x7fa5680c6eb0 con 0x7fa56815c9c0 2023-08-25T04:03:07.315 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:07.315 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:02.329010+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:07.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.315+0000 7fa56c9ba640 1 -- 172.21.15.55:0/2953800703 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa548065680 msgr2=0x7fa548067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.315+0000 7fa56c9ba640 1 --2- 172.21.15.55:0/2953800703 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa548065680 0x7fa548067b40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa5580ae000 tx=0x7fa5580a7000 comp rx=0 tx=0).stop 2023-08-25T04:03:07.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.315+0000 7fa56c9ba640 1 -- 172.21.15.55:0/2953800703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56815c9c0 msgr2=0x7fa5680c6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.315+0000 7fa56c9ba640 1 --2- 172.21.15.55:0/2953800703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56815c9c0 0x7fa5680c6370 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa56000efc0 tx=0x7fa56000c490 comp rx=0 tx=0).stop 2023-08-25T04:03:07.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.315+0000 7fa56c9ba640 1 -- 172.21.15.55:0/2953800703 shutdown_connections 2023-08-25T04:03:07.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.315+0000 7fa56c9ba640 1 --2- 172.21.15.55:0/2953800703 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa548065680 0x7fa548067b40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.315+0000 7fa56c9ba640 1 --2- 172.21.15.55:0/2953800703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa56815c9c0 0x7fa5680c6370 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.315+0000 7fa56c9ba640 1 --2- 172.21.15.55:0/2953800703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5680cfa70 0x7fa5680c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.315+0000 7fa56c9ba640 1 --2- 172.21.15.55:0/2953800703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa56806b2b0 0x7fa5680b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.315+0000 7fa56c9ba640 1 -- 172.21.15.55:0/2953800703 >> 172.21.15.55:0/2953800703 conn(0x7fa5680d05a0 msgr2=0x7fa5680ad170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:07.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.315+0000 7fa56c9ba640 1 -- 172.21.15.55:0/2953800703 shutdown_connections 2023-08-25T04:03:07.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.315+0000 7fa56c9ba640 1 -- 172.21.15.55:0/2953800703 wait complete. 2023-08-25T04:03:07.336 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-25T04:03:07.337 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-25T04:03:07.338 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-25T04:03:07.338 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-25T04:03:07.339 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-25T04:03:07.339 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-25T04:03:07.339 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-25T04:03:07.340 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-25T04:03:07.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.583+0000 7fabbca9e640 1 Processor -- start 2023-08-25T04:03:07.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.583+0000 7fabbca9e640 1 -- start start 2023-08-25T04:03:07.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.583+0000 7f071d574640 1 Processor -- start 2023-08-25T04:03:07.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.583+0000 7f071d574640 1 -- start start 2023-08-25T04:03:07.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.583+0000 7fabbca9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabb8158000 0x7fabb815b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.583+0000 7fabbca9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fabb80714c0 0x7fabb806b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.583+0000 7fabbca9e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb815b000 con 0x7fabb806bc30 2023-08-25T04:03:07.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.583+0000 7fabbca9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb806d040 con 0x7fabb80714c0 2023-08-25T04:03:07.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.583+0000 7fabbca9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb806ca80 con 0x7fabb8158000 2023-08-25T04:03:07.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.583+0000 7f071d574640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0718158000 0x7f071815b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.583+0000 7f071d574640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f07180714c0 0x7f071806b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.583+0000 7f071d574640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071815b000 con 0x7f071806bc30 2023-08-25T04:03:07.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.583+0000 7f071d574640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071806d040 con 0x7f0718158000 2023-08-25T04:03:07.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.583+0000 7f071d574640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071806ca80 con 0x7f07180714c0 2023-08-25T04:03:07.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.587+0000 7f0716ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0718158000 0x7f071815b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.587+0000 7fabb5d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fabb80714c0 0x7fabb806b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.587+0000 7fabb5d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fabb80714c0 0x7fabb806b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35500/0 (socket says 172.21.15.55:35500) 2023-08-25T04:03:07.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.587+0000 7fabb5d9b640 1 -- 172.21.15.55:0/2028667868 learned_addr learned my addr 172.21.15.55:0/2028667868 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:07.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.587+0000 7fabb659c640 1 --2- 172.21.15.55:0/2028667868 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabb8158000 0x7fabb815b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.587+0000 7f0716ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0718158000 0x7f071815b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35510/0 (socket says 172.21.15.55:35510) 2023-08-25T04:03:07.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.587+0000 7f0716ffd640 1 -- 172.21.15.55:0/3055168847 learned_addr learned my addr 172.21.15.55:0/3055168847 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:07.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.587+0000 7f0715ffb640 1 -- 172.21.15.55:0/3055168847 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837766216 0 0) 0x7f071815b000 con 0x7f071806bc30 2023-08-25T04:03:07.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.587+0000 7f0715ffb640 1 -- 172.21.15.55:0/3055168847 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0700003530 con 0x7f071806bc30 2023-08-25T04:03:07.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.587+0000 7fabb559a640 1 -- 172.21.15.55:0/2028667868 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224499384 0 0) 0x7fabb815b000 con 0x7fabb806bc30 2023-08-25T04:03:07.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.587+0000 7fabb5d9b640 1 -- 172.21.15.55:0/2028667868 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabb8158000 msgr2=0x7fabb815b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:07.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.587+0000 7fabb5d9b640 1 --2- 172.21.15.55:0/2028667868 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabb8158000 0x7fabb815b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.587+0000 7fabb5d9b640 1 -- 172.21.15.55:0/2028667868 >> v1:172.21.15.110:6789/0 conn(0x7fabb806bc30 legacy=0x7fabb815e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.587+0000 7fabb5d9b640 1 -- 172.21.15.55:0/2028667868 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb806cd60 con 0x7fabb80714c0 2023-08-25T04:03:07.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.587+0000 7f0716ffd640 1 -- 172.21.15.55:0/3055168847 >> v2:172.21.15.110:3300/0 conn(0x7f07180714c0 msgr2=0x7f071806b6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-25T04:03:07.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.587+0000 7f0716ffd640 1 --2- 172.21.15.55:0/3055168847 >> v2:172.21.15.110:3300/0 conn(0x7f07180714c0 0x7f071806b6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.587+0000 7f0716ffd640 1 -- 172.21.15.55:0/3055168847 >> v1:172.21.15.110:6789/0 conn(0x7f071806bc30 legacy=0x7f071815e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.587+0000 7f0716ffd640 1 -- 172.21.15.55:0/3055168847 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071806cd60 con 0x7f0718158000 2023-08-25T04:03:07.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.591+0000 7fabb5d9b640 1 --2- 172.21.15.55:0/2028667868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabb80714c0 0x7fabb806b6f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fabb0009e80 tx=0x7fabb0020e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e539490912f274dd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.591+0000 7fabb559a640 1 -- 172.21.15.55:0/2028667868 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb00090d0 con 0x7fabb80714c0 2023-08-25T04:03:07.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.591+0000 7f0716ffd640 1 --2- 172.21.15.55:0/3055168847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0718158000 0x7f071815b490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0718066c60 tx=0x7f070801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518a25ba433eb1a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.591+0000 7fabb559a640 1 -- 172.21.15.55:0/2028667868 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb0009230 con 0x7fabb80714c0 2023-08-25T04:03:07.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.591+0000 7fabb559a640 1 -- 172.21.15.55:0/2028667868 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb00090d0 con 0x7fabb80714c0 2023-08-25T04:03:07.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.591+0000 7fabbca9e640 1 -- 172.21.15.55:0/2028667868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabb80714c0 msgr2=0x7fabb806b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.591+0000 7fabbca9e640 1 --2- 172.21.15.55:0/2028667868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabb80714c0 0x7fabb806b6f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fabb0009e80 tx=0x7fabb0020e10 comp rx=0 tx=0).stop 2023-08-25T04:03:07.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.591+0000 7f0715ffb640 1 -- 172.21.15.55:0/3055168847 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07080aa670 con 0x7f0718158000 2023-08-25T04:03:07.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.591+0000 7f0715ffb640 1 -- 172.21.15.55:0/3055168847 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07080aa7d0 con 0x7f0718158000 2023-08-25T04:03:07.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.591+0000 7f0715ffb640 1 -- 172.21.15.55:0/3055168847 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07080aab60 con 0x7f0718158000 2023-08-25T04:03:07.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7fabbca9e640 1 -- 172.21.15.55:0/2028667868 shutdown_connections 2023-08-25T04:03:07.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7fabbca9e640 1 --2- 172.21.15.55:0/2028667868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabb80714c0 0x7fabb806b6f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7fabbca9e640 1 --2- 172.21.15.55:0/2028667868 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabb8158000 0x7fabb815b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7fabbca9e640 1 -- 172.21.15.55:0/2028667868 >> 172.21.15.55:0/2028667868 conn(0x7fabb80cabd0 msgr2=0x7fabb80cafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:07.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7fabbca9e640 1 -- 172.21.15.55:0/2028667868 shutdown_connections 2023-08-25T04:03:07.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7f071d574640 1 -- 172.21.15.55:0/3055168847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0718158000 msgr2=0x7f071815b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7f071d574640 1 --2- 172.21.15.55:0/3055168847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0718158000 0x7f071815b490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0718066c60 tx=0x7f070801c4f0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7f071d574640 1 -- 172.21.15.55:0/3055168847 shutdown_connections 2023-08-25T04:03:07.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7f071d574640 1 --2- 172.21.15.55:0/3055168847 >> v2:172.21.15.110:3300/0 conn(0x7f07180714c0 0x7f071806b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7f071d574640 1 --2- 172.21.15.55:0/3055168847 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0718158000 0x7f071815b490 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0718066c60 tx=0x7f070801c4f0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7f071d574640 1 -- 172.21.15.55:0/3055168847 >> 172.21.15.55:0/3055168847 conn(0x7f07180cabd0 msgr2=0x7f07180cafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:07.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7f071d574640 1 -- 172.21.15.55:0/3055168847 shutdown_connections 2023-08-25T04:03:07.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7fbdf5982640 1 Processor -- start 2023-08-25T04:03:07.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7fabbca9e640 1 -- 172.21.15.55:0/2028667868 wait complete. 2023-08-25T04:03:07.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7fbdf5982640 1 -- start start 2023-08-25T04:03:07.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7f071d574640 1 -- 172.21.15.55:0/3055168847 wait complete. 2023-08-25T04:03:07.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7fabbca9e640 1 Processor -- start 2023-08-25T04:03:07.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7fabbca9e640 1 -- start start 2023-08-25T04:03:07.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fabbca9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabb806bc30 0x7fabb80c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f071d574640 1 Processor -- start 2023-08-25T04:03:07.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f071d574640 1 -- start start 2023-08-25T04:03:07.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7fbdf5982640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbde80e4580 0x7fbde80340d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7fbdf5982640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbde8033b80 0x7fbde8006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7fbdf5982640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde804eb20 con 0x7fbde8039fe0 2023-08-25T04:03:07.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7fbdf5982640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde804f050 con 0x7fbde80e4580 2023-08-25T04:03:07.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.595+0000 7fbdf5982640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde80e4960 con 0x7fbde8033b80 2023-08-25T04:03:07.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fbdeeffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbde80e4580 0x7fbde80340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fbdee7fc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbde8033b80 0x7fbde8006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fbdeeffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbde80e4580 0x7fbde80340d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35522/0 (socket says 172.21.15.55:35522) 2023-08-25T04:03:07.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fbdeeffd640 1 -- 172.21.15.55:0/2500508272 learned_addr learned my addr 172.21.15.55:0/2500508272 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:07.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fabbca9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabb80714c0 0x7fabb815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fabb659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabb806bc30 0x7fabb80c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fabb659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabb806bc30 0x7fabb80c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35528/0 (socket says 172.21.15.55:35528) 2023-08-25T04:03:07.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fabb659c640 1 -- 172.21.15.55:0/3731497404 learned_addr learned my addr 172.21.15.55:0/3731497404 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:07.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fabbca9e640 1 --2- 172.21.15.55:0/3731497404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabb8158000 0x7fabb815c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f071d574640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f071806bc30 0x7f0718098a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fbdeeffd640 1 -- 172.21.15.55:0/2500508272 >> v2:172.21.15.110:3300/0 conn(0x7fbde8033b80 msgr2=0x7fbde8006020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:07.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fbdeeffd640 1 --2- 172.21.15.55:0/2500508272 >> v2:172.21.15.110:3300/0 conn(0x7fbde8033b80 0x7fbde8006020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fbdeeffd640 1 -- 172.21.15.55:0/2500508272 >> v1:172.21.15.55:6789/0 conn(0x7fbde8039fe0 legacy=0x7fbde803a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:07.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fbdeeffd640 1 -- 172.21.15.55:0/2500508272 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde8054830 con 0x7fbde80e4580 2023-08-25T04:03:07.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f071d574640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07180714c0 0x7f0718157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f071d574640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0718157560 0x7f0718155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f071d574640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07181579f0 con 0x7f071806bc30 2023-08-25T04:03:07.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f071d574640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071815a570 con 0x7f07180714c0 2023-08-25T04:03:07.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f071d574640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07180ad960 con 0x7f0718157560 2023-08-25T04:03:07.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fabbca9e640 1 -- 172.21.15.55:0/3731497404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb8154430 con 0x7fabb806bc30 2023-08-25T04:03:07.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fabb5d9b640 1 --2- 172.21.15.55:0/3731497404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabb80714c0 0x7fabb815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fabb6d9d640 1 --2- 172.21.15.55:0/3731497404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabb8158000 0x7fabb815c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f07167fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07180714c0 0x7f0718157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f07177fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0718157560 0x7f0718155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f0716ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f071806bc30 0x7f0718098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f07177fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0718157560 0x7f0718155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:46818/0 (socket says 172.21.15.55:46818) 2023-08-25T04:03:07.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f07167fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07180714c0 0x7f0718157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:38640/0 (socket says 172.21.15.55:38640) 2023-08-25T04:03:07.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f0716ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f071806bc30 0x7f0718098a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35544/0 (socket says 172.21.15.55:35544) 2023-08-25T04:03:07.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f07177fe640 1 -- 172.21.15.55:0/1815934919 learned_addr learned my addr 172.21.15.55:0/1815934919 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:07.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fabbca9e640 1 -- 172.21.15.55:0/3731497404 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb81e5ce0 con 0x7fabb8158000 2023-08-25T04:03:07.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7fabbca9e640 1 -- 172.21.15.55:0/3731497404 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb81e5fc0 con 0x7fabb80714c0 2023-08-25T04:03:07.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f07177fe640 1 -- 172.21.15.55:0/1815934919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07180714c0 msgr2=0x7f0718157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f07177fe640 1 --2- 172.21.15.55:0/1815934919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07180714c0 0x7f0718157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f07177fe640 1 -- 172.21.15.55:0/1815934919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f071806bc30 msgr2=0x7f0718098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f07177fe640 1 --2- 172.21.15.55:0/1815934919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f071806bc30 0x7f0718098a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f07177fe640 1 -- 172.21.15.55:0/1815934919 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0708009470 con 0x7f0718157560 2023-08-25T04:03:07.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f07167fc640 1 --2- 172.21.15.55:0/1815934919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07180714c0 0x7f0718157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:07.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.599+0000 7f0716ffd640 1 --2- 172.21.15.55:0/1815934919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f071806bc30 0x7f0718098a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:07.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7f07177fe640 1 --2- 172.21.15.55:0/1815934919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0718157560 0x7f0718155e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f071000c7a0 tx=0x7f071000cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fabb5d9b640 1 -- 172.21.15.55:0/3731497404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabb8158000 msgr2=0x7fabb815c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fabb5d9b640 1 --2- 172.21.15.55:0/3731497404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabb8158000 0x7fabb815c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fabb5d9b640 1 -- 172.21.15.55:0/3731497404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabb806bc30 msgr2=0x7fabb80c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fabb5d9b640 1 --2- 172.21.15.55:0/3731497404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabb806bc30 0x7fabb80c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fabb5d9b640 1 -- 172.21.15.55:0/3731497404 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb0009b30 con 0x7fabb80714c0 2023-08-25T04:03:07.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fabb5d9b640 1 --2- 172.21.15.55:0/3731497404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabb80714c0 0x7fabb815bd80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fabb00af000 tx=0x7fabb001dbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7f06ff7fe640 1 -- 172.21.15.55:0/1815934919 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0710003b80 con 0x7f0718157560 2023-08-25T04:03:07.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7f06ff7fe640 1 -- 172.21.15.55:0/1815934919 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0710003ce0 con 0x7f0718157560 2023-08-25T04:03:07.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fed0dacb640 1 Processor -- start 2023-08-25T04:03:07.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fed0dacb640 1 -- start start 2023-08-25T04:03:07.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7faba6ffd640 1 -- 172.21.15.55:0/3731497404 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb0004240 con 0x7fabb80714c0 2023-08-25T04:03:07.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7faba6ffd640 1 -- 172.21.15.55:0/3731497404 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb00043a0 con 0x7fabb80714c0 2023-08-25T04:03:07.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7faba6ffd640 1 -- 172.21.15.55:0/3731497404 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb0004730 con 0x7fabb80714c0 2023-08-25T04:03:07.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fabbca9e640 1 -- 172.21.15.55:0/3731497404 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb81e62a0 con 0x7fabb80714c0 2023-08-25T04:03:07.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fabbca9e640 1 -- 172.21.15.55:0/3731497404 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb81e6860 con 0x7fabb80714c0 2023-08-25T04:03:07.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7f071d574640 1 -- 172.21.15.55:0/1815934919 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0718098f40 con 0x7f0718157560 2023-08-25T04:03:07.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7f071d574640 1 -- 172.21.15.55:0/1815934919 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0718099170 con 0x7f0718157560 2023-08-25T04:03:07.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7f5483648640 1 Processor -- start 2023-08-25T04:03:07.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7f5483648640 1 -- start start 2023-08-25T04:03:07.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fabbca9e640 1 -- 172.21.15.55:0/3731497404 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fabb815b9d0 con 0x7fabb80714c0 2023-08-25T04:03:07.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7f071d574640 1 -- 172.21.15.55:0/1815934919 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f071815b9d0 con 0x7f0718157560 2023-08-25T04:03:07.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7f06ff7fe640 1 -- 172.21.15.55:0/1815934919 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071000aa90 con 0x7f0718157560 2023-08-25T04:03:07.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7f33daa8a640 1 Processor -- start 2023-08-25T04:03:07.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fed0dacb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed00033da0 0x7fed0004ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fed0dacb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fed0003a6f0 0x7fed00006260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fed0dacb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed00037e50 con 0x7fed000e13c0 2023-08-25T04:03:07.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fed0dacb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed00038a90 con 0x7fed0003a6f0 2023-08-25T04:03:07.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fed0dacb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed000380f0 con 0x7fed00033da0 2023-08-25T04:03:07.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fed06ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed00033da0 0x7fed0004ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fed06ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed00033da0 0x7fed0004ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:46820/0 (socket says 172.21.15.55:46820) 2023-08-25T04:03:07.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7fed06ffd640 1 -- 172.21.15.55:0/2542283018 learned_addr learned my addr 172.21.15.55:0/2542283018 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:07.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7f5483648640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54740df2f0 0x7f5474007220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7f5483648640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5474053ce0 0x7f54740e2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7f5483648640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5474054140 0x7f54740e31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7f5483648640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5474005ee0 con 0x7f54740df2f0 2023-08-25T04:03:07.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7f5483648640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54740e3a70 con 0x7f5474053ce0 2023-08-25T04:03:07.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7f5483648640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5474006180 con 0x7f5474054140 2023-08-25T04:03:07.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.603+0000 7f33daa8a640 1 -- start start 2023-08-25T04:03:07.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7fed07fff640 1 --2- 172.21.15.55:0/2542283018 >> v2:172.21.15.55:3300/0 conn(0x7fed0003a6f0 0x7fed00006260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7faba6ffd640 1 -- 172.21.15.55:0/3731497404 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fabb00c3440 con 0x7fabb80714c0 2023-08-25T04:03:07.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f54813e4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54740df2f0 0x7f5474007220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f54813e4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54740df2f0 0x7f5474007220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35556/0 (socket says 172.21.15.55:35556) 2023-08-25T04:03:07.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f54813e4640 1 -- 172.21.15.55:0/1017641836 learned_addr learned my addr 172.21.15.55:0/1017641836 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:07.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f5480be3640 1 --2- 172.21.15.55:0/1017641836 >> v2:172.21.15.110:3300/0 conn(0x7f5474053ce0 0x7f54740e2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7fed07fff640 1 -- 172.21.15.55:0/2542283018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed00033da0 msgr2=0x7fed0004ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:07.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7fed07fff640 1 --2- 172.21.15.55:0/2542283018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed00033da0 0x7fed0004ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7fed07fff640 1 -- 172.21.15.55:0/2542283018 >> v1:172.21.15.55:6789/0 conn(0x7fed000e13c0 legacy=0x7fed00039fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f633f59e640 1 Processor -- start 2023-08-25T04:03:07.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f5481be5640 1 --2- 172.21.15.55:0/1017641836 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5474054140 0x7f54740e31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f33daa8a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d40cad80 0x7f33d4158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f33daa8a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f33d4159130 0x7f33d40cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f33daa8a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d406b9b0 con 0x7f33d40ca9a0 2023-08-25T04:03:07.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f33daa8a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d41595a0 con 0x7f33d4159130 2023-08-25T04:03:07.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f33daa8a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d4159860 con 0x7f33d40cad80 2023-08-25T04:03:07.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7fbdeeffd640 1 --2- 172.21.15.55:0/2500508272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbde80e4580 0x7fbde80340d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbde8034080 tx=0x7fbde001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2238d345788a48fe server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f5480be3640 1 -- 172.21.15.55:0/1017641836 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5474054140 msgr2=0x7f54740e31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f5480be3640 1 --2- 172.21.15.55:0/1017641836 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5474054140 0x7f54740e31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f5480be3640 1 -- 172.21.15.55:0/1017641836 >> v2:172.21.15.55:3300/0 conn(0x7f54740df2f0 msgr2=0x7f5474007220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f5480be3640 1 --2- 172.21.15.55:0/1017641836 >> v2:172.21.15.55:3300/0 conn(0x7f54740df2f0 0x7f5474007220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f5480be3640 1 -- 172.21.15.55:0/1017641836 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5474006460 con 0x7f5474053ce0 2023-08-25T04:03:07.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7fed067fc640 1 -- 172.21.15.55:0/2542283018 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479464768 0 0) 0x7fed00037e50 con 0x7fed000e13c0 2023-08-25T04:03:07.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f33d9a88640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f33d40ca9a0 0x7f33d406c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:49658/0 (socket says 172.21.15.55:49658) 2023-08-25T04:03:07.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f33d9a88640 1 -- 172.21.15.55:0/1000662226 learned_addr learned my addr 172.21.15.55:0/1000662226 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:07.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f33da289640 1 --2- 172.21.15.55:0/1000662226 >> v2:172.21.15.110:3300/0 conn(0x7f33d4159130 0x7f33d40cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f33d9287640 1 --2- 172.21.15.55:0/1000662226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d40cad80 0x7f33d4158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7faba6ffd640 1 --2- 172.21.15.55:0/3731497404 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fab98065750 0x7fab98067c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7faba6ffd640 1 -- 172.21.15.55:0/3731497404 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fabb011d8a0 con 0x7fabb80714c0 2023-08-25T04:03:07.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7faba6ffd640 1 --2- 172.21.15.55:0/3731497404 >> [v2:172.21.15.55:6824/1615684400,v1:172.21.15.55:6825/1615684400] conn(0x7fab9806e010 0x7fab98070430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7faba6ffd640 1 -- 172.21.15.55:0/3731497404 --> [v2:172.21.15.55:6824/1615684400,v1:172.21.15.55:6825/1615684400] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab98070ae0 con 0x7fab9806e010 2023-08-25T04:03:07.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7faba6ffd640 1 -- 172.21.15.55:0/3731497404 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabb011dc50 con 0x7fabb80714c0 2023-08-25T04:03:07.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f33d8a86640 1 -- 172.21.15.55:0/1000662226 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580574214 0 0) 0x7f33d406b9b0 con 0x7f33d40ca9a0 2023-08-25T04:03:07.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f33d8a86640 1 -- 172.21.15.55:0/1000662226 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33c0003530 con 0x7f33d40ca9a0 2023-08-25T04:03:07.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f633f59e640 1 -- start start 2023-08-25T04:03:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f33d9287640 1 -- 172.21.15.55:0/1000662226 >> v2:172.21.15.110:3300/0 conn(0x7f33d4159130 msgr2=0x7f33d40cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f33d9287640 1 --2- 172.21.15.55:0/1000662226 >> v2:172.21.15.110:3300/0 conn(0x7f33d4159130 0x7f33d40cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f33d9287640 1 -- 172.21.15.55:0/1000662226 >> v1:172.21.15.110:6789/0 conn(0x7f33d40ca9a0 legacy=0x7f33d406c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f33d9287640 1 -- 172.21.15.55:0/1000662226 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d4159b40 con 0x7f33d40cad80 2023-08-25T04:03:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f33da289640 1 --2- 172.21.15.55:0/1000662226 >> v2:172.21.15.110:3300/0 conn(0x7f33d4159130 0x7f33d40cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7f06ff7fe640 1 -- 172.21.15.55:0/1815934919 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f071000abf0 con 0x7f0718157560 2023-08-25T04:03:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7fabb6d9d640 1 --2- 172.21.15.55:0/3731497404 >> [v2:172.21.15.55:6824/1615684400,v1:172.21.15.55:6825/1615684400] conn(0x7fab9806e010 0x7fab98070430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.607+0000 7fed07fff640 1 -- 172.21.15.55:0/2542283018 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed000383d0 con 0x7fed0003a6f0 2023-08-25T04:03:07.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7fabb659c640 1 --2- 172.21.15.55:0/3731497404 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fab98065750 0x7fab98067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7fbdedffb640 1 -- 172.21.15.55:0/2500508272 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde00aa620 con 0x7fbde80e4580 2023-08-25T04:03:07.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7fbdedffb640 1 -- 172.21.15.55:0/2500508272 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde00aa780 con 0x7fbde80e4580 2023-08-25T04:03:07.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7fbdedffb640 1 -- 172.21.15.55:0/2500508272 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde00aab10 con 0x7fbde80e4580 2023-08-25T04:03:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7fabb659c640 1 --2- 172.21.15.55:0/3731497404 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fab98065750 0x7fab98067c10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fabac009b60 tx=0x7fabac006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7fabb6d9d640 1 --2- 172.21.15.55:0/3731497404 >> [v2:172.21.15.55:6824/1615684400,v1:172.21.15.55:6825/1615684400] conn(0x7fab9806e010 0x7fab98070430 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633f59e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f63401589a0 0x7f634006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7fbdf5982640 1 -- 172.21.15.55:0/2500508272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbde80e4580 msgr2=0x7fbde80340d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7fbdf5982640 1 --2- 172.21.15.55:0/2500508272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbde80e4580 0x7fbde80340d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbde8034080 tx=0x7fbde001c4c0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633dd9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6340070860 0x7f634006cbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50456/0 (socket says 172.21.15.55:50456) 2023-08-25T04:03:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633dd9b640 1 -- 172.21.15.55:0/4076438459 learned_addr learned my addr 172.21.15.55:0/4076438459 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f06ff7fe640 1 --2- 172.21.15.55:0/1815934919 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0704065750 0x7f0704067c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f06ff7fe640 1 -- 172.21.15.55:0/1815934919 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f07100834c0 con 0x7f0718157560 2023-08-25T04:03:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f06ff7fe640 1 --2- 172.21.15.55:0/1815934919 >> [v2:172.21.15.55:6800/1562339076,v1:172.21.15.55:6801/1562339076] conn(0x7f070406dea0 0x7f07040702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f06ff7fe640 1 -- 172.21.15.55:0/1815934919 --> [v2:172.21.15.55:6800/1562339076,v1:172.21.15.55:6801/1562339076] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0704070970 con 0x7f070406dea0 2023-08-25T04:03:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633f59e640 1 -- 172.21.15.55:0/4076438459 --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634006e240 con 0x7f6340070860 2023-08-25T04:03:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f06ff7fe640 1 -- 172.21.15.55:0/1815934919 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0710083870 con 0x7f0718157560 2023-08-25T04:03:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f0716ffd640 1 --2- 172.21.15.55:0/1815934919 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0704065750 0x7f0704067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f07167fc640 1 --2- 172.21.15.55:0/1815934919 >> [v2:172.21.15.55:6800/1562339076,v1:172.21.15.55:6801/1562339076] conn(0x7f070406dea0 0x7f07040702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7fbdf5982640 1 -- 172.21.15.55:0/2500508272 shutdown_connections 2023-08-25T04:03:07.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7fbdf5982640 1 --2- 172.21.15.55:0/2500508272 >> v2:172.21.15.110:3300/0 conn(0x7fbde8033b80 0x7fbde8006020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7fbdf5982640 1 --2- 172.21.15.55:0/2500508272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbde80e4580 0x7fbde80340d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7fbdf5982640 1 -- 172.21.15.55:0/2500508272 >> 172.21.15.55:0/2500508272 conn(0x7fbde8054c50 msgr2=0x7fbde8055060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:07.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633f59e640 1 -- 172.21.15.55:0/4076438459 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63400703d0 con 0x7f634006d300 2023-08-25T04:03:07.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633f59e640 1 -- 172.21.15.55:0/4076438459 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6340071a80 con 0x7f63401589a0 2023-08-25T04:03:07.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7fbdf5982640 1 -- 172.21.15.55:0/2500508272 shutdown_connections 2023-08-25T04:03:07.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633d59a640 1 -- 172.21.15.55:0/4076438459 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416643253 0 0) 0x7f6334001120 con 0x7f6340070860 2023-08-25T04:03:07.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633d59a640 1 -- 172.21.15.55:0/4076438459 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6328003530 con 0x7f6340070860 2023-08-25T04:03:07.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633d59a640 1 -- 172.21.15.55:0/4076438459 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2490875633 0 0) 0x7f6328003530 con 0x7f6340070860 2023-08-25T04:03:07.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633d59a640 1 -- 172.21.15.55:0/4076438459 >> v2:172.21.15.110:3300/0 conn(0x7f63401589a0 msgr2=0x7f634006dd00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:03:07.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633d59a640 1 --2- 172.21.15.55:0/4076438459 >> v2:172.21.15.110:3300/0 conn(0x7f63401589a0 0x7f634006dd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633d59a640 1 -- 172.21.15.55:0/4076438459 >> v1:172.21.15.110:6789/0 conn(0x7f634006d300 legacy=0x7f63400cc0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:03:07.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633d59a640 1 -- 172.21.15.55:0/4076438459 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63400717a0 con 0x7f6340070860 2023-08-25T04:03:07.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633d59a640 1 -- 172.21.15.55:0/4076438459 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f6334001810 con 0x7f6340070860 2023-08-25T04:03:07.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633d59a640 1 -- 172.21.15.55:0/4076438459 >> v1:172.21.15.55:6789/0 conn(0x7f6340070860 legacy=0x7f634006cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633d59a640 1 --2- 172.21.15.55:0/4076438459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6328003770 0x7f6328003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633d59a640 1 --2- 172.21.15.55:0/4076438459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6328004100 0x7f632800b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633d59a640 1 --2- 172.21.15.55:0/4076438459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f632800b610 0x7f632800dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633d59a640 1 -- 172.21.15.55:0/4076438459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6340071a80 con 0x7f632800b610 2023-08-25T04:03:07.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633d59a640 1 -- 172.21.15.55:0/4076438459 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632800e400 con 0x7f6328003770 2023-08-25T04:03:07.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633d59a640 1 -- 172.21.15.55:0/4076438459 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632800e5c0 con 0x7f6328004100 2023-08-25T04:03:07.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f07167fc640 1 --2- 172.21.15.55:0/1815934919 >> [v2:172.21.15.55:6800/1562339076,v1:172.21.15.55:6801/1562339076] conn(0x7f070406dea0 0x7f07040702c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7fbdf5982640 1 -- 172.21.15.55:0/2500508272 wait complete. 2023-08-25T04:03:07.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633ed9d640 1 --2- 172.21.15.55:0/4076438459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f632800b610 0x7f632800dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f633e59c640 1 --2- 172.21.15.55:0/4076438459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6328003770 0x7f6328003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.611+0000 7f33d9287640 1 --2- 172.21.15.55:0/1000662226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d40cad80 0x7f33d4158bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f33d000ba60 tx=0x7f33d001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6348adbf63eca44b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f633dd9b640 1 --2- 172.21.15.55:0/4076438459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6328004100 0x7f632800b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7fed07fff640 1 --2- 172.21.15.55:0/2542283018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed0003a6f0 0x7fed00006260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fed08000b70 tx=0x7fed08096070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6f3c93f0299853 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f33d8a86640 1 -- 172.21.15.55:0/1000662226 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d00a5950 con 0x7f33d40cad80 2023-08-25T04:03:07.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f33d8a86640 1 -- 172.21.15.55:0/1000662226 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d00a5ab0 con 0x7f33d40cad80 2023-08-25T04:03:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f33d8a86640 1 -- 172.21.15.55:0/1000662226 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d00a5e40 con 0x7f33d40cad80 2023-08-25T04:03:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f5480be3640 1 --2- 172.21.15.55:0/1017641836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5474053ce0 0x7f54740e2cb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f547400dbd0 tx=0x7f546c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49d629e5ef5a20e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f06ff7fe640 1 -- 172.21.15.55:0/1815934919 <== osd.1 v2:172.21.15.55:6800/1562339076 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f0704070970 con 0x7f070406dea0 2023-08-25T04:03:07.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f0716ffd640 1 --2- 172.21.15.55:0/1815934919 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0704065750 0x7f0704067c10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f07080ae000 tx=0x7f07080b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7fbdf5982640 1 Processor -- start 2023-08-25T04:03:07.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7fed067fc640 1 -- 172.21.15.55:0/2542283018 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0811ee00 con 0x7fed0003a6f0 2023-08-25T04:03:07.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7fed067fc640 1 -- 172.21.15.55:0/2542283018 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed08126440 con 0x7fed0003a6f0 2023-08-25T04:03:07.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7fed067fc640 1 -- 172.21.15.55:0/2542283018 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08126890 con 0x7fed0003a6f0 2023-08-25T04:03:07.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7fed0dacb640 1 -- 172.21.15.55:0/2542283018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed0003a6f0 msgr2=0x7fed00006260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7fed0dacb640 1 --2- 172.21.15.55:0/2542283018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed0003a6f0 0x7fed00006260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fed08000b70 tx=0x7fed08096070 comp rx=0 tx=0).stop 2023-08-25T04:03:07.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7fed0dacb640 1 -- 172.21.15.55:0/2542283018 shutdown_connections 2023-08-25T04:03:07.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f5473fff640 1 -- 172.21.15.55:0/1017641836 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c0ab5f0 con 0x7f5474053ce0 2023-08-25T04:03:07.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f5473fff640 1 -- 172.21.15.55:0/1017641836 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c0ab750 con 0x7f5474053ce0 2023-08-25T04:03:07.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f5473fff640 1 -- 172.21.15.55:0/1017641836 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c0abae0 con 0x7f5474053ce0 2023-08-25T04:03:07.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f33daa8a640 1 -- 172.21.15.55:0/1000662226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d40cad80 msgr2=0x7f33d4158bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f33daa8a640 1 --2- 172.21.15.55:0/1000662226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d40cad80 0x7f33d4158bf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f33d000ba60 tx=0x7f33d001c890 comp rx=0 tx=0).stop 2023-08-25T04:03:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f33daa8a640 1 -- 172.21.15.55:0/1000662226 shutdown_connections 2023-08-25T04:03:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f33daa8a640 1 --2- 172.21.15.55:0/1000662226 >> v2:172.21.15.110:3300/0 conn(0x7f33d4159130 0x7f33d40cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f33daa8a640 1 --2- 172.21.15.55:0/1000662226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d40cad80 0x7f33d4158bf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f33daa8a640 1 -- 172.21.15.55:0/1000662226 >> 172.21.15.55:0/1000662226 conn(0x7f33d406d3a0 msgr2=0x7f33d406d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f633e59c640 1 -- 172.21.15.55:0/4076438459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6328004100 msgr2=0x7f632800b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f633e59c640 1 --2- 172.21.15.55:0/4076438459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6328004100 0x7f632800b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f633e59c640 1 -- 172.21.15.55:0/4076438459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f632800b610 msgr2=0x7f632800dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f633e59c640 1 --2- 172.21.15.55:0/4076438459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f632800b610 0x7f632800dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f633e59c640 1 -- 172.21.15.55:0/4076438459 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63400717a0 con 0x7f6328003770 2023-08-25T04:03:07.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7faba6ffd640 1 -- 172.21.15.55:0/3731497404 <== osd.0 v2:172.21.15.55:6824/1615684400 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fab98070ae0 con 0x7fab9806e010 2023-08-25T04:03:07.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7fed0dacb640 1 --2- 172.21.15.55:0/2542283018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed00033da0 0x7fed0004ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7fed0dacb640 1 --2- 172.21.15.55:0/2542283018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed0003a6f0 0x7fed00006260 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7fed0dacb640 1 -- 172.21.15.55:0/2542283018 >> 172.21.15.55:0/2542283018 conn(0x7fed00054c50 msgr2=0x7fed00055060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:07.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f5483648640 1 -- 172.21.15.55:0/1017641836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5474053ce0 msgr2=0x7f54740e2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f5483648640 1 --2- 172.21.15.55:0/1017641836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5474053ce0 0x7f54740e2cb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f547400dbd0 tx=0x7f546c01c450 comp rx=0 tx=0).stop 2023-08-25T04:03:07.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f5483648640 1 -- 172.21.15.55:0/1017641836 shutdown_connections 2023-08-25T04:03:07.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f5483648640 1 --2- 172.21.15.55:0/1017641836 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5474054140 0x7f54740e31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f5483648640 1 --2- 172.21.15.55:0/1017641836 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5474053ce0 0x7f54740e2cb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f5483648640 1 --2- 172.21.15.55:0/1017641836 >> v2:172.21.15.55:3300/0 conn(0x7f54740df2f0 0x7f5474007220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f5483648640 1 -- 172.21.15.55:0/1017641836 >> 172.21.15.55:0/1017641836 conn(0x7f5474054b10 msgr2=0x7f5474054f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:07.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7fed0dacb640 1 -- 172.21.15.55:0/2542283018 shutdown_connections 2023-08-25T04:03:07.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f5483648640 1 -- 172.21.15.55:0/1017641836 shutdown_connections 2023-08-25T04:03:07.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7fbdf5982640 1 -- start start 2023-08-25T04:03:07.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7fbdf5982640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbde8033b80 0x7fbde80e4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f33daa8a640 1 -- 172.21.15.55:0/1000662226 shutdown_connections 2023-08-25T04:03:07.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f5483648640 1 -- 172.21.15.55:0/1017641836 wait complete. 2023-08-25T04:03:07.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fbdf5982640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbde8039fe0 0x7fbde804d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fb07f59e640 1 Processor -- start 2023-08-25T04:03:07.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fbdf5982640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbde80e4580 0x7fbde8034270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fbdf5982640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde80edaa0 con 0x7fbde8033b80 2023-08-25T04:03:07.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fbdf5982640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde80d38f0 con 0x7fbde8039fe0 2023-08-25T04:03:07.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fbdf5982640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde8034f60 con 0x7fbde80e4580 2023-08-25T04:03:07.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7fed0dacb640 1 -- 172.21.15.55:0/2542283018 wait complete. 2023-08-25T04:03:07.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fed0dacb640 1 Processor -- start 2023-08-25T04:03:07.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f633ed9d640 1 -- 172.21.15.55:0/4076438459 reap_dead start 2023-08-25T04:03:07.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7f5483648640 1 Processor -- start 2023-08-25T04:03:07.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fbdeeffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbde8033b80 0x7fbde80e4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fbdee7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbde8039fe0 0x7fbde804d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fbdeeffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbde8033b80 0x7fbde80e4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35574/0 (socket says 172.21.15.55:35574) 2023-08-25T04:03:07.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fbdeeffd640 1 -- 172.21.15.55:0/2682399967 learned_addr learned my addr 172.21.15.55:0/2682399967 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:07.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fbdef7fe640 1 --2- 172.21.15.55:0/2682399967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbde80e4580 0x7fbde8034270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.615+0000 7f33daa8a640 1 -- 172.21.15.55:0/1000662226 wait complete. 2023-08-25T04:03:07.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7f33daa8a640 1 Processor -- start 2023-08-25T04:03:07.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7f633e59c640 1 --2- 172.21.15.55:0/4076438459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6328003770 0x7f6328003b70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f63300097e0 tx=0x7f633001c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1852469d2223c75 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fb07f59e640 1 -- start start 2023-08-25T04:03:07.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7f5483648640 1 -- start start 2023-08-25T04:03:07.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fbdeeffd640 1 -- 172.21.15.55:0/2682399967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbde80e4580 msgr2=0x7fbde8034270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fbdeeffd640 1 --2- 172.21.15.55:0/2682399967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbde80e4580 0x7fbde8034270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fbdeeffd640 1 -- 172.21.15.55:0/2682399967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbde8039fe0 msgr2=0x7fbde804d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fbdeeffd640 1 --2- 172.21.15.55:0/2682399967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbde8039fe0 0x7fbde804d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fbdeeffd640 1 -- 172.21.15.55:0/2682399967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde00094d0 con 0x7fbde8033b80 2023-08-25T04:03:07.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fbdef7fe640 1 --2- 172.21.15.55:0/2682399967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbde80e4580 0x7fbde8034270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:07.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fb07f59e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb08015e560 0x7fb0800c8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fb07f59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb080161df0 0x7fb0800ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fed0dacb640 1 -- start start 2023-08-25T04:03:07.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fed0dacb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed00033da0 0x7fed0018b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fed0dacb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed0003a6f0 0x7fed000de6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fed0dacb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed000e13c0 0x7fed000e3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fed0dacb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0018bc80 con 0x7fed00033da0 2023-08-25T04:03:07.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fed0dacb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0018bf60 con 0x7fed000e13c0 2023-08-25T04:03:07.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fed0dacb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0018c240 con 0x7fed0003a6f0 2023-08-25T04:03:07.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fb07f59e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb080164e20 con 0x7fb0800c8d90 2023-08-25T04:03:07.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7f5483648640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5474053ce0 0x7f54740d6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fb07f59e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0800c9510 con 0x7fb080161df0 2023-08-25T04:03:07.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7fb07f59e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0800c9230 con 0x7fb08015e560 2023-08-25T04:03:07.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7f633d59a640 1 -- 172.21.15.55:0/4076438459 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63300ab600 con 0x7f6328003770 2023-08-25T04:03:07.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7f633d59a640 1 -- 172.21.15.55:0/4076438459 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63300a7050 con 0x7f6328003770 2023-08-25T04:03:07.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7f633d59a640 1 -- 172.21.15.55:0/4076438459 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63300aba00 con 0x7f6328003770 2023-08-25T04:03:07.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.619+0000 7f33daa8a640 1 -- start start 2023-08-25T04:03:07.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f33daa8a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33d40ca9a0 0x7f33d40ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f33daa8a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33d40cad80 0x7f33d414d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5483648640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5474054140 0x7f54740e1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5483648640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54740df2f0 0x7f54740d2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fed06ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed0003a6f0 0x7fed000de6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fed06ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed0003a6f0 0x7fed000de6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:46870/0 (socket says 172.21.15.55:46870) 2023-08-25T04:03:07.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fed06ffd640 1 -- 172.21.15.55:0/796283153 learned_addr learned my addr 172.21.15.55:0/796283153 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:07.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fed07fff640 1 --2- 172.21.15.55:0/796283153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed000e13c0 0x7fed000e3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f33daa8a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d4159130 0x7f33d4152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5483648640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54740d7260 con 0x7f5474053ce0 2023-08-25T04:03:07.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5483648640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54740d69c0 con 0x7f5474054140 2023-08-25T04:03:07.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f33d9287640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33d40cad80 0x7f33d414d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f33d9287640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33d40cad80 0x7f33d414d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:38678/0 (socket says 172.21.15.55:38678) 2023-08-25T04:03:07.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5480be3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5474054140 0x7f54740e1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5483648640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54740d6ca0 con 0x7f54740df2f0 2023-08-25T04:03:07.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5480be3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5474054140 0x7f54740e1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:38690/0 (socket says 172.21.15.55:38690) 2023-08-25T04:03:07.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5480be3640 1 -- 172.21.15.55:0/3991559049 learned_addr learned my addr 172.21.15.55:0/3991559049 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:07.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5481be5640 1 --2- 172.21.15.55:0/3991559049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54740df2f0 0x7f54740d2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f33d9287640 1 -- 172.21.15.55:0/2520970808 learned_addr learned my addr 172.21.15.55:0/2520970808 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:07.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f33daa8a640 1 -- 172.21.15.55:0/2520970808 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d40c15a0 con 0x7f33d40ca9a0 2023-08-25T04:03:07.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f33da289640 1 --2- 172.21.15.55:0/2520970808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d4159130 0x7f33d4152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f33daa8a640 1 -- 172.21.15.55:0/2520970808 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d40c3130 con 0x7f33d40cad80 2023-08-25T04:03:07.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f633f59e640 1 -- 172.21.15.55:0/4076438459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6328003770 msgr2=0x7f6328003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f633f59e640 1 --2- 172.21.15.55:0/4076438459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6328003770 0x7f6328003b70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f63300097e0 tx=0x7f633001c300 comp rx=0 tx=0).stop 2023-08-25T04:03:07.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f633f59e640 1 -- 172.21.15.55:0/4076438459 shutdown_connections 2023-08-25T04:03:07.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f633f59e640 1 --2- 172.21.15.55:0/4076438459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6328003770 0x7f6328003b70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f633f59e640 1 -- 172.21.15.55:0/4076438459 >> 172.21.15.55:0/4076438459 conn(0x7f63400cac40 msgr2=0x7f63400cb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:07.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f633f59e640 1 -- 172.21.15.55:0/4076438459 shutdown_connections 2023-08-25T04:03:07.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f633f59e640 1 -- 172.21.15.55:0/4076438459 wait complete. 2023-08-25T04:03:07.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fb07dd9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb080161df0 0x7fb0800ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fb07ed9d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb0800c8d90 0x7fb0800c0e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:49664/0 (socket says 172.21.15.55:49664) 2023-08-25T04:03:07.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fb07ed9d640 1 -- 172.21.15.55:0/2339232850 learned_addr learned my addr 172.21.15.55:0/2339232850 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:07.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fbdeeffd640 1 --2- 172.21.15.55:0/2682399967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbde8033b80 0x7fbde80e4b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbde00ac040 tx=0x7fbde001ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f33daa8a640 1 -- 172.21.15.55:0/2520970808 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d41571c0 con 0x7f33d4159130 2023-08-25T04:03:07.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fed077fe640 1 --2- 172.21.15.55:0/796283153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed00033da0 0x7fed0018b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fed07fff640 1 -- 172.21.15.55:0/796283153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed0003a6f0 msgr2=0x7fed000de6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fed07fff640 1 --2- 172.21.15.55:0/796283153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed0003a6f0 0x7fed000de6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f33d9a88640 1 --2- 172.21.15.55:0/2520970808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33d40ca9a0 0x7f33d40ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fed07fff640 1 -- 172.21.15.55:0/796283153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed00033da0 msgr2=0x7fed0018b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fed07fff640 1 --2- 172.21.15.55:0/796283153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed00033da0 0x7fed0018b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fed07fff640 1 -- 172.21.15.55:0/796283153 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0804e150 con 0x7fed000e13c0 2023-08-25T04:03:07.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f54813e4640 1 --2- 172.21.15.55:0/3991559049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5474053ce0 0x7f54740d6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5481be5640 1 -- 172.21.15.55:0/3991559049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5474054140 msgr2=0x7f54740e1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5481be5640 1 --2- 172.21.15.55:0/3991559049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5474054140 0x7f54740e1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5481be5640 1 -- 172.21.15.55:0/3991559049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5474053ce0 msgr2=0x7f54740d6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5481be5640 1 --2- 172.21.15.55:0/3991559049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5474053ce0 0x7f54740d6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5481be5640 1 -- 172.21.15.55:0/3991559049 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546c009420 con 0x7f54740df2f0 2023-08-25T04:03:07.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fb07e59c640 1 --2- 172.21.15.55:0/2339232850 >> v2:172.21.15.110:3300/0 conn(0x7fb08015e560 0x7fb0800c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5481be5640 1 --2- 172.21.15.55:0/3991559049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54740df2f0 0x7f54740d2060 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f547800e7f0 tx=0x7f547800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fed07fff640 1 --2- 172.21.15.55:0/796283153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed000e13c0 0x7fed000e3c40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fed08068750 tx=0x7fed08092eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fbdd7fff640 1 -- 172.21.15.55:0/2682399967 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde00aadc0 con 0x7fbde8033b80 2023-08-25T04:03:07.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5471ffb640 1 -- 172.21.15.55:0/3991559049 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547800eea0 con 0x7f54740df2f0 2023-08-25T04:03:07.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fb07e59c640 1 -- 172.21.15.55:0/2339232850 >> v2:172.21.15.55:3300/0 conn(0x7fb080161df0 msgr2=0x7fb0800ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:07.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fb07e59c640 1 --2- 172.21.15.55:0/2339232850 >> v2:172.21.15.55:3300/0 conn(0x7fb080161df0 0x7fb0800ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fb07e59c640 1 -- 172.21.15.55:0/2339232850 >> v1:172.21.15.110:6789/0 conn(0x7fb0800c8d90 legacy=0x7fb0800c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:07.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7fb07e59c640 1 -- 172.21.15.55:0/2339232850 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0801647d0 con 0x7fb08015e560 2023-08-25T04:03:07.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5471ffb640 1 -- 172.21.15.55:0/3991559049 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547800c940 con 0x7f54740df2f0 2023-08-25T04:03:07.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5471ffb640 1 -- 172.21.15.55:0/3991559049 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547800ccf0 con 0x7f54740df2f0 2023-08-25T04:03:07.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f5483648640 1 -- 172.21.15.55:0/3991559049 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54740d6f80 con 0x7f54740df2f0 2023-08-25T04:03:07.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f33da289640 1 -- 172.21.15.55:0/2520970808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33d40cad80 msgr2=0x7f33d414d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f33da289640 1 --2- 172.21.15.55:0/2520970808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33d40cad80 0x7f33d414d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f33da289640 1 -- 172.21.15.55:0/2520970808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33d40ca9a0 msgr2=0x7f33d40ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f33da289640 1 --2- 172.21.15.55:0/2520970808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33d40ca9a0 0x7f33d40ad6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f33da289640 1 -- 172.21.15.55:0/2520970808 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c800a430 con 0x7f33d4159130 2023-08-25T04:03:07.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.623+0000 7f33da289640 1 --2- 172.21.15.55:0/2520970808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d4159130 0x7f33d4152800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f33c800f860 tx=0x7f33c800fd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f5483648640 1 -- 172.21.15.55:0/3991559049 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54740d66b0 con 0x7f54740df2f0 2023-08-25T04:03:07.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f33c67fc640 1 -- 172.21.15.55:0/2520970808 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c800a5e0 con 0x7f33d4159130 2023-08-25T04:03:07.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f33c67fc640 1 -- 172.21.15.55:0/2520970808 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c8004030 con 0x7f33d4159130 2023-08-25T04:03:07.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f33c67fc640 1 -- 172.21.15.55:0/2520970808 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c80043c0 con 0x7f33d4159130 2023-08-25T04:03:07.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7fecf3fff640 1 -- 172.21.15.55:0/796283153 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08135070 con 0x7fed000e13c0 2023-08-25T04:03:07.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7fbdd7fff640 1 -- 172.21.15.55:0/2682399967 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde00bd3f0 con 0x7fbde8033b80 2023-08-25T04:03:07.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7fbdf5982640 1 -- 172.21.15.55:0/2682399967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde80ed100 con 0x7fbde8033b80 2023-08-25T04:03:07.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7fbdd7fff640 1 -- 172.21.15.55:0/2682399967 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde00bd7a0 con 0x7fbde8033b80 2023-08-25T04:03:07.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7fbdf5982640 1 -- 172.21.15.55:0/2682399967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde80ed6c0 con 0x7fbde8033b80 2023-08-25T04:03:07.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7fecf3fff640 1 -- 172.21.15.55:0/796283153 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed08131440 con 0x7fed000e13c0 2023-08-25T04:03:07.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f633f59e640 1 Processor -- start 2023-08-25T04:03:07.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7fecf3fff640 1 -- 172.21.15.55:0/796283153 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed081317b0 con 0x7fed000e13c0 2023-08-25T04:03:07.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7fed0dacb640 1 -- 172.21.15.55:0/796283153 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed00188210 con 0x7fed000e13c0 2023-08-25T04:03:07.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f633f59e640 1 -- start start 2023-08-25T04:03:07.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7fed0dacb640 1 -- 172.21.15.55:0/796283153 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed000dec00 con 0x7fed000e13c0 2023-08-25T04:03:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7fbdf5982640 1 -- 172.21.15.55:0/2682399967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbde804ff00 con 0x7fbde8033b80 2023-08-25T04:03:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f633f59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6328003770 0x7f63401f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f545f7fe640 1 -- 172.21.15.55:0/3991559049 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5458000fd0 con 0x7f54740df2f0 2023-08-25T04:03:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f5471ffb640 1 -- 172.21.15.55:0/3991559049 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5478013470 con 0x7f54740df2f0 2023-08-25T04:03:07.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f633e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6328003770 0x7f63401f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f633e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6328003770 0x7f63401f4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35628/0 (socket says 172.21.15.55:35628) 2023-08-25T04:03:07.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f633e59c640 1 -- 172.21.15.55:0/2048922270 learned_addr learned my addr 172.21.15.55:0/2048922270 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:07.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f633f59e640 1 --2- 172.21.15.55:0/2048922270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63400c5290 0x7f63400c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f633f59e640 1 --2- 172.21.15.55:0/2048922270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63400c5710 0x7f63400c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f633f59e640 1 -- 172.21.15.55:0/2048922270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6340159ea0 con 0x7f6328003770 2023-08-25T04:03:07.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f633f59e640 1 -- 172.21.15.55:0/2048922270 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63400c7d10 con 0x7f63400c5710 2023-08-25T04:03:07.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f633f59e640 1 -- 172.21.15.55:0/2048922270 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63400c7ff0 con 0x7f63400c5290 2023-08-25T04:03:07.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f33daa8a640 1 -- 172.21.15.55:0/2520970808 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d000b6c0 con 0x7f33d4159130 2023-08-25T04:03:07.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f33daa8a640 1 -- 172.21.15.55:0/2520970808 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d40c36b0 con 0x7f33d4159130 2023-08-25T04:03:07.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.627+0000 7f5471ffb640 1 --2- 172.21.15.55:0/3991559049 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f54600656d0 0x7f5460067b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f5471ffb640 1 -- 172.21.15.55:0/3991559049 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5478082dc0 con 0x7f54740df2f0 2023-08-25T04:03:07.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f633ed9d640 1 --2- 172.21.15.55:0/2048922270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63400c5710 0x7f63400c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f633e59c640 1 -- 172.21.15.55:0/2048922270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63400c5290 msgr2=0x7f63400c5c20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-25T04:03:07.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f633e59c640 1 --2- 172.21.15.55:0/2048922270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63400c5290 0x7f63400c5c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f633e59c640 1 -- 172.21.15.55:0/2048922270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63400c5710 msgr2=0x7f63400c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f633e59c640 1 --2- 172.21.15.55:0/2048922270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63400c5710 0x7f63400c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f633e59c640 1 -- 172.21.15.55:0/2048922270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63400c82d0 con 0x7f6328003770 2023-08-25T04:03:07.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f5471ffb640 1 --2- 172.21.15.55:0/3991559049 >> [v2:172.21.15.110:6816/1700969513,v1:172.21.15.110:6817/1700969513] conn(0x7f546006df90 0x7f54600703b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f5471ffb640 1 -- 172.21.15.55:0/3991559049 --> [v2:172.21.15.110:6816/1700969513,v1:172.21.15.110:6817/1700969513] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5460070a60 con 0x7f546006df90 2023-08-25T04:03:07.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f5471ffb640 1 -- 172.21.15.55:0/3991559049 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54780853a0 con 0x7f54740df2f0 2023-08-25T04:03:07.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f54813e4640 1 --2- 172.21.15.55:0/3991559049 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f54600656d0 0x7f5460067b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f633e59c640 1 --2- 172.21.15.55:0/2048922270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6328003770 0x7f63401f4560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f633001c130 tx=0x7f63280047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f33daa8a640 1 -- 172.21.15.55:0/2520970808 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f33d40c2fb0 con 0x7f33d4159130 2023-08-25T04:03:07.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7fb07e59c640 1 --2- 172.21.15.55:0/2339232850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb08015e560 0x7fb0800c8850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb0800b4390 tx=0x7fb07001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71f05ee7f00de42e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f632effd640 1 -- 172.21.15.55:0/2048922270 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63300b4600 con 0x7f6328003770 2023-08-25T04:03:07.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f632effd640 1 -- 172.21.15.55:0/2048922270 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63300a4e90 con 0x7f6328003770 2023-08-25T04:03:07.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f632effd640 1 -- 172.21.15.55:0/2048922270 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63300b49a0 con 0x7f6328003770 2023-08-25T04:03:07.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f633f59e640 1 -- 172.21.15.55:0/2048922270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63400c85b0 con 0x7f6328003770 2023-08-25T04:03:07.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f633f59e640 1 -- 172.21.15.55:0/2048922270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63401f4c70 con 0x7f6328003770 2023-08-25T04:03:07.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7fb07d59a640 1 -- 172.21.15.55:0/2339232850 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0700ab600 con 0x7fb08015e560 2023-08-25T04:03:07.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7fb07d59a640 1 -- 172.21.15.55:0/2339232850 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0700a7050 con 0x7fb08015e560 2023-08-25T04:03:07.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7fb07d59a640 1 -- 172.21.15.55:0/2339232850 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0700ab980 con 0x7fb08015e560 2023-08-25T04:03:07.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7fb07f59e640 1 -- 172.21.15.55:0/2339232850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb08015e560 msgr2=0x7fb0800c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7fb07f59e640 1 --2- 172.21.15.55:0/2339232850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb08015e560 0x7fb0800c8850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb0800b4390 tx=0x7fb07001c3f0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f633f59e640 1 -- 172.21.15.55:0/2048922270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6340070060 con 0x7f6328003770 2023-08-25T04:03:07.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7fb07f59e640 1 -- 172.21.15.55:0/2339232850 shutdown_connections 2023-08-25T04:03:07.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7fb07f59e640 1 --2- 172.21.15.55:0/2339232850 >> v2:172.21.15.55:3300/0 conn(0x7fb080161df0 0x7fb0800ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7fb07f59e640 1 --2- 172.21.15.55:0/2339232850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb08015e560 0x7fb0800c8850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7fb07f59e640 1 -- 172.21.15.55:0/2339232850 >> 172.21.15.55:0/2339232850 conn(0x7fb080069f00 msgr2=0x7fb0800afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:07.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7fbdd7fff640 1 -- 172.21.15.55:0/2682399967 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fbde00c6440 con 0x7fbde8033b80 2023-08-25T04:03:07.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f33c67fc640 1 -- 172.21.15.55:0/2520970808 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f33c800d860 con 0x7f33d4159130 2023-08-25T04:03:07.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7fb07f59e640 1 -- 172.21.15.55:0/2339232850 shutdown_connections 2023-08-25T04:03:07.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f5480be3640 1 --2- 172.21.15.55:0/3991559049 >> [v2:172.21.15.110:6816/1700969513,v1:172.21.15.110:6817/1700969513] conn(0x7f546006df90 0x7f54600703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7f5480be3640 1 --2- 172.21.15.55:0/3991559049 >> [v2:172.21.15.110:6816/1700969513,v1:172.21.15.110:6817/1700969513] conn(0x7f546006df90 0x7f54600703b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7fecf3fff640 1 -- 172.21.15.55:0/796283153 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fed0813a410 con 0x7fed000e13c0 2023-08-25T04:03:07.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7fecf3fff640 1 --2- 172.21.15.55:0/796283153 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fecec065750 0x7fecec067c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7fecf3fff640 1 -- 172.21.15.55:0/796283153 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed08196e20 con 0x7fed000e13c0 2023-08-25T04:03:07.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7fed077fe640 1 --2- 172.21.15.55:0/796283153 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fecec065750 0x7fecec067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7fbdd7fff640 1 --2- 172.21.15.55:0/2682399967 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbddc0656d0 0x7fbddc067b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7f5471ffb640 1 -- 172.21.15.55:0/3991559049 <== osd.4 v2:172.21.15.110:6816/1700969513 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f5460070a60 con 0x7f546006df90 2023-08-25T04:03:07.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7f54813e4640 1 --2- 172.21.15.55:0/3991559049 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f54600656d0 0x7f5460067b90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f547c0722d0 tx=0x7f547c08b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7fbdd7fff640 1 -- 172.21.15.55:0/2682399967 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbde011d7b0 con 0x7fbde8033b80 2023-08-25T04:03:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7fbdd7fff640 1 --2- 172.21.15.55:0/2682399967 >> [v2:172.21.15.55:6808/3999551967,v1:172.21.15.55:6809/3999551967] conn(0x7fbddc06df90 0x7fbddc0703b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7fbdd7fff640 1 -- 172.21.15.55:0/2682399967 --> [v2:172.21.15.55:6808/3999551967,v1:172.21.15.55:6809/3999551967] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbddc070a60 con 0x7fbddc06df90 2023-08-25T04:03:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7fbdd7fff640 1 -- 172.21.15.55:0/2682399967 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbde011dc50 con 0x7fbde8033b80 2023-08-25T04:03:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7fbdee7fc640 1 --2- 172.21.15.55:0/2682399967 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbddc0656d0 0x7fbddc067b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7fbdef7fe640 1 --2- 172.21.15.55:0/2682399967 >> [v2:172.21.15.55:6808/3999551967,v1:172.21.15.55:6809/3999551967] conn(0x7fbddc06df90 0x7fbddc0703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7fbdee7fc640 1 --2- 172.21.15.55:0/2682399967 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbddc0656d0 0x7fbddc067b90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbde80d9600 tx=0x7fbde4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7fbdef7fe640 1 --2- 172.21.15.55:0/2682399967 >> [v2:172.21.15.55:6808/3999551967,v1:172.21.15.55:6809/3999551967] conn(0x7fbddc06df90 0x7fbddc0703b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7f33c67fc640 1 --2- 172.21.15.55:0/2520970808 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f33b8065780 0x7f33b8067c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7f33c67fc640 1 -- 172.21.15.55:0/2520970808 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f33c8083ce0 con 0x7f33d4159130 2023-08-25T04:03:07.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7f33d9a88640 1 --2- 172.21.15.55:0/2520970808 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f33b8065780 0x7f33b8067c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7f33c67fc640 1 --2- 172.21.15.55:0/2520970808 >> [v2:172.21.15.110:6824/3619347626,v1:172.21.15.110:6825/3619347626] conn(0x7f33b806e040 0x7f33b8070460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7f33c67fc640 1 -- 172.21.15.55:0/2520970808 --> [v2:172.21.15.110:6824/3619347626,v1:172.21.15.110:6825/3619347626] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33b8070b10 con 0x7f33b806e040 2023-08-25T04:03:07.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7f33c67fc640 1 -- 172.21.15.55:0/2520970808 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33c8084010 con 0x7f33d4159130 2023-08-25T04:03:07.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7f33d9a88640 1 --2- 172.21.15.55:0/2520970808 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f33b8065780 0x7f33b8067c40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f33cc004f10 tx=0x7f33cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7f33d9287640 1 --2- 172.21.15.55:0/2520970808 >> [v2:172.21.15.110:6824/3619347626,v1:172.21.15.110:6825/3619347626] conn(0x7f33b806e040 0x7f33b8070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.631+0000 7fb07f59e640 1 -- 172.21.15.55:0/2339232850 wait complete. 2023-08-25T04:03:07.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7fb07f59e640 1 Processor -- start 2023-08-25T04:03:07.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7f632effd640 1 -- 172.21.15.55:0/2048922270 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f63300b2040 con 0x7f6328003770 2023-08-25T04:03:07.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7fbdd7fff640 1 -- 172.21.15.55:0/2682399967 <== osd.2 v2:172.21.15.55:6808/3999551967 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fbddc070a60 con 0x7fbddc06df90 2023-08-25T04:03:07.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7fed077fe640 1 --2- 172.21.15.55:0/796283153 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fecec065750 0x7fecec067c10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fecfc000f70 tx=0x7fecfc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7fecf1ffb640 1 --2- 172.21.15.55:0/796283153 >> [v2:172.21.15.55:6816/2251401738,v1:172.21.15.55:6817/2251401738] conn(0x7fed00006fb0 0x7fed000346b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7f33d9287640 1 --2- 172.21.15.55:0/2520970808 >> [v2:172.21.15.110:6824/3619347626,v1:172.21.15.110:6825/3619347626] conn(0x7f33b806e040 0x7f33b8070460 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7f33c67fc640 1 -- 172.21.15.55:0/2520970808 <== osd.5 v2:172.21.15.110:6824/3619347626 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f33b8070b10 con 0x7f33b806e040 2023-08-25T04:03:07.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.635+0000 7fb07f59e640 1 -- start start 2023-08-25T04:03:07.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7fb07f59e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0800c8d90 0x7fb0800c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7f632effd640 1 --2- 172.21.15.55:0/2048922270 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6328069a80 0x7f632806bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7f632effd640 1 -- 172.21.15.55:0/2048922270 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f633011c020 con 0x7f6328003770 2023-08-25T04:03:07.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7f632effd640 1 --2- 172.21.15.55:0/2048922270 >> [v2:172.21.15.110:6800/3646933996,v1:172.21.15.110:6801/3646933996] conn(0x7f63280722f0 0x7f6328074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7f632effd640 1 -- 172.21.15.55:0/2048922270 --> [v2:172.21.15.110:6800/3646933996,v1:172.21.15.110:6801/3646933996] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6328074dc0 con 0x7f63280722f0 2023-08-25T04:03:07.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7f632effd640 1 -- 172.21.15.55:0/2048922270 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f633011c4c0 con 0x7f6328003770 2023-08-25T04:03:07.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7fed06ffd640 1 --2- 172.21.15.55:0/796283153 >> [v2:172.21.15.55:6816/2251401738,v1:172.21.15.55:6817/2251401738] conn(0x7fed00006fb0 0x7fed000346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7fb07f59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb08015e560 0x7fb0800c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7fb07e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0800c8d90 0x7fb0800c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7fb07e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0800c8d90 0x7fb0800c7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:38718/0 (socket says 172.21.15.55:38718) 2023-08-25T04:03:07.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7f633dd9b640 1 --2- 172.21.15.55:0/2048922270 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6328069a80 0x7f632806bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7fed06ffd640 1 --2- 172.21.15.55:0/796283153 >> [v2:172.21.15.55:6816/2251401738,v1:172.21.15.55:6817/2251401738] conn(0x7fed00006fb0 0x7fed000346b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7fb07e59c640 1 -- 172.21.15.55:0/1674659072 learned_addr learned my addr 172.21.15.55:0/1674659072 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:07.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7fecf1ffb640 1 -- 172.21.15.55:0/796283153 --> [v2:172.21.15.55:6816/2251401738,v1:172.21.15.55:6817/2251401738] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fed00008b60 con 0x7fed00006fb0 2023-08-25T04:03:07.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7f633dd9b640 1 --2- 172.21.15.55:0/2048922270 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6328069a80 0x7f632806bf40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6334001ec0 tx=0x7f6334001df0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7fb07dd9b640 1 --2- 172.21.15.55:0/1674659072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb08015e560 0x7fb0800c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7fb07f59e640 1 --2- 172.21.15.55:0/1674659072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb08015cc50 0x7fb0800c3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7fb07f59e640 1 -- 172.21.15.55:0/1674659072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800c81a0 con 0x7fb08015cc50 2023-08-25T04:03:07.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7fb07f59e640 1 -- 172.21.15.55:0/1674659072 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800c6c90 con 0x7fb0800c8d90 2023-08-25T04:03:07.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.639+0000 7fb07f59e640 1 -- 172.21.15.55:0/1674659072 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800c56b0 con 0x7fb08015e560 2023-08-25T04:03:07.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7fecf3fff640 1 -- 172.21.15.55:0/796283153 <== osd.3 v2:172.21.15.55:6816/2251401738 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fed00008b60 con 0x7fed00006fb0 2023-08-25T04:03:07.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7f633ed9d640 1 --2- 172.21.15.55:0/2048922270 >> [v2:172.21.15.110:6800/3646933996,v1:172.21.15.110:6801/3646933996] conn(0x7f63280722f0 0x7f6328074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7f633ed9d640 1 --2- 172.21.15.55:0/2048922270 >> [v2:172.21.15.110:6800/3646933996,v1:172.21.15.110:6801/3646933996] conn(0x7f63280722f0 0x7f6328074710 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7fb07ed9d640 1 --2- 172.21.15.55:0/1674659072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb08015cc50 0x7fb0800c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7fb07dd9b640 1 -- 172.21.15.55:0/1674659072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0800c8d90 msgr2=0x7fb0800c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7fb07dd9b640 1 --2- 172.21.15.55:0/1674659072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0800c8d90 0x7fb0800c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7fb07dd9b640 1 -- 172.21.15.55:0/1674659072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb08015cc50 msgr2=0x7fb0800c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7fb07dd9b640 1 --2- 172.21.15.55:0/1674659072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb08015cc50 0x7fb0800c3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7fb07dd9b640 1 -- 172.21.15.55:0/1674659072 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb070009420 con 0x7fb08015e560 2023-08-25T04:03:07.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7fb07ed9d640 1 --2- 172.21.15.55:0/1674659072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb08015cc50 0x7fb0800c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:07.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7fb07dd9b640 1 --2- 172.21.15.55:0/1674659072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb08015e560 0x7fb0800c6750 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb08006f6c0 tx=0x7fb07400da30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7fb06effd640 1 -- 172.21.15.55:0/1674659072 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074004240 con 0x7fb08015e560 2023-08-25T04:03:07.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7fb06effd640 1 -- 172.21.15.55:0/1674659072 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0740043a0 con 0x7fb08015e560 2023-08-25T04:03:07.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7fabbca9e640 1 -- 172.21.15.55:0/3731497404 --> [v2:172.21.15.55:6824/1615684400,v1:172.21.15.55:6825/1615684400] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fabb81e6a20 con 0x7fab9806e010 2023-08-25T04:03:07.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7f632effd640 1 -- 172.21.15.55:0/2048922270 <== osd.6 v2:172.21.15.110:6800/3646933996 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6328074dc0 con 0x7f63280722f0 2023-08-25T04:03:07.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7fb07f59e640 1 -- 172.21.15.55:0/1674659072 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0800c5990 con 0x7fb08015e560 2023-08-25T04:03:07.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7fb06effd640 1 -- 172.21.15.55:0/1674659072 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074003840 con 0x7fb08015e560 2023-08-25T04:03:07.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7fb07f59e640 1 -- 172.21.15.55:0/1674659072 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0800c5f50 con 0x7fb08015e560 2023-08-25T04:03:07.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.643+0000 7faba6ffd640 1 -- 172.21.15.55:0/3731497404 <== osd.0 v2:172.21.15.55:6824/1615684400 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fabb81e6a20 con 0x7fab9806e010 2023-08-25T04:03:07.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.647+0000 7faba4ff9640 1 -- 172.21.15.55:0/3731497404 >> [v2:172.21.15.55:6824/1615684400,v1:172.21.15.55:6825/1615684400] conn(0x7fab9806e010 msgr2=0x7fab98070430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.647+0000 7faba4ff9640 1 --2- 172.21.15.55:0/3731497404 >> [v2:172.21.15.55:6824/1615684400,v1:172.21.15.55:6825/1615684400] conn(0x7fab9806e010 0x7fab98070430 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.647+0000 7fb06effd640 1 -- 172.21.15.55:0/1674659072 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb0740039a0 con 0x7fb08015e560 2023-08-25T04:03:07.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.647+0000 7fb06effd640 1 --2- 172.21.15.55:0/1674659072 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb0600656d0 0x7fb060067b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.647+0000 7fb06effd640 1 -- 172.21.15.55:0/1674659072 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb074082e10 con 0x7fb08015e560 2023-08-25T04:03:07.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.651+0000 7fb07e59c640 1 --2- 172.21.15.55:0/1674659072 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb0600656d0 0x7fb060067b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.651+0000 7fb07f59e640 1 --2- 172.21.15.55:0/1674659072 >> [v2:172.21.15.110:6808/2557570989,v1:172.21.15.110:6809/2557570989] conn(0x7fb0800c5230 0x7fb080163420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:07.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.651+0000 7fb07f59e640 1 -- 172.21.15.55:0/1674659072 --> [v2:172.21.15.110:6808/2557570989,v1:172.21.15.110:6809/2557570989] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb080073e50 con 0x7fb0800c5230 2023-08-25T04:03:07.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.651+0000 7faba4ff9640 1 -- 172.21.15.55:0/3731497404 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fab98065750 msgr2=0x7fab98067c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.651+0000 7faba4ff9640 1 --2- 172.21.15.55:0/3731497404 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fab98065750 0x7fab98067c10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fabac009b60 tx=0x7fabac006f90 comp rx=0 tx=0).stop 2023-08-25T04:03:07.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.651+0000 7faba4ff9640 1 -- 172.21.15.55:0/3731497404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabb80714c0 msgr2=0x7fabb815bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.651+0000 7faba4ff9640 1 --2- 172.21.15.55:0/3731497404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabb80714c0 0x7fabb815bd80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fabb00af000 tx=0x7fabb001dbb0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.651+0000 7fabb6d9d640 1 -- 172.21.15.55:0/3731497404 reap_dead start 2023-08-25T04:03:07.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.651+0000 7faba4ff9640 1 -- 172.21.15.55:0/3731497404 shutdown_connections 2023-08-25T04:03:07.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.651+0000 7faba4ff9640 1 -- 172.21.15.55:0/3731497404 >> 172.21.15.55:0/3731497404 conn(0x7fabb80cabd0 msgr2=0x7fabb806f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:07.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.651+0000 7faba4ff9640 1 -- 172.21.15.55:0/3731497404 shutdown_connections 2023-08-25T04:03:07.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.651+0000 7faba4ff9640 1 -- 172.21.15.55:0/3731497404 wait complete. 2023-08-25T04:03:07.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.651+0000 7f071d574640 1 -- 172.21.15.55:0/1815934919 --> [v2:172.21.15.55:6800/1562339076,v1:172.21.15.55:6801/1562339076] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f071815b9d0 con 0x7f070406dea0 2023-08-25T04:03:07.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.651+0000 7f06ff7fe640 1 -- 172.21.15.55:0/1815934919 <== osd.1 v2:172.21.15.55:6800/1562339076 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f070c009900 con 0x7f070406dea0 2023-08-25T04:03:07.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.651+0000 7fb07ed9d640 1 --2- 172.21.15.55:0/1674659072 >> [v2:172.21.15.110:6808/2557570989,v1:172.21.15.110:6809/2557570989] conn(0x7fb0800c5230 0x7fb080163420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:07.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.651+0000 7fb07ed9d640 1 --2- 172.21.15.55:0/1674659072 >> [v2:172.21.15.110:6808/2557570989,v1:172.21.15.110:6809/2557570989] conn(0x7fb0800c5230 0x7fb080163420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.651+0000 7fb07e59c640 1 --2- 172.21.15.55:0/1674659072 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb0600656d0 0x7fb060067b90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb07001c430 tx=0x7fb070008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:07.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.651+0000 7fb06effd640 1 -- 172.21.15.55:0/1674659072 <== osd.7 v2:172.21.15.110:6808/2557570989 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb080073e50 con 0x7fb0800c5230 2023-08-25T04:03:07.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.655+0000 7f06fd7fa640 1 -- 172.21.15.55:0/1815934919 >> [v2:172.21.15.55:6800/1562339076,v1:172.21.15.55:6801/1562339076] conn(0x7f070406dea0 msgr2=0x7f07040702c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.655+0000 7f06fd7fa640 1 --2- 172.21.15.55:0/1815934919 >> [v2:172.21.15.55:6800/1562339076,v1:172.21.15.55:6801/1562339076] conn(0x7f070406dea0 0x7f07040702c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.655+0000 7f06fd7fa640 1 -- 172.21.15.55:0/1815934919 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0704065750 msgr2=0x7f0704067c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.655+0000 7f06fd7fa640 1 --2- 172.21.15.55:0/1815934919 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0704065750 0x7f0704067c10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f07080ae000 tx=0x7f07080b5040 comp rx=0 tx=0).stop 2023-08-25T04:03:07.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.655+0000 7f06fd7fa640 1 -- 172.21.15.55:0/1815934919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0718157560 msgr2=0x7f0718155e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.655+0000 7f06fd7fa640 1 --2- 172.21.15.55:0/1815934919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0718157560 0x7f0718155e30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f071000c7a0 tx=0x7f071000cc60 comp rx=0 tx=0).stop 2023-08-25T04:03:07.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.655+0000 7f07177fe640 1 -- 172.21.15.55:0/1815934919 reap_dead start 2023-08-25T04:03:07.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.655+0000 7f06fd7fa640 1 -- 172.21.15.55:0/1815934919 shutdown_connections 2023-08-25T04:03:07.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.655+0000 7f06fd7fa640 1 -- 172.21.15.55:0/1815934919 >> 172.21.15.55:0/1815934919 conn(0x7f07180cabd0 msgr2=0x7f07180cafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:07.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.655+0000 7f06fd7fa640 1 -- 172.21.15.55:0/1815934919 shutdown_connections 2023-08-25T04:03:07.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.655+0000 7f06fd7fa640 1 -- 172.21.15.55:0/1815934919 wait complete. 2023-08-25T04:03:07.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7fbdf5982640 1 -- 172.21.15.55:0/2682399967 --> [v2:172.21.15.55:6808/3999551967,v1:172.21.15.55:6809/3999551967] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbde804fc20 con 0x7fbddc06df90 2023-08-25T04:03:07.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7f545f7fe640 1 -- 172.21.15.55:0/3991559049 --> [v2:172.21.15.110:6816/1700969513,v1:172.21.15.110:6817/1700969513] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5458002cc0 con 0x7f546006df90 2023-08-25T04:03:07.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7fbdd7fff640 1 -- 172.21.15.55:0/2682399967 <== osd.2 v2:172.21.15.55:6808/3999551967 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbdf004e430 con 0x7fbddc06df90 2023-08-25T04:03:07.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7f5471ffb640 1 -- 172.21.15.55:0/3991559049 <== osd.4 v2:172.21.15.110:6816/1700969513 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5458002cc0 con 0x7f546006df90 2023-08-25T04:03:07.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7f545f7fe640 1 -- 172.21.15.55:0/3991559049 >> [v2:172.21.15.110:6816/1700969513,v1:172.21.15.110:6817/1700969513] conn(0x7f546006df90 msgr2=0x7f54600703b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7f545f7fe640 1 --2- 172.21.15.55:0/3991559049 >> [v2:172.21.15.110:6816/1700969513,v1:172.21.15.110:6817/1700969513] conn(0x7f546006df90 0x7f54600703b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7fbdd5ffb640 1 -- 172.21.15.55:0/2682399967 >> [v2:172.21.15.55:6808/3999551967,v1:172.21.15.55:6809/3999551967] conn(0x7fbddc06df90 msgr2=0x7fbddc0703b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7fbdd5ffb640 1 --2- 172.21.15.55:0/2682399967 >> [v2:172.21.15.55:6808/3999551967,v1:172.21.15.55:6809/3999551967] conn(0x7fbddc06df90 0x7fbddc0703b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7f545f7fe640 1 -- 172.21.15.55:0/3991559049 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f54600656d0 msgr2=0x7f5460067b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7f545f7fe640 1 --2- 172.21.15.55:0/3991559049 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f54600656d0 0x7f5460067b90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f547c0722d0 tx=0x7f547c08b040 comp rx=0 tx=0).stop 2023-08-25T04:03:07.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7fbdd5ffb640 1 -- 172.21.15.55:0/2682399967 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbddc0656d0 msgr2=0x7fbddc067b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7fbdd5ffb640 1 --2- 172.21.15.55:0/2682399967 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbddc0656d0 0x7fbddc067b90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbde80d9600 tx=0x7fbde4008040 comp rx=0 tx=0).stop 2023-08-25T04:03:07.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7fbdd5ffb640 1 -- 172.21.15.55:0/2682399967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbde8033b80 msgr2=0x7fbde80e4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7fbdd5ffb640 1 --2- 172.21.15.55:0/2682399967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbde8033b80 0x7fbde80e4b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbde00ac040 tx=0x7fbde001ad00 comp rx=0 tx=0).stop 2023-08-25T04:03:07.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7fbdef7fe640 1 -- 172.21.15.55:0/2682399967 reap_dead start 2023-08-25T04:03:07.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7f545f7fe640 1 -- 172.21.15.55:0/3991559049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54740df2f0 msgr2=0x7f54740d2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7f545f7fe640 1 --2- 172.21.15.55:0/3991559049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54740df2f0 0x7f54740d2060 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f547800e7f0 tx=0x7f547800ecb0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7fbdd5ffb640 1 -- 172.21.15.55:0/2682399967 shutdown_connections 2023-08-25T04:03:07.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7fbdd5ffb640 1 -- 172.21.15.55:0/2682399967 >> 172.21.15.55:0/2682399967 conn(0x7fbde8054c50 msgr2=0x7fbde8037370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:07.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7f5481be5640 1 -- 172.21.15.55:0/3991559049 reap_dead start 2023-08-25T04:03:07.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7f545f7fe640 1 -- 172.21.15.55:0/3991559049 shutdown_connections 2023-08-25T04:03:07.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7f545f7fe640 1 -- 172.21.15.55:0/3991559049 >> 172.21.15.55:0/3991559049 conn(0x7f5474054b10 msgr2=0x7f54740e29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:07.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7fbdd5ffb640 1 -- 172.21.15.55:0/2682399967 shutdown_connections 2023-08-25T04:03:07.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7f545f7fe640 1 -- 172.21.15.55:0/3991559049 shutdown_connections 2023-08-25T04:03:07.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7f545f7fe640 1 -- 172.21.15.55:0/3991559049 wait complete. 2023-08-25T04:03:07.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.663+0000 7fbdd5ffb640 1 -- 172.21.15.55:0/2682399967 wait complete. 2023-08-25T04:03:07.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.667+0000 7f33daa8a640 1 -- 172.21.15.55:0/2520970808 --> [v2:172.21.15.110:6824/3619347626,v1:172.21.15.110:6825/3619347626] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f33d40c38a0 con 0x7f33b806e040 2023-08-25T04:03:07.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.667+0000 7f33c67fc640 1 -- 172.21.15.55:0/2520970808 <== osd.5 v2:172.21.15.110:6824/3619347626 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f33d40c38a0 con 0x7f33b806e040 2023-08-25T04:03:07.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.671+0000 7f33daa8a640 1 -- 172.21.15.55:0/2520970808 >> [v2:172.21.15.110:6824/3619347626,v1:172.21.15.110:6825/3619347626] conn(0x7f33b806e040 msgr2=0x7f33b8070460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.671+0000 7f33daa8a640 1 --2- 172.21.15.55:0/2520970808 >> [v2:172.21.15.110:6824/3619347626,v1:172.21.15.110:6825/3619347626] conn(0x7f33b806e040 0x7f33b8070460 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.671+0000 7f33daa8a640 1 -- 172.21.15.55:0/2520970808 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f33b8065780 msgr2=0x7f33b8067c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.671+0000 7f33daa8a640 1 --2- 172.21.15.55:0/2520970808 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f33b8065780 0x7f33b8067c40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f33cc004f10 tx=0x7f33cc009040 comp rx=0 tx=0).stop 2023-08-25T04:03:07.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.671+0000 7f33daa8a640 1 -- 172.21.15.55:0/2520970808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d4159130 msgr2=0x7f33d4152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.671+0000 7f33daa8a640 1 --2- 172.21.15.55:0/2520970808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33d4159130 0x7f33d4152800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f33c800f860 tx=0x7f33c800fd20 comp rx=0 tx=0).stop 2023-08-25T04:03:07.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.671+0000 7f33da289640 1 -- 172.21.15.55:0/2520970808 reap_dead start 2023-08-25T04:03:07.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.671+0000 7f33daa8a640 1 -- 172.21.15.55:0/2520970808 shutdown_connections 2023-08-25T04:03:07.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.671+0000 7f33daa8a640 1 -- 172.21.15.55:0/2520970808 >> 172.21.15.55:0/2520970808 conn(0x7f33d406d3a0 msgr2=0x7f33d4070300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:07.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.671+0000 7f33daa8a640 1 -- 172.21.15.55:0/2520970808 shutdown_connections 2023-08-25T04:03:07.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.671+0000 7f33daa8a640 1 -- 172.21.15.55:0/2520970808 wait complete. 2023-08-25T04:03:07.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.671+0000 7fecf1ffb640 1 -- 172.21.15.55:0/796283153 --> [v2:172.21.15.55:6816/2251401738,v1:172.21.15.55:6817/2251401738] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fed000054d0 con 0x7fed00006fb0 2023-08-25T04:03:07.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.675+0000 7fecf3fff640 1 -- 172.21.15.55:0/796283153 <== osd.3 v2:172.21.15.55:6816/2251401738 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fed000054d0 con 0x7fed00006fb0 2023-08-25T04:03:07.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.675+0000 7f633f59e640 1 -- 172.21.15.55:0/2048922270 --> [v2:172.21.15.110:6800/3646933996,v1:172.21.15.110:6801/3646933996] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f634006fd80 con 0x7f63280722f0 2023-08-25T04:03:07.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.675+0000 7f632effd640 1 -- 172.21.15.55:0/2048922270 <== osd.6 v2:172.21.15.110:6800/3646933996 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6338009e50 con 0x7f63280722f0 2023-08-25T04:03:07.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.675+0000 7f632cff9640 1 -- 172.21.15.55:0/2048922270 >> [v2:172.21.15.110:6800/3646933996,v1:172.21.15.110:6801/3646933996] conn(0x7f63280722f0 msgr2=0x7f6328074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.675+0000 7f632cff9640 1 --2- 172.21.15.55:0/2048922270 >> [v2:172.21.15.110:6800/3646933996,v1:172.21.15.110:6801/3646933996] conn(0x7f63280722f0 0x7f6328074710 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.675+0000 7f632cff9640 1 -- 172.21.15.55:0/2048922270 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6328069a80 msgr2=0x7f632806bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.675+0000 7f632cff9640 1 --2- 172.21.15.55:0/2048922270 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6328069a80 0x7f632806bf40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6334001ec0 tx=0x7f6334001df0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.675+0000 7f632cff9640 1 -- 172.21.15.55:0/2048922270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6328003770 msgr2=0x7f63401f4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.675+0000 7f632cff9640 1 --2- 172.21.15.55:0/2048922270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6328003770 0x7f63401f4560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f633001c130 tx=0x7f63280047f0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.675+0000 7f633ed9d640 1 -- 172.21.15.55:0/2048922270 reap_dead start 2023-08-25T04:03:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.675+0000 7f632cff9640 1 -- 172.21.15.55:0/2048922270 shutdown_connections 2023-08-25T04:03:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.675+0000 7f632cff9640 1 -- 172.21.15.55:0/2048922270 >> 172.21.15.55:0/2048922270 conn(0x7f63400cac40 msgr2=0x7f63400cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:07.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.675+0000 7f632cff9640 1 -- 172.21.15.55:0/2048922270 shutdown_connections 2023-08-25T04:03:07.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.675+0000 7f632cff9640 1 -- 172.21.15.55:0/2048922270 wait complete. 2023-08-25T04:03:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.679+0000 7fecf1ffb640 1 -- 172.21.15.55:0/796283153 >> [v2:172.21.15.55:6816/2251401738,v1:172.21.15.55:6817/2251401738] conn(0x7fed00006fb0 msgr2=0x7fed000346b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.679+0000 7fecf1ffb640 1 --2- 172.21.15.55:0/796283153 >> [v2:172.21.15.55:6816/2251401738,v1:172.21.15.55:6817/2251401738] conn(0x7fed00006fb0 0x7fed000346b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.679+0000 7fecf1ffb640 1 -- 172.21.15.55:0/796283153 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fecec065750 msgr2=0x7fecec067c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.679+0000 7fecf1ffb640 1 --2- 172.21.15.55:0/796283153 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fecec065750 0x7fecec067c10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fecfc000f70 tx=0x7fecfc009040 comp rx=0 tx=0).stop 2023-08-25T04:03:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.679+0000 7fecf1ffb640 1 -- 172.21.15.55:0/796283153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed000e13c0 msgr2=0x7fed000e3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.679+0000 7fecf1ffb640 1 --2- 172.21.15.55:0/796283153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed000e13c0 0x7fed000e3c40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fed08068750 tx=0x7fed08092eb0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.679+0000 7fed07fff640 1 -- 172.21.15.55:0/796283153 reap_dead start 2023-08-25T04:03:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.679+0000 7fecf1ffb640 1 -- 172.21.15.55:0/796283153 shutdown_connections 2023-08-25T04:03:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.679+0000 7fecf1ffb640 1 -- 172.21.15.55:0/796283153 >> 172.21.15.55:0/796283153 conn(0x7fed00054c50 msgr2=0x7fed0004e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.679+0000 7fecf1ffb640 1 -- 172.21.15.55:0/796283153 shutdown_connections 2023-08-25T04:03:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.679+0000 7fecf1ffb640 1 -- 172.21.15.55:0/796283153 wait complete. 2023-08-25T04:03:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.683+0000 7fb07f59e640 1 -- 172.21.15.55:0/1674659072 --> [v2:172.21.15.110:6808/2557570989,v1:172.21.15.110:6809/2557570989] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb0800b0a80 con 0x7fb0800c5230 2023-08-25T04:03:07.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.683+0000 7fb06effd640 1 -- 172.21.15.55:0/1674659072 <== osd.7 v2:172.21.15.110:6808/2557570989 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb0800b0a80 con 0x7fb0800c5230 2023-08-25T04:03:07.755 INFO:teuthology.orchestra.run.smithi055.stdout:60129542150 2023-08-25T04:03:07.756 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-25T04:03:07.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.691+0000 7fb07f59e640 1 -- 172.21.15.55:0/1674659072 >> [v2:172.21.15.110:6808/2557570989,v1:172.21.15.110:6809/2557570989] conn(0x7fb0800c5230 msgr2=0x7fb080163420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.691+0000 7fb07f59e640 1 --2- 172.21.15.55:0/1674659072 >> [v2:172.21.15.110:6808/2557570989,v1:172.21.15.110:6809/2557570989] conn(0x7fb0800c5230 0x7fb080163420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:07.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.691+0000 7fb07f59e640 1 -- 172.21.15.55:0/1674659072 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb0600656d0 msgr2=0x7fb060067b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.691+0000 7fb07f59e640 1 --2- 172.21.15.55:0/1674659072 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb0600656d0 0x7fb060067b90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb07001c430 tx=0x7fb070008040 comp rx=0 tx=0).stop 2023-08-25T04:03:07.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.691+0000 7fb07f59e640 1 -- 172.21.15.55:0/1674659072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb08015e560 msgr2=0x7fb0800c6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:07.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.691+0000 7fb07f59e640 1 --2- 172.21.15.55:0/1674659072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb08015e560 0x7fb0800c6750 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb08006f6c0 tx=0x7fb07400da30 comp rx=0 tx=0).stop 2023-08-25T04:03:07.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.691+0000 7fb07ed9d640 1 -- 172.21.15.55:0/1674659072 reap_dead start 2023-08-25T04:03:07.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.691+0000 7fb07f59e640 1 -- 172.21.15.55:0/1674659072 shutdown_connections 2023-08-25T04:03:07.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.691+0000 7fb07f59e640 1 -- 172.21.15.55:0/1674659072 >> 172.21.15.55:0/1674659072 conn(0x7fb080069f00 msgr2=0x7fb0800aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:07.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.691+0000 7fb07f59e640 1 -- 172.21.15.55:0/1674659072 shutdown_connections 2023-08-25T04:03:07.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:07.691+0000 7fb07f59e640 1 -- 172.21.15.55:0/1674659072 wait complete. 2023-08-25T04:03:07.759 INFO:teuthology.orchestra.run.smithi055.stdout:60129542151 2023-08-25T04:03:07.759 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-25T04:03:07.760 INFO:teuthology.orchestra.run.smithi055.stdout:60129542151 2023-08-25T04:03:07.761 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-25T04:03:07.761 INFO:teuthology.orchestra.run.smithi055.stdout:60129542150 2023-08-25T04:03:07.762 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-25T04:03:07.762 INFO:teuthology.orchestra.run.smithi055.stdout:64424509448 2023-08-25T04:03:07.763 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-25T04:03:07.764 INFO:teuthology.orchestra.run.smithi055.stdout:60129542150 2023-08-25T04:03:07.764 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-25T04:03:07.765 INFO:teuthology.orchestra.run.smithi055.stdout:60129542150 2023-08-25T04:03:07.765 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-25T04:03:07.766 INFO:teuthology.orchestra.run.smithi055.stdout:64424509448 2023-08-25T04:03:07.766 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-25T04:03:08.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.039+0000 7fd0712cb640 1 Processor -- start 2023-08-25T04:03:08.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.043+0000 7fd0712cb640 1 -- start start 2023-08-25T04:03:08.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.043+0000 7fd0712cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd06c0ac7e0 0x7fd06c06b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.043+0000 7fd0712cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd06c0abdb0 0x7fd06c06b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.043+0000 7fd0712cb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06c0cc8c0 con 0x7fd06c0cb6f0 2023-08-25T04:03:08.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.043+0000 7fd0712cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06c0ad8e0 con 0x7fd06c0abdb0 2023-08-25T04:03:08.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.043+0000 7fd0712cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c0ccba0 con 0x7fd06c0ac7e0 2023-08-25T04:03:08.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.043+0000 7fd06b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd06c0abdb0 0x7fd06c06b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.043+0000 7fd06b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd06c0abdb0 0x7fd06c06b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35650/0 (socket says 172.21.15.55:35650) 2023-08-25T04:03:08.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.043+0000 7fd06b7fe640 1 -- 172.21.15.55:0/3469300606 learned_addr learned my addr 172.21.15.55:0/3469300606 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:08.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.043+0000 7fd06affd640 1 --2- 172.21.15.55:0/3469300606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd06c0ac7e0 0x7fd06c06b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.043+0000 7fd069ffb640 1 -- 172.21.15.55:0/3469300606 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435712604 0 0) 0x7fd06c0cc8c0 con 0x7fd06c0cb6f0 2023-08-25T04:03:08.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.043+0000 7fd069ffb640 1 -- 172.21.15.55:0/3469300606 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd054003530 con 0x7fd06c0cb6f0 2023-08-25T04:03:08.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.043+0000 7fd06b7fe640 1 -- 172.21.15.55:0/3469300606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd06c0ac7e0 msgr2=0x7fd06c06b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:08.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.043+0000 7fd06b7fe640 1 --2- 172.21.15.55:0/3469300606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd06c0ac7e0 0x7fd06c06b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.043+0000 7fd06b7fe640 1 -- 172.21.15.55:0/3469300606 >> v1:172.21.15.110:6789/0 conn(0x7fd06c0cb6f0 legacy=0x7fd06c15c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.047+0000 7fd06b7fe640 1 -- 172.21.15.55:0/3469300606 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06c0cce80 con 0x7fd06c0abdb0 2023-08-25T04:03:08.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.047+0000 7f8e553d5640 1 Processor -- start 2023-08-25T04:03:08.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.047+0000 7f8e553d5640 1 -- start start 2023-08-25T04:03:08.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.047+0000 7f8e553d5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e500aee40 0x7f8e5006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7f8e553d5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8e500cf160 0x7f8e5006a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7f8e553d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5006b4c0 con 0x7f8e500cae10 2023-08-25T04:03:08.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7f8e553d5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5006e200 con 0x7f8e500aee40 2023-08-25T04:03:08.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7f8e553d5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5006e4e0 con 0x7f8e500cf160 2023-08-25T04:03:08.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7f8e4e7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8e500cae10 0x7f8e500cea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50462/0 (socket says 172.21.15.55:50462) 2023-08-25T04:03:08.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7f8e4e7fc640 1 -- 172.21.15.55:0/3023893727 learned_addr learned my addr 172.21.15.55:0/3023893727 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:08.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7fd06b7fe640 1 --2- 172.21.15.55:0/3469300606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd06c0abdb0 0x7fd06c06b970 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd060009870 tx=0x7fd06001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2e12c1b6ec2ab8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7f8e4ffff640 1 --2- 172.21.15.55:0/3023893727 >> v2:172.21.15.110:3300/0 conn(0x7f8e500cf160 0x7f8e5006a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7fd069ffb640 1 -- 172.21.15.55:0/3469300606 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0600a7070 con 0x7fd06c0abdb0 2023-08-25T04:03:08.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7f8e4effd640 1 --2- 172.21.15.55:0/3023893727 >> v2:172.21.15.55:3300/0 conn(0x7f8e500aee40 0x7f8e5006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7f8e4dffb640 1 -- 172.21.15.55:0/3023893727 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570342910 0 0) 0x7f8e5006b4c0 con 0x7f8e500cae10 2023-08-25T04:03:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7f8e4ffff640 1 -- 172.21.15.55:0/3023893727 >> v2:172.21.15.55:3300/0 conn(0x7f8e500aee40 msgr2=0x7f8e5006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7f8e4ffff640 1 --2- 172.21.15.55:0/3023893727 >> v2:172.21.15.55:3300/0 conn(0x7f8e500aee40 0x7f8e5006d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7f8e4ffff640 1 -- 172.21.15.55:0/3023893727 >> v1:172.21.15.55:6789/0 conn(0x7f8e500cae10 legacy=0x7f8e500cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7f8e4ffff640 1 -- 172.21.15.55:0/3023893727 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5006e7c0 con 0x7f8e500cf160 2023-08-25T04:03:08.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7fd069ffb640 1 -- 172.21.15.55:0/3469300606 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0600ab430 con 0x7fd06c0abdb0 2023-08-25T04:03:08.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7f8e4effd640 1 --2- 172.21.15.55:0/3023893727 >> v2:172.21.15.55:3300/0 conn(0x7f8e500aee40 0x7f8e5006d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:08.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7fd0712cb640 1 -- 172.21.15.55:0/3469300606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd06c0abdb0 msgr2=0x7fd06c06b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7fd069ffb640 1 -- 172.21.15.55:0/3469300606 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0600a7070 con 0x7fd06c0abdb0 2023-08-25T04:03:08.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7fd0712cb640 1 --2- 172.21.15.55:0/3469300606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd06c0abdb0 0x7fd06c06b970 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd060009870 tx=0x7fd06001c510 comp rx=0 tx=0).stop 2023-08-25T04:03:08.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7fd0712cb640 1 -- 172.21.15.55:0/3469300606 shutdown_connections 2023-08-25T04:03:08.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7fd0712cb640 1 --2- 172.21.15.55:0/3469300606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd06c0abdb0 0x7fd06c06b970 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7fd0712cb640 1 --2- 172.21.15.55:0/3469300606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd06c0ac7e0 0x7fd06c06b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7fd0712cb640 1 -- 172.21.15.55:0/3469300606 >> 172.21.15.55:0/3469300606 conn(0x7fd06c0cabd0 msgr2=0x7fd06c0cafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:08.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.051+0000 7fd0712cb640 1 -- 172.21.15.55:0/3469300606 shutdown_connections 2023-08-25T04:03:08.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.055+0000 7fd0712cb640 1 -- 172.21.15.55:0/3469300606 wait complete. 2023-08-25T04:03:08.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.055+0000 7fd0712cb640 1 Processor -- start 2023-08-25T04:03:08.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.055+0000 7fd0712cb640 1 -- start start 2023-08-25T04:03:08.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.055+0000 7f8e4ffff640 1 --2- 172.21.15.55:0/3023893727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e500cf160 0x7f8e5006a210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8e50065f50 tx=0x7f8e4001c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e5b844f7b2a4474 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f8e4dffb640 1 -- 172.21.15.55:0/3023893727 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e400ad660 con 0x7f8e500cf160 2023-08-25T04:03:08.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f8e4dffb640 1 -- 172.21.15.55:0/3023893727 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e400ad7c0 con 0x7f8e500cf160 2023-08-25T04:03:08.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f8e4dffb640 1 -- 172.21.15.55:0/3023893727 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e400adb50 con 0x7f8e500cf160 2023-08-25T04:03:08.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.055+0000 7f100532d640 1 Processor -- start 2023-08-25T04:03:08.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.055+0000 7f100532d640 1 -- start start 2023-08-25T04:03:08.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd0712cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd06c0abdb0 0x7fd06c149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd0712cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd06c0ac7e0 0x7fd06c09a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd0712cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd06c0cb6f0 0x7fd06c0af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd06affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd06c0abdb0 0x7fd06c149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd06affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd06c0abdb0 0x7fd06c149cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:38726/0 (socket says 172.21.15.55:38726) 2023-08-25T04:03:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f8e553d5640 1 -- 172.21.15.55:0/3023893727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e500cf160 msgr2=0x7f8e5006a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f8e553d5640 1 --2- 172.21.15.55:0/3023893727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e500cf160 0x7f8e5006a210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8e50065f50 tx=0x7f8e4001c3a0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd06a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd06c0ac7e0 0x7fd06c09a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f8e553d5640 1 -- 172.21.15.55:0/3023893727 shutdown_connections 2023-08-25T04:03:08.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f8e553d5640 1 --2- 172.21.15.55:0/3023893727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e500cf160 0x7f8e5006a210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f8e553d5640 1 --2- 172.21.15.55:0/3023893727 >> v2:172.21.15.55:3300/0 conn(0x7f8e500aee40 0x7f8e5006d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f8e553d5640 1 -- 172.21.15.55:0/3023893727 >> 172.21.15.55:0/3023893727 conn(0x7f8e500cfa40 msgr2=0x7f8e500cfe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:08.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd06a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd06c0ac7e0 0x7fd06c09a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35664/0 (socket says 172.21.15.55:35664) 2023-08-25T04:03:08.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd06b7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd06c0cb6f0 0x7fd06c0af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd06b7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd06c0cb6f0 0x7fd06c0af470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:46908/0 (socket says 172.21.15.55:46908) 2023-08-25T04:03:08.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd06b7fe640 1 -- 172.21.15.55:0/2503177246 learned_addr learned my addr 172.21.15.55:0/2503177246 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:08.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd0712cb640 1 -- 172.21.15.55:0/2503177246 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c0c52c0 con 0x7fd06c0ac7e0 2023-08-25T04:03:08.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd0712cb640 1 -- 172.21.15.55:0/2503177246 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c0c5560 con 0x7fd06c0abdb0 2023-08-25T04:03:08.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd0712cb640 1 -- 172.21.15.55:0/2503177246 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06c0c5840 con 0x7fd06c0cb6f0 2023-08-25T04:03:08.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f8e553d5640 1 -- 172.21.15.55:0/3023893727 shutdown_connections 2023-08-25T04:03:08.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f8e553d5640 1 -- 172.21.15.55:0/3023893727 wait complete. 2023-08-25T04:03:08.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f100532d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0ff8033e20 0x7f0ff80eb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f100532d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff8048310 0x7f0ff80eb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f100532d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff80ec130 con 0x7f0ff8047ce0 2023-08-25T04:03:08.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f100532d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff8054000 con 0x7f0ff8033e20 2023-08-25T04:03:08.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f100532d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff804f310 con 0x7f0ff8048310 2023-08-25T04:03:08.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f1004b2c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0ff8047ce0 0x7f0ff8005ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:49684/0 (socket says 172.21.15.55:49684) 2023-08-25T04:03:08.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f1004b2c640 1 -- 172.21.15.55:0/1765158965 learned_addr learned my addr 172.21.15.55:0/1765158965 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:08.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f0ffffff640 1 --2- 172.21.15.55:0/1765158965 >> v2:172.21.15.110:3300/0 conn(0x7f0ff8033e20 0x7f0ff80eb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f0fff7fe640 1 --2- 172.21.15.55:0/1765158965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff8048310 0x7f0ff80eb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd06affd640 1 -- 172.21.15.55:0/2503177246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd06c0cb6f0 msgr2=0x7fd06c0af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd06affd640 1 --2- 172.21.15.55:0/2503177246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd06c0cb6f0 0x7fd06c0af470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd06affd640 1 -- 172.21.15.55:0/2503177246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd06c0ac7e0 msgr2=0x7fd06c09a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd06affd640 1 --2- 172.21.15.55:0/2503177246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd06c0ac7e0 0x7fd06c09a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd06affd640 1 -- 172.21.15.55:0/2503177246 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0600094d0 con 0x7fd06c0abdb0 2023-08-25T04:03:08.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f0ffeffd640 1 -- 172.21.15.55:0/1765158965 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177391358 0 0) 0x7f0ff80ec130 con 0x7f0ff8047ce0 2023-08-25T04:03:08.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f0ffeffd640 1 -- 172.21.15.55:0/1765158965 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ff0003530 con 0x7f0ff8047ce0 2023-08-25T04:03:08.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7fd06affd640 1 --2- 172.21.15.55:0/2503177246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd06c0abdb0 0x7fd06c149cc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00e870 tx=0x7fd05c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7fd0537fe640 1 -- 172.21.15.55:0/2503177246 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c0095d0 con 0x7fd06c0abdb0 2023-08-25T04:03:08.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7fd0712cb640 1 -- 172.21.15.55:0/2503177246 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06c0c5b20 con 0x7fd06c0abdb0 2023-08-25T04:03:08.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7fd0712cb640 1 -- 172.21.15.55:0/2503177246 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06c09b410 con 0x7fd06c0abdb0 2023-08-25T04:03:08.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7f8e553d5640 1 Processor -- start 2023-08-25T04:03:08.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7fd0537fe640 1 -- 172.21.15.55:0/2503177246 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05c00c940 con 0x7fd06c0abdb0 2023-08-25T04:03:08.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7fd0537fe640 1 -- 172.21.15.55:0/2503177246 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c00ccb0 con 0x7fd06c0abdb0 2023-08-25T04:03:08.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7f8e553d5640 1 -- start start 2023-08-25T04:03:08.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f0fff7fe640 1 -- 172.21.15.55:0/1765158965 >> v2:172.21.15.110:3300/0 conn(0x7f0ff8033e20 msgr2=0x7f0ff80eb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:08.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f0fff7fe640 1 --2- 172.21.15.55:0/1765158965 >> v2:172.21.15.110:3300/0 conn(0x7f0ff8033e20 0x7f0ff80eb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f0fff7fe640 1 -- 172.21.15.55:0/1765158965 >> v1:172.21.15.110:6789/0 conn(0x7f0ff8047ce0 legacy=0x7f0ff8005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f0fff7fe640 1 -- 172.21.15.55:0/1765158965 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff804f5f0 con 0x7f0ff8048310 2023-08-25T04:03:08.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.059+0000 7f0ffffff640 1 --2- 172.21.15.55:0/1765158965 >> v2:172.21.15.110:3300/0 conn(0x7f0ff8033e20 0x7f0ff80eb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:08.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7fd0712cb640 1 -- 172.21.15.55:0/2503177246 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04c005260 con 0x7fd06c0abdb0 2023-08-25T04:03:08.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7f8e553d5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e500aee40 0x7f8e50156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7f8e553d5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e500cae10 0x7f8e50150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7f8e553d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e500cf160 0x7f8e501487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7f8e4effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e500aee40 0x7f8e50156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7f8e4effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e500aee40 0x7f8e50156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:46936/0 (socket says 172.21.15.55:46936) 2023-08-25T04:03:08.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7f8e4e7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e500cae10 0x7f8e50150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7f8e4e7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e500cae10 0x7f8e50150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:38744/0 (socket says 172.21.15.55:38744) 2023-08-25T04:03:08.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7f8e4ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e500cf160 0x7f8e501487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7f8e4ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e500cf160 0x7f8e501487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35678/0 (socket says 172.21.15.55:35678) 2023-08-25T04:03:08.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7f8e4effd640 1 -- 172.21.15.55:0/1302575284 learned_addr learned my addr 172.21.15.55:0/1302575284 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:08.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.063+0000 7f8e553d5640 1 -- 172.21.15.55:0/1302575284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e501511d0 con 0x7f8e500cf160 2023-08-25T04:03:08.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7f8e553d5640 1 -- 172.21.15.55:0/1302575284 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e50157c50 con 0x7f8e500cae10 2023-08-25T04:03:08.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7f8e553d5640 1 -- 172.21.15.55:0/1302575284 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e50148d20 con 0x7f8e500aee40 2023-08-25T04:03:08.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7fd0537fe640 1 -- 172.21.15.55:0/2503177246 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd05c0059a0 con 0x7fd06c0abdb0 2023-08-25T04:03:08.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7f8e4effd640 1 -- 172.21.15.55:0/1302575284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e500cae10 msgr2=0x7f8e50150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7f8e4effd640 1 --2- 172.21.15.55:0/1302575284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e500cae10 0x7f8e50150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7f8e4effd640 1 -- 172.21.15.55:0/1302575284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e500cf160 msgr2=0x7f8e501487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7f8e4effd640 1 --2- 172.21.15.55:0/1302575284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e500cf160 0x7f8e501487e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7f8e4effd640 1 -- 172.21.15.55:0/1302575284 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e40009420 con 0x7f8e500aee40 2023-08-25T04:03:08.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7f8e4effd640 1 --2- 172.21.15.55:0/1302575284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e500aee40 0x7f8e50156940 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400c820 tx=0x7f8e4400cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7effa04cb640 1 Processor -- start 2023-08-25T04:03:08.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7f8e377fe640 1 -- 172.21.15.55:0/1302575284 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44007820 con 0x7f8e500aee40 2023-08-25T04:03:08.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7f8e377fe640 1 -- 172.21.15.55:0/1302575284 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e44007980 con 0x7f8e500aee40 2023-08-25T04:03:08.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7f8e553d5640 1 -- 172.21.15.55:0/1302575284 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e50157040 con 0x7f8e500aee40 2023-08-25T04:03:08.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7f8e377fe640 1 -- 172.21.15.55:0/1302575284 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44007d30 con 0x7f8e500aee40 2023-08-25T04:03:08.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7f8e553d5640 1 -- 172.21.15.55:0/1302575284 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e50157600 con 0x7f8e500aee40 2023-08-25T04:03:08.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7fd0537fe640 1 --2- 172.21.15.55:0/2503177246 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd0580656b0 0x7fd058067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7fd0537fe640 1 -- 172.21.15.55:0/2503177246 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd05c082f40 con 0x7fd06c0abdb0 2023-08-25T04:03:08.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7effa04cb640 1 -- start start 2023-08-25T04:03:08.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7fa80f59e640 1 Processor -- start 2023-08-25T04:03:08.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7fd06a7fc640 1 --2- 172.21.15.55:0/2503177246 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd0580656b0 0x7fd058067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7fa80f59e640 1 -- start start 2023-08-25T04:03:08.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7f8e553d5640 1 -- 172.21.15.55:0/1302575284 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5004dbe0 con 0x7f8e500aee40 2023-08-25T04:03:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7f0fff7fe640 1 --2- 172.21.15.55:0/1765158965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff8048310 0x7f0ff80eb7a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0097f0 tx=0x7f0fec01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72bad2b0c3d33818 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7f0ffeffd640 1 -- 172.21.15.55:0/1765158965 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec0ab470 con 0x7f0ff8048310 2023-08-25T04:03:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7f0ffeffd640 1 -- 172.21.15.55:0/1765158965 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec0ab5d0 con 0x7f0ff8048310 2023-08-25T04:03:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7f0ffeffd640 1 -- 172.21.15.55:0/1765158965 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec0ab960 con 0x7f0ff8048310 2023-08-25T04:03:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.067+0000 7fd06a7fc640 1 --2- 172.21.15.55:0/2503177246 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd0580656b0 0x7fd058067b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0c8320 tx=0x7fd064009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7f8e377fe640 1 -- 172.21.15.55:0/1302575284 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8e440113f0 con 0x7f8e500aee40 2023-08-25T04:03:08.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7effa04cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff980c8cf0 0x7eff9815b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7eff9e267640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7eff98158120 0x7eff98070730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:49690/0 (socket says 172.21.15.55:49690) 2023-08-25T04:03:08.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7fd0537fe640 1 -- 172.21.15.55:0/2503177246 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd05c050b20 con 0x7fd06c0abdb0 2023-08-25T04:03:08.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7eff9e267640 1 -- 172.21.15.55:0/434533871 learned_addr learned my addr 172.21.15.55:0/434533871 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7f100532d640 1 -- 172.21.15.55:0/1765158965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff8048310 msgr2=0x7f0ff80eb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7f100532d640 1 --2- 172.21.15.55:0/1765158965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff8048310 0x7f0ff80eb7a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0097f0 tx=0x7f0fec01c450 comp rx=0 tx=0).stop 2023-08-25T04:03:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7f100532d640 1 -- 172.21.15.55:0/1765158965 shutdown_connections 2023-08-25T04:03:08.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7f100532d640 1 --2- 172.21.15.55:0/1765158965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff8048310 0x7f0ff80eb7a0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0097f0 tx=0x7f0fec01c450 comp rx=0 tx=0).stop 2023-08-25T04:03:08.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7f100532d640 1 --2- 172.21.15.55:0/1765158965 >> v2:172.21.15.110:3300/0 conn(0x7f0ff8033e20 0x7f0ff80eb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7f100532d640 1 -- 172.21.15.55:0/1765158965 >> 172.21.15.55:0/1765158965 conn(0x7f0ff8054c20 msgr2=0x7f0ff8055030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:08.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7eff9da66640 1 --2- 172.21.15.55:0/434533871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff980c8cf0 0x7eff9815b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7f100532d640 1 -- 172.21.15.55:0/1765158965 shutdown_connections 2023-08-25T04:03:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7fa80f59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa81015e560 0x7fa8100c8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7fa80f59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8100c8d90 0x7fa8100c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7fa80dd9b640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa810161df0 0x7fa8100ca9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:49704/0 (socket says 172.21.15.55:49704) 2023-08-25T04:03:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7fa80e59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa81015e560 0x7fa8100c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7fa80e59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa81015e560 0x7fa8100c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:46948/0 (socket says 172.21.15.55:46948) 2023-08-25T04:03:08.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7fa80dd9b640 1 -- 172.21.15.55:0/2165932613 learned_addr learned my addr 172.21.15.55:0/2165932613 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:08.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7fa80f59e640 1 -- 172.21.15.55:0/2165932613 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa810164e20 con 0x7fa810161df0 2023-08-25T04:03:08.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7fa80f59e640 1 -- 172.21.15.55:0/2165932613 --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8100c9510 con 0x7fa8100c8d90 2023-08-25T04:03:08.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7fa80f59e640 1 -- 172.21.15.55:0/2165932613 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8100c9230 con 0x7fa81015e560 2023-08-25T04:03:08.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7fa80ed9d640 1 --2- 172.21.15.55:0/2165932613 >> v2:172.21.15.55:3300/0 conn(0x7fa8100c8d90 0x7fa8100c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7fa80d59a640 1 -- 172.21.15.55:0/2165932613 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576299649 0 0) 0x7fa810164e20 con 0x7fa810161df0 2023-08-25T04:03:08.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7fa80d59a640 1 -- 172.21.15.55:0/2165932613 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f8003530 con 0x7fa810161df0 2023-08-25T04:03:08.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7fa80e59c640 1 -- 172.21.15.55:0/2165932613 >> v2:172.21.15.55:3300/0 conn(0x7fa8100c8d90 msgr2=0x7fa8100c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:08.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7fa80e59c640 1 --2- 172.21.15.55:0/2165932613 >> v2:172.21.15.55:3300/0 conn(0x7fa8100c8d90 0x7fa8100c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7fa80e59c640 1 -- 172.21.15.55:0/2165932613 >> v1:172.21.15.110:6789/0 conn(0x7fa810161df0 legacy=0x7fa8100ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7fa80e59c640 1 -- 172.21.15.55:0/2165932613 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8101647d0 con 0x7fa81015e560 2023-08-25T04:03:08.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7fa80d59a640 1 -- 172.21.15.55:0/2165932613 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4036264833 0 0) 0x7fa7f8003530 con 0x7fa810161df0 2023-08-25T04:03:08.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7f8e377fe640 1 --2- 172.21.15.55:0/1302575284 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8e3c065750 0x7f8e3c067c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7f8e377fe640 1 -- 172.21.15.55:0/1302575284 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8e44082cc0 con 0x7f8e500aee40 2023-08-25T04:03:08.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7f8e4e7fc640 1 --2- 172.21.15.55:0/1302575284 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8e3c065750 0x7f8e3c067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7f100532d640 1 -- 172.21.15.55:0/1765158965 wait complete. 2023-08-25T04:03:08.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.071+0000 7effa04cb640 1 --2- 172.21.15.55:0/434533871 >> v2:172.21.15.110:3300/0 conn(0x7eff98069900 0x7eff98069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7f8e4e7fc640 1 --2- 172.21.15.55:0/1302575284 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8e3c065750 0x7f8e3c067c10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8e48001950 tx=0x7f8e480018e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7eff9ea68640 1 --2- 172.21.15.55:0/434533871 >> v2:172.21.15.110:3300/0 conn(0x7eff98069900 0x7eff98069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7effa04cb640 1 -- 172.21.15.55:0/434533871 --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9806fce0 con 0x7eff98158120 2023-08-25T04:03:08.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7effa04cb640 1 -- 172.21.15.55:0/434533871 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9815bb30 con 0x7eff98069900 2023-08-25T04:03:08.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7effa04cb640 1 -- 172.21.15.55:0/434533871 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9806a2d0 con 0x7eff980c8cf0 2023-08-25T04:03:08.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7f042b9ac640 1 Processor -- start 2023-08-25T04:03:08.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7eff9d265640 1 -- 172.21.15.55:0/434533871 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777490982 0 0) 0x7eff9806fce0 con 0x7eff98158120 2023-08-25T04:03:08.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7eff9da66640 1 -- 172.21.15.55:0/434533871 >> v2:172.21.15.110:3300/0 conn(0x7eff98069900 msgr2=0x7eff98069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:08.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7eff9da66640 1 --2- 172.21.15.55:0/434533871 >> v2:172.21.15.110:3300/0 conn(0x7eff98069900 0x7eff98069d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7eff9da66640 1 -- 172.21.15.55:0/434533871 >> v1:172.21.15.110:6789/0 conn(0x7eff98158120 legacy=0x7eff98070730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7eff9da66640 1 -- 172.21.15.55:0/434533871 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff980702a0 con 0x7eff980c8cf0 2023-08-25T04:03:08.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7f042b9ac640 1 -- start start 2023-08-25T04:03:08.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7f2e5e66d640 1 Processor -- start 2023-08-25T04:03:08.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7f2e5e66d640 1 -- start start 2023-08-25T04:03:08.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7f100532d640 1 Processor -- start 2023-08-25T04:03:08.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7fa80e59c640 1 --2- 172.21.15.55:0/2165932613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa81015e560 0x7fa8100c8850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa8040097c0 tx=0x7fa80401c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f31ee29314f8d27 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7f100532d640 1 -- start start 2023-08-25T04:03:08.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7fc24eca1640 1 Processor -- start 2023-08-25T04:03:08.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7fa80d59a640 1 -- 172.21.15.55:0/2165932613 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa800001680 con 0x7fa81015e560 2023-08-25T04:03:08.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7f042b9ac640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f041c054a30 0x7f041c0ec270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7fa80d59a640 1 -- 172.21.15.55:0/2165932613 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8040a7050 con 0x7fa81015e560 2023-08-25T04:03:08.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7f042b9ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f041c008ca0 0x7f041c051890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7f042b9ac640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c0364a0 con 0x7f041c038b40 2023-08-25T04:03:08.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7f042b9ac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041c0533c0 con 0x7f041c008ca0 2023-08-25T04:03:08.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7f042b9ac640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041c0536a0 con 0x7f041c054a30 2023-08-25T04:03:08.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7fa80d59a640 1 -- 172.21.15.55:0/2165932613 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa800001680 con 0x7fa81015e560 2023-08-25T04:03:08.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.075+0000 7fc24eca1640 1 -- start start 2023-08-25T04:03:08.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e5e66d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e50033d10 0x7f2e500eb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f8e377fe640 1 -- 172.21.15.55:0/1302575284 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8e440508a0 con 0x7f8e500aee40 2023-08-25T04:03:08.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f0429f49640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f041c008ca0 0x7f041c051890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f0428f47640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f041c054a30 0x7f041c0ec270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f0429f49640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f041c008ca0 0x7f041c051890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35702/0 (socket says 172.21.15.55:35702) 2023-08-25T04:03:08.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f0429f49640 1 -- 172.21.15.55:0/966666976 learned_addr learned my addr 172.21.15.55:0/966666976 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:08.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e5e66d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e500ebda0 con 0x7f2e50048200 2023-08-25T04:03:08.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e5e66d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e500ec020 con 0x7f2e50047bd0 2023-08-25T04:03:08.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e5e66d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5004f200 con 0x7f2e50033d10 2023-08-25T04:03:08.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7fa80f59e640 1 -- 172.21.15.55:0/2165932613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa81015e560 msgr2=0x7fa8100c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7fa80f59e640 1 --2- 172.21.15.55:0/2165932613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa81015e560 0x7fa8100c8850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa8040097c0 tx=0x7fa80401c390 comp rx=0 tx=0).stop 2023-08-25T04:03:08.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e57fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e50033d10 0x7f2e500eb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e57fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e50033d10 0x7f2e500eb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35712/0 (socket says 172.21.15.55:35712) 2023-08-25T04:03:08.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e57fff640 1 -- 172.21.15.55:0/1366183947 learned_addr learned my addr 172.21.15.55:0/1366183947 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:08.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f041bfff640 1 -- 172.21.15.55:0/966666976 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261825473 0 0) 0x7f041c0364a0 con 0x7f041c038b40 2023-08-25T04:03:08.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f041bfff640 1 -- 172.21.15.55:0/966666976 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0410003530 con 0x7f041c038b40 2023-08-25T04:03:08.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7fa80f59e640 1 -- 172.21.15.55:0/2165932613 shutdown_connections 2023-08-25T04:03:08.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7fa80f59e640 1 --2- 172.21.15.55:0/2165932613 >> v2:172.21.15.55:3300/0 conn(0x7fa8100c8d90 0x7fa8100c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7fa80f59e640 1 --2- 172.21.15.55:0/2165932613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa81015e560 0x7fa8100c8850 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7fa80f59e640 1 -- 172.21.15.55:0/2165932613 >> 172.21.15.55:0/2165932613 conn(0x7fa810069f00 msgr2=0x7fa8100afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:08.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e56ffd640 1 -- 172.21.15.55:0/1366183947 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053298603 0 0) 0x7f2e500ec020 con 0x7f2e50047bd0 2023-08-25T04:03:08.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e56ffd640 1 -- 172.21.15.55:0/1366183947 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e48003530 con 0x7f2e50047bd0 2023-08-25T04:03:08.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f100532d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff8033e20 0x7f0ff80d7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f100532d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff8047ce0 0x7f0ff80e3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f100532d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ff8038270 0x7f0ff80e4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f041bfff640 1 -- 172.21.15.55:0/966666976 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3249678740 0 0) 0x7f0410003530 con 0x7f041c038b40 2023-08-25T04:03:08.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f041bfff640 1 -- 172.21.15.55:0/966666976 >> v2:172.21.15.110:3300/0 conn(0x7f041c054a30 msgr2=0x7f041c0ec270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:08.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f041bfff640 1 --2- 172.21.15.55:0/966666976 >> v2:172.21.15.110:3300/0 conn(0x7f041c054a30 0x7f041c0ec270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f041bfff640 1 -- 172.21.15.55:0/966666976 >> v2:172.21.15.55:3300/0 conn(0x7f041c008ca0 msgr2=0x7f041c051890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:08.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f041bfff640 1 --2- 172.21.15.55:0/966666976 >> v2:172.21.15.55:3300/0 conn(0x7f041c008ca0 0x7f041c051890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f041bfff640 1 -- 172.21.15.55:0/966666976 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c0544a0 con 0x7f041c038b40 2023-08-25T04:03:08.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f041bfff640 1 -- 172.21.15.55:0/966666976 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f0420001680 con 0x7f041c038b40 2023-08-25T04:03:08.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f041bfff640 1 -- 172.21.15.55:0/966666976 >> v1:172.21.15.110:6789/0 conn(0x7f041c038b40 legacy=0x7f041c0ebb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f041bfff640 1 --2- 172.21.15.55:0/966666976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0410003980 0x7f0410003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f041bfff640 1 --2- 172.21.15.55:0/966666976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04100047d0 0x7f0410004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f041bfff640 1 --2- 172.21.15.55:0/966666976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0410005190 0x7f041000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f041bfff640 1 -- 172.21.15.55:0/966666976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0533c0 con 0x7f04100047d0 2023-08-25T04:03:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f041bfff640 1 -- 172.21.15.55:0/966666976 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0536a0 con 0x7f0410003980 2023-08-25T04:03:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f041bfff640 1 -- 172.21.15.55:0/966666976 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041000bf20 con 0x7f0410005190 2023-08-25T04:03:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f0429f49640 1 --2- 172.21.15.55:0/966666976 >> v2:172.21.15.55:3300/0 conn(0x7f041c008ca0 0x7f041c051890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f0428f47640 1 --2- 172.21.15.55:0/966666976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04100047d0 0x7f0410004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e56ffd640 1 -- 172.21.15.55:0/1366183947 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 653533736 0 0) 0x7f2e48003530 con 0x7f2e50047bd0 2023-08-25T04:03:08.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e56ffd640 1 -- 172.21.15.55:0/1366183947 >> v2:172.21.15.55:3300/0 conn(0x7f2e50033d10 msgr2=0x7f2e500eb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:08.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e56ffd640 1 --2- 172.21.15.55:0/1366183947 >> v2:172.21.15.55:3300/0 conn(0x7f2e50033d10 0x7f2e500eb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e56ffd640 1 -- 172.21.15.55:0/1366183947 >> v1:172.21.15.55:6789/0 conn(0x7f2e50048200 legacy=0x7f2e500eb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:08.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e56ffd640 1 -- 172.21.15.55:0/1366183947 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5004f4e0 con 0x7f2e50047bd0 2023-08-25T04:03:08.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e56ffd640 1 -- 172.21.15.55:0/1366183947 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f2e5804e430 con 0x7f2e50047bd0 2023-08-25T04:03:08.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e56ffd640 1 -- 172.21.15.55:0/1366183947 >> v1:172.21.15.110:6789/0 conn(0x7f2e50047bd0 legacy=0x7f2e50052ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e56ffd640 1 --2- 172.21.15.55:0/1366183947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e48003980 0x7f2e48003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e56ffd640 1 --2- 172.21.15.55:0/1366183947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e48004300 0x7f2e480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e56ffd640 1 --2- 172.21.15.55:0/1366183947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e48004f80 0x7f2e4800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e56ffd640 1 -- 172.21.15.55:0/1366183947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5004f200 con 0x7f2e48004300 2023-08-25T04:03:08.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e56ffd640 1 -- 172.21.15.55:0/1366183947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4800bed0 con 0x7f2e48004f80 2023-08-25T04:03:08.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e56ffd640 1 -- 172.21.15.55:0/1366183947 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4800c090 con 0x7f2e48003980 2023-08-25T04:03:08.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7fc24eca1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc240054510 0x7fc2400ede50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7fc24eca1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2400577a0 con 0x7fc2400e6890 2023-08-25T04:03:08.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7fc24eca1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc240057470 con 0x7fc24003ed00 2023-08-25T04:03:08.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7fc24eca1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24003f160 con 0x7fc240054510 2023-08-25T04:03:08.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7eff9da66640 1 --2- 172.21.15.55:0/434533871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff980c8cf0 0x7eff9815b5f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff9400dbe0 tx=0x7eff94020760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29b9b63617ed7f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f0429f49640 1 --2- 172.21.15.55:0/966666976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0410005190 0x7f041000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7fc24dc9f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc2400e6890 0x7fc240006cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50490/0 (socket says 172.21.15.55:50490) 2023-08-25T04:03:08.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7fc24dc9f640 1 -- 172.21.15.55:0/3760831664 learned_addr learned my addr 172.21.15.55:0/3760831664 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:08.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f0429748640 1 --2- 172.21.15.55:0/966666976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0410003980 0x7f0410003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f2e5cc0a640 1 --2- 172.21.15.55:0/1366183947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e48004f80 0x7f2e4800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7eff9d265640 1 -- 172.21.15.55:0/434533871 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9400d0d0 con 0x7eff980c8cf0 2023-08-25T04:03:08.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7eff9d265640 1 -- 172.21.15.55:0/434533871 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9400d230 con 0x7eff980c8cf0 2023-08-25T04:03:08.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7eff9d265640 1 -- 172.21.15.55:0/434533871 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff940a9850 con 0x7eff980c8cf0 2023-08-25T04:03:08.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f0fff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff8047ce0 0x7f0ff80e3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f0fff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff8047ce0 0x7f0ff80e3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35736/0 (socket says 172.21.15.55:35736) 2023-08-25T04:03:08.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f0fff7fe640 1 -- 172.21.15.55:0/2020018568 learned_addr learned my addr 172.21.15.55:0/2020018568 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:08.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7fc24e4a0640 1 --2- 172.21.15.55:0/3760831664 >> v2:172.21.15.55:3300/0 conn(0x7fc240054510 0x7fc2400ede50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f1004b2c640 1 --2- 172.21.15.55:0/2020018568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ff8038270 0x7f0ff80e4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f100532d640 1 -- 172.21.15.55:0/2020018568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8183ea0 con 0x7f0ff8047ce0 2023-08-25T04:03:08.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f100532d640 1 -- 172.21.15.55:0/2020018568 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80d8380 con 0x7f0ff8038270 2023-08-25T04:03:08.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f100532d640 1 -- 172.21.15.55:0/2020018568 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8183290 con 0x7f0ff8033e20 2023-08-25T04:03:08.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7f0ffffff640 1 --2- 172.21.15.55:0/2020018568 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff8033e20 0x7f0ff80d7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.079+0000 7fc24cc9d640 1 -- 172.21.15.55:0/3760831664 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173995947 0 0) 0x7fc240057470 con 0x7fc24003ed00 2023-08-25T04:03:08.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7fc24cc9d640 1 -- 172.21.15.55:0/3760831664 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc234003530 con 0x7fc24003ed00 2023-08-25T04:03:08.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7fa80f59e640 1 -- 172.21.15.55:0/2165932613 shutdown_connections 2023-08-25T04:03:08.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f0fff7fe640 1 -- 172.21.15.55:0/2020018568 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff8033e20 msgr2=0x7f0ff80d7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f0fff7fe640 1 --2- 172.21.15.55:0/2020018568 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff8033e20 0x7f0ff80d7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f0fff7fe640 1 -- 172.21.15.55:0/2020018568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ff8038270 msgr2=0x7f0ff80e4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f0fff7fe640 1 --2- 172.21.15.55:0/2020018568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ff8038270 0x7f0ff80e4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f0fff7fe640 1 -- 172.21.15.55:0/2020018568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100004e150 con 0x7f0ff8047ce0 2023-08-25T04:03:08.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f0fff7fe640 1 --2- 172.21.15.55:0/2020018568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff8047ce0 0x7f0ff80e3c10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0ad040 tx=0x7f0fec01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f0ffcff9640 1 -- 172.21.15.55:0/2020018568 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec0ab470 con 0x7f0ff8047ce0 2023-08-25T04:03:08.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f0ffcff9640 1 -- 172.21.15.55:0/2020018568 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec0b5810 con 0x7f0ff8047ce0 2023-08-25T04:03:08.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f0ffcff9640 1 -- 172.21.15.55:0/2020018568 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec0b5bc0 con 0x7f0ff8047ce0 2023-08-25T04:03:08.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f100532d640 1 -- 172.21.15.55:0/2020018568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fec009420 con 0x7f0ff8047ce0 2023-08-25T04:03:08.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f100532d640 1 -- 172.21.15.55:0/2020018568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff8183850 con 0x7f0ff8047ce0 2023-08-25T04:03:08.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7fa80f59e640 1 -- 172.21.15.55:0/2165932613 wait complete. 2023-08-25T04:03:08.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7fa80f59e640 1 Processor -- start 2023-08-25T04:03:08.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f2e57fff640 1 --2- 172.21.15.55:0/1366183947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e48003980 0x7f2e48003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f0429f49640 1 -- 172.21.15.55:0/966666976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0410003980 msgr2=0x7f0410003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:08.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f0429f49640 1 --2- 172.21.15.55:0/966666976 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0410003980 0x7f0410003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f0429f49640 1 -- 172.21.15.55:0/966666976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04100047d0 msgr2=0x7f0410004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:08.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f0429f49640 1 --2- 172.21.15.55:0/966666976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04100047d0 0x7f0410004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f0429f49640 1 -- 172.21.15.55:0/966666976 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c0544a0 con 0x7f0410005190 2023-08-25T04:03:08.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f0429f49640 1 -- 172.21.15.55:0/966666976 reap_dead start 2023-08-25T04:03:08.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7fc24e4a0640 1 -- 172.21.15.55:0/3760831664 >> v1:172.21.15.110:6789/0 conn(0x7fc24003ed00 legacy=0x7fc240053e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7fc24e4a0640 1 -- 172.21.15.55:0/3760831664 >> v1:172.21.15.55:6789/0 conn(0x7fc2400e6890 legacy=0x7fc240006cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7fc24e4a0640 1 -- 172.21.15.55:0/3760831664 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc240007520 con 0x7fc240054510 2023-08-25T04:03:08.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7effa04cb640 1 -- 172.21.15.55:0/434533871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff980c8cf0 msgr2=0x7eff9815b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7effa04cb640 1 --2- 172.21.15.55:0/434533871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff980c8cf0 0x7eff9815b5f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff9400dbe0 tx=0x7eff94020760 comp rx=0 tx=0).stop 2023-08-25T04:03:08.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f2e5cc0a640 1 -- 172.21.15.55:0/1366183947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e48003980 msgr2=0x7f2e48003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:08.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f2e5cc0a640 1 --2- 172.21.15.55:0/1366183947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e48003980 0x7f2e48003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f2e5cc0a640 1 -- 172.21.15.55:0/1366183947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e48004300 msgr2=0x7f2e480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:08.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f2e5cc0a640 1 --2- 172.21.15.55:0/1366183947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e48004300 0x7f2e480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7f2e5cc0a640 1 -- 172.21.15.55:0/1366183947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5004f4e0 con 0x7f2e48004f80 2023-08-25T04:03:08.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f2e5cc0a640 1 -- 172.21.15.55:0/1366183947 reap_dead start 2023-08-25T04:03:08.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fc24e4a0640 1 --2- 172.21.15.55:0/3760831664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc240054510 0x7fc2400ede50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc248000b70 tx=0x7fc248096110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ee86ae83e104d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7effa04cb640 1 -- 172.21.15.55:0/434533871 shutdown_connections 2023-08-25T04:03:08.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7effa04cb640 1 --2- 172.21.15.55:0/434533871 >> v2:172.21.15.110:3300/0 conn(0x7eff98069900 0x7eff98069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7effa04cb640 1 --2- 172.21.15.55:0/434533871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff980c8cf0 0x7eff9815b5f0 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff9400dbe0 tx=0x7eff94020760 comp rx=0 tx=0).stop 2023-08-25T04:03:08.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7effa04cb640 1 -- 172.21.15.55:0/434533871 >> 172.21.15.55:0/434533871 conn(0x7eff980ce6a0 msgr2=0x7eff980ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:08.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.083+0000 7fa80f59e640 1 -- start start 2023-08-25T04:03:08.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fa80f59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8100c8d90 0x7fa8101559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7effa04cb640 1 -- 172.21.15.55:0/434533871 shutdown_connections 2023-08-25T04:03:08.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f2e5cc0a640 1 --2- 172.21.15.55:0/1366183947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e48004f80 0x7f2e4800b990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2e580687f0 tx=0x7f2e58099050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88d2c860e979e6ee server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7effa04cb640 1 -- 172.21.15.55:0/434533871 wait complete. 2023-08-25T04:03:08.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fa80f59e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa81015e560 0x7fa8100c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f0429f49640 1 --2- 172.21.15.55:0/966666976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0410005190 0x7f041000b990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f042404f520 tx=0x7f0424096670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ed087233d6eac6f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fa80f59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa81015d950 0x7fa81015fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fa80e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8100c8d90 0x7fa8101559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fa80e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8100c8d90 0x7fa8101559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35758/0 (socket says 172.21.15.55:35758) 2023-08-25T04:03:08.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fa80dd9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa81015e560 0x7fa8100c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fa80dd9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa81015e560 0x7fa8100c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:38812/0 (socket says 172.21.15.55:38812) 2023-08-25T04:03:08.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f2e56ffd640 1 -- 172.21.15.55:0/1366183947 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58122b30 con 0x7f2e48004f80 2023-08-25T04:03:08.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f2e56ffd640 1 -- 172.21.15.55:0/1366183947 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e58122c90 con 0x7f2e48004f80 2023-08-25T04:03:08.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f2e56ffd640 1 -- 172.21.15.55:0/1366183947 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5812a440 con 0x7f2e48004f80 2023-08-25T04:03:08.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fc24cc9d640 1 -- 172.21.15.55:0/3760831664 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248126440 con 0x7fc240054510 2023-08-25T04:03:08.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fc24cc9d640 1 -- 172.21.15.55:0/3760831664 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2481265a0 con 0x7fc240054510 2023-08-25T04:03:08.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fc24cc9d640 1 -- 172.21.15.55:0/3760831664 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2481269d0 con 0x7fc240054510 2023-08-25T04:03:08.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f100532d640 1 -- 172.21.15.55:0/2020018568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe0005260 con 0x7f0ff8047ce0 2023-08-25T04:03:08.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f041bfff640 1 -- 172.21.15.55:0/966666976 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0424125640 con 0x7f0410005190 2023-08-25T04:03:08.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f041bfff640 1 -- 172.21.15.55:0/966666976 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0424121050 con 0x7f0410005190 2023-08-25T04:03:08.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f041bfff640 1 -- 172.21.15.55:0/966666976 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04241259a0 con 0x7f0410005190 2023-08-25T04:03:08.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f042b9ac640 1 -- 172.21.15.55:0/966666976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0410005190 msgr2=0x7f041000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fa80f59e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8100c3b20 con 0x7fa8100c8d90 2023-08-25T04:03:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fa80f59e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8100c3690 con 0x7fa81015e560 2023-08-25T04:03:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fa80f59e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8100c2a80 con 0x7fa81015d950 2023-08-25T04:03:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fa80e59c640 1 -- 172.21.15.55:0/1260436912 learned_addr learned my addr 172.21.15.55:0/1260436912 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fa80ed9d640 1 --2- 172.21.15.55:0/1260436912 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa81015d950 0x7fa81015fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fa80dd9b640 1 -- 172.21.15.55:0/1260436912 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa81015d950 msgr2=0x7fa81015fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fa80dd9b640 1 --2- 172.21.15.55:0/1260436912 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa81015d950 0x7fa81015fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fa80dd9b640 1 -- 172.21.15.55:0/1260436912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8100c8d90 msgr2=0x7fa8101559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fa80dd9b640 1 --2- 172.21.15.55:0/1260436912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8100c8d90 0x7fa8101559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fa80dd9b640 1 -- 172.21.15.55:0/1260436912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa804009420 con 0x7fa81015e560 2023-08-25T04:03:08.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f2e5e66d640 1 -- 172.21.15.55:0/1366183947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e48004f80 msgr2=0x7f2e4800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f2e5e66d640 1 --2- 172.21.15.55:0/1366183947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e48004f80 0x7f2e4800b990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2e580687f0 tx=0x7f2e58099050 comp rx=0 tx=0).stop 2023-08-25T04:03:08.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fc24eca1640 1 -- 172.21.15.55:0/3760831664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc240054510 msgr2=0x7fc2400ede50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fc24eca1640 1 --2- 172.21.15.55:0/3760831664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc240054510 0x7fc2400ede50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc248000b70 tx=0x7fc248096110 comp rx=0 tx=0).stop 2023-08-25T04:03:08.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fc24eca1640 1 -- 172.21.15.55:0/3760831664 shutdown_connections 2023-08-25T04:03:08.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fc24eca1640 1 --2- 172.21.15.55:0/3760831664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc240054510 0x7fc2400ede50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f042b9ac640 1 --2- 172.21.15.55:0/966666976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0410005190 0x7f041000b990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f042404f520 tx=0x7f0424096670 comp rx=0 tx=0).stop 2023-08-25T04:03:08.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fc24eca1640 1 -- 172.21.15.55:0/3760831664 >> 172.21.15.55:0/3760831664 conn(0x7fc240059130 msgr2=0x7fc240059540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:08.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f042b9ac640 1 -- 172.21.15.55:0/966666976 shutdown_connections 2023-08-25T04:03:08.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f042b9ac640 1 --2- 172.21.15.55:0/966666976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0410005190 0x7f041000b990 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f042b9ac640 1 -- 172.21.15.55:0/966666976 >> 172.21.15.55:0/966666976 conn(0x7f041c0538e0 msgr2=0x7f041c053cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:08.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7fa80e59c640 1 --2- 172.21.15.55:0/1260436912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8100c8d90 0x7fa8101559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:08.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7f042b9ac640 1 -- 172.21.15.55:0/966666976 shutdown_connections 2023-08-25T04:03:08.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7f042b9ac640 1 -- 172.21.15.55:0/966666976 wait complete. 2023-08-25T04:03:08.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7fa80dd9b640 1 --2- 172.21.15.55:0/1260436912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa81015e560 0x7fa8100c77c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa80000caf0 tx=0x7fa800001d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f2e5e66d640 1 -- 172.21.15.55:0/1366183947 shutdown_connections 2023-08-25T04:03:08.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f2e5e66d640 1 --2- 172.21.15.55:0/1366183947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e48004f80 0x7f2e4800b990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.087+0000 7f2e5e66d640 1 -- 172.21.15.55:0/1366183947 >> 172.21.15.55:0/1366183947 conn(0x7f2e50054b10 msgr2=0x7f2e50054f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:08.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7fc24eca1640 1 -- 172.21.15.55:0/3760831664 shutdown_connections 2023-08-25T04:03:08.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7f0ffcff9640 1 -- 172.21.15.55:0/2020018568 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0fec0b5d20 con 0x7f0ff8047ce0 2023-08-25T04:03:08.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7fc24eca1640 1 -- 172.21.15.55:0/3760831664 wait complete. 2023-08-25T04:03:08.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7fa7feffd640 1 -- 172.21.15.55:0/1260436912 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa800005cf0 con 0x7fa81015e560 2023-08-25T04:03:08.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7fa7feffd640 1 -- 172.21.15.55:0/1260436912 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa800005e50 con 0x7fa81015e560 2023-08-25T04:03:08.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7fa7feffd640 1 -- 172.21.15.55:0/1260436912 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8000072b0 con 0x7fa81015e560 2023-08-25T04:03:08.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7fa80f59e640 1 -- 172.21.15.55:0/1260436912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8100c1b70 con 0x7fa81015e560 2023-08-25T04:03:08.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7fa80f59e640 1 -- 172.21.15.55:0/1260436912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8100c3040 con 0x7fa81015e560 2023-08-25T04:03:08.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7effa04cb640 1 Processor -- start 2023-08-25T04:03:08.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7effa04cb640 1 -- start start 2023-08-25T04:03:08.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7effa04cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff98069900 0x7eff980b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7effa04cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff98158120 0x7eff98155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7f042b9ac640 1 Processor -- start 2023-08-25T04:03:08.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7f2e5e66d640 1 -- 172.21.15.55:0/1366183947 shutdown_connections 2023-08-25T04:03:08.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7fc24eca1640 1 Processor -- start 2023-08-25T04:03:08.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7f0ffcff9640 1 --2- 172.21.15.55:0/2020018568 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0fe4065750 0x7f0fe4067c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7f0ffcff9640 1 -- 172.21.15.55:0/2020018568 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0fec11d890 con 0x7f0ff8047ce0 2023-08-25T04:03:08.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7f0ffffff640 1 --2- 172.21.15.55:0/2020018568 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0fe4065750 0x7f0fe4067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7f042b9ac640 1 -- start start 2023-08-25T04:03:08.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7f2e5e66d640 1 -- 172.21.15.55:0/1366183947 wait complete. 2023-08-25T04:03:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7f2e5e66d640 1 Processor -- start 2023-08-25T04:03:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7fc24eca1640 1 -- start start 2023-08-25T04:03:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7fc24eca1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc24003ed00 0x7fc24004bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7fc24dc9f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc24003ed00 0x7fc24004bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7fc24dc9f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc24003ed00 0x7fc24004bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35782/0 (socket says 172.21.15.55:35782) 2023-08-25T04:03:08.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7fc24dc9f640 1 -- 172.21.15.55:0/4147192470 learned_addr learned my addr 172.21.15.55:0/4147192470 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:08.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7fc24eca1640 1 --2- 172.21.15.55:0/4147192470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc240054510 0x7fc2400dae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7fc24eca1640 1 --2- 172.21.15.55:0/4147192470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2400e6890 0x7fc2400dcf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7effa04cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff9806cae0 0x7eff980c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7effa04cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff980c6a90 con 0x7eff9806cae0 2023-08-25T04:03:08.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7effa04cb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff980c6180 con 0x7eff98069900 2023-08-25T04:03:08.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7effa04cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff980b3dd0 con 0x7eff98158120 2023-08-25T04:03:08.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7eff9da66640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff98158120 0x7eff98155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7eff9ea68640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff9806cae0 0x7eff980c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7eff9da66640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff98158120 0x7eff98155d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:47008/0 (socket says 172.21.15.55:47008) 2023-08-25T04:03:08.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7fc24d49e640 1 --2- 172.21.15.55:0/4147192470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc240054510 0x7fc2400dae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7eff9ea68640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff9806cae0 0x7eff980c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35770/0 (socket says 172.21.15.55:35770) 2023-08-25T04:03:08.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7eff9da66640 1 -- 172.21.15.55:0/3916115530 learned_addr learned my addr 172.21.15.55:0/3916115530 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:08.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7eff9e267640 1 --2- 172.21.15.55:0/3916115530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff98069900 0x7eff980b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7eff9da66640 1 -- 172.21.15.55:0/3916115530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff98069900 msgr2=0x7eff980b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7eff9da66640 1 --2- 172.21.15.55:0/3916115530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff98069900 0x7eff980b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7eff9da66640 1 -- 172.21.15.55:0/3916115530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff9806cae0 msgr2=0x7eff980c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7eff9da66640 1 --2- 172.21.15.55:0/3916115530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff9806cae0 0x7eff980c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.091+0000 7eff9da66640 1 -- 172.21.15.55:0/3916115530 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9400d8c0 con 0x7eff98158120 2023-08-25T04:03:08.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7eff9da66640 1 --2- 172.21.15.55:0/3916115530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff98158120 0x7eff98155d10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7eff9401ee10 tx=0x7eff9401d500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7eff8effd640 1 -- 172.21.15.55:0/3916115530 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9400b070 con 0x7eff98158120 2023-08-25T04:03:08.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7eff8effd640 1 -- 172.21.15.55:0/3916115530 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff940ba460 con 0x7eff98158120 2023-08-25T04:03:08.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7eff8effd640 1 -- 172.21.15.55:0/3916115530 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9400d0d0 con 0x7eff98158120 2023-08-25T04:03:08.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7effa04cb640 1 -- 172.21.15.55:0/3916115530 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff980c63d0 con 0x7eff98158120 2023-08-25T04:03:08.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7effa04cb640 1 -- 172.21.15.55:0/3916115530 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff980b3540 con 0x7eff98158120 2023-08-25T04:03:08.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7fa7feffd640 1 -- 172.21.15.55:0/1260436912 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa800007410 con 0x7fa81015e560 2023-08-25T04:03:08.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7fa7feffd640 1 --2- 172.21.15.55:0/1260436912 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa7f0065750 0x7fa7f0067c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7fa7feffd640 1 -- 172.21.15.55:0/1260436912 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa800082740 con 0x7fa81015e560 2023-08-25T04:03:08.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7fa80f59e640 1 -- 172.21.15.55:0/1260436912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa810073e50 con 0x7fa81015e560 2023-08-25T04:03:08.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7fc24e4a0640 1 --2- 172.21.15.55:0/4147192470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2400e6890 0x7fc2400dcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7fc24eca1640 1 -- 172.21.15.55:0/4147192470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400db380 con 0x7fc24003ed00 2023-08-25T04:03:08.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7fc24eca1640 1 -- 172.21.15.55:0/4147192470 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400db810 con 0x7fc240054510 2023-08-25T04:03:08.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7fc24eca1640 1 -- 172.21.15.55:0/4147192470 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400e2d80 con 0x7fc2400e6890 2023-08-25T04:03:08.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7f0ffffff640 1 --2- 172.21.15.55:0/2020018568 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0fe4065750 0x7f0fe4067c10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f100002c750 tx=0x7f100008b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7fa80e59c640 1 --2- 172.21.15.55:0/1260436912 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa7f0065750 0x7fa7f0067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7f2e5e66d640 1 -- start start 2023-08-25T04:03:08.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.095+0000 7effa04cb640 1 -- 172.21.15.55:0/3916115530 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff80005260 con 0x7eff98158120 2023-08-25T04:03:08.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7fc24dc9f640 1 -- 172.21.15.55:0/4147192470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2400e6890 msgr2=0x7fc2400dcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7fc24dc9f640 1 --2- 172.21.15.55:0/4147192470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2400e6890 0x7fc2400dcf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7fc24dc9f640 1 -- 172.21.15.55:0/4147192470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc240054510 msgr2=0x7fc2400dae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7fc24dc9f640 1 --2- 172.21.15.55:0/4147192470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc240054510 0x7fc2400dae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7fc24dc9f640 1 -- 172.21.15.55:0/4147192470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24804e150 con 0x7fc24003ed00 2023-08-25T04:03:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7eff8effd640 1 -- 172.21.15.55:0/3916115530 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7eff940b13f0 con 0x7eff98158120 2023-08-25T04:03:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7fa80e59c640 1 --2- 172.21.15.55:0/1260436912 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa7f0065750 0x7fa7f0067c10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa80401aa40 tx=0x7fa8040a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7fc24dc9f640 1 --2- 172.21.15.55:0/4147192470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc24003ed00 0x7fc24004bf30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc23800c400 tx=0x7fc23800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f2e5e66d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e48004f80 0x7f2e5004a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f2e5e66d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e50048b20 0x7f2e500daf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f2e5e66d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e500eb150 0x7f2e500eb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f2e5e66d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5004b520 con 0x7f2e50048b20 2023-08-25T04:03:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f2e5e66d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e500ebb10 con 0x7f2e500eb150 2023-08-25T04:03:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f2e5e66d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5004a5d0 con 0x7f2e48004f80 2023-08-25T04:03:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f2e57fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e48004f80 0x7f2e5004a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f2e57fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e48004f80 0x7f2e5004a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:47018/0 (socket says 172.21.15.55:47018) 2023-08-25T04:03:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f2e57fff640 1 -- 172.21.15.55:0/4116694511 learned_addr learned my addr 172.21.15.55:0/4116694511 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f2e577fe640 1 --2- 172.21.15.55:0/4116694511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e50048b20 0x7f2e500daf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f042b9ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0410005190 0x7f041c04c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f042b9ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f041c174d20 0x7f041c16e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f042b9ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f041c02f040 0x7f041c02f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f042b9ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c02fa00 con 0x7f041c174d20 2023-08-25T04:03:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f042b9ac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c02d830 con 0x7f041c02f040 2023-08-25T04:03:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f042b9ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c04c900 con 0x7f0410005190 2023-08-25T04:03:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f2e5cc0a640 1 --2- 172.21.15.55:0/4116694511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e500eb150 0x7f2e500eb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f2e57fff640 1 -- 172.21.15.55:0/4116694511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e500eb150 msgr2=0x7f2e500eb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f2e57fff640 1 --2- 172.21.15.55:0/4116694511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e500eb150 0x7f2e500eb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f2e57fff640 1 -- 172.21.15.55:0/4116694511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e50048b20 msgr2=0x7f2e500daf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f2e57fff640 1 --2- 172.21.15.55:0/4116694511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e50048b20 0x7f2e500daf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7eff8effd640 1 --2- 172.21.15.55:0/3916115530 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7eff7c0656b0 0x7eff7c067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7eff8effd640 1 -- 172.21.15.55:0/3916115530 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff9411cc90 con 0x7eff98158120 2023-08-25T04:03:08.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f2e57fff640 1 -- 172.21.15.55:0/4116694511 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5004a8a0 con 0x7f2e48004f80 2023-08-25T04:03:08.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f0429748640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0410005190 0x7f041c04c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f0429748640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0410005190 0x7f041c04c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:47030/0 (socket says 172.21.15.55:47030) 2023-08-25T04:03:08.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f0429748640 1 -- 172.21.15.55:0/595505688 learned_addr learned my addr 172.21.15.55:0/595505688 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:08.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f0428f47640 1 --2- 172.21.15.55:0/595505688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f041c174d20 0x7f041c16e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7eff9e267640 1 --2- 172.21.15.55:0/3916115530 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7eff7c0656b0 0x7eff7c067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f2e57fff640 1 --2- 172.21.15.55:0/4116694511 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e48004f80 0x7f2e5004a090 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0108c0 tx=0x7f2e4c010d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f0429f49640 1 --2- 172.21.15.55:0/595505688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f041c02f040 0x7f041c02f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f0428f47640 1 -- 172.21.15.55:0/595505688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0410005190 msgr2=0x7f041c04c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f0428f47640 1 --2- 172.21.15.55:0/595505688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0410005190 0x7f041c04c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f0428f47640 1 -- 172.21.15.55:0/595505688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f041c02f040 msgr2=0x7f041c02f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f0428f47640 1 --2- 172.21.15.55:0/595505688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f041c02f040 0x7f041c02f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f0428f47640 1 -- 172.21.15.55:0/595505688 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c04cbe0 con 0x7f041c174d20 2023-08-25T04:03:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f0429f49640 1 --2- 172.21.15.55:0/595505688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f041c02f040 0x7f041c02f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f0428f47640 1 --2- 172.21.15.55:0/595505688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f041c174d20 0x7f041c16e190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f041c0044b0 tx=0x7f0414011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7f0ffcff9640 1 -- 172.21.15.55:0/2020018568 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0fec0eb400 con 0x7f0ff8047ce0 2023-08-25T04:03:08.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7fc23e7fc640 1 -- 172.21.15.55:0/4147192470 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc238005cf0 con 0x7fc24003ed00 2023-08-25T04:03:08.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7fc23e7fc640 1 -- 172.21.15.55:0/4147192470 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc238005e50 con 0x7fc24003ed00 2023-08-25T04:03:08.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7fc23e7fc640 1 -- 172.21.15.55:0/4147192470 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2380072d0 con 0x7fc24003ed00 2023-08-25T04:03:08.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7fc24eca1640 1 -- 172.21.15.55:0/4147192470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2400e3060 con 0x7fc24003ed00 2023-08-25T04:03:08.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.099+0000 7eff9e267640 1 --2- 172.21.15.55:0/3916115530 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7eff7c0656b0 0x7eff7c067b70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7eff88005ed0 tx=0x7eff88000f20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.103+0000 7fc24eca1640 1 -- 172.21.15.55:0/4147192470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2400e3620 con 0x7fc24003ed00 2023-08-25T04:03:08.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.103+0000 7fa7feffd640 1 -- 172.21.15.55:0/1260436912 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa800050290 con 0x7fa81015e560 2023-08-25T04:03:08.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.103+0000 7f2e54ff9640 1 -- 172.21.15.55:0/4116694511 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c00e9c0 con 0x7f2e48004f80 2023-08-25T04:03:08.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.103+0000 7f2e54ff9640 1 -- 172.21.15.55:0/4116694511 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c00eb20 con 0x7f2e48004f80 2023-08-25T04:03:08.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.103+0000 7f2e54ff9640 1 -- 172.21.15.55:0/4116694511 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c00ee90 con 0x7f2e48004f80 2023-08-25T04:03:08.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.103+0000 7eff8effd640 1 -- 172.21.15.55:0/3916115530 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7eff940ea8a0 con 0x7eff98158120 2023-08-25T04:03:08.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.103+0000 7fc22bfff640 1 -- 172.21.15.55:0/4147192470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2400058f0 con 0x7fc24003ed00 2023-08-25T04:03:08.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.103+0000 7f2e5e66d640 1 -- 172.21.15.55:0/4116694511 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5004ab80 con 0x7f2e48004f80 2023-08-25T04:03:08.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.103+0000 7f2e5e66d640 1 -- 172.21.15.55:0/4116694511 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5004b140 con 0x7f2e48004f80 2023-08-25T04:03:08.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.107+0000 7f2e5e66d640 1 -- 172.21.15.55:0/4116694511 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e50005350 con 0x7f2e48004f80 2023-08-25T04:03:08.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.107+0000 7f2e54ff9640 1 -- 172.21.15.55:0/4116694511 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2e4c016460 con 0x7f2e48004f80 2023-08-25T04:03:08.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.107+0000 7fc23e7fc640 1 -- 172.21.15.55:0/4147192470 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc238007430 con 0x7fc24003ed00 2023-08-25T04:03:08.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.111+0000 7f2e54ff9640 1 --2- 172.21.15.55:0/4116694511 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2e3c065750 0x7f2e3c067c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.111+0000 7f2e54ff9640 1 -- 172.21.15.55:0/4116694511 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e4c083c10 con 0x7f2e48004f80 2023-08-25T04:03:08.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.111+0000 7f0419ffb640 1 -- 172.21.15.55:0/595505688 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414004240 con 0x7f041c174d20 2023-08-25T04:03:08.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.111+0000 7f0419ffb640 1 -- 172.21.15.55:0/595505688 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04140043c0 con 0x7f041c174d20 2023-08-25T04:03:08.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.111+0000 7f0419ffb640 1 -- 172.21.15.55:0/595505688 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414004530 con 0x7f041c174d20 2023-08-25T04:03:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.111+0000 7fc23e7fc640 1 --2- 172.21.15.55:0/4147192470 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc22c065750 0x7fc22c067c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.111+0000 7fc23e7fc640 1 -- 172.21.15.55:0/4147192470 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc238082b90 con 0x7fc24003ed00 2023-08-25T04:03:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.111+0000 7f042b9ac640 1 -- 172.21.15.55:0/595505688 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041c04cec0 con 0x7f041c174d20 2023-08-25T04:03:08.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.111+0000 7f2e577fe640 1 --2- 172.21.15.55:0/4116694511 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2e3c065750 0x7f2e3c067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.111+0000 7fc24d49e640 1 --2- 172.21.15.55:0/4147192470 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc22c065750 0x7fc22c067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.111+0000 7fc24d49e640 1 --2- 172.21.15.55:0/4147192470 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc22c065750 0x7fc22c067c10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc2401833b0 tx=0x7fc244009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.111+0000 7f2e577fe640 1 --2- 172.21.15.55:0/4116694511 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2e3c065750 0x7f2e3c067c10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e44007fd0 tx=0x7f2e44009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.111+0000 7f042b9ac640 1 -- 172.21.15.55:0/595505688 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041c16e6d0 con 0x7f041c174d20 2023-08-25T04:03:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.111+0000 7f2e54ff9640 1 -- 172.21.15.55:0/4116694511 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2e4c0516d0 con 0x7f2e48004f80 2023-08-25T04:03:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.115+0000 7f042b9ac640 1 -- 172.21.15.55:0/595505688 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041c02d9e0 con 0x7f041c174d20 2023-08-25T04:03:08.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.115+0000 7fc23e7fc640 1 -- 172.21.15.55:0/4147192470 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc2380506e0 con 0x7fc24003ed00 2023-08-25T04:03:08.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.115+0000 7f0419ffb640 1 -- 172.21.15.55:0/595505688 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f041400fa60 con 0x7f041c174d20 2023-08-25T04:03:08.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.119+0000 7f0419ffb640 1 --2- 172.21.15.55:0/595505688 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0408065700 0x7f0408067bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:08.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.119+0000 7f0419ffb640 1 -- 172.21.15.55:0/595505688 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0414083490 con 0x7f041c174d20 2023-08-25T04:03:08.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.119+0000 7f0429748640 1 --2- 172.21.15.55:0/595505688 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0408065700 0x7f0408067bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:08.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.119+0000 7f0429748640 1 --2- 172.21.15.55:0/595505688 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0408065700 0x7f0408067bc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0420007c20 tx=0x7f0420009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:08.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.123+0000 7f0419ffb640 1 -- 172.21.15.55:0/595505688 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0414051070 con 0x7f041c174d20 2023-08-25T04:03:08.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.403+0000 7fd0712cb640 1 -- 172.21.15.55:0/2503177246 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd04c0057e0 con 0x7fd06c0abdb0 2023-08-25T04:03:08.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.407+0000 7fd0537fe640 1 -- 172.21.15.55:0/2503177246 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd05c021090 con 0x7fd06c0abdb0 2023-08-25T04:03:08.410 INFO:teuthology.orchestra.run.smithi055.stdout:60129542148 2023-08-25T04:03:08.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.407+0000 7fd0517fa640 1 -- 172.21.15.55:0/2503177246 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd0580656b0 msgr2=0x7fd058067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.411+0000 7fd0517fa640 1 --2- 172.21.15.55:0/2503177246 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd0580656b0 0x7fd058067b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0c8320 tx=0x7fd064009040 comp rx=0 tx=0).stop 2023-08-25T04:03:08.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.411+0000 7fd0517fa640 1 -- 172.21.15.55:0/2503177246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd06c0abdb0 msgr2=0x7fd06c149cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.411+0000 7fd0517fa640 1 --2- 172.21.15.55:0/2503177246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd06c0abdb0 0x7fd06c149cc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00e870 tx=0x7fd05c00ed30 comp rx=0 tx=0).stop 2023-08-25T04:03:08.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.411+0000 7fd0517fa640 1 -- 172.21.15.55:0/2503177246 shutdown_connections 2023-08-25T04:03:08.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.411+0000 7fd0517fa640 1 --2- 172.21.15.55:0/2503177246 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd0580656b0 0x7fd058067b70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.411+0000 7fd0517fa640 1 --2- 172.21.15.55:0/2503177246 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd06c0cb6f0 0x7fd06c0af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.411+0000 7fd0517fa640 1 --2- 172.21.15.55:0/2503177246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd06c0ac7e0 0x7fd06c09a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.411+0000 7fd0517fa640 1 --2- 172.21.15.55:0/2503177246 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd06c0abdb0 0x7fd06c149cc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.411+0000 7fd0517fa640 1 -- 172.21.15.55:0/2503177246 >> 172.21.15.55:0/2503177246 conn(0x7fd06c0cabd0 msgr2=0x7fd06c0adbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:08.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.411+0000 7fd0517fa640 1 -- 172.21.15.55:0/2503177246 shutdown_connections 2023-08-25T04:03:08.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.411+0000 7fd0517fa640 1 -- 172.21.15.55:0/2503177246 wait complete. 2023-08-25T04:03:08.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.415+0000 7f8e553d5640 1 -- 172.21.15.55:0/1302575284 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8e5006da30 con 0x7f8e500aee40 2023-08-25T04:03:08.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.419+0000 7f8e377fe640 1 -- 172.21.15.55:0/1302575284 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8e44053ec0 con 0x7f8e500aee40 2023-08-25T04:03:08.423 INFO:teuthology.orchestra.run.smithi055.stdout:60129542149 2023-08-25T04:03:08.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.423+0000 7f8e553d5640 1 -- 172.21.15.55:0/1302575284 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8e3c065750 msgr2=0x7f8e3c067c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.423+0000 7f8e553d5640 1 --2- 172.21.15.55:0/1302575284 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8e3c065750 0x7f8e3c067c10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8e48001950 tx=0x7f8e480018e0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.423+0000 7f8e553d5640 1 -- 172.21.15.55:0/1302575284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e500aee40 msgr2=0x7f8e50156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.423+0000 7f8e553d5640 1 --2- 172.21.15.55:0/1302575284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e500aee40 0x7f8e50156940 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400c820 tx=0x7f8e4400cc20 comp rx=0 tx=0).stop 2023-08-25T04:03:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.423+0000 7f8e553d5640 1 -- 172.21.15.55:0/1302575284 shutdown_connections 2023-08-25T04:03:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.423+0000 7f8e553d5640 1 --2- 172.21.15.55:0/1302575284 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8e3c065750 0x7f8e3c067c10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.423+0000 7f8e553d5640 1 --2- 172.21.15.55:0/1302575284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e500cf160 0x7f8e501487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.423+0000 7f8e553d5640 1 --2- 172.21.15.55:0/1302575284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e500cae10 0x7f8e50150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.423+0000 7f8e553d5640 1 --2- 172.21.15.55:0/1302575284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e500aee40 0x7f8e50156940 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.423+0000 7f8e553d5640 1 -- 172.21.15.55:0/1302575284 >> 172.21.15.55:0/1302575284 conn(0x7f8e500cfa40 msgr2=0x7f8e500b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:08.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.423+0000 7f8e553d5640 1 -- 172.21.15.55:0/1302575284 shutdown_connections 2023-08-25T04:03:08.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.423+0000 7f8e553d5640 1 -- 172.21.15.55:0/1302575284 wait complete. 2023-08-25T04:03:08.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.435+0000 7fa80f59e640 1 -- 172.21.15.55:0/1260436912 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa8100c37d0 con 0x7fa81015e560 2023-08-25T04:03:08.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.435+0000 7effa04cb640 1 -- 172.21.15.55:0/3916115530 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7eff80005510 con 0x7eff98158120 2023-08-25T04:03:08.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.435+0000 7fa7feffd640 1 -- 172.21.15.55:0/1260436912 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa8000538b0 con 0x7fa81015e560 2023-08-25T04:03:08.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.435+0000 7eff8effd640 1 -- 172.21.15.55:0/3916115530 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff940bf090 con 0x7eff98158120 2023-08-25T04:03:08.439 INFO:teuthology.orchestra.run.smithi055.stdout:60129542148 2023-08-25T04:03:08.441 INFO:teuthology.orchestra.run.smithi055.stdout:64424509446 2023-08-25T04:03:08.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7eff8cff9640 1 -- 172.21.15.55:0/3916115530 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7eff7c0656b0 msgr2=0x7eff7c067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7eff8cff9640 1 --2- 172.21.15.55:0/3916115530 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7eff7c0656b0 0x7eff7c067b70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7eff88005ed0 tx=0x7eff88000f20 comp rx=0 tx=0).stop 2023-08-25T04:03:08.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7fa7fcff9640 1 -- 172.21.15.55:0/1260436912 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa7f0065750 msgr2=0x7fa7f0067c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7fa7fcff9640 1 --2- 172.21.15.55:0/1260436912 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa7f0065750 0x7fa7f0067c10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa80401aa40 tx=0x7fa8040a6000 comp rx=0 tx=0).stop 2023-08-25T04:03:08.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7fa7fcff9640 1 -- 172.21.15.55:0/1260436912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa81015e560 msgr2=0x7fa8100c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7eff8cff9640 1 -- 172.21.15.55:0/3916115530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff98158120 msgr2=0x7eff98155d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7eff8cff9640 1 --2- 172.21.15.55:0/3916115530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff98158120 0x7eff98155d10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7eff9401ee10 tx=0x7eff9401d500 comp rx=0 tx=0).stop 2023-08-25T04:03:08.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7fa7fcff9640 1 --2- 172.21.15.55:0/1260436912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa81015e560 0x7fa8100c77c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa80000caf0 tx=0x7fa800001d80 comp rx=0 tx=0).stop 2023-08-25T04:03:08.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7fa7fcff9640 1 -- 172.21.15.55:0/1260436912 shutdown_connections 2023-08-25T04:03:08.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7fa7fcff9640 1 --2- 172.21.15.55:0/1260436912 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa7f0065750 0x7fa7f0067c10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7eff8cff9640 1 -- 172.21.15.55:0/3916115530 shutdown_connections 2023-08-25T04:03:08.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7eff8cff9640 1 --2- 172.21.15.55:0/3916115530 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7eff7c0656b0 0x7eff7c067b70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7fa7fcff9640 1 --2- 172.21.15.55:0/1260436912 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa81015d950 0x7fa81015fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7eff8cff9640 1 --2- 172.21.15.55:0/3916115530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff9806cae0 0x7eff980c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7fa7fcff9640 1 --2- 172.21.15.55:0/1260436912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa81015e560 0x7fa8100c77c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7eff8cff9640 1 --2- 172.21.15.55:0/3916115530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff98158120 0x7eff98155d10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7fa7fcff9640 1 --2- 172.21.15.55:0/1260436912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8100c8d90 0x7fa8101559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7eff8cff9640 1 --2- 172.21.15.55:0/3916115530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff98069900 0x7eff980b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7fa7fcff9640 1 -- 172.21.15.55:0/1260436912 >> 172.21.15.55:0/1260436912 conn(0x7fa810069f00 msgr2=0x7fa8101621e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:08.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7eff8cff9640 1 -- 172.21.15.55:0/3916115530 >> 172.21.15.55:0/3916115530 conn(0x7eff980ce6a0 msgr2=0x7eff9815a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:08.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7fa7fcff9640 1 -- 172.21.15.55:0/1260436912 shutdown_connections 2023-08-25T04:03:08.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7eff8cff9640 1 -- 172.21.15.55:0/3916115530 shutdown_connections 2023-08-25T04:03:08.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7fa7fcff9640 1 -- 172.21.15.55:0/1260436912 wait complete. 2023-08-25T04:03:08.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.439+0000 7eff8cff9640 1 -- 172.21.15.55:0/3916115530 wait complete. 2023-08-25T04:03:08.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.443+0000 7f100532d640 1 -- 172.21.15.55:0/2020018568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0fe00050d0 con 0x7f0ff8047ce0 2023-08-25T04:03:08.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.443+0000 7f0ffcff9640 1 -- 172.21.15.55:0/2020018568 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0fec006e20 con 0x7f0ff8047ce0 2023-08-25T04:03:08.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.0 2023-08-25T04:03:08.452 INFO:teuthology.orchestra.run.smithi055.stdout:60129542149 2023-08-25T04:03:08.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.443+0000 7f100532d640 1 -- 172.21.15.55:0/2020018568 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0fe4065750 msgr2=0x7f0fe4067c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.443+0000 7f100532d640 1 --2- 172.21.15.55:0/2020018568 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0fe4065750 0x7f0fe4067c10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f100002c750 tx=0x7f100008b040 comp rx=0 tx=0).stop 2023-08-25T04:03:08.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.443+0000 7f100532d640 1 -- 172.21.15.55:0/2020018568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff8047ce0 msgr2=0x7f0ff80e3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.443+0000 7f100532d640 1 --2- 172.21.15.55:0/2020018568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff8047ce0 0x7f0ff80e3c10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0fec0ad040 tx=0x7f0fec01ac90 comp rx=0 tx=0).stop 2023-08-25T04:03:08.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.443+0000 7f100532d640 1 -- 172.21.15.55:0/2020018568 shutdown_connections 2023-08-25T04:03:08.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.443+0000 7f100532d640 1 --2- 172.21.15.55:0/2020018568 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0fe4065750 0x7f0fe4067c10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.443+0000 7f100532d640 1 --2- 172.21.15.55:0/2020018568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ff8038270 0x7f0ff80e4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.447+0000 7f100532d640 1 --2- 172.21.15.55:0/2020018568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff8047ce0 0x7f0ff80e3c10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.447+0000 7f100532d640 1 --2- 172.21.15.55:0/2020018568 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff8033e20 0x7f0ff80d7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.447+0000 7f100532d640 1 -- 172.21.15.55:0/2020018568 >> 172.21.15.55:0/2020018568 conn(0x7f0ff8054c20 msgr2=0x7f0ff8034cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:08.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.447+0000 7f100532d640 1 -- 172.21.15.55:0/2020018568 shutdown_connections 2023-08-25T04:03:08.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.447+0000 7f100532d640 1 -- 172.21.15.55:0/2020018568 wait complete. 2023-08-25T04:03:08.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.455+0000 7f2e5e66d640 1 -- 172.21.15.55:0/4116694511 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2e500e8e80 con 0x7f2e48004f80 2023-08-25T04:03:08.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.455+0000 7f2e54ff9640 1 -- 172.21.15.55:0/4116694511 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2e4c054cf0 con 0x7f2e48004f80 2023-08-25T04:03:08.458 INFO:teuthology.orchestra.run.smithi055.stdout:60129542148 2023-08-25T04:03:08.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.455+0000 7fc22bfff640 1 -- 172.21.15.55:0/4147192470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc24004c470 con 0x7fc24003ed00 2023-08-25T04:03:08.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.455+0000 7fc23e7fc640 1 -- 172.21.15.55:0/4147192470 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc238017020 con 0x7fc24003ed00 2023-08-25T04:03:08.459 INFO:teuthology.orchestra.run.smithi055.stdout:64424509446 2023-08-25T04:03:08.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7f2e5e66d640 1 -- 172.21.15.55:0/4116694511 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2e3c065750 msgr2=0x7f2e3c067c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7f2e5e66d640 1 --2- 172.21.15.55:0/4116694511 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2e3c065750 0x7f2e3c067c10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e44007fd0 tx=0x7f2e44009040 comp rx=0 tx=0).stop 2023-08-25T04:03:08.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7f2e5e66d640 1 -- 172.21.15.55:0/4116694511 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e48004f80 msgr2=0x7f2e5004a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7f2e5e66d640 1 --2- 172.21.15.55:0/4116694511 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e48004f80 0x7f2e5004a090 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0108c0 tx=0x7f2e4c010d80 comp rx=0 tx=0).stop 2023-08-25T04:03:08.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7f2e5e66d640 1 -- 172.21.15.55:0/4116694511 shutdown_connections 2023-08-25T04:03:08.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7fc22bfff640 1 -- 172.21.15.55:0/4147192470 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc22c065750 msgr2=0x7fc22c067c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7fc22bfff640 1 --2- 172.21.15.55:0/4147192470 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc22c065750 0x7fc22c067c10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc2401833b0 tx=0x7fc244009040 comp rx=0 tx=0).stop 2023-08-25T04:03:08.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7fc22bfff640 1 -- 172.21.15.55:0/4147192470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc24003ed00 msgr2=0x7fc24004bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7fc22bfff640 1 --2- 172.21.15.55:0/4147192470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc24003ed00 0x7fc24004bf30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc23800c400 tx=0x7fc23800c8c0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7f2e5e66d640 1 --2- 172.21.15.55:0/4116694511 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2e3c065750 0x7f2e3c067c10 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e44007fd0 tx=0x7f2e44009040 comp rx=0 tx=0).stop 2023-08-25T04:03:08.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7f2e5e66d640 1 --2- 172.21.15.55:0/4116694511 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e500eb150 0x7f2e500eb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7f2e5e66d640 1 --2- 172.21.15.55:0/4116694511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e50048b20 0x7f2e500daf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7f2e5e66d640 1 --2- 172.21.15.55:0/4116694511 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e48004f80 0x7f2e5004a090 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7f2e5e66d640 1 -- 172.21.15.55:0/4116694511 >> 172.21.15.55:0/4116694511 conn(0x7f2e50054b10 msgr2=0x7f2e50005770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:08.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.1 2023-08-25T04:03:08.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7f042b9ac640 1 -- 172.21.15.55:0/595505688 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f041c02d9a0 con 0x7f041c174d20 2023-08-25T04:03:08.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7fc22bfff640 1 -- 172.21.15.55:0/4147192470 shutdown_connections 2023-08-25T04:03:08.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7fc22bfff640 1 --2- 172.21.15.55:0/4147192470 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc22c065750 0x7fc22c067c10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7fc22bfff640 1 --2- 172.21.15.55:0/4147192470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2400e6890 0x7fc2400dcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7fc22bfff640 1 --2- 172.21.15.55:0/4147192470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc240054510 0x7fc2400dae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7fc22bfff640 1 --2- 172.21.15.55:0/4147192470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc24003ed00 0x7fc24004bf30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7fc22bfff640 1 -- 172.21.15.55:0/4147192470 >> 172.21.15.55:0/4147192470 conn(0x7fc240059130 msgr2=0x7fc24004d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:08.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7f2e5e66d640 1 -- 172.21.15.55:0/4116694511 shutdown_connections 2023-08-25T04:03:08.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7f2e5e66d640 1 -- 172.21.15.55:0/4116694511 wait complete. 2023-08-25T04:03:08.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7fc22bfff640 1 -- 172.21.15.55:0/4147192470 shutdown_connections 2023-08-25T04:03:08.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7fc22bfff640 1 -- 172.21.15.55:0/4147192470 wait complete. 2023-08-25T04:03:08.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.459+0000 7f0419ffb640 1 -- 172.21.15.55:0/595505688 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0414054690 con 0x7f041c174d20 2023-08-25T04:03:08.468 INFO:teuthology.orchestra.run.smithi055.stdout:60129542148 2023-08-25T04:03:08.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.467+0000 7f042b9ac640 1 -- 172.21.15.55:0/595505688 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0408065700 msgr2=0x7f0408067bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.467+0000 7f042b9ac640 1 --2- 172.21.15.55:0/595505688 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0408065700 0x7f0408067bc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0420007c20 tx=0x7f0420009040 comp rx=0 tx=0).stop 2023-08-25T04:03:08.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.467+0000 7f042b9ac640 1 -- 172.21.15.55:0/595505688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f041c174d20 msgr2=0x7f041c16e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.467+0000 7f042b9ac640 1 --2- 172.21.15.55:0/595505688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f041c174d20 0x7f041c16e190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f041c0044b0 tx=0x7f0414011cf0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.467+0000 7f042b9ac640 1 -- 172.21.15.55:0/595505688 shutdown_connections 2023-08-25T04:03:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.467+0000 7f042b9ac640 1 --2- 172.21.15.55:0/595505688 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0408065700 0x7f0408067bc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.467+0000 7f042b9ac640 1 --2- 172.21.15.55:0/595505688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f041c02f040 0x7f041c02f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.467+0000 7f042b9ac640 1 --2- 172.21.15.55:0/595505688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f041c174d20 0x7f041c16e190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.467+0000 7f042b9ac640 1 --2- 172.21.15.55:0/595505688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0410005190 0x7f041c04c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.467+0000 7f042b9ac640 1 -- 172.21.15.55:0/595505688 >> 172.21.15.55:0/595505688 conn(0x7f041c0538e0 msgr2=0x7f041c0520e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:08.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.467+0000 7f042b9ac640 1 -- 172.21.15.55:0/595505688 shutdown_connections 2023-08-25T04:03:08.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:08.467+0000 7f042b9ac640 1 -- 172.21.15.55:0/595505688 wait complete. 2023-08-25T04:03:08.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.2 2023-08-25T04:03:08.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.5 2023-08-25T04:03:08.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509446 for osd.6 2023-08-25T04:03:08.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.4 2023-08-25T04:03:08.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509446 for osd.7 2023-08-25T04:03:08.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.3 2023-08-25T04:03:09.452 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-25T04:03:09.465 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-25T04:03:09.478 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-25T04:03:09.486 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-25T04:03:09.487 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-25T04:03:09.494 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-25T04:03:09.502 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-25T04:03:09.503 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-25T04:03:09.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.671+0000 7f909c219640 1 Processor -- start 2023-08-25T04:03:09.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.671+0000 7f909c219640 1 -- start start 2023-08-25T04:03:09.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.675+0000 7f909c219640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f909406bb40 0x7f90940cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.675+0000 7f909c219640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f90940cc1d0 0x7f90940aada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.675+0000 7f909c219640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90940cc8c0 con 0x7f90940ac7e0 2023-08-25T04:03:09.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.675+0000 7f909c219640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90940ad8e0 con 0x7f909406bb40 2023-08-25T04:03:09.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.675+0000 7f909c219640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90940ccba0 con 0x7f90940cc1d0 2023-08-25T04:03:09.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.675+0000 7f9099fb5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f90940ac7e0 0x7f909406b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50496/0 (socket says 172.21.15.55:50496) 2023-08-25T04:03:09.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.675+0000 7f9099fb5640 1 -- 172.21.15.55:0/3531115783 learned_addr learned my addr 172.21.15.55:0/3531115783 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:09.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.675+0000 7f90997b4640 1 --2- 172.21.15.55:0/3531115783 >> v2:172.21.15.55:3300/0 conn(0x7f909406bb40 0x7f90940cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.679+0000 7f90997b4640 1 -- 172.21.15.55:0/3531115783 >> v2:172.21.15.110:3300/0 conn(0x7f90940cc1d0 msgr2=0x7f90940aada0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-25T04:03:09.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.679+0000 7f90997b4640 1 --2- 172.21.15.55:0/3531115783 >> v2:172.21.15.110:3300/0 conn(0x7f90940cc1d0 0x7f90940aada0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.679+0000 7f90997b4640 1 -- 172.21.15.55:0/3531115783 >> v1:172.21.15.55:6789/0 conn(0x7f90940ac7e0 legacy=0x7f909406b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.679+0000 7f90997b4640 1 -- 172.21.15.55:0/3531115783 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90940cce80 con 0x7f909406bb40 2023-08-25T04:03:09.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.683+0000 7f90997b4640 1 --2- 172.21.15.55:0/3531115783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909406bb40 0x7f90940cbc90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f909415c250 tx=0x7f909001c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd44627cb42d3e77 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.687+0000 7f9098fb3640 1 -- 172.21.15.55:0/3531115783 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900ab600 con 0x7f909406bb40 2023-08-25T04:03:09.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.687+0000 7f9098fb3640 1 -- 172.21.15.55:0/3531115783 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90900a7050 con 0x7f909406bb40 2023-08-25T04:03:09.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.687+0000 7f9098fb3640 1 -- 172.21.15.55:0/3531115783 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900ab980 con 0x7f909406bb40 2023-08-25T04:03:09.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.687+0000 7f909c219640 1 -- 172.21.15.55:0/3531115783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909406bb40 msgr2=0x7f90940cbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.687+0000 7f909c219640 1 --2- 172.21.15.55:0/3531115783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909406bb40 0x7f90940cbc90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f909415c250 tx=0x7f909001c2e0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.687+0000 7f909c219640 1 -- 172.21.15.55:0/3531115783 shutdown_connections 2023-08-25T04:03:09.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.687+0000 7f909c219640 1 --2- 172.21.15.55:0/3531115783 >> v2:172.21.15.110:3300/0 conn(0x7f90940cc1d0 0x7f90940aada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.687+0000 7f909c219640 1 --2- 172.21.15.55:0/3531115783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909406bb40 0x7f90940cbc90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.687+0000 7f909c219640 1 -- 172.21.15.55:0/3531115783 >> 172.21.15.55:0/3531115783 conn(0x7f90940cabd0 msgr2=0x7f90940cafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:09.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.687+0000 7f909c219640 1 -- 172.21.15.55:0/3531115783 shutdown_connections 2023-08-25T04:03:09.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.687+0000 7f909c219640 1 -- 172.21.15.55:0/3531115783 wait complete. 2023-08-25T04:03:09.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.691+0000 7f909c219640 1 Processor -- start 2023-08-25T04:03:09.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.691+0000 7f909c219640 1 -- start start 2023-08-25T04:03:09.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.691+0000 7f909c219640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90940ac7e0 0x7f90940c1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.691+0000 7f909c219640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90940cc1d0 0x7f90940c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.691+0000 7f909c219640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90941687e0 0x7f9094168c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.691+0000 7f909c219640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90940aefa0 con 0x7f90940cc1d0 2023-08-25T04:03:09.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.691+0000 7f909c219640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90940af280 con 0x7f90940ac7e0 2023-08-25T04:03:09.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.691+0000 7f909c219640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90940af560 con 0x7f90941687e0 2023-08-25T04:03:09.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.691+0000 7f9099fb5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90940ac7e0 0x7f90940c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.691+0000 7f9099fb5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90940ac7e0 0x7f90940c1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:38858/0 (socket says 172.21.15.55:38858) 2023-08-25T04:03:09.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.691+0000 7f9099fb5640 1 -- 172.21.15.55:0/1261866118 learned_addr learned my addr 172.21.15.55:0/1261866118 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:09.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.691+0000 7f909a7b6640 1 --2- 172.21.15.55:0/1261866118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90941687e0 0x7f9094168c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.695+0000 7f9099fb5640 1 -- 172.21.15.55:0/1261866118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90941687e0 msgr2=0x7f9094168c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.695+0000 7f9099fb5640 1 --2- 172.21.15.55:0/1261866118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90941687e0 0x7f9094168c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.695+0000 7f9099fb5640 1 -- 172.21.15.55:0/1261866118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90940cc1d0 msgr2=0x7f90940c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.695+0000 7f90997b4640 1 --2- 172.21.15.55:0/1261866118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90940cc1d0 0x7f90940c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.695+0000 7f9099fb5640 1 --2- 172.21.15.55:0/1261866118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90940cc1d0 0x7f90940c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.695+0000 7f9099fb5640 1 -- 172.21.15.55:0/1261866118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9090009420 con 0x7f90940ac7e0 2023-08-25T04:03:09.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.695+0000 7f90997b4640 1 --2- 172.21.15.55:0/1261866118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90940cc1d0 0x7f90940c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:09.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.695+0000 7f9099fb5640 1 --2- 172.21.15.55:0/1261866118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90940ac7e0 0x7f90940c1910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f908c00caf0 tx=0x7f908c0021a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.695+0000 7f908a7fc640 1 -- 172.21.15.55:0/1261866118 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c00a7c0 con 0x7f90940ac7e0 2023-08-25T04:03:09.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.695+0000 7f909c219640 1 -- 172.21.15.55:0/1261866118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90940af840 con 0x7f90940ac7e0 2023-08-25T04:03:09.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.695+0000 7f909c219640 1 -- 172.21.15.55:0/1261866118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90940aec00 con 0x7f90940ac7e0 2023-08-25T04:03:09.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.695+0000 7f908a7fc640 1 -- 172.21.15.55:0/1261866118 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c00a920 con 0x7f90940ac7e0 2023-08-25T04:03:09.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.695+0000 7f908a7fc640 1 -- 172.21.15.55:0/1261866118 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c00ad10 con 0x7f90940ac7e0 2023-08-25T04:03:09.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.699+0000 7f908a7fc640 1 -- 172.21.15.55:0/1261866118 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f908c0070d0 con 0x7f90940ac7e0 2023-08-25T04:03:09.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.703+0000 7f908a7fc640 1 --2- 172.21.15.55:0/1261866118 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9078065750 0x7f9078067c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.703+0000 7f908a7fc640 1 -- 172.21.15.55:0/1261866118 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f908c082980 con 0x7f90940ac7e0 2023-08-25T04:03:09.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.703+0000 7f90997b4640 1 --2- 172.21.15.55:0/1261866118 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9078065750 0x7f9078067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.703+0000 7f90997b4640 1 --2- 172.21.15.55:0/1261866118 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9078065750 0x7f9078067c10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f90900ad000 tx=0x7f9090008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.703+0000 7f909c219640 1 -- 172.21.15.55:0/1261866118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907c005260 con 0x7f90940ac7e0 2023-08-25T04:03:09.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.711+0000 7f908a7fc640 1 -- 172.21.15.55:0/1261866118 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f908c018080 con 0x7f90940ac7e0 2023-08-25T04:03:09.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.739+0000 7f1236426640 1 Processor -- start 2023-08-25T04:03:09.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.739+0000 7f1236426640 1 -- start start 2023-08-25T04:03:09.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.743+0000 7f1236426640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f123006c800 0x7f123006cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.743+0000 7f1236426640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12300c8910 0x7f12300c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.743+0000 7f1236426640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12301648e0 con 0x7f12300ad590 2023-08-25T04:03:09.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.743+0000 7f1236426640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12301611f0 con 0x7f123006c800 2023-08-25T04:03:09.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.743+0000 7f1236426640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12300ad970 con 0x7f12300c8910 2023-08-25T04:03:09.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.743+0000 7f122f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f123006c800 0x7f123006cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.743+0000 7f122f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f123006c800 0x7f123006cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35832/0 (socket says 172.21.15.55:35832) 2023-08-25T04:03:09.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.743+0000 7f122f7fe640 1 -- 172.21.15.55:0/1090738306 learned_addr learned my addr 172.21.15.55:0/1090738306 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:09.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.743+0000 7f12349c3640 1 --2- 172.21.15.55:0/1090738306 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12300c8910 0x7f12300c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.743+0000 7f122f7fe640 1 -- 172.21.15.55:0/1090738306 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12300c8910 msgr2=0x7f12300c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:09.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.743+0000 7f122f7fe640 1 --2- 172.21.15.55:0/1090738306 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12300c8910 0x7f12300c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.743+0000 7f122f7fe640 1 -- 172.21.15.55:0/1090738306 >> v1:172.21.15.55:6789/0 conn(0x7f12300ad590 legacy=0x7f12300c1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.743+0000 7f122f7fe640 1 -- 172.21.15.55:0/1090738306 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1230164b30 con 0x7f123006c800 2023-08-25T04:03:09.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.747+0000 7f887add2640 1 Processor -- start 2023-08-25T04:03:09.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.747+0000 7f887add2640 1 -- start start 2023-08-25T04:03:09.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.747+0000 7f887add2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874150260 0x7f887415a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.747+0000 7f887add2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f88740cd820 0x7f88740cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.747+0000 7f887add2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f88740cac10 0x7f88740cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.747+0000 7f887add2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88740cb600 con 0x7f88740cd820 2023-08-25T04:03:09.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.747+0000 7f887add2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88740ccc70 con 0x7f88740cac10 2023-08-25T04:03:09.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.747+0000 7f887add2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8874159df0 con 0x7f8874150260 2023-08-25T04:03:09.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7f8879dd0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874150260 0x7f887415a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7f8879dd0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874150260 0x7f887415a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:47060/0 (socket says 172.21.15.55:47060) 2023-08-25T04:03:09.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7f8879dd0640 1 -- 172.21.15.55:0/1184463698 learned_addr learned my addr 172.21.15.55:0/1184463698 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:09.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.747+0000 7fa62b78f640 1 Processor -- start 2023-08-25T04:03:09.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7f8879dd0640 1 -- 172.21.15.55:0/1184463698 >> v2:172.21.15.110:3300/0 conn(0x7f88740cac10 msgr2=0x7f88740cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:09.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7f8879dd0640 1 --2- 172.21.15.55:0/1184463698 >> v2:172.21.15.110:3300/0 conn(0x7f88740cac10 0x7f88740cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7f8879dd0640 1 -- 172.21.15.55:0/1184463698 >> v2:172.21.15.55:3300/0 conn(0x7f88740cd820 msgr2=0x7f88740cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:09.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7f8879dd0640 1 --2- 172.21.15.55:0/1184463698 >> v2:172.21.15.55:3300/0 conn(0x7f88740cd820 0x7f88740cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7f8879dd0640 1 -- 172.21.15.55:0/1184463698 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88740cc6b0 con 0x7f8874150260 2023-08-25T04:03:09.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.747+0000 7fa62b78f640 1 -- start start 2023-08-25T04:03:09.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7fa62b78f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa6240c9920 0x7fa62416bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7fa62b78f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6241648e0 con 0x7fa6240ad590 2023-08-25T04:03:09.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7fa62b78f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6241611f0 con 0x7fa62406c800 2023-08-25T04:03:09.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7fa62b78f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6240ad970 con 0x7fa6240c9920 2023-08-25T04:03:09.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7fa629d2c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa6240c9920 0x7fa62416bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7fa629d2c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa6240c9920 0x7fa62416bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:38876/0 (socket says 172.21.15.55:38876) 2023-08-25T04:03:09.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7fa629d2c640 1 -- 172.21.15.55:0/2754297411 learned_addr learned my addr 172.21.15.55:0/2754297411 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:09.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7fa629d2c640 1 -- 172.21.15.55:0/2754297411 >> v1:172.21.15.110:6789/0 conn(0x7fa62406c800 legacy=0x7fa62406cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:09.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7f122f7fe640 1 --2- 172.21.15.55:0/1090738306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123006c800 0x7f123006cc60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1220009870 tx=0x7f122001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891917c4786cc479 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7fa61bfff640 1 -- 172.21.15.55:0/2754297411 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777597116 0 0) 0x7fa6241648e0 con 0x7fa6240ad590 2023-08-25T04:03:09.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7fa629d2c640 1 -- 172.21.15.55:0/2754297411 >> v1:172.21.15.55:6789/0 conn(0x7fa6240ad590 legacy=0x7fa6240c1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7fa629d2c640 1 -- 172.21.15.55:0/2754297411 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa624164b30 con 0x7fa6240c9920 2023-08-25T04:03:09.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7f122effd640 1 -- 172.21.15.55:0/1090738306 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12200a9400 con 0x7f123006c800 2023-08-25T04:03:09.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7f122effd640 1 -- 172.21.15.55:0/1090738306 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12200a9560 con 0x7f123006c800 2023-08-25T04:03:09.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7f122effd640 1 -- 172.21.15.55:0/1090738306 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12200a98f0 con 0x7f123006c800 2023-08-25T04:03:09.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.751+0000 7f1dd0034640 1 Processor -- start 2023-08-25T04:03:09.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f1dd0034640 1 -- start start 2023-08-25T04:03:09.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f1236426640 1 -- 172.21.15.55:0/1090738306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123006c800 msgr2=0x7f123006cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f1236426640 1 --2- 172.21.15.55:0/1090738306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123006c800 0x7f123006cc60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1220009870 tx=0x7f122001c540 comp rx=0 tx=0).stop 2023-08-25T04:03:09.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f1236426640 1 -- 172.21.15.55:0/1090738306 shutdown_connections 2023-08-25T04:03:09.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f1236426640 1 --2- 172.21.15.55:0/1090738306 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12300c8910 0x7f12300c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f1236426640 1 --2- 172.21.15.55:0/1090738306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123006c800 0x7f123006cc60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f1236426640 1 -- 172.21.15.55:0/1090738306 >> 172.21.15.55:0/1090738306 conn(0x7f12300cabd0 msgr2=0x7f12300cafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:09.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f1236426640 1 -- 172.21.15.55:0/1090738306 shutdown_connections 2023-08-25T04:03:09.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f8879dd0640 1 --2- 172.21.15.55:0/1184463698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874150260 0x7f887415a280 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f88740c87e0 tx=0x7f887001ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73ececb8bfa0d7a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f1236426640 1 -- 172.21.15.55:0/1090738306 wait complete. 2023-08-25T04:03:09.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7fa57b544640 1 Processor -- start 2023-08-25T04:03:09.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f1dd0034640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc80ac7e0 0x7f1dc806b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f1dd0034640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1dc806b970 0x7f1dc80cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f1dd0034640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dc806bdb0 con 0x7f1dc80cc1d0 2023-08-25T04:03:09.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f1dd0034640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dc80ad8e0 con 0x7f1dc806b970 2023-08-25T04:03:09.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f1dd0034640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc80cc640 con 0x7f1dc80ac7e0 2023-08-25T04:03:09.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f1dcddd0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc80ac7e0 0x7f1dc806b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f1dcddd0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc80ac7e0 0x7f1dc806b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:47066/0 (socket says 172.21.15.55:47066) 2023-08-25T04:03:09.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f1dcddd0640 1 -- 172.21.15.55:0/1040459136 learned_addr learned my addr 172.21.15.55:0/1040459136 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:09.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f8878dce640 1 -- 172.21.15.55:0/1184463698 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88700a7c30 con 0x7f8874150260 2023-08-25T04:03:09.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f8878dce640 1 -- 172.21.15.55:0/1184463698 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88700a7d90 con 0x7f8874150260 2023-08-25T04:03:09.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f8878dce640 1 -- 172.21.15.55:0/1184463698 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88700af660 con 0x7f8874150260 2023-08-25T04:03:09.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f887add2640 1 -- 172.21.15.55:0/1184463698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874150260 msgr2=0x7f887415a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f887add2640 1 --2- 172.21.15.55:0/1184463698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874150260 0x7f887415a280 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f88740c87e0 tx=0x7f887001ebc0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f887add2640 1 -- 172.21.15.55:0/1184463698 shutdown_connections 2023-08-25T04:03:09.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f887add2640 1 --2- 172.21.15.55:0/1184463698 >> v2:172.21.15.110:3300/0 conn(0x7f88740cac10 0x7f88740cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f887add2640 1 --2- 172.21.15.55:0/1184463698 >> v2:172.21.15.55:3300/0 conn(0x7f88740cd820 0x7f88740cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f887add2640 1 --2- 172.21.15.55:0/1184463698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8874150260 0x7f887415a280 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f88740c87e0 tx=0x7f887001ebc0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f887add2640 1 -- 172.21.15.55:0/1184463698 >> 172.21.15.55:0/1184463698 conn(0x7f887406d3a0 msgr2=0x7f887406d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:09.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7f1236426640 1 Processor -- start 2023-08-25T04:03:09.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7fa629d2c640 1 --2- 172.21.15.55:0/2754297411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6240c9920 0x7fa62416bc10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009e50 tx=0x7fa61c01c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d316eb81bf270298 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7f1dcddd0640 1 -- 172.21.15.55:0/1040459136 >> v2:172.21.15.110:3300/0 conn(0x7f1dc806b970 msgr2=0x7f1dc80cbc90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:03:09.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.755+0000 7fa57b544640 1 -- start start 2023-08-25T04:03:09.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7f1236426640 1 -- start start 2023-08-25T04:03:09.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7f887add2640 1 -- 172.21.15.55:0/1184463698 shutdown_connections 2023-08-25T04:03:09.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7fa57b544640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa57406bb40 0x7fa5740cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7fa57b544640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5740cc1d0 0x7fa5740aada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7fa57b544640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5740cc620 con 0x7fa5740ac7e0 2023-08-25T04:03:09.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7fa57b544640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5740ad8e0 con 0x7fa57406bb40 2023-08-25T04:03:09.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7fa57b544640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5740cc8c0 con 0x7fa5740cc1d0 2023-08-25T04:03:09.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7f887add2640 1 -- 172.21.15.55:0/1184463698 wait complete. 2023-08-25T04:03:09.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7fa578adf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa57406bb40 0x7fa5740cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7fa5792e0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa5740ac7e0 0x7fa57406b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50510/0 (socket says 172.21.15.55:50510) 2023-08-25T04:03:09.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7fa5792e0640 1 -- 172.21.15.55:0/1850407588 learned_addr learned my addr 172.21.15.55:0/1850407588 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:09.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7f1236426640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123006c800 0x7f12300cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7fa579ae1640 1 --2- 172.21.15.55:0/1850407588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5740cc1d0 0x7fa5740aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7f1236426640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12300ad590 0x7f12300c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7f1236426640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12300c8910 0x7f12300c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7fa61bfff640 1 -- 172.21.15.55:0/2754297411 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c0a5890 con 0x7fa6240c9920 2023-08-25T04:03:09.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7fa61bfff640 1 -- 172.21.15.55:0/2754297411 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c0a59f0 con 0x7fa6240c9920 2023-08-25T04:03:09.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7fa579ae1640 1 -- 172.21.15.55:0/1850407588 >> v2:172.21.15.55:3300/0 conn(0x7fa57406bb40 msgr2=0x7fa5740cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:09.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7fa61bfff640 1 -- 172.21.15.55:0/2754297411 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c0a5d80 con 0x7fa6240c9920 2023-08-25T04:03:09.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7f122f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12300ad590 0x7f12300c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7f122f7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12300ad590 0x7f12300c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:38888/0 (socket says 172.21.15.55:38888) 2023-08-25T04:03:09.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7fa579ae1640 1 --2- 172.21.15.55:0/1850407588 >> v2:172.21.15.55:3300/0 conn(0x7fa57406bb40 0x7fa5740cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7fa579ae1640 1 -- 172.21.15.55:0/1850407588 >> v1:172.21.15.55:6789/0 conn(0x7fa5740ac7e0 legacy=0x7fa57406b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7fa579ae1640 1 -- 172.21.15.55:0/1850407588 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5740ccba0 con 0x7fa5740cc1d0 2023-08-25T04:03:09.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7f887add2640 1 Processor -- start 2023-08-25T04:03:09.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7f122f7fe640 1 -- 172.21.15.55:0/2787173114 learned_addr learned my addr 172.21.15.55:0/2787173114 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:09.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7f12349c3640 1 --2- 172.21.15.55:0/2787173114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12300c8910 0x7f12300c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7f122ffff640 1 --2- 172.21.15.55:0/2787173114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123006c800 0x7f12300cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7fa62b78f640 1 -- 172.21.15.55:0/2754297411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6240c9920 msgr2=0x7fa62416bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7fa62b78f640 1 --2- 172.21.15.55:0/2754297411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6240c9920 0x7fa62416bc10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009e50 tx=0x7fa61c01c9d0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7f1dcddd0640 1 --2- 172.21.15.55:0/1040459136 >> v2:172.21.15.110:3300/0 conn(0x7f1dc806b970 0x7f1dc80cbc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7f1dcddd0640 1 -- 172.21.15.55:0/1040459136 >> v1:172.21.15.110:6789/0 conn(0x7f1dc80cc1d0 legacy=0x7f1dc815c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7f1dcddd0640 1 -- 172.21.15.55:0/1040459136 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc80cc8c0 con 0x7f1dc80ac7e0 2023-08-25T04:03:09.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f1236426640 1 -- 172.21.15.55:0/2787173114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1230158860 con 0x7f123006c800 2023-08-25T04:03:09.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7fa62b78f640 1 -- 172.21.15.55:0/2754297411 shutdown_connections 2023-08-25T04:03:09.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7fa62b78f640 1 --2- 172.21.15.55:0/2754297411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6240c9920 0x7fa62416bc10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7fa62b78f640 1 -- 172.21.15.55:0/2754297411 >> 172.21.15.55:0/2754297411 conn(0x7fa6240cabd0 msgr2=0x7fa6240cafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:09.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f1236426640 1 -- 172.21.15.55:0/2787173114 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1230157c50 con 0x7f12300ad590 2023-08-25T04:03:09.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7fa62b78f640 1 -- 172.21.15.55:0/2754297411 shutdown_connections 2023-08-25T04:03:09.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f1236426640 1 -- 172.21.15.55:0/2787173114 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1230157f30 con 0x7f12300c8910 2023-08-25T04:03:09.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7fa62b78f640 1 -- 172.21.15.55:0/2754297411 wait complete. 2023-08-25T04:03:09.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.759+0000 7f887add2640 1 -- start start 2023-08-25T04:03:09.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f122f7fe640 1 -- 172.21.15.55:0/2787173114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12300c8910 msgr2=0x7f12300c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f122f7fe640 1 --2- 172.21.15.55:0/2787173114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12300c8910 0x7f12300c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f122f7fe640 1 -- 172.21.15.55:0/2787173114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123006c800 msgr2=0x7f12300cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f122f7fe640 1 --2- 172.21.15.55:0/2787173114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123006c800 0x7f12300cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f122f7fe640 1 -- 172.21.15.55:0/2787173114 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12200094d0 con 0x7f12300ad590 2023-08-25T04:03:09.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f887add2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88740cac10 0x7f88740c7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f122f7fe640 1 --2- 172.21.15.55:0/2787173114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12300ad590 0x7f12300c5440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f12200097c0 tx=0x7f122001ad80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f887add2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88740cd820 0x7f88741497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7fa578adf640 1 --2- 172.21.15.55:0/1850407588 >> v2:172.21.15.55:3300/0 conn(0x7fa57406bb40 0x7fa5740cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:09.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f8879dd0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88740cac10 0x7f88740c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f8879dd0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88740cac10 0x7f88740c7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:47092/0 (socket says 172.21.15.55:47092) 2023-08-25T04:03:09.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f122cff9640 1 -- 172.21.15.55:0/2787173114 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12200a9400 con 0x7f12300ad590 2023-08-25T04:03:09.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f122cff9640 1 -- 172.21.15.55:0/2787173114 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12200b1820 con 0x7f12300ad590 2023-08-25T04:03:09.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f122cff9640 1 -- 172.21.15.55:0/2787173114 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12200b1bd0 con 0x7f12300ad590 2023-08-25T04:03:09.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f1236426640 1 -- 172.21.15.55:0/2787173114 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1230158210 con 0x7f12300ad590 2023-08-25T04:03:09.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f8879dd0640 1 -- 172.21.15.55:0/2732646788 learned_addr learned my addr 172.21.15.55:0/2732646788 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:09.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f1236426640 1 -- 172.21.15.55:0/2787173114 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12301578b0 con 0x7f12300ad590 2023-08-25T04:03:09.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7fa62b78f640 1 Processor -- start 2023-08-25T04:03:09.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f88795cf640 1 --2- 172.21.15.55:0/2732646788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88740cd820 0x7f88741497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f887add2640 1 --2- 172.21.15.55:0/2732646788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88740c9bd0 0x7f8874150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f887add2640 1 -- 172.21.15.55:0/2732646788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8874149f80 con 0x7f88740c9bd0 2023-08-25T04:03:09.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f887add2640 1 -- 172.21.15.55:0/2732646788 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8874149d00 con 0x7f88740cd820 2023-08-25T04:03:09.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f887add2640 1 -- 172.21.15.55:0/2732646788 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88740c61e0 con 0x7f88740cac10 2023-08-25T04:03:09.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7f887a5d1640 1 --2- 172.21.15.55:0/2732646788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88740c9bd0 0x7f8874150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f8879dd0640 1 -- 172.21.15.55:0/2732646788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88740cd820 msgr2=0x7f88741497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f8879dd0640 1 --2- 172.21.15.55:0/2732646788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88740cd820 0x7f88741497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f8879dd0640 1 -- 172.21.15.55:0/2732646788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88740c9bd0 msgr2=0x7f8874150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f8879dd0640 1 --2- 172.21.15.55:0/2732646788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88740c9bd0 0x7f8874150640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f8879dd0640 1 -- 172.21.15.55:0/2732646788 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887000b770 con 0x7f88740cac10 2023-08-25T04:03:09.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f88795cf640 1 --2- 172.21.15.55:0/2732646788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88740cd820 0x7f88741497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:09.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.763+0000 7fa62b78f640 1 -- start start 2023-08-25T04:03:09.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f8879dd0640 1 --2- 172.21.15.55:0/2732646788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88740cac10 0x7f88740c7240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f887001d270 tx=0x7f887001b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f1dcddd0640 1 --2- 172.21.15.55:0/1040459136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc80ac7e0 0x7f1dc806b430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4008870 tx=0x7f1dc401ea40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da11ed6c35b0970a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7fa62b78f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa62406c800 0x7fa624151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f1236426640 1 -- 172.21.15.55:0/2787173114 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1210005260 con 0x7f12300ad590 2023-08-25T04:03:09.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7fa62952b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa62406c800 0x7fa624151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7fa62952b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa62406c800 0x7fa624151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35886/0 (socket says 172.21.15.55:35886) 2023-08-25T04:03:09.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f1dccdce640 1 -- 172.21.15.55:0/1040459136 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40a7b10 con 0x7f1dc80ac7e0 2023-08-25T04:03:09.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f1dccdce640 1 -- 172.21.15.55:0/1040459136 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc40ab070 con 0x7f1dc80ac7e0 2023-08-25T04:03:09.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f1dccdce640 1 -- 172.21.15.55:0/1040459136 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40a7e90 con 0x7f1dc80ac7e0 2023-08-25T04:03:09.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f886a7fc640 1 -- 172.21.15.55:0/2732646788 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88700afdc0 con 0x7f88740cac10 2023-08-25T04:03:09.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f886a7fc640 1 -- 172.21.15.55:0/2732646788 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88700ba470 con 0x7f88740cac10 2023-08-25T04:03:09.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f886a7fc640 1 -- 172.21.15.55:0/2732646788 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88700ba820 con 0x7f88740cac10 2023-08-25T04:03:09.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f887add2640 1 -- 172.21.15.55:0/2732646788 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88740c6480 con 0x7f88740cac10 2023-08-25T04:03:09.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f887add2640 1 -- 172.21.15.55:0/2732646788 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88740c6a40 con 0x7f88740cac10 2023-08-25T04:03:09.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7fa579ae1640 1 --2- 172.21.15.55:0/1850407588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5740cc1d0 0x7fa5740aada0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa5640097c0 tx=0x7fa56401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80eb93f950d380c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7fa62b78f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6240ad590 0x7fa62414f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7fa62952b640 1 -- 172.21.15.55:0/795349778 learned_addr learned my addr 172.21.15.55:0/795349778 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:09.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7fa62b78f640 1 --2- 172.21.15.55:0/795349778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6240c9920 0x7fa6240c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7fa62b78f640 1 -- 172.21.15.55:0/795349778 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6240c7650 con 0x7fa62406c800 2023-08-25T04:03:09.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7fa62b78f640 1 -- 172.21.15.55:0/795349778 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6240c6a40 con 0x7fa6240ad590 2023-08-25T04:03:09.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7fa62b78f640 1 -- 172.21.15.55:0/795349778 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6240c6d20 con 0x7fa6240c9920 2023-08-25T04:03:09.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f1dd0034640 1 -- 172.21.15.55:0/1040459136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc80ac7e0 msgr2=0x7f1dc806b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f1dd0034640 1 --2- 172.21.15.55:0/1040459136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc80ac7e0 0x7f1dc806b430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4008870 tx=0x7f1dc401ea40 comp rx=0 tx=0).stop 2023-08-25T04:03:09.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7fa56bfff640 1 -- 172.21.15.55:0/1850407588 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5640ab600 con 0x7fa5740cc1d0 2023-08-25T04:03:09.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7fa56bfff640 1 -- 172.21.15.55:0/1850407588 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5640a7050 con 0x7fa5740cc1d0 2023-08-25T04:03:09.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7fa56bfff640 1 -- 172.21.15.55:0/1850407588 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5640ab980 con 0x7fa5740cc1d0 2023-08-25T04:03:09.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7fa628d2a640 1 --2- 172.21.15.55:0/795349778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6240ad590 0x7fa62414f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7fa629d2c640 1 --2- 172.21.15.55:0/795349778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6240c9920 0x7fa6240c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f1dd0034640 1 -- 172.21.15.55:0/1040459136 shutdown_connections 2023-08-25T04:03:09.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f1dd0034640 1 --2- 172.21.15.55:0/1040459136 >> v2:172.21.15.110:3300/0 conn(0x7f1dc806b970 0x7f1dc80cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f1dd0034640 1 --2- 172.21.15.55:0/1040459136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc80ac7e0 0x7f1dc806b430 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7f1dd0034640 1 -- 172.21.15.55:0/1040459136 >> 172.21.15.55:0/1040459136 conn(0x7f1dc80cabd0 msgr2=0x7f1dc80cafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:09.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7fa628d2a640 1 -- 172.21.15.55:0/795349778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6240c9920 msgr2=0x7fa6240c5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7fa628d2a640 1 --2- 172.21.15.55:0/795349778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6240c9920 0x7fa6240c5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.767+0000 7fa628d2a640 1 -- 172.21.15.55:0/795349778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa62406c800 msgr2=0x7fa624151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7fa628d2a640 1 --2- 172.21.15.55:0/795349778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa62406c800 0x7fa624151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7fa628d2a640 1 -- 172.21.15.55:0/795349778 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c009b30 con 0x7fa6240ad590 2023-08-25T04:03:09.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7f122cff9640 1 -- 172.21.15.55:0/2787173114 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f12200b1d30 con 0x7f12300ad590 2023-08-25T04:03:09.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7fa629d2c640 1 --2- 172.21.15.55:0/795349778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6240c9920 0x7fa6240c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:09.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7fa57b544640 1 -- 172.21.15.55:0/1850407588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5740cc1d0 msgr2=0x7fa5740aada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7fa57b544640 1 --2- 172.21.15.55:0/1850407588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5740cc1d0 0x7fa5740aada0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa5640097c0 tx=0x7fa56401c450 comp rx=0 tx=0).stop 2023-08-25T04:03:09.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7fa628d2a640 1 --2- 172.21.15.55:0/795349778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6240ad590 0x7fa62414f960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa61400b410 tx=0x7fa61400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7f1dd0034640 1 -- 172.21.15.55:0/1040459136 shutdown_connections 2023-08-25T04:03:09.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7f1dd0034640 1 -- 172.21.15.55:0/1040459136 wait complete. 2023-08-25T04:03:09.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7f886a7fc640 1 -- 172.21.15.55:0/2732646788 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f88700b6070 con 0x7f88740cac10 2023-08-25T04:03:09.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7f887add2640 1 -- 172.21.15.55:0/2732646788 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8874073e50 con 0x7f88740cac10 2023-08-25T04:03:09.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7f122cff9640 1 --2- 172.21.15.55:0/2787173114 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f121c065780 0x7f121c067c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7f122cff9640 1 -- 172.21.15.55:0/2787173114 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f122011d560 con 0x7f12300ad590 2023-08-25T04:03:09.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7f122ffff640 1 --2- 172.21.15.55:0/2787173114 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f121c065780 0x7f121c067c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7fa57b544640 1 -- 172.21.15.55:0/1850407588 shutdown_connections 2023-08-25T04:03:09.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7fa57b544640 1 --2- 172.21.15.55:0/1850407588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5740cc1d0 0x7fa5740aada0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7fa57b544640 1 --2- 172.21.15.55:0/1850407588 >> v2:172.21.15.55:3300/0 conn(0x7fa57406bb40 0x7fa5740cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7fa57b544640 1 -- 172.21.15.55:0/1850407588 >> 172.21.15.55:0/1850407588 conn(0x7fa5740cabd0 msgr2=0x7fa5740cafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:09.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7fa57b544640 1 -- 172.21.15.55:0/1850407588 shutdown_connections 2023-08-25T04:03:09.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7fa57b544640 1 -- 172.21.15.55:0/1850407588 wait complete. 2023-08-25T04:03:09.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7f886a7fc640 1 --2- 172.21.15.55:0/2732646788 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8858065750 0x7f8858067c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7f886a7fc640 1 -- 172.21.15.55:0/2732646788 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f887011e000 con 0x7f88740cac10 2023-08-25T04:03:09.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7f122ffff640 1 --2- 172.21.15.55:0/2787173114 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f121c065780 0x7f121c067c40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1224001810 tx=0x7f1224009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7f88795cf640 1 --2- 172.21.15.55:0/2732646788 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8858065750 0x7f8858067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7f1dd0034640 1 Processor -- start 2023-08-25T04:03:09.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.771+0000 7f1dd0034640 1 -- start start 2023-08-25T04:03:09.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f88795cf640 1 --2- 172.21.15.55:0/2732646788 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8858065750 0x7f8858067c10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f88740afcd0 tx=0x7f8864006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa57b544640 1 Processor -- start 2023-08-25T04:03:09.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa57b544640 1 -- start start 2023-08-25T04:03:09.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dd0034640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc806b970 0x7f1dc81fcc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dd0034640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc80ac7e0 0x7f1dc80ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dd0034640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dc80cc1d0 0x7f1dc81fc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa57b544640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa57406bb40 0x7fa574151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa57b544640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5740ac7e0 0x7fa5740c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa57b544640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5740cc1d0 0x7fa574166a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa57b544640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5740c4950 con 0x7fa5740cc1d0 2023-08-25T04:03:09.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa57b544640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5740b1880 con 0x7fa5740ac7e0 2023-08-25T04:03:09.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa57b544640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5740b1b60 con 0x7fa57406bb40 2023-08-25T04:03:09.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dcddd0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc806b970 0x7f1dc81fcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dcddd0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc806b970 0x7f1dc81fcc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:38902/0 (socket says 172.21.15.55:38902) 2023-08-25T04:03:09.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dcd5cf640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc80ac7e0 0x7f1dc80ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dce5d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dc80cc1d0 0x7f1dc81fc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dcd5cf640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc80ac7e0 0x7f1dc80ae5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:47114/0 (socket says 172.21.15.55:47114) 2023-08-25T04:03:09.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dce5d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dc80cc1d0 0x7f1dc81fc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35902/0 (socket says 172.21.15.55:35902) 2023-08-25T04:03:09.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa578adf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5740ac7e0 0x7fa5740c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa579ae1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5740cc1d0 0x7fa574166a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa578adf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5740ac7e0 0x7fa5740c4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:38918/0 (socket says 172.21.15.55:38918) 2023-08-25T04:03:09.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa578adf640 1 -- 172.21.15.55:0/4047654056 learned_addr learned my addr 172.21.15.55:0/4047654056 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:09.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa5792e0640 1 --2- 172.21.15.55:0/4047654056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa57406bb40 0x7fa574151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa578adf640 1 -- 172.21.15.55:0/4047654056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa57406bb40 msgr2=0x7fa574151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa578adf640 1 --2- 172.21.15.55:0/4047654056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa57406bb40 0x7fa574151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa578adf640 1 -- 172.21.15.55:0/4047654056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5740cc1d0 msgr2=0x7fa574166a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa578adf640 1 --2- 172.21.15.55:0/4047654056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5740cc1d0 0x7fa574166a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa578adf640 1 -- 172.21.15.55:0/4047654056 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa564009420 con 0x7fa5740ac7e0 2023-08-25T04:03:09.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa5792e0640 1 --2- 172.21.15.55:0/4047654056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa57406bb40 0x7fa574151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:09.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dcddd0640 1 -- 172.21.15.55:0/2527234470 learned_addr learned my addr 172.21.15.55:0/2527234470 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:09.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dd0034640 1 -- 172.21.15.55:0/2527234470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc80af490 con 0x7f1dc80cc1d0 2023-08-25T04:03:09.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dd0034640 1 -- 172.21.15.55:0/2527234470 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc80afac0 con 0x7f1dc806b970 2023-08-25T04:03:09.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dd0034640 1 -- 172.21.15.55:0/2527234470 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc81fc9b0 con 0x7f1dc80ac7e0 2023-08-25T04:03:09.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dcddd0640 1 -- 172.21.15.55:0/2527234470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc80ac7e0 msgr2=0x7f1dc80ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dcddd0640 1 --2- 172.21.15.55:0/2527234470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc80ac7e0 0x7f1dc80ae5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dcddd0640 1 -- 172.21.15.55:0/2527234470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dc80cc1d0 msgr2=0x7f1dc81fc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dcddd0640 1 --2- 172.21.15.55:0/2527234470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dc80cc1d0 0x7f1dc81fc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dcddd0640 1 -- 172.21.15.55:0/2527234470 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc4008550 con 0x7f1dc806b970 2023-08-25T04:03:09.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa578adf640 1 --2- 172.21.15.55:0/4047654056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5740ac7e0 0x7fa5740c4020 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa570009fc0 tx=0x7fa57000d560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dcddd0640 1 --2- 172.21.15.55:0/2527234470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc806b970 0x7f1dc81fcc20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40b3040 tx=0x7f1dc401d280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa619ffb640 1 -- 172.21.15.55:0/795349778 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614004020 con 0x7fa6240ad590 2023-08-25T04:03:09.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.779+0000 7fa619ffb640 1 -- 172.21.15.55:0/795349778 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa614004180 con 0x7fa6240ad590 2023-08-25T04:03:09.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.779+0000 7fa62b78f640 1 -- 172.21.15.55:0/795349778 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6240c7000 con 0x7fa6240ad590 2023-08-25T04:03:09.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7f1dbe7fc640 1 -- 172.21.15.55:0/2527234470 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc40a8ba0 con 0x7f1dc806b970 2023-08-25T04:03:09.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.779+0000 7f1dbe7fc640 1 -- 172.21.15.55:0/2527234470 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc40a8d20 con 0x7f1dc806b970 2023-08-25T04:03:09.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.779+0000 7f1dbe7fc640 1 -- 172.21.15.55:0/2527234470 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc400b390 con 0x7f1dc806b970 2023-08-25T04:03:09.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.775+0000 7fa569ffb640 1 -- 172.21.15.55:0/4047654056 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa570003ba0 con 0x7fa5740ac7e0 2023-08-25T04:03:09.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.779+0000 7fa619ffb640 1 -- 172.21.15.55:0/795349778 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614011630 con 0x7fa6240ad590 2023-08-25T04:03:09.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.779+0000 7fa62b78f640 1 -- 172.21.15.55:0/795349778 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa624151880 con 0x7fa6240ad590 2023-08-25T04:03:09.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.779+0000 7f1dd0034640 1 -- 172.21.15.55:0/2527234470 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc81fd200 con 0x7f1dc806b970 2023-08-25T04:03:09.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.779+0000 7f122cff9640 1 -- 172.21.15.55:0/2787173114 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f12200eb140 con 0x7f12300ad590 2023-08-25T04:03:09.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.779+0000 7f1dd0034640 1 -- 172.21.15.55:0/2527234470 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc81fd7c0 con 0x7f1dc806b970 2023-08-25T04:03:09.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.779+0000 7fa569ffb640 1 -- 172.21.15.55:0/4047654056 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57000f040 con 0x7fa5740ac7e0 2023-08-25T04:03:09.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.779+0000 7fa569ffb640 1 -- 172.21.15.55:0/4047654056 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa570004030 con 0x7fa5740ac7e0 2023-08-25T04:03:09.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.779+0000 7fa57b544640 1 -- 172.21.15.55:0/4047654056 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5740b1e40 con 0x7fa5740ac7e0 2023-08-25T04:03:09.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.779+0000 7fa57b544640 1 -- 172.21.15.55:0/4047654056 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5740c4560 con 0x7fa5740ac7e0 2023-08-25T04:03:09.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.779+0000 7fa62b78f640 1 -- 172.21.15.55:0/795349778 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6240c77c0 con 0x7fa6240ad590 2023-08-25T04:03:09.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.779+0000 7f1dd0034640 1 -- 172.21.15.55:0/2527234470 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc80afc30 con 0x7f1dc806b970 2023-08-25T04:03:09.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.779+0000 7f886a7fc640 1 -- 172.21.15.55:0/2732646788 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f88700ebd00 con 0x7f88740cac10 2023-08-25T04:03:09.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.779+0000 7fa619ffb640 1 -- 172.21.15.55:0/795349778 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa614011790 con 0x7fa6240ad590 2023-08-25T04:03:09.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.779+0000 7fa57b544640 1 -- 172.21.15.55:0/4047654056 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa574073e50 con 0x7fa5740ac7e0 2023-08-25T04:03:09.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.783+0000 7fa619ffb640 1 --2- 172.21.15.55:0/795349778 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa608065750 0x7fa608067c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.783+0000 7fa619ffb640 1 -- 172.21.15.55:0/795349778 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa614082a70 con 0x7fa6240ad590 2023-08-25T04:03:09.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.783+0000 7fa569ffb640 1 -- 172.21.15.55:0/4047654056 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa570004190 con 0x7fa5740ac7e0 2023-08-25T04:03:09.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.783+0000 7f1dbe7fc640 1 -- 172.21.15.55:0/2527234470 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1dc400b4f0 con 0x7f1dc806b970 2023-08-25T04:03:09.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.783+0000 7f1dbe7fc640 1 --2- 172.21.15.55:0/2527234470 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1dac0656b0 0x7f1dac067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.783+0000 7f1dbe7fc640 1 -- 172.21.15.55:0/2527234470 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1dc412da00 con 0x7f1dc806b970 2023-08-25T04:03:09.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.783+0000 7fa62952b640 1 --2- 172.21.15.55:0/795349778 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa608065750 0x7fa608067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.783+0000 7f1dcd5cf640 1 --2- 172.21.15.55:0/2527234470 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1dac0656b0 0x7f1dac067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.783+0000 7fa62952b640 1 --2- 172.21.15.55:0/795349778 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa608065750 0x7fa608067c10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa6240c2980 tx=0x7fa620009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.783+0000 7fa569ffb640 1 --2- 172.21.15.55:0/4047654056 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa558065680 0x7fa558067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.783+0000 7f1dcd5cf640 1 --2- 172.21.15.55:0/2527234470 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1dac0656b0 0x7f1dac067b70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8071990 tx=0x7f1db80090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.783+0000 7fa569ffb640 1 -- 172.21.15.55:0/4047654056 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa570083610 con 0x7fa5740ac7e0 2023-08-25T04:03:09.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.787+0000 7fa5792e0640 1 --2- 172.21.15.55:0/4047654056 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa558065680 0x7fa558067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.787+0000 7fa619ffb640 1 -- 172.21.15.55:0/795349778 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa614050510 con 0x7fa6240ad590 2023-08-25T04:03:09.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.787+0000 7fa5792e0640 1 --2- 172.21.15.55:0/4047654056 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa558065680 0x7fa558067b40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa56c005890 tx=0x7fa56c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.791+0000 7fa569ffb640 1 -- 172.21.15.55:0/4047654056 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa5700511f0 con 0x7fa5740ac7e0 2023-08-25T04:03:09.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.795+0000 7f1dbe7fc640 1 -- 172.21.15.55:0/2527234470 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1dc40fb4d0 con 0x7f1dc806b970 2023-08-25T04:03:09.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.811+0000 7f15d8944640 1 Processor -- start 2023-08-25T04:03:09.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.811+0000 7f15d8944640 1 -- start start 2023-08-25T04:03:09.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.811+0000 7f15d8944640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15d40cdde0 0x7f15d40ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.811+0000 7f15d8944640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f15d40b2e40 0x7f15d40b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.811+0000 7f15d8944640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d40b29b0 con 0x7f15d40d0da0 2023-08-25T04:03:09.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.811+0000 7f15d8944640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d40ce760 con 0x7f15d40cdde0 2023-08-25T04:03:09.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.811+0000 7f15d8944640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d40b1dc0 con 0x7f15d40b2e40 2023-08-25T04:03:09.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.811+0000 7f15d2d9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f15d40b2e40 0x7f15d40b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.811+0000 7f15d1d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15d40cdde0 0x7f15d40ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.811+0000 7f15d259c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f15d40d0da0 0x7f15d40d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:49776/0 (socket says 172.21.15.55:49776) 2023-08-25T04:03:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.811+0000 7f15d259c640 1 -- 172.21.15.55:0/3642013031 learned_addr learned my addr 172.21.15.55:0/3642013031 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.811+0000 7f15d159a640 1 -- 172.21.15.55:0/3642013031 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930344319 0 0) 0x7f15d40b29b0 con 0x7f15d40d0da0 2023-08-25T04:03:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.811+0000 7f15d159a640 1 -- 172.21.15.55:0/3642013031 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15bc003530 con 0x7f15d40d0da0 2023-08-25T04:03:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.811+0000 7f15d2d9d640 1 -- 172.21.15.55:0/3642013031 >> v2:172.21.15.55:3300/0 conn(0x7f15d40cdde0 msgr2=0x7f15d40ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.811+0000 7f15d2d9d640 1 --2- 172.21.15.55:0/3642013031 >> v2:172.21.15.55:3300/0 conn(0x7f15d40cdde0 0x7f15d40ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.811+0000 7f15d2d9d640 1 -- 172.21.15.55:0/3642013031 >> v1:172.21.15.110:6789/0 conn(0x7f15d40d0da0 legacy=0x7f15d40d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.811+0000 7f15d2d9d640 1 -- 172.21.15.55:0/3642013031 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d40b2080 con 0x7f15d40b2e40 2023-08-25T04:03:09.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.811+0000 7f15d1d9b640 1 --2- 172.21.15.55:0/3642013031 >> v2:172.21.15.55:3300/0 conn(0x7f15d40cdde0 0x7f15d40ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:09.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.819+0000 7f15d2d9d640 1 --2- 172.21.15.55:0/3642013031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15d40b2e40 0x7f15d40b32b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f15d40ceae0 tx=0x7f15cc01f0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df766478ada66baf server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.819+0000 7f15d159a640 1 -- 172.21.15.55:0/3642013031 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0b0440 con 0x7f15d40b2e40 2023-08-25T04:03:09.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.819+0000 7f15d159a640 1 -- 172.21.15.55:0/3642013031 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15cc0b05a0 con 0x7f15d40b2e40 2023-08-25T04:03:09.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.819+0000 7f15d159a640 1 -- 172.21.15.55:0/3642013031 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0b0930 con 0x7f15d40b2e40 2023-08-25T04:03:09.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.819+0000 7f15d8944640 1 -- 172.21.15.55:0/3642013031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15d40b2e40 msgr2=0x7f15d40b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.819+0000 7f15d8944640 1 --2- 172.21.15.55:0/3642013031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15d40b2e40 0x7f15d40b32b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f15d40ceae0 tx=0x7f15cc01f0f0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.819+0000 7f15d8944640 1 -- 172.21.15.55:0/3642013031 shutdown_connections 2023-08-25T04:03:09.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.819+0000 7f15d8944640 1 --2- 172.21.15.55:0/3642013031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15d40b2e40 0x7f15d40b32b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.819+0000 7f15d8944640 1 --2- 172.21.15.55:0/3642013031 >> v2:172.21.15.55:3300/0 conn(0x7f15d40cdde0 0x7f15d40ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.819+0000 7f15d8944640 1 -- 172.21.15.55:0/3642013031 >> 172.21.15.55:0/3642013031 conn(0x7f15d409bae0 msgr2=0x7f15d40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:09.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.819+0000 7f15d8944640 1 -- 172.21.15.55:0/3642013031 shutdown_connections 2023-08-25T04:03:09.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.819+0000 7f15d8944640 1 -- 172.21.15.55:0/3642013031 wait complete. 2023-08-25T04:03:09.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d8944640 1 Processor -- start 2023-08-25T04:03:09.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d8944640 1 -- start start 2023-08-25T04:03:09.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d8944640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15d40b2e40 0x7f15d40c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d8944640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15d40cdde0 0x7f15d41f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d8944640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15d40d0da0 0x7f15d41f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d8944640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d40ca580 con 0x7f15d40d0da0 2023-08-25T04:03:09.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d8944640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d40cc560 con 0x7f15d40cdde0 2023-08-25T04:03:09.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d8944640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d40ca820 con 0x7f15d40b2e40 2023-08-25T04:03:09.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d1d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15d40cdde0 0x7f15d41f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d259c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15d40b2e40 0x7f15d40c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d1d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15d40cdde0 0x7f15d41f5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:38942/0 (socket says 172.21.15.55:38942) 2023-08-25T04:03:09.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d1d9b640 1 -- 172.21.15.55:0/892507087 learned_addr learned my addr 172.21.15.55:0/892507087 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:09.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d2d9d640 1 --2- 172.21.15.55:0/892507087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15d40d0da0 0x7f15d41f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d1d9b640 1 -- 172.21.15.55:0/892507087 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15d40b2e40 msgr2=0x7f15d40c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d1d9b640 1 --2- 172.21.15.55:0/892507087 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15d40b2e40 0x7f15d40c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d1d9b640 1 -- 172.21.15.55:0/892507087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15d40d0da0 msgr2=0x7f15d41f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d1d9b640 1 --2- 172.21.15.55:0/892507087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15d40d0da0 0x7f15d41f5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d1d9b640 1 -- 172.21.15.55:0/892507087 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c8009420 con 0x7f15d40cdde0 2023-08-25T04:03:09.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d259c640 1 --2- 172.21.15.55:0/892507087 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15d40b2e40 0x7f15d40c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:09.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d2d9d640 1 --2- 172.21.15.55:0/892507087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15d40d0da0 0x7f15d41f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:09.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d1d9b640 1 --2- 172.21.15.55:0/892507087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15d40cdde0 0x7f15d41f5550 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f15c800ebe0 tx=0x7f15c800c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15c2ffd640 1 -- 172.21.15.55:0/892507087 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c800eee0 con 0x7f15d40cdde0 2023-08-25T04:03:09.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.823+0000 7f15d8944640 1 -- 172.21.15.55:0/892507087 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15cc009a70 con 0x7f15d40cdde0 2023-08-25T04:03:09.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.827+0000 7f15d8944640 1 -- 172.21.15.55:0/892507087 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d40cade0 con 0x7f15d40cdde0 2023-08-25T04:03:09.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.827+0000 7f15c2ffd640 1 -- 172.21.15.55:0/892507087 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c800cc30 con 0x7f15d40cdde0 2023-08-25T04:03:09.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.827+0000 7f15c2ffd640 1 -- 172.21.15.55:0/892507087 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c8013470 con 0x7f15d40cdde0 2023-08-25T04:03:09.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.827+0000 7f15d8944640 1 -- 172.21.15.55:0/892507087 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b8005260 con 0x7f15d40cdde0 2023-08-25T04:03:09.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.827+0000 7f15c2ffd640 1 -- 172.21.15.55:0/892507087 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f15c8013610 con 0x7f15d40cdde0 2023-08-25T04:03:09.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.831+0000 7f15c2ffd640 1 --2- 172.21.15.55:0/892507087 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f15b40656b0 0x7f15b4067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.831+0000 7f15c2ffd640 1 -- 172.21.15.55:0/892507087 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15c80830b0 con 0x7f15d40cdde0 2023-08-25T04:03:09.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.831+0000 7f15d259c640 1 --2- 172.21.15.55:0/892507087 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f15b40656b0 0x7f15b4067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.831+0000 7f15d259c640 1 --2- 172.21.15.55:0/892507087 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f15b40656b0 0x7f15b4067b70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f15c40010f0 tx=0x7f15c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.835+0000 7f15c2ffd640 1 -- 172.21.15.55:0/892507087 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f15c8050c50 con 0x7f15d40cdde0 2023-08-25T04:03:09.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.839+0000 7f1858869640 1 Processor -- start 2023-08-25T04:03:09.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.839+0000 7f1858869640 1 -- start start 2023-08-25T04:03:09.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.843+0000 7f1858869640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1854168f80 0x7f1854169360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.843+0000 7f1858869640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f185416d810 0x7f18540caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.843+0000 7f1858869640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18540c95e0 con 0x7f18540cd8c0 2023-08-25T04:03:09.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.843+0000 7f1858869640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18541698a0 con 0x7f185416d810 2023-08-25T04:03:09.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.843+0000 7f1858869640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185406c190 con 0x7f1854168f80 2023-08-25T04:03:09.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.843+0000 7f1852ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f18540cd8c0 0x7f185406b9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50522/0 (socket says 172.21.15.55:50522) 2023-08-25T04:03:09.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.843+0000 7f1852ffd640 1 -- 172.21.15.55:0/3278704055 learned_addr learned my addr 172.21.15.55:0/3278704055 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:09.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.843+0000 7f18537fe640 1 --2- 172.21.15.55:0/3278704055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1854168f80 0x7f1854169360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.843+0000 7f1853fff640 1 --2- 172.21.15.55:0/3278704055 >> v2:172.21.15.110:3300/0 conn(0x7f185416d810 0x7f18540caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.843+0000 7f18537fe640 1 -- 172.21.15.55:0/3278704055 >> v2:172.21.15.110:3300/0 conn(0x7f185416d810 msgr2=0x7f18540caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:09.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.843+0000 7f18537fe640 1 --2- 172.21.15.55:0/3278704055 >> v2:172.21.15.110:3300/0 conn(0x7f185416d810 0x7f18540caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.843+0000 7f18537fe640 1 -- 172.21.15.55:0/3278704055 >> v1:172.21.15.55:6789/0 conn(0x7f18540cd8c0 legacy=0x7f185406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.843+0000 7f18537fe640 1 -- 172.21.15.55:0/3278704055 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185406c470 con 0x7f1854168f80 2023-08-25T04:03:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.843+0000 7f1853fff640 1 --2- 172.21.15.55:0/3278704055 >> v2:172.21.15.110:3300/0 conn(0x7f185416d810 0x7f18540caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.851+0000 7f18537fe640 1 --2- 172.21.15.55:0/3278704055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1854168f80 0x7f1854169360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f184400f9b0 tx=0x7f1844024a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85101b2c3491b2c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.851+0000 7f18527fc640 1 -- 172.21.15.55:0/3278704055 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18440ada60 con 0x7f1854168f80 2023-08-25T04:03:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.851+0000 7f18527fc640 1 -- 172.21.15.55:0/3278704055 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18440adbc0 con 0x7f1854168f80 2023-08-25T04:03:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.851+0000 7f1858869640 1 -- 172.21.15.55:0/3278704055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1854168f80 msgr2=0x7f1854169360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.851+0000 7f1858869640 1 --2- 172.21.15.55:0/3278704055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1854168f80 0x7f1854169360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f184400f9b0 tx=0x7f1844024a30 comp rx=0 tx=0).stop 2023-08-25T04:03:09.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.851+0000 7f1858869640 1 -- 172.21.15.55:0/3278704055 shutdown_connections 2023-08-25T04:03:09.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.851+0000 7f1858869640 1 --2- 172.21.15.55:0/3278704055 >> v2:172.21.15.110:3300/0 conn(0x7f185416d810 0x7f18540caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.851+0000 7f1858869640 1 --2- 172.21.15.55:0/3278704055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1854168f80 0x7f1854169360 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.851+0000 7f1858869640 1 -- 172.21.15.55:0/3278704055 >> 172.21.15.55:0/3278704055 conn(0x7f185406d3a0 msgr2=0x7f185406d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:09.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.855+0000 7f1858869640 1 -- 172.21.15.55:0/3278704055 shutdown_connections 2023-08-25T04:03:09.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.855+0000 7f1858869640 1 -- 172.21.15.55:0/3278704055 wait complete. 2023-08-25T04:03:09.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.855+0000 7f1858869640 1 Processor -- start 2023-08-25T04:03:09.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.859+0000 7f1858869640 1 -- start start 2023-08-25T04:03:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.859+0000 7f1858869640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18540cd8c0 0x7f1854209770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.859+0000 7f1858869640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f185416d810 0x7f18540c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.859+0000 7f18537fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18540cd8c0 0x7f1854209770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.859+0000 7f18537fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18540cd8c0 0x7f1854209770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:38960/0 (socket says 172.21.15.55:38960) 2023-08-25T04:03:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.859+0000 7f18537fe640 1 -- 172.21.15.55:0/3325976286 learned_addr learned my addr 172.21.15.55:0/3325976286 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.859+0000 7f1852ffd640 1 --2- 172.21.15.55:0/3325976286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f185416d810 0x7f18540c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.859+0000 7f1858869640 1 --2- 172.21.15.55:0/3325976286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18540c7e30 0x7f1854212fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.863+0000 7f1853fff640 1 --2- 172.21.15.55:0/3325976286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18540c7e30 0x7f1854212fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.863+0000 7f1858869640 1 -- 172.21.15.55:0/3325976286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18540c5f80 con 0x7f18540c7e30 2023-08-25T04:03:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.863+0000 7f1858869640 1 -- 172.21.15.55:0/3325976286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18540c5370 con 0x7f18540cd8c0 2023-08-25T04:03:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.863+0000 7f1858869640 1 -- 172.21.15.55:0/3325976286 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18540c5650 con 0x7f185416d810 2023-08-25T04:03:09.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.863+0000 7f18537fe640 1 -- 172.21.15.55:0/3325976286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f185416d810 msgr2=0x7f18540c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.863+0000 7f18537fe640 1 --2- 172.21.15.55:0/3325976286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f185416d810 0x7f18540c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.863+0000 7f18537fe640 1 -- 172.21.15.55:0/3325976286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18540c7e30 msgr2=0x7f1854212fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.863+0000 7f18537fe640 1 --2- 172.21.15.55:0/3325976286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18540c7e30 0x7f1854212fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.863+0000 7f18537fe640 1 -- 172.21.15.55:0/3325976286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184800b4c0 con 0x7f18540cd8c0 2023-08-25T04:03:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.863+0000 7f18537fe640 1 --2- 172.21.15.55:0/3325976286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18540cd8c0 0x7f1854209770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f18440230e0 tx=0x7f18440217d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.863+0000 7f183bfff640 1 -- 172.21.15.55:0/3325976286 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844018020 con 0x7f18540cd8c0 2023-08-25T04:03:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.863+0000 7f1858869640 1 -- 172.21.15.55:0/3325976286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184400f610 con 0x7f18540cd8c0 2023-08-25T04:03:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.863+0000 7f183bfff640 1 -- 172.21.15.55:0/3325976286 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18440181a0 con 0x7f18540cd8c0 2023-08-25T04:03:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.863+0000 7f1858869640 1 -- 172.21.15.55:0/3325976286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18540c5c10 con 0x7f18540cd8c0 2023-08-25T04:03:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.863+0000 7f183bfff640 1 -- 172.21.15.55:0/3325976286 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844018550 con 0x7f18540cd8c0 2023-08-25T04:03:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.867+0000 7f1839ffb640 1 -- 172.21.15.55:0/3325976286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1854073e50 con 0x7f18540cd8c0 2023-08-25T04:03:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.867+0000 7f183bfff640 1 -- 172.21.15.55:0/3325976286 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f18440be400 con 0x7f18540cd8c0 2023-08-25T04:03:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.871+0000 7f183bfff640 1 --2- 172.21.15.55:0/3325976286 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1840065750 0x7f1840067c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.871+0000 7f183bfff640 1 -- 172.21.15.55:0/3325976286 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f184411d1c0 con 0x7f18540cd8c0 2023-08-25T04:03:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.871+0000 7f1852ffd640 1 --2- 172.21.15.55:0/3325976286 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1840065750 0x7f1840067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.871+0000 7f1852ffd640 1 --2- 172.21.15.55:0/3325976286 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1840065750 0x7f1840067c10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f184c000f90 tx=0x7f184c001260 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:09.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:09.871+0000 7f183bfff640 1 -- 172.21.15.55:0/3325976286 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f18440ead10 con 0x7f18540cd8c0 2023-08-25T04:03:10.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.043+0000 7f909c219640 1 -- 172.21.15.55:0/1261866118 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f907c005510 con 0x7f90940ac7e0 2023-08-25T04:03:10.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.043+0000 7f908a7fc640 1 -- 172.21.15.55:0/1261866118 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f908c050560 con 0x7f90940ac7e0 2023-08-25T04:03:10.049 INFO:teuthology.orchestra.run.smithi055.stdout:60129542150 2023-08-25T04:03:10.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.047+0000 7f9077fff640 1 -- 172.21.15.55:0/1261866118 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9078065750 msgr2=0x7f9078067c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.047+0000 7f9077fff640 1 --2- 172.21.15.55:0/1261866118 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9078065750 0x7f9078067c10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f90900ad000 tx=0x7f9090008040 comp rx=0 tx=0).stop 2023-08-25T04:03:10.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.047+0000 7f9077fff640 1 -- 172.21.15.55:0/1261866118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90940ac7e0 msgr2=0x7f90940c1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.047+0000 7f9077fff640 1 --2- 172.21.15.55:0/1261866118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90940ac7e0 0x7f90940c1910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f908c00caf0 tx=0x7f908c0021a0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.047+0000 7f9077fff640 1 -- 172.21.15.55:0/1261866118 shutdown_connections 2023-08-25T04:03:10.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.047+0000 7f9077fff640 1 --2- 172.21.15.55:0/1261866118 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9078065750 0x7f9078067c10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.047+0000 7f9077fff640 1 --2- 172.21.15.55:0/1261866118 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90941687e0 0x7f9094168c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.047+0000 7f9077fff640 1 --2- 172.21.15.55:0/1261866118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90940cc1d0 0x7f90940c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.047+0000 7f9077fff640 1 --2- 172.21.15.55:0/1261866118 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90940ac7e0 0x7f90940c1910 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.047+0000 7f9077fff640 1 -- 172.21.15.55:0/1261866118 >> 172.21.15.55:0/1261866118 conn(0x7f90940cabd0 msgr2=0x7f90941662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:10.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.047+0000 7f9077fff640 1 -- 172.21.15.55:0/1261866118 shutdown_connections 2023-08-25T04:03:10.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.047+0000 7f9077fff640 1 -- 172.21.15.55:0/1261866118 wait complete. 2023-08-25T04:03:10.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2023-08-25T04:03:10.082 DEBUG:teuthology.parallel:result is None 2023-08-25T04:03:10.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.095+0000 7f887add2640 1 -- 172.21.15.55:0/2732646788 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f887406e1d0 con 0x7f88740cac10 2023-08-25T04:03:10.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.099+0000 7f886a7fc640 1 -- 172.21.15.55:0/2732646788 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f88700b4020 con 0x7f88740cac10 2023-08-25T04:03:10.101 INFO:teuthology.orchestra.run.smithi055.stdout:60129542150 2023-08-25T04:03:10.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.099+0000 7f887add2640 1 -- 172.21.15.55:0/2732646788 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8858065750 msgr2=0x7f8858067c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.099+0000 7f887add2640 1 --2- 172.21.15.55:0/2732646788 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8858065750 0x7f8858067c10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f88740afcd0 tx=0x7f8864006f90 comp rx=0 tx=0).stop 2023-08-25T04:03:10.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.099+0000 7f887add2640 1 -- 172.21.15.55:0/2732646788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88740cac10 msgr2=0x7f88740c7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.099+0000 7f887add2640 1 --2- 172.21.15.55:0/2732646788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88740cac10 0x7f88740c7240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f887001d270 tx=0x7f887001b960 comp rx=0 tx=0).stop 2023-08-25T04:03:10.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.099+0000 7f887add2640 1 -- 172.21.15.55:0/2732646788 shutdown_connections 2023-08-25T04:03:10.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.099+0000 7f887add2640 1 --2- 172.21.15.55:0/2732646788 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8858065750 0x7f8858067c10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.099+0000 7f887add2640 1 --2- 172.21.15.55:0/2732646788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88740c9bd0 0x7f8874150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.099+0000 7f887add2640 1 --2- 172.21.15.55:0/2732646788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88740cd820 0x7f88741497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.099+0000 7f887add2640 1 --2- 172.21.15.55:0/2732646788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88740cac10 0x7f88740c7240 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.099+0000 7f887add2640 1 -- 172.21.15.55:0/2732646788 >> 172.21.15.55:0/2732646788 conn(0x7f887406d3a0 msgr2=0x7f88740ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:10.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.099+0000 7f887add2640 1 -- 172.21.15.55:0/2732646788 shutdown_connections 2023-08-25T04:03:10.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.103+0000 7f887add2640 1 -- 172.21.15.55:0/2732646788 wait complete. 2023-08-25T04:03:10.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.119+0000 7fa57b544640 1 -- 172.21.15.55:0/4047654056 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa5740b19c0 con 0x7fa5740ac7e0 2023-08-25T04:03:10.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.119+0000 7fa569ffb640 1 -- 172.21.15.55:0/4047654056 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5740b19c0 con 0x7fa5740ac7e0 2023-08-25T04:03:10.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2023-08-25T04:03:10.125 INFO:teuthology.orchestra.run.smithi055.stdout:60129542150 2023-08-25T04:03:10.126 DEBUG:teuthology.parallel:result is None 2023-08-25T04:03:10.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.123+0000 7f1236426640 1 -- 172.21.15.55:0/2787173114 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1210005510 con 0x7f12300ad590 2023-08-25T04:03:10.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.123+0000 7f122cff9640 1 -- 172.21.15.55:0/2787173114 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f12200a6020 con 0x7f12300ad590 2023-08-25T04:03:10.127 INFO:teuthology.orchestra.run.smithi055.stdout:64424509448 2023-08-25T04:03:10.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.123+0000 7f1236426640 1 -- 172.21.15.55:0/2787173114 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f121c065780 msgr2=0x7f121c067c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.123+0000 7f1236426640 1 --2- 172.21.15.55:0/2787173114 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f121c065780 0x7f121c067c40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1224001810 tx=0x7f1224009040 comp rx=0 tx=0).stop 2023-08-25T04:03:10.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.123+0000 7f1236426640 1 -- 172.21.15.55:0/2787173114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12300ad590 msgr2=0x7f12300c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.123+0000 7f1236426640 1 --2- 172.21.15.55:0/2787173114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12300ad590 0x7f12300c5440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f12200097c0 tx=0x7f122001ad80 comp rx=0 tx=0).stop 2023-08-25T04:03:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.123+0000 7f1236426640 1 -- 172.21.15.55:0/2787173114 shutdown_connections 2023-08-25T04:03:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.123+0000 7f1236426640 1 --2- 172.21.15.55:0/2787173114 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f121c065780 0x7f121c067c40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.123+0000 7f1236426640 1 --2- 172.21.15.55:0/2787173114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12300c8910 0x7f12300c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.123+0000 7f1236426640 1 --2- 172.21.15.55:0/2787173114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12300ad590 0x7f12300c5440 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.123+0000 7f1236426640 1 --2- 172.21.15.55:0/2787173114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f123006c800 0x7f12300cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.123+0000 7f1236426640 1 -- 172.21.15.55:0/2787173114 >> 172.21.15.55:0/2787173114 conn(0x7f12300cabd0 msgr2=0x7f12300b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:10.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.123+0000 7f1236426640 1 -- 172.21.15.55:0/2787173114 shutdown_connections 2023-08-25T04:03:10.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.123+0000 7f1236426640 1 -- 172.21.15.55:0/2787173114 wait complete. 2023-08-25T04:03:10.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.127+0000 7fa57b544640 1 -- 172.21.15.55:0/4047654056 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa558065680 msgr2=0x7fa558067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.127+0000 7fa57b544640 1 --2- 172.21.15.55:0/4047654056 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa558065680 0x7fa558067b40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa56c005890 tx=0x7fa56c009040 comp rx=0 tx=0).stop 2023-08-25T04:03:10.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.127+0000 7fa57b544640 1 -- 172.21.15.55:0/4047654056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5740ac7e0 msgr2=0x7fa5740c4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.127+0000 7fa57b544640 1 --2- 172.21.15.55:0/4047654056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5740ac7e0 0x7fa5740c4020 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa570009fc0 tx=0x7fa57000d560 comp rx=0 tx=0).stop 2023-08-25T04:03:10.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.127+0000 7fa57b544640 1 -- 172.21.15.55:0/4047654056 shutdown_connections 2023-08-25T04:03:10.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.127+0000 7fa57b544640 1 --2- 172.21.15.55:0/4047654056 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa558065680 0x7fa558067b40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.127+0000 7fa57b544640 1 --2- 172.21.15.55:0/4047654056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5740cc1d0 0x7fa574166a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.127+0000 7fa57b544640 1 --2- 172.21.15.55:0/4047654056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5740ac7e0 0x7fa5740c4020 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.127+0000 7fa57b544640 1 --2- 172.21.15.55:0/4047654056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa57406bb40 0x7fa574151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.127+0000 7fa57b544640 1 -- 172.21.15.55:0/4047654056 >> 172.21.15.55:0/4047654056 conn(0x7fa5740cabd0 msgr2=0x7fa57406b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:10.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.127+0000 7fa57b544640 1 -- 172.21.15.55:0/4047654056 shutdown_connections 2023-08-25T04:03:10.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.127+0000 7fa57b544640 1 -- 172.21.15.55:0/4047654056 wait complete. 2023-08-25T04:03:10.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.131+0000 7fa62b78f640 1 -- 172.21.15.55:0/795349778 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa624073e50 con 0x7fa6240ad590 2023-08-25T04:03:10.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.131+0000 7fa619ffb640 1 -- 172.21.15.55:0/795349778 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa614053b30 con 0x7fa6240ad590 2023-08-25T04:03:10.137 INFO:teuthology.orchestra.run.smithi055.stdout:60129542151 2023-08-25T04:03:10.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.135+0000 7fa62b78f640 1 -- 172.21.15.55:0/795349778 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa608065750 msgr2=0x7fa608067c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.135+0000 7fa62b78f640 1 --2- 172.21.15.55:0/795349778 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa608065750 0x7fa608067c10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa6240c2980 tx=0x7fa620009040 comp rx=0 tx=0).stop 2023-08-25T04:03:10.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.139+0000 7fa62b78f640 1 -- 172.21.15.55:0/795349778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6240ad590 msgr2=0x7fa62414f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.139+0000 7fa62b78f640 1 --2- 172.21.15.55:0/795349778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6240ad590 0x7fa62414f960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa61400b410 tx=0x7fa61400b8d0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.139+0000 7fa62b78f640 1 -- 172.21.15.55:0/795349778 shutdown_connections 2023-08-25T04:03:10.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.139+0000 7fa62b78f640 1 --2- 172.21.15.55:0/795349778 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa608065750 0x7fa608067c10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.139+0000 7fa62b78f640 1 --2- 172.21.15.55:0/795349778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6240c9920 0x7fa6240c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.139+0000 7fa62b78f640 1 --2- 172.21.15.55:0/795349778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6240ad590 0x7fa62414f960 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.139+0000 7fa62b78f640 1 --2- 172.21.15.55:0/795349778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa62406c800 0x7fa624151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.139+0000 7fa62b78f640 1 -- 172.21.15.55:0/795349778 >> 172.21.15.55:0/795349778 conn(0x7fa6240cabd0 msgr2=0x7fa624154220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:10.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.139+0000 7fa62b78f640 1 -- 172.21.15.55:0/795349778 shutdown_connections 2023-08-25T04:03:10.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.139+0000 7fa62b78f640 1 -- 172.21.15.55:0/795349778 wait complete. 2023-08-25T04:03:10.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.139+0000 7f1dd0034640 1 -- 172.21.15.55:0/2527234470 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1dc80cd410 con 0x7f1dc806b970 2023-08-25T04:03:10.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.139+0000 7f1dbe7fc640 1 -- 172.21.15.55:0/2527234470 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1dc40d1090 con 0x7f1dc806b970 2023-08-25T04:03:10.145 INFO:teuthology.orchestra.run.smithi055.stdout:60129542151 2023-08-25T04:03:10.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.143+0000 7f1dd0034640 1 -- 172.21.15.55:0/2527234470 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1dac0656b0 msgr2=0x7f1dac067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.143+0000 7f1dd0034640 1 --2- 172.21.15.55:0/2527234470 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1dac0656b0 0x7f1dac067b70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8071990 tx=0x7f1db80090e0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.143+0000 7f1dd0034640 1 -- 172.21.15.55:0/2527234470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc806b970 msgr2=0x7f1dc81fcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.143+0000 7f1dd0034640 1 --2- 172.21.15.55:0/2527234470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc806b970 0x7f1dc81fcc20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1dc40b3040 tx=0x7f1dc401d280 comp rx=0 tx=0).stop 2023-08-25T04:03:10.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.143+0000 7f1dd0034640 1 -- 172.21.15.55:0/2527234470 shutdown_connections 2023-08-25T04:03:10.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.143+0000 7f1dd0034640 1 --2- 172.21.15.55:0/2527234470 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1dac0656b0 0x7f1dac067b70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.143+0000 7f1dd0034640 1 --2- 172.21.15.55:0/2527234470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1dc80cc1d0 0x7f1dc81fc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.143+0000 7f1dd0034640 1 --2- 172.21.15.55:0/2527234470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1dc80ac7e0 0x7f1dc80ae5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.143+0000 7f1dd0034640 1 --2- 172.21.15.55:0/2527234470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1dc806b970 0x7f1dc81fcc20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.143+0000 7f1dd0034640 1 -- 172.21.15.55:0/2527234470 >> 172.21.15.55:0/2527234470 conn(0x7f1dc80cabd0 msgr2=0x7f1dc8070db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:10.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.143+0000 7f1dd0034640 1 -- 172.21.15.55:0/2527234470 shutdown_connections 2023-08-25T04:03:10.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.143+0000 7f1dd0034640 1 -- 172.21.15.55:0/2527234470 wait complete. 2023-08-25T04:03:10.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.151+0000 7f15d8944640 1 -- 172.21.15.55:0/892507087 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f15b80050d0 con 0x7f15d40cdde0 2023-08-25T04:03:10.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.151+0000 7f15c2ffd640 1 -- 172.21.15.55:0/892507087 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f15c8054270 con 0x7f15d40cdde0 2023-08-25T04:03:10.152 INFO:teuthology.orchestra.run.smithi055.stdout:64424509448 2023-08-25T04:03:10.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.151+0000 7f15d8944640 1 -- 172.21.15.55:0/892507087 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f15b40656b0 msgr2=0x7f15b4067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.151+0000 7f15d8944640 1 --2- 172.21.15.55:0/892507087 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f15b40656b0 0x7f15b4067b70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f15c40010f0 tx=0x7f15c4009040 comp rx=0 tx=0).stop 2023-08-25T04:03:10.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.151+0000 7f15d8944640 1 -- 172.21.15.55:0/892507087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15d40cdde0 msgr2=0x7f15d41f5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.151+0000 7f15d8944640 1 --2- 172.21.15.55:0/892507087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15d40cdde0 0x7f15d41f5550 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f15c800ebe0 tx=0x7f15c800c520 comp rx=0 tx=0).stop 2023-08-25T04:03:10.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.151+0000 7f15d8944640 1 -- 172.21.15.55:0/892507087 shutdown_connections 2023-08-25T04:03:10.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.151+0000 7f15d8944640 1 --2- 172.21.15.55:0/892507087 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f15b40656b0 0x7f15b4067b70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.151+0000 7f15d8944640 1 --2- 172.21.15.55:0/892507087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15d40d0da0 0x7f15d41f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.151+0000 7f15d8944640 1 --2- 172.21.15.55:0/892507087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15d40cdde0 0x7f15d41f5550 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.151+0000 7f15d8944640 1 --2- 172.21.15.55:0/892507087 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15d40b2e40 0x7f15d40c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.151+0000 7f15d8944640 1 -- 172.21.15.55:0/892507087 >> 172.21.15.55:0/892507087 conn(0x7f15d409bae0 msgr2=0x7f15d406ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:10.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.151+0000 7f15d8944640 1 -- 172.21.15.55:0/892507087 shutdown_connections 2023-08-25T04:03:10.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.151+0000 7f15d8944640 1 -- 172.21.15.55:0/892507087 wait complete. 2023-08-25T04:03:10.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.6 2023-08-25T04:03:10.157 DEBUG:teuthology.parallel:result is None 2023-08-25T04:03:10.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2023-08-25T04:03:10.167 DEBUG:teuthology.parallel:result is None 2023-08-25T04:03:10.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.1 2023-08-25T04:03:10.173 DEBUG:teuthology.parallel:result is None 2023-08-25T04:03:10.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.2 2023-08-25T04:03:10.174 DEBUG:teuthology.parallel:result is None 2023-08-25T04:03:10.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.7 2023-08-25T04:03:10.179 DEBUG:teuthology.parallel:result is None 2023-08-25T04:03:10.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.183+0000 7f1839ffb640 1 -- 172.21.15.55:0/3325976286 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f185406e100 con 0x7f18540cd8c0 2023-08-25T04:03:10.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.183+0000 7f183bfff640 1 -- 172.21.15.55:0/3325976286 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f18440186b0 con 0x7f18540cd8c0 2023-08-25T04:03:10.185 INFO:teuthology.orchestra.run.smithi055.stdout:60129542150 2023-08-25T04:03:10.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.183+0000 7f1839ffb640 1 -- 172.21.15.55:0/3325976286 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1840065750 msgr2=0x7f1840067c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.183+0000 7f1839ffb640 1 --2- 172.21.15.55:0/3325976286 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1840065750 0x7f1840067c10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f184c000f90 tx=0x7f184c001260 comp rx=0 tx=0).stop 2023-08-25T04:03:10.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.183+0000 7f1839ffb640 1 -- 172.21.15.55:0/3325976286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18540cd8c0 msgr2=0x7f1854209770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.183+0000 7f1839ffb640 1 --2- 172.21.15.55:0/3325976286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18540cd8c0 0x7f1854209770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f18440230e0 tx=0x7f18440217d0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.183+0000 7f1839ffb640 1 -- 172.21.15.55:0/3325976286 shutdown_connections 2023-08-25T04:03:10.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.183+0000 7f1839ffb640 1 --2- 172.21.15.55:0/3325976286 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1840065750 0x7f1840067c10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.183+0000 7f1839ffb640 1 --2- 172.21.15.55:0/3325976286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18540c7e30 0x7f1854212fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.183+0000 7f1839ffb640 1 --2- 172.21.15.55:0/3325976286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f185416d810 0x7f18540c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.183+0000 7f1839ffb640 1 --2- 172.21.15.55:0/3325976286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18540cd8c0 0x7f1854209770 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.183+0000 7f1839ffb640 1 -- 172.21.15.55:0/3325976286 >> 172.21.15.55:0/3325976286 conn(0x7f185406d3a0 msgr2=0x7f1854169180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:10.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.183+0000 7f1839ffb640 1 -- 172.21.15.55:0/3325976286 shutdown_connections 2023-08-25T04:03:10.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.183+0000 7f1839ffb640 1 -- 172.21.15.55:0/3325976286 wait complete. 2023-08-25T04:03:10.206 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2023-08-25T04:03:10.207 DEBUG:teuthology.parallel:result is None 2023-08-25T04:03:10.207 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-25T04:03:10.208 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:03:10.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.391+0000 7fa995434640 1 Processor -- start 2023-08-25T04:03:10.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.391+0000 7fa995434640 1 -- start start 2023-08-25T04:03:10.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.391+0000 7fa995434640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9900cdde0 0x7fa9900ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:10.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.391+0000 7fa995434640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9900b2e40 0x7fa9900b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:10.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.391+0000 7fa995434640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9900b29b0 con 0x7fa9900d0da0 2023-08-25T04:03:10.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.391+0000 7fa995434640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9900ce760 con 0x7fa9900b2e40 2023-08-25T04:03:10.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.391+0000 7fa995434640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9900b1dc0 con 0x7fa9900cdde0 2023-08-25T04:03:10.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.395+0000 7fa98f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9900b2e40 0x7fa9900b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:10.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.395+0000 7fa98f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9900b2e40 0x7fa9900b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35958/0 (socket says 172.21.15.55:35958) 2023-08-25T04:03:10.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.395+0000 7fa98f7fe640 1 -- 172.21.15.55:0/2460646752 learned_addr learned my addr 172.21.15.55:0/2460646752 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:10.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.395+0000 7fa9867fc640 1 --2- 172.21.15.55:0/2460646752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9900cdde0 0x7fa9900ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:10.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.395+0000 7fa98f7fe640 1 -- 172.21.15.55:0/2460646752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9900cdde0 msgr2=0x7fa9900ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:10.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.395+0000 7fa98f7fe640 1 --2- 172.21.15.55:0/2460646752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9900cdde0 0x7fa9900ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.395+0000 7fa98f7fe640 1 -- 172.21.15.55:0/2460646752 >> v1:172.21.15.110:6789/0 conn(0x7fa9900d0da0 legacy=0x7fa9900d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.395+0000 7fa98f7fe640 1 -- 172.21.15.55:0/2460646752 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9900b2080 con 0x7fa9900b2e40 2023-08-25T04:03:10.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.395+0000 7fa98f7fe640 1 --2- 172.21.15.55:0/2460646752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900b2e40 0x7fa9900b32d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa988009870 tx=0x7fa98801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792682a739ff3f6f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:10.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.395+0000 7fa98e7fc640 1 -- 172.21.15.55:0/2460646752 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9880a8a30 con 0x7fa9900b2e40 2023-08-25T04:03:10.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.395+0000 7fa98e7fc640 1 -- 172.21.15.55:0/2460646752 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9880a8b90 con 0x7fa9900b2e40 2023-08-25T04:03:10.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.395+0000 7fa98e7fc640 1 -- 172.21.15.55:0/2460646752 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9880b0440 con 0x7fa9900b2e40 2023-08-25T04:03:10.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa995434640 1 -- 172.21.15.55:0/2460646752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900b2e40 msgr2=0x7fa9900b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa995434640 1 --2- 172.21.15.55:0/2460646752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900b2e40 0x7fa9900b32d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa988009870 tx=0x7fa98801ed30 comp rx=0 tx=0).stop 2023-08-25T04:03:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa995434640 1 -- 172.21.15.55:0/2460646752 shutdown_connections 2023-08-25T04:03:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa995434640 1 --2- 172.21.15.55:0/2460646752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900b2e40 0x7fa9900b32d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa995434640 1 --2- 172.21.15.55:0/2460646752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9900cdde0 0x7fa9900ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa995434640 1 -- 172.21.15.55:0/2460646752 >> 172.21.15.55:0/2460646752 conn(0x7fa99009bae0 msgr2=0x7fa9900d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:10.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa995434640 1 -- 172.21.15.55:0/2460646752 shutdown_connections 2023-08-25T04:03:10.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa995434640 1 -- 172.21.15.55:0/2460646752 wait complete. 2023-08-25T04:03:10.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa995434640 1 Processor -- start 2023-08-25T04:03:10.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa995434640 1 -- start start 2023-08-25T04:03:10.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa995434640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9900b2e40 0x7fa99014f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa995434640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900cdde0 0x7fa9901f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa995434640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9900d0da0 0x7fa9900c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa995434640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9901f67a0 con 0x7fa9900cdde0 2023-08-25T04:03:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa995434640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9900c8580 con 0x7fa9900d0da0 2023-08-25T04:03:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa995434640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9900b7c80 con 0x7fa9900b2e40 2023-08-25T04:03:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa9867fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900cdde0 0x7fa9901f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa9867fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900cdde0 0x7fa9901f6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35964/0 (socket says 172.21.15.55:35964) 2023-08-25T04:03:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa9867fc640 1 -- 172.21.15.55:0/637950398 learned_addr learned my addr 172.21.15.55:0/637950398 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa98f7fe640 1 --2- 172.21.15.55:0/637950398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9900d0da0 0x7fa9900c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.399+0000 7fa98effd640 1 --2- 172.21.15.55:0/637950398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9900b2e40 0x7fa99014f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.403+0000 7fa9867fc640 1 -- 172.21.15.55:0/637950398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9900b2e40 msgr2=0x7fa99014f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.403+0000 7fa9867fc640 1 --2- 172.21.15.55:0/637950398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9900b2e40 0x7fa99014f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.403+0000 7fa9867fc640 1 -- 172.21.15.55:0/637950398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9900d0da0 msgr2=0x7fa9900c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.403+0000 7fa9867fc640 1 --2- 172.21.15.55:0/637950398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9900d0da0 0x7fa9900c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.403+0000 7fa9867fc640 1 -- 172.21.15.55:0/637950398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9880094d0 con 0x7fa9900cdde0 2023-08-25T04:03:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.403+0000 7fa98effd640 1 --2- 172.21.15.55:0/637950398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9900b2e40 0x7fa99014f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.403+0000 7fa9867fc640 1 --2- 172.21.15.55:0/637950398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900cdde0 0x7fa9901f6260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa97800d800 tx=0x7fa97800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.403+0000 7fa987fff640 1 -- 172.21.15.55:0/637950398 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97800b6c0 con 0x7fa9900cdde0 2023-08-25T04:03:10.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.403+0000 7fa987fff640 1 -- 172.21.15.55:0/637950398 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97800b820 con 0x7fa9900cdde0 2023-08-25T04:03:10.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.403+0000 7fa987fff640 1 -- 172.21.15.55:0/637950398 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97800bb90 con 0x7fa9900cdde0 2023-08-25T04:03:10.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.403+0000 7fa995434640 1 -- 172.21.15.55:0/637950398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9900b7f60 con 0x7fa9900cdde0 2023-08-25T04:03:10.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.403+0000 7fa995434640 1 -- 172.21.15.55:0/637950398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99014be70 con 0x7fa9900cdde0 2023-08-25T04:03:10.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.403+0000 7fa995434640 1 -- 172.21.15.55:0/637950398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9900b8710 con 0x7fa9900cdde0 2023-08-25T04:03:10.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.403+0000 7fa987fff640 1 -- 172.21.15.55:0/637950398 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa97800bcf0 con 0x7fa9900cdde0 2023-08-25T04:03:10.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.403+0000 7fa987fff640 1 --2- 172.21.15.55:0/637950398 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa970065680 0x7fa970067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:10.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.403+0000 7fa987fff640 1 -- 172.21.15.55:0/637950398 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa978083390 con 0x7fa9900cdde0 2023-08-25T04:03:10.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.407+0000 7fa98effd640 1 --2- 172.21.15.55:0/637950398 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa970065680 0x7fa970067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:10.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.407+0000 7fa98effd640 1 --2- 172.21.15.55:0/637950398 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa970065680 0x7fa970067b40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa9900cc630 tx=0x7fa980009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:10.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.411+0000 7fa987fff640 1 -- 172.21.15.55:0/637950398 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa978054840 con 0x7fa9900cdde0 2023-08-25T04:03:10.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.563+0000 7fa995434640 1 -- 172.21.15.55:0/637950398 --> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9900b2640 con 0x7fa970065680 2023-08-25T04:03:10.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.575+0000 7fa987fff640 1 -- 172.21.15.55:0/637950398 <== mgr.4102 v2:172.21.15.110:6832/413962747 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286690 (secure 0 0 0) 0x7fa9800039d0 con 0x7fa970065680 2023-08-25T04:03:10.578 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:10.579 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:03:10.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.579+0000 7fa995434640 1 -- 172.21.15.55:0/637950398 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa970065680 msgr2=0x7fa970067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.579+0000 7fa995434640 1 --2- 172.21.15.55:0/637950398 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa970065680 0x7fa970067b40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa9900cc630 tx=0x7fa980009040 comp rx=0 tx=0).stop 2023-08-25T04:03:10.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.579+0000 7fa995434640 1 -- 172.21.15.55:0/637950398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900cdde0 msgr2=0x7fa9901f6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.579+0000 7fa995434640 1 --2- 172.21.15.55:0/637950398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900cdde0 0x7fa9901f6260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa97800d800 tx=0x7fa97800dcc0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.579+0000 7fa995434640 1 -- 172.21.15.55:0/637950398 shutdown_connections 2023-08-25T04:03:10.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.579+0000 7fa995434640 1 --2- 172.21.15.55:0/637950398 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa970065680 0x7fa970067b40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.579+0000 7fa995434640 1 --2- 172.21.15.55:0/637950398 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9900d0da0 0x7fa9900c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.579+0000 7fa995434640 1 --2- 172.21.15.55:0/637950398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9900cdde0 0x7fa9901f6260 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.579+0000 7fa995434640 1 --2- 172.21.15.55:0/637950398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9900b2e40 0x7fa99014f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.579+0000 7fa995434640 1 -- 172.21.15.55:0/637950398 >> 172.21.15.55:0/637950398 conn(0x7fa99009bae0 msgr2=0x7fa99006b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:10.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.579+0000 7fa995434640 1 -- 172.21.15.55:0/637950398 shutdown_connections 2023-08-25T04:03:10.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.579+0000 7fa995434640 1 -- 172.21.15.55:0/637950398 wait complete. 2023-08-25T04:03:10.599 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-08-25T04:03:08.605920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244296,"kb_used_data":3144,"kb_used_omap":13,"kb_used_meta":241010,"kb_avail":754730424,"statfs":{"total":773094113280,"available":772843954176,"internally_reserved":0,"allocated":3219456,"data_stored":1920100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":246794328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.909021"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.459746+0000","last_change":"2023-08-25T04:03:01.345042+0000","last_active":"2023-08-25T04:03:03.459746+0000","last_peered":"2023-08-25T04:03:03.459746+0000","last_clean":"2023-08-25T04:03:03.459746+0000","last_became_active":"2023-08-25T04:03:01.344724+0000","last_became_peered":"2023-08-25T04:03:01.344724+0000","last_unstale":"2023-08-25T04:03:03.459746+0000","last_undegraded":"2023-08-25T04:03:03.459746+0000","last_fullsized":"2023-08-25T04:03:03.459746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:09:20.866112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711241+0000","last_change":"2023-08-25T04:03:01.362953+0000","last_active":"2023-08-25T04:03:02.711241+0000","last_peered":"2023-08-25T04:03:02.711241+0000","last_clean":"2023-08-25T04:03:02.711241+0000","last_became_active":"2023-08-25T04:03:01.362672+0000","last_became_peered":"2023-08-25T04:03:01.362672+0000","last_unstale":"2023-08-25T04:03:02.711241+0000","last_undegraded":"2023-08-25T04:03:02.711241+0000","last_fullsized":"2023-08-25T04:03:02.711241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:13:48.014358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336274+0000","last_change":"2023-08-25T04:03:01.352794+0000","last_active":"2023-08-25T04:03:02.336274+0000","last_peered":"2023-08-25T04:03:02.336274+0000","last_clean":"2023-08-25T04:03:02.336274+0000","last_became_active":"2023-08-25T04:03:01.352520+0000","last_became_peered":"2023-08-25T04:03:01.352520+0000","last_unstale":"2023-08-25T04:03:02.336274+0000","last_undegraded":"2023-08-25T04:03:02.336274+0000","last_fullsized":"2023-08-25T04:03:02.336274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:50:18.492555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335413+0000","last_change":"2023-08-25T04:03:01.348099+0000","last_active":"2023-08-25T04:03:02.335413+0000","last_peered":"2023-08-25T04:03:02.335413+0000","last_clean":"2023-08-25T04:03:02.335413+0000","last_became_active":"2023-08-25T04:03:01.347798+0000","last_became_peered":"2023-08-25T04:03:01.347798+0000","last_unstale":"2023-08-25T04:03:02.335413+0000","last_undegraded":"2023-08-25T04:03:02.335413+0000","last_fullsized":"2023-08-25T04:03:02.335413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:03.894113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857077+0000","last_change":"2023-08-25T04:03:01.350578+0000","last_active":"2023-08-25T04:03:02.857077+0000","last_peered":"2023-08-25T04:03:02.857077+0000","last_clean":"2023-08-25T04:03:02.857077+0000","last_became_active":"2023-08-25T04:03:01.350212+0000","last_became_peered":"2023-08-25T04:03:01.350212+0000","last_unstale":"2023-08-25T04:03:02.857077+0000","last_undegraded":"2023-08-25T04:03:02.857077+0000","last_fullsized":"2023-08-25T04:03:02.857077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:45.270852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335049+0000","last_change":"2023-08-25T04:03:01.353871+0000","last_active":"2023-08-25T04:03:02.335049+0000","last_peered":"2023-08-25T04:03:02.335049+0000","last_clean":"2023-08-25T04:03:02.335049+0000","last_became_active":"2023-08-25T04:03:01.353553+0000","last_became_peered":"2023-08-25T04:03:01.353553+0000","last_unstale":"2023-08-25T04:03:02.335049+0000","last_undegraded":"2023-08-25T04:03:02.335049+0000","last_fullsized":"2023-08-25T04:03:02.335049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:10:46.841700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221486+0000","last_change":"2023-08-25T04:03:01.364502+0000","last_active":"2023-08-25T04:03:03.221486+0000","last_peered":"2023-08-25T04:03:03.221486+0000","last_clean":"2023-08-25T04:03:03.221486+0000","last_became_active":"2023-08-25T04:03:01.364135+0000","last_became_peered":"2023-08-25T04:03:01.364135+0000","last_unstale":"2023-08-25T04:03:03.221486+0000","last_undegraded":"2023-08-25T04:03:03.221486+0000","last_fullsized":"2023-08-25T04:03:03.221486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:55.727274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711247+0000","last_change":"2023-08-25T04:03:01.362258+0000","last_active":"2023-08-25T04:03:02.711247+0000","last_peered":"2023-08-25T04:03:02.711247+0000","last_clean":"2023-08-25T04:03:02.711247+0000","last_became_active":"2023-08-25T04:03:01.361897+0000","last_became_peered":"2023-08-25T04:03:01.361897+0000","last_unstale":"2023-08-25T04:03:02.711247+0000","last_undegraded":"2023-08-25T04:03:02.711247+0000","last_fullsized":"2023-08-25T04:03:02.711247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:08:37.753060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857136+0000","last_change":"2023-08-25T04:03:01.354196+0000","last_active":"2023-08-25T04:03:02.857136+0000","last_peered":"2023-08-25T04:03:02.857136+0000","last_clean":"2023-08-25T04:03:02.857136+0000","last_became_active":"2023-08-25T04:03:01.353929+0000","last_became_peered":"2023-08-25T04:03:01.353929+0000","last_unstale":"2023-08-25T04:03:02.857136+0000","last_undegraded":"2023-08-25T04:03:02.857136+0000","last_fullsized":"2023-08-25T04:03:02.857136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:50:23.206799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711471+0000","last_change":"2023-08-25T04:03:01.355535+0000","last_active":"2023-08-25T04:03:02.711471+0000","last_peered":"2023-08-25T04:03:02.711471+0000","last_clean":"2023-08-25T04:03:02.711471+0000","last_became_active":"2023-08-25T04:03:01.355233+0000","last_became_peered":"2023-08-25T04:03:01.355233+0000","last_unstale":"2023-08-25T04:03:02.711471+0000","last_undegraded":"2023-08-25T04:03:02.711471+0000","last_fullsized":"2023-08-25T04:03:02.711471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:40:00.894010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336429+0000","last_change":"2023-08-25T04:03:01.350101+0000","last_active":"2023-08-25T04:03:02.336429+0000","last_peered":"2023-08-25T04:03:02.336429+0000","last_clean":"2023-08-25T04:03:02.336429+0000","last_became_active":"2023-08-25T04:03:01.347061+0000","last_became_peered":"2023-08-25T04:03:01.347061+0000","last_unstale":"2023-08-25T04:03:02.336429+0000","last_undegraded":"2023-08-25T04:03:02.336429+0000","last_fullsized":"2023-08-25T04:03:02.336429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:38:18.973058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.459589+0000","last_change":"2023-08-25T04:03:01.358731+0000","last_active":"2023-08-25T04:03:03.459589+0000","last_peered":"2023-08-25T04:03:03.459589+0000","last_clean":"2023-08-25T04:03:03.459589+0000","last_became_active":"2023-08-25T04:03:01.358447+0000","last_became_peered":"2023-08-25T04:03:01.358447+0000","last_unstale":"2023-08-25T04:03:03.459589+0000","last_undegraded":"2023-08-25T04:03:03.459589+0000","last_fullsized":"2023-08-25T04:03:03.459589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:19:38.808296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.459439+0000","last_change":"2023-08-25T04:03:01.344944+0000","last_active":"2023-08-25T04:03:03.459439+0000","last_peered":"2023-08-25T04:03:03.459439+0000","last_clean":"2023-08-25T04:03:03.459439+0000","last_became_active":"2023-08-25T04:03:01.344660+0000","last_became_peered":"2023-08-25T04:03:01.344660+0000","last_unstale":"2023-08-25T04:03:03.459439+0000","last_undegraded":"2023-08-25T04:03:03.459439+0000","last_fullsized":"2023-08-25T04:03:03.459439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:42:21.914526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711067+0000","last_change":"2023-08-25T04:03:01.354816+0000","last_active":"2023-08-25T04:03:02.711067+0000","last_peered":"2023-08-25T04:03:02.711067+0000","last_clean":"2023-08-25T04:03:02.711067+0000","last_became_active":"2023-08-25T04:03:01.354525+0000","last_became_peered":"2023-08-25T04:03:01.354525+0000","last_unstale":"2023-08-25T04:03:02.711067+0000","last_undegraded":"2023-08-25T04:03:02.711067+0000","last_fullsized":"2023-08-25T04:03:02.711067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:17.983189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221863+0000","last_change":"2023-08-25T04:03:01.363162+0000","last_active":"2023-08-25T04:03:03.221863+0000","last_peered":"2023-08-25T04:03:03.221863+0000","last_clean":"2023-08-25T04:03:03.221863+0000","last_became_active":"2023-08-25T04:03:01.362765+0000","last_became_peered":"2023-08-25T04:03:01.362765+0000","last_unstale":"2023-08-25T04:03:03.221863+0000","last_undegraded":"2023-08-25T04:03:03.221863+0000","last_fullsized":"2023-08-25T04:03:03.221863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:03.156111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335027+0000","last_change":"2023-08-25T04:03:01.353137+0000","last_active":"2023-08-25T04:03:02.335027+0000","last_peered":"2023-08-25T04:03:02.335027+0000","last_clean":"2023-08-25T04:03:02.335027+0000","last_became_active":"2023-08-25T04:03:01.352866+0000","last_became_peered":"2023-08-25T04:03:01.352866+0000","last_unstale":"2023-08-25T04:03:02.335027+0000","last_undegraded":"2023-08-25T04:03:02.335027+0000","last_fullsized":"2023-08-25T04:03:02.335027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:09:40.170139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857408+0000","last_change":"2023-08-25T04:03:01.354256+0000","last_active":"2023-08-25T04:03:02.857408+0000","last_peered":"2023-08-25T04:03:02.857408+0000","last_clean":"2023-08-25T04:03:02.857408+0000","last_became_active":"2023-08-25T04:03:01.353982+0000","last_became_peered":"2023-08-25T04:03:01.353982+0000","last_unstale":"2023-08-25T04:03:02.857408+0000","last_undegraded":"2023-08-25T04:03:02.857408+0000","last_fullsized":"2023-08-25T04:03:02.857408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:40:00.894010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336258+0000","last_change":"2023-08-25T04:03:01.342079+0000","last_active":"2023-08-25T04:03:02.336258+0000","last_peered":"2023-08-25T04:03:02.336258+0000","last_clean":"2023-08-25T04:03:02.336258+0000","last_became_active":"2023-08-25T04:03:01.341556+0000","last_became_peered":"2023-08-25T04:03:01.341556+0000","last_unstale":"2023-08-25T04:03:02.336258+0000","last_undegraded":"2023-08-25T04:03:02.336258+0000","last_fullsized":"2023-08-25T04:03:02.336258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:31:57.902690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.459699+0000","last_change":"2023-08-25T04:03:01.340781+0000","last_active":"2023-08-25T04:03:03.459699+0000","last_peered":"2023-08-25T04:03:03.459699+0000","last_clean":"2023-08-25T04:03:03.459699+0000","last_became_active":"2023-08-25T04:03:01.340444+0000","last_became_peered":"2023-08-25T04:03:01.340444+0000","last_unstale":"2023-08-25T04:03:03.459699+0000","last_undegraded":"2023-08-25T04:03:03.459699+0000","last_fullsized":"2023-08-25T04:03:03.459699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:33:15.291618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335970+0000","last_change":"2023-08-25T04:03:01.343273+0000","last_active":"2023-08-25T04:03:02.335970+0000","last_peered":"2023-08-25T04:03:02.335970+0000","last_clean":"2023-08-25T04:03:02.335970+0000","last_became_active":"2023-08-25T04:03:01.342978+0000","last_became_peered":"2023-08-25T04:03:01.342978+0000","last_unstale":"2023-08-25T04:03:02.335970+0000","last_undegraded":"2023-08-25T04:03:02.335970+0000","last_fullsized":"2023-08-25T04:03:02.335970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:12:02.187737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221697+0000","last_change":"2023-08-25T04:03:01.356873+0000","last_active":"2023-08-25T04:03:03.221697+0000","last_peered":"2023-08-25T04:03:03.221697+0000","last_clean":"2023-08-25T04:03:03.221697+0000","last_became_active":"2023-08-25T04:03:01.356524+0000","last_became_peered":"2023-08-25T04:03:01.356524+0000","last_unstale":"2023-08-25T04:03:03.221697+0000","last_undegraded":"2023-08-25T04:03:03.221697+0000","last_fullsized":"2023-08-25T04:03:03.221697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:31:57.902690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.856841+0000","last_change":"2023-08-25T04:03:01.362913+0000","last_active":"2023-08-25T04:03:02.856841+0000","last_peered":"2023-08-25T04:03:02.856841+0000","last_clean":"2023-08-25T04:03:02.856841+0000","last_became_active":"2023-08-25T04:03:01.362630+0000","last_became_peered":"2023-08-25T04:03:01.362630+0000","last_unstale":"2023-08-25T04:03:02.856841+0000","last_undegraded":"2023-08-25T04:03:02.856841+0000","last_fullsized":"2023-08-25T04:03:02.856841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:55:09.171814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.333963+0000","last_change":"2023-08-25T04:03:01.349042+0000","last_active":"2023-08-25T04:03:02.333963+0000","last_peered":"2023-08-25T04:03:02.333963+0000","last_clean":"2023-08-25T04:03:02.333963+0000","last_became_active":"2023-08-25T04:03:01.348683+0000","last_became_peered":"2023-08-25T04:03:01.348683+0000","last_unstale":"2023-08-25T04:03:02.333963+0000","last_undegraded":"2023-08-25T04:03:02.333963+0000","last_fullsized":"2023-08-25T04:03:02.333963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:49.902232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221508+0000","last_change":"2023-08-25T04:03:01.356864+0000","last_active":"2023-08-25T04:03:03.221508+0000","last_peered":"2023-08-25T04:03:03.221508+0000","last_clean":"2023-08-25T04:03:03.221508+0000","last_became_active":"2023-08-25T04:03:01.356507+0000","last_became_peered":"2023-08-25T04:03:01.356507+0000","last_unstale":"2023-08-25T04:03:03.221508+0000","last_undegraded":"2023-08-25T04:03:03.221508+0000","last_fullsized":"2023-08-25T04:03:03.221508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:07:32.176731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726476+0000","last_change":"2023-08-25T04:03:01.342638+0000","last_active":"2023-08-25T04:03:03.726476+0000","last_peered":"2023-08-25T04:03:03.726476+0000","last_clean":"2023-08-25T04:03:03.726476+0000","last_became_active":"2023-08-25T04:03:01.342295+0000","last_became_peered":"2023-08-25T04:03:01.342295+0000","last_unstale":"2023-08-25T04:03:03.726476+0000","last_undegraded":"2023-08-25T04:03:03.726476+0000","last_fullsized":"2023-08-25T04:03:03.726476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:29:51.124247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726793+0000","last_change":"2023-08-25T04:03:01.348390+0000","last_active":"2023-08-25T04:03:03.726793+0000","last_peered":"2023-08-25T04:03:03.726793+0000","last_clean":"2023-08-25T04:03:03.726793+0000","last_became_active":"2023-08-25T04:03:01.347587+0000","last_became_peered":"2023-08-25T04:03:01.347587+0000","last_unstale":"2023-08-25T04:03:03.726793+0000","last_undegraded":"2023-08-25T04:03:03.726793+0000","last_fullsized":"2023-08-25T04:03:03.726793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:16:41.881739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711233+0000","last_change":"2023-08-25T04:03:01.358436+0000","last_active":"2023-08-25T04:03:02.711233+0000","last_peered":"2023-08-25T04:03:02.711233+0000","last_clean":"2023-08-25T04:03:02.711233+0000","last_became_active":"2023-08-25T04:03:01.356095+0000","last_became_peered":"2023-08-25T04:03:01.356095+0000","last_unstale":"2023-08-25T04:03:02.711233+0000","last_undegraded":"2023-08-25T04:03:02.711233+0000","last_fullsized":"2023-08-25T04:03:02.711233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:31.298630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726832+0000","last_change":"2023-08-25T04:03:01.351628+0000","last_active":"2023-08-25T04:03:03.726832+0000","last_peered":"2023-08-25T04:03:03.726832+0000","last_clean":"2023-08-25T04:03:03.726832+0000","last_became_active":"2023-08-25T04:03:01.350541+0000","last_became_peered":"2023-08-25T04:03:01.350541+0000","last_unstale":"2023-08-25T04:03:03.726832+0000","last_undegraded":"2023-08-25T04:03:03.726832+0000","last_fullsized":"2023-08-25T04:03:03.726832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:24.755751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334503+0000","last_change":"2023-08-25T04:03:01.349534+0000","last_active":"2023-08-25T04:03:02.334503+0000","last_peered":"2023-08-25T04:03:02.334503+0000","last_clean":"2023-08-25T04:03:02.334503+0000","last_became_active":"2023-08-25T04:03:01.348968+0000","last_became_peered":"2023-08-25T04:03:01.348968+0000","last_unstale":"2023-08-25T04:03:02.334503+0000","last_undegraded":"2023-08-25T04:03:02.334503+0000","last_fullsized":"2023-08-25T04:03:02.334503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:14:51.687765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335307+0000","last_change":"2023-08-25T04:03:01.343257+0000","last_active":"2023-08-25T04:03:02.335307+0000","last_peered":"2023-08-25T04:03:02.335307+0000","last_clean":"2023-08-25T04:03:02.335307+0000","last_became_active":"2023-08-25T04:03:01.342938+0000","last_became_peered":"2023-08-25T04:03:01.342938+0000","last_unstale":"2023-08-25T04:03:02.335307+0000","last_undegraded":"2023-08-25T04:03:02.335307+0000","last_fullsized":"2023-08-25T04:03:02.335307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:31.298630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334108+0000","last_change":"2023-08-25T04:03:01.357291+0000","last_active":"2023-08-25T04:03:02.334108+0000","last_peered":"2023-08-25T04:03:02.334108+0000","last_clean":"2023-08-25T04:03:02.334108+0000","last_became_active":"2023-08-25T04:03:01.356973+0000","last_became_peered":"2023-08-25T04:03:01.356973+0000","last_unstale":"2023-08-25T04:03:02.334108+0000","last_undegraded":"2023-08-25T04:03:02.334108+0000","last_fullsized":"2023-08-25T04:03:02.334108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:21:32.310549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335221+0000","last_change":"2023-08-25T04:03:01.341244+0000","last_active":"2023-08-25T04:03:02.335221+0000","last_peered":"2023-08-25T04:03:02.335221+0000","last_clean":"2023-08-25T04:03:02.335221+0000","last_became_active":"2023-08-25T04:03:01.340907+0000","last_became_peered":"2023-08-25T04:03:01.340907+0000","last_unstale":"2023-08-25T04:03:02.335221+0000","last_undegraded":"2023-08-25T04:03:02.335221+0000","last_fullsized":"2023-08-25T04:03:02.335221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:04:24.406419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334363+0000","last_change":"2023-08-25T04:03:01.357303+0000","last_active":"2023-08-25T04:03:02.334363+0000","last_peered":"2023-08-25T04:03:02.334363+0000","last_clean":"2023-08-25T04:03:02.334363+0000","last_became_active":"2023-08-25T04:03:01.356965+0000","last_became_peered":"2023-08-25T04:03:01.356965+0000","last_unstale":"2023-08-25T04:03:02.334363+0000","last_undegraded":"2023-08-25T04:03:02.334363+0000","last_fullsized":"2023-08-25T04:03:02.334363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:42:05.413297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221859+0000","last_change":"2023-08-25T04:03:00.724082+0000","last_active":"2023-08-25T04:03:03.221859+0000","last_peered":"2023-08-25T04:03:03.221859+0000","last_clean":"2023-08-25T04:03:03.221859+0000","last_became_active":"2023-08-25T04:03:00.723792+0000","last_became_peered":"2023-08-25T04:03:00.723792+0000","last_unstale":"2023-08-25T04:03:03.221859+0000","last_undegraded":"2023-08-25T04:03:03.221859+0000","last_fullsized":"2023-08-25T04:03:03.221859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:38:17.963139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711395+0000","last_change":"2023-08-25T04:03:01.356130+0000","last_active":"2023-08-25T04:03:02.711395+0000","last_peered":"2023-08-25T04:03:02.711395+0000","last_clean":"2023-08-25T04:03:02.711395+0000","last_became_active":"2023-08-25T04:03:01.355561+0000","last_became_peered":"2023-08-25T04:03:01.355561+0000","last_unstale":"2023-08-25T04:03:02.711395+0000","last_undegraded":"2023-08-25T04:03:02.711395+0000","last_fullsized":"2023-08-25T04:03:02.711395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:55.727274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.856980+0000","last_change":"2023-08-25T04:03:00.723608+0000","last_active":"2023-08-25T04:03:02.856980+0000","last_peered":"2023-08-25T04:03:02.856980+0000","last_clean":"2023-08-25T04:03:02.856980+0000","last_became_active":"2023-08-25T04:03:00.723314+0000","last_became_peered":"2023-08-25T04:03:00.723314+0000","last_unstale":"2023-08-25T04:03:02.856980+0000","last_undegraded":"2023-08-25T04:03:02.856980+0000","last_fullsized":"2023-08-25T04:03:02.856980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:16.973270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857273+0000","last_change":"2023-08-25T04:03:01.350258+0000","last_active":"2023-08-25T04:03:02.857273+0000","last_peered":"2023-08-25T04:03:02.857273+0000","last_clean":"2023-08-25T04:03:02.857273+0000","last_became_active":"2023-08-25T04:03:01.349984+0000","last_became_peered":"2023-08-25T04:03:01.349984+0000","last_unstale":"2023-08-25T04:03:02.857273+0000","last_undegraded":"2023-08-25T04:03:02.857273+0000","last_fullsized":"2023-08-25T04:03:02.857273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:07:32.176731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221691+0000","last_change":"2023-08-25T04:03:00.725255+0000","last_active":"2023-08-25T04:03:03.221691+0000","last_peered":"2023-08-25T04:03:03.221691+0000","last_clean":"2023-08-25T04:03:03.221691+0000","last_became_active":"2023-08-25T04:03:00.724980+0000","last_became_peered":"2023-08-25T04:03:00.724980+0000","last_unstale":"2023-08-25T04:03:03.221691+0000","last_undegraded":"2023-08-25T04:03:03.221691+0000","last_fullsized":"2023-08-25T04:03:03.221691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:04.723845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334630+0000","last_change":"2023-08-25T04:03:01.345546+0000","last_active":"2023-08-25T04:03:02.334630+0000","last_peered":"2023-08-25T04:03:02.334630+0000","last_clean":"2023-08-25T04:03:02.334630+0000","last_became_active":"2023-08-25T04:03:01.345316+0000","last_became_peered":"2023-08-25T04:03:01.345316+0000","last_unstale":"2023-08-25T04:03:02.334630+0000","last_undegraded":"2023-08-25T04:03:02.334630+0000","last_fullsized":"2023-08-25T04:03:02.334630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:16:41.881739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335383+0000","last_change":"2023-08-25T04:03:00.716518+0000","last_active":"2023-08-25T04:03:02.335383+0000","last_peered":"2023-08-25T04:03:02.335383+0000","last_clean":"2023-08-25T04:03:02.335383+0000","last_became_active":"2023-08-25T04:03:00.716196+0000","last_became_peered":"2023-08-25T04:03:00.716196+0000","last_unstale":"2023-08-25T04:03:02.335383+0000","last_undegraded":"2023-08-25T04:03:02.335383+0000","last_fullsized":"2023-08-25T04:03:02.335383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:35.759065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221966+0000","last_change":"2023-08-25T04:03:00.724751+0000","last_active":"2023-08-25T04:03:03.221966+0000","last_peered":"2023-08-25T04:03:03.221966+0000","last_clean":"2023-08-25T04:03:03.221966+0000","last_became_active":"2023-08-25T04:03:00.724484+0000","last_became_peered":"2023-08-25T04:03:00.724484+0000","last_unstale":"2023-08-25T04:03:03.221966+0000","last_undegraded":"2023-08-25T04:03:03.221966+0000","last_fullsized":"2023-08-25T04:03:03.221966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:25.866072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711055+0000","last_change":"2023-08-25T04:03:01.349649+0000","last_active":"2023-08-25T04:03:02.711055+0000","last_peered":"2023-08-25T04:03:02.711055+0000","last_clean":"2023-08-25T04:03:02.711055+0000","last_became_active":"2023-08-25T04:03:01.349285+0000","last_became_peered":"2023-08-25T04:03:01.349285+0000","last_unstale":"2023-08-25T04:03:02.711055+0000","last_undegraded":"2023-08-25T04:03:02.711055+0000","last_fullsized":"2023-08-25T04:03:02.711055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:55.890269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221848+0000","last_change":"2023-08-25T04:03:00.724274+0000","last_active":"2023-08-25T04:03:03.221848+0000","last_peered":"2023-08-25T04:03:03.221848+0000","last_clean":"2023-08-25T04:03:03.221848+0000","last_became_active":"2023-08-25T04:03:00.723971+0000","last_became_peered":"2023-08-25T04:03:00.723971+0000","last_unstale":"2023-08-25T04:03:03.221848+0000","last_undegraded":"2023-08-25T04:03:03.221848+0000","last_fullsized":"2023-08-25T04:03:03.221848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:31:33.425623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335038+0000","last_change":"2023-08-25T04:03:01.352013+0000","last_active":"2023-08-25T04:03:02.335038+0000","last_peered":"2023-08-25T04:03:02.335038+0000","last_clean":"2023-08-25T04:03:02.335038+0000","last_became_active":"2023-08-25T04:03:01.351727+0000","last_became_peered":"2023-08-25T04:03:01.351727+0000","last_unstale":"2023-08-25T04:03:02.335038+0000","last_undegraded":"2023-08-25T04:03:02.335038+0000","last_fullsized":"2023-08-25T04:03:02.335038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:55:09.171814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221979+0000","last_change":"2023-08-25T04:03:00.720598+0000","last_active":"2023-08-25T04:03:03.221979+0000","last_peered":"2023-08-25T04:03:03.221979+0000","last_clean":"2023-08-25T04:03:03.221979+0000","last_became_active":"2023-08-25T04:03:00.720316+0000","last_became_peered":"2023-08-25T04:03:00.720316+0000","last_unstale":"2023-08-25T04:03:03.221979+0000","last_undegraded":"2023-08-25T04:03:03.221979+0000","last_fullsized":"2023-08-25T04:03:03.221979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:42:54.045585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335421+0000","last_change":"2023-08-25T04:03:01.357353+0000","last_active":"2023-08-25T04:03:02.335421+0000","last_peered":"2023-08-25T04:03:02.335421+0000","last_clean":"2023-08-25T04:03:02.335421+0000","last_became_active":"2023-08-25T04:03:01.356994+0000","last_became_peered":"2023-08-25T04:03:01.356994+0000","last_unstale":"2023-08-25T04:03:02.335421+0000","last_undegraded":"2023-08-25T04:03:02.335421+0000","last_fullsized":"2023-08-25T04:03:02.335421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:53:18.372759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711297+0000","last_change":"2023-08-25T04:03:00.721557+0000","last_active":"2023-08-25T04:03:02.711297+0000","last_peered":"2023-08-25T04:03:02.711297+0000","last_clean":"2023-08-25T04:03:02.711297+0000","last_became_active":"2023-08-25T04:03:00.721111+0000","last_became_peered":"2023-08-25T04:03:00.721111+0000","last_unstale":"2023-08-25T04:03:02.711297+0000","last_undegraded":"2023-08-25T04:03:02.711297+0000","last_fullsized":"2023-08-25T04:03:02.711297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:12:01.177818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.856932+0000","last_change":"2023-08-25T04:03:01.362147+0000","last_active":"2023-08-25T04:03:02.856932+0000","last_peered":"2023-08-25T04:03:02.856932+0000","last_clean":"2023-08-25T04:03:02.856932+0000","last_became_active":"2023-08-25T04:03:01.361891+0000","last_became_peered":"2023-08-25T04:03:01.361891+0000","last_unstale":"2023-08-25T04:03:02.856932+0000","last_undegraded":"2023-08-25T04:03:02.856932+0000","last_fullsized":"2023-08-25T04:03:02.856932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:55.890269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334620+0000","last_change":"2023-08-25T04:03:00.726270+0000","last_active":"2023-08-25T04:03:02.334620+0000","last_peered":"2023-08-25T04:03:02.334620+0000","last_clean":"2023-08-25T04:03:02.334620+0000","last_became_active":"2023-08-25T04:03:00.725846+0000","last_became_peered":"2023-08-25T04:03:00.725846+0000","last_unstale":"2023-08-25T04:03:02.334620+0000","last_undegraded":"2023-08-25T04:03:02.334620+0000","last_fullsized":"2023-08-25T04:03:02.334620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:23.745831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336163+0000","last_change":"2023-08-25T04:03:01.354419+0000","last_active":"2023-08-25T04:03:02.336163+0000","last_peered":"2023-08-25T04:03:02.336163+0000","last_clean":"2023-08-25T04:03:02.336163+0000","last_became_active":"2023-08-25T04:03:01.354110+0000","last_became_peered":"2023-08-25T04:03:01.354110+0000","last_unstale":"2023-08-25T04:03:02.336163+0000","last_undegraded":"2023-08-25T04:03:02.336163+0000","last_fullsized":"2023-08-25T04:03:02.336163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:55.727274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335674+0000","last_change":"2023-08-25T04:03:00.720247+0000","last_active":"2023-08-25T04:03:02.335674+0000","last_peered":"2023-08-25T04:03:02.335674+0000","last_clean":"2023-08-25T04:03:02.335674+0000","last_became_active":"2023-08-25T04:03:00.719941+0000","last_became_peered":"2023-08-25T04:03:00.719941+0000","last_unstale":"2023-08-25T04:03:02.335674+0000","last_undegraded":"2023-08-25T04:03:02.335674+0000","last_fullsized":"2023-08-25T04:03:02.335674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:31:25.565858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336512+0000","last_change":"2023-08-25T04:03:01.357912+0000","last_active":"2023-08-25T04:03:02.336512+0000","last_peered":"2023-08-25T04:03:02.336512+0000","last_clean":"2023-08-25T04:03:02.336512+0000","last_became_active":"2023-08-25T04:03:01.357568+0000","last_became_peered":"2023-08-25T04:03:01.357568+0000","last_unstale":"2023-08-25T04:03:02.336512+0000","last_undegraded":"2023-08-25T04:03:02.336512+0000","last_fullsized":"2023-08-25T04:03:02.336512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:31:34.435542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335358+0000","last_change":"2023-08-25T04:03:00.719201+0000","last_active":"2023-08-25T04:03:02.335358+0000","last_peered":"2023-08-25T04:03:02.335358+0000","last_clean":"2023-08-25T04:03:02.335358+0000","last_became_active":"2023-08-25T04:03:00.718923+0000","last_became_peered":"2023-08-25T04:03:00.718923+0000","last_unstale":"2023-08-25T04:03:02.335358+0000","last_undegraded":"2023-08-25T04:03:02.335358+0000","last_fullsized":"2023-08-25T04:03:02.335358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:50:22.196879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336371+0000","last_change":"2023-08-25T04:03:01.351447+0000","last_active":"2023-08-25T04:03:02.336371+0000","last_peered":"2023-08-25T04:03:02.336371+0000","last_clean":"2023-08-25T04:03:02.336371+0000","last_became_active":"2023-08-25T04:03:01.351187+0000","last_became_peered":"2023-08-25T04:03:01.351187+0000","last_unstale":"2023-08-25T04:03:02.336371+0000","last_undegraded":"2023-08-25T04:03:02.336371+0000","last_fullsized":"2023-08-25T04:03:02.336371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:03.156111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334088+0000","last_change":"2023-08-25T04:03:00.718022+0000","last_active":"2023-08-25T04:03:02.334088+0000","last_peered":"2023-08-25T04:03:02.334088+0000","last_clean":"2023-08-25T04:03:02.334088+0000","last_became_active":"2023-08-25T04:03:00.717031+0000","last_became_peered":"2023-08-25T04:03:00.717031+0000","last_unstale":"2023-08-25T04:03:02.334088+0000","last_undegraded":"2023-08-25T04:03:02.334088+0000","last_fullsized":"2023-08-25T04:03:02.334088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:31:16.804059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726835+0000","last_change":"2023-08-25T04:03:01.347111+0000","last_active":"2023-08-25T04:03:03.726835+0000","last_peered":"2023-08-25T04:03:03.726835+0000","last_clean":"2023-08-25T04:03:03.726835+0000","last_became_active":"2023-08-25T04:03:01.346777+0000","last_became_peered":"2023-08-25T04:03:01.346777+0000","last_unstale":"2023-08-25T04:03:03.726835+0000","last_undegraded":"2023-08-25T04:03:03.726835+0000","last_fullsized":"2023-08-25T04:03:03.726835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:02:14.211702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221677+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:03:03.221677+0000","last_peered":"2023-08-25T04:03:03.221677+0000","last_clean":"2023-08-25T04:03:03.221677+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:03:03.221677+0000","last_undegraded":"2023-08-25T04:03:03.221677+0000","last_fullsized":"2023-08-25T04:03:03.221677+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:39:47.813927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711352+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:03:02.711352+0000","last_peered":"2023-08-25T04:03:02.711352+0000","last_clean":"2023-08-25T04:03:02.711352+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:03:02.711352+0000","last_undegraded":"2023-08-25T04:03:02.711352+0000","last_fullsized":"2023-08-25T04:03:02.711352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:07:26.129416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334130+0000","last_change":"2023-08-25T04:03:00.716745+0000","last_active":"2023-08-25T04:03:02.334130+0000","last_peered":"2023-08-25T04:03:02.334130+0000","last_clean":"2023-08-25T04:03:02.334130+0000","last_became_active":"2023-08-25T04:03:00.716419+0000","last_became_peered":"2023-08-25T04:03:00.716419+0000","last_unstale":"2023-08-25T04:03:02.334130+0000","last_undegraded":"2023-08-25T04:03:02.334130+0000","last_fullsized":"2023-08-25T04:03:02.334130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:00:59.219341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335514+0000","last_change":"2023-08-25T04:03:01.359007+0000","last_active":"2023-08-25T04:03:02.335514+0000","last_peered":"2023-08-25T04:03:02.335514+0000","last_clean":"2023-08-25T04:03:02.335514+0000","last_became_active":"2023-08-25T04:03:01.358654+0000","last_became_peered":"2023-08-25T04:03:01.358654+0000","last_unstale":"2023-08-25T04:03:02.335514+0000","last_undegraded":"2023-08-25T04:03:02.335514+0000","last_fullsized":"2023-08-25T04:03:02.335514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:26.962898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221750+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:03:03.221750+0000","last_peered":"2023-08-25T04:03:03.221750+0000","last_clean":"2023-08-25T04:03:03.221750+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:03:03.221750+0000","last_undegraded":"2023-08-25T04:03:03.221750+0000","last_fullsized":"2023-08-25T04:03:03.221750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:50:12.445240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.856811+0000","last_change":"2023-08-25T04:03:00.724401+0000","last_active":"2023-08-25T04:03:02.856811+0000","last_peered":"2023-08-25T04:03:02.856811+0000","last_clean":"2023-08-25T04:03:02.856811+0000","last_became_active":"2023-08-25T04:03:00.724057+0000","last_became_peered":"2023-08-25T04:03:00.724057+0000","last_unstale":"2023-08-25T04:03:02.856811+0000","last_undegraded":"2023-08-25T04:03:02.856811+0000","last_fullsized":"2023-08-25T04:03:02.856811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:09:39.160220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857204+0000","last_change":"2023-08-25T04:03:01.362199+0000","last_active":"2023-08-25T04:03:02.857204+0000","last_peered":"2023-08-25T04:03:02.857204+0000","last_clean":"2023-08-25T04:03:02.857204+0000","last_became_active":"2023-08-25T04:03:01.361885+0000","last_became_peered":"2023-08-25T04:03:01.361885+0000","last_unstale":"2023-08-25T04:03:02.857204+0000","last_undegraded":"2023-08-25T04:03:02.857204+0000","last_fullsized":"2023-08-25T04:03:02.857204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:08:37.753060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.459489+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:03:03.459489+0000","last_peered":"2023-08-25T04:03:03.459489+0000","last_clean":"2023-08-25T04:03:03.459489+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:03:03.459489+0000","last_undegraded":"2023-08-25T04:03:03.459489+0000","last_fullsized":"2023-08-25T04:03:03.459489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:01:59.393215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.725585+0000","last_change":"2023-08-25T04:03:00.715784+0000","last_active":"2023-08-25T04:03:03.725585+0000","last_peered":"2023-08-25T04:03:03.725585+0000","last_clean":"2023-08-25T04:03:03.725585+0000","last_became_active":"2023-08-25T04:03:00.715481+0000","last_became_peered":"2023-08-25T04:03:00.715481+0000","last_unstale":"2023-08-25T04:03:03.725585+0000","last_undegraded":"2023-08-25T04:03:03.725585+0000","last_fullsized":"2023-08-25T04:03:03.725585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:31:16.804059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726625+0000","last_change":"2023-08-25T04:03:01.351813+0000","last_active":"2023-08-25T04:03:03.726625+0000","last_peered":"2023-08-25T04:03:03.726625+0000","last_clean":"2023-08-25T04:03:03.726625+0000","last_became_active":"2023-08-25T04:03:01.351168+0000","last_became_peered":"2023-08-25T04:03:01.351168+0000","last_unstale":"2023-08-25T04:03:03.726625+0000","last_undegraded":"2023-08-25T04:03:03.726625+0000","last_fullsized":"2023-08-25T04:03:03.726625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:14:42.010699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711239+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:03:02.711239+0000","last_peered":"2023-08-25T04:03:02.711239+0000","last_clean":"2023-08-25T04:03:02.711239+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:03:02.711239+0000","last_undegraded":"2023-08-25T04:03:02.711239+0000","last_fullsized":"2023-08-25T04:03:02.711239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:50:17.159484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336213+0000","last_change":"2023-08-25T04:03:00.726687+0000","last_active":"2023-08-25T04:03:02.336213+0000","last_peered":"2023-08-25T04:03:02.336213+0000","last_clean":"2023-08-25T04:03:02.336213+0000","last_became_active":"2023-08-25T04:03:00.726151+0000","last_became_peered":"2023-08-25T04:03:00.726151+0000","last_unstale":"2023-08-25T04:03:02.336213+0000","last_undegraded":"2023-08-25T04:03:02.336213+0000","last_fullsized":"2023-08-25T04:03:02.336213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:04.723845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726361+0000","last_change":"2023-08-25T04:03:01.347217+0000","last_active":"2023-08-25T04:03:03.726361+0000","last_peered":"2023-08-25T04:03:03.726361+0000","last_clean":"2023-08-25T04:03:03.726361+0000","last_became_active":"2023-08-25T04:03:01.346945+0000","last_became_peered":"2023-08-25T04:03:01.346945+0000","last_unstale":"2023-08-25T04:03:03.726361+0000","last_undegraded":"2023-08-25T04:03:03.726361+0000","last_fullsized":"2023-08-25T04:03:03.726361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:42:05.413297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711563+0000","last_change":"2023-08-25T04:03:00.721967+0000","last_active":"2023-08-25T04:03:02.711563+0000","last_peered":"2023-08-25T04:03:02.711563+0000","last_clean":"2023-08-25T04:03:02.711563+0000","last_became_active":"2023-08-25T04:03:00.721550+0000","last_became_peered":"2023-08-25T04:03:00.721550+0000","last_unstale":"2023-08-25T04:03:02.711563+0000","last_undegraded":"2023-08-25T04:03:02.711563+0000","last_fullsized":"2023-08-25T04:03:02.711563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:31:56.892771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.725392+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:03:03.725392+0000","last_peered":"2023-08-25T04:03:03.725392+0000","last_clean":"2023-08-25T04:03:03.725392+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:03:03.725392+0000","last_undegraded":"2023-08-25T04:03:03.725392+0000","last_fullsized":"2023-08-25T04:03:03.725392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:53:40.748218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726277+0000","last_change":"2023-08-25T04:03:01.350688+0000","last_active":"2023-08-25T04:03:03.726277+0000","last_peered":"2023-08-25T04:03:03.726277+0000","last_clean":"2023-08-25T04:03:03.726277+0000","last_became_active":"2023-08-25T04:03:01.350333+0000","last_became_peered":"2023-08-25T04:03:01.350333+0000","last_unstale":"2023-08-25T04:03:03.726277+0000","last_undegraded":"2023-08-25T04:03:03.726277+0000","last_fullsized":"2023-08-25T04:03:03.726277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:17:39.196100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726525+0000","last_change":"2023-08-25T04:03:00.710773+0000","last_active":"2023-08-25T04:03:03.726525+0000","last_peered":"2023-08-25T04:03:03.726525+0000","last_clean":"2023-08-25T04:03:03.726525+0000","last_became_active":"2023-08-25T04:03:00.710376+0000","last_became_peered":"2023-08-25T04:03:00.710376+0000","last_unstale":"2023-08-25T04:03:03.726525+0000","last_undegraded":"2023-08-25T04:03:03.726525+0000","last_fullsized":"2023-08-25T04:03:03.726525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:14:50.677846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.222057+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:03:03.222057+0000","last_peered":"2023-08-25T04:03:03.222057+0000","last_clean":"2023-08-25T04:03:03.222057+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:03:03.222057+0000","last_undegraded":"2023-08-25T04:03:03.222057+0000","last_fullsized":"2023-08-25T04:03:03.222057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:31.595801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.856940+0000","last_change":"2023-08-25T04:03:01.352376+0000","last_active":"2023-08-25T04:03:02.856940+0000","last_peered":"2023-08-25T04:03:02.856940+0000","last_clean":"2023-08-25T04:03:02.856940+0000","last_became_active":"2023-08-25T04:03:01.352104+0000","last_became_peered":"2023-08-25T04:03:01.352104+0000","last_unstale":"2023-08-25T04:03:02.856940+0000","last_undegraded":"2023-08-25T04:03:02.856940+0000","last_fullsized":"2023-08-25T04:03:02.856940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:10:46.841700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334677+0000","last_change":"2023-08-25T04:03:00.718260+0000","last_active":"2023-08-25T04:03:02.334677+0000","last_peered":"2023-08-25T04:03:02.334677+0000","last_clean":"2023-08-25T04:03:02.334677+0000","last_became_active":"2023-08-25T04:03:00.717748+0000","last_became_peered":"2023-08-25T04:03:00.717748+0000","last_unstale":"2023-08-25T04:03:02.334677+0000","last_undegraded":"2023-08-25T04:03:02.334677+0000","last_fullsized":"2023-08-25T04:03:02.334677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:09:22.303931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.725411+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:03:03.725411+0000","last_peered":"2023-08-25T04:03:03.725411+0000","last_clean":"2023-08-25T04:03:03.725411+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:03:03.725411+0000","last_undegraded":"2023-08-25T04:03:03.725411+0000","last_fullsized":"2023-08-25T04:03:03.725411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:43.854917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.333963+0000","last_change":"2023-08-25T04:03:01.345303+0000","last_active":"2023-08-25T04:03:02.333963+0000","last_peered":"2023-08-25T04:03:02.333963+0000","last_clean":"2023-08-25T04:03:02.333963+0000","last_became_active":"2023-08-25T04:03:01.344815+0000","last_became_peered":"2023-08-25T04:03:01.344815+0000","last_unstale":"2023-08-25T04:03:02.333963+0000","last_undegraded":"2023-08-25T04:03:02.333963+0000","last_fullsized":"2023-08-25T04:03:02.333963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:33:22.570632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857336+0000","last_change":"2023-08-25T04:03:00.723286+0000","last_active":"2023-08-25T04:03:02.857336+0000","last_peered":"2023-08-25T04:03:02.857336+0000","last_clean":"2023-08-25T04:03:02.857336+0000","last_became_active":"2023-08-25T04:03:00.722952+0000","last_became_peered":"2023-08-25T04:03:00.722952+0000","last_unstale":"2023-08-25T04:03:02.857336+0000","last_undegraded":"2023-08-25T04:03:02.857336+0000","last_fullsized":"2023-08-25T04:03:02.857336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:54.717355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335621+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:03:02.335621+0000","last_peered":"2023-08-25T04:03:02.335621+0000","last_clean":"2023-08-25T04:03:02.335621+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:03:02.335621+0000","last_undegraded":"2023-08-25T04:03:02.335621+0000","last_fullsized":"2023-08-25T04:03:02.335621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:00:57.716050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335246+0000","last_change":"2023-08-25T04:03:01.358953+0000","last_active":"2023-08-25T04:03:02.335246+0000","last_peered":"2023-08-25T04:03:02.335246+0000","last_clean":"2023-08-25T04:03:02.335246+0000","last_became_active":"2023-08-25T04:03:01.358612+0000","last_became_peered":"2023-08-25T04:03:01.358612+0000","last_unstale":"2023-08-25T04:03:02.335246+0000","last_undegraded":"2023-08-25T04:03:02.335246+0000","last_fullsized":"2023-08-25T04:03:02.335246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:45.270852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336173+0000","last_change":"2023-08-25T04:03:01.358957+0000","last_active":"2023-08-25T04:03:02.336173+0000","last_peered":"2023-08-25T04:03:02.336173+0000","last_clean":"2023-08-25T04:03:02.336173+0000","last_became_active":"2023-08-25T04:03:01.358559+0000","last_became_peered":"2023-08-25T04:03:01.358559+0000","last_unstale":"2023-08-25T04:03:02.336173+0000","last_undegraded":"2023-08-25T04:03:02.336173+0000","last_fullsized":"2023-08-25T04:03:02.336173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:40:00.894010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336333+0000","last_change":"2023-08-25T04:03:00.719414+0000","last_active":"2023-08-25T04:03:02.336333+0000","last_peered":"2023-08-25T04:03:02.336333+0000","last_clean":"2023-08-25T04:03:02.336333+0000","last_became_active":"2023-08-25T04:03:00.719016+0000","last_became_peered":"2023-08-25T04:03:00.719016+0000","last_unstale":"2023-08-25T04:03:02.336333+0000","last_undegraded":"2023-08-25T04:03:02.336333+0000","last_fullsized":"2023-08-25T04:03:02.336333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:13:47.004438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726230+0000","last_change":"2023-08-25T04:03:01.348671+0000","last_active":"2023-08-25T04:03:03.726230+0000","last_peered":"2023-08-25T04:03:03.726230+0000","last_clean":"2023-08-25T04:03:03.726230+0000","last_became_active":"2023-08-25T04:03:01.348415+0000","last_became_peered":"2023-08-25T04:03:01.348415+0000","last_unstale":"2023-08-25T04:03:03.726230+0000","last_undegraded":"2023-08-25T04:03:03.726230+0000","last_fullsized":"2023-08-25T04:03:03.726230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:01:00.229261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221754+0000","last_change":"2023-08-25T04:03:00.721463+0000","last_active":"2023-08-25T04:03:03.221754+0000","last_peered":"2023-08-25T04:03:03.221754+0000","last_clean":"2023-08-25T04:03:03.221754+0000","last_became_active":"2023-08-25T04:03:00.721177+0000","last_became_peered":"2023-08-25T04:03:00.721177+0000","last_unstale":"2023-08-25T04:03:03.221754+0000","last_undegraded":"2023-08-25T04:03:03.221754+0000","last_fullsized":"2023-08-25T04:03:03.221754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:13:47.004438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711603+0000","last_change":"2023-08-25T04:03:00.719107+0000","last_active":"2023-08-25T04:03:02.711603+0000","last_peered":"2023-08-25T04:03:02.711603+0000","last_clean":"2023-08-25T04:03:02.711603+0000","last_became_active":"2023-08-25T04:03:00.718831+0000","last_became_peered":"2023-08-25T04:03:00.718831+0000","last_unstale":"2023-08-25T04:03:02.711603+0000","last_undegraded":"2023-08-25T04:03:02.711603+0000","last_fullsized":"2023-08-25T04:03:02.711603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:50:17.482636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334254+0000","last_change":"2023-08-25T04:03:01.349735+0000","last_active":"2023-08-25T04:03:02.334254+0000","last_peered":"2023-08-25T04:03:02.334254+0000","last_clean":"2023-08-25T04:03:02.334254+0000","last_became_active":"2023-08-25T04:03:01.349169+0000","last_became_peered":"2023-08-25T04:03:01.349169+0000","last_unstale":"2023-08-25T04:03:02.334254+0000","last_undegraded":"2023-08-25T04:03:02.334254+0000","last_fullsized":"2023-08-25T04:03:02.334254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:17:39.196100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857509+0000","last_change":"2023-08-25T04:03:00.722052+0000","last_active":"2023-08-25T04:03:02.857509+0000","last_peered":"2023-08-25T04:03:02.857509+0000","last_clean":"2023-08-25T04:03:02.857509+0000","last_became_active":"2023-08-25T04:03:00.721711+0000","last_became_peered":"2023-08-25T04:03:00.721711+0000","last_unstale":"2023-08-25T04:03:02.857509+0000","last_undegraded":"2023-08-25T04:03:02.857509+0000","last_fullsized":"2023-08-25T04:03:02.857509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:31:56.892771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.333893+0000","last_change":"2023-08-25T04:03:01.345111+0000","last_active":"2023-08-25T04:03:02.333893+0000","last_peered":"2023-08-25T04:03:02.333893+0000","last_clean":"2023-08-25T04:03:02.333893+0000","last_became_active":"2023-08-25T04:03:01.344450+0000","last_became_peered":"2023-08-25T04:03:01.344450+0000","last_unstale":"2023-08-25T04:03:02.333893+0000","last_undegraded":"2023-08-25T04:03:02.333893+0000","last_fullsized":"2023-08-25T04:03:02.333893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:51.005114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335653+0000","last_change":"2023-08-25T04:03:01.354750+0000","last_active":"2023-08-25T04:03:02.335653+0000","last_peered":"2023-08-25T04:03:02.335653+0000","last_clean":"2023-08-25T04:03:02.335653+0000","last_became_active":"2023-08-25T04:03:01.354428+0000","last_became_peered":"2023-08-25T04:03:01.354428+0000","last_unstale":"2023-08-25T04:03:02.335653+0000","last_undegraded":"2023-08-25T04:03:02.335653+0000","last_fullsized":"2023-08-25T04:03:02.335653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:55.173495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334030+0000","last_change":"2023-08-25T04:03:00.724234+0000","last_active":"2023-08-25T04:03:02.334030+0000","last_peered":"2023-08-25T04:03:02.334030+0000","last_clean":"2023-08-25T04:03:02.334030+0000","last_became_active":"2023-08-25T04:03:00.723532+0000","last_became_peered":"2023-08-25T04:03:00.723532+0000","last_unstale":"2023-08-25T04:03:02.334030+0000","last_undegraded":"2023-08-25T04:03:02.334030+0000","last_fullsized":"2023-08-25T04:03:02.334030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:53:45.785613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857193+0000","last_change":"2023-08-25T04:03:01.349065+0000","last_active":"2023-08-25T04:03:02.857193+0000","last_peered":"2023-08-25T04:03:02.857193+0000","last_clean":"2023-08-25T04:03:02.857193+0000","last_became_active":"2023-08-25T04:03:01.348789+0000","last_became_peered":"2023-08-25T04:03:01.348789+0000","last_unstale":"2023-08-25T04:03:02.857193+0000","last_undegraded":"2023-08-25T04:03:02.857193+0000","last_fullsized":"2023-08-25T04:03:02.857193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:12:02.187737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726121+0000","last_change":"2023-08-25T04:03:00.718057+0000","last_active":"2023-08-25T04:03:03.726121+0000","last_peered":"2023-08-25T04:03:03.726121+0000","last_clean":"2023-08-25T04:03:03.726121+0000","last_became_active":"2023-08-25T04:03:00.717736+0000","last_became_peered":"2023-08-25T04:03:00.717736+0000","last_unstale":"2023-08-25T04:03:03.726121+0000","last_undegraded":"2023-08-25T04:03:03.726121+0000","last_fullsized":"2023-08-25T04:03:03.726121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:21:31.300629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334621+0000","last_change":"2023-08-25T04:03:01.357499+0000","last_active":"2023-08-25T04:03:02.334621+0000","last_peered":"2023-08-25T04:03:02.334621+0000","last_clean":"2023-08-25T04:03:02.334621+0000","last_became_active":"2023-08-25T04:03:01.357124+0000","last_became_peered":"2023-08-25T04:03:01.357124+0000","last_unstale":"2023-08-25T04:03:02.334621+0000","last_undegraded":"2023-08-25T04:03:02.334621+0000","last_fullsized":"2023-08-25T04:03:02.334621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:02:14.211702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335702+0000","last_change":"2023-08-25T04:03:00.719151+0000","last_active":"2023-08-25T04:03:02.335702+0000","last_peered":"2023-08-25T04:03:02.335702+0000","last_clean":"2023-08-25T04:03:02.335702+0000","last_became_active":"2023-08-25T04:03:00.718851+0000","last_became_peered":"2023-08-25T04:03:00.718851+0000","last_unstale":"2023-08-25T04:03:02.335702+0000","last_undegraded":"2023-08-25T04:03:02.335702+0000","last_fullsized":"2023-08-25T04:03:02.335702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:08:36.743141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.459589+0000","last_change":"2023-08-25T04:03:01.357412+0000","last_active":"2023-08-25T04:03:03.459589+0000","last_peered":"2023-08-25T04:03:03.459589+0000","last_clean":"2023-08-25T04:03:03.459589+0000","last_became_active":"2023-08-25T04:03:01.357136+0000","last_became_peered":"2023-08-25T04:03:01.357136+0000","last_unstale":"2023-08-25T04:03:03.459589+0000","last_undegraded":"2023-08-25T04:03:03.459589+0000","last_fullsized":"2023-08-25T04:03:03.459589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:14:58.886873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857086+0000","last_change":"2023-08-25T04:03:00.725319+0000","last_active":"2023-08-25T04:03:02.857086+0000","last_peered":"2023-08-25T04:03:02.857086+0000","last_clean":"2023-08-25T04:03:02.857086+0000","last_became_active":"2023-08-25T04:03:00.725047+0000","last_became_peered":"2023-08-25T04:03:00.725047+0000","last_unstale":"2023-08-25T04:03:02.857086+0000","last_undegraded":"2023-08-25T04:03:02.857086+0000","last_fullsized":"2023-08-25T04:03:02.857086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:30.288711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336061+0000","last_change":"2023-08-25T04:03:01.359175+0000","last_active":"2023-08-25T04:03:02.336061+0000","last_peered":"2023-08-25T04:03:02.336061+0000","last_clean":"2023-08-25T04:03:02.336061+0000","last_became_active":"2023-08-25T04:03:01.358098+0000","last_became_peered":"2023-08-25T04:03:01.358098+0000","last_unstale":"2023-08-25T04:03:02.336061+0000","last_undegraded":"2023-08-25T04:03:02.336061+0000","last_fullsized":"2023-08-25T04:03:02.336061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:07:32.176731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711204+0000","last_change":"2023-08-25T04:03:00.724464+0000","last_active":"2023-08-25T04:03:02.711204+0000","last_peered":"2023-08-25T04:03:02.711204+0000","last_clean":"2023-08-25T04:03:02.711204+0000","last_became_active":"2023-08-25T04:03:00.724195+0000","last_became_peered":"2023-08-25T04:03:00.724195+0000","last_unstale":"2023-08-25T04:03:02.711204+0000","last_undegraded":"2023-08-25T04:03:02.711204+0000","last_fullsized":"2023-08-25T04:03:02.711204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:44.260933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335179+0000","last_change":"2023-08-25T04:03:01.359383+0000","last_active":"2023-08-25T04:03:02.335179+0000","last_peered":"2023-08-25T04:03:02.335179+0000","last_clean":"2023-08-25T04:03:02.335179+0000","last_became_active":"2023-08-25T04:03:01.358081+0000","last_became_peered":"2023-08-25T04:03:01.358081+0000","last_unstale":"2023-08-25T04:03:02.335179+0000","last_undegraded":"2023-08-25T04:03:02.335179+0000","last_fullsized":"2023-08-25T04:03:02.335179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:17.983189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711534+0000","last_change":"2023-08-25T04:03:00.724403+0000","last_active":"2023-08-25T04:03:02.711534+0000","last_peered":"2023-08-25T04:03:02.711534+0000","last_clean":"2023-08-25T04:03:02.711534+0000","last_became_active":"2023-08-25T04:03:00.724136+0000","last_became_peered":"2023-08-25T04:03:00.724136+0000","last_unstale":"2023-08-25T04:03:02.711534+0000","last_undegraded":"2023-08-25T04:03:02.711534+0000","last_fullsized":"2023-08-25T04:03:02.711534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:04.723845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334480+0000","last_change":"2023-08-25T04:03:01.348397+0000","last_active":"2023-08-25T04:03:02.334480+0000","last_peered":"2023-08-25T04:03:02.334480+0000","last_clean":"2023-08-25T04:03:02.334480+0000","last_became_active":"2023-08-25T04:03:01.345667+0000","last_became_peered":"2023-08-25T04:03:01.345667+0000","last_unstale":"2023-08-25T04:03:02.334480+0000","last_undegraded":"2023-08-25T04:03:02.334480+0000","last_fullsized":"2023-08-25T04:03:02.334480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:29:51.124247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334436+0000","last_change":"2023-08-25T04:03:00.718222+0000","last_active":"2023-08-25T04:03:02.334436+0000","last_peered":"2023-08-25T04:03:02.334436+0000","last_clean":"2023-08-25T04:03:02.334436+0000","last_became_active":"2023-08-25T04:03:00.717941+0000","last_became_peered":"2023-08-25T04:03:00.717941+0000","last_unstale":"2023-08-25T04:03:02.334436+0000","last_undegraded":"2023-08-25T04:03:02.334436+0000","last_fullsized":"2023-08-25T04:03:02.334436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:14:41.000779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335078+0000","last_change":"2023-08-25T04:03:01.344378+0000","last_active":"2023-08-25T04:03:02.335078+0000","last_peered":"2023-08-25T04:03:02.335078+0000","last_clean":"2023-08-25T04:03:02.335078+0000","last_became_active":"2023-08-25T04:03:01.343370+0000","last_became_peered":"2023-08-25T04:03:01.343370+0000","last_unstale":"2023-08-25T04:03:02.335078+0000","last_undegraded":"2023-08-25T04:03:02.335078+0000","last_fullsized":"2023-08-25T04:03:02.335078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:55.890269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857402+0000","last_change":"2023-08-25T04:03:00.723428+0000","last_active":"2023-08-25T04:03:02.857402+0000","last_peered":"2023-08-25T04:03:02.857402+0000","last_clean":"2023-08-25T04:03:02.857402+0000","last_became_active":"2023-08-25T04:03:00.722959+0000","last_became_peered":"2023-08-25T04:03:00.722959+0000","last_unstale":"2023-08-25T04:03:02.857402+0000","last_undegraded":"2023-08-25T04:03:02.857402+0000","last_fullsized":"2023-08-25T04:03:02.857402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:04.723845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":868352,"data_stored":684014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":91818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":92470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":93486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":249856,"data_stored":91908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":245760,"data_stored":91818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":91818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":843776,"data_stored":682768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:03:10.605 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:03:10.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.783+0000 7f1e9346d640 1 Processor -- start 2023-08-25T04:03:10.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.783+0000 7f1e9346d640 1 -- start start 2023-08-25T04:03:10.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.783+0000 7f1e9346d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1e8c164410 0x7f1e8c0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:10.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.783+0000 7f1e9346d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1e8c0c1a80 0x7f1e8c06bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:10.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.783+0000 7f1e9346d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8c0cc510 con 0x7f1e8c0cddf0 2023-08-25T04:03:10.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.783+0000 7f1e9346d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8c1647f0 con 0x7f1e8c0c1a80 2023-08-25T04:03:10.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.783+0000 7f1e9346d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8c0cc9b0 con 0x7f1e8c164410 2023-08-25T04:03:10.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.787+0000 7f1e91a0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1e8c0c1a80 0x7f1e8c06bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:10.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.787+0000 7f1e91a0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1e8c0c1a80 0x7f1e8c06bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59716/0 (socket says 172.21.15.55:59716) 2023-08-25T04:03:10.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.787+0000 7f1e91a0a640 1 -- 172.21.15.55:0/3145395047 learned_addr learned my addr 172.21.15.55:0/3145395047 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:10.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.787+0000 7f1e91209640 1 --2- 172.21.15.55:0/3145395047 >> v2:172.21.15.110:3300/0 conn(0x7f1e8c164410 0x7f1e8c0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:10.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.787+0000 7f1e91a0a640 1 -- 172.21.15.55:0/3145395047 >> v2:172.21.15.110:3300/0 conn(0x7f1e8c164410 msgr2=0x7f1e8c0b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:10.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.787+0000 7f1e91a0a640 1 --2- 172.21.15.55:0/3145395047 >> v2:172.21.15.110:3300/0 conn(0x7f1e8c164410 0x7f1e8c0b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.787+0000 7f1e91a0a640 1 -- 172.21.15.55:0/3145395047 >> v1:172.21.15.110:6789/0 conn(0x7f1e8c0cddf0 legacy=0x7f1e8c0c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.787+0000 7f1e91a0a640 1 -- 172.21.15.55:0/3145395047 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c0ccc90 con 0x7f1e8c0c1a80 2023-08-25T04:03:10.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.787+0000 7f1e91a0a640 1 --2- 172.21.15.55:0/3145395047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e8c0c1a80 0x7f1e8c06bb40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0cec10 tx=0x7f1e8401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a18dc15a3cff151 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:10.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.787+0000 7f1e83fff640 1 -- 172.21.15.55:0/3145395047 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e840a5670 con 0x7f1e8c0c1a80 2023-08-25T04:03:10.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.787+0000 7f1e83fff640 1 -- 172.21.15.55:0/3145395047 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e840a57d0 con 0x7f1e8c0c1a80 2023-08-25T04:03:10.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.787+0000 7f1e83fff640 1 -- 172.21.15.55:0/3145395047 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e840a5b60 con 0x7f1e8c0c1a80 2023-08-25T04:03:10.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e9346d640 1 -- 172.21.15.55:0/3145395047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e8c0c1a80 msgr2=0x7f1e8c06bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e9346d640 1 --2- 172.21.15.55:0/3145395047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e8c0c1a80 0x7f1e8c06bb40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c0cec10 tx=0x7f1e8401c9d0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e9346d640 1 -- 172.21.15.55:0/3145395047 shutdown_connections 2023-08-25T04:03:10.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e9346d640 1 --2- 172.21.15.55:0/3145395047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e8c0c1a80 0x7f1e8c06bb40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e9346d640 1 --2- 172.21.15.55:0/3145395047 >> v2:172.21.15.110:3300/0 conn(0x7f1e8c164410 0x7f1e8c0b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e9346d640 1 -- 172.21.15.55:0/3145395047 >> 172.21.15.55:0/3145395047 conn(0x7f1e8c069d00 msgr2=0x7f1e8c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:10.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e9346d640 1 -- 172.21.15.55:0/3145395047 shutdown_connections 2023-08-25T04:03:10.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e9346d640 1 -- 172.21.15.55:0/3145395047 wait complete. 2023-08-25T04:03:10.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e9346d640 1 Processor -- start 2023-08-25T04:03:10.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e9346d640 1 -- start start 2023-08-25T04:03:10.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e9346d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e8c0c1a80 0x7f1e8c0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:10.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e9346d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e8c0cddf0 0x7f1e8c1626e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:10.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e9346d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e8c164410 0x7f1e8c0ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:10.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e9346d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c0b0f00 con 0x7f1e8c164410 2023-08-25T04:03:10.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e9346d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c0c5610 con 0x7f1e8c0cddf0 2023-08-25T04:03:10.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e9346d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c0afde0 con 0x7f1e8c0c1a80 2023-08-25T04:03:10.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e91a0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e8c164410 0x7f1e8c0ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:10.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e91a0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e8c164410 0x7f1e8c0ae590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59724/0 (socket says 172.21.15.55:59724) 2023-08-25T04:03:10.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e91a0a640 1 -- 172.21.15.55:0/2975262892 learned_addr learned my addr 172.21.15.55:0/2975262892 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:10.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e90a08640 1 --2- 172.21.15.55:0/2975262892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e8c0cddf0 0x7f1e8c1626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:10.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.791+0000 7f1e91209640 1 --2- 172.21.15.55:0/2975262892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e8c0c1a80 0x7f1e8c0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:10.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.795+0000 7f1e91a0a640 1 -- 172.21.15.55:0/2975262892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e8c0c1a80 msgr2=0x7f1e8c0b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.795+0000 7f1e91a0a640 1 --2- 172.21.15.55:0/2975262892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e8c0c1a80 0x7f1e8c0b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.795+0000 7f1e91a0a640 1 -- 172.21.15.55:0/2975262892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e8c0cddf0 msgr2=0x7f1e8c1626e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.795+0000 7f1e91a0a640 1 --2- 172.21.15.55:0/2975262892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e8c0cddf0 0x7f1e8c1626e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.795+0000 7f1e91a0a640 1 -- 172.21.15.55:0/2975262892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e84009b30 con 0x7f1e8c164410 2023-08-25T04:03:10.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.795+0000 7f1e91a0a640 1 --2- 172.21.15.55:0/2975262892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e8c164410 0x7f1e8c0ae590 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1e840195e0 tx=0x7f1e84019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:10.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.795+0000 7f1e81ffb640 1 -- 172.21.15.55:0/2975262892 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e840b8670 con 0x7f1e8c164410 2023-08-25T04:03:10.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.795+0000 7f1e81ffb640 1 -- 172.21.15.55:0/2975262892 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e840b87d0 con 0x7f1e8c164410 2023-08-25T04:03:10.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.795+0000 7f1e9346d640 1 -- 172.21.15.55:0/2975262892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8c0b00c0 con 0x7f1e8c164410 2023-08-25T04:03:10.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.795+0000 7f1e81ffb640 1 -- 172.21.15.55:0/2975262892 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e840b8bc0 con 0x7f1e8c164410 2023-08-25T04:03:10.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.795+0000 7f1e9346d640 1 -- 172.21.15.55:0/2975262892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8c15b830 con 0x7f1e8c164410 2023-08-25T04:03:10.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.795+0000 7f1e9346d640 1 -- 172.21.15.55:0/2975262892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8c04dbe0 con 0x7f1e8c164410 2023-08-25T04:03:10.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.795+0000 7f1e81ffb640 1 -- 172.21.15.55:0/2975262892 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1e840b8d20 con 0x7f1e8c164410 2023-08-25T04:03:10.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.799+0000 7f1e81ffb640 1 --2- 172.21.15.55:0/2975262892 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1e70065680 0x7f1e70067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:10.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.799+0000 7f1e81ffb640 1 -- 172.21.15.55:0/2975262892 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1e8411e1e0 con 0x7f1e8c164410 2023-08-25T04:03:10.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.799+0000 7f1e91209640 1 --2- 172.21.15.55:0/2975262892 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1e70065680 0x7f1e70067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:10.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.799+0000 7f1e91209640 1 --2- 172.21.15.55:0/2975262892 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1e70065680 0x7f1e70067b40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1e88009ac0 tx=0x7f1e88009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:10.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.803+0000 7f1e81ffb640 1 -- 172.21.15.55:0/2975262892 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1e840ebd40 con 0x7f1e8c164410 2023-08-25T04:03:10.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.955+0000 7f1e9346d640 1 -- 172.21.15.55:0/2975262892 --> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1e8c0cd530 con 0x7f1e70065680 2023-08-25T04:03:10.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.963+0000 7f1e81ffb640 1 -- 172.21.15.55:0/2975262892 <== mgr.4102 v2:172.21.15.110:6832/413962747 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286690 (secure 0 0 0) 0x7f1e880119e0 con 0x7f1e70065680 2023-08-25T04:03:10.994 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:10.995 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:03:10.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.967+0000 7f1e9346d640 1 -- 172.21.15.55:0/2975262892 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1e70065680 msgr2=0x7f1e70067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.967+0000 7f1e9346d640 1 --2- 172.21.15.55:0/2975262892 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1e70065680 0x7f1e70067b40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1e88009ac0 tx=0x7f1e88009190 comp rx=0 tx=0).stop 2023-08-25T04:03:10.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.967+0000 7f1e9346d640 1 -- 172.21.15.55:0/2975262892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e8c164410 msgr2=0x7f1e8c0ae590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:10.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.967+0000 7f1e9346d640 1 --2- 172.21.15.55:0/2975262892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e8c164410 0x7f1e8c0ae590 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1e840195e0 tx=0x7f1e84019770 comp rx=0 tx=0).stop 2023-08-25T04:03:10.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.967+0000 7f1e9346d640 1 -- 172.21.15.55:0/2975262892 shutdown_connections 2023-08-25T04:03:10.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.967+0000 7f1e9346d640 1 --2- 172.21.15.55:0/2975262892 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1e70065680 0x7f1e70067b40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.967+0000 7f1e9346d640 1 --2- 172.21.15.55:0/2975262892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e8c164410 0x7f1e8c0ae590 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.967+0000 7f1e9346d640 1 --2- 172.21.15.55:0/2975262892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1e8c0cddf0 0x7f1e8c1626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.967+0000 7f1e9346d640 1 --2- 172.21.15.55:0/2975262892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1e8c0c1a80 0x7f1e8c0b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:10.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.967+0000 7f1e9346d640 1 -- 172.21.15.55:0/2975262892 >> 172.21.15.55:0/2975262892 conn(0x7f1e8c069d00 msgr2=0x7f1e8c0abe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:10.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.967+0000 7f1e9346d640 1 -- 172.21.15.55:0/2975262892 shutdown_connections 2023-08-25T04:03:10.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:10.967+0000 7f1e9346d640 1 -- 172.21.15.55:0/2975262892 wait complete. 2023-08-25T04:03:10.998 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-08-25T04:03:10.606577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244296,"kb_used_data":3144,"kb_used_omap":13,"kb_used_meta":241010,"kb_avail":754730424,"statfs":{"total":773094113280,"available":772843954176,"internally_reserved":0,"allocated":3219456,"data_stored":1920100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":246794328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.275925"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.459746+0000","last_change":"2023-08-25T04:03:01.345042+0000","last_active":"2023-08-25T04:03:03.459746+0000","last_peered":"2023-08-25T04:03:03.459746+0000","last_clean":"2023-08-25T04:03:03.459746+0000","last_became_active":"2023-08-25T04:03:01.344724+0000","last_became_peered":"2023-08-25T04:03:01.344724+0000","last_unstale":"2023-08-25T04:03:03.459746+0000","last_undegraded":"2023-08-25T04:03:03.459746+0000","last_fullsized":"2023-08-25T04:03:03.459746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:09:20.866112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711241+0000","last_change":"2023-08-25T04:03:01.362953+0000","last_active":"2023-08-25T04:03:02.711241+0000","last_peered":"2023-08-25T04:03:02.711241+0000","last_clean":"2023-08-25T04:03:02.711241+0000","last_became_active":"2023-08-25T04:03:01.362672+0000","last_became_peered":"2023-08-25T04:03:01.362672+0000","last_unstale":"2023-08-25T04:03:02.711241+0000","last_undegraded":"2023-08-25T04:03:02.711241+0000","last_fullsized":"2023-08-25T04:03:02.711241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:13:48.014358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336274+0000","last_change":"2023-08-25T04:03:01.352794+0000","last_active":"2023-08-25T04:03:02.336274+0000","last_peered":"2023-08-25T04:03:02.336274+0000","last_clean":"2023-08-25T04:03:02.336274+0000","last_became_active":"2023-08-25T04:03:01.352520+0000","last_became_peered":"2023-08-25T04:03:01.352520+0000","last_unstale":"2023-08-25T04:03:02.336274+0000","last_undegraded":"2023-08-25T04:03:02.336274+0000","last_fullsized":"2023-08-25T04:03:02.336274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:50:18.492555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335413+0000","last_change":"2023-08-25T04:03:01.348099+0000","last_active":"2023-08-25T04:03:02.335413+0000","last_peered":"2023-08-25T04:03:02.335413+0000","last_clean":"2023-08-25T04:03:02.335413+0000","last_became_active":"2023-08-25T04:03:01.347798+0000","last_became_peered":"2023-08-25T04:03:01.347798+0000","last_unstale":"2023-08-25T04:03:02.335413+0000","last_undegraded":"2023-08-25T04:03:02.335413+0000","last_fullsized":"2023-08-25T04:03:02.335413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:03.894113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857077+0000","last_change":"2023-08-25T04:03:01.350578+0000","last_active":"2023-08-25T04:03:02.857077+0000","last_peered":"2023-08-25T04:03:02.857077+0000","last_clean":"2023-08-25T04:03:02.857077+0000","last_became_active":"2023-08-25T04:03:01.350212+0000","last_became_peered":"2023-08-25T04:03:01.350212+0000","last_unstale":"2023-08-25T04:03:02.857077+0000","last_undegraded":"2023-08-25T04:03:02.857077+0000","last_fullsized":"2023-08-25T04:03:02.857077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:45.270852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335049+0000","last_change":"2023-08-25T04:03:01.353871+0000","last_active":"2023-08-25T04:03:02.335049+0000","last_peered":"2023-08-25T04:03:02.335049+0000","last_clean":"2023-08-25T04:03:02.335049+0000","last_became_active":"2023-08-25T04:03:01.353553+0000","last_became_peered":"2023-08-25T04:03:01.353553+0000","last_unstale":"2023-08-25T04:03:02.335049+0000","last_undegraded":"2023-08-25T04:03:02.335049+0000","last_fullsized":"2023-08-25T04:03:02.335049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:10:46.841700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221486+0000","last_change":"2023-08-25T04:03:01.364502+0000","last_active":"2023-08-25T04:03:03.221486+0000","last_peered":"2023-08-25T04:03:03.221486+0000","last_clean":"2023-08-25T04:03:03.221486+0000","last_became_active":"2023-08-25T04:03:01.364135+0000","last_became_peered":"2023-08-25T04:03:01.364135+0000","last_unstale":"2023-08-25T04:03:03.221486+0000","last_undegraded":"2023-08-25T04:03:03.221486+0000","last_fullsized":"2023-08-25T04:03:03.221486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:55.727274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711247+0000","last_change":"2023-08-25T04:03:01.362258+0000","last_active":"2023-08-25T04:03:02.711247+0000","last_peered":"2023-08-25T04:03:02.711247+0000","last_clean":"2023-08-25T04:03:02.711247+0000","last_became_active":"2023-08-25T04:03:01.361897+0000","last_became_peered":"2023-08-25T04:03:01.361897+0000","last_unstale":"2023-08-25T04:03:02.711247+0000","last_undegraded":"2023-08-25T04:03:02.711247+0000","last_fullsized":"2023-08-25T04:03:02.711247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:08:37.753060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857136+0000","last_change":"2023-08-25T04:03:01.354196+0000","last_active":"2023-08-25T04:03:02.857136+0000","last_peered":"2023-08-25T04:03:02.857136+0000","last_clean":"2023-08-25T04:03:02.857136+0000","last_became_active":"2023-08-25T04:03:01.353929+0000","last_became_peered":"2023-08-25T04:03:01.353929+0000","last_unstale":"2023-08-25T04:03:02.857136+0000","last_undegraded":"2023-08-25T04:03:02.857136+0000","last_fullsized":"2023-08-25T04:03:02.857136+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:50:23.206799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711471+0000","last_change":"2023-08-25T04:03:01.355535+0000","last_active":"2023-08-25T04:03:02.711471+0000","last_peered":"2023-08-25T04:03:02.711471+0000","last_clean":"2023-08-25T04:03:02.711471+0000","last_became_active":"2023-08-25T04:03:01.355233+0000","last_became_peered":"2023-08-25T04:03:01.355233+0000","last_unstale":"2023-08-25T04:03:02.711471+0000","last_undegraded":"2023-08-25T04:03:02.711471+0000","last_fullsized":"2023-08-25T04:03:02.711471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:40:00.894010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336429+0000","last_change":"2023-08-25T04:03:01.350101+0000","last_active":"2023-08-25T04:03:02.336429+0000","last_peered":"2023-08-25T04:03:02.336429+0000","last_clean":"2023-08-25T04:03:02.336429+0000","last_became_active":"2023-08-25T04:03:01.347061+0000","last_became_peered":"2023-08-25T04:03:01.347061+0000","last_unstale":"2023-08-25T04:03:02.336429+0000","last_undegraded":"2023-08-25T04:03:02.336429+0000","last_fullsized":"2023-08-25T04:03:02.336429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:38:18.973058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.459589+0000","last_change":"2023-08-25T04:03:01.358731+0000","last_active":"2023-08-25T04:03:03.459589+0000","last_peered":"2023-08-25T04:03:03.459589+0000","last_clean":"2023-08-25T04:03:03.459589+0000","last_became_active":"2023-08-25T04:03:01.358447+0000","last_became_peered":"2023-08-25T04:03:01.358447+0000","last_unstale":"2023-08-25T04:03:03.459589+0000","last_undegraded":"2023-08-25T04:03:03.459589+0000","last_fullsized":"2023-08-25T04:03:03.459589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:19:38.808296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.459439+0000","last_change":"2023-08-25T04:03:01.344944+0000","last_active":"2023-08-25T04:03:03.459439+0000","last_peered":"2023-08-25T04:03:03.459439+0000","last_clean":"2023-08-25T04:03:03.459439+0000","last_became_active":"2023-08-25T04:03:01.344660+0000","last_became_peered":"2023-08-25T04:03:01.344660+0000","last_unstale":"2023-08-25T04:03:03.459439+0000","last_undegraded":"2023-08-25T04:03:03.459439+0000","last_fullsized":"2023-08-25T04:03:03.459439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:42:21.914526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711067+0000","last_change":"2023-08-25T04:03:01.354816+0000","last_active":"2023-08-25T04:03:02.711067+0000","last_peered":"2023-08-25T04:03:02.711067+0000","last_clean":"2023-08-25T04:03:02.711067+0000","last_became_active":"2023-08-25T04:03:01.354525+0000","last_became_peered":"2023-08-25T04:03:01.354525+0000","last_unstale":"2023-08-25T04:03:02.711067+0000","last_undegraded":"2023-08-25T04:03:02.711067+0000","last_fullsized":"2023-08-25T04:03:02.711067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:17.983189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221863+0000","last_change":"2023-08-25T04:03:01.363162+0000","last_active":"2023-08-25T04:03:03.221863+0000","last_peered":"2023-08-25T04:03:03.221863+0000","last_clean":"2023-08-25T04:03:03.221863+0000","last_became_active":"2023-08-25T04:03:01.362765+0000","last_became_peered":"2023-08-25T04:03:01.362765+0000","last_unstale":"2023-08-25T04:03:03.221863+0000","last_undegraded":"2023-08-25T04:03:03.221863+0000","last_fullsized":"2023-08-25T04:03:03.221863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:03.156111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335027+0000","last_change":"2023-08-25T04:03:01.353137+0000","last_active":"2023-08-25T04:03:02.335027+0000","last_peered":"2023-08-25T04:03:02.335027+0000","last_clean":"2023-08-25T04:03:02.335027+0000","last_became_active":"2023-08-25T04:03:01.352866+0000","last_became_peered":"2023-08-25T04:03:01.352866+0000","last_unstale":"2023-08-25T04:03:02.335027+0000","last_undegraded":"2023-08-25T04:03:02.335027+0000","last_fullsized":"2023-08-25T04:03:02.335027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:09:40.170139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857408+0000","last_change":"2023-08-25T04:03:01.354256+0000","last_active":"2023-08-25T04:03:02.857408+0000","last_peered":"2023-08-25T04:03:02.857408+0000","last_clean":"2023-08-25T04:03:02.857408+0000","last_became_active":"2023-08-25T04:03:01.353982+0000","last_became_peered":"2023-08-25T04:03:01.353982+0000","last_unstale":"2023-08-25T04:03:02.857408+0000","last_undegraded":"2023-08-25T04:03:02.857408+0000","last_fullsized":"2023-08-25T04:03:02.857408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:40:00.894010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336258+0000","last_change":"2023-08-25T04:03:01.342079+0000","last_active":"2023-08-25T04:03:02.336258+0000","last_peered":"2023-08-25T04:03:02.336258+0000","last_clean":"2023-08-25T04:03:02.336258+0000","last_became_active":"2023-08-25T04:03:01.341556+0000","last_became_peered":"2023-08-25T04:03:01.341556+0000","last_unstale":"2023-08-25T04:03:02.336258+0000","last_undegraded":"2023-08-25T04:03:02.336258+0000","last_fullsized":"2023-08-25T04:03:02.336258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:31:57.902690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.459699+0000","last_change":"2023-08-25T04:03:01.340781+0000","last_active":"2023-08-25T04:03:03.459699+0000","last_peered":"2023-08-25T04:03:03.459699+0000","last_clean":"2023-08-25T04:03:03.459699+0000","last_became_active":"2023-08-25T04:03:01.340444+0000","last_became_peered":"2023-08-25T04:03:01.340444+0000","last_unstale":"2023-08-25T04:03:03.459699+0000","last_undegraded":"2023-08-25T04:03:03.459699+0000","last_fullsized":"2023-08-25T04:03:03.459699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:33:15.291618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335970+0000","last_change":"2023-08-25T04:03:01.343273+0000","last_active":"2023-08-25T04:03:02.335970+0000","last_peered":"2023-08-25T04:03:02.335970+0000","last_clean":"2023-08-25T04:03:02.335970+0000","last_became_active":"2023-08-25T04:03:01.342978+0000","last_became_peered":"2023-08-25T04:03:01.342978+0000","last_unstale":"2023-08-25T04:03:02.335970+0000","last_undegraded":"2023-08-25T04:03:02.335970+0000","last_fullsized":"2023-08-25T04:03:02.335970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:12:02.187737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221697+0000","last_change":"2023-08-25T04:03:01.356873+0000","last_active":"2023-08-25T04:03:03.221697+0000","last_peered":"2023-08-25T04:03:03.221697+0000","last_clean":"2023-08-25T04:03:03.221697+0000","last_became_active":"2023-08-25T04:03:01.356524+0000","last_became_peered":"2023-08-25T04:03:01.356524+0000","last_unstale":"2023-08-25T04:03:03.221697+0000","last_undegraded":"2023-08-25T04:03:03.221697+0000","last_fullsized":"2023-08-25T04:03:03.221697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:31:57.902690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.856841+0000","last_change":"2023-08-25T04:03:01.362913+0000","last_active":"2023-08-25T04:03:02.856841+0000","last_peered":"2023-08-25T04:03:02.856841+0000","last_clean":"2023-08-25T04:03:02.856841+0000","last_became_active":"2023-08-25T04:03:01.362630+0000","last_became_peered":"2023-08-25T04:03:01.362630+0000","last_unstale":"2023-08-25T04:03:02.856841+0000","last_undegraded":"2023-08-25T04:03:02.856841+0000","last_fullsized":"2023-08-25T04:03:02.856841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:55:09.171814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.333963+0000","last_change":"2023-08-25T04:03:01.349042+0000","last_active":"2023-08-25T04:03:02.333963+0000","last_peered":"2023-08-25T04:03:02.333963+0000","last_clean":"2023-08-25T04:03:02.333963+0000","last_became_active":"2023-08-25T04:03:01.348683+0000","last_became_peered":"2023-08-25T04:03:01.348683+0000","last_unstale":"2023-08-25T04:03:02.333963+0000","last_undegraded":"2023-08-25T04:03:02.333963+0000","last_fullsized":"2023-08-25T04:03:02.333963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:49.902232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221508+0000","last_change":"2023-08-25T04:03:01.356864+0000","last_active":"2023-08-25T04:03:03.221508+0000","last_peered":"2023-08-25T04:03:03.221508+0000","last_clean":"2023-08-25T04:03:03.221508+0000","last_became_active":"2023-08-25T04:03:01.356507+0000","last_became_peered":"2023-08-25T04:03:01.356507+0000","last_unstale":"2023-08-25T04:03:03.221508+0000","last_undegraded":"2023-08-25T04:03:03.221508+0000","last_fullsized":"2023-08-25T04:03:03.221508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:07:32.176731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726476+0000","last_change":"2023-08-25T04:03:01.342638+0000","last_active":"2023-08-25T04:03:03.726476+0000","last_peered":"2023-08-25T04:03:03.726476+0000","last_clean":"2023-08-25T04:03:03.726476+0000","last_became_active":"2023-08-25T04:03:01.342295+0000","last_became_peered":"2023-08-25T04:03:01.342295+0000","last_unstale":"2023-08-25T04:03:03.726476+0000","last_undegraded":"2023-08-25T04:03:03.726476+0000","last_fullsized":"2023-08-25T04:03:03.726476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:29:51.124247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726793+0000","last_change":"2023-08-25T04:03:01.348390+0000","last_active":"2023-08-25T04:03:03.726793+0000","last_peered":"2023-08-25T04:03:03.726793+0000","last_clean":"2023-08-25T04:03:03.726793+0000","last_became_active":"2023-08-25T04:03:01.347587+0000","last_became_peered":"2023-08-25T04:03:01.347587+0000","last_unstale":"2023-08-25T04:03:03.726793+0000","last_undegraded":"2023-08-25T04:03:03.726793+0000","last_fullsized":"2023-08-25T04:03:03.726793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:16:41.881739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711233+0000","last_change":"2023-08-25T04:03:01.358436+0000","last_active":"2023-08-25T04:03:02.711233+0000","last_peered":"2023-08-25T04:03:02.711233+0000","last_clean":"2023-08-25T04:03:02.711233+0000","last_became_active":"2023-08-25T04:03:01.356095+0000","last_became_peered":"2023-08-25T04:03:01.356095+0000","last_unstale":"2023-08-25T04:03:02.711233+0000","last_undegraded":"2023-08-25T04:03:02.711233+0000","last_fullsized":"2023-08-25T04:03:02.711233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:31.298630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726832+0000","last_change":"2023-08-25T04:03:01.351628+0000","last_active":"2023-08-25T04:03:03.726832+0000","last_peered":"2023-08-25T04:03:03.726832+0000","last_clean":"2023-08-25T04:03:03.726832+0000","last_became_active":"2023-08-25T04:03:01.350541+0000","last_became_peered":"2023-08-25T04:03:01.350541+0000","last_unstale":"2023-08-25T04:03:03.726832+0000","last_undegraded":"2023-08-25T04:03:03.726832+0000","last_fullsized":"2023-08-25T04:03:03.726832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:24.755751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334503+0000","last_change":"2023-08-25T04:03:01.349534+0000","last_active":"2023-08-25T04:03:02.334503+0000","last_peered":"2023-08-25T04:03:02.334503+0000","last_clean":"2023-08-25T04:03:02.334503+0000","last_became_active":"2023-08-25T04:03:01.348968+0000","last_became_peered":"2023-08-25T04:03:01.348968+0000","last_unstale":"2023-08-25T04:03:02.334503+0000","last_undegraded":"2023-08-25T04:03:02.334503+0000","last_fullsized":"2023-08-25T04:03:02.334503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:14:51.687765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335307+0000","last_change":"2023-08-25T04:03:01.343257+0000","last_active":"2023-08-25T04:03:02.335307+0000","last_peered":"2023-08-25T04:03:02.335307+0000","last_clean":"2023-08-25T04:03:02.335307+0000","last_became_active":"2023-08-25T04:03:01.342938+0000","last_became_peered":"2023-08-25T04:03:01.342938+0000","last_unstale":"2023-08-25T04:03:02.335307+0000","last_undegraded":"2023-08-25T04:03:02.335307+0000","last_fullsized":"2023-08-25T04:03:02.335307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:31.298630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334108+0000","last_change":"2023-08-25T04:03:01.357291+0000","last_active":"2023-08-25T04:03:02.334108+0000","last_peered":"2023-08-25T04:03:02.334108+0000","last_clean":"2023-08-25T04:03:02.334108+0000","last_became_active":"2023-08-25T04:03:01.356973+0000","last_became_peered":"2023-08-25T04:03:01.356973+0000","last_unstale":"2023-08-25T04:03:02.334108+0000","last_undegraded":"2023-08-25T04:03:02.334108+0000","last_fullsized":"2023-08-25T04:03:02.334108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:21:32.310549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335221+0000","last_change":"2023-08-25T04:03:01.341244+0000","last_active":"2023-08-25T04:03:02.335221+0000","last_peered":"2023-08-25T04:03:02.335221+0000","last_clean":"2023-08-25T04:03:02.335221+0000","last_became_active":"2023-08-25T04:03:01.340907+0000","last_became_peered":"2023-08-25T04:03:01.340907+0000","last_unstale":"2023-08-25T04:03:02.335221+0000","last_undegraded":"2023-08-25T04:03:02.335221+0000","last_fullsized":"2023-08-25T04:03:02.335221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:04:24.406419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334363+0000","last_change":"2023-08-25T04:03:01.357303+0000","last_active":"2023-08-25T04:03:02.334363+0000","last_peered":"2023-08-25T04:03:02.334363+0000","last_clean":"2023-08-25T04:03:02.334363+0000","last_became_active":"2023-08-25T04:03:01.356965+0000","last_became_peered":"2023-08-25T04:03:01.356965+0000","last_unstale":"2023-08-25T04:03:02.334363+0000","last_undegraded":"2023-08-25T04:03:02.334363+0000","last_fullsized":"2023-08-25T04:03:02.334363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:42:05.413297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221859+0000","last_change":"2023-08-25T04:03:00.724082+0000","last_active":"2023-08-25T04:03:03.221859+0000","last_peered":"2023-08-25T04:03:03.221859+0000","last_clean":"2023-08-25T04:03:03.221859+0000","last_became_active":"2023-08-25T04:03:00.723792+0000","last_became_peered":"2023-08-25T04:03:00.723792+0000","last_unstale":"2023-08-25T04:03:03.221859+0000","last_undegraded":"2023-08-25T04:03:03.221859+0000","last_fullsized":"2023-08-25T04:03:03.221859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:38:17.963139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711395+0000","last_change":"2023-08-25T04:03:01.356130+0000","last_active":"2023-08-25T04:03:02.711395+0000","last_peered":"2023-08-25T04:03:02.711395+0000","last_clean":"2023-08-25T04:03:02.711395+0000","last_became_active":"2023-08-25T04:03:01.355561+0000","last_became_peered":"2023-08-25T04:03:01.355561+0000","last_unstale":"2023-08-25T04:03:02.711395+0000","last_undegraded":"2023-08-25T04:03:02.711395+0000","last_fullsized":"2023-08-25T04:03:02.711395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:55.727274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.856980+0000","last_change":"2023-08-25T04:03:00.723608+0000","last_active":"2023-08-25T04:03:02.856980+0000","last_peered":"2023-08-25T04:03:02.856980+0000","last_clean":"2023-08-25T04:03:02.856980+0000","last_became_active":"2023-08-25T04:03:00.723314+0000","last_became_peered":"2023-08-25T04:03:00.723314+0000","last_unstale":"2023-08-25T04:03:02.856980+0000","last_undegraded":"2023-08-25T04:03:02.856980+0000","last_fullsized":"2023-08-25T04:03:02.856980+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:16.973270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857273+0000","last_change":"2023-08-25T04:03:01.350258+0000","last_active":"2023-08-25T04:03:02.857273+0000","last_peered":"2023-08-25T04:03:02.857273+0000","last_clean":"2023-08-25T04:03:02.857273+0000","last_became_active":"2023-08-25T04:03:01.349984+0000","last_became_peered":"2023-08-25T04:03:01.349984+0000","last_unstale":"2023-08-25T04:03:02.857273+0000","last_undegraded":"2023-08-25T04:03:02.857273+0000","last_fullsized":"2023-08-25T04:03:02.857273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:07:32.176731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221691+0000","last_change":"2023-08-25T04:03:00.725255+0000","last_active":"2023-08-25T04:03:03.221691+0000","last_peered":"2023-08-25T04:03:03.221691+0000","last_clean":"2023-08-25T04:03:03.221691+0000","last_became_active":"2023-08-25T04:03:00.724980+0000","last_became_peered":"2023-08-25T04:03:00.724980+0000","last_unstale":"2023-08-25T04:03:03.221691+0000","last_undegraded":"2023-08-25T04:03:03.221691+0000","last_fullsized":"2023-08-25T04:03:03.221691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:04.723845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334630+0000","last_change":"2023-08-25T04:03:01.345546+0000","last_active":"2023-08-25T04:03:02.334630+0000","last_peered":"2023-08-25T04:03:02.334630+0000","last_clean":"2023-08-25T04:03:02.334630+0000","last_became_active":"2023-08-25T04:03:01.345316+0000","last_became_peered":"2023-08-25T04:03:01.345316+0000","last_unstale":"2023-08-25T04:03:02.334630+0000","last_undegraded":"2023-08-25T04:03:02.334630+0000","last_fullsized":"2023-08-25T04:03:02.334630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:16:41.881739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335383+0000","last_change":"2023-08-25T04:03:00.716518+0000","last_active":"2023-08-25T04:03:02.335383+0000","last_peered":"2023-08-25T04:03:02.335383+0000","last_clean":"2023-08-25T04:03:02.335383+0000","last_became_active":"2023-08-25T04:03:00.716196+0000","last_became_peered":"2023-08-25T04:03:00.716196+0000","last_unstale":"2023-08-25T04:03:02.335383+0000","last_undegraded":"2023-08-25T04:03:02.335383+0000","last_fullsized":"2023-08-25T04:03:02.335383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:35.759065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221966+0000","last_change":"2023-08-25T04:03:00.724751+0000","last_active":"2023-08-25T04:03:03.221966+0000","last_peered":"2023-08-25T04:03:03.221966+0000","last_clean":"2023-08-25T04:03:03.221966+0000","last_became_active":"2023-08-25T04:03:00.724484+0000","last_became_peered":"2023-08-25T04:03:00.724484+0000","last_unstale":"2023-08-25T04:03:03.221966+0000","last_undegraded":"2023-08-25T04:03:03.221966+0000","last_fullsized":"2023-08-25T04:03:03.221966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:25.866072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711055+0000","last_change":"2023-08-25T04:03:01.349649+0000","last_active":"2023-08-25T04:03:02.711055+0000","last_peered":"2023-08-25T04:03:02.711055+0000","last_clean":"2023-08-25T04:03:02.711055+0000","last_became_active":"2023-08-25T04:03:01.349285+0000","last_became_peered":"2023-08-25T04:03:01.349285+0000","last_unstale":"2023-08-25T04:03:02.711055+0000","last_undegraded":"2023-08-25T04:03:02.711055+0000","last_fullsized":"2023-08-25T04:03:02.711055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:55.890269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221848+0000","last_change":"2023-08-25T04:03:00.724274+0000","last_active":"2023-08-25T04:03:03.221848+0000","last_peered":"2023-08-25T04:03:03.221848+0000","last_clean":"2023-08-25T04:03:03.221848+0000","last_became_active":"2023-08-25T04:03:00.723971+0000","last_became_peered":"2023-08-25T04:03:00.723971+0000","last_unstale":"2023-08-25T04:03:03.221848+0000","last_undegraded":"2023-08-25T04:03:03.221848+0000","last_fullsized":"2023-08-25T04:03:03.221848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:31:33.425623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335038+0000","last_change":"2023-08-25T04:03:01.352013+0000","last_active":"2023-08-25T04:03:02.335038+0000","last_peered":"2023-08-25T04:03:02.335038+0000","last_clean":"2023-08-25T04:03:02.335038+0000","last_became_active":"2023-08-25T04:03:01.351727+0000","last_became_peered":"2023-08-25T04:03:01.351727+0000","last_unstale":"2023-08-25T04:03:02.335038+0000","last_undegraded":"2023-08-25T04:03:02.335038+0000","last_fullsized":"2023-08-25T04:03:02.335038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:55:09.171814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221979+0000","last_change":"2023-08-25T04:03:00.720598+0000","last_active":"2023-08-25T04:03:03.221979+0000","last_peered":"2023-08-25T04:03:03.221979+0000","last_clean":"2023-08-25T04:03:03.221979+0000","last_became_active":"2023-08-25T04:03:00.720316+0000","last_became_peered":"2023-08-25T04:03:00.720316+0000","last_unstale":"2023-08-25T04:03:03.221979+0000","last_undegraded":"2023-08-25T04:03:03.221979+0000","last_fullsized":"2023-08-25T04:03:03.221979+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:42:54.045585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335421+0000","last_change":"2023-08-25T04:03:01.357353+0000","last_active":"2023-08-25T04:03:02.335421+0000","last_peered":"2023-08-25T04:03:02.335421+0000","last_clean":"2023-08-25T04:03:02.335421+0000","last_became_active":"2023-08-25T04:03:01.356994+0000","last_became_peered":"2023-08-25T04:03:01.356994+0000","last_unstale":"2023-08-25T04:03:02.335421+0000","last_undegraded":"2023-08-25T04:03:02.335421+0000","last_fullsized":"2023-08-25T04:03:02.335421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:53:18.372759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711297+0000","last_change":"2023-08-25T04:03:00.721557+0000","last_active":"2023-08-25T04:03:02.711297+0000","last_peered":"2023-08-25T04:03:02.711297+0000","last_clean":"2023-08-25T04:03:02.711297+0000","last_became_active":"2023-08-25T04:03:00.721111+0000","last_became_peered":"2023-08-25T04:03:00.721111+0000","last_unstale":"2023-08-25T04:03:02.711297+0000","last_undegraded":"2023-08-25T04:03:02.711297+0000","last_fullsized":"2023-08-25T04:03:02.711297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:12:01.177818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.856932+0000","last_change":"2023-08-25T04:03:01.362147+0000","last_active":"2023-08-25T04:03:02.856932+0000","last_peered":"2023-08-25T04:03:02.856932+0000","last_clean":"2023-08-25T04:03:02.856932+0000","last_became_active":"2023-08-25T04:03:01.361891+0000","last_became_peered":"2023-08-25T04:03:01.361891+0000","last_unstale":"2023-08-25T04:03:02.856932+0000","last_undegraded":"2023-08-25T04:03:02.856932+0000","last_fullsized":"2023-08-25T04:03:02.856932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:55.890269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334620+0000","last_change":"2023-08-25T04:03:00.726270+0000","last_active":"2023-08-25T04:03:02.334620+0000","last_peered":"2023-08-25T04:03:02.334620+0000","last_clean":"2023-08-25T04:03:02.334620+0000","last_became_active":"2023-08-25T04:03:00.725846+0000","last_became_peered":"2023-08-25T04:03:00.725846+0000","last_unstale":"2023-08-25T04:03:02.334620+0000","last_undegraded":"2023-08-25T04:03:02.334620+0000","last_fullsized":"2023-08-25T04:03:02.334620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:23.745831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336163+0000","last_change":"2023-08-25T04:03:01.354419+0000","last_active":"2023-08-25T04:03:02.336163+0000","last_peered":"2023-08-25T04:03:02.336163+0000","last_clean":"2023-08-25T04:03:02.336163+0000","last_became_active":"2023-08-25T04:03:01.354110+0000","last_became_peered":"2023-08-25T04:03:01.354110+0000","last_unstale":"2023-08-25T04:03:02.336163+0000","last_undegraded":"2023-08-25T04:03:02.336163+0000","last_fullsized":"2023-08-25T04:03:02.336163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:55.727274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335674+0000","last_change":"2023-08-25T04:03:00.720247+0000","last_active":"2023-08-25T04:03:02.335674+0000","last_peered":"2023-08-25T04:03:02.335674+0000","last_clean":"2023-08-25T04:03:02.335674+0000","last_became_active":"2023-08-25T04:03:00.719941+0000","last_became_peered":"2023-08-25T04:03:00.719941+0000","last_unstale":"2023-08-25T04:03:02.335674+0000","last_undegraded":"2023-08-25T04:03:02.335674+0000","last_fullsized":"2023-08-25T04:03:02.335674+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:31:25.565858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336512+0000","last_change":"2023-08-25T04:03:01.357912+0000","last_active":"2023-08-25T04:03:02.336512+0000","last_peered":"2023-08-25T04:03:02.336512+0000","last_clean":"2023-08-25T04:03:02.336512+0000","last_became_active":"2023-08-25T04:03:01.357568+0000","last_became_peered":"2023-08-25T04:03:01.357568+0000","last_unstale":"2023-08-25T04:03:02.336512+0000","last_undegraded":"2023-08-25T04:03:02.336512+0000","last_fullsized":"2023-08-25T04:03:02.336512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:31:34.435542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335358+0000","last_change":"2023-08-25T04:03:00.719201+0000","last_active":"2023-08-25T04:03:02.335358+0000","last_peered":"2023-08-25T04:03:02.335358+0000","last_clean":"2023-08-25T04:03:02.335358+0000","last_became_active":"2023-08-25T04:03:00.718923+0000","last_became_peered":"2023-08-25T04:03:00.718923+0000","last_unstale":"2023-08-25T04:03:02.335358+0000","last_undegraded":"2023-08-25T04:03:02.335358+0000","last_fullsized":"2023-08-25T04:03:02.335358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:50:22.196879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336371+0000","last_change":"2023-08-25T04:03:01.351447+0000","last_active":"2023-08-25T04:03:02.336371+0000","last_peered":"2023-08-25T04:03:02.336371+0000","last_clean":"2023-08-25T04:03:02.336371+0000","last_became_active":"2023-08-25T04:03:01.351187+0000","last_became_peered":"2023-08-25T04:03:01.351187+0000","last_unstale":"2023-08-25T04:03:02.336371+0000","last_undegraded":"2023-08-25T04:03:02.336371+0000","last_fullsized":"2023-08-25T04:03:02.336371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:03.156111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334088+0000","last_change":"2023-08-25T04:03:00.718022+0000","last_active":"2023-08-25T04:03:02.334088+0000","last_peered":"2023-08-25T04:03:02.334088+0000","last_clean":"2023-08-25T04:03:02.334088+0000","last_became_active":"2023-08-25T04:03:00.717031+0000","last_became_peered":"2023-08-25T04:03:00.717031+0000","last_unstale":"2023-08-25T04:03:02.334088+0000","last_undegraded":"2023-08-25T04:03:02.334088+0000","last_fullsized":"2023-08-25T04:03:02.334088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:31:16.804059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726835+0000","last_change":"2023-08-25T04:03:01.347111+0000","last_active":"2023-08-25T04:03:03.726835+0000","last_peered":"2023-08-25T04:03:03.726835+0000","last_clean":"2023-08-25T04:03:03.726835+0000","last_became_active":"2023-08-25T04:03:01.346777+0000","last_became_peered":"2023-08-25T04:03:01.346777+0000","last_unstale":"2023-08-25T04:03:03.726835+0000","last_undegraded":"2023-08-25T04:03:03.726835+0000","last_fullsized":"2023-08-25T04:03:03.726835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:02:14.211702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":175,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221677+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:03:03.221677+0000","last_peered":"2023-08-25T04:03:03.221677+0000","last_clean":"2023-08-25T04:03:03.221677+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:03:03.221677+0000","last_undegraded":"2023-08-25T04:03:03.221677+0000","last_fullsized":"2023-08-25T04:03:03.221677+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:39:47.813927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711352+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:03:02.711352+0000","last_peered":"2023-08-25T04:03:02.711352+0000","last_clean":"2023-08-25T04:03:02.711352+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:03:02.711352+0000","last_undegraded":"2023-08-25T04:03:02.711352+0000","last_fullsized":"2023-08-25T04:03:02.711352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:07:26.129416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334130+0000","last_change":"2023-08-25T04:03:00.716745+0000","last_active":"2023-08-25T04:03:02.334130+0000","last_peered":"2023-08-25T04:03:02.334130+0000","last_clean":"2023-08-25T04:03:02.334130+0000","last_became_active":"2023-08-25T04:03:00.716419+0000","last_became_peered":"2023-08-25T04:03:00.716419+0000","last_unstale":"2023-08-25T04:03:02.334130+0000","last_undegraded":"2023-08-25T04:03:02.334130+0000","last_fullsized":"2023-08-25T04:03:02.334130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:00:59.219341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335514+0000","last_change":"2023-08-25T04:03:01.359007+0000","last_active":"2023-08-25T04:03:02.335514+0000","last_peered":"2023-08-25T04:03:02.335514+0000","last_clean":"2023-08-25T04:03:02.335514+0000","last_became_active":"2023-08-25T04:03:01.358654+0000","last_became_peered":"2023-08-25T04:03:01.358654+0000","last_unstale":"2023-08-25T04:03:02.335514+0000","last_undegraded":"2023-08-25T04:03:02.335514+0000","last_fullsized":"2023-08-25T04:03:02.335514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:26.962898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221750+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:03:03.221750+0000","last_peered":"2023-08-25T04:03:03.221750+0000","last_clean":"2023-08-25T04:03:03.221750+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:03:03.221750+0000","last_undegraded":"2023-08-25T04:03:03.221750+0000","last_fullsized":"2023-08-25T04:03:03.221750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:50:12.445240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.856811+0000","last_change":"2023-08-25T04:03:00.724401+0000","last_active":"2023-08-25T04:03:02.856811+0000","last_peered":"2023-08-25T04:03:02.856811+0000","last_clean":"2023-08-25T04:03:02.856811+0000","last_became_active":"2023-08-25T04:03:00.724057+0000","last_became_peered":"2023-08-25T04:03:00.724057+0000","last_unstale":"2023-08-25T04:03:02.856811+0000","last_undegraded":"2023-08-25T04:03:02.856811+0000","last_fullsized":"2023-08-25T04:03:02.856811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:09:39.160220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857204+0000","last_change":"2023-08-25T04:03:01.362199+0000","last_active":"2023-08-25T04:03:02.857204+0000","last_peered":"2023-08-25T04:03:02.857204+0000","last_clean":"2023-08-25T04:03:02.857204+0000","last_became_active":"2023-08-25T04:03:01.361885+0000","last_became_peered":"2023-08-25T04:03:01.361885+0000","last_unstale":"2023-08-25T04:03:02.857204+0000","last_undegraded":"2023-08-25T04:03:02.857204+0000","last_fullsized":"2023-08-25T04:03:02.857204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:08:37.753060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.459489+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:03:03.459489+0000","last_peered":"2023-08-25T04:03:03.459489+0000","last_clean":"2023-08-25T04:03:03.459489+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:03:03.459489+0000","last_undegraded":"2023-08-25T04:03:03.459489+0000","last_fullsized":"2023-08-25T04:03:03.459489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:01:59.393215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.725585+0000","last_change":"2023-08-25T04:03:00.715784+0000","last_active":"2023-08-25T04:03:03.725585+0000","last_peered":"2023-08-25T04:03:03.725585+0000","last_clean":"2023-08-25T04:03:03.725585+0000","last_became_active":"2023-08-25T04:03:00.715481+0000","last_became_peered":"2023-08-25T04:03:00.715481+0000","last_unstale":"2023-08-25T04:03:03.725585+0000","last_undegraded":"2023-08-25T04:03:03.725585+0000","last_fullsized":"2023-08-25T04:03:03.725585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:31:16.804059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726625+0000","last_change":"2023-08-25T04:03:01.351813+0000","last_active":"2023-08-25T04:03:03.726625+0000","last_peered":"2023-08-25T04:03:03.726625+0000","last_clean":"2023-08-25T04:03:03.726625+0000","last_became_active":"2023-08-25T04:03:01.351168+0000","last_became_peered":"2023-08-25T04:03:01.351168+0000","last_unstale":"2023-08-25T04:03:03.726625+0000","last_undegraded":"2023-08-25T04:03:03.726625+0000","last_fullsized":"2023-08-25T04:03:03.726625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:14:42.010699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711239+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:03:02.711239+0000","last_peered":"2023-08-25T04:03:02.711239+0000","last_clean":"2023-08-25T04:03:02.711239+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:03:02.711239+0000","last_undegraded":"2023-08-25T04:03:02.711239+0000","last_fullsized":"2023-08-25T04:03:02.711239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:50:17.159484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336213+0000","last_change":"2023-08-25T04:03:00.726687+0000","last_active":"2023-08-25T04:03:02.336213+0000","last_peered":"2023-08-25T04:03:02.336213+0000","last_clean":"2023-08-25T04:03:02.336213+0000","last_became_active":"2023-08-25T04:03:00.726151+0000","last_became_peered":"2023-08-25T04:03:00.726151+0000","last_unstale":"2023-08-25T04:03:02.336213+0000","last_undegraded":"2023-08-25T04:03:02.336213+0000","last_fullsized":"2023-08-25T04:03:02.336213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:04.723845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726361+0000","last_change":"2023-08-25T04:03:01.347217+0000","last_active":"2023-08-25T04:03:03.726361+0000","last_peered":"2023-08-25T04:03:03.726361+0000","last_clean":"2023-08-25T04:03:03.726361+0000","last_became_active":"2023-08-25T04:03:01.346945+0000","last_became_peered":"2023-08-25T04:03:01.346945+0000","last_unstale":"2023-08-25T04:03:03.726361+0000","last_undegraded":"2023-08-25T04:03:03.726361+0000","last_fullsized":"2023-08-25T04:03:03.726361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:42:05.413297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711563+0000","last_change":"2023-08-25T04:03:00.721967+0000","last_active":"2023-08-25T04:03:02.711563+0000","last_peered":"2023-08-25T04:03:02.711563+0000","last_clean":"2023-08-25T04:03:02.711563+0000","last_became_active":"2023-08-25T04:03:00.721550+0000","last_became_peered":"2023-08-25T04:03:00.721550+0000","last_unstale":"2023-08-25T04:03:02.711563+0000","last_undegraded":"2023-08-25T04:03:02.711563+0000","last_fullsized":"2023-08-25T04:03:02.711563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:31:56.892771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.725392+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:03:03.725392+0000","last_peered":"2023-08-25T04:03:03.725392+0000","last_clean":"2023-08-25T04:03:03.725392+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:03:03.725392+0000","last_undegraded":"2023-08-25T04:03:03.725392+0000","last_fullsized":"2023-08-25T04:03:03.725392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:53:40.748218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726277+0000","last_change":"2023-08-25T04:03:01.350688+0000","last_active":"2023-08-25T04:03:03.726277+0000","last_peered":"2023-08-25T04:03:03.726277+0000","last_clean":"2023-08-25T04:03:03.726277+0000","last_became_active":"2023-08-25T04:03:01.350333+0000","last_became_peered":"2023-08-25T04:03:01.350333+0000","last_unstale":"2023-08-25T04:03:03.726277+0000","last_undegraded":"2023-08-25T04:03:03.726277+0000","last_fullsized":"2023-08-25T04:03:03.726277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:17:39.196100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726525+0000","last_change":"2023-08-25T04:03:00.710773+0000","last_active":"2023-08-25T04:03:03.726525+0000","last_peered":"2023-08-25T04:03:03.726525+0000","last_clean":"2023-08-25T04:03:03.726525+0000","last_became_active":"2023-08-25T04:03:00.710376+0000","last_became_peered":"2023-08-25T04:03:00.710376+0000","last_unstale":"2023-08-25T04:03:03.726525+0000","last_undegraded":"2023-08-25T04:03:03.726525+0000","last_fullsized":"2023-08-25T04:03:03.726525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:14:50.677846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.222057+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:03:03.222057+0000","last_peered":"2023-08-25T04:03:03.222057+0000","last_clean":"2023-08-25T04:03:03.222057+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:03:03.222057+0000","last_undegraded":"2023-08-25T04:03:03.222057+0000","last_fullsized":"2023-08-25T04:03:03.222057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:31.595801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.856940+0000","last_change":"2023-08-25T04:03:01.352376+0000","last_active":"2023-08-25T04:03:02.856940+0000","last_peered":"2023-08-25T04:03:02.856940+0000","last_clean":"2023-08-25T04:03:02.856940+0000","last_became_active":"2023-08-25T04:03:01.352104+0000","last_became_peered":"2023-08-25T04:03:01.352104+0000","last_unstale":"2023-08-25T04:03:02.856940+0000","last_undegraded":"2023-08-25T04:03:02.856940+0000","last_fullsized":"2023-08-25T04:03:02.856940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:10:46.841700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334677+0000","last_change":"2023-08-25T04:03:00.718260+0000","last_active":"2023-08-25T04:03:02.334677+0000","last_peered":"2023-08-25T04:03:02.334677+0000","last_clean":"2023-08-25T04:03:02.334677+0000","last_became_active":"2023-08-25T04:03:00.717748+0000","last_became_peered":"2023-08-25T04:03:00.717748+0000","last_unstale":"2023-08-25T04:03:02.334677+0000","last_undegraded":"2023-08-25T04:03:02.334677+0000","last_fullsized":"2023-08-25T04:03:02.334677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:09:22.303931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.725411+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:03:03.725411+0000","last_peered":"2023-08-25T04:03:03.725411+0000","last_clean":"2023-08-25T04:03:03.725411+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:03:03.725411+0000","last_undegraded":"2023-08-25T04:03:03.725411+0000","last_fullsized":"2023-08-25T04:03:03.725411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:49:43.854917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.333963+0000","last_change":"2023-08-25T04:03:01.345303+0000","last_active":"2023-08-25T04:03:02.333963+0000","last_peered":"2023-08-25T04:03:02.333963+0000","last_clean":"2023-08-25T04:03:02.333963+0000","last_became_active":"2023-08-25T04:03:01.344815+0000","last_became_peered":"2023-08-25T04:03:01.344815+0000","last_unstale":"2023-08-25T04:03:02.333963+0000","last_undegraded":"2023-08-25T04:03:02.333963+0000","last_fullsized":"2023-08-25T04:03:02.333963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:33:22.570632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857336+0000","last_change":"2023-08-25T04:03:00.723286+0000","last_active":"2023-08-25T04:03:02.857336+0000","last_peered":"2023-08-25T04:03:02.857336+0000","last_clean":"2023-08-25T04:03:02.857336+0000","last_became_active":"2023-08-25T04:03:00.722952+0000","last_became_peered":"2023-08-25T04:03:00.722952+0000","last_unstale":"2023-08-25T04:03:02.857336+0000","last_undegraded":"2023-08-25T04:03:02.857336+0000","last_fullsized":"2023-08-25T04:03:02.857336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:54.717355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335621+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:03:02.335621+0000","last_peered":"2023-08-25T04:03:02.335621+0000","last_clean":"2023-08-25T04:03:02.335621+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:03:02.335621+0000","last_undegraded":"2023-08-25T04:03:02.335621+0000","last_fullsized":"2023-08-25T04:03:02.335621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:00:57.716050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335246+0000","last_change":"2023-08-25T04:03:01.358953+0000","last_active":"2023-08-25T04:03:02.335246+0000","last_peered":"2023-08-25T04:03:02.335246+0000","last_clean":"2023-08-25T04:03:02.335246+0000","last_became_active":"2023-08-25T04:03:01.358612+0000","last_became_peered":"2023-08-25T04:03:01.358612+0000","last_unstale":"2023-08-25T04:03:02.335246+0000","last_undegraded":"2023-08-25T04:03:02.335246+0000","last_fullsized":"2023-08-25T04:03:02.335246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:45.270852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336173+0000","last_change":"2023-08-25T04:03:01.358957+0000","last_active":"2023-08-25T04:03:02.336173+0000","last_peered":"2023-08-25T04:03:02.336173+0000","last_clean":"2023-08-25T04:03:02.336173+0000","last_became_active":"2023-08-25T04:03:01.358559+0000","last_became_peered":"2023-08-25T04:03:01.358559+0000","last_unstale":"2023-08-25T04:03:02.336173+0000","last_undegraded":"2023-08-25T04:03:02.336173+0000","last_fullsized":"2023-08-25T04:03:02.336173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:40:00.894010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336333+0000","last_change":"2023-08-25T04:03:00.719414+0000","last_active":"2023-08-25T04:03:02.336333+0000","last_peered":"2023-08-25T04:03:02.336333+0000","last_clean":"2023-08-25T04:03:02.336333+0000","last_became_active":"2023-08-25T04:03:00.719016+0000","last_became_peered":"2023-08-25T04:03:00.719016+0000","last_unstale":"2023-08-25T04:03:02.336333+0000","last_undegraded":"2023-08-25T04:03:02.336333+0000","last_fullsized":"2023-08-25T04:03:02.336333+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:13:47.004438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726230+0000","last_change":"2023-08-25T04:03:01.348671+0000","last_active":"2023-08-25T04:03:03.726230+0000","last_peered":"2023-08-25T04:03:03.726230+0000","last_clean":"2023-08-25T04:03:03.726230+0000","last_became_active":"2023-08-25T04:03:01.348415+0000","last_became_peered":"2023-08-25T04:03:01.348415+0000","last_unstale":"2023-08-25T04:03:03.726230+0000","last_undegraded":"2023-08-25T04:03:03.726230+0000","last_fullsized":"2023-08-25T04:03:03.726230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:01:00.229261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.221754+0000","last_change":"2023-08-25T04:03:00.721463+0000","last_active":"2023-08-25T04:03:03.221754+0000","last_peered":"2023-08-25T04:03:03.221754+0000","last_clean":"2023-08-25T04:03:03.221754+0000","last_became_active":"2023-08-25T04:03:00.721177+0000","last_became_peered":"2023-08-25T04:03:00.721177+0000","last_unstale":"2023-08-25T04:03:03.221754+0000","last_undegraded":"2023-08-25T04:03:03.221754+0000","last_fullsized":"2023-08-25T04:03:03.221754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:13:47.004438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711603+0000","last_change":"2023-08-25T04:03:00.719107+0000","last_active":"2023-08-25T04:03:02.711603+0000","last_peered":"2023-08-25T04:03:02.711603+0000","last_clean":"2023-08-25T04:03:02.711603+0000","last_became_active":"2023-08-25T04:03:00.718831+0000","last_became_peered":"2023-08-25T04:03:00.718831+0000","last_unstale":"2023-08-25T04:03:02.711603+0000","last_undegraded":"2023-08-25T04:03:02.711603+0000","last_fullsized":"2023-08-25T04:03:02.711603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:50:17.482636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334254+0000","last_change":"2023-08-25T04:03:01.349735+0000","last_active":"2023-08-25T04:03:02.334254+0000","last_peered":"2023-08-25T04:03:02.334254+0000","last_clean":"2023-08-25T04:03:02.334254+0000","last_became_active":"2023-08-25T04:03:01.349169+0000","last_became_peered":"2023-08-25T04:03:01.349169+0000","last_unstale":"2023-08-25T04:03:02.334254+0000","last_undegraded":"2023-08-25T04:03:02.334254+0000","last_fullsized":"2023-08-25T04:03:02.334254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:17:39.196100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857509+0000","last_change":"2023-08-25T04:03:00.722052+0000","last_active":"2023-08-25T04:03:02.857509+0000","last_peered":"2023-08-25T04:03:02.857509+0000","last_clean":"2023-08-25T04:03:02.857509+0000","last_became_active":"2023-08-25T04:03:00.721711+0000","last_became_peered":"2023-08-25T04:03:00.721711+0000","last_unstale":"2023-08-25T04:03:02.857509+0000","last_undegraded":"2023-08-25T04:03:02.857509+0000","last_fullsized":"2023-08-25T04:03:02.857509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:31:56.892771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.333893+0000","last_change":"2023-08-25T04:03:01.345111+0000","last_active":"2023-08-25T04:03:02.333893+0000","last_peered":"2023-08-25T04:03:02.333893+0000","last_clean":"2023-08-25T04:03:02.333893+0000","last_became_active":"2023-08-25T04:03:01.344450+0000","last_became_peered":"2023-08-25T04:03:01.344450+0000","last_unstale":"2023-08-25T04:03:02.333893+0000","last_undegraded":"2023-08-25T04:03:02.333893+0000","last_fullsized":"2023-08-25T04:03:02.333893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:51.005114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335653+0000","last_change":"2023-08-25T04:03:01.354750+0000","last_active":"2023-08-25T04:03:02.335653+0000","last_peered":"2023-08-25T04:03:02.335653+0000","last_clean":"2023-08-25T04:03:02.335653+0000","last_became_active":"2023-08-25T04:03:01.354428+0000","last_became_peered":"2023-08-25T04:03:01.354428+0000","last_unstale":"2023-08-25T04:03:02.335653+0000","last_undegraded":"2023-08-25T04:03:02.335653+0000","last_fullsized":"2023-08-25T04:03:02.335653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:55.173495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334030+0000","last_change":"2023-08-25T04:03:00.724234+0000","last_active":"2023-08-25T04:03:02.334030+0000","last_peered":"2023-08-25T04:03:02.334030+0000","last_clean":"2023-08-25T04:03:02.334030+0000","last_became_active":"2023-08-25T04:03:00.723532+0000","last_became_peered":"2023-08-25T04:03:00.723532+0000","last_unstale":"2023-08-25T04:03:02.334030+0000","last_undegraded":"2023-08-25T04:03:02.334030+0000","last_fullsized":"2023-08-25T04:03:02.334030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:53:45.785613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857193+0000","last_change":"2023-08-25T04:03:01.349065+0000","last_active":"2023-08-25T04:03:02.857193+0000","last_peered":"2023-08-25T04:03:02.857193+0000","last_clean":"2023-08-25T04:03:02.857193+0000","last_became_active":"2023-08-25T04:03:01.348789+0000","last_became_peered":"2023-08-25T04:03:01.348789+0000","last_unstale":"2023-08-25T04:03:02.857193+0000","last_undegraded":"2023-08-25T04:03:02.857193+0000","last_fullsized":"2023-08-25T04:03:02.857193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:12:02.187737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.726121+0000","last_change":"2023-08-25T04:03:00.718057+0000","last_active":"2023-08-25T04:03:03.726121+0000","last_peered":"2023-08-25T04:03:03.726121+0000","last_clean":"2023-08-25T04:03:03.726121+0000","last_became_active":"2023-08-25T04:03:00.717736+0000","last_became_peered":"2023-08-25T04:03:00.717736+0000","last_unstale":"2023-08-25T04:03:03.726121+0000","last_undegraded":"2023-08-25T04:03:03.726121+0000","last_fullsized":"2023-08-25T04:03:03.726121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:21:31.300629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334621+0000","last_change":"2023-08-25T04:03:01.357499+0000","last_active":"2023-08-25T04:03:02.334621+0000","last_peered":"2023-08-25T04:03:02.334621+0000","last_clean":"2023-08-25T04:03:02.334621+0000","last_became_active":"2023-08-25T04:03:01.357124+0000","last_became_peered":"2023-08-25T04:03:01.357124+0000","last_unstale":"2023-08-25T04:03:02.334621+0000","last_undegraded":"2023-08-25T04:03:02.334621+0000","last_fullsized":"2023-08-25T04:03:02.334621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:02:14.211702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335702+0000","last_change":"2023-08-25T04:03:00.719151+0000","last_active":"2023-08-25T04:03:02.335702+0000","last_peered":"2023-08-25T04:03:02.335702+0000","last_clean":"2023-08-25T04:03:02.335702+0000","last_became_active":"2023-08-25T04:03:00.718851+0000","last_became_peered":"2023-08-25T04:03:00.718851+0000","last_unstale":"2023-08-25T04:03:02.335702+0000","last_undegraded":"2023-08-25T04:03:02.335702+0000","last_fullsized":"2023-08-25T04:03:02.335702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:08:36.743141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:03.459589+0000","last_change":"2023-08-25T04:03:01.357412+0000","last_active":"2023-08-25T04:03:03.459589+0000","last_peered":"2023-08-25T04:03:03.459589+0000","last_clean":"2023-08-25T04:03:03.459589+0000","last_became_active":"2023-08-25T04:03:01.357136+0000","last_became_peered":"2023-08-25T04:03:01.357136+0000","last_unstale":"2023-08-25T04:03:03.459589+0000","last_undegraded":"2023-08-25T04:03:03.459589+0000","last_fullsized":"2023-08-25T04:03:03.459589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:14:58.886873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857086+0000","last_change":"2023-08-25T04:03:00.725319+0000","last_active":"2023-08-25T04:03:02.857086+0000","last_peered":"2023-08-25T04:03:02.857086+0000","last_clean":"2023-08-25T04:03:02.857086+0000","last_became_active":"2023-08-25T04:03:00.725047+0000","last_became_peered":"2023-08-25T04:03:00.725047+0000","last_unstale":"2023-08-25T04:03:02.857086+0000","last_undegraded":"2023-08-25T04:03:02.857086+0000","last_fullsized":"2023-08-25T04:03:02.857086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:30.288711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.336061+0000","last_change":"2023-08-25T04:03:01.359175+0000","last_active":"2023-08-25T04:03:02.336061+0000","last_peered":"2023-08-25T04:03:02.336061+0000","last_clean":"2023-08-25T04:03:02.336061+0000","last_became_active":"2023-08-25T04:03:01.358098+0000","last_became_peered":"2023-08-25T04:03:01.358098+0000","last_unstale":"2023-08-25T04:03:02.336061+0000","last_undegraded":"2023-08-25T04:03:02.336061+0000","last_fullsized":"2023-08-25T04:03:02.336061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:07:32.176731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711204+0000","last_change":"2023-08-25T04:03:00.724464+0000","last_active":"2023-08-25T04:03:02.711204+0000","last_peered":"2023-08-25T04:03:02.711204+0000","last_clean":"2023-08-25T04:03:02.711204+0000","last_became_active":"2023-08-25T04:03:00.724195+0000","last_became_peered":"2023-08-25T04:03:00.724195+0000","last_unstale":"2023-08-25T04:03:02.711204+0000","last_undegraded":"2023-08-25T04:03:02.711204+0000","last_fullsized":"2023-08-25T04:03:02.711204+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:44.260933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335179+0000","last_change":"2023-08-25T04:03:01.359383+0000","last_active":"2023-08-25T04:03:02.335179+0000","last_peered":"2023-08-25T04:03:02.335179+0000","last_clean":"2023-08-25T04:03:02.335179+0000","last_became_active":"2023-08-25T04:03:01.358081+0000","last_became_peered":"2023-08-25T04:03:01.358081+0000","last_unstale":"2023-08-25T04:03:02.335179+0000","last_undegraded":"2023-08-25T04:03:02.335179+0000","last_fullsized":"2023-08-25T04:03:02.335179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:17.983189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.711534+0000","last_change":"2023-08-25T04:03:00.724403+0000","last_active":"2023-08-25T04:03:02.711534+0000","last_peered":"2023-08-25T04:03:02.711534+0000","last_clean":"2023-08-25T04:03:02.711534+0000","last_became_active":"2023-08-25T04:03:00.724136+0000","last_became_peered":"2023-08-25T04:03:00.724136+0000","last_unstale":"2023-08-25T04:03:02.711534+0000","last_undegraded":"2023-08-25T04:03:02.711534+0000","last_fullsized":"2023-08-25T04:03:02.711534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:04.723845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334480+0000","last_change":"2023-08-25T04:03:01.348397+0000","last_active":"2023-08-25T04:03:02.334480+0000","last_peered":"2023-08-25T04:03:02.334480+0000","last_clean":"2023-08-25T04:03:02.334480+0000","last_became_active":"2023-08-25T04:03:01.345667+0000","last_became_peered":"2023-08-25T04:03:01.345667+0000","last_unstale":"2023-08-25T04:03:02.334480+0000","last_undegraded":"2023-08-25T04:03:02.334480+0000","last_fullsized":"2023-08-25T04:03:02.334480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:29:51.124247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.334436+0000","last_change":"2023-08-25T04:03:00.718222+0000","last_active":"2023-08-25T04:03:02.334436+0000","last_peered":"2023-08-25T04:03:02.334436+0000","last_clean":"2023-08-25T04:03:02.334436+0000","last_became_active":"2023-08-25T04:03:00.717941+0000","last_became_peered":"2023-08-25T04:03:00.717941+0000","last_unstale":"2023-08-25T04:03:02.334436+0000","last_undegraded":"2023-08-25T04:03:02.334436+0000","last_fullsized":"2023-08-25T04:03:02.334436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:14:41.000779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.335078+0000","last_change":"2023-08-25T04:03:01.344378+0000","last_active":"2023-08-25T04:03:02.335078+0000","last_peered":"2023-08-25T04:03:02.335078+0000","last_clean":"2023-08-25T04:03:02.335078+0000","last_became_active":"2023-08-25T04:03:01.343370+0000","last_became_peered":"2023-08-25T04:03:01.343370+0000","last_unstale":"2023-08-25T04:03:02.335078+0000","last_undegraded":"2023-08-25T04:03:02.335078+0000","last_fullsized":"2023-08-25T04:03:02.335078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:00.686539+0000","last_clean_scrub_stamp":"2023-08-25T04:03:00.686539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:55.890269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-08-25T04:03:02.857402+0000","last_change":"2023-08-25T04:03:00.723428+0000","last_active":"2023-08-25T04:03:02.857402+0000","last_peered":"2023-08-25T04:03:02.857402+0000","last_clean":"2023-08-25T04:03:02.857402+0000","last_became_active":"2023-08-25T04:03:00.722959+0000","last_became_peered":"2023-08-25T04:03:00.722959+0000","last_unstale":"2023-08-25T04:03:02.857402+0000","last_undegraded":"2023-08-25T04:03:02.857402+0000","last_fullsized":"2023-08-25T04:03:02.857402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:59.676619+0000","last_clean_scrub_stamp":"2023-08-25T04:02:59.676619+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:04.723845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":868352,"data_stored":684014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":91818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":253952,"data_stored":92470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":93486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":249856,"data_stored":91908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":245760,"data_stored":91818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":245760,"data_stored":91818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":843776,"data_stored":682768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:03:11.005 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-25T04:03:11.006 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-25T04:03:11.006 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-25T04:03:11.006 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-25T04:03:11.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.147+0000 7fe1613ac640 1 Processor -- start 2023-08-25T04:03:11.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.147+0000 7fe1613ac640 1 -- start start 2023-08-25T04:03:11.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.147+0000 7fe1613ac640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe15c0cf4a0 0x7fe15c0d2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:11.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.147+0000 7fe1613ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe15c0cf880 0x7fe15c0d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:11.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.147+0000 7fe1613ac640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15c0ce1d0 con 0x7fe15c0d11f0 2023-08-25T04:03:11.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.147+0000 7fe1613ac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15c0ce660 con 0x7fe15c0cf880 2023-08-25T04:03:11.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.147+0000 7fe1613ac640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15c0d15d0 con 0x7fe15c0cf4a0 2023-08-25T04:03:11.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.147+0000 7fe1527fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe15c0cf880 0x7fe15c0d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:11.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.147+0000 7fe1527fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe15c0cf880 0x7fe15c0d0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59726/0 (socket says 172.21.15.55:59726) 2023-08-25T04:03:11.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.147+0000 7fe1527fc640 1 -- 172.21.15.55:0/2122174233 learned_addr learned my addr 172.21.15.55:0/2122174233 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:11.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.147+0000 7fe15affd640 1 --2- 172.21.15.55:0/2122174233 >> v2:172.21.15.110:3300/0 conn(0x7fe15c0cf4a0 0x7fe15c0d2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:11.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.147+0000 7fe1527fc640 1 -- 172.21.15.55:0/2122174233 >> v2:172.21.15.110:3300/0 conn(0x7fe15c0cf4a0 msgr2=0x7fe15c0d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:11.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.147+0000 7fe1527fc640 1 --2- 172.21.15.55:0/2122174233 >> v2:172.21.15.110:3300/0 conn(0x7fe15c0cf4a0 0x7fe15c0d2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.147+0000 7fe1527fc640 1 -- 172.21.15.55:0/2122174233 >> v1:172.21.15.110:6789/0 conn(0x7fe15c0d11f0 legacy=0x7fe15c160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:11.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.147+0000 7fe1527fc640 1 -- 172.21.15.55:0/2122174233 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c0cd5c0 con 0x7fe15c0cf880 2023-08-25T04:03:11.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.151+0000 7fe1527fc640 1 --2- 172.21.15.55:0/2122174233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe15c0cf880 0x7fe15c0d0cb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe15c08a5e0 tx=0x7fe14c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87590bb730be5e46 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:11.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.151+0000 7fe15a7fc640 1 -- 172.21.15.55:0/2122174233 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0ac410 con 0x7fe15c0cf880 2023-08-25T04:03:11.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.151+0000 7fe15a7fc640 1 -- 172.21.15.55:0/2122174233 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c0ac570 con 0x7fe15c0cf880 2023-08-25T04:03:11.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.151+0000 7fe15a7fc640 1 -- 172.21.15.55:0/2122174233 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0ac900 con 0x7fe15c0cf880 2023-08-25T04:03:11.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.151+0000 7fe1613ac640 1 -- 172.21.15.55:0/2122174233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe15c0cf880 msgr2=0x7fe15c0d0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:11.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.151+0000 7fe1613ac640 1 --2- 172.21.15.55:0/2122174233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe15c0cf880 0x7fe15c0d0cb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe15c08a5e0 tx=0x7fe14c01c490 comp rx=0 tx=0).stop 2023-08-25T04:03:11.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.151+0000 7fe1613ac640 1 -- 172.21.15.55:0/2122174233 shutdown_connections 2023-08-25T04:03:11.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.151+0000 7fe1613ac640 1 --2- 172.21.15.55:0/2122174233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe15c0cf880 0x7fe15c0d0cb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.151+0000 7fe1613ac640 1 --2- 172.21.15.55:0/2122174233 >> v2:172.21.15.110:3300/0 conn(0x7fe15c0cf4a0 0x7fe15c0d2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.151+0000 7fe1613ac640 1 -- 172.21.15.55:0/2122174233 >> 172.21.15.55:0/2122174233 conn(0x7fe15c089f90 msgr2=0x7fe15c0d26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:11.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.151+0000 7fe1613ac640 1 -- 172.21.15.55:0/2122174233 shutdown_connections 2023-08-25T04:03:11.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.151+0000 7fe1613ac640 1 -- 172.21.15.55:0/2122174233 wait complete. 2023-08-25T04:03:11.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1613ac640 1 Processor -- start 2023-08-25T04:03:11.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1613ac640 1 -- start start 2023-08-25T04:03:11.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1613ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe15c0cf4a0 0x7fe15c14f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:11.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1613ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe15c0cf880 0x7fe15c15b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:11.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1613ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe15c0d11f0 0x7fe15c0ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:11.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1613ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c14feb0 con 0x7fe15c0cf880 2023-08-25T04:03:11.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1613ac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0c6e40 con 0x7fe15c0cf4a0 2023-08-25T04:03:11.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1613ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c15a1c0 con 0x7fe15c0d11f0 2023-08-25T04:03:11.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1527fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe15c0cf880 0x7fe15c15b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:11.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1527fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe15c0cf880 0x7fe15c15b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59734/0 (socket says 172.21.15.55:59734) 2023-08-25T04:03:11.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1527fc640 1 -- 172.21.15.55:0/3224420938 learned_addr learned my addr 172.21.15.55:0/3224420938 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:11.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe15affd640 1 --2- 172.21.15.55:0/3224420938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe15c0cf4a0 0x7fe15c14f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:11.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe15b7fe640 1 --2- 172.21.15.55:0/3224420938 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe15c0d11f0 0x7fe15c0ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:11.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1527fc640 1 -- 172.21.15.55:0/3224420938 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe15c0d11f0 msgr2=0x7fe15c0ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:11.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1527fc640 1 --2- 172.21.15.55:0/3224420938 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe15c0d11f0 0x7fe15c0ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1527fc640 1 -- 172.21.15.55:0/3224420938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe15c0cf4a0 msgr2=0x7fe15c14f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:11.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1527fc640 1 --2- 172.21.15.55:0/3224420938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe15c0cf4a0 0x7fe15c14f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1527fc640 1 -- 172.21.15.55:0/3224420938 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0094d0 con 0x7fe15c0cf880 2023-08-25T04:03:11.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1527fc640 1 --2- 172.21.15.55:0/3224420938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe15c0cf880 0x7fe15c15b190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe14c01a0c0 tx=0x7fe14c019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:11.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe153fff640 1 -- 172.21.15.55:0/3224420938 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0ac410 con 0x7fe15c0cf880 2023-08-25T04:03:11.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe153fff640 1 -- 172.21.15.55:0/3224420938 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c0b65f0 con 0x7fe15c0cf880 2023-08-25T04:03:11.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe153fff640 1 -- 172.21.15.55:0/3224420938 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0b69c0 con 0x7fe15c0cf880 2023-08-25T04:03:11.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1613ac640 1 -- 172.21.15.55:0/3224420938 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15c15ad00 con 0x7fe15c0cf880 2023-08-25T04:03:11.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1613ac640 1 -- 172.21.15.55:0/3224420938 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15c15a6b0 con 0x7fe15c0cf880 2023-08-25T04:03:11.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.155+0000 7fe1613ac640 1 -- 172.21.15.55:0/3224420938 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15c0d34b0 con 0x7fe15c0cf880 2023-08-25T04:03:11.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.159+0000 7fe153fff640 1 -- 172.21.15.55:0/3224420938 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe14c0b6b20 con 0x7fe15c0cf880 2023-08-25T04:03:11.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.159+0000 7fe153fff640 1 --2- 172.21.15.55:0/3224420938 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe13c065680 0x7fe13c067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:11.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.159+0000 7fe153fff640 1 -- 172.21.15.55:0/3224420938 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe14c11d650 con 0x7fe15c0cf880 2023-08-25T04:03:11.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.159+0000 7fe15affd640 1 --2- 172.21.15.55:0/3224420938 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe13c065680 0x7fe13c067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:11.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.159+0000 7fe15affd640 1 --2- 172.21.15.55:0/3224420938 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe13c065680 0x7fe13c067b40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe1440079c0 tx=0x7fe144008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:11.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.163+0000 7fe153fff640 1 -- 172.21.15.55:0/3224420938 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe14c0eb180 con 0x7fe15c0cf880 2023-08-25T04:03:11.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.355+0000 7fe1613ac640 1 -- 172.21.15.55:0/3224420938 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe15c073ec0 con 0x7fe15c0cf880 2023-08-25T04:03:11.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.355+0000 7fe153fff640 1 -- 172.21.15.55:0/3224420938 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe14c0f2e60 con 0x7fe15c0cf880 2023-08-25T04:03:11.357 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:11.357 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-25T04:03:11.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.355+0000 7fe1613ac640 1 -- 172.21.15.55:0/3224420938 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe13c065680 msgr2=0x7fe13c067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:11.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.355+0000 7fe1613ac640 1 --2- 172.21.15.55:0/3224420938 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe13c065680 0x7fe13c067b40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe1440079c0 tx=0x7fe144008040 comp rx=0 tx=0).stop 2023-08-25T04:03:11.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.355+0000 7fe1613ac640 1 -- 172.21.15.55:0/3224420938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe15c0cf880 msgr2=0x7fe15c15b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:11.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.355+0000 7fe1613ac640 1 --2- 172.21.15.55:0/3224420938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe15c0cf880 0x7fe15c15b190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe14c01a0c0 tx=0x7fe14c019230 comp rx=0 tx=0).stop 2023-08-25T04:03:11.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.355+0000 7fe1613ac640 1 -- 172.21.15.55:0/3224420938 shutdown_connections 2023-08-25T04:03:11.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.355+0000 7fe1613ac640 1 --2- 172.21.15.55:0/3224420938 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe13c065680 0x7fe13c067b40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.355+0000 7fe1613ac640 1 --2- 172.21.15.55:0/3224420938 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe15c0d11f0 0x7fe15c0ca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.355+0000 7fe1613ac640 1 --2- 172.21.15.55:0/3224420938 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe15c0cf880 0x7fe15c15b190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.355+0000 7fe1613ac640 1 --2- 172.21.15.55:0/3224420938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe15c0cf4a0 0x7fe15c14f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.355+0000 7fe1613ac640 1 -- 172.21.15.55:0/3224420938 >> 172.21.15.55:0/3224420938 conn(0x7fe15c089f90 msgr2=0x7fe15c0cb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:11.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.355+0000 7fe1613ac640 1 -- 172.21.15.55:0/3224420938 shutdown_connections 2023-08-25T04:03:11.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.355+0000 7fe1613ac640 1 -- 172.21.15.55:0/3224420938 wait complete. 2023-08-25T04:03:11.378 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-25T04:03:11.378 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:11.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.519+0000 7ff1afe6d640 1 Processor -- start 2023-08-25T04:03:11.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.519+0000 7ff1afe6d640 1 -- start start 2023-08-25T04:03:11.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.519+0000 7ff1afe6d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff1a80d0da0 0x7ff1a80d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:11.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.519+0000 7ff1afe6d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1a80cdde0 0x7ff1a80ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:11.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.519+0000 7ff1afe6d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a80b29b0 con 0x7ff1a80cee60 2023-08-25T04:03:11.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.519+0000 7ff1afe6d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a80ce760 con 0x7ff1a80d0da0 2023-08-25T04:03:11.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.519+0000 7ff1afe6d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a80d16c0 con 0x7ff1a80cdde0 2023-08-25T04:03:11.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.519+0000 7ff1ae40a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff1a80cee60 0x7ff1a80cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50552/0 (socket says 172.21.15.55:50552) 2023-08-25T04:03:11.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.519+0000 7ff1ae40a640 1 -- 172.21.15.55:0/2571475243 learned_addr learned my addr 172.21.15.55:0/2571475243 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:11.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.519+0000 7ff1adc09640 1 --2- 172.21.15.55:0/2571475243 >> v2:172.21.15.110:3300/0 conn(0x7ff1a80d0da0 0x7ff1a80d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:11.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.519+0000 7ff1ad408640 1 --2- 172.21.15.55:0/2571475243 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1a80cdde0 0x7ff1a80ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:11.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.519+0000 7ff1acc07640 1 -- 172.21.15.55:0/2571475243 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954017854 0 0) 0x7ff1a80b29b0 con 0x7ff1a80cee60 2023-08-25T04:03:11.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.519+0000 7ff1acc07640 1 -- 172.21.15.55:0/2571475243 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff194003530 con 0x7ff1a80cee60 2023-08-25T04:03:11.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.523+0000 7ff1adc09640 1 -- 172.21.15.55:0/2571475243 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1a80cdde0 msgr2=0x7ff1a80ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:11.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.523+0000 7ff1acc07640 1 -- 172.21.15.55:0/2571475243 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3008058019 0 0) 0x7ff194003530 con 0x7ff1a80cee60 2023-08-25T04:03:11.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.523+0000 7ff1adc09640 1 --2- 172.21.15.55:0/2571475243 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1a80cdde0 0x7ff1a80ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.523+0000 7ff1adc09640 1 -- 172.21.15.55:0/2571475243 >> v1:172.21.15.55:6789/0 conn(0x7ff1a80cee60 legacy=0x7ff1a80cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:11.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.523+0000 7ff1adc09640 1 -- 172.21.15.55:0/2571475243 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a80b1dc0 con 0x7ff1a80d0da0 2023-08-25T04:03:11.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.523+0000 7ff1ad408640 1 --2- 172.21.15.55:0/2571475243 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1a80cdde0 0x7ff1a80ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:11.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.523+0000 7ff1adc09640 1 --2- 172.21.15.55:0/2571475243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a80d0da0 0x7ff1a80d1180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40097a0 tx=0x7ff1a401eb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=668ddcb73cf52356 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:11.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.523+0000 7ff1acc07640 1 -- 172.21.15.55:0/2571475243 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0001a00 con 0x7ff1a80d0da0 2023-08-25T04:03:11.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.523+0000 7ff1acc07640 1 -- 172.21.15.55:0/2571475243 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a40a85b0 con 0x7ff1a80d0da0 2023-08-25T04:03:11.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.523+0000 7ff1acc07640 1 -- 172.21.15.55:0/2571475243 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a40a8940 con 0x7ff1a80d0da0 2023-08-25T04:03:11.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.523+0000 7ff1afe6d640 1 -- 172.21.15.55:0/2571475243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a80d0da0 msgr2=0x7ff1a80d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:11.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.523+0000 7ff1afe6d640 1 --2- 172.21.15.55:0/2571475243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a80d0da0 0x7ff1a80d1180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40097a0 tx=0x7ff1a401eb70 comp rx=0 tx=0).stop 2023-08-25T04:03:11.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.523+0000 7ff1afe6d640 1 -- 172.21.15.55:0/2571475243 shutdown_connections 2023-08-25T04:03:11.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1afe6d640 1 --2- 172.21.15.55:0/2571475243 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1a80cdde0 0x7ff1a80ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1afe6d640 1 --2- 172.21.15.55:0/2571475243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a80d0da0 0x7ff1a80d1180 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1afe6d640 1 -- 172.21.15.55:0/2571475243 >> 172.21.15.55:0/2571475243 conn(0x7ff1a809bae0 msgr2=0x7ff1a80d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:11.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1afe6d640 1 -- 172.21.15.55:0/2571475243 shutdown_connections 2023-08-25T04:03:11.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1afe6d640 1 -- 172.21.15.55:0/2571475243 wait complete. 2023-08-25T04:03:11.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1afe6d640 1 Processor -- start 2023-08-25T04:03:11.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1afe6d640 1 -- start start 2023-08-25T04:03:11.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1afe6d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a80cdde0 0x7ff1a8159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:11.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1afe6d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1a80cee60 0x7ff1a80ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:11.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1afe6d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1a80d0da0 0x7ff1a80c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:11.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1afe6d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a80ca580 con 0x7ff1a80d0da0 2023-08-25T04:03:11.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1afe6d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a815ac30 con 0x7ff1a80cdde0 2023-08-25T04:03:11.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1afe6d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a815a390 con 0x7ff1a80cee60 2023-08-25T04:03:11.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1ae40a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1a80d0da0 0x7ff1a80c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:11.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1ae40a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1a80d0da0 0x7ff1a80c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59750/0 (socket says 172.21.15.55:59750) 2023-08-25T04:03:11.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1ae40a640 1 -- 172.21.15.55:0/508417611 learned_addr learned my addr 172.21.15.55:0/508417611 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:11.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1adc09640 1 --2- 172.21.15.55:0/508417611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a80cdde0 0x7ff1a8159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:11.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1ae40a640 1 -- 172.21.15.55:0/508417611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1a80cee60 msgr2=0x7ff1a80ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:11.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1ad408640 1 --2- 172.21.15.55:0/508417611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1a80cee60 0x7ff1a80ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:11.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1ae40a640 1 --2- 172.21.15.55:0/508417611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1a80cee60 0x7ff1a80ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1ae40a640 1 -- 172.21.15.55:0/508417611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a80cdde0 msgr2=0x7ff1a8159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:11.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1ae40a640 1 --2- 172.21.15.55:0/508417611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a80cdde0 0x7ff1a8159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1ae40a640 1 -- 172.21.15.55:0/508417611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff198009420 con 0x7ff1a80d0da0 2023-08-25T04:03:11.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1adc09640 1 --2- 172.21.15.55:0/508417611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a80cdde0 0x7ff1a8159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:11.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1ad408640 1 --2- 172.21.15.55:0/508417611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1a80cee60 0x7ff1a80ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:11.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.527+0000 7ff1ae40a640 1 --2- 172.21.15.55:0/508417611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1a80d0da0 0x7ff1a80c6550 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0001f80 tx=0x7ff1a000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:11.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.531+0000 7ff19e7fc640 1 -- 172.21.15.55:0/508417611 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0012400 con 0x7ff1a80d0da0 2023-08-25T04:03:11.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.531+0000 7ff19e7fc640 1 -- 172.21.15.55:0/508417611 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a0012560 con 0x7ff1a80d0da0 2023-08-25T04:03:11.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.531+0000 7ff19e7fc640 1 -- 172.21.15.55:0/508417611 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0012910 con 0x7ff1a80d0da0 2023-08-25T04:03:11.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.531+0000 7ff1afe6d640 1 -- 172.21.15.55:0/508417611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a40093b0 con 0x7ff1a80d0da0 2023-08-25T04:03:11.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.531+0000 7ff1afe6d640 1 -- 172.21.15.55:0/508417611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a815a950 con 0x7ff1a80d0da0 2023-08-25T04:03:11.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.531+0000 7ff1afe6d640 1 -- 172.21.15.55:0/508417611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a804dbe0 con 0x7ff1a80d0da0 2023-08-25T04:03:11.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.531+0000 7ff19e7fc640 1 -- 172.21.15.55:0/508417611 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff1a0012a70 con 0x7ff1a80d0da0 2023-08-25T04:03:11.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.531+0000 7ff19e7fc640 1 --2- 172.21.15.55:0/508417611 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff18c065680 0x7ff18c067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:11.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.531+0000 7ff19e7fc640 1 -- 172.21.15.55:0/508417611 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1a0083630 con 0x7ff1a80d0da0 2023-08-25T04:03:11.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.531+0000 7ff1adc09640 1 --2- 172.21.15.55:0/508417611 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff18c065680 0x7ff18c067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:11.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.535+0000 7ff1adc09640 1 --2- 172.21.15.55:0/508417611 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff18c065680 0x7ff18c067b40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40b2000 tx=0x7ff1a4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:11.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.535+0000 7ff19e7fc640 1 -- 172.21.15.55:0/508417611 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff1a0051050 con 0x7ff1a80d0da0 2023-08-25T04:03:11.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.695+0000 7ff1afe6d640 1 -- 172.21.15.55:0/508417611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1a80d0b80 con 0x7ff1a80d0da0 2023-08-25T04:03:11.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.699+0000 7ff19e7fc640 1 -- 172.21.15.55:0/508417611 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18291 (secure 0 0 0) 0x7ff1a0054670 con 0x7ff1a80d0da0 2023-08-25T04:03:11.700 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:11.701 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:02.329010+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:11.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.699+0000 7ff1afe6d640 1 -- 172.21.15.55:0/508417611 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff18c065680 msgr2=0x7ff18c067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:11.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.699+0000 7ff1afe6d640 1 --2- 172.21.15.55:0/508417611 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff18c065680 0x7ff18c067b40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40b2000 tx=0x7ff1a4008040 comp rx=0 tx=0).stop 2023-08-25T04:03:11.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.699+0000 7ff1afe6d640 1 -- 172.21.15.55:0/508417611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1a80d0da0 msgr2=0x7ff1a80c6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:11.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.699+0000 7ff1afe6d640 1 --2- 172.21.15.55:0/508417611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1a80d0da0 0x7ff1a80c6550 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0001f80 tx=0x7ff1a000a430 comp rx=0 tx=0).stop 2023-08-25T04:03:11.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.699+0000 7ff1afe6d640 1 -- 172.21.15.55:0/508417611 shutdown_connections 2023-08-25T04:03:11.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.699+0000 7ff1afe6d640 1 --2- 172.21.15.55:0/508417611 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff18c065680 0x7ff18c067b40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.699+0000 7ff1afe6d640 1 --2- 172.21.15.55:0/508417611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1a80d0da0 0x7ff1a80c6550 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.699+0000 7ff1afe6d640 1 --2- 172.21.15.55:0/508417611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1a80cee60 0x7ff1a80ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.699+0000 7ff1afe6d640 1 --2- 172.21.15.55:0/508417611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a80cdde0 0x7ff1a8159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.699+0000 7ff1afe6d640 1 -- 172.21.15.55:0/508417611 >> 172.21.15.55:0/508417611 conn(0x7ff1a809bae0 msgr2=0x7ff1a80cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:11.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.699+0000 7ff1afe6d640 1 -- 172.21.15.55:0/508417611 shutdown_connections 2023-08-25T04:03:11.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.699+0000 7ff1afe6d640 1 -- 172.21.15.55:0/508417611 wait complete. 2023-08-25T04:03:11.721 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:02:58.890533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:03:00.093976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:03:11.722 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:03:11.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.867+0000 7fead105c640 1 Processor -- start 2023-08-25T04:03:11.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.867+0000 7fead105c640 1 -- start start 2023-08-25T04:03:11.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.867+0000 7fead105c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feacc06c020 0x7feacc09bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:11.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.867+0000 7fead105c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feacc15abd0 con 0x7feacc15a7f0 2023-08-25T04:03:11.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.867+0000 7fead105c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feacc0c8ab0 con 0x7feacc0c9830 2023-08-25T04:03:11.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.867+0000 7fead105c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feacc0c8d50 con 0x7feacc06c020 2023-08-25T04:03:11.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.867+0000 7feacb59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feacc06c020 0x7feacc09bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:11.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.867+0000 7feacb59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feacc06c020 0x7feacc09bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59752/0 (socket says 172.21.15.55:59752) 2023-08-25T04:03:11.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.867+0000 7feacb59e640 1 -- 172.21.15.55:0/1585217985 learned_addr learned my addr 172.21.15.55:0/1585217985 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:11.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.867+0000 7feacb59e640 1 -- 172.21.15.55:0/1585217985 >> v1:172.21.15.110:6789/0 conn(0x7feacc0c9830 legacy=0x7feacc0acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:11.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.867+0000 7feacb59e640 1 -- 172.21.15.55:0/1585217985 >> v1:172.21.15.55:6789/0 conn(0x7feacc15a7f0 legacy=0x7feacc070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:11.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.867+0000 7feacb59e640 1 -- 172.21.15.55:0/1585217985 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc0c9030 con 0x7feacc06c020 2023-08-25T04:03:11.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.867+0000 7feac9d9b640 1 -- 172.21.15.55:0/1585217985 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797693338 0 0) 0x7feacc15abd0 con 0x7feacc15a7f0 2023-08-25T04:03:11.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.871+0000 7feacb59e640 1 --2- 172.21.15.55:0/1585217985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feacc06c020 0x7feacc09bde0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feac4009e50 tx=0x7feac401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7930c8a5fec8b68a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:11.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.871+0000 7feac9d9b640 1 -- 172.21.15.55:0/1585217985 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac40a5770 con 0x7feacc06c020 2023-08-25T04:03:11.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.871+0000 7feac9d9b640 1 -- 172.21.15.55:0/1585217985 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac40a58d0 con 0x7feacc06c020 2023-08-25T04:03:11.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.871+0000 7feac9d9b640 1 -- 172.21.15.55:0/1585217985 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac40a5c60 con 0x7feacc06c020 2023-08-25T04:03:11.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.871+0000 7fead105c640 1 -- 172.21.15.55:0/1585217985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feacc06c020 msgr2=0x7feacc09bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:11.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.871+0000 7fead105c640 1 --2- 172.21.15.55:0/1585217985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feacc06c020 0x7feacc09bde0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feac4009e50 tx=0x7feac401c9a0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.871+0000 7fead105c640 1 -- 172.21.15.55:0/1585217985 shutdown_connections 2023-08-25T04:03:11.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.871+0000 7fead105c640 1 --2- 172.21.15.55:0/1585217985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feacc06c020 0x7feacc09bde0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.871+0000 7fead105c640 1 -- 172.21.15.55:0/1585217985 >> 172.21.15.55:0/1585217985 conn(0x7feacc069900 msgr2=0x7feacc069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:11.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.871+0000 7fead105c640 1 -- 172.21.15.55:0/1585217985 shutdown_connections 2023-08-25T04:03:11.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.871+0000 7fead105c640 1 -- 172.21.15.55:0/1585217985 wait complete. 2023-08-25T04:03:11.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7fead105c640 1 Processor -- start 2023-08-25T04:03:11.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7fead105c640 1 -- start start 2023-08-25T04:03:11.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7fead105c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feacc06c020 0x7feacc157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:11.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7fead105c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feacc0c9830 0x7feacc15e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:11.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7fead105c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feacc15a7f0 0x7feacc15e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:11.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7fead105c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feacc158330 con 0x7feacc0c9830 2023-08-25T04:03:11.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7fead105c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feacc0c4600 con 0x7feacc15a7f0 2023-08-25T04:03:11.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7fead105c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feacc0c48e0 con 0x7feacc06c020 2023-08-25T04:03:11.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7feaca59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feacc0c9830 0x7feacc15e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:11.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7feaca59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feacc0c9830 0x7feacc15e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59766/0 (socket says 172.21.15.55:59766) 2023-08-25T04:03:11.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7feaca59c640 1 -- 172.21.15.55:0/2181948829 learned_addr learned my addr 172.21.15.55:0/2181948829 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:11.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7feacb59e640 1 --2- 172.21.15.55:0/2181948829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feacc15a7f0 0x7feacc15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:11.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7feacad9d640 1 --2- 172.21.15.55:0/2181948829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feacc06c020 0x7feacc157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:11.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7feaca59c640 1 -- 172.21.15.55:0/2181948829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feacc06c020 msgr2=0x7feacc157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:11.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7feaca59c640 1 --2- 172.21.15.55:0/2181948829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feacc06c020 0x7feacc157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7feaca59c640 1 -- 172.21.15.55:0/2181948829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feacc15a7f0 msgr2=0x7feacc15e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:11.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7feaca59c640 1 --2- 172.21.15.55:0/2181948829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feacc15a7f0 0x7feacc15e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:11.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7feaca59c640 1 -- 172.21.15.55:0/2181948829 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac4009b30 con 0x7feacc0c9830 2023-08-25T04:03:11.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7feaca59c640 1 --2- 172.21.15.55:0/2181948829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feacc0c9830 0x7feacc15e250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feac000b410 tx=0x7feac000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:11.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7feab37fe640 1 -- 172.21.15.55:0/2181948829 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac0004020 con 0x7feacc0c9830 2023-08-25T04:03:11.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7feab37fe640 1 -- 172.21.15.55:0/2181948829 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac0004180 con 0x7feacc0c9830 2023-08-25T04:03:11.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7feab37fe640 1 -- 172.21.15.55:0/2181948829 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac0011630 con 0x7feacc0c9830 2023-08-25T04:03:11.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7fead105c640 1 -- 172.21.15.55:0/2181948829 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feacc0adc90 con 0x7feacc0c9830 2023-08-25T04:03:11.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7fead105c640 1 -- 172.21.15.55:0/2181948829 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feacc0c2e70 con 0x7feacc0c9830 2023-08-25T04:03:11.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.875+0000 7fead105c640 1 -- 172.21.15.55:0/2181948829 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feacc06d5b0 con 0x7feacc0c9830 2023-08-25T04:03:11.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.879+0000 7feab37fe640 1 -- 172.21.15.55:0/2181948829 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7feac0011790 con 0x7feacc0c9830 2023-08-25T04:03:11.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.879+0000 7feab37fe640 1 --2- 172.21.15.55:0/2181948829 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7feab8065680 0x7feab8067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:11.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.879+0000 7feab37fe640 1 -- 172.21.15.55:0/2181948829 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feac0082b40 con 0x7feacc0c9830 2023-08-25T04:03:11.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.879+0000 7feacad9d640 1 --2- 172.21.15.55:0/2181948829 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7feab8065680 0x7feab8067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:11.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.879+0000 7feacad9d640 1 --2- 172.21.15.55:0/2181948829 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7feab8065680 0x7feab8067b40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feabc001860 tx=0x7feabc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:11.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:11.883+0000 7feab37fe640 1 -- 172.21.15.55:0/2181948829 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7feac0050610 con 0x7feacc0c9830 2023-08-25T04:03:12.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.039+0000 7fead105c640 1 -- 172.21.15.55:0/2181948829 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feacc073ec0 con 0x7feacc0c9830 2023-08-25T04:03:12.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.039+0000 7feab37fe640 1 -- 172.21.15.55:0/2181948829 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7feac00150a0 con 0x7feacc0c9830 2023-08-25T04:03:12.042 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:03:12.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.043+0000 7fead105c640 1 -- 172.21.15.55:0/2181948829 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7feab8065680 msgr2=0x7feab8067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.043+0000 7fead105c640 1 --2- 172.21.15.55:0/2181948829 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7feab8065680 0x7feab8067b40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7feabc001860 tx=0x7feabc009040 comp rx=0 tx=0).stop 2023-08-25T04:03:12.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.043+0000 7fead105c640 1 -- 172.21.15.55:0/2181948829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feacc0c9830 msgr2=0x7feacc15e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.043+0000 7fead105c640 1 --2- 172.21.15.55:0/2181948829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feacc0c9830 0x7feacc15e250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feac000b410 tx=0x7feac000b8d0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.043+0000 7fead105c640 1 -- 172.21.15.55:0/2181948829 shutdown_connections 2023-08-25T04:03:12.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.043+0000 7fead105c640 1 --2- 172.21.15.55:0/2181948829 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7feab8065680 0x7feab8067b40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.043+0000 7fead105c640 1 --2- 172.21.15.55:0/2181948829 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feacc15a7f0 0x7feacc15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.043+0000 7fead105c640 1 --2- 172.21.15.55:0/2181948829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feacc0c9830 0x7feacc15e250 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.043+0000 7fead105c640 1 --2- 172.21.15.55:0/2181948829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feacc06c020 0x7feacc157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.043+0000 7fead105c640 1 -- 172.21.15.55:0/2181948829 >> 172.21.15.55:0/2181948829 conn(0x7feacc069900 msgr2=0x7feacc070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:12.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.043+0000 7fead105c640 1 -- 172.21.15.55:0/2181948829 shutdown_connections 2023-08-25T04:03:12.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.043+0000 7fead105c640 1 -- 172.21.15.55:0/2181948829 wait complete. 2023-08-25T04:03:12.063 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:03:12.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.207+0000 7fb238c93640 1 Processor -- start 2023-08-25T04:03:12.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.207+0000 7fb238c93640 1 -- start start 2023-08-25T04:03:12.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.207+0000 7fb238c93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2340c9900 0x7fb2340cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:12.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.207+0000 7fb238c93640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2340c9d90 con 0x7fb23406c720 2023-08-25T04:03:12.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.207+0000 7fb238c93640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2340cbca0 con 0x7fb2340cb020 2023-08-25T04:03:12.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.207+0000 7fb238c93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2340c9470 con 0x7fb2340c9900 2023-08-25T04:03:12.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.207+0000 7fb229d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2340c9900 0x7fb2340cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:12.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.207+0000 7fb232d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb23406c720 0x7fb23406cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50574/0 (socket says 172.21.15.55:50574) 2023-08-25T04:03:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.207+0000 7fb232d9d640 1 -- 172.21.15.55:0/2642651740 learned_addr learned my addr 172.21.15.55:0/2642651740 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.211+0000 7fb229d9b640 1 -- 172.21.15.55:0/2642651740 >> v1:172.21.15.110:6789/0 conn(0x7fb2340cb020 legacy=0x7fb2340cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.211+0000 7fb229d9b640 1 -- 172.21.15.55:0/2642651740 >> v1:172.21.15.55:6789/0 conn(0x7fb23406c720 legacy=0x7fb23406cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.211+0000 7fb231d9b640 1 -- 172.21.15.55:0/2642651740 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718690951 0 0) 0x7fb2340c9d90 con 0x7fb23406c720 2023-08-25T04:03:12.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.211+0000 7fb229d9b640 1 -- 172.21.15.55:0/2642651740 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2340c8b40 con 0x7fb2340c9900 2023-08-25T04:03:12.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.211+0000 7fb229d9b640 1 --2- 172.21.15.55:0/2642651740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2340c9900 0x7fb2340cdd50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0097c0 tx=0x7fb21c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977ff707c668e742 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:12.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.211+0000 7fb231d9b640 1 -- 172.21.15.55:0/2642651740 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c0ab600 con 0x7fb2340c9900 2023-08-25T04:03:12.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.211+0000 7fb231d9b640 1 -- 172.21.15.55:0/2642651740 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c0a7050 con 0x7fb2340c9900 2023-08-25T04:03:12.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.211+0000 7fb231d9b640 1 -- 172.21.15.55:0/2642651740 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c0ab980 con 0x7fb2340c9900 2023-08-25T04:03:12.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.211+0000 7fb238c93640 1 -- 172.21.15.55:0/2642651740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2340c9900 msgr2=0x7fb2340cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.211+0000 7fb238c93640 1 --2- 172.21.15.55:0/2642651740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2340c9900 0x7fb2340cdd50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0097c0 tx=0x7fb21c01c3f0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb238c93640 1 -- 172.21.15.55:0/2642651740 shutdown_connections 2023-08-25T04:03:12.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb238c93640 1 --2- 172.21.15.55:0/2642651740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2340c9900 0x7fb2340cdd50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb238c93640 1 -- 172.21.15.55:0/2642651740 >> 172.21.15.55:0/2642651740 conn(0x7fb234069900 msgr2=0x7fb234069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:12.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb238c93640 1 -- 172.21.15.55:0/2642651740 shutdown_connections 2023-08-25T04:03:12.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb238c93640 1 -- 172.21.15.55:0/2642651740 wait complete. 2023-08-25T04:03:12.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb238c93640 1 Processor -- start 2023-08-25T04:03:12.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb238c93640 1 -- start start 2023-08-25T04:03:12.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb238c93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb23406c720 0x7fb2340c1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:12.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb238c93640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2340c9900 0x7fb234148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:12.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb238c93640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2340cb020 0x7fb2341524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:12.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb238c93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb234148890 con 0x7fb23406c720 2023-08-25T04:03:12.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb238c93640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2341491f0 con 0x7fb2340cb020 2023-08-25T04:03:12.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb238c93640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb234147930 con 0x7fb2340c9900 2023-08-25T04:03:12.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb23259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb23406c720 0x7fb2340c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:12.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb23259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb23406c720 0x7fb2340c1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59794/0 (socket says 172.21.15.55:59794) 2023-08-25T04:03:12.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb23259c640 1 -- 172.21.15.55:0/2545088556 learned_addr learned my addr 172.21.15.55:0/2545088556 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:12.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb232d9d640 1 --2- 172.21.15.55:0/2545088556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2340cb020 0x7fb2341524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:12.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb229d9b640 1 --2- 172.21.15.55:0/2545088556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2340c9900 0x7fb234148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:12.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb23259c640 1 -- 172.21.15.55:0/2545088556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2340c9900 msgr2=0x7fb234148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb23259c640 1 --2- 172.21.15.55:0/2545088556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2340c9900 0x7fb234148cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb23259c640 1 -- 172.21.15.55:0/2545088556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2340cb020 msgr2=0x7fb2341524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb23259c640 1 --2- 172.21.15.55:0/2545088556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2340cb020 0x7fb2341524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb23259c640 1 -- 172.21.15.55:0/2545088556 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c009420 con 0x7fb23406c720 2023-08-25T04:03:12.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb229d9b640 1 --2- 172.21.15.55:0/2545088556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2340c9900 0x7fb234148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:12.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb232d9d640 1 --2- 172.21.15.55:0/2545088556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2340cb020 0x7fb2341524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:12.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.215+0000 7fb23259c640 1 --2- 172.21.15.55:0/2545088556 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb23406c720 0x7fb2340c1120 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb22400c450 tx=0x7fb22400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:12.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.219+0000 7fb22b7fe640 1 -- 172.21.15.55:0/2545088556 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2240052d0 con 0x7fb23406c720 2023-08-25T04:03:12.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.219+0000 7fb22b7fe640 1 -- 172.21.15.55:0/2545088556 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb224005430 con 0x7fb23406c720 2023-08-25T04:03:12.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.219+0000 7fb22b7fe640 1 -- 172.21.15.55:0/2545088556 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb224003890 con 0x7fb23406c720 2023-08-25T04:03:12.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.219+0000 7fb238c93640 1 -- 172.21.15.55:0/2545088556 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb234147c10 con 0x7fb23406c720 2023-08-25T04:03:12.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.219+0000 7fb238c93640 1 -- 172.21.15.55:0/2545088556 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2341481d0 con 0x7fb23406c720 2023-08-25T04:03:12.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.219+0000 7fb238c93640 1 -- 172.21.15.55:0/2545088556 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb234148b00 con 0x7fb23406c720 2023-08-25T04:03:12.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.219+0000 7fb22b7fe640 1 -- 172.21.15.55:0/2545088556 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb2240039f0 con 0x7fb23406c720 2023-08-25T04:03:12.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.219+0000 7fb22b7fe640 1 --2- 172.21.15.55:0/2545088556 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb214065680 0x7fb214067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:12.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.219+0000 7fb22b7fe640 1 -- 172.21.15.55:0/2545088556 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb224082a00 con 0x7fb23406c720 2023-08-25T04:03:12.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.219+0000 7fb229d9b640 1 --2- 172.21.15.55:0/2545088556 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb214065680 0x7fb214067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:12.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.223+0000 7fb229d9b640 1 --2- 172.21.15.55:0/2545088556 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb214065680 0x7fb214067b40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0ad000 tx=0x7fb21c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.223+0000 7fb22b7fe640 1 -- 172.21.15.55:0/2545088556 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb224050420 con 0x7fb23406c720 2023-08-25T04:03:12.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.383+0000 7fb238c93640 1 -- 172.21.15.55:0/2545088556 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb234073ec0 con 0x7fb23406c720 2023-08-25T04:03:12.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.383+0000 7fb22b7fe640 1 -- 172.21.15.55:0/2545088556 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb224053a40 con 0x7fb23406c720 2023-08-25T04:03:12.385 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:03:12.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.383+0000 7fb238c93640 1 -- 172.21.15.55:0/2545088556 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb214065680 msgr2=0x7fb214067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.383+0000 7fb238c93640 1 --2- 172.21.15.55:0/2545088556 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb214065680 0x7fb214067b40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0ad000 tx=0x7fb21c008040 comp rx=0 tx=0).stop 2023-08-25T04:03:12.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.383+0000 7fb238c93640 1 -- 172.21.15.55:0/2545088556 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb23406c720 msgr2=0x7fb2340c1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.383+0000 7fb238c93640 1 --2- 172.21.15.55:0/2545088556 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb23406c720 0x7fb2340c1120 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb22400c450 tx=0x7fb22400c910 comp rx=0 tx=0).stop 2023-08-25T04:03:12.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.383+0000 7fb238c93640 1 -- 172.21.15.55:0/2545088556 shutdown_connections 2023-08-25T04:03:12.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.383+0000 7fb238c93640 1 --2- 172.21.15.55:0/2545088556 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb214065680 0x7fb214067b40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.383+0000 7fb238c93640 1 --2- 172.21.15.55:0/2545088556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2340cb020 0x7fb2341524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.383+0000 7fb238c93640 1 --2- 172.21.15.55:0/2545088556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2340c9900 0x7fb234148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.383+0000 7fb238c93640 1 --2- 172.21.15.55:0/2545088556 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb23406c720 0x7fb2340c1120 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.383+0000 7fb238c93640 1 -- 172.21.15.55:0/2545088556 >> 172.21.15.55:0/2545088556 conn(0x7fb234069900 msgr2=0x7fb234069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:12.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.383+0000 7fb238c93640 1 -- 172.21.15.55:0/2545088556 shutdown_connections 2023-08-25T04:03:12.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.383+0000 7fb238c93640 1 -- 172.21.15.55:0/2545088556 wait complete. 2023-08-25T04:03:12.407 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:03:12.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.555+0000 7fcb79903640 1 Processor -- start 2023-08-25T04:03:12.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.555+0000 7fcb79903640 1 -- start start 2023-08-25T04:03:12.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.559+0000 7fcb79903640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb7415c950 0x7fcb740b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:12.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.559+0000 7fcb79903640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcb740b4be0 0x7fcb740b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:12.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.559+0000 7fcb79903640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb740cd020 con 0x7fcb740b4040 2023-08-25T04:03:12.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.559+0000 7fcb79903640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb740cd650 con 0x7fcb7415c950 2023-08-25T04:03:12.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.559+0000 7fcb79903640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb740cd8f0 con 0x7fcb740b4be0 2023-08-25T04:03:12.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.559+0000 7fcb6a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb7415c950 0x7fcb740b7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:12.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.559+0000 7fcb72ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcb740b4040 0x7fcb740b4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50580/0 (socket says 172.21.15.55:50580) 2023-08-25T04:03:12.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.559+0000 7fcb72ffd640 1 -- 172.21.15.55:0/998965740 learned_addr learned my addr 172.21.15.55:0/998965740 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:12.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.559+0000 7fcb737fe640 1 --2- 172.21.15.55:0/998965740 >> v2:172.21.15.110:3300/0 conn(0x7fcb740b4be0 0x7fcb740b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:12.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.559+0000 7fcb6a7fc640 1 -- 172.21.15.55:0/998965740 >> v2:172.21.15.110:3300/0 conn(0x7fcb740b4be0 msgr2=0x7fcb740b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:12.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.559+0000 7fcb6a7fc640 1 --2- 172.21.15.55:0/998965740 >> v2:172.21.15.110:3300/0 conn(0x7fcb740b4be0 0x7fcb740b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.559+0000 7fcb6a7fc640 1 -- 172.21.15.55:0/998965740 >> v1:172.21.15.55:6789/0 conn(0x7fcb740b4040 legacy=0x7fcb740b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.559+0000 7fcb6a7fc640 1 -- 172.21.15.55:0/998965740 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb740cccb0 con 0x7fcb7415c950 2023-08-25T04:03:12.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.559+0000 7fcb727fc640 1 -- 172.21.15.55:0/998965740 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3633139108 0 0) 0x7fcb740cd020 con 0x7fcb740b4040 2023-08-25T04:03:12.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.559+0000 7fcb6a7fc640 1 --2- 172.21.15.55:0/998965740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb7415c950 0x7fcb740b7ee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcb740cfed0 tx=0x7fcb5c01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb54fbf4a3a771e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:12.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.559+0000 7fcb727fc640 1 -- 172.21.15.55:0/998965740 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0a58d0 con 0x7fcb7415c950 2023-08-25T04:03:12.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.559+0000 7fcb727fc640 1 -- 172.21.15.55:0/998965740 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c0a5a30 con 0x7fcb7415c950 2023-08-25T04:03:12.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.559+0000 7fcb727fc640 1 -- 172.21.15.55:0/998965740 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0a5dc0 con 0x7fcb7415c950 2023-08-25T04:03:12.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb79903640 1 -- 172.21.15.55:0/998965740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb7415c950 msgr2=0x7fcb740b7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb79903640 1 --2- 172.21.15.55:0/998965740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb7415c950 0x7fcb740b7ee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcb740cfed0 tx=0x7fcb5c01c7f0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb79903640 1 -- 172.21.15.55:0/998965740 shutdown_connections 2023-08-25T04:03:12.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb79903640 1 --2- 172.21.15.55:0/998965740 >> v2:172.21.15.110:3300/0 conn(0x7fcb740b4be0 0x7fcb740b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb79903640 1 --2- 172.21.15.55:0/998965740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb7415c950 0x7fcb740b7ee0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb79903640 1 -- 172.21.15.55:0/998965740 >> 172.21.15.55:0/998965740 conn(0x7fcb740658c0 msgr2=0x7fcb74065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:12.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb79903640 1 -- 172.21.15.55:0/998965740 shutdown_connections 2023-08-25T04:03:12.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb79903640 1 -- 172.21.15.55:0/998965740 wait complete. 2023-08-25T04:03:12.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb79903640 1 Processor -- start 2023-08-25T04:03:12.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb79903640 1 -- start start 2023-08-25T04:03:12.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb79903640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb740b4040 0x7fcb740c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:12.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb79903640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb740b4be0 0x7fcb7415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:12.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb79903640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb7415c950 0x7fcb7415b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:12.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb79903640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb740c7cf0 con 0x7fcb740b4040 2023-08-25T04:03:12.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb79903640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb740c7fd0 con 0x7fcb7415c950 2023-08-25T04:03:12.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb79903640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb740c82b0 con 0x7fcb740b4be0 2023-08-25T04:03:12.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb72ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb740b4040 0x7fcb740c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:12.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb72ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb740b4040 0x7fcb740c74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59816/0 (socket says 172.21.15.55:59816) 2023-08-25T04:03:12.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb72ffd640 1 -- 172.21.15.55:0/3222127333 learned_addr learned my addr 172.21.15.55:0/3222127333 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb6a7fc640 1 --2- 172.21.15.55:0/3222127333 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb740b4be0 0x7fcb7415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.563+0000 7fcb737fe640 1 --2- 172.21.15.55:0/3222127333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb7415c950 0x7fcb7415b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.567+0000 7fcb72ffd640 1 -- 172.21.15.55:0/3222127333 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb740b4be0 msgr2=0x7fcb7415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.567+0000 7fcb72ffd640 1 --2- 172.21.15.55:0/3222127333 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb740b4be0 0x7fcb7415b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.567+0000 7fcb72ffd640 1 -- 172.21.15.55:0/3222127333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb7415c950 msgr2=0x7fcb7415b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.567+0000 7fcb72ffd640 1 --2- 172.21.15.55:0/3222127333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb7415c950 0x7fcb7415b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.567+0000 7fcb72ffd640 1 -- 172.21.15.55:0/3222127333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c009a70 con 0x7fcb740b4040 2023-08-25T04:03:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.567+0000 7fcb6a7fc640 1 --2- 172.21.15.55:0/3222127333 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb740b4be0 0x7fcb7415b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.567+0000 7fcb737fe640 1 --2- 172.21.15.55:0/3222127333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb7415c950 0x7fcb7415b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:12.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.567+0000 7fcb72ffd640 1 --2- 172.21.15.55:0/3222127333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb740b4040 0x7fcb740c74a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400c480 tx=0x7fcb6400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:12.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.567+0000 7fcb70ff9640 1 -- 172.21.15.55:0/3222127333 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb640074e0 con 0x7fcb740b4040 2023-08-25T04:03:12.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.567+0000 7fcb70ff9640 1 -- 172.21.15.55:0/3222127333 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb64007660 con 0x7fcb740b4040 2023-08-25T04:03:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.567+0000 7fcb79903640 1 -- 172.21.15.55:0/3222127333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb740c8590 con 0x7fcb740b4040 2023-08-25T04:03:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.567+0000 7fcb70ff9640 1 -- 172.21.15.55:0/3222127333 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb64004a30 con 0x7fcb740b4040 2023-08-25T04:03:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.567+0000 7fcb79903640 1 -- 172.21.15.55:0/3222127333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb740c79e0 con 0x7fcb740b4040 2023-08-25T04:03:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.567+0000 7fcb79903640 1 -- 172.21.15.55:0/3222127333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb740668d0 con 0x7fcb740b4040 2023-08-25T04:03:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.567+0000 7fcb70ff9640 1 -- 172.21.15.55:0/3222127333 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fcb64004b90 con 0x7fcb740b4040 2023-08-25T04:03:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.567+0000 7fcb70ff9640 1 --2- 172.21.15.55:0/3222127333 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcb54065680 0x7fcb54067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.571+0000 7fcb70ff9640 1 -- 172.21.15.55:0/3222127333 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb64082340 con 0x7fcb740b4040 2023-08-25T04:03:12.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.571+0000 7fcb6a7fc640 1 --2- 172.21.15.55:0/3222127333 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcb54065680 0x7fcb54067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:12.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.571+0000 7fcb6a7fc640 1 --2- 172.21.15.55:0/3222127333 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcb54065680 0x7fcb54067b40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c0af000 tx=0x7fcb5c0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:12.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.575+0000 7fcb70ff9640 1 -- 172.21.15.55:0/3222127333 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fcb64053880 con 0x7fcb740b4040 2023-08-25T04:03:12.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.727+0000 7fcb79903640 1 -- 172.21.15.55:0/3222127333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb740d17a0 con 0x7fcb740b4040 2023-08-25T04:03:12.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.727+0000 7fcb70ff9640 1 -- 172.21.15.55:0/3222127333 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb64053410 con 0x7fcb740b4040 2023-08-25T04:03:12.732 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:03:12.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.731+0000 7fcb79903640 1 -- 172.21.15.55:0/3222127333 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcb54065680 msgr2=0x7fcb54067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.731+0000 7fcb79903640 1 --2- 172.21.15.55:0/3222127333 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcb54065680 0x7fcb54067b40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c0af000 tx=0x7fcb5c0a7070 comp rx=0 tx=0).stop 2023-08-25T04:03:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.731+0000 7fcb79903640 1 -- 172.21.15.55:0/3222127333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb740b4040 msgr2=0x7fcb740c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.731+0000 7fcb79903640 1 --2- 172.21.15.55:0/3222127333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb740b4040 0x7fcb740c74a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400c480 tx=0x7fcb6400c940 comp rx=0 tx=0).stop 2023-08-25T04:03:12.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.731+0000 7fcb79903640 1 -- 172.21.15.55:0/3222127333 shutdown_connections 2023-08-25T04:03:12.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.731+0000 7fcb79903640 1 --2- 172.21.15.55:0/3222127333 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcb54065680 0x7fcb54067b40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.731+0000 7fcb79903640 1 --2- 172.21.15.55:0/3222127333 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb7415c950 0x7fcb7415b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.731+0000 7fcb79903640 1 --2- 172.21.15.55:0/3222127333 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb740b4be0 0x7fcb7415b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.731+0000 7fcb79903640 1 --2- 172.21.15.55:0/3222127333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb740b4040 0x7fcb740c74a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.731+0000 7fcb79903640 1 -- 172.21.15.55:0/3222127333 >> 172.21.15.55:0/3222127333 conn(0x7fcb740658c0 msgr2=0x7fcb740b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:12.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.731+0000 7fcb79903640 1 -- 172.21.15.55:0/3222127333 shutdown_connections 2023-08-25T04:03:12.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.731+0000 7fcb79903640 1 -- 172.21.15.55:0/3222127333 wait complete. 2023-08-25T04:03:12.752 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:03:12.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.895+0000 7fa909f03640 1 Processor -- start 2023-08-25T04:03:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.895+0000 7fa909f03640 1 -- start start 2023-08-25T04:03:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.899+0000 7fa909f03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa90415a7f0 0x7fa90409bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.899+0000 7fa909f03640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9040c9830 0x7fa904070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.899+0000 7fa909f03640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90415abd0 con 0x7fa90406c020 2023-08-25T04:03:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.899+0000 7fa909f03640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9040c8ab0 con 0x7fa9040c9830 2023-08-25T04:03:12.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.899+0000 7fa909f03640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040c8d50 con 0x7fa90415a7f0 2023-08-25T04:03:12.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.899+0000 7fa902ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9040c9830 0x7fa904070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:12.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.899+0000 7fa902ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9040c9830 0x7fa904070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59822/0 (socket says 172.21.15.55:59822) 2023-08-25T04:03:12.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.899+0000 7fa902ffd640 1 -- 172.21.15.55:0/231724686 learned_addr learned my addr 172.21.15.55:0/231724686 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:12.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.899+0000 7fa903fff640 1 --1- 172.21.15.55:0/231724686 >> v1:172.21.15.55:6789/0 conn(0x7fa90406c020 0x7fa9040acff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50584/0 (socket says 172.21.15.55:50584) 2023-08-25T04:03:12.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.899+0000 7fa9037fe640 1 --2- 172.21.15.55:0/231724686 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa90415a7f0 0x7fa90409bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:12.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.899+0000 7fa902ffd640 1 -- 172.21.15.55:0/231724686 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa90415a7f0 msgr2=0x7fa90409bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:12.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.899+0000 7fa902ffd640 1 --2- 172.21.15.55:0/231724686 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa90415a7f0 0x7fa90409bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.899+0000 7fa902ffd640 1 -- 172.21.15.55:0/231724686 >> v1:172.21.15.55:6789/0 conn(0x7fa90406c020 legacy=0x7fa9040acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.899+0000 7fa902ffd640 1 -- 172.21.15.55:0/231724686 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9040c9030 con 0x7fa9040c9830 2023-08-25T04:03:12.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.899+0000 7fa902ffd640 1 --2- 172.21.15.55:0/231724686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9040c9830 0x7fa904070f00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8009870 tx=0x7fa8f801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e6e826d58e7812 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:12.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.899+0000 7fa9027fc640 1 -- 172.21.15.55:0/231724686 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f80a95f0 con 0x7fa9040c9830 2023-08-25T04:03:12.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.899+0000 7fa9027fc640 1 -- 172.21.15.55:0/231724686 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f80a9750 con 0x7fa9040c9830 2023-08-25T04:03:12.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa9027fc640 1 -- 172.21.15.55:0/231724686 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f80a9ae0 con 0x7fa9040c9830 2023-08-25T04:03:12.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa909f03640 1 -- 172.21.15.55:0/231724686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9040c9830 msgr2=0x7fa904070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa909f03640 1 --2- 172.21.15.55:0/231724686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9040c9830 0x7fa904070f00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8009870 tx=0x7fa8f801c510 comp rx=0 tx=0).stop 2023-08-25T04:03:12.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa909f03640 1 -- 172.21.15.55:0/231724686 shutdown_connections 2023-08-25T04:03:12.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa909f03640 1 --2- 172.21.15.55:0/231724686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9040c9830 0x7fa904070f00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa909f03640 1 --2- 172.21.15.55:0/231724686 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa90415a7f0 0x7fa90409bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa909f03640 1 -- 172.21.15.55:0/231724686 >> 172.21.15.55:0/231724686 conn(0x7fa904069900 msgr2=0x7fa904069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:12.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa909f03640 1 -- 172.21.15.55:0/231724686 shutdown_connections 2023-08-25T04:03:12.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa909f03640 1 -- 172.21.15.55:0/231724686 wait complete. 2023-08-25T04:03:12.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa909f03640 1 Processor -- start 2023-08-25T04:03:12.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa909f03640 1 -- start start 2023-08-25T04:03:12.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa909f03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa90406c020 0x7fa9040b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:12.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa909f03640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9040c9830 0x7fa9041f7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:12.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa909f03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa90415a7f0 0x7fa904148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:12.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa909f03640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9041f7ab0 con 0x7fa90406c020 2023-08-25T04:03:12.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa909f03640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa904148660 con 0x7fa9040c9830 2023-08-25T04:03:12.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa909f03640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040b1640 con 0x7fa90415a7f0 2023-08-25T04:03:12.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa9037fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa90406c020 0x7fa9040b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:12.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa9037fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa90406c020 0x7fa9040b0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59834/0 (socket says 172.21.15.55:59834) 2023-08-25T04:03:12.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.903+0000 7fa9037fe640 1 -- 172.21.15.55:0/1008285849 learned_addr learned my addr 172.21.15.55:0/1008285849 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:12.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa9037fe640 1 -- 172.21.15.55:0/1008285849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa90415a7f0 msgr2=0x7fa904148120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa902ffd640 1 --2- 172.21.15.55:0/1008285849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9040c9830 0x7fa9041f7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:12.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa903fff640 1 --2- 172.21.15.55:0/1008285849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa90415a7f0 0x7fa904148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:12.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa9037fe640 1 --2- 172.21.15.55:0/1008285849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa90415a7f0 0x7fa904148120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa9037fe640 1 -- 172.21.15.55:0/1008285849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9040c9830 msgr2=0x7fa9041f7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:12.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa9037fe640 1 --2- 172.21.15.55:0/1008285849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9040c9830 0x7fa9041f7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:12.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa9037fe640 1 -- 172.21.15.55:0/1008285849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f80094d0 con 0x7fa90406c020 2023-08-25T04:03:12.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa902ffd640 1 --2- 172.21.15.55:0/1008285849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9040c9830 0x7fa9041f7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:12.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa903fff640 1 --2- 172.21.15.55:0/1008285849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa90415a7f0 0x7fa904148120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:12.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa9037fe640 1 --2- 172.21.15.55:0/1008285849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa90406c020 0x7fa9040b0fb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa8f400e9b0 tx=0x7fa8f400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:12.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa8ebfff640 1 -- 172.21.15.55:0/1008285849 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f4009670 con 0x7fa90406c020 2023-08-25T04:03:12.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa8ebfff640 1 -- 172.21.15.55:0/1008285849 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f400c9a0 con 0x7fa90406c020 2023-08-25T04:03:12.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa909f03640 1 -- 172.21.15.55:0/1008285849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9040adc90 con 0x7fa90406c020 2023-08-25T04:03:12.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa8ebfff640 1 -- 172.21.15.55:0/1008285849 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f400cd10 con 0x7fa90406c020 2023-08-25T04:03:12.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa909f03640 1 -- 172.21.15.55:0/1008285849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9040b1c00 con 0x7fa90406c020 2023-08-25T04:03:12.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa909f03640 1 -- 172.21.15.55:0/1008285849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90406d5b0 con 0x7fa90406c020 2023-08-25T04:03:12.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa8ebfff640 1 -- 172.21.15.55:0/1008285849 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa8f4013470 con 0x7fa90406c020 2023-08-25T04:03:12.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa8ebfff640 1 --2- 172.21.15.55:0/1008285849 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa8f0065680 0x7fa8f0067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:12.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa8ebfff640 1 -- 172.21.15.55:0/1008285849 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa8f4083410 con 0x7fa90406c020 2023-08-25T04:03:12.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.907+0000 7fa902ffd640 1 --2- 172.21.15.55:0/1008285849 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa8f0065680 0x7fa8f0067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:12.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.911+0000 7fa902ffd640 1 --2- 172.21.15.55:0/1008285849 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa8f0065680 0x7fa8f0067b40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80ae000 tx=0x7fa8f80b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:12.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:12.911+0000 7fa8ebfff640 1 -- 172.21.15.55:0/1008285849 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa8f4050ec0 con 0x7fa90406c020 2023-08-25T04:03:13.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.067+0000 7fa909f03640 1 -- 172.21.15.55:0/1008285849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9040b2530 con 0x7fa90406c020 2023-08-25T04:03:13.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.067+0000 7fa8ebfff640 1 -- 172.21.15.55:0/1008285849 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa8f40544e0 con 0x7fa90406c020 2023-08-25T04:03:13.070 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:03:13.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.071+0000 7fa909f03640 1 -- 172.21.15.55:0/1008285849 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa8f0065680 msgr2=0x7fa8f0067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.071+0000 7fa909f03640 1 --2- 172.21.15.55:0/1008285849 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa8f0065680 0x7fa8f0067b40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80ae000 tx=0x7fa8f80b3040 comp rx=0 tx=0).stop 2023-08-25T04:03:13.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.071+0000 7fa909f03640 1 -- 172.21.15.55:0/1008285849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa90406c020 msgr2=0x7fa9040b0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.071+0000 7fa909f03640 1 --2- 172.21.15.55:0/1008285849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa90406c020 0x7fa9040b0fb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa8f400e9b0 tx=0x7fa8f400ee70 comp rx=0 tx=0).stop 2023-08-25T04:03:13.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.071+0000 7fa909f03640 1 -- 172.21.15.55:0/1008285849 shutdown_connections 2023-08-25T04:03:13.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.071+0000 7fa909f03640 1 --2- 172.21.15.55:0/1008285849 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa8f0065680 0x7fa8f0067b40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.071+0000 7fa909f03640 1 --2- 172.21.15.55:0/1008285849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa90415a7f0 0x7fa904148120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.071+0000 7fa909f03640 1 --2- 172.21.15.55:0/1008285849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9040c9830 0x7fa9041f7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.071+0000 7fa909f03640 1 --2- 172.21.15.55:0/1008285849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa90406c020 0x7fa9040b0fb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.071+0000 7fa909f03640 1 -- 172.21.15.55:0/1008285849 >> 172.21.15.55:0/1008285849 conn(0x7fa904069900 msgr2=0x7fa9040ca940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:13.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.071+0000 7fa909f03640 1 -- 172.21.15.55:0/1008285849 shutdown_connections 2023-08-25T04:03:13.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.071+0000 7fa909f03640 1 -- 172.21.15.55:0/1008285849 wait complete. 2023-08-25T04:03:13.090 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:03:13.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0150d59640 1 Processor -- start 2023-08-25T04:03:13.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0150d59640 1 -- start start 2023-08-25T04:03:13.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0150d59640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f014c0ce220 0x7f014c0b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0150d59640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c0b29b0 con 0x7f014c0d0da0 2023-08-25T04:03:13.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0150d59640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c0ce6b0 con 0x7f014c0cdde0 2023-08-25T04:03:13.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0150d59640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0b1dc0 con 0x7f014c0ce220 2023-08-25T04:03:13.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f014a59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f014c0d0da0 0x7f014c0d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50598/0 (socket says 172.21.15.55:50598) 2023-08-25T04:03:13.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f014a59c640 1 -- 172.21.15.55:0/2681535437 learned_addr learned my addr 172.21.15.55:0/2681535437 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:13.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f014ad9d640 1 --2- 172.21.15.55:0/2681535437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f014c0ce220 0x7f014c0b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0149d9b640 1 -- 172.21.15.55:0/2681535437 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477914598 0 0) 0x7f014c0b29b0 con 0x7f014c0d0da0 2023-08-25T04:03:13.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0149d9b640 1 -- 172.21.15.55:0/2681535437 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0138003530 con 0x7f014c0d0da0 2023-08-25T04:03:13.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0149d9b640 1 -- 172.21.15.55:0/2681535437 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388231066 0 0) 0x7f014c0ce6b0 con 0x7f014c0cdde0 2023-08-25T04:03:13.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0149d9b640 1 -- 172.21.15.55:0/2681535437 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f014c0b29b0 con 0x7f014c0cdde0 2023-08-25T04:03:13.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0149d9b640 1 -- 172.21.15.55:0/2681535437 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4251774115 0 0) 0x7f0138003530 con 0x7f014c0d0da0 2023-08-25T04:03:13.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0149d9b640 1 -- 172.21.15.55:0/2681535437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f014c0ce220 msgr2=0x7f014c0b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:13.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0149d9b640 1 --2- 172.21.15.55:0/2681535437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f014c0ce220 0x7f014c0b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0149d9b640 1 -- 172.21.15.55:0/2681535437 >> v1:172.21.15.110:6789/0 conn(0x7f014c0cdde0 legacy=0x7f014c0b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0149d9b640 1 -- 172.21.15.55:0/2681535437 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c0b2080 con 0x7f014c0d0da0 2023-08-25T04:03:13.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0149d9b640 1 -- 172.21.15.55:0/2681535437 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f013c001800 con 0x7f014c0d0da0 2023-08-25T04:03:13.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0149d9b640 1 -- 172.21.15.55:0/2681535437 >> v1:172.21.15.55:6789/0 conn(0x7f014c0d0da0 legacy=0x7f014c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0149d9b640 1 --2- 172.21.15.55:0/2681535437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0138003b40 0x7f0138003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0149d9b640 1 --2- 172.21.15.55:0/2681535437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01380047d0 0x7f0138004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0149d9b640 1 --2- 172.21.15.55:0/2681535437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0138005190 0x7f013800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0149d9b640 1 -- 172.21.15.55:0/2681535437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0b1dc0 con 0x7f0138005190 2023-08-25T04:03:13.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0149d9b640 1 -- 172.21.15.55:0/2681535437 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013800bf00 con 0x7f01380047d0 2023-08-25T04:03:13.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0149d9b640 1 -- 172.21.15.55:0/2681535437 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013800c0c0 con 0x7f0138003b40 2023-08-25T04:03:13.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f014ad9d640 1 --2- 172.21.15.55:0/2681535437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0138005190 0x7f013800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f0141d9b640 1 --2- 172.21.15.55:0/2681535437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01380047d0 0x7f0138004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.231+0000 7f014a59c640 1 --2- 172.21.15.55:0/2681535437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0138003b40 0x7f0138003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.235+0000 7f014ad9d640 1 -- 172.21.15.55:0/2681535437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0138003b40 msgr2=0x7f0138003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:13.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.235+0000 7f014ad9d640 1 --2- 172.21.15.55:0/2681535437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0138003b40 0x7f0138003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.235+0000 7f014ad9d640 1 -- 172.21.15.55:0/2681535437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01380047d0 msgr2=0x7f0138004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:13.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.235+0000 7f014ad9d640 1 --2- 172.21.15.55:0/2681535437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01380047d0 0x7f0138004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.235+0000 7f014ad9d640 1 -- 172.21.15.55:0/2681535437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0138003530 con 0x7f0138005190 2023-08-25T04:03:13.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.235+0000 7f014ad9d640 1 --2- 172.21.15.55:0/2681535437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0138005190 0x7f013800b990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f014c0ce600 tx=0x7f014401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29529679b4e0594e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:13.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.235+0000 7f0149d9b640 1 -- 172.21.15.55:0/2681535437 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01440a5520 con 0x7f0138005190 2023-08-25T04:03:13.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.235+0000 7f0149d9b640 1 -- 172.21.15.55:0/2681535437 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01440a5680 con 0x7f0138005190 2023-08-25T04:03:13.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.235+0000 7f0149d9b640 1 -- 172.21.15.55:0/2681535437 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01440a5a30 con 0x7f0138005190 2023-08-25T04:03:13.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.235+0000 7f0150d59640 1 -- 172.21.15.55:0/2681535437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0138005190 msgr2=0x7f013800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.235+0000 7f0150d59640 1 --2- 172.21.15.55:0/2681535437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0138005190 0x7f013800b990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f014c0ce600 tx=0x7f014401c930 comp rx=0 tx=0).stop 2023-08-25T04:03:13.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.235+0000 7f014ad9d640 1 -- 172.21.15.55:0/2681535437 reap_dead start 2023-08-25T04:03:13.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.235+0000 7f0150d59640 1 -- 172.21.15.55:0/2681535437 shutdown_connections 2023-08-25T04:03:13.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.235+0000 7f0150d59640 1 -- 172.21.15.55:0/2681535437 >> 172.21.15.55:0/2681535437 conn(0x7f014c09bae0 msgr2=0x7f014c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:13.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.235+0000 7f0150d59640 1 -- 172.21.15.55:0/2681535437 shutdown_connections 2023-08-25T04:03:13.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.235+0000 7f0150d59640 1 -- 172.21.15.55:0/2681535437 wait complete. 2023-08-25T04:03:13.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f0150d59640 1 Processor -- start 2023-08-25T04:03:13.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f0150d59640 1 -- start start 2023-08-25T04:03:13.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f0150d59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0138005190 0x7f014c151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f0150d59640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f014c0cc110 0x7f014c15a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f0150d59640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f014c15aae0 0x7f014c0c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f0150d59640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c15d880 con 0x7f0138005190 2023-08-25T04:03:13.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f0150d59640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0ca8b0 con 0x7f014c0cc110 2023-08-25T04:03:13.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f0150d59640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c15af60 con 0x7f014c15aae0 2023-08-25T04:03:13.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f014a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0138005190 0x7f014c151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f014a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0138005190 0x7f014c151c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59850/0 (socket says 172.21.15.55:59850) 2023-08-25T04:03:13.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f014a59c640 1 -- 172.21.15.55:0/2830710500 learned_addr learned my addr 172.21.15.55:0/2830710500 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:13.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f0141d9b640 1 --2- 172.21.15.55:0/2830710500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f014c0cc110 0x7f014c15a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f014ad9d640 1 --2- 172.21.15.55:0/2830710500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f014c15aae0 0x7f014c0c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f014a59c640 1 -- 172.21.15.55:0/2830710500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f014c15aae0 msgr2=0x7f014c0c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f014a59c640 1 --2- 172.21.15.55:0/2830710500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f014c15aae0 0x7f014c0c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f014a59c640 1 -- 172.21.15.55:0/2830710500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f014c0cc110 msgr2=0x7f014c15a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f014a59c640 1 --2- 172.21.15.55:0/2830710500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f014c0cc110 0x7f014c15a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f014a59c640 1 -- 172.21.15.55:0/2830710500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c0c9c30 con 0x7f0138005190 2023-08-25T04:03:13.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f0141d9b640 1 --2- 172.21.15.55:0/2830710500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f014c0cc110 0x7f014c15a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:13.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f014ad9d640 1 --2- 172.21.15.55:0/2830710500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f014c15aae0 0x7f014c0c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:13.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.239+0000 7f014a59c640 1 --2- 172.21.15.55:0/2830710500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0138005190 0x7f014c151c40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f013c00f860 tx=0x7f013c00fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:13.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.243+0000 7f01437fe640 1 -- 172.21.15.55:0/2830710500 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c0072e0 con 0x7f0138005190 2023-08-25T04:03:13.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.243+0000 7f01437fe640 1 -- 172.21.15.55:0/2830710500 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c007460 con 0x7f0138005190 2023-08-25T04:03:13.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.243+0000 7f01437fe640 1 -- 172.21.15.55:0/2830710500 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c0057b0 con 0x7f0138005190 2023-08-25T04:03:13.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.243+0000 7f0150d59640 1 -- 172.21.15.55:0/2830710500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014c0c9f10 con 0x7f0138005190 2023-08-25T04:03:13.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.243+0000 7f0150d59640 1 -- 172.21.15.55:0/2830710500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014c0ca4d0 con 0x7f0138005190 2023-08-25T04:03:13.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.243+0000 7f0150d59640 1 -- 172.21.15.55:0/2830710500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014c0ca9f0 con 0x7f0138005190 2023-08-25T04:03:13.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.243+0000 7f01437fe640 1 -- 172.21.15.55:0/2830710500 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f013c005910 con 0x7f0138005190 2023-08-25T04:03:13.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.243+0000 7f01437fe640 1 --2- 172.21.15.55:0/2830710500 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f012c0656b0 0x7f012c067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.243+0000 7f01437fe640 1 -- 172.21.15.55:0/2830710500 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f013c082a80 con 0x7f0138005190 2023-08-25T04:03:13.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.243+0000 7f0141d9b640 1 --2- 172.21.15.55:0/2830710500 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f012c0656b0 0x7f012c067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.243+0000 7f0141d9b640 1 --2- 172.21.15.55:0/2830710500 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f012c0656b0 0x7f012c067b70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f014c1f5420 tx=0x7f0134009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:13.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.247+0000 7f01437fe640 1 -- 172.21.15.55:0/2830710500 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f014c0ca9f0 con 0x7f0138005190 2023-08-25T04:03:13.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.439+0000 7f0150d59640 1 -- 172.21.15.55:0/2830710500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f014c0ca9f0 con 0x7f0138005190 2023-08-25T04:03:13.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.439+0000 7f01437fe640 1 -- 172.21.15.55:0/2830710500 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4875 (secure 0 0 0) 0x7f014c0ca9f0 con 0x7f0138005190 2023-08-25T04:03:13.443 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:13.444 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3370778281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3370778281},{"type":"v1","addr":"172.21.15.55:6835","nonce":3370778281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/2321139789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2321139789},{"type":"v1","addr":"172.21.15.110:6837","nonce":2321139789}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3825401605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3825401605},{"type":"v1","addr":"172.21.15.110:6836","nonce":3825401605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:03:01.098486+0000","modified":"2023-08-25T04:03:04.724648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/2606103809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2606103809},{"type":"v1","addr":"172.21.15.55:6834","nonce":2606103809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:03:13.444 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2023-08-25T04:03:13.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.443+0000 7f0150d59640 1 -- 172.21.15.55:0/2830710500 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f012c0656b0 msgr2=0x7f012c067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.443+0000 7f0150d59640 1 --2- 172.21.15.55:0/2830710500 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f012c0656b0 0x7f012c067b70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f014c1f5420 tx=0x7f0134009040 comp rx=0 tx=0).stop 2023-08-25T04:03:13.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.443+0000 7f0150d59640 1 -- 172.21.15.55:0/2830710500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0138005190 msgr2=0x7f014c151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.443+0000 7f0150d59640 1 --2- 172.21.15.55:0/2830710500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0138005190 0x7f014c151c40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f013c00f860 tx=0x7f013c00fd20 comp rx=0 tx=0).stop 2023-08-25T04:03:13.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.443+0000 7f0150d59640 1 -- 172.21.15.55:0/2830710500 shutdown_connections 2023-08-25T04:03:13.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.443+0000 7f0150d59640 1 --2- 172.21.15.55:0/2830710500 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f012c0656b0 0x7f012c067b70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.443+0000 7f0150d59640 1 --2- 172.21.15.55:0/2830710500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f014c15aae0 0x7f014c0c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.443+0000 7f0150d59640 1 --2- 172.21.15.55:0/2830710500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f014c0cc110 0x7f014c15a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.443+0000 7f0150d59640 1 --2- 172.21.15.55:0/2830710500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0138005190 0x7f014c151c40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.443+0000 7f0150d59640 1 -- 172.21.15.55:0/2830710500 >> 172.21.15.55:0/2830710500 conn(0x7f014c09bae0 msgr2=0x7f014c0b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:13.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.443+0000 7f0150d59640 1 -- 172.21.15.55:0/2830710500 shutdown_connections 2023-08-25T04:03:13.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.443+0000 7f0150d59640 1 -- 172.21.15.55:0/2830710500 wait complete. 2023-08-25T04:03:13.465 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:13.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.607+0000 7fd8ab65c640 1 Processor -- start 2023-08-25T04:03:13.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.607+0000 7fd8ab65c640 1 -- start start 2023-08-25T04:03:13.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.607+0000 7fd8ab65c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8a40d0da0 0x7fd8a40d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.607+0000 7fd8ab65c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd8a40b3e50 0x7fd8a40ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.607+0000 7fd8ab65c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a40b29b0 con 0x7fd8a40cdde0 2023-08-25T04:03:13.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.607+0000 7fd8ab65c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a40ce760 con 0x7fd8a40b3e50 2023-08-25T04:03:13.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.607+0000 7fd8ab65c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a40d16c0 con 0x7fd8a40d0da0 2023-08-25T04:03:13.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.607+0000 7fd8a8bf7640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd8a40cdde0 0x7fd8a40cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50604/0 (socket says 172.21.15.55:50604) 2023-08-25T04:03:13.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.607+0000 7fd8a8bf7640 1 -- 172.21.15.55:0/3749229907 learned_addr learned my addr 172.21.15.55:0/3749229907 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:13.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.607+0000 7fd8a9bf9640 1 --2- 172.21.15.55:0/3749229907 >> v2:172.21.15.110:3300/0 conn(0x7fd8a40b3e50 0x7fd8a40ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.607+0000 7fd8a93f8640 1 --2- 172.21.15.55:0/3749229907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8a40d0da0 0x7fd8a40d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.607+0000 7fd89bfff640 1 -- 172.21.15.55:0/3749229907 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654155350 0 0) 0x7fd8a40b29b0 con 0x7fd8a40cdde0 2023-08-25T04:03:13.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.607+0000 7fd89bfff640 1 -- 172.21.15.55:0/3749229907 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd890003530 con 0x7fd8a40cdde0 2023-08-25T04:03:13.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.607+0000 7fd8a9bf9640 1 -- 172.21.15.55:0/3749229907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8a40d0da0 msgr2=0x7fd8a40d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:13.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.607+0000 7fd8a9bf9640 1 --2- 172.21.15.55:0/3749229907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8a40d0da0 0x7fd8a40d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.607+0000 7fd8a9bf9640 1 -- 172.21.15.55:0/3749229907 >> v1:172.21.15.55:6789/0 conn(0x7fd8a40cdde0 legacy=0x7fd8a40cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.607+0000 7fd8a9bf9640 1 -- 172.21.15.55:0/3749229907 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a40b1dc0 con 0x7fd8a40b3e50 2023-08-25T04:03:13.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.607+0000 7fd8a93f8640 1 --2- 172.21.15.55:0/3749229907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8a40d0da0 0x7fd8a40d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:13.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.611+0000 7fd8a9bf9640 1 --2- 172.21.15.55:0/3749229907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a40b3e50 0x7fd8a40ce220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009d90 tx=0x7fd89c01f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59f17e22135b3eaf server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:13.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.611+0000 7fd89bfff640 1 -- 172.21.15.55:0/3749229907 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0af600 con 0x7fd8a40b3e50 2023-08-25T04:03:13.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.611+0000 7fd89bfff640 1 -- 172.21.15.55:0/3749229907 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c0ab050 con 0x7fd8a40b3e50 2023-08-25T04:03:13.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.611+0000 7fd89bfff640 1 -- 172.21.15.55:0/3749229907 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0af980 con 0x7fd8a40b3e50 2023-08-25T04:03:13.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.611+0000 7fd8ab65c640 1 -- 172.21.15.55:0/3749229907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a40b3e50 msgr2=0x7fd8a40ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.611+0000 7fd8ab65c640 1 --2- 172.21.15.55:0/3749229907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a40b3e50 0x7fd8a40ce220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009d90 tx=0x7fd89c01f130 comp rx=0 tx=0).stop 2023-08-25T04:03:13.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.611+0000 7fd8ab65c640 1 -- 172.21.15.55:0/3749229907 shutdown_connections 2023-08-25T04:03:13.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.611+0000 7fd8ab65c640 1 --2- 172.21.15.55:0/3749229907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a40b3e50 0x7fd8a40ce220 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.611+0000 7fd8ab65c640 1 --2- 172.21.15.55:0/3749229907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8a40d0da0 0x7fd8a40d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.611+0000 7fd8ab65c640 1 -- 172.21.15.55:0/3749229907 >> 172.21.15.55:0/3749229907 conn(0x7fd8a409bae0 msgr2=0x7fd8a40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:13.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.611+0000 7fd8ab65c640 1 -- 172.21.15.55:0/3749229907 shutdown_connections 2023-08-25T04:03:13.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.611+0000 7fd8ab65c640 1 -- 172.21.15.55:0/3749229907 wait complete. 2023-08-25T04:03:13.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8ab65c640 1 Processor -- start 2023-08-25T04:03:13.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8ab65c640 1 -- start start 2023-08-25T04:03:13.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8ab65c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a40b3e50 0x7fd8a41592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8ab65c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a40cdde0 0x7fd8a4151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8ab65c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8a40d0da0 0x7fd8a406b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8ab65c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a4159b10 con 0x7fd8a40cdde0 2023-08-25T04:03:13.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8ab65c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a4159df0 con 0x7fd8a40b3e50 2023-08-25T04:03:13.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8ab65c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a415a0d0 con 0x7fd8a40d0da0 2023-08-25T04:03:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8a8bf7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a40cdde0 0x7fd8a4151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8a8bf7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a40cdde0 0x7fd8a4151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59858/0 (socket says 172.21.15.55:59858) 2023-08-25T04:03:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8a8bf7640 1 -- 172.21.15.55:0/3950442585 learned_addr learned my addr 172.21.15.55:0/3950442585 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8a93f8640 1 --2- 172.21.15.55:0/3950442585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a40b3e50 0x7fd8a41592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8a9bf9640 1 --2- 172.21.15.55:0/3950442585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8a40d0da0 0x7fd8a406b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8a8bf7640 1 -- 172.21.15.55:0/3950442585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8a40d0da0 msgr2=0x7fd8a406b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8a8bf7640 1 --2- 172.21.15.55:0/3950442585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8a40d0da0 0x7fd8a406b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8a8bf7640 1 -- 172.21.15.55:0/3950442585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a40b3e50 msgr2=0x7fd8a41592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8a8bf7640 1 --2- 172.21.15.55:0/3950442585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a40b3e50 0x7fd8a41592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8a8bf7640 1 -- 172.21.15.55:0/3950442585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a00093b0 con 0x7fd8a40cdde0 2023-08-25T04:03:13.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8a8bf7640 1 --2- 172.21.15.55:0/3950442585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a40cdde0 0x7fd8a4151b10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd89400c4d0 tx=0x7fd89400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:13.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd899ffb640 1 -- 172.21.15.55:0/3950442585 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894005cf0 con 0x7fd8a40cdde0 2023-08-25T04:03:13.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd899ffb640 1 -- 172.21.15.55:0/3950442585 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd894005e50 con 0x7fd8a40cdde0 2023-08-25T04:03:13.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd899ffb640 1 -- 172.21.15.55:0/3950442585 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894007270 con 0x7fd8a40cdde0 2023-08-25T04:03:13.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8ab65c640 1 -- 172.21.15.55:0/3950442585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c009a70 con 0x7fd8a40cdde0 2023-08-25T04:03:13.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.615+0000 7fd8ab65c640 1 -- 172.21.15.55:0/3950442585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a40cb2a0 con 0x7fd8a40cdde0 2023-08-25T04:03:13.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.619+0000 7fd8ab65c640 1 -- 172.21.15.55:0/3950442585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a404dbe0 con 0x7fd8a40cdde0 2023-08-25T04:03:13.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.619+0000 7fd899ffb640 1 -- 172.21.15.55:0/3950442585 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd8940073d0 con 0x7fd8a40cdde0 2023-08-25T04:03:13.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.619+0000 7fd899ffb640 1 --2- 172.21.15.55:0/3950442585 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd888065680 0x7fd888067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.619+0000 7fd899ffb640 1 -- 172.21.15.55:0/3950442585 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd8940822d0 con 0x7fd8a40cdde0 2023-08-25T04:03:13.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.619+0000 7fd8a93f8640 1 --2- 172.21.15.55:0/3950442585 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd888065680 0x7fd888067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.623+0000 7fd8a93f8640 1 --2- 172.21.15.55:0/3950442585 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd888065680 0x7fd888067b40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd8a406c9c0 tx=0x7fd8a0006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:13.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.623+0000 7fd899ffb640 1 -- 172.21.15.55:0/3950442585 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd89404fe40 con 0x7fd8a40cdde0 2023-08-25T04:03:13.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.783+0000 7fd8ab65c640 1 -- 172.21.15.55:0/3950442585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8a40d0b80 con 0x7fd8a40cdde0 2023-08-25T04:03:13.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.783+0000 7fd899ffb640 1 -- 172.21.15.55:0/3950442585 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18291 (secure 0 0 0) 0x7fd894053460 con 0x7fd8a40cdde0 2023-08-25T04:03:13.785 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:13.785 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:02.329010+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:13.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.783+0000 7fd8ab65c640 1 -- 172.21.15.55:0/3950442585 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd888065680 msgr2=0x7fd888067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.783+0000 7fd8ab65c640 1 --2- 172.21.15.55:0/3950442585 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd888065680 0x7fd888067b40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd8a406c9c0 tx=0x7fd8a0006f90 comp rx=0 tx=0).stop 2023-08-25T04:03:13.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.783+0000 7fd8ab65c640 1 -- 172.21.15.55:0/3950442585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a40cdde0 msgr2=0x7fd8a4151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.783+0000 7fd8ab65c640 1 --2- 172.21.15.55:0/3950442585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a40cdde0 0x7fd8a4151b10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd89400c4d0 tx=0x7fd89400c990 comp rx=0 tx=0).stop 2023-08-25T04:03:13.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.783+0000 7fd8ab65c640 1 -- 172.21.15.55:0/3950442585 shutdown_connections 2023-08-25T04:03:13.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.783+0000 7fd8ab65c640 1 --2- 172.21.15.55:0/3950442585 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd888065680 0x7fd888067b40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.783+0000 7fd8ab65c640 1 --2- 172.21.15.55:0/3950442585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8a40d0da0 0x7fd8a406b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.783+0000 7fd8ab65c640 1 --2- 172.21.15.55:0/3950442585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a40cdde0 0x7fd8a4151b10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.783+0000 7fd8ab65c640 1 --2- 172.21.15.55:0/3950442585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8a40b3e50 0x7fd8a41592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.783+0000 7fd8ab65c640 1 -- 172.21.15.55:0/3950442585 >> 172.21.15.55:0/3950442585 conn(0x7fd8a409bae0 msgr2=0x7fd8a40d2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:13.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.783+0000 7fd8ab65c640 1 -- 172.21.15.55:0/3950442585 shutdown_connections 2023-08-25T04:03:13.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.783+0000 7fd8ab65c640 1 -- 172.21.15.55:0/3950442585 wait complete. 2023-08-25T04:03:13.807 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:02:58.890533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:03:00.093976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:03:13.808 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:03:13.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.951+0000 7f30c4f2c640 1 Processor -- start 2023-08-25T04:03:13.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.951+0000 7f30c4f2c640 1 -- start start 2023-08-25T04:03:13.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.951+0000 7f30c4f2c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30c006c3b0 0x7f30c00cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.951+0000 7f30c4f2c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f30c006e5a0 0x7f30c00ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.951+0000 7f30c4f2c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c00cab90 con 0x7f30c006c790 2023-08-25T04:03:13.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.955+0000 7f30c4f2c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c006dbb0 con 0x7f30c006e5a0 2023-08-25T04:03:13.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.955+0000 7f30c4f2c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00cae50 con 0x7f30c006c3b0 2023-08-25T04:03:13.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.955+0000 7f30bed9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f30c006e5a0 0x7f30c00ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.955+0000 7f30be59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30c006c3b0 0x7f30c00cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.955+0000 7f30bed9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f30c006e5a0 0x7f30c00ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:46172/0 (socket says 172.21.15.55:46172) 2023-08-25T04:03:13.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.955+0000 7f30bed9d640 1 -- 172.21.15.55:0/3693833800 learned_addr learned my addr 172.21.15.55:0/3693833800 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:13.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.955+0000 7f30be59c640 1 -- 172.21.15.55:0/3693833800 >> v2:172.21.15.110:3300/0 conn(0x7f30c006e5a0 msgr2=0x7f30c00ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:13.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.955+0000 7f30be59c640 1 --2- 172.21.15.55:0/3693833800 >> v2:172.21.15.110:3300/0 conn(0x7f30c006e5a0 0x7f30c00ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.955+0000 7f30be59c640 1 -- 172.21.15.55:0/3693833800 >> v1:172.21.15.110:6789/0 conn(0x7f30c006c790 legacy=0x7f30c006de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.955+0000 7f30be59c640 1 -- 172.21.15.55:0/3693833800 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c00cb130 con 0x7f30c006c3b0 2023-08-25T04:03:13.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30be59c640 1 --2- 172.21.15.55:0/3693833800 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30c006c3b0 0x7f30c00cd7d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f30b00097a0 tx=0x7f30b001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3636159158d6383 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:13.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30bdd9b640 1 -- 172.21.15.55:0/3693833800 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b00ab610 con 0x7f30c006c3b0 2023-08-25T04:03:13.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30bdd9b640 1 -- 172.21.15.55:0/3693833800 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b00ab770 con 0x7f30c006c3b0 2023-08-25T04:03:13.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30bdd9b640 1 -- 172.21.15.55:0/3693833800 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b00abb00 con 0x7f30c006c3b0 2023-08-25T04:03:13.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30c4f2c640 1 -- 172.21.15.55:0/3693833800 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30c006c3b0 msgr2=0x7f30c00cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30c4f2c640 1 --2- 172.21.15.55:0/3693833800 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30c006c3b0 0x7f30c00cd7d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f30b00097a0 tx=0x7f30b001c430 comp rx=0 tx=0).stop 2023-08-25T04:03:13.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30c4f2c640 1 -- 172.21.15.55:0/3693833800 shutdown_connections 2023-08-25T04:03:13.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30c4f2c640 1 --2- 172.21.15.55:0/3693833800 >> v2:172.21.15.110:3300/0 conn(0x7f30c006e5a0 0x7f30c00ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30c4f2c640 1 --2- 172.21.15.55:0/3693833800 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30c006c3b0 0x7f30c00cd7d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30c4f2c640 1 -- 172.21.15.55:0/3693833800 >> 172.21.15.55:0/3693833800 conn(0x7f30c00d0540 msgr2=0x7f30c00d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:13.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30c4f2c640 1 -- 172.21.15.55:0/3693833800 shutdown_connections 2023-08-25T04:03:13.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30c4f2c640 1 -- 172.21.15.55:0/3693833800 wait complete. 2023-08-25T04:03:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30c4f2c640 1 Processor -- start 2023-08-25T04:03:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30c4f2c640 1 -- start start 2023-08-25T04:03:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30c4f2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30c006c3b0 0x7f30c0152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30c4f2c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30c006c790 0x7f30c00c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30c4f2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c006e5a0 0x7f30c00b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30c4f2c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00c9b90 con 0x7f30c006e5a0 2023-08-25T04:03:13.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30c4f2c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c0158700 con 0x7f30c006c3b0 2023-08-25T04:03:13.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.959+0000 7f30c4f2c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c00c8890 con 0x7f30c006c790 2023-08-25T04:03:13.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.963+0000 7f30bed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c006e5a0 0x7f30c00b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.963+0000 7f30bed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c006e5a0 0x7f30c00b0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59868/0 (socket says 172.21.15.55:59868) 2023-08-25T04:03:13.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.963+0000 7f30bed9d640 1 -- 172.21.15.55:0/1909310056 learned_addr learned my addr 172.21.15.55:0/1909310056 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:13.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.963+0000 7f30be59c640 1 --2- 172.21.15.55:0/1909310056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30c006c3b0 0x7f30c0152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.963+0000 7f30b7fff640 1 --2- 172.21.15.55:0/1909310056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30c006c790 0x7f30c00c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.963+0000 7f30bed9d640 1 -- 172.21.15.55:0/1909310056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30c006c790 msgr2=0x7f30c00c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.963+0000 7f30bed9d640 1 --2- 172.21.15.55:0/1909310056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30c006c790 0x7f30c00c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.963+0000 7f30bed9d640 1 -- 172.21.15.55:0/1909310056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30c006c3b0 msgr2=0x7f30c0152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:13.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.963+0000 7f30bed9d640 1 --2- 172.21.15.55:0/1909310056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30c006c3b0 0x7f30c0152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:13.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.963+0000 7f30bed9d640 1 -- 172.21.15.55:0/1909310056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b00093b0 con 0x7f30c006e5a0 2023-08-25T04:03:13.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.963+0000 7f30bed9d640 1 --2- 172.21.15.55:0/1909310056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c006e5a0 0x7f30c00b0280 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f30b800ebe0 tx=0x7f30b800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.963+0000 7f30b6ffd640 1 -- 172.21.15.55:0/1909310056 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b800cb20 con 0x7f30c006e5a0 2023-08-25T04:03:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.963+0000 7f30b6ffd640 1 -- 172.21.15.55:0/1909310056 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b800f040 con 0x7f30c006e5a0 2023-08-25T04:03:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.963+0000 7f30b6ffd640 1 -- 172.21.15.55:0/1909310056 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b80039a0 con 0x7f30c006e5a0 2023-08-25T04:03:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.963+0000 7f30c4f2c640 1 -- 172.21.15.55:0/1909310056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c00c8b70 con 0x7f30c006e5a0 2023-08-25T04:03:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.963+0000 7f30c4f2c640 1 -- 172.21.15.55:0/1909310056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c00c9130 con 0x7f30c006e5a0 2023-08-25T04:03:13.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.963+0000 7f30c4f2c640 1 -- 172.21.15.55:0/1909310056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c00c9350 con 0x7f30c006e5a0 2023-08-25T04:03:13.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.963+0000 7f30b6ffd640 1 -- 172.21.15.55:0/1909310056 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f30b8003b00 con 0x7f30c006e5a0 2023-08-25T04:03:13.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.967+0000 7f30b6ffd640 1 --2- 172.21.15.55:0/1909310056 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f30a0065680 0x7f30a0067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:13.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.967+0000 7f30b6ffd640 1 -- 172.21.15.55:0/1909310056 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f30b8083230 con 0x7f30c006e5a0 2023-08-25T04:03:13.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.967+0000 7f30be59c640 1 --2- 172.21.15.55:0/1909310056 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f30a0065680 0x7f30a0067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:13.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.967+0000 7f30be59c640 1 --2- 172.21.15.55:0/1909310056 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f30a0065680 0x7f30a0067b40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f30b00af000 tx=0x7f30b00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:13.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:13.971+0000 7f30b6ffd640 1 -- 172.21.15.55:0/1909310056 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f30b8050d00 con 0x7f30c006e5a0 2023-08-25T04:03:14.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.127+0000 7f30c4f2c640 1 -- 172.21.15.55:0/1909310056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f30c0073ec0 con 0x7f30c006e5a0 2023-08-25T04:03:14.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.127+0000 7f30b6ffd640 1 -- 172.21.15.55:0/1909310056 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f30b8054320 con 0x7f30c006e5a0 2023-08-25T04:03:14.131 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:03:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.131+0000 7f30c4f2c640 1 -- 172.21.15.55:0/1909310056 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f30a0065680 msgr2=0x7f30a0067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.131+0000 7f30c4f2c640 1 --2- 172.21.15.55:0/1909310056 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f30a0065680 0x7f30a0067b40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f30b00af000 tx=0x7f30b00a7000 comp rx=0 tx=0).stop 2023-08-25T04:03:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.131+0000 7f30c4f2c640 1 -- 172.21.15.55:0/1909310056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c006e5a0 msgr2=0x7f30c00b0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.131+0000 7f30c4f2c640 1 --2- 172.21.15.55:0/1909310056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c006e5a0 0x7f30c00b0280 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f30b800ebe0 tx=0x7f30b800c490 comp rx=0 tx=0).stop 2023-08-25T04:03:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.131+0000 7f30c4f2c640 1 -- 172.21.15.55:0/1909310056 shutdown_connections 2023-08-25T04:03:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.131+0000 7f30c4f2c640 1 --2- 172.21.15.55:0/1909310056 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f30a0065680 0x7f30a0067b40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.131+0000 7f30c4f2c640 1 --2- 172.21.15.55:0/1909310056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30c006e5a0 0x7f30c00b0280 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.131+0000 7f30c4f2c640 1 --2- 172.21.15.55:0/1909310056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30c006c790 0x7f30c00c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.131+0000 7f30c4f2c640 1 --2- 172.21.15.55:0/1909310056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30c006c3b0 0x7f30c0152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.131+0000 7f30c4f2c640 1 -- 172.21.15.55:0/1909310056 >> 172.21.15.55:0/1909310056 conn(0x7f30c00d0540 msgr2=0x7f30c00add60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.131+0000 7f30c4f2c640 1 -- 172.21.15.55:0/1909310056 shutdown_connections 2023-08-25T04:03:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.131+0000 7f30c4f2c640 1 -- 172.21.15.55:0/1909310056 wait complete. 2023-08-25T04:03:14.151 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:03:14.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.295+0000 7f8dc4bac640 1 Processor -- start 2023-08-25T04:03:14.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.295+0000 7f8dc4bac640 1 -- start start 2023-08-25T04:03:14.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.295+0000 7f8dc4bac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dc015e3c0 0x7f8dc015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:14.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.295+0000 7f8dc4bac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc00cd5a0 con 0x7f8dc01601f0 2023-08-25T04:03:14.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.295+0000 7f8dc4bac640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc00cd880 con 0x7f8dc00d1290 2023-08-25T04:03:14.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.295+0000 7f8dc4bac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc00cdb60 con 0x7f8dc015e3c0 2023-08-25T04:03:14.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.295+0000 7f8dbe59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8dc01601f0 0x7f8dc00d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50608/0 (socket says 172.21.15.55:50608) 2023-08-25T04:03:14.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.295+0000 7f8dbe59c640 1 -- 172.21.15.55:0/19651736 learned_addr learned my addr 172.21.15.55:0/19651736 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:14.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8db7fff640 1 --2- 172.21.15.55:0/19651736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dc015e3c0 0x7f8dc015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:14.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbdd9b640 1 -- 172.21.15.55:0/19651736 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591891670 0 0) 0x7f8dc00cd5a0 con 0x7f8dc01601f0 2023-08-25T04:03:14.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbdd9b640 1 -- 172.21.15.55:0/19651736 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dac003530 con 0x7f8dc01601f0 2023-08-25T04:03:14.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbdd9b640 1 -- 172.21.15.55:0/19651736 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758196320 0 0) 0x7f8dc00cd880 con 0x7f8dc00d1290 2023-08-25T04:03:14.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbdd9b640 1 -- 172.21.15.55:0/19651736 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dc00cd5a0 con 0x7f8dc00d1290 2023-08-25T04:03:14.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbdd9b640 1 -- 172.21.15.55:0/19651736 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 272115805 0 0) 0x7f8dac003530 con 0x7f8dc01601f0 2023-08-25T04:03:14.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbdd9b640 1 -- 172.21.15.55:0/19651736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dc015e3c0 msgr2=0x7f8dc015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:14.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbdd9b640 1 --2- 172.21.15.55:0/19651736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dc015e3c0 0x7f8dc015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbdd9b640 1 -- 172.21.15.55:0/19651736 >> v1:172.21.15.110:6789/0 conn(0x7f8dc00d1290 legacy=0x7f8dc015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:14.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbdd9b640 1 -- 172.21.15.55:0/19651736 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc00cde40 con 0x7f8dc01601f0 2023-08-25T04:03:14.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbdd9b640 1 -- 172.21.15.55:0/19651736 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f8db0001800 con 0x7f8dc01601f0 2023-08-25T04:03:14.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbdd9b640 1 -- 172.21.15.55:0/19651736 >> v1:172.21.15.55:6789/0 conn(0x7f8dc01601f0 legacy=0x7f8dc00d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:14.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbdd9b640 1 --2- 172.21.15.55:0/19651736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dac003b40 0x7f8dac003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:14.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbdd9b640 1 --2- 172.21.15.55:0/19651736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dc015e3c0 0x7f8dac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:14.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbdd9b640 1 --2- 172.21.15.55:0/19651736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dac004d10 0x7f8dac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:14.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbdd9b640 1 -- 172.21.15.55:0/19651736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc00cdb60 con 0x7f8dac003b40 2023-08-25T04:03:14.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbdd9b640 1 -- 172.21.15.55:0/19651736 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac00ba70 con 0x7f8dac004d10 2023-08-25T04:03:14.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbdd9b640 1 -- 172.21.15.55:0/19651736 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac00bc30 con 0x7f8dc015e3c0 2023-08-25T04:03:14.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbe59c640 1 --2- 172.21.15.55:0/19651736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dac003b40 0x7f8dac003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:14.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8db7fff640 1 --2- 172.21.15.55:0/19651736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dc015e3c0 0x7f8dac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:14.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbed9d640 1 --2- 172.21.15.55:0/19651736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dac004d10 0x7f8dac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:14.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbe59c640 1 -- 172.21.15.55:0/19651736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dc015e3c0 msgr2=0x7f8dac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:14.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbe59c640 1 --2- 172.21.15.55:0/19651736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dc015e3c0 0x7f8dac0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbe59c640 1 -- 172.21.15.55:0/19651736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dac004d10 msgr2=0x7f8dac005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:14.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbe59c640 1 --2- 172.21.15.55:0/19651736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dac004d10 0x7f8dac005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.299+0000 7f8dbe59c640 1 -- 172.21.15.55:0/19651736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac003530 con 0x7f8dac003b40 2023-08-25T04:03:14.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dbe59c640 1 --2- 172.21.15.55:0/19651736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dac003b40 0x7f8dac003f40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8db000c160 tx=0x7f8db001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ceffdce8c576c8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:14.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dbdd9b640 1 -- 172.21.15.55:0/19651736 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db00070d0 con 0x7f8dac003b40 2023-08-25T04:03:14.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dbdd9b640 1 -- 172.21.15.55:0/19651736 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db0007250 con 0x7f8dac003b40 2023-08-25T04:03:14.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dbdd9b640 1 -- 172.21.15.55:0/19651736 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db0007600 con 0x7f8dac003b40 2023-08-25T04:03:14.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dc4bac640 1 -- 172.21.15.55:0/19651736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dac003b40 msgr2=0x7f8dac003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:14.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dc4bac640 1 --2- 172.21.15.55:0/19651736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dac003b40 0x7f8dac003f40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8db000c160 tx=0x7f8db001cba0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dbed9d640 1 -- 172.21.15.55:0/19651736 reap_dead start 2023-08-25T04:03:14.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dc4bac640 1 -- 172.21.15.55:0/19651736 shutdown_connections 2023-08-25T04:03:14.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dc4bac640 1 -- 172.21.15.55:0/19651736 >> 172.21.15.55:0/19651736 conn(0x7f8dc00d27d0 msgr2=0x7f8dc00d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:14.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dc4bac640 1 -- 172.21.15.55:0/19651736 shutdown_connections 2023-08-25T04:03:14.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dc4bac640 1 -- 172.21.15.55:0/19651736 wait complete. 2023-08-25T04:03:14.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dc4bac640 1 Processor -- start 2023-08-25T04:03:14.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dc4bac640 1 -- start start 2023-08-25T04:03:14.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dc4bac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dac003b40 0x7f8dc0154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:14.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dc4bac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dc00c8d70 0x7f8dc015a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:14.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dc4bac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dc015aa20 0x7f8dc00ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:14.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dc4bac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc015bd50 con 0x7f8dc00c8d70 2023-08-25T04:03:14.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dc4bac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc015b2b0 con 0x7f8dac003b40 2023-08-25T04:03:14.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.303+0000 7f8dc4bac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc0159040 con 0x7f8dc015aa20 2023-08-25T04:03:14.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8db7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dc00c8d70 0x7f8dc015a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:14.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8db7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dc00c8d70 0x7f8dc015a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59888/0 (socket says 172.21.15.55:59888) 2023-08-25T04:03:14.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8db7fff640 1 -- 172.21.15.55:0/3245972721 learned_addr learned my addr 172.21.15.55:0/3245972721 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:14.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8dbe59c640 1 --2- 172.21.15.55:0/3245972721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dac003b40 0x7f8dc0154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:14.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8dbed9d640 1 --2- 172.21.15.55:0/3245972721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dc015aa20 0x7f8dc00ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:14.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8db7fff640 1 -- 172.21.15.55:0/3245972721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dc015aa20 msgr2=0x7f8dc00ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:14.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8db7fff640 1 --2- 172.21.15.55:0/3245972721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dc015aa20 0x7f8dc00ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8db7fff640 1 -- 172.21.15.55:0/3245972721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dac003b40 msgr2=0x7f8dc0154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:14.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8db7fff640 1 --2- 172.21.15.55:0/3245972721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dac003b40 0x7f8dc0154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8db7fff640 1 -- 172.21.15.55:0/3245972721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc00ce7c0 con 0x7f8dc00c8d70 2023-08-25T04:03:14.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8dbed9d640 1 --2- 172.21.15.55:0/3245972721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dc015aa20 0x7f8dc00ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:14.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8dbe59c640 1 --2- 172.21.15.55:0/3245972721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dac003b40 0x7f8dc0154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:14.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8db7fff640 1 --2- 172.21.15.55:0/3245972721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dc00c8d70 0x7f8dc015a4e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8da80115e0 tx=0x7f8da8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:14.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8db6ffd640 1 -- 172.21.15.55:0/3245972721 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da800f8f0 con 0x7f8dc00c8d70 2023-08-25T04:03:14.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8db6ffd640 1 -- 172.21.15.55:0/3245972721 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da800fa50 con 0x7f8dc00c8d70 2023-08-25T04:03:14.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8db6ffd640 1 -- 172.21.15.55:0/3245972721 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da800fdc0 con 0x7f8dc00c8d70 2023-08-25T04:03:14.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8dc4bac640 1 -- 172.21.15.55:0/3245972721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc0158d60 con 0x7f8dc00c8d70 2023-08-25T04:03:14.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8dc4bac640 1 -- 172.21.15.55:0/3245972721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc015b830 con 0x7f8dc00c8d70 2023-08-25T04:03:14.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8dc4bac640 1 -- 172.21.15.55:0/3245972721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc00b5260 con 0x7f8dc00c8d70 2023-08-25T04:03:14.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8db6ffd640 1 -- 172.21.15.55:0/3245972721 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8da8015460 con 0x7f8dc00c8d70 2023-08-25T04:03:14.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.307+0000 7f8db6ffd640 1 --2- 172.21.15.55:0/3245972721 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8da00656b0 0x7f8da0067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:14.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.311+0000 7f8db6ffd640 1 -- 172.21.15.55:0/3245972721 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8da8083370 con 0x7f8dc00c8d70 2023-08-25T04:03:14.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.311+0000 7f8dbe59c640 1 --2- 172.21.15.55:0/3245972721 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8da00656b0 0x7f8da0067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:14.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.311+0000 7f8dbe59c640 1 --2- 172.21.15.55:0/3245972721 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8da00656b0 0x7f8da0067b70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8db00aa000 tx=0x7f8db00b0040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:14.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.315+0000 7f8db6ffd640 1 -- 172.21.15.55:0/3245972721 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8da8050da0 con 0x7f8dc00c8d70 2023-08-25T04:03:14.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.471+0000 7f8dc4bac640 1 -- 172.21.15.55:0/3245972721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8dc0073ec0 con 0x7f8dc00c8d70 2023-08-25T04:03:14.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.471+0000 7f8db6ffd640 1 -- 172.21.15.55:0/3245972721 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8da80543c0 con 0x7f8dc00c8d70 2023-08-25T04:03:14.473 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:03:14.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.471+0000 7f8dc4bac640 1 -- 172.21.15.55:0/3245972721 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8da00656b0 msgr2=0x7f8da0067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:14.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.471+0000 7f8dc4bac640 1 --2- 172.21.15.55:0/3245972721 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8da00656b0 0x7f8da0067b70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8db00aa000 tx=0x7f8db00b0040 comp rx=0 tx=0).stop 2023-08-25T04:03:14.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.471+0000 7f8dc4bac640 1 -- 172.21.15.55:0/3245972721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dc00c8d70 msgr2=0x7f8dc015a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:14.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.471+0000 7f8dc4bac640 1 --2- 172.21.15.55:0/3245972721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dc00c8d70 0x7f8dc015a4e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8da80115e0 tx=0x7f8da8011aa0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.471+0000 7f8dc4bac640 1 -- 172.21.15.55:0/3245972721 shutdown_connections 2023-08-25T04:03:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.471+0000 7f8dc4bac640 1 --2- 172.21.15.55:0/3245972721 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8da00656b0 0x7f8da0067b70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.471+0000 7f8dc4bac640 1 --2- 172.21.15.55:0/3245972721 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8dc015aa20 0x7f8dc00ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.471+0000 7f8dc4bac640 1 --2- 172.21.15.55:0/3245972721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dc00c8d70 0x7f8dc015a4e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.471+0000 7f8dc4bac640 1 --2- 172.21.15.55:0/3245972721 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8dac003b40 0x7f8dc0154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.471+0000 7f8dc4bac640 1 -- 172.21.15.55:0/3245972721 >> 172.21.15.55:0/3245972721 conn(0x7f8dc00d27d0 msgr2=0x7f8dc00b7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.471+0000 7f8dc4bac640 1 -- 172.21.15.55:0/3245972721 shutdown_connections 2023-08-25T04:03:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.471+0000 7f8dc4bac640 1 -- 172.21.15.55:0/3245972721 wait complete. 2023-08-25T04:03:14.494 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:03:14.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3034796640 1 Processor -- start 2023-08-25T04:03:14.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3034796640 1 -- start start 2023-08-25T04:03:14.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3034796640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f302c0d14c0 0x7f302c0ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:14.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3034796640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302c0cd3e0 con 0x7f302c0d32f0 2023-08-25T04:03:14.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3034796640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302c0cd680 con 0x7f302c15cb40 2023-08-25T04:03:14.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3034796640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f302c0d0c40 con 0x7f302c0d14c0 2023-08-25T04:03:14.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3032d33640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f302c0d32f0 0x7f302c0b1c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50610/0 (socket says 172.21.15.55:50610) 2023-08-25T04:03:14.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3032d33640 1 -- 172.21.15.55:0/2919594661 learned_addr learned my addr 172.21.15.55:0/2919594661 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:14.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3031d31640 1 --2- 172.21.15.55:0/2919594661 >> v2:172.21.15.110:3300/0 conn(0x7f302c0d14c0 0x7f302c0ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:14.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3031530640 1 -- 172.21.15.55:0/2919594661 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838583491 0 0) 0x7f302c0cd3e0 con 0x7f302c0d32f0 2023-08-25T04:03:14.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3031530640 1 -- 172.21.15.55:0/2919594661 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3018003530 con 0x7f302c0d32f0 2023-08-25T04:03:14.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3031530640 1 -- 172.21.15.55:0/2919594661 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1723761734 0 0) 0x7f3018003530 con 0x7f302c0d32f0 2023-08-25T04:03:14.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3031530640 1 -- 172.21.15.55:0/2919594661 >> v2:172.21.15.110:3300/0 conn(0x7f302c0d14c0 msgr2=0x7f302c0ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:14.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3031530640 1 --2- 172.21.15.55:0/2919594661 >> v2:172.21.15.110:3300/0 conn(0x7f302c0d14c0 0x7f302c0ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3031530640 1 -- 172.21.15.55:0/2919594661 >> v1:172.21.15.110:6789/0 conn(0x7f302c15cb40 legacy=0x7f302c0d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:14.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3031530640 1 -- 172.21.15.55:0/2919594661 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c0cd960 con 0x7f302c0d32f0 2023-08-25T04:03:14.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3031530640 1 -- 172.21.15.55:0/2919594661 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f3024001a00 con 0x7f302c0d32f0 2023-08-25T04:03:14.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3031530640 1 -- 172.21.15.55:0/2919594661 >> v1:172.21.15.55:6789/0 conn(0x7f302c0d32f0 legacy=0x7f302c0b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:14.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3031530640 1 --2- 172.21.15.55:0/2919594661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3018003980 0x7f3018003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:14.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3031530640 1 --2- 172.21.15.55:0/2919594661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30180047d0 0x7f3018004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:14.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3031530640 1 --2- 172.21.15.55:0/2919594661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3018005190 0x7f301800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:14.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3031530640 1 -- 172.21.15.55:0/2919594661 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301800c100 con 0x7f3018005190 2023-08-25T04:03:14.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3031530640 1 -- 172.21.15.55:0/2919594661 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301800c270 con 0x7f3018003980 2023-08-25T04:03:14.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.639+0000 7f3031530640 1 -- 172.21.15.55:0/2919594661 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301800c430 con 0x7f30180047d0 2023-08-25T04:03:14.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.643+0000 7f3032d33640 1 --2- 172.21.15.55:0/2919594661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3018005190 0x7f301800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:14.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.643+0000 7f3032532640 1 --2- 172.21.15.55:0/2919594661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3018003980 0x7f3018003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:14.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.643+0000 7f3031d31640 1 --2- 172.21.15.55:0/2919594661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30180047d0 0x7f3018004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.643+0000 7f3032d33640 1 -- 172.21.15.55:0/2919594661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30180047d0 msgr2=0x7f3018004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.643+0000 7f3032d33640 1 --2- 172.21.15.55:0/2919594661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30180047d0 0x7f3018004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.643+0000 7f3032d33640 1 -- 172.21.15.55:0/2919594661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3018003980 msgr2=0x7f3018003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.643+0000 7f3032d33640 1 --2- 172.21.15.55:0/2919594661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3018003980 0x7f3018003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.643+0000 7f3032d33640 1 -- 172.21.15.55:0/2919594661 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018003530 con 0x7f3018005190 2023-08-25T04:03:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.643+0000 7f3032d33640 1 -- 172.21.15.55:0/2919594661 reap_dead start 2023-08-25T04:03:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.643+0000 7f3032d33640 1 --2- 172.21.15.55:0/2919594661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3018005190 0x7f301800b990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f302400a830 tx=0x7f302401faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7707e93974de115 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.643+0000 7f3031530640 1 -- 172.21.15.55:0/2919594661 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30240aa6d0 con 0x7f3018005190 2023-08-25T04:03:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.643+0000 7f3031530640 1 -- 172.21.15.55:0/2919594661 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30240aa870 con 0x7f3018005190 2023-08-25T04:03:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.643+0000 7f3031530640 1 -- 172.21.15.55:0/2919594661 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30240aac20 con 0x7f3018005190 2023-08-25T04:03:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3034796640 1 -- 172.21.15.55:0/2919594661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3018005190 msgr2=0x7f301800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3034796640 1 --2- 172.21.15.55:0/2919594661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3018005190 0x7f301800b990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f302400a830 tx=0x7f302401faa0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3034796640 1 -- 172.21.15.55:0/2919594661 shutdown_connections 2023-08-25T04:03:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3034796640 1 --2- 172.21.15.55:0/2919594661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3018005190 0x7f301800b990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3034796640 1 -- 172.21.15.55:0/2919594661 >> 172.21.15.55:0/2919594661 conn(0x7f302c0d27d0 msgr2=0x7f302c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3034796640 1 -- 172.21.15.55:0/2919594661 shutdown_connections 2023-08-25T04:03:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3034796640 1 -- 172.21.15.55:0/2919594661 wait complete. 2023-08-25T04:03:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3034796640 1 Processor -- start 2023-08-25T04:03:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3034796640 1 -- start start 2023-08-25T04:03:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3034796640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3018005190 0x7f302c158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3034796640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f302c159180 0x7f302c0cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3034796640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f302c0b5e10 0x7f302c0ce160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3034796640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302c158ed0 con 0x7f302c0b5e10 2023-08-25T04:03:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3034796640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302c0b53c0 con 0x7f3018005190 2023-08-25T04:03:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3034796640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302c0cc6e0 con 0x7f302c159180 2023-08-25T04:03:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3032d33640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f302c0b5e10 0x7f302c0ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3032d33640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f302c0b5e10 0x7f302c0ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59906/0 (socket says 172.21.15.55:59906) 2023-08-25T04:03:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3032d33640 1 -- 172.21.15.55:0/2560112480 learned_addr learned my addr 172.21.15.55:0/2560112480 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3032532640 1 --2- 172.21.15.55:0/2560112480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3018005190 0x7f302c158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3031d31640 1 --2- 172.21.15.55:0/2560112480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f302c159180 0x7f302c0cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3032d33640 1 -- 172.21.15.55:0/2560112480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f302c159180 msgr2=0x7f302c0cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3032d33640 1 --2- 172.21.15.55:0/2560112480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f302c159180 0x7f302c0cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3032d33640 1 -- 172.21.15.55:0/2560112480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3018005190 msgr2=0x7f302c158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3032d33640 1 --2- 172.21.15.55:0/2560112480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3018005190 0x7f302c158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3032d33640 1 -- 172.21.15.55:0/2560112480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c0cb810 con 0x7f302c0b5e10 2023-08-25T04:03:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.647+0000 7f3032d33640 1 --2- 172.21.15.55:0/2560112480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f302c0b5e10 0x7f302c0ce160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3024007040 tx=0x7f3018005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.651+0000 7f3022ffd640 1 -- 172.21.15.55:0/2560112480 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30240aa6d0 con 0x7f302c0b5e10 2023-08-25T04:03:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.651+0000 7f3022ffd640 1 -- 172.21.15.55:0/2560112480 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3024001be0 con 0x7f302c0b5e10 2023-08-25T04:03:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.651+0000 7f3034796640 1 -- 172.21.15.55:0/2560112480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302c0cbaf0 con 0x7f302c0b5e10 2023-08-25T04:03:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.651+0000 7f3022ffd640 1 -- 172.21.15.55:0/2560112480 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024004b70 con 0x7f302c0b5e10 2023-08-25T04:03:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.651+0000 7f3034796640 1 -- 172.21.15.55:0/2560112480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302c0b5610 con 0x7f302c0b5e10 2023-08-25T04:03:14.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.651+0000 7f3034796640 1 -- 172.21.15.55:0/2560112480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302c073ec0 con 0x7f302c0b5e10 2023-08-25T04:03:14.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.651+0000 7f3022ffd640 1 -- 172.21.15.55:0/2560112480 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f3024004cd0 con 0x7f302c0b5e10 2023-08-25T04:03:14.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.651+0000 7f3022ffd640 1 --2- 172.21.15.55:0/2560112480 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3010065680 0x7f3010067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:14.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.651+0000 7f3022ffd640 1 -- 172.21.15.55:0/2560112480 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3024120570 con 0x7f302c0b5e10 2023-08-25T04:03:14.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.651+0000 7f3032532640 1 --2- 172.21.15.55:0/2560112480 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3010065680 0x7f3010067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:14.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.655+0000 7f3032532640 1 --2- 172.21.15.55:0/2560112480 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3010065680 0x7f3010067b40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3028000c10 tx=0x7f3028009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:14.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.655+0000 7f3022ffd640 1 -- 172.21.15.55:0/2560112480 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f30240ee010 con 0x7f302c0b5e10 2023-08-25T04:03:14.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.811+0000 7f3034796640 1 -- 172.21.15.55:0/2560112480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f302c0b40a0 con 0x7f302c0b5e10 2023-08-25T04:03:14.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.811+0000 7f3022ffd640 1 -- 172.21.15.55:0/2560112480 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f30240f1630 con 0x7f302c0b5e10 2023-08-25T04:03:14.815 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:03:14.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.815+0000 7f3034796640 1 -- 172.21.15.55:0/2560112480 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3010065680 msgr2=0x7f3010067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:14.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.815+0000 7f3034796640 1 --2- 172.21.15.55:0/2560112480 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3010065680 0x7f3010067b40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3028000c10 tx=0x7f3028009040 comp rx=0 tx=0).stop 2023-08-25T04:03:14.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.815+0000 7f3034796640 1 -- 172.21.15.55:0/2560112480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f302c0b5e10 msgr2=0x7f302c0ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:14.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.815+0000 7f3034796640 1 --2- 172.21.15.55:0/2560112480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f302c0b5e10 0x7f302c0ce160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3024007040 tx=0x7f3018005800 comp rx=0 tx=0).stop 2023-08-25T04:03:14.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.815+0000 7f3034796640 1 -- 172.21.15.55:0/2560112480 shutdown_connections 2023-08-25T04:03:14.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.815+0000 7f3034796640 1 --2- 172.21.15.55:0/2560112480 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3010065680 0x7f3010067b40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.815+0000 7f3034796640 1 --2- 172.21.15.55:0/2560112480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f302c0b5e10 0x7f302c0ce160 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.815+0000 7f3034796640 1 --2- 172.21.15.55:0/2560112480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f302c159180 0x7f302c0cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.815+0000 7f3034796640 1 --2- 172.21.15.55:0/2560112480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3018005190 0x7f302c158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.815+0000 7f3034796640 1 -- 172.21.15.55:0/2560112480 >> 172.21.15.55:0/2560112480 conn(0x7f302c0d27d0 msgr2=0x7f302c06c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:14.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.815+0000 7f3034796640 1 -- 172.21.15.55:0/2560112480 shutdown_connections 2023-08-25T04:03:14.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.815+0000 7f3034796640 1 -- 172.21.15.55:0/2560112480 wait complete. 2023-08-25T04:03:14.835 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:03:14.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.979+0000 7f51b2120640 1 Processor -- start 2023-08-25T04:03:14.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.979+0000 7f51b2120640 1 -- start start 2023-08-25T04:03:14.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.979+0000 7f51b2120640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51ac0cfc90 0x7f51ac0b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:14.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.979+0000 7f51b2120640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51ac0b8330 0x7f51ac0b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:14.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.979+0000 7f51b2120640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ac0b70c0 con 0x7f51ac15fca0 2023-08-25T04:03:14.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.979+0000 7f51b2120640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ac160080 con 0x7f51ac0b8330 2023-08-25T04:03:14.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.979+0000 7f51b2120640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac0b73a0 con 0x7f51ac0cfc90 2023-08-25T04:03:14.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.979+0000 7f51b111e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f51ac15fca0 0x7f51ac0cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50614/0 (socket says 172.21.15.55:50614) 2023-08-25T04:03:14.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.979+0000 7f51b111e640 1 -- 172.21.15.55:0/1961956112 learned_addr learned my addr 172.21.15.55:0/1961956112 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:14.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.979+0000 7f51b191f640 1 --2- 172.21.15.55:0/1961956112 >> v2:172.21.15.55:3300/0 conn(0x7f51ac0b8330 0x7f51ac0b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:14.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.979+0000 7f51b091d640 1 --2- 172.21.15.55:0/1961956112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51ac0cfc90 0x7f51ac0b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:14.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.983+0000 7f51b191f640 1 -- 172.21.15.55:0/1961956112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51ac0cfc90 msgr2=0x7f51ac0b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:14.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.983+0000 7f51b191f640 1 --2- 172.21.15.55:0/1961956112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51ac0cfc90 0x7f51ac0b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:14.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.983+0000 7f51b191f640 1 -- 172.21.15.55:0/1961956112 >> v1:172.21.15.55:6789/0 conn(0x7f51ac15fca0 legacy=0x7f51ac0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:14.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.983+0000 7f51a3fff640 1 -- 172.21.15.55:0/1961956112 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500241131 0 0) 0x7f51ac0b70c0 con 0x7f51ac15fca0 2023-08-25T04:03:14.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.983+0000 7f51b191f640 1 -- 172.21.15.55:0/1961956112 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac0b7680 con 0x7f51ac0b8330 2023-08-25T04:03:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.983+0000 7f51b191f640 1 --2- 172.21.15.55:0/1961956112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ac0b8330 0x7f51ac0b5b10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009d90 tx=0x7f51a401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba1b4941c2742f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:15.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.983+0000 7f51a3fff640 1 -- 172.21.15.55:0/1961956112 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a40af600 con 0x7f51ac0b8330 2023-08-25T04:03:15.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.983+0000 7f51a3fff640 1 -- 172.21.15.55:0/1961956112 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a40ab050 con 0x7f51ac0b8330 2023-08-25T04:03:15.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.983+0000 7f51a3fff640 1 -- 172.21.15.55:0/1961956112 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a40af980 con 0x7f51ac0b8330 2023-08-25T04:03:15.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.983+0000 7f51b2120640 1 -- 172.21.15.55:0/1961956112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ac0b8330 msgr2=0x7f51ac0b5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:15.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.983+0000 7f51b2120640 1 --2- 172.21.15.55:0/1961956112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ac0b8330 0x7f51ac0b5b10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f51a4009d90 tx=0x7f51a401f130 comp rx=0 tx=0).stop 2023-08-25T04:03:15.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.983+0000 7f51b2120640 1 -- 172.21.15.55:0/1961956112 shutdown_connections 2023-08-25T04:03:15.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.983+0000 7f51b2120640 1 --2- 172.21.15.55:0/1961956112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51ac0cfc90 0x7f51ac0b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.983+0000 7f51b2120640 1 --2- 172.21.15.55:0/1961956112 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ac0b8330 0x7f51ac0b5b10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.983+0000 7f51b2120640 1 -- 172.21.15.55:0/1961956112 >> 172.21.15.55:0/1961956112 conn(0x7f51ac0658c0 msgr2=0x7f51ac065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:15.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b2120640 1 -- 172.21.15.55:0/1961956112 shutdown_connections 2023-08-25T04:03:15.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b2120640 1 -- 172.21.15.55:0/1961956112 wait complete. 2023-08-25T04:03:15.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b2120640 1 Processor -- start 2023-08-25T04:03:15.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b2120640 1 -- start start 2023-08-25T04:03:15.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b2120640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51ac0b8330 0x7f51ac148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:15.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b2120640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51ac0cfc90 0x7f51ac157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b2120640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ac15fca0 0x7f51ac159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b2120640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac0c65b0 con 0x7f51ac15fca0 2023-08-25T04:03:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b2120640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac0c6890 con 0x7f51ac0cfc90 2023-08-25T04:03:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b2120640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac0c6b70 con 0x7f51ac0b8330 2023-08-25T04:03:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b191f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ac15fca0 0x7f51ac159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b191f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ac15fca0 0x7f51ac159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59936/0 (socket says 172.21.15.55:59936) 2023-08-25T04:03:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b191f640 1 -- 172.21.15.55:0/1974085796 learned_addr learned my addr 172.21.15.55:0/1974085796 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b091d640 1 --2- 172.21.15.55:0/1974085796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51ac0cfc90 0x7f51ac157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b111e640 1 --2- 172.21.15.55:0/1974085796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51ac0b8330 0x7f51ac148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b191f640 1 -- 172.21.15.55:0/1974085796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51ac0b8330 msgr2=0x7f51ac148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b191f640 1 --2- 172.21.15.55:0/1974085796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51ac0b8330 0x7f51ac148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b191f640 1 -- 172.21.15.55:0/1974085796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51ac0cfc90 msgr2=0x7f51ac157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b191f640 1 --2- 172.21.15.55:0/1974085796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51ac0cfc90 0x7f51ac157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b191f640 1 -- 172.21.15.55:0/1974085796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a4009a70 con 0x7f51ac15fca0 2023-08-25T04:03:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.987+0000 7f51b191f640 1 --2- 172.21.15.55:0/1974085796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ac15fca0 0x7f51ac159b90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f51a401d7e0 tx=0x7f51a401bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:15.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.991+0000 7f51a1ffb640 1 -- 172.21.15.55:0/1974085796 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a4009450 con 0x7f51ac15fca0 2023-08-25T04:03:15.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.991+0000 7f51a1ffb640 1 -- 172.21.15.55:0/1974085796 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a40039a0 con 0x7f51ac15fca0 2023-08-25T04:03:15.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.991+0000 7f51a1ffb640 1 -- 172.21.15.55:0/1974085796 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a4003d10 con 0x7f51ac15fca0 2023-08-25T04:03:15.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.991+0000 7f51b2120640 1 -- 172.21.15.55:0/1974085796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ac0c6e50 con 0x7f51ac15fca0 2023-08-25T04:03:15.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.991+0000 7f51b2120640 1 -- 172.21.15.55:0/1974085796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac0c6120 con 0x7f51ac15fca0 2023-08-25T04:03:15.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.991+0000 7f51b2120640 1 -- 172.21.15.55:0/1974085796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ac073e50 con 0x7f51ac15fca0 2023-08-25T04:03:15.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.991+0000 7f51a1ffb640 1 -- 172.21.15.55:0/1974085796 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f51a4004030 con 0x7f51ac15fca0 2023-08-25T04:03:15.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.991+0000 7f51a1ffb640 1 --2- 172.21.15.55:0/1974085796 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5190065680 0x7f5190067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:15.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.991+0000 7f51a1ffb640 1 -- 172.21.15.55:0/1974085796 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51a4121680 con 0x7f51ac15fca0 2023-08-25T04:03:15.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.991+0000 7f51b111e640 1 --2- 172.21.15.55:0/1974085796 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5190065680 0x7f5190067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:15.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.995+0000 7f51b111e640 1 --2- 172.21.15.55:0/1974085796 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5190065680 0x7f5190067b40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f51a8000f70 tx=0x7f51a8007df0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:15.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:14.995+0000 7f51a1ffb640 1 -- 172.21.15.55:0/1974085796 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f51a40ef270 con 0x7f51ac15fca0 2023-08-25T04:03:15.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.151+0000 7f51b2120640 1 -- 172.21.15.55:0/1974085796 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f51ac154110 con 0x7f51ac15fca0 2023-08-25T04:03:15.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.151+0000 7f51a1ffb640 1 -- 172.21.15.55:0/1974085796 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f51a40f2890 con 0x7f51ac15fca0 2023-08-25T04:03:15.158 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:03:15.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.155+0000 7f51b2120640 1 -- 172.21.15.55:0/1974085796 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5190065680 msgr2=0x7f5190067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:15.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.155+0000 7f51b2120640 1 --2- 172.21.15.55:0/1974085796 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5190065680 0x7f5190067b40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f51a8000f70 tx=0x7f51a8007df0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.155+0000 7f51b2120640 1 -- 172.21.15.55:0/1974085796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ac15fca0 msgr2=0x7f51ac159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:15.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.155+0000 7f51b2120640 1 --2- 172.21.15.55:0/1974085796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ac15fca0 0x7f51ac159b90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f51a401d7e0 tx=0x7f51a401bed0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.155+0000 7f51b2120640 1 -- 172.21.15.55:0/1974085796 shutdown_connections 2023-08-25T04:03:15.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.155+0000 7f51b2120640 1 --2- 172.21.15.55:0/1974085796 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5190065680 0x7f5190067b40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.155+0000 7f51b2120640 1 --2- 172.21.15.55:0/1974085796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ac15fca0 0x7f51ac159b90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.155+0000 7f51b2120640 1 --2- 172.21.15.55:0/1974085796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51ac0cfc90 0x7f51ac157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.155+0000 7f51b2120640 1 --2- 172.21.15.55:0/1974085796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51ac0b8330 0x7f51ac148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.155+0000 7f51b2120640 1 -- 172.21.15.55:0/1974085796 >> 172.21.15.55:0/1974085796 conn(0x7f51ac0658c0 msgr2=0x7f51ac156e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:15.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.155+0000 7f51b2120640 1 -- 172.21.15.55:0/1974085796 shutdown_connections 2023-08-25T04:03:15.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.155+0000 7f51b2120640 1 -- 172.21.15.55:0/1974085796 wait complete. 2023-08-25T04:03:15.175 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:03:15.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.315+0000 7f80d869c640 1 Processor -- start 2023-08-25T04:03:15.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.315+0000 7f80d869c640 1 -- start start 2023-08-25T04:03:15.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.319+0000 7f80d869c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80d015c9c0 0x7f80d0160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:15.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.319+0000 7f80d869c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80d00cfa70 0x7f80d0160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:15.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.319+0000 7f80d869c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f80d0160f90 0x7f80d00ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:15.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.319+0000 7f80d869c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d006eaf0 con 0x7f80d015c9c0 2023-08-25T04:03:15.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.319+0000 7f80d869c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d006e530 con 0x7f80d0160f90 2023-08-25T04:03:15.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.319+0000 7f80d869c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d006e810 con 0x7f80d00cfa70 2023-08-25T04:03:15.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.319+0000 7f80d6438640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80d015c9c0 0x7f80d0160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:15.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.319+0000 7f80d6438640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80d015c9c0 0x7f80d0160510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59948/0 (socket says 172.21.15.55:59948) 2023-08-25T04:03:15.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.319+0000 7f80d6438640 1 -- 172.21.15.55:0/1161219535 learned_addr learned my addr 172.21.15.55:0/1161219535 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:15.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.319+0000 7f80d6438640 1 -- 172.21.15.55:0/1161219535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80d00cfa70 msgr2=0x7f80d0160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:15.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.319+0000 7f80d5c37640 1 --2- 172.21.15.55:0/1161219535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80d00cfa70 0x7f80d0160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:15.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.319+0000 7f80d6c39640 1 --2- 172.21.15.55:0/1161219535 >> v2:172.21.15.110:3300/0 conn(0x7f80d0160f90 0x7f80d00ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:15.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.319+0000 7f80d6438640 1 --2- 172.21.15.55:0/1161219535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80d00cfa70 0x7f80d0160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.319+0000 7f80d6438640 1 -- 172.21.15.55:0/1161219535 >> v2:172.21.15.110:3300/0 conn(0x7f80d0160f90 msgr2=0x7f80d00ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:15.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.319+0000 7f80d6438640 1 --2- 172.21.15.55:0/1161219535 >> v2:172.21.15.110:3300/0 conn(0x7f80d0160f90 0x7f80d00ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.319+0000 7f80d6438640 1 -- 172.21.15.55:0/1161219535 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d006aab0 con 0x7f80d015c9c0 2023-08-25T04:03:15.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.319+0000 7f80d5c37640 1 --2- 172.21.15.55:0/1161219535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80d00cfa70 0x7f80d0160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:15.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.319+0000 7f80d6c39640 1 --2- 172.21.15.55:0/1161219535 >> v2:172.21.15.110:3300/0 conn(0x7f80d0160f90 0x7f80d00ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:15.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.323+0000 7f80d6438640 1 --2- 172.21.15.55:0/1161219535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d015c9c0 0x7f80d0160510 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f80d00c4080 tx=0x7f80cc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0772ba1ddd0a47 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:15.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.323+0000 7f80d5436640 1 -- 172.21.15.55:0/1161219535 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0ac600 con 0x7f80d015c9c0 2023-08-25T04:03:15.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.323+0000 7f80d5436640 1 -- 172.21.15.55:0/1161219535 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80cc0a8050 con 0x7f80d015c9c0 2023-08-25T04:03:15.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.323+0000 7f80d5436640 1 -- 172.21.15.55:0/1161219535 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0ac980 con 0x7f80d015c9c0 2023-08-25T04:03:15.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.323+0000 7f80d869c640 1 -- 172.21.15.55:0/1161219535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d015c9c0 msgr2=0x7f80d0160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:15.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.323+0000 7f80d869c640 1 --2- 172.21.15.55:0/1161219535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d015c9c0 0x7f80d0160510 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f80d00c4080 tx=0x7f80cc01c4d0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.323+0000 7f80d869c640 1 -- 172.21.15.55:0/1161219535 shutdown_connections 2023-08-25T04:03:15.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.323+0000 7f80d869c640 1 --2- 172.21.15.55:0/1161219535 >> v2:172.21.15.110:3300/0 conn(0x7f80d0160f90 0x7f80d00ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.323+0000 7f80d869c640 1 --2- 172.21.15.55:0/1161219535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80d00cfa70 0x7f80d0160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.323+0000 7f80d869c640 1 --2- 172.21.15.55:0/1161219535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d015c9c0 0x7f80d0160510 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.323+0000 7f80d869c640 1 -- 172.21.15.55:0/1161219535 >> 172.21.15.55:0/1161219535 conn(0x7f80d00d05a0 msgr2=0x7f80d00d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:15.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.323+0000 7f80d869c640 1 -- 172.21.15.55:0/1161219535 shutdown_connections 2023-08-25T04:03:15.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.323+0000 7f80d869c640 1 -- 172.21.15.55:0/1161219535 wait complete. 2023-08-25T04:03:15.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.323+0000 7f80d869c640 1 Processor -- start 2023-08-25T04:03:15.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.323+0000 7f80d869c640 1 -- start start 2023-08-25T04:03:15.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d869c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80d00cfa70 0x7f80d014b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d869c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d015c9c0 0x7f80d015b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d869c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80d0160f90 0x7f80d00c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d869c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d014e790 con 0x7f80d015c9c0 2023-08-25T04:03:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d869c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d014b580 con 0x7f80d00cfa70 2023-08-25T04:03:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d869c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d014db80 con 0x7f80d0160f90 2023-08-25T04:03:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d5c37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d015c9c0 0x7f80d015b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d5c37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d015c9c0 0x7f80d015b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59954/0 (socket says 172.21.15.55:59954) 2023-08-25T04:03:15.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d5c37640 1 -- 172.21.15.55:0/4212553509 learned_addr learned my addr 172.21.15.55:0/4212553509 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:15.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d6438640 1 --2- 172.21.15.55:0/4212553509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80d00cfa70 0x7f80d014b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:15.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d6c39640 1 --2- 172.21.15.55:0/4212553509 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80d0160f90 0x7f80d00c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:15.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d5c37640 1 -- 172.21.15.55:0/4212553509 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80d0160f90 msgr2=0x7f80d00c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:15.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d5c37640 1 --2- 172.21.15.55:0/4212553509 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80d0160f90 0x7f80d00c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d5c37640 1 -- 172.21.15.55:0/4212553509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80d00cfa70 msgr2=0x7f80d014b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:15.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d5c37640 1 --2- 172.21.15.55:0/4212553509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80d00cfa70 0x7f80d014b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d5c37640 1 -- 172.21.15.55:0/4212553509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc009480 con 0x7f80d015c9c0 2023-08-25T04:03:15.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d5c37640 1 --2- 172.21.15.55:0/4212553509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d015c9c0 0x7f80d015b6d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f80c000c820 tx=0x7f80c000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:15.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80c6ffd640 1 -- 172.21.15.55:0/4212553509 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c0007a30 con 0x7f80d015c9c0 2023-08-25T04:03:15.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80c6ffd640 1 -- 172.21.15.55:0/4212553509 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c0007b90 con 0x7f80d015c9c0 2023-08-25T04:03:15.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80c6ffd640 1 -- 172.21.15.55:0/4212553509 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c00113f0 con 0x7f80d015c9c0 2023-08-25T04:03:15.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d869c640 1 -- 172.21.15.55:0/4212553509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d014de60 con 0x7f80d015c9c0 2023-08-25T04:03:15.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.327+0000 7f80d869c640 1 -- 172.21.15.55:0/4212553509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d014e420 con 0x7f80d015c9c0 2023-08-25T04:03:15.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.331+0000 7f80d869c640 1 -- 172.21.15.55:0/4212553509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d004dbe0 con 0x7f80d015c9c0 2023-08-25T04:03:15.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.331+0000 7f80c6ffd640 1 -- 172.21.15.55:0/4212553509 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f80c0011550 con 0x7f80d015c9c0 2023-08-25T04:03:15.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.331+0000 7f80c6ffd640 1 --2- 172.21.15.55:0/4212553509 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f80b4065680 0x7f80b4067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:15.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.331+0000 7f80c6ffd640 1 -- 172.21.15.55:0/4212553509 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f80c0082f60 con 0x7f80d015c9c0 2023-08-25T04:03:15.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.331+0000 7f80d6438640 1 --2- 172.21.15.55:0/4212553509 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f80b4065680 0x7f80b4067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:15.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.331+0000 7f80d6438640 1 --2- 172.21.15.55:0/4212553509 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f80b4065680 0x7f80b4067b40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0ae000 tx=0x7f80cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:15.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.335+0000 7f80c6ffd640 1 -- 172.21.15.55:0/4212553509 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f80c0050a30 con 0x7f80d015c9c0 2023-08-25T04:03:15.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.527+0000 7f80d869c640 1 -- 172.21.15.55:0/4212553509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80d00cdc20 con 0x7f80d015c9c0 2023-08-25T04:03:15.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.527+0000 7f80c6ffd640 1 -- 172.21.15.55:0/4212553509 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4875 (secure 0 0 0) 0x7f80c0054050 con 0x7f80d015c9c0 2023-08-25T04:03:15.529 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:15.529 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3370778281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3370778281},{"type":"v1","addr":"172.21.15.55:6835","nonce":3370778281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/2321139789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2321139789},{"type":"v1","addr":"172.21.15.110:6837","nonce":2321139789}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3825401605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3825401605},{"type":"v1","addr":"172.21.15.110:6836","nonce":3825401605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:03:01.098486+0000","modified":"2023-08-25T04:03:04.724648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/2606103809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2606103809},{"type":"v1","addr":"172.21.15.55:6834","nonce":2606103809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:03:15.530 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2023-08-25T04:03:15.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.527+0000 7f80d869c640 1 -- 172.21.15.55:0/4212553509 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f80b4065680 msgr2=0x7f80b4067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:15.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.527+0000 7f80d869c640 1 --2- 172.21.15.55:0/4212553509 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f80b4065680 0x7f80b4067b40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0ae000 tx=0x7f80cc008040 comp rx=0 tx=0).stop 2023-08-25T04:03:15.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.527+0000 7f80d869c640 1 -- 172.21.15.55:0/4212553509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d015c9c0 msgr2=0x7f80d015b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:15.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.527+0000 7f80d869c640 1 --2- 172.21.15.55:0/4212553509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d015c9c0 0x7f80d015b6d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f80c000c820 tx=0x7f80c000cce0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.527+0000 7f80d869c640 1 -- 172.21.15.55:0/4212553509 shutdown_connections 2023-08-25T04:03:15.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.527+0000 7f80d869c640 1 --2- 172.21.15.55:0/4212553509 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f80b4065680 0x7f80b4067b40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.527+0000 7f80d869c640 1 --2- 172.21.15.55:0/4212553509 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80d0160f90 0x7f80d00c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.527+0000 7f80d869c640 1 --2- 172.21.15.55:0/4212553509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d015c9c0 0x7f80d015b6d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.527+0000 7f80d869c640 1 --2- 172.21.15.55:0/4212553509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80d00cfa70 0x7f80d014b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.527+0000 7f80d869c640 1 -- 172.21.15.55:0/4212553509 >> 172.21.15.55:0/4212553509 conn(0x7f80d00d05a0 msgr2=0x7f80d00af420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.527+0000 7f80d869c640 1 -- 172.21.15.55:0/4212553509 shutdown_connections 2023-08-25T04:03:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.527+0000 7f80d869c640 1 -- 172.21.15.55:0/4212553509 wait complete. 2023-08-25T04:03:15.551 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:15.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.695+0000 7f02a0f82640 1 Processor -- start 2023-08-25T04:03:15.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.695+0000 7f02a0f82640 1 -- start start 2023-08-25T04:03:15.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.695+0000 7f02a0f82640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f029c0cdde0 0x7f029c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:15.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.695+0000 7f02a0f82640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f029c0b2e40 0x7f029c0b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:15.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.695+0000 7f02a0f82640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029c0b29b0 con 0x7f029c0d0da0 2023-08-25T04:03:15.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.695+0000 7f02a0f82640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029c0ce760 con 0x7f029c0cdde0 2023-08-25T04:03:15.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.695+0000 7f02a0f82640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029c0b1dc0 con 0x7f029c0b2e40 2023-08-25T04:03:15.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.695+0000 7f0291d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f029c0cdde0 0x7f029c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:15.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.695+0000 7f0291d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f029c0cdde0 0x7f029c0ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59968/0 (socket says 172.21.15.55:59968) 2023-08-25T04:03:15.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.695+0000 7f029a59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f029c0d0da0 0x7f029c0d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50616/0 (socket says 172.21.15.55:50616) 2023-08-25T04:03:15.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.695+0000 7f0291d9b640 1 -- 172.21.15.55:0/2700594111 learned_addr learned my addr 172.21.15.55:0/2700594111 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:15.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.695+0000 7f029ad9d640 1 --2- 172.21.15.55:0/2700594111 >> v2:172.21.15.110:3300/0 conn(0x7f029c0b2e40 0x7f029c0b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:15.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.695+0000 7f0291d9b640 1 -- 172.21.15.55:0/2700594111 >> v2:172.21.15.110:3300/0 conn(0x7f029c0b2e40 msgr2=0x7f029c0b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:15.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.695+0000 7f0291d9b640 1 --2- 172.21.15.55:0/2700594111 >> v2:172.21.15.110:3300/0 conn(0x7f029c0b2e40 0x7f029c0b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.695+0000 7f0291d9b640 1 -- 172.21.15.55:0/2700594111 >> v1:172.21.15.55:6789/0 conn(0x7f029c0d0da0 legacy=0x7f029c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:15.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.695+0000 7f0291d9b640 1 -- 172.21.15.55:0/2700594111 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c0b2080 con 0x7f029c0cdde0 2023-08-25T04:03:15.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.699+0000 7f0291d9b640 1 --2- 172.21.15.55:0/2700594111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029c0cdde0 0x7f029c0ce220 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f029c0ceae0 tx=0x7f028401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829382493a515595 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:15.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.699+0000 7f0299d9b640 1 -- 172.21.15.55:0/2700594111 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02840a89f0 con 0x7f029c0cdde0 2023-08-25T04:03:15.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.699+0000 7f0299d9b640 1 -- 172.21.15.55:0/2700594111 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02840a8b50 con 0x7f029c0cdde0 2023-08-25T04:03:15.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.699+0000 7f0299d9b640 1 -- 172.21.15.55:0/2700594111 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02840b0440 con 0x7f029c0cdde0 2023-08-25T04:03:15.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.699+0000 7f02a0f82640 1 -- 172.21.15.55:0/2700594111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029c0cdde0 msgr2=0x7f029c0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:15.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.699+0000 7f02a0f82640 1 --2- 172.21.15.55:0/2700594111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029c0cdde0 0x7f029c0ce220 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f029c0ceae0 tx=0x7f028401ecf0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.699+0000 7f02a0f82640 1 -- 172.21.15.55:0/2700594111 shutdown_connections 2023-08-25T04:03:15.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.699+0000 7f02a0f82640 1 --2- 172.21.15.55:0/2700594111 >> v2:172.21.15.110:3300/0 conn(0x7f029c0b2e40 0x7f029c0b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.699+0000 7f02a0f82640 1 --2- 172.21.15.55:0/2700594111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029c0cdde0 0x7f029c0ce220 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.699+0000 7f02a0f82640 1 -- 172.21.15.55:0/2700594111 >> 172.21.15.55:0/2700594111 conn(0x7f029c09bae0 msgr2=0x7f029c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:15.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.699+0000 7f02a0f82640 1 -- 172.21.15.55:0/2700594111 shutdown_connections 2023-08-25T04:03:15.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.699+0000 7f02a0f82640 1 -- 172.21.15.55:0/2700594111 wait complete. 2023-08-25T04:03:15.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f02a0f82640 1 Processor -- start 2023-08-25T04:03:15.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f02a0f82640 1 -- start start 2023-08-25T04:03:15.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f02a0f82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029c0b2e40 0x7f029c15e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:15.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f02a0f82640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f029c0cdde0 0x7f029c15e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:15.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f02a0f82640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f029c0d0da0 0x7f029c0c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:15.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f02a0f82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c15ecb0 con 0x7f029c0b2e40 2023-08-25T04:03:15.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f02a0f82640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c15eef0 con 0x7f029c0d0da0 2023-08-25T04:03:15.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f02a0f82640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c15f1d0 con 0x7f029c0cdde0 2023-08-25T04:03:15.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f029a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029c0b2e40 0x7f029c15e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:15.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f029a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029c0b2e40 0x7f029c15e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59972/0 (socket says 172.21.15.55:59972) 2023-08-25T04:03:15.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f029a59c640 1 -- 172.21.15.55:0/104165380 learned_addr learned my addr 172.21.15.55:0/104165380 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:15.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f029ad9d640 1 --2- 172.21.15.55:0/104165380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f029c0d0da0 0x7f029c0c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:15.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f0291d9b640 1 --2- 172.21.15.55:0/104165380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f029c0cdde0 0x7f029c15e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:15.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f029a59c640 1 -- 172.21.15.55:0/104165380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f029c0cdde0 msgr2=0x7f029c15e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:15.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f029a59c640 1 --2- 172.21.15.55:0/104165380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f029c0cdde0 0x7f029c15e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f029a59c640 1 -- 172.21.15.55:0/104165380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f029c0d0da0 msgr2=0x7f029c0c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:15.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f029a59c640 1 --2- 172.21.15.55:0/104165380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f029c0d0da0 0x7f029c0c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f029a59c640 1 -- 172.21.15.55:0/104165380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02840094d0 con 0x7f029c0b2e40 2023-08-25T04:03:15.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f0291d9b640 1 --2- 172.21.15.55:0/104165380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f029c0cdde0 0x7f029c15e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:15.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f029ad9d640 1 --2- 172.21.15.55:0/104165380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f029c0d0da0 0x7f029c0c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:15.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f029a59c640 1 --2- 172.21.15.55:0/104165380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029c0b2e40 0x7f029c15e230 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f028c00c7a0 tx=0x7f028c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:15.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f02937fe640 1 -- 172.21.15.55:0/104165380 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c00a640 con 0x7f029c0b2e40 2023-08-25T04:03:15.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f02937fe640 1 -- 172.21.15.55:0/104165380 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028c00a7a0 con 0x7f029c0b2e40 2023-08-25T04:03:15.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f02937fe640 1 -- 172.21.15.55:0/104165380 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c00ab30 con 0x7f029c0b2e40 2023-08-25T04:03:15.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f02a0f82640 1 -- 172.21.15.55:0/104165380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029c15f4b0 con 0x7f029c0b2e40 2023-08-25T04:03:15.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.703+0000 7f02a0f82640 1 -- 172.21.15.55:0/104165380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029c15fa70 con 0x7f029c0b2e40 2023-08-25T04:03:15.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.707+0000 7f02a0f82640 1 -- 172.21.15.55:0/104165380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029c04dbe0 con 0x7f029c0b2e40 2023-08-25T04:03:15.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.707+0000 7f02937fe640 1 -- 172.21.15.55:0/104165380 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f028c00ac90 con 0x7f029c0b2e40 2023-08-25T04:03:15.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.707+0000 7f02937fe640 1 --2- 172.21.15.55:0/104165380 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f027c065680 0x7f027c067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:15.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.707+0000 7f02937fe640 1 -- 172.21.15.55:0/104165380 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f028c082680 con 0x7f029c0b2e40 2023-08-25T04:03:15.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.707+0000 7f0291d9b640 1 --2- 172.21.15.55:0/104165380 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f027c065680 0x7f027c067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:15.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.707+0000 7f0291d9b640 1 --2- 172.21.15.55:0/104165380 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f027c065680 0x7f027c067b40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f02840b2000 tx=0x7f0284008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:15.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.711+0000 7f02937fe640 1 -- 172.21.15.55:0/104165380 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f028c050130 con 0x7f029c0b2e40 2023-08-25T04:03:15.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.875+0000 7f02a0f82640 1 -- 172.21.15.55:0/104165380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f029c0d0b80 con 0x7f029c0b2e40 2023-08-25T04:03:15.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.875+0000 7f02937fe640 1 -- 172.21.15.55:0/104165380 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18291 (secure 0 0 0) 0x7f028c053750 con 0x7f029c0b2e40 2023-08-25T04:03:15.879 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:15.879 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:02.329010+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:15.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.879+0000 7f02a0f82640 1 -- 172.21.15.55:0/104165380 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f027c065680 msgr2=0x7f027c067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:15.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.879+0000 7f02a0f82640 1 --2- 172.21.15.55:0/104165380 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f027c065680 0x7f027c067b40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f02840b2000 tx=0x7f0284008040 comp rx=0 tx=0).stop 2023-08-25T04:03:15.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.879+0000 7f02a0f82640 1 -- 172.21.15.55:0/104165380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029c0b2e40 msgr2=0x7f029c15e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:15.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.879+0000 7f02a0f82640 1 --2- 172.21.15.55:0/104165380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029c0b2e40 0x7f029c15e230 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f028c00c7a0 tx=0x7f028c00cc60 comp rx=0 tx=0).stop 2023-08-25T04:03:15.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.879+0000 7f02a0f82640 1 -- 172.21.15.55:0/104165380 shutdown_connections 2023-08-25T04:03:15.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.879+0000 7f02a0f82640 1 --2- 172.21.15.55:0/104165380 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f027c065680 0x7f027c067b40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.879+0000 7f02a0f82640 1 --2- 172.21.15.55:0/104165380 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f029c0d0da0 0x7f029c0c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.879+0000 7f02a0f82640 1 --2- 172.21.15.55:0/104165380 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f029c0cdde0 0x7f029c15e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.879+0000 7f02a0f82640 1 --2- 172.21.15.55:0/104165380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029c0b2e40 0x7f029c15e230 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:15.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.879+0000 7f02a0f82640 1 -- 172.21.15.55:0/104165380 >> 172.21.15.55:0/104165380 conn(0x7f029c09bae0 msgr2=0x7f029c0cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:15.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.879+0000 7f02a0f82640 1 -- 172.21.15.55:0/104165380 shutdown_connections 2023-08-25T04:03:15.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:15.879+0000 7f02a0f82640 1 -- 172.21.15.55:0/104165380 wait complete. 2023-08-25T04:03:15.900 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:03:16.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.043+0000 7fa50c144640 1 Processor -- start 2023-08-25T04:03:16.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.043+0000 7fa50c144640 1 -- start start 2023-08-25T04:03:16.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.043+0000 7fa50c144640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa5040c1a80 0x7fa5040b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.043+0000 7fa50c144640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5040cddf0 0x7fa50406bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.043+0000 7fa50c144640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5040cc510 con 0x7fa504164410 2023-08-25T04:03:16.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.043+0000 7fa50c144640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5041647f0 con 0x7fa5040cddf0 2023-08-25T04:03:16.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.043+0000 7fa50c144640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5040cc9b0 con 0x7fa5040c1a80 2023-08-25T04:03:16.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.043+0000 7fa50a6e1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5040cddf0 0x7fa50406bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.043+0000 7fa50a6e1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5040cddf0 0x7fa50406bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59976/0 (socket says 172.21.15.55:59976) 2023-08-25T04:03:16.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.043+0000 7fa50a6e1640 1 -- 172.21.15.55:0/1028067440 learned_addr learned my addr 172.21.15.55:0/1028067440 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:16.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.043+0000 7fa5096df640 1 --2- 172.21.15.55:0/1028067440 >> v2:172.21.15.110:3300/0 conn(0x7fa5040c1a80 0x7fa5040b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.043+0000 7fa50a6e1640 1 -- 172.21.15.55:0/1028067440 >> v2:172.21.15.110:3300/0 conn(0x7fa5040c1a80 msgr2=0x7fa5040b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.043+0000 7fa50a6e1640 1 --2- 172.21.15.55:0/1028067440 >> v2:172.21.15.110:3300/0 conn(0x7fa5040c1a80 0x7fa5040b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.043+0000 7fa50a6e1640 1 -- 172.21.15.55:0/1028067440 >> v1:172.21.15.110:6789/0 conn(0x7fa504164410 legacy=0x7fa5040c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.043+0000 7fa50a6e1640 1 -- 172.21.15.55:0/1028067440 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5040ccc90 con 0x7fa5040cddf0 2023-08-25T04:03:16.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.043+0000 7fa5096df640 1 --2- 172.21.15.55:0/1028067440 >> v2:172.21.15.110:3300/0 conn(0x7fa5040c1a80 0x7fa5040b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:16.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.047+0000 7fa50a6e1640 1 --2- 172.21.15.55:0/1028067440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5040cddf0 0x7fa50406bb40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa5040cbe80 tx=0x7fa4fc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45012cfa8c5c7d4a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:16.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.047+0000 7fa508ede640 1 -- 172.21.15.55:0/1028067440 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0a5670 con 0x7fa5040cddf0 2023-08-25T04:03:16.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.047+0000 7fa508ede640 1 -- 172.21.15.55:0/1028067440 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc0a57d0 con 0x7fa5040cddf0 2023-08-25T04:03:16.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.047+0000 7fa508ede640 1 -- 172.21.15.55:0/1028067440 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc0a5b60 con 0x7fa5040cddf0 2023-08-25T04:03:16.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.047+0000 7fa50c144640 1 -- 172.21.15.55:0/1028067440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5040cddf0 msgr2=0x7fa50406bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:16.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.047+0000 7fa50c144640 1 --2- 172.21.15.55:0/1028067440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5040cddf0 0x7fa50406bb40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa5040cbe80 tx=0x7fa4fc01c9d0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.047+0000 7fa50c144640 1 -- 172.21.15.55:0/1028067440 shutdown_connections 2023-08-25T04:03:16.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.047+0000 7fa50c144640 1 --2- 172.21.15.55:0/1028067440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5040cddf0 0x7fa50406bb40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.047+0000 7fa50c144640 1 --2- 172.21.15.55:0/1028067440 >> v2:172.21.15.110:3300/0 conn(0x7fa5040c1a80 0x7fa5040b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.047+0000 7fa50c144640 1 -- 172.21.15.55:0/1028067440 >> 172.21.15.55:0/1028067440 conn(0x7fa504069d00 msgr2=0x7fa50406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:16.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.047+0000 7fa50c144640 1 -- 172.21.15.55:0/1028067440 shutdown_connections 2023-08-25T04:03:16.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.047+0000 7fa50c144640 1 -- 172.21.15.55:0/1028067440 wait complete. 2023-08-25T04:03:16.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.047+0000 7fa50c144640 1 Processor -- start 2023-08-25T04:03:16.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.047+0000 7fa50c144640 1 -- start start 2023-08-25T04:03:16.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa50c144640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5040c1a80 0x7fa5040c2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa50c144640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5040cddf0 0x7fa50415c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa50c144640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa504164410 0x7fa5040afe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa50c144640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5040c39b0 con 0x7fa5040cddf0 2023-08-25T04:03:16.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa50c144640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5040c2da0 con 0x7fa5040c1a80 2023-08-25T04:03:16.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa50c144640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5040c3080 con 0x7fa504164410 2023-08-25T04:03:16.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa5096df640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5040cddf0 0x7fa50415c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa5096df640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5040cddf0 0x7fa50415c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59992/0 (socket says 172.21.15.55:59992) 2023-08-25T04:03:16.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa5096df640 1 -- 172.21.15.55:0/1944209628 learned_addr learned my addr 172.21.15.55:0/1944209628 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:16.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa50a6e1640 1 --2- 172.21.15.55:0/1944209628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa504164410 0x7fa5040afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa509ee0640 1 --2- 172.21.15.55:0/1944209628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5040c1a80 0x7fa5040c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa5096df640 1 -- 172.21.15.55:0/1944209628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa504164410 msgr2=0x7fa5040afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:16.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa5096df640 1 --2- 172.21.15.55:0/1944209628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa504164410 0x7fa5040afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa5096df640 1 -- 172.21.15.55:0/1944209628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5040c1a80 msgr2=0x7fa5040c2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:16.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa5096df640 1 --2- 172.21.15.55:0/1944209628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5040c1a80 0x7fa5040c2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa5096df640 1 -- 172.21.15.55:0/1944209628 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc009b30 con 0x7fa5040cddf0 2023-08-25T04:03:16.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa509ee0640 1 --2- 172.21.15.55:0/1944209628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5040c1a80 0x7fa5040c2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:16.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa5096df640 1 --2- 172.21.15.55:0/1944209628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5040cddf0 0x7fa50415c3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400e810 tx=0x7fa4f400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:16.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa4fa7fc640 1 -- 172.21.15.55:0/1944209628 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f400c8d0 con 0x7fa5040cddf0 2023-08-25T04:03:16.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa4fa7fc640 1 -- 172.21.15.55:0/1944209628 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f400ca30 con 0x7fa5040cddf0 2023-08-25T04:03:16.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa4fa7fc640 1 -- 172.21.15.55:0/1944209628 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f400cdc0 con 0x7fa5040cddf0 2023-08-25T04:03:16.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa50c144640 1 -- 172.21.15.55:0/1944209628 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5040c3360 con 0x7fa5040cddf0 2023-08-25T04:03:16.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa50c144640 1 -- 172.21.15.55:0/1944209628 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50415c900 con 0x7fa5040cddf0 2023-08-25T04:03:16.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa50c144640 1 -- 172.21.15.55:0/1944209628 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50415a780 con 0x7fa5040cddf0 2023-08-25T04:03:16.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.051+0000 7fa4fa7fc640 1 -- 172.21.15.55:0/1944209628 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa4f4013410 con 0x7fa5040cddf0 2023-08-25T04:03:16.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.055+0000 7fa4fa7fc640 1 --2- 172.21.15.55:0/1944209628 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa4e8065680 0x7fa4e8067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.055+0000 7fa4fa7fc640 1 -- 172.21.15.55:0/1944209628 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa4f4082be0 con 0x7fa5040cddf0 2023-08-25T04:03:16.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.055+0000 7fa509ee0640 1 --2- 172.21.15.55:0/1944209628 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa4e8065680 0x7fa4e8067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.055+0000 7fa509ee0640 1 --2- 172.21.15.55:0/1944209628 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa4e8065680 0x7fa4e8067b40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa500000f70 tx=0x7fa500009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:16.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.059+0000 7fa4fa7fc640 1 -- 172.21.15.55:0/1944209628 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa50415a780 con 0x7fa5040cddf0 2023-08-25T04:03:16.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.243+0000 7fa50c144640 1 -- 172.21.15.55:0/1944209628 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa50415a780 con 0x7fa5040cddf0 2023-08-25T04:03:16.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.247+0000 7fa4fa7fc640 1 -- 172.21.15.55:0/1944209628 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4875 (secure 0 0 0) 0x7fa50415a780 con 0x7fa5040cddf0 2023-08-25T04:03:16.248 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:16.248 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3370778281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3370778281},{"type":"v1","addr":"172.21.15.55:6835","nonce":3370778281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/2321139789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2321139789},{"type":"v1","addr":"172.21.15.110:6837","nonce":2321139789}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3825401605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3825401605},{"type":"v1","addr":"172.21.15.110:6836","nonce":3825401605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:03:01.098486+0000","modified":"2023-08-25T04:03:04.724648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/2606103809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2606103809},{"type":"v1","addr":"172.21.15.55:6834","nonce":2606103809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:03:16.248 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2023-08-25T04:03:16.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.247+0000 7fa50c144640 1 -- 172.21.15.55:0/1944209628 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa4e8065680 msgr2=0x7fa4e8067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:16.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.247+0000 7fa50c144640 1 --2- 172.21.15.55:0/1944209628 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa4e8065680 0x7fa4e8067b40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa500000f70 tx=0x7fa500009040 comp rx=0 tx=0).stop 2023-08-25T04:03:16.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.247+0000 7fa50c144640 1 -- 172.21.15.55:0/1944209628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5040cddf0 msgr2=0x7fa50415c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:16.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.247+0000 7fa50c144640 1 --2- 172.21.15.55:0/1944209628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5040cddf0 0x7fa50415c3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400e810 tx=0x7fa4f400ecd0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.247+0000 7fa50c144640 1 -- 172.21.15.55:0/1944209628 shutdown_connections 2023-08-25T04:03:16.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.247+0000 7fa50c144640 1 --2- 172.21.15.55:0/1944209628 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa4e8065680 0x7fa4e8067b40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.247+0000 7fa50c144640 1 --2- 172.21.15.55:0/1944209628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa504164410 0x7fa5040afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.247+0000 7fa50c144640 1 --2- 172.21.15.55:0/1944209628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5040cddf0 0x7fa50415c3c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.247+0000 7fa50c144640 1 --2- 172.21.15.55:0/1944209628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5040c1a80 0x7fa5040c2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.247+0000 7fa50c144640 1 -- 172.21.15.55:0/1944209628 >> 172.21.15.55:0/1944209628 conn(0x7fa504069d00 msgr2=0x7fa50406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:16.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.247+0000 7fa50c144640 1 -- 172.21.15.55:0/1944209628 shutdown_connections 2023-08-25T04:03:16.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.247+0000 7fa50c144640 1 -- 172.21.15.55:0/1944209628 wait complete. 2023-08-25T04:03:16.673 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-25T04:03:01.098486+0000', 'modified': '2023-08-25T04:03:04.724648+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4299}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4299': {'gid': 4299, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6834/2606103809', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 2606103809}, {'type': 'v1', 'addr': '172.21.15.55:6834', 'nonce': 2606103809}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-25T04:03:16.674 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-25T04:03:16.674 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-25T04:03:16.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.819+0000 7fbc4dee5640 1 Processor -- start 2023-08-25T04:03:16.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.819+0000 7fbc4dee5640 1 -- start start 2023-08-25T04:03:16.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.819+0000 7fbc4dee5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbc4815eba0 0x7fbc480b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.823+0000 7fbc4dee5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbc4815ef80 0x7fbc480ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.823+0000 7fbc4dee5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc480ac100 con 0x7fbc480cece0 2023-08-25T04:03:16.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.823+0000 7fbc4dee5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc480cf170 con 0x7fbc4815eba0 2023-08-25T04:03:16.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.823+0000 7fbc4dee5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc480ac3a0 con 0x7fbc4815ef80 2023-08-25T04:03:16.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.823+0000 7fbc477fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbc4815eba0 0x7fbc480b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.823+0000 7fbc477fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbc4815eba0 0x7fbc480b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60002/0 (socket says 172.21.15.55:60002) 2023-08-25T04:03:16.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.823+0000 7fbc477fe640 1 -- 172.21.15.55:0/3708228489 learned_addr learned my addr 172.21.15.55:0/3708228489 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:16.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.823+0000 7fbc3ffff640 1 --2- 172.21.15.55:0/3708228489 >> v2:172.21.15.110:3300/0 conn(0x7fbc4815ef80 0x7fbc480ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.823+0000 7fbc477fe640 1 -- 172.21.15.55:0/3708228489 >> v2:172.21.15.110:3300/0 conn(0x7fbc4815ef80 msgr2=0x7fbc480ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:16.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.823+0000 7fbc477fe640 1 --2- 172.21.15.55:0/3708228489 >> v2:172.21.15.110:3300/0 conn(0x7fbc4815ef80 0x7fbc480ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.823+0000 7fbc477fe640 1 -- 172.21.15.55:0/3708228489 >> v1:172.21.15.110:6789/0 conn(0x7fbc480cece0 legacy=0x7fbc480cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:16.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.823+0000 7fbc477fe640 1 -- 172.21.15.55:0/3708228489 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc480b1390 con 0x7fbc4815eba0 2023-08-25T04:03:16.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.823+0000 7fbc3ffff640 1 --2- 172.21.15.55:0/3708228489 >> v2:172.21.15.110:3300/0 conn(0x7fbc4815ef80 0x7fbc480ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:16.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.823+0000 7fbc477fe640 1 --2- 172.21.15.55:0/3708228489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc4815eba0 0x7fbc480b2a40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbc480b3470 tx=0x7fbc3801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f249fd2be734c9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:16.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.827+0000 7fbc46ffd640 1 -- 172.21.15.55:0/3708228489 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380ac410 con 0x7fbc4815eba0 2023-08-25T04:03:16.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.827+0000 7fbc46ffd640 1 -- 172.21.15.55:0/3708228489 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc380ac570 con 0x7fbc4815eba0 2023-08-25T04:03:16.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.827+0000 7fbc46ffd640 1 -- 172.21.15.55:0/3708228489 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380ac900 con 0x7fbc4815eba0 2023-08-25T04:03:16.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.827+0000 7fbc4dee5640 1 -- 172.21.15.55:0/3708228489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc4815eba0 msgr2=0x7fbc480b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:16.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.827+0000 7fbc4dee5640 1 --2- 172.21.15.55:0/3708228489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc4815eba0 0x7fbc480b2a40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbc480b3470 tx=0x7fbc3801c490 comp rx=0 tx=0).stop 2023-08-25T04:03:16.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.827+0000 7fbc4dee5640 1 -- 172.21.15.55:0/3708228489 shutdown_connections 2023-08-25T04:03:16.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.827+0000 7fbc4dee5640 1 --2- 172.21.15.55:0/3708228489 >> v2:172.21.15.110:3300/0 conn(0x7fbc4815ef80 0x7fbc480ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.827+0000 7fbc4dee5640 1 --2- 172.21.15.55:0/3708228489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc4815eba0 0x7fbc480b2a40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.827+0000 7fbc4dee5640 1 -- 172.21.15.55:0/3708228489 >> 172.21.15.55:0/3708228489 conn(0x7fbc48069d00 msgr2=0x7fbc4806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:16.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.827+0000 7fbc4dee5640 1 -- 172.21.15.55:0/3708228489 shutdown_connections 2023-08-25T04:03:16.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.827+0000 7fbc4dee5640 1 -- 172.21.15.55:0/3708228489 wait complete. 2023-08-25T04:03:16.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.827+0000 7fbc4dee5640 1 Processor -- start 2023-08-25T04:03:16.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.827+0000 7fbc4dee5640 1 -- start start 2023-08-25T04:03:16.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.827+0000 7fbc4dee5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc480cece0 0x7fbc481f5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.827+0000 7fbc4dee5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc4815eba0 0x7fbc48159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.827+0000 7fbc4dee5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc4815ef80 0x7fbc48163840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc4dee5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc48163d80 con 0x7fbc4815eba0 2023-08-25T04:03:16.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc4dee5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc48159bc0 con 0x7fbc480cece0 2023-08-25T04:03:16.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc4dee5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc48159ea0 con 0x7fbc4815ef80 2023-08-25T04:03:16.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc477fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc480cece0 0x7fbc481f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc3ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc4815eba0 0x7fbc48159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc477fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc480cece0 0x7fbc481f5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:46294/0 (socket says 172.21.15.55:46294) 2023-08-25T04:03:16.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc477fe640 1 -- 172.21.15.55:0/4063012622 learned_addr learned my addr 172.21.15.55:0/4063012622 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:16.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc47fff640 1 --2- 172.21.15.55:0/4063012622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc4815ef80 0x7fbc48163840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc3ffff640 1 -- 172.21.15.55:0/4063012622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc4815ef80 msgr2=0x7fbc48163840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:16.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc3ffff640 1 --2- 172.21.15.55:0/4063012622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc4815ef80 0x7fbc48163840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc3ffff640 1 -- 172.21.15.55:0/4063012622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc480cece0 msgr2=0x7fbc481f5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:16.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc3ffff640 1 --2- 172.21.15.55:0/4063012622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc480cece0 0x7fbc481f5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc3ffff640 1 -- 172.21.15.55:0/4063012622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc380094d0 con 0x7fbc4815eba0 2023-08-25T04:03:16.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc47fff640 1 --2- 172.21.15.55:0/4063012622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc4815ef80 0x7fbc48163840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:16.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc3ffff640 1 --2- 172.21.15.55:0/4063012622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc4815eba0 0x7fbc48159360 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000c7f0 tx=0x7fbc3000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:16.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc44ff9640 1 -- 172.21.15.55:0/4063012622 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc30004220 con 0x7fbc4815eba0 2023-08-25T04:03:16.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc44ff9640 1 -- 172.21.15.55:0/4063012622 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc30004380 con 0x7fbc4815eba0 2023-08-25T04:03:16.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc44ff9640 1 -- 172.21.15.55:0/4063012622 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc30003840 con 0x7fbc4815eba0 2023-08-25T04:03:16.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc4dee5640 1 -- 172.21.15.55:0/4063012622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4806cfc0 con 0x7fbc4815eba0 2023-08-25T04:03:16.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc4dee5640 1 -- 172.21.15.55:0/4063012622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4806d580 con 0x7fbc4815eba0 2023-08-25T04:03:16.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.831+0000 7fbc44ff9640 1 -- 172.21.15.55:0/4063012622 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fbc30003bb0 con 0x7fbc4815eba0 2023-08-25T04:03:16.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc44ff9640 1 --2- 172.21.15.55:0/4063012622 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbc28065680 0x7fbc28067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc44ff9640 1 -- 172.21.15.55:0/4063012622 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc30082df0 con 0x7fbc4815eba0 2023-08-25T04:03:16.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc5123e000 1 Processor -- start 2023-08-25T04:03:16.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc477fe640 1 --2- 172.21.15.55:0/4063012622 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbc28065680 0x7fbc28067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc5123e000 1 -- start start 2023-08-25T04:03:16.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc477fe640 1 --2- 172.21.15.55:0/4063012622 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbc28065680 0x7fbc28067b40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbc3801c4d0 tx=0x7fbc38008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:16.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc5123e000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 0x55ed13240400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc5123e000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 0x55ed131f6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc5123e000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed131f65b0 0x55ed131f6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc5123e000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1304c440 con 0x55ed13240940 2023-08-25T04:03:16.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc5123e000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed13049970 con 0x55ed13240020 2023-08-25T04:03:16.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc5123e000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed13045260 con 0x55ed131f65b0 2023-08-25T04:03:16.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc3ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 0x55ed131f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc3ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 0x55ed131f6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60018/0 (socket says 172.21.15.55:60018) 2023-08-25T04:03:16.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc3ffff640 1 -- 172.21.15.55:0/1869966764 learned_addr learned my addr 172.21.15.55:0/1869966764 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:16.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc477fe640 1 --2- 172.21.15.55:0/1869966764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 0x55ed13240400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc47fff640 1 --2- 172.21.15.55:0/1869966764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed131f65b0 0x55ed131f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc3ffff640 1 -- 172.21.15.55:0/1869966764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed131f65b0 msgr2=0x55ed131f6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:16.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc3ffff640 1 --2- 172.21.15.55:0/1869966764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed131f65b0 0x55ed131f6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc3ffff640 1 -- 172.21.15.55:0/1869966764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 msgr2=0x55ed13240400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:16.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc3ffff640 1 --2- 172.21.15.55:0/1869966764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 0x55ed13240400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc3ffff640 1 -- 172.21.15.55:0/1869966764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed130ddec0 con 0x55ed13240940 2023-08-25T04:03:16.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc3ffff640 1 --2- 172.21.15.55:0/1869966764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 0x55ed131f6070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbc3005bcb0 tx=0x7fbc30054010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4be9c1fc92a563 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:16.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc3d7fa640 1 -- 172.21.15.55:0/1869966764 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc300526c0 con 0x55ed13240940 2023-08-25T04:03:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc3d7fa640 1 -- 172.21.15.55:0/1869966764 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc30052920 con 0x55ed13240940 2023-08-25T04:03:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc3d7fa640 1 -- 172.21.15.55:0/1869966764 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc30050370 con 0x55ed13240940 2023-08-25T04:03:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc5123e000 1 -- 172.21.15.55:0/1869966764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 msgr2=0x55ed131f6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.835+0000 7fbc5123e000 1 --2- 172.21.15.55:0/1869966764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 0x55ed131f6070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbc3005bcb0 tx=0x7fbc30054010 comp rx=0 tx=0).stop 2023-08-25T04:03:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 1 -- 172.21.15.55:0/1869966764 shutdown_connections 2023-08-25T04:03:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 1 --2- 172.21.15.55:0/1869966764 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed131f65b0 0x55ed131f6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 1 --2- 172.21.15.55:0/1869966764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 0x55ed131f6070 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 1 --2- 172.21.15.55:0/1869966764 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 0x55ed13240400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 1 -- 172.21.15.55:0/1869966764 >> 172.21.15.55:0/1869966764 conn(0x55ed131f2560 msgr2=0x55ed131f4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:16.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 1 -- 172.21.15.55:0/1869966764 shutdown_connections 2023-08-25T04:03:16.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 1 -- 172.21.15.55:0/1869966764 wait complete. 2023-08-25T04:03:16.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 1 -- start start 2023-08-25T04:03:16.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 1 Processor -- start 2023-08-25T04:03:16.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed131f65b0 0x55ed13247380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 0x55ed132478c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 0x55ed1322ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed12ffff60 con 0x55ed13240940 2023-08-25T04:03:16.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed12fffc00 con 0x55ed13240020 2023-08-25T04:03:16.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed12d00940 con 0x55ed131f65b0 2023-08-25T04:03:16.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 10 client.0 _ll_register_callbacks cb 0x55ed131e1900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:03:16.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc47fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 0x55ed1322ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc47fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 0x55ed1322ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60032/0 (socket says 172.21.15.55:60032) 2023-08-25T04:03:16.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc47fff640 1 -- 172.21.15.55:0/807639783 learned_addr learned my addr 172.21.15.55:0/807639783 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:16.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc477fe640 1 --2- 172.21.15.55:0/807639783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed131f65b0 0x55ed13247380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc3ffff640 1 --2- 172.21.15.55:0/807639783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 0x55ed132478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc47fff640 1 -- 172.21.15.55:0/807639783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed131f65b0 msgr2=0x55ed13247380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:16.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc47fff640 1 --2- 172.21.15.55:0/807639783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed131f65b0 0x55ed13247380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc47fff640 1 -- 172.21.15.55:0/807639783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 msgr2=0x55ed132478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:16.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc47fff640 1 --2- 172.21.15.55:0/807639783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 0x55ed132478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc47fff640 1 -- 172.21.15.55:0/807639783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4806d580 con 0x55ed13240940 2023-08-25T04:03:16.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc47fff640 1 --2- 172.21.15.55:0/807639783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 0x55ed1322ddd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000fb90 tx=0x7fbc4000d6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab226e6616895c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:16.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc267fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T04:03:16.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc267fc640 1 -- 172.21.15.55:0/807639783 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40019670 con 0x55ed13240940 2023-08-25T04:03:16.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc267fc640 1 -- 172.21.15.55:0/807639783 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc40008040 con 0x55ed13240940 2023-08-25T04:03:16.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 1 -- 172.21.15.55:0/807639783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed12fdc9d0 con 0x55ed13240940 2023-08-25T04:03:16.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc267fc640 1 -- 172.21.15.55:0/807639783 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc4000de90 con 0x55ed13240940 2023-08-25T04:03:16.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 10 client.4722 fetch_fsmap learned FSMap version 8 2023-08-25T04:03:16.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc5123e000 1 -- 172.21.15.55:0/807639783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55ed12d3f890 con 0x55ed13240940 2023-08-25T04:03:16.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.839+0000 7fbc267fc640 1 -- 172.21.15.55:0/807639783 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed12fdc9d0 con 0x55ed13240940 2023-08-25T04:03:16.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc267fc640 1 -- 172.21.15.55:0/807639783 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbc400197d0 con 0x55ed13240940 2023-08-25T04:03:16.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc5123e000 10 client.4722 fetch_fsmap finished waiting for FSMap version 8 2023-08-25T04:03:16.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc5123e000 10 client.4722 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-25T04:03:16.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc5123e000 20 client.4722 populate_metadata read hostname 'smithi055' 2023-08-25T04:03:16.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc5123e000 1 --2- 172.21.15.55:0/807639783 >> [v2:172.21.15.55:6832/2606103809,v1:172.21.15.55:6834/2606103809] conn(0x55ed1322eb70 0x55ed1322ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc5123e000 4 client.4722 mds_command: new command op to 4299 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-25T04:03:16.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc5123e000 1 -- 172.21.15.55:0/807639783 --> [v2:172.21.15.55:6832/2606103809,v1:172.21.15.55:6834/2606103809] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed12ffc7a0 con 0x55ed1322eb70 2023-08-25T04:03:16.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc477fe640 1 --2- 172.21.15.55:0/807639783 >> [v2:172.21.15.55:6832/2606103809,v1:172.21.15.55:6834/2606103809] conn(0x55ed1322eb70 0x55ed1322ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc477fe640 1 --2- 172.21.15.55:0/807639783 >> [v2:172.21.15.55:6832/2606103809,v1:172.21.15.55:6834/2606103809] conn(0x55ed1322eb70 0x55ed1322ef50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7edecd26af640ca8 server_cookie=1fb3ac101afc9071 in_seq=0 out_seq=0 2023-08-25T04:03:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc267fc640 10 client.4722 ms_handle_connect on v2:172.21.15.55:6832/2606103809 2023-08-25T04:03:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc267fc640 1 -- 172.21.15.55:0/807639783 <== mds.0 v2:172.21.15.55:6832/2606103809 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ed12ffc7a0 con 0x55ed1322eb70 2023-08-25T04:03:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc267fc640 10 client.4722 handle_command_reply: tid=0 2023-08-25T04:03:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc5123e000 1 client.4722 shutdown 2023-08-25T04:03:16.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc5123e000 1 -- 172.21.15.55:0/807639783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 msgr2=0x55ed1322ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:16.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc5123e000 1 --2- 172.21.15.55:0/807639783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 0x55ed1322ddd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000fb90 tx=0x7fbc4000d6e0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc5123e000 1 -- 172.21.15.55:0/807639783 shutdown_connections 2023-08-25T04:03:16.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc5123e000 1 --2- 172.21.15.55:0/807639783 >> [v2:172.21.15.55:6832/2606103809,v1:172.21.15.55:6834/2606103809] conn(0x55ed1322eb70 0x55ed1322ef50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc5123e000 1 --2- 172.21.15.55:0/807639783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 0x55ed1322ddd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc5123e000 1 --2- 172.21.15.55:0/807639783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 0x55ed132478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc5123e000 1 --2- 172.21.15.55:0/807639783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed131f65b0 0x55ed13247380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc5123e000 1 -- 172.21.15.55:0/807639783 >> 172.21.15.55:0/807639783 conn(0x55ed131f2560 msgr2=0x55ed131f51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:16.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc267fc640 0 client.4722 ms_handle_reset on v2:172.21.15.55:6832/2606103809 2023-08-25T04:03:16.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc5123e000 1 -- 172.21.15.55:0/807639783 shutdown_connections 2023-08-25T04:03:16.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc5123e000 1 -- 172.21.15.55:0/807639783 wait complete. 2023-08-25T04:03:16.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.843+0000 7fbc5123e000 20 client.4722 trim_cache size 0 max 16384 2023-08-25T04:03:16.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc5123e000 1 Processor -- start 2023-08-25T04:03:16.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc5123e000 1 -- start start 2023-08-25T04:03:16.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc5123e000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed131f65b0 0x55ed13299d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc5123e000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 0x55ed1329a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc5123e000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed13240940 0x55ed1329a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc5123e000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed13047dc0 con 0x55ed131f65b0 2023-08-25T04:03:16.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc5123e000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed1300ce80 con 0x55ed13240020 2023-08-25T04:03:16.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc5123e000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed131f8bd0 con 0x55ed13240940 2023-08-25T04:03:16.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc477fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed131f65b0 0x55ed13299d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc477fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed131f65b0 0x55ed13299d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60046/0 (socket says 172.21.15.55:60046) 2023-08-25T04:03:16.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc477fe640 1 -- 172.21.15.55:0/251603237 learned_addr learned my addr 172.21.15.55:0/251603237 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:16.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc47fff640 1 --2- 172.21.15.55:0/251603237 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed13240940 0x55ed1329a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc3ffff640 1 --2- 172.21.15.55:0/251603237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 0x55ed1329a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc477fe640 1 -- 172.21.15.55:0/251603237 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed13240940 msgr2=0x55ed1329a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:16.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc477fe640 1 --2- 172.21.15.55:0/251603237 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed13240940 0x55ed1329a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc477fe640 1 -- 172.21.15.55:0/251603237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 msgr2=0x55ed1329a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:16.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc477fe640 1 --2- 172.21.15.55:0/251603237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 0x55ed1329a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc477fe640 1 -- 172.21.15.55:0/251603237 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed13008190 con 0x55ed131f65b0 2023-08-25T04:03:16.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc3ffff640 1 --2- 172.21.15.55:0/251603237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 0x55ed1329a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:16.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc477fe640 1 --2- 172.21.15.55:0/251603237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed131f65b0 0x55ed13299d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbc3801c970 tx=0x7fbc38004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8627980f0a8976 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:16.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc3dffb640 1 -- 172.21.15.55:0/251603237 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380ace30 con 0x55ed131f65b0 2023-08-25T04:03:16.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc3dffb640 1 -- 172.21.15.55:0/251603237 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc380bd040 con 0x55ed131f65b0 2023-08-25T04:03:16.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.859+0000 7fbc3dffb640 1 -- 172.21.15.55:0/251603237 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380c6ae0 con 0x55ed131f65b0 2023-08-25T04:03:16.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 -- 172.21.15.55:0/251603237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed131f65b0 msgr2=0x55ed13299d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:16.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 --2- 172.21.15.55:0/251603237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed131f65b0 0x55ed13299d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbc3801c970 tx=0x7fbc38004740 comp rx=0 tx=0).stop 2023-08-25T04:03:16.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 -- 172.21.15.55:0/251603237 shutdown_connections 2023-08-25T04:03:16.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 --2- 172.21.15.55:0/251603237 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed13240940 0x55ed1329a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 --2- 172.21.15.55:0/251603237 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 0x55ed1329a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 --2- 172.21.15.55:0/251603237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed131f65b0 0x55ed13299d80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 -- 172.21.15.55:0/251603237 >> 172.21.15.55:0/251603237 conn(0x55ed131f2560 msgr2=0x55ed1323efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:16.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 -- 172.21.15.55:0/251603237 shutdown_connections 2023-08-25T04:03:16.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 -- 172.21.15.55:0/251603237 wait complete. 2023-08-25T04:03:16.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 -- start start 2023-08-25T04:03:16.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 Processor -- start 2023-08-25T04:03:16.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed131f65b0 0x55ed132446f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 0x55ed13244c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 0x55ed13245170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed12d401b0 con 0x55ed13240940 2023-08-25T04:03:16.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed131f1f00 con 0x55ed13240020 2023-08-25T04:03:16.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed13005430 con 0x55ed131f65b0 2023-08-25T04:03:16.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 10 client.0 _ll_register_callbacks cb 0x7fbc300508c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:03:16.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc47fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 0x55ed13245170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc47fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 0x55ed13245170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60058/0 (socket says 172.21.15.55:60058) 2023-08-25T04:03:16.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc47fff640 1 -- 172.21.15.55:0/3108456096 learned_addr learned my addr 172.21.15.55:0/3108456096 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:16.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc477fe640 1 --2- 172.21.15.55:0/3108456096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed131f65b0 0x55ed132446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc3ffff640 1 --2- 172.21.15.55:0/3108456096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 0x55ed13244c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc47fff640 1 -- 172.21.15.55:0/3108456096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed131f65b0 msgr2=0x55ed132446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:16.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc47fff640 1 --2- 172.21.15.55:0/3108456096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed131f65b0 0x55ed132446f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc47fff640 1 -- 172.21.15.55:0/3108456096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 msgr2=0x55ed13244c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:16.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc47fff640 1 --2- 172.21.15.55:0/3108456096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 0x55ed13244c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc47fff640 1 -- 172.21.15.55:0/3108456096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc480b1390 con 0x55ed13240940 2023-08-25T04:03:16.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc47fff640 1 --2- 172.21.15.55:0/3108456096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 0x55ed13245170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbc40000f90 tx=0x7fbc40004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9f368234ec5046 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:16.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc267fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T04:03:16.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc267fc640 1 -- 172.21.15.55:0/3108456096 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4000f750 con 0x55ed13240940 2023-08-25T04:03:16.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 -- 172.21.15.55:0/3108456096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed13256ab0 con 0x55ed13240940 2023-08-25T04:03:16.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc267fc640 1 -- 172.21.15.55:0/3108456096 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc40010810 con 0x55ed13240940 2023-08-25T04:03:16.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc267fc640 1 -- 172.21.15.55:0/3108456096 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc40007480 con 0x55ed13240940 2023-08-25T04:03:16.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 10 client.4728 fetch_fsmap learned FSMap version 8 2023-08-25T04:03:16.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.863+0000 7fbc5123e000 1 -- 172.21.15.55:0/3108456096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55ed12fee420 con 0x55ed13240940 2023-08-25T04:03:16.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc267fc640 1 -- 172.21.15.55:0/3108456096 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed13256ab0 con 0x55ed13240940 2023-08-25T04:03:16.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc267fc640 1 -- 172.21.15.55:0/3108456096 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbc400109d0 con 0x55ed13240940 2023-08-25T04:03:16.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc5123e000 10 client.4728 fetch_fsmap finished waiting for FSMap version 8 2023-08-25T04:03:16.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc5123e000 10 client.4728 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-25T04:03:16.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc5123e000 20 client.4728 populate_metadata read hostname 'smithi055' 2023-08-25T04:03:16.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc5123e000 1 --2- 172.21.15.55:0/3108456096 >> [v2:172.21.15.55:6832/2606103809,v1:172.21.15.55:6834/2606103809] conn(0x55ed132456b0 0x55ed13245a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:16.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc5123e000 4 client.4728 mds_command: new command op to 4299 tid=0[{"prefix": "status"}] 2023-08-25T04:03:16.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc5123e000 1 -- 172.21.15.55:0/3108456096 --> [v2:172.21.15.55:6832/2606103809,v1:172.21.15.55:6834/2606103809] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ed13000880 con 0x55ed132456b0 2023-08-25T04:03:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc477fe640 1 --2- 172.21.15.55:0/3108456096 >> [v2:172.21.15.55:6832/2606103809,v1:172.21.15.55:6834/2606103809] conn(0x55ed132456b0 0x55ed13245a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc477fe640 1 --2- 172.21.15.55:0/3108456096 >> [v2:172.21.15.55:6832/2606103809,v1:172.21.15.55:6834/2606103809] conn(0x55ed132456b0 0x55ed13245a90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad0fde2fa54b46f0 server_cookie=cd624b3faaeea204 in_seq=0 out_seq=0 2023-08-25T04:03:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc267fc640 10 client.4728 ms_handle_connect on v2:172.21.15.55:6832/2606103809 2023-08-25T04:03:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc267fc640 1 -- 172.21.15.55:0/3108456096 <== mds.0 v2:172.21.15.55:6832/2606103809 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55ed13000880 con 0x55ed132456b0 2023-08-25T04:03:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc267fc640 10 client.4728 handle_command_reply: tid=0 2023-08-25T04:03:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc5123e000 1 client.4728 shutdown 2023-08-25T04:03:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc5123e000 1 -- 172.21.15.55:0/3108456096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 msgr2=0x55ed13245170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:16.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc5123e000 1 --2- 172.21.15.55:0/3108456096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 0x55ed13245170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbc40000f90 tx=0x7fbc40004a80 comp rx=0 tx=0).stop 2023-08-25T04:03:16.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc5123e000 1 -- 172.21.15.55:0/3108456096 shutdown_connections 2023-08-25T04:03:16.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc5123e000 1 --2- 172.21.15.55:0/3108456096 >> [v2:172.21.15.55:6832/2606103809,v1:172.21.15.55:6834/2606103809] conn(0x55ed132456b0 0x55ed13245a90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc5123e000 1 --2- 172.21.15.55:0/3108456096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55ed13240940 0x55ed13245170 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc5123e000 1 --2- 172.21.15.55:0/3108456096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55ed13240020 0x55ed13244c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc5123e000 1 --2- 172.21.15.55:0/3108456096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55ed131f65b0 0x55ed132446f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc267fc640 0 client.4728 ms_handle_reset on v2:172.21.15.55:6832/2606103809 2023-08-25T04:03:16.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc5123e000 1 -- 172.21.15.55:0/3108456096 >> 172.21.15.55:0/3108456096 conn(0x55ed131f2560 msgr2=0x55ed1323f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:16.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc5123e000 1 -- 172.21.15.55:0/3108456096 shutdown_connections 2023-08-25T04:03:16.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc5123e000 1 -- 172.21.15.55:0/3108456096 wait complete. 2023-08-25T04:03:16.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc5123e000 20 client.4728 trim_cache size 0 max 16384 2023-08-25T04:03:16.882 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T04:03:16.883 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2d2a9024-b152-4d40-880c-1686d1810590", 2023-08-25T04:03:16.883 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-08-25T04:03:16.883 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 4299, 2023-08-25T04:03:16.883 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-08-25T04:03:16.883 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-08-25T04:03:16.883 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-08-25T04:03:16.883 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 15.171405833, 2023-08-25T04:03:16.884 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 8, 2023-08-25T04:03:16.884 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 24, 2023-08-25T04:03:16.884 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 24, 2023-08-25T04:03:16.884 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 21.074150656 2023-08-25T04:03:16.884 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T04:03:16.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc4dee5640 1 -- 172.21.15.55:0/4063012622 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbc28065680 msgr2=0x7fbc28067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:16.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc4dee5640 1 --2- 172.21.15.55:0/4063012622 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbc28065680 0x7fbc28067b40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbc3801c4d0 tx=0x7fbc38008040 comp rx=0 tx=0).stop 2023-08-25T04:03:16.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc4dee5640 1 -- 172.21.15.55:0/4063012622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc4815eba0 msgr2=0x7fbc48159360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:16.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc4dee5640 1 --2- 172.21.15.55:0/4063012622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc4815eba0 0x7fbc48159360 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000c7f0 tx=0x7fbc3000ccb0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc4dee5640 1 -- 172.21.15.55:0/4063012622 shutdown_connections 2023-08-25T04:03:16.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc4dee5640 1 --2- 172.21.15.55:0/4063012622 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbc28065680 0x7fbc28067b40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc4dee5640 1 --2- 172.21.15.55:0/4063012622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbc4815ef80 0x7fbc48163840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc4dee5640 1 --2- 172.21.15.55:0/4063012622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc4815eba0 0x7fbc48159360 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc4dee5640 1 --2- 172.21.15.55:0/4063012622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbc480cece0 0x7fbc481f5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:16.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc4dee5640 1 -- 172.21.15.55:0/4063012622 >> 172.21.15.55:0/4063012622 conn(0x7fbc48069d00 msgr2=0x7fbc480aed60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:16.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc4dee5640 1 -- 172.21.15.55:0/4063012622 shutdown_connections 2023-08-25T04:03:16.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:16.867+0000 7fbc4dee5640 1 -- 172.21.15.55:0/4063012622 wait complete. 2023-08-25T04:03:16.888 INFO:teuthology.run_tasks:Running task kclient... 2023-08-25T04:03:16.923 INFO:tasks.kclient:Mounting kernel clients... 2023-08-25T04:03:16.924 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-08-25T04:03:16.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:16.925 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-08-25T04:03:16.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:16.935 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2023-08-25T04:03:16.999 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2023-08-25T04:03:17.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:03:17.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:17.001 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-08-25T04:03:17.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:17.055 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2023-08-25T04:03:17.119 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2023-08-25T04:03:17.125 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:03:17.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:17.129 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2023-08-25T04:03:17.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:17.140 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2023-08-25T04:03:17.210 INFO:teuthology.orchestra.run.smithi110.stderr:Cannot find device "ceph-brx" 2023-08-25T04:03:17.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:03:17.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:17.214 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2023-08-25T04:03:17.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:17.265 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2023-08-25T04:03:17.331 INFO:teuthology.orchestra.run.smithi110.stderr:Cannot find device "ceph-brx" 2023-08-25T04:03:17.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T04:03:17.337 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-08-25T04:03:17.337 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-25T04:03:17.338 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T04:03:17.338 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:03:17.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c91ba640 1 Processor -- start 2023-08-25T04:03:17.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c91ba640 1 -- start start 2023-08-25T04:03:17.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c91ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff4c40cdde0 0x7ff4c40ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:17.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c91ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c40b2e40 0x7ff4c40b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:17.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c91ba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c40b29b0 con 0x7ff4c40d0da0 2023-08-25T04:03:17.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c91ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c40ce760 con 0x7ff4c40cdde0 2023-08-25T04:03:17.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c91ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40b1dc0 con 0x7ff4c40b2e40 2023-08-25T04:03:17.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c2d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff4c40d0da0 0x7ff4c40d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50626/0 (socket says 172.21.15.55:50626) 2023-08-25T04:03:17.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c2d9d640 1 -- 172.21.15.55:0/4249671376 learned_addr learned my addr 172.21.15.55:0/4249671376 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:17.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c359e640 1 --2- 172.21.15.55:0/4249671376 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c40b2e40 0x7ff4c40b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:17.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4bbfff640 1 --2- 172.21.15.55:0/4249671376 >> v2:172.21.15.110:3300/0 conn(0x7ff4c40cdde0 0x7ff4c40ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:17.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c259c640 1 -- 172.21.15.55:0/4249671376 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822601998 0 0) 0x7ff4c40b29b0 con 0x7ff4c40d0da0 2023-08-25T04:03:17.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c259c640 1 -- 172.21.15.55:0/4249671376 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4b0003530 con 0x7ff4c40d0da0 2023-08-25T04:03:17.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c259c640 1 -- 172.21.15.55:0/4249671376 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3679009385 0 0) 0x7ff4b0003530 con 0x7ff4c40d0da0 2023-08-25T04:03:17.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c259c640 1 -- 172.21.15.55:0/4249671376 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c40b2e40 msgr2=0x7ff4c40b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:17.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c259c640 1 --2- 172.21.15.55:0/4249671376 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c40b2e40 0x7ff4c40b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:17.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c259c640 1 -- 172.21.15.55:0/4249671376 >> v2:172.21.15.110:3300/0 conn(0x7ff4c40cdde0 msgr2=0x7ff4c40ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:17.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c259c640 1 --2- 172.21.15.55:0/4249671376 >> v2:172.21.15.110:3300/0 conn(0x7ff4c40cdde0 0x7ff4c40ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:17.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c259c640 1 -- 172.21.15.55:0/4249671376 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40b2080 con 0x7ff4c40d0da0 2023-08-25T04:03:17.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c259c640 1 -- 172.21.15.55:0/4249671376 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7ff4b4001800 con 0x7ff4c40d0da0 2023-08-25T04:03:17.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c259c640 1 -- 172.21.15.55:0/4249671376 >> v1:172.21.15.55:6789/0 conn(0x7ff4c40d0da0 legacy=0x7ff4c40d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:17.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c259c640 1 --2- 172.21.15.55:0/4249671376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4b0003980 0x7ff4b0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:17.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c259c640 1 --2- 172.21.15.55:0/4249671376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4b00047d0 0x7ff4b0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:17.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c259c640 1 --2- 172.21.15.55:0/4249671376 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c40b2e40 0x7ff4b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:17.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c259c640 1 -- 172.21.15.55:0/4249671376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40ce760 con 0x7ff4b00047d0 2023-08-25T04:03:17.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c259c640 1 -- 172.21.15.55:0/4249671376 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40b1dc0 con 0x7ff4b0003980 2023-08-25T04:03:17.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c259c640 1 -- 172.21.15.55:0/4249671376 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b000b990 con 0x7ff4c40b2e40 2023-08-25T04:03:17.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4bbfff640 1 --2- 172.21.15.55:0/4249671376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4b00047d0 0x7ff4b0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:17.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c359e640 1 --2- 172.21.15.55:0/4249671376 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c40b2e40 0x7ff4b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:17.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4c2d9d640 1 --2- 172.21.15.55:0/4249671376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4b0003980 0x7ff4b0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:17.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4bbfff640 1 -- 172.21.15.55:0/4249671376 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c40b2e40 msgr2=0x7ff4b0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:17.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4bbfff640 1 --2- 172.21.15.55:0/4249671376 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c40b2e40 0x7ff4b0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:17.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4bbfff640 1 -- 172.21.15.55:0/4249671376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4b0003980 msgr2=0x7ff4b0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:17.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4bbfff640 1 --2- 172.21.15.55:0/4249671376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4b0003980 0x7ff4b0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:17.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.483+0000 7ff4bbfff640 1 -- 172.21.15.55:0/4249671376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b0003530 con 0x7ff4b00047d0 2023-08-25T04:03:17.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.487+0000 7ff4bbfff640 1 --2- 172.21.15.55:0/4249671376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4b00047d0 0x7ff4b0004c50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009ae0 tx=0x7ff4ac01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f28672b4e92256 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:17.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.487+0000 7ff4c259c640 1 -- 172.21.15.55:0/4249671376 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0a55a0 con 0x7ff4b00047d0 2023-08-25T04:03:17.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.487+0000 7ff4c259c640 1 -- 172.21.15.55:0/4249671376 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac0a5700 con 0x7ff4b00047d0 2023-08-25T04:03:17.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.487+0000 7ff4c259c640 1 -- 172.21.15.55:0/4249671376 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0a5ab0 con 0x7ff4b00047d0 2023-08-25T04:03:17.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.487+0000 7ff4c91ba640 1 -- 172.21.15.55:0/4249671376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4b00047d0 msgr2=0x7ff4b0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:17.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.487+0000 7ff4c91ba640 1 --2- 172.21.15.55:0/4249671376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4b00047d0 0x7ff4b0004c50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009ae0 tx=0x7ff4ac01ca90 comp rx=0 tx=0).stop 2023-08-25T04:03:17.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.487+0000 7ff4c359e640 1 -- 172.21.15.55:0/4249671376 reap_dead start 2023-08-25T04:03:17.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.487+0000 7ff4c91ba640 1 -- 172.21.15.55:0/4249671376 shutdown_connections 2023-08-25T04:03:17.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.487+0000 7ff4c91ba640 1 -- 172.21.15.55:0/4249671376 >> 172.21.15.55:0/4249671376 conn(0x7ff4c409bae0 msgr2=0x7ff4c40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:17.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.487+0000 7ff4c91ba640 1 -- 172.21.15.55:0/4249671376 shutdown_connections 2023-08-25T04:03:17.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.487+0000 7ff4c91ba640 1 -- 172.21.15.55:0/4249671376 wait complete. 2023-08-25T04:03:17.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c91ba640 1 Processor -- start 2023-08-25T04:03:17.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c91ba640 1 -- start start 2023-08-25T04:03:17.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c91ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4b00047d0 0x7ff4c4158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:17.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c91ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c40b06f0 0x7ff4c41f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:17.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c91ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c40b0b70 0x7ff4c40c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:17.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c91ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c4158da0 con 0x7ff4b00047d0 2023-08-25T04:03:17.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c91ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40c7f60 con 0x7ff4c40b06f0 2023-08-25T04:03:17.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c91ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c41591e0 con 0x7ff4c40b0b70 2023-08-25T04:03:17.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4b00047d0 0x7ff4c4158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:17.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4b00047d0 0x7ff4c4158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60082/0 (socket says 172.21.15.55:60082) 2023-08-25T04:03:17.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c2d9d640 1 -- 172.21.15.55:0/40102610 learned_addr learned my addr 172.21.15.55:0/40102610 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:17.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c359e640 1 --2- 172.21.15.55:0/40102610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c40b0b70 0x7ff4c40c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:17.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4bbfff640 1 --2- 172.21.15.55:0/40102610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c40b06f0 0x7ff4c41f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:17.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c2d9d640 1 -- 172.21.15.55:0/40102610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c40b0b70 msgr2=0x7ff4c40c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:17.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c2d9d640 1 --2- 172.21.15.55:0/40102610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c40b0b70 0x7ff4c40c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:17.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c2d9d640 1 -- 172.21.15.55:0/40102610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c40b06f0 msgr2=0x7ff4c41f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:17.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c2d9d640 1 --2- 172.21.15.55:0/40102610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c40b06f0 0x7ff4c41f55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:17.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c2d9d640 1 -- 172.21.15.55:0/40102610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40c81b0 con 0x7ff4b00047d0 2023-08-25T04:03:17.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c2d9d640 1 --2- 172.21.15.55:0/40102610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4b00047d0 0x7ff4c4158860 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400f960 tx=0x7ff4b400fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:17.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4bb7fe640 1 -- 172.21.15.55:0/40102610 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40072e0 con 0x7ff4b00047d0 2023-08-25T04:03:17.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4bb7fe640 1 -- 172.21.15.55:0/40102610 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b4007440 con 0x7ff4b00047d0 2023-08-25T04:03:17.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4bb7fe640 1 -- 172.21.15.55:0/40102610 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40057b0 con 0x7ff4b00047d0 2023-08-25T04:03:17.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c91ba640 1 -- 172.21.15.55:0/40102610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c40c8490 con 0x7ff4b00047d0 2023-08-25T04:03:17.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.491+0000 7ff4c91ba640 1 -- 172.21.15.55:0/40102610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c41f5080 con 0x7ff4b00047d0 2023-08-25T04:03:17.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.495+0000 7ff4c91ba640 1 -- 172.21.15.55:0/40102610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c404dbe0 con 0x7ff4b00047d0 2023-08-25T04:03:17.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.495+0000 7ff4bb7fe640 1 -- 172.21.15.55:0/40102610 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff4b4005910 con 0x7ff4b00047d0 2023-08-25T04:03:17.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.495+0000 7ff4bb7fe640 1 --2- 172.21.15.55:0/40102610 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff4a4065680 0x7ff4a4067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:17.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.495+0000 7ff4bb7fe640 1 -- 172.21.15.55:0/40102610 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff4b4082f60 con 0x7ff4b00047d0 2023-08-25T04:03:17.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.495+0000 7ff4bbfff640 1 --2- 172.21.15.55:0/40102610 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff4a4065680 0x7ff4a4067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:17.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.495+0000 7ff4bbfff640 1 --2- 172.21.15.55:0/40102610 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff4a4065680 0x7ff4a4067b40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac0af000 tx=0x7ff4ac0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:17.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.499+0000 7ff4bb7fe640 1 -- 172.21.15.55:0/40102610 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff4b4050ac0 con 0x7ff4b00047d0 2023-08-25T04:03:17.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.687+0000 7ff4c91ba640 1 -- 172.21.15.55:0/40102610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff4c40d0b80 con 0x7ff4b00047d0 2023-08-25T04:03:17.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.687+0000 7ff4bb7fe640 1 -- 172.21.15.55:0/40102610 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff4b40540e0 con 0x7ff4b00047d0 2023-08-25T04:03:17.695 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T04:03:17.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.691+0000 7ff4c91ba640 1 -- 172.21.15.55:0/40102610 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff4a4065680 msgr2=0x7ff4a4067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:17.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.691+0000 7ff4c91ba640 1 --2- 172.21.15.55:0/40102610 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff4a4065680 0x7ff4a4067b40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac0af000 tx=0x7ff4ac0046d0 comp rx=0 tx=0).stop 2023-08-25T04:03:17.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.691+0000 7ff4c91ba640 1 -- 172.21.15.55:0/40102610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4b00047d0 msgr2=0x7ff4c4158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:17.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.691+0000 7ff4c91ba640 1 --2- 172.21.15.55:0/40102610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4b00047d0 0x7ff4c4158860 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400f960 tx=0x7ff4b400fe20 comp rx=0 tx=0).stop 2023-08-25T04:03:17.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.691+0000 7ff4c91ba640 1 -- 172.21.15.55:0/40102610 shutdown_connections 2023-08-25T04:03:17.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.691+0000 7ff4c91ba640 1 --2- 172.21.15.55:0/40102610 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff4a4065680 0x7ff4a4067b40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:17.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.691+0000 7ff4c91ba640 1 --2- 172.21.15.55:0/40102610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4c40b0b70 0x7ff4c40c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:17.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.691+0000 7ff4c91ba640 1 --2- 172.21.15.55:0/40102610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4c40b06f0 0x7ff4c41f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:17.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.691+0000 7ff4c91ba640 1 --2- 172.21.15.55:0/40102610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4b00047d0 0x7ff4c4158860 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:17.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.691+0000 7ff4c91ba640 1 -- 172.21.15.55:0/40102610 >> 172.21.15.55:0/40102610 conn(0x7ff4c409bae0 msgr2=0x7ff4c406b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:17.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.691+0000 7ff4c91ba640 1 -- 172.21.15.55:0/40102610 shutdown_connections 2023-08-25T04:03:17.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:17.691+0000 7ff4c91ba640 1 -- 172.21.15.55:0/40102610 wait complete. 2023-08-25T04:03:17.711 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-25T04:03:17.711 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:03:17.711 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-08-25T04:03:17.712 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-25T04:03:17.712 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T04:03:17.712 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-25T04:03:17.712 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-25T04:03:17.712 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:03:17.713 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:03:17.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:17.714 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-08-25T04:03:17.726 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:03:17.726 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:03:17.726 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:03:17.727 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:17.727 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-08-25T04:03:17.727 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:17.727 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:03:17.727 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:17.727 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-08-25T04:03:17.727 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:03:17.728 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:17.728 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-08-25T04:03:17.728 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:03:17.728 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:17.728 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-08-25T04:03:17.728 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-08-25T04:03:17.728 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42391sec preferred_lft 42391sec 2023-08-25T04:03:17.729 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-08-25T04:03:17.729 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:17.729 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:03:17.729 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:17.729 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-08-25T04:03:17.729 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-25T04:03:17.729 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:98:6a:38:6a brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:17.730 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-25T04:03:17.730 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:17.730 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-25T04:03:17.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:17.731 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T04:03:17.731 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T04:03:17.731 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add name ceph-brx type bridge 2023-08-25T04:03:17.732 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr flush dev ceph-brx 2023-08-25T04:03:17.732 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set ceph-brx up 2023-08-25T04:03:17.732 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-25T04:03:17.732 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T04:03:17.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:17.841 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:03:17.861 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-08-25T04:03:17.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:17.863 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-08-25T04:03:17.934 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-08-25T04:03:17.934 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:03:17.935 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-08-25T04:03:17.935 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-25T04:03:17.935 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-08-25T04:03:17.936 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:03:17.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:17.937 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T04:03:17.937 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T04:03:17.937 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-25T04:03:17.938 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-25T04:03:17.938 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-25T04:03:17.938 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T04:03:18.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:18.029 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-08-25T04:03:18.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:18.041 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2023-08-25T04:03:18.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:18.098 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T04:03:18.098 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T04:03:18.099 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T04:03:18.099 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-25T04:03:18.099 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T04:03:18.179 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-25T04:03:18.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:18.181 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T04:03:18.181 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T04:03:18.181 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-25T04:03:18.181 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-25T04:03:18.182 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-25T04:03:18.182 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-25T04:03:18.182 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-25T04:03:18.183 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T04:03:18.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:18.347 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T04:03:18.348 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T04:03:18.348 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-08-25T04:03:18.348 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.0 master ceph-brx 2023-08-25T04:03:18.348 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T04:03:18.392 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:03:18.392 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-25T04:03:18.444 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:03:18.444 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:03:18.445 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:03:18.494 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-25T04:03:18.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:18.495 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:03:18.595 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:03:18.596 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:03:18.708 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:03:18.708 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:03:18.708 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.110:3300,172.21.15.110:3301" 2023-08-25T04:03:18.708 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2d2a9024-b152-4d40-880c-1686d1810590.cephfs=/ 2023-08-25T04:03:18.709 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2023-08-25T04:03:18.711 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T04:03:18.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:18.712 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:03:18.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:18.736 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:03:18.809 INFO:teuthology.orchestra.run.smithi055.stdout:client4663 2023-08-25T04:03:18.810 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:03:18.811 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:03:18.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:18.863 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:03:18.927 INFO:teuthology.orchestra.run.smithi055.stdout:client4663 2023-08-25T04:03:18.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:18.928 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:03:18.991 INFO:teuthology.orchestra.run.smithi055.stdout:client4663 2023-08-25T04:03:18.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:18.992 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/2d2a9024-b152-4d40-880c-1686d1810590.client4663/status') 2023-08-25T04:03:19.063 INFO:teuthology.orchestra.run.smithi055.stdout:instance: client.4663 (3)172.21.15.55:0/3317612603 2023-08-25T04:03:19.064 INFO:teuthology.orchestra.run.smithi055.stdout:blocklisted: false 2023-08-25T04:03:19.064 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records in 2023-08-25T04:03:19.064 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records out 2023-08-25T04:03:19.065 INFO:teuthology.orchestra.run.smithi055.stderr:70 bytes copied, 5.6838e-05 s, 1.2 MB/s 2023-08-25T04:03:19.066 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-08-25T04:03:19.066 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-25T04:03:19.066 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-25T04:03:19.067 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:03:19.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.251+0000 7f550cf67640 1 Processor -- start 2023-08-25T04:03:19.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.251+0000 7f550cf67640 1 -- start start 2023-08-25T04:03:19.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f550cf67640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550815ef80 0x7f55080ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:19.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f550cf67640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55080cece0 0x7f55080ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:19.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f550cf67640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55080ac3a0 con 0x7f550815eba0 2023-08-25T04:03:19.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f550cf67640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55080cf170 con 0x7f55080cece0 2023-08-25T04:03:19.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f550cf67640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55080b3150 con 0x7f550815ef80 2023-08-25T04:03:19.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f550659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f550815eba0 0x7f55080b2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50630/0 (socket says 172.21.15.55:50630) 2023-08-25T04:03:19.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f550659c640 1 -- 172.21.15.55:0/547616405 learned_addr learned my addr 172.21.15.55:0/547616405 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:19.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f54fdd9b640 1 --2- 172.21.15.55:0/547616405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550815ef80 0x7f55080ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:19.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f5506d9d640 1 --2- 172.21.15.55:0/547616405 >> v2:172.21.15.110:3300/0 conn(0x7f55080cece0 0x7f55080ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:19.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f5505d9b640 1 -- 172.21.15.55:0/547616405 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607853243 0 0) 0x7f55080ac3a0 con 0x7f550815eba0 2023-08-25T04:03:19.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f5505d9b640 1 -- 172.21.15.55:0/547616405 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54f4003530 con 0x7f550815eba0 2023-08-25T04:03:19.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f5505d9b640 1 -- 172.21.15.55:0/547616405 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3317712614 0 0) 0x7f54f4003530 con 0x7f550815eba0 2023-08-25T04:03:19.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f5505d9b640 1 -- 172.21.15.55:0/547616405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550815ef80 msgr2=0x7f55080ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:19.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f5505d9b640 1 --2- 172.21.15.55:0/547616405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550815ef80 0x7f55080ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:19.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f5505d9b640 1 -- 172.21.15.55:0/547616405 >> v2:172.21.15.110:3300/0 conn(0x7f55080cece0 msgr2=0x7f55080ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:19.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f5505d9b640 1 --2- 172.21.15.55:0/547616405 >> v2:172.21.15.110:3300/0 conn(0x7f55080cece0 0x7f55080ab0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:19.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f5505d9b640 1 -- 172.21.15.55:0/547616405 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55080b1390 con 0x7f550815eba0 2023-08-25T04:03:19.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f5505d9b640 1 -- 172.21.15.55:0/547616405 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f54f8001680 con 0x7f550815eba0 2023-08-25T04:03:19.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f5505d9b640 1 -- 172.21.15.55:0/547616405 >> v1:172.21.15.55:6789/0 conn(0x7f550815eba0 legacy=0x7f55080b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:19.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f5505d9b640 1 --2- 172.21.15.55:0/547616405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f4003980 0x7f54f4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:19.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f5505d9b640 1 --2- 172.21.15.55:0/547616405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54f40047d0 0x7f54f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:19.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f5505d9b640 1 --2- 172.21.15.55:0/547616405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550815ef80 0x7f54f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:19.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f5505d9b640 1 -- 172.21.15.55:0/547616405 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55080cf170 con 0x7f54f4003980 2023-08-25T04:03:19.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f5505d9b640 1 -- 172.21.15.55:0/547616405 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55080b3150 con 0x7f54f40047d0 2023-08-25T04:03:19.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f5505d9b640 1 -- 172.21.15.55:0/547616405 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f400b990 con 0x7f550815ef80 2023-08-25T04:03:19.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f550659c640 1 --2- 172.21.15.55:0/547616405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f4003980 0x7f54f4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:19.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f54fdd9b640 1 --2- 172.21.15.55:0/547616405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54f40047d0 0x7f54f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:19.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f5506d9d640 1 --2- 172.21.15.55:0/547616405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550815ef80 0x7f54f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:19.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f550659c640 1 -- 172.21.15.55:0/547616405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550815ef80 msgr2=0x7f54f4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:19.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f550659c640 1 --2- 172.21.15.55:0/547616405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550815ef80 0x7f54f4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:19.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f550659c640 1 -- 172.21.15.55:0/547616405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54f40047d0 msgr2=0x7f54f4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:19.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f550659c640 1 --2- 172.21.15.55:0/547616405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54f40047d0 0x7f54f4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:19.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f550659c640 1 -- 172.21.15.55:0/547616405 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f4003530 con 0x7f54f4003980 2023-08-25T04:03:19.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.255+0000 7f54fdd9b640 1 --2- 172.21.15.55:0/547616405 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54f40047d0 0x7f54f4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:19.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.259+0000 7f550659c640 1 --2- 172.21.15.55:0/547616405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f4003980 0x7f54f4003da0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f54f800c240 tx=0x7f54f801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e929fc0de221c75a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:19.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.259+0000 7f5505d9b640 1 -- 172.21.15.55:0/547616405 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f80058e0 con 0x7f54f4003980 2023-08-25T04:03:19.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.259+0000 7f5505d9b640 1 -- 172.21.15.55:0/547616405 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f8005a40 con 0x7f54f4003980 2023-08-25T04:03:19.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.259+0000 7f5505d9b640 1 -- 172.21.15.55:0/547616405 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8005e10 con 0x7f54f4003980 2023-08-25T04:03:19.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.259+0000 7f550cf67640 1 -- 172.21.15.55:0/547616405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f4003980 msgr2=0x7f54f4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:19.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.259+0000 7f550cf67640 1 --2- 172.21.15.55:0/547616405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54f4003980 0x7f54f4003da0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f54f800c240 tx=0x7f54f801cc30 comp rx=0 tx=0).stop 2023-08-25T04:03:19.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.259+0000 7f5506d9d640 1 -- 172.21.15.55:0/547616405 reap_dead start 2023-08-25T04:03:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.259+0000 7f550cf67640 1 -- 172.21.15.55:0/547616405 shutdown_connections 2023-08-25T04:03:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.259+0000 7f550cf67640 1 -- 172.21.15.55:0/547616405 >> 172.21.15.55:0/547616405 conn(0x7f5508069d00 msgr2=0x7f550806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.259+0000 7f550cf67640 1 -- 172.21.15.55:0/547616405 shutdown_connections 2023-08-25T04:03:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.259+0000 7f550cf67640 1 -- 172.21.15.55:0/547616405 wait complete. 2023-08-25T04:03:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.259+0000 7f550cf67640 1 Processor -- start 2023-08-25T04:03:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.259+0000 7f550cf67640 1 -- start start 2023-08-25T04:03:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f550cf67640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54f4003980 0x7f5508156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:19.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f550cf67640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55080add80 0x7f55080ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:19.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f550cf67640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550815caa0 0x7f550815cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:19.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f550cf67640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55080ae740 con 0x7f55080add80 2023-08-25T04:03:19.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f550cf67640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55081f6610 con 0x7f54f4003980 2023-08-25T04:03:19.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f550cf67640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55081f68f0 con 0x7f550815caa0 2023-08-25T04:03:19.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f54fdd9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55080add80 0x7f55080ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:19.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f54fdd9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55080add80 0x7f55080ae200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60110/0 (socket says 172.21.15.55:60110) 2023-08-25T04:03:19.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f54fdd9b640 1 -- 172.21.15.55:0/2827036857 learned_addr learned my addr 172.21.15.55:0/2827036857 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:19.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f550659c640 1 --2- 172.21.15.55:0/2827036857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54f4003980 0x7f5508156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:19.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f5506d9d640 1 --2- 172.21.15.55:0/2827036857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550815caa0 0x7f550815cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:19.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f54fdd9b640 1 -- 172.21.15.55:0/2827036857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550815caa0 msgr2=0x7f550815cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:19.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f54fdd9b640 1 --2- 172.21.15.55:0/2827036857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550815caa0 0x7f550815cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:19.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f54fdd9b640 1 -- 172.21.15.55:0/2827036857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54f4003980 msgr2=0x7f5508156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:19.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f54fdd9b640 1 --2- 172.21.15.55:0/2827036857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54f4003980 0x7f5508156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:19.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f54fdd9b640 1 -- 172.21.15.55:0/2827036857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55081f6bd0 con 0x7f55080add80 2023-08-25T04:03:19.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f550659c640 1 --2- 172.21.15.55:0/2827036857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54f4003980 0x7f5508156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:19.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f5506d9d640 1 --2- 172.21.15.55:0/2827036857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550815caa0 0x7f550815cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:19.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f54fdd9b640 1 --2- 172.21.15.55:0/2827036857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55080add80 0x7f55080ae200 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f54f0009160 tx=0x7f54f0011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:19.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f54ff7fe640 1 -- 172.21.15.55:0/2827036857 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0004220 con 0x7f55080add80 2023-08-25T04:03:19.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f54ff7fe640 1 -- 172.21.15.55:0/2827036857 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f0004380 con 0x7f55080add80 2023-08-25T04:03:19.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f54ff7fe640 1 -- 172.21.15.55:0/2827036857 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f0015890 con 0x7f55080add80 2023-08-25T04:03:19.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f550cf67640 1 -- 172.21.15.55:0/2827036857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55081f6eb0 con 0x7f55080add80 2023-08-25T04:03:19.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f550cf67640 1 -- 172.21.15.55:0/2827036857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55080c6260 con 0x7f55080add80 2023-08-25T04:03:19.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.263+0000 7f550cf67640 1 -- 172.21.15.55:0/2827036857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55080b1c10 con 0x7f55080add80 2023-08-25T04:03:19.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.267+0000 7f54ff7fe640 1 -- 172.21.15.55:0/2827036857 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f54f00159f0 con 0x7f55080add80 2023-08-25T04:03:19.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.267+0000 7f54ff7fe640 1 --2- 172.21.15.55:0/2827036857 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f54e8065680 0x7f54e8067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:19.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.267+0000 7f54ff7fe640 1 -- 172.21.15.55:0/2827036857 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f54f0083310 con 0x7f55080add80 2023-08-25T04:03:19.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.267+0000 7f550659c640 1 --2- 172.21.15.55:0/2827036857 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f54e8065680 0x7f54e8067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:19.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.267+0000 7f550659c640 1 --2- 172.21.15.55:0/2827036857 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f54e8065680 0x7f54e8067b40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f54f80aa000 tx=0x7f54f8001a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:19.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.271+0000 7f54ff7fe640 1 -- 172.21.15.55:0/2827036857 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f55080b1c10 con 0x7f55080add80 2023-08-25T04:03:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.459+0000 7f550cf67640 1 -- 172.21.15.55:0/2827036857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f55080b1c10 con 0x7f55080add80 2023-08-25T04:03:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.459+0000 7f54ff7fe640 1 -- 172.21.15.55:0/2827036857 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f55080b1c10 con 0x7f55080add80 2023-08-25T04:03:19.462 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T04:03:19.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.463+0000 7f550cf67640 1 -- 172.21.15.55:0/2827036857 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f54e8065680 msgr2=0x7f54e8067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:19.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.463+0000 7f550cf67640 1 --2- 172.21.15.55:0/2827036857 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f54e8065680 0x7f54e8067b40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f54f80aa000 tx=0x7f54f8001a80 comp rx=0 tx=0).stop 2023-08-25T04:03:19.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.463+0000 7f550cf67640 1 -- 172.21.15.55:0/2827036857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55080add80 msgr2=0x7f55080ae200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:19.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.463+0000 7f550cf67640 1 --2- 172.21.15.55:0/2827036857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55080add80 0x7f55080ae200 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f54f0009160 tx=0x7f54f0011a60 comp rx=0 tx=0).stop 2023-08-25T04:03:19.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.463+0000 7f550cf67640 1 -- 172.21.15.55:0/2827036857 shutdown_connections 2023-08-25T04:03:19.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.463+0000 7f550cf67640 1 --2- 172.21.15.55:0/2827036857 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f54e8065680 0x7f54e8067b40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:19.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.463+0000 7f550cf67640 1 --2- 172.21.15.55:0/2827036857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550815caa0 0x7f550815cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:19.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.463+0000 7f550cf67640 1 --2- 172.21.15.55:0/2827036857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55080add80 0x7f55080ae200 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.463+0000 7f550cf67640 1 --2- 172.21.15.55:0/2827036857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54f4003980 0x7f5508156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.463+0000 7f550cf67640 1 -- 172.21.15.55:0/2827036857 >> 172.21.15.55:0/2827036857 conn(0x7f5508069d00 msgr2=0x7f550806f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.463+0000 7f550cf67640 1 -- 172.21.15.55:0/2827036857 shutdown_connections 2023-08-25T04:03:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:19.463+0000 7f550cf67640 1 -- 172.21.15.55:0/2827036857 wait complete. 2023-08-25T04:03:19.483 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-25T04:03:19.483 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:03:19.483 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-08-25T04:03:19.483 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-08-25T04:03:19.484 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-25T04:03:19.484 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-25T04:03:19.484 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-25T04:03:19.485 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:03:19.485 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-08-25T04:03:19.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:19.486 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-08-25T04:03:19.496 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:03:19.497 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:03:19.497 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:03:19.497 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:19.497 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-08-25T04:03:19.497 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:19.497 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:03:19.498 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:19.498 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-08-25T04:03:19.498 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:03:19.498 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:19.498 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-08-25T04:03:19.498 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:03:19.498 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:19.498 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-08-25T04:03:19.499 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-08-25T04:03:19.499 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42389sec preferred_lft 42389sec 2023-08-25T04:03:19.499 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-08-25T04:03:19.499 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:19.500 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:03:19.500 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:19.500 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-08-25T04:03:19.500 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-25T04:03:19.500 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:98:6a:38:6a brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:19.501 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-25T04:03:19.501 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:19.501 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:03:19.501 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:19.501 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T04:03:19.502 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:19.502 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-08-25T04:03:19.502 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:19.502 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:03:19.503 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T04:03:19.503 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-08-25T04:03:19.503 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:19.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:19.503 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:03:19.558 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-08-25T04:03:19.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:19.560 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-08-25T04:03:19.615 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-08-25T04:03:19.615 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:03:19.616 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-08-25T04:03:19.616 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-25T04:03:19.616 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-08-25T04:03:19.616 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:03:19.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:19.617 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T04:03:19.617 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T04:03:19.618 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-25T04:03:19.619 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-25T04:03:19.619 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-25T04:03:19.619 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T04:03:19.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:19.713 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-08-25T04:03:19.722 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-25T04:03:19.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:19.723 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2023-08-25T04:03:19.776 INFO:teuthology.orchestra.run.smithi055.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-08-25T04:03:19.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:19.777 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T04:03:19.778 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T04:03:19.778 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-25T04:03:19.778 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-08-25T04:03:19.778 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T04:03:19.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:19.859 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-25T04:03:19.929 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:03:19.930 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:03:19.930 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:03:19.930 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:19.931 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-08-25T04:03:19.931 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:19.931 INFO:teuthology.orchestra.run.smithi055.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:03:19.931 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 22:e2:77:43:3f:cb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-25T04:03:19.931 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-25T04:03:19.931 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:19.932 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::20e2:77ff:fe43:3fcb/64 scope link 2023-08-25T04:03:19.932 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:19.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:19.933 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-25T04:03:19.996 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:03:19.996 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:03:19.997 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:03:19.997 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:19.997 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-08-25T04:03:19.997 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:19.997 INFO:teuthology.orchestra.run.smithi055.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:03:19.997 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 22:e2:77:43:3f:cb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-25T04:03:19.997 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-25T04:03:19.998 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:19.998 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::20e2:77ff:fe43:3fcb/64 scope link 2023-08-25T04:03:19.998 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:19.999 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-08-25T04:03:19.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:20.000 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T04:03:20.000 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T04:03:20.001 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-08-25T04:03:20.001 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-25T04:03:20.001 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-08-25T04:03:20.001 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-08-25T04:03:20.002 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-08-25T04:03:20.002 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T04:03:20.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:20.146 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T04:03:20.146 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T04:03:20.146 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.1 up 2023-08-25T04:03:20.147 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.1 master ceph-brx 2023-08-25T04:03:20.147 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T04:03:20.190 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:03:20.190 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-08-25T04:03:20.241 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-08-25T04:03:20.241 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:03:20.242 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-08-25T04:03:20.290 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-08-25T04:03:20.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:20.291 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:03:20.388 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:03:20.388 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:03:20.397 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:03:20.397 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:03:20.397 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.110:3300,172.21.15.110:3301" 2023-08-25T04:03:20.397 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 2@2d2a9024-b152-4d40-880c-1686d1810590.cephfs=/ 2023-08-25T04:03:20.398 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.55:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2023-08-25T04:03:20.400 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T04:03:20.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:20.401 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-08-25T04:03:20.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:20.423 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:03:20.478 INFO:teuthology.orchestra.run.smithi055.stdout:client4526 2023-08-25T04:03:20.478 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:03:20.479 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:03:20.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:20.528 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:03:20.582 INFO:teuthology.orchestra.run.smithi055.stdout:client4526 2023-08-25T04:03:20.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:20.583 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:03:20.633 INFO:teuthology.orchestra.run.smithi055.stdout:client4526 2023-08-25T04:03:20.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:20.634 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/2d2a9024-b152-4d40-880c-1686d1810590.client4526/status') 2023-08-25T04:03:20.696 INFO:teuthology.orchestra.run.smithi055.stdout:instance: client.4526 (3)172.21.15.55:0/1964950803 2023-08-25T04:03:20.696 INFO:teuthology.orchestra.run.smithi055.stdout:blocklisted: false 2023-08-25T04:03:20.696 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records in 2023-08-25T04:03:20.696 INFO:teuthology.orchestra.run.smithi055.stderr:0+1 records out 2023-08-25T04:03:20.697 INFO:teuthology.orchestra.run.smithi055.stderr:70 bytes copied, 5.6039e-05 s, 1.2 MB/s 2023-08-25T04:03:20.697 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-08-25T04:03:20.698 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-25T04:03:20.698 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-25T04:03:20.698 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:03:20.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febc67fa640 1 Processor -- start 2023-08-25T04:03:20.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febc67fa640 1 -- start start 2023-08-25T04:03:20.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febc67fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febc00d0da0 0x7febc00d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:20.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febc67fa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7febc00b3e50 0x7febc00ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:20.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febc67fa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc00b29b0 con 0x7febc00cdde0 2023-08-25T04:03:20.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febc67fa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc00ce760 con 0x7febc00b3e50 2023-08-25T04:03:20.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febc67fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc00d16c0 con 0x7febc00d0da0 2023-08-25T04:03:20.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febbffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febc00d0da0 0x7febc00d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:20.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febc4d97640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7febc00b3e50 0x7febc00ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:20.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febbffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febc00d0da0 0x7febc00d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:50054/0 (socket says 172.21.15.55:50054) 2023-08-25T04:03:20.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febc4d97640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7febc00b3e50 0x7febc00ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:56854/0 (socket says 172.21.15.55:56854) 2023-08-25T04:03:20.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febbf7fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7febc00cdde0 0x7febc00cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:59098/0 (socket says 172.21.15.55:59098) 2023-08-25T04:03:20.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febbffff640 1 -- 172.21.15.55:0/2049253378 learned_addr learned my addr 172.21.15.55:0/2049253378 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:20.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febbffff640 1 -- 172.21.15.55:0/2049253378 >> v2:172.21.15.110:3300/0 conn(0x7febc00b3e50 msgr2=0x7febc00ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:20.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febbffff640 1 --2- 172.21.15.55:0/2049253378 >> v2:172.21.15.110:3300/0 conn(0x7febc00b3e50 0x7febc00ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:20.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febbffff640 1 -- 172.21.15.55:0/2049253378 >> v1:172.21.15.110:6789/0 conn(0x7febc00cdde0 legacy=0x7febc00cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:20.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febbeffd640 1 -- 172.21.15.55:0/2049253378 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610586705 0 0) 0x7febc00b29b0 con 0x7febc00cdde0 2023-08-25T04:03:20.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febbffff640 1 -- 172.21.15.55:0/2049253378 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc00b1dc0 con 0x7febc00d0da0 2023-08-25T04:03:20.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.879+0000 7febc4d97640 1 --2- 172.21.15.55:0/2049253378 >> v2:172.21.15.110:3300/0 conn(0x7febc00b3e50 0x7febc00ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:20.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.883+0000 7febbffff640 1 --2- 172.21.15.55:0/2049253378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febc00d0da0 0x7febc00d1180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7febb0006fd0 tx=0x7febb001ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c99bd6a385e5150d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:20.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.883+0000 7febbeffd640 1 -- 172.21.15.55:0/2049253378 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb00a8a10 con 0x7febc00d0da0 2023-08-25T04:03:20.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.883+0000 7febbeffd640 1 -- 172.21.15.55:0/2049253378 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb00a8b70 con 0x7febc00d0da0 2023-08-25T04:03:20.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.883+0000 7febbeffd640 1 -- 172.21.15.55:0/2049253378 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb00b0440 con 0x7febc00d0da0 2023-08-25T04:03:20.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febc67fa640 1 -- 172.21.15.55:0/2049253378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febc00d0da0 msgr2=0x7febc00d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:20.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febc67fa640 1 --2- 172.21.15.55:0/2049253378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febc00d0da0 0x7febc00d1180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7febb0006fd0 tx=0x7febb001ed10 comp rx=0 tx=0).stop 2023-08-25T04:03:20.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febc67fa640 1 -- 172.21.15.55:0/2049253378 shutdown_connections 2023-08-25T04:03:20.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febc67fa640 1 --2- 172.21.15.55:0/2049253378 >> v2:172.21.15.110:3300/0 conn(0x7febc00b3e50 0x7febc00ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:20.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febc67fa640 1 --2- 172.21.15.55:0/2049253378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febc00d0da0 0x7febc00d1180 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:20.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febc67fa640 1 -- 172.21.15.55:0/2049253378 >> 172.21.15.55:0/2049253378 conn(0x7febc009bae0 msgr2=0x7febc00d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:20.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febc67fa640 1 -- 172.21.15.55:0/2049253378 shutdown_connections 2023-08-25T04:03:20.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febc67fa640 1 -- 172.21.15.55:0/2049253378 wait complete. 2023-08-25T04:03:20.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febc67fa640 1 Processor -- start 2023-08-25T04:03:20.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febc67fa640 1 -- start start 2023-08-25T04:03:20.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febc67fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc00b3e50 0x7febc00cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:20.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febc67fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febc00cdde0 0x7febc01f1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:20.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febc67fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febc00d0da0 0x7febc00d28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:20.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febc67fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc015da40 con 0x7febc00b3e50 2023-08-25T04:03:20.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febc67fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc00c7e40 con 0x7febc00d0da0 2023-08-25T04:03:20.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febc67fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc00c8120 con 0x7febc00cdde0 2023-08-25T04:03:20.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febbffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc00b3e50 0x7febc00cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:20.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febbffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc00b3e50 0x7febc00cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47194/0 (socket says 172.21.15.55:47194) 2023-08-25T04:03:20.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febbffff640 1 -- 172.21.15.55:0/3599470896 learned_addr learned my addr 172.21.15.55:0/3599470896 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:20.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febbf7fe640 1 --2- 172.21.15.55:0/3599470896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febc00cdde0 0x7febc01f1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:20.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febc4d97640 1 --2- 172.21.15.55:0/3599470896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febc00d0da0 0x7febc00d28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:20.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febbffff640 1 -- 172.21.15.55:0/3599470896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febc00cdde0 msgr2=0x7febc01f1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:20.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febbffff640 1 --2- 172.21.15.55:0/3599470896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febc00cdde0 0x7febc01f1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:20.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febbffff640 1 -- 172.21.15.55:0/3599470896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febc00d0da0 msgr2=0x7febc00d28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:20.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febbffff640 1 --2- 172.21.15.55:0/3599470896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febc00d0da0 0x7febc00d28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:20.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febbffff640 1 -- 172.21.15.55:0/3599470896 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb8009a70 con 0x7febc00b3e50 2023-08-25T04:03:20.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.887+0000 7febc4d97640 1 --2- 172.21.15.55:0/3599470896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febc00d0da0 0x7febc00d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:20.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.891+0000 7febbffff640 1 --2- 172.21.15.55:0/3599470896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc00b3e50 0x7febc00cb2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7febb009b530 tx=0x7febb001d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:20.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.891+0000 7febbcff9640 1 -- 172.21.15.55:0/3599470896 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb00be070 con 0x7febc00b3e50 2023-08-25T04:03:20.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.891+0000 7febbcff9640 1 -- 172.21.15.55:0/3599470896 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb0004030 con 0x7febc00b3e50 2023-08-25T04:03:20.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.891+0000 7febbcff9640 1 -- 172.21.15.55:0/3599470896 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb00043a0 con 0x7febc00b3e50 2023-08-25T04:03:20.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.891+0000 7febc67fa640 1 -- 172.21.15.55:0/3599470896 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb0009480 con 0x7febc00b3e50 2023-08-25T04:03:20.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.891+0000 7febc67fa640 1 -- 172.21.15.55:0/3599470896 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc00c86e0 con 0x7febc00b3e50 2023-08-25T04:03:20.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.891+0000 7febc67fa640 1 -- 172.21.15.55:0/3599470896 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc004dbe0 con 0x7febc00b3e50 2023-08-25T04:03:20.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.891+0000 7febbcff9640 1 -- 172.21.15.55:0/3599470896 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7febb00b7040 con 0x7febc00b3e50 2023-08-25T04:03:20.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.891+0000 7febbcff9640 1 --2- 172.21.15.55:0/3599470896 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7febac065680 0x7febac067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:20.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.891+0000 7febbcff9640 1 -- 172.21.15.55:0/3599470896 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7febb0120120 con 0x7febc00b3e50 2023-08-25T04:03:20.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.891+0000 7febbf7fe640 1 --2- 172.21.15.55:0/3599470896 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7febac065680 0x7febac067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:20.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.895+0000 7febbf7fe640 1 --2- 172.21.15.55:0/3599470896 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7febac065680 0x7febac067b40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7febc00d35a0 tx=0x7febb4007d60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:20.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:20.895+0000 7febbcff9640 1 -- 172.21.15.55:0/3599470896 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7febb00edbd0 con 0x7febc00b3e50 2023-08-25T04:03:21.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:21.083+0000 7febc67fa640 1 -- 172.21.15.55:0/3599470896 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7febc00d0b80 con 0x7febc00b3e50 2023-08-25T04:03:21.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:21.083+0000 7febbcff9640 1 -- 172.21.15.55:0/3599470896 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7febb00f11f0 con 0x7febc00b3e50 2023-08-25T04:03:21.171 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T04:03:21.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:21.087+0000 7febc67fa640 1 -- 172.21.15.55:0/3599470896 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7febac065680 msgr2=0x7febac067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:21.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:21.087+0000 7febc67fa640 1 --2- 172.21.15.55:0/3599470896 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7febac065680 0x7febac067b40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7febc00d35a0 tx=0x7febb4007d60 comp rx=0 tx=0).stop 2023-08-25T04:03:21.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:21.087+0000 7febc67fa640 1 -- 172.21.15.55:0/3599470896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc00b3e50 msgr2=0x7febc00cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:21.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:21.087+0000 7febc67fa640 1 --2- 172.21.15.55:0/3599470896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc00b3e50 0x7febc00cb2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7febb009b530 tx=0x7febb001d550 comp rx=0 tx=0).stop 2023-08-25T04:03:21.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:21.087+0000 7febc67fa640 1 -- 172.21.15.55:0/3599470896 shutdown_connections 2023-08-25T04:03:21.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:21.087+0000 7febc67fa640 1 --2- 172.21.15.55:0/3599470896 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7febac065680 0x7febac067b40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:21.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:21.087+0000 7febc67fa640 1 --2- 172.21.15.55:0/3599470896 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febc00d0da0 0x7febc00d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:21.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:21.087+0000 7febc67fa640 1 --2- 172.21.15.55:0/3599470896 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febc00cdde0 0x7febc01f1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:21.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:21.087+0000 7febc67fa640 1 --2- 172.21.15.55:0/3599470896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc00b3e50 0x7febc00cb2f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:21.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:21.087+0000 7febc67fa640 1 -- 172.21.15.55:0/3599470896 >> 172.21.15.55:0/3599470896 conn(0x7febc009bae0 msgr2=0x7febc00cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:21.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:21.087+0000 7febc67fa640 1 -- 172.21.15.55:0/3599470896 shutdown_connections 2023-08-25T04:03:21.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:21.087+0000 7febc67fa640 1 -- 172.21.15.55:0/3599470896 wait complete. 2023-08-25T04:03:21.174 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-25T04:03:21.174 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:03:21.174 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2023-08-25T04:03:21.174 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-25T04:03:21.175 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-25T04:03:21.175 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-25T04:03:21.175 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-25T04:03:21.175 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:03:21.175 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-25T04:03:21.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:21.176 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2023-08-25T04:03:21.194 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:03:21.194 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:03:21.194 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:03:21.195 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:21.195 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2023-08-25T04:03:21.195 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:21.195 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:03:21.195 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:21.195 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2023-08-25T04:03:21.195 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:03:21.196 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:21.196 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2023-08-25T04:03:21.196 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:03:21.197 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:21.197 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:03:21.197 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:21.197 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-25T04:03:21.197 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42387sec preferred_lft 42387sec 2023-08-25T04:03:21.198 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2023-08-25T04:03:21.198 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:21.198 INFO:teuthology.orchestra.run.smithi110.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-25T04:03:21.198 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 02:42:c0:b1:3e:04 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:21.198 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-25T04:03:21.198 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:21.199 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-25T04:03:21.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:21.199 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2023-08-25T04:03:21.200 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2023-08-25T04:03:21.200 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add name ceph-brx type bridge 2023-08-25T04:03:21.200 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr flush dev ceph-brx 2023-08-25T04:03:21.201 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set ceph-brx up 2023-08-25T04:03:21.201 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-25T04:03:21.201 DEBUG:teuthology.orchestra.run.smithi110:> ') 2023-08-25T04:03:21.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:21.316 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:03:21.337 INFO:teuthology.orchestra.run.smithi110.stdout:1 2023-08-25T04:03:21.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:21.339 DEBUG:teuthology.orchestra.run.smithi110:> route 2023-08-25T04:03:21.413 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2023-08-25T04:03:21.413 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:03:21.413 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-25T04:03:21.413 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-25T04:03:21.414 INFO:teuthology.orchestra.run.smithi110.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-25T04:03:21.414 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-25T04:03:21.414 INFO:teuthology.orchestra.run.smithi110.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-25T04:03:21.414 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-25T04:03:21.414 INFO:teuthology.orchestra.run.smithi110.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-25T04:03:21.414 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:03:21.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:21.415 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2023-08-25T04:03:21.415 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2023-08-25T04:03:21.415 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-25T04:03:21.416 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-25T04:03:21.416 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-25T04:03:21.416 DEBUG:teuthology.orchestra.run.smithi110:> ') 2023-08-25T04:03:21.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:21.507 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2023-08-25T04:03:21.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:21.517 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list-id 2023-08-25T04:03:21.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:21.568 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2023-08-25T04:03:21.568 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2023-08-25T04:03:21.568 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-25T04:03:21.569 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-08-25T04:03:21.569 DEBUG:teuthology.orchestra.run.smithi110:> ') 2023-08-25T04:03:21.651 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-08-25T04:03:21.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:21.652 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2023-08-25T04:03:21.652 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2023-08-25T04:03:21.652 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-08-25T04:03:21.652 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-25T04:03:21.653 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-08-25T04:03:21.653 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-08-25T04:03:21.653 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-08-25T04:03:21.653 DEBUG:teuthology.orchestra.run.smithi110:> ') 2023-08-25T04:03:21.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:21.813 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2023-08-25T04:03:21.814 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2023-08-25T04:03:21.814 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2023-08-25T04:03:21.815 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set dev brx.0 master ceph-brx 2023-08-25T04:03:21.815 DEBUG:teuthology.orchestra.run.smithi110:> ') 2023-08-25T04:03:21.857 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:03:21.857 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-25T04:03:21.911 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-25T04:03:21.911 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:03:21.911 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-25T04:03:21.966 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-08-25T04:03:21.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:21.967 DEBUG:teuthology.orchestra.run.smithi110:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:03:22.070 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:03:22.070 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:03:22.184 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:03:22.184 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:03:22.185 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.110:3300,172.21.15.110:3301" 2023-08-25T04:03:22.185 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: trying mount with new device syntax: 1@2d2a9024-b152-4d40-880c-1686d1810590.cephfs=/ 2023-08-25T04:03:22.185 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.55:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2023-08-25T04:03:22.188 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T04:03:22.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:22.188 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-25T04:03:22.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:22.211 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:03:22.266 INFO:teuthology.orchestra.run.smithi110.stdout:client4678 2023-08-25T04:03:22.266 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:03:22.267 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:03:22.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:22.315 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:03:22.369 INFO:teuthology.orchestra.run.smithi110.stdout:client4678 2023-08-25T04:03:22.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:22.370 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:03:22.426 INFO:teuthology.orchestra.run.smithi110.stdout:client4678 2023-08-25T04:03:22.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:22.427 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/2d2a9024-b152-4d40-880c-1686d1810590.client4678/status') 2023-08-25T04:03:22.487 INFO:teuthology.orchestra.run.smithi110.stdout:instance: client.4678 (3)192.168.0.1:0/2542974121 2023-08-25T04:03:22.488 INFO:teuthology.orchestra.run.smithi110.stdout:blocklisted: false 2023-08-25T04:03:22.488 INFO:teuthology.orchestra.run.smithi110.stderr:0+1 records in 2023-08-25T04:03:22.488 INFO:teuthology.orchestra.run.smithi110.stderr:0+1 records out 2023-08-25T04:03:22.489 INFO:teuthology.orchestra.run.smithi110.stderr:69 bytes copied, 6.6896e-05 s, 1.0 MB/s 2023-08-25T04:03:22.490 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-08-25T04:03:22.490 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-25T04:03:22.491 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-25T04:03:22.491 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:03:22.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.643+0000 7f13a1f2c640 1 Processor -- start 2023-08-25T04:03:22.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.643+0000 7f13a1f2c640 1 -- start start 2023-08-25T04:03:22.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.647+0000 7f13a1f2c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f139c0d0da0 0x7f139c0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:22.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.647+0000 7f13a1f2c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f139c0b3e50 0x7f139c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:22.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.647+0000 7f13a1f2c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139c0b29b0 con 0x7f139c0cdde0 2023-08-25T04:03:22.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.647+0000 7f13a1f2c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139c0ce760 con 0x7f139c0b3e50 2023-08-25T04:03:22.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.647+0000 7f13a1f2c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139c0d16c0 con 0x7f139c0d0da0 2023-08-25T04:03:22.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.647+0000 7f139bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f139c0b3e50 0x7f139c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:22.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.647+0000 7f139bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f139c0b3e50 0x7f139c0ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47196/0 (socket says 172.21.15.55:47196) 2023-08-25T04:03:22.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.647+0000 7f139bfff640 1 -- 172.21.15.55:0/340003121 learned_addr learned my addr 172.21.15.55:0/340003121 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:22.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.647+0000 7f139b7fe640 1 --2- 172.21.15.55:0/340003121 >> v2:172.21.15.110:3300/0 conn(0x7f139c0d0da0 0x7f139c0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:22.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.647+0000 7f139bfff640 1 -- 172.21.15.55:0/340003121 >> v2:172.21.15.110:3300/0 conn(0x7f139c0d0da0 msgr2=0x7f139c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:22.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.647+0000 7f139bfff640 1 --2- 172.21.15.55:0/340003121 >> v2:172.21.15.110:3300/0 conn(0x7f139c0d0da0 0x7f139c0d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:22.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.647+0000 7f139bfff640 1 -- 172.21.15.55:0/340003121 >> v1:172.21.15.110:6789/0 conn(0x7f139c0cdde0 legacy=0x7f139c0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:22.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.647+0000 7f139bfff640 1 -- 172.21.15.55:0/340003121 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139c0b1dc0 con 0x7f139c0b3e50 2023-08-25T04:03:22.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.651+0000 7f139bfff640 1 --2- 172.21.15.55:0/340003121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f139c0b3e50 0x7f139c0ce220 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f139c073720 tx=0x7f139401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4aa899fddbb1cb3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:22.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.651+0000 7f139affd640 1 -- 172.21.15.55:0/340003121 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13940af400 con 0x7f139c0b3e50 2023-08-25T04:03:22.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.651+0000 7f139affd640 1 -- 172.21.15.55:0/340003121 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13940ab050 con 0x7f139c0b3e50 2023-08-25T04:03:22.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.651+0000 7f139affd640 1 -- 172.21.15.55:0/340003121 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13940af780 con 0x7f139c0b3e50 2023-08-25T04:03:22.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.651+0000 7f13a1f2c640 1 -- 172.21.15.55:0/340003121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f139c0b3e50 msgr2=0x7f139c0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:22.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.651+0000 7f13a1f2c640 1 --2- 172.21.15.55:0/340003121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f139c0b3e50 0x7f139c0ce220 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f139c073720 tx=0x7f139401f1c0 comp rx=0 tx=0).stop 2023-08-25T04:03:22.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.651+0000 7f13a1f2c640 1 -- 172.21.15.55:0/340003121 shutdown_connections 2023-08-25T04:03:22.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.651+0000 7f13a1f2c640 1 --2- 172.21.15.55:0/340003121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f139c0b3e50 0x7f139c0ce220 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:22.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.651+0000 7f13a1f2c640 1 --2- 172.21.15.55:0/340003121 >> v2:172.21.15.110:3300/0 conn(0x7f139c0d0da0 0x7f139c0d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:22.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.651+0000 7f13a1f2c640 1 -- 172.21.15.55:0/340003121 >> 172.21.15.55:0/340003121 conn(0x7f139c09bae0 msgr2=0x7f139c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:22.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.651+0000 7f13a1f2c640 1 -- 172.21.15.55:0/340003121 shutdown_connections 2023-08-25T04:03:22.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.651+0000 7f13a1f2c640 1 -- 172.21.15.55:0/340003121 wait complete. 2023-08-25T04:03:22.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.651+0000 7f13a1f2c640 1 Processor -- start 2023-08-25T04:03:22.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.651+0000 7f13a1f2c640 1 -- start start 2023-08-25T04:03:22.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.651+0000 7f13a1f2c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f139c0b3e50 0x7f139c1517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:22.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f13a1f2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f139c0cdde0 0x7f139c0cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:22.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f13a1f2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f139c0d0da0 0x7f139c0c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:22.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f13a1f2c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c0c99c0 con 0x7f139c0d0da0 2023-08-25T04:03:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f13a1f2c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c0c9ca0 con 0x7f139c0cdde0 2023-08-25T04:03:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f13a1f2c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139c0c9f80 con 0x7f139c0b3e50 2023-08-25T04:03:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f139bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f139c0d0da0 0x7f139c0c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f1393fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f139c0cdde0 0x7f139c0cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f139b7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f139c0b3e50 0x7f139c1517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f1393fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f139c0cdde0 0x7f139c0cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:56882/0 (socket says 172.21.15.55:56882) 2023-08-25T04:03:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f1393fff640 1 -- 172.21.15.55:0/2602851885 learned_addr learned my addr 172.21.15.55:0/2602851885 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:22.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f1393fff640 1 -- 172.21.15.55:0/2602851885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f139c0b3e50 msgr2=0x7f139c1517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:22.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f1393fff640 1 --2- 172.21.15.55:0/2602851885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f139c0b3e50 0x7f139c1517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:22.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f1393fff640 1 -- 172.21.15.55:0/2602851885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f139c0d0da0 msgr2=0x7f139c0c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:22.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f1393fff640 1 --2- 172.21.15.55:0/2602851885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f139c0d0da0 0x7f139c0c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:22.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f1393fff640 1 -- 172.21.15.55:0/2602851885 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1394009b30 con 0x7f139c0cdde0 2023-08-25T04:03:22.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f139bfff640 1 --2- 172.21.15.55:0/2602851885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f139c0d0da0 0x7f139c0c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:22.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f1393fff640 1 --2- 172.21.15.55:0/2602851885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f139c0cdde0 0x7f139c0cbdb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f138400c500 tx=0x7f138400c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:22.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f1398ff9640 1 -- 172.21.15.55:0/2602851885 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1384005220 con 0x7f139c0cdde0 2023-08-25T04:03:22.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f1398ff9640 1 -- 172.21.15.55:0/2602851885 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1384005380 con 0x7f139c0cdde0 2023-08-25T04:03:22.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f1398ff9640 1 -- 172.21.15.55:0/2602851885 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1384007270 con 0x7f139c0cdde0 2023-08-25T04:03:22.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f13a1f2c640 1 -- 172.21.15.55:0/2602851885 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139c0ca260 con 0x7f139c0cdde0 2023-08-25T04:03:22.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f13a1f2c640 1 -- 172.21.15.55:0/2602851885 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139c151f20 con 0x7f139c0cdde0 2023-08-25T04:03:22.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.655+0000 7f13a1f2c640 1 -- 172.21.15.55:0/2602851885 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139c0ca4a0 con 0x7f139c0cdde0 2023-08-25T04:03:22.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.659+0000 7f1398ff9640 1 -- 172.21.15.55:0/2602851885 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f13840073d0 con 0x7f139c0cdde0 2023-08-25T04:03:22.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.659+0000 7f1398ff9640 1 --2- 172.21.15.55:0/2602851885 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f137c065680 0x7f137c067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:22.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.659+0000 7f1398ff9640 1 -- 172.21.15.55:0/2602851885 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1384082140 con 0x7f139c0cdde0 2023-08-25T04:03:22.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.659+0000 7f139b7fe640 1 --2- 172.21.15.55:0/2602851885 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f137c065680 0x7f137c067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:22.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.659+0000 7f139b7fe640 1 --2- 172.21.15.55:0/2602851885 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f137c065680 0x7f137c067b40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f138c009b40 tx=0x7f138c006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:22.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.663+0000 7f1398ff9640 1 -- 172.21.15.55:0/2602851885 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f139c0ca4a0 con 0x7f139c0cdde0 2023-08-25T04:03:22.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.855+0000 7f13a1f2c640 1 -- 172.21.15.55:0/2602851885 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f139c0ca4a0 con 0x7f139c0cdde0 2023-08-25T04:03:22.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.855+0000 7f1398ff9640 1 -- 172.21.15.55:0/2602851885 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f139c0ca4a0 con 0x7f139c0cdde0 2023-08-25T04:03:22.859 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T04:03:22.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.859+0000 7f13a1f2c640 1 -- 172.21.15.55:0/2602851885 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f137c065680 msgr2=0x7f137c067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:22.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.859+0000 7f13a1f2c640 1 --2- 172.21.15.55:0/2602851885 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f137c065680 0x7f137c067b40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f138c009b40 tx=0x7f138c006f90 comp rx=0 tx=0).stop 2023-08-25T04:03:22.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.859+0000 7f13a1f2c640 1 -- 172.21.15.55:0/2602851885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f139c0cdde0 msgr2=0x7f139c0cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:22.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.859+0000 7f13a1f2c640 1 --2- 172.21.15.55:0/2602851885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f139c0cdde0 0x7f139c0cbdb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f138400c500 tx=0x7f138400c9c0 comp rx=0 tx=0).stop 2023-08-25T04:03:22.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.859+0000 7f13a1f2c640 1 -- 172.21.15.55:0/2602851885 shutdown_connections 2023-08-25T04:03:22.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.859+0000 7f13a1f2c640 1 --2- 172.21.15.55:0/2602851885 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f137c065680 0x7f137c067b40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:22.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.859+0000 7f13a1f2c640 1 --2- 172.21.15.55:0/2602851885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f139c0d0da0 0x7f139c0c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:22.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.859+0000 7f13a1f2c640 1 --2- 172.21.15.55:0/2602851885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f139c0cdde0 0x7f139c0cbdb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:22.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.859+0000 7f13a1f2c640 1 --2- 172.21.15.55:0/2602851885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f139c0b3e50 0x7f139c1517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:22.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.859+0000 7f13a1f2c640 1 -- 172.21.15.55:0/2602851885 >> 172.21.15.55:0/2602851885 conn(0x7f139c09bae0 msgr2=0x7f139c06ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:22.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.859+0000 7f13a1f2c640 1 -- 172.21.15.55:0/2602851885 shutdown_connections 2023-08-25T04:03:22.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:22.859+0000 7f13a1f2c640 1 -- 172.21.15.55:0/2602851885 wait complete. 2023-08-25T04:03:22.880 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-25T04:03:22.880 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:03:22.880 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2023-08-25T04:03:22.881 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-08-25T04:03:22.881 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-25T04:03:22.881 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-25T04:03:22.882 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-25T04:03:22.882 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:03:22.882 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-08-25T04:03:22.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:22.883 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2023-08-25T04:03:22.892 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:03:22.892 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:03:22.892 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:03:22.892 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:22.893 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2023-08-25T04:03:22.893 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:22.893 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:03:22.893 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:22.893 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2023-08-25T04:03:22.893 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:03:22.893 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:22.894 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2023-08-25T04:03:22.894 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:03:22.894 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:22.894 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:03:22.894 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:22.894 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-25T04:03:22.894 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42385sec preferred_lft 42385sec 2023-08-25T04:03:22.895 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2023-08-25T04:03:22.895 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:22.895 INFO:teuthology.orchestra.run.smithi110.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-25T04:03:22.895 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 02:42:c0:b1:3e:04 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:22.895 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-25T04:03:22.896 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:22.896 INFO:teuthology.orchestra.run.smithi110.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:03:22.896 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-08-25T04:03:22.896 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T04:03:22.896 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:22.896 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-08-25T04:03:22.896 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:22.897 INFO:teuthology.orchestra.run.smithi110.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:03:22.897 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-25T04:03:22.897 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-08-25T04:03:22.897 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:22.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:22.898 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:03:22.957 INFO:teuthology.orchestra.run.smithi110.stdout:1 2023-08-25T04:03:22.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:22.960 DEBUG:teuthology.orchestra.run.smithi110:> route 2023-08-25T04:03:23.012 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2023-08-25T04:03:23.013 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:03:23.013 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-25T04:03:23.013 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-25T04:03:23.013 INFO:teuthology.orchestra.run.smithi110.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-25T04:03:23.013 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-25T04:03:23.013 INFO:teuthology.orchestra.run.smithi110.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-25T04:03:23.014 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-25T04:03:23.014 INFO:teuthology.orchestra.run.smithi110.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-25T04:03:23.014 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:03:23.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:23.015 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2023-08-25T04:03:23.015 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2023-08-25T04:03:23.015 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-25T04:03:23.015 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-25T04:03:23.016 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-25T04:03:23.016 DEBUG:teuthology.orchestra.run.smithi110:> ') 2023-08-25T04:03:23.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:23.107 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2023-08-25T04:03:23.115 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-25T04:03:23.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:23.117 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list-id 2023-08-25T04:03:23.167 INFO:teuthology.orchestra.run.smithi110.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-08-25T04:03:23.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:23.168 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2023-08-25T04:03:23.168 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2023-08-25T04:03:23.168 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-25T04:03:23.168 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-08-25T04:03:23.169 DEBUG:teuthology.orchestra.run.smithi110:> ') 2023-08-25T04:03:23.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:23.250 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-25T04:03:23.311 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:03:23.312 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:03:23.312 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:03:23.312 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:23.312 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2023-08-25T04:03:23.312 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:23.313 INFO:teuthology.orchestra.run.smithi110.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:03:23.313 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether a6:54:20:20:5e:24 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-25T04:03:23.313 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-25T04:03:23.313 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:23.313 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::a454:20ff:fe20:5e24/64 scope link tentative 2023-08-25T04:03:23.313 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:23.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:23.314 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-25T04:03:23.375 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:03:23.375 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:03:23.376 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:03:23.376 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:23.376 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2023-08-25T04:03:23.376 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:23.376 INFO:teuthology.orchestra.run.smithi110.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:03:23.376 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether a6:54:20:20:5e:24 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-25T04:03:23.376 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-25T04:03:23.377 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:23.377 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::a454:20ff:fe20:5e24/64 scope link tentative 2023-08-25T04:03:23.377 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:03:23.378 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-08-25T04:03:23.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:23.379 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2023-08-25T04:03:23.379 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2023-08-25T04:03:23.380 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-08-25T04:03:23.380 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-25T04:03:23.380 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-08-25T04:03:23.380 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-08-25T04:03:23.381 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-08-25T04:03:23.381 DEBUG:teuthology.orchestra.run.smithi110:> ') 2023-08-25T04:03:23.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:23.517 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2023-08-25T04:03:23.518 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2023-08-25T04:03:23.518 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.1 up 2023-08-25T04:03:23.518 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set dev brx.1 master ceph-brx 2023-08-25T04:03:23.518 DEBUG:teuthology.orchestra.run.smithi110:> ') 2023-08-25T04:03:23.560 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:03:23.560 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-08-25T04:03:23.610 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-08-25T04:03:23.611 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:03:23.611 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-08-25T04:03:23.662 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-08-25T04:03:23.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:23.663 DEBUG:teuthology.orchestra.run.smithi110:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:03:23.752 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:03:23.753 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:03:23.766 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:03:23.766 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:03:23.766 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.110:3300,172.21.15.110:3301" 2023-08-25T04:03:23.766 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: trying mount with new device syntax: 3@2d2a9024-b152-4d40-880c-1686d1810590.cephfs=/ 2023-08-25T04:03:23.766 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.55:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2023-08-25T04:03:23.769 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T04:03:23.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:23.770 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-08-25T04:03:23.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:23.790 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:03:23.842 INFO:teuthology.orchestra.run.smithi110.stdout:client4690 2023-08-25T04:03:23.842 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:03:23.842 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:03:23.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:23.894 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:03:23.945 INFO:teuthology.orchestra.run.smithi110.stdout:client4690 2023-08-25T04:03:23.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:23.946 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:03:23.997 INFO:teuthology.orchestra.run.smithi110.stdout:client4690 2023-08-25T04:03:23.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:23.998 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/2d2a9024-b152-4d40-880c-1686d1810590.client4690/status') 2023-08-25T04:03:24.062 INFO:teuthology.orchestra.run.smithi110.stdout:instance: client.4690 (3)192.168.0.2:0/4262615782 2023-08-25T04:03:24.062 INFO:teuthology.orchestra.run.smithi110.stdout:blocklisted: false 2023-08-25T04:03:24.063 INFO:teuthology.orchestra.run.smithi110.stderr:0+1 records in 2023-08-25T04:03:24.063 INFO:teuthology.orchestra.run.smithi110.stderr:0+1 records out 2023-08-25T04:03:24.063 INFO:teuthology.orchestra.run.smithi110.stderr:69 bytes copied, 5.2583e-05 s, 1.3 MB/s 2023-08-25T04:03:24.065 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-08-25T04:03:24.081 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:24.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.231+0000 7f1dafa5c640 1 Processor -- start 2023-08-25T04:03:24.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.235+0000 7f1dafa5c640 1 -- start start 2023-08-25T04:03:24.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.235+0000 7f1dafa5c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1da80d0da0 0x7f1da80d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:24.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.235+0000 7f1dafa5c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da80b3e50 0x7f1da80ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:24.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.235+0000 7f1dafa5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da80b29b0 con 0x7f1da80cdde0 2023-08-25T04:03:24.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.235+0000 7f1dafa5c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da80ce760 con 0x7f1da80d0da0 2023-08-25T04:03:24.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.235+0000 7f1dafa5c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80d16c0 con 0x7f1da80b3e50 2023-08-25T04:03:24.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.235+0000 7f1dacff7640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1da80cdde0 0x7f1da80cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60882/0 (socket says 172.21.15.55:60882) 2023-08-25T04:03:24.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.235+0000 7f1dacff7640 1 -- 172.21.15.55:0/2672195298 learned_addr learned my addr 172.21.15.55:0/2672195298 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:24.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.235+0000 7f1dad7f8640 1 --2- 172.21.15.55:0/2672195298 >> v2:172.21.15.110:3300/0 conn(0x7f1da80d0da0 0x7f1da80d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:24.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.235+0000 7f1dadff9640 1 --2- 172.21.15.55:0/2672195298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da80b3e50 0x7f1da80ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:24.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.235+0000 7f1d9ffff640 1 -- 172.21.15.55:0/2672195298 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230679786 0 0) 0x7f1da80b29b0 con 0x7f1da80cdde0 2023-08-25T04:03:24.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.235+0000 7f1d9ffff640 1 -- 172.21.15.55:0/2672195298 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d94003530 con 0x7f1da80cdde0 2023-08-25T04:03:24.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.235+0000 7f1dadff9640 1 -- 172.21.15.55:0/2672195298 >> v2:172.21.15.110:3300/0 conn(0x7f1da80d0da0 msgr2=0x7f1da80d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:24.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.235+0000 7f1dadff9640 1 --2- 172.21.15.55:0/2672195298 >> v2:172.21.15.110:3300/0 conn(0x7f1da80d0da0 0x7f1da80d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.235+0000 7f1dadff9640 1 -- 172.21.15.55:0/2672195298 >> v1:172.21.15.55:6789/0 conn(0x7f1da80cdde0 legacy=0x7f1da80cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:24.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.235+0000 7f1dadff9640 1 -- 172.21.15.55:0/2672195298 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da80b1dc0 con 0x7f1da80b3e50 2023-08-25T04:03:24.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.235+0000 7f1dad7f8640 1 --2- 172.21.15.55:0/2672195298 >> v2:172.21.15.110:3300/0 conn(0x7f1da80d0da0 0x7f1da80d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:24.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.239+0000 7f1dadff9640 1 --2- 172.21.15.55:0/2672195298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da80b3e50 0x7f1da80ce220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009d90 tx=0x7f1da001f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecfbf24f6dd67eb4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:24.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.239+0000 7f1d9ffff640 1 -- 172.21.15.55:0/2672195298 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da00af600 con 0x7f1da80b3e50 2023-08-25T04:03:24.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.239+0000 7f1d9ffff640 1 -- 172.21.15.55:0/2672195298 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da00ab050 con 0x7f1da80b3e50 2023-08-25T04:03:24.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.239+0000 7f1d9ffff640 1 -- 172.21.15.55:0/2672195298 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da00af980 con 0x7f1da80b3e50 2023-08-25T04:03:24.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.239+0000 7f1dafa5c640 1 -- 172.21.15.55:0/2672195298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da80b3e50 msgr2=0x7f1da80ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:24.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.239+0000 7f1dafa5c640 1 --2- 172.21.15.55:0/2672195298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da80b3e50 0x7f1da80ce220 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009d90 tx=0x7f1da001f130 comp rx=0 tx=0).stop 2023-08-25T04:03:24.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.239+0000 7f1dafa5c640 1 -- 172.21.15.55:0/2672195298 shutdown_connections 2023-08-25T04:03:24.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.239+0000 7f1dafa5c640 1 --2- 172.21.15.55:0/2672195298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da80b3e50 0x7f1da80ce220 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.239+0000 7f1dafa5c640 1 --2- 172.21.15.55:0/2672195298 >> v2:172.21.15.110:3300/0 conn(0x7f1da80d0da0 0x7f1da80d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.239+0000 7f1dafa5c640 1 -- 172.21.15.55:0/2672195298 >> 172.21.15.55:0/2672195298 conn(0x7f1da809bae0 msgr2=0x7f1da80d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:24.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.239+0000 7f1dafa5c640 1 -- 172.21.15.55:0/2672195298 shutdown_connections 2023-08-25T04:03:24.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.239+0000 7f1dafa5c640 1 -- 172.21.15.55:0/2672195298 wait complete. 2023-08-25T04:03:24.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dafa5c640 1 Processor -- start 2023-08-25T04:03:24.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dafa5c640 1 -- start start 2023-08-25T04:03:24.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dafa5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1da80b3e50 0x7f1da8151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:24.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dafa5c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da80cdde0 0x7f1da80c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:24.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dafa5c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1da80d0da0 0x7f1da80ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:24.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dafa5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da8152310 con 0x7f1da80b3e50 2023-08-25T04:03:24.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dafa5c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80cb330 con 0x7f1da80d0da0 2023-08-25T04:03:24.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dafa5c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80cb610 con 0x7f1da80cdde0 2023-08-25T04:03:24.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dad7f8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1da80b3e50 0x7f1da8151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:24.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dad7f8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1da80b3e50 0x7f1da8151dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47216/0 (socket says 172.21.15.55:47216) 2023-08-25T04:03:24.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dad7f8640 1 -- 172.21.15.55:0/50804469 learned_addr learned my addr 172.21.15.55:0/50804469 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:24.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dadff9640 1 --2- 172.21.15.55:0/50804469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1da80d0da0 0x7f1da80ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:24.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dacff7640 1 --2- 172.21.15.55:0/50804469 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da80cdde0 0x7f1da80c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:24.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dad7f8640 1 -- 172.21.15.55:0/50804469 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da80cdde0 msgr2=0x7f1da80c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:24.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dad7f8640 1 --2- 172.21.15.55:0/50804469 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da80cdde0 0x7f1da80c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dad7f8640 1 -- 172.21.15.55:0/50804469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1da80d0da0 msgr2=0x7f1da80ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:24.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dad7f8640 1 --2- 172.21.15.55:0/50804469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1da80d0da0 0x7f1da80ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dad7f8640 1 -- 172.21.15.55:0/50804469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da40093b0 con 0x7f1da80b3e50 2023-08-25T04:03:24.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dadff9640 1 --2- 172.21.15.55:0/50804469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1da80d0da0 0x7f1da80ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:24.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dad7f8640 1 --2- 172.21.15.55:0/50804469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1da80b3e50 0x7f1da8151dd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1da400ebe0 tx=0x7f1da400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:24.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1d9dffb640 1 -- 172.21.15.55:0/50804469 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da4009760 con 0x7f1da80b3e50 2023-08-25T04:03:24.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1d9dffb640 1 -- 172.21.15.55:0/50804469 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da400cc30 con 0x7f1da80b3e50 2023-08-25T04:03:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1d9dffb640 1 -- 172.21.15.55:0/50804469 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da400eee0 con 0x7f1da80b3e50 2023-08-25T04:03:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dafa5c640 1 -- 172.21.15.55:0/50804469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da0009a70 con 0x7f1da80b3e50 2023-08-25T04:03:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.243+0000 7f1dafa5c640 1 -- 172.21.15.55:0/50804469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da80b68a0 con 0x7f1da80b3e50 2023-08-25T04:03:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.247+0000 7f1dafa5c640 1 -- 172.21.15.55:0/50804469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da804dbe0 con 0x7f1da80b3e50 2023-08-25T04:03:24.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.247+0000 7f1d9dffb640 1 -- 172.21.15.55:0/50804469 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1da40059a0 con 0x7f1da80b3e50 2023-08-25T04:03:24.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.247+0000 7f1d9dffb640 1 --2- 172.21.15.55:0/50804469 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1d8c0656b0 0x7f1d8c067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:24.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.247+0000 7f1d9dffb640 1 -- 172.21.15.55:0/50804469 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1da4083230 con 0x7f1da80b3e50 2023-08-25T04:03:24.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.247+0000 7f1dacff7640 1 --2- 172.21.15.55:0/50804469 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1d8c0656b0 0x7f1d8c067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:24.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.247+0000 7f1dacff7640 1 --2- 172.21.15.55:0/50804469 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1d8c0656b0 0x7f1d8c067b70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1da80a0720 tx=0x7f1d98009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:24.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.251+0000 7f1d9dffb640 1 -- 172.21.15.55:0/50804469 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1da4054770 con 0x7f1da80b3e50 2023-08-25T04:03:24.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.407+0000 7f1dafa5c640 1 -- 172.21.15.55:0/50804469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1da80d0b80 con 0x7f1da80b3e50 2023-08-25T04:03:24.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.415+0000 7f1d9dffb640 1 -- 172.21.15.55:0/50804469 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18291 (secure 0 0 0) 0x7f1da4054300 con 0x7f1da80b3e50 2023-08-25T04:03:24.417 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:24.418 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:02.329010+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:24.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.419+0000 7f1dafa5c640 1 -- 172.21.15.55:0/50804469 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1d8c0656b0 msgr2=0x7f1d8c067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:24.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.419+0000 7f1dafa5c640 1 --2- 172.21.15.55:0/50804469 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1d8c0656b0 0x7f1d8c067b70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1da80a0720 tx=0x7f1d98009040 comp rx=0 tx=0).stop 2023-08-25T04:03:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.419+0000 7f1dafa5c640 1 -- 172.21.15.55:0/50804469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1da80b3e50 msgr2=0x7f1da8151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.419+0000 7f1dafa5c640 1 --2- 172.21.15.55:0/50804469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1da80b3e50 0x7f1da8151dd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1da400ebe0 tx=0x7f1da400c520 comp rx=0 tx=0).stop 2023-08-25T04:03:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.419+0000 7f1dafa5c640 1 -- 172.21.15.55:0/50804469 shutdown_connections 2023-08-25T04:03:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.419+0000 7f1dafa5c640 1 --2- 172.21.15.55:0/50804469 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1d8c0656b0 0x7f1d8c067b70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.419+0000 7f1dafa5c640 1 --2- 172.21.15.55:0/50804469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1da80d0da0 0x7f1da80ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.419+0000 7f1dafa5c640 1 --2- 172.21.15.55:0/50804469 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1da80cdde0 0x7f1da80c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.419+0000 7f1dafa5c640 1 --2- 172.21.15.55:0/50804469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1da80b3e50 0x7f1da8151dd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.419+0000 7f1dafa5c640 1 -- 172.21.15.55:0/50804469 >> 172.21.15.55:0/50804469 conn(0x7f1da809bae0 msgr2=0x7f1da80cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:24.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.419+0000 7f1dafa5c640 1 -- 172.21.15.55:0/50804469 shutdown_connections 2023-08-25T04:03:24.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.419+0000 7f1dafa5c640 1 -- 172.21.15.55:0/50804469 wait complete. 2023-08-25T04:03:24.438 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:02:58.890533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:03:00.093976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:03:24.439 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:03:24.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.583+0000 7f6aef340640 1 Processor -- start 2023-08-25T04:03:24.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.583+0000 7f6aef340640 1 -- start start 2023-08-25T04:03:24.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.583+0000 7f6aef340640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6ae81601f0 0x7f6ae815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:24.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.583+0000 7f6aef340640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae80d1290 0x7f6ae815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:24.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.583+0000 7f6aef340640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae80cd5a0 con 0x7f6ae815e3c0 2023-08-25T04:03:24.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.583+0000 7f6aef340640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae80cd880 con 0x7f6ae81601f0 2023-08-25T04:03:24.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.583+0000 7f6aef340640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80cdb60 con 0x7f6ae80d1290 2023-08-25T04:03:24.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.583+0000 7f6aed0dc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6ae81601f0 0x7f6ae815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:24.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.583+0000 7f6aed0dc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6ae81601f0 0x7f6ae815d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47230/0 (socket says 172.21.15.55:47230) 2023-08-25T04:03:24.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.583+0000 7f6aed0dc640 1 -- 172.21.15.55:0/4205917546 learned_addr learned my addr 172.21.15.55:0/4205917546 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:24.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.583+0000 7f6aed8dd640 1 --2- 172.21.15.55:0/4205917546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae80d1290 0x7f6ae815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:24.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.583+0000 7f6aed0dc640 1 -- 172.21.15.55:0/4205917546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae80d1290 msgr2=0x7f6ae815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:24.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.583+0000 7f6aed0dc640 1 --2- 172.21.15.55:0/4205917546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae80d1290 0x7f6ae815e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.583+0000 7f6aed0dc640 1 -- 172.21.15.55:0/4205917546 >> v1:172.21.15.110:6789/0 conn(0x7f6ae815e3c0 legacy=0x7f6ae80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:24.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.583+0000 7f6aed0dc640 1 -- 172.21.15.55:0/4205917546 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae80cde40 con 0x7f6ae81601f0 2023-08-25T04:03:24.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.587+0000 7f6aed0dc640 1 --2- 172.21.15.55:0/4205917546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ae81601f0 0x7f6ae815d430 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009860 tx=0x7f6ae401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26787a5cc5a904c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:24.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.587+0000 7f6adffff640 1 -- 172.21.15.55:0/4205917546 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40a8a10 con 0x7f6ae81601f0 2023-08-25T04:03:24.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.587+0000 7f6adffff640 1 -- 172.21.15.55:0/4205917546 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae40a8b70 con 0x7f6ae81601f0 2023-08-25T04:03:24.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.587+0000 7f6adffff640 1 -- 172.21.15.55:0/4205917546 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40b0440 con 0x7f6ae81601f0 2023-08-25T04:03:24.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.587+0000 7f6aef340640 1 -- 172.21.15.55:0/4205917546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ae81601f0 msgr2=0x7f6ae815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:24.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.587+0000 7f6aef340640 1 --2- 172.21.15.55:0/4205917546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ae81601f0 0x7f6ae815d430 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4009860 tx=0x7f6ae401ed10 comp rx=0 tx=0).stop 2023-08-25T04:03:24.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.587+0000 7f6aef340640 1 -- 172.21.15.55:0/4205917546 shutdown_connections 2023-08-25T04:03:24.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.587+0000 7f6aef340640 1 --2- 172.21.15.55:0/4205917546 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae80d1290 0x7f6ae815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.587+0000 7f6aef340640 1 --2- 172.21.15.55:0/4205917546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ae81601f0 0x7f6ae815d430 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.587+0000 7f6aef340640 1 -- 172.21.15.55:0/4205917546 >> 172.21.15.55:0/4205917546 conn(0x7f6ae80d27d0 msgr2=0x7f6ae80d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:24.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.587+0000 7f6aef340640 1 -- 172.21.15.55:0/4205917546 shutdown_connections 2023-08-25T04:03:24.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.587+0000 7f6aef340640 1 -- 172.21.15.55:0/4205917546 wait complete. 2023-08-25T04:03:24.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aef340640 1 Processor -- start 2023-08-25T04:03:24.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aef340640 1 -- start start 2023-08-25T04:03:24.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aef340640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae80d1290 0x7f6ae8155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:24.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aef340640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ae815e3c0 0x7f6ae81f3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:24.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aef340640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae81601f0 0x7f6ae81f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:24.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aef340640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae81f3ef0 con 0x7f6ae815e3c0 2023-08-25T04:03:24.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aef340640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae81f41d0 con 0x7f6ae80d1290 2023-08-25T04:03:24.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aef340640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae81f44b0 con 0x7f6ae81601f0 2023-08-25T04:03:24.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aec8db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ae815e3c0 0x7f6ae81f3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:24.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aec8db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ae815e3c0 0x7f6ae81f3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47240/0 (socket says 172.21.15.55:47240) 2023-08-25T04:03:24.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aec8db640 1 -- 172.21.15.55:0/3014658201 learned_addr learned my addr 172.21.15.55:0/3014658201 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:24.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aed0dc640 1 --2- 172.21.15.55:0/3014658201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae80d1290 0x7f6ae8155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:24.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aed8dd640 1 --2- 172.21.15.55:0/3014658201 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae81601f0 0x7f6ae81f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aec8db640 1 -- 172.21.15.55:0/3014658201 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae81601f0 msgr2=0x7f6ae81f4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aec8db640 1 --2- 172.21.15.55:0/3014658201 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae81601f0 0x7f6ae81f4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aec8db640 1 -- 172.21.15.55:0/3014658201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae80d1290 msgr2=0x7f6ae8155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aec8db640 1 --2- 172.21.15.55:0/3014658201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae80d1290 0x7f6ae8155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aec8db640 1 -- 172.21.15.55:0/3014658201 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae4009470 con 0x7f6ae815e3c0 2023-08-25T04:03:24.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aec8db640 1 --2- 172.21.15.55:0/3014658201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ae815e3c0 0x7f6ae81f3580 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800c500 tx=0x7f6ad800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:24.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6addffb640 1 -- 172.21.15.55:0/3014658201 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8005220 con 0x7f6ae815e3c0 2023-08-25T04:03:24.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6addffb640 1 -- 172.21.15.55:0/3014658201 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad8005380 con 0x7f6ae815e3c0 2023-08-25T04:03:24.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6addffb640 1 -- 172.21.15.55:0/3014658201 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8007270 con 0x7f6ae815e3c0 2023-08-25T04:03:24.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aef340640 1 -- 172.21.15.55:0/3014658201 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae81f4790 con 0x7f6ae815e3c0 2023-08-25T04:03:24.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.591+0000 7f6aef340640 1 -- 172.21.15.55:0/3014658201 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae81f3ac0 con 0x7f6ae815e3c0 2023-08-25T04:03:24.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.595+0000 7f6aef340640 1 -- 172.21.15.55:0/3014658201 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae80b5260 con 0x7f6ae815e3c0 2023-08-25T04:03:24.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.595+0000 7f6addffb640 1 -- 172.21.15.55:0/3014658201 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6ad80073d0 con 0x7f6ae815e3c0 2023-08-25T04:03:24.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.595+0000 7f6addffb640 1 --2- 172.21.15.55:0/3014658201 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6acc065680 0x7f6acc067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:24.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.595+0000 7f6addffb640 1 -- 172.21.15.55:0/3014658201 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ad8082640 con 0x7f6ae815e3c0 2023-08-25T04:03:24.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.595+0000 7f6aed0dc640 1 --2- 172.21.15.55:0/3014658201 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6acc065680 0x7f6acc067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:24.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.595+0000 7f6aed0dc640 1 --2- 172.21.15.55:0/3014658201 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6acc065680 0x7f6acc067b40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6ae40b2000 tx=0x7f6ae4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:24.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.599+0000 7f6addffb640 1 -- 172.21.15.55:0/3014658201 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6ad8050120 con 0x7f6ae815e3c0 2023-08-25T04:03:24.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.759+0000 7f6aef340640 1 -- 172.21.15.55:0/3014658201 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ae8073ec0 con 0x7f6ae815e3c0 2023-08-25T04:03:24.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.759+0000 7f6addffb640 1 -- 172.21.15.55:0/3014658201 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ad8053740 con 0x7f6ae815e3c0 2023-08-25T04:03:24.760 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:03:24.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.759+0000 7f6aef340640 1 -- 172.21.15.55:0/3014658201 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6acc065680 msgr2=0x7f6acc067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:24.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.759+0000 7f6aef340640 1 --2- 172.21.15.55:0/3014658201 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6acc065680 0x7f6acc067b40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6ae40b2000 tx=0x7f6ae4009040 comp rx=0 tx=0).stop 2023-08-25T04:03:24.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.759+0000 7f6aef340640 1 -- 172.21.15.55:0/3014658201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ae815e3c0 msgr2=0x7f6ae81f3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:24.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.759+0000 7f6aef340640 1 --2- 172.21.15.55:0/3014658201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ae815e3c0 0x7f6ae81f3580 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800c500 tx=0x7f6ad800c9c0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.759+0000 7f6aef340640 1 -- 172.21.15.55:0/3014658201 shutdown_connections 2023-08-25T04:03:24.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.759+0000 7f6aef340640 1 --2- 172.21.15.55:0/3014658201 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6acc065680 0x7f6acc067b40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.759+0000 7f6aef340640 1 --2- 172.21.15.55:0/3014658201 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ae81601f0 0x7f6ae81f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.759+0000 7f6aef340640 1 --2- 172.21.15.55:0/3014658201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ae815e3c0 0x7f6ae81f3580 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.759+0000 7f6aef340640 1 --2- 172.21.15.55:0/3014658201 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ae80d1290 0x7f6ae8155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.759+0000 7f6aef340640 1 -- 172.21.15.55:0/3014658201 >> 172.21.15.55:0/3014658201 conn(0x7f6ae80d27d0 msgr2=0x7f6ae80cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.759+0000 7f6aef340640 1 -- 172.21.15.55:0/3014658201 shutdown_connections 2023-08-25T04:03:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.759+0000 7f6aef340640 1 -- 172.21.15.55:0/3014658201 wait complete. 2023-08-25T04:03:24.781 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:03:24.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.923+0000 7effd5c9e640 1 Processor -- start 2023-08-25T04:03:24.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.923+0000 7effd5c9e640 1 -- start start 2023-08-25T04:03:24.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.927+0000 7effd5c9e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7effd01601f0 0x7effd015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:24.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.927+0000 7effd5c9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd00cd5a0 con 0x7effd015e3c0 2023-08-25T04:03:24.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.927+0000 7effd5c9e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd00cd880 con 0x7effd00d1290 2023-08-25T04:03:24.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.927+0000 7effd5c9e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd00cdb60 con 0x7effd01601f0 2023-08-25T04:03:24.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.927+0000 7effc7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7effd015e3c0 0x7effd00d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60896/0 (socket says 172.21.15.55:60896) 2023-08-25T04:03:24.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.927+0000 7effc7fff640 1 -- 172.21.15.55:0/3646281255 learned_addr learned my addr 172.21.15.55:0/3646281255 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:24.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.927+0000 7effcf7fe640 1 --2- 172.21.15.55:0/3646281255 >> v2:172.21.15.110:3300/0 conn(0x7effd01601f0 0x7effd015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:24.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.927+0000 7effceffd640 1 -- 172.21.15.55:0/3646281255 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250812031 0 0) 0x7effd00cd5a0 con 0x7effd015e3c0 2023-08-25T04:03:24.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.927+0000 7effceffd640 1 -- 172.21.15.55:0/3646281255 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effbc003530 con 0x7effd015e3c0 2023-08-25T04:03:24.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.927+0000 7effcf7fe640 1 -- 172.21.15.55:0/3646281255 >> v1:172.21.15.110:6789/0 conn(0x7effd00d1290 legacy=0x7effd015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:24.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.927+0000 7effcf7fe640 1 -- 172.21.15.55:0/3646281255 >> v1:172.21.15.55:6789/0 conn(0x7effd015e3c0 legacy=0x7effd00d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:24.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.927+0000 7effcf7fe640 1 -- 172.21.15.55:0/3646281255 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd00cde40 con 0x7effd01601f0 2023-08-25T04:03:24.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.931+0000 7effcf7fe640 1 --2- 172.21.15.55:0/3646281255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effd01601f0 0x7effd015d430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7effc00097a0 tx=0x7effc001c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8d885079aac050d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:24.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.931+0000 7effceffd640 1 -- 172.21.15.55:0/3646281255 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0004230 con 0x7effd01601f0 2023-08-25T04:03:24.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.931+0000 7effceffd640 1 -- 172.21.15.55:0/3646281255 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc00a7050 con 0x7effd01601f0 2023-08-25T04:03:24.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.931+0000 7effceffd640 1 -- 172.21.15.55:0/3646281255 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc0003620 con 0x7effd01601f0 2023-08-25T04:03:24.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.931+0000 7effd5c9e640 1 -- 172.21.15.55:0/3646281255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effd01601f0 msgr2=0x7effd015d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:24.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.931+0000 7effd5c9e640 1 --2- 172.21.15.55:0/3646281255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effd01601f0 0x7effd015d430 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7effc00097a0 tx=0x7effc001c430 comp rx=0 tx=0).stop 2023-08-25T04:03:24.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.931+0000 7effd5c9e640 1 -- 172.21.15.55:0/3646281255 shutdown_connections 2023-08-25T04:03:24.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.931+0000 7effd5c9e640 1 --2- 172.21.15.55:0/3646281255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effd01601f0 0x7effd015d430 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.931+0000 7effd5c9e640 1 -- 172.21.15.55:0/3646281255 >> 172.21.15.55:0/3646281255 conn(0x7effd00d27d0 msgr2=0x7effd00d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:24.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.931+0000 7effd5c9e640 1 -- 172.21.15.55:0/3646281255 shutdown_connections 2023-08-25T04:03:24.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.931+0000 7effd5c9e640 1 -- 172.21.15.55:0/3646281255 wait complete. 2023-08-25T04:03:24.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.931+0000 7effd5c9e640 1 Processor -- start 2023-08-25T04:03:24.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.931+0000 7effd5c9e640 1 -- start start 2023-08-25T04:03:24.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effd5c9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effd00d1290 0x7effd009d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:24.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effd5c9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effd015e3c0 0x7effd006c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:24.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effd5c9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effd01601f0 0x7effd00c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:24.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effd5c9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd00c6f50 con 0x7effd015e3c0 2023-08-25T04:03:24.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effd5c9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd009d660 con 0x7effd00d1290 2023-08-25T04:03:24.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effd5c9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd00c6310 con 0x7effd01601f0 2023-08-25T04:03:24.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effc7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effd015e3c0 0x7effd006c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:24.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effc7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effd015e3c0 0x7effd006c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47242/0 (socket says 172.21.15.55:47242) 2023-08-25T04:03:24.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effc7fff640 1 -- 172.21.15.55:0/2499467557 learned_addr learned my addr 172.21.15.55:0/2499467557 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:24.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effcffff640 1 --2- 172.21.15.55:0/2499467557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effd01601f0 0x7effd00c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:24.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effcf7fe640 1 --2- 172.21.15.55:0/2499467557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effd00d1290 0x7effd009d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:24.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effc7fff640 1 -- 172.21.15.55:0/2499467557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effd01601f0 msgr2=0x7effd00c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:24.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effc7fff640 1 --2- 172.21.15.55:0/2499467557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effd01601f0 0x7effd00c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effc7fff640 1 -- 172.21.15.55:0/2499467557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effd00d1290 msgr2=0x7effd009d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:24.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effc7fff640 1 --2- 172.21.15.55:0/2499467557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effd00d1290 0x7effd009d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:24.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effc7fff640 1 -- 172.21.15.55:0/2499467557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc00093b0 con 0x7effd015e3c0 2023-08-25T04:03:24.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effc7fff640 1 --2- 172.21.15.55:0/2499467557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effd015e3c0 0x7effd006c260 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7effb800c4d0 tx=0x7effb800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:24.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effccff9640 1 -- 172.21.15.55:0/2499467557 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8005cf0 con 0x7effd015e3c0 2023-08-25T04:03:24.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effccff9640 1 -- 172.21.15.55:0/2499467557 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb8005e50 con 0x7effd015e3c0 2023-08-25T04:03:24.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effccff9640 1 -- 172.21.15.55:0/2499467557 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8007270 con 0x7effd015e3c0 2023-08-25T04:03:24.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effd5c9e640 1 -- 172.21.15.55:0/2499467557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd006c7a0 con 0x7effd015e3c0 2023-08-25T04:03:24.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effd5c9e640 1 -- 172.21.15.55:0/2499467557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd00c6890 con 0x7effd015e3c0 2023-08-25T04:03:24.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effd5c9e640 1 -- 172.21.15.55:0/2499467557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd00b5260 con 0x7effd015e3c0 2023-08-25T04:03:24.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.935+0000 7effccff9640 1 -- 172.21.15.55:0/2499467557 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7effb80073d0 con 0x7effd015e3c0 2023-08-25T04:03:24.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.939+0000 7effccff9640 1 --2- 172.21.15.55:0/2499467557 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7effb0065680 0x7effb0067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:24.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.939+0000 7effccff9640 1 -- 172.21.15.55:0/2499467557 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7effb8082340 con 0x7effd015e3c0 2023-08-25T04:03:24.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.939+0000 7effcf7fe640 1 --2- 172.21.15.55:0/2499467557 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7effb0065680 0x7effb0067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:24.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.939+0000 7effcf7fe640 1 --2- 172.21.15.55:0/2499467557 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7effb0065680 0x7effb0067b40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7effc00ad000 tx=0x7effc00a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:24.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:24.943+0000 7effccff9640 1 -- 172.21.15.55:0/2499467557 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7effb804fea0 con 0x7effd015e3c0 2023-08-25T04:03:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.099+0000 7effd5c9e640 1 -- 172.21.15.55:0/2499467557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7effd0073ec0 con 0x7effd015e3c0 2023-08-25T04:03:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.099+0000 7effccff9640 1 -- 172.21.15.55:0/2499467557 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7effb80534c0 con 0x7effd015e3c0 2023-08-25T04:03:25.101 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:03:25.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.099+0000 7effd5c9e640 1 -- 172.21.15.55:0/2499467557 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7effb0065680 msgr2=0x7effb0067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:25.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.099+0000 7effd5c9e640 1 --2- 172.21.15.55:0/2499467557 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7effb0065680 0x7effb0067b40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7effc00ad000 tx=0x7effc00a6000 comp rx=0 tx=0).stop 2023-08-25T04:03:25.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.099+0000 7effd5c9e640 1 -- 172.21.15.55:0/2499467557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effd015e3c0 msgr2=0x7effd006c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:25.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.099+0000 7effd5c9e640 1 --2- 172.21.15.55:0/2499467557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effd015e3c0 0x7effd006c260 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7effb800c4d0 tx=0x7effb800c990 comp rx=0 tx=0).stop 2023-08-25T04:03:25.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.099+0000 7effd5c9e640 1 -- 172.21.15.55:0/2499467557 shutdown_connections 2023-08-25T04:03:25.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.099+0000 7effd5c9e640 1 --2- 172.21.15.55:0/2499467557 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7effb0065680 0x7effb0067b40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.099+0000 7effd5c9e640 1 --2- 172.21.15.55:0/2499467557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effd01601f0 0x7effd00c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.099+0000 7effd5c9e640 1 --2- 172.21.15.55:0/2499467557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effd015e3c0 0x7effd006c260 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.099+0000 7effd5c9e640 1 --2- 172.21.15.55:0/2499467557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effd00d1290 0x7effd009d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.099+0000 7effd5c9e640 1 -- 172.21.15.55:0/2499467557 >> 172.21.15.55:0/2499467557 conn(0x7effd00d27d0 msgr2=0x7effd00d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:25.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.099+0000 7effd5c9e640 1 -- 172.21.15.55:0/2499467557 shutdown_connections 2023-08-25T04:03:25.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.099+0000 7effd5c9e640 1 -- 172.21.15.55:0/2499467557 wait complete. 2023-08-25T04:03:25.122 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:03:25.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.267+0000 7f3272d59640 1 Processor -- start 2023-08-25T04:03:25.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.267+0000 7f3272d59640 1 -- start start 2023-08-25T04:03:25.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.267+0000 7f3272d59640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f326c0cb020 0x7f326c0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.267+0000 7f3272d59640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f326c0cdd50 0x7f326c0cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.267+0000 7f3272d59640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f326c06c720 0x7f326c06cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.267+0000 7f3272d59640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f326c06d0d0 con 0x7f326c06c720 2023-08-25T04:03:25.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.267+0000 7f3272d59640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f326c0cbca0 con 0x7f326c0cb020 2023-08-25T04:03:25.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.267+0000 7f3272d59640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326c0c9470 con 0x7f326c0cdd50 2023-08-25T04:03:25.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.267+0000 7f32712f6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f326c06c720 0x7f326c06cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.267+0000 7f32712f6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f326c06c720 0x7f326c06cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47258/0 (socket says 172.21.15.55:47258) 2023-08-25T04:03:25.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.267+0000 7f32712f6640 1 -- 172.21.15.55:0/2571008162 learned_addr learned my addr 172.21.15.55:0/2571008162 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:25.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.267+0000 7f326bfff640 1 --2- 172.21.15.55:0/2571008162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f326c0cdd50 0x7f326c0cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.267+0000 7f3270af5640 1 --2- 172.21.15.55:0/2571008162 >> v2:172.21.15.110:3300/0 conn(0x7f326c0cb020 0x7f326c0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.267+0000 7f32712f6640 1 -- 172.21.15.55:0/2571008162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f326c0cdd50 msgr2=0x7f326c0cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:25.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.267+0000 7f32712f6640 1 --2- 172.21.15.55:0/2571008162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f326c0cdd50 0x7f326c0cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.267+0000 7f32712f6640 1 -- 172.21.15.55:0/2571008162 >> v2:172.21.15.110:3300/0 conn(0x7f326c0cb020 msgr2=0x7f326c0c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:25.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.267+0000 7f32712f6640 1 --2- 172.21.15.55:0/2571008162 >> v2:172.21.15.110:3300/0 conn(0x7f326c0cb020 0x7f326c0c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.267+0000 7f32712f6640 1 -- 172.21.15.55:0/2571008162 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326c0ce1e0 con 0x7f326c06c720 2023-08-25T04:03:25.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.271+0000 7f32712f6640 1 --2- 172.21.15.55:0/2571008162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f326c06c720 0x7f326c06cb90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f326c06daf0 tx=0x7f326401eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbbc35a8d402496 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:25.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.271+0000 7f326b7fe640 1 -- 172.21.15.55:0/2571008162 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326400b2d0 con 0x7f326c06c720 2023-08-25T04:03:25.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.271+0000 7f326b7fe640 1 -- 172.21.15.55:0/2571008162 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326400b430 con 0x7f326c06c720 2023-08-25T04:03:25.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.271+0000 7f326b7fe640 1 -- 172.21.15.55:0/2571008162 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32640a7ae0 con 0x7f326c06c720 2023-08-25T04:03:25.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.271+0000 7f3272d59640 1 -- 172.21.15.55:0/2571008162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f326c06c720 msgr2=0x7f326c06cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:25.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.271+0000 7f3272d59640 1 --2- 172.21.15.55:0/2571008162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f326c06c720 0x7f326c06cb90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f326c06daf0 tx=0x7f326401eb40 comp rx=0 tx=0).stop 2023-08-25T04:03:25.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.271+0000 7f3272d59640 1 -- 172.21.15.55:0/2571008162 shutdown_connections 2023-08-25T04:03:25.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.271+0000 7f3272d59640 1 --2- 172.21.15.55:0/2571008162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f326c06c720 0x7f326c06cb90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.271+0000 7f3272d59640 1 --2- 172.21.15.55:0/2571008162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f326c0cdd50 0x7f326c0cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.271+0000 7f3272d59640 1 --2- 172.21.15.55:0/2571008162 >> v2:172.21.15.110:3300/0 conn(0x7f326c0cb020 0x7f326c0c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.271+0000 7f3272d59640 1 -- 172.21.15.55:0/2571008162 >> 172.21.15.55:0/2571008162 conn(0x7f326c069900 msgr2=0x7f326c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:25.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.271+0000 7f3272d59640 1 -- 172.21.15.55:0/2571008162 shutdown_connections 2023-08-25T04:03:25.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.271+0000 7f3272d59640 1 -- 172.21.15.55:0/2571008162 wait complete. 2023-08-25T04:03:25.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3272d59640 1 Processor -- start 2023-08-25T04:03:25.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3272d59640 1 -- start start 2023-08-25T04:03:25.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3272d59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f326c06c720 0x7f326c0ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3272d59640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f326c0cb020 0x7f326c158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3272d59640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f326c0cdd50 0x7f326c0b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3272d59640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326c0af0f0 con 0x7f326c06c720 2023-08-25T04:03:25.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3272d59640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326c0aee10 con 0x7f326c0cb020 2023-08-25T04:03:25.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3272d59640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326c158050 con 0x7f326c0cdd50 2023-08-25T04:03:25.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3270af5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f326c06c720 0x7f326c0ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3270af5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f326c06c720 0x7f326c0ae830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47268/0 (socket says 172.21.15.55:47268) 2023-08-25T04:03:25.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3270af5640 1 -- 172.21.15.55:0/2320223488 learned_addr learned my addr 172.21.15.55:0/2320223488 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:25.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f326bfff640 1 --2- 172.21.15.55:0/2320223488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f326c0cb020 0x7f326c158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f32712f6640 1 --2- 172.21.15.55:0/2320223488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f326c0cdd50 0x7f326c0b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3270af5640 1 -- 172.21.15.55:0/2320223488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f326c0cdd50 msgr2=0x7f326c0b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:25.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3270af5640 1 --2- 172.21.15.55:0/2320223488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f326c0cdd50 0x7f326c0b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3270af5640 1 -- 172.21.15.55:0/2320223488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f326c0cb020 msgr2=0x7f326c158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:25.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3270af5640 1 --2- 172.21.15.55:0/2320223488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f326c0cb020 0x7f326c158b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3270af5640 1 -- 172.21.15.55:0/2320223488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326400bd40 con 0x7f326c06c720 2023-08-25T04:03:25.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3270af5640 1 --2- 172.21.15.55:0/2320223488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f326c06c720 0x7f326c0ae830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f326000d800 tx=0x7f326000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:25.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f32697fa640 1 -- 172.21.15.55:0/2320223488 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260018070 con 0x7f326c06c720 2023-08-25T04:03:25.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f32697fa640 1 -- 172.21.15.55:0/2320223488 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32600059a0 con 0x7f326c06c720 2023-08-25T04:03:25.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f32697fa640 1 -- 172.21.15.55:0/2320223488 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260005b50 con 0x7f326c06c720 2023-08-25T04:03:25.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3272d59640 1 -- 172.21.15.55:0/2320223488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326c158330 con 0x7f326c06c720 2023-08-25T04:03:25.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3272d59640 1 -- 172.21.15.55:0/2320223488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f326c0b0780 con 0x7f326c06c720 2023-08-25T04:03:25.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.275+0000 7f3272d59640 1 -- 172.21.15.55:0/2320223488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326c0ae680 con 0x7f326c06c720 2023-08-25T04:03:25.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.279+0000 7f32697fa640 1 -- 172.21.15.55:0/2320223488 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f3260005cb0 con 0x7f326c06c720 2023-08-25T04:03:25.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.279+0000 7f32697fa640 1 --2- 172.21.15.55:0/2320223488 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3250065680 0x7f3250067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.279+0000 7f32697fa640 1 -- 172.21.15.55:0/2320223488 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3260082c30 con 0x7f326c06c720 2023-08-25T04:03:25.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.279+0000 7f326bfff640 1 --2- 172.21.15.55:0/2320223488 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3250065680 0x7f3250067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.279+0000 7f326bfff640 1 --2- 172.21.15.55:0/2320223488 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3250065680 0x7f3250067b40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f326c1592d0 tx=0x7f3258008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:25.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.283+0000 7f32697fa640 1 -- 172.21.15.55:0/2320223488 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3260054190 con 0x7f326c06c720 2023-08-25T04:03:25.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.447+0000 7f3272d59640 1 -- 172.21.15.55:0/2320223488 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f326c157e80 con 0x7f326c06c720 2023-08-25T04:03:25.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.447+0000 7f32697fa640 1 -- 172.21.15.55:0/2320223488 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3260053d20 con 0x7f326c06c720 2023-08-25T04:03:25.451 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:03:25.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.451+0000 7f3272d59640 1 -- 172.21.15.55:0/2320223488 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3250065680 msgr2=0x7f3250067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:25.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.451+0000 7f3272d59640 1 --2- 172.21.15.55:0/2320223488 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3250065680 0x7f3250067b40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f326c1592d0 tx=0x7f3258008040 comp rx=0 tx=0).stop 2023-08-25T04:03:25.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.451+0000 7f3272d59640 1 -- 172.21.15.55:0/2320223488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f326c06c720 msgr2=0x7f326c0ae830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:25.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.451+0000 7f3272d59640 1 --2- 172.21.15.55:0/2320223488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f326c06c720 0x7f326c0ae830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f326000d800 tx=0x7f326000dcc0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.451+0000 7f3272d59640 1 -- 172.21.15.55:0/2320223488 shutdown_connections 2023-08-25T04:03:25.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.451+0000 7f3272d59640 1 --2- 172.21.15.55:0/2320223488 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3250065680 0x7f3250067b40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.451+0000 7f3272d59640 1 --2- 172.21.15.55:0/2320223488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f326c0cdd50 0x7f326c0b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.451+0000 7f3272d59640 1 --2- 172.21.15.55:0/2320223488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f326c0cb020 0x7f326c158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.451+0000 7f3272d59640 1 --2- 172.21.15.55:0/2320223488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f326c06c720 0x7f326c0ae830 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.451+0000 7f3272d59640 1 -- 172.21.15.55:0/2320223488 >> 172.21.15.55:0/2320223488 conn(0x7f326c069900 msgr2=0x7f326c15d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:25.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.451+0000 7f3272d59640 1 -- 172.21.15.55:0/2320223488 shutdown_connections 2023-08-25T04:03:25.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.451+0000 7f3272d59640 1 -- 172.21.15.55:0/2320223488 wait complete. 2023-08-25T04:03:25.472 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:03:25.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.615+0000 7ff72fe93640 1 Processor -- start 2023-08-25T04:03:25.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.619+0000 7ff72fe93640 1 -- start start 2023-08-25T04:03:25.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.619+0000 7ff72fe93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff72806dc80 0x7ff7280ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.619+0000 7ff72fe93640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72806cd40 con 0x7ff72815cba0 2023-08-25T04:03:25.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.619+0000 7ff72fe93640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff72806be90 con 0x7ff7280b11c0 2023-08-25T04:03:25.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.619+0000 7ff72fe93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72806c130 con 0x7ff72806dc80 2023-08-25T04:03:25.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.619+0000 7ff72d42e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff72806dc80 0x7ff7280ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.619+0000 7ff72dc2f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff72815cba0 0x7ff72806d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60906/0 (socket says 172.21.15.55:60906) 2023-08-25T04:03:25.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.619+0000 7ff72d42e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff72806dc80 0x7ff7280ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47282/0 (socket says 172.21.15.55:47282) 2023-08-25T04:03:25.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.619+0000 7ff72dc2f640 1 -- 172.21.15.55:0/2888000915 learned_addr learned my addr 172.21.15.55:0/2888000915 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:25.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.619+0000 7ff72d42e640 1 -- 172.21.15.55:0/2888000915 >> v1:172.21.15.110:6789/0 conn(0x7ff7280b11c0 legacy=0x7ff728069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:25.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.619+0000 7ff72d42e640 1 -- 172.21.15.55:0/2888000915 >> v1:172.21.15.55:6789/0 conn(0x7ff72815cba0 legacy=0x7ff72806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:25.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.619+0000 7ff72d42e640 1 -- 172.21.15.55:0/2888000915 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72806c410 con 0x7ff72806dc80 2023-08-25T04:03:25.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.619+0000 7ff72cc2d640 1 -- 172.21.15.55:0/2888000915 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012527409 0 0) 0x7ff72806cd40 con 0x7ff72815cba0 2023-08-25T04:03:25.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.623+0000 7ff72d42e640 1 --2- 172.21.15.55:0/2888000915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff72806dc80 0x7ff7280ce600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff7180097c0 tx=0x7ff71801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4103d3c9407c5c63 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:25.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.623+0000 7ff72cc2d640 1 -- 172.21.15.55:0/2888000915 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7180ab680 con 0x7ff72806dc80 2023-08-25T04:03:25.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.623+0000 7ff72cc2d640 1 -- 172.21.15.55:0/2888000915 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7180ab7e0 con 0x7ff72806dc80 2023-08-25T04:03:25.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.623+0000 7ff72cc2d640 1 -- 172.21.15.55:0/2888000915 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7180abb70 con 0x7ff72806dc80 2023-08-25T04:03:25.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.623+0000 7ff72fe93640 1 -- 172.21.15.55:0/2888000915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff72806dc80 msgr2=0x7ff7280ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:25.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.623+0000 7ff72fe93640 1 --2- 172.21.15.55:0/2888000915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff72806dc80 0x7ff7280ce600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff7180097c0 tx=0x7ff71801c480 comp rx=0 tx=0).stop 2023-08-25T04:03:25.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.623+0000 7ff72fe93640 1 -- 172.21.15.55:0/2888000915 shutdown_connections 2023-08-25T04:03:25.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.623+0000 7ff72fe93640 1 --2- 172.21.15.55:0/2888000915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff72806dc80 0x7ff7280ce600 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.623+0000 7ff72fe93640 1 -- 172.21.15.55:0/2888000915 >> 172.21.15.55:0/2888000915 conn(0x7ff7280b06a0 msgr2=0x7ff7280b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:25.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.623+0000 7ff72fe93640 1 -- 172.21.15.55:0/2888000915 shutdown_connections 2023-08-25T04:03:25.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.623+0000 7ff72fe93640 1 -- 172.21.15.55:0/2888000915 wait complete. 2023-08-25T04:03:25.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.623+0000 7ff72fe93640 1 Processor -- start 2023-08-25T04:03:25.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.623+0000 7ff72fe93640 1 -- start start 2023-08-25T04:03:25.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72fe93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff72806dc80 0x7ff728158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72fe93640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7280b11c0 0x7ff7280c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72fe93640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff72815cba0 0x7ff72809ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72fe93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7280c37d0 con 0x7ff72806dc80 2023-08-25T04:03:25.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72fe93640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7280c4380 con 0x7ff7280b11c0 2023-08-25T04:03:25.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72fe93640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7280c34f0 con 0x7ff72815cba0 2023-08-25T04:03:25.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72dc2f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff72806dc80 0x7ff728158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72dc2f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff72806dc80 0x7ff728158730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47298/0 (socket says 172.21.15.55:47298) 2023-08-25T04:03:25.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72dc2f640 1 -- 172.21.15.55:0/293901143 learned_addr learned my addr 172.21.15.55:0/293901143 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:25.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72e430640 1 --2- 172.21.15.55:0/293901143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff72815cba0 0x7ff72809ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72d42e640 1 --2- 172.21.15.55:0/293901143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7280b11c0 0x7ff7280c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72dc2f640 1 -- 172.21.15.55:0/293901143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff72815cba0 msgr2=0x7ff72809ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72dc2f640 1 --2- 172.21.15.55:0/293901143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff72815cba0 0x7ff72809ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72dc2f640 1 -- 172.21.15.55:0/293901143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7280b11c0 msgr2=0x7ff7280c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72dc2f640 1 --2- 172.21.15.55:0/293901143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7280b11c0 0x7ff7280c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72dc2f640 1 -- 172.21.15.55:0/293901143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff718009420 con 0x7ff72806dc80 2023-08-25T04:03:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72dc2f640 1 --2- 172.21.15.55:0/293901143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff72806dc80 0x7ff728158730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff72400c440 tx=0x7ff72400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff71e7fc640 1 -- 172.21.15.55:0/293901143 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7240074e0 con 0x7ff72806dc80 2023-08-25T04:03:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff71e7fc640 1 -- 172.21.15.55:0/293901143 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff724007640 con 0x7ff72806dc80 2023-08-25T04:03:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff71e7fc640 1 -- 172.21.15.55:0/293901143 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff724004a10 con 0x7ff72806dc80 2023-08-25T04:03:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72fe93640 1 -- 172.21.15.55:0/293901143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7280c3cc0 con 0x7ff72806dc80 2023-08-25T04:03:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72fe93640 1 -- 172.21.15.55:0/293901143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff728158c70 con 0x7ff72806dc80 2023-08-25T04:03:25.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff72fe93640 1 -- 172.21.15.55:0/293901143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7280c3b20 con 0x7ff72806dc80 2023-08-25T04:03:25.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.627+0000 7ff71e7fc640 1 -- 172.21.15.55:0/293901143 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff724004b70 con 0x7ff72806dc80 2023-08-25T04:03:25.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.631+0000 7ff71e7fc640 1 --2- 172.21.15.55:0/293901143 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff70c065680 0x7ff70c067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.631+0000 7ff71e7fc640 1 -- 172.21.15.55:0/293901143 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff724081f20 con 0x7ff72806dc80 2023-08-25T04:03:25.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.631+0000 7ff72d42e640 1 --2- 172.21.15.55:0/293901143 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff70c065680 0x7ff70c067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.631+0000 7ff72d42e640 1 --2- 172.21.15.55:0/293901143 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff70c065680 0x7ff70c067b40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff7180af000 tx=0x7ff7180a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:25.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.635+0000 7ff71e7fc640 1 -- 172.21.15.55:0/293901143 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff7280c3b20 con 0x7ff72806dc80 2023-08-25T04:03:25.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.787+0000 7ff72fe93640 1 -- 172.21.15.55:0/293901143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff72806d1b0 con 0x7ff72806dc80 2023-08-25T04:03:25.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.791+0000 7ff71e7fc640 1 -- 172.21.15.55:0/293901143 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff72806d1b0 con 0x7ff72806dc80 2023-08-25T04:03:25.792 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:03:25.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.791+0000 7ff72fe93640 1 -- 172.21.15.55:0/293901143 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff70c065680 msgr2=0x7ff70c067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:25.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.791+0000 7ff72fe93640 1 --2- 172.21.15.55:0/293901143 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff70c065680 0x7ff70c067b40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff7180af000 tx=0x7ff7180a7000 comp rx=0 tx=0).stop 2023-08-25T04:03:25.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.791+0000 7ff72fe93640 1 -- 172.21.15.55:0/293901143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff72806dc80 msgr2=0x7ff728158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.791+0000 7ff72fe93640 1 --2- 172.21.15.55:0/293901143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff72806dc80 0x7ff728158730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff72400c440 tx=0x7ff72400c900 comp rx=0 tx=0).stop 2023-08-25T04:03:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.791+0000 7ff72fe93640 1 -- 172.21.15.55:0/293901143 shutdown_connections 2023-08-25T04:03:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.791+0000 7ff72fe93640 1 --2- 172.21.15.55:0/293901143 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff70c065680 0x7ff70c067b40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.791+0000 7ff72fe93640 1 --2- 172.21.15.55:0/293901143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff72815cba0 0x7ff72809ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.791+0000 7ff72fe93640 1 --2- 172.21.15.55:0/293901143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7280b11c0 0x7ff7280c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.791+0000 7ff72fe93640 1 --2- 172.21.15.55:0/293901143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff72806dc80 0x7ff728158730 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.791+0000 7ff72fe93640 1 -- 172.21.15.55:0/293901143 >> 172.21.15.55:0/293901143 conn(0x7ff7280b06a0 msgr2=0x7ff7280b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.791+0000 7ff72fe93640 1 -- 172.21.15.55:0/293901143 shutdown_connections 2023-08-25T04:03:25.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.791+0000 7ff72fe93640 1 -- 172.21.15.55:0/293901143 wait complete. 2023-08-25T04:03:25.812 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:25.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.951+0000 7f0804ea1640 1 Processor -- start 2023-08-25T04:03:25.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.951+0000 7f0804ea1640 1 -- start start 2023-08-25T04:03:25.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.955+0000 7f0804ea1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f080015ca50 0x7f08000d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.955+0000 7f0804ea1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f08000d0f50 0x7f080006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.955+0000 7f0804ea1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f080006c150 0x7f08000b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.955+0000 7f0804ea1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08000d13d0 con 0x7f080015ca50 2023-08-25T04:03:25.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.955+0000 7f0804ea1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08000afe20 con 0x7f08000d0f50 2023-08-25T04:03:25.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.955+0000 7f0804ea1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08000af210 con 0x7f080006c150 2023-08-25T04:03:25.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.955+0000 7f07ff7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f080015ca50 0x7f08000d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.955+0000 7f07ff7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f080015ca50 0x7f08000d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47306/0 (socket says 172.21.15.55:47306) 2023-08-25T04:03:25.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.955+0000 7f07ff7fe640 1 -- 172.21.15.55:0/2850715071 learned_addr learned my addr 172.21.15.55:0/2850715071 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:25.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.955+0000 7f07feffd640 1 --2- 172.21.15.55:0/2850715071 >> v2:172.21.15.110:3300/0 conn(0x7f08000d0f50 0x7f080006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.955+0000 7f07fffff640 1 --2- 172.21.15.55:0/2850715071 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f080006c150 0x7f08000b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.955+0000 7f07ff7fe640 1 -- 172.21.15.55:0/2850715071 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f080006c150 msgr2=0x7f08000b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.955+0000 7f07ff7fe640 1 --2- 172.21.15.55:0/2850715071 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f080006c150 0x7f08000b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.955+0000 7f07ff7fe640 1 -- 172.21.15.55:0/2850715071 >> v2:172.21.15.110:3300/0 conn(0x7f08000d0f50 msgr2=0x7f080006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.955+0000 7f07ff7fe640 1 --2- 172.21.15.55:0/2850715071 >> v2:172.21.15.110:3300/0 conn(0x7f08000d0f50 0x7f080006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.955+0000 7f07ff7fe640 1 -- 172.21.15.55:0/2850715071 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08000af4f0 con 0x7f080015ca50 2023-08-25T04:03:25.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.955+0000 7f07fffff640 1 --2- 172.21.15.55:0/2850715071 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f080006c150 0x7f08000b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:25.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.959+0000 7f07ff7fe640 1 --2- 172.21.15.55:0/2850715071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f080015ca50 0x7f08000d0a10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f08000ccd90 tx=0x7f07f001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df81f2eb9ae271f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:25.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.959+0000 7f07fe7fc640 1 -- 172.21.15.55:0/2850715071 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f00ab600 con 0x7f080015ca50 2023-08-25T04:03:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.959+0000 7f07fe7fc640 1 -- 172.21.15.55:0/2850715071 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f00a7050 con 0x7f080015ca50 2023-08-25T04:03:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.959+0000 7f07fe7fc640 1 -- 172.21.15.55:0/2850715071 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f00ab980 con 0x7f080015ca50 2023-08-25T04:03:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.959+0000 7f0804ea1640 1 -- 172.21.15.55:0/2850715071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f080015ca50 msgr2=0x7f08000d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.959+0000 7f0804ea1640 1 --2- 172.21.15.55:0/2850715071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f080015ca50 0x7f08000d0a10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f08000ccd90 tx=0x7f07f001c210 comp rx=0 tx=0).stop 2023-08-25T04:03:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.959+0000 7f0804ea1640 1 -- 172.21.15.55:0/2850715071 shutdown_connections 2023-08-25T04:03:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.959+0000 7f0804ea1640 1 --2- 172.21.15.55:0/2850715071 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f080006c150 0x7f08000b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.959+0000 7f0804ea1640 1 --2- 172.21.15.55:0/2850715071 >> v2:172.21.15.110:3300/0 conn(0x7f08000d0f50 0x7f080006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.959+0000 7f0804ea1640 1 --2- 172.21.15.55:0/2850715071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f080015ca50 0x7f08000d0a10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.959+0000 7f0804ea1640 1 -- 172.21.15.55:0/2850715071 >> 172.21.15.55:0/2850715071 conn(0x7f0800065f40 msgr2=0x7f080009b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:25.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.959+0000 7f0804ea1640 1 -- 172.21.15.55:0/2850715071 shutdown_connections 2023-08-25T04:03:25.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.959+0000 7f0804ea1640 1 -- 172.21.15.55:0/2850715071 wait complete. 2023-08-25T04:03:25.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.959+0000 7f0804ea1640 1 Processor -- start 2023-08-25T04:03:25.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.959+0000 7f0804ea1640 1 -- start start 2023-08-25T04:03:25.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f0804ea1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f080006c150 0x7f08001494c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f0804ea1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08000d0f50 0x7f0800147d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f0804ea1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f080015ca50 0x7f080014a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f0804ea1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0800158970 con 0x7f080006c150 2023-08-25T04:03:25.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f0804ea1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0800149030 con 0x7f080015ca50 2023-08-25T04:03:25.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f0804ea1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0800148700 con 0x7f08000d0f50 2023-08-25T04:03:25.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f07ff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f080006c150 0x7f08001494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f07ff7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f080006c150 0x7f08001494c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47314/0 (socket says 172.21.15.55:47314) 2023-08-25T04:03:25.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f07ff7fe640 1 -- 172.21.15.55:0/2476346730 learned_addr learned my addr 172.21.15.55:0/2476346730 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:25.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f07feffd640 1 --2- 172.21.15.55:0/2476346730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08000d0f50 0x7f0800147d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f07fffff640 1 --2- 172.21.15.55:0/2476346730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f080015ca50 0x7f080014a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f07ff7fe640 1 -- 172.21.15.55:0/2476346730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08000d0f50 msgr2=0x7f0800147d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:25.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f07ff7fe640 1 --2- 172.21.15.55:0/2476346730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08000d0f50 0x7f0800147d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f07ff7fe640 1 -- 172.21.15.55:0/2476346730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f080015ca50 msgr2=0x7f080014a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:25.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f07ff7fe640 1 --2- 172.21.15.55:0/2476346730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f080015ca50 0x7f080014a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:25.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f07ff7fe640 1 -- 172.21.15.55:0/2476346730 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f0009480 con 0x7f080006c150 2023-08-25T04:03:25.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f07feffd640 1 --2- 172.21.15.55:0/2476346730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08000d0f50 0x7f0800147d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:25.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f07fffff640 1 --2- 172.21.15.55:0/2476346730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f080015ca50 0x7f080014a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:25.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f07ff7fe640 1 --2- 172.21.15.55:0/2476346730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f080006c150 0x7f08001494c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f07f001cab0 tx=0x7f07f0018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:25.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f07e7fff640 1 -- 172.21.15.55:0/2476346730 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0005ba0 con 0x7f080006c150 2023-08-25T04:03:25.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f07e7fff640 1 -- 172.21.15.55:0/2476346730 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f0005d00 con 0x7f080006c150 2023-08-25T04:03:25.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f07e7fff640 1 -- 172.21.15.55:0/2476346730 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0003a30 con 0x7f080006c150 2023-08-25T04:03:25.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f0804ea1640 1 -- 172.21.15.55:0/2476346730 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08001489e0 con 0x7f080006c150 2023-08-25T04:03:25.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f0804ea1640 1 -- 172.21.15.55:0/2476346730 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0800148270 con 0x7f080006c150 2023-08-25T04:03:25.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.963+0000 7f0804ea1640 1 -- 172.21.15.55:0/2476346730 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0800073e50 con 0x7f080006c150 2023-08-25T04:03:25.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.967+0000 7f07e7fff640 1 -- 172.21.15.55:0/2476346730 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f07f00b2070 con 0x7f080006c150 2023-08-25T04:03:25.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.967+0000 7f07e7fff640 1 --2- 172.21.15.55:0/2476346730 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f07ec065680 0x7f07ec067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:25.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.967+0000 7f07e7fff640 1 -- 172.21.15.55:0/2476346730 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f07f011bff0 con 0x7f080006c150 2023-08-25T04:03:25.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.967+0000 7f07feffd640 1 --2- 172.21.15.55:0/2476346730 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f07ec065680 0x7f07ec067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:25.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.967+0000 7f07feffd640 1 --2- 172.21.15.55:0/2476346730 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f07ec065680 0x7f07ec067b40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f080014fb80 tx=0x7f07f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:25.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:25.971+0000 7f07e7fff640 1 -- 172.21.15.55:0/2476346730 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f07f00e9aa0 con 0x7f080006c150 2023-08-25T04:03:26.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.127+0000 7f0804ea1640 1 -- 172.21.15.55:0/2476346730 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08000c7830 con 0x7f080006c150 2023-08-25T04:03:26.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.131+0000 7f07e7fff640 1 -- 172.21.15.55:0/2476346730 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18291 (secure 0 0 0) 0x7f07f00ed0c0 con 0x7f080006c150 2023-08-25T04:03:26.132 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:26.133 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:02.329010+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:26.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.131+0000 7f0804ea1640 1 -- 172.21.15.55:0/2476346730 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f07ec065680 msgr2=0x7f07ec067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:26.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.131+0000 7f0804ea1640 1 --2- 172.21.15.55:0/2476346730 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f07ec065680 0x7f07ec067b40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f080014fb80 tx=0x7f07f4008040 comp rx=0 tx=0).stop 2023-08-25T04:03:26.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.131+0000 7f0804ea1640 1 -- 172.21.15.55:0/2476346730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f080006c150 msgr2=0x7f08001494c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:26.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.131+0000 7f0804ea1640 1 --2- 172.21.15.55:0/2476346730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f080006c150 0x7f08001494c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f07f001cab0 tx=0x7f07f0018fb0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.131+0000 7f0804ea1640 1 -- 172.21.15.55:0/2476346730 shutdown_connections 2023-08-25T04:03:26.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.131+0000 7f0804ea1640 1 --2- 172.21.15.55:0/2476346730 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f07ec065680 0x7f07ec067b40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.131+0000 7f0804ea1640 1 --2- 172.21.15.55:0/2476346730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f080015ca50 0x7f080014a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.131+0000 7f0804ea1640 1 --2- 172.21.15.55:0/2476346730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08000d0f50 0x7f0800147d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.131+0000 7f0804ea1640 1 --2- 172.21.15.55:0/2476346730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f080006c150 0x7f08001494c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.131+0000 7f0804ea1640 1 -- 172.21.15.55:0/2476346730 >> 172.21.15.55:0/2476346730 conn(0x7f0800065f40 msgr2=0x7f08000c6560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:26.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.131+0000 7f0804ea1640 1 -- 172.21.15.55:0/2476346730 shutdown_connections 2023-08-25T04:03:26.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.131+0000 7f0804ea1640 1 -- 172.21.15.55:0/2476346730 wait complete. 2023-08-25T04:03:26.154 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:02:58.890533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:03:00.093976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:03:26.155 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:03:26.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.299+0000 7fcc0a49c640 1 Processor -- start 2023-08-25T04:03:26.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.299+0000 7fcc0a49c640 1 -- start start 2023-08-25T04:03:26.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.303+0000 7fcc0a49c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcc041601f0 0x7fcc0415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:26.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.303+0000 7fcc0a49c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc040d1290 0x7fcc0415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:26.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.303+0000 7fcc0a49c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc040cd5a0 con 0x7fcc0415e3c0 2023-08-25T04:03:26.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.303+0000 7fcc0a49c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc040cd880 con 0x7fcc040d1290 2023-08-25T04:03:26.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.303+0000 7fcc0a49c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc040cdb60 con 0x7fcc041601f0 2023-08-25T04:03:26.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.303+0000 7fcc08a39640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc040d1290 0x7fcc0415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:26.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.303+0000 7fcc08a39640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc040d1290 0x7fcc0415e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47324/0 (socket says 172.21.15.55:47324) 2023-08-25T04:03:26.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.303+0000 7fcc08a39640 1 -- 172.21.15.55:0/526215656 learned_addr learned my addr 172.21.15.55:0/526215656 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:26.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.303+0000 7fcc03fff640 1 --2- 172.21.15.55:0/526215656 >> v2:172.21.15.110:3300/0 conn(0x7fcc041601f0 0x7fcc0415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:26.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.303+0000 7fcc08a39640 1 -- 172.21.15.55:0/526215656 >> v2:172.21.15.110:3300/0 conn(0x7fcc041601f0 msgr2=0x7fcc0415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:26.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.303+0000 7fcc08a39640 1 --2- 172.21.15.55:0/526215656 >> v2:172.21.15.110:3300/0 conn(0x7fcc041601f0 0x7fcc0415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.303+0000 7fcc08a39640 1 -- 172.21.15.55:0/526215656 >> v1:172.21.15.110:6789/0 conn(0x7fcc0415e3c0 legacy=0x7fcc040d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:26.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.303+0000 7fcc08a39640 1 -- 172.21.15.55:0/526215656 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc040cde40 con 0x7fcc040d1290 2023-08-25T04:03:26.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.303+0000 7fcc08a39640 1 --2- 172.21.15.55:0/526215656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc040d1290 0x7fcc0415e8a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcc0408b7f0 tx=0x7fcbfc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec55338fea2f9f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:26.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc02ffd640 1 -- 172.21.15.55:0/526215656 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0a5790 con 0x7fcc040d1290 2023-08-25T04:03:26.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc02ffd640 1 -- 172.21.15.55:0/526215656 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc0a58f0 con 0x7fcc040d1290 2023-08-25T04:03:26.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc02ffd640 1 -- 172.21.15.55:0/526215656 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0a5c80 con 0x7fcc040d1290 2023-08-25T04:03:26.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc0a49c640 1 -- 172.21.15.55:0/526215656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc040d1290 msgr2=0x7fcc0415e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:26.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc0a49c640 1 --2- 172.21.15.55:0/526215656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc040d1290 0x7fcc0415e8a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcc0408b7f0 tx=0x7fcbfc01c9a0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc0a49c640 1 -- 172.21.15.55:0/526215656 shutdown_connections 2023-08-25T04:03:26.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc0a49c640 1 --2- 172.21.15.55:0/526215656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc040d1290 0x7fcc0415e8a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc0a49c640 1 --2- 172.21.15.55:0/526215656 >> v2:172.21.15.110:3300/0 conn(0x7fcc041601f0 0x7fcc0415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc0a49c640 1 -- 172.21.15.55:0/526215656 >> 172.21.15.55:0/526215656 conn(0x7fcc040d27d0 msgr2=0x7fcc040d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:26.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc0a49c640 1 -- 172.21.15.55:0/526215656 shutdown_connections 2023-08-25T04:03:26.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc0a49c640 1 -- 172.21.15.55:0/526215656 wait complete. 2023-08-25T04:03:26.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc0a49c640 1 Processor -- start 2023-08-25T04:03:26.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc0a49c640 1 -- start start 2023-08-25T04:03:26.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc0a49c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc040d1290 0x7fcc04151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:26.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc0a49c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc0415e3c0 0x7fcc040ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:26.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc0a49c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc041601f0 0x7fcc041f8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:26.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc0a49c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc040b6d00 con 0x7fcc041601f0 2023-08-25T04:03:26.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc0a49c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc040b6fe0 con 0x7fcc040d1290 2023-08-25T04:03:26.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc0a49c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc040b72c0 con 0x7fcc0415e3c0 2023-08-25T04:03:26.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc08a39640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc041601f0 0x7fcc041f8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:26.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc03fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc040d1290 0x7fcc04151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:26.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc08a39640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc041601f0 0x7fcc041f8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47334/0 (socket says 172.21.15.55:47334) 2023-08-25T04:03:26.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc03fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc040d1290 0x7fcc04151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:57004/0 (socket says 172.21.15.55:57004) 2023-08-25T04:03:26.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc08a39640 1 -- 172.21.15.55:0/1015934960 learned_addr learned my addr 172.21.15.55:0/1015934960 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:26.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.307+0000 7fcc037fe640 1 --2- 172.21.15.55:0/1015934960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc0415e3c0 0x7fcc040ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:26.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.311+0000 7fcc08a39640 1 -- 172.21.15.55:0/1015934960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc0415e3c0 msgr2=0x7fcc040ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:26.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.311+0000 7fcc08a39640 1 --2- 172.21.15.55:0/1015934960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc0415e3c0 0x7fcc040ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.311+0000 7fcc08a39640 1 -- 172.21.15.55:0/1015934960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc040d1290 msgr2=0x7fcc04151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:26.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.311+0000 7fcc08a39640 1 --2- 172.21.15.55:0/1015934960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc040d1290 0x7fcc04151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.311+0000 7fcc08a39640 1 -- 172.21.15.55:0/1015934960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc009b30 con 0x7fcc041601f0 2023-08-25T04:03:26.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.311+0000 7fcc037fe640 1 --2- 172.21.15.55:0/1015934960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc0415e3c0 0x7fcc040ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:26.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.311+0000 7fcc08a39640 1 --2- 172.21.15.55:0/1015934960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc041601f0 0x7fcc041f8ce0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0af040 tx=0x7fcbfc019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:26.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.311+0000 7fcc00ff9640 1 -- 172.21.15.55:0/1015934960 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0b8670 con 0x7fcc041601f0 2023-08-25T04:03:26.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.311+0000 7fcc00ff9640 1 -- 172.21.15.55:0/1015934960 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc0b87d0 con 0x7fcc041601f0 2023-08-25T04:03:26.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.311+0000 7fcc0a49c640 1 -- 172.21.15.55:0/1015934960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc040ce7c0 con 0x7fcc041601f0 2023-08-25T04:03:26.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.311+0000 7fcc00ff9640 1 -- 172.21.15.55:0/1015934960 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0b8b80 con 0x7fcc041601f0 2023-08-25T04:03:26.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.311+0000 7fcc0a49c640 1 -- 172.21.15.55:0/1015934960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc04158eb0 con 0x7fcc041601f0 2023-08-25T04:03:26.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.311+0000 7fcc0a49c640 1 -- 172.21.15.55:0/1015934960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc040b5260 con 0x7fcc041601f0 2023-08-25T04:03:26.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.311+0000 7fcc00ff9640 1 -- 172.21.15.55:0/1015934960 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fcbfc0b8ce0 con 0x7fcc041601f0 2023-08-25T04:03:26.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.311+0000 7fcc00ff9640 1 --2- 172.21.15.55:0/1015934960 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcbf0065680 0x7fcbf0067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:26.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.311+0000 7fcc00ff9640 1 -- 172.21.15.55:0/1015934960 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcbfc11e720 con 0x7fcc041601f0 2023-08-25T04:03:26.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.311+0000 7fcc03fff640 1 --2- 172.21.15.55:0/1015934960 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcbf0065680 0x7fcbf0067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:26.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.315+0000 7fcc03fff640 1 --2- 172.21.15.55:0/1015934960 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcbf0065680 0x7fcbf0067b40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcc0415da50 tx=0x7fcbf4006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:26.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.315+0000 7fcc00ff9640 1 -- 172.21.15.55:0/1015934960 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fcbfc0ec330 con 0x7fcc041601f0 2023-08-25T04:03:26.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.475+0000 7fcc0a49c640 1 -- 172.21.15.55:0/1015934960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc040b7ac0 con 0x7fcc041601f0 2023-08-25T04:03:26.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.475+0000 7fcc00ff9640 1 -- 172.21.15.55:0/1015934960 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc040b7ac0 con 0x7fcc041601f0 2023-08-25T04:03:26.479 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:03:26.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.479+0000 7fcc0a49c640 1 -- 172.21.15.55:0/1015934960 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcbf0065680 msgr2=0x7fcbf0067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:26.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.479+0000 7fcc0a49c640 1 --2- 172.21.15.55:0/1015934960 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcbf0065680 0x7fcbf0067b40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcc0415da50 tx=0x7fcbf4006f90 comp rx=0 tx=0).stop 2023-08-25T04:03:26.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.479+0000 7fcc0a49c640 1 -- 172.21.15.55:0/1015934960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc041601f0 msgr2=0x7fcc041f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:26.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.479+0000 7fcc0a49c640 1 --2- 172.21.15.55:0/1015934960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc041601f0 0x7fcc041f8ce0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0af040 tx=0x7fcbfc019740 comp rx=0 tx=0).stop 2023-08-25T04:03:26.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.479+0000 7fcc0a49c640 1 -- 172.21.15.55:0/1015934960 shutdown_connections 2023-08-25T04:03:26.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.479+0000 7fcc0a49c640 1 --2- 172.21.15.55:0/1015934960 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcbf0065680 0x7fcbf0067b40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.479+0000 7fcc0a49c640 1 --2- 172.21.15.55:0/1015934960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc041601f0 0x7fcc041f8ce0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.479+0000 7fcc0a49c640 1 --2- 172.21.15.55:0/1015934960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc0415e3c0 0x7fcc040ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.479+0000 7fcc0a49c640 1 --2- 172.21.15.55:0/1015934960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc040d1290 0x7fcc04151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.479+0000 7fcc0a49c640 1 -- 172.21.15.55:0/1015934960 >> 172.21.15.55:0/1015934960 conn(0x7fcc040d27d0 msgr2=0x7fcc040b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:26.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.479+0000 7fcc0a49c640 1 -- 172.21.15.55:0/1015934960 shutdown_connections 2023-08-25T04:03:26.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.479+0000 7fcc0a49c640 1 -- 172.21.15.55:0/1015934960 wait complete. 2023-08-25T04:03:26.504 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:03:26.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.647+0000 7fd91449e640 1 Processor -- start 2023-08-25T04:03:26.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.651+0000 7fd91449e640 1 -- start start 2023-08-25T04:03:26.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.651+0000 7fd91449e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd90c0c9830 0x7fd90c09bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:26.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.651+0000 7fd91449e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd90c06c020 0x7fd90c0acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:26.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.651+0000 7fd91449e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd90c15abd0 con 0x7fd90c15a7f0 2023-08-25T04:03:26.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.651+0000 7fd91449e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd90c0c8ab0 con 0x7fd90c0c9830 2023-08-25T04:03:26.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.651+0000 7fd91449e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c0c8d50 con 0x7fd90c06c020 2023-08-25T04:03:26.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.651+0000 7fd911a39640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd90c0c9830 0x7fd90c09bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:26.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.651+0000 7fd911a39640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd90c0c9830 0x7fd90c09bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47348/0 (socket says 172.21.15.55:47348) 2023-08-25T04:03:26.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.651+0000 7fd911a39640 1 -- 172.21.15.55:0/1872535884 learned_addr learned my addr 172.21.15.55:0/1872535884 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:26.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.651+0000 7fd912a3b640 1 --2- 172.21.15.55:0/1872535884 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd90c06c020 0x7fd90c0acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:26.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.651+0000 7fd911a39640 1 -- 172.21.15.55:0/1872535884 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd90c06c020 msgr2=0x7fd90c0acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:26.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.651+0000 7fd911a39640 1 --2- 172.21.15.55:0/1872535884 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd90c06c020 0x7fd90c0acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.651+0000 7fd911a39640 1 -- 172.21.15.55:0/1872535884 >> v1:172.21.15.110:6789/0 conn(0x7fd90c15a7f0 legacy=0x7fd90c070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:26.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.651+0000 7fd911a39640 1 -- 172.21.15.55:0/1872535884 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c0c9030 con 0x7fd90c0c9830 2023-08-25T04:03:26.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.655+0000 7fd911a39640 1 --2- 172.21.15.55:0/1872535884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd90c0c9830 0x7fd90c09bde0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc009870 tx=0x7fd8fc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652652bfd96d99da server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:26.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.655+0000 7fd911238640 1 -- 172.21.15.55:0/1872535884 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc0ab620 con 0x7fd90c0c9830 2023-08-25T04:03:26.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.655+0000 7fd911238640 1 -- 172.21.15.55:0/1872535884 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8fc0ab780 con 0x7fd90c0c9830 2023-08-25T04:03:26.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.655+0000 7fd911238640 1 -- 172.21.15.55:0/1872535884 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc0abb10 con 0x7fd90c0c9830 2023-08-25T04:03:26.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.655+0000 7fd91449e640 1 -- 172.21.15.55:0/1872535884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd90c0c9830 msgr2=0x7fd90c09bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:26.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.655+0000 7fd91449e640 1 --2- 172.21.15.55:0/1872535884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd90c0c9830 0x7fd90c09bde0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc009870 tx=0x7fd8fc01c510 comp rx=0 tx=0).stop 2023-08-25T04:03:26.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.655+0000 7fd91449e640 1 -- 172.21.15.55:0/1872535884 shutdown_connections 2023-08-25T04:03:26.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.655+0000 7fd91449e640 1 --2- 172.21.15.55:0/1872535884 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd90c06c020 0x7fd90c0acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.655+0000 7fd91449e640 1 --2- 172.21.15.55:0/1872535884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd90c0c9830 0x7fd90c09bde0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.655+0000 7fd91449e640 1 -- 172.21.15.55:0/1872535884 >> 172.21.15.55:0/1872535884 conn(0x7fd90c069900 msgr2=0x7fd90c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:26.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.655+0000 7fd91449e640 1 -- 172.21.15.55:0/1872535884 shutdown_connections 2023-08-25T04:03:26.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.655+0000 7fd91449e640 1 -- 172.21.15.55:0/1872535884 wait complete. 2023-08-25T04:03:26.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.655+0000 7fd91449e640 1 Processor -- start 2023-08-25T04:03:26.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.655+0000 7fd91449e640 1 -- start start 2023-08-25T04:03:26.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd91449e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd90c06c020 0x7fd90c158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:26.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd91449e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd90c0c9830 0x7fd90c1595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:26.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd91449e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd90c15a7f0 0x7fd90c159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:26.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd91449e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c15cc90 con 0x7fd90c06c020 2023-08-25T04:03:26.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd91449e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c15cec0 con 0x7fd90c15a7f0 2023-08-25T04:03:26.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd91449e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c15d1a0 con 0x7fd90c0c9830 2023-08-25T04:03:26.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd91223a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd90c06c020 0x7fd90c158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:26.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd91223a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd90c06c020 0x7fd90c158450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47354/0 (socket says 172.21.15.55:47354) 2023-08-25T04:03:26.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd91223a640 1 -- 172.21.15.55:0/3093172569 learned_addr learned my addr 172.21.15.55:0/3093172569 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:26.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd912a3b640 1 --2- 172.21.15.55:0/3093172569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd90c15a7f0 0x7fd90c159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:26.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd911a39640 1 --2- 172.21.15.55:0/3093172569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd90c0c9830 0x7fd90c1595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:26.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd91223a640 1 -- 172.21.15.55:0/3093172569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd90c0c9830 msgr2=0x7fd90c1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:26.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd91223a640 1 --2- 172.21.15.55:0/3093172569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd90c0c9830 0x7fd90c1595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd91223a640 1 -- 172.21.15.55:0/3093172569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd90c15a7f0 msgr2=0x7fd90c159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:26.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd91223a640 1 --2- 172.21.15.55:0/3093172569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd90c15a7f0 0x7fd90c159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd91223a640 1 -- 172.21.15.55:0/3093172569 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc0094d0 con 0x7fd90c06c020 2023-08-25T04:03:26.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd91223a640 1 --2- 172.21.15.55:0/3093172569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd90c06c020 0x7fd90c158450 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd90800c400 tx=0x7fd90800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:26.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd902ffd640 1 -- 172.21.15.55:0/3093172569 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9080052d0 con 0x7fd90c06c020 2023-08-25T04:03:26.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd902ffd640 1 -- 172.21.15.55:0/3093172569 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd908005430 con 0x7fd90c06c020 2023-08-25T04:03:26.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd902ffd640 1 -- 172.21.15.55:0/3093172569 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908003890 con 0x7fd90c06c020 2023-08-25T04:03:26.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd91449e640 1 -- 172.21.15.55:0/3093172569 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90c15d480 con 0x7fd90c06c020 2023-08-25T04:03:26.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd91449e640 1 -- 172.21.15.55:0/3093172569 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90c15da40 con 0x7fd90c06c020 2023-08-25T04:03:26.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.659+0000 7fd91449e640 1 -- 172.21.15.55:0/3093172569 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90c06d5b0 con 0x7fd90c06c020 2023-08-25T04:03:26.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.663+0000 7fd902ffd640 1 -- 172.21.15.55:0/3093172569 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd9080039f0 con 0x7fd90c06c020 2023-08-25T04:03:26.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.663+0000 7fd902ffd640 1 --2- 172.21.15.55:0/3093172569 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd8f0065680 0x7fd8f0067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:26.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.663+0000 7fd902ffd640 1 -- 172.21.15.55:0/3093172569 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd908082340 con 0x7fd90c06c020 2023-08-25T04:03:26.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.663+0000 7fd911a39640 1 --2- 172.21.15.55:0/3093172569 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd8f0065680 0x7fd8f0067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:26.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.663+0000 7fd911a39640 1 --2- 172.21.15.55:0/3093172569 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd8f0065680 0x7fd8f0067b40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0af000 tx=0x7fd8fc0b6040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:26.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.667+0000 7fd902ffd640 1 -- 172.21.15.55:0/3093172569 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd90804feb0 con 0x7fd90c06c020 2023-08-25T04:03:26.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.823+0000 7fd91449e640 1 -- 172.21.15.55:0/3093172569 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd90c073ec0 con 0x7fd90c06c020 2023-08-25T04:03:26.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.823+0000 7fd902ffd640 1 -- 172.21.15.55:0/3093172569 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd9080534d0 con 0x7fd90c06c020 2023-08-25T04:03:26.826 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:03:26.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.827+0000 7fd91449e640 1 -- 172.21.15.55:0/3093172569 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd8f0065680 msgr2=0x7fd8f0067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:26.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.827+0000 7fd91449e640 1 --2- 172.21.15.55:0/3093172569 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd8f0065680 0x7fd8f0067b40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0af000 tx=0x7fd8fc0b6040 comp rx=0 tx=0).stop 2023-08-25T04:03:26.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.827+0000 7fd91449e640 1 -- 172.21.15.55:0/3093172569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd90c06c020 msgr2=0x7fd90c158450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:26.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.827+0000 7fd91449e640 1 --2- 172.21.15.55:0/3093172569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd90c06c020 0x7fd90c158450 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd90800c400 tx=0x7fd90800c8c0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.827+0000 7fd91449e640 1 -- 172.21.15.55:0/3093172569 shutdown_connections 2023-08-25T04:03:26.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.827+0000 7fd91449e640 1 --2- 172.21.15.55:0/3093172569 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd8f0065680 0x7fd8f0067b40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.827+0000 7fd91449e640 1 --2- 172.21.15.55:0/3093172569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd90c15a7f0 0x7fd90c159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.827+0000 7fd91449e640 1 --2- 172.21.15.55:0/3093172569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd90c0c9830 0x7fd90c1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.827+0000 7fd91449e640 1 --2- 172.21.15.55:0/3093172569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd90c06c020 0x7fd90c158450 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.827+0000 7fd91449e640 1 -- 172.21.15.55:0/3093172569 >> 172.21.15.55:0/3093172569 conn(0x7fd90c069900 msgr2=0x7fd90c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:26.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.827+0000 7fd91449e640 1 -- 172.21.15.55:0/3093172569 shutdown_connections 2023-08-25T04:03:26.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.827+0000 7fd91449e640 1 -- 172.21.15.55:0/3093172569 wait complete. 2023-08-25T04:03:26.847 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:03:26.913 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:03:26.917 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:03:26.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.991+0000 7fc8bc943640 1 Processor -- start 2023-08-25T04:03:26.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.991+0000 7fc8bc943640 1 -- start start 2023-08-25T04:03:26.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.995+0000 7fc8bc943640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8b80cfc90 0x7fc8b80b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:26.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.995+0000 7fc8bc943640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8b80b8330 0x7fc8b80b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:26.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.995+0000 7fc8bc943640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b80b70c0 con 0x7fc8b815fca0 2023-08-25T04:03:26.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.995+0000 7fc8bc943640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b8160080 con 0x7fc8b80b8330 2023-08-25T04:03:26.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.995+0000 7fc8bc943640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80b73a0 con 0x7fc8b80cfc90 2023-08-25T04:03:26.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.995+0000 7fc8b759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8b80b8330 0x7fc8b80b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:26.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.995+0000 7fc8b6d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc8b815fca0 0x7fc8b80cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60916/0 (socket says 172.21.15.55:60916) 2023-08-25T04:03:26.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.995+0000 7fc8b6d9d640 1 -- 172.21.15.55:0/174153533 learned_addr learned my addr 172.21.15.55:0/174153533 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:26.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.995+0000 7fc8affff640 1 --2- 172.21.15.55:0/174153533 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8b80cfc90 0x7fc8b80b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:26.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.995+0000 7fc8b759e640 1 -- 172.21.15.55:0/174153533 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8b80cfc90 msgr2=0x7fc8b80b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:26.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.995+0000 7fc8b759e640 1 --2- 172.21.15.55:0/174153533 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8b80cfc90 0x7fc8b80b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:26.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.995+0000 7fc8b759e640 1 -- 172.21.15.55:0/174153533 >> v1:172.21.15.55:6789/0 conn(0x7fc8b815fca0 legacy=0x7fc8b80cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:26.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.995+0000 7fc8b759e640 1 -- 172.21.15.55:0/174153533 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b80b7680 con 0x7fc8b80b8330 2023-08-25T04:03:26.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.995+0000 7fc8b659c640 1 -- 172.21.15.55:0/174153533 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979429457 0 0) 0x7fc8b80b70c0 con 0x7fc8b815fca0 2023-08-25T04:03:26.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8b759e640 1 --2- 172.21.15.55:0/174153533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8b80b8330 0x7fc8b80b5b10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009d90 tx=0x7fc8b001f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7afac4e9e113e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:26.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8b659c640 1 -- 172.21.15.55:0/174153533 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00af600 con 0x7fc8b80b8330 2023-08-25T04:03:26.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8b659c640 1 -- 172.21.15.55:0/174153533 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b00ab050 con 0x7fc8b80b8330 2023-08-25T04:03:26.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8b659c640 1 -- 172.21.15.55:0/174153533 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00af980 con 0x7fc8b80b8330 2023-08-25T04:03:27.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8bc943640 1 -- 172.21.15.55:0/174153533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8b80b8330 msgr2=0x7fc8b80b5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:27.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8bc943640 1 --2- 172.21.15.55:0/174153533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8b80b8330 0x7fc8b80b5b10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009d90 tx=0x7fc8b001f130 comp rx=0 tx=0).stop 2023-08-25T04:03:27.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8bc943640 1 -- 172.21.15.55:0/174153533 shutdown_connections 2023-08-25T04:03:27.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8bc943640 1 --2- 172.21.15.55:0/174153533 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8b80cfc90 0x7fc8b80b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8bc943640 1 --2- 172.21.15.55:0/174153533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8b80b8330 0x7fc8b80b5b10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8bc943640 1 -- 172.21.15.55:0/174153533 >> 172.21.15.55:0/174153533 conn(0x7fc8b80658c0 msgr2=0x7fc8b8065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:27.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8bc943640 1 -- 172.21.15.55:0/174153533 shutdown_connections 2023-08-25T04:03:27.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8bc943640 1 -- 172.21.15.55:0/174153533 wait complete. 2023-08-25T04:03:27.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8bc943640 1 Processor -- start 2023-08-25T04:03:27.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8bc943640 1 -- start start 2023-08-25T04:03:27.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8bc943640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8b80b8330 0x7fc8b814c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:27.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8bc943640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8b80cfc90 0x7fc8b80c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:27.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8bc943640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8b815fca0 0x7fc8b814a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:27.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8bc943640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b814f2b0 con 0x7fc8b80b8330 2023-08-25T04:03:27.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8bc943640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b814e0c0 con 0x7fc8b80cfc90 2023-08-25T04:03:27.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:26.999+0000 7fc8bc943640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b814c5f0 con 0x7fc8b815fca0 2023-08-25T04:03:27.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8b6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8b80b8330 0x7fc8b814c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8b6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8b80b8330 0x7fc8b814c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47372/0 (socket says 172.21.15.55:47372) 2023-08-25T04:03:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8b6d9d640 1 -- 172.21.15.55:0/2865401771 learned_addr learned my addr 172.21.15.55:0/2865401771 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8affff640 1 --2- 172.21.15.55:0/2865401771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8b80cfc90 0x7fc8b80c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8b759e640 1 --2- 172.21.15.55:0/2865401771 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8b815fca0 0x7fc8b814a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8b6d9d640 1 -- 172.21.15.55:0/2865401771 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8b815fca0 msgr2=0x7fc8b814a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8b6d9d640 1 --2- 172.21.15.55:0/2865401771 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8b815fca0 0x7fc8b814a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8b6d9d640 1 -- 172.21.15.55:0/2865401771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8b80cfc90 msgr2=0x7fc8b80c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8b6d9d640 1 --2- 172.21.15.55:0/2865401771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8b80cfc90 0x7fc8b80c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8b6d9d640 1 -- 172.21.15.55:0/2865401771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b0009a70 con 0x7fc8b80b8330 2023-08-25T04:03:27.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8b759e640 1 --2- 172.21.15.55:0/2865401771 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8b815fca0 0x7fc8b814a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:27.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8b6d9d640 1 --2- 172.21.15.55:0/2865401771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8b80b8330 0x7fc8b814c0b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800c480 tx=0x7fc8a800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:27.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8af7fe640 1 -- 172.21.15.55:0/2865401771 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a80074e0 con 0x7fc8b80b8330 2023-08-25T04:03:27.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8af7fe640 1 -- 172.21.15.55:0/2865401771 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a8007660 con 0x7fc8b80b8330 2023-08-25T04:03:27.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8af7fe640 1 -- 172.21.15.55:0/2865401771 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8004a30 con 0x7fc8b80b8330 2023-08-25T04:03:27.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8bc943640 1 -- 172.21.15.55:0/2865401771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b81527f0 con 0x7fc8b80b8330 2023-08-25T04:03:27.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8bc943640 1 -- 172.21.15.55:0/2865401771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b814eed0 con 0x7fc8b80b8330 2023-08-25T04:03:27.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8bc943640 1 -- 172.21.15.55:0/2865401771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b814f3f0 con 0x7fc8b80b8330 2023-08-25T04:03:27.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8af7fe640 1 -- 172.21.15.55:0/2865401771 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc8a8004b90 con 0x7fc8b80b8330 2023-08-25T04:03:27.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.003+0000 7fc8af7fe640 1 --2- 172.21.15.55:0/2865401771 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc898065680 0x7fc898067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:27.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.007+0000 7fc8af7fe640 1 -- 172.21.15.55:0/2865401771 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc8a8081fc0 con 0x7fc8b80b8330 2023-08-25T04:03:27.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.007+0000 7fc8affff640 1 --2- 172.21.15.55:0/2865401771 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc898065680 0x7fc898067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:27.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.007+0000 7fc8affff640 1 --2- 172.21.15.55:0/2865401771 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc898065680 0x7fc898067b40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8156c30 tx=0x7fc8a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:27.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.011+0000 7fc8af7fe640 1 -- 172.21.15.55:0/2865401771 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc8a8053500 con 0x7fc8b80b8330 2023-08-25T04:03:27.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.163+0000 7fc8bc943640 1 -- 172.21.15.55:0/2865401771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc8b8073e50 con 0x7fc8b80b8330 2023-08-25T04:03:27.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.163+0000 7fc8af7fe640 1 -- 172.21.15.55:0/2865401771 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc8a8018020 con 0x7fc8b80b8330 2023-08-25T04:03:27.167 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:03:27.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.167+0000 7fc8bc943640 1 -- 172.21.15.55:0/2865401771 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc898065680 msgr2=0x7fc898067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:27.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.167+0000 7fc8bc943640 1 --2- 172.21.15.55:0/2865401771 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc898065680 0x7fc898067b40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8156c30 tx=0x7fc8a0008040 comp rx=0 tx=0).stop 2023-08-25T04:03:27.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.167+0000 7fc8bc943640 1 -- 172.21.15.55:0/2865401771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8b80b8330 msgr2=0x7fc8b814c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:27.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.167+0000 7fc8bc943640 1 --2- 172.21.15.55:0/2865401771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8b80b8330 0x7fc8b814c0b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800c480 tx=0x7fc8a800c940 comp rx=0 tx=0).stop 2023-08-25T04:03:27.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.167+0000 7fc8bc943640 1 -- 172.21.15.55:0/2865401771 shutdown_connections 2023-08-25T04:03:27.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.167+0000 7fc8bc943640 1 --2- 172.21.15.55:0/2865401771 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc898065680 0x7fc898067b40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.167+0000 7fc8bc943640 1 --2- 172.21.15.55:0/2865401771 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8b815fca0 0x7fc8b814a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.167+0000 7fc8bc943640 1 --2- 172.21.15.55:0/2865401771 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8b80cfc90 0x7fc8b80c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.167+0000 7fc8bc943640 1 --2- 172.21.15.55:0/2865401771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8b80b8330 0x7fc8b814c0b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.167+0000 7fc8bc943640 1 -- 172.21.15.55:0/2865401771 >> 172.21.15.55:0/2865401771 conn(0x7fc8b80658c0 msgr2=0x7fc8b80b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.167+0000 7fc8bc943640 1 -- 172.21.15.55:0/2865401771 shutdown_connections 2023-08-25T04:03:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.167+0000 7fc8bc943640 1 -- 172.21.15.55:0/2865401771 wait complete. 2023-08-25T04:03:27.188 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:03:27.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.375+0000 7fa40ae93640 1 Processor -- start 2023-08-25T04:03:27.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.375+0000 7fa40ae93640 1 -- start start 2023-08-25T04:03:27.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.375+0000 7fa40ae93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa40415e3c0 0x7fa40415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:27.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.375+0000 7fa40ae93640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4040cd5a0 con 0x7fa4041601f0 2023-08-25T04:03:27.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.375+0000 7fa40ae93640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4040cd880 con 0x7fa4040d1290 2023-08-25T04:03:27.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.375+0000 7fa40ae93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4040cdb60 con 0x7fa40415e3c0 2023-08-25T04:03:27.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.375+0000 7fa408c2f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa4041601f0 0x7fa4040d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60918/0 (socket says 172.21.15.55:60918) 2023-08-25T04:03:27.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.375+0000 7fa408c2f640 1 -- 172.21.15.55:0/1546706352 learned_addr learned my addr 172.21.15.55:0/1546706352 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:27.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.375+0000 7fa3fbfff640 1 --2- 172.21.15.55:0/1546706352 >> v2:172.21.15.55:3300/0 conn(0x7fa40415e3c0 0x7fa40415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:27.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.375+0000 7fa3fb7fe640 1 -- 172.21.15.55:0/1546706352 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392987588 0 0) 0x7fa4040cd5a0 con 0x7fa4041601f0 2023-08-25T04:03:27.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.375+0000 7fa3fbfff640 1 -- 172.21.15.55:0/1546706352 >> v1:172.21.15.110:6789/0 conn(0x7fa4040d1290 legacy=0x7fa40415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:27.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.375+0000 7fa3fbfff640 1 -- 172.21.15.55:0/1546706352 >> v1:172.21.15.55:6789/0 conn(0x7fa4041601f0 legacy=0x7fa4040d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:27.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.375+0000 7fa3fbfff640 1 -- 172.21.15.55:0/1546706352 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4040cde40 con 0x7fa40415e3c0 2023-08-25T04:03:27.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.379+0000 7fa3fbfff640 1 --2- 172.21.15.55:0/1546706352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa40415e3c0 0x7fa40415d430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40097c0 tx=0x7fa3f401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7349ca7c161b79e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:27.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.379+0000 7fa3fb7fe640 1 -- 172.21.15.55:0/1546706352 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f40ab600 con 0x7fa40415e3c0 2023-08-25T04:03:27.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.379+0000 7fa3fb7fe640 1 -- 172.21.15.55:0/1546706352 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f40a7050 con 0x7fa40415e3c0 2023-08-25T04:03:27.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.379+0000 7fa3fb7fe640 1 -- 172.21.15.55:0/1546706352 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f40ab980 con 0x7fa40415e3c0 2023-08-25T04:03:27.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.379+0000 7fa40ae93640 1 -- 172.21.15.55:0/1546706352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa40415e3c0 msgr2=0x7fa40415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.379+0000 7fa40ae93640 1 --2- 172.21.15.55:0/1546706352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa40415e3c0 0x7fa40415d430 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40097c0 tx=0x7fa3f401c410 comp rx=0 tx=0).stop 2023-08-25T04:03:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.379+0000 7fa40ae93640 1 -- 172.21.15.55:0/1546706352 shutdown_connections 2023-08-25T04:03:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.379+0000 7fa40ae93640 1 --2- 172.21.15.55:0/1546706352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa40415e3c0 0x7fa40415d430 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.379+0000 7fa40ae93640 1 -- 172.21.15.55:0/1546706352 >> 172.21.15.55:0/1546706352 conn(0x7fa4040d27d0 msgr2=0x7fa4040d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.379+0000 7fa40ae93640 1 -- 172.21.15.55:0/1546706352 shutdown_connections 2023-08-25T04:03:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.379+0000 7fa40ae93640 1 -- 172.21.15.55:0/1546706352 wait complete. 2023-08-25T04:03:27.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa40ae93640 1 Processor -- start 2023-08-25T04:03:27.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa40ae93640 1 -- start start 2023-08-25T04:03:27.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa40ae93640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4040d1290 0x7fa404154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:27.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa40ae93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa40415e3c0 0x7fa404148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:27.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa40ae93640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4041601f0 0x7fa4040b6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:27.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa40ae93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa404149320 con 0x7fa40415e3c0 2023-08-25T04:03:27.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa40ae93640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4040b6d40 con 0x7fa4040d1290 2023-08-25T04:03:27.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa40ae93640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40414bd10 con 0x7fa4041601f0 2023-08-25T04:03:27.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa3fbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa40415e3c0 0x7fa404148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:27.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa3fbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa40415e3c0 0x7fa404148de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47390/0 (socket says 172.21.15.55:47390) 2023-08-25T04:03:27.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa3fbfff640 1 -- 172.21.15.55:0/4112907514 learned_addr learned my addr 172.21.15.55:0/4112907514 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:27.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa3fbfff640 1 -- 172.21.15.55:0/4112907514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4041601f0 msgr2=0x7fa4040b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:27.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa409430640 1 --2- 172.21.15.55:0/4112907514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4041601f0 0x7fa4040b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:27.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa408c2f640 1 --2- 172.21.15.55:0/4112907514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4040d1290 0x7fa404154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:27.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa3fbfff640 1 --2- 172.21.15.55:0/4112907514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4041601f0 0x7fa4040b6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa3fbfff640 1 -- 172.21.15.55:0/4112907514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4040d1290 msgr2=0x7fa404154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:27.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa3fbfff640 1 --2- 172.21.15.55:0/4112907514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4040d1290 0x7fa404154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa3fbfff640 1 -- 172.21.15.55:0/4112907514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f4009420 con 0x7fa40415e3c0 2023-08-25T04:03:27.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa409430640 1 --2- 172.21.15.55:0/4112907514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4041601f0 0x7fa4040b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:27.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa408c2f640 1 --2- 172.21.15.55:0/4112907514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4040d1290 0x7fa404154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:27.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa3fbfff640 1 --2- 172.21.15.55:0/4112907514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa40415e3c0 0x7fa404148de0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4019020 tx=0x7fa3f40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:27.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa3f97fa640 1 -- 172.21.15.55:0/4112907514 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f40b4600 con 0x7fa40415e3c0 2023-08-25T04:03:27.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa3f97fa640 1 -- 172.21.15.55:0/4112907514 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f40b47a0 con 0x7fa40415e3c0 2023-08-25T04:03:27.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa3f97fa640 1 -- 172.21.15.55:0/4112907514 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f40b4b50 con 0x7fa40415e3c0 2023-08-25T04:03:27.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa40ae93640 1 -- 172.21.15.55:0/4112907514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4040ce7c0 con 0x7fa40415e3c0 2023-08-25T04:03:27.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.383+0000 7fa40ae93640 1 -- 172.21.15.55:0/4112907514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4040b5a40 con 0x7fa40415e3c0 2023-08-25T04:03:27.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.387+0000 7fa40ae93640 1 -- 172.21.15.55:0/4112907514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4040b5260 con 0x7fa40415e3c0 2023-08-25T04:03:27.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.387+0000 7fa3f97fa640 1 -- 172.21.15.55:0/4112907514 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa3f40b2040 con 0x7fa40415e3c0 2023-08-25T04:03:27.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.387+0000 7fa3f97fa640 1 --2- 172.21.15.55:0/4112907514 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa3f0065680 0x7fa3f0067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:27.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.387+0000 7fa3f97fa640 1 -- 172.21.15.55:0/4112907514 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3f411d060 con 0x7fa40415e3c0 2023-08-25T04:03:27.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.387+0000 7fa408c2f640 1 --2- 172.21.15.55:0/4112907514 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa3f0065680 0x7fa3f0067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:27.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.387+0000 7fa408c2f640 1 --2- 172.21.15.55:0/4112907514 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa3f0065680 0x7fa3f0067b40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa404154220 tx=0x7fa400009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:27.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.391+0000 7fa3f97fa640 1 -- 172.21.15.55:0/4112907514 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa3f40eaba0 con 0x7fa40415e3c0 2023-08-25T04:03:27.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.547+0000 7fa40ae93640 1 -- 172.21.15.55:0/4112907514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa404073ec0 con 0x7fa40415e3c0 2023-08-25T04:03:27.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.547+0000 7fa3f97fa640 1 -- 172.21.15.55:0/4112907514 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa3f40ee1c0 con 0x7fa40415e3c0 2023-08-25T04:03:27.549 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:03:27.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.547+0000 7fa40ae93640 1 -- 172.21.15.55:0/4112907514 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa3f0065680 msgr2=0x7fa3f0067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:27.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.547+0000 7fa40ae93640 1 --2- 172.21.15.55:0/4112907514 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa3f0065680 0x7fa3f0067b40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa404154220 tx=0x7fa400009040 comp rx=0 tx=0).stop 2023-08-25T04:03:27.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.547+0000 7fa40ae93640 1 -- 172.21.15.55:0/4112907514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa40415e3c0 msgr2=0x7fa404148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:27.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.547+0000 7fa40ae93640 1 --2- 172.21.15.55:0/4112907514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa40415e3c0 0x7fa404148de0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4019020 tx=0x7fa3f40191b0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.551+0000 7fa40ae93640 1 -- 172.21.15.55:0/4112907514 shutdown_connections 2023-08-25T04:03:27.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.551+0000 7fa40ae93640 1 --2- 172.21.15.55:0/4112907514 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fa3f0065680 0x7fa3f0067b40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.551+0000 7fa40ae93640 1 --2- 172.21.15.55:0/4112907514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4041601f0 0x7fa4040b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.551+0000 7fa40ae93640 1 --2- 172.21.15.55:0/4112907514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa40415e3c0 0x7fa404148de0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.551+0000 7fa40ae93640 1 --2- 172.21.15.55:0/4112907514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4040d1290 0x7fa404154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.551+0000 7fa40ae93640 1 -- 172.21.15.55:0/4112907514 >> 172.21.15.55:0/4112907514 conn(0x7fa4040d27d0 msgr2=0x7fa40406bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:27.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.551+0000 7fa40ae93640 1 -- 172.21.15.55:0/4112907514 shutdown_connections 2023-08-25T04:03:27.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.551+0000 7fa40ae93640 1 -- 172.21.15.55:0/4112907514 wait complete. 2023-08-25T04:03:27.570 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:27.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.711+0000 7fb83d6d8640 1 Processor -- start 2023-08-25T04:03:27.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.711+0000 7fb83d6d8640 1 -- start start 2023-08-25T04:03:27.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.715+0000 7fb83d6d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8380b12c0 0x7fb83806c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:27.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.715+0000 7fb83d6d8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8380afe20 con 0x7fb8380d1120 2023-08-25T04:03:27.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.715+0000 7fb83d6d8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8380af210 con 0x7fb83815ca50 2023-08-25T04:03:27.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.715+0000 7fb83d6d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8380af4f0 con 0x7fb8380b12c0 2023-08-25T04:03:27.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.715+0000 7fb82ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb8380d1120 0x7fb83806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60932/0 (socket says 172.21.15.55:60932) 2023-08-25T04:03:27.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.715+0000 7fb82ffff640 1 -- 172.21.15.55:0/2693593759 learned_addr learned my addr 172.21.15.55:0/2693593759 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:27.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.715+0000 7fb83ced7640 1 --2- 172.21.15.55:0/2693593759 >> v2:172.21.15.55:3300/0 conn(0x7fb8380b12c0 0x7fb83806c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:27.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.715+0000 7fb83ced7640 1 -- 172.21.15.55:0/2693593759 >> v1:172.21.15.110:6789/0 conn(0x7fb83815ca50 legacy=0x7fb8380d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:27.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.715+0000 7fb83ced7640 1 -- 172.21.15.55:0/2693593759 >> v1:172.21.15.55:6789/0 conn(0x7fb8380d1120 legacy=0x7fb83806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:27.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.715+0000 7fb83ced7640 1 -- 172.21.15.55:0/2693593759 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8380af7d0 con 0x7fb8380b12c0 2023-08-25T04:03:27.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.715+0000 7fb8377fe640 1 -- 172.21.15.55:0/2693593759 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036461245 0 0) 0x7fb8380afe20 con 0x7fb8380d1120 2023-08-25T04:03:27.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.719+0000 7fb83ced7640 1 --2- 172.21.15.55:0/2693593759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8380b12c0 0x7fb83806c320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb830009d90 tx=0x7fb83001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7f8441f18c5eca server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:27.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.719+0000 7fb8377fe640 1 -- 172.21.15.55:0/2693593759 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8300a5a00 con 0x7fb8380b12c0 2023-08-25T04:03:27.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.719+0000 7fb8377fe640 1 -- 172.21.15.55:0/2693593759 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8300a5b60 con 0x7fb8380b12c0 2023-08-25T04:03:27.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.719+0000 7fb8377fe640 1 -- 172.21.15.55:0/2693593759 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8300ad440 con 0x7fb8380b12c0 2023-08-25T04:03:27.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.719+0000 7fb83d6d8640 1 -- 172.21.15.55:0/2693593759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8380b12c0 msgr2=0x7fb83806c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:27.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.719+0000 7fb83d6d8640 1 --2- 172.21.15.55:0/2693593759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8380b12c0 0x7fb83806c320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb830009d90 tx=0x7fb83001c920 comp rx=0 tx=0).stop 2023-08-25T04:03:27.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.719+0000 7fb83d6d8640 1 -- 172.21.15.55:0/2693593759 shutdown_connections 2023-08-25T04:03:27.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.719+0000 7fb83d6d8640 1 --2- 172.21.15.55:0/2693593759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8380b12c0 0x7fb83806c320 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.719+0000 7fb83d6d8640 1 -- 172.21.15.55:0/2693593759 >> 172.21.15.55:0/2693593759 conn(0x7fb838065f40 msgr2=0x7fb83809b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:27.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.719+0000 7fb83d6d8640 1 -- 172.21.15.55:0/2693593759 shutdown_connections 2023-08-25T04:03:27.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.719+0000 7fb83d6d8640 1 -- 172.21.15.55:0/2693593759 wait complete. 2023-08-25T04:03:27.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.719+0000 7fb83d6d8640 1 Processor -- start 2023-08-25T04:03:27.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.719+0000 7fb83d6d8640 1 -- start start 2023-08-25T04:03:27.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb83d6d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8380b12c0 0x7fb83815f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:27.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb83d6d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8380d1120 0x7fb8380b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:27.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb83d6d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb83815ca50 0x7fb8381503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:27.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb83d6d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8380b4f50 con 0x7fb8380b12c0 2023-08-25T04:03:27.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb83d6d8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83815ef90 con 0x7fb83815ca50 2023-08-25T04:03:27.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb83d6d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8380b3150 con 0x7fb8380d1120 2023-08-25T04:03:27.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb837fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8380b12c0 0x7fb83815f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:27.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb837fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8380b12c0 0x7fb83815f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47398/0 (socket says 172.21.15.55:47398) 2023-08-25T04:03:27.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb837fff640 1 -- 172.21.15.55:0/3860415079 learned_addr learned my addr 172.21.15.55:0/3860415079 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:27.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb83ced7640 1 --2- 172.21.15.55:0/3860415079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb83815ca50 0x7fb8381503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:27.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb82ffff640 1 --2- 172.21.15.55:0/3860415079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8380d1120 0x7fb8380b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:27.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb837fff640 1 -- 172.21.15.55:0/3860415079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8380d1120 msgr2=0x7fb8380b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:27.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb837fff640 1 --2- 172.21.15.55:0/3860415079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8380d1120 0x7fb8380b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb837fff640 1 -- 172.21.15.55:0/3860415079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb83815ca50 msgr2=0x7fb8381503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:27.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb837fff640 1 --2- 172.21.15.55:0/3860415079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb83815ca50 0x7fb8381503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb837fff640 1 -- 172.21.15.55:0/3860415079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb830009a70 con 0x7fb8380b12c0 2023-08-25T04:03:27.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb82ffff640 1 --2- 172.21.15.55:0/3860415079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8380d1120 0x7fb8380b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:27.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb837fff640 1 --2- 172.21.15.55:0/3860415079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8380b12c0 0x7fb83815f420 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb82800c400 tx=0x7fb82800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:27.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb8357fa640 1 -- 172.21.15.55:0/3860415079 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8280052d0 con 0x7fb8380b12c0 2023-08-25T04:03:27.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb8357fa640 1 -- 172.21.15.55:0/3860415079 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb828005430 con 0x7fb8380b12c0 2023-08-25T04:03:27.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb83d6d8640 1 -- 172.21.15.55:0/3860415079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8380b3430 con 0x7fb8380b12c0 2023-08-25T04:03:27.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb8357fa640 1 -- 172.21.15.55:0/3860415079 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb828003890 con 0x7fb8380b12c0 2023-08-25T04:03:27.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb83d6d8640 1 -- 172.21.15.55:0/3860415079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83815ec20 con 0x7fb8380b12c0 2023-08-25T04:03:27.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb83d6d8640 1 -- 172.21.15.55:0/3860415079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb838073e50 con 0x7fb8380b12c0 2023-08-25T04:03:27.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.723+0000 7fb8357fa640 1 -- 172.21.15.55:0/3860415079 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb8280039f0 con 0x7fb8380b12c0 2023-08-25T04:03:27.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.727+0000 7fb8357fa640 1 --2- 172.21.15.55:0/3860415079 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb8180656b0 0x7fb818067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:27.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.727+0000 7fb8357fa640 1 -- 172.21.15.55:0/3860415079 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb828082310 con 0x7fb8380b12c0 2023-08-25T04:03:27.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.727+0000 7fb82ffff640 1 --2- 172.21.15.55:0/3860415079 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb8180656b0 0x7fb818067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:27.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.727+0000 7fb82ffff640 1 --2- 172.21.15.55:0/3860415079 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb8180656b0 0x7fb818067b70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb83815e870 tx=0x7fb820007c60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:27.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.731+0000 7fb8357fa640 1 -- 172.21.15.55:0/3860415079 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb82804fe80 con 0x7fb8380b12c0 2023-08-25T04:03:27.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.887+0000 7fb83d6d8640 1 -- 172.21.15.55:0/3860415079 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8380c5e90 con 0x7fb8380b12c0 2023-08-25T04:03:27.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.891+0000 7fb8357fa640 1 -- 172.21.15.55:0/3860415079 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18291 (secure 0 0 0) 0x7fb8280534a0 con 0x7fb8380b12c0 2023-08-25T04:03:27.892 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:27.893 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:02.329010+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:27.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.891+0000 7fb83d6d8640 1 -- 172.21.15.55:0/3860415079 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb8180656b0 msgr2=0x7fb818067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:27.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.891+0000 7fb83d6d8640 1 --2- 172.21.15.55:0/3860415079 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb8180656b0 0x7fb818067b70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb83815e870 tx=0x7fb820007c60 comp rx=0 tx=0).stop 2023-08-25T04:03:27.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.891+0000 7fb83d6d8640 1 -- 172.21.15.55:0/3860415079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8380b12c0 msgr2=0x7fb83815f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:27.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.891+0000 7fb83d6d8640 1 --2- 172.21.15.55:0/3860415079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8380b12c0 0x7fb83815f420 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb82800c400 tx=0x7fb82800c8c0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.891+0000 7fb83d6d8640 1 -- 172.21.15.55:0/3860415079 shutdown_connections 2023-08-25T04:03:27.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.891+0000 7fb83d6d8640 1 --2- 172.21.15.55:0/3860415079 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb8180656b0 0x7fb818067b70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.891+0000 7fb83d6d8640 1 --2- 172.21.15.55:0/3860415079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb83815ca50 0x7fb8381503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.891+0000 7fb83d6d8640 1 --2- 172.21.15.55:0/3860415079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8380d1120 0x7fb8380b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.891+0000 7fb83d6d8640 1 --2- 172.21.15.55:0/3860415079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8380b12c0 0x7fb83815f420 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:27.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.891+0000 7fb83d6d8640 1 -- 172.21.15.55:0/3860415079 >> 172.21.15.55:0/3860415079 conn(0x7fb838065f40 msgr2=0x7fb83809b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:27.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.891+0000 7fb83d6d8640 1 -- 172.21.15.55:0/3860415079 shutdown_connections 2023-08-25T04:03:27.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:27.891+0000 7fb83d6d8640 1 -- 172.21.15.55:0/3860415079 wait complete. 2023-08-25T04:03:27.913 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:02:58.890533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:03:00.093976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:03:27.914 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:03:28.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.059+0000 7f9b1589c640 1 Processor -- start 2023-08-25T04:03:28.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.059+0000 7f9b1589c640 1 -- start start 2023-08-25T04:03:28.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.059+0000 7f9b1589c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9b101601f0 0x7f9b1015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:28.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.059+0000 7f9b1589c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b100cd5a0 con 0x7f9b1015e3c0 2023-08-25T04:03:28.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.059+0000 7f9b1589c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b100cd880 con 0x7f9b100d1290 2023-08-25T04:03:28.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.059+0000 7f9b1589c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b100cdb60 con 0x7f9b101601f0 2023-08-25T04:03:28.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.059+0000 7f9b0effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9b101601f0 0x7f9b1015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:28.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.059+0000 7f9b0e7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9b1015e3c0 0x7f9b100d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60946/0 (socket says 172.21.15.55:60946) 2023-08-25T04:03:28.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.059+0000 7f9b0e7fc640 1 -- 172.21.15.55:0/489195553 learned_addr learned my addr 172.21.15.55:0/489195553 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:28.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.059+0000 7f9b0effd640 1 -- 172.21.15.55:0/489195553 >> v1:172.21.15.110:6789/0 conn(0x7f9b100d1290 legacy=0x7f9b1015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.059+0000 7f9b0effd640 1 -- 172.21.15.55:0/489195553 >> v1:172.21.15.55:6789/0 conn(0x7f9b1015e3c0 legacy=0x7f9b100d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.059+0000 7f9b0effd640 1 -- 172.21.15.55:0/489195553 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b100cde40 con 0x7f9b101601f0 2023-08-25T04:03:28.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.059+0000 7f9b0dffb640 1 -- 172.21.15.55:0/489195553 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031205283 0 0) 0x7f9b100cd5a0 con 0x7f9b1015e3c0 2023-08-25T04:03:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.063+0000 7f9b0effd640 1 --2- 172.21.15.55:0/489195553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b101601f0 0x7f9b1015d430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9b000097a0 tx=0x7f9b0001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f215c6c99f085d33 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.063+0000 7f9b0dffb640 1 -- 172.21.15.55:0/489195553 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b00004230 con 0x7f9b101601f0 2023-08-25T04:03:28.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.063+0000 7f9b0dffb640 1 -- 172.21.15.55:0/489195553 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b000a7050 con 0x7f9b101601f0 2023-08-25T04:03:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.063+0000 7f9b0dffb640 1 -- 172.21.15.55:0/489195553 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b00003620 con 0x7f9b101601f0 2023-08-25T04:03:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.063+0000 7f9b1589c640 1 -- 172.21.15.55:0/489195553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b101601f0 msgr2=0x7f9b1015d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.063+0000 7f9b1589c640 1 --2- 172.21.15.55:0/489195553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b101601f0 0x7f9b1015d430 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9b000097a0 tx=0x7f9b0001c430 comp rx=0 tx=0).stop 2023-08-25T04:03:28.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.063+0000 7f9b1589c640 1 -- 172.21.15.55:0/489195553 shutdown_connections 2023-08-25T04:03:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.063+0000 7f9b1589c640 1 --2- 172.21.15.55:0/489195553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b101601f0 0x7f9b1015d430 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.063+0000 7f9b1589c640 1 -- 172.21.15.55:0/489195553 >> 172.21.15.55:0/489195553 conn(0x7f9b100d27d0 msgr2=0x7f9b100d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.063+0000 7f9b1589c640 1 -- 172.21.15.55:0/489195553 shutdown_connections 2023-08-25T04:03:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.063+0000 7f9b1589c640 1 -- 172.21.15.55:0/489195553 wait complete. 2023-08-25T04:03:28.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.063+0000 7f9b1589c640 1 Processor -- start 2023-08-25T04:03:28.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b1589c640 1 -- start start 2023-08-25T04:03:28.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b1589c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b100d1290 0x7f9b100c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:28.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b1589c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b1015e3c0 0x7f9b101f83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:28.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b1589c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b101601f0 0x7f9b101f8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:28.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b1589c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b100c91f0 con 0x7f9b101601f0 2023-08-25T04:03:28.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b1589c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b100c85e0 con 0x7f9b1015e3c0 2023-08-25T04:03:28.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b1589c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b100c88c0 con 0x7f9b100d1290 2023-08-25T04:03:28.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b0f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b101601f0 0x7f9b101f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:28.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b0f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b101601f0 0x7f9b101f8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47414/0 (socket says 172.21.15.55:47414) 2023-08-25T04:03:28.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b0f7fe640 1 -- 172.21.15.55:0/2521417444 learned_addr learned my addr 172.21.15.55:0/2521417444 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:28.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b0effd640 1 --2- 172.21.15.55:0/2521417444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b100d1290 0x7f9b100c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:28.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b0e7fc640 1 --2- 172.21.15.55:0/2521417444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b1015e3c0 0x7f9b101f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:28.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b0f7fe640 1 -- 172.21.15.55:0/2521417444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b100d1290 msgr2=0x7f9b100c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b0f7fe640 1 --2- 172.21.15.55:0/2521417444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b100d1290 0x7f9b100c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b0f7fe640 1 -- 172.21.15.55:0/2521417444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b1015e3c0 msgr2=0x7f9b101f83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b0f7fe640 1 --2- 172.21.15.55:0/2521417444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b1015e3c0 0x7f9b101f83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b0f7fe640 1 -- 172.21.15.55:0/2521417444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b000093b0 con 0x7f9b101601f0 2023-08-25T04:03:28.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b0f7fe640 1 --2- 172.21.15.55:0/2521417444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b101601f0 0x7f9b101f8910 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800c770 tx=0x7f9b0800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:28.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9af7fff640 1 -- 172.21.15.55:0/2521417444 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08003b80 con 0x7f9b101601f0 2023-08-25T04:03:28.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9af7fff640 1 -- 172.21.15.55:0/2521417444 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b08003ce0 con 0x7f9b101601f0 2023-08-25T04:03:28.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9af7fff640 1 -- 172.21.15.55:0/2521417444 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0800aa90 con 0x7f9b101601f0 2023-08-25T04:03:28.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b1589c640 1 -- 172.21.15.55:0/2521417444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b100c8ba0 con 0x7f9b101601f0 2023-08-25T04:03:28.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b1589c640 1 -- 172.21.15.55:0/2521417444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b10152a30 con 0x7f9b101601f0 2023-08-25T04:03:28.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.067+0000 7f9b1589c640 1 -- 172.21.15.55:0/2521417444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b100b5260 con 0x7f9b101601f0 2023-08-25T04:03:28.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.071+0000 7f9af7fff640 1 -- 172.21.15.55:0/2521417444 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9b0800abf0 con 0x7f9b101601f0 2023-08-25T04:03:28.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.071+0000 7f9af7fff640 1 --2- 172.21.15.55:0/2521417444 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9afc065680 0x7f9afc067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:28.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.071+0000 7f9af7fff640 1 -- 172.21.15.55:0/2521417444 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9b08082b90 con 0x7f9b101601f0 2023-08-25T04:03:28.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.071+0000 7f9b0effd640 1 --2- 172.21.15.55:0/2521417444 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9afc065680 0x7f9afc067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:28.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.071+0000 7f9b0effd640 1 --2- 172.21.15.55:0/2521417444 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9afc065680 0x7f9afc067b40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9b000ad000 tx=0x7f9b000a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:28.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.075+0000 7f9af7fff640 1 -- 172.21.15.55:0/2521417444 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9b08050660 con 0x7f9b101601f0 2023-08-25T04:03:28.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.227+0000 7f9b1589c640 1 -- 172.21.15.55:0/2521417444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b10073ec0 con 0x7f9b101601f0 2023-08-25T04:03:28.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.231+0000 7f9af7fff640 1 -- 172.21.15.55:0/2521417444 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b08053c80 con 0x7f9b101601f0 2023-08-25T04:03:28.231 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:03:28.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.231+0000 7f9b1589c640 1 -- 172.21.15.55:0/2521417444 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9afc065680 msgr2=0x7f9afc067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.231+0000 7f9b1589c640 1 --2- 172.21.15.55:0/2521417444 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9afc065680 0x7f9afc067b40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9b000ad000 tx=0x7f9b000a6000 comp rx=0 tx=0).stop 2023-08-25T04:03:28.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.231+0000 7f9b1589c640 1 -- 172.21.15.55:0/2521417444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b101601f0 msgr2=0x7f9b101f8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.231+0000 7f9b1589c640 1 --2- 172.21.15.55:0/2521417444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b101601f0 0x7f9b101f8910 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800c770 tx=0x7f9b0800cc30 comp rx=0 tx=0).stop 2023-08-25T04:03:28.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.231+0000 7f9b1589c640 1 -- 172.21.15.55:0/2521417444 shutdown_connections 2023-08-25T04:03:28.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.231+0000 7f9b1589c640 1 --2- 172.21.15.55:0/2521417444 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9afc065680 0x7f9afc067b40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.231+0000 7f9b1589c640 1 --2- 172.21.15.55:0/2521417444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b101601f0 0x7f9b101f8910 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.231+0000 7f9b1589c640 1 --2- 172.21.15.55:0/2521417444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b1015e3c0 0x7f9b101f83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.231+0000 7f9b1589c640 1 --2- 172.21.15.55:0/2521417444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b100d1290 0x7f9b100c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.231+0000 7f9b1589c640 1 -- 172.21.15.55:0/2521417444 >> 172.21.15.55:0/2521417444 conn(0x7f9b100d27d0 msgr2=0x7f9b100cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:28.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.231+0000 7f9b1589c640 1 -- 172.21.15.55:0/2521417444 shutdown_connections 2023-08-25T04:03:28.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.231+0000 7f9b1589c640 1 -- 172.21.15.55:0/2521417444 wait complete. 2023-08-25T04:03:28.252 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:03:28.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.395+0000 7fae60759640 1 Processor -- start 2023-08-25T04:03:28.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.395+0000 7fae60759640 1 -- start start 2023-08-25T04:03:28.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.395+0000 7fae60759640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fae580cb020 0x7fae580c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:28.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.395+0000 7fae60759640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae5806c720 0x7fae5806cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:28.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.395+0000 7fae60759640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae580cbca0 con 0x7fae580cdd50 2023-08-25T04:03:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.395+0000 7fae60759640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae580c9470 con 0x7fae5806c720 2023-08-25T04:03:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.395+0000 7fae60759640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae580ce1e0 con 0x7fae580cb020 2023-08-25T04:03:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.399+0000 7fae5ecf6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae5806c720 0x7fae5806cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.399+0000 7fae5ecf6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae5806c720 0x7fae5806cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47422/0 (socket says 172.21.15.55:47422) 2023-08-25T04:03:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.399+0000 7fae5ecf6640 1 -- 172.21.15.55:0/832803897 learned_addr learned my addr 172.21.15.55:0/832803897 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:28.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.399+0000 7fae5dcf4640 1 --1- 172.21.15.55:0/832803897 >> v1:172.21.15.55:6789/0 conn(0x7fae580cdd50 0x7fae580cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60948/0 (socket says 172.21.15.55:60948) 2023-08-25T04:03:28.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.399+0000 7fae5e4f5640 1 --2- 172.21.15.55:0/832803897 >> v2:172.21.15.110:3300/0 conn(0x7fae580cb020 0x7fae580c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:28.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.399+0000 7fae5ecf6640 1 -- 172.21.15.55:0/832803897 >> v2:172.21.15.110:3300/0 conn(0x7fae580cb020 msgr2=0x7fae580c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:28.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.399+0000 7fae5ecf6640 1 --2- 172.21.15.55:0/832803897 >> v2:172.21.15.110:3300/0 conn(0x7fae580cb020 0x7fae580c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.399+0000 7fae5ecf6640 1 -- 172.21.15.55:0/832803897 >> v1:172.21.15.55:6789/0 conn(0x7fae580cdd50 legacy=0x7fae580cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.399+0000 7fae5ecf6640 1 -- 172.21.15.55:0/832803897 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5806d040 con 0x7fae5806c720 2023-08-25T04:03:28.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.399+0000 7fae5d4f3640 1 -- 172.21.15.55:0/832803897 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155555645 0 0) 0x7fae580cbca0 con 0x7fae580cdd50 2023-08-25T04:03:28.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.399+0000 7fae5ecf6640 1 --2- 172.21.15.55:0/832803897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae5806c720 0x7fae5806cb00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fae5806daf0 tx=0x7fae5001eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533f5217f7515eed server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:28.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.399+0000 7fae5d4f3640 1 -- 172.21.15.55:0/832803897 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5000b2d0 con 0x7fae5806c720 2023-08-25T04:03:28.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.399+0000 7fae5d4f3640 1 -- 172.21.15.55:0/832803897 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5000b430 con 0x7fae5806c720 2023-08-25T04:03:28.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.399+0000 7fae5d4f3640 1 -- 172.21.15.55:0/832803897 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae500a7b20 con 0x7fae5806c720 2023-08-25T04:03:28.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae60759640 1 -- 172.21.15.55:0/832803897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae5806c720 msgr2=0x7fae5806cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae60759640 1 --2- 172.21.15.55:0/832803897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae5806c720 0x7fae5806cb00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fae5806daf0 tx=0x7fae5001eb40 comp rx=0 tx=0).stop 2023-08-25T04:03:28.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae60759640 1 -- 172.21.15.55:0/832803897 shutdown_connections 2023-08-25T04:03:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae60759640 1 --2- 172.21.15.55:0/832803897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae5806c720 0x7fae5806cb00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae60759640 1 --2- 172.21.15.55:0/832803897 >> v2:172.21.15.110:3300/0 conn(0x7fae580cb020 0x7fae580c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae60759640 1 -- 172.21.15.55:0/832803897 >> 172.21.15.55:0/832803897 conn(0x7fae58069900 msgr2=0x7fae58069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae60759640 1 -- 172.21.15.55:0/832803897 shutdown_connections 2023-08-25T04:03:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae60759640 1 -- 172.21.15.55:0/832803897 wait complete. 2023-08-25T04:03:28.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae60759640 1 Processor -- start 2023-08-25T04:03:28.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae60759640 1 -- start start 2023-08-25T04:03:28.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae60759640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae5806c720 0x7fae58155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:28.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae60759640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae580cb020 0x7fae58154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:28.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae60759640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae580cdd50 0x7fae580c1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:28.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae60759640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae580ae760 con 0x7fae580cdd50 2023-08-25T04:03:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae60759640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae58156170 con 0x7fae580cb020 2023-08-25T04:03:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae60759640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae58156450 con 0x7fae5806c720 2023-08-25T04:03:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae5ecf6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae580cdd50 0x7fae580c1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae5ecf6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae580cdd50 0x7fae580c1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47436/0 (socket says 172.21.15.55:47436) 2023-08-25T04:03:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae5ecf6640 1 -- 172.21.15.55:0/2924681703 learned_addr learned my addr 172.21.15.55:0/2924681703 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae5e4f5640 1 --2- 172.21.15.55:0/2924681703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae5806c720 0x7fae58155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae5dcf4640 1 --2- 172.21.15.55:0/2924681703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae580cb020 0x7fae58154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae5ecf6640 1 -- 172.21.15.55:0/2924681703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae5806c720 msgr2=0x7fae58155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae5ecf6640 1 --2- 172.21.15.55:0/2924681703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae5806c720 0x7fae58155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae5ecf6640 1 -- 172.21.15.55:0/2924681703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae580cb020 msgr2=0x7fae58154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae5ecf6640 1 --2- 172.21.15.55:0/2924681703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae580cb020 0x7fae58154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae5ecf6640 1 -- 172.21.15.55:0/2924681703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5000bd40 con 0x7fae580cdd50 2023-08-25T04:03:28.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.403+0000 7fae5dcf4640 1 --2- 172.21.15.55:0/2924681703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae580cb020 0x7fae58154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:28.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.407+0000 7fae5ecf6640 1 --2- 172.21.15.55:0/2924681703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae580cdd50 0x7fae580c1ef0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fae5001b750 tx=0x7fae5001b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:28.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.407+0000 7fae4effd640 1 -- 172.21.15.55:0/2924681703 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50009800 con 0x7fae580cdd50 2023-08-25T04:03:28.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.407+0000 7fae4effd640 1 -- 172.21.15.55:0/2924681703 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae50009960 con 0x7fae580cdd50 2023-08-25T04:03:28.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.407+0000 7fae4effd640 1 -- 172.21.15.55:0/2924681703 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50009d10 con 0x7fae580cdd50 2023-08-25T04:03:28.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.407+0000 7fae60759640 1 -- 172.21.15.55:0/2924681703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae58156730 con 0x7fae580cdd50 2023-08-25T04:03:28.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.407+0000 7fae60759640 1 -- 172.21.15.55:0/2924681703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae58155db0 con 0x7fae580cdd50 2023-08-25T04:03:28.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.407+0000 7fae60759640 1 -- 172.21.15.55:0/2924681703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae580ae5c0 con 0x7fae580cdd50 2023-08-25T04:03:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.407+0000 7fae4effd640 1 -- 172.21.15.55:0/2924681703 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fae500c3460 con 0x7fae580cdd50 2023-08-25T04:03:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.407+0000 7fae4effd640 1 --2- 172.21.15.55:0/2924681703 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fae3c065680 0x7fae3c067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.407+0000 7fae4effd640 1 -- 172.21.15.55:0/2924681703 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae5011e450 con 0x7fae580cdd50 2023-08-25T04:03:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.407+0000 7fae5e4f5640 1 --2- 172.21.15.55:0/2924681703 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fae3c065680 0x7fae3c067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.411+0000 7fae5e4f5640 1 --2- 172.21.15.55:0/2924681703 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fae3c065680 0x7fae3c067b40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fae54009b40 tx=0x7fae54006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:28.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.411+0000 7fae4effd640 1 -- 172.21.15.55:0/2924681703 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fae580ae5c0 con 0x7fae580cdd50 2023-08-25T04:03:28.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.571+0000 7fae60759640 1 -- 172.21.15.55:0/2924681703 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fae580ae5c0 con 0x7fae580cdd50 2023-08-25T04:03:28.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.571+0000 7fae4effd640 1 -- 172.21.15.55:0/2924681703 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fae580ae5c0 con 0x7fae580cdd50 2023-08-25T04:03:28.573 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:03:28.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.571+0000 7fae60759640 1 -- 172.21.15.55:0/2924681703 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fae3c065680 msgr2=0x7fae3c067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.571+0000 7fae60759640 1 --2- 172.21.15.55:0/2924681703 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fae3c065680 0x7fae3c067b40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fae54009b40 tx=0x7fae54006f90 comp rx=0 tx=0).stop 2023-08-25T04:03:28.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.571+0000 7fae60759640 1 -- 172.21.15.55:0/2924681703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae580cdd50 msgr2=0x7fae580c1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.571+0000 7fae60759640 1 --2- 172.21.15.55:0/2924681703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae580cdd50 0x7fae580c1ef0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fae5001b750 tx=0x7fae5001b8e0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.571+0000 7fae60759640 1 -- 172.21.15.55:0/2924681703 shutdown_connections 2023-08-25T04:03:28.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.571+0000 7fae60759640 1 --2- 172.21.15.55:0/2924681703 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fae3c065680 0x7fae3c067b40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.571+0000 7fae60759640 1 --2- 172.21.15.55:0/2924681703 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae580cdd50 0x7fae580c1ef0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.571+0000 7fae60759640 1 --2- 172.21.15.55:0/2924681703 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae580cb020 0x7fae58154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.571+0000 7fae60759640 1 --2- 172.21.15.55:0/2924681703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae5806c720 0x7fae58155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.571+0000 7fae60759640 1 -- 172.21.15.55:0/2924681703 >> 172.21.15.55:0/2924681703 conn(0x7fae58069900 msgr2=0x7fae580ac7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:28.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.571+0000 7fae60759640 1 -- 172.21.15.55:0/2924681703 shutdown_connections 2023-08-25T04:03:28.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.571+0000 7fae60759640 1 -- 172.21.15.55:0/2924681703 wait complete. 2023-08-25T04:03:28.593 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:03:28.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.739+0000 7fb09ca56640 1 Processor -- start 2023-08-25T04:03:28.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.739+0000 7fb09ca56640 1 -- start start 2023-08-25T04:03:28.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.739+0000 7fb09ca56640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb0980c9900 0x7fb0980cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:28.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.739+0000 7fb09ca56640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb09806c720 0x7fb09806cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:28.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.739+0000 7fb09ca56640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0980c9d90 con 0x7fb0980cb020 2023-08-25T04:03:28.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.739+0000 7fb09ca56640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0980cbca0 con 0x7fb09806c720 2023-08-25T04:03:28.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.739+0000 7fb09ca56640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0980c9470 con 0x7fb0980c9900 2023-08-25T04:03:28.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.739+0000 7fb096d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb09806c720 0x7fb09806cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:28.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.739+0000 7fb09659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb0980cb020 0x7fb0980cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60962/0 (socket says 172.21.15.55:60962) 2023-08-25T04:03:28.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.739+0000 7fb09659c640 1 -- 172.21.15.55:0/2648258428 learned_addr learned my addr 172.21.15.55:0/2648258428 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:28.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.739+0000 7fb08ffff640 1 --2- 172.21.15.55:0/2648258428 >> v2:172.21.15.110:3300/0 conn(0x7fb0980c9900 0x7fb0980cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:28.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.739+0000 7fb095d9b640 1 -- 172.21.15.55:0/2648258428 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697951546 0 0) 0x7fb0980c9d90 con 0x7fb0980cb020 2023-08-25T04:03:28.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.739+0000 7fb095d9b640 1 -- 172.21.15.55:0/2648258428 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb084003530 con 0x7fb0980cb020 2023-08-25T04:03:28.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.739+0000 7fb096d9d640 1 -- 172.21.15.55:0/2648258428 >> v2:172.21.15.110:3300/0 conn(0x7fb0980c9900 msgr2=0x7fb0980cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:28.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.739+0000 7fb096d9d640 1 --2- 172.21.15.55:0/2648258428 >> v2:172.21.15.110:3300/0 conn(0x7fb0980c9900 0x7fb0980cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.739+0000 7fb096d9d640 1 -- 172.21.15.55:0/2648258428 >> v1:172.21.15.55:6789/0 conn(0x7fb0980cb020 legacy=0x7fb0980cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.739+0000 7fb096d9d640 1 -- 172.21.15.55:0/2648258428 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09806d040 con 0x7fb09806c720 2023-08-25T04:03:28.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.743+0000 7fb096d9d640 1 --2- 172.21.15.55:0/2648258428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09806c720 0x7fb09806cb00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb098071fe0 tx=0x7fb09001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdabec15cda836f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:28.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.743+0000 7fb095d9b640 1 -- 172.21.15.55:0/2648258428 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0900a5740 con 0x7fb09806c720 2023-08-25T04:03:28.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.743+0000 7fb095d9b640 1 -- 172.21.15.55:0/2648258428 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0900a58a0 con 0x7fb09806c720 2023-08-25T04:03:28.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.743+0000 7fb095d9b640 1 -- 172.21.15.55:0/2648258428 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0900a5c30 con 0x7fb09806c720 2023-08-25T04:03:28.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.743+0000 7fb09ca56640 1 -- 172.21.15.55:0/2648258428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09806c720 msgr2=0x7fb09806cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.743+0000 7fb09ca56640 1 --2- 172.21.15.55:0/2648258428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09806c720 0x7fb09806cb00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb098071fe0 tx=0x7fb09001c880 comp rx=0 tx=0).stop 2023-08-25T04:03:28.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.743+0000 7fb09ca56640 1 -- 172.21.15.55:0/2648258428 shutdown_connections 2023-08-25T04:03:28.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.743+0000 7fb09ca56640 1 --2- 172.21.15.55:0/2648258428 >> v2:172.21.15.110:3300/0 conn(0x7fb0980c9900 0x7fb0980cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.743+0000 7fb09ca56640 1 --2- 172.21.15.55:0/2648258428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09806c720 0x7fb09806cb00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.743+0000 7fb09ca56640 1 -- 172.21.15.55:0/2648258428 >> 172.21.15.55:0/2648258428 conn(0x7fb098069900 msgr2=0x7fb098069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:28.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.743+0000 7fb09ca56640 1 -- 172.21.15.55:0/2648258428 shutdown_connections 2023-08-25T04:03:28.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.743+0000 7fb09ca56640 1 -- 172.21.15.55:0/2648258428 wait complete. 2023-08-25T04:03:28.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09ca56640 1 Processor -- start 2023-08-25T04:03:28.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09ca56640 1 -- start start 2023-08-25T04:03:28.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09ca56640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09806c720 0x7fb0980b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:28.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09ca56640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0980c9900 0x7fb098144a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:28.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09ca56640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0980cb020 0x7fb0980ac410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:28.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09ca56640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0980b1b10 con 0x7fb09806c720 2023-08-25T04:03:28.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09ca56640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0980b2970 con 0x7fb0980cb020 2023-08-25T04:03:28.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09ca56640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb098099d70 con 0x7fb0980c9900 2023-08-25T04:03:28.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09806c720 0x7fb0980b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:28.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09806c720 0x7fb0980b2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47464/0 (socket says 172.21.15.55:47464) 2023-08-25T04:03:28.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09659c640 1 -- 172.21.15.55:0/668687058 learned_addr learned my addr 172.21.15.55:0/668687058 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:28.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09659c640 1 -- 172.21.15.55:0/668687058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0980c9900 msgr2=0x7fb098144a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09659c640 1 --2- 172.21.15.55:0/668687058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0980c9900 0x7fb098144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb096d9d640 1 --2- 172.21.15.55:0/668687058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0980cb020 0x7fb0980ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:28.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09659c640 1 -- 172.21.15.55:0/668687058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0980cb020 msgr2=0x7fb0980ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09659c640 1 --2- 172.21.15.55:0/668687058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0980cb020 0x7fb0980ac410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09659c640 1 -- 172.21.15.55:0/668687058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb090009a70 con 0x7fb09806c720 2023-08-25T04:03:28.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb096d9d640 1 --2- 172.21.15.55:0/668687058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0980cb020 0x7fb0980ac410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:28.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09659c640 1 --2- 172.21.15.55:0/668687058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09806c720 0x7fb0980b2e00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb08800c450 tx=0x7fb08800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:28.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb08effd640 1 -- 172.21.15.55:0/668687058 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb088007480 con 0x7fb09806c720 2023-08-25T04:03:28.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb08effd640 1 -- 172.21.15.55:0/668687058 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0880075e0 con 0x7fb09806c720 2023-08-25T04:03:28.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09ca56640 1 -- 172.21.15.55:0/668687058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0980b1d60 con 0x7fb09806c720 2023-08-25T04:03:28.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb08effd640 1 -- 172.21.15.55:0/668687058 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0880059d0 con 0x7fb09806c720 2023-08-25T04:03:28.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09ca56640 1 -- 172.21.15.55:0/668687058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0980b2320 con 0x7fb09806c720 2023-08-25T04:03:28.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.747+0000 7fb09ca56640 1 -- 172.21.15.55:0/668687058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb098073ec0 con 0x7fb09806c720 2023-08-25T04:03:28.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.751+0000 7fb08effd640 1 -- 172.21.15.55:0/668687058 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb088005b30 con 0x7fb09806c720 2023-08-25T04:03:28.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.751+0000 7fb08effd640 1 --2- 172.21.15.55:0/668687058 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb078065680 0x7fb078067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:28.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.751+0000 7fb08effd640 1 -- 172.21.15.55:0/668687058 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb088082430 con 0x7fb09806c720 2023-08-25T04:03:28.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.751+0000 7fb08ffff640 1 --2- 172.21.15.55:0/668687058 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb078065680 0x7fb078067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:28.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.751+0000 7fb08ffff640 1 --2- 172.21.15.55:0/668687058 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb078065680 0x7fb078067b40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb080006aa0 tx=0x7fb080006a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:28.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.755+0000 7fb08effd640 1 -- 172.21.15.55:0/668687058 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb0880538e0 con 0x7fb09806c720 2023-08-25T04:03:28.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.911+0000 7fb09ca56640 1 -- 172.21.15.55:0/668687058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb0980cc230 con 0x7fb09806c720 2023-08-25T04:03:28.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.911+0000 7fb08effd640 1 -- 172.21.15.55:0/668687058 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb088007de0 con 0x7fb09806c720 2023-08-25T04:03:28.913 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:03:28.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.911+0000 7fb09ca56640 1 -- 172.21.15.55:0/668687058 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb078065680 msgr2=0x7fb078067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.911+0000 7fb09ca56640 1 --2- 172.21.15.55:0/668687058 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb078065680 0x7fb078067b40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb080006aa0 tx=0x7fb080006a30 comp rx=0 tx=0).stop 2023-08-25T04:03:28.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.911+0000 7fb09ca56640 1 -- 172.21.15.55:0/668687058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09806c720 msgr2=0x7fb0980b2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:28.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.911+0000 7fb09ca56640 1 --2- 172.21.15.55:0/668687058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09806c720 0x7fb0980b2e00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb08800c450 tx=0x7fb08800c910 comp rx=0 tx=0).stop 2023-08-25T04:03:28.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.911+0000 7fb09ca56640 1 -- 172.21.15.55:0/668687058 shutdown_connections 2023-08-25T04:03:28.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.911+0000 7fb09ca56640 1 --2- 172.21.15.55:0/668687058 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb078065680 0x7fb078067b40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.911+0000 7fb09ca56640 1 --2- 172.21.15.55:0/668687058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0980cb020 0x7fb0980ac410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.911+0000 7fb09ca56640 1 --2- 172.21.15.55:0/668687058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0980c9900 0x7fb098144a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.911+0000 7fb09ca56640 1 --2- 172.21.15.55:0/668687058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb09806c720 0x7fb0980b2e00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:28.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.911+0000 7fb09ca56640 1 -- 172.21.15.55:0/668687058 >> 172.21.15.55:0/668687058 conn(0x7fb098069900 msgr2=0x7fb0980c9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:28.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.911+0000 7fb09ca56640 1 -- 172.21.15.55:0/668687058 shutdown_connections 2023-08-25T04:03:28.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:28.911+0000 7fb09ca56640 1 -- 172.21.15.55:0/668687058 wait complete. 2023-08-25T04:03:28.933 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:03:29.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.075+0000 7f9468ed8640 1 Processor -- start 2023-08-25T04:03:29.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.079+0000 7f9468ed8640 1 -- start start 2023-08-25T04:03:29.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.079+0000 7f9468ed8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f94640ad6b0 0x7f94640b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:29.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.079+0000 7f9468ed8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94640cdf20 con 0x7f946406d0d0 2023-08-25T04:03:29.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.079+0000 7f9468ed8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946409bc40 con 0x7f94640cb710 2023-08-25T04:03:29.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.079+0000 7f9468ed8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946409bf20 con 0x7f94640ad6b0 2023-08-25T04:03:29.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.079+0000 7f946259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f94640ad6b0 0x7f94640b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:29.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.079+0000 7f946259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f94640ad6b0 0x7f94640b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47474/0 (socket says 172.21.15.55:47474) 2023-08-25T04:03:29.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.079+0000 7f946259c640 1 -- 172.21.15.55:0/2305675612 learned_addr learned my addr 172.21.15.55:0/2305675612 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:29.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.079+0000 7f9462d9d640 1 --1- 172.21.15.55:0/2305675612 >> v1:172.21.15.55:6789/0 conn(0x7f946406d0d0 0x7f94640c8a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60978/0 (socket says 172.21.15.55:60978) 2023-08-25T04:03:29.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.079+0000 7f946259c640 1 -- 172.21.15.55:0/2305675612 >> v1:172.21.15.110:6789/0 conn(0x7f94640cb710 legacy=0x7f946406c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.079+0000 7f946259c640 1 -- 172.21.15.55:0/2305675612 >> v1:172.21.15.55:6789/0 conn(0x7f946406d0d0 legacy=0x7f94640c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.079+0000 7f946259c640 1 -- 172.21.15.55:0/2305675612 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946406c1c0 con 0x7f94640ad6b0 2023-08-25T04:03:29.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.083+0000 7f946259c640 1 --2- 172.21.15.55:0/2305675612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94640ad6b0 0x7f94640b1210 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9454006fd0 tx=0x7f945401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcce02bb3f11a01 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:29.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.083+0000 7f9461d9b640 1 -- 172.21.15.55:0/2305675612 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540a7070 con 0x7f94640ad6b0 2023-08-25T04:03:29.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.083+0000 7f9461d9b640 1 -- 172.21.15.55:0/2305675612 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94540ab430 con 0x7f94640ad6b0 2023-08-25T04:03:29.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.083+0000 7f9461d9b640 1 -- 172.21.15.55:0/2305675612 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540ab7c0 con 0x7f94640ad6b0 2023-08-25T04:03:29.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.083+0000 7f9468ed8640 1 -- 172.21.15.55:0/2305675612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94640ad6b0 msgr2=0x7f94640b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.083+0000 7f9468ed8640 1 --2- 172.21.15.55:0/2305675612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94640ad6b0 0x7f94640b1210 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9454006fd0 tx=0x7f945401c520 comp rx=0 tx=0).stop 2023-08-25T04:03:29.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.083+0000 7f9468ed8640 1 -- 172.21.15.55:0/2305675612 shutdown_connections 2023-08-25T04:03:29.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.083+0000 7f9468ed8640 1 --2- 172.21.15.55:0/2305675612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94640ad6b0 0x7f94640b1210 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.083+0000 7f9468ed8640 1 -- 172.21.15.55:0/2305675612 >> 172.21.15.55:0/2305675612 conn(0x7f9464069900 msgr2=0x7f9464069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:29.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.083+0000 7f9468ed8640 1 -- 172.21.15.55:0/2305675612 shutdown_connections 2023-08-25T04:03:29.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.083+0000 7f9468ed8640 1 -- 172.21.15.55:0/2305675612 wait complete. 2023-08-25T04:03:29.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.083+0000 7f9468ed8640 1 Processor -- start 2023-08-25T04:03:29.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.083+0000 7f9468ed8640 1 -- start start 2023-08-25T04:03:29.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9468ed8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94640ad6b0 0x7f9464155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:29.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9468ed8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94640cb710 0x7f94640afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:29.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9468ed8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94640affd0 0x7f9464070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:29.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9468ed8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9464160d20 con 0x7f94640cb710 2023-08-25T04:03:29.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9468ed8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9464161000 con 0x7f94640affd0 2023-08-25T04:03:29.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9468ed8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94641612e0 con 0x7f94640ad6b0 2023-08-25T04:03:29.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9459d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94640cb710 0x7f94640afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:29.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9459d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94640cb710 0x7f94640afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47476/0 (socket says 172.21.15.55:47476) 2023-08-25T04:03:29.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9459d9b640 1 -- 172.21.15.55:0/2515304178 learned_addr learned my addr 172.21.15.55:0/2515304178 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:29.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f946259c640 1 --2- 172.21.15.55:0/2515304178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94640ad6b0 0x7f9464155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:29.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9462d9d640 1 --2- 172.21.15.55:0/2515304178 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94640affd0 0x7f9464070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:29.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9459d9b640 1 -- 172.21.15.55:0/2515304178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94640ad6b0 msgr2=0x7f9464155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9459d9b640 1 --2- 172.21.15.55:0/2515304178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94640ad6b0 0x7f9464155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9459d9b640 1 -- 172.21.15.55:0/2515304178 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94640affd0 msgr2=0x7f9464070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9459d9b640 1 --2- 172.21.15.55:0/2515304178 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94640affd0 0x7f9464070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9459d9b640 1 -- 172.21.15.55:0/2515304178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9454009480 con 0x7f94640cb710 2023-08-25T04:03:29.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9462d9d640 1 --2- 172.21.15.55:0/2515304178 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94640affd0 0x7f9464070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:29.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9459d9b640 1 --2- 172.21.15.55:0/2515304178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94640cb710 0x7f94640afa90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f944c00c7a0 tx=0x7f944c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:29.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f945b7fe640 1 -- 172.21.15.55:0/2515304178 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c003b80 con 0x7f94640cb710 2023-08-25T04:03:29.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f945b7fe640 1 -- 172.21.15.55:0/2515304178 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944c003ce0 con 0x7f94640cb710 2023-08-25T04:03:29.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f945b7fe640 1 -- 172.21.15.55:0/2515304178 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c00aa90 con 0x7f94640cb710 2023-08-25T04:03:29.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9468ed8640 1 -- 172.21.15.55:0/2515304178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94641615c0 con 0x7f94640cb710 2023-08-25T04:03:29.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9468ed8640 1 -- 172.21.15.55:0/2515304178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9464161b80 con 0x7f94640cb710 2023-08-25T04:03:29.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.087+0000 7f9468ed8640 1 -- 172.21.15.55:0/2515304178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9464073ec0 con 0x7f94640cb710 2023-08-25T04:03:29.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.091+0000 7f945b7fe640 1 -- 172.21.15.55:0/2515304178 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f944c00abf0 con 0x7f94640cb710 2023-08-25T04:03:29.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.091+0000 7f945b7fe640 1 --2- 172.21.15.55:0/2515304178 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9444065680 0x7f9444067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:29.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.091+0000 7f945b7fe640 1 -- 172.21.15.55:0/2515304178 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f944c082bb0 con 0x7f94640cb710 2023-08-25T04:03:29.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.091+0000 7f946259c640 1 --2- 172.21.15.55:0/2515304178 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9444065680 0x7f9444067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:29.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.091+0000 7f946259c640 1 --2- 172.21.15.55:0/2515304178 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9444065680 0x7f9444067b40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f94540af000 tx=0x7f94540a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:29.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.095+0000 7f945b7fe640 1 -- 172.21.15.55:0/2515304178 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f944c050660 con 0x7f94640cb710 2023-08-25T04:03:29.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.247+0000 7f9468ed8640 1 -- 172.21.15.55:0/2515304178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94640b2d50 con 0x7f94640cb710 2023-08-25T04:03:29.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.247+0000 7f945b7fe640 1 -- 172.21.15.55:0/2515304178 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f944c053c80 con 0x7f94640cb710 2023-08-25T04:03:29.251 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:03:29.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.251+0000 7f9468ed8640 1 -- 172.21.15.55:0/2515304178 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9444065680 msgr2=0x7f9444067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.251+0000 7f9468ed8640 1 --2- 172.21.15.55:0/2515304178 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9444065680 0x7f9444067b40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f94540af000 tx=0x7f94540a7000 comp rx=0 tx=0).stop 2023-08-25T04:03:29.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.251+0000 7f9468ed8640 1 -- 172.21.15.55:0/2515304178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94640cb710 msgr2=0x7f94640afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.251+0000 7f9468ed8640 1 --2- 172.21.15.55:0/2515304178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94640cb710 0x7f94640afa90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f944c00c7a0 tx=0x7f944c00cc60 comp rx=0 tx=0).stop 2023-08-25T04:03:29.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.251+0000 7f9468ed8640 1 -- 172.21.15.55:0/2515304178 shutdown_connections 2023-08-25T04:03:29.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.251+0000 7f9468ed8640 1 --2- 172.21.15.55:0/2515304178 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9444065680 0x7f9444067b40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.251+0000 7f9468ed8640 1 --2- 172.21.15.55:0/2515304178 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94640affd0 0x7f9464070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.251+0000 7f9468ed8640 1 --2- 172.21.15.55:0/2515304178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94640cb710 0x7f94640afa90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.251+0000 7f9468ed8640 1 --2- 172.21.15.55:0/2515304178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94640ad6b0 0x7f9464155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.251+0000 7f9468ed8640 1 -- 172.21.15.55:0/2515304178 >> 172.21.15.55:0/2515304178 conn(0x7f9464069900 msgr2=0x7f94640acb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:29.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.251+0000 7f9468ed8640 1 -- 172.21.15.55:0/2515304178 shutdown_connections 2023-08-25T04:03:29.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.251+0000 7f9468ed8640 1 -- 172.21.15.55:0/2515304178 wait complete. 2023-08-25T04:03:29.272 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:29.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.415+0000 7f6368c19640 1 Processor -- start 2023-08-25T04:03:29.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.415+0000 7f6368c19640 1 -- start start 2023-08-25T04:03:29.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.415+0000 7f6368c19640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f63640d0da0 0x7f63640d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:29.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.415+0000 7f6368c19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63640b3e50 0x7f63640ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:29.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.415+0000 7f6368c19640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63640b29b0 con 0x7f63640cdde0 2023-08-25T04:03:29.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.415+0000 7f6368c19640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63640ce760 con 0x7f63640d0da0 2023-08-25T04:03:29.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.415+0000 7f6368c19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63640d16c0 con 0x7f63640b3e50 2023-08-25T04:03:29.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.415+0000 7f636259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f63640d0da0 0x7f63640d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:29.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.415+0000 7f636259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f63640d0da0 0x7f63640d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47490/0 (socket says 172.21.15.55:47490) 2023-08-25T04:03:29.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.415+0000 7f636259c640 1 -- 172.21.15.55:0/1890468693 learned_addr learned my addr 172.21.15.55:0/1890468693 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:29.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.415+0000 7f6362d9d640 1 --2- 172.21.15.55:0/1890468693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63640b3e50 0x7f63640ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:29.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.415+0000 7f636259c640 1 -- 172.21.15.55:0/1890468693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63640b3e50 msgr2=0x7f63640ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:29.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.415+0000 7f636259c640 1 --2- 172.21.15.55:0/1890468693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63640b3e50 0x7f63640ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.415+0000 7f636259c640 1 -- 172.21.15.55:0/1890468693 >> v1:172.21.15.110:6789/0 conn(0x7f63640cdde0 legacy=0x7f63640cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.415+0000 7f636259c640 1 -- 172.21.15.55:0/1890468693 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63640b1dc0 con 0x7f63640d0da0 2023-08-25T04:03:29.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.419+0000 7f636259c640 1 --2- 172.21.15.55:0/1890468693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63640d0da0 0x7f63640d1180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6354009860 tx=0x7f635401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1027c5f505cbea0b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:29.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.419+0000 7f636159a640 1 -- 172.21.15.55:0/1890468693 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63540a8a10 con 0x7f63640d0da0 2023-08-25T04:03:29.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.419+0000 7f636159a640 1 -- 172.21.15.55:0/1890468693 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63540a8b70 con 0x7f63640d0da0 2023-08-25T04:03:29.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.419+0000 7f636159a640 1 -- 172.21.15.55:0/1890468693 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63540b0440 con 0x7f63640d0da0 2023-08-25T04:03:29.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.419+0000 7f6368c19640 1 -- 172.21.15.55:0/1890468693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63640d0da0 msgr2=0x7f63640d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.419+0000 7f6368c19640 1 --2- 172.21.15.55:0/1890468693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63640d0da0 0x7f63640d1180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6354009860 tx=0x7f635401ed10 comp rx=0 tx=0).stop 2023-08-25T04:03:29.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.419+0000 7f6368c19640 1 -- 172.21.15.55:0/1890468693 shutdown_connections 2023-08-25T04:03:29.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.419+0000 7f6368c19640 1 --2- 172.21.15.55:0/1890468693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63640b3e50 0x7f63640ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.419+0000 7f6368c19640 1 --2- 172.21.15.55:0/1890468693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63640d0da0 0x7f63640d1180 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.419+0000 7f6368c19640 1 -- 172.21.15.55:0/1890468693 >> 172.21.15.55:0/1890468693 conn(0x7f636409bae0 msgr2=0x7f63640d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:29.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.419+0000 7f6368c19640 1 -- 172.21.15.55:0/1890468693 shutdown_connections 2023-08-25T04:03:29.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.419+0000 7f6368c19640 1 -- 172.21.15.55:0/1890468693 wait complete. 2023-08-25T04:03:29.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f6368c19640 1 Processor -- start 2023-08-25T04:03:29.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f6368c19640 1 -- start start 2023-08-25T04:03:29.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f6368c19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63640b3e50 0x7f63640cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:29.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f6368c19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63640cdde0 0x7f636415eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:29.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f6368c19640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63640d0da0 0x7f636415f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:29.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f6368c19640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63640c89b0 con 0x7f63640b3e50 2023-08-25T04:03:29.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f6368c19640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636415fd10 con 0x7f63640d0da0 2023-08-25T04:03:29.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f6368c19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6364152500 con 0x7f63640cdde0 2023-08-25T04:03:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f636259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63640b3e50 0x7f63640cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f636259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63640b3e50 0x7f63640cc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47498/0 (socket says 172.21.15.55:47498) 2023-08-25T04:03:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f636259c640 1 -- 172.21.15.55:0/1255528681 learned_addr learned my addr 172.21.15.55:0/1255528681 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f6362d9d640 1 --2- 172.21.15.55:0/1255528681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63640d0da0 0x7f636415f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f6361d9b640 1 --2- 172.21.15.55:0/1255528681 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63640cdde0 0x7f636415eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:29.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f636259c640 1 -- 172.21.15.55:0/1255528681 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63640cdde0 msgr2=0x7f636415eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f636259c640 1 --2- 172.21.15.55:0/1255528681 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63640cdde0 0x7f636415eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f636259c640 1 -- 172.21.15.55:0/1255528681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63640d0da0 msgr2=0x7f636415f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f636259c640 1 --2- 172.21.15.55:0/1255528681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63640d0da0 0x7f636415f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f636259c640 1 -- 172.21.15.55:0/1255528681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6354009470 con 0x7f63640b3e50 2023-08-25T04:03:29.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f636259c640 1 --2- 172.21.15.55:0/1255528681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63640b3e50 0x7f63640cc180 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f63540b3040 tx=0x7f635401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f6352ffd640 1 -- 172.21.15.55:0/1255528681 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63540a8a10 con 0x7f63640b3e50 2023-08-25T04:03:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f6352ffd640 1 -- 172.21.15.55:0/1255528681 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63540bb480 con 0x7f63640b3e50 2023-08-25T04:03:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f6352ffd640 1 -- 172.21.15.55:0/1255528681 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63540bb830 con 0x7f63640b3e50 2023-08-25T04:03:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f6368c19640 1 -- 172.21.15.55:0/1255528681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63640cc6c0 con 0x7f63640b3e50 2023-08-25T04:03:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f6368c19640 1 -- 172.21.15.55:0/1255528681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63640c86d0 con 0x7f63640b3e50 2023-08-25T04:03:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.423+0000 7f6368c19640 1 -- 172.21.15.55:0/1255528681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636404dbe0 con 0x7f63640b3e50 2023-08-25T04:03:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.427+0000 7f6352ffd640 1 -- 172.21.15.55:0/1255528681 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f63540bb990 con 0x7f63640b3e50 2023-08-25T04:03:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.427+0000 7f6352ffd640 1 --2- 172.21.15.55:0/1255528681 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6344065680 0x7f6344067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.427+0000 7f6352ffd640 1 -- 172.21.15.55:0/1255528681 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6354121450 con 0x7f63640b3e50 2023-08-25T04:03:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.427+0000 7f6361d9b640 1 --2- 172.21.15.55:0/1255528681 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6344065680 0x7f6344067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:29.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.427+0000 7f6361d9b640 1 --2- 172.21.15.55:0/1255528681 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6344065680 0x7f6344067b40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6364155e10 tx=0x7f6358009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:29.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.431+0000 7f6352ffd640 1 -- 172.21.15.55:0/1255528681 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f63540eee70 con 0x7f63640b3e50 2023-08-25T04:03:29.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.587+0000 7f6368c19640 1 -- 172.21.15.55:0/1255528681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63640b19b0 con 0x7f63640b3e50 2023-08-25T04:03:29.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.591+0000 7f6352ffd640 1 -- 172.21.15.55:0/1255528681 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18291 (secure 0 0 0) 0x7f63540f2490 con 0x7f63640b3e50 2023-08-25T04:03:29.592 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:29.592 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:02.329010+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:29.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.591+0000 7f6368c19640 1 -- 172.21.15.55:0/1255528681 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6344065680 msgr2=0x7f6344067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.591+0000 7f6368c19640 1 --2- 172.21.15.55:0/1255528681 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6344065680 0x7f6344067b40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6364155e10 tx=0x7f6358009040 comp rx=0 tx=0).stop 2023-08-25T04:03:29.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.591+0000 7f6368c19640 1 -- 172.21.15.55:0/1255528681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63640b3e50 msgr2=0x7f63640cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.591+0000 7f6368c19640 1 --2- 172.21.15.55:0/1255528681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63640b3e50 0x7f63640cc180 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f63540b3040 tx=0x7f635401bab0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.591+0000 7f6368c19640 1 -- 172.21.15.55:0/1255528681 shutdown_connections 2023-08-25T04:03:29.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.591+0000 7f6368c19640 1 --2- 172.21.15.55:0/1255528681 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6344065680 0x7f6344067b40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.591+0000 7f6368c19640 1 --2- 172.21.15.55:0/1255528681 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63640d0da0 0x7f636415f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.591+0000 7f6368c19640 1 --2- 172.21.15.55:0/1255528681 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63640cdde0 0x7f636415eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.591+0000 7f6368c19640 1 --2- 172.21.15.55:0/1255528681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63640b3e50 0x7f63640cc180 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.591+0000 7f6368c19640 1 -- 172.21.15.55:0/1255528681 >> 172.21.15.55:0/1255528681 conn(0x7f636409bae0 msgr2=0x7f63640d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:29.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.591+0000 7f6368c19640 1 -- 172.21.15.55:0/1255528681 shutdown_connections 2023-08-25T04:03:29.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.591+0000 7f6368c19640 1 -- 172.21.15.55:0/1255528681 wait complete. 2023-08-25T04:03:29.613 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:02:58.890533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:03:00.093976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:03:29.614 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:03:29.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.759+0000 7fe50ef37640 1 Processor -- start 2023-08-25T04:03:29.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.759+0000 7fe50ef37640 1 -- start start 2023-08-25T04:03:29.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.759+0000 7fe50ef37640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe5081601f0 0x7fe50815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:29.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.759+0000 7fe50ef37640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe5080d1290 0x7fe50815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:29.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.759+0000 7fe50ef37640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5080cd5a0 con 0x7fe50815e3c0 2023-08-25T04:03:29.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.759+0000 7fe50ef37640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5080cd880 con 0x7fe5081601f0 2023-08-25T04:03:29.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.759+0000 7fe50ef37640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5080cdb60 con 0x7fe5080d1290 2023-08-25T04:03:29.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.759+0000 7fe50ccd3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe5081601f0 0x7fe50815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:29.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.759+0000 7fe4fffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe50815e3c0 0x7fe5080d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60982/0 (socket says 172.21.15.55:60982) 2023-08-25T04:03:29.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.759+0000 7fe4fffff640 1 -- 172.21.15.55:0/2774360648 learned_addr learned my addr 172.21.15.55:0/2774360648 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:29.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.759+0000 7fe50ccd3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe5081601f0 0x7fe50815d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47514/0 (socket says 172.21.15.55:47514) 2023-08-25T04:03:29.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.759+0000 7fe50ccd3640 1 -- 172.21.15.55:0/2774360648 >> v2:172.21.15.110:3300/0 conn(0x7fe5080d1290 msgr2=0x7fe50815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:29.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.759+0000 7fe50d4d4640 1 --2- 172.21.15.55:0/2774360648 >> v2:172.21.15.110:3300/0 conn(0x7fe5080d1290 0x7fe50815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:29.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.759+0000 7fe50ccd3640 1 --2- 172.21.15.55:0/2774360648 >> v2:172.21.15.110:3300/0 conn(0x7fe5080d1290 0x7fe50815e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.759+0000 7fe50ccd3640 1 -- 172.21.15.55:0/2774360648 >> v1:172.21.15.55:6789/0 conn(0x7fe50815e3c0 legacy=0x7fe5080d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.759+0000 7fe50ccd3640 1 -- 172.21.15.55:0/2774360648 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5080cde40 con 0x7fe5081601f0 2023-08-25T04:03:29.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.759+0000 7fe50d4d4640 1 --2- 172.21.15.55:0/2774360648 >> v2:172.21.15.110:3300/0 conn(0x7fe5080d1290 0x7fe50815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:29.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.759+0000 7fe4ff7fe640 1 -- 172.21.15.55:0/2774360648 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638529639 0 0) 0x7fe5080cd5a0 con 0x7fe50815e3c0 2023-08-25T04:03:29.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.763+0000 7fe50ccd3640 1 --2- 172.21.15.55:0/2774360648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5081601f0 0x7fe50815d430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe5080d2060 tx=0x7fe50401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eaf8673d08bf350 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:29.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.763+0000 7fe4ff7fe640 1 -- 172.21.15.55:0/2774360648 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5040ab600 con 0x7fe5081601f0 2023-08-25T04:03:29.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.763+0000 7fe4ff7fe640 1 -- 172.21.15.55:0/2774360648 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5040a7050 con 0x7fe5081601f0 2023-08-25T04:03:29.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.763+0000 7fe4ff7fe640 1 -- 172.21.15.55:0/2774360648 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5040ab980 con 0x7fe5081601f0 2023-08-25T04:03:29.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.763+0000 7fe50ef37640 1 -- 172.21.15.55:0/2774360648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5081601f0 msgr2=0x7fe50815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.763+0000 7fe50ef37640 1 --2- 172.21.15.55:0/2774360648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5081601f0 0x7fe50815d430 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe5080d2060 tx=0x7fe50401c410 comp rx=0 tx=0).stop 2023-08-25T04:03:29.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.763+0000 7fe50ef37640 1 -- 172.21.15.55:0/2774360648 shutdown_connections 2023-08-25T04:03:29.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.763+0000 7fe50ef37640 1 --2- 172.21.15.55:0/2774360648 >> v2:172.21.15.110:3300/0 conn(0x7fe5080d1290 0x7fe50815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.763+0000 7fe50ef37640 1 --2- 172.21.15.55:0/2774360648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5081601f0 0x7fe50815d430 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.763+0000 7fe50ef37640 1 -- 172.21.15.55:0/2774360648 >> 172.21.15.55:0/2774360648 conn(0x7fe5080d27d0 msgr2=0x7fe5080d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:29.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.763+0000 7fe50ef37640 1 -- 172.21.15.55:0/2774360648 shutdown_connections 2023-08-25T04:03:29.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.763+0000 7fe50ef37640 1 -- 172.21.15.55:0/2774360648 wait complete. 2023-08-25T04:03:29.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50ef37640 1 Processor -- start 2023-08-25T04:03:29.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50ef37640 1 -- start start 2023-08-25T04:03:29.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50ef37640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5080d1290 0x7fe5080c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:29.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50ef37640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe50815e3c0 0x7fe508154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:29.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50ef37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5081601f0 0x7fe5080c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:29.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50ef37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5081566c0 con 0x7fe5081601f0 2023-08-25T04:03:29.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50ef37640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5081569a0 con 0x7fe5080d1290 2023-08-25T04:03:29.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50ef37640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5081581e0 con 0x7fe50815e3c0 2023-08-25T04:03:29.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50d4d4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5081601f0 0x7fe5080c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:29.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50d4d4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5081601f0 0x7fe5080c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47520/0 (socket says 172.21.15.55:47520) 2023-08-25T04:03:29.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50d4d4640 1 -- 172.21.15.55:0/3878463969 learned_addr learned my addr 172.21.15.55:0/3878463969 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:29.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50d4d4640 1 -- 172.21.15.55:0/3878463969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe50815e3c0 msgr2=0x7fe508154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50d4d4640 1 --2- 172.21.15.55:0/3878463969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe50815e3c0 0x7fe508154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50d4d4640 1 -- 172.21.15.55:0/3878463969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5080d1290 msgr2=0x7fe5080c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50ccd3640 1 --2- 172.21.15.55:0/3878463969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5080d1290 0x7fe5080c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:29.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50d4d4640 1 --2- 172.21.15.55:0/3878463969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5080d1290 0x7fe5080c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50d4d4640 1 -- 172.21.15.55:0/3878463969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5040093b0 con 0x7fe5081601f0 2023-08-25T04:03:29.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50ccd3640 1 --2- 172.21.15.55:0/3878463969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5080d1290 0x7fe5080c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:29.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50d4d4640 1 --2- 172.21.15.55:0/3878463969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5081601f0 0x7fe5080c88d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe50000cf20 tx=0x7fe50000a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:29.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe4fd7fa640 1 -- 172.21.15.55:0/3878463969 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50000d840 con 0x7fe5081601f0 2023-08-25T04:03:29.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe4fd7fa640 1 -- 172.21.15.55:0/3878463969 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50000d9a0 con 0x7fe5081601f0 2023-08-25T04:03:29.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe4fd7fa640 1 -- 172.21.15.55:0/3878463969 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50000dd50 con 0x7fe5081601f0 2023-08-25T04:03:29.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50ef37640 1 -- 172.21.15.55:0/3878463969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5081584c0 con 0x7fe5081601f0 2023-08-25T04:03:29.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50ef37640 1 -- 172.21.15.55:0/3878463969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe508154960 con 0x7fe5081601f0 2023-08-25T04:03:29.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.767+0000 7fe50ef37640 1 -- 172.21.15.55:0/3878463969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5080b5260 con 0x7fe5081601f0 2023-08-25T04:03:29.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.771+0000 7fe4fd7fa640 1 -- 172.21.15.55:0/3878463969 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe50001e3b0 con 0x7fe5081601f0 2023-08-25T04:03:29.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.771+0000 7fe4fd7fa640 1 --2- 172.21.15.55:0/3878463969 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe4f4065680 0x7fe4f4067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:29.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.771+0000 7fe4fd7fa640 1 -- 172.21.15.55:0/3878463969 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe500083890 con 0x7fe5081601f0 2023-08-25T04:03:29.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.771+0000 7fe50ccd3640 1 --2- 172.21.15.55:0/3878463969 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe4f4065680 0x7fe4f4067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:29.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.771+0000 7fe50ccd3640 1 --2- 172.21.15.55:0/3878463969 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe4f4065680 0x7fe4f4067b40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe5040ad000 tx=0x7fe504008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:29.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.775+0000 7fe4fd7fa640 1 -- 172.21.15.55:0/3878463969 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe500051340 con 0x7fe5081601f0 2023-08-25T04:03:29.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.935+0000 7fe50ef37640 1 -- 172.21.15.55:0/3878463969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe508073ec0 con 0x7fe5081601f0 2023-08-25T04:03:29.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.935+0000 7fe4fd7fa640 1 -- 172.21.15.55:0/3878463969 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe50001a0a0 con 0x7fe5081601f0 2023-08-25T04:03:29.937 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:03:29.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.935+0000 7fe50ef37640 1 -- 172.21.15.55:0/3878463969 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe4f4065680 msgr2=0x7fe4f4067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.935+0000 7fe50ef37640 1 --2- 172.21.15.55:0/3878463969 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe4f4065680 0x7fe4f4067b40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe5040ad000 tx=0x7fe504008040 comp rx=0 tx=0).stop 2023-08-25T04:03:29.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.935+0000 7fe50ef37640 1 -- 172.21.15.55:0/3878463969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5081601f0 msgr2=0x7fe5080c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:29.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.935+0000 7fe50ef37640 1 --2- 172.21.15.55:0/3878463969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5081601f0 0x7fe5080c88d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe50000cf20 tx=0x7fe50000a7d0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.935+0000 7fe50ef37640 1 -- 172.21.15.55:0/3878463969 shutdown_connections 2023-08-25T04:03:29.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.935+0000 7fe50ef37640 1 --2- 172.21.15.55:0/3878463969 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe4f4065680 0x7fe4f4067b40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.935+0000 7fe50ef37640 1 --2- 172.21.15.55:0/3878463969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5081601f0 0x7fe5080c88d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.935+0000 7fe50ef37640 1 --2- 172.21.15.55:0/3878463969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe50815e3c0 0x7fe508154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.935+0000 7fe50ef37640 1 --2- 172.21.15.55:0/3878463969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5080d1290 0x7fe5080c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.935+0000 7fe50ef37640 1 -- 172.21.15.55:0/3878463969 >> 172.21.15.55:0/3878463969 conn(0x7fe5080d27d0 msgr2=0x7fe5080b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.935+0000 7fe50ef37640 1 -- 172.21.15.55:0/3878463969 shutdown_connections 2023-08-25T04:03:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:29.939+0000 7fe50ef37640 1 -- 172.21.15.55:0/3878463969 wait complete. 2023-08-25T04:03:29.958 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:03:30.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.103+0000 7f14f9c88640 1 Processor -- start 2023-08-25T04:03:30.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.103+0000 7f14f9c88640 1 -- start start 2023-08-25T04:03:30.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.103+0000 7f14f9c88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14f41601f0 0x7f14f415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:30.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.103+0000 7f14f9c88640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f40cd5a0 con 0x7f14f40d1290 2023-08-25T04:03:30.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.103+0000 7f14f9c88640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f40cd880 con 0x7f14f415e3c0 2023-08-25T04:03:30.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.103+0000 7f14f9c88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f40cdb60 con 0x7f14f41601f0 2023-08-25T04:03:30.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.103+0000 7f14f37fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14f41601f0 0x7f14f415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:30.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.103+0000 7f14f3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f14f40d1290 0x7f14f415e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60992/0 (socket says 172.21.15.55:60992) 2023-08-25T04:03:30.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.103+0000 7f14f3fff640 1 -- 172.21.15.55:0/2809845625 learned_addr learned my addr 172.21.15.55:0/2809845625 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:30.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.103+0000 7f14f37fe640 1 -- 172.21.15.55:0/2809845625 >> v1:172.21.15.110:6789/0 conn(0x7f14f415e3c0 legacy=0x7f14f40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:30.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.103+0000 7f14f37fe640 1 -- 172.21.15.55:0/2809845625 >> v1:172.21.15.55:6789/0 conn(0x7f14f40d1290 legacy=0x7f14f415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:30.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.103+0000 7f14f37fe640 1 -- 172.21.15.55:0/2809845625 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f40cde40 con 0x7f14f41601f0 2023-08-25T04:03:30.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.103+0000 7f14f2ffd640 1 -- 172.21.15.55:0/2809845625 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833972558 0 0) 0x7f14f40cd5a0 con 0x7f14f40d1290 2023-08-25T04:03:30.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.107+0000 7f14f37fe640 1 --2- 172.21.15.55:0/2809845625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14f41601f0 0x7f14f415d430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f14e40097d0 tx=0x7f14e401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f54f24ae68abc0f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:30.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.107+0000 7f14f2ffd640 1 -- 172.21.15.55:0/2809845625 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e40a8990 con 0x7f14f41601f0 2023-08-25T04:03:30.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.107+0000 7f14f2ffd640 1 -- 172.21.15.55:0/2809845625 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e40a8af0 con 0x7f14f41601f0 2023-08-25T04:03:30.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.107+0000 7f14f2ffd640 1 -- 172.21.15.55:0/2809845625 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e40a8e80 con 0x7f14f41601f0 2023-08-25T04:03:30.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.107+0000 7f14f9c88640 1 -- 172.21.15.55:0/2809845625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14f41601f0 msgr2=0x7f14f415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:30.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.107+0000 7f14f9c88640 1 --2- 172.21.15.55:0/2809845625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14f41601f0 0x7f14f415d430 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f14e40097d0 tx=0x7f14e401ec90 comp rx=0 tx=0).stop 2023-08-25T04:03:30.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.107+0000 7f14f9c88640 1 -- 172.21.15.55:0/2809845625 shutdown_connections 2023-08-25T04:03:30.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.107+0000 7f14f9c88640 1 --2- 172.21.15.55:0/2809845625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14f41601f0 0x7f14f415d430 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.107+0000 7f14f9c88640 1 -- 172.21.15.55:0/2809845625 >> 172.21.15.55:0/2809845625 conn(0x7f14f40d27d0 msgr2=0x7f14f40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:30.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.107+0000 7f14f9c88640 1 -- 172.21.15.55:0/2809845625 shutdown_connections 2023-08-25T04:03:30.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.107+0000 7f14f9c88640 1 -- 172.21.15.55:0/2809845625 wait complete. 2023-08-25T04:03:30.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14f9c88640 1 Processor -- start 2023-08-25T04:03:30.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14f9c88640 1 -- start start 2023-08-25T04:03:30.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14f9c88640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f40d1290 0x7f14f40c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:30.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14f9c88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14f415e3c0 0x7f14f40c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:30.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14f9c88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14f41601f0 0x7f14f40c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:30.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14f9c88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f409fb30 con 0x7f14f415e3c0 2023-08-25T04:03:30.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14f9c88640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f409ef20 con 0x7f14f40d1290 2023-08-25T04:03:30.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14f9c88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f409f200 con 0x7f14f41601f0 2023-08-25T04:03:30.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14ebfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14f415e3c0 0x7f14f40c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:30.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14f37fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f40d1290 0x7f14f40c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:30.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14ebfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14f415e3c0 0x7f14f40c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47536/0 (socket says 172.21.15.55:47536) 2023-08-25T04:03:30.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14ebfff640 1 -- 172.21.15.55:0/3568353773 learned_addr learned my addr 172.21.15.55:0/3568353773 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:30.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14f3fff640 1 --2- 172.21.15.55:0/3568353773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14f41601f0 0x7f14f40c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:30.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14ebfff640 1 -- 172.21.15.55:0/3568353773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14f41601f0 msgr2=0x7f14f40c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:30.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14ebfff640 1 --2- 172.21.15.55:0/3568353773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14f41601f0 0x7f14f40c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14ebfff640 1 -- 172.21.15.55:0/3568353773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f40d1290 msgr2=0x7f14f40c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:30.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14ebfff640 1 --2- 172.21.15.55:0/3568353773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f40d1290 0x7f14f40c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14ebfff640 1 -- 172.21.15.55:0/3568353773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e40093b0 con 0x7f14f415e3c0 2023-08-25T04:03:30.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14f37fe640 1 --2- 172.21.15.55:0/3568353773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f40d1290 0x7f14f40c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:30.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14ebfff640 1 --2- 172.21.15.55:0/3568353773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14f415e3c0 0x7f14f40c8980 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00c500 tx=0x7f14dc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:30.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14f0ff9640 1 -- 172.21.15.55:0/3568353773 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc005220 con 0x7f14f415e3c0 2023-08-25T04:03:30.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14f0ff9640 1 -- 172.21.15.55:0/3568353773 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc005380 con 0x7f14f415e3c0 2023-08-25T04:03:30.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14f9c88640 1 -- 172.21.15.55:0/3568353773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f40ce7c0 con 0x7f14f415e3c0 2023-08-25T04:03:30.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14f0ff9640 1 -- 172.21.15.55:0/3568353773 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc007270 con 0x7f14f415e3c0 2023-08-25T04:03:30.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.111+0000 7f14f9c88640 1 -- 172.21.15.55:0/3568353773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f409f7c0 con 0x7f14f415e3c0 2023-08-25T04:03:30.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.115+0000 7f14f9c88640 1 -- 172.21.15.55:0/3568353773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f40b5260 con 0x7f14f415e3c0 2023-08-25T04:03:30.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.115+0000 7f14f0ff9640 1 -- 172.21.15.55:0/3568353773 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f14dc0073d0 con 0x7f14f415e3c0 2023-08-25T04:03:30.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.115+0000 7f14f0ff9640 1 --2- 172.21.15.55:0/3568353773 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f14d40656b0 0x7f14d4067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:30.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.115+0000 7f14f0ff9640 1 -- 172.21.15.55:0/3568353773 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f14dc082540 con 0x7f14f415e3c0 2023-08-25T04:03:30.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.115+0000 7f14f37fe640 1 --2- 172.21.15.55:0/3568353773 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f14d40656b0 0x7f14d4067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:30.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.119+0000 7f14f37fe640 1 --2- 172.21.15.55:0/3568353773 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f14d40656b0 0x7f14d4067b70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f14e40b2000 tx=0x7f14e40aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:30.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.119+0000 7f14f0ff9640 1 -- 172.21.15.55:0/3568353773 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f14dc0500c0 con 0x7f14f415e3c0 2023-08-25T04:03:30.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.279+0000 7f14f9c88640 1 -- 172.21.15.55:0/3568353773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f14f4073ec0 con 0x7f14f415e3c0 2023-08-25T04:03:30.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.279+0000 7f14f0ff9640 1 -- 172.21.15.55:0/3568353773 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f14dc0536e0 con 0x7f14f415e3c0 2023-08-25T04:03:30.283 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:03:30.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.283+0000 7f14f9c88640 1 -- 172.21.15.55:0/3568353773 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f14d40656b0 msgr2=0x7f14d4067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.283+0000 7f14f9c88640 1 --2- 172.21.15.55:0/3568353773 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f14d40656b0 0x7f14d4067b70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f14e40b2000 tx=0x7f14e40aa070 comp rx=0 tx=0).stop 2023-08-25T04:03:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.283+0000 7f14f9c88640 1 -- 172.21.15.55:0/3568353773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14f415e3c0 msgr2=0x7f14f40c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.283+0000 7f14f9c88640 1 --2- 172.21.15.55:0/3568353773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14f415e3c0 0x7f14f40c8980 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00c500 tx=0x7f14dc00c9c0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.283+0000 7f14f9c88640 1 -- 172.21.15.55:0/3568353773 shutdown_connections 2023-08-25T04:03:30.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.283+0000 7f14f9c88640 1 --2- 172.21.15.55:0/3568353773 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f14d40656b0 0x7f14d4067b70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.283+0000 7f14f9c88640 1 --2- 172.21.15.55:0/3568353773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14f41601f0 0x7f14f40c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.283+0000 7f14f9c88640 1 --2- 172.21.15.55:0/3568353773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14f415e3c0 0x7f14f40c8980 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.283+0000 7f14f9c88640 1 --2- 172.21.15.55:0/3568353773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f40d1290 0x7f14f40c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.283+0000 7f14f9c88640 1 -- 172.21.15.55:0/3568353773 >> 172.21.15.55:0/3568353773 conn(0x7f14f40d27d0 msgr2=0x7f14f40d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.283+0000 7f14f9c88640 1 -- 172.21.15.55:0/3568353773 shutdown_connections 2023-08-25T04:03:30.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.283+0000 7f14f9c88640 1 -- 172.21.15.55:0/3568353773 wait complete. 2023-08-25T04:03:30.303 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:03:30.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.451+0000 7f54cf703640 1 Processor -- start 2023-08-25T04:03:30.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.451+0000 7f54cf703640 1 -- start start 2023-08-25T04:03:30.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.451+0000 7f54cf703640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54c80ada40 0x7f54c80cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:30.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.451+0000 7f54cf703640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f54c80cc6a0 0x7f54c806c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:30.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.451+0000 7f54cf703640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c80cdf40 con 0x7f54c80ad660 2023-08-25T04:03:30.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.451+0000 7f54cf703640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c806c7b0 con 0x7f54c80cc6a0 2023-08-25T04:03:30.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.451+0000 7f54cf703640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c806b7b0 con 0x7f54c80ada40 2023-08-25T04:03:30.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.451+0000 7f54ccc9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54c80ada40 0x7f54c80cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:30.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.451+0000 7f54cdca0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f54c80cc6a0 0x7f54c806c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:30.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.451+0000 7f54ccc9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54c80ada40 0x7f54c80cd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:50296/0 (socket says 172.21.15.55:50296) 2023-08-25T04:03:30.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.451+0000 7f54ccc9e640 1 -- 172.21.15.55:0/3958234671 learned_addr learned my addr 172.21.15.55:0/3958234671 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:30.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.451+0000 7f54ccc9e640 1 -- 172.21.15.55:0/3958234671 >> v2:172.21.15.110:3300/0 conn(0x7f54c80cc6a0 msgr2=0x7f54c806c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:30.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.451+0000 7f54ccc9e640 1 --2- 172.21.15.55:0/3958234671 >> v2:172.21.15.110:3300/0 conn(0x7f54c80cc6a0 0x7f54c806c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.451+0000 7f54ccc9e640 1 -- 172.21.15.55:0/3958234671 >> v1:172.21.15.110:6789/0 conn(0x7f54c80ad660 legacy=0x7f54c80cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:30.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.451+0000 7f54ccc9e640 1 -- 172.21.15.55:0/3958234671 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c806ba90 con 0x7f54c80ada40 2023-08-25T04:03:30.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.451+0000 7f54cdca0640 1 --2- 172.21.15.55:0/3958234671 >> v2:172.21.15.110:3300/0 conn(0x7f54c80cc6a0 0x7f54c806c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:30.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.455+0000 7f54ccc9e640 1 --2- 172.21.15.55:0/3958234671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54c80ada40 0x7f54c80cd8b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f54b8009870 tx=0x7f54b801c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5695eee1c09612be server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:30.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.455+0000 7f54bffff640 1 -- 172.21.15.55:0/3958234671 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80ab600 con 0x7f54c80ada40 2023-08-25T04:03:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.455+0000 7f54bffff640 1 -- 172.21.15.55:0/3958234671 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b80a7050 con 0x7f54c80ada40 2023-08-25T04:03:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.455+0000 7f54bffff640 1 -- 172.21.15.55:0/3958234671 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80ab980 con 0x7f54c80ada40 2023-08-25T04:03:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.455+0000 7f54cf703640 1 -- 172.21.15.55:0/3958234671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54c80ada40 msgr2=0x7f54c80cd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.455+0000 7f54cf703640 1 --2- 172.21.15.55:0/3958234671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54c80ada40 0x7f54c80cd8b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f54b8009870 tx=0x7f54b801c3d0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.455+0000 7f54cf703640 1 -- 172.21.15.55:0/3958234671 shutdown_connections 2023-08-25T04:03:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.455+0000 7f54cf703640 1 --2- 172.21.15.55:0/3958234671 >> v2:172.21.15.110:3300/0 conn(0x7f54c80cc6a0 0x7f54c806c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.455+0000 7f54cf703640 1 --2- 172.21.15.55:0/3958234671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54c80ada40 0x7f54c80cd8b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.455+0000 7f54cf703640 1 -- 172.21.15.55:0/3958234671 >> 172.21.15.55:0/3958234671 conn(0x7f54c8069900 msgr2=0x7f54c8069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:30.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.455+0000 7f54cf703640 1 -- 172.21.15.55:0/3958234671 shutdown_connections 2023-08-25T04:03:30.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.455+0000 7f54cf703640 1 -- 172.21.15.55:0/3958234671 wait complete. 2023-08-25T04:03:30.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54cf703640 1 Processor -- start 2023-08-25T04:03:30.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54cf703640 1 -- start start 2023-08-25T04:03:30.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54cf703640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54c80ad660 0x7f54c8149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:30.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54cf703640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c80ada40 0x7f54c815a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:30.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54cf703640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54c80cc6a0 0x7f54c815ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:30.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54cf703640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c8099e60 con 0x7f54c80ada40 2023-08-25T04:03:30.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54cf703640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c815af20 con 0x7f54c80ad660 2023-08-25T04:03:30.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54cf703640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c815b200 con 0x7f54c80cc6a0 2023-08-25T04:03:30.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54ccc9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c80ada40 0x7f54c815a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:30.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54ccc9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c80ada40 0x7f54c815a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47538/0 (socket says 172.21.15.55:47538) 2023-08-25T04:03:30.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54ccc9e640 1 -- 172.21.15.55:0/3468763967 learned_addr learned my addr 172.21.15.55:0/3468763967 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:30.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54cd49f640 1 --2- 172.21.15.55:0/3468763967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54c80ad660 0x7f54c8149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:30.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54cdca0640 1 --2- 172.21.15.55:0/3468763967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54c80cc6a0 0x7f54c815ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:30.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54ccc9e640 1 -- 172.21.15.55:0/3468763967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54c80cc6a0 msgr2=0x7f54c815ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:30.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54ccc9e640 1 --2- 172.21.15.55:0/3468763967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54c80cc6a0 0x7f54c815ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54ccc9e640 1 -- 172.21.15.55:0/3468763967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54c80ad660 msgr2=0x7f54c8149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:30.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54ccc9e640 1 --2- 172.21.15.55:0/3468763967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54c80ad660 0x7f54c8149850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54ccc9e640 1 -- 172.21.15.55:0/3468763967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c0009a70 con 0x7f54c80ada40 2023-08-25T04:03:30.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54ccc9e640 1 --2- 172.21.15.55:0/3468763967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c80ada40 0x7f54c815a460 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f54b80ae040 tx=0x7f54b8019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:30.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54bdffb640 1 -- 172.21.15.55:0/3468763967 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80b4420 con 0x7f54c80ada40 2023-08-25T04:03:30.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54bdffb640 1 -- 172.21.15.55:0/3468763967 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b80b45a0 con 0x7f54c80ada40 2023-08-25T04:03:30.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54bdffb640 1 -- 172.21.15.55:0/3468763967 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80b4950 con 0x7f54c80ada40 2023-08-25T04:03:30.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54cf703640 1 -- 172.21.15.55:0/3468763967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b80094d0 con 0x7f54c80ada40 2023-08-25T04:03:30.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.459+0000 7f54cf703640 1 -- 172.21.15.55:0/3468763967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c815b7c0 con 0x7f54c80ada40 2023-08-25T04:03:30.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.463+0000 7f54cf703640 1 -- 172.21.15.55:0/3468763967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c8073ec0 con 0x7f54c80ada40 2023-08-25T04:03:30.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.463+0000 7f54bdffb640 1 -- 172.21.15.55:0/3468763967 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f54b80b2070 con 0x7f54c80ada40 2023-08-25T04:03:30.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.463+0000 7f54bdffb640 1 --2- 172.21.15.55:0/3468763967 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f54ac065680 0x7f54ac067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:30.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.463+0000 7f54bdffb640 1 -- 172.21.15.55:0/3468763967 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f54b811bed0 con 0x7f54c80ada40 2023-08-25T04:03:30.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.463+0000 7f54cd49f640 1 --2- 172.21.15.55:0/3468763967 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f54ac065680 0x7f54ac067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:30.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.463+0000 7f54cd49f640 1 --2- 172.21.15.55:0/3468763967 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f54ac065680 0x7f54ac067b40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f54c4000f00 tx=0x7f54c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:30.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.467+0000 7f54bdffb640 1 -- 172.21.15.55:0/3468763967 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f54b80e99a0 con 0x7f54c80ada40 2023-08-25T04:03:30.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.623+0000 7f54cf703640 1 -- 172.21.15.55:0/3468763967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f54c806c8f0 con 0x7f54c80ada40 2023-08-25T04:03:30.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.627+0000 7f54bdffb640 1 -- 172.21.15.55:0/3468763967 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f54b80ecfc0 con 0x7f54c80ada40 2023-08-25T04:03:30.628 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:03:30.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.627+0000 7f54cf703640 1 -- 172.21.15.55:0/3468763967 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f54ac065680 msgr2=0x7f54ac067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:30.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.627+0000 7f54cf703640 1 --2- 172.21.15.55:0/3468763967 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f54ac065680 0x7f54ac067b40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f54c4000f00 tx=0x7f54c4009040 comp rx=0 tx=0).stop 2023-08-25T04:03:30.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.627+0000 7f54cf703640 1 -- 172.21.15.55:0/3468763967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c80ada40 msgr2=0x7f54c815a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:30.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.627+0000 7f54cf703640 1 --2- 172.21.15.55:0/3468763967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c80ada40 0x7f54c815a460 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f54b80ae040 tx=0x7f54b8019170 comp rx=0 tx=0).stop 2023-08-25T04:03:30.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.627+0000 7f54cf703640 1 -- 172.21.15.55:0/3468763967 shutdown_connections 2023-08-25T04:03:30.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.627+0000 7f54cf703640 1 --2- 172.21.15.55:0/3468763967 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f54ac065680 0x7f54ac067b40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.627+0000 7f54cf703640 1 --2- 172.21.15.55:0/3468763967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54c80cc6a0 0x7f54c815ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.627+0000 7f54cf703640 1 --2- 172.21.15.55:0/3468763967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54c80ada40 0x7f54c815a460 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.627+0000 7f54cf703640 1 --2- 172.21.15.55:0/3468763967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54c80ad660 0x7f54c8149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.627+0000 7f54cf703640 1 -- 172.21.15.55:0/3468763967 >> 172.21.15.55:0/3468763967 conn(0x7f54c8069900 msgr2=0x7f54c8159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:30.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.627+0000 7f54cf703640 1 -- 172.21.15.55:0/3468763967 shutdown_connections 2023-08-25T04:03:30.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.627+0000 7f54cf703640 1 -- 172.21.15.55:0/3468763967 wait complete. 2023-08-25T04:03:30.648 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:03:30.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.791+0000 7f5ff27e8640 1 Processor -- start 2023-08-25T04:03:30.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.791+0000 7f5ff27e8640 1 -- start start 2023-08-25T04:03:30.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.795+0000 7f5ff27e8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5fec15a7f0 0x7f5fec09bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:30.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.795+0000 7f5ff27e8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5fec0c9830 0x7f5fec070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:30.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.795+0000 7f5ff27e8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fec15abd0 con 0x7f5fec06c020 2023-08-25T04:03:30.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.795+0000 7f5ff27e8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fec0c8ab0 con 0x7f5fec0c9830 2023-08-25T04:03:30.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.795+0000 7f5ff27e8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fec0c8d50 con 0x7f5fec15a7f0 2023-08-25T04:03:30.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.795+0000 7f5feb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5fec0c9830 0x7f5fec070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:30.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.795+0000 7f5feb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5fec0c9830 0x7f5fec070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33172/0 (socket says 172.21.15.55:33172) 2023-08-25T04:03:30.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.795+0000 7f5feb7fe640 1 -- 172.21.15.55:0/3069883133 learned_addr learned my addr 172.21.15.55:0/3069883133 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:30.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.795+0000 7f5febfff640 1 --2- 172.21.15.55:0/3069883133 >> v2:172.21.15.110:3300/0 conn(0x7f5fec15a7f0 0x7f5fec09bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:30.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.795+0000 7f5feb7fe640 1 -- 172.21.15.55:0/3069883133 >> v2:172.21.15.110:3300/0 conn(0x7f5fec15a7f0 msgr2=0x7f5fec09bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:30.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.795+0000 7f5feb7fe640 1 --2- 172.21.15.55:0/3069883133 >> v2:172.21.15.110:3300/0 conn(0x7f5fec15a7f0 0x7f5fec09bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.795+0000 7f5feb7fe640 1 -- 172.21.15.55:0/3069883133 >> v1:172.21.15.110:6789/0 conn(0x7f5fec06c020 legacy=0x7f5fec0acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:30.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.795+0000 7f5feb7fe640 1 -- 172.21.15.55:0/3069883133 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec0c9030 con 0x7f5fec0c9830 2023-08-25T04:03:30.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.799+0000 7f5feb7fe640 1 --2- 172.21.15.55:0/3069883133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fec0c9830 0x7f5fec070f00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5fec072060 tx=0x7f5fe001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6240901c7069a91e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:30.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.799+0000 7f5feaffd640 1 -- 172.21.15.55:0/3069883133 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00aa610 con 0x7f5fec0c9830 2023-08-25T04:03:30.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.799+0000 7f5feaffd640 1 -- 172.21.15.55:0/3069883133 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe00a6040 con 0x7f5fec0c9830 2023-08-25T04:03:30.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.799+0000 7f5feaffd640 1 -- 172.21.15.55:0/3069883133 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00aa990 con 0x7f5fec0c9830 2023-08-25T04:03:30.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.799+0000 7f5ff27e8640 1 -- 172.21.15.55:0/3069883133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fec0c9830 msgr2=0x7f5fec070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:30.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.799+0000 7f5ff27e8640 1 --2- 172.21.15.55:0/3069883133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fec0c9830 0x7f5fec070f00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5fec072060 tx=0x7f5fe001c490 comp rx=0 tx=0).stop 2023-08-25T04:03:30.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.799+0000 7f5ff27e8640 1 -- 172.21.15.55:0/3069883133 shutdown_connections 2023-08-25T04:03:30.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.799+0000 7f5ff27e8640 1 --2- 172.21.15.55:0/3069883133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fec0c9830 0x7f5fec070f00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.799+0000 7f5ff27e8640 1 --2- 172.21.15.55:0/3069883133 >> v2:172.21.15.110:3300/0 conn(0x7f5fec15a7f0 0x7f5fec09bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.799+0000 7f5ff27e8640 1 -- 172.21.15.55:0/3069883133 >> 172.21.15.55:0/3069883133 conn(0x7f5fec069900 msgr2=0x7f5fec069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:30.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.799+0000 7f5ff27e8640 1 -- 172.21.15.55:0/3069883133 shutdown_connections 2023-08-25T04:03:30.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.799+0000 7f5ff27e8640 1 -- 172.21.15.55:0/3069883133 wait complete. 2023-08-25T04:03:30.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.799+0000 7f5ff27e8640 1 Processor -- start 2023-08-25T04:03:30.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.799+0000 7f5ff27e8640 1 -- start start 2023-08-25T04:03:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5ff27e8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5fec06c020 0x7f5fec0cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5ff27e8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fec0c9830 0x7f5fec0b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:30.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5ff27e8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fec15a7f0 0x7f5fec150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:30.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5ff27e8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0cd510 con 0x7f5fec15a7f0 2023-08-25T04:03:30.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5ff27e8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0cc890 con 0x7f5fec0c9830 2023-08-25T04:03:30.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5ff27e8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0ccb70 con 0x7f5fec06c020 2023-08-25T04:03:30.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5ff0d85640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fec15a7f0 0x7f5fec150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:30.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5ff0d85640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fec15a7f0 0x7f5fec150780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33174/0 (socket says 172.21.15.55:33174) 2023-08-25T04:03:30.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5ff0d85640 1 -- 172.21.15.55:0/2051096641 learned_addr learned my addr 172.21.15.55:0/2051096641 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:30.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5febfff640 1 --2- 172.21.15.55:0/2051096641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5fec06c020 0x7f5fec0cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:30.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5feb7fe640 1 --2- 172.21.15.55:0/2051096641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fec0c9830 0x7f5fec0b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:30.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5ff0d85640 1 -- 172.21.15.55:0/2051096641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5fec06c020 msgr2=0x7f5fec0cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:30.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5ff0d85640 1 --2- 172.21.15.55:0/2051096641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5fec06c020 0x7f5fec0cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5ff0d85640 1 -- 172.21.15.55:0/2051096641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fec0c9830 msgr2=0x7f5fec0b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:30.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5ff0d85640 1 --2- 172.21.15.55:0/2051096641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fec0c9830 0x7f5fec0b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5ff0d85640 1 -- 172.21.15.55:0/2051096641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe00094d0 con 0x7f5fec15a7f0 2023-08-25T04:03:30.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5ff0d85640 1 --2- 172.21.15.55:0/2051096641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fec15a7f0 0x7f5fec150780 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400be60 tx=0x7f5fe400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:30.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5fe8ff9640 1 -- 172.21.15.55:0/2051096641 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4014440 con 0x7f5fec15a7f0 2023-08-25T04:03:30.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5fe8ff9640 1 -- 172.21.15.55:0/2051096641 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe40145a0 con 0x7f5fec15a7f0 2023-08-25T04:03:30.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5fe8ff9640 1 -- 172.21.15.55:0/2051096641 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4014990 con 0x7f5fec15a7f0 2023-08-25T04:03:30.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5ff27e8640 1 -- 172.21.15.55:0/2051096641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fec0adc90 con 0x7f5fec15a7f0 2023-08-25T04:03:30.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5ff27e8640 1 -- 172.21.15.55:0/2051096641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fec0cd130 con 0x7f5fec15a7f0 2023-08-25T04:03:30.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.803+0000 7f5ff27e8640 1 -- 172.21.15.55:0/2051096641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fec06d5b0 con 0x7f5fec15a7f0 2023-08-25T04:03:30.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.807+0000 7f5fe8ff9640 1 -- 172.21.15.55:0/2051096641 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5fe401d3b0 con 0x7f5fec15a7f0 2023-08-25T04:03:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.807+0000 7f5fe8ff9640 1 --2- 172.21.15.55:0/2051096641 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5fd8065680 0x7f5fd8067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.807+0000 7f5fe8ff9640 1 -- 172.21.15.55:0/2051096641 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5fe4082e70 con 0x7f5fec15a7f0 2023-08-25T04:03:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.807+0000 7f5febfff640 1 --2- 172.21.15.55:0/2051096641 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5fd8065680 0x7f5fd8067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.807+0000 7f5febfff640 1 --2- 172.21.15.55:0/2051096641 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5fd8065680 0x7f5fd8067b40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc006fd0 tx=0x7f5fdc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:30.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.811+0000 7f5fe8ff9640 1 -- 172.21.15.55:0/2051096641 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5fe4050a70 con 0x7f5fec15a7f0 2023-08-25T04:03:30.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.963+0000 7f5ff27e8640 1 -- 172.21.15.55:0/2051096641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5fec0cc5e0 con 0x7f5fec15a7f0 2023-08-25T04:03:30.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.967+0000 7f5fe8ff9640 1 -- 172.21.15.55:0/2051096641 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5fe4054090 con 0x7f5fec15a7f0 2023-08-25T04:03:30.968 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:03:30.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.967+0000 7f5ff27e8640 1 -- 172.21.15.55:0/2051096641 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5fd8065680 msgr2=0x7f5fd8067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:30.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.967+0000 7f5ff27e8640 1 --2- 172.21.15.55:0/2051096641 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5fd8065680 0x7f5fd8067b40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc006fd0 tx=0x7f5fdc008040 comp rx=0 tx=0).stop 2023-08-25T04:03:30.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.967+0000 7f5ff27e8640 1 -- 172.21.15.55:0/2051096641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fec15a7f0 msgr2=0x7f5fec150780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:30.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.967+0000 7f5ff27e8640 1 --2- 172.21.15.55:0/2051096641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fec15a7f0 0x7f5fec150780 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400be60 tx=0x7f5fe400bf50 comp rx=0 tx=0).stop 2023-08-25T04:03:30.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.967+0000 7f5ff27e8640 1 -- 172.21.15.55:0/2051096641 shutdown_connections 2023-08-25T04:03:30.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.967+0000 7f5ff27e8640 1 --2- 172.21.15.55:0/2051096641 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5fd8065680 0x7f5fd8067b40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.967+0000 7f5ff27e8640 1 --2- 172.21.15.55:0/2051096641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fec15a7f0 0x7f5fec150780 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.967+0000 7f5ff27e8640 1 --2- 172.21.15.55:0/2051096641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fec0c9830 0x7f5fec0b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.967+0000 7f5ff27e8640 1 --2- 172.21.15.55:0/2051096641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5fec06c020 0x7f5fec0cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:30.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.967+0000 7f5ff27e8640 1 -- 172.21.15.55:0/2051096641 >> 172.21.15.55:0/2051096641 conn(0x7f5fec069900 msgr2=0x7f5fec069dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:30.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.967+0000 7f5ff27e8640 1 -- 172.21.15.55:0/2051096641 shutdown_connections 2023-08-25T04:03:30.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:30.967+0000 7f5ff27e8640 1 -- 172.21.15.55:0/2051096641 wait complete. 2023-08-25T04:03:31.079 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-08-25T04:03:31.080 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-25T04:03:31.080 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-08-25T04:03:31.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.223+0000 7f345cccb640 1 Processor -- start 2023-08-25T04:03:31.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.223+0000 7f345cccb640 1 -- start start 2023-08-25T04:03:31.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.223+0000 7f345cccb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f34580d0da0 0x7f34580d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:31.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.223+0000 7f345cccb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f34580b3e50 0x7f34580ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:31.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.223+0000 7f345cccb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34580b29b0 con 0x7f34580cdde0 2023-08-25T04:03:31.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.223+0000 7f345cccb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34580ce760 con 0x7f34580b3e50 2023-08-25T04:03:31.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.223+0000 7f345cccb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34580d16c0 con 0x7f34580d0da0 2023-08-25T04:03:31.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.223+0000 7f3456d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f34580b3e50 0x7f34580ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:31.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.223+0000 7f3456d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f34580b3e50 0x7f34580ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33188/0 (socket says 172.21.15.55:33188) 2023-08-25T04:03:31.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.223+0000 7f3456d9d640 1 -- 172.21.15.55:0/4154691973 learned_addr learned my addr 172.21.15.55:0/4154691973 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:31.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.223+0000 7f345659c640 1 --2- 172.21.15.55:0/4154691973 >> v2:172.21.15.110:3300/0 conn(0x7f34580d0da0 0x7f34580d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:31.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.223+0000 7f3456d9d640 1 -- 172.21.15.55:0/4154691973 >> v2:172.21.15.110:3300/0 conn(0x7f34580d0da0 msgr2=0x7f34580d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:31.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.223+0000 7f3456d9d640 1 --2- 172.21.15.55:0/4154691973 >> v2:172.21.15.110:3300/0 conn(0x7f34580d0da0 0x7f34580d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.223+0000 7f3456d9d640 1 -- 172.21.15.55:0/4154691973 >> v1:172.21.15.110:6789/0 conn(0x7f34580cdde0 legacy=0x7f34580cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:31.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.223+0000 7f3456d9d640 1 -- 172.21.15.55:0/4154691973 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34580b1dc0 con 0x7f34580b3e50 2023-08-25T04:03:31.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.227+0000 7f3456d9d640 1 --2- 172.21.15.55:0/4154691973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34580b3e50 0x7f34580ce220 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3458073720 tx=0x7f345001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a837b5c124b31a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:31.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.227+0000 7f3455d9b640 1 -- 172.21.15.55:0/4154691973 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34500af400 con 0x7f34580b3e50 2023-08-25T04:03:31.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.227+0000 7f3455d9b640 1 -- 172.21.15.55:0/4154691973 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34500ab050 con 0x7f34580b3e50 2023-08-25T04:03:31.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.227+0000 7f3455d9b640 1 -- 172.21.15.55:0/4154691973 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34500af780 con 0x7f34580b3e50 2023-08-25T04:03:31.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.227+0000 7f345cccb640 1 -- 172.21.15.55:0/4154691973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34580b3e50 msgr2=0x7f34580ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:31.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.227+0000 7f345cccb640 1 --2- 172.21.15.55:0/4154691973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34580b3e50 0x7f34580ce220 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3458073720 tx=0x7f345001f1c0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.227+0000 7f345cccb640 1 -- 172.21.15.55:0/4154691973 shutdown_connections 2023-08-25T04:03:31.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.227+0000 7f345cccb640 1 --2- 172.21.15.55:0/4154691973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34580b3e50 0x7f34580ce220 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.227+0000 7f345cccb640 1 --2- 172.21.15.55:0/4154691973 >> v2:172.21.15.110:3300/0 conn(0x7f34580d0da0 0x7f34580d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.227+0000 7f345cccb640 1 -- 172.21.15.55:0/4154691973 >> 172.21.15.55:0/4154691973 conn(0x7f345809bae0 msgr2=0x7f34580d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:31.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.227+0000 7f345cccb640 1 -- 172.21.15.55:0/4154691973 shutdown_connections 2023-08-25T04:03:31.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.227+0000 7f345cccb640 1 -- 172.21.15.55:0/4154691973 wait complete. 2023-08-25T04:03:31.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.227+0000 7f345cccb640 1 Processor -- start 2023-08-25T04:03:31.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f345cccb640 1 -- start start 2023-08-25T04:03:31.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f345cccb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34580b3e50 0x7f34581517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:31.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f345cccb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34580cdde0 0x7f34580cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:31.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f345cccb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34580d0da0 0x7f34580c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:31.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f345cccb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34580c99c0 con 0x7f34580d0da0 2023-08-25T04:03:31.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f345cccb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34580c9ca0 con 0x7f34580cdde0 2023-08-25T04:03:31.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f345cccb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34580c9f80 con 0x7f34580b3e50 2023-08-25T04:03:31.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f3456d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34580d0da0 0x7f34580c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:31.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f3456d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34580d0da0 0x7f34580c6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33200/0 (socket says 172.21.15.55:33200) 2023-08-25T04:03:31.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f3456d9d640 1 -- 172.21.15.55:0/3463820957 learned_addr learned my addr 172.21.15.55:0/3463820957 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:31.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f345659c640 1 --2- 172.21.15.55:0/3463820957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34580b3e50 0x7f34581517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:31.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f344ffff640 1 --2- 172.21.15.55:0/3463820957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34580cdde0 0x7f34580cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:31.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f3456d9d640 1 -- 172.21.15.55:0/3463820957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34580b3e50 msgr2=0x7f34581517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:31.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f3456d9d640 1 --2- 172.21.15.55:0/3463820957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34580b3e50 0x7f34581517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f3456d9d640 1 -- 172.21.15.55:0/3463820957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34580cdde0 msgr2=0x7f34580cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:31.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f3456d9d640 1 --2- 172.21.15.55:0/3463820957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34580cdde0 0x7f34580cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f3456d9d640 1 -- 172.21.15.55:0/3463820957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3450009b30 con 0x7f34580d0da0 2023-08-25T04:03:31.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f344ffff640 1 --2- 172.21.15.55:0/3463820957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34580cdde0 0x7f34580cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:31.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f3456d9d640 1 --2- 172.21.15.55:0/3463820957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34580d0da0 0x7f34580c6f70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f34500b2040 tx=0x7f345001bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:31.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f344effd640 1 -- 172.21.15.55:0/3463820957 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34500afd60 con 0x7f34580d0da0 2023-08-25T04:03:31.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f344effd640 1 -- 172.21.15.55:0/3463820957 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3450009510 con 0x7f34580d0da0 2023-08-25T04:03:31.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f345cccb640 1 -- 172.21.15.55:0/3463820957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34580ca260 con 0x7f34580d0da0 2023-08-25T04:03:31.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f344effd640 1 -- 172.21.15.55:0/3463820957 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34500ba660 con 0x7f34580d0da0 2023-08-25T04:03:31.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f345cccb640 1 -- 172.21.15.55:0/3463820957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3458151f20 con 0x7f34580d0da0 2023-08-25T04:03:31.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.231+0000 7f345cccb640 1 -- 172.21.15.55:0/3463820957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345804dbe0 con 0x7f34580d0da0 2023-08-25T04:03:31.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.235+0000 7f344effd640 1 -- 172.21.15.55:0/3463820957 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f34500b6040 con 0x7f34580d0da0 2023-08-25T04:03:31.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.235+0000 7f344effd640 1 --2- 172.21.15.55:0/3463820957 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3438065680 0x7f3438067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:31.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.235+0000 7f344effd640 1 -- 172.21.15.55:0/3463820957 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3450121210 con 0x7f34580d0da0 2023-08-25T04:03:31.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.235+0000 7f345659c640 1 --2- 172.21.15.55:0/3463820957 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3438065680 0x7f3438067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:31.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.235+0000 7f345659c640 1 --2- 172.21.15.55:0/3463820957 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3438065680 0x7f3438067b40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3448006fd0 tx=0x7f3448008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:31.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.239+0000 7f344effd640 1 -- 172.21.15.55:0/3463820957 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f34500eee90 con 0x7f34580d0da0 2023-08-25T04:03:31.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.447+0000 7f345cccb640 1 -- 172.21.15.55:0/3463820957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f34580c9b00 con 0x7f34580d0da0 2023-08-25T04:03:31.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.483+0000 7f344effd640 1 -- 172.21.15.55:0/3463820957 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7f34580c9b00 con 0x7f34580d0da0 2023-08-25T04:03:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.483+0000 7f345cccb640 1 -- 172.21.15.55:0/3463820957 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3438065680 msgr2=0x7f3438067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.483+0000 7f345cccb640 1 --2- 172.21.15.55:0/3463820957 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3438065680 0x7f3438067b40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3448006fd0 tx=0x7f3448008040 comp rx=0 tx=0).stop 2023-08-25T04:03:31.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.483+0000 7f345cccb640 1 -- 172.21.15.55:0/3463820957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34580d0da0 msgr2=0x7f34580c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:31.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.483+0000 7f345cccb640 1 --2- 172.21.15.55:0/3463820957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34580d0da0 0x7f34580c6f70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f34500b2040 tx=0x7f345001bf60 comp rx=0 tx=0).stop 2023-08-25T04:03:31.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.483+0000 7f345cccb640 1 -- 172.21.15.55:0/3463820957 shutdown_connections 2023-08-25T04:03:31.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.483+0000 7f345cccb640 1 --2- 172.21.15.55:0/3463820957 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3438065680 0x7f3438067b40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.483+0000 7f345cccb640 1 --2- 172.21.15.55:0/3463820957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34580d0da0 0x7f34580c6f70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.483+0000 7f345cccb640 1 --2- 172.21.15.55:0/3463820957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34580cdde0 0x7f34580cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.483+0000 7f345cccb640 1 --2- 172.21.15.55:0/3463820957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34580b3e50 0x7f34581517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.483+0000 7f345cccb640 1 -- 172.21.15.55:0/3463820957 >> 172.21.15.55:0/3463820957 conn(0x7f345809bae0 msgr2=0x7f345806ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:31.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.483+0000 7f345cccb640 1 -- 172.21.15.55:0/3463820957 shutdown_connections 2023-08-25T04:03:31.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.483+0000 7f345cccb640 1 -- 172.21.15.55:0/3463820957 wait complete. 2023-08-25T04:03:31.506 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:31.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.647+0000 7f7ed0fa3640 1 Processor -- start 2023-08-25T04:03:31.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.647+0000 7f7ed0fa3640 1 -- start start 2023-08-25T04:03:31.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.651+0000 7f7ed0fa3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ecc0b2d30 0x7f7ecc159f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:31.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.651+0000 7f7ed0fa3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ecc0cdbf0 con 0x7f7ecc158e10 2023-08-25T04:03:31.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.651+0000 7f7ed0fa3640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ecc0b3110 con 0x7f7ecc0cab90 2023-08-25T04:03:31.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.651+0000 7f7ed0fa3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ecc0ad940 con 0x7f7ecc0b2d30 2023-08-25T04:03:31.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.651+0000 7f7eca59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ecc0b2d30 0x7f7ecc159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:31.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.651+0000 7f7ec1d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7ecc158e10 0x7f7ecc0ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45024/0 (socket says 172.21.15.55:45024) 2023-08-25T04:03:31.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.651+0000 7f7ec1d9b640 1 -- 172.21.15.55:0/2078520448 learned_addr learned my addr 172.21.15.55:0/2078520448 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:31.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.651+0000 7f7eca59c640 1 -- 172.21.15.55:0/2078520448 >> v1:172.21.15.110:6789/0 conn(0x7f7ecc0cab90 legacy=0x7f7ecc0cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:31.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.651+0000 7f7eca59c640 1 -- 172.21.15.55:0/2078520448 >> v1:172.21.15.55:6789/0 conn(0x7f7ecc158e10 legacy=0x7f7ecc0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:31.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.651+0000 7f7eca59c640 1 -- 172.21.15.55:0/2078520448 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc06d380 con 0x7f7ecc0b2d30 2023-08-25T04:03:31.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.651+0000 7f7ec9d9b640 1 -- 172.21.15.55:0/2078520448 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128353570 0 0) 0x7f7ecc0cdbf0 con 0x7f7ecc158e10 2023-08-25T04:03:31.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7eca59c640 1 --2- 172.21.15.55:0/2078520448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ecc0b2d30 0x7f7ecc159f10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00ba60 tx=0x7f7ebc01eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef8de7c0dcbcffa server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:31.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7ec9d9b640 1 -- 172.21.15.55:0/2078520448 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc0a7b30 con 0x7f7ecc0b2d30 2023-08-25T04:03:31.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7ec9d9b640 1 -- 172.21.15.55:0/2078520448 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc0a7c90 con 0x7f7ecc0b2d30 2023-08-25T04:03:31.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7ec9d9b640 1 -- 172.21.15.55:0/2078520448 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc0af440 con 0x7f7ecc0b2d30 2023-08-25T04:03:31.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7ed0fa3640 1 -- 172.21.15.55:0/2078520448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ecc0b2d30 msgr2=0x7f7ecc159f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:31.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7ed0fa3640 1 --2- 172.21.15.55:0/2078520448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ecc0b2d30 0x7f7ecc159f10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00ba60 tx=0x7f7ebc01eb50 comp rx=0 tx=0).stop 2023-08-25T04:03:31.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7ed0fa3640 1 -- 172.21.15.55:0/2078520448 shutdown_connections 2023-08-25T04:03:31.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7ed0fa3640 1 --2- 172.21.15.55:0/2078520448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ecc0b2d30 0x7f7ecc159f10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7ed0fa3640 1 -- 172.21.15.55:0/2078520448 >> 172.21.15.55:0/2078520448 conn(0x7f7ecc069d00 msgr2=0x7f7ecc06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:31.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7ed0fa3640 1 -- 172.21.15.55:0/2078520448 shutdown_connections 2023-08-25T04:03:31.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7ed0fa3640 1 -- 172.21.15.55:0/2078520448 wait complete. 2023-08-25T04:03:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7ed0fa3640 1 Processor -- start 2023-08-25T04:03:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7ed0fa3640 1 -- start start 2023-08-25T04:03:31.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7ed0fa3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ecc0b2d30 0x7f7ecc163330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7ed0fa3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ecc0cab90 0x7f7ecc09bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7ed0fa3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ecc158e10 0x7f7ecc0acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7ed0fa3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0ad2c0 con 0x7f7ecc0b2d30 2023-08-25T04:03:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7ed0fa3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0abce0 con 0x7f7ecc158e10 2023-08-25T04:03:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.655+0000 7f7ed0fa3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0abfc0 con 0x7f7ecc0cab90 2023-08-25T04:03:31.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7eca59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ecc0b2d30 0x7f7ecc163330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:31.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7eca59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ecc0b2d30 0x7f7ecc163330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33222/0 (socket says 172.21.15.55:33222) 2023-08-25T04:03:31.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7eca59c640 1 -- 172.21.15.55:0/2671365693 learned_addr learned my addr 172.21.15.55:0/2671365693 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:31.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7ec1d9b640 1 --2- 172.21.15.55:0/2671365693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ecc0cab90 0x7f7ecc09bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:31.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7ecad9d640 1 --2- 172.21.15.55:0/2671365693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ecc158e10 0x7f7ecc0acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:31.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7eca59c640 1 -- 172.21.15.55:0/2671365693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ecc0cab90 msgr2=0x7f7ecc09bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:31.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7eca59c640 1 --2- 172.21.15.55:0/2671365693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ecc0cab90 0x7f7ecc09bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7eca59c640 1 -- 172.21.15.55:0/2671365693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ecc158e10 msgr2=0x7f7ecc0acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:31.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7eca59c640 1 --2- 172.21.15.55:0/2671365693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ecc158e10 0x7f7ecc0acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7eca59c640 1 -- 172.21.15.55:0/2671365693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ebc00b6c0 con 0x7f7ecc0b2d30 2023-08-25T04:03:31.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7eca59c640 1 --2- 172.21.15.55:0/2671365693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ecc0b2d30 0x7f7ecc163330 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc01c780 tx=0x7f7ebc01d390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:31.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7ec37fe640 1 -- 172.21.15.55:0/2671365693 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc0b0c30 con 0x7f7ecc0b2d30 2023-08-25T04:03:31.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7ec37fe640 1 -- 172.21.15.55:0/2671365693 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc0b0d90 con 0x7f7ecc0b2d30 2023-08-25T04:03:31.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7ec37fe640 1 -- 172.21.15.55:0/2671365693 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc004230 con 0x7f7ecc0b2d30 2023-08-25T04:03:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7ed0fa3640 1 -- 172.21.15.55:0/2671365693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ecc0ac2a0 con 0x7f7ecc0b2d30 2023-08-25T04:03:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7ed0fa3640 1 -- 172.21.15.55:0/2671365693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ecc0ac860 con 0x7f7ecc0b2d30 2023-08-25T04:03:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7ed0fa3640 1 -- 172.21.15.55:0/2671365693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ecc159a00 con 0x7f7ecc0b2d30 2023-08-25T04:03:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7ec37fe640 1 -- 172.21.15.55:0/2671365693 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7ebc0b6040 con 0x7f7ecc0b2d30 2023-08-25T04:03:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.659+0000 7f7ec37fe640 1 --2- 172.21.15.55:0/2671365693 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7eac065680 0x7f7eac067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.663+0000 7f7ec37fe640 1 -- 172.21.15.55:0/2671365693 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7ebc11dfd0 con 0x7f7ecc0b2d30 2023-08-25T04:03:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.663+0000 7f7ec1d9b640 1 --2- 172.21.15.55:0/2671365693 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7eac065680 0x7f7eac067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.663+0000 7f7ec1d9b640 1 --2- 172.21.15.55:0/2671365693 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7eac065680 0x7f7eac067b40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc0c5370 tx=0x7f7eb4007ba0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:31.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.663+0000 7f7ec37fe640 1 -- 172.21.15.55:0/2671365693 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7ebc0eba80 con 0x7f7ecc0b2d30 2023-08-25T04:03:31.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.823+0000 7f7ed0fa3640 1 -- 172.21.15.55:0/2671365693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ecc04dbe0 con 0x7f7ecc0b2d30 2023-08-25T04:03:31.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.823+0000 7f7ec37fe640 1 -- 172.21.15.55:0/2671365693 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18291 (secure 0 0 0) 0x7f7ebc0ef0a0 con 0x7f7ecc0b2d30 2023-08-25T04:03:31.829 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:31.829 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:02.329010+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.823+0000 7f7ed0fa3640 1 -- 172.21.15.55:0/2671365693 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7eac065680 msgr2=0x7f7eac067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.823+0000 7f7ed0fa3640 1 --2- 172.21.15.55:0/2671365693 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7eac065680 0x7f7eac067b40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc0c5370 tx=0x7f7eb4007ba0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.823+0000 7f7ed0fa3640 1 -- 172.21.15.55:0/2671365693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ecc0b2d30 msgr2=0x7f7ecc163330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.823+0000 7f7ed0fa3640 1 --2- 172.21.15.55:0/2671365693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ecc0b2d30 0x7f7ecc163330 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc01c780 tx=0x7f7ebc01d390 comp rx=0 tx=0).stop 2023-08-25T04:03:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.823+0000 7f7ed0fa3640 1 -- 172.21.15.55:0/2671365693 shutdown_connections 2023-08-25T04:03:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.823+0000 7f7ed0fa3640 1 --2- 172.21.15.55:0/2671365693 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7eac065680 0x7f7eac067b40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.823+0000 7f7ed0fa3640 1 --2- 172.21.15.55:0/2671365693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ecc158e10 0x7f7ecc0acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.823+0000 7f7ed0fa3640 1 --2- 172.21.15.55:0/2671365693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ecc0cab90 0x7f7ecc09bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.823+0000 7f7ed0fa3640 1 --2- 172.21.15.55:0/2671365693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ecc0b2d30 0x7f7ecc163330 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.823+0000 7f7ed0fa3640 1 -- 172.21.15.55:0/2671365693 >> 172.21.15.55:0/2671365693 conn(0x7f7ecc069d00 msgr2=0x7f7ecc0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:31.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.823+0000 7f7ed0fa3640 1 -- 172.21.15.55:0/2671365693 shutdown_connections 2023-08-25T04:03:31.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.823+0000 7f7ed0fa3640 1 -- 172.21.15.55:0/2671365693 wait complete. 2023-08-25T04:03:31.846 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:02:58.890533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:03:00.093976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:03:31.847 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:03:31.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.991+0000 7f0702d67640 1 Processor -- start 2023-08-25T04:03:31.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.991+0000 7f0702d67640 1 -- start start 2023-08-25T04:03:31.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.995+0000 7f0702d67640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06fc0ce110 0x7f06fc0cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:31.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.995+0000 7f0702d67640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f06fc0cd620 0x7f06fc1646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:31.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.995+0000 7f0702d67640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06fc0ce5a0 con 0x7f06fc15a840 2023-08-25T04:03:31.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.995+0000 7f0702d67640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06fc0cf640 con 0x7f06fc0cd620 2023-08-25T04:03:31.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.995+0000 7f0702d67640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0ce880 con 0x7f06fc0ce110 2023-08-25T04:03:31.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.995+0000 7f0700b03640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f06fc15a840 0x7f06fc0ccf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:53876/0 (socket says 172.21.15.55:53876) 2023-08-25T04:03:31.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.995+0000 7f0700b03640 1 -- 172.21.15.55:0/3589031313 learned_addr learned my addr 172.21.15.55:0/3589031313 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:31.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.995+0000 7f06fbfff640 1 --2- 172.21.15.55:0/3589031313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06fc0ce110 0x7f06fc0cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:31.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.995+0000 7f0701304640 1 --2- 172.21.15.55:0/3589031313 >> v2:172.21.15.110:3300/0 conn(0x7f06fc0cd620 0x7f06fc1646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:31.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.995+0000 7f06fb7fe640 1 -- 172.21.15.55:0/3589031313 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229483033 0 0) 0x7f06fc0ce5a0 con 0x7f06fc15a840 2023-08-25T04:03:31.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.995+0000 7f06fb7fe640 1 -- 172.21.15.55:0/3589031313 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06ec003530 con 0x7f06fc15a840 2023-08-25T04:03:31.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.995+0000 7f0701304640 1 -- 172.21.15.55:0/3589031313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06fc0ce110 msgr2=0x7f06fc0cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:31.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.995+0000 7f0701304640 1 --2- 172.21.15.55:0/3589031313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06fc0ce110 0x7f06fc0cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:31.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.995+0000 7f0701304640 1 -- 172.21.15.55:0/3589031313 >> v1:172.21.15.110:6789/0 conn(0x7f06fc15a840 legacy=0x7f06fc0ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:31.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.995+0000 7f0701304640 1 -- 172.21.15.55:0/3589031313 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc0ceb60 con 0x7f06fc0cd620 2023-08-25T04:03:31.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.995+0000 7f06fbfff640 1 --2- 172.21.15.55:0/3589031313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06fc0ce110 0x7f06fc0cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:31.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.999+0000 7f0701304640 1 --2- 172.21.15.55:0/3589031313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06fc0cd620 0x7f06fc1646e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009d90 tx=0x7f06f401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6589064877d49ada server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:31.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.999+0000 7f06fb7fe640 1 -- 172.21.15.55:0/3589031313 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f40a5900 con 0x7f06fc0cd620 2023-08-25T04:03:32.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.999+0000 7f06fb7fe640 1 -- 172.21.15.55:0/3589031313 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f40a5a60 con 0x7f06fc0cd620 2023-08-25T04:03:32.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.999+0000 7f06fb7fe640 1 -- 172.21.15.55:0/3589031313 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f40a5df0 con 0x7f06fc0cd620 2023-08-25T04:03:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.999+0000 7f0702d67640 1 -- 172.21.15.55:0/3589031313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06fc0cd620 msgr2=0x7f06fc1646e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.999+0000 7f0702d67640 1 --2- 172.21.15.55:0/3589031313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06fc0cd620 0x7f06fc1646e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009d90 tx=0x7f06f401c950 comp rx=0 tx=0).stop 2023-08-25T04:03:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.999+0000 7f0702d67640 1 -- 172.21.15.55:0/3589031313 shutdown_connections 2023-08-25T04:03:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.999+0000 7f0702d67640 1 --2- 172.21.15.55:0/3589031313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06fc0cd620 0x7f06fc1646e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.999+0000 7f0702d67640 1 --2- 172.21.15.55:0/3589031313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06fc0ce110 0x7f06fc0cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.999+0000 7f0702d67640 1 -- 172.21.15.55:0/3589031313 >> 172.21.15.55:0/3589031313 conn(0x7f06fc0d0540 msgr2=0x7f06fc0d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:32.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.999+0000 7f0702d67640 1 -- 172.21.15.55:0/3589031313 shutdown_connections 2023-08-25T04:03:32.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.999+0000 7f0702d67640 1 -- 172.21.15.55:0/3589031313 wait complete. 2023-08-25T04:03:32.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.999+0000 7f0702d67640 1 Processor -- start 2023-08-25T04:03:32.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.999+0000 7f0702d67640 1 -- start start 2023-08-25T04:03:32.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:31.999+0000 7f0702d67640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06fc0cd620 0x7f06fc0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:32.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0702d67640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06fc15a840 0x7f06fc152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:32.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0702d67640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc0b42e0 0x7f06fc0b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:32.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0702d67640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0b29e0 con 0x7f06fc0b42e0 2023-08-25T04:03:32.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0702d67640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0b2f30 con 0x7f06fc15a840 2023-08-25T04:03:32.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0702d67640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0b1e60 con 0x7f06fc0cd620 2023-08-25T04:03:32.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0701304640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc0b42e0 0x7f06fc0b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:32.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0701304640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc0b42e0 0x7f06fc0b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33224/0 (socket says 172.21.15.55:33224) 2023-08-25T04:03:32.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0701304640 1 -- 172.21.15.55:0/774408766 learned_addr learned my addr 172.21.15.55:0/774408766 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:32.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f06fbfff640 1 --2- 172.21.15.55:0/774408766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06fc15a840 0x7f06fc152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:32.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0700b03640 1 --2- 172.21.15.55:0/774408766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06fc0cd620 0x7f06fc0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:32.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0701304640 1 -- 172.21.15.55:0/774408766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06fc0cd620 msgr2=0x7f06fc0b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:32.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0701304640 1 --2- 172.21.15.55:0/774408766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06fc0cd620 0x7f06fc0b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0701304640 1 -- 172.21.15.55:0/774408766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06fc15a840 msgr2=0x7f06fc152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:32.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0701304640 1 --2- 172.21.15.55:0/774408766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06fc15a840 0x7f06fc152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0701304640 1 -- 172.21.15.55:0/774408766 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e8009420 con 0x7f06fc0b42e0 2023-08-25T04:03:32.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0700b03640 1 --2- 172.21.15.55:0/774408766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06fc0cd620 0x7f06fc0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:32.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0701304640 1 --2- 172.21.15.55:0/774408766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc0b42e0 0x7f06fc0b4770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f06f40b0040 tx=0x7f06f40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:32.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f06f97fa640 1 -- 172.21.15.55:0/774408766 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f40b9860 con 0x7f06fc0b42e0 2023-08-25T04:03:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f06f97fa640 1 -- 172.21.15.55:0/774408766 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f40b99c0 con 0x7f06fc0b42e0 2023-08-25T04:03:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f06f97fa640 1 -- 172.21.15.55:0/774408766 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f40b9d70 con 0x7f06fc0b42e0 2023-08-25T04:03:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0702d67640 1 -- 172.21.15.55:0/774408766 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f4009a70 con 0x7f06fc0b42e0 2023-08-25T04:03:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0702d67640 1 -- 172.21.15.55:0/774408766 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06fc0b2420 con 0x7f06fc0b42e0 2023-08-25T04:03:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f0702d67640 1 -- 172.21.15.55:0/774408766 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06fc073ec0 con 0x7f06fc0b42e0 2023-08-25T04:03:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.003+0000 7f06f97fa640 1 -- 172.21.15.55:0/774408766 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f06f40ad440 con 0x7f06fc0b42e0 2023-08-25T04:03:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.007+0000 7f06f97fa640 1 --2- 172.21.15.55:0/774408766 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f06e0065680 0x7f06e0067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.007+0000 7f06f97fa640 1 -- 172.21.15.55:0/774408766 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f06f411e0d0 con 0x7f06fc0b42e0 2023-08-25T04:03:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.007+0000 7f0700b03640 1 --2- 172.21.15.55:0/774408766 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f06e0065680 0x7f06e0067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.007+0000 7f0700b03640 1 --2- 172.21.15.55:0/774408766 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f06e0065680 0x7f06e0067b40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f06f0001240 tx=0x7f06f0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:32.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.011+0000 7f06f97fa640 1 -- 172.21.15.55:0/774408766 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f06f40ebb80 con 0x7f06fc0b42e0 2023-08-25T04:03:32.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.163+0000 7f0702d67640 1 -- 172.21.15.55:0/774408766 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f06fc151ff0 con 0x7f06fc0b42e0 2023-08-25T04:03:32.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.167+0000 7f06f97fa640 1 -- 172.21.15.55:0/774408766 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f06f40ef1a0 con 0x7f06fc0b42e0 2023-08-25T04:03:32.167 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:03:32.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.167+0000 7f0702d67640 1 -- 172.21.15.55:0/774408766 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f06e0065680 msgr2=0x7f06e0067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:32.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.167+0000 7f0702d67640 1 --2- 172.21.15.55:0/774408766 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f06e0065680 0x7f06e0067b40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f06f0001240 tx=0x7f06f0009040 comp rx=0 tx=0).stop 2023-08-25T04:03:32.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.167+0000 7f0702d67640 1 -- 172.21.15.55:0/774408766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc0b42e0 msgr2=0x7f06fc0b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:32.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.167+0000 7f0702d67640 1 --2- 172.21.15.55:0/774408766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc0b42e0 0x7f06fc0b4770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f06f40b0040 tx=0x7f06f40196f0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.167+0000 7f0702d67640 1 -- 172.21.15.55:0/774408766 shutdown_connections 2023-08-25T04:03:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.167+0000 7f0702d67640 1 --2- 172.21.15.55:0/774408766 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f06e0065680 0x7f06e0067b40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.167+0000 7f0702d67640 1 --2- 172.21.15.55:0/774408766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc0b42e0 0x7f06fc0b4770 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.167+0000 7f0702d67640 1 --2- 172.21.15.55:0/774408766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06fc15a840 0x7f06fc152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.167+0000 7f0702d67640 1 --2- 172.21.15.55:0/774408766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06fc0cd620 0x7f06fc0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.167+0000 7f0702d67640 1 -- 172.21.15.55:0/774408766 >> 172.21.15.55:0/774408766 conn(0x7f06fc0d0540 msgr2=0x7f06fc06eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.167+0000 7f0702d67640 1 -- 172.21.15.55:0/774408766 shutdown_connections 2023-08-25T04:03:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.167+0000 7f0702d67640 1 -- 172.21.15.55:0/774408766 wait complete. 2023-08-25T04:03:32.189 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:03:32.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.335+0000 7fb568b44640 1 Processor -- start 2023-08-25T04:03:32.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.335+0000 7fb568b44640 1 -- start start 2023-08-25T04:03:32.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.335+0000 7fb568b44640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb5641601f0 0x7fb56415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:32.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.335+0000 7fb568b44640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb56415e3c0 0x7fb5640d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:32.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.335+0000 7fb568b44640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56415f8b0 con 0x7fb5640d10c0 2023-08-25T04:03:32.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.335+0000 7fb568b44640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5640cd5a0 con 0x7fb5641601f0 2023-08-25T04:03:32.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.335+0000 7fb568b44640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640cd880 con 0x7fb56415e3c0 2023-08-25T04:03:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.335+0000 7fb56259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb5641601f0 0x7fb56415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.335+0000 7fb56259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb5641601f0 0x7fb56415d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33234/0 (socket says 172.21.15.55:33234) 2023-08-25T04:03:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.335+0000 7fb56259c640 1 -- 172.21.15.55:0/3445009739 learned_addr learned my addr 172.21.15.55:0/3445009739 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.335+0000 7fb55bfff640 1 --2- 172.21.15.55:0/3445009739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb56415e3c0 0x7fb5640d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:32.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.335+0000 7fb56259c640 1 -- 172.21.15.55:0/3445009739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb56415e3c0 msgr2=0x7fb5640d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:32.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.335+0000 7fb56259c640 1 --2- 172.21.15.55:0/3445009739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb56415e3c0 0x7fb5640d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.335+0000 7fb56259c640 1 -- 172.21.15.55:0/3445009739 >> v1:172.21.15.110:6789/0 conn(0x7fb5640d10c0 legacy=0x7fb5640b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:32.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.335+0000 7fb561d9b640 1 -- 172.21.15.55:0/3445009739 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773883443 0 0) 0x7fb56415f8b0 con 0x7fb5640d10c0 2023-08-25T04:03:32.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.335+0000 7fb56259c640 1 -- 172.21.15.55:0/3445009739 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5640cdb60 con 0x7fb5641601f0 2023-08-25T04:03:32.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.339+0000 7fb56259c640 1 --2- 172.21.15.55:0/3445009739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5641601f0 0x7fb56415d430 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb554006fd0 tx=0x7fb55401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e165a7962c41d33 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:32.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.339+0000 7fb561d9b640 1 -- 172.21.15.55:0/3445009739 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5540a8a10 con 0x7fb5641601f0 2023-08-25T04:03:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.339+0000 7fb561d9b640 1 -- 172.21.15.55:0/3445009739 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5540a8b70 con 0x7fb5641601f0 2023-08-25T04:03:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.339+0000 7fb561d9b640 1 -- 172.21.15.55:0/3445009739 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5540b0440 con 0x7fb5641601f0 2023-08-25T04:03:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.339+0000 7fb568b44640 1 -- 172.21.15.55:0/3445009739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5641601f0 msgr2=0x7fb56415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.339+0000 7fb568b44640 1 --2- 172.21.15.55:0/3445009739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5641601f0 0x7fb56415d430 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb554006fd0 tx=0x7fb55401ed10 comp rx=0 tx=0).stop 2023-08-25T04:03:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.339+0000 7fb568b44640 1 -- 172.21.15.55:0/3445009739 shutdown_connections 2023-08-25T04:03:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.339+0000 7fb568b44640 1 --2- 172.21.15.55:0/3445009739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb56415e3c0 0x7fb5640d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.339+0000 7fb568b44640 1 --2- 172.21.15.55:0/3445009739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5641601f0 0x7fb56415d430 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.339+0000 7fb568b44640 1 -- 172.21.15.55:0/3445009739 >> 172.21.15.55:0/3445009739 conn(0x7fb5640d27d0 msgr2=0x7fb5640d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:32.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.339+0000 7fb568b44640 1 -- 172.21.15.55:0/3445009739 shutdown_connections 2023-08-25T04:03:32.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.339+0000 7fb568b44640 1 -- 172.21.15.55:0/3445009739 wait complete. 2023-08-25T04:03:32.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb568b44640 1 Processor -- start 2023-08-25T04:03:32.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb568b44640 1 -- start start 2023-08-25T04:03:32.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb568b44640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5640d10c0 0x7fb5640c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:32.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb568b44640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb56415e3c0 0x7fb5640cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:32.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb568b44640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5641601f0 0x7fb56409fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:32.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb568b44640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640cc7a0 con 0x7fb56415e3c0 2023-08-25T04:03:32.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb568b44640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640c7f20 con 0x7fb5640d10c0 2023-08-25T04:03:32.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb568b44640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640c7310 con 0x7fb5641601f0 2023-08-25T04:03:32.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb55bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb56415e3c0 0x7fb5640cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:32.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb55bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb56415e3c0 0x7fb5640cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33242/0 (socket says 172.21.15.55:33242) 2023-08-25T04:03:32.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb55bfff640 1 -- 172.21.15.55:0/2772211726 learned_addr learned my addr 172.21.15.55:0/2772211726 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:32.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb56259c640 1 --2- 172.21.15.55:0/2772211726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5640d10c0 0x7fb5640c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:32.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb562d9d640 1 --2- 172.21.15.55:0/2772211726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5641601f0 0x7fb56409fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:32.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb55bfff640 1 -- 172.21.15.55:0/2772211726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5641601f0 msgr2=0x7fb56409fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:32.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb55bfff640 1 --2- 172.21.15.55:0/2772211726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5641601f0 0x7fb56409fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb55bfff640 1 -- 172.21.15.55:0/2772211726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5640d10c0 msgr2=0x7fb5640c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:32.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb55bfff640 1 --2- 172.21.15.55:0/2772211726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5640d10c0 0x7fb5640c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb55bfff640 1 -- 172.21.15.55:0/2772211726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb554009480 con 0x7fb56415e3c0 2023-08-25T04:03:32.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb562d9d640 1 --2- 172.21.15.55:0/2772211726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5641601f0 0x7fb56409fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:32.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb55bfff640 1 --2- 172.21.15.55:0/2772211726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb56415e3c0 0x7fb5640cc260 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00e930 tx=0x7fb54c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:32.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb55affd640 1 -- 172.21.15.55:0/2772211726 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c009690 con 0x7fb56415e3c0 2023-08-25T04:03:32.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb55affd640 1 -- 172.21.15.55:0/2772211726 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c00ca00 con 0x7fb56415e3c0 2023-08-25T04:03:32.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb55affd640 1 -- 172.21.15.55:0/2772211726 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c00cd70 con 0x7fb56415e3c0 2023-08-25T04:03:32.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb568b44640 1 -- 172.21.15.55:0/2772211726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5640c75f0 con 0x7fb56415e3c0 2023-08-25T04:03:32.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb568b44640 1 -- 172.21.15.55:0/2772211726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5640c7bb0 con 0x7fb56415e3c0 2023-08-25T04:03:32.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.343+0000 7fb568b44640 1 -- 172.21.15.55:0/2772211726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5640b5260 con 0x7fb56415e3c0 2023-08-25T04:03:32.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.347+0000 7fb55affd640 1 -- 172.21.15.55:0/2772211726 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb54c013470 con 0x7fb56415e3c0 2023-08-25T04:03:32.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.347+0000 7fb55affd640 1 --2- 172.21.15.55:0/2772211726 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb544065680 0x7fb544067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:32.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.347+0000 7fb55affd640 1 -- 172.21.15.55:0/2772211726 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb54c082ff0 con 0x7fb56415e3c0 2023-08-25T04:03:32.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.347+0000 7fb56259c640 1 --2- 172.21.15.55:0/2772211726 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb544065680 0x7fb544067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:32.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.347+0000 7fb56259c640 1 --2- 172.21.15.55:0/2772211726 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb544065680 0x7fb544067b40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb5540b2000 tx=0x7fb554009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:32.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.351+0000 7fb55affd640 1 -- 172.21.15.55:0/2772211726 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb54c050be0 con 0x7fb56415e3c0 2023-08-25T04:03:32.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.511+0000 7fb568b44640 1 -- 172.21.15.55:0/2772211726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb564073ec0 con 0x7fb56415e3c0 2023-08-25T04:03:32.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.511+0000 7fb55affd640 1 -- 172.21.15.55:0/2772211726 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb54c054200 con 0x7fb56415e3c0 2023-08-25T04:03:32.512 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:03:32.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.511+0000 7fb568b44640 1 -- 172.21.15.55:0/2772211726 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb544065680 msgr2=0x7fb544067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:32.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.511+0000 7fb568b44640 1 --2- 172.21.15.55:0/2772211726 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb544065680 0x7fb544067b40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb5540b2000 tx=0x7fb554009040 comp rx=0 tx=0).stop 2023-08-25T04:03:32.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.511+0000 7fb568b44640 1 -- 172.21.15.55:0/2772211726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb56415e3c0 msgr2=0x7fb5640cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:32.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.511+0000 7fb568b44640 1 --2- 172.21.15.55:0/2772211726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb56415e3c0 0x7fb5640cc260 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00e930 tx=0x7fb54c00edf0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.511+0000 7fb568b44640 1 -- 172.21.15.55:0/2772211726 shutdown_connections 2023-08-25T04:03:32.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.511+0000 7fb568b44640 1 --2- 172.21.15.55:0/2772211726 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fb544065680 0x7fb544067b40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.511+0000 7fb568b44640 1 --2- 172.21.15.55:0/2772211726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5641601f0 0x7fb56409fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.511+0000 7fb568b44640 1 --2- 172.21.15.55:0/2772211726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb56415e3c0 0x7fb5640cc260 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.511+0000 7fb568b44640 1 --2- 172.21.15.55:0/2772211726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5640d10c0 0x7fb5640c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.511+0000 7fb568b44640 1 -- 172.21.15.55:0/2772211726 >> 172.21.15.55:0/2772211726 conn(0x7fb5640d27d0 msgr2=0x7fb56406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:32.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.511+0000 7fb568b44640 1 -- 172.21.15.55:0/2772211726 shutdown_connections 2023-08-25T04:03:32.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.511+0000 7fb568b44640 1 -- 172.21.15.55:0/2772211726 wait complete. 2023-08-25T04:03:32.534 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:03:32.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.679+0000 7fd40cd59640 1 Processor -- start 2023-08-25T04:03:32.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.679+0000 7fd40cd59640 1 -- start start 2023-08-25T04:03:32.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.679+0000 7fd40cd59640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4081601f0 0x7fd40815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:32.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.679+0000 7fd40cd59640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080cd5a0 con 0x7fd40815e3c0 2023-08-25T04:03:32.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.679+0000 7fd40cd59640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080cd880 con 0x7fd4080d1290 2023-08-25T04:03:32.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.679+0000 7fd40cd59640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4080cdb60 con 0x7fd4081601f0 2023-08-25T04:03:32.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.679+0000 7fd40659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4081601f0 0x7fd40815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:32.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.679+0000 7fd40659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4081601f0 0x7fd40815d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33258/0 (socket says 172.21.15.55:33258) 2023-08-25T04:03:32.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.679+0000 7fd40659c640 1 -- 172.21.15.55:0/510755818 learned_addr learned my addr 172.21.15.55:0/510755818 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:32.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.683+0000 7fd40659c640 1 -- 172.21.15.55:0/510755818 >> v1:172.21.15.110:6789/0 conn(0x7fd4080d1290 legacy=0x7fd40815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:32.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.683+0000 7fd40659c640 1 -- 172.21.15.55:0/510755818 >> v1:172.21.15.55:6789/0 conn(0x7fd40815e3c0 legacy=0x7fd4080d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.683+0000 7fd40659c640 1 -- 172.21.15.55:0/510755818 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4080cde40 con 0x7fd4081601f0 2023-08-25T04:03:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.683+0000 7fd405d9b640 1 -- 172.21.15.55:0/510755818 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2903748161 0 0) 0x7fd4080cd5a0 con 0x7fd40815e3c0 2023-08-25T04:03:32.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.683+0000 7fd40659c640 1 --2- 172.21.15.55:0/510755818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4081601f0 0x7fd40815d430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8006fd0 tx=0x7fd3f801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b663c587c94aa6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:32.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.683+0000 7fd405d9b640 1 -- 172.21.15.55:0/510755818 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f80ac640 con 0x7fd4081601f0 2023-08-25T04:03:32.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.683+0000 7fd405d9b640 1 -- 172.21.15.55:0/510755818 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f80ac7a0 con 0x7fd4081601f0 2023-08-25T04:03:32.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.683+0000 7fd405d9b640 1 -- 172.21.15.55:0/510755818 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f80acb30 con 0x7fd4081601f0 2023-08-25T04:03:32.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.683+0000 7fd40cd59640 1 -- 172.21.15.55:0/510755818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4081601f0 msgr2=0x7fd40815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:32.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.683+0000 7fd40cd59640 1 --2- 172.21.15.55:0/510755818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4081601f0 0x7fd40815d430 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8006fd0 tx=0x7fd3f801c4b0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.683+0000 7fd40cd59640 1 -- 172.21.15.55:0/510755818 shutdown_connections 2023-08-25T04:03:32.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.683+0000 7fd40cd59640 1 --2- 172.21.15.55:0/510755818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4081601f0 0x7fd40815d430 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.683+0000 7fd40cd59640 1 -- 172.21.15.55:0/510755818 >> 172.21.15.55:0/510755818 conn(0x7fd4080d27d0 msgr2=0x7fd4080d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:32.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd40cd59640 1 -- 172.21.15.55:0/510755818 shutdown_connections 2023-08-25T04:03:32.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd40cd59640 1 -- 172.21.15.55:0/510755818 wait complete. 2023-08-25T04:03:32.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd40cd59640 1 Processor -- start 2023-08-25T04:03:32.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd40cd59640 1 -- start start 2023-08-25T04:03:32.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd40cd59640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4080d1290 0x7fd4081546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:32.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd40cd59640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd40815e3c0 0x7fd4080b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd40cd59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4081601f0 0x7fd408152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd40cd59640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd408155260 con 0x7fd4081601f0 2023-08-25T04:03:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd40cd59640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd408154ca0 con 0x7fd4080d1290 2023-08-25T04:03:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd40cd59640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd408154f80 con 0x7fd40815e3c0 2023-08-25T04:03:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4081601f0 0x7fd408152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd406d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4081601f0 0x7fd408152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33268/0 (socket says 172.21.15.55:33268) 2023-08-25T04:03:32.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd406d9d640 1 -- 172.21.15.55:0/4057124515 learned_addr learned my addr 172.21.15.55:0/4057124515 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd3fffff640 1 --2- 172.21.15.55:0/4057124515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd40815e3c0 0x7fd4080b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd40659c640 1 --2- 172.21.15.55:0/4057124515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4080d1290 0x7fd4081546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd406d9d640 1 -- 172.21.15.55:0/4057124515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd40815e3c0 msgr2=0x7fd4080b7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd406d9d640 1 --2- 172.21.15.55:0/4057124515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd40815e3c0 0x7fd4080b7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd406d9d640 1 -- 172.21.15.55:0/4057124515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4080d1290 msgr2=0x7fd4081546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd406d9d640 1 --2- 172.21.15.55:0/4057124515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4080d1290 0x7fd4081546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd406d9d640 1 -- 172.21.15.55:0/4057124515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f8009480 con 0x7fd4081601f0 2023-08-25T04:03:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd40659c640 1 --2- 172.21.15.55:0/4057124515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4080d1290 0x7fd4081546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd3fffff640 1 --2- 172.21.15.55:0/4057124515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd40815e3c0 0x7fd4080b7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd406d9d640 1 --2- 172.21.15.55:0/4057124515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4081601f0 0x7fd408152db0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd40000c780 tx=0x7fd40000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd3feffd640 1 -- 172.21.15.55:0/4057124515 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd400004b70 con 0x7fd4081601f0 2023-08-25T04:03:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd3feffd640 1 -- 172.21.15.55:0/4057124515 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40000ce90 con 0x7fd4081601f0 2023-08-25T04:03:32.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd3feffd640 1 -- 172.21.15.55:0/4057124515 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40000a850 con 0x7fd4081601f0 2023-08-25T04:03:32.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.687+0000 7fd40cd59640 1 -- 172.21.15.55:0/4057124515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4080ce7c0 con 0x7fd4081601f0 2023-08-25T04:03:32.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.691+0000 7fd40cd59640 1 -- 172.21.15.55:0/4057124515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4080b7410 con 0x7fd4081601f0 2023-08-25T04:03:32.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.691+0000 7fd40cd59640 1 -- 172.21.15.55:0/4057124515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4080b5260 con 0x7fd4081601f0 2023-08-25T04:03:32.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.691+0000 7fd3feffd640 1 -- 172.21.15.55:0/4057124515 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd40000a9b0 con 0x7fd4081601f0 2023-08-25T04:03:32.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.691+0000 7fd3feffd640 1 --2- 172.21.15.55:0/4057124515 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd3e80656b0 0x7fd3e8067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:32.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.691+0000 7fd3feffd640 1 -- 172.21.15.55:0/4057124515 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd400082f70 con 0x7fd4081601f0 2023-08-25T04:03:32.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.691+0000 7fd40659c640 1 --2- 172.21.15.55:0/4057124515 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd3e80656b0 0x7fd3e8067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:32.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.695+0000 7fd40659c640 1 --2- 172.21.15.55:0/4057124515 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd3e80656b0 0x7fd3e8067b70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80ae000 tx=0x7fd3f80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:32.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.695+0000 7fd3feffd640 1 -- 172.21.15.55:0/4057124515 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd4000b3d90 con 0x7fd4081601f0 2023-08-25T04:03:32.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.851+0000 7fd40cd59640 1 -- 172.21.15.55:0/4057124515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd4080b7630 con 0x7fd4081601f0 2023-08-25T04:03:32.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.855+0000 7fd3feffd640 1 -- 172.21.15.55:0/4057124515 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd4000544c0 con 0x7fd4081601f0 2023-08-25T04:03:32.856 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:03:32.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.855+0000 7fd40cd59640 1 -- 172.21.15.55:0/4057124515 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd3e80656b0 msgr2=0x7fd3e8067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:32.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.855+0000 7fd40cd59640 1 --2- 172.21.15.55:0/4057124515 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd3e80656b0 0x7fd3e8067b70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80ae000 tx=0x7fd3f80a7000 comp rx=0 tx=0).stop 2023-08-25T04:03:32.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.855+0000 7fd40cd59640 1 -- 172.21.15.55:0/4057124515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4081601f0 msgr2=0x7fd408152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:32.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.855+0000 7fd40cd59640 1 --2- 172.21.15.55:0/4057124515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4081601f0 0x7fd408152db0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd40000c780 tx=0x7fd40000cc40 comp rx=0 tx=0).stop 2023-08-25T04:03:32.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.855+0000 7fd40cd59640 1 -- 172.21.15.55:0/4057124515 shutdown_connections 2023-08-25T04:03:32.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.855+0000 7fd40cd59640 1 --2- 172.21.15.55:0/4057124515 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd3e80656b0 0x7fd3e8067b70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.855+0000 7fd40cd59640 1 --2- 172.21.15.55:0/4057124515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4081601f0 0x7fd408152db0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.855+0000 7fd40cd59640 1 --2- 172.21.15.55:0/4057124515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd40815e3c0 0x7fd4080b7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.855+0000 7fd40cd59640 1 --2- 172.21.15.55:0/4057124515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4080d1290 0x7fd4081546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:32.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.855+0000 7fd40cd59640 1 -- 172.21.15.55:0/4057124515 >> 172.21.15.55:0/4057124515 conn(0x7fd4080d27d0 msgr2=0x7fd40806bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:32.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.855+0000 7fd40cd59640 1 -- 172.21.15.55:0/4057124515 shutdown_connections 2023-08-25T04:03:32.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:32.855+0000 7fd40cd59640 1 -- 172.21.15.55:0/4057124515 wait complete. 2023-08-25T04:03:32.876 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:03:33.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f7008bd2640 1 Processor -- start 2023-08-25T04:03:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f7008bd2640 1 -- start start 2023-08-25T04:03:33.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f7008bd2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f700415a7f0 0x7f700409bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:33.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f7008bd2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70040c9830 0x7f7004070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:33.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f7008bd2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f700406c020 0x7f7004071440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:33.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f7008bd2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7004071980 con 0x7f700415a7f0 2023-08-25T04:03:33.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f7008bd2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f700415abd0 con 0x7f700406c020 2023-08-25T04:03:33.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f7008bd2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70040c8ab0 con 0x7f70040c9830 2023-08-25T04:03:33.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f700259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f700415a7f0 0x7f700409bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:33.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f700259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f700415a7f0 0x7f700409bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33282/0 (socket says 172.21.15.55:33282) 2023-08-25T04:03:33.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f700259c640 1 -- 172.21.15.55:0/588607056 learned_addr learned my addr 172.21.15.55:0/588607056 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:33.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f7002d9d640 1 --2- 172.21.15.55:0/588607056 >> v2:172.21.15.110:3300/0 conn(0x7f700406c020 0x7f7004071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:33.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f6ff9d9b640 1 --2- 172.21.15.55:0/588607056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70040c9830 0x7f7004070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f700259c640 1 -- 172.21.15.55:0/588607056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70040c9830 msgr2=0x7f7004070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f700259c640 1 --2- 172.21.15.55:0/588607056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70040c9830 0x7f7004070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f700259c640 1 -- 172.21.15.55:0/588607056 >> v2:172.21.15.110:3300/0 conn(0x7f700406c020 msgr2=0x7f7004071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f700259c640 1 --2- 172.21.15.55:0/588607056 >> v2:172.21.15.110:3300/0 conn(0x7f700406c020 0x7f7004071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f700259c640 1 -- 172.21.15.55:0/588607056 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70040c8d50 con 0x7f700415a7f0 2023-08-25T04:03:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f7002d9d640 1 --2- 172.21.15.55:0/588607056 >> v2:172.21.15.110:3300/0 conn(0x7f700406c020 0x7f7004071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.023+0000 7f6ff9d9b640 1 --2- 172.21.15.55:0/588607056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70040c9830 0x7f7004070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:33.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.027+0000 7f700259c640 1 --2- 172.21.15.55:0/588607056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f700415a7f0 0x7f700409bde0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f70040c9e50 tx=0x7f6ff401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d02f49266030fda server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:33.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.027+0000 7f7001d9b640 1 -- 172.21.15.55:0/588607056 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff40aa5f0 con 0x7f700415a7f0 2023-08-25T04:03:33.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.027+0000 7f7001d9b640 1 -- 172.21.15.55:0/588607056 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff40aa750 con 0x7f700415a7f0 2023-08-25T04:03:33.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.027+0000 7f7001d9b640 1 -- 172.21.15.55:0/588607056 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff40aaae0 con 0x7f700415a7f0 2023-08-25T04:03:33.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.027+0000 7f7008bd2640 1 -- 172.21.15.55:0/588607056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f700415a7f0 msgr2=0x7f700409bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:33.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.027+0000 7f7008bd2640 1 --2- 172.21.15.55:0/588607056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f700415a7f0 0x7f700409bde0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f70040c9e50 tx=0x7f6ff401c4d0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.027+0000 7f7008bd2640 1 -- 172.21.15.55:0/588607056 shutdown_connections 2023-08-25T04:03:33.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.027+0000 7f7008bd2640 1 --2- 172.21.15.55:0/588607056 >> v2:172.21.15.110:3300/0 conn(0x7f700406c020 0x7f7004071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.027+0000 7f7008bd2640 1 --2- 172.21.15.55:0/588607056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70040c9830 0x7f7004070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.027+0000 7f7008bd2640 1 --2- 172.21.15.55:0/588607056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f700415a7f0 0x7f700409bde0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.027+0000 7f7008bd2640 1 -- 172.21.15.55:0/588607056 >> 172.21.15.55:0/588607056 conn(0x7f7004069900 msgr2=0x7f7004069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:33.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.027+0000 7f7008bd2640 1 -- 172.21.15.55:0/588607056 shutdown_connections 2023-08-25T04:03:33.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.027+0000 7f7008bd2640 1 -- 172.21.15.55:0/588607056 wait complete. 2023-08-25T04:03:33.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f7008bd2640 1 Processor -- start 2023-08-25T04:03:33.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f7008bd2640 1 -- start start 2023-08-25T04:03:33.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f7008bd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f700406c020 0x7f70040ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:33.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f7008bd2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70040c9830 0x7f7004159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:33.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f7008bd2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f700415a7f0 0x7f7004159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:33.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f7008bd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70040c5530 con 0x7f700406c020 2023-08-25T04:03:33.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f7008bd2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70040c5810 con 0x7f70040c9830 2023-08-25T04:03:33.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f7008bd2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70040c5af0 con 0x7f700415a7f0 2023-08-25T04:03:33.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f700259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f700406c020 0x7f70040ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:33.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f700259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f700406c020 0x7f70040ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33294/0 (socket says 172.21.15.55:33294) 2023-08-25T04:03:33.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f700259c640 1 -- 172.21.15.55:0/895628078 learned_addr learned my addr 172.21.15.55:0/895628078 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:33.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f7002d9d640 1 --2- 172.21.15.55:0/895628078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f700415a7f0 0x7f7004159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:33.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f6ff9d9b640 1 --2- 172.21.15.55:0/895628078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70040c9830 0x7f7004159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:33.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f700259c640 1 -- 172.21.15.55:0/895628078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f700415a7f0 msgr2=0x7f7004159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:33.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f700259c640 1 --2- 172.21.15.55:0/895628078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f700415a7f0 0x7f7004159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f700259c640 1 -- 172.21.15.55:0/895628078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70040c9830 msgr2=0x7f7004159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:33.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f700259c640 1 --2- 172.21.15.55:0/895628078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70040c9830 0x7f7004159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f700259c640 1 -- 172.21.15.55:0/895628078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff4009480 con 0x7f700406c020 2023-08-25T04:03:33.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f6ff9d9b640 1 --2- 172.21.15.55:0/895628078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70040c9830 0x7f7004159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:33.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f700259c640 1 --2- 172.21.15.55:0/895628078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f700406c020 0x7f70040ccb50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6ff401ab80 tx=0x7f6ff4019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:33.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f6ffb7fe640 1 -- 172.21.15.55:0/895628078 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff40bb070 con 0x7f700406c020 2023-08-25T04:03:33.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f6ffb7fe640 1 -- 172.21.15.55:0/895628078 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff40aaad0 con 0x7f700406c020 2023-08-25T04:03:33.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f6ffb7fe640 1 -- 172.21.15.55:0/895628078 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff40aa5f0 con 0x7f700406c020 2023-08-25T04:03:33.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f7008bd2640 1 -- 172.21.15.55:0/895628078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70040c5dd0 con 0x7f700406c020 2023-08-25T04:03:33.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f7008bd2640 1 -- 172.21.15.55:0/895628078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70040cd090 con 0x7f700406c020 2023-08-25T04:03:33.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.031+0000 7f7008bd2640 1 -- 172.21.15.55:0/895628078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700406d5b0 con 0x7f700406c020 2023-08-25T04:03:33.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.035+0000 7f6ffb7fe640 1 -- 172.21.15.55:0/895628078 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6ff4003620 con 0x7f700406c020 2023-08-25T04:03:33.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.035+0000 7f6ffb7fe640 1 --2- 172.21.15.55:0/895628078 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6fe40656b0 0x7f6fe4067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:33.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.035+0000 7f6ffb7fe640 1 -- 172.21.15.55:0/895628078 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ff40a7070 con 0x7f700406c020 2023-08-25T04:03:33.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.035+0000 7f6ff9d9b640 1 --2- 172.21.15.55:0/895628078 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6fe40656b0 0x7f6fe4067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:33.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.035+0000 7f6ff9d9b640 1 --2- 172.21.15.55:0/895628078 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6fe40656b0 0x7f6fe4067b70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f70040afde0 tx=0x7f6fec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:33.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.039+0000 7f6ffb7fe640 1 -- 172.21.15.55:0/895628078 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6ff40ea880 con 0x7f700406c020 2023-08-25T04:03:33.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.195+0000 7f7008bd2640 1 -- 172.21.15.55:0/895628078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7004073ec0 con 0x7f700406c020 2023-08-25T04:03:33.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.195+0000 7f6ffb7fe640 1 -- 172.21.15.55:0/895628078 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ff40edea0 con 0x7f700406c020 2023-08-25T04:03:33.196 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:03:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.195+0000 7f7008bd2640 1 -- 172.21.15.55:0/895628078 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6fe40656b0 msgr2=0x7f6fe4067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.195+0000 7f7008bd2640 1 --2- 172.21.15.55:0/895628078 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6fe40656b0 0x7f6fe4067b70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f70040afde0 tx=0x7f6fec008040 comp rx=0 tx=0).stop 2023-08-25T04:03:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.195+0000 7f7008bd2640 1 -- 172.21.15.55:0/895628078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f700406c020 msgr2=0x7f70040ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:33.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.195+0000 7f7008bd2640 1 --2- 172.21.15.55:0/895628078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f700406c020 0x7f70040ccb50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6ff401ab80 tx=0x7f6ff4019270 comp rx=0 tx=0).stop 2023-08-25T04:03:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.195+0000 7f7008bd2640 1 -- 172.21.15.55:0/895628078 shutdown_connections 2023-08-25T04:03:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.195+0000 7f7008bd2640 1 --2- 172.21.15.55:0/895628078 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6fe40656b0 0x7f6fe4067b70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.195+0000 7f7008bd2640 1 --2- 172.21.15.55:0/895628078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f700415a7f0 0x7f7004159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.195+0000 7f7008bd2640 1 --2- 172.21.15.55:0/895628078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70040c9830 0x7f7004159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.195+0000 7f7008bd2640 1 --2- 172.21.15.55:0/895628078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f700406c020 0x7f70040ccb50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.195+0000 7f7008bd2640 1 -- 172.21.15.55:0/895628078 >> 172.21.15.55:0/895628078 conn(0x7f7004069900 msgr2=0x7f70040ac4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.195+0000 7f7008bd2640 1 -- 172.21.15.55:0/895628078 shutdown_connections 2023-08-25T04:03:33.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.195+0000 7f7008bd2640 1 -- 172.21.15.55:0/895628078 wait complete. 2023-08-25T04:03:33.217 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-25T04:03:33.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.363+0000 7f91eda0b640 1 Processor -- start 2023-08-25T04:03:33.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.363+0000 7f91eda0b640 1 -- start start 2023-08-25T04:03:33.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.363+0000 7f91eda0b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91e815c8a0 0x7f91e80b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:33.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.363+0000 7f91eda0b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f91e80d1270 0x7f91e80b1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:33.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.363+0000 7f91eda0b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e80d0690 con 0x7f91e80cd190 2023-08-25T04:03:33.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.363+0000 7f91eda0b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e80cd6c0 con 0x7f91e80d1270 2023-08-25T04:03:33.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.363+0000 7f91eda0b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80cd9a0 con 0x7f91e815c8a0 2023-08-25T04:03:33.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.367+0000 7f91e7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f91e80cd190 0x7f91e80d0b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45046/0 (socket says 172.21.15.55:45046) 2023-08-25T04:03:33.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.367+0000 7f91e7fff640 1 -- 172.21.15.55:0/3230259477 learned_addr learned my addr 172.21.15.55:0/3230259477 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:33.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.367+0000 7f91eca09640 1 --2- 172.21.15.55:0/3230259477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91e815c8a0 0x7f91e80b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:33.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.367+0000 7f91ed20a640 1 --2- 172.21.15.55:0/3230259477 >> v2:172.21.15.110:3300/0 conn(0x7f91e80d1270 0x7f91e80b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.367+0000 7f91e77fe640 1 -- 172.21.15.55:0/3230259477 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246729616 0 0) 0x7f91e80d0690 con 0x7f91e80cd190 2023-08-25T04:03:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.367+0000 7f91e77fe640 1 -- 172.21.15.55:0/3230259477 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91d8003530 con 0x7f91e80cd190 2023-08-25T04:03:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.367+0000 7f91eca09640 1 -- 172.21.15.55:0/3230259477 >> v2:172.21.15.110:3300/0 conn(0x7f91e80d1270 msgr2=0x7f91e80b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.367+0000 7f91eca09640 1 --2- 172.21.15.55:0/3230259477 >> v2:172.21.15.110:3300/0 conn(0x7f91e80d1270 0x7f91e80b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.367+0000 7f91eca09640 1 -- 172.21.15.55:0/3230259477 >> v1:172.21.15.55:6789/0 conn(0x7f91e80cd190 legacy=0x7f91e80d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.367+0000 7f91eca09640 1 -- 172.21.15.55:0/3230259477 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e80cdc80 con 0x7f91e815c8a0 2023-08-25T04:03:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.367+0000 7f91ed20a640 1 --2- 172.21.15.55:0/3230259477 >> v2:172.21.15.110:3300/0 conn(0x7f91e80d1270 0x7f91e80b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:33.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.367+0000 7f91eca09640 1 --2- 172.21.15.55:0/3230259477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91e815c8a0 0x7f91e80b4aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0097a0 tx=0x7f91dc01c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fac9c70b3f323f35 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:33.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.367+0000 7f91e77fe640 1 -- 172.21.15.55:0/3230259477 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0ab5f0 con 0x7f91e815c8a0 2023-08-25T04:03:33.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.367+0000 7f91e77fe640 1 -- 172.21.15.55:0/3230259477 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91dc0ab750 con 0x7f91e815c8a0 2023-08-25T04:03:33.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91e77fe640 1 -- 172.21.15.55:0/3230259477 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0abac0 con 0x7f91e815c8a0 2023-08-25T04:03:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91eda0b640 1 -- 172.21.15.55:0/3230259477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91e815c8a0 msgr2=0x7f91e80b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91eda0b640 1 --2- 172.21.15.55:0/3230259477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91e815c8a0 0x7f91e80b4aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0097a0 tx=0x7f91dc01c430 comp rx=0 tx=0).stop 2023-08-25T04:03:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91eda0b640 1 -- 172.21.15.55:0/3230259477 shutdown_connections 2023-08-25T04:03:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91eda0b640 1 --2- 172.21.15.55:0/3230259477 >> v2:172.21.15.110:3300/0 conn(0x7f91e80d1270 0x7f91e80b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91eda0b640 1 --2- 172.21.15.55:0/3230259477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91e815c8a0 0x7f91e80b4aa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91eda0b640 1 -- 172.21.15.55:0/3230259477 >> 172.21.15.55:0/3230259477 conn(0x7f91e80d2610 msgr2=0x7f91e80d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91eda0b640 1 -- 172.21.15.55:0/3230259477 shutdown_connections 2023-08-25T04:03:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91eda0b640 1 -- 172.21.15.55:0/3230259477 wait complete. 2023-08-25T04:03:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91eda0b640 1 Processor -- start 2023-08-25T04:03:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91eda0b640 1 -- start start 2023-08-25T04:03:33.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91eda0b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91e80cd190 0x7f91e815af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:33.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91eda0b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91e80d1270 0x7f91e8159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:33.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91eda0b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91e815c8a0 0x7f91e8153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:33.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91eda0b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e815a440 con 0x7f91e815c8a0 2023-08-25T04:03:33.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91eda0b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e815a630 con 0x7f91e80d1270 2023-08-25T04:03:33.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91eda0b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e815daa0 con 0x7f91e80cd190 2023-08-25T04:03:33.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91ed20a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91e815c8a0 0x7f91e8153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:33.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91eca09640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91e80cd190 0x7f91e815af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:33.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91ed20a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91e815c8a0 0x7f91e8153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33308/0 (socket says 172.21.15.55:33308) 2023-08-25T04:03:33.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91ed20a640 1 -- 172.21.15.55:0/1342882854 learned_addr learned my addr 172.21.15.55:0/1342882854 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:33.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.371+0000 7f91e7fff640 1 --2- 172.21.15.55:0/1342882854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91e80d1270 0x7f91e8159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:33.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.375+0000 7f91ed20a640 1 -- 172.21.15.55:0/1342882854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91e80cd190 msgr2=0x7f91e815af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:33.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.375+0000 7f91ed20a640 1 --2- 172.21.15.55:0/1342882854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91e80cd190 0x7f91e815af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.375+0000 7f91ed20a640 1 -- 172.21.15.55:0/1342882854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91e80d1270 msgr2=0x7f91e8159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.375+0000 7f91ed20a640 1 --2- 172.21.15.55:0/1342882854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91e80d1270 0x7f91e8159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.375+0000 7f91ed20a640 1 -- 172.21.15.55:0/1342882854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e0009a70 con 0x7f91e815c8a0 2023-08-25T04:03:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.375+0000 7f91ed20a640 1 --2- 172.21.15.55:0/1342882854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91e815c8a0 0x7f91e8153ab0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f91e000efb0 tx=0x7f91e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.375+0000 7f91e57fa640 1 -- 172.21.15.55:0/1342882854 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0009d50 con 0x7f91e815c8a0 2023-08-25T04:03:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.375+0000 7f91e57fa640 1 -- 172.21.15.55:0/1342882854 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e000f040 con 0x7f91e815c8a0 2023-08-25T04:03:33.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.375+0000 7f91eda0b640 1 -- 172.21.15.55:0/1342882854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91dc0093b0 con 0x7f91e815c8a0 2023-08-25T04:03:33.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.375+0000 7f91e57fa640 1 -- 172.21.15.55:0/1342882854 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e00146a0 con 0x7f91e815c8a0 2023-08-25T04:03:33.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.375+0000 7f91eda0b640 1 -- 172.21.15.55:0/1342882854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e815e060 con 0x7f91e815c8a0 2023-08-25T04:03:33.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.375+0000 7f91eda0b640 1 -- 172.21.15.55:0/1342882854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e8066d20 con 0x7f91e815c8a0 2023-08-25T04:03:33.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.375+0000 7f91e57fa640 1 -- 172.21.15.55:0/1342882854 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f91e0014820 con 0x7f91e815c8a0 2023-08-25T04:03:33.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.375+0000 7f91e57fa640 1 --2- 172.21.15.55:0/1342882854 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f91cc065680 0x7f91cc067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:33.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.375+0000 7f91e57fa640 1 -- 172.21.15.55:0/1342882854 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f91e0083c80 con 0x7f91e815c8a0 2023-08-25T04:03:33.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.375+0000 7f91eca09640 1 --2- 172.21.15.55:0/1342882854 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f91cc065680 0x7f91cc067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.379+0000 7f91eca09640 1 --2- 172.21.15.55:0/1342882854 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f91cc065680 0x7f91cc067b40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0af000 tx=0x7f91dc0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:33.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.379+0000 7f91e57fa640 1 -- 172.21.15.55:0/1342882854 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f91e0055280 con 0x7f91e815c8a0 2023-08-25T04:03:33.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.543+0000 7f91eda0b640 1 -- 172.21.15.55:0/1342882854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f91e80cea90 con 0x7f91e815c8a0 2023-08-25T04:03:33.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.547+0000 7f91e57fa640 1 -- 172.21.15.55:0/1342882854 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f91e00180c0 con 0x7f91e815c8a0 2023-08-25T04:03:33.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.547+0000 7f91eda0b640 1 -- 172.21.15.55:0/1342882854 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f91cc065680 msgr2=0x7f91cc067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:33.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.547+0000 7f91eda0b640 1 --2- 172.21.15.55:0/1342882854 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f91cc065680 0x7f91cc067b40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f91dc0af000 tx=0x7f91dc0a7000 comp rx=0 tx=0).stop 2023-08-25T04:03:33.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.547+0000 7f91eda0b640 1 -- 172.21.15.55:0/1342882854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91e815c8a0 msgr2=0x7f91e8153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:33.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.547+0000 7f91eda0b640 1 --2- 172.21.15.55:0/1342882854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91e815c8a0 0x7f91e8153ab0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f91e000efb0 tx=0x7f91e000c490 comp rx=0 tx=0).stop 2023-08-25T04:03:33.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.547+0000 7f91eda0b640 1 -- 172.21.15.55:0/1342882854 shutdown_connections 2023-08-25T04:03:33.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.547+0000 7f91eda0b640 1 --2- 172.21.15.55:0/1342882854 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f91cc065680 0x7f91cc067b40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.547+0000 7f91eda0b640 1 --2- 172.21.15.55:0/1342882854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91e815c8a0 0x7f91e8153ab0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.547+0000 7f91eda0b640 1 --2- 172.21.15.55:0/1342882854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91e80d1270 0x7f91e8159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.547+0000 7f91eda0b640 1 --2- 172.21.15.55:0/1342882854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91e80cd190 0x7f91e815af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.547+0000 7f91eda0b640 1 -- 172.21.15.55:0/1342882854 >> 172.21.15.55:0/1342882854 conn(0x7f91e80d2610 msgr2=0x7f91e815bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.547+0000 7f91eda0b640 1 -- 172.21.15.55:0/1342882854 shutdown_connections 2023-08-25T04:03:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.547+0000 7f91eda0b640 1 -- 172.21.15.55:0/1342882854 wait complete. 2023-08-25T04:03:33.570 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T04:03:33.571 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:03:33.638 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:03:33.702 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T04:03:33.702 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:03:33.703 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:03:33.712 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:03:33.713 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:03:33.763 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:03:33.764 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:03:33.816 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.999+0000 7f300b46d640 1 Processor -- start 2023-08-25T04:03:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.999+0000 7f300b46d640 1 -- start start 2023-08-25T04:03:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.999+0000 7f300b46d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f30040c1a80 0x7f30040b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.999+0000 7f300b46d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f30040cddf0 0x7f300406bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.999+0000 7f300b46d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30040cc510 con 0x7f3004164410 2023-08-25T04:03:34.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.999+0000 7f300b46d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30041647f0 con 0x7f30040cddf0 2023-08-25T04:03:34.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.999+0000 7f300b46d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30040cc9b0 con 0x7f30040c1a80 2023-08-25T04:03:34.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:33.999+0000 7f3009a0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f30040cddf0 0x7f300406bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.003+0000 7f3009a0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f30040cddf0 0x7f300406bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33312/0 (socket says 172.21.15.55:33312) 2023-08-25T04:03:34.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.003+0000 7f3009a0a640 1 -- 172.21.15.55:0/887209060 learned_addr learned my addr 172.21.15.55:0/887209060 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:34.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.003+0000 7f3008a08640 1 --2- 172.21.15.55:0/887209060 >> v2:172.21.15.110:3300/0 conn(0x7f30040c1a80 0x7f30040b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.003+0000 7f3009a0a640 1 -- 172.21.15.55:0/887209060 >> v2:172.21.15.110:3300/0 conn(0x7f30040c1a80 msgr2=0x7f30040b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.003+0000 7f3009a0a640 1 --2- 172.21.15.55:0/887209060 >> v2:172.21.15.110:3300/0 conn(0x7f30040c1a80 0x7f30040b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.003+0000 7f3009a0a640 1 -- 172.21.15.55:0/887209060 >> v1:172.21.15.110:6789/0 conn(0x7f3004164410 legacy=0x7f30040c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.003+0000 7f3009a0a640 1 -- 172.21.15.55:0/887209060 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30040ccc90 con 0x7f30040cddf0 2023-08-25T04:03:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.003+0000 7f3009a0a640 1 --2- 172.21.15.55:0/887209060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30040cddf0 0x7f300406bb40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f30040cbe80 tx=0x7f2ffc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebbfeeb6dca669db server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.003+0000 7f2ffbfff640 1 -- 172.21.15.55:0/887209060 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc0a5670 con 0x7f30040cddf0 2023-08-25T04:03:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.003+0000 7f2ffbfff640 1 -- 172.21.15.55:0/887209060 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ffc0a57d0 con 0x7f30040cddf0 2023-08-25T04:03:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.003+0000 7f2ffbfff640 1 -- 172.21.15.55:0/887209060 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc0a5b60 con 0x7f30040cddf0 2023-08-25T04:03:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f300b46d640 1 -- 172.21.15.55:0/887209060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30040cddf0 msgr2=0x7f300406bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f300b46d640 1 --2- 172.21.15.55:0/887209060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30040cddf0 0x7f300406bb40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f30040cbe80 tx=0x7f2ffc01c9d0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f300b46d640 1 -- 172.21.15.55:0/887209060 shutdown_connections 2023-08-25T04:03:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f300b46d640 1 --2- 172.21.15.55:0/887209060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30040cddf0 0x7f300406bb40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f300b46d640 1 --2- 172.21.15.55:0/887209060 >> v2:172.21.15.110:3300/0 conn(0x7f30040c1a80 0x7f30040b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f300b46d640 1 -- 172.21.15.55:0/887209060 >> 172.21.15.55:0/887209060 conn(0x7f3004069d00 msgr2=0x7f300406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f300b46d640 1 -- 172.21.15.55:0/887209060 shutdown_connections 2023-08-25T04:03:34.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f300b46d640 1 -- 172.21.15.55:0/887209060 wait complete. 2023-08-25T04:03:34.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f300b46d640 1 Processor -- start 2023-08-25T04:03:34.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f300b46d640 1 -- start start 2023-08-25T04:03:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f300b46d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30040c1a80 0x7f300415afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f300b46d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30040cddf0 0x7f3004162790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f300b46d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3004164410 0x7f3004162cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f300b46d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30040af080 con 0x7f30040cddf0 2023-08-25T04:03:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f300b46d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30040ae1b0 con 0x7f3004164410 2023-08-25T04:03:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f300b46d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30040ae400 con 0x7f30040c1a80 2023-08-25T04:03:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f3008a08640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30040cddf0 0x7f3004162790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f3008a08640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30040cddf0 0x7f3004162790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33326/0 (socket says 172.21.15.55:33326) 2023-08-25T04:03:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f3008a08640 1 -- 172.21.15.55:0/170938296 learned_addr learned my addr 172.21.15.55:0/170938296 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f3009a0a640 1 --2- 172.21.15.55:0/170938296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3004164410 0x7f3004162cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f3009209640 1 --2- 172.21.15.55:0/170938296 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30040c1a80 0x7f300415afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f3008a08640 1 -- 172.21.15.55:0/170938296 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30040c1a80 msgr2=0x7f300415afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f3008a08640 1 --2- 172.21.15.55:0/170938296 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30040c1a80 0x7f300415afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f3008a08640 1 -- 172.21.15.55:0/170938296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3004164410 msgr2=0x7f3004162cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f3008a08640 1 --2- 172.21.15.55:0/170938296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3004164410 0x7f3004162cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.007+0000 7f3008a08640 1 -- 172.21.15.55:0/170938296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc009b30 con 0x7f30040cddf0 2023-08-25T04:03:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.011+0000 7f3008a08640 1 --2- 172.21.15.55:0/170938296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30040cddf0 0x7f3004162790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400d800 tx=0x7f2ff400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.011+0000 7f2ff9ffb640 1 -- 172.21.15.55:0/170938296 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff400b6c0 con 0x7f30040cddf0 2023-08-25T04:03:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.011+0000 7f2ff9ffb640 1 -- 172.21.15.55:0/170938296 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff400b820 con 0x7f30040cddf0 2023-08-25T04:03:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.011+0000 7f2ff9ffb640 1 -- 172.21.15.55:0/170938296 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff400bb90 con 0x7f30040cddf0 2023-08-25T04:03:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.011+0000 7f300b46d640 1 -- 172.21.15.55:0/170938296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30040ae6e0 con 0x7f30040cddf0 2023-08-25T04:03:34.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.011+0000 7f300b46d640 1 -- 172.21.15.55:0/170938296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30040aeca0 con 0x7f30040cddf0 2023-08-25T04:03:34.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.011+0000 7f300b46d640 1 -- 172.21.15.55:0/170938296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300404dbe0 con 0x7f30040cddf0 2023-08-25T04:03:34.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.011+0000 7f2ff9ffb640 1 -- 172.21.15.55:0/170938296 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2ff400bcf0 con 0x7f30040cddf0 2023-08-25T04:03:34.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.011+0000 7f2ff9ffb640 1 --2- 172.21.15.55:0/170938296 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2fe8065680 0x7f2fe8067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.011+0000 7f2ff9ffb640 1 -- 172.21.15.55:0/170938296 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ff40832e0 con 0x7f30040cddf0 2023-08-25T04:03:34.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.011+0000 7f3009209640 1 --2- 172.21.15.55:0/170938296 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2fe8065680 0x7f2fe8067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.015+0000 7f3009209640 1 --2- 172.21.15.55:0/170938296 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2fe8065680 0x7f2fe8067b40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f30040c88c0 tx=0x7f3000009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:34.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.015+0000 7f2ff9ffb640 1 -- 172.21.15.55:0/170938296 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2ff4054840 con 0x7f30040cddf0 2023-08-25T04:03:34.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.175+0000 7f300b46d640 1 -- 172.21.15.55:0/170938296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30040c1780 con 0x7f30040cddf0 2023-08-25T04:03:34.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.175+0000 7f2ff9ffb640 1 -- 172.21.15.55:0/170938296 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18291 (secure 0 0 0) 0x7f2ff40543d0 con 0x7f30040cddf0 2023-08-25T04:03:34.179 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:34.179 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:02.329010+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:34.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.179+0000 7f300b46d640 1 -- 172.21.15.55:0/170938296 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2fe8065680 msgr2=0x7f2fe8067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:34.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.179+0000 7f300b46d640 1 --2- 172.21.15.55:0/170938296 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2fe8065680 0x7f2fe8067b40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f30040c88c0 tx=0x7f3000009040 comp rx=0 tx=0).stop 2023-08-25T04:03:34.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.179+0000 7f300b46d640 1 -- 172.21.15.55:0/170938296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30040cddf0 msgr2=0x7f3004162790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:34.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.179+0000 7f300b46d640 1 --2- 172.21.15.55:0/170938296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30040cddf0 0x7f3004162790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2ff400d800 tx=0x7f2ff400dcc0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.179+0000 7f300b46d640 1 -- 172.21.15.55:0/170938296 shutdown_connections 2023-08-25T04:03:34.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.179+0000 7f300b46d640 1 --2- 172.21.15.55:0/170938296 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2fe8065680 0x7f2fe8067b40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.179+0000 7f300b46d640 1 --2- 172.21.15.55:0/170938296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3004164410 0x7f3004162cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.179+0000 7f300b46d640 1 --2- 172.21.15.55:0/170938296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30040cddf0 0x7f3004162790 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.179+0000 7f300b46d640 1 --2- 172.21.15.55:0/170938296 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30040c1a80 0x7f300415afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.179+0000 7f300b46d640 1 -- 172.21.15.55:0/170938296 >> 172.21.15.55:0/170938296 conn(0x7f3004069d00 msgr2=0x7f3004163740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:34.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.179+0000 7f300b46d640 1 -- 172.21.15.55:0/170938296 shutdown_connections 2023-08-25T04:03:34.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.179+0000 7f300b46d640 1 -- 172.21.15.55:0/170938296 wait complete. 2023-08-25T04:03:34.201 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:02:58.890533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:03:00.093976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:03:34.202 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:03:34.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53f8e6d640 1 Processor -- start 2023-08-25T04:03:34.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53f8e6d640 1 -- start start 2023-08-25T04:03:34.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53f8e6d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53f40cb020 0x7f53f40c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53f8e6d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53f40cdd50 0x7f53f40cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53f8e6d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f53f406c720 0x7f53f406cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53f8e6d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f406d0d0 con 0x7f53f40cb020 2023-08-25T04:03:34.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53f8e6d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f40cbca0 con 0x7f53f406c720 2023-08-25T04:03:34.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53f8e6d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f40c9470 con 0x7f53f40cdd50 2023-08-25T04:03:34.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53f259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53f40cb020 0x7f53f40c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53f259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53f40cb020 0x7f53f40c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33340/0 (socket says 172.21.15.55:33340) 2023-08-25T04:03:34.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53f259c640 1 -- 172.21.15.55:0/3608347897 learned_addr learned my addr 172.21.15.55:0/3608347897 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:34.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53e9d9b640 1 --2- 172.21.15.55:0/3608347897 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53f40cdd50 0x7f53f40cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53f2d9d640 1 --2- 172.21.15.55:0/3608347897 >> v2:172.21.15.110:3300/0 conn(0x7f53f406c720 0x7f53f406cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53f259c640 1 -- 172.21.15.55:0/3608347897 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53f40cdd50 msgr2=0x7f53f40cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:34.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53f259c640 1 --2- 172.21.15.55:0/3608347897 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53f40cdd50 0x7f53f40cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53f259c640 1 -- 172.21.15.55:0/3608347897 >> v2:172.21.15.110:3300/0 conn(0x7f53f406c720 msgr2=0x7f53f406cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:34.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53f259c640 1 --2- 172.21.15.55:0/3608347897 >> v2:172.21.15.110:3300/0 conn(0x7f53f406c720 0x7f53f406cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53f259c640 1 -- 172.21.15.55:0/3608347897 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f40ce1e0 con 0x7f53f40cb020 2023-08-25T04:03:34.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.347+0000 7f53f2d9d640 1 --2- 172.21.15.55:0/3608347897 >> v2:172.21.15.110:3300/0 conn(0x7f53f406c720 0x7f53f406cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:34.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.351+0000 7f53f259c640 1 --2- 172.21.15.55:0/3608347897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f40cb020 0x7f53f40c9900 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f53f40c5400 tx=0x7f53e401e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f465b98db35f19e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.351+0000 7f53f1d9b640 1 -- 172.21.15.55:0/3608347897 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e40ab400 con 0x7f53f40cb020 2023-08-25T04:03:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.351+0000 7f53f1d9b640 1 -- 172.21.15.55:0/3608347897 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e40ab560 con 0x7f53f40cb020 2023-08-25T04:03:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.351+0000 7f53f1d9b640 1 -- 172.21.15.55:0/3608347897 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e40ab8f0 con 0x7f53f40cb020 2023-08-25T04:03:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.351+0000 7f53f8e6d640 1 -- 172.21.15.55:0/3608347897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f40cb020 msgr2=0x7f53f40c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.351+0000 7f53f8e6d640 1 --2- 172.21.15.55:0/3608347897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f40cb020 0x7f53f40c9900 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f53f40c5400 tx=0x7f53e401e680 comp rx=0 tx=0).stop 2023-08-25T04:03:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.351+0000 7f53f8e6d640 1 -- 172.21.15.55:0/3608347897 shutdown_connections 2023-08-25T04:03:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.351+0000 7f53f8e6d640 1 --2- 172.21.15.55:0/3608347897 >> v2:172.21.15.110:3300/0 conn(0x7f53f406c720 0x7f53f406cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.351+0000 7f53f8e6d640 1 --2- 172.21.15.55:0/3608347897 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53f40cdd50 0x7f53f40cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.351+0000 7f53f8e6d640 1 --2- 172.21.15.55:0/3608347897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f40cb020 0x7f53f40c9900 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.351+0000 7f53f8e6d640 1 -- 172.21.15.55:0/3608347897 >> 172.21.15.55:0/3608347897 conn(0x7f53f4069900 msgr2=0x7f53f4069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:34.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.351+0000 7f53f8e6d640 1 -- 172.21.15.55:0/3608347897 shutdown_connections 2023-08-25T04:03:34.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.351+0000 7f53f8e6d640 1 -- 172.21.15.55:0/3608347897 wait complete. 2023-08-25T04:03:34.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53f8e6d640 1 Processor -- start 2023-08-25T04:03:34.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53f8e6d640 1 -- start start 2023-08-25T04:03:34.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53f8e6d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53f406c720 0x7f53f41518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53f8e6d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f40cb020 0x7f53f4162850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53f8e6d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53f40cdd50 0x7f53f40b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53f8e6d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f41559e0 con 0x7f53f40cb020 2023-08-25T04:03:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53f8e6d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f40b2bf0 con 0x7f53f40cdd50 2023-08-25T04:03:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53f8e6d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f40b2ed0 con 0x7f53f406c720 2023-08-25T04:03:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53e9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f40cb020 0x7f53f4162850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53e9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f40cb020 0x7f53f4162850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33350/0 (socket says 172.21.15.55:33350) 2023-08-25T04:03:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53e9d9b640 1 -- 172.21.15.55:0/2704998308 learned_addr learned my addr 172.21.15.55:0/2704998308 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53f259c640 1 --2- 172.21.15.55:0/2704998308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53f406c720 0x7f53f41518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53f2d9d640 1 --2- 172.21.15.55:0/2704998308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53f40cdd50 0x7f53f40b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53e9d9b640 1 -- 172.21.15.55:0/2704998308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53f406c720 msgr2=0x7f53f41518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53e9d9b640 1 --2- 172.21.15.55:0/2704998308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53f406c720 0x7f53f41518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53e9d9b640 1 -- 172.21.15.55:0/2704998308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53f40cdd50 msgr2=0x7f53f40b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53e9d9b640 1 --2- 172.21.15.55:0/2704998308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53f40cdd50 0x7f53f40b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53e9d9b640 1 -- 172.21.15.55:0/2704998308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e4009480 con 0x7f53f40cb020 2023-08-25T04:03:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53e9d9b640 1 --2- 172.21.15.55:0/2704998308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f40cb020 0x7f53f4162850 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00d5f0 tx=0x7f53dc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.355+0000 7f53eb7fe640 1 -- 172.21.15.55:0/2704998308 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc0125f0 con 0x7f53f40cb020 2023-08-25T04:03:34.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.359+0000 7f53eb7fe640 1 -- 172.21.15.55:0/2704998308 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc012750 con 0x7f53f40cb020 2023-08-25T04:03:34.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.359+0000 7f53eb7fe640 1 -- 172.21.15.55:0/2704998308 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc012ae0 con 0x7f53f40cb020 2023-08-25T04:03:34.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.359+0000 7f53f8e6d640 1 -- 172.21.15.55:0/2704998308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f4155c30 con 0x7f53f40cb020 2023-08-25T04:03:34.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.359+0000 7f53f8e6d640 1 -- 172.21.15.55:0/2704998308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f41f51e0 con 0x7f53f40cb020 2023-08-25T04:03:34.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.359+0000 7f53f8e6d640 1 -- 172.21.15.55:0/2704998308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f4073ec0 con 0x7f53f40cb020 2023-08-25T04:03:34.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.359+0000 7f53eb7fe640 1 -- 172.21.15.55:0/2704998308 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f53dc012c40 con 0x7f53f40cb020 2023-08-25T04:03:34.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.359+0000 7f53eb7fe640 1 --2- 172.21.15.55:0/2704998308 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f53d4065680 0x7f53d4067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.359+0000 7f53eb7fe640 1 -- 172.21.15.55:0/2704998308 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53dc083100 con 0x7f53f40cb020 2023-08-25T04:03:34.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.359+0000 7f53f259c640 1 --2- 172.21.15.55:0/2704998308 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f53d4065680 0x7f53d4067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.359+0000 7f53f259c640 1 --2- 172.21.15.55:0/2704998308 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f53d4065680 0x7f53d4067b40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f53e40b0000 tx=0x7f53e4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:34.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.363+0000 7f53eb7fe640 1 -- 172.21.15.55:0/2704998308 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f53dc050c70 con 0x7f53f40cb020 2023-08-25T04:03:34.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.519+0000 7f53f8e6d640 1 -- 172.21.15.55:0/2704998308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53f40c16c0 con 0x7f53f40cb020 2023-08-25T04:03:34.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.519+0000 7f53eb7fe640 1 -- 172.21.15.55:0/2704998308 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53dc054290 con 0x7f53f40cb020 2023-08-25T04:03:34.523 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:03:34.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.523+0000 7f53f8e6d640 1 -- 172.21.15.55:0/2704998308 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f53d4065680 msgr2=0x7f53d4067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:34.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.523+0000 7f53f8e6d640 1 --2- 172.21.15.55:0/2704998308 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f53d4065680 0x7f53d4067b40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f53e40b0000 tx=0x7f53e4008040 comp rx=0 tx=0).stop 2023-08-25T04:03:34.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.523+0000 7f53f8e6d640 1 -- 172.21.15.55:0/2704998308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f40cb020 msgr2=0x7f53f4162850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:34.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.523+0000 7f53f8e6d640 1 --2- 172.21.15.55:0/2704998308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f40cb020 0x7f53f4162850 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00d5f0 tx=0x7f53dc00dab0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.523+0000 7f53f8e6d640 1 -- 172.21.15.55:0/2704998308 shutdown_connections 2023-08-25T04:03:34.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.523+0000 7f53f8e6d640 1 --2- 172.21.15.55:0/2704998308 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f53d4065680 0x7f53d4067b40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.523+0000 7f53f8e6d640 1 --2- 172.21.15.55:0/2704998308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53f40cdd50 0x7f53f40b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.523+0000 7f53f8e6d640 1 --2- 172.21.15.55:0/2704998308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53f40cb020 0x7f53f4162850 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.523+0000 7f53f8e6d640 1 --2- 172.21.15.55:0/2704998308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53f406c720 0x7f53f41518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.523+0000 7f53f8e6d640 1 -- 172.21.15.55:0/2704998308 >> 172.21.15.55:0/2704998308 conn(0x7f53f4069900 msgr2=0x7f53f406b610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:34.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.523+0000 7f53f8e6d640 1 -- 172.21.15.55:0/2704998308 shutdown_connections 2023-08-25T04:03:34.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.523+0000 7f53f8e6d640 1 -- 172.21.15.55:0/2704998308 wait complete. 2023-08-25T04:03:34.546 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:03:34.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.691+0000 7fe56e91e640 1 Processor -- start 2023-08-25T04:03:34.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.691+0000 7fe56e91e640 1 -- start start 2023-08-25T04:03:34.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.691+0000 7fe56e91e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5680ad6b0 0x7fe5680b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.691+0000 7fe56e91e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe5680cb710 0x7fe56806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.691+0000 7fe56e91e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5680cdf20 con 0x7fe5680b1750 2023-08-25T04:03:34.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.691+0000 7fe56e91e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56809bc40 con 0x7fe5680cb710 2023-08-25T04:03:34.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.691+0000 7fe56e91e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56809bf20 con 0x7fe5680ad6b0 2023-08-25T04:03:34.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.691+0000 7fe5677fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe5680cb710 0x7fe56806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.691+0000 7fe56cebb640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe5680b1750 0x7fe5680c8a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45062/0 (socket says 172.21.15.55:45062) 2023-08-25T04:03:34.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.691+0000 7fe5677fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe5680cb710 0x7fe56806c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33358/0 (socket says 172.21.15.55:33358) 2023-08-25T04:03:34.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.691+0000 7fe56cebb640 1 -- 172.21.15.55:0/985511429 learned_addr learned my addr 172.21.15.55:0/985511429 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:34.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.691+0000 7fe567fff640 1 --2- 172.21.15.55:0/985511429 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5680ad6b0 0x7fe5680b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.691+0000 7fe5677fe640 1 -- 172.21.15.55:0/985511429 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5680ad6b0 msgr2=0x7fe5680b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:34.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.691+0000 7fe5677fe640 1 --2- 172.21.15.55:0/985511429 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5680ad6b0 0x7fe5680b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.691+0000 7fe5677fe640 1 -- 172.21.15.55:0/985511429 >> v1:172.21.15.55:6789/0 conn(0x7fe5680b1750 legacy=0x7fe5680c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:34.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.691+0000 7fe5677fe640 1 -- 172.21.15.55:0/985511429 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56806c1c0 con 0x7fe5680cb710 2023-08-25T04:03:34.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.691+0000 7fe566ffd640 1 -- 172.21.15.55:0/985511429 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731192898 0 0) 0x7fe5680cdf20 con 0x7fe5680b1750 2023-08-25T04:03:34.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.695+0000 7fe5677fe640 1 --2- 172.21.15.55:0/985511429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5680cb710 0x7fe56806c9c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00ba50 tx=0x7fe55c01e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35ce842e3b8318a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:34.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.695+0000 7fe566ffd640 1 -- 172.21.15.55:0/985511429 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c0a7910 con 0x7fe5680cb710 2023-08-25T04:03:34.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.695+0000 7fe566ffd640 1 -- 172.21.15.55:0/985511429 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c0ab070 con 0x7fe5680cb710 2023-08-25T04:03:34.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.695+0000 7fe566ffd640 1 -- 172.21.15.55:0/985511429 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c0a7c90 con 0x7fe5680cb710 2023-08-25T04:03:34.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.695+0000 7fe56e91e640 1 -- 172.21.15.55:0/985511429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5680cb710 msgr2=0x7fe56806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:34.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.695+0000 7fe56e91e640 1 --2- 172.21.15.55:0/985511429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5680cb710 0x7fe56806c9c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00ba50 tx=0x7fe55c01e930 comp rx=0 tx=0).stop 2023-08-25T04:03:34.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.695+0000 7fe56e91e640 1 -- 172.21.15.55:0/985511429 shutdown_connections 2023-08-25T04:03:34.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.695+0000 7fe56e91e640 1 --2- 172.21.15.55:0/985511429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5680cb710 0x7fe56806c9c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.695+0000 7fe56e91e640 1 --2- 172.21.15.55:0/985511429 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5680ad6b0 0x7fe5680b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.695+0000 7fe56e91e640 1 -- 172.21.15.55:0/985511429 >> 172.21.15.55:0/985511429 conn(0x7fe568069900 msgr2=0x7fe568069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:34.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.695+0000 7fe56e91e640 1 -- 172.21.15.55:0/985511429 shutdown_connections 2023-08-25T04:03:34.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.695+0000 7fe56e91e640 1 -- 172.21.15.55:0/985511429 wait complete. 2023-08-25T04:03:34.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe56e91e640 1 Processor -- start 2023-08-25T04:03:34.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe56e91e640 1 -- start start 2023-08-25T04:03:34.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe56e91e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5680ad6b0 0x7fe5680ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe56e91e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5680b1750 0x7fe5681585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe56e91e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5680cb710 0x7fe5681497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe56e91e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe568150880 con 0x7fe5680ad6b0 2023-08-25T04:03:34.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe56e91e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5680c21c0 con 0x7fe5680b1750 2023-08-25T04:03:34.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe56e91e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe568150ad0 con 0x7fe5680cb710 2023-08-25T04:03:34.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe567fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5680ad6b0 0x7fe5680ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe567fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5680ad6b0 0x7fe5680ace40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33374/0 (socket says 172.21.15.55:33374) 2023-08-25T04:03:34.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe567fff640 1 -- 172.21.15.55:0/1126943739 learned_addr learned my addr 172.21.15.55:0/1126943739 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:34.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe56cebb640 1 --2- 172.21.15.55:0/1126943739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5680cb710 0x7fe5681497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe5677fe640 1 --2- 172.21.15.55:0/1126943739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5680b1750 0x7fe5681585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe567fff640 1 -- 172.21.15.55:0/1126943739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5680cb710 msgr2=0x7fe5681497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:34.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe567fff640 1 --2- 172.21.15.55:0/1126943739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5680cb710 0x7fe5681497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe567fff640 1 -- 172.21.15.55:0/1126943739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5680b1750 msgr2=0x7fe5681585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:34.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe567fff640 1 --2- 172.21.15.55:0/1126943739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5680b1750 0x7fe5681585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe567fff640 1 -- 172.21.15.55:0/1126943739 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c00b6b0 con 0x7fe5680ad6b0 2023-08-25T04:03:34.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe56cebb640 1 --2- 172.21.15.55:0/1126943739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5680cb710 0x7fe5681497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:34.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe567fff640 1 --2- 172.21.15.55:0/1126943739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5680ad6b0 0x7fe5680ace40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe55800e9b0 tx=0x7fe55800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:34.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe564ff9640 1 -- 172.21.15.55:0/1126943739 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558009670 con 0x7fe5680ad6b0 2023-08-25T04:03:34.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe564ff9640 1 -- 172.21.15.55:0/1126943739 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55800c9a0 con 0x7fe5680ad6b0 2023-08-25T04:03:34.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe56e91e640 1 -- 172.21.15.55:0/1126943739 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe568150db0 con 0x7fe5680ad6b0 2023-08-25T04:03:34.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe564ff9640 1 -- 172.21.15.55:0/1126943739 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55800cd10 con 0x7fe5680ad6b0 2023-08-25T04:03:34.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.699+0000 7fe56e91e640 1 -- 172.21.15.55:0/1126943739 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5680c1e20 con 0x7fe5680ad6b0 2023-08-25T04:03:34.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.703+0000 7fe56e91e640 1 -- 172.21.15.55:0/1126943739 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe568073ec0 con 0x7fe5680ad6b0 2023-08-25T04:03:34.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.703+0000 7fe564ff9640 1 -- 172.21.15.55:0/1126943739 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe558013470 con 0x7fe5680ad6b0 2023-08-25T04:03:34.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.703+0000 7fe564ff9640 1 --2- 172.21.15.55:0/1126943739 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe5540656b0 0x7fe554067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.703+0000 7fe564ff9640 1 -- 172.21.15.55:0/1126943739 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe558083450 con 0x7fe5680ad6b0 2023-08-25T04:03:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.703+0000 7fe5677fe640 1 --2- 172.21.15.55:0/1126943739 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe5540656b0 0x7fe554067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.703+0000 7fe5677fe640 1 --2- 172.21.15.55:0/1126943739 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe5540656b0 0x7fe554067b70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe55c0b2000 tx=0x7fe55c0a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.707+0000 7fe564ff9640 1 -- 172.21.15.55:0/1126943739 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe558050e70 con 0x7fe5680ad6b0 2023-08-25T04:03:34.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.867+0000 7fe56e91e640 1 -- 172.21.15.55:0/1126943739 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe568071b50 con 0x7fe5680ad6b0 2023-08-25T04:03:34.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.867+0000 7fe564ff9640 1 -- 172.21.15.55:0/1126943739 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe558054490 con 0x7fe5680ad6b0 2023-08-25T04:03:34.868 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:03:34.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.867+0000 7fe56e91e640 1 -- 172.21.15.55:0/1126943739 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe5540656b0 msgr2=0x7fe554067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:34.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.867+0000 7fe56e91e640 1 --2- 172.21.15.55:0/1126943739 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe5540656b0 0x7fe554067b70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe55c0b2000 tx=0x7fe55c0a9070 comp rx=0 tx=0).stop 2023-08-25T04:03:34.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.867+0000 7fe56e91e640 1 -- 172.21.15.55:0/1126943739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5680ad6b0 msgr2=0x7fe5680ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:34.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.867+0000 7fe56e91e640 1 --2- 172.21.15.55:0/1126943739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5680ad6b0 0x7fe5680ace40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe55800e9b0 tx=0x7fe55800ee70 comp rx=0 tx=0).stop 2023-08-25T04:03:34.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.867+0000 7fe56e91e640 1 -- 172.21.15.55:0/1126943739 shutdown_connections 2023-08-25T04:03:34.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.867+0000 7fe56e91e640 1 --2- 172.21.15.55:0/1126943739 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe5540656b0 0x7fe554067b70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.867+0000 7fe56e91e640 1 --2- 172.21.15.55:0/1126943739 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe5680cb710 0x7fe5681497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.867+0000 7fe56e91e640 1 --2- 172.21.15.55:0/1126943739 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe5680b1750 0x7fe5681585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.867+0000 7fe56e91e640 1 --2- 172.21.15.55:0/1126943739 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5680ad6b0 0x7fe5680ace40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:34.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.867+0000 7fe56e91e640 1 -- 172.21.15.55:0/1126943739 >> 172.21.15.55:0/1126943739 conn(0x7fe568069900 msgr2=0x7fe568070b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:34.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.867+0000 7fe56e91e640 1 -- 172.21.15.55:0/1126943739 shutdown_connections 2023-08-25T04:03:34.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:34.867+0000 7fe56e91e640 1 -- 172.21.15.55:0/1126943739 wait complete. 2023-08-25T04:03:34.889 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:03:35.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.035+0000 7f1fa9f3a640 1 Processor -- start 2023-08-25T04:03:35.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.035+0000 7f1fa9f3a640 1 -- start start 2023-08-25T04:03:35.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.035+0000 7f1fa9f3a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa41601f0 0x7f1fa415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.035+0000 7f1fa9f3a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1fa40d1290 0x7f1fa415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.035+0000 7f1fa9f3a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa40cd5a0 con 0x7f1fa415e3c0 2023-08-25T04:03:35.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.035+0000 7f1fa9f3a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa40cd880 con 0x7f1fa40d1290 2023-08-25T04:03:35.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.035+0000 7f1fa9f3a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa40cdb60 con 0x7f1fa41601f0 2023-08-25T04:03:35.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.035+0000 7f1fa3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1fa40d1290 0x7f1fa415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.035+0000 7f1fa3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1fa40d1290 0x7f1fa415e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33380/0 (socket says 172.21.15.55:33380) 2023-08-25T04:03:35.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.035+0000 7f1fa3fff640 1 -- 172.21.15.55:0/2716659135 learned_addr learned my addr 172.21.15.55:0/2716659135 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:35.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.035+0000 7f1f9bfff640 1 --1- 172.21.15.55:0/2716659135 >> v1:172.21.15.55:6789/0 conn(0x7f1fa415e3c0 0x7f1fa40d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45076/0 (socket says 172.21.15.55:45076) 2023-08-25T04:03:35.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.035+0000 7f1fa37fe640 1 --2- 172.21.15.55:0/2716659135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa41601f0 0x7f1fa415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.035+0000 7f1fa3fff640 1 -- 172.21.15.55:0/2716659135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa41601f0 msgr2=0x7f1fa415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:35.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.035+0000 7f1fa3fff640 1 --2- 172.21.15.55:0/2716659135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa41601f0 0x7f1fa415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.035+0000 7f1fa3fff640 1 -- 172.21.15.55:0/2716659135 >> v1:172.21.15.55:6789/0 conn(0x7f1fa415e3c0 legacy=0x7f1fa40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:35.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.035+0000 7f1fa3fff640 1 -- 172.21.15.55:0/2716659135 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa40cde40 con 0x7f1fa40d1290 2023-08-25T04:03:35.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.035+0000 7f1fa2ffd640 1 -- 172.21.15.55:0/2716659135 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062093570 0 0) 0x7f1fa40cd5a0 con 0x7f1fa415e3c0 2023-08-25T04:03:35.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.039+0000 7f1fa3fff640 1 --2- 172.21.15.55:0/2716659135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa40d1290 0x7f1fa415e8a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c009e50 tx=0x7f1f9c01f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c264ab4bb4ea309 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:35.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.039+0000 7f1fa2ffd640 1 -- 172.21.15.55:0/2716659135 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c0af400 con 0x7f1fa40d1290 2023-08-25T04:03:35.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.039+0000 7f1fa2ffd640 1 -- 172.21.15.55:0/2716659135 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9c0ab050 con 0x7f1fa40d1290 2023-08-25T04:03:35.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.039+0000 7f1fa2ffd640 1 -- 172.21.15.55:0/2716659135 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c0af780 con 0x7f1fa40d1290 2023-08-25T04:03:35.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.039+0000 7f1fa9f3a640 1 -- 172.21.15.55:0/2716659135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa40d1290 msgr2=0x7f1fa415e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:35.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.039+0000 7f1fa9f3a640 1 --2- 172.21.15.55:0/2716659135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa40d1290 0x7f1fa415e8a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c009e50 tx=0x7f1f9c01f1f0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.039+0000 7f1fa9f3a640 1 -- 172.21.15.55:0/2716659135 shutdown_connections 2023-08-25T04:03:35.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.039+0000 7f1fa9f3a640 1 --2- 172.21.15.55:0/2716659135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa40d1290 0x7f1fa415e8a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.039+0000 7f1fa9f3a640 1 --2- 172.21.15.55:0/2716659135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa41601f0 0x7f1fa415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.039+0000 7f1fa9f3a640 1 -- 172.21.15.55:0/2716659135 >> 172.21.15.55:0/2716659135 conn(0x7f1fa40d27d0 msgr2=0x7f1fa40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:35.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.039+0000 7f1fa9f3a640 1 -- 172.21.15.55:0/2716659135 shutdown_connections 2023-08-25T04:03:35.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.039+0000 7f1fa9f3a640 1 -- 172.21.15.55:0/2716659135 wait complete. 2023-08-25T04:03:35.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1fa9f3a640 1 Processor -- start 2023-08-25T04:03:35.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1fa9f3a640 1 -- start start 2023-08-25T04:03:35.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1fa9f3a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa40d1290 0x7f1fa41555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1fa9f3a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa415e3c0 0x7f1fa40cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1fa9f3a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa41601f0 0x7f1fa40cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1fa9f3a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa415b190 con 0x7f1fa415e3c0 2023-08-25T04:03:35.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1fa9f3a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa415a510 con 0x7f1fa41601f0 2023-08-25T04:03:35.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1fa9f3a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa415a7f0 con 0x7f1fa40d1290 2023-08-25T04:03:35.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1f9bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa415e3c0 0x7f1fa40cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1f9bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa415e3c0 0x7f1fa40cad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33386/0 (socket says 172.21.15.55:33386) 2023-08-25T04:03:35.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1f9bfff640 1 -- 172.21.15.55:0/3616570186 learned_addr learned my addr 172.21.15.55:0/3616570186 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:35.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1fa3fff640 1 --2- 172.21.15.55:0/3616570186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa41601f0 0x7f1fa40cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1fa37fe640 1 --2- 172.21.15.55:0/3616570186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa40d1290 0x7f1fa41555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1f9bfff640 1 -- 172.21.15.55:0/3616570186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa40d1290 msgr2=0x7f1fa41555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:35.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1f9bfff640 1 --2- 172.21.15.55:0/3616570186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa40d1290 0x7f1fa41555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1f9bfff640 1 -- 172.21.15.55:0/3616570186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa41601f0 msgr2=0x7f1fa40cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:35.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1f9bfff640 1 --2- 172.21.15.55:0/3616570186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa41601f0 0x7f1fa40cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1f9bfff640 1 -- 172.21.15.55:0/3616570186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9c009b30 con 0x7f1fa415e3c0 2023-08-25T04:03:35.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1f9bfff640 1 --2- 172.21.15.55:0/3616570186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa415e3c0 0x7f1fa40cad70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c0011f0 tx=0x7f1f8c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:35.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1fa0ff9640 1 -- 172.21.15.55:0/3616570186 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c0074e0 con 0x7f1fa415e3c0 2023-08-25T04:03:35.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1fa0ff9640 1 -- 172.21.15.55:0/3616570186 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c007640 con 0x7f1fa415e3c0 2023-08-25T04:03:35.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1fa0ff9640 1 -- 172.21.15.55:0/3616570186 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c004a10 con 0x7f1fa415e3c0 2023-08-25T04:03:35.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1fa9f3a640 1 -- 172.21.15.55:0/3616570186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa40ce7c0 con 0x7f1fa415e3c0 2023-08-25T04:03:35.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.043+0000 7f1fa9f3a640 1 -- 172.21.15.55:0/3616570186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa415adb0 con 0x7f1fa415e3c0 2023-08-25T04:03:35.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.047+0000 7f1fa9f3a640 1 -- 172.21.15.55:0/3616570186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa40d0040 con 0x7f1fa415e3c0 2023-08-25T04:03:35.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.047+0000 7f1fa0ff9640 1 -- 172.21.15.55:0/3616570186 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1f8c004b70 con 0x7f1fa415e3c0 2023-08-25T04:03:35.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.047+0000 7f1fa0ff9640 1 --2- 172.21.15.55:0/3616570186 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1f84065680 0x7f1f84067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.047+0000 7f1fa0ff9640 1 -- 172.21.15.55:0/3616570186 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f8c0821a0 con 0x7f1fa415e3c0 2023-08-25T04:03:35.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.047+0000 7f1fa37fe640 1 --2- 172.21.15.55:0/3616570186 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1f84065680 0x7f1f84067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.047+0000 7f1fa37fe640 1 --2- 172.21.15.55:0/3616570186 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1f84065680 0x7f1f84067b40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009a30 tx=0x7f1f94008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:35.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.051+0000 7f1fa0ff9640 1 -- 172.21.15.55:0/3616570186 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1f8c04fbc0 con 0x7f1fa415e3c0 2023-08-25T04:03:35.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.207+0000 7f1fa9f3a640 1 -- 172.21.15.55:0/3616570186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1fa40d3300 con 0x7f1fa415e3c0 2023-08-25T04:03:35.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.207+0000 7f1fa0ff9640 1 -- 172.21.15.55:0/3616570186 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1f8c0531e0 con 0x7f1fa415e3c0 2023-08-25T04:03:35.209 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:03:35.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.207+0000 7f1fa9f3a640 1 -- 172.21.15.55:0/3616570186 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1f84065680 msgr2=0x7f1f84067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:35.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.207+0000 7f1fa9f3a640 1 --2- 172.21.15.55:0/3616570186 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1f84065680 0x7f1f84067b40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1f94009a30 tx=0x7f1f94008040 comp rx=0 tx=0).stop 2023-08-25T04:03:35.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.207+0000 7f1fa9f3a640 1 -- 172.21.15.55:0/3616570186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa415e3c0 msgr2=0x7f1fa40cad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:35.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.207+0000 7f1fa9f3a640 1 --2- 172.21.15.55:0/3616570186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa415e3c0 0x7f1fa40cad70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c0011f0 tx=0x7f1f8c00c9b0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.207+0000 7f1fa9f3a640 1 -- 172.21.15.55:0/3616570186 shutdown_connections 2023-08-25T04:03:35.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.207+0000 7f1fa9f3a640 1 --2- 172.21.15.55:0/3616570186 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1f84065680 0x7f1f84067b40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.207+0000 7f1fa9f3a640 1 --2- 172.21.15.55:0/3616570186 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa41601f0 0x7f1fa40cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.207+0000 7f1fa9f3a640 1 --2- 172.21.15.55:0/3616570186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa415e3c0 0x7f1fa40cad70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.207+0000 7f1fa9f3a640 1 --2- 172.21.15.55:0/3616570186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa40d1290 0x7f1fa41555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.207+0000 7f1fa9f3a640 1 -- 172.21.15.55:0/3616570186 >> 172.21.15.55:0/3616570186 conn(0x7f1fa40d27d0 msgr2=0x7f1fa406b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:35.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.207+0000 7f1fa9f3a640 1 -- 172.21.15.55:0/3616570186 shutdown_connections 2023-08-25T04:03:35.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.207+0000 7f1fa9f3a640 1 -- 172.21.15.55:0/3616570186 wait complete. 2023-08-25T04:03:35.243 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:03:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.391+0000 7f70aff8f640 1 Processor -- start 2023-08-25T04:03:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.391+0000 7f70aff8f640 1 -- start start 2023-08-25T04:03:35.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.391+0000 7f70aff8f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70a815a7f0 0x7f70a809bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.391+0000 7f70aff8f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f70a80c9830 0x7f70a8070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.391+0000 7f70aff8f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f70a806c020 0x7f70a8071440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.391+0000 7f70aff8f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a8071980 con 0x7f70a80c9830 2023-08-25T04:03:35.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.391+0000 7f70aff8f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a815abd0 con 0x7f70a806c020 2023-08-25T04:03:35.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.391+0000 7f70aff8f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a80c8ab0 con 0x7f70a815a7f0 2023-08-25T04:03:35.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.391+0000 7f70ad52a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f70a80c9830 0x7f70a8070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.391+0000 7f70ad52a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f70a80c9830 0x7f70a8070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33402/0 (socket says 172.21.15.55:33402) 2023-08-25T04:03:35.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.391+0000 7f70ad52a640 1 -- 172.21.15.55:0/1787295178 learned_addr learned my addr 172.21.15.55:0/1787295178 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:35.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.395+0000 7f70add2b640 1 --2- 172.21.15.55:0/1787295178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70a815a7f0 0x7f70a809bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.395+0000 7f70ae52c640 1 --2- 172.21.15.55:0/1787295178 >> v2:172.21.15.110:3300/0 conn(0x7f70a806c020 0x7f70a8071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.395+0000 7f70ad52a640 1 -- 172.21.15.55:0/1787295178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70a815a7f0 msgr2=0x7f70a809bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.395+0000 7f70ad52a640 1 --2- 172.21.15.55:0/1787295178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70a815a7f0 0x7f70a809bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.395+0000 7f70ad52a640 1 -- 172.21.15.55:0/1787295178 >> v2:172.21.15.110:3300/0 conn(0x7f70a806c020 msgr2=0x7f70a8071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.395+0000 7f70ad52a640 1 --2- 172.21.15.55:0/1787295178 >> v2:172.21.15.110:3300/0 conn(0x7f70a806c020 0x7f70a8071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.395+0000 7f70ad52a640 1 -- 172.21.15.55:0/1787295178 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a80c8d50 con 0x7f70a80c9830 2023-08-25T04:03:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.395+0000 7f70ae52c640 1 --2- 172.21.15.55:0/1787295178 >> v2:172.21.15.110:3300/0 conn(0x7f70a806c020 0x7f70a8071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.395+0000 7f70ad52a640 1 --2- 172.21.15.55:0/1787295178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70a80c9830 0x7f70a8070f00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f70a80c9e50 tx=0x7f709801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf6b98340426779 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.395+0000 7f70acd29640 1 -- 172.21.15.55:0/1787295178 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980aa5f0 con 0x7f70a80c9830 2023-08-25T04:03:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.395+0000 7f70acd29640 1 -- 172.21.15.55:0/1787295178 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70980aa750 con 0x7f70a80c9830 2023-08-25T04:03:35.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.395+0000 7f70acd29640 1 -- 172.21.15.55:0/1787295178 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980aaae0 con 0x7f70a80c9830 2023-08-25T04:03:35.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.395+0000 7f70aff8f640 1 -- 172.21.15.55:0/1787295178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70a80c9830 msgr2=0x7f70a8070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:35.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.395+0000 7f70aff8f640 1 --2- 172.21.15.55:0/1787295178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70a80c9830 0x7f70a8070f00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f70a80c9e50 tx=0x7f709801c4d0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70aff8f640 1 -- 172.21.15.55:0/1787295178 shutdown_connections 2023-08-25T04:03:35.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70aff8f640 1 --2- 172.21.15.55:0/1787295178 >> v2:172.21.15.110:3300/0 conn(0x7f70a806c020 0x7f70a8071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70aff8f640 1 --2- 172.21.15.55:0/1787295178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70a80c9830 0x7f70a8070f00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70aff8f640 1 --2- 172.21.15.55:0/1787295178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70a815a7f0 0x7f70a809bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70aff8f640 1 -- 172.21.15.55:0/1787295178 >> 172.21.15.55:0/1787295178 conn(0x7f70a8069900 msgr2=0x7f70a8069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:35.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70aff8f640 1 -- 172.21.15.55:0/1787295178 shutdown_connections 2023-08-25T04:03:35.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70aff8f640 1 -- 172.21.15.55:0/1787295178 wait complete. 2023-08-25T04:03:35.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70aff8f640 1 Processor -- start 2023-08-25T04:03:35.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70aff8f640 1 -- start start 2023-08-25T04:03:35.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70aff8f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70a806c020 0x7f70a8159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70aff8f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70a80c9830 0x7f70a8152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70aff8f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70a815a7f0 0x7f70a80aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70aff8f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a8155f20 con 0x7f70a815a7f0 2023-08-25T04:03:35.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70aff8f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a815a0a0 con 0x7f70a806c020 2023-08-25T04:03:35.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70aff8f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a81556c0 con 0x7f70a80c9830 2023-08-25T04:03:35.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70ae52c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70a815a7f0 0x7f70a80aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70ae52c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70a815a7f0 0x7f70a80aafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33414/0 (socket says 172.21.15.55:33414) 2023-08-25T04:03:35.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70ae52c640 1 -- 172.21.15.55:0/588981851 learned_addr learned my addr 172.21.15.55:0/588981851 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:35.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70add2b640 1 --2- 172.21.15.55:0/588981851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70a806c020 0x7f70a8159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70ad52a640 1 --2- 172.21.15.55:0/588981851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70a80c9830 0x7f70a8152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70ae52c640 1 -- 172.21.15.55:0/588981851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70a80c9830 msgr2=0x7f70a8152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:35.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70ae52c640 1 --2- 172.21.15.55:0/588981851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70a80c9830 0x7f70a8152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70ae52c640 1 -- 172.21.15.55:0/588981851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70a806c020 msgr2=0x7f70a8159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:35.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70ae52c640 1 --2- 172.21.15.55:0/588981851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70a806c020 0x7f70a8159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70ae52c640 1 -- 172.21.15.55:0/588981851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70980094d0 con 0x7f70a815a7f0 2023-08-25T04:03:35.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70ad52a640 1 --2- 172.21.15.55:0/588981851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70a80c9830 0x7f70a8152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:35.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f70ae52c640 1 --2- 172.21.15.55:0/588981851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70a815a7f0 0x7f70a80aafd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f70a0007d80 tx=0x7f70a000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:35.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.399+0000 7f709e7fc640 1 -- 172.21.15.55:0/588981851 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0015400 con 0x7f70a815a7f0 2023-08-25T04:03:35.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.403+0000 7f709e7fc640 1 -- 172.21.15.55:0/588981851 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a000f040 con 0x7f70a815a7f0 2023-08-25T04:03:35.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.403+0000 7f709e7fc640 1 -- 172.21.15.55:0/588981851 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a00157a0 con 0x7f70a815a7f0 2023-08-25T04:03:35.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.403+0000 7f70aff8f640 1 -- 172.21.15.55:0/588981851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a8155960 con 0x7f70a815a7f0 2023-08-25T04:03:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.403+0000 7f70aff8f640 1 -- 172.21.15.55:0/588981851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a80cc130 con 0x7f70a815a7f0 2023-08-25T04:03:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.403+0000 7f70aff8f640 1 -- 172.21.15.55:0/588981851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a806d5b0 con 0x7f70a815a7f0 2023-08-25T04:03:35.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.403+0000 7f709e7fc640 1 -- 172.21.15.55:0/588981851 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f70a001e3b0 con 0x7f70a815a7f0 2023-08-25T04:03:35.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.403+0000 7f709e7fc640 1 --2- 172.21.15.55:0/588981851 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f708c065680 0x7f708c067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.403+0000 7f709e7fc640 1 -- 172.21.15.55:0/588981851 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f70a0082ff0 con 0x7f70a815a7f0 2023-08-25T04:03:35.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.403+0000 7f70add2b640 1 --2- 172.21.15.55:0/588981851 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f708c065680 0x7f708c067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.407+0000 7f70add2b640 1 --2- 172.21.15.55:0/588981851 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f708c065680 0x7f708c067b40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f70a4006fd0 tx=0x7f70a4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:35.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.407+0000 7f709e7fc640 1 -- 172.21.15.55:0/588981851 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f70a0050b20 con 0x7f70a815a7f0 2023-08-25T04:03:35.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.567+0000 7f70aff8f640 1 -- 172.21.15.55:0/588981851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f70a80cbf90 con 0x7f70a815a7f0 2023-08-25T04:03:35.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.567+0000 7f709e7fc640 1 -- 172.21.15.55:0/588981851 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f70a001a020 con 0x7f70a815a7f0 2023-08-25T04:03:35.569 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:03:35.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.567+0000 7f70aff8f640 1 -- 172.21.15.55:0/588981851 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f708c065680 msgr2=0x7f708c067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:35.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.567+0000 7f70aff8f640 1 --2- 172.21.15.55:0/588981851 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f708c065680 0x7f708c067b40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f70a4006fd0 tx=0x7f70a4008040 comp rx=0 tx=0).stop 2023-08-25T04:03:35.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.567+0000 7f70aff8f640 1 -- 172.21.15.55:0/588981851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70a815a7f0 msgr2=0x7f70a80aafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:35.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.567+0000 7f70aff8f640 1 --2- 172.21.15.55:0/588981851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70a815a7f0 0x7f70a80aafd0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f70a0007d80 tx=0x7f70a000d4a0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.567+0000 7f70aff8f640 1 -- 172.21.15.55:0/588981851 shutdown_connections 2023-08-25T04:03:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.567+0000 7f70aff8f640 1 --2- 172.21.15.55:0/588981851 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f708c065680 0x7f708c067b40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.567+0000 7f70aff8f640 1 --2- 172.21.15.55:0/588981851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70a815a7f0 0x7f70a80aafd0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.567+0000 7f70aff8f640 1 --2- 172.21.15.55:0/588981851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70a80c9830 0x7f70a8152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.567+0000 7f70aff8f640 1 --2- 172.21.15.55:0/588981851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70a806c020 0x7f70a8159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.567+0000 7f70aff8f640 1 -- 172.21.15.55:0/588981851 >> 172.21.15.55:0/588981851 conn(0x7f70a8069900 msgr2=0x7f70a8070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.571+0000 7f70aff8f640 1 -- 172.21.15.55:0/588981851 shutdown_connections 2023-08-25T04:03:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.571+0000 7f70aff8f640 1 -- 172.21.15.55:0/588981851 wait complete. 2023-08-25T04:03:35.590 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:03:35.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.735+0000 7ff79e9ba640 1 Processor -- start 2023-08-25T04:03:35.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.735+0000 7ff79e9ba640 1 -- start start 2023-08-25T04:03:35.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.735+0000 7ff79e9ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7980d0da0 0x7ff7980d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.735+0000 7ff79e9ba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff7980cdde0 0x7ff7980ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.735+0000 7ff79e9ba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7980b29b0 con 0x7ff7980cee60 2023-08-25T04:03:35.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.735+0000 7ff79e9ba640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7980ce760 con 0x7ff7980cdde0 2023-08-25T04:03:35.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.735+0000 7ff79e9ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980d16c0 con 0x7ff7980d0da0 2023-08-25T04:03:35.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.735+0000 7ff7977fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff7980cdde0 0x7ff7980ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.735+0000 7ff79cf57640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff7980cee60 0x7ff7980cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45088/0 (socket says 172.21.15.55:45088) 2023-08-25T04:03:35.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.735+0000 7ff79cf57640 1 -- 172.21.15.55:0/2023495779 learned_addr learned my addr 172.21.15.55:0/2023495779 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:35.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.735+0000 7ff797fff640 1 --2- 172.21.15.55:0/2023495779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7980d0da0 0x7ff7980d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.735+0000 7ff7977fe640 1 -- 172.21.15.55:0/2023495779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7980d0da0 msgr2=0x7ff7980d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:35.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.735+0000 7ff7977fe640 1 --2- 172.21.15.55:0/2023495779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7980d0da0 0x7ff7980d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.735+0000 7ff7977fe640 1 -- 172.21.15.55:0/2023495779 >> v1:172.21.15.55:6789/0 conn(0x7ff7980cee60 legacy=0x7ff7980cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:35.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.735+0000 7ff7977fe640 1 -- 172.21.15.55:0/2023495779 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7980b1dc0 con 0x7ff7980cdde0 2023-08-25T04:03:35.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.735+0000 7ff797fff640 1 --2- 172.21.15.55:0/2023495779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7980d0da0 0x7ff7980d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:35.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.739+0000 7ff7977fe640 1 --2- 172.21.15.55:0/2023495779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7980cdde0 0x7ff7980ce220 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0097c0 tx=0x7ff78c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704c4b6700a53c35 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:35.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.739+0000 7ff796ffd640 1 -- 172.21.15.55:0/2023495779 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c0a8970 con 0x7ff7980cdde0 2023-08-25T04:03:35.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.739+0000 7ff796ffd640 1 -- 172.21.15.55:0/2023495779 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c0a8ad0 con 0x7ff7980cdde0 2023-08-25T04:03:35.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.739+0000 7ff796ffd640 1 -- 172.21.15.55:0/2023495779 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c0a8e60 con 0x7ff7980cdde0 2023-08-25T04:03:35.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.739+0000 7ff79e9ba640 1 -- 172.21.15.55:0/2023495779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7980cdde0 msgr2=0x7ff7980ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:35.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.739+0000 7ff79e9ba640 1 --2- 172.21.15.55:0/2023495779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7980cdde0 0x7ff7980ce220 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0097c0 tx=0x7ff78c01ec70 comp rx=0 tx=0).stop 2023-08-25T04:03:35.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.739+0000 7ff79e9ba640 1 -- 172.21.15.55:0/2023495779 shutdown_connections 2023-08-25T04:03:35.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.739+0000 7ff79e9ba640 1 --2- 172.21.15.55:0/2023495779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7980cdde0 0x7ff7980ce220 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.739+0000 7ff79e9ba640 1 --2- 172.21.15.55:0/2023495779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7980d0da0 0x7ff7980d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.739+0000 7ff79e9ba640 1 -- 172.21.15.55:0/2023495779 >> 172.21.15.55:0/2023495779 conn(0x7ff79809bae0 msgr2=0x7ff7980d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:35.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.739+0000 7ff79e9ba640 1 -- 172.21.15.55:0/2023495779 shutdown_connections 2023-08-25T04:03:35.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.739+0000 7ff79e9ba640 1 -- 172.21.15.55:0/2023495779 wait complete. 2023-08-25T04:03:35.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.739+0000 7ff79e9ba640 1 Processor -- start 2023-08-25T04:03:35.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79e9ba640 1 -- start start 2023-08-25T04:03:35.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79e9ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7980cdde0 0x7ff798151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79e9ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7980cee60 0x7ff7980cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79e9ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7980d0da0 0x7ff7980c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79e9ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79815d740 con 0x7ff7980d0da0 2023-08-25T04:03:35.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79e9ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980ca730 con 0x7ff7980cee60 2023-08-25T04:03:35.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79e9ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980caa10 con 0x7ff7980cdde0 2023-08-25T04:03:35.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79cf57640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7980d0da0 0x7ff7980c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79cf57640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7980d0da0 0x7ff7980c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33430/0 (socket says 172.21.15.55:33430) 2023-08-25T04:03:35.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79cf57640 1 -- 172.21.15.55:0/1064145854 learned_addr learned my addr 172.21.15.55:0/1064145854 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:35.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff797fff640 1 --2- 172.21.15.55:0/1064145854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7980cdde0 0x7ff798151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff7977fe640 1 --2- 172.21.15.55:0/1064145854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7980cee60 0x7ff7980cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79cf57640 1 -- 172.21.15.55:0/1064145854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7980cdde0 msgr2=0x7ff798151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:35.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79cf57640 1 --2- 172.21.15.55:0/1064145854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7980cdde0 0x7ff798151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79cf57640 1 -- 172.21.15.55:0/1064145854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7980cee60 msgr2=0x7ff7980cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:35.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79cf57640 1 --2- 172.21.15.55:0/1064145854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7980cee60 0x7ff7980cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79cf57640 1 -- 172.21.15.55:0/1064145854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c009420 con 0x7ff7980d0da0 2023-08-25T04:03:35.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff797fff640 1 --2- 172.21.15.55:0/1064145854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7980cdde0 0x7ff798151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:35.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79cf57640 1 --2- 172.21.15.55:0/1064145854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7980d0da0 0x7ff7980c7c10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff79000cbc0 tx=0x7ff79000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:35.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff794ff9640 1 -- 172.21.15.55:0/1064145854 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79000ad40 con 0x7ff7980d0da0 2023-08-25T04:03:35.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff794ff9640 1 -- 172.21.15.55:0/1064145854 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff790012400 con 0x7ff7980d0da0 2023-08-25T04:03:35.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79e9ba640 1 -- 172.21.15.55:0/1064145854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7980cacf0 con 0x7ff7980d0da0 2023-08-25T04:03:35.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff794ff9640 1 -- 172.21.15.55:0/1064145854 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79000aea0 con 0x7ff7980d0da0 2023-08-25T04:03:35.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79e9ba640 1 -- 172.21.15.55:0/1064145854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff798152110 con 0x7ff7980d0da0 2023-08-25T04:03:35.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.743+0000 7ff79e9ba640 1 -- 172.21.15.55:0/1064145854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7980cb210 con 0x7ff7980d0da0 2023-08-25T04:03:35.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.747+0000 7ff794ff9640 1 -- 172.21.15.55:0/1064145854 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff790007070 con 0x7ff7980d0da0 2023-08-25T04:03:35.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.747+0000 7ff794ff9640 1 --2- 172.21.15.55:0/1064145854 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff7840656b0 0x7ff784067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:35.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.747+0000 7ff794ff9640 1 -- 172.21.15.55:0/1064145854 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff790082cd0 con 0x7ff7980d0da0 2023-08-25T04:03:35.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.747+0000 7ff797fff640 1 --2- 172.21.15.55:0/1064145854 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff7840656b0 0x7ff784067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:35.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.747+0000 7ff797fff640 1 --2- 172.21.15.55:0/1064145854 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff7840656b0 0x7ff784067b70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff78800a990 tx=0x7ff788008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:35.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.751+0000 7ff794ff9640 1 -- 172.21.15.55:0/1064145854 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff790050820 con 0x7ff7980d0da0 2023-08-25T04:03:35.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.915+0000 7ff79e9ba640 1 -- 172.21.15.55:0/1064145854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff79804dbe0 con 0x7ff7980d0da0 2023-08-25T04:03:35.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.919+0000 7ff794ff9640 1 -- 172.21.15.55:0/1064145854 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff790017080 con 0x7ff7980d0da0 2023-08-25T04:03:35.920 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2023-08-25T04:03:35.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.919+0000 7ff79e9ba640 1 -- 172.21.15.55:0/1064145854 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff7840656b0 msgr2=0x7ff784067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:35.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.919+0000 7ff79e9ba640 1 --2- 172.21.15.55:0/1064145854 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff7840656b0 0x7ff784067b70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff78800a990 tx=0x7ff788008040 comp rx=0 tx=0).stop 2023-08-25T04:03:35.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.919+0000 7ff79e9ba640 1 -- 172.21.15.55:0/1064145854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7980d0da0 msgr2=0x7ff7980c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:35.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.919+0000 7ff79e9ba640 1 --2- 172.21.15.55:0/1064145854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7980d0da0 0x7ff7980c7c10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff79000cbc0 tx=0x7ff79000a430 comp rx=0 tx=0).stop 2023-08-25T04:03:35.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.919+0000 7ff79e9ba640 1 -- 172.21.15.55:0/1064145854 shutdown_connections 2023-08-25T04:03:35.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.919+0000 7ff79e9ba640 1 --2- 172.21.15.55:0/1064145854 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff7840656b0 0x7ff784067b70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.919+0000 7ff79e9ba640 1 --2- 172.21.15.55:0/1064145854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7980d0da0 0x7ff7980c7c10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.919+0000 7ff79e9ba640 1 --2- 172.21.15.55:0/1064145854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7980cee60 0x7ff7980cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.919+0000 7ff79e9ba640 1 --2- 172.21.15.55:0/1064145854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7980cdde0 0x7ff798151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:35.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.919+0000 7ff79e9ba640 1 -- 172.21.15.55:0/1064145854 >> 172.21.15.55:0/1064145854 conn(0x7ff79809bae0 msgr2=0x7ff7980cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:35.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.919+0000 7ff79e9ba640 1 -- 172.21.15.55:0/1064145854 shutdown_connections 2023-08-25T04:03:35.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:35.919+0000 7ff79e9ba640 1 -- 172.21.15.55:0/1064145854 wait complete. 2023-08-25T04:03:35.940 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-25T04:03:35.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:35.941 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-08-25T04:03:36.027 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T04:03:36.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:36.028 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-25T04:03:36.043 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:03:36.044 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:03:36.054 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:03:36.054 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:03:36.103 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:03:36.104 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:03:36.159 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:36.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.299+0000 7f25602d8640 1 Processor -- start 2023-08-25T04:03:36.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.299+0000 7f25602d8640 1 -- start start 2023-08-25T04:03:36.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.303+0000 7f25602d8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f25580ceeb0 0x7f25580cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:36.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.303+0000 7f25602d8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25580cc880 con 0x7f25580ad950 2023-08-25T04:03:36.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.303+0000 7f25602d8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25580ccb60 con 0x7f25580c89f0 2023-08-25T04:03:36.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.303+0000 7f25602d8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25580b11f0 con 0x7f25580ceeb0 2023-08-25T04:03:36.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.303+0000 7f255e074640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f25580ad950 0x7f25580ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45098/0 (socket says 172.21.15.55:45098) 2023-08-25T04:03:36.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.303+0000 7f255e074640 1 -- 172.21.15.55:0/1102806404 learned_addr learned my addr 172.21.15.55:0/1102806404 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:36.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.303+0000 7f255d873640 1 --2- 172.21.15.55:0/1102806404 >> v2:172.21.15.110:3300/0 conn(0x7f25580ceeb0 0x7f25580cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:36.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.303+0000 7f255d072640 1 -- 172.21.15.55:0/1102806404 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895139734 0 0) 0x7f25580cc880 con 0x7f25580ad950 2023-08-25T04:03:36.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.303+0000 7f255d072640 1 -- 172.21.15.55:0/1102806404 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2544003530 con 0x7f25580ad950 2023-08-25T04:03:36.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.303+0000 7f255d873640 1 -- 172.21.15.55:0/1102806404 >> v1:172.21.15.110:6789/0 conn(0x7f25580c89f0 legacy=0x7f25580b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:36.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.303+0000 7f255d873640 1 -- 172.21.15.55:0/1102806404 >> v1:172.21.15.55:6789/0 conn(0x7f25580ad950 legacy=0x7f25580ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:36.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.303+0000 7f255d072640 1 -- 172.21.15.55:0/1102806404 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4141876721 0 0) 0x7f2544003530 con 0x7f25580ad950 2023-08-25T04:03:36.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.303+0000 7f255d873640 1 -- 172.21.15.55:0/1102806404 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25580cce40 con 0x7f25580ceeb0 2023-08-25T04:03:36.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.307+0000 7f255d873640 1 --2- 172.21.15.55:0/1102806404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25580ceeb0 0x7f25580cc2a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f25480097c0 tx=0x7f254801e520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1523876fca93cdb6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:36.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.307+0000 7f255d072640 1 -- 172.21.15.55:0/1102806404 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2554001680 con 0x7f25580ceeb0 2023-08-25T04:03:36.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.307+0000 7f255d072640 1 -- 172.21.15.55:0/1102806404 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25480a9050 con 0x7f25580ceeb0 2023-08-25T04:03:36.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.307+0000 7f255d072640 1 -- 172.21.15.55:0/1102806404 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25480ad620 con 0x7f25580ceeb0 2023-08-25T04:03:36.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.307+0000 7f25602d8640 1 -- 172.21.15.55:0/1102806404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25580ceeb0 msgr2=0x7f25580cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:36.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.307+0000 7f25602d8640 1 --2- 172.21.15.55:0/1102806404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25580ceeb0 0x7f25580cc2a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f25480097c0 tx=0x7f254801e520 comp rx=0 tx=0).stop 2023-08-25T04:03:36.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.307+0000 7f25602d8640 1 -- 172.21.15.55:0/1102806404 shutdown_connections 2023-08-25T04:03:36.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.307+0000 7f25602d8640 1 --2- 172.21.15.55:0/1102806404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25580ceeb0 0x7f25580cc2a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:36.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.307+0000 7f25602d8640 1 -- 172.21.15.55:0/1102806404 >> 172.21.15.55:0/1102806404 conn(0x7f2558069d00 msgr2=0x7f255806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:36.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.307+0000 7f25602d8640 1 -- 172.21.15.55:0/1102806404 shutdown_connections 2023-08-25T04:03:36.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.307+0000 7f25602d8640 1 -- 172.21.15.55:0/1102806404 wait complete. 2023-08-25T04:03:36.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.307+0000 7f25602d8640 1 Processor -- start 2023-08-25T04:03:36.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.307+0000 7f25602d8640 1 -- start start 2023-08-25T04:03:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.307+0000 7f25602d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25580ad950 0x7f25580971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.307+0000 7f25602d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25580c89f0 0x7f25581548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.307+0000 7f25602d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25580ceeb0 0x7f2558152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f25602d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2558154e20 con 0x7f25580ceeb0 2023-08-25T04:03:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f25602d8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25580abd50 con 0x7f25580ad950 2023-08-25T04:03:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f25602d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25580ac030 con 0x7f25580c89f0 2023-08-25T04:03:36.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f255e875640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25580ceeb0 0x7f2558152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:36.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f255e875640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25580ceeb0 0x7f2558152200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33444/0 (socket says 172.21.15.55:33444) 2023-08-25T04:03:36.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f255e875640 1 -- 172.21.15.55:0/4035306783 learned_addr learned my addr 172.21.15.55:0/4035306783 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:36.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f255e074640 1 --2- 172.21.15.55:0/4035306783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25580ad950 0x7f25580971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:36.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f255e875640 1 -- 172.21.15.55:0/4035306783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25580c89f0 msgr2=0x7f25581548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:36.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f255d873640 1 --2- 172.21.15.55:0/4035306783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25580c89f0 0x7f25581548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:36.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f255e875640 1 --2- 172.21.15.55:0/4035306783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25580c89f0 0x7f25581548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:36.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f255e875640 1 -- 172.21.15.55:0/4035306783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25580ad950 msgr2=0x7f25580971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:36.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f255e875640 1 --2- 172.21.15.55:0/4035306783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25580ad950 0x7f25580971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:36.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f255e875640 1 -- 172.21.15.55:0/4035306783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2548009420 con 0x7f25580ceeb0 2023-08-25T04:03:36.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f255e875640 1 --2- 172.21.15.55:0/4035306783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25580ceeb0 0x7f2558152200 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f255000c770 tx=0x7f255000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:36.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f254effd640 1 -- 172.21.15.55:0/4035306783 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2550003b80 con 0x7f25580ceeb0 2023-08-25T04:03:36.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f254effd640 1 -- 172.21.15.55:0/4035306783 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2550003ce0 con 0x7f25580ceeb0 2023-08-25T04:03:36.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f254effd640 1 -- 172.21.15.55:0/4035306783 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255000aa90 con 0x7f25580ceeb0 2023-08-25T04:03:36.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f25602d8640 1 -- 172.21.15.55:0/4035306783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25580ac310 con 0x7f25580ceeb0 2023-08-25T04:03:36.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f25602d8640 1 -- 172.21.15.55:0/4035306783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25580ac8d0 con 0x7f25580ceeb0 2023-08-25T04:03:36.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f25602d8640 1 -- 172.21.15.55:0/4035306783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25580acac0 con 0x7f25580ceeb0 2023-08-25T04:03:36.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.311+0000 7f254effd640 1 -- 172.21.15.55:0/4035306783 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f255000abf0 con 0x7f25580ceeb0 2023-08-25T04:03:36.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.315+0000 7f254effd640 1 --2- 172.21.15.55:0/4035306783 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f253c065680 0x7f253c067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:36.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.315+0000 7f254effd640 1 -- 172.21.15.55:0/4035306783 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2550082d00 con 0x7f25580ceeb0 2023-08-25T04:03:36.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.315+0000 7f255e074640 1 --2- 172.21.15.55:0/4035306783 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f253c065680 0x7f253c067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:36.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.315+0000 7f255e074640 1 --2- 172.21.15.55:0/4035306783 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f253c065680 0x7f253c067b40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f25540011f0 tx=0x7f2554009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:36.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.315+0000 7f254effd640 1 -- 172.21.15.55:0/4035306783 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2550050720 con 0x7f25580ceeb0 2023-08-25T04:03:36.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.471+0000 7f25602d8640 1 -- 172.21.15.55:0/4035306783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f255804dbe0 con 0x7f25580ceeb0 2023-08-25T04:03:36.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.475+0000 7f254effd640 1 -- 172.21.15.55:0/4035306783 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18291 (secure 0 0 0) 0x7f2550080790 con 0x7f25580ceeb0 2023-08-25T04:03:36.504 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:36.504 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:02.329010+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:36.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.475+0000 7f25602d8640 1 -- 172.21.15.55:0/4035306783 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f253c065680 msgr2=0x7f253c067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:36.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.475+0000 7f25602d8640 1 --2- 172.21.15.55:0/4035306783 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f253c065680 0x7f253c067b40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f25540011f0 tx=0x7f2554009040 comp rx=0 tx=0).stop 2023-08-25T04:03:36.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.475+0000 7f25602d8640 1 -- 172.21.15.55:0/4035306783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25580ceeb0 msgr2=0x7f2558152200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:36.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.475+0000 7f25602d8640 1 --2- 172.21.15.55:0/4035306783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25580ceeb0 0x7f2558152200 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f255000c770 tx=0x7f255000cc30 comp rx=0 tx=0).stop 2023-08-25T04:03:36.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.475+0000 7f25602d8640 1 -- 172.21.15.55:0/4035306783 shutdown_connections 2023-08-25T04:03:36.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.475+0000 7f25602d8640 1 --2- 172.21.15.55:0/4035306783 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f253c065680 0x7f253c067b40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:36.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.475+0000 7f25602d8640 1 --2- 172.21.15.55:0/4035306783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25580ceeb0 0x7f2558152200 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:36.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.475+0000 7f25602d8640 1 --2- 172.21.15.55:0/4035306783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25580c89f0 0x7f25581548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:36.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.475+0000 7f25602d8640 1 --2- 172.21.15.55:0/4035306783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25580ad950 0x7f25580971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:36.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.475+0000 7f25602d8640 1 -- 172.21.15.55:0/4035306783 >> 172.21.15.55:0/4035306783 conn(0x7f2558069d00 msgr2=0x7f25580b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:36.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.475+0000 7f25602d8640 1 -- 172.21.15.55:0/4035306783 shutdown_connections 2023-08-25T04:03:36.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.475+0000 7f25602d8640 1 -- 172.21.15.55:0/4035306783 wait complete. 2023-08-25T04:03:36.509 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:02:58.890533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:03:00.093976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:03:36.510 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:03:36.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.663+0000 7fc95ef59640 1 Processor -- start 2023-08-25T04:03:36.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.663+0000 7fc95ef59640 1 -- start start 2023-08-25T04:03:36.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.667+0000 7fc95ef59640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc95806e5a0 0x7fc9580cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:36.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.667+0000 7fc95ef59640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc95806c790 0x7fc9580ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:36.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.667+0000 7fc95ef59640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9580cab90 con 0x7fc95806c3b0 2023-08-25T04:03:36.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.667+0000 7fc95ef59640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc95806dbb0 con 0x7fc95806e5a0 2023-08-25T04:03:36.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.667+0000 7fc95ef59640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9580cae50 con 0x7fc95806c790 2023-08-25T04:03:36.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.667+0000 7fc94ffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc95806e5a0 0x7fc9580cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:36.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.667+0000 7fc95d4f6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc95806c790 0x7fc9580ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:36.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.667+0000 7fc95d4f6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc95806c790 0x7fc9580ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:35250/0 (socket says 172.21.15.55:35250) 2023-08-25T04:03:36.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.667+0000 7fc95d4f6640 1 -- 172.21.15.55:0/2309659780 learned_addr learned my addr 172.21.15.55:0/2309659780 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:36.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.667+0000 7fc95d4f6640 1 -- 172.21.15.55:0/2309659780 >> v2:172.21.15.110:3300/0 conn(0x7fc95806e5a0 msgr2=0x7fc9580cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:36.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.667+0000 7fc95d4f6640 1 --2- 172.21.15.55:0/2309659780 >> v2:172.21.15.110:3300/0 conn(0x7fc95806e5a0 0x7fc9580cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:36.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.667+0000 7fc95d4f6640 1 -- 172.21.15.55:0/2309659780 >> v1:172.21.15.110:6789/0 conn(0x7fc95806c3b0 legacy=0x7fc95806de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:36.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.667+0000 7fc95d4f6640 1 -- 172.21.15.55:0/2309659780 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9580cb130 con 0x7fc95806c790 2023-08-25T04:03:36.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.667+0000 7fc94ffff640 1 --2- 172.21.15.55:0/2309659780 >> v2:172.21.15.110:3300/0 conn(0x7fc95806e5a0 0x7fc9580cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:36.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.671+0000 7fc95d4f6640 1 --2- 172.21.15.55:0/2309659780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc95806c790 0x7fc9580ce8b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc950009e50 tx=0x7fc95001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=646e1434dc2a63ef server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:36.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.671+0000 7fc94f7fe640 1 -- 172.21.15.55:0/2309659780 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9500a5890 con 0x7fc95806c790 2023-08-25T04:03:36.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.671+0000 7fc94f7fe640 1 -- 172.21.15.55:0/2309659780 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9500a59f0 con 0x7fc95806c790 2023-08-25T04:03:36.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.671+0000 7fc94f7fe640 1 -- 172.21.15.55:0/2309659780 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9500a5d80 con 0x7fc95806c790 2023-08-25T04:03:36.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.671+0000 7fc95ef59640 1 -- 172.21.15.55:0/2309659780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc95806c790 msgr2=0x7fc9580ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:36.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.671+0000 7fc95ef59640 1 --2- 172.21.15.55:0/2309659780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc95806c790 0x7fc9580ce8b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc950009e50 tx=0x7fc95001c9e0 comp rx=0 tx=0).stop 2023-08-25T04:03:36.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.671+0000 7fc95ef59640 1 -- 172.21.15.55:0/2309659780 shutdown_connections 2023-08-25T04:03:36.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.671+0000 7fc95ef59640 1 --2- 172.21.15.55:0/2309659780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc95806c790 0x7fc9580ce8b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:36.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.671+0000 7fc95ef59640 1 --2- 172.21.15.55:0/2309659780 >> v2:172.21.15.110:3300/0 conn(0x7fc95806e5a0 0x7fc9580cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:36.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.671+0000 7fc95ef59640 1 -- 172.21.15.55:0/2309659780 >> 172.21.15.55:0/2309659780 conn(0x7fc9580d0540 msgr2=0x7fc9580d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:36.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.671+0000 7fc95ef59640 1 -- 172.21.15.55:0/2309659780 shutdown_connections 2023-08-25T04:03:36.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.671+0000 7fc95ef59640 1 -- 172.21.15.55:0/2309659780 wait complete. 2023-08-25T04:03:36.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.671+0000 7fc95ef59640 1 Processor -- start 2023-08-25T04:03:36.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.671+0000 7fc95ef59640 1 -- start start 2023-08-25T04:03:36.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.671+0000 7fc95ef59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc95806c3b0 0x7fc9580c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:36.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.671+0000 7fc95ef59640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc95806c790 0x7fc9581545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:36.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.671+0000 7fc95ef59640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc95806e5a0 0x7fc9580c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:36.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc95ef59640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9580c8710 con 0x7fc95806c3b0 2023-08-25T04:03:36.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc95ef59640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc958154b00 con 0x7fc95806c790 2023-08-25T04:03:36.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc95ef59640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9580ca440 con 0x7fc95806e5a0 2023-08-25T04:03:36.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc95ccf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc95806c3b0 0x7fc9580c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:36.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc95ccf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc95806c3b0 0x7fc9580c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33454/0 (socket says 172.21.15.55:33454) 2023-08-25T04:03:36.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc95ccf5640 1 -- 172.21.15.55:0/1919269978 learned_addr learned my addr 172.21.15.55:0/1919269978 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:36.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc95d4f6640 1 --2- 172.21.15.55:0/1919269978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc95806e5a0 0x7fc9580c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:36.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc94ffff640 1 --2- 172.21.15.55:0/1919269978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc95806c790 0x7fc9581545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:36.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc95ccf5640 1 -- 172.21.15.55:0/1919269978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc95806e5a0 msgr2=0x7fc9580c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:36.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc95ccf5640 1 --2- 172.21.15.55:0/1919269978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc95806e5a0 0x7fc9580c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:36.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc95ccf5640 1 -- 172.21.15.55:0/1919269978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc95806c790 msgr2=0x7fc9581545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:36.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc95ccf5640 1 --2- 172.21.15.55:0/1919269978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc95806c790 0x7fc9581545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:36.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc95ccf5640 1 -- 172.21.15.55:0/1919269978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc948009420 con 0x7fc95806c3b0 2023-08-25T04:03:36.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc94ffff640 1 --2- 172.21.15.55:0/1919269978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc95806c790 0x7fc9581545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:36.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc95ccf5640 1 --2- 172.21.15.55:0/1919269978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc95806c3b0 0x7fc9580c81d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc95400c450 tx=0x7fc95400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:36.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc94d7fa640 1 -- 172.21.15.55:0/1919269978 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9540052d0 con 0x7fc95806c3b0 2023-08-25T04:03:36.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc94d7fa640 1 -- 172.21.15.55:0/1919269978 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc954005430 con 0x7fc95806c3b0 2023-08-25T04:03:36.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc94d7fa640 1 -- 172.21.15.55:0/1919269978 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954003890 con 0x7fc95806c3b0 2023-08-25T04:03:36.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc95ef59640 1 -- 172.21.15.55:0/1919269978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc950009b30 con 0x7fc95806c3b0 2023-08-25T04:03:36.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc95ef59640 1 -- 172.21.15.55:0/1919269978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9580b3440 con 0x7fc95806c3b0 2023-08-25T04:03:36.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc95ef59640 1 -- 172.21.15.55:0/1919269978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc958073ec0 con 0x7fc95806c3b0 2023-08-25T04:03:36.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc94d7fa640 1 -- 172.21.15.55:0/1919269978 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc9540039f0 con 0x7fc95806c3b0 2023-08-25T04:03:36.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.675+0000 7fc94d7fa640 1 --2- 172.21.15.55:0/1919269978 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc944065680 0x7fc944067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:36.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.679+0000 7fc94d7fa640 1 -- 172.21.15.55:0/1919269978 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc954082920 con 0x7fc95806c3b0 2023-08-25T04:03:36.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.679+0000 7fc94ffff640 1 --2- 172.21.15.55:0/1919269978 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc944065680 0x7fc944067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:36.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.679+0000 7fc94ffff640 1 --2- 172.21.15.55:0/1919269978 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc944065680 0x7fc944067b40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc9581f81e0 tx=0x7fc948008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:36.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.679+0000 7fc94d7fa640 1 -- 172.21.15.55:0/1919269978 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc954050340 con 0x7fc95806c3b0 2023-08-25T04:03:36.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.839+0000 7fc95ef59640 1 -- 172.21.15.55:0/1919269978 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc95806cc90 con 0x7fc95806c3b0 2023-08-25T04:03:36.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.839+0000 7fc94d7fa640 1 -- 172.21.15.55:0/1919269978 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc954053960 con 0x7fc95806c3b0 2023-08-25T04:03:36.843 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:03:36.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.843+0000 7fc95ef59640 1 -- 172.21.15.55:0/1919269978 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc944065680 msgr2=0x7fc944067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:36.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.843+0000 7fc95ef59640 1 --2- 172.21.15.55:0/1919269978 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc944065680 0x7fc944067b40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc9581f81e0 tx=0x7fc948008040 comp rx=0 tx=0).stop 2023-08-25T04:03:36.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.843+0000 7fc95ef59640 1 -- 172.21.15.55:0/1919269978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc95806c3b0 msgr2=0x7fc9580c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:36.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.843+0000 7fc95ef59640 1 --2- 172.21.15.55:0/1919269978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc95806c3b0 0x7fc9580c81d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc95400c450 tx=0x7fc95400c910 comp rx=0 tx=0).stop 2023-08-25T04:03:36.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.843+0000 7fc95ef59640 1 -- 172.21.15.55:0/1919269978 shutdown_connections 2023-08-25T04:03:36.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.843+0000 7fc95ef59640 1 --2- 172.21.15.55:0/1919269978 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc944065680 0x7fc944067b40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:36.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.843+0000 7fc95ef59640 1 --2- 172.21.15.55:0/1919269978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc95806e5a0 0x7fc9580c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:36.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.843+0000 7fc95ef59640 1 --2- 172.21.15.55:0/1919269978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc95806c790 0x7fc9581545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:36.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.843+0000 7fc95ef59640 1 --2- 172.21.15.55:0/1919269978 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc95806c3b0 0x7fc9580c81d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:36.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.843+0000 7fc95ef59640 1 -- 172.21.15.55:0/1919269978 >> 172.21.15.55:0/1919269978 conn(0x7fc9580d0540 msgr2=0x7fc9580d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:36.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.843+0000 7fc95ef59640 1 -- 172.21.15.55:0/1919269978 shutdown_connections 2023-08-25T04:03:36.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:36.843+0000 7fc95ef59640 1 -- 172.21.15.55:0/1919269978 wait complete. 2023-08-25T04:03:36.864 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:03:37.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.011+0000 7f6ebd72c640 1 Processor -- start 2023-08-25T04:03:37.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.011+0000 7f6ebd72c640 1 -- start start 2023-08-25T04:03:37.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.011+0000 7f6ebd72c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6eb806c3b0 0x7f6eb80cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.011+0000 7f6ebd72c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6eb806c790 0x7f6eb806de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.011+0000 7f6ebd72c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb80cab90 con 0x7f6eb80d1060 2023-08-25T04:03:37.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.011+0000 7f6ebd72c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb806dbb0 con 0x7f6eb806c790 2023-08-25T04:03:37.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.011+0000 7f6ebd72c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb80cae50 con 0x7f6eb806c3b0 2023-08-25T04:03:37.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.011+0000 7f6eb67fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6eb806c790 0x7f6eb806de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.011+0000 7f6eb67fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6eb806c790 0x7f6eb806de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33468/0 (socket says 172.21.15.55:33468) 2023-08-25T04:03:37.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.011+0000 7f6eb67fc640 1 -- 172.21.15.55:0/2347531026 learned_addr learned my addr 172.21.15.55:0/2347531026 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:37.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.011+0000 7f6eb6ffd640 1 --2- 172.21.15.55:0/2347531026 >> v2:172.21.15.110:3300/0 conn(0x7f6eb806c3b0 0x7f6eb80cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.011+0000 7f6eb67fc640 1 -- 172.21.15.55:0/2347531026 >> v2:172.21.15.110:3300/0 conn(0x7f6eb806c3b0 msgr2=0x7f6eb80cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:37.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.011+0000 7f6eb67fc640 1 --2- 172.21.15.55:0/2347531026 >> v2:172.21.15.110:3300/0 conn(0x7f6eb806c3b0 0x7f6eb80cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.011+0000 7f6eb67fc640 1 -- 172.21.15.55:0/2347531026 >> v1:172.21.15.110:6789/0 conn(0x7f6eb80d1060 legacy=0x7f6eb815c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:37.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.011+0000 7f6eb67fc640 1 -- 172.21.15.55:0/2347531026 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb80cb130 con 0x7f6eb806c790 2023-08-25T04:03:37.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.015+0000 7f6eb67fc640 1 --2- 172.21.15.55:0/2347531026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb806c790 0x7f6eb806de90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80718a0 tx=0x7f6eac01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8667b3536abfe60c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:37.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.015+0000 7f6eb5ffb640 1 -- 172.21.15.55:0/2347531026 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0ac640 con 0x7f6eb806c790 2023-08-25T04:03:37.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.015+0000 7f6eb5ffb640 1 -- 172.21.15.55:0/2347531026 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac0ac7a0 con 0x7f6eb806c790 2023-08-25T04:03:37.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.015+0000 7f6eb5ffb640 1 -- 172.21.15.55:0/2347531026 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0acb30 con 0x7f6eb806c790 2023-08-25T04:03:37.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.015+0000 7f6ebd72c640 1 -- 172.21.15.55:0/2347531026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb806c790 msgr2=0x7f6eb806de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:37.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.015+0000 7f6ebd72c640 1 --2- 172.21.15.55:0/2347531026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb806c790 0x7f6eb806de90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80718a0 tx=0x7f6eac01c4d0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.015+0000 7f6ebd72c640 1 -- 172.21.15.55:0/2347531026 shutdown_connections 2023-08-25T04:03:37.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.015+0000 7f6ebd72c640 1 --2- 172.21.15.55:0/2347531026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb806c790 0x7f6eb806de90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.015+0000 7f6ebd72c640 1 --2- 172.21.15.55:0/2347531026 >> v2:172.21.15.110:3300/0 conn(0x7f6eb806c3b0 0x7f6eb80cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.015+0000 7f6ebd72c640 1 -- 172.21.15.55:0/2347531026 >> 172.21.15.55:0/2347531026 conn(0x7f6eb80d0540 msgr2=0x7f6eb80d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:37.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.015+0000 7f6ebd72c640 1 -- 172.21.15.55:0/2347531026 shutdown_connections 2023-08-25T04:03:37.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.015+0000 7f6ebd72c640 1 -- 172.21.15.55:0/2347531026 wait complete. 2023-08-25T04:03:37.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.015+0000 7f6ebd72c640 1 Processor -- start 2023-08-25T04:03:37.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6ebd72c640 1 -- start start 2023-08-25T04:03:37.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6ebd72c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb806c3b0 0x7f6eb814f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6ebd72c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eb806c790 0x7f6eb81531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6ebd72c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eb80d1060 0x7f6eb80cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6ebd72c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8153af0 con 0x7f6eb806c3b0 2023-08-25T04:03:37.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6ebd72c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8153dd0 con 0x7f6eb806c790 2023-08-25T04:03:37.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6ebd72c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb81540b0 con 0x7f6eb80d1060 2023-08-25T04:03:37.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6eb6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb806c3b0 0x7f6eb814f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6eb6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb806c3b0 0x7f6eb814f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33474/0 (socket says 172.21.15.55:33474) 2023-08-25T04:03:37.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6eb6ffd640 1 -- 172.21.15.55:0/3666857755 learned_addr learned my addr 172.21.15.55:0/3666857755 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:37.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6eb77fe640 1 --2- 172.21.15.55:0/3666857755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eb80d1060 0x7f6eb80cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6eb67fc640 1 --2- 172.21.15.55:0/3666857755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eb806c790 0x7f6eb81531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6eb6ffd640 1 -- 172.21.15.55:0/3666857755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eb80d1060 msgr2=0x7f6eb80cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:37.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6eb6ffd640 1 --2- 172.21.15.55:0/3666857755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eb80d1060 0x7f6eb80cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6eb6ffd640 1 -- 172.21.15.55:0/3666857755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eb806c790 msgr2=0x7f6eb81531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:37.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6eb6ffd640 1 --2- 172.21.15.55:0/3666857755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eb806c790 0x7f6eb81531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6eb6ffd640 1 -- 172.21.15.55:0/3666857755 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac0094d0 con 0x7f6eb806c3b0 2023-08-25T04:03:37.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6eb67fc640 1 --2- 172.21.15.55:0/3666857755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eb806c790 0x7f6eb81531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:37.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6eb77fe640 1 --2- 172.21.15.55:0/3666857755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eb80d1060 0x7f6eb80cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:37.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6eb6ffd640 1 --2- 172.21.15.55:0/3666857755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb806c3b0 0x7f6eb814f9c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800e9b0 tx=0x7f6ea800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:37.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6e9f7fe640 1 -- 172.21.15.55:0/3666857755 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8009670 con 0x7f6eb806c3b0 2023-08-25T04:03:37.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6e9f7fe640 1 -- 172.21.15.55:0/3666857755 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea800c9a0 con 0x7f6eb806c3b0 2023-08-25T04:03:37.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6ebd72c640 1 -- 172.21.15.55:0/3666857755 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb8154390 con 0x7f6eb806c3b0 2023-08-25T04:03:37.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6e9f7fe640 1 -- 172.21.15.55:0/3666857755 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea800cd10 con 0x7f6eb806c3b0 2023-08-25T04:03:37.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6ebd72c640 1 -- 172.21.15.55:0/3666857755 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb814ff00 con 0x7f6eb806c3b0 2023-08-25T04:03:37.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.019+0000 7f6ebd72c640 1 -- 172.21.15.55:0/3666857755 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb8073ec0 con 0x7f6eb806c3b0 2023-08-25T04:03:37.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.023+0000 7f6e9f7fe640 1 -- 172.21.15.55:0/3666857755 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6ea8013470 con 0x7f6eb806c3b0 2023-08-25T04:03:37.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.023+0000 7f6e9f7fe640 1 --2- 172.21.15.55:0/3666857755 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6ea40656b0 0x7f6ea4067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.023+0000 7f6e9f7fe640 1 -- 172.21.15.55:0/3666857755 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ea80835a0 con 0x7f6eb806c3b0 2023-08-25T04:03:37.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.023+0000 7f6eb67fc640 1 --2- 172.21.15.55:0/3666857755 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6ea40656b0 0x7f6ea4067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.023+0000 7f6eb67fc640 1 --2- 172.21.15.55:0/3666857755 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6ea40656b0 0x7f6ea4067b70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0ae000 tx=0x7f6eac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:37.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.027+0000 7f6e9f7fe640 1 -- 172.21.15.55:0/3666857755 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6ea8050eb0 con 0x7f6eb806c3b0 2023-08-25T04:03:37.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.183+0000 7f6ebd72c640 1 -- 172.21.15.55:0/3666857755 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6eb80d0210 con 0x7f6eb806c3b0 2023-08-25T04:03:37.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.183+0000 7f6e9f7fe640 1 -- 172.21.15.55:0/3666857755 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6ea8017020 con 0x7f6eb806c3b0 2023-08-25T04:03:37.187 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:03:37.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.187+0000 7f6ebd72c640 1 -- 172.21.15.55:0/3666857755 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6ea40656b0 msgr2=0x7f6ea4067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:37.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.187+0000 7f6ebd72c640 1 --2- 172.21.15.55:0/3666857755 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6ea40656b0 0x7f6ea4067b70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0ae000 tx=0x7f6eac008040 comp rx=0 tx=0).stop 2023-08-25T04:03:37.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.187+0000 7f6ebd72c640 1 -- 172.21.15.55:0/3666857755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb806c3b0 msgr2=0x7f6eb814f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:37.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.187+0000 7f6ebd72c640 1 --2- 172.21.15.55:0/3666857755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb806c3b0 0x7f6eb814f9c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800e9b0 tx=0x7f6ea800ee70 comp rx=0 tx=0).stop 2023-08-25T04:03:37.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.187+0000 7f6ebd72c640 1 -- 172.21.15.55:0/3666857755 shutdown_connections 2023-08-25T04:03:37.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.187+0000 7f6ebd72c640 1 --2- 172.21.15.55:0/3666857755 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6ea40656b0 0x7f6ea4067b70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.187+0000 7f6ebd72c640 1 --2- 172.21.15.55:0/3666857755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6eb80d1060 0x7f6eb80cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.187+0000 7f6ebd72c640 1 --2- 172.21.15.55:0/3666857755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6eb806c790 0x7f6eb81531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.187+0000 7f6ebd72c640 1 --2- 172.21.15.55:0/3666857755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6eb806c3b0 0x7f6eb814f9c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.187+0000 7f6ebd72c640 1 -- 172.21.15.55:0/3666857755 >> 172.21.15.55:0/3666857755 conn(0x7f6eb80d0540 msgr2=0x7f6eb80b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:37.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.187+0000 7f6ebd72c640 1 -- 172.21.15.55:0/3666857755 shutdown_connections 2023-08-25T04:03:37.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.187+0000 7f6ebd72c640 1 -- 172.21.15.55:0/3666857755 wait complete. 2023-08-25T04:03:37.207 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:03:37.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.351+0000 7f578b582640 1 Processor -- start 2023-08-25T04:03:37.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.351+0000 7f578b582640 1 -- start start 2023-08-25T04:03:37.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.351+0000 7f578b582640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57840c9900 0x7f57840cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.351+0000 7f578b582640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f578406c720 0x7f578406cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.351+0000 7f578b582640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57840c9d90 con 0x7f57840cb020 2023-08-25T04:03:37.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.351+0000 7f578b582640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578406d0d0 con 0x7f578406c720 2023-08-25T04:03:37.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.351+0000 7f578b582640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57840cbca0 con 0x7f57840c9900 2023-08-25T04:03:37.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.351+0000 7f5789b1f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f578406c720 0x7f578406cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.351+0000 7f5788b1d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57840c9900 0x7f57840cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.351+0000 7f5789b1f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f578406c720 0x7f578406cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33488/0 (socket says 172.21.15.55:33488) 2023-08-25T04:03:37.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.351+0000 7f5789b1f640 1 -- 172.21.15.55:0/3503460571 learned_addr learned my addr 172.21.15.55:0/3503460571 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:37.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.351+0000 7f578931e640 1 --1- 172.21.15.55:0/3503460571 >> v1:172.21.15.110:6789/0 conn(0x7f57840cb020 0x7f57840cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:53920/0 (socket says 172.21.15.55:53920) 2023-08-25T04:03:37.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.351+0000 7f5789b1f640 1 -- 172.21.15.55:0/3503460571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57840c9900 msgr2=0x7f57840cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:37.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.351+0000 7f5789b1f640 1 --2- 172.21.15.55:0/3503460571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57840c9900 0x7f57840cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.351+0000 7f5789b1f640 1 -- 172.21.15.55:0/3503460571 >> v1:172.21.15.110:6789/0 conn(0x7f57840cb020 legacy=0x7f57840cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:37.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.355+0000 7f5789b1f640 1 -- 172.21.15.55:0/3503460571 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57840c9470 con 0x7f578406c720 2023-08-25T04:03:37.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.355+0000 7f5789b1f640 1 --2- 172.21.15.55:0/3503460571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f578406c720 0x7f578406cb90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f577c009e50 tx=0x7f577c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89766fa85761971b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:37.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.355+0000 7f577bfff640 1 -- 172.21.15.55:0/3503460571 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0a5640 con 0x7f578406c720 2023-08-25T04:03:37.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.355+0000 7f577bfff640 1 -- 172.21.15.55:0/3503460571 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c0a57a0 con 0x7f578406c720 2023-08-25T04:03:37.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.355+0000 7f577bfff640 1 -- 172.21.15.55:0/3503460571 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c0a5b30 con 0x7f578406c720 2023-08-25T04:03:37.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.355+0000 7f578b582640 1 -- 172.21.15.55:0/3503460571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f578406c720 msgr2=0x7f578406cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:37.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.355+0000 7f578b582640 1 --2- 172.21.15.55:0/3503460571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f578406c720 0x7f578406cb90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f577c009e50 tx=0x7f577c01c980 comp rx=0 tx=0).stop 2023-08-25T04:03:37.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.355+0000 7f578b582640 1 -- 172.21.15.55:0/3503460571 shutdown_connections 2023-08-25T04:03:37.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.355+0000 7f578b582640 1 --2- 172.21.15.55:0/3503460571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f578406c720 0x7f578406cb90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.355+0000 7f578b582640 1 --2- 172.21.15.55:0/3503460571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57840c9900 0x7f57840cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.355+0000 7f578b582640 1 -- 172.21.15.55:0/3503460571 >> 172.21.15.55:0/3503460571 conn(0x7f5784069900 msgr2=0x7f5784069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:37.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.355+0000 7f578b582640 1 -- 172.21.15.55:0/3503460571 shutdown_connections 2023-08-25T04:03:37.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.355+0000 7f578b582640 1 -- 172.21.15.55:0/3503460571 wait complete. 2023-08-25T04:03:37.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f578b582640 1 Processor -- start 2023-08-25T04:03:37.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f578b582640 1 -- start start 2023-08-25T04:03:37.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f578b582640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f578406c720 0x7f57840b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f578b582640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57840c9900 0x7f5784159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f578b582640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57840cb020 0x7f578406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f578b582640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57841f8dc0 con 0x7f57840c9900 2023-08-25T04:03:37.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f578b582640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57841f90a0 con 0x7f578406c720 2023-08-25T04:03:37.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f578b582640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57841f9380 con 0x7f57840cb020 2023-08-25T04:03:37.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f5788b1d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57840c9900 0x7f5784159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f5788b1d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57840c9900 0x7f5784159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33498/0 (socket says 172.21.15.55:33498) 2023-08-25T04:03:37.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f5788b1d640 1 -- 172.21.15.55:0/555796323 learned_addr learned my addr 172.21.15.55:0/555796323 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:37.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f5789b1f640 1 --2- 172.21.15.55:0/555796323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57840cb020 0x7f578406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f578931e640 1 --2- 172.21.15.55:0/555796323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f578406c720 0x7f57840b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f5788b1d640 1 -- 172.21.15.55:0/555796323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57840cb020 msgr2=0x7f578406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:37.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f5788b1d640 1 --2- 172.21.15.55:0/555796323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57840cb020 0x7f578406fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f5788b1d640 1 -- 172.21.15.55:0/555796323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f578406c720 msgr2=0x7f57840b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:37.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f5788b1d640 1 --2- 172.21.15.55:0/555796323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f578406c720 0x7f57840b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f5788b1d640 1 -- 172.21.15.55:0/555796323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c009b30 con 0x7f57840c9900 2023-08-25T04:03:37.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f578931e640 1 --2- 172.21.15.55:0/555796323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f578406c720 0x7f57840b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:37.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f5788b1d640 1 --2- 172.21.15.55:0/555796323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57840c9900 0x7f5784159a30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f577400e930 tx=0x7f577400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:37.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f5779ffb640 1 -- 172.21.15.55:0/555796323 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774009690 con 0x7f57840c9900 2023-08-25T04:03:37.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f5779ffb640 1 -- 172.21.15.55:0/555796323 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577400ca00 con 0x7f57840c9900 2023-08-25T04:03:37.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f5779ffb640 1 -- 172.21.15.55:0/555796323 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577400cd70 con 0x7f57840c9900 2023-08-25T04:03:37.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.359+0000 7f578b582640 1 -- 172.21.15.55:0/555796323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57841f5320 con 0x7f57840c9900 2023-08-25T04:03:37.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.363+0000 7f578b582640 1 -- 172.21.15.55:0/555796323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57841f9660 con 0x7f57840c9900 2023-08-25T04:03:37.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.363+0000 7f578b582640 1 -- 172.21.15.55:0/555796323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5784073ec0 con 0x7f57840c9900 2023-08-25T04:03:37.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.363+0000 7f5779ffb640 1 -- 172.21.15.55:0/555796323 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5774013470 con 0x7f57840c9900 2023-08-25T04:03:37.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.363+0000 7f5779ffb640 1 --2- 172.21.15.55:0/555796323 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5768065680 0x7f5768067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.363+0000 7f5779ffb640 1 -- 172.21.15.55:0/555796323 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5774083100 con 0x7f57840c9900 2023-08-25T04:03:37.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.363+0000 7f578931e640 1 --2- 172.21.15.55:0/555796323 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5768065680 0x7f5768067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.363+0000 7f578931e640 1 --2- 172.21.15.55:0/555796323 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5768065680 0x7f5768067b40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5780000fc0 tx=0x7f5780007d00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:37.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.367+0000 7f5779ffb640 1 -- 172.21.15.55:0/555796323 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5774050c90 con 0x7f57840c9900 2023-08-25T04:03:37.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.519+0000 7f578b582640 1 -- 172.21.15.55:0/555796323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f57840cc230 con 0x7f57840c9900 2023-08-25T04:03:37.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.523+0000 7f5779ffb640 1 -- 172.21.15.55:0/555796323 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f57740542b0 con 0x7f57840c9900 2023-08-25T04:03:37.523 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:03:37.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.523+0000 7f578b582640 1 -- 172.21.15.55:0/555796323 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5768065680 msgr2=0x7f5768067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:37.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.523+0000 7f578b582640 1 --2- 172.21.15.55:0/555796323 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5768065680 0x7f5768067b40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5780000fc0 tx=0x7f5780007d00 comp rx=0 tx=0).stop 2023-08-25T04:03:37.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.523+0000 7f578b582640 1 -- 172.21.15.55:0/555796323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57840c9900 msgr2=0x7f5784159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:37.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.523+0000 7f578b582640 1 --2- 172.21.15.55:0/555796323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57840c9900 0x7f5784159a30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f577400e930 tx=0x7f577400edf0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.523+0000 7f578b582640 1 -- 172.21.15.55:0/555796323 shutdown_connections 2023-08-25T04:03:37.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.523+0000 7f578b582640 1 --2- 172.21.15.55:0/555796323 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5768065680 0x7f5768067b40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.523+0000 7f578b582640 1 --2- 172.21.15.55:0/555796323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57840cb020 0x7f578406fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.523+0000 7f578b582640 1 --2- 172.21.15.55:0/555796323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57840c9900 0x7f5784159a30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.523+0000 7f578b582640 1 --2- 172.21.15.55:0/555796323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f578406c720 0x7f57840b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.523+0000 7f578b582640 1 -- 172.21.15.55:0/555796323 >> 172.21.15.55:0/555796323 conn(0x7f5784069900 msgr2=0x7f57840b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:37.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.523+0000 7f578b582640 1 -- 172.21.15.55:0/555796323 shutdown_connections 2023-08-25T04:03:37.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.523+0000 7f578b582640 1 -- 172.21.15.55:0/555796323 wait complete. 2023-08-25T04:03:37.546 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:03:37.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c0b256640 1 Processor -- start 2023-08-25T04:03:37.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c0b256640 1 -- start start 2023-08-25T04:03:37.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c0b256640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1c041601f0 0x7f1c0415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c0b256640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c0415e3c0 0x7f1c040d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c0b256640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0415f8b0 con 0x7f1c040d10c0 2023-08-25T04:03:37.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c0b256640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c040cd5a0 con 0x7f1c041601f0 2023-08-25T04:03:37.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c0b256640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040cd880 con 0x7f1c0415e3c0 2023-08-25T04:03:37.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c097f3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1c040d10c0 0x7f1c040b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45104/0 (socket says 172.21.15.55:45104) 2023-08-25T04:03:37.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c097f3640 1 -- 172.21.15.55:0/3838205204 learned_addr learned my addr 172.21.15.55:0/3838205204 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:37.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c08ff2640 1 --2- 172.21.15.55:0/3838205204 >> v2:172.21.15.110:3300/0 conn(0x7f1c041601f0 0x7f1c0415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c03fff640 1 --2- 172.21.15.55:0/3838205204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c0415e3c0 0x7f1c040d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c037fe640 1 -- 172.21.15.55:0/3838205204 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016798170 0 0) 0x7f1c0415f8b0 con 0x7f1c040d10c0 2023-08-25T04:03:37.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c037fe640 1 -- 172.21.15.55:0/3838205204 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bf4003530 con 0x7f1c040d10c0 2023-08-25T04:03:37.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c037fe640 1 -- 172.21.15.55:0/3838205204 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1328837771 0 0) 0x7f1bf4003530 con 0x7f1c040d10c0 2023-08-25T04:03:37.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c037fe640 1 -- 172.21.15.55:0/3838205204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c0415e3c0 msgr2=0x7f1c040d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:37.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c037fe640 1 --2- 172.21.15.55:0/3838205204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c0415e3c0 0x7f1c040d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c037fe640 1 -- 172.21.15.55:0/3838205204 >> v2:172.21.15.110:3300/0 conn(0x7f1c041601f0 msgr2=0x7f1c0415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:37.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c037fe640 1 --2- 172.21.15.55:0/3838205204 >> v2:172.21.15.110:3300/0 conn(0x7f1c041601f0 0x7f1c0415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c037fe640 1 -- 172.21.15.55:0/3838205204 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c040cdb60 con 0x7f1c040d10c0 2023-08-25T04:03:37.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c037fe640 1 -- 172.21.15.55:0/3838205204 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f1bfc001a00 con 0x7f1c040d10c0 2023-08-25T04:03:37.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c08ff2640 1 --2- 172.21.15.55:0/3838205204 >> v2:172.21.15.110:3300/0 conn(0x7f1c041601f0 0x7f1c0415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:37.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.695+0000 7f1c037fe640 1 -- 172.21.15.55:0/3838205204 >> v1:172.21.15.55:6789/0 conn(0x7f1c040d10c0 legacy=0x7f1c040b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:37.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c037fe640 1 --2- 172.21.15.55:0/3838205204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf4003980 0x7f1bf4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c037fe640 1 --2- 172.21.15.55:0/3838205204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c0415e3c0 0x7f1bf40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c037fe640 1 --2- 172.21.15.55:0/3838205204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bf4004d10 0x7f1bf4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c037fe640 1 -- 172.21.15.55:0/3838205204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040cd5a0 con 0x7f1bf4003980 2023-08-25T04:03:37.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c037fe640 1 -- 172.21.15.55:0/3838205204 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040cd880 con 0x7f1bf4004d10 2023-08-25T04:03:37.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c037fe640 1 -- 172.21.15.55:0/3838205204 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf400b9c0 con 0x7f1c0415e3c0 2023-08-25T04:03:37.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c08ff2640 1 --2- 172.21.15.55:0/3838205204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf4003980 0x7f1bf4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c03fff640 1 --2- 172.21.15.55:0/3838205204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c0415e3c0 0x7f1bf40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c097f3640 1 --2- 172.21.15.55:0/3838205204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bf4004d10 0x7f1bf4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c08ff2640 1 -- 172.21.15.55:0/3838205204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c0415e3c0 msgr2=0x7f1bf40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:37.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c08ff2640 1 --2- 172.21.15.55:0/3838205204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c0415e3c0 0x7f1bf40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c08ff2640 1 -- 172.21.15.55:0/3838205204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bf4004d10 msgr2=0x7f1bf4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:37.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c08ff2640 1 --2- 172.21.15.55:0/3838205204 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1bf4004d10 0x7f1bf4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c08ff2640 1 -- 172.21.15.55:0/3838205204 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf4003530 con 0x7f1bf4003980 2023-08-25T04:03:37.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c03fff640 1 --2- 172.21.15.55:0/3838205204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c0415e3c0 0x7f1bf40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:37.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c08ff2640 1 --2- 172.21.15.55:0/3838205204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf4003980 0x7f1bf4003da0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8009c90 tx=0x7f1bf801cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f1e3574741da0f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:37.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c037fe640 1 -- 172.21.15.55:0/3838205204 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf80a5800 con 0x7f1bf4003980 2023-08-25T04:03:37.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c037fe640 1 -- 172.21.15.55:0/3838205204 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf80a5960 con 0x7f1bf4003980 2023-08-25T04:03:37.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.699+0000 7f1c037fe640 1 -- 172.21.15.55:0/3838205204 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf80a5d10 con 0x7f1bf4003980 2023-08-25T04:03:37.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c0b256640 1 -- 172.21.15.55:0/3838205204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf4003980 msgr2=0x7f1bf4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:37.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c0b256640 1 --2- 172.21.15.55:0/3838205204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf4003980 0x7f1bf4003da0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8009c90 tx=0x7f1bf801cc50 comp rx=0 tx=0).stop 2023-08-25T04:03:37.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c097f3640 1 -- 172.21.15.55:0/3838205204 reap_dead start 2023-08-25T04:03:37.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c0b256640 1 -- 172.21.15.55:0/3838205204 shutdown_connections 2023-08-25T04:03:37.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c0b256640 1 -- 172.21.15.55:0/3838205204 >> 172.21.15.55:0/3838205204 conn(0x7f1c040d27d0 msgr2=0x7f1c040d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:37.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c0b256640 1 -- 172.21.15.55:0/3838205204 shutdown_connections 2023-08-25T04:03:37.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c0b256640 1 -- 172.21.15.55:0/3838205204 wait complete. 2023-08-25T04:03:37.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c0b256640 1 Processor -- start 2023-08-25T04:03:37.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c0b256640 1 -- start start 2023-08-25T04:03:37.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c0b256640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf4003980 0x7f1c041525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c0b256640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c04152df0 0x7f1c040c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c0b256640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c040c8280 0x7f1c040c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c0b256640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040c8c40 con 0x7f1bf4003980 2023-08-25T04:03:37.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c0b256640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040caec0 con 0x7f1c04152df0 2023-08-25T04:03:37.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c0b256640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040ca110 con 0x7f1c040c8280 2023-08-25T04:03:37.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c08ff2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf4003980 0x7f1c041525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c08ff2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf4003980 0x7f1c041525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33508/0 (socket says 172.21.15.55:33508) 2023-08-25T04:03:37.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c08ff2640 1 -- 172.21.15.55:0/2598644271 learned_addr learned my addr 172.21.15.55:0/2598644271 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:37.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c03fff640 1 --2- 172.21.15.55:0/2598644271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c04152df0 0x7f1c040c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.703+0000 7f1c097f3640 1 --2- 172.21.15.55:0/2598644271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c040c8280 0x7f1c040c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.707+0000 7f1c08ff2640 1 -- 172.21.15.55:0/2598644271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c040c8280 msgr2=0x7f1c040c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:37.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.707+0000 7f1c08ff2640 1 --2- 172.21.15.55:0/2598644271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c040c8280 0x7f1c040c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.707+0000 7f1c08ff2640 1 -- 172.21.15.55:0/2598644271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c04152df0 msgr2=0x7f1c040c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:37.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.707+0000 7f1c08ff2640 1 --2- 172.21.15.55:0/2598644271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c04152df0 0x7f1c040c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.707+0000 7f1c08ff2640 1 -- 172.21.15.55:0/2598644271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c040ca3f0 con 0x7f1bf4003980 2023-08-25T04:03:37.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.707+0000 7f1c08ff2640 1 --2- 172.21.15.55:0/2598644271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf4003980 0x7f1c041525e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1bf80b0040 tx=0x7f1bf4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:37.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.707+0000 7f1c017fa640 1 -- 172.21.15.55:0/2598644271 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8004220 con 0x7f1bf4003980 2023-08-25T04:03:37.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.707+0000 7f1c017fa640 1 -- 172.21.15.55:0/2598644271 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf80043a0 con 0x7f1bf4003980 2023-08-25T04:03:37.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.707+0000 7f1c017fa640 1 -- 172.21.15.55:0/2598644271 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8004510 con 0x7f1bf4003980 2023-08-25T04:03:37.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.707+0000 7f1c0b256640 1 -- 172.21.15.55:0/2598644271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c040ca6d0 con 0x7f1bf4003980 2023-08-25T04:03:37.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.707+0000 7f1c0b256640 1 -- 172.21.15.55:0/2598644271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c040ca9b0 con 0x7f1bf4003980 2023-08-25T04:03:37.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.707+0000 7f1c0b256640 1 -- 172.21.15.55:0/2598644271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c040b5260 con 0x7f1bf4003980 2023-08-25T04:03:37.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.707+0000 7f1c017fa640 1 -- 172.21.15.55:0/2598644271 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1bf80b4040 con 0x7f1bf4003980 2023-08-25T04:03:37.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.707+0000 7f1c017fa640 1 --2- 172.21.15.55:0/2598644271 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1be8065680 0x7f1be8067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:37.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.707+0000 7f1c017fa640 1 -- 172.21.15.55:0/2598644271 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1bf811cc20 con 0x7f1bf4003980 2023-08-25T04:03:37.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.707+0000 7f1c03fff640 1 --2- 172.21.15.55:0/2598644271 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1be8065680 0x7f1be8067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:37.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.711+0000 7f1c03fff640 1 --2- 172.21.15.55:0/2598644271 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1be8065680 0x7f1be8067b40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1c040c8fb0 tx=0x7f1bf0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:37.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.711+0000 7f1c017fa640 1 -- 172.21.15.55:0/2598644271 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1bf80ea660 con 0x7f1bf4003980 2023-08-25T04:03:37.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.867+0000 7f1c0b256640 1 -- 172.21.15.55:0/2598644271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1c040b40c0 con 0x7f1bf4003980 2023-08-25T04:03:37.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.867+0000 7f1c017fa640 1 -- 172.21.15.55:0/2598644271 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1bf80be020 con 0x7f1bf4003980 2023-08-25T04:03:37.871 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:03:37.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.871+0000 7f1c0b256640 1 -- 172.21.15.55:0/2598644271 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1be8065680 msgr2=0x7f1be8067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:37.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.871+0000 7f1c0b256640 1 --2- 172.21.15.55:0/2598644271 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1be8065680 0x7f1be8067b40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1c040c8fb0 tx=0x7f1bf0008040 comp rx=0 tx=0).stop 2023-08-25T04:03:37.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.871+0000 7f1c0b256640 1 -- 172.21.15.55:0/2598644271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf4003980 msgr2=0x7f1c041525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:37.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.871+0000 7f1c0b256640 1 --2- 172.21.15.55:0/2598644271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf4003980 0x7f1c041525e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1bf80b0040 tx=0x7f1bf4005800 comp rx=0 tx=0).stop 2023-08-25T04:03:37.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.871+0000 7f1c0b256640 1 -- 172.21.15.55:0/2598644271 shutdown_connections 2023-08-25T04:03:37.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.871+0000 7f1c0b256640 1 --2- 172.21.15.55:0/2598644271 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1be8065680 0x7f1be8067b40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.871+0000 7f1c0b256640 1 --2- 172.21.15.55:0/2598644271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c040c8280 0x7f1c040c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.871+0000 7f1c0b256640 1 --2- 172.21.15.55:0/2598644271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c04152df0 0x7f1c040c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.871+0000 7f1c0b256640 1 --2- 172.21.15.55:0/2598644271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf4003980 0x7f1c041525e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:37.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.871+0000 7f1c0b256640 1 -- 172.21.15.55:0/2598644271 >> 172.21.15.55:0/2598644271 conn(0x7f1c040d27d0 msgr2=0x7f1c040b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:37.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.871+0000 7f1c0b256640 1 -- 172.21.15.55:0/2598644271 shutdown_connections 2023-08-25T04:03:37.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:37.871+0000 7f1c0b256640 1 -- 172.21.15.55:0/2598644271 wait complete. 2023-08-25T04:03:37.892 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:03:38.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.035+0000 7fef6086d640 1 Processor -- start 2023-08-25T04:03:38.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.035+0000 7fef6086d640 1 -- start start 2023-08-25T04:03:38.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.035+0000 7fef6086d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fef5c0ad950 0x7fef5c0cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:38.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.035+0000 7fef6086d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fef5c0ceeb0 0x7fef5c0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:38.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.035+0000 7fef6086d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5c0cc880 con 0x7fef5c0c89f0 2023-08-25T04:03:38.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.035+0000 7fef6086d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5c0b11f0 con 0x7fef5c0ceeb0 2023-08-25T04:03:38.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.035+0000 7fef6086d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5c159d50 con 0x7fef5c0ad950 2023-08-25T04:03:38.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.035+0000 7fef5ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fef5c0ceeb0 0x7fef5c0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:38.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.035+0000 7fef5ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fef5c0ceeb0 0x7fef5c0b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33510/0 (socket says 172.21.15.55:33510) 2023-08-25T04:03:38.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.035+0000 7fef5ad9d640 1 -- 172.21.15.55:0/2202275288 learned_addr learned my addr 172.21.15.55:0/2202275288 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:38.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.035+0000 7fef5a59c640 1 --2- 172.21.15.55:0/2202275288 >> v2:172.21.15.110:3300/0 conn(0x7fef5c0ad950 0x7fef5c0cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:38.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.035+0000 7fef5ad9d640 1 -- 172.21.15.55:0/2202275288 >> v2:172.21.15.110:3300/0 conn(0x7fef5c0ad950 msgr2=0x7fef5c0cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:38.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.035+0000 7fef5ad9d640 1 --2- 172.21.15.55:0/2202275288 >> v2:172.21.15.110:3300/0 conn(0x7fef5c0ad950 0x7fef5c0cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.035+0000 7fef5ad9d640 1 -- 172.21.15.55:0/2202275288 >> v1:172.21.15.110:6789/0 conn(0x7fef5c0c89f0 legacy=0x7fef5c0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:38.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.035+0000 7fef5ad9d640 1 -- 172.21.15.55:0/2202275288 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c0ccb60 con 0x7fef5c0ceeb0 2023-08-25T04:03:38.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.039+0000 7fef5ad9d640 1 --2- 172.21.15.55:0/2202275288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef5c0ceeb0 0x7fef5c0b1640 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0cd4b0 tx=0x7fef5401eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a37816fbb497ffc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:38.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.039+0000 7fef59d9b640 1 -- 172.21.15.55:0/2202275288 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef540a7af0 con 0x7fef5c0ceeb0 2023-08-25T04:03:38.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.039+0000 7fef59d9b640 1 -- 172.21.15.55:0/2202275288 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef540a7c50 con 0x7fef5c0ceeb0 2023-08-25T04:03:38.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.039+0000 7fef59d9b640 1 -- 172.21.15.55:0/2202275288 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef540af440 con 0x7fef5c0ceeb0 2023-08-25T04:03:38.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.039+0000 7fef6086d640 1 -- 172.21.15.55:0/2202275288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef5c0ceeb0 msgr2=0x7fef5c0b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:38.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.039+0000 7fef6086d640 1 --2- 172.21.15.55:0/2202275288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef5c0ceeb0 0x7fef5c0b1640 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fef5c0cd4b0 tx=0x7fef5401eb10 comp rx=0 tx=0).stop 2023-08-25T04:03:38.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.039+0000 7fef6086d640 1 -- 172.21.15.55:0/2202275288 shutdown_connections 2023-08-25T04:03:38.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.039+0000 7fef6086d640 1 --2- 172.21.15.55:0/2202275288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef5c0ceeb0 0x7fef5c0b1640 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.039+0000 7fef6086d640 1 --2- 172.21.15.55:0/2202275288 >> v2:172.21.15.110:3300/0 conn(0x7fef5c0ad950 0x7fef5c0cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.039+0000 7fef6086d640 1 -- 172.21.15.55:0/2202275288 >> 172.21.15.55:0/2202275288 conn(0x7fef5c069d00 msgr2=0x7fef5c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:38.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.039+0000 7fef6086d640 1 -- 172.21.15.55:0/2202275288 shutdown_connections 2023-08-25T04:03:38.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.039+0000 7fef6086d640 1 -- 172.21.15.55:0/2202275288 wait complete. 2023-08-25T04:03:38.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef6086d640 1 Processor -- start 2023-08-25T04:03:38.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef6086d640 1 -- start start 2023-08-25T04:03:38.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef6086d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5c0ad950 0x7fef5c0702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:38.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef6086d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef5c0c89f0 0x7fef5c151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:38.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef6086d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef5c0ceeb0 0x7fef5c0977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:38.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef6086d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c152330 con 0x7fef5c0c89f0 2023-08-25T04:03:38.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef6086d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c0acc20 con 0x7fef5c0ad950 2023-08-25T04:03:38.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef6086d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5c0acec0 con 0x7fef5c0ceeb0 2023-08-25T04:03:38.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef51d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef5c0c89f0 0x7fef5c151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:38.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef51d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef5c0c89f0 0x7fef5c151df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33524/0 (socket says 172.21.15.55:33524) 2023-08-25T04:03:38.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef51d9b640 1 -- 172.21.15.55:0/514839987 learned_addr learned my addr 172.21.15.55:0/514839987 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:38.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef5a59c640 1 --2- 172.21.15.55:0/514839987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5c0ad950 0x7fef5c0702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:38.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef5ad9d640 1 --2- 172.21.15.55:0/514839987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef5c0ceeb0 0x7fef5c0977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:38.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef51d9b640 1 -- 172.21.15.55:0/514839987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef5c0ceeb0 msgr2=0x7fef5c0977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:38.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef51d9b640 1 --2- 172.21.15.55:0/514839987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef5c0ceeb0 0x7fef5c0977f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef51d9b640 1 -- 172.21.15.55:0/514839987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5c0ad950 msgr2=0x7fef5c0702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:38.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef51d9b640 1 --2- 172.21.15.55:0/514839987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5c0ad950 0x7fef5c0702d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef51d9b640 1 -- 172.21.15.55:0/514839987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5400b770 con 0x7fef5c0c89f0 2023-08-25T04:03:38.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef51d9b640 1 --2- 172.21.15.55:0/514839987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef5c0c89f0 0x7fef5c151df0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fef4400c7f0 tx=0x7fef4400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:38.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef537fe640 1 -- 172.21.15.55:0/514839987 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44003b80 con 0x7fef5c0c89f0 2023-08-25T04:03:38.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef537fe640 1 -- 172.21.15.55:0/514839987 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef44003ce0 con 0x7fef5c0c89f0 2023-08-25T04:03:38.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef6086d640 1 -- 172.21.15.55:0/514839987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5c154af0 con 0x7fef5c0c89f0 2023-08-25T04:03:38.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef537fe640 1 -- 172.21.15.55:0/514839987 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4400aa90 con 0x7fef5c0c89f0 2023-08-25T04:03:38.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef6086d640 1 -- 172.21.15.55:0/514839987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5c097d30 con 0x7fef5c0c89f0 2023-08-25T04:03:38.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.043+0000 7fef6086d640 1 -- 172.21.15.55:0/514839987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5c151b10 con 0x7fef5c0c89f0 2023-08-25T04:03:38.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.047+0000 7fef537fe640 1 -- 172.21.15.55:0/514839987 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fef4400abf0 con 0x7fef5c0c89f0 2023-08-25T04:03:38.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.047+0000 7fef537fe640 1 --2- 172.21.15.55:0/514839987 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fef3c0656b0 0x7fef3c067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:38.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.047+0000 7fef537fe640 1 -- 172.21.15.55:0/514839987 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fef44082b40 con 0x7fef5c0c89f0 2023-08-25T04:03:38.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.047+0000 7fef5a59c640 1 --2- 172.21.15.55:0/514839987 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fef3c0656b0 0x7fef3c067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:38.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.047+0000 7fef5a59c640 1 --2- 172.21.15.55:0/514839987 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fef3c0656b0 0x7fef3c067b70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fef5c163eb0 tx=0x7fef4c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:38.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.051+0000 7fef537fe640 1 -- 172.21.15.55:0/514839987 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fef5c151b10 con 0x7fef5c0c89f0 2023-08-25T04:03:38.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.219+0000 7fef6086d640 1 -- 172.21.15.55:0/514839987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fef5c151b10 con 0x7fef5c0c89f0 2023-08-25T04:03:38.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.219+0000 7fef537fe640 1 -- 172.21.15.55:0/514839987 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fef5c151b10 con 0x7fef5c0c89f0 2023-08-25T04:03:38.220 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2023-08-25T04:03:38.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.219+0000 7fef6086d640 1 -- 172.21.15.55:0/514839987 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fef3c0656b0 msgr2=0x7fef3c067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:38.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.219+0000 7fef6086d640 1 --2- 172.21.15.55:0/514839987 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fef3c0656b0 0x7fef3c067b70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fef5c163eb0 tx=0x7fef4c009190 comp rx=0 tx=0).stop 2023-08-25T04:03:38.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.219+0000 7fef6086d640 1 -- 172.21.15.55:0/514839987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef5c0c89f0 msgr2=0x7fef5c151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:38.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.219+0000 7fef6086d640 1 --2- 172.21.15.55:0/514839987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef5c0c89f0 0x7fef5c151df0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fef4400c7f0 tx=0x7fef4400ccb0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.219+0000 7fef6086d640 1 -- 172.21.15.55:0/514839987 shutdown_connections 2023-08-25T04:03:38.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.219+0000 7fef6086d640 1 --2- 172.21.15.55:0/514839987 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fef3c0656b0 0x7fef3c067b70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.219+0000 7fef6086d640 1 --2- 172.21.15.55:0/514839987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef5c0ceeb0 0x7fef5c0977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.219+0000 7fef6086d640 1 --2- 172.21.15.55:0/514839987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef5c0c89f0 0x7fef5c151df0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.219+0000 7fef6086d640 1 --2- 172.21.15.55:0/514839987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5c0ad950 0x7fef5c0702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.219+0000 7fef6086d640 1 -- 172.21.15.55:0/514839987 >> 172.21.15.55:0/514839987 conn(0x7fef5c069d00 msgr2=0x7fef5c155020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:38.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.219+0000 7fef6086d640 1 -- 172.21.15.55:0/514839987 shutdown_connections 2023-08-25T04:03:38.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.219+0000 7fef6086d640 1 -- 172.21.15.55:0/514839987 wait complete. 2023-08-25T04:03:38.240 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-25T04:03:38.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:38.242 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-08-25T04:03:38.311 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2023-08-25T04:03:38.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:38.312 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-25T04:03:38.327 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:03:38.328 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:03:38.338 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:03:38.340 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:03:38.390 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:03:38.391 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:03:38.443 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:38.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.627+0000 7f801629e640 1 Processor -- start 2023-08-25T04:03:38.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.631+0000 7f801629e640 1 -- start start 2023-08-25T04:03:38.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.631+0000 7f801629e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8010158e10 0x7f80100b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:38.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.631+0000 7f801629e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80100cb2a0 0x7f80100c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:38.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.631+0000 7f801629e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80100cdbf0 con 0x7f8010159f10 2023-08-25T04:03:38.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.631+0000 7f801629e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80100ad940 con 0x7f80100cb2a0 2023-08-25T04:03:38.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.631+0000 7f801629e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801015a390 con 0x7f8010158e10 2023-08-25T04:03:38.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.631+0000 7f801483b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80100cb2a0 0x7f80100c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:38.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.631+0000 7f800f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8010159f10 0x7f80100cab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45116/0 (socket says 172.21.15.55:45116) 2023-08-25T04:03:38.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.631+0000 7f800f7fe640 1 -- 172.21.15.55:0/301149928 learned_addr learned my addr 172.21.15.55:0/301149928 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:38.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.631+0000 7f800ffff640 1 --2- 172.21.15.55:0/301149928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8010158e10 0x7f80100b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:38.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.631+0000 7f801483b640 1 -- 172.21.15.55:0/301149928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8010158e10 msgr2=0x7f80100b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:38.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.631+0000 7f801483b640 1 --2- 172.21.15.55:0/301149928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8010158e10 0x7f80100b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.631+0000 7f801483b640 1 -- 172.21.15.55:0/301149928 >> v1:172.21.15.55:6789/0 conn(0x7f8010159f10 legacy=0x7f80100cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:38.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.631+0000 7f801483b640 1 -- 172.21.15.55:0/301149928 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801006d380 con 0x7f80100cb2a0 2023-08-25T04:03:38.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.631+0000 7f800effd640 1 -- 172.21.15.55:0/301149928 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485834140 0 0) 0x7f80100cdbf0 con 0x7f8010159f10 2023-08-25T04:03:38.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.635+0000 7f801483b640 1 --2- 172.21.15.55:0/301149928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80100cb2a0 0x7f80100c9a00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8008009d90 tx=0x7f800801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b282b94b7e9df69f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:38.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.635+0000 7f800effd640 1 -- 172.21.15.55:0/301149928 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80080a5990 con 0x7f80100cb2a0 2023-08-25T04:03:38.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.635+0000 7f800effd640 1 -- 172.21.15.55:0/301149928 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80080a5af0 con 0x7f80100cb2a0 2023-08-25T04:03:38.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.635+0000 7f800effd640 1 -- 172.21.15.55:0/301149928 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80080a5e80 con 0x7f80100cb2a0 2023-08-25T04:03:38.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.635+0000 7f801629e640 1 -- 172.21.15.55:0/301149928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80100cb2a0 msgr2=0x7f80100c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:38.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.635+0000 7f801629e640 1 --2- 172.21.15.55:0/301149928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80100cb2a0 0x7f80100c9a00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8008009d90 tx=0x7f800801c950 comp rx=0 tx=0).stop 2023-08-25T04:03:38.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.635+0000 7f801629e640 1 -- 172.21.15.55:0/301149928 shutdown_connections 2023-08-25T04:03:38.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.635+0000 7f801629e640 1 --2- 172.21.15.55:0/301149928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80100cb2a0 0x7f80100c9a00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.635+0000 7f801629e640 1 --2- 172.21.15.55:0/301149928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8010158e10 0x7f80100b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.635+0000 7f801629e640 1 -- 172.21.15.55:0/301149928 >> 172.21.15.55:0/301149928 conn(0x7f8010069d00 msgr2=0x7f801006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:38.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.635+0000 7f801629e640 1 -- 172.21.15.55:0/301149928 shutdown_connections 2023-08-25T04:03:38.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.635+0000 7f801629e640 1 -- 172.21.15.55:0/301149928 wait complete. 2023-08-25T04:03:38.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.635+0000 7f801629e640 1 Processor -- start 2023-08-25T04:03:38.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.635+0000 7f801629e640 1 -- start start 2023-08-25T04:03:38.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f801629e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80100cb2a0 0x7f80100ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:38.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f801629e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8010158e10 0x7f80100b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:38.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f801629e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8010159f10 0x7f80100b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:38.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f801629e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80100abf50 con 0x7f8010159f10 2023-08-25T04:03:38.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f801629e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80100c7c10 con 0x7f80100cb2a0 2023-08-25T04:03:38.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f801629e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80100c7ef0 con 0x7f8010158e10 2023-08-25T04:03:38.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f801483b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8010159f10 0x7f80100b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:38.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f801483b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8010159f10 0x7f80100b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33544/0 (socket says 172.21.15.55:33544) 2023-08-25T04:03:38.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f801483b640 1 -- 172.21.15.55:0/1331108587 learned_addr learned my addr 172.21.15.55:0/1331108587 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:38.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f800f7fe640 1 --2- 172.21.15.55:0/1331108587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8010158e10 0x7f80100b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:38.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f800ffff640 1 --2- 172.21.15.55:0/1331108587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80100cb2a0 0x7f80100ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:38.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f801483b640 1 -- 172.21.15.55:0/1331108587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8010158e10 msgr2=0x7f80100b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:38.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f801483b640 1 --2- 172.21.15.55:0/1331108587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8010158e10 0x7f80100b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f801483b640 1 -- 172.21.15.55:0/1331108587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80100cb2a0 msgr2=0x7f80100ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:38.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f801483b640 1 --2- 172.21.15.55:0/1331108587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80100cb2a0 0x7f80100ab5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f801483b640 1 -- 172.21.15.55:0/1331108587 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8008009a70 con 0x7f8010159f10 2023-08-25T04:03:38.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f800f7fe640 1 --2- 172.21.15.55:0/1331108587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8010158e10 0x7f80100b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:38.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f800ffff640 1 --2- 172.21.15.55:0/1331108587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80100cb2a0 0x7f80100ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:38.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f801483b640 1 --2- 172.21.15.55:0/1331108587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8010159f10 0x7f80100b2760 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f80080b0040 tx=0x7f80080196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:38.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f800cff9640 1 -- 172.21.15.55:0/1331108587 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80080add90 con 0x7f8010159f10 2023-08-25T04:03:38.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f800cff9640 1 -- 172.21.15.55:0/1331108587 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8008009450 con 0x7f8010159f10 2023-08-25T04:03:38.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f801629e640 1 -- 172.21.15.55:0/1331108587 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8010159370 con 0x7f8010159f10 2023-08-25T04:03:38.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f800cff9640 1 -- 172.21.15.55:0/1331108587 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80080b9690 con 0x7f8010159f10 2023-08-25T04:03:38.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f801629e640 1 -- 172.21.15.55:0/1331108587 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80101557b0 con 0x7f8010159f10 2023-08-25T04:03:38.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f801629e640 1 -- 172.21.15.55:0/1331108587 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801004dbe0 con 0x7f8010159f10 2023-08-25T04:03:38.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.639+0000 7f800cff9640 1 -- 172.21.15.55:0/1331108587 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f80080b97f0 con 0x7f8010159f10 2023-08-25T04:03:38.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.643+0000 7f800cff9640 1 --2- 172.21.15.55:0/1331108587 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7ffc065680 0x7f7ffc067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:38.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.643+0000 7f800cff9640 1 -- 172.21.15.55:0/1331108587 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f800811e590 con 0x7f8010159f10 2023-08-25T04:03:38.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.643+0000 7f800ffff640 1 --2- 172.21.15.55:0/1331108587 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7ffc065680 0x7f7ffc067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:38.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.643+0000 7f800ffff640 1 --2- 172.21.15.55:0/1331108587 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7ffc065680 0x7f7ffc067b40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8010164f40 tx=0x7f8000008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:38.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.647+0000 7f800cff9640 1 -- 172.21.15.55:0/1331108587 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f80080ebfb0 con 0x7f8010159f10 2023-08-25T04:03:38.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.803+0000 7f801629e640 1 -- 172.21.15.55:0/1331108587 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80100ad4d0 con 0x7f8010159f10 2023-08-25T04:03:38.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.807+0000 7f800cff9640 1 -- 172.21.15.55:0/1331108587 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18291 (secure 0 0 0) 0x7f80080ef5d0 con 0x7f8010159f10 2023-08-25T04:03:38.807 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:38.807 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:02.329010+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:38.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.807+0000 7f801629e640 1 -- 172.21.15.55:0/1331108587 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7ffc065680 msgr2=0x7f7ffc067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:38.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.807+0000 7f801629e640 1 --2- 172.21.15.55:0/1331108587 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7ffc065680 0x7f7ffc067b40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8010164f40 tx=0x7f8000008040 comp rx=0 tx=0).stop 2023-08-25T04:03:38.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.807+0000 7f801629e640 1 -- 172.21.15.55:0/1331108587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8010159f10 msgr2=0x7f80100b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:38.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.807+0000 7f801629e640 1 --2- 172.21.15.55:0/1331108587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8010159f10 0x7f80100b2760 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f80080b0040 tx=0x7f80080196f0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.807+0000 7f801629e640 1 -- 172.21.15.55:0/1331108587 shutdown_connections 2023-08-25T04:03:38.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.807+0000 7f801629e640 1 --2- 172.21.15.55:0/1331108587 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7ffc065680 0x7f7ffc067b40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.807+0000 7f801629e640 1 --2- 172.21.15.55:0/1331108587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8010159f10 0x7f80100b2760 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.807+0000 7f801629e640 1 --2- 172.21.15.55:0/1331108587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8010158e10 0x7f80100b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.807+0000 7f801629e640 1 --2- 172.21.15.55:0/1331108587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80100cb2a0 0x7f80100ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.807+0000 7f801629e640 1 -- 172.21.15.55:0/1331108587 >> 172.21.15.55:0/1331108587 conn(0x7f8010069d00 msgr2=0x7f8010159500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:38.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.807+0000 7f801629e640 1 -- 172.21.15.55:0/1331108587 shutdown_connections 2023-08-25T04:03:38.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.807+0000 7f801629e640 1 -- 172.21.15.55:0/1331108587 wait complete. 2023-08-25T04:03:38.829 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:02:58.890533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:03:00.093976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:03:38.830 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:03:38.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.975+0000 7f2489fe9640 1 Processor -- start 2023-08-25T04:03:38.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.975+0000 7f2489fe9640 1 -- start start 2023-08-25T04:03:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.975+0000 7f2489fe9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f248406c3b0 0x7f24840cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.975+0000 7f2489fe9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f248406e5a0 0x7f24840ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.975+0000 7f2489fe9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24840cab90 con 0x7f248406c790 2023-08-25T04:03:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.975+0000 7f2489fe9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f248406dbb0 con 0x7f248406c3b0 2023-08-25T04:03:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.975+0000 7f2489fe9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24840cae50 con 0x7f248406e5a0 2023-08-25T04:03:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.975+0000 7f24837fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f248406c3b0 0x7f24840cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:38.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.975+0000 7f247bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f248406c790 0x7f248406de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45118/0 (socket says 172.21.15.55:45118) 2023-08-25T04:03:38.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.975+0000 7f247bfff640 1 -- 172.21.15.55:0/3914841973 learned_addr learned my addr 172.21.15.55:0/3914841973 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:38.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.975+0000 7f2483fff640 1 --2- 172.21.15.55:0/3914841973 >> v2:172.21.15.110:3300/0 conn(0x7f248406e5a0 0x7f24840ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:38.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.975+0000 7f24837fe640 1 -- 172.21.15.55:0/3914841973 >> v2:172.21.15.110:3300/0 conn(0x7f248406e5a0 msgr2=0x7f24840ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:38.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.975+0000 7f24837fe640 1 --2- 172.21.15.55:0/3914841973 >> v2:172.21.15.110:3300/0 conn(0x7f248406e5a0 0x7f24840ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.975+0000 7f24837fe640 1 -- 172.21.15.55:0/3914841973 >> v1:172.21.15.55:6789/0 conn(0x7f248406c790 legacy=0x7f248406de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:38.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.975+0000 7f2482ffd640 1 -- 172.21.15.55:0/3914841973 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172810236 0 0) 0x7f24840cab90 con 0x7f248406c790 2023-08-25T04:03:38.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.975+0000 7f24837fe640 1 -- 172.21.15.55:0/3914841973 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24840cb130 con 0x7f248406c3b0 2023-08-25T04:03:38.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.979+0000 7f24837fe640 1 --2- 172.21.15.55:0/3914841973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248406c3b0 0x7f24840cd7d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2484070600 tx=0x7f247401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0a7d97454ff261 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:38.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.979+0000 7f2482ffd640 1 -- 172.21.15.55:0/3914841973 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24740ab5f0 con 0x7f248406c3b0 2023-08-25T04:03:38.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.979+0000 7f2482ffd640 1 -- 172.21.15.55:0/3914841973 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24740ab750 con 0x7f248406c3b0 2023-08-25T04:03:38.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.979+0000 7f2482ffd640 1 -- 172.21.15.55:0/3914841973 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24740abae0 con 0x7f248406c3b0 2023-08-25T04:03:38.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.979+0000 7f2489fe9640 1 -- 172.21.15.55:0/3914841973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248406c3b0 msgr2=0x7f24840cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:38.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.979+0000 7f2489fe9640 1 --2- 172.21.15.55:0/3914841973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248406c3b0 0x7f24840cd7d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2484070600 tx=0x7f247401c410 comp rx=0 tx=0).stop 2023-08-25T04:03:38.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.979+0000 7f2489fe9640 1 -- 172.21.15.55:0/3914841973 shutdown_connections 2023-08-25T04:03:38.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.979+0000 7f2489fe9640 1 --2- 172.21.15.55:0/3914841973 >> v2:172.21.15.110:3300/0 conn(0x7f248406e5a0 0x7f24840ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.979+0000 7f2489fe9640 1 --2- 172.21.15.55:0/3914841973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248406c3b0 0x7f24840cd7d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.979+0000 7f2489fe9640 1 -- 172.21.15.55:0/3914841973 >> 172.21.15.55:0/3914841973 conn(0x7f24840d0540 msgr2=0x7f24840d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:38.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.979+0000 7f2489fe9640 1 -- 172.21.15.55:0/3914841973 shutdown_connections 2023-08-25T04:03:38.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.979+0000 7f2489fe9640 1 -- 172.21.15.55:0/3914841973 wait complete. 2023-08-25T04:03:38.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2489fe9640 1 Processor -- start 2023-08-25T04:03:38.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2489fe9640 1 -- start start 2023-08-25T04:03:38.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2489fe9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f248406c3b0 0x7f24841579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:38.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2489fe9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f248406c790 0x7f248415f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:38.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2489fe9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248406e5a0 0x7f248415a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:38.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2489fe9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24840b3be0 con 0x7f248406e5a0 2023-08-25T04:03:38.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2489fe9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24840b3ec0 con 0x7f248406c790 2023-08-25T04:03:38.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2489fe9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24840b41a0 con 0x7f248406c3b0 2023-08-25T04:03:38.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2483fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248406e5a0 0x7f248415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:38.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2483fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248406e5a0 0x7f248415a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33570/0 (socket says 172.21.15.55:33570) 2023-08-25T04:03:38.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2483fff640 1 -- 172.21.15.55:0/36989850 learned_addr learned my addr 172.21.15.55:0/36989850 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:38.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f24837fe640 1 --2- 172.21.15.55:0/36989850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f248406c3b0 0x7f24841579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:38.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f247bfff640 1 --2- 172.21.15.55:0/36989850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f248406c790 0x7f248415f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:38.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2483fff640 1 -- 172.21.15.55:0/36989850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f248406c3b0 msgr2=0x7f24841579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:38.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2483fff640 1 --2- 172.21.15.55:0/36989850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f248406c3b0 0x7f24841579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2483fff640 1 -- 172.21.15.55:0/36989850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f248406c790 msgr2=0x7f248415f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:38.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2483fff640 1 --2- 172.21.15.55:0/36989850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f248406c790 0x7f248415f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:38.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2483fff640 1 -- 172.21.15.55:0/36989850 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24740093b0 con 0x7f248406e5a0 2023-08-25T04:03:38.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f24837fe640 1 --2- 172.21.15.55:0/36989850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f248406c3b0 0x7f24841579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:38.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2483fff640 1 --2- 172.21.15.55:0/36989850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248406e5a0 0x7f248415a360 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f247c00efc0 tx=0x7f247c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:38.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2480ff9640 1 -- 172.21.15.55:0/36989850 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c009b20 con 0x7f248406e5a0 2023-08-25T04:03:38.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2480ff9640 1 -- 172.21.15.55:0/36989850 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247c00f040 con 0x7f248406e5a0 2023-08-25T04:03:38.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2480ff9640 1 -- 172.21.15.55:0/36989850 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c0146c0 con 0x7f248406e5a0 2023-08-25T04:03:38.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2489fe9640 1 -- 172.21.15.55:0/36989850 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24840c8a20 con 0x7f248406e5a0 2023-08-25T04:03:38.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.983+0000 7f2489fe9640 1 -- 172.21.15.55:0/36989850 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24840b4480 con 0x7f248406e5a0 2023-08-25T04:03:38.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.987+0000 7f2489fe9640 1 -- 172.21.15.55:0/36989850 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24840c8c40 con 0x7f248406e5a0 2023-08-25T04:03:38.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.987+0000 7f2480ff9640 1 -- 172.21.15.55:0/36989850 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f247c014820 con 0x7f248406e5a0 2023-08-25T04:03:38.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.987+0000 7f2480ff9640 1 --2- 172.21.15.55:0/36989850 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2464065680 0x7f2464067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:38.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.987+0000 7f2480ff9640 1 -- 172.21.15.55:0/36989850 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f247c083c60 con 0x7f248406e5a0 2023-08-25T04:03:38.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.987+0000 7f24837fe640 1 --2- 172.21.15.55:0/36989850 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2464065680 0x7f2464067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:38.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.987+0000 7f24837fe640 1 --2- 172.21.15.55:0/36989850 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2464065680 0x7f2464067b40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f24740af000 tx=0x7f24740a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:38.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:38.991+0000 7f2480ff9640 1 -- 172.21.15.55:0/36989850 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f247c051680 con 0x7f248406e5a0 2023-08-25T04:03:39.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.147+0000 7f2489fe9640 1 -- 172.21.15.55:0/36989850 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2484073ec0 con 0x7f248406e5a0 2023-08-25T04:03:39.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.147+0000 7f2480ff9640 1 -- 172.21.15.55:0/36989850 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f247c018020 con 0x7f248406e5a0 2023-08-25T04:03:39.150 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:03:39.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.151+0000 7f2489fe9640 1 -- 172.21.15.55:0/36989850 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2464065680 msgr2=0x7f2464067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.151+0000 7f2489fe9640 1 --2- 172.21.15.55:0/36989850 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2464065680 0x7f2464067b40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f24740af000 tx=0x7f24740a7000 comp rx=0 tx=0).stop 2023-08-25T04:03:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.151+0000 7f2489fe9640 1 -- 172.21.15.55:0/36989850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248406e5a0 msgr2=0x7f248415a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.151+0000 7f2489fe9640 1 --2- 172.21.15.55:0/36989850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248406e5a0 0x7f248415a360 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f247c00efc0 tx=0x7f247c00c490 comp rx=0 tx=0).stop 2023-08-25T04:03:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.151+0000 7f2489fe9640 1 -- 172.21.15.55:0/36989850 shutdown_connections 2023-08-25T04:03:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.151+0000 7f2489fe9640 1 --2- 172.21.15.55:0/36989850 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2464065680 0x7f2464067b40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.151+0000 7f2489fe9640 1 --2- 172.21.15.55:0/36989850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f248406e5a0 0x7f248415a360 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.151+0000 7f2489fe9640 1 --2- 172.21.15.55:0/36989850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f248406c790 0x7f248415f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.151+0000 7f2489fe9640 1 --2- 172.21.15.55:0/36989850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f248406c3b0 0x7f24841579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.151+0000 7f2489fe9640 1 -- 172.21.15.55:0/36989850 >> 172.21.15.55:0/36989850 conn(0x7f24840d0540 msgr2=0x7f24840ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:39.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.151+0000 7f2489fe9640 1 -- 172.21.15.55:0/36989850 shutdown_connections 2023-08-25T04:03:39.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.151+0000 7f2489fe9640 1 -- 172.21.15.55:0/36989850 wait complete. 2023-08-25T04:03:39.170 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:03:39.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.315+0000 7ff1600ec640 1 Processor -- start 2023-08-25T04:03:39.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.315+0000 7ff1600ec640 1 -- start start 2023-08-25T04:03:39.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.315+0000 7ff1600ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1581601f0 0x7ff15815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:39.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.315+0000 7ff1600ec640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff15815e3c0 0x7ff1580d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:39.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.315+0000 7ff1600ec640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff1580d10c0 0x7ff1580b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:39.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.315+0000 7ff1600ec640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1580cd5a0 con 0x7ff1580d10c0 2023-08-25T04:03:39.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.315+0000 7ff1600ec640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1580cd880 con 0x7ff15815e3c0 2023-08-25T04:03:39.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.315+0000 7ff1600ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1580cdb60 con 0x7ff1581601f0 2023-08-25T04:03:39.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.315+0000 7ff15e689640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff1580d10c0 0x7ff1580b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:39.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.315+0000 7ff15e689640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff1580d10c0 0x7ff1580b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33580/0 (socket says 172.21.15.55:33580) 2023-08-25T04:03:39.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.315+0000 7ff15e689640 1 -- 172.21.15.55:0/2649854887 learned_addr learned my addr 172.21.15.55:0/2649854887 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:39.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.315+0000 7ff15de88640 1 --2- 172.21.15.55:0/2649854887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1581601f0 0x7ff15815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:39.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.315+0000 7ff15d687640 1 --2- 172.21.15.55:0/2649854887 >> v2:172.21.15.110:3300/0 conn(0x7ff15815e3c0 0x7ff1580d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:39.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.315+0000 7ff15e689640 1 -- 172.21.15.55:0/2649854887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1581601f0 msgr2=0x7ff15815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:39.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.315+0000 7ff15e689640 1 --2- 172.21.15.55:0/2649854887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1581601f0 0x7ff15815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.315+0000 7ff15e689640 1 -- 172.21.15.55:0/2649854887 >> v2:172.21.15.110:3300/0 conn(0x7ff15815e3c0 msgr2=0x7ff1580d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:39.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.315+0000 7ff15e689640 1 --2- 172.21.15.55:0/2649854887 >> v2:172.21.15.110:3300/0 conn(0x7ff15815e3c0 0x7ff1580d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.315+0000 7ff15e689640 1 -- 172.21.15.55:0/2649854887 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1580cde40 con 0x7ff1580d10c0 2023-08-25T04:03:39.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.319+0000 7ff15e689640 1 --2- 172.21.15.55:0/2649854887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1580d10c0 0x7ff1580b4250 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff1580d05a0 tx=0x7ff15001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b65051e5cd3dd22 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:39.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.319+0000 7ff15ce86640 1 -- 172.21.15.55:0/2649854887 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1500af400 con 0x7ff1580d10c0 2023-08-25T04:03:39.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.319+0000 7ff15ce86640 1 -- 172.21.15.55:0/2649854887 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1500ab050 con 0x7ff1580d10c0 2023-08-25T04:03:39.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.319+0000 7ff15ce86640 1 -- 172.21.15.55:0/2649854887 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1500af780 con 0x7ff1580d10c0 2023-08-25T04:03:39.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.319+0000 7ff1600ec640 1 -- 172.21.15.55:0/2649854887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1580d10c0 msgr2=0x7ff1580b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:39.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.319+0000 7ff1600ec640 1 --2- 172.21.15.55:0/2649854887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1580d10c0 0x7ff1580b4250 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff1580d05a0 tx=0x7ff15001f1c0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.319+0000 7ff1600ec640 1 -- 172.21.15.55:0/2649854887 shutdown_connections 2023-08-25T04:03:39.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.319+0000 7ff1600ec640 1 --2- 172.21.15.55:0/2649854887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1580d10c0 0x7ff1580b4250 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.319+0000 7ff1600ec640 1 --2- 172.21.15.55:0/2649854887 >> v2:172.21.15.110:3300/0 conn(0x7ff15815e3c0 0x7ff1580d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.319+0000 7ff1600ec640 1 --2- 172.21.15.55:0/2649854887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1581601f0 0x7ff15815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.319+0000 7ff1600ec640 1 -- 172.21.15.55:0/2649854887 >> 172.21.15.55:0/2649854887 conn(0x7ff1580d27d0 msgr2=0x7ff1580d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:39.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.319+0000 7ff1600ec640 1 -- 172.21.15.55:0/2649854887 shutdown_connections 2023-08-25T04:03:39.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.319+0000 7ff1600ec640 1 -- 172.21.15.55:0/2649854887 wait complete. 2023-08-25T04:03:39.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff1600ec640 1 Processor -- start 2023-08-25T04:03:39.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff1600ec640 1 -- start start 2023-08-25T04:03:39.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff1600ec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1580d10c0 0x7ff15809c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:39.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff1600ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff15815e3c0 0x7ff1580c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:39.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff1600ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1581601f0 0x7ff1580b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:39.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff1600ec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1580c9670 con 0x7ff15815e3c0 2023-08-25T04:03:39.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff1600ec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1580c6c40 con 0x7ff1580d10c0 2023-08-25T04:03:39.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff1600ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1580b2f30 con 0x7ff1581601f0 2023-08-25T04:03:39.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff15d687640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff15815e3c0 0x7ff1580c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:39.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff15d687640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff15815e3c0 0x7ff1580c9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33588/0 (socket says 172.21.15.55:33588) 2023-08-25T04:03:39.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff15d687640 1 -- 172.21.15.55:0/2947380743 learned_addr learned my addr 172.21.15.55:0/2947380743 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:39.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff15e689640 1 --2- 172.21.15.55:0/2947380743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1581601f0 0x7ff1580b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:39.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff15de88640 1 --2- 172.21.15.55:0/2947380743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1580d10c0 0x7ff15809c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:39.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff15d687640 1 -- 172.21.15.55:0/2947380743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1581601f0 msgr2=0x7ff1580b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:39.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff15d687640 1 --2- 172.21.15.55:0/2947380743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1581601f0 0x7ff1580b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff15d687640 1 -- 172.21.15.55:0/2947380743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1580d10c0 msgr2=0x7ff15809c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:39.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff15d687640 1 --2- 172.21.15.55:0/2947380743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1580d10c0 0x7ff15809c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff15d687640 1 -- 172.21.15.55:0/2947380743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff150009b30 con 0x7ff15815e3c0 2023-08-25T04:03:39.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff15d687640 1 --2- 172.21.15.55:0/2947380743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff15815e3c0 0x7ff1580c9130 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff14800d800 tx=0x7ff14800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:39.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff14e7fc640 1 -- 172.21.15.55:0/2947380743 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1480096a0 con 0x7ff15815e3c0 2023-08-25T04:03:39.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff14e7fc640 1 -- 172.21.15.55:0/2947380743 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff148009800 con 0x7ff15815e3c0 2023-08-25T04:03:39.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff14e7fc640 1 -- 172.21.15.55:0/2947380743 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff148009b70 con 0x7ff15815e3c0 2023-08-25T04:03:39.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff1600ec640 1 -- 172.21.15.55:0/2947380743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1580ce7c0 con 0x7ff15815e3c0 2023-08-25T04:03:39.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.323+0000 7ff1600ec640 1 -- 172.21.15.55:0/2947380743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1580c65f0 con 0x7ff15815e3c0 2023-08-25T04:03:39.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.327+0000 7ff1600ec640 1 -- 172.21.15.55:0/2947380743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1580b5260 con 0x7ff15815e3c0 2023-08-25T04:03:39.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.327+0000 7ff14e7fc640 1 -- 172.21.15.55:0/2947380743 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff148009cd0 con 0x7ff15815e3c0 2023-08-25T04:03:39.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.327+0000 7ff14e7fc640 1 --2- 172.21.15.55:0/2947380743 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff13c065680 0x7ff13c067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:39.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.327+0000 7ff14e7fc640 1 -- 172.21.15.55:0/2947380743 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff148083490 con 0x7ff15815e3c0 2023-08-25T04:03:39.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.327+0000 7ff15de88640 1 --2- 172.21.15.55:0/2947380743 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff13c065680 0x7ff13c067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:39.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.327+0000 7ff15de88640 1 --2- 172.21.15.55:0/2947380743 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff13c065680 0x7ff13c067b40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff1580b3370 tx=0x7ff154008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:39.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.331+0000 7ff14e7fc640 1 -- 172.21.15.55:0/2947380743 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff148050f60 con 0x7ff15815e3c0 2023-08-25T04:03:39.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.487+0000 7ff1600ec640 1 -- 172.21.15.55:0/2947380743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff1580c6db0 con 0x7ff15815e3c0 2023-08-25T04:03:39.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.487+0000 7ff14e7fc640 1 -- 172.21.15.55:0/2947380743 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff148054580 con 0x7ff15815e3c0 2023-08-25T04:03:39.489 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:03:39.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.487+0000 7ff1600ec640 1 -- 172.21.15.55:0/2947380743 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff13c065680 msgr2=0x7ff13c067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:39.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.487+0000 7ff1600ec640 1 --2- 172.21.15.55:0/2947380743 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff13c065680 0x7ff13c067b40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff1580b3370 tx=0x7ff154008040 comp rx=0 tx=0).stop 2023-08-25T04:03:39.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.487+0000 7ff1600ec640 1 -- 172.21.15.55:0/2947380743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff15815e3c0 msgr2=0x7ff1580c9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:39.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.487+0000 7ff1600ec640 1 --2- 172.21.15.55:0/2947380743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff15815e3c0 0x7ff1580c9130 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff14800d800 tx=0x7ff14800dcc0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.487+0000 7ff1600ec640 1 -- 172.21.15.55:0/2947380743 shutdown_connections 2023-08-25T04:03:39.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.487+0000 7ff1600ec640 1 --2- 172.21.15.55:0/2947380743 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff13c065680 0x7ff13c067b40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.487+0000 7ff1600ec640 1 --2- 172.21.15.55:0/2947380743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1581601f0 0x7ff1580b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.487+0000 7ff1600ec640 1 --2- 172.21.15.55:0/2947380743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff15815e3c0 0x7ff1580c9130 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.487+0000 7ff1600ec640 1 --2- 172.21.15.55:0/2947380743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1580d10c0 0x7ff15809c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.487+0000 7ff1600ec640 1 -- 172.21.15.55:0/2947380743 >> 172.21.15.55:0/2947380743 conn(0x7ff1580d27d0 msgr2=0x7ff1580b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:39.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.487+0000 7ff1600ec640 1 -- 172.21.15.55:0/2947380743 shutdown_connections 2023-08-25T04:03:39.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.487+0000 7ff1600ec640 1 -- 172.21.15.55:0/2947380743 wait complete. 2023-08-25T04:03:39.509 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:03:39.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.655+0000 7f2c831ba640 1 Processor -- start 2023-08-25T04:03:39.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.655+0000 7f2c831ba640 1 -- start start 2023-08-25T04:03:39.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.655+0000 7f2c831ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c06fed0 0x7f2c7c0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:39.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.655+0000 7f2c831ba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7c15de30 con 0x7f2c7c0ce120 2023-08-25T04:03:39.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.655+0000 7f2c831ba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7c15a9f0 con 0x7f2c7c0cdcc0 2023-08-25T04:03:39.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.655+0000 7f2c831ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c0cb120 con 0x7f2c7c06fed0 2023-08-25T04:03:39.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.655+0000 7f2c81757640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2c7c0ce120 0x7f2c7c0ccad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45134/0 (socket says 172.21.15.55:45134) 2023-08-25T04:03:39.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.655+0000 7f2c81757640 1 -- 172.21.15.55:0/3587669365 learned_addr learned my addr 172.21.15.55:0/3587669365 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:39.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.655+0000 7f2c80f56640 1 --2- 172.21.15.55:0/3587669365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c06fed0 0x7f2c7c0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:39.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.655+0000 7f2c7b7fe640 1 -- 172.21.15.55:0/3587669365 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534257351 0 0) 0x7f2c7c15de30 con 0x7f2c7c0ce120 2023-08-25T04:03:39.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.655+0000 7f2c7b7fe640 1 -- 172.21.15.55:0/3587669365 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c6c003530 con 0x7f2c7c0ce120 2023-08-25T04:03:39.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.655+0000 7f2c7b7fe640 1 -- 172.21.15.55:0/3587669365 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138978440 0 0) 0x7f2c7c15a9f0 con 0x7f2c7c0cdcc0 2023-08-25T04:03:39.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.655+0000 7f2c7b7fe640 1 -- 172.21.15.55:0/3587669365 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c7c15de30 con 0x7f2c7c0cdcc0 2023-08-25T04:03:39.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.655+0000 7f2c80f56640 1 -- 172.21.15.55:0/3587669365 >> v1:172.21.15.110:6789/0 conn(0x7f2c7c0cdcc0 legacy=0x7f2c7c0cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:39.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.655+0000 7f2c80f56640 1 -- 172.21.15.55:0/3587669365 >> v1:172.21.15.55:6789/0 conn(0x7f2c7c0ce120 legacy=0x7f2c7c0ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:39.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.655+0000 7f2c80f56640 1 -- 172.21.15.55:0/3587669365 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7c0cd1e0 con 0x7f2c7c06fed0 2023-08-25T04:03:39.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.659+0000 7f2c80f56640 1 --2- 172.21.15.55:0/3587669365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c06fed0 0x7f2c7c0702b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2c700097f0 tx=0x7f2c7001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baaf091a0843bc32 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:39.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.659+0000 7f2c7b7fe640 1 -- 172.21.15.55:0/3587669365 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c700aa620 con 0x7f2c7c06fed0 2023-08-25T04:03:39.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.659+0000 7f2c7b7fe640 1 -- 172.21.15.55:0/3587669365 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c700aa780 con 0x7f2c7c06fed0 2023-08-25T04:03:39.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.659+0000 7f2c7b7fe640 1 -- 172.21.15.55:0/3587669365 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c700aab10 con 0x7f2c7c06fed0 2023-08-25T04:03:39.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.659+0000 7f2c831ba640 1 -- 172.21.15.55:0/3587669365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c06fed0 msgr2=0x7f2c7c0702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:39.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.659+0000 7f2c831ba640 1 --2- 172.21.15.55:0/3587669365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c06fed0 0x7f2c7c0702b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2c700097f0 tx=0x7f2c7001c4c0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.659+0000 7f2c831ba640 1 -- 172.21.15.55:0/3587669365 shutdown_connections 2023-08-25T04:03:39.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.659+0000 7f2c831ba640 1 --2- 172.21.15.55:0/3587669365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c06fed0 0x7f2c7c0702b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.659+0000 7f2c831ba640 1 -- 172.21.15.55:0/3587669365 >> 172.21.15.55:0/3587669365 conn(0x7f2c7c0ce7f0 msgr2=0x7f2c7c0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:39.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.659+0000 7f2c831ba640 1 -- 172.21.15.55:0/3587669365 shutdown_connections 2023-08-25T04:03:39.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.659+0000 7f2c831ba640 1 -- 172.21.15.55:0/3587669365 wait complete. 2023-08-25T04:03:39.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c831ba640 1 Processor -- start 2023-08-25T04:03:39.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c831ba640 1 -- start start 2023-08-25T04:03:39.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c831ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c06fed0 0x7f2c7c0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:39.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c831ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c7c0cdcc0 0x7f2c7c147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:39.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c831ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c7c0ce120 0x7f2c7c148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:39.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c831ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c0c6470 con 0x7f2c7c0cdcc0 2023-08-25T04:03:39.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c831ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c0c6750 con 0x7f2c7c0ce120 2023-08-25T04:03:39.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c831ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c0c6a30 con 0x7f2c7c06fed0 2023-08-25T04:03:39.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c7bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c7c0cdcc0 0x7f2c7c147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:39.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c7bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c7c0cdcc0 0x7f2c7c147f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33598/0 (socket says 172.21.15.55:33598) 2023-08-25T04:03:39.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c7bfff640 1 -- 172.21.15.55:0/340197330 learned_addr learned my addr 172.21.15.55:0/340197330 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:39.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c81757640 1 --2- 172.21.15.55:0/340197330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c7c0ce120 0x7f2c7c148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:39.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c80f56640 1 --2- 172.21.15.55:0/340197330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c06fed0 0x7f2c7c0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:39.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c7bfff640 1 -- 172.21.15.55:0/340197330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c06fed0 msgr2=0x7f2c7c0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:39.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c7bfff640 1 --2- 172.21.15.55:0/340197330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c06fed0 0x7f2c7c0c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c7bfff640 1 -- 172.21.15.55:0/340197330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c7c0ce120 msgr2=0x7f2c7c148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:39.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c7bfff640 1 --2- 172.21.15.55:0/340197330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c7c0ce120 0x7f2c7c148450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c7bfff640 1 -- 172.21.15.55:0/340197330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c70009420 con 0x7f2c7c0cdcc0 2023-08-25T04:03:39.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c7bfff640 1 --2- 172.21.15.55:0/340197330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c7c0cdcc0 0x7f2c7c147f10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800c490 tx=0x7f2c6800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:39.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c797fa640 1 -- 172.21.15.55:0/340197330 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c680052d0 con 0x7f2c7c0cdcc0 2023-08-25T04:03:39.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c797fa640 1 -- 172.21.15.55:0/340197330 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c68005430 con 0x7f2c7c0cdcc0 2023-08-25T04:03:39.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c797fa640 1 -- 172.21.15.55:0/340197330 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68012870 con 0x7f2c7c0cdcc0 2023-08-25T04:03:39.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.663+0000 7f2c831ba640 1 -- 172.21.15.55:0/340197330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7c0c6d10 con 0x7f2c7c0cdcc0 2023-08-25T04:03:39.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.667+0000 7f2c831ba640 1 -- 172.21.15.55:0/340197330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7c0c7d70 con 0x7f2c7c0cdcc0 2023-08-25T04:03:39.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.667+0000 7f2c831ba640 1 -- 172.21.15.55:0/340197330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7c14c070 con 0x7f2c7c0cdcc0 2023-08-25T04:03:39.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.667+0000 7f2c797fa640 1 -- 172.21.15.55:0/340197330 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2c680129d0 con 0x7f2c7c0cdcc0 2023-08-25T04:03:39.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.667+0000 7f2c797fa640 1 --2- 172.21.15.55:0/340197330 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2c60065680 0x7f2c60067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:39.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.667+0000 7f2c797fa640 1 -- 172.21.15.55:0/340197330 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2c68082860 con 0x7f2c7c0cdcc0 2023-08-25T04:03:39.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.667+0000 7f2c80f56640 1 --2- 172.21.15.55:0/340197330 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2c60065680 0x7f2c60067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:39.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.667+0000 7f2c80f56640 1 --2- 172.21.15.55:0/340197330 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2c60065680 0x7f2c60067b40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2c700ae000 tx=0x7f2c700a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:39.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.671+0000 7f2c797fa640 1 -- 172.21.15.55:0/340197330 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2c7c14c070 con 0x7f2c7c0cdcc0 2023-08-25T04:03:39.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.827+0000 7f2c831ba640 1 -- 172.21.15.55:0/340197330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2c7c14c070 con 0x7f2c7c0cdcc0 2023-08-25T04:03:39.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.827+0000 7f2c797fa640 1 -- 172.21.15.55:0/340197330 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2c7c14c070 con 0x7f2c7c0cdcc0 2023-08-25T04:03:39.831 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:03:39.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.831+0000 7f2c831ba640 1 -- 172.21.15.55:0/340197330 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2c60065680 msgr2=0x7f2c60067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:39.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.831+0000 7f2c831ba640 1 --2- 172.21.15.55:0/340197330 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2c60065680 0x7f2c60067b40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2c700ae000 tx=0x7f2c700a7000 comp rx=0 tx=0).stop 2023-08-25T04:03:39.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.831+0000 7f2c831ba640 1 -- 172.21.15.55:0/340197330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c7c0cdcc0 msgr2=0x7f2c7c147f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:39.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.831+0000 7f2c831ba640 1 --2- 172.21.15.55:0/340197330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c7c0cdcc0 0x7f2c7c147f10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800c490 tx=0x7f2c6800c950 comp rx=0 tx=0).stop 2023-08-25T04:03:39.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.831+0000 7f2c831ba640 1 -- 172.21.15.55:0/340197330 shutdown_connections 2023-08-25T04:03:39.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.831+0000 7f2c831ba640 1 --2- 172.21.15.55:0/340197330 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2c60065680 0x7f2c60067b40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.831+0000 7f2c831ba640 1 --2- 172.21.15.55:0/340197330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c7c0ce120 0x7f2c7c148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.831+0000 7f2c831ba640 1 --2- 172.21.15.55:0/340197330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c7c0cdcc0 0x7f2c7c147f10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.831+0000 7f2c831ba640 1 --2- 172.21.15.55:0/340197330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c06fed0 0x7f2c7c0c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:39.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.831+0000 7f2c831ba640 1 -- 172.21.15.55:0/340197330 >> 172.21.15.55:0/340197330 conn(0x7f2c7c0ce7f0 msgr2=0x7f2c7c0c4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:39.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.831+0000 7f2c831ba640 1 -- 172.21.15.55:0/340197330 shutdown_connections 2023-08-25T04:03:39.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.831+0000 7f2c831ba640 1 -- 172.21.15.55:0/340197330 wait complete. 2023-08-25T04:03:39.852 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:03:39.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.995+0000 7fbb77f37640 1 Processor -- start 2023-08-25T04:03:39.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.995+0000 7fbb77f37640 1 -- start start 2023-08-25T04:03:40.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.999+0000 7fbb77f37640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbb700cb020 0x7fbb700c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.999+0000 7fbb77f37640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb700cdd50 0x7fbb700cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.999+0000 7fbb77f37640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb7006c720 0x7fbb7006cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.999+0000 7fbb77f37640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb700cbca0 con 0x7fbb700cdd50 2023-08-25T04:03:40.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.999+0000 7fbb77f37640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb700c9470 con 0x7fbb700cb020 2023-08-25T04:03:40.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.999+0000 7fbb77f37640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb700ce1e0 con 0x7fbb7006c720 2023-08-25T04:03:40.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.999+0000 7fbb754d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb700cdd50 0x7fbb700cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.999+0000 7fbb754d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb700cdd50 0x7fbb700cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33606/0 (socket says 172.21.15.55:33606) 2023-08-25T04:03:40.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.999+0000 7fbb754d2640 1 -- 172.21.15.55:0/1071173012 learned_addr learned my addr 172.21.15.55:0/1071173012 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:40.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.999+0000 7fbb75cd3640 1 --2- 172.21.15.55:0/1071173012 >> v2:172.21.15.110:3300/0 conn(0x7fbb700cb020 0x7fbb700c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.999+0000 7fbb764d4640 1 --2- 172.21.15.55:0/1071173012 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb7006c720 0x7fbb7006cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.999+0000 7fbb754d2640 1 -- 172.21.15.55:0/1071173012 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb7006c720 msgr2=0x7fbb7006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:40.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.999+0000 7fbb754d2640 1 --2- 172.21.15.55:0/1071173012 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb7006c720 0x7fbb7006cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.999+0000 7fbb754d2640 1 -- 172.21.15.55:0/1071173012 >> v2:172.21.15.110:3300/0 conn(0x7fbb700cb020 msgr2=0x7fbb700c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:40.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.999+0000 7fbb754d2640 1 --2- 172.21.15.55:0/1071173012 >> v2:172.21.15.110:3300/0 conn(0x7fbb700cb020 0x7fbb700c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:39.999+0000 7fbb754d2640 1 -- 172.21.15.55:0/1071173012 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7006d070 con 0x7fbb700cdd50 2023-08-25T04:03:40.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.003+0000 7fbb754d2640 1 --2- 172.21.15.55:0/1071173012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb700cdd50 0x7fbb700cb400 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbb7006daf0 tx=0x7fbb6001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0feda17134898fc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:40.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.003+0000 7fbb74cd1640 1 -- 172.21.15.55:0/1071173012 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb600ab600 con 0x7fbb700cdd50 2023-08-25T04:03:40.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.003+0000 7fbb74cd1640 1 -- 172.21.15.55:0/1071173012 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb600a7050 con 0x7fbb700cdd50 2023-08-25T04:03:40.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.003+0000 7fbb74cd1640 1 -- 172.21.15.55:0/1071173012 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb600ab980 con 0x7fbb700cdd50 2023-08-25T04:03:40.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.003+0000 7fbb77f37640 1 -- 172.21.15.55:0/1071173012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb700cdd50 msgr2=0x7fbb700cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:40.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.003+0000 7fbb77f37640 1 --2- 172.21.15.55:0/1071173012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb700cdd50 0x7fbb700cb400 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbb7006daf0 tx=0x7fbb6001c470 comp rx=0 tx=0).stop 2023-08-25T04:03:40.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.003+0000 7fbb77f37640 1 -- 172.21.15.55:0/1071173012 shutdown_connections 2023-08-25T04:03:40.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.003+0000 7fbb77f37640 1 --2- 172.21.15.55:0/1071173012 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb7006c720 0x7fbb7006cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.003+0000 7fbb77f37640 1 --2- 172.21.15.55:0/1071173012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb700cdd50 0x7fbb700cb400 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.003+0000 7fbb77f37640 1 --2- 172.21.15.55:0/1071173012 >> v2:172.21.15.110:3300/0 conn(0x7fbb700cb020 0x7fbb700c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.003+0000 7fbb77f37640 1 -- 172.21.15.55:0/1071173012 >> 172.21.15.55:0/1071173012 conn(0x7fbb70069900 msgr2=0x7fbb70069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:40.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.003+0000 7fbb77f37640 1 -- 172.21.15.55:0/1071173012 shutdown_connections 2023-08-25T04:03:40.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.003+0000 7fbb77f37640 1 -- 172.21.15.55:0/1071173012 wait complete. 2023-08-25T04:03:40.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb77f37640 1 Processor -- start 2023-08-25T04:03:40.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb77f37640 1 -- start start 2023-08-25T04:03:40.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb77f37640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb7006c720 0x7fbb701f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb77f37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb700cb020 0x7fbb70151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb77f37640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb700cdd50 0x7fbb7009ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb77f37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb700b0770 con 0x7fbb700cb020 2023-08-25T04:03:40.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb77f37640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7009b540 con 0x7fbb700cdd50 2023-08-25T04:03:40.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb77f37640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7009b820 con 0x7fbb7006c720 2023-08-25T04:03:40.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb754d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb700cb020 0x7fbb70151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb754d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb700cb020 0x7fbb70151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33612/0 (socket says 172.21.15.55:33612) 2023-08-25T04:03:40.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb754d2640 1 -- 172.21.15.55:0/2007835088 learned_addr learned my addr 172.21.15.55:0/2007835088 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:40.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb75cd3640 1 --2- 172.21.15.55:0/2007835088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb7006c720 0x7fbb701f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb764d4640 1 --2- 172.21.15.55:0/2007835088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb700cdd50 0x7fbb7009ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb754d2640 1 -- 172.21.15.55:0/2007835088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb7006c720 msgr2=0x7fbb701f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:40.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb754d2640 1 --2- 172.21.15.55:0/2007835088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb7006c720 0x7fbb701f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb754d2640 1 -- 172.21.15.55:0/2007835088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb700cdd50 msgr2=0x7fbb7009ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:40.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb754d2640 1 --2- 172.21.15.55:0/2007835088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb700cdd50 0x7fbb7009ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb754d2640 1 -- 172.21.15.55:0/2007835088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb600094d0 con 0x7fbb700cb020 2023-08-25T04:03:40.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb764d4640 1 --2- 172.21.15.55:0/2007835088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb700cdd50 0x7fbb7009ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:40.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb754d2640 1 --2- 172.21.15.55:0/2007835088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb700cb020 0x7fbb70151510 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbb6001ab20 tx=0x7fbb60019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:40.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb667fc640 1 -- 172.21.15.55:0/2007835088 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb600abe70 con 0x7fbb700cb020 2023-08-25T04:03:40.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb667fc640 1 -- 172.21.15.55:0/2007835088 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb600b4440 con 0x7fbb700cb020 2023-08-25T04:03:40.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb667fc640 1 -- 172.21.15.55:0/2007835088 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb600b47f0 con 0x7fbb700cb020 2023-08-25T04:03:40.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb77f37640 1 -- 172.21.15.55:0/2007835088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb701f3240 con 0x7fbb700cb020 2023-08-25T04:03:40.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.007+0000 7fbb77f37640 1 -- 172.21.15.55:0/2007835088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb701f2ef0 con 0x7fbb700cb020 2023-08-25T04:03:40.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.011+0000 7fbb77f37640 1 -- 172.21.15.55:0/2007835088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb70073ec0 con 0x7fbb700cb020 2023-08-25T04:03:40.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.011+0000 7fbb667fc640 1 -- 172.21.15.55:0/2007835088 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fbb600b2070 con 0x7fbb700cb020 2023-08-25T04:03:40.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.011+0000 7fbb667fc640 1 --2- 172.21.15.55:0/2007835088 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbb54065680 0x7fbb54067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.011+0000 7fbb667fc640 1 -- 172.21.15.55:0/2007835088 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb6011cb60 con 0x7fbb700cb020 2023-08-25T04:03:40.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.011+0000 7fbb75cd3640 1 --2- 172.21.15.55:0/2007835088 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbb54065680 0x7fbb54067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.011+0000 7fbb75cd3640 1 --2- 172.21.15.55:0/2007835088 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbb54065680 0x7fbb54067b40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009ac0 tx=0x7fbb6c006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:40.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.015+0000 7fbb667fc640 1 -- 172.21.15.55:0/2007835088 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbb600ea580 con 0x7fbb700cb020 2023-08-25T04:03:40.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.171+0000 7fbb77f37640 1 -- 172.21.15.55:0/2007835088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb701f36f0 con 0x7fbb700cb020 2023-08-25T04:03:40.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.171+0000 7fbb667fc640 1 -- 172.21.15.55:0/2007835088 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb600b00a0 con 0x7fbb700cb020 2023-08-25T04:03:40.174 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:03:40.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.175+0000 7fbb77f37640 1 -- 172.21.15.55:0/2007835088 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbb54065680 msgr2=0x7fbb54067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:40.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.175+0000 7fbb77f37640 1 --2- 172.21.15.55:0/2007835088 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbb54065680 0x7fbb54067b40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c009ac0 tx=0x7fbb6c006f90 comp rx=0 tx=0).stop 2023-08-25T04:03:40.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.175+0000 7fbb77f37640 1 -- 172.21.15.55:0/2007835088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb700cb020 msgr2=0x7fbb70151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:40.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.175+0000 7fbb77f37640 1 --2- 172.21.15.55:0/2007835088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb700cb020 0x7fbb70151510 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbb6001ab20 tx=0x7fbb60019210 comp rx=0 tx=0).stop 2023-08-25T04:03:40.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.175+0000 7fbb77f37640 1 -- 172.21.15.55:0/2007835088 shutdown_connections 2023-08-25T04:03:40.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.175+0000 7fbb77f37640 1 --2- 172.21.15.55:0/2007835088 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbb54065680 0x7fbb54067b40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.175+0000 7fbb77f37640 1 --2- 172.21.15.55:0/2007835088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb700cdd50 0x7fbb7009ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.175+0000 7fbb77f37640 1 --2- 172.21.15.55:0/2007835088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb700cb020 0x7fbb70151510 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.175+0000 7fbb77f37640 1 --2- 172.21.15.55:0/2007835088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb7006c720 0x7fbb701f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.175+0000 7fbb77f37640 1 -- 172.21.15.55:0/2007835088 >> 172.21.15.55:0/2007835088 conn(0x7fbb70069900 msgr2=0x7fbb700ab2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:40.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.175+0000 7fbb77f37640 1 -- 172.21.15.55:0/2007835088 shutdown_connections 2023-08-25T04:03:40.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.175+0000 7fbb77f37640 1 -- 172.21.15.55:0/2007835088 wait complete. 2023-08-25T04:03:40.195 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:03:40.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac39703640 1 Processor -- start 2023-08-25T04:03:40.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac39703640 1 -- start start 2023-08-25T04:03:40.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac39703640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fac3415c8a0 0x7fac340d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac39703640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac3415cc80 0x7fac340ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac39703640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac340d18a0 con 0x7fac340b1a90 2023-08-25T04:03:40.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac39703640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac340d08a0 con 0x7fac3415c8a0 2023-08-25T04:03:40.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac39703640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac340cd6c0 con 0x7fac3415cc80 2023-08-25T04:03:40.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac337fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fac340b1a90 0x7fac3406a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45140/0 (socket says 172.21.15.55:45140) 2023-08-25T04:03:40.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac337fe640 1 -- 172.21.15.55:0/2928117996 learned_addr learned my addr 172.21.15.55:0/2928117996 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:40.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac32ffd640 1 --2- 172.21.15.55:0/2928117996 >> v2:172.21.15.110:3300/0 conn(0x7fac3415c8a0 0x7fac340d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac327fc640 1 --2- 172.21.15.55:0/2928117996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac3415cc80 0x7fac340ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac31ffb640 1 -- 172.21.15.55:0/2928117996 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876345143 0 0) 0x7fac340d18a0 con 0x7fac340b1a90 2023-08-25T04:03:40.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac31ffb640 1 -- 172.21.15.55:0/2928117996 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac1c003530 con 0x7fac340b1a90 2023-08-25T04:03:40.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac31ffb640 1 -- 172.21.15.55:0/2928117996 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2184285009 0 0) 0x7fac1c003530 con 0x7fac340b1a90 2023-08-25T04:03:40.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac31ffb640 1 -- 172.21.15.55:0/2928117996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac3415cc80 msgr2=0x7fac340ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:40.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac31ffb640 1 --2- 172.21.15.55:0/2928117996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac3415cc80 0x7fac340ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac31ffb640 1 -- 172.21.15.55:0/2928117996 >> v2:172.21.15.110:3300/0 conn(0x7fac3415c8a0 msgr2=0x7fac340d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:40.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac31ffb640 1 --2- 172.21.15.55:0/2928117996 >> v2:172.21.15.110:3300/0 conn(0x7fac3415c8a0 0x7fac340d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac31ffb640 1 -- 172.21.15.55:0/2928117996 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac340cd9a0 con 0x7fac340b1a90 2023-08-25T04:03:40.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac31ffb640 1 -- 172.21.15.55:0/2928117996 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fac2c001a00 con 0x7fac340b1a90 2023-08-25T04:03:40.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac31ffb640 1 -- 172.21.15.55:0/2928117996 >> v1:172.21.15.55:6789/0 conn(0x7fac340b1a90 legacy=0x7fac3406a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:40.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac31ffb640 1 --2- 172.21.15.55:0/2928117996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac1c003980 0x7fac1c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac31ffb640 1 --2- 172.21.15.55:0/2928117996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac3415cc80 0x7fac1c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac31ffb640 1 --2- 172.21.15.55:0/2928117996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac1c004d10 0x7fac1c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac31ffb640 1 -- 172.21.15.55:0/2928117996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac340d08a0 con 0x7fac1c004d10 2023-08-25T04:03:40.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac31ffb640 1 -- 172.21.15.55:0/2928117996 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac340cd6c0 con 0x7fac1c003980 2023-08-25T04:03:40.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac31ffb640 1 -- 172.21.15.55:0/2928117996 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c00b9e0 con 0x7fac3415cc80 2023-08-25T04:03:40.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.339+0000 7fac32ffd640 1 --2- 172.21.15.55:0/2928117996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac1c003980 0x7fac1c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.343+0000 7fac327fc640 1 --2- 172.21.15.55:0/2928117996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac3415cc80 0x7fac1c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.343+0000 7fac337fe640 1 --2- 172.21.15.55:0/2928117996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac1c004d10 0x7fac1c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.343+0000 7fac337fe640 1 -- 172.21.15.55:0/2928117996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac3415cc80 msgr2=0x7fac1c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:40.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.343+0000 7fac337fe640 1 --2- 172.21.15.55:0/2928117996 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac3415cc80 0x7fac1c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.343+0000 7fac337fe640 1 -- 172.21.15.55:0/2928117996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac1c003980 msgr2=0x7fac1c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:40.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.343+0000 7fac337fe640 1 --2- 172.21.15.55:0/2928117996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac1c003980 0x7fac1c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.343+0000 7fac337fe640 1 -- 172.21.15.55:0/2928117996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c003530 con 0x7fac1c004d10 2023-08-25T04:03:40.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.343+0000 7fac32ffd640 1 --2- 172.21.15.55:0/2928117996 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac1c003980 0x7fac1c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:40.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.343+0000 7fac337fe640 1 --2- 172.21.15.55:0/2928117996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac1c004d10 0x7fac1c005190 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00a890 tx=0x7fac2c01fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec864b8f17829b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:40.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.343+0000 7fac31ffb640 1 -- 172.21.15.55:0/2928117996 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c0aa6f0 con 0x7fac1c004d10 2023-08-25T04:03:40.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.343+0000 7fac31ffb640 1 -- 172.21.15.55:0/2928117996 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2c0aa850 con 0x7fac1c004d10 2023-08-25T04:03:40.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.343+0000 7fac31ffb640 1 -- 172.21.15.55:0/2928117996 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c0aac20 con 0x7fac1c004d10 2023-08-25T04:03:40.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac39703640 1 -- 172.21.15.55:0/2928117996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac1c004d10 msgr2=0x7fac1c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:40.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac39703640 1 --2- 172.21.15.55:0/2928117996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac1c004d10 0x7fac1c005190 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00a890 tx=0x7fac2c01fac0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac337fe640 1 -- 172.21.15.55:0/2928117996 reap_dead start 2023-08-25T04:03:40.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac39703640 1 -- 172.21.15.55:0/2928117996 shutdown_connections 2023-08-25T04:03:40.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac39703640 1 -- 172.21.15.55:0/2928117996 >> 172.21.15.55:0/2928117996 conn(0x7fac3409b950 msgr2=0x7fac340d2610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:40.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac39703640 1 -- 172.21.15.55:0/2928117996 shutdown_connections 2023-08-25T04:03:40.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac39703640 1 -- 172.21.15.55:0/2928117996 wait complete. 2023-08-25T04:03:40.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac39703640 1 Processor -- start 2023-08-25T04:03:40.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac39703640 1 -- start start 2023-08-25T04:03:40.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac39703640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac1c004d10 0x7fac341f2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac39703640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac341f5190 0x7fac341501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac39703640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac340b0890 0x7fac340b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac39703640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac341f2b60 con 0x7fac341f5190 2023-08-25T04:03:40.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac39703640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac340b1250 con 0x7fac1c004d10 2023-08-25T04:03:40.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac39703640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3415edf0 con 0x7fac340b0890 2023-08-25T04:03:40.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac327fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac341f5190 0x7fac341501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac327fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac341f5190 0x7fac341501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33638/0 (socket says 172.21.15.55:33638) 2023-08-25T04:03:40.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac327fc640 1 -- 172.21.15.55:0/984782716 learned_addr learned my addr 172.21.15.55:0/984782716 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:40.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac32ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac1c004d10 0x7fac341f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac337fe640 1 --2- 172.21.15.55:0/984782716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac340b0890 0x7fac340b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac327fc640 1 -- 172.21.15.55:0/984782716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac340b0890 msgr2=0x7fac340b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:40.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac327fc640 1 --2- 172.21.15.55:0/984782716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac340b0890 0x7fac340b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac327fc640 1 -- 172.21.15.55:0/984782716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac1c004d10 msgr2=0x7fac341f2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:40.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac327fc640 1 --2- 172.21.15.55:0/984782716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac1c004d10 0x7fac341f2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac327fc640 1 -- 172.21.15.55:0/984782716 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac34150d90 con 0x7fac341f5190 2023-08-25T04:03:40.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac32ffd640 1 --2- 172.21.15.55:0/984782716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac1c004d10 0x7fac341f2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:40.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.347+0000 7fac337fe640 1 --2- 172.21.15.55:0/984782716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac340b0890 0x7fac340b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:40.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.351+0000 7fac327fc640 1 --2- 172.21.15.55:0/984782716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac341f5190 0x7fac341501a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fac280119d0 tx=0x7fac28011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:40.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.351+0000 7fac1b7fe640 1 -- 172.21.15.55:0/984782716 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2800fa90 con 0x7fac341f5190 2023-08-25T04:03:40.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.351+0000 7fac1b7fe640 1 -- 172.21.15.55:0/984782716 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2800fbf0 con 0x7fac341f5190 2023-08-25T04:03:40.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.351+0000 7fac1b7fe640 1 -- 172.21.15.55:0/984782716 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac28014440 con 0x7fac341f5190 2023-08-25T04:03:40.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.351+0000 7fac39703640 1 -- 172.21.15.55:0/984782716 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac341f56e0 con 0x7fac341f5190 2023-08-25T04:03:40.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.351+0000 7fac39703640 1 -- 172.21.15.55:0/984782716 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac341f5ca0 con 0x7fac341f5190 2023-08-25T04:03:40.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.351+0000 7fac39703640 1 -- 172.21.15.55:0/984782716 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3415efa0 con 0x7fac341f5190 2023-08-25T04:03:40.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.351+0000 7fac1b7fe640 1 -- 172.21.15.55:0/984782716 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fac280145a0 con 0x7fac341f5190 2023-08-25T04:03:40.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.351+0000 7fac1b7fe640 1 --2- 172.21.15.55:0/984782716 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fac200656b0 0x7fac20067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.351+0000 7fac1b7fe640 1 -- 172.21.15.55:0/984782716 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac28083570 con 0x7fac341f5190 2023-08-25T04:03:40.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.351+0000 7fac32ffd640 1 --2- 172.21.15.55:0/984782716 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fac200656b0 0x7fac20067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.355+0000 7fac32ffd640 1 --2- 172.21.15.55:0/984782716 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fac200656b0 0x7fac20067b70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fac340d07c0 tx=0x7fac24006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:40.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.355+0000 7fac1b7fe640 1 -- 172.21.15.55:0/984782716 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fac3415efa0 con 0x7fac341f5190 2023-08-25T04:03:40.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.523+0000 7fac39703640 1 -- 172.21.15.55:0/984782716 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fac3415ef60 con 0x7fac341f5190 2023-08-25T04:03:40.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.523+0000 7fac1b7fe640 1 -- 172.21.15.55:0/984782716 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fac28051050 con 0x7fac341f5190 2023-08-25T04:03:40.526 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2023-08-25T04:03:40.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.527+0000 7fac39703640 1 -- 172.21.15.55:0/984782716 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fac200656b0 msgr2=0x7fac20067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:40.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.527+0000 7fac39703640 1 --2- 172.21.15.55:0/984782716 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fac200656b0 0x7fac20067b70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fac340d07c0 tx=0x7fac24006f90 comp rx=0 tx=0).stop 2023-08-25T04:03:40.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.527+0000 7fac39703640 1 -- 172.21.15.55:0/984782716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac341f5190 msgr2=0x7fac341501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:40.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.527+0000 7fac39703640 1 --2- 172.21.15.55:0/984782716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac341f5190 0x7fac341501a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fac280119d0 tx=0x7fac28011dd0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.527+0000 7fac39703640 1 -- 172.21.15.55:0/984782716 shutdown_connections 2023-08-25T04:03:40.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.527+0000 7fac39703640 1 --2- 172.21.15.55:0/984782716 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fac200656b0 0x7fac20067b70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.527+0000 7fac39703640 1 --2- 172.21.15.55:0/984782716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac340b0890 0x7fac340b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.527+0000 7fac39703640 1 --2- 172.21.15.55:0/984782716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac341f5190 0x7fac341501a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.527+0000 7fac39703640 1 --2- 172.21.15.55:0/984782716 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac1c004d10 0x7fac341f2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.527+0000 7fac39703640 1 -- 172.21.15.55:0/984782716 >> 172.21.15.55:0/984782716 conn(0x7fac3409b950 msgr2=0x7fac340af140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:40.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.527+0000 7fac39703640 1 -- 172.21.15.55:0/984782716 shutdown_connections 2023-08-25T04:03:40.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.527+0000 7fac39703640 1 -- 172.21.15.55:0/984782716 wait complete. 2023-08-25T04:03:40.547 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-08-25T04:03:40.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:40.548 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-08-25T04:03:40.598 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T04:03:40.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:40.599 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-25T04:03:40.651 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:03:40.652 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:03:40.662 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:03:40.663 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:03:40.715 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:03:40.715 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:03:40.771 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:40.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.911+0000 7f15ec2af640 1 Processor -- start 2023-08-25T04:03:40.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.911+0000 7f15ec2af640 1 -- start start 2023-08-25T04:03:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.915+0000 7f15ec2af640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15e40ad950 0x7f15e40cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.915+0000 7f15ec2af640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e40cc880 con 0x7f15e40c89f0 2023-08-25T04:03:40.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.915+0000 7f15ec2af640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e40ccb60 con 0x7f15e40ceeb0 2023-08-25T04:03:40.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.915+0000 7f15ec2af640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e40b11f0 con 0x7f15e40ad950 2023-08-25T04:03:40.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.915+0000 7f15ea04b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15e40ad950 0x7f15e40cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.915+0000 7f15ea04b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15e40ad950 0x7f15e40cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48186/0 (socket says 172.21.15.55:48186) 2023-08-25T04:03:40.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.915+0000 7f15e984a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f15e40c89f0 0x7f15e40ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49270/0 (socket says 172.21.15.55:49270) 2023-08-25T04:03:40.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.915+0000 7f15ea04b640 1 -- 172.21.15.55:0/1757930597 learned_addr learned my addr 172.21.15.55:0/1757930597 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:40.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.915+0000 7f15ea04b640 1 -- 172.21.15.55:0/1757930597 >> v1:172.21.15.110:6789/0 conn(0x7f15e40ceeb0 legacy=0x7f15e40b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:40.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.915+0000 7f15ea04b640 1 -- 172.21.15.55:0/1757930597 >> v1:172.21.15.55:6789/0 conn(0x7f15e40c89f0 legacy=0x7f15e40ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:40.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.915+0000 7f15ea04b640 1 -- 172.21.15.55:0/1757930597 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e40cce40 con 0x7f15e40ad950 2023-08-25T04:03:40.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15ea04b640 1 --2- 172.21.15.55:0/1757930597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15e40ad950 0x7f15e40cc2a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f15e40b1330 tx=0x7f15e001eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22e1734973556a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:40.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15e9049640 1 -- 172.21.15.55:0/1757930597 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e00a79f0 con 0x7f15e40ad950 2023-08-25T04:03:40.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15e9049640 1 -- 172.21.15.55:0/1757930597 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e00a7b50 con 0x7f15e40ad950 2023-08-25T04:03:40.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15e9049640 1 -- 172.21.15.55:0/1757930597 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e00af440 con 0x7f15e40ad950 2023-08-25T04:03:40.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15ec2af640 1 -- 172.21.15.55:0/1757930597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15e40ad950 msgr2=0x7f15e40cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:40.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15ec2af640 1 --2- 172.21.15.55:0/1757930597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15e40ad950 0x7f15e40cc2a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f15e40b1330 tx=0x7f15e001eb20 comp rx=0 tx=0).stop 2023-08-25T04:03:40.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15ec2af640 1 -- 172.21.15.55:0/1757930597 shutdown_connections 2023-08-25T04:03:40.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15ec2af640 1 --2- 172.21.15.55:0/1757930597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15e40ad950 0x7f15e40cc2a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15ec2af640 1 -- 172.21.15.55:0/1757930597 >> 172.21.15.55:0/1757930597 conn(0x7f15e4069d00 msgr2=0x7f15e406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:40.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15ec2af640 1 -- 172.21.15.55:0/1757930597 shutdown_connections 2023-08-25T04:03:40.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15ec2af640 1 -- 172.21.15.55:0/1757930597 wait complete. 2023-08-25T04:03:40.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15ec2af640 1 Processor -- start 2023-08-25T04:03:40.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15ec2af640 1 -- start start 2023-08-25T04:03:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15ec2af640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15e40ad950 0x7f15e40c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15ec2af640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15e40c89f0 0x7f15e4152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15ec2af640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15e40ceeb0 0x7f15e40abca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15ec2af640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e41540b0 con 0x7f15e40ad950 2023-08-25T04:03:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15ec2af640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4153430 con 0x7f15e40ceeb0 2023-08-25T04:03:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.919+0000 7f15ec2af640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e4153710 con 0x7f15e40c89f0 2023-08-25T04:03:40.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15ea04b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15e40ad950 0x7f15e40c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15ea04b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15e40ad950 0x7f15e40c0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48188/0 (socket says 172.21.15.55:48188) 2023-08-25T04:03:40.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15ea04b640 1 -- 172.21.15.55:0/1356096138 learned_addr learned my addr 172.21.15.55:0/1356096138 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:40.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15ea84c640 1 --2- 172.21.15.55:0/1356096138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15e40ceeb0 0x7f15e40abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15e984a640 1 --2- 172.21.15.55:0/1356096138 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15e40c89f0 0x7f15e4152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15ea04b640 1 -- 172.21.15.55:0/1356096138 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15e40c89f0 msgr2=0x7f15e4152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:40.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15ea04b640 1 --2- 172.21.15.55:0/1356096138 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15e40c89f0 0x7f15e4152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15ea04b640 1 -- 172.21.15.55:0/1356096138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15e40ceeb0 msgr2=0x7f15e40abca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:40.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15ea04b640 1 --2- 172.21.15.55:0/1356096138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15e40ceeb0 0x7f15e40abca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:40.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15ea04b640 1 -- 172.21.15.55:0/1356096138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e000b770 con 0x7f15e40ad950 2023-08-25T04:03:40.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15ea04b640 1 --2- 172.21.15.55:0/1356096138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15e40ad950 0x7f15e40c0c20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f15e000b2c0 tx=0x7f15e001b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:40.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15daffd640 1 -- 172.21.15.55:0/1356096138 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e00afea0 con 0x7f15e40ad950 2023-08-25T04:03:40.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15daffd640 1 -- 172.21.15.55:0/1356096138 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e00b8400 con 0x7f15e40ad950 2023-08-25T04:03:40.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15ec2af640 1 -- 172.21.15.55:0/1356096138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e41539f0 con 0x7f15e40ad950 2023-08-25T04:03:40.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15daffd640 1 -- 172.21.15.55:0/1356096138 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e00b87b0 con 0x7f15e40ad950 2023-08-25T04:03:40.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15ec2af640 1 -- 172.21.15.55:0/1356096138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e40c1400 con 0x7f15e40ad950 2023-08-25T04:03:40.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15ec2af640 1 -- 172.21.15.55:0/1356096138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e404dbe0 con 0x7f15e40ad950 2023-08-25T04:03:40.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15daffd640 1 -- 172.21.15.55:0/1356096138 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f15e00b6040 con 0x7f15e40ad950 2023-08-25T04:03:40.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15daffd640 1 --2- 172.21.15.55:0/1356096138 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f15c80656b0 0x7f15c8067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:40.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.923+0000 7f15daffd640 1 -- 172.21.15.55:0/1356096138 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15e0120040 con 0x7f15e40ad950 2023-08-25T04:03:40.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.927+0000 7f15e984a640 1 --2- 172.21.15.55:0/1356096138 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f15c80656b0 0x7f15c8067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:40.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.927+0000 7f15e984a640 1 --2- 172.21.15.55:0/1356096138 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f15c80656b0 0x7f15c8067b70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f15e4095210 tx=0x7f15d4007c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:40.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:40.927+0000 7f15daffd640 1 -- 172.21.15.55:0/1356096138 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f15e00edb80 con 0x7f15e40ad950 2023-08-25T04:03:41.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.083+0000 7f15ec2af640 1 -- 172.21.15.55:0/1356096138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15e40c4ee0 con 0x7f15e40ad950 2023-08-25T04:03:41.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.087+0000 7f15daffd640 1 -- 172.21.15.55:0/1356096138 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18291 (secure 0 0 0) 0x7f15e00b4090 con 0x7f15e40ad950 2023-08-25T04:03:41.088 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:41.088 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:02.329010+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:41.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.087+0000 7f15ec2af640 1 -- 172.21.15.55:0/1356096138 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f15c80656b0 msgr2=0x7f15c8067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:41.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.087+0000 7f15ec2af640 1 --2- 172.21.15.55:0/1356096138 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f15c80656b0 0x7f15c8067b70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f15e4095210 tx=0x7f15d4007c90 comp rx=0 tx=0).stop 2023-08-25T04:03:41.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.087+0000 7f15ec2af640 1 -- 172.21.15.55:0/1356096138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15e40ad950 msgr2=0x7f15e40c0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:41.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.087+0000 7f15ec2af640 1 --2- 172.21.15.55:0/1356096138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15e40ad950 0x7f15e40c0c20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f15e000b2c0 tx=0x7f15e001b8c0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.087+0000 7f15ec2af640 1 -- 172.21.15.55:0/1356096138 shutdown_connections 2023-08-25T04:03:41.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.087+0000 7f15ec2af640 1 --2- 172.21.15.55:0/1356096138 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f15c80656b0 0x7f15c8067b70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.087+0000 7f15ec2af640 1 --2- 172.21.15.55:0/1356096138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15e40ceeb0 0x7f15e40abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.087+0000 7f15ec2af640 1 --2- 172.21.15.55:0/1356096138 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15e40c89f0 0x7f15e4152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.087+0000 7f15ec2af640 1 --2- 172.21.15.55:0/1356096138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15e40ad950 0x7f15e40c0c20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.087+0000 7f15ec2af640 1 -- 172.21.15.55:0/1356096138 >> 172.21.15.55:0/1356096138 conn(0x7f15e4069d00 msgr2=0x7f15e40c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:41.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.087+0000 7f15ec2af640 1 -- 172.21.15.55:0/1356096138 shutdown_connections 2023-08-25T04:03:41.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.087+0000 7f15ec2af640 1 -- 172.21.15.55:0/1356096138 wait complete. 2023-08-25T04:03:41.109 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:02:58.890533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:03:00.093976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:03:41.110 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:03:41.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.255+0000 7f2e9f544640 1 Processor -- start 2023-08-25T04:03:41.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.255+0000 7f2e9f544640 1 -- start start 2023-08-25T04:03:41.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.255+0000 7f2e9f544640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e9815aa10 0x7f2e980cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.255+0000 7f2e9f544640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e980cfff0 0x7f2e980cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.255+0000 7f2e9f544640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2e98069900 0x7f2e98069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.255+0000 7f2e9f544640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9806a2d0 con 0x7f2e980cfff0 2023-08-25T04:03:41.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.255+0000 7f2e9f544640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e980cb720 con 0x7f2e98069900 2023-08-25T04:03:41.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.255+0000 7f2e9f544640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9815b150 con 0x7f2e9815aa10 2023-08-25T04:03:41.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.255+0000 7f2e9cadf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e980cfff0 0x7f2e980cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.255+0000 7f2e9cadf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e980cfff0 0x7f2e980cb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48202/0 (socket says 172.21.15.55:48202) 2023-08-25T04:03:41.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.255+0000 7f2e9cadf640 1 -- 172.21.15.55:0/1709192269 learned_addr learned my addr 172.21.15.55:0/1709192269 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:41.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.255+0000 7f2e9d2e0640 1 --2- 172.21.15.55:0/1709192269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e9815aa10 0x7f2e980cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.255+0000 7f2e9dae1640 1 --2- 172.21.15.55:0/1709192269 >> v2:172.21.15.110:3300/0 conn(0x7f2e98069900 0x7f2e98069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.255+0000 7f2e9cadf640 1 -- 172.21.15.55:0/1709192269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e9815aa10 msgr2=0x7f2e980cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:41.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.255+0000 7f2e9cadf640 1 --2- 172.21.15.55:0/1709192269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e9815aa10 0x7f2e980cee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.255+0000 7f2e9cadf640 1 -- 172.21.15.55:0/1709192269 >> v2:172.21.15.110:3300/0 conn(0x7f2e98069900 msgr2=0x7f2e98069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:41.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.255+0000 7f2e9cadf640 1 --2- 172.21.15.55:0/1709192269 >> v2:172.21.15.110:3300/0 conn(0x7f2e98069900 0x7f2e98069d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.255+0000 7f2e9cadf640 1 -- 172.21.15.55:0/1709192269 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9815b430 con 0x7f2e980cfff0 2023-08-25T04:03:41.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.259+0000 7f2e9cadf640 1 --2- 172.21.15.55:0/1709192269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e980cfff0 0x7f2e980cb1e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2e9806e770 tx=0x7f2e8801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b12db6579c58bb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:41.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.259+0000 7f2e8ffff640 1 -- 172.21.15.55:0/1709192269 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e880ab600 con 0x7f2e980cfff0 2023-08-25T04:03:41.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.259+0000 7f2e8ffff640 1 -- 172.21.15.55:0/1709192269 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e880a7050 con 0x7f2e980cfff0 2023-08-25T04:03:41.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.259+0000 7f2e8ffff640 1 -- 172.21.15.55:0/1709192269 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e880ab980 con 0x7f2e980cfff0 2023-08-25T04:03:41.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.259+0000 7f2e9f544640 1 -- 172.21.15.55:0/1709192269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e980cfff0 msgr2=0x7f2e980cb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:41.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.259+0000 7f2e9f544640 1 --2- 172.21.15.55:0/1709192269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e980cfff0 0x7f2e980cb1e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2e9806e770 tx=0x7f2e8801c470 comp rx=0 tx=0).stop 2023-08-25T04:03:41.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.259+0000 7f2e9f544640 1 -- 172.21.15.55:0/1709192269 shutdown_connections 2023-08-25T04:03:41.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.259+0000 7f2e9f544640 1 --2- 172.21.15.55:0/1709192269 >> v2:172.21.15.110:3300/0 conn(0x7f2e98069900 0x7f2e98069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.259+0000 7f2e9f544640 1 --2- 172.21.15.55:0/1709192269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e980cfff0 0x7f2e980cb1e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.259+0000 7f2e9f544640 1 --2- 172.21.15.55:0/1709192269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e9815aa10 0x7f2e980cee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.259+0000 7f2e9f544640 1 -- 172.21.15.55:0/1709192269 >> 172.21.15.55:0/1709192269 conn(0x7f2e980cf4d0 msgr2=0x7f2e980cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.259+0000 7f2e9f544640 1 -- 172.21.15.55:0/1709192269 shutdown_connections 2023-08-25T04:03:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.259+0000 7f2e9f544640 1 -- 172.21.15.55:0/1709192269 wait complete. 2023-08-25T04:03:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9f544640 1 Processor -- start 2023-08-25T04:03:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9f544640 1 -- start start 2023-08-25T04:03:41.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9f544640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e98069900 0x7f2e98152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9f544640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e980cfff0 0x7f2e9814c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9f544640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e9806d810 0x7f2e9806c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9f544640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9813bdc0 con 0x7f2e980cfff0 2023-08-25T04:03:41.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9f544640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9814cc30 con 0x7f2e98069900 2023-08-25T04:03:41.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9f544640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e98151ab0 con 0x7f2e9806d810 2023-08-25T04:03:41.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9cadf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e980cfff0 0x7f2e9814c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9cadf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e980cfff0 0x7f2e9814c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48210/0 (socket says 172.21.15.55:48210) 2023-08-25T04:03:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9cadf640 1 -- 172.21.15.55:0/1191749673 learned_addr learned my addr 172.21.15.55:0/1191749673 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9d2e0640 1 --2- 172.21.15.55:0/1191749673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e98069900 0x7f2e98152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9dae1640 1 --2- 172.21.15.55:0/1191749673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e9806d810 0x7f2e9806c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9cadf640 1 -- 172.21.15.55:0/1191749673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e9806d810 msgr2=0x7f2e9806c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:41.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9cadf640 1 --2- 172.21.15.55:0/1191749673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e9806d810 0x7f2e9806c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9cadf640 1 -- 172.21.15.55:0/1191749673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e98069900 msgr2=0x7f2e98152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:41.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9cadf640 1 --2- 172.21.15.55:0/1191749673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e98069900 0x7f2e98152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9cadf640 1 -- 172.21.15.55:0/1191749673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e880094d0 con 0x7f2e980cfff0 2023-08-25T04:03:41.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9dae1640 1 --2- 172.21.15.55:0/1191749673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e9806d810 0x7f2e9806c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:41.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9cadf640 1 --2- 172.21.15.55:0/1191749673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e980cfff0 0x7f2e9814c6f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2e880ae040 tx=0x7f2e88019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:41.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e8dffb640 1 -- 172.21.15.55:0/1191749673 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e880ba070 con 0x7f2e980cfff0 2023-08-25T04:03:41.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e8dffb640 1 -- 172.21.15.55:0/1191749673 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e880abd20 con 0x7f2e980cfff0 2023-08-25T04:03:41.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e8dffb640 1 -- 172.21.15.55:0/1191749673 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e880b66b0 con 0x7f2e980cfff0 2023-08-25T04:03:41.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9f544640 1 -- 172.21.15.55:0/1191749673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e98151d90 con 0x7f2e980cfff0 2023-08-25T04:03:41.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.263+0000 7f2e9f544640 1 -- 172.21.15.55:0/1191749673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e98152350 con 0x7f2e980cfff0 2023-08-25T04:03:41.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.267+0000 7f2e9f544640 1 -- 172.21.15.55:0/1191749673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e98073ec0 con 0x7f2e980cfff0 2023-08-25T04:03:41.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.267+0000 7f2e8dffb640 1 -- 172.21.15.55:0/1191749673 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2e880b2070 con 0x7f2e980cfff0 2023-08-25T04:03:41.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.267+0000 7f2e8dffb640 1 --2- 172.21.15.55:0/1191749673 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2e7c065680 0x7f2e7c067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.267+0000 7f2e8dffb640 1 -- 172.21.15.55:0/1191749673 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e8811c990 con 0x7f2e980cfff0 2023-08-25T04:03:41.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.267+0000 7f2e9d2e0640 1 --2- 172.21.15.55:0/1191749673 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2e7c065680 0x7f2e7c067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.267+0000 7f2e9d2e0640 1 --2- 172.21.15.55:0/1191749673 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2e7c065680 0x7f2e7c067b40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2e9814fe00 tx=0x7f2e94008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:41.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.271+0000 7f2e8dffb640 1 -- 172.21.15.55:0/1191749673 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2e880ea440 con 0x7f2e980cfff0 2023-08-25T04:03:41.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.431+0000 7f2e9f544640 1 -- 172.21.15.55:0/1191749673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2e980ca0e0 con 0x7f2e980cfff0 2023-08-25T04:03:41.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.431+0000 7f2e8dffb640 1 -- 172.21.15.55:0/1191749673 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2e880eda60 con 0x7f2e980cfff0 2023-08-25T04:03:41.433 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:03:41.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.435+0000 7f2e9f544640 1 -- 172.21.15.55:0/1191749673 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2e7c065680 msgr2=0x7f2e7c067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:41.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.435+0000 7f2e9f544640 1 --2- 172.21.15.55:0/1191749673 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2e7c065680 0x7f2e7c067b40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2e9814fe00 tx=0x7f2e94008040 comp rx=0 tx=0).stop 2023-08-25T04:03:41.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.435+0000 7f2e9f544640 1 -- 172.21.15.55:0/1191749673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e980cfff0 msgr2=0x7f2e9814c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:41.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.435+0000 7f2e9f544640 1 --2- 172.21.15.55:0/1191749673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e980cfff0 0x7f2e9814c6f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2e880ae040 tx=0x7f2e88019210 comp rx=0 tx=0).stop 2023-08-25T04:03:41.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.435+0000 7f2e9f544640 1 -- 172.21.15.55:0/1191749673 shutdown_connections 2023-08-25T04:03:41.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.435+0000 7f2e9f544640 1 --2- 172.21.15.55:0/1191749673 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2e7c065680 0x7f2e7c067b40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.435+0000 7f2e9f544640 1 --2- 172.21.15.55:0/1191749673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e9806d810 0x7f2e9806c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.435+0000 7f2e9f544640 1 --2- 172.21.15.55:0/1191749673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e980cfff0 0x7f2e9814c6f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.435+0000 7f2e9f544640 1 --2- 172.21.15.55:0/1191749673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e98069900 0x7f2e98152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.435+0000 7f2e9f544640 1 -- 172.21.15.55:0/1191749673 >> 172.21.15.55:0/1191749673 conn(0x7f2e980cf4d0 msgr2=0x7f2e981531c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:41.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.435+0000 7f2e9f544640 1 -- 172.21.15.55:0/1191749673 shutdown_connections 2023-08-25T04:03:41.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.435+0000 7f2e9f544640 1 -- 172.21.15.55:0/1191749673 wait complete. 2023-08-25T04:03:41.454 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:03:41.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.599+0000 7facf3f11640 1 Processor -- start 2023-08-25T04:03:41.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.599+0000 7facf3f11640 1 -- start start 2023-08-25T04:03:41.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.603+0000 7facf3f11640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7facec1601f0 0x7facec15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.603+0000 7facf3f11640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facec15e3c0 0x7facec0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.603+0000 7facf3f11640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facec15f8b0 con 0x7facec0d10c0 2023-08-25T04:03:41.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.603+0000 7facf3f11640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facec0cd5a0 con 0x7facec1601f0 2023-08-25T04:03:41.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.603+0000 7facf3f11640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facec0cd880 con 0x7facec15e3c0 2023-08-25T04:03:41.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.603+0000 7facf1cad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7facec1601f0 0x7facec15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.603+0000 7facf24ae640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7facec0d10c0 0x7facec0b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49280/0 (socket says 172.21.15.55:49280) 2023-08-25T04:03:41.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.603+0000 7facf24ae640 1 -- 172.21.15.55:0/1849919161 learned_addr learned my addr 172.21.15.55:0/1849919161 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:41.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.603+0000 7facf14ac640 1 --2- 172.21.15.55:0/1849919161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facec15e3c0 0x7facec0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.603+0000 7facf0cab640 1 -- 172.21.15.55:0/1849919161 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269978359 0 0) 0x7facec15f8b0 con 0x7facec0d10c0 2023-08-25T04:03:41.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.603+0000 7facf1cad640 1 -- 172.21.15.55:0/1849919161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facec15e3c0 msgr2=0x7facec0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:41.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.603+0000 7facf1cad640 1 --2- 172.21.15.55:0/1849919161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facec15e3c0 0x7facec0d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.603+0000 7facf1cad640 1 -- 172.21.15.55:0/1849919161 >> v1:172.21.15.55:6789/0 conn(0x7facec0d10c0 legacy=0x7facec0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:41.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.603+0000 7facf1cad640 1 -- 172.21.15.55:0/1849919161 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec0cdb60 con 0x7facec1601f0 2023-08-25T04:03:41.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.603+0000 7facf1cad640 1 --2- 172.21.15.55:0/1849919161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facec1601f0 0x7facec15d430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7face80097b0 tx=0x7face801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246ec6d937c72e65 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:41.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf0cab640 1 -- 172.21.15.55:0/1849919161 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face80a8970 con 0x7facec1601f0 2023-08-25T04:03:41.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf0cab640 1 -- 172.21.15.55:0/1849919161 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face80a8ad0 con 0x7facec1601f0 2023-08-25T04:03:41.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf0cab640 1 -- 172.21.15.55:0/1849919161 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face80a8e60 con 0x7facec1601f0 2023-08-25T04:03:41.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf3f11640 1 -- 172.21.15.55:0/1849919161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facec1601f0 msgr2=0x7facec15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:41.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf3f11640 1 --2- 172.21.15.55:0/1849919161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facec1601f0 0x7facec15d430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7face80097b0 tx=0x7face801ec70 comp rx=0 tx=0).stop 2023-08-25T04:03:41.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf3f11640 1 -- 172.21.15.55:0/1849919161 shutdown_connections 2023-08-25T04:03:41.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf3f11640 1 --2- 172.21.15.55:0/1849919161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facec15e3c0 0x7facec0d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf3f11640 1 --2- 172.21.15.55:0/1849919161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facec1601f0 0x7facec15d430 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf3f11640 1 -- 172.21.15.55:0/1849919161 >> 172.21.15.55:0/1849919161 conn(0x7facec0d27d0 msgr2=0x7facec0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:41.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf3f11640 1 -- 172.21.15.55:0/1849919161 shutdown_connections 2023-08-25T04:03:41.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf3f11640 1 -- 172.21.15.55:0/1849919161 wait complete. 2023-08-25T04:03:41.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf3f11640 1 Processor -- start 2023-08-25T04:03:41.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf3f11640 1 -- start start 2023-08-25T04:03:41.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf3f11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facec0d10c0 0x7facec0b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf3f11640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facec15e3c0 0x7facec15c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf3f11640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facec1601f0 0x7facec0b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf3f11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec15c6f0 con 0x7facec0d10c0 2023-08-25T04:03:41.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf3f11640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec0b2d40 con 0x7facec15e3c0 2023-08-25T04:03:41.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf3f11640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facec0b3020 con 0x7facec1601f0 2023-08-25T04:03:41.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf1cad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facec0d10c0 0x7facec0b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.607+0000 7facf1cad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facec0d10c0 0x7facec0b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48224/0 (socket says 172.21.15.55:48224) 2023-08-25T04:03:41.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7facf1cad640 1 -- 172.21.15.55:0/2370169199 learned_addr learned my addr 172.21.15.55:0/2370169199 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:41.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7facf14ac640 1 --2- 172.21.15.55:0/2370169199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facec15e3c0 0x7facec15c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7facf24ae640 1 --2- 172.21.15.55:0/2370169199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facec1601f0 0x7facec0b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7facf1cad640 1 -- 172.21.15.55:0/2370169199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facec1601f0 msgr2=0x7facec0b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:41.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7facf1cad640 1 --2- 172.21.15.55:0/2370169199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facec1601f0 0x7facec0b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7facf1cad640 1 -- 172.21.15.55:0/2370169199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facec15e3c0 msgr2=0x7facec15c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:41.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7facf1cad640 1 --2- 172.21.15.55:0/2370169199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facec15e3c0 0x7facec15c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7facf1cad640 1 -- 172.21.15.55:0/2370169199 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face80093c0 con 0x7facec0d10c0 2023-08-25T04:03:41.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7facf24ae640 1 --2- 172.21.15.55:0/2370169199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facec1601f0 0x7facec0b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:41.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7facf1cad640 1 --2- 172.21.15.55:0/2370169199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facec0d10c0 0x7facec0b01c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7face80b3040 tx=0x7face801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:41.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7face27fc640 1 -- 172.21.15.55:0/2370169199 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face80b9630 con 0x7facec0d10c0 2023-08-25T04:03:41.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7face27fc640 1 -- 172.21.15.55:0/2370169199 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face80b97b0 con 0x7facec0d10c0 2023-08-25T04:03:41.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7face27fc640 1 -- 172.21.15.55:0/2370169199 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face80b9b60 con 0x7facec0d10c0 2023-08-25T04:03:41.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7facf3f11640 1 -- 172.21.15.55:0/2370169199 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facec1f3370 con 0x7facec0d10c0 2023-08-25T04:03:41.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7facf3f11640 1 -- 172.21.15.55:0/2370169199 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facec1f3930 con 0x7facec0d10c0 2023-08-25T04:03:41.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7facf3f11640 1 -- 172.21.15.55:0/2370169199 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facec0b5260 con 0x7facec0d10c0 2023-08-25T04:03:41.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7face27fc640 1 -- 172.21.15.55:0/2370169199 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7face80b7040 con 0x7facec0d10c0 2023-08-25T04:03:41.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7face27fc640 1 --2- 172.21.15.55:0/2370169199 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7facd0065680 0x7facd0067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.611+0000 7face27fc640 1 -- 172.21.15.55:0/2370169199 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7face8120d80 con 0x7facec0d10c0 2023-08-25T04:03:41.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.615+0000 7facf14ac640 1 --2- 172.21.15.55:0/2370169199 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7facd0065680 0x7facd0067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.615+0000 7facf14ac640 1 --2- 172.21.15.55:0/2370169199 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7facd0065680 0x7facd0067b40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7facec0d1a70 tx=0x7facdc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:41.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.615+0000 7face27fc640 1 -- 172.21.15.55:0/2370169199 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7face80ee910 con 0x7facec0d10c0 2023-08-25T04:03:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.779+0000 7facf3f11640 1 -- 172.21.15.55:0/2370169199 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7facec073ec0 con 0x7facec0d10c0 2023-08-25T04:03:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.779+0000 7face27fc640 1 -- 172.21.15.55:0/2370169199 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7face80b50a0 con 0x7facec0d10c0 2023-08-25T04:03:41.780 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:03:41.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.779+0000 7facf3f11640 1 -- 172.21.15.55:0/2370169199 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7facd0065680 msgr2=0x7facd0067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:41.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.779+0000 7facf3f11640 1 --2- 172.21.15.55:0/2370169199 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7facd0065680 0x7facd0067b40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7facec0d1a70 tx=0x7facdc008040 comp rx=0 tx=0).stop 2023-08-25T04:03:41.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.779+0000 7facf3f11640 1 -- 172.21.15.55:0/2370169199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facec0d10c0 msgr2=0x7facec0b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:41.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.779+0000 7facf3f11640 1 --2- 172.21.15.55:0/2370169199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facec0d10c0 0x7facec0b01c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7face80b3040 tx=0x7face801ba10 comp rx=0 tx=0).stop 2023-08-25T04:03:41.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.779+0000 7facf3f11640 1 -- 172.21.15.55:0/2370169199 shutdown_connections 2023-08-25T04:03:41.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.779+0000 7facf3f11640 1 --2- 172.21.15.55:0/2370169199 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7facd0065680 0x7facd0067b40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.779+0000 7facf3f11640 1 --2- 172.21.15.55:0/2370169199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facec1601f0 0x7facec0b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.779+0000 7facf3f11640 1 --2- 172.21.15.55:0/2370169199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facec15e3c0 0x7facec15c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.779+0000 7facf3f11640 1 --2- 172.21.15.55:0/2370169199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7facec0d10c0 0x7facec0b01c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.779+0000 7facf3f11640 1 -- 172.21.15.55:0/2370169199 >> 172.21.15.55:0/2370169199 conn(0x7facec0d27d0 msgr2=0x7facec0cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:41.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.779+0000 7facf3f11640 1 -- 172.21.15.55:0/2370169199 shutdown_connections 2023-08-25T04:03:41.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.779+0000 7facf3f11640 1 -- 172.21.15.55:0/2370169199 wait complete. 2023-08-25T04:03:41.800 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:03:41.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.947+0000 7f715c18f640 1 Processor -- start 2023-08-25T04:03:41.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.947+0000 7f715c18f640 1 -- start start 2023-08-25T04:03:41.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.947+0000 7f715c18f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f71540cb020 0x7f71540c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.947+0000 7f715c18f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f71540cdd50 0x7f71540cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.947+0000 7f715c18f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f715406c720 0x7f715406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.947+0000 7f715c18f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71540cbca0 con 0x7f71540cdd50 2023-08-25T04:03:41.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.947+0000 7f715c18f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71540c9470 con 0x7f71540cb020 2023-08-25T04:03:41.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.947+0000 7f715c18f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71540ce1e0 con 0x7f715406c720 2023-08-25T04:03:41.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.947+0000 7f715972a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f71540cdd50 0x7f71540cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.947+0000 7f715972a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f71540cdd50 0x7f71540cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48234/0 (socket says 172.21.15.55:48234) 2023-08-25T04:03:41.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.947+0000 7f715972a640 1 -- 172.21.15.55:0/1178929317 learned_addr learned my addr 172.21.15.55:0/1178929317 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:41.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.947+0000 7f715a72c640 1 --2- 172.21.15.55:0/1178929317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f715406c720 0x7f715406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.947+0000 7f7159f2b640 1 --2- 172.21.15.55:0/1178929317 >> v2:172.21.15.110:3300/0 conn(0x7f71540cb020 0x7f71540c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.947+0000 7f715972a640 1 -- 172.21.15.55:0/1178929317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f715406c720 msgr2=0x7f715406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:41.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.947+0000 7f715972a640 1 --2- 172.21.15.55:0/1178929317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f715406c720 0x7f715406cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.947+0000 7f715972a640 1 -- 172.21.15.55:0/1178929317 >> v2:172.21.15.110:3300/0 conn(0x7f71540cb020 msgr2=0x7f71540c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:41.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.947+0000 7f715972a640 1 --2- 172.21.15.55:0/1178929317 >> v2:172.21.15.110:3300/0 conn(0x7f71540cb020 0x7f71540c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.947+0000 7f715972a640 1 -- 172.21.15.55:0/1178929317 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715406d070 con 0x7f71540cdd50 2023-08-25T04:03:41.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.951+0000 7f715972a640 1 --2- 172.21.15.55:0/1178929317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71540cdd50 0x7f71540cb400 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f715406daf0 tx=0x7f714401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9918e011fdd96c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:41.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.951+0000 7f7158f29640 1 -- 172.21.15.55:0/1178929317 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71440ab600 con 0x7f71540cdd50 2023-08-25T04:03:41.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.951+0000 7f7158f29640 1 -- 172.21.15.55:0/1178929317 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71440a7050 con 0x7f71540cdd50 2023-08-25T04:03:41.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.951+0000 7f7158f29640 1 -- 172.21.15.55:0/1178929317 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71440ab980 con 0x7f71540cdd50 2023-08-25T04:03:41.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.951+0000 7f715c18f640 1 -- 172.21.15.55:0/1178929317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71540cdd50 msgr2=0x7f71540cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:41.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.951+0000 7f715c18f640 1 --2- 172.21.15.55:0/1178929317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71540cdd50 0x7f71540cb400 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f715406daf0 tx=0x7f714401c470 comp rx=0 tx=0).stop 2023-08-25T04:03:41.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.951+0000 7f715c18f640 1 -- 172.21.15.55:0/1178929317 shutdown_connections 2023-08-25T04:03:41.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.951+0000 7f715c18f640 1 --2- 172.21.15.55:0/1178929317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f715406c720 0x7f715406cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.951+0000 7f715c18f640 1 --2- 172.21.15.55:0/1178929317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71540cdd50 0x7f71540cb400 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.951+0000 7f715c18f640 1 --2- 172.21.15.55:0/1178929317 >> v2:172.21.15.110:3300/0 conn(0x7f71540cb020 0x7f71540c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.951+0000 7f715c18f640 1 -- 172.21.15.55:0/1178929317 >> 172.21.15.55:0/1178929317 conn(0x7f7154069900 msgr2=0x7f7154069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:41.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.951+0000 7f715c18f640 1 -- 172.21.15.55:0/1178929317 shutdown_connections 2023-08-25T04:03:41.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.951+0000 7f715c18f640 1 -- 172.21.15.55:0/1178929317 wait complete. 2023-08-25T04:03:41.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715c18f640 1 Processor -- start 2023-08-25T04:03:41.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715c18f640 1 -- start start 2023-08-25T04:03:41.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715c18f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f715406c720 0x7f71540c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715c18f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71540cb020 0x7f71541518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715c18f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71540cdd50 0x7f71540c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715c18f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71540afb70 con 0x7f71540cdd50 2023-08-25T04:03:41.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715c18f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71540aeef0 con 0x7f715406c720 2023-08-25T04:03:41.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715c18f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71540af1d0 con 0x7f71540cb020 2023-08-25T04:03:41.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715a72c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71540cdd50 0x7f71540c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715a72c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71540cdd50 0x7f71540c4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48246/0 (socket says 172.21.15.55:48246) 2023-08-25T04:03:41.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715a72c640 1 -- 172.21.15.55:0/1372089271 learned_addr learned my addr 172.21.15.55:0/1372089271 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:41.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f7159f2b640 1 --2- 172.21.15.55:0/1372089271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f715406c720 0x7f71540c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715972a640 1 --2- 172.21.15.55:0/1372089271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71540cb020 0x7f71541518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715a72c640 1 -- 172.21.15.55:0/1372089271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71540cb020 msgr2=0x7f71541518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:41.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715a72c640 1 --2- 172.21.15.55:0/1372089271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71540cb020 0x7f71541518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715a72c640 1 -- 172.21.15.55:0/1372089271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f715406c720 msgr2=0x7f71540c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:41.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715a72c640 1 --2- 172.21.15.55:0/1372089271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f715406c720 0x7f71540c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:41.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715a72c640 1 -- 172.21.15.55:0/1372089271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71440094d0 con 0x7f71540cdd50 2023-08-25T04:03:41.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715a72c640 1 --2- 172.21.15.55:0/1372089271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71540cdd50 0x7f71540c4700 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f714c00efc0 tx=0x7f714c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:41.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f714a7fc640 1 -- 172.21.15.55:0/1372089271 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c014480 con 0x7f71540cdd50 2023-08-25T04:03:41.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f714a7fc640 1 -- 172.21.15.55:0/1372089271 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c00f040 con 0x7f71540cdd50 2023-08-25T04:03:41.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f714a7fc640 1 -- 172.21.15.55:0/1372089271 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c014820 con 0x7f71540cdd50 2023-08-25T04:03:41.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715c18f640 1 -- 172.21.15.55:0/1372089271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71540af4b0 con 0x7f71540cdd50 2023-08-25T04:03:41.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715c18f640 1 -- 172.21.15.55:0/1372089271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71540c8670 con 0x7f71540cdd50 2023-08-25T04:03:41.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.955+0000 7f715c18f640 1 -- 172.21.15.55:0/1372089271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7154073ec0 con 0x7f71540cdd50 2023-08-25T04:03:41.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.959+0000 7f714a7fc640 1 -- 172.21.15.55:0/1372089271 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f714c014980 con 0x7f71540cdd50 2023-08-25T04:03:41.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.959+0000 7f714a7fc640 1 --2- 172.21.15.55:0/1372089271 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7138065680 0x7f7138067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:41.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.959+0000 7f714a7fc640 1 -- 172.21.15.55:0/1372089271 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f714c083bd0 con 0x7f71540cdd50 2023-08-25T04:03:41.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.959+0000 7f7159f2b640 1 --2- 172.21.15.55:0/1372089271 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7138065680 0x7f7138067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:41.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.959+0000 7f7159f2b640 1 --2- 172.21.15.55:0/1372089271 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7138065680 0x7f7138067b40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7150006fd0 tx=0x7f7150008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:41.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:41.963+0000 7f714a7fc640 1 -- 172.21.15.55:0/1372089271 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f714c0516f0 con 0x7f71540cdd50 2023-08-25T04:03:42.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.119+0000 7f715c18f640 1 -- 172.21.15.55:0/1372089271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f715406a5f0 con 0x7f71540cdd50 2023-08-25T04:03:42.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.119+0000 7f714a7fc640 1 -- 172.21.15.55:0/1372089271 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f714c0180a0 con 0x7f71540cdd50 2023-08-25T04:03:42.122 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:03:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.119+0000 7f715c18f640 1 -- 172.21.15.55:0/1372089271 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7138065680 msgr2=0x7f7138067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.119+0000 7f715c18f640 1 --2- 172.21.15.55:0/1372089271 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7138065680 0x7f7138067b40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7150006fd0 tx=0x7f7150008040 comp rx=0 tx=0).stop 2023-08-25T04:03:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.123+0000 7f715c18f640 1 -- 172.21.15.55:0/1372089271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71540cdd50 msgr2=0x7f71540c4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:42.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.123+0000 7f715c18f640 1 --2- 172.21.15.55:0/1372089271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71540cdd50 0x7f71540c4700 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f714c00efc0 tx=0x7f714c00c490 comp rx=0 tx=0).stop 2023-08-25T04:03:42.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.123+0000 7f715c18f640 1 -- 172.21.15.55:0/1372089271 shutdown_connections 2023-08-25T04:03:42.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.123+0000 7f715c18f640 1 --2- 172.21.15.55:0/1372089271 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7138065680 0x7f7138067b40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.123+0000 7f715c18f640 1 --2- 172.21.15.55:0/1372089271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71540cdd50 0x7f71540c4700 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.123+0000 7f715c18f640 1 --2- 172.21.15.55:0/1372089271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71540cb020 0x7f71541518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.123+0000 7f715c18f640 1 --2- 172.21.15.55:0/1372089271 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f715406c720 0x7f71540c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.123+0000 7f715c18f640 1 -- 172.21.15.55:0/1372089271 >> 172.21.15.55:0/1372089271 conn(0x7f7154069900 msgr2=0x7f71540abcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:42.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.123+0000 7f715c18f640 1 -- 172.21.15.55:0/1372089271 shutdown_connections 2023-08-25T04:03:42.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.123+0000 7f715c18f640 1 -- 172.21.15.55:0/1372089271 wait complete. 2023-08-25T04:03:42.142 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:03:42.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.287+0000 7f7833144640 1 Processor -- start 2023-08-25T04:03:42.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.287+0000 7f7833144640 1 -- start start 2023-08-25T04:03:42.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.287+0000 7f7833144640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f782c0cb710 0x7f782c0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:42.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.287+0000 7f7833144640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c0cdf20 con 0x7f782c06c9c0 2023-08-25T04:03:42.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.287+0000 7f7833144640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c09bc40 con 0x7f782c0ad6b0 2023-08-25T04:03:42.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.287+0000 7f7833144640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782c09bf20 con 0x7f782c0cb710 2023-08-25T04:03:42.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.287+0000 7f78316e1640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f782c06c9c0 0x7f782c0c8a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49292/0 (socket says 172.21.15.55:49292) 2023-08-25T04:03:42.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.287+0000 7f78316e1640 1 -- 172.21.15.55:0/2507399991 learned_addr learned my addr 172.21.15.55:0/2507399991 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:42.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.287+0000 7f7823fff640 1 --2- 172.21.15.55:0/2507399991 >> v2:172.21.15.110:3300/0 conn(0x7f782c0cb710 0x7f782c0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:42.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.287+0000 7f78237fe640 1 -- 172.21.15.55:0/2507399991 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894913314 0 0) 0x7f782c0cdf20 con 0x7f782c06c9c0 2023-08-25T04:03:42.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.287+0000 7f78237fe640 1 -- 172.21.15.55:0/2507399991 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7814003530 con 0x7f782c06c9c0 2023-08-25T04:03:42.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.287+0000 7f7823fff640 1 -- 172.21.15.55:0/2507399991 >> v1:172.21.15.110:6789/0 conn(0x7f782c0ad6b0 legacy=0x7f782c0b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:42.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.287+0000 7f78237fe640 1 -- 172.21.15.55:0/2507399991 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212000923 0 0) 0x7f782c09bc40 con 0x7f782c0ad6b0 2023-08-25T04:03:42.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.287+0000 7f7823fff640 1 -- 172.21.15.55:0/2507399991 >> v1:172.21.15.55:6789/0 conn(0x7f782c06c9c0 legacy=0x7f782c0c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:42.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.287+0000 7f7823fff640 1 -- 172.21.15.55:0/2507399991 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c06c1c0 con 0x7f782c0cb710 2023-08-25T04:03:42.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.291+0000 7f7823fff640 1 --2- 172.21.15.55:0/2507399991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f782c0cb710 0x7f782c0cd1b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f781c0097c0 tx=0x7f781c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91f6c787f972a694 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:42.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.291+0000 7f78237fe640 1 -- 172.21.15.55:0/2507399991 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c0ab600 con 0x7f782c0cb710 2023-08-25T04:03:42.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.291+0000 7f78237fe640 1 -- 172.21.15.55:0/2507399991 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c0a7050 con 0x7f782c0cb710 2023-08-25T04:03:42.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.291+0000 7f78237fe640 1 -- 172.21.15.55:0/2507399991 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c0ab960 con 0x7f782c0cb710 2023-08-25T04:03:42.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.291+0000 7f7833144640 1 -- 172.21.15.55:0/2507399991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f782c0cb710 msgr2=0x7f782c0cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:42.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.291+0000 7f7833144640 1 --2- 172.21.15.55:0/2507399991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f782c0cb710 0x7f782c0cd1b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f781c0097c0 tx=0x7f781c01c480 comp rx=0 tx=0).stop 2023-08-25T04:03:42.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.291+0000 7f7833144640 1 -- 172.21.15.55:0/2507399991 shutdown_connections 2023-08-25T04:03:42.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.291+0000 7f7833144640 1 --2- 172.21.15.55:0/2507399991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f782c0cb710 0x7f782c0cd1b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.291+0000 7f7833144640 1 -- 172.21.15.55:0/2507399991 >> 172.21.15.55:0/2507399991 conn(0x7f782c069900 msgr2=0x7f782c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:42.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.291+0000 7f7833144640 1 -- 172.21.15.55:0/2507399991 shutdown_connections 2023-08-25T04:03:42.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.291+0000 7f7833144640 1 -- 172.21.15.55:0/2507399991 wait complete. 2023-08-25T04:03:42.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f7833144640 1 Processor -- start 2023-08-25T04:03:42.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f7833144640 1 -- start start 2023-08-25T04:03:42.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f7833144640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f782c06c9c0 0x7f782c157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:42.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f7833144640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f782c0ad6b0 0x7f782c09b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:42.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f7833144640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f782c0cb710 0x7f782c1f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:42.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f7833144640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0ac0d0 con 0x7f782c06c9c0 2023-08-25T04:03:42.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f7833144640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0ac590 con 0x7f782c0cb710 2023-08-25T04:03:42.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f7833144640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0ae170 con 0x7f782c0ad6b0 2023-08-25T04:03:42.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f7830ee0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f782c06c9c0 0x7f782c157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:42.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f7830ee0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f782c06c9c0 0x7f782c157250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48252/0 (socket says 172.21.15.55:48252) 2023-08-25T04:03:42.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f7830ee0640 1 -- 172.21.15.55:0/3827119010 learned_addr learned my addr 172.21.15.55:0/3827119010 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:42.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f7823fff640 1 --2- 172.21.15.55:0/3827119010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f782c0ad6b0 0x7f782c09b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:42.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f78316e1640 1 --2- 172.21.15.55:0/3827119010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f782c0cb710 0x7f782c1f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:42.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f7830ee0640 1 -- 172.21.15.55:0/3827119010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f782c0ad6b0 msgr2=0x7f782c09b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:42.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f7830ee0640 1 --2- 172.21.15.55:0/3827119010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f782c0ad6b0 0x7f782c09b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f7830ee0640 1 -- 172.21.15.55:0/3827119010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f782c0cb710 msgr2=0x7f782c1f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:42.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f7830ee0640 1 --2- 172.21.15.55:0/3827119010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f782c0cb710 0x7f782c1f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f7830ee0640 1 -- 172.21.15.55:0/3827119010 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c009420 con 0x7f782c06c9c0 2023-08-25T04:03:42.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f7830ee0640 1 --2- 172.21.15.55:0/3827119010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f782c06c9c0 0x7f782c157250 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f782800c460 tx=0x7f782800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:42.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f78217fa640 1 -- 172.21.15.55:0/3827119010 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828005480 con 0x7f782c06c9c0 2023-08-25T04:03:42.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f78217fa640 1 -- 172.21.15.55:0/3827119010 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7828003650 con 0x7f782c06c9c0 2023-08-25T04:03:42.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.295+0000 7f78217fa640 1 -- 172.21.15.55:0/3827119010 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828003a00 con 0x7f782c06c9c0 2023-08-25T04:03:42.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.299+0000 7f7833144640 1 -- 172.21.15.55:0/3827119010 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c0ac2b0 con 0x7f782c06c9c0 2023-08-25T04:03:42.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.299+0000 7f7833144640 1 -- 172.21.15.55:0/3827119010 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c09a8a0 con 0x7f782c06c9c0 2023-08-25T04:03:42.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.299+0000 7f7833144640 1 -- 172.21.15.55:0/3827119010 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782c09a420 con 0x7f782c06c9c0 2023-08-25T04:03:42.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.299+0000 7f78217fa640 1 -- 172.21.15.55:0/3827119010 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7828003b60 con 0x7f782c06c9c0 2023-08-25T04:03:42.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.299+0000 7f78217fa640 1 --2- 172.21.15.55:0/3827119010 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f78180656b0 0x7f7818067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:42.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.299+0000 7f78217fa640 1 -- 172.21.15.55:0/3827119010 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f78280823a0 con 0x7f782c06c9c0 2023-08-25T04:03:42.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.299+0000 7f7823fff640 1 --2- 172.21.15.55:0/3827119010 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f78180656b0 0x7f7818067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:42.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.303+0000 7f7823fff640 1 --2- 172.21.15.55:0/3827119010 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f78180656b0 0x7f7818067b70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f781c0ad000 tx=0x7f781c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:42.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.303+0000 7f78217fa640 1 -- 172.21.15.55:0/3827119010 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f782c09a420 con 0x7f782c06c9c0 2023-08-25T04:03:42.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.459+0000 7f7833144640 1 -- 172.21.15.55:0/3827119010 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f782c09a420 con 0x7f782c06c9c0 2023-08-25T04:03:42.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.459+0000 7f78217fa640 1 -- 172.21.15.55:0/3827119010 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f782c09a420 con 0x7f782c06c9c0 2023-08-25T04:03:42.461 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:03:42.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.459+0000 7f7833144640 1 -- 172.21.15.55:0/3827119010 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f78180656b0 msgr2=0x7f7818067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:42.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.459+0000 7f7833144640 1 --2- 172.21.15.55:0/3827119010 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f78180656b0 0x7f7818067b70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f781c0ad000 tx=0x7f781c0a6000 comp rx=0 tx=0).stop 2023-08-25T04:03:42.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.459+0000 7f7833144640 1 -- 172.21.15.55:0/3827119010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f782c06c9c0 msgr2=0x7f782c157250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:42.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.459+0000 7f7833144640 1 --2- 172.21.15.55:0/3827119010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f782c06c9c0 0x7f782c157250 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f782800c460 tx=0x7f782800c920 comp rx=0 tx=0).stop 2023-08-25T04:03:42.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.459+0000 7f7833144640 1 -- 172.21.15.55:0/3827119010 shutdown_connections 2023-08-25T04:03:42.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.459+0000 7f7833144640 1 --2- 172.21.15.55:0/3827119010 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f78180656b0 0x7f7818067b70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.459+0000 7f7833144640 1 --2- 172.21.15.55:0/3827119010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f782c0cb710 0x7f782c1f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.459+0000 7f7833144640 1 --2- 172.21.15.55:0/3827119010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f782c0ad6b0 0x7f782c09b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.459+0000 7f7833144640 1 --2- 172.21.15.55:0/3827119010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f782c06c9c0 0x7f782c157250 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.459+0000 7f7833144640 1 -- 172.21.15.55:0/3827119010 >> 172.21.15.55:0/3827119010 conn(0x7f782c069900 msgr2=0x7f782c06f920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:42.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.463+0000 7f7833144640 1 -- 172.21.15.55:0/3827119010 shutdown_connections 2023-08-25T04:03:42.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.463+0000 7f7833144640 1 -- 172.21.15.55:0/3827119010 wait complete. 2023-08-25T04:03:42.482 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:03:42.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.627+0000 7efe2be88640 1 Processor -- start 2023-08-25T04:03:42.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.627+0000 7efe2be88640 1 -- start start 2023-08-25T04:03:42.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.627+0000 7efe2be88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe240cdde0 0x7efe240ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:42.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.627+0000 7efe2be88640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe240b2e40 0x7efe240b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:42.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.627+0000 7efe2be88640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe240b29b0 con 0x7efe240d0da0 2023-08-25T04:03:42.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.627+0000 7efe2be88640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe240ce760 con 0x7efe240b2e40 2023-08-25T04:03:42.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.627+0000 7efe2be88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe240b1dc0 con 0x7efe240cdde0 2023-08-25T04:03:42.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.627+0000 7efe2a425640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe240b2e40 0x7efe240b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:42.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.627+0000 7efe2a425640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe240b2e40 0x7efe240b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48266/0 (socket says 172.21.15.55:48266) 2023-08-25T04:03:42.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.627+0000 7efe2a425640 1 -- 172.21.15.55:0/1428823292 learned_addr learned my addr 172.21.15.55:0/1428823292 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:42.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.627+0000 7efe29423640 1 --2- 172.21.15.55:0/1428823292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe240cdde0 0x7efe240ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:42.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.627+0000 7efe2a425640 1 -- 172.21.15.55:0/1428823292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe240cdde0 msgr2=0x7efe240ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:42.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.627+0000 7efe2a425640 1 --2- 172.21.15.55:0/1428823292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe240cdde0 0x7efe240ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.627+0000 7efe2a425640 1 -- 172.21.15.55:0/1428823292 >> v1:172.21.15.110:6789/0 conn(0x7efe240d0da0 legacy=0x7efe240d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:42.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.627+0000 7efe2a425640 1 -- 172.21.15.55:0/1428823292 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe240b2080 con 0x7efe240b2e40 2023-08-25T04:03:42.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.631+0000 7efe2a425640 1 --2- 172.21.15.55:0/1428823292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe240b2e40 0x7efe240b32d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009e50 tx=0x7efe1c01f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38bae6c38a1d7c80 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:42.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.631+0000 7efe28c22640 1 -- 172.21.15.55:0/1428823292 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c0af400 con 0x7efe240b2e40 2023-08-25T04:03:42.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.631+0000 7efe28c22640 1 -- 172.21.15.55:0/1428823292 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c0ab050 con 0x7efe240b2e40 2023-08-25T04:03:42.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.631+0000 7efe28c22640 1 -- 172.21.15.55:0/1428823292 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c0af780 con 0x7efe240b2e40 2023-08-25T04:03:42.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.631+0000 7efe2be88640 1 -- 172.21.15.55:0/1428823292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe240b2e40 msgr2=0x7efe240b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:42.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.631+0000 7efe2be88640 1 --2- 172.21.15.55:0/1428823292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe240b2e40 0x7efe240b32d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009e50 tx=0x7efe1c01f1f0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.631+0000 7efe2be88640 1 -- 172.21.15.55:0/1428823292 shutdown_connections 2023-08-25T04:03:42.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.631+0000 7efe2be88640 1 --2- 172.21.15.55:0/1428823292 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe240b2e40 0x7efe240b32d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.631+0000 7efe2be88640 1 --2- 172.21.15.55:0/1428823292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe240cdde0 0x7efe240ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.631+0000 7efe2be88640 1 -- 172.21.15.55:0/1428823292 >> 172.21.15.55:0/1428823292 conn(0x7efe2409bae0 msgr2=0x7efe240d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:42.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.631+0000 7efe2be88640 1 -- 172.21.15.55:0/1428823292 shutdown_connections 2023-08-25T04:03:42.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.631+0000 7efe2be88640 1 -- 172.21.15.55:0/1428823292 wait complete. 2023-08-25T04:03:42.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2be88640 1 Processor -- start 2023-08-25T04:03:42.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2be88640 1 -- start start 2023-08-25T04:03:42.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2be88640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe240b2e40 0x7efe2414f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:42.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2be88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe240cdde0 0x7efe241f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:42.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2be88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe240d0da0 0x7efe240c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:42.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2be88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe241f67a0 con 0x7efe240d0da0 2023-08-25T04:03:42.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2be88640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe240c8580 con 0x7efe240b2e40 2023-08-25T04:03:42.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2be88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe240b7c80 con 0x7efe240cdde0 2023-08-25T04:03:42.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2a425640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe240d0da0 0x7efe240c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:42.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe29c24640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe240b2e40 0x7efe2414f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:42.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2a425640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe240d0da0 0x7efe240c5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48270/0 (socket says 172.21.15.55:48270) 2023-08-25T04:03:42.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2a425640 1 -- 172.21.15.55:0/3072403740 learned_addr learned my addr 172.21.15.55:0/3072403740 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:42.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe29423640 1 --2- 172.21.15.55:0/3072403740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe240cdde0 0x7efe241f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:42.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2a425640 1 -- 172.21.15.55:0/3072403740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe240cdde0 msgr2=0x7efe241f6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:42.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2a425640 1 --2- 172.21.15.55:0/3072403740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe240cdde0 0x7efe241f6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2a425640 1 -- 172.21.15.55:0/3072403740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe240b2e40 msgr2=0x7efe2414f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:42.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2a425640 1 --2- 172.21.15.55:0/3072403740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe240b2e40 0x7efe2414f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2a425640 1 -- 172.21.15.55:0/3072403740 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1c009b30 con 0x7efe240d0da0 2023-08-25T04:03:42.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2a425640 1 --2- 172.21.15.55:0/3072403740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe240d0da0 0x7efe240c5a30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efe1c01ce20 tx=0x7efe1c01bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:42.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe1a7fc640 1 -- 172.21.15.55:0/3072403740 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c0afde0 con 0x7efe240d0da0 2023-08-25T04:03:42.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe1a7fc640 1 -- 172.21.15.55:0/3072403740 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c009510 con 0x7efe240d0da0 2023-08-25T04:03:42.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe1a7fc640 1 -- 172.21.15.55:0/3072403740 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c0b8640 con 0x7efe240d0da0 2023-08-25T04:03:42.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2be88640 1 -- 172.21.15.55:0/3072403740 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe240b7f60 con 0x7efe240d0da0 2023-08-25T04:03:42.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.635+0000 7efe2be88640 1 -- 172.21.15.55:0/3072403740 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2414be70 con 0x7efe240d0da0 2023-08-25T04:03:42.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.639+0000 7efe2be88640 1 -- 172.21.15.55:0/3072403740 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe240b8710 con 0x7efe240d0da0 2023-08-25T04:03:42.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.639+0000 7efe1a7fc640 1 -- 172.21.15.55:0/3072403740 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7efe1c0b6040 con 0x7efe240d0da0 2023-08-25T04:03:42.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.639+0000 7efe1a7fc640 1 --2- 172.21.15.55:0/3072403740 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7efe08065680 0x7efe08067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:42.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.639+0000 7efe1a7fc640 1 -- 172.21.15.55:0/3072403740 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7efe1c120db0 con 0x7efe240d0da0 2023-08-25T04:03:42.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.639+0000 7efe29c24640 1 --2- 172.21.15.55:0/3072403740 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7efe08065680 0x7efe08067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:42.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.639+0000 7efe29c24640 1 --2- 172.21.15.55:0/3072403740 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7efe08065680 0x7efe08067b40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efe240cc630 tx=0x7efe20009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:42.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.643+0000 7efe1a7fc640 1 -- 172.21.15.55:0/3072403740 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7efe1c125070 con 0x7efe240d0da0 2023-08-25T04:03:42.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.815+0000 7efe2be88640 1 -- 172.21.15.55:0/3072403740 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efe2414c060 con 0x7efe240d0da0 2023-08-25T04:03:42.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.815+0000 7efe1a7fc640 1 -- 172.21.15.55:0/3072403740 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7efe1c0b4020 con 0x7efe240d0da0 2023-08-25T04:03:42.815 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2023-08-25T04:03:42.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.815+0000 7efe2be88640 1 -- 172.21.15.55:0/3072403740 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7efe08065680 msgr2=0x7efe08067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:42.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.815+0000 7efe2be88640 1 --2- 172.21.15.55:0/3072403740 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7efe08065680 0x7efe08067b40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efe240cc630 tx=0x7efe20009040 comp rx=0 tx=0).stop 2023-08-25T04:03:42.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.815+0000 7efe2be88640 1 -- 172.21.15.55:0/3072403740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe240d0da0 msgr2=0x7efe240c5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:42.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.815+0000 7efe2be88640 1 --2- 172.21.15.55:0/3072403740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe240d0da0 0x7efe240c5a30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efe1c01ce20 tx=0x7efe1c01bf90 comp rx=0 tx=0).stop 2023-08-25T04:03:42.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.815+0000 7efe2be88640 1 -- 172.21.15.55:0/3072403740 shutdown_connections 2023-08-25T04:03:42.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.815+0000 7efe2be88640 1 --2- 172.21.15.55:0/3072403740 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7efe08065680 0x7efe08067b40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.815+0000 7efe2be88640 1 --2- 172.21.15.55:0/3072403740 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe240d0da0 0x7efe240c5a30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.815+0000 7efe2be88640 1 --2- 172.21.15.55:0/3072403740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe240cdde0 0x7efe241f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.815+0000 7efe2be88640 1 --2- 172.21.15.55:0/3072403740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe240b2e40 0x7efe2414f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:42.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.815+0000 7efe2be88640 1 -- 172.21.15.55:0/3072403740 >> 172.21.15.55:0/3072403740 conn(0x7efe2409bae0 msgr2=0x7efe2406b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:42.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.815+0000 7efe2be88640 1 -- 172.21.15.55:0/3072403740 shutdown_connections 2023-08-25T04:03:42.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:42.815+0000 7efe2be88640 1 -- 172.21.15.55:0/3072403740 wait complete. 2023-08-25T04:03:42.836 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-08-25T04:03:42.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:42.837 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-08-25T04:03:42.896 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2023-08-25T04:03:42.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:03:42.897 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-25T04:03:42.908 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-25T04:03:42.909 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:03:43.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.051+0000 7f6c6f008640 1 Processor -- start 2023-08-25T04:03:43.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.051+0000 7f6c6f008640 1 -- start start 2023-08-25T04:03:43.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.051+0000 7f6c6f008640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c680ceeb0 0x7f6c680cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.051+0000 7f6c6f008640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6c680c89f0 0x7f6c680b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.051+0000 7f6c6f008640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c680cc880 con 0x7f6c680ad950 2023-08-25T04:03:43.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.051+0000 7f6c6f008640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c680b11f0 con 0x7f6c680c89f0 2023-08-25T04:03:43.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.051+0000 7f6c6f008640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c68159d50 con 0x7f6c680ceeb0 2023-08-25T04:03:43.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.051+0000 7f6c6cda4640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6c680ad950 0x7f6c680ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49306/0 (socket says 172.21.15.55:49306) 2023-08-25T04:03:43.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.051+0000 7f6c6cda4640 1 -- 172.21.15.55:0/990907811 learned_addr learned my addr 172.21.15.55:0/990907811 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:43.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.051+0000 7f6c6d5a5640 1 --2- 172.21.15.55:0/990907811 >> v2:172.21.15.55:3300/0 conn(0x7f6c680c89f0 0x7f6c680b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.055+0000 7f6c5ffff640 1 --2- 172.21.15.55:0/990907811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c680ceeb0 0x7f6c680cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.055+0000 7f6c5f7fe640 1 -- 172.21.15.55:0/990907811 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3929196713 0 0) 0x7f6c680cc880 con 0x7f6c680ad950 2023-08-25T04:03:43.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.055+0000 7f6c6d5a5640 1 -- 172.21.15.55:0/990907811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c680ceeb0 msgr2=0x7f6c680cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:43.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.055+0000 7f6c6d5a5640 1 --2- 172.21.15.55:0/990907811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c680ceeb0 0x7f6c680cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.055+0000 7f6c6d5a5640 1 -- 172.21.15.55:0/990907811 >> v1:172.21.15.55:6789/0 conn(0x7f6c680ad950 legacy=0x7f6c680ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:43.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.055+0000 7f6c6d5a5640 1 -- 172.21.15.55:0/990907811 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c680ccb60 con 0x7f6c680c89f0 2023-08-25T04:03:43.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.055+0000 7f6c6d5a5640 1 --2- 172.21.15.55:0/990907811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c680c89f0 0x7f6c680b1640 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009d90 tx=0x7f6c6001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57740675a7009b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:43.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.055+0000 7f6c5f7fe640 1 -- 172.21.15.55:0/990907811 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c600a5860 con 0x7f6c680c89f0 2023-08-25T04:03:43.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.055+0000 7f6c5f7fe640 1 -- 172.21.15.55:0/990907811 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c600a59c0 con 0x7f6c680c89f0 2023-08-25T04:03:43.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.055+0000 7f6c5f7fe640 1 -- 172.21.15.55:0/990907811 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c600a5d50 con 0x7f6c680c89f0 2023-08-25T04:03:43.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.055+0000 7f6c6f008640 1 -- 172.21.15.55:0/990907811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c680c89f0 msgr2=0x7f6c680b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:43.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.055+0000 7f6c6f008640 1 --2- 172.21.15.55:0/990907811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c680c89f0 0x7f6c680b1640 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009d90 tx=0x7f6c6001c890 comp rx=0 tx=0).stop 2023-08-25T04:03:43.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c6f008640 1 -- 172.21.15.55:0/990907811 shutdown_connections 2023-08-25T04:03:43.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c6f008640 1 --2- 172.21.15.55:0/990907811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c680ceeb0 0x7f6c680cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c6f008640 1 --2- 172.21.15.55:0/990907811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c680c89f0 0x7f6c680b1640 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c6f008640 1 -- 172.21.15.55:0/990907811 >> 172.21.15.55:0/990907811 conn(0x7f6c68069d00 msgr2=0x7f6c6806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:43.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c6f008640 1 -- 172.21.15.55:0/990907811 shutdown_connections 2023-08-25T04:03:43.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c6f008640 1 -- 172.21.15.55:0/990907811 wait complete. 2023-08-25T04:03:43.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c6f008640 1 Processor -- start 2023-08-25T04:03:43.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c6f008640 1 -- start start 2023-08-25T04:03:43.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c6f008640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c680ad950 0x7f6c68097260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c6f008640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c680c89f0 0x7f6c680c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c6f008640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c680ceeb0 0x7f6c68070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c6f008640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c680c45e0 con 0x7f6c680c89f0 2023-08-25T04:03:43.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c6f008640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c680b0b20 con 0x7f6c680ad950 2023-08-25T04:03:43.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c6f008640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c680c3f90 con 0x7f6c680ceeb0 2023-08-25T04:03:43.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c5ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c680c89f0 0x7f6c680c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c5ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c680c89f0 0x7f6c680c4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48284/0 (socket says 172.21.15.55:48284) 2023-08-25T04:03:43.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c5ffff640 1 -- 172.21.15.55:0/2663259547 learned_addr learned my addr 172.21.15.55:0/2663259547 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:43.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c6d5a5640 1 --2- 172.21.15.55:0/2663259547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c680ceeb0 0x7f6c68070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c6cda4640 1 --2- 172.21.15.55:0/2663259547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c680ad950 0x7f6c68097260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c5ffff640 1 -- 172.21.15.55:0/2663259547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c680ceeb0 msgr2=0x7f6c68070150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:43.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c5ffff640 1 --2- 172.21.15.55:0/2663259547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c680ceeb0 0x7f6c68070150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c5ffff640 1 -- 172.21.15.55:0/2663259547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c680ad950 msgr2=0x7f6c68097260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:43.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c5ffff640 1 --2- 172.21.15.55:0/2663259547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c680ad950 0x7f6c68097260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.059+0000 7f6c5ffff640 1 -- 172.21.15.55:0/2663259547 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c60009a70 con 0x7f6c680c89f0 2023-08-25T04:03:43.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.063+0000 7f6c5ffff640 1 --2- 172.21.15.55:0/2663259547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c680c89f0 0x7f6c680c4a70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800d800 tx=0x7f6c5800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:43.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.063+0000 7f6c5d7fa640 1 -- 172.21.15.55:0/2663259547 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5800b6c0 con 0x7f6c680c89f0 2023-08-25T04:03:43.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.063+0000 7f6c5d7fa640 1 -- 172.21.15.55:0/2663259547 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5800b820 con 0x7f6c680c89f0 2023-08-25T04:03:43.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.063+0000 7f6c5d7fa640 1 -- 172.21.15.55:0/2663259547 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5800bb90 con 0x7f6c680c89f0 2023-08-25T04:03:43.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.063+0000 7f6c6f008640 1 -- 172.21.15.55:0/2663259547 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c680c4270 con 0x7f6c680c89f0 2023-08-25T04:03:43.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.063+0000 7f6c6f008640 1 -- 172.21.15.55:0/2663259547 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c680c3c40 con 0x7f6c680c89f0 2023-08-25T04:03:43.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.063+0000 7f6c6f008640 1 -- 172.21.15.55:0/2663259547 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c680c4790 con 0x7f6c680c89f0 2023-08-25T04:03:43.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.063+0000 7f6c5d7fa640 1 -- 172.21.15.55:0/2663259547 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6c5800bcf0 con 0x7f6c680c89f0 2023-08-25T04:03:43.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.063+0000 7f6c5d7fa640 1 --2- 172.21.15.55:0/2663259547 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6c54065680 0x7f6c54067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.063+0000 7f6c5d7fa640 1 -- 172.21.15.55:0/2663259547 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6c58083440 con 0x7f6c680c89f0 2023-08-25T04:03:43.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.063+0000 7f6c6cda4640 1 --2- 172.21.15.55:0/2663259547 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6c54065680 0x7f6c54067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.067+0000 7f6c6cda4640 1 --2- 172.21.15.55:0/2663259547 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6c54065680 0x7f6c54067b40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6c64000f70 tx=0x7f6c64007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:43.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.067+0000 7f6c5d7fa640 1 -- 172.21.15.55:0/2663259547 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6c680c4790 con 0x7f6c680c89f0 2023-08-25T04:03:43.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.255+0000 7f6c6f008640 1 -- 172.21.15.55:0/2663259547 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c6804dbe0 con 0x7f6c680c89f0 2023-08-25T04:03:43.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.255+0000 7f6c5d7fa640 1 -- 172.21.15.55:0/2663259547 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4875 (secure 0 0 0) 0x7f6c580548b0 con 0x7f6c680c89f0 2023-08-25T04:03:43.258 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:43.259 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3370778281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3370778281},{"type":"v1","addr":"172.21.15.55:6835","nonce":3370778281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/2321139789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2321139789},{"type":"v1","addr":"172.21.15.110:6837","nonce":2321139789}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3825401605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3825401605},{"type":"v1","addr":"172.21.15.110:6836","nonce":3825401605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:03:01.098486+0000","modified":"2023-08-25T04:03:04.724648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/2606103809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2606103809},{"type":"v1","addr":"172.21.15.55:6834","nonce":2606103809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:03:43.259 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2023-08-25T04:03:43.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.259+0000 7f6c6f008640 1 -- 172.21.15.55:0/2663259547 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6c54065680 msgr2=0x7f6c54067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:43.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.259+0000 7f6c6f008640 1 --2- 172.21.15.55:0/2663259547 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6c54065680 0x7f6c54067b40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6c64000f70 tx=0x7f6c64007c10 comp rx=0 tx=0).stop 2023-08-25T04:03:43.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.259+0000 7f6c6f008640 1 -- 172.21.15.55:0/2663259547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c680c89f0 msgr2=0x7f6c680c4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:43.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.259+0000 7f6c6f008640 1 --2- 172.21.15.55:0/2663259547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c680c89f0 0x7f6c680c4a70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800d800 tx=0x7f6c5800dcc0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.259+0000 7f6c6f008640 1 -- 172.21.15.55:0/2663259547 shutdown_connections 2023-08-25T04:03:43.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.259+0000 7f6c6f008640 1 --2- 172.21.15.55:0/2663259547 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6c54065680 0x7f6c54067b40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.259+0000 7f6c6f008640 1 --2- 172.21.15.55:0/2663259547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c680ceeb0 0x7f6c68070150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.259+0000 7f6c6f008640 1 --2- 172.21.15.55:0/2663259547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c680c89f0 0x7f6c680c4a70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.259+0000 7f6c6f008640 1 --2- 172.21.15.55:0/2663259547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c680ad950 0x7f6c68097260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.259+0000 7f6c6f008640 1 -- 172.21.15.55:0/2663259547 >> 172.21.15.55:0/2663259547 conn(0x7f6c68069d00 msgr2=0x7f6c68154de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:43.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.259+0000 7f6c6f008640 1 -- 172.21.15.55:0/2663259547 shutdown_connections 2023-08-25T04:03:43.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.259+0000 7f6c6f008640 1 -- 172.21.15.55:0/2663259547 wait complete. 2023-08-25T04:03:43.279 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:43.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.419+0000 7f7ac689c640 1 Processor -- start 2023-08-25T04:03:43.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.419+0000 7f7ac689c640 1 -- start start 2023-08-25T04:03:43.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7ac689c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ac015c9c0 0x7f7ac0160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7ac689c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ac00cfa70 0x7f7ac0160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7ac689c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac006eaf0 con 0x7f7ac0160f90 2023-08-25T04:03:43.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7ac689c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac006e530 con 0x7f7ac00cfa70 2023-08-25T04:03:43.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7ac689c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac006e810 con 0x7f7ac015c9c0 2023-08-25T04:03:43.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7ac4e39640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7ac0160f90 0x7f7ac00ce910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49320/0 (socket says 172.21.15.55:49320) 2023-08-25T04:03:43.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7ac4e39640 1 -- 172.21.15.55:0/1330727892 learned_addr learned my addr 172.21.15.55:0/1330727892 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:43.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abf7fe640 1 --2- 172.21.15.55:0/1330727892 >> v2:172.21.15.110:3300/0 conn(0x7f7ac00cfa70 0x7f7ac0160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abffff640 1 --2- 172.21.15.55:0/1330727892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ac015c9c0 0x7f7ac0160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abeffd640 1 -- 172.21.15.55:0/1330727892 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367410319 0 0) 0x7f7ac006eaf0 con 0x7f7ac0160f90 2023-08-25T04:03:43.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abeffd640 1 -- 172.21.15.55:0/1330727892 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7aa8003530 con 0x7f7ac0160f90 2023-08-25T04:03:43.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abeffd640 1 -- 172.21.15.55:0/1330727892 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2801146596 0 0) 0x7f7aa8003530 con 0x7f7ac0160f90 2023-08-25T04:03:43.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abeffd640 1 -- 172.21.15.55:0/1330727892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ac015c9c0 msgr2=0x7f7ac0160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:43.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abeffd640 1 --2- 172.21.15.55:0/1330727892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ac015c9c0 0x7f7ac0160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abeffd640 1 -- 172.21.15.55:0/1330727892 >> v2:172.21.15.110:3300/0 conn(0x7f7ac00cfa70 msgr2=0x7f7ac0160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:43.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abeffd640 1 --2- 172.21.15.55:0/1330727892 >> v2:172.21.15.110:3300/0 conn(0x7f7ac00cfa70 0x7f7ac0160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abeffd640 1 -- 172.21.15.55:0/1330727892 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac006aab0 con 0x7f7ac0160f90 2023-08-25T04:03:43.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abeffd640 1 -- 172.21.15.55:0/1330727892 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f7ab8001a00 con 0x7f7ac0160f90 2023-08-25T04:03:43.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abf7fe640 1 --2- 172.21.15.55:0/1330727892 >> v2:172.21.15.110:3300/0 conn(0x7f7ac00cfa70 0x7f7ac0160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:43.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abeffd640 1 -- 172.21.15.55:0/1330727892 >> v1:172.21.15.55:6789/0 conn(0x7f7ac0160f90 legacy=0x7f7ac00ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:43.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abeffd640 1 --2- 172.21.15.55:0/1330727892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7aa8003980 0x7f7aa8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abeffd640 1 --2- 172.21.15.55:0/1330727892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ac015c9c0 0x7f7aa80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abeffd640 1 --2- 172.21.15.55:0/1330727892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7aa8004d10 0x7f7aa8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abeffd640 1 -- 172.21.15.55:0/1330727892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac006e530 con 0x7f7aa8004d10 2023-08-25T04:03:43.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abeffd640 1 -- 172.21.15.55:0/1330727892 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac006e810 con 0x7f7aa8003980 2023-08-25T04:03:43.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abeffd640 1 -- 172.21.15.55:0/1330727892 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa800b990 con 0x7f7ac015c9c0 2023-08-25T04:03:43.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7ac4e39640 1 --2- 172.21.15.55:0/1330727892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7aa8004d10 0x7f7aa8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abffff640 1 --2- 172.21.15.55:0/1330727892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7aa8003980 0x7f7aa8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abf7fe640 1 --2- 172.21.15.55:0/1330727892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ac015c9c0 0x7f7aa80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7ac4e39640 1 -- 172.21.15.55:0/1330727892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ac015c9c0 msgr2=0x7f7aa80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:43.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7ac4e39640 1 --2- 172.21.15.55:0/1330727892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ac015c9c0 0x7f7aa80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7ac4e39640 1 -- 172.21.15.55:0/1330727892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7aa8003980 msgr2=0x7f7aa8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:43.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7ac4e39640 1 --2- 172.21.15.55:0/1330727892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7aa8003980 0x7f7aa8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7ac4e39640 1 -- 172.21.15.55:0/1330727892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa8003530 con 0x7f7aa8004d10 2023-08-25T04:03:43.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.423+0000 7f7abffff640 1 --2- 172.21.15.55:0/1330727892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7aa8003980 0x7f7aa8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:43.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.427+0000 7f7ac4e39640 1 --2- 172.21.15.55:0/1330727892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7aa8004d10 0x7f7aa8005190 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800a860 tx=0x7f7ab801d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420e51e8ec0ef10f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:43.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.427+0000 7f7abeffd640 1 -- 172.21.15.55:0/1330727892 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab80ad630 con 0x7f7aa8004d10 2023-08-25T04:03:43.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.427+0000 7f7abeffd640 1 -- 172.21.15.55:0/1330727892 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab80a8070 con 0x7f7aa8004d10 2023-08-25T04:03:43.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.427+0000 7f7abeffd640 1 -- 172.21.15.55:0/1330727892 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab80ad9f0 con 0x7f7aa8004d10 2023-08-25T04:03:43.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.427+0000 7f7ac689c640 1 -- 172.21.15.55:0/1330727892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7aa8004d10 msgr2=0x7f7aa8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:43.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.427+0000 7f7ac689c640 1 --2- 172.21.15.55:0/1330727892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7aa8004d10 0x7f7aa8005190 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800a860 tx=0x7f7ab801d360 comp rx=0 tx=0).stop 2023-08-25T04:03:43.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.427+0000 7f7ac4e39640 1 -- 172.21.15.55:0/1330727892 reap_dead start 2023-08-25T04:03:43.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.427+0000 7f7ac689c640 1 -- 172.21.15.55:0/1330727892 shutdown_connections 2023-08-25T04:03:43.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.427+0000 7f7ac689c640 1 -- 172.21.15.55:0/1330727892 >> 172.21.15.55:0/1330727892 conn(0x7f7ac00d05a0 msgr2=0x7f7ac00d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:43.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.427+0000 7f7ac689c640 1 -- 172.21.15.55:0/1330727892 shutdown_connections 2023-08-25T04:03:43.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.427+0000 7f7ac689c640 1 -- 172.21.15.55:0/1330727892 wait complete. 2023-08-25T04:03:43.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.427+0000 7f7ac689c640 1 Processor -- start 2023-08-25T04:03:43.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.427+0000 7f7ac689c640 1 -- start start 2023-08-25T04:03:43.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7ac689c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7aa8004d10 0x7f7ac0151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7ac689c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ac0156820 0x7f7ac0154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7ac689c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ac0155200 0x7f7ac015e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7ac689c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac0157830 con 0x7f7aa8004d10 2023-08-25T04:03:43.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7ac689c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac0157270 con 0x7f7ac0155200 2023-08-25T04:03:43.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7ac689c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac0157550 con 0x7f7ac0156820 2023-08-25T04:03:43.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7abffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7aa8004d10 0x7f7ac0151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7abffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7aa8004d10 0x7f7ac0151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48290/0 (socket says 172.21.15.55:48290) 2023-08-25T04:03:43.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7abffff640 1 -- 172.21.15.55:0/2838461034 learned_addr learned my addr 172.21.15.55:0/2838461034 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:43.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7abffff640 1 -- 172.21.15.55:0/2838461034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ac0156820 msgr2=0x7f7ac0154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:43.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7abffff640 1 --2- 172.21.15.55:0/2838461034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ac0156820 0x7f7ac0154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7ac4e39640 1 --2- 172.21.15.55:0/2838461034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ac0155200 0x7f7ac015e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7abffff640 1 -- 172.21.15.55:0/2838461034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ac0155200 msgr2=0x7f7ac015e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:43.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7abffff640 1 --2- 172.21.15.55:0/2838461034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ac0155200 0x7f7ac015e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7abffff640 1 -- 172.21.15.55:0/2838461034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac015e110 con 0x7f7aa8004d10 2023-08-25T04:03:43.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7ac4e39640 1 --2- 172.21.15.55:0/2838461034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ac0155200 0x7f7ac015e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:43.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7abffff640 1 --2- 172.21.15.55:0/2838461034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7aa8004d10 0x7f7ac0151110 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0009160 tx=0x7f7ab0011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:43.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7abcff9640 1 -- 172.21.15.55:0/2838461034 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0005db0 con 0x7f7aa8004d10 2023-08-25T04:03:43.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7abcff9640 1 -- 172.21.15.55:0/2838461034 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab0004020 con 0x7f7aa8004d10 2023-08-25T04:03:43.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7abcff9640 1 -- 172.21.15.55:0/2838461034 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00043d0 con 0x7f7aa8004d10 2023-08-25T04:03:43.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7ac689c640 1 -- 172.21.15.55:0/2838461034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac015e3f0 con 0x7f7aa8004d10 2023-08-25T04:03:43.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7ac689c640 1 -- 172.21.15.55:0/2838461034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac0156ca0 con 0x7f7aa8004d10 2023-08-25T04:03:43.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7ac689c640 1 -- 172.21.15.55:0/2838461034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac015df70 con 0x7f7aa8004d10 2023-08-25T04:03:43.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.431+0000 7f7abcff9640 1 -- 172.21.15.55:0/2838461034 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7ab0003620 con 0x7f7aa8004d10 2023-08-25T04:03:43.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.435+0000 7f7abcff9640 1 --2- 172.21.15.55:0/2838461034 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7aac065680 0x7f7aac067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.435+0000 7f7abcff9640 1 -- 172.21.15.55:0/2838461034 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7ab00830d0 con 0x7f7aa8004d10 2023-08-25T04:03:43.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.435+0000 7f7abf7fe640 1 --2- 172.21.15.55:0/2838461034 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7aac065680 0x7f7aac067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.435+0000 7f7abf7fe640 1 --2- 172.21.15.55:0/2838461034 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7aac065680 0x7f7aac067b40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00af3e0 tx=0x7f7ab4011690 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:43.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.439+0000 7f7abcff9640 1 -- 172.21.15.55:0/2838461034 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7ac015df70 con 0x7f7aa8004d10 2023-08-25T04:03:43.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.599+0000 7f7ac689c640 1 -- 172.21.15.55:0/2838461034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ac015df70 con 0x7f7aa8004d10 2023-08-25T04:03:43.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.599+0000 7f7abcff9640 1 -- 172.21.15.55:0/2838461034 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18387 (secure 0 0 0) 0x7f7ac015df70 con 0x7f7aa8004d10 2023-08-25T04:03:43.602 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:43.603 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":26,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:42.589744+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2b","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:43.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.603+0000 7f7ac689c640 1 -- 172.21.15.55:0/2838461034 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7aac065680 msgr2=0x7f7aac067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:43.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.603+0000 7f7ac689c640 1 --2- 172.21.15.55:0/2838461034 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7aac065680 0x7f7aac067b40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00af3e0 tx=0x7f7ab4011690 comp rx=0 tx=0).stop 2023-08-25T04:03:43.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.603+0000 7f7ac689c640 1 -- 172.21.15.55:0/2838461034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7aa8004d10 msgr2=0x7f7ac0151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:43.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.603+0000 7f7ac689c640 1 --2- 172.21.15.55:0/2838461034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7aa8004d10 0x7f7ac0151110 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0009160 tx=0x7f7ab0011a10 comp rx=0 tx=0).stop 2023-08-25T04:03:43.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.603+0000 7f7ac689c640 1 -- 172.21.15.55:0/2838461034 shutdown_connections 2023-08-25T04:03:43.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.603+0000 7f7ac689c640 1 --2- 172.21.15.55:0/2838461034 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7aac065680 0x7f7aac067b40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.603+0000 7f7ac689c640 1 --2- 172.21.15.55:0/2838461034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ac0155200 0x7f7ac015e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.603+0000 7f7ac689c640 1 --2- 172.21.15.55:0/2838461034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ac0156820 0x7f7ac0154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.603+0000 7f7ac689c640 1 --2- 172.21.15.55:0/2838461034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7aa8004d10 0x7f7ac0151110 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.603+0000 7f7ac689c640 1 -- 172.21.15.55:0/2838461034 >> 172.21.15.55:0/2838461034 conn(0x7f7ac00d05a0 msgr2=0x7f7ac015ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:43.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.603+0000 7f7ac689c640 1 -- 172.21.15.55:0/2838461034 shutdown_connections 2023-08-25T04:03:43.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.603+0000 7f7ac689c640 1 -- 172.21.15.55:0/2838461034 wait complete. 2023-08-25T04:03:43.625 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:02:58.890533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:03:00.093976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:03:43.626 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:03:43.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.771+0000 7fbfdbd00640 1 Processor -- start 2023-08-25T04:03:43.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.771+0000 7fbfdbd00640 1 -- start start 2023-08-25T04:03:43.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.771+0000 7fbfdbd00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfd41601f0 0x7fbfd415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.771+0000 7fbfdbd00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfd40d1290 0x7fbfd415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.771+0000 7fbfdbd00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd40cd5a0 con 0x7fbfd415e3c0 2023-08-25T04:03:43.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.771+0000 7fbfdbd00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd40cd880 con 0x7fbfd41601f0 2023-08-25T04:03:43.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.771+0000 7fbfdbd00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40cdb60 con 0x7fbfd40d1290 2023-08-25T04:03:43.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.771+0000 7fbfd9a9c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfd41601f0 0x7fbfd415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.771+0000 7fbfd9a9c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfd41601f0 0x7fbfd415d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48300/0 (socket says 172.21.15.55:48300) 2023-08-25T04:03:43.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.771+0000 7fbfd9a9c640 1 -- 172.21.15.55:0/2092020291 learned_addr learned my addr 172.21.15.55:0/2092020291 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:43.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.771+0000 7fbfda29d640 1 --2- 172.21.15.55:0/2092020291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfd40d1290 0x7fbfd415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.771+0000 7fbfd9a9c640 1 -- 172.21.15.55:0/2092020291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfd40d1290 msgr2=0x7fbfd415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:43.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.771+0000 7fbfd9a9c640 1 --2- 172.21.15.55:0/2092020291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfd40d1290 0x7fbfd415e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.771+0000 7fbfd9a9c640 1 -- 172.21.15.55:0/2092020291 >> v1:172.21.15.110:6789/0 conn(0x7fbfd415e3c0 legacy=0x7fbfd40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:43.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.771+0000 7fbfd9a9c640 1 -- 172.21.15.55:0/2092020291 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd40cde40 con 0x7fbfd41601f0 2023-08-25T04:03:43.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.775+0000 7fbfd9a9c640 1 --2- 172.21.15.55:0/2092020291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd41601f0 0x7fbfd415d430 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0006fd0 tx=0x7fbfd001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c4a39ee8935cac server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:43.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.775+0000 7fbfd8a9a640 1 -- 172.21.15.55:0/2092020291 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd00a8a10 con 0x7fbfd41601f0 2023-08-25T04:03:43.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.775+0000 7fbfd8a9a640 1 -- 172.21.15.55:0/2092020291 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd00a8b70 con 0x7fbfd41601f0 2023-08-25T04:03:43.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.775+0000 7fbfd8a9a640 1 -- 172.21.15.55:0/2092020291 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd00b0440 con 0x7fbfd41601f0 2023-08-25T04:03:43.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.775+0000 7fbfdbd00640 1 -- 172.21.15.55:0/2092020291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd41601f0 msgr2=0x7fbfd415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:43.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.775+0000 7fbfdbd00640 1 --2- 172.21.15.55:0/2092020291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd41601f0 0x7fbfd415d430 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbfd0006fd0 tx=0x7fbfd001ed10 comp rx=0 tx=0).stop 2023-08-25T04:03:43.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.775+0000 7fbfdbd00640 1 -- 172.21.15.55:0/2092020291 shutdown_connections 2023-08-25T04:03:43.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.775+0000 7fbfdbd00640 1 --2- 172.21.15.55:0/2092020291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfd40d1290 0x7fbfd415e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.775+0000 7fbfdbd00640 1 --2- 172.21.15.55:0/2092020291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd41601f0 0x7fbfd415d430 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.775+0000 7fbfdbd00640 1 -- 172.21.15.55:0/2092020291 >> 172.21.15.55:0/2092020291 conn(0x7fbfd40d27d0 msgr2=0x7fbfd40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:43.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.775+0000 7fbfdbd00640 1 -- 172.21.15.55:0/2092020291 shutdown_connections 2023-08-25T04:03:43.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.775+0000 7fbfdbd00640 1 -- 172.21.15.55:0/2092020291 wait complete. 2023-08-25T04:03:43.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfdbd00640 1 Processor -- start 2023-08-25T04:03:43.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfdbd00640 1 -- start start 2023-08-25T04:03:43.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfdbd00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfd40d1290 0x7fbfd415d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfdbd00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd415e3c0 0x7fbfd40b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfdbd00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfd41601f0 0x7fbfd40c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfdbd00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40b0490 con 0x7fbfd415e3c0 2023-08-25T04:03:43.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfdbd00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd415d660 con 0x7fbfd40d1290 2023-08-25T04:03:43.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfdbd00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40af810 con 0x7fbfd41601f0 2023-08-25T04:03:43.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfd929b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd415e3c0 0x7fbfd40b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfd929b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd415e3c0 0x7fbfd40b08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48304/0 (socket says 172.21.15.55:48304) 2023-08-25T04:03:43.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfd929b640 1 -- 172.21.15.55:0/1472148016 learned_addr learned my addr 172.21.15.55:0/1472148016 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:43.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfd9a9c640 1 --2- 172.21.15.55:0/1472148016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfd40d1290 0x7fbfd415d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfda29d640 1 --2- 172.21.15.55:0/1472148016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfd41601f0 0x7fbfd40c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfd929b640 1 -- 172.21.15.55:0/1472148016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfd41601f0 msgr2=0x7fbfd40c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:43.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfd929b640 1 --2- 172.21.15.55:0/1472148016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfd41601f0 0x7fbfd40c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfd929b640 1 -- 172.21.15.55:0/1472148016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfd40d1290 msgr2=0x7fbfd415d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:43.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfd929b640 1 --2- 172.21.15.55:0/1472148016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfd40d1290 0x7fbfd415d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfd929b640 1 -- 172.21.15.55:0/1472148016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd0009480 con 0x7fbfd415e3c0 2023-08-25T04:03:43.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfd929b640 1 --2- 172.21.15.55:0/1472148016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd415e3c0 0x7fbfd40b08b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400c500 tx=0x7fbfc400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:43.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfca7fc640 1 -- 172.21.15.55:0/1472148016 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4005220 con 0x7fbfd415e3c0 2023-08-25T04:03:43.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfca7fc640 1 -- 172.21.15.55:0/1472148016 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc4005380 con 0x7fbfd415e3c0 2023-08-25T04:03:43.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfca7fc640 1 -- 172.21.15.55:0/1472148016 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4007270 con 0x7fbfd415e3c0 2023-08-25T04:03:43.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfdbd00640 1 -- 172.21.15.55:0/1472148016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd40afaf0 con 0x7fbfd415e3c0 2023-08-25T04:03:43.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.779+0000 7fbfdbd00640 1 -- 172.21.15.55:0/1472148016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd40b00b0 con 0x7fbfd415e3c0 2023-08-25T04:03:43.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.783+0000 7fbfdbd00640 1 -- 172.21.15.55:0/1472148016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd40b5260 con 0x7fbfd415e3c0 2023-08-25T04:03:43.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.783+0000 7fbfca7fc640 1 -- 172.21.15.55:0/1472148016 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fbfc40073d0 con 0x7fbfd415e3c0 2023-08-25T04:03:43.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.783+0000 7fbfca7fc640 1 --2- 172.21.15.55:0/1472148016 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbfb8065680 0x7fbfb8067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:43.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.783+0000 7fbfca7fc640 1 -- 172.21.15.55:0/1472148016 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbfc40826b0 con 0x7fbfd415e3c0 2023-08-25T04:03:43.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.783+0000 7fbfd9a9c640 1 --2- 172.21.15.55:0/1472148016 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbfb8065680 0x7fbfb8067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:43.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.783+0000 7fbfd9a9c640 1 --2- 172.21.15.55:0/1472148016 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbfb8065680 0x7fbfb8067b40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00b2000 tx=0x7fbfd0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:43.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.787+0000 7fbfca7fc640 1 -- 172.21.15.55:0/1472148016 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbfc4050150 con 0x7fbfd415e3c0 2023-08-25T04:03:43.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.943+0000 7fbfdbd00640 1 -- 172.21.15.55:0/1472148016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbfd40b05d0 con 0x7fbfd415e3c0 2023-08-25T04:03:43.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.943+0000 7fbfca7fc640 1 -- 172.21.15.55:0/1472148016 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbfd40b05d0 con 0x7fbfd415e3c0 2023-08-25T04:03:43.945 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:03:43.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.943+0000 7fbfdbd00640 1 -- 172.21.15.55:0/1472148016 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbfb8065680 msgr2=0x7fbfb8067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:43.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.943+0000 7fbfdbd00640 1 --2- 172.21.15.55:0/1472148016 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbfb8065680 0x7fbfb8067b40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbfd00b2000 tx=0x7fbfd0009040 comp rx=0 tx=0).stop 2023-08-25T04:03:43.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.943+0000 7fbfdbd00640 1 -- 172.21.15.55:0/1472148016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd415e3c0 msgr2=0x7fbfd40b08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:43.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.943+0000 7fbfdbd00640 1 --2- 172.21.15.55:0/1472148016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd415e3c0 0x7fbfd40b08b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400c500 tx=0x7fbfc400c9c0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.947+0000 7fbfdbd00640 1 -- 172.21.15.55:0/1472148016 shutdown_connections 2023-08-25T04:03:43.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.947+0000 7fbfdbd00640 1 --2- 172.21.15.55:0/1472148016 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbfb8065680 0x7fbfb8067b40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.947+0000 7fbfdbd00640 1 --2- 172.21.15.55:0/1472148016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfd41601f0 0x7fbfd40c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.947+0000 7fbfdbd00640 1 --2- 172.21.15.55:0/1472148016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfd415e3c0 0x7fbfd40b08b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.947+0000 7fbfdbd00640 1 --2- 172.21.15.55:0/1472148016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfd40d1290 0x7fbfd415d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:43.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.947+0000 7fbfdbd00640 1 -- 172.21.15.55:0/1472148016 >> 172.21.15.55:0/1472148016 conn(0x7fbfd40d27d0 msgr2=0x7fbfd40d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:43.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.947+0000 7fbfdbd00640 1 -- 172.21.15.55:0/1472148016 shutdown_connections 2023-08-25T04:03:43.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:43.947+0000 7fbfdbd00640 1 -- 172.21.15.55:0/1472148016 wait complete. 2023-08-25T04:03:43.966 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:03:44.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.111+0000 7f4268b96640 1 Processor -- start 2023-08-25T04:03:44.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.111+0000 7f4268b96640 1 -- start start 2023-08-25T04:03:44.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.111+0000 7f4268b96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f426406ce30 0x7f42640cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:44.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.111+0000 7f4268b96640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42640c9d90 con 0x7f42640c9900 2023-08-25T04:03:44.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.111+0000 7f4268b96640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42640cbca0 con 0x7f42640cb020 2023-08-25T04:03:44.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.111+0000 7f4268b96640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42640c9470 con 0x7f426406ce30 2023-08-25T04:03:44.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.111+0000 7f4262d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f426406ce30 0x7f42640cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:44.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.111+0000 7f4259d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f42640c9900 0x7f426406c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49326/0 (socket says 172.21.15.55:49326) 2023-08-25T04:03:44.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.111+0000 7f4259d9b640 1 -- 172.21.15.55:0/3285751098 learned_addr learned my addr 172.21.15.55:0/3285751098 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:44.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.111+0000 7f4262d9d640 1 -- 172.21.15.55:0/3285751098 >> v1:172.21.15.110:6789/0 conn(0x7f42640cb020 legacy=0x7f42640cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.111+0000 7f4262d9d640 1 -- 172.21.15.55:0/3285751098 >> v1:172.21.15.55:6789/0 conn(0x7f42640c9900 legacy=0x7f426406c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.111+0000 7f4262d9d640 1 -- 172.21.15.55:0/3285751098 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42640c8b40 con 0x7f426406ce30 2023-08-25T04:03:44.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.111+0000 7f4261d9b640 1 -- 172.21.15.55:0/3285751098 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637998293 0 0) 0x7f42640c9d90 con 0x7f42640c9900 2023-08-25T04:03:44.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.115+0000 7f4262d9d640 1 --2- 172.21.15.55:0/3285751098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f426406ce30 0x7f42640cdd50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f425c009d90 tx=0x7f425c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94afed3801409e3f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:44.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.115+0000 7f4261d9b640 1 -- 172.21.15.55:0/3285751098 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c0a5780 con 0x7f426406ce30 2023-08-25T04:03:44.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.115+0000 7f4261d9b640 1 -- 172.21.15.55:0/3285751098 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c0a58e0 con 0x7f426406ce30 2023-08-25T04:03:44.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.115+0000 7f4261d9b640 1 -- 172.21.15.55:0/3285751098 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c0a5c70 con 0x7f426406ce30 2023-08-25T04:03:44.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.115+0000 7f4268b96640 1 -- 172.21.15.55:0/3285751098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f426406ce30 msgr2=0x7f42640cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.115+0000 7f4268b96640 1 --2- 172.21.15.55:0/3285751098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f426406ce30 0x7f42640cdd50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f425c009d90 tx=0x7f425c01c8c0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.115+0000 7f4268b96640 1 -- 172.21.15.55:0/3285751098 shutdown_connections 2023-08-25T04:03:44.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.115+0000 7f4268b96640 1 --2- 172.21.15.55:0/3285751098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f426406ce30 0x7f42640cdd50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.115+0000 7f4268b96640 1 -- 172.21.15.55:0/3285751098 >> 172.21.15.55:0/3285751098 conn(0x7f4264069900 msgr2=0x7f4264069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:44.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.115+0000 7f4268b96640 1 -- 172.21.15.55:0/3285751098 shutdown_connections 2023-08-25T04:03:44.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.115+0000 7f4268b96640 1 -- 172.21.15.55:0/3285751098 wait complete. 2023-08-25T04:03:44.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4268b96640 1 Processor -- start 2023-08-25T04:03:44.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4268b96640 1 -- start start 2023-08-25T04:03:44.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4268b96640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f426406ce30 0x7f42640c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:44.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4268b96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42640c9900 0x7f4264155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:44.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4268b96640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42640cb020 0x7f42641583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:44.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4268b96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640c2e10 con 0x7f42640c9900 2023-08-25T04:03:44.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4268b96640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640b2690 con 0x7f426406ce30 2023-08-25T04:03:44.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4268b96640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42641f8b20 con 0x7f42640cb020 2023-08-25T04:03:44.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4259d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42640c9900 0x7f4264155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:44.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4259d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42640c9900 0x7f4264155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48312/0 (socket says 172.21.15.55:48312) 2023-08-25T04:03:44.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4259d9b640 1 -- 172.21.15.55:0/3666098156 learned_addr learned my addr 172.21.15.55:0/3666098156 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:44.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4262d9d640 1 --2- 172.21.15.55:0/3666098156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42640cb020 0x7f42641583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:44.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f426259c640 1 --2- 172.21.15.55:0/3666098156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f426406ce30 0x7f42640c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:44.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4259d9b640 1 -- 172.21.15.55:0/3666098156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42640cb020 msgr2=0x7f42641583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4259d9b640 1 --2- 172.21.15.55:0/3666098156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42640cb020 0x7f42641583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4259d9b640 1 -- 172.21.15.55:0/3666098156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f426406ce30 msgr2=0x7f42640c28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4259d9b640 1 --2- 172.21.15.55:0/3666098156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f426406ce30 0x7f42640c28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4259d9b640 1 -- 172.21.15.55:0/3666098156 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425c009a70 con 0x7f42640c9900 2023-08-25T04:03:44.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4259d9b640 1 --2- 172.21.15.55:0/3666098156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42640c9900 0x7f4264155a40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f424c00c410 tx=0x7f424c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:44.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f425b7fe640 1 -- 172.21.15.55:0/3666098156 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c0074e0 con 0x7f42640c9900 2023-08-25T04:03:44.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f425b7fe640 1 -- 172.21.15.55:0/3666098156 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c007640 con 0x7f42640c9900 2023-08-25T04:03:44.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4268b96640 1 -- 172.21.15.55:0/3666098156 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42641f8e00 con 0x7f42640c9900 2023-08-25T04:03:44.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f425b7fe640 1 -- 172.21.15.55:0/3666098156 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c004a30 con 0x7f42640c9900 2023-08-25T04:03:44.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.119+0000 7f4268b96640 1 -- 172.21.15.55:0/3666098156 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42641f93c0 con 0x7f42640c9900 2023-08-25T04:03:44.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.123+0000 7f4268b96640 1 -- 172.21.15.55:0/3666098156 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42641f95e0 con 0x7f42640c9900 2023-08-25T04:03:44.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.123+0000 7f425b7fe640 1 -- 172.21.15.55:0/3666098156 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f424c004b90 con 0x7f42640c9900 2023-08-25T04:03:44.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.123+0000 7f425b7fe640 1 --2- 172.21.15.55:0/3666098156 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f4244065680 0x7f4244067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:44.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.123+0000 7f425b7fe640 1 -- 172.21.15.55:0/3666098156 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f424c082ca0 con 0x7f42640c9900 2023-08-25T04:03:44.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.123+0000 7f426259c640 1 --2- 172.21.15.55:0/3666098156 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f4244065680 0x7f4244067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:44.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.123+0000 7f426259c640 1 --2- 172.21.15.55:0/3666098156 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f4244065680 0x7f4244067b40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f42640c1930 tx=0x7f4254009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:44.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.127+0000 7f425b7fe640 1 -- 172.21.15.55:0/3666098156 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f424c050710 con 0x7f42640c9900 2023-08-25T04:03:44.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.283+0000 7f4268b96640 1 -- 172.21.15.55:0/3666098156 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4264073ec0 con 0x7f42640c9900 2023-08-25T04:03:44.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.283+0000 7f425b7fe640 1 -- 172.21.15.55:0/3666098156 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f424c053d30 con 0x7f42640c9900 2023-08-25T04:03:44.286 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:03:44.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.287+0000 7f4268b96640 1 -- 172.21.15.55:0/3666098156 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f4244065680 msgr2=0x7f4244067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.287+0000 7f4268b96640 1 --2- 172.21.15.55:0/3666098156 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f4244065680 0x7f4244067b40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f42640c1930 tx=0x7f4254009040 comp rx=0 tx=0).stop 2023-08-25T04:03:44.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.287+0000 7f4268b96640 1 -- 172.21.15.55:0/3666098156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42640c9900 msgr2=0x7f4264155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.287+0000 7f4268b96640 1 --2- 172.21.15.55:0/3666098156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42640c9900 0x7f4264155a40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f424c00c410 tx=0x7f424c00c8d0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.287+0000 7f4268b96640 1 -- 172.21.15.55:0/3666098156 shutdown_connections 2023-08-25T04:03:44.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.287+0000 7f4268b96640 1 --2- 172.21.15.55:0/3666098156 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f4244065680 0x7f4244067b40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.287+0000 7f4268b96640 1 --2- 172.21.15.55:0/3666098156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42640cb020 0x7f42641583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.287+0000 7f4268b96640 1 --2- 172.21.15.55:0/3666098156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42640c9900 0x7f4264155a40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.287+0000 7f4268b96640 1 --2- 172.21.15.55:0/3666098156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f426406ce30 0x7f42640c28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.287+0000 7f4268b96640 1 -- 172.21.15.55:0/3666098156 >> 172.21.15.55:0/3666098156 conn(0x7f4264069900 msgr2=0x7f4264072c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:44.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.287+0000 7f4268b96640 1 -- 172.21.15.55:0/3666098156 shutdown_connections 2023-08-25T04:03:44.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.287+0000 7f4268b96640 1 -- 172.21.15.55:0/3666098156 wait complete. 2023-08-25T04:03:44.306 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:03:44.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.451+0000 7f2bda5a3640 1 Processor -- start 2023-08-25T04:03:44.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.451+0000 7f2bda5a3640 1 -- start start 2023-08-25T04:03:44.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.451+0000 7f2bda5a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2bd415a7f0 0x7f2bd409bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:44.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.451+0000 7f2bda5a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bd406c020 0x7f2bd40acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:44.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.451+0000 7f2bda5a3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd415abd0 con 0x7f2bd40c9830 2023-08-25T04:03:44.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.451+0000 7f2bda5a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd40c8ab0 con 0x7f2bd415a7f0 2023-08-25T04:03:44.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.451+0000 7f2bda5a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd40c8d50 con 0x7f2bd406c020 2023-08-25T04:03:44.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.451+0000 7f2bd3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2bd415a7f0 0x7f2bd409bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:44.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.451+0000 7f2bd3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2bd415a7f0 0x7f2bd409bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48320/0 (socket says 172.21.15.55:48320) 2023-08-25T04:03:44.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.451+0000 7f2bd3fff640 1 -- 172.21.15.55:0/1193055514 learned_addr learned my addr 172.21.15.55:0/1193055514 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:44.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.451+0000 7f2bd8b40640 1 --2- 172.21.15.55:0/1193055514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bd406c020 0x7f2bd40acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:44.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.451+0000 7f2bd3fff640 1 -- 172.21.15.55:0/1193055514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bd406c020 msgr2=0x7f2bd40acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:44.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.451+0000 7f2bd3fff640 1 --2- 172.21.15.55:0/1193055514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bd406c020 0x7f2bd40acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.451+0000 7f2bd3fff640 1 -- 172.21.15.55:0/1193055514 >> v1:172.21.15.55:6789/0 conn(0x7f2bd40c9830 legacy=0x7f2bd4070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.451+0000 7f2bd3fff640 1 -- 172.21.15.55:0/1193055514 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd40c9030 con 0x7f2bd415a7f0 2023-08-25T04:03:44.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.455+0000 7f2bd3fff640 1 --2- 172.21.15.55:0/1193055514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd415a7f0 0x7f2bd409bde0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4006fd0 tx=0x7f2bc401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8e16d84ac52e24 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:44.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.455+0000 7f2bd2ffd640 1 -- 172.21.15.55:0/1193055514 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc40ab600 con 0x7f2bd415a7f0 2023-08-25T04:03:44.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.455+0000 7f2bd2ffd640 1 -- 172.21.15.55:0/1193055514 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc40ab760 con 0x7f2bd415a7f0 2023-08-25T04:03:44.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.455+0000 7f2bd2ffd640 1 -- 172.21.15.55:0/1193055514 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc40abaf0 con 0x7f2bd415a7f0 2023-08-25T04:03:44.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.455+0000 7f2bda5a3640 1 -- 172.21.15.55:0/1193055514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd415a7f0 msgr2=0x7f2bd409bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.455+0000 7f2bda5a3640 1 --2- 172.21.15.55:0/1193055514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd415a7f0 0x7f2bd409bde0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4006fd0 tx=0x7f2bc401c4f0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.455+0000 7f2bda5a3640 1 -- 172.21.15.55:0/1193055514 shutdown_connections 2023-08-25T04:03:44.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.455+0000 7f2bda5a3640 1 --2- 172.21.15.55:0/1193055514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bd406c020 0x7f2bd40acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.455+0000 7f2bda5a3640 1 --2- 172.21.15.55:0/1193055514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd415a7f0 0x7f2bd409bde0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.455+0000 7f2bda5a3640 1 -- 172.21.15.55:0/1193055514 >> 172.21.15.55:0/1193055514 conn(0x7f2bd4069900 msgr2=0x7f2bd4069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:44.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.455+0000 7f2bda5a3640 1 -- 172.21.15.55:0/1193055514 shutdown_connections 2023-08-25T04:03:44.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.455+0000 7f2bda5a3640 1 -- 172.21.15.55:0/1193055514 wait complete. 2023-08-25T04:03:44.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bda5a3640 1 Processor -- start 2023-08-25T04:03:44.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bda5a3640 1 -- start start 2023-08-25T04:03:44.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bda5a3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bd406c020 0x7f2bd4158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:44.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bda5a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bd40c9830 0x7f2bd40c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:44.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bda5a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd415a7f0 0x7f2bd4158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:44.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bda5a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd40c6860 con 0x7f2bd415a7f0 2023-08-25T04:03:44.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bda5a3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd409b0c0 con 0x7f2bd406c020 2023-08-25T04:03:44.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bda5a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd40c7800 con 0x7f2bd40c9830 2023-08-25T04:03:44.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bd8b40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd415a7f0 0x7f2bd4158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:44.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bd8b40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd415a7f0 0x7f2bd4158620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48324/0 (socket says 172.21.15.55:48324) 2023-08-25T04:03:44.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bd8b40640 1 -- 172.21.15.55:0/3261810868 learned_addr learned my addr 172.21.15.55:0/3261810868 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:44.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bd3fff640 1 --2- 172.21.15.55:0/3261810868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bd406c020 0x7f2bd4158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:44.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bd37fe640 1 --2- 172.21.15.55:0/3261810868 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bd40c9830 0x7f2bd40c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:44.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bd8b40640 1 -- 172.21.15.55:0/3261810868 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bd40c9830 msgr2=0x7f2bd40c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bd8b40640 1 --2- 172.21.15.55:0/3261810868 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bd40c9830 0x7f2bd40c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bd8b40640 1 -- 172.21.15.55:0/3261810868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bd406c020 msgr2=0x7f2bd4158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bd8b40640 1 --2- 172.21.15.55:0/3261810868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bd406c020 0x7f2bd4158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bd8b40640 1 -- 172.21.15.55:0/3261810868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc4009480 con 0x7f2bd415a7f0 2023-08-25T04:03:44.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bd8b40640 1 --2- 172.21.15.55:0/3261810868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd415a7f0 0x7f2bd4158620 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc007e60 tx=0x7f2bcc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:44.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bd0ff9640 1 -- 172.21.15.55:0/3261810868 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc014620 con 0x7f2bd415a7f0 2023-08-25T04:03:44.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bd0ff9640 1 -- 172.21.15.55:0/3261810868 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc0147a0 con 0x7f2bd415a7f0 2023-08-25T04:03:44.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bd0ff9640 1 -- 172.21.15.55:0/3261810868 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc014b50 con 0x7f2bd415a7f0 2023-08-25T04:03:44.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bda5a3640 1 -- 172.21.15.55:0/3261810868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd409ab00 con 0x7f2bd415a7f0 2023-08-25T04:03:44.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.459+0000 7f2bda5a3640 1 -- 172.21.15.55:0/3261810868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd4165bd0 con 0x7f2bd415a7f0 2023-08-25T04:03:44.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.463+0000 7f2bda5a3640 1 -- 172.21.15.55:0/3261810868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd406d5b0 con 0x7f2bd415a7f0 2023-08-25T04:03:44.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.463+0000 7f2bd0ff9640 1 -- 172.21.15.55:0/3261810868 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2bcc014cb0 con 0x7f2bd415a7f0 2023-08-25T04:03:44.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.463+0000 7f2bd0ff9640 1 --2- 172.21.15.55:0/3261810868 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2bc0065680 0x7f2bc0067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:44.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.463+0000 7f2bd0ff9640 1 -- 172.21.15.55:0/3261810868 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2bcc083670 con 0x7f2bd415a7f0 2023-08-25T04:03:44.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.463+0000 7f2bd3fff640 1 --2- 172.21.15.55:0/3261810868 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2bc0065680 0x7f2bc0067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:44.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.463+0000 7f2bd3fff640 1 --2- 172.21.15.55:0/3261810868 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2bc0065680 0x7f2bc0067b40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40af000 tx=0x7f2bc40a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:44.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.467+0000 7f2bd0ff9640 1 -- 172.21.15.55:0/3261810868 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2bcc051190 con 0x7f2bd415a7f0 2023-08-25T04:03:44.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.623+0000 7f2bda5a3640 1 -- 172.21.15.55:0/3261810868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2bd40c75d0 con 0x7f2bd415a7f0 2023-08-25T04:03:44.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.623+0000 7f2bd0ff9640 1 -- 172.21.15.55:0/3261810868 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2bd40c75d0 con 0x7f2bd415a7f0 2023-08-25T04:03:44.624 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:03:44.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.623+0000 7f2bda5a3640 1 -- 172.21.15.55:0/3261810868 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2bc0065680 msgr2=0x7f2bc0067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.623+0000 7f2bda5a3640 1 --2- 172.21.15.55:0/3261810868 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2bc0065680 0x7f2bc0067b40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40af000 tx=0x7f2bc40a7000 comp rx=0 tx=0).stop 2023-08-25T04:03:44.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.623+0000 7f2bda5a3640 1 -- 172.21.15.55:0/3261810868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd415a7f0 msgr2=0x7f2bd4158620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.623+0000 7f2bda5a3640 1 --2- 172.21.15.55:0/3261810868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd415a7f0 0x7f2bd4158620 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc007e60 tx=0x7f2bcc00e4b0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.623+0000 7f2bda5a3640 1 -- 172.21.15.55:0/3261810868 shutdown_connections 2023-08-25T04:03:44.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.623+0000 7f2bda5a3640 1 --2- 172.21.15.55:0/3261810868 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f2bc0065680 0x7f2bc0067b40 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.623+0000 7f2bda5a3640 1 --2- 172.21.15.55:0/3261810868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd415a7f0 0x7f2bd4158620 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.623+0000 7f2bda5a3640 1 --2- 172.21.15.55:0/3261810868 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bd40c9830 0x7f2bd40c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.623+0000 7f2bda5a3640 1 --2- 172.21.15.55:0/3261810868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bd406c020 0x7f2bd4158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.623+0000 7f2bda5a3640 1 -- 172.21.15.55:0/3261810868 >> 172.21.15.55:0/3261810868 conn(0x7f2bd4069900 msgr2=0x7f2bd41596f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:44.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.623+0000 7f2bda5a3640 1 -- 172.21.15.55:0/3261810868 shutdown_connections 2023-08-25T04:03:44.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.623+0000 7f2bda5a3640 1 -- 172.21.15.55:0/3261810868 wait complete. 2023-08-25T04:03:44.645 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:03:44.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.791+0000 7f813ce4f640 1 Processor -- start 2023-08-25T04:03:44.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.791+0000 7f813ce4f640 1 -- start start 2023-08-25T04:03:44.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.791+0000 7f813ce4f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81380c9900 0x7f81380cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:44.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.791+0000 7f813ce4f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f813806c720 0x7f813806cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:44.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.791+0000 7f813ce4f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81380c9d90 con 0x7f81380cb020 2023-08-25T04:03:44.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.791+0000 7f813ce4f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81380cbca0 con 0x7f81380c9900 2023-08-25T04:03:44.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.791+0000 7f813ce4f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81380c9470 con 0x7f813806c720 2023-08-25T04:03:44.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.791+0000 7f8135d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81380c9900 0x7f81380cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:44.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.791+0000 7f8135d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81380c9900 0x7f81380cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48328/0 (socket says 172.21.15.55:48328) 2023-08-25T04:03:44.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.791+0000 7f8135d9b640 1 -- 172.21.15.55:0/510325802 learned_addr learned my addr 172.21.15.55:0/510325802 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:44.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.791+0000 7f8135d9b640 1 -- 172.21.15.55:0/510325802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f813806c720 msgr2=0x7f813806cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:44.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.791+0000 7f8136d9d640 1 --2- 172.21.15.55:0/510325802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f813806c720 0x7f813806cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:44.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.791+0000 7f8135d9b640 1 --2- 172.21.15.55:0/510325802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f813806c720 0x7f813806cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.791+0000 7f8135d9b640 1 -- 172.21.15.55:0/510325802 >> v1:172.21.15.55:6789/0 conn(0x7f81380cb020 legacy=0x7f81380cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.791+0000 7f8135d9b640 1 -- 172.21.15.55:0/510325802 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813806d070 con 0x7f81380c9900 2023-08-25T04:03:44.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.791+0000 7f813559a640 1 -- 172.21.15.55:0/510325802 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940140057 0 0) 0x7f81380c9d90 con 0x7f81380cb020 2023-08-25T04:03:44.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.791+0000 7f8136d9d640 1 --2- 172.21.15.55:0/510325802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f813806c720 0x7f813806cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:44.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.795+0000 7f8135d9b640 1 --2- 172.21.15.55:0/510325802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81380c9900 0x7f81380cdd50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f812c009870 tx=0x7f812c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc37e70d2367d2b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:44.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.795+0000 7f813559a640 1 -- 172.21.15.55:0/510325802 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c0ab600 con 0x7f81380c9900 2023-08-25T04:03:44.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.795+0000 7f813559a640 1 -- 172.21.15.55:0/510325802 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c0a7050 con 0x7f81380c9900 2023-08-25T04:03:44.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.795+0000 7f813559a640 1 -- 172.21.15.55:0/510325802 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c0ab980 con 0x7f81380c9900 2023-08-25T04:03:44.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.795+0000 7f813ce4f640 1 -- 172.21.15.55:0/510325802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81380c9900 msgr2=0x7f81380cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.795+0000 7f813ce4f640 1 --2- 172.21.15.55:0/510325802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81380c9900 0x7f81380cdd50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f812c009870 tx=0x7f812c01c4b0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.795+0000 7f813ce4f640 1 -- 172.21.15.55:0/510325802 shutdown_connections 2023-08-25T04:03:44.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.795+0000 7f813ce4f640 1 --2- 172.21.15.55:0/510325802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f813806c720 0x7f813806cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.795+0000 7f813ce4f640 1 --2- 172.21.15.55:0/510325802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81380c9900 0x7f81380cdd50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.795+0000 7f813ce4f640 1 -- 172.21.15.55:0/510325802 >> 172.21.15.55:0/510325802 conn(0x7f8138069900 msgr2=0x7f8138069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:44.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.795+0000 7f813ce4f640 1 -- 172.21.15.55:0/510325802 shutdown_connections 2023-08-25T04:03:44.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.795+0000 7f813ce4f640 1 -- 172.21.15.55:0/510325802 wait complete. 2023-08-25T04:03:44.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813ce4f640 1 Processor -- start 2023-08-25T04:03:44.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813ce4f640 1 -- start start 2023-08-25T04:03:44.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813ce4f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f813806c720 0x7f81381f8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:44.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813ce4f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81380c9900 0x7f81381f9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:44.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813ce4f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81380cb020 0x7f81380ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:44.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813ce4f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81381f4ef0 con 0x7f813806c720 2023-08-25T04:03:44.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813ce4f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81380b0da0 con 0x7f81380c9900 2023-08-25T04:03:44.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813ce4f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81381f5ea0 con 0x7f81380cb020 2023-08-25T04:03:44.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f813806c720 0x7f81381f8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:44.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f813806c720 0x7f81381f8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48340/0 (socket says 172.21.15.55:48340) 2023-08-25T04:03:44.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813659c640 1 -- 172.21.15.55:0/3148585174 learned_addr learned my addr 172.21.15.55:0/3148585174 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:44.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f8135d9b640 1 --2- 172.21.15.55:0/3148585174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81380c9900 0x7f81381f9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:44.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f8136d9d640 1 --2- 172.21.15.55:0/3148585174 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81380cb020 0x7f81380ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:44.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813659c640 1 -- 172.21.15.55:0/3148585174 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81380cb020 msgr2=0x7f81380ab9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813659c640 1 --2- 172.21.15.55:0/3148585174 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81380cb020 0x7f81380ab9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813659c640 1 -- 172.21.15.55:0/3148585174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81380c9900 msgr2=0x7f81381f9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813659c640 1 --2- 172.21.15.55:0/3148585174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81380c9900 0x7f81381f9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813659c640 1 -- 172.21.15.55:0/3148585174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c0094d0 con 0x7f813806c720 2023-08-25T04:03:44.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f8136d9d640 1 --2- 172.21.15.55:0/3148585174 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81380cb020 0x7f81380ab9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:44.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813659c640 1 --2- 172.21.15.55:0/3148585174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f813806c720 0x7f81381f8ac0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f812800c410 tx=0x7f812800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:44.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f8126ffd640 1 -- 172.21.15.55:0/3148585174 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81280054e0 con 0x7f813806c720 2023-08-25T04:03:44.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f8126ffd640 1 -- 172.21.15.55:0/3148585174 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8128003620 con 0x7f813806c720 2023-08-25T04:03:44.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f8126ffd640 1 -- 172.21.15.55:0/3148585174 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81280039d0 con 0x7f813806c720 2023-08-25T04:03:44.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813ce4f640 1 -- 172.21.15.55:0/3148585174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81380c1c00 con 0x7f813806c720 2023-08-25T04:03:44.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813ce4f640 1 -- 172.21.15.55:0/3148585174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81381f53c0 con 0x7f813806c720 2023-08-25T04:03:44.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.799+0000 7f813ce4f640 1 -- 172.21.15.55:0/3148585174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813806e300 con 0x7f813806c720 2023-08-25T04:03:44.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.803+0000 7f8126ffd640 1 -- 172.21.15.55:0/3148585174 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8128003b30 con 0x7f813806c720 2023-08-25T04:03:44.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.803+0000 7f8126ffd640 1 --2- 172.21.15.55:0/3148585174 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8118065680 0x7f8118067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:44.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.803+0000 7f8126ffd640 1 -- 172.21.15.55:0/3148585174 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f81280823b0 con 0x7f813806c720 2023-08-25T04:03:44.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.803+0000 7f8135d9b640 1 --2- 172.21.15.55:0/3148585174 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8118065680 0x7f8118067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:44.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.803+0000 7f8135d9b640 1 --2- 172.21.15.55:0/3148585174 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8118065680 0x7f8118067b40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f812c0ad000 tx=0x7f812c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:44.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.807+0000 7f8126ffd640 1 -- 172.21.15.55:0/3148585174 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f812804fed0 con 0x7f813806c720 2023-08-25T04:03:44.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.963+0000 7f813ce4f640 1 -- 172.21.15.55:0/3148585174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8138073ec0 con 0x7f813806c720 2023-08-25T04:03:44.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.963+0000 7f8126ffd640 1 -- 172.21.15.55:0/3148585174 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f81280534f0 con 0x7f813806c720 2023-08-25T04:03:44.964 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:03:44.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.963+0000 7f813ce4f640 1 -- 172.21.15.55:0/3148585174 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8118065680 msgr2=0x7f8118067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.963+0000 7f813ce4f640 1 --2- 172.21.15.55:0/3148585174 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8118065680 0x7f8118067b40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f812c0ad000 tx=0x7f812c008040 comp rx=0 tx=0).stop 2023-08-25T04:03:44.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.963+0000 7f813ce4f640 1 -- 172.21.15.55:0/3148585174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f813806c720 msgr2=0x7f81381f8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:44.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.963+0000 7f813ce4f640 1 --2- 172.21.15.55:0/3148585174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f813806c720 0x7f81381f8ac0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f812800c410 tx=0x7f812800c8d0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.963+0000 7f813ce4f640 1 -- 172.21.15.55:0/3148585174 shutdown_connections 2023-08-25T04:03:44.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.963+0000 7f813ce4f640 1 --2- 172.21.15.55:0/3148585174 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8118065680 0x7f8118067b40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.963+0000 7f813ce4f640 1 --2- 172.21.15.55:0/3148585174 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81380cb020 0x7f81380ab9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.963+0000 7f813ce4f640 1 --2- 172.21.15.55:0/3148585174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f81380c9900 0x7f81381f9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.963+0000 7f813ce4f640 1 --2- 172.21.15.55:0/3148585174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f813806c720 0x7f81381f8ac0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:44.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.963+0000 7f813ce4f640 1 -- 172.21.15.55:0/3148585174 >> 172.21.15.55:0/3148585174 conn(0x7f8138069900 msgr2=0x7f8138157c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:44.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.963+0000 7f813ce4f640 1 -- 172.21.15.55:0/3148585174 shutdown_connections 2023-08-25T04:03:44.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:44.963+0000 7f813ce4f640 1 -- 172.21.15.55:0/3148585174 wait complete. 2023-08-25T04:03:44.985 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:03:45.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f55290cb640 1 Processor -- start 2023-08-25T04:03:45.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f55290cb640 1 -- start start 2023-08-25T04:03:45.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f55290cb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55240d0da0 0x7f55240d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f55290cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55240b29b0 con 0x7f55240cdde0 2023-08-25T04:03:45.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f55290cb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55240cfc80 con 0x7f55240b3e50 2023-08-25T04:03:45.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f55290cb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55240d16c0 con 0x7f55240d0da0 2023-08-25T04:03:45.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f551bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f55240cdde0 0x7f55240cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49362/0 (socket says 172.21.15.55:49362) 2023-08-25T04:03:45.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f551bfff640 1 -- 172.21.15.55:0/183216513 learned_addr learned my addr 172.21.15.55:0/183216513 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:45.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f5522d9d640 1 --2- 172.21.15.55:0/183216513 >> v2:172.21.15.110:3300/0 conn(0x7f55240d0da0 0x7f55240d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f552259c640 1 -- 172.21.15.55:0/183216513 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461921968 0 0) 0x7f55240b29b0 con 0x7f55240cdde0 2023-08-25T04:03:45.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f552259c640 1 -- 172.21.15.55:0/183216513 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5510003530 con 0x7f55240cdde0 2023-08-25T04:03:45.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f552259c640 1 -- 172.21.15.55:0/183216513 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3926016595 0 0) 0x7f5510003530 con 0x7f55240cdde0 2023-08-25T04:03:45.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f552259c640 1 -- 172.21.15.55:0/183216513 >> v2:172.21.15.110:3300/0 conn(0x7f55240d0da0 msgr2=0x7f55240d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:45.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f552259c640 1 --2- 172.21.15.55:0/183216513 >> v2:172.21.15.110:3300/0 conn(0x7f55240d0da0 0x7f55240d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f552259c640 1 -- 172.21.15.55:0/183216513 >> v1:172.21.15.110:6789/0 conn(0x7f55240b3e50 legacy=0x7f55240cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:45.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f552259c640 1 -- 172.21.15.55:0/183216513 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55240b1dc0 con 0x7f55240cdde0 2023-08-25T04:03:45.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f552259c640 1 -- 172.21.15.55:0/183216513 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f550c001680 con 0x7f55240cdde0 2023-08-25T04:03:45.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f552259c640 1 -- 172.21.15.55:0/183216513 >> v1:172.21.15.55:6789/0 conn(0x7f55240cdde0 legacy=0x7f55240cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:45.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f552259c640 1 --2- 172.21.15.55:0/183216513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5510003980 0x7f5510003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f552259c640 1 --2- 172.21.15.55:0/183216513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55100047d0 0x7f5510004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f552259c640 1 --2- 172.21.15.55:0/183216513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5510005190 0x7f551000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f552259c640 1 -- 172.21.15.55:0/183216513 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55240d16c0 con 0x7f55100047d0 2023-08-25T04:03:45.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f552259c640 1 -- 172.21.15.55:0/183216513 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551000c040 con 0x7f5510003980 2023-08-25T04:03:45.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f552259c640 1 -- 172.21.15.55:0/183216513 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551000c200 con 0x7f5510005190 2023-08-25T04:03:45.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f551bfff640 1 --2- 172.21.15.55:0/183216513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55100047d0 0x7f5510004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.127+0000 7f5522d9d640 1 --2- 172.21.15.55:0/183216513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5510003980 0x7f5510003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.131+0000 7f552359e640 1 --2- 172.21.15.55:0/183216513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5510005190 0x7f551000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.131+0000 7f551bfff640 1 -- 172.21.15.55:0/183216513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5510005190 msgr2=0x7f551000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:45.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.131+0000 7f551bfff640 1 --2- 172.21.15.55:0/183216513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5510005190 0x7f551000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.131+0000 7f551bfff640 1 -- 172.21.15.55:0/183216513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5510003980 msgr2=0x7f5510003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:45.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.131+0000 7f551bfff640 1 --2- 172.21.15.55:0/183216513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5510003980 0x7f5510003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.131+0000 7f551bfff640 1 -- 172.21.15.55:0/183216513 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5510003530 con 0x7f55100047d0 2023-08-25T04:03:45.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.131+0000 7f552359e640 1 -- 172.21.15.55:0/183216513 reap_dead start 2023-08-25T04:03:45.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.131+0000 7f551bfff640 1 --2- 172.21.15.55:0/183216513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55100047d0 0x7f5510004c50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f550c00c240 tx=0x7f550c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67408525dd00bd0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:45.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.131+0000 7f552259c640 1 -- 172.21.15.55:0/183216513 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c0a5b40 con 0x7f55100047d0 2023-08-25T04:03:45.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.131+0000 7f552259c640 1 -- 172.21.15.55:0/183216513 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c0a5ca0 con 0x7f55100047d0 2023-08-25T04:03:45.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.131+0000 7f552259c640 1 -- 172.21.15.55:0/183216513 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c005b20 con 0x7f55100047d0 2023-08-25T04:03:45.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.131+0000 7f55290cb640 1 -- 172.21.15.55:0/183216513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55100047d0 msgr2=0x7f5510004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:45.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.131+0000 7f55290cb640 1 --2- 172.21.15.55:0/183216513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55100047d0 0x7f5510004c50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f550c00c240 tx=0x7f550c01cc40 comp rx=0 tx=0).stop 2023-08-25T04:03:45.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.131+0000 7f55290cb640 1 -- 172.21.15.55:0/183216513 shutdown_connections 2023-08-25T04:03:45.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.131+0000 7f55290cb640 1 --2- 172.21.15.55:0/183216513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55100047d0 0x7f5510004c50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.131+0000 7f55290cb640 1 -- 172.21.15.55:0/183216513 >> 172.21.15.55:0/183216513 conn(0x7f552409bae0 msgr2=0x7f55240d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:45.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f55290cb640 1 -- 172.21.15.55:0/183216513 shutdown_connections 2023-08-25T04:03:45.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f55290cb640 1 -- 172.21.15.55:0/183216513 wait complete. 2023-08-25T04:03:45.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f55290cb640 1 Processor -- start 2023-08-25T04:03:45.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f55290cb640 1 -- start start 2023-08-25T04:03:45.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f55290cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55100047d0 0x7f5524158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f55290cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55240cbfc0 0x7f552414abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f55290cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f552406b530 0x7f552406b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f55290cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55240cc710 con 0x7f552406b530 2023-08-25T04:03:45.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f55290cb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552406bf00 con 0x7f55100047d0 2023-08-25T04:03:45.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f55290cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55241f61d0 con 0x7f55240cbfc0 2023-08-25T04:03:45.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f552359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f552406b530 0x7f552406b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f552359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f552406b530 0x7f552406b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48354/0 (socket says 172.21.15.55:48354) 2023-08-25T04:03:45.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f552359e640 1 -- 172.21.15.55:0/3202320736 learned_addr learned my addr 172.21.15.55:0/3202320736 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:45.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f5522d9d640 1 --2- 172.21.15.55:0/3202320736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55100047d0 0x7f5524158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f551bfff640 1 --2- 172.21.15.55:0/3202320736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55240cbfc0 0x7f552414abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f552359e640 1 -- 172.21.15.55:0/3202320736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55240cbfc0 msgr2=0x7f552414abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:45.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f552359e640 1 --2- 172.21.15.55:0/3202320736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55240cbfc0 0x7f552414abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f552359e640 1 -- 172.21.15.55:0/3202320736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55100047d0 msgr2=0x7f5524158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f552359e640 1 --2- 172.21.15.55:0/3202320736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55100047d0 0x7f5524158090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f552359e640 1 -- 172.21.15.55:0/3202320736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5524157e90 con 0x7f552406b530 2023-08-25T04:03:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f5522d9d640 1 --2- 172.21.15.55:0/3202320736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55100047d0 0x7f5524158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f552359e640 1 --2- 172.21.15.55:0/3202320736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f552406b530 0x7f552406b9c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f552408c9f0 tx=0x7f551c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.135+0000 7f551b7fe640 1 -- 172.21.15.55:0/3202320736 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c003980 con 0x7f552406b530 2023-08-25T04:03:45.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.139+0000 7f551b7fe640 1 -- 172.21.15.55:0/3202320736 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c003b00 con 0x7f552406b530 2023-08-25T04:03:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.139+0000 7f55290cb640 1 -- 172.21.15.55:0/3202320736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552414b0f0 con 0x7f552406b530 2023-08-25T04:03:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.139+0000 7f551b7fe640 1 -- 172.21.15.55:0/3202320736 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0050d0 con 0x7f552406b530 2023-08-25T04:03:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.139+0000 7f55290cb640 1 -- 172.21.15.55:0/3202320736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55241f5410 con 0x7f552406b530 2023-08-25T04:03:45.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.139+0000 7f55290cb640 1 -- 172.21.15.55:0/3202320736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552404dbe0 con 0x7f552406b530 2023-08-25T04:03:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.139+0000 7f551b7fe640 1 -- 172.21.15.55:0/3202320736 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f551c005230 con 0x7f552406b530 2023-08-25T04:03:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.139+0000 7f551b7fe640 1 --2- 172.21.15.55:0/3202320736 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5504065680 0x7f5504067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.139+0000 7f551b7fe640 1 -- 172.21.15.55:0/3202320736 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f551c082c70 con 0x7f552406b530 2023-08-25T04:03:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.139+0000 7f5522d9d640 1 --2- 172.21.15.55:0/3202320736 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5504065680 0x7f5504067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.143+0000 7f5522d9d640 1 --2- 172.21.15.55:0/3202320736 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5504065680 0x7f5504067b40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f552406c150 tx=0x7f5514008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:45.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.143+0000 7f551b7fe640 1 -- 172.21.15.55:0/3202320736 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f551c050650 con 0x7f552406b530 2023-08-25T04:03:45.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.331+0000 7f55290cb640 1 -- 172.21.15.55:0/3202320736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55240d0b80 con 0x7f552406b530 2023-08-25T04:03:45.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.335+0000 7f551b7fe640 1 -- 172.21.15.55:0/3202320736 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4875 (secure 0 0 0) 0x7f551c053c70 con 0x7f552406b530 2023-08-25T04:03:45.336 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:45.336 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3370778281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3370778281},{"type":"v1","addr":"172.21.15.55:6835","nonce":3370778281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/2321139789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2321139789},{"type":"v1","addr":"172.21.15.110:6837","nonce":2321139789}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3825401605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3825401605},{"type":"v1","addr":"172.21.15.110:6836","nonce":3825401605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:03:01.098486+0000","modified":"2023-08-25T04:03:04.724648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/2606103809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2606103809},{"type":"v1","addr":"172.21.15.55:6834","nonce":2606103809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:03:45.338 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2023-08-25T04:03:45.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.335+0000 7f55290cb640 1 -- 172.21.15.55:0/3202320736 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5504065680 msgr2=0x7f5504067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:45.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.335+0000 7f55290cb640 1 --2- 172.21.15.55:0/3202320736 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5504065680 0x7f5504067b40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f552406c150 tx=0x7f5514008040 comp rx=0 tx=0).stop 2023-08-25T04:03:45.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.335+0000 7f55290cb640 1 -- 172.21.15.55:0/3202320736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f552406b530 msgr2=0x7f552406b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:45.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.335+0000 7f55290cb640 1 --2- 172.21.15.55:0/3202320736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f552406b530 0x7f552406b9c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f552408c9f0 tx=0x7f551c00ec10 comp rx=0 tx=0).stop 2023-08-25T04:03:45.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.335+0000 7f55290cb640 1 -- 172.21.15.55:0/3202320736 shutdown_connections 2023-08-25T04:03:45.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.335+0000 7f55290cb640 1 --2- 172.21.15.55:0/3202320736 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f5504065680 0x7f5504067b40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.335+0000 7f55290cb640 1 --2- 172.21.15.55:0/3202320736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f552406b530 0x7f552406b9c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.335+0000 7f55290cb640 1 --2- 172.21.15.55:0/3202320736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55240cbfc0 0x7f552414abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.335+0000 7f55290cb640 1 --2- 172.21.15.55:0/3202320736 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55100047d0 0x7f5524158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.335+0000 7f55290cb640 1 -- 172.21.15.55:0/3202320736 >> 172.21.15.55:0/3202320736 conn(0x7f552409bae0 msgr2=0x7f55240cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:45.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.335+0000 7f55290cb640 1 -- 172.21.15.55:0/3202320736 shutdown_connections 2023-08-25T04:03:45.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.335+0000 7f55290cb640 1 -- 172.21.15.55:0/3202320736 wait complete. 2023-08-25T04:03:45.356 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:45.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f260e456640 1 Processor -- start 2023-08-25T04:03:45.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f260e456640 1 -- start start 2023-08-25T04:03:45.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f260e456640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26080d0da0 0x7f26080d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f260e456640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f26080cdde0 0x7f26080ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f260e456640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26080b29b0 con 0x7f26080cee60 2023-08-25T04:03:45.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f260e456640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26080ce760 con 0x7f26080cdde0 2023-08-25T04:03:45.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f260e456640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26080d16c0 con 0x7f26080d0da0 2023-08-25T04:03:45.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f260c9f3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f26080cee60 0x7f26080cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49376/0 (socket says 172.21.15.55:49376) 2023-08-25T04:03:45.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f260c9f3640 1 -- 172.21.15.55:0/1257835660 learned_addr learned my addr 172.21.15.55:0/1257835660 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:45.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f2607fff640 1 --2- 172.21.15.55:0/1257835660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26080d0da0 0x7f26080d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f26077fe640 1 --2- 172.21.15.55:0/1257835660 >> v2:172.21.15.110:3300/0 conn(0x7f26080cdde0 0x7f26080ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f2606ffd640 1 -- 172.21.15.55:0/1257835660 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283225112 0 0) 0x7f26080b29b0 con 0x7f26080cee60 2023-08-25T04:03:45.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f2606ffd640 1 -- 172.21.15.55:0/1257835660 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25f0003530 con 0x7f26080cee60 2023-08-25T04:03:45.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f2606ffd640 1 -- 172.21.15.55:0/1257835660 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3771804944 0 0) 0x7f25f0003530 con 0x7f26080cee60 2023-08-25T04:03:45.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f2606ffd640 1 -- 172.21.15.55:0/1257835660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26080d0da0 msgr2=0x7f26080d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:45.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f2606ffd640 1 --2- 172.21.15.55:0/1257835660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26080d0da0 0x7f26080d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f2606ffd640 1 -- 172.21.15.55:0/1257835660 >> v2:172.21.15.110:3300/0 conn(0x7f26080cdde0 msgr2=0x7f26080ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:45.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f2606ffd640 1 --2- 172.21.15.55:0/1257835660 >> v2:172.21.15.110:3300/0 conn(0x7f26080cdde0 0x7f26080ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f2606ffd640 1 -- 172.21.15.55:0/1257835660 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26080b1dc0 con 0x7f26080cee60 2023-08-25T04:03:45.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f2606ffd640 1 -- 172.21.15.55:0/1257835660 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f2600001a00 con 0x7f26080cee60 2023-08-25T04:03:45.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f2606ffd640 1 -- 172.21.15.55:0/1257835660 >> v1:172.21.15.55:6789/0 conn(0x7f26080cee60 legacy=0x7f26080cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:45.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f2606ffd640 1 --2- 172.21.15.55:0/1257835660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26080d0da0 0x7f25f0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f2606ffd640 1 --2- 172.21.15.55:0/1257835660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25f0003f00 0x7f25f00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f2606ffd640 1 --2- 172.21.15.55:0/1257835660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25f0004d10 0x7f25f0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f2606ffd640 1 -- 172.21.15.55:0/1257835660 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26080ce760 con 0x7f25f0004d10 2023-08-25T04:03:45.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f2606ffd640 1 -- 172.21.15.55:0/1257835660 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26080d16c0 con 0x7f25f0003f00 2023-08-25T04:03:45.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f2606ffd640 1 -- 172.21.15.55:0/1257835660 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f000b9c0 con 0x7f26080d0da0 2023-08-25T04:03:45.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f260c9f3640 1 --2- 172.21.15.55:0/1257835660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25f0004d10 0x7f25f0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f26077fe640 1 --2- 172.21.15.55:0/1257835660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25f0003f00 0x7f25f00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f2607fff640 1 --2- 172.21.15.55:0/1257835660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26080d0da0 0x7f25f0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f260c9f3640 1 -- 172.21.15.55:0/1257835660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26080d0da0 msgr2=0x7f25f0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:45.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f260c9f3640 1 --2- 172.21.15.55:0/1257835660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26080d0da0 0x7f25f0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f260c9f3640 1 -- 172.21.15.55:0/1257835660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25f0003f00 msgr2=0x7f25f00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:45.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f260c9f3640 1 --2- 172.21.15.55:0/1257835660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25f0003f00 0x7f25f00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.499+0000 7f260c9f3640 1 -- 172.21.15.55:0/1257835660 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f0003530 con 0x7f25f0004d10 2023-08-25T04:03:45.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.503+0000 7f260c9f3640 1 --2- 172.21.15.55:0/1257835660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25f0004d10 0x7f25f0005190 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f260000a860 tx=0x7f260001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e170405b9d3341 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:45.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.503+0000 7f2606ffd640 1 -- 172.21.15.55:0/1257835660 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26000ad630 con 0x7f25f0004d10 2023-08-25T04:03:45.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.503+0000 7f2606ffd640 1 -- 172.21.15.55:0/1257835660 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26000a8070 con 0x7f25f0004d10 2023-08-25T04:03:45.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.503+0000 7f2606ffd640 1 -- 172.21.15.55:0/1257835660 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26000ada30 con 0x7f25f0004d10 2023-08-25T04:03:45.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.503+0000 7f260e456640 1 -- 172.21.15.55:0/1257835660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25f0004d10 msgr2=0x7f25f0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:45.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.503+0000 7f260e456640 1 --2- 172.21.15.55:0/1257835660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25f0004d10 0x7f25f0005190 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f260000a860 tx=0x7f260001d360 comp rx=0 tx=0).stop 2023-08-25T04:03:45.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.503+0000 7f260c9f3640 1 -- 172.21.15.55:0/1257835660 reap_dead start 2023-08-25T04:03:45.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.503+0000 7f260e456640 1 -- 172.21.15.55:0/1257835660 shutdown_connections 2023-08-25T04:03:45.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.503+0000 7f260e456640 1 -- 172.21.15.55:0/1257835660 >> 172.21.15.55:0/1257835660 conn(0x7f260809bae0 msgr2=0x7f26080d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:45.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.503+0000 7f260e456640 1 -- 172.21.15.55:0/1257835660 shutdown_connections 2023-08-25T04:03:45.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.503+0000 7f260e456640 1 -- 172.21.15.55:0/1257835660 wait complete. 2023-08-25T04:03:45.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f260e456640 1 Processor -- start 2023-08-25T04:03:45.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f260e456640 1 -- start start 2023-08-25T04:03:45.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f260e456640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25f0004d10 0x7f26080ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f260e456640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26080b7a90 0x7f26080b7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f260e456640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26080b53e0 0x7f26080b5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f260e456640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26080b5dd0 con 0x7f26080b53e0 2023-08-25T04:03:45.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f260e456640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26080b8450 con 0x7f26080b7a90 2023-08-25T04:03:45.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f260e456640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26080cc1f0 con 0x7f25f0004d10 2023-08-25T04:03:45.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f260c9f3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26080b53e0 0x7f26080b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f260c9f3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26080b53e0 0x7f26080b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48364/0 (socket says 172.21.15.55:48364) 2023-08-25T04:03:45.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f260c9f3640 1 -- 172.21.15.55:0/3503601597 learned_addr learned my addr 172.21.15.55:0/3503601597 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:45.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f2607fff640 1 --2- 172.21.15.55:0/3503601597 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25f0004d10 0x7f26080ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f26077fe640 1 --2- 172.21.15.55:0/3503601597 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26080b7a90 0x7f26080b7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f260c9f3640 1 -- 172.21.15.55:0/3503601597 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25f0004d10 msgr2=0x7f26080ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:45.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f260c9f3640 1 --2- 172.21.15.55:0/3503601597 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25f0004d10 0x7f26080ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f260c9f3640 1 -- 172.21.15.55:0/3503601597 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26080b7a90 msgr2=0x7f26080b7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:45.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f260c9f3640 1 --2- 172.21.15.55:0/3503601597 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26080b7a90 0x7f26080b7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f260c9f3640 1 -- 172.21.15.55:0/3503601597 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26080cb150 con 0x7f26080b53e0 2023-08-25T04:03:45.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f260c9f3640 1 --2- 172.21.15.55:0/3503601597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26080b53e0 0x7f26080b5890 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f260001dc00 tx=0x7f25f0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:45.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f2604ff9640 1 -- 172.21.15.55:0/3503601597 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26000019c0 con 0x7f26080b53e0 2023-08-25T04:03:45.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f2604ff9640 1 -- 172.21.15.55:0/3503601597 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26000ad430 con 0x7f26080b53e0 2023-08-25T04:03:45.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f260e456640 1 -- 172.21.15.55:0/3503601597 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26080cb430 con 0x7f26080b53e0 2023-08-25T04:03:45.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.507+0000 7f2604ff9640 1 -- 172.21.15.55:0/3503601597 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26000ad7a0 con 0x7f26080b53e0 2023-08-25T04:03:45.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.511+0000 7f260e456640 1 -- 172.21.15.55:0/3503601597 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26080cb9f0 con 0x7f26080b53e0 2023-08-25T04:03:45.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.511+0000 7f260e456640 1 -- 172.21.15.55:0/3503601597 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260804dbe0 con 0x7f26080b53e0 2023-08-25T04:03:45.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.511+0000 7f2604ff9640 1 -- 172.21.15.55:0/3503601597 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f26000aa030 con 0x7f26080b53e0 2023-08-25T04:03:45.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.511+0000 7f2604ff9640 1 --2- 172.21.15.55:0/3503601597 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f25f40656b0 0x7f25f4067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.511+0000 7f2604ff9640 1 -- 172.21.15.55:0/3503601597 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f260011d7c0 con 0x7f26080b53e0 2023-08-25T04:03:45.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.511+0000 7f2607fff640 1 --2- 172.21.15.55:0/3503601597 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f25f40656b0 0x7f25f4067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.511+0000 7f2607fff640 1 --2- 172.21.15.55:0/3503601597 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f25f40656b0 0x7f25f4067b70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2608160320 tx=0x7f25f8006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:45.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.515+0000 7f2604ff9640 1 -- 172.21.15.55:0/3503601597 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f26000eee10 con 0x7f26080b53e0 2023-08-25T04:03:45.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.675+0000 7f260e456640 1 -- 172.21.15.55:0/3503601597 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f260804dbe0 con 0x7f26080b53e0 2023-08-25T04:03:45.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.679+0000 7f2604ff9640 1 -- 172.21.15.55:0/3503601597 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18387 (secure 0 0 0) 0x7f26000ee9a0 con 0x7f26080b53e0 2023-08-25T04:03:45.680 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:45.680 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":26,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:42.589744+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2b","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:45.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.679+0000 7f260e456640 1 -- 172.21.15.55:0/3503601597 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f25f40656b0 msgr2=0x7f25f4067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:45.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.679+0000 7f260e456640 1 --2- 172.21.15.55:0/3503601597 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f25f40656b0 0x7f25f4067b70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2608160320 tx=0x7f25f8006f90 comp rx=0 tx=0).stop 2023-08-25T04:03:45.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.679+0000 7f260e456640 1 -- 172.21.15.55:0/3503601597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26080b53e0 msgr2=0x7f26080b5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:45.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.679+0000 7f260e456640 1 --2- 172.21.15.55:0/3503601597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26080b53e0 0x7f26080b5890 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f260001dc00 tx=0x7f25f0005800 comp rx=0 tx=0).stop 2023-08-25T04:03:45.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.679+0000 7f260e456640 1 -- 172.21.15.55:0/3503601597 shutdown_connections 2023-08-25T04:03:45.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.679+0000 7f260e456640 1 --2- 172.21.15.55:0/3503601597 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f25f40656b0 0x7f25f4067b70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.679+0000 7f260e456640 1 --2- 172.21.15.55:0/3503601597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26080b53e0 0x7f26080b5890 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.679+0000 7f260e456640 1 --2- 172.21.15.55:0/3503601597 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26080b7a90 0x7f26080b7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.679+0000 7f260e456640 1 --2- 172.21.15.55:0/3503601597 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25f0004d10 0x7f26080ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.679+0000 7f260e456640 1 -- 172.21.15.55:0/3503601597 >> 172.21.15.55:0/3503601597 conn(0x7f260809bae0 msgr2=0x7f26080cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:45.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.679+0000 7f260e456640 1 -- 172.21.15.55:0/3503601597 shutdown_connections 2023-08-25T04:03:45.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.679+0000 7f260e456640 1 -- 172.21.15.55:0/3503601597 wait complete. 2023-08-25T04:03:45.701 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-25T04:03:45.702 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:03:45.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.843+0000 7f06fdb59640 1 Processor -- start 2023-08-25T04:03:45.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.843+0000 7f06fdb59640 1 -- start start 2023-08-25T04:03:45.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.843+0000 7f06fdb59640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06f80cdde0 0x7f06f80ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.843+0000 7f06fdb59640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f06f80b2e40 0x7f06f80b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.843+0000 7f06fdb59640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f80b29b0 con 0x7f06f80d0da0 2023-08-25T04:03:45.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.843+0000 7f06fdb59640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f80ce760 con 0x7f06f80cdde0 2023-08-25T04:03:45.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.843+0000 7f06fdb59640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f80b1dc0 con 0x7f06f80b2e40 2023-08-25T04:03:45.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.843+0000 7f06effff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06f80cdde0 0x7f06f80ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.843+0000 7f06effff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06f80cdde0 0x7f06f80ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48376/0 (socket says 172.21.15.55:48376) 2023-08-25T04:03:45.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.843+0000 7f06effff640 1 -- 172.21.15.55:0/3434602141 learned_addr learned my addr 172.21.15.55:0/3434602141 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:45.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.843+0000 7f06f7fff640 1 --2- 172.21.15.55:0/3434602141 >> v2:172.21.15.110:3300/0 conn(0x7f06f80b2e40 0x7f06f80b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.843+0000 7f06effff640 1 -- 172.21.15.55:0/3434602141 >> v2:172.21.15.110:3300/0 conn(0x7f06f80b2e40 msgr2=0x7f06f80b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:45.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.843+0000 7f06effff640 1 --2- 172.21.15.55:0/3434602141 >> v2:172.21.15.110:3300/0 conn(0x7f06f80b2e40 0x7f06f80b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.843+0000 7f06effff640 1 -- 172.21.15.55:0/3434602141 >> v1:172.21.15.110:6789/0 conn(0x7f06f80d0da0 legacy=0x7f06f80d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:45.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.843+0000 7f06effff640 1 -- 172.21.15.55:0/3434602141 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f80b2080 con 0x7f06f80cdde0 2023-08-25T04:03:45.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.847+0000 7f06effff640 1 --2- 172.21.15.55:0/3434602141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f80cdde0 0x7f06f80ce220 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f06f80ceae0 tx=0x7f06e001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49f77fe5082b188 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:45.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.847+0000 7f06f6ffd640 1 -- 172.21.15.55:0/3434602141 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e00a89b0 con 0x7f06f80cdde0 2023-08-25T04:03:45.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.847+0000 7f06f6ffd640 1 -- 172.21.15.55:0/3434602141 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e00a8b10 con 0x7f06f80cdde0 2023-08-25T04:03:45.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.847+0000 7f06f6ffd640 1 -- 172.21.15.55:0/3434602141 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e00a8ea0 con 0x7f06f80cdde0 2023-08-25T04:03:45.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.847+0000 7f06fdb59640 1 -- 172.21.15.55:0/3434602141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f80cdde0 msgr2=0x7f06f80ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:45.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.847+0000 7f06fdb59640 1 --2- 172.21.15.55:0/3434602141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f80cdde0 0x7f06f80ce220 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f06f80ceae0 tx=0x7f06e001ecb0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.847+0000 7f06fdb59640 1 -- 172.21.15.55:0/3434602141 shutdown_connections 2023-08-25T04:03:45.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.847+0000 7f06fdb59640 1 --2- 172.21.15.55:0/3434602141 >> v2:172.21.15.110:3300/0 conn(0x7f06f80b2e40 0x7f06f80b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.847+0000 7f06fdb59640 1 --2- 172.21.15.55:0/3434602141 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f80cdde0 0x7f06f80ce220 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.847+0000 7f06fdb59640 1 -- 172.21.15.55:0/3434602141 >> 172.21.15.55:0/3434602141 conn(0x7f06f809bae0 msgr2=0x7f06f80d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:45.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.847+0000 7f06fdb59640 1 -- 172.21.15.55:0/3434602141 shutdown_connections 2023-08-25T04:03:45.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.847+0000 7f06fdb59640 1 -- 172.21.15.55:0/3434602141 wait complete. 2023-08-25T04:03:45.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06fdb59640 1 Processor -- start 2023-08-25T04:03:45.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06fdb59640 1 -- start start 2023-08-25T04:03:45.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06fdb59640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06f80b2e40 0x7f06f81f4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06fdb59640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f80cdde0 0x7f06f815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06fdb59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f80d0da0 0x7f06f80b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06fdb59640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f815e360 con 0x7f06f80d0da0 2023-08-25T04:03:45.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06fdb59640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f80cc550 con 0x7f06f80cdde0 2023-08-25T04:03:45.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06fdb59640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f815e5d0 con 0x7f06f80b2e40 2023-08-25T04:03:45.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06f7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f80d0da0 0x7f06f80b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06f7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f80d0da0 0x7f06f80b0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48378/0 (socket says 172.21.15.55:48378) 2023-08-25T04:03:45.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06f7fff640 1 -- 172.21.15.55:0/204526295 learned_addr learned my addr 172.21.15.55:0/204526295 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:45.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06effff640 1 --2- 172.21.15.55:0/204526295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f80cdde0 0x7f06f815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06f77fe640 1 --2- 172.21.15.55:0/204526295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06f80b2e40 0x7f06f81f4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06f7fff640 1 -- 172.21.15.55:0/204526295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06f80b2e40 msgr2=0x7f06f81f4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:45.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06f7fff640 1 --2- 172.21.15.55:0/204526295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06f80b2e40 0x7f06f81f4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06f7fff640 1 -- 172.21.15.55:0/204526295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f80cdde0 msgr2=0x7f06f815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:45.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06f7fff640 1 --2- 172.21.15.55:0/204526295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f80cdde0 0x7f06f815f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:45.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06f7fff640 1 -- 172.21.15.55:0/204526295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e00094d0 con 0x7f06f80d0da0 2023-08-25T04:03:45.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06f7fff640 1 --2- 172.21.15.55:0/204526295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f80d0da0 0x7f06f80b0550 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f06f0007e40 tx=0x7f06f000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:45.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06f4ff9640 1 -- 172.21.15.55:0/204526295 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f0014620 con 0x7f06f80d0da0 2023-08-25T04:03:45.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06f4ff9640 1 -- 172.21.15.55:0/204526295 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f000ee90 con 0x7f06f80d0da0 2023-08-25T04:03:45.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06fdb59640 1 -- 172.21.15.55:0/204526295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f815e8b0 con 0x7f06f80d0da0 2023-08-25T04:03:45.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06f4ff9640 1 -- 172.21.15.55:0/204526295 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f00149e0 con 0x7f06f80d0da0 2023-08-25T04:03:45.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.851+0000 7f06fdb59640 1 -- 172.21.15.55:0/204526295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f815f5f0 con 0x7f06f80d0da0 2023-08-25T04:03:45.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.855+0000 7f06fdb59640 1 -- 172.21.15.55:0/204526295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f804dbe0 con 0x7f06f80d0da0 2023-08-25T04:03:45.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.855+0000 7f06f4ff9640 1 -- 172.21.15.55:0/204526295 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f06f0014b40 con 0x7f06f80d0da0 2023-08-25T04:03:45.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.855+0000 7f06f4ff9640 1 --2- 172.21.15.55:0/204526295 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f06d8065680 0x7f06d8067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:45.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.855+0000 7f06f4ff9640 1 -- 172.21.15.55:0/204526295 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f06f0083720 con 0x7f06f80d0da0 2023-08-25T04:03:45.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.855+0000 7f06f77fe640 1 --2- 172.21.15.55:0/204526295 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f06d8065680 0x7f06d8067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:45.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.855+0000 7f06f77fe640 1 --2- 172.21.15.55:0/204526295 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f06d8065680 0x7f06d8067b40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f06f80c8180 tx=0x7f06e8009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:45.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:45.859+0000 7f06f4ff9640 1 -- 172.21.15.55:0/204526295 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f06f0051240 con 0x7f06f80d0da0 2023-08-25T04:03:46.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.047+0000 7f06fdb59640 1 -- 172.21.15.55:0/204526295 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06f815ed60 con 0x7f06f80d0da0 2023-08-25T04:03:46.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.047+0000 7f06f4ff9640 1 -- 172.21.15.55:0/204526295 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4875 (secure 0 0 0) 0x7f06f0054860 con 0x7f06f80d0da0 2023-08-25T04:03:46.049 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:46.049 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3370778281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3370778281},{"type":"v1","addr":"172.21.15.55:6835","nonce":3370778281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/2321139789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2321139789},{"type":"v1","addr":"172.21.15.110:6837","nonce":2321139789}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3825401605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3825401605},{"type":"v1","addr":"172.21.15.110:6836","nonce":3825401605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:03:01.098486+0000","modified":"2023-08-25T04:03:04.724648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/2606103809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2606103809},{"type":"v1","addr":"172.21.15.55:6834","nonce":2606103809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:03:46.049 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2023-08-25T04:03:46.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.047+0000 7f06fdb59640 1 -- 172.21.15.55:0/204526295 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f06d8065680 msgr2=0x7f06d8067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.047+0000 7f06fdb59640 1 --2- 172.21.15.55:0/204526295 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f06d8065680 0x7f06d8067b40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f06f80c8180 tx=0x7f06e8009060 comp rx=0 tx=0).stop 2023-08-25T04:03:46.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.047+0000 7f06fdb59640 1 -- 172.21.15.55:0/204526295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f80d0da0 msgr2=0x7f06f80b0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.047+0000 7f06fdb59640 1 --2- 172.21.15.55:0/204526295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f80d0da0 0x7f06f80b0550 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f06f0007e40 tx=0x7f06f000e4b0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.047+0000 7f06fdb59640 1 -- 172.21.15.55:0/204526295 shutdown_connections 2023-08-25T04:03:46.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.047+0000 7f06fdb59640 1 --2- 172.21.15.55:0/204526295 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f06d8065680 0x7f06d8067b40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.047+0000 7f06fdb59640 1 --2- 172.21.15.55:0/204526295 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f80d0da0 0x7f06f80b0550 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.047+0000 7f06fdb59640 1 --2- 172.21.15.55:0/204526295 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06f80cdde0 0x7f06f815f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.047+0000 7f06fdb59640 1 --2- 172.21.15.55:0/204526295 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06f80b2e40 0x7f06f81f4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.047+0000 7f06fdb59640 1 -- 172.21.15.55:0/204526295 >> 172.21.15.55:0/204526295 conn(0x7f06f809bae0 msgr2=0x7f06f80b44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:46.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.047+0000 7f06fdb59640 1 -- 172.21.15.55:0/204526295 shutdown_connections 2023-08-25T04:03:46.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.047+0000 7f06fdb59640 1 -- 172.21.15.55:0/204526295 wait complete. 2023-08-25T04:03:46.077 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:03:46.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.219+0000 7f5074ffa640 1 Processor -- start 2023-08-25T04:03:46.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.219+0000 7f5074ffa640 1 -- start start 2023-08-25T04:03:46.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.219+0000 7f5074ffa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50700c89f0 0x7f50700cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.219+0000 7f5074ffa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50700cc880 con 0x7f50700ad950 2023-08-25T04:03:46.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.219+0000 7f5074ffa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50700ccb60 con 0x7f50700ceeb0 2023-08-25T04:03:46.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.219+0000 7f5074ffa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50700b11f0 con 0x7f50700c89f0 2023-08-25T04:03:46.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506e59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f50700ad950 0x7f50700ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49380/0 (socket says 172.21.15.55:49380) 2023-08-25T04:03:46.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506e59c640 1 -- 172.21.15.55:0/683928506 learned_addr learned my addr 172.21.15.55:0/683928506 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:46.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506ed9d640 1 --2- 172.21.15.55:0/683928506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50700c89f0 0x7f50700cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506dd9b640 1 -- 172.21.15.55:0/683928506 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119546943 0 0) 0x7f50700cc880 con 0x7f50700ad950 2023-08-25T04:03:46.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506dd9b640 1 -- 172.21.15.55:0/683928506 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f505c005740 con 0x7f50700ad950 2023-08-25T04:03:46.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506dd9b640 1 -- 172.21.15.55:0/683928506 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1438146826 0 0) 0x7f505c005740 con 0x7f50700ad950 2023-08-25T04:03:46.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506dd9b640 1 -- 172.21.15.55:0/683928506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50700c89f0 msgr2=0x7f50700cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:46.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506dd9b640 1 --2- 172.21.15.55:0/683928506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50700c89f0 0x7f50700cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506dd9b640 1 -- 172.21.15.55:0/683928506 >> v1:172.21.15.110:6789/0 conn(0x7f50700ceeb0 legacy=0x7f50700b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506dd9b640 1 -- 172.21.15.55:0/683928506 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50700cce40 con 0x7f50700ad950 2023-08-25T04:03:46.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506dd9b640 1 -- 172.21.15.55:0/683928506 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f5060001680 con 0x7f50700ad950 2023-08-25T04:03:46.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506dd9b640 1 -- 172.21.15.55:0/683928506 >> v1:172.21.15.55:6789/0 conn(0x7f50700ad950 legacy=0x7f50700ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506dd9b640 1 --2- 172.21.15.55:0/683928506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f505c005bc0 0x7f505c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506dd9b640 1 --2- 172.21.15.55:0/683928506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f505c006570 0x7f505c006a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506dd9b640 1 --2- 172.21.15.55:0/683928506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50700c89f0 0x7f505c007340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506dd9b640 1 -- 172.21.15.55:0/683928506 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700b11f0 con 0x7f505c005bc0 2023-08-25T04:03:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506dd9b640 1 -- 172.21.15.55:0/683928506 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c00dc50 con 0x7f505c006570 2023-08-25T04:03:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506dd9b640 1 -- 172.21.15.55:0/683928506 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c00de10 con 0x7f50700c89f0 2023-08-25T04:03:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506e59c640 1 --2- 172.21.15.55:0/683928506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f505c005bc0 0x7f505c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f5067fff640 1 --2- 172.21.15.55:0/683928506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f505c006570 0x7f505c006a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506ed9d640 1 --2- 172.21.15.55:0/683928506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50700c89f0 0x7f505c007340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506e59c640 1 -- 172.21.15.55:0/683928506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50700c89f0 msgr2=0x7f505c007340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:46.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506e59c640 1 --2- 172.21.15.55:0/683928506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50700c89f0 0x7f505c007340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506e59c640 1 -- 172.21.15.55:0/683928506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f505c006570 msgr2=0x7f505c006a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:46.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506e59c640 1 --2- 172.21.15.55:0/683928506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f505c006570 0x7f505c006a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f506e59c640 1 -- 172.21.15.55:0/683928506 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c005740 con 0x7f505c005bc0 2023-08-25T04:03:46.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.223+0000 7f5067fff640 1 --2- 172.21.15.55:0/683928506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f505c006570 0x7f505c006a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:46.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.227+0000 7f506e59c640 1 --2- 172.21.15.55:0/683928506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f505c005bc0 0x7f505c005fa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f506000c210 tx=0x7f506001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651954d12fbb275c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:46.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.227+0000 7f506dd9b640 1 -- 172.21.15.55:0/683928506 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060005ae0 con 0x7f505c005bc0 2023-08-25T04:03:46.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.227+0000 7f506dd9b640 1 -- 172.21.15.55:0/683928506 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5060005c60 con 0x7f505c005bc0 2023-08-25T04:03:46.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.227+0000 7f506dd9b640 1 -- 172.21.15.55:0/683928506 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060007070 con 0x7f505c005bc0 2023-08-25T04:03:46.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.227+0000 7f5074ffa640 1 -- 172.21.15.55:0/683928506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f505c005bc0 msgr2=0x7f505c005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.227+0000 7f5074ffa640 1 --2- 172.21.15.55:0/683928506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f505c005bc0 0x7f505c005fa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f506000c210 tx=0x7f506001cc60 comp rx=0 tx=0).stop 2023-08-25T04:03:46.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.227+0000 7f506ed9d640 1 -- 172.21.15.55:0/683928506 reap_dead start 2023-08-25T04:03:46.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.227+0000 7f5074ffa640 1 -- 172.21.15.55:0/683928506 shutdown_connections 2023-08-25T04:03:46.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.227+0000 7f5074ffa640 1 -- 172.21.15.55:0/683928506 >> 172.21.15.55:0/683928506 conn(0x7f5070069d00 msgr2=0x7f507006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:46.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.227+0000 7f5074ffa640 1 -- 172.21.15.55:0/683928506 shutdown_connections 2023-08-25T04:03:46.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.227+0000 7f5074ffa640 1 -- 172.21.15.55:0/683928506 wait complete. 2023-08-25T04:03:46.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.227+0000 7f5074ffa640 1 Processor -- start 2023-08-25T04:03:46.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.227+0000 7f5074ffa640 1 -- start start 2023-08-25T04:03:46.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f5074ffa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f505c005bc0 0x7f5070152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f5074ffa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5070097940 0x7f50701520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f5074ffa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5070154130 0x7f50701545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f5074ffa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5070153c80 con 0x7f5070154130 2023-08-25T04:03:46.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f5074ffa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5070151860 con 0x7f505c005bc0 2023-08-25T04:03:46.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f5074ffa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5070151b20 con 0x7f5070097940 2023-08-25T04:03:46.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f506ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5070154130 0x7f50701545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f506e59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f505c005bc0 0x7f5070152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f506ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5070154130 0x7f50701545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48398/0 (socket says 172.21.15.55:48398) 2023-08-25T04:03:46.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f506ed9d640 1 -- 172.21.15.55:0/3485982447 learned_addr learned my addr 172.21.15.55:0/3485982447 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:46.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f5067fff640 1 --2- 172.21.15.55:0/3485982447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5070097940 0x7f50701520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f506ed9d640 1 -- 172.21.15.55:0/3485982447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5070097940 msgr2=0x7f50701520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f506ed9d640 1 --2- 172.21.15.55:0/3485982447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5070097940 0x7f50701520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f506ed9d640 1 -- 172.21.15.55:0/3485982447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f505c005bc0 msgr2=0x7f5070152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f506ed9d640 1 --2- 172.21.15.55:0/3485982447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f505c005bc0 0x7f5070152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f506ed9d640 1 -- 172.21.15.55:0/3485982447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5070151e00 con 0x7f5070154130 2023-08-25T04:03:46.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f506ed9d640 1 --2- 172.21.15.55:0/3485982447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5070154130 0x7f50701545b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f507006d620 tx=0x7f50680115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:46.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f5066ffd640 1 -- 172.21.15.55:0/3485982447 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506800e070 con 0x7f5070154130 2023-08-25T04:03:46.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f5066ffd640 1 -- 172.21.15.55:0/3485982447 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5068011ed0 con 0x7f5070154130 2023-08-25T04:03:46.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f5066ffd640 1 -- 172.21.15.55:0/3485982447 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50680039a0 con 0x7f5070154130 2023-08-25T04:03:46.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f5074ffa640 1 -- 172.21.15.55:0/3485982447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5070152620 con 0x7f5070154130 2023-08-25T04:03:46.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f5074ffa640 1 -- 172.21.15.55:0/3485982447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50700acd40 con 0x7f5070154130 2023-08-25T04:03:46.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f5074ffa640 1 -- 172.21.15.55:0/3485982447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507004dbe0 con 0x7f5070154130 2023-08-25T04:03:46.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.231+0000 7f5066ffd640 1 -- 172.21.15.55:0/3485982447 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5068003b20 con 0x7f5070154130 2023-08-25T04:03:46.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.235+0000 7f5066ffd640 1 --2- 172.21.15.55:0/3485982447 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f50500656b0 0x7f5050067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.235+0000 7f5066ffd640 1 -- 172.21.15.55:0/3485982447 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f50680833f0 con 0x7f5070154130 2023-08-25T04:03:46.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.235+0000 7f506e59c640 1 --2- 172.21.15.55:0/3485982447 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f50500656b0 0x7f5050067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.235+0000 7f506e59c640 1 --2- 172.21.15.55:0/3485982447 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f50500656b0 0x7f5050067b70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f50600ab000 tx=0x7f50600b1040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:46.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.239+0000 7f5066ffd640 1 -- 172.21.15.55:0/3485982447 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5068050e80 con 0x7f5070154130 2023-08-25T04:03:46.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.427+0000 7f5074ffa640 1 -- 172.21.15.55:0/3485982447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50700cddf0 con 0x7f5070154130 2023-08-25T04:03:46.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.427+0000 7f5066ffd640 1 -- 172.21.15.55:0/3485982447 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4875 (secure 0 0 0) 0x7f50680544a0 con 0x7f5070154130 2023-08-25T04:03:46.428 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:46.428 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3370778281","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3370778281},{"type":"v1","addr":"172.21.15.55:6835","nonce":3370778281}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/2321139789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2321139789},{"type":"v1","addr":"172.21.15.110:6837","nonce":2321139789}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3825401605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3825401605},{"type":"v1","addr":"172.21.15.110:6836","nonce":3825401605}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:03:01.098486+0000","modified":"2023-08-25T04:03:04.724648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/2606103809","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2606103809},{"type":"v1","addr":"172.21.15.55:6834","nonce":2606103809}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-25T04:03:46.429 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2023-08-25T04:03:46.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.427+0000 7f5074ffa640 1 -- 172.21.15.55:0/3485982447 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f50500656b0 msgr2=0x7f5050067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.427+0000 7f5074ffa640 1 --2- 172.21.15.55:0/3485982447 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f50500656b0 0x7f5050067b70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f50600ab000 tx=0x7f50600b1040 comp rx=0 tx=0).stop 2023-08-25T04:03:46.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.427+0000 7f5074ffa640 1 -- 172.21.15.55:0/3485982447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5070154130 msgr2=0x7f50701545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.427+0000 7f5074ffa640 1 --2- 172.21.15.55:0/3485982447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5070154130 0x7f50701545b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f507006d620 tx=0x7f50680115a0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.427+0000 7f5074ffa640 1 -- 172.21.15.55:0/3485982447 shutdown_connections 2023-08-25T04:03:46.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.427+0000 7f5074ffa640 1 --2- 172.21.15.55:0/3485982447 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f50500656b0 0x7f5050067b70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.427+0000 7f5074ffa640 1 --2- 172.21.15.55:0/3485982447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5070154130 0x7f50701545b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.427+0000 7f5074ffa640 1 --2- 172.21.15.55:0/3485982447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5070097940 0x7f50701520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.427+0000 7f5074ffa640 1 --2- 172.21.15.55:0/3485982447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f505c005bc0 0x7f5070152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.427+0000 7f5074ffa640 1 -- 172.21.15.55:0/3485982447 >> 172.21.15.55:0/3485982447 conn(0x7f5070069d00 msgr2=0x7f50700c97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:46.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.427+0000 7f5074ffa640 1 -- 172.21.15.55:0/3485982447 shutdown_connections 2023-08-25T04:03:46.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.427+0000 7f5074ffa640 1 -- 172.21.15.55:0/3485982447 wait complete. 2023-08-25T04:03:46.449 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.591+0000 7f7cbfe9c640 1 Processor -- start 2023-08-25T04:03:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.591+0000 7f7cbfe9c640 1 -- start start 2023-08-25T04:03:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.591+0000 7f7cbfe9c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7cb8164410 0x7f7cb80b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.591+0000 7f7cbfe9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cb80c1a80 0x7f7cb806bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.591+0000 7f7cbfe9c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb80cc510 con 0x7f7cb80cddf0 2023-08-25T04:03:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.591+0000 7f7cbfe9c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb81647f0 con 0x7f7cb8164410 2023-08-25T04:03:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.591+0000 7f7cbfe9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80cc9b0 con 0x7f7cb80c1a80 2023-08-25T04:03:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.591+0000 7f7cbdc38640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7cb8164410 0x7f7cb80b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.591+0000 7f7cbdc38640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7cb8164410 0x7f7cb80b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48408/0 (socket says 172.21.15.55:48408) 2023-08-25T04:03:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.591+0000 7f7cbdc38640 1 -- 172.21.15.55:0/4050906550 learned_addr learned my addr 172.21.15.55:0/4050906550 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.591+0000 7f7cbe439640 1 --2- 172.21.15.55:0/4050906550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cb80c1a80 0x7f7cb806bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.591+0000 7f7cbdc38640 1 -- 172.21.15.55:0/4050906550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cb80c1a80 msgr2=0x7f7cb806bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.591+0000 7f7cbdc38640 1 --2- 172.21.15.55:0/4050906550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cb80c1a80 0x7f7cb806bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.591+0000 7f7cbdc38640 1 -- 172.21.15.55:0/4050906550 >> v1:172.21.15.110:6789/0 conn(0x7f7cb80cddf0 legacy=0x7f7cb80c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.591+0000 7f7cbdc38640 1 -- 172.21.15.55:0/4050906550 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb80ccc90 con 0x7f7cb8164410 2023-08-25T04:03:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.595+0000 7f7cbdc38640 1 --2- 172.21.15.55:0/4050906550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cb8164410 0x7f7cb80b21b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009870 tx=0x7f7cb401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3e0677bd3fc1e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:46.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.595+0000 7f7cbcc36640 1 -- 172.21.15.55:0/4050906550 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb40ab600 con 0x7f7cb8164410 2023-08-25T04:03:46.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.595+0000 7f7cbcc36640 1 -- 172.21.15.55:0/4050906550 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb40a7050 con 0x7f7cb8164410 2023-08-25T04:03:46.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.595+0000 7f7cbcc36640 1 -- 172.21.15.55:0/4050906550 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb40ab980 con 0x7f7cb8164410 2023-08-25T04:03:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.595+0000 7f7cbfe9c640 1 -- 172.21.15.55:0/4050906550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cb8164410 msgr2=0x7f7cb80b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.595+0000 7f7cbfe9c640 1 --2- 172.21.15.55:0/4050906550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cb8164410 0x7f7cb80b21b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009870 tx=0x7f7cb401c540 comp rx=0 tx=0).stop 2023-08-25T04:03:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.595+0000 7f7cbfe9c640 1 -- 172.21.15.55:0/4050906550 shutdown_connections 2023-08-25T04:03:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.595+0000 7f7cbfe9c640 1 --2- 172.21.15.55:0/4050906550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cb80c1a80 0x7f7cb806bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.595+0000 7f7cbfe9c640 1 --2- 172.21.15.55:0/4050906550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cb8164410 0x7f7cb80b21b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.595+0000 7f7cbfe9c640 1 -- 172.21.15.55:0/4050906550 >> 172.21.15.55:0/4050906550 conn(0x7f7cb8069d00 msgr2=0x7f7cb806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.595+0000 7f7cbfe9c640 1 -- 172.21.15.55:0/4050906550 shutdown_connections 2023-08-25T04:03:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.595+0000 7f7cbfe9c640 1 -- 172.21.15.55:0/4050906550 wait complete. 2023-08-25T04:03:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbfe9c640 1 Processor -- start 2023-08-25T04:03:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbfe9c640 1 -- start start 2023-08-25T04:03:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbfe9c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cb80c1a80 0x7f7cb81615c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbfe9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cb80cddf0 0x7f7cb8163320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbfe9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cb8164410 0x7f7cb8153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbfe9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8163860 con 0x7f7cb80cddf0 2023-08-25T04:03:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbfe9c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80c29c0 con 0x7f7cb80c1a80 2023-08-25T04:03:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbfe9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8162860 con 0x7f7cb8164410 2023-08-25T04:03:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbd437640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cb80cddf0 0x7f7cb8163320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbd437640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cb80cddf0 0x7f7cb8163320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48424/0 (socket says 172.21.15.55:48424) 2023-08-25T04:03:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbd437640 1 -- 172.21.15.55:0/4020731893 learned_addr learned my addr 172.21.15.55:0/4020731893 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbdc38640 1 --2- 172.21.15.55:0/4020731893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cb80c1a80 0x7f7cb81615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbe439640 1 --2- 172.21.15.55:0/4020731893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cb8164410 0x7f7cb8153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbd437640 1 -- 172.21.15.55:0/4020731893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cb8164410 msgr2=0x7f7cb8153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbd437640 1 --2- 172.21.15.55:0/4020731893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cb8164410 0x7f7cb8153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbd437640 1 -- 172.21.15.55:0/4020731893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cb80c1a80 msgr2=0x7f7cb81615c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbd437640 1 --2- 172.21.15.55:0/4020731893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cb80c1a80 0x7f7cb81615c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbd437640 1 -- 172.21.15.55:0/4020731893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb40094d0 con 0x7f7cb80cddf0 2023-08-25T04:03:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbdc38640 1 --2- 172.21.15.55:0/4020731893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cb80c1a80 0x7f7cb81615c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbd437640 1 --2- 172.21.15.55:0/4020731893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cb80cddf0 0x7f7cb8163320 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800c500 tx=0x7f7ca800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cae7fc640 1 -- 172.21.15.55:0/4020731893 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca80052d0 con 0x7f7cb80cddf0 2023-08-25T04:03:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cae7fc640 1 -- 172.21.15.55:0/4020731893 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca8005430 con 0x7f7cb80cddf0 2023-08-25T04:03:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cae7fc640 1 -- 172.21.15.55:0/4020731893 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8012830 con 0x7f7cb80cddf0 2023-08-25T04:03:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbfe9c640 1 -- 172.21.15.55:0/4020731893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb8161c50 con 0x7f7cb80cddf0 2023-08-25T04:03:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.599+0000 7f7cbfe9c640 1 -- 172.21.15.55:0/4020731893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb8162210 con 0x7f7cb80cddf0 2023-08-25T04:03:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.603+0000 7f7cbfe9c640 1 -- 172.21.15.55:0/4020731893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb80c2b50 con 0x7f7cb80cddf0 2023-08-25T04:03:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.603+0000 7f7cae7fc640 1 -- 172.21.15.55:0/4020731893 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7ca8012990 con 0x7f7cb80cddf0 2023-08-25T04:03:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.603+0000 7f7cae7fc640 1 --2- 172.21.15.55:0/4020731893 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7c9c0656b0 0x7f7c9c067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.603+0000 7f7cae7fc640 1 -- 172.21.15.55:0/4020731893 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f7ca8082890 con 0x7f7cb80cddf0 2023-08-25T04:03:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.603+0000 7f7cbdc38640 1 --2- 172.21.15.55:0/4020731893 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7c9c0656b0 0x7f7c9c067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.603+0000 7f7cbdc38640 1 --2- 172.21.15.55:0/4020731893 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7c9c0656b0 0x7f7c9c067b70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40ad000 tx=0x7f7cb40a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.607+0000 7f7cae7fc640 1 -- 172.21.15.55:0/4020731893 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7ca8050330 con 0x7f7cb80cddf0 2023-08-25T04:03:46.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.763+0000 7f7cbfe9c640 1 -- 172.21.15.55:0/4020731893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cb804dbe0 con 0x7f7cb80cddf0 2023-08-25T04:03:46.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.767+0000 7f7cae7fc640 1 -- 172.21.15.55:0/4020731893 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18387 (secure 0 0 0) 0x7f7ca8053950 con 0x7f7cb80cddf0 2023-08-25T04:03:46.768 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:46.768 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":26,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:42.589744+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:02:58.890533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:00.093976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2b","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:46.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.767+0000 7f7cbfe9c640 1 -- 172.21.15.55:0/4020731893 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7c9c0656b0 msgr2=0x7f7c9c067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.767+0000 7f7cbfe9c640 1 --2- 172.21.15.55:0/4020731893 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7c9c0656b0 0x7f7c9c067b70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7cb40ad000 tx=0x7f7cb40a6000 comp rx=0 tx=0).stop 2023-08-25T04:03:46.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.767+0000 7f7cbfe9c640 1 -- 172.21.15.55:0/4020731893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cb80cddf0 msgr2=0x7f7cb8163320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.767+0000 7f7cbfe9c640 1 --2- 172.21.15.55:0/4020731893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cb80cddf0 0x7f7cb8163320 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800c500 tx=0x7f7ca800c9c0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.767+0000 7f7cbfe9c640 1 -- 172.21.15.55:0/4020731893 shutdown_connections 2023-08-25T04:03:46.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.767+0000 7f7cbfe9c640 1 --2- 172.21.15.55:0/4020731893 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7c9c0656b0 0x7f7c9c067b70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.767+0000 7f7cbfe9c640 1 --2- 172.21.15.55:0/4020731893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cb8164410 0x7f7cb8153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.767+0000 7f7cbfe9c640 1 --2- 172.21.15.55:0/4020731893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cb80cddf0 0x7f7cb8163320 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.767+0000 7f7cbfe9c640 1 --2- 172.21.15.55:0/4020731893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cb80c1a80 0x7f7cb81615c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.767+0000 7f7cbfe9c640 1 -- 172.21.15.55:0/4020731893 >> 172.21.15.55:0/4020731893 conn(0x7f7cb8069d00 msgr2=0x7f7cb8071520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:46.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.767+0000 7f7cbfe9c640 1 -- 172.21.15.55:0/4020731893 shutdown_connections 2023-08-25T04:03:46.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.767+0000 7f7cbfe9c640 1 -- 172.21.15.55:0/4020731893 wait complete. 2023-08-25T04:03:46.789 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-25T04:03:46.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.931+0000 7f4b44619640 1 Processor -- start 2023-08-25T04:03:46.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.931+0000 7f4b44619640 1 -- start start 2023-08-25T04:03:46.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.935+0000 7f4b44619640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b3c15eba0 0x7f4b3c0b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.935+0000 7f4b44619640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3c0ac3a0 con 0x7f4b3c0ceeb0 2023-08-25T04:03:46.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.935+0000 7f4b44619640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3c0b1390 con 0x7f4b3c15ef80 2023-08-25T04:03:46.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.935+0000 7f4b44619640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3c0b1670 con 0x7f4b3c15eba0 2023-08-25T04:03:46.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.935+0000 7f4b423b5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b3c15eba0 0x7f4b3c0b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.935+0000 7f4b42bb6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4b3c0ceeb0 0x7f4b3c0ab0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49396/0 (socket says 172.21.15.55:49396) 2023-08-25T04:03:46.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.935+0000 7f4b42bb6640 1 -- 172.21.15.55:0/2742731214 learned_addr learned my addr 172.21.15.55:0/2742731214 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:46.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.935+0000 7f4b423b5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b3c15eba0 0x7f4b3c0b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48430/0 (socket says 172.21.15.55:48430) 2023-08-25T04:03:46.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.935+0000 7f4b423b5640 1 -- 172.21.15.55:0/2742731214 >> v1:172.21.15.110:6789/0 conn(0x7f4b3c15ef80 legacy=0x7f4b3c0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.935+0000 7f4b423b5640 1 -- 172.21.15.55:0/2742731214 >> v1:172.21.15.55:6789/0 conn(0x7f4b3c0ceeb0 legacy=0x7f4b3c0ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.935+0000 7f4b423b5640 1 -- 172.21.15.55:0/2742731214 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c0b1950 con 0x7f4b3c15eba0 2023-08-25T04:03:46.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.935+0000 7f4b413b3640 1 -- 172.21.15.55:0/2742731214 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011058908 0 0) 0x7f4b3c0ac3a0 con 0x7f4b3c0ceeb0 2023-08-25T04:03:46.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b423b5640 1 --2- 172.21.15.55:0/2742731214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b3c15eba0 0x7f4b3c0b2a40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4b380097c0 tx=0x7f4b3801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983eda762bf83177 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:46.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b413b3640 1 -- 172.21.15.55:0/2742731214 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b380ab650 con 0x7f4b3c15eba0 2023-08-25T04:03:46.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b413b3640 1 -- 172.21.15.55:0/2742731214 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b380ab7b0 con 0x7f4b3c15eba0 2023-08-25T04:03:46.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b413b3640 1 -- 172.21.15.55:0/2742731214 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b380abb40 con 0x7f4b3c15eba0 2023-08-25T04:03:46.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b44619640 1 -- 172.21.15.55:0/2742731214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b3c15eba0 msgr2=0x7f4b3c0b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b44619640 1 --2- 172.21.15.55:0/2742731214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b3c15eba0 0x7f4b3c0b2a40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4b380097c0 tx=0x7f4b3801c450 comp rx=0 tx=0).stop 2023-08-25T04:03:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b44619640 1 -- 172.21.15.55:0/2742731214 shutdown_connections 2023-08-25T04:03:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b44619640 1 --2- 172.21.15.55:0/2742731214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b3c15eba0 0x7f4b3c0b2a40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b44619640 1 -- 172.21.15.55:0/2742731214 >> 172.21.15.55:0/2742731214 conn(0x7f4b3c069d00 msgr2=0x7f4b3c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b44619640 1 -- 172.21.15.55:0/2742731214 shutdown_connections 2023-08-25T04:03:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b44619640 1 -- 172.21.15.55:0/2742731214 wait complete. 2023-08-25T04:03:46.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b44619640 1 Processor -- start 2023-08-25T04:03:46.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b44619640 1 -- start start 2023-08-25T04:03:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b44619640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b3c0ceeb0 0x7f4b3c097ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b44619640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b3c15eba0 0x7f4b3c152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b44619640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b3c15ef80 0x7f4b3c152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b44619640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c0c9c80 con 0x7f4b3c0ceeb0 2023-08-25T04:03:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b44619640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c0aed80 con 0x7f4b3c15eba0 2023-08-25T04:03:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.939+0000 7f4b44619640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3c159430 con 0x7f4b3c15ef80 2023-08-25T04:03:46.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b423b5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b3c0ceeb0 0x7f4b3c097ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b423b5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b3c0ceeb0 0x7f4b3c097ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48444/0 (socket says 172.21.15.55:48444) 2023-08-25T04:03:46.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b423b5640 1 -- 172.21.15.55:0/2919734605 learned_addr learned my addr 172.21.15.55:0/2919734605 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:46.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b42bb6640 1 --2- 172.21.15.55:0/2919734605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b3c15ef80 0x7f4b3c152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b41bb4640 1 --2- 172.21.15.55:0/2919734605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b3c15eba0 0x7f4b3c152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b423b5640 1 -- 172.21.15.55:0/2919734605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b3c15ef80 msgr2=0x7f4b3c152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b423b5640 1 --2- 172.21.15.55:0/2919734605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b3c15ef80 0x7f4b3c152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b423b5640 1 -- 172.21.15.55:0/2919734605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b3c15eba0 msgr2=0x7f4b3c152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b423b5640 1 --2- 172.21.15.55:0/2919734605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b3c15eba0 0x7f4b3c152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b423b5640 1 -- 172.21.15.55:0/2919734605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b38009420 con 0x7f4b3c0ceeb0 2023-08-25T04:03:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b42bb6640 1 --2- 172.21.15.55:0/2919734605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b3c15ef80 0x7f4b3c152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b41bb4640 1 --2- 172.21.15.55:0/2919734605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b3c15eba0 0x7f4b3c152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b423b5640 1 --2- 172.21.15.55:0/2919734605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b3c0ceeb0 0x7f4b3c097ad0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4b380ad040 tx=0x7f4b3801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b32ffd640 1 -- 172.21.15.55:0/2919734605 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b380b5810 con 0x7f4b3c0ceeb0 2023-08-25T04:03:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b32ffd640 1 -- 172.21.15.55:0/2919734605 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b380b59b0 con 0x7f4b3c0ceeb0 2023-08-25T04:03:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b44619640 1 -- 172.21.15.55:0/2919734605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b3c0aeaa0 con 0x7f4b3c0ceeb0 2023-08-25T04:03:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b32ffd640 1 -- 172.21.15.55:0/2919734605 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b380b5d60 con 0x7f4b3c0ceeb0 2023-08-25T04:03:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b44619640 1 -- 172.21.15.55:0/2919734605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3c153ce0 con 0x7f4b3c0ceeb0 2023-08-25T04:03:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b44619640 1 -- 172.21.15.55:0/2919734605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b3c153f90 con 0x7f4b3c0ceeb0 2023-08-25T04:03:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b32ffd640 1 -- 172.21.15.55:0/2919734605 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4b380c93f0 con 0x7f4b3c0ceeb0 2023-08-25T04:03:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b32ffd640 1 --2- 172.21.15.55:0/2919734605 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f4b20065680 0x7f4b20067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.943+0000 7f4b32ffd640 1 -- 172.21.15.55:0/2919734605 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4b3811df80 con 0x7f4b3c0ceeb0 2023-08-25T04:03:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.947+0000 7f4b41bb4640 1 --2- 172.21.15.55:0/2919734605 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f4b20065680 0x7f4b20067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.947+0000 7f4b41bb4640 1 --2- 172.21.15.55:0/2919734605 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f4b20065680 0x7f4b20067b40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c06e590 tx=0x7f4b2c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:46.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:46.947+0000 7f4b32ffd640 1 -- 172.21.15.55:0/2919734605 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4b380ebb10 con 0x7f4b3c0ceeb0 2023-08-25T04:03:47.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.139+0000 7f4b44619640 1 -- 172.21.15.55:0/2919734605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4b3c04dbe0 con 0x7f4b3c0ceeb0 2023-08-25T04:03:47.140 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-08-25T04:03:47.139+0000 7f7f18c38640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-25T04:03:47.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.147+0000 7f4b32ffd640 1 -- 172.21.15.55:0/2919734605 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4b380ef130 con 0x7f4b3c0ceeb0 2023-08-25T04:03:47.147 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-25T04:03:47.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.147+0000 7f4b44619640 1 -- 172.21.15.55:0/2919734605 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f4b20065680 msgr2=0x7f4b20067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:47.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.147+0000 7f4b44619640 1 --2- 172.21.15.55:0/2919734605 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f4b20065680 0x7f4b20067b40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c06e590 tx=0x7f4b2c009040 comp rx=0 tx=0).stop 2023-08-25T04:03:47.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.147+0000 7f4b44619640 1 -- 172.21.15.55:0/2919734605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b3c0ceeb0 msgr2=0x7f4b3c097ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:47.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.147+0000 7f4b44619640 1 --2- 172.21.15.55:0/2919734605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b3c0ceeb0 0x7f4b3c097ad0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4b380ad040 tx=0x7f4b3801ac90 comp rx=0 tx=0).stop 2023-08-25T04:03:47.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.147+0000 7f4b44619640 1 -- 172.21.15.55:0/2919734605 shutdown_connections 2023-08-25T04:03:47.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.147+0000 7f4b44619640 1 --2- 172.21.15.55:0/2919734605 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f4b20065680 0x7f4b20067b40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:47.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.147+0000 7f4b44619640 1 --2- 172.21.15.55:0/2919734605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b3c15ef80 0x7f4b3c152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:47.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.147+0000 7f4b44619640 1 --2- 172.21.15.55:0/2919734605 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b3c15eba0 0x7f4b3c152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:47.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.147+0000 7f4b44619640 1 --2- 172.21.15.55:0/2919734605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b3c0ceeb0 0x7f4b3c097ad0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:47.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.147+0000 7f4b44619640 1 -- 172.21.15.55:0/2919734605 >> 172.21.15.55:0/2919734605 conn(0x7f4b3c069d00 msgr2=0x7f4b3c06f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:47.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.147+0000 7f4b44619640 1 -- 172.21.15.55:0/2919734605 shutdown_connections 2023-08-25T04:03:47.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.147+0000 7f4b44619640 1 -- 172.21.15.55:0/2919734605 wait complete. 2023-08-25T04:03:47.156 INFO:tasks.ceph.mds.a.smithi055.stderr: -6905> 2023-08-25T04:03:06.815+0000 7f60f56b9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T04:03:47.170 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-25T04:03:47.209 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-08-25T04:03:47.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.315+0000 7f07cbb03640 1 Processor -- start 2023-08-25T04:03:47.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.315+0000 7f07cbb03640 1 -- start start 2023-08-25T04:03:47.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.319+0000 7f07cbb03640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f07c40b11c0 0x7f07c40ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:47.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.319+0000 7f07cbb03640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c406cd40 con 0x7f07c406dc80 2023-08-25T04:03:47.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.319+0000 7f07cbb03640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c406be90 con 0x7f07c415cba0 2023-08-25T04:03:47.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.319+0000 7f07cbb03640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c406c130 con 0x7f07c40b11c0 2023-08-25T04:03:47.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.319+0000 7f07ca0a0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f07c40b11c0 0x7f07c40ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:47.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.319+0000 7f07ca0a0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f07c40b11c0 0x7f07c40ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48478/0 (socket says 172.21.15.55:48478) 2023-08-25T04:03:47.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.319+0000 7f07ca0a0640 1 -- 172.21.15.55:0/2402358819 learned_addr learned my addr 172.21.15.55:0/2402358819 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:47.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.319+0000 7f07ca0a0640 1 -- 172.21.15.55:0/2402358819 >> v1:172.21.15.110:6789/0 conn(0x7f07c415cba0 legacy=0x7f07c406d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:47.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.319+0000 7f07ca0a0640 1 -- 172.21.15.55:0/2402358819 >> v1:172.21.15.55:6789/0 conn(0x7f07c406dc80 legacy=0x7f07c4069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:47.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.319+0000 7f07ca0a0640 1 -- 172.21.15.55:0/2402358819 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c406c410 con 0x7f07c40b11c0 2023-08-25T04:03:47.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.319+0000 7f07c889d640 1 -- 172.21.15.55:0/2402358819 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965218787 0 0) 0x7f07c406cd40 con 0x7f07c406dc80 2023-08-25T04:03:47.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.323+0000 7f07ca0a0640 1 --2- 172.21.15.55:0/2402358819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07c40b11c0 0x7f07c40ce600 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009e50 tx=0x7f07bc01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34af2dd2df16f155 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:47.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.323+0000 7f07c889d640 1 -- 172.21.15.55:0/2402358819 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0a58e0 con 0x7f07c40b11c0 2023-08-25T04:03:47.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.323+0000 7f07c889d640 1 -- 172.21.15.55:0/2402358819 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc0a5a40 con 0x7f07c40b11c0 2023-08-25T04:03:47.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.323+0000 7f07c889d640 1 -- 172.21.15.55:0/2402358819 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0a5dd0 con 0x7f07c40b11c0 2023-08-25T04:03:47.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.323+0000 7f07cbb03640 1 -- 172.21.15.55:0/2402358819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07c40b11c0 msgr2=0x7f07c40ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:47.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.323+0000 7f07cbb03640 1 --2- 172.21.15.55:0/2402358819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07c40b11c0 0x7f07c40ce600 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009e50 tx=0x7f07bc01ca10 comp rx=0 tx=0).stop 2023-08-25T04:03:47.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.323+0000 7f07cbb03640 1 -- 172.21.15.55:0/2402358819 shutdown_connections 2023-08-25T04:03:47.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.323+0000 7f07cbb03640 1 --2- 172.21.15.55:0/2402358819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07c40b11c0 0x7f07c40ce600 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:47.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.323+0000 7f07cbb03640 1 -- 172.21.15.55:0/2402358819 >> 172.21.15.55:0/2402358819 conn(0x7f07c40b06a0 msgr2=0x7f07c40b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:47.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.323+0000 7f07cbb03640 1 -- 172.21.15.55:0/2402358819 shutdown_connections 2023-08-25T04:03:47.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.323+0000 7f07cbb03640 1 -- 172.21.15.55:0/2402358819 wait complete. 2023-08-25T04:03:47.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.323+0000 7f07cbb03640 1 Processor -- start 2023-08-25T04:03:47.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.323+0000 7f07cbb03640 1 -- start start 2023-08-25T04:03:47.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07cbb03640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07c406dc80 0x7f07c41f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:47.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07cbb03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07c40b11c0 0x7f07c409f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:47.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07cbb03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07c415cba0 0x7f07c409ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:47.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07cbb03640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c41f5630 con 0x7f07c415cba0 2023-08-25T04:03:47.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07cbb03640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40c5520 con 0x7f07c406dc80 2023-08-25T04:03:47.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07cbb03640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c40c3190 con 0x7f07c40b11c0 2023-08-25T04:03:47.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07ca0a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07c415cba0 0x7f07c409ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:47.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07ca0a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07c415cba0 0x7f07c409ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48488/0 (socket says 172.21.15.55:48488) 2023-08-25T04:03:47.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07ca0a0640 1 -- 172.21.15.55:0/363648990 learned_addr learned my addr 172.21.15.55:0/363648990 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:47.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07c909e640 1 --2- 172.21.15.55:0/363648990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07c40b11c0 0x7f07c409f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:47.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07c989f640 1 --2- 172.21.15.55:0/363648990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07c406dc80 0x7f07c41f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:47.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07ca0a0640 1 -- 172.21.15.55:0/363648990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07c40b11c0 msgr2=0x7f07c409f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:47.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07ca0a0640 1 --2- 172.21.15.55:0/363648990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07c40b11c0 0x7f07c409f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:47.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07ca0a0640 1 -- 172.21.15.55:0/363648990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07c406dc80 msgr2=0x7f07c41f50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:47.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07ca0a0640 1 --2- 172.21.15.55:0/363648990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07c406dc80 0x7f07c41f50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:47.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07ca0a0640 1 -- 172.21.15.55:0/363648990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc009b30 con 0x7f07c415cba0 2023-08-25T04:03:47.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07ca0a0640 1 --2- 172.21.15.55:0/363648990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07c415cba0 0x7f07c409ce10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0af040 tx=0x7f07bc0197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:47.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07ba7fc640 1 -- 172.21.15.55:0/363648990 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0b8880 con 0x7f07c415cba0 2023-08-25T04:03:47.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07ba7fc640 1 -- 172.21.15.55:0/363648990 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc0b8a00 con 0x7f07c415cba0 2023-08-25T04:03:47.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07ba7fc640 1 -- 172.21.15.55:0/363648990 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0b8db0 con 0x7f07c415cba0 2023-08-25T04:03:47.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07cbb03640 1 -- 172.21.15.55:0/363648990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c40c3470 con 0x7f07c415cba0 2023-08-25T04:03:47.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07cbb03640 1 -- 172.21.15.55:0/363648990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c40c3a30 con 0x7f07c415cba0 2023-08-25T04:03:47.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07cbb03640 1 -- 172.21.15.55:0/363648990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c40c3c20 con 0x7f07c415cba0 2023-08-25T04:03:47.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.327+0000 7f07ba7fc640 1 -- 172.21.15.55:0/363648990 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f07bc0c3460 con 0x7f07c415cba0 2023-08-25T04:03:47.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.331+0000 7f07ba7fc640 1 --2- 172.21.15.55:0/363648990 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f07a8065680 0x7f07a8067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:47.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.331+0000 7f07ba7fc640 1 -- 172.21.15.55:0/363648990 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f07bc11e5c0 con 0x7f07c415cba0 2023-08-25T04:03:47.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.331+0000 7f07c989f640 1 --2- 172.21.15.55:0/363648990 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f07a8065680 0x7f07a8067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:47.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.331+0000 7f07c989f640 1 --2- 172.21.15.55:0/363648990 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f07a8065680 0x7f07a8067b40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f07c0007fd0 tx=0x7f07c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:47.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.335+0000 7f07ba7fc640 1 -- 172.21.15.55:0/363648990 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f07bc0ebf70 con 0x7f07c415cba0 2023-08-25T04:03:47.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:47.523+0000 7f07cbb03640 1 -- 172.21.15.55:0/363648990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f07c4073ec0 con 0x7f07c415cba0 2023-08-25T04:03:48.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.147+0000 7f07ba7fc640 1 -- 172.21.15.55:0/363648990 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f07bc0ef590 con 0x7f07c415cba0 2023-08-25T04:03:48.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.147+0000 7f07cbb03640 1 -- 172.21.15.55:0/363648990 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f07a8065680 msgr2=0x7f07a8067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:48.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.147+0000 7f07cbb03640 1 --2- 172.21.15.55:0/363648990 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f07a8065680 0x7f07a8067b40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f07c0007fd0 tx=0x7f07c0009040 comp rx=0 tx=0).stop 2023-08-25T04:03:48.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.147+0000 7f07cbb03640 1 -- 172.21.15.55:0/363648990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07c415cba0 msgr2=0x7f07c409ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:48.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.147+0000 7f07cbb03640 1 --2- 172.21.15.55:0/363648990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07c415cba0 0x7f07c409ce10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0af040 tx=0x7f07bc0197b0 comp rx=0 tx=0).stop 2023-08-25T04:03:48.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.147+0000 7f07cbb03640 1 -- 172.21.15.55:0/363648990 shutdown_connections 2023-08-25T04:03:48.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.147+0000 7f07cbb03640 1 --2- 172.21.15.55:0/363648990 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f07a8065680 0x7f07a8067b40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:48.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.147+0000 7f07cbb03640 1 --2- 172.21.15.55:0/363648990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07c415cba0 0x7f07c409ce10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:48.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.147+0000 7f07cbb03640 1 --2- 172.21.15.55:0/363648990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07c40b11c0 0x7f07c409f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:48.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.147+0000 7f07cbb03640 1 --2- 172.21.15.55:0/363648990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07c406dc80 0x7f07c41f50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:48.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.147+0000 7f07cbb03640 1 -- 172.21.15.55:0/363648990 >> 172.21.15.55:0/363648990 conn(0x7f07c40b06a0 msgr2=0x7f07c40b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:48.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.147+0000 7f07cbb03640 1 -- 172.21.15.55:0/363648990 shutdown_connections 2023-08-25T04:03:48.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.147+0000 7f07cbb03640 1 -- 172.21.15.55:0/363648990 wait complete. 2023-08-25T04:03:48.171 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-25T04:03:48.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.359+0000 7fbbaf10a640 1 Processor -- start 2023-08-25T04:03:48.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.359+0000 7fbbaf10a640 1 -- start start 2023-08-25T04:03:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.363+0000 7fbbaf10a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbba80afa20 0x7fbba80b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.363+0000 7fbbaf10a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbba80cf9b0 0x7fbba80ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.363+0000 7fbbaf10a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbba80cd160 0x7fbba80cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.363+0000 7fbbaf10a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba80cdb30 con 0x7fbba80cf9b0 2023-08-25T04:03:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.363+0000 7fbbaf10a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba80cfe10 con 0x7fbba80afa20 2023-08-25T04:03:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.363+0000 7fbbaf10a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba80cae70 con 0x7fbba80cd160 2023-08-25T04:03:48.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.363+0000 7fbb9ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbba80cf9b0 0x7fbba80ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:48.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.363+0000 7fbb9ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbba80cf9b0 0x7fbba80ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48494/0 (socket says 172.21.15.55:48494) 2023-08-25T04:03:48.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.363+0000 7fbb9ffff640 1 -- 172.21.15.55:0/1401151218 learned_addr learned my addr 172.21.15.55:0/1401151218 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:48.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.363+0000 7fbbacea6640 1 --2- 172.21.15.55:0/1401151218 >> v2:172.21.15.110:3300/0 conn(0x7fbba80afa20 0x7fbba80b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:48.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.363+0000 7fbbad6a7640 1 --2- 172.21.15.55:0/1401151218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbba80cd160 0x7fbba80cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:48.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.363+0000 7fbb9ffff640 1 -- 172.21.15.55:0/1401151218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbba80cd160 msgr2=0x7fbba80cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:48.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.363+0000 7fbb9ffff640 1 --2- 172.21.15.55:0/1401151218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbba80cd160 0x7fbba80cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:48.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.363+0000 7fbb9ffff640 1 -- 172.21.15.55:0/1401151218 >> v2:172.21.15.110:3300/0 conn(0x7fbba80afa20 msgr2=0x7fbba80b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:48.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.363+0000 7fbb9ffff640 1 --2- 172.21.15.55:0/1401151218 >> v2:172.21.15.110:3300/0 conn(0x7fbba80afa20 0x7fbba80b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:48.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.363+0000 7fbb9ffff640 1 -- 172.21.15.55:0/1401151218 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba80cb0e0 con 0x7fbba80cf9b0 2023-08-25T04:03:48.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.367+0000 7fbb9ffff640 1 --2- 172.21.15.55:0/1401151218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba80cf9b0 0x7fbba80ce9c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbba80b32c0 tx=0x7fbb9801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef070bad3306ae53 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:48.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.367+0000 7fbb9f7fe640 1 -- 172.21.15.55:0/1401151218 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb980ab600 con 0x7fbba80cf9b0 2023-08-25T04:03:48.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.367+0000 7fbb9f7fe640 1 -- 172.21.15.55:0/1401151218 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb980ab760 con 0x7fbba80cf9b0 2023-08-25T04:03:48.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.367+0000 7fbb9f7fe640 1 -- 172.21.15.55:0/1401151218 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb980abaf0 con 0x7fbba80cf9b0 2023-08-25T04:03:48.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.367+0000 7fbbaf10a640 1 -- 172.21.15.55:0/1401151218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba80cf9b0 msgr2=0x7fbba80ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:48.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.367+0000 7fbbaf10a640 1 --2- 172.21.15.55:0/1401151218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba80cf9b0 0x7fbba80ce9c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbba80b32c0 tx=0x7fbb9801c440 comp rx=0 tx=0).stop 2023-08-25T04:03:48.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.367+0000 7fbbaf10a640 1 -- 172.21.15.55:0/1401151218 shutdown_connections 2023-08-25T04:03:48.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.367+0000 7fbbaf10a640 1 --2- 172.21.15.55:0/1401151218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbba80cd160 0x7fbba80cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:48.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.367+0000 7fbbaf10a640 1 --2- 172.21.15.55:0/1401151218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba80cf9b0 0x7fbba80ce9c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:48.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.367+0000 7fbbaf10a640 1 --2- 172.21.15.55:0/1401151218 >> v2:172.21.15.110:3300/0 conn(0x7fbba80afa20 0x7fbba80b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:48.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.367+0000 7fbbaf10a640 1 -- 172.21.15.55:0/1401151218 >> 172.21.15.55:0/1401151218 conn(0x7fbba80d0780 msgr2=0x7fbba80d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:48.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.367+0000 7fbbaf10a640 1 -- 172.21.15.55:0/1401151218 shutdown_connections 2023-08-25T04:03:48.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.367+0000 7fbbaf10a640 1 -- 172.21.15.55:0/1401151218 wait complete. 2023-08-25T04:03:48.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.367+0000 7fbbaf10a640 1 Processor -- start 2023-08-25T04:03:48.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.367+0000 7fbbaf10a640 1 -- start start 2023-08-25T04:03:48.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbbaf10a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbba80afa20 0x7fbba8148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:48.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbbaf10a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba80cd160 0x7fbba81545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:48.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbbaf10a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbba80cf9b0 0x7fbba8154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:48.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbbaf10a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba8151c70 con 0x7fbba80cd160 2023-08-25T04:03:48.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbbaf10a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba8151f10 con 0x7fbba80cf9b0 2023-08-25T04:03:48.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbbaf10a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba814e040 con 0x7fbba80afa20 2023-08-25T04:03:48.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbb9ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba80cd160 0x7fbba81545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:48.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbb9ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba80cd160 0x7fbba81545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48496/0 (socket says 172.21.15.55:48496) 2023-08-25T04:03:48.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbb9ffff640 1 -- 172.21.15.55:0/3694542349 learned_addr learned my addr 172.21.15.55:0/3694542349 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:48.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbbacea6640 1 --2- 172.21.15.55:0/3694542349 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbba80afa20 0x7fbba8148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:48.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbbad6a7640 1 --2- 172.21.15.55:0/3694542349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbba80cf9b0 0x7fbba8154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:48.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbb9ffff640 1 -- 172.21.15.55:0/3694542349 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbba80afa20 msgr2=0x7fbba8148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:48.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbb9ffff640 1 --2- 172.21.15.55:0/3694542349 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbba80afa20 0x7fbba8148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:48.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbb9ffff640 1 -- 172.21.15.55:0/3694542349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbba80cf9b0 msgr2=0x7fbba8154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:48.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbb9ffff640 1 --2- 172.21.15.55:0/3694542349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbba80cf9b0 0x7fbba8154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:48.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbb9ffff640 1 -- 172.21.15.55:0/3694542349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb980094d0 con 0x7fbba80cd160 2023-08-25T04:03:48.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbb9ffff640 1 --2- 172.21.15.55:0/3694542349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba80cd160 0x7fbba81545d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbb9801aaf0 tx=0x7fbb9801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:48.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbb9d7fa640 1 -- 172.21.15.55:0/3694542349 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb980b4800 con 0x7fbba80cd160 2023-08-25T04:03:48.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbb9d7fa640 1 -- 172.21.15.55:0/3694542349 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb980b4980 con 0x7fbba80cd160 2023-08-25T04:03:48.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbbaf10a640 1 -- 172.21.15.55:0/3694542349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba814e320 con 0x7fbba80cd160 2023-08-25T04:03:48.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbb9d7fa640 1 -- 172.21.15.55:0/3694542349 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb980b4d30 con 0x7fbba80cd160 2023-08-25T04:03:48.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbbaf10a640 1 -- 172.21.15.55:0/3694542349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba8148f80 con 0x7fbba80cd160 2023-08-25T04:03:48.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbbaf10a640 1 -- 172.21.15.55:0/3694542349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba814e510 con 0x7fbba80cd160 2023-08-25T04:03:48.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.371+0000 7fbb9d7fa640 1 -- 172.21.15.55:0/3694542349 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fbb980c7390 con 0x7fbba80cd160 2023-08-25T04:03:48.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.375+0000 7fbb9d7fa640 1 --2- 172.21.15.55:0/3694542349 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbb94065680 0x7fbb94067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:48.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.375+0000 7fbb9d7fa640 1 -- 172.21.15.55:0/3694542349 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6206+0+0 (secure 0 0 0) 0x7fbb9811d7f0 con 0x7fbba80cd160 2023-08-25T04:03:48.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.375+0000 7fbbacea6640 1 --2- 172.21.15.55:0/3694542349 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbb94065680 0x7fbb94067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:48.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.375+0000 7fbbacea6640 1 --2- 172.21.15.55:0/3694542349 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbb94065680 0x7fbb94067b40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbba40045f0 tx=0x7fbba4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:48.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.379+0000 7fbb9d7fa640 1 -- 172.21.15.55:0/3694542349 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbb980eb2d0 con 0x7fbba80cd160 2023-08-25T04:03:48.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:48.531+0000 7fbbaf10a640 1 -- 172.21.15.55:0/3694542349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbba80d0380 con 0x7fbba80cd160 2023-08-25T04:03:49.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.159+0000 7fbb9d7fa640 1 -- 172.21.15.55:0/3694542349 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbb980ee8f0 con 0x7fbba80cd160 2023-08-25T04:03:49.161 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-08-25T04:03:49.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.163+0000 7fbbaf10a640 1 -- 172.21.15.55:0/3694542349 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbb94065680 msgr2=0x7fbb94067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:49.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.163+0000 7fbbaf10a640 1 --2- 172.21.15.55:0/3694542349 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbb94065680 0x7fbb94067b40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbba40045f0 tx=0x7fbba4008040 comp rx=0 tx=0).stop 2023-08-25T04:03:49.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.163+0000 7fbbaf10a640 1 -- 172.21.15.55:0/3694542349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba80cd160 msgr2=0x7fbba81545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:49.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.163+0000 7fbbaf10a640 1 --2- 172.21.15.55:0/3694542349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba80cd160 0x7fbba81545d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbb9801aaf0 tx=0x7fbb9801ac80 comp rx=0 tx=0).stop 2023-08-25T04:03:49.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.163+0000 7fbbaf10a640 1 -- 172.21.15.55:0/3694542349 shutdown_connections 2023-08-25T04:03:49.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.163+0000 7fbbaf10a640 1 --2- 172.21.15.55:0/3694542349 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fbb94065680 0x7fbb94067b40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:49.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.163+0000 7fbbaf10a640 1 --2- 172.21.15.55:0/3694542349 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbba80cf9b0 0x7fbba8154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:49.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.163+0000 7fbbaf10a640 1 --2- 172.21.15.55:0/3694542349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba80cd160 0x7fbba81545d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:49.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.163+0000 7fbbaf10a640 1 --2- 172.21.15.55:0/3694542349 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbba80afa20 0x7fbba8148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:49.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.163+0000 7fbbaf10a640 1 -- 172.21.15.55:0/3694542349 >> 172.21.15.55:0/3694542349 conn(0x7fbba80d0780 msgr2=0x7fbba80d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:49.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.163+0000 7fbbaf10a640 1 -- 172.21.15.55:0/3694542349 shutdown_connections 2023-08-25T04:03:49.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.163+0000 7fbbaf10a640 1 -- 172.21.15.55:0/3694542349 wait complete. 2023-08-25T04:03:49.188 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-25T04:03:49.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.335+0000 7fcc57acb640 1 Processor -- start 2023-08-25T04:03:49.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.335+0000 7fcc57acb640 1 -- start start 2023-08-25T04:03:49.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.339+0000 7fcc57acb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc500cd870 0x7fcc500b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:49.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.339+0000 7fcc57acb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc500cf9b0 0x7fcc500ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:49.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.339+0000 7fcc57acb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc500cae70 con 0x7fcc500afa20 2023-08-25T04:03:49.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.339+0000 7fcc57acb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc500cfe10 con 0x7fcc500cf9b0 2023-08-25T04:03:49.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.339+0000 7fcc57acb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc500cb0e0 con 0x7fcc500cd870 2023-08-25T04:03:49.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.339+0000 7fcc56068640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc500cf9b0 0x7fcc500ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:49.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.339+0000 7fcc56068640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc500cf9b0 0x7fcc500ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48502/0 (socket says 172.21.15.55:48502) 2023-08-25T04:03:49.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.339+0000 7fcc56068640 1 -- 172.21.15.55:0/1483432865 learned_addr learned my addr 172.21.15.55:0/1483432865 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:49.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.339+0000 7fcc55066640 1 --2- 172.21.15.55:0/1483432865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc500cd870 0x7fcc500b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:49.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.339+0000 7fcc56068640 1 -- 172.21.15.55:0/1483432865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc500cd870 msgr2=0x7fcc500b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:49.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.339+0000 7fcc56068640 1 --2- 172.21.15.55:0/1483432865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc500cd870 0x7fcc500b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:49.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.339+0000 7fcc56068640 1 -- 172.21.15.55:0/1483432865 >> v1:172.21.15.110:6789/0 conn(0x7fcc500afa20 legacy=0x7fcc500cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:49.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.339+0000 7fcc56068640 1 -- 172.21.15.55:0/1483432865 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc500cb3c0 con 0x7fcc500cf9b0 2023-08-25T04:03:49.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.339+0000 7fcc56068640 1 --2- 172.21.15.55:0/1483432865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc500cf9b0 0x7fcc500ce9c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcc48009e50 tx=0x7fcc4801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be719e3b30f414f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.343+0000 7fcc54865640 1 -- 172.21.15.55:0/1483432865 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc480a5810 con 0x7fcc500cf9b0 2023-08-25T04:03:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.343+0000 7fcc54865640 1 -- 172.21.15.55:0/1483432865 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc480a5970 con 0x7fcc500cf9b0 2023-08-25T04:03:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.343+0000 7fcc54865640 1 -- 172.21.15.55:0/1483432865 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc480a5d00 con 0x7fcc500cf9b0 2023-08-25T04:03:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.343+0000 7fcc57acb640 1 -- 172.21.15.55:0/1483432865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc500cf9b0 msgr2=0x7fcc500ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.343+0000 7fcc57acb640 1 --2- 172.21.15.55:0/1483432865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc500cf9b0 0x7fcc500ce9c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcc48009e50 tx=0x7fcc4801c950 comp rx=0 tx=0).stop 2023-08-25T04:03:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.343+0000 7fcc57acb640 1 -- 172.21.15.55:0/1483432865 shutdown_connections 2023-08-25T04:03:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.343+0000 7fcc57acb640 1 --2- 172.21.15.55:0/1483432865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc500cf9b0 0x7fcc500ce9c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:49.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.343+0000 7fcc57acb640 1 --2- 172.21.15.55:0/1483432865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc500cd870 0x7fcc500b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:49.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.343+0000 7fcc57acb640 1 -- 172.21.15.55:0/1483432865 >> 172.21.15.55:0/1483432865 conn(0x7fcc500d0780 msgr2=0x7fcc500d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:49.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.343+0000 7fcc57acb640 1 -- 172.21.15.55:0/1483432865 shutdown_connections 2023-08-25T04:03:49.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.343+0000 7fcc57acb640 1 -- 172.21.15.55:0/1483432865 wait complete. 2023-08-25T04:03:49.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.343+0000 7fcc57acb640 1 Processor -- start 2023-08-25T04:03:49.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.343+0000 7fcc57acb640 1 -- start start 2023-08-25T04:03:49.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc57acb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc500afa20 0x7fcc501550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:49.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc57acb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc500cd870 0x7fcc5006f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:49.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc57acb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc500cf9b0 0x7fcc5014f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:49.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc57acb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5006ecb0 con 0x7fcc500cd870 2023-08-25T04:03:49.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc57acb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5006e0a0 con 0x7fcc500cf9b0 2023-08-25T04:03:49.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc57acb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5006e380 con 0x7fcc500afa20 2023-08-25T04:03:49.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc55066640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc500cd870 0x7fcc5006f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:49.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc55066640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc500cd870 0x7fcc5006f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48510/0 (socket says 172.21.15.55:48510) 2023-08-25T04:03:49.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc55066640 1 -- 172.21.15.55:0/814743055 learned_addr learned my addr 172.21.15.55:0/814743055 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:49.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc55867640 1 --2- 172.21.15.55:0/814743055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc500afa20 0x7fcc501550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:49.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc56068640 1 --2- 172.21.15.55:0/814743055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc500cf9b0 0x7fcc5014f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:49.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc55066640 1 -- 172.21.15.55:0/814743055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc500afa20 msgr2=0x7fcc501550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:49.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc55066640 1 --2- 172.21.15.55:0/814743055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc500afa20 0x7fcc501550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:49.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc55066640 1 -- 172.21.15.55:0/814743055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc500cf9b0 msgr2=0x7fcc5014f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:49.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc55066640 1 --2- 172.21.15.55:0/814743055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc500cf9b0 0x7fcc5014f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:49.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc55066640 1 -- 172.21.15.55:0/814743055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc48009b30 con 0x7fcc500cd870 2023-08-25T04:03:49.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc55066640 1 --2- 172.21.15.55:0/814743055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc500cd870 0x7fcc5006f140 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000d800 tx=0x7fcc4000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:49.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc467fc640 1 -- 172.21.15.55:0/814743055 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000b6c0 con 0x7fcc500cd870 2023-08-25T04:03:49.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc467fc640 1 -- 172.21.15.55:0/814743055 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4000b820 con 0x7fcc500cd870 2023-08-25T04:03:49.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc57acb640 1 -- 172.21.15.55:0/814743055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5006e660 con 0x7fcc500cd870 2023-08-25T04:03:49.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc467fc640 1 -- 172.21.15.55:0/814743055 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000bb90 con 0x7fcc500cd870 2023-08-25T04:03:49.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc57acb640 1 -- 172.21.15.55:0/814743055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc50152de0 con 0x7fcc500cd870 2023-08-25T04:03:49.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.347+0000 7fcc57acb640 1 -- 172.21.15.55:0/814743055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5004dbe0 con 0x7fcc500cd870 2023-08-25T04:03:49.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.351+0000 7fcc467fc640 1 -- 172.21.15.55:0/814743055 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fcc4000bcf0 con 0x7fcc500cd870 2023-08-25T04:03:49.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.351+0000 7fcc467fc640 1 --2- 172.21.15.55:0/814743055 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcc34065680 0x7fcc34067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:49.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.351+0000 7fcc467fc640 1 -- 172.21.15.55:0/814743055 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5768+0+0 (secure 0 0 0) 0x7fcc400831d0 con 0x7fcc500cd870 2023-08-25T04:03:49.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.351+0000 7fcc55867640 1 --2- 172.21.15.55:0/814743055 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcc34065680 0x7fcc34067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:49.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.351+0000 7fcc55867640 1 --2- 172.21.15.55:0/814743055 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcc34065680 0x7fcc34067b40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c007fd0 tx=0x7fcc4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:49.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.355+0000 7fcc467fc640 1 -- 172.21.15.55:0/814743055 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fcc40054840 con 0x7fcc500cd870 2023-08-25T04:03:49.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:49.519+0000 7fcc57acb640 1 -- 172.21.15.55:0/814743055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcc5006b130 con 0x7fcc500cd870 2023-08-25T04:03:50.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.167+0000 7fcc467fc640 1 -- 172.21.15.55:0/814743055 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcc400543d0 con 0x7fcc500cd870 2023-08-25T04:03:50.168 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-08-25T04:03:50.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.171+0000 7fcc57acb640 1 -- 172.21.15.55:0/814743055 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcc34065680 msgr2=0x7fcc34067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:50.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.171+0000 7fcc57acb640 1 --2- 172.21.15.55:0/814743055 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcc34065680 0x7fcc34067b40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c007fd0 tx=0x7fcc4c009040 comp rx=0 tx=0).stop 2023-08-25T04:03:50.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.171+0000 7fcc57acb640 1 -- 172.21.15.55:0/814743055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc500cd870 msgr2=0x7fcc5006f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:50.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.171+0000 7fcc57acb640 1 --2- 172.21.15.55:0/814743055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc500cd870 0x7fcc5006f140 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000d800 tx=0x7fcc4000dcc0 comp rx=0 tx=0).stop 2023-08-25T04:03:50.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.171+0000 7fcc57acb640 1 -- 172.21.15.55:0/814743055 shutdown_connections 2023-08-25T04:03:50.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.171+0000 7fcc57acb640 1 --2- 172.21.15.55:0/814743055 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcc34065680 0x7fcc34067b40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:50.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.171+0000 7fcc57acb640 1 --2- 172.21.15.55:0/814743055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc500cf9b0 0x7fcc5014f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:50.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.171+0000 7fcc57acb640 1 --2- 172.21.15.55:0/814743055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc500cd870 0x7fcc5006f140 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:50.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.171+0000 7fcc57acb640 1 --2- 172.21.15.55:0/814743055 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc500afa20 0x7fcc501550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:50.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.171+0000 7fcc57acb640 1 -- 172.21.15.55:0/814743055 >> 172.21.15.55:0/814743055 conn(0x7fcc500d0780 msgr2=0x7fcc500d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:50.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.171+0000 7fcc57acb640 1 -- 172.21.15.55:0/814743055 shutdown_connections 2023-08-25T04:03:50.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.171+0000 7fcc57acb640 1 -- 172.21.15.55:0/814743055 wait complete. 2023-08-25T04:03:50.198 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-25T04:03:50.198 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-25T04:03:50.198 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-25T04:03:50.199 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:03:50.199 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-25T04:03:50.199 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-25T04:03:50.200 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-25T04:03:50.200 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:03:50.200 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-25T04:03:50.200 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-25T04:03:50.200 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-25T04:03:50.201 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:03:50.201 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-25T04:03:50.201 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-25T04:03:50.201 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-25T04:03:50.202 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:03:50.216 INFO:tasks.ceph.mds.b:Stopped 2023-08-25T04:03:50.216 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-25T04:03:50.219 INFO:tasks.ceph.mds.d:Stopped 2023-08-25T04:03:50.219 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-25T04:03:50.220 INFO:tasks.ceph.mds.c:Stopped 2023-08-25T04:03:50.221 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-25T04:03:50.221 INFO:tasks.ceph.mds.a:Stopped 2023-08-25T04:03:50.222 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-25T04:03:50.266 INFO:tasks.ceph.mds.b:Started 2023-08-25T04:03:50.267 DEBUG:teuthology.parallel:result is None 2023-08-25T04:03:50.268 INFO:tasks.ceph.mds.c:Started 2023-08-25T04:03:50.268 INFO:tasks.ceph.mds.d:Started 2023-08-25T04:03:50.269 DEBUG:teuthology.parallel:result is None 2023-08-25T04:03:50.269 DEBUG:teuthology.parallel:result is None 2023-08-25T04:03:50.270 INFO:tasks.ceph.mds.a:Started 2023-08-25T04:03:50.271 DEBUG:teuthology.parallel:result is None 2023-08-25T04:03:50.272 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-25T04:03:50.353 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2023-08-25T04:03:50.354 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2023-08-25T04:03:50.358 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-08-25T04:03:50.359 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T04:03:50.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.423+0000 7faeeac19640 1 Processor -- start 2023-08-25T04:03:50.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.423+0000 7faeeac19640 1 -- start start 2023-08-25T04:03:50.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.423+0000 7faeeac19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faee40d0da0 0x7faee40d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:50.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.423+0000 7faeeac19640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faee40b3e50 0x7faee40ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:50.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.423+0000 7faeeac19640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee40b29b0 con 0x7faee40cdde0 2023-08-25T04:03:50.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.423+0000 7faeeac19640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee40ce760 con 0x7faee40b3e50 2023-08-25T04:03:50.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.423+0000 7faeeac19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee40d16c0 con 0x7faee40d0da0 2023-08-25T04:03:50.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.423+0000 7faee3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faee40cdde0 0x7faee40cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49444/0 (socket says 172.21.15.55:49444) 2023-08-25T04:03:50.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.423+0000 7faee3fff640 1 -- 172.21.15.55:0/2572450757 learned_addr learned my addr 172.21.15.55:0/2572450757 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:50.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.423+0000 7faee91b6640 1 --2- 172.21.15.55:0/2572450757 >> v2:172.21.15.110:3300/0 conn(0x7faee40b3e50 0x7faee40ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:50.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.423+0000 7faee89b5640 1 --2- 172.21.15.55:0/2572450757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faee40d0da0 0x7faee40d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:50.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.427+0000 7faee37fe640 1 -- 172.21.15.55:0/2572450757 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961410762 0 0) 0x7faee40b29b0 con 0x7faee40cdde0 2023-08-25T04:03:50.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.427+0000 7faee91b6640 1 -- 172.21.15.55:0/2572450757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faee40d0da0 msgr2=0x7faee40d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:50.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.427+0000 7faee91b6640 1 --2- 172.21.15.55:0/2572450757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faee40d0da0 0x7faee40d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:50.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.427+0000 7faee91b6640 1 -- 172.21.15.55:0/2572450757 >> v1:172.21.15.55:6789/0 conn(0x7faee40cdde0 legacy=0x7faee40cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:50.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.427+0000 7faee91b6640 1 -- 172.21.15.55:0/2572450757 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee40b1dc0 con 0x7faee40b3e50 2023-08-25T04:03:50.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.427+0000 7faee91b6640 1 --2- 172.21.15.55:0/2572450757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faee40b3e50 0x7faee40ce220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faedc009d90 tx=0x7faedc01f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75aedfde011d1121 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:50.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.427+0000 7faee37fe640 1 -- 172.21.15.55:0/2572450757 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc0af600 con 0x7faee40b3e50 2023-08-25T04:03:50.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.427+0000 7faee37fe640 1 -- 172.21.15.55:0/2572450757 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc0ab050 con 0x7faee40b3e50 2023-08-25T04:03:50.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.427+0000 7faee37fe640 1 -- 172.21.15.55:0/2572450757 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc0af980 con 0x7faee40b3e50 2023-08-25T04:03:50.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.427+0000 7faeeac19640 1 -- 172.21.15.55:0/2572450757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faee40b3e50 msgr2=0x7faee40ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:50.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.427+0000 7faeeac19640 1 --2- 172.21.15.55:0/2572450757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faee40b3e50 0x7faee40ce220 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faedc009d90 tx=0x7faedc01f130 comp rx=0 tx=0).stop 2023-08-25T04:03:50.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.427+0000 7faeeac19640 1 -- 172.21.15.55:0/2572450757 shutdown_connections 2023-08-25T04:03:50.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faeeac19640 1 --2- 172.21.15.55:0/2572450757 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faee40b3e50 0x7faee40ce220 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:50.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faeeac19640 1 --2- 172.21.15.55:0/2572450757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faee40d0da0 0x7faee40d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:50.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faeeac19640 1 -- 172.21.15.55:0/2572450757 >> 172.21.15.55:0/2572450757 conn(0x7faee409bae0 msgr2=0x7faee40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:50.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faeeac19640 1 -- 172.21.15.55:0/2572450757 shutdown_connections 2023-08-25T04:03:50.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faeeac19640 1 -- 172.21.15.55:0/2572450757 wait complete. 2023-08-25T04:03:50.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faeeac19640 1 Processor -- start 2023-08-25T04:03:50.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faeeac19640 1 -- start start 2023-08-25T04:03:50.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faeeac19640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faee40b3e50 0x7faee40cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:50.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faeeac19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee40cdde0 0x7faee41517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:50.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faeeac19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faee40d0da0 0x7faee4151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:50.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faeeac19640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee41f5230 con 0x7faee40cdde0 2023-08-25T04:03:50.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faeeac19640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee40ca270 con 0x7faee40b3e50 2023-08-25T04:03:50.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faeeac19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee40cb2b0 con 0x7faee40d0da0 2023-08-25T04:03:50.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faee3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee40cdde0 0x7faee41517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:50.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faee89b5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faee40b3e50 0x7faee40cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:50.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faee3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee40cdde0 0x7faee41517f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48554/0 (socket says 172.21.15.55:48554) 2023-08-25T04:03:50.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faee3fff640 1 -- 172.21.15.55:0/1160092568 learned_addr learned my addr 172.21.15.55:0/1160092568 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:50.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faee91b6640 1 --2- 172.21.15.55:0/1160092568 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faee40d0da0 0x7faee4151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:50.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faee3fff640 1 -- 172.21.15.55:0/1160092568 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faee40d0da0 msgr2=0x7faee4151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:50.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faee3fff640 1 --2- 172.21.15.55:0/1160092568 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faee40d0da0 0x7faee4151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:50.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faee3fff640 1 -- 172.21.15.55:0/1160092568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faee40b3e50 msgr2=0x7faee40cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:50.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faee3fff640 1 --2- 172.21.15.55:0/1160092568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faee40b3e50 0x7faee40cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:50.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faee3fff640 1 -- 172.21.15.55:0/1160092568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc009a70 con 0x7faee40cdde0 2023-08-25T04:03:50.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.431+0000 7faee89b5640 1 --2- 172.21.15.55:0/1160092568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faee40b3e50 0x7faee40cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:50.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.435+0000 7faee3fff640 1 --2- 172.21.15.55:0/1160092568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee40cdde0 0x7faee41517f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faed00011f0 tx=0x7faed000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:50.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.435+0000 7faee17fa640 1 -- 172.21.15.55:0/1160092568 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed00074e0 con 0x7faee40cdde0 2023-08-25T04:03:50.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.435+0000 7faee17fa640 1 -- 172.21.15.55:0/1160092568 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed0007640 con 0x7faee40cdde0 2023-08-25T04:03:50.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.435+0000 7faee17fa640 1 -- 172.21.15.55:0/1160092568 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed0004a10 con 0x7faee40cdde0 2023-08-25T04:03:50.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.435+0000 7faeeac19640 1 -- 172.21.15.55:0/1160092568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee40c70e0 con 0x7faee40cdde0 2023-08-25T04:03:50.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.435+0000 7faeeac19640 1 -- 172.21.15.55:0/1160092568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee40ca7d0 con 0x7faee40cdde0 2023-08-25T04:03:50.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.435+0000 7faeeac19640 1 -- 172.21.15.55:0/1160092568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee404dbe0 con 0x7faee40cdde0 2023-08-25T04:03:50.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.435+0000 7faee17fa640 1 -- 172.21.15.55:0/1160092568 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7faed0004b70 con 0x7faee40cdde0 2023-08-25T04:03:50.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.439+0000 7faee17fa640 1 --2- 172.21.15.55:0/1160092568 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7faec8065680 0x7faec8067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:50.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.439+0000 7faee17fa640 1 -- 172.21.15.55:0/1160092568 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5296+0+0 (secure 0 0 0) 0x7faed0081be0 con 0x7faee40cdde0 2023-08-25T04:03:50.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.439+0000 7faee89b5640 1 --2- 172.21.15.55:0/1160092568 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7faec8065680 0x7faec8067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:50.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.439+0000 7faee89b5640 1 --2- 172.21.15.55:0/1160092568 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7faec8065680 0x7faec8067b40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faee40cbb70 tx=0x7faed8006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:50.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.443+0000 7faee17fa640 1 -- 172.21.15.55:0/1160092568 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7faed004fae0 con 0x7faee40cdde0 2023-08-25T04:03:50.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:50.639+0000 7faeeac19640 1 -- 172.21.15.55:0/1160092568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7faee40d0b80 con 0x7faee40cdde0 2023-08-25T04:03:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.195+0000 7faee17fa640 1 -- 172.21.15.55:0/1160092568 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) v1 ==== 97+0+0 (secure 0 0 0) 0x7faed0018080 con 0x7faee40cdde0 2023-08-25T04:03:52.199 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-08-25T04:03:52.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.199+0000 7faeeac19640 1 -- 172.21.15.55:0/1160092568 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7faec8065680 msgr2=0x7faec8067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:52.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.199+0000 7faeeac19640 1 --2- 172.21.15.55:0/1160092568 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7faec8065680 0x7faec8067b40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faee40cbb70 tx=0x7faed8006f90 comp rx=0 tx=0).stop 2023-08-25T04:03:52.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.199+0000 7faeeac19640 1 -- 172.21.15.55:0/1160092568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee40cdde0 msgr2=0x7faee41517f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:52.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.199+0000 7faeeac19640 1 --2- 172.21.15.55:0/1160092568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee40cdde0 0x7faee41517f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faed00011f0 tx=0x7faed000c9b0 comp rx=0 tx=0).stop 2023-08-25T04:03:52.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.199+0000 7faeeac19640 1 -- 172.21.15.55:0/1160092568 shutdown_connections 2023-08-25T04:03:52.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.199+0000 7faeeac19640 1 --2- 172.21.15.55:0/1160092568 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7faec8065680 0x7faec8067b40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:52.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.199+0000 7faeeac19640 1 --2- 172.21.15.55:0/1160092568 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faee40d0da0 0x7faee4151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:52.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.199+0000 7faeeac19640 1 --2- 172.21.15.55:0/1160092568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faee40cdde0 0x7faee41517f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:52.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.199+0000 7faeeac19640 1 --2- 172.21.15.55:0/1160092568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faee40b3e50 0x7faee40cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:52.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.199+0000 7faeeac19640 1 -- 172.21.15.55:0/1160092568 >> 172.21.15.55:0/1160092568 conn(0x7faee409bae0 msgr2=0x7faee40cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:52.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.199+0000 7faeeac19640 1 -- 172.21.15.55:0/1160092568 shutdown_connections 2023-08-25T04:03:52.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.199+0000 7faeeac19640 1 -- 172.21.15.55:0/1160092568 wait complete. 2023-08-25T04:03:52.224 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-25T04:03:52.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.371+0000 7fc436540640 1 Processor -- start 2023-08-25T04:03:52.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.371+0000 7fc436540640 1 -- start start 2023-08-25T04:03:52.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.371+0000 7fc436540640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc43015eba0 0x7fc4300b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:52.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.371+0000 7fc436540640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4300ac3a0 con 0x7fc43015ef80 2023-08-25T04:03:52.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.371+0000 7fc436540640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4300b1390 con 0x7fc4300ceeb0 2023-08-25T04:03:52.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.371+0000 7fc436540640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4300b1670 con 0x7fc43015eba0 2023-08-25T04:03:52.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.371+0000 7fc42f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc43015ef80 0x7fc4300ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48732/0 (socket says 172.21.15.55:48732) 2023-08-25T04:03:52.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.371+0000 7fc42f7fe640 1 -- 172.21.15.55:0/2437143811 learned_addr learned my addr 172.21.15.55:0/2437143811 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:52.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.371+0000 7fc42ffff640 1 --2- 172.21.15.55:0/2437143811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc43015eba0 0x7fc4300b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:52.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.371+0000 7fc42effd640 1 -- 172.21.15.55:0/2437143811 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624627649 0 0) 0x7fc4300ac3a0 con 0x7fc43015ef80 2023-08-25T04:03:52.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.371+0000 7fc42effd640 1 -- 172.21.15.55:0/2437143811 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc418003530 con 0x7fc43015ef80 2023-08-25T04:03:52.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.371+0000 7fc42effd640 1 -- 172.21.15.55:0/2437143811 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566972576 0 0) 0x7fc4300b1390 con 0x7fc4300ceeb0 2023-08-25T04:03:52.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.371+0000 7fc42effd640 1 -- 172.21.15.55:0/2437143811 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4300ac3a0 con 0x7fc4300ceeb0 2023-08-25T04:03:52.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.371+0000 7fc42ffff640 1 -- 172.21.15.55:0/2437143811 >> v1:172.21.15.110:6789/0 conn(0x7fc4300ceeb0 legacy=0x7fc4300ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:52.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.371+0000 7fc42ffff640 1 -- 172.21.15.55:0/2437143811 >> v1:172.21.15.55:6789/0 conn(0x7fc43015ef80 legacy=0x7fc4300ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:52.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.371+0000 7fc42ffff640 1 -- 172.21.15.55:0/2437143811 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4300b1950 con 0x7fc43015eba0 2023-08-25T04:03:52.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.375+0000 7fc42ffff640 1 --2- 172.21.15.55:0/2437143811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc43015eba0 0x7fc4300b2a40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc4200097f0 tx=0x7fc42001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78def42a0765d65e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.375+0000 7fc42effd640 1 -- 172.21.15.55:0/2437143811 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4200aa5f0 con 0x7fc43015eba0 2023-08-25T04:03:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.375+0000 7fc42effd640 1 -- 172.21.15.55:0/2437143811 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4200aa750 con 0x7fc43015eba0 2023-08-25T04:03:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.375+0000 7fc42effd640 1 -- 172.21.15.55:0/2437143811 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4200aaae0 con 0x7fc43015eba0 2023-08-25T04:03:52.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.375+0000 7fc436540640 1 -- 172.21.15.55:0/2437143811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc43015eba0 msgr2=0x7fc4300b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:52.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.375+0000 7fc436540640 1 --2- 172.21.15.55:0/2437143811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc43015eba0 0x7fc4300b2a40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc4200097f0 tx=0x7fc42001c490 comp rx=0 tx=0).stop 2023-08-25T04:03:52.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.375+0000 7fc436540640 1 -- 172.21.15.55:0/2437143811 shutdown_connections 2023-08-25T04:03:52.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.375+0000 7fc436540640 1 --2- 172.21.15.55:0/2437143811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc43015eba0 0x7fc4300b2a40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:52.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.375+0000 7fc436540640 1 -- 172.21.15.55:0/2437143811 >> 172.21.15.55:0/2437143811 conn(0x7fc430069d00 msgr2=0x7fc43006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:52.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.375+0000 7fc436540640 1 -- 172.21.15.55:0/2437143811 shutdown_connections 2023-08-25T04:03:52.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.375+0000 7fc436540640 1 -- 172.21.15.55:0/2437143811 wait complete. 2023-08-25T04:03:52.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc436540640 1 Processor -- start 2023-08-25T04:03:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc436540640 1 -- start start 2023-08-25T04:03:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc436540640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4300ceeb0 0x7fc430153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc436540640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc43015eba0 0x7fc4301657d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc436540640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc43015ef80 0x7fc430165d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc436540640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc430166300 con 0x7fc43015eba0 2023-08-25T04:03:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc436540640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4301641d0 con 0x7fc43015ef80 2023-08-25T04:03:52.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc436540640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4301638a0 con 0x7fc4300ceeb0 2023-08-25T04:03:52.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc42f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc43015eba0 0x7fc4301657d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:52.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc42f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc43015eba0 0x7fc4301657d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55524/0 (socket says 172.21.15.55:55524) 2023-08-25T04:03:52.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc42f7fe640 1 -- 172.21.15.55:0/4273992706 learned_addr learned my addr 172.21.15.55:0/4273992706 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:52.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc42ffff640 1 --2- 172.21.15.55:0/4273992706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4300ceeb0 0x7fc430153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:52.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc434add640 1 --2- 172.21.15.55:0/4273992706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc43015ef80 0x7fc430165d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:52.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc42f7fe640 1 -- 172.21.15.55:0/4273992706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4300ceeb0 msgr2=0x7fc430153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc42f7fe640 1 --2- 172.21.15.55:0/4273992706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4300ceeb0 0x7fc430153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc42f7fe640 1 -- 172.21.15.55:0/4273992706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc43015ef80 msgr2=0x7fc430165d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc42f7fe640 1 --2- 172.21.15.55:0/4273992706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc43015ef80 0x7fc430165d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc42f7fe640 1 -- 172.21.15.55:0/4273992706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc420009420 con 0x7fc43015eba0 2023-08-25T04:03:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc42f7fe640 1 --2- 172.21.15.55:0/4273992706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc43015eba0 0x7fc4301657d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc42400c4d0 tx=0x7fc42400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc42cff9640 1 -- 172.21.15.55:0/4273992706 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424005cf0 con 0x7fc43015eba0 2023-08-25T04:03:52.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.379+0000 7fc42cff9640 1 -- 172.21.15.55:0/4273992706 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc424005e50 con 0x7fc43015eba0 2023-08-25T04:03:52.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.383+0000 7fc42cff9640 1 -- 172.21.15.55:0/4273992706 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4240072b0 con 0x7fc43015eba0 2023-08-25T04:03:52.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.383+0000 7fc436540640 1 -- 172.21.15.55:0/4273992706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc430163b80 con 0x7fc43015eba0 2023-08-25T04:03:52.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.383+0000 7fc436540640 1 -- 172.21.15.55:0/4273992706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc430154420 con 0x7fc43015eba0 2023-08-25T04:03:52.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.383+0000 7fc436540640 1 -- 172.21.15.55:0/4273992706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43004dbe0 con 0x7fc43015eba0 2023-08-25T04:03:52.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.383+0000 7fc42cff9640 1 -- 172.21.15.55:0/4273992706 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc424007410 con 0x7fc43015eba0 2023-08-25T04:03:52.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.383+0000 7fc42cff9640 1 --2- 172.21.15.55:0/4273992706 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc41c0656b0 0x7fc41c067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:52.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.383+0000 7fc42cff9640 1 -- 172.21.15.55:0/4273992706 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc424082020 con 0x7fc43015eba0 2023-08-25T04:03:52.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.383+0000 7fc42ffff640 1 --2- 172.21.15.55:0/4273992706 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc41c0656b0 0x7fc41c067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:52.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.387+0000 7fc42ffff640 1 --2- 172.21.15.55:0/4273992706 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc41c0656b0 0x7fc41c067b70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc4200ae000 tx=0x7fc4200a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:52.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.387+0000 7fc42cff9640 1 -- 172.21.15.55:0/4273992706 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc42404fed0 con 0x7fc43015eba0 2023-08-25T04:03:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.595+0000 7fc436540640 1 -- 172.21.15.55:0/4273992706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc4300ab3a0 con 0x7fc43015eba0 2023-08-25T04:03:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.595+0000 7fc42cff9640 1 -- 172.21.15.55:0/4273992706 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fc424017090 con 0x7fc43015eba0 2023-08-25T04:03:52.598 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:52.598 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T04:03:52.600 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-08-25T04:03:52.600 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.600 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-08-25T04:03:52.601 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkgFrTEBAAoan9rk8Q+qPyMjb2vGUHhA==", 2023-08-25T04:03:52.601 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.601 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:03:52.602 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:03:52.602 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:03:52.602 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:03:52.602 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.602 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.603 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.603 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-08-25T04:03:52.603 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk18hNHRAAzXuhzQEONXRzRXTeCH9fKQ==", 2023-08-25T04:03:52.603 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.603 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:03:52.603 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:03:52.604 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:03:52.604 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:03:52.604 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.604 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.605 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.605 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-08-25T04:03:52.605 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkLF9CGBAAqxgRU/02SsZfWuZPSYxuZA==", 2023-08-25T04:03:52.605 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.606 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:03:52.606 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:03:52.608 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:03:52.608 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:03:52.608 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.608 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.608 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.608 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-08-25T04:03:52.609 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hky6HiJBAAsrXlTDn2cxbk7PnqSgNNkA==", 2023-08-25T04:03:52.609 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.609 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:03:52.609 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:03:52.609 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:03:52.609 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:03:52.609 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.610 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.610 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.610 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-08-25T04:03:52.610 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC+J+hkY1tDFBAAVQY5Xl8On9pN3jLWwKWGTA==", 2023-08-25T04:03:52.610 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.610 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:03:52.610 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:03:52.610 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:03:52.611 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.611 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.611 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.611 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-08-25T04:03:52.611 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDBJ+hkpdBCHRAADyMAxTsnQfkD9G0p48H4zQ==", 2023-08-25T04:03:52.611 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.611 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:03:52.612 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:03:52.612 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:03:52.612 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.612 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.612 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.612 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-08-25T04:03:52.612 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDEJ+hkOR49KRAAudbqAxLItsoczide8ybzAg==", 2023-08-25T04:03:52.612 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.613 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:03:52.613 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:03:52.613 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:03:52.613 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.613 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.613 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.613 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-08-25T04:03:52.614 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDHJ+hkxun5MBAAAhGtJYVeL3ogL3TQV67diw==", 2023-08-25T04:03:52.614 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.614 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:03:52.614 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:03:52.614 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:03:52.614 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.614 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.614 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.615 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-08-25T04:03:52.615 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDMJ+hkuosTCRAAqCuwHFZFBVR/7nFtHHByNg==", 2023-08-25T04:03:52.615 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.615 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:03:52.615 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:03:52.615 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:03:52.615 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.616 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.616 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.616 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-08-25T04:03:52.616 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDPJ+hkJa+SDhAAllo6biVE99BZWvv5K/gXGw==", 2023-08-25T04:03:52.616 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.616 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:03:52.616 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:03:52.616 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:03:52.617 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.617 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.617 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.617 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-08-25T04:03:52.617 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDSJ+hkUPywFBAA4jua1Eu1nRl2L6hX/mycfw==", 2023-08-25T04:03:52.617 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.617 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:03:52.618 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:03:52.618 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:03:52.618 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.618 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.618 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.618 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-08-25T04:03:52.618 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDVJ+hkhyDMGxAAmcSWLzJqIE5w5H/E4wIurQ==", 2023-08-25T04:03:52.618 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.619 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:03:52.619 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:03:52.619 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:03:52.619 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.619 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.619 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.619 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-08-25T04:03:52.619 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g==", 2023-08-25T04:03:52.620 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.620 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:03:52.620 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:03:52.620 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:03:52.620 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:03:52.620 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.620 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.621 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.621 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-08-25T04:03:52.621 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk8KsDMxAAKyK4jMKflYNnJXYIbr2OBQ==", 2023-08-25T04:03:52.621 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.621 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:03:52.621 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:03:52.621 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:03:52.621 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:03:52.622 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.622 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.622 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.622 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-08-25T04:03:52.622 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjSA4LxAAxzbnHeV85qYZYhSqTOT2rw==", 2023-08-25T04:03:52.622 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.622 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:03:52.622 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:03:52.623 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:03:52.623 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:03:52.623 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.623 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.623 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.623 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-08-25T04:03:52.623 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkl9AoORAARYZcPObsM/HT/yrTmneZrw==", 2023-08-25T04:03:52.623 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.624 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:03:52.624 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:03:52.624 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:03:52.624 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:03:52.624 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.624 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.624 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.625 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-08-25T04:03:52.625 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC2J+hkgTdcLxAAqxSepXXhEultFAFYBBKSag==", 2023-08-25T04:03:52.625 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.625 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:03:52.625 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:03:52.625 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:03:52.625 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:03:52.626 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.626 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.626 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.626 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-mds", 2023-08-25T04:03:52.626 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDbJ+hkhZoqIRAA20ggdCTGbxB8TM0cwjbplw==", 2023-08-25T04:03:52.626 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.626 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-mds" 2023-08-25T04:03:52.626 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.627 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.627 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.627 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-mgr", 2023-08-25T04:03:52.627 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDbJ+hkAaYqIRAACpqjhXqz9lLfTAgSOfdEcA==", 2023-08-25T04:03:52.627 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.627 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-mgr" 2023-08-25T04:03:52.627 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.627 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.628 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.628 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-osd", 2023-08-25T04:03:52.628 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDbJ+hkk64qIRAA84Ai4q4SzIND99Fuz0awDw==", 2023-08-25T04:03:52.628 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.628 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-osd" 2023-08-25T04:03:52.628 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.628 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.628 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.629 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rbd", 2023-08-25T04:03:52.629 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDbJ+hk2rYqIRAA5K5XpXVDyV4MRAfKXvY3TA==", 2023-08-25T04:03:52.629 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.629 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rbd" 2023-08-25T04:03:52.629 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.629 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.629 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.630 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-08-25T04:03:52.630 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDbJ+hkPb8qIRAAir5nYtP6DZJvZKO166R76A==", 2023-08-25T04:03:52.630 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.630 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-08-25T04:03:52.630 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.630 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.630 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.630 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rgw", 2023-08-25T04:03:52.631 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDbJ+hk6scqIRAA0ptxOrT+DPgi1RyMhQco6g==", 2023-08-25T04:03:52.631 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.631 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rgw" 2023-08-25T04:03:52.631 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.631 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.631 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.631 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-08-25T04:03:52.631 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkYGUZDBAAiuDo9hqavWq7zQlGd6x4YQ==", 2023-08-25T04:03:52.632 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.632 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:03:52.632 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T04:03:52.632 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:03:52.632 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.632 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:52.632 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:52.633 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-08-25T04:03:52.633 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjr9KCBAApSqjtFhLnjHduMBu/eaaKw==", 2023-08-25T04:03:52.633 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:03:52.633 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:03:52.633 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T04:03:52.633 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:03:52.633 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.633 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:52.634 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-08-25T04:03:52.634 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T04:03:52.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.595+0000 7fc436540640 1 -- 172.21.15.55:0/4273992706 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc41c0656b0 msgr2=0x7fc41c067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:52.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.595+0000 7fc436540640 1 --2- 172.21.15.55:0/4273992706 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc41c0656b0 0x7fc41c067b70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc4200ae000 tx=0x7fc4200a7000 comp rx=0 tx=0).stop 2023-08-25T04:03:52.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.595+0000 7fc436540640 1 -- 172.21.15.55:0/4273992706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc43015eba0 msgr2=0x7fc4301657d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:52.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.595+0000 7fc436540640 1 --2- 172.21.15.55:0/4273992706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc43015eba0 0x7fc4301657d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc42400c4d0 tx=0x7fc42400c990 comp rx=0 tx=0).stop 2023-08-25T04:03:52.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.595+0000 7fc436540640 1 -- 172.21.15.55:0/4273992706 shutdown_connections 2023-08-25T04:03:52.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.595+0000 7fc436540640 1 --2- 172.21.15.55:0/4273992706 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc41c0656b0 0x7fc41c067b70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:52.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.595+0000 7fc436540640 1 --2- 172.21.15.55:0/4273992706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc43015ef80 0x7fc430165d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:52.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.595+0000 7fc436540640 1 --2- 172.21.15.55:0/4273992706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc43015eba0 0x7fc4301657d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:52.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.595+0000 7fc436540640 1 --2- 172.21.15.55:0/4273992706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4300ceeb0 0x7fc430153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:52.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.595+0000 7fc436540640 1 -- 172.21.15.55:0/4273992706 >> 172.21.15.55:0/4273992706 conn(0x7fc430069d00 msgr2=0x7fc430155e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:52.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.599+0000 7fc436540640 1 -- 172.21.15.55:0/4273992706 shutdown_connections 2023-08-25T04:03:52.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.599+0000 7fc436540640 1 -- 172.21.15.55:0/4273992706 wait complete. 2023-08-25T04:03:52.637 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-08-25T04:03:52.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.779+0000 7f895351e640 1 Processor -- start 2023-08-25T04:03:52.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.779+0000 7f895351e640 1 -- start start 2023-08-25T04:03:52.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.783+0000 7f895351e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f894c0c1a80 0x7f894c0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:52.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.783+0000 7f895351e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f894c0cddf0 0x7f894c06bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:52.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.783+0000 7f895351e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894c0cc510 con 0x7f894c164410 2023-08-25T04:03:52.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.783+0000 7f895351e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894c1647f0 con 0x7f894c0c1a80 2023-08-25T04:03:52.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.783+0000 7f895351e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894c0cc9b0 con 0x7f894c0cddf0 2023-08-25T04:03:52.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.783+0000 7f8950ab9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f894c0c1a80 0x7f894c0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:52.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.783+0000 7f8950ab9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f894c0c1a80 0x7f894c0b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55540/0 (socket says 172.21.15.55:55540) 2023-08-25T04:03:52.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.783+0000 7f8950ab9640 1 -- 172.21.15.55:0/777416763 learned_addr learned my addr 172.21.15.55:0/777416763 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:52.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.783+0000 7f8951abb640 1 --2- 172.21.15.55:0/777416763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f894c0cddf0 0x7f894c06bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:52.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.783+0000 7f8950ab9640 1 -- 172.21.15.55:0/777416763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f894c0cddf0 msgr2=0x7f894c06bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:52.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.783+0000 7f8950ab9640 1 --2- 172.21.15.55:0/777416763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f894c0cddf0 0x7f894c06bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:52.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.783+0000 7f8950ab9640 1 -- 172.21.15.55:0/777416763 >> v1:172.21.15.110:6789/0 conn(0x7f894c164410 legacy=0x7f894c0c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:52.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.783+0000 7f8950ab9640 1 -- 172.21.15.55:0/777416763 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c0ccc90 con 0x7f894c0c1a80 2023-08-25T04:03:52.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f8950ab9640 1 --2- 172.21.15.55:0/777416763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f894c0c1a80 0x7f894c0b21b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f893c009870 tx=0x7f893c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd3429b502828da server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:52.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f8943fff640 1 -- 172.21.15.55:0/777416763 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c0ab600 con 0x7f894c0c1a80 2023-08-25T04:03:52.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f8943fff640 1 -- 172.21.15.55:0/777416763 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c0a7050 con 0x7f894c0c1a80 2023-08-25T04:03:52.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f8943fff640 1 -- 172.21.15.55:0/777416763 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c0ab980 con 0x7f894c0c1a80 2023-08-25T04:03:52.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f895351e640 1 -- 172.21.15.55:0/777416763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f894c0c1a80 msgr2=0x7f894c0b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:52.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f895351e640 1 --2- 172.21.15.55:0/777416763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f894c0c1a80 0x7f894c0b21b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f893c009870 tx=0x7f893c01c540 comp rx=0 tx=0).stop 2023-08-25T04:03:52.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f895351e640 1 -- 172.21.15.55:0/777416763 shutdown_connections 2023-08-25T04:03:52.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f895351e640 1 --2- 172.21.15.55:0/777416763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f894c0cddf0 0x7f894c06bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:52.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f895351e640 1 --2- 172.21.15.55:0/777416763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f894c0c1a80 0x7f894c0b21b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:52.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f895351e640 1 -- 172.21.15.55:0/777416763 >> 172.21.15.55:0/777416763 conn(0x7f894c069d00 msgr2=0x7f894c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:52.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f895351e640 1 -- 172.21.15.55:0/777416763 shutdown_connections 2023-08-25T04:03:52.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f895351e640 1 -- 172.21.15.55:0/777416763 wait complete. 2023-08-25T04:03:52.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f895351e640 1 Processor -- start 2023-08-25T04:03:52.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f895351e640 1 -- start start 2023-08-25T04:03:52.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f895351e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f894c0c1a80 0x7f894c163540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:52.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f895351e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f894c0cddf0 0x7f894c0c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:52.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f895351e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f894c164410 0x7f894c157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:52.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f895351e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c159fe0 con 0x7f894c0c1a80 2023-08-25T04:03:52.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f895351e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c0c4ca0 con 0x7f894c0cddf0 2023-08-25T04:03:52.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f895351e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894c15f2a0 con 0x7f894c164410 2023-08-25T04:03:52.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f89512ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f894c0c1a80 0x7f894c163540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:52.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.787+0000 7f89512ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f894c0c1a80 0x7f894c163540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55548/0 (socket says 172.21.15.55:55548) 2023-08-25T04:03:52.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.791+0000 7f89512ba640 1 -- 172.21.15.55:0/2475625278 learned_addr learned my addr 172.21.15.55:0/2475625278 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:52.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.791+0000 7f8950ab9640 1 --2- 172.21.15.55:0/2475625278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f894c0cddf0 0x7f894c0c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:52.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.791+0000 7f8951abb640 1 --2- 172.21.15.55:0/2475625278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f894c164410 0x7f894c157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:52.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.791+0000 7f89512ba640 1 -- 172.21.15.55:0/2475625278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f894c164410 msgr2=0x7f894c157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:52.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.791+0000 7f89512ba640 1 --2- 172.21.15.55:0/2475625278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f894c164410 0x7f894c157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:52.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.791+0000 7f89512ba640 1 -- 172.21.15.55:0/2475625278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f894c0cddf0 msgr2=0x7f894c0c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:52.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.791+0000 7f89512ba640 1 --2- 172.21.15.55:0/2475625278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f894c0cddf0 0x7f894c0c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:52.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.791+0000 7f89512ba640 1 -- 172.21.15.55:0/2475625278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c0094d0 con 0x7f894c0c1a80 2023-08-25T04:03:52.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.791+0000 7f89512ba640 1 --2- 172.21.15.55:0/2475625278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f894c0c1a80 0x7f894c163540 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f894800c3c0 tx=0x7f894800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:52.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.791+0000 7f8941ffb640 1 -- 172.21.15.55:0/2475625278 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89480052d0 con 0x7f894c0c1a80 2023-08-25T04:03:52.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.791+0000 7f8941ffb640 1 -- 172.21.15.55:0/2475625278 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8948005430 con 0x7f894c0c1a80 2023-08-25T04:03:52.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.791+0000 7f8941ffb640 1 -- 172.21.15.55:0/2475625278 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8948003840 con 0x7f894c0c1a80 2023-08-25T04:03:52.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.791+0000 7f895351e640 1 -- 172.21.15.55:0/2475625278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894c15f540 con 0x7f894c0c1a80 2023-08-25T04:03:52.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.791+0000 7f895351e640 1 -- 172.21.15.55:0/2475625278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894c15fb00 con 0x7f894c0c1a80 2023-08-25T04:03:52.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.791+0000 7f895351e640 1 -- 172.21.15.55:0/2475625278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894c15fcf0 con 0x7f894c0c1a80 2023-08-25T04:03:52.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.791+0000 7f8941ffb640 1 -- 172.21.15.55:0/2475625278 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f89480039a0 con 0x7f894c0c1a80 2023-08-25T04:03:52.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.795+0000 7f8941ffb640 1 --2- 172.21.15.55:0/2475625278 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8930065680 0x7f8930067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:52.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.795+0000 7f8941ffb640 1 -- 172.21.15.55:0/2475625278 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8948081f50 con 0x7f894c0c1a80 2023-08-25T04:03:52.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.795+0000 7f8950ab9640 1 --2- 172.21.15.55:0/2475625278 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8930065680 0x7f8930067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:52.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.795+0000 7f8950ab9640 1 --2- 172.21.15.55:0/2475625278 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8930065680 0x7f8930067b40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f893c0ad000 tx=0x7f893c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:52.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:52.799+0000 7f8941ffb640 1 -- 172.21.15.55:0/2475625278 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f894804fe00 con 0x7f894c0c1a80 2023-08-25T04:03:53.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.007+0000 7f895351e640 1 -- 172.21.15.55:0/2475625278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f894c04dbe0 con 0x7f894c0c1a80 2023-08-25T04:03:53.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.015+0000 7f8941ffb640 1 -- 172.21.15.55:0/2475625278 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8948053420 con 0x7f894c0c1a80 2023-08-25T04:03:53.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.015+0000 7f895351e640 1 -- 172.21.15.55:0/2475625278 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8930065680 msgr2=0x7f8930067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:53.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.015+0000 7f895351e640 1 --2- 172.21.15.55:0/2475625278 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8930065680 0x7f8930067b40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f893c0ad000 tx=0x7f893c008040 comp rx=0 tx=0).stop 2023-08-25T04:03:53.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.015+0000 7f895351e640 1 -- 172.21.15.55:0/2475625278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f894c0c1a80 msgr2=0x7f894c163540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:53.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.015+0000 7f895351e640 1 --2- 172.21.15.55:0/2475625278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f894c0c1a80 0x7f894c163540 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f894800c3c0 tx=0x7f894800c880 comp rx=0 tx=0).stop 2023-08-25T04:03:53.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.015+0000 7f895351e640 1 -- 172.21.15.55:0/2475625278 shutdown_connections 2023-08-25T04:03:53.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.015+0000 7f895351e640 1 --2- 172.21.15.55:0/2475625278 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8930065680 0x7f8930067b40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.015+0000 7f895351e640 1 --2- 172.21.15.55:0/2475625278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f894c164410 0x7f894c157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.015+0000 7f895351e640 1 --2- 172.21.15.55:0/2475625278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f894c0cddf0 0x7f894c0c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.015+0000 7f895351e640 1 --2- 172.21.15.55:0/2475625278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f894c0c1a80 0x7f894c163540 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.015+0000 7f895351e640 1 -- 172.21.15.55:0/2475625278 >> 172.21.15.55:0/2475625278 conn(0x7f894c069d00 msgr2=0x7f894c160c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:53.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.015+0000 7f895351e640 1 -- 172.21.15.55:0/2475625278 shutdown_connections 2023-08-25T04:03:53.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.015+0000 7f895351e640 1 -- 172.21.15.55:0/2475625278 wait complete. 2023-08-25T04:03:53.037 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-08-25T04:03:53.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.179+0000 7ff2cabfa640 1 Processor -- start 2023-08-25T04:03:53.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.179+0000 7ff2cabfa640 1 -- start start 2023-08-25T04:03:53.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.183+0000 7ff2cabfa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2c40cde20 0x7ff2c40ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:53.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.183+0000 7ff2cabfa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2c40cabf0 0x7ff2c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:53.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.183+0000 7ff2cabfa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c406d2b0 con 0x7ff2c40b1220 2023-08-25T04:03:53.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.183+0000 7ff2cabfa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c40c9490 con 0x7ff2c40cabf0 2023-08-25T04:03:53.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.183+0000 7ff2cabfa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c40cb1e0 con 0x7ff2c40cde20 2023-08-25T04:03:53.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.183+0000 7ff2c9197640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2c40cabf0 0x7ff2c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:53.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.183+0000 7ff2c9197640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2c40cabf0 0x7ff2c406c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55550/0 (socket says 172.21.15.55:55550) 2023-08-25T04:03:53.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.183+0000 7ff2c9197640 1 -- 172.21.15.55:0/1390325157 learned_addr learned my addr 172.21.15.55:0/1390325157 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:53.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.183+0000 7ff2c9197640 1 -- 172.21.15.55:0/1390325157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2c40cde20 msgr2=0x7ff2c40ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:53.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.183+0000 7ff2c8996640 1 --2- 172.21.15.55:0/1390325157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2c40cde20 0x7ff2c40ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:53.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.183+0000 7ff2c9197640 1 --2- 172.21.15.55:0/1390325157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2c40cde20 0x7ff2c40ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.183+0000 7ff2c9197640 1 -- 172.21.15.55:0/1390325157 >> v1:172.21.15.110:6789/0 conn(0x7ff2c40b1220 legacy=0x7ff2c406be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:53.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.183+0000 7ff2c9197640 1 -- 172.21.15.55:0/1390325157 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c40cb480 con 0x7ff2c40cabf0 2023-08-25T04:03:53.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.183+0000 7ff2c8996640 1 --2- 172.21.15.55:0/1390325157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2c40cde20 0x7ff2c40ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:53.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.183+0000 7ff2c9197640 1 --2- 172.21.15.55:0/1390325157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2c40cabf0 0x7ff2c406c5a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009e50 tx=0x7ff2bc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690b8350c187dac3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:53.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2c37fe640 1 -- 172.21.15.55:0/1390325157 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc0a5870 con 0x7ff2c40cabf0 2023-08-25T04:03:53.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2c37fe640 1 -- 172.21.15.55:0/1390325157 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc0a59d0 con 0x7ff2c40cabf0 2023-08-25T04:03:53.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2c37fe640 1 -- 172.21.15.55:0/1390325157 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc0a5d60 con 0x7ff2c40cabf0 2023-08-25T04:03:53.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2cabfa640 1 -- 172.21.15.55:0/1390325157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2c40cabf0 msgr2=0x7ff2c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:53.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2cabfa640 1 --2- 172.21.15.55:0/1390325157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2c40cabf0 0x7ff2c406c5a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009e50 tx=0x7ff2bc01c9d0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2cabfa640 1 -- 172.21.15.55:0/1390325157 shutdown_connections 2023-08-25T04:03:53.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2cabfa640 1 --2- 172.21.15.55:0/1390325157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2c40cabf0 0x7ff2c406c5a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2cabfa640 1 --2- 172.21.15.55:0/1390325157 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2c40cde20 0x7ff2c40ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2cabfa640 1 -- 172.21.15.55:0/1390325157 >> 172.21.15.55:0/1390325157 conn(0x7ff2c40b0700 msgr2=0x7ff2c40b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:53.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2cabfa640 1 -- 172.21.15.55:0/1390325157 shutdown_connections 2023-08-25T04:03:53.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2cabfa640 1 -- 172.21.15.55:0/1390325157 wait complete. 2023-08-25T04:03:53.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2cabfa640 1 Processor -- start 2023-08-25T04:03:53.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2cabfa640 1 -- start start 2023-08-25T04:03:53.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2cabfa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2c40b1220 0x7ff2c4153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:53.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2cabfa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2c40cabf0 0x7ff2c40ad240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:53.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2cabfa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2c40cde20 0x7ff2c40bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:53.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2cabfa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4154490 con 0x7ff2c40b1220 2023-08-25T04:03:53.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2cabfa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4155a90 con 0x7ff2c40cabf0 2023-08-25T04:03:53.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2cabfa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4155d70 con 0x7ff2c40cde20 2023-08-25T04:03:53.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2c8996640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2c40b1220 0x7ff2c4153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:53.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2c8996640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2c40b1220 0x7ff2c4153f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55556/0 (socket says 172.21.15.55:55556) 2023-08-25T04:03:53.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2c8996640 1 -- 172.21.15.55:0/3871756305 learned_addr learned my addr 172.21.15.55:0/3871756305 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:53.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2c9197640 1 --2- 172.21.15.55:0/3871756305 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2c40cde20 0x7ff2c40bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:53.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.187+0000 7ff2c3fff640 1 --2- 172.21.15.55:0/3871756305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2c40cabf0 0x7ff2c40ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:53.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.191+0000 7ff2c8996640 1 -- 172.21.15.55:0/3871756305 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2c40cde20 msgr2=0x7ff2c40bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:53.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.191+0000 7ff2c8996640 1 --2- 172.21.15.55:0/3871756305 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2c40cde20 0x7ff2c40bfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.191+0000 7ff2c8996640 1 -- 172.21.15.55:0/3871756305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2c40cabf0 msgr2=0x7ff2c40ad240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:53.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.191+0000 7ff2c8996640 1 --2- 172.21.15.55:0/3871756305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2c40cabf0 0x7ff2c40ad240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.191+0000 7ff2c8996640 1 -- 172.21.15.55:0/3871756305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc009b30 con 0x7ff2c40b1220 2023-08-25T04:03:53.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.191+0000 7ff2c8996640 1 --2- 172.21.15.55:0/3871756305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2c40b1220 0x7ff2c4153f50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800c7c0 tx=0x7ff2b800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:53.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.191+0000 7ff2c17fa640 1 -- 172.21.15.55:0/3871756305 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8007a30 con 0x7ff2c40b1220 2023-08-25T04:03:53.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.191+0000 7ff2c17fa640 1 -- 172.21.15.55:0/3871756305 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b8007b90 con 0x7ff2c40b1220 2023-08-25T04:03:53.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.191+0000 7ff2c17fa640 1 -- 172.21.15.55:0/3871756305 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b800ce70 con 0x7ff2c40b1220 2023-08-25T04:03:53.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.191+0000 7ff2cabfa640 1 -- 172.21.15.55:0/3871756305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c4156050 con 0x7ff2c40b1220 2023-08-25T04:03:53.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.191+0000 7ff2cabfa640 1 -- 172.21.15.55:0/3871756305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c40ad780 con 0x7ff2c40b1220 2023-08-25T04:03:53.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.191+0000 7ff2cabfa640 1 -- 172.21.15.55:0/3871756305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c404dbe0 con 0x7ff2c40b1220 2023-08-25T04:03:53.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.191+0000 7ff2c17fa640 1 -- 172.21.15.55:0/3871756305 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff2b80113f0 con 0x7ff2c40b1220 2023-08-25T04:03:53.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.195+0000 7ff2c17fa640 1 --2- 172.21.15.55:0/3871756305 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff2a8065680 0x7ff2a8067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:53.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.195+0000 7ff2c17fa640 1 -- 172.21.15.55:0/3871756305 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff2b8082e40 con 0x7ff2c40b1220 2023-08-25T04:03:53.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.195+0000 7ff2c3fff640 1 --2- 172.21.15.55:0/3871756305 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff2a8065680 0x7ff2a8067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:53.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.195+0000 7ff2c3fff640 1 --2- 172.21.15.55:0/3871756305 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff2a8065680 0x7ff2a8067b40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff2c41f8240 tx=0x7ff2b0009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:53.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.199+0000 7ff2c17fa640 1 -- 172.21.15.55:0/3871756305 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff2b8050d90 con 0x7ff2c40b1220 2023-08-25T04:03:53.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.407+0000 7ff2cabfa640 1 -- 172.21.15.55:0/3871756305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7ff2c4065770 con 0x7ff2c40b1220 2023-08-25T04:03:53.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.415+0000 7ff2c17fa640 1 -- 172.21.15.55:0/3871756305 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff2b80543b0 con 0x7ff2c40b1220 2023-08-25T04:03:53.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.415+0000 7ff2cabfa640 1 -- 172.21.15.55:0/3871756305 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff2a8065680 msgr2=0x7ff2a8067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:53.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.415+0000 7ff2cabfa640 1 --2- 172.21.15.55:0/3871756305 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff2a8065680 0x7ff2a8067b40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff2c41f8240 tx=0x7ff2b0009060 comp rx=0 tx=0).stop 2023-08-25T04:03:53.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.415+0000 7ff2cabfa640 1 -- 172.21.15.55:0/3871756305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2c40b1220 msgr2=0x7ff2c4153f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:53.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.415+0000 7ff2cabfa640 1 --2- 172.21.15.55:0/3871756305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2c40b1220 0x7ff2c4153f50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800c7c0 tx=0x7ff2b800cc80 comp rx=0 tx=0).stop 2023-08-25T04:03:53.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.415+0000 7ff2cabfa640 1 -- 172.21.15.55:0/3871756305 shutdown_connections 2023-08-25T04:03:53.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.415+0000 7ff2cabfa640 1 --2- 172.21.15.55:0/3871756305 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff2a8065680 0x7ff2a8067b40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.415+0000 7ff2cabfa640 1 --2- 172.21.15.55:0/3871756305 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2c40cde20 0x7ff2c40bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.415+0000 7ff2cabfa640 1 --2- 172.21.15.55:0/3871756305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2c40cabf0 0x7ff2c40ad240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.415+0000 7ff2cabfa640 1 --2- 172.21.15.55:0/3871756305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2c40b1220 0x7ff2c4153f50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.415+0000 7ff2cabfa640 1 -- 172.21.15.55:0/3871756305 >> 172.21.15.55:0/3871756305 conn(0x7ff2c40b0700 msgr2=0x7ff2c40701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:53.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.415+0000 7ff2cabfa640 1 -- 172.21.15.55:0/3871756305 shutdown_connections 2023-08-25T04:03:53.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.415+0000 7ff2cabfa640 1 -- 172.21.15.55:0/3871756305 wait complete. 2023-08-25T04:03:53.436 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-08-25T04:03:53.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.579+0000 7ff09ec88640 1 Processor -- start 2023-08-25T04:03:53.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.579+0000 7ff09ec88640 1 -- start start 2023-08-25T04:03:53.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.579+0000 7ff09ec88640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff0980ceeb0 0x7ff0980cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:53.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.579+0000 7ff09ec88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0980c89f0 0x7ff0980b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:53.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.579+0000 7ff09ec88640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0980cc880 con 0x7ff0980ad950 2023-08-25T04:03:53.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.579+0000 7ff09ec88640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0980b11f0 con 0x7ff0980ceeb0 2023-08-25T04:03:53.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.579+0000 7ff09ec88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff098159d50 con 0x7ff0980c89f0 2023-08-25T04:03:53.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.579+0000 7ff09ca24640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff0980ad950 0x7ff0980ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:46504/0 (socket says 172.21.15.55:46504) 2023-08-25T04:03:53.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.579+0000 7ff09d225640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0980c89f0 0x7ff0980b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:53.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.579+0000 7ff08ffff640 1 --2- 172.21.15.55:0/2725836714 >> v2:172.21.15.110:3300/0 conn(0x7ff0980ceeb0 0x7ff0980cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:53.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.579+0000 7ff09ca24640 1 -- 172.21.15.55:0/2725836714 learned_addr learned my addr 172.21.15.55:0/2725836714 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:53.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.579+0000 7ff08f7fe640 1 -- 172.21.15.55:0/2725836714 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196515400 0 0) 0x7ff0980cc880 con 0x7ff0980ad950 2023-08-25T04:03:53.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.579+0000 7ff08f7fe640 1 -- 172.21.15.55:0/2725836714 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff080003530 con 0x7ff0980ad950 2023-08-25T04:03:53.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.579+0000 7ff09d225640 1 -- 172.21.15.55:0/2725836714 >> v2:172.21.15.110:3300/0 conn(0x7ff0980ceeb0 msgr2=0x7ff0980cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:53.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.579+0000 7ff09d225640 1 --2- 172.21.15.55:0/2725836714 >> v2:172.21.15.110:3300/0 conn(0x7ff0980ceeb0 0x7ff0980cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.579+0000 7ff09d225640 1 -- 172.21.15.55:0/2725836714 >> v1:172.21.15.110:6789/0 conn(0x7ff0980ad950 legacy=0x7ff0980ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:53.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.579+0000 7ff09d225640 1 -- 172.21.15.55:0/2725836714 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0980ccb60 con 0x7ff0980c89f0 2023-08-25T04:03:53.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.579+0000 7ff08ffff640 1 --2- 172.21.15.55:0/2725836714 >> v2:172.21.15.110:3300/0 conn(0x7ff0980ceeb0 0x7ff0980cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:53.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.583+0000 7ff09d225640 1 --2- 172.21.15.55:0/2725836714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0980c89f0 0x7ff0980b1640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff090009d90 tx=0x7ff09001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74f2cfb18e799e03 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:53.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.583+0000 7ff08f7fe640 1 -- 172.21.15.55:0/2725836714 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0900a5860 con 0x7ff0980c89f0 2023-08-25T04:03:53.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.583+0000 7ff08f7fe640 1 -- 172.21.15.55:0/2725836714 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0900a59c0 con 0x7ff0980c89f0 2023-08-25T04:03:53.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.583+0000 7ff08f7fe640 1 -- 172.21.15.55:0/2725836714 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0900a5d50 con 0x7ff0980c89f0 2023-08-25T04:03:53.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.583+0000 7ff09ec88640 1 -- 172.21.15.55:0/2725836714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0980c89f0 msgr2=0x7ff0980b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:53.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.583+0000 7ff09ec88640 1 --2- 172.21.15.55:0/2725836714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0980c89f0 0x7ff0980b1640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff090009d90 tx=0x7ff09001c890 comp rx=0 tx=0).stop 2023-08-25T04:03:53.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.583+0000 7ff09ec88640 1 -- 172.21.15.55:0/2725836714 shutdown_connections 2023-08-25T04:03:53.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.583+0000 7ff09ec88640 1 --2- 172.21.15.55:0/2725836714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0980c89f0 0x7ff0980b1640 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.583+0000 7ff09ec88640 1 --2- 172.21.15.55:0/2725836714 >> v2:172.21.15.110:3300/0 conn(0x7ff0980ceeb0 0x7ff0980cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.583+0000 7ff09ec88640 1 -- 172.21.15.55:0/2725836714 >> 172.21.15.55:0/2725836714 conn(0x7ff098069d00 msgr2=0x7ff09806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:53.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.583+0000 7ff09ec88640 1 -- 172.21.15.55:0/2725836714 shutdown_connections 2023-08-25T04:03:53.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.583+0000 7ff09ec88640 1 -- 172.21.15.55:0/2725836714 wait complete. 2023-08-25T04:03:53.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09ec88640 1 Processor -- start 2023-08-25T04:03:53.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09ec88640 1 -- start start 2023-08-25T04:03:53.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09ec88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0980ad950 0x7ff0980c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:53.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09ec88640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0980c89f0 0x7ff098158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:53.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09ec88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0980ceeb0 0x7ff098156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:53.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09ec88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09815aa10 con 0x7ff0980ceeb0 2023-08-25T04:03:53.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09ec88640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff098158980 con 0x7ff0980c89f0 2023-08-25T04:03:53.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09ec88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09815a070 con 0x7ff0980ad950 2023-08-25T04:03:53.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09d225640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0980ceeb0 0x7ff098156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:53.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09d225640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0980ceeb0 0x7ff098156320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55558/0 (socket says 172.21.15.55:55558) 2023-08-25T04:03:53.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09d225640 1 -- 172.21.15.55:0/2194320260 learned_addr learned my addr 172.21.15.55:0/2194320260 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:53.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff08ffff640 1 --2- 172.21.15.55:0/2194320260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0980c89f0 0x7ff098158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:53.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09ca24640 1 --2- 172.21.15.55:0/2194320260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0980ad950 0x7ff0980c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:53.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09d225640 1 -- 172.21.15.55:0/2194320260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0980ad950 msgr2=0x7ff0980c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:53.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09d225640 1 --2- 172.21.15.55:0/2194320260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0980ad950 0x7ff0980c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09d225640 1 -- 172.21.15.55:0/2194320260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0980c89f0 msgr2=0x7ff098158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:53.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09d225640 1 --2- 172.21.15.55:0/2194320260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0980c89f0 0x7ff098158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09d225640 1 -- 172.21.15.55:0/2194320260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff088009420 con 0x7ff0980ceeb0 2023-08-25T04:03:53.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff08ffff640 1 --2- 172.21.15.55:0/2194320260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0980c89f0 0x7ff098158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:53.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09d225640 1 --2- 172.21.15.55:0/2194320260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0980ceeb0 0x7ff098156320 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff09001af40 tx=0x7ff090019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:53.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff08d7fa640 1 -- 172.21.15.55:0/2194320260 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0900b9650 con 0x7ff0980ceeb0 2023-08-25T04:03:53.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff08d7fa640 1 -- 172.21.15.55:0/2194320260 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0900b97b0 con 0x7ff0980ceeb0 2023-08-25T04:03:53.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff08d7fa640 1 -- 172.21.15.55:0/2194320260 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0900b9b20 con 0x7ff0980ceeb0 2023-08-25T04:03:53.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09ec88640 1 -- 172.21.15.55:0/2194320260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff090009a70 con 0x7ff0980ceeb0 2023-08-25T04:03:53.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.587+0000 7ff09ec88640 1 -- 172.21.15.55:0/2194320260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09815a630 con 0x7ff0980ceeb0 2023-08-25T04:03:53.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.591+0000 7ff09ec88640 1 -- 172.21.15.55:0/2194320260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09815ab50 con 0x7ff0980ceeb0 2023-08-25T04:03:53.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.591+0000 7ff08d7fa640 1 -- 172.21.15.55:0/2194320260 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff0900b9c80 con 0x7ff0980ceeb0 2023-08-25T04:03:53.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.591+0000 7ff08d7fa640 1 --2- 172.21.15.55:0/2194320260 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff084065680 0x7ff084067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:53.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.591+0000 7ff08d7fa640 1 -- 172.21.15.55:0/2194320260 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff09011de00 con 0x7ff0980ceeb0 2023-08-25T04:03:53.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.591+0000 7ff09ca24640 1 --2- 172.21.15.55:0/2194320260 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff084065680 0x7ff084067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:53.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.591+0000 7ff09ca24640 1 --2- 172.21.15.55:0/2194320260 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff084065680 0x7ff084067b40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff0940011f0 tx=0x7ff094009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:53.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.595+0000 7ff08d7fa640 1 -- 172.21.15.55:0/2194320260 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff09815ab50 con 0x7ff0980ceeb0 2023-08-25T04:03:53.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.803+0000 7ff09ec88640 1 -- 172.21.15.55:0/2194320260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7ff09815ab50 con 0x7ff0980ceeb0 2023-08-25T04:03:53.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.811+0000 7ff08d7fa640 1 -- 172.21.15.55:0/2194320260 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff09815ab50 con 0x7ff0980ceeb0 2023-08-25T04:03:53.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.815+0000 7ff09ec88640 1 -- 172.21.15.55:0/2194320260 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff084065680 msgr2=0x7ff084067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:53.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.815+0000 7ff09ec88640 1 --2- 172.21.15.55:0/2194320260 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff084065680 0x7ff084067b40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff0940011f0 tx=0x7ff094009040 comp rx=0 tx=0).stop 2023-08-25T04:03:53.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.815+0000 7ff09ec88640 1 -- 172.21.15.55:0/2194320260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0980ceeb0 msgr2=0x7ff098156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:53.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.815+0000 7ff09ec88640 1 --2- 172.21.15.55:0/2194320260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0980ceeb0 0x7ff098156320 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff09001af40 tx=0x7ff090019630 comp rx=0 tx=0).stop 2023-08-25T04:03:53.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.815+0000 7ff09ec88640 1 -- 172.21.15.55:0/2194320260 shutdown_connections 2023-08-25T04:03:53.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.815+0000 7ff09ec88640 1 --2- 172.21.15.55:0/2194320260 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff084065680 0x7ff084067b40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.815+0000 7ff09ec88640 1 --2- 172.21.15.55:0/2194320260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0980ceeb0 0x7ff098156320 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.815+0000 7ff09ec88640 1 --2- 172.21.15.55:0/2194320260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff0980c89f0 0x7ff098158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.815+0000 7ff09ec88640 1 --2- 172.21.15.55:0/2194320260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff0980ad950 0x7ff0980c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.815+0000 7ff09ec88640 1 -- 172.21.15.55:0/2194320260 >> 172.21.15.55:0/2194320260 conn(0x7ff098069d00 msgr2=0x7ff0980b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:53.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.815+0000 7ff09ec88640 1 -- 172.21.15.55:0/2194320260 shutdown_connections 2023-08-25T04:03:53.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.815+0000 7ff09ec88640 1 -- 172.21.15.55:0/2194320260 wait complete. 2023-08-25T04:03:53.834 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-08-25T04:03:53.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.979+0000 7fe3e4774640 1 Processor -- start 2023-08-25T04:03:53.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.979+0000 7fe3e4774640 1 -- start start 2023-08-25T04:03:53.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.979+0000 7fe3e4774640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3dc06a010 0x7fe3dc0ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:53.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.979+0000 7fe3e4774640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe3dc0ce4b0 0x7fe3dc0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:53.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.979+0000 7fe3e4774640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3dc0d0050 con 0x7fe3dc15aac0 2023-08-25T04:03:53.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.979+0000 7fe3e4774640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3dc0cb370 con 0x7fe3dc0ce4b0 2023-08-25T04:03:53.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.979+0000 7fe3e4774640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc0cb650 con 0x7fe3dc06a010 2023-08-25T04:03:53.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.979+0000 7fe3e2d11640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe3dc0ce4b0 0x7fe3dc0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:53.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.979+0000 7fe3e2510640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe3dc15aac0 0x7fe3dc069900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48746/0 (socket says 172.21.15.55:48746) 2023-08-25T04:03:53.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.979+0000 7fe3e2510640 1 -- 172.21.15.55:0/4243480342 learned_addr learned my addr 172.21.15.55:0/4243480342 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:53.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.979+0000 7fe3e1d0f640 1 --2- 172.21.15.55:0/4243480342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3dc06a010 0x7fe3dc0ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:53.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.979+0000 7fe3e150e640 1 -- 172.21.15.55:0/4243480342 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477389151 0 0) 0x7fe3dc0d0050 con 0x7fe3dc15aac0 2023-08-25T04:03:53.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.979+0000 7fe3e150e640 1 -- 172.21.15.55:0/4243480342 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3c8003530 con 0x7fe3dc15aac0 2023-08-25T04:03:53.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.979+0000 7fe3e2d11640 1 -- 172.21.15.55:0/4243480342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3dc06a010 msgr2=0x7fe3dc0ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:53.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.979+0000 7fe3e2d11640 1 --2- 172.21.15.55:0/4243480342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3dc06a010 0x7fe3dc0ac110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.979+0000 7fe3e2d11640 1 -- 172.21.15.55:0/4243480342 >> v1:172.21.15.55:6789/0 conn(0x7fe3dc15aac0 legacy=0x7fe3dc069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:53.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.979+0000 7fe3e2d11640 1 -- 172.21.15.55:0/4243480342 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc0cb930 con 0x7fe3dc0ce4b0 2023-08-25T04:03:53.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.983+0000 7fe3e2d11640 1 --2- 172.21.15.55:0/4243480342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3dc0ce4b0 0x7fe3dc0cc130 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40097c0 tx=0x7fe3d401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb29413cb65ce6b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:53.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.983+0000 7fe3e150e640 1 -- 172.21.15.55:0/4243480342 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40ac640 con 0x7fe3dc0ce4b0 2023-08-25T04:03:53.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.983+0000 7fe3e150e640 1 -- 172.21.15.55:0/4243480342 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d40ac7a0 con 0x7fe3dc0ce4b0 2023-08-25T04:03:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.983+0000 7fe3e150e640 1 -- 172.21.15.55:0/4243480342 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40acb30 con 0x7fe3dc0ce4b0 2023-08-25T04:03:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.983+0000 7fe3e4774640 1 -- 172.21.15.55:0/4243480342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3dc0ce4b0 msgr2=0x7fe3dc0cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.983+0000 7fe3e4774640 1 --2- 172.21.15.55:0/4243480342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3dc0ce4b0 0x7fe3dc0cc130 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe3d40097c0 tx=0x7fe3d401c3c0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.983+0000 7fe3e4774640 1 -- 172.21.15.55:0/4243480342 shutdown_connections 2023-08-25T04:03:53.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.983+0000 7fe3e4774640 1 --2- 172.21.15.55:0/4243480342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3dc06a010 0x7fe3dc0ac110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.983+0000 7fe3e4774640 1 --2- 172.21.15.55:0/4243480342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3dc0ce4b0 0x7fe3dc0cc130 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.983+0000 7fe3e4774640 1 -- 172.21.15.55:0/4243480342 >> 172.21.15.55:0/4243480342 conn(0x7fe3dc0cf530 msgr2=0x7fe3dc0cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:53.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.983+0000 7fe3e4774640 1 -- 172.21.15.55:0/4243480342 shutdown_connections 2023-08-25T04:03:53.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.983+0000 7fe3e4774640 1 -- 172.21.15.55:0/4243480342 wait complete. 2023-08-25T04:03:53.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.983+0000 7fe3e4774640 1 Processor -- start 2023-08-25T04:03:53.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e4774640 1 -- start start 2023-08-25T04:03:53.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e4774640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3dc06a010 0x7fe3dc159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:53.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e4774640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3dc0ce4b0 0x7fe3dc1f8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:53.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e4774640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3dc15aac0 0x7fe3dc14a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:53.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e4774640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc1f8b40 con 0x7fe3dc15aac0 2023-08-25T04:03:53.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e4774640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc14b360 con 0x7fe3dc0ce4b0 2023-08-25T04:03:53.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e4774640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3dc14cd50 con 0x7fe3dc06a010 2023-08-25T04:03:53.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e2d11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3dc15aac0 0x7fe3dc14a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:53.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e2d11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3dc15aac0 0x7fe3dc14a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55582/0 (socket says 172.21.15.55:55582) 2023-08-25T04:03:53.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e2d11640 1 -- 172.21.15.55:0/3674602135 learned_addr learned my addr 172.21.15.55:0/3674602135 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:53.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e1d0f640 1 --2- 172.21.15.55:0/3674602135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3dc0ce4b0 0x7fe3dc1f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:53.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e2510640 1 --2- 172.21.15.55:0/3674602135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3dc06a010 0x7fe3dc159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:53.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e2d11640 1 -- 172.21.15.55:0/3674602135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3dc06a010 msgr2=0x7fe3dc159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:53.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e2d11640 1 --2- 172.21.15.55:0/3674602135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3dc06a010 0x7fe3dc159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e2d11640 1 -- 172.21.15.55:0/3674602135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3dc0ce4b0 msgr2=0x7fe3dc1f8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:53.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e2d11640 1 --2- 172.21.15.55:0/3674602135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3dc0ce4b0 0x7fe3dc1f8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:53.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e2d11640 1 -- 172.21.15.55:0/3674602135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d4009420 con 0x7fe3dc15aac0 2023-08-25T04:03:53.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e2510640 1 --2- 172.21.15.55:0/3674602135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3dc06a010 0x7fe3dc159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:53.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e2d11640 1 --2- 172.21.15.55:0/3674602135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3dc15aac0 0x7fe3dc14a640 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4019ff0 tx=0x7fe3d401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:53.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3d2ffd640 1 -- 172.21.15.55:0/3674602135 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40b7620 con 0x7fe3dc15aac0 2023-08-25T04:03:53.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3d2ffd640 1 -- 172.21.15.55:0/3674602135 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d40b77c0 con 0x7fe3dc15aac0 2023-08-25T04:03:53.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3d2ffd640 1 -- 172.21.15.55:0/3674602135 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d40b7b70 con 0x7fe3dc15aac0 2023-08-25T04:03:53.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e4774640 1 -- 172.21.15.55:0/3674602135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3dc15a1f0 con 0x7fe3dc15aac0 2023-08-25T04:03:53.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e4774640 1 -- 172.21.15.55:0/3674602135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3dc14d2d0 con 0x7fe3dc15aac0 2023-08-25T04:03:53.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.987+0000 7fe3e4774640 1 -- 172.21.15.55:0/3674602135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3dc1f8c80 con 0x7fe3dc15aac0 2023-08-25T04:03:53.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.991+0000 7fe3d2ffd640 1 -- 172.21.15.55:0/3674602135 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe3d40b3040 con 0x7fe3dc15aac0 2023-08-25T04:03:53.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.991+0000 7fe3d2ffd640 1 --2- 172.21.15.55:0/3674602135 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe3c0065680 0x7fe3c0067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:53.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.991+0000 7fe3d2ffd640 1 -- 172.21.15.55:0/3674602135 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe3d411d260 con 0x7fe3dc15aac0 2023-08-25T04:03:53.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.991+0000 7fe3e2510640 1 --2- 172.21.15.55:0/3674602135 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe3c0065680 0x7fe3c0067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:53.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.991+0000 7fe3e2510640 1 --2- 172.21.15.55:0/3674602135 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe3c0065680 0x7fe3c0067b40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8001570 tx=0x7fe3d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:53.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:53.995+0000 7fe3d2ffd640 1 -- 172.21.15.55:0/3674602135 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe3dc1f8c80 con 0x7fe3dc15aac0 2023-08-25T04:03:54.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.207+0000 7fe3e4774640 1 -- 172.21.15.55:0/3674602135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fe3dc1f8c80 con 0x7fe3dc15aac0 2023-08-25T04:03:54.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.215+0000 7fe3d2ffd640 1 -- 172.21.15.55:0/3674602135 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe3dc1f8c80 con 0x7fe3dc15aac0 2023-08-25T04:03:54.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.215+0000 7fe3e4774640 1 -- 172.21.15.55:0/3674602135 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe3c0065680 msgr2=0x7fe3c0067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:54.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.215+0000 7fe3e4774640 1 --2- 172.21.15.55:0/3674602135 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe3c0065680 0x7fe3c0067b40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8001570 tx=0x7fe3d8009040 comp rx=0 tx=0).stop 2023-08-25T04:03:54.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.215+0000 7fe3e4774640 1 -- 172.21.15.55:0/3674602135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3dc15aac0 msgr2=0x7fe3dc14a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:54.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.215+0000 7fe3e4774640 1 --2- 172.21.15.55:0/3674602135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3dc15aac0 0x7fe3dc14a640 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe3d4019ff0 tx=0x7fe3d401ac00 comp rx=0 tx=0).stop 2023-08-25T04:03:54.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.215+0000 7fe3e4774640 1 -- 172.21.15.55:0/3674602135 shutdown_connections 2023-08-25T04:03:54.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.215+0000 7fe3e4774640 1 --2- 172.21.15.55:0/3674602135 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fe3c0065680 0x7fe3c0067b40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:54.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.215+0000 7fe3e4774640 1 --2- 172.21.15.55:0/3674602135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3dc15aac0 0x7fe3dc14a640 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:54.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.215+0000 7fe3e4774640 1 --2- 172.21.15.55:0/3674602135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3dc0ce4b0 0x7fe3dc1f8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:54.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.215+0000 7fe3e4774640 1 --2- 172.21.15.55:0/3674602135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3dc06a010 0x7fe3dc159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:54.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.215+0000 7fe3e4774640 1 -- 172.21.15.55:0/3674602135 >> 172.21.15.55:0/3674602135 conn(0x7fe3dc0cf530 msgr2=0x7fe3dc150b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:54.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.215+0000 7fe3e4774640 1 -- 172.21.15.55:0/3674602135 shutdown_connections 2023-08-25T04:03:54.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.215+0000 7fe3e4774640 1 -- 172.21.15.55:0/3674602135 wait complete. 2023-08-25T04:03:54.237 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-08-25T04:03:54.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.379+0000 7fdc0f656640 1 Processor -- start 2023-08-25T04:03:54.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.379+0000 7fdc0f656640 1 -- start start 2023-08-25T04:03:54.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.383+0000 7fdc0f656640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdc081462d0 0x7fdc080708e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:54.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.383+0000 7fdc0f656640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc08160580 0x7fdc080cd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:54.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.383+0000 7fdc0f656640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc080c9e10 con 0x7fdc080cdb50 2023-08-25T04:03:54.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.383+0000 7fdc0f656640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc080cdfe0 con 0x7fdc081462d0 2023-08-25T04:03:54.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.383+0000 7fdc0f656640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc08160d00 con 0x7fdc08160580 2023-08-25T04:03:54.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.383+0000 7fdc0dbf3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdc080cdb50 0x7fdc080cc3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48758/0 (socket says 172.21.15.55:48758) 2023-08-25T04:03:54.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.383+0000 7fdc0dbf3640 1 -- 172.21.15.55:0/522207309 learned_addr learned my addr 172.21.15.55:0/522207309 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:54.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.383+0000 7fdc0cbf1640 1 --2- 172.21.15.55:0/522207309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc08160580 0x7fdc080cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:54.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.383+0000 7fdc0d3f2640 1 --2- 172.21.15.55:0/522207309 >> v2:172.21.15.110:3300/0 conn(0x7fdc081462d0 0x7fdc080708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:54.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.383+0000 7fdbfffff640 1 -- 172.21.15.55:0/522207309 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610702341 0 0) 0x7fdc080c9e10 con 0x7fdc080cdb50 2023-08-25T04:03:54.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.383+0000 7fdbfffff640 1 -- 172.21.15.55:0/522207309 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbf4003530 con 0x7fdc080cdb50 2023-08-25T04:03:54.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.383+0000 7fdc0d3f2640 1 -- 172.21.15.55:0/522207309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc08160580 msgr2=0x7fdc080cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:54.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.383+0000 7fdc0d3f2640 1 --2- 172.21.15.55:0/522207309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc08160580 0x7fdc080cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:54.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.383+0000 7fdc0d3f2640 1 -- 172.21.15.55:0/522207309 >> v1:172.21.15.55:6789/0 conn(0x7fdc080cdb50 legacy=0x7fdc080cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:54.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.383+0000 7fdbfffff640 1 -- 172.21.15.55:0/522207309 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 186513482 0 0) 0x7fdbf4003530 con 0x7fdc080cdb50 2023-08-25T04:03:54.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.383+0000 7fdc0d3f2640 1 -- 172.21.15.55:0/522207309 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc08160fe0 con 0x7fdc081462d0 2023-08-25T04:03:54.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.383+0000 7fdc0cbf1640 1 --2- 172.21.15.55:0/522207309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc08160580 0x7fdc080cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:54.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.387+0000 7fdc0d3f2640 1 --2- 172.21.15.55:0/522207309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc081462d0 0x7fdc080708e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdc040097c0 tx=0x7fdc0401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82cdbeac980db514 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:54.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.387+0000 7fdbfffff640 1 -- 172.21.15.55:0/522207309 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00001a00 con 0x7fdc081462d0 2023-08-25T04:03:54.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.387+0000 7fdbfffff640 1 -- 172.21.15.55:0/522207309 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc040a7050 con 0x7fdc081462d0 2023-08-25T04:03:54.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.387+0000 7fdbfffff640 1 -- 172.21.15.55:0/522207309 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040ab620 con 0x7fdc081462d0 2023-08-25T04:03:54.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.387+0000 7fdc0f656640 1 -- 172.21.15.55:0/522207309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc081462d0 msgr2=0x7fdc080708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:54.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.387+0000 7fdc0f656640 1 --2- 172.21.15.55:0/522207309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc081462d0 0x7fdc080708e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdc040097c0 tx=0x7fdc0401c370 comp rx=0 tx=0).stop 2023-08-25T04:03:54.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.387+0000 7fdc0f656640 1 -- 172.21.15.55:0/522207309 shutdown_connections 2023-08-25T04:03:54.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.387+0000 7fdc0f656640 1 --2- 172.21.15.55:0/522207309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc08160580 0x7fdc080cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:54.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.387+0000 7fdc0f656640 1 --2- 172.21.15.55:0/522207309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc081462d0 0x7fdc080708e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:54.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.387+0000 7fdc0f656640 1 -- 172.21.15.55:0/522207309 >> 172.21.15.55:0/522207309 conn(0x7fdc08069900 msgr2=0x7fdc08069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:54.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.387+0000 7fdc0f656640 1 -- 172.21.15.55:0/522207309 shutdown_connections 2023-08-25T04:03:54.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.387+0000 7fdc0f656640 1 -- 172.21.15.55:0/522207309 wait complete. 2023-08-25T04:03:54.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0f656640 1 Processor -- start 2023-08-25T04:03:54.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0f656640 1 -- start start 2023-08-25T04:03:54.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0f656640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc080cdb50 0x7fdc0815f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:54.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0f656640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc081462d0 0x7fdc080b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:54.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0f656640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc08160580 0x7fdc080b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:54.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0f656640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0815e8e0 con 0x7fdc081462d0 2023-08-25T04:03:54.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0f656640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0815ebc0 con 0x7fdc080cdb50 2023-08-25T04:03:54.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0f656640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0815eea0 con 0x7fdc08160580 2023-08-25T04:03:54.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0cbf1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc081462d0 0x7fdc080b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:54.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0cbf1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc081462d0 0x7fdc080b1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55592/0 (socket says 172.21.15.55:55592) 2023-08-25T04:03:54.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0cbf1640 1 -- 172.21.15.55:0/2987303868 learned_addr learned my addr 172.21.15.55:0/2987303868 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:54.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0d3f2640 1 --2- 172.21.15.55:0/2987303868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc080cdb50 0x7fdc0815f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:54.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0dbf3640 1 --2- 172.21.15.55:0/2987303868 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc08160580 0x7fdc080b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:54.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0cbf1640 1 -- 172.21.15.55:0/2987303868 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc08160580 msgr2=0x7fdc080b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:54.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0cbf1640 1 --2- 172.21.15.55:0/2987303868 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc08160580 0x7fdc080b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:54.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0cbf1640 1 -- 172.21.15.55:0/2987303868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc080cdb50 msgr2=0x7fdc0815f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:54.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0cbf1640 1 --2- 172.21.15.55:0/2987303868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc080cdb50 0x7fdc0815f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:54.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0cbf1640 1 -- 172.21.15.55:0/2987303868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf8009420 con 0x7fdc081462d0 2023-08-25T04:03:54.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0d3f2640 1 --2- 172.21.15.55:0/2987303868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc080cdb50 0x7fdc0815f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:54.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0cbf1640 1 --2- 172.21.15.55:0/2987303868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc081462d0 0x7fdc080b1840 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800ebe0 tx=0x7fdbf800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:54.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdbfdffb640 1 -- 172.21.15.55:0/2987303868 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf800eee0 con 0x7fdc081462d0 2023-08-25T04:03:54.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdbfdffb640 1 -- 172.21.15.55:0/2987303868 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf800cc30 con 0x7fdc081462d0 2023-08-25T04:03:54.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0f656640 1 -- 172.21.15.55:0/2987303868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc04009420 con 0x7fdc081462d0 2023-08-25T04:03:54.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdbfdffb640 1 -- 172.21.15.55:0/2987303868 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8013470 con 0x7fdc081462d0 2023-08-25T04:03:54.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0f656640 1 -- 172.21.15.55:0/2987303868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0815fea0 con 0x7fdc081462d0 2023-08-25T04:03:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.391+0000 7fdc0f656640 1 -- 172.21.15.55:0/2987303868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0815f2c0 con 0x7fdc081462d0 2023-08-25T04:03:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.395+0000 7fdbfdffb640 1 -- 172.21.15.55:0/2987303868 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdbf80135d0 con 0x7fdc081462d0 2023-08-25T04:03:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.395+0000 7fdbfdffb640 1 --2- 172.21.15.55:0/2987303868 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fdbec065680 0x7fdbec067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.395+0000 7fdbfdffb640 1 -- 172.21.15.55:0/2987303868 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdbf8082ea0 con 0x7fdc081462d0 2023-08-25T04:03:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.395+0000 7fdc0d3f2640 1 --2- 172.21.15.55:0/2987303868 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fdbec065680 0x7fdbec067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.395+0000 7fdc0d3f2640 1 --2- 172.21.15.55:0/2987303868 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fdbec065680 0x7fdbec067b40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdc040ad000 tx=0x7fdc04008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.399+0000 7fdbfdffb640 1 -- 172.21.15.55:0/2987303868 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fdc0815f2c0 con 0x7fdc081462d0 2023-08-25T04:03:54.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.611+0000 7fdc0f656640 1 -- 172.21.15.55:0/2987303868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fdc0815f2c0 con 0x7fdc081462d0 2023-08-25T04:03:54.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.619+0000 7fdbfdffb640 1 -- 172.21.15.55:0/2987303868 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdc0815f2c0 con 0x7fdc081462d0 2023-08-25T04:03:54.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.619+0000 7fdc0f656640 1 -- 172.21.15.55:0/2987303868 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fdbec065680 msgr2=0x7fdbec067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:54.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.619+0000 7fdc0f656640 1 --2- 172.21.15.55:0/2987303868 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fdbec065680 0x7fdbec067b40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdc040ad000 tx=0x7fdc04008040 comp rx=0 tx=0).stop 2023-08-25T04:03:54.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.619+0000 7fdc0f656640 1 -- 172.21.15.55:0/2987303868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc081462d0 msgr2=0x7fdc080b1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:54.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.619+0000 7fdc0f656640 1 --2- 172.21.15.55:0/2987303868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc081462d0 0x7fdc080b1840 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800ebe0 tx=0x7fdbf800c520 comp rx=0 tx=0).stop 2023-08-25T04:03:54.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.623+0000 7fdc0f656640 1 -- 172.21.15.55:0/2987303868 shutdown_connections 2023-08-25T04:03:54.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.623+0000 7fdc0f656640 1 --2- 172.21.15.55:0/2987303868 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fdbec065680 0x7fdbec067b40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:54.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.623+0000 7fdc0f656640 1 --2- 172.21.15.55:0/2987303868 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc08160580 0x7fdc080b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:54.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.623+0000 7fdc0f656640 1 --2- 172.21.15.55:0/2987303868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc081462d0 0x7fdc080b1840 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:54.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.623+0000 7fdc0f656640 1 --2- 172.21.15.55:0/2987303868 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc080cdb50 0x7fdc0815f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:54.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.623+0000 7fdc0f656640 1 -- 172.21.15.55:0/2987303868 >> 172.21.15.55:0/2987303868 conn(0x7fdc08069900 msgr2=0x7fdc080c3770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:54.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.623+0000 7fdc0f656640 1 -- 172.21.15.55:0/2987303868 shutdown_connections 2023-08-25T04:03:54.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.623+0000 7fdc0f656640 1 -- 172.21.15.55:0/2987303868 wait complete. 2023-08-25T04:03:54.642 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-08-25T04:03:54.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.787+0000 7f5413379640 1 Processor -- start 2023-08-25T04:03:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.787+0000 7f5413379640 1 -- start start 2023-08-25T04:03:54.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.787+0000 7f5413379640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f540c0d1120 0x7f540c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:54.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.787+0000 7f5413379640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f540c06c150 0x7f540c0b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:54.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.787+0000 7f5413379640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540c0afe20 con 0x7f540c15ca50 2023-08-25T04:03:54.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.787+0000 7f5413379640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c0af210 con 0x7f540c06c150 2023-08-25T04:03:54.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.787+0000 7f5413379640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0af4f0 con 0x7f540c0d1120 2023-08-25T04:03:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.787+0000 7f5412b78640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f540c06c150 0x7f540c0b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.787+0000 7f5412b78640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f540c06c150 0x7f540c0b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55606/0 (socket says 172.21.15.55:55606) 2023-08-25T04:03:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.787+0000 7f5412b78640 1 -- 172.21.15.55:0/2493927315 learned_addr learned my addr 172.21.15.55:0/2493927315 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.787+0000 7f5412b78640 1 -- 172.21.15.55:0/2493927315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f540c0d1120 msgr2=0x7f540c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.787+0000 7f5412b78640 1 --2- 172.21.15.55:0/2493927315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f540c0d1120 0x7f540c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.787+0000 7f5412b78640 1 -- 172.21.15.55:0/2493927315 >> v1:172.21.15.110:6789/0 conn(0x7f540c15ca50 legacy=0x7f540c0d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.787+0000 7f5412b78640 1 -- 172.21.15.55:0/2493927315 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c0af7d0 con 0x7f540c06c150 2023-08-25T04:03:54.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.791+0000 7f5412b78640 1 --2- 172.21.15.55:0/2493927315 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f540c06c150 0x7f540c0b02b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5404009e50 tx=0x7f540401d400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b79712b763e3b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.791+0000 7f5411375640 1 -- 172.21.15.55:0/2493927315 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040a5840 con 0x7f540c06c150 2023-08-25T04:03:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.791+0000 7f5411375640 1 -- 172.21.15.55:0/2493927315 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54040a59a0 con 0x7f540c06c150 2023-08-25T04:03:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.791+0000 7f5411375640 1 -- 172.21.15.55:0/2493927315 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040a5d30 con 0x7f540c06c150 2023-08-25T04:03:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.791+0000 7f5413379640 1 -- 172.21.15.55:0/2493927315 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f540c06c150 msgr2=0x7f540c0b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.791+0000 7f5413379640 1 --2- 172.21.15.55:0/2493927315 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f540c06c150 0x7f540c0b02b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5404009e50 tx=0x7f540401d400 comp rx=0 tx=0).stop 2023-08-25T04:03:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.791+0000 7f5413379640 1 -- 172.21.15.55:0/2493927315 shutdown_connections 2023-08-25T04:03:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.791+0000 7f5413379640 1 --2- 172.21.15.55:0/2493927315 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f540c06c150 0x7f540c0b02b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.791+0000 7f5413379640 1 --2- 172.21.15.55:0/2493927315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f540c0d1120 0x7f540c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.791+0000 7f5413379640 1 -- 172.21.15.55:0/2493927315 >> 172.21.15.55:0/2493927315 conn(0x7f540c065f40 msgr2=0x7f540c09b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.791+0000 7f5413379640 1 -- 172.21.15.55:0/2493927315 shutdown_connections 2023-08-25T04:03:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.791+0000 7f5413379640 1 -- 172.21.15.55:0/2493927315 wait complete. 2023-08-25T04:03:54.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5413379640 1 Processor -- start 2023-08-25T04:03:54.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5413379640 1 -- start start 2023-08-25T04:03:54.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5413379640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f540c06c150 0x7f540c0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:54.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5413379640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f540c0d1120 0x7f540c0cf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:54.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5413379640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f540c15ca50 0x7f540c15a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:54.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5413379640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0cdea0 con 0x7f540c0d1120 2023-08-25T04:03:54.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5413379640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0c6aa0 con 0x7f540c06c150 2023-08-25T04:03:54.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5413379640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0cd8e0 con 0x7f540c15ca50 2023-08-25T04:03:54.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5411b76640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f540c0d1120 0x7f540c0cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:54.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5411b76640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f540c0d1120 0x7f540c0cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55618/0 (socket says 172.21.15.55:55618) 2023-08-25T04:03:54.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5411b76640 1 -- 172.21.15.55:0/4016564262 learned_addr learned my addr 172.21.15.55:0/4016564262 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:54.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5412b78640 1 --2- 172.21.15.55:0/4016564262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f540c15ca50 0x7f540c15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:54.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5412377640 1 --2- 172.21.15.55:0/4016564262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f540c06c150 0x7f540c0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:54.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5411b76640 1 -- 172.21.15.55:0/4016564262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f540c15ca50 msgr2=0x7f540c15a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:54.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5411b76640 1 --2- 172.21.15.55:0/4016564262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f540c15ca50 0x7f540c15a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:54.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5411b76640 1 -- 172.21.15.55:0/4016564262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f540c06c150 msgr2=0x7f540c0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:54.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5411b76640 1 --2- 172.21.15.55:0/4016564262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f540c06c150 0x7f540c0ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:54.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5411b76640 1 -- 172.21.15.55:0/4016564262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5404009b30 con 0x7f540c0d1120 2023-08-25T04:03:54.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5411b76640 1 --2- 172.21.15.55:0/4016564262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f540c0d1120 0x7f540c0cf520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00b550 tx=0x7f53fc00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:54.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5402ffd640 1 -- 172.21.15.55:0/4016564262 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc010870 con 0x7f540c0d1120 2023-08-25T04:03:54.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5402ffd640 1 -- 172.21.15.55:0/4016564262 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc0109f0 con 0x7f540c0d1120 2023-08-25T04:03:54.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5402ffd640 1 -- 172.21.15.55:0/4016564262 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc010da0 con 0x7f540c0d1120 2023-08-25T04:03:54.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5413379640 1 -- 172.21.15.55:0/4016564262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540c0cdbc0 con 0x7f540c0d1120 2023-08-25T04:03:54.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5413379640 1 -- 172.21.15.55:0/4016564262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c0c6f90 con 0x7f540c0d1120 2023-08-25T04:03:54.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.795+0000 7f5413379640 1 -- 172.21.15.55:0/4016564262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540c0c7180 con 0x7f540c0d1120 2023-08-25T04:03:54.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.799+0000 7f5402ffd640 1 -- 172.21.15.55:0/4016564262 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f53fc00f3c0 con 0x7f540c0d1120 2023-08-25T04:03:54.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.799+0000 7f5402ffd640 1 --2- 172.21.15.55:0/4016564262 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f53f0065680 0x7f53f0067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:54.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.799+0000 7f5402ffd640 1 -- 172.21.15.55:0/4016564262 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f53fc082ac0 con 0x7f540c0d1120 2023-08-25T04:03:54.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.799+0000 7f5412377640 1 --2- 172.21.15.55:0/4016564262 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f53f0065680 0x7f53f0067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:54.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.799+0000 7f5412377640 1 --2- 172.21.15.55:0/4016564262 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f53f0065680 0x7f53f0067b40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5408006fd0 tx=0x7f5408008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:54.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:54.803+0000 7f5402ffd640 1 -- 172.21.15.55:0/4016564262 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f53fc0508c0 con 0x7f540c0d1120 2023-08-25T04:03:55.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.015+0000 7f5413379640 1 -- 172.21.15.55:0/4016564262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f540c073e50 con 0x7f540c0d1120 2023-08-25T04:03:55.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.019+0000 7f5402ffd640 1 -- 172.21.15.55:0/4016564262 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f53fc053ee0 con 0x7f540c0d1120 2023-08-25T04:03:55.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.023+0000 7f5413379640 1 -- 172.21.15.55:0/4016564262 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f53f0065680 msgr2=0x7f53f0067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:55.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.023+0000 7f5413379640 1 --2- 172.21.15.55:0/4016564262 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f53f0065680 0x7f53f0067b40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5408006fd0 tx=0x7f5408008040 comp rx=0 tx=0).stop 2023-08-25T04:03:55.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.023+0000 7f5413379640 1 -- 172.21.15.55:0/4016564262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f540c0d1120 msgr2=0x7f540c0cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:55.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.023+0000 7f5413379640 1 --2- 172.21.15.55:0/4016564262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f540c0d1120 0x7f540c0cf520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00b550 tx=0x7f53fc00ba10 comp rx=0 tx=0).stop 2023-08-25T04:03:55.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.023+0000 7f5413379640 1 -- 172.21.15.55:0/4016564262 shutdown_connections 2023-08-25T04:03:55.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.023+0000 7f5413379640 1 --2- 172.21.15.55:0/4016564262 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f53f0065680 0x7f53f0067b40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.023+0000 7f5413379640 1 --2- 172.21.15.55:0/4016564262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f540c15ca50 0x7f540c15a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.023+0000 7f5413379640 1 --2- 172.21.15.55:0/4016564262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f540c0d1120 0x7f540c0cf520 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.023+0000 7f5413379640 1 --2- 172.21.15.55:0/4016564262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f540c06c150 0x7f540c0ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.023+0000 7f5413379640 1 -- 172.21.15.55:0/4016564262 >> 172.21.15.55:0/4016564262 conn(0x7f540c065f40 msgr2=0x7f540c157f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:55.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.023+0000 7f5413379640 1 -- 172.21.15.55:0/4016564262 shutdown_connections 2023-08-25T04:03:55.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.023+0000 7f5413379640 1 -- 172.21.15.55:0/4016564262 wait complete. 2023-08-25T04:03:55.043 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:55.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.187+0000 7faef1226640 1 Processor -- start 2023-08-25T04:03:55.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.187+0000 7faef1226640 1 -- start start 2023-08-25T04:03:55.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.187+0000 7faef1226640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faeec15c9f0 0x7faeec0b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:55.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.187+0000 7faef1226640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeec0cdd30 0x7faeec0ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:55.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.187+0000 7faef1226640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeec0b4b20 con 0x7faeec0d0340 2023-08-25T04:03:55.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.187+0000 7faef1226640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeec0b4e00 con 0x7faeec15c9f0 2023-08-25T04:03:55.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.187+0000 7faef1226640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec0cd530 con 0x7faeec0cdd30 2023-08-25T04:03:55.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.187+0000 7faeebfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faeec15c9f0 0x7faeec0b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:55.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.187+0000 7faeebfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faeec15c9f0 0x7faeec0b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55634/0 (socket says 172.21.15.55:55634) 2023-08-25T04:03:55.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.187+0000 7faeeb7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faeec0d0340 0x7faeec06a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48760/0 (socket says 172.21.15.55:48760) 2023-08-25T04:03:55.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.187+0000 7faeebfff640 1 -- 172.21.15.55:0/3553853369 learned_addr learned my addr 172.21.15.55:0/3553853369 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:55.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.187+0000 7faef0a25640 1 --2- 172.21.15.55:0/3553853369 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeec0cdd30 0x7faeec0ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:55.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.187+0000 7faeebfff640 1 -- 172.21.15.55:0/3553853369 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeec0cdd30 msgr2=0x7faeec0ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:55.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.187+0000 7faeebfff640 1 --2- 172.21.15.55:0/3553853369 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeec0cdd30 0x7faeec0ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.187+0000 7faeebfff640 1 -- 172.21.15.55:0/3553853369 >> v1:172.21.15.55:6789/0 conn(0x7faeec0d0340 legacy=0x7faeec06a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:55.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.187+0000 7faeebfff640 1 -- 172.21.15.55:0/3553853369 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec0cd810 con 0x7faeec15c9f0 2023-08-25T04:03:55.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.191+0000 7faeebfff640 1 --2- 172.21.15.55:0/3553853369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec15c9f0 0x7faeec0b1ac0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faedc006fd0 tx=0x7faedc01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c824a5009d6ce7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:55.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.191+0000 7faeeaffd640 1 -- 172.21.15.55:0/3553853369 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc0a8a10 con 0x7faeec15c9f0 2023-08-25T04:03:55.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.191+0000 7faeeaffd640 1 -- 172.21.15.55:0/3553853369 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc0a8b70 con 0x7faeec15c9f0 2023-08-25T04:03:55.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.191+0000 7faeeaffd640 1 -- 172.21.15.55:0/3553853369 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc0b0440 con 0x7faeec15c9f0 2023-08-25T04:03:55.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.191+0000 7faef1226640 1 -- 172.21.15.55:0/3553853369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec15c9f0 msgr2=0x7faeec0b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:55.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.191+0000 7faef1226640 1 --2- 172.21.15.55:0/3553853369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec15c9f0 0x7faeec0b1ac0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7faedc006fd0 tx=0x7faedc01ed10 comp rx=0 tx=0).stop 2023-08-25T04:03:55.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.191+0000 7faef1226640 1 -- 172.21.15.55:0/3553853369 shutdown_connections 2023-08-25T04:03:55.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.191+0000 7faef1226640 1 --2- 172.21.15.55:0/3553853369 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeec0cdd30 0x7faeec0ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.191+0000 7faef1226640 1 --2- 172.21.15.55:0/3553853369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec15c9f0 0x7faeec0b1ac0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.191+0000 7faef1226640 1 -- 172.21.15.55:0/3553853369 >> 172.21.15.55:0/3553853369 conn(0x7faeec0d25f0 msgr2=0x7faeec0d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:55.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.191+0000 7faef1226640 1 -- 172.21.15.55:0/3553853369 shutdown_connections 2023-08-25T04:03:55.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.191+0000 7faef1226640 1 -- 172.21.15.55:0/3553853369 wait complete. 2023-08-25T04:03:55.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef1226640 1 Processor -- start 2023-08-25T04:03:55.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef1226640 1 -- start start 2023-08-25T04:03:55.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef1226640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeec0cdd30 0x7faeec1f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:55.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef1226640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeec0d0340 0x7faeec0c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:55.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef1226640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec15c9f0 0x7faeec0b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:55.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef1226640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec0b6450 con 0x7faeec15c9f0 2023-08-25T04:03:55.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef1226640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec0c8f40 con 0x7faeec0d0340 2023-08-25T04:03:55.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef1226640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec0b53b0 con 0x7faeec0cdd30 2023-08-25T04:03:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef0a25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec15c9f0 0x7faeec0b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef0a25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec15c9f0 0x7faeec0b6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55640/0 (socket says 172.21.15.55:55640) 2023-08-25T04:03:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef0a25640 1 -- 172.21.15.55:0/4068897448 learned_addr learned my addr 172.21.15.55:0/4068897448 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:55.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faeebfff640 1 --2- 172.21.15.55:0/4068897448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeec0cdd30 0x7faeec1f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:55.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faeeb7fe640 1 --2- 172.21.15.55:0/4068897448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeec0d0340 0x7faeec0c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:55.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef0a25640 1 -- 172.21.15.55:0/4068897448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeec0cdd30 msgr2=0x7faeec1f29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:55.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef0a25640 1 --2- 172.21.15.55:0/4068897448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeec0cdd30 0x7faeec1f29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef0a25640 1 -- 172.21.15.55:0/4068897448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeec0d0340 msgr2=0x7faeec0c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:55.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef0a25640 1 --2- 172.21.15.55:0/4068897448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeec0d0340 0x7faeec0c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef0a25640 1 -- 172.21.15.55:0/4068897448 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc009480 con 0x7faeec15c9f0 2023-08-25T04:03:55.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef0a25640 1 --2- 172.21.15.55:0/4068897448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec15c9f0 0x7faeec0b6610 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faee4007e40 tx=0x7faee400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:55.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faee8ff9640 1 -- 172.21.15.55:0/4068897448 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4014620 con 0x7faeec15c9f0 2023-08-25T04:03:55.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faee8ff9640 1 -- 172.21.15.55:0/4068897448 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee400ee90 con 0x7faeec15c9f0 2023-08-25T04:03:55.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faee8ff9640 1 -- 172.21.15.55:0/4068897448 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee40149e0 con 0x7faeec15c9f0 2023-08-25T04:03:55.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef1226640 1 -- 172.21.15.55:0/4068897448 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeec0b5690 con 0x7faeec15c9f0 2023-08-25T04:03:55.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.195+0000 7faef1226640 1 -- 172.21.15.55:0/4068897448 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeec0b5c50 con 0x7faeec15c9f0 2023-08-25T04:03:55.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.199+0000 7faef1226640 1 -- 172.21.15.55:0/4068897448 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeec15a150 con 0x7faeec15c9f0 2023-08-25T04:03:55.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.199+0000 7faee8ff9640 1 -- 172.21.15.55:0/4068897448 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7faee4014b40 con 0x7faeec15c9f0 2023-08-25T04:03:55.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.199+0000 7faee8ff9640 1 --2- 172.21.15.55:0/4068897448 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7faed8065680 0x7faed8067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:55.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.199+0000 7faee8ff9640 1 -- 172.21.15.55:0/4068897448 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7faee4083330 con 0x7faeec15c9f0 2023-08-25T04:03:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.199+0000 7faeebfff640 1 --2- 172.21.15.55:0/4068897448 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7faed8065680 0x7faed8067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.199+0000 7faeebfff640 1 --2- 172.21.15.55:0/4068897448 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7faed8065680 0x7faed8067b40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faedc0b2000 tx=0x7faedc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:55.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.203+0000 7faee8ff9640 1 -- 172.21.15.55:0/4068897448 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7faee40511f0 con 0x7faeec15c9f0 2023-08-25T04:03:55.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.359+0000 7faef1226640 1 -- 172.21.15.55:0/4068897448 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faeec0d23a0 con 0x7faeec15c9f0 2023-08-25T04:03:55.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.363+0000 7faee8ff9640 1 -- 172.21.15.55:0/4068897448 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+14651 (secure 0 0 0) 0x7faee4054810 con 0x7faeec15c9f0 2023-08-25T04:03:55.364 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:55.364 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":34,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:52.194205+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:55.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.363+0000 7faef1226640 1 -- 172.21.15.55:0/4068897448 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7faed8065680 msgr2=0x7faed8067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:55.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.363+0000 7faef1226640 1 --2- 172.21.15.55:0/4068897448 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7faed8065680 0x7faed8067b40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faedc0b2000 tx=0x7faedc009040 comp rx=0 tx=0).stop 2023-08-25T04:03:55.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.363+0000 7faef1226640 1 -- 172.21.15.55:0/4068897448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec15c9f0 msgr2=0x7faeec0b6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:55.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.363+0000 7faef1226640 1 --2- 172.21.15.55:0/4068897448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec15c9f0 0x7faeec0b6610 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7faee4007e40 tx=0x7faee400e4b0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.363+0000 7faef1226640 1 -- 172.21.15.55:0/4068897448 shutdown_connections 2023-08-25T04:03:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.363+0000 7faef1226640 1 --2- 172.21.15.55:0/4068897448 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7faed8065680 0x7faed8067b40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.363+0000 7faef1226640 1 --2- 172.21.15.55:0/4068897448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeec15c9f0 0x7faeec0b6610 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.363+0000 7faef1226640 1 --2- 172.21.15.55:0/4068897448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faeec0d0340 0x7faeec0c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.363+0000 7faef1226640 1 --2- 172.21.15.55:0/4068897448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faeec0cdd30 0x7faeec1f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.363+0000 7faef1226640 1 -- 172.21.15.55:0/4068897448 >> 172.21.15.55:0/4068897448 conn(0x7faeec0d25f0 msgr2=0x7faeec06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.363+0000 7faef1226640 1 -- 172.21.15.55:0/4068897448 shutdown_connections 2023-08-25T04:03:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.363+0000 7faef1226640 1 -- 172.21.15.55:0/4068897448 wait complete. 2023-08-25T04:03:55.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:03:55.387 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:03:55.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.531+0000 7f58963fa640 1 Processor -- start 2023-08-25T04:03:55.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.531+0000 7f58963fa640 1 -- start start 2023-08-25T04:03:55.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.531+0000 7f58963fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58900cb020 0x7f58900c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.531+0000 7f58963fa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f589006c720 0x7f589006cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.531+0000 7f58963fa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589006d0b0 con 0x7f58900cdd50 2023-08-25T04:03:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.531+0000 7f58963fa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58900cbca0 con 0x7f589006c720 2023-08-25T04:03:55.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.531+0000 7f58963fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58900c9470 con 0x7f58900cb020 2023-08-25T04:03:55.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.531+0000 7f588ffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58900cb020 0x7f58900c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:55.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.531+0000 7f5894997640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f589006c720 0x7f589006cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:55.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.531+0000 7f5894997640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f589006c720 0x7f589006cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:49888/0 (socket says 172.21.15.55:49888) 2023-08-25T04:03:55.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.531+0000 7f588ffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58900cb020 0x7f58900c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:43574/0 (socket says 172.21.15.55:43574) 2023-08-25T04:03:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.531+0000 7f5894997640 1 -- 172.21.15.55:0/1086215891 learned_addr learned my addr 172.21.15.55:0/1086215891 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.531+0000 7f5894997640 1 -- 172.21.15.55:0/1086215891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58900cb020 msgr2=0x7f58900c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:55.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.531+0000 7f5894997640 1 --2- 172.21.15.55:0/1086215891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58900cb020 0x7f58900c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.531+0000 7f5894997640 1 -- 172.21.15.55:0/1086215891 >> v1:172.21.15.110:6789/0 conn(0x7f58900cdd50 legacy=0x7f58900cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.531+0000 7f5894997640 1 -- 172.21.15.55:0/1086215891 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58900ce1b0 con 0x7f589006c720 2023-08-25T04:03:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.531+0000 7f588ffff640 1 --2- 172.21.15.55:0/1086215891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58900cb020 0x7f58900c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:55.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.535+0000 7f5894997640 1 --2- 172.21.15.55:0/1086215891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f589006c720 0x7f589006cb70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5888009e50 tx=0x7f588801c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13a104d292037222 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:55.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.535+0000 7f588effd640 1 -- 172.21.15.55:0/1086215891 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58880a5730 con 0x7f589006c720 2023-08-25T04:03:55.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.535+0000 7f588effd640 1 -- 172.21.15.55:0/1086215891 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58880a5890 con 0x7f589006c720 2023-08-25T04:03:55.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.535+0000 7f588effd640 1 -- 172.21.15.55:0/1086215891 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58880a5c20 con 0x7f589006c720 2023-08-25T04:03:55.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.535+0000 7f58963fa640 1 -- 172.21.15.55:0/1086215891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f589006c720 msgr2=0x7f589006cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:55.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.535+0000 7f58963fa640 1 --2- 172.21.15.55:0/1086215891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f589006c720 0x7f589006cb70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5888009e50 tx=0x7f588801c980 comp rx=0 tx=0).stop 2023-08-25T04:03:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.535+0000 7f58963fa640 1 -- 172.21.15.55:0/1086215891 shutdown_connections 2023-08-25T04:03:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.535+0000 7f58963fa640 1 --2- 172.21.15.55:0/1086215891 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f589006c720 0x7f589006cb70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.535+0000 7f58963fa640 1 --2- 172.21.15.55:0/1086215891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58900cb020 0x7f58900c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.535+0000 7f58963fa640 1 -- 172.21.15.55:0/1086215891 >> 172.21.15.55:0/1086215891 conn(0x7f5890069900 msgr2=0x7f5890069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.535+0000 7f58963fa640 1 -- 172.21.15.55:0/1086215891 shutdown_connections 2023-08-25T04:03:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.535+0000 7f58963fa640 1 -- 172.21.15.55:0/1086215891 wait complete. 2023-08-25T04:03:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f58963fa640 1 Processor -- start 2023-08-25T04:03:55.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f58963fa640 1 -- start start 2023-08-25T04:03:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f58963fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f589006c720 0x7f5890098a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f58963fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58900cb020 0x7f58901f49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f58963fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58900cdd50 0x7f58901f8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f58963fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589009b0a0 con 0x7f58900cb020 2023-08-25T04:03:55.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f58963fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589009b340 con 0x7f589006c720 2023-08-25T04:03:55.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f58963fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589009b620 con 0x7f58900cdd50 2023-08-25T04:03:55.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f588f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58900cb020 0x7f58901f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:55.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f588f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58900cb020 0x7f58901f49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55644/0 (socket says 172.21.15.55:55644) 2023-08-25T04:03:55.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f588f7fe640 1 -- 172.21.15.55:0/936095419 learned_addr learned my addr 172.21.15.55:0/936095419 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:55.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f588ffff640 1 --2- 172.21.15.55:0/936095419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f589006c720 0x7f5890098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:55.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f5894997640 1 --2- 172.21.15.55:0/936095419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58900cdd50 0x7f58901f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:55.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f588f7fe640 1 -- 172.21.15.55:0/936095419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58900cdd50 msgr2=0x7f58901f8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:55.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f588f7fe640 1 --2- 172.21.15.55:0/936095419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58900cdd50 0x7f58901f8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f588f7fe640 1 -- 172.21.15.55:0/936095419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f589006c720 msgr2=0x7f5890098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:55.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f588f7fe640 1 --2- 172.21.15.55:0/936095419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f589006c720 0x7f5890098a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f588f7fe640 1 -- 172.21.15.55:0/936095419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58800093b0 con 0x7f58900cb020 2023-08-25T04:03:55.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f588f7fe640 1 --2- 172.21.15.55:0/936095419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58900cb020 0x7f58901f49c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f588400c3c0 tx=0x7f588400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:55.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f588cff9640 1 -- 172.21.15.55:0/936095419 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58840052d0 con 0x7f58900cb020 2023-08-25T04:03:55.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f588cff9640 1 -- 172.21.15.55:0/936095419 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5884005430 con 0x7f58900cb020 2023-08-25T04:03:55.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f588cff9640 1 -- 172.21.15.55:0/936095419 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884003840 con 0x7f58900cb020 2023-08-25T04:03:55.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.539+0000 7f58963fa640 1 -- 172.21.15.55:0/936095419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5888009b30 con 0x7f58900cb020 2023-08-25T04:03:55.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.543+0000 7f58963fa640 1 -- 172.21.15.55:0/936095419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58900c2f40 con 0x7f58900cb020 2023-08-25T04:03:55.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.543+0000 7f58963fa640 1 -- 172.21.15.55:0/936095419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5890073ec0 con 0x7f58900cb020 2023-08-25T04:03:55.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.543+0000 7f588cff9640 1 -- 172.21.15.55:0/936095419 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f58840039a0 con 0x7f58900cb020 2023-08-25T04:03:55.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.543+0000 7f588cff9640 1 --2- 172.21.15.55:0/936095419 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f587c065680 0x7f587c067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:55.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.543+0000 7f588cff9640 1 -- 172.21.15.55:0/936095419 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5884081e30 con 0x7f58900cb020 2023-08-25T04:03:55.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.543+0000 7f588ffff640 1 --2- 172.21.15.55:0/936095419 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f587c065680 0x7f587c067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:55.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.547+0000 7f588ffff640 1 --2- 172.21.15.55:0/936095419 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f587c065680 0x7f587c067b40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5880009cd0 tx=0x7f5880006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:55.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.547+0000 7f588cff9640 1 -- 172.21.15.55:0/936095419 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f588404fc50 con 0x7f58900cb020 2023-08-25T04:03:55.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.707+0000 7f58963fa640 1 -- 172.21.15.55:0/936095419 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f589006d0b0 con 0x7f58900cb020 2023-08-25T04:03:55.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.707+0000 7f588cff9640 1 -- 172.21.15.55:0/936095419 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5884017020 con 0x7f58900cb020 2023-08-25T04:03:55.710 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:03:55.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.711+0000 7f58963fa640 1 -- 172.21.15.55:0/936095419 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f587c065680 msgr2=0x7f587c067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:55.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.711+0000 7f58963fa640 1 --2- 172.21.15.55:0/936095419 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f587c065680 0x7f587c067b40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5880009cd0 tx=0x7f5880006f90 comp rx=0 tx=0).stop 2023-08-25T04:03:55.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.711+0000 7f58963fa640 1 -- 172.21.15.55:0/936095419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58900cb020 msgr2=0x7f58901f49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:55.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.711+0000 7f58963fa640 1 --2- 172.21.15.55:0/936095419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58900cb020 0x7f58901f49c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f588400c3c0 tx=0x7f588400c880 comp rx=0 tx=0).stop 2023-08-25T04:03:55.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.711+0000 7f58963fa640 1 -- 172.21.15.55:0/936095419 shutdown_connections 2023-08-25T04:03:55.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.711+0000 7f58963fa640 1 --2- 172.21.15.55:0/936095419 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f587c065680 0x7f587c067b40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.711+0000 7f58963fa640 1 --2- 172.21.15.55:0/936095419 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58900cdd50 0x7f58901f8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.711+0000 7f58963fa640 1 --2- 172.21.15.55:0/936095419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58900cb020 0x7f58901f49c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.711+0000 7f58963fa640 1 --2- 172.21.15.55:0/936095419 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f589006c720 0x7f5890098a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.711+0000 7f58963fa640 1 -- 172.21.15.55:0/936095419 >> 172.21.15.55:0/936095419 conn(0x7f5890069900 msgr2=0x7f5890069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:55.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.711+0000 7f58963fa640 1 -- 172.21.15.55:0/936095419 shutdown_connections 2023-08-25T04:03:55.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.711+0000 7f58963fa640 1 -- 172.21.15.55:0/936095419 wait complete. 2023-08-25T04:03:55.731 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:03:55.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.875+0000 7f39aa7e1640 1 Processor -- start 2023-08-25T04:03:55.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.875+0000 7f39aa7e1640 1 -- start start 2023-08-25T04:03:55.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.875+0000 7f39aa7e1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a415e3c0 0x7f39a415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:55.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.875+0000 7f39aa7e1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f39a40d1290 0x7f39a415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:55.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.875+0000 7f39aa7e1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a40cd5a0 con 0x7f39a41601f0 2023-08-25T04:03:55.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.875+0000 7f39aa7e1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a40cd880 con 0x7f39a40d1290 2023-08-25T04:03:55.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.875+0000 7f39aa7e1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a40cdb60 con 0x7f39a415e3c0 2023-08-25T04:03:55.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.875+0000 7f39a8d7e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f39a40d1290 0x7f39a415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:55.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.875+0000 7f39a8d7e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f39a40d1290 0x7f39a415e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55652/0 (socket says 172.21.15.55:55652) 2023-08-25T04:03:55.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.875+0000 7f39a8d7e640 1 -- 172.21.15.55:0/3293644671 learned_addr learned my addr 172.21.15.55:0/3293644671 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:55.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.875+0000 7f39a37fe640 1 --2- 172.21.15.55:0/3293644671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a415e3c0 0x7f39a415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:55.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.875+0000 7f39a8d7e640 1 -- 172.21.15.55:0/3293644671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a415e3c0 msgr2=0x7f39a415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:55.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.875+0000 7f39a8d7e640 1 --2- 172.21.15.55:0/3293644671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a415e3c0 0x7f39a415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.875+0000 7f39a8d7e640 1 -- 172.21.15.55:0/3293644671 >> v1:172.21.15.55:6789/0 conn(0x7f39a41601f0 legacy=0x7f39a40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:55.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.875+0000 7f39a8d7e640 1 -- 172.21.15.55:0/3293644671 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a40cde40 con 0x7f39a40d1290 2023-08-25T04:03:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.879+0000 7f39a8d7e640 1 --2- 172.21.15.55:0/3293644671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a40d1290 0x7f39a415e8a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f399c009e50 tx=0x7f399c01f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcce8b1184e19a8a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:55.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.879+0000 7f39a2ffd640 1 -- 172.21.15.55:0/3293644671 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c0af400 con 0x7f39a40d1290 2023-08-25T04:03:55.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.879+0000 7f39a2ffd640 1 -- 172.21.15.55:0/3293644671 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c0ab050 con 0x7f39a40d1290 2023-08-25T04:03:55.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.879+0000 7f39a2ffd640 1 -- 172.21.15.55:0/3293644671 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c0af780 con 0x7f39a40d1290 2023-08-25T04:03:55.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.879+0000 7f39aa7e1640 1 -- 172.21.15.55:0/3293644671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a40d1290 msgr2=0x7f39a415e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:55.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.879+0000 7f39aa7e1640 1 --2- 172.21.15.55:0/3293644671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a40d1290 0x7f39a415e8a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f399c009e50 tx=0x7f399c01f1f0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.879+0000 7f39aa7e1640 1 -- 172.21.15.55:0/3293644671 shutdown_connections 2023-08-25T04:03:55.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.879+0000 7f39aa7e1640 1 --2- 172.21.15.55:0/3293644671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a415e3c0 0x7f39a415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.879+0000 7f39aa7e1640 1 --2- 172.21.15.55:0/3293644671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a40d1290 0x7f39a415e8a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.879+0000 7f39aa7e1640 1 -- 172.21.15.55:0/3293644671 >> 172.21.15.55:0/3293644671 conn(0x7f39a40d27d0 msgr2=0x7f39a40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:55.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.879+0000 7f39aa7e1640 1 -- 172.21.15.55:0/3293644671 shutdown_connections 2023-08-25T04:03:55.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.879+0000 7f39aa7e1640 1 -- 172.21.15.55:0/3293644671 wait complete. 2023-08-25T04:03:55.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39aa7e1640 1 Processor -- start 2023-08-25T04:03:55.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39aa7e1640 1 -- start start 2023-08-25T04:03:55.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39aa7e1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a40d1290 0x7f39a415a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:55.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39aa7e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a415e3c0 0x7f39a40ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:55.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39aa7e1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a41601f0 0x7f39a40cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:55.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39aa7e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a40c6680 con 0x7f39a415e3c0 2023-08-25T04:03:55.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39aa7e1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a415b750 con 0x7f39a41601f0 2023-08-25T04:03:55.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39aa7e1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a415b190 con 0x7f39a40d1290 2023-08-25T04:03:55.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39a37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a415e3c0 0x7f39a40ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:55.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39a37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a415e3c0 0x7f39a40ca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55656/0 (socket says 172.21.15.55:55656) 2023-08-25T04:03:55.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39a37fe640 1 -- 172.21.15.55:0/1679475321 learned_addr learned my addr 172.21.15.55:0/1679475321 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:55.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39a3fff640 1 --2- 172.21.15.55:0/1679475321 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a40d1290 0x7f39a415a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:55.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39a8d7e640 1 --2- 172.21.15.55:0/1679475321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a41601f0 0x7f39a40cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:55.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39a37fe640 1 -- 172.21.15.55:0/1679475321 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a40d1290 msgr2=0x7f39a415a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:55.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39a37fe640 1 --2- 172.21.15.55:0/1679475321 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a40d1290 0x7f39a415a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39a37fe640 1 -- 172.21.15.55:0/1679475321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a41601f0 msgr2=0x7f39a40cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:55.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39a37fe640 1 --2- 172.21.15.55:0/1679475321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a41601f0 0x7f39a40cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:55.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39a37fe640 1 -- 172.21.15.55:0/1679475321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c009b30 con 0x7f39a415e3c0 2023-08-25T04:03:55.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39a3fff640 1 --2- 172.21.15.55:0/1679475321 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a40d1290 0x7f39a415a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:55.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39a8d7e640 1 --2- 172.21.15.55:0/1679475321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a41601f0 0x7f39a40cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:55.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39a37fe640 1 --2- 172.21.15.55:0/1679475321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a415e3c0 0x7f39a40ca860 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f399800d800 tx=0x7f399800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:55.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39a0ff9640 1 -- 172.21.15.55:0/1679475321 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399800b6c0 con 0x7f39a415e3c0 2023-08-25T04:03:55.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39a0ff9640 1 -- 172.21.15.55:0/1679475321 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399800b820 con 0x7f39a415e3c0 2023-08-25T04:03:55.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39aa7e1640 1 -- 172.21.15.55:0/1679475321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a40ce7c0 con 0x7f39a415e3c0 2023-08-25T04:03:55.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39a0ff9640 1 -- 172.21.15.55:0/1679475321 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399800bb90 con 0x7f39a415e3c0 2023-08-25T04:03:55.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.883+0000 7f39aa7e1640 1 -- 172.21.15.55:0/1679475321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a40c6310 con 0x7f39a415e3c0 2023-08-25T04:03:55.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.887+0000 7f39aa7e1640 1 -- 172.21.15.55:0/1679475321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a40b5260 con 0x7f39a415e3c0 2023-08-25T04:03:55.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.887+0000 7f39a0ff9640 1 -- 172.21.15.55:0/1679475321 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f399800bcf0 con 0x7f39a415e3c0 2023-08-25T04:03:55.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.887+0000 7f39a0ff9640 1 --2- 172.21.15.55:0/1679475321 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3990065680 0x7f3990067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:55.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.887+0000 7f39a0ff9640 1 -- 172.21.15.55:0/1679475321 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f39980830f0 con 0x7f39a415e3c0 2023-08-25T04:03:55.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.887+0000 7f39a3fff640 1 --2- 172.21.15.55:0/1679475321 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3990065680 0x7f3990067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:55.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.887+0000 7f39a3fff640 1 --2- 172.21.15.55:0/1679475321 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3990065680 0x7f3990067b40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3994000fe0 tx=0x7f3994009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:55.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:55.891+0000 7f39a0ff9640 1 -- 172.21.15.55:0/1679475321 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f39980548f0 con 0x7f39a415e3c0 2023-08-25T04:03:56.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.051+0000 7f39aa7e1640 1 -- 172.21.15.55:0/1679475321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f39a4073ec0 con 0x7f39a415e3c0 2023-08-25T04:03:56.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.051+0000 7f39a0ff9640 1 -- 172.21.15.55:0/1679475321 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v34) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3998011340 con 0x7f39a415e3c0 2023-08-25T04:03:56.053 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:03:56.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.051+0000 7f39aa7e1640 1 -- 172.21.15.55:0/1679475321 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3990065680 msgr2=0x7f3990067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:56.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.051+0000 7f39aa7e1640 1 --2- 172.21.15.55:0/1679475321 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3990065680 0x7f3990067b40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3994000fe0 tx=0x7f3994009040 comp rx=0 tx=0).stop 2023-08-25T04:03:56.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.051+0000 7f39aa7e1640 1 -- 172.21.15.55:0/1679475321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a415e3c0 msgr2=0x7f39a40ca860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:56.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.051+0000 7f39aa7e1640 1 --2- 172.21.15.55:0/1679475321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a415e3c0 0x7f39a40ca860 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f399800d800 tx=0x7f399800dcc0 comp rx=0 tx=0).stop 2023-08-25T04:03:56.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.051+0000 7f39aa7e1640 1 -- 172.21.15.55:0/1679475321 shutdown_connections 2023-08-25T04:03:56.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.051+0000 7f39aa7e1640 1 --2- 172.21.15.55:0/1679475321 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f3990065680 0x7f3990067b40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:56.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.051+0000 7f39aa7e1640 1 --2- 172.21.15.55:0/1679475321 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a41601f0 0x7f39a40cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:56.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.051+0000 7f39aa7e1640 1 --2- 172.21.15.55:0/1679475321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a415e3c0 0x7f39a40ca860 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:56.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.051+0000 7f39aa7e1640 1 --2- 172.21.15.55:0/1679475321 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a40d1290 0x7f39a415a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:56.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.051+0000 7f39aa7e1640 1 -- 172.21.15.55:0/1679475321 >> 172.21.15.55:0/1679475321 conn(0x7f39a40d27d0 msgr2=0x7f39a406bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:56.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.051+0000 7f39aa7e1640 1 -- 172.21.15.55:0/1679475321 shutdown_connections 2023-08-25T04:03:56.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.051+0000 7f39aa7e1640 1 -- 172.21.15.55:0/1679475321 wait complete. 2023-08-25T04:03:56.074 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-25T04:03:56.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.215+0000 7f66d5419640 1 Processor -- start 2023-08-25T04:03:56.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.215+0000 7f66d5419640 1 -- start start 2023-08-25T04:03:56.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.215+0000 7f66d5419640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66d015eba0 0x7f66d00b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:56.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.215+0000 7f66d5419640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f66d00ceeb0 0x7f66d00ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:56.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.215+0000 7f66d5419640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d00ac3a0 con 0x7f66d015ef80 2023-08-25T04:03:56.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.215+0000 7f66d5419640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d00b1390 con 0x7f66d015eba0 2023-08-25T04:03:56.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.215+0000 7f66d5419640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d00b1670 con 0x7f66d00ceeb0 2023-08-25T04:03:56.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.215+0000 7f66ceffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66d015eba0 0x7f66d00b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:56.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.215+0000 7f66ceffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66d015eba0 0x7f66d00b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55670/0 (socket says 172.21.15.55:55670) 2023-08-25T04:03:56.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.215+0000 7f66ceffd640 1 -- 172.21.15.55:0/459095491 learned_addr learned my addr 172.21.15.55:0/459095491 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:56.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.215+0000 7f66cf7fe640 1 --2- 172.21.15.55:0/459095491 >> v2:172.21.15.110:3300/0 conn(0x7f66d00ceeb0 0x7f66d00ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:56.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.215+0000 7f66ceffd640 1 -- 172.21.15.55:0/459095491 >> v2:172.21.15.110:3300/0 conn(0x7f66d00ceeb0 msgr2=0x7f66d00ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:56.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.215+0000 7f66ceffd640 1 --2- 172.21.15.55:0/459095491 >> v2:172.21.15.110:3300/0 conn(0x7f66d00ceeb0 0x7f66d00ab0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:56.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.215+0000 7f66ceffd640 1 -- 172.21.15.55:0/459095491 >> v1:172.21.15.110:6789/0 conn(0x7f66d015ef80 legacy=0x7f66d00ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:56.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.219+0000 7f66ceffd640 1 -- 172.21.15.55:0/459095491 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d00b1950 con 0x7f66d015eba0 2023-08-25T04:03:56.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.219+0000 7f66cf7fe640 1 --2- 172.21.15.55:0/459095491 >> v2:172.21.15.110:3300/0 conn(0x7f66d00ceeb0 0x7f66d00ab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:56.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.219+0000 7f66ceffd640 1 --2- 172.21.15.55:0/459095491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d015eba0 0x7f66d00b2a40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f66d00c5400 tx=0x7f66c001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ae2b40587b909f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:56.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.219+0000 7f66ce7fc640 1 -- 172.21.15.55:0/459095491 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c00aa5f0 con 0x7f66d015eba0 2023-08-25T04:03:56.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.219+0000 7f66ce7fc640 1 -- 172.21.15.55:0/459095491 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c00aa750 con 0x7f66d015eba0 2023-08-25T04:03:56.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.219+0000 7f66ce7fc640 1 -- 172.21.15.55:0/459095491 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c00aaae0 con 0x7f66d015eba0 2023-08-25T04:03:56.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.219+0000 7f66d5419640 1 -- 172.21.15.55:0/459095491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d015eba0 msgr2=0x7f66d00b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:56.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.219+0000 7f66d5419640 1 --2- 172.21.15.55:0/459095491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d015eba0 0x7f66d00b2a40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f66d00c5400 tx=0x7f66c001c490 comp rx=0 tx=0).stop 2023-08-25T04:03:56.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.219+0000 7f66d5419640 1 -- 172.21.15.55:0/459095491 shutdown_connections 2023-08-25T04:03:56.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.219+0000 7f66d5419640 1 --2- 172.21.15.55:0/459095491 >> v2:172.21.15.110:3300/0 conn(0x7f66d00ceeb0 0x7f66d00ab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:56.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.219+0000 7f66d5419640 1 --2- 172.21.15.55:0/459095491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d015eba0 0x7f66d00b2a40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:56.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.219+0000 7f66d5419640 1 -- 172.21.15.55:0/459095491 >> 172.21.15.55:0/459095491 conn(0x7f66d0069d00 msgr2=0x7f66d006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:56.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66d5419640 1 -- 172.21.15.55:0/459095491 shutdown_connections 2023-08-25T04:03:56.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66d5419640 1 -- 172.21.15.55:0/459095491 wait complete. 2023-08-25T04:03:56.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66d5419640 1 Processor -- start 2023-08-25T04:03:56.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66d5419640 1 -- start start 2023-08-25T04:03:56.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66d5419640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d00ceeb0 0x7f66d015ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:56.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66d5419640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d015eba0 0x7f66d00cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:56.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66d5419640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66d015ef80 0x7f66d00cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:56.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66d5419640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d015ccc0 con 0x7f66d015eba0 2023-08-25T04:03:56.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66d5419640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d01f4e60 con 0x7f66d00ceeb0 2023-08-25T04:03:56.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66d5419640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d015b840 con 0x7f66d015ef80 2023-08-25T04:03:56.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66c67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d015eba0 0x7f66d00cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:56.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66c67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d015eba0 0x7f66d00cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55678/0 (socket says 172.21.15.55:55678) 2023-08-25T04:03:56.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66c67fc640 1 -- 172.21.15.55:0/2406858934 learned_addr learned my addr 172.21.15.55:0/2406858934 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:56.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66ceffd640 1 --2- 172.21.15.55:0/2406858934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d00ceeb0 0x7f66d015ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:56.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66cf7fe640 1 --2- 172.21.15.55:0/2406858934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66d015ef80 0x7f66d00cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:56.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66c67fc640 1 -- 172.21.15.55:0/2406858934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66d015ef80 msgr2=0x7f66d00cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:56.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66c67fc640 1 --2- 172.21.15.55:0/2406858934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66d015ef80 0x7f66d00cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:56.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66c67fc640 1 -- 172.21.15.55:0/2406858934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d00ceeb0 msgr2=0x7f66d015ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:56.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66c67fc640 1 --2- 172.21.15.55:0/2406858934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d00ceeb0 0x7f66d015ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:56.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66c67fc640 1 -- 172.21.15.55:0/2406858934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c00094d0 con 0x7f66d015eba0 2023-08-25T04:03:56.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66c67fc640 1 --2- 172.21.15.55:0/2406858934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d015eba0 0x7f66d00cb070 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f66b800c7c0 tx=0x7f66b800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:56.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.223+0000 7f66c7fff640 1 -- 172.21.15.55:0/2406858934 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b800aa50 con 0x7f66d015eba0 2023-08-25T04:03:56.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.227+0000 7f66c7fff640 1 -- 172.21.15.55:0/2406858934 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b800abb0 con 0x7f66d015eba0 2023-08-25T04:03:56.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.227+0000 7f66c7fff640 1 -- 172.21.15.55:0/2406858934 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8012420 con 0x7f66d015eba0 2023-08-25T04:03:56.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.227+0000 7f66d5419640 1 -- 172.21.15.55:0/2406858934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d015b560 con 0x7f66d015eba0 2023-08-25T04:03:56.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.227+0000 7f66d5419640 1 -- 172.21.15.55:0/2406858934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d015d200 con 0x7f66d015eba0 2023-08-25T04:03:56.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.227+0000 7f66d5419640 1 -- 172.21.15.55:0/2406858934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d00adb30 con 0x7f66d015eba0 2023-08-25T04:03:56.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.227+0000 7f66c7fff640 1 -- 172.21.15.55:0/2406858934 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f66b8012580 con 0x7f66d015eba0 2023-08-25T04:03:56.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.227+0000 7f66c7fff640 1 --2- 172.21.15.55:0/2406858934 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f66b0065680 0x7f66b0067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:56.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.227+0000 7f66c7fff640 1 -- 172.21.15.55:0/2406858934 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f66b8082c80 con 0x7f66d015eba0 2023-08-25T04:03:56.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.227+0000 7f66ceffd640 1 --2- 172.21.15.55:0/2406858934 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f66b0065680 0x7f66b0067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:56.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.227+0000 7f66ceffd640 1 --2- 172.21.15.55:0/2406858934 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f66b0065680 0x7f66b0067b40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f66c00ae000 tx=0x7f66c00b5040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:56.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.231+0000 7f66c7fff640 1 -- 172.21.15.55:0/2406858934 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f66b8050a80 con 0x7f66d015eba0 2023-08-25T04:03:56.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.391+0000 7f66d5419640 1 -- 172.21.15.55:0/2406858934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f66d004dbe0 con 0x7f66d015eba0 2023-08-25T04:03:56.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.391+0000 7f66c7fff640 1 -- 172.21.15.55:0/2406858934 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+126 (secure 0 0 0) 0x7f66b8016090 con 0x7f66d015eba0 2023-08-25T04:03:56.394 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:56.394 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T04:03:56.395 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:56.395 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-08-25T04:03:56.395 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-08-25T04:03:56.395 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:03:56.395 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:03:56.396 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-08-25T04:03:56.396 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-08-25T04:03:56.396 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:03:56.396 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T04:03:56.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.395+0000 7f66d5419640 1 -- 172.21.15.55:0/2406858934 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f66b0065680 msgr2=0x7f66b0067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:56.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.395+0000 7f66d5419640 1 --2- 172.21.15.55:0/2406858934 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f66b0065680 0x7f66b0067b40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f66c00ae000 tx=0x7f66c00b5040 comp rx=0 tx=0).stop 2023-08-25T04:03:56.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.395+0000 7f66d5419640 1 -- 172.21.15.55:0/2406858934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d015eba0 msgr2=0x7f66d00cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:56.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.395+0000 7f66d5419640 1 --2- 172.21.15.55:0/2406858934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d015eba0 0x7f66d00cb070 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f66b800c7c0 tx=0x7f66b800cc80 comp rx=0 tx=0).stop 2023-08-25T04:03:56.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.395+0000 7f66d5419640 1 -- 172.21.15.55:0/2406858934 shutdown_connections 2023-08-25T04:03:56.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.395+0000 7f66d5419640 1 --2- 172.21.15.55:0/2406858934 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f66b0065680 0x7f66b0067b40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:56.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.395+0000 7f66d5419640 1 --2- 172.21.15.55:0/2406858934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66d015ef80 0x7f66d00cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:56.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.395+0000 7f66d5419640 1 --2- 172.21.15.55:0/2406858934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66d015eba0 0x7f66d00cb070 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:56.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.395+0000 7f66d5419640 1 --2- 172.21.15.55:0/2406858934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66d00ceeb0 0x7f66d015ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:56.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.395+0000 7f66d5419640 1 -- 172.21.15.55:0/2406858934 >> 172.21.15.55:0/2406858934 conn(0x7f66d0069d00 msgr2=0x7f66d0163820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:56.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.395+0000 7f66d5419640 1 -- 172.21.15.55:0/2406858934 shutdown_connections 2023-08-25T04:03:56.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.395+0000 7f66d5419640 1 -- 172.21.15.55:0/2406858934 wait complete. 2023-08-25T04:03:56.414 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-25T04:03:56.415 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-25T04:03:56.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.559+0000 7fc5ca434640 1 Processor -- start 2023-08-25T04:03:56.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.559+0000 7fc5ca434640 1 -- start start 2023-08-25T04:03:56.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.559+0000 7fc5ca434640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc5c40cf7b0 0x7fc5c40b6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:56.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.559+0000 7fc5ca434640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c40d1970 con 0x7fc5c415cb40 2023-08-25T04:03:56.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.559+0000 7fc5ca434640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c40d2790 con 0x7fc5c40cf340 2023-08-25T04:03:56.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.559+0000 7fc5ca434640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c40d0d80 con 0x7fc5c40cf7b0 2023-08-25T04:03:56.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.559+0000 7fc5c89d1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc5c40cf7b0 0x7fc5c40b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:56.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.559+0000 7fc5c3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc5c415cb40 0x7fc5c40d2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48778/0 (socket says 172.21.15.55:48778) 2023-08-25T04:03:56.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.559+0000 7fc5c3fff640 1 -- 172.21.15.55:0/3039176494 learned_addr learned my addr 172.21.15.55:0/3039176494 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:56.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.563+0000 7fc5c89d1640 1 -- 172.21.15.55:0/3039176494 >> v1:172.21.15.110:6789/0 conn(0x7fc5c40cf340 legacy=0x7fc5c40b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:56.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.563+0000 7fc5c89d1640 1 -- 172.21.15.55:0/3039176494 >> v1:172.21.15.55:6789/0 conn(0x7fc5c415cb40 legacy=0x7fc5c40d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:56.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.563+0000 7fc5c89d1640 1 -- 172.21.15.55:0/3039176494 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c40d1040 con 0x7fc5c40cf7b0 2023-08-25T04:03:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.563+0000 7fc5c2ffd640 1 -- 172.21.15.55:0/3039176494 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818970622 0 0) 0x7fc5c40d1970 con 0x7fc5c415cb40 2023-08-25T04:03:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.563+0000 7fc5c89d1640 1 --2- 172.21.15.55:0/3039176494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c40cf7b0 0x7fc5c40b6100 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009d90 tx=0x7fc5bc01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca5b50b138c9d75 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:56.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.563+0000 7fc5c2ffd640 1 -- 172.21.15.55:0/3039176494 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0af600 con 0x7fc5c40cf7b0 2023-08-25T04:03:56.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.563+0000 7fc5c2ffd640 1 -- 172.21.15.55:0/3039176494 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc0ab050 con 0x7fc5c40cf7b0 2023-08-25T04:03:56.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.563+0000 7fc5c2ffd640 1 -- 172.21.15.55:0/3039176494 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0af980 con 0x7fc5c40cf7b0 2023-08-25T04:03:56.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.563+0000 7fc5ca434640 1 -- 172.21.15.55:0/3039176494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c40cf7b0 msgr2=0x7fc5c40b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:56.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.563+0000 7fc5ca434640 1 --2- 172.21.15.55:0/3039176494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c40cf7b0 0x7fc5c40b6100 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009d90 tx=0x7fc5bc01f130 comp rx=0 tx=0).stop 2023-08-25T04:03:56.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.563+0000 7fc5ca434640 1 -- 172.21.15.55:0/3039176494 shutdown_connections 2023-08-25T04:03:56.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.563+0000 7fc5ca434640 1 --2- 172.21.15.55:0/3039176494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c40cf7b0 0x7fc5c40b6100 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:56.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5ca434640 1 -- 172.21.15.55:0/3039176494 >> 172.21.15.55:0/3039176494 conn(0x7fc5c406aae0 msgr2=0x7fc5c406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:56.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5ca434640 1 -- 172.21.15.55:0/3039176494 shutdown_connections 2023-08-25T04:03:56.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5ca434640 1 -- 172.21.15.55:0/3039176494 wait complete. 2023-08-25T04:03:56.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5ca434640 1 Processor -- start 2023-08-25T04:03:56.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5ca434640 1 -- start start 2023-08-25T04:03:56.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5ca434640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5c40cf340 0x7fc5c414db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:56.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5ca434640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5c40cf7b0 0x7fc5c40b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:56.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5ca434640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c415cb40 0x7fc5c40b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:56.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5ca434640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c415e280 con 0x7fc5c415cb40 2023-08-25T04:03:56.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5ca434640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40b3e00 con 0x7fc5c40cf7b0 2023-08-25T04:03:56.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5ca434640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40b2d60 con 0x7fc5c40cf340 2023-08-25T04:03:56.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5c89d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c415cb40 0x7fc5c40b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:56.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5c89d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c415cb40 0x7fc5c40b26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55684/0 (socket says 172.21.15.55:55684) 2023-08-25T04:03:56.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5c89d1640 1 -- 172.21.15.55:0/3628443144 learned_addr learned my addr 172.21.15.55:0/3628443144 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:56.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5c89d1640 1 -- 172.21.15.55:0/3628443144 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5c40cf340 msgr2=0x7fc5c414db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:56.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5c89d1640 1 --2- 172.21.15.55:0/3628443144 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5c40cf340 0x7fc5c414db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:56.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5c89d1640 1 -- 172.21.15.55:0/3628443144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5c40cf7b0 msgr2=0x7fc5c40b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:56.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5c89d1640 1 --2- 172.21.15.55:0/3628443144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5c40cf7b0 0x7fc5c40b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:56.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5c89d1640 1 -- 172.21.15.55:0/3628443144 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc009a70 con 0x7fc5c415cb40 2023-08-25T04:03:56.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.567+0000 7fc5c89d1640 1 --2- 172.21.15.55:0/3628443144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c415cb40 0x7fc5c40b26e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc01cd60 tx=0x7fc5bc01bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:56.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.571+0000 7fc5c0ff9640 1 -- 172.21.15.55:0/3628443144 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0b9610 con 0x7fc5c415cb40 2023-08-25T04:03:56.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.571+0000 7fc5c0ff9640 1 -- 172.21.15.55:0/3628443144 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc0b9770 con 0x7fc5c415cb40 2023-08-25T04:03:56.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.571+0000 7fc5c0ff9640 1 -- 172.21.15.55:0/3628443144 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0b9b00 con 0x7fc5c415cb40 2023-08-25T04:03:56.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.571+0000 7fc5ca434640 1 -- 172.21.15.55:0/3628443144 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c40b3040 con 0x7fc5c415cb40 2023-08-25T04:03:56.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.571+0000 7fc5ca434640 1 -- 172.21.15.55:0/3628443144 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c40b3600 con 0x7fc5c415cb40 2023-08-25T04:03:56.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.571+0000 7fc5ca434640 1 -- 172.21.15.55:0/3628443144 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c4071f80 con 0x7fc5c415cb40 2023-08-25T04:03:56.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.571+0000 7fc5c0ff9640 1 -- 172.21.15.55:0/3628443144 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc5bc0b6050 con 0x7fc5c415cb40 2023-08-25T04:03:56.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.571+0000 7fc5c0ff9640 1 --2- 172.21.15.55:0/3628443144 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc5b0065680 0x7fc5b0067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:56.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.571+0000 7fc5c0ff9640 1 -- 172.21.15.55:0/3628443144 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc5bc1212f0 con 0x7fc5c415cb40 2023-08-25T04:03:56.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.571+0000 7fc5c3fff640 1 --2- 172.21.15.55:0/3628443144 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc5b0065680 0x7fc5b0067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:56.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.575+0000 7fc5c3fff640 1 --2- 172.21.15.55:0/3628443144 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc5b0065680 0x7fc5b0067b40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4000c10 tx=0x7fc5b4007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:56.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.575+0000 7fc5c0ff9640 1 -- 172.21.15.55:0/3628443144 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc5bc0f2b30 con 0x7fc5c415cb40 2023-08-25T04:03:56.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:56.731+0000 7fc5ca434640 1 -- 172.21.15.55:0/3628443144 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc5c404dbe0 con 0x7fc5c415cb40 2023-08-25T04:03:56.979 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:03:56.984 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:03:57.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.359+0000 7fc5c0ff9640 1 -- 172.21.15.55:0/3628443144 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc5bc0f26c0 con 0x7fc5c415cb40 2023-08-25T04:03:57.360 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-08-25T04:03:57.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.363+0000 7fc5ca434640 1 -- 172.21.15.55:0/3628443144 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc5b0065680 msgr2=0x7fc5b0067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:57.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.363+0000 7fc5ca434640 1 --2- 172.21.15.55:0/3628443144 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc5b0065680 0x7fc5b0067b40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4000c10 tx=0x7fc5b4007910 comp rx=0 tx=0).stop 2023-08-25T04:03:57.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.363+0000 7fc5ca434640 1 -- 172.21.15.55:0/3628443144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c415cb40 msgr2=0x7fc5c40b26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:57.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.363+0000 7fc5ca434640 1 --2- 172.21.15.55:0/3628443144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c415cb40 0x7fc5c40b26e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc01cd60 tx=0x7fc5bc01bed0 comp rx=0 tx=0).stop 2023-08-25T04:03:57.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.363+0000 7fc5ca434640 1 -- 172.21.15.55:0/3628443144 shutdown_connections 2023-08-25T04:03:57.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.363+0000 7fc5ca434640 1 --2- 172.21.15.55:0/3628443144 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc5b0065680 0x7fc5b0067b40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:57.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.363+0000 7fc5ca434640 1 --2- 172.21.15.55:0/3628443144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c415cb40 0x7fc5c40b26e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:57.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.363+0000 7fc5ca434640 1 --2- 172.21.15.55:0/3628443144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5c40cf7b0 0x7fc5c40b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:57.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.363+0000 7fc5ca434640 1 --2- 172.21.15.55:0/3628443144 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5c40cf340 0x7fc5c414db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:57.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.363+0000 7fc5ca434640 1 -- 172.21.15.55:0/3628443144 >> 172.21.15.55:0/3628443144 conn(0x7fc5c406aae0 msgr2=0x7fc5c40b7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.367+0000 7fc5ca434640 1 -- 172.21.15.55:0/3628443144 shutdown_connections 2023-08-25T04:03:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.367+0000 7fc5ca434640 1 -- 172.21.15.55:0/3628443144 wait complete. 2023-08-25T04:03:57.392 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-25T04:03:57.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.543+0000 7fd1dbd3a640 1 Processor -- start 2023-08-25T04:03:57.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.543+0000 7fd1dbd3a640 1 -- start start 2023-08-25T04:03:57.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.543+0000 7fd1dbd3a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd1d40c1aa0 0x7fd1d406c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:57.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.543+0000 7fd1dbd3a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d4161440 con 0x7fd1d40ad7b0 2023-08-25T04:03:57.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.543+0000 7fd1dbd3a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d406cb20 con 0x7fd1d4164b30 2023-08-25T04:03:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.543+0000 7fd1dbd3a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d406ce00 con 0x7fd1d40c1aa0 2023-08-25T04:03:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.543+0000 7fd1d9ad6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd1d40ad7b0 0x7fd1d40c1390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48792/0 (socket says 172.21.15.55:48792) 2023-08-25T04:03:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.543+0000 7fd1d9ad6640 1 -- 172.21.15.55:0/3540946869 learned_addr learned my addr 172.21.15.55:0/3540946869 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.543+0000 7fd1d92d5640 1 --2- 172.21.15.55:0/3540946869 >> v2:172.21.15.110:3300/0 conn(0x7fd1d40c1aa0 0x7fd1d406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.543+0000 7fd1d8ad4640 1 -- 172.21.15.55:0/3540946869 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315059677 0 0) 0x7fd1d4161440 con 0x7fd1d40ad7b0 2023-08-25T04:03:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.543+0000 7fd1d8ad4640 1 -- 172.21.15.55:0/3540946869 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c0003530 con 0x7fd1d40ad7b0 2023-08-25T04:03:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.543+0000 7fd1d8ad4640 1 -- 172.21.15.55:0/3540946869 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897463980 0 0) 0x7fd1d406cb20 con 0x7fd1d4164b30 2023-08-25T04:03:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.543+0000 7fd1d8ad4640 1 -- 172.21.15.55:0/3540946869 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1d4161440 con 0x7fd1d4164b30 2023-08-25T04:03:57.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.543+0000 7fd1d92d5640 1 -- 172.21.15.55:0/3540946869 >> v1:172.21.15.110:6789/0 conn(0x7fd1d4164b30 legacy=0x7fd1d40c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:57.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.543+0000 7fd1d92d5640 1 -- 172.21.15.55:0/3540946869 >> v1:172.21.15.55:6789/0 conn(0x7fd1d40ad7b0 legacy=0x7fd1d40c1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:57.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.543+0000 7fd1d92d5640 1 -- 172.21.15.55:0/3540946869 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d406d0e0 con 0x7fd1d40c1aa0 2023-08-25T04:03:57.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.547+0000 7fd1d92d5640 1 --2- 172.21.15.55:0/3540946869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1d40c1aa0 0x7fd1d406c540 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40097c0 tx=0x7fd1c401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=644a5ca48ae8a42b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:57.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.547+0000 7fd1d8ad4640 1 -- 172.21.15.55:0/3540946869 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40a8970 con 0x7fd1d40c1aa0 2023-08-25T04:03:57.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.547+0000 7fd1d8ad4640 1 -- 172.21.15.55:0/3540946869 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c40a8ad0 con 0x7fd1d40c1aa0 2023-08-25T04:03:57.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.547+0000 7fd1d8ad4640 1 -- 172.21.15.55:0/3540946869 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40a8e60 con 0x7fd1d40c1aa0 2023-08-25T04:03:57.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.547+0000 7fd1dbd3a640 1 -- 172.21.15.55:0/3540946869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1d40c1aa0 msgr2=0x7fd1d406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:57.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.547+0000 7fd1dbd3a640 1 --2- 172.21.15.55:0/3540946869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1d40c1aa0 0x7fd1d406c540 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40097c0 tx=0x7fd1c401ec70 comp rx=0 tx=0).stop 2023-08-25T04:03:57.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.547+0000 7fd1dbd3a640 1 -- 172.21.15.55:0/3540946869 shutdown_connections 2023-08-25T04:03:57.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.547+0000 7fd1dbd3a640 1 --2- 172.21.15.55:0/3540946869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1d40c1aa0 0x7fd1d406c540 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:57.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.547+0000 7fd1dbd3a640 1 -- 172.21.15.55:0/3540946869 >> 172.21.15.55:0/3540946869 conn(0x7fd1d4069900 msgr2=0x7fd1d4069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:57.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.547+0000 7fd1dbd3a640 1 -- 172.21.15.55:0/3540946869 shutdown_connections 2023-08-25T04:03:57.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.547+0000 7fd1dbd3a640 1 -- 172.21.15.55:0/3540946869 wait complete. 2023-08-25T04:03:57.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1dbd3a640 1 Processor -- start 2023-08-25T04:03:57.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1dbd3a640 1 -- start start 2023-08-25T04:03:57.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1dbd3a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1d40ad7b0 0x7fd1d4155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:57.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1dbd3a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1d40c1aa0 0x7fd1d40c2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:57.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1dbd3a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1d4164b30 0x7fd1d40aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:57.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1dbd3a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d41560a0 con 0x7fd1d40ad7b0 2023-08-25T04:03:57.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1dbd3a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d40ab9b0 con 0x7fd1d4164b30 2023-08-25T04:03:57.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1dbd3a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d40abc90 con 0x7fd1d40c1aa0 2023-08-25T04:03:57.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1d9ad6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1d40ad7b0 0x7fd1d4155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:57.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1d9ad6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1d40ad7b0 0x7fd1d4155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55696/0 (socket says 172.21.15.55:55696) 2023-08-25T04:03:57.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1d9ad6640 1 -- 172.21.15.55:0/2339321195 learned_addr learned my addr 172.21.15.55:0/2339321195 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:57.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1da2d7640 1 --2- 172.21.15.55:0/2339321195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1d4164b30 0x7fd1d40aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:57.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1d92d5640 1 --2- 172.21.15.55:0/2339321195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1d40c1aa0 0x7fd1d40c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:57.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1d9ad6640 1 -- 172.21.15.55:0/2339321195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1d40c1aa0 msgr2=0x7fd1d40c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:57.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1d9ad6640 1 --2- 172.21.15.55:0/2339321195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1d40c1aa0 0x7fd1d40c2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:57.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1d9ad6640 1 -- 172.21.15.55:0/2339321195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1d4164b30 msgr2=0x7fd1d40aafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:57.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1d9ad6640 1 --2- 172.21.15.55:0/2339321195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1d4164b30 0x7fd1d40aafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:57.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1d9ad6640 1 -- 172.21.15.55:0/2339321195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c4009420 con 0x7fd1d40ad7b0 2023-08-25T04:03:57.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1d92d5640 1 --2- 172.21.15.55:0/2339321195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1d40c1aa0 0x7fd1d40c2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:57.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1da2d7640 1 --2- 172.21.15.55:0/2339321195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1d4164b30 0x7fd1d40aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:03:57.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1d9ad6640 1 --2- 172.21.15.55:0/2339321195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1d40ad7b0 0x7fd1d4155b60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000c680 tx=0x7fd1d000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:57.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1ca7fc640 1 -- 172.21.15.55:0/2339321195 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0007270 con 0x7fd1d40ad7b0 2023-08-25T04:03:57.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1ca7fc640 1 -- 172.21.15.55:0/2339321195 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d00073d0 con 0x7fd1d40ad7b0 2023-08-25T04:03:57.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1ca7fc640 1 -- 172.21.15.55:0/2339321195 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d000ce80 con 0x7fd1d40ad7b0 2023-08-25T04:03:57.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1dbd3a640 1 -- 172.21.15.55:0/2339321195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d40abf70 con 0x7fd1d40ad7b0 2023-08-25T04:03:57.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.551+0000 7fd1dbd3a640 1 -- 172.21.15.55:0/2339321195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d40af2d0 con 0x7fd1d40ad7b0 2023-08-25T04:03:57.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.555+0000 7fd1dbd3a640 1 -- 172.21.15.55:0/2339321195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d4073ec0 con 0x7fd1d40ad7b0 2023-08-25T04:03:57.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.555+0000 7fd1ca7fc640 1 -- 172.21.15.55:0/2339321195 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd1d00057b0 con 0x7fd1d40ad7b0 2023-08-25T04:03:57.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.555+0000 7fd1ca7fc640 1 --2- 172.21.15.55:0/2339321195 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd1b8065680 0x7fd1b8067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:57.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.555+0000 7fd1ca7fc640 1 -- 172.21.15.55:0/2339321195 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fd1d00820e0 con 0x7fd1d40ad7b0 2023-08-25T04:03:57.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.555+0000 7fd1d92d5640 1 --2- 172.21.15.55:0/2339321195 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd1b8065680 0x7fd1b8067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:57.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.555+0000 7fd1d92d5640 1 --2- 172.21.15.55:0/2339321195 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd1b8065680 0x7fd1b8067b40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40b2000 tx=0x7fd1c40aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:57.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.559+0000 7fd1ca7fc640 1 -- 172.21.15.55:0/2339321195 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd1d004fe20 con 0x7fd1d40ad7b0 2023-08-25T04:03:57.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:57.715+0000 7fd1dbd3a640 1 -- 172.21.15.55:0/2339321195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd1d40c1420 con 0x7fd1d40ad7b0 2023-08-25T04:03:58.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.363+0000 7fd1ca7fc640 1 -- 172.21.15.55:0/2339321195 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd1d0053440 con 0x7fd1d40ad7b0 2023-08-25T04:03:58.366 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-08-25T04:03:58.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.371+0000 7fd1dbd3a640 1 -- 172.21.15.55:0/2339321195 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd1b8065680 msgr2=0x7fd1b8067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:58.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.371+0000 7fd1dbd3a640 1 --2- 172.21.15.55:0/2339321195 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd1b8065680 0x7fd1b8067b40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40b2000 tx=0x7fd1c40aa070 comp rx=0 tx=0).stop 2023-08-25T04:03:58.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.371+0000 7fd1dbd3a640 1 -- 172.21.15.55:0/2339321195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1d40ad7b0 msgr2=0x7fd1d4155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:58.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.371+0000 7fd1dbd3a640 1 --2- 172.21.15.55:0/2339321195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1d40ad7b0 0x7fd1d4155b60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000c680 tx=0x7fd1d000cb40 comp rx=0 tx=0).stop 2023-08-25T04:03:58.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.375+0000 7fd1dbd3a640 1 -- 172.21.15.55:0/2339321195 shutdown_connections 2023-08-25T04:03:58.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.375+0000 7fd1dbd3a640 1 --2- 172.21.15.55:0/2339321195 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd1b8065680 0x7fd1b8067b40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:58.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.375+0000 7fd1dbd3a640 1 --2- 172.21.15.55:0/2339321195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1d4164b30 0x7fd1d40aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:58.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.375+0000 7fd1dbd3a640 1 --2- 172.21.15.55:0/2339321195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1d40c1aa0 0x7fd1d40c2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:58.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.375+0000 7fd1dbd3a640 1 --2- 172.21.15.55:0/2339321195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1d40ad7b0 0x7fd1d4155b60 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:58.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.375+0000 7fd1dbd3a640 1 -- 172.21.15.55:0/2339321195 >> 172.21.15.55:0/2339321195 conn(0x7fd1d4069900 msgr2=0x7fd1d41652f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:58.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.375+0000 7fd1dbd3a640 1 -- 172.21.15.55:0/2339321195 shutdown_connections 2023-08-25T04:03:58.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.375+0000 7fd1dbd3a640 1 -- 172.21.15.55:0/2339321195 wait complete. 2023-08-25T04:03:58.410 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-25T04:03:58.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.555+0000 7f85a386d640 1 Processor -- start 2023-08-25T04:03:58.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.555+0000 7f85a386d640 1 -- start start 2023-08-25T04:03:58.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.555+0000 7f85a386d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f859c164b30 0x7f859c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:58.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.555+0000 7f85a386d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f859c161440 con 0x7f859c0ad7b0 2023-08-25T04:03:58.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.555+0000 7f85a386d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f859c06cb20 con 0x7f859c0c1aa0 2023-08-25T04:03:58.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.555+0000 7f85a386d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859c06ce00 con 0x7f859c164b30 2023-08-25T04:03:58.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f85a1609640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f859c0ad7b0 0x7f859c0c1390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48804/0 (socket says 172.21.15.55:48804) 2023-08-25T04:03:58.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f85a1609640 1 -- 172.21.15.55:0/4263158817 learned_addr learned my addr 172.21.15.55:0/4263158817 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:58.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f85a1e0a640 1 --2- 172.21.15.55:0/4263158817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f859c164b30 0x7f859c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:58.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f8593fff640 1 -- 172.21.15.55:0/4263158817 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686639994 0 0) 0x7f859c161440 con 0x7f859c0ad7b0 2023-08-25T04:03:58.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f8593fff640 1 -- 172.21.15.55:0/4263158817 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8588003530 con 0x7f859c0ad7b0 2023-08-25T04:03:58.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f8593fff640 1 -- 172.21.15.55:0/4263158817 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1332122271 0 0) 0x7f8588003530 con 0x7f859c0ad7b0 2023-08-25T04:03:58.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f8593fff640 1 -- 172.21.15.55:0/4263158817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f859c164b30 msgr2=0x7f859c06c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:58.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f8593fff640 1 --2- 172.21.15.55:0/4263158817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f859c164b30 0x7f859c06c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:58.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f8593fff640 1 -- 172.21.15.55:0/4263158817 >> v1:172.21.15.110:6789/0 conn(0x7f859c0c1aa0 legacy=0x7f859c0c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:58.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f8593fff640 1 -- 172.21.15.55:0/4263158817 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859c06d0e0 con 0x7f859c0ad7b0 2023-08-25T04:03:58.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f8593fff640 1 -- 172.21.15.55:0/4263158817 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f8598001800 con 0x7f859c0ad7b0 2023-08-25T04:03:58.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f8593fff640 1 -- 172.21.15.55:0/4263158817 >> v1:172.21.15.55:6789/0 conn(0x7f859c0ad7b0 legacy=0x7f859c0c1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:58.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f8593fff640 1 --2- 172.21.15.55:0/4263158817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85880039b0 0x7f8588003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:58.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f8593fff640 1 --2- 172.21.15.55:0/4263158817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f859c164b30 0x7f85880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:58.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f8593fff640 1 --2- 172.21.15.55:0/4263158817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8588004d10 0x7f8588005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:58.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f8593fff640 1 -- 172.21.15.55:0/4263158817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859c06ce00 con 0x7f85880039b0 2023-08-25T04:03:58.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f8593fff640 1 -- 172.21.15.55:0/4263158817 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858800bbb0 con 0x7f8588004d10 2023-08-25T04:03:58.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f8593fff640 1 -- 172.21.15.55:0/4263158817 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858800bd40 con 0x7f859c164b30 2023-08-25T04:03:58.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f85a1609640 1 --2- 172.21.15.55:0/4263158817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85880039b0 0x7f8588003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:58.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f85a0e08640 1 --2- 172.21.15.55:0/4263158817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f859c164b30 0x7f85880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:58.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f85a1e0a640 1 --2- 172.21.15.55:0/4263158817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8588004d10 0x7f8588005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:58.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f85a1609640 1 -- 172.21.15.55:0/4263158817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f859c164b30 msgr2=0x7f85880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:58.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f85a1609640 1 --2- 172.21.15.55:0/4263158817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f859c164b30 0x7f85880047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:58.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f85a1609640 1 -- 172.21.15.55:0/4263158817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8588004d10 msgr2=0x7f8588005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:58.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f85a1609640 1 --2- 172.21.15.55:0/4263158817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8588004d10 0x7f8588005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:58.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f85a1609640 1 -- 172.21.15.55:0/4263158817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8588003530 con 0x7f85880039b0 2023-08-25T04:03:58.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.559+0000 7f85a1e0a640 1 --2- 172.21.15.55:0/4263158817 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8588004d10 0x7f8588005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:58.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.563+0000 7f85a1609640 1 --2- 172.21.15.55:0/4263158817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85880039b0 0x7f8588003dd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f859800c270 tx=0x7f859801f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367a22f83f37560 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:58.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.563+0000 7f8593fff640 1 -- 172.21.15.55:0/4263158817 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598007270 con 0x7f85880039b0 2023-08-25T04:03:58.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.563+0000 7f8593fff640 1 -- 172.21.15.55:0/4263158817 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85980ab070 con 0x7f85880039b0 2023-08-25T04:03:58.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.563+0000 7f8593fff640 1 -- 172.21.15.55:0/4263158817 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598007630 con 0x7f85880039b0 2023-08-25T04:03:58.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.563+0000 7f85a386d640 1 -- 172.21.15.55:0/4263158817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85880039b0 msgr2=0x7f8588003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:58.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.563+0000 7f85a386d640 1 --2- 172.21.15.55:0/4263158817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85880039b0 0x7f8588003dd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f859800c270 tx=0x7f859801f370 comp rx=0 tx=0).stop 2023-08-25T04:03:58.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.563+0000 7f85a1e0a640 1 -- 172.21.15.55:0/4263158817 reap_dead start 2023-08-25T04:03:58.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.563+0000 7f85a386d640 1 -- 172.21.15.55:0/4263158817 shutdown_connections 2023-08-25T04:03:58.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.563+0000 7f85a386d640 1 -- 172.21.15.55:0/4263158817 >> 172.21.15.55:0/4263158817 conn(0x7f859c069900 msgr2=0x7f859c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:58.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.563+0000 7f85a386d640 1 -- 172.21.15.55:0/4263158817 shutdown_connections 2023-08-25T04:03:58.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.563+0000 7f85a386d640 1 -- 172.21.15.55:0/4263158817 wait complete. 2023-08-25T04:03:58.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.563+0000 7f85a386d640 1 Processor -- start 2023-08-25T04:03:58.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.563+0000 7f85a386d640 1 -- start start 2023-08-25T04:03:58.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a386d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85880039b0 0x7f859c0c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:58.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a386d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f859c1fa710 0x7f859c15dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:58.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a386d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f859c06ffa0 0x7f859c070420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:58.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a386d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859c070960 con 0x7f859c06ffa0 2023-08-25T04:03:58.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a386d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859c0c7a80 con 0x7f85880039b0 2023-08-25T04:03:58.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a386d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859c0c7d60 con 0x7f859c1fa710 2023-08-25T04:03:58.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a1e0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f859c06ffa0 0x7f859c070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:58.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a1e0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f859c06ffa0 0x7f859c070420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55724/0 (socket says 172.21.15.55:55724) 2023-08-25T04:03:58.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a1e0a640 1 -- 172.21.15.55:0/2477770643 learned_addr learned my addr 172.21.15.55:0/2477770643 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:58.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a0e08640 1 --2- 172.21.15.55:0/2477770643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f859c1fa710 0x7f859c15dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:58.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a1609640 1 --2- 172.21.15.55:0/2477770643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85880039b0 0x7f859c0c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a1e0a640 1 -- 172.21.15.55:0/2477770643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f859c1fa710 msgr2=0x7f859c15dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a1e0a640 1 --2- 172.21.15.55:0/2477770643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f859c1fa710 0x7f859c15dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a1e0a640 1 -- 172.21.15.55:0/2477770643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85880039b0 msgr2=0x7f859c0c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a1e0a640 1 --2- 172.21.15.55:0/2477770643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85880039b0 0x7f859c0c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a1e0a640 1 -- 172.21.15.55:0/2477770643 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859c0c8040 con 0x7f859c06ffa0 2023-08-25T04:03:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a1609640 1 --2- 172.21.15.55:0/2477770643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85880039b0 0x7f859c0c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a1e0a640 1 --2- 172.21.15.55:0/2477770643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f859c06ffa0 0x7f859c070420 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f859c0c90d0 tx=0x7f8594004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f8591ffb640 1 -- 172.21.15.55:0/2477770643 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8594007cd0 con 0x7f859c06ffa0 2023-08-25T04:03:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f8591ffb640 1 -- 172.21.15.55:0/2477770643 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859400f050 con 0x7f859c06ffa0 2023-08-25T04:03:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a386d640 1 -- 172.21.15.55:0/2477770643 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f859c0c5530 con 0x7f859c06ffa0 2023-08-25T04:03:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f8591ffb640 1 -- 172.21.15.55:0/2477770643 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8594014650 con 0x7f859c06ffa0 2023-08-25T04:03:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a386d640 1 -- 172.21.15.55:0/2477770643 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f859c1fab90 con 0x7f859c06ffa0 2023-08-25T04:03:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.567+0000 7f85a386d640 1 -- 172.21.15.55:0/2477770643 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f859c0c5720 con 0x7f859c06ffa0 2023-08-25T04:03:58.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.571+0000 7f8591ffb640 1 -- 172.21.15.55:0/2477770643 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f85940147b0 con 0x7f859c06ffa0 2023-08-25T04:03:58.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.571+0000 7f8591ffb640 1 --2- 172.21.15.55:0/2477770643 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f85800656b0 0x7f8580067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:58.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.571+0000 7f8591ffb640 1 -- 172.21.15.55:0/2477770643 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f85940831b0 con 0x7f859c06ffa0 2023-08-25T04:03:58.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.571+0000 7f85a1609640 1 --2- 172.21.15.55:0/2477770643 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f85800656b0 0x7f8580067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:58.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.571+0000 7f85a1609640 1 --2- 172.21.15.55:0/2477770643 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f85800656b0 0x7f8580067b70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f85980af000 tx=0x7f85980aa000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:58.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.575+0000 7f8591ffb640 1 -- 172.21.15.55:0/2477770643 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8594050c30 con 0x7f859c06ffa0 2023-08-25T04:03:58.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:58.763+0000 7f85a386d640 1 -- 172.21.15.55:0/2477770643 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f859c073ec0 con 0x7f859c06ffa0 2023-08-25T04:03:59.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.383+0000 7f8591ffb640 1 -- 172.21.15.55:0/2477770643 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8594054250 con 0x7f859c06ffa0 2023-08-25T04:03:59.385 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 5 and data pool 6 2023-08-25T04:03:59.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.399+0000 7f85a386d640 1 -- 172.21.15.55:0/2477770643 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f85800656b0 msgr2=0x7f8580067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:59.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.399+0000 7f85a386d640 1 --2- 172.21.15.55:0/2477770643 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f85800656b0 0x7f8580067b70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f85980af000 tx=0x7f85980aa000 comp rx=0 tx=0).stop 2023-08-25T04:03:59.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.399+0000 7f85a386d640 1 -- 172.21.15.55:0/2477770643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f859c06ffa0 msgr2=0x7f859c070420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:59.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.399+0000 7f85a386d640 1 --2- 172.21.15.55:0/2477770643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f859c06ffa0 0x7f859c070420 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f859c0c90d0 tx=0x7f8594004840 comp rx=0 tx=0).stop 2023-08-25T04:03:59.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.399+0000 7f85a386d640 1 -- 172.21.15.55:0/2477770643 shutdown_connections 2023-08-25T04:03:59.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.399+0000 7f85a386d640 1 --2- 172.21.15.55:0/2477770643 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f85800656b0 0x7f8580067b70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.399+0000 7f85a386d640 1 --2- 172.21.15.55:0/2477770643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f859c06ffa0 0x7f859c070420 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.399+0000 7f85a386d640 1 --2- 172.21.15.55:0/2477770643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f859c1fa710 0x7f859c15dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.399+0000 7f85a386d640 1 --2- 172.21.15.55:0/2477770643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85880039b0 0x7f859c0c7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.399+0000 7f85a386d640 1 -- 172.21.15.55:0/2477770643 >> 172.21.15.55:0/2477770643 conn(0x7f859c069900 msgr2=0x7f859c15ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:59.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.407+0000 7f85a386d640 1 -- 172.21.15.55:0/2477770643 shutdown_connections 2023-08-25T04:03:59.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.411+0000 7f85a386d640 1 -- 172.21.15.55:0/2477770643 wait complete. 2023-08-25T04:03:59.438 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:59.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.579+0000 7f6ed0137640 1 Processor -- start 2023-08-25T04:03:59.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.579+0000 7f6ed0137640 1 -- start start 2023-08-25T04:03:59.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.583+0000 7f6ed0137640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ec80cdb10 0x7f6ec80cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:59.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.583+0000 7f6ed0137640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6ec806cc50 0x7f6ec806d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:59.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.583+0000 7f6ed0137640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec806c7c0 con 0x7f6ec80ae450 2023-08-25T04:03:59.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.583+0000 7f6ed0137640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec80ae9a0 con 0x7f6ec806cc50 2023-08-25T04:03:59.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.583+0000 7f6ed0137640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80cb5e0 con 0x7f6ec80cdb10 2023-08-25T04:03:59.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.583+0000 7f6ecd6d2640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6ec80ae450 0x7f6ec80cdef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48810/0 (socket says 172.21.15.55:48810) 2023-08-25T04:03:59.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.583+0000 7f6ecd6d2640 1 -- 172.21.15.55:0/1127557599 learned_addr learned my addr 172.21.15.55:0/1127557599 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:03:59.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.583+0000 7f6ecded3640 1 --2- 172.21.15.55:0/1127557599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ec80cdb10 0x7f6ec80cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:59.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.583+0000 7f6ece6d4640 1 --2- 172.21.15.55:0/1127557599 >> v2:172.21.15.110:3300/0 conn(0x7f6ec806cc50 0x7f6ec806d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:59.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.583+0000 7f6ecced1640 1 -- 172.21.15.55:0/1127557599 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873464444 0 0) 0x7f6ec806c7c0 con 0x7f6ec80ae450 2023-08-25T04:03:59.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.583+0000 7f6ecced1640 1 -- 172.21.15.55:0/1127557599 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eb4003530 con 0x7f6ec80ae450 2023-08-25T04:03:59.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.583+0000 7f6ecded3640 1 -- 172.21.15.55:0/1127557599 >> v2:172.21.15.110:3300/0 conn(0x7f6ec806cc50 msgr2=0x7f6ec806d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:59.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.583+0000 7f6ecded3640 1 --2- 172.21.15.55:0/1127557599 >> v2:172.21.15.110:3300/0 conn(0x7f6ec806cc50 0x7f6ec806d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.583+0000 7f6ecded3640 1 -- 172.21.15.55:0/1127557599 >> v1:172.21.15.55:6789/0 conn(0x7f6ec80ae450 legacy=0x7f6ec80cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:59.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.583+0000 7f6ecded3640 1 -- 172.21.15.55:0/1127557599 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec80aec60 con 0x7f6ec80cdb10 2023-08-25T04:03:59.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.583+0000 7f6ece6d4640 1 --2- 172.21.15.55:0/1127557599 >> v2:172.21.15.110:3300/0 conn(0x7f6ec806cc50 0x7f6ec806d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:03:59.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.583+0000 7f6ecded3640 1 --2- 172.21.15.55:0/1127557599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ec80cdb10 0x7f6ec80cd310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40097c0 tx=0x7f6ec401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bc3404bb059412a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:59.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ecced1640 1 -- 172.21.15.55:0/1127557599 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec40ad660 con 0x7f6ec80cdb10 2023-08-25T04:03:59.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ecced1640 1 -- 172.21.15.55:0/1127557599 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec40ad7c0 con 0x7f6ec80cdb10 2023-08-25T04:03:59.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ecced1640 1 -- 172.21.15.55:0/1127557599 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec40adb30 con 0x7f6ec80cdb10 2023-08-25T04:03:59.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ed0137640 1 -- 172.21.15.55:0/1127557599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ec80cdb10 msgr2=0x7f6ec80cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:59.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ed0137640 1 --2- 172.21.15.55:0/1127557599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ec80cdb10 0x7f6ec80cd310 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40097c0 tx=0x7f6ec401c450 comp rx=0 tx=0).stop 2023-08-25T04:03:59.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ed0137640 1 -- 172.21.15.55:0/1127557599 shutdown_connections 2023-08-25T04:03:59.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ed0137640 1 --2- 172.21.15.55:0/1127557599 >> v2:172.21.15.110:3300/0 conn(0x7f6ec806cc50 0x7f6ec806d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ed0137640 1 --2- 172.21.15.55:0/1127557599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ec80cdb10 0x7f6ec80cd310 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ed0137640 1 -- 172.21.15.55:0/1127557599 >> 172.21.15.55:0/1127557599 conn(0x7f6ec80cf530 msgr2=0x7f6ec80cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:59.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ed0137640 1 -- 172.21.15.55:0/1127557599 shutdown_connections 2023-08-25T04:03:59.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ed0137640 1 -- 172.21.15.55:0/1127557599 wait complete. 2023-08-25T04:03:59.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ed0137640 1 Processor -- start 2023-08-25T04:03:59.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ed0137640 1 -- start start 2023-08-25T04:03:59.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ed0137640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec806cc50 0x7f6ec80b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:59.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ed0137640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec80ae450 0x7f6ec814cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:59.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ed0137640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ec80cdb10 0x7f6ec8150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:59.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ed0137640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8158480 con 0x7f6ec806cc50 2023-08-25T04:03:59.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ed0137640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8157870 con 0x7f6ec80ae450 2023-08-25T04:03:59.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.587+0000 7f6ed0137640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8157b50 con 0x7f6ec80cdb10 2023-08-25T04:03:59.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ecded3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec806cc50 0x7f6ec80b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:59.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ecded3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec806cc50 0x7f6ec80b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55740/0 (socket says 172.21.15.55:55740) 2023-08-25T04:03:59.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ecded3640 1 -- 172.21.15.55:0/1329372077 learned_addr learned my addr 172.21.15.55:0/1329372077 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:59.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ecd6d2640 1 --2- 172.21.15.55:0/1329372077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec80ae450 0x7f6ec814cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:59.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ece6d4640 1 --2- 172.21.15.55:0/1329372077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ec80cdb10 0x7f6ec8150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:59.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ecded3640 1 -- 172.21.15.55:0/1329372077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ec80cdb10 msgr2=0x7f6ec8150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:59.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ecded3640 1 --2- 172.21.15.55:0/1329372077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ec80cdb10 0x7f6ec8150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ecded3640 1 -- 172.21.15.55:0/1329372077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec80ae450 msgr2=0x7f6ec814cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:59.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ecded3640 1 --2- 172.21.15.55:0/1329372077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec80ae450 0x7f6ec814cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ecded3640 1 -- 172.21.15.55:0/1329372077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec0009a70 con 0x7f6ec806cc50 2023-08-25T04:03:59.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ecded3640 1 --2- 172.21.15.55:0/1329372077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec806cc50 0x7f6ec80b1040 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6ec401a080 tx=0x7f6ec40191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:59.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ebe7fc640 1 -- 172.21.15.55:0/1329372077 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec40adb30 con 0x7f6ec806cc50 2023-08-25T04:03:59.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ebe7fc640 1 -- 172.21.15.55:0/1329372077 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec40adc90 con 0x7f6ec806cc50 2023-08-25T04:03:59.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ed0137640 1 -- 172.21.15.55:0/1329372077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec4009420 con 0x7f6ec806cc50 2023-08-25T04:03:59.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ebe7fc640 1 -- 172.21.15.55:0/1329372077 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4003620 con 0x7f6ec806cc50 2023-08-25T04:03:59.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ed0137640 1 -- 172.21.15.55:0/1329372077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec8158110 con 0x7f6ec806cc50 2023-08-25T04:03:59.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ed0137640 1 -- 172.21.15.55:0/1329372077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec80cf1d0 con 0x7f6ec806cc50 2023-08-25T04:03:59.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ebe7fc640 1 -- 172.21.15.55:0/1329372077 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6ec40b4050 con 0x7f6ec806cc50 2023-08-25T04:03:59.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.591+0000 7f6ebe7fc640 1 --2- 172.21.15.55:0/1329372077 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6eac065680 0x7f6eac067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:59.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.595+0000 7f6ebe7fc640 1 -- 172.21.15.55:0/1329372077 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6ec411d380 con 0x7f6ec806cc50 2023-08-25T04:03:59.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.595+0000 7f6ecd6d2640 1 --2- 172.21.15.55:0/1329372077 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6eac065680 0x7f6eac067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:59.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.595+0000 7f6ecd6d2640 1 --2- 172.21.15.55:0/1329372077 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6eac065680 0x7f6eac067b40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8007fd0 tx=0x7f6eb8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:59.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.599+0000 7f6ebe7fc640 1 -- 172.21.15.55:0/1329372077 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6ec40eb000 con 0x7f6ec806cc50 2023-08-25T04:03:59.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.755+0000 7f6ed0137640 1 -- 172.21.15.55:0/1329372077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ec81644a0 con 0x7f6ec806cc50 2023-08-25T04:03:59.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.755+0000 7f6ebe7fc640 1 -- 172.21.15.55:0/1329372077 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18376 (secure 0 0 0) 0x7f6ec81644a0 con 0x7f6ec806cc50 2023-08-25T04:03:59.758 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:03:59.758 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":37,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:58.767336+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:03:56.779789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:57.764926+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:03:59.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.759+0000 7f6ed0137640 1 -- 172.21.15.55:0/1329372077 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6eac065680 msgr2=0x7f6eac067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:59.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.759+0000 7f6ed0137640 1 --2- 172.21.15.55:0/1329372077 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6eac065680 0x7f6eac067b40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8007fd0 tx=0x7f6eb8009040 comp rx=0 tx=0).stop 2023-08-25T04:03:59.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.759+0000 7f6ed0137640 1 -- 172.21.15.55:0/1329372077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec806cc50 msgr2=0x7f6ec80b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:59.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.759+0000 7f6ed0137640 1 --2- 172.21.15.55:0/1329372077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec806cc50 0x7f6ec80b1040 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6ec401a080 tx=0x7f6ec40191f0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.759+0000 7f6ed0137640 1 -- 172.21.15.55:0/1329372077 shutdown_connections 2023-08-25T04:03:59.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.759+0000 7f6ed0137640 1 --2- 172.21.15.55:0/1329372077 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6eac065680 0x7f6eac067b40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.759+0000 7f6ed0137640 1 --2- 172.21.15.55:0/1329372077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ec80cdb10 0x7f6ec8150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.759+0000 7f6ed0137640 1 --2- 172.21.15.55:0/1329372077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ec80ae450 0x7f6ec814cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.759+0000 7f6ed0137640 1 --2- 172.21.15.55:0/1329372077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec806cc50 0x7f6ec80b1040 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.759+0000 7f6ed0137640 1 -- 172.21.15.55:0/1329372077 >> 172.21.15.55:0/1329372077 conn(0x7f6ec80cf530 msgr2=0x7f6ec80acb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:59.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.759+0000 7f6ed0137640 1 -- 172.21.15.55:0/1329372077 shutdown_connections 2023-08-25T04:03:59.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.759+0000 7f6ed0137640 1 -- 172.21.15.55:0/1329372077 wait complete. 2023-08-25T04:03:59.779 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:03:59.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.919+0000 7f8a5209e640 1 Processor -- start 2023-08-25T04:03:59.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.919+0000 7f8a5209e640 1 -- start start 2023-08-25T04:03:59.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.919+0000 7f8a5209e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8a4c15eba0 0x7f8a4c0b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:59.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.919+0000 7f8a5209e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a4c15ef80 0x7f8a4c0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:59.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.919+0000 7f8a5209e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4c0ac100 con 0x7f8a4c0cece0 2023-08-25T04:03:59.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.919+0000 7f8a5209e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4c0cf170 con 0x7f8a4c15ef80 2023-08-25T04:03:59.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.919+0000 7f8a5209e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4c0ac3a0 con 0x7f8a4c15eba0 2023-08-25T04:03:59.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.923+0000 7f8a43fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a4c15ef80 0x7f8a4c0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:59.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.923+0000 7f8a43fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a4c15ef80 0x7f8a4c0ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55754/0 (socket says 172.21.15.55:55754) 2023-08-25T04:03:59.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.923+0000 7f8a43fff640 1 -- 172.21.15.55:0/78856391 learned_addr learned my addr 172.21.15.55:0/78856391 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:59.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.923+0000 7f8a4b7fe640 1 --2- 172.21.15.55:0/78856391 >> v2:172.21.15.110:3300/0 conn(0x7f8a4c15eba0 0x7f8a4c0b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:59.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.923+0000 7f8a43fff640 1 -- 172.21.15.55:0/78856391 >> v2:172.21.15.110:3300/0 conn(0x7f8a4c15eba0 msgr2=0x7f8a4c0b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:03:59.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.923+0000 7f8a43fff640 1 --2- 172.21.15.55:0/78856391 >> v2:172.21.15.110:3300/0 conn(0x7f8a4c15eba0 0x7f8a4c0b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.923+0000 7f8a43fff640 1 -- 172.21.15.55:0/78856391 >> v1:172.21.15.110:6789/0 conn(0x7f8a4c0cece0 legacy=0x7f8a4c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:59.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.923+0000 7f8a43fff640 1 -- 172.21.15.55:0/78856391 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c0b1390 con 0x7f8a4c15ef80 2023-08-25T04:03:59.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.923+0000 7f8a43fff640 1 --2- 172.21.15.55:0/78856391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c15ef80 0x7f8a4c0ce7a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0b4450 tx=0x7f8a3401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e227d72642a05d19 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:59.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.923+0000 7f8a4affd640 1 -- 172.21.15.55:0/78856391 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a340ab5f0 con 0x7f8a4c15ef80 2023-08-25T04:03:59.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.923+0000 7f8a4affd640 1 -- 172.21.15.55:0/78856391 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a340ab750 con 0x7f8a4c15ef80 2023-08-25T04:03:59.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.923+0000 7f8a4affd640 1 -- 172.21.15.55:0/78856391 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a340abae0 con 0x7f8a4c15ef80 2023-08-25T04:03:59.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a5209e640 1 -- 172.21.15.55:0/78856391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c15ef80 msgr2=0x7f8a4c0ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:59.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a5209e640 1 --2- 172.21.15.55:0/78856391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c15ef80 0x7f8a4c0ce7a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0b4450 tx=0x7f8a3401c4d0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a5209e640 1 -- 172.21.15.55:0/78856391 shutdown_connections 2023-08-25T04:03:59.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a5209e640 1 --2- 172.21.15.55:0/78856391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c15ef80 0x7f8a4c0ce7a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a5209e640 1 --2- 172.21.15.55:0/78856391 >> v2:172.21.15.110:3300/0 conn(0x7f8a4c15eba0 0x7f8a4c0b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a5209e640 1 -- 172.21.15.55:0/78856391 >> 172.21.15.55:0/78856391 conn(0x7f8a4c069d00 msgr2=0x7f8a4c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:03:59.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a5209e640 1 -- 172.21.15.55:0/78856391 shutdown_connections 2023-08-25T04:03:59.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a5209e640 1 -- 172.21.15.55:0/78856391 wait complete. 2023-08-25T04:03:59.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a5209e640 1 Processor -- start 2023-08-25T04:03:59.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a5209e640 1 -- start start 2023-08-25T04:03:59.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a5209e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a4c0cece0 0x7f8a4c159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:59.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a5209e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c15eba0 0x7f8a4c1563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:59.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a5209e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a4c15ef80 0x7f8a4c097850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:59.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a5209e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c0c5dc0 con 0x7f8a4c15eba0 2023-08-25T04:03:59.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a5209e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c156900 con 0x7f8a4c0cece0 2023-08-25T04:03:59.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a5209e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c159e70 con 0x7f8a4c15ef80 2023-08-25T04:03:59.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a43fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c15eba0 0x7f8a4c1563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:59.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a43fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c15eba0 0x7f8a4c1563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55766/0 (socket says 172.21.15.55:55766) 2023-08-25T04:03:59.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a43fff640 1 -- 172.21.15.55:0/2470074373 learned_addr learned my addr 172.21.15.55:0/2470074373 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:03:59.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a4b7fe640 1 --2- 172.21.15.55:0/2470074373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a4c0cece0 0x7f8a4c159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:59.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a4bfff640 1 --2- 172.21.15.55:0/2470074373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a4c15ef80 0x7f8a4c097850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:59.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a43fff640 1 -- 172.21.15.55:0/2470074373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a4c15ef80 msgr2=0x7f8a4c097850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:59.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a43fff640 1 --2- 172.21.15.55:0/2470074373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a4c15ef80 0x7f8a4c097850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a43fff640 1 -- 172.21.15.55:0/2470074373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a4c0cece0 msgr2=0x7f8a4c159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:03:59.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a43fff640 1 --2- 172.21.15.55:0/2470074373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a4c0cece0 0x7f8a4c159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:03:59.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a43fff640 1 -- 172.21.15.55:0/2470074373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a340094d0 con 0x7f8a4c15eba0 2023-08-25T04:03:59.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.927+0000 7f8a4b7fe640 1 --2- 172.21.15.55:0/2470074373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a4c0cece0 0x7f8a4c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:03:59.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.931+0000 7f8a43fff640 1 --2- 172.21.15.55:0/2470074373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c15eba0 0x7f8a4c1563c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8a340ad040 tx=0x7f8a34019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:59.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.931+0000 7f8a48ff9640 1 -- 172.21.15.55:0/2470074373 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a340bf610 con 0x7f8a4c15eba0 2023-08-25T04:03:59.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.931+0000 7f8a48ff9640 1 -- 172.21.15.55:0/2470074373 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a340bf790 con 0x7f8a4c15eba0 2023-08-25T04:03:59.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.931+0000 7f8a48ff9640 1 -- 172.21.15.55:0/2470074373 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a340bfb40 con 0x7f8a4c15eba0 2023-08-25T04:03:59.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.931+0000 7f8a5209e640 1 -- 172.21.15.55:0/2470074373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4c15a150 con 0x7f8a4c15eba0 2023-08-25T04:03:59.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.931+0000 7f8a5209e640 1 -- 172.21.15.55:0/2470074373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4c15a710 con 0x7f8a4c15eba0 2023-08-25T04:03:59.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.931+0000 7f8a5209e640 1 -- 172.21.15.55:0/2470074373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4c04dbe0 con 0x7f8a4c15eba0 2023-08-25T04:03:59.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.931+0000 7f8a48ff9640 1 -- 172.21.15.55:0/2470074373 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8a340b5400 con 0x7f8a4c15eba0 2023-08-25T04:03:59.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.931+0000 7f8a48ff9640 1 --2- 172.21.15.55:0/2470074373 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8a2c065680 0x7f8a2c067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:03:59.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.931+0000 7f8a48ff9640 1 -- 172.21.15.55:0/2470074373 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8a340a8050 con 0x7f8a4c15eba0 2023-08-25T04:03:59.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.931+0000 7f8a4b7fe640 1 --2- 172.21.15.55:0/2470074373 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8a2c065680 0x7f8a2c067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:03:59.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.935+0000 7f8a4b7fe640 1 --2- 172.21.15.55:0/2470074373 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8a2c065680 0x7f8a2c067b40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0c1810 tx=0x7f8a3c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:03:59.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:03:59.935+0000 7f8a48ff9640 1 -- 172.21.15.55:0/2470074373 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8a340eb2f0 con 0x7f8a4c15eba0 2023-08-25T04:04:00.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.091+0000 7f8a5209e640 1 -- 172.21.15.55:0/2470074373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a4c0ccc40 con 0x7f8a4c15eba0 2023-08-25T04:04:00.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.095+0000 7f8a48ff9640 1 -- 172.21.15.55:0/2470074373 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18376 (secure 0 0 0) 0x7f8a340ee910 con 0x7f8a4c15eba0 2023-08-25T04:04:00.096 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:04:00.096 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":37,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:03:58.767336+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:03:56.779789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:57.764926+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:04:00.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.095+0000 7f8a5209e640 1 -- 172.21.15.55:0/2470074373 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8a2c065680 msgr2=0x7f8a2c067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:00.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.095+0000 7f8a5209e640 1 --2- 172.21.15.55:0/2470074373 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8a2c065680 0x7f8a2c067b40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0c1810 tx=0x7f8a3c008040 comp rx=0 tx=0).stop 2023-08-25T04:04:00.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.095+0000 7f8a5209e640 1 -- 172.21.15.55:0/2470074373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c15eba0 msgr2=0x7f8a4c1563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:00.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.095+0000 7f8a5209e640 1 --2- 172.21.15.55:0/2470074373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c15eba0 0x7f8a4c1563c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8a340ad040 tx=0x7f8a34019270 comp rx=0 tx=0).stop 2023-08-25T04:04:00.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.095+0000 7f8a5209e640 1 -- 172.21.15.55:0/2470074373 shutdown_connections 2023-08-25T04:04:00.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.095+0000 7f8a5209e640 1 --2- 172.21.15.55:0/2470074373 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8a2c065680 0x7f8a2c067b40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:00.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.095+0000 7f8a5209e640 1 --2- 172.21.15.55:0/2470074373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a4c15ef80 0x7f8a4c097850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:00.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.095+0000 7f8a5209e640 1 --2- 172.21.15.55:0/2470074373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4c15eba0 0x7f8a4c1563c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:00.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.095+0000 7f8a5209e640 1 --2- 172.21.15.55:0/2470074373 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a4c0cece0 0x7f8a4c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:00.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.095+0000 7f8a5209e640 1 -- 172.21.15.55:0/2470074373 >> 172.21.15.55:0/2470074373 conn(0x7f8a4c069d00 msgr2=0x7f8a4c0af2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:00.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.095+0000 7f8a5209e640 1 -- 172.21.15.55:0/2470074373 shutdown_connections 2023-08-25T04:04:00.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.095+0000 7f8a5209e640 1 -- 172.21.15.55:0/2470074373 wait complete. 2023-08-25T04:04:00.117 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-25T04:04:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.263+0000 7ff61b093640 1 Processor -- start 2023-08-25T04:04:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.263+0000 7ff61b093640 1 -- start start 2023-08-25T04:04:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.263+0000 7ff61b093640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6140ae8e0 0x7ff614069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.263+0000 7ff61b093640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6140cef20 0x7ff61415c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.263+0000 7ff61b093640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff61406a2a0 con 0x7ff614069e40 2023-08-25T04:04:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.263+0000 7ff61b093640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff61406d200 con 0x7ff6140cef20 2023-08-25T04:04:00.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.263+0000 7ff61b093640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61406c5f0 con 0x7ff6140ae8e0 2023-08-25T04:04:00.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.263+0000 7ff619630640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6140cef20 0x7ff61415c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:00.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.263+0000 7ff619630640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6140cef20 0x7ff61415c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55768/0 (socket says 172.21.15.55:55768) 2023-08-25T04:04:00.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.263+0000 7ff619630640 1 -- 172.21.15.55:0/1293998402 learned_addr learned my addr 172.21.15.55:0/1293998402 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:00.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.263+0000 7ff618e2f640 1 --2- 172.21.15.55:0/1293998402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6140ae8e0 0x7ff614069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:00.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.263+0000 7ff619630640 1 -- 172.21.15.55:0/1293998402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6140ae8e0 msgr2=0x7ff614069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:00.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.263+0000 7ff619630640 1 --2- 172.21.15.55:0/1293998402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6140ae8e0 0x7ff614069900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:00.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.263+0000 7ff619630640 1 -- 172.21.15.55:0/1293998402 >> v1:172.21.15.55:6789/0 conn(0x7ff614069e40 legacy=0x7ff6140ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:00.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.263+0000 7ff619630640 1 -- 172.21.15.55:0/1293998402 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61406c8d0 con 0x7ff6140cef20 2023-08-25T04:04:00.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.263+0000 7ff6137fe640 1 -- 172.21.15.55:0/1293998402 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625898554 0 0) 0x7ff61406a2a0 con 0x7ff614069e40 2023-08-25T04:04:00.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.267+0000 7ff619630640 1 --2- 172.21.15.55:0/1293998402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6140cef20 0x7ff61415c150 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009e50 tx=0x7ff60c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3156d7cb3387f796 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:00.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.267+0000 7ff6137fe640 1 -- 172.21.15.55:0/1293998402 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c0090d0 con 0x7ff6140cef20 2023-08-25T04:04:00.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.267+0000 7ff6137fe640 1 -- 172.21.15.55:0/1293998402 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60c009230 con 0x7ff6140cef20 2023-08-25T04:04:00.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.267+0000 7ff6137fe640 1 -- 172.21.15.55:0/1293998402 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c0a5b00 con 0x7ff6140cef20 2023-08-25T04:04:00.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.267+0000 7ff61b093640 1 -- 172.21.15.55:0/1293998402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6140cef20 msgr2=0x7ff61415c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:00.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.267+0000 7ff61b093640 1 --2- 172.21.15.55:0/1293998402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6140cef20 0x7ff61415c150 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009e50 tx=0x7ff60c01ca10 comp rx=0 tx=0).stop 2023-08-25T04:04:00.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.267+0000 7ff61b093640 1 -- 172.21.15.55:0/1293998402 shutdown_connections 2023-08-25T04:04:00.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.267+0000 7ff61b093640 1 --2- 172.21.15.55:0/1293998402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6140cef20 0x7ff61415c150 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:00.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.267+0000 7ff61b093640 1 --2- 172.21.15.55:0/1293998402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6140ae8e0 0x7ff614069900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:00.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.267+0000 7ff61b093640 1 -- 172.21.15.55:0/1293998402 >> 172.21.15.55:0/1293998402 conn(0x7ff6140cf4d0 msgr2=0x7ff6140cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:00.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.267+0000 7ff61b093640 1 -- 172.21.15.55:0/1293998402 shutdown_connections 2023-08-25T04:04:00.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.267+0000 7ff61b093640 1 -- 172.21.15.55:0/1293998402 wait complete. 2023-08-25T04:04:00.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.267+0000 7ff61b093640 1 Processor -- start 2023-08-25T04:04:00.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff61b093640 1 -- start start 2023-08-25T04:04:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff61b093640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff614069e40 0x7ff61414e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff61b093640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6140ae8e0 0x7ff61414ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff61b093640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6140cef20 0x7ff6140c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff61b093640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6141535a0 con 0x7ff614069e40 2023-08-25T04:04:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff61b093640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61414ed20 con 0x7ff6140ae8e0 2023-08-25T04:04:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff61b093640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff614152990 con 0x7ff6140cef20 2023-08-25T04:04:00.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff618e2f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff614069e40 0x7ff61414e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff618e2f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff614069e40 0x7ff61414e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55784/0 (socket says 172.21.15.55:55784) 2023-08-25T04:04:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff618e2f640 1 -- 172.21.15.55:0/2123564932 learned_addr learned my addr 172.21.15.55:0/2123564932 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff619630640 1 --2- 172.21.15.55:0/2123564932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6140cef20 0x7ff6140c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff613fff640 1 --2- 172.21.15.55:0/2123564932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6140ae8e0 0x7ff61414ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff618e2f640 1 -- 172.21.15.55:0/2123564932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6140cef20 msgr2=0x7ff6140c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff618e2f640 1 --2- 172.21.15.55:0/2123564932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6140cef20 0x7ff6140c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:00.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff618e2f640 1 -- 172.21.15.55:0/2123564932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6140ae8e0 msgr2=0x7ff61414ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:00.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff618e2f640 1 --2- 172.21.15.55:0/2123564932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6140ae8e0 0x7ff61414ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:00.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff618e2f640 1 -- 172.21.15.55:0/2123564932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c009b30 con 0x7ff614069e40 2023-08-25T04:04:00.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff618e2f640 1 --2- 172.21.15.55:0/2123564932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff614069e40 0x7ff61414e7e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff60800d800 tx=0x7ff60800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff6117fa640 1 -- 172.21.15.55:0/2123564932 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60800b6c0 con 0x7ff614069e40 2023-08-25T04:04:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff61b093640 1 -- 172.21.15.55:0/2123564932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff614152c70 con 0x7ff614069e40 2023-08-25T04:04:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff6117fa640 1 -- 172.21.15.55:0/2123564932 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60800b820 con 0x7ff614069e40 2023-08-25T04:04:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff6117fa640 1 -- 172.21.15.55:0/2123564932 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60800bb90 con 0x7ff614069e40 2023-08-25T04:04:00.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff61b093640 1 -- 172.21.15.55:0/2123564932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff614153230 con 0x7ff614069e40 2023-08-25T04:04:00.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.271+0000 7ff61b093640 1 -- 172.21.15.55:0/2123564932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff614073ec0 con 0x7ff614069e40 2023-08-25T04:04:00.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.275+0000 7ff6117fa640 1 -- 172.21.15.55:0/2123564932 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff60800bcf0 con 0x7ff614069e40 2023-08-25T04:04:00.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.275+0000 7ff6117fa640 1 --2- 172.21.15.55:0/2123564932 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff5f8065680 0x7ff5f8067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:00.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.275+0000 7ff6117fa640 1 -- 172.21.15.55:0/2123564932 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff608083320 con 0x7ff614069e40 2023-08-25T04:04:00.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.275+0000 7ff613fff640 1 --2- 172.21.15.55:0/2123564932 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff5f8065680 0x7ff5f8067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:00.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.275+0000 7ff613fff640 1 --2- 172.21.15.55:0/2123564932 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff5f8065680 0x7ff5f8067b40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff61415bed0 tx=0x7ff600009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:00.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.279+0000 7ff6117fa640 1 -- 172.21.15.55:0/2123564932 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff608054890 con 0x7ff614069e40 2023-08-25T04:04:00.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:00.471+0000 7ff61b093640 1 -- 172.21.15.55:0/2123564932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff6140cd2d0 con 0x7ff614069e40 2023-08-25T04:04:01.359 INFO:tasks.ceph.mds.c.smithi055.stderr:2023-08-25T04:04:01.359+0000 7f27e444b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T04:04:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.407+0000 7ff6117fa640 1 -- 172.21.15.55:0/2123564932 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff608054420 con 0x7ff614069e40 2023-08-25T04:04:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.407+0000 7ff61b093640 1 -- 172.21.15.55:0/2123564932 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff5f8065680 msgr2=0x7ff5f8067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.407+0000 7ff61b093640 1 --2- 172.21.15.55:0/2123564932 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff5f8065680 0x7ff5f8067b40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff61415bed0 tx=0x7ff600009040 comp rx=0 tx=0).stop 2023-08-25T04:04:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.407+0000 7ff61b093640 1 -- 172.21.15.55:0/2123564932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff614069e40 msgr2=0x7ff61414e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.407+0000 7ff61b093640 1 --2- 172.21.15.55:0/2123564932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff614069e40 0x7ff61414e7e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff60800d800 tx=0x7ff60800dcc0 comp rx=0 tx=0).stop 2023-08-25T04:04:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.411+0000 7ff61b093640 1 -- 172.21.15.55:0/2123564932 shutdown_connections 2023-08-25T04:04:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.411+0000 7ff61b093640 1 --2- 172.21.15.55:0/2123564932 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff5f8065680 0x7ff5f8067b40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.411+0000 7ff61b093640 1 --2- 172.21.15.55:0/2123564932 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6140cef20 0x7ff6140c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.411+0000 7ff61b093640 1 --2- 172.21.15.55:0/2123564932 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6140ae8e0 0x7ff61414ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.411+0000 7ff61b093640 1 --2- 172.21.15.55:0/2123564932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff614069e40 0x7ff61414e7e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.411+0000 7ff61b093640 1 -- 172.21.15.55:0/2123564932 >> 172.21.15.55:0/2123564932 conn(0x7ff6140cf4d0 msgr2=0x7ff6140c65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.411+0000 7ff61b093640 1 -- 172.21.15.55:0/2123564932 shutdown_connections 2023-08-25T04:04:01.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.411+0000 7ff61b093640 1 -- 172.21.15.55:0/2123564932 wait complete. 2023-08-25T04:04:01.434 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-25T04:04:01.435 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-25T04:04:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.583+0000 7f611f093640 1 Processor -- start 2023-08-25T04:04:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.583+0000 7f611f093640 1 -- start start 2023-08-25T04:04:01.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.583+0000 7f611f093640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61181601f0 0x7f611815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:01.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.583+0000 7f611f093640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f61180d1290 0x7f611815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:01.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.583+0000 7f611f093640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61180cd5a0 con 0x7f611815e3c0 2023-08-25T04:04:01.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.583+0000 7f611f093640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61180cd880 con 0x7f61180d1290 2023-08-25T04:04:01.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.583+0000 7f611f093640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61180cdb60 con 0x7f61181601f0 2023-08-25T04:04:01.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.587+0000 7f611ce2f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61181601f0 0x7f611815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:01.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.587+0000 7f611d630640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f61180d1290 0x7f611815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.587+0000 7f611d630640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f61180d1290 0x7f611815e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:51976/0 (socket says 172.21.15.55:51976) 2023-08-25T04:04:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.587+0000 7f610ffff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f611815e3c0 0x7f61180d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:37078/0 (socket says 172.21.15.55:37078) 2023-08-25T04:04:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.587+0000 7f611d630640 1 -- 172.21.15.55:0/861061372 learned_addr learned my addr 172.21.15.55:0/861061372 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.587+0000 7f611ce2f640 1 -- 172.21.15.55:0/861061372 >> v2:172.21.15.110:3300/0 conn(0x7f61180d1290 msgr2=0x7f611815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.587+0000 7f611ce2f640 1 --2- 172.21.15.55:0/861061372 >> v2:172.21.15.110:3300/0 conn(0x7f61180d1290 0x7f611815e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.587+0000 7f611ce2f640 1 -- 172.21.15.55:0/861061372 >> v1:172.21.15.110:6789/0 conn(0x7f611815e3c0 legacy=0x7f61180d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.587+0000 7f611ce2f640 1 -- 172.21.15.55:0/861061372 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61180cde40 con 0x7f61181601f0 2023-08-25T04:04:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.587+0000 7f611d630640 1 --2- 172.21.15.55:0/861061372 >> v2:172.21.15.110:3300/0 conn(0x7f61180d1290 0x7f611815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:04:01.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.587+0000 7f611ce2f640 1 --2- 172.21.15.55:0/861061372 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61181601f0 0x7f611815d430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f61140097a0 tx=0x7f611401ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66a6e08491226557 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:01.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f610f7fe640 1 -- 172.21.15.55:0/861061372 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61140a8950 con 0x7f61181601f0 2023-08-25T04:04:01.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f610f7fe640 1 -- 172.21.15.55:0/861061372 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61140a8ab0 con 0x7f61181601f0 2023-08-25T04:04:01.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f610f7fe640 1 -- 172.21.15.55:0/861061372 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61140a8e40 con 0x7f61181601f0 2023-08-25T04:04:01.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611f093640 1 -- 172.21.15.55:0/861061372 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61181601f0 msgr2=0x7f611815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:01.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611f093640 1 --2- 172.21.15.55:0/861061372 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61181601f0 0x7f611815d430 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f61140097a0 tx=0x7f611401ec50 comp rx=0 tx=0).stop 2023-08-25T04:04:01.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611f093640 1 -- 172.21.15.55:0/861061372 shutdown_connections 2023-08-25T04:04:01.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611f093640 1 --2- 172.21.15.55:0/861061372 >> v2:172.21.15.110:3300/0 conn(0x7f61180d1290 0x7f611815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:01.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611f093640 1 --2- 172.21.15.55:0/861061372 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61181601f0 0x7f611815d430 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:01.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611f093640 1 -- 172.21.15.55:0/861061372 >> 172.21.15.55:0/861061372 conn(0x7f61180d27d0 msgr2=0x7f61180d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:01.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611f093640 1 -- 172.21.15.55:0/861061372 shutdown_connections 2023-08-25T04:04:01.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611f093640 1 -- 172.21.15.55:0/861061372 wait complete. 2023-08-25T04:04:01.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611f093640 1 Processor -- start 2023-08-25T04:04:01.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611f093640 1 -- start start 2023-08-25T04:04:01.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611f093640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61180d1290 0x7f61181f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:01.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611f093640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f611815e3c0 0x7f611809fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:01.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611f093640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61181601f0 0x7f61180c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:01.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611f093640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61181530d0 con 0x7f61180d1290 2023-08-25T04:04:01.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611f093640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61181f66b0 con 0x7f61181601f0 2023-08-25T04:04:01.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611f093640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61180a0310 con 0x7f611815e3c0 2023-08-25T04:04:01.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611ce2f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61180d1290 0x7f61181f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:01.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611ce2f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61180d1290 0x7f61181f6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39438/0 (socket says 172.21.15.55:39438) 2023-08-25T04:04:01.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.591+0000 7f611ce2f640 1 -- 172.21.15.55:0/3954124821 learned_addr learned my addr 172.21.15.55:0/3954124821 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:01.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.595+0000 7f610ffff640 1 --2- 172.21.15.55:0/3954124821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f611815e3c0 0x7f611809fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:01.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.595+0000 7f611d630640 1 --2- 172.21.15.55:0/3954124821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61181601f0 0x7f61180c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:01.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.595+0000 7f611ce2f640 1 -- 172.21.15.55:0/3954124821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f611815e3c0 msgr2=0x7f611809fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:01.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.595+0000 7f611ce2f640 1 --2- 172.21.15.55:0/3954124821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f611815e3c0 0x7f611809fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:01.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.595+0000 7f611ce2f640 1 -- 172.21.15.55:0/3954124821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61181601f0 msgr2=0x7f61180c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:01.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.595+0000 7f611ce2f640 1 --2- 172.21.15.55:0/3954124821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61181601f0 0x7f61180c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:01.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.595+0000 7f611ce2f640 1 -- 172.21.15.55:0/3954124821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6110009b30 con 0x7f61180d1290 2023-08-25T04:04:01.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.595+0000 7f610ffff640 1 --2- 172.21.15.55:0/3954124821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f611815e3c0 0x7f611809fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:04:01.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.595+0000 7f611ce2f640 1 --2- 172.21.15.55:0/3954124821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61180d1290 0x7f61181f6170 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f611401b860 tx=0x7f611401b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:01.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.595+0000 7f610d7fa640 1 -- 172.21.15.55:0/3954124821 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61140b0d70 con 0x7f61180d1290 2023-08-25T04:04:01.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.595+0000 7f610d7fa640 1 -- 172.21.15.55:0/3954124821 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61140ba440 con 0x7f61180d1290 2023-08-25T04:04:01.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.595+0000 7f610d7fa640 1 -- 172.21.15.55:0/3954124821 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61140ba7f0 con 0x7f61180d1290 2023-08-25T04:04:01.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.595+0000 7f611f093640 1 -- 172.21.15.55:0/3954124821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61140093b0 con 0x7f61180d1290 2023-08-25T04:04:01.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.595+0000 7f611f093640 1 -- 172.21.15.55:0/3954124821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61180ce7c0 con 0x7f61180d1290 2023-08-25T04:04:01.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.595+0000 7f611f093640 1 -- 172.21.15.55:0/3954124821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61180b5260 con 0x7f61180d1290 2023-08-25T04:04:01.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.595+0000 7f610d7fa640 1 -- 172.21.15.55:0/3954124821 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f61140ba950 con 0x7f61180d1290 2023-08-25T04:04:01.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.595+0000 7f610d7fa640 1 --2- 172.21.15.55:0/3954124821 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f61040656b0 0x7f6104067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:01.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.595+0000 7f610d7fa640 1 -- 172.21.15.55:0/3954124821 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6114120be0 con 0x7f61180d1290 2023-08-25T04:04:01.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.599+0000 7f610ffff640 1 --2- 172.21.15.55:0/3954124821 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f61040656b0 0x7f6104067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:01.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.599+0000 7f610ffff640 1 --2- 172.21.15.55:0/3954124821 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f61040656b0 0x7f6104067b70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6108007fd0 tx=0x7f6108009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:01.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.599+0000 7f610d7fa640 1 -- 172.21.15.55:0/3954124821 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f61140ee7b0 con 0x7f61180d1290 2023-08-25T04:04:01.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:01.791+0000 7f611f093640 1 -- 172.21.15.55:0/3954124821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f61180d3360 con 0x7f61180d1290 2023-08-25T04:04:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.407+0000 7f610d7fa640 1 -- 172.21.15.55:0/3954124821 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f61140b5020 con 0x7f61180d1290 2023-08-25T04:04:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.411+0000 7f611f093640 1 -- 172.21.15.55:0/3954124821 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f61040656b0 msgr2=0x7f6104067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.411+0000 7f611f093640 1 --2- 172.21.15.55:0/3954124821 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f61040656b0 0x7f6104067b70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6108007fd0 tx=0x7f6108009040 comp rx=0 tx=0).stop 2023-08-25T04:04:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.411+0000 7f611f093640 1 -- 172.21.15.55:0/3954124821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61180d1290 msgr2=0x7f61181f6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.411+0000 7f611f093640 1 --2- 172.21.15.55:0/3954124821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61180d1290 0x7f61181f6170 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f611401b860 tx=0x7f611401b9f0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.411+0000 7f611f093640 1 -- 172.21.15.55:0/3954124821 shutdown_connections 2023-08-25T04:04:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.411+0000 7f611f093640 1 --2- 172.21.15.55:0/3954124821 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f61040656b0 0x7f6104067b70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.411+0000 7f611f093640 1 --2- 172.21.15.55:0/3954124821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61181601f0 0x7f61180c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.411+0000 7f611f093640 1 --2- 172.21.15.55:0/3954124821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f611815e3c0 0x7f611809fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.411+0000 7f611f093640 1 --2- 172.21.15.55:0/3954124821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61180d1290 0x7f61181f6170 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.411+0000 7f611f093640 1 -- 172.21.15.55:0/3954124821 >> 172.21.15.55:0/3954124821 conn(0x7f61180d27d0 msgr2=0x7f61180d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.411+0000 7f611f093640 1 -- 172.21.15.55:0/3954124821 shutdown_connections 2023-08-25T04:04:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.411+0000 7f611f093640 1 -- 172.21.15.55:0/3954124821 wait complete. 2023-08-25T04:04:02.435 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-25T04:04:02.435 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:04:02.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.579+0000 7f6b896cb640 1 Processor -- start 2023-08-25T04:04:02.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.579+0000 7f6b896cb640 1 -- start start 2023-08-25T04:04:02.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.583+0000 7f6b896cb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6b840ad950 0x7f6b840cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:02.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.583+0000 7f6b896cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b840c89f0 0x7f6b840ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:02.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.583+0000 7f6b896cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b8406c000 0x7f6b840cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:02.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.583+0000 7f6b896cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b840b11f0 con 0x7f6b8406c000 2023-08-25T04:04:02.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.583+0000 7f6b896cb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b84159d50 con 0x7f6b840ad950 2023-08-25T04:04:02.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.583+0000 7f6b896cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b840cc880 con 0x7f6b840c89f0 2023-08-25T04:04:02.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.583+0000 7f6b837fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b8406c000 0x7f6b840cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:02.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.583+0000 7f6b837fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b8406c000 0x7f6b840cece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39448/0 (socket says 172.21.15.55:39448) 2023-08-25T04:04:02.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.583+0000 7f6b837fe640 1 -- 172.21.15.55:0/2495609032 learned_addr learned my addr 172.21.15.55:0/2495609032 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:02.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.583+0000 7f6b837fe640 1 -- 172.21.15.55:0/2495609032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b840c89f0 msgr2=0x7f6b840ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:02.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.583+0000 7f6b837fe640 1 --2- 172.21.15.55:0/2495609032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b840c89f0 0x7f6b840ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.583+0000 7f6b837fe640 1 -- 172.21.15.55:0/2495609032 >> v2:172.21.15.110:3300/0 conn(0x7f6b840ad950 msgr2=0x7f6b840cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:02.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.583+0000 7f6b837fe640 1 --2- 172.21.15.55:0/2495609032 >> v2:172.21.15.110:3300/0 conn(0x7f6b840ad950 0x7f6b840cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.583+0000 7f6b837fe640 1 -- 172.21.15.55:0/2495609032 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b840ccb60 con 0x7f6b8406c000 2023-08-25T04:04:02.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.583+0000 7f6b837fe640 1 --2- 172.21.15.55:0/2495609032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b8406c000 0x7f6b840cece0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6b840cd4b0 tx=0x7f6b7c01eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2827a0c5e2f7801 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:02.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b81ffb640 1 -- 172.21.15.55:0/2495609032 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c0a79b0 con 0x7f6b8406c000 2023-08-25T04:04:02.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b81ffb640 1 -- 172.21.15.55:0/2495609032 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c0a7b10 con 0x7f6b8406c000 2023-08-25T04:04:02.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b81ffb640 1 -- 172.21.15.55:0/2495609032 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c0a7ea0 con 0x7f6b8406c000 2023-08-25T04:04:02.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b896cb640 1 -- 172.21.15.55:0/2495609032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b8406c000 msgr2=0x7f6b840cece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:02.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b896cb640 1 --2- 172.21.15.55:0/2495609032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b8406c000 0x7f6b840cece0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6b840cd4b0 tx=0x7f6b7c01eb20 comp rx=0 tx=0).stop 2023-08-25T04:04:02.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b896cb640 1 -- 172.21.15.55:0/2495609032 shutdown_connections 2023-08-25T04:04:02.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b896cb640 1 --2- 172.21.15.55:0/2495609032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b8406c000 0x7f6b840cece0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b896cb640 1 --2- 172.21.15.55:0/2495609032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b840c89f0 0x7f6b840ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b896cb640 1 --2- 172.21.15.55:0/2495609032 >> v2:172.21.15.110:3300/0 conn(0x7f6b840ad950 0x7f6b840cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b896cb640 1 -- 172.21.15.55:0/2495609032 >> 172.21.15.55:0/2495609032 conn(0x7f6b84069d00 msgr2=0x7f6b8406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:02.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b896cb640 1 -- 172.21.15.55:0/2495609032 shutdown_connections 2023-08-25T04:04:02.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b896cb640 1 -- 172.21.15.55:0/2495609032 wait complete. 2023-08-25T04:04:02.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b896cb640 1 Processor -- start 2023-08-25T04:04:02.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b896cb640 1 -- start start 2023-08-25T04:04:02.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b896cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b8406c000 0x7f6b84163ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:02.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b896cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b840ad950 0x7f6b84154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:02.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b896cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b840c89f0 0x7f6b840c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:02.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b896cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b840c5d80 con 0x7f6b840c89f0 2023-08-25T04:04:02.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b896cb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b84164530 con 0x7f6b840ad950 2023-08-25T04:04:02.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.587+0000 7f6b896cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8415ccb0 con 0x7f6b8406c000 2023-08-25T04:04:02.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b837fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b840c89f0 0x7f6b840c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b837fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b840c89f0 0x7f6b840c7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39464/0 (socket says 172.21.15.55:39464) 2023-08-25T04:04:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b837fe640 1 -- 172.21.15.55:0/2927267513 learned_addr learned my addr 172.21.15.55:0/2927267513 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b82ffd640 1 --2- 172.21.15.55:0/2927267513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b8406c000 0x7f6b84163ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b827fc640 1 --2- 172.21.15.55:0/2927267513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b840ad950 0x7f6b84154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:02.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b837fe640 1 -- 172.21.15.55:0/2927267513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b8406c000 msgr2=0x7f6b84163ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:02.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b837fe640 1 --2- 172.21.15.55:0/2927267513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b8406c000 0x7f6b84163ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b837fe640 1 -- 172.21.15.55:0/2927267513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b840ad950 msgr2=0x7f6b84154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:02.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b837fe640 1 --2- 172.21.15.55:0/2927267513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b840ad950 0x7f6b84154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b837fe640 1 -- 172.21.15.55:0/2927267513 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7c009b30 con 0x7f6b840c89f0 2023-08-25T04:04:02.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b827fc640 1 --2- 172.21.15.55:0/2927267513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b840ad950 0x7f6b84154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:02.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b837fe640 1 --2- 172.21.15.55:0/2927267513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b840c89f0 0x7f6b840c7970 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c01d1d0 tx=0x7f6b7c01b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:02.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b6b7fe640 1 -- 172.21.15.55:0/2927267513 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c00e150 con 0x7f6b840c89f0 2023-08-25T04:04:02.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b6b7fe640 1 -- 172.21.15.55:0/2927267513 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c009510 con 0x7f6b840c89f0 2023-08-25T04:04:02.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b6b7fe640 1 -- 172.21.15.55:0/2927267513 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c007ea0 con 0x7f6b840c89f0 2023-08-25T04:04:02.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b896cb640 1 -- 172.21.15.55:0/2927267513 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8415cf90 con 0x7f6b840c89f0 2023-08-25T04:04:02.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b896cb640 1 -- 172.21.15.55:0/2927267513 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b840c62b0 con 0x7f6b840c89f0 2023-08-25T04:04:02.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b896cb640 1 -- 172.21.15.55:0/2927267513 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8404dbe0 con 0x7f6b840c89f0 2023-08-25T04:04:02.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.591+0000 7f6b6b7fe640 1 -- 172.21.15.55:0/2927267513 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6b7c0af3f0 con 0x7f6b840c89f0 2023-08-25T04:04:02.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.595+0000 7f6b6b7fe640 1 --2- 172.21.15.55:0/2927267513 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6b70065680 0x7f6b70067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:02.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.595+0000 7f6b6b7fe640 1 -- 172.21.15.55:0/2927267513 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6b7c11d410 con 0x7f6b840c89f0 2023-08-25T04:04:02.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.595+0000 7f6b82ffd640 1 --2- 172.21.15.55:0/2927267513 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6b70065680 0x7f6b70067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:02.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.595+0000 7f6b82ffd640 1 --2- 172.21.15.55:0/2927267513 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6b70065680 0x7f6b70067b40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6b8415c640 tx=0x7f6b74009110 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:02.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.599+0000 7f6b6b7fe640 1 -- 172.21.15.55:0/2927267513 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6b7c0eaee0 con 0x7f6b840c89f0 2023-08-25T04:04:02.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.787+0000 7f6b896cb640 1 -- 172.21.15.55:0/2927267513 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b840b3100 con 0x7f6b840c89f0 2023-08-25T04:04:02.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.787+0000 7f6b6b7fe640 1 -- 172.21.15.55:0/2927267513 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4881 (secure 0 0 0) 0x7f6b7c0ee500 con 0x7f6b840c89f0 2023-08-25T04:04:02.791 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:04:02.791 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4838,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1920231780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1920231780},{"type":"v1","addr":"172.21.15.110:6837","nonce":1920231780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2215940247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2215940247},{"type":"v1","addr":"172.21.15.55:6835","nonce":2215940247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1708341067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1708341067},{"type":"v1","addr":"172.21.15.110:6836","nonce":1708341067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:03:58.767654+0000","modified":"2023-08-25T04:04:02.406061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5080":{"gid":5080,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6834/2079290775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2079290775},{"type":"v1","addr":"172.21.15.55:6834","nonce":2079290775}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-25T04:04:02.792 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 15 2023-08-25T04:04:02.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.791+0000 7f6b896cb640 1 -- 172.21.15.55:0/2927267513 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6b70065680 msgr2=0x7f6b70067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:02.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.791+0000 7f6b896cb640 1 --2- 172.21.15.55:0/2927267513 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6b70065680 0x7f6b70067b40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6b8415c640 tx=0x7f6b74009110 comp rx=0 tx=0).stop 2023-08-25T04:04:02.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.791+0000 7f6b896cb640 1 -- 172.21.15.55:0/2927267513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b840c89f0 msgr2=0x7f6b840c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:02.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.791+0000 7f6b896cb640 1 --2- 172.21.15.55:0/2927267513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b840c89f0 0x7f6b840c7970 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c01d1d0 tx=0x7f6b7c01b8c0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.791+0000 7f6b896cb640 1 -- 172.21.15.55:0/2927267513 shutdown_connections 2023-08-25T04:04:02.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.791+0000 7f6b896cb640 1 --2- 172.21.15.55:0/2927267513 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f6b70065680 0x7f6b70067b40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.791+0000 7f6b896cb640 1 --2- 172.21.15.55:0/2927267513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b840c89f0 0x7f6b840c7970 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.791+0000 7f6b896cb640 1 --2- 172.21.15.55:0/2927267513 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b840ad950 0x7f6b84154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.791+0000 7f6b896cb640 1 --2- 172.21.15.55:0/2927267513 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b8406c000 0x7f6b84163ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.791+0000 7f6b896cb640 1 -- 172.21.15.55:0/2927267513 >> 172.21.15.55:0/2927267513 conn(0x7f6b84069d00 msgr2=0x7f6b840b22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.791+0000 7f6b896cb640 1 -- 172.21.15.55:0/2927267513 shutdown_connections 2023-08-25T04:04:02.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.791+0000 7f6b896cb640 1 -- 172.21.15.55:0/2927267513 wait complete. 2023-08-25T04:04:02.811 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:04:02.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.959+0000 7f9ee1fe1640 1 Processor -- start 2023-08-25T04:04:02.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.959+0000 7f9ee1fe1640 1 -- start start 2023-08-25T04:04:02.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.959+0000 7f9ee1fe1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9edc0ce220 0x7f9edc0b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:02.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.959+0000 7f9ee1fe1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc0b29b0 con 0x7f9edc0cdde0 2023-08-25T04:04:02.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.959+0000 7f9ee1fe1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc0ce6b0 con 0x7f9edc0d0da0 2023-08-25T04:04:02.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.959+0000 7f9ee1fe1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0b1dc0 con 0x7f9edc0ce220 2023-08-25T04:04:02.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.959+0000 7f9ed3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9edc0cdde0 0x7f9edc0b2e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46518/0 (socket says 172.21.15.55:46518) 2023-08-25T04:04:02.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.959+0000 7f9ed3fff640 1 -- 172.21.15.55:0/475943809 learned_addr learned my addr 172.21.15.55:0/475943809 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:02.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.959+0000 7f9edbfff640 1 --2- 172.21.15.55:0/475943809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9edc0ce220 0x7f9edc0b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:02.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.959+0000 7f9edaffd640 1 -- 172.21.15.55:0/475943809 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790903806 0 0) 0x7f9edc0b29b0 con 0x7f9edc0cdde0 2023-08-25T04:04:02.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.959+0000 7f9edaffd640 1 -- 172.21.15.55:0/475943809 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ec8003530 con 0x7f9edc0cdde0 2023-08-25T04:04:02.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.959+0000 7f9edaffd640 1 -- 172.21.15.55:0/475943809 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957223074 0 0) 0x7f9edc0ce6b0 con 0x7f9edc0d0da0 2023-08-25T04:04:02.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.959+0000 7f9edaffd640 1 -- 172.21.15.55:0/475943809 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9edc0b29b0 con 0x7f9edc0d0da0 2023-08-25T04:04:02.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.959+0000 7f9edbfff640 1 -- 172.21.15.55:0/475943809 >> v1:172.21.15.110:6789/0 conn(0x7f9edc0d0da0 legacy=0x7f9edc0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:02.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.959+0000 7f9edbfff640 1 -- 172.21.15.55:0/475943809 >> v1:172.21.15.55:6789/0 conn(0x7f9edc0cdde0 legacy=0x7f9edc0b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:02.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.959+0000 7f9edbfff640 1 -- 172.21.15.55:0/475943809 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc0b2080 con 0x7f9edc0ce220 2023-08-25T04:04:02.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.963+0000 7f9edbfff640 1 --2- 172.21.15.55:0/475943809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9edc0ce220 0x7f9edc0b3550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4009dc0 tx=0x7f9ed401f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc477829ff290875 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:02.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.963+0000 7f9edaffd640 1 -- 172.21.15.55:0/475943809 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed40af600 con 0x7f9edc0ce220 2023-08-25T04:04:02.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.963+0000 7f9edaffd640 1 -- 172.21.15.55:0/475943809 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed40ab050 con 0x7f9edc0ce220 2023-08-25T04:04:02.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.963+0000 7f9edaffd640 1 -- 172.21.15.55:0/475943809 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed40af980 con 0x7f9edc0ce220 2023-08-25T04:04:02.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.963+0000 7f9ee1fe1640 1 -- 172.21.15.55:0/475943809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9edc0ce220 msgr2=0x7f9edc0b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:02.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.963+0000 7f9ee1fe1640 1 --2- 172.21.15.55:0/475943809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9edc0ce220 0x7f9edc0b3550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4009dc0 tx=0x7f9ed401f150 comp rx=0 tx=0).stop 2023-08-25T04:04:02.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.963+0000 7f9ee1fe1640 1 -- 172.21.15.55:0/475943809 shutdown_connections 2023-08-25T04:04:02.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.963+0000 7f9ee1fe1640 1 --2- 172.21.15.55:0/475943809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9edc0ce220 0x7f9edc0b3550 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.963+0000 7f9ee1fe1640 1 -- 172.21.15.55:0/475943809 >> 172.21.15.55:0/475943809 conn(0x7f9edc09bae0 msgr2=0x7f9edc0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:02.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.963+0000 7f9ee1fe1640 1 -- 172.21.15.55:0/475943809 shutdown_connections 2023-08-25T04:04:02.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.963+0000 7f9ee1fe1640 1 -- 172.21.15.55:0/475943809 wait complete. 2023-08-25T04:04:02.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9ee1fe1640 1 Processor -- start 2023-08-25T04:04:02.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9ee1fe1640 1 -- start start 2023-08-25T04:04:02.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9ee1fe1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9edc0cdde0 0x7f9edc0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:02.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9ee1fe1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9edc0ce220 0x7f9edc142a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:02.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9ee1fe1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9edc0d0da0 0x7f9edc142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:02.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9ee1fe1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc144320 con 0x7f9edc0d0da0 2023-08-25T04:04:02.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9ee1fe1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc1f6750 con 0x7f9edc0cdde0 2023-08-25T04:04:02.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9ee1fe1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc1f6a30 con 0x7f9edc0ce220 2023-08-25T04:04:02.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9edbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9edc0d0da0 0x7f9edc142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:02.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9edbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9edc0d0da0 0x7f9edc142f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39474/0 (socket says 172.21.15.55:39474) 2023-08-25T04:04:02.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9edbfff640 1 -- 172.21.15.55:0/628883206 learned_addr learned my addr 172.21.15.55:0/628883206 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:02.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9edb7fe640 1 --2- 172.21.15.55:0/628883206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9edc0cdde0 0x7f9edc0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:02.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9ed3fff640 1 --2- 172.21.15.55:0/628883206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9edc0ce220 0x7f9edc142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:02.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9edbfff640 1 -- 172.21.15.55:0/628883206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9edc0ce220 msgr2=0x7f9edc142a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9edbfff640 1 --2- 172.21.15.55:0/628883206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9edc0ce220 0x7f9edc142a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9edbfff640 1 -- 172.21.15.55:0/628883206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9edc0cdde0 msgr2=0x7f9edc0cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:02.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9edbfff640 1 --2- 172.21.15.55:0/628883206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9edc0cdde0 0x7f9edc0cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:02.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9edbfff640 1 -- 172.21.15.55:0/628883206 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed4009a70 con 0x7f9edc0d0da0 2023-08-25T04:04:02.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9edb7fe640 1 --2- 172.21.15.55:0/628883206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9edc0cdde0 0x7f9edc0cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:04:02.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9ed3fff640 1 --2- 172.21.15.55:0/628883206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9edc0ce220 0x7f9edc142a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:04:02.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9edbfff640 1 --2- 172.21.15.55:0/628883206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9edc0d0da0 0x7f9edc142f40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9ed401bd60 tx=0x7f9ed401bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9ed8ff9640 1 -- 172.21.15.55:0/628883206 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed40afe90 con 0x7f9edc0d0da0 2023-08-25T04:04:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9ed8ff9640 1 -- 172.21.15.55:0/628883206 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed4009450 con 0x7f9edc0d0da0 2023-08-25T04:04:02.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9ed8ff9640 1 -- 172.21.15.55:0/628883206 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed40b9650 con 0x7f9edc0d0da0 2023-08-25T04:04:02.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9ee1fe1640 1 -- 172.21.15.55:0/628883206 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc1f6d10 con 0x7f9edc0d0da0 2023-08-25T04:04:02.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.967+0000 7f9ee1fe1640 1 -- 172.21.15.55:0/628883206 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc0c64f0 con 0x7f9edc0d0da0 2023-08-25T04:04:02.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.971+0000 7f9ee1fe1640 1 -- 172.21.15.55:0/628883206 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc04dbe0 con 0x7f9edc0d0da0 2023-08-25T04:04:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.971+0000 7f9ed8ff9640 1 -- 172.21.15.55:0/628883206 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9ed40b6050 con 0x7f9edc0d0da0 2023-08-25T04:04:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.971+0000 7f9ed8ff9640 1 --2- 172.21.15.55:0/628883206 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9ebc065680 0x7f9ebc067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.971+0000 7f9ed8ff9640 1 -- 172.21.15.55:0/628883206 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ed4121200 con 0x7f9edc0d0da0 2023-08-25T04:04:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.971+0000 7f9edb7fe640 1 --2- 172.21.15.55:0/628883206 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9ebc065680 0x7f9ebc067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.971+0000 7f9edb7fe640 1 --2- 172.21.15.55:0/628883206 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9ebc065680 0x7f9ebc067b40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc001240 tx=0x7f9ecc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:02.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:02.975+0000 7f9ed8ff9640 1 -- 172.21.15.55:0/628883206 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9ed40f2780 con 0x7f9edc0d0da0 2023-08-25T04:04:03.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.135+0000 7f9ee1fe1640 1 -- 172.21.15.55:0/628883206 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9edc1f71c0 con 0x7f9edc0d0da0 2023-08-25T04:04:03.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.135+0000 7f9ed8ff9640 1 -- 172.21.15.55:0/628883206 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f9ed40f2310 con 0x7f9edc0d0da0 2023-08-25T04:04:03.137 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:04:03.138 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":38,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:04:00.392308+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:03:56.779789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:57.764926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:04:03.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.135+0000 7f9ee1fe1640 1 -- 172.21.15.55:0/628883206 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9ebc065680 msgr2=0x7f9ebc067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:03.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.135+0000 7f9ee1fe1640 1 --2- 172.21.15.55:0/628883206 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9ebc065680 0x7f9ebc067b40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc001240 tx=0x7f9ecc009040 comp rx=0 tx=0).stop 2023-08-25T04:04:03.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.135+0000 7f9ee1fe1640 1 -- 172.21.15.55:0/628883206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9edc0d0da0 msgr2=0x7f9edc142f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:03.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.135+0000 7f9ee1fe1640 1 --2- 172.21.15.55:0/628883206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9edc0d0da0 0x7f9edc142f40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9ed401bd60 tx=0x7f9ed401bef0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.135+0000 7f9ee1fe1640 1 -- 172.21.15.55:0/628883206 shutdown_connections 2023-08-25T04:04:03.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.135+0000 7f9ee1fe1640 1 --2- 172.21.15.55:0/628883206 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f9ebc065680 0x7f9ebc067b40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.135+0000 7f9ee1fe1640 1 --2- 172.21.15.55:0/628883206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9edc0d0da0 0x7f9edc142f40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.135+0000 7f9ee1fe1640 1 --2- 172.21.15.55:0/628883206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9edc0ce220 0x7f9edc142a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.135+0000 7f9ee1fe1640 1 --2- 172.21.15.55:0/628883206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9edc0cdde0 0x7f9edc0cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.135+0000 7f9ee1fe1640 1 -- 172.21.15.55:0/628883206 >> 172.21.15.55:0/628883206 conn(0x7f9edc09bae0 msgr2=0x7f9edc0af440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:03.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.135+0000 7f9ee1fe1640 1 -- 172.21.15.55:0/628883206 shutdown_connections 2023-08-25T04:04:03.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.135+0000 7f9ee1fe1640 1 -- 172.21.15.55:0/628883206 wait complete. 2023-08-25T04:04:03.158 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-25T04:04:03.159 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:04:03.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.303+0000 7f8035344640 1 Processor -- start 2023-08-25T04:04:03.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.303+0000 7f8035344640 1 -- start start 2023-08-25T04:04:03.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.303+0000 7f8035344640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f80300d0da0 0x7f80300d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:03.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.303+0000 7f8035344640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80300cdde0 0x7f80300ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:03.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.303+0000 7f8035344640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80300cee60 0x7f80300cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:03.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.303+0000 7f8035344640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80300ce760 con 0x7f80300cee60 2023-08-25T04:04:03.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.303+0000 7f8035344640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80300b29b0 con 0x7f80300d0da0 2023-08-25T04:04:03.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.303+0000 7f8035344640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80300d16c0 con 0x7f80300cdde0 2023-08-25T04:04:03.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.303+0000 7f802f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80300cee60 0x7f80300cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:03.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.303+0000 7f802f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80300cee60 0x7f80300cf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39484/0 (socket says 172.21.15.55:39484) 2023-08-25T04:04:03.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.303+0000 7f802f7fe640 1 -- 172.21.15.55:0/1279239140 learned_addr learned my addr 172.21.15.55:0/1279239140 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:03.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.303+0000 7f80267fc640 1 --2- 172.21.15.55:0/1279239140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80300cdde0 0x7f80300ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:03.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.303+0000 7f802effd640 1 --2- 172.21.15.55:0/1279239140 >> v2:172.21.15.110:3300/0 conn(0x7f80300d0da0 0x7f80300d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:03.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.303+0000 7f802f7fe640 1 -- 172.21.15.55:0/1279239140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80300cdde0 msgr2=0x7f80300ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:03.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.303+0000 7f802f7fe640 1 --2- 172.21.15.55:0/1279239140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80300cdde0 0x7f80300ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.303+0000 7f802f7fe640 1 -- 172.21.15.55:0/1279239140 >> v2:172.21.15.110:3300/0 conn(0x7f80300d0da0 msgr2=0x7f80300d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:03.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.303+0000 7f802f7fe640 1 --2- 172.21.15.55:0/1279239140 >> v2:172.21.15.110:3300/0 conn(0x7f80300d0da0 0x7f80300d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.303+0000 7f802f7fe640 1 -- 172.21.15.55:0/1279239140 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80300b1dc0 con 0x7f80300cee60 2023-08-25T04:04:03.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.307+0000 7f802f7fe640 1 --2- 172.21.15.55:0/1279239140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80300cee60 0x7f80300cf2f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8030073720 tx=0x7f802801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be43103b50b435c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:03.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.307+0000 7f802e7fc640 1 -- 172.21.15.55:0/1279239140 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80280a89b0 con 0x7f80300cee60 2023-08-25T04:04:03.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.307+0000 7f802e7fc640 1 -- 172.21.15.55:0/1279239140 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80280a8b10 con 0x7f80300cee60 2023-08-25T04:04:03.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.307+0000 7f802e7fc640 1 -- 172.21.15.55:0/1279239140 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80280a8ea0 con 0x7f80300cee60 2023-08-25T04:04:03.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.307+0000 7f8035344640 1 -- 172.21.15.55:0/1279239140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80300cee60 msgr2=0x7f80300cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:03.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.307+0000 7f8035344640 1 --2- 172.21.15.55:0/1279239140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80300cee60 0x7f80300cf2f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8030073720 tx=0x7f802801ecf0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.307+0000 7f8035344640 1 -- 172.21.15.55:0/1279239140 shutdown_connections 2023-08-25T04:04:03.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.307+0000 7f8035344640 1 --2- 172.21.15.55:0/1279239140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80300cee60 0x7f80300cf2f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.307+0000 7f8035344640 1 --2- 172.21.15.55:0/1279239140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80300cdde0 0x7f80300ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.307+0000 7f8035344640 1 --2- 172.21.15.55:0/1279239140 >> v2:172.21.15.110:3300/0 conn(0x7f80300d0da0 0x7f80300d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.307+0000 7f8035344640 1 -- 172.21.15.55:0/1279239140 >> 172.21.15.55:0/1279239140 conn(0x7f803009bae0 msgr2=0x7f80300d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:03.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.307+0000 7f8035344640 1 -- 172.21.15.55:0/1279239140 shutdown_connections 2023-08-25T04:04:03.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.307+0000 7f8035344640 1 -- 172.21.15.55:0/1279239140 wait complete. 2023-08-25T04:04:03.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f8035344640 1 Processor -- start 2023-08-25T04:04:03.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f8035344640 1 -- start start 2023-08-25T04:04:03.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f8035344640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80300cdde0 0x7f80300c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:03.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f8035344640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80300cee60 0x7f8030151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:03.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f8035344640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80300d0da0 0x7f80300b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:03.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f8035344640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80300ca8e0 con 0x7f80300d0da0 2023-08-25T04:04:03.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f8035344640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80300b7720 con 0x7f80300cdde0 2023-08-25T04:04:03.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f8035344640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80300c6f60 con 0x7f80300cee60 2023-08-25T04:04:03.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f802f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80300d0da0 0x7f80300b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:03.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f802f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80300d0da0 0x7f80300b5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39490/0 (socket says 172.21.15.55:39490) 2023-08-25T04:04:03.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f802f7fe640 1 -- 172.21.15.55:0/2218321778 learned_addr learned my addr 172.21.15.55:0/2218321778 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:03.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f802effd640 1 --2- 172.21.15.55:0/2218321778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80300cdde0 0x7f80300c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:03.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f80267fc640 1 --2- 172.21.15.55:0/2218321778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80300cee60 0x7f8030151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:03.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f802f7fe640 1 -- 172.21.15.55:0/2218321778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80300cee60 msgr2=0x7f8030151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:03.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f802f7fe640 1 --2- 172.21.15.55:0/2218321778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80300cee60 0x7f8030151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f802f7fe640 1 -- 172.21.15.55:0/2218321778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80300cdde0 msgr2=0x7f80300c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:03.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f802f7fe640 1 --2- 172.21.15.55:0/2218321778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80300cdde0 0x7f80300c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f802f7fe640 1 -- 172.21.15.55:0/2218321778 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80280094d0 con 0x7f80300d0da0 2023-08-25T04:04:03.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f802effd640 1 --2- 172.21.15.55:0/2218321778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80300cdde0 0x7f80300c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:03.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f80267fc640 1 --2- 172.21.15.55:0/2218321778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80300cee60 0x7f8030151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:03.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f802f7fe640 1 --2- 172.21.15.55:0/2218321778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80300d0da0 0x7f80300b5df0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f802801d3a0 tx=0x7f802801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:03.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f8027fff640 1 -- 172.21.15.55:0/2218321778 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80280b0bc0 con 0x7f80300d0da0 2023-08-25T04:04:03.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f8027fff640 1 -- 172.21.15.55:0/2218321778 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80280b0d20 con 0x7f80300d0da0 2023-08-25T04:04:03.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f8035344640 1 -- 172.21.15.55:0/2218321778 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80300b6e80 con 0x7f80300d0da0 2023-08-25T04:04:03.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f8027fff640 1 -- 172.21.15.55:0/2218321778 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80280b9640 con 0x7f80300d0da0 2023-08-25T04:04:03.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f8035344640 1 -- 172.21.15.55:0/2218321778 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80300b7440 con 0x7f80300d0da0 2023-08-25T04:04:03.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.311+0000 7f8035344640 1 -- 172.21.15.55:0/2218321778 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80300cad00 con 0x7f80300d0da0 2023-08-25T04:04:03.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.315+0000 7f8027fff640 1 -- 172.21.15.55:0/2218321778 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f80280b7070 con 0x7f80300d0da0 2023-08-25T04:04:03.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.315+0000 7f8027fff640 1 --2- 172.21.15.55:0/2218321778 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8010065680 0x7f8010067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:03.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.315+0000 7f8027fff640 1 -- 172.21.15.55:0/2218321778 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8028120870 con 0x7f80300d0da0 2023-08-25T04:04:03.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.315+0000 7f802effd640 1 --2- 172.21.15.55:0/2218321778 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8010065680 0x7f8010067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:03.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.315+0000 7f802effd640 1 --2- 172.21.15.55:0/2218321778 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8010065680 0x7f8010067b40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8020009b90 tx=0x7f8020008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:03.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.319+0000 7f8027fff640 1 -- 172.21.15.55:0/2218321778 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f80300cad00 con 0x7f80300d0da0 2023-08-25T04:04:03.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.471+0000 7f8035344640 1 -- 172.21.15.55:0/2218321778 --> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80300b2360 con 0x7f8010065680 2023-08-25T04:04:03.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.483+0000 7f8027fff640 1 -- 172.21.15.55:0/2218321778 <== mgr.4102 v2:172.21.15.110:6832/413962747 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308186 (secure 0 0 0) 0x7f8020011a60 con 0x7f8010065680 2023-08-25T04:04:03.485 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:04:03.488 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:04:03.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.487+0000 7f8035344640 1 -- 172.21.15.55:0/2218321778 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8010065680 msgr2=0x7f8010067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:03.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.487+0000 7f8035344640 1 --2- 172.21.15.55:0/2218321778 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8010065680 0x7f8010067b40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8020009b90 tx=0x7f8020008040 comp rx=0 tx=0).stop 2023-08-25T04:04:03.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.487+0000 7f8035344640 1 -- 172.21.15.55:0/2218321778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80300d0da0 msgr2=0x7f80300b5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:03.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.487+0000 7f8035344640 1 --2- 172.21.15.55:0/2218321778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80300d0da0 0x7f80300b5df0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f802801d3a0 tx=0x7f802801ba90 comp rx=0 tx=0).stop 2023-08-25T04:04:03.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.487+0000 7f8035344640 1 -- 172.21.15.55:0/2218321778 shutdown_connections 2023-08-25T04:04:03.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.487+0000 7f8035344640 1 --2- 172.21.15.55:0/2218321778 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f8010065680 0x7f8010067b40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.487+0000 7f8035344640 1 --2- 172.21.15.55:0/2218321778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80300d0da0 0x7f80300b5df0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.487+0000 7f8035344640 1 --2- 172.21.15.55:0/2218321778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80300cee60 0x7f8030151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.487+0000 7f8035344640 1 --2- 172.21.15.55:0/2218321778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80300cdde0 0x7f80300c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.487+0000 7f8035344640 1 -- 172.21.15.55:0/2218321778 >> 172.21.15.55:0/2218321778 conn(0x7f803009bae0 msgr2=0x7f80300b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:03.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.487+0000 7f8035344640 1 -- 172.21.15.55:0/2218321778 shutdown_connections 2023-08-25T04:04:03.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.487+0000 7f8035344640 1 -- 172.21.15.55:0/2218321778 wait complete. 2023-08-25T04:04:03.507 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-08-25T04:04:02.619051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249716,"kb_used_data":4412,"kb_used_omap":13,"kb_used_meta":245170,"kb_avail":754725004,"statfs":{"total":773094113280,"available":772838404096,"internally_reserved":0,"allocated":4517888,"data_stored":2537620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":251054168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.259284"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983113+0000","last_change":"2023-08-25T04:03:59.406557+0000","last_active":"2023-08-25T04:04:00.983113+0000","last_peered":"2023-08-25T04:04:00.983113+0000","last_clean":"2023-08-25T04:04:00.983113+0000","last_became_active":"2023-08-25T04:03:59.406203+0000","last_became_peered":"2023-08-25T04:03:59.406203+0000","last_unstale":"2023-08-25T04:04:00.983113+0000","last_undegraded":"2023-08-25T04:04:00.983113+0000","last_fullsized":"2023-08-25T04:04:00.983113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:24:08.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982922+0000","last_change":"2023-08-25T04:03:59.405679+0000","last_active":"2023-08-25T04:04:00.982922+0000","last_peered":"2023-08-25T04:04:00.982922+0000","last_clean":"2023-08-25T04:04:00.982922+0000","last_became_active":"2023-08-25T04:03:59.405378+0000","last_became_peered":"2023-08-25T04:03:59.405378+0000","last_unstale":"2023-08-25T04:04:00.982922+0000","last_undegraded":"2023-08-25T04:04:00.982922+0000","last_fullsized":"2023-08-25T04:04:00.982922+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:38.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.423571+0000","last_change":"2023-08-25T04:03:59.422508+0000","last_active":"2023-08-25T04:03:59.423571+0000","last_peered":"2023-08-25T04:03:59.423571+0000","last_clean":"2023-08-25T04:03:59.423571+0000","last_became_active":"2023-08-25T04:03:59.422191+0000","last_became_peered":"2023-08-25T04:03:59.422191+0000","last_unstale":"2023-08-25T04:03:59.423571+0000","last_undegraded":"2023-08-25T04:03:59.423571+0000","last_fullsized":"2023-08-25T04:03:59.423571+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:13:22.438164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401269+0000","last_change":"2023-08-25T04:03:59.400540+0000","last_active":"2023-08-25T04:04:00.401269+0000","last_peered":"2023-08-25T04:04:00.401269+0000","last_clean":"2023-08-25T04:04:00.401269+0000","last_became_active":"2023-08-25T04:03:59.399951+0000","last_became_peered":"2023-08-25T04:03:59.399951+0000","last_unstale":"2023-08-25T04:04:00.401269+0000","last_undegraded":"2023-08-25T04:04:00.401269+0000","last_fullsized":"2023-08-25T04:04:00.401269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:27:39.558644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400972+0000","last_change":"2023-08-25T04:03:59.401446+0000","last_active":"2023-08-25T04:04:00.400972+0000","last_peered":"2023-08-25T04:04:00.400972+0000","last_clean":"2023-08-25T04:04:00.400972+0000","last_became_active":"2023-08-25T04:03:59.401196+0000","last_became_peered":"2023-08-25T04:03:59.401196+0000","last_unstale":"2023-08-25T04:04:00.400972+0000","last_undegraded":"2023-08-25T04:04:00.400972+0000","last_fullsized":"2023-08-25T04:04:00.400972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:56:27.953788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410797+0000","last_change":"2023-08-25T04:03:59.409377+0000","last_active":"2023-08-25T04:03:59.410797+0000","last_peered":"2023-08-25T04:03:59.410797+0000","last_clean":"2023-08-25T04:03:59.410797+0000","last_became_active":"2023-08-25T04:03:59.403715+0000","last_became_peered":"2023-08-25T04:03:59.403715+0000","last_unstale":"2023-08-25T04:03:59.410797+0000","last_undegraded":"2023-08-25T04:03:59.410797+0000","last_fullsized":"2023-08-25T04:03:59.410797+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:14.765621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419238+0000","last_change":"2023-08-25T04:03:59.415058+0000","last_active":"2023-08-25T04:04:00.419238+0000","last_peered":"2023-08-25T04:04:00.419238+0000","last_clean":"2023-08-25T04:04:00.419238+0000","last_became_active":"2023-08-25T04:03:59.414723+0000","last_became_peered":"2023-08-25T04:03:59.414723+0000","last_unstale":"2023-08-25T04:04:00.419238+0000","last_undegraded":"2023-08-25T04:04:00.419238+0000","last_fullsized":"2023-08-25T04:04:00.419238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:34:37.814493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982607+0000","last_change":"2023-08-25T04:03:59.423164+0000","last_active":"2023-08-25T04:04:00.982607+0000","last_peered":"2023-08-25T04:04:00.982607+0000","last_clean":"2023-08-25T04:04:00.982607+0000","last_became_active":"2023-08-25T04:03:59.422861+0000","last_became_peered":"2023-08-25T04:03:59.422861+0000","last_unstale":"2023-08-25T04:04:00.982607+0000","last_undegraded":"2023-08-25T04:04:00.982607+0000","last_fullsized":"2023-08-25T04:04:00.982607+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:51:20.329496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.421133+0000","last_change":"2023-08-25T04:03:59.420041+0000","last_active":"2023-08-25T04:03:59.421133+0000","last_peered":"2023-08-25T04:03:59.421133+0000","last_clean":"2023-08-25T04:03:59.421133+0000","last_became_active":"2023-08-25T04:03:59.419589+0000","last_became_peered":"2023-08-25T04:03:59.419589+0000","last_unstale":"2023-08-25T04:03:59.421133+0000","last_undegraded":"2023-08-25T04:03:59.421133+0000","last_fullsized":"2023-08-25T04:03:59.421133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:05.539349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419590+0000","last_change":"2023-08-25T04:03:59.417854+0000","last_active":"2023-08-25T04:04:00.419590+0000","last_peered":"2023-08-25T04:04:00.419590+0000","last_clean":"2023-08-25T04:04:00.419590+0000","last_became_active":"2023-08-25T04:03:59.416366+0000","last_became_peered":"2023-08-25T04:03:59.416366+0000","last_unstale":"2023-08-25T04:04:00.419590+0000","last_undegraded":"2023-08-25T04:04:00.419590+0000","last_fullsized":"2023-08-25T04:04:00.419590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:20:23.025472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419740+0000","last_change":"2023-08-25T04:03:59.421543+0000","last_active":"2023-08-25T04:04:00.419740+0000","last_peered":"2023-08-25T04:04:00.419740+0000","last_clean":"2023-08-25T04:04:00.419740+0000","last_became_active":"2023-08-25T04:03:59.421202+0000","last_became_peered":"2023-08-25T04:03:59.421202+0000","last_unstale":"2023-08-25T04:04:00.419740+0000","last_undegraded":"2023-08-25T04:04:00.419740+0000","last_fullsized":"2023-08-25T04:04:00.419740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:08:57.095318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.416141+0000","last_change":"2023-08-25T04:03:59.414096+0000","last_active":"2023-08-25T04:03:59.416141+0000","last_peered":"2023-08-25T04:03:59.416141+0000","last_clean":"2023-08-25T04:03:59.416141+0000","last_became_active":"2023-08-25T04:03:59.413799+0000","last_became_peered":"2023-08-25T04:03:59.413799+0000","last_unstale":"2023-08-25T04:03:59.416141+0000","last_undegraded":"2023-08-25T04:03:59.416141+0000","last_fullsized":"2023-08-25T04:03:59.416141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:05:09.949970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419553+0000","last_change":"2023-08-25T04:03:59.418141+0000","last_active":"2023-08-25T04:04:00.419553+0000","last_peered":"2023-08-25T04:04:00.419553+0000","last_clean":"2023-08-25T04:04:00.419553+0000","last_became_active":"2023-08-25T04:03:59.417880+0000","last_became_peered":"2023-08-25T04:03:59.417880+0000","last_unstale":"2023-08-25T04:04:00.419553+0000","last_undegraded":"2023-08-25T04:04:00.419553+0000","last_fullsized":"2023-08-25T04:04:00.419553+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:55:54.338998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401652+0000","last_change":"2023-08-25T04:03:59.394965+0000","last_active":"2023-08-25T04:04:00.401652+0000","last_peered":"2023-08-25T04:04:00.401652+0000","last_clean":"2023-08-25T04:04:00.401652+0000","last_became_active":"2023-08-25T04:03:59.394626+0000","last_became_peered":"2023-08-25T04:03:59.394626+0000","last_unstale":"2023-08-25T04:04:00.401652+0000","last_undegraded":"2023-08-25T04:04:00.401652+0000","last_fullsized":"2023-08-25T04:04:00.401652+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:08:51.394168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419194+0000","last_change":"2023-08-25T04:03:59.413847+0000","last_active":"2023-08-25T04:04:00.419194+0000","last_peered":"2023-08-25T04:04:00.419194+0000","last_clean":"2023-08-25T04:04:00.419194+0000","last_became_active":"2023-08-25T04:03:59.413121+0000","last_became_peered":"2023-08-25T04:03:59.413121+0000","last_unstale":"2023-08-25T04:04:00.419194+0000","last_undegraded":"2023-08-25T04:04:00.419194+0000","last_fullsized":"2023-08-25T04:04:00.419194+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:20:45.210270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401121+0000","last_change":"2023-08-25T04:03:59.414035+0000","last_active":"2023-08-25T04:04:00.401121+0000","last_peered":"2023-08-25T04:04:00.401121+0000","last_clean":"2023-08-25T04:04:00.401121+0000","last_became_active":"2023-08-25T04:03:59.413749+0000","last_became_peered":"2023-08-25T04:03:59.413749+0000","last_unstale":"2023-08-25T04:04:00.401121+0000","last_undegraded":"2023-08-25T04:04:00.401121+0000","last_fullsized":"2023-08-25T04:04:00.401121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:07:11.827147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419383+0000","last_change":"2023-08-25T04:03:59.418049+0000","last_active":"2023-08-25T04:04:00.419383+0000","last_peered":"2023-08-25T04:04:00.419383+0000","last_clean":"2023-08-25T04:04:00.419383+0000","last_became_active":"2023-08-25T04:03:59.417803+0000","last_became_peered":"2023-08-25T04:03:59.417803+0000","last_unstale":"2023-08-25T04:04:00.419383+0000","last_undegraded":"2023-08-25T04:04:00.419383+0000","last_fullsized":"2023-08-25T04:04:00.419383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:30:53.684824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402633+0000","last_change":"2023-08-25T04:03:59.405308+0000","last_active":"2023-08-25T04:04:00.402633+0000","last_peered":"2023-08-25T04:04:00.402633+0000","last_clean":"2023-08-25T04:04:00.402633+0000","last_became_active":"2023-08-25T04:03:59.405020+0000","last_became_peered":"2023-08-25T04:03:59.405020+0000","last_unstale":"2023-08-25T04:04:00.402633+0000","last_undegraded":"2023-08-25T04:04:00.402633+0000","last_fullsized":"2023-08-25T04:04:00.402633+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:32.783190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400796+0000","last_change":"2023-08-25T04:03:59.400976+0000","last_active":"2023-08-25T04:04:00.400796+0000","last_peered":"2023-08-25T04:04:00.400796+0000","last_clean":"2023-08-25T04:04:00.400796+0000","last_became_active":"2023-08-25T04:03:59.400488+0000","last_became_peered":"2023-08-25T04:03:59.400488+0000","last_unstale":"2023-08-25T04:04:00.400796+0000","last_undegraded":"2023-08-25T04:04:00.400796+0000","last_fullsized":"2023-08-25T04:04:00.400796+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:42:10.702642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.419196+0000","last_change":"2023-08-25T04:03:59.417741+0000","last_active":"2023-08-25T04:03:59.419196+0000","last_peered":"2023-08-25T04:03:59.419196+0000","last_clean":"2023-08-25T04:03:59.419196+0000","last_became_active":"2023-08-25T04:03:59.417492+0000","last_became_peered":"2023-08-25T04:03:59.417492+0000","last_unstale":"2023-08-25T04:03:59.419196+0000","last_undegraded":"2023-08-25T04:03:59.419196+0000","last_fullsized":"2023-08-25T04:03:59.419196+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:31:49.886410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419678+0000","last_change":"2023-08-25T04:03:59.414961+0000","last_active":"2023-08-25T04:04:00.419678+0000","last_peered":"2023-08-25T04:04:00.419678+0000","last_clean":"2023-08-25T04:04:00.419678+0000","last_became_active":"2023-08-25T04:03:59.414610+0000","last_became_peered":"2023-08-25T04:03:59.414610+0000","last_unstale":"2023-08-25T04:04:00.419678+0000","last_undegraded":"2023-08-25T04:04:00.419678+0000","last_fullsized":"2023-08-25T04:04:00.419678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:08:51.394168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410368+0000","last_change":"2023-08-25T04:03:59.409108+0000","last_active":"2023-08-25T04:03:59.410368+0000","last_peered":"2023-08-25T04:03:59.410368+0000","last_clean":"2023-08-25T04:03:59.410368+0000","last_became_active":"2023-08-25T04:03:59.408844+0000","last_became_peered":"2023-08-25T04:03:59.408844+0000","last_unstale":"2023-08-25T04:03:59.410368+0000","last_undegraded":"2023-08-25T04:03:59.410368+0000","last_fullsized":"2023-08-25T04:03:59.410368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:31:52.823942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.366119+0000","last_change":"2023-08-25T04:03:57.366119+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.366119+0000","last_undegraded":"2023-08-25T04:03:57.366119+0000","last_fullsized":"2023-08-25T04:03:57.366119+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.423971+0000","last_change":"2023-08-25T04:03:59.422459+0000","last_active":"2023-08-25T04:03:59.423971+0000","last_peered":"2023-08-25T04:03:59.423971+0000","last_clean":"2023-08-25T04:03:59.423971+0000","last_became_active":"2023-08-25T04:03:59.422050+0000","last_became_peered":"2023-08-25T04:03:59.422050+0000","last_unstale":"2023-08-25T04:03:59.423971+0000","last_undegraded":"2023-08-25T04:03:59.423971+0000","last_fullsized":"2023-08-25T04:03:59.423971+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:17:35.817866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.400966+0000","last_change":"2023-08-25T04:03:58.386703+0000","last_active":"2023-08-25T04:03:59.400966+0000","last_peered":"2023-08-25T04:03:59.400966+0000","last_clean":"2023-08-25T04:03:59.400966+0000","last_became_active":"2023-08-25T04:03:58.386432+0000","last_became_peered":"2023-08-25T04:03:58.386432+0000","last_unstale":"2023-08-25T04:03:59.400966+0000","last_undegraded":"2023-08-25T04:03:59.400966+0000","last_fullsized":"2023-08-25T04:03:59.400966+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:49.791778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402854+0000","last_change":"2023-08-25T04:03:59.395833+0000","last_active":"2023-08-25T04:04:00.402854+0000","last_peered":"2023-08-25T04:04:00.402854+0000","last_clean":"2023-08-25T04:04:00.402854+0000","last_became_active":"2023-08-25T04:03:59.395329+0000","last_became_peered":"2023-08-25T04:03:59.395329+0000","last_unstale":"2023-08-25T04:04:00.402854+0000","last_undegraded":"2023-08-25T04:04:00.402854+0000","last_fullsized":"2023-08-25T04:04:00.402854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:02:30.264838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410774+0000","last_change":"2023-08-25T04:03:58.376492+0000","last_active":"2023-08-25T04:03:59.410774+0000","last_peered":"2023-08-25T04:03:59.410774+0000","last_clean":"2023-08-25T04:03:59.410774+0000","last_became_active":"2023-08-25T04:03:58.375494+0000","last_became_peered":"2023-08-25T04:03:58.375494+0000","last_unstale":"2023-08-25T04:03:59.410774+0000","last_undegraded":"2023-08-25T04:03:59.410774+0000","last_fullsized":"2023-08-25T04:03:59.410774+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:06:00.526490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983068+0000","last_change":"2023-08-25T04:03:59.405903+0000","last_active":"2023-08-25T04:04:00.983068+0000","last_peered":"2023-08-25T04:04:00.983068+0000","last_clean":"2023-08-25T04:04:00.983068+0000","last_became_active":"2023-08-25T04:03:59.405466+0000","last_became_peered":"2023-08-25T04:03:59.405466+0000","last_unstale":"2023-08-25T04:04:00.983068+0000","last_undegraded":"2023-08-25T04:04:00.983068+0000","last_fullsized":"2023-08-25T04:04:00.983068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:35:34.878076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402698+0000","last_change":"2023-08-25T04:03:58.388087+0000","last_active":"2023-08-25T04:04:00.402698+0000","last_peered":"2023-08-25T04:04:00.402698+0000","last_clean":"2023-08-25T04:04:00.402698+0000","last_became_active":"2023-08-25T04:03:58.387747+0000","last_became_peered":"2023-08-25T04:03:58.387747+0000","last_unstale":"2023-08-25T04:04:00.402698+0000","last_undegraded":"2023-08-25T04:04:00.402698+0000","last_fullsized":"2023-08-25T04:04:00.402698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:17.322151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.404892+0000","last_change":"2023-08-25T04:03:59.402378+0000","last_active":"2023-08-25T04:03:59.404892+0000","last_peered":"2023-08-25T04:03:59.404892+0000","last_clean":"2023-08-25T04:03:59.404892+0000","last_became_active":"2023-08-25T04:03:59.402007+0000","last_became_peered":"2023-08-25T04:03:59.402007+0000","last_unstale":"2023-08-25T04:03:59.404892+0000","last_undegraded":"2023-08-25T04:03:59.404892+0000","last_fullsized":"2023-08-25T04:03:59.404892+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:14:06.833085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419370+0000","last_change":"2023-08-25T04:03:58.385258+0000","last_active":"2023-08-25T04:04:00.419370+0000","last_peered":"2023-08-25T04:04:00.419370+0000","last_clean":"2023-08-25T04:04:00.419370+0000","last_became_active":"2023-08-25T04:03:58.384991+0000","last_became_peered":"2023-08-25T04:03:58.384991+0000","last_unstale":"2023-08-25T04:04:00.419370+0000","last_undegraded":"2023-08-25T04:04:00.419370+0000","last_fullsized":"2023-08-25T04:04:00.419370+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:07:30.250928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419383+0000","last_change":"2023-08-25T04:03:59.414026+0000","last_active":"2023-08-25T04:04:00.419383+0000","last_peered":"2023-08-25T04:04:00.419383+0000","last_clean":"2023-08-25T04:04:00.419383+0000","last_became_active":"2023-08-25T04:03:59.413496+0000","last_became_peered":"2023-08-25T04:03:59.413496+0000","last_unstale":"2023-08-25T04:04:00.419383+0000","last_undegraded":"2023-08-25T04:04:00.419383+0000","last_fullsized":"2023-08-25T04:04:00.419383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:47.335245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.362336+0000","last_change":"2023-08-25T04:03:57.362336+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.362336+0000","last_undegraded":"2023-08-25T04:03:57.362336+0000","last_fullsized":"2023-08-25T04:03:57.362336+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402516+0000","last_change":"2023-08-25T04:03:59.417484+0000","last_active":"2023-08-25T04:04:00.402516+0000","last_peered":"2023-08-25T04:04:00.402516+0000","last_clean":"2023-08-25T04:04:00.402516+0000","last_became_active":"2023-08-25T04:03:59.417130+0000","last_became_peered":"2023-08-25T04:03:59.417130+0000","last_unstale":"2023-08-25T04:04:00.402516+0000","last_undegraded":"2023-08-25T04:04:00.402516+0000","last_fullsized":"2023-08-25T04:04:00.402516+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:23:20.399499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.389371+0000","last_change":"2023-08-25T04:03:58.384345+0000","last_active":"2023-08-25T04:03:59.389371+0000","last_peered":"2023-08-25T04:03:59.389371+0000","last_clean":"2023-08-25T04:03:59.389371+0000","last_became_active":"2023-08-25T04:03:58.384067+0000","last_became_peered":"2023-08-25T04:03:58.384067+0000","last_unstale":"2023-08-25T04:03:59.389371+0000","last_undegraded":"2023-08-25T04:03:59.389371+0000","last_fullsized":"2023-08-25T04:03:59.389371+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:47:45.627944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982797+0000","last_change":"2023-08-25T04:03:59.406474+0000","last_active":"2023-08-25T04:04:00.982797+0000","last_peered":"2023-08-25T04:04:00.982797+0000","last_clean":"2023-08-25T04:04:00.982797+0000","last_became_active":"2023-08-25T04:03:59.406133+0000","last_became_peered":"2023-08-25T04:03:59.406133+0000","last_unstale":"2023-08-25T04:04:00.982797+0000","last_undegraded":"2023-08-25T04:04:00.982797+0000","last_fullsized":"2023-08-25T04:04:00.982797+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:04:17.226276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401672+0000","last_change":"2023-08-25T04:03:58.380770+0000","last_active":"2023-08-25T04:04:00.401672+0000","last_peered":"2023-08-25T04:04:00.401672+0000","last_clean":"2023-08-25T04:04:00.401672+0000","last_became_active":"2023-08-25T04:03:58.380444+0000","last_became_peered":"2023-08-25T04:03:58.380444+0000","last_unstale":"2023-08-25T04:04:00.401672+0000","last_undegraded":"2023-08-25T04:04:00.401672+0000","last_fullsized":"2023-08-25T04:04:00.401672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:08:56.083693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401151+0000","last_change":"2023-08-25T04:03:59.400753+0000","last_active":"2023-08-25T04:04:00.401151+0000","last_peered":"2023-08-25T04:04:00.401151+0000","last_clean":"2023-08-25T04:04:00.401151+0000","last_became_active":"2023-08-25T04:03:59.400263+0000","last_became_peered":"2023-08-25T04:03:59.400263+0000","last_unstale":"2023-08-25T04:04:00.401151+0000","last_undegraded":"2023-08-25T04:04:00.401151+0000","last_fullsized":"2023-08-25T04:04:00.401151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:40:08.451848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983139+0000","last_change":"2023-08-25T04:03:58.389611+0000","last_active":"2023-08-25T04:04:00.983139+0000","last_peered":"2023-08-25T04:04:00.983139+0000","last_clean":"2023-08-25T04:04:00.983139+0000","last_became_active":"2023-08-25T04:03:58.389289+0000","last_became_peered":"2023-08-25T04:03:58.389289+0000","last_unstale":"2023-08-25T04:04:00.983139+0000","last_undegraded":"2023-08-25T04:04:00.983139+0000","last_fullsized":"2023-08-25T04:04:00.983139+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:58.251174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419820+0000","last_change":"2023-08-25T04:03:58.390364+0000","last_active":"2023-08-25T04:04:00.419820+0000","last_peered":"2023-08-25T04:04:00.419820+0000","last_clean":"2023-08-25T04:04:00.419820+0000","last_became_active":"2023-08-25T04:03:58.390106+0000","last_became_peered":"2023-08-25T04:03:58.390106+0000","last_unstale":"2023-08-25T04:04:00.419820+0000","last_undegraded":"2023-08-25T04:04:00.419820+0000","last_fullsized":"2023-08-25T04:04:00.419820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:23:19.387874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.403467+0000","last_change":"2023-08-25T04:03:59.400496+0000","last_active":"2023-08-25T04:03:59.403467+0000","last_peered":"2023-08-25T04:03:59.403467+0000","last_clean":"2023-08-25T04:03:59.403467+0000","last_became_active":"2023-08-25T04:03:59.400190+0000","last_became_peered":"2023-08-25T04:03:59.400190+0000","last_unstale":"2023-08-25T04:03:59.403467+0000","last_undegraded":"2023-08-25T04:03:59.403467+0000","last_fullsized":"2023-08-25T04:03:59.403467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:58:14.431223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419790+0000","last_change":"2023-08-25T04:03:58.386413+0000","last_active":"2023-08-25T04:04:00.419790+0000","last_peered":"2023-08-25T04:04:00.419790+0000","last_clean":"2023-08-25T04:04:00.419790+0000","last_became_active":"2023-08-25T04:03:58.385665+0000","last_became_peered":"2023-08-25T04:03:58.385665+0000","last_unstale":"2023-08-25T04:04:00.419790+0000","last_undegraded":"2023-08-25T04:04:00.419790+0000","last_fullsized":"2023-08-25T04:04:00.419790+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:43.279859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402931+0000","last_change":"2023-08-25T04:03:59.410573+0000","last_active":"2023-08-25T04:04:00.402931+0000","last_peered":"2023-08-25T04:04:00.402931+0000","last_clean":"2023-08-25T04:04:00.402931+0000","last_became_active":"2023-08-25T04:03:59.410265+0000","last_became_peered":"2023-08-25T04:03:59.410265+0000","last_unstale":"2023-08-25T04:04:00.402931+0000","last_undegraded":"2023-08-25T04:04:00.402931+0000","last_fullsized":"2023-08-25T04:04:00.402931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:23:45.964870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983052+0000","last_change":"2023-08-25T04:03:58.387790+0000","last_active":"2023-08-25T04:04:00.983052+0000","last_peered":"2023-08-25T04:04:00.983052+0000","last_clean":"2023-08-25T04:04:00.983052+0000","last_became_active":"2023-08-25T04:03:58.387517+0000","last_became_peered":"2023-08-25T04:03:58.387517+0000","last_unstale":"2023-08-25T04:04:00.983052+0000","last_undegraded":"2023-08-25T04:04:00.983052+0000","last_fullsized":"2023-08-25T04:04:00.983052+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:20.409272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.420670+0000","last_change":"2023-08-25T04:03:59.418006+0000","last_active":"2023-08-25T04:03:59.420670+0000","last_peered":"2023-08-25T04:03:59.420670+0000","last_clean":"2023-08-25T04:03:59.420670+0000","last_became_active":"2023-08-25T04:03:59.417698+0000","last_became_peered":"2023-08-25T04:03:59.417698+0000","last_unstale":"2023-08-25T04:03:59.420670+0000","last_undegraded":"2023-08-25T04:03:59.420670+0000","last_fullsized":"2023-08-25T04:03:59.420670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:44.450303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982988+0000","last_change":"2023-08-25T04:03:58.389761+0000","last_active":"2023-08-25T04:04:00.982988+0000","last_peered":"2023-08-25T04:04:00.982988+0000","last_clean":"2023-08-25T04:04:00.982988+0000","last_became_active":"2023-08-25T04:03:58.388403+0000","last_became_peered":"2023-08-25T04:03:58.388403+0000","last_unstale":"2023-08-25T04:04:00.982988+0000","last_undegraded":"2023-08-25T04:04:00.982988+0000","last_fullsized":"2023-08-25T04:04:00.982988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:44:53.006803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982613+0000","last_change":"2023-08-25T04:03:59.406135+0000","last_active":"2023-08-25T04:04:00.982613+0000","last_peered":"2023-08-25T04:04:00.982613+0000","last_clean":"2023-08-25T04:04:00.982613+0000","last_became_active":"2023-08-25T04:03:59.405815+0000","last_became_peered":"2023-08-25T04:03:59.405815+0000","last_unstale":"2023-08-25T04:04:00.982613+0000","last_undegraded":"2023-08-25T04:04:00.982613+0000","last_fullsized":"2023-08-25T04:04:00.982613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:04:29.975483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.388438+0000","last_change":"2023-08-25T04:03:58.385409+0000","last_active":"2023-08-25T04:03:59.388438+0000","last_peered":"2023-08-25T04:03:59.388438+0000","last_clean":"2023-08-25T04:03:59.388438+0000","last_became_active":"2023-08-25T04:03:58.385114+0000","last_became_peered":"2023-08-25T04:03:58.385114+0000","last_unstale":"2023-08-25T04:03:59.388438+0000","last_undegraded":"2023-08-25T04:03:59.388438+0000","last_fullsized":"2023-08-25T04:03:59.388438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:11:51.858524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.366033+0000","last_change":"2023-08-25T04:03:57.366033+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.366033+0000","last_undegraded":"2023-08-25T04:03:57.366033+0000","last_fullsized":"2023-08-25T04:03:57.366033+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982718+0000","last_change":"2023-08-25T04:03:59.404648+0000","last_active":"2023-08-25T04:04:00.982718+0000","last_peered":"2023-08-25T04:04:00.982718+0000","last_clean":"2023-08-25T04:04:00.982718+0000","last_became_active":"2023-08-25T04:03:59.404224+0000","last_became_peered":"2023-08-25T04:03:59.404224+0000","last_unstale":"2023-08-25T04:04:00.982718+0000","last_undegraded":"2023-08-25T04:04:00.982718+0000","last_fullsized":"2023-08-25T04:04:00.982718+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:12:53.411199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.362302+0000","last_change":"2023-08-25T04:03:57.362302+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.362302+0000","last_undegraded":"2023-08-25T04:03:57.362302+0000","last_fullsized":"2023-08-25T04:03:57.362302+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982887+0000","last_change":"2023-08-25T04:03:59.402822+0000","last_active":"2023-08-25T04:04:00.982887+0000","last_peered":"2023-08-25T04:04:00.982887+0000","last_clean":"2023-08-25T04:04:00.982887+0000","last_became_active":"2023-08-25T04:03:59.402413+0000","last_became_peered":"2023-08-25T04:03:59.402413+0000","last_unstale":"2023-08-25T04:04:00.982887+0000","last_undegraded":"2023-08-25T04:04:00.982887+0000","last_fullsized":"2023-08-25T04:04:00.982887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:06.684416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419894+0000","last_change":"2023-08-25T04:03:58.389581+0000","last_active":"2023-08-25T04:04:00.419894+0000","last_peered":"2023-08-25T04:04:00.419894+0000","last_clean":"2023-08-25T04:04:00.419894+0000","last_became_active":"2023-08-25T04:03:58.388910+0000","last_became_peered":"2023-08-25T04:03:58.388910+0000","last_unstale":"2023-08-25T04:04:00.419894+0000","last_undegraded":"2023-08-25T04:04:00.419894+0000","last_fullsized":"2023-08-25T04:04:00.419894+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:31.771566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419619+0000","last_change":"2023-08-25T04:03:59.421526+0000","last_active":"2023-08-25T04:04:00.419619+0000","last_peered":"2023-08-25T04:04:00.419619+0000","last_clean":"2023-08-25T04:04:00.419619+0000","last_became_active":"2023-08-25T04:03:59.421169+0000","last_became_peered":"2023-08-25T04:03:59.421169+0000","last_unstale":"2023-08-25T04:04:00.419619+0000","last_undegraded":"2023-08-25T04:04:00.419619+0000","last_fullsized":"2023-08-25T04:04:00.419619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:56:53.601262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402892+0000","last_change":"2023-08-25T04:03:58.385498+0000","last_active":"2023-08-25T04:04:00.402892+0000","last_peered":"2023-08-25T04:04:00.402892+0000","last_clean":"2023-08-25T04:04:00.402892+0000","last_became_active":"2023-08-25T04:03:58.385215+0000","last_became_peered":"2023-08-25T04:03:58.385215+0000","last_unstale":"2023-08-25T04:04:00.402892+0000","last_undegraded":"2023-08-25T04:04:00.402892+0000","last_fullsized":"2023-08-25T04:04:00.402892+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:21.370228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402806+0000","last_change":"2023-08-25T04:03:59.410945+0000","last_active":"2023-08-25T04:04:00.402806+0000","last_peered":"2023-08-25T04:04:00.402806+0000","last_clean":"2023-08-25T04:04:00.402806+0000","last_became_active":"2023-08-25T04:03:59.410648+0000","last_became_peered":"2023-08-25T04:03:59.410648+0000","last_unstale":"2023-08-25T04:04:00.402806+0000","last_undegraded":"2023-08-25T04:04:00.402806+0000","last_fullsized":"2023-08-25T04:04:00.402806+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:39.793044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401201+0000","last_change":"2023-08-25T04:03:58.388839+0000","last_active":"2023-08-25T04:04:00.401201+0000","last_peered":"2023-08-25T04:04:00.401201+0000","last_clean":"2023-08-25T04:04:00.401201+0000","last_became_active":"2023-08-25T04:03:58.387292+0000","last_became_peered":"2023-08-25T04:03:58.387292+0000","last_unstale":"2023-08-25T04:04:00.401201+0000","last_undegraded":"2023-08-25T04:04:00.401201+0000","last_fullsized":"2023-08-25T04:04:00.401201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:17:38.350945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401251+0000","last_change":"2023-08-25T04:03:59.412433+0000","last_active":"2023-08-25T04:04:00.401251+0000","last_peered":"2023-08-25T04:04:00.401251+0000","last_clean":"2023-08-25T04:04:00.401251+0000","last_became_active":"2023-08-25T04:03:59.412124+0000","last_became_peered":"2023-08-25T04:03:59.412124+0000","last_unstale":"2023-08-25T04:04:00.401251+0000","last_undegraded":"2023-08-25T04:04:00.401251+0000","last_fullsized":"2023-08-25T04:04:00.401251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:39:52.127970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.394843+0000","last_change":"2023-08-25T04:03:58.375199+0000","last_active":"2023-08-25T04:03:59.394843+0000","last_peered":"2023-08-25T04:03:59.394843+0000","last_clean":"2023-08-25T04:03:59.394843+0000","last_became_active":"2023-08-25T04:03:58.374994+0000","last_became_peered":"2023-08-25T04:03:58.374994+0000","last_unstale":"2023-08-25T04:03:59.394843+0000","last_undegraded":"2023-08-25T04:03:59.394843+0000","last_fullsized":"2023-08-25T04:03:59.394843+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:10:41.181170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401003+0000","last_change":"2023-08-25T04:03:58.388343+0000","last_active":"2023-08-25T04:04:00.401003+0000","last_peered":"2023-08-25T04:04:00.401003+0000","last_clean":"2023-08-25T04:04:00.401003+0000","last_became_active":"2023-08-25T04:03:58.387241+0000","last_became_peered":"2023-08-25T04:03:58.387241+0000","last_unstale":"2023-08-25T04:04:00.401003+0000","last_undegraded":"2023-08-25T04:04:00.401003+0000","last_fullsized":"2023-08-25T04:04:00.401003+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:12:13.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.403432+0000","last_change":"2023-08-25T04:03:59.400416+0000","last_active":"2023-08-25T04:03:59.403432+0000","last_peered":"2023-08-25T04:03:59.403432+0000","last_clean":"2023-08-25T04:03:59.403432+0000","last_became_active":"2023-08-25T04:03:59.400094+0000","last_became_peered":"2023-08-25T04:03:59.400094+0000","last_unstale":"2023-08-25T04:03:59.403432+0000","last_undegraded":"2023-08-25T04:03:59.403432+0000","last_fullsized":"2023-08-25T04:03:59.403432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:38:49.403139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400938+0000","last_change":"2023-08-25T04:03:58.380520+0000","last_active":"2023-08-25T04:04:00.400938+0000","last_peered":"2023-08-25T04:04:00.400938+0000","last_clean":"2023-08-25T04:04:00.400938+0000","last_became_active":"2023-08-25T04:03:58.380215+0000","last_became_peered":"2023-08-25T04:03:58.380215+0000","last_unstale":"2023-08-25T04:04:00.400938+0000","last_undegraded":"2023-08-25T04:04:00.400938+0000","last_fullsized":"2023-08-25T04:04:00.400938+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:20:10.016494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419387+0000","last_change":"2023-08-25T04:03:59.418011+0000","last_active":"2023-08-25T04:04:00.419387+0000","last_peered":"2023-08-25T04:04:00.419387+0000","last_clean":"2023-08-25T04:04:00.419387+0000","last_became_active":"2023-08-25T04:03:59.416332+0000","last_became_peered":"2023-08-25T04:03:59.416332+0000","last_unstale":"2023-08-25T04:04:00.419387+0000","last_undegraded":"2023-08-25T04:04:00.419387+0000","last_fullsized":"2023-08-25T04:04:00.419387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:44:01.894126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.362928+0000","last_change":"2023-08-25T04:03:57.362928+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.362928+0000","last_undegraded":"2023-08-25T04:03:57.362928+0000","last_fullsized":"2023-08-25T04:03:57.362928+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982896+0000","last_change":"2023-08-25T04:03:59.406384+0000","last_active":"2023-08-25T04:04:00.982896+0000","last_peered":"2023-08-25T04:04:00.982896+0000","last_clean":"2023-08-25T04:04:00.982896+0000","last_became_active":"2023-08-25T04:03:59.405851+0000","last_became_peered":"2023-08-25T04:03:59.405851+0000","last_unstale":"2023-08-25T04:04:00.982896+0000","last_undegraded":"2023-08-25T04:04:00.982896+0000","last_fullsized":"2023-08-25T04:04:00.982896+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:40.592468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400806+0000","last_change":"2023-08-25T04:03:58.387617+0000","last_active":"2023-08-25T04:04:00.400806+0000","last_peered":"2023-08-25T04:04:00.400806+0000","last_clean":"2023-08-25T04:04:00.400806+0000","last_became_active":"2023-08-25T04:03:58.387256+0000","last_became_peered":"2023-08-25T04:03:58.387256+0000","last_unstale":"2023-08-25T04:04:00.400806+0000","last_undegraded":"2023-08-25T04:04:00.400806+0000","last_fullsized":"2023-08-25T04:04:00.400806+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:32:58.744009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419752+0000","last_change":"2023-08-25T04:03:59.418440+0000","last_active":"2023-08-25T04:04:00.419752+0000","last_peered":"2023-08-25T04:04:00.419752+0000","last_clean":"2023-08-25T04:04:00.419752+0000","last_became_active":"2023-08-25T04:03:59.418264+0000","last_became_peered":"2023-08-25T04:03:59.418264+0000","last_unstale":"2023-08-25T04:04:00.419752+0000","last_undegraded":"2023-08-25T04:04:00.419752+0000","last_fullsized":"2023-08-25T04:04:00.419752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:52.932778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.363019+0000","last_change":"2023-08-25T04:03:57.363019+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.363019+0000","last_undegraded":"2023-08-25T04:03:57.363019+0000","last_fullsized":"2023-08-25T04:03:57.363019+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":193,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-25T04:03:57.363664+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:03:57.363664+0000","last_peered":"2023-08-25T04:03:57.363664+0000","last_clean":"2023-08-25T04:03:57.363664+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:03:57.363664+0000","last_undegraded":"2023-08-25T04:03:57.363664+0000","last_fullsized":"2023-08-25T04:03:57.363664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:21:23.296682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419570+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:04:00.419570+0000","last_peered":"2023-08-25T04:04:00.419570+0000","last_clean":"2023-08-25T04:04:00.419570+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:04:00.419570+0000","last_undegraded":"2023-08-25T04:04:00.419570+0000","last_fullsized":"2023-08-25T04:04:00.419570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:45:20.387820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.420791+0000","last_change":"2023-08-25T04:03:59.419512+0000","last_active":"2023-08-25T04:03:59.420791+0000","last_peered":"2023-08-25T04:03:59.420791+0000","last_clean":"2023-08-25T04:03:59.420791+0000","last_became_active":"2023-08-25T04:03:59.419143+0000","last_became_peered":"2023-08-25T04:03:59.419143+0000","last_unstale":"2023-08-25T04:03:59.420791+0000","last_undegraded":"2023-08-25T04:03:59.420791+0000","last_fullsized":"2023-08-25T04:03:59.420791+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:08:08.686296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419946+0000","last_change":"2023-08-25T04:03:58.389811+0000","last_active":"2023-08-25T04:04:00.419946+0000","last_peered":"2023-08-25T04:04:00.419946+0000","last_clean":"2023-08-25T04:04:00.419946+0000","last_became_active":"2023-08-25T04:03:58.389274+0000","last_became_peered":"2023-08-25T04:03:58.389274+0000","last_unstale":"2023-08-25T04:04:00.419946+0000","last_undegraded":"2023-08-25T04:04:00.419946+0000","last_fullsized":"2023-08-25T04:04:00.419946+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:17.322151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-25T04:03:57.363537+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:03:57.363537+0000","last_peered":"2023-08-25T04:03:57.363537+0000","last_clean":"2023-08-25T04:03:57.363537+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:03:57.363537+0000","last_undegraded":"2023-08-25T04:03:57.363537+0000","last_fullsized":"2023-08-25T04:03:57.363537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:14:47.084096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401201+0000","last_change":"2023-08-25T04:03:58.386244+0000","last_active":"2023-08-25T04:04:00.401201+0000","last_peered":"2023-08-25T04:04:00.401201+0000","last_clean":"2023-08-25T04:04:00.401201+0000","last_became_active":"2023-08-25T04:03:58.385936+0000","last_became_peered":"2023-08-25T04:03:58.385936+0000","last_unstale":"2023-08-25T04:04:00.401201+0000","last_undegraded":"2023-08-25T04:04:00.401201+0000","last_fullsized":"2023-08-25T04:04:00.401201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:40:13.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400848+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:04:00.400848+0000","last_peered":"2023-08-25T04:04:00.400848+0000","last_clean":"2023-08-25T04:04:00.400848+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:04:00.400848+0000","last_undegraded":"2023-08-25T04:04:00.400848+0000","last_fullsized":"2023-08-25T04:04:00.400848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:49.545600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982987+0000","last_change":"2023-08-25T04:03:59.397271+0000","last_active":"2023-08-25T04:04:00.982987+0000","last_peered":"2023-08-25T04:04:00.982987+0000","last_clean":"2023-08-25T04:04:00.982987+0000","last_became_active":"2023-08-25T04:03:59.396948+0000","last_became_peered":"2023-08-25T04:03:59.396948+0000","last_unstale":"2023-08-25T04:04:00.982987+0000","last_undegraded":"2023-08-25T04:04:00.982987+0000","last_fullsized":"2023-08-25T04:04:00.982987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:11:44.609170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.390471+0000","last_change":"2023-08-25T04:03:58.382342+0000","last_active":"2023-08-25T04:03:59.390471+0000","last_peered":"2023-08-25T04:03:59.390471+0000","last_clean":"2023-08-25T04:03:59.390471+0000","last_became_active":"2023-08-25T04:03:58.382068+0000","last_became_peered":"2023-08-25T04:03:58.382068+0000","last_unstale":"2023-08-25T04:03:59.390471+0000","last_undegraded":"2023-08-25T04:03:59.390471+0000","last_fullsized":"2023-08-25T04:03:59.390471+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:18:16.177809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419423+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:04:00.419423+0000","last_peered":"2023-08-25T04:04:00.419423+0000","last_clean":"2023-08-25T04:04:00.419423+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:04:00.419423+0000","last_undegraded":"2023-08-25T04:04:00.419423+0000","last_fullsized":"2023-08-25T04:04:00.419423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:44:08.796401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410272+0000","last_change":"2023-08-25T04:03:59.408317+0000","last_active":"2023-08-25T04:03:59.410272+0000","last_peered":"2023-08-25T04:03:59.410272+0000","last_clean":"2023-08-25T04:03:59.410272+0000","last_became_active":"2023-08-25T04:03:59.408091+0000","last_became_peered":"2023-08-25T04:03:59.408091+0000","last_unstale":"2023-08-25T04:03:59.410272+0000","last_undegraded":"2023-08-25T04:03:59.410272+0000","last_fullsized":"2023-08-25T04:03:59.410272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:27:40.842846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.391080+0000","last_change":"2023-08-25T04:03:58.384133+0000","last_active":"2023-08-25T04:03:59.391080+0000","last_peered":"2023-08-25T04:03:59.391080+0000","last_clean":"2023-08-25T04:03:59.391080+0000","last_became_active":"2023-08-25T04:03:58.383821+0000","last_became_peered":"2023-08-25T04:03:58.383821+0000","last_unstale":"2023-08-25T04:03:59.391080+0000","last_undegraded":"2023-08-25T04:03:59.391080+0000","last_fullsized":"2023-08-25T04:03:59.391080+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:22:33.037133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.394919+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:03:59.394919+0000","last_peered":"2023-08-25T04:03:59.394919+0000","last_clean":"2023-08-25T04:03:59.394919+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:03:59.394919+0000","last_undegraded":"2023-08-25T04:03:59.394919+0000","last_fullsized":"2023-08-25T04:03:59.394919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:08:13.548315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410403+0000","last_change":"2023-08-25T04:03:59.402065+0000","last_active":"2023-08-25T04:03:59.410403+0000","last_peered":"2023-08-25T04:03:59.410403+0000","last_clean":"2023-08-25T04:03:59.410403+0000","last_became_active":"2023-08-25T04:03:59.401800+0000","last_became_peered":"2023-08-25T04:03:59.401800+0000","last_unstale":"2023-08-25T04:03:59.410403+0000","last_undegraded":"2023-08-25T04:03:59.410403+0000","last_fullsized":"2023-08-25T04:03:59.410403+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:00:55.769641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.366089+0000","last_change":"2023-08-25T04:03:57.366089+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.366089+0000","last_undegraded":"2023-08-25T04:03:57.366089+0000","last_fullsized":"2023-08-25T04:03:57.366089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-25T04:03:57.362121+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:03:57.362121+0000","last_peered":"2023-08-25T04:03:57.362121+0000","last_clean":"2023-08-25T04:03:57.362121+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:03:57.362121+0000","last_undegraded":"2023-08-25T04:03:57.362121+0000","last_fullsized":"2023-08-25T04:03:57.362121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:13.470127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402389+0000","last_change":"2023-08-25T04:03:59.409061+0000","last_active":"2023-08-25T04:04:00.402389+0000","last_peered":"2023-08-25T04:04:00.402389+0000","last_clean":"2023-08-25T04:04:00.402389+0000","last_became_active":"2023-08-25T04:03:59.408631+0000","last_became_peered":"2023-08-25T04:03:59.408631+0000","last_unstale":"2023-08-25T04:04:00.402389+0000","last_undegraded":"2023-08-25T04:04:00.402389+0000","last_fullsized":"2023-08-25T04:04:00.402389+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:44.291484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401697+0000","last_change":"2023-08-25T04:03:58.388711+0000","last_active":"2023-08-25T04:04:00.401697+0000","last_peered":"2023-08-25T04:04:00.401697+0000","last_clean":"2023-08-25T04:04:00.401697+0000","last_became_active":"2023-08-25T04:03:58.388399+0000","last_became_peered":"2023-08-25T04:03:58.388399+0000","last_unstale":"2023-08-25T04:04:00.401697+0000","last_undegraded":"2023-08-25T04:04:00.401697+0000","last_fullsized":"2023-08-25T04:04:00.401697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:51.921153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.390607+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:03:59.390607+0000","last_peered":"2023-08-25T04:03:59.390607+0000","last_clean":"2023-08-25T04:03:59.390607+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:03:59.390607+0000","last_undegraded":"2023-08-25T04:03:59.390607+0000","last_fullsized":"2023-08-25T04:03:59.390607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:13:19.148757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982644+0000","last_change":"2023-08-25T04:03:58.389799+0000","last_active":"2023-08-25T04:04:00.982644+0000","last_peered":"2023-08-25T04:04:00.982644+0000","last_clean":"2023-08-25T04:04:00.982644+0000","last_became_active":"2023-08-25T04:03:58.389277+0000","last_became_peered":"2023-08-25T04:03:58.389277+0000","last_unstale":"2023-08-25T04:04:00.982644+0000","last_undegraded":"2023-08-25T04:04:00.982644+0000","last_fullsized":"2023-08-25T04:04:00.982644+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:03:31.104737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-25T04:03:57.367666+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:03:57.367666+0000","last_peered":"2023-08-25T04:03:57.367666+0000","last_clean":"2023-08-25T04:03:57.367666+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:03:57.367666+0000","last_undegraded":"2023-08-25T04:03:57.367666+0000","last_fullsized":"2023-08-25T04:03:57.367666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:58:43.499994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":741388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.68600000000000005}]},{"osd":1,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.624},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.76700000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.65400000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.745},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.67400000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":151020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.77600000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.70699999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.73999999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.497}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.84199999999999997}]},{"osd":7,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.82499999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":434176,"data_stored":177711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.754}]},{"osd":3,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.69799999999999995}]},{"osd":4,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.71599999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.85799999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.84799999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":434176,"data_stored":178203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.69299999999999995}]},{"osd":1,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.75900000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.78600000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.628},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.745}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":179245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53200000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.1359999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.0269999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.0700000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.90100000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":177669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.435}]},{"osd":4,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.54200000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.66200000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.57599999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":417792,"data_stored":171036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.308},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.433}]},{"osd":2,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.77400000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1011712,"data_stored":761348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.43099999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.749},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.79600000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.66000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:04:03.516 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:04:03.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.691+0000 7f1858da3640 1 Processor -- start 2023-08-25T04:04:03.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.691+0000 7f1858da3640 1 -- start start 2023-08-25T04:04:03.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.695+0000 7f1858da3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f18540aeb10 0x7f18540ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:03.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.695+0000 7f1858da3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f185406a010 0x7f18540cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:03.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.695+0000 7f1858da3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18540cf2b0 con 0x7f18540cee20 2023-08-25T04:04:03.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.695+0000 7f1858da3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18540d0380 con 0x7f18540aeb10 2023-08-25T04:04:03.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.695+0000 7f1858da3640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185406d590 con 0x7f185406a010 2023-08-25T04:04:03.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.695+0000 7f185259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f18540aeb10 0x7f18540ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:03.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.695+0000 7f185259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f18540aeb10 0x7f18540ce8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39496/0 (socket says 172.21.15.55:39496) 2023-08-25T04:04:03.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.695+0000 7f185259c640 1 -- 172.21.15.55:0/2040974454 learned_addr learned my addr 172.21.15.55:0/2040974454 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:03.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.695+0000 7f1849d9b640 1 --1- 172.21.15.55:0/2040974454 >> v1:172.21.15.55:6789/0 conn(0x7f18540cee20 0x7f1854069900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46530/0 (socket says 172.21.15.55:46530) 2023-08-25T04:04:03.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.695+0000 7f1852d9d640 1 --2- 172.21.15.55:0/2040974454 >> v2:172.21.15.110:3300/0 conn(0x7f185406a010 0x7f18540cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:03.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.695+0000 7f185259c640 1 -- 172.21.15.55:0/2040974454 >> v2:172.21.15.110:3300/0 conn(0x7f185406a010 msgr2=0x7f18540cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:03.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.695+0000 7f185259c640 1 --2- 172.21.15.55:0/2040974454 >> v2:172.21.15.110:3300/0 conn(0x7f185406a010 0x7f18540cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.695+0000 7f185259c640 1 -- 172.21.15.55:0/2040974454 >> v1:172.21.15.55:6789/0 conn(0x7f18540cee20 legacy=0x7f1854069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:03.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.695+0000 7f1851d9b640 1 -- 172.21.15.55:0/2040974454 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875206822 0 0) 0x7f18540cf2b0 con 0x7f18540cee20 2023-08-25T04:04:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.695+0000 7f185259c640 1 -- 172.21.15.55:0/2040974454 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185406c4f0 con 0x7f18540aeb10 2023-08-25T04:04:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.695+0000 7f1852d9d640 1 --2- 172.21.15.55:0/2040974454 >> v2:172.21.15.110:3300/0 conn(0x7f185406a010 0x7f18540cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:04:03.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.695+0000 7f185259c640 1 --2- 172.21.15.55:0/2040974454 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18540aeb10 0x7f18540ce8e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f185406d6d0 tx=0x7f184401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6439c348892368 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.695+0000 7f1851d9b640 1 -- 172.21.15.55:0/2040974454 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18440ab5f0 con 0x7f18540aeb10 2023-08-25T04:04:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1851d9b640 1 -- 172.21.15.55:0/2040974454 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18440ab750 con 0x7f18540aeb10 2023-08-25T04:04:03.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1851d9b640 1 -- 172.21.15.55:0/2040974454 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18440abae0 con 0x7f18540aeb10 2023-08-25T04:04:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1858da3640 1 -- 172.21.15.55:0/2040974454 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18540aeb10 msgr2=0x7f18540ce8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1858da3640 1 --2- 172.21.15.55:0/2040974454 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18540aeb10 0x7f18540ce8e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f185406d6d0 tx=0x7f184401c500 comp rx=0 tx=0).stop 2023-08-25T04:04:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1858da3640 1 -- 172.21.15.55:0/2040974454 shutdown_connections 2023-08-25T04:04:03.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1858da3640 1 --2- 172.21.15.55:0/2040974454 >> v2:172.21.15.110:3300/0 conn(0x7f185406a010 0x7f18540cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1858da3640 1 --2- 172.21.15.55:0/2040974454 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18540aeb10 0x7f18540ce8e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1858da3640 1 -- 172.21.15.55:0/2040974454 >> 172.21.15.55:0/2040974454 conn(0x7f18540cf530 msgr2=0x7f18540cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1858da3640 1 -- 172.21.15.55:0/2040974454 shutdown_connections 2023-08-25T04:04:03.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1858da3640 1 -- 172.21.15.55:0/2040974454 wait complete. 2023-08-25T04:04:03.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1858da3640 1 Processor -- start 2023-08-25T04:04:03.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1858da3640 1 -- start start 2023-08-25T04:04:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1858da3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f185406a010 0x7f185415ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1858da3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18540aeb10 0x7f18540c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:03.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1858da3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18540cee20 0x7f18540c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:03.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1858da3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185415c820 con 0x7f18540aeb10 2023-08-25T04:04:03.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1858da3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1854142430 con 0x7f185406a010 2023-08-25T04:04:03.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1858da3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185415bc10 con 0x7f18540cee20 2023-08-25T04:04:03.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1849d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18540aeb10 0x7f18540c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:03.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1849d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18540aeb10 0x7f18540c3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39500/0 (socket says 172.21.15.55:39500) 2023-08-25T04:04:03.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.699+0000 7f1849d9b640 1 -- 172.21.15.55:0/2996365427 learned_addr learned my addr 172.21.15.55:0/2996365427 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:03.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.703+0000 7f185259c640 1 --2- 172.21.15.55:0/2996365427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f185406a010 0x7f185415ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:03.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.703+0000 7f1852d9d640 1 --2- 172.21.15.55:0/2996365427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18540cee20 0x7f18540c35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:03.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.703+0000 7f1849d9b640 1 -- 172.21.15.55:0/2996365427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18540cee20 msgr2=0x7f18540c35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:03.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.703+0000 7f1849d9b640 1 --2- 172.21.15.55:0/2996365427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18540cee20 0x7f18540c35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.703+0000 7f1849d9b640 1 -- 172.21.15.55:0/2996365427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f185406a010 msgr2=0x7f185415ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:03.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.703+0000 7f1849d9b640 1 --2- 172.21.15.55:0/2996365427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f185406a010 0x7f185415ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.703+0000 7f1849d9b640 1 -- 172.21.15.55:0/2996365427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18440094d0 con 0x7f18540aeb10 2023-08-25T04:04:03.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.703+0000 7f185259c640 1 --2- 172.21.15.55:0/2996365427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f185406a010 0x7f185415ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:03.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.703+0000 7f1849d9b640 1 --2- 172.21.15.55:0/2996365427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18540aeb10 0x7f18540c3060 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f183c00c7c0 tx=0x7f183c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:03.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.703+0000 7f184b7fe640 1 -- 172.21.15.55:0/2996365427 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c00a640 con 0x7f18540aeb10 2023-08-25T04:04:03.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.703+0000 7f184b7fe640 1 -- 172.21.15.55:0/2996365427 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c00a7c0 con 0x7f18540aeb10 2023-08-25T04:04:03.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.703+0000 7f184b7fe640 1 -- 172.21.15.55:0/2996365427 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c00ab70 con 0x7f18540aeb10 2023-08-25T04:04:03.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.703+0000 7f1858da3640 1 -- 172.21.15.55:0/2996365427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185415bef0 con 0x7f18540aeb10 2023-08-25T04:04:03.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.703+0000 7f1858da3640 1 -- 172.21.15.55:0/2996365427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185415c4b0 con 0x7f18540aeb10 2023-08-25T04:04:03.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.703+0000 7f1858da3640 1 -- 172.21.15.55:0/2996365427 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185404dbe0 con 0x7f18540aeb10 2023-08-25T04:04:03.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.703+0000 7f184b7fe640 1 -- 172.21.15.55:0/2996365427 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f183c00acd0 con 0x7f18540aeb10 2023-08-25T04:04:03.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.707+0000 7f184b7fe640 1 --2- 172.21.15.55:0/2996365427 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1834065680 0x7f1834067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:03.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.707+0000 7f184b7fe640 1 -- 172.21.15.55:0/2996365427 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f183c082370 con 0x7f18540aeb10 2023-08-25T04:04:03.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.707+0000 7f185259c640 1 --2- 172.21.15.55:0/2996365427 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1834065680 0x7f1834067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:03.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.707+0000 7f185259c640 1 --2- 172.21.15.55:0/2996365427 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1834065680 0x7f1834067b40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f18440af000 tx=0x7f18440a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:03.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.707+0000 7f184b7fe640 1 -- 172.21.15.55:0/2996365427 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f183c04fed0 con 0x7f18540aeb10 2023-08-25T04:04:03.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.859+0000 7f1858da3640 1 -- 172.21.15.55:0/2996365427 --> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f185406d070 con 0x7f1834065680 2023-08-25T04:04:03.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.871+0000 7f184b7fe640 1 -- 172.21.15.55:0/2996365427 <== mgr.4102 v2:172.21.15.110:6832/413962747 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308186 (secure 0 0 0) 0x7f18440ab5b0 con 0x7f1834065680 2023-08-25T04:04:03.874 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:04:03.875 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:04:03.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.871+0000 7f1858da3640 1 -- 172.21.15.55:0/2996365427 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1834065680 msgr2=0x7f1834067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:03.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.871+0000 7f1858da3640 1 --2- 172.21.15.55:0/2996365427 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1834065680 0x7f1834067b40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f18440af000 tx=0x7f18440a7000 comp rx=0 tx=0).stop 2023-08-25T04:04:03.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.871+0000 7f1858da3640 1 -- 172.21.15.55:0/2996365427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18540aeb10 msgr2=0x7f18540c3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:03.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.871+0000 7f1858da3640 1 --2- 172.21.15.55:0/2996365427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18540aeb10 0x7f18540c3060 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f183c00c7c0 tx=0x7f183c00cc80 comp rx=0 tx=0).stop 2023-08-25T04:04:03.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.875+0000 7f1858da3640 1 -- 172.21.15.55:0/2996365427 shutdown_connections 2023-08-25T04:04:03.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.875+0000 7f1858da3640 1 --2- 172.21.15.55:0/2996365427 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f1834065680 0x7f1834067b40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.875+0000 7f1858da3640 1 --2- 172.21.15.55:0/2996365427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f18540cee20 0x7f18540c35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.875+0000 7f1858da3640 1 --2- 172.21.15.55:0/2996365427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18540aeb10 0x7f18540c3060 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.875+0000 7f1858da3640 1 --2- 172.21.15.55:0/2996365427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f185406a010 0x7f185415ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:03.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.875+0000 7f1858da3640 1 -- 172.21.15.55:0/2996365427 >> 172.21.15.55:0/2996365427 conn(0x7f18540cf530 msgr2=0x7f1854069900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:03.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.875+0000 7f1858da3640 1 -- 172.21.15.55:0/2996365427 shutdown_connections 2023-08-25T04:04:03.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:03.875+0000 7f1858da3640 1 -- 172.21.15.55:0/2996365427 wait complete. 2023-08-25T04:04:03.895 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-08-25T04:04:02.619051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249716,"kb_used_data":4412,"kb_used_omap":13,"kb_used_meta":245170,"kb_avail":754725004,"statfs":{"total":773094113280,"available":772838404096,"internally_reserved":0,"allocated":4517888,"data_stored":2537620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":251054168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.259284"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983113+0000","last_change":"2023-08-25T04:03:59.406557+0000","last_active":"2023-08-25T04:04:00.983113+0000","last_peered":"2023-08-25T04:04:00.983113+0000","last_clean":"2023-08-25T04:04:00.983113+0000","last_became_active":"2023-08-25T04:03:59.406203+0000","last_became_peered":"2023-08-25T04:03:59.406203+0000","last_unstale":"2023-08-25T04:04:00.983113+0000","last_undegraded":"2023-08-25T04:04:00.983113+0000","last_fullsized":"2023-08-25T04:04:00.983113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:24:08.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982922+0000","last_change":"2023-08-25T04:03:59.405679+0000","last_active":"2023-08-25T04:04:00.982922+0000","last_peered":"2023-08-25T04:04:00.982922+0000","last_clean":"2023-08-25T04:04:00.982922+0000","last_became_active":"2023-08-25T04:03:59.405378+0000","last_became_peered":"2023-08-25T04:03:59.405378+0000","last_unstale":"2023-08-25T04:04:00.982922+0000","last_undegraded":"2023-08-25T04:04:00.982922+0000","last_fullsized":"2023-08-25T04:04:00.982922+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:38.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.423571+0000","last_change":"2023-08-25T04:03:59.422508+0000","last_active":"2023-08-25T04:03:59.423571+0000","last_peered":"2023-08-25T04:03:59.423571+0000","last_clean":"2023-08-25T04:03:59.423571+0000","last_became_active":"2023-08-25T04:03:59.422191+0000","last_became_peered":"2023-08-25T04:03:59.422191+0000","last_unstale":"2023-08-25T04:03:59.423571+0000","last_undegraded":"2023-08-25T04:03:59.423571+0000","last_fullsized":"2023-08-25T04:03:59.423571+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:13:22.438164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401269+0000","last_change":"2023-08-25T04:03:59.400540+0000","last_active":"2023-08-25T04:04:00.401269+0000","last_peered":"2023-08-25T04:04:00.401269+0000","last_clean":"2023-08-25T04:04:00.401269+0000","last_became_active":"2023-08-25T04:03:59.399951+0000","last_became_peered":"2023-08-25T04:03:59.399951+0000","last_unstale":"2023-08-25T04:04:00.401269+0000","last_undegraded":"2023-08-25T04:04:00.401269+0000","last_fullsized":"2023-08-25T04:04:00.401269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:27:39.558644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400972+0000","last_change":"2023-08-25T04:03:59.401446+0000","last_active":"2023-08-25T04:04:00.400972+0000","last_peered":"2023-08-25T04:04:00.400972+0000","last_clean":"2023-08-25T04:04:00.400972+0000","last_became_active":"2023-08-25T04:03:59.401196+0000","last_became_peered":"2023-08-25T04:03:59.401196+0000","last_unstale":"2023-08-25T04:04:00.400972+0000","last_undegraded":"2023-08-25T04:04:00.400972+0000","last_fullsized":"2023-08-25T04:04:00.400972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:56:27.953788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410797+0000","last_change":"2023-08-25T04:03:59.409377+0000","last_active":"2023-08-25T04:03:59.410797+0000","last_peered":"2023-08-25T04:03:59.410797+0000","last_clean":"2023-08-25T04:03:59.410797+0000","last_became_active":"2023-08-25T04:03:59.403715+0000","last_became_peered":"2023-08-25T04:03:59.403715+0000","last_unstale":"2023-08-25T04:03:59.410797+0000","last_undegraded":"2023-08-25T04:03:59.410797+0000","last_fullsized":"2023-08-25T04:03:59.410797+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:14.765621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419238+0000","last_change":"2023-08-25T04:03:59.415058+0000","last_active":"2023-08-25T04:04:00.419238+0000","last_peered":"2023-08-25T04:04:00.419238+0000","last_clean":"2023-08-25T04:04:00.419238+0000","last_became_active":"2023-08-25T04:03:59.414723+0000","last_became_peered":"2023-08-25T04:03:59.414723+0000","last_unstale":"2023-08-25T04:04:00.419238+0000","last_undegraded":"2023-08-25T04:04:00.419238+0000","last_fullsized":"2023-08-25T04:04:00.419238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:34:37.814493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982607+0000","last_change":"2023-08-25T04:03:59.423164+0000","last_active":"2023-08-25T04:04:00.982607+0000","last_peered":"2023-08-25T04:04:00.982607+0000","last_clean":"2023-08-25T04:04:00.982607+0000","last_became_active":"2023-08-25T04:03:59.422861+0000","last_became_peered":"2023-08-25T04:03:59.422861+0000","last_unstale":"2023-08-25T04:04:00.982607+0000","last_undegraded":"2023-08-25T04:04:00.982607+0000","last_fullsized":"2023-08-25T04:04:00.982607+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:51:20.329496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.421133+0000","last_change":"2023-08-25T04:03:59.420041+0000","last_active":"2023-08-25T04:03:59.421133+0000","last_peered":"2023-08-25T04:03:59.421133+0000","last_clean":"2023-08-25T04:03:59.421133+0000","last_became_active":"2023-08-25T04:03:59.419589+0000","last_became_peered":"2023-08-25T04:03:59.419589+0000","last_unstale":"2023-08-25T04:03:59.421133+0000","last_undegraded":"2023-08-25T04:03:59.421133+0000","last_fullsized":"2023-08-25T04:03:59.421133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:05.539349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419590+0000","last_change":"2023-08-25T04:03:59.417854+0000","last_active":"2023-08-25T04:04:00.419590+0000","last_peered":"2023-08-25T04:04:00.419590+0000","last_clean":"2023-08-25T04:04:00.419590+0000","last_became_active":"2023-08-25T04:03:59.416366+0000","last_became_peered":"2023-08-25T04:03:59.416366+0000","last_unstale":"2023-08-25T04:04:00.419590+0000","last_undegraded":"2023-08-25T04:04:00.419590+0000","last_fullsized":"2023-08-25T04:04:00.419590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:20:23.025472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419740+0000","last_change":"2023-08-25T04:03:59.421543+0000","last_active":"2023-08-25T04:04:00.419740+0000","last_peered":"2023-08-25T04:04:00.419740+0000","last_clean":"2023-08-25T04:04:00.419740+0000","last_became_active":"2023-08-25T04:03:59.421202+0000","last_became_peered":"2023-08-25T04:03:59.421202+0000","last_unstale":"2023-08-25T04:04:00.419740+0000","last_undegraded":"2023-08-25T04:04:00.419740+0000","last_fullsized":"2023-08-25T04:04:00.419740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:08:57.095318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.416141+0000","last_change":"2023-08-25T04:03:59.414096+0000","last_active":"2023-08-25T04:03:59.416141+0000","last_peered":"2023-08-25T04:03:59.416141+0000","last_clean":"2023-08-25T04:03:59.416141+0000","last_became_active":"2023-08-25T04:03:59.413799+0000","last_became_peered":"2023-08-25T04:03:59.413799+0000","last_unstale":"2023-08-25T04:03:59.416141+0000","last_undegraded":"2023-08-25T04:03:59.416141+0000","last_fullsized":"2023-08-25T04:03:59.416141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:05:09.949970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419553+0000","last_change":"2023-08-25T04:03:59.418141+0000","last_active":"2023-08-25T04:04:00.419553+0000","last_peered":"2023-08-25T04:04:00.419553+0000","last_clean":"2023-08-25T04:04:00.419553+0000","last_became_active":"2023-08-25T04:03:59.417880+0000","last_became_peered":"2023-08-25T04:03:59.417880+0000","last_unstale":"2023-08-25T04:04:00.419553+0000","last_undegraded":"2023-08-25T04:04:00.419553+0000","last_fullsized":"2023-08-25T04:04:00.419553+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:55:54.338998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401652+0000","last_change":"2023-08-25T04:03:59.394965+0000","last_active":"2023-08-25T04:04:00.401652+0000","last_peered":"2023-08-25T04:04:00.401652+0000","last_clean":"2023-08-25T04:04:00.401652+0000","last_became_active":"2023-08-25T04:03:59.394626+0000","last_became_peered":"2023-08-25T04:03:59.394626+0000","last_unstale":"2023-08-25T04:04:00.401652+0000","last_undegraded":"2023-08-25T04:04:00.401652+0000","last_fullsized":"2023-08-25T04:04:00.401652+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:08:51.394168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419194+0000","last_change":"2023-08-25T04:03:59.413847+0000","last_active":"2023-08-25T04:04:00.419194+0000","last_peered":"2023-08-25T04:04:00.419194+0000","last_clean":"2023-08-25T04:04:00.419194+0000","last_became_active":"2023-08-25T04:03:59.413121+0000","last_became_peered":"2023-08-25T04:03:59.413121+0000","last_unstale":"2023-08-25T04:04:00.419194+0000","last_undegraded":"2023-08-25T04:04:00.419194+0000","last_fullsized":"2023-08-25T04:04:00.419194+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:20:45.210270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401121+0000","last_change":"2023-08-25T04:03:59.414035+0000","last_active":"2023-08-25T04:04:00.401121+0000","last_peered":"2023-08-25T04:04:00.401121+0000","last_clean":"2023-08-25T04:04:00.401121+0000","last_became_active":"2023-08-25T04:03:59.413749+0000","last_became_peered":"2023-08-25T04:03:59.413749+0000","last_unstale":"2023-08-25T04:04:00.401121+0000","last_undegraded":"2023-08-25T04:04:00.401121+0000","last_fullsized":"2023-08-25T04:04:00.401121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:07:11.827147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419383+0000","last_change":"2023-08-25T04:03:59.418049+0000","last_active":"2023-08-25T04:04:00.419383+0000","last_peered":"2023-08-25T04:04:00.419383+0000","last_clean":"2023-08-25T04:04:00.419383+0000","last_became_active":"2023-08-25T04:03:59.417803+0000","last_became_peered":"2023-08-25T04:03:59.417803+0000","last_unstale":"2023-08-25T04:04:00.419383+0000","last_undegraded":"2023-08-25T04:04:00.419383+0000","last_fullsized":"2023-08-25T04:04:00.419383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:30:53.684824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402633+0000","last_change":"2023-08-25T04:03:59.405308+0000","last_active":"2023-08-25T04:04:00.402633+0000","last_peered":"2023-08-25T04:04:00.402633+0000","last_clean":"2023-08-25T04:04:00.402633+0000","last_became_active":"2023-08-25T04:03:59.405020+0000","last_became_peered":"2023-08-25T04:03:59.405020+0000","last_unstale":"2023-08-25T04:04:00.402633+0000","last_undegraded":"2023-08-25T04:04:00.402633+0000","last_fullsized":"2023-08-25T04:04:00.402633+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:32.783190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400796+0000","last_change":"2023-08-25T04:03:59.400976+0000","last_active":"2023-08-25T04:04:00.400796+0000","last_peered":"2023-08-25T04:04:00.400796+0000","last_clean":"2023-08-25T04:04:00.400796+0000","last_became_active":"2023-08-25T04:03:59.400488+0000","last_became_peered":"2023-08-25T04:03:59.400488+0000","last_unstale":"2023-08-25T04:04:00.400796+0000","last_undegraded":"2023-08-25T04:04:00.400796+0000","last_fullsized":"2023-08-25T04:04:00.400796+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:42:10.702642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.419196+0000","last_change":"2023-08-25T04:03:59.417741+0000","last_active":"2023-08-25T04:03:59.419196+0000","last_peered":"2023-08-25T04:03:59.419196+0000","last_clean":"2023-08-25T04:03:59.419196+0000","last_became_active":"2023-08-25T04:03:59.417492+0000","last_became_peered":"2023-08-25T04:03:59.417492+0000","last_unstale":"2023-08-25T04:03:59.419196+0000","last_undegraded":"2023-08-25T04:03:59.419196+0000","last_fullsized":"2023-08-25T04:03:59.419196+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:31:49.886410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419678+0000","last_change":"2023-08-25T04:03:59.414961+0000","last_active":"2023-08-25T04:04:00.419678+0000","last_peered":"2023-08-25T04:04:00.419678+0000","last_clean":"2023-08-25T04:04:00.419678+0000","last_became_active":"2023-08-25T04:03:59.414610+0000","last_became_peered":"2023-08-25T04:03:59.414610+0000","last_unstale":"2023-08-25T04:04:00.419678+0000","last_undegraded":"2023-08-25T04:04:00.419678+0000","last_fullsized":"2023-08-25T04:04:00.419678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:08:51.394168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410368+0000","last_change":"2023-08-25T04:03:59.409108+0000","last_active":"2023-08-25T04:03:59.410368+0000","last_peered":"2023-08-25T04:03:59.410368+0000","last_clean":"2023-08-25T04:03:59.410368+0000","last_became_active":"2023-08-25T04:03:59.408844+0000","last_became_peered":"2023-08-25T04:03:59.408844+0000","last_unstale":"2023-08-25T04:03:59.410368+0000","last_undegraded":"2023-08-25T04:03:59.410368+0000","last_fullsized":"2023-08-25T04:03:59.410368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:31:52.823942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.366119+0000","last_change":"2023-08-25T04:03:57.366119+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.366119+0000","last_undegraded":"2023-08-25T04:03:57.366119+0000","last_fullsized":"2023-08-25T04:03:57.366119+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.423971+0000","last_change":"2023-08-25T04:03:59.422459+0000","last_active":"2023-08-25T04:03:59.423971+0000","last_peered":"2023-08-25T04:03:59.423971+0000","last_clean":"2023-08-25T04:03:59.423971+0000","last_became_active":"2023-08-25T04:03:59.422050+0000","last_became_peered":"2023-08-25T04:03:59.422050+0000","last_unstale":"2023-08-25T04:03:59.423971+0000","last_undegraded":"2023-08-25T04:03:59.423971+0000","last_fullsized":"2023-08-25T04:03:59.423971+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:17:35.817866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.400966+0000","last_change":"2023-08-25T04:03:58.386703+0000","last_active":"2023-08-25T04:03:59.400966+0000","last_peered":"2023-08-25T04:03:59.400966+0000","last_clean":"2023-08-25T04:03:59.400966+0000","last_became_active":"2023-08-25T04:03:58.386432+0000","last_became_peered":"2023-08-25T04:03:58.386432+0000","last_unstale":"2023-08-25T04:03:59.400966+0000","last_undegraded":"2023-08-25T04:03:59.400966+0000","last_fullsized":"2023-08-25T04:03:59.400966+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:49.791778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402854+0000","last_change":"2023-08-25T04:03:59.395833+0000","last_active":"2023-08-25T04:04:00.402854+0000","last_peered":"2023-08-25T04:04:00.402854+0000","last_clean":"2023-08-25T04:04:00.402854+0000","last_became_active":"2023-08-25T04:03:59.395329+0000","last_became_peered":"2023-08-25T04:03:59.395329+0000","last_unstale":"2023-08-25T04:04:00.402854+0000","last_undegraded":"2023-08-25T04:04:00.402854+0000","last_fullsized":"2023-08-25T04:04:00.402854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:02:30.264838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410774+0000","last_change":"2023-08-25T04:03:58.376492+0000","last_active":"2023-08-25T04:03:59.410774+0000","last_peered":"2023-08-25T04:03:59.410774+0000","last_clean":"2023-08-25T04:03:59.410774+0000","last_became_active":"2023-08-25T04:03:58.375494+0000","last_became_peered":"2023-08-25T04:03:58.375494+0000","last_unstale":"2023-08-25T04:03:59.410774+0000","last_undegraded":"2023-08-25T04:03:59.410774+0000","last_fullsized":"2023-08-25T04:03:59.410774+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:06:00.526490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983068+0000","last_change":"2023-08-25T04:03:59.405903+0000","last_active":"2023-08-25T04:04:00.983068+0000","last_peered":"2023-08-25T04:04:00.983068+0000","last_clean":"2023-08-25T04:04:00.983068+0000","last_became_active":"2023-08-25T04:03:59.405466+0000","last_became_peered":"2023-08-25T04:03:59.405466+0000","last_unstale":"2023-08-25T04:04:00.983068+0000","last_undegraded":"2023-08-25T04:04:00.983068+0000","last_fullsized":"2023-08-25T04:04:00.983068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:35:34.878076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402698+0000","last_change":"2023-08-25T04:03:58.388087+0000","last_active":"2023-08-25T04:04:00.402698+0000","last_peered":"2023-08-25T04:04:00.402698+0000","last_clean":"2023-08-25T04:04:00.402698+0000","last_became_active":"2023-08-25T04:03:58.387747+0000","last_became_peered":"2023-08-25T04:03:58.387747+0000","last_unstale":"2023-08-25T04:04:00.402698+0000","last_undegraded":"2023-08-25T04:04:00.402698+0000","last_fullsized":"2023-08-25T04:04:00.402698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:17.322151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.404892+0000","last_change":"2023-08-25T04:03:59.402378+0000","last_active":"2023-08-25T04:03:59.404892+0000","last_peered":"2023-08-25T04:03:59.404892+0000","last_clean":"2023-08-25T04:03:59.404892+0000","last_became_active":"2023-08-25T04:03:59.402007+0000","last_became_peered":"2023-08-25T04:03:59.402007+0000","last_unstale":"2023-08-25T04:03:59.404892+0000","last_undegraded":"2023-08-25T04:03:59.404892+0000","last_fullsized":"2023-08-25T04:03:59.404892+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:14:06.833085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419370+0000","last_change":"2023-08-25T04:03:58.385258+0000","last_active":"2023-08-25T04:04:00.419370+0000","last_peered":"2023-08-25T04:04:00.419370+0000","last_clean":"2023-08-25T04:04:00.419370+0000","last_became_active":"2023-08-25T04:03:58.384991+0000","last_became_peered":"2023-08-25T04:03:58.384991+0000","last_unstale":"2023-08-25T04:04:00.419370+0000","last_undegraded":"2023-08-25T04:04:00.419370+0000","last_fullsized":"2023-08-25T04:04:00.419370+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:07:30.250928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419383+0000","last_change":"2023-08-25T04:03:59.414026+0000","last_active":"2023-08-25T04:04:00.419383+0000","last_peered":"2023-08-25T04:04:00.419383+0000","last_clean":"2023-08-25T04:04:00.419383+0000","last_became_active":"2023-08-25T04:03:59.413496+0000","last_became_peered":"2023-08-25T04:03:59.413496+0000","last_unstale":"2023-08-25T04:04:00.419383+0000","last_undegraded":"2023-08-25T04:04:00.419383+0000","last_fullsized":"2023-08-25T04:04:00.419383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:47.335245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.362336+0000","last_change":"2023-08-25T04:03:57.362336+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.362336+0000","last_undegraded":"2023-08-25T04:03:57.362336+0000","last_fullsized":"2023-08-25T04:03:57.362336+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402516+0000","last_change":"2023-08-25T04:03:59.417484+0000","last_active":"2023-08-25T04:04:00.402516+0000","last_peered":"2023-08-25T04:04:00.402516+0000","last_clean":"2023-08-25T04:04:00.402516+0000","last_became_active":"2023-08-25T04:03:59.417130+0000","last_became_peered":"2023-08-25T04:03:59.417130+0000","last_unstale":"2023-08-25T04:04:00.402516+0000","last_undegraded":"2023-08-25T04:04:00.402516+0000","last_fullsized":"2023-08-25T04:04:00.402516+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:23:20.399499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.389371+0000","last_change":"2023-08-25T04:03:58.384345+0000","last_active":"2023-08-25T04:03:59.389371+0000","last_peered":"2023-08-25T04:03:59.389371+0000","last_clean":"2023-08-25T04:03:59.389371+0000","last_became_active":"2023-08-25T04:03:58.384067+0000","last_became_peered":"2023-08-25T04:03:58.384067+0000","last_unstale":"2023-08-25T04:03:59.389371+0000","last_undegraded":"2023-08-25T04:03:59.389371+0000","last_fullsized":"2023-08-25T04:03:59.389371+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:47:45.627944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982797+0000","last_change":"2023-08-25T04:03:59.406474+0000","last_active":"2023-08-25T04:04:00.982797+0000","last_peered":"2023-08-25T04:04:00.982797+0000","last_clean":"2023-08-25T04:04:00.982797+0000","last_became_active":"2023-08-25T04:03:59.406133+0000","last_became_peered":"2023-08-25T04:03:59.406133+0000","last_unstale":"2023-08-25T04:04:00.982797+0000","last_undegraded":"2023-08-25T04:04:00.982797+0000","last_fullsized":"2023-08-25T04:04:00.982797+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:04:17.226276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401672+0000","last_change":"2023-08-25T04:03:58.380770+0000","last_active":"2023-08-25T04:04:00.401672+0000","last_peered":"2023-08-25T04:04:00.401672+0000","last_clean":"2023-08-25T04:04:00.401672+0000","last_became_active":"2023-08-25T04:03:58.380444+0000","last_became_peered":"2023-08-25T04:03:58.380444+0000","last_unstale":"2023-08-25T04:04:00.401672+0000","last_undegraded":"2023-08-25T04:04:00.401672+0000","last_fullsized":"2023-08-25T04:04:00.401672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:08:56.083693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401151+0000","last_change":"2023-08-25T04:03:59.400753+0000","last_active":"2023-08-25T04:04:00.401151+0000","last_peered":"2023-08-25T04:04:00.401151+0000","last_clean":"2023-08-25T04:04:00.401151+0000","last_became_active":"2023-08-25T04:03:59.400263+0000","last_became_peered":"2023-08-25T04:03:59.400263+0000","last_unstale":"2023-08-25T04:04:00.401151+0000","last_undegraded":"2023-08-25T04:04:00.401151+0000","last_fullsized":"2023-08-25T04:04:00.401151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:40:08.451848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983139+0000","last_change":"2023-08-25T04:03:58.389611+0000","last_active":"2023-08-25T04:04:00.983139+0000","last_peered":"2023-08-25T04:04:00.983139+0000","last_clean":"2023-08-25T04:04:00.983139+0000","last_became_active":"2023-08-25T04:03:58.389289+0000","last_became_peered":"2023-08-25T04:03:58.389289+0000","last_unstale":"2023-08-25T04:04:00.983139+0000","last_undegraded":"2023-08-25T04:04:00.983139+0000","last_fullsized":"2023-08-25T04:04:00.983139+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:58.251174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419820+0000","last_change":"2023-08-25T04:03:58.390364+0000","last_active":"2023-08-25T04:04:00.419820+0000","last_peered":"2023-08-25T04:04:00.419820+0000","last_clean":"2023-08-25T04:04:00.419820+0000","last_became_active":"2023-08-25T04:03:58.390106+0000","last_became_peered":"2023-08-25T04:03:58.390106+0000","last_unstale":"2023-08-25T04:04:00.419820+0000","last_undegraded":"2023-08-25T04:04:00.419820+0000","last_fullsized":"2023-08-25T04:04:00.419820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:23:19.387874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.403467+0000","last_change":"2023-08-25T04:03:59.400496+0000","last_active":"2023-08-25T04:03:59.403467+0000","last_peered":"2023-08-25T04:03:59.403467+0000","last_clean":"2023-08-25T04:03:59.403467+0000","last_became_active":"2023-08-25T04:03:59.400190+0000","last_became_peered":"2023-08-25T04:03:59.400190+0000","last_unstale":"2023-08-25T04:03:59.403467+0000","last_undegraded":"2023-08-25T04:03:59.403467+0000","last_fullsized":"2023-08-25T04:03:59.403467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:58:14.431223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419790+0000","last_change":"2023-08-25T04:03:58.386413+0000","last_active":"2023-08-25T04:04:00.419790+0000","last_peered":"2023-08-25T04:04:00.419790+0000","last_clean":"2023-08-25T04:04:00.419790+0000","last_became_active":"2023-08-25T04:03:58.385665+0000","last_became_peered":"2023-08-25T04:03:58.385665+0000","last_unstale":"2023-08-25T04:04:00.419790+0000","last_undegraded":"2023-08-25T04:04:00.419790+0000","last_fullsized":"2023-08-25T04:04:00.419790+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:43.279859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402931+0000","last_change":"2023-08-25T04:03:59.410573+0000","last_active":"2023-08-25T04:04:00.402931+0000","last_peered":"2023-08-25T04:04:00.402931+0000","last_clean":"2023-08-25T04:04:00.402931+0000","last_became_active":"2023-08-25T04:03:59.410265+0000","last_became_peered":"2023-08-25T04:03:59.410265+0000","last_unstale":"2023-08-25T04:04:00.402931+0000","last_undegraded":"2023-08-25T04:04:00.402931+0000","last_fullsized":"2023-08-25T04:04:00.402931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:23:45.964870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983052+0000","last_change":"2023-08-25T04:03:58.387790+0000","last_active":"2023-08-25T04:04:00.983052+0000","last_peered":"2023-08-25T04:04:00.983052+0000","last_clean":"2023-08-25T04:04:00.983052+0000","last_became_active":"2023-08-25T04:03:58.387517+0000","last_became_peered":"2023-08-25T04:03:58.387517+0000","last_unstale":"2023-08-25T04:04:00.983052+0000","last_undegraded":"2023-08-25T04:04:00.983052+0000","last_fullsized":"2023-08-25T04:04:00.983052+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:20.409272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.420670+0000","last_change":"2023-08-25T04:03:59.418006+0000","last_active":"2023-08-25T04:03:59.420670+0000","last_peered":"2023-08-25T04:03:59.420670+0000","last_clean":"2023-08-25T04:03:59.420670+0000","last_became_active":"2023-08-25T04:03:59.417698+0000","last_became_peered":"2023-08-25T04:03:59.417698+0000","last_unstale":"2023-08-25T04:03:59.420670+0000","last_undegraded":"2023-08-25T04:03:59.420670+0000","last_fullsized":"2023-08-25T04:03:59.420670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:44.450303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982988+0000","last_change":"2023-08-25T04:03:58.389761+0000","last_active":"2023-08-25T04:04:00.982988+0000","last_peered":"2023-08-25T04:04:00.982988+0000","last_clean":"2023-08-25T04:04:00.982988+0000","last_became_active":"2023-08-25T04:03:58.388403+0000","last_became_peered":"2023-08-25T04:03:58.388403+0000","last_unstale":"2023-08-25T04:04:00.982988+0000","last_undegraded":"2023-08-25T04:04:00.982988+0000","last_fullsized":"2023-08-25T04:04:00.982988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:44:53.006803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982613+0000","last_change":"2023-08-25T04:03:59.406135+0000","last_active":"2023-08-25T04:04:00.982613+0000","last_peered":"2023-08-25T04:04:00.982613+0000","last_clean":"2023-08-25T04:04:00.982613+0000","last_became_active":"2023-08-25T04:03:59.405815+0000","last_became_peered":"2023-08-25T04:03:59.405815+0000","last_unstale":"2023-08-25T04:04:00.982613+0000","last_undegraded":"2023-08-25T04:04:00.982613+0000","last_fullsized":"2023-08-25T04:04:00.982613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:04:29.975483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.388438+0000","last_change":"2023-08-25T04:03:58.385409+0000","last_active":"2023-08-25T04:03:59.388438+0000","last_peered":"2023-08-25T04:03:59.388438+0000","last_clean":"2023-08-25T04:03:59.388438+0000","last_became_active":"2023-08-25T04:03:58.385114+0000","last_became_peered":"2023-08-25T04:03:58.385114+0000","last_unstale":"2023-08-25T04:03:59.388438+0000","last_undegraded":"2023-08-25T04:03:59.388438+0000","last_fullsized":"2023-08-25T04:03:59.388438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:11:51.858524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.366033+0000","last_change":"2023-08-25T04:03:57.366033+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.366033+0000","last_undegraded":"2023-08-25T04:03:57.366033+0000","last_fullsized":"2023-08-25T04:03:57.366033+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982718+0000","last_change":"2023-08-25T04:03:59.404648+0000","last_active":"2023-08-25T04:04:00.982718+0000","last_peered":"2023-08-25T04:04:00.982718+0000","last_clean":"2023-08-25T04:04:00.982718+0000","last_became_active":"2023-08-25T04:03:59.404224+0000","last_became_peered":"2023-08-25T04:03:59.404224+0000","last_unstale":"2023-08-25T04:04:00.982718+0000","last_undegraded":"2023-08-25T04:04:00.982718+0000","last_fullsized":"2023-08-25T04:04:00.982718+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:12:53.411199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.362302+0000","last_change":"2023-08-25T04:03:57.362302+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.362302+0000","last_undegraded":"2023-08-25T04:03:57.362302+0000","last_fullsized":"2023-08-25T04:03:57.362302+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982887+0000","last_change":"2023-08-25T04:03:59.402822+0000","last_active":"2023-08-25T04:04:00.982887+0000","last_peered":"2023-08-25T04:04:00.982887+0000","last_clean":"2023-08-25T04:04:00.982887+0000","last_became_active":"2023-08-25T04:03:59.402413+0000","last_became_peered":"2023-08-25T04:03:59.402413+0000","last_unstale":"2023-08-25T04:04:00.982887+0000","last_undegraded":"2023-08-25T04:04:00.982887+0000","last_fullsized":"2023-08-25T04:04:00.982887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:06.684416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419894+0000","last_change":"2023-08-25T04:03:58.389581+0000","last_active":"2023-08-25T04:04:00.419894+0000","last_peered":"2023-08-25T04:04:00.419894+0000","last_clean":"2023-08-25T04:04:00.419894+0000","last_became_active":"2023-08-25T04:03:58.388910+0000","last_became_peered":"2023-08-25T04:03:58.388910+0000","last_unstale":"2023-08-25T04:04:00.419894+0000","last_undegraded":"2023-08-25T04:04:00.419894+0000","last_fullsized":"2023-08-25T04:04:00.419894+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:31.771566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419619+0000","last_change":"2023-08-25T04:03:59.421526+0000","last_active":"2023-08-25T04:04:00.419619+0000","last_peered":"2023-08-25T04:04:00.419619+0000","last_clean":"2023-08-25T04:04:00.419619+0000","last_became_active":"2023-08-25T04:03:59.421169+0000","last_became_peered":"2023-08-25T04:03:59.421169+0000","last_unstale":"2023-08-25T04:04:00.419619+0000","last_undegraded":"2023-08-25T04:04:00.419619+0000","last_fullsized":"2023-08-25T04:04:00.419619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:56:53.601262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402892+0000","last_change":"2023-08-25T04:03:58.385498+0000","last_active":"2023-08-25T04:04:00.402892+0000","last_peered":"2023-08-25T04:04:00.402892+0000","last_clean":"2023-08-25T04:04:00.402892+0000","last_became_active":"2023-08-25T04:03:58.385215+0000","last_became_peered":"2023-08-25T04:03:58.385215+0000","last_unstale":"2023-08-25T04:04:00.402892+0000","last_undegraded":"2023-08-25T04:04:00.402892+0000","last_fullsized":"2023-08-25T04:04:00.402892+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:21.370228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402806+0000","last_change":"2023-08-25T04:03:59.410945+0000","last_active":"2023-08-25T04:04:00.402806+0000","last_peered":"2023-08-25T04:04:00.402806+0000","last_clean":"2023-08-25T04:04:00.402806+0000","last_became_active":"2023-08-25T04:03:59.410648+0000","last_became_peered":"2023-08-25T04:03:59.410648+0000","last_unstale":"2023-08-25T04:04:00.402806+0000","last_undegraded":"2023-08-25T04:04:00.402806+0000","last_fullsized":"2023-08-25T04:04:00.402806+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:39.793044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401201+0000","last_change":"2023-08-25T04:03:58.388839+0000","last_active":"2023-08-25T04:04:00.401201+0000","last_peered":"2023-08-25T04:04:00.401201+0000","last_clean":"2023-08-25T04:04:00.401201+0000","last_became_active":"2023-08-25T04:03:58.387292+0000","last_became_peered":"2023-08-25T04:03:58.387292+0000","last_unstale":"2023-08-25T04:04:00.401201+0000","last_undegraded":"2023-08-25T04:04:00.401201+0000","last_fullsized":"2023-08-25T04:04:00.401201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:17:38.350945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401251+0000","last_change":"2023-08-25T04:03:59.412433+0000","last_active":"2023-08-25T04:04:00.401251+0000","last_peered":"2023-08-25T04:04:00.401251+0000","last_clean":"2023-08-25T04:04:00.401251+0000","last_became_active":"2023-08-25T04:03:59.412124+0000","last_became_peered":"2023-08-25T04:03:59.412124+0000","last_unstale":"2023-08-25T04:04:00.401251+0000","last_undegraded":"2023-08-25T04:04:00.401251+0000","last_fullsized":"2023-08-25T04:04:00.401251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:39:52.127970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.394843+0000","last_change":"2023-08-25T04:03:58.375199+0000","last_active":"2023-08-25T04:03:59.394843+0000","last_peered":"2023-08-25T04:03:59.394843+0000","last_clean":"2023-08-25T04:03:59.394843+0000","last_became_active":"2023-08-25T04:03:58.374994+0000","last_became_peered":"2023-08-25T04:03:58.374994+0000","last_unstale":"2023-08-25T04:03:59.394843+0000","last_undegraded":"2023-08-25T04:03:59.394843+0000","last_fullsized":"2023-08-25T04:03:59.394843+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:10:41.181170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401003+0000","last_change":"2023-08-25T04:03:58.388343+0000","last_active":"2023-08-25T04:04:00.401003+0000","last_peered":"2023-08-25T04:04:00.401003+0000","last_clean":"2023-08-25T04:04:00.401003+0000","last_became_active":"2023-08-25T04:03:58.387241+0000","last_became_peered":"2023-08-25T04:03:58.387241+0000","last_unstale":"2023-08-25T04:04:00.401003+0000","last_undegraded":"2023-08-25T04:04:00.401003+0000","last_fullsized":"2023-08-25T04:04:00.401003+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:12:13.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.403432+0000","last_change":"2023-08-25T04:03:59.400416+0000","last_active":"2023-08-25T04:03:59.403432+0000","last_peered":"2023-08-25T04:03:59.403432+0000","last_clean":"2023-08-25T04:03:59.403432+0000","last_became_active":"2023-08-25T04:03:59.400094+0000","last_became_peered":"2023-08-25T04:03:59.400094+0000","last_unstale":"2023-08-25T04:03:59.403432+0000","last_undegraded":"2023-08-25T04:03:59.403432+0000","last_fullsized":"2023-08-25T04:03:59.403432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:38:49.403139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400938+0000","last_change":"2023-08-25T04:03:58.380520+0000","last_active":"2023-08-25T04:04:00.400938+0000","last_peered":"2023-08-25T04:04:00.400938+0000","last_clean":"2023-08-25T04:04:00.400938+0000","last_became_active":"2023-08-25T04:03:58.380215+0000","last_became_peered":"2023-08-25T04:03:58.380215+0000","last_unstale":"2023-08-25T04:04:00.400938+0000","last_undegraded":"2023-08-25T04:04:00.400938+0000","last_fullsized":"2023-08-25T04:04:00.400938+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:20:10.016494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419387+0000","last_change":"2023-08-25T04:03:59.418011+0000","last_active":"2023-08-25T04:04:00.419387+0000","last_peered":"2023-08-25T04:04:00.419387+0000","last_clean":"2023-08-25T04:04:00.419387+0000","last_became_active":"2023-08-25T04:03:59.416332+0000","last_became_peered":"2023-08-25T04:03:59.416332+0000","last_unstale":"2023-08-25T04:04:00.419387+0000","last_undegraded":"2023-08-25T04:04:00.419387+0000","last_fullsized":"2023-08-25T04:04:00.419387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:44:01.894126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.362928+0000","last_change":"2023-08-25T04:03:57.362928+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.362928+0000","last_undegraded":"2023-08-25T04:03:57.362928+0000","last_fullsized":"2023-08-25T04:03:57.362928+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982896+0000","last_change":"2023-08-25T04:03:59.406384+0000","last_active":"2023-08-25T04:04:00.982896+0000","last_peered":"2023-08-25T04:04:00.982896+0000","last_clean":"2023-08-25T04:04:00.982896+0000","last_became_active":"2023-08-25T04:03:59.405851+0000","last_became_peered":"2023-08-25T04:03:59.405851+0000","last_unstale":"2023-08-25T04:04:00.982896+0000","last_undegraded":"2023-08-25T04:04:00.982896+0000","last_fullsized":"2023-08-25T04:04:00.982896+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:40.592468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400806+0000","last_change":"2023-08-25T04:03:58.387617+0000","last_active":"2023-08-25T04:04:00.400806+0000","last_peered":"2023-08-25T04:04:00.400806+0000","last_clean":"2023-08-25T04:04:00.400806+0000","last_became_active":"2023-08-25T04:03:58.387256+0000","last_became_peered":"2023-08-25T04:03:58.387256+0000","last_unstale":"2023-08-25T04:04:00.400806+0000","last_undegraded":"2023-08-25T04:04:00.400806+0000","last_fullsized":"2023-08-25T04:04:00.400806+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:32:58.744009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419752+0000","last_change":"2023-08-25T04:03:59.418440+0000","last_active":"2023-08-25T04:04:00.419752+0000","last_peered":"2023-08-25T04:04:00.419752+0000","last_clean":"2023-08-25T04:04:00.419752+0000","last_became_active":"2023-08-25T04:03:59.418264+0000","last_became_peered":"2023-08-25T04:03:59.418264+0000","last_unstale":"2023-08-25T04:04:00.419752+0000","last_undegraded":"2023-08-25T04:04:00.419752+0000","last_fullsized":"2023-08-25T04:04:00.419752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:52.932778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.363019+0000","last_change":"2023-08-25T04:03:57.363019+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.363019+0000","last_undegraded":"2023-08-25T04:03:57.363019+0000","last_fullsized":"2023-08-25T04:03:57.363019+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":193,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-25T04:03:57.363664+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:03:57.363664+0000","last_peered":"2023-08-25T04:03:57.363664+0000","last_clean":"2023-08-25T04:03:57.363664+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:03:57.363664+0000","last_undegraded":"2023-08-25T04:03:57.363664+0000","last_fullsized":"2023-08-25T04:03:57.363664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:21:23.296682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419570+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:04:00.419570+0000","last_peered":"2023-08-25T04:04:00.419570+0000","last_clean":"2023-08-25T04:04:00.419570+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:04:00.419570+0000","last_undegraded":"2023-08-25T04:04:00.419570+0000","last_fullsized":"2023-08-25T04:04:00.419570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:45:20.387820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.420791+0000","last_change":"2023-08-25T04:03:59.419512+0000","last_active":"2023-08-25T04:03:59.420791+0000","last_peered":"2023-08-25T04:03:59.420791+0000","last_clean":"2023-08-25T04:03:59.420791+0000","last_became_active":"2023-08-25T04:03:59.419143+0000","last_became_peered":"2023-08-25T04:03:59.419143+0000","last_unstale":"2023-08-25T04:03:59.420791+0000","last_undegraded":"2023-08-25T04:03:59.420791+0000","last_fullsized":"2023-08-25T04:03:59.420791+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:08:08.686296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419946+0000","last_change":"2023-08-25T04:03:58.389811+0000","last_active":"2023-08-25T04:04:00.419946+0000","last_peered":"2023-08-25T04:04:00.419946+0000","last_clean":"2023-08-25T04:04:00.419946+0000","last_became_active":"2023-08-25T04:03:58.389274+0000","last_became_peered":"2023-08-25T04:03:58.389274+0000","last_unstale":"2023-08-25T04:04:00.419946+0000","last_undegraded":"2023-08-25T04:04:00.419946+0000","last_fullsized":"2023-08-25T04:04:00.419946+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:17.322151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-25T04:03:57.363537+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:03:57.363537+0000","last_peered":"2023-08-25T04:03:57.363537+0000","last_clean":"2023-08-25T04:03:57.363537+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:03:57.363537+0000","last_undegraded":"2023-08-25T04:03:57.363537+0000","last_fullsized":"2023-08-25T04:03:57.363537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:14:47.084096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401201+0000","last_change":"2023-08-25T04:03:58.386244+0000","last_active":"2023-08-25T04:04:00.401201+0000","last_peered":"2023-08-25T04:04:00.401201+0000","last_clean":"2023-08-25T04:04:00.401201+0000","last_became_active":"2023-08-25T04:03:58.385936+0000","last_became_peered":"2023-08-25T04:03:58.385936+0000","last_unstale":"2023-08-25T04:04:00.401201+0000","last_undegraded":"2023-08-25T04:04:00.401201+0000","last_fullsized":"2023-08-25T04:04:00.401201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:40:13.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400848+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:04:00.400848+0000","last_peered":"2023-08-25T04:04:00.400848+0000","last_clean":"2023-08-25T04:04:00.400848+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:04:00.400848+0000","last_undegraded":"2023-08-25T04:04:00.400848+0000","last_fullsized":"2023-08-25T04:04:00.400848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:49.545600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982987+0000","last_change":"2023-08-25T04:03:59.397271+0000","last_active":"2023-08-25T04:04:00.982987+0000","last_peered":"2023-08-25T04:04:00.982987+0000","last_clean":"2023-08-25T04:04:00.982987+0000","last_became_active":"2023-08-25T04:03:59.396948+0000","last_became_peered":"2023-08-25T04:03:59.396948+0000","last_unstale":"2023-08-25T04:04:00.982987+0000","last_undegraded":"2023-08-25T04:04:00.982987+0000","last_fullsized":"2023-08-25T04:04:00.982987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:11:44.609170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.390471+0000","last_change":"2023-08-25T04:03:58.382342+0000","last_active":"2023-08-25T04:03:59.390471+0000","last_peered":"2023-08-25T04:03:59.390471+0000","last_clean":"2023-08-25T04:03:59.390471+0000","last_became_active":"2023-08-25T04:03:58.382068+0000","last_became_peered":"2023-08-25T04:03:58.382068+0000","last_unstale":"2023-08-25T04:03:59.390471+0000","last_undegraded":"2023-08-25T04:03:59.390471+0000","last_fullsized":"2023-08-25T04:03:59.390471+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:18:16.177809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419423+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:04:00.419423+0000","last_peered":"2023-08-25T04:04:00.419423+0000","last_clean":"2023-08-25T04:04:00.419423+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:04:00.419423+0000","last_undegraded":"2023-08-25T04:04:00.419423+0000","last_fullsized":"2023-08-25T04:04:00.419423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:44:08.796401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410272+0000","last_change":"2023-08-25T04:03:59.408317+0000","last_active":"2023-08-25T04:03:59.410272+0000","last_peered":"2023-08-25T04:03:59.410272+0000","last_clean":"2023-08-25T04:03:59.410272+0000","last_became_active":"2023-08-25T04:03:59.408091+0000","last_became_peered":"2023-08-25T04:03:59.408091+0000","last_unstale":"2023-08-25T04:03:59.410272+0000","last_undegraded":"2023-08-25T04:03:59.410272+0000","last_fullsized":"2023-08-25T04:03:59.410272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:27:40.842846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.391080+0000","last_change":"2023-08-25T04:03:58.384133+0000","last_active":"2023-08-25T04:03:59.391080+0000","last_peered":"2023-08-25T04:03:59.391080+0000","last_clean":"2023-08-25T04:03:59.391080+0000","last_became_active":"2023-08-25T04:03:58.383821+0000","last_became_peered":"2023-08-25T04:03:58.383821+0000","last_unstale":"2023-08-25T04:03:59.391080+0000","last_undegraded":"2023-08-25T04:03:59.391080+0000","last_fullsized":"2023-08-25T04:03:59.391080+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:22:33.037133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.394919+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:03:59.394919+0000","last_peered":"2023-08-25T04:03:59.394919+0000","last_clean":"2023-08-25T04:03:59.394919+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:03:59.394919+0000","last_undegraded":"2023-08-25T04:03:59.394919+0000","last_fullsized":"2023-08-25T04:03:59.394919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:08:13.548315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410403+0000","last_change":"2023-08-25T04:03:59.402065+0000","last_active":"2023-08-25T04:03:59.410403+0000","last_peered":"2023-08-25T04:03:59.410403+0000","last_clean":"2023-08-25T04:03:59.410403+0000","last_became_active":"2023-08-25T04:03:59.401800+0000","last_became_peered":"2023-08-25T04:03:59.401800+0000","last_unstale":"2023-08-25T04:03:59.410403+0000","last_undegraded":"2023-08-25T04:03:59.410403+0000","last_fullsized":"2023-08-25T04:03:59.410403+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:00:55.769641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.366089+0000","last_change":"2023-08-25T04:03:57.366089+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.366089+0000","last_undegraded":"2023-08-25T04:03:57.366089+0000","last_fullsized":"2023-08-25T04:03:57.366089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-25T04:03:57.362121+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:03:57.362121+0000","last_peered":"2023-08-25T04:03:57.362121+0000","last_clean":"2023-08-25T04:03:57.362121+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:03:57.362121+0000","last_undegraded":"2023-08-25T04:03:57.362121+0000","last_fullsized":"2023-08-25T04:03:57.362121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:13.470127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402389+0000","last_change":"2023-08-25T04:03:59.409061+0000","last_active":"2023-08-25T04:04:00.402389+0000","last_peered":"2023-08-25T04:04:00.402389+0000","last_clean":"2023-08-25T04:04:00.402389+0000","last_became_active":"2023-08-25T04:03:59.408631+0000","last_became_peered":"2023-08-25T04:03:59.408631+0000","last_unstale":"2023-08-25T04:04:00.402389+0000","last_undegraded":"2023-08-25T04:04:00.402389+0000","last_fullsized":"2023-08-25T04:04:00.402389+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:44.291484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401697+0000","last_change":"2023-08-25T04:03:58.388711+0000","last_active":"2023-08-25T04:04:00.401697+0000","last_peered":"2023-08-25T04:04:00.401697+0000","last_clean":"2023-08-25T04:04:00.401697+0000","last_became_active":"2023-08-25T04:03:58.388399+0000","last_became_peered":"2023-08-25T04:03:58.388399+0000","last_unstale":"2023-08-25T04:04:00.401697+0000","last_undegraded":"2023-08-25T04:04:00.401697+0000","last_fullsized":"2023-08-25T04:04:00.401697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:51.921153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.390607+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:03:59.390607+0000","last_peered":"2023-08-25T04:03:59.390607+0000","last_clean":"2023-08-25T04:03:59.390607+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:03:59.390607+0000","last_undegraded":"2023-08-25T04:03:59.390607+0000","last_fullsized":"2023-08-25T04:03:59.390607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:13:19.148757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982644+0000","last_change":"2023-08-25T04:03:58.389799+0000","last_active":"2023-08-25T04:04:00.982644+0000","last_peered":"2023-08-25T04:04:00.982644+0000","last_clean":"2023-08-25T04:04:00.982644+0000","last_became_active":"2023-08-25T04:03:58.389277+0000","last_became_peered":"2023-08-25T04:03:58.389277+0000","last_unstale":"2023-08-25T04:04:00.982644+0000","last_undegraded":"2023-08-25T04:04:00.982644+0000","last_fullsized":"2023-08-25T04:04:00.982644+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:03:31.104737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-25T04:03:57.367666+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:03:57.367666+0000","last_peered":"2023-08-25T04:03:57.367666+0000","last_clean":"2023-08-25T04:03:57.367666+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:03:57.367666+0000","last_undegraded":"2023-08-25T04:03:57.367666+0000","last_fullsized":"2023-08-25T04:03:57.367666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:58:43.499994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":741388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.68600000000000005}]},{"osd":1,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.624},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.76700000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.65400000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.745},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.67400000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":151020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.77600000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.70699999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.73999999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.497}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.84199999999999997}]},{"osd":7,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.82499999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":434176,"data_stored":177711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.754}]},{"osd":3,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.69799999999999995}]},{"osd":4,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.71599999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.85799999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.84799999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":434176,"data_stored":178203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.69299999999999995}]},{"osd":1,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.75900000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.78600000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.628},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.745}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":179245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53200000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.1359999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.0269999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.0700000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.90100000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":177669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.435}]},{"osd":4,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.54200000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.66200000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.57599999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":417792,"data_stored":171036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.308},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.433}]},{"osd":2,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.77400000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1011712,"data_stored":761348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.43099999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.749},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.79600000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.66000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:04:03.902 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:04:04.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.083+0000 7fd9c4e19640 1 Processor -- start 2023-08-25T04:04:04.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.083+0000 7fd9c4e19640 1 -- start start 2023-08-25T04:04:04.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.083+0000 7fd9c4e19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c00cde20 0x7fd9c00ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:04.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.083+0000 7fd9c4e19640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd9c00cabf0 0x7fd9c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:04.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.083+0000 7fd9c4e19640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c006d2b0 con 0x7fd9c00b1220 2023-08-25T04:04:04.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.083+0000 7fd9c4e19640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c00c9490 con 0x7fd9c00cabf0 2023-08-25T04:04:04.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.083+0000 7fd9c4e19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c00cb1e0 con 0x7fd9c00cde20 2023-08-25T04:04:04.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.083+0000 7fd9be59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c00cde20 0x7fd9c00ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:04.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.083+0000 7fd9bed9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd9c00cabf0 0x7fd9c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:04.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.083+0000 7fd9be59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c00cde20 0x7fd9c00ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:36544/0 (socket says 172.21.15.55:36544) 2023-08-25T04:04:04.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.083+0000 7fd9be59c640 1 -- 172.21.15.55:0/2853654818 learned_addr learned my addr 172.21.15.55:0/2853654818 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:04.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.087+0000 7fd9be59c640 1 -- 172.21.15.55:0/2853654818 >> v2:172.21.15.110:3300/0 conn(0x7fd9c00cabf0 msgr2=0x7fd9c006c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:04.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.087+0000 7fd9be59c640 1 --2- 172.21.15.55:0/2853654818 >> v2:172.21.15.110:3300/0 conn(0x7fd9c00cabf0 0x7fd9c006c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.087+0000 7fd9be59c640 1 -- 172.21.15.55:0/2853654818 >> v1:172.21.15.110:6789/0 conn(0x7fd9c00b1220 legacy=0x7fd9c006be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:04.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.087+0000 7fd9be59c640 1 -- 172.21.15.55:0/2853654818 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c00cb480 con 0x7fd9c00cde20 2023-08-25T04:04:04.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.087+0000 7fd9bed9d640 1 --2- 172.21.15.55:0/2853654818 >> v2:172.21.15.110:3300/0 conn(0x7fd9c00cabf0 0x7fd9c006c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:04:04.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.087+0000 7fd9be59c640 1 --2- 172.21.15.55:0/2853654818 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c00cde20 0x7fd9c00ce200 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009870 tx=0x7fd9b001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8fd9216fb116eb7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:04.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.087+0000 7fd9bdd9b640 1 -- 172.21.15.55:0/2853654818 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00a9620 con 0x7fd9c00cde20 2023-08-25T04:04:04.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.087+0000 7fd9bdd9b640 1 -- 172.21.15.55:0/2853654818 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b00a9780 con 0x7fd9c00cde20 2023-08-25T04:04:04.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.087+0000 7fd9bdd9b640 1 -- 172.21.15.55:0/2853654818 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00a9b10 con 0x7fd9c00cde20 2023-08-25T04:04:04.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9c4e19640 1 -- 172.21.15.55:0/2853654818 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c00cde20 msgr2=0x7fd9c00ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:04.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9c4e19640 1 --2- 172.21.15.55:0/2853654818 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c00cde20 0x7fd9c00ce200 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0009870 tx=0x7fd9b001c540 comp rx=0 tx=0).stop 2023-08-25T04:04:04.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9c4e19640 1 -- 172.21.15.55:0/2853654818 shutdown_connections 2023-08-25T04:04:04.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9c4e19640 1 --2- 172.21.15.55:0/2853654818 >> v2:172.21.15.110:3300/0 conn(0x7fd9c00cabf0 0x7fd9c006c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9c4e19640 1 --2- 172.21.15.55:0/2853654818 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c00cde20 0x7fd9c00ce200 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9c4e19640 1 -- 172.21.15.55:0/2853654818 >> 172.21.15.55:0/2853654818 conn(0x7fd9c00b0700 msgr2=0x7fd9c00b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9c4e19640 1 -- 172.21.15.55:0/2853654818 shutdown_connections 2023-08-25T04:04:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9c4e19640 1 -- 172.21.15.55:0/2853654818 wait complete. 2023-08-25T04:04:04.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9c4e19640 1 Processor -- start 2023-08-25T04:04:04.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9c4e19640 1 -- start start 2023-08-25T04:04:04.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9c4e19640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c00b1220 0x7fd9c00ad920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:04.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9c4e19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c00cabf0 0x7fd9c00b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:04.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9c4e19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c00cde20 0x7fd9c015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:04.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9c4e19640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c00afff0 con 0x7fd9c00cabf0 2023-08-25T04:04:04.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9c4e19640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c009df50 con 0x7fd9c00b1220 2023-08-25T04:04:04.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9c4e19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c00afd10 con 0x7fd9c00cde20 2023-08-25T04:04:04.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9b7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c00cabf0 0x7fd9c00b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:04.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9b7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c00cabf0 0x7fd9c00b1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39516/0 (socket says 172.21.15.55:39516) 2023-08-25T04:04:04.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9b7fff640 1 -- 172.21.15.55:0/1309587927 learned_addr learned my addr 172.21.15.55:0/1309587927 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:04.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9be59c640 1 --2- 172.21.15.55:0/1309587927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c00b1220 0x7fd9c00ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:04.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.091+0000 7fd9bed9d640 1 --2- 172.21.15.55:0/1309587927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c00cde20 0x7fd9c015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:04.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.095+0000 7fd9b7fff640 1 -- 172.21.15.55:0/1309587927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c00cde20 msgr2=0x7fd9c015dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:04.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.095+0000 7fd9b7fff640 1 --2- 172.21.15.55:0/1309587927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c00cde20 0x7fd9c015dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.095+0000 7fd9b7fff640 1 -- 172.21.15.55:0/1309587927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c00b1220 msgr2=0x7fd9c00ad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:04.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.095+0000 7fd9b7fff640 1 --2- 172.21.15.55:0/1309587927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c00b1220 0x7fd9c00ad920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.095+0000 7fd9b7fff640 1 -- 172.21.15.55:0/1309587927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8009a70 con 0x7fd9c00cabf0 2023-08-25T04:04:04.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.095+0000 7fd9b7fff640 1 --2- 172.21.15.55:0/1309587927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c00cabf0 0x7fd9c00b1830 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800c390 tx=0x7fd9a800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:04.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.095+0000 7fd9b6ffd640 1 -- 172.21.15.55:0/1309587927 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a80052d0 con 0x7fd9c00cabf0 2023-08-25T04:04:04.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.095+0000 7fd9b6ffd640 1 -- 172.21.15.55:0/1309587927 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a8005430 con 0x7fd9c00cabf0 2023-08-25T04:04:04.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.095+0000 7fd9b6ffd640 1 -- 172.21.15.55:0/1309587927 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8003820 con 0x7fd9c00cabf0 2023-08-25T04:04:04.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.095+0000 7fd9c4e19640 1 -- 172.21.15.55:0/1309587927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b00094d0 con 0x7fd9c00cabf0 2023-08-25T04:04:04.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.095+0000 7fd9c4e19640 1 -- 172.21.15.55:0/1309587927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c009e4d0 con 0x7fd9c00cabf0 2023-08-25T04:04:04.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.095+0000 7fd9c4e19640 1 -- 172.21.15.55:0/1309587927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c004dbe0 con 0x7fd9c00cabf0 2023-08-25T04:04:04.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.095+0000 7fd9b6ffd640 1 -- 172.21.15.55:0/1309587927 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd9a8003980 con 0x7fd9c00cabf0 2023-08-25T04:04:04.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.095+0000 7fd9b6ffd640 1 --2- 172.21.15.55:0/1309587927 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd9a00656b0 0x7fd9a0067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:04.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.095+0000 7fd9b6ffd640 1 -- 172.21.15.55:0/1309587927 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd9a80821b0 con 0x7fd9c00cabf0 2023-08-25T04:04:04.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.095+0000 7fd9be59c640 1 --2- 172.21.15.55:0/1309587927 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd9a00656b0 0x7fd9a0067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:04.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.099+0000 7fd9be59c640 1 --2- 172.21.15.55:0/1309587927 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd9a00656b0 0x7fd9a0067b70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00ae000 tx=0x7fd9b00b4040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:04.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.099+0000 7fd9b6ffd640 1 -- 172.21.15.55:0/1309587927 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd9a804fd10 con 0x7fd9c00cabf0 2023-08-25T04:04:04.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.255+0000 7fd9c4e19640 1 -- 172.21.15.55:0/1309587927 --> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9c015cdb0 con 0x7fd9a00656b0 2023-08-25T04:04:04.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.263+0000 7fd9b6ffd640 1 -- 172.21.15.55:0/1309587927 <== mgr.4102 v2:172.21.15.110:6832/413962747 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308186 (secure 0 0 0) 0x7fd9b00a98f0 con 0x7fd9a00656b0 2023-08-25T04:04:04.267 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:04:04.268 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:04:04.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.267+0000 7fd9c4e19640 1 -- 172.21.15.55:0/1309587927 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd9a00656b0 msgr2=0x7fd9a0067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:04.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.267+0000 7fd9c4e19640 1 --2- 172.21.15.55:0/1309587927 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd9a00656b0 0x7fd9a0067b70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00ae000 tx=0x7fd9b00b4040 comp rx=0 tx=0).stop 2023-08-25T04:04:04.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.267+0000 7fd9c4e19640 1 -- 172.21.15.55:0/1309587927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c00cabf0 msgr2=0x7fd9c00b1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:04.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.267+0000 7fd9c4e19640 1 --2- 172.21.15.55:0/1309587927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c00cabf0 0x7fd9c00b1830 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800c390 tx=0x7fd9a800c790 comp rx=0 tx=0).stop 2023-08-25T04:04:04.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.267+0000 7fd9c4e19640 1 -- 172.21.15.55:0/1309587927 shutdown_connections 2023-08-25T04:04:04.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.267+0000 7fd9c4e19640 1 --2- 172.21.15.55:0/1309587927 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fd9a00656b0 0x7fd9a0067b70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.267+0000 7fd9c4e19640 1 --2- 172.21.15.55:0/1309587927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c00cde20 0x7fd9c015dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.267+0000 7fd9c4e19640 1 --2- 172.21.15.55:0/1309587927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c00cabf0 0x7fd9c00b1830 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.267+0000 7fd9c4e19640 1 --2- 172.21.15.55:0/1309587927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c00b1220 0x7fd9c00ad920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.267+0000 7fd9c4e19640 1 -- 172.21.15.55:0/1309587927 >> 172.21.15.55:0/1309587927 conn(0x7fd9c00b0700 msgr2=0x7fd9c0156460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:04.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.267+0000 7fd9c4e19640 1 -- 172.21.15.55:0/1309587927 shutdown_connections 2023-08-25T04:04:04.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.267+0000 7fd9c4e19640 1 -- 172.21.15.55:0/1309587927 wait complete. 2023-08-25T04:04:04.287 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2023-08-25T04:04:02.619051+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592196,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249716,"kb_used_data":4412,"kb_used_omap":13,"kb_used_meta":245170,"kb_avail":754725004,"statfs":{"total":773094113280,"available":772838404096,"internally_reserved":0,"allocated":4517888,"data_stored":2537620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":251054168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.259284"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983113+0000","last_change":"2023-08-25T04:03:59.406557+0000","last_active":"2023-08-25T04:04:00.983113+0000","last_peered":"2023-08-25T04:04:00.983113+0000","last_clean":"2023-08-25T04:04:00.983113+0000","last_became_active":"2023-08-25T04:03:59.406203+0000","last_became_peered":"2023-08-25T04:03:59.406203+0000","last_unstale":"2023-08-25T04:04:00.983113+0000","last_undegraded":"2023-08-25T04:04:00.983113+0000","last_fullsized":"2023-08-25T04:04:00.983113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:24:08.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982922+0000","last_change":"2023-08-25T04:03:59.405679+0000","last_active":"2023-08-25T04:04:00.982922+0000","last_peered":"2023-08-25T04:04:00.982922+0000","last_clean":"2023-08-25T04:04:00.982922+0000","last_became_active":"2023-08-25T04:03:59.405378+0000","last_became_peered":"2023-08-25T04:03:59.405378+0000","last_unstale":"2023-08-25T04:04:00.982922+0000","last_undegraded":"2023-08-25T04:04:00.982922+0000","last_fullsized":"2023-08-25T04:04:00.982922+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:38.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.423571+0000","last_change":"2023-08-25T04:03:59.422508+0000","last_active":"2023-08-25T04:03:59.423571+0000","last_peered":"2023-08-25T04:03:59.423571+0000","last_clean":"2023-08-25T04:03:59.423571+0000","last_became_active":"2023-08-25T04:03:59.422191+0000","last_became_peered":"2023-08-25T04:03:59.422191+0000","last_unstale":"2023-08-25T04:03:59.423571+0000","last_undegraded":"2023-08-25T04:03:59.423571+0000","last_fullsized":"2023-08-25T04:03:59.423571+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:13:22.438164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401269+0000","last_change":"2023-08-25T04:03:59.400540+0000","last_active":"2023-08-25T04:04:00.401269+0000","last_peered":"2023-08-25T04:04:00.401269+0000","last_clean":"2023-08-25T04:04:00.401269+0000","last_became_active":"2023-08-25T04:03:59.399951+0000","last_became_peered":"2023-08-25T04:03:59.399951+0000","last_unstale":"2023-08-25T04:04:00.401269+0000","last_undegraded":"2023-08-25T04:04:00.401269+0000","last_fullsized":"2023-08-25T04:04:00.401269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:27:39.558644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400972+0000","last_change":"2023-08-25T04:03:59.401446+0000","last_active":"2023-08-25T04:04:00.400972+0000","last_peered":"2023-08-25T04:04:00.400972+0000","last_clean":"2023-08-25T04:04:00.400972+0000","last_became_active":"2023-08-25T04:03:59.401196+0000","last_became_peered":"2023-08-25T04:03:59.401196+0000","last_unstale":"2023-08-25T04:04:00.400972+0000","last_undegraded":"2023-08-25T04:04:00.400972+0000","last_fullsized":"2023-08-25T04:04:00.400972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:56:27.953788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410797+0000","last_change":"2023-08-25T04:03:59.409377+0000","last_active":"2023-08-25T04:03:59.410797+0000","last_peered":"2023-08-25T04:03:59.410797+0000","last_clean":"2023-08-25T04:03:59.410797+0000","last_became_active":"2023-08-25T04:03:59.403715+0000","last_became_peered":"2023-08-25T04:03:59.403715+0000","last_unstale":"2023-08-25T04:03:59.410797+0000","last_undegraded":"2023-08-25T04:03:59.410797+0000","last_fullsized":"2023-08-25T04:03:59.410797+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:14.765621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419238+0000","last_change":"2023-08-25T04:03:59.415058+0000","last_active":"2023-08-25T04:04:00.419238+0000","last_peered":"2023-08-25T04:04:00.419238+0000","last_clean":"2023-08-25T04:04:00.419238+0000","last_became_active":"2023-08-25T04:03:59.414723+0000","last_became_peered":"2023-08-25T04:03:59.414723+0000","last_unstale":"2023-08-25T04:04:00.419238+0000","last_undegraded":"2023-08-25T04:04:00.419238+0000","last_fullsized":"2023-08-25T04:04:00.419238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:34:37.814493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982607+0000","last_change":"2023-08-25T04:03:59.423164+0000","last_active":"2023-08-25T04:04:00.982607+0000","last_peered":"2023-08-25T04:04:00.982607+0000","last_clean":"2023-08-25T04:04:00.982607+0000","last_became_active":"2023-08-25T04:03:59.422861+0000","last_became_peered":"2023-08-25T04:03:59.422861+0000","last_unstale":"2023-08-25T04:04:00.982607+0000","last_undegraded":"2023-08-25T04:04:00.982607+0000","last_fullsized":"2023-08-25T04:04:00.982607+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:51:20.329496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.421133+0000","last_change":"2023-08-25T04:03:59.420041+0000","last_active":"2023-08-25T04:03:59.421133+0000","last_peered":"2023-08-25T04:03:59.421133+0000","last_clean":"2023-08-25T04:03:59.421133+0000","last_became_active":"2023-08-25T04:03:59.419589+0000","last_became_peered":"2023-08-25T04:03:59.419589+0000","last_unstale":"2023-08-25T04:03:59.421133+0000","last_undegraded":"2023-08-25T04:03:59.421133+0000","last_fullsized":"2023-08-25T04:03:59.421133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:05.539349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419590+0000","last_change":"2023-08-25T04:03:59.417854+0000","last_active":"2023-08-25T04:04:00.419590+0000","last_peered":"2023-08-25T04:04:00.419590+0000","last_clean":"2023-08-25T04:04:00.419590+0000","last_became_active":"2023-08-25T04:03:59.416366+0000","last_became_peered":"2023-08-25T04:03:59.416366+0000","last_unstale":"2023-08-25T04:04:00.419590+0000","last_undegraded":"2023-08-25T04:04:00.419590+0000","last_fullsized":"2023-08-25T04:04:00.419590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:20:23.025472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419740+0000","last_change":"2023-08-25T04:03:59.421543+0000","last_active":"2023-08-25T04:04:00.419740+0000","last_peered":"2023-08-25T04:04:00.419740+0000","last_clean":"2023-08-25T04:04:00.419740+0000","last_became_active":"2023-08-25T04:03:59.421202+0000","last_became_peered":"2023-08-25T04:03:59.421202+0000","last_unstale":"2023-08-25T04:04:00.419740+0000","last_undegraded":"2023-08-25T04:04:00.419740+0000","last_fullsized":"2023-08-25T04:04:00.419740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:08:57.095318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.416141+0000","last_change":"2023-08-25T04:03:59.414096+0000","last_active":"2023-08-25T04:03:59.416141+0000","last_peered":"2023-08-25T04:03:59.416141+0000","last_clean":"2023-08-25T04:03:59.416141+0000","last_became_active":"2023-08-25T04:03:59.413799+0000","last_became_peered":"2023-08-25T04:03:59.413799+0000","last_unstale":"2023-08-25T04:03:59.416141+0000","last_undegraded":"2023-08-25T04:03:59.416141+0000","last_fullsized":"2023-08-25T04:03:59.416141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:05:09.949970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419553+0000","last_change":"2023-08-25T04:03:59.418141+0000","last_active":"2023-08-25T04:04:00.419553+0000","last_peered":"2023-08-25T04:04:00.419553+0000","last_clean":"2023-08-25T04:04:00.419553+0000","last_became_active":"2023-08-25T04:03:59.417880+0000","last_became_peered":"2023-08-25T04:03:59.417880+0000","last_unstale":"2023-08-25T04:04:00.419553+0000","last_undegraded":"2023-08-25T04:04:00.419553+0000","last_fullsized":"2023-08-25T04:04:00.419553+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:55:54.338998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401652+0000","last_change":"2023-08-25T04:03:59.394965+0000","last_active":"2023-08-25T04:04:00.401652+0000","last_peered":"2023-08-25T04:04:00.401652+0000","last_clean":"2023-08-25T04:04:00.401652+0000","last_became_active":"2023-08-25T04:03:59.394626+0000","last_became_peered":"2023-08-25T04:03:59.394626+0000","last_unstale":"2023-08-25T04:04:00.401652+0000","last_undegraded":"2023-08-25T04:04:00.401652+0000","last_fullsized":"2023-08-25T04:04:00.401652+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:08:51.394168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419194+0000","last_change":"2023-08-25T04:03:59.413847+0000","last_active":"2023-08-25T04:04:00.419194+0000","last_peered":"2023-08-25T04:04:00.419194+0000","last_clean":"2023-08-25T04:04:00.419194+0000","last_became_active":"2023-08-25T04:03:59.413121+0000","last_became_peered":"2023-08-25T04:03:59.413121+0000","last_unstale":"2023-08-25T04:04:00.419194+0000","last_undegraded":"2023-08-25T04:04:00.419194+0000","last_fullsized":"2023-08-25T04:04:00.419194+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:20:45.210270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401121+0000","last_change":"2023-08-25T04:03:59.414035+0000","last_active":"2023-08-25T04:04:00.401121+0000","last_peered":"2023-08-25T04:04:00.401121+0000","last_clean":"2023-08-25T04:04:00.401121+0000","last_became_active":"2023-08-25T04:03:59.413749+0000","last_became_peered":"2023-08-25T04:03:59.413749+0000","last_unstale":"2023-08-25T04:04:00.401121+0000","last_undegraded":"2023-08-25T04:04:00.401121+0000","last_fullsized":"2023-08-25T04:04:00.401121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:07:11.827147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419383+0000","last_change":"2023-08-25T04:03:59.418049+0000","last_active":"2023-08-25T04:04:00.419383+0000","last_peered":"2023-08-25T04:04:00.419383+0000","last_clean":"2023-08-25T04:04:00.419383+0000","last_became_active":"2023-08-25T04:03:59.417803+0000","last_became_peered":"2023-08-25T04:03:59.417803+0000","last_unstale":"2023-08-25T04:04:00.419383+0000","last_undegraded":"2023-08-25T04:04:00.419383+0000","last_fullsized":"2023-08-25T04:04:00.419383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:30:53.684824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402633+0000","last_change":"2023-08-25T04:03:59.405308+0000","last_active":"2023-08-25T04:04:00.402633+0000","last_peered":"2023-08-25T04:04:00.402633+0000","last_clean":"2023-08-25T04:04:00.402633+0000","last_became_active":"2023-08-25T04:03:59.405020+0000","last_became_peered":"2023-08-25T04:03:59.405020+0000","last_unstale":"2023-08-25T04:04:00.402633+0000","last_undegraded":"2023-08-25T04:04:00.402633+0000","last_fullsized":"2023-08-25T04:04:00.402633+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:32.783190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400796+0000","last_change":"2023-08-25T04:03:59.400976+0000","last_active":"2023-08-25T04:04:00.400796+0000","last_peered":"2023-08-25T04:04:00.400796+0000","last_clean":"2023-08-25T04:04:00.400796+0000","last_became_active":"2023-08-25T04:03:59.400488+0000","last_became_peered":"2023-08-25T04:03:59.400488+0000","last_unstale":"2023-08-25T04:04:00.400796+0000","last_undegraded":"2023-08-25T04:04:00.400796+0000","last_fullsized":"2023-08-25T04:04:00.400796+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:42:10.702642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.419196+0000","last_change":"2023-08-25T04:03:59.417741+0000","last_active":"2023-08-25T04:03:59.419196+0000","last_peered":"2023-08-25T04:03:59.419196+0000","last_clean":"2023-08-25T04:03:59.419196+0000","last_became_active":"2023-08-25T04:03:59.417492+0000","last_became_peered":"2023-08-25T04:03:59.417492+0000","last_unstale":"2023-08-25T04:03:59.419196+0000","last_undegraded":"2023-08-25T04:03:59.419196+0000","last_fullsized":"2023-08-25T04:03:59.419196+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:31:49.886410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419678+0000","last_change":"2023-08-25T04:03:59.414961+0000","last_active":"2023-08-25T04:04:00.419678+0000","last_peered":"2023-08-25T04:04:00.419678+0000","last_clean":"2023-08-25T04:04:00.419678+0000","last_became_active":"2023-08-25T04:03:59.414610+0000","last_became_peered":"2023-08-25T04:03:59.414610+0000","last_unstale":"2023-08-25T04:04:00.419678+0000","last_undegraded":"2023-08-25T04:04:00.419678+0000","last_fullsized":"2023-08-25T04:04:00.419678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:08:51.394168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410368+0000","last_change":"2023-08-25T04:03:59.409108+0000","last_active":"2023-08-25T04:03:59.410368+0000","last_peered":"2023-08-25T04:03:59.410368+0000","last_clean":"2023-08-25T04:03:59.410368+0000","last_became_active":"2023-08-25T04:03:59.408844+0000","last_became_peered":"2023-08-25T04:03:59.408844+0000","last_unstale":"2023-08-25T04:03:59.410368+0000","last_undegraded":"2023-08-25T04:03:59.410368+0000","last_fullsized":"2023-08-25T04:03:59.410368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:31:52.823942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.366119+0000","last_change":"2023-08-25T04:03:57.366119+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.366119+0000","last_undegraded":"2023-08-25T04:03:57.366119+0000","last_fullsized":"2023-08-25T04:03:57.366119+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.423971+0000","last_change":"2023-08-25T04:03:59.422459+0000","last_active":"2023-08-25T04:03:59.423971+0000","last_peered":"2023-08-25T04:03:59.423971+0000","last_clean":"2023-08-25T04:03:59.423971+0000","last_became_active":"2023-08-25T04:03:59.422050+0000","last_became_peered":"2023-08-25T04:03:59.422050+0000","last_unstale":"2023-08-25T04:03:59.423971+0000","last_undegraded":"2023-08-25T04:03:59.423971+0000","last_fullsized":"2023-08-25T04:03:59.423971+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:17:35.817866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.400966+0000","last_change":"2023-08-25T04:03:58.386703+0000","last_active":"2023-08-25T04:03:59.400966+0000","last_peered":"2023-08-25T04:03:59.400966+0000","last_clean":"2023-08-25T04:03:59.400966+0000","last_became_active":"2023-08-25T04:03:58.386432+0000","last_became_peered":"2023-08-25T04:03:58.386432+0000","last_unstale":"2023-08-25T04:03:59.400966+0000","last_undegraded":"2023-08-25T04:03:59.400966+0000","last_fullsized":"2023-08-25T04:03:59.400966+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:49.791778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402854+0000","last_change":"2023-08-25T04:03:59.395833+0000","last_active":"2023-08-25T04:04:00.402854+0000","last_peered":"2023-08-25T04:04:00.402854+0000","last_clean":"2023-08-25T04:04:00.402854+0000","last_became_active":"2023-08-25T04:03:59.395329+0000","last_became_peered":"2023-08-25T04:03:59.395329+0000","last_unstale":"2023-08-25T04:04:00.402854+0000","last_undegraded":"2023-08-25T04:04:00.402854+0000","last_fullsized":"2023-08-25T04:04:00.402854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:02:30.264838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410774+0000","last_change":"2023-08-25T04:03:58.376492+0000","last_active":"2023-08-25T04:03:59.410774+0000","last_peered":"2023-08-25T04:03:59.410774+0000","last_clean":"2023-08-25T04:03:59.410774+0000","last_became_active":"2023-08-25T04:03:58.375494+0000","last_became_peered":"2023-08-25T04:03:58.375494+0000","last_unstale":"2023-08-25T04:03:59.410774+0000","last_undegraded":"2023-08-25T04:03:59.410774+0000","last_fullsized":"2023-08-25T04:03:59.410774+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:06:00.526490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983068+0000","last_change":"2023-08-25T04:03:59.405903+0000","last_active":"2023-08-25T04:04:00.983068+0000","last_peered":"2023-08-25T04:04:00.983068+0000","last_clean":"2023-08-25T04:04:00.983068+0000","last_became_active":"2023-08-25T04:03:59.405466+0000","last_became_peered":"2023-08-25T04:03:59.405466+0000","last_unstale":"2023-08-25T04:04:00.983068+0000","last_undegraded":"2023-08-25T04:04:00.983068+0000","last_fullsized":"2023-08-25T04:04:00.983068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:35:34.878076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402698+0000","last_change":"2023-08-25T04:03:58.388087+0000","last_active":"2023-08-25T04:04:00.402698+0000","last_peered":"2023-08-25T04:04:00.402698+0000","last_clean":"2023-08-25T04:04:00.402698+0000","last_became_active":"2023-08-25T04:03:58.387747+0000","last_became_peered":"2023-08-25T04:03:58.387747+0000","last_unstale":"2023-08-25T04:04:00.402698+0000","last_undegraded":"2023-08-25T04:04:00.402698+0000","last_fullsized":"2023-08-25T04:04:00.402698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:17.322151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.404892+0000","last_change":"2023-08-25T04:03:59.402378+0000","last_active":"2023-08-25T04:03:59.404892+0000","last_peered":"2023-08-25T04:03:59.404892+0000","last_clean":"2023-08-25T04:03:59.404892+0000","last_became_active":"2023-08-25T04:03:59.402007+0000","last_became_peered":"2023-08-25T04:03:59.402007+0000","last_unstale":"2023-08-25T04:03:59.404892+0000","last_undegraded":"2023-08-25T04:03:59.404892+0000","last_fullsized":"2023-08-25T04:03:59.404892+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:14:06.833085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419370+0000","last_change":"2023-08-25T04:03:58.385258+0000","last_active":"2023-08-25T04:04:00.419370+0000","last_peered":"2023-08-25T04:04:00.419370+0000","last_clean":"2023-08-25T04:04:00.419370+0000","last_became_active":"2023-08-25T04:03:58.384991+0000","last_became_peered":"2023-08-25T04:03:58.384991+0000","last_unstale":"2023-08-25T04:04:00.419370+0000","last_undegraded":"2023-08-25T04:04:00.419370+0000","last_fullsized":"2023-08-25T04:04:00.419370+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:07:30.250928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419383+0000","last_change":"2023-08-25T04:03:59.414026+0000","last_active":"2023-08-25T04:04:00.419383+0000","last_peered":"2023-08-25T04:04:00.419383+0000","last_clean":"2023-08-25T04:04:00.419383+0000","last_became_active":"2023-08-25T04:03:59.413496+0000","last_became_peered":"2023-08-25T04:03:59.413496+0000","last_unstale":"2023-08-25T04:04:00.419383+0000","last_undegraded":"2023-08-25T04:04:00.419383+0000","last_fullsized":"2023-08-25T04:04:00.419383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:47.335245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.362336+0000","last_change":"2023-08-25T04:03:57.362336+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.362336+0000","last_undegraded":"2023-08-25T04:03:57.362336+0000","last_fullsized":"2023-08-25T04:03:57.362336+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402516+0000","last_change":"2023-08-25T04:03:59.417484+0000","last_active":"2023-08-25T04:04:00.402516+0000","last_peered":"2023-08-25T04:04:00.402516+0000","last_clean":"2023-08-25T04:04:00.402516+0000","last_became_active":"2023-08-25T04:03:59.417130+0000","last_became_peered":"2023-08-25T04:03:59.417130+0000","last_unstale":"2023-08-25T04:04:00.402516+0000","last_undegraded":"2023-08-25T04:04:00.402516+0000","last_fullsized":"2023-08-25T04:04:00.402516+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:23:20.399499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.389371+0000","last_change":"2023-08-25T04:03:58.384345+0000","last_active":"2023-08-25T04:03:59.389371+0000","last_peered":"2023-08-25T04:03:59.389371+0000","last_clean":"2023-08-25T04:03:59.389371+0000","last_became_active":"2023-08-25T04:03:58.384067+0000","last_became_peered":"2023-08-25T04:03:58.384067+0000","last_unstale":"2023-08-25T04:03:59.389371+0000","last_undegraded":"2023-08-25T04:03:59.389371+0000","last_fullsized":"2023-08-25T04:03:59.389371+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:47:45.627944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982797+0000","last_change":"2023-08-25T04:03:59.406474+0000","last_active":"2023-08-25T04:04:00.982797+0000","last_peered":"2023-08-25T04:04:00.982797+0000","last_clean":"2023-08-25T04:04:00.982797+0000","last_became_active":"2023-08-25T04:03:59.406133+0000","last_became_peered":"2023-08-25T04:03:59.406133+0000","last_unstale":"2023-08-25T04:04:00.982797+0000","last_undegraded":"2023-08-25T04:04:00.982797+0000","last_fullsized":"2023-08-25T04:04:00.982797+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:04:17.226276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401672+0000","last_change":"2023-08-25T04:03:58.380770+0000","last_active":"2023-08-25T04:04:00.401672+0000","last_peered":"2023-08-25T04:04:00.401672+0000","last_clean":"2023-08-25T04:04:00.401672+0000","last_became_active":"2023-08-25T04:03:58.380444+0000","last_became_peered":"2023-08-25T04:03:58.380444+0000","last_unstale":"2023-08-25T04:04:00.401672+0000","last_undegraded":"2023-08-25T04:04:00.401672+0000","last_fullsized":"2023-08-25T04:04:00.401672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:08:56.083693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401151+0000","last_change":"2023-08-25T04:03:59.400753+0000","last_active":"2023-08-25T04:04:00.401151+0000","last_peered":"2023-08-25T04:04:00.401151+0000","last_clean":"2023-08-25T04:04:00.401151+0000","last_became_active":"2023-08-25T04:03:59.400263+0000","last_became_peered":"2023-08-25T04:03:59.400263+0000","last_unstale":"2023-08-25T04:04:00.401151+0000","last_undegraded":"2023-08-25T04:04:00.401151+0000","last_fullsized":"2023-08-25T04:04:00.401151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:40:08.451848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983139+0000","last_change":"2023-08-25T04:03:58.389611+0000","last_active":"2023-08-25T04:04:00.983139+0000","last_peered":"2023-08-25T04:04:00.983139+0000","last_clean":"2023-08-25T04:04:00.983139+0000","last_became_active":"2023-08-25T04:03:58.389289+0000","last_became_peered":"2023-08-25T04:03:58.389289+0000","last_unstale":"2023-08-25T04:04:00.983139+0000","last_undegraded":"2023-08-25T04:04:00.983139+0000","last_fullsized":"2023-08-25T04:04:00.983139+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:58.251174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419820+0000","last_change":"2023-08-25T04:03:58.390364+0000","last_active":"2023-08-25T04:04:00.419820+0000","last_peered":"2023-08-25T04:04:00.419820+0000","last_clean":"2023-08-25T04:04:00.419820+0000","last_became_active":"2023-08-25T04:03:58.390106+0000","last_became_peered":"2023-08-25T04:03:58.390106+0000","last_unstale":"2023-08-25T04:04:00.419820+0000","last_undegraded":"2023-08-25T04:04:00.419820+0000","last_fullsized":"2023-08-25T04:04:00.419820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:23:19.387874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.403467+0000","last_change":"2023-08-25T04:03:59.400496+0000","last_active":"2023-08-25T04:03:59.403467+0000","last_peered":"2023-08-25T04:03:59.403467+0000","last_clean":"2023-08-25T04:03:59.403467+0000","last_became_active":"2023-08-25T04:03:59.400190+0000","last_became_peered":"2023-08-25T04:03:59.400190+0000","last_unstale":"2023-08-25T04:03:59.403467+0000","last_undegraded":"2023-08-25T04:03:59.403467+0000","last_fullsized":"2023-08-25T04:03:59.403467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:58:14.431223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419790+0000","last_change":"2023-08-25T04:03:58.386413+0000","last_active":"2023-08-25T04:04:00.419790+0000","last_peered":"2023-08-25T04:04:00.419790+0000","last_clean":"2023-08-25T04:04:00.419790+0000","last_became_active":"2023-08-25T04:03:58.385665+0000","last_became_peered":"2023-08-25T04:03:58.385665+0000","last_unstale":"2023-08-25T04:04:00.419790+0000","last_undegraded":"2023-08-25T04:04:00.419790+0000","last_fullsized":"2023-08-25T04:04:00.419790+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:43.279859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402931+0000","last_change":"2023-08-25T04:03:59.410573+0000","last_active":"2023-08-25T04:04:00.402931+0000","last_peered":"2023-08-25T04:04:00.402931+0000","last_clean":"2023-08-25T04:04:00.402931+0000","last_became_active":"2023-08-25T04:03:59.410265+0000","last_became_peered":"2023-08-25T04:03:59.410265+0000","last_unstale":"2023-08-25T04:04:00.402931+0000","last_undegraded":"2023-08-25T04:04:00.402931+0000","last_fullsized":"2023-08-25T04:04:00.402931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:23:45.964870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983052+0000","last_change":"2023-08-25T04:03:58.387790+0000","last_active":"2023-08-25T04:04:00.983052+0000","last_peered":"2023-08-25T04:04:00.983052+0000","last_clean":"2023-08-25T04:04:00.983052+0000","last_became_active":"2023-08-25T04:03:58.387517+0000","last_became_peered":"2023-08-25T04:03:58.387517+0000","last_unstale":"2023-08-25T04:04:00.983052+0000","last_undegraded":"2023-08-25T04:04:00.983052+0000","last_fullsized":"2023-08-25T04:04:00.983052+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:20.409272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.420670+0000","last_change":"2023-08-25T04:03:59.418006+0000","last_active":"2023-08-25T04:03:59.420670+0000","last_peered":"2023-08-25T04:03:59.420670+0000","last_clean":"2023-08-25T04:03:59.420670+0000","last_became_active":"2023-08-25T04:03:59.417698+0000","last_became_peered":"2023-08-25T04:03:59.417698+0000","last_unstale":"2023-08-25T04:03:59.420670+0000","last_undegraded":"2023-08-25T04:03:59.420670+0000","last_fullsized":"2023-08-25T04:03:59.420670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:44.450303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982988+0000","last_change":"2023-08-25T04:03:58.389761+0000","last_active":"2023-08-25T04:04:00.982988+0000","last_peered":"2023-08-25T04:04:00.982988+0000","last_clean":"2023-08-25T04:04:00.982988+0000","last_became_active":"2023-08-25T04:03:58.388403+0000","last_became_peered":"2023-08-25T04:03:58.388403+0000","last_unstale":"2023-08-25T04:04:00.982988+0000","last_undegraded":"2023-08-25T04:04:00.982988+0000","last_fullsized":"2023-08-25T04:04:00.982988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:44:53.006803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982613+0000","last_change":"2023-08-25T04:03:59.406135+0000","last_active":"2023-08-25T04:04:00.982613+0000","last_peered":"2023-08-25T04:04:00.982613+0000","last_clean":"2023-08-25T04:04:00.982613+0000","last_became_active":"2023-08-25T04:03:59.405815+0000","last_became_peered":"2023-08-25T04:03:59.405815+0000","last_unstale":"2023-08-25T04:04:00.982613+0000","last_undegraded":"2023-08-25T04:04:00.982613+0000","last_fullsized":"2023-08-25T04:04:00.982613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:04:29.975483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.388438+0000","last_change":"2023-08-25T04:03:58.385409+0000","last_active":"2023-08-25T04:03:59.388438+0000","last_peered":"2023-08-25T04:03:59.388438+0000","last_clean":"2023-08-25T04:03:59.388438+0000","last_became_active":"2023-08-25T04:03:58.385114+0000","last_became_peered":"2023-08-25T04:03:58.385114+0000","last_unstale":"2023-08-25T04:03:59.388438+0000","last_undegraded":"2023-08-25T04:03:59.388438+0000","last_fullsized":"2023-08-25T04:03:59.388438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:11:51.858524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.366033+0000","last_change":"2023-08-25T04:03:57.366033+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.366033+0000","last_undegraded":"2023-08-25T04:03:57.366033+0000","last_fullsized":"2023-08-25T04:03:57.366033+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982718+0000","last_change":"2023-08-25T04:03:59.404648+0000","last_active":"2023-08-25T04:04:00.982718+0000","last_peered":"2023-08-25T04:04:00.982718+0000","last_clean":"2023-08-25T04:04:00.982718+0000","last_became_active":"2023-08-25T04:03:59.404224+0000","last_became_peered":"2023-08-25T04:03:59.404224+0000","last_unstale":"2023-08-25T04:04:00.982718+0000","last_undegraded":"2023-08-25T04:04:00.982718+0000","last_fullsized":"2023-08-25T04:04:00.982718+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:12:53.411199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.362302+0000","last_change":"2023-08-25T04:03:57.362302+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.362302+0000","last_undegraded":"2023-08-25T04:03:57.362302+0000","last_fullsized":"2023-08-25T04:03:57.362302+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982887+0000","last_change":"2023-08-25T04:03:59.402822+0000","last_active":"2023-08-25T04:04:00.982887+0000","last_peered":"2023-08-25T04:04:00.982887+0000","last_clean":"2023-08-25T04:04:00.982887+0000","last_became_active":"2023-08-25T04:03:59.402413+0000","last_became_peered":"2023-08-25T04:03:59.402413+0000","last_unstale":"2023-08-25T04:04:00.982887+0000","last_undegraded":"2023-08-25T04:04:00.982887+0000","last_fullsized":"2023-08-25T04:04:00.982887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:06.684416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419894+0000","last_change":"2023-08-25T04:03:58.389581+0000","last_active":"2023-08-25T04:04:00.419894+0000","last_peered":"2023-08-25T04:04:00.419894+0000","last_clean":"2023-08-25T04:04:00.419894+0000","last_became_active":"2023-08-25T04:03:58.388910+0000","last_became_peered":"2023-08-25T04:03:58.388910+0000","last_unstale":"2023-08-25T04:04:00.419894+0000","last_undegraded":"2023-08-25T04:04:00.419894+0000","last_fullsized":"2023-08-25T04:04:00.419894+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:31.771566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419619+0000","last_change":"2023-08-25T04:03:59.421526+0000","last_active":"2023-08-25T04:04:00.419619+0000","last_peered":"2023-08-25T04:04:00.419619+0000","last_clean":"2023-08-25T04:04:00.419619+0000","last_became_active":"2023-08-25T04:03:59.421169+0000","last_became_peered":"2023-08-25T04:03:59.421169+0000","last_unstale":"2023-08-25T04:04:00.419619+0000","last_undegraded":"2023-08-25T04:04:00.419619+0000","last_fullsized":"2023-08-25T04:04:00.419619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:56:53.601262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402892+0000","last_change":"2023-08-25T04:03:58.385498+0000","last_active":"2023-08-25T04:04:00.402892+0000","last_peered":"2023-08-25T04:04:00.402892+0000","last_clean":"2023-08-25T04:04:00.402892+0000","last_became_active":"2023-08-25T04:03:58.385215+0000","last_became_peered":"2023-08-25T04:03:58.385215+0000","last_unstale":"2023-08-25T04:04:00.402892+0000","last_undegraded":"2023-08-25T04:04:00.402892+0000","last_fullsized":"2023-08-25T04:04:00.402892+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:21.370228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402806+0000","last_change":"2023-08-25T04:03:59.410945+0000","last_active":"2023-08-25T04:04:00.402806+0000","last_peered":"2023-08-25T04:04:00.402806+0000","last_clean":"2023-08-25T04:04:00.402806+0000","last_became_active":"2023-08-25T04:03:59.410648+0000","last_became_peered":"2023-08-25T04:03:59.410648+0000","last_unstale":"2023-08-25T04:04:00.402806+0000","last_undegraded":"2023-08-25T04:04:00.402806+0000","last_fullsized":"2023-08-25T04:04:00.402806+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:39.793044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401201+0000","last_change":"2023-08-25T04:03:58.388839+0000","last_active":"2023-08-25T04:04:00.401201+0000","last_peered":"2023-08-25T04:04:00.401201+0000","last_clean":"2023-08-25T04:04:00.401201+0000","last_became_active":"2023-08-25T04:03:58.387292+0000","last_became_peered":"2023-08-25T04:03:58.387292+0000","last_unstale":"2023-08-25T04:04:00.401201+0000","last_undegraded":"2023-08-25T04:04:00.401201+0000","last_fullsized":"2023-08-25T04:04:00.401201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:17:38.350945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401251+0000","last_change":"2023-08-25T04:03:59.412433+0000","last_active":"2023-08-25T04:04:00.401251+0000","last_peered":"2023-08-25T04:04:00.401251+0000","last_clean":"2023-08-25T04:04:00.401251+0000","last_became_active":"2023-08-25T04:03:59.412124+0000","last_became_peered":"2023-08-25T04:03:59.412124+0000","last_unstale":"2023-08-25T04:04:00.401251+0000","last_undegraded":"2023-08-25T04:04:00.401251+0000","last_fullsized":"2023-08-25T04:04:00.401251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:39:52.127970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.394843+0000","last_change":"2023-08-25T04:03:58.375199+0000","last_active":"2023-08-25T04:03:59.394843+0000","last_peered":"2023-08-25T04:03:59.394843+0000","last_clean":"2023-08-25T04:03:59.394843+0000","last_became_active":"2023-08-25T04:03:58.374994+0000","last_became_peered":"2023-08-25T04:03:58.374994+0000","last_unstale":"2023-08-25T04:03:59.394843+0000","last_undegraded":"2023-08-25T04:03:59.394843+0000","last_fullsized":"2023-08-25T04:03:59.394843+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:10:41.181170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401003+0000","last_change":"2023-08-25T04:03:58.388343+0000","last_active":"2023-08-25T04:04:00.401003+0000","last_peered":"2023-08-25T04:04:00.401003+0000","last_clean":"2023-08-25T04:04:00.401003+0000","last_became_active":"2023-08-25T04:03:58.387241+0000","last_became_peered":"2023-08-25T04:03:58.387241+0000","last_unstale":"2023-08-25T04:04:00.401003+0000","last_undegraded":"2023-08-25T04:04:00.401003+0000","last_fullsized":"2023-08-25T04:04:00.401003+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:12:13.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.403432+0000","last_change":"2023-08-25T04:03:59.400416+0000","last_active":"2023-08-25T04:03:59.403432+0000","last_peered":"2023-08-25T04:03:59.403432+0000","last_clean":"2023-08-25T04:03:59.403432+0000","last_became_active":"2023-08-25T04:03:59.400094+0000","last_became_peered":"2023-08-25T04:03:59.400094+0000","last_unstale":"2023-08-25T04:03:59.403432+0000","last_undegraded":"2023-08-25T04:03:59.403432+0000","last_fullsized":"2023-08-25T04:03:59.403432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:38:49.403139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400938+0000","last_change":"2023-08-25T04:03:58.380520+0000","last_active":"2023-08-25T04:04:00.400938+0000","last_peered":"2023-08-25T04:04:00.400938+0000","last_clean":"2023-08-25T04:04:00.400938+0000","last_became_active":"2023-08-25T04:03:58.380215+0000","last_became_peered":"2023-08-25T04:03:58.380215+0000","last_unstale":"2023-08-25T04:04:00.400938+0000","last_undegraded":"2023-08-25T04:04:00.400938+0000","last_fullsized":"2023-08-25T04:04:00.400938+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:20:10.016494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419387+0000","last_change":"2023-08-25T04:03:59.418011+0000","last_active":"2023-08-25T04:04:00.419387+0000","last_peered":"2023-08-25T04:04:00.419387+0000","last_clean":"2023-08-25T04:04:00.419387+0000","last_became_active":"2023-08-25T04:03:59.416332+0000","last_became_peered":"2023-08-25T04:03:59.416332+0000","last_unstale":"2023-08-25T04:04:00.419387+0000","last_undegraded":"2023-08-25T04:04:00.419387+0000","last_fullsized":"2023-08-25T04:04:00.419387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:44:01.894126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.362928+0000","last_change":"2023-08-25T04:03:57.362928+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.362928+0000","last_undegraded":"2023-08-25T04:03:57.362928+0000","last_fullsized":"2023-08-25T04:03:57.362928+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982896+0000","last_change":"2023-08-25T04:03:59.406384+0000","last_active":"2023-08-25T04:04:00.982896+0000","last_peered":"2023-08-25T04:04:00.982896+0000","last_clean":"2023-08-25T04:04:00.982896+0000","last_became_active":"2023-08-25T04:03:59.405851+0000","last_became_peered":"2023-08-25T04:03:59.405851+0000","last_unstale":"2023-08-25T04:04:00.982896+0000","last_undegraded":"2023-08-25T04:04:00.982896+0000","last_fullsized":"2023-08-25T04:04:00.982896+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:40.592468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400806+0000","last_change":"2023-08-25T04:03:58.387617+0000","last_active":"2023-08-25T04:04:00.400806+0000","last_peered":"2023-08-25T04:04:00.400806+0000","last_clean":"2023-08-25T04:04:00.400806+0000","last_became_active":"2023-08-25T04:03:58.387256+0000","last_became_peered":"2023-08-25T04:03:58.387256+0000","last_unstale":"2023-08-25T04:04:00.400806+0000","last_undegraded":"2023-08-25T04:04:00.400806+0000","last_fullsized":"2023-08-25T04:04:00.400806+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:32:58.744009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419752+0000","last_change":"2023-08-25T04:03:59.418440+0000","last_active":"2023-08-25T04:04:00.419752+0000","last_peered":"2023-08-25T04:04:00.419752+0000","last_clean":"2023-08-25T04:04:00.419752+0000","last_became_active":"2023-08-25T04:03:59.418264+0000","last_became_peered":"2023-08-25T04:03:59.418264+0000","last_unstale":"2023-08-25T04:04:00.419752+0000","last_undegraded":"2023-08-25T04:04:00.419752+0000","last_fullsized":"2023-08-25T04:04:00.419752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:52.932778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.363019+0000","last_change":"2023-08-25T04:03:57.363019+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.363019+0000","last_undegraded":"2023-08-25T04:03:57.363019+0000","last_fullsized":"2023-08-25T04:03:57.363019+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":193,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-25T04:03:57.363664+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:03:57.363664+0000","last_peered":"2023-08-25T04:03:57.363664+0000","last_clean":"2023-08-25T04:03:57.363664+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:03:57.363664+0000","last_undegraded":"2023-08-25T04:03:57.363664+0000","last_fullsized":"2023-08-25T04:03:57.363664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:21:23.296682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419570+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:04:00.419570+0000","last_peered":"2023-08-25T04:04:00.419570+0000","last_clean":"2023-08-25T04:04:00.419570+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:04:00.419570+0000","last_undegraded":"2023-08-25T04:04:00.419570+0000","last_fullsized":"2023-08-25T04:04:00.419570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:45:20.387820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.420791+0000","last_change":"2023-08-25T04:03:59.419512+0000","last_active":"2023-08-25T04:03:59.420791+0000","last_peered":"2023-08-25T04:03:59.420791+0000","last_clean":"2023-08-25T04:03:59.420791+0000","last_became_active":"2023-08-25T04:03:59.419143+0000","last_became_peered":"2023-08-25T04:03:59.419143+0000","last_unstale":"2023-08-25T04:03:59.420791+0000","last_undegraded":"2023-08-25T04:03:59.420791+0000","last_fullsized":"2023-08-25T04:03:59.420791+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:08:08.686296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419946+0000","last_change":"2023-08-25T04:03:58.389811+0000","last_active":"2023-08-25T04:04:00.419946+0000","last_peered":"2023-08-25T04:04:00.419946+0000","last_clean":"2023-08-25T04:04:00.419946+0000","last_became_active":"2023-08-25T04:03:58.389274+0000","last_became_peered":"2023-08-25T04:03:58.389274+0000","last_unstale":"2023-08-25T04:04:00.419946+0000","last_undegraded":"2023-08-25T04:04:00.419946+0000","last_fullsized":"2023-08-25T04:04:00.419946+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:17.322151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-25T04:03:57.363537+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:03:57.363537+0000","last_peered":"2023-08-25T04:03:57.363537+0000","last_clean":"2023-08-25T04:03:57.363537+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:03:57.363537+0000","last_undegraded":"2023-08-25T04:03:57.363537+0000","last_fullsized":"2023-08-25T04:03:57.363537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:14:47.084096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401201+0000","last_change":"2023-08-25T04:03:58.386244+0000","last_active":"2023-08-25T04:04:00.401201+0000","last_peered":"2023-08-25T04:04:00.401201+0000","last_clean":"2023-08-25T04:04:00.401201+0000","last_became_active":"2023-08-25T04:03:58.385936+0000","last_became_peered":"2023-08-25T04:03:58.385936+0000","last_unstale":"2023-08-25T04:04:00.401201+0000","last_undegraded":"2023-08-25T04:04:00.401201+0000","last_fullsized":"2023-08-25T04:04:00.401201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:40:13.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400848+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:04:00.400848+0000","last_peered":"2023-08-25T04:04:00.400848+0000","last_clean":"2023-08-25T04:04:00.400848+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:04:00.400848+0000","last_undegraded":"2023-08-25T04:04:00.400848+0000","last_fullsized":"2023-08-25T04:04:00.400848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:49.545600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982987+0000","last_change":"2023-08-25T04:03:59.397271+0000","last_active":"2023-08-25T04:04:00.982987+0000","last_peered":"2023-08-25T04:04:00.982987+0000","last_clean":"2023-08-25T04:04:00.982987+0000","last_became_active":"2023-08-25T04:03:59.396948+0000","last_became_peered":"2023-08-25T04:03:59.396948+0000","last_unstale":"2023-08-25T04:04:00.982987+0000","last_undegraded":"2023-08-25T04:04:00.982987+0000","last_fullsized":"2023-08-25T04:04:00.982987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:11:44.609170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.390471+0000","last_change":"2023-08-25T04:03:58.382342+0000","last_active":"2023-08-25T04:03:59.390471+0000","last_peered":"2023-08-25T04:03:59.390471+0000","last_clean":"2023-08-25T04:03:59.390471+0000","last_became_active":"2023-08-25T04:03:58.382068+0000","last_became_peered":"2023-08-25T04:03:58.382068+0000","last_unstale":"2023-08-25T04:03:59.390471+0000","last_undegraded":"2023-08-25T04:03:59.390471+0000","last_fullsized":"2023-08-25T04:03:59.390471+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:18:16.177809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419423+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:04:00.419423+0000","last_peered":"2023-08-25T04:04:00.419423+0000","last_clean":"2023-08-25T04:04:00.419423+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:04:00.419423+0000","last_undegraded":"2023-08-25T04:04:00.419423+0000","last_fullsized":"2023-08-25T04:04:00.419423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:44:08.796401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410272+0000","last_change":"2023-08-25T04:03:59.408317+0000","last_active":"2023-08-25T04:03:59.410272+0000","last_peered":"2023-08-25T04:03:59.410272+0000","last_clean":"2023-08-25T04:03:59.410272+0000","last_became_active":"2023-08-25T04:03:59.408091+0000","last_became_peered":"2023-08-25T04:03:59.408091+0000","last_unstale":"2023-08-25T04:03:59.410272+0000","last_undegraded":"2023-08-25T04:03:59.410272+0000","last_fullsized":"2023-08-25T04:03:59.410272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:27:40.842846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.391080+0000","last_change":"2023-08-25T04:03:58.384133+0000","last_active":"2023-08-25T04:03:59.391080+0000","last_peered":"2023-08-25T04:03:59.391080+0000","last_clean":"2023-08-25T04:03:59.391080+0000","last_became_active":"2023-08-25T04:03:58.383821+0000","last_became_peered":"2023-08-25T04:03:58.383821+0000","last_unstale":"2023-08-25T04:03:59.391080+0000","last_undegraded":"2023-08-25T04:03:59.391080+0000","last_fullsized":"2023-08-25T04:03:59.391080+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:22:33.037133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.394919+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:03:59.394919+0000","last_peered":"2023-08-25T04:03:59.394919+0000","last_clean":"2023-08-25T04:03:59.394919+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:03:59.394919+0000","last_undegraded":"2023-08-25T04:03:59.394919+0000","last_fullsized":"2023-08-25T04:03:59.394919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:08:13.548315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410403+0000","last_change":"2023-08-25T04:03:59.402065+0000","last_active":"2023-08-25T04:03:59.410403+0000","last_peered":"2023-08-25T04:03:59.410403+0000","last_clean":"2023-08-25T04:03:59.410403+0000","last_became_active":"2023-08-25T04:03:59.401800+0000","last_became_peered":"2023-08-25T04:03:59.401800+0000","last_unstale":"2023-08-25T04:03:59.410403+0000","last_undegraded":"2023-08-25T04:03:59.410403+0000","last_fullsized":"2023-08-25T04:03:59.410403+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:00:55.769641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-08-25T04:03:57.366089+0000","last_change":"2023-08-25T04:03:57.366089+0000","last_active":"2023-08-25T04:03:57.346906+0000","last_peered":"2023-08-25T04:03:57.346906+0000","last_clean":"2023-08-25T04:03:57.346906+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:57.366089+0000","last_undegraded":"2023-08-25T04:03:57.366089+0000","last_fullsized":"2023-08-25T04:03:57.366089+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-25T04:03:57.362121+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:03:57.362121+0000","last_peered":"2023-08-25T04:03:57.362121+0000","last_clean":"2023-08-25T04:03:57.362121+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:03:57.362121+0000","last_undegraded":"2023-08-25T04:03:57.362121+0000","last_fullsized":"2023-08-25T04:03:57.362121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:13.470127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402389+0000","last_change":"2023-08-25T04:03:59.409061+0000","last_active":"2023-08-25T04:04:00.402389+0000","last_peered":"2023-08-25T04:04:00.402389+0000","last_clean":"2023-08-25T04:04:00.402389+0000","last_became_active":"2023-08-25T04:03:59.408631+0000","last_became_peered":"2023-08-25T04:03:59.408631+0000","last_unstale":"2023-08-25T04:04:00.402389+0000","last_undegraded":"2023-08-25T04:04:00.402389+0000","last_fullsized":"2023-08-25T04:04:00.402389+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:44.291484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401697+0000","last_change":"2023-08-25T04:03:58.388711+0000","last_active":"2023-08-25T04:04:00.401697+0000","last_peered":"2023-08-25T04:04:00.401697+0000","last_clean":"2023-08-25T04:04:00.401697+0000","last_became_active":"2023-08-25T04:03:58.388399+0000","last_became_peered":"2023-08-25T04:03:58.388399+0000","last_unstale":"2023-08-25T04:04:00.401697+0000","last_undegraded":"2023-08-25T04:04:00.401697+0000","last_fullsized":"2023-08-25T04:04:00.401697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:51.921153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.390607+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:03:59.390607+0000","last_peered":"2023-08-25T04:03:59.390607+0000","last_clean":"2023-08-25T04:03:59.390607+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:03:59.390607+0000","last_undegraded":"2023-08-25T04:03:59.390607+0000","last_fullsized":"2023-08-25T04:03:59.390607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:13:19.148757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:03:58.358530+0000","last_change":"2023-08-25T04:03:58.358530+0000","last_active":"2023-08-25T04:03:58.358530+0000","last_peered":"2023-08-25T04:03:58.358530+0000","last_clean":"2023-08-25T04:03:58.358530+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:03:58.358530+0000","last_undegraded":"2023-08-25T04:03:58.358530+0000","last_fullsized":"2023-08-25T04:03:58.358530+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982644+0000","last_change":"2023-08-25T04:03:58.389799+0000","last_active":"2023-08-25T04:04:00.982644+0000","last_peered":"2023-08-25T04:04:00.982644+0000","last_clean":"2023-08-25T04:04:00.982644+0000","last_became_active":"2023-08-25T04:03:58.389277+0000","last_became_peered":"2023-08-25T04:03:58.389277+0000","last_unstale":"2023-08-25T04:04:00.982644+0000","last_undegraded":"2023-08-25T04:04:00.982644+0000","last_fullsized":"2023-08-25T04:04:00.982644+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:03:31.104737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-08-25T04:03:57.367666+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:03:57.367666+0000","last_peered":"2023-08-25T04:03:57.367666+0000","last_clean":"2023-08-25T04:03:57.367666+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:03:57.367666+0000","last_undegraded":"2023-08-25T04:03:57.367666+0000","last_fullsized":"2023-08-25T04:03:57.367666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:58:43.499994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1828,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":741388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.68600000000000005}]},{"osd":1,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.624},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.76700000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.65400000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.745},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.67400000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509458,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":151020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.77600000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.70699999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.73999999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.497}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.84199999999999997}]},{"osd":7,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.82499999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":434176,"data_stored":177711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.754}]},{"osd":3,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.69799999999999995}]},{"osd":4,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.71599999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.85799999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.84799999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":434176,"data_stored":178203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.69299999999999995}]},{"osd":1,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.75900000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.78600000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.628},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.745}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":179245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53200000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.1359999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.0269999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.0700000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.90100000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":177669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.435}]},{"osd":4,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.54200000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.66200000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.57599999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":417792,"data_stored":171036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.308},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.433}]},{"osd":2,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.77400000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1011712,"data_stored":761348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.43099999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.749},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.79600000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.66000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:04:04.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-08-25T04:04:04.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-25T04:03:58.358530+0000', 'last_change': '2023-08-25T04:03:58.358530+0000', 'last_active': '2023-08-25T04:03:58.358530+0000', 'last_peered': '2023-08-25T04:03:58.358530+0000', 'last_clean': '2023-08-25T04:03:58.358530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:58.358530+0000', 'last_undegraded': '2023-08-25T04:03:58.358530+0000', 'last_fullsized': '2023-08-25T04:03:58.358530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-25T04:04:04.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-08-25T04:04:04.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-25T04:03:58.358530+0000', 'last_change': '2023-08-25T04:03:58.358530+0000', 'last_active': '2023-08-25T04:03:58.358530+0000', 'last_peered': '2023-08-25T04:03:58.358530+0000', 'last_clean': '2023-08-25T04:03:58.358530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:58.358530+0000', 'last_undegraded': '2023-08-25T04:03:58.358530+0000', 'last_fullsized': '2023-08-25T04:03:58.358530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-25T04:04:04.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-08-25T04:04:04.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-25T04:03:58.358530+0000', 'last_change': '2023-08-25T04:03:58.358530+0000', 'last_active': '2023-08-25T04:03:58.358530+0000', 'last_peered': '2023-08-25T04:03:58.358530+0000', 'last_clean': '2023-08-25T04:03:58.358530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:58.358530+0000', 'last_undegraded': '2023-08-25T04:03:58.358530+0000', 'last_fullsized': '2023-08-25T04:03:58.358530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-25T04:04:04.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-08-25T04:04:04.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-25T04:03:58.358530+0000', 'last_change': '2023-08-25T04:03:58.358530+0000', 'last_active': '2023-08-25T04:03:58.358530+0000', 'last_peered': '2023-08-25T04:03:58.358530+0000', 'last_clean': '2023-08-25T04:03:58.358530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:58.358530+0000', 'last_undegraded': '2023-08-25T04:03:58.358530+0000', 'last_fullsized': '2023-08-25T04:03:58.358530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-25T04:04:04.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-08-25T04:04:04.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-25T04:03:58.358530+0000', 'last_change': '2023-08-25T04:03:58.358530+0000', 'last_active': '2023-08-25T04:03:58.358530+0000', 'last_peered': '2023-08-25T04:03:58.358530+0000', 'last_clean': '2023-08-25T04:03:58.358530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:58.358530+0000', 'last_undegraded': '2023-08-25T04:03:58.358530+0000', 'last_fullsized': '2023-08-25T04:03:58.358530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-25T04:04:04.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-08-25T04:04:04.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-25T04:03:58.358530+0000', 'last_change': '2023-08-25T04:03:58.358530+0000', 'last_active': '2023-08-25T04:03:58.358530+0000', 'last_peered': '2023-08-25T04:03:58.358530+0000', 'last_clean': '2023-08-25T04:03:58.358530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:58.358530+0000', 'last_undegraded': '2023-08-25T04:03:58.358530+0000', 'last_fullsized': '2023-08-25T04:03:58.358530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-25T04:04:04.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-08-25T04:04:04.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-25T04:03:58.358530+0000', 'last_change': '2023-08-25T04:03:58.358530+0000', 'last_active': '2023-08-25T04:03:58.358530+0000', 'last_peered': '2023-08-25T04:03:58.358530+0000', 'last_clean': '2023-08-25T04:03:58.358530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:58.358530+0000', 'last_undegraded': '2023-08-25T04:03:58.358530+0000', 'last_fullsized': '2023-08-25T04:03:58.358530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-25T04:04:04.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-08-25T04:04:04.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-25T04:03:58.358530+0000', 'last_change': '2023-08-25T04:03:58.358530+0000', 'last_active': '2023-08-25T04:03:58.358530+0000', 'last_peered': '2023-08-25T04:03:58.358530+0000', 'last_clean': '2023-08-25T04:03:58.358530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:58.358530+0000', 'last_undegraded': '2023-08-25T04:03:58.358530+0000', 'last_fullsized': '2023-08-25T04:03:58.358530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-25T04:04:04.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-08-25T04:04:04.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-25T04:03:58.358530+0000', 'last_change': '2023-08-25T04:03:58.358530+0000', 'last_active': '2023-08-25T04:03:58.358530+0000', 'last_peered': '2023-08-25T04:03:58.358530+0000', 'last_clean': '2023-08-25T04:03:58.358530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:58.358530+0000', 'last_undegraded': '2023-08-25T04:03:58.358530+0000', 'last_fullsized': '2023-08-25T04:03:58.358530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-25T04:04:04.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-08-25T04:04:04.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-25T04:03:58.358530+0000', 'last_change': '2023-08-25T04:03:58.358530+0000', 'last_active': '2023-08-25T04:03:58.358530+0000', 'last_peered': '2023-08-25T04:03:58.358530+0000', 'last_clean': '2023-08-25T04:03:58.358530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:58.358530+0000', 'last_undegraded': '2023-08-25T04:03:58.358530+0000', 'last_fullsized': '2023-08-25T04:03:58.358530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-25T04:04:04.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-08-25T04:04:04.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-25T04:03:58.358530+0000', 'last_change': '2023-08-25T04:03:58.358530+0000', 'last_active': '2023-08-25T04:03:58.358530+0000', 'last_peered': '2023-08-25T04:03:58.358530+0000', 'last_clean': '2023-08-25T04:03:58.358530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:58.358530+0000', 'last_undegraded': '2023-08-25T04:03:58.358530+0000', 'last_fullsized': '2023-08-25T04:03:58.358530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-25T04:04:04.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-08-25T04:04:04.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-08-25T04:03:57.366119+0000', 'last_change': '2023-08-25T04:03:57.366119+0000', 'last_active': '2023-08-25T04:03:57.346906+0000', 'last_peered': '2023-08-25T04:03:57.346906+0000', 'last_clean': '2023-08-25T04:03:57.346906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:57.366119+0000', 'last_undegraded': '2023-08-25T04:03:57.366119+0000', 'last_fullsized': '2023-08-25T04:03:57.366119+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-25T04:04:04.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-08-25T04:04:04.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-08-25T04:03:57.362336+0000', 'last_change': '2023-08-25T04:03:57.362336+0000', 'last_active': '2023-08-25T04:03:57.346906+0000', 'last_peered': '2023-08-25T04:03:57.346906+0000', 'last_clean': '2023-08-25T04:03:57.346906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:57.362336+0000', 'last_undegraded': '2023-08-25T04:03:57.362336+0000', 'last_fullsized': '2023-08-25T04:03:57.362336+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-25T04:04:04.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-08-25T04:04:04.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-25T04:03:58.358530+0000', 'last_change': '2023-08-25T04:03:58.358530+0000', 'last_active': '2023-08-25T04:03:58.358530+0000', 'last_peered': '2023-08-25T04:03:58.358530+0000', 'last_clean': '2023-08-25T04:03:58.358530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:58.358530+0000', 'last_undegraded': '2023-08-25T04:03:58.358530+0000', 'last_fullsized': '2023-08-25T04:03:58.358530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-25T04:04:04.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-08-25T04:04:04.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-25T04:03:58.358530+0000', 'last_change': '2023-08-25T04:03:58.358530+0000', 'last_active': '2023-08-25T04:03:58.358530+0000', 'last_peered': '2023-08-25T04:03:58.358530+0000', 'last_clean': '2023-08-25T04:03:58.358530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:58.358530+0000', 'last_undegraded': '2023-08-25T04:03:58.358530+0000', 'last_fullsized': '2023-08-25T04:03:58.358530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-25T04:04:04.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-08-25T04:04:04.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-08-25T04:03:57.366033+0000', 'last_change': '2023-08-25T04:03:57.366033+0000', 'last_active': '2023-08-25T04:03:57.346906+0000', 'last_peered': '2023-08-25T04:03:57.346906+0000', 'last_clean': '2023-08-25T04:03:57.346906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:57.366033+0000', 'last_undegraded': '2023-08-25T04:03:57.366033+0000', 'last_fullsized': '2023-08-25T04:03:57.366033+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-25T04:04:04.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-08-25T04:04:04.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-08-25T04:03:57.362302+0000', 'last_change': '2023-08-25T04:03:57.362302+0000', 'last_active': '2023-08-25T04:03:57.346906+0000', 'last_peered': '2023-08-25T04:03:57.346906+0000', 'last_clean': '2023-08-25T04:03:57.346906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:57.362302+0000', 'last_undegraded': '2023-08-25T04:03:57.362302+0000', 'last_fullsized': '2023-08-25T04:03:57.362302+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-25T04:04:04.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-08-25T04:04:04.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-25T04:03:58.358530+0000', 'last_change': '2023-08-25T04:03:58.358530+0000', 'last_active': '2023-08-25T04:03:58.358530+0000', 'last_peered': '2023-08-25T04:03:58.358530+0000', 'last_clean': '2023-08-25T04:03:58.358530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:58.358530+0000', 'last_undegraded': '2023-08-25T04:03:58.358530+0000', 'last_fullsized': '2023-08-25T04:03:58.358530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-25T04:04:04.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-08-25T04:04:04.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-08-25T04:03:57.362928+0000', 'last_change': '2023-08-25T04:03:57.362928+0000', 'last_active': '2023-08-25T04:03:57.346906+0000', 'last_peered': '2023-08-25T04:03:57.346906+0000', 'last_clean': '2023-08-25T04:03:57.346906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:57.362928+0000', 'last_undegraded': '2023-08-25T04:03:57.362928+0000', 'last_fullsized': '2023-08-25T04:03:57.362928+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-25T04:04:04.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-08-25T04:04:04.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-08-25T04:03:57.363019+0000', 'last_change': '2023-08-25T04:03:57.363019+0000', 'last_active': '2023-08-25T04:03:57.346906+0000', 'last_peered': '2023-08-25T04:03:57.346906+0000', 'last_clean': '2023-08-25T04:03:57.346906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:57.363019+0000', 'last_undegraded': '2023-08-25T04:03:57.363019+0000', 'last_fullsized': '2023-08-25T04:03:57.363019+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-25T04:04:04.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-08-25T04:04:04.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-25T04:03:58.358530+0000', 'last_change': '2023-08-25T04:03:58.358530+0000', 'last_active': '2023-08-25T04:03:58.358530+0000', 'last_peered': '2023-08-25T04:03:58.358530+0000', 'last_clean': '2023-08-25T04:03:58.358530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:58.358530+0000', 'last_undegraded': '2023-08-25T04:03:58.358530+0000', 'last_fullsized': '2023-08-25T04:03:58.358530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-25T04:04:04.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-08-25T04:04:04.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-08-25T04:03:57.366089+0000', 'last_change': '2023-08-25T04:03:57.366089+0000', 'last_active': '2023-08-25T04:03:57.346906+0000', 'last_peered': '2023-08-25T04:03:57.346906+0000', 'last_clean': '2023-08-25T04:03:57.346906+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:57.366089+0000', 'last_undegraded': '2023-08-25T04:03:57.366089+0000', 'last_fullsized': '2023-08-25T04:03:57.366089+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:57.346906+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-25T04:04:04.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-08-25T04:04:04.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-25T04:03:58.358530+0000', 'last_change': '2023-08-25T04:03:58.358530+0000', 'last_active': '2023-08-25T04:03:58.358530+0000', 'last_peered': '2023-08-25T04:03:58.358530+0000', 'last_clean': '2023-08-25T04:03:58.358530+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-25T04:03:58.358530+0000', 'last_undegraded': '2023-08-25T04:03:58.358530+0000', 'last_fullsized': '2023-08-25T04:03:58.358530+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'last_clean_scrub_stamp': '2023-08-25T04:03:58.358530+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-25T04:04:04.314 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-25T04:04:04.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.475+0000 7f2392703640 1 Processor -- start 2023-08-25T04:04:04.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.475+0000 7f2392703640 1 -- start start 2023-08-25T04:04:04.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.475+0000 7f2392703640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f238c0d0d30 0x7f238c0b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:04.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.475+0000 7f2392703640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f238c0d1110 0x7f238c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:04.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.475+0000 7f2392703640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238c0cfbc0 con 0x7f238c0d0880 2023-08-25T04:04:04.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.475+0000 7f2392703640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238c0cd5b0 con 0x7f238c0d1110 2023-08-25T04:04:04.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.475+0000 7f2392703640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0cf320 con 0x7f238c0d0d30 2023-08-25T04:04:04.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.475+0000 7f238bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f238c0d0d30 0x7f238c0b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:04.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.475+0000 7f238bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f238c0d0d30 0x7f238c0b55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:36570/0 (socket says 172.21.15.55:36570) 2023-08-25T04:04:04.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.475+0000 7f238bfff640 1 -- 172.21.15.55:0/3428053146 learned_addr learned my addr 172.21.15.55:0/3428053146 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:04.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.475+0000 7f238b7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f238c0d1110 0x7f238c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:04.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.475+0000 7f238bfff640 1 -- 172.21.15.55:0/3428053146 >> v2:172.21.15.110:3300/0 conn(0x7f238c0d1110 msgr2=0x7f238c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:04.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.475+0000 7f238bfff640 1 --2- 172.21.15.55:0/3428053146 >> v2:172.21.15.110:3300/0 conn(0x7f238c0d1110 0x7f238c0d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.475+0000 7f238bfff640 1 -- 172.21.15.55:0/3428053146 >> v1:172.21.15.110:6789/0 conn(0x7f238c0d0880 legacy=0x7f238c0cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:04.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.475+0000 7f238bfff640 1 -- 172.21.15.55:0/3428053146 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c0cf600 con 0x7f238c0d0d30 2023-08-25T04:04:04.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.479+0000 7f238bfff640 1 --2- 172.21.15.55:0/3428053146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f238c0d0d30 0x7f238c0b55c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f237c006fd0 tx=0x7f237c01c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce2b8ec6e2aa7e7e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:04.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.479+0000 7f238affd640 1 -- 172.21.15.55:0/3428053146 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c0ac620 con 0x7f238c0d0d30 2023-08-25T04:04:04.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.479+0000 7f238affd640 1 -- 172.21.15.55:0/3428053146 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c0ac780 con 0x7f238c0d0d30 2023-08-25T04:04:04.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.479+0000 7f238affd640 1 -- 172.21.15.55:0/3428053146 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c0acb10 con 0x7f238c0d0d30 2023-08-25T04:04:04.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.479+0000 7f2392703640 1 -- 172.21.15.55:0/3428053146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f238c0d0d30 msgr2=0x7f238c0b55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:04.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.479+0000 7f2392703640 1 --2- 172.21.15.55:0/3428053146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f238c0d0d30 0x7f238c0b55c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f237c006fd0 tx=0x7f237c01c460 comp rx=0 tx=0).stop 2023-08-25T04:04:04.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.479+0000 7f2392703640 1 -- 172.21.15.55:0/3428053146 shutdown_connections 2023-08-25T04:04:04.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.479+0000 7f2392703640 1 --2- 172.21.15.55:0/3428053146 >> v2:172.21.15.110:3300/0 conn(0x7f238c0d1110 0x7f238c0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.479+0000 7f2392703640 1 --2- 172.21.15.55:0/3428053146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f238c0d0d30 0x7f238c0b55c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.479+0000 7f2392703640 1 -- 172.21.15.55:0/3428053146 >> 172.21.15.55:0/3428053146 conn(0x7f238c09baf0 msgr2=0x7f238c0d2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:04.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.479+0000 7f2392703640 1 -- 172.21.15.55:0/3428053146 shutdown_connections 2023-08-25T04:04:04.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.479+0000 7f2392703640 1 -- 172.21.15.55:0/3428053146 wait complete. 2023-08-25T04:04:04.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f2392703640 1 Processor -- start 2023-08-25T04:04:04.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f2392703640 1 -- start start 2023-08-25T04:04:04.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f2392703640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f238c0d0880 0x7f238c13c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:04.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f2392703640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f238c0d0d30 0x7f238c06bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:04.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f2392703640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f238c0d1110 0x7f238c06c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f2392703640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c15b130 con 0x7f238c0d0880 2023-08-25T04:04:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f2392703640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0b7d90 con 0x7f238c0d1110 2023-08-25T04:04:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f2392703640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c0b77d0 con 0x7f238c0d0d30 2023-08-25T04:04:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f238bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f238c0d0880 0x7f238c13c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f238bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f238c0d0880 0x7f238c13c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39528/0 (socket says 172.21.15.55:39528) 2023-08-25T04:04:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f238bfff640 1 -- 172.21.15.55:0/1327598693 learned_addr learned my addr 172.21.15.55:0/1327598693 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f238b7fe640 1 --2- 172.21.15.55:0/1327598693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f238c0d0d30 0x7f238c06bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:04.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f2390ca0640 1 --2- 172.21.15.55:0/1327598693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f238c0d1110 0x7f238c06c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:04.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f238bfff640 1 -- 172.21.15.55:0/1327598693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f238c0d0d30 msgr2=0x7f238c06bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:04.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f238bfff640 1 --2- 172.21.15.55:0/1327598693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f238c0d0d30 0x7f238c06bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f238bfff640 1 -- 172.21.15.55:0/1327598693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f238c0d1110 msgr2=0x7f238c06c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:04.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f238bfff640 1 --2- 172.21.15.55:0/1327598693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f238c0d1110 0x7f238c06c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f238bfff640 1 -- 172.21.15.55:0/1327598693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c009480 con 0x7f238c0d0880 2023-08-25T04:04:04.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.483+0000 7f238bfff640 1 --2- 172.21.15.55:0/1327598693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f238c0d0880 0x7f238c13c9d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f237c01ab10 tx=0x7f237c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:04.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.487+0000 7f2388ff9640 1 -- 172.21.15.55:0/1327598693 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c0ac8f0 con 0x7f238c0d0880 2023-08-25T04:04:04.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.487+0000 7f2388ff9640 1 -- 172.21.15.55:0/1327598693 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c0aca50 con 0x7f238c0d0880 2023-08-25T04:04:04.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.487+0000 7f2388ff9640 1 -- 172.21.15.55:0/1327598693 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c0acde0 con 0x7f238c0d0880 2023-08-25T04:04:04.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.487+0000 7f2392703640 1 -- 172.21.15.55:0/1327598693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238c0b7ab0 con 0x7f238c0d0880 2023-08-25T04:04:04.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.487+0000 7f2392703640 1 -- 172.21.15.55:0/1327598693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238c13cf10 con 0x7f238c0d0880 2023-08-25T04:04:04.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.487+0000 7f2392703640 1 -- 172.21.15.55:0/1327598693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238c04dbe0 con 0x7f238c0d0880 2023-08-25T04:04:04.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.487+0000 7f2388ff9640 1 -- 172.21.15.55:0/1327598693 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f237c0b3040 con 0x7f238c0d0880 2023-08-25T04:04:04.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.487+0000 7f2388ff9640 1 --2- 172.21.15.55:0/1327598693 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f23780656b0 0x7f2378067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:04.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.487+0000 7f2388ff9640 1 -- 172.21.15.55:0/1327598693 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f237c11d180 con 0x7f238c0d0880 2023-08-25T04:04:04.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.487+0000 7f238b7fe640 1 --2- 172.21.15.55:0/1327598693 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f23780656b0 0x7f2378067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:04.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.491+0000 7f238b7fe640 1 --2- 172.21.15.55:0/1327598693 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f23780656b0 0x7f2378067b70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f238c1f9b40 tx=0x7f2380009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:04.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.491+0000 7f2388ff9640 1 -- 172.21.15.55:0/1327598693 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f237c0ead60 con 0x7f238c0d0880 2023-08-25T04:04:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.703+0000 7f2392703640 1 -- 172.21.15.55:0/1327598693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f238c0cde80 con 0x7f238c0d0880 2023-08-25T04:04:04.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.703+0000 7f2388ff9640 1 -- 172.21.15.55:0/1327598693 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1722 (secure 0 0 0) 0x7f237c0ee380 con 0x7f238c0d0880 2023-08-25T04:04:04.707 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:04:04.707 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":89,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1692936167,"num_in_osds":8,"osd_in_since":1692936158,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":82},{"state_name":"unknown","count":16},{"state_name":"creating+peering","count":7}],"num_pgs":105,"num_pools":4,"num_objects":18,"data_bytes":592196,"bytes_used":255709184,"bytes_avail":772838404096,"bytes_total":773094113280,"unknown_pgs_ratio":0.15238095819950104,"inactive_pgs_ratio":0.066666670143604279,"write_bytes_sec":2531,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5080}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-08-25T04:03:48.616093+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-25T04:04:04.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.707+0000 7f2392703640 1 -- 172.21.15.55:0/1327598693 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f23780656b0 msgr2=0x7f2378067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:04.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.707+0000 7f2392703640 1 --2- 172.21.15.55:0/1327598693 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f23780656b0 0x7f2378067b70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f238c1f9b40 tx=0x7f2380009190 comp rx=0 tx=0).stop 2023-08-25T04:04:04.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.707+0000 7f2392703640 1 -- 172.21.15.55:0/1327598693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f238c0d0880 msgr2=0x7f238c13c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:04.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.707+0000 7f2392703640 1 --2- 172.21.15.55:0/1327598693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f238c0d0880 0x7f238c13c9d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f237c01ab10 tx=0x7f237c019200 comp rx=0 tx=0).stop 2023-08-25T04:04:04.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.707+0000 7f2392703640 1 -- 172.21.15.55:0/1327598693 shutdown_connections 2023-08-25T04:04:04.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.707+0000 7f2392703640 1 --2- 172.21.15.55:0/1327598693 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f23780656b0 0x7f2378067b70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.707+0000 7f2392703640 1 --2- 172.21.15.55:0/1327598693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f238c0d1110 0x7f238c06c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.707+0000 7f2392703640 1 --2- 172.21.15.55:0/1327598693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f238c0d0d30 0x7f238c06bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.707+0000 7f2392703640 1 --2- 172.21.15.55:0/1327598693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f238c0d0880 0x7f238c13c9d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.707+0000 7f2392703640 1 -- 172.21.15.55:0/1327598693 >> 172.21.15.55:0/1327598693 conn(0x7f238c09baf0 msgr2=0x7f238c0b7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:04.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.707+0000 7f2392703640 1 -- 172.21.15.55:0/1327598693 shutdown_connections 2023-08-25T04:04:04.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.707+0000 7f2392703640 1 -- 172.21.15.55:0/1327598693 wait complete. 2023-08-25T04:04:04.728 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-25T04:04:04.729 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:04:04.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.871+0000 7f64cde88640 1 Processor -- start 2023-08-25T04:04:04.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.871+0000 7f64cde88640 1 -- start start 2023-08-25T04:04:04.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.871+0000 7f64cde88640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64c80cdde0 0x7f64c80ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:04.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.871+0000 7f64cde88640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c80b29b0 con 0x7f64c80d0da0 2023-08-25T04:04:04.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.871+0000 7f64cde88640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c80b1dc0 con 0x7f64c80b2e40 2023-08-25T04:04:04.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.871+0000 7f64cde88640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c80ce760 con 0x7f64c80cdde0 2023-08-25T04:04:04.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.871+0000 7f64c6ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64c80cdde0 0x7f64c80ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:04.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.871+0000 7f64c6ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64c80cdde0 0x7f64c80ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39538/0 (socket says 172.21.15.55:39538) 2023-08-25T04:04:04.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.871+0000 7f64c6ffd640 1 -- 172.21.15.55:0/337060072 learned_addr learned my addr 172.21.15.55:0/337060072 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:04.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.871+0000 7f64c77fe640 1 --1- 172.21.15.55:0/337060072 >> v1:172.21.15.55:6789/0 conn(0x7f64c80d0da0 0x7f64c80d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46534/0 (socket says 172.21.15.55:46534) 2023-08-25T04:04:04.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.871+0000 7f64c6ffd640 1 -- 172.21.15.55:0/337060072 >> v1:172.21.15.110:6789/0 conn(0x7f64c80b2e40 legacy=0x7f64c80b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:04.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.871+0000 7f64c6ffd640 1 -- 172.21.15.55:0/337060072 >> v1:172.21.15.55:6789/0 conn(0x7f64c80d0da0 legacy=0x7f64c80d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:04.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.871+0000 7f64c6ffd640 1 -- 172.21.15.55:0/337060072 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c80b2080 con 0x7f64c80cdde0 2023-08-25T04:04:04.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.871+0000 7f64c67fc640 1 -- 172.21.15.55:0/337060072 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979990336 0 0) 0x7f64c80b29b0 con 0x7f64c80d0da0 2023-08-25T04:04:04.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.875+0000 7f64c6ffd640 1 --2- 172.21.15.55:0/337060072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64c80cdde0 0x7f64c80ce220 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f64bc009870 tx=0x7f64bc01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88dced749d8893b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:04.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.875+0000 7f64c67fc640 1 -- 172.21.15.55:0/337060072 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc0a8a30 con 0x7f64c80cdde0 2023-08-25T04:04:04.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.875+0000 7f64c67fc640 1 -- 172.21.15.55:0/337060072 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64bc0a8b90 con 0x7f64c80cdde0 2023-08-25T04:04:04.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.875+0000 7f64c67fc640 1 -- 172.21.15.55:0/337060072 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc0b0440 con 0x7f64c80cdde0 2023-08-25T04:04:04.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.875+0000 7f64cde88640 1 -- 172.21.15.55:0/337060072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64c80cdde0 msgr2=0x7f64c80ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:04.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.875+0000 7f64cde88640 1 --2- 172.21.15.55:0/337060072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64c80cdde0 0x7f64c80ce220 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f64bc009870 tx=0x7f64bc01ed30 comp rx=0 tx=0).stop 2023-08-25T04:04:04.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.875+0000 7f64cde88640 1 -- 172.21.15.55:0/337060072 shutdown_connections 2023-08-25T04:04:04.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.875+0000 7f64cde88640 1 --2- 172.21.15.55:0/337060072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64c80cdde0 0x7f64c80ce220 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.875+0000 7f64cde88640 1 -- 172.21.15.55:0/337060072 >> 172.21.15.55:0/337060072 conn(0x7f64c809bae0 msgr2=0x7f64c80d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:04.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.875+0000 7f64cde88640 1 -- 172.21.15.55:0/337060072 shutdown_connections 2023-08-25T04:04:04.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.875+0000 7f64cde88640 1 -- 172.21.15.55:0/337060072 wait complete. 2023-08-25T04:04:04.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64cde88640 1 Processor -- start 2023-08-25T04:04:04.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64cde88640 1 -- start start 2023-08-25T04:04:04.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64cde88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64c80b2e40 0x7f64c815fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64cde88640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64c80cdde0 0x7f64c80cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64cde88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64c80d0da0 0x7f64c80c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64cde88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c80cb640 con 0x7f64c80d0da0 2023-08-25T04:04:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64cde88640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c81e52e0 con 0x7f64c80cdde0 2023-08-25T04:04:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64cde88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c81e58a0 con 0x7f64c80b2e40 2023-08-25T04:04:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64c7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64c80d0da0 0x7f64c80c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:04.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64c7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64c80d0da0 0x7f64c80c9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39554/0 (socket says 172.21.15.55:39554) 2023-08-25T04:04:04.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64c7fff640 1 -- 172.21.15.55:0/1699583958 learned_addr learned my addr 172.21.15.55:0/1699583958 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:04.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64c77fe640 1 --2- 172.21.15.55:0/1699583958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64c80b2e40 0x7f64c815fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:04.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64c6ffd640 1 --2- 172.21.15.55:0/1699583958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64c80cdde0 0x7f64c80cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:04.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64c7fff640 1 -- 172.21.15.55:0/1699583958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64c80b2e40 msgr2=0x7f64c815fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:04.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64c7fff640 1 --2- 172.21.15.55:0/1699583958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64c80b2e40 0x7f64c815fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64c7fff640 1 -- 172.21.15.55:0/1699583958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64c80cdde0 msgr2=0x7f64c80cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:04.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64c7fff640 1 --2- 172.21.15.55:0/1699583958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64c80cdde0 0x7f64c80cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:04.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64c7fff640 1 -- 172.21.15.55:0/1699583958 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc0094d0 con 0x7f64c80d0da0 2023-08-25T04:04:04.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64c7fff640 1 --2- 172.21.15.55:0/1699583958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64c80d0da0 0x7f64c80c9890 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f64c000c7a0 tx=0x7f64c000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:04.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64affff640 1 -- 172.21.15.55:0/1699583958 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c0003b80 con 0x7f64c80d0da0 2023-08-25T04:04:04.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64affff640 1 -- 172.21.15.55:0/1699583958 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c0003ce0 con 0x7f64c80d0da0 2023-08-25T04:04:04.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64affff640 1 -- 172.21.15.55:0/1699583958 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c000aa90 con 0x7f64c80d0da0 2023-08-25T04:04:04.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64cde88640 1 -- 172.21.15.55:0/1699583958 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c80cb890 con 0x7f64c80d0da0 2023-08-25T04:04:04.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.879+0000 7f64cde88640 1 -- 172.21.15.55:0/1699583958 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c81e5530 con 0x7f64c80d0da0 2023-08-25T04:04:04.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.882+0000 7f64cde88640 1 -- 172.21.15.55:0/1699583958 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c81e5a10 con 0x7f64c80d0da0 2023-08-25T04:04:04.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.882+0000 7f64affff640 1 -- 172.21.15.55:0/1699583958 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f64c000abf0 con 0x7f64c80d0da0 2023-08-25T04:04:04.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.882+0000 7f64affff640 1 --2- 172.21.15.55:0/1699583958 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f64b40656b0 0x7f64b4067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:04.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.882+0000 7f64affff640 1 -- 172.21.15.55:0/1699583958 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f64c0082b00 con 0x7f64c80d0da0 2023-08-25T04:04:04.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.882+0000 7f64c77fe640 1 --2- 172.21.15.55:0/1699583958 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f64b40656b0 0x7f64b4067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.882+0000 7f64c77fe640 1 --2- 172.21.15.55:0/1699583958 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f64b40656b0 0x7f64b4067b70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f64b8007fd0 tx=0x7f64b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:04.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:04.886+0000 7f64affff640 1 -- 172.21.15.55:0/1699583958 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f64c0084e60 con 0x7f64c80d0da0 2023-08-25T04:04:05.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:05.038+0000 7f64cde88640 1 -- 172.21.15.55:0/1699583958 --> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f64c80b2640 con 0x7f64b40656b0 2023-08-25T04:04:05.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:05.046+0000 7f64affff640 1 -- 172.21.15.55:0/1699583958 <== mgr.4102 v2:172.21.15.110:6832/413962747 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311102 (secure 0 0 0) 0x7f64b8001430 con 0x7f64b40656b0 2023-08-25T04:04:05.053 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:04:05.054 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:04:05.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:05.050+0000 7f64cde88640 1 -- 172.21.15.55:0/1699583958 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f64b40656b0 msgr2=0x7f64b4067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:05.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:05.050+0000 7f64cde88640 1 --2- 172.21.15.55:0/1699583958 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f64b40656b0 0x7f64b4067b70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f64b8007fd0 tx=0x7f64b8009040 comp rx=0 tx=0).stop 2023-08-25T04:04:05.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:05.050+0000 7f64cde88640 1 -- 172.21.15.55:0/1699583958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64c80d0da0 msgr2=0x7f64c80c9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:05.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:05.050+0000 7f64cde88640 1 --2- 172.21.15.55:0/1699583958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64c80d0da0 0x7f64c80c9890 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f64c000c7a0 tx=0x7f64c000cc60 comp rx=0 tx=0).stop 2023-08-25T04:04:05.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:05.050+0000 7f64cde88640 1 -- 172.21.15.55:0/1699583958 shutdown_connections 2023-08-25T04:04:05.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:05.050+0000 7f64cde88640 1 --2- 172.21.15.55:0/1699583958 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f64b40656b0 0x7f64b4067b70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:05.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:05.050+0000 7f64cde88640 1 --2- 172.21.15.55:0/1699583958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64c80d0da0 0x7f64c80c9890 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:05.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:05.050+0000 7f64cde88640 1 --2- 172.21.15.55:0/1699583958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64c80cdde0 0x7f64c80cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:05.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:05.050+0000 7f64cde88640 1 --2- 172.21.15.55:0/1699583958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64c80b2e40 0x7f64c815fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:05.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:05.050+0000 7f64cde88640 1 -- 172.21.15.55:0/1699583958 >> 172.21.15.55:0/1699583958 conn(0x7f64c809bae0 msgr2=0x7f64c80b4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:05.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:05.050+0000 7f64cde88640 1 -- 172.21.15.55:0/1699583958 shutdown_connections 2023-08-25T04:04:05.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:05.050+0000 7f64cde88640 1 -- 172.21.15.55:0/1699583958 wait complete. 2023-08-25T04:04:05.073 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-08-25T04:04:04.619598+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249832,"kb_used_data":4528,"kb_used_omap":13,"kb_used_meta":245170,"kb_avail":754724888,"statfs":{"total":773094113280,"available":772838285312,"internally_reserved":0,"allocated":4636672,"data_stored":2593042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":251054168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.255894"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983113+0000","last_change":"2023-08-25T04:03:59.406557+0000","last_active":"2023-08-25T04:04:00.983113+0000","last_peered":"2023-08-25T04:04:00.983113+0000","last_clean":"2023-08-25T04:04:00.983113+0000","last_became_active":"2023-08-25T04:03:59.406203+0000","last_became_peered":"2023-08-25T04:03:59.406203+0000","last_unstale":"2023-08-25T04:04:00.983113+0000","last_undegraded":"2023-08-25T04:04:00.983113+0000","last_fullsized":"2023-08-25T04:04:00.983113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:24:08.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982922+0000","last_change":"2023-08-25T04:03:59.405679+0000","last_active":"2023-08-25T04:04:00.982922+0000","last_peered":"2023-08-25T04:04:00.982922+0000","last_clean":"2023-08-25T04:04:00.982922+0000","last_became_active":"2023-08-25T04:03:59.405378+0000","last_became_peered":"2023-08-25T04:03:59.405378+0000","last_unstale":"2023-08-25T04:04:00.982922+0000","last_undegraded":"2023-08-25T04:04:00.982922+0000","last_fullsized":"2023-08-25T04:04:00.982922+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:38.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.423571+0000","last_change":"2023-08-25T04:03:59.422508+0000","last_active":"2023-08-25T04:03:59.423571+0000","last_peered":"2023-08-25T04:03:59.423571+0000","last_clean":"2023-08-25T04:03:59.423571+0000","last_became_active":"2023-08-25T04:03:59.422191+0000","last_became_peered":"2023-08-25T04:03:59.422191+0000","last_unstale":"2023-08-25T04:03:59.423571+0000","last_undegraded":"2023-08-25T04:03:59.423571+0000","last_fullsized":"2023-08-25T04:03:59.423571+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:13:22.438164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401269+0000","last_change":"2023-08-25T04:03:59.400540+0000","last_active":"2023-08-25T04:04:00.401269+0000","last_peered":"2023-08-25T04:04:00.401269+0000","last_clean":"2023-08-25T04:04:00.401269+0000","last_became_active":"2023-08-25T04:03:59.399951+0000","last_became_peered":"2023-08-25T04:03:59.399951+0000","last_unstale":"2023-08-25T04:04:00.401269+0000","last_undegraded":"2023-08-25T04:04:00.401269+0000","last_fullsized":"2023-08-25T04:04:00.401269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:27:39.558644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400972+0000","last_change":"2023-08-25T04:03:59.401446+0000","last_active":"2023-08-25T04:04:00.400972+0000","last_peered":"2023-08-25T04:04:00.400972+0000","last_clean":"2023-08-25T04:04:00.400972+0000","last_became_active":"2023-08-25T04:03:59.401196+0000","last_became_peered":"2023-08-25T04:03:59.401196+0000","last_unstale":"2023-08-25T04:04:00.400972+0000","last_undegraded":"2023-08-25T04:04:00.400972+0000","last_fullsized":"2023-08-25T04:04:00.400972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:56:27.953788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410797+0000","last_change":"2023-08-25T04:03:59.409377+0000","last_active":"2023-08-25T04:03:59.410797+0000","last_peered":"2023-08-25T04:03:59.410797+0000","last_clean":"2023-08-25T04:03:59.410797+0000","last_became_active":"2023-08-25T04:03:59.403715+0000","last_became_peered":"2023-08-25T04:03:59.403715+0000","last_unstale":"2023-08-25T04:03:59.410797+0000","last_undegraded":"2023-08-25T04:03:59.410797+0000","last_fullsized":"2023-08-25T04:03:59.410797+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:14.765621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419238+0000","last_change":"2023-08-25T04:03:59.415058+0000","last_active":"2023-08-25T04:04:00.419238+0000","last_peered":"2023-08-25T04:04:00.419238+0000","last_clean":"2023-08-25T04:04:00.419238+0000","last_became_active":"2023-08-25T04:03:59.414723+0000","last_became_peered":"2023-08-25T04:03:59.414723+0000","last_unstale":"2023-08-25T04:04:00.419238+0000","last_undegraded":"2023-08-25T04:04:00.419238+0000","last_fullsized":"2023-08-25T04:04:00.419238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:34:37.814493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982607+0000","last_change":"2023-08-25T04:03:59.423164+0000","last_active":"2023-08-25T04:04:00.982607+0000","last_peered":"2023-08-25T04:04:00.982607+0000","last_clean":"2023-08-25T04:04:00.982607+0000","last_became_active":"2023-08-25T04:03:59.422861+0000","last_became_peered":"2023-08-25T04:03:59.422861+0000","last_unstale":"2023-08-25T04:04:00.982607+0000","last_undegraded":"2023-08-25T04:04:00.982607+0000","last_fullsized":"2023-08-25T04:04:00.982607+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:51:20.329496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.421133+0000","last_change":"2023-08-25T04:03:59.420041+0000","last_active":"2023-08-25T04:03:59.421133+0000","last_peered":"2023-08-25T04:03:59.421133+0000","last_clean":"2023-08-25T04:03:59.421133+0000","last_became_active":"2023-08-25T04:03:59.419589+0000","last_became_peered":"2023-08-25T04:03:59.419589+0000","last_unstale":"2023-08-25T04:03:59.421133+0000","last_undegraded":"2023-08-25T04:03:59.421133+0000","last_fullsized":"2023-08-25T04:03:59.421133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:05.539349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419590+0000","last_change":"2023-08-25T04:03:59.417854+0000","last_active":"2023-08-25T04:04:00.419590+0000","last_peered":"2023-08-25T04:04:00.419590+0000","last_clean":"2023-08-25T04:04:00.419590+0000","last_became_active":"2023-08-25T04:03:59.416366+0000","last_became_peered":"2023-08-25T04:03:59.416366+0000","last_unstale":"2023-08-25T04:04:00.419590+0000","last_undegraded":"2023-08-25T04:04:00.419590+0000","last_fullsized":"2023-08-25T04:04:00.419590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:20:23.025472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419740+0000","last_change":"2023-08-25T04:03:59.421543+0000","last_active":"2023-08-25T04:04:00.419740+0000","last_peered":"2023-08-25T04:04:00.419740+0000","last_clean":"2023-08-25T04:04:00.419740+0000","last_became_active":"2023-08-25T04:03:59.421202+0000","last_became_peered":"2023-08-25T04:03:59.421202+0000","last_unstale":"2023-08-25T04:04:00.419740+0000","last_undegraded":"2023-08-25T04:04:00.419740+0000","last_fullsized":"2023-08-25T04:04:00.419740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:08:57.095318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.416141+0000","last_change":"2023-08-25T04:03:59.414096+0000","last_active":"2023-08-25T04:03:59.416141+0000","last_peered":"2023-08-25T04:03:59.416141+0000","last_clean":"2023-08-25T04:03:59.416141+0000","last_became_active":"2023-08-25T04:03:59.413799+0000","last_became_peered":"2023-08-25T04:03:59.413799+0000","last_unstale":"2023-08-25T04:03:59.416141+0000","last_undegraded":"2023-08-25T04:03:59.416141+0000","last_fullsized":"2023-08-25T04:03:59.416141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:05:09.949970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419553+0000","last_change":"2023-08-25T04:03:59.418141+0000","last_active":"2023-08-25T04:04:00.419553+0000","last_peered":"2023-08-25T04:04:00.419553+0000","last_clean":"2023-08-25T04:04:00.419553+0000","last_became_active":"2023-08-25T04:03:59.417880+0000","last_became_peered":"2023-08-25T04:03:59.417880+0000","last_unstale":"2023-08-25T04:04:00.419553+0000","last_undegraded":"2023-08-25T04:04:00.419553+0000","last_fullsized":"2023-08-25T04:04:00.419553+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:55:54.338998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401652+0000","last_change":"2023-08-25T04:03:59.394965+0000","last_active":"2023-08-25T04:04:00.401652+0000","last_peered":"2023-08-25T04:04:00.401652+0000","last_clean":"2023-08-25T04:04:00.401652+0000","last_became_active":"2023-08-25T04:03:59.394626+0000","last_became_peered":"2023-08-25T04:03:59.394626+0000","last_unstale":"2023-08-25T04:04:00.401652+0000","last_undegraded":"2023-08-25T04:04:00.401652+0000","last_fullsized":"2023-08-25T04:04:00.401652+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:08:51.394168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419194+0000","last_change":"2023-08-25T04:03:59.413847+0000","last_active":"2023-08-25T04:04:00.419194+0000","last_peered":"2023-08-25T04:04:00.419194+0000","last_clean":"2023-08-25T04:04:00.419194+0000","last_became_active":"2023-08-25T04:03:59.413121+0000","last_became_peered":"2023-08-25T04:03:59.413121+0000","last_unstale":"2023-08-25T04:04:00.419194+0000","last_undegraded":"2023-08-25T04:04:00.419194+0000","last_fullsized":"2023-08-25T04:04:00.419194+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:20:45.210270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.331864+0000","last_change":"2023-08-25T04:03:59.416450+0000","last_active":"2023-08-25T04:04:01.331864+0000","last_peered":"2023-08-25T04:04:01.331864+0000","last_clean":"2023-08-25T04:04:01.331864+0000","last_became_active":"2023-08-25T04:03:59.416193+0000","last_became_peered":"2023-08-25T04:03:59.416193+0000","last_unstale":"2023-08-25T04:04:01.331864+0000","last_undegraded":"2023-08-25T04:04:01.331864+0000","last_fullsized":"2023-08-25T04:04:01.331864+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:46:24.107127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332485+0000","last_change":"2023-08-25T04:03:59.423381+0000","last_active":"2023-08-25T04:04:01.332485+0000","last_peered":"2023-08-25T04:04:01.332485+0000","last_clean":"2023-08-25T04:04:01.332485+0000","last_became_active":"2023-08-25T04:03:59.423057+0000","last_became_peered":"2023-08-25T04:03:59.423057+0000","last_unstale":"2023-08-25T04:04:01.332485+0000","last_undegraded":"2023-08-25T04:04:01.332485+0000","last_fullsized":"2023-08-25T04:04:01.332485+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:28:05.226459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402183+0000","last_change":"2023-08-25T04:03:59.391310+0000","last_active":"2023-08-25T04:04:00.402183+0000","last_peered":"2023-08-25T04:04:00.402183+0000","last_clean":"2023-08-25T04:04:00.402183+0000","last_became_active":"2023-08-25T04:03:59.390994+0000","last_became_peered":"2023-08-25T04:03:59.390994+0000","last_unstale":"2023-08-25T04:04:00.402183+0000","last_undegraded":"2023-08-25T04:04:00.402183+0000","last_fullsized":"2023-08-25T04:04:00.402183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:28:58.427763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401121+0000","last_change":"2023-08-25T04:03:59.414035+0000","last_active":"2023-08-25T04:04:00.401121+0000","last_peered":"2023-08-25T04:04:00.401121+0000","last_clean":"2023-08-25T04:04:00.401121+0000","last_became_active":"2023-08-25T04:03:59.413749+0000","last_became_peered":"2023-08-25T04:03:59.413749+0000","last_unstale":"2023-08-25T04:04:00.401121+0000","last_undegraded":"2023-08-25T04:04:00.401121+0000","last_fullsized":"2023-08-25T04:04:00.401121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:07:11.827147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402124+0000","last_change":"2023-08-25T04:03:59.391591+0000","last_active":"2023-08-25T04:04:00.402124+0000","last_peered":"2023-08-25T04:04:00.402124+0000","last_clean":"2023-08-25T04:04:00.402124+0000","last_became_active":"2023-08-25T04:03:59.391312+0000","last_became_peered":"2023-08-25T04:03:59.391312+0000","last_unstale":"2023-08-25T04:04:00.402124+0000","last_undegraded":"2023-08-25T04:04:00.402124+0000","last_fullsized":"2023-08-25T04:04:00.402124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:33:51.036999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419383+0000","last_change":"2023-08-25T04:03:59.418049+0000","last_active":"2023-08-25T04:04:00.419383+0000","last_peered":"2023-08-25T04:04:00.419383+0000","last_clean":"2023-08-25T04:04:00.419383+0000","last_became_active":"2023-08-25T04:03:59.417803+0000","last_became_peered":"2023-08-25T04:03:59.417803+0000","last_unstale":"2023-08-25T04:04:00.419383+0000","last_undegraded":"2023-08-25T04:04:00.419383+0000","last_fullsized":"2023-08-25T04:04:00.419383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:30:53.684824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402633+0000","last_change":"2023-08-25T04:03:59.405308+0000","last_active":"2023-08-25T04:04:00.402633+0000","last_peered":"2023-08-25T04:04:00.402633+0000","last_clean":"2023-08-25T04:04:00.402633+0000","last_became_active":"2023-08-25T04:03:59.405020+0000","last_became_peered":"2023-08-25T04:03:59.405020+0000","last_unstale":"2023-08-25T04:04:00.402633+0000","last_undegraded":"2023-08-25T04:04:00.402633+0000","last_fullsized":"2023-08-25T04:04:00.402633+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:32.783190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.331860+0000","last_change":"2023-08-25T04:03:59.405282+0000","last_active":"2023-08-25T04:04:01.331860+0000","last_peered":"2023-08-25T04:04:01.331860+0000","last_clean":"2023-08-25T04:04:01.331860+0000","last_became_active":"2023-08-25T04:03:59.404959+0000","last_became_peered":"2023-08-25T04:03:59.404959+0000","last_unstale":"2023-08-25T04:04:01.331860+0000","last_undegraded":"2023-08-25T04:04:01.331860+0000","last_fullsized":"2023-08-25T04:04:01.331860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:20:23.025472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400796+0000","last_change":"2023-08-25T04:03:59.400976+0000","last_active":"2023-08-25T04:04:00.400796+0000","last_peered":"2023-08-25T04:04:00.400796+0000","last_clean":"2023-08-25T04:04:00.400796+0000","last_became_active":"2023-08-25T04:03:59.400488+0000","last_became_peered":"2023-08-25T04:03:59.400488+0000","last_unstale":"2023-08-25T04:04:00.400796+0000","last_undegraded":"2023-08-25T04:04:00.400796+0000","last_fullsized":"2023-08-25T04:04:00.400796+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:42:10.702642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402261+0000","last_change":"2023-08-25T04:03:59.397032+0000","last_active":"2023-08-25T04:04:00.402261+0000","last_peered":"2023-08-25T04:04:00.402261+0000","last_clean":"2023-08-25T04:04:00.402261+0000","last_became_active":"2023-08-25T04:03:59.396729+0000","last_became_peered":"2023-08-25T04:03:59.396729+0000","last_unstale":"2023-08-25T04:04:00.402261+0000","last_undegraded":"2023-08-25T04:04:00.402261+0000","last_fullsized":"2023-08-25T04:04:00.402261+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:55:48.674520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.419196+0000","last_change":"2023-08-25T04:03:59.417741+0000","last_active":"2023-08-25T04:03:59.419196+0000","last_peered":"2023-08-25T04:03:59.419196+0000","last_clean":"2023-08-25T04:03:59.419196+0000","last_became_active":"2023-08-25T04:03:59.417492+0000","last_became_peered":"2023-08-25T04:03:59.417492+0000","last_unstale":"2023-08-25T04:03:59.419196+0000","last_undegraded":"2023-08-25T04:03:59.419196+0000","last_fullsized":"2023-08-25T04:03:59.419196+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:31:49.886410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402196+0000","last_change":"2023-08-25T04:03:59.397759+0000","last_active":"2023-08-25T04:04:00.402196+0000","last_peered":"2023-08-25T04:04:00.402196+0000","last_clean":"2023-08-25T04:04:00.402196+0000","last_became_active":"2023-08-25T04:03:59.397470+0000","last_became_peered":"2023-08-25T04:03:59.397470+0000","last_unstale":"2023-08-25T04:04:00.402196+0000","last_undegraded":"2023-08-25T04:04:00.402196+0000","last_fullsized":"2023-08-25T04:04:00.402196+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:43:22.887170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419678+0000","last_change":"2023-08-25T04:03:59.414961+0000","last_active":"2023-08-25T04:04:00.419678+0000","last_peered":"2023-08-25T04:04:00.419678+0000","last_clean":"2023-08-25T04:04:00.419678+0000","last_became_active":"2023-08-25T04:03:59.414610+0000","last_became_peered":"2023-08-25T04:03:59.414610+0000","last_unstale":"2023-08-25T04:04:00.419678+0000","last_undegraded":"2023-08-25T04:04:00.419678+0000","last_fullsized":"2023-08-25T04:04:00.419678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:08:51.394168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402152+0000","last_change":"2023-08-25T04:03:59.406847+0000","last_active":"2023-08-25T04:04:00.402152+0000","last_peered":"2023-08-25T04:04:00.402152+0000","last_clean":"2023-08-25T04:04:00.402152+0000","last_became_active":"2023-08-25T04:03:59.406550+0000","last_became_peered":"2023-08-25T04:03:59.406550+0000","last_unstale":"2023-08-25T04:04:00.402152+0000","last_undegraded":"2023-08-25T04:04:00.402152+0000","last_fullsized":"2023-08-25T04:04:00.402152+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:25:19.755302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401861+0000","last_change":"2023-08-25T04:03:59.397948+0000","last_active":"2023-08-25T04:04:00.401861+0000","last_peered":"2023-08-25T04:04:00.401861+0000","last_clean":"2023-08-25T04:04:00.401861+0000","last_became_active":"2023-08-25T04:03:59.397631+0000","last_became_peered":"2023-08-25T04:03:59.397631+0000","last_unstale":"2023-08-25T04:04:00.401861+0000","last_undegraded":"2023-08-25T04:04:00.401861+0000","last_fullsized":"2023-08-25T04:04:00.401861+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:51.119086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332118+0000","last_change":"2023-08-25T04:03:59.406484+0000","last_active":"2023-08-25T04:04:01.332118+0000","last_peered":"2023-08-25T04:04:01.332118+0000","last_clean":"2023-08-25T04:04:01.332118+0000","last_became_active":"2023-08-25T04:03:59.405207+0000","last_became_peered":"2023-08-25T04:03:59.405207+0000","last_unstale":"2023-08-25T04:04:01.332118+0000","last_undegraded":"2023-08-25T04:04:01.332118+0000","last_fullsized":"2023-08-25T04:04:01.332118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:52.932778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410368+0000","last_change":"2023-08-25T04:03:59.409108+0000","last_active":"2023-08-25T04:03:59.410368+0000","last_peered":"2023-08-25T04:03:59.410368+0000","last_clean":"2023-08-25T04:03:59.410368+0000","last_became_active":"2023-08-25T04:03:59.408844+0000","last_became_peered":"2023-08-25T04:03:59.408844+0000","last_unstale":"2023-08-25T04:03:59.410368+0000","last_undegraded":"2023-08-25T04:03:59.410368+0000","last_fullsized":"2023-08-25T04:03:59.410368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:31:52.823942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332171+0000","last_change":"2023-08-25T04:03:59.422851+0000","last_active":"2023-08-25T04:04:01.332171+0000","last_peered":"2023-08-25T04:04:01.332171+0000","last_clean":"2023-08-25T04:04:01.332171+0000","last_became_active":"2023-08-25T04:03:59.422576+0000","last_became_peered":"2023-08-25T04:03:59.422576+0000","last_unstale":"2023-08-25T04:04:01.332171+0000","last_undegraded":"2023-08-25T04:04:01.332171+0000","last_fullsized":"2023-08-25T04:04:01.332171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:44.291484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402304+0000","last_change":"2023-08-25T04:03:58.379427+0000","last_active":"2023-08-25T04:04:00.402304+0000","last_peered":"2023-08-25T04:04:00.402304+0000","last_clean":"2023-08-25T04:04:00.402304+0000","last_became_active":"2023-08-25T04:03:58.379126+0000","last_became_peered":"2023-08-25T04:03:58.379126+0000","last_unstale":"2023-08-25T04:04:00.402304+0000","last_undegraded":"2023-08-25T04:04:00.402304+0000","last_fullsized":"2023-08-25T04:04:00.402304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:13:37.865822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.423971+0000","last_change":"2023-08-25T04:03:59.422459+0000","last_active":"2023-08-25T04:03:59.423971+0000","last_peered":"2023-08-25T04:03:59.423971+0000","last_clean":"2023-08-25T04:03:59.423971+0000","last_became_active":"2023-08-25T04:03:59.422050+0000","last_became_peered":"2023-08-25T04:03:59.422050+0000","last_unstale":"2023-08-25T04:03:59.423971+0000","last_undegraded":"2023-08-25T04:03:59.423971+0000","last_fullsized":"2023-08-25T04:03:59.423971+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:17:35.817866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.400966+0000","last_change":"2023-08-25T04:03:58.386703+0000","last_active":"2023-08-25T04:03:59.400966+0000","last_peered":"2023-08-25T04:03:59.400966+0000","last_clean":"2023-08-25T04:03:59.400966+0000","last_became_active":"2023-08-25T04:03:58.386432+0000","last_became_peered":"2023-08-25T04:03:58.386432+0000","last_unstale":"2023-08-25T04:03:59.400966+0000","last_undegraded":"2023-08-25T04:03:59.400966+0000","last_fullsized":"2023-08-25T04:03:59.400966+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:49.791778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402854+0000","last_change":"2023-08-25T04:03:59.395833+0000","last_active":"2023-08-25T04:04:00.402854+0000","last_peered":"2023-08-25T04:04:00.402854+0000","last_clean":"2023-08-25T04:04:00.402854+0000","last_became_active":"2023-08-25T04:03:59.395329+0000","last_became_peered":"2023-08-25T04:03:59.395329+0000","last_unstale":"2023-08-25T04:04:00.402854+0000","last_undegraded":"2023-08-25T04:04:00.402854+0000","last_fullsized":"2023-08-25T04:04:00.402854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:02:30.264838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410774+0000","last_change":"2023-08-25T04:03:58.376492+0000","last_active":"2023-08-25T04:03:59.410774+0000","last_peered":"2023-08-25T04:03:59.410774+0000","last_clean":"2023-08-25T04:03:59.410774+0000","last_became_active":"2023-08-25T04:03:58.375494+0000","last_became_peered":"2023-08-25T04:03:58.375494+0000","last_unstale":"2023-08-25T04:03:59.410774+0000","last_undegraded":"2023-08-25T04:03:59.410774+0000","last_fullsized":"2023-08-25T04:03:59.410774+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:06:00.526490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983068+0000","last_change":"2023-08-25T04:03:59.405903+0000","last_active":"2023-08-25T04:04:00.983068+0000","last_peered":"2023-08-25T04:04:00.983068+0000","last_clean":"2023-08-25T04:04:00.983068+0000","last_became_active":"2023-08-25T04:03:59.405466+0000","last_became_peered":"2023-08-25T04:03:59.405466+0000","last_unstale":"2023-08-25T04:04:00.983068+0000","last_undegraded":"2023-08-25T04:04:00.983068+0000","last_fullsized":"2023-08-25T04:04:00.983068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:35:34.878076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402698+0000","last_change":"2023-08-25T04:03:58.388087+0000","last_active":"2023-08-25T04:04:00.402698+0000","last_peered":"2023-08-25T04:04:00.402698+0000","last_clean":"2023-08-25T04:04:00.402698+0000","last_became_active":"2023-08-25T04:03:58.387747+0000","last_became_peered":"2023-08-25T04:03:58.387747+0000","last_unstale":"2023-08-25T04:04:00.402698+0000","last_undegraded":"2023-08-25T04:04:00.402698+0000","last_fullsized":"2023-08-25T04:04:00.402698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:17.322151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.404892+0000","last_change":"2023-08-25T04:03:59.402378+0000","last_active":"2023-08-25T04:03:59.404892+0000","last_peered":"2023-08-25T04:03:59.404892+0000","last_clean":"2023-08-25T04:03:59.404892+0000","last_became_active":"2023-08-25T04:03:59.402007+0000","last_became_peered":"2023-08-25T04:03:59.402007+0000","last_unstale":"2023-08-25T04:03:59.404892+0000","last_undegraded":"2023-08-25T04:03:59.404892+0000","last_fullsized":"2023-08-25T04:03:59.404892+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:14:06.833085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419370+0000","last_change":"2023-08-25T04:03:58.385258+0000","last_active":"2023-08-25T04:04:00.419370+0000","last_peered":"2023-08-25T04:04:00.419370+0000","last_clean":"2023-08-25T04:04:00.419370+0000","last_became_active":"2023-08-25T04:03:58.384991+0000","last_became_peered":"2023-08-25T04:03:58.384991+0000","last_unstale":"2023-08-25T04:04:00.419370+0000","last_undegraded":"2023-08-25T04:04:00.419370+0000","last_fullsized":"2023-08-25T04:04:00.419370+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:07:30.250928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419383+0000","last_change":"2023-08-25T04:03:59.414026+0000","last_active":"2023-08-25T04:04:00.419383+0000","last_peered":"2023-08-25T04:04:00.419383+0000","last_clean":"2023-08-25T04:04:00.419383+0000","last_became_active":"2023-08-25T04:03:59.413496+0000","last_became_peered":"2023-08-25T04:03:59.413496+0000","last_unstale":"2023-08-25T04:04:00.419383+0000","last_undegraded":"2023-08-25T04:04:00.419383+0000","last_fullsized":"2023-08-25T04:04:00.419383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:47.335245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.331865+0000","last_change":"2023-08-25T04:03:58.387667+0000","last_active":"2023-08-25T04:04:01.331865+0000","last_peered":"2023-08-25T04:04:01.331865+0000","last_clean":"2023-08-25T04:04:01.331865+0000","last_became_active":"2023-08-25T04:03:58.387352+0000","last_became_peered":"2023-08-25T04:03:58.387352+0000","last_unstale":"2023-08-25T04:04:01.331865+0000","last_undegraded":"2023-08-25T04:04:01.331865+0000","last_fullsized":"2023-08-25T04:04:01.331865+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:08:50.382544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402516+0000","last_change":"2023-08-25T04:03:59.417484+0000","last_active":"2023-08-25T04:04:00.402516+0000","last_peered":"2023-08-25T04:04:00.402516+0000","last_clean":"2023-08-25T04:04:00.402516+0000","last_became_active":"2023-08-25T04:03:59.417130+0000","last_became_peered":"2023-08-25T04:03:59.417130+0000","last_unstale":"2023-08-25T04:04:00.402516+0000","last_undegraded":"2023-08-25T04:04:00.402516+0000","last_fullsized":"2023-08-25T04:04:00.402516+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:23:20.399499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.389371+0000","last_change":"2023-08-25T04:03:58.384345+0000","last_active":"2023-08-25T04:03:59.389371+0000","last_peered":"2023-08-25T04:03:59.389371+0000","last_clean":"2023-08-25T04:03:59.389371+0000","last_became_active":"2023-08-25T04:03:58.384067+0000","last_became_peered":"2023-08-25T04:03:58.384067+0000","last_unstale":"2023-08-25T04:03:59.389371+0000","last_undegraded":"2023-08-25T04:03:59.389371+0000","last_fullsized":"2023-08-25T04:03:59.389371+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:47:45.627944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982797+0000","last_change":"2023-08-25T04:03:59.406474+0000","last_active":"2023-08-25T04:04:00.982797+0000","last_peered":"2023-08-25T04:04:00.982797+0000","last_clean":"2023-08-25T04:04:00.982797+0000","last_became_active":"2023-08-25T04:03:59.406133+0000","last_became_peered":"2023-08-25T04:03:59.406133+0000","last_unstale":"2023-08-25T04:04:00.982797+0000","last_undegraded":"2023-08-25T04:04:00.982797+0000","last_fullsized":"2023-08-25T04:04:00.982797+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:04:17.226276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401672+0000","last_change":"2023-08-25T04:03:58.380770+0000","last_active":"2023-08-25T04:04:00.401672+0000","last_peered":"2023-08-25T04:04:00.401672+0000","last_clean":"2023-08-25T04:04:00.401672+0000","last_became_active":"2023-08-25T04:03:58.380444+0000","last_became_peered":"2023-08-25T04:03:58.380444+0000","last_unstale":"2023-08-25T04:04:00.401672+0000","last_undegraded":"2023-08-25T04:04:00.401672+0000","last_fullsized":"2023-08-25T04:04:00.401672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:08:56.083693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401151+0000","last_change":"2023-08-25T04:03:59.400753+0000","last_active":"2023-08-25T04:04:00.401151+0000","last_peered":"2023-08-25T04:04:00.401151+0000","last_clean":"2023-08-25T04:04:00.401151+0000","last_became_active":"2023-08-25T04:03:59.400263+0000","last_became_peered":"2023-08-25T04:03:59.400263+0000","last_unstale":"2023-08-25T04:04:00.401151+0000","last_undegraded":"2023-08-25T04:04:00.401151+0000","last_fullsized":"2023-08-25T04:04:00.401151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:40:08.451848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983139+0000","last_change":"2023-08-25T04:03:58.389611+0000","last_active":"2023-08-25T04:04:00.983139+0000","last_peered":"2023-08-25T04:04:00.983139+0000","last_clean":"2023-08-25T04:04:00.983139+0000","last_became_active":"2023-08-25T04:03:58.389289+0000","last_became_peered":"2023-08-25T04:03:58.389289+0000","last_unstale":"2023-08-25T04:04:00.983139+0000","last_undegraded":"2023-08-25T04:04:00.983139+0000","last_fullsized":"2023-08-25T04:04:00.983139+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:58.251174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332374+0000","last_change":"2023-08-25T04:03:59.404413+0000","last_active":"2023-08-25T04:04:01.332374+0000","last_peered":"2023-08-25T04:04:01.332374+0000","last_clean":"2023-08-25T04:04:01.332374+0000","last_became_active":"2023-08-25T04:03:59.404111+0000","last_became_peered":"2023-08-25T04:03:59.404111+0000","last_unstale":"2023-08-25T04:04:01.332374+0000","last_undegraded":"2023-08-25T04:04:01.332374+0000","last_fullsized":"2023-08-25T04:04:01.332374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:22.381853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419820+0000","last_change":"2023-08-25T04:03:58.390364+0000","last_active":"2023-08-25T04:04:00.419820+0000","last_peered":"2023-08-25T04:04:00.419820+0000","last_clean":"2023-08-25T04:04:00.419820+0000","last_became_active":"2023-08-25T04:03:58.390106+0000","last_became_peered":"2023-08-25T04:03:58.390106+0000","last_unstale":"2023-08-25T04:04:00.419820+0000","last_undegraded":"2023-08-25T04:04:00.419820+0000","last_fullsized":"2023-08-25T04:04:00.419820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:23:19.387874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.403467+0000","last_change":"2023-08-25T04:03:59.400496+0000","last_active":"2023-08-25T04:03:59.403467+0000","last_peered":"2023-08-25T04:03:59.403467+0000","last_clean":"2023-08-25T04:03:59.403467+0000","last_became_active":"2023-08-25T04:03:59.400190+0000","last_became_peered":"2023-08-25T04:03:59.400190+0000","last_unstale":"2023-08-25T04:03:59.403467+0000","last_undegraded":"2023-08-25T04:03:59.403467+0000","last_fullsized":"2023-08-25T04:03:59.403467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:58:14.431223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419790+0000","last_change":"2023-08-25T04:03:58.386413+0000","last_active":"2023-08-25T04:04:00.419790+0000","last_peered":"2023-08-25T04:04:00.419790+0000","last_clean":"2023-08-25T04:04:00.419790+0000","last_became_active":"2023-08-25T04:03:58.385665+0000","last_became_peered":"2023-08-25T04:03:58.385665+0000","last_unstale":"2023-08-25T04:04:00.419790+0000","last_undegraded":"2023-08-25T04:04:00.419790+0000","last_fullsized":"2023-08-25T04:04:00.419790+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:43.279859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402931+0000","last_change":"2023-08-25T04:03:59.410573+0000","last_active":"2023-08-25T04:04:00.402931+0000","last_peered":"2023-08-25T04:04:00.402931+0000","last_clean":"2023-08-25T04:04:00.402931+0000","last_became_active":"2023-08-25T04:03:59.410265+0000","last_became_peered":"2023-08-25T04:03:59.410265+0000","last_unstale":"2023-08-25T04:04:00.402931+0000","last_undegraded":"2023-08-25T04:04:00.402931+0000","last_fullsized":"2023-08-25T04:04:00.402931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:23:45.964870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983052+0000","last_change":"2023-08-25T04:03:58.387790+0000","last_active":"2023-08-25T04:04:00.983052+0000","last_peered":"2023-08-25T04:04:00.983052+0000","last_clean":"2023-08-25T04:04:00.983052+0000","last_became_active":"2023-08-25T04:03:58.387517+0000","last_became_peered":"2023-08-25T04:03:58.387517+0000","last_unstale":"2023-08-25T04:04:00.983052+0000","last_undegraded":"2023-08-25T04:04:00.983052+0000","last_fullsized":"2023-08-25T04:04:00.983052+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:20.409272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.420670+0000","last_change":"2023-08-25T04:03:59.418006+0000","last_active":"2023-08-25T04:03:59.420670+0000","last_peered":"2023-08-25T04:03:59.420670+0000","last_clean":"2023-08-25T04:03:59.420670+0000","last_became_active":"2023-08-25T04:03:59.417698+0000","last_became_peered":"2023-08-25T04:03:59.417698+0000","last_unstale":"2023-08-25T04:03:59.420670+0000","last_undegraded":"2023-08-25T04:03:59.420670+0000","last_fullsized":"2023-08-25T04:03:59.420670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:44.450303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982988+0000","last_change":"2023-08-25T04:03:58.389761+0000","last_active":"2023-08-25T04:04:00.982988+0000","last_peered":"2023-08-25T04:04:00.982988+0000","last_clean":"2023-08-25T04:04:00.982988+0000","last_became_active":"2023-08-25T04:03:58.388403+0000","last_became_peered":"2023-08-25T04:03:58.388403+0000","last_unstale":"2023-08-25T04:04:00.982988+0000","last_undegraded":"2023-08-25T04:04:00.982988+0000","last_fullsized":"2023-08-25T04:04:00.982988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:44:53.006803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982613+0000","last_change":"2023-08-25T04:03:59.406135+0000","last_active":"2023-08-25T04:04:00.982613+0000","last_peered":"2023-08-25T04:04:00.982613+0000","last_clean":"2023-08-25T04:04:00.982613+0000","last_became_active":"2023-08-25T04:03:59.405815+0000","last_became_peered":"2023-08-25T04:03:59.405815+0000","last_unstale":"2023-08-25T04:04:00.982613+0000","last_undegraded":"2023-08-25T04:04:00.982613+0000","last_fullsized":"2023-08-25T04:04:00.982613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:04:29.975483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.388438+0000","last_change":"2023-08-25T04:03:58.385409+0000","last_active":"2023-08-25T04:03:59.388438+0000","last_peered":"2023-08-25T04:03:59.388438+0000","last_clean":"2023-08-25T04:03:59.388438+0000","last_became_active":"2023-08-25T04:03:58.385114+0000","last_became_peered":"2023-08-25T04:03:58.385114+0000","last_unstale":"2023-08-25T04:03:59.388438+0000","last_undegraded":"2023-08-25T04:03:59.388438+0000","last_fullsized":"2023-08-25T04:03:59.388438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:11:51.858524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.331884+0000","last_change":"2023-08-25T04:03:59.406096+0000","last_active":"2023-08-25T04:04:01.331884+0000","last_peered":"2023-08-25T04:04:01.331884+0000","last_clean":"2023-08-25T04:04:01.331884+0000","last_became_active":"2023-08-25T04:03:59.405160+0000","last_became_peered":"2023-08-25T04:03:59.405160+0000","last_unstale":"2023-08-25T04:04:01.331884+0000","last_undegraded":"2023-08-25T04:04:01.331884+0000","last_fullsized":"2023-08-25T04:04:01.331884+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:56:53.601262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401819+0000","last_change":"2023-08-25T04:03:58.380065+0000","last_active":"2023-08-25T04:04:00.401819+0000","last_peered":"2023-08-25T04:04:00.401819+0000","last_clean":"2023-08-25T04:04:00.401819+0000","last_became_active":"2023-08-25T04:03:58.379764+0000","last_became_peered":"2023-08-25T04:03:58.379764+0000","last_unstale":"2023-08-25T04:04:00.401819+0000","last_undegraded":"2023-08-25T04:04:00.401819+0000","last_fullsized":"2023-08-25T04:04:00.401819+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:28:16.964460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982718+0000","last_change":"2023-08-25T04:03:59.404648+0000","last_active":"2023-08-25T04:04:00.982718+0000","last_peered":"2023-08-25T04:04:00.982718+0000","last_clean":"2023-08-25T04:04:00.982718+0000","last_became_active":"2023-08-25T04:03:59.404224+0000","last_became_peered":"2023-08-25T04:03:59.404224+0000","last_unstale":"2023-08-25T04:04:00.982718+0000","last_undegraded":"2023-08-25T04:04:00.982718+0000","last_fullsized":"2023-08-25T04:04:00.982718+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:12:53.411199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.331738+0000","last_change":"2023-08-25T04:03:58.386551+0000","last_active":"2023-08-25T04:04:01.331738+0000","last_peered":"2023-08-25T04:04:01.331738+0000","last_clean":"2023-08-25T04:04:01.331738+0000","last_became_active":"2023-08-25T04:03:58.386285+0000","last_became_peered":"2023-08-25T04:03:58.386285+0000","last_unstale":"2023-08-25T04:04:01.331738+0000","last_undegraded":"2023-08-25T04:04:01.331738+0000","last_fullsized":"2023-08-25T04:04:01.331738+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:08:56.083693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982887+0000","last_change":"2023-08-25T04:03:59.402822+0000","last_active":"2023-08-25T04:04:00.982887+0000","last_peered":"2023-08-25T04:04:00.982887+0000","last_clean":"2023-08-25T04:04:00.982887+0000","last_became_active":"2023-08-25T04:03:59.402413+0000","last_became_peered":"2023-08-25T04:03:59.402413+0000","last_unstale":"2023-08-25T04:04:00.982887+0000","last_undegraded":"2023-08-25T04:04:00.982887+0000","last_fullsized":"2023-08-25T04:04:00.982887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:06.684416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419894+0000","last_change":"2023-08-25T04:03:58.389581+0000","last_active":"2023-08-25T04:04:00.419894+0000","last_peered":"2023-08-25T04:04:00.419894+0000","last_clean":"2023-08-25T04:04:00.419894+0000","last_became_active":"2023-08-25T04:03:58.388910+0000","last_became_peered":"2023-08-25T04:03:58.388910+0000","last_unstale":"2023-08-25T04:04:00.419894+0000","last_undegraded":"2023-08-25T04:04:00.419894+0000","last_fullsized":"2023-08-25T04:04:00.419894+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:31.771566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419619+0000","last_change":"2023-08-25T04:03:59.421526+0000","last_active":"2023-08-25T04:04:00.419619+0000","last_peered":"2023-08-25T04:04:00.419619+0000","last_clean":"2023-08-25T04:04:00.419619+0000","last_became_active":"2023-08-25T04:03:59.421169+0000","last_became_peered":"2023-08-25T04:03:59.421169+0000","last_unstale":"2023-08-25T04:04:00.419619+0000","last_undegraded":"2023-08-25T04:04:00.419619+0000","last_fullsized":"2023-08-25T04:04:00.419619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:56:53.601262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402892+0000","last_change":"2023-08-25T04:03:58.385498+0000","last_active":"2023-08-25T04:04:00.402892+0000","last_peered":"2023-08-25T04:04:00.402892+0000","last_clean":"2023-08-25T04:04:00.402892+0000","last_became_active":"2023-08-25T04:03:58.385215+0000","last_became_peered":"2023-08-25T04:03:58.385215+0000","last_unstale":"2023-08-25T04:04:00.402892+0000","last_undegraded":"2023-08-25T04:04:00.402892+0000","last_fullsized":"2023-08-25T04:04:00.402892+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:21.370228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402806+0000","last_change":"2023-08-25T04:03:59.410945+0000","last_active":"2023-08-25T04:04:00.402806+0000","last_peered":"2023-08-25T04:04:00.402806+0000","last_clean":"2023-08-25T04:04:00.402806+0000","last_became_active":"2023-08-25T04:03:59.410648+0000","last_became_peered":"2023-08-25T04:03:59.410648+0000","last_unstale":"2023-08-25T04:04:00.402806+0000","last_undegraded":"2023-08-25T04:04:00.402806+0000","last_fullsized":"2023-08-25T04:04:00.402806+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:39.793044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401201+0000","last_change":"2023-08-25T04:03:58.388839+0000","last_active":"2023-08-25T04:04:00.401201+0000","last_peered":"2023-08-25T04:04:00.401201+0000","last_clean":"2023-08-25T04:04:00.401201+0000","last_became_active":"2023-08-25T04:03:58.387292+0000","last_became_peered":"2023-08-25T04:03:58.387292+0000","last_unstale":"2023-08-25T04:04:00.401201+0000","last_undegraded":"2023-08-25T04:04:00.401201+0000","last_fullsized":"2023-08-25T04:04:00.401201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:17:38.350945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401251+0000","last_change":"2023-08-25T04:03:59.412433+0000","last_active":"2023-08-25T04:04:00.401251+0000","last_peered":"2023-08-25T04:04:00.401251+0000","last_clean":"2023-08-25T04:04:00.401251+0000","last_became_active":"2023-08-25T04:03:59.412124+0000","last_became_peered":"2023-08-25T04:03:59.412124+0000","last_unstale":"2023-08-25T04:04:00.401251+0000","last_undegraded":"2023-08-25T04:04:00.401251+0000","last_fullsized":"2023-08-25T04:04:00.401251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:39:52.127970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.394843+0000","last_change":"2023-08-25T04:03:58.375199+0000","last_active":"2023-08-25T04:03:59.394843+0000","last_peered":"2023-08-25T04:03:59.394843+0000","last_clean":"2023-08-25T04:03:59.394843+0000","last_became_active":"2023-08-25T04:03:58.374994+0000","last_became_peered":"2023-08-25T04:03:58.374994+0000","last_unstale":"2023-08-25T04:03:59.394843+0000","last_undegraded":"2023-08-25T04:03:59.394843+0000","last_fullsized":"2023-08-25T04:03:59.394843+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:10:41.181170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332245+0000","last_change":"2023-08-25T04:03:59.409092+0000","last_active":"2023-08-25T04:04:01.332245+0000","last_peered":"2023-08-25T04:04:01.332245+0000","last_clean":"2023-08-25T04:04:01.332245+0000","last_became_active":"2023-08-25T04:03:59.408723+0000","last_became_peered":"2023-08-25T04:03:59.408723+0000","last_unstale":"2023-08-25T04:04:01.332245+0000","last_undegraded":"2023-08-25T04:04:01.332245+0000","last_fullsized":"2023-08-25T04:04:01.332245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:18.333776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401003+0000","last_change":"2023-08-25T04:03:58.388343+0000","last_active":"2023-08-25T04:04:00.401003+0000","last_peered":"2023-08-25T04:04:00.401003+0000","last_clean":"2023-08-25T04:04:00.401003+0000","last_became_active":"2023-08-25T04:03:58.387241+0000","last_became_peered":"2023-08-25T04:03:58.387241+0000","last_unstale":"2023-08-25T04:04:00.401003+0000","last_undegraded":"2023-08-25T04:04:00.401003+0000","last_fullsized":"2023-08-25T04:04:00.401003+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:12:13.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.403432+0000","last_change":"2023-08-25T04:03:59.400416+0000","last_active":"2023-08-25T04:03:59.403432+0000","last_peered":"2023-08-25T04:03:59.403432+0000","last_clean":"2023-08-25T04:03:59.403432+0000","last_became_active":"2023-08-25T04:03:59.400094+0000","last_became_peered":"2023-08-25T04:03:59.400094+0000","last_unstale":"2023-08-25T04:03:59.403432+0000","last_undegraded":"2023-08-25T04:03:59.403432+0000","last_fullsized":"2023-08-25T04:03:59.403432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:38:49.403139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400938+0000","last_change":"2023-08-25T04:03:58.380520+0000","last_active":"2023-08-25T04:04:00.400938+0000","last_peered":"2023-08-25T04:04:00.400938+0000","last_clean":"2023-08-25T04:04:00.400938+0000","last_became_active":"2023-08-25T04:03:58.380215+0000","last_became_peered":"2023-08-25T04:03:58.380215+0000","last_unstale":"2023-08-25T04:04:00.400938+0000","last_undegraded":"2023-08-25T04:04:00.400938+0000","last_fullsized":"2023-08-25T04:04:00.400938+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:20:10.016494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419387+0000","last_change":"2023-08-25T04:03:59.418011+0000","last_active":"2023-08-25T04:04:00.419387+0000","last_peered":"2023-08-25T04:04:00.419387+0000","last_clean":"2023-08-25T04:04:00.419387+0000","last_became_active":"2023-08-25T04:03:59.416332+0000","last_became_peered":"2023-08-25T04:03:59.416332+0000","last_unstale":"2023-08-25T04:04:00.419387+0000","last_undegraded":"2023-08-25T04:04:00.419387+0000","last_fullsized":"2023-08-25T04:04:00.419387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:44:01.894126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332098+0000","last_change":"2023-08-25T04:03:58.387286+0000","last_active":"2023-08-25T04:04:01.332098+0000","last_peered":"2023-08-25T04:04:01.332098+0000","last_clean":"2023-08-25T04:04:01.332098+0000","last_became_active":"2023-08-25T04:03:58.386957+0000","last_became_peered":"2023-08-25T04:03:58.386957+0000","last_unstale":"2023-08-25T04:04:01.332098+0000","last_undegraded":"2023-08-25T04:04:01.332098+0000","last_fullsized":"2023-08-25T04:04:01.332098+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:23:19.387874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982896+0000","last_change":"2023-08-25T04:03:59.406384+0000","last_active":"2023-08-25T04:04:00.982896+0000","last_peered":"2023-08-25T04:04:00.982896+0000","last_clean":"2023-08-25T04:04:00.982896+0000","last_became_active":"2023-08-25T04:03:59.405851+0000","last_became_peered":"2023-08-25T04:03:59.405851+0000","last_unstale":"2023-08-25T04:04:00.982896+0000","last_undegraded":"2023-08-25T04:04:00.982896+0000","last_fullsized":"2023-08-25T04:04:00.982896+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:40.592468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400806+0000","last_change":"2023-08-25T04:03:58.387617+0000","last_active":"2023-08-25T04:04:00.400806+0000","last_peered":"2023-08-25T04:04:00.400806+0000","last_clean":"2023-08-25T04:04:00.400806+0000","last_became_active":"2023-08-25T04:03:58.387256+0000","last_became_peered":"2023-08-25T04:03:58.387256+0000","last_unstale":"2023-08-25T04:04:00.400806+0000","last_undegraded":"2023-08-25T04:04:00.400806+0000","last_fullsized":"2023-08-25T04:04:00.400806+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:32:58.744009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419752+0000","last_change":"2023-08-25T04:03:59.418440+0000","last_active":"2023-08-25T04:04:00.419752+0000","last_peered":"2023-08-25T04:04:00.419752+0000","last_clean":"2023-08-25T04:04:00.419752+0000","last_became_active":"2023-08-25T04:03:59.418264+0000","last_became_peered":"2023-08-25T04:03:59.418264+0000","last_unstale":"2023-08-25T04:04:00.419752+0000","last_undegraded":"2023-08-25T04:04:00.419752+0000","last_fullsized":"2023-08-25T04:04:00.419752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:52.932778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332144+0000","last_change":"2023-08-25T04:03:58.391746+0000","last_active":"2023-08-25T04:04:01.332144+0000","last_peered":"2023-08-25T04:04:01.332144+0000","last_clean":"2023-08-25T04:04:01.332144+0000","last_became_active":"2023-08-25T04:03:58.391487+0000","last_became_peered":"2023-08-25T04:03:58.391487+0000","last_unstale":"2023-08-25T04:04:01.332144+0000","last_undegraded":"2023-08-25T04:04:01.332144+0000","last_fullsized":"2023-08-25T04:04:01.332144+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:38.781419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332315+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:04:01.332315+0000","last_peered":"2023-08-25T04:04:01.332315+0000","last_clean":"2023-08-25T04:04:01.332315+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:04:01.332315+0000","last_undegraded":"2023-08-25T04:04:01.332315+0000","last_fullsized":"2023-08-25T04:04:01.332315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:22:35.212795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419570+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:04:00.419570+0000","last_peered":"2023-08-25T04:04:00.419570+0000","last_clean":"2023-08-25T04:04:00.419570+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:04:00.419570+0000","last_undegraded":"2023-08-25T04:04:00.419570+0000","last_fullsized":"2023-08-25T04:04:00.419570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:45:20.387820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.420791+0000","last_change":"2023-08-25T04:03:59.419512+0000","last_active":"2023-08-25T04:03:59.420791+0000","last_peered":"2023-08-25T04:03:59.420791+0000","last_clean":"2023-08-25T04:03:59.420791+0000","last_became_active":"2023-08-25T04:03:59.419143+0000","last_became_peered":"2023-08-25T04:03:59.419143+0000","last_unstale":"2023-08-25T04:03:59.420791+0000","last_undegraded":"2023-08-25T04:03:59.420791+0000","last_fullsized":"2023-08-25T04:03:59.420791+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:08:08.686296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419946+0000","last_change":"2023-08-25T04:03:58.389811+0000","last_active":"2023-08-25T04:04:00.419946+0000","last_peered":"2023-08-25T04:04:00.419946+0000","last_clean":"2023-08-25T04:04:00.419946+0000","last_became_active":"2023-08-25T04:03:58.389274+0000","last_became_peered":"2023-08-25T04:03:58.389274+0000","last_unstale":"2023-08-25T04:04:00.419946+0000","last_undegraded":"2023-08-25T04:04:00.419946+0000","last_fullsized":"2023-08-25T04:04:00.419946+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:17.322151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.331956+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:04:01.331956+0000","last_peered":"2023-08-25T04:04:01.331956+0000","last_clean":"2023-08-25T04:04:01.331956+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:04:01.331956+0000","last_undegraded":"2023-08-25T04:04:01.331956+0000","last_fullsized":"2023-08-25T04:04:01.331956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:57:29.063884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332438+0000","last_change":"2023-08-25T04:03:59.405843+0000","last_active":"2023-08-25T04:04:01.332438+0000","last_peered":"2023-08-25T04:04:01.332438+0000","last_clean":"2023-08-25T04:04:01.332438+0000","last_became_active":"2023-08-25T04:03:59.405403+0000","last_became_peered":"2023-08-25T04:03:59.405403+0000","last_unstale":"2023-08-25T04:04:01.332438+0000","last_undegraded":"2023-08-25T04:04:01.332438+0000","last_fullsized":"2023-08-25T04:04:01.332438+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:39:23.658027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401201+0000","last_change":"2023-08-25T04:03:58.386244+0000","last_active":"2023-08-25T04:04:00.401201+0000","last_peered":"2023-08-25T04:04:00.401201+0000","last_clean":"2023-08-25T04:04:00.401201+0000","last_became_active":"2023-08-25T04:03:58.385936+0000","last_became_peered":"2023-08-25T04:03:58.385936+0000","last_unstale":"2023-08-25T04:04:00.401201+0000","last_undegraded":"2023-08-25T04:04:00.401201+0000","last_fullsized":"2023-08-25T04:04:00.401201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:40:13.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400848+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:04:00.400848+0000","last_peered":"2023-08-25T04:04:00.400848+0000","last_clean":"2023-08-25T04:04:00.400848+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:04:00.400848+0000","last_undegraded":"2023-08-25T04:04:00.400848+0000","last_fullsized":"2023-08-25T04:04:00.400848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:49.545600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982987+0000","last_change":"2023-08-25T04:03:59.397271+0000","last_active":"2023-08-25T04:04:00.982987+0000","last_peered":"2023-08-25T04:04:00.982987+0000","last_clean":"2023-08-25T04:04:00.982987+0000","last_became_active":"2023-08-25T04:03:59.396948+0000","last_became_peered":"2023-08-25T04:03:59.396948+0000","last_unstale":"2023-08-25T04:04:00.982987+0000","last_undegraded":"2023-08-25T04:04:00.982987+0000","last_fullsized":"2023-08-25T04:04:00.982987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:11:44.609170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.390471+0000","last_change":"2023-08-25T04:03:58.382342+0000","last_active":"2023-08-25T04:03:59.390471+0000","last_peered":"2023-08-25T04:03:59.390471+0000","last_clean":"2023-08-25T04:03:59.390471+0000","last_became_active":"2023-08-25T04:03:58.382068+0000","last_became_peered":"2023-08-25T04:03:58.382068+0000","last_unstale":"2023-08-25T04:03:59.390471+0000","last_undegraded":"2023-08-25T04:03:59.390471+0000","last_fullsized":"2023-08-25T04:03:59.390471+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:18:16.177809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419423+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:04:00.419423+0000","last_peered":"2023-08-25T04:04:00.419423+0000","last_clean":"2023-08-25T04:04:00.419423+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:04:00.419423+0000","last_undegraded":"2023-08-25T04:04:00.419423+0000","last_fullsized":"2023-08-25T04:04:00.419423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:44:08.796401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410272+0000","last_change":"2023-08-25T04:03:59.408317+0000","last_active":"2023-08-25T04:03:59.410272+0000","last_peered":"2023-08-25T04:03:59.410272+0000","last_clean":"2023-08-25T04:03:59.410272+0000","last_became_active":"2023-08-25T04:03:59.408091+0000","last_became_peered":"2023-08-25T04:03:59.408091+0000","last_unstale":"2023-08-25T04:03:59.410272+0000","last_undegraded":"2023-08-25T04:03:59.410272+0000","last_fullsized":"2023-08-25T04:03:59.410272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:27:40.842846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.391080+0000","last_change":"2023-08-25T04:03:58.384133+0000","last_active":"2023-08-25T04:03:59.391080+0000","last_peered":"2023-08-25T04:03:59.391080+0000","last_clean":"2023-08-25T04:03:59.391080+0000","last_became_active":"2023-08-25T04:03:58.383821+0000","last_became_peered":"2023-08-25T04:03:58.383821+0000","last_unstale":"2023-08-25T04:03:59.391080+0000","last_undegraded":"2023-08-25T04:03:59.391080+0000","last_fullsized":"2023-08-25T04:03:59.391080+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:22:33.037133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.394919+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:03:59.394919+0000","last_peered":"2023-08-25T04:03:59.394919+0000","last_clean":"2023-08-25T04:03:59.394919+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:03:59.394919+0000","last_undegraded":"2023-08-25T04:03:59.394919+0000","last_fullsized":"2023-08-25T04:03:59.394919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:08:13.548315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410403+0000","last_change":"2023-08-25T04:03:59.402065+0000","last_active":"2023-08-25T04:03:59.410403+0000","last_peered":"2023-08-25T04:03:59.410403+0000","last_clean":"2023-08-25T04:03:59.410403+0000","last_became_active":"2023-08-25T04:03:59.401800+0000","last_became_peered":"2023-08-25T04:03:59.401800+0000","last_unstale":"2023-08-25T04:03:59.410403+0000","last_undegraded":"2023-08-25T04:03:59.410403+0000","last_fullsized":"2023-08-25T04:03:59.410403+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:00:55.769641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401955+0000","last_change":"2023-08-25T04:03:58.382420+0000","last_active":"2023-08-25T04:04:00.401955+0000","last_peered":"2023-08-25T04:04:00.401955+0000","last_clean":"2023-08-25T04:04:00.401955+0000","last_became_active":"2023-08-25T04:03:58.382101+0000","last_became_peered":"2023-08-25T04:03:58.382101+0000","last_unstale":"2023-08-25T04:04:00.401955+0000","last_undegraded":"2023-08-25T04:04:00.401955+0000","last_fullsized":"2023-08-25T04:04:00.401955+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:53:04.164317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332474+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:04:01.332474+0000","last_peered":"2023-08-25T04:04:01.332474+0000","last_clean":"2023-08-25T04:04:01.332474+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:04:01.332474+0000","last_undegraded":"2023-08-25T04:04:01.332474+0000","last_fullsized":"2023-08-25T04:04:01.332474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:23.908663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402389+0000","last_change":"2023-08-25T04:03:59.409061+0000","last_active":"2023-08-25T04:04:00.402389+0000","last_peered":"2023-08-25T04:04:00.402389+0000","last_clean":"2023-08-25T04:04:00.402389+0000","last_became_active":"2023-08-25T04:03:59.408631+0000","last_became_peered":"2023-08-25T04:03:59.408631+0000","last_unstale":"2023-08-25T04:04:00.402389+0000","last_undegraded":"2023-08-25T04:04:00.402389+0000","last_fullsized":"2023-08-25T04:04:00.402389+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:44.291484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401697+0000","last_change":"2023-08-25T04:03:58.388711+0000","last_active":"2023-08-25T04:04:00.401697+0000","last_peered":"2023-08-25T04:04:00.401697+0000","last_clean":"2023-08-25T04:04:00.401697+0000","last_became_active":"2023-08-25T04:03:58.388399+0000","last_became_peered":"2023-08-25T04:03:58.388399+0000","last_unstale":"2023-08-25T04:04:00.401697+0000","last_undegraded":"2023-08-25T04:04:00.401697+0000","last_fullsized":"2023-08-25T04:04:00.401697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:51.921153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.390607+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:03:59.390607+0000","last_peered":"2023-08-25T04:03:59.390607+0000","last_clean":"2023-08-25T04:03:59.390607+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:03:59.390607+0000","last_undegraded":"2023-08-25T04:03:59.390607+0000","last_fullsized":"2023-08-25T04:03:59.390607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:13:19.148757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332311+0000","last_change":"2023-08-25T04:03:59.407013+0000","last_active":"2023-08-25T04:04:01.332311+0000","last_peered":"2023-08-25T04:04:01.332311+0000","last_clean":"2023-08-25T04:04:01.332311+0000","last_became_active":"2023-08-25T04:03:59.404840+0000","last_became_peered":"2023-08-25T04:03:59.404840+0000","last_unstale":"2023-08-25T04:04:01.332311+0000","last_undegraded":"2023-08-25T04:04:01.332311+0000","last_fullsized":"2023-08-25T04:04:01.332311+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:02:30.264838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982644+0000","last_change":"2023-08-25T04:03:58.389799+0000","last_active":"2023-08-25T04:04:00.982644+0000","last_peered":"2023-08-25T04:04:00.982644+0000","last_clean":"2023-08-25T04:04:00.982644+0000","last_became_active":"2023-08-25T04:03:58.389277+0000","last_became_peered":"2023-08-25T04:03:58.389277+0000","last_unstale":"2023-08-25T04:04:00.982644+0000","last_undegraded":"2023-08-25T04:04:00.982644+0000","last_fullsized":"2023-08-25T04:04:00.982644+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:03:31.104737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402340+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:04:00.402340+0000","last_peered":"2023-08-25T04:04:00.402340+0000","last_clean":"2023-08-25T04:04:00.402340+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:04:00.402340+0000","last_undegraded":"2023-08-25T04:04:00.402340+0000","last_fullsized":"2023-08-25T04:04:00.402340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:45:35.784220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1036288,"data_stored":769649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.71099999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.79000000000000004}]},{"osd":4,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.89600000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.61799999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64200000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":430080,"data_stored":178181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.628}]},{"osd":1,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.54500000000000004}]},{"osd":2,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.68200000000000005}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.78600000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.73499999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.83499999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":434176,"data_stored":177711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.754}]},{"osd":3,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.69799999999999995}]},{"osd":4,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.71599999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.85799999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.84799999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":434176,"data_stored":178203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.69299999999999995}]},{"osd":1,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.75900000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.78600000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.628},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.745}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":179245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53200000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.1359999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.0269999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.0700000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.90100000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":177669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.435}]},{"osd":4,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.54200000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.66200000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.57599999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":417792,"data_stored":171036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.308},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.433}]},{"osd":2,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.77400000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1011712,"data_stored":761348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.43099999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.749},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.79600000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.66000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:04:08.081 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:04:08.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.234+0000 7f0f5b503640 1 Processor -- start 2023-08-25T04:04:08.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.234+0000 7f0f5b503640 1 -- start start 2023-08-25T04:04:08.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.234+0000 7f0f5b503640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f540cdde0 0x7f0f540ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:08.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.234+0000 7f0f5b503640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0f540b2e40 0x7f0f540b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:08.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.234+0000 7f0f5b503640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f540b29b0 con 0x7f0f540d0da0 2023-08-25T04:04:08.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.234+0000 7f0f5b503640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f540ce760 con 0x7f0f540b2e40 2023-08-25T04:04:08.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.234+0000 7f0f5b503640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540b1dc0 con 0x7f0f540cdde0 2023-08-25T04:04:08.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.234+0000 7f0f5929f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0f540d0da0 0x7f0f540d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46538/0 (socket says 172.21.15.55:46538) 2023-08-25T04:04:08.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.234+0000 7f0f5929f640 1 -- 172.21.15.55:0/3768238104 learned_addr learned my addr 172.21.15.55:0/3768238104 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:08.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.234+0000 7f0f58a9e640 1 --2- 172.21.15.55:0/3768238104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f540cdde0 0x7f0f540ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:08.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.234+0000 7f0f59aa0640 1 --2- 172.21.15.55:0/3768238104 >> v2:172.21.15.110:3300/0 conn(0x7f0f540b2e40 0x7f0f540b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.234+0000 7f0f4bfff640 1 -- 172.21.15.55:0/3768238104 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1715711682 0 0) 0x7f0f540b29b0 con 0x7f0f540d0da0 2023-08-25T04:04:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.234+0000 7f0f4bfff640 1 -- 172.21.15.55:0/3768238104 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f40003530 con 0x7f0f540d0da0 2023-08-25T04:04:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.234+0000 7f0f58a9e640 1 -- 172.21.15.55:0/3768238104 >> v2:172.21.15.110:3300/0 conn(0x7f0f540b2e40 msgr2=0x7f0f540b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.234+0000 7f0f58a9e640 1 --2- 172.21.15.55:0/3768238104 >> v2:172.21.15.110:3300/0 conn(0x7f0f540b2e40 0x7f0f540b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.234+0000 7f0f58a9e640 1 -- 172.21.15.55:0/3768238104 >> v1:172.21.15.55:6789/0 conn(0x7f0f540d0da0 legacy=0x7f0f540d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:08.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.234+0000 7f0f58a9e640 1 -- 172.21.15.55:0/3768238104 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f540b2080 con 0x7f0f540cdde0 2023-08-25T04:04:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.234+0000 7f0f59aa0640 1 --2- 172.21.15.55:0/3768238104 >> v2:172.21.15.110:3300/0 conn(0x7f0f540b2e40 0x7f0f540b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:04:08.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.238+0000 7f0f58a9e640 1 --2- 172.21.15.55:0/3768238104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f540cdde0 0x7f0f540ce220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f440097c0 tx=0x7f0f4401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7b5589b46c5a705 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.238+0000 7f0f4bfff640 1 -- 172.21.15.55:0/3768238104 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f440a8970 con 0x7f0f540cdde0 2023-08-25T04:04:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.238+0000 7f0f4bfff640 1 -- 172.21.15.55:0/3768238104 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f440a8ad0 con 0x7f0f540cdde0 2023-08-25T04:04:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.238+0000 7f0f4bfff640 1 -- 172.21.15.55:0/3768238104 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f440a8e60 con 0x7f0f540cdde0 2023-08-25T04:04:08.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.238+0000 7f0f5b503640 1 -- 172.21.15.55:0/3768238104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f540cdde0 msgr2=0x7f0f540ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:08.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.238+0000 7f0f5b503640 1 --2- 172.21.15.55:0/3768238104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f540cdde0 0x7f0f540ce220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0f440097c0 tx=0x7f0f4401ec70 comp rx=0 tx=0).stop 2023-08-25T04:04:08.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.238+0000 7f0f5b503640 1 -- 172.21.15.55:0/3768238104 shutdown_connections 2023-08-25T04:04:08.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.238+0000 7f0f5b503640 1 --2- 172.21.15.55:0/3768238104 >> v2:172.21.15.110:3300/0 conn(0x7f0f540b2e40 0x7f0f540b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:08.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.238+0000 7f0f5b503640 1 --2- 172.21.15.55:0/3768238104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f540cdde0 0x7f0f540ce220 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:08.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.238+0000 7f0f5b503640 1 -- 172.21.15.55:0/3768238104 >> 172.21.15.55:0/3768238104 conn(0x7f0f5409bae0 msgr2=0x7f0f540d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:08.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.238+0000 7f0f5b503640 1 -- 172.21.15.55:0/3768238104 shutdown_connections 2023-08-25T04:04:08.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.238+0000 7f0f5b503640 1 -- 172.21.15.55:0/3768238104 wait complete. 2023-08-25T04:04:08.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f5b503640 1 Processor -- start 2023-08-25T04:04:08.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f5b503640 1 -- start start 2023-08-25T04:04:08.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f5b503640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f540b2e40 0x7f0f541f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:08.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f5b503640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f540cdde0 0x7f0f54150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:08.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f5b503640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f540d0da0 0x7f0f540cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:08.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f5b503640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f541f3030 con 0x7f0f540d0da0 2023-08-25T04:04:08.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f5b503640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540ca8e0 con 0x7f0f540b2e40 2023-08-25T04:04:08.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f5b503640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540cabc0 con 0x7f0f540cdde0 2023-08-25T04:04:08.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f59aa0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f540d0da0 0x7f0f540cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:08.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f59aa0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f540d0da0 0x7f0f540cbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39570/0 (socket says 172.21.15.55:39570) 2023-08-25T04:04:08.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f59aa0640 1 -- 172.21.15.55:0/840275724 learned_addr learned my addr 172.21.15.55:0/840275724 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:08.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f5929f640 1 --2- 172.21.15.55:0/840275724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f540b2e40 0x7f0f541f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:08.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f58a9e640 1 --2- 172.21.15.55:0/840275724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f540cdde0 0x7f0f54150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:08.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f59aa0640 1 -- 172.21.15.55:0/840275724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f540cdde0 msgr2=0x7f0f54150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:08.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f59aa0640 1 --2- 172.21.15.55:0/840275724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f540cdde0 0x7f0f54150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:08.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f59aa0640 1 -- 172.21.15.55:0/840275724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f540b2e40 msgr2=0x7f0f541f2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:08.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f59aa0640 1 --2- 172.21.15.55:0/840275724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f540b2e40 0x7f0f541f2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:08.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f59aa0640 1 -- 172.21.15.55:0/840275724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c009a70 con 0x7f0f540d0da0 2023-08-25T04:04:08.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f59aa0640 1 --2- 172.21.15.55:0/840275724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f540d0da0 0x7f0f540cbc60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00efc0 tx=0x7f0f4c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:08.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f49ffb640 1 -- 172.21.15.55:0/840275724 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c009cd0 con 0x7f0f540d0da0 2023-08-25T04:04:08.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f49ffb640 1 -- 172.21.15.55:0/840275724 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c00f040 con 0x7f0f540d0da0 2023-08-25T04:04:08.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f49ffb640 1 -- 172.21.15.55:0/840275724 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c0039a0 con 0x7f0f540d0da0 2023-08-25T04:04:08.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f5b503640 1 -- 172.21.15.55:0/840275724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f44009420 con 0x7f0f540d0da0 2023-08-25T04:04:08.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.242+0000 7f0f5b503640 1 -- 172.21.15.55:0/840275724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f540cb180 con 0x7f0f540d0da0 2023-08-25T04:04:08.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.246+0000 7f0f5b503640 1 -- 172.21.15.55:0/840275724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5404dbe0 con 0x7f0f540d0da0 2023-08-25T04:04:08.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.246+0000 7f0f49ffb640 1 -- 172.21.15.55:0/840275724 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0f4c014480 con 0x7f0f540d0da0 2023-08-25T04:04:08.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.246+0000 7f0f49ffb640 1 --2- 172.21.15.55:0/840275724 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0f38065680 0x7f0f38067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:08.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.246+0000 7f0f49ffb640 1 -- 172.21.15.55:0/840275724 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f4c083930 con 0x7f0f540d0da0 2023-08-25T04:04:08.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.246+0000 7f0f5929f640 1 --2- 172.21.15.55:0/840275724 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0f38065680 0x7f0f38067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:08.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.246+0000 7f0f5929f640 1 --2- 172.21.15.55:0/840275724 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0f38065680 0x7f0f38067b40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0f50001370 tx=0x7f0f50009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:08.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.250+0000 7f0f49ffb640 1 -- 172.21.15.55:0/840275724 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0f4c054e90 con 0x7f0f540d0da0 2023-08-25T04:04:08.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.402+0000 7f0f5b503640 1 -- 172.21.15.55:0/840275724 --> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0f540b2640 con 0x7f0f38065680 2023-08-25T04:04:08.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.410+0000 7f0f49ffb640 1 -- 172.21.15.55:0/840275724 <== mgr.4102 v2:172.21.15.110:6832/413962747 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311102 (secure 0 0 0) 0x7f0f50007e60 con 0x7f0f38065680 2023-08-25T04:04:08.417 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:04:08.419 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:04:08.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.414+0000 7f0f5b503640 1 -- 172.21.15.55:0/840275724 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0f38065680 msgr2=0x7f0f38067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:08.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.414+0000 7f0f5b503640 1 --2- 172.21.15.55:0/840275724 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0f38065680 0x7f0f38067b40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0f50001370 tx=0x7f0f50009040 comp rx=0 tx=0).stop 2023-08-25T04:04:08.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.414+0000 7f0f5b503640 1 -- 172.21.15.55:0/840275724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f540d0da0 msgr2=0x7f0f540cbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:08.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.414+0000 7f0f5b503640 1 --2- 172.21.15.55:0/840275724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f540d0da0 0x7f0f540cbc60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00efc0 tx=0x7f0f4c00c490 comp rx=0 tx=0).stop 2023-08-25T04:04:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.414+0000 7f0f5b503640 1 -- 172.21.15.55:0/840275724 shutdown_connections 2023-08-25T04:04:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.414+0000 7f0f5b503640 1 --2- 172.21.15.55:0/840275724 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f0f38065680 0x7f0f38067b40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.414+0000 7f0f5b503640 1 --2- 172.21.15.55:0/840275724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f540d0da0 0x7f0f540cbc60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.414+0000 7f0f5b503640 1 --2- 172.21.15.55:0/840275724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f540cdde0 0x7f0f54150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.414+0000 7f0f5b503640 1 --2- 172.21.15.55:0/840275724 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f540b2e40 0x7f0f541f2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.414+0000 7f0f5b503640 1 -- 172.21.15.55:0/840275724 >> 172.21.15.55:0/840275724 conn(0x7f0f5409bae0 msgr2=0x7f0f5415be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:08.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.414+0000 7f0f5b503640 1 -- 172.21.15.55:0/840275724 shutdown_connections 2023-08-25T04:04:08.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.414+0000 7f0f5b503640 1 -- 172.21.15.55:0/840275724 wait complete. 2023-08-25T04:04:08.437 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-08-25T04:04:06.620061+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249832,"kb_used_data":4528,"kb_used_omap":13,"kb_used_meta":245170,"kb_avail":754724888,"statfs":{"total":773094113280,"available":772838285312,"internally_reserved":0,"allocated":4636672,"data_stored":2593042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":251054168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001882"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983113+0000","last_change":"2023-08-25T04:03:59.406557+0000","last_active":"2023-08-25T04:04:00.983113+0000","last_peered":"2023-08-25T04:04:00.983113+0000","last_clean":"2023-08-25T04:04:00.983113+0000","last_became_active":"2023-08-25T04:03:59.406203+0000","last_became_peered":"2023-08-25T04:03:59.406203+0000","last_unstale":"2023-08-25T04:04:00.983113+0000","last_undegraded":"2023-08-25T04:04:00.983113+0000","last_fullsized":"2023-08-25T04:04:00.983113+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:24:08.841451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982922+0000","last_change":"2023-08-25T04:03:59.405679+0000","last_active":"2023-08-25T04:04:00.982922+0000","last_peered":"2023-08-25T04:04:00.982922+0000","last_clean":"2023-08-25T04:04:00.982922+0000","last_became_active":"2023-08-25T04:03:59.405378+0000","last_became_peered":"2023-08-25T04:03:59.405378+0000","last_unstale":"2023-08-25T04:04:00.982922+0000","last_undegraded":"2023-08-25T04:04:00.982922+0000","last_fullsized":"2023-08-25T04:04:00.982922+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:38.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.423571+0000","last_change":"2023-08-25T04:03:59.422508+0000","last_active":"2023-08-25T04:03:59.423571+0000","last_peered":"2023-08-25T04:03:59.423571+0000","last_clean":"2023-08-25T04:03:59.423571+0000","last_became_active":"2023-08-25T04:03:59.422191+0000","last_became_peered":"2023-08-25T04:03:59.422191+0000","last_unstale":"2023-08-25T04:03:59.423571+0000","last_undegraded":"2023-08-25T04:03:59.423571+0000","last_fullsized":"2023-08-25T04:03:59.423571+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:13:22.438164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401269+0000","last_change":"2023-08-25T04:03:59.400540+0000","last_active":"2023-08-25T04:04:00.401269+0000","last_peered":"2023-08-25T04:04:00.401269+0000","last_clean":"2023-08-25T04:04:00.401269+0000","last_became_active":"2023-08-25T04:03:59.399951+0000","last_became_peered":"2023-08-25T04:03:59.399951+0000","last_unstale":"2023-08-25T04:04:00.401269+0000","last_undegraded":"2023-08-25T04:04:00.401269+0000","last_fullsized":"2023-08-25T04:04:00.401269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:27:39.558644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400972+0000","last_change":"2023-08-25T04:03:59.401446+0000","last_active":"2023-08-25T04:04:00.400972+0000","last_peered":"2023-08-25T04:04:00.400972+0000","last_clean":"2023-08-25T04:04:00.400972+0000","last_became_active":"2023-08-25T04:03:59.401196+0000","last_became_peered":"2023-08-25T04:03:59.401196+0000","last_unstale":"2023-08-25T04:04:00.400972+0000","last_undegraded":"2023-08-25T04:04:00.400972+0000","last_fullsized":"2023-08-25T04:04:00.400972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:56:27.953788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410797+0000","last_change":"2023-08-25T04:03:59.409377+0000","last_active":"2023-08-25T04:03:59.410797+0000","last_peered":"2023-08-25T04:03:59.410797+0000","last_clean":"2023-08-25T04:03:59.410797+0000","last_became_active":"2023-08-25T04:03:59.403715+0000","last_became_peered":"2023-08-25T04:03:59.403715+0000","last_unstale":"2023-08-25T04:03:59.410797+0000","last_undegraded":"2023-08-25T04:03:59.410797+0000","last_fullsized":"2023-08-25T04:03:59.410797+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:14.765621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419238+0000","last_change":"2023-08-25T04:03:59.415058+0000","last_active":"2023-08-25T04:04:00.419238+0000","last_peered":"2023-08-25T04:04:00.419238+0000","last_clean":"2023-08-25T04:04:00.419238+0000","last_became_active":"2023-08-25T04:03:59.414723+0000","last_became_peered":"2023-08-25T04:03:59.414723+0000","last_unstale":"2023-08-25T04:04:00.419238+0000","last_undegraded":"2023-08-25T04:04:00.419238+0000","last_fullsized":"2023-08-25T04:04:00.419238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:34:37.814493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982607+0000","last_change":"2023-08-25T04:03:59.423164+0000","last_active":"2023-08-25T04:04:00.982607+0000","last_peered":"2023-08-25T04:04:00.982607+0000","last_clean":"2023-08-25T04:04:00.982607+0000","last_became_active":"2023-08-25T04:03:59.422861+0000","last_became_peered":"2023-08-25T04:03:59.422861+0000","last_unstale":"2023-08-25T04:04:00.982607+0000","last_undegraded":"2023-08-25T04:04:00.982607+0000","last_fullsized":"2023-08-25T04:04:00.982607+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:51:20.329496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.421133+0000","last_change":"2023-08-25T04:03:59.420041+0000","last_active":"2023-08-25T04:03:59.421133+0000","last_peered":"2023-08-25T04:03:59.421133+0000","last_clean":"2023-08-25T04:03:59.421133+0000","last_became_active":"2023-08-25T04:03:59.419589+0000","last_became_peered":"2023-08-25T04:03:59.419589+0000","last_unstale":"2023-08-25T04:03:59.421133+0000","last_undegraded":"2023-08-25T04:03:59.421133+0000","last_fullsized":"2023-08-25T04:03:59.421133+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:05.539349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419590+0000","last_change":"2023-08-25T04:03:59.417854+0000","last_active":"2023-08-25T04:04:00.419590+0000","last_peered":"2023-08-25T04:04:00.419590+0000","last_clean":"2023-08-25T04:04:00.419590+0000","last_became_active":"2023-08-25T04:03:59.416366+0000","last_became_peered":"2023-08-25T04:03:59.416366+0000","last_unstale":"2023-08-25T04:04:00.419590+0000","last_undegraded":"2023-08-25T04:04:00.419590+0000","last_fullsized":"2023-08-25T04:04:00.419590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:20:23.025472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419740+0000","last_change":"2023-08-25T04:03:59.421543+0000","last_active":"2023-08-25T04:04:00.419740+0000","last_peered":"2023-08-25T04:04:00.419740+0000","last_clean":"2023-08-25T04:04:00.419740+0000","last_became_active":"2023-08-25T04:03:59.421202+0000","last_became_peered":"2023-08-25T04:03:59.421202+0000","last_unstale":"2023-08-25T04:04:00.419740+0000","last_undegraded":"2023-08-25T04:04:00.419740+0000","last_fullsized":"2023-08-25T04:04:00.419740+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:08:57.095318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.416141+0000","last_change":"2023-08-25T04:03:59.414096+0000","last_active":"2023-08-25T04:03:59.416141+0000","last_peered":"2023-08-25T04:03:59.416141+0000","last_clean":"2023-08-25T04:03:59.416141+0000","last_became_active":"2023-08-25T04:03:59.413799+0000","last_became_peered":"2023-08-25T04:03:59.413799+0000","last_unstale":"2023-08-25T04:03:59.416141+0000","last_undegraded":"2023-08-25T04:03:59.416141+0000","last_fullsized":"2023-08-25T04:03:59.416141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:05:09.949970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419553+0000","last_change":"2023-08-25T04:03:59.418141+0000","last_active":"2023-08-25T04:04:00.419553+0000","last_peered":"2023-08-25T04:04:00.419553+0000","last_clean":"2023-08-25T04:04:00.419553+0000","last_became_active":"2023-08-25T04:03:59.417880+0000","last_became_peered":"2023-08-25T04:03:59.417880+0000","last_unstale":"2023-08-25T04:04:00.419553+0000","last_undegraded":"2023-08-25T04:04:00.419553+0000","last_fullsized":"2023-08-25T04:04:00.419553+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:55:54.338998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401652+0000","last_change":"2023-08-25T04:03:59.394965+0000","last_active":"2023-08-25T04:04:00.401652+0000","last_peered":"2023-08-25T04:04:00.401652+0000","last_clean":"2023-08-25T04:04:00.401652+0000","last_became_active":"2023-08-25T04:03:59.394626+0000","last_became_peered":"2023-08-25T04:03:59.394626+0000","last_unstale":"2023-08-25T04:04:00.401652+0000","last_undegraded":"2023-08-25T04:04:00.401652+0000","last_fullsized":"2023-08-25T04:04:00.401652+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:08:51.394168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419194+0000","last_change":"2023-08-25T04:03:59.413847+0000","last_active":"2023-08-25T04:04:00.419194+0000","last_peered":"2023-08-25T04:04:00.419194+0000","last_clean":"2023-08-25T04:04:00.419194+0000","last_became_active":"2023-08-25T04:03:59.413121+0000","last_became_peered":"2023-08-25T04:03:59.413121+0000","last_unstale":"2023-08-25T04:04:00.419194+0000","last_undegraded":"2023-08-25T04:04:00.419194+0000","last_fullsized":"2023-08-25T04:04:00.419194+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:20:45.210270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.331864+0000","last_change":"2023-08-25T04:03:59.416450+0000","last_active":"2023-08-25T04:04:01.331864+0000","last_peered":"2023-08-25T04:04:01.331864+0000","last_clean":"2023-08-25T04:04:01.331864+0000","last_became_active":"2023-08-25T04:03:59.416193+0000","last_became_peered":"2023-08-25T04:03:59.416193+0000","last_unstale":"2023-08-25T04:04:01.331864+0000","last_undegraded":"2023-08-25T04:04:01.331864+0000","last_fullsized":"2023-08-25T04:04:01.331864+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:46:24.107127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332485+0000","last_change":"2023-08-25T04:03:59.423381+0000","last_active":"2023-08-25T04:04:01.332485+0000","last_peered":"2023-08-25T04:04:01.332485+0000","last_clean":"2023-08-25T04:04:01.332485+0000","last_became_active":"2023-08-25T04:03:59.423057+0000","last_became_peered":"2023-08-25T04:03:59.423057+0000","last_unstale":"2023-08-25T04:04:01.332485+0000","last_undegraded":"2023-08-25T04:04:01.332485+0000","last_fullsized":"2023-08-25T04:04:01.332485+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:28:05.226459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402183+0000","last_change":"2023-08-25T04:03:59.391310+0000","last_active":"2023-08-25T04:04:00.402183+0000","last_peered":"2023-08-25T04:04:00.402183+0000","last_clean":"2023-08-25T04:04:00.402183+0000","last_became_active":"2023-08-25T04:03:59.390994+0000","last_became_peered":"2023-08-25T04:03:59.390994+0000","last_unstale":"2023-08-25T04:04:00.402183+0000","last_undegraded":"2023-08-25T04:04:00.402183+0000","last_fullsized":"2023-08-25T04:04:00.402183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:28:58.427763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401121+0000","last_change":"2023-08-25T04:03:59.414035+0000","last_active":"2023-08-25T04:04:00.401121+0000","last_peered":"2023-08-25T04:04:00.401121+0000","last_clean":"2023-08-25T04:04:00.401121+0000","last_became_active":"2023-08-25T04:03:59.413749+0000","last_became_peered":"2023-08-25T04:03:59.413749+0000","last_unstale":"2023-08-25T04:04:00.401121+0000","last_undegraded":"2023-08-25T04:04:00.401121+0000","last_fullsized":"2023-08-25T04:04:00.401121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:07:11.827147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402124+0000","last_change":"2023-08-25T04:03:59.391591+0000","last_active":"2023-08-25T04:04:00.402124+0000","last_peered":"2023-08-25T04:04:00.402124+0000","last_clean":"2023-08-25T04:04:00.402124+0000","last_became_active":"2023-08-25T04:03:59.391312+0000","last_became_peered":"2023-08-25T04:03:59.391312+0000","last_unstale":"2023-08-25T04:04:00.402124+0000","last_undegraded":"2023-08-25T04:04:00.402124+0000","last_fullsized":"2023-08-25T04:04:00.402124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:33:51.036999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419383+0000","last_change":"2023-08-25T04:03:59.418049+0000","last_active":"2023-08-25T04:04:00.419383+0000","last_peered":"2023-08-25T04:04:00.419383+0000","last_clean":"2023-08-25T04:04:00.419383+0000","last_became_active":"2023-08-25T04:03:59.417803+0000","last_became_peered":"2023-08-25T04:03:59.417803+0000","last_unstale":"2023-08-25T04:04:00.419383+0000","last_undegraded":"2023-08-25T04:04:00.419383+0000","last_fullsized":"2023-08-25T04:04:00.419383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:30:53.684824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402633+0000","last_change":"2023-08-25T04:03:59.405308+0000","last_active":"2023-08-25T04:04:00.402633+0000","last_peered":"2023-08-25T04:04:00.402633+0000","last_clean":"2023-08-25T04:04:00.402633+0000","last_became_active":"2023-08-25T04:03:59.405020+0000","last_became_peered":"2023-08-25T04:03:59.405020+0000","last_unstale":"2023-08-25T04:04:00.402633+0000","last_undegraded":"2023-08-25T04:04:00.402633+0000","last_fullsized":"2023-08-25T04:04:00.402633+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:32.783190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.331860+0000","last_change":"2023-08-25T04:03:59.405282+0000","last_active":"2023-08-25T04:04:01.331860+0000","last_peered":"2023-08-25T04:04:01.331860+0000","last_clean":"2023-08-25T04:04:01.331860+0000","last_became_active":"2023-08-25T04:03:59.404959+0000","last_became_peered":"2023-08-25T04:03:59.404959+0000","last_unstale":"2023-08-25T04:04:01.331860+0000","last_undegraded":"2023-08-25T04:04:01.331860+0000","last_fullsized":"2023-08-25T04:04:01.331860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:20:23.025472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400796+0000","last_change":"2023-08-25T04:03:59.400976+0000","last_active":"2023-08-25T04:04:00.400796+0000","last_peered":"2023-08-25T04:04:00.400796+0000","last_clean":"2023-08-25T04:04:00.400796+0000","last_became_active":"2023-08-25T04:03:59.400488+0000","last_became_peered":"2023-08-25T04:03:59.400488+0000","last_unstale":"2023-08-25T04:04:00.400796+0000","last_undegraded":"2023-08-25T04:04:00.400796+0000","last_fullsized":"2023-08-25T04:04:00.400796+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:42:10.702642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402261+0000","last_change":"2023-08-25T04:03:59.397032+0000","last_active":"2023-08-25T04:04:00.402261+0000","last_peered":"2023-08-25T04:04:00.402261+0000","last_clean":"2023-08-25T04:04:00.402261+0000","last_became_active":"2023-08-25T04:03:59.396729+0000","last_became_peered":"2023-08-25T04:03:59.396729+0000","last_unstale":"2023-08-25T04:04:00.402261+0000","last_undegraded":"2023-08-25T04:04:00.402261+0000","last_fullsized":"2023-08-25T04:04:00.402261+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:55:48.674520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.419196+0000","last_change":"2023-08-25T04:03:59.417741+0000","last_active":"2023-08-25T04:03:59.419196+0000","last_peered":"2023-08-25T04:03:59.419196+0000","last_clean":"2023-08-25T04:03:59.419196+0000","last_became_active":"2023-08-25T04:03:59.417492+0000","last_became_peered":"2023-08-25T04:03:59.417492+0000","last_unstale":"2023-08-25T04:03:59.419196+0000","last_undegraded":"2023-08-25T04:03:59.419196+0000","last_fullsized":"2023-08-25T04:03:59.419196+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:31:49.886410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402196+0000","last_change":"2023-08-25T04:03:59.397759+0000","last_active":"2023-08-25T04:04:00.402196+0000","last_peered":"2023-08-25T04:04:00.402196+0000","last_clean":"2023-08-25T04:04:00.402196+0000","last_became_active":"2023-08-25T04:03:59.397470+0000","last_became_peered":"2023-08-25T04:03:59.397470+0000","last_unstale":"2023-08-25T04:04:00.402196+0000","last_undegraded":"2023-08-25T04:04:00.402196+0000","last_fullsized":"2023-08-25T04:04:00.402196+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:43:22.887170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419678+0000","last_change":"2023-08-25T04:03:59.414961+0000","last_active":"2023-08-25T04:04:00.419678+0000","last_peered":"2023-08-25T04:04:00.419678+0000","last_clean":"2023-08-25T04:04:00.419678+0000","last_became_active":"2023-08-25T04:03:59.414610+0000","last_became_peered":"2023-08-25T04:03:59.414610+0000","last_unstale":"2023-08-25T04:04:00.419678+0000","last_undegraded":"2023-08-25T04:04:00.419678+0000","last_fullsized":"2023-08-25T04:04:00.419678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:08:51.394168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402152+0000","last_change":"2023-08-25T04:03:59.406847+0000","last_active":"2023-08-25T04:04:00.402152+0000","last_peered":"2023-08-25T04:04:00.402152+0000","last_clean":"2023-08-25T04:04:00.402152+0000","last_became_active":"2023-08-25T04:03:59.406550+0000","last_became_peered":"2023-08-25T04:03:59.406550+0000","last_unstale":"2023-08-25T04:04:00.402152+0000","last_undegraded":"2023-08-25T04:04:00.402152+0000","last_fullsized":"2023-08-25T04:04:00.402152+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:25:19.755302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401861+0000","last_change":"2023-08-25T04:03:59.397948+0000","last_active":"2023-08-25T04:04:00.401861+0000","last_peered":"2023-08-25T04:04:00.401861+0000","last_clean":"2023-08-25T04:04:00.401861+0000","last_became_active":"2023-08-25T04:03:59.397631+0000","last_became_peered":"2023-08-25T04:03:59.397631+0000","last_unstale":"2023-08-25T04:04:00.401861+0000","last_undegraded":"2023-08-25T04:04:00.401861+0000","last_fullsized":"2023-08-25T04:04:00.401861+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:51.119086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332118+0000","last_change":"2023-08-25T04:03:59.406484+0000","last_active":"2023-08-25T04:04:01.332118+0000","last_peered":"2023-08-25T04:04:01.332118+0000","last_clean":"2023-08-25T04:04:01.332118+0000","last_became_active":"2023-08-25T04:03:59.405207+0000","last_became_peered":"2023-08-25T04:03:59.405207+0000","last_unstale":"2023-08-25T04:04:01.332118+0000","last_undegraded":"2023-08-25T04:04:01.332118+0000","last_fullsized":"2023-08-25T04:04:01.332118+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:52.932778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410368+0000","last_change":"2023-08-25T04:03:59.409108+0000","last_active":"2023-08-25T04:03:59.410368+0000","last_peered":"2023-08-25T04:03:59.410368+0000","last_clean":"2023-08-25T04:03:59.410368+0000","last_became_active":"2023-08-25T04:03:59.408844+0000","last_became_peered":"2023-08-25T04:03:59.408844+0000","last_unstale":"2023-08-25T04:03:59.410368+0000","last_undegraded":"2023-08-25T04:03:59.410368+0000","last_fullsized":"2023-08-25T04:03:59.410368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:31:52.823942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332171+0000","last_change":"2023-08-25T04:03:59.422851+0000","last_active":"2023-08-25T04:04:01.332171+0000","last_peered":"2023-08-25T04:04:01.332171+0000","last_clean":"2023-08-25T04:04:01.332171+0000","last_became_active":"2023-08-25T04:03:59.422576+0000","last_became_peered":"2023-08-25T04:03:59.422576+0000","last_unstale":"2023-08-25T04:04:01.332171+0000","last_undegraded":"2023-08-25T04:04:01.332171+0000","last_fullsized":"2023-08-25T04:04:01.332171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:44.291484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402304+0000","last_change":"2023-08-25T04:03:58.379427+0000","last_active":"2023-08-25T04:04:00.402304+0000","last_peered":"2023-08-25T04:04:00.402304+0000","last_clean":"2023-08-25T04:04:00.402304+0000","last_became_active":"2023-08-25T04:03:58.379126+0000","last_became_peered":"2023-08-25T04:03:58.379126+0000","last_unstale":"2023-08-25T04:04:00.402304+0000","last_undegraded":"2023-08-25T04:04:00.402304+0000","last_fullsized":"2023-08-25T04:04:00.402304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:13:37.865822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.423971+0000","last_change":"2023-08-25T04:03:59.422459+0000","last_active":"2023-08-25T04:03:59.423971+0000","last_peered":"2023-08-25T04:03:59.423971+0000","last_clean":"2023-08-25T04:03:59.423971+0000","last_became_active":"2023-08-25T04:03:59.422050+0000","last_became_peered":"2023-08-25T04:03:59.422050+0000","last_unstale":"2023-08-25T04:03:59.423971+0000","last_undegraded":"2023-08-25T04:03:59.423971+0000","last_fullsized":"2023-08-25T04:03:59.423971+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:17:35.817866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.400966+0000","last_change":"2023-08-25T04:03:58.386703+0000","last_active":"2023-08-25T04:03:59.400966+0000","last_peered":"2023-08-25T04:03:59.400966+0000","last_clean":"2023-08-25T04:03:59.400966+0000","last_became_active":"2023-08-25T04:03:58.386432+0000","last_became_peered":"2023-08-25T04:03:58.386432+0000","last_unstale":"2023-08-25T04:03:59.400966+0000","last_undegraded":"2023-08-25T04:03:59.400966+0000","last_fullsized":"2023-08-25T04:03:59.400966+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:15:49.791778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402854+0000","last_change":"2023-08-25T04:03:59.395833+0000","last_active":"2023-08-25T04:04:00.402854+0000","last_peered":"2023-08-25T04:04:00.402854+0000","last_clean":"2023-08-25T04:04:00.402854+0000","last_became_active":"2023-08-25T04:03:59.395329+0000","last_became_peered":"2023-08-25T04:03:59.395329+0000","last_unstale":"2023-08-25T04:04:00.402854+0000","last_undegraded":"2023-08-25T04:04:00.402854+0000","last_fullsized":"2023-08-25T04:04:00.402854+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:02:30.264838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410774+0000","last_change":"2023-08-25T04:03:58.376492+0000","last_active":"2023-08-25T04:03:59.410774+0000","last_peered":"2023-08-25T04:03:59.410774+0000","last_clean":"2023-08-25T04:03:59.410774+0000","last_became_active":"2023-08-25T04:03:58.375494+0000","last_became_peered":"2023-08-25T04:03:58.375494+0000","last_unstale":"2023-08-25T04:03:59.410774+0000","last_undegraded":"2023-08-25T04:03:59.410774+0000","last_fullsized":"2023-08-25T04:03:59.410774+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:06:00.526490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983068+0000","last_change":"2023-08-25T04:03:59.405903+0000","last_active":"2023-08-25T04:04:00.983068+0000","last_peered":"2023-08-25T04:04:00.983068+0000","last_clean":"2023-08-25T04:04:00.983068+0000","last_became_active":"2023-08-25T04:03:59.405466+0000","last_became_peered":"2023-08-25T04:03:59.405466+0000","last_unstale":"2023-08-25T04:04:00.983068+0000","last_undegraded":"2023-08-25T04:04:00.983068+0000","last_fullsized":"2023-08-25T04:04:00.983068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:35:34.878076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402698+0000","last_change":"2023-08-25T04:03:58.388087+0000","last_active":"2023-08-25T04:04:00.402698+0000","last_peered":"2023-08-25T04:04:00.402698+0000","last_clean":"2023-08-25T04:04:00.402698+0000","last_became_active":"2023-08-25T04:03:58.387747+0000","last_became_peered":"2023-08-25T04:03:58.387747+0000","last_unstale":"2023-08-25T04:04:00.402698+0000","last_undegraded":"2023-08-25T04:04:00.402698+0000","last_fullsized":"2023-08-25T04:04:00.402698+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:17.322151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.404892+0000","last_change":"2023-08-25T04:03:59.402378+0000","last_active":"2023-08-25T04:03:59.404892+0000","last_peered":"2023-08-25T04:03:59.404892+0000","last_clean":"2023-08-25T04:03:59.404892+0000","last_became_active":"2023-08-25T04:03:59.402007+0000","last_became_peered":"2023-08-25T04:03:59.402007+0000","last_unstale":"2023-08-25T04:03:59.404892+0000","last_undegraded":"2023-08-25T04:03:59.404892+0000","last_fullsized":"2023-08-25T04:03:59.404892+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:14:06.833085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419370+0000","last_change":"2023-08-25T04:03:58.385258+0000","last_active":"2023-08-25T04:04:00.419370+0000","last_peered":"2023-08-25T04:04:00.419370+0000","last_clean":"2023-08-25T04:04:00.419370+0000","last_became_active":"2023-08-25T04:03:58.384991+0000","last_became_peered":"2023-08-25T04:03:58.384991+0000","last_unstale":"2023-08-25T04:04:00.419370+0000","last_undegraded":"2023-08-25T04:04:00.419370+0000","last_fullsized":"2023-08-25T04:04:00.419370+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:07:30.250928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419383+0000","last_change":"2023-08-25T04:03:59.414026+0000","last_active":"2023-08-25T04:04:00.419383+0000","last_peered":"2023-08-25T04:04:00.419383+0000","last_clean":"2023-08-25T04:04:00.419383+0000","last_became_active":"2023-08-25T04:03:59.413496+0000","last_became_peered":"2023-08-25T04:03:59.413496+0000","last_unstale":"2023-08-25T04:04:00.419383+0000","last_undegraded":"2023-08-25T04:04:00.419383+0000","last_fullsized":"2023-08-25T04:04:00.419383+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:47.335245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.331865+0000","last_change":"2023-08-25T04:03:58.387667+0000","last_active":"2023-08-25T04:04:01.331865+0000","last_peered":"2023-08-25T04:04:01.331865+0000","last_clean":"2023-08-25T04:04:01.331865+0000","last_became_active":"2023-08-25T04:03:58.387352+0000","last_became_peered":"2023-08-25T04:03:58.387352+0000","last_unstale":"2023-08-25T04:04:01.331865+0000","last_undegraded":"2023-08-25T04:04:01.331865+0000","last_fullsized":"2023-08-25T04:04:01.331865+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:08:50.382544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402516+0000","last_change":"2023-08-25T04:03:59.417484+0000","last_active":"2023-08-25T04:04:00.402516+0000","last_peered":"2023-08-25T04:04:00.402516+0000","last_clean":"2023-08-25T04:04:00.402516+0000","last_became_active":"2023-08-25T04:03:59.417130+0000","last_became_peered":"2023-08-25T04:03:59.417130+0000","last_unstale":"2023-08-25T04:04:00.402516+0000","last_undegraded":"2023-08-25T04:04:00.402516+0000","last_fullsized":"2023-08-25T04:04:00.402516+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:23:20.399499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.389371+0000","last_change":"2023-08-25T04:03:58.384345+0000","last_active":"2023-08-25T04:03:59.389371+0000","last_peered":"2023-08-25T04:03:59.389371+0000","last_clean":"2023-08-25T04:03:59.389371+0000","last_became_active":"2023-08-25T04:03:58.384067+0000","last_became_peered":"2023-08-25T04:03:58.384067+0000","last_unstale":"2023-08-25T04:03:59.389371+0000","last_undegraded":"2023-08-25T04:03:59.389371+0000","last_fullsized":"2023-08-25T04:03:59.389371+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:47:45.627944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982797+0000","last_change":"2023-08-25T04:03:59.406474+0000","last_active":"2023-08-25T04:04:00.982797+0000","last_peered":"2023-08-25T04:04:00.982797+0000","last_clean":"2023-08-25T04:04:00.982797+0000","last_became_active":"2023-08-25T04:03:59.406133+0000","last_became_peered":"2023-08-25T04:03:59.406133+0000","last_unstale":"2023-08-25T04:04:00.982797+0000","last_undegraded":"2023-08-25T04:04:00.982797+0000","last_fullsized":"2023-08-25T04:04:00.982797+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:04:17.226276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401672+0000","last_change":"2023-08-25T04:03:58.380770+0000","last_active":"2023-08-25T04:04:00.401672+0000","last_peered":"2023-08-25T04:04:00.401672+0000","last_clean":"2023-08-25T04:04:00.401672+0000","last_became_active":"2023-08-25T04:03:58.380444+0000","last_became_peered":"2023-08-25T04:03:58.380444+0000","last_unstale":"2023-08-25T04:04:00.401672+0000","last_undegraded":"2023-08-25T04:04:00.401672+0000","last_fullsized":"2023-08-25T04:04:00.401672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:08:56.083693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401151+0000","last_change":"2023-08-25T04:03:59.400753+0000","last_active":"2023-08-25T04:04:00.401151+0000","last_peered":"2023-08-25T04:04:00.401151+0000","last_clean":"2023-08-25T04:04:00.401151+0000","last_became_active":"2023-08-25T04:03:59.400263+0000","last_became_peered":"2023-08-25T04:03:59.400263+0000","last_unstale":"2023-08-25T04:04:00.401151+0000","last_undegraded":"2023-08-25T04:04:00.401151+0000","last_fullsized":"2023-08-25T04:04:00.401151+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:40:08.451848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983139+0000","last_change":"2023-08-25T04:03:58.389611+0000","last_active":"2023-08-25T04:04:00.983139+0000","last_peered":"2023-08-25T04:04:00.983139+0000","last_clean":"2023-08-25T04:04:00.983139+0000","last_became_active":"2023-08-25T04:03:58.389289+0000","last_became_peered":"2023-08-25T04:03:58.389289+0000","last_unstale":"2023-08-25T04:04:00.983139+0000","last_undegraded":"2023-08-25T04:04:00.983139+0000","last_fullsized":"2023-08-25T04:04:00.983139+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:58.251174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332374+0000","last_change":"2023-08-25T04:03:59.404413+0000","last_active":"2023-08-25T04:04:01.332374+0000","last_peered":"2023-08-25T04:04:01.332374+0000","last_clean":"2023-08-25T04:04:01.332374+0000","last_became_active":"2023-08-25T04:03:59.404111+0000","last_became_peered":"2023-08-25T04:03:59.404111+0000","last_unstale":"2023-08-25T04:04:01.332374+0000","last_undegraded":"2023-08-25T04:04:01.332374+0000","last_fullsized":"2023-08-25T04:04:01.332374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:22.381853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419820+0000","last_change":"2023-08-25T04:03:58.390364+0000","last_active":"2023-08-25T04:04:00.419820+0000","last_peered":"2023-08-25T04:04:00.419820+0000","last_clean":"2023-08-25T04:04:00.419820+0000","last_became_active":"2023-08-25T04:03:58.390106+0000","last_became_peered":"2023-08-25T04:03:58.390106+0000","last_unstale":"2023-08-25T04:04:00.419820+0000","last_undegraded":"2023-08-25T04:04:00.419820+0000","last_fullsized":"2023-08-25T04:04:00.419820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:23:19.387874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.403467+0000","last_change":"2023-08-25T04:03:59.400496+0000","last_active":"2023-08-25T04:03:59.403467+0000","last_peered":"2023-08-25T04:03:59.403467+0000","last_clean":"2023-08-25T04:03:59.403467+0000","last_became_active":"2023-08-25T04:03:59.400190+0000","last_became_peered":"2023-08-25T04:03:59.400190+0000","last_unstale":"2023-08-25T04:03:59.403467+0000","last_undegraded":"2023-08-25T04:03:59.403467+0000","last_fullsized":"2023-08-25T04:03:59.403467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:58:14.431223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419790+0000","last_change":"2023-08-25T04:03:58.386413+0000","last_active":"2023-08-25T04:04:00.419790+0000","last_peered":"2023-08-25T04:04:00.419790+0000","last_clean":"2023-08-25T04:04:00.419790+0000","last_became_active":"2023-08-25T04:03:58.385665+0000","last_became_peered":"2023-08-25T04:03:58.385665+0000","last_unstale":"2023-08-25T04:04:00.419790+0000","last_undegraded":"2023-08-25T04:04:00.419790+0000","last_fullsized":"2023-08-25T04:04:00.419790+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:43.279859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402931+0000","last_change":"2023-08-25T04:03:59.410573+0000","last_active":"2023-08-25T04:04:00.402931+0000","last_peered":"2023-08-25T04:04:00.402931+0000","last_clean":"2023-08-25T04:04:00.402931+0000","last_became_active":"2023-08-25T04:03:59.410265+0000","last_became_peered":"2023-08-25T04:03:59.410265+0000","last_unstale":"2023-08-25T04:04:00.402931+0000","last_undegraded":"2023-08-25T04:04:00.402931+0000","last_fullsized":"2023-08-25T04:04:00.402931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:23:45.964870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.983052+0000","last_change":"2023-08-25T04:03:58.387790+0000","last_active":"2023-08-25T04:04:00.983052+0000","last_peered":"2023-08-25T04:04:00.983052+0000","last_clean":"2023-08-25T04:04:00.983052+0000","last_became_active":"2023-08-25T04:03:58.387517+0000","last_became_peered":"2023-08-25T04:03:58.387517+0000","last_unstale":"2023-08-25T04:04:00.983052+0000","last_undegraded":"2023-08-25T04:04:00.983052+0000","last_fullsized":"2023-08-25T04:04:00.983052+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:20.409272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.420670+0000","last_change":"2023-08-25T04:03:59.418006+0000","last_active":"2023-08-25T04:03:59.420670+0000","last_peered":"2023-08-25T04:03:59.420670+0000","last_clean":"2023-08-25T04:03:59.420670+0000","last_became_active":"2023-08-25T04:03:59.417698+0000","last_became_peered":"2023-08-25T04:03:59.417698+0000","last_unstale":"2023-08-25T04:03:59.420670+0000","last_undegraded":"2023-08-25T04:03:59.420670+0000","last_fullsized":"2023-08-25T04:03:59.420670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:44.450303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982988+0000","last_change":"2023-08-25T04:03:58.389761+0000","last_active":"2023-08-25T04:04:00.982988+0000","last_peered":"2023-08-25T04:04:00.982988+0000","last_clean":"2023-08-25T04:04:00.982988+0000","last_became_active":"2023-08-25T04:03:58.388403+0000","last_became_peered":"2023-08-25T04:03:58.388403+0000","last_unstale":"2023-08-25T04:04:00.982988+0000","last_undegraded":"2023-08-25T04:04:00.982988+0000","last_fullsized":"2023-08-25T04:04:00.982988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:44:53.006803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982613+0000","last_change":"2023-08-25T04:03:59.406135+0000","last_active":"2023-08-25T04:04:00.982613+0000","last_peered":"2023-08-25T04:04:00.982613+0000","last_clean":"2023-08-25T04:04:00.982613+0000","last_became_active":"2023-08-25T04:03:59.405815+0000","last_became_peered":"2023-08-25T04:03:59.405815+0000","last_unstale":"2023-08-25T04:04:00.982613+0000","last_undegraded":"2023-08-25T04:04:00.982613+0000","last_fullsized":"2023-08-25T04:04:00.982613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:04:29.975483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.388438+0000","last_change":"2023-08-25T04:03:58.385409+0000","last_active":"2023-08-25T04:03:59.388438+0000","last_peered":"2023-08-25T04:03:59.388438+0000","last_clean":"2023-08-25T04:03:59.388438+0000","last_became_active":"2023-08-25T04:03:58.385114+0000","last_became_peered":"2023-08-25T04:03:58.385114+0000","last_unstale":"2023-08-25T04:03:59.388438+0000","last_undegraded":"2023-08-25T04:03:59.388438+0000","last_fullsized":"2023-08-25T04:03:59.388438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:11:51.858524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.331884+0000","last_change":"2023-08-25T04:03:59.406096+0000","last_active":"2023-08-25T04:04:01.331884+0000","last_peered":"2023-08-25T04:04:01.331884+0000","last_clean":"2023-08-25T04:04:01.331884+0000","last_became_active":"2023-08-25T04:03:59.405160+0000","last_became_peered":"2023-08-25T04:03:59.405160+0000","last_unstale":"2023-08-25T04:04:01.331884+0000","last_undegraded":"2023-08-25T04:04:01.331884+0000","last_fullsized":"2023-08-25T04:04:01.331884+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:56:53.601262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401819+0000","last_change":"2023-08-25T04:03:58.380065+0000","last_active":"2023-08-25T04:04:00.401819+0000","last_peered":"2023-08-25T04:04:00.401819+0000","last_clean":"2023-08-25T04:04:00.401819+0000","last_became_active":"2023-08-25T04:03:58.379764+0000","last_became_peered":"2023-08-25T04:03:58.379764+0000","last_unstale":"2023-08-25T04:04:00.401819+0000","last_undegraded":"2023-08-25T04:04:00.401819+0000","last_fullsized":"2023-08-25T04:04:00.401819+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:28:16.964460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982718+0000","last_change":"2023-08-25T04:03:59.404648+0000","last_active":"2023-08-25T04:04:00.982718+0000","last_peered":"2023-08-25T04:04:00.982718+0000","last_clean":"2023-08-25T04:04:00.982718+0000","last_became_active":"2023-08-25T04:03:59.404224+0000","last_became_peered":"2023-08-25T04:03:59.404224+0000","last_unstale":"2023-08-25T04:04:00.982718+0000","last_undegraded":"2023-08-25T04:04:00.982718+0000","last_fullsized":"2023-08-25T04:04:00.982718+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:12:53.411199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.331738+0000","last_change":"2023-08-25T04:03:58.386551+0000","last_active":"2023-08-25T04:04:01.331738+0000","last_peered":"2023-08-25T04:04:01.331738+0000","last_clean":"2023-08-25T04:04:01.331738+0000","last_became_active":"2023-08-25T04:03:58.386285+0000","last_became_peered":"2023-08-25T04:03:58.386285+0000","last_unstale":"2023-08-25T04:04:01.331738+0000","last_undegraded":"2023-08-25T04:04:01.331738+0000","last_fullsized":"2023-08-25T04:04:01.331738+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:08:56.083693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982887+0000","last_change":"2023-08-25T04:03:59.402822+0000","last_active":"2023-08-25T04:04:00.982887+0000","last_peered":"2023-08-25T04:04:00.982887+0000","last_clean":"2023-08-25T04:04:00.982887+0000","last_became_active":"2023-08-25T04:03:59.402413+0000","last_became_peered":"2023-08-25T04:03:59.402413+0000","last_unstale":"2023-08-25T04:04:00.982887+0000","last_undegraded":"2023-08-25T04:04:00.982887+0000","last_fullsized":"2023-08-25T04:04:00.982887+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:06.684416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419894+0000","last_change":"2023-08-25T04:03:58.389581+0000","last_active":"2023-08-25T04:04:00.419894+0000","last_peered":"2023-08-25T04:04:00.419894+0000","last_clean":"2023-08-25T04:04:00.419894+0000","last_became_active":"2023-08-25T04:03:58.388910+0000","last_became_peered":"2023-08-25T04:03:58.388910+0000","last_unstale":"2023-08-25T04:04:00.419894+0000","last_undegraded":"2023-08-25T04:04:00.419894+0000","last_fullsized":"2023-08-25T04:04:00.419894+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:31.771566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419619+0000","last_change":"2023-08-25T04:03:59.421526+0000","last_active":"2023-08-25T04:04:00.419619+0000","last_peered":"2023-08-25T04:04:00.419619+0000","last_clean":"2023-08-25T04:04:00.419619+0000","last_became_active":"2023-08-25T04:03:59.421169+0000","last_became_peered":"2023-08-25T04:03:59.421169+0000","last_unstale":"2023-08-25T04:04:00.419619+0000","last_undegraded":"2023-08-25T04:04:00.419619+0000","last_fullsized":"2023-08-25T04:04:00.419619+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:56:53.601262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402892+0000","last_change":"2023-08-25T04:03:58.385498+0000","last_active":"2023-08-25T04:04:00.402892+0000","last_peered":"2023-08-25T04:04:00.402892+0000","last_clean":"2023-08-25T04:04:00.402892+0000","last_became_active":"2023-08-25T04:03:58.385215+0000","last_became_peered":"2023-08-25T04:03:58.385215+0000","last_unstale":"2023-08-25T04:04:00.402892+0000","last_undegraded":"2023-08-25T04:04:00.402892+0000","last_fullsized":"2023-08-25T04:04:00.402892+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:21.370228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402806+0000","last_change":"2023-08-25T04:03:59.410945+0000","last_active":"2023-08-25T04:04:00.402806+0000","last_peered":"2023-08-25T04:04:00.402806+0000","last_clean":"2023-08-25T04:04:00.402806+0000","last_became_active":"2023-08-25T04:03:59.410648+0000","last_became_peered":"2023-08-25T04:03:59.410648+0000","last_unstale":"2023-08-25T04:04:00.402806+0000","last_undegraded":"2023-08-25T04:04:00.402806+0000","last_fullsized":"2023-08-25T04:04:00.402806+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:39.793044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401201+0000","last_change":"2023-08-25T04:03:58.388839+0000","last_active":"2023-08-25T04:04:00.401201+0000","last_peered":"2023-08-25T04:04:00.401201+0000","last_clean":"2023-08-25T04:04:00.401201+0000","last_became_active":"2023-08-25T04:03:58.387292+0000","last_became_peered":"2023-08-25T04:03:58.387292+0000","last_unstale":"2023-08-25T04:04:00.401201+0000","last_undegraded":"2023-08-25T04:04:00.401201+0000","last_fullsized":"2023-08-25T04:04:00.401201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:17:38.350945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401251+0000","last_change":"2023-08-25T04:03:59.412433+0000","last_active":"2023-08-25T04:04:00.401251+0000","last_peered":"2023-08-25T04:04:00.401251+0000","last_clean":"2023-08-25T04:04:00.401251+0000","last_became_active":"2023-08-25T04:03:59.412124+0000","last_became_peered":"2023-08-25T04:03:59.412124+0000","last_unstale":"2023-08-25T04:04:00.401251+0000","last_undegraded":"2023-08-25T04:04:00.401251+0000","last_fullsized":"2023-08-25T04:04:00.401251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:39:52.127970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.394843+0000","last_change":"2023-08-25T04:03:58.375199+0000","last_active":"2023-08-25T04:03:59.394843+0000","last_peered":"2023-08-25T04:03:59.394843+0000","last_clean":"2023-08-25T04:03:59.394843+0000","last_became_active":"2023-08-25T04:03:58.374994+0000","last_became_peered":"2023-08-25T04:03:58.374994+0000","last_unstale":"2023-08-25T04:03:59.394843+0000","last_undegraded":"2023-08-25T04:03:59.394843+0000","last_fullsized":"2023-08-25T04:03:59.394843+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:10:41.181170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332245+0000","last_change":"2023-08-25T04:03:59.409092+0000","last_active":"2023-08-25T04:04:01.332245+0000","last_peered":"2023-08-25T04:04:01.332245+0000","last_clean":"2023-08-25T04:04:01.332245+0000","last_became_active":"2023-08-25T04:03:59.408723+0000","last_became_peered":"2023-08-25T04:03:59.408723+0000","last_unstale":"2023-08-25T04:04:01.332245+0000","last_undegraded":"2023-08-25T04:04:01.332245+0000","last_fullsized":"2023-08-25T04:04:01.332245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:18.333776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401003+0000","last_change":"2023-08-25T04:03:58.388343+0000","last_active":"2023-08-25T04:04:00.401003+0000","last_peered":"2023-08-25T04:04:00.401003+0000","last_clean":"2023-08-25T04:04:00.401003+0000","last_became_active":"2023-08-25T04:03:58.387241+0000","last_became_peered":"2023-08-25T04:03:58.387241+0000","last_unstale":"2023-08-25T04:04:00.401003+0000","last_undegraded":"2023-08-25T04:04:00.401003+0000","last_fullsized":"2023-08-25T04:04:00.401003+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:12:13.970416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.403432+0000","last_change":"2023-08-25T04:03:59.400416+0000","last_active":"2023-08-25T04:03:59.403432+0000","last_peered":"2023-08-25T04:03:59.403432+0000","last_clean":"2023-08-25T04:03:59.403432+0000","last_became_active":"2023-08-25T04:03:59.400094+0000","last_became_peered":"2023-08-25T04:03:59.400094+0000","last_unstale":"2023-08-25T04:03:59.403432+0000","last_undegraded":"2023-08-25T04:03:59.403432+0000","last_fullsized":"2023-08-25T04:03:59.403432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:38:49.403139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400938+0000","last_change":"2023-08-25T04:03:58.380520+0000","last_active":"2023-08-25T04:04:00.400938+0000","last_peered":"2023-08-25T04:04:00.400938+0000","last_clean":"2023-08-25T04:04:00.400938+0000","last_became_active":"2023-08-25T04:03:58.380215+0000","last_became_peered":"2023-08-25T04:03:58.380215+0000","last_unstale":"2023-08-25T04:04:00.400938+0000","last_undegraded":"2023-08-25T04:04:00.400938+0000","last_fullsized":"2023-08-25T04:04:00.400938+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:20:10.016494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419387+0000","last_change":"2023-08-25T04:03:59.418011+0000","last_active":"2023-08-25T04:04:00.419387+0000","last_peered":"2023-08-25T04:04:00.419387+0000","last_clean":"2023-08-25T04:04:00.419387+0000","last_became_active":"2023-08-25T04:03:59.416332+0000","last_became_peered":"2023-08-25T04:03:59.416332+0000","last_unstale":"2023-08-25T04:04:00.419387+0000","last_undegraded":"2023-08-25T04:04:00.419387+0000","last_fullsized":"2023-08-25T04:04:00.419387+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:44:01.894126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332098+0000","last_change":"2023-08-25T04:03:58.387286+0000","last_active":"2023-08-25T04:04:01.332098+0000","last_peered":"2023-08-25T04:04:01.332098+0000","last_clean":"2023-08-25T04:04:01.332098+0000","last_became_active":"2023-08-25T04:03:58.386957+0000","last_became_peered":"2023-08-25T04:03:58.386957+0000","last_unstale":"2023-08-25T04:04:01.332098+0000","last_undegraded":"2023-08-25T04:04:01.332098+0000","last_fullsized":"2023-08-25T04:04:01.332098+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:23:19.387874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982896+0000","last_change":"2023-08-25T04:03:59.406384+0000","last_active":"2023-08-25T04:04:00.982896+0000","last_peered":"2023-08-25T04:04:00.982896+0000","last_clean":"2023-08-25T04:04:00.982896+0000","last_became_active":"2023-08-25T04:03:59.405851+0000","last_became_peered":"2023-08-25T04:03:59.405851+0000","last_unstale":"2023-08-25T04:04:00.982896+0000","last_undegraded":"2023-08-25T04:04:00.982896+0000","last_fullsized":"2023-08-25T04:04:00.982896+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:40.592468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400806+0000","last_change":"2023-08-25T04:03:58.387617+0000","last_active":"2023-08-25T04:04:00.400806+0000","last_peered":"2023-08-25T04:04:00.400806+0000","last_clean":"2023-08-25T04:04:00.400806+0000","last_became_active":"2023-08-25T04:03:58.387256+0000","last_became_peered":"2023-08-25T04:03:58.387256+0000","last_unstale":"2023-08-25T04:04:00.400806+0000","last_undegraded":"2023-08-25T04:04:00.400806+0000","last_fullsized":"2023-08-25T04:04:00.400806+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:32:58.744009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419752+0000","last_change":"2023-08-25T04:03:59.418440+0000","last_active":"2023-08-25T04:04:00.419752+0000","last_peered":"2023-08-25T04:04:00.419752+0000","last_clean":"2023-08-25T04:04:00.419752+0000","last_became_active":"2023-08-25T04:03:59.418264+0000","last_became_peered":"2023-08-25T04:03:59.418264+0000","last_unstale":"2023-08-25T04:04:00.419752+0000","last_undegraded":"2023-08-25T04:04:00.419752+0000","last_fullsized":"2023-08-25T04:04:00.419752+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:52.932778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332144+0000","last_change":"2023-08-25T04:03:58.391746+0000","last_active":"2023-08-25T04:04:01.332144+0000","last_peered":"2023-08-25T04:04:01.332144+0000","last_clean":"2023-08-25T04:04:01.332144+0000","last_became_active":"2023-08-25T04:03:58.391487+0000","last_became_peered":"2023-08-25T04:03:58.391487+0000","last_unstale":"2023-08-25T04:04:01.332144+0000","last_undegraded":"2023-08-25T04:04:01.332144+0000","last_fullsized":"2023-08-25T04:04:01.332144+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:38.781419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332315+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:04:01.332315+0000","last_peered":"2023-08-25T04:04:01.332315+0000","last_clean":"2023-08-25T04:04:01.332315+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:04:01.332315+0000","last_undegraded":"2023-08-25T04:04:01.332315+0000","last_fullsized":"2023-08-25T04:04:01.332315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:22:35.212795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419570+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:04:00.419570+0000","last_peered":"2023-08-25T04:04:00.419570+0000","last_clean":"2023-08-25T04:04:00.419570+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:04:00.419570+0000","last_undegraded":"2023-08-25T04:04:00.419570+0000","last_fullsized":"2023-08-25T04:04:00.419570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:45:20.387820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.420791+0000","last_change":"2023-08-25T04:03:59.419512+0000","last_active":"2023-08-25T04:03:59.420791+0000","last_peered":"2023-08-25T04:03:59.420791+0000","last_clean":"2023-08-25T04:03:59.420791+0000","last_became_active":"2023-08-25T04:03:59.419143+0000","last_became_peered":"2023-08-25T04:03:59.419143+0000","last_unstale":"2023-08-25T04:03:59.420791+0000","last_undegraded":"2023-08-25T04:03:59.420791+0000","last_fullsized":"2023-08-25T04:03:59.420791+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:08:08.686296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419946+0000","last_change":"2023-08-25T04:03:58.389811+0000","last_active":"2023-08-25T04:04:00.419946+0000","last_peered":"2023-08-25T04:04:00.419946+0000","last_clean":"2023-08-25T04:04:00.419946+0000","last_became_active":"2023-08-25T04:03:58.389274+0000","last_became_peered":"2023-08-25T04:03:58.389274+0000","last_unstale":"2023-08-25T04:04:00.419946+0000","last_undegraded":"2023-08-25T04:04:00.419946+0000","last_fullsized":"2023-08-25T04:04:00.419946+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:17.322151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.331956+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:04:01.331956+0000","last_peered":"2023-08-25T04:04:01.331956+0000","last_clean":"2023-08-25T04:04:01.331956+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:04:01.331956+0000","last_undegraded":"2023-08-25T04:04:01.331956+0000","last_fullsized":"2023-08-25T04:04:01.331956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:57:29.063884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332438+0000","last_change":"2023-08-25T04:03:59.405843+0000","last_active":"2023-08-25T04:04:01.332438+0000","last_peered":"2023-08-25T04:04:01.332438+0000","last_clean":"2023-08-25T04:04:01.332438+0000","last_became_active":"2023-08-25T04:03:59.405403+0000","last_became_peered":"2023-08-25T04:03:59.405403+0000","last_unstale":"2023-08-25T04:04:01.332438+0000","last_undegraded":"2023-08-25T04:04:01.332438+0000","last_fullsized":"2023-08-25T04:04:01.332438+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:39:23.658027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401201+0000","last_change":"2023-08-25T04:03:58.386244+0000","last_active":"2023-08-25T04:04:00.401201+0000","last_peered":"2023-08-25T04:04:00.401201+0000","last_clean":"2023-08-25T04:04:00.401201+0000","last_became_active":"2023-08-25T04:03:58.385936+0000","last_became_peered":"2023-08-25T04:03:58.385936+0000","last_unstale":"2023-08-25T04:04:00.401201+0000","last_undegraded":"2023-08-25T04:04:00.401201+0000","last_fullsized":"2023-08-25T04:04:00.401201+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:40:13.209260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.400848+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:04:00.400848+0000","last_peered":"2023-08-25T04:04:00.400848+0000","last_clean":"2023-08-25T04:04:00.400848+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:04:00.400848+0000","last_undegraded":"2023-08-25T04:04:00.400848+0000","last_fullsized":"2023-08-25T04:04:00.400848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:49.545600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982987+0000","last_change":"2023-08-25T04:03:59.397271+0000","last_active":"2023-08-25T04:04:00.982987+0000","last_peered":"2023-08-25T04:04:00.982987+0000","last_clean":"2023-08-25T04:04:00.982987+0000","last_became_active":"2023-08-25T04:03:59.396948+0000","last_became_peered":"2023-08-25T04:03:59.396948+0000","last_unstale":"2023-08-25T04:04:00.982987+0000","last_undegraded":"2023-08-25T04:04:00.982987+0000","last_fullsized":"2023-08-25T04:04:00.982987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:11:44.609170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.390471+0000","last_change":"2023-08-25T04:03:58.382342+0000","last_active":"2023-08-25T04:03:59.390471+0000","last_peered":"2023-08-25T04:03:59.390471+0000","last_clean":"2023-08-25T04:03:59.390471+0000","last_became_active":"2023-08-25T04:03:58.382068+0000","last_became_peered":"2023-08-25T04:03:58.382068+0000","last_unstale":"2023-08-25T04:03:59.390471+0000","last_undegraded":"2023-08-25T04:03:59.390471+0000","last_fullsized":"2023-08-25T04:03:59.390471+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:18:16.177809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.419423+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:04:00.419423+0000","last_peered":"2023-08-25T04:04:00.419423+0000","last_clean":"2023-08-25T04:04:00.419423+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:04:00.419423+0000","last_undegraded":"2023-08-25T04:04:00.419423+0000","last_fullsized":"2023-08-25T04:04:00.419423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:44:08.796401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410272+0000","last_change":"2023-08-25T04:03:59.408317+0000","last_active":"2023-08-25T04:03:59.410272+0000","last_peered":"2023-08-25T04:03:59.410272+0000","last_clean":"2023-08-25T04:03:59.410272+0000","last_became_active":"2023-08-25T04:03:59.408091+0000","last_became_peered":"2023-08-25T04:03:59.408091+0000","last_unstale":"2023-08-25T04:03:59.410272+0000","last_undegraded":"2023-08-25T04:03:59.410272+0000","last_fullsized":"2023-08-25T04:03:59.410272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:27:40.842846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.391080+0000","last_change":"2023-08-25T04:03:58.384133+0000","last_active":"2023-08-25T04:03:59.391080+0000","last_peered":"2023-08-25T04:03:59.391080+0000","last_clean":"2023-08-25T04:03:59.391080+0000","last_became_active":"2023-08-25T04:03:58.383821+0000","last_became_peered":"2023-08-25T04:03:58.383821+0000","last_unstale":"2023-08-25T04:03:59.391080+0000","last_undegraded":"2023-08-25T04:03:59.391080+0000","last_fullsized":"2023-08-25T04:03:59.391080+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:22:33.037133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.394919+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:03:59.394919+0000","last_peered":"2023-08-25T04:03:59.394919+0000","last_clean":"2023-08-25T04:03:59.394919+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:03:59.394919+0000","last_undegraded":"2023-08-25T04:03:59.394919+0000","last_fullsized":"2023-08-25T04:03:59.394919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:08:13.548315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.410403+0000","last_change":"2023-08-25T04:03:59.402065+0000","last_active":"2023-08-25T04:03:59.410403+0000","last_peered":"2023-08-25T04:03:59.410403+0000","last_clean":"2023-08-25T04:03:59.410403+0000","last_became_active":"2023-08-25T04:03:59.401800+0000","last_became_peered":"2023-08-25T04:03:59.401800+0000","last_unstale":"2023-08-25T04:03:59.410403+0000","last_undegraded":"2023-08-25T04:03:59.410403+0000","last_fullsized":"2023-08-25T04:03:59.410403+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:00:55.769641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401955+0000","last_change":"2023-08-25T04:03:58.382420+0000","last_active":"2023-08-25T04:04:00.401955+0000","last_peered":"2023-08-25T04:04:00.401955+0000","last_clean":"2023-08-25T04:04:00.401955+0000","last_became_active":"2023-08-25T04:03:58.382101+0000","last_became_peered":"2023-08-25T04:03:58.382101+0000","last_unstale":"2023-08-25T04:04:00.401955+0000","last_undegraded":"2023-08-25T04:04:00.401955+0000","last_fullsized":"2023-08-25T04:04:00.401955+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:53:04.164317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332474+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:04:01.332474+0000","last_peered":"2023-08-25T04:04:01.332474+0000","last_clean":"2023-08-25T04:04:01.332474+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:04:01.332474+0000","last_undegraded":"2023-08-25T04:04:01.332474+0000","last_fullsized":"2023-08-25T04:04:01.332474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:23.908663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402389+0000","last_change":"2023-08-25T04:03:59.409061+0000","last_active":"2023-08-25T04:04:00.402389+0000","last_peered":"2023-08-25T04:04:00.402389+0000","last_clean":"2023-08-25T04:04:00.402389+0000","last_became_active":"2023-08-25T04:03:59.408631+0000","last_became_peered":"2023-08-25T04:03:59.408631+0000","last_unstale":"2023-08-25T04:04:00.402389+0000","last_undegraded":"2023-08-25T04:04:00.402389+0000","last_fullsized":"2023-08-25T04:04:00.402389+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:44.291484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.401697+0000","last_change":"2023-08-25T04:03:58.388711+0000","last_active":"2023-08-25T04:04:00.401697+0000","last_peered":"2023-08-25T04:04:00.401697+0000","last_clean":"2023-08-25T04:04:00.401697+0000","last_became_active":"2023-08-25T04:03:58.388399+0000","last_became_peered":"2023-08-25T04:03:58.388399+0000","last_unstale":"2023-08-25T04:04:00.401697+0000","last_undegraded":"2023-08-25T04:04:00.401697+0000","last_fullsized":"2023-08-25T04:04:00.401697+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:51.921153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-08-25T04:03:59.390607+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:03:59.390607+0000","last_peered":"2023-08-25T04:03:59.390607+0000","last_clean":"2023-08-25T04:03:59.390607+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:03:59.390607+0000","last_undegraded":"2023-08-25T04:03:59.390607+0000","last_fullsized":"2023-08-25T04:03:59.390607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:13:19.148757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:01.332311+0000","last_change":"2023-08-25T04:03:59.407013+0000","last_active":"2023-08-25T04:04:01.332311+0000","last_peered":"2023-08-25T04:04:01.332311+0000","last_clean":"2023-08-25T04:04:01.332311+0000","last_became_active":"2023-08-25T04:03:59.404840+0000","last_became_peered":"2023-08-25T04:03:59.404840+0000","last_unstale":"2023-08-25T04:04:01.332311+0000","last_undegraded":"2023-08-25T04:04:01.332311+0000","last_fullsized":"2023-08-25T04:04:01.332311+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:58.358530+0000","last_clean_scrub_stamp":"2023-08-25T04:03:58.358530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:02:30.264838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.982644+0000","last_change":"2023-08-25T04:03:58.389799+0000","last_active":"2023-08-25T04:04:00.982644+0000","last_peered":"2023-08-25T04:04:00.982644+0000","last_clean":"2023-08-25T04:04:00.982644+0000","last_became_active":"2023-08-25T04:03:58.389277+0000","last_became_peered":"2023-08-25T04:03:58.389277+0000","last_unstale":"2023-08-25T04:04:00.982644+0000","last_undegraded":"2023-08-25T04:04:00.982644+0000","last_fullsized":"2023-08-25T04:04:00.982644+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:03:57.346906+0000","last_clean_scrub_stamp":"2023-08-25T04:03:57.346906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:03:31.104737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-08-25T04:04:00.402340+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:04:00.402340+0000","last_peered":"2023-08-25T04:04:00.402340+0000","last_clean":"2023-08-25T04:04:00.402340+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:04:00.402340+0000","last_undegraded":"2023-08-25T04:04:00.402340+0000","last_fullsized":"2023-08-25T04:04:00.402340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:45:35.784220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1036288,"data_stored":769649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.71099999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.79000000000000004}]},{"osd":4,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.89600000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.61799999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64200000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509459,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":430080,"data_stored":178181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.628}]},{"osd":1,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.54500000000000004}]},{"osd":2,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.68200000000000005}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.78600000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.73499999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.83499999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":434176,"data_stored":177711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.63700000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.754}]},{"osd":3,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.69799999999999995}]},{"osd":4,"last update":"Fri Aug 25 04:03:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.71599999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.85799999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.84799999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":434176,"data_stored":178203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.69299999999999995}]},{"osd":1,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.75900000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.78600000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.628},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.745}]}]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":179245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53200000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.1359999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.0269999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.0700000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.90100000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":177669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.48499999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.435}]},{"osd":4,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.54200000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.66200000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.57599999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":417792,"data_stored":171036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.308},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.433}]},{"osd":2,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.77400000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1011712,"data_stored":761348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.43099999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.749},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.79600000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.66000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:04:08.444 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-25T04:04:08.444 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-25T04:04:08.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.626+0000 7fadadbac640 1 Processor -- start 2023-08-25T04:04:08.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.626+0000 7fadadbac640 1 -- start start 2023-08-25T04:04:08.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.626+0000 7fadadbac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fada806c020 0x7fada809bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:08.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.626+0000 7fadadbac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada815abd0 con 0x7fada815a7f0 2023-08-25T04:04:08.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.626+0000 7fadadbac640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada80c8ab0 con 0x7fada80c9830 2023-08-25T04:04:08.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.626+0000 7fadadbac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada80c8d50 con 0x7fada806c020 2023-08-25T04:04:08.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.626+0000 7fada77fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fada815a7f0 0x7fada8070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46544/0 (socket says 172.21.15.55:46544) 2023-08-25T04:04:08.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.626+0000 7fada77fe640 1 -- 172.21.15.55:0/2537567920 learned_addr learned my addr 172.21.15.55:0/2537567920 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:08.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.626+0000 7fada7fff640 1 --2- 172.21.15.55:0/2537567920 >> v2:172.21.15.55:3300/0 conn(0x7fada806c020 0x7fada809bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:08.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.626+0000 7fada7fff640 1 -- 172.21.15.55:0/2537567920 >> v1:172.21.15.110:6789/0 conn(0x7fada80c9830 legacy=0x7fada80acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:08.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.626+0000 7fada7fff640 1 -- 172.21.15.55:0/2537567920 >> v1:172.21.15.55:6789/0 conn(0x7fada815a7f0 legacy=0x7fada8070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:08.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.626+0000 7fada7fff640 1 -- 172.21.15.55:0/2537567920 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada80c9030 con 0x7fada806c020 2023-08-25T04:04:08.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.630+0000 7fada7fff640 1 --2- 172.21.15.55:0/2537567920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fada806c020 0x7fada809bde0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fada0009d90 tx=0x7fada001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f58393fd4f9a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:08.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.630+0000 7fada6ffd640 1 -- 172.21.15.55:0/2537567920 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada00a58f0 con 0x7fada806c020 2023-08-25T04:04:08.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.630+0000 7fada6ffd640 1 -- 172.21.15.55:0/2537567920 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada00a5a50 con 0x7fada806c020 2023-08-25T04:04:08.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.630+0000 7fada6ffd640 1 -- 172.21.15.55:0/2537567920 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada00a5de0 con 0x7fada806c020 2023-08-25T04:04:08.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.630+0000 7fadadbac640 1 -- 172.21.15.55:0/2537567920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fada806c020 msgr2=0x7fada809bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:08.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.630+0000 7fadadbac640 1 --2- 172.21.15.55:0/2537567920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fada806c020 0x7fada809bde0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fada0009d90 tx=0x7fada001c920 comp rx=0 tx=0).stop 2023-08-25T04:04:08.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.630+0000 7fadadbac640 1 -- 172.21.15.55:0/2537567920 shutdown_connections 2023-08-25T04:04:08.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.630+0000 7fadadbac640 1 --2- 172.21.15.55:0/2537567920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fada806c020 0x7fada809bde0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:08.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.630+0000 7fadadbac640 1 -- 172.21.15.55:0/2537567920 >> 172.21.15.55:0/2537567920 conn(0x7fada8069900 msgr2=0x7fada8069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:08.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.630+0000 7fadadbac640 1 -- 172.21.15.55:0/2537567920 shutdown_connections 2023-08-25T04:04:08.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.630+0000 7fadadbac640 1 -- 172.21.15.55:0/2537567920 wait complete. 2023-08-25T04:04:08.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fadadbac640 1 Processor -- start 2023-08-25T04:04:08.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fadadbac640 1 -- start start 2023-08-25T04:04:08.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fadadbac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fada806c020 0x7fada80c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:08.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fadadbac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fada80c9830 0x7fada8165400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:08.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fadadbac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fada815a7f0 0x7fada8165940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:08.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fadadbac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada80c80d0 con 0x7fada815a7f0 2023-08-25T04:04:08.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fadadbac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada80ab150 con 0x7fada80c9830 2023-08-25T04:04:08.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fadadbac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada80ab430 con 0x7fada806c020 2023-08-25T04:04:08.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fada7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fada815a7f0 0x7fada8165940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:08.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fada7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fada815a7f0 0x7fada8165940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39590/0 (socket says 172.21.15.55:39590) 2023-08-25T04:04:08.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fada7fff640 1 -- 172.21.15.55:0/1061164116 learned_addr learned my addr 172.21.15.55:0/1061164116 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:08.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fada77fe640 1 --2- 172.21.15.55:0/1061164116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fada806c020 0x7fada80c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:08.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fad9ffff640 1 --2- 172.21.15.55:0/1061164116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fada80c9830 0x7fada8165400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:08.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fada7fff640 1 -- 172.21.15.55:0/1061164116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fada806c020 msgr2=0x7fada80c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:08.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fada7fff640 1 --2- 172.21.15.55:0/1061164116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fada806c020 0x7fada80c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:08.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fada7fff640 1 -- 172.21.15.55:0/1061164116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fada80c9830 msgr2=0x7fada8165400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:08.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fada7fff640 1 --2- 172.21.15.55:0/1061164116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fada80c9830 0x7fada8165400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:08.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fada7fff640 1 -- 172.21.15.55:0/1061164116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada0009a70 con 0x7fada815a7f0 2023-08-25T04:04:08.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fada7fff640 1 --2- 172.21.15.55:0/1061164116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fada815a7f0 0x7fada8165940 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fada001a550 tx=0x7fada00196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:08.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fada4ff9640 1 -- 172.21.15.55:0/1061164116 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada00b9860 con 0x7fada815a7f0 2023-08-25T04:04:08.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fada4ff9640 1 -- 172.21.15.55:0/1061164116 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada00b99c0 con 0x7fada815a7f0 2023-08-25T04:04:08.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fadadbac640 1 -- 172.21.15.55:0/1061164116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada80adc90 con 0x7fada815a7f0 2023-08-25T04:04:08.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fada4ff9640 1 -- 172.21.15.55:0/1061164116 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada00b9d50 con 0x7fada815a7f0 2023-08-25T04:04:08.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.634+0000 7fadadbac640 1 -- 172.21.15.55:0/1061164116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada8164f10 con 0x7fada815a7f0 2023-08-25T04:04:08.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.638+0000 7fadadbac640 1 -- 172.21.15.55:0/1061164116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada806d5b0 con 0x7fada815a7f0 2023-08-25T04:04:08.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.638+0000 7fada4ff9640 1 -- 172.21.15.55:0/1061164116 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fada00ad440 con 0x7fada815a7f0 2023-08-25T04:04:08.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.638+0000 7fada4ff9640 1 --2- 172.21.15.55:0/1061164116 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fad88065680 0x7fad88067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:08.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.638+0000 7fada4ff9640 1 -- 172.21.15.55:0/1061164116 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fada011e2e0 con 0x7fada815a7f0 2023-08-25T04:04:08.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.638+0000 7fada77fe640 1 --2- 172.21.15.55:0/1061164116 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fad88065680 0x7fad88067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:08.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.638+0000 7fada77fe640 1 --2- 172.21.15.55:0/1061164116 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fad88065680 0x7fad88067b40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fad980010f0 tx=0x7fad98009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:08.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.642+0000 7fada4ff9640 1 -- 172.21.15.55:0/1061164116 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fada00ebe50 con 0x7fada815a7f0 2023-08-25T04:04:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.858+0000 7fadadbac640 1 -- 172.21.15.55:0/1061164116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fada8073ec0 con 0x7fada815a7f0 2023-08-25T04:04:08.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.862+0000 7fada4ff9640 1 -- 172.21.15.55:0/1061164116 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7fada00ef470 con 0x7fada815a7f0 2023-08-25T04:04:08.866 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2023-08-25T04:04:08.867 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g== 2023-08-25T04:04:08.867 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2023-08-25T04:04:08.867 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2023-08-25T04:04:08.867 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-25T04:04:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-08-25T04:04:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.866+0000 7fadadbac640 1 -- 172.21.15.55:0/1061164116 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fad88065680 msgr2=0x7fad88067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.866+0000 7fadadbac640 1 --2- 172.21.15.55:0/1061164116 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fad88065680 0x7fad88067b40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fad980010f0 tx=0x7fad98009040 comp rx=0 tx=0).stop 2023-08-25T04:04:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.866+0000 7fadadbac640 1 -- 172.21.15.55:0/1061164116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fada815a7f0 msgr2=0x7fada8165940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.866+0000 7fadadbac640 1 --2- 172.21.15.55:0/1061164116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fada815a7f0 0x7fada8165940 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fada001a550 tx=0x7fada00196c0 comp rx=0 tx=0).stop 2023-08-25T04:04:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.866+0000 7fadadbac640 1 -- 172.21.15.55:0/1061164116 shutdown_connections 2023-08-25T04:04:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.866+0000 7fadadbac640 1 --2- 172.21.15.55:0/1061164116 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fad88065680 0x7fad88067b40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.866+0000 7fadadbac640 1 --2- 172.21.15.55:0/1061164116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fada815a7f0 0x7fada8165940 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.866+0000 7fadadbac640 1 --2- 172.21.15.55:0/1061164116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fada80c9830 0x7fada8165400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.866+0000 7fadadbac640 1 --2- 172.21.15.55:0/1061164116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fada806c020 0x7fada80c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:08.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.866+0000 7fadadbac640 1 -- 172.21.15.55:0/1061164116 >> 172.21.15.55:0/1061164116 conn(0x7fada8069900 msgr2=0x7fada80aee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:08.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.866+0000 7fadadbac640 1 -- 172.21.15.55:0/1061164116 shutdown_connections 2023-08-25T04:04:08.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:08.866+0000 7fadadbac640 1 -- 172.21.15.55:0/1061164116 wait complete. 2023-08-25T04:04:08.887 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:04:09.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.026+0000 7fcf237ba640 1 Processor -- start 2023-08-25T04:04:09.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.026+0000 7fcf237ba640 1 -- start start 2023-08-25T04:04:09.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.030+0000 7fcf237ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcf1c164410 0x7fcf1c0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.030+0000 7fcf237ba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf1c0c1a80 0x7fcf1c06bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.030+0000 7fcf237ba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1c0cc510 con 0x7fcf1c0cddf0 2023-08-25T04:04:09.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.030+0000 7fcf237ba640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c1647f0 con 0x7fcf1c0c1a80 2023-08-25T04:04:09.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.030+0000 7fcf237ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c0cc9b0 con 0x7fcf1c164410 2023-08-25T04:04:09.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.030+0000 7fcf21d57640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf1c0c1a80 0x7fcf1c06bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.030+0000 7fcf20d55640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcf1c0cddf0 0x7fcf1c0c1370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46552/0 (socket says 172.21.15.55:46552) 2023-08-25T04:04:09.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.030+0000 7fcf20d55640 1 -- 172.21.15.55:0/1717626963 learned_addr learned my addr 172.21.15.55:0/1717626963 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:09.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.030+0000 7fcf21556640 1 --2- 172.21.15.55:0/1717626963 >> v2:172.21.15.110:3300/0 conn(0x7fcf1c164410 0x7fcf1c0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.030+0000 7fcf21d57640 1 -- 172.21.15.55:0/1717626963 >> v2:172.21.15.110:3300/0 conn(0x7fcf1c164410 msgr2=0x7fcf1c0b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:09.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.030+0000 7fcf21d57640 1 --2- 172.21.15.55:0/1717626963 >> v2:172.21.15.110:3300/0 conn(0x7fcf1c164410 0x7fcf1c0b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.030+0000 7fcf21d57640 1 -- 172.21.15.55:0/1717626963 >> v1:172.21.15.55:6789/0 conn(0x7fcf1c0cddf0 legacy=0x7fcf1c0c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:09.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.030+0000 7fcf21d57640 1 -- 172.21.15.55:0/1717626963 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c0ccc90 con 0x7fcf1c0c1a80 2023-08-25T04:04:09.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.030+0000 7fcf13fff640 1 -- 172.21.15.55:0/1717626963 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202549300 0 0) 0x7fcf1c0cc510 con 0x7fcf1c0cddf0 2023-08-25T04:04:09.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf21d57640 1 --2- 172.21.15.55:0/1717626963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf1c0c1a80 0x7fcf1c06bb40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0cec10 tx=0x7fcf1401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4519c67e2ac6f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:09.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf13fff640 1 -- 172.21.15.55:0/1717626963 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf140a57b0 con 0x7fcf1c0c1a80 2023-08-25T04:04:09.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf13fff640 1 -- 172.21.15.55:0/1717626963 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf140a5910 con 0x7fcf1c0c1a80 2023-08-25T04:04:09.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf13fff640 1 -- 172.21.15.55:0/1717626963 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf140a5ca0 con 0x7fcf1c0c1a80 2023-08-25T04:04:09.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf237ba640 1 -- 172.21.15.55:0/1717626963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf1c0c1a80 msgr2=0x7fcf1c06bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:09.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf237ba640 1 --2- 172.21.15.55:0/1717626963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf1c0c1a80 0x7fcf1c06bb40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0cec10 tx=0x7fcf1401c910 comp rx=0 tx=0).stop 2023-08-25T04:04:09.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf237ba640 1 -- 172.21.15.55:0/1717626963 shutdown_connections 2023-08-25T04:04:09.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf237ba640 1 --2- 172.21.15.55:0/1717626963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf1c0c1a80 0x7fcf1c06bb40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf237ba640 1 --2- 172.21.15.55:0/1717626963 >> v2:172.21.15.110:3300/0 conn(0x7fcf1c164410 0x7fcf1c0b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf237ba640 1 -- 172.21.15.55:0/1717626963 >> 172.21.15.55:0/1717626963 conn(0x7fcf1c069d00 msgr2=0x7fcf1c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:09.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf237ba640 1 -- 172.21.15.55:0/1717626963 shutdown_connections 2023-08-25T04:04:09.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf237ba640 1 -- 172.21.15.55:0/1717626963 wait complete. 2023-08-25T04:04:09.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf237ba640 1 Processor -- start 2023-08-25T04:04:09.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf237ba640 1 -- start start 2023-08-25T04:04:09.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf237ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf1c0c1a80 0x7fcf1c0c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf237ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf1c0cddf0 0x7fcf1c0c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf237ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf1c164410 0x7fcf1c1629b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf237ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c0c73e0 con 0x7fcf1c0c1a80 2023-08-25T04:04:09.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf237ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c0c2870 con 0x7fcf1c164410 2023-08-25T04:04:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.034+0000 7fcf237ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c0c2b50 con 0x7fcf1c0cddf0 2023-08-25T04:04:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf21556640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf1c0c1a80 0x7fcf1c0c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf21556640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf1c0c1a80 0x7fcf1c0c6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39612/0 (socket says 172.21.15.55:39612) 2023-08-25T04:04:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf21556640 1 -- 172.21.15.55:0/70622362 learned_addr learned my addr 172.21.15.55:0/70622362 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf21d57640 1 --2- 172.21.15.55:0/70622362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf1c164410 0x7fcf1c1629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf20d55640 1 --2- 172.21.15.55:0/70622362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf1c0cddf0 0x7fcf1c0c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf21556640 1 -- 172.21.15.55:0/70622362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf1c0cddf0 msgr2=0x7fcf1c0c3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf21556640 1 --2- 172.21.15.55:0/70622362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf1c0cddf0 0x7fcf1c0c3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf21556640 1 -- 172.21.15.55:0/70622362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf1c164410 msgr2=0x7fcf1c1629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf21556640 1 --2- 172.21.15.55:0/70622362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf1c164410 0x7fcf1c1629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf21556640 1 -- 172.21.15.55:0/70622362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf14009a70 con 0x7fcf1c0c1a80 2023-08-25T04:04:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf21d57640 1 --2- 172.21.15.55:0/70622362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf1c164410 0x7fcf1c1629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf21556640 1 --2- 172.21.15.55:0/70622362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf1c0c1a80 0x7fcf1c0c6d50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800d5f0 tx=0x7fcf1800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf11ffb640 1 -- 172.21.15.55:0/70622362 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf180125f0 con 0x7fcf1c0c1a80 2023-08-25T04:04:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf11ffb640 1 -- 172.21.15.55:0/70622362 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf18012750 con 0x7fcf1c0c1a80 2023-08-25T04:04:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf237ba640 1 -- 172.21.15.55:0/70622362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1c0c2e30 con 0x7fcf1c0c1a80 2023-08-25T04:04:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf11ffb640 1 -- 172.21.15.55:0/70622362 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18012ae0 con 0x7fcf1c0c1a80 2023-08-25T04:04:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf237ba640 1 -- 172.21.15.55:0/70622362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c15f9d0 con 0x7fcf1c0c1a80 2023-08-25T04:04:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf237ba640 1 -- 172.21.15.55:0/70622362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1c04dbe0 con 0x7fcf1c0c1a80 2023-08-25T04:04:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.038+0000 7fcf11ffb640 1 -- 172.21.15.55:0/70622362 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fcf18012c40 con 0x7fcf1c0c1a80 2023-08-25T04:04:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.042+0000 7fcf11ffb640 1 --2- 172.21.15.55:0/70622362 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcf00065680 0x7fcf00067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.042+0000 7fcf11ffb640 1 -- 172.21.15.55:0/70622362 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf180832f0 con 0x7fcf1c0c1a80 2023-08-25T04:04:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.042+0000 7fcf20d55640 1 --2- 172.21.15.55:0/70622362 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcf00065680 0x7fcf00067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.042+0000 7fcf20d55640 1 --2- 172.21.15.55:0/70622362 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcf00065680 0x7fcf00067b40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c163690 tx=0x7fcf0c007b60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.046+0000 7fcf11ffb640 1 -- 172.21.15.55:0/70622362 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fcf18050db0 con 0x7fcf1c0c1a80 2023-08-25T04:04:09.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.234+0000 7fcf237ba640 1 -- 172.21.15.55:0/70622362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf1c073ef0 con 0x7fcf1c0c1a80 2023-08-25T04:04:09.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.234+0000 7fcf11ffb640 1 -- 172.21.15.55:0/70622362 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4881 (secure 0 0 0) 0x7fcf18007380 con 0x7fcf1c0c1a80 2023-08-25T04:04:09.236 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:04:09.237 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4838,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1920231780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1920231780},{"type":"v1","addr":"172.21.15.110:6837","nonce":1920231780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2215940247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2215940247},{"type":"v1","addr":"172.21.15.55:6835","nonce":2215940247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1708341067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1708341067},{"type":"v1","addr":"172.21.15.110:6836","nonce":1708341067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:03:58.767654+0000","modified":"2023-08-25T04:04:02.406061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5080":{"gid":5080,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6834/2079290775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2079290775},{"type":"v1","addr":"172.21.15.55:6834","nonce":2079290775}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-25T04:04:09.237 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 15 2023-08-25T04:04:09.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.234+0000 7fcf237ba640 1 -- 172.21.15.55:0/70622362 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcf00065680 msgr2=0x7fcf00067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:09.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.234+0000 7fcf237ba640 1 --2- 172.21.15.55:0/70622362 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcf00065680 0x7fcf00067b40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c163690 tx=0x7fcf0c007b60 comp rx=0 tx=0).stop 2023-08-25T04:04:09.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.234+0000 7fcf237ba640 1 -- 172.21.15.55:0/70622362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf1c0c1a80 msgr2=0x7fcf1c0c6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:09.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.234+0000 7fcf237ba640 1 --2- 172.21.15.55:0/70622362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf1c0c1a80 0x7fcf1c0c6d50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800d5f0 tx=0x7fcf1800dab0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.234+0000 7fcf237ba640 1 -- 172.21.15.55:0/70622362 shutdown_connections 2023-08-25T04:04:09.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.234+0000 7fcf237ba640 1 --2- 172.21.15.55:0/70622362 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fcf00065680 0x7fcf00067b40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.234+0000 7fcf237ba640 1 --2- 172.21.15.55:0/70622362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf1c164410 0x7fcf1c1629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.234+0000 7fcf237ba640 1 --2- 172.21.15.55:0/70622362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf1c0cddf0 0x7fcf1c0c3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.234+0000 7fcf237ba640 1 --2- 172.21.15.55:0/70622362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf1c0c1a80 0x7fcf1c0c6d50 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.234+0000 7fcf237ba640 1 -- 172.21.15.55:0/70622362 >> 172.21.15.55:0/70622362 conn(0x7fcf1c069d00 msgr2=0x7fcf1c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:09.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.234+0000 7fcf237ba640 1 -- 172.21.15.55:0/70622362 shutdown_connections 2023-08-25T04:04:09.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.234+0000 7fcf237ba640 1 -- 172.21.15.55:0/70622362 wait complete. 2023-08-25T04:04:09.659 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-25T04:03:58.767654+0000', 'modified': '2023-08-25T04:04:02.406061+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5080}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5080': {'gid': 5080, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.55:6834/2079290775', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6833', 'nonce': 2079290775}, {'type': 'v1', 'addr': '172.21.15.55:6834', 'nonce': 2079290775}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-25T04:04:09.660 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-25T04:04:09.660 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-25T04:04:09.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1bb688640 1 Processor -- start 2023-08-25T04:04:09.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1bb688640 1 -- start start 2023-08-25T04:04:09.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1bb688640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1b40ceff0 0x7ff1b4069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1bb688640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff1b4069e40 0x7ff1b40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1bb688640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b406c4f0 con 0x7ff1b40aeb10 2023-08-25T04:04:09.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1bb688640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b40d0380 con 0x7ff1b4069e40 2023-08-25T04:04:09.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1bb688640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b406d590 con 0x7ff1b40ceff0 2023-08-25T04:04:09.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1b9424640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff1b40aeb10 0x7ff1b40ce8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46566/0 (socket says 172.21.15.55:46566) 2023-08-25T04:04:09.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1b9424640 1 -- 172.21.15.55:0/4265262402 learned_addr learned my addr 172.21.15.55:0/4265262402 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:09.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1abfff640 1 -- 172.21.15.55:0/4265262402 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989120421 0 0) 0x7ff1b406c4f0 con 0x7ff1b40aeb10 2023-08-25T04:04:09.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/4265262402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1b40ceff0 0x7ff1b4069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1abfff640 1 -- 172.21.15.55:0/4265262402 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1a0003530 con 0x7ff1b40aeb10 2023-08-25T04:04:09.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1b9c25640 1 --2- 172.21.15.55:0/4265262402 >> v2:172.21.15.110:3300/0 conn(0x7ff1b4069e40 0x7ff1b40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1abfff640 1 -- 172.21.15.55:0/4265262402 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1472953226 0 0) 0x7ff1a0003530 con 0x7ff1b40aeb10 2023-08-25T04:04:09.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1abfff640 1 -- 172.21.15.55:0/4265262402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1b40ceff0 msgr2=0x7ff1b4069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:09.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1abfff640 1 --2- 172.21.15.55:0/4265262402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1b40ceff0 0x7ff1b4069900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1abfff640 1 -- 172.21.15.55:0/4265262402 >> v2:172.21.15.110:3300/0 conn(0x7ff1b4069e40 msgr2=0x7ff1b40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:09.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1abfff640 1 --2- 172.21.15.55:0/4265262402 >> v2:172.21.15.110:3300/0 conn(0x7ff1b4069e40 0x7ff1b40cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1abfff640 1 -- 172.21.15.55:0/4265262402 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b406c7d0 con 0x7ff1b40aeb10 2023-08-25T04:04:09.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1abfff640 1 -- 172.21.15.55:0/4265262402 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7ff1b0001680 con 0x7ff1b40aeb10 2023-08-25T04:04:09.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1abfff640 1 -- 172.21.15.55:0/4265262402 >> v1:172.21.15.55:6789/0 conn(0x7ff1b40aeb10 legacy=0x7ff1b40ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:09.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1abfff640 1 --2- 172.21.15.55:0/4265262402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a0003980 0x7ff1a0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1abfff640 1 --2- 172.21.15.55:0/4265262402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1a00047d0 0x7ff1a0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1abfff640 1 --2- 172.21.15.55:0/4265262402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1b40ceff0 0x7ff1a0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1abfff640 1 -- 172.21.15.55:0/4265262402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b40d0380 con 0x7ff1a00047d0 2023-08-25T04:04:09.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1abfff640 1 -- 172.21.15.55:0/4265262402 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b406d590 con 0x7ff1a0003980 2023-08-25T04:04:09.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1abfff640 1 -- 172.21.15.55:0/4265262402 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a000b990 con 0x7ff1b40ceff0 2023-08-25T04:04:09.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/4265262402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1a00047d0 0x7ff1a0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1b9424640 1 --2- 172.21.15.55:0/4265262402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a0003980 0x7ff1a0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.806+0000 7ff1b9c25640 1 --2- 172.21.15.55:0/4265262402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1b40ceff0 0x7ff1a0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.810+0000 7ff1b8c23640 1 -- 172.21.15.55:0/4265262402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1b40ceff0 msgr2=0x7ff1a0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:09.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.810+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/4265262402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1b40ceff0 0x7ff1a0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.810+0000 7ff1b8c23640 1 -- 172.21.15.55:0/4265262402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a0003980 msgr2=0x7ff1a0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:09.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.810+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/4265262402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a0003980 0x7ff1a0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.810+0000 7ff1b8c23640 1 -- 172.21.15.55:0/4265262402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a0003530 con 0x7ff1a00047d0 2023-08-25T04:04:09.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.810+0000 7ff1b9c25640 1 --2- 172.21.15.55:0/4265262402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1b40ceff0 0x7ff1a0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:09.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.810+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/4265262402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1a00047d0 0x7ff1a0004c50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009ae0 tx=0x7ff1a401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e555f23949befd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:09.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.810+0000 7ff1abfff640 1 -- 172.21.15.55:0/4265262402 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a40a5560 con 0x7ff1a00047d0 2023-08-25T04:04:09.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.810+0000 7ff1abfff640 1 -- 172.21.15.55:0/4265262402 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a40a56c0 con 0x7ff1a00047d0 2023-08-25T04:04:09.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.810+0000 7ff1abfff640 1 -- 172.21.15.55:0/4265262402 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a40a5a70 con 0x7ff1a00047d0 2023-08-25T04:04:09.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.810+0000 7ff1bb688640 1 -- 172.21.15.55:0/4265262402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1a00047d0 msgr2=0x7ff1a0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:09.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.810+0000 7ff1bb688640 1 --2- 172.21.15.55:0/4265262402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1a00047d0 0x7ff1a0004c50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009ae0 tx=0x7ff1a401ca50 comp rx=0 tx=0).stop 2023-08-25T04:04:09.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.810+0000 7ff1b9c25640 1 -- 172.21.15.55:0/4265262402 reap_dead start 2023-08-25T04:04:09.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.810+0000 7ff1bb688640 1 -- 172.21.15.55:0/4265262402 shutdown_connections 2023-08-25T04:04:09.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.810+0000 7ff1bb688640 1 -- 172.21.15.55:0/4265262402 >> 172.21.15.55:0/4265262402 conn(0x7ff1b40cf530 msgr2=0x7ff1b40cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:09.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.810+0000 7ff1bb688640 1 -- 172.21.15.55:0/4265262402 shutdown_connections 2023-08-25T04:04:09.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.810+0000 7ff1bb688640 1 -- 172.21.15.55:0/4265262402 wait complete. 2023-08-25T04:04:09.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1bb688640 1 Processor -- start 2023-08-25T04:04:09.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1bb688640 1 -- start start 2023-08-25T04:04:09.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1bb688640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a00047d0 0x7ff1b414c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1bb688640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1b40ac110 0x7ff1b40ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1bb688640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1b41f20e0 0x7ff1b41f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1bb688640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b41f32d0 con 0x7ff1b40ac110 2023-08-25T04:04:09.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1bb688640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b40acad0 con 0x7ff1a00047d0 2023-08-25T04:04:09.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1bb688640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b40c8f30 con 0x7ff1b41f20e0 2023-08-25T04:04:09.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1b8c23640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1b40ac110 0x7ff1b40ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1b8c23640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1b40ac110 0x7ff1b40ac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39638/0 (socket says 172.21.15.55:39638) 2023-08-25T04:04:09.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1b8c23640 1 -- 172.21.15.55:0/2668796845 learned_addr learned my addr 172.21.15.55:0/2668796845 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:09.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1b9424640 1 --2- 172.21.15.55:0/2668796845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a00047d0 0x7ff1b414c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1b9c25640 1 --2- 172.21.15.55:0/2668796845 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1b41f20e0 0x7ff1b41f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1b8c23640 1 -- 172.21.15.55:0/2668796845 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1b41f20e0 msgr2=0x7ff1b41f2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:09.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/2668796845 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1b41f20e0 0x7ff1b41f2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1b8c23640 1 -- 172.21.15.55:0/2668796845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a00047d0 msgr2=0x7ff1b414c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:09.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/2668796845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a00047d0 0x7ff1b414c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1b8c23640 1 -- 172.21.15.55:0/2668796845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b40b21c0 con 0x7ff1b40ac110 2023-08-25T04:04:09.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1b9c25640 1 --2- 172.21.15.55:0/2668796845 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1b41f20e0 0x7ff1b41f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:04:09.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/2668796845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1b40ac110 0x7ff1b40ac590 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40b0040 tx=0x7ff1a0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:09.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1a9ffb640 1 -- 172.21.15.55:0/2668796845 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4004220 con 0x7ff1b40ac110 2023-08-25T04:04:09.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1a9ffb640 1 -- 172.21.15.55:0/2668796845 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a4004380 con 0x7ff1b40ac110 2023-08-25T04:04:09.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1a9ffb640 1 -- 172.21.15.55:0/2668796845 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4003860 con 0x7ff1b40ac110 2023-08-25T04:04:09.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.814+0000 7ff1bb688640 1 -- 172.21.15.55:0/2668796845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b41f2aa0 con 0x7ff1b40ac110 2023-08-25T04:04:09.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.818+0000 7ff1bb688640 1 -- 172.21.15.55:0/2668796845 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b41f2d20 con 0x7ff1b40ac110 2023-08-25T04:04:09.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.818+0000 7ff1a9ffb640 1 -- 172.21.15.55:0/2668796845 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff1a40b4040 con 0x7ff1b40ac110 2023-08-25T04:04:09.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.818+0000 7ff1a9ffb640 1 --2- 172.21.15.55:0/2668796845 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff198065680 0x7ff198067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.818+0000 7ff1a9ffb640 1 -- 172.21.15.55:0/2668796845 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1a411d3f0 con 0x7ff1b40ac110 2023-08-25T04:04:09.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1be9e7000 1 Processor -- start 2023-08-25T04:04:09.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1b9424640 1 --2- 172.21.15.55:0/2668796845 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff198065680 0x7ff198067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1be9e7000 1 -- start start 2023-08-25T04:04:09.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1b9424640 1 --2- 172.21.15.55:0/2668796845 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff198065680 0x7ff198067b40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff1b409d3e0 tx=0x7ff1b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:09.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1be9e7000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92020 0x564813c92400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1be9e7000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c92940 0x564813c48070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1be9e7000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c485b0 0x564813c48990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1be9e7000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564813a9e440 con 0x564813c92940 2023-08-25T04:04:09.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1be9e7000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x564813a9b970 con 0x564813c92020 2023-08-25T04:04:09.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1be9e7000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x564813a97260 con 0x564813c485b0 2023-08-25T04:04:09.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1b8c23640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c92940 0x564813c48070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1b8c23640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c92940 0x564813c48070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39646/0 (socket says 172.21.15.55:39646) 2023-08-25T04:04:09.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1b8c23640 1 -- 172.21.15.55:0/1754653799 learned_addr learned my addr 172.21.15.55:0/1754653799 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:09.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1b9424640 1 --2- 172.21.15.55:0/1754653799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92020 0x564813c92400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1b9c25640 1 --2- 172.21.15.55:0/1754653799 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c485b0 0x564813c48990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1b8c23640 1 -- 172.21.15.55:0/1754653799 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c485b0 msgr2=0x564813c48990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:09.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/1754653799 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c485b0 0x564813c48990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1b8c23640 1 -- 172.21.15.55:0/1754653799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92020 msgr2=0x564813c92400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:09.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/1754653799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92020 0x564813c92400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1b8c23640 1 -- 172.21.15.55:0/1754653799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564813b2fec0 con 0x564813c92940 2023-08-25T04:04:09.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1b9c25640 1 --2- 172.21.15.55:0/1754653799 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c485b0 0x564813c48990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:04:09.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/1754653799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c92940 0x564813c48070 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff1a401c880 tx=0x7ff1a40ee5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aed3032083bde80 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:09.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff196ffd640 1 -- 172.21.15.55:0/1754653799 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a40ecf20 con 0x564813c92940 2023-08-25T04:04:09.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff196ffd640 1 -- 172.21.15.55:0/1754653799 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a40096b0 con 0x564813c92940 2023-08-25T04:04:09.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff196ffd640 1 -- 172.21.15.55:0/1754653799 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a40eb290 con 0x564813c92940 2023-08-25T04:04:09.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1be9e7000 1 -- 172.21.15.55:0/1754653799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c92940 msgr2=0x564813c48070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:09.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/1754653799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c92940 0x564813c48070 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff1a401c880 tx=0x7ff1a40ee5a0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1be9e7000 1 -- 172.21.15.55:0/1754653799 shutdown_connections 2023-08-25T04:04:09.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/1754653799 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c485b0 0x564813c48990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/1754653799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c92940 0x564813c48070 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/1754653799 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92020 0x564813c92400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1be9e7000 1 -- 172.21.15.55:0/1754653799 >> 172.21.15.55:0/1754653799 conn(0x564813c44560 msgr2=0x564813c46950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:09.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1be9e7000 1 -- 172.21.15.55:0/1754653799 shutdown_connections 2023-08-25T04:04:09.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1be9e7000 1 -- 172.21.15.55:0/1754653799 wait complete. 2023-08-25T04:04:09.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.822+0000 7ff1be9e7000 1 -- start start 2023-08-25T04:04:09.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1be9e7000 1 Processor -- start 2023-08-25T04:04:09.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1be9e7000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c485b0 0x564813c99380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1be9e7000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c92020 0x564813c998c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1be9e7000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92940 0x564813c7fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1be9e7000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564813a51f60 con 0x564813c485b0 2023-08-25T04:04:09.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1be9e7000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x564813a51c00 con 0x564813c92940 2023-08-25T04:04:09.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1be9e7000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x564813752940 con 0x564813c92020 2023-08-25T04:04:09.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1be9e7000 10 client.0 _ll_register_callbacks cb 0x564813c33900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:04:09.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1b9424640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c485b0 0x564813c99380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1b9424640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c485b0 0x564813c99380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39654/0 (socket says 172.21.15.55:39654) 2023-08-25T04:04:09.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1b9424640 1 -- 172.21.15.55:0/3242047345 learned_addr learned my addr 172.21.15.55:0/3242047345 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:09.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1b9c25640 1 --2- 172.21.15.55:0/3242047345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92940 0x564813c7fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/3242047345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c92020 0x564813c998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1b9424640 1 -- 172.21.15.55:0/3242047345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c92020 msgr2=0x564813c998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:09.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1b9424640 1 --2- 172.21.15.55:0/3242047345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c92020 0x564813c998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1b9424640 1 -- 172.21.15.55:0/3242047345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92940 msgr2=0x564813c7fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:09.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1b9424640 1 --2- 172.21.15.55:0/3242047345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92940 0x564813c7fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1b9424640 1 -- 172.21.15.55:0/3242047345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b41f2d20 con 0x564813c485b0 2023-08-25T04:04:09.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/3242047345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c92020 0x564813c998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:09.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1b9424640 1 --2- 172.21.15.55:0/3242047345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c485b0 0x564813c99380 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0014c70 tx=0x7ff1b0001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20178030cd6483bc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:09.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff18ffff640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T04:04:09.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff18ffff640 1 -- 172.21.15.55:0/3242047345 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b001c040 con 0x564813c485b0 2023-08-25T04:04:09.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1be9e7000 1 -- 172.21.15.55:0/3242047345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564813a2e9d0 con 0x564813c485b0 2023-08-25T04:04:09.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff18ffff640 1 -- 172.21.15.55:0/3242047345 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1b000f9d0 con 0x564813c485b0 2023-08-25T04:04:09.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff18ffff640 1 -- 172.21.15.55:0/3242047345 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1b0014eb0 con 0x564813c485b0 2023-08-25T04:04:09.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1be9e7000 10 client.5442 fetch_fsmap learned FSMap version 15 2023-08-25T04:04:09.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1be9e7000 1 -- 172.21.15.55:0/3242047345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x564813791890 con 0x564813c485b0 2023-08-25T04:04:09.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff18ffff640 1 -- 172.21.15.55:0/3242047345 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b0033020 con 0x564813c485b0 2023-08-25T04:04:09.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff18ffff640 1 -- 172.21.15.55:0/3242047345 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff1b0022050 con 0x564813c485b0 2023-08-25T04:04:09.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1be9e7000 10 client.5442 fetch_fsmap finished waiting for FSMap version 15 2023-08-25T04:04:09.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1be9e7000 10 client.5442 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T04:04:09.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1be9e7000 20 client.5442 populate_metadata read hostname 'smithi055' 2023-08-25T04:04:09.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/3242047345 >> [v2:172.21.15.55:6833/2079290775,v1:172.21.15.55:6834/2079290775] conn(0x564813c80b40 0x564813c80f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1be9e7000 4 client.5442 mds_command: new command op to 5080 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-25T04:04:09.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1be9e7000 1 -- 172.21.15.55:0/3242047345 --> [v2:172.21.15.55:6833/2079290775,v1:172.21.15.55:6834/2079290775] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564813a4e7a0 con 0x564813c80b40 2023-08-25T04:04:09.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/3242047345 >> [v2:172.21.15.55:6833/2079290775,v1:172.21.15.55:6834/2079290775] conn(0x564813c80b40 0x564813c80f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/3242047345 >> [v2:172.21.15.55:6833/2079290775,v1:172.21.15.55:6834/2079290775] conn(0x564813c80b40 0x564813c80f20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=942a313beb6652de server_cookie=16505d1e12e19d36 in_seq=0 out_seq=0 2023-08-25T04:04:09.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.826+0000 7ff18ffff640 10 client.5442 ms_handle_connect on v2:172.21.15.55:6833/2079290775 2023-08-25T04:04:09.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.830+0000 7ff18ffff640 1 -- 172.21.15.55:0/3242047345 <== mds.0 v2:172.21.15.55:6833/2079290775 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564813a4e7a0 con 0x564813c80b40 2023-08-25T04:04:09.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.830+0000 7ff18ffff640 10 client.5442 handle_command_reply: tid=0 2023-08-25T04:04:09.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.830+0000 7ff1be9e7000 1 client.5442 shutdown 2023-08-25T04:04:09.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.830+0000 7ff1be9e7000 1 -- 172.21.15.55:0/3242047345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c485b0 msgr2=0x564813c99380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:09.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.830+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/3242047345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c485b0 0x564813c99380 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0014c70 tx=0x7ff1b0001a10 comp rx=0 tx=0).stop 2023-08-25T04:04:09.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.830+0000 7ff1be9e7000 1 -- 172.21.15.55:0/3242047345 shutdown_connections 2023-08-25T04:04:09.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.830+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/3242047345 >> [v2:172.21.15.55:6833/2079290775,v1:172.21.15.55:6834/2079290775] conn(0x564813c80b40 0x564813c80f20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.830+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/3242047345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92940 0x564813c7fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.830+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/3242047345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c92020 0x564813c998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.830+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/3242047345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c485b0 0x564813c99380 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.830+0000 7ff18ffff640 0 client.5442 ms_handle_reset on v2:172.21.15.55:6833/2079290775 2023-08-25T04:04:09.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.830+0000 7ff1be9e7000 1 -- 172.21.15.55:0/3242047345 >> 172.21.15.55:0/3242047345 conn(0x564813c44560 msgr2=0x564813c471e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:09.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.830+0000 7ff1be9e7000 1 -- 172.21.15.55:0/3242047345 shutdown_connections 2023-08-25T04:04:09.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.830+0000 7ff1be9e7000 1 -- 172.21.15.55:0/3242047345 wait complete. 2023-08-25T04:04:09.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.830+0000 7ff1be9e7000 20 client.5442 trim_cache size 0 max 16384 2023-08-25T04:04:09.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1be9e7000 1 Processor -- start 2023-08-25T04:04:09.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1be9e7000 1 -- start start 2023-08-25T04:04:09.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1be9e7000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c485b0 0x564813cebd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1be9e7000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92020 0x564813cec2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1be9e7000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c92940 0x564813cec800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1be9e7000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564813a97260 con 0x564813c92940 2023-08-25T04:04:09.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1be9e7000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x564813a34d10 con 0x564813c92020 2023-08-25T04:04:09.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1be9e7000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x564813a960f0 con 0x564813c485b0 2023-08-25T04:04:09.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1b9c25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c92940 0x564813cec800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1b9c25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c92940 0x564813cec800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39668/0 (socket says 172.21.15.55:39668) 2023-08-25T04:04:09.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1b9c25640 1 -- 172.21.15.55:0/3056859406 learned_addr learned my addr 172.21.15.55:0/3056859406 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:09.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1b9424640 1 --2- 172.21.15.55:0/3056859406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c485b0 0x564813cebd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/3056859406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92020 0x564813cec2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1b9c25640 1 -- 172.21.15.55:0/3056859406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c485b0 msgr2=0x564813cebd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:09.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1b9c25640 1 --2- 172.21.15.55:0/3056859406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c485b0 0x564813cebd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1b9c25640 1 -- 172.21.15.55:0/3056859406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92020 msgr2=0x564813cec2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:09.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1b9c25640 1 --2- 172.21.15.55:0/3056859406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92020 0x564813cec2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1b9c25640 1 -- 172.21.15.55:0/3056859406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564813a5a190 con 0x564813c92940 2023-08-25T04:04:09.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1b9c25640 1 --2- 172.21.15.55:0/3056859406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c92940 0x564813cec800 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40707d0 tx=0x7ff1ac009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c435baee364d54b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:09.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1977fe640 1 -- 172.21.15.55:0/3056859406 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac00e040 con 0x564813c92940 2023-08-25T04:04:09.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1977fe640 1 -- 172.21.15.55:0/3056859406 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac017610 con 0x564813c92940 2023-08-25T04:04:09.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1977fe640 1 -- 172.21.15.55:0/3056859406 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac017980 con 0x564813c92940 2023-08-25T04:04:09.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1be9e7000 1 -- 172.21.15.55:0/3056859406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c92940 msgr2=0x564813cec800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:09.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/3056859406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c92940 0x564813cec800 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40707d0 tx=0x7ff1ac009750 comp rx=0 tx=0).stop 2023-08-25T04:04:09.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1be9e7000 1 -- 172.21.15.55:0/3056859406 shutdown_connections 2023-08-25T04:04:09.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/3056859406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c92940 0x564813cec800 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/3056859406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92020 0x564813cec2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/3056859406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c485b0 0x564813cebd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1be9e7000 1 -- 172.21.15.55:0/3056859406 >> 172.21.15.55:0/3056859406 conn(0x564813c44560 msgr2=0x564813c90fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:09.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1be9e7000 1 -- 172.21.15.55:0/3056859406 shutdown_connections 2023-08-25T04:04:09.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.846+0000 7ff1be9e7000 1 -- 172.21.15.55:0/3056859406 wait complete. 2023-08-25T04:04:09.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1be9e7000 1 -- start start 2023-08-25T04:04:09.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1be9e7000 1 Processor -- start 2023-08-25T04:04:09.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1be9e7000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c485b0 0x564813cf06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1be9e7000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92020 0x564813cf0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1be9e7000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c92940 0x564813c966f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1be9e7000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564813a9fa10 con 0x564813c485b0 2023-08-25T04:04:09.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1be9e7000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x564813a9b260 con 0x564813c92020 2023-08-25T04:04:09.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1be9e7000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x564813a3a0d0 con 0x564813c92940 2023-08-25T04:04:09.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1be9e7000 10 client.0 _ll_register_callbacks cb 0x7ff1a4004590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:04:09.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1b9424640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c485b0 0x564813cf06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1b9424640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c485b0 0x564813cf06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39670/0 (socket says 172.21.15.55:39670) 2023-08-25T04:04:09.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1b9424640 1 -- 172.21.15.55:0/2236535617 learned_addr learned my addr 172.21.15.55:0/2236535617 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:09.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1b9c25640 1 --2- 172.21.15.55:0/2236535617 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c92940 0x564813c966f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/2236535617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92020 0x564813cf0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1b9424640 1 -- 172.21.15.55:0/2236535617 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c92940 msgr2=0x564813c966f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:09.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1b9424640 1 --2- 172.21.15.55:0/2236535617 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c92940 0x564813c966f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1b9424640 1 -- 172.21.15.55:0/2236535617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92020 msgr2=0x564813cf0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:09.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1b9424640 1 --2- 172.21.15.55:0/2236535617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92020 0x564813cf0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1b9424640 1 -- 172.21.15.55:0/2236535617 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ac0039a0 con 0x564813c485b0 2023-08-25T04:04:09.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1b9424640 1 --2- 172.21.15.55:0/2236535617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c485b0 0x564813cf06b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0014c10 tx=0x7ff1b0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c78e60998ab0258 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:09.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff18ffff640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T04:04:09.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff18ffff640 1 -- 172.21.15.55:0/2236535617 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b000fa70 con 0x564813c485b0 2023-08-25T04:04:09.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1be9e7000 1 -- 172.21.15.55:0/2236535617 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564813ca8ab0 con 0x564813c485b0 2023-08-25T04:04:09.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff18ffff640 1 -- 172.21.15.55:0/2236535617 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1b0034080 con 0x564813c485b0 2023-08-25T04:04:09.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff18ffff640 1 -- 172.21.15.55:0/2236535617 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1b0001a10 con 0x564813c485b0 2023-08-25T04:04:09.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1be9e7000 10 client.5448 fetch_fsmap learned FSMap version 15 2023-08-25T04:04:09.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1be9e7000 1 -- 172.21.15.55:0/2236535617 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x564813a40420 con 0x564813c485b0 2023-08-25T04:04:09.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff18ffff640 1 -- 172.21.15.55:0/2236535617 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564813ca8ab0 con 0x564813c485b0 2023-08-25T04:04:09.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff18ffff640 1 -- 172.21.15.55:0/2236535617 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff1b0036070 con 0x564813c485b0 2023-08-25T04:04:09.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1be9e7000 10 client.5448 fetch_fsmap finished waiting for FSMap version 15 2023-08-25T04:04:09.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1be9e7000 10 client.5448 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T04:04:09.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1be9e7000 20 client.5448 populate_metadata read hostname 'smithi055' 2023-08-25T04:04:09.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/2236535617 >> [v2:172.21.15.55:6833/2079290775,v1:172.21.15.55:6834/2079290775] conn(0x564813cf7580 0x564813cf9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:09.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1be9e7000 4 client.5448 mds_command: new command op to 5080 tid=0[{"prefix": "status"}] 2023-08-25T04:04:09.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1be9e7000 1 -- 172.21.15.55:0/2236535617 --> [v2:172.21.15.55:6833/2079290775,v1:172.21.15.55:6834/2079290775] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564813a52880 con 0x564813cf7580 2023-08-25T04:04:09.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/2236535617 >> [v2:172.21.15.55:6833/2079290775,v1:172.21.15.55:6834/2079290775] conn(0x564813cf7580 0x564813cf9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:09.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff1b8c23640 1 --2- 172.21.15.55:0/2236535617 >> [v2:172.21.15.55:6833/2079290775,v1:172.21.15.55:6834/2079290775] conn(0x564813cf7580 0x564813cf9970 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f01e402ae3a35cc server_cookie=f11ab91c5e76e130 in_seq=0 out_seq=0 2023-08-25T04:04:09.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.850+0000 7ff18ffff640 10 client.5448 ms_handle_connect on v2:172.21.15.55:6833/2079290775 2023-08-25T04:04:09.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff18ffff640 1 -- 172.21.15.55:0/2236535617 <== mds.0 v2:172.21.15.55:6833/2079290775 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x564813a52880 con 0x564813cf7580 2023-08-25T04:04:09.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff18ffff640 10 client.5448 handle_command_reply: tid=0 2023-08-25T04:04:09.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1be9e7000 1 client.5448 shutdown 2023-08-25T04:04:09.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1be9e7000 1 -- 172.21.15.55:0/2236535617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c485b0 msgr2=0x564813cf06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:09.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/2236535617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c485b0 0x564813cf06b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0014c10 tx=0x7ff1b0018000 comp rx=0 tx=0).stop 2023-08-25T04:04:09.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1be9e7000 1 -- 172.21.15.55:0/2236535617 shutdown_connections 2023-08-25T04:04:09.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/2236535617 >> [v2:172.21.15.55:6833/2079290775,v1:172.21.15.55:6834/2079290775] conn(0x564813cf7580 0x564813cf9970 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/2236535617 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x564813c92940 0x564813c966f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/2236535617 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x564813c92020 0x564813cf0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff18ffff640 0 client.5448 ms_handle_reset on v2:172.21.15.55:6833/2079290775 2023-08-25T04:04:09.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1be9e7000 1 --2- 172.21.15.55:0/2236535617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564813c485b0 0x564813cf06b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1be9e7000 1 -- 172.21.15.55:0/2236535617 >> 172.21.15.55:0/2236535617 conn(0x564813c44560 msgr2=0x564813c91830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:09.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1be9e7000 1 -- 172.21.15.55:0/2236535617 shutdown_connections 2023-08-25T04:04:09.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1be9e7000 1 -- 172.21.15.55:0/2236535617 wait complete. 2023-08-25T04:04:09.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1be9e7000 20 client.5448 trim_cache size 0 max 16384 2023-08-25T04:04:09.863 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T04:04:09.863 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2d2a9024-b152-4d40-880c-1686d1810590", 2023-08-25T04:04:09.863 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-08-25T04:04:09.863 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 5080, 2023-08-25T04:04:09.863 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-08-25T04:04:09.864 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-08-25T04:04:09.864 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-08-25T04:04:09.864 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.477916014, 2023-08-25T04:04:09.864 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 15, 2023-08-25T04:04:09.864 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 38, 2023-08-25T04:04:09.864 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 38, 2023-08-25T04:04:09.864 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 19.491860214999999 2023-08-25T04:04:09.865 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T04:04:09.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1bb688640 1 -- 172.21.15.55:0/2668796845 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff198065680 msgr2=0x7ff198067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:09.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1bb688640 1 --2- 172.21.15.55:0/2668796845 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff198065680 0x7ff198067b40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff1b409d3e0 tx=0x7ff1b0009040 comp rx=0 tx=0).stop 2023-08-25T04:04:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1bb688640 1 -- 172.21.15.55:0/2668796845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1b40ac110 msgr2=0x7ff1b40ac590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1bb688640 1 --2- 172.21.15.55:0/2668796845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1b40ac110 0x7ff1b40ac590 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40b0040 tx=0x7ff1a0005800 comp rx=0 tx=0).stop 2023-08-25T04:04:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1bb688640 1 -- 172.21.15.55:0/2668796845 shutdown_connections 2023-08-25T04:04:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1bb688640 1 --2- 172.21.15.55:0/2668796845 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff198065680 0x7ff198067b40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1bb688640 1 --2- 172.21.15.55:0/2668796845 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1b41f20e0 0x7ff1b41f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1bb688640 1 --2- 172.21.15.55:0/2668796845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1b40ac110 0x7ff1b40ac590 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1bb688640 1 --2- 172.21.15.55:0/2668796845 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1a00047d0 0x7ff1b414c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:09.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1bb688640 1 -- 172.21.15.55:0/2668796845 >> 172.21.15.55:0/2668796845 conn(0x7ff1b40cf530 msgr2=0x7ff1b415fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:09.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1bb688640 1 -- 172.21.15.55:0/2668796845 shutdown_connections 2023-08-25T04:04:09.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:09.854+0000 7ff1bb688640 1 -- 172.21.15.55:0/2668796845 wait complete. 2023-08-25T04:04:09.875 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:04:10.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.014+0000 7eff23dfa640 1 Processor -- start 2023-08-25T04:04:10.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.014+0000 7eff23dfa640 1 -- start start 2023-08-25T04:04:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.014+0000 7eff23dfa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7eff1c0c1a80 0x7eff1c0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.014+0000 7eff23dfa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7eff1c0cddf0 0x7eff1c06bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.014+0000 7eff23dfa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c0cc510 con 0x7eff1c164410 2023-08-25T04:04:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.014+0000 7eff23dfa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c1647f0 con 0x7eff1c0c1a80 2023-08-25T04:04:10.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.014+0000 7eff23dfa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0cc9b0 con 0x7eff1c0cddf0 2023-08-25T04:04:10.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.018+0000 7eff21395640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7eff1c0c1a80 0x7eff1c0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:10.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.018+0000 7eff21395640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7eff1c0c1a80 0x7eff1c0b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39684/0 (socket says 172.21.15.55:39684) 2023-08-25T04:04:10.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.018+0000 7eff21395640 1 -- 172.21.15.55:0/853804000 learned_addr learned my addr 172.21.15.55:0/853804000 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:10.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.018+0000 7eff21b96640 1 --1- 172.21.15.55:0/853804000 >> v1:172.21.15.55:6789/0 conn(0x7eff1c164410 0x7eff1c0c1370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46580/0 (socket says 172.21.15.55:46580) 2023-08-25T04:04:10.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.018+0000 7eff22397640 1 --2- 172.21.15.55:0/853804000 >> v2:172.21.15.110:3300/0 conn(0x7eff1c0cddf0 0x7eff1c06bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:10.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.018+0000 7eff21395640 1 -- 172.21.15.55:0/853804000 >> v2:172.21.15.110:3300/0 conn(0x7eff1c0cddf0 msgr2=0x7eff1c06bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:10.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.018+0000 7eff21395640 1 --2- 172.21.15.55:0/853804000 >> v2:172.21.15.110:3300/0 conn(0x7eff1c0cddf0 0x7eff1c06bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:10.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.018+0000 7eff21395640 1 -- 172.21.15.55:0/853804000 >> v1:172.21.15.55:6789/0 conn(0x7eff1c164410 legacy=0x7eff1c0c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:10.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.018+0000 7eff21395640 1 -- 172.21.15.55:0/853804000 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c0ccc90 con 0x7eff1c0c1a80 2023-08-25T04:04:10.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.018+0000 7eff22397640 1 --2- 172.21.15.55:0/853804000 >> v2:172.21.15.110:3300/0 conn(0x7eff1c0cddf0 0x7eff1c06bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:10.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.018+0000 7eff21395640 1 --2- 172.21.15.55:0/853804000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff1c0c1a80 0x7eff1c0b21b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0c5400 tx=0x7eff0c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae9229cf41db902 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:10.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.018+0000 7eff20b94640 1 -- 172.21.15.55:0/853804000 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0ab600 con 0x7eff1c0c1a80 2023-08-25T04:04:10.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.018+0000 7eff20b94640 1 -- 172.21.15.55:0/853804000 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c0a7050 con 0x7eff1c0c1a80 2023-08-25T04:04:10.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.018+0000 7eff20b94640 1 -- 172.21.15.55:0/853804000 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0ab980 con 0x7eff1c0c1a80 2023-08-25T04:04:10.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff23dfa640 1 -- 172.21.15.55:0/853804000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff1c0c1a80 msgr2=0x7eff1c0b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff23dfa640 1 --2- 172.21.15.55:0/853804000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff1c0c1a80 0x7eff1c0b21b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0c5400 tx=0x7eff0c01c500 comp rx=0 tx=0).stop 2023-08-25T04:04:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff23dfa640 1 -- 172.21.15.55:0/853804000 shutdown_connections 2023-08-25T04:04:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff23dfa640 1 --2- 172.21.15.55:0/853804000 >> v2:172.21.15.110:3300/0 conn(0x7eff1c0cddf0 0x7eff1c06bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff23dfa640 1 --2- 172.21.15.55:0/853804000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff1c0c1a80 0x7eff1c0b21b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff23dfa640 1 -- 172.21.15.55:0/853804000 >> 172.21.15.55:0/853804000 conn(0x7eff1c069d00 msgr2=0x7eff1c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:10.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff23dfa640 1 -- 172.21.15.55:0/853804000 shutdown_connections 2023-08-25T04:04:10.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff23dfa640 1 -- 172.21.15.55:0/853804000 wait complete. 2023-08-25T04:04:10.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff23dfa640 1 Processor -- start 2023-08-25T04:04:10.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff23dfa640 1 -- start start 2023-08-25T04:04:10.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff23dfa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff1c0c1a80 0x7eff1c070220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:10.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff23dfa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff1c0cddf0 0x7eff1c097840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:10.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff23dfa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1c164410 0x7eff1c0afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:10.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff23dfa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0716f0 con 0x7eff1c0cddf0 2023-08-25T04:04:10.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff23dfa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c070a70 con 0x7eff1c0c1a80 2023-08-25T04:04:10.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff23dfa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c070d50 con 0x7eff1c164410 2023-08-25T04:04:10.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff21395640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff1c0cddf0 0x7eff1c097840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:10.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff21395640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff1c0cddf0 0x7eff1c097840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39688/0 (socket says 172.21.15.55:39688) 2023-08-25T04:04:10.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff21395640 1 -- 172.21.15.55:0/2576442668 learned_addr learned my addr 172.21.15.55:0/2576442668 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:10.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff21b96640 1 --2- 172.21.15.55:0/2576442668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff1c0c1a80 0x7eff1c070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:10.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff22397640 1 --2- 172.21.15.55:0/2576442668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1c164410 0x7eff1c0afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:10.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff21395640 1 -- 172.21.15.55:0/2576442668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1c164410 msgr2=0x7eff1c0afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:10.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff21395640 1 --2- 172.21.15.55:0/2576442668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1c164410 0x7eff1c0afa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:10.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff21395640 1 -- 172.21.15.55:0/2576442668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff1c0c1a80 msgr2=0x7eff1c070220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:10.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff21395640 1 --2- 172.21.15.55:0/2576442668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff1c0c1a80 0x7eff1c070220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:10.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff21395640 1 -- 172.21.15.55:0/2576442668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c0094d0 con 0x7eff1c0cddf0 2023-08-25T04:04:10.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.022+0000 7eff21b96640 1 --2- 172.21.15.55:0/2576442668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff1c0c1a80 0x7eff1c070220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:04:10.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.026+0000 7eff21395640 1 --2- 172.21.15.55:0/2576442668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff1c0cddf0 0x7eff1c097840 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7eff0c019110 tx=0x7eff0c0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:10.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.026+0000 7eff127fc640 1 -- 172.21.15.55:0/2576442668 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0b4420 con 0x7eff1c0cddf0 2023-08-25T04:04:10.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.026+0000 7eff127fc640 1 -- 172.21.15.55:0/2576442668 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c0b4580 con 0x7eff1c0cddf0 2023-08-25T04:04:10.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.026+0000 7eff127fc640 1 -- 172.21.15.55:0/2576442668 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0b48f0 con 0x7eff1c0cddf0 2023-08-25T04:04:10.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.026+0000 7eff23dfa640 1 -- 172.21.15.55:0/2576442668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c071030 con 0x7eff1c0cddf0 2023-08-25T04:04:10.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.026+0000 7eff23dfa640 1 -- 172.21.15.55:0/2576442668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c070760 con 0x7eff1c0cddf0 2023-08-25T04:04:10.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.026+0000 7eff23dfa640 1 -- 172.21.15.55:0/2576442668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c071830 con 0x7eff1c0cddf0 2023-08-25T04:04:10.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.026+0000 7eff127fc640 1 -- 172.21.15.55:0/2576442668 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7eff0c0b2070 con 0x7eff1c0cddf0 2023-08-25T04:04:10.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.026+0000 7eff127fc640 1 --2- 172.21.15.55:0/2576442668 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7eff00065680 0x7eff00067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:10.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.026+0000 7eff127fc640 1 -- 172.21.15.55:0/2576442668 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff0c11ca20 con 0x7eff1c0cddf0 2023-08-25T04:04:10.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.026+0000 7eff21b96640 1 --2- 172.21.15.55:0/2576442668 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7eff00065680 0x7eff00067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:10.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.030+0000 7eff21b96640 1 --2- 172.21.15.55:0/2576442668 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7eff00065680 0x7eff00067b40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7eff18000f70 tx=0x7eff18009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:10.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.030+0000 7eff127fc640 1 -- 172.21.15.55:0/2576442668 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7eff0c0ea570 con 0x7eff1c0cddf0 2023-08-25T04:04:10.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.218+0000 7eff23dfa640 1 -- 172.21.15.55:0/2576442668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7eff1c04dbe0 con 0x7eff1c0cddf0 2023-08-25T04:04:10.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.222+0000 7eff127fc640 1 -- 172.21.15.55:0/2576442668 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7eff0c0b0060 con 0x7eff1c0cddf0 2023-08-25T04:04:10.224 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T04:04:10.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.222+0000 7eff23dfa640 1 -- 172.21.15.55:0/2576442668 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7eff00065680 msgr2=0x7eff00067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:10.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.222+0000 7eff23dfa640 1 --2- 172.21.15.55:0/2576442668 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7eff00065680 0x7eff00067b40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7eff18000f70 tx=0x7eff18009040 comp rx=0 tx=0).stop 2023-08-25T04:04:10.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.222+0000 7eff23dfa640 1 -- 172.21.15.55:0/2576442668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff1c0cddf0 msgr2=0x7eff1c097840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:10.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.222+0000 7eff23dfa640 1 --2- 172.21.15.55:0/2576442668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff1c0cddf0 0x7eff1c097840 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7eff0c019110 tx=0x7eff0c0192a0 comp rx=0 tx=0).stop 2023-08-25T04:04:10.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.222+0000 7eff23dfa640 1 -- 172.21.15.55:0/2576442668 shutdown_connections 2023-08-25T04:04:10.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.222+0000 7eff23dfa640 1 --2- 172.21.15.55:0/2576442668 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7eff00065680 0x7eff00067b40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:10.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.222+0000 7eff23dfa640 1 --2- 172.21.15.55:0/2576442668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff1c164410 0x7eff1c0afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:10.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.222+0000 7eff23dfa640 1 --2- 172.21.15.55:0/2576442668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff1c0cddf0 0x7eff1c097840 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:10.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.222+0000 7eff23dfa640 1 --2- 172.21.15.55:0/2576442668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff1c0c1a80 0x7eff1c070220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:10.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.222+0000 7eff23dfa640 1 -- 172.21.15.55:0/2576442668 >> 172.21.15.55:0/2576442668 conn(0x7eff1c069d00 msgr2=0x7eff1c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:10.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.222+0000 7eff23dfa640 1 -- 172.21.15.55:0/2576442668 shutdown_connections 2023-08-25T04:04:10.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:10.222+0000 7eff23dfa640 1 -- 172.21.15.55:0/2576442668 wait complete. 2023-08-25T04:04:10.244 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-25T04:04:10.244 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:04:10.245 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-08-25T04:04:10.245 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-25T04:04:10.245 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T04:04:10.246 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-25T04:04:10.246 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-25T04:04:10.247 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:04:10.247 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:04:10.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:10.248 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-08-25T04:04:10.258 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:04:10.259 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:04:10.259 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:04:10.259 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:04:10.259 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-08-25T04:04:10.259 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:04:10.259 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:04:10.260 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:04:10.260 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-08-25T04:04:10.260 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:04:10.260 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:04:10.260 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-08-25T04:04:10.261 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:04:10.261 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:04:10.261 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-08-25T04:04:10.261 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-08-25T04:04:10.261 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42338sec preferred_lft 42338sec 2023-08-25T04:04:10.261 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-08-25T04:04:10.262 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:04:10.262 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:04:10.262 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:04:10.262 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-08-25T04:04:10.262 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-25T04:04:10.262 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:98:6a:38:6a brd ff:ff:ff:ff:ff:ff 2023-08-25T04:04:10.262 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-25T04:04:10.263 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:04:10.263 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:04:10.263 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-08-25T04:04:10.263 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T04:04:10.263 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:04:10.263 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-08-25T04:04:10.264 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:04:10.264 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:04:10.264 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T04:04:10.264 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-08-25T04:04:10.264 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:04:10.264 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:04:10.265 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-25T04:04:10.265 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-08-25T04:04:10.265 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:04:10.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:10.266 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:04:10.326 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-08-25T04:04:10.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:10.328 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-08-25T04:04:10.380 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-08-25T04:04:10.381 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:04:10.381 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-08-25T04:04:10.381 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-25T04:04:10.381 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-08-25T04:04:10.381 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:04:10.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:10.382 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T04:04:10.382 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T04:04:10.382 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-25T04:04:10.383 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-25T04:04:10.383 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-25T04:04:10.383 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T04:04:10.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:10.478 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-08-25T04:04:10.487 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-25T04:04:10.487 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-25T04:04:10.488 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:04:10.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:10.489 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-08-25T04:04:10.552 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:04:10.552 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-25T04:04:10.603 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:04:10.603 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:04:10.604 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:04:10.654 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-25T04:04:10.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:10.655 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:04:10.746 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:04:10.746 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:04:10.761 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:04:10.761 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:04:10.762 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.110:3300,172.21.15.110:3301" 2023-08-25T04:04:10.762 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2d2a9024-b152-4d40-880c-1686d1810590.cephfs=/ 2023-08-25T04:04:10.762 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2023-08-25T04:04:10.765 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T04:04:10.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:10.765 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:04:10.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:10.787 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:04:10.850 INFO:teuthology.orchestra.run.smithi055.stdout:client5269 2023-08-25T04:04:10.850 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:04:10.850 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:04:10.899 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-25T04:04:11.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.082+0000 7f719d293640 1 Processor -- start 2023-08-25T04:04:11.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.082+0000 7f719d293640 1 -- start start 2023-08-25T04:04:11.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.086+0000 7f719d293640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f71980cdde0 0x7f71980ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.086+0000 7f719d293640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71980b2e40 0x7f71980b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.086+0000 7f719d293640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71980b29b0 con 0x7f71980d0da0 2023-08-25T04:04:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.086+0000 7f719d293640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71980ce760 con 0x7f71980cdde0 2023-08-25T04:04:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.086+0000 7f719d293640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71980b1dc0 con 0x7f71980b2e40 2023-08-25T04:04:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.086+0000 7f718ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f71980cdde0 0x7f71980ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.086+0000 7f718ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f71980cdde0 0x7f71980ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43716/0 (socket says 172.21.15.55:43716) 2023-08-25T04:04:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.086+0000 7f718ffff640 1 -- 172.21.15.55:0/3456271824 learned_addr learned my addr 172.21.15.55:0/3456271824 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.086+0000 7f7196ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f71980d0da0 0x7f71980d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49360/0 (socket says 172.21.15.55:49360) 2023-08-25T04:04:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.086+0000 7f71977fe640 1 --2- 172.21.15.55:0/3456271824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71980b2e40 0x7f71980b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.086+0000 7f718ffff640 1 -- 172.21.15.55:0/3456271824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71980b2e40 msgr2=0x7f71980b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:11.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.086+0000 7f718ffff640 1 --2- 172.21.15.55:0/3456271824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71980b2e40 0x7f71980b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:11.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.086+0000 7f718ffff640 1 -- 172.21.15.55:0/3456271824 >> v1:172.21.15.55:6789/0 conn(0x7f71980d0da0 legacy=0x7f71980d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:11.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.086+0000 7f718ffff640 1 -- 172.21.15.55:0/3456271824 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71980b2080 con 0x7f71980cdde0 2023-08-25T04:04:11.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.086+0000 7f718ffff640 1 --2- 172.21.15.55:0/3456271824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71980cdde0 0x7f71980ce220 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7180009870 tx=0x7f718001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844d6a8cdbe9055d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f71967fc640 1 -- 172.21.15.55:0/3456271824 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71800a8a30 con 0x7f71980cdde0 2023-08-25T04:04:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f71967fc640 1 -- 172.21.15.55:0/3456271824 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71800a8b90 con 0x7f71980cdde0 2023-08-25T04:04:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f71967fc640 1 -- 172.21.15.55:0/3456271824 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71800b0440 con 0x7f71980cdde0 2023-08-25T04:04:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f719d293640 1 -- 172.21.15.55:0/3456271824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71980cdde0 msgr2=0x7f71980ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f719d293640 1 --2- 172.21.15.55:0/3456271824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71980cdde0 0x7f71980ce220 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7180009870 tx=0x7f718001ed30 comp rx=0 tx=0).stop 2023-08-25T04:04:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f719d293640 1 -- 172.21.15.55:0/3456271824 shutdown_connections 2023-08-25T04:04:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f719d293640 1 --2- 172.21.15.55:0/3456271824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71980b2e40 0x7f71980b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f719d293640 1 --2- 172.21.15.55:0/3456271824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71980cdde0 0x7f71980ce220 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f719d293640 1 -- 172.21.15.55:0/3456271824 >> 172.21.15.55:0/3456271824 conn(0x7f719809bae0 msgr2=0x7f71980d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f719d293640 1 -- 172.21.15.55:0/3456271824 shutdown_connections 2023-08-25T04:04:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f719d293640 1 -- 172.21.15.55:0/3456271824 wait complete. 2023-08-25T04:04:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f719d293640 1 Processor -- start 2023-08-25T04:04:11.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f719d293640 1 -- start start 2023-08-25T04:04:11.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f719d293640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71980b2e40 0x7f719814fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:11.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f719d293640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71980cdde0 0x7f71980ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:11.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f719d293640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71980d0da0 0x7f7198153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:11.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f719d293640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71980c9ca0 con 0x7f71980d0da0 2023-08-25T04:04:11.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f719d293640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719814fff0 con 0x7f71980cdde0 2023-08-25T04:04:11.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.090+0000 7f719d293640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7198154710 con 0x7f71980b2e40 2023-08-25T04:04:11.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.094+0000 7f71977fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71980d0da0 0x7f7198153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:11.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.094+0000 7f7196ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71980b2e40 0x7f719814fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:11.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.094+0000 7f71977fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71980d0da0 0x7f7198153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43722/0 (socket says 172.21.15.55:43722) 2023-08-25T04:04:11.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.094+0000 7f71977fe640 1 -- 172.21.15.55:0/2410105017 learned_addr learned my addr 172.21.15.55:0/2410105017 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:11.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.094+0000 7f718ffff640 1 --2- 172.21.15.55:0/2410105017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71980cdde0 0x7f71980ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:11.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.094+0000 7f71977fe640 1 -- 172.21.15.55:0/2410105017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71980b2e40 msgr2=0x7f719814fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:11.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.094+0000 7f71977fe640 1 --2- 172.21.15.55:0/2410105017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71980b2e40 0x7f719814fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:11.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.094+0000 7f71977fe640 1 -- 172.21.15.55:0/2410105017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71980cdde0 msgr2=0x7f71980ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:11.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.094+0000 7f71977fe640 1 --2- 172.21.15.55:0/2410105017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71980cdde0 0x7f71980ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:11.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.094+0000 7f71977fe640 1 -- 172.21.15.55:0/2410105017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71800094d0 con 0x7f71980d0da0 2023-08-25T04:04:11.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.094+0000 7f71977fe640 1 --2- 172.21.15.55:0/2410105017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71980d0da0 0x7f7198153ba0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7190007e90 tx=0x7f719000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:11.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.094+0000 7f718f7fe640 1 -- 172.21.15.55:0/2410105017 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190014420 con 0x7f71980d0da0 2023-08-25T04:04:11.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.094+0000 7f718f7fe640 1 -- 172.21.15.55:0/2410105017 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7190014580 con 0x7f71980d0da0 2023-08-25T04:04:11.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.094+0000 7f719d293640 1 -- 172.21.15.55:0/2410105017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71981549f0 con 0x7f71980d0da0 2023-08-25T04:04:11.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.094+0000 7f718f7fe640 1 -- 172.21.15.55:0/2410105017 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190014930 con 0x7f71980d0da0 2023-08-25T04:04:11.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.094+0000 7f719d293640 1 -- 172.21.15.55:0/2410105017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71980b0910 con 0x7f71980d0da0 2023-08-25T04:04:11.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.094+0000 7f719d293640 1 -- 172.21.15.55:0/2410105017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71980c9e50 con 0x7f71980d0da0 2023-08-25T04:04:11.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.094+0000 7f718f7fe640 1 -- 172.21.15.55:0/2410105017 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7190014a90 con 0x7f71980d0da0 2023-08-25T04:04:11.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.098+0000 7f718f7fe640 1 --2- 172.21.15.55:0/2410105017 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7178065680 0x7f7178067b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:11.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.098+0000 7f718f7fe640 1 -- 172.21.15.55:0/2410105017 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7190083620 con 0x7f71980d0da0 2023-08-25T04:04:11.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.098+0000 7f7196ffd640 1 --2- 172.21.15.55:0/2410105017 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7178065680 0x7f7178067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:11.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.098+0000 7f7196ffd640 1 --2- 172.21.15.55:0/2410105017 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7178065680 0x7f7178067b40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7188007fd0 tx=0x7f7188009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:11.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.102+0000 7f718f7fe640 1 -- 172.21.15.55:0/2410105017 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f71980c9e50 con 0x7f71980d0da0 2023-08-25T04:04:11.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.274+0000 7f719d293640 1 -- 172.21.15.55:0/2410105017 --> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f71980b2640 con 0x7f7178065680 2023-08-25T04:04:11.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.278+0000 7f718f7fe640 1 -- 172.21.15.55:0/2410105017 <== mgr.4102 v2:172.21.15.110:6832/413962747 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f7188001500 con 0x7f7178065680 2023-08-25T04:04:11.280 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T04:04:11.281 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:04:11.281 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-08-25T04:04:11.281 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:04:11.281 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T04:04:11.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.278+0000 7f719d293640 1 -- 172.21.15.55:0/2410105017 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7178065680 msgr2=0x7f7178067b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:11.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.278+0000 7f719d293640 1 --2- 172.21.15.55:0/2410105017 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7178065680 0x7f7178067b40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7188007fd0 tx=0x7f7188009040 comp rx=0 tx=0).stop 2023-08-25T04:04:11.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.278+0000 7f719d293640 1 -- 172.21.15.55:0/2410105017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71980d0da0 msgr2=0x7f7198153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:11.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.278+0000 7f719d293640 1 --2- 172.21.15.55:0/2410105017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71980d0da0 0x7f7198153ba0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7190007e90 tx=0x7f719000e4b0 comp rx=0 tx=0).stop 2023-08-25T04:04:11.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.278+0000 7f719d293640 1 -- 172.21.15.55:0/2410105017 shutdown_connections 2023-08-25T04:04:11.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.278+0000 7f719d293640 1 --2- 172.21.15.55:0/2410105017 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f7178065680 0x7f7178067b40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:11.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.278+0000 7f719d293640 1 --2- 172.21.15.55:0/2410105017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71980d0da0 0x7f7198153ba0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:11.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.278+0000 7f719d293640 1 --2- 172.21.15.55:0/2410105017 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71980cdde0 0x7f71980ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:11.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.278+0000 7f719d293640 1 --2- 172.21.15.55:0/2410105017 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71980b2e40 0x7f719814fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.278+0000 7f719d293640 1 -- 172.21.15.55:0/2410105017 >> 172.21.15.55:0/2410105017 conn(0x7f719809bae0 msgr2=0x7f719806b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.278+0000 7f719d293640 1 -- 172.21.15.55:0/2410105017 shutdown_connections 2023-08-25T04:04:11.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.278+0000 7f719d293640 1 -- 172.21.15.55:0/2410105017 wait complete. 2023-08-25T04:04:11.302 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-25T04:04:11.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.442+0000 7f28971fa640 1 Processor -- start 2023-08-25T04:04:11.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.442+0000 7f28971fa640 1 -- start start 2023-08-25T04:04:11.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.446+0000 7f28971fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28901601f0 0x7f289015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:11.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.446+0000 7f28971fa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f289015e3c0 0x7f28900d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:11.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.446+0000 7f28971fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28900d10c0 0x7f28900b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:11.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.446+0000 7f28971fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28900cd5a0 con 0x7f28901601f0 2023-08-25T04:04:11.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.446+0000 7f28971fa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28900cd880 con 0x7f289015e3c0 2023-08-25T04:04:11.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.446+0000 7f28971fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28900cdb60 con 0x7f28900d10c0 2023-08-25T04:04:11.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.446+0000 7f2894f96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28901601f0 0x7f289015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:11.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.446+0000 7f2894f96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28901601f0 0x7f289015d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43734/0 (socket says 172.21.15.55:43734) 2023-08-25T04:04:11.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.446+0000 7f2894f96640 1 -- 172.21.15.55:0/4097299121 learned_addr learned my addr 172.21.15.55:0/4097299121 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:11.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.446+0000 7f288ffff640 1 --2- 172.21.15.55:0/4097299121 >> v2:172.21.15.110:3300/0 conn(0x7f289015e3c0 0x7f28900d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:11.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.446+0000 7f2895797640 1 --2- 172.21.15.55:0/4097299121 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28900d10c0 0x7f28900b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:11.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.446+0000 7f2894f96640 1 -- 172.21.15.55:0/4097299121 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28900d10c0 msgr2=0x7f28900b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:11.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.446+0000 7f2894f96640 1 --2- 172.21.15.55:0/4097299121 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28900d10c0 0x7f28900b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:11.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.446+0000 7f2894f96640 1 -- 172.21.15.55:0/4097299121 >> v2:172.21.15.110:3300/0 conn(0x7f289015e3c0 msgr2=0x7f28900d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:11.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.446+0000 7f2894f96640 1 --2- 172.21.15.55:0/4097299121 >> v2:172.21.15.110:3300/0 conn(0x7f289015e3c0 0x7f28900d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:11.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.446+0000 7f2894f96640 1 -- 172.21.15.55:0/4097299121 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28900cde40 con 0x7f28901601f0 2023-08-25T04:04:11.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.450+0000 7f2894f96640 1 --2- 172.21.15.55:0/4097299121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28901601f0 0x7f289015d430 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f28900cd350 tx=0x7f288401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c47c979c8dbc50e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:11.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.450+0000 7f288f7fe640 1 -- 172.21.15.55:0/4097299121 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28840a89b0 con 0x7f28901601f0 2023-08-25T04:04:11.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.450+0000 7f288f7fe640 1 -- 172.21.15.55:0/4097299121 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28840a8b10 con 0x7f28901601f0 2023-08-25T04:04:11.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.450+0000 7f288f7fe640 1 -- 172.21.15.55:0/4097299121 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28840a8ea0 con 0x7f28901601f0 2023-08-25T04:04:11.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.450+0000 7f28971fa640 1 -- 172.21.15.55:0/4097299121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28901601f0 msgr2=0x7f289015d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:11.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.450+0000 7f28971fa640 1 --2- 172.21.15.55:0/4097299121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28901601f0 0x7f289015d430 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f28900cd350 tx=0x7f288401ecf0 comp rx=0 tx=0).stop 2023-08-25T04:04:11.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.450+0000 7f28971fa640 1 -- 172.21.15.55:0/4097299121 shutdown_connections 2023-08-25T04:04:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.450+0000 7f28971fa640 1 --2- 172.21.15.55:0/4097299121 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28900d10c0 0x7f28900b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.450+0000 7f28971fa640 1 --2- 172.21.15.55:0/4097299121 >> v2:172.21.15.110:3300/0 conn(0x7f289015e3c0 0x7f28900d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.450+0000 7f28971fa640 1 --2- 172.21.15.55:0/4097299121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28901601f0 0x7f289015d430 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.450+0000 7f28971fa640 1 -- 172.21.15.55:0/4097299121 >> 172.21.15.55:0/4097299121 conn(0x7f28900d27d0 msgr2=0x7f28900d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.450+0000 7f28971fa640 1 -- 172.21.15.55:0/4097299121 shutdown_connections 2023-08-25T04:04:11.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.450+0000 7f28971fa640 1 -- 172.21.15.55:0/4097299121 wait complete. 2023-08-25T04:04:11.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.450+0000 7f28971fa640 1 Processor -- start 2023-08-25T04:04:11.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.450+0000 7f28971fa640 1 -- start start 2023-08-25T04:04:11.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f28971fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28900d10c0 0x7f28900b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:11.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f28971fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f289015e3c0 0x7f28900c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f28971fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28901601f0 0x7f28900c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f28971fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28900ca8e0 con 0x7f289015e3c0 2023-08-25T04:04:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f28971fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28900b2290 con 0x7f28901601f0 2023-08-25T04:04:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f28971fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28900b2570 con 0x7f28900d10c0 2023-08-25T04:04:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f288ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f289015e3c0 0x7f28900c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f288ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f289015e3c0 0x7f28900c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43742/0 (socket says 172.21.15.55:43742) 2023-08-25T04:04:11.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f288ffff640 1 -- 172.21.15.55:0/350886325 learned_addr learned my addr 172.21.15.55:0/350886325 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:11.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f2894f96640 1 --2- 172.21.15.55:0/350886325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28900d10c0 0x7f28900b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:11.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f2895797640 1 --2- 172.21.15.55:0/350886325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28901601f0 0x7f28900c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:11.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f288ffff640 1 -- 172.21.15.55:0/350886325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28900d10c0 msgr2=0x7f28900b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:11.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f288ffff640 1 --2- 172.21.15.55:0/350886325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28900d10c0 0x7f28900b04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:11.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f288ffff640 1 -- 172.21.15.55:0/350886325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28901601f0 msgr2=0x7f28900c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:11.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f288ffff640 1 --2- 172.21.15.55:0/350886325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28901601f0 0x7f28900c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:11.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f288ffff640 1 -- 172.21.15.55:0/350886325 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2884009480 con 0x7f289015e3c0 2023-08-25T04:04:11.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f288ffff640 1 --2- 172.21.15.55:0/350886325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f289015e3c0 0x7f28900c8440 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f287c00d800 tx=0x7f287c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:11.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f288d7fa640 1 -- 172.21.15.55:0/350886325 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c00b6c0 con 0x7f289015e3c0 2023-08-25T04:04:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f288d7fa640 1 -- 172.21.15.55:0/350886325 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c00b820 con 0x7f289015e3c0 2023-08-25T04:04:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f288d7fa640 1 -- 172.21.15.55:0/350886325 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c00bb90 con 0x7f289015e3c0 2023-08-25T04:04:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f28971fa640 1 -- 172.21.15.55:0/350886325 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28900ce7c0 con 0x7f289015e3c0 2023-08-25T04:04:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f28971fa640 1 -- 172.21.15.55:0/350886325 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28900b2b30 con 0x7f289015e3c0 2023-08-25T04:04:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.454+0000 7f28971fa640 1 -- 172.21.15.55:0/350886325 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28900b5260 con 0x7f289015e3c0 2023-08-25T04:04:11.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.458+0000 7f288d7fa640 1 -- 172.21.15.55:0/350886325 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f287c00bcf0 con 0x7f289015e3c0 2023-08-25T04:04:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.458+0000 7f288d7fa640 1 --2- 172.21.15.55:0/350886325 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f28740656b0 0x7f2874067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.458+0000 7f288d7fa640 1 -- 172.21.15.55:0/350886325 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f287c083240 con 0x7f289015e3c0 2023-08-25T04:04:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.458+0000 7f2894f96640 1 --2- 172.21.15.55:0/350886325 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f28740656b0 0x7f2874067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:11.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.458+0000 7f2894f96640 1 --2- 172.21.15.55:0/350886325 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f28740656b0 0x7f2874067b70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f28840b2000 tx=0x7f28840aa070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:11.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.462+0000 7f288d7fa640 1 -- 172.21.15.55:0/350886325 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f287c050d90 con 0x7f289015e3c0 2023-08-25T04:04:11.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:11.658+0000 7f28971fa640 1 -- 172.21.15.55:0/350886325 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f28900b2cc0 con 0x7f289015e3c0 2023-08-25T04:04:12.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.454+0000 7f288d7fa640 1 -- 172.21.15.55:0/350886325 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 6) v1 ==== 84979+0+0 (secure 0 0 0) 0x7f287c051160 con 0x7f289015e3c0 2023-08-25T04:04:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.454+0000 7f288d7fa640 1 -- 172.21.15.55:0/350886325 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v6) v1 ==== 92+0+0 (secure 0 0 0) 0x7f287c050d90 con 0x7f289015e3c0 2023-08-25T04:04:12.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.458+0000 7f28971fa640 1 -- 172.21.15.55:0/350886325 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f28740656b0 msgr2=0x7f2874067b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:12.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.458+0000 7f28971fa640 1 --2- 172.21.15.55:0/350886325 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f28740656b0 0x7f2874067b70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f28840b2000 tx=0x7f28840aa070 comp rx=0 tx=0).stop 2023-08-25T04:04:12.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.458+0000 7f28971fa640 1 -- 172.21.15.55:0/350886325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f289015e3c0 msgr2=0x7f28900c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:12.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.458+0000 7f28971fa640 1 --2- 172.21.15.55:0/350886325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f289015e3c0 0x7f28900c8440 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f287c00d800 tx=0x7f287c00dcc0 comp rx=0 tx=0).stop 2023-08-25T04:04:12.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.458+0000 7f28971fa640 1 -- 172.21.15.55:0/350886325 shutdown_connections 2023-08-25T04:04:12.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.458+0000 7f28971fa640 1 --2- 172.21.15.55:0/350886325 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f28740656b0 0x7f2874067b70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:12.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.458+0000 7f28971fa640 1 --2- 172.21.15.55:0/350886325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28901601f0 0x7f28900c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:12.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.458+0000 7f28971fa640 1 --2- 172.21.15.55:0/350886325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f289015e3c0 0x7f28900c8440 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:12.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.458+0000 7f28971fa640 1 --2- 172.21.15.55:0/350886325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28900d10c0 0x7f28900b04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:12.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.458+0000 7f28971fa640 1 -- 172.21.15.55:0/350886325 >> 172.21.15.55:0/350886325 conn(0x7f28900d27d0 msgr2=0x7f289015f400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:12.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.458+0000 7f28971fa640 1 -- 172.21.15.55:0/350886325 shutdown_connections 2023-08-25T04:04:12.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.458+0000 7f28971fa640 1 -- 172.21.15.55:0/350886325 wait complete. 2023-08-25T04:04:12.486 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-25T04:04:12.635 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:12.634+0000 7fce88e4a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:04:12.636 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:12.634+0000 7ff5f9d2a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:04:12.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.638+0000 7ff1119fa640 1 Processor -- start 2023-08-25T04:04:12.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.638+0000 7ff1119fa640 1 -- start start 2023-08-25T04:04:12.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.638+0000 7ff1119fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff10c1601f0 0x7ff10c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:12.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.638+0000 7ff1119fa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff10c0d1290 0x7ff10c15e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:12.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.638+0000 7ff1119fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10c0cd5a0 con 0x7ff10c15e3c0 2023-08-25T04:04:12.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.638+0000 7ff1119fa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10c0cd880 con 0x7ff10c0d1290 2023-08-25T04:04:12.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.638+0000 7ff1119fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c0cdb60 con 0x7ff10c1601f0 2023-08-25T04:04:12.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.638+0000 7ff103fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff10c15e3c0 0x7ff10c0d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49366/0 (socket says 172.21.15.55:49366) 2023-08-25T04:04:12.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.638+0000 7ff103fff640 1 -- 172.21.15.55:0/2697866981 learned_addr learned my addr 172.21.15.55:0/2697866981 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:12.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.638+0000 7ff10affd640 1 --2- 172.21.15.55:0/2697866981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff10c1601f0 0x7ff10c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:12.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.638+0000 7ff10b7fe640 1 --2- 172.21.15.55:0/2697866981 >> v2:172.21.15.110:3300/0 conn(0x7ff10c0d1290 0x7ff10c15e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:12.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.638+0000 7ff10a7fc640 1 -- 172.21.15.55:0/2697866981 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307994526 0 0) 0x7ff10c0cd5a0 con 0x7ff10c15e3c0 2023-08-25T04:04:12.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.638+0000 7ff10a7fc640 1 -- 172.21.15.55:0/2697866981 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0f8003530 con 0x7ff10c15e3c0 2023-08-25T04:04:12.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.638+0000 7ff10b7fe640 1 -- 172.21.15.55:0/2697866981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff10c1601f0 msgr2=0x7ff10c15d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:12.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.638+0000 7ff10b7fe640 1 --2- 172.21.15.55:0/2697866981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff10c1601f0 0x7ff10c15d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:12.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.638+0000 7ff10b7fe640 1 -- 172.21.15.55:0/2697866981 >> v1:172.21.15.55:6789/0 conn(0x7ff10c15e3c0 legacy=0x7ff10c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:12.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.638+0000 7ff10b7fe640 1 -- 172.21.15.55:0/2697866981 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c0cde40 con 0x7ff10c0d1290 2023-08-25T04:04:12.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.638+0000 7ff10affd640 1 --2- 172.21.15.55:0/2697866981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff10c1601f0 0x7ff10c15d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:04:12.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.642+0000 7ff10b7fe640 1 --2- 172.21.15.55:0/2697866981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10c0d1290 0x7ff10c15e8a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff104009d90 tx=0x7ff10401f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cf2d1b45f80bd7e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:12.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.642+0000 7ff10a7fc640 1 -- 172.21.15.55:0/2697866981 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1040af600 con 0x7ff10c0d1290 2023-08-25T04:04:12.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.642+0000 7ff10a7fc640 1 -- 172.21.15.55:0/2697866981 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1040ab050 con 0x7ff10c0d1290 2023-08-25T04:04:12.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.642+0000 7ff10a7fc640 1 -- 172.21.15.55:0/2697866981 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1040af980 con 0x7ff10c0d1290 2023-08-25T04:04:12.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.642+0000 7ff1119fa640 1 -- 172.21.15.55:0/2697866981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10c0d1290 msgr2=0x7ff10c15e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:12.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.642+0000 7ff1119fa640 1 --2- 172.21.15.55:0/2697866981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10c0d1290 0x7ff10c15e8a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff104009d90 tx=0x7ff10401f130 comp rx=0 tx=0).stop 2023-08-25T04:04:12.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.642+0000 7ff1119fa640 1 -- 172.21.15.55:0/2697866981 shutdown_connections 2023-08-25T04:04:12.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.642+0000 7ff1119fa640 1 --2- 172.21.15.55:0/2697866981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10c0d1290 0x7ff10c15e8a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:12.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.642+0000 7ff1119fa640 1 --2- 172.21.15.55:0/2697866981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff10c1601f0 0x7ff10c15d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:12.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.642+0000 7ff1119fa640 1 -- 172.21.15.55:0/2697866981 >> 172.21.15.55:0/2697866981 conn(0x7ff10c0d27d0 msgr2=0x7ff10c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:12.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.642+0000 7ff1119fa640 1 -- 172.21.15.55:0/2697866981 shutdown_connections 2023-08-25T04:04:12.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.642+0000 7ff1119fa640 1 -- 172.21.15.55:0/2697866981 wait complete. 2023-08-25T04:04:12.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff1119fa640 1 Processor -- start 2023-08-25T04:04:12.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff1119fa640 1 -- start start 2023-08-25T04:04:12.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff1119fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff10c0d1290 0x7ff10c0b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:12.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff1119fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff10c15e3c0 0x7ff10c0c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:12.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff1119fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10c1601f0 0x7ff10c0c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:12.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff1119fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c15bc00 con 0x7ff10c0d1290 2023-08-25T04:04:12.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff1119fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c158f00 con 0x7ff10c1601f0 2023-08-25T04:04:12.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff1119fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c0c8c50 con 0x7ff10c15e3c0 2023-08-25T04:04:12.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff10affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff10c0d1290 0x7ff10c0b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:12.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff10affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff10c0d1290 0x7ff10c0b78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43764/0 (socket says 172.21.15.55:43764) 2023-08-25T04:04:12.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff10affd640 1 -- 172.21.15.55:0/2327371382 learned_addr learned my addr 172.21.15.55:0/2327371382 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:12.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff10b7fe640 1 --2- 172.21.15.55:0/2327371382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10c1601f0 0x7ff10c0c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:12.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff103fff640 1 --2- 172.21.15.55:0/2327371382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff10c15e3c0 0x7ff10c0c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:12.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff10affd640 1 -- 172.21.15.55:0/2327371382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff10c15e3c0 msgr2=0x7ff10c0c7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:12.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff10affd640 1 --2- 172.21.15.55:0/2327371382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff10c15e3c0 0x7ff10c0c7dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:12.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff10affd640 1 -- 172.21.15.55:0/2327371382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10c1601f0 msgr2=0x7ff10c0c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:12.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff10affd640 1 --2- 172.21.15.55:0/2327371382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10c1601f0 0x7ff10c0c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:12.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff10affd640 1 -- 172.21.15.55:0/2327371382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc0093b0 con 0x7ff10c0d1290 2023-08-25T04:04:12.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff103fff640 1 --2- 172.21.15.55:0/2327371382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff10c15e3c0 0x7ff10c0c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:12.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff10affd640 1 --2- 172.21.15.55:0/2327371382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff10c0d1290 0x7ff10c0b78a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00e960 tx=0x7ff0fc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:12.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff108ff9640 1 -- 172.21.15.55:0/2327371382 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc00ca00 con 0x7ff10c0d1290 2023-08-25T04:04:12.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff108ff9640 1 -- 172.21.15.55:0/2327371382 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0fc00cb60 con 0x7ff10c0d1290 2023-08-25T04:04:12.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff108ff9640 1 -- 172.21.15.55:0/2327371382 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc0059a0 con 0x7ff10c0d1290 2023-08-25T04:04:12.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff1119fa640 1 -- 172.21.15.55:0/2327371382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff104009a70 con 0x7ff10c0d1290 2023-08-25T04:04:12.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.646+0000 7ff1119fa640 1 -- 172.21.15.55:0/2327371382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10c0ce7c0 con 0x7ff10c0d1290 2023-08-25T04:04:12.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.650+0000 7ff1119fa640 1 -- 172.21.15.55:0/2327371382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff10c0b5260 con 0x7ff10c0d1290 2023-08-25T04:04:12.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.650+0000 7ff108ff9640 1 -- 172.21.15.55:0/2327371382 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 6) v1 ==== 84979+0+0 (secure 0 0 0) 0x7ff0fc005b00 con 0x7ff10c0d1290 2023-08-25T04:04:12.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.650+0000 7ff108ff9640 1 --2- 172.21.15.55:0/2327371382 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff0ec0656d0 0x7ff0ec067b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:12.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.650+0000 7ff108ff9640 1 -- 172.21.15.55:0/2327371382 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff0fc083270 con 0x7ff10c0d1290 2023-08-25T04:04:12.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.650+0000 7ff103fff640 1 -- 172.21.15.55:0/2327371382 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff0ec0656d0 msgr2=0x7ff0ec067b90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/413962747 2023-08-25T04:04:12.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.650+0000 7ff103fff640 1 --2- 172.21.15.55:0/2327371382 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff0ec0656d0 0x7ff0ec067b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:04:12.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.658+0000 7ff108ff9640 1 -- 172.21.15.55:0/2327371382 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff0fc050d40 con 0x7ff10c0d1290 2023-08-25T04:04:12.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.818+0000 7ff1119fa640 1 -- 172.21.15.55:0/2327371382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7ff10c073ec0 con 0x7ff10c0d1290 2023-08-25T04:04:12.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.826+0000 7ff108ff9640 1 -- 172.21.15.55:0/2327371382 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff0fc054360 con 0x7ff10c0d1290 2023-08-25T04:04:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.826+0000 7ff1119fa640 1 -- 172.21.15.55:0/2327371382 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff0ec0656d0 msgr2=0x7ff0ec067b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:04:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.826+0000 7ff1119fa640 1 --2- 172.21.15.55:0/2327371382 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff0ec0656d0 0x7ff0ec067b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.826+0000 7ff1119fa640 1 -- 172.21.15.55:0/2327371382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff10c0d1290 msgr2=0x7ff10c0b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.826+0000 7ff1119fa640 1 --2- 172.21.15.55:0/2327371382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff10c0d1290 0x7ff10c0b78a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00e960 tx=0x7ff0fc00ee20 comp rx=0 tx=0).stop 2023-08-25T04:04:12.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.826+0000 7ff1119fa640 1 -- 172.21.15.55:0/2327371382 shutdown_connections 2023-08-25T04:04:12.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.826+0000 7ff1119fa640 1 --2- 172.21.15.55:0/2327371382 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7ff0ec0656d0 0x7ff0ec067b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:12.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.826+0000 7ff1119fa640 1 --2- 172.21.15.55:0/2327371382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff10c1601f0 0x7ff10c0c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:12.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.826+0000 7ff1119fa640 1 --2- 172.21.15.55:0/2327371382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff10c15e3c0 0x7ff10c0c7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:12.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.826+0000 7ff1119fa640 1 --2- 172.21.15.55:0/2327371382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff10c0d1290 0x7ff10c0b78a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:12.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.826+0000 7ff1119fa640 1 -- 172.21.15.55:0/2327371382 >> 172.21.15.55:0/2327371382 conn(0x7ff10c0d27d0 msgr2=0x7ff10c06c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:12.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.826+0000 7ff1119fa640 1 -- 172.21.15.55:0/2327371382 shutdown_connections 2023-08-25T04:04:12.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.826+0000 7ff1119fa640 1 -- 172.21.15.55:0/2327371382 wait complete. 2023-08-25T04:04:12.849 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-08-25T04:04:12.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.994+0000 7f3123888640 1 Processor -- start 2023-08-25T04:04:12.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.994+0000 7f3123888640 1 -- start start 2023-08-25T04:04:12.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.994+0000 7f3123888640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f311c1601f0 0x7f311c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.994+0000 7f3123888640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f311c0d1290 0x7f311c15e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.994+0000 7f3123888640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f311c0cd5a0 con 0x7f311c15e3c0 2023-08-25T04:04:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.994+0000 7f3123888640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311c0cd880 con 0x7f311c0d1290 2023-08-25T04:04:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.994+0000 7f3123888640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311c0cdb60 con 0x7f311c1601f0 2023-08-25T04:04:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.994+0000 7f3120e23640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f311c15e3c0 0x7f311c0d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49378/0 (socket says 172.21.15.55:49378) 2023-08-25T04:04:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.994+0000 7f3120e23640 1 -- 172.21.15.55:0/163313551 learned_addr learned my addr 172.21.15.55:0/163313551 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:12.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.994+0000 7f3121624640 1 --2- 172.21.15.55:0/163313551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f311c1601f0 0x7f311c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:12.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.994+0000 7f3121e25640 1 --2- 172.21.15.55:0/163313551 >> v2:172.21.15.110:3300/0 conn(0x7f311c0d1290 0x7f311c15e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:12.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.994+0000 7f3113fff640 1 -- 172.21.15.55:0/163313551 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542214716 0 0) 0x7f311c0cd5a0 con 0x7f311c15e3c0 2023-08-25T04:04:13.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.994+0000 7f3113fff640 1 -- 172.21.15.55:0/163313551 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3108003530 con 0x7f311c15e3c0 2023-08-25T04:04:13.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.994+0000 7f3121e25640 1 -- 172.21.15.55:0/163313551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f311c1601f0 msgr2=0x7f311c15d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:13.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.994+0000 7f3121e25640 1 --2- 172.21.15.55:0/163313551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f311c1601f0 0x7f311c15d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:13.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.994+0000 7f3121e25640 1 -- 172.21.15.55:0/163313551 >> v1:172.21.15.55:6789/0 conn(0x7f311c15e3c0 legacy=0x7f311c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:13.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.994+0000 7f3121e25640 1 -- 172.21.15.55:0/163313551 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c0cde40 con 0x7f311c0d1290 2023-08-25T04:04:13.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.994+0000 7f3121624640 1 --2- 172.21.15.55:0/163313551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f311c1601f0 0x7f311c15d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:04:13.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.998+0000 7f3121e25640 1 --2- 172.21.15.55:0/163313551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f311c0d1290 0x7f311c15e8a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3114009d90 tx=0x7f311401f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1fd08c96ea7711a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:13.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.998+0000 7f3113fff640 1 -- 172.21.15.55:0/163313551 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31140af600 con 0x7f311c0d1290 2023-08-25T04:04:13.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.998+0000 7f3113fff640 1 -- 172.21.15.55:0/163313551 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31140ab050 con 0x7f311c0d1290 2023-08-25T04:04:13.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.998+0000 7f3113fff640 1 -- 172.21.15.55:0/163313551 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31140af980 con 0x7f311c0d1290 2023-08-25T04:04:13.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.998+0000 7f3123888640 1 -- 172.21.15.55:0/163313551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f311c0d1290 msgr2=0x7f311c15e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:13.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.998+0000 7f3123888640 1 --2- 172.21.15.55:0/163313551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f311c0d1290 0x7f311c15e8a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3114009d90 tx=0x7f311401f130 comp rx=0 tx=0).stop 2023-08-25T04:04:13.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.998+0000 7f3123888640 1 -- 172.21.15.55:0/163313551 shutdown_connections 2023-08-25T04:04:13.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.998+0000 7f3123888640 1 --2- 172.21.15.55:0/163313551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f311c0d1290 0x7f311c15e8a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:13.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.998+0000 7f3123888640 1 --2- 172.21.15.55:0/163313551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f311c1601f0 0x7f311c15d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:13.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.998+0000 7f3123888640 1 -- 172.21.15.55:0/163313551 >> 172.21.15.55:0/163313551 conn(0x7f311c0d27d0 msgr2=0x7f311c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:13.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.998+0000 7f3123888640 1 -- 172.21.15.55:0/163313551 shutdown_connections 2023-08-25T04:04:13.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:12.998+0000 7f3123888640 1 -- 172.21.15.55:0/163313551 wait complete. 2023-08-25T04:04:13.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3123888640 1 Processor -- start 2023-08-25T04:04:13.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3123888640 1 -- start start 2023-08-25T04:04:13.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3123888640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f311c0d1290 0x7f311c0cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:13.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3123888640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f311c15e3c0 0x7f311c09d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:13.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3123888640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f311c1601f0 0x7f311c09daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:13.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3123888640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c09e030 con 0x7f311c15e3c0 2023-08-25T04:04:13.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3123888640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c1f5790 con 0x7f311c0d1290 2023-08-25T04:04:13.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3123888640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311c1f5a70 con 0x7f311c1601f0 2023-08-25T04:04:13.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3120e23640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f311c15e3c0 0x7f311c09d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:13.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3121624640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f311c0d1290 0x7f311c0cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:13.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3120e23640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f311c15e3c0 0x7f311c09d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43778/0 (socket says 172.21.15.55:43778) 2023-08-25T04:04:13.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3120e23640 1 -- 172.21.15.55:0/3219723971 learned_addr learned my addr 172.21.15.55:0/3219723971 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:13.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3121e25640 1 --2- 172.21.15.55:0/3219723971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f311c1601f0 0x7f311c09daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:13.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3120e23640 1 -- 172.21.15.55:0/3219723971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f311c1601f0 msgr2=0x7f311c09daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:13.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3120e23640 1 --2- 172.21.15.55:0/3219723971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f311c1601f0 0x7f311c09daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:13.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3120e23640 1 -- 172.21.15.55:0/3219723971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f311c0d1290 msgr2=0x7f311c0cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:13.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3120e23640 1 --2- 172.21.15.55:0/3219723971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f311c0d1290 0x7f311c0cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:13.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3120e23640 1 -- 172.21.15.55:0/3219723971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31180093b0 con 0x7f311c15e3c0 2023-08-25T04:04:13.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3120e23640 1 --2- 172.21.15.55:0/3219723971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f311c15e3c0 0x7f311c09d5b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f310c00c4d0 tx=0x7f310c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:13.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3111ffb640 1 -- 172.21.15.55:0/3219723971 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c005cf0 con 0x7f311c15e3c0 2023-08-25T04:04:13.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3111ffb640 1 -- 172.21.15.55:0/3219723971 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c005e50 con 0x7f311c15e3c0 2023-08-25T04:04:13.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3123888640 1 -- 172.21.15.55:0/3219723971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3114009a70 con 0x7f311c15e3c0 2023-08-25T04:04:13.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.002+0000 7f3111ffb640 1 -- 172.21.15.55:0/3219723971 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c007270 con 0x7f311c15e3c0 2023-08-25T04:04:13.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.006+0000 7f3123888640 1 -- 172.21.15.55:0/3219723971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311c0ce7c0 con 0x7f311c15e3c0 2023-08-25T04:04:13.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.006+0000 7f3123888640 1 -- 172.21.15.55:0/3219723971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f311c0b5260 con 0x7f311c15e3c0 2023-08-25T04:04:13.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.006+0000 7f3111ffb640 1 -- 172.21.15.55:0/3219723971 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 6) v1 ==== 84979+0+0 (secure 0 0 0) 0x7f310c0073d0 con 0x7f311c15e3c0 2023-08-25T04:04:13.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.006+0000 7f3111ffb640 1 --2- 172.21.15.55:0/3219723971 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f31000656d0 0x7f3100067b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:13.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.006+0000 7f3111ffb640 1 -- 172.21.15.55:0/3219723971 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f310c0822a0 con 0x7f311c15e3c0 2023-08-25T04:04:13.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.006+0000 7f3121624640 1 -- 172.21.15.55:0/3219723971 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f31000656d0 msgr2=0x7f3100067b90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/413962747 2023-08-25T04:04:13.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.006+0000 7f3121624640 1 --2- 172.21.15.55:0/3219723971 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f31000656d0 0x7f3100067b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:04:13.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.014+0000 7f3111ffb640 1 -- 172.21.15.55:0/3219723971 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f310c04fea0 con 0x7f311c15e3c0 2023-08-25T04:04:13.053 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:13.050+0000 7ff5f9d2a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:04:13.087 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:13.086+0000 7fce88e4a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:04:13.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.174+0000 7f3123888640 1 -- 172.21.15.55:0/3219723971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f311c073ec0 con 0x7f311c15e3c0 2023-08-25T04:04:13.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.182+0000 7f3111ffb640 1 -- 172.21.15.55:0/3219723971 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v12)=0 v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7f310c0534c0 con 0x7f311c15e3c0 2023-08-25T04:04:13.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.186+0000 7f3123888640 1 -- 172.21.15.55:0/3219723971 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f31000656d0 msgr2=0x7f3100067b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:04:13.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.186+0000 7f3123888640 1 --2- 172.21.15.55:0/3219723971 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f31000656d0 0x7f3100067b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:13.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.186+0000 7f3123888640 1 -- 172.21.15.55:0/3219723971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f311c15e3c0 msgr2=0x7f311c09d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:13.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.186+0000 7f3123888640 1 --2- 172.21.15.55:0/3219723971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f311c15e3c0 0x7f311c09d5b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f310c00c4d0 tx=0x7f310c00c990 comp rx=0 tx=0).stop 2023-08-25T04:04:13.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.186+0000 7f3123888640 1 -- 172.21.15.55:0/3219723971 shutdown_connections 2023-08-25T04:04:13.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.186+0000 7f3123888640 1 --2- 172.21.15.55:0/3219723971 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7f31000656d0 0x7f3100067b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:13.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.186+0000 7f3123888640 1 --2- 172.21.15.55:0/3219723971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f311c1601f0 0x7f311c09daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:13.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.186+0000 7f3123888640 1 --2- 172.21.15.55:0/3219723971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f311c15e3c0 0x7f311c09d5b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:13.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.186+0000 7f3123888640 1 --2- 172.21.15.55:0/3219723971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f311c0d1290 0x7f311c0cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:13.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.186+0000 7f3123888640 1 -- 172.21.15.55:0/3219723971 >> 172.21.15.55:0/3219723971 conn(0x7f311c0d27d0 msgr2=0x7f311c06b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:13.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.186+0000 7f3123888640 1 -- 172.21.15.55:0/3219723971 shutdown_connections 2023-08-25T04:04:13.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.186+0000 7f3123888640 1 -- 172.21.15.55:0/3219723971 wait complete. 2023-08-25T04:04:13.203 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:13.202+0000 7ff5f9d2a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:04:13.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:13.208 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-25T04:04:13.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:13.226 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-08-25T04:04:13.247 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:13.246+0000 7fce88e4a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:04:13.258 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-08-25T04:04:13.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.446+0000 7fc62bb10640 1 Processor -- start 2023-08-25T04:04:13.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.446+0000 7fc62bb10640 1 -- start start 2023-08-25T04:04:13.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.446+0000 7fc62bb10640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc62415cb40 0x7fc6240d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:13.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.446+0000 7fc62bb10640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6240d1970 con 0x7fc6240b6a00 2023-08-25T04:04:13.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.446+0000 7fc62bb10640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6240b5200 con 0x7fc6240cf340 2023-08-25T04:04:13.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.446+0000 7fc62bb10640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6240d0d80 con 0x7fc62415cb40 2023-08-25T04:04:13.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.446+0000 7fc6298ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc62415cb40 0x7fc6240d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:13.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.446+0000 7fc62a0ad640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc6240b6a00 0x7fc6240b4af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49388/0 (socket says 172.21.15.55:49388) 2023-08-25T04:04:13.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.446+0000 7fc62a0ad640 1 -- 172.21.15.55:0/1931507597 learned_addr learned my addr 172.21.15.55:0/1931507597 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:13.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.446+0000 7fc6298ac640 1 -- 172.21.15.55:0/1931507597 >> v1:172.21.15.110:6789/0 conn(0x7fc6240cf340 legacy=0x7fc6240b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:13.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.446+0000 7fc6298ac640 1 -- 172.21.15.55:0/1931507597 >> v1:172.21.15.55:6789/0 conn(0x7fc6240b6a00 legacy=0x7fc6240b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:13.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.446+0000 7fc6298ac640 1 -- 172.21.15.55:0/1931507597 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6240d1040 con 0x7fc62415cb40 2023-08-25T04:04:13.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.446+0000 7fc6288aa640 1 -- 172.21.15.55:0/1931507597 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543917708 0 0) 0x7fc6240d1970 con 0x7fc6240b6a00 2023-08-25T04:04:13.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.450+0000 7fc6298ac640 1 --2- 172.21.15.55:0/1931507597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc62415cb40 0x7fc6240d2080 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc6200097c0 tx=0x7fc62001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b7784d07998edb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:13.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.450+0000 7fc6288aa640 1 -- 172.21.15.55:0/1931507597 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6200a8970 con 0x7fc62415cb40 2023-08-25T04:04:13.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.450+0000 7fc6288aa640 1 -- 172.21.15.55:0/1931507597 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6200a8ad0 con 0x7fc62415cb40 2023-08-25T04:04:13.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.450+0000 7fc6288aa640 1 -- 172.21.15.55:0/1931507597 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6200a8e60 con 0x7fc62415cb40 2023-08-25T04:04:13.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.450+0000 7fc62bb10640 1 -- 172.21.15.55:0/1931507597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc62415cb40 msgr2=0x7fc6240d2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:13.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.450+0000 7fc62bb10640 1 --2- 172.21.15.55:0/1931507597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc62415cb40 0x7fc6240d2080 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc6200097c0 tx=0x7fc62001ec70 comp rx=0 tx=0).stop 2023-08-25T04:04:13.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.450+0000 7fc62bb10640 1 -- 172.21.15.55:0/1931507597 shutdown_connections 2023-08-25T04:04:13.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.450+0000 7fc62bb10640 1 --2- 172.21.15.55:0/1931507597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc62415cb40 0x7fc6240d2080 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:13.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.450+0000 7fc62bb10640 1 -- 172.21.15.55:0/1931507597 >> 172.21.15.55:0/1931507597 conn(0x7fc62406aae0 msgr2=0x7fc62406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:13.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.450+0000 7fc62bb10640 1 -- 172.21.15.55:0/1931507597 shutdown_connections 2023-08-25T04:04:13.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.450+0000 7fc62bb10640 1 -- 172.21.15.55:0/1931507597 wait complete. 2023-08-25T04:04:13.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc62bb10640 1 Processor -- start 2023-08-25T04:04:13.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc62bb10640 1 -- start start 2023-08-25T04:04:13.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc62bb10640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6240b6a00 0x7fc6240c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:13.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc62bb10640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6240cf340 0x7fc62415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:13.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc62bb10640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc62415cb40 0x7fc62415ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:13.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc62bb10640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6240c70a0 con 0x7fc6240cf340 2023-08-25T04:04:13.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc62bb10640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62415d970 con 0x7fc6240b6a00 2023-08-25T04:04:13.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc62bb10640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62415dc50 con 0x7fc62415cb40 2023-08-25T04:04:13.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc6290ab640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6240cf340 0x7fc62415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:13.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc6298ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6240b6a00 0x7fc6240c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:13.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc6298ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6240b6a00 0x7fc6240c93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:33330/0 (socket says 172.21.15.55:33330) 2023-08-25T04:04:13.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc6290ab640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6240cf340 0x7fc62415cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43794/0 (socket says 172.21.15.55:43794) 2023-08-25T04:04:13.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc6298ac640 1 -- 172.21.15.55:0/1378960995 learned_addr learned my addr 172.21.15.55:0/1378960995 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:13.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc62a0ad640 1 --2- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc62415cb40 0x7fc62415ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc6290ab640 1 -- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc62415cb40 msgr2=0x7fc62415ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc6290ab640 1 --2- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc62415cb40 0x7fc62415ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:13.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc6290ab640 1 -- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6240b6a00 msgr2=0x7fc6240c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc6290ab640 1 --2- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6240b6a00 0x7fc6240c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc6290ab640 1 -- 172.21.15.55:0/1378960995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc620009420 con 0x7fc6240cf340 2023-08-25T04:04:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc62a0ad640 1 --2- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc62415cb40 0x7fc62415ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc6290ab640 1 --2- 172.21.15.55:0/1378960995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6240cf340 0x7fc62415cf20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc614000f70 tx=0x7fc61400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc61a7fc640 1 -- 172.21.15.55:0/1378960995 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6140052d0 con 0x7fc6240cf340 2023-08-25T04:04:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc61a7fc640 1 -- 172.21.15.55:0/1378960995 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc614005430 con 0x7fc6240cf340 2023-08-25T04:04:13.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc61a7fc640 1 -- 172.21.15.55:0/1378960995 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc614003840 con 0x7fc6240cf340 2023-08-25T04:04:13.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc62bb10640 1 -- 172.21.15.55:0/1378960995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62415df30 con 0x7fc6240cf340 2023-08-25T04:04:13.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.454+0000 7fc62bb10640 1 -- 172.21.15.55:0/1378960995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6240cb610 con 0x7fc6240cf340 2023-08-25T04:04:13.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.458+0000 7fc62bb10640 1 -- 172.21.15.55:0/1378960995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc624071f80 con 0x7fc6240cf340 2023-08-25T04:04:13.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.458+0000 7fc61a7fc640 1 -- 172.21.15.55:0/1378960995 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 6) v1 ==== 84979+0+0 (secure 0 0 0) 0x7fc6140039a0 con 0x7fc6240cf340 2023-08-25T04:04:13.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.458+0000 7fc61a7fc640 1 --2- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc6080656d0 0x7fc608067b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:13.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.458+0000 7fc61a7fc640 1 -- 172.21.15.55:0/1378960995 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc614082370 con 0x7fc6240cf340 2023-08-25T04:04:13.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.458+0000 7fc6298ac640 1 -- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc6080656d0 msgr2=0x7fc608067b90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/413962747 2023-08-25T04:04:13.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.458+0000 7fc6298ac640 1 --2- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc6080656d0 0x7fc608067b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:04:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.462+0000 7fc61a7fc640 1 -- 172.21.15.55:0/1378960995 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc61404fed0 con 0x7fc6240cf340 2023-08-25T04:04:13.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.642+0000 7fc62bb10640 1 -- 172.21.15.55:0/1378960995 --> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6240d1600 con 0x7fc6080656d0 2023-08-25T04:04:13.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.662+0000 7fc6298ac640 1 -- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc6080656d0 msgr2=0x7fc608067b90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/413962747 2023-08-25T04:04:13.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:13.662+0000 7fc6298ac640 1 --2- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc6080656d0 0x7fc608067b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-25T04:04:13.688 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:13.686+0000 7ff5f9d2a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:04:13.746 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:13.742+0000 7ff5f9d2a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:04:13.757 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:13.754+0000 7fce88e4a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:04:13.802 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:13.798+0000 7ff5f9d2a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:04:13.818 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:13.814+0000 7fce88e4a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:04:13.876 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:13.874+0000 7fce88e4a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:04:13.887 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:13.886+0000 7ff5f9d2a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:04:13.945 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:13.942+0000 7ff5f9d2a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:04:13.967 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:13.966+0000 7fce88e4a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:04:14.026 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:14.022+0000 7fce88e4a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:04:14.029 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:14.026+0000 7ff5f9d2a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:04:14.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:14.066+0000 7fc6298ac640 1 -- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc6080656d0 msgr2=0x7fc608067b90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/413962747 2023-08-25T04:04:14.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:14.066+0000 7fc6298ac640 1 --2- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc6080656d0 0x7fc608067b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-25T04:04:14.085 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:14.082+0000 7ff5f9d2a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:04:14.113 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:14.110+0000 7fce88e4a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:04:14.172 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:14.170+0000 7fce88e4a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:04:14.228 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:14.226+0000 7ff5f9d2a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:04:14.286 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:14.282+0000 7ff5f9d2a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:04:14.321 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:14.318+0000 7fce88e4a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:04:14.382 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:14.378+0000 7fce88e4a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:04:14.529 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:04:14.529 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:04:14.529 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:04:14.537 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:14.534+0000 7ff5f9d2a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:04:14.633 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:04:14.633 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:04:14.633 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:04:14.642 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:14.638+0000 7fce88e4a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:04:14.673 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:14.670+0000 7ff5f9d2a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:04:14.783 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:14.778+0000 7fce88e4a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:04:14.798 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:14.794+0000 7ff5f9d2a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:04:14.868 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:14.866+0000 7ff5f9d2a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:04:14.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:14.870+0000 7fc6298ac640 1 -- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc6080656d0 msgr2=0x7fc608067b90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/413962747 2023-08-25T04:04:14.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:14.870+0000 7fc6298ac640 1 --2- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc6080656d0 0x7fc608067b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-25T04:04:14.913 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:14.910+0000 7fce88e4a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:04:14.986 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:14.982+0000 7fce88e4a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:04:15.004 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:15.002+0000 7ff5f9d2a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:04:15.128 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:15.126+0000 7fce88e4a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:04:15.551 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:15.550+0000 7ff5f9d2a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:04:15.636 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:15.634+0000 7ff5f9d2a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:04:15.698 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:15.694+0000 7fce88e4a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:04:15.786 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:15.782+0000 7fce88e4a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:04:15.788 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:15.786+0000 7ff5f9d2a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:04:15.872 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:15.870+0000 7ff5f9d2a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:04:15.941 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:15.938+0000 7fce88e4a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:04:16.028 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:16.026+0000 7fce88e4a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:04:16.188 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:16.186+0000 7ff5f9d2a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:04:16.249 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:16.246+0000 7ff5f9d2a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:04:16.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:16.258+0000 7fc61a7fc640 1 -- 172.21.15.55:0/1378960995 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 7) v1 ==== 84690+0+0 (secure 0 0 0) 0x7fc6140502a0 con 0x7fc6240cf340 2023-08-25T04:04:16.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:16.258+0000 7fc61a7fc640 1 -- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc6080656d0 msgr2=0x7fc608067b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:04:16.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:16.258+0000 7fc61a7fc640 1 --2- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:6832/413962747,v1:172.21.15.110:6833/413962747] conn(0x7fc6080656d0 0x7fc608067b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:16.376 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:16.374+0000 7fce88e4a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:04:16.383 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:16.382+0000 7ff57fb55640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:04:16.383 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:16.382+0000 7ff57fb55640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:04:16.383 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:16.382+0000 7ff57fb55640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:04:16.384 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:16.382+0000 7ff57fb55640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:04:16.384 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:16.382+0000 7ff57fb55640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:04:16.384 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:16.382+0000 7ff57cb4f640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:04:16.384 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:16.382+0000 7ff57cb4f640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:04:16.384 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:16.382+0000 7ff57cb4f640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:04:16.385 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:16.382+0000 7ff57cb4f640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:04:16.385 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:04:16.382+0000 7ff57cb4f640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:04:16.442 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:04:16.438+0000 7fce88e4a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:04:17.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.266+0000 7fc61a7fc640 1 -- 172.21.15.55:0/1378960995 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 8) v1 ==== 84817+0+0 (secure 0 0 0) 0x7fc614080260 con 0x7fc6240cf340 2023-08-25T04:04:17.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.266+0000 7fc61a7fc640 1 --2- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fc6080337f0 0x7fc60806fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:17.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.266+0000 7fc61a7fc640 1 -- 172.21.15.55:0/1378960995 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc608033bd0 con 0x7fc6080337f0 2023-08-25T04:04:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.266+0000 7fc6298ac640 1 --2- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fc6080337f0 0x7fc60806fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.270+0000 7fc6298ac640 1 --2- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fc6080337f0 0x7fc60806fbb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc62001c8a0 tx=0x7fc6200aa070 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:17.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.350+0000 7fc61a7fc640 1 -- 172.21.15.55:0/1378960995 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fc608033bd0 con 0x7fc6080337f0 2023-08-25T04:04:17.354 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir0 2023-08-25T04:04:17.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.354+0000 7fc62bb10640 1 -- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fc6080337f0 msgr2=0x7fc60806fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:17.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.354+0000 7fc62bb10640 1 --2- 172.21.15.55:0/1378960995 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fc6080337f0 0x7fc60806fbb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc62001c8a0 tx=0x7fc6200aa070 comp rx=0 tx=0).stop 2023-08-25T04:04:17.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.354+0000 7fc62bb10640 1 -- 172.21.15.55:0/1378960995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6240cf340 msgr2=0x7fc62415cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:17.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.354+0000 7fc62bb10640 1 --2- 172.21.15.55:0/1378960995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6240cf340 0x7fc62415cf20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc614000f70 tx=0x7fc61400c890 comp rx=0 tx=0).stop 2023-08-25T04:04:17.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.354+0000 7fc62a0ad640 1 -- 172.21.15.55:0/1378960995 reap_dead start 2023-08-25T04:04:17.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.354+0000 7fc62bb10640 1 -- 172.21.15.55:0/1378960995 shutdown_connections 2023-08-25T04:04:17.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.354+0000 7fc62bb10640 1 -- 172.21.15.55:0/1378960995 >> 172.21.15.55:0/1378960995 conn(0x7fc62406aae0 msgr2=0x7fc6240b8030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:17.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.354+0000 7fc62bb10640 1 -- 172.21.15.55:0/1378960995 shutdown_connections 2023-08-25T04:04:17.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.354+0000 7fc62bb10640 1 -- 172.21.15.55:0/1378960995 wait complete. 2023-08-25T04:04:17.376 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-08-25T04:04:17.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:17.377 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-08-25T04:04:17.388 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-08-25T04:04:17.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.582+0000 7f8190bac640 1 Processor -- start 2023-08-25T04:04:17.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.582+0000 7f8190bac640 1 -- start start 2023-08-25T04:04:17.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.582+0000 7f8190bac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f818c0afa20 0x7f818c0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:17.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.582+0000 7f8190bac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f818c0cf9b0 0x7f818c0ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:17.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.582+0000 7f8190bac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f818c0cae70 con 0x7f818c0cd160 2023-08-25T04:04:17.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.582+0000 7f8190bac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818c0cfe10 con 0x7f818c0cf9b0 2023-08-25T04:04:17.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.582+0000 7f8190bac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818c0cb0e0 con 0x7f818c0afa20 2023-08-25T04:04:17.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.582+0000 7f8181d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f818c0cf9b0 0x7f818c0ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:17.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.582+0000 7f818ad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f818c0cd160 0x7f818c15c3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49394/0 (socket says 172.21.15.55:49394) 2023-08-25T04:04:17.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.582+0000 7f818ad9d640 1 -- 172.21.15.55:0/2445378585 learned_addr learned my addr 172.21.15.55:0/2445378585 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:17.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.582+0000 7f818a59c640 1 --2- 172.21.15.55:0/2445378585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f818c0afa20 0x7f818c0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:17.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.582+0000 7f8181d9b640 1 -- 172.21.15.55:0/2445378585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f818c0afa20 msgr2=0x7f818c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:17.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.582+0000 7f8181d9b640 1 --2- 172.21.15.55:0/2445378585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f818c0afa20 0x7f818c0b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:17.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.582+0000 7f8181d9b640 1 -- 172.21.15.55:0/2445378585 >> v1:172.21.15.55:6789/0 conn(0x7f818c0cd160 legacy=0x7f818c15c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:17.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.582+0000 7f8181d9b640 1 -- 172.21.15.55:0/2445378585 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c0cb3c0 con 0x7f818c0cf9b0 2023-08-25T04:04:17.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.582+0000 7f8189d9b640 1 -- 172.21.15.55:0/2445378585 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084074043 0 0) 0x7f818c0cae70 con 0x7f818c0cd160 2023-08-25T04:04:17.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.586+0000 7f8181d9b640 1 --2- 172.21.15.55:0/2445378585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f818c0cf9b0 0x7f818c0ce9c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f81740097c0 tx=0x7f817401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3265bd3121397a28 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:17.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.586+0000 7f8189d9b640 1 -- 172.21.15.55:0/2445378585 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81740ac620 con 0x7f818c0cf9b0 2023-08-25T04:04:17.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.586+0000 7f8189d9b640 1 -- 172.21.15.55:0/2445378585 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81740ac780 con 0x7f818c0cf9b0 2023-08-25T04:04:17.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.586+0000 7f8189d9b640 1 -- 172.21.15.55:0/2445378585 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81740acb10 con 0x7f818c0cf9b0 2023-08-25T04:04:17.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.586+0000 7f8190bac640 1 -- 172.21.15.55:0/2445378585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f818c0cf9b0 msgr2=0x7f818c0ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:17.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.586+0000 7f8190bac640 1 --2- 172.21.15.55:0/2445378585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f818c0cf9b0 0x7f818c0ce9c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f81740097c0 tx=0x7f817401c3c0 comp rx=0 tx=0).stop 2023-08-25T04:04:17.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.586+0000 7f8190bac640 1 -- 172.21.15.55:0/2445378585 shutdown_connections 2023-08-25T04:04:17.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.586+0000 7f8190bac640 1 --2- 172.21.15.55:0/2445378585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f818c0cf9b0 0x7f818c0ce9c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:17.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.586+0000 7f8190bac640 1 --2- 172.21.15.55:0/2445378585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f818c0afa20 0x7f818c0b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:17.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.586+0000 7f8190bac640 1 -- 172.21.15.55:0/2445378585 >> 172.21.15.55:0/2445378585 conn(0x7f818c0d0780 msgr2=0x7f818c0d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:17.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.586+0000 7f8190bac640 1 -- 172.21.15.55:0/2445378585 shutdown_connections 2023-08-25T04:04:17.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.586+0000 7f8190bac640 1 -- 172.21.15.55:0/2445378585 wait complete. 2023-08-25T04:04:17.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f8190bac640 1 Processor -- start 2023-08-25T04:04:17.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f8190bac640 1 -- start start 2023-08-25T04:04:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f8190bac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f818c0afa20 0x7f818c152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f8190bac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f818c0cd160 0x7f818c0c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f8190bac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f818c0cf9b0 0x7f818c06a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f8190bac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c0b5360 con 0x7f818c0cf9b0 2023-08-25T04:04:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f8190bac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818c0b4720 con 0x7f818c0cd160 2023-08-25T04:04:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f8190bac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f818c0b4a00 con 0x7f818c0afa20 2023-08-25T04:04:17.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f818ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f818c0cf9b0 0x7f818c06a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:17.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f818ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f818c0cf9b0 0x7f818c06a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43808/0 (socket says 172.21.15.55:43808) 2023-08-25T04:04:17.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f818ad9d640 1 -- 172.21.15.55:0/3929158616 learned_addr learned my addr 172.21.15.55:0/3929158616 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:17.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f8181d9b640 1 --2- 172.21.15.55:0/3929158616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f818c0cd160 0x7f818c0c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:17.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f818a59c640 1 --2- 172.21.15.55:0/3929158616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f818c0afa20 0x7f818c152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:17.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f818ad9d640 1 -- 172.21.15.55:0/3929158616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f818c0afa20 msgr2=0x7f818c152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:17.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f818ad9d640 1 --2- 172.21.15.55:0/3929158616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f818c0afa20 0x7f818c152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:17.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f818ad9d640 1 -- 172.21.15.55:0/3929158616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f818c0cd160 msgr2=0x7f818c0c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:17.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f818ad9d640 1 --2- 172.21.15.55:0/3929158616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f818c0cd160 0x7f818c0c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:17.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f818ad9d640 1 -- 172.21.15.55:0/3929158616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8174009420 con 0x7f818c0cf9b0 2023-08-25T04:04:17.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f818ad9d640 1 --2- 172.21.15.55:0/3929158616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f818c0cf9b0 0x7f818c06a9d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f818400c780 tx=0x7f818400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:17.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f81837fe640 1 -- 172.21.15.55:0/3929158616 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818400ce90 con 0x7f818c0cf9b0 2023-08-25T04:04:17.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f81837fe640 1 -- 172.21.15.55:0/3929158616 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818400a640 con 0x7f818c0cf9b0 2023-08-25T04:04:17.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f8190bac640 1 -- 172.21.15.55:0/3929158616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818c0b4ce0 con 0x7f818c0cf9b0 2023-08-25T04:04:17.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f81837fe640 1 -- 172.21.15.55:0/3929158616 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818400a9d0 con 0x7f818c0cf9b0 2023-08-25T04:04:17.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f8190bac640 1 -- 172.21.15.55:0/3929158616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818c1528a0 con 0x7f818c0cf9b0 2023-08-25T04:04:17.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.590+0000 7f8190bac640 1 -- 172.21.15.55:0/3929158616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818c0b54d0 con 0x7f818c0cf9b0 2023-08-25T04:04:17.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.594+0000 7f81837fe640 1 -- 172.21.15.55:0/3929158616 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 84817+0+0 (secure 0 0 0) 0x7f818400ab30 con 0x7f818c0cf9b0 2023-08-25T04:04:17.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.594+0000 7f81837fe640 1 --2- 172.21.15.55:0/3929158616 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f816c065520 0x7f816c0679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:17.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.594+0000 7f81837fe640 1 -- 172.21.15.55:0/3929158616 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f81840820c0 con 0x7f818c0cf9b0 2023-08-25T04:04:17.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.594+0000 7f818a59c640 1 --2- 172.21.15.55:0/3929158616 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f816c065520 0x7f816c0679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:17.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.594+0000 7f818a59c640 1 --2- 172.21.15.55:0/3929158616 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f816c065520 0x7f816c0679e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f817c009ac0 tx=0x7f817c009190 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:17.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.598+0000 7f81837fe640 1 -- 172.21.15.55:0/3929158616 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f818404fdc0 con 0x7f818c0cf9b0 2023-08-25T04:04:17.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.774+0000 7f8190bac640 1 -- 172.21.15.55:0/3929158616 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f818c0b4b70 con 0x7f816c065520 2023-08-25T04:04:17.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.838+0000 7f81837fe640 1 -- 172.21.15.55:0/3929158616 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f818c0b4b70 con 0x7f816c065520 2023-08-25T04:04:17.840 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir1 2023-08-25T04:04:17.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.838+0000 7f8190bac640 1 -- 172.21.15.55:0/3929158616 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f816c065520 msgr2=0x7f816c0679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:17.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.838+0000 7f8190bac640 1 --2- 172.21.15.55:0/3929158616 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f816c065520 0x7f816c0679e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f817c009ac0 tx=0x7f817c009190 comp rx=0 tx=0).stop 2023-08-25T04:04:17.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.838+0000 7f8190bac640 1 -- 172.21.15.55:0/3929158616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f818c0cf9b0 msgr2=0x7f818c06a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:17.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.838+0000 7f8190bac640 1 --2- 172.21.15.55:0/3929158616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f818c0cf9b0 0x7f818c06a9d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f818400c780 tx=0x7f818400cc40 comp rx=0 tx=0).stop 2023-08-25T04:04:17.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.838+0000 7f8190bac640 1 -- 172.21.15.55:0/3929158616 shutdown_connections 2023-08-25T04:04:17.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.838+0000 7f8190bac640 1 --2- 172.21.15.55:0/3929158616 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f816c065520 0x7f816c0679e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:17.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.838+0000 7f8190bac640 1 --2- 172.21.15.55:0/3929158616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f818c0cf9b0 0x7f818c06a9d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:17.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.838+0000 7f8190bac640 1 --2- 172.21.15.55:0/3929158616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f818c0cd160 0x7f818c0c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:17.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.838+0000 7f8190bac640 1 --2- 172.21.15.55:0/3929158616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f818c0afa20 0x7f818c152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:17.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.838+0000 7f8190bac640 1 -- 172.21.15.55:0/3929158616 >> 172.21.15.55:0/3929158616 conn(0x7f818c0d0780 msgr2=0x7f818c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:17.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.838+0000 7f8190bac640 1 -- 172.21.15.55:0/3929158616 shutdown_connections 2023-08-25T04:04:17.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:17.838+0000 7f8190bac640 1 -- 172.21.15.55:0/3929158616 wait complete. 2023-08-25T04:04:17.861 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-08-25T04:04:17.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:17.861 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-08-25T04:04:17.872 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-08-25T04:04:18.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.058+0000 7f3102b1e640 1 Processor -- start 2023-08-25T04:04:18.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.058+0000 7f3102b1e640 1 -- start start 2023-08-25T04:04:18.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.058+0000 7f3102b1e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30fc159d00 0x7f30fc0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:18.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.058+0000 7f3102b1e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f30fc0cc930 0x7f30fc0ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:18.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.058+0000 7f3102b1e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30fc0c9270 con 0x7f30fc06fb50 2023-08-25T04:04:18.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.058+0000 7f3102b1e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30fc0cc510 con 0x7f30fc0cc930 2023-08-25T04:04:18.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.058+0000 7f3102b1e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc0ce220 con 0x7f30fc159d00 2023-08-25T04:04:18.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.058+0000 7f30fbfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f30fc06fb50 0x7f30fc0c8b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49398/0 (socket says 172.21.15.55:49398) 2023-08-25T04:04:18.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.058+0000 7f30fbfff640 1 -- 172.21.15.55:0/1293203260 learned_addr learned my addr 172.21.15.55:0/1293203260 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:18.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.062+0000 7f31008ba640 1 --2- 172.21.15.55:0/1293203260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30fc159d00 0x7f30fc0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:18.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.062+0000 7f31010bb640 1 --2- 172.21.15.55:0/1293203260 >> v2:172.21.15.110:3300/0 conn(0x7f30fc0cc930 0x7f30fc0ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:18.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.062+0000 7f30fb7fe640 1 -- 172.21.15.55:0/1293203260 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632190921 0 0) 0x7f30fc0c9270 con 0x7f30fc06fb50 2023-08-25T04:04:18.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.062+0000 7f30fb7fe640 1 -- 172.21.15.55:0/1293203260 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30ec005740 con 0x7f30fc06fb50 2023-08-25T04:04:18.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.062+0000 7f31010bb640 1 -- 172.21.15.55:0/1293203260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30fc159d00 msgr2=0x7f30fc0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:18.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.062+0000 7f31010bb640 1 --2- 172.21.15.55:0/1293203260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30fc159d00 0x7f30fc0cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.062+0000 7f30fb7fe640 1 -- 172.21.15.55:0/1293203260 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3063715661 0 0) 0x7f30ec005740 con 0x7f30fc06fb50 2023-08-25T04:04:18.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.062+0000 7f31010bb640 1 -- 172.21.15.55:0/1293203260 >> v1:172.21.15.55:6789/0 conn(0x7f30fc06fb50 legacy=0x7f30fc0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:18.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.062+0000 7f31010bb640 1 -- 172.21.15.55:0/1293203260 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30fc0ca6c0 con 0x7f30fc0cc930 2023-08-25T04:04:18.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.062+0000 7f31008ba640 1 --2- 172.21.15.55:0/1293203260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30fc159d00 0x7f30fc0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:04:18.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.062+0000 7f31010bb640 1 --2- 172.21.15.55:0/1293203260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30fc0cc930 0x7f30fc0ccda0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009d90 tx=0x7f30f401c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e91ac54c14d6bb5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:18.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.062+0000 7f30fb7fe640 1 -- 172.21.15.55:0/1293203260 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8001680 con 0x7f30fc0cc930 2023-08-25T04:04:18.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.062+0000 7f30fb7fe640 1 -- 172.21.15.55:0/1293203260 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f40a55b0 con 0x7f30fc0cc930 2023-08-25T04:04:18.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.062+0000 7f30fb7fe640 1 -- 172.21.15.55:0/1293203260 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f40a5920 con 0x7f30fc0cc930 2023-08-25T04:04:18.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f3102b1e640 1 -- 172.21.15.55:0/1293203260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30fc0cc930 msgr2=0x7f30fc0ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:18.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f3102b1e640 1 --2- 172.21.15.55:0/1293203260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30fc0cc930 0x7f30fc0ccda0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009d90 tx=0x7f30f401c7b0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f3102b1e640 1 -- 172.21.15.55:0/1293203260 shutdown_connections 2023-08-25T04:04:18.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f3102b1e640 1 --2- 172.21.15.55:0/1293203260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30fc0cc930 0x7f30fc0ccda0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f3102b1e640 1 --2- 172.21.15.55:0/1293203260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30fc159d00 0x7f30fc0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f3102b1e640 1 -- 172.21.15.55:0/1293203260 >> 172.21.15.55:0/1293203260 conn(0x7f30fc0caf90 msgr2=0x7f30fc0cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:18.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f3102b1e640 1 -- 172.21.15.55:0/1293203260 shutdown_connections 2023-08-25T04:04:18.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f3102b1e640 1 -- 172.21.15.55:0/1293203260 wait complete. 2023-08-25T04:04:18.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f3102b1e640 1 Processor -- start 2023-08-25T04:04:18.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f3102b1e640 1 -- start start 2023-08-25T04:04:18.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f3102b1e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30fc06fb50 0x7f30fc0c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:18.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f3102b1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc0cc930 0x7f30fc1f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:18.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f3102b1e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30fc159d00 0x7f30fc1f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:18.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f3102b1e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc1f62d0 con 0x7f30fc0cc930 2023-08-25T04:04:18.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f3102b1e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc1f8890 con 0x7f30fc159d00 2023-08-25T04:04:18.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f3102b1e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc1f8b70 con 0x7f30fc06fb50 2023-08-25T04:04:18.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f30fbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc0cc930 0x7f30fc1f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:18.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f30fbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc0cc930 0x7f30fc1f5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43824/0 (socket says 172.21.15.55:43824) 2023-08-25T04:04:18.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.066+0000 7f30fbfff640 1 -- 172.21.15.55:0/2486658752 learned_addr learned my addr 172.21.15.55:0/2486658752 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:18.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.070+0000 7f31008ba640 1 --2- 172.21.15.55:0/2486658752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30fc06fb50 0x7f30fc0c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:18.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.070+0000 7f31010bb640 1 --2- 172.21.15.55:0/2486658752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30fc159d00 0x7f30fc1f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:18.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.070+0000 7f30fbfff640 1 -- 172.21.15.55:0/2486658752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30fc06fb50 msgr2=0x7f30fc0c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:18.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.070+0000 7f30fbfff640 1 --2- 172.21.15.55:0/2486658752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30fc06fb50 0x7f30fc0c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.070+0000 7f30fbfff640 1 -- 172.21.15.55:0/2486658752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30fc159d00 msgr2=0x7f30fc1f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:18.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.070+0000 7f30fbfff640 1 --2- 172.21.15.55:0/2486658752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30fc159d00 0x7f30fc1f5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.070+0000 7f30fbfff640 1 -- 172.21.15.55:0/2486658752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f0009420 con 0x7f30fc0cc930 2023-08-25T04:04:18.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.070+0000 7f30fbfff640 1 --2- 172.21.15.55:0/2486658752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc0cc930 0x7f30fc1f5850 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f30e800c750 tx=0x7f30e800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:18.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.070+0000 7f30f97fa640 1 -- 172.21.15.55:0/2486658752 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8005ae0 con 0x7f30fc0cc930 2023-08-25T04:04:18.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.070+0000 7f30f97fa640 1 -- 172.21.15.55:0/2486658752 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e8005c40 con 0x7f30fc0cc930 2023-08-25T04:04:18.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.070+0000 7f30f97fa640 1 -- 172.21.15.55:0/2486658752 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8007070 con 0x7f30fc0cc930 2023-08-25T04:04:18.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.070+0000 7f3102b1e640 1 -- 172.21.15.55:0/2486658752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f4009a70 con 0x7f30fc0cc930 2023-08-25T04:04:18.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.070+0000 7f3102b1e640 1 -- 172.21.15.55:0/2486658752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30fc1f9130 con 0x7f30fc0cc930 2023-08-25T04:04:18.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.070+0000 7f3102b1e640 1 -- 172.21.15.55:0/2486658752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30fc04dbe0 con 0x7f30fc0cc930 2023-08-25T04:04:18.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.070+0000 7f30f97fa640 1 -- 172.21.15.55:0/2486658752 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 8) v1 ==== 84817+0+0 (secure 0 0 0) 0x7f30e80071d0 con 0x7f30fc0cc930 2023-08-25T04:04:18.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.070+0000 7f30f97fa640 1 --2- 172.21.15.55:0/2486658752 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f30e0065520 0x7f30e00679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:18.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.070+0000 7f30f97fa640 1 -- 172.21.15.55:0/2486658752 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f30e8082300 con 0x7f30fc0cc930 2023-08-25T04:04:18.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.074+0000 7f31008ba640 1 --2- 172.21.15.55:0/2486658752 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f30e0065520 0x7f30e00679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:18.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.074+0000 7f31008ba640 1 --2- 172.21.15.55:0/2486658752 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f30e0065520 0x7f30e00679e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0ac2e0 tx=0x7f30f0008040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:18.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.074+0000 7f30f97fa640 1 -- 172.21.15.55:0/2486658752 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f30e804ff50 con 0x7f30fc0cc930 2023-08-25T04:04:18.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.254+0000 7f3102b1e640 1 -- 172.21.15.55:0/2486658752 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f30fc15a0e0 con 0x7f30e0065520 2023-08-25T04:04:18.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.314+0000 7f30f97fa640 1 -- 172.21.15.55:0/2486658752 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f30f0011e90 con 0x7f30e0065520 2023-08-25T04:04:18.317 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir2 2023-08-25T04:04:18.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.314+0000 7f3102b1e640 1 -- 172.21.15.55:0/2486658752 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f30e0065520 msgr2=0x7f30e00679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:18.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.314+0000 7f3102b1e640 1 --2- 172.21.15.55:0/2486658752 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f30e0065520 0x7f30e00679e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f30fc0ac2e0 tx=0x7f30f0008040 comp rx=0 tx=0).stop 2023-08-25T04:04:18.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.314+0000 7f3102b1e640 1 -- 172.21.15.55:0/2486658752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc0cc930 msgr2=0x7f30fc1f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:18.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.314+0000 7f3102b1e640 1 --2- 172.21.15.55:0/2486658752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc0cc930 0x7f30fc1f5850 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f30e800c750 tx=0x7f30e800cc10 comp rx=0 tx=0).stop 2023-08-25T04:04:18.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.314+0000 7f3102b1e640 1 -- 172.21.15.55:0/2486658752 shutdown_connections 2023-08-25T04:04:18.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.314+0000 7f3102b1e640 1 --2- 172.21.15.55:0/2486658752 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f30e0065520 0x7f30e00679e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.314+0000 7f3102b1e640 1 --2- 172.21.15.55:0/2486658752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30fc159d00 0x7f30fc1f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.314+0000 7f3102b1e640 1 --2- 172.21.15.55:0/2486658752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30fc0cc930 0x7f30fc1f5850 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.314+0000 7f3102b1e640 1 --2- 172.21.15.55:0/2486658752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30fc06fb50 0x7f30fc0c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.314+0000 7f3102b1e640 1 -- 172.21.15.55:0/2486658752 >> 172.21.15.55:0/2486658752 conn(0x7f30fc0caf90 msgr2=0x7f30fc156800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.314+0000 7f3102b1e640 1 -- 172.21.15.55:0/2486658752 shutdown_connections 2023-08-25T04:04:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.314+0000 7f3102b1e640 1 -- 172.21.15.55:0/2486658752 wait complete. 2023-08-25T04:04:18.338 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-08-25T04:04:18.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:18.339 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-08-25T04:04:18.350 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-08-25T04:04:18.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.538+0000 7f4a94a34640 1 Processor -- start 2023-08-25T04:04:18.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.538+0000 7f4a94a34640 1 -- start start 2023-08-25T04:04:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.538+0000 7f4a94a34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4a90155740 0x7f4a9015c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.538+0000 7f4a94a34640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4a9006fb50 0x7f4a900aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.542+0000 7f4a94a34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a9015fa50 con 0x7f4a90155360 2023-08-25T04:04:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.542+0000 7f4a94a34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9015f2a0 con 0x7f4a90155740 2023-08-25T04:04:18.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.542+0000 7f4a94a34640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9015f490 con 0x7f4a9006fb50 2023-08-25T04:04:18.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.542+0000 7f4a87fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4a90155740 0x7f4a9015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:18.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.542+0000 7f4a8e59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4a90155360 0x7f4a9015eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49400/0 (socket says 172.21.15.55:49400) 2023-08-25T04:04:18.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.542+0000 7f4a8e59c640 1 -- 172.21.15.55:0/1564675525 learned_addr learned my addr 172.21.15.55:0/1564675525 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.542+0000 7f4a87fff640 1 -- 172.21.15.55:0/1564675525 >> v2:172.21.15.110:3300/0 conn(0x7f4a9006fb50 msgr2=0x7f4a900aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.542+0000 7f4a8ed9d640 1 --2- 172.21.15.55:0/1564675525 >> v2:172.21.15.110:3300/0 conn(0x7f4a9006fb50 0x7f4a900aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.542+0000 7f4a87fff640 1 --2- 172.21.15.55:0/1564675525 >> v2:172.21.15.110:3300/0 conn(0x7f4a9006fb50 0x7f4a900aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.542+0000 7f4a87fff640 1 -- 172.21.15.55:0/1564675525 >> v1:172.21.15.55:6789/0 conn(0x7f4a90155360 legacy=0x7f4a9015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.542+0000 7f4a87fff640 1 -- 172.21.15.55:0/1564675525 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9015f770 con 0x7f4a90155740 2023-08-25T04:04:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.542+0000 7f4a8ed9d640 1 --2- 172.21.15.55:0/1564675525 >> v2:172.21.15.110:3300/0 conn(0x7f4a9006fb50 0x7f4a900aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:04:18.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.542+0000 7f4a8dd9b640 1 -- 172.21.15.55:0/1564675525 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597795157 0 0) 0x7f4a9015fa50 con 0x7f4a90155360 2023-08-25T04:04:18.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.542+0000 7f4a87fff640 1 --2- 172.21.15.55:0/1564675525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a90155740 0x7f4a9015c180 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4a901590d0 tx=0x7f4a7801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610db78e92e6a67d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:18.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.542+0000 7f4a8dd9b640 1 -- 172.21.15.55:0/1564675525 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a780ab600 con 0x7f4a90155740 2023-08-25T04:04:18.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.542+0000 7f4a8dd9b640 1 -- 172.21.15.55:0/1564675525 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a780a7050 con 0x7f4a90155740 2023-08-25T04:04:18.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.542+0000 7f4a8dd9b640 1 -- 172.21.15.55:0/1564675525 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a780ab980 con 0x7f4a90155740 2023-08-25T04:04:18.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a94a34640 1 -- 172.21.15.55:0/1564675525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a90155740 msgr2=0x7f4a9015c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:18.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a94a34640 1 --2- 172.21.15.55:0/1564675525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a90155740 0x7f4a9015c180 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4a901590d0 tx=0x7f4a7801c340 comp rx=0 tx=0).stop 2023-08-25T04:04:18.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a94a34640 1 -- 172.21.15.55:0/1564675525 shutdown_connections 2023-08-25T04:04:18.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a94a34640 1 --2- 172.21.15.55:0/1564675525 >> v2:172.21.15.110:3300/0 conn(0x7f4a9006fb50 0x7f4a900aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a94a34640 1 --2- 172.21.15.55:0/1564675525 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a90155740 0x7f4a9015c180 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a94a34640 1 -- 172.21.15.55:0/1564675525 >> 172.21.15.55:0/1564675525 conn(0x7f4a900caf90 msgr2=0x7f4a900cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:18.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a94a34640 1 -- 172.21.15.55:0/1564675525 shutdown_connections 2023-08-25T04:04:18.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a94a34640 1 -- 172.21.15.55:0/1564675525 wait complete. 2023-08-25T04:04:18.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a94a34640 1 Processor -- start 2023-08-25T04:04:18.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a94a34640 1 -- start start 2023-08-25T04:04:18.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a94a34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a9006fb50 0x7f4a900c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:18.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a94a34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a90155360 0x7f4a900c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:18.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a94a34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a90155740 0x7f4a90141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:18.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a94a34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a90142880 con 0x7f4a90155740 2023-08-25T04:04:18.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a94a34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a90154880 con 0x7f4a9006fb50 2023-08-25T04:04:18.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a94a34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a90140d20 con 0x7f4a90155360 2023-08-25T04:04:18.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a8ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a90155740 0x7f4a90141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:18.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a8ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a90155740 0x7f4a90141420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43852/0 (socket says 172.21.15.55:43852) 2023-08-25T04:04:18.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a8ed9d640 1 -- 172.21.15.55:0/1475529837 learned_addr learned my addr 172.21.15.55:0/1475529837 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:18.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a87fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a90155360 0x7f4a900c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:18.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.546+0000 7f4a8e59c640 1 --2- 172.21.15.55:0/1475529837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a9006fb50 0x7f4a900c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:18.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.550+0000 7f4a8ed9d640 1 -- 172.21.15.55:0/1475529837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a90155360 msgr2=0x7f4a900c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:18.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.550+0000 7f4a8ed9d640 1 --2- 172.21.15.55:0/1475529837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a90155360 0x7f4a900c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.550+0000 7f4a8ed9d640 1 -- 172.21.15.55:0/1475529837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a9006fb50 msgr2=0x7f4a900c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:18.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.550+0000 7f4a8ed9d640 1 --2- 172.21.15.55:0/1475529837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a9006fb50 0x7f4a900c6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.550+0000 7f4a8ed9d640 1 -- 172.21.15.55:0/1475529837 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a78009420 con 0x7f4a90155740 2023-08-25T04:04:18.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.550+0000 7f4a8ed9d640 1 --2- 172.21.15.55:0/1475529837 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a90155740 0x7f4a90141420 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800cd80 tx=0x7f4a8800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:18.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.550+0000 7f4a86ffd640 1 -- 172.21.15.55:0/1475529837 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8800f680 con 0x7f4a90155740 2023-08-25T04:04:18.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.550+0000 7f4a86ffd640 1 -- 172.21.15.55:0/1475529837 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8800f800 con 0x7f4a90155740 2023-08-25T04:04:18.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.550+0000 7f4a94a34640 1 -- 172.21.15.55:0/1475529837 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a90141000 con 0x7f4a90155740 2023-08-25T04:04:18.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.550+0000 7f4a86ffd640 1 -- 172.21.15.55:0/1475529837 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8800fbb0 con 0x7f4a90155740 2023-08-25T04:04:18.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.550+0000 7f4a94a34640 1 -- 172.21.15.55:0/1475529837 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a90142d70 con 0x7f4a90155740 2023-08-25T04:04:18.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.550+0000 7f4a94a34640 1 -- 172.21.15.55:0/1475529837 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a90142f90 con 0x7f4a90155740 2023-08-25T04:04:18.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.550+0000 7f4a86ffd640 1 -- 172.21.15.55:0/1475529837 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 9) v1 ==== 85082+0+0 (secure 0 0 0) 0x7f4a8800b040 con 0x7f4a90155740 2023-08-25T04:04:18.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.554+0000 7f4a86ffd640 1 --2- 172.21.15.55:0/1475529837 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4a700657f0 0x7f4a70067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:18.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.554+0000 7f4a86ffd640 1 -- 172.21.15.55:0/1475529837 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f4a88083bb0 con 0x7f4a90155740 2023-08-25T04:04:18.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.554+0000 7f4a8e59c640 1 --2- 172.21.15.55:0/1475529837 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4a700657f0 0x7f4a70067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:18.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.554+0000 7f4a8e59c640 1 --2- 172.21.15.55:0/1475529837 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4a700657f0 0x7f4a70067cb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4a80007fd0 tx=0x7f4a80007d60 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:18.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.558+0000 7f4a86ffd640 1 -- 172.21.15.55:0/1475529837 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4a88051380 con 0x7f4a90155740 2023-08-25T04:04:18.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.734+0000 7f4a94a34640 1 -- 172.21.15.55:0/1475529837 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a90141240 con 0x7f4a700657f0 2023-08-25T04:04:18.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.794+0000 7f4a86ffd640 1 -- 172.21.15.55:0/1475529837 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f4a90141240 con 0x7f4a700657f0 2023-08-25T04:04:18.797 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir3 2023-08-25T04:04:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.794+0000 7f4a94a34640 1 -- 172.21.15.55:0/1475529837 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4a700657f0 msgr2=0x7f4a70067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.794+0000 7f4a94a34640 1 --2- 172.21.15.55:0/1475529837 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4a700657f0 0x7f4a70067cb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4a80007fd0 tx=0x7f4a80007d60 comp rx=0 tx=0).stop 2023-08-25T04:04:18.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.794+0000 7f4a94a34640 1 -- 172.21.15.55:0/1475529837 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a90155740 msgr2=0x7f4a90141420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:18.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.794+0000 7f4a94a34640 1 --2- 172.21.15.55:0/1475529837 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a90155740 0x7f4a90141420 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800cd80 tx=0x7f4a8800a650 comp rx=0 tx=0).stop 2023-08-25T04:04:18.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.794+0000 7f4a94a34640 1 -- 172.21.15.55:0/1475529837 shutdown_connections 2023-08-25T04:04:18.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.794+0000 7f4a94a34640 1 --2- 172.21.15.55:0/1475529837 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4a700657f0 0x7f4a70067cb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.794+0000 7f4a94a34640 1 --2- 172.21.15.55:0/1475529837 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a90155740 0x7f4a90141420 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.794+0000 7f4a94a34640 1 --2- 172.21.15.55:0/1475529837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a90155360 0x7f4a900c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.794+0000 7f4a94a34640 1 --2- 172.21.15.55:0/1475529837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a9006fb50 0x7f4a900c6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.794+0000 7f4a94a34640 1 -- 172.21.15.55:0/1475529837 >> 172.21.15.55:0/1475529837 conn(0x7f4a900caf90 msgr2=0x7f4a900b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.798+0000 7f4a94a34640 1 -- 172.21.15.55:0/1475529837 shutdown_connections 2023-08-25T04:04:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:18.798+0000 7f4a94a34640 1 -- 172.21.15.55:0/1475529837 wait complete. 2023-08-25T04:04:18.818 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-08-25T04:04:18.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:18.819 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-08-25T04:04:18.830 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-08-25T04:04:19.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.014+0000 7f4dd7888640 1 Processor -- start 2023-08-25T04:04:19.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.014+0000 7f4dd7888640 1 -- start start 2023-08-25T04:04:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.018+0000 7f4dd7888640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4dd0159d00 0x7f4dd00cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.018+0000 7f4dd7888640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dd006fb50 0x7f4dd00c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.018+0000 7f4dd7888640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4dd00cc930 0x7f4dd00ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.018+0000 7f4dd7888640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd00cc510 con 0x7f4dd0159d00 2023-08-25T04:04:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.018+0000 7f4dd7888640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd00ce220 con 0x7f4dd00cc930 2023-08-25T04:04:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.018+0000 7f4dd7888640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd00ca6c0 con 0x7f4dd006fb50 2023-08-25T04:04:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.018+0000 7f4dd5624640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4dd0159d00 0x7f4dd00cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.018+0000 7f4dd5624640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4dd0159d00 0x7f4dd00cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43858/0 (socket says 172.21.15.55:43858) 2023-08-25T04:04:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.018+0000 7f4dd5624640 1 -- 172.21.15.55:0/4129716189 learned_addr learned my addr 172.21.15.55:0/4129716189 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.018+0000 7f4dd4e23640 1 --2- 172.21.15.55:0/4129716189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dd006fb50 0x7f4dd00c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.018+0000 7f4dd5e25640 1 --2- 172.21.15.55:0/4129716189 >> v2:172.21.15.110:3300/0 conn(0x7f4dd00cc930 0x7f4dd00ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:19.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.018+0000 7f4dd5624640 1 -- 172.21.15.55:0/4129716189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dd006fb50 msgr2=0x7f4dd00c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:19.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.018+0000 7f4dd5624640 1 --2- 172.21.15.55:0/4129716189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dd006fb50 0x7f4dd00c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.018+0000 7f4dd5624640 1 -- 172.21.15.55:0/4129716189 >> v2:172.21.15.110:3300/0 conn(0x7f4dd00cc930 msgr2=0x7f4dd00ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:19.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.018+0000 7f4dd5624640 1 --2- 172.21.15.55:0/4129716189 >> v2:172.21.15.110:3300/0 conn(0x7f4dd00cc930 0x7f4dd00ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.018+0000 7f4dd5624640 1 -- 172.21.15.55:0/4129716189 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd00ca9a0 con 0x7f4dd0159d00 2023-08-25T04:04:19.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.022+0000 7f4dd5624640 1 --2- 172.21.15.55:0/4129716189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dd0159d00 0x7f4dd00cdc40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00cbd30 tx=0x7f4dcc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7bd793591f29dc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:19.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.022+0000 7f4dc7fff640 1 -- 172.21.15.55:0/4129716189 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0ab620 con 0x7f4dd0159d00 2023-08-25T04:04:19.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.022+0000 7f4dc7fff640 1 -- 172.21.15.55:0/4129716189 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc0ab780 con 0x7f4dd0159d00 2023-08-25T04:04:19.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.022+0000 7f4dc7fff640 1 -- 172.21.15.55:0/4129716189 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0abb10 con 0x7f4dd0159d00 2023-08-25T04:04:19.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.022+0000 7f4dd7888640 1 -- 172.21.15.55:0/4129716189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dd0159d00 msgr2=0x7f4dd00cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:19.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.022+0000 7f4dd7888640 1 --2- 172.21.15.55:0/4129716189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dd0159d00 0x7f4dd00cdc40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00cbd30 tx=0x7f4dcc01c440 comp rx=0 tx=0).stop 2023-08-25T04:04:19.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.022+0000 7f4dd7888640 1 -- 172.21.15.55:0/4129716189 shutdown_connections 2023-08-25T04:04:19.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.022+0000 7f4dd7888640 1 --2- 172.21.15.55:0/4129716189 >> v2:172.21.15.110:3300/0 conn(0x7f4dd00cc930 0x7f4dd00ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.022+0000 7f4dd7888640 1 --2- 172.21.15.55:0/4129716189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dd006fb50 0x7f4dd00c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.022+0000 7f4dd7888640 1 --2- 172.21.15.55:0/4129716189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dd0159d00 0x7f4dd00cdc40 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.022+0000 7f4dd7888640 1 -- 172.21.15.55:0/4129716189 >> 172.21.15.55:0/4129716189 conn(0x7f4dd00caf90 msgr2=0x7f4dd00cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:19.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.022+0000 7f4dd7888640 1 -- 172.21.15.55:0/4129716189 shutdown_connections 2023-08-25T04:04:19.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.022+0000 7f4dd7888640 1 -- 172.21.15.55:0/4129716189 wait complete. 2023-08-25T04:04:19.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.022+0000 7f4dd7888640 1 Processor -- start 2023-08-25T04:04:19.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.022+0000 7f4dd7888640 1 -- start start 2023-08-25T04:04:19.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd7888640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dd006fb50 0x7f4dd01f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:19.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd7888640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dd00cc930 0x7f4dd00c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:19.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd7888640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dd0159d00 0x7f4dd014ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:19.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd7888640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd014b700 con 0x7f4dd0159d00 2023-08-25T04:04:19.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd7888640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd00c6de0 con 0x7f4dd006fb50 2023-08-25T04:04:19.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd7888640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd00c6210 con 0x7f4dd00cc930 2023-08-25T04:04:19.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd5e25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dd0159d00 0x7f4dd014ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:19.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd5e25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dd0159d00 0x7f4dd014ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43866/0 (socket says 172.21.15.55:43866) 2023-08-25T04:04:19.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd5e25640 1 -- 172.21.15.55:0/2249926777 learned_addr learned my addr 172.21.15.55:0/2249926777 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:19.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd5624640 1 --2- 172.21.15.55:0/2249926777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dd006fb50 0x7f4dd01f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:19.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd4e23640 1 --2- 172.21.15.55:0/2249926777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dd00cc930 0x7f4dd00c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:19.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd5e25640 1 -- 172.21.15.55:0/2249926777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dd00cc930 msgr2=0x7f4dd00c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:19.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd5e25640 1 --2- 172.21.15.55:0/2249926777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dd00cc930 0x7f4dd00c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd5e25640 1 -- 172.21.15.55:0/2249926777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dd006fb50 msgr2=0x7f4dd01f93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:19.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd5e25640 1 --2- 172.21.15.55:0/2249926777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dd006fb50 0x7f4dd01f93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd5e25640 1 -- 172.21.15.55:0/2249926777 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc0094d0 con 0x7f4dd0159d00 2023-08-25T04:04:19.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd5624640 1 --2- 172.21.15.55:0/2249926777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dd006fb50 0x7f4dd01f93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:19.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd4e23640 1 --2- 172.21.15.55:0/2249926777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dd00cc930 0x7f4dd00c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:19.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd5e25640 1 --2- 172.21.15.55:0/2249926777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dd0159d00 0x7f4dd014ad80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8007e40 tx=0x7f4dc800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:19.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dc5ffb640 1 -- 172.21.15.55:0/2249926777 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8014620 con 0x7f4dd0159d00 2023-08-25T04:04:19.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dc5ffb640 1 -- 172.21.15.55:0/2249926777 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc800ee90 con 0x7f4dd0159d00 2023-08-25T04:04:19.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd7888640 1 -- 172.21.15.55:0/2249926777 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd00c64b0 con 0x7f4dd0159d00 2023-08-25T04:04:19.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dc5ffb640 1 -- 172.21.15.55:0/2249926777 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc80149e0 con 0x7f4dd0159d00 2023-08-25T04:04:19.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd7888640 1 -- 172.21.15.55:0/2249926777 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd00c6a70 con 0x7f4dd0159d00 2023-08-25T04:04:19.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dd7888640 1 -- 172.21.15.55:0/2249926777 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd004dbe0 con 0x7f4dd0159d00 2023-08-25T04:04:19.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.026+0000 7f4dc5ffb640 1 -- 172.21.15.55:0/2249926777 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 9) v1 ==== 85082+0+0 (secure 0 0 0) 0x7f4dc8014b40 con 0x7f4dd0159d00 2023-08-25T04:04:19.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.030+0000 7f4dc5ffb640 1 --2- 172.21.15.55:0/2249926777 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4db40657f0 0x7f4db4067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:19.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.030+0000 7f4dc5ffb640 1 -- 172.21.15.55:0/2249926777 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f4dc8083be0 con 0x7f4dd0159d00 2023-08-25T04:04:19.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.030+0000 7f4dd5624640 1 --2- 172.21.15.55:0/2249926777 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4db40657f0 0x7f4db4067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:19.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.030+0000 7f4dd5624640 1 --2- 172.21.15.55:0/2249926777 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4db40657f0 0x7f4db4067cb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0af000 tx=0x7f4dcc0a7000 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:19.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.034+0000 7f4dc5ffb640 1 -- 172.21.15.55:0/2249926777 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4dc8054ea0 con 0x7f4dd0159d00 2023-08-25T04:04:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.210+0000 7f4dd7888640 1 -- 172.21.15.55:0/2249926777 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4dd00cd770 con 0x7f4db40657f0 2023-08-25T04:04:19.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.278+0000 7f4dc5ffb640 1 -- 172.21.15.55:0/2249926777 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f4dcc0ab8f0 con 0x7f4db40657f0 2023-08-25T04:04:19.283 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir4 2023-08-25T04:04:19.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.282+0000 7f4dd7888640 1 -- 172.21.15.55:0/2249926777 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4db40657f0 msgr2=0x7f4db4067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:19.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.282+0000 7f4dd7888640 1 --2- 172.21.15.55:0/2249926777 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4db40657f0 0x7f4db4067cb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0af000 tx=0x7f4dcc0a7000 comp rx=0 tx=0).stop 2023-08-25T04:04:19.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.282+0000 7f4dd7888640 1 -- 172.21.15.55:0/2249926777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dd0159d00 msgr2=0x7f4dd014ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:19.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.282+0000 7f4dd7888640 1 --2- 172.21.15.55:0/2249926777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dd0159d00 0x7f4dd014ad80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8007e40 tx=0x7f4dc800e4b0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.282+0000 7f4dd7888640 1 -- 172.21.15.55:0/2249926777 shutdown_connections 2023-08-25T04:04:19.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.282+0000 7f4dd7888640 1 --2- 172.21.15.55:0/2249926777 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4db40657f0 0x7f4db4067cb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.282+0000 7f4dd7888640 1 --2- 172.21.15.55:0/2249926777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4dd0159d00 0x7f4dd014ad80 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.282+0000 7f4dd7888640 1 --2- 172.21.15.55:0/2249926777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4dd00cc930 0x7f4dd00c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.282+0000 7f4dd7888640 1 --2- 172.21.15.55:0/2249926777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4dd006fb50 0x7f4dd01f93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.282+0000 7f4dd7888640 1 -- 172.21.15.55:0/2249926777 >> 172.21.15.55:0/2249926777 conn(0x7f4dd00caf90 msgr2=0x7f4dd0158e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:19.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.282+0000 7f4dd7888640 1 -- 172.21.15.55:0/2249926777 shutdown_connections 2023-08-25T04:04:19.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.282+0000 7f4dd7888640 1 -- 172.21.15.55:0/2249926777 wait complete. 2023-08-25T04:04:19.303 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-08-25T04:04:19.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:19.304 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-08-25T04:04:19.315 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-08-25T04:04:19.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd31e008640 1 Processor -- start 2023-08-25T04:04:19.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd31e008640 1 -- start start 2023-08-25T04:04:19.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd31e008640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd318159d00 0x7fd3180cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:19.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd31e008640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3180c9270 con 0x7fd3180cc930 2023-08-25T04:04:19.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd31e008640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3180ce220 con 0x7fd31806fb50 2023-08-25T04:04:19.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd31e008640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3180cc510 con 0x7fd318159d00 2023-08-25T04:04:19.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd317fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd3180cc930 0x7fd3180ccd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49404/0 (socket says 172.21.15.55:49404) 2023-08-25T04:04:19.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd317fff640 1 -- 172.21.15.55:0/256807650 learned_addr learned my addr 172.21.15.55:0/256807650 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:19.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd3177fe640 1 --2- 172.21.15.55:0/256807650 >> v2:172.21.15.110:3300/0 conn(0x7fd318159d00 0x7fd3180cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:19.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd3167fc640 1 -- 172.21.15.55:0/256807650 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648833920 0 0) 0x7fd3180c9270 con 0x7fd3180cc930 2023-08-25T04:04:19.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd3167fc640 1 -- 172.21.15.55:0/256807650 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd300003530 con 0x7fd3180cc930 2023-08-25T04:04:19.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd3167fc640 1 -- 172.21.15.55:0/256807650 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4125037687 0 0) 0x7fd300003530 con 0x7fd3180cc930 2023-08-25T04:04:19.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd3167fc640 1 -- 172.21.15.55:0/256807650 >> v2:172.21.15.110:3300/0 conn(0x7fd318159d00 msgr2=0x7fd3180cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:19.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd3167fc640 1 --2- 172.21.15.55:0/256807650 >> v2:172.21.15.110:3300/0 conn(0x7fd318159d00 0x7fd3180cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd3167fc640 1 -- 172.21.15.55:0/256807650 >> v1:172.21.15.110:6789/0 conn(0x7fd31806fb50 legacy=0x7fd3180c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:19.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd3167fc640 1 -- 172.21.15.55:0/256807650 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3180ca6c0 con 0x7fd3180cc930 2023-08-25T04:04:19.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd3167fc640 1 -- 172.21.15.55:0/256807650 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fd310001a00 con 0x7fd3180cc930 2023-08-25T04:04:19.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd3167fc640 1 -- 172.21.15.55:0/256807650 >> v1:172.21.15.55:6789/0 conn(0x7fd3180cc930 legacy=0x7fd3180ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:19.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd3167fc640 1 --2- 172.21.15.55:0/256807650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd300003980 0x7fd300003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:19.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd3167fc640 1 --2- 172.21.15.55:0/256807650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3000047d0 0x7fd300004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:19.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd3167fc640 1 --2- 172.21.15.55:0/256807650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd300005190 0x7fd30000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:19.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd3167fc640 1 -- 172.21.15.55:0/256807650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180cc510 con 0x7fd300005190 2023-08-25T04:04:19.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd3167fc640 1 -- 172.21.15.55:0/256807650 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30000c130 con 0x7fd3000047d0 2023-08-25T04:04:19.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd3167fc640 1 -- 172.21.15.55:0/256807650 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30000e500 con 0x7fd300003980 2023-08-25T04:04:19.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd317fff640 1 --2- 172.21.15.55:0/256807650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd300005190 0x7fd30000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:19.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd316ffd640 1 --2- 172.21.15.55:0/256807650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3000047d0 0x7fd300004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:19.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd3177fe640 1 --2- 172.21.15.55:0/256807650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd300003980 0x7fd300003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:19.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd317fff640 1 -- 172.21.15.55:0/256807650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd300003980 msgr2=0x7fd300003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:19.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd317fff640 1 --2- 172.21.15.55:0/256807650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd300003980 0x7fd300003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd317fff640 1 -- 172.21.15.55:0/256807650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3000047d0 msgr2=0x7fd300004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:19.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd317fff640 1 --2- 172.21.15.55:0/256807650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3000047d0 0x7fd300004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.506+0000 7fd317fff640 1 -- 172.21.15.55:0/256807650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd300003530 con 0x7fd300005190 2023-08-25T04:04:19.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.510+0000 7fd317fff640 1 -- 172.21.15.55:0/256807650 reap_dead start 2023-08-25T04:04:19.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.510+0000 7fd317fff640 1 --2- 172.21.15.55:0/256807650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd300005190 0x7fd30000b990 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd31000a830 tx=0x7fd31001faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f28d09b448e3dd7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:19.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.510+0000 7fd3167fc640 1 -- 172.21.15.55:0/256807650 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3100aa6d0 con 0x7fd300005190 2023-08-25T04:04:19.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.510+0000 7fd3167fc640 1 -- 172.21.15.55:0/256807650 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3100aa870 con 0x7fd300005190 2023-08-25T04:04:19.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.510+0000 7fd3167fc640 1 -- 172.21.15.55:0/256807650 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3100aac20 con 0x7fd300005190 2023-08-25T04:04:19.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.510+0000 7fd31e008640 1 -- 172.21.15.55:0/256807650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd300005190 msgr2=0x7fd30000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:19.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.510+0000 7fd31e008640 1 --2- 172.21.15.55:0/256807650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd300005190 0x7fd30000b990 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd31000a830 tx=0x7fd31001faa0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.510+0000 7fd31e008640 1 -- 172.21.15.55:0/256807650 shutdown_connections 2023-08-25T04:04:19.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.510+0000 7fd31e008640 1 --2- 172.21.15.55:0/256807650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd300005190 0x7fd30000b990 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.510+0000 7fd31e008640 1 -- 172.21.15.55:0/256807650 >> 172.21.15.55:0/256807650 conn(0x7fd3180caf90 msgr2=0x7fd3180cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:19.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.510+0000 7fd31e008640 1 -- 172.21.15.55:0/256807650 shutdown_connections 2023-08-25T04:04:19.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.510+0000 7fd31e008640 1 -- 172.21.15.55:0/256807650 wait complete. 2023-08-25T04:04:19.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd31e008640 1 Processor -- start 2023-08-25T04:04:19.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd31e008640 1 -- start start 2023-08-25T04:04:19.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd31e008640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd300005190 0x7fd3181ee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:19.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd31e008640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3180aef10 0x7fd3180af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:19.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd31e008640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3180c2050 0x7fd3180c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:19.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd31e008640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3181ee640 con 0x7fd300005190 2023-08-25T04:04:19.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd31e008640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180af8d0 con 0x7fd3180aef10 2023-08-25T04:04:19.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd31e008640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3181ef180 con 0x7fd3180c2050 2023-08-25T04:04:19.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd3177fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd300005190 0x7fd3181ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:19.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd3177fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd300005190 0x7fd3181ee100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43898/0 (socket says 172.21.15.55:43898) 2023-08-25T04:04:19.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd3177fe640 1 -- 172.21.15.55:0/3407557041 learned_addr learned my addr 172.21.15.55:0/3407557041 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:19.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd317fff640 1 --2- 172.21.15.55:0/3407557041 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3180c2050 0x7fd3180c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:19.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd316ffd640 1 --2- 172.21.15.55:0/3407557041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3180aef10 0x7fd3180af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:19.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd3177fe640 1 -- 172.21.15.55:0/3407557041 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3180c2050 msgr2=0x7fd3180c2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:19.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd3177fe640 1 --2- 172.21.15.55:0/3407557041 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3180c2050 0x7fd3180c2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd3177fe640 1 -- 172.21.15.55:0/3407557041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3180aef10 msgr2=0x7fd3180af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:19.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd3177fe640 1 --2- 172.21.15.55:0/3407557041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3180aef10 0x7fd3180af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd3177fe640 1 -- 172.21.15.55:0/3407557041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3181ee850 con 0x7fd300005190 2023-08-25T04:04:19.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd3177fe640 1 --2- 172.21.15.55:0/3407557041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd300005190 0x7fd3181ee100 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd308011990 tx=0x7fd308011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:19.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd2fffff640 1 -- 172.21.15.55:0/3407557041 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30800fa70 con 0x7fd300005190 2023-08-25T04:04:19.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd2fffff640 1 -- 172.21.15.55:0/3407557041 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30800fbd0 con 0x7fd300005190 2023-08-25T04:04:19.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd2fffff640 1 -- 172.21.15.55:0/3407557041 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd308014440 con 0x7fd300005190 2023-08-25T04:04:19.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd31e008640 1 -- 172.21.15.55:0/3407557041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3181eeb30 con 0x7fd300005190 2023-08-25T04:04:19.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.514+0000 7fd31e008640 1 -- 172.21.15.55:0/3407557041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3180c2a40 con 0x7fd300005190 2023-08-25T04:04:19.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.518+0000 7fd31e008640 1 -- 172.21.15.55:0/3407557041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3180b0c50 con 0x7fd300005190 2023-08-25T04:04:19.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.518+0000 7fd2fffff640 1 -- 172.21.15.55:0/3407557041 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 9) v1 ==== 85082+0+0 (secure 0 0 0) 0x7fd3080145a0 con 0x7fd300005190 2023-08-25T04:04:19.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.518+0000 7fd2fffff640 1 --2- 172.21.15.55:0/3407557041 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fd304065820 0x7fd304067ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:19.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.518+0000 7fd2fffff640 1 -- 172.21.15.55:0/3407557041 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fd308083820 con 0x7fd300005190 2023-08-25T04:04:19.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.518+0000 7fd316ffd640 1 --2- 172.21.15.55:0/3407557041 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fd304065820 0x7fd304067ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:19.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.518+0000 7fd316ffd640 1 --2- 172.21.15.55:0/3407557041 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fd304065820 0x7fd304067ce0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd30c000c10 tx=0x7fd30c009040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:19.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.522+0000 7fd2fffff640 1 -- 172.21.15.55:0/3407557041 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd308051100 con 0x7fd300005190 2023-08-25T04:04:19.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.698+0000 7fd31e008640 1 -- 172.21.15.55:0/3407557041 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3180cac80 con 0x7fd304065820 2023-08-25T04:04:19.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.762+0000 7fd2fffff640 1 -- 172.21.15.55:0/3407557041 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fd30c0014c0 con 0x7fd304065820 2023-08-25T04:04:19.766 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir5 2023-08-25T04:04:19.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.762+0000 7fd31e008640 1 -- 172.21.15.55:0/3407557041 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fd304065820 msgr2=0x7fd304067ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:19.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.762+0000 7fd31e008640 1 --2- 172.21.15.55:0/3407557041 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fd304065820 0x7fd304067ce0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd30c000c10 tx=0x7fd30c009040 comp rx=0 tx=0).stop 2023-08-25T04:04:19.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.762+0000 7fd31e008640 1 -- 172.21.15.55:0/3407557041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd300005190 msgr2=0x7fd3181ee100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:19.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.762+0000 7fd31e008640 1 --2- 172.21.15.55:0/3407557041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd300005190 0x7fd3181ee100 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd308011990 tx=0x7fd308011e50 comp rx=0 tx=0).stop 2023-08-25T04:04:19.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.762+0000 7fd31e008640 1 -- 172.21.15.55:0/3407557041 shutdown_connections 2023-08-25T04:04:19.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.762+0000 7fd31e008640 1 --2- 172.21.15.55:0/3407557041 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fd304065820 0x7fd304067ce0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.762+0000 7fd31e008640 1 --2- 172.21.15.55:0/3407557041 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3180c2050 0x7fd3180c2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.762+0000 7fd31e008640 1 --2- 172.21.15.55:0/3407557041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3180aef10 0x7fd3180af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.762+0000 7fd31e008640 1 --2- 172.21.15.55:0/3407557041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd300005190 0x7fd3181ee100 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.762+0000 7fd31e008640 1 -- 172.21.15.55:0/3407557041 >> 172.21.15.55:0/3407557041 conn(0x7fd3180caf90 msgr2=0x7fd3180c9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:19.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.762+0000 7fd31e008640 1 -- 172.21.15.55:0/3407557041 shutdown_connections 2023-08-25T04:04:19.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.762+0000 7fd31e008640 1 -- 172.21.15.55:0/3407557041 wait complete. 2023-08-25T04:04:19.786 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-08-25T04:04:19.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:19.787 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-08-25T04:04:19.799 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-08-25T04:04:19.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.990+0000 7f6f517a3640 1 Processor -- start 2023-08-25T04:04:19.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.990+0000 7f6f517a3640 1 -- start start 2023-08-25T04:04:19.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.990+0000 7f6f517a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f4c155740 0x7f6f4c15c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:19.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.990+0000 7f6f517a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f4c06fb50 0x7f6f4c0aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:19.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.990+0000 7f6f517a3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4c15fa50 con 0x7f6f4c155360 2023-08-25T04:04:19.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.990+0000 7f6f517a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f4c15f2a0 con 0x7f6f4c155740 2023-08-25T04:04:19.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.990+0000 7f6f517a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c15f490 con 0x7f6f4c06fb50 2023-08-25T04:04:19.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.990+0000 7f6f427fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f4c155740 0x7f6f4c15c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:19.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.990+0000 7f6f4affd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6f4c155360 0x7f6f4c15eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49416/0 (socket says 172.21.15.55:49416) 2023-08-25T04:04:19.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.990+0000 7f6f4affd640 1 -- 172.21.15.55:0/2142926032 learned_addr learned my addr 172.21.15.55:0/2142926032 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:19.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.990+0000 7f6f4b7fe640 1 --2- 172.21.15.55:0/2142926032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f4c06fb50 0x7f6f4c0aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:19.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.994+0000 7f6f427fc640 1 -- 172.21.15.55:0/2142926032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f4c06fb50 msgr2=0x7f6f4c0aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:19.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.994+0000 7f6f427fc640 1 --2- 172.21.15.55:0/2142926032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f4c06fb50 0x7f6f4c0aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:19.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.994+0000 7f6f427fc640 1 -- 172.21.15.55:0/2142926032 >> v1:172.21.15.55:6789/0 conn(0x7f6f4c155360 legacy=0x7f6f4c15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:20.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.994+0000 7f6f427fc640 1 -- 172.21.15.55:0/2142926032 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c15f770 con 0x7f6f4c155740 2023-08-25T04:04:20.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.994+0000 7f6f4b7fe640 1 --2- 172.21.15.55:0/2142926032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f4c06fb50 0x7f6f4c0aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:20.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.994+0000 7f6f427fc640 1 --2- 172.21.15.55:0/2142926032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c155740 0x7f6f4c15c180 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6f340097c0 tx=0x7f6f3401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a907b4004d58c292 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:20.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.994+0000 7f6f4a7fc640 1 -- 172.21.15.55:0/2142926032 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f340ab600 con 0x7f6f4c155740 2023-08-25T04:04:20.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.994+0000 7f6f4a7fc640 1 -- 172.21.15.55:0/2142926032 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f340a7050 con 0x7f6f4c155740 2023-08-25T04:04:20.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.994+0000 7f6f4a7fc640 1 -- 172.21.15.55:0/2142926032 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f340ab980 con 0x7f6f4c155740 2023-08-25T04:04:20.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.994+0000 7f6f517a3640 1 -- 172.21.15.55:0/2142926032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c155740 msgr2=0x7f6f4c15c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:20.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.994+0000 7f6f517a3640 1 --2- 172.21.15.55:0/2142926032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c155740 0x7f6f4c15c180 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6f340097c0 tx=0x7f6f3401c360 comp rx=0 tx=0).stop 2023-08-25T04:04:20.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.994+0000 7f6f517a3640 1 -- 172.21.15.55:0/2142926032 shutdown_connections 2023-08-25T04:04:20.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.994+0000 7f6f517a3640 1 --2- 172.21.15.55:0/2142926032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f4c06fb50 0x7f6f4c0aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.994+0000 7f6f517a3640 1 --2- 172.21.15.55:0/2142926032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c155740 0x7f6f4c15c180 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.994+0000 7f6f517a3640 1 -- 172.21.15.55:0/2142926032 >> 172.21.15.55:0/2142926032 conn(0x7f6f4c0caf90 msgr2=0x7f6f4c0cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:20.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.994+0000 7f6f517a3640 1 -- 172.21.15.55:0/2142926032 shutdown_connections 2023-08-25T04:04:20.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.994+0000 7f6f517a3640 1 -- 172.21.15.55:0/2142926032 wait complete. 2023-08-25T04:04:20.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f517a3640 1 Processor -- start 2023-08-25T04:04:20.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f517a3640 1 -- start start 2023-08-25T04:04:20.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f517a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f4c06fb50 0x7f6f4c0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:20.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f517a3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f4c155360 0x7f6f4c150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:20.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f517a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c155740 0x7f6f4c149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:20.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f517a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c0c5880 con 0x7f6f4c155740 2023-08-25T04:04:20.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f517a3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c1494c0 con 0x7f6f4c155360 2023-08-25T04:04:20.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f517a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c1515f0 con 0x7f6f4c06fb50 2023-08-25T04:04:20.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f4b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c155740 0x7f6f4c149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:20.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f4b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c155740 0x7f6f4c149650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43914/0 (socket says 172.21.15.55:43914) 2023-08-25T04:04:20.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f4b7fe640 1 -- 172.21.15.55:0/119729034 learned_addr learned my addr 172.21.15.55:0/119729034 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:20.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f4affd640 1 --2- 172.21.15.55:0/119729034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f4c06fb50 0x7f6f4c0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:20.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f427fc640 1 --2- 172.21.15.55:0/119729034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f4c155360 0x7f6f4c150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:20.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f4b7fe640 1 -- 172.21.15.55:0/119729034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f4c06fb50 msgr2=0x7f6f4c0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:20.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f4b7fe640 1 --2- 172.21.15.55:0/119729034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f4c06fb50 0x7f6f4c0c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f4b7fe640 1 -- 172.21.15.55:0/119729034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f4c155360 msgr2=0x7f6f4c150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:20.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f4b7fe640 1 --2- 172.21.15.55:0/119729034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f4c155360 0x7f6f4c150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f4b7fe640 1 -- 172.21.15.55:0/119729034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f34009420 con 0x7f6f4c155740 2023-08-25T04:04:20.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f4b7fe640 1 --2- 172.21.15.55:0/119729034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c155740 0x7f6f4c149650 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400d800 tx=0x7f6f4400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:20.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f43fff640 1 -- 172.21.15.55:0/119729034 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f440096a0 con 0x7f6f4c155740 2023-08-25T04:04:20.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f43fff640 1 -- 172.21.15.55:0/119729034 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f44009800 con 0x7f6f4c155740 2023-08-25T04:04:20.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f43fff640 1 -- 172.21.15.55:0/119729034 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f44009bb0 con 0x7f6f4c155740 2023-08-25T04:04:20.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:19.998+0000 7f6f517a3640 1 -- 172.21.15.55:0/119729034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f4c151890 con 0x7f6f4c155740 2023-08-25T04:04:20.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.002+0000 7f6f517a3640 1 -- 172.21.15.55:0/119729034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4c151100 con 0x7f6f4c155740 2023-08-25T04:04:20.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.002+0000 7f6f517a3640 1 -- 172.21.15.55:0/119729034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f4c0c55e0 con 0x7f6f4c155740 2023-08-25T04:04:20.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.002+0000 7f6f43fff640 1 -- 172.21.15.55:0/119729034 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 9) v1 ==== 85082+0+0 (secure 0 0 0) 0x7f6f44009d10 con 0x7f6f4c155740 2023-08-25T04:04:20.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.002+0000 7f6f43fff640 1 --2- 172.21.15.55:0/119729034 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6f2c0657f0 0x7f6f2c067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:20.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.002+0000 7f6f43fff640 1 -- 172.21.15.55:0/119729034 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f6f44083480 con 0x7f6f4c155740 2023-08-25T04:04:20.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.002+0000 7f6f4affd640 1 --2- 172.21.15.55:0/119729034 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6f2c0657f0 0x7f6f2c067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:20.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.002+0000 7f6f4affd640 1 --2- 172.21.15.55:0/119729034 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6f2c0657f0 0x7f6f2c067cb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c005c10 tx=0x7f6f3c009040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:20.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.006+0000 7f6f43fff640 1 -- 172.21.15.55:0/119729034 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6f4c0c55e0 con 0x7f6f4c155740 2023-08-25T04:04:20.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.182+0000 7f6f517a3640 1 -- 172.21.15.55:0/119729034 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f4c0b08e0 con 0x7f6f2c0657f0 2023-08-25T04:04:20.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.246+0000 7f6f43fff640 1 -- 172.21.15.55:0/119729034 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f6f3c001f90 con 0x7f6f2c0657f0 2023-08-25T04:04:20.248 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir6 2023-08-25T04:04:20.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.246+0000 7f6f517a3640 1 -- 172.21.15.55:0/119729034 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6f2c0657f0 msgr2=0x7f6f2c067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:20.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.246+0000 7f6f517a3640 1 --2- 172.21.15.55:0/119729034 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6f2c0657f0 0x7f6f2c067cb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c005c10 tx=0x7f6f3c009040 comp rx=0 tx=0).stop 2023-08-25T04:04:20.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.246+0000 7f6f517a3640 1 -- 172.21.15.55:0/119729034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c155740 msgr2=0x7f6f4c149650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:20.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.246+0000 7f6f517a3640 1 --2- 172.21.15.55:0/119729034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c155740 0x7f6f4c149650 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400d800 tx=0x7f6f4400dcc0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.246+0000 7f6f517a3640 1 -- 172.21.15.55:0/119729034 shutdown_connections 2023-08-25T04:04:20.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.246+0000 7f6f517a3640 1 --2- 172.21.15.55:0/119729034 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6f2c0657f0 0x7f6f2c067cb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.246+0000 7f6f517a3640 1 --2- 172.21.15.55:0/119729034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f4c155740 0x7f6f4c149650 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.246+0000 7f6f517a3640 1 --2- 172.21.15.55:0/119729034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f4c155360 0x7f6f4c150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.246+0000 7f6f517a3640 1 --2- 172.21.15.55:0/119729034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f4c06fb50 0x7f6f4c0c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.246+0000 7f6f517a3640 1 -- 172.21.15.55:0/119729034 >> 172.21.15.55:0/119729034 conn(0x7f6f4c0caf90 msgr2=0x7f6f4c0cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:20.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.246+0000 7f6f517a3640 1 -- 172.21.15.55:0/119729034 shutdown_connections 2023-08-25T04:04:20.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.246+0000 7f6f517a3640 1 -- 172.21.15.55:0/119729034 wait complete. 2023-08-25T04:04:20.271 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-08-25T04:04:20.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:20.272 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-08-25T04:04:20.296 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-08-25T04:04:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.490+0000 7f4e5369c640 1 Processor -- start 2023-08-25T04:04:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.494+0000 7f4e5369c640 1 -- start start 2023-08-25T04:04:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.494+0000 7f4e5369c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4e4c159d00 0x7f4e4c0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.494+0000 7f4e5369c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4e4c0cc930 0x7f4e4c0ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.494+0000 7f4e5369c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4c0c9270 con 0x7f4e4c06fb50 2023-08-25T04:04:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.494+0000 7f4e5369c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4c0cc510 con 0x7f4e4c159d00 2023-08-25T04:04:20.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.494+0000 7f4e5369c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4c0ce220 con 0x7f4e4c0cc930 2023-08-25T04:04:20.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.494+0000 7f4e51438640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4e4c159d00 0x7f4e4c0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:20.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.494+0000 7f4e50c37640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4e4c06fb50 0x7f4e4c0c8b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49422/0 (socket says 172.21.15.55:49422) 2023-08-25T04:04:20.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.494+0000 7f4e50c37640 1 -- 172.21.15.55:0/1293108041 learned_addr learned my addr 172.21.15.55:0/1293108041 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:20.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.494+0000 7f4e51c39640 1 --2- 172.21.15.55:0/1293108041 >> v2:172.21.15.110:3300/0 conn(0x7f4e4c0cc930 0x7f4e4c0ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:20.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.494+0000 7f4e51438640 1 -- 172.21.15.55:0/1293108041 >> v2:172.21.15.110:3300/0 conn(0x7f4e4c0cc930 msgr2=0x7f4e4c0ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:20.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.494+0000 7f4e51438640 1 --2- 172.21.15.55:0/1293108041 >> v2:172.21.15.110:3300/0 conn(0x7f4e4c0cc930 0x7f4e4c0ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.494+0000 7f4e51438640 1 -- 172.21.15.55:0/1293108041 >> v1:172.21.15.55:6789/0 conn(0x7f4e4c06fb50 legacy=0x7f4e4c0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:20.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.494+0000 7f4e51438640 1 -- 172.21.15.55:0/1293108041 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c0ca6c0 con 0x7f4e4c159d00 2023-08-25T04:04:20.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.494+0000 7f4e51c39640 1 --2- 172.21.15.55:0/1293108041 >> v2:172.21.15.110:3300/0 conn(0x7f4e4c0cc930 0x7f4e4c0ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:20.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.498+0000 7f4e51438640 1 --2- 172.21.15.55:0/1293108041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c159d00 0x7f4e4c0cdc40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0b3f40 tx=0x7f4e4801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd566e5b35782c7a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:20.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.498+0000 7f4e43fff640 1 -- 172.21.15.55:0/1293108041 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e480ac600 con 0x7f4e4c159d00 2023-08-25T04:04:20.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.498+0000 7f4e43fff640 1 -- 172.21.15.55:0/1293108041 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e480a8050 con 0x7f4e4c159d00 2023-08-25T04:04:20.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.498+0000 7f4e43fff640 1 -- 172.21.15.55:0/1293108041 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e480ac980 con 0x7f4e4c159d00 2023-08-25T04:04:20.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.498+0000 7f4e5369c640 1 -- 172.21.15.55:0/1293108041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c159d00 msgr2=0x7f4e4c0cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:20.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.498+0000 7f4e5369c640 1 --2- 172.21.15.55:0/1293108041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c159d00 0x7f4e4c0cdc40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0b3f40 tx=0x7f4e4801c3a0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.498+0000 7f4e5369c640 1 -- 172.21.15.55:0/1293108041 shutdown_connections 2023-08-25T04:04:20.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.498+0000 7f4e5369c640 1 --2- 172.21.15.55:0/1293108041 >> v2:172.21.15.110:3300/0 conn(0x7f4e4c0cc930 0x7f4e4c0ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.498+0000 7f4e5369c640 1 --2- 172.21.15.55:0/1293108041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c159d00 0x7f4e4c0cdc40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.498+0000 7f4e5369c640 1 -- 172.21.15.55:0/1293108041 >> 172.21.15.55:0/1293108041 conn(0x7f4e4c0caf90 msgr2=0x7f4e4c0cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:20.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.498+0000 7f4e5369c640 1 -- 172.21.15.55:0/1293108041 shutdown_connections 2023-08-25T04:04:20.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.498+0000 7f4e5369c640 1 -- 172.21.15.55:0/1293108041 wait complete. 2023-08-25T04:04:20.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.498+0000 7f4e5369c640 1 Processor -- start 2023-08-25T04:04:20.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.498+0000 7f4e5369c640 1 -- start start 2023-08-25T04:04:20.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e5369c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c06fb50 0x7f4e4c14fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:20.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e5369c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c0cc930 0x7f4e4c15a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:20.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e5369c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e4c159d00 0x7f4e4c069900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:20.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e5369c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c0c2780 con 0x7f4e4c06fb50 2023-08-25T04:04:20.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e5369c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c0c4eb0 con 0x7f4e4c0cc930 2023-08-25T04:04:20.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e5369c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c0c21c0 con 0x7f4e4c159d00 2023-08-25T04:04:20.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e51438640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c06fb50 0x7f4e4c14fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:20.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e51438640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c06fb50 0x7f4e4c14fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43934/0 (socket says 172.21.15.55:43934) 2023-08-25T04:04:20.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e51438640 1 -- 172.21.15.55:0/900142050 learned_addr learned my addr 172.21.15.55:0/900142050 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:20.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e50c37640 1 --2- 172.21.15.55:0/900142050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c0cc930 0x7f4e4c15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:20.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e51c39640 1 --2- 172.21.15.55:0/900142050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e4c159d00 0x7f4e4c069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:20.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e51438640 1 -- 172.21.15.55:0/900142050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e4c159d00 msgr2=0x7f4e4c069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:20.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e51438640 1 --2- 172.21.15.55:0/900142050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e4c159d00 0x7f4e4c069900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e51438640 1 -- 172.21.15.55:0/900142050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c0cc930 msgr2=0x7f4e4c15a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:20.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e51438640 1 --2- 172.21.15.55:0/900142050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c0cc930 0x7f4e4c15a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e51438640 1 -- 172.21.15.55:0/900142050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e48009420 con 0x7f4e4c06fb50 2023-08-25T04:04:20.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e51c39640 1 --2- 172.21.15.55:0/900142050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e4c159d00 0x7f4e4c069900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:04:20.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e51438640 1 --2- 172.21.15.55:0/900142050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c06fb50 0x7f4e4c14fc40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4e48018fb0 tx=0x7f4e4801abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:20.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e41ffb640 1 -- 172.21.15.55:0/900142050 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e480b7650 con 0x7f4e4c06fb50 2023-08-25T04:04:20.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e41ffb640 1 -- 172.21.15.55:0/900142050 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e480b77b0 con 0x7f4e4c06fb50 2023-08-25T04:04:20.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e5369c640 1 -- 172.21.15.55:0/900142050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4c0c24a0 con 0x7f4e4c06fb50 2023-08-25T04:04:20.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e41ffb640 1 -- 172.21.15.55:0/900142050 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e480b7b20 con 0x7f4e4c06fb50 2023-08-25T04:04:20.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e5369c640 1 -- 172.21.15.55:0/900142050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4c0c6b20 con 0x7f4e4c06fb50 2023-08-25T04:04:20.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.502+0000 7f4e5369c640 1 -- 172.21.15.55:0/900142050 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4c0c66a0 con 0x7f4e4c06fb50 2023-08-25T04:04:20.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.506+0000 7f4e41ffb640 1 -- 172.21.15.55:0/900142050 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85138+0+0 (secure 0 0 0) 0x7f4e480b3070 con 0x7f4e4c06fb50 2023-08-25T04:04:20.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.506+0000 7f4e41ffb640 1 --2- 172.21.15.55:0/900142050 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4e30065880 0x7f4e30067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:20.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.506+0000 7f4e41ffb640 1 -- 172.21.15.55:0/900142050 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f4e4811da50 con 0x7f4e4c06fb50 2023-08-25T04:04:20.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.506+0000 7f4e50c37640 1 --2- 172.21.15.55:0/900142050 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4e30065880 0x7f4e30067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:20.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.506+0000 7f4e50c37640 1 --2- 172.21.15.55:0/900142050 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4e30065880 0x7f4e30067d40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c1f8ca0 tx=0x7f4e3c009040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:20.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.510+0000 7f4e41ffb640 1 -- 172.21.15.55:0/900142050 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4e4c0c66a0 con 0x7f4e4c06fb50 2023-08-25T04:04:20.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.686+0000 7f4e5369c640 1 -- 172.21.15.55:0/900142050 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e4c0cd770 con 0x7f4e30065880 2023-08-25T04:04:20.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.750+0000 7f4e41ffb640 1 -- 172.21.15.55:0/900142050 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f4e3c001c80 con 0x7f4e30065880 2023-08-25T04:04:20.755 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir7 2023-08-25T04:04:20.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.754+0000 7f4e5369c640 1 -- 172.21.15.55:0/900142050 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4e30065880 msgr2=0x7f4e30067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:20.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.754+0000 7f4e5369c640 1 --2- 172.21.15.55:0/900142050 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4e30065880 0x7f4e30067d40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c1f8ca0 tx=0x7f4e3c009040 comp rx=0 tx=0).stop 2023-08-25T04:04:20.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.754+0000 7f4e5369c640 1 -- 172.21.15.55:0/900142050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c06fb50 msgr2=0x7f4e4c14fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:20.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.754+0000 7f4e5369c640 1 --2- 172.21.15.55:0/900142050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c06fb50 0x7f4e4c14fc40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4e48018fb0 tx=0x7f4e4801abe0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.754+0000 7f4e5369c640 1 -- 172.21.15.55:0/900142050 shutdown_connections 2023-08-25T04:04:20.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.754+0000 7f4e5369c640 1 --2- 172.21.15.55:0/900142050 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4e30065880 0x7f4e30067d40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.754+0000 7f4e5369c640 1 --2- 172.21.15.55:0/900142050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e4c159d00 0x7f4e4c069900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.754+0000 7f4e5369c640 1 --2- 172.21.15.55:0/900142050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c0cc930 0x7f4e4c15a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.754+0000 7f4e5369c640 1 --2- 172.21.15.55:0/900142050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c06fb50 0x7f4e4c14fc40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.754+0000 7f4e5369c640 1 -- 172.21.15.55:0/900142050 >> 172.21.15.55:0/900142050 conn(0x7f4e4c0caf90 msgr2=0x7f4e4c0cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:20.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.754+0000 7f4e5369c640 1 -- 172.21.15.55:0/900142050 shutdown_connections 2023-08-25T04:04:20.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.754+0000 7f4e5369c640 1 -- 172.21.15.55:0/900142050 wait complete. 2023-08-25T04:04:20.776 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-08-25T04:04:20.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:20.777 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-08-25T04:04:20.789 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-08-25T04:04:20.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.974+0000 7fe8c2d03640 1 Processor -- start 2023-08-25T04:04:20.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.974+0000 7fe8c2d03640 1 -- start start 2023-08-25T04:04:20.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.978+0000 7fe8c2d03640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe8bc0afa20 0x7fe8bc0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:20.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.978+0000 7fe8c2d03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8bc0cd870 0x7fe8bc0ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:20.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.978+0000 7fe8c2d03640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8bc0cae70 con 0x7fe8bc0cf9b0 2023-08-25T04:04:20.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.978+0000 7fe8c2d03640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8bc0cfe10 con 0x7fe8bc0afa20 2023-08-25T04:04:20.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.978+0000 7fe8c2d03640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc0cb0e0 con 0x7fe8bc0cd870 2023-08-25T04:04:20.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.978+0000 7fe8c0a9f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe8bc0afa20 0x7fe8bc0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:20.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.978+0000 7fe8bbfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe8bc0cf9b0 0x7fe8bc0cd160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45916/0 (socket says 172.21.15.55:45916) 2023-08-25T04:04:20.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.978+0000 7fe8bbfff640 1 -- 172.21.15.55:0/2145677153 learned_addr learned my addr 172.21.15.55:0/2145677153 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:20.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.978+0000 7fe8c12a0640 1 --2- 172.21.15.55:0/2145677153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8bc0cd870 0x7fe8bc0ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:20.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.978+0000 7fe8c0a9f640 1 -- 172.21.15.55:0/2145677153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8bc0cd870 msgr2=0x7fe8bc0ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:20.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.978+0000 7fe8c0a9f640 1 --2- 172.21.15.55:0/2145677153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8bc0cd870 0x7fe8bc0ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.978+0000 7fe8c0a9f640 1 -- 172.21.15.55:0/2145677153 >> v1:172.21.15.55:6789/0 conn(0x7fe8bc0cf9b0 legacy=0x7fe8bc0cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:20.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.978+0000 7fe8c0a9f640 1 -- 172.21.15.55:0/2145677153 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc0cb3c0 con 0x7fe8bc0afa20 2023-08-25T04:04:20.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.978+0000 7fe8c12a0640 1 --2- 172.21.15.55:0/2145677153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8bc0cd870 0x7fe8bc0ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:04:20.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.978+0000 7fe8bb7fe640 1 -- 172.21.15.55:0/2145677153 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289327313 0 0) 0x7fe8bc0cae70 con 0x7fe8bc0cf9b0 2023-08-25T04:04:20.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.982+0000 7fe8c0a9f640 1 --2- 172.21.15.55:0/2145677153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8bc0afa20 0x7fe8bc0b00e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00097c0 tx=0x7fe8b001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf12254184525c43 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:20.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.982+0000 7fe8bb7fe640 1 -- 172.21.15.55:0/2145677153 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b00ac620 con 0x7fe8bc0afa20 2023-08-25T04:04:20.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.982+0000 7fe8bb7fe640 1 -- 172.21.15.55:0/2145677153 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b00ac780 con 0x7fe8bc0afa20 2023-08-25T04:04:20.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.982+0000 7fe8bb7fe640 1 -- 172.21.15.55:0/2145677153 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b00acb10 con 0x7fe8bc0afa20 2023-08-25T04:04:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.982+0000 7fe8c2d03640 1 -- 172.21.15.55:0/2145677153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8bc0afa20 msgr2=0x7fe8bc0b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.982+0000 7fe8c2d03640 1 --2- 172.21.15.55:0/2145677153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8bc0afa20 0x7fe8bc0b00e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00097c0 tx=0x7fe8b001c3c0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.982+0000 7fe8c2d03640 1 -- 172.21.15.55:0/2145677153 shutdown_connections 2023-08-25T04:04:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.982+0000 7fe8c2d03640 1 --2- 172.21.15.55:0/2145677153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8bc0cd870 0x7fe8bc0ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.982+0000 7fe8c2d03640 1 --2- 172.21.15.55:0/2145677153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8bc0afa20 0x7fe8bc0b00e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.982+0000 7fe8c2d03640 1 -- 172.21.15.55:0/2145677153 >> 172.21.15.55:0/2145677153 conn(0x7fe8bc0d0780 msgr2=0x7fe8bc0d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.982+0000 7fe8c2d03640 1 -- 172.21.15.55:0/2145677153 shutdown_connections 2023-08-25T04:04:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.982+0000 7fe8c2d03640 1 -- 172.21.15.55:0/2145677153 wait complete. 2023-08-25T04:04:20.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.982+0000 7fe8c2d03640 1 Processor -- start 2023-08-25T04:04:20.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.982+0000 7fe8c2d03640 1 -- start start 2023-08-25T04:04:20.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c2d03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8bc0afa20 0x7fe8bc146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:20.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c2d03640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8bc0cd870 0x7fe8bc15e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:20.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c2d03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8bc0cf9b0 0x7fe8bc15ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:20.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c2d03640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc1471b0 con 0x7fe8bc0cf9b0 2023-08-25T04:04:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c2d03640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc15f1a0 con 0x7fe8bc0cd870 2023-08-25T04:04:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c2d03640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc15f3f0 con 0x7fe8bc0afa20 2023-08-25T04:04:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c12a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8bc0cf9b0 0x7fe8bc15ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c12a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8bc0cf9b0 0x7fe8bc15ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40650/0 (socket says 172.21.15.55:40650) 2023-08-25T04:04:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c12a0640 1 -- 172.21.15.55:0/2019949094 learned_addr learned my addr 172.21.15.55:0/2019949094 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c12a0640 1 -- 172.21.15.55:0/2019949094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8bc0afa20 msgr2=0x7fe8bc146c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8bbfff640 1 --2- 172.21.15.55:0/2019949094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8bc0cd870 0x7fe8bc15e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c0a9f640 1 --2- 172.21.15.55:0/2019949094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8bc0afa20 0x7fe8bc146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:20.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c12a0640 1 --2- 172.21.15.55:0/2019949094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8bc0afa20 0x7fe8bc146c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c12a0640 1 -- 172.21.15.55:0/2019949094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8bc0cd870 msgr2=0x7fe8bc15e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:20.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c12a0640 1 --2- 172.21.15.55:0/2019949094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8bc0cd870 0x7fe8bc15e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:20.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c12a0640 1 -- 172.21.15.55:0/2019949094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b0009420 con 0x7fe8bc0cf9b0 2023-08-25T04:04:20.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8bbfff640 1 --2- 172.21.15.55:0/2019949094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8bc0cd870 0x7fe8bc15e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:04:20.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c0a9f640 1 --2- 172.21.15.55:0/2019949094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8bc0afa20 0x7fe8bc146c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:04:20.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c12a0640 1 --2- 172.21.15.55:0/2019949094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8bc0cf9b0 0x7fe8bc15ec60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400cf20 tx=0x7fe8b400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:20.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8b97fa640 1 -- 172.21.15.55:0/2019949094 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b400d840 con 0x7fe8bc0cf9b0 2023-08-25T04:04:20.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8b97fa640 1 -- 172.21.15.55:0/2019949094 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b400d9a0 con 0x7fe8bc0cf9b0 2023-08-25T04:04:20.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c2d03640 1 -- 172.21.15.55:0/2019949094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8bc15f6d0 con 0x7fe8bc0cf9b0 2023-08-25T04:04:20.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8b97fa640 1 -- 172.21.15.55:0/2019949094 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b400dd50 con 0x7fe8bc0cf9b0 2023-08-25T04:04:20.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c2d03640 1 -- 172.21.15.55:0/2019949094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8bc15fc90 con 0x7fe8bc0cf9b0 2023-08-25T04:04:20.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8c2d03640 1 -- 172.21.15.55:0/2019949094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8bc04dbe0 con 0x7fe8bc0cf9b0 2023-08-25T04:04:20.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.986+0000 7fe8b97fa640 1 -- 172.21.15.55:0/2019949094 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85138+0+0 (secure 0 0 0) 0x7fe8b401d360 con 0x7fe8bc0cf9b0 2023-08-25T04:04:20.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.990+0000 7fe8b97fa640 1 --2- 172.21.15.55:0/2019949094 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fe8a0065880 0x7fe8a0067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:20.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.990+0000 7fe8b97fa640 1 -- 172.21.15.55:0/2019949094 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fe8b4083d20 con 0x7fe8bc0cf9b0 2023-08-25T04:04:20.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.990+0000 7fe8c0a9f640 1 --2- 172.21.15.55:0/2019949094 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fe8a0065880 0x7fe8a0067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:20.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.990+0000 7fe8c0a9f640 1 --2- 172.21.15.55:0/2019949094 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fe8a0065880 0x7fe8a0067d40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00ae000 tx=0x7fe8b0008040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:20.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:20.994+0000 7fe8b97fa640 1 -- 172.21.15.55:0/2019949094 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe8b4051460 con 0x7fe8bc0cf9b0 2023-08-25T04:04:21.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.170+0000 7fe8c2d03640 1 -- 172.21.15.55:0/2019949094 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8bc0cdeb0 con 0x7fe8a0065880 2023-08-25T04:04:21.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.238+0000 7fe8b97fa640 1 -- 172.21.15.55:0/2019949094 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe8b00bc0d0 con 0x7fe8a0065880 2023-08-25T04:04:21.241 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir8 2023-08-25T04:04:21.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.238+0000 7fe8c2d03640 1 -- 172.21.15.55:0/2019949094 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fe8a0065880 msgr2=0x7fe8a0067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:21.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.238+0000 7fe8c2d03640 1 --2- 172.21.15.55:0/2019949094 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fe8a0065880 0x7fe8a0067d40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00ae000 tx=0x7fe8b0008040 comp rx=0 tx=0).stop 2023-08-25T04:04:21.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.238+0000 7fe8c2d03640 1 -- 172.21.15.55:0/2019949094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8bc0cf9b0 msgr2=0x7fe8bc15ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:21.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.238+0000 7fe8c2d03640 1 --2- 172.21.15.55:0/2019949094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8bc0cf9b0 0x7fe8bc15ec60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400cf20 tx=0x7fe8b400a7d0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.238+0000 7fe8c2d03640 1 -- 172.21.15.55:0/2019949094 shutdown_connections 2023-08-25T04:04:21.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.238+0000 7fe8c2d03640 1 --2- 172.21.15.55:0/2019949094 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fe8a0065880 0x7fe8a0067d40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.238+0000 7fe8c2d03640 1 --2- 172.21.15.55:0/2019949094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8bc0cf9b0 0x7fe8bc15ec60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.238+0000 7fe8c2d03640 1 --2- 172.21.15.55:0/2019949094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8bc0cd870 0x7fe8bc15e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.238+0000 7fe8c2d03640 1 --2- 172.21.15.55:0/2019949094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8bc0afa20 0x7fe8bc146c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.238+0000 7fe8c2d03640 1 -- 172.21.15.55:0/2019949094 >> 172.21.15.55:0/2019949094 conn(0x7fe8bc0d0780 msgr2=0x7fe8bc06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:21.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.238+0000 7fe8c2d03640 1 -- 172.21.15.55:0/2019949094 shutdown_connections 2023-08-25T04:04:21.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.238+0000 7fe8c2d03640 1 -- 172.21.15.55:0/2019949094 wait complete. 2023-08-25T04:04:21.261 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-08-25T04:04:21.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:04:21.263 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-08-25T04:04:21.275 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-08-25T04:04:21.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.466+0000 7f6884288640 1 Processor -- start 2023-08-25T04:04:21.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.466+0000 7f6884288640 1 -- start start 2023-08-25T04:04:21.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.470+0000 7f6884288640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c155360 0x7f687c15c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:21.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.470+0000 7f6884288640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f687c155740 0x7f687c15eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:21.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.470+0000 7f6884288640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f687c06fb50 0x7f687c0aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:21.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.470+0000 7f6884288640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f687c15fa50 con 0x7f687c06fb50 2023-08-25T04:04:21.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.470+0000 7f6884288640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f687c15f490 con 0x7f687c155740 2023-08-25T04:04:21.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.470+0000 7f6884288640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687c15f770 con 0x7f687c155360 2023-08-25T04:04:21.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.470+0000 7f6882825640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f687c06fb50 0x7f687c0aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:21.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.470+0000 7f6882825640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f687c06fb50 0x7f687c0aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40652/0 (socket says 172.21.15.55:40652) 2023-08-25T04:04:21.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.470+0000 7f6882825640 1 -- 172.21.15.55:0/521636441 learned_addr learned my addr 172.21.15.55:0/521636441 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:21.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.470+0000 7f6882024640 1 --2- 172.21.15.55:0/521636441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c155360 0x7f687c15c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:21.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.470+0000 7f6881823640 1 --2- 172.21.15.55:0/521636441 >> v2:172.21.15.110:3300/0 conn(0x7f687c155740 0x7f687c15eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:21.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.470+0000 7f6882825640 1 -- 172.21.15.55:0/521636441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c155360 msgr2=0x7f687c15c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:21.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.470+0000 7f6882825640 1 --2- 172.21.15.55:0/521636441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c155360 0x7f687c15c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.470+0000 7f6882825640 1 -- 172.21.15.55:0/521636441 >> v2:172.21.15.110:3300/0 conn(0x7f687c155740 msgr2=0x7f687c15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:21.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.470+0000 7f6882825640 1 --2- 172.21.15.55:0/521636441 >> v2:172.21.15.110:3300/0 conn(0x7f687c155740 0x7f687c15eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.470+0000 7f6882825640 1 -- 172.21.15.55:0/521636441 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c0ccb40 con 0x7f687c06fb50 2023-08-25T04:04:21.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.474+0000 7f6882825640 1 --2- 172.21.15.55:0/521636441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f687c06fb50 0x7f687c0aff90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f687c06a910 tx=0x7f687401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2ca1a5c59f0b90 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:21.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.474+0000 7f6881022640 1 -- 172.21.15.55:0/521636441 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68740a5530 con 0x7f687c06fb50 2023-08-25T04:04:21.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.474+0000 7f6881022640 1 -- 172.21.15.55:0/521636441 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68740a5690 con 0x7f687c06fb50 2023-08-25T04:04:21.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.474+0000 7f6881022640 1 -- 172.21.15.55:0/521636441 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68740a5a20 con 0x7f687c06fb50 2023-08-25T04:04:21.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.474+0000 7f6884288640 1 -- 172.21.15.55:0/521636441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f687c06fb50 msgr2=0x7f687c0aff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:21.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.474+0000 7f6884288640 1 --2- 172.21.15.55:0/521636441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f687c06fb50 0x7f687c0aff90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f687c06a910 tx=0x7f687401c8b0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.474+0000 7f6884288640 1 -- 172.21.15.55:0/521636441 shutdown_connections 2023-08-25T04:04:21.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.474+0000 7f6884288640 1 --2- 172.21.15.55:0/521636441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f687c06fb50 0x7f687c0aff90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.474+0000 7f6884288640 1 --2- 172.21.15.55:0/521636441 >> v2:172.21.15.110:3300/0 conn(0x7f687c155740 0x7f687c15eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.474+0000 7f6884288640 1 --2- 172.21.15.55:0/521636441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c155360 0x7f687c15c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.474+0000 7f6884288640 1 -- 172.21.15.55:0/521636441 >> 172.21.15.55:0/521636441 conn(0x7f687c0caf90 msgr2=0x7f687c0cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:21.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.474+0000 7f6884288640 1 -- 172.21.15.55:0/521636441 shutdown_connections 2023-08-25T04:04:21.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.474+0000 7f6884288640 1 -- 172.21.15.55:0/521636441 wait complete. 2023-08-25T04:04:21.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.474+0000 7f6884288640 1 Processor -- start 2023-08-25T04:04:21.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.474+0000 7f6884288640 1 -- start start 2023-08-25T04:04:21.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6884288640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f687c06fb50 0x7f687c152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:21.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6884288640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f687c155360 0x7f687c14c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:21.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6884288640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c155740 0x7f687c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:21.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6884288640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c14cf30 con 0x7f687c06fb50 2023-08-25T04:04:21.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6884288640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c152d30 con 0x7f687c155360 2023-08-25T04:04:21.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6884288640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687c153010 con 0x7f687c155740 2023-08-25T04:04:21.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6882024640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f687c06fb50 0x7f687c152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:21.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6882024640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f687c06fb50 0x7f687c152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40662/0 (socket says 172.21.15.55:40662) 2023-08-25T04:04:21.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6882024640 1 -- 172.21.15.55:0/3306161735 learned_addr learned my addr 172.21.15.55:0/3306161735 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:21.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6882825640 1 --2- 172.21.15.55:0/3306161735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c155740 0x7f687c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:21.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6881823640 1 --2- 172.21.15.55:0/3306161735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f687c155360 0x7f687c14c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:21.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6882024640 1 -- 172.21.15.55:0/3306161735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c155740 msgr2=0x7f687c153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:21.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6882024640 1 --2- 172.21.15.55:0/3306161735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c155740 0x7f687c153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6882024640 1 -- 172.21.15.55:0/3306161735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f687c155360 msgr2=0x7f687c14c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:21.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6882024640 1 --2- 172.21.15.55:0/3306161735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f687c155360 0x7f687c14c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6882024640 1 -- 172.21.15.55:0/3306161735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6874009b30 con 0x7f687c06fb50 2023-08-25T04:04:21.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6882024640 1 --2- 172.21.15.55:0/3306161735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f687c06fb50 0x7f687c152630 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f687800e8b0 tx=0x7f687800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:21.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6872ffd640 1 -- 172.21.15.55:0/3306161735 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687800c940 con 0x7f687c06fb50 2023-08-25T04:04:21.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6872ffd640 1 -- 172.21.15.55:0/3306161735 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687800caa0 con 0x7f687c06fb50 2023-08-25T04:04:21.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6872ffd640 1 -- 172.21.15.55:0/3306161735 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687800ce30 con 0x7f687c06fb50 2023-08-25T04:04:21.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6884288640 1 -- 172.21.15.55:0/3306161735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687c1532f0 con 0x7f687c06fb50 2023-08-25T04:04:21.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6884288640 1 -- 172.21.15.55:0/3306161735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687c1538b0 con 0x7f687c06fb50 2023-08-25T04:04:21.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6884288640 1 -- 172.21.15.55:0/3306161735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f687c153a70 con 0x7f687c06fb50 2023-08-25T04:04:21.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.478+0000 7f6872ffd640 1 -- 172.21.15.55:0/3306161735 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85138+0+0 (secure 0 0 0) 0x7f6878013470 con 0x7f687c06fb50 2023-08-25T04:04:21.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.482+0000 7f6872ffd640 1 --2- 172.21.15.55:0/3306161735 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f68600658b0 0x7f6860067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:21.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.482+0000 7f6872ffd640 1 -- 172.21.15.55:0/3306161735 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f6878083420 con 0x7f687c06fb50 2023-08-25T04:04:21.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.482+0000 7f6881823640 1 --2- 172.21.15.55:0/3306161735 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f68600658b0 0x7f6860067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:21.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.482+0000 7f6881823640 1 --2- 172.21.15.55:0/3306161735 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f68600658b0 0x7f6860067d70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f687c14c3d0 tx=0x7f686c008040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:21.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.486+0000 7f6872ffd640 1 -- 172.21.15.55:0/3306161735 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6878050b60 con 0x7f687c06fb50 2023-08-25T04:04:21.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.658+0000 7f6884288640 1 -- 172.21.15.55:0/3306161735 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f687c0b08e0 con 0x7f68600658b0 2023-08-25T04:04:21.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.726+0000 7f6872ffd640 1 -- 172.21.15.55:0/3306161735 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f686c011950 con 0x7f68600658b0 2023-08-25T04:04:21.730 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/dir9 2023-08-25T04:04:21.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.730+0000 7f6884288640 1 -- 172.21.15.55:0/3306161735 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f68600658b0 msgr2=0x7f6860067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:21.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.730+0000 7f6884288640 1 --2- 172.21.15.55:0/3306161735 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f68600658b0 0x7f6860067d70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f687c14c3d0 tx=0x7f686c008040 comp rx=0 tx=0).stop 2023-08-25T04:04:21.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.730+0000 7f6884288640 1 -- 172.21.15.55:0/3306161735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f687c06fb50 msgr2=0x7f687c152630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:21.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.730+0000 7f6884288640 1 --2- 172.21.15.55:0/3306161735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f687c06fb50 0x7f687c152630 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f687800e8b0 tx=0x7f687800ed70 comp rx=0 tx=0).stop 2023-08-25T04:04:21.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.730+0000 7f6884288640 1 -- 172.21.15.55:0/3306161735 shutdown_connections 2023-08-25T04:04:21.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.730+0000 7f6884288640 1 --2- 172.21.15.55:0/3306161735 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f68600658b0 0x7f6860067d70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.730+0000 7f6884288640 1 --2- 172.21.15.55:0/3306161735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f687c155740 0x7f687c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.730+0000 7f6884288640 1 --2- 172.21.15.55:0/3306161735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f687c155360 0x7f687c14c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.730+0000 7f6884288640 1 --2- 172.21.15.55:0/3306161735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f687c06fb50 0x7f687c152630 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.730+0000 7f6884288640 1 -- 172.21.15.55:0/3306161735 >> 172.21.15.55:0/3306161735 conn(0x7f687c0caf90 msgr2=0x7f687c0cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:21.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.730+0000 7f6884288640 1 -- 172.21.15.55:0/3306161735 shutdown_connections 2023-08-25T04:04:21.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.730+0000 7f6884288640 1 -- 172.21.15.55:0/3306161735 wait complete. 2023-08-25T04:04:21.750 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-08-25T04:04:21.751 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-08-25T04:04:21.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd18d32d640 1 Processor -- start 2023-08-25T04:04:21.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd18d32d640 1 -- start start 2023-08-25T04:04:21.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd18d32d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd188160120 0x7fd1880b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:21.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd18d32d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1880b33c0 0x7fd1880b4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:21.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd18d32d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1880b1f20 con 0x7fd1880b4080 2023-08-25T04:04:21.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd18d32d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1880b4a50 con 0x7fd188160120 2023-08-25T04:04:21.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd18d32d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880cddf0 con 0x7fd1880b33c0 2023-08-25T04:04:21.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd1877fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd1880b4080 0x7fd1880d0500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45918/0 (socket says 172.21.15.55:45918) 2023-08-25T04:04:21.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd1877fe640 1 -- 172.21.15.55:0/164974409 learned_addr learned my addr 172.21.15.55:0/164974409 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:21.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd186ffd640 1 -- 172.21.15.55:0/164974409 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948021341 0 0) 0x7fd1880b1f20 con 0x7fd1880b4080 2023-08-25T04:04:21.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd18cb2c640 1 --2- 172.21.15.55:0/164974409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1880b33c0 0x7fd1880b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:21.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd187fff640 1 --2- 172.21.15.55:0/164974409 >> v2:172.21.15.110:3300/0 conn(0x7fd188160120 0x7fd1880b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:21.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd186ffd640 1 -- 172.21.15.55:0/164974409 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd170003530 con 0x7fd1880b4080 2023-08-25T04:04:21.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd186ffd640 1 -- 172.21.15.55:0/164974409 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2875350684 0 0) 0x7fd170003530 con 0x7fd1880b4080 2023-08-25T04:04:21.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd186ffd640 1 -- 172.21.15.55:0/164974409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1880b33c0 msgr2=0x7fd1880b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:21.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd186ffd640 1 --2- 172.21.15.55:0/164974409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1880b33c0 0x7fd1880b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd186ffd640 1 -- 172.21.15.55:0/164974409 >> v2:172.21.15.110:3300/0 conn(0x7fd188160120 msgr2=0x7fd1880b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:21.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd186ffd640 1 --2- 172.21.15.55:0/164974409 >> v2:172.21.15.110:3300/0 conn(0x7fd188160120 0x7fd1880b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd186ffd640 1 -- 172.21.15.55:0/164974409 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1880ce0d0 con 0x7fd1880b4080 2023-08-25T04:04:21.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd186ffd640 1 -- 172.21.15.55:0/164974409 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fd17c001680 con 0x7fd1880b4080 2023-08-25T04:04:21.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd186ffd640 1 -- 172.21.15.55:0/164974409 >> v1:172.21.15.55:6789/0 conn(0x7fd1880b4080 legacy=0x7fd1880d0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:21.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd186ffd640 1 --2- 172.21.15.55:0/164974409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd170003980 0x7fd170003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:21.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd186ffd640 1 --2- 172.21.15.55:0/164974409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1880b33c0 0x7fd1700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:21.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd186ffd640 1 --2- 172.21.15.55:0/164974409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd170004d10 0x7fd170005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:21.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd186ffd640 1 -- 172.21.15.55:0/164974409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880b4a50 con 0x7fd170004d10 2023-08-25T04:04:21.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd186ffd640 1 -- 172.21.15.55:0/164974409 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880cddf0 con 0x7fd170003980 2023-08-25T04:04:21.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd186ffd640 1 -- 172.21.15.55:0/164974409 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd17000b990 con 0x7fd1880b33c0 2023-08-25T04:04:21.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd18cb2c640 1 --2- 172.21.15.55:0/164974409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd170004d10 0x7fd170005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd1877fe640 1 --2- 172.21.15.55:0/164974409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1880b33c0 0x7fd1700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd187fff640 1 --2- 172.21.15.55:0/164974409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd170003980 0x7fd170003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd18cb2c640 1 -- 172.21.15.55:0/164974409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1880b33c0 msgr2=0x7fd1700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd18cb2c640 1 --2- 172.21.15.55:0/164974409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1880b33c0 0x7fd1700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd18cb2c640 1 -- 172.21.15.55:0/164974409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd170003980 msgr2=0x7fd170003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd18cb2c640 1 --2- 172.21.15.55:0/164974409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd170003980 0x7fd170003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.898+0000 7fd18cb2c640 1 -- 172.21.15.55:0/164974409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd170003530 con 0x7fd170004d10 2023-08-25T04:04:21.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.902+0000 7fd18cb2c640 1 --2- 172.21.15.55:0/164974409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd170004d10 0x7fd170005190 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd180009f70 tx=0x7fd18001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd726dd65155535 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:21.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.902+0000 7fd186ffd640 1 -- 172.21.15.55:0/164974409 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1800a5cd0 con 0x7fd170004d10 2023-08-25T04:04:21.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.902+0000 7fd186ffd640 1 -- 172.21.15.55:0/164974409 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18000f040 con 0x7fd170004d10 2023-08-25T04:04:21.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.902+0000 7fd186ffd640 1 -- 172.21.15.55:0/164974409 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1800ad660 con 0x7fd170004d10 2023-08-25T04:04:21.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.902+0000 7fd18d32d640 1 -- 172.21.15.55:0/164974409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd170004d10 msgr2=0x7fd170005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:21.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.902+0000 7fd18d32d640 1 --2- 172.21.15.55:0/164974409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd170004d10 0x7fd170005190 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd180009f70 tx=0x7fd18001cba0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.902+0000 7fd18cb2c640 1 -- 172.21.15.55:0/164974409 reap_dead start 2023-08-25T04:04:21.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.902+0000 7fd18d32d640 1 -- 172.21.15.55:0/164974409 shutdown_connections 2023-08-25T04:04:21.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.902+0000 7fd18d32d640 1 -- 172.21.15.55:0/164974409 >> 172.21.15.55:0/164974409 conn(0x7fd18809b950 msgr2=0x7fd1880d2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:21.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.902+0000 7fd18d32d640 1 -- 172.21.15.55:0/164974409 shutdown_connections 2023-08-25T04:04:21.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.902+0000 7fd18d32d640 1 -- 172.21.15.55:0/164974409 wait complete. 2023-08-25T04:04:21.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd18d32d640 1 Processor -- start 2023-08-25T04:04:21.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd18d32d640 1 -- start start 2023-08-25T04:04:21.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd18d32d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd170004d10 0x7fd1880b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:21.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd18d32d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd18815b040 0x7fd1880cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:21.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd18d32d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd18815b550 0x7fd18815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:21.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd18d32d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880cc110 con 0x7fd18815b550 2023-08-25T04:04:21.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd18d32d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18815bf10 con 0x7fd170004d10 2023-08-25T04:04:21.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd18d32d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880b58b0 con 0x7fd18815b040 2023-08-25T04:04:21.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd18cb2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd18815b550 0x7fd18815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:21.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd18cb2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd18815b550 0x7fd18815b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40682/0 (socket says 172.21.15.55:40682) 2023-08-25T04:04:21.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd18cb2c640 1 -- 172.21.15.55:0/712385121 learned_addr learned my addr 172.21.15.55:0/712385121 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:21.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd187fff640 1 --2- 172.21.15.55:0/712385121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd170004d10 0x7fd1880b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:21.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd1877fe640 1 --2- 172.21.15.55:0/712385121 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd18815b040 0x7fd1880cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:21.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd18cb2c640 1 -- 172.21.15.55:0/712385121 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd18815b040 msgr2=0x7fd1880cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:21.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd18cb2c640 1 --2- 172.21.15.55:0/712385121 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd18815b040 0x7fd1880cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd18cb2c640 1 -- 172.21.15.55:0/712385121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd170004d10 msgr2=0x7fd1880b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:21.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd18cb2c640 1 --2- 172.21.15.55:0/712385121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd170004d10 0x7fd1880b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:21.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd18cb2c640 1 -- 172.21.15.55:0/712385121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1880b5b90 con 0x7fd18815b550 2023-08-25T04:04:21.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.906+0000 7fd18cb2c640 1 --2- 172.21.15.55:0/712385121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd18815b550 0x7fd18815b9d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd180002240 tx=0x7fd180009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:21.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.910+0000 7fd184ff9640 1 -- 172.21.15.55:0/712385121 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd180009490 con 0x7fd18815b550 2023-08-25T04:04:21.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.910+0000 7fd184ff9640 1 -- 172.21.15.55:0/712385121 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1800ad880 con 0x7fd18815b550 2023-08-25T04:04:21.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.910+0000 7fd184ff9640 1 -- 172.21.15.55:0/712385121 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1800adc30 con 0x7fd18815b550 2023-08-25T04:04:21.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.910+0000 7fd18d32d640 1 -- 172.21.15.55:0/712385121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1880b5e70 con 0x7fd18815b550 2023-08-25T04:04:21.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.910+0000 7fd18d32d640 1 -- 172.21.15.55:0/712385121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18815cf50 con 0x7fd18815b550 2023-08-25T04:04:21.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.910+0000 7fd18d32d640 1 -- 172.21.15.55:0/712385121 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd188073e50 con 0x7fd18815b550 2023-08-25T04:04:21.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.910+0000 7fd184ff9640 1 -- 172.21.15.55:0/712385121 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85138+0+0 (secure 0 0 0) 0x7fd1800b4040 con 0x7fd18815b550 2023-08-25T04:04:21.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.910+0000 7fd184ff9640 1 --2- 172.21.15.55:0/712385121 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fd174065880 0x7fd174067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:21.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.910+0000 7fd184ff9640 1 -- 172.21.15.55:0/712385121 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fd18011dcc0 con 0x7fd18815b550 2023-08-25T04:04:21.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.910+0000 7fd187fff640 1 --2- 172.21.15.55:0/712385121 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fd174065880 0x7fd174067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:21.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.914+0000 7fd187fff640 1 --2- 172.21.15.55:0/712385121 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fd174065880 0x7fd174067d40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd178009c40 tx=0x7fd178006f90 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:21.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:21.914+0000 7fd184ff9640 1 -- 172.21.15.55:0/712385121 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd180124080 con 0x7fd18815b550 2023-08-25T04:04:22.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.090+0000 7fd18d32d640 1 -- 172.21.15.55:0/712385121 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1880ce690 con 0x7fd174065880 2023-08-25T04:04:22.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.138+0000 7fd184ff9640 1 -- 172.21.15.55:0/712385121 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd178009890 con 0x7fd174065880 2023-08-25T04:04:22.142 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-08-25T04:04:22.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.142+0000 7fd18d32d640 1 -- 172.21.15.55:0/712385121 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fd174065880 msgr2=0x7fd174067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:22.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.142+0000 7fd18d32d640 1 --2- 172.21.15.55:0/712385121 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fd174065880 0x7fd174067d40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd178009c40 tx=0x7fd178006f90 comp rx=0 tx=0).stop 2023-08-25T04:04:22.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.142+0000 7fd18d32d640 1 -- 172.21.15.55:0/712385121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd18815b550 msgr2=0x7fd18815b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:22.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.142+0000 7fd18d32d640 1 --2- 172.21.15.55:0/712385121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd18815b550 0x7fd18815b9d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd180002240 tx=0x7fd180009750 comp rx=0 tx=0).stop 2023-08-25T04:04:22.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.142+0000 7fd18d32d640 1 -- 172.21.15.55:0/712385121 shutdown_connections 2023-08-25T04:04:22.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.142+0000 7fd18d32d640 1 --2- 172.21.15.55:0/712385121 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fd174065880 0x7fd174067d40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.142+0000 7fd18d32d640 1 --2- 172.21.15.55:0/712385121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd18815b550 0x7fd18815b9d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.142+0000 7fd18d32d640 1 --2- 172.21.15.55:0/712385121 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd18815b040 0x7fd1880cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.142+0000 7fd18d32d640 1 --2- 172.21.15.55:0/712385121 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd170004d10 0x7fd1880b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.142+0000 7fd18d32d640 1 -- 172.21.15.55:0/712385121 >> 172.21.15.55:0/712385121 conn(0x7fd18809b950 msgr2=0x7fd1880cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:22.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.142+0000 7fd18d32d640 1 -- 172.21.15.55:0/712385121 shutdown_connections 2023-08-25T04:04:22.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.142+0000 7fd18d32d640 1 -- 172.21.15.55:0/712385121 wait complete. 2023-08-25T04:04:22.163 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-08-25T04:04:22.163 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-08-25T04:04:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cfbe34640 1 Processor -- start 2023-08-25T04:04:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cfbe34640 1 -- start start 2023-08-25T04:04:22.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cfbe34640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9cf4165090 0x7f9cf41615d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:22.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cfbe34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cf40aff90 0x7f9cf40b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:22.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cfbe34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf40c9440 con 0x7f9cf41611f0 2023-08-25T04:04:22.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cfbe34640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf40ca0c0 con 0x7f9cf4165090 2023-08-25T04:04:22.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cfbe34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf40b0940 con 0x7f9cf40aff90 2023-08-25T04:04:22.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf9bd0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9cf41611f0 0x7f9cf40c8b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45930/0 (socket says 172.21.15.55:45930) 2023-08-25T04:04:22.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf9bd0640 1 -- 172.21.15.55:0/848557293 learned_addr learned my addr 172.21.15.55:0/848557293 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:22.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf93cf640 1 --2- 172.21.15.55:0/848557293 >> v2:172.21.15.110:3300/0 conn(0x7f9cf4165090 0x7f9cf41615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:22.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cfa3d1640 1 --2- 172.21.15.55:0/848557293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cf40aff90 0x7f9cf40b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:22.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf8bce640 1 -- 172.21.15.55:0/848557293 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743157354 0 0) 0x7f9cf40c9440 con 0x7f9cf41611f0 2023-08-25T04:04:22.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf8bce640 1 -- 172.21.15.55:0/848557293 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ce0003530 con 0x7f9cf41611f0 2023-08-25T04:04:22.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf8bce640 1 -- 172.21.15.55:0/848557293 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2856890155 0 0) 0x7f9ce0003530 con 0x7f9cf41611f0 2023-08-25T04:04:22.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf8bce640 1 -- 172.21.15.55:0/848557293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cf40aff90 msgr2=0x7f9cf40b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:22.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf8bce640 1 --2- 172.21.15.55:0/848557293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cf40aff90 0x7f9cf40b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf8bce640 1 -- 172.21.15.55:0/848557293 >> v2:172.21.15.110:3300/0 conn(0x7f9cf4165090 msgr2=0x7f9cf41615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:22.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf8bce640 1 --2- 172.21.15.55:0/848557293 >> v2:172.21.15.110:3300/0 conn(0x7f9cf4165090 0x7f9cf41615d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf8bce640 1 -- 172.21.15.55:0/848557293 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf40c9720 con 0x7f9cf41611f0 2023-08-25T04:04:22.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf8bce640 1 -- 172.21.15.55:0/848557293 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f9cf0001680 con 0x7f9cf41611f0 2023-08-25T04:04:22.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cfa3d1640 1 --2- 172.21.15.55:0/848557293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cf40aff90 0x7f9cf40b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:04:22.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf8bce640 1 -- 172.21.15.55:0/848557293 >> v1:172.21.15.55:6789/0 conn(0x7f9cf41611f0 legacy=0x7f9cf40c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:22.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf8bce640 1 --2- 172.21.15.55:0/848557293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ce00039b0 0x7f9ce0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:22.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf8bce640 1 --2- 172.21.15.55:0/848557293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ce00047d0 0x7f9ce0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:22.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf8bce640 1 --2- 172.21.15.55:0/848557293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cf40aff90 0x7f9ce0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:22.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf8bce640 1 -- 172.21.15.55:0/848557293 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf40ca0c0 con 0x7f9ce00039b0 2023-08-25T04:04:22.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf8bce640 1 -- 172.21.15.55:0/848557293 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf40b0940 con 0x7f9ce00047d0 2023-08-25T04:04:22.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf8bce640 1 -- 172.21.15.55:0/848557293 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce000b990 con 0x7f9cf40aff90 2023-08-25T04:04:22.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf9bd0640 1 --2- 172.21.15.55:0/848557293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ce00039b0 0x7f9ce0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:22.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cfa3d1640 1 --2- 172.21.15.55:0/848557293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cf40aff90 0x7f9ce0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:22.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.310+0000 7f9cf93cf640 1 --2- 172.21.15.55:0/848557293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ce00047d0 0x7f9ce0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:22.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.314+0000 7f9cf9bd0640 1 -- 172.21.15.55:0/848557293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cf40aff90 msgr2=0x7f9ce0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:22.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.314+0000 7f9cf9bd0640 1 --2- 172.21.15.55:0/848557293 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cf40aff90 0x7f9ce0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.314+0000 7f9cf9bd0640 1 -- 172.21.15.55:0/848557293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ce00047d0 msgr2=0x7f9ce0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:22.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.314+0000 7f9cf9bd0640 1 --2- 172.21.15.55:0/848557293 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ce00047d0 0x7f9ce0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.314+0000 7f9cf9bd0640 1 -- 172.21.15.55:0/848557293 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec009a70 con 0x7f9ce00039b0 2023-08-25T04:04:22.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.314+0000 7f9cf9bd0640 1 --2- 172.21.15.55:0/848557293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ce00039b0 0x7f9ce0003dd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000c240 tx=0x7f9cf001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6228c68b3d64321c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:22.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.314+0000 7f9cf8bce640 1 -- 172.21.15.55:0/848557293 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0005ae0 con 0x7f9ce00039b0 2023-08-25T04:04:22.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.314+0000 7f9cf8bce640 1 -- 172.21.15.55:0/848557293 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf0005c40 con 0x7f9ce00039b0 2023-08-25T04:04:22.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.314+0000 7f9cf8bce640 1 -- 172.21.15.55:0/848557293 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0007070 con 0x7f9ce00039b0 2023-08-25T04:04:22.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.314+0000 7f9cfbe34640 1 -- 172.21.15.55:0/848557293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ce00039b0 msgr2=0x7f9ce0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:22.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.314+0000 7f9cfbe34640 1 --2- 172.21.15.55:0/848557293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ce00039b0 0x7f9ce0003dd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000c240 tx=0x7f9cf001cc40 comp rx=0 tx=0).stop 2023-08-25T04:04:22.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.314+0000 7f9cfa3d1640 1 -- 172.21.15.55:0/848557293 reap_dead start 2023-08-25T04:04:22.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.314+0000 7f9cfbe34640 1 -- 172.21.15.55:0/848557293 shutdown_connections 2023-08-25T04:04:22.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.314+0000 7f9cfbe34640 1 -- 172.21.15.55:0/848557293 >> 172.21.15.55:0/848557293 conn(0x7f9cf40caf90 msgr2=0x7f9cf40cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:22.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.314+0000 7f9cfbe34640 1 -- 172.21.15.55:0/848557293 shutdown_connections 2023-08-25T04:04:22.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cfbe34640 1 -- 172.21.15.55:0/848557293 wait complete. 2023-08-25T04:04:22.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cfbe34640 1 Processor -- start 2023-08-25T04:04:22.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cfbe34640 1 -- start start 2023-08-25T04:04:22.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cfbe34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ce00039b0 0x7f9cf4169790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:22.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cfbe34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cf4165ec0 0x7f9cf40b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:22.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cfbe34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cf415fc70 0x7f9cf41600f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:22.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cfbe34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf4162b80 con 0x7f9cf4165ec0 2023-08-25T04:04:22.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cfbe34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf40b12d0 con 0x7f9ce00039b0 2023-08-25T04:04:22.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cfbe34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf4160630 con 0x7f9cf415fc70 2023-08-25T04:04:22.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cf93cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cf4165ec0 0x7f9cf40b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:22.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cf93cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cf4165ec0 0x7f9cf40b3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40694/0 (socket says 172.21.15.55:40694) 2023-08-25T04:04:22.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cf93cf640 1 -- 172.21.15.55:0/477078520 learned_addr learned my addr 172.21.15.55:0/477078520 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:22.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cf9bd0640 1 --2- 172.21.15.55:0/477078520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ce00039b0 0x7f9cf4169790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:22.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cfa3d1640 1 --2- 172.21.15.55:0/477078520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cf415fc70 0x7f9cf41600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:22.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cf93cf640 1 -- 172.21.15.55:0/477078520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cf415fc70 msgr2=0x7f9cf41600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:22.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cf93cf640 1 --2- 172.21.15.55:0/477078520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cf415fc70 0x7f9cf41600f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cf93cf640 1 -- 172.21.15.55:0/477078520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ce00039b0 msgr2=0x7f9cf4169790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:22.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cf93cf640 1 --2- 172.21.15.55:0/477078520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ce00039b0 0x7f9cf4169790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cf93cf640 1 -- 172.21.15.55:0/477078520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf40b07b0 con 0x7f9cf4165ec0 2023-08-25T04:04:22.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cf93cf640 1 --2- 172.21.15.55:0/477078520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cf4165ec0 0x7f9cf40b3450 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40119d0 tx=0x7f9ce4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:22.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cea7fc640 1 -- 172.21.15.55:0/477078520 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce400fb50 con 0x7f9cf4165ec0 2023-08-25T04:04:22.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cea7fc640 1 -- 172.21.15.55:0/477078520 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce400fcb0 con 0x7f9cf4165ec0 2023-08-25T04:04:22.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cfbe34640 1 -- 172.21.15.55:0/477078520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf40b1570 con 0x7f9cf4165ec0 2023-08-25T04:04:22.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.318+0000 7f9cea7fc640 1 -- 172.21.15.55:0/477078520 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4014440 con 0x7f9cf4165ec0 2023-08-25T04:04:22.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.322+0000 7f9cfbe34640 1 -- 172.21.15.55:0/477078520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf40b1b30 con 0x7f9cf4165ec0 2023-08-25T04:04:22.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.322+0000 7f9cfbe34640 1 -- 172.21.15.55:0/477078520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf404dbe0 con 0x7f9cf4165ec0 2023-08-25T04:04:22.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.322+0000 7f9cea7fc640 1 -- 172.21.15.55:0/477078520 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85138+0+0 (secure 0 0 0) 0x7f9ce40145a0 con 0x7f9cf4165ec0 2023-08-25T04:04:22.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.322+0000 7f9cea7fc640 1 --2- 172.21.15.55:0/477078520 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f9cd80658b0 0x7f9cd8067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:22.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.322+0000 7f9cea7fc640 1 -- 172.21.15.55:0/477078520 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f9ce4083a50 con 0x7f9cf4165ec0 2023-08-25T04:04:22.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.322+0000 7f9cf9bd0640 1 --2- 172.21.15.55:0/477078520 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f9cd80658b0 0x7f9cd8067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:22.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.326+0000 7f9cf9bd0640 1 --2- 172.21.15.55:0/477078520 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f9cd80658b0 0x7f9cd8067d70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00ab000 tx=0x7f9cf00a7070 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:22.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.326+0000 7f9cea7fc640 1 -- 172.21.15.55:0/477078520 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9ce4051260 con 0x7f9cf4165ec0 2023-08-25T04:04:22.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.506+0000 7f9cfbe34640 1 -- 172.21.15.55:0/477078520 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cf40cc700 con 0x7f9cd80658b0 2023-08-25T04:04:22.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.558+0000 7f9cea7fc640 1 -- 172.21.15.55:0/477078520 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f9cf40cc700 con 0x7f9cd80658b0 2023-08-25T04:04:22.561 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-08-25T04:04:22.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.558+0000 7f9cfbe34640 1 -- 172.21.15.55:0/477078520 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f9cd80658b0 msgr2=0x7f9cd8067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.558+0000 7f9cfbe34640 1 --2- 172.21.15.55:0/477078520 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f9cd80658b0 0x7f9cd8067d70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00ab000 tx=0x7f9cf00a7070 comp rx=0 tx=0).stop 2023-08-25T04:04:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.558+0000 7f9cfbe34640 1 -- 172.21.15.55:0/477078520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cf4165ec0 msgr2=0x7f9cf40b3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.558+0000 7f9cfbe34640 1 --2- 172.21.15.55:0/477078520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cf4165ec0 0x7f9cf40b3450 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40119d0 tx=0x7f9ce4011e90 comp rx=0 tx=0).stop 2023-08-25T04:04:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.558+0000 7f9cfbe34640 1 -- 172.21.15.55:0/477078520 shutdown_connections 2023-08-25T04:04:22.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.558+0000 7f9cfbe34640 1 --2- 172.21.15.55:0/477078520 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f9cd80658b0 0x7f9cd8067d70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.558+0000 7f9cfbe34640 1 --2- 172.21.15.55:0/477078520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cf415fc70 0x7f9cf41600f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.558+0000 7f9cfbe34640 1 --2- 172.21.15.55:0/477078520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9cf4165ec0 0x7f9cf40b3450 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.558+0000 7f9cfbe34640 1 --2- 172.21.15.55:0/477078520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ce00039b0 0x7f9cf4169790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.558+0000 7f9cfbe34640 1 -- 172.21.15.55:0/477078520 >> 172.21.15.55:0/477078520 conn(0x7f9cf40caf90 msgr2=0x7f9cf40c2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:22.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.558+0000 7f9cfbe34640 1 -- 172.21.15.55:0/477078520 shutdown_connections 2023-08-25T04:04:22.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.558+0000 7f9cfbe34640 1 -- 172.21.15.55:0/477078520 wait complete. 2023-08-25T04:04:22.581 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-08-25T04:04:22.581 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-08-25T04:04:22.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.734+0000 7f48915ac640 1 Processor -- start 2023-08-25T04:04:22.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.734+0000 7f48915ac640 1 -- start start 2023-08-25T04:04:22.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.734+0000 7f48915ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f488c0cf340 0x7f488c0cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:22.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.734+0000 7f48915ac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f488c0d1970 con 0x7f488c0b59f0 2023-08-25T04:04:22.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.734+0000 7f48915ac640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f488c0cfcf0 con 0x7f488c15cb40 2023-08-25T04:04:22.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.734+0000 7f48915ac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f488c0d2790 con 0x7f488c0cf340 2023-08-25T04:04:22.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.734+0000 7f488a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f488c0cf340 0x7f488c0cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:22.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.734+0000 7f488b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f488c0b59f0 0x7f488c0b5e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45942/0 (socket says 172.21.15.55:45942) 2023-08-25T04:04:22.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.734+0000 7f488b7fe640 1 -- 172.21.15.55:0/4194746647 learned_addr learned my addr 172.21.15.55:0/4194746647 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:22.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.734+0000 7f488a7fc640 1 -- 172.21.15.55:0/4194746647 >> v1:172.21.15.110:6789/0 conn(0x7f488c15cb40 legacy=0x7f488c0d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:22.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.734+0000 7f488a7fc640 1 -- 172.21.15.55:0/4194746647 >> v1:172.21.15.55:6789/0 conn(0x7f488c0b59f0 legacy=0x7f488c0b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:22.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.734+0000 7f488a7fc640 1 -- 172.21.15.55:0/4194746647 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488c0d0d80 con 0x7f488c0cf340 2023-08-25T04:04:22.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.734+0000 7f4889ffb640 1 -- 172.21.15.55:0/4194746647 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625468050 0 0) 0x7f488c0d1970 con 0x7f488c0b59f0 2023-08-25T04:04:22.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.738+0000 7f488a7fc640 1 --2- 172.21.15.55:0/4194746647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c0cf340 0x7f488c0cf7b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f48800097c0 tx=0x7f488001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f6ae2f62726459 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:22.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.738+0000 7f4889ffb640 1 -- 172.21.15.55:0/4194746647 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48800a8970 con 0x7f488c0cf340 2023-08-25T04:04:22.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.738+0000 7f4889ffb640 1 -- 172.21.15.55:0/4194746647 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48800a8ad0 con 0x7f488c0cf340 2023-08-25T04:04:22.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.738+0000 7f4889ffb640 1 -- 172.21.15.55:0/4194746647 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48800a8e60 con 0x7f488c0cf340 2023-08-25T04:04:22.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.738+0000 7f48915ac640 1 -- 172.21.15.55:0/4194746647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c0cf340 msgr2=0x7f488c0cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:22.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.738+0000 7f48915ac640 1 --2- 172.21.15.55:0/4194746647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c0cf340 0x7f488c0cf7b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f48800097c0 tx=0x7f488001ec70 comp rx=0 tx=0).stop 2023-08-25T04:04:22.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.738+0000 7f48915ac640 1 -- 172.21.15.55:0/4194746647 shutdown_connections 2023-08-25T04:04:22.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.738+0000 7f48915ac640 1 --2- 172.21.15.55:0/4194746647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c0cf340 0x7f488c0cf7b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.738+0000 7f48915ac640 1 -- 172.21.15.55:0/4194746647 >> 172.21.15.55:0/4194746647 conn(0x7f488c06aae0 msgr2=0x7f488c06aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:22.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.738+0000 7f48915ac640 1 -- 172.21.15.55:0/4194746647 shutdown_connections 2023-08-25T04:04:22.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.738+0000 7f48915ac640 1 -- 172.21.15.55:0/4194746647 wait complete. 2023-08-25T04:04:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f48915ac640 1 Processor -- start 2023-08-25T04:04:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f48915ac640 1 -- start start 2023-08-25T04:04:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f48915ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f488c0b59f0 0x7f488c15f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f48915ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c0cf340 0x7f488c0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f48915ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c15cb40 0x7f488c0c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f48915ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c15fee0 con 0x7f488c0cf340 2023-08-25T04:04:22.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f48915ac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488c15f510 con 0x7f488c0b59f0 2023-08-25T04:04:22.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f48915ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488c15e900 con 0x7f488c15cb40 2023-08-25T04:04:22.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f488a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c0cf340 0x7f488c0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:22.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f488a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c0cf340 0x7f488c0b70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40716/0 (socket says 172.21.15.55:40716) 2023-08-25T04:04:22.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f488a7fc640 1 -- 172.21.15.55:0/3100393132 learned_addr learned my addr 172.21.15.55:0/3100393132 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:22.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f488affd640 1 --2- 172.21.15.55:0/3100393132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f488c0b59f0 0x7f488c15f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:22.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f488b7fe640 1 --2- 172.21.15.55:0/3100393132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c15cb40 0x7f488c0c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:22.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f488a7fc640 1 -- 172.21.15.55:0/3100393132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c15cb40 msgr2=0x7f488c0c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:22.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f488a7fc640 1 --2- 172.21.15.55:0/3100393132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c15cb40 0x7f488c0c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f488a7fc640 1 -- 172.21.15.55:0/3100393132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f488c0b59f0 msgr2=0x7f488c15f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:22.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f488a7fc640 1 --2- 172.21.15.55:0/3100393132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f488c0b59f0 0x7f488c15f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f488a7fc640 1 -- 172.21.15.55:0/3100393132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4880009420 con 0x7f488c0cf340 2023-08-25T04:04:22.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f488affd640 1 --2- 172.21.15.55:0/3100393132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f488c0b59f0 0x7f488c15f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:22.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f488a7fc640 1 --2- 172.21.15.55:0/3100393132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c0cf340 0x7f488c0b70d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f488001b880 tx=0x7f488001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:22.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f48737fe640 1 -- 172.21.15.55:0/3100393132 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48800a8970 con 0x7f488c0cf340 2023-08-25T04:04:22.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f48737fe640 1 -- 172.21.15.55:0/3100393132 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48800b9410 con 0x7f488c0cf340 2023-08-25T04:04:22.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f48915ac640 1 -- 172.21.15.55:0/3100393132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488c15ebe0 con 0x7f488c0cf340 2023-08-25T04:04:22.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f48737fe640 1 -- 172.21.15.55:0/3100393132 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48800b97a0 con 0x7f488c0cf340 2023-08-25T04:04:22.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f48915ac640 1 -- 172.21.15.55:0/3100393132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488c15f1a0 con 0x7f488c0cf340 2023-08-25T04:04:22.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.742+0000 7f48915ac640 1 -- 172.21.15.55:0/3100393132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488c071f80 con 0x7f488c0cf340 2023-08-25T04:04:22.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.746+0000 7f48737fe640 1 -- 172.21.15.55:0/3100393132 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85138+0+0 (secure 0 0 0) 0x7f48800b7040 con 0x7f488c0cf340 2023-08-25T04:04:22.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.746+0000 7f48737fe640 1 --2- 172.21.15.55:0/3100393132 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4878065880 0x7f4878067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:22.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.746+0000 7f48737fe640 1 -- 172.21.15.55:0/3100393132 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f4880120fc0 con 0x7f488c0cf340 2023-08-25T04:04:22.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.746+0000 7f488affd640 1 --2- 172.21.15.55:0/3100393132 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4878065880 0x7f4878067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:22.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.746+0000 7f488affd640 1 --2- 172.21.15.55:0/3100393132 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4878065880 0x7f4878067d40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f488c0cebe0 tx=0x7f487c009040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:22.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.750+0000 7f48737fe640 1 -- 172.21.15.55:0/3100393132 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f48800ee700 con 0x7f488c0cf340 2023-08-25T04:04:22.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.926+0000 7f48915ac640 1 -- 172.21.15.55:0/3100393132 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f488c0d1320 con 0x7f4878065880 2023-08-25T04:04:22.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.982+0000 7f48737fe640 1 -- 172.21.15.55:0/3100393132 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f487c001ce0 con 0x7f4878065880 2023-08-25T04:04:22.987 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-08-25T04:04:22.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.986+0000 7f48915ac640 1 -- 172.21.15.55:0/3100393132 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4878065880 msgr2=0x7f4878067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:22.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.986+0000 7f48915ac640 1 --2- 172.21.15.55:0/3100393132 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4878065880 0x7f4878067d40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f488c0cebe0 tx=0x7f487c009040 comp rx=0 tx=0).stop 2023-08-25T04:04:22.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.986+0000 7f48915ac640 1 -- 172.21.15.55:0/3100393132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c0cf340 msgr2=0x7f488c0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:22.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.986+0000 7f48915ac640 1 --2- 172.21.15.55:0/3100393132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c0cf340 0x7f488c0b70d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f488001b880 tx=0x7f488001ba10 comp rx=0 tx=0).stop 2023-08-25T04:04:22.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.986+0000 7f48915ac640 1 -- 172.21.15.55:0/3100393132 shutdown_connections 2023-08-25T04:04:22.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.986+0000 7f48915ac640 1 --2- 172.21.15.55:0/3100393132 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f4878065880 0x7f4878067d40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.986+0000 7f48915ac640 1 --2- 172.21.15.55:0/3100393132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f488c15cb40 0x7f488c0c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.986+0000 7f48915ac640 1 --2- 172.21.15.55:0/3100393132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488c0cf340 0x7f488c0b70d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.986+0000 7f48915ac640 1 --2- 172.21.15.55:0/3100393132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f488c0b59f0 0x7f488c15f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:22.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.986+0000 7f48915ac640 1 -- 172.21.15.55:0/3100393132 >> 172.21.15.55:0/3100393132 conn(0x7f488c06aae0 msgr2=0x7f488c0ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:22.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.986+0000 7f48915ac640 1 -- 172.21.15.55:0/3100393132 shutdown_connections 2023-08-25T04:04:22.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:22.986+0000 7f48915ac640 1 -- 172.21.15.55:0/3100393132 wait complete. 2023-08-25T04:04:23.007 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-08-25T04:04:23.008 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-08-25T04:04:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.154+0000 7fef5ebfa640 1 Processor -- start 2023-08-25T04:04:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.154+0000 7fef5ebfa640 1 -- start start 2023-08-25T04:04:23.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.158+0000 7fef5ebfa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fef5815cb40 0x7fef580d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:23.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.158+0000 7fef5ebfa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef580d1970 con 0x7fef580cf340 2023-08-25T04:04:23.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.158+0000 7fef5ebfa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef580b5200 con 0x7fef580b6a00 2023-08-25T04:04:23.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.158+0000 7fef5ebfa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef580d0d80 con 0x7fef5815cb40 2023-08-25T04:04:23.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.158+0000 7fef4ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fef580cf340 0x7fef580b43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45948/0 (socket says 172.21.15.55:45948) 2023-08-25T04:04:23.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.158+0000 7fef4ffff640 1 -- 172.21.15.55:0/3465011522 learned_addr learned my addr 172.21.15.55:0/3465011522 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:23.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.158+0000 7fef5c996640 1 --2- 172.21.15.55:0/3465011522 >> v2:172.21.15.110:3300/0 conn(0x7fef5815cb40 0x7fef580d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:23.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.158+0000 7fef4f7fe640 1 -- 172.21.15.55:0/3465011522 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815049067 0 0) 0x7fef580d1970 con 0x7fef580cf340 2023-08-25T04:04:23.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.158+0000 7fef4f7fe640 1 -- 172.21.15.55:0/3465011522 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef40003530 con 0x7fef580cf340 2023-08-25T04:04:23.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.158+0000 7fef5c996640 1 -- 172.21.15.55:0/3465011522 >> v1:172.21.15.110:6789/0 conn(0x7fef580b6a00 legacy=0x7fef580b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:23.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.158+0000 7fef5c996640 1 -- 172.21.15.55:0/3465011522 >> v1:172.21.15.55:6789/0 conn(0x7fef580cf340 legacy=0x7fef580b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:23.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.158+0000 7fef5c996640 1 -- 172.21.15.55:0/3465011522 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef580d1040 con 0x7fef5815cb40 2023-08-25T04:04:23.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.158+0000 7fef5c996640 1 --2- 172.21.15.55:0/3465011522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5815cb40 0x7fef580d2080 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fef540097c0 tx=0x7fef5401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d840a4b616fc2ceb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.162+0000 7fef4f7fe640 1 -- 172.21.15.55:0/3465011522 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef540a8970 con 0x7fef5815cb40 2023-08-25T04:04:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.162+0000 7fef4f7fe640 1 -- 172.21.15.55:0/3465011522 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef540a8ad0 con 0x7fef5815cb40 2023-08-25T04:04:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.162+0000 7fef4f7fe640 1 -- 172.21.15.55:0/3465011522 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef540a8e40 con 0x7fef5815cb40 2023-08-25T04:04:23.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.162+0000 7fef5ebfa640 1 -- 172.21.15.55:0/3465011522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5815cb40 msgr2=0x7fef580d2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:23.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.162+0000 7fef5ebfa640 1 --2- 172.21.15.55:0/3465011522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5815cb40 0x7fef580d2080 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fef540097c0 tx=0x7fef5401ec70 comp rx=0 tx=0).stop 2023-08-25T04:04:23.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.162+0000 7fef5ebfa640 1 -- 172.21.15.55:0/3465011522 shutdown_connections 2023-08-25T04:04:23.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.162+0000 7fef5ebfa640 1 --2- 172.21.15.55:0/3465011522 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef5815cb40 0x7fef580d2080 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:23.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.162+0000 7fef5ebfa640 1 -- 172.21.15.55:0/3465011522 >> 172.21.15.55:0/3465011522 conn(0x7fef5806aae0 msgr2=0x7fef5806aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:23.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.162+0000 7fef5ebfa640 1 -- 172.21.15.55:0/3465011522 shutdown_connections 2023-08-25T04:04:23.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.162+0000 7fef5ebfa640 1 -- 172.21.15.55:0/3465011522 wait complete. 2023-08-25T04:04:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.162+0000 7fef5ebfa640 1 Processor -- start 2023-08-25T04:04:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.162+0000 7fef5ebfa640 1 -- start start 2023-08-25T04:04:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.162+0000 7fef5ebfa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef580b6a00 0x7fef58154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.162+0000 7fef5ebfa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef580cf340 0x7fef580cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.162+0000 7fef5ebfa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef5815cb40 0x7fef580ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.162+0000 7fef5ebfa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef580c9bf0 con 0x7fef5815cb40 2023-08-25T04:04:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.162+0000 7fef5ebfa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef580c9ed0 con 0x7fef580b6a00 2023-08-25T04:04:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.162+0000 7fef5ebfa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef580ca1b0 con 0x7fef580cf340 2023-08-25T04:04:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef5d197640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef5815cb40 0x7fef580ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef5d197640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef5815cb40 0x7fef580ca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40730/0 (socket says 172.21.15.55:40730) 2023-08-25T04:04:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef5d197640 1 -- 172.21.15.55:0/1965243705 learned_addr learned my addr 172.21.15.55:0/1965243705 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef5c996640 1 --2- 172.21.15.55:0/1965243705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef580b6a00 0x7fef58154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:23.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef4ffff640 1 --2- 172.21.15.55:0/1965243705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef580cf340 0x7fef580cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:23.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef5d197640 1 -- 172.21.15.55:0/1965243705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef580cf340 msgr2=0x7fef580cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:23.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef5d197640 1 --2- 172.21.15.55:0/1965243705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef580cf340 0x7fef580cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:23.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef5d197640 1 -- 172.21.15.55:0/1965243705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef580b6a00 msgr2=0x7fef58154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:23.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef5d197640 1 --2- 172.21.15.55:0/1965243705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef580b6a00 0x7fef58154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef5d197640 1 -- 172.21.15.55:0/1965243705 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef54009420 con 0x7fef5815cb40 2023-08-25T04:04:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef5d197640 1 --2- 172.21.15.55:0/1965243705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef5815cb40 0x7fef580ca9b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fef5000c730 tx=0x7fef5000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef4d7fa640 1 -- 172.21.15.55:0/1965243705 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef50003b80 con 0x7fef5815cb40 2023-08-25T04:04:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef4d7fa640 1 -- 172.21.15.55:0/1965243705 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef50003ce0 con 0x7fef5815cb40 2023-08-25T04:04:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef5ebfa640 1 -- 172.21.15.55:0/1965243705 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef580ca490 con 0x7fef5815cb40 2023-08-25T04:04:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef4d7fa640 1 -- 172.21.15.55:0/1965243705 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5000aa30 con 0x7fef5815cb40 2023-08-25T04:04:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef5ebfa640 1 -- 172.21.15.55:0/1965243705 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef58155090 con 0x7fef5815cb40 2023-08-25T04:04:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef5ebfa640 1 -- 172.21.15.55:0/1965243705 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef58071f80 con 0x7fef5815cb40 2023-08-25T04:04:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef4d7fa640 1 -- 172.21.15.55:0/1965243705 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85138+0+0 (secure 0 0 0) 0x7fef5000ab90 con 0x7fef5815cb40 2023-08-25T04:04:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.166+0000 7fef4d7fa640 1 --2- 172.21.15.55:0/1965243705 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fef440658b0 0x7fef44067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:23.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.170+0000 7fef4d7fa640 1 -- 172.21.15.55:0/1965243705 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fef50082e00 con 0x7fef5815cb40 2023-08-25T04:04:23.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.170+0000 7fef5c996640 1 --2- 172.21.15.55:0/1965243705 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fef440658b0 0x7fef44067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:23.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.170+0000 7fef5c996640 1 --2- 172.21.15.55:0/1965243705 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fef440658b0 0x7fef44067d70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef540b2000 tx=0x7fef540aa070 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:23.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.170+0000 7fef4d7fa640 1 -- 172.21.15.55:0/1965243705 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fef50050680 con 0x7fef5815cb40 2023-08-25T04:04:23.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.350+0000 7fef5ebfa640 1 -- 172.21.15.55:0/1965243705 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fef581552b0 con 0x7fef440658b0 2023-08-25T04:04:23.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.402+0000 7fef4d7fa640 1 -- 172.21.15.55:0/1965243705 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fef581552b0 con 0x7fef440658b0 2023-08-25T04:04:23.428 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-08-25T04:04:23.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.406+0000 7fef5ebfa640 1 -- 172.21.15.55:0/1965243705 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fef440658b0 msgr2=0x7fef44067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:23.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.406+0000 7fef5ebfa640 1 --2- 172.21.15.55:0/1965243705 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fef440658b0 0x7fef44067d70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef540b2000 tx=0x7fef540aa070 comp rx=0 tx=0).stop 2023-08-25T04:04:23.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.406+0000 7fef5ebfa640 1 -- 172.21.15.55:0/1965243705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef5815cb40 msgr2=0x7fef580ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:23.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.406+0000 7fef5ebfa640 1 --2- 172.21.15.55:0/1965243705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef5815cb40 0x7fef580ca9b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fef5000c730 tx=0x7fef5000cbf0 comp rx=0 tx=0).stop 2023-08-25T04:04:23.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.406+0000 7fef5ebfa640 1 -- 172.21.15.55:0/1965243705 shutdown_connections 2023-08-25T04:04:23.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.406+0000 7fef5ebfa640 1 --2- 172.21.15.55:0/1965243705 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fef440658b0 0x7fef44067d70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:23.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.406+0000 7fef5ebfa640 1 --2- 172.21.15.55:0/1965243705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef5815cb40 0x7fef580ca9b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:23.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.406+0000 7fef5ebfa640 1 --2- 172.21.15.55:0/1965243705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef580cf340 0x7fef580cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:23.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.406+0000 7fef5ebfa640 1 --2- 172.21.15.55:0/1965243705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef580b6a00 0x7fef58154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:23.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.406+0000 7fef5ebfa640 1 -- 172.21.15.55:0/1965243705 >> 172.21.15.55:0/1965243705 conn(0x7fef5806aae0 msgr2=0x7fef580b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:23.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.406+0000 7fef5ebfa640 1 -- 172.21.15.55:0/1965243705 shutdown_connections 2023-08-25T04:04:23.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.406+0000 7fef5ebfa640 1 -- 172.21.15.55:0/1965243705 wait complete. 2023-08-25T04:04:23.437 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-08-25T04:04:23.437 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-08-25T04:04:23.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.582+0000 7fa207f82640 1 Processor -- start 2023-08-25T04:04:23.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.582+0000 7fa207f82640 1 -- start start 2023-08-25T04:04:23.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.586+0000 7fa207f82640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa20006fb50 0x7fa2000cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:23.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.586+0000 7fa207f82640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa2000cc930 0x7fa2000ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:23.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.586+0000 7fa207f82640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2000c9270 con 0x7fa200159d00 2023-08-25T04:04:23.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.586+0000 7fa207f82640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2000cc510 con 0x7fa2000cc930 2023-08-25T04:04:23.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.586+0000 7fa207f82640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2000ce220 con 0x7fa20006fb50 2023-08-25T04:04:23.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.586+0000 7fa20651f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa2000cc930 0x7fa2000ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:23.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.586+0000 7fa20651f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa2000cc930 0x7fa2000ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40734/0 (socket says 172.21.15.55:40734) 2023-08-25T04:04:23.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.586+0000 7fa20651f640 1 -- 172.21.15.55:0/1129380234 learned_addr learned my addr 172.21.15.55:0/1129380234 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:23.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.586+0000 7fa205d1e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa200159d00 0x7fa2000c8b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45964/0 (socket says 172.21.15.55:45964) 2023-08-25T04:04:23.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.586+0000 7fa20551d640 1 --2- 172.21.15.55:0/1129380234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa20006fb50 0x7fa2000cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:23.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.586+0000 7fa20651f640 1 -- 172.21.15.55:0/1129380234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa20006fb50 msgr2=0x7fa2000cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:23.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.586+0000 7fa20651f640 1 --2- 172.21.15.55:0/1129380234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa20006fb50 0x7fa2000cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:23.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.586+0000 7fa20651f640 1 -- 172.21.15.55:0/1129380234 >> v1:172.21.15.55:6789/0 conn(0x7fa200159d00 legacy=0x7fa2000c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:23.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.586+0000 7fa20651f640 1 -- 172.21.15.55:0/1129380234 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2000ca6c0 con 0x7fa2000cc930 2023-08-25T04:04:23.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.586+0000 7fa20551d640 1 --2- 172.21.15.55:0/1129380234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa20006fb50 0x7fa2000cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:23.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.586+0000 7fa204d1c640 1 -- 172.21.15.55:0/1129380234 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010939433 0 0) 0x7fa2000c9270 con 0x7fa200159d00 2023-08-25T04:04:23.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.590+0000 7fa20651f640 1 --2- 172.21.15.55:0/1129380234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2000cc930 0x7fa2000ccda0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009e50 tx=0x7fa1f801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1e5b2e156f41bd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:23.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.590+0000 7fa204d1c640 1 -- 172.21.15.55:0/1129380234 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f80a5810 con 0x7fa2000cc930 2023-08-25T04:04:23.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.590+0000 7fa204d1c640 1 -- 172.21.15.55:0/1129380234 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f80a5970 con 0x7fa2000cc930 2023-08-25T04:04:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.590+0000 7fa204d1c640 1 -- 172.21.15.55:0/1129380234 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f80a5d00 con 0x7fa2000cc930 2023-08-25T04:04:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.590+0000 7fa207f82640 1 -- 172.21.15.55:0/1129380234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2000cc930 msgr2=0x7fa2000ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.590+0000 7fa207f82640 1 --2- 172.21.15.55:0/1129380234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2000cc930 0x7fa2000ccda0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009e50 tx=0x7fa1f801c950 comp rx=0 tx=0).stop 2023-08-25T04:04:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.590+0000 7fa207f82640 1 -- 172.21.15.55:0/1129380234 shutdown_connections 2023-08-25T04:04:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.590+0000 7fa207f82640 1 --2- 172.21.15.55:0/1129380234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa20006fb50 0x7fa2000cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.590+0000 7fa207f82640 1 --2- 172.21.15.55:0/1129380234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2000cc930 0x7fa2000ccda0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.590+0000 7fa207f82640 1 -- 172.21.15.55:0/1129380234 >> 172.21.15.55:0/1129380234 conn(0x7fa2000caf90 msgr2=0x7fa2000cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.590+0000 7fa207f82640 1 -- 172.21.15.55:0/1129380234 shutdown_connections 2023-08-25T04:04:23.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.590+0000 7fa207f82640 1 -- 172.21.15.55:0/1129380234 wait complete. 2023-08-25T04:04:23.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.590+0000 7fa207f82640 1 Processor -- start 2023-08-25T04:04:23.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.590+0000 7fa207f82640 1 -- start start 2023-08-25T04:04:23.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa207f82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa20006fb50 0x7fa200152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:23.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa207f82640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa2000cc930 0x7fa2001f83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:23.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa207f82640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa200159d00 0x7fa2000c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:23.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa207f82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2000ae4d0 con 0x7fa20006fb50 2023-08-25T04:04:23.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa207f82640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2001f92d0 con 0x7fa200159d00 2023-08-25T04:04:23.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa207f82640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2001528a0 con 0x7fa2000cc930 2023-08-25T04:04:23.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa205d1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa20006fb50 0x7fa200152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:23.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa205d1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa20006fb50 0x7fa200152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40748/0 (socket says 172.21.15.55:40748) 2023-08-25T04:04:23.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa205d1e640 1 -- 172.21.15.55:0/3847913011 learned_addr learned my addr 172.21.15.55:0/3847913011 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:23.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa205d1e640 1 -- 172.21.15.55:0/3847913011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa2000cc930 msgr2=0x7fa2001f83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:23.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa205d1e640 1 --2- 172.21.15.55:0/3847913011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa2000cc930 0x7fa2001f83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:23.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa205d1e640 1 -- 172.21.15.55:0/3847913011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa200159d00 msgr2=0x7fa2000c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:23.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa205d1e640 1 --2- 172.21.15.55:0/3847913011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa200159d00 0x7fa2000c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:23.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa205d1e640 1 -- 172.21.15.55:0/3847913011 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f8009b30 con 0x7fa20006fb50 2023-08-25T04:04:23.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa205d1e640 1 --2- 172.21.15.55:0/3847913011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa20006fb50 0x7fa200152360 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0011f0 tx=0x7fa1fc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:23.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa1f67fc640 1 -- 172.21.15.55:0/3847913011 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc0074e0 con 0x7fa20006fb50 2023-08-25T04:04:23.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa1f67fc640 1 -- 172.21.15.55:0/3847913011 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1fc007640 con 0x7fa20006fb50 2023-08-25T04:04:23.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa1f67fc640 1 -- 172.21.15.55:0/3847913011 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc004a30 con 0x7fa20006fb50 2023-08-25T04:04:23.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa207f82640 1 -- 172.21.15.55:0/3847913011 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2001f8d10 con 0x7fa20006fb50 2023-08-25T04:04:23.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa207f82640 1 -- 172.21.15.55:0/3847913011 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2000ae0f0 con 0x7fa20006fb50 2023-08-25T04:04:23.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa207f82640 1 -- 172.21.15.55:0/3847913011 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20004dbe0 con 0x7fa20006fb50 2023-08-25T04:04:23.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.594+0000 7fa1f67fc640 1 -- 172.21.15.55:0/3847913011 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85138+0+0 (secure 0 0 0) 0x7fa1fc004b90 con 0x7fa20006fb50 2023-08-25T04:04:23.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.598+0000 7fa1f67fc640 1 --2- 172.21.15.55:0/3847913011 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fa1e4065880 0x7fa1e4067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:23.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.598+0000 7fa1f67fc640 1 -- 172.21.15.55:0/3847913011 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fa1fc082530 con 0x7fa20006fb50 2023-08-25T04:04:23.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.598+0000 7fa20551d640 1 --2- 172.21.15.55:0/3847913011 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fa1e4065880 0x7fa1e4067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:23.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.598+0000 7fa20551d640 1 --2- 172.21.15.55:0/3847913011 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fa1e4065880 0x7fa1e4067d40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0006f10 tx=0x7fa1f0008040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:23.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.602+0000 7fa1f67fc640 1 -- 172.21.15.55:0/3847913011 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa1fc04fd00 con 0x7fa20006fb50 2023-08-25T04:04:23.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.778+0000 7fa207f82640 1 -- 172.21.15.55:0/3847913011 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa20015a0e0 con 0x7fa1e4065880 2023-08-25T04:04:23.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.830+0000 7fa1f67fc640 1 -- 172.21.15.55:0/3847913011 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fa1f000be40 con 0x7fa1e4065880 2023-08-25T04:04:23.837 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-08-25T04:04:23.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.834+0000 7fa207f82640 1 -- 172.21.15.55:0/3847913011 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fa1e4065880 msgr2=0x7fa1e4067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:23.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.834+0000 7fa207f82640 1 --2- 172.21.15.55:0/3847913011 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fa1e4065880 0x7fa1e4067d40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0006f10 tx=0x7fa1f0008040 comp rx=0 tx=0).stop 2023-08-25T04:04:23.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.834+0000 7fa207f82640 1 -- 172.21.15.55:0/3847913011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa20006fb50 msgr2=0x7fa200152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:23.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.834+0000 7fa207f82640 1 --2- 172.21.15.55:0/3847913011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa20006fb50 0x7fa200152360 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0011f0 tx=0x7fa1fc00c9b0 comp rx=0 tx=0).stop 2023-08-25T04:04:23.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.834+0000 7fa207f82640 1 -- 172.21.15.55:0/3847913011 shutdown_connections 2023-08-25T04:04:23.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.834+0000 7fa207f82640 1 --2- 172.21.15.55:0/3847913011 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fa1e4065880 0x7fa1e4067d40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:23.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.834+0000 7fa207f82640 1 --2- 172.21.15.55:0/3847913011 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa200159d00 0x7fa2000c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:23.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.834+0000 7fa207f82640 1 --2- 172.21.15.55:0/3847913011 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa2000cc930 0x7fa2001f83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:23.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.834+0000 7fa207f82640 1 --2- 172.21.15.55:0/3847913011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa20006fb50 0x7fa200152360 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:23.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.834+0000 7fa207f82640 1 -- 172.21.15.55:0/3847913011 >> 172.21.15.55:0/3847913011 conn(0x7fa2000caf90 msgr2=0x7fa2000c8820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:23.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.834+0000 7fa207f82640 1 -- 172.21.15.55:0/3847913011 shutdown_connections 2023-08-25T04:04:23.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:23.834+0000 7fa207f82640 1 -- 172.21.15.55:0/3847913011 wait complete. 2023-08-25T04:04:23.856 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-08-25T04:04:23.856 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-08-25T04:04:24.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.002+0000 7f2b5ca6a640 1 Processor -- start 2023-08-25T04:04:24.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.002+0000 7f2b5ca6a640 1 -- start start 2023-08-25T04:04:24.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.002+0000 7f2b5ca6a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2b58159d00 0x7f2b580cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.002+0000 7f2b5ca6a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b5806fb50 0x7f2b580c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.002+0000 7f2b5ca6a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b580ce220 con 0x7f2b580cc930 2023-08-25T04:04:24.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.002+0000 7f2b5ca6a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b580cc510 con 0x7f2b5806fb50 2023-08-25T04:04:24.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.002+0000 7f2b5ca6a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b580ca6c0 con 0x7f2b58159d00 2023-08-25T04:04:24.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.002+0000 7f2b4dd9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b5806fb50 0x7f2b580c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.002+0000 7f2b4dd9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b5806fb50 0x7f2b580c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40760/0 (socket says 172.21.15.55:40760) 2023-08-25T04:04:24.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.002+0000 7f2b4dd9b640 1 -- 172.21.15.55:0/399381231 learned_addr learned my addr 172.21.15.55:0/399381231 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:24.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.002+0000 7f2b5659c640 1 --2- 172.21.15.55:0/399381231 >> v2:172.21.15.110:3300/0 conn(0x7f2b58159d00 0x7f2b580cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.002+0000 7f2b4dd9b640 1 -- 172.21.15.55:0/399381231 >> v2:172.21.15.110:3300/0 conn(0x7f2b58159d00 msgr2=0x7f2b580cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:24.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.002+0000 7f2b4dd9b640 1 --2- 172.21.15.55:0/399381231 >> v2:172.21.15.110:3300/0 conn(0x7f2b58159d00 0x7f2b580cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.002+0000 7f2b4dd9b640 1 -- 172.21.15.55:0/399381231 >> v1:172.21.15.110:6789/0 conn(0x7f2b580cc930 legacy=0x7f2b580ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:24.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.002+0000 7f2b4dd9b640 1 -- 172.21.15.55:0/399381231 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b580ca9a0 con 0x7f2b5806fb50 2023-08-25T04:04:24.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.002+0000 7f2b5659c640 1 --2- 172.21.15.55:0/399381231 >> v2:172.21.15.110:3300/0 conn(0x7f2b58159d00 0x7f2b580cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:04:24.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.006+0000 7f2b4dd9b640 1 --2- 172.21.15.55:0/399381231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b5806fb50 0x7f2b580c8b60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2b580b0de0 tx=0x7f2b4001f530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35c37dbc94122e3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:24.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.006+0000 7f2b55d9b640 1 -- 172.21.15.55:0/399381231 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b400a7bc0 con 0x7f2b5806fb50 2023-08-25T04:04:24.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.006+0000 7f2b55d9b640 1 -- 172.21.15.55:0/399381231 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b400a7d20 con 0x7f2b5806fb50 2023-08-25T04:04:24.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.006+0000 7f2b55d9b640 1 -- 172.21.15.55:0/399381231 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b400af660 con 0x7f2b5806fb50 2023-08-25T04:04:24.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.006+0000 7f2b5ca6a640 1 -- 172.21.15.55:0/399381231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b5806fb50 msgr2=0x7f2b580c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:24.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.006+0000 7f2b5ca6a640 1 --2- 172.21.15.55:0/399381231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b5806fb50 0x7f2b580c8b60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2b580b0de0 tx=0x7f2b4001f530 comp rx=0 tx=0).stop 2023-08-25T04:04:24.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.006+0000 7f2b5ca6a640 1 -- 172.21.15.55:0/399381231 shutdown_connections 2023-08-25T04:04:24.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.006+0000 7f2b5ca6a640 1 --2- 172.21.15.55:0/399381231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b5806fb50 0x7f2b580c8b60 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.006+0000 7f2b5ca6a640 1 --2- 172.21.15.55:0/399381231 >> v2:172.21.15.110:3300/0 conn(0x7f2b58159d00 0x7f2b580cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.006+0000 7f2b5ca6a640 1 -- 172.21.15.55:0/399381231 >> 172.21.15.55:0/399381231 conn(0x7f2b580caf90 msgr2=0x7f2b580cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:24.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.006+0000 7f2b5ca6a640 1 -- 172.21.15.55:0/399381231 shutdown_connections 2023-08-25T04:04:24.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.006+0000 7f2b5ca6a640 1 -- 172.21.15.55:0/399381231 wait complete. 2023-08-25T04:04:24.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b5ca6a640 1 Processor -- start 2023-08-25T04:04:24.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b5ca6a640 1 -- start start 2023-08-25T04:04:24.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b5ca6a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b5806fb50 0x7f2b581519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b5ca6a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b580cc930 0x7f2b580ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b5ca6a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b58159d00 0x7f2b580ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b5ca6a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b580aff80 con 0x7f2b58159d00 2023-08-25T04:04:24.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b5ca6a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b58152f60 con 0x7f2b580cc930 2023-08-25T04:04:24.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b5ca6a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b58152350 con 0x7f2b5806fb50 2023-08-25T04:04:24.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b56d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b58159d00 0x7f2b580ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b5659c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b5806fb50 0x7f2b581519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b56d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b58159d00 0x7f2b580ae7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40770/0 (socket says 172.21.15.55:40770) 2023-08-25T04:04:24.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b56d9d640 1 -- 172.21.15.55:0/4092104842 learned_addr learned my addr 172.21.15.55:0/4092104842 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:24.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b5659c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b5806fb50 0x7f2b581519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:49744/0 (socket says 172.21.15.55:49744) 2023-08-25T04:04:24.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b4dd9b640 1 --2- 172.21.15.55:0/4092104842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b580cc930 0x7f2b580ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b56d9d640 1 -- 172.21.15.55:0/4092104842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b5806fb50 msgr2=0x7f2b581519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:24.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b56d9d640 1 --2- 172.21.15.55:0/4092104842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b5806fb50 0x7f2b581519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b56d9d640 1 -- 172.21.15.55:0/4092104842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b580cc930 msgr2=0x7f2b580ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:24.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b56d9d640 1 --2- 172.21.15.55:0/4092104842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b580cc930 0x7f2b580ae2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b56d9d640 1 -- 172.21.15.55:0/4092104842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4000b770 con 0x7f2b58159d00 2023-08-25T04:04:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.010+0000 7f2b56d9d640 1 --2- 172.21.15.55:0/4092104842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b58159d00 0x7f2b580ae7e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000c440 tx=0x7f2b5000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.014+0000 7f2b4f7fe640 1 -- 172.21.15.55:0/4092104842 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50003600 con 0x7f2b58159d00 2023-08-25T04:04:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.014+0000 7f2b4f7fe640 1 -- 172.21.15.55:0/4092104842 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b50003780 con 0x7f2b58159d00 2023-08-25T04:04:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.014+0000 7f2b4f7fe640 1 -- 172.21.15.55:0/4092104842 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50003b30 con 0x7f2b58159d00 2023-08-25T04:04:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.014+0000 7f2b5ca6a640 1 -- 172.21.15.55:0/4092104842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b58152630 con 0x7f2b58159d00 2023-08-25T04:04:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.014+0000 7f2b5ca6a640 1 -- 172.21.15.55:0/4092104842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b58152bf0 con 0x7f2b58159d00 2023-08-25T04:04:24.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.014+0000 7f2b5ca6a640 1 -- 172.21.15.55:0/4092104842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b581530f0 con 0x7f2b58159d00 2023-08-25T04:04:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.014+0000 7f2b4f7fe640 1 -- 172.21.15.55:0/4092104842 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85138+0+0 (secure 0 0 0) 0x7f2b50003c90 con 0x7f2b58159d00 2023-08-25T04:04:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.014+0000 7f2b4f7fe640 1 --2- 172.21.15.55:0/4092104842 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f2b38065880 0x7f2b38067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.014+0000 7f2b4f7fe640 1 -- 172.21.15.55:0/4092104842 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f2b500823b0 con 0x7f2b58159d00 2023-08-25T04:04:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.014+0000 7f2b5659c640 1 --2- 172.21.15.55:0/4092104842 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f2b38065880 0x7f2b38067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.014+0000 7f2b5659c640 1 --2- 172.21.15.55:0/4092104842 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f2b38065880 0x7f2b38067d40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800f500 tx=0x7f2b48007770 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:24.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.018+0000 7f2b4f7fe640 1 -- 172.21.15.55:0/4092104842 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2b5004fbd0 con 0x7f2b58159d00 2023-08-25T04:04:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.194+0000 7f2b5ca6a640 1 -- 172.21.15.55:0/4092104842 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b580cd770 con 0x7f2b38065880 2023-08-25T04:04:24.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.246+0000 7f2b4f7fe640 1 -- 172.21.15.55:0/4092104842 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f2b4800d4f0 con 0x7f2b38065880 2023-08-25T04:04:24.254 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-08-25T04:04:24.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.250+0000 7f2b5ca6a640 1 -- 172.21.15.55:0/4092104842 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f2b38065880 msgr2=0x7f2b38067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:24.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.250+0000 7f2b5ca6a640 1 --2- 172.21.15.55:0/4092104842 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f2b38065880 0x7f2b38067d40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2b4800f500 tx=0x7f2b48007770 comp rx=0 tx=0).stop 2023-08-25T04:04:24.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.250+0000 7f2b5ca6a640 1 -- 172.21.15.55:0/4092104842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b58159d00 msgr2=0x7f2b580ae7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:24.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.250+0000 7f2b5ca6a640 1 --2- 172.21.15.55:0/4092104842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b58159d00 0x7f2b580ae7e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000c440 tx=0x7f2b5000c900 comp rx=0 tx=0).stop 2023-08-25T04:04:24.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.250+0000 7f2b5ca6a640 1 -- 172.21.15.55:0/4092104842 shutdown_connections 2023-08-25T04:04:24.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.250+0000 7f2b5ca6a640 1 --2- 172.21.15.55:0/4092104842 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f2b38065880 0x7f2b38067d40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.250+0000 7f2b5ca6a640 1 --2- 172.21.15.55:0/4092104842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b58159d00 0x7f2b580ae7e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.250+0000 7f2b5ca6a640 1 --2- 172.21.15.55:0/4092104842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b580cc930 0x7f2b580ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.250+0000 7f2b5ca6a640 1 --2- 172.21.15.55:0/4092104842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b5806fb50 0x7f2b581519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.250+0000 7f2b5ca6a640 1 -- 172.21.15.55:0/4092104842 >> 172.21.15.55:0/4092104842 conn(0x7f2b580caf90 msgr2=0x7f2b58163e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.250+0000 7f2b5ca6a640 1 -- 172.21.15.55:0/4092104842 shutdown_connections 2023-08-25T04:04:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.250+0000 7f2b5ca6a640 1 -- 172.21.15.55:0/4092104842 wait complete. 2023-08-25T04:04:24.276 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-08-25T04:04:24.278 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-08-25T04:04:24.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.426+0000 7f39aab33640 1 Processor -- start 2023-08-25T04:04:24.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.426+0000 7f39aab33640 1 -- start start 2023-08-25T04:04:24.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.430+0000 7f39aab33640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a4155740 0x7f39a415c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.430+0000 7f39aab33640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a415fa50 con 0x7f39a4155360 2023-08-25T04:04:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.430+0000 7f39aab33640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a415f490 con 0x7f39a406fb50 2023-08-25T04:04:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.430+0000 7f39aab33640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a415f2a0 con 0x7f39a4155740 2023-08-25T04:04:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.430+0000 7f39a88cf640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f39a4155360 0x7f39a415eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45968/0 (socket says 172.21.15.55:45968) 2023-08-25T04:04:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.430+0000 7f39a88cf640 1 -- 172.21.15.55:0/128383704 learned_addr learned my addr 172.21.15.55:0/128383704 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:24.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.430+0000 7f39a3fff640 1 --2- 172.21.15.55:0/128383704 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a4155740 0x7f39a415c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.430+0000 7f39a37fe640 1 -- 172.21.15.55:0/128383704 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648921336 0 0) 0x7f39a415fa50 con 0x7f39a4155360 2023-08-25T04:04:24.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.430+0000 7f39a37fe640 1 -- 172.21.15.55:0/128383704 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3994003530 con 0x7f39a4155360 2023-08-25T04:04:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.430+0000 7f39a37fe640 1 -- 172.21.15.55:0/128383704 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175882953 0 0) 0x7f39a415f490 con 0x7f39a406fb50 2023-08-25T04:04:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.430+0000 7f39a37fe640 1 -- 172.21.15.55:0/128383704 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39a415fa50 con 0x7f39a406fb50 2023-08-25T04:04:24.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.430+0000 7f39a3fff640 1 -- 172.21.15.55:0/128383704 >> v1:172.21.15.110:6789/0 conn(0x7f39a406fb50 legacy=0x7f39a40aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:24.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.430+0000 7f39a37fe640 1 -- 172.21.15.55:0/128383704 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 393036363 0 0) 0x7f3994003530 con 0x7f39a4155360 2023-08-25T04:04:24.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.430+0000 7f39a3fff640 1 -- 172.21.15.55:0/128383704 >> v1:172.21.15.55:6789/0 conn(0x7f39a4155360 legacy=0x7f39a415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:24.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.430+0000 7f39a3fff640 1 -- 172.21.15.55:0/128383704 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a415f770 con 0x7f39a4155740 2023-08-25T04:04:24.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39a3fff640 1 --2- 172.21.15.55:0/128383704 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a4155740 0x7f39a415c180 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f39900097f0 tx=0x7f399001c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cb06e29736069c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:24.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39a37fe640 1 -- 172.21.15.55:0/128383704 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3998001680 con 0x7f39a4155740 2023-08-25T04:04:24.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39a37fe640 1 -- 172.21.15.55:0/128383704 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39900a7050 con 0x7f39a4155740 2023-08-25T04:04:24.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39a37fe640 1 -- 172.21.15.55:0/128383704 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39900ab620 con 0x7f39a4155740 2023-08-25T04:04:24.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39aab33640 1 -- 172.21.15.55:0/128383704 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a4155740 msgr2=0x7f39a415c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:24.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39aab33640 1 --2- 172.21.15.55:0/128383704 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a4155740 0x7f39a415c180 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f39900097f0 tx=0x7f399001c2c0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39aab33640 1 -- 172.21.15.55:0/128383704 shutdown_connections 2023-08-25T04:04:24.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39aab33640 1 --2- 172.21.15.55:0/128383704 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a4155740 0x7f39a415c180 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39aab33640 1 -- 172.21.15.55:0/128383704 >> 172.21.15.55:0/128383704 conn(0x7f39a40caf90 msgr2=0x7f39a40cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:24.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39aab33640 1 -- 172.21.15.55:0/128383704 shutdown_connections 2023-08-25T04:04:24.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39aab33640 1 -- 172.21.15.55:0/128383704 wait complete. 2023-08-25T04:04:24.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39aab33640 1 Processor -- start 2023-08-25T04:04:24.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39aab33640 1 -- start start 2023-08-25T04:04:24.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39aab33640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a406fb50 0x7f39a4157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39aab33640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a4155360 0x7f39a4155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39aab33640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a4155740 0x7f39a40afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39aab33640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a414ff90 con 0x7f39a4155740 2023-08-25T04:04:24.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39aab33640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a40af2c0 con 0x7f39a406fb50 2023-08-25T04:04:24.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.434+0000 7f39aab33640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a414da70 con 0x7f39a4155360 2023-08-25T04:04:24.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.438+0000 7f39a90d0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a4155740 0x7f39a40afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.438+0000 7f39a90d0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a4155740 0x7f39a40afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40784/0 (socket says 172.21.15.55:40784) 2023-08-25T04:04:24.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.438+0000 7f39a90d0640 1 -- 172.21.15.55:0/579619706 learned_addr learned my addr 172.21.15.55:0/579619706 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:24.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.438+0000 7f39a88cf640 1 --2- 172.21.15.55:0/579619706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a406fb50 0x7f39a4157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.438+0000 7f39a3fff640 1 --2- 172.21.15.55:0/579619706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a4155360 0x7f39a4155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.438+0000 7f39a90d0640 1 -- 172.21.15.55:0/579619706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a4155360 msgr2=0x7f39a4155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:24.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.438+0000 7f39a90d0640 1 --2- 172.21.15.55:0/579619706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a4155360 0x7f39a4155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.438+0000 7f39a90d0640 1 -- 172.21.15.55:0/579619706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a406fb50 msgr2=0x7f39a4157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:24.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.438+0000 7f39a90d0640 1 --2- 172.21.15.55:0/579619706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a406fb50 0x7f39a4157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.438+0000 7f39a90d0640 1 -- 172.21.15.55:0/579619706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3990009420 con 0x7f39a4155740 2023-08-25T04:04:24.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.438+0000 7f39a90d0640 1 --2- 172.21.15.55:0/579619706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a4155740 0x7f39a40afc20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f399c00c760 tx=0x7f399c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:24.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.438+0000 7f39a17fa640 1 -- 172.21.15.55:0/579619706 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c003b80 con 0x7f39a4155740 2023-08-25T04:04:24.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.438+0000 7f39a17fa640 1 -- 172.21.15.55:0/579619706 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c003ce0 con 0x7f39a4155740 2023-08-25T04:04:24.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.438+0000 7f39aab33640 1 -- 172.21.15.55:0/579619706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a40aea20 con 0x7f39a4155740 2023-08-25T04:04:24.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.438+0000 7f39a17fa640 1 -- 172.21.15.55:0/579619706 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c00aa90 con 0x7f39a4155740 2023-08-25T04:04:24.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.438+0000 7f39aab33640 1 -- 172.21.15.55:0/579619706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a40aefe0 con 0x7f39a4155740 2023-08-25T04:04:24.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.438+0000 7f39aab33640 1 -- 172.21.15.55:0/579619706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a404dbe0 con 0x7f39a4155740 2023-08-25T04:04:24.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.438+0000 7f39a17fa640 1 -- 172.21.15.55:0/579619706 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85138+0+0 (secure 0 0 0) 0x7f399c00abf0 con 0x7f39a4155740 2023-08-25T04:04:24.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.442+0000 7f39a17fa640 1 --2- 172.21.15.55:0/579619706 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f3988065880 0x7f3988067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.442+0000 7f39a17fa640 1 -- 172.21.15.55:0/579619706 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f399c082f90 con 0x7f39a4155740 2023-08-25T04:04:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.442+0000 7f39a88cf640 1 --2- 172.21.15.55:0/579619706 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f3988065880 0x7f3988067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.442+0000 7f39a88cf640 1 --2- 172.21.15.55:0/579619706 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f3988065880 0x7f3988067d40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3998001ec0 tx=0x7f3998001a60 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.446+0000 7f39a17fa640 1 -- 172.21.15.55:0/579619706 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f399c050790 con 0x7f39a4155740 2023-08-25T04:04:24.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.618+0000 7f39aab33640 1 -- 172.21.15.55:0/579619706 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f39a40b06a0 con 0x7f3988065880 2023-08-25T04:04:24.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.670+0000 7f39a17fa640 1 -- 172.21.15.55:0/579619706 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f3998006e70 con 0x7f3988065880 2023-08-25T04:04:24.674 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-08-25T04:04:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.674+0000 7f39aab33640 1 -- 172.21.15.55:0/579619706 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f3988065880 msgr2=0x7f3988067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.674+0000 7f39aab33640 1 --2- 172.21.15.55:0/579619706 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f3988065880 0x7f3988067d40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3998001ec0 tx=0x7f3998001a60 comp rx=0 tx=0).stop 2023-08-25T04:04:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.674+0000 7f39aab33640 1 -- 172.21.15.55:0/579619706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a4155740 msgr2=0x7f39a40afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.674+0000 7f39aab33640 1 --2- 172.21.15.55:0/579619706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a4155740 0x7f39a40afc20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f399c00c760 tx=0x7f399c00cc20 comp rx=0 tx=0).stop 2023-08-25T04:04:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.674+0000 7f39aab33640 1 -- 172.21.15.55:0/579619706 shutdown_connections 2023-08-25T04:04:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.674+0000 7f39aab33640 1 --2- 172.21.15.55:0/579619706 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f3988065880 0x7f3988067d40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.674+0000 7f39aab33640 1 --2- 172.21.15.55:0/579619706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39a4155740 0x7f39a40afc20 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.674+0000 7f39aab33640 1 --2- 172.21.15.55:0/579619706 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39a4155360 0x7f39a4155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.674+0000 7f39aab33640 1 --2- 172.21.15.55:0/579619706 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39a406fb50 0x7f39a4157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.674+0000 7f39aab33640 1 -- 172.21.15.55:0/579619706 >> 172.21.15.55:0/579619706 conn(0x7f39a40caf90 msgr2=0x7f39a40c8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:24.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.674+0000 7f39aab33640 1 -- 172.21.15.55:0/579619706 shutdown_connections 2023-08-25T04:04:24.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.674+0000 7f39aab33640 1 -- 172.21.15.55:0/579619706 wait complete. 2023-08-25T04:04:24.694 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-08-25T04:04:24.695 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-08-25T04:04:24.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.838+0000 7f67e438f640 1 Processor -- start 2023-08-25T04:04:24.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.838+0000 7f67e438f640 1 -- start start 2023-08-25T04:04:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e438f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f67dc0cd040 0x7f67dc0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e438f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67dc0c9270 con 0x7f67dc06fb50 2023-08-25T04:04:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e438f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67dc0ce220 con 0x7f67dc159d00 2023-08-25T04:04:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e438f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67dc0cc510 con 0x7f67dc0cd040 2023-08-25T04:04:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e192a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f67dc06fb50 0x7f67dc0cc930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45970/0 (socket says 172.21.15.55:45970) 2023-08-25T04:04:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e192a640 1 -- 172.21.15.55:0/2107165776 learned_addr learned my addr 172.21.15.55:0/2107165776 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e292c640 1 --2- 172.21.15.55:0/2107165776 >> v2:172.21.15.110:3300/0 conn(0x7f67dc0cd040 0x7f67dc0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e1129640 1 -- 172.21.15.55:0/2107165776 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055451736 0 0) 0x7f67dc0c9270 con 0x7f67dc06fb50 2023-08-25T04:04:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e1129640 1 -- 172.21.15.55:0/2107165776 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67c8003530 con 0x7f67dc06fb50 2023-08-25T04:04:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e1129640 1 -- 172.21.15.55:0/2107165776 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 953368790 0 0) 0x7f67c8003530 con 0x7f67dc06fb50 2023-08-25T04:04:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e1129640 1 -- 172.21.15.55:0/2107165776 >> v2:172.21.15.110:3300/0 conn(0x7f67dc0cd040 msgr2=0x7f67dc0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e1129640 1 --2- 172.21.15.55:0/2107165776 >> v2:172.21.15.110:3300/0 conn(0x7f67dc0cd040 0x7f67dc0cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e1129640 1 -- 172.21.15.55:0/2107165776 >> v1:172.21.15.110:6789/0 conn(0x7f67dc159d00 legacy=0x7f67dc0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e1129640 1 -- 172.21.15.55:0/2107165776 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc0ca6c0 con 0x7f67dc06fb50 2023-08-25T04:04:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e1129640 1 -- 172.21.15.55:0/2107165776 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f67cc001680 con 0x7f67dc06fb50 2023-08-25T04:04:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e1129640 1 -- 172.21.15.55:0/2107165776 >> v1:172.21.15.55:6789/0 conn(0x7f67dc06fb50 legacy=0x7f67dc0cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e1129640 1 --2- 172.21.15.55:0/2107165776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67c8003980 0x7f67c8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e1129640 1 --2- 172.21.15.55:0/2107165776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67c80047d0 0x7f67c8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e1129640 1 --2- 172.21.15.55:0/2107165776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67c8005190 0x7f67c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e1129640 1 -- 172.21.15.55:0/2107165776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0cc510 con 0x7f67c8003980 2023-08-25T04:04:24.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e1129640 1 -- 172.21.15.55:0/2107165776 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c800c130 con 0x7f67c8005190 2023-08-25T04:04:24.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e1129640 1 -- 172.21.15.55:0/2107165776 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c800c2f0 con 0x7f67c80047d0 2023-08-25T04:04:24.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e212b640 1 --2- 172.21.15.55:0/2107165776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67c8003980 0x7f67c8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e292c640 1 --2- 172.21.15.55:0/2107165776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67c8005190 0x7f67c800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e192a640 1 --2- 172.21.15.55:0/2107165776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67c80047d0 0x7f67c8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e212b640 1 -- 172.21.15.55:0/2107165776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67c80047d0 msgr2=0x7f67c8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e212b640 1 --2- 172.21.15.55:0/2107165776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67c80047d0 0x7f67c8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e212b640 1 -- 172.21.15.55:0/2107165776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67c8005190 msgr2=0x7f67c800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e212b640 1 --2- 172.21.15.55:0/2107165776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67c8005190 0x7f67c800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e212b640 1 -- 172.21.15.55:0/2107165776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c8003530 con 0x7f67c8003980 2023-08-25T04:04:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.842+0000 7f67e292c640 1 -- 172.21.15.55:0/2107165776 reap_dead start 2023-08-25T04:04:24.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.846+0000 7f67e212b640 1 --2- 172.21.15.55:0/2107165776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67c8003980 0x7f67c8003da0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f67d8001780 tx=0x7f67d801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdded0c5e74181c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.846+0000 7f67e1129640 1 -- 172.21.15.55:0/2107165776 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d80052d0 con 0x7f67c8003980 2023-08-25T04:04:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.846+0000 7f67e1129640 1 -- 172.21.15.55:0/2107165776 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d80a7050 con 0x7f67c8003980 2023-08-25T04:04:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.846+0000 7f67e1129640 1 -- 172.21.15.55:0/2107165776 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d8003600 con 0x7f67c8003980 2023-08-25T04:04:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.846+0000 7f67e438f640 1 -- 172.21.15.55:0/2107165776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67c8003980 msgr2=0x7f67c8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.846+0000 7f67e438f640 1 --2- 172.21.15.55:0/2107165776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67c8003980 0x7f67c8003da0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f67d8001780 tx=0x7f67d801c3b0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.846+0000 7f67e438f640 1 -- 172.21.15.55:0/2107165776 shutdown_connections 2023-08-25T04:04:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.846+0000 7f67e438f640 1 --2- 172.21.15.55:0/2107165776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67c8003980 0x7f67c8003da0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.846+0000 7f67e438f640 1 -- 172.21.15.55:0/2107165776 >> 172.21.15.55:0/2107165776 conn(0x7f67dc0caf90 msgr2=0x7f67dc0cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.846+0000 7f67e438f640 1 -- 172.21.15.55:0/2107165776 shutdown_connections 2023-08-25T04:04:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.846+0000 7f67e438f640 1 -- 172.21.15.55:0/2107165776 wait complete. 2023-08-25T04:04:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e438f640 1 Processor -- start 2023-08-25T04:04:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e438f640 1 -- start start 2023-08-25T04:04:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e438f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67c8003980 0x7f67dc0c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e438f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67dc0c6de0 0x7f67dc15e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e438f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc14ef40 0x7f67dc14f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e438f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0c6530 con 0x7f67dc0c6de0 2023-08-25T04:04:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e438f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0b3700 con 0x7f67dc14ef40 2023-08-25T04:04:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e438f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0c7330 con 0x7f67c8003980 2023-08-25T04:04:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e192a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67dc0c6de0 0x7f67dc15e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e192a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67dc0c6de0 0x7f67dc15e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40790/0 (socket says 172.21.15.55:40790) 2023-08-25T04:04:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e192a640 1 -- 172.21.15.55:0/3300197028 learned_addr learned my addr 172.21.15.55:0/3300197028 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e212b640 1 --2- 172.21.15.55:0/3300197028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67c8003980 0x7f67dc0c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e292c640 1 --2- 172.21.15.55:0/3300197028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc14ef40 0x7f67dc14f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e192a640 1 -- 172.21.15.55:0/3300197028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67c8003980 msgr2=0x7f67dc0c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e192a640 1 --2- 172.21.15.55:0/3300197028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67c8003980 0x7f67dc0c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e192a640 1 -- 172.21.15.55:0/3300197028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc14ef40 msgr2=0x7f67dc14f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e192a640 1 --2- 172.21.15.55:0/3300197028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc14ef40 0x7f67dc14f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e192a640 1 -- 172.21.15.55:0/3300197028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc0c7610 con 0x7f67dc0c6de0 2023-08-25T04:04:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e212b640 1 --2- 172.21.15.55:0/3300197028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67c8003980 0x7f67dc0c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e292c640 1 --2- 172.21.15.55:0/3300197028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc14ef40 0x7f67dc14f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e192a640 1 --2- 172.21.15.55:0/3300197028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67dc0c6de0 0x7f67dc15e020 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00e780 tx=0x7f67cc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67d2ffd640 1 -- 172.21.15.55:0/3300197028 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc00c6c0 con 0x7f67dc0c6de0 2023-08-25T04:04:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67d2ffd640 1 -- 172.21.15.55:0/3300197028 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67cc00c820 con 0x7f67dc0c6de0 2023-08-25T04:04:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67d2ffd640 1 -- 172.21.15.55:0/3300197028 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc00cb90 con 0x7f67dc0c6de0 2023-08-25T04:04:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e438f640 1 -- 172.21.15.55:0/3300197028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67dc0c78f0 con 0x7f67dc0c6de0 2023-08-25T04:04:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e438f640 1 -- 172.21.15.55:0/3300197028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67dc0c7eb0 con 0x7f67dc0c6de0 2023-08-25T04:04:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.850+0000 7f67e438f640 1 -- 172.21.15.55:0/3300197028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67dc1540d0 con 0x7f67dc0c6de0 2023-08-25T04:04:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.854+0000 7f67d2ffd640 1 -- 172.21.15.55:0/3300197028 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85138+0+0 (secure 0 0 0) 0x7f67cc00ccf0 con 0x7f67dc0c6de0 2023-08-25T04:04:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.854+0000 7f67d2ffd640 1 --2- 172.21.15.55:0/3300197028 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f67c00658b0 0x7f67c0067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.854+0000 7f67d2ffd640 1 -- 172.21.15.55:0/3300197028 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f67cc083220 con 0x7f67dc0c6de0 2023-08-25T04:04:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.854+0000 7f67e212b640 1 --2- 172.21.15.55:0/3300197028 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f67c00658b0 0x7f67c0067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.854+0000 7f67e212b640 1 --2- 172.21.15.55:0/3300197028 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f67c00658b0 0x7f67c0067d70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f67d8001750 tx=0x7f67d80011a0 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:24.858+0000 7f67d2ffd640 1 -- 172.21.15.55:0/3300197028 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f67cc0508e0 con 0x7f67dc0c6de0 2023-08-25T04:04:25.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.034+0000 7f67e438f640 1 -- 172.21.15.55:0/3300197028 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f67dc0cd770 con 0x7f67c00658b0 2023-08-25T04:04:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.082+0000 7f67d2ffd640 1 -- 172.21.15.55:0/3300197028 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f67d80051d0 con 0x7f67c00658b0 2023-08-25T04:04:25.087 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-08-25T04:04:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.086+0000 7f67e438f640 1 -- 172.21.15.55:0/3300197028 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f67c00658b0 msgr2=0x7f67c0067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.086+0000 7f67e438f640 1 --2- 172.21.15.55:0/3300197028 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f67c00658b0 0x7f67c0067d70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f67d8001750 tx=0x7f67d80011a0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.086+0000 7f67e438f640 1 -- 172.21.15.55:0/3300197028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67dc0c6de0 msgr2=0x7f67dc15e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.086+0000 7f67e438f640 1 --2- 172.21.15.55:0/3300197028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67dc0c6de0 0x7f67dc15e020 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f67cc00e780 tx=0x7f67cc00eb80 comp rx=0 tx=0).stop 2023-08-25T04:04:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.086+0000 7f67e438f640 1 -- 172.21.15.55:0/3300197028 shutdown_connections 2023-08-25T04:04:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.086+0000 7f67e438f640 1 --2- 172.21.15.55:0/3300197028 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f67c00658b0 0x7f67c0067d70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.086+0000 7f67e438f640 1 --2- 172.21.15.55:0/3300197028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc14ef40 0x7f67dc14f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.086+0000 7f67e438f640 1 --2- 172.21.15.55:0/3300197028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67dc0c6de0 0x7f67dc15e020 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.086+0000 7f67e438f640 1 --2- 172.21.15.55:0/3300197028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67c8003980 0x7f67dc0c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.086+0000 7f67e438f640 1 -- 172.21.15.55:0/3300197028 >> 172.21.15.55:0/3300197028 conn(0x7f67dc0caf90 msgr2=0x7f67dc0c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.086+0000 7f67e438f640 1 -- 172.21.15.55:0/3300197028 shutdown_connections 2023-08-25T04:04:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.086+0000 7f67e438f640 1 -- 172.21.15.55:0/3300197028 wait complete. 2023-08-25T04:04:25.108 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-08-25T04:04:25.109 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-08-25T04:04:25.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.254+0000 7fbbc7782640 1 Processor -- start 2023-08-25T04:04:25.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.254+0000 7fbbc7782640 1 -- start start 2023-08-25T04:04:25.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.258+0000 7fbbc7782640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbbc01611f0 0x7fbbc01615d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:25.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.258+0000 7fbbc7782640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbbc00aff90 0x7fbbc00b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:25.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.258+0000 7fbbc7782640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc00c9440 con 0x7fbbc0165090 2023-08-25T04:04:25.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.258+0000 7fbbc7782640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc00ca0c0 con 0x7fbbc01611f0 2023-08-25T04:04:25.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.258+0000 7fbbc7782640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc00b0940 con 0x7fbbc00aff90 2023-08-25T04:04:25.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.258+0000 7fbbc551e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbbc01611f0 0x7fbbc01615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:25.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.258+0000 7fbbc4d1d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbbc0165090 0x7fbbc00c8b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45986/0 (socket says 172.21.15.55:45986) 2023-08-25T04:04:25.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.258+0000 7fbbc4d1d640 1 -- 172.21.15.55:0/367844291 learned_addr learned my addr 172.21.15.55:0/367844291 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:25.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.258+0000 7fbbc5d1f640 1 --2- 172.21.15.55:0/367844291 >> v2:172.21.15.110:3300/0 conn(0x7fbbc00aff90 0x7fbbc00b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:25.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.258+0000 7fbbc551e640 1 -- 172.21.15.55:0/367844291 >> v2:172.21.15.110:3300/0 conn(0x7fbbc00aff90 msgr2=0x7fbbc00b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:25.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.258+0000 7fbbc551e640 1 --2- 172.21.15.55:0/367844291 >> v2:172.21.15.110:3300/0 conn(0x7fbbc00aff90 0x7fbbc00b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.258+0000 7fbbc551e640 1 -- 172.21.15.55:0/367844291 >> v1:172.21.15.55:6789/0 conn(0x7fbbc0165090 legacy=0x7fbbc00c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:25.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.258+0000 7fbbc551e640 1 -- 172.21.15.55:0/367844291 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc00c9720 con 0x7fbbc01611f0 2023-08-25T04:04:25.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.258+0000 7fbbb7fff640 1 -- 172.21.15.55:0/367844291 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524277536 0 0) 0x7fbbc00c9440 con 0x7fbbc0165090 2023-08-25T04:04:25.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.258+0000 7fbbc5d1f640 1 --2- 172.21.15.55:0/367844291 >> v2:172.21.15.110:3300/0 conn(0x7fbbc00aff90 0x7fbbc00b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:04:25.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc551e640 1 --2- 172.21.15.55:0/367844291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbc01611f0 0x7fbbc01615d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0097f0 tx=0x7fbbbc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73a4d358c601f39 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:25.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbb7fff640 1 -- 172.21.15.55:0/367844291 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc004230 con 0x7fbbc01611f0 2023-08-25T04:04:25.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbb7fff640 1 -- 172.21.15.55:0/367844291 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc0a7050 con 0x7fbbc01611f0 2023-08-25T04:04:25.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbb7fff640 1 -- 172.21.15.55:0/367844291 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc003620 con 0x7fbbc01611f0 2023-08-25T04:04:25.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc7782640 1 -- 172.21.15.55:0/367844291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbc01611f0 msgr2=0x7fbbc01615d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:25.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc7782640 1 --2- 172.21.15.55:0/367844291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbc01611f0 0x7fbbc01615d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0097f0 tx=0x7fbbbc01c440 comp rx=0 tx=0).stop 2023-08-25T04:04:25.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc7782640 1 -- 172.21.15.55:0/367844291 shutdown_connections 2023-08-25T04:04:25.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc7782640 1 --2- 172.21.15.55:0/367844291 >> v2:172.21.15.110:3300/0 conn(0x7fbbc00aff90 0x7fbbc00b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc7782640 1 --2- 172.21.15.55:0/367844291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbc01611f0 0x7fbbc01615d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc7782640 1 -- 172.21.15.55:0/367844291 >> 172.21.15.55:0/367844291 conn(0x7fbbc00caf90 msgr2=0x7fbbc00cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:25.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc7782640 1 -- 172.21.15.55:0/367844291 shutdown_connections 2023-08-25T04:04:25.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc7782640 1 -- 172.21.15.55:0/367844291 wait complete. 2023-08-25T04:04:25.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc7782640 1 Processor -- start 2023-08-25T04:04:25.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc7782640 1 -- start start 2023-08-25T04:04:25.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc7782640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbc00aff90 0x7fbbc00c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:25.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc7782640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbc01611f0 0x7fbbc00c5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:25.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc7782640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbc0165090 0x7fbbc00c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:25.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc7782640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc01f9900 con 0x7fbbc01611f0 2023-08-25T04:04:25.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc7782640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc00c8480 con 0x7fbbc0165090 2023-08-25T04:04:25.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc7782640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc01632c0 con 0x7fbbc00aff90 2023-08-25T04:04:25.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc4d1d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbc01611f0 0x7fbbc00c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:25.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc4d1d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbc01611f0 0x7fbbc00c5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40818/0 (socket says 172.21.15.55:40818) 2023-08-25T04:04:25.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.262+0000 7fbbc4d1d640 1 -- 172.21.15.55:0/2567938137 learned_addr learned my addr 172.21.15.55:0/2567938137 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:25.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.266+0000 7fbbc551e640 1 --2- 172.21.15.55:0/2567938137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbc00aff90 0x7fbbc00c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:25.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.266+0000 7fbbc5d1f640 1 --2- 172.21.15.55:0/2567938137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbc0165090 0x7fbbc00c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:25.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.266+0000 7fbbc4d1d640 1 -- 172.21.15.55:0/2567938137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbc00aff90 msgr2=0x7fbbc00c2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:25.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.266+0000 7fbbc4d1d640 1 --2- 172.21.15.55:0/2567938137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbc00aff90 0x7fbbc00c2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.266+0000 7fbbc4d1d640 1 -- 172.21.15.55:0/2567938137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbc0165090 msgr2=0x7fbbc00c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:25.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.266+0000 7fbbc4d1d640 1 --2- 172.21.15.55:0/2567938137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbc0165090 0x7fbbc00c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.266+0000 7fbbc4d1d640 1 -- 172.21.15.55:0/2567938137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbbc009420 con 0x7fbbc01611f0 2023-08-25T04:04:25.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.266+0000 7fbbc4d1d640 1 --2- 172.21.15.55:0/2567938137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbc01611f0 0x7fbbc00c5840 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00011f0 tx=0x7fbbb000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:25.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.266+0000 7fbbb5ffb640 1 -- 172.21.15.55:0/2567938137 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb00074e0 con 0x7fbbc01611f0 2023-08-25T04:04:25.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.266+0000 7fbbb5ffb640 1 -- 172.21.15.55:0/2567938137 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb0007640 con 0x7fbbc01611f0 2023-08-25T04:04:25.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.266+0000 7fbbb5ffb640 1 -- 172.21.15.55:0/2567938137 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0004a10 con 0x7fbbc01611f0 2023-08-25T04:04:25.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.266+0000 7fbbc7782640 1 -- 172.21.15.55:0/2567938137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc00c6620 con 0x7fbbc01611f0 2023-08-25T04:04:25.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.266+0000 7fbbc7782640 1 -- 172.21.15.55:0/2567938137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc00c62c0 con 0x7fbbc01611f0 2023-08-25T04:04:25.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.266+0000 7fbbc7782640 1 -- 172.21.15.55:0/2567938137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc004dbe0 con 0x7fbbc01611f0 2023-08-25T04:04:25.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.266+0000 7fbbb5ffb640 1 -- 172.21.15.55:0/2567938137 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85138+0+0 (secure 0 0 0) 0x7fbbb0004b70 con 0x7fbbc01611f0 2023-08-25T04:04:25.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.266+0000 7fbbb5ffb640 1 --2- 172.21.15.55:0/2567938137 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fbba4065880 0x7fbba4067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:25.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.266+0000 7fbbb5ffb640 1 -- 172.21.15.55:0/2567938137 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fbbb00824a0 con 0x7fbbc01611f0 2023-08-25T04:04:25.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.266+0000 7fbbc551e640 1 --2- 172.21.15.55:0/2567938137 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fbba4065880 0x7fbba4067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:25.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.270+0000 7fbbc551e640 1 --2- 172.21.15.55:0/2567938137 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fbba4065880 0x7fbba4067d40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0ad000 tx=0x7fbbbc0a6000 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:25.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.270+0000 7fbbb5ffb640 1 -- 172.21.15.55:0/2567938137 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbbb004fcc0 con 0x7fbbc01611f0 2023-08-25T04:04:25.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.450+0000 7fbbc7782640 1 -- 172.21.15.55:0/2567938137 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbc0163400 con 0x7fbba4065880 2023-08-25T04:04:25.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.498+0000 7fbbb5ffb640 1 -- 172.21.15.55:0/2567938137 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fbbc0163400 con 0x7fbba4065880 2023-08-25T04:04:25.502 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-08-25T04:04:25.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.502+0000 7fbbc7782640 1 -- 172.21.15.55:0/2567938137 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fbba4065880 msgr2=0x7fbba4067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:25.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.502+0000 7fbbc7782640 1 --2- 172.21.15.55:0/2567938137 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fbba4065880 0x7fbba4067d40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0ad000 tx=0x7fbbbc0a6000 comp rx=0 tx=0).stop 2023-08-25T04:04:25.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.502+0000 7fbbc7782640 1 -- 172.21.15.55:0/2567938137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbc01611f0 msgr2=0x7fbbc00c5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:25.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.502+0000 7fbbc7782640 1 --2- 172.21.15.55:0/2567938137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbc01611f0 0x7fbbc00c5840 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00011f0 tx=0x7fbbb000c9b0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.502+0000 7fbbc7782640 1 -- 172.21.15.55:0/2567938137 shutdown_connections 2023-08-25T04:04:25.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.502+0000 7fbbc7782640 1 --2- 172.21.15.55:0/2567938137 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fbba4065880 0x7fbba4067d40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.502+0000 7fbbc7782640 1 --2- 172.21.15.55:0/2567938137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbbc0165090 0x7fbbc00c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.502+0000 7fbbc7782640 1 --2- 172.21.15.55:0/2567938137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbc01611f0 0x7fbbc00c5840 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.502+0000 7fbbc7782640 1 --2- 172.21.15.55:0/2567938137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbbc00aff90 0x7fbbc00c2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.502+0000 7fbbc7782640 1 -- 172.21.15.55:0/2567938137 >> 172.21.15.55:0/2567938137 conn(0x7fbbc00caf90 msgr2=0x7fbbc00714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:25.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.502+0000 7fbbc7782640 1 -- 172.21.15.55:0/2567938137 shutdown_connections 2023-08-25T04:04:25.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.502+0000 7fbbc7782640 1 -- 172.21.15.55:0/2567938137 wait complete. 2023-08-25T04:04:25.523 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-08-25T04:04:25.524 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-08-25T04:04:25.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.670+0000 7fe740e9e640 1 Processor -- start 2023-08-25T04:04:25.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.670+0000 7fe740e9e640 1 -- start start 2023-08-25T04:04:25.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.670+0000 7fe740e9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe73c0cd870 0x7fe73c0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:25.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.670+0000 7fe740e9e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe73c0cf9b0 0x7fe73c0ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:25.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.670+0000 7fe740e9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73c0cae70 con 0x7fe73c0afa20 2023-08-25T04:04:25.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.670+0000 7fe740e9e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73c0cfe10 con 0x7fe73c0cf9b0 2023-08-25T04:04:25.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.670+0000 7fe740e9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c0cb0e0 con 0x7fe73c0cd870 2023-08-25T04:04:25.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.670+0000 7fe73a59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe73c0afa20 0x7fe73c0cd160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45994/0 (socket says 172.21.15.55:45994) 2023-08-25T04:04:25.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.670+0000 7fe73a59c640 1 -- 172.21.15.55:0/1617691688 learned_addr learned my addr 172.21.15.55:0/1617691688 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:04:25.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe733fff640 1 --2- 172.21.15.55:0/1617691688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe73c0cd870 0x7fe73c0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:25.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe73ad9d640 1 --2- 172.21.15.55:0/1617691688 >> v2:172.21.15.110:3300/0 conn(0x7fe73c0cf9b0 0x7fe73c0ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:25.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe739d9b640 1 -- 172.21.15.55:0/1617691688 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668343326 0 0) 0x7fe73c0cae70 con 0x7fe73c0afa20 2023-08-25T04:04:25.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe739d9b640 1 -- 172.21.15.55:0/1617691688 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe728003530 con 0x7fe73c0afa20 2023-08-25T04:04:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe739d9b640 1 -- 172.21.15.55:0/1617691688 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3376622583 0 0) 0x7fe728003530 con 0x7fe73c0afa20 2023-08-25T04:04:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe739d9b640 1 -- 172.21.15.55:0/1617691688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe73c0cd870 msgr2=0x7fe73c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe739d9b640 1 --2- 172.21.15.55:0/1617691688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe73c0cd870 0x7fe73c0b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe739d9b640 1 -- 172.21.15.55:0/1617691688 >> v2:172.21.15.110:3300/0 conn(0x7fe73c0cf9b0 msgr2=0x7fe73c0ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe739d9b640 1 --2- 172.21.15.55:0/1617691688 >> v2:172.21.15.110:3300/0 conn(0x7fe73c0cf9b0 0x7fe73c0ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe739d9b640 1 -- 172.21.15.55:0/1617691688 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c0cb3c0 con 0x7fe73c0afa20 2023-08-25T04:04:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe739d9b640 1 -- 172.21.15.55:0/1617691688 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fe72c001680 con 0x7fe73c0afa20 2023-08-25T04:04:25.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe739d9b640 1 -- 172.21.15.55:0/1617691688 >> v1:172.21.15.55:6789/0 conn(0x7fe73c0afa20 legacy=0x7fe73c0cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:25.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe739d9b640 1 --2- 172.21.15.55:0/1617691688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe728003980 0x7fe728003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:25.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe739d9b640 1 --2- 172.21.15.55:0/1617691688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7280047d0 0x7fe728004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:25.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe739d9b640 1 --2- 172.21.15.55:0/1617691688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe73c0cd870 0x7fe728005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:25.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe739d9b640 1 -- 172.21.15.55:0/1617691688 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c0cfe10 con 0x7fe728003980 2023-08-25T04:04:25.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe739d9b640 1 -- 172.21.15.55:0/1617691688 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c0cb0e0 con 0x7fe7280047d0 2023-08-25T04:04:25.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe739d9b640 1 -- 172.21.15.55:0/1617691688 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72800b990 con 0x7fe73c0cd870 2023-08-25T04:04:25.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe73a59c640 1 --2- 172.21.15.55:0/1617691688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe728003980 0x7fe728003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:25.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe733fff640 1 --2- 172.21.15.55:0/1617691688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7280047d0 0x7fe728004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:25.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe73ad9d640 1 --2- 172.21.15.55:0/1617691688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe73c0cd870 0x7fe728005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:25.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe73a59c640 1 -- 172.21.15.55:0/1617691688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe73c0cd870 msgr2=0x7fe728005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:25.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe73a59c640 1 --2- 172.21.15.55:0/1617691688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe73c0cd870 0x7fe728005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe73a59c640 1 -- 172.21.15.55:0/1617691688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7280047d0 msgr2=0x7fe728004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:04:25.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe73a59c640 1 --2- 172.21.15.55:0/1617691688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7280047d0 0x7fe728004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe73a59c640 1 -- 172.21.15.55:0/1617691688 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe728003530 con 0x7fe728003980 2023-08-25T04:04:25.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.674+0000 7fe733fff640 1 --2- 172.21.15.55:0/1617691688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7280047d0 0x7fe728004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:04:25.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.678+0000 7fe73a59c640 1 --2- 172.21.15.55:0/1617691688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe728003980 0x7fe728003da0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00c270 tx=0x7fe72c01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62ff77e1586c2ac server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:25.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.678+0000 7fe739d9b640 1 -- 172.21.15.55:0/1617691688 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0058e0 con 0x7fe728003980 2023-08-25T04:04:25.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.678+0000 7fe739d9b640 1 -- 172.21.15.55:0/1617691688 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c005a40 con 0x7fe728003980 2023-08-25T04:04:25.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.678+0000 7fe739d9b640 1 -- 172.21.15.55:0/1617691688 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c005e30 con 0x7fe728003980 2023-08-25T04:04:25.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.678+0000 7fe740e9e640 1 -- 172.21.15.55:0/1617691688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe728003980 msgr2=0x7fe728003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:25.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.678+0000 7fe740e9e640 1 --2- 172.21.15.55:0/1617691688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe728003980 0x7fe728003da0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00c270 tx=0x7fe72c01cc30 comp rx=0 tx=0).stop 2023-08-25T04:04:25.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.678+0000 7fe73ad9d640 1 -- 172.21.15.55:0/1617691688 reap_dead start 2023-08-25T04:04:25.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.678+0000 7fe740e9e640 1 -- 172.21.15.55:0/1617691688 shutdown_connections 2023-08-25T04:04:25.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.678+0000 7fe740e9e640 1 -- 172.21.15.55:0/1617691688 >> 172.21.15.55:0/1617691688 conn(0x7fe73c0d0780 msgr2=0x7fe73c0d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:25.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.678+0000 7fe740e9e640 1 -- 172.21.15.55:0/1617691688 shutdown_connections 2023-08-25T04:04:25.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.678+0000 7fe740e9e640 1 -- 172.21.15.55:0/1617691688 wait complete. 2023-08-25T04:04:25.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.678+0000 7fe740e9e640 1 Processor -- start 2023-08-25T04:04:25.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.678+0000 7fe740e9e640 1 -- start start 2023-08-25T04:04:25.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe740e9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe728003980 0x7fe73c1f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:25.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe740e9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe73c0aefb0 0x7fe73c0c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:25.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe740e9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe73c0c4f10 0x7fe73c0c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:25.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe740e9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c0aec80 con 0x7fe728003980 2023-08-25T04:04:25.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe740e9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c0add60 con 0x7fe73c0aefb0 2023-08-25T04:04:25.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe740e9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c0ae000 con 0x7fe73c0c4f10 2023-08-25T04:04:25.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe73a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe728003980 0x7fe73c1f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:25.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe73a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe728003980 0x7fe73c1f4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40822/0 (socket says 172.21.15.55:40822) 2023-08-25T04:04:25.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe73a59c640 1 -- 172.21.15.55:0/1743345743 learned_addr learned my addr 172.21.15.55:0/1743345743 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:04:25.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe73ad9d640 1 --2- 172.21.15.55:0/1743345743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe73c0c4f10 0x7fe73c0c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:25.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe733fff640 1 --2- 172.21.15.55:0/1743345743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe73c0aefb0 0x7fe73c0c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:25.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe73a59c640 1 -- 172.21.15.55:0/1743345743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe73c0c4f10 msgr2=0x7fe73c0c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:25.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe73a59c640 1 --2- 172.21.15.55:0/1743345743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe73c0c4f10 0x7fe73c0c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe73a59c640 1 -- 172.21.15.55:0/1743345743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe73c0aefb0 msgr2=0x7fe73c0c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:25.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe73a59c640 1 --2- 172.21.15.55:0/1743345743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe73c0aefb0 0x7fe73c0c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe73a59c640 1 -- 172.21.15.55:0/1743345743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c0ae2e0 con 0x7fe728003980 2023-08-25T04:04:25.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe73a59c640 1 --2- 172.21.15.55:0/1743345743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe728003980 0x7fe73c1f4cf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00c270 tx=0x7fe728005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:25.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe732ffd640 1 -- 172.21.15.55:0/1743345743 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0047f0 con 0x7fe728003980 2023-08-25T04:04:25.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe732ffd640 1 -- 172.21.15.55:0/1743345743 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c004950 con 0x7fe728003980 2023-08-25T04:04:25.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe740e9e640 1 -- 172.21.15.55:0/1743345743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73c0ae5c0 con 0x7fe728003980 2023-08-25T04:04:25.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe732ffd640 1 -- 172.21.15.55:0/1743345743 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c004ce0 con 0x7fe728003980 2023-08-25T04:04:25.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe740e9e640 1 -- 172.21.15.55:0/1743345743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73c1f8840 con 0x7fe728003980 2023-08-25T04:04:25.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe740e9e640 1 -- 172.21.15.55:0/1743345743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73c159c40 con 0x7fe728003980 2023-08-25T04:04:25.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.682+0000 7fe732ffd640 1 -- 172.21.15.55:0/1743345743 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 10) v1 ==== 85138+0+0 (secure 0 0 0) 0x7fe72c0a5740 con 0x7fe728003980 2023-08-25T04:04:25.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.686+0000 7fe732ffd640 1 --2- 172.21.15.55:0/1743345743 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fe71c065880 0x7fe71c067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:04:25.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.686+0000 7fe732ffd640 1 -- 172.21.15.55:0/1743345743 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fe72c11ccf0 con 0x7fe728003980 2023-08-25T04:04:25.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.686+0000 7fe733fff640 1 --2- 172.21.15.55:0/1743345743 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fe71c065880 0x7fe71c067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:04:25.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.686+0000 7fe733fff640 1 --2- 172.21.15.55:0/1743345743 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fe71c065880 0x7fe71c067d40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe73c164380 tx=0x7fe724008040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:04:25.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.690+0000 7fe732ffd640 1 -- 172.21.15.55:0/1743345743 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe72c0ea3b0 con 0x7fe728003980 2023-08-25T04:04:25.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.866+0000 7fe740e9e640 1 -- 172.21.15.55:0/1743345743 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe73c0cdeb0 con 0x7fe71c065880 2023-08-25T04:04:25.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.922+0000 7fe732ffd640 1 -- 172.21.15.55:0/1743345743 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fe724009c40 con 0x7fe71c065880 2023-08-25T04:04:25.924 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-08-25T04:04:25.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.922+0000 7fe740e9e640 1 -- 172.21.15.55:0/1743345743 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fe71c065880 msgr2=0x7fe71c067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:25.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.922+0000 7fe740e9e640 1 --2- 172.21.15.55:0/1743345743 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fe71c065880 0x7fe71c067d40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe73c164380 tx=0x7fe724008040 comp rx=0 tx=0).stop 2023-08-25T04:04:25.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.922+0000 7fe740e9e640 1 -- 172.21.15.55:0/1743345743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe728003980 msgr2=0x7fe73c1f4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:04:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.922+0000 7fe740e9e640 1 --2- 172.21.15.55:0/1743345743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe728003980 0x7fe73c1f4cf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00c270 tx=0x7fe728005800 comp rx=0 tx=0).stop 2023-08-25T04:04:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.922+0000 7fe740e9e640 1 -- 172.21.15.55:0/1743345743 shutdown_connections 2023-08-25T04:04:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.922+0000 7fe740e9e640 1 --2- 172.21.15.55:0/1743345743 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fe71c065880 0x7fe71c067d40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.922+0000 7fe740e9e640 1 --2- 172.21.15.55:0/1743345743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe73c0c4f10 0x7fe73c0c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.922+0000 7fe740e9e640 1 --2- 172.21.15.55:0/1743345743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe73c0aefb0 0x7fe73c0c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.922+0000 7fe740e9e640 1 --2- 172.21.15.55:0/1743345743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe728003980 0x7fe73c1f4cf0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:04:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.922+0000 7fe740e9e640 1 -- 172.21.15.55:0/1743345743 >> 172.21.15.55:0/1743345743 conn(0x7fe73c0d0780 msgr2=0x7fe73c0d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:04:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.922+0000 7fe740e9e640 1 -- 172.21.15.55:0/1743345743 shutdown_connections 2023-08-25T04:04:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:04:25.922+0000 7fe740e9e640 1 -- 172.21.15.55:0/1743345743 wait complete. 2023-08-25T04:04:25.945 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-08-25T04:04:27.054 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:04:27.065 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:04:57.144 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:04:57.148 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:05:00.100 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:05:00.097+0000 7ff568226640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:05:00.101 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:05:00.097+0000 7ff568226640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:05:00.101 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:05:00.097+0000 7ff568226640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:05:00.101 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:05:00.097+0000 7ff568226640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:05:00.101 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:05:00.097+0000 7ff568226640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:05:27.283 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:05:27.287 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:05:57.356 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:05:57.361 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:06:27.415 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:06:27.419 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:06:57.470 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:06:57.474 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:07:27.804 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:07:27.809 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:07:57.859 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:07:57.863 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:08:27.928 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:08:27.932 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:08:58.073 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:08:58.078 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:09:28.378 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:09:28.383 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:09:58.434 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:09:58.438 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:10:28.493 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:10:28.498 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:10:58.567 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:10:58.572 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:11:00.348 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:11:00.346+0000 7ff56db31640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:11:00.348 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:11:00.346+0000 7ff56db31640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:11:00.350 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:11:00.346+0000 7ff56db31640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:11:00.350 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:11:00.346+0000 7ff56db31640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:11:00.350 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:11:00.346+0000 7ff56db31640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:11:28.629 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:11:28.635 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:11:58.695 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:11:58.699 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:12:28.751 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:12:28.756 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:12:58.864 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:12:58.869 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:13:29.221 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:13:29.225 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:13:59.287 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:13:59.291 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:14:29.343 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:14:29.348 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:14:59.398 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:14:59.403 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:15:19.947 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-08-25T04:15:20.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.106+0000 7fdc26b3a640 1 Processor -- start 2023-08-25T04:15:20.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc26b3a640 1 -- start start 2023-08-25T04:15:20.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc26b3a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc20155740 0x7fdc2015c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc26b3a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2015fa50 con 0x7fdc20155360 2023-08-25T04:15:20.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc26b3a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2015f490 con 0x7fdc2006fb50 2023-08-25T04:15:20.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc26b3a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2015f2a0 con 0x7fdc20155740 2023-08-25T04:15:20.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc248d6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdc20155360 0x7fdc2015eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57938/0 (socket says 172.21.15.55:57938) 2023-08-25T04:15:20.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc248d6640 1 -- 172.21.15.55:0/3726265211 learned_addr learned my addr 172.21.15.55:0/3726265211 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:20.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc1ffff640 1 --2- 172.21.15.55:0/3726265211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc20155740 0x7fdc2015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:20.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc1f7fe640 1 -- 172.21.15.55:0/3726265211 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190490827 0 0) 0x7fdc2015fa50 con 0x7fdc20155360 2023-08-25T04:15:20.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc1f7fe640 1 -- 172.21.15.55:0/3726265211 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc10003530 con 0x7fdc20155360 2023-08-25T04:15:20.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc1f7fe640 1 -- 172.21.15.55:0/3726265211 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4047336669 0 0) 0x7fdc10003530 con 0x7fdc20155360 2023-08-25T04:15:20.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc1f7fe640 1 -- 172.21.15.55:0/3726265211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc20155740 msgr2=0x7fdc2015c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:20.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc1f7fe640 1 --2- 172.21.15.55:0/3726265211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc20155740 0x7fdc2015c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc1f7fe640 1 -- 172.21.15.55:0/3726265211 >> v1:172.21.15.110:6789/0 conn(0x7fdc2006fb50 legacy=0x7fdc200aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:20.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc1f7fe640 1 -- 172.21.15.55:0/3726265211 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2015f770 con 0x7fdc20155360 2023-08-25T04:15:20.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc1f7fe640 1 -- 172.21.15.55:0/3726265211 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fdc14001680 con 0x7fdc20155360 2023-08-25T04:15:20.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc1f7fe640 1 -- 172.21.15.55:0/3726265211 >> v1:172.21.15.55:6789/0 conn(0x7fdc20155360 legacy=0x7fdc2015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:20.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc1f7fe640 1 --2- 172.21.15.55:0/3726265211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc20155740 0x7fdc100039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc1f7fe640 1 --2- 172.21.15.55:0/3726265211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc10003ef0 0x7fdc100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc1f7fe640 1 --2- 172.21.15.55:0/3726265211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc10004d10 0x7fdc10005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc1f7fe640 1 -- 172.21.15.55:0/3726265211 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1000bb20 con 0x7fdc10003ef0 2023-08-25T04:15:20.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc1f7fe640 1 -- 172.21.15.55:0/3726265211 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1000bc90 con 0x7fdc10004d10 2023-08-25T04:15:20.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc1f7fe640 1 -- 172.21.15.55:0/3726265211 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1000be50 con 0x7fdc20155740 2023-08-25T04:15:20.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc248d6640 1 --2- 172.21.15.55:0/3726265211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc20155740 0x7fdc100039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:20.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc1ffff640 1 --2- 172.21.15.55:0/3726265211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc10003ef0 0x7fdc100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:20.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc250d7640 1 --2- 172.21.15.55:0/3726265211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc10004d10 0x7fdc10005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:20.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc248d6640 1 -- 172.21.15.55:0/3726265211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc10004d10 msgr2=0x7fdc10005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:20.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc248d6640 1 --2- 172.21.15.55:0/3726265211 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc10004d10 0x7fdc10005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc248d6640 1 -- 172.21.15.55:0/3726265211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc10003ef0 msgr2=0x7fdc100047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:20.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc248d6640 1 --2- 172.21.15.55:0/3726265211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc10003ef0 0x7fdc100047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc248d6640 1 -- 172.21.15.55:0/3726265211 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc10003530 con 0x7fdc20155740 2023-08-25T04:15:20.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.110+0000 7fdc1ffff640 1 --2- 172.21.15.55:0/3726265211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc10003ef0 0x7fdc100047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:15:20.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.114+0000 7fdc248d6640 1 --2- 172.21.15.55:0/3726265211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc20155740 0x7fdc100039b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400c210 tx=0x7fdc1401cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e707fb09ddd3f83 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:20.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.114+0000 7fdc1f7fe640 1 -- 172.21.15.55:0/3726265211 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14005ae0 con 0x7fdc20155740 2023-08-25T04:15:20.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.114+0000 7fdc1f7fe640 1 -- 172.21.15.55:0/3726265211 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc14005c60 con 0x7fdc20155740 2023-08-25T04:15:20.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.114+0000 7fdc1f7fe640 1 -- 172.21.15.55:0/3726265211 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc140a5a70 con 0x7fdc20155740 2023-08-25T04:15:20.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.114+0000 7fdc26b3a640 1 -- 172.21.15.55:0/3726265211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc20155740 msgr2=0x7fdc100039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:20.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.114+0000 7fdc26b3a640 1 --2- 172.21.15.55:0/3726265211 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc20155740 0x7fdc100039b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400c210 tx=0x7fdc1401cc60 comp rx=0 tx=0).stop 2023-08-25T04:15:20.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.114+0000 7fdc250d7640 1 -- 172.21.15.55:0/3726265211 reap_dead start 2023-08-25T04:15:20.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.114+0000 7fdc26b3a640 1 -- 172.21.15.55:0/3726265211 shutdown_connections 2023-08-25T04:15:20.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.114+0000 7fdc26b3a640 1 -- 172.21.15.55:0/3726265211 >> 172.21.15.55:0/3726265211 conn(0x7fdc200caf90 msgr2=0x7fdc200cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:20.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.114+0000 7fdc26b3a640 1 -- 172.21.15.55:0/3726265211 shutdown_connections 2023-08-25T04:15:20.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.114+0000 7fdc26b3a640 1 -- 172.21.15.55:0/3726265211 wait complete. 2023-08-25T04:15:20.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc26b3a640 1 Processor -- start 2023-08-25T04:15:20.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc26b3a640 1 -- start start 2023-08-25T04:15:20.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc26b3a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc20155740 0x7fdc200c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc26b3a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc20154d20 0x7fdc20161240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc26b3a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc20161780 0x7fdc20156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc26b3a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc20161c00 con 0x7fdc20161780 2023-08-25T04:15:20.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc26b3a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc200c7cc0 con 0x7fdc20154d20 2023-08-25T04:15:20.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc26b3a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc200c7420 con 0x7fdc20155740 2023-08-25T04:15:20.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc250d7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc20161780 0x7fdc20156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:20.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc250d7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc20161780 0x7fdc20156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44962/0 (socket says 172.21.15.55:44962) 2023-08-25T04:15:20.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc250d7640 1 -- 172.21.15.55:0/2785191579 learned_addr learned my addr 172.21.15.55:0/2785191579 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc248d6640 1 --2- 172.21.15.55:0/2785191579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc20155740 0x7fdc200c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc1ffff640 1 --2- 172.21.15.55:0/2785191579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc20154d20 0x7fdc20161240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc250d7640 1 -- 172.21.15.55:0/2785191579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc20155740 msgr2=0x7fdc200c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc250d7640 1 --2- 172.21.15.55:0/2785191579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc20155740 0x7fdc200c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc250d7640 1 -- 172.21.15.55:0/2785191579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc20154d20 msgr2=0x7fdc20161240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc250d7640 1 --2- 172.21.15.55:0/2785191579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc20154d20 0x7fdc20161240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc250d7640 1 -- 172.21.15.55:0/2785191579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc200c7700 con 0x7fdc20161780 2023-08-25T04:15:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc250d7640 1 --2- 172.21.15.55:0/2785191579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc20161780 0x7fdc20156220 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdc200c8b10 tx=0x7fdc1800eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc1d7fa640 1 -- 172.21.15.55:0/2785191579 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18003980 con 0x7fdc20161780 2023-08-25T04:15:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc1d7fa640 1 -- 172.21.15.55:0/2785191579 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc18003ae0 con 0x7fdc20161780 2023-08-25T04:15:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc1d7fa640 1 -- 172.21.15.55:0/2785191579 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18003e90 con 0x7fdc20161780 2023-08-25T04:15:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc26b3a640 1 -- 172.21.15.55:0/2785191579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc200c79e0 con 0x7fdc20161780 2023-08-25T04:15:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.118+0000 7fdc26b3a640 1 -- 172.21.15.55:0/2785191579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc200c7040 con 0x7fdc20161780 2023-08-25T04:15:20.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.122+0000 7fdc26b3a640 1 -- 172.21.15.55:0/2785191579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2004dbe0 con 0x7fdc20161780 2023-08-25T04:15:20.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.122+0000 7fdc1d7fa640 1 -- 172.21.15.55:0/2785191579 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7fdc180050d0 con 0x7fdc20161780 2023-08-25T04:15:20.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.122+0000 7fdc1d7fa640 1 --2- 172.21.15.55:0/2785191579 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fdc040658b0 0x7fdc04067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.122+0000 7fdc1d7fa640 1 -- 172.21.15.55:0/2785191579 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fdc180830b0 con 0x7fdc20161780 2023-08-25T04:15:20.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.122+0000 7fdc248d6640 1 --2- 172.21.15.55:0/2785191579 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fdc040658b0 0x7fdc04067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:20.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.122+0000 7fdc248d6640 1 --2- 172.21.15.55:0/2785191579 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fdc040658b0 0x7fdc04067d70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdc140ab000 tx=0x7fdc140a7070 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:20.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.126+0000 7fdc1d7fa640 1 -- 172.21.15.55:0/2785191579 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fdc180507c0 con 0x7fdc20161780 2023-08-25T04:15:20.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.302+0000 7fdc26b3a640 1 -- 172.21.15.55:0/2785191579 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc200b06a0 con 0x7fdc040658b0 2023-08-25T04:15:20.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.374+0000 7fdc1d7fa640 1 -- 172.21.15.55:0/2785191579 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fdc140b5040 con 0x7fdc040658b0 2023-08-25T04:15:20.372 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-08-25T04:15:20.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.374+0000 7fdc26b3a640 1 -- 172.21.15.55:0/2785191579 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fdc040658b0 msgr2=0x7fdc04067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:20.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.374+0000 7fdc26b3a640 1 --2- 172.21.15.55:0/2785191579 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fdc040658b0 0x7fdc04067d70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdc140ab000 tx=0x7fdc140a7070 comp rx=0 tx=0).stop 2023-08-25T04:15:20.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.374+0000 7fdc26b3a640 1 -- 172.21.15.55:0/2785191579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc20161780 msgr2=0x7fdc20156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:20.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.374+0000 7fdc26b3a640 1 --2- 172.21.15.55:0/2785191579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc20161780 0x7fdc20156220 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdc200c8b10 tx=0x7fdc1800eb70 comp rx=0 tx=0).stop 2023-08-25T04:15:20.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.374+0000 7fdc26b3a640 1 -- 172.21.15.55:0/2785191579 shutdown_connections 2023-08-25T04:15:20.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.374+0000 7fdc26b3a640 1 --2- 172.21.15.55:0/2785191579 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fdc040658b0 0x7fdc04067d70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.374+0000 7fdc26b3a640 1 --2- 172.21.15.55:0/2785191579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc20161780 0x7fdc20156220 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.374+0000 7fdc26b3a640 1 --2- 172.21.15.55:0/2785191579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc20154d20 0x7fdc20161240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.374+0000 7fdc26b3a640 1 --2- 172.21.15.55:0/2785191579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc20155740 0x7fdc200c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.374+0000 7fdc26b3a640 1 -- 172.21.15.55:0/2785191579 >> 172.21.15.55:0/2785191579 conn(0x7fdc200caf90 msgr2=0x7fdc200c17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:20.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.374+0000 7fdc26b3a640 1 -- 172.21.15.55:0/2785191579 shutdown_connections 2023-08-25T04:15:20.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.374+0000 7fdc26b3a640 1 -- 172.21.15.55:0/2785191579 wait complete. 2023-08-25T04:15:20.393 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-08-25T04:15:20.394 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-08-25T04:15:20.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35db567640 1 Processor -- start 2023-08-25T04:15:20.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35db567640 1 -- start start 2023-08-25T04:15:20.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35db567640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f35d41611f0 0x7f35d41615d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35db567640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35d4165090 0x7f35d40c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35db567640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35d40aff90 0x7f35d40b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35db567640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d40ca0c0 con 0x7f35d4165090 2023-08-25T04:15:20.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35db567640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d40b0940 con 0x7f35d41611f0 2023-08-25T04:15:20.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35db567640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40c9440 con 0x7f35d40aff90 2023-08-25T04:15:20.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35d8b02640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35d4165090 0x7f35d40c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:20.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35d8b02640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35d4165090 0x7f35d40c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50106/0 (socket says 172.21.15.55:50106) 2023-08-25T04:15:20.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35d8b02640 1 -- 172.21.15.55:0/1929945134 learned_addr learned my addr 172.21.15.55:0/1929945134 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:20.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35d9303640 1 --2- 172.21.15.55:0/1929945134 >> v2:172.21.15.110:3300/0 conn(0x7f35d41611f0 0x7f35d41615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:20.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35d9b04640 1 --2- 172.21.15.55:0/1929945134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35d40aff90 0x7f35d40b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:20.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35d8b02640 1 -- 172.21.15.55:0/1929945134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35d40aff90 msgr2=0x7f35d40b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35d8b02640 1 --2- 172.21.15.55:0/1929945134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35d40aff90 0x7f35d40b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35d8b02640 1 -- 172.21.15.55:0/1929945134 >> v2:172.21.15.110:3300/0 conn(0x7f35d41611f0 msgr2=0x7f35d41615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35d8b02640 1 --2- 172.21.15.55:0/1929945134 >> v2:172.21.15.110:3300/0 conn(0x7f35d41611f0 0x7f35d41615d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35d8b02640 1 -- 172.21.15.55:0/1929945134 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d40c9720 con 0x7f35d4165090 2023-08-25T04:15:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35d9b04640 1 --2- 172.21.15.55:0/1929945134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35d40aff90 0x7f35d40b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:15:20.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.546+0000 7f35d9303640 1 --2- 172.21.15.55:0/1929945134 >> v2:172.21.15.110:3300/0 conn(0x7f35d41611f0 0x7f35d41615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:15:20.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.550+0000 7f35d8b02640 1 --2- 172.21.15.55:0/1929945134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d4165090 0x7f35d40c8b60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f35c40098a0 tx=0x7f35c401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233adba0cd674554 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:20.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.550+0000 7f35cbfff640 1 -- 172.21.15.55:0/1929945134 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c40a6040 con 0x7f35d4165090 2023-08-25T04:15:20.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.550+0000 7f35cbfff640 1 -- 172.21.15.55:0/1929945134 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c40aa600 con 0x7f35d4165090 2023-08-25T04:15:20.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.550+0000 7f35cbfff640 1 -- 172.21.15.55:0/1929945134 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c40aa990 con 0x7f35d4165090 2023-08-25T04:15:20.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.550+0000 7f35db567640 1 -- 172.21.15.55:0/1929945134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d4165090 msgr2=0x7f35d40c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:20.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.550+0000 7f35db567640 1 --2- 172.21.15.55:0/1929945134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d4165090 0x7f35d40c8b60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f35c40098a0 tx=0x7f35c401c4e0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.550+0000 7f35db567640 1 -- 172.21.15.55:0/1929945134 shutdown_connections 2023-08-25T04:15:20.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.550+0000 7f35db567640 1 --2- 172.21.15.55:0/1929945134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35d40aff90 0x7f35d40b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.550+0000 7f35db567640 1 --2- 172.21.15.55:0/1929945134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d4165090 0x7f35d40c8b60 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.550+0000 7f35db567640 1 --2- 172.21.15.55:0/1929945134 >> v2:172.21.15.110:3300/0 conn(0x7f35d41611f0 0x7f35d41615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.550+0000 7f35db567640 1 -- 172.21.15.55:0/1929945134 >> 172.21.15.55:0/1929945134 conn(0x7f35d40caf90 msgr2=0x7f35d40cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:20.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.550+0000 7f35db567640 1 -- 172.21.15.55:0/1929945134 shutdown_connections 2023-08-25T04:15:20.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.550+0000 7f35db567640 1 -- 172.21.15.55:0/1929945134 wait complete. 2023-08-25T04:15:20.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35db567640 1 Processor -- start 2023-08-25T04:15:20.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35db567640 1 -- start start 2023-08-25T04:15:20.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35db567640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35d40aff90 0x7f35d41630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35db567640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35d41611f0 0x7f35d415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35db567640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d4165090 0x7f35d41615d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35db567640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d4162050 con 0x7f35d4165090 2023-08-25T04:15:20.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35db567640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d4162330 con 0x7f35d40aff90 2023-08-25T04:15:20.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35db567640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d4162610 con 0x7f35d41611f0 2023-08-25T04:15:20.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35d9b04640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d4165090 0x7f35d41615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35d9b04640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d4165090 0x7f35d41615d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50114/0 (socket says 172.21.15.55:50114) 2023-08-25T04:15:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35d9b04640 1 -- 172.21.15.55:0/3492998602 learned_addr learned my addr 172.21.15.55:0/3492998602 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35d9b04640 1 -- 172.21.15.55:0/3492998602 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35d41611f0 msgr2=0x7f35d415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35d9b04640 1 --2- 172.21.15.55:0/3492998602 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35d41611f0 0x7f35d415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35d9b04640 1 -- 172.21.15.55:0/3492998602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35d40aff90 msgr2=0x7f35d41630f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:20.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35d9b04640 1 --2- 172.21.15.55:0/3492998602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35d40aff90 0x7f35d41630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35d9b04640 1 -- 172.21.15.55:0/3492998602 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c40094d0 con 0x7f35d4165090 2023-08-25T04:15:20.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35d9b04640 1 --2- 172.21.15.55:0/3492998602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d4165090 0x7f35d41615d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00cd10 tx=0x7f35cc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:20.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35c9ffb640 1 -- 172.21.15.55:0/3492998602 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc00f680 con 0x7f35d4165090 2023-08-25T04:15:20.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35c9ffb640 1 -- 172.21.15.55:0/3492998602 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc00f800 con 0x7f35d4165090 2023-08-25T04:15:20.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35db567640 1 -- 172.21.15.55:0/3492998602 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d41628f0 con 0x7f35d4165090 2023-08-25T04:15:20.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35c9ffb640 1 -- 172.21.15.55:0/3492998602 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc00fbb0 con 0x7f35d4165090 2023-08-25T04:15:20.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35db567640 1 -- 172.21.15.55:0/3492998602 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d4160e00 con 0x7f35d4165090 2023-08-25T04:15:20.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.554+0000 7f35db567640 1 -- 172.21.15.55:0/3492998602 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d404dbe0 con 0x7f35d4165090 2023-08-25T04:15:20.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.558+0000 7f35c9ffb640 1 -- 172.21.15.55:0/3492998602 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f35cc00b040 con 0x7f35d4165090 2023-08-25T04:15:20.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.558+0000 7f35c9ffb640 1 --2- 172.21.15.55:0/3492998602 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f35b8065880 0x7f35b8067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.558+0000 7f35c9ffb640 1 -- 172.21.15.55:0/3492998602 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f35cc083d40 con 0x7f35d4165090 2023-08-25T04:15:20.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.558+0000 7f35d9303640 1 --2- 172.21.15.55:0/3492998602 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f35b8065880 0x7f35b8067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:20.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.558+0000 7f35d9303640 1 --2- 172.21.15.55:0/3492998602 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f35b8065880 0x7f35b8067d40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f35d40cba80 tx=0x7f35d0008040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:20.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.562+0000 7f35c9ffb640 1 -- 172.21.15.55:0/3492998602 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f35cc051340 con 0x7f35d4165090 2023-08-25T04:15:20.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.738+0000 7f35db567640 1 -- 172.21.15.55:0/3492998602 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f35d406a110 con 0x7f35b8065880 2023-08-25T04:15:20.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.810+0000 7f35c9ffb640 1 -- 172.21.15.55:0/3492998602 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f35d000ae80 con 0x7f35b8065880 2023-08-25T04:15:20.808 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-08-25T04:15:20.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.810+0000 7f35db567640 1 -- 172.21.15.55:0/3492998602 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f35b8065880 msgr2=0x7f35b8067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.810+0000 7f35db567640 1 --2- 172.21.15.55:0/3492998602 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f35b8065880 0x7f35b8067d40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f35d40cba80 tx=0x7f35d0008040 comp rx=0 tx=0).stop 2023-08-25T04:15:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.810+0000 7f35db567640 1 -- 172.21.15.55:0/3492998602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d4165090 msgr2=0x7f35d41615d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.810+0000 7f35db567640 1 --2- 172.21.15.55:0/3492998602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d4165090 0x7f35d41615d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00cd10 tx=0x7f35cc00a650 comp rx=0 tx=0).stop 2023-08-25T04:15:20.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.810+0000 7f35db567640 1 -- 172.21.15.55:0/3492998602 shutdown_connections 2023-08-25T04:15:20.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.810+0000 7f35db567640 1 --2- 172.21.15.55:0/3492998602 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f35b8065880 0x7f35b8067d40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.810+0000 7f35db567640 1 --2- 172.21.15.55:0/3492998602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35d4165090 0x7f35d41615d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.810+0000 7f35db567640 1 --2- 172.21.15.55:0/3492998602 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35d41611f0 0x7f35d415aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.810+0000 7f35db567640 1 --2- 172.21.15.55:0/3492998602 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35d40aff90 0x7f35d41630f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.810+0000 7f35db567640 1 -- 172.21.15.55:0/3492998602 >> 172.21.15.55:0/3492998602 conn(0x7f35d40caf90 msgr2=0x7f35d40cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:20.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.810+0000 7f35db567640 1 -- 172.21.15.55:0/3492998602 shutdown_connections 2023-08-25T04:15:20.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.810+0000 7f35db567640 1 -- 172.21.15.55:0/3492998602 wait complete. 2023-08-25T04:15:20.829 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-08-25T04:15:20.829 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-08-25T04:15:20.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.978+0000 7fc06aaae640 1 Processor -- start 2023-08-25T04:15:20.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.978+0000 7fc06aaae640 1 -- start start 2023-08-25T04:15:20.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.982+0000 7fc06aaae640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc064160120 0x7fc0640b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.982+0000 7fc06aaae640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0640b1f20 con 0x7fc0640b4080 2023-08-25T04:15:20.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.982+0000 7fc06aaae640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0640d1320 con 0x7fc0640b33c0 2023-08-25T04:15:20.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.982+0000 7fc06aaae640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640cddf0 con 0x7fc064160120 2023-08-25T04:15:20.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.982+0000 7fc0692ab640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc0640b4080 0x7fc0640d0500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38840/0 (socket says 172.21.15.55:38840) 2023-08-25T04:15:20.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.982+0000 7fc0692ab640 1 -- 172.21.15.55:0/1732054167 learned_addr learned my addr 172.21.15.55:0/1732054167 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:20.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.982+0000 7fc069aac640 1 --2- 172.21.15.55:0/1732054167 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc064160120 0x7fc0640b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:20.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.982+0000 7fc068aaa640 1 -- 172.21.15.55:0/1732054167 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388758173 0 0) 0x7fc0640b1f20 con 0x7fc0640b4080 2023-08-25T04:15:20.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.982+0000 7fc068aaa640 1 -- 172.21.15.55:0/1732054167 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc050003530 con 0x7fc0640b4080 2023-08-25T04:15:20.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.982+0000 7fc068aaa640 1 -- 172.21.15.55:0/1732054167 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988394672 0 0) 0x7fc0640d1320 con 0x7fc0640b33c0 2023-08-25T04:15:20.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.982+0000 7fc068aaa640 1 -- 172.21.15.55:0/1732054167 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0640b1f20 con 0x7fc0640b33c0 2023-08-25T04:15:20.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.982+0000 7fc069aac640 1 -- 172.21.15.55:0/1732054167 >> v1:172.21.15.110:6789/0 conn(0x7fc0640b33c0 legacy=0x7fc0640d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:20.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.982+0000 7fc069aac640 1 -- 172.21.15.55:0/1732054167 >> v1:172.21.15.55:6789/0 conn(0x7fc0640b4080 legacy=0x7fc0640d0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:20.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.982+0000 7fc069aac640 1 -- 172.21.15.55:0/1732054167 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0640ce0d0 con 0x7fc064160120 2023-08-25T04:15:20.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.986+0000 7fc069aac640 1 --2- 172.21.15.55:0/1732054167 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc064160120 0x7fc0640b1480 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc060009800 tx=0x7fc06001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3989ef43b74fb3fa server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:20.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.986+0000 7fc068aaa640 1 -- 172.21.15.55:0/1732054167 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0600ab650 con 0x7fc064160120 2023-08-25T04:15:20.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.986+0000 7fc068aaa640 1 -- 172.21.15.55:0/1732054167 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0600ab7b0 con 0x7fc064160120 2023-08-25T04:15:20.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.986+0000 7fc068aaa640 1 -- 172.21.15.55:0/1732054167 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0600abb40 con 0x7fc064160120 2023-08-25T04:15:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.986+0000 7fc06aaae640 1 -- 172.21.15.55:0/1732054167 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc064160120 msgr2=0x7fc0640b1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.986+0000 7fc06aaae640 1 --2- 172.21.15.55:0/1732054167 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc064160120 0x7fc0640b1480 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc060009800 tx=0x7fc06001c450 comp rx=0 tx=0).stop 2023-08-25T04:15:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.986+0000 7fc06aaae640 1 -- 172.21.15.55:0/1732054167 shutdown_connections 2023-08-25T04:15:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.986+0000 7fc06aaae640 1 --2- 172.21.15.55:0/1732054167 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc064160120 0x7fc0640b1480 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.986+0000 7fc06aaae640 1 -- 172.21.15.55:0/1732054167 >> 172.21.15.55:0/1732054167 conn(0x7fc06409b950 msgr2=0x7fc0640d2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:20.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.986+0000 7fc06aaae640 1 -- 172.21.15.55:0/1732054167 shutdown_connections 2023-08-25T04:15:20.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.986+0000 7fc06aaae640 1 -- 172.21.15.55:0/1732054167 wait complete. 2023-08-25T04:15:20.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.986+0000 7fc06aaae640 1 Processor -- start 2023-08-25T04:15:20.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.986+0000 7fc06aaae640 1 -- start start 2023-08-25T04:15:20.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc06aaae640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0640b33c0 0x7fc064158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc06aaae640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0640b4080 0x7fc0640b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc06aaae640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc064160120 0x7fc0640b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc06aaae640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc064158d60 con 0x7fc0640b33c0 2023-08-25T04:15:20.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc06aaae640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0641439e0 con 0x7fc0640b4080 2023-08-25T04:15:20.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc06aaae640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc064143c80 con 0x7fc064160120 2023-08-25T04:15:20.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc069aac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0640b33c0 0x7fc064158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:20.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc069aac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0640b33c0 0x7fc064158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50118/0 (socket says 172.21.15.55:50118) 2023-08-25T04:15:20.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc069aac640 1 -- 172.21.15.55:0/2967077137 learned_addr learned my addr 172.21.15.55:0/2967077137 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:20.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc069aac640 1 -- 172.21.15.55:0/2967077137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc064160120 msgr2=0x7fc0640b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc069aac640 1 --2- 172.21.15.55:0/2967077137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc064160120 0x7fc0640b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc069aac640 1 -- 172.21.15.55:0/2967077137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0640b4080 msgr2=0x7fc0640b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc069aac640 1 --2- 172.21.15.55:0/2967077137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0640b4080 0x7fc0640b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc069aac640 1 -- 172.21.15.55:0/2967077137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0600093b0 con 0x7fc0640b33c0 2023-08-25T04:15:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc069aac640 1 --2- 172.21.15.55:0/2967077137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0640b33c0 0x7fc064158820 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc0600ad040 tx=0x7fc0600191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc05a7fc640 1 -- 172.21.15.55:0/2967077137 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0600abd30 con 0x7fc0640b33c0 2023-08-25T04:15:20.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc05a7fc640 1 -- 172.21.15.55:0/2967077137 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0600059a0 con 0x7fc0640b33c0 2023-08-25T04:15:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc05a7fc640 1 -- 172.21.15.55:0/2967077137 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060005d50 con 0x7fc0640b33c0 2023-08-25T04:15:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc06aaae640 1 -- 172.21.15.55:0/2967077137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc064143f60 con 0x7fc0640b33c0 2023-08-25T04:15:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc06aaae640 1 -- 172.21.15.55:0/2967077137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc064144520 con 0x7fc0640b33c0 2023-08-25T04:15:20.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc06aaae640 1 -- 172.21.15.55:0/2967077137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc064144710 con 0x7fc0640b33c0 2023-08-25T04:15:20.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.990+0000 7fc05a7fc640 1 -- 172.21.15.55:0/2967077137 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7fc060006020 con 0x7fc0640b33c0 2023-08-25T04:15:20.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.994+0000 7fc05a7fc640 1 --2- 172.21.15.55:0/2967077137 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fc0480658b0 0x7fc048067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:20.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.994+0000 7fc05a7fc640 1 -- 172.21.15.55:0/2967077137 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fc06011d4f0 con 0x7fc0640b33c0 2023-08-25T04:15:20.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.994+0000 7fc0692ab640 1 --2- 172.21.15.55:0/2967077137 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fc0480658b0 0x7fc048067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:20.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.994+0000 7fc0692ab640 1 --2- 172.21.15.55:0/2967077137 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fc0480658b0 0x7fc048067d70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc054007fd0 tx=0x7fc054007960 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:20.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:20.998+0000 7fc05a7fc640 1 -- 172.21.15.55:0/2967077137 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc0600eab70 con 0x7fc0640b33c0 2023-08-25T04:15:21.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.170+0000 7fc06aaae640 1 -- 172.21.15.55:0/2967077137 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0640d3370 con 0x7fc0480658b0 2023-08-25T04:15:21.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.242+0000 7fc05a7fc640 1 -- 172.21.15.55:0/2967077137 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fc054001c50 con 0x7fc0480658b0 2023-08-25T04:15:21.243 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-08-25T04:15:21.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.246+0000 7fc06aaae640 1 -- 172.21.15.55:0/2967077137 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fc0480658b0 msgr2=0x7fc048067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:21.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.246+0000 7fc06aaae640 1 --2- 172.21.15.55:0/2967077137 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fc0480658b0 0x7fc048067d70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc054007fd0 tx=0x7fc054007960 comp rx=0 tx=0).stop 2023-08-25T04:15:21.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.246+0000 7fc06aaae640 1 -- 172.21.15.55:0/2967077137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0640b33c0 msgr2=0x7fc064158820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:21.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.246+0000 7fc06aaae640 1 --2- 172.21.15.55:0/2967077137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0640b33c0 0x7fc064158820 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc0600ad040 tx=0x7fc0600191f0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.246+0000 7fc06aaae640 1 -- 172.21.15.55:0/2967077137 shutdown_connections 2023-08-25T04:15:21.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.246+0000 7fc06aaae640 1 --2- 172.21.15.55:0/2967077137 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fc0480658b0 0x7fc048067d70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.246+0000 7fc06aaae640 1 --2- 172.21.15.55:0/2967077137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc064160120 0x7fc0640b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.246+0000 7fc06aaae640 1 --2- 172.21.15.55:0/2967077137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0640b4080 0x7fc0640b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.246+0000 7fc06aaae640 1 --2- 172.21.15.55:0/2967077137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0640b33c0 0x7fc064158820 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.246+0000 7fc06aaae640 1 -- 172.21.15.55:0/2967077137 >> 172.21.15.55:0/2967077137 conn(0x7fc06409b950 msgr2=0x7fc0640cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:21.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.246+0000 7fc06aaae640 1 -- 172.21.15.55:0/2967077137 shutdown_connections 2023-08-25T04:15:21.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.246+0000 7fc06aaae640 1 -- 172.21.15.55:0/2967077137 wait complete. 2023-08-25T04:15:21.263 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-08-25T04:15:21.264 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-08-25T04:15:21.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f14478ec640 1 Processor -- start 2023-08-25T04:15:21.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f14478ec640 1 -- start start 2023-08-25T04:15:21.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f14478ec640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f14400cf340 0x7f14400cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:21.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f14478ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14400b59f0 0x7f14400b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:21.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f14478ec640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14400d1970 con 0x7f144015cb40 2023-08-25T04:15:21.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f14478ec640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14400cfcf0 con 0x7f14400cf340 2023-08-25T04:15:21.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f14478ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14400d2790 con 0x7f14400b59f0 2023-08-25T04:15:21.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1445688640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f144015cb40 0x7f14400d2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38848/0 (socket says 172.21.15.55:38848) 2023-08-25T04:15:21.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1445688640 1 -- 172.21.15.55:0/941947304 learned_addr learned my addr 172.21.15.55:0/941947304 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:21.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1437fff640 1 -- 172.21.15.55:0/941947304 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991552452 0 0) 0x7f14400d1970 con 0x7f144015cb40 2023-08-25T04:15:21.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1444e87640 1 --2- 172.21.15.55:0/941947304 >> v2:172.21.15.110:3300/0 conn(0x7f14400cf340 0x7f14400cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:21.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1437fff640 1 -- 172.21.15.55:0/941947304 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f142c003530 con 0x7f144015cb40 2023-08-25T04:15:21.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1445e89640 1 --2- 172.21.15.55:0/941947304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14400b59f0 0x7f14400b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1437fff640 1 -- 172.21.15.55:0/941947304 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 509245678 0 0) 0x7f142c003530 con 0x7f144015cb40 2023-08-25T04:15:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1437fff640 1 -- 172.21.15.55:0/941947304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14400b59f0 msgr2=0x7f14400b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1437fff640 1 --2- 172.21.15.55:0/941947304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14400b59f0 0x7f14400b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1437fff640 1 -- 172.21.15.55:0/941947304 >> v2:172.21.15.110:3300/0 conn(0x7f14400cf340 msgr2=0x7f14400cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1437fff640 1 --2- 172.21.15.55:0/941947304 >> v2:172.21.15.110:3300/0 conn(0x7f14400cf340 0x7f14400cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1437fff640 1 -- 172.21.15.55:0/941947304 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14400d0d80 con 0x7f144015cb40 2023-08-25T04:15:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1437fff640 1 -- 172.21.15.55:0/941947304 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f143c001680 con 0x7f144015cb40 2023-08-25T04:15:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1437fff640 1 -- 172.21.15.55:0/941947304 >> v1:172.21.15.55:6789/0 conn(0x7f144015cb40 legacy=0x7f14400d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1437fff640 1 --2- 172.21.15.55:0/941947304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14400b59f0 0x7f142c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1437fff640 1 --2- 172.21.15.55:0/941947304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f142c003f00 0x7f142c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1437fff640 1 --2- 172.21.15.55:0/941947304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f142c004d10 0x7f142c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1437fff640 1 -- 172.21.15.55:0/941947304 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14400cfcf0 con 0x7f142c004d10 2023-08-25T04:15:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1437fff640 1 -- 172.21.15.55:0/941947304 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14400d2790 con 0x7f142c003f00 2023-08-25T04:15:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.414+0000 7f1437fff640 1 -- 172.21.15.55:0/941947304 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142c00b9c0 con 0x7f14400b59f0 2023-08-25T04:15:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.418+0000 7f1445e89640 1 --2- 172.21.15.55:0/941947304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f142c004d10 0x7f142c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.418+0000 7f1444e87640 1 --2- 172.21.15.55:0/941947304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f142c003f00 0x7f142c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.418+0000 7f1445688640 1 --2- 172.21.15.55:0/941947304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14400b59f0 0x7f142c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.418+0000 7f1445e89640 1 -- 172.21.15.55:0/941947304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14400b59f0 msgr2=0x7f142c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.418+0000 7f1445e89640 1 --2- 172.21.15.55:0/941947304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14400b59f0 0x7f142c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.418+0000 7f1445e89640 1 -- 172.21.15.55:0/941947304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f142c003f00 msgr2=0x7f142c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.418+0000 7f1445e89640 1 --2- 172.21.15.55:0/941947304 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f142c003f00 0x7f142c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.418+0000 7f1445e89640 1 -- 172.21.15.55:0/941947304 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c003530 con 0x7f142c004d10 2023-08-25T04:15:21.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.418+0000 7f1445688640 1 --2- 172.21.15.55:0/941947304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14400b59f0 0x7f142c003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:21.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.418+0000 7f1445e89640 1 --2- 172.21.15.55:0/941947304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f142c004d10 0x7f142c005190 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1438009fc0 tx=0x7f143801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e35beca1c66531 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:21.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.418+0000 7f1437fff640 1 -- 172.21.15.55:0/941947304 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14380a5c70 con 0x7f142c004d10 2023-08-25T04:15:21.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.418+0000 7f1437fff640 1 -- 172.21.15.55:0/941947304 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143800f040 con 0x7f142c004d10 2023-08-25T04:15:21.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.418+0000 7f1437fff640 1 -- 172.21.15.55:0/941947304 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14380ad440 con 0x7f142c004d10 2023-08-25T04:15:21.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f14478ec640 1 -- 172.21.15.55:0/941947304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f142c004d10 msgr2=0x7f142c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:21.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f14478ec640 1 --2- 172.21.15.55:0/941947304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f142c004d10 0x7f142c005190 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1438009fc0 tx=0x7f143801cc60 comp rx=0 tx=0).stop 2023-08-25T04:15:21.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f1445e89640 1 -- 172.21.15.55:0/941947304 reap_dead start 2023-08-25T04:15:21.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f14478ec640 1 -- 172.21.15.55:0/941947304 shutdown_connections 2023-08-25T04:15:21.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f14478ec640 1 -- 172.21.15.55:0/941947304 >> 172.21.15.55:0/941947304 conn(0x7f144006aae0 msgr2=0x7f144006aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:21.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f14478ec640 1 -- 172.21.15.55:0/941947304 shutdown_connections 2023-08-25T04:15:21.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f14478ec640 1 -- 172.21.15.55:0/941947304 wait complete. 2023-08-25T04:15:21.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f14478ec640 1 Processor -- start 2023-08-25T04:15:21.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f14478ec640 1 -- start start 2023-08-25T04:15:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f14478ec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f142c004d10 0x7f14401f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f14478ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1440157540 0x7f14401f1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f14478ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14401579c0 0x7f14401f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:21.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f14478ec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14400c74e0 con 0x7f1440157540 2023-08-25T04:15:21.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f14478ec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14400c7730 con 0x7f142c004d10 2023-08-25T04:15:21.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f14478ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14400c7a10 con 0x7f14401579c0 2023-08-25T04:15:21.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f1444e87640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1440157540 0x7f14401f1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:21.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f1444e87640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1440157540 0x7f14401f1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50132/0 (socket says 172.21.15.55:50132) 2023-08-25T04:15:21.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f1444e87640 1 -- 172.21.15.55:0/1231817439 learned_addr learned my addr 172.21.15.55:0/1231817439 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:21.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f1445e89640 1 --2- 172.21.15.55:0/1231817439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14401579c0 0x7f14401f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:21.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f1445688640 1 --2- 172.21.15.55:0/1231817439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f142c004d10 0x7f14401f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:21.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f1444e87640 1 -- 172.21.15.55:0/1231817439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14401579c0 msgr2=0x7f14401f1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:21.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.422+0000 7f1444e87640 1 --2- 172.21.15.55:0/1231817439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14401579c0 0x7f14401f1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.426+0000 7f1444e87640 1 -- 172.21.15.55:0/1231817439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f142c004d10 msgr2=0x7f14401f2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:21.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.426+0000 7f1444e87640 1 --2- 172.21.15.55:0/1231817439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f142c004d10 0x7f14401f2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.426+0000 7f1444e87640 1 -- 172.21.15.55:0/1231817439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14400c7cf0 con 0x7f1440157540 2023-08-25T04:15:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.426+0000 7f1444e87640 1 --2- 172.21.15.55:0/1231817439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1440157540 0x7f14401f1710 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f14300119d0 tx=0x7f1430011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.426+0000 7f1435ffb640 1 -- 172.21.15.55:0/1231817439 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143000fb50 con 0x7f1440157540 2023-08-25T04:15:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.426+0000 7f1435ffb640 1 -- 172.21.15.55:0/1231817439 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143000fcb0 con 0x7f1440157540 2023-08-25T04:15:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.426+0000 7f1435ffb640 1 -- 172.21.15.55:0/1231817439 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430014440 con 0x7f1440157540 2023-08-25T04:15:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.426+0000 7f14478ec640 1 -- 172.21.15.55:0/1231817439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14400c7fd0 con 0x7f1440157540 2023-08-25T04:15:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.426+0000 7f14478ec640 1 -- 172.21.15.55:0/1231817439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14401f4a90 con 0x7f1440157540 2023-08-25T04:15:21.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.426+0000 7f14478ec640 1 -- 172.21.15.55:0/1231817439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1440071f80 con 0x7f1440157540 2023-08-25T04:15:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.426+0000 7f1435ffb640 1 -- 172.21.15.55:0/1231817439 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f14300145a0 con 0x7f1440157540 2023-08-25T04:15:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.426+0000 7f1435ffb640 1 --2- 172.21.15.55:0/1231817439 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f14240658b0 0x7f1424067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.426+0000 7f1435ffb640 1 -- 172.21.15.55:0/1231817439 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f1430083a00 con 0x7f1440157540 2023-08-25T04:15:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.430+0000 7f1445688640 1 --2- 172.21.15.55:0/1231817439 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f14240658b0 0x7f1424067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.430+0000 7f1445688640 1 --2- 172.21.15.55:0/1231817439 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f14240658b0 0x7f1424067d70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1440072b60 tx=0x7f143c007040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:21.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.430+0000 7f1435ffb640 1 -- 172.21.15.55:0/1231817439 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1430051280 con 0x7f1440157540 2023-08-25T04:15:21.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.606+0000 7f14478ec640 1 -- 172.21.15.55:0/1231817439 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f14400d1040 con 0x7f14240658b0 2023-08-25T04:15:21.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.678+0000 7f1435ffb640 1 -- 172.21.15.55:0/1231817439 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f143c011e80 con 0x7f14240658b0 2023-08-25T04:15:21.679 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-08-25T04:15:21.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.682+0000 7f14478ec640 1 -- 172.21.15.55:0/1231817439 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f14240658b0 msgr2=0x7f1424067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:21.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.682+0000 7f14478ec640 1 --2- 172.21.15.55:0/1231817439 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f14240658b0 0x7f1424067d70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1440072b60 tx=0x7f143c007040 comp rx=0 tx=0).stop 2023-08-25T04:15:21.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.682+0000 7f14478ec640 1 -- 172.21.15.55:0/1231817439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1440157540 msgr2=0x7f14401f1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:21.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.682+0000 7f14478ec640 1 --2- 172.21.15.55:0/1231817439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1440157540 0x7f14401f1710 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f14300119d0 tx=0x7f1430011e90 comp rx=0 tx=0).stop 2023-08-25T04:15:21.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.682+0000 7f14478ec640 1 -- 172.21.15.55:0/1231817439 shutdown_connections 2023-08-25T04:15:21.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.682+0000 7f14478ec640 1 --2- 172.21.15.55:0/1231817439 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f14240658b0 0x7f1424067d70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.682+0000 7f14478ec640 1 --2- 172.21.15.55:0/1231817439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14401579c0 0x7f14401f1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.682+0000 7f14478ec640 1 --2- 172.21.15.55:0/1231817439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1440157540 0x7f14401f1710 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.682+0000 7f14478ec640 1 --2- 172.21.15.55:0/1231817439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f142c004d10 0x7f14401f2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.682+0000 7f14478ec640 1 -- 172.21.15.55:0/1231817439 >> 172.21.15.55:0/1231817439 conn(0x7f144006aae0 msgr2=0x7f14400ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:21.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.682+0000 7f14478ec640 1 -- 172.21.15.55:0/1231817439 shutdown_connections 2023-08-25T04:15:21.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.682+0000 7f14478ec640 1 -- 172.21.15.55:0/1231817439 wait complete. 2023-08-25T04:15:21.700 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-08-25T04:15:21.700 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-08-25T04:15:21.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.850+0000 7f8165103640 1 Processor -- start 2023-08-25T04:15:21.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.850+0000 7f8165103640 1 -- start start 2023-08-25T04:15:21.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.850+0000 7f8165103640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8160159d00 0x7f81600cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:21.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.850+0000 7f8165103640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f816006fb50 0x7f81600c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:21.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.850+0000 7f8165103640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81600cc930 0x7f81600ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:21.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.850+0000 7f8165103640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81600cc510 con 0x7f8160159d00 2023-08-25T04:15:21.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.850+0000 7f8165103640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81600ce220 con 0x7f816006fb50 2023-08-25T04:15:21.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.850+0000 7f8165103640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81600ca6c0 con 0x7f81600cc930 2023-08-25T04:15:21.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.854+0000 7f815ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8160159d00 0x7f81600cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:21.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.854+0000 7f815ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8160159d00 0x7f81600cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50148/0 (socket says 172.21.15.55:50148) 2023-08-25T04:15:21.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.854+0000 7f815ed9d640 1 -- 172.21.15.55:0/2185804918 learned_addr learned my addr 172.21.15.55:0/2185804918 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:21.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.854+0000 7f815659c640 1 --2- 172.21.15.55:0/2185804918 >> v2:172.21.15.110:3300/0 conn(0x7f816006fb50 0x7f81600c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:21.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.854+0000 7f815f59e640 1 --2- 172.21.15.55:0/2185804918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81600cc930 0x7f81600ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:21.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.854+0000 7f815ed9d640 1 -- 172.21.15.55:0/2185804918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81600cc930 msgr2=0x7f81600ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:21.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.854+0000 7f815ed9d640 1 --2- 172.21.15.55:0/2185804918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81600cc930 0x7f81600ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.854+0000 7f815ed9d640 1 -- 172.21.15.55:0/2185804918 >> v2:172.21.15.110:3300/0 conn(0x7f816006fb50 msgr2=0x7f81600c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:21.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.854+0000 7f815ed9d640 1 --2- 172.21.15.55:0/2185804918 >> v2:172.21.15.110:3300/0 conn(0x7f816006fb50 0x7f81600c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.854+0000 7f815ed9d640 1 -- 172.21.15.55:0/2185804918 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81600ca9a0 con 0x7f8160159d00 2023-08-25T04:15:21.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.854+0000 7f815ed9d640 1 --2- 172.21.15.55:0/2185804918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8160159d00 0x7f81600cdc40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f81600720c0 tx=0x7f815001f570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748f938529ff7340 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:21.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.854+0000 7f815e59c640 1 -- 172.21.15.55:0/2185804918 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815000b2d0 con 0x7f8160159d00 2023-08-25T04:15:21.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.854+0000 7f815e59c640 1 -- 172.21.15.55:0/2185804918 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815000b430 con 0x7f8160159d00 2023-08-25T04:15:21.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.854+0000 7f815e59c640 1 -- 172.21.15.55:0/2185804918 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81500a7be0 con 0x7f8160159d00 2023-08-25T04:15:21.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f8165103640 1 -- 172.21.15.55:0/2185804918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8160159d00 msgr2=0x7f81600cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:21.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f8165103640 1 --2- 172.21.15.55:0/2185804918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8160159d00 0x7f81600cdc40 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f81600720c0 tx=0x7f815001f570 comp rx=0 tx=0).stop 2023-08-25T04:15:21.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f8165103640 1 -- 172.21.15.55:0/2185804918 shutdown_connections 2023-08-25T04:15:21.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f8165103640 1 --2- 172.21.15.55:0/2185804918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81600cc930 0x7f81600ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f8165103640 1 --2- 172.21.15.55:0/2185804918 >> v2:172.21.15.110:3300/0 conn(0x7f816006fb50 0x7f81600c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f8165103640 1 --2- 172.21.15.55:0/2185804918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8160159d00 0x7f81600cdc40 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f8165103640 1 -- 172.21.15.55:0/2185804918 >> 172.21.15.55:0/2185804918 conn(0x7f81600caf90 msgr2=0x7f81600cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:21.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f8165103640 1 -- 172.21.15.55:0/2185804918 shutdown_connections 2023-08-25T04:15:21.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f8165103640 1 -- 172.21.15.55:0/2185804918 wait complete. 2023-08-25T04:15:21.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f8165103640 1 Processor -- start 2023-08-25T04:15:21.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f8165103640 1 -- start start 2023-08-25T04:15:21.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f8165103640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f816006fb50 0x7f8160155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:21.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f8165103640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81600cc930 0x7f81600c2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:21.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f8165103640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8160159d00 0x7f81601509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:21.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f8165103640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81601f88e0 con 0x7f81600cc930 2023-08-25T04:15:21.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f8165103640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81601f8bc0 con 0x7f8160159d00 2023-08-25T04:15:21.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f8165103640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81601f8ea0 con 0x7f816006fb50 2023-08-25T04:15:21.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f815659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81600cc930 0x7f81600c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:21.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f815659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81600cc930 0x7f81600c2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50154/0 (socket says 172.21.15.55:50154) 2023-08-25T04:15:21.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.858+0000 7f815659c640 1 -- 172.21.15.55:0/1690598451 learned_addr learned my addr 172.21.15.55:0/1690598451 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:21.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.862+0000 7f815f59e640 1 --2- 172.21.15.55:0/1690598451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8160159d00 0x7f81601509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:21.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.862+0000 7f815ed9d640 1 --2- 172.21.15.55:0/1690598451 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f816006fb50 0x7f8160155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:21.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.862+0000 7f815659c640 1 -- 172.21.15.55:0/1690598451 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f816006fb50 msgr2=0x7f8160155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:21.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.862+0000 7f815659c640 1 --2- 172.21.15.55:0/1690598451 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f816006fb50 0x7f8160155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.862+0000 7f815659c640 1 -- 172.21.15.55:0/1690598451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8160159d00 msgr2=0x7f81601509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:21.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.862+0000 7f815659c640 1 --2- 172.21.15.55:0/1690598451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8160159d00 0x7f81601509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:21.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.862+0000 7f815659c640 1 -- 172.21.15.55:0/1690598451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815000bd40 con 0x7f81600cc930 2023-08-25T04:15:21.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.862+0000 7f815659c640 1 --2- 172.21.15.55:0/1690598451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81600cc930 0x7f81600c2120 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f814800d800 tx=0x7f814800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:21.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.862+0000 7f8157fff640 1 -- 172.21.15.55:0/1690598451 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81480096a0 con 0x7f81600cc930 2023-08-25T04:15:21.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.862+0000 7f8157fff640 1 -- 172.21.15.55:0/1690598451 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8148009800 con 0x7f81600cc930 2023-08-25T04:15:21.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.862+0000 7f8165103640 1 -- 172.21.15.55:0/1690598451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81601f9180 con 0x7f81600cc930 2023-08-25T04:15:21.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.862+0000 7f8157fff640 1 -- 172.21.15.55:0/1690598451 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8148009b70 con 0x7f81600cc930 2023-08-25T04:15:21.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.862+0000 7f8165103640 1 -- 172.21.15.55:0/1690598451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81601569c0 con 0x7f81600cc930 2023-08-25T04:15:21.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.862+0000 7f8165103640 1 -- 172.21.15.55:0/1690598451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f816004dbe0 con 0x7f81600cc930 2023-08-25T04:15:21.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.862+0000 7f8157fff640 1 -- 172.21.15.55:0/1690598451 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f8148009cd0 con 0x7f81600cc930 2023-08-25T04:15:21.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.862+0000 7f8157fff640 1 --2- 172.21.15.55:0/1690598451 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8140065880 0x7f8140067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:21.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.866+0000 7f8157fff640 1 -- 172.21.15.55:0/1690598451 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f8148083940 con 0x7f81600cc930 2023-08-25T04:15:21.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.866+0000 7f815ed9d640 1 --2- 172.21.15.55:0/1690598451 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8140065880 0x7f8140067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:21.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.866+0000 7f815ed9d640 1 --2- 172.21.15.55:0/1690598451 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8140065880 0x7f8140067d40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f81500b0000 tx=0x7f8150004ac0 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:21.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:21.870+0000 7f8157fff640 1 -- 172.21.15.55:0/1690598451 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8148051070 con 0x7f81600cc930 2023-08-25T04:15:22.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.050+0000 7f8165103640 1 -- 172.21.15.55:0/1690598451 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f81600cd770 con 0x7f8140065880 2023-08-25T04:15:22.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.122+0000 7f8157fff640 1 -- 172.21.15.55:0/1690598451 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f81500a79c0 con 0x7f8140065880 2023-08-25T04:15:22.120 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-08-25T04:15:22.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.122+0000 7f8165103640 1 -- 172.21.15.55:0/1690598451 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8140065880 msgr2=0x7f8140067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:22.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.122+0000 7f8165103640 1 --2- 172.21.15.55:0/1690598451 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8140065880 0x7f8140067d40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f81500b0000 tx=0x7f8150004ac0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.122+0000 7f8165103640 1 -- 172.21.15.55:0/1690598451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81600cc930 msgr2=0x7f81600c2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:22.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.122+0000 7f8165103640 1 --2- 172.21.15.55:0/1690598451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81600cc930 0x7f81600c2120 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f814800d800 tx=0x7f814800dcc0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.122+0000 7f8165103640 1 -- 172.21.15.55:0/1690598451 shutdown_connections 2023-08-25T04:15:22.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.122+0000 7f8165103640 1 --2- 172.21.15.55:0/1690598451 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8140065880 0x7f8140067d40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.122+0000 7f8165103640 1 --2- 172.21.15.55:0/1690598451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8160159d00 0x7f81601509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.122+0000 7f8165103640 1 --2- 172.21.15.55:0/1690598451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81600cc930 0x7f81600c2120 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.122+0000 7f8165103640 1 --2- 172.21.15.55:0/1690598451 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f816006fb50 0x7f8160155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.122+0000 7f8165103640 1 -- 172.21.15.55:0/1690598451 >> 172.21.15.55:0/1690598451 conn(0x7f81600caf90 msgr2=0x7f81600acaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:22.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.122+0000 7f8165103640 1 -- 172.21.15.55:0/1690598451 shutdown_connections 2023-08-25T04:15:22.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.122+0000 7f8165103640 1 -- 172.21.15.55:0/1690598451 wait complete. 2023-08-25T04:15:22.140 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-08-25T04:15:22.141 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-08-25T04:15:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.290+0000 7fa1a0174640 1 Processor -- start 2023-08-25T04:15:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.290+0000 7fa1a0174640 1 -- start start 2023-08-25T04:15:22.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.290+0000 7fa1a0174640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa1980717a0 0x7fa1980b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:22.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.290+0000 7fa1a0174640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa198159e30 con 0x7fa19806b120 2023-08-25T04:15:22.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.290+0000 7fa1a0174640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1980714f0 con 0x7fa198159a50 2023-08-25T04:15:22.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.290+0000 7fa1a0174640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1980b5540 con 0x7fa1980717a0 2023-08-25T04:15:22.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.290+0000 7fa19d70f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa19806b120 0x7fa1980cd770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38860/0 (socket says 172.21.15.55:38860) 2023-08-25T04:15:22.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.290+0000 7fa19d70f640 1 -- 172.21.15.55:0/517825388 learned_addr learned my addr 172.21.15.55:0/517825388 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:22.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.294+0000 7fa19e711640 1 --2- 172.21.15.55:0/517825388 >> v2:172.21.15.110:3300/0 conn(0x7fa1980717a0 0x7fa1980b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:22.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.294+0000 7fa19cf0e640 1 -- 172.21.15.55:0/517825388 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2561480240 0 0) 0x7fa198159e30 con 0x7fa19806b120 2023-08-25T04:15:22.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.294+0000 7fa19cf0e640 1 -- 172.21.15.55:0/517825388 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa184003530 con 0x7fa19806b120 2023-08-25T04:15:22.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.294+0000 7fa19cf0e640 1 -- 172.21.15.55:0/517825388 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626383820 0 0) 0x7fa1980714f0 con 0x7fa198159a50 2023-08-25T04:15:22.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.294+0000 7fa19cf0e640 1 -- 172.21.15.55:0/517825388 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa198159e30 con 0x7fa198159a50 2023-08-25T04:15:22.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.294+0000 7fa19e711640 1 -- 172.21.15.55:0/517825388 >> v1:172.21.15.110:6789/0 conn(0x7fa198159a50 legacy=0x7fa19806aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:22.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.294+0000 7fa19e711640 1 -- 172.21.15.55:0/517825388 >> v1:172.21.15.55:6789/0 conn(0x7fa19806b120 legacy=0x7fa1980cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:22.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.294+0000 7fa19e711640 1 -- 172.21.15.55:0/517825388 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa198070f10 con 0x7fa1980717a0 2023-08-25T04:15:22.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.294+0000 7fa19e711640 1 --2- 172.21.15.55:0/517825388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1980717a0 0x7fa1980b5000 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa190009d90 tx=0x7fa19001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bebe755d991fd805 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:22.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.294+0000 7fa19cf0e640 1 -- 172.21.15.55:0/517825388 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1900a5900 con 0x7fa1980717a0 2023-08-25T04:15:22.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.294+0000 7fa19cf0e640 1 -- 172.21.15.55:0/517825388 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1900a5a60 con 0x7fa1980717a0 2023-08-25T04:15:22.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.294+0000 7fa19cf0e640 1 -- 172.21.15.55:0/517825388 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1900a5df0 con 0x7fa1980717a0 2023-08-25T04:15:22.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa1a0174640 1 -- 172.21.15.55:0/517825388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1980717a0 msgr2=0x7fa1980b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:22.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa1a0174640 1 --2- 172.21.15.55:0/517825388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1980717a0 0x7fa1980b5000 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa190009d90 tx=0x7fa19001c950 comp rx=0 tx=0).stop 2023-08-25T04:15:22.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa1a0174640 1 -- 172.21.15.55:0/517825388 shutdown_connections 2023-08-25T04:15:22.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa1a0174640 1 --2- 172.21.15.55:0/517825388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1980717a0 0x7fa1980b5000 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa1a0174640 1 -- 172.21.15.55:0/517825388 >> 172.21.15.55:0/517825388 conn(0x7fa1980cc010 msgr2=0x7fa1980cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:22.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa1a0174640 1 -- 172.21.15.55:0/517825388 shutdown_connections 2023-08-25T04:15:22.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa1a0174640 1 -- 172.21.15.55:0/517825388 wait complete. 2023-08-25T04:15:22.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa1a0174640 1 Processor -- start 2023-08-25T04:15:22.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa1a0174640 1 -- start start 2023-08-25T04:15:22.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa1a0174640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa19806b120 0x7fa19814eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:22.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa1a0174640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1980717a0 0x7fa198153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:22.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa1a0174640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa198159a50 0x7fa1981563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:22.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa1a0174640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1981f5c20 con 0x7fa198159a50 2023-08-25T04:15:22.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa1a0174640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1981547a0 con 0x7fa1980717a0 2023-08-25T04:15:22.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa1a0174640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19814f0e0 con 0x7fa19806b120 2023-08-25T04:15:22.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa19e711640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa198159a50 0x7fa1981563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:22.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa19d70f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1980717a0 0x7fa198153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:22.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa19e711640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa198159a50 0x7fa1981563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50166/0 (socket says 172.21.15.55:50166) 2023-08-25T04:15:22.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa19e711640 1 -- 172.21.15.55:0/1206957928 learned_addr learned my addr 172.21.15.55:0/1206957928 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:22.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa19df10640 1 --2- 172.21.15.55:0/1206957928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa19806b120 0x7fa19814eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:22.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa19e711640 1 -- 172.21.15.55:0/1206957928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa19806b120 msgr2=0x7fa19814eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:22.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa19e711640 1 --2- 172.21.15.55:0/1206957928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa19806b120 0x7fa19814eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa19e711640 1 -- 172.21.15.55:0/1206957928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1980717a0 msgr2=0x7fa198153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:22.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa19e711640 1 --2- 172.21.15.55:0/1206957928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1980717a0 0x7fa198153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.298+0000 7fa19e711640 1 -- 172.21.15.55:0/1206957928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa190009a70 con 0x7fa198159a50 2023-08-25T04:15:22.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.302+0000 7fa19e711640 1 --2- 172.21.15.55:0/1206957928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa198159a50 0x7fa1981563b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa19001a580 tx=0x7fa1900196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:22.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.302+0000 7fa18e7fc640 1 -- 172.21.15.55:0/1206957928 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1900b9650 con 0x7fa198159a50 2023-08-25T04:15:22.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.302+0000 7fa18e7fc640 1 -- 172.21.15.55:0/1206957928 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1900b97b0 con 0x7fa198159a50 2023-08-25T04:15:22.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.302+0000 7fa1a0174640 1 -- 172.21.15.55:0/1206957928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1981f4ce0 con 0x7fa198159a50 2023-08-25T04:15:22.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.302+0000 7fa18e7fc640 1 -- 172.21.15.55:0/1206957928 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1900b9b20 con 0x7fa198159a50 2023-08-25T04:15:22.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.302+0000 7fa1a0174640 1 -- 172.21.15.55:0/1206957928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1981f5280 con 0x7fa198159a50 2023-08-25T04:15:22.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.302+0000 7fa1a0174640 1 -- 172.21.15.55:0/1206957928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19804dbe0 con 0x7fa198159a50 2023-08-25T04:15:22.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.302+0000 7fa18e7fc640 1 -- 172.21.15.55:0/1206957928 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7fa1900b9c80 con 0x7fa198159a50 2023-08-25T04:15:22.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.302+0000 7fa18e7fc640 1 --2- 172.21.15.55:0/1206957928 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fa17c065880 0x7fa17c067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:22.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.302+0000 7fa18e7fc640 1 -- 172.21.15.55:0/1206957928 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fa19011e4e0 con 0x7fa198159a50 2023-08-25T04:15:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.306+0000 7fa19df10640 1 --2- 172.21.15.55:0/1206957928 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fa17c065880 0x7fa17c067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.306+0000 7fa19df10640 1 --2- 172.21.15.55:0/1206957928 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fa17c065880 0x7fa17c067d40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa1940011f0 tx=0x7fa194009040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:22.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.306+0000 7fa18e7fc640 1 -- 172.21.15.55:0/1206957928 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa1900ebc10 con 0x7fa198159a50 2023-08-25T04:15:22.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.486+0000 7fa1a0174640 1 -- 172.21.15.55:0/1206957928 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1980cbd60 con 0x7fa17c065880 2023-08-25T04:15:22.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.562+0000 7fa18e7fc640 1 -- 172.21.15.55:0/1206957928 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa194001460 con 0x7fa17c065880 2023-08-25T04:15:22.561 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-08-25T04:15:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.562+0000 7fa1a0174640 1 -- 172.21.15.55:0/1206957928 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fa17c065880 msgr2=0x7fa17c067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.562+0000 7fa1a0174640 1 --2- 172.21.15.55:0/1206957928 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fa17c065880 0x7fa17c067d40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa1940011f0 tx=0x7fa194009040 comp rx=0 tx=0).stop 2023-08-25T04:15:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.562+0000 7fa1a0174640 1 -- 172.21.15.55:0/1206957928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa198159a50 msgr2=0x7fa1981563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.562+0000 7fa1a0174640 1 --2- 172.21.15.55:0/1206957928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa198159a50 0x7fa1981563b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa19001a580 tx=0x7fa1900196f0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.562+0000 7fa1a0174640 1 -- 172.21.15.55:0/1206957928 shutdown_connections 2023-08-25T04:15:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.562+0000 7fa1a0174640 1 --2- 172.21.15.55:0/1206957928 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fa17c065880 0x7fa17c067d40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.562+0000 7fa1a0174640 1 --2- 172.21.15.55:0/1206957928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa198159a50 0x7fa1981563b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.562+0000 7fa1a0174640 1 --2- 172.21.15.55:0/1206957928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1980717a0 0x7fa198153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.562+0000 7fa1a0174640 1 --2- 172.21.15.55:0/1206957928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa19806b120 0x7fa19814eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.562+0000 7fa1a0174640 1 -- 172.21.15.55:0/1206957928 >> 172.21.15.55:0/1206957928 conn(0x7fa1980cc010 msgr2=0x7fa1981587b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.566+0000 7fa1a0174640 1 -- 172.21.15.55:0/1206957928 shutdown_connections 2023-08-25T04:15:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.566+0000 7fa1a0174640 1 -- 172.21.15.55:0/1206957928 wait complete. 2023-08-25T04:15:22.582 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-08-25T04:15:22.582 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-08-25T04:15:22.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.734+0000 7f6cb5f0a640 1 Processor -- start 2023-08-25T04:15:22.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.734+0000 7f6cb5f0a640 1 -- start start 2023-08-25T04:15:22.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.738+0000 7f6cb5f0a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6cb00afa20 0x7f6cb00b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:22.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.738+0000 7f6cb5f0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6cb00cd870 0x7f6cb00ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:22.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.738+0000 7f6cb5f0a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb00cae70 con 0x7f6cb00cf9b0 2023-08-25T04:15:22.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.738+0000 7f6cb5f0a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb00cfe10 con 0x7f6cb00cd870 2023-08-25T04:15:22.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.738+0000 7f6cb5f0a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb00cb0e0 con 0x7f6cb00afa20 2023-08-25T04:15:22.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.738+0000 7f6caffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6cb00cd870 0x7f6cb00ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:22.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.738+0000 7f6caffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6cb00cd870 0x7f6cb00ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50182/0 (socket says 172.21.15.55:50182) 2023-08-25T04:15:22.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.738+0000 7f6caffff640 1 -- 172.21.15.55:0/612804685 learned_addr learned my addr 172.21.15.55:0/612804685 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:22.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.738+0000 7f6caf7fe640 1 --2- 172.21.15.55:0/612804685 >> v2:172.21.15.110:3300/0 conn(0x7f6cb00afa20 0x7f6cb00b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:22.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.738+0000 7f6caffff640 1 -- 172.21.15.55:0/612804685 >> v2:172.21.15.110:3300/0 conn(0x7f6cb00afa20 msgr2=0x7f6cb00b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:22.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.738+0000 7f6caffff640 1 --2- 172.21.15.55:0/612804685 >> v2:172.21.15.110:3300/0 conn(0x7f6cb00afa20 0x7f6cb00b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.738+0000 7f6caffff640 1 -- 172.21.15.55:0/612804685 >> v1:172.21.15.110:6789/0 conn(0x7f6cb00cf9b0 legacy=0x7f6cb00cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:22.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.738+0000 7f6caffff640 1 -- 172.21.15.55:0/612804685 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb00cb3c0 con 0x7f6cb00cd870 2023-08-25T04:15:22.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.738+0000 7f6caffff640 1 --2- 172.21.15.55:0/612804685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6cb00cd870 0x7f6cb00ce9c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00b32c0 tx=0x7f6ca801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf0677d8276e7f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:22.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6caeffd640 1 -- 172.21.15.55:0/612804685 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80a57d0 con 0x7f6cb00cd870 2023-08-25T04:15:22.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6caeffd640 1 -- 172.21.15.55:0/612804685 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca80a5930 con 0x7f6cb00cd870 2023-08-25T04:15:22.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6caeffd640 1 -- 172.21.15.55:0/612804685 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80a5cc0 con 0x7f6cb00cd870 2023-08-25T04:15:22.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6cb5f0a640 1 -- 172.21.15.55:0/612804685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6cb00cd870 msgr2=0x7f6cb00ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:22.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6cb5f0a640 1 --2- 172.21.15.55:0/612804685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6cb00cd870 0x7f6cb00ce9c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00b32c0 tx=0x7f6ca801c910 comp rx=0 tx=0).stop 2023-08-25T04:15:22.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6cb5f0a640 1 -- 172.21.15.55:0/612804685 shutdown_connections 2023-08-25T04:15:22.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6cb5f0a640 1 --2- 172.21.15.55:0/612804685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6cb00cd870 0x7f6cb00ce9c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6cb5f0a640 1 --2- 172.21.15.55:0/612804685 >> v2:172.21.15.110:3300/0 conn(0x7f6cb00afa20 0x7f6cb00b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6cb5f0a640 1 -- 172.21.15.55:0/612804685 >> 172.21.15.55:0/612804685 conn(0x7f6cb00d0780 msgr2=0x7f6cb00d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:22.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6cb5f0a640 1 -- 172.21.15.55:0/612804685 shutdown_connections 2023-08-25T04:15:22.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6cb5f0a640 1 -- 172.21.15.55:0/612804685 wait complete. 2023-08-25T04:15:22.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6cb5f0a640 1 Processor -- start 2023-08-25T04:15:22.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6cb5f0a640 1 -- start start 2023-08-25T04:15:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6cb5f0a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cb00afa20 0x7f6cb0150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6cb5f0a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6cb00cd870 0x7f6cb00c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:22.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6cb5f0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6cb00cf9b0 0x7f6cb01f8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:22.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6cb5f0a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb0150ed0 con 0x7f6cb00cf9b0 2023-08-25T04:15:22.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6cb5f0a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb01563e0 con 0x7f6cb00afa20 2023-08-25T04:15:22.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6cb5f0a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb0156680 con 0x7f6cb00cd870 2023-08-25T04:15:22.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.742+0000 7f6caffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6cb00cf9b0 0x7f6cb01f8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:22.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6caf7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cb00afa20 0x7f6cb0150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:22.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6caffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6cb00cf9b0 0x7f6cb01f8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50188/0 (socket says 172.21.15.55:50188) 2023-08-25T04:15:22.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6caffff640 1 -- 172.21.15.55:0/3498640982 learned_addr learned my addr 172.21.15.55:0/3498640982 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:22.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6ca7fff640 1 --2- 172.21.15.55:0/3498640982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6cb00cd870 0x7f6cb00c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:22.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6caffff640 1 -- 172.21.15.55:0/3498640982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6cb00cd870 msgr2=0x7f6cb00c4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:22.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6caffff640 1 --2- 172.21.15.55:0/3498640982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6cb00cd870 0x7f6cb00c4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6caffff640 1 -- 172.21.15.55:0/3498640982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cb00afa20 msgr2=0x7f6cb0150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:22.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6caffff640 1 --2- 172.21.15.55:0/3498640982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cb00afa20 0x7f6cb0150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:22.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6caffff640 1 -- 172.21.15.55:0/3498640982 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca8009b30 con 0x7f6cb00cf9b0 2023-08-25T04:15:22.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6caffff640 1 --2- 172.21.15.55:0/3498640982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6cb00cf9b0 0x7f6cb01f8140 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80af040 tx=0x7f6ca80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:22.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6cacff9640 1 -- 172.21.15.55:0/3498640982 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80b8670 con 0x7f6cb00cf9b0 2023-08-25T04:15:22.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6cacff9640 1 -- 172.21.15.55:0/3498640982 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca80b87f0 con 0x7f6cb00cf9b0 2023-08-25T04:15:22.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6cb5f0a640 1 -- 172.21.15.55:0/3498640982 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb0156960 con 0x7f6cb00cf9b0 2023-08-25T04:15:22.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6cacff9640 1 -- 172.21.15.55:0/3498640982 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80b8ba0 con 0x7f6cb00cf9b0 2023-08-25T04:15:22.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6cb5f0a640 1 -- 172.21.15.55:0/3498640982 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb0156f20 con 0x7f6cb00cf9b0 2023-08-25T04:15:22.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6cb5f0a640 1 -- 172.21.15.55:0/3498640982 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb004dbe0 con 0x7f6cb00cf9b0 2023-08-25T04:15:22.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6cacff9640 1 -- 172.21.15.55:0/3498640982 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f6ca80b8d00 con 0x7f6cb00cf9b0 2023-08-25T04:15:22.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6cacff9640 1 --2- 172.21.15.55:0/3498640982 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6c90065880 0x7f6c90067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:22.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.746+0000 7f6cacff9640 1 -- 172.21.15.55:0/3498640982 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f6ca811e860 con 0x7f6cb00cf9b0 2023-08-25T04:15:22.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.750+0000 7f6caf7fe640 1 --2- 172.21.15.55:0/3498640982 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6c90065880 0x7f6c90067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:22.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.750+0000 7f6caf7fe640 1 --2- 172.21.15.55:0/3498640982 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6c90065880 0x7f6c90067d40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0007a60 tx=0x7f6ca0008040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:22.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.750+0000 7f6cacff9640 1 -- 172.21.15.55:0/3498640982 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6ca80ebf90 con 0x7f6cb00cf9b0 2023-08-25T04:15:22.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.930+0000 7f6cb5f0a640 1 -- 172.21.15.55:0/3498640982 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cb00cdeb0 con 0x7f6c90065880 2023-08-25T04:15:22.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:22.998+0000 7f6cacff9640 1 -- 172.21.15.55:0/3498640982 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f6ca0010990 con 0x7f6c90065880 2023-08-25T04:15:22.998 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-08-25T04:15:23.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.002+0000 7f6cb5f0a640 1 -- 172.21.15.55:0/3498640982 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6c90065880 msgr2=0x7f6c90067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:23.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.002+0000 7f6cb5f0a640 1 --2- 172.21.15.55:0/3498640982 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6c90065880 0x7f6c90067d40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0007a60 tx=0x7f6ca0008040 comp rx=0 tx=0).stop 2023-08-25T04:15:23.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.002+0000 7f6cb5f0a640 1 -- 172.21.15.55:0/3498640982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6cb00cf9b0 msgr2=0x7f6cb01f8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:23.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.002+0000 7f6cb5f0a640 1 --2- 172.21.15.55:0/3498640982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6cb00cf9b0 0x7f6cb01f8140 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80af040 tx=0x7f6ca80196b0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.002+0000 7f6cb5f0a640 1 -- 172.21.15.55:0/3498640982 shutdown_connections 2023-08-25T04:15:23.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.002+0000 7f6cb5f0a640 1 --2- 172.21.15.55:0/3498640982 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6c90065880 0x7f6c90067d40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.002+0000 7f6cb5f0a640 1 --2- 172.21.15.55:0/3498640982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6cb00cf9b0 0x7f6cb01f8140 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.002+0000 7f6cb5f0a640 1 --2- 172.21.15.55:0/3498640982 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6cb00cd870 0x7f6cb00c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.002+0000 7f6cb5f0a640 1 --2- 172.21.15.55:0/3498640982 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cb00afa20 0x7f6cb0150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.002+0000 7f6cb5f0a640 1 -- 172.21.15.55:0/3498640982 >> 172.21.15.55:0/3498640982 conn(0x7f6cb00d0780 msgr2=0x7f6cb00d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:23.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.002+0000 7f6cb5f0a640 1 -- 172.21.15.55:0/3498640982 shutdown_connections 2023-08-25T04:15:23.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.002+0000 7f6cb5f0a640 1 -- 172.21.15.55:0/3498640982 wait complete. 2023-08-25T04:15:23.019 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-08-25T04:15:23.020 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-08-25T04:15:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.170+0000 7fd332986640 1 Processor -- start 2023-08-25T04:15:23.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.170+0000 7fd332986640 1 -- start start 2023-08-25T04:15:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.170+0000 7fd332986640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd32c160120 0x7fd32c0b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:23.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.170+0000 7fd332986640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd32c0b33c0 0x7fd32c0b4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:23.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.170+0000 7fd332986640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32c0b1f20 con 0x7fd32c0b4080 2023-08-25T04:15:23.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.170+0000 7fd332986640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32c0b4a50 con 0x7fd32c0b33c0 2023-08-25T04:15:23.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.170+0000 7fd332986640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32c0cddf0 con 0x7fd32c160120 2023-08-25T04:15:23.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.170+0000 7fd331183640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd32c0b4080 0x7fd32c0d0500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38866/0 (socket says 172.21.15.55:38866) 2023-08-25T04:15:23.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.170+0000 7fd331183640 1 -- 172.21.15.55:0/3179897333 learned_addr learned my addr 172.21.15.55:0/3179897333 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:23.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.170+0000 7fd332185640 1 --2- 172.21.15.55:0/3179897333 >> v2:172.21.15.55:3300/0 conn(0x7fd32c0b33c0 0x7fd32c0b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:23.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.170+0000 7fd331984640 1 --2- 172.21.15.55:0/3179897333 >> v2:172.21.15.110:3300/0 conn(0x7fd32c160120 0x7fd32c0b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:23.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.170+0000 7fd332185640 1 -- 172.21.15.55:0/3179897333 >> v2:172.21.15.110:3300/0 conn(0x7fd32c160120 msgr2=0x7fd32c0b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:23.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.170+0000 7fd332185640 1 --2- 172.21.15.55:0/3179897333 >> v2:172.21.15.110:3300/0 conn(0x7fd32c160120 0x7fd32c0b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.170+0000 7fd330982640 1 -- 172.21.15.55:0/3179897333 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406230406 0 0) 0x7fd32c0b1f20 con 0x7fd32c0b4080 2023-08-25T04:15:23.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.170+0000 7fd332185640 1 -- 172.21.15.55:0/3179897333 >> v1:172.21.15.55:6789/0 conn(0x7fd32c0b4080 legacy=0x7fd32c0d0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:23.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.170+0000 7fd332185640 1 -- 172.21.15.55:0/3179897333 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c0ce0d0 con 0x7fd32c0b33c0 2023-08-25T04:15:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.174+0000 7fd332185640 1 --2- 172.21.15.55:0/3179897333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd32c0b33c0 0x7fd32c0b4510 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd324009d90 tx=0x7fd32401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f24cad89479eed server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.174+0000 7fd330982640 1 -- 172.21.15.55:0/3179897333 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3240a58c0 con 0x7fd32c0b33c0 2023-08-25T04:15:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.174+0000 7fd330982640 1 -- 172.21.15.55:0/3179897333 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3240a5a20 con 0x7fd32c0b33c0 2023-08-25T04:15:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.174+0000 7fd330982640 1 -- 172.21.15.55:0/3179897333 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3240a5db0 con 0x7fd32c0b33c0 2023-08-25T04:15:23.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.174+0000 7fd332986640 1 -- 172.21.15.55:0/3179897333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd32c0b33c0 msgr2=0x7fd32c0b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:23.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.174+0000 7fd332986640 1 --2- 172.21.15.55:0/3179897333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd32c0b33c0 0x7fd32c0b4510 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd324009d90 tx=0x7fd32401c8e0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.174+0000 7fd332986640 1 -- 172.21.15.55:0/3179897333 shutdown_connections 2023-08-25T04:15:23.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.174+0000 7fd332986640 1 --2- 172.21.15.55:0/3179897333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd32c0b33c0 0x7fd32c0b4510 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.174+0000 7fd332986640 1 --2- 172.21.15.55:0/3179897333 >> v2:172.21.15.110:3300/0 conn(0x7fd32c160120 0x7fd32c0b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.174+0000 7fd332986640 1 -- 172.21.15.55:0/3179897333 >> 172.21.15.55:0/3179897333 conn(0x7fd32c09b950 msgr2=0x7fd32c0d2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:23.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.174+0000 7fd332986640 1 -- 172.21.15.55:0/3179897333 shutdown_connections 2023-08-25T04:15:23.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.174+0000 7fd332986640 1 -- 172.21.15.55:0/3179897333 wait complete. 2023-08-25T04:15:23.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd332986640 1 Processor -- start 2023-08-25T04:15:23.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd332986640 1 -- start start 2023-08-25T04:15:23.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd332986640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd32c0b33c0 0x7fd32c156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:23.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd332986640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd32c0b4080 0x7fd32c157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:23.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd332986640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd32c160120 0x7fd32c0b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:23.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd332986640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c158960 con 0x7fd32c0b33c0 2023-08-25T04:15:23.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd332986640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c158c40 con 0x7fd32c0b4080 2023-08-25T04:15:23.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd332986640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32c158f20 con 0x7fd32c160120 2023-08-25T04:15:23.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd331984640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd32c0b33c0 0x7fd32c156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:23.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd331984640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd32c0b33c0 0x7fd32c156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50208/0 (socket says 172.21.15.55:50208) 2023-08-25T04:15:23.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd331984640 1 -- 172.21.15.55:0/2775705609 learned_addr learned my addr 172.21.15.55:0/2775705609 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:23.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd332185640 1 --2- 172.21.15.55:0/2775705609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd32c160120 0x7fd32c0b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:23.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd331183640 1 --2- 172.21.15.55:0/2775705609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd32c0b4080 0x7fd32c157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:23.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd331984640 1 -- 172.21.15.55:0/2775705609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd32c160120 msgr2=0x7fd32c0b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:23.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd331984640 1 --2- 172.21.15.55:0/2775705609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd32c160120 0x7fd32c0b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd331984640 1 -- 172.21.15.55:0/2775705609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd32c0b4080 msgr2=0x7fd32c157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:23.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd331984640 1 --2- 172.21.15.55:0/2775705609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd32c0b4080 0x7fd32c157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd331984640 1 -- 172.21.15.55:0/2775705609 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd324009a70 con 0x7fd32c0b33c0 2023-08-25T04:15:23.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd331984640 1 --2- 172.21.15.55:0/2775705609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd32c0b33c0 0x7fd32c156f00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd32800e870 tx=0x7fd32800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:23.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd3227fc640 1 -- 172.21.15.55:0/2775705609 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3280095d0 con 0x7fd32c0b33c0 2023-08-25T04:15:23.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd3227fc640 1 -- 172.21.15.55:0/2775705609 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32800c940 con 0x7fd32c0b33c0 2023-08-25T04:15:23.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd3227fc640 1 -- 172.21.15.55:0/2775705609 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32800ccb0 con 0x7fd32c0b33c0 2023-08-25T04:15:23.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd332986640 1 -- 172.21.15.55:0/2775705609 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32c159200 con 0x7fd32c0b33c0 2023-08-25T04:15:23.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.178+0000 7fd332986640 1 -- 172.21.15.55:0/2775705609 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32c158530 con 0x7fd32c0b33c0 2023-08-25T04:15:23.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.182+0000 7fd332986640 1 -- 172.21.15.55:0/2775705609 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32c073e50 con 0x7fd32c0b33c0 2023-08-25T04:15:23.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.182+0000 7fd3227fc640 1 -- 172.21.15.55:0/2775705609 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7fd328013470 con 0x7fd32c0b33c0 2023-08-25T04:15:23.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.182+0000 7fd3227fc640 1 --2- 172.21.15.55:0/2775705609 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fd310065880 0x7fd310067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:23.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.182+0000 7fd3227fc640 1 -- 172.21.15.55:0/2775705609 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fd328083680 con 0x7fd32c0b33c0 2023-08-25T04:15:23.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.182+0000 7fd331183640 1 --2- 172.21.15.55:0/2775705609 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fd310065880 0x7fd310067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:23.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.182+0000 7fd331183640 1 --2- 172.21.15.55:0/2775705609 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fd310065880 0x7fd310067d40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd32c072d50 tx=0x7fd31c007d60 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:23.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.186+0000 7fd3227fc640 1 -- 172.21.15.55:0/2775705609 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd328050fc0 con 0x7fd32c0b33c0 2023-08-25T04:15:23.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.362+0000 7fd332986640 1 -- 172.21.15.55:0/2775705609 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd32c158750 con 0x7fd310065880 2023-08-25T04:15:23.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.426+0000 7fd3227fc640 1 -- 172.21.15.55:0/2775705609 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fd32c158750 con 0x7fd310065880 2023-08-25T04:15:23.427 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-08-25T04:15:23.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.430+0000 7fd332986640 1 -- 172.21.15.55:0/2775705609 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fd310065880 msgr2=0x7fd310067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:23.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.430+0000 7fd332986640 1 --2- 172.21.15.55:0/2775705609 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fd310065880 0x7fd310067d40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd32c072d50 tx=0x7fd31c007d60 comp rx=0 tx=0).stop 2023-08-25T04:15:23.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.430+0000 7fd332986640 1 -- 172.21.15.55:0/2775705609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd32c0b33c0 msgr2=0x7fd32c156f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:23.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.430+0000 7fd332986640 1 --2- 172.21.15.55:0/2775705609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd32c0b33c0 0x7fd32c156f00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd32800e870 tx=0x7fd32800ed30 comp rx=0 tx=0).stop 2023-08-25T04:15:23.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.430+0000 7fd332986640 1 -- 172.21.15.55:0/2775705609 shutdown_connections 2023-08-25T04:15:23.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.430+0000 7fd332986640 1 --2- 172.21.15.55:0/2775705609 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fd310065880 0x7fd310067d40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.430+0000 7fd332986640 1 --2- 172.21.15.55:0/2775705609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd32c160120 0x7fd32c0b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.430+0000 7fd332986640 1 --2- 172.21.15.55:0/2775705609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd32c0b4080 0x7fd32c157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.430+0000 7fd332986640 1 --2- 172.21.15.55:0/2775705609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd32c0b33c0 0x7fd32c156f00 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.430+0000 7fd332986640 1 -- 172.21.15.55:0/2775705609 >> 172.21.15.55:0/2775705609 conn(0x7fd32c09b950 msgr2=0x7fd32c0cf080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:23.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.430+0000 7fd332986640 1 -- 172.21.15.55:0/2775705609 shutdown_connections 2023-08-25T04:15:23.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.430+0000 7fd332986640 1 -- 172.21.15.55:0/2775705609 wait complete. 2023-08-25T04:15:23.447 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-08-25T04:15:23.448 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-08-25T04:15:23.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.598+0000 7f5f395ba640 1 Processor -- start 2023-08-25T04:15:23.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.598+0000 7f5f395ba640 1 -- start start 2023-08-25T04:15:23.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.598+0000 7f5f395ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f3415cbe0 0x7f5f340b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:23.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.598+0000 7f5f395ba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5f340cd260 0x7f5f340cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:23.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.598+0000 7f5f395ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f340cf230 0x7f5f340cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:23.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.598+0000 7f5f395ba640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f340cdc00 con 0x7f5f340cd260 2023-08-25T04:15:23.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.598+0000 7f5f395ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f340d0f70 con 0x7f5f340cf230 2023-08-25T04:15:23.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.598+0000 7f5f395ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f34160b80 con 0x7f5f3415cbe0 2023-08-25T04:15:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.598+0000 7f5f2a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5f340cd260 0x7f5f340cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.598+0000 7f5f2a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5f340cd260 0x7f5f340cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50216/0 (socket says 172.21.15.55:50216) 2023-08-25T04:15:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.598+0000 7f5f2a7fc640 1 -- 172.21.15.55:0/1833400560 learned_addr learned my addr 172.21.15.55:0/1833400560 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.598+0000 7f5f32ffd640 1 --2- 172.21.15.55:0/1833400560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f3415cbe0 0x7f5f340b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.598+0000 7f5f337fe640 1 --2- 172.21.15.55:0/1833400560 >> v2:172.21.15.110:3300/0 conn(0x7f5f340cf230 0x7f5f340cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.598+0000 7f5f2a7fc640 1 -- 172.21.15.55:0/1833400560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f3415cbe0 msgr2=0x7f5f340b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.598+0000 7f5f2a7fc640 1 --2- 172.21.15.55:0/1833400560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f3415cbe0 0x7f5f340b5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.598+0000 7f5f2a7fc640 1 -- 172.21.15.55:0/1833400560 >> v2:172.21.15.110:3300/0 conn(0x7f5f340cf230 msgr2=0x7f5f340cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.598+0000 7f5f2a7fc640 1 --2- 172.21.15.55:0/1833400560 >> v2:172.21.15.110:3300/0 conn(0x7f5f340cf230 0x7f5f340cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.598+0000 7f5f2a7fc640 1 -- 172.21.15.55:0/1833400560 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f340cfc00 con 0x7f5f340cd260 2023-08-25T04:15:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.602+0000 7f5f2a7fc640 1 --2- 172.21.15.55:0/1833400560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f340cd260 0x7f5f340cd6c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5f340c99f0 tx=0x7f5f1c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657c00a74a2f559d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.602+0000 7f5f327fc640 1 -- 172.21.15.55:0/1833400560 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0aa620 con 0x7f5f340cd260 2023-08-25T04:15:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.602+0000 7f5f327fc640 1 -- 172.21.15.55:0/1833400560 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1c0aa780 con 0x7f5f340cd260 2023-08-25T04:15:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.602+0000 7f5f327fc640 1 -- 172.21.15.55:0/1833400560 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c0aab10 con 0x7f5f340cd260 2023-08-25T04:15:23.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.602+0000 7f5f395ba640 1 -- 172.21.15.55:0/1833400560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f340cd260 msgr2=0x7f5f340cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:23.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.602+0000 7f5f395ba640 1 --2- 172.21.15.55:0/1833400560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f340cd260 0x7f5f340cd6c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f5f340c99f0 tx=0x7f5f1c01c500 comp rx=0 tx=0).stop 2023-08-25T04:15:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.602+0000 7f5f395ba640 1 -- 172.21.15.55:0/1833400560 shutdown_connections 2023-08-25T04:15:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.602+0000 7f5f395ba640 1 --2- 172.21.15.55:0/1833400560 >> v2:172.21.15.110:3300/0 conn(0x7f5f340cf230 0x7f5f340cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.602+0000 7f5f395ba640 1 --2- 172.21.15.55:0/1833400560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f340cd260 0x7f5f340cd6c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.602+0000 7f5f395ba640 1 --2- 172.21.15.55:0/1833400560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f3415cbe0 0x7f5f340b5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.602+0000 7f5f395ba640 1 -- 172.21.15.55:0/1833400560 >> 172.21.15.55:0/1833400560 conn(0x7f5f340b4480 msgr2=0x7f5f340b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.602+0000 7f5f395ba640 1 -- 172.21.15.55:0/1833400560 shutdown_connections 2023-08-25T04:15:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.602+0000 7f5f395ba640 1 -- 172.21.15.55:0/1833400560 wait complete. 2023-08-25T04:15:23.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f395ba640 1 Processor -- start 2023-08-25T04:15:23.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f395ba640 1 -- start start 2023-08-25T04:15:23.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f395ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f340cd260 0x7f5f340c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:23.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f395ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f340cf230 0x7f5f3415dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:23.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f395ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3415cbe0 0x7f5f3414cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:23.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f395ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3414ead0 con 0x7f5f3415cbe0 2023-08-25T04:15:23.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f395ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3414edb0 con 0x7f5f340cf230 2023-08-25T04:15:23.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f395ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3414f090 con 0x7f5f340cd260 2023-08-25T04:15:23.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f337fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3415cbe0 0x7f5f3414cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:23.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f337fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3415cbe0 0x7f5f3414cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50218/0 (socket says 172.21.15.55:50218) 2023-08-25T04:15:23.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f337fe640 1 -- 172.21.15.55:0/730453047 learned_addr learned my addr 172.21.15.55:0/730453047 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:23.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f32ffd640 1 --2- 172.21.15.55:0/730453047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f340cd260 0x7f5f340c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:23.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f2a7fc640 1 --2- 172.21.15.55:0/730453047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f340cf230 0x7f5f3415dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:23.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f337fe640 1 -- 172.21.15.55:0/730453047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f340cd260 msgr2=0x7f5f340c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f337fe640 1 --2- 172.21.15.55:0/730453047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f340cd260 0x7f5f340c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f337fe640 1 -- 172.21.15.55:0/730453047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f340cf230 msgr2=0x7f5f3415dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f337fe640 1 --2- 172.21.15.55:0/730453047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f340cf230 0x7f5f3415dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f337fe640 1 -- 172.21.15.55:0/730453047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1c0094d0 con 0x7f5f3415cbe0 2023-08-25T04:15:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f337fe640 1 --2- 172.21.15.55:0/730453047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3415cbe0 0x7f5f3414cac0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00eed0 tx=0x7f5f2c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f2bfff640 1 -- 172.21.15.55:0/730453047 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c010040 con 0x7f5f3415cbe0 2023-08-25T04:15:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f2bfff640 1 -- 172.21.15.55:0/730453047 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c014400 con 0x7f5f3415cbe0 2023-08-25T04:15:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f2bfff640 1 -- 172.21.15.55:0/730453047 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c009ea0 con 0x7f5f3415cbe0 2023-08-25T04:15:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.606+0000 7f5f395ba640 1 -- 172.21.15.55:0/730453047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3414f370 con 0x7f5f3415cbe0 2023-08-25T04:15:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.610+0000 7f5f395ba640 1 -- 172.21.15.55:0/730453047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3415f5d0 con 0x7f5f3415cbe0 2023-08-25T04:15:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.610+0000 7f5f395ba640 1 -- 172.21.15.55:0/730453047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f34066d20 con 0x7f5f3415cbe0 2023-08-25T04:15:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.610+0000 7f5f2bfff640 1 -- 172.21.15.55:0/730453047 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f5f2c0147b0 con 0x7f5f3415cbe0 2023-08-25T04:15:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.610+0000 7f5f2bfff640 1 --2- 172.21.15.55:0/730453047 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f5f14065880 0x7f5f14067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.610+0000 7f5f2bfff640 1 -- 172.21.15.55:0/730453047 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f5f2c083a80 con 0x7f5f3415cbe0 2023-08-25T04:15:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.610+0000 7f5f32ffd640 1 --2- 172.21.15.55:0/730453047 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f5f14065880 0x7f5f14067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.610+0000 7f5f32ffd640 1 --2- 172.21.15.55:0/730453047 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f5f14065880 0x7f5f14067d40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009ac0 tx=0x7f5f24009190 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:23.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.614+0000 7f5f2bfff640 1 -- 172.21.15.55:0/730453047 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5f2c0510a0 con 0x7f5f3415cbe0 2023-08-25T04:15:23.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.794+0000 7f5f395ba640 1 -- 172.21.15.55:0/730453047 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f3414ef20 con 0x7f5f14065880 2023-08-25T04:15:23.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.862+0000 7f5f2bfff640 1 -- 172.21.15.55:0/730453047 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f5f3414ef20 con 0x7f5f14065880 2023-08-25T04:15:24.313 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-08-25T04:15:24.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.866+0000 7f5f395ba640 1 -- 172.21.15.55:0/730453047 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f5f14065880 msgr2=0x7f5f14067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:24.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.866+0000 7f5f395ba640 1 --2- 172.21.15.55:0/730453047 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f5f14065880 0x7f5f14067d40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009ac0 tx=0x7f5f24009190 comp rx=0 tx=0).stop 2023-08-25T04:15:24.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.866+0000 7f5f395ba640 1 -- 172.21.15.55:0/730453047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3415cbe0 msgr2=0x7f5f3414cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:24.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.866+0000 7f5f395ba640 1 --2- 172.21.15.55:0/730453047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3415cbe0 0x7f5f3414cac0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00eed0 tx=0x7f5f2c00b480 comp rx=0 tx=0).stop 2023-08-25T04:15:24.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.866+0000 7f5f395ba640 1 -- 172.21.15.55:0/730453047 shutdown_connections 2023-08-25T04:15:24.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.866+0000 7f5f395ba640 1 --2- 172.21.15.55:0/730453047 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f5f14065880 0x7f5f14067d40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.866+0000 7f5f395ba640 1 --2- 172.21.15.55:0/730453047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3415cbe0 0x7f5f3414cac0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.866+0000 7f5f395ba640 1 --2- 172.21.15.55:0/730453047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f340cf230 0x7f5f3415dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.866+0000 7f5f395ba640 1 --2- 172.21.15.55:0/730453047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f340cd260 0x7f5f340c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.866+0000 7f5f395ba640 1 -- 172.21.15.55:0/730453047 >> 172.21.15.55:0/730453047 conn(0x7f5f340b4480 msgr2=0x7f5f340b7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.866+0000 7f5f395ba640 1 -- 172.21.15.55:0/730453047 shutdown_connections 2023-08-25T04:15:24.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:23.866+0000 7f5f395ba640 1 -- 172.21.15.55:0/730453047 wait complete. 2023-08-25T04:15:24.317 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-08-25T04:15:24.317 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-08-25T04:15:24.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.470+0000 7f8f8229e640 1 Processor -- start 2023-08-25T04:15:24.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.474+0000 7f8f8229e640 1 -- start start 2023-08-25T04:15:24.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.474+0000 7f8f8229e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8f7c0cd870 0x7f8f7c0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:24.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.474+0000 7f8f8229e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f7c0cf9b0 0x7f8f7c0ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:24.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.474+0000 7f8f8229e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f7c0cae70 con 0x7f8f7c0afa20 2023-08-25T04:15:24.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.474+0000 7f8f8229e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f7c0cfe40 con 0x7f8f7c0cd870 2023-08-25T04:15:24.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.474+0000 7f8f8229e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c0cb0e0 con 0x7f8f7c0cf9b0 2023-08-25T04:15:24.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.474+0000 7f8f7bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8f7c0afa20 0x7f8f7c0cd160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38870/0 (socket says 172.21.15.55:38870) 2023-08-25T04:15:24.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.474+0000 7f8f7bfff640 1 -- 172.21.15.55:0/1467551240 learned_addr learned my addr 172.21.15.55:0/1467551240 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:24.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.474+0000 7f8f7b7fe640 1 --2- 172.21.15.55:0/1467551240 >> v2:172.21.15.110:3300/0 conn(0x7f8f7c0cd870 0x7f8f7c0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:24.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.474+0000 7f8f8083b640 1 --2- 172.21.15.55:0/1467551240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f7c0cf9b0 0x7f8f7c0ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:24.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.474+0000 7f8f7affd640 1 -- 172.21.15.55:0/1467551240 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560714998 0 0) 0x7f8f7c0cae70 con 0x7f8f7c0afa20 2023-08-25T04:15:24.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.474+0000 7f8f7affd640 1 -- 172.21.15.55:0/1467551240 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f64003530 con 0x7f8f7c0afa20 2023-08-25T04:15:24.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.474+0000 7f8f7b7fe640 1 -- 172.21.15.55:0/1467551240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f7c0cf9b0 msgr2=0x7f8f7c0ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:24.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.474+0000 7f8f7b7fe640 1 --2- 172.21.15.55:0/1467551240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f7c0cf9b0 0x7f8f7c0ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:24.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.474+0000 7f8f7b7fe640 1 -- 172.21.15.55:0/1467551240 >> v1:172.21.15.55:6789/0 conn(0x7f8f7c0afa20 legacy=0x7f8f7c0cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:24.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.474+0000 7f8f7b7fe640 1 -- 172.21.15.55:0/1467551240 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c0cb3c0 con 0x7f8f7c0cd870 2023-08-25T04:15:24.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.478+0000 7f8f7b7fe640 1 --2- 172.21.15.55:0/1467551240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f7c0cd870 0x7f8f7c0b00e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8f700097c0 tx=0x7f8f7001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11e5392b78841d15 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:24.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.478+0000 7f8f7affd640 1 -- 172.21.15.55:0/1467551240 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f700ac620 con 0x7f8f7c0cd870 2023-08-25T04:15:24.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.478+0000 7f8f7affd640 1 -- 172.21.15.55:0/1467551240 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f700ac780 con 0x7f8f7c0cd870 2023-08-25T04:15:24.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.478+0000 7f8f7affd640 1 -- 172.21.15.55:0/1467551240 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f700acb10 con 0x7f8f7c0cd870 2023-08-25T04:15:24.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.478+0000 7f8f8229e640 1 -- 172.21.15.55:0/1467551240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f7c0cd870 msgr2=0x7f8f7c0b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:24.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.478+0000 7f8f8229e640 1 --2- 172.21.15.55:0/1467551240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f7c0cd870 0x7f8f7c0b00e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8f700097c0 tx=0x7f8f7001c3c0 comp rx=0 tx=0).stop 2023-08-25T04:15:24.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.478+0000 7f8f8229e640 1 -- 172.21.15.55:0/1467551240 shutdown_connections 2023-08-25T04:15:24.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.478+0000 7f8f8229e640 1 --2- 172.21.15.55:0/1467551240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f7c0cf9b0 0x7f8f7c0ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:24.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.478+0000 7f8f8229e640 1 --2- 172.21.15.55:0/1467551240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f7c0cd870 0x7f8f7c0b00e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:24.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.478+0000 7f8f8229e640 1 -- 172.21.15.55:0/1467551240 >> 172.21.15.55:0/1467551240 conn(0x7f8f7c0d0780 msgr2=0x7f8f7c0d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:24.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.478+0000 7f8f8229e640 1 -- 172.21.15.55:0/1467551240 shutdown_connections 2023-08-25T04:15:24.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.478+0000 7f8f8229e640 1 -- 172.21.15.55:0/1467551240 wait complete. 2023-08-25T04:15:24.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.478+0000 7f8f8229e640 1 Processor -- start 2023-08-25T04:15:24.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8229e640 1 -- start start 2023-08-25T04:15:24.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8229e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f7c0afa20 0x7f8f7c150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:24.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8229e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f7c0cd870 0x7f8f7c157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:24.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8229e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f7c0cf9b0 0x7f8f7c157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:24.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8229e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c0c66b0 con 0x7f8f7c0cf9b0 2023-08-25T04:15:24.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8229e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c0c5aa0 con 0x7f8f7c0afa20 2023-08-25T04:15:24.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8229e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c0c5d80 con 0x7f8f7c0cd870 2023-08-25T04:15:24.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8083b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f7c0cf9b0 0x7f8f7c157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:24.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8083b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f7c0cf9b0 0x7f8f7c157950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50226/0 (socket says 172.21.15.55:50226) 2023-08-25T04:15:24.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8083b640 1 -- 172.21.15.55:0/216247735 learned_addr learned my addr 172.21.15.55:0/216247735 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:24.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f7b7fe640 1 --2- 172.21.15.55:0/216247735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f7c0cd870 0x7f8f7c157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:24.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f7bfff640 1 --2- 172.21.15.55:0/216247735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f7c0afa20 0x7f8f7c150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:24.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8083b640 1 -- 172.21.15.55:0/216247735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f7c0cd870 msgr2=0x7f8f7c157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:24.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8083b640 1 --2- 172.21.15.55:0/216247735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f7c0cd870 0x7f8f7c157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:24.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8083b640 1 -- 172.21.15.55:0/216247735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f7c0afa20 msgr2=0x7f8f7c150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:24.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8083b640 1 --2- 172.21.15.55:0/216247735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f7c0afa20 0x7f8f7c150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:24.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8083b640 1 -- 172.21.15.55:0/216247735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f70009420 con 0x7f8f7c0cf9b0 2023-08-25T04:15:24.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8083b640 1 --2- 172.21.15.55:0/216247735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f7c0cf9b0 0x7f8f7c157950 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400efc0 tx=0x7f8f7400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:24.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f78ff9640 1 -- 172.21.15.55:0/216247735 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74009ba0 con 0x7f8f7c0cf9b0 2023-08-25T04:15:24.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f78ff9640 1 -- 172.21.15.55:0/216247735 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7400f040 con 0x7f8f7c0cf9b0 2023-08-25T04:15:24.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f78ff9640 1 -- 172.21.15.55:0/216247735 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f740146c0 con 0x7f8f7c0cf9b0 2023-08-25T04:15:24.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8229e640 1 -- 172.21.15.55:0/216247735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f7c0c6060 con 0x7f8f7c0cf9b0 2023-08-25T04:15:24.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8229e640 1 -- 172.21.15.55:0/216247735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7c153490 con 0x7f8f7c0cf9b0 2023-08-25T04:15:24.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.482+0000 7f8f8229e640 1 -- 172.21.15.55:0/216247735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f7c0c6820 con 0x7f8f7c0cf9b0 2023-08-25T04:15:24.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.486+0000 7f8f78ff9640 1 -- 172.21.15.55:0/216247735 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f8f74014820 con 0x7f8f7c0cf9b0 2023-08-25T04:15:24.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.486+0000 7f8f78ff9640 1 --2- 172.21.15.55:0/216247735 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8f680658b0 0x7f8f68067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:24.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.486+0000 7f8f78ff9640 1 -- 172.21.15.55:0/216247735 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f8f74083f10 con 0x7f8f7c0cf9b0 2023-08-25T04:15:24.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.486+0000 7f8f7bfff640 1 --2- 172.21.15.55:0/216247735 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8f680658b0 0x7f8f68067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:24.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.486+0000 7f8f7bfff640 1 --2- 172.21.15.55:0/216247735 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8f680658b0 0x7f8f68067d70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0011f0 tx=0x7f8f6c009040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:24.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.490+0000 7f8f78ff9640 1 -- 172.21.15.55:0/216247735 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8f74051480 con 0x7f8f7c0cf9b0 2023-08-25T04:15:24.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.666+0000 7f8f8229e640 1 -- 172.21.15.55:0/216247735 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f7c0cdeb0 con 0x7f8f680658b0 2023-08-25T04:15:24.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.730+0000 7f8f78ff9640 1 -- 172.21.15.55:0/216247735 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f8f6c001cf0 con 0x7f8f680658b0 2023-08-25T04:15:24.730 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-08-25T04:15:24.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.734+0000 7f8f8229e640 1 -- 172.21.15.55:0/216247735 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8f680658b0 msgr2=0x7f8f68067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:24.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.734+0000 7f8f8229e640 1 --2- 172.21.15.55:0/216247735 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8f680658b0 0x7f8f68067d70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0011f0 tx=0x7f8f6c009040 comp rx=0 tx=0).stop 2023-08-25T04:15:24.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.734+0000 7f8f8229e640 1 -- 172.21.15.55:0/216247735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f7c0cf9b0 msgr2=0x7f8f7c157950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:24.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.734+0000 7f8f8229e640 1 --2- 172.21.15.55:0/216247735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f7c0cf9b0 0x7f8f7c157950 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400efc0 tx=0x7f8f7400c490 comp rx=0 tx=0).stop 2023-08-25T04:15:24.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.734+0000 7f8f8229e640 1 -- 172.21.15.55:0/216247735 shutdown_connections 2023-08-25T04:15:24.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.734+0000 7f8f8229e640 1 --2- 172.21.15.55:0/216247735 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8f680658b0 0x7f8f68067d70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:24.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.734+0000 7f8f8229e640 1 --2- 172.21.15.55:0/216247735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f7c0cf9b0 0x7f8f7c157950 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:24.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.734+0000 7f8f8229e640 1 --2- 172.21.15.55:0/216247735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f7c0cd870 0x7f8f7c157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:24.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.734+0000 7f8f8229e640 1 --2- 172.21.15.55:0/216247735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f7c0afa20 0x7f8f7c150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:24.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.734+0000 7f8f8229e640 1 -- 172.21.15.55:0/216247735 >> 172.21.15.55:0/216247735 conn(0x7f8f7c0d0780 msgr2=0x7f8f7c06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:24.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.734+0000 7f8f8229e640 1 -- 172.21.15.55:0/216247735 shutdown_connections 2023-08-25T04:15:24.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.734+0000 7f8f8229e640 1 -- 172.21.15.55:0/216247735 wait complete. 2023-08-25T04:15:24.751 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-08-25T04:15:24.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:24.753 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-08-25T04:15:24.765 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:24.766 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:24.766 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:24.766 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:24.766 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:24.767 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:24.767 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:24.767 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:24.767 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:24.767 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:24.768 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:24.769 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-25-04_05_00_UTC', 'scheduled-2023-08-25-04_06_00_UTC', 'scheduled-2023-08-25-04_07_00_UTC', 'scheduled-2023-08-25-04_08_00_UTC', 'scheduled-2023-08-25-04_09_00_UTC', 'scheduled-2023-08-25-04_10_00_UTC', 'scheduled-2023-08-25-04_11_00_UTC', 'scheduled-2023-08-25-04_12_00_UTC', 'scheduled-2023-08-25-04_13_00_UTC', 'scheduled-2023-08-25-04_14_00_UTC', 'scheduled-2023-08-25-04_15_00_UTC'] 2023-08-25T04:15:24.769 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-08-25T04:15:24.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.958+0000 7f3330903640 1 Processor -- start 2023-08-25T04:15:24.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.958+0000 7f3330903640 1 -- start start 2023-08-25T04:15:24.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.958+0000 7f3330903640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f332c15c180 0x7f332c0aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:24.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.958+0000 7f3330903640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332c15fa50 con 0x7f332c155740 2023-08-25T04:15:24.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.958+0000 7f3330903640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332c070260 con 0x7f332c155360 2023-08-25T04:15:24.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.958+0000 7f3330903640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332c15f2a0 con 0x7f332c15c180 2023-08-25T04:15:24.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.958+0000 7f332ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f332c15c180 0x7f332c0aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:24.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.958+0000 7f3321d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f332c155740 0x7f332c06fb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38886/0 (socket says 172.21.15.55:38886) 2023-08-25T04:15:24.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.958+0000 7f3321d9b640 1 -- 172.21.15.55:0/3421246204 learned_addr learned my addr 172.21.15.55:0/3421246204 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:24.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.962+0000 7f332ad9d640 1 -- 172.21.15.55:0/3421246204 >> v1:172.21.15.110:6789/0 conn(0x7f332c155360 legacy=0x7f332c15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:24.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.962+0000 7f332ad9d640 1 -- 172.21.15.55:0/3421246204 >> v1:172.21.15.55:6789/0 conn(0x7f332c155740 legacy=0x7f332c06fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:24.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.962+0000 7f332ad9d640 1 -- 172.21.15.55:0/3421246204 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c15f490 con 0x7f332c15c180 2023-08-25T04:15:24.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.962+0000 7f3329d9b640 1 -- 172.21.15.55:0/3421246204 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694705922 0 0) 0x7f332c15fa50 con 0x7f332c155740 2023-08-25T04:15:24.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.962+0000 7f332ad9d640 1 --2- 172.21.15.55:0/3421246204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c15c180 0x7f332c0aff90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f33240097c0 tx=0x7f332401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58aa2576325bd94d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:24.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.962+0000 7f3329d9b640 1 -- 172.21.15.55:0/3421246204 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33240ab600 con 0x7f332c15c180 2023-08-25T04:15:24.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.962+0000 7f3329d9b640 1 -- 172.21.15.55:0/3421246204 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33240a7050 con 0x7f332c15c180 2023-08-25T04:15:24.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.962+0000 7f3329d9b640 1 -- 172.21.15.55:0/3421246204 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33240ab980 con 0x7f332c15c180 2023-08-25T04:15:24.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.962+0000 7f3330903640 1 -- 172.21.15.55:0/3421246204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c15c180 msgr2=0x7f332c0aff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:24.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.962+0000 7f3330903640 1 --2- 172.21.15.55:0/3421246204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c15c180 0x7f332c0aff90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f33240097c0 tx=0x7f332401c360 comp rx=0 tx=0).stop 2023-08-25T04:15:24.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f3330903640 1 -- 172.21.15.55:0/3421246204 shutdown_connections 2023-08-25T04:15:24.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f3330903640 1 --2- 172.21.15.55:0/3421246204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c15c180 0x7f332c0aff90 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:24.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f3330903640 1 -- 172.21.15.55:0/3421246204 >> 172.21.15.55:0/3421246204 conn(0x7f332c0caf90 msgr2=0x7f332c0cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:24.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f3330903640 1 -- 172.21.15.55:0/3421246204 shutdown_connections 2023-08-25T04:15:24.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f3330903640 1 -- 172.21.15.55:0/3421246204 wait complete. 2023-08-25T04:15:24.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f3330903640 1 Processor -- start 2023-08-25T04:15:24.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f3330903640 1 -- start start 2023-08-25T04:15:24.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f3330903640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c155360 0x7f332c14d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:24.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f3330903640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f332c155740 0x7f332c0c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:24.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f3330903640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f332c15c180 0x7f332c0ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:24.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f3330903640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c151590 con 0x7f332c155360 2023-08-25T04:15:24.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f3330903640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c150910 con 0x7f332c15c180 2023-08-25T04:15:24.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f3330903640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c150bf0 con 0x7f332c155740 2023-08-25T04:15:24.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f332a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c155360 0x7f332c14d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f332a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c155360 0x7f332c14d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50240/0 (socket says 172.21.15.55:50240) 2023-08-25T04:15:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f332a59c640 1 -- 172.21.15.55:0/4279327441 learned_addr learned my addr 172.21.15.55:0/4279327441 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f3321d9b640 1 --2- 172.21.15.55:0/4279327441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f332c155740 0x7f332c0c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f332ad9d640 1 --2- 172.21.15.55:0/4279327441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f332c15c180 0x7f332c0ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f332a59c640 1 -- 172.21.15.55:0/4279327441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f332c155740 msgr2=0x7f332c0c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f332a59c640 1 --2- 172.21.15.55:0/4279327441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f332c155740 0x7f332c0c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:24.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f332a59c640 1 -- 172.21.15.55:0/4279327441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f332c15c180 msgr2=0x7f332c0ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:24.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f332a59c640 1 --2- 172.21.15.55:0/4279327441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f332c15c180 0x7f332c0ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:24.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f332a59c640 1 -- 172.21.15.55:0/4279327441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3324009420 con 0x7f332c155360 2023-08-25T04:15:24.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.966+0000 7f332ad9d640 1 --2- 172.21.15.55:0/4279327441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f332c15c180 0x7f332c0ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:24.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.970+0000 7f332a59c640 1 --2- 172.21.15.55:0/4279327441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c155360 0x7f332c14d970 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f331c00c7a0 tx=0x7f331c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:24.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.970+0000 7f33237fe640 1 -- 172.21.15.55:0/4279327441 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c003b80 con 0x7f332c155360 2023-08-25T04:15:24.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.970+0000 7f33237fe640 1 -- 172.21.15.55:0/4279327441 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331c003ce0 con 0x7f332c155360 2023-08-25T04:15:24.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.970+0000 7f3330903640 1 -- 172.21.15.55:0/4279327441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332c150ed0 con 0x7f332c155360 2023-08-25T04:15:24.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.970+0000 7f33237fe640 1 -- 172.21.15.55:0/4279327441 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c00aa90 con 0x7f332c155360 2023-08-25T04:15:24.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.970+0000 7f3330903640 1 -- 172.21.15.55:0/4279327441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332c14deb0 con 0x7f332c155360 2023-08-25T04:15:24.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.970+0000 7f3330903640 1 -- 172.21.15.55:0/4279327441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332c04dbe0 con 0x7f332c155360 2023-08-25T04:15:24.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.970+0000 7f33237fe640 1 -- 172.21.15.55:0/4279327441 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f331c00abf0 con 0x7f332c155360 2023-08-25T04:15:24.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.970+0000 7f33237fe640 1 --2- 172.21.15.55:0/4279327441 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f330c065880 0x7f330c067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:24.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.974+0000 7f33237fe640 1 -- 172.21.15.55:0/4279327441 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f331c082ff0 con 0x7f332c155360 2023-08-25T04:15:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.974+0000 7f3321d9b640 1 --2- 172.21.15.55:0/4279327441 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f330c065880 0x7f330c067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.974+0000 7f3321d9b640 1 --2- 172.21.15.55:0/4279327441 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f330c065880 0x7f330c067d40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f332c0add10 tx=0x7f3314007240 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:24.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:24.978+0000 7f33237fe640 1 -- 172.21.15.55:0/4279327441 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f331c0b3d90 con 0x7f332c155360 2023-08-25T04:15:25.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.150+0000 7f3330903640 1 -- 172.21.15.55:0/4279327441 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f332c14e0d0 con 0x7f330c065880 2023-08-25T04:15:25.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.162+0000 7f33237fe640 1 -- 172.21.15.55:0/4279327441 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f3314001510 con 0x7f330c065880 2023-08-25T04:15:25.159 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:25.160 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:17", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:25.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.162+0000 7f3330903640 1 -- 172.21.15.55:0/4279327441 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f330c065880 msgr2=0x7f330c067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.162+0000 7f3330903640 1 --2- 172.21.15.55:0/4279327441 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f330c065880 0x7f330c067d40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f332c0add10 tx=0x7f3314007240 comp rx=0 tx=0).stop 2023-08-25T04:15:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.162+0000 7f3330903640 1 -- 172.21.15.55:0/4279327441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c155360 msgr2=0x7f332c14d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.162+0000 7f3330903640 1 --2- 172.21.15.55:0/4279327441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c155360 0x7f332c14d970 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f331c00c7a0 tx=0x7f331c00cc60 comp rx=0 tx=0).stop 2023-08-25T04:15:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.162+0000 7f3330903640 1 -- 172.21.15.55:0/4279327441 shutdown_connections 2023-08-25T04:15:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.162+0000 7f3330903640 1 --2- 172.21.15.55:0/4279327441 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f330c065880 0x7f330c067d40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.162+0000 7f3330903640 1 --2- 172.21.15.55:0/4279327441 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f332c15c180 0x7f332c0ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.162+0000 7f3330903640 1 --2- 172.21.15.55:0/4279327441 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f332c155740 0x7f332c0c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.162+0000 7f3330903640 1 --2- 172.21.15.55:0/4279327441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c155360 0x7f332c14d970 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.162+0000 7f3330903640 1 -- 172.21.15.55:0/4279327441 >> 172.21.15.55:0/4279327441 conn(0x7f332c0caf90 msgr2=0x7f332c0ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.162+0000 7f3330903640 1 -- 172.21.15.55:0/4279327441 shutdown_connections 2023-08-25T04:15:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.162+0000 7f3330903640 1 -- 172.21.15.55:0/4279327441 wait complete. 2023-08-25T04:15:25.180 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:17", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:25.181 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-08-25T00:00:00', 'created': '2023-08-25T04:04:17', 'first': '2023-08-25T04:05:00', 'last': '2023-08-25T04:15:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-25T04:15:25.183 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-08-25T04:15:25.183 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-08-25T04:15:25.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:25.185 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-08-25T04:15:25.197 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:25.197 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:25.197 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:25.197 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:25.198 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:25.198 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:25.198 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:25.198 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:25.198 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:25.198 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:25.198 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:25.199 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-25-04_05_00_UTC', 'scheduled-2023-08-25-04_06_00_UTC', 'scheduled-2023-08-25-04_07_00_UTC', 'scheduled-2023-08-25-04_08_00_UTC', 'scheduled-2023-08-25-04_09_00_UTC', 'scheduled-2023-08-25-04_10_00_UTC', 'scheduled-2023-08-25-04_11_00_UTC', 'scheduled-2023-08-25-04_12_00_UTC', 'scheduled-2023-08-25-04_13_00_UTC', 'scheduled-2023-08-25-04_14_00_UTC', 'scheduled-2023-08-25-04_15_00_UTC'] 2023-08-25T04:15:25.200 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-08-25T04:15:25.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.390+0000 7f722b511640 1 Processor -- start 2023-08-25T04:15:25.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.390+0000 7f722b511640 1 -- start start 2023-08-25T04:15:25.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.390+0000 7f722b511640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f72240afa20 0x7f72240b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:25.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.390+0000 7f722b511640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72240cf9b0 0x7f72240ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:25.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.390+0000 7f722b511640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72240cae70 con 0x7f72240cd160 2023-08-25T04:15:25.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.390+0000 7f722b511640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72240cfe10 con 0x7f72240afa20 2023-08-25T04:15:25.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.390+0000 7f722b511640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72240cb0e0 con 0x7f72240cf9b0 2023-08-25T04:15:25.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.390+0000 7f72292ad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f72240afa20 0x7f72240b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:25.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.390+0000 7f72292ad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f72240afa20 0x7f72240b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50252/0 (socket says 172.21.15.55:50252) 2023-08-25T04:15:25.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.390+0000 7f72292ad640 1 -- 172.21.15.55:0/1991553388 learned_addr learned my addr 172.21.15.55:0/1991553388 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:25.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.390+0000 7f7228aac640 1 --2- 172.21.15.55:0/1991553388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72240cf9b0 0x7f72240ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:25.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.390+0000 7f72292ad640 1 -- 172.21.15.55:0/1991553388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72240cf9b0 msgr2=0x7f72240ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:25.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.390+0000 7f72292ad640 1 --2- 172.21.15.55:0/1991553388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72240cf9b0 0x7f72240ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.390+0000 7f72292ad640 1 -- 172.21.15.55:0/1991553388 >> v1:172.21.15.110:6789/0 conn(0x7f72240cd160 legacy=0x7f722415c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:25.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.390+0000 7f72292ad640 1 -- 172.21.15.55:0/1991553388 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72240cb3c0 con 0x7f72240afa20 2023-08-25T04:15:25.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.394+0000 7f72292ad640 1 --2- 172.21.15.55:0/1991553388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72240afa20 0x7f72240b00e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7220009870 tx=0x7f722001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24dda66b943bc6b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:25.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.394+0000 7f721bfff640 1 -- 172.21.15.55:0/1991553388 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72200ab680 con 0x7f72240afa20 2023-08-25T04:15:25.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.394+0000 7f721bfff640 1 -- 172.21.15.55:0/1991553388 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72200ab7e0 con 0x7f72240afa20 2023-08-25T04:15:25.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.394+0000 7f721bfff640 1 -- 172.21.15.55:0/1991553388 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72200abb70 con 0x7f72240afa20 2023-08-25T04:15:25.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.394+0000 7f722b511640 1 -- 172.21.15.55:0/1991553388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72240afa20 msgr2=0x7f72240b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:25.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.394+0000 7f722b511640 1 --2- 172.21.15.55:0/1991553388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72240afa20 0x7f72240b00e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7220009870 tx=0x7f722001c480 comp rx=0 tx=0).stop 2023-08-25T04:15:25.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.394+0000 7f722b511640 1 -- 172.21.15.55:0/1991553388 shutdown_connections 2023-08-25T04:15:25.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.394+0000 7f722b511640 1 --2- 172.21.15.55:0/1991553388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72240cf9b0 0x7f72240ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.394+0000 7f722b511640 1 --2- 172.21.15.55:0/1991553388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72240afa20 0x7f72240b00e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.394+0000 7f722b511640 1 -- 172.21.15.55:0/1991553388 >> 172.21.15.55:0/1991553388 conn(0x7f72240d0780 msgr2=0x7f72240d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:25.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.394+0000 7f722b511640 1 -- 172.21.15.55:0/1991553388 shutdown_connections 2023-08-25T04:15:25.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.394+0000 7f722b511640 1 -- 172.21.15.55:0/1991553388 wait complete. 2023-08-25T04:15:25.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f722b511640 1 Processor -- start 2023-08-25T04:15:25.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f722b511640 1 -- start start 2023-08-25T04:15:25.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f722b511640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72240afa20 0x7f7224152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:25.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f722b511640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72240cd160 0x7f7224153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:25.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f722b511640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72240cf9b0 0x7f722414b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:25.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f722b511640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72241599b0 con 0x7f72240cf9b0 2023-08-25T04:15:25.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f722b511640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7224153c50 con 0x7f72240afa20 2023-08-25T04:15:25.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f722b511640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7224153f30 con 0x7f72240cd160 2023-08-25T04:15:25.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f7229aae640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72240cf9b0 0x7f722414b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:25.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f7228aac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72240cd160 0x7f7224153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:25.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f72292ad640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72240afa20 0x7f7224152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:25.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f7229aae640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72240cf9b0 0x7f722414b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50256/0 (socket says 172.21.15.55:50256) 2023-08-25T04:15:25.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f7229aae640 1 -- 172.21.15.55:0/159494018 learned_addr learned my addr 172.21.15.55:0/159494018 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:25.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f7229aae640 1 -- 172.21.15.55:0/159494018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72240cd160 msgr2=0x7f7224153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:25.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f7229aae640 1 --2- 172.21.15.55:0/159494018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72240cd160 0x7f7224153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f7229aae640 1 -- 172.21.15.55:0/159494018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72240afa20 msgr2=0x7f7224152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:25.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f7229aae640 1 --2- 172.21.15.55:0/159494018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72240afa20 0x7f7224152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f7229aae640 1 -- 172.21.15.55:0/159494018 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72200094d0 con 0x7f72240cf9b0 2023-08-25T04:15:25.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f7229aae640 1 --2- 172.21.15.55:0/159494018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72240cf9b0 0x7f722414b830 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f721c00c730 tx=0x7f721c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:25.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f7219ffb640 1 -- 172.21.15.55:0/159494018 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c003b80 con 0x7f72240cf9b0 2023-08-25T04:15:25.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f7219ffb640 1 -- 172.21.15.55:0/159494018 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721c003ce0 con 0x7f72240cf9b0 2023-08-25T04:15:25.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f7219ffb640 1 -- 172.21.15.55:0/159494018 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721c00aa30 con 0x7f72240cf9b0 2023-08-25T04:15:25.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f722b511640 1 -- 172.21.15.55:0/159494018 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7224154210 con 0x7f72240cf9b0 2023-08-25T04:15:25.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.398+0000 7f722b511640 1 -- 172.21.15.55:0/159494018 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72241547d0 con 0x7f72240cf9b0 2023-08-25T04:15:25.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.402+0000 7f722b511640 1 -- 172.21.15.55:0/159494018 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f722404dbe0 con 0x7f72240cf9b0 2023-08-25T04:15:25.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.402+0000 7f7219ffb640 1 -- 172.21.15.55:0/159494018 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f721c00ab90 con 0x7f72240cf9b0 2023-08-25T04:15:25.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.402+0000 7f7219ffb640 1 --2- 172.21.15.55:0/159494018 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f7208065880 0x7f7208067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:25.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.402+0000 7f7219ffb640 1 -- 172.21.15.55:0/159494018 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f721c082fd0 con 0x7f72240cf9b0 2023-08-25T04:15:25.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.402+0000 7f72292ad640 1 --2- 172.21.15.55:0/159494018 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f7208065880 0x7f7208067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:25.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.402+0000 7f72292ad640 1 --2- 172.21.15.55:0/159494018 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f7208065880 0x7f7208067d40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f72200af000 tx=0x7f72200b6040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:25.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.406+0000 7f7219ffb640 1 -- 172.21.15.55:0/159494018 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f721c050700 con 0x7f72240cf9b0 2023-08-25T04:15:25.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.582+0000 7f722b511640 1 -- 172.21.15.55:0/159494018 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f72240cdeb0 con 0x7f7208065880 2023-08-25T04:15:25.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.590+0000 7f7219ffb640 1 -- 172.21.15.55:0/159494018 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f72200ab950 con 0x7f7208065880 2023-08-25T04:15:25.591 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:25.591 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:17", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:25.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.594+0000 7f722b511640 1 -- 172.21.15.55:0/159494018 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f7208065880 msgr2=0x7f7208067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:25.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.594+0000 7f722b511640 1 --2- 172.21.15.55:0/159494018 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f7208065880 0x7f7208067d40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f72200af000 tx=0x7f72200b6040 comp rx=0 tx=0).stop 2023-08-25T04:15:25.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.594+0000 7f722b511640 1 -- 172.21.15.55:0/159494018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72240cf9b0 msgr2=0x7f722414b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:25.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.594+0000 7f722b511640 1 --2- 172.21.15.55:0/159494018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72240cf9b0 0x7f722414b830 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f721c00c730 tx=0x7f721c00cbf0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.594+0000 7f722b511640 1 -- 172.21.15.55:0/159494018 shutdown_connections 2023-08-25T04:15:25.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.594+0000 7f722b511640 1 --2- 172.21.15.55:0/159494018 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f7208065880 0x7f7208067d40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.594+0000 7f722b511640 1 --2- 172.21.15.55:0/159494018 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72240cf9b0 0x7f722414b830 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.594+0000 7f722b511640 1 --2- 172.21.15.55:0/159494018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72240cd160 0x7f7224153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.594+0000 7f722b511640 1 --2- 172.21.15.55:0/159494018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72240afa20 0x7f7224152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.594+0000 7f722b511640 1 -- 172.21.15.55:0/159494018 >> 172.21.15.55:0/159494018 conn(0x7f72240d0780 msgr2=0x7f722406f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:25.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.594+0000 7f722b511640 1 -- 172.21.15.55:0/159494018 shutdown_connections 2023-08-25T04:15:25.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.594+0000 7f722b511640 1 -- 172.21.15.55:0/159494018 wait complete. 2023-08-25T04:15:25.611 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:17", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:25.612 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-08-25T00:00:00', 'created': '2023-08-25T04:04:17', 'first': '2023-08-25T04:05:00', 'last': '2023-08-25T04:15:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-25T04:15:25.612 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-08-25T04:15:25.612 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-08-25T04:15:25.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:25.613 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-08-25T04:15:25.623 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:25.623 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:25.624 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:25.624 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:25.624 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:25.624 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:25.624 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:25.624 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:25.624 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:25.625 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:25.625 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:25.626 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-25-04_05_00_UTC', 'scheduled-2023-08-25-04_06_00_UTC', 'scheduled-2023-08-25-04_07_00_UTC', 'scheduled-2023-08-25-04_08_00_UTC', 'scheduled-2023-08-25-04_09_00_UTC', 'scheduled-2023-08-25-04_10_00_UTC', 'scheduled-2023-08-25-04_11_00_UTC', 'scheduled-2023-08-25-04_12_00_UTC', 'scheduled-2023-08-25-04_13_00_UTC', 'scheduled-2023-08-25-04_14_00_UTC', 'scheduled-2023-08-25-04_15_00_UTC'] 2023-08-25T04:15:25.627 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-08-25T04:15:25.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.822+0000 7f38d8c9e640 1 Processor -- start 2023-08-25T04:15:25.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.822+0000 7f38d8c9e640 1 -- start start 2023-08-25T04:15:25.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.822+0000 7f38d8c9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38d406fb50 0x7f38d40cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:25.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.822+0000 7f38d8c9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38d40cc930 0x7f38d40ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:25.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.822+0000 7f38d8c9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d40c9270 con 0x7f38d4159d00 2023-08-25T04:15:25.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.822+0000 7f38d8c9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d40cc510 con 0x7f38d40cc930 2023-08-25T04:15:25.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.822+0000 7f38d8c9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d40ce220 con 0x7f38d406fb50 2023-08-25T04:15:25.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.826+0000 7f38d259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f38d4159d00 0x7f38d40c8b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38892/0 (socket says 172.21.15.55:38892) 2023-08-25T04:15:25.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.826+0000 7f38d259c640 1 -- 172.21.15.55:0/2310464947 learned_addr learned my addr 172.21.15.55:0/2310464947 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:25.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.826+0000 7f38d2d9d640 1 --2- 172.21.15.55:0/2310464947 >> v2:172.21.15.55:3300/0 conn(0x7f38d40cc930 0x7f38d40ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:25.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.826+0000 7f38c9d9b640 1 --2- 172.21.15.55:0/2310464947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38d406fb50 0x7f38d40cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.826+0000 7f38d1d9b640 1 -- 172.21.15.55:0/2310464947 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879986506 0 0) 0x7f38d40c9270 con 0x7f38d4159d00 2023-08-25T04:15:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.826+0000 7f38d1d9b640 1 -- 172.21.15.55:0/2310464947 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38c0003530 con 0x7f38d4159d00 2023-08-25T04:15:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.826+0000 7f38d2d9d640 1 -- 172.21.15.55:0/2310464947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38d406fb50 msgr2=0x7f38d40cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.826+0000 7f38d2d9d640 1 --2- 172.21.15.55:0/2310464947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38d406fb50 0x7f38d40cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.826+0000 7f38d2d9d640 1 -- 172.21.15.55:0/2310464947 >> v1:172.21.15.55:6789/0 conn(0x7f38d4159d00 legacy=0x7f38d40c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.826+0000 7f38d2d9d640 1 -- 172.21.15.55:0/2310464947 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d40ca6c0 con 0x7f38d40cc930 2023-08-25T04:15:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.826+0000 7f38d2d9d640 1 --2- 172.21.15.55:0/2310464947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d40cc930 0x7f38d40ccda0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0097c0 tx=0x7f38cc01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b3fb360d94eb0c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.826+0000 7f38d1d9b640 1 -- 172.21.15.55:0/2310464947 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc0ac620 con 0x7f38d40cc930 2023-08-25T04:15:25.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.826+0000 7f38d1d9b640 1 -- 172.21.15.55:0/2310464947 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc0ac780 con 0x7f38d40cc930 2023-08-25T04:15:25.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.826+0000 7f38d1d9b640 1 -- 172.21.15.55:0/2310464947 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc0acaf0 con 0x7f38d40cc930 2023-08-25T04:15:25.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.830+0000 7f38d8c9e640 1 -- 172.21.15.55:0/2310464947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d40cc930 msgr2=0x7f38d40ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:25.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.830+0000 7f38d8c9e640 1 --2- 172.21.15.55:0/2310464947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d40cc930 0x7f38d40ccda0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0097c0 tx=0x7f38cc01c3c0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.830+0000 7f38d8c9e640 1 -- 172.21.15.55:0/2310464947 shutdown_connections 2023-08-25T04:15:25.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.830+0000 7f38d8c9e640 1 --2- 172.21.15.55:0/2310464947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38d406fb50 0x7f38d40cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.830+0000 7f38d8c9e640 1 --2- 172.21.15.55:0/2310464947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d40cc930 0x7f38d40ccda0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.830+0000 7f38d8c9e640 1 -- 172.21.15.55:0/2310464947 >> 172.21.15.55:0/2310464947 conn(0x7f38d40caf90 msgr2=0x7f38d40cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:25.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.830+0000 7f38d8c9e640 1 -- 172.21.15.55:0/2310464947 shutdown_connections 2023-08-25T04:15:25.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.830+0000 7f38d8c9e640 1 -- 172.21.15.55:0/2310464947 wait complete. 2023-08-25T04:15:25.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.830+0000 7f38d8c9e640 1 Processor -- start 2023-08-25T04:15:25.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.830+0000 7f38d8c9e640 1 -- start start 2023-08-25T04:15:25.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.830+0000 7f38d8c9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38d406fb50 0x7f38d40c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:25.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.830+0000 7f38d8c9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38d40cc930 0x7f38d4162e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:25.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.830+0000 7f38d8c9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d4159d00 0x7f38d41633a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:25.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.830+0000 7f38d8c9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d40c6e00 con 0x7f38d4159d00 2023-08-25T04:15:25.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.830+0000 7f38d8c9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d41f6430 con 0x7f38d406fb50 2023-08-25T04:15:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.830+0000 7f38d8c9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d41f6150 con 0x7f38d40cc930 2023-08-25T04:15:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.830+0000 7f38d2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d4159d00 0x7f38d41633a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.830+0000 7f38d2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d4159d00 0x7f38d41633a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50272/0 (socket says 172.21.15.55:50272) 2023-08-25T04:15:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.834+0000 7f38d2d9d640 1 -- 172.21.15.55:0/2501031265 learned_addr learned my addr 172.21.15.55:0/2501031265 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.834+0000 7f38c9d9b640 1 --2- 172.21.15.55:0/2501031265 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38d40cc930 0x7f38d4162e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:25.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.834+0000 7f38d259c640 1 --2- 172.21.15.55:0/2501031265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38d406fb50 0x7f38d40c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.834+0000 7f38d2d9d640 1 -- 172.21.15.55:0/2501031265 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38d40cc930 msgr2=0x7f38d4162e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.834+0000 7f38d2d9d640 1 --2- 172.21.15.55:0/2501031265 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38d40cc930 0x7f38d4162e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.834+0000 7f38d2d9d640 1 -- 172.21.15.55:0/2501031265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38d406fb50 msgr2=0x7f38d40c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.834+0000 7f38d2d9d640 1 --2- 172.21.15.55:0/2501031265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38d406fb50 0x7f38d40c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.834+0000 7f38d2d9d640 1 -- 172.21.15.55:0/2501031265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc009420 con 0x7f38d4159d00 2023-08-25T04:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.834+0000 7f38d259c640 1 --2- 172.21.15.55:0/2501031265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38d406fb50 0x7f38d40c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:25.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.834+0000 7f38d2d9d640 1 --2- 172.21.15.55:0/2501031265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d4159d00 0x7f38d41633a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0097c0 tx=0x7f38cc019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:25.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.834+0000 7f38cb7fe640 1 -- 172.21.15.55:0/2501031265 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc0ac620 con 0x7f38d4159d00 2023-08-25T04:15:25.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.834+0000 7f38cb7fe640 1 -- 172.21.15.55:0/2501031265 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc0ac8f0 con 0x7f38d4159d00 2023-08-25T04:15:25.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.834+0000 7f38cb7fe640 1 -- 172.21.15.55:0/2501031265 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc0acc60 con 0x7f38d4159d00 2023-08-25T04:15:25.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.834+0000 7f38d8c9e640 1 -- 172.21.15.55:0/2501031265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d41f8bf0 con 0x7f38d4159d00 2023-08-25T04:15:25.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.834+0000 7f38d8c9e640 1 -- 172.21.15.55:0/2501031265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d41f91b0 con 0x7f38d4159d00 2023-08-25T04:15:25.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.834+0000 7f38d8c9e640 1 -- 172.21.15.55:0/2501031265 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d41f8a50 con 0x7f38d4159d00 2023-08-25T04:15:25.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.834+0000 7f38cb7fe640 1 -- 172.21.15.55:0/2501031265 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f38cc0b3040 con 0x7f38d4159d00 2023-08-25T04:15:25.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.838+0000 7f38cb7fe640 1 --2- 172.21.15.55:0/2501031265 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f38b4065880 0x7f38b4067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:25.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.838+0000 7f38cb7fe640 1 -- 172.21.15.55:0/2501031265 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f38cc11d300 con 0x7f38d4159d00 2023-08-25T04:15:25.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.838+0000 7f38d259c640 1 --2- 172.21.15.55:0/2501031265 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f38b4065880 0x7f38b4067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:25.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.838+0000 7f38d259c640 1 --2- 172.21.15.55:0/2501031265 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f38b4065880 0x7f38b4067d40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f38c4005c10 tx=0x7f38c4009040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:25.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:25.842+0000 7f38cb7fe640 1 -- 172.21.15.55:0/2501031265 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f38d41f8a50 con 0x7f38d4159d00 2023-08-25T04:15:26.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.014+0000 7f38d8c9e640 1 -- 172.21.15.55:0/2501031265 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38d415a0e0 con 0x7f38b4065880 2023-08-25T04:15:26.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.026+0000 7f38cb7fe640 1 -- 172.21.15.55:0/2501031265 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f38c400edc0 con 0x7f38b4065880 2023-08-25T04:15:26.023 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:26.024 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:18", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:26.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.026+0000 7f38d8c9e640 1 -- 172.21.15.55:0/2501031265 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f38b4065880 msgr2=0x7f38b4067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:26.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.026+0000 7f38d8c9e640 1 --2- 172.21.15.55:0/2501031265 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f38b4065880 0x7f38b4067d40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f38c4005c10 tx=0x7f38c4009040 comp rx=0 tx=0).stop 2023-08-25T04:15:26.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.026+0000 7f38d8c9e640 1 -- 172.21.15.55:0/2501031265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d4159d00 msgr2=0x7f38d41633a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:26.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.026+0000 7f38d8c9e640 1 --2- 172.21.15.55:0/2501031265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d4159d00 0x7f38d41633a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0097c0 tx=0x7f38cc019160 comp rx=0 tx=0).stop 2023-08-25T04:15:26.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.026+0000 7f38d8c9e640 1 -- 172.21.15.55:0/2501031265 shutdown_connections 2023-08-25T04:15:26.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.026+0000 7f38d8c9e640 1 --2- 172.21.15.55:0/2501031265 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f38b4065880 0x7f38b4067d40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.026+0000 7f38d8c9e640 1 --2- 172.21.15.55:0/2501031265 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38d4159d00 0x7f38d41633a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.026+0000 7f38d8c9e640 1 --2- 172.21.15.55:0/2501031265 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38d40cc930 0x7f38d4162e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.026+0000 7f38d8c9e640 1 --2- 172.21.15.55:0/2501031265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38d406fb50 0x7f38d40c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.026+0000 7f38d8c9e640 1 -- 172.21.15.55:0/2501031265 >> 172.21.15.55:0/2501031265 conn(0x7f38d40caf90 msgr2=0x7f38d415de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:26.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.026+0000 7f38d8c9e640 1 -- 172.21.15.55:0/2501031265 shutdown_connections 2023-08-25T04:15:26.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.026+0000 7f38d8c9e640 1 -- 172.21.15.55:0/2501031265 wait complete. 2023-08-25T04:15:26.045 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:18", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:26.046 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-08-25T00:00:00', 'created': '2023-08-25T04:04:18', 'first': '2023-08-25T04:05:00', 'last': '2023-08-25T04:15:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-25T04:15:26.046 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-08-25T04:15:26.046 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-08-25T04:15:26.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:26.047 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-08-25T04:15:26.060 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:26.061 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:26.061 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:26.061 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:26.061 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:26.061 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:26.062 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:26.062 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:26.062 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:26.062 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:26.062 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:26.062 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-25-04_05_00_UTC', 'scheduled-2023-08-25-04_06_00_UTC', 'scheduled-2023-08-25-04_07_00_UTC', 'scheduled-2023-08-25-04_08_00_UTC', 'scheduled-2023-08-25-04_09_00_UTC', 'scheduled-2023-08-25-04_10_00_UTC', 'scheduled-2023-08-25-04_11_00_UTC', 'scheduled-2023-08-25-04_12_00_UTC', 'scheduled-2023-08-25-04_13_00_UTC', 'scheduled-2023-08-25-04_14_00_UTC', 'scheduled-2023-08-25-04_15_00_UTC'] 2023-08-25T04:15:26.063 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-08-25T04:15:26.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.250+0000 7fbe27b82640 1 Processor -- start 2023-08-25T04:15:26.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.250+0000 7fbe27b82640 1 -- start start 2023-08-25T04:15:26.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.254+0000 7fbe27b82640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbe2015cb40 0x7fbe200d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:26.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.254+0000 7fbe27b82640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbe200cf340 0x7fbe200cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:26.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.254+0000 7fbe27b82640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe200d1970 con 0x7fbe200b43e0 2023-08-25T04:15:26.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.254+0000 7fbe27b82640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe200cfcf0 con 0x7fbe200cf340 2023-08-25T04:15:26.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.254+0000 7fbe27b82640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe200d0d80 con 0x7fbe2015cb40 2023-08-25T04:15:26.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.254+0000 7fbe2511d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbe200cf340 0x7fbe200cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:26.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.254+0000 7fbe2611f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbe200b43e0 0x7fbe200b4810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38900/0 (socket says 172.21.15.55:38900) 2023-08-25T04:15:26.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.254+0000 7fbe2611f640 1 -- 172.21.15.55:0/1692011808 learned_addr learned my addr 172.21.15.55:0/1692011808 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:26.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.254+0000 7fbe2591e640 1 --2- 172.21.15.55:0/1692011808 >> v2:172.21.15.110:3300/0 conn(0x7fbe2015cb40 0x7fbe200d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:26.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.254+0000 7fbe2491c640 1 -- 172.21.15.55:0/1692011808 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768081293 0 0) 0x7fbe200d1970 con 0x7fbe200b43e0 2023-08-25T04:15:26.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.254+0000 7fbe2511d640 1 -- 172.21.15.55:0/1692011808 >> v2:172.21.15.110:3300/0 conn(0x7fbe2015cb40 msgr2=0x7fbe200d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:26.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.254+0000 7fbe2511d640 1 --2- 172.21.15.55:0/1692011808 >> v2:172.21.15.110:3300/0 conn(0x7fbe2015cb40 0x7fbe200d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.254+0000 7fbe2511d640 1 -- 172.21.15.55:0/1692011808 >> v1:172.21.15.55:6789/0 conn(0x7fbe200b43e0 legacy=0x7fbe200b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:26.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.254+0000 7fbe2511d640 1 -- 172.21.15.55:0/1692011808 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe200d1040 con 0x7fbe200cf340 2023-08-25T04:15:26.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.254+0000 7fbe2511d640 1 --2- 172.21.15.55:0/1692011808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe200cf340 0x7fbe200cf7b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbe2008b5a0 tx=0x7fbe1001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d1a7d597932b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:26.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe2491c640 1 -- 172.21.15.55:0/1692011808 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe100a8950 con 0x7fbe200cf340 2023-08-25T04:15:26.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe2491c640 1 -- 172.21.15.55:0/1692011808 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe100a8ab0 con 0x7fbe200cf340 2023-08-25T04:15:26.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe2491c640 1 -- 172.21.15.55:0/1692011808 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe100a8e40 con 0x7fbe200cf340 2023-08-25T04:15:26.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe27b82640 1 -- 172.21.15.55:0/1692011808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe200cf340 msgr2=0x7fbe200cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:26.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe27b82640 1 --2- 172.21.15.55:0/1692011808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe200cf340 0x7fbe200cf7b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbe2008b5a0 tx=0x7fbe1001ec50 comp rx=0 tx=0).stop 2023-08-25T04:15:26.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe27b82640 1 -- 172.21.15.55:0/1692011808 shutdown_connections 2023-08-25T04:15:26.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe27b82640 1 --2- 172.21.15.55:0/1692011808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe200cf340 0x7fbe200cf7b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe27b82640 1 --2- 172.21.15.55:0/1692011808 >> v2:172.21.15.110:3300/0 conn(0x7fbe2015cb40 0x7fbe200d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe27b82640 1 -- 172.21.15.55:0/1692011808 >> 172.21.15.55:0/1692011808 conn(0x7fbe2006aae0 msgr2=0x7fbe2006aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:26.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe27b82640 1 -- 172.21.15.55:0/1692011808 shutdown_connections 2023-08-25T04:15:26.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe27b82640 1 -- 172.21.15.55:0/1692011808 wait complete. 2023-08-25T04:15:26.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe27b82640 1 Processor -- start 2023-08-25T04:15:26.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe27b82640 1 -- start start 2023-08-25T04:15:26.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe27b82640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe200b43e0 0x7fbe2015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:26.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe27b82640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe200cf340 0x7fbe2015f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:26.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe27b82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe2015cb40 0x7fbe2015f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:26.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe27b82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe200c7490 con 0x7fbe2015cb40 2023-08-25T04:15:26.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe27b82640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe200c7770 con 0x7fbe200cf340 2023-08-25T04:15:26.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe27b82640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe200c7a50 con 0x7fbe200b43e0 2023-08-25T04:15:26.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe2611f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe2015cb40 0x7fbe2015f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:26.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe2611f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe2015cb40 0x7fbe2015f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50288/0 (socket says 172.21.15.55:50288) 2023-08-25T04:15:26.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.258+0000 7fbe2611f640 1 -- 172.21.15.55:0/621175345 learned_addr learned my addr 172.21.15.55:0/621175345 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:26.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.262+0000 7fbe2591e640 1 --2- 172.21.15.55:0/621175345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe200b43e0 0x7fbe2015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:26.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.262+0000 7fbe2511d640 1 --2- 172.21.15.55:0/621175345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe200cf340 0x7fbe2015f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:26.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.262+0000 7fbe2611f640 1 -- 172.21.15.55:0/621175345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe200b43e0 msgr2=0x7fbe2015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:26.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.262+0000 7fbe2611f640 1 --2- 172.21.15.55:0/621175345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe200b43e0 0x7fbe2015a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.262+0000 7fbe2611f640 1 -- 172.21.15.55:0/621175345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe200cf340 msgr2=0x7fbe2015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:26.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.262+0000 7fbe2611f640 1 --2- 172.21.15.55:0/621175345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe200cf340 0x7fbe2015f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.262+0000 7fbe2611f640 1 -- 172.21.15.55:0/621175345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe10009420 con 0x7fbe2015cb40 2023-08-25T04:15:26.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.262+0000 7fbe2611f640 1 --2- 172.21.15.55:0/621175345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe2015cb40 0x7fbe2015f630 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800c700 tx=0x7fbe1800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:26.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.262+0000 7fbe167fc640 1 -- 172.21.15.55:0/621175345 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1800ce10 con 0x7fbe2015cb40 2023-08-25T04:15:26.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.262+0000 7fbe167fc640 1 -- 172.21.15.55:0/621175345 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1800a640 con 0x7fbe2015cb40 2023-08-25T04:15:26.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.262+0000 7fbe167fc640 1 -- 172.21.15.55:0/621175345 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1800aa70 con 0x7fbe2015cb40 2023-08-25T04:15:26.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.262+0000 7fbe27b82640 1 -- 172.21.15.55:0/621175345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe200c7d30 con 0x7fbe2015cb40 2023-08-25T04:15:26.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.262+0000 7fbe27b82640 1 -- 172.21.15.55:0/621175345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2015a6c0 con 0x7fbe2015cb40 2023-08-25T04:15:26.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.262+0000 7fbe27b82640 1 -- 172.21.15.55:0/621175345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe20071f80 con 0x7fbe2015cb40 2023-08-25T04:15:26.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.262+0000 7fbe167fc640 1 -- 172.21.15.55:0/621175345 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7fbe1800abd0 con 0x7fbe2015cb40 2023-08-25T04:15:26.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.262+0000 7fbe167fc640 1 --2- 172.21.15.55:0/621175345 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fbe04065880 0x7fbe04067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:26.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.262+0000 7fbe167fc640 1 -- 172.21.15.55:0/621175345 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fbe18082860 con 0x7fbe2015cb40 2023-08-25T04:15:26.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.266+0000 7fbe2591e640 1 --2- 172.21.15.55:0/621175345 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fbe04065880 0x7fbe04067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:26.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.266+0000 7fbe2591e640 1 --2- 172.21.15.55:0/621175345 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fbe04065880 0x7fbe04067d40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00b9d0 tx=0x7fbe1c008040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:26.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.266+0000 7fbe167fc640 1 -- 172.21.15.55:0/621175345 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbe1804fee0 con 0x7fbe2015cb40 2023-08-25T04:15:26.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.442+0000 7fbe27b82640 1 -- 172.21.15.55:0/621175345 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbe200d1600 con 0x7fbe04065880 2023-08-25T04:15:26.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.450+0000 7fbe167fc640 1 -- 172.21.15.55:0/621175345 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fbe1c00f860 con 0x7fbe04065880 2023-08-25T04:15:26.451 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:26.451 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:18", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:26.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.454+0000 7fbe27b82640 1 -- 172.21.15.55:0/621175345 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fbe04065880 msgr2=0x7fbe04067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:26.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.454+0000 7fbe27b82640 1 --2- 172.21.15.55:0/621175345 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fbe04065880 0x7fbe04067d40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00b9d0 tx=0x7fbe1c008040 comp rx=0 tx=0).stop 2023-08-25T04:15:26.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.454+0000 7fbe27b82640 1 -- 172.21.15.55:0/621175345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe2015cb40 msgr2=0x7fbe2015f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:26.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.454+0000 7fbe27b82640 1 --2- 172.21.15.55:0/621175345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe2015cb40 0x7fbe2015f630 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800c700 tx=0x7fbe1800cbc0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.454+0000 7fbe27b82640 1 -- 172.21.15.55:0/621175345 shutdown_connections 2023-08-25T04:15:26.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.454+0000 7fbe27b82640 1 --2- 172.21.15.55:0/621175345 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fbe04065880 0x7fbe04067d40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.454+0000 7fbe27b82640 1 --2- 172.21.15.55:0/621175345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe2015cb40 0x7fbe2015f630 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.454+0000 7fbe27b82640 1 --2- 172.21.15.55:0/621175345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe200cf340 0x7fbe2015f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.454+0000 7fbe27b82640 1 --2- 172.21.15.55:0/621175345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe200b43e0 0x7fbe2015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.454+0000 7fbe27b82640 1 -- 172.21.15.55:0/621175345 >> 172.21.15.55:0/621175345 conn(0x7fbe2006aae0 msgr2=0x7fbe20072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:26.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.454+0000 7fbe27b82640 1 -- 172.21.15.55:0/621175345 shutdown_connections 2023-08-25T04:15:26.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.454+0000 7fbe27b82640 1 -- 172.21.15.55:0/621175345 wait complete. 2023-08-25T04:15:26.471 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:18", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:26.471 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-08-25T00:00:00', 'created': '2023-08-25T04:04:18', 'first': '2023-08-25T04:05:00', 'last': '2023-08-25T04:15:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-25T04:15:26.471 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-08-25T04:15:26.472 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-08-25T04:15:26.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:26.473 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-08-25T04:15:26.483 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:26.484 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:26.484 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:26.484 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:26.485 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:26.485 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:26.485 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:26.485 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:26.486 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:26.486 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:26.486 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:26.488 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-25-04_05_00_UTC', 'scheduled-2023-08-25-04_06_00_UTC', 'scheduled-2023-08-25-04_07_00_UTC', 'scheduled-2023-08-25-04_08_00_UTC', 'scheduled-2023-08-25-04_09_00_UTC', 'scheduled-2023-08-25-04_10_00_UTC', 'scheduled-2023-08-25-04_11_00_UTC', 'scheduled-2023-08-25-04_12_00_UTC', 'scheduled-2023-08-25-04_13_00_UTC', 'scheduled-2023-08-25-04_14_00_UTC', 'scheduled-2023-08-25-04_15_00_UTC'] 2023-08-25T04:15:26.489 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-08-25T04:15:26.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.678+0000 7f7ffa374640 1 Processor -- start 2023-08-25T04:15:26.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.678+0000 7f7ffa374640 1 -- start start 2023-08-25T04:15:26.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.678+0000 7f7ffa374640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ff415cb40 0x7f7ff40d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:26.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.678+0000 7f7ffa374640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff40b6a00 0x7f7ff40cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:26.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.678+0000 7f7ffa374640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff40d1970 con 0x7f7ff40cf340 2023-08-25T04:15:26.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.678+0000 7f7ffa374640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff40cfcf0 con 0x7f7ff415cb40 2023-08-25T04:15:26.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.678+0000 7f7ffa374640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff40d0d80 con 0x7f7ff40b6a00 2023-08-25T04:15:26.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.678+0000 7f7ff37fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7ff40cf340 0x7f7ff40b43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38906/0 (socket says 172.21.15.55:38906) 2023-08-25T04:15:26.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.678+0000 7f7ff37fe640 1 -- 172.21.15.55:0/2647843372 learned_addr learned my addr 172.21.15.55:0/2647843372 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:26.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.678+0000 7f7ff8911640 1 --2- 172.21.15.55:0/2647843372 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff40b6a00 0x7f7ff40cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:26.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.678+0000 7f7ff3fff640 1 --2- 172.21.15.55:0/2647843372 >> v2:172.21.15.110:3300/0 conn(0x7f7ff415cb40 0x7f7ff40d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:26.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.682+0000 7f7ff2ffd640 1 -- 172.21.15.55:0/2647843372 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321222242 0 0) 0x7f7ff40d1970 con 0x7f7ff40cf340 2023-08-25T04:15:26.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.682+0000 7f7ff2ffd640 1 -- 172.21.15.55:0/2647843372 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fdc003530 con 0x7f7ff40cf340 2023-08-25T04:15:26.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.682+0000 7f7ff3fff640 1 -- 172.21.15.55:0/2647843372 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff40b6a00 msgr2=0x7f7ff40cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:26.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.682+0000 7f7ff3fff640 1 --2- 172.21.15.55:0/2647843372 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff40b6a00 0x7f7ff40cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.682+0000 7f7ff3fff640 1 -- 172.21.15.55:0/2647843372 >> v1:172.21.15.55:6789/0 conn(0x7f7ff40cf340 legacy=0x7f7ff40b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:26.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.682+0000 7f7ff3fff640 1 -- 172.21.15.55:0/2647843372 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff40d1040 con 0x7f7ff415cb40 2023-08-25T04:15:26.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.682+0000 7f7ff8911640 1 --2- 172.21.15.55:0/2647843372 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff40b6a00 0x7f7ff40cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:15:26.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.682+0000 7f7ff3fff640 1 --2- 172.21.15.55:0/2647843372 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff415cb40 0x7f7ff40d2080 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40097c0 tx=0x7f7fe401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d24956565064a0b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:26.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.682+0000 7f7ff2ffd640 1 -- 172.21.15.55:0/2647843372 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe40a8970 con 0x7f7ff415cb40 2023-08-25T04:15:26.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.682+0000 7f7ff2ffd640 1 -- 172.21.15.55:0/2647843372 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe40a8ad0 con 0x7f7ff415cb40 2023-08-25T04:15:26.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.682+0000 7f7ff2ffd640 1 -- 172.21.15.55:0/2647843372 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe40a8e60 con 0x7f7ff415cb40 2023-08-25T04:15:26.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.682+0000 7f7ffa374640 1 -- 172.21.15.55:0/2647843372 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff415cb40 msgr2=0x7f7ff40d2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:26.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.682+0000 7f7ffa374640 1 --2- 172.21.15.55:0/2647843372 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff415cb40 0x7f7ff40d2080 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40097c0 tx=0x7f7fe401ec70 comp rx=0 tx=0).stop 2023-08-25T04:15:26.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.682+0000 7f7ffa374640 1 -- 172.21.15.55:0/2647843372 shutdown_connections 2023-08-25T04:15:26.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.682+0000 7f7ffa374640 1 --2- 172.21.15.55:0/2647843372 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff40b6a00 0x7f7ff40cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.682+0000 7f7ffa374640 1 --2- 172.21.15.55:0/2647843372 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff415cb40 0x7f7ff40d2080 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.682+0000 7f7ffa374640 1 -- 172.21.15.55:0/2647843372 >> 172.21.15.55:0/2647843372 conn(0x7f7ff406aae0 msgr2=0x7f7ff406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:26.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ffa374640 1 -- 172.21.15.55:0/2647843372 shutdown_connections 2023-08-25T04:15:26.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ffa374640 1 -- 172.21.15.55:0/2647843372 wait complete. 2023-08-25T04:15:26.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ffa374640 1 Processor -- start 2023-08-25T04:15:26.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ffa374640 1 -- start start 2023-08-25T04:15:26.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ffa374640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff40b6a00 0x7f7ff415eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:26.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ffa374640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff40cf340 0x7f7ff40c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:26.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ffa374640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ff415cb40 0x7f7ff414dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:26.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ffa374640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff40c73e0 con 0x7f7ff415cb40 2023-08-25T04:15:26.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ffa374640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff40c75f0 con 0x7f7ff40cf340 2023-08-25T04:15:26.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ffa374640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff40c78d0 con 0x7f7ff40b6a00 2023-08-25T04:15:26.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ff8911640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ff415cb40 0x7f7ff414dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:26.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ff8911640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ff415cb40 0x7f7ff414dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50294/0 (socket says 172.21.15.55:50294) 2023-08-25T04:15:26.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ff8911640 1 -- 172.21.15.55:0/4054370516 learned_addr learned my addr 172.21.15.55:0/4054370516 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:26.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ff3fff640 1 --2- 172.21.15.55:0/4054370516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff40b6a00 0x7f7ff415eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:26.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ff37fe640 1 --2- 172.21.15.55:0/4054370516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff40cf340 0x7f7ff40c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:26.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ff8911640 1 -- 172.21.15.55:0/4054370516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff40b6a00 msgr2=0x7f7ff415eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:26.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ff8911640 1 --2- 172.21.15.55:0/4054370516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff40b6a00 0x7f7ff415eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ff8911640 1 -- 172.21.15.55:0/4054370516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff40cf340 msgr2=0x7f7ff40c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:26.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ff8911640 1 --2- 172.21.15.55:0/4054370516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff40cf340 0x7f7ff40c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ff8911640 1 -- 172.21.15.55:0/4054370516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec009a70 con 0x7f7ff415cb40 2023-08-25T04:15:26.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ff37fe640 1 --2- 172.21.15.55:0/4054370516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff40cf340 0x7f7ff40c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:26.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.686+0000 7f7ff8911640 1 --2- 172.21.15.55:0/4054370516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ff415cb40 0x7f7ff414dea0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00efc0 tx=0x7f7fec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:26.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.690+0000 7f7ff0ff9640 1 -- 172.21.15.55:0/4054370516 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec009cd0 con 0x7f7ff415cb40 2023-08-25T04:15:26.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.690+0000 7f7ff0ff9640 1 -- 172.21.15.55:0/4054370516 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fec00f040 con 0x7f7ff415cb40 2023-08-25T04:15:26.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.690+0000 7f7ff0ff9640 1 -- 172.21.15.55:0/4054370516 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec0039a0 con 0x7f7ff415cb40 2023-08-25T04:15:26.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.690+0000 7f7ffa374640 1 -- 172.21.15.55:0/4054370516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe4009420 con 0x7f7ff415cb40 2023-08-25T04:15:26.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.690+0000 7f7ffa374640 1 -- 172.21.15.55:0/4054370516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff40c7e90 con 0x7f7ff415cb40 2023-08-25T04:15:26.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.690+0000 7f7ffa374640 1 -- 172.21.15.55:0/4054370516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff4071f80 con 0x7f7ff415cb40 2023-08-25T04:15:26.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.690+0000 7f7ff0ff9640 1 -- 172.21.15.55:0/4054370516 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f7fec014480 con 0x7f7ff415cb40 2023-08-25T04:15:26.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.690+0000 7f7ff0ff9640 1 --2- 172.21.15.55:0/4054370516 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f7fe0065880 0x7f7fe0067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:26.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.690+0000 7f7ff0ff9640 1 -- 172.21.15.55:0/4054370516 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f7fec083f90 con 0x7f7ff415cb40 2023-08-25T04:15:26.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.690+0000 7f7ff3fff640 1 --2- 172.21.15.55:0/4054370516 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f7fe0065880 0x7f7fe0067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:26.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.694+0000 7f7ff3fff640 1 --2- 172.21.15.55:0/4054370516 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f7fe0065880 0x7f7fe0067d40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40b2000 tx=0x7f7fe40aa070 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:26.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.694+0000 7f7ff0ff9640 1 -- 172.21.15.55:0/4054370516 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7fec051500 con 0x7f7ff415cb40 2023-08-25T04:15:26.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.870+0000 7f7ffa374640 1 -- 172.21.15.55:0/4054370516 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ff40d1320 con 0x7f7fe0065880 2023-08-25T04:15:26.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.882+0000 7f7ff0ff9640 1 -- 172.21.15.55:0/4054370516 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f7fe40ba470 con 0x7f7fe0065880 2023-08-25T04:15:26.881 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:26.882 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:19", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:26.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.882+0000 7f7ffa374640 1 -- 172.21.15.55:0/4054370516 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f7fe0065880 msgr2=0x7f7fe0067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:26.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.882+0000 7f7ffa374640 1 --2- 172.21.15.55:0/4054370516 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f7fe0065880 0x7f7fe0067d40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40b2000 tx=0x7f7fe40aa070 comp rx=0 tx=0).stop 2023-08-25T04:15:26.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.882+0000 7f7ffa374640 1 -- 172.21.15.55:0/4054370516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ff415cb40 msgr2=0x7f7ff414dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:26.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.882+0000 7f7ffa374640 1 --2- 172.21.15.55:0/4054370516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ff415cb40 0x7f7ff414dea0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00efc0 tx=0x7f7fec00c490 comp rx=0 tx=0).stop 2023-08-25T04:15:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.886+0000 7f7ffa374640 1 -- 172.21.15.55:0/4054370516 shutdown_connections 2023-08-25T04:15:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.886+0000 7f7ffa374640 1 --2- 172.21.15.55:0/4054370516 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f7fe0065880 0x7f7fe0067d40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.886+0000 7f7ffa374640 1 --2- 172.21.15.55:0/4054370516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ff415cb40 0x7f7ff414dea0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.886+0000 7f7ffa374640 1 --2- 172.21.15.55:0/4054370516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff40cf340 0x7f7ff40c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.886+0000 7f7ffa374640 1 --2- 172.21.15.55:0/4054370516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff40b6a00 0x7f7ff415eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.886+0000 7f7ffa374640 1 -- 172.21.15.55:0/4054370516 >> 172.21.15.55:0/4054370516 conn(0x7f7ff406aae0 msgr2=0x7f7ff40cb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.886+0000 7f7ffa374640 1 -- 172.21.15.55:0/4054370516 shutdown_connections 2023-08-25T04:15:26.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:26.886+0000 7f7ffa374640 1 -- 172.21.15.55:0/4054370516 wait complete. 2023-08-25T04:15:26.903 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:19", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:26.904 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-08-25T00:00:00', 'created': '2023-08-25T04:04:19', 'first': '2023-08-25T04:05:00', 'last': '2023-08-25T04:15:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-25T04:15:26.905 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-08-25T04:15:26.906 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-08-25T04:15:26.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:26.907 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-08-25T04:15:26.918 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:26.919 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:26.919 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:26.919 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:26.919 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:26.920 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:26.920 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:26.920 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:26.920 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:26.920 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:26.921 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:26.922 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-25-04_05_00_UTC', 'scheduled-2023-08-25-04_06_00_UTC', 'scheduled-2023-08-25-04_07_00_UTC', 'scheduled-2023-08-25-04_08_00_UTC', 'scheduled-2023-08-25-04_09_00_UTC', 'scheduled-2023-08-25-04_10_00_UTC', 'scheduled-2023-08-25-04_11_00_UTC', 'scheduled-2023-08-25-04_12_00_UTC', 'scheduled-2023-08-25-04_13_00_UTC', 'scheduled-2023-08-25-04_14_00_UTC', 'scheduled-2023-08-25-04_15_00_UTC'] 2023-08-25T04:15:26.923 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-08-25T04:15:27.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.114+0000 7f82cf38f640 1 Processor -- start 2023-08-25T04:15:27.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.114+0000 7f82cf38f640 1 -- start start 2023-08-25T04:15:27.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.114+0000 7f82cf38f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f82c8158d80 0x7f82c80ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.114+0000 7f82cf38f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f82c80ca8e0 0x7f82c80cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.114+0000 7f82cf38f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82c80ce0f0 0x7f82c80cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.114+0000 7f82cf38f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c80ce5a0 con 0x7f82c80ca8e0 2023-08-25T04:15:27.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.114+0000 7f82cf38f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c8069900 con 0x7f82c8158d80 2023-08-25T04:15:27.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.114+0000 7f82cf38f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c80cae10 con 0x7f82c80ce0f0 2023-08-25T04:15:27.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.114+0000 7f82cc92a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f82c80ca8e0 0x7f82c80cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.114+0000 7f82cc92a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f82c80ca8e0 0x7f82c80cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50296/0 (socket says 172.21.15.55:50296) 2023-08-25T04:15:27.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.114+0000 7f82cc92a640 1 -- 172.21.15.55:0/4189831833 learned_addr learned my addr 172.21.15.55:0/4189831833 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:27.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.114+0000 7f82cd92c640 1 --2- 172.21.15.55:0/4189831833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82c80ce0f0 0x7f82c80cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.114+0000 7f82cd12b640 1 --2- 172.21.15.55:0/4189831833 >> v2:172.21.15.110:3300/0 conn(0x7f82c8158d80 0x7f82c80ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.118+0000 7f82cc92a640 1 -- 172.21.15.55:0/4189831833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82c80ce0f0 msgr2=0x7f82c80cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:27.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.118+0000 7f82cc92a640 1 --2- 172.21.15.55:0/4189831833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82c80ce0f0 0x7f82c80cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.118+0000 7f82cc92a640 1 -- 172.21.15.55:0/4189831833 >> v2:172.21.15.110:3300/0 conn(0x7f82c8158d80 msgr2=0x7f82c80ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:27.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.118+0000 7f82cc92a640 1 --2- 172.21.15.55:0/4189831833 >> v2:172.21.15.110:3300/0 conn(0x7f82c8158d80 0x7f82c80ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.118+0000 7f82cc92a640 1 -- 172.21.15.55:0/4189831833 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c80cb0f0 con 0x7f82c80ca8e0 2023-08-25T04:15:27.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.118+0000 7f82cd92c640 1 --2- 172.21.15.55:0/4189831833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82c80ce0f0 0x7f82c80cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:27.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.118+0000 7f82cc92a640 1 --2- 172.21.15.55:0/4189831833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c80ca8e0 0x7f82c80cdbb0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f82c80cc890 tx=0x7f82b801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be356d35d25703e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:27.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.118+0000 7f82bffff640 1 -- 172.21.15.55:0/4189831833 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b80ab600 con 0x7f82c80ca8e0 2023-08-25T04:15:27.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.118+0000 7f82bffff640 1 -- 172.21.15.55:0/4189831833 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b80a7050 con 0x7f82c80ca8e0 2023-08-25T04:15:27.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.118+0000 7f82bffff640 1 -- 172.21.15.55:0/4189831833 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b80ab980 con 0x7f82c80ca8e0 2023-08-25T04:15:27.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.118+0000 7f82cf38f640 1 -- 172.21.15.55:0/4189831833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c80ca8e0 msgr2=0x7f82c80cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:27.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.118+0000 7f82cf38f640 1 --2- 172.21.15.55:0/4189831833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c80ca8e0 0x7f82c80cdbb0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f82c80cc890 tx=0x7f82b801c3b0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.118+0000 7f82cf38f640 1 -- 172.21.15.55:0/4189831833 shutdown_connections 2023-08-25T04:15:27.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.118+0000 7f82cf38f640 1 --2- 172.21.15.55:0/4189831833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82c80ce0f0 0x7f82c80cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.118+0000 7f82cf38f640 1 --2- 172.21.15.55:0/4189831833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c80ca8e0 0x7f82c80cdbb0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.118+0000 7f82cf38f640 1 --2- 172.21.15.55:0/4189831833 >> v2:172.21.15.110:3300/0 conn(0x7f82c8158d80 0x7f82c80ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.118+0000 7f82cf38f640 1 -- 172.21.15.55:0/4189831833 >> 172.21.15.55:0/4189831833 conn(0x7f82c80cb790 msgr2=0x7f82c80cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:27.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cf38f640 1 -- 172.21.15.55:0/4189831833 shutdown_connections 2023-08-25T04:15:27.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cf38f640 1 -- 172.21.15.55:0/4189831833 wait complete. 2023-08-25T04:15:27.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cf38f640 1 Processor -- start 2023-08-25T04:15:27.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cf38f640 1 -- start start 2023-08-25T04:15:27.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cf38f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c80ca8e0 0x7f82c806cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cf38f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82c80ce0f0 0x7f82c806c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cf38f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82c8158d80 0x7f82c814d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cf38f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c814e810 con 0x7f82c80ca8e0 2023-08-25T04:15:27.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cf38f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c81460e0 con 0x7f82c80ce0f0 2023-08-25T04:15:27.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cf38f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c806c9c0 con 0x7f82c8158d80 2023-08-25T04:15:27.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cd12b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c80ca8e0 0x7f82c806cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cd12b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c80ca8e0 0x7f82c806cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50304/0 (socket says 172.21.15.55:50304) 2023-08-25T04:15:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cd12b640 1 -- 172.21.15.55:0/1252712504 learned_addr learned my addr 172.21.15.55:0/1252712504 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cc92a640 1 --2- 172.21.15.55:0/1252712504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82c80ce0f0 0x7f82c806c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cd92c640 1 --2- 172.21.15.55:0/1252712504 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82c8158d80 0x7f82c814d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cd12b640 1 -- 172.21.15.55:0/1252712504 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82c8158d80 msgr2=0x7f82c814d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:27.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cd12b640 1 --2- 172.21.15.55:0/1252712504 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82c8158d80 0x7f82c814d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cd12b640 1 -- 172.21.15.55:0/1252712504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82c80ce0f0 msgr2=0x7f82c806c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:27.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cd12b640 1 --2- 172.21.15.55:0/1252712504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82c80ce0f0 0x7f82c806c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cd12b640 1 -- 172.21.15.55:0/1252712504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b80094d0 con 0x7f82c80ca8e0 2023-08-25T04:15:27.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cd12b640 1 --2- 172.21.15.55:0/1252712504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c80ca8e0 0x7f82c806cf30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f82c400e8a0 tx=0x7f82c400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:27.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82bdffb640 1 -- 172.21.15.55:0/1252712504 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4009510 con 0x7f82c80ca8e0 2023-08-25T04:15:27.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82bdffb640 1 -- 172.21.15.55:0/1252712504 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c400c940 con 0x7f82c80ca8e0 2023-08-25T04:15:27.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82bdffb640 1 -- 172.21.15.55:0/1252712504 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c400ccb0 con 0x7f82c80ca8e0 2023-08-25T04:15:27.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.122+0000 7f82cf38f640 1 -- 172.21.15.55:0/1252712504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c814e250 con 0x7f82c80ca8e0 2023-08-25T04:15:27.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.126+0000 7f82cf38f640 1 -- 172.21.15.55:0/1252712504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c80c5f80 con 0x7f82c80ca8e0 2023-08-25T04:15:27.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.126+0000 7f82cf38f640 1 -- 172.21.15.55:0/1252712504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c804dbe0 con 0x7f82c80ca8e0 2023-08-25T04:15:27.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.126+0000 7f82bdffb640 1 -- 172.21.15.55:0/1252712504 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f82c4013470 con 0x7f82c80ca8e0 2023-08-25T04:15:27.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.126+0000 7f82bdffb640 1 --2- 172.21.15.55:0/1252712504 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f82ac065880 0x7f82ac067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.126+0000 7f82bdffb640 1 -- 172.21.15.55:0/1252712504 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f82c4083400 con 0x7f82c80ca8e0 2023-08-25T04:15:27.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.126+0000 7f82cc92a640 1 --2- 172.21.15.55:0/1252712504 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f82ac065880 0x7f82ac067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.130+0000 7f82cc92a640 1 --2- 172.21.15.55:0/1252712504 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f82ac065880 0x7f82ac067d40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f82b80ad000 tx=0x7f82b8008040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:27.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.130+0000 7f82bdffb640 1 -- 172.21.15.55:0/1252712504 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f82c4050a80 con 0x7f82c80ca8e0 2023-08-25T04:15:27.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.306+0000 7f82cf38f640 1 -- 172.21.15.55:0/1252712504 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82c8159160 con 0x7f82ac065880 2023-08-25T04:15:27.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.314+0000 7f82bdffb640 1 -- 172.21.15.55:0/1252712504 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f82b80ab580 con 0x7f82ac065880 2023-08-25T04:15:27.315 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:27.315 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:19", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:27.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.318+0000 7f82cf38f640 1 -- 172.21.15.55:0/1252712504 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f82ac065880 msgr2=0x7f82ac067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:27.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.318+0000 7f82cf38f640 1 --2- 172.21.15.55:0/1252712504 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f82ac065880 0x7f82ac067d40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f82b80ad000 tx=0x7f82b8008040 comp rx=0 tx=0).stop 2023-08-25T04:15:27.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.318+0000 7f82cf38f640 1 -- 172.21.15.55:0/1252712504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c80ca8e0 msgr2=0x7f82c806cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:27.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.318+0000 7f82cf38f640 1 --2- 172.21.15.55:0/1252712504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c80ca8e0 0x7f82c806cf30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f82c400e8a0 tx=0x7f82c400eca0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.318+0000 7f82cf38f640 1 -- 172.21.15.55:0/1252712504 shutdown_connections 2023-08-25T04:15:27.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.318+0000 7f82cf38f640 1 --2- 172.21.15.55:0/1252712504 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f82ac065880 0x7f82ac067d40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.318+0000 7f82cf38f640 1 --2- 172.21.15.55:0/1252712504 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82c8158d80 0x7f82c814d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.318+0000 7f82cf38f640 1 --2- 172.21.15.55:0/1252712504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82c80ce0f0 0x7f82c806c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.318+0000 7f82cf38f640 1 --2- 172.21.15.55:0/1252712504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82c80ca8e0 0x7f82c806cf30 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.318+0000 7f82cf38f640 1 -- 172.21.15.55:0/1252712504 >> 172.21.15.55:0/1252712504 conn(0x7f82c80cb790 msgr2=0x7f82c80cd190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.318+0000 7f82cf38f640 1 -- 172.21.15.55:0/1252712504 shutdown_connections 2023-08-25T04:15:27.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.318+0000 7f82cf38f640 1 -- 172.21.15.55:0/1252712504 wait complete. 2023-08-25T04:15:27.334 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:19", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:27.335 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-08-25T00:00:00', 'created': '2023-08-25T04:04:19', 'first': '2023-08-25T04:05:00', 'last': '2023-08-25T04:15:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-25T04:15:27.335 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-08-25T04:15:27.335 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-08-25T04:15:27.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:27.337 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-08-25T04:15:27.347 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:27.347 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:27.348 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:27.348 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:27.348 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:27.348 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:27.348 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:27.348 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:27.349 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:27.349 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:27.349 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:27.350 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-25-04_05_00_UTC', 'scheduled-2023-08-25-04_06_00_UTC', 'scheduled-2023-08-25-04_07_00_UTC', 'scheduled-2023-08-25-04_08_00_UTC', 'scheduled-2023-08-25-04_09_00_UTC', 'scheduled-2023-08-25-04_10_00_UTC', 'scheduled-2023-08-25-04_11_00_UTC', 'scheduled-2023-08-25-04_12_00_UTC', 'scheduled-2023-08-25-04_13_00_UTC', 'scheduled-2023-08-25-04_14_00_UTC', 'scheduled-2023-08-25-04_15_00_UTC'] 2023-08-25T04:15:27.350 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-08-25T04:15:27.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2ec8a640 1 Processor -- start 2023-08-25T04:15:27.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2ec8a640 1 -- start start 2023-08-25T04:15:27.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2ec8a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8b28160120 0x7f8b280b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2ec8a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b280b4080 0x7f8b280b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2ec8a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b280b4a20 con 0x7f8b280d0500 2023-08-25T04:15:27.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2ec8a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b280b1f20 con 0x7f8b28160120 2023-08-25T04:15:27.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2ec8a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280cddf0 con 0x7f8b280b4080 2023-08-25T04:15:27.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2e489640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8b280d0500 0x7f8b280d0990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38922/0 (socket says 172.21.15.55:38922) 2023-08-25T04:15:27.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2e489640 1 -- 172.21.15.55:0/2365990588 learned_addr learned my addr 172.21.15.55:0/2365990588 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:27.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2d487640 1 --2- 172.21.15.55:0/2365990588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b280b4080 0x7f8b280b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2dc88640 1 --2- 172.21.15.55:0/2365990588 >> v2:172.21.15.110:3300/0 conn(0x7f8b28160120 0x7f8b280b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2cc86640 1 -- 172.21.15.55:0/2365990588 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008231542 0 0) 0x7f8b280b4a20 con 0x7f8b280d0500 2023-08-25T04:15:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2cc86640 1 -- 172.21.15.55:0/2365990588 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b14003530 con 0x7f8b280d0500 2023-08-25T04:15:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2cc86640 1 -- 172.21.15.55:0/2365990588 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 964633160 0 0) 0x7f8b14003530 con 0x7f8b280d0500 2023-08-25T04:15:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2d487640 1 -- 172.21.15.55:0/2365990588 >> v2:172.21.15.110:3300/0 conn(0x7f8b28160120 msgr2=0x7f8b280b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2d487640 1 --2- 172.21.15.55:0/2365990588 >> v2:172.21.15.110:3300/0 conn(0x7f8b28160120 0x7f8b280b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2d487640 1 -- 172.21.15.55:0/2365990588 >> v1:172.21.15.55:6789/0 conn(0x7f8b280d0500 legacy=0x7f8b280d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:27.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2d487640 1 -- 172.21.15.55:0/2365990588 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b280ce0d0 con 0x7f8b280b4080 2023-08-25T04:15:27.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.542+0000 7f8b2dc88640 1 --2- 172.21.15.55:0/2365990588 >> v2:172.21.15.110:3300/0 conn(0x7f8b28160120 0x7f8b280b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:15:27.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.546+0000 7f8b2d487640 1 --2- 172.21.15.55:0/2365990588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b280b4080 0x7f8b280b44e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b180097f0 tx=0x7f8b1801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4de34daa54740947 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:27.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.546+0000 7f8b2cc86640 1 -- 172.21.15.55:0/2365990588 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20001a00 con 0x7f8b280b4080 2023-08-25T04:15:27.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.546+0000 7f8b2cc86640 1 -- 172.21.15.55:0/2365990588 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b180a7050 con 0x7f8b280b4080 2023-08-25T04:15:27.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.546+0000 7f8b2cc86640 1 -- 172.21.15.55:0/2365990588 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b180ab620 con 0x7f8b280b4080 2023-08-25T04:15:27.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.546+0000 7f8b2ec8a640 1 -- 172.21.15.55:0/2365990588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b280b4080 msgr2=0x7f8b280b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:27.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.546+0000 7f8b2ec8a640 1 --2- 172.21.15.55:0/2365990588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b280b4080 0x7f8b280b44e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b180097f0 tx=0x7f8b1801c370 comp rx=0 tx=0).stop 2023-08-25T04:15:27.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.546+0000 7f8b2ec8a640 1 -- 172.21.15.55:0/2365990588 shutdown_connections 2023-08-25T04:15:27.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.546+0000 7f8b2ec8a640 1 --2- 172.21.15.55:0/2365990588 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b280b4080 0x7f8b280b44e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.546+0000 7f8b2ec8a640 1 --2- 172.21.15.55:0/2365990588 >> v2:172.21.15.110:3300/0 conn(0x7f8b28160120 0x7f8b280b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.546+0000 7f8b2ec8a640 1 -- 172.21.15.55:0/2365990588 >> 172.21.15.55:0/2365990588 conn(0x7f8b2809b950 msgr2=0x7f8b280d2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:27.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.546+0000 7f8b2ec8a640 1 -- 172.21.15.55:0/2365990588 shutdown_connections 2023-08-25T04:15:27.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.546+0000 7f8b2ec8a640 1 -- 172.21.15.55:0/2365990588 wait complete. 2023-08-25T04:15:27.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2ec8a640 1 Processor -- start 2023-08-25T04:15:27.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2ec8a640 1 -- start start 2023-08-25T04:15:27.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2ec8a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b280b4080 0x7f8b2814fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2ec8a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b280d0500 0x7f8b280b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2ec8a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b28160120 0x7f8b28158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2ec8a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280b59c0 con 0x7f8b280d0500 2023-08-25T04:15:27.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2ec8a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2815c0c0 con 0x7f8b280b4080 2023-08-25T04:15:27.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2ec8a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280b5760 con 0x7f8b28160120 2023-08-25T04:15:27.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2d487640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b280d0500 0x7f8b280b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2d487640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b280d0500 0x7f8b280b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50310/0 (socket says 172.21.15.55:50310) 2023-08-25T04:15:27.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2d487640 1 -- 172.21.15.55:0/96519670 learned_addr learned my addr 172.21.15.55:0/96519670 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:27.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2dc88640 1 --2- 172.21.15.55:0/96519670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b280b4080 0x7f8b2814fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2e489640 1 --2- 172.21.15.55:0/96519670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b28160120 0x7f8b28158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2d487640 1 -- 172.21.15.55:0/96519670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b28160120 msgr2=0x7f8b28158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:27.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2d487640 1 --2- 172.21.15.55:0/96519670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b28160120 0x7f8b28158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2d487640 1 -- 172.21.15.55:0/96519670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b280b4080 msgr2=0x7f8b2814fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:27.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2d487640 1 --2- 172.21.15.55:0/96519670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b280b4080 0x7f8b2814fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2d487640 1 -- 172.21.15.55:0/96519670 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b240093b0 con 0x7f8b280d0500 2023-08-25T04:15:27.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2d487640 1 --2- 172.21.15.55:0/96519670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b280d0500 0x7f8b280b5220 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8b1801aa20 tx=0x7f8b18019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:27.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b1e7fc640 1 -- 172.21.15.55:0/96519670 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b180b4410 con 0x7f8b280d0500 2023-08-25T04:15:27.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b1e7fc640 1 -- 172.21.15.55:0/96519670 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b180b4590 con 0x7f8b280d0500 2023-08-25T04:15:27.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2ec8a640 1 -- 172.21.15.55:0/96519670 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b18009420 con 0x7f8b280d0500 2023-08-25T04:15:27.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b1e7fc640 1 -- 172.21.15.55:0/96519670 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b180b4940 con 0x7f8b280d0500 2023-08-25T04:15:27.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2ec8a640 1 -- 172.21.15.55:0/96519670 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b280b7a90 con 0x7f8b280d0500 2023-08-25T04:15:27.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.550+0000 7f8b2ec8a640 1 -- 172.21.15.55:0/96519670 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b28073e50 con 0x7f8b280d0500 2023-08-25T04:15:27.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.554+0000 7f8b1e7fc640 1 -- 172.21.15.55:0/96519670 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f8b180b2040 con 0x7f8b280d0500 2023-08-25T04:15:27.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.554+0000 7f8b1e7fc640 1 --2- 172.21.15.55:0/96519670 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8b0c065880 0x7f8b0c067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.554+0000 7f8b1e7fc640 1 -- 172.21.15.55:0/96519670 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f8b1811d2f0 con 0x7f8b280d0500 2023-08-25T04:15:27.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.554+0000 7f8b2dc88640 1 --2- 172.21.15.55:0/96519670 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8b0c065880 0x7f8b0c067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.554+0000 7f8b2dc88640 1 --2- 172.21.15.55:0/96519670 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8b0c065880 0x7f8b0c067d40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009bc0 tx=0x7f8b24008040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:27.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.558+0000 7f8b1e7fc640 1 -- 172.21.15.55:0/96519670 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8b180ea860 con 0x7f8b280d0500 2023-08-25T04:15:27.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.734+0000 7f8b2ec8a640 1 -- 172.21.15.55:0/96519670 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b280d3370 con 0x7f8b0c065880 2023-08-25T04:15:27.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.746+0000 7f8b1e7fc640 1 -- 172.21.15.55:0/96519670 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f8b24011ac0 con 0x7f8b0c065880 2023-08-25T04:15:27.745 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:27.745 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:20", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:27.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.746+0000 7f8b2ec8a640 1 -- 172.21.15.55:0/96519670 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8b0c065880 msgr2=0x7f8b0c067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:27.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.746+0000 7f8b2ec8a640 1 --2- 172.21.15.55:0/96519670 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8b0c065880 0x7f8b0c067d40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009bc0 tx=0x7f8b24008040 comp rx=0 tx=0).stop 2023-08-25T04:15:27.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.746+0000 7f8b2ec8a640 1 -- 172.21.15.55:0/96519670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b280d0500 msgr2=0x7f8b280b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:27.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.746+0000 7f8b2ec8a640 1 --2- 172.21.15.55:0/96519670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b280d0500 0x7f8b280b5220 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8b1801aa20 tx=0x7f8b18019110 comp rx=0 tx=0).stop 2023-08-25T04:15:27.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.746+0000 7f8b2ec8a640 1 -- 172.21.15.55:0/96519670 shutdown_connections 2023-08-25T04:15:27.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.746+0000 7f8b2ec8a640 1 --2- 172.21.15.55:0/96519670 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8b0c065880 0x7f8b0c067d40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.746+0000 7f8b2ec8a640 1 --2- 172.21.15.55:0/96519670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b28160120 0x7f8b28158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.746+0000 7f8b2ec8a640 1 --2- 172.21.15.55:0/96519670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b280d0500 0x7f8b280b5220 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.746+0000 7f8b2ec8a640 1 --2- 172.21.15.55:0/96519670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b280b4080 0x7f8b2814fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.746+0000 7f8b2ec8a640 1 -- 172.21.15.55:0/96519670 >> 172.21.15.55:0/96519670 conn(0x7f8b2809b950 msgr2=0x7f8b2806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:27.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.746+0000 7f8b2ec8a640 1 -- 172.21.15.55:0/96519670 shutdown_connections 2023-08-25T04:15:27.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.746+0000 7f8b2ec8a640 1 -- 172.21.15.55:0/96519670 wait complete. 2023-08-25T04:15:27.765 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:20", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:27.766 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-08-25T00:00:00', 'created': '2023-08-25T04:04:20', 'first': '2023-08-25T04:05:00', 'last': '2023-08-25T04:15:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-25T04:15:27.766 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-08-25T04:15:27.766 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-08-25T04:15:27.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:27.767 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-08-25T04:15:27.777 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:27.777 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:27.777 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:27.778 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:27.778 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:27.778 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:27.778 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:27.778 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:27.778 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:27.778 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:27.779 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:27.779 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-25-04_05_00_UTC', 'scheduled-2023-08-25-04_06_00_UTC', 'scheduled-2023-08-25-04_07_00_UTC', 'scheduled-2023-08-25-04_08_00_UTC', 'scheduled-2023-08-25-04_09_00_UTC', 'scheduled-2023-08-25-04_10_00_UTC', 'scheduled-2023-08-25-04_11_00_UTC', 'scheduled-2023-08-25-04_12_00_UTC', 'scheduled-2023-08-25-04_13_00_UTC', 'scheduled-2023-08-25-04_14_00_UTC', 'scheduled-2023-08-25-04_15_00_UTC'] 2023-08-25T04:15:27.780 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-08-25T04:15:27.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.974+0000 7f5c5bf44640 1 Processor -- start 2023-08-25T04:15:27.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.974+0000 7f5c5bf44640 1 -- start start 2023-08-25T04:15:27.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.974+0000 7f5c5bf44640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5c5415cb40 0x7f5c540d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.974+0000 7f5c5bf44640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c540cf340 0x7f5c540cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.974+0000 7f5c5bf44640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c540d1970 con 0x7f5c540b43e0 2023-08-25T04:15:27.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.974+0000 7f5c5bf44640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c540cfcc0 con 0x7f5c5415cb40 2023-08-25T04:15:27.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.974+0000 7f5c5bf44640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c540d0d80 con 0x7f5c540cf340 2023-08-25T04:15:27.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.974+0000 7f5c59ce0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5c5415cb40 0x7f5c540d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.974+0000 7f5c59ce0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5c5415cb40 0x7f5c540d2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50314/0 (socket says 172.21.15.55:50314) 2023-08-25T04:15:27.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.974+0000 7f5c59ce0640 1 -- 172.21.15.55:0/83147151 learned_addr learned my addr 172.21.15.55:0/83147151 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:27.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.974+0000 7f5c594df640 1 --2- 172.21.15.55:0/83147151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c540cf340 0x7f5c540cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.974+0000 7f5c59ce0640 1 -- 172.21.15.55:0/83147151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c540cf340 msgr2=0x7f5c540cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:27.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.974+0000 7f5c59ce0640 1 --2- 172.21.15.55:0/83147151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c540cf340 0x7f5c540cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.974+0000 7f5c59ce0640 1 -- 172.21.15.55:0/83147151 >> v1:172.21.15.110:6789/0 conn(0x7f5c540b43e0 legacy=0x7f5c540b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:27.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.974+0000 7f5c59ce0640 1 -- 172.21.15.55:0/83147151 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c540d1040 con 0x7f5c5415cb40 2023-08-25T04:15:27.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.978+0000 7f5c59ce0640 1 --2- 172.21.15.55:0/83147151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c5415cb40 0x7f5c540d2080 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5c50009870 tx=0x7f5c5001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98edfbb7fcd0e59 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:27.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.978+0000 7f5c58cde640 1 -- 172.21.15.55:0/83147151 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c500a8a30 con 0x7f5c5415cb40 2023-08-25T04:15:27.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.978+0000 7f5c58cde640 1 -- 172.21.15.55:0/83147151 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c500a8b90 con 0x7f5c5415cb40 2023-08-25T04:15:27.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.978+0000 7f5c58cde640 1 -- 172.21.15.55:0/83147151 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c500b0440 con 0x7f5c5415cb40 2023-08-25T04:15:27.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.978+0000 7f5c5bf44640 1 -- 172.21.15.55:0/83147151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c5415cb40 msgr2=0x7f5c540d2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:27.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.978+0000 7f5c5bf44640 1 --2- 172.21.15.55:0/83147151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c5415cb40 0x7f5c540d2080 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5c50009870 tx=0x7f5c5001ed30 comp rx=0 tx=0).stop 2023-08-25T04:15:27.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.978+0000 7f5c5bf44640 1 -- 172.21.15.55:0/83147151 shutdown_connections 2023-08-25T04:15:27.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.978+0000 7f5c5bf44640 1 --2- 172.21.15.55:0/83147151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c540cf340 0x7f5c540cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.978+0000 7f5c5bf44640 1 --2- 172.21.15.55:0/83147151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c5415cb40 0x7f5c540d2080 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.978+0000 7f5c5bf44640 1 -- 172.21.15.55:0/83147151 >> 172.21.15.55:0/83147151 conn(0x7f5c5406aae0 msgr2=0x7f5c5406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:27.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.978+0000 7f5c5bf44640 1 -- 172.21.15.55:0/83147151 shutdown_connections 2023-08-25T04:15:27.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.978+0000 7f5c5bf44640 1 -- 172.21.15.55:0/83147151 wait complete. 2023-08-25T04:15:27.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c5bf44640 1 Processor -- start 2023-08-25T04:15:27.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c5bf44640 1 -- start start 2023-08-25T04:15:27.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c5bf44640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c540b43e0 0x7f5c540c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c5bf44640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c540cf340 0x7f5c540c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c5bf44640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c5415cb40 0x7f5c5415f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c5bf44640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5415d050 con 0x7f5c540cf340 2023-08-25T04:15:27.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c5bf44640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5415d2f0 con 0x7f5c5415cb40 2023-08-25T04:15:27.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c5bf44640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5415d5d0 con 0x7f5c540b43e0 2023-08-25T04:15:27.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c594df640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c540cf340 0x7f5c540c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c594df640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c540cf340 0x7f5c540c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50326/0 (socket says 172.21.15.55:50326) 2023-08-25T04:15:27.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c594df640 1 -- 172.21.15.55:0/568870272 learned_addr learned my addr 172.21.15.55:0/568870272 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:27.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c59ce0640 1 --2- 172.21.15.55:0/568870272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c540b43e0 0x7f5c540c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c594df640 1 -- 172.21.15.55:0/568870272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c540b43e0 msgr2=0x7f5c540c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:27.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c594df640 1 --2- 172.21.15.55:0/568870272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c540b43e0 0x7f5c540c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c5a4e1640 1 --2- 172.21.15.55:0/568870272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c5415cb40 0x7f5c5415f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c594df640 1 -- 172.21.15.55:0/568870272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c5415cb40 msgr2=0x7f5c5415f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:27.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c594df640 1 --2- 172.21.15.55:0/568870272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c5415cb40 0x7f5c5415f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:27.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c594df640 1 -- 172.21.15.55:0/568870272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c500094d0 con 0x7f5c540cf340 2023-08-25T04:15:27.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c5a4e1640 1 --2- 172.21.15.55:0/568870272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c5415cb40 0x7f5c5415f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:15:27.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c594df640 1 --2- 172.21.15.55:0/568870272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c540cf340 0x7f5c540c86c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400e930 tx=0x7f5c4400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c4a7fc640 1 -- 172.21.15.55:0/568870272 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c44009690 con 0x7f5c540cf340 2023-08-25T04:15:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c4a7fc640 1 -- 172.21.15.55:0/568870272 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4400ca00 con 0x7f5c540cf340 2023-08-25T04:15:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c5bf44640 1 -- 172.21.15.55:0/568870272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c5415d8b0 con 0x7f5c540cf340 2023-08-25T04:15:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c4a7fc640 1 -- 172.21.15.55:0/568870272 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4400cd70 con 0x7f5c540cf340 2023-08-25T04:15:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.982+0000 7f5c5bf44640 1 -- 172.21.15.55:0/568870272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c541f62d0 con 0x7f5c540cf340 2023-08-25T04:15:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.986+0000 7f5c5bf44640 1 -- 172.21.15.55:0/568870272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c54071f80 con 0x7f5c540cf340 2023-08-25T04:15:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.986+0000 7f5c4a7fc640 1 -- 172.21.15.55:0/568870272 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f5c44013470 con 0x7f5c540cf340 2023-08-25T04:15:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.986+0000 7f5c4a7fc640 1 --2- 172.21.15.55:0/568870272 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f5c38065880 0x7f5c38067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:27.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.986+0000 7f5c4a7fc640 1 -- 172.21.15.55:0/568870272 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f5c440834a0 con 0x7f5c540cf340 2023-08-25T04:15:27.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.986+0000 7f5c59ce0640 1 --2- 172.21.15.55:0/568870272 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f5c38065880 0x7f5c38067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:27.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.990+0000 7f5c59ce0640 1 --2- 172.21.15.55:0/568870272 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f5c38065880 0x7f5c38067d40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c500b2000 tx=0x7f5c50008040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:27.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:27.990+0000 7f5c4a7fc640 1 -- 172.21.15.55:0/568870272 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5c44050d10 con 0x7f5c540cf340 2023-08-25T04:15:28.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.166+0000 7f5c5bf44640 1 -- 172.21.15.55:0/568870272 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c540d1600 con 0x7f5c38065880 2023-08-25T04:15:28.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.174+0000 7f5c4a7fc640 1 -- 172.21.15.55:0/568870272 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f5c500b0440 con 0x7f5c38065880 2023-08-25T04:15:28.174 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:28.174 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:20", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:28.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.178+0000 7f5c5bf44640 1 -- 172.21.15.55:0/568870272 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f5c38065880 msgr2=0x7f5c38067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:28.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.178+0000 7f5c5bf44640 1 --2- 172.21.15.55:0/568870272 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f5c38065880 0x7f5c38067d40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c500b2000 tx=0x7f5c50008040 comp rx=0 tx=0).stop 2023-08-25T04:15:28.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.178+0000 7f5c5bf44640 1 -- 172.21.15.55:0/568870272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c540cf340 msgr2=0x7f5c540c86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:28.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.178+0000 7f5c5bf44640 1 --2- 172.21.15.55:0/568870272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c540cf340 0x7f5c540c86c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400e930 tx=0x7f5c4400edf0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.178+0000 7f5c5bf44640 1 -- 172.21.15.55:0/568870272 shutdown_connections 2023-08-25T04:15:28.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.178+0000 7f5c5bf44640 1 --2- 172.21.15.55:0/568870272 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f5c38065880 0x7f5c38067d40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.178+0000 7f5c5bf44640 1 --2- 172.21.15.55:0/568870272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c5415cb40 0x7f5c5415f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.178+0000 7f5c5bf44640 1 --2- 172.21.15.55:0/568870272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c540cf340 0x7f5c540c86c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.178+0000 7f5c5bf44640 1 --2- 172.21.15.55:0/568870272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c540b43e0 0x7f5c540c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.178+0000 7f5c5bf44640 1 -- 172.21.15.55:0/568870272 >> 172.21.15.55:0/568870272 conn(0x7f5c5406aae0 msgr2=0x7f5c540b5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:28.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.178+0000 7f5c5bf44640 1 -- 172.21.15.55:0/568870272 shutdown_connections 2023-08-25T04:15:28.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.178+0000 7f5c5bf44640 1 -- 172.21.15.55:0/568870272 wait complete. 2023-08-25T04:15:28.195 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:20", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:28.195 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-08-25T00:00:00', 'created': '2023-08-25T04:04:20', 'first': '2023-08-25T04:05:00', 'last': '2023-08-25T04:15:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-25T04:15:28.196 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-08-25T04:15:28.196 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-08-25T04:15:28.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:28.197 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-08-25T04:15:28.207 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:28.207 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:28.208 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:28.208 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:28.208 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:28.208 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:28.208 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:28.208 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:28.208 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:28.208 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:28.209 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:28.209 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-25-04_05_00_UTC', 'scheduled-2023-08-25-04_06_00_UTC', 'scheduled-2023-08-25-04_07_00_UTC', 'scheduled-2023-08-25-04_08_00_UTC', 'scheduled-2023-08-25-04_09_00_UTC', 'scheduled-2023-08-25-04_10_00_UTC', 'scheduled-2023-08-25-04_11_00_UTC', 'scheduled-2023-08-25-04_12_00_UTC', 'scheduled-2023-08-25-04_13_00_UTC', 'scheduled-2023-08-25-04_14_00_UTC', 'scheduled-2023-08-25-04_15_00_UTC'] 2023-08-25T04:15:28.210 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-08-25T04:15:28.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.402+0000 7fe24bfd2640 1 Processor -- start 2023-08-25T04:15:28.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.406+0000 7fe24bfd2640 1 -- start start 2023-08-25T04:15:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.406+0000 7fe24bfd2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe24415cb40 0x7fe2440d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.406+0000 7fe24bfd2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2440b6a00 0x7fe2440cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.406+0000 7fe24bfd2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2440d1970 con 0x7fe2440cf340 2023-08-25T04:15:28.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.406+0000 7fe24bfd2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2440cfcf0 con 0x7fe2440b6a00 2023-08-25T04:15:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.406+0000 7fe24bfd2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2440d0d80 con 0x7fe24415cb40 2023-08-25T04:15:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.406+0000 7fe24a56f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2440b6a00 0x7fe2440cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.406+0000 7fe24a56f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2440b6a00 0x7fe2440cf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50336/0 (socket says 172.21.15.55:50336) 2023-08-25T04:15:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.406+0000 7fe24a56f640 1 -- 172.21.15.55:0/1067965113 learned_addr learned my addr 172.21.15.55:0/1067965113 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:28.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.406+0000 7fe249d6e640 1 --2- 172.21.15.55:0/1067965113 >> v2:172.21.15.110:3300/0 conn(0x7fe24415cb40 0x7fe2440d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.406+0000 7fe24a56f640 1 -- 172.21.15.55:0/1067965113 >> v2:172.21.15.110:3300/0 conn(0x7fe24415cb40 msgr2=0x7fe2440d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.406+0000 7fe24a56f640 1 --2- 172.21.15.55:0/1067965113 >> v2:172.21.15.110:3300/0 conn(0x7fe24415cb40 0x7fe2440d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.406+0000 7fe24a56f640 1 -- 172.21.15.55:0/1067965113 >> v1:172.21.15.110:6789/0 conn(0x7fe2440cf340 legacy=0x7fe2440b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:28.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.406+0000 7fe24a56f640 1 -- 172.21.15.55:0/1067965113 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2440d1040 con 0x7fe2440b6a00 2023-08-25T04:15:28.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.410+0000 7fe24a56f640 1 --2- 172.21.15.55:0/1067965113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2440b6a00 0x7fe2440cf7b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe24408b5a0 tx=0x7fe23c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ffa5c9e3beaec5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:28.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.410+0000 7fe248d6c640 1 -- 172.21.15.55:0/1067965113 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c0af400 con 0x7fe2440b6a00 2023-08-25T04:15:28.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.410+0000 7fe248d6c640 1 -- 172.21.15.55:0/1067965113 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c0ab050 con 0x7fe2440b6a00 2023-08-25T04:15:28.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.410+0000 7fe248d6c640 1 -- 172.21.15.55:0/1067965113 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c0af780 con 0x7fe2440b6a00 2023-08-25T04:15:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.410+0000 7fe24bfd2640 1 -- 172.21.15.55:0/1067965113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2440b6a00 msgr2=0x7fe2440cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:28.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.410+0000 7fe24bfd2640 1 --2- 172.21.15.55:0/1067965113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2440b6a00 0x7fe2440cf7b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fe24408b5a0 tx=0x7fe23c01f1c0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.410+0000 7fe24bfd2640 1 -- 172.21.15.55:0/1067965113 shutdown_connections 2023-08-25T04:15:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.410+0000 7fe24bfd2640 1 --2- 172.21.15.55:0/1067965113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2440b6a00 0x7fe2440cf7b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.410+0000 7fe24bfd2640 1 --2- 172.21.15.55:0/1067965113 >> v2:172.21.15.110:3300/0 conn(0x7fe24415cb40 0x7fe2440d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.410+0000 7fe24bfd2640 1 -- 172.21.15.55:0/1067965113 >> 172.21.15.55:0/1067965113 conn(0x7fe24406aae0 msgr2=0x7fe24406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.410+0000 7fe24bfd2640 1 -- 172.21.15.55:0/1067965113 shutdown_connections 2023-08-25T04:15:28.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.410+0000 7fe24bfd2640 1 -- 172.21.15.55:0/1067965113 wait complete. 2023-08-25T04:15:28.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.410+0000 7fe24bfd2640 1 Processor -- start 2023-08-25T04:15:28.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.410+0000 7fe24bfd2640 1 -- start start 2023-08-25T04:15:28.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe24bfd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2440b6a00 0x7fe244151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:28.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe24bfd2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2440cf340 0x7fe2440ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:28.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe24bfd2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe24415cb40 0x7fe2440ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:28.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe24bfd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2440c73a0 con 0x7fe2440b6a00 2023-08-25T04:15:28.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe24bfd2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2440c9350 con 0x7fe2440cf340 2023-08-25T04:15:28.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe24bfd2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2441522f0 con 0x7fe24415cb40 2023-08-25T04:15:28.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe249d6e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2440b6a00 0x7fe244151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe249d6e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2440b6a00 0x7fe244151760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50350/0 (socket says 172.21.15.55:50350) 2023-08-25T04:15:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe249d6e640 1 -- 172.21.15.55:0/1027680203 learned_addr learned my addr 172.21.15.55:0/1027680203 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe24956d640 1 --2- 172.21.15.55:0/1027680203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2440cf340 0x7fe2440ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe249d6e640 1 -- 172.21.15.55:0/1027680203 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe24415cb40 msgr2=0x7fe2440ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe249d6e640 1 --2- 172.21.15.55:0/1027680203 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe24415cb40 0x7fe2440ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe249d6e640 1 -- 172.21.15.55:0/1027680203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2440cf340 msgr2=0x7fe2440ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:28.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe249d6e640 1 --2- 172.21.15.55:0/1027680203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2440cf340 0x7fe2440ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe249d6e640 1 -- 172.21.15.55:0/1027680203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c009b30 con 0x7fe2440b6a00 2023-08-25T04:15:28.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe24956d640 1 --2- 172.21.15.55:0/1027680203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2440cf340 0x7fe2440ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:15:28.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe249d6e640 1 --2- 172.21.15.55:0/1027680203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2440b6a00 0x7fe244151760 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe24000e930 tx=0x7fe24000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe23a7fc640 1 -- 172.21.15.55:0/1027680203 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe240009690 con 0x7fe2440b6a00 2023-08-25T04:15:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe23a7fc640 1 -- 172.21.15.55:0/1027680203 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24000ca00 con 0x7fe2440b6a00 2023-08-25T04:15:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe23a7fc640 1 -- 172.21.15.55:0/1027680203 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24000cd70 con 0x7fe2440b6a00 2023-08-25T04:15:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe24bfd2640 1 -- 172.21.15.55:0/1027680203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2440c87c0 con 0x7fe2440b6a00 2023-08-25T04:15:28.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe24bfd2640 1 -- 172.21.15.55:0/1027680203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2440c8d00 con 0x7fe2440b6a00 2023-08-25T04:15:28.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.414+0000 7fe24bfd2640 1 -- 172.21.15.55:0/1027680203 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe244071f80 con 0x7fe2440b6a00 2023-08-25T04:15:28.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.418+0000 7fe23a7fc640 1 -- 172.21.15.55:0/1027680203 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7fe240013470 con 0x7fe2440b6a00 2023-08-25T04:15:28.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.418+0000 7fe23a7fc640 1 --2- 172.21.15.55:0/1027680203 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fe228065880 0x7fe228067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:28.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.418+0000 7fe23a7fc640 1 -- 172.21.15.55:0/1027680203 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fe240083540 con 0x7fe2440b6a00 2023-08-25T04:15:28.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.418+0000 7fe24956d640 1 --2- 172.21.15.55:0/1027680203 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fe228065880 0x7fe228067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:28.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.418+0000 7fe24956d640 1 --2- 172.21.15.55:0/1027680203 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fe228065880 0x7fe228067d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe2441f5540 tx=0x7fe234009040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:28.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.422+0000 7fe23a7fc640 1 -- 172.21.15.55:0/1027680203 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe240050d10 con 0x7fe2440b6a00 2023-08-25T04:15:28.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.598+0000 7fe24bfd2640 1 -- 172.21.15.55:0/1027680203 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2440d1600 con 0x7fe228065880 2023-08-25T04:15:28.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.606+0000 7fe23a7fc640 1 -- 172.21.15.55:0/1027680203 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fe2340012d0 con 0x7fe228065880 2023-08-25T04:15:28.605 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:28.606 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:21", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:28.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.610+0000 7fe24bfd2640 1 -- 172.21.15.55:0/1027680203 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fe228065880 msgr2=0x7fe228067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:28.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.610+0000 7fe24bfd2640 1 --2- 172.21.15.55:0/1027680203 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fe228065880 0x7fe228067d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe2441f5540 tx=0x7fe234009040 comp rx=0 tx=0).stop 2023-08-25T04:15:28.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.610+0000 7fe24bfd2640 1 -- 172.21.15.55:0/1027680203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2440b6a00 msgr2=0x7fe244151760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:28.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.610+0000 7fe24bfd2640 1 --2- 172.21.15.55:0/1027680203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2440b6a00 0x7fe244151760 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe24000e930 tx=0x7fe24000edf0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.610+0000 7fe24bfd2640 1 -- 172.21.15.55:0/1027680203 shutdown_connections 2023-08-25T04:15:28.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.610+0000 7fe24bfd2640 1 --2- 172.21.15.55:0/1027680203 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fe228065880 0x7fe228067d40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.610+0000 7fe24bfd2640 1 --2- 172.21.15.55:0/1027680203 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe24415cb40 0x7fe2440ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.610+0000 7fe24bfd2640 1 --2- 172.21.15.55:0/1027680203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2440cf340 0x7fe2440ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.610+0000 7fe24bfd2640 1 --2- 172.21.15.55:0/1027680203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2440b6a00 0x7fe244151760 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.610+0000 7fe24bfd2640 1 -- 172.21.15.55:0/1027680203 >> 172.21.15.55:0/1027680203 conn(0x7fe24406aae0 msgr2=0x7fe2440d3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:28.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.610+0000 7fe24bfd2640 1 -- 172.21.15.55:0/1027680203 shutdown_connections 2023-08-25T04:15:28.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.610+0000 7fe24bfd2640 1 -- 172.21.15.55:0/1027680203 wait complete. 2023-08-25T04:15:28.626 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:21", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:28.626 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-08-25T00:00:00', 'created': '2023-08-25T04:04:21', 'first': '2023-08-25T04:05:00', 'last': '2023-08-25T04:15:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-25T04:15:28.627 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-08-25T04:15:28.627 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-08-25T04:15:28.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:28.628 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-08-25T04:15:28.639 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:28.639 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:28.639 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:28.639 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:28.639 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:28.640 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:28.640 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:28.640 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:28.640 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:28.640 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:28.640 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:28.641 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-25-04_05_00_UTC', 'scheduled-2023-08-25-04_06_00_UTC', 'scheduled-2023-08-25-04_07_00_UTC', 'scheduled-2023-08-25-04_08_00_UTC', 'scheduled-2023-08-25-04_09_00_UTC', 'scheduled-2023-08-25-04_10_00_UTC', 'scheduled-2023-08-25-04_11_00_UTC', 'scheduled-2023-08-25-04_12_00_UTC', 'scheduled-2023-08-25-04_13_00_UTC', 'scheduled-2023-08-25-04_14_00_UTC', 'scheduled-2023-08-25-04_15_00_UTC'] 2023-08-25T04:15:28.642 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-08-25T04:15:28.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.830+0000 7f8c1b1d5640 1 Processor -- start 2023-08-25T04:15:28.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.830+0000 7f8c1b1d5640 1 -- start start 2023-08-25T04:15:28.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.830+0000 7f8c1b1d5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8c1406fb50 0x7f8c140cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:28.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.830+0000 7f8c1b1d5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8c140cc930 0x7f8c140ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:28.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.830+0000 7f8c1b1d5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c140c9270 con 0x7f8c14159d00 2023-08-25T04:15:28.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.830+0000 7f8c1b1d5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c140cc510 con 0x7f8c140cc930 2023-08-25T04:15:28.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.830+0000 7f8c1b1d5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c140ce220 con 0x7f8c1406fb50 2023-08-25T04:15:28.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.834+0000 7f8c0bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8c1406fb50 0x7f8c140cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:28.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.834+0000 7f8c0bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8c1406fb50 0x7f8c140cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:54424/0 (socket says 172.21.15.55:54424) 2023-08-25T04:15:28.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.834+0000 7f8c0bfff640 1 -- 172.21.15.55:0/3097454209 learned_addr learned my addr 172.21.15.55:0/3097454209 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:28.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.834+0000 7f8c19772640 1 --2- 172.21.15.55:0/3097454209 >> v2:172.21.15.110:3300/0 conn(0x7f8c140cc930 0x7f8c140ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:28.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.834+0000 7f8c0bfff640 1 -- 172.21.15.55:0/3097454209 >> v2:172.21.15.110:3300/0 conn(0x7f8c140cc930 msgr2=0x7f8c140ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:28.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.834+0000 7f8c0bfff640 1 --2- 172.21.15.55:0/3097454209 >> v2:172.21.15.110:3300/0 conn(0x7f8c140cc930 0x7f8c140ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.834+0000 7f8c0bfff640 1 -- 172.21.15.55:0/3097454209 >> v1:172.21.15.110:6789/0 conn(0x7f8c14159d00 legacy=0x7f8c140c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:28.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.834+0000 7f8c0bfff640 1 -- 172.21.15.55:0/3097454209 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c140ca6c0 con 0x7f8c1406fb50 2023-08-25T04:15:28.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.834+0000 7f8c0bfff640 1 --2- 172.21.15.55:0/3097454209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8c1406fb50 0x7f8c140cdc40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8c04009870 tx=0x7f8c0401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f617298cfcf8f852 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:28.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.834+0000 7f8c0b7fe640 1 -- 172.21.15.55:0/3097454209 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c040ab680 con 0x7f8c1406fb50 2023-08-25T04:15:28.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c0b7fe640 1 -- 172.21.15.55:0/3097454209 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c040ab7e0 con 0x7f8c1406fb50 2023-08-25T04:15:28.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c0b7fe640 1 -- 172.21.15.55:0/3097454209 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c040abb70 con 0x7f8c1406fb50 2023-08-25T04:15:28.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c1b1d5640 1 -- 172.21.15.55:0/3097454209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8c1406fb50 msgr2=0x7f8c140cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:28.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c1b1d5640 1 --2- 172.21.15.55:0/3097454209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8c1406fb50 0x7f8c140cdc40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8c04009870 tx=0x7f8c0401c480 comp rx=0 tx=0).stop 2023-08-25T04:15:28.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c1b1d5640 1 -- 172.21.15.55:0/3097454209 shutdown_connections 2023-08-25T04:15:28.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c1b1d5640 1 --2- 172.21.15.55:0/3097454209 >> v2:172.21.15.110:3300/0 conn(0x7f8c140cc930 0x7f8c140ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c1b1d5640 1 --2- 172.21.15.55:0/3097454209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8c1406fb50 0x7f8c140cdc40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c1b1d5640 1 -- 172.21.15.55:0/3097454209 >> 172.21.15.55:0/3097454209 conn(0x7f8c140caf90 msgr2=0x7f8c140cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:28.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c1b1d5640 1 -- 172.21.15.55:0/3097454209 shutdown_connections 2023-08-25T04:15:28.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c1b1d5640 1 -- 172.21.15.55:0/3097454209 wait complete. 2023-08-25T04:15:28.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c1b1d5640 1 Processor -- start 2023-08-25T04:15:28.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c1b1d5640 1 -- start start 2023-08-25T04:15:28.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c1b1d5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c1406fb50 0x7f8c140c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:28.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c1b1d5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8c140cc930 0x7f8c14152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:28.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c1b1d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c14159d00 0x7f8c14152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:28.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c1b1d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c140af390 con 0x7f8c14159d00 2023-08-25T04:15:28.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c1b1d5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c140c7f40 con 0x7f8c1406fb50 2023-08-25T04:15:28.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c1b1d5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c140c8220 con 0x7f8c140cc930 2023-08-25T04:15:28.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.838+0000 7f8c19772640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c14159d00 0x7f8c14152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:28.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c19772640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c14159d00 0x7f8c14152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50362/0 (socket says 172.21.15.55:50362) 2023-08-25T04:15:28.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c19772640 1 -- 172.21.15.55:0/1188386320 learned_addr learned my addr 172.21.15.55:0/1188386320 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:28.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c18f71640 1 --2- 172.21.15.55:0/1188386320 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c1406fb50 0x7f8c140c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:28.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c0bfff640 1 --2- 172.21.15.55:0/1188386320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8c140cc930 0x7f8c14152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:28.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c19772640 1 -- 172.21.15.55:0/1188386320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8c140cc930 msgr2=0x7f8c14152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:28.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c19772640 1 --2- 172.21.15.55:0/1188386320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8c140cc930 0x7f8c14152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c19772640 1 -- 172.21.15.55:0/1188386320 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c1406fb50 msgr2=0x7f8c140c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:28.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c19772640 1 --2- 172.21.15.55:0/1188386320 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c1406fb50 0x7f8c140c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:28.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c19772640 1 -- 172.21.15.55:0/1188386320 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c040094d0 con 0x7f8c14159d00 2023-08-25T04:15:28.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c19772640 1 --2- 172.21.15.55:0/1188386320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c14159d00 0x7f8c14152d20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c00efc0 tx=0x7f8c0c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:28.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c097fa640 1 -- 172.21.15.55:0/1188386320 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c014480 con 0x7f8c14159d00 2023-08-25T04:15:28.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c097fa640 1 -- 172.21.15.55:0/1188386320 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0c00f040 con 0x7f8c14159d00 2023-08-25T04:15:28.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c1b1d5640 1 -- 172.21.15.55:0/1188386320 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c140af020 con 0x7f8c14159d00 2023-08-25T04:15:28.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c097fa640 1 -- 172.21.15.55:0/1188386320 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c014820 con 0x7f8c14159d00 2023-08-25T04:15:28.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c1b1d5640 1 -- 172.21.15.55:0/1188386320 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c140c6530 con 0x7f8c14159d00 2023-08-25T04:15:28.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c1b1d5640 1 -- 172.21.15.55:0/1188386320 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c140af500 con 0x7f8c14159d00 2023-08-25T04:15:28.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c097fa640 1 -- 172.21.15.55:0/1188386320 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f8c0c014980 con 0x7f8c14159d00 2023-08-25T04:15:28.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c097fa640 1 --2- 172.21.15.55:0/1188386320 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8c000658b0 0x7f8c00067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:28.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.842+0000 7f8c097fa640 1 -- 172.21.15.55:0/1188386320 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f8c0c083ef0 con 0x7f8c14159d00 2023-08-25T04:15:28.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.846+0000 7f8c18f71640 1 --2- 172.21.15.55:0/1188386320 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8c000658b0 0x7f8c00067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:28.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.846+0000 7f8c18f71640 1 --2- 172.21.15.55:0/1188386320 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8c000658b0 0x7f8c00067d70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8c10007fd0 tx=0x7f8c10009040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:28.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:28.846+0000 7f8c097fa640 1 -- 172.21.15.55:0/1188386320 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8c0c051510 con 0x7f8c14159d00 2023-08-25T04:15:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.022+0000 7f8c1b1d5640 1 -- 172.21.15.55:0/1188386320 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c1415a0e0 con 0x7f8c000658b0 2023-08-25T04:15:29.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.030+0000 7f8c097fa640 1 -- 172.21.15.55:0/1188386320 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f8c10001450 con 0x7f8c000658b0 2023-08-25T04:15:29.031 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:29.031 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:21", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:29.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.034+0000 7f8c1b1d5640 1 -- 172.21.15.55:0/1188386320 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8c000658b0 msgr2=0x7f8c00067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:29.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.034+0000 7f8c1b1d5640 1 --2- 172.21.15.55:0/1188386320 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8c000658b0 0x7f8c00067d70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8c10007fd0 tx=0x7f8c10009040 comp rx=0 tx=0).stop 2023-08-25T04:15:29.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.034+0000 7f8c1b1d5640 1 -- 172.21.15.55:0/1188386320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c14159d00 msgr2=0x7f8c14152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:29.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.034+0000 7f8c1b1d5640 1 --2- 172.21.15.55:0/1188386320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c14159d00 0x7f8c14152d20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c00efc0 tx=0x7f8c0c00c490 comp rx=0 tx=0).stop 2023-08-25T04:15:29.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.034+0000 7f8c1b1d5640 1 -- 172.21.15.55:0/1188386320 shutdown_connections 2023-08-25T04:15:29.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.034+0000 7f8c1b1d5640 1 --2- 172.21.15.55:0/1188386320 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8c000658b0 0x7f8c00067d70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:29.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.034+0000 7f8c1b1d5640 1 --2- 172.21.15.55:0/1188386320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c14159d00 0x7f8c14152d20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:29.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.034+0000 7f8c1b1d5640 1 --2- 172.21.15.55:0/1188386320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8c140cc930 0x7f8c14152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:29.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.034+0000 7f8c1b1d5640 1 --2- 172.21.15.55:0/1188386320 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8c1406fb50 0x7f8c140c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:29.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.034+0000 7f8c1b1d5640 1 -- 172.21.15.55:0/1188386320 >> 172.21.15.55:0/1188386320 conn(0x7f8c140caf90 msgr2=0x7f8c140c8820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:29.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.034+0000 7f8c1b1d5640 1 -- 172.21.15.55:0/1188386320 shutdown_connections 2023-08-25T04:15:29.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.034+0000 7f8c1b1d5640 1 -- 172.21.15.55:0/1188386320 wait complete. 2023-08-25T04:15:29.052 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:04:21", "first": "2023-08-25T04:05:00", "last": "2023-08-25T04:15:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-08-25T04:15:29.053 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-08-25T00:00:00', 'created': '2023-08-25T04:04:21', 'first': '2023-08-25T04:05:00', 'last': '2023-08-25T04:15:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-08-25T04:15:29.053 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-08-25T04:15:29.053 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-08-25T04:15:29.053 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-08-25T04:15:29.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.202+0000 7f8e537ac640 1 Processor -- start 2023-08-25T04:15:29.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.202+0000 7f8e537ac640 1 -- start start 2023-08-25T04:15:29.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.206+0000 7f8e537ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e4c15cb40 0x7f8e4c0d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:29.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.206+0000 7f8e537ac640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8e4c0cf340 0x7f8e4c0cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:29.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.206+0000 7f8e537ac640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4c0d1970 con 0x7f8e4c0b43e0 2023-08-25T04:15:29.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.206+0000 7f8e537ac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c0cfcf0 con 0x7f8e4c15cb40 2023-08-25T04:15:29.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.206+0000 7f8e537ac640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c0d0d80 con 0x7f8e4c0cf340 2023-08-25T04:15:29.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.206+0000 7f8e51548640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e4c15cb40 0x7f8e4c0d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:29.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.206+0000 7f8e51548640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e4c15cb40 0x7f8e4c0d2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50372/0 (socket says 172.21.15.55:50372) 2023-08-25T04:15:29.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.206+0000 7f8e51548640 1 -- 172.21.15.55:0/1854914049 learned_addr learned my addr 172.21.15.55:0/1854914049 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:29.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.206+0000 7f8e50d47640 1 --2- 172.21.15.55:0/1854914049 >> v2:172.21.15.110:3300/0 conn(0x7f8e4c0cf340 0x7f8e4c0cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:29.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.206+0000 7f8e51548640 1 -- 172.21.15.55:0/1854914049 >> v2:172.21.15.110:3300/0 conn(0x7f8e4c0cf340 msgr2=0x7f8e4c0cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:29.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.206+0000 7f8e51548640 1 --2- 172.21.15.55:0/1854914049 >> v2:172.21.15.110:3300/0 conn(0x7f8e4c0cf340 0x7f8e4c0cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:29.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.206+0000 7f8e51548640 1 -- 172.21.15.55:0/1854914049 >> v1:172.21.15.110:6789/0 conn(0x7f8e4c0b43e0 legacy=0x7f8e4c0b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:29.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.206+0000 7f8e51548640 1 -- 172.21.15.55:0/1854914049 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c0d1040 con 0x7f8e4c15cb40 2023-08-25T04:15:29.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.210+0000 7f8e51548640 1 --2- 172.21.15.55:0/1854914049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e4c15cb40 0x7f8e4c0d2080 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c160730 tx=0x7f8e4801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33dd5545c09e30bc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:29.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.210+0000 7f8e43fff640 1 -- 172.21.15.55:0/1854914049 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e480a89f0 con 0x7f8e4c15cb40 2023-08-25T04:15:29.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.210+0000 7f8e43fff640 1 -- 172.21.15.55:0/1854914049 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e480a8b50 con 0x7f8e4c15cb40 2023-08-25T04:15:29.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.210+0000 7f8e43fff640 1 -- 172.21.15.55:0/1854914049 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e480b0440 con 0x7f8e4c15cb40 2023-08-25T04:15:29.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.210+0000 7f8e537ac640 1 -- 172.21.15.55:0/1854914049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e4c15cb40 msgr2=0x7f8e4c0d2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:29.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.210+0000 7f8e537ac640 1 --2- 172.21.15.55:0/1854914049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e4c15cb40 0x7f8e4c0d2080 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c160730 tx=0x7f8e4801ecf0 comp rx=0 tx=0).stop 2023-08-25T04:15:29.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.210+0000 7f8e537ac640 1 -- 172.21.15.55:0/1854914049 shutdown_connections 2023-08-25T04:15:29.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.210+0000 7f8e537ac640 1 --2- 172.21.15.55:0/1854914049 >> v2:172.21.15.110:3300/0 conn(0x7f8e4c0cf340 0x7f8e4c0cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:29.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.210+0000 7f8e537ac640 1 --2- 172.21.15.55:0/1854914049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e4c15cb40 0x7f8e4c0d2080 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:29.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.210+0000 7f8e537ac640 1 -- 172.21.15.55:0/1854914049 >> 172.21.15.55:0/1854914049 conn(0x7f8e4c06aae0 msgr2=0x7f8e4c06aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:29.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.210+0000 7f8e537ac640 1 -- 172.21.15.55:0/1854914049 shutdown_connections 2023-08-25T04:15:29.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.210+0000 7f8e537ac640 1 -- 172.21.15.55:0/1854914049 wait complete. 2023-08-25T04:15:29.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.210+0000 7f8e537ac640 1 Processor -- start 2023-08-25T04:15:29.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.210+0000 7f8e537ac640 1 -- start start 2023-08-25T04:15:29.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e537ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e4c0b43e0 0x7f8e4c1f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:29.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e537ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e4c0cf340 0x7f8e4c158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:29.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e537ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e4c15cb40 0x7f8e4c0c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:29.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e537ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c1f2b30 con 0x7f8e4c15cb40 2023-08-25T04:15:29.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e537ac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c1f2e10 con 0x7f8e4c0cf340 2023-08-25T04:15:29.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e537ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c1f30f0 con 0x7f8e4c0b43e0 2023-08-25T04:15:29.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e51d49640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e4c15cb40 0x7f8e4c0c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:29.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e51d49640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e4c15cb40 0x7f8e4c0c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50386/0 (socket says 172.21.15.55:50386) 2023-08-25T04:15:29.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e51d49640 1 -- 172.21.15.55:0/129416258 learned_addr learned my addr 172.21.15.55:0/129416258 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:29.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e50d47640 1 --2- 172.21.15.55:0/129416258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e4c0cf340 0x7f8e4c158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:29.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e51548640 1 --2- 172.21.15.55:0/129416258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e4c0b43e0 0x7f8e4c1f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:29.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e51d49640 1 -- 172.21.15.55:0/129416258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e4c0b43e0 msgr2=0x7f8e4c1f22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:29.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e51d49640 1 --2- 172.21.15.55:0/129416258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e4c0b43e0 0x7f8e4c1f22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:29.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e51d49640 1 -- 172.21.15.55:0/129416258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e4c0cf340 msgr2=0x7f8e4c158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:29.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e51d49640 1 --2- 172.21.15.55:0/129416258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e4c0cf340 0x7f8e4c158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:29.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e51d49640 1 -- 172.21.15.55:0/129416258 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e480094d0 con 0x7f8e4c15cb40 2023-08-25T04:15:29.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e51d49640 1 --2- 172.21.15.55:0/129416258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e4c15cb40 0x7f8e4c0c8ff0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400c730 tx=0x7f8e4400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:29.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e41ffb640 1 -- 172.21.15.55:0/129416258 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e44003b80 con 0x7f8e4c15cb40 2023-08-25T04:15:29.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e41ffb640 1 -- 172.21.15.55:0/129416258 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e44003ce0 con 0x7f8e4c15cb40 2023-08-25T04:15:29.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e537ac640 1 -- 172.21.15.55:0/129416258 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c0c8ad0 con 0x7f8e4c15cb40 2023-08-25T04:15:29.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e41ffb640 1 -- 172.21.15.55:0/129416258 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4400aa30 con 0x7f8e4c15cb40 2023-08-25T04:15:29.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e537ac640 1 -- 172.21.15.55:0/129416258 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c159400 con 0x7f8e4c15cb40 2023-08-25T04:15:29.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e537ac640 1 -- 172.21.15.55:0/129416258 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c071f80 con 0x7f8e4c15cb40 2023-08-25T04:15:29.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.214+0000 7f8e41ffb640 1 -- 172.21.15.55:0/129416258 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f8e4400ab90 con 0x7f8e4c15cb40 2023-08-25T04:15:29.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.218+0000 7f8e41ffb640 1 --2- 172.21.15.55:0/129416258 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8e30065880 0x7f8e30067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:29.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.218+0000 7f8e41ffb640 1 -- 172.21.15.55:0/129416258 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f8e44083150 con 0x7f8e4c15cb40 2023-08-25T04:15:29.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.218+0000 7f8e51548640 1 --2- 172.21.15.55:0/129416258 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8e30065880 0x7f8e30067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:29.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.218+0000 7f8e51548640 1 --2- 172.21.15.55:0/129416258 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8e30065880 0x7f8e30067d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8e480b2000 tx=0x7f8e48008040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:29.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.218+0000 7f8e41ffb640 1 -- 172.21.15.55:0/129416258 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8e440507d0 con 0x7f8e4c15cb40 2023-08-25T04:15:29.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.394+0000 7f8e537ac640 1 -- 172.21.15.55:0/129416258 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e4c0d1600 con 0x7f8e30065880 2023-08-25T04:15:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.478+0000 7f8e41ffb640 1 -- 172.21.15.55:0/129416258 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f8e480b0440 con 0x7f8e30065880 2023-08-25T04:15:29.479 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-08-25T04:15:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.482+0000 7f8e537ac640 1 -- 172.21.15.55:0/129416258 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8e30065880 msgr2=0x7f8e30067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.482+0000 7f8e537ac640 1 --2- 172.21.15.55:0/129416258 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8e30065880 0x7f8e30067d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8e480b2000 tx=0x7f8e48008040 comp rx=0 tx=0).stop 2023-08-25T04:15:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.482+0000 7f8e537ac640 1 -- 172.21.15.55:0/129416258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e4c15cb40 msgr2=0x7f8e4c0c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.482+0000 7f8e537ac640 1 --2- 172.21.15.55:0/129416258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e4c15cb40 0x7f8e4c0c8ff0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400c730 tx=0x7f8e4400cbf0 comp rx=0 tx=0).stop 2023-08-25T04:15:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.482+0000 7f8e537ac640 1 -- 172.21.15.55:0/129416258 shutdown_connections 2023-08-25T04:15:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.482+0000 7f8e537ac640 1 --2- 172.21.15.55:0/129416258 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8e30065880 0x7f8e30067d40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.482+0000 7f8e537ac640 1 --2- 172.21.15.55:0/129416258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e4c15cb40 0x7f8e4c0c8ff0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.482+0000 7f8e537ac640 1 --2- 172.21.15.55:0/129416258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e4c0cf340 0x7f8e4c158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.482+0000 7f8e537ac640 1 --2- 172.21.15.55:0/129416258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e4c0b43e0 0x7f8e4c1f22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.482+0000 7f8e537ac640 1 -- 172.21.15.55:0/129416258 >> 172.21.15.55:0/129416258 conn(0x7f8e4c06aae0 msgr2=0x7f8e4c0b65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.482+0000 7f8e537ac640 1 -- 172.21.15.55:0/129416258 shutdown_connections 2023-08-25T04:15:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:29.482+0000 7f8e537ac640 1 -- 172.21.15.55:0/129416258 wait complete. 2023-08-25T04:15:29.499 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-08-25T04:15:29.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:29.500 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-08-25T04:15:29.504 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:15:29.510 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:29.510 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:29.511 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:29.511 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:29.511 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:29.511 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:29.511 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:29.511 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:29.511 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:29.512 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:29.512 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:29.513 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:29.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:29.513 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_05_00_UTC) 2023-08-25T04:15:29.561 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:15:29.579 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:29.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:29.580 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_06_00_UTC) 2023-08-25T04:15:29.662 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:29.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:29.663 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_07_00_UTC) 2023-08-25T04:15:29.719 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:29.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:29.720 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_08_00_UTC) 2023-08-25T04:15:29.778 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:29.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:29.778 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_09_00_UTC) 2023-08-25T04:15:29.840 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:29.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:29.841 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_10_00_UTC) 2023-08-25T04:15:29.899 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:29.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:29.900 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_11_00_UTC) 2023-08-25T04:15:29.958 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:29.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:29.960 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_12_00_UTC) 2023-08-25T04:15:30.018 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:30.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:30.019 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_13_00_UTC) 2023-08-25T04:15:30.073 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:30.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:30.074 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_14_00_UTC) 2023-08-25T04:15:30.130 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:30.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:30.131 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-08-25-04_15_00_UTC) 2023-08-25T04:15:30.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:30.188 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-08-25T04:15:30.247 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-08-25T04:15:30.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.446+0000 7f9bfac9c640 1 Processor -- start 2023-08-25T04:15:30.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.446+0000 7f9bfac9c640 1 -- start start 2023-08-25T04:15:30.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.446+0000 7f9bfac9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf4159d00 0x7f9bf40cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:30.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.446+0000 7f9bfac9c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9bf40cc930 0x7f9bf40ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:30.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.446+0000 7f9bfac9c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf40c9270 con 0x7f9bf406fb50 2023-08-25T04:15:30.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.446+0000 7f9bfac9c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf40cc510 con 0x7f9bf40cc930 2023-08-25T04:15:30.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.446+0000 7f9bfac9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40ce220 con 0x7f9bf4159d00 2023-08-25T04:15:30.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.446+0000 7f9bf3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9bf406fb50 0x7f9bf40c8b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38926/0 (socket says 172.21.15.55:38926) 2023-08-25T04:15:30.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.446+0000 7f9bf3fff640 1 -- 172.21.15.55:0/2267514723 learned_addr learned my addr 172.21.15.55:0/2267514723 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:30.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.446+0000 7f9bf9239640 1 --2- 172.21.15.55:0/2267514723 >> v2:172.21.15.110:3300/0 conn(0x7f9bf40cc930 0x7f9bf40ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:30.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.446+0000 7f9bf8a38640 1 --2- 172.21.15.55:0/2267514723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf4159d00 0x7f9bf40cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:30.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.446+0000 7f9bf37fe640 1 -- 172.21.15.55:0/2267514723 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847939867 0 0) 0x7f9bf40c9270 con 0x7f9bf406fb50 2023-08-25T04:15:30.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.446+0000 7f9bf37fe640 1 -- 172.21.15.55:0/2267514723 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9be4003530 con 0x7f9bf406fb50 2023-08-25T04:15:30.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.446+0000 7f9bf9239640 1 -- 172.21.15.55:0/2267514723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf4159d00 msgr2=0x7f9bf40cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:30.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.446+0000 7f9bf9239640 1 --2- 172.21.15.55:0/2267514723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf4159d00 0x7f9bf40cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:30.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.446+0000 7f9bf9239640 1 -- 172.21.15.55:0/2267514723 >> v1:172.21.15.55:6789/0 conn(0x7f9bf406fb50 legacy=0x7f9bf40c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:30.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.446+0000 7f9bf9239640 1 -- 172.21.15.55:0/2267514723 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf40ca6c0 con 0x7f9bf40cc930 2023-08-25T04:15:30.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.446+0000 7f9bf8a38640 1 --2- 172.21.15.55:0/2267514723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf4159d00 0x7f9bf40cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:15:30.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.450+0000 7f9bf9239640 1 --2- 172.21.15.55:0/2267514723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf40cc930 0x7f9bf40ccda0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9bec009d90 tx=0x7f9bec01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f66671a5a5cae9c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:30.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.450+0000 7f9bf37fe640 1 -- 172.21.15.55:0/2267514723 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec0a5950 con 0x7f9bf40cc930 2023-08-25T04:15:30.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.450+0000 7f9bf37fe640 1 -- 172.21.15.55:0/2267514723 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec0a5ab0 con 0x7f9bf40cc930 2023-08-25T04:15:30.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.450+0000 7f9bf37fe640 1 -- 172.21.15.55:0/2267514723 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec0a5e40 con 0x7f9bf40cc930 2023-08-25T04:15:30.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.450+0000 7f9bfac9c640 1 -- 172.21.15.55:0/2267514723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf40cc930 msgr2=0x7f9bf40ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:30.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.450+0000 7f9bfac9c640 1 --2- 172.21.15.55:0/2267514723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf40cc930 0x7f9bf40ccda0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9bec009d90 tx=0x7f9bec01c890 comp rx=0 tx=0).stop 2023-08-25T04:15:30.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.450+0000 7f9bfac9c640 1 -- 172.21.15.55:0/2267514723 shutdown_connections 2023-08-25T04:15:30.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.450+0000 7f9bfac9c640 1 --2- 172.21.15.55:0/2267514723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf40cc930 0x7f9bf40ccda0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:30.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.450+0000 7f9bfac9c640 1 --2- 172.21.15.55:0/2267514723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf4159d00 0x7f9bf40cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:30.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.450+0000 7f9bfac9c640 1 -- 172.21.15.55:0/2267514723 >> 172.21.15.55:0/2267514723 conn(0x7f9bf40caf90 msgr2=0x7f9bf40cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:30.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.450+0000 7f9bfac9c640 1 -- 172.21.15.55:0/2267514723 shutdown_connections 2023-08-25T04:15:30.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.450+0000 7f9bfac9c640 1 -- 172.21.15.55:0/2267514723 wait complete. 2023-08-25T04:15:30.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bfac9c640 1 Processor -- start 2023-08-25T04:15:30.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bfac9c640 1 -- start start 2023-08-25T04:15:30.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bfac9c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf406fb50 0x7f9bf40b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:30.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bfac9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf40cc930 0x7f9bf414ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:30.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bfac9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bf4159d00 0x7f9bf4158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:30.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bfac9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf414b3a0 con 0x7f9bf4159d00 2023-08-25T04:15:30.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bfac9c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40b11d0 con 0x7f9bf406fb50 2023-08-25T04:15:30.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bfac9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40b14b0 con 0x7f9bf40cc930 2023-08-25T04:15:30.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bf9239640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bf4159d00 0x7f9bf4158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:30.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bf9239640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bf4159d00 0x7f9bf4158770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50398/0 (socket says 172.21.15.55:50398) 2023-08-25T04:15:30.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bf9239640 1 -- 172.21.15.55:0/1117371584 learned_addr learned my addr 172.21.15.55:0/1117371584 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:30.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bf3fff640 1 --2- 172.21.15.55:0/1117371584 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf40cc930 0x7f9bf414ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:30.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bf8a38640 1 --2- 172.21.15.55:0/1117371584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf406fb50 0x7f9bf40b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:30.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bf9239640 1 -- 172.21.15.55:0/1117371584 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf40cc930 msgr2=0x7f9bf414ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:30.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bf9239640 1 --2- 172.21.15.55:0/1117371584 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf40cc930 0x7f9bf414ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:30.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bf9239640 1 -- 172.21.15.55:0/1117371584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf406fb50 msgr2=0x7f9bf40b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:30.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bf9239640 1 --2- 172.21.15.55:0/1117371584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf406fb50 0x7f9bf40b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:30.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bf9239640 1 -- 172.21.15.55:0/1117371584 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be8009420 con 0x7f9bf4159d00 2023-08-25T04:15:30.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bf9239640 1 --2- 172.21.15.55:0/1117371584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bf4159d00 0x7f9bf4158770 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9bec01a4c0 tx=0x7f9bec019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:30.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bf17fa640 1 -- 172.21.15.55:0/1117371584 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec0aed30 con 0x7f9bf4159d00 2023-08-25T04:15:30.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bf17fa640 1 -- 172.21.15.55:0/1117371584 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec0aee90 con 0x7f9bf4159d00 2023-08-25T04:15:30.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bf17fa640 1 -- 172.21.15.55:0/1117371584 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec0b7650 con 0x7f9bf4159d00 2023-08-25T04:15:30.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bfac9c640 1 -- 172.21.15.55:0/1117371584 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec009a70 con 0x7f9bf4159d00 2023-08-25T04:15:30.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bfac9c640 1 -- 172.21.15.55:0/1117371584 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf40b1a70 con 0x7f9bf4159d00 2023-08-25T04:15:30.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.454+0000 7f9bfac9c640 1 -- 172.21.15.55:0/1117371584 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf40addf0 con 0x7f9bf4159d00 2023-08-25T04:15:30.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.458+0000 7f9bf17fa640 1 -- 172.21.15.55:0/1117371584 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f9bec0b4050 con 0x7f9bf4159d00 2023-08-25T04:15:30.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.458+0000 7f9bf17fa640 1 --2- 172.21.15.55:0/1117371584 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f9bd8065880 0x7f9bd8067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:30.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.458+0000 7f9bf17fa640 1 -- 172.21.15.55:0/1117371584 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f9bec11e5b0 con 0x7f9bf4159d00 2023-08-25T04:15:30.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.458+0000 7f9bf8a38640 1 --2- 172.21.15.55:0/1117371584 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f9bd8065880 0x7f9bd8067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.458+0000 7f9bf8a38640 1 --2- 172.21.15.55:0/1117371584 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f9bd8065880 0x7f9bd8067d40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9be8009be0 tx=0x7f9be8008040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:30.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.462+0000 7f9bf17fa640 1 -- 172.21.15.55:0/1117371584 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9bec0ebcc0 con 0x7f9bf4159d00 2023-08-25T04:15:30.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.638+0000 7f9bfac9c640 1 -- 172.21.15.55:0/1117371584 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bf415a0e0 con 0x7f9bd8065880 2023-08-25T04:15:30.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.798+0000 7f9bf17fa640 1 -- 172.21.15.55:0/1117371584 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f9be8011ac0 con 0x7f9bd8065880 2023-08-25T04:15:30.798 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-08-25T04:15:30.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.798+0000 7f9bfac9c640 1 -- 172.21.15.55:0/1117371584 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f9bd8065880 msgr2=0x7f9bd8067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:30.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.798+0000 7f9bfac9c640 1 --2- 172.21.15.55:0/1117371584 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f9bd8065880 0x7f9bd8067d40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9be8009be0 tx=0x7f9be8008040 comp rx=0 tx=0).stop 2023-08-25T04:15:30.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.798+0000 7f9bfac9c640 1 -- 172.21.15.55:0/1117371584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bf4159d00 msgr2=0x7f9bf4158770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:30.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.798+0000 7f9bfac9c640 1 --2- 172.21.15.55:0/1117371584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bf4159d00 0x7f9bf4158770 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9bec01a4c0 tx=0x7f9bec019630 comp rx=0 tx=0).stop 2023-08-25T04:15:30.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.802+0000 7f9bfac9c640 1 -- 172.21.15.55:0/1117371584 shutdown_connections 2023-08-25T04:15:30.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.802+0000 7f9bfac9c640 1 --2- 172.21.15.55:0/1117371584 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f9bd8065880 0x7f9bd8067d40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:30.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.802+0000 7f9bfac9c640 1 --2- 172.21.15.55:0/1117371584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9bf4159d00 0x7f9bf4158770 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:30.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.802+0000 7f9bfac9c640 1 --2- 172.21.15.55:0/1117371584 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9bf40cc930 0x7f9bf414ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:30.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.802+0000 7f9bfac9c640 1 --2- 172.21.15.55:0/1117371584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9bf406fb50 0x7f9bf40b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:30.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.802+0000 7f9bfac9c640 1 -- 172.21.15.55:0/1117371584 >> 172.21.15.55:0/1117371584 conn(0x7f9bf40caf90 msgr2=0x7f9bf40b0120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:30.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.802+0000 7f9bfac9c640 1 -- 172.21.15.55:0/1117371584 shutdown_connections 2023-08-25T04:15:30.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:30.802+0000 7f9bfac9c640 1 -- 172.21.15.55:0/1117371584 wait complete. 2023-08-25T04:15:30.818 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-08-25T04:15:30.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:30.819 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-08-25T04:15:30.829 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:30.829 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:30.829 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:30.829 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:30.830 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:30.830 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:30.830 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:30.830 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:30.830 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:30.830 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:30.830 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:30.832 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:30.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:30.833 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_05_00_UTC) 2023-08-25T04:15:30.914 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:30.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:30.915 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_06_00_UTC) 2023-08-25T04:15:30.971 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:30.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:30.972 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_07_00_UTC) 2023-08-25T04:15:31.030 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:31.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:31.031 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_08_00_UTC) 2023-08-25T04:15:31.090 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:31.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:31.091 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_09_00_UTC) 2023-08-25T04:15:31.145 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:31.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:31.146 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_10_00_UTC) 2023-08-25T04:15:31.201 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:31.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:31.202 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_11_00_UTC) 2023-08-25T04:15:31.257 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:31.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:31.258 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_12_00_UTC) 2023-08-25T04:15:31.313 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:31.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:31.314 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_13_00_UTC) 2023-08-25T04:15:31.369 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:31.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:31.370 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_14_00_UTC) 2023-08-25T04:15:31.430 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:31.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:31.431 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-08-25-04_15_00_UTC) 2023-08-25T04:15:31.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:31.486 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-08-25T04:15:31.539 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-08-25T04:15:31.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.734+0000 7fc6cbe34640 1 Processor -- start 2023-08-25T04:15:31.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.734+0000 7fc6cbe34640 1 -- start start 2023-08-25T04:15:31.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.734+0000 7fc6cbe34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc6c4069900 0x7fc6c4161070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:31.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.734+0000 7fc6cbe34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6c4071500 0x7fc6c40c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:31.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.734+0000 7fc6cbe34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c4069d60 con 0x7fc6c406e690 2023-08-25T04:15:31.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.734+0000 7fc6cbe34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c406b370 con 0x7fc6c4069900 2023-08-25T04:15:31.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.734+0000 7fc6cbe34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c4071070 con 0x7fc6c4071500 2023-08-25T04:15:31.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.734+0000 7fc6c9bd0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc6c406e690 0x7fc6c406ea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47834/0 (socket says 172.21.15.55:47834) 2023-08-25T04:15:31.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.734+0000 7fc6c93cf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc6c4069900 0x7fc6c4161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:31.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.734+0000 7fc6c9bd0640 1 -- 172.21.15.55:0/1224212352 learned_addr learned my addr 172.21.15.55:0/1224212352 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:31.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.734+0000 7fc6ca3d1640 1 --2- 172.21.15.55:0/1224212352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6c4071500 0x7fc6c40c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:31.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.734+0000 7fc6c93cf640 1 -- 172.21.15.55:0/1224212352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6c4071500 msgr2=0x7fc6c40c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:31.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.734+0000 7fc6c93cf640 1 --2- 172.21.15.55:0/1224212352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6c4071500 0x7fc6c40c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:31.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.734+0000 7fc6c93cf640 1 -- 172.21.15.55:0/1224212352 >> v1:172.21.15.55:6789/0 conn(0x7fc6c406e690 legacy=0x7fc6c406ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:31.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.734+0000 7fc6c93cf640 1 -- 172.21.15.55:0/1224212352 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c41615b0 con 0x7fc6c4069900 2023-08-25T04:15:31.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.734+0000 7fc6c8bce640 1 -- 172.21.15.55:0/1224212352 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566508984 0 0) 0x7fc6c4069d60 con 0x7fc6c406e690 2023-08-25T04:15:31.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.738+0000 7fc6c93cf640 1 --2- 172.21.15.55:0/1224212352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6c4069900 0x7fc6c4161070 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc6b40097c0 tx=0x7fc6b401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8027a6a955c0f6d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:31.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.738+0000 7fc6c8bce640 1 -- 172.21.15.55:0/1224212352 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b40ab600 con 0x7fc6c4069900 2023-08-25T04:15:31.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.738+0000 7fc6c8bce640 1 -- 172.21.15.55:0/1224212352 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b40a7050 con 0x7fc6c4069900 2023-08-25T04:15:31.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.738+0000 7fc6c8bce640 1 -- 172.21.15.55:0/1224212352 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b40ab980 con 0x7fc6c4069900 2023-08-25T04:15:31.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.738+0000 7fc6cbe34640 1 -- 172.21.15.55:0/1224212352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6c4069900 msgr2=0x7fc6c4161070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:31.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.738+0000 7fc6cbe34640 1 --2- 172.21.15.55:0/1224212352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6c4069900 0x7fc6c4161070 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc6b40097c0 tx=0x7fc6b401c480 comp rx=0 tx=0).stop 2023-08-25T04:15:31.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.738+0000 7fc6cbe34640 1 -- 172.21.15.55:0/1224212352 shutdown_connections 2023-08-25T04:15:31.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.738+0000 7fc6cbe34640 1 --2- 172.21.15.55:0/1224212352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6c4071500 0x7fc6c40c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:31.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.738+0000 7fc6cbe34640 1 --2- 172.21.15.55:0/1224212352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6c4069900 0x7fc6c4161070 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:31.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.738+0000 7fc6cbe34640 1 -- 172.21.15.55:0/1224212352 >> 172.21.15.55:0/1224212352 conn(0x7fc6c40cc010 msgr2=0x7fc6c40cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:31.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.738+0000 7fc6cbe34640 1 -- 172.21.15.55:0/1224212352 shutdown_connections 2023-08-25T04:15:31.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.738+0000 7fc6cbe34640 1 -- 172.21.15.55:0/1224212352 wait complete. 2023-08-25T04:15:31.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.738+0000 7fc6cbe34640 1 Processor -- start 2023-08-25T04:15:31.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6cbe34640 1 -- start start 2023-08-25T04:15:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6cbe34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6c4069900 0x7fc6c4151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6cbe34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6c406e690 0x7fc6c40ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6cbe34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6c4071500 0x7fc6c40acef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6cbe34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40c6660 con 0x7fc6c4071500 2023-08-25T04:15:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6cbe34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c4152210 con 0x7fc6c406e690 2023-08-25T04:15:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6cbe34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c40c2dd0 con 0x7fc6c4069900 2023-08-25T04:15:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6ca3d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6c4071500 0x7fc6c40acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:31.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6ca3d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6c4071500 0x7fc6c40acef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58020/0 (socket says 172.21.15.55:58020) 2023-08-25T04:15:31.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6ca3d1640 1 -- 172.21.15.55:0/3962601779 learned_addr learned my addr 172.21.15.55:0/3962601779 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:31.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6c9bd0640 1 --2- 172.21.15.55:0/3962601779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6c4069900 0x7fc6c4151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:31.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6c93cf640 1 --2- 172.21.15.55:0/3962601779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6c406e690 0x7fc6c40ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:31.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6ca3d1640 1 -- 172.21.15.55:0/3962601779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6c4069900 msgr2=0x7fc6c4151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:31.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6ca3d1640 1 --2- 172.21.15.55:0/3962601779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6c4069900 0x7fc6c4151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:31.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6ca3d1640 1 -- 172.21.15.55:0/3962601779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6c406e690 msgr2=0x7fc6c40ac9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:31.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6ca3d1640 1 --2- 172.21.15.55:0/3962601779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6c406e690 0x7fc6c40ac9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:31.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6ca3d1640 1 -- 172.21.15.55:0/3962601779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b4009420 con 0x7fc6c4071500 2023-08-25T04:15:31.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6ca3d1640 1 --2- 172.21.15.55:0/3962601779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6c4071500 0x7fc6c40acef0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc007ec0 tx=0x7fc6bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:31.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6ba7fc640 1 -- 172.21.15.55:0/3962601779 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc014620 con 0x7fc6c4071500 2023-08-25T04:15:31.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6ba7fc640 1 -- 172.21.15.55:0/3962601779 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc0147a0 con 0x7fc6c4071500 2023-08-25T04:15:31.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6ba7fc640 1 -- 172.21.15.55:0/3962601779 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc014b50 con 0x7fc6c4071500 2023-08-25T04:15:31.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6cbe34640 1 -- 172.21.15.55:0/3962601779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c40ad520 con 0x7fc6c4071500 2023-08-25T04:15:31.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6cbe34640 1 -- 172.21.15.55:0/3962601779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c40c6b50 con 0x7fc6c4071500 2023-08-25T04:15:31.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.742+0000 7fc6cbe34640 1 -- 172.21.15.55:0/3962601779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c404dbe0 con 0x7fc6c4071500 2023-08-25T04:15:31.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.746+0000 7fc6ba7fc640 1 -- 172.21.15.55:0/3962601779 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7fc6bc014cb0 con 0x7fc6c4071500 2023-08-25T04:15:31.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.746+0000 7fc6ba7fc640 1 --2- 172.21.15.55:0/3962601779 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fc6a8065880 0x7fc6a8067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:31.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.746+0000 7fc6ba7fc640 1 -- 172.21.15.55:0/3962601779 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fc6bc083dd0 con 0x7fc6c4071500 2023-08-25T04:15:31.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.746+0000 7fc6c9bd0640 1 --2- 172.21.15.55:0/3962601779 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fc6a8065880 0x7fc6a8067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:31.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.746+0000 7fc6c9bd0640 1 --2- 172.21.15.55:0/3962601779 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fc6a8065880 0x7fc6a8067d40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0000f70 tx=0x7fc6c0007b60 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.750+0000 7fc6ba7fc640 1 -- 172.21.15.55:0/3962601779 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc6bc051350 con 0x7fc6c4071500 2023-08-25T04:15:31.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:31.926+0000 7fc6cbe34640 1 -- 172.21.15.55:0/3962601779 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6c4070d00 con 0x7fc6a8065880 2023-08-25T04:15:32.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.006+0000 7fc6ba7fc640 1 -- 172.21.15.55:0/3962601779 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fc6c00071f0 con 0x7fc6a8065880 2023-08-25T04:15:32.006 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-08-25T04:15:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.010+0000 7fc6cbe34640 1 -- 172.21.15.55:0/3962601779 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fc6a8065880 msgr2=0x7fc6a8067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.010+0000 7fc6cbe34640 1 --2- 172.21.15.55:0/3962601779 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fc6a8065880 0x7fc6a8067d40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0000f70 tx=0x7fc6c0007b60 comp rx=0 tx=0).stop 2023-08-25T04:15:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.010+0000 7fc6cbe34640 1 -- 172.21.15.55:0/3962601779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6c4071500 msgr2=0x7fc6c40acef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.010+0000 7fc6cbe34640 1 --2- 172.21.15.55:0/3962601779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6c4071500 0x7fc6c40acef0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc007ec0 tx=0x7fc6bc00e4b0 comp rx=0 tx=0).stop 2023-08-25T04:15:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.010+0000 7fc6cbe34640 1 -- 172.21.15.55:0/3962601779 shutdown_connections 2023-08-25T04:15:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.010+0000 7fc6cbe34640 1 --2- 172.21.15.55:0/3962601779 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fc6a8065880 0x7fc6a8067d40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.010+0000 7fc6cbe34640 1 --2- 172.21.15.55:0/3962601779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6c4071500 0x7fc6c40acef0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.010+0000 7fc6cbe34640 1 --2- 172.21.15.55:0/3962601779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6c406e690 0x7fc6c40ac9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:32.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.010+0000 7fc6cbe34640 1 --2- 172.21.15.55:0/3962601779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6c4069900 0x7fc6c4151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:32.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.010+0000 7fc6cbe34640 1 -- 172.21.15.55:0/3962601779 >> 172.21.15.55:0/3962601779 conn(0x7fc6c40cc010 msgr2=0x7fc6c40cde00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:32.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.010+0000 7fc6cbe34640 1 -- 172.21.15.55:0/3962601779 shutdown_connections 2023-08-25T04:15:32.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.010+0000 7fc6cbe34640 1 -- 172.21.15.55:0/3962601779 wait complete. 2023-08-25T04:15:32.027 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-08-25T04:15:32.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:32.028 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-08-25T04:15:32.039 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:32.039 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:32.039 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:32.039 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:32.039 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:32.040 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:32.040 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:32.040 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:32.040 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:32.040 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:32.041 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:32.041 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:32.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:32.042 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_05_00_UTC) 2023-08-25T04:15:32.104 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:32.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:32.105 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_06_00_UTC) 2023-08-25T04:15:32.162 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:32.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:32.163 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_07_00_UTC) 2023-08-25T04:15:32.226 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:32.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:32.227 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_08_00_UTC) 2023-08-25T04:15:32.286 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:32.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:32.287 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_09_00_UTC) 2023-08-25T04:15:32.342 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:32.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:32.343 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_10_00_UTC) 2023-08-25T04:15:32.398 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:32.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:32.400 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_11_00_UTC) 2023-08-25T04:15:32.457 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:32.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:32.458 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_12_00_UTC) 2023-08-25T04:15:32.513 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:32.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:32.514 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_13_00_UTC) 2023-08-25T04:15:32.574 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:32.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:32.575 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_14_00_UTC) 2023-08-25T04:15:32.637 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:32.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:32.638 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-08-25-04_15_00_UTC) 2023-08-25T04:15:32.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:32.699 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-08-25T04:15:32.750 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-08-25T04:15:32.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda69c6a640 1 Processor -- start 2023-08-25T04:15:32.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda69c6a640 1 -- start start 2023-08-25T04:15:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda69c6a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda6415cb40 0x7fda640d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda69c6a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda640d1970 con 0x7fda640b59f0 2023-08-25T04:15:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda69c6a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda640d0d80 con 0x7fda640cf340 2023-08-25T04:15:32.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda69c6a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda640d1040 con 0x7fda6415cb40 2023-08-25T04:15:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda63fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fda640b59f0 0x7fda640b5e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47844/0 (socket says 172.21.15.55:47844) 2023-08-25T04:15:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda63fff640 1 -- 172.21.15.55:0/2245933872 learned_addr learned my addr 172.21.15.55:0/2245933872 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda637fe640 1 --2- 172.21.15.55:0/2245933872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda6415cb40 0x7fda640d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda62ffd640 1 -- 172.21.15.55:0/2245933872 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707697439 0 0) 0x7fda640d1970 con 0x7fda640b59f0 2023-08-25T04:15:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda62ffd640 1 -- 172.21.15.55:0/2245933872 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda50003530 con 0x7fda640b59f0 2023-08-25T04:15:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda62ffd640 1 -- 172.21.15.55:0/2245933872 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866132245 0 0) 0x7fda640d0d80 con 0x7fda640cf340 2023-08-25T04:15:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda62ffd640 1 -- 172.21.15.55:0/2245933872 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda640d1970 con 0x7fda640cf340 2023-08-25T04:15:32.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda62ffd640 1 -- 172.21.15.55:0/2245933872 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1412594736 0 0) 0x7fda50003530 con 0x7fda640b59f0 2023-08-25T04:15:32.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda62ffd640 1 -- 172.21.15.55:0/2245933872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda6415cb40 msgr2=0x7fda640d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:32.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda62ffd640 1 --2- 172.21.15.55:0/2245933872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda6415cb40 0x7fda640d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:32.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda62ffd640 1 -- 172.21.15.55:0/2245933872 >> v1:172.21.15.110:6789/0 conn(0x7fda640cf340 legacy=0x7fda640cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:32.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda62ffd640 1 -- 172.21.15.55:0/2245933872 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda640d1320 con 0x7fda640b59f0 2023-08-25T04:15:32.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda62ffd640 1 -- 172.21.15.55:0/2245933872 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fda5c001a00 con 0x7fda640b59f0 2023-08-25T04:15:32.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda62ffd640 1 -- 172.21.15.55:0/2245933872 >> v1:172.21.15.55:6789/0 conn(0x7fda640b59f0 legacy=0x7fda640b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:32.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda62ffd640 1 --2- 172.21.15.55:0/2245933872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda50003b40 0x7fda50003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda62ffd640 1 --2- 172.21.15.55:0/2245933872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda500047d0 0x7fda50004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda62ffd640 1 --2- 172.21.15.55:0/2245933872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda6415cb40 0x7fda50005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda62ffd640 1 -- 172.21.15.55:0/2245933872 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda640d1040 con 0x7fda500047d0 2023-08-25T04:15:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda62ffd640 1 -- 172.21.15.55:0/2245933872 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5000ba40 con 0x7fda50003b40 2023-08-25T04:15:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda62ffd640 1 -- 172.21.15.55:0/2245933872 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5000bbd0 con 0x7fda6415cb40 2023-08-25T04:15:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda5bfff640 1 --2- 172.21.15.55:0/2245933872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda500047d0 0x7fda50004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:32.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda637fe640 1 --2- 172.21.15.55:0/2245933872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda50003b40 0x7fda50003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:32.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda63fff640 1 --2- 172.21.15.55:0/2245933872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda6415cb40 0x7fda50005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:32.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda5bfff640 1 -- 172.21.15.55:0/2245933872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda6415cb40 msgr2=0x7fda50005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:32.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda5bfff640 1 --2- 172.21.15.55:0/2245933872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda6415cb40 0x7fda50005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:32.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda5bfff640 1 -- 172.21.15.55:0/2245933872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda50003b40 msgr2=0x7fda50003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:32.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda5bfff640 1 --2- 172.21.15.55:0/2245933872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda50003b40 0x7fda50003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:32.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.942+0000 7fda5bfff640 1 -- 172.21.15.55:0/2245933872 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda50003530 con 0x7fda500047d0 2023-08-25T04:15:32.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.946+0000 7fda5bfff640 1 --2- 172.21.15.55:0/2245933872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda500047d0 0x7fda50004c50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0018d0 tx=0x7fda4c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f3496b0ae6accd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:32.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.946+0000 7fda62ffd640 1 -- 172.21.15.55:0/2245933872 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c0052d0 con 0x7fda500047d0 2023-08-25T04:15:32.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.946+0000 7fda62ffd640 1 -- 172.21.15.55:0/2245933872 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c0a7050 con 0x7fda500047d0 2023-08-25T04:15:32.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.946+0000 7fda62ffd640 1 -- 172.21.15.55:0/2245933872 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c003600 con 0x7fda500047d0 2023-08-25T04:15:32.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.946+0000 7fda69c6a640 1 -- 172.21.15.55:0/2245933872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda500047d0 msgr2=0x7fda50004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:32.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.946+0000 7fda69c6a640 1 --2- 172.21.15.55:0/2245933872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda500047d0 0x7fda50004c50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0018d0 tx=0x7fda4c01c500 comp rx=0 tx=0).stop 2023-08-25T04:15:32.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.946+0000 7fda63fff640 1 -- 172.21.15.55:0/2245933872 reap_dead start 2023-08-25T04:15:32.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.946+0000 7fda69c6a640 1 -- 172.21.15.55:0/2245933872 shutdown_connections 2023-08-25T04:15:32.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.946+0000 7fda69c6a640 1 -- 172.21.15.55:0/2245933872 >> 172.21.15.55:0/2245933872 conn(0x7fda6406aae0 msgr2=0x7fda6406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:32.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.946+0000 7fda69c6a640 1 -- 172.21.15.55:0/2245933872 shutdown_connections 2023-08-25T04:15:32.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.946+0000 7fda69c6a640 1 -- 172.21.15.55:0/2245933872 wait complete. 2023-08-25T04:15:32.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda69c6a640 1 Processor -- start 2023-08-25T04:15:32.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda69c6a640 1 -- start start 2023-08-25T04:15:32.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda69c6a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda500047d0 0x7fda640b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:32.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda69c6a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda641f1c10 0x7fda640b6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:32.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda69c6a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda640b73b0 0x7fda640c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:32.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda69c6a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda640b7830 con 0x7fda640b73b0 2023-08-25T04:15:32.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda69c6a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda640cb860 con 0x7fda641f1c10 2023-08-25T04:15:32.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda69c6a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda640cac50 con 0x7fda500047d0 2023-08-25T04:15:32.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda63fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda640b73b0 0x7fda640c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:32.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda637fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda500047d0 0x7fda640b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:32.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda63fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda640b73b0 0x7fda640c6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58044/0 (socket says 172.21.15.55:58044) 2023-08-25T04:15:32.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda63fff640 1 -- 172.21.15.55:0/3633673897 learned_addr learned my addr 172.21.15.55:0/3633673897 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:32.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda637fe640 1 --2- 172.21.15.55:0/3633673897 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda500047d0 0x7fda640b0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:47758/0 (socket says 172.21.15.55:47758) 2023-08-25T04:15:32.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda5bfff640 1 --2- 172.21.15.55:0/3633673897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda641f1c10 0x7fda640b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:32.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda63fff640 1 -- 172.21.15.55:0/3633673897 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda500047d0 msgr2=0x7fda640b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:32.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda63fff640 1 --2- 172.21.15.55:0/3633673897 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda500047d0 0x7fda640b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:32.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda63fff640 1 -- 172.21.15.55:0/3633673897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda641f1c10 msgr2=0x7fda640b6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:32.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda63fff640 1 --2- 172.21.15.55:0/3633673897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda641f1c10 0x7fda640b6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:32.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda63fff640 1 -- 172.21.15.55:0/3633673897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda640caf30 con 0x7fda640b73b0 2023-08-25T04:15:32.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda63fff640 1 --2- 172.21.15.55:0/3633673897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda640b73b0 0x7fda640c6ec0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fda5c001fb0 tx=0x7fda5c012860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:32.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda60ff9640 1 -- 172.21.15.55:0/3633673897 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c01b070 con 0x7fda640b73b0 2023-08-25T04:15:32.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda60ff9640 1 -- 172.21.15.55:0/3633673897 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c0012a0 con 0x7fda640b73b0 2023-08-25T04:15:32.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda60ff9640 1 -- 172.21.15.55:0/3633673897 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c0166a0 con 0x7fda640b73b0 2023-08-25T04:15:32.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda69c6a640 1 -- 172.21.15.55:0/3633673897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda640cb210 con 0x7fda640b73b0 2023-08-25T04:15:32.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.950+0000 7fda69c6a640 1 -- 172.21.15.55:0/3633673897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda641f2090 con 0x7fda640b73b0 2023-08-25T04:15:32.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.954+0000 7fda69c6a640 1 -- 172.21.15.55:0/3633673897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda64071f80 con 0x7fda640b73b0 2023-08-25T04:15:32.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.954+0000 7fda60ff9640 1 -- 172.21.15.55:0/3633673897 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7fda5c016800 con 0x7fda640b73b0 2023-08-25T04:15:32.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.954+0000 7fda60ff9640 1 --2- 172.21.15.55:0/3633673897 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fda44065880 0x7fda44067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:32.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.954+0000 7fda60ff9640 1 -- 172.21.15.55:0/3633673897 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6757+0+0 (secure 0 0 0) 0x7fda5c086fc0 con 0x7fda640b73b0 2023-08-25T04:15:32.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.954+0000 7fda637fe640 1 --2- 172.21.15.55:0/3633673897 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fda44065880 0x7fda44067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:32.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.954+0000 7fda637fe640 1 --2- 172.21.15.55:0/3633673897 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fda44065880 0x7fda44067d40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fda54009b00 tx=0x7fda54009190 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:32.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:32.958+0000 7fda60ff9640 1 -- 172.21.15.55:0/3633673897 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fda5c054550 con 0x7fda640b73b0 2023-08-25T04:15:33.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:33.134+0000 7fda69c6a640 1 -- 172.21.15.55:0/3633673897 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fda640b1f00 con 0x7fda44065880 2023-08-25T04:15:33.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:33.218+0000 7fda60ff9640 1 -- 172.21.15.55:0/3633673897 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fda54019070 con 0x7fda44065880 2023-08-25T04:15:33.218 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-08-25T04:15:33.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:33.222+0000 7fda69c6a640 1 -- 172.21.15.55:0/3633673897 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fda44065880 msgr2=0x7fda44067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:33.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:33.222+0000 7fda69c6a640 1 --2- 172.21.15.55:0/3633673897 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fda44065880 0x7fda44067d40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fda54009b00 tx=0x7fda54009190 comp rx=0 tx=0).stop 2023-08-25T04:15:33.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:33.222+0000 7fda69c6a640 1 -- 172.21.15.55:0/3633673897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda640b73b0 msgr2=0x7fda640c6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:33.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:33.222+0000 7fda69c6a640 1 --2- 172.21.15.55:0/3633673897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda640b73b0 0x7fda640c6ec0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fda5c001fb0 tx=0x7fda5c012860 comp rx=0 tx=0).stop 2023-08-25T04:15:33.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:33.222+0000 7fda69c6a640 1 -- 172.21.15.55:0/3633673897 shutdown_connections 2023-08-25T04:15:33.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:33.222+0000 7fda69c6a640 1 --2- 172.21.15.55:0/3633673897 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fda44065880 0x7fda44067d40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:33.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:33.222+0000 7fda69c6a640 1 --2- 172.21.15.55:0/3633673897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda640b73b0 0x7fda640c6ec0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:33.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:33.222+0000 7fda69c6a640 1 --2- 172.21.15.55:0/3633673897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda641f1c10 0x7fda640b6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:33.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:33.222+0000 7fda69c6a640 1 --2- 172.21.15.55:0/3633673897 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda500047d0 0x7fda640b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:33.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:33.222+0000 7fda69c6a640 1 -- 172.21.15.55:0/3633673897 >> 172.21.15.55:0/3633673897 conn(0x7fda6406aae0 msgr2=0x7fda640ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:33.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:33.222+0000 7fda69c6a640 1 -- 172.21.15.55:0/3633673897 shutdown_connections 2023-08-25T04:15:33.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:33.222+0000 7fda69c6a640 1 -- 172.21.15.55:0/3633673897 wait complete. 2023-08-25T04:15:33.239 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-08-25T04:15:33.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:33.240 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-08-25T04:15:33.250 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:33.250 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:33.250 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:33.250 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:33.250 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:33.251 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:33.251 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:33.251 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:33.251 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:33.251 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:33.251 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:33.252 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:33.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:33.253 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_05_00_UTC) 2023-08-25T04:15:33.317 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:33.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:33.318 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_06_00_UTC) 2023-08-25T04:15:33.373 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:33.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:33.374 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_07_00_UTC) 2023-08-25T04:15:33.433 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:33.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:33.434 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_08_00_UTC) 2023-08-25T04:15:33.489 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:33.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:33.490 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_09_00_UTC) 2023-08-25T04:15:33.545 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:33.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:33.546 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_10_00_UTC) 2023-08-25T04:15:33.601 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:33.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:33.602 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_11_00_UTC) 2023-08-25T04:15:33.657 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:33.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:33.658 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_12_00_UTC) 2023-08-25T04:15:33.714 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:33.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:33.714 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_13_00_UTC) 2023-08-25T04:15:33.769 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:33.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:33.770 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_14_00_UTC) 2023-08-25T04:15:33.826 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:33.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:33.827 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-08-25-04_15_00_UTC) 2023-08-25T04:15:33.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:33.882 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-08-25T04:15:33.933 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-08-25T04:15:34.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.122+0000 7f624a337640 1 Processor -- start 2023-08-25T04:15:34.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.122+0000 7f624a337640 1 -- start start 2023-08-25T04:15:34.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.126+0000 7f624a337640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6244159d00 0x7f62440cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:34.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.126+0000 7f624a337640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f624406fb50 0x7f62440c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:34.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.126+0000 7f624a337640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f62440cc930 0x7f62440ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:34.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.126+0000 7f624a337640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62440cc510 con 0x7f6244159d00 2023-08-25T04:15:34.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.126+0000 7f624a337640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62440ce220 con 0x7f62440cc930 2023-08-25T04:15:34.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.126+0000 7f624a337640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62440ca6c0 con 0x7f624406fb50 2023-08-25T04:15:34.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.126+0000 7f6243fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6244159d00 0x7f62440cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:34.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.126+0000 7f6243fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6244159d00 0x7f62440cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58054/0 (socket says 172.21.15.55:58054) 2023-08-25T04:15:34.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.126+0000 7f6243fff640 1 -- 172.21.15.55:0/3786514371 learned_addr learned my addr 172.21.15.55:0/3786514371 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:34.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.126+0000 7f62488d4640 1 --2- 172.21.15.55:0/3786514371 >> v2:172.21.15.110:3300/0 conn(0x7f62440cc930 0x7f62440ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:34.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.126+0000 7f62437fe640 1 --2- 172.21.15.55:0/3786514371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f624406fb50 0x7f62440c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:34.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.126+0000 7f6243fff640 1 -- 172.21.15.55:0/3786514371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f624406fb50 msgr2=0x7f62440c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:34.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.126+0000 7f6243fff640 1 --2- 172.21.15.55:0/3786514371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f624406fb50 0x7f62440c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:34.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.126+0000 7f6243fff640 1 -- 172.21.15.55:0/3786514371 >> v2:172.21.15.110:3300/0 conn(0x7f62440cc930 msgr2=0x7f62440ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:34.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.126+0000 7f6243fff640 1 --2- 172.21.15.55:0/3786514371 >> v2:172.21.15.110:3300/0 conn(0x7f62440cc930 0x7f62440ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:34.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.126+0000 7f6243fff640 1 -- 172.21.15.55:0/3786514371 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62440ca9a0 con 0x7f6244159d00 2023-08-25T04:15:34.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.126+0000 7f62488d4640 1 --2- 172.21.15.55:0/3786514371 >> v2:172.21.15.110:3300/0 conn(0x7f62440cc930 0x7f62440ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:15:34.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.126+0000 7f62437fe640 1 --2- 172.21.15.55:0/3786514371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f624406fb50 0x7f62440c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:15:34.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f6243fff640 1 --2- 172.21.15.55:0/3786514371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6244159d00 0x7f62440cdc40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f62440cbd30 tx=0x7f623401eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab84222831c2920 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:34.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f6242ffd640 1 -- 172.21.15.55:0/3786514371 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62340a7bc0 con 0x7f6244159d00 2023-08-25T04:15:34.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f6242ffd640 1 -- 172.21.15.55:0/3786514371 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62340a7d20 con 0x7f6244159d00 2023-08-25T04:15:34.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f6242ffd640 1 -- 172.21.15.55:0/3786514371 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62340af660 con 0x7f6244159d00 2023-08-25T04:15:34.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f624a337640 1 -- 172.21.15.55:0/3786514371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6244159d00 msgr2=0x7f62440cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:34.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f624a337640 1 --2- 172.21.15.55:0/3786514371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6244159d00 0x7f62440cdc40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f62440cbd30 tx=0x7f623401eb10 comp rx=0 tx=0).stop 2023-08-25T04:15:34.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f624a337640 1 -- 172.21.15.55:0/3786514371 shutdown_connections 2023-08-25T04:15:34.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f624a337640 1 --2- 172.21.15.55:0/3786514371 >> v2:172.21.15.110:3300/0 conn(0x7f62440cc930 0x7f62440ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:34.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f624a337640 1 --2- 172.21.15.55:0/3786514371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f624406fb50 0x7f62440c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:34.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f624a337640 1 --2- 172.21.15.55:0/3786514371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6244159d00 0x7f62440cdc40 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:34.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f624a337640 1 -- 172.21.15.55:0/3786514371 >> 172.21.15.55:0/3786514371 conn(0x7f62440caf90 msgr2=0x7f62440cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:34.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f624a337640 1 -- 172.21.15.55:0/3786514371 shutdown_connections 2023-08-25T04:15:34.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f624a337640 1 -- 172.21.15.55:0/3786514371 wait complete. 2023-08-25T04:15:34.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f624a337640 1 Processor -- start 2023-08-25T04:15:34.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f624a337640 1 -- start start 2023-08-25T04:15:34.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f624a337640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f624406fb50 0x7f6244150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:34.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f624a337640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62440cc930 0x7f62440c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:34.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f624a337640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6244159d00 0x7f62440c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:34.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f624a337640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62440c5cd0 con 0x7f62440cc930 2023-08-25T04:15:34.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f624a337640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62440c4420 con 0x7f624406fb50 2023-08-25T04:15:34.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.130+0000 7f624a337640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62440c4700 con 0x7f6244159d00 2023-08-25T04:15:34.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.134+0000 7f62437fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62440cc930 0x7f62440c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:34.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.134+0000 7f62437fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62440cc930 0x7f62440c7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58064/0 (socket says 172.21.15.55:58064) 2023-08-25T04:15:34.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.134+0000 7f62437fe640 1 -- 172.21.15.55:0/278693863 learned_addr learned my addr 172.21.15.55:0/278693863 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:34.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.134+0000 7f6243fff640 1 --2- 172.21.15.55:0/278693863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f624406fb50 0x7f6244150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:34.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.134+0000 7f62488d4640 1 --2- 172.21.15.55:0/278693863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6244159d00 0x7f62440c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:34.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.134+0000 7f62437fe640 1 -- 172.21.15.55:0/278693863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6244159d00 msgr2=0x7f62440c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:34.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.134+0000 7f62437fe640 1 --2- 172.21.15.55:0/278693863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6244159d00 0x7f62440c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:34.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.134+0000 7f62437fe640 1 -- 172.21.15.55:0/278693863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f624406fb50 msgr2=0x7f6244150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:34.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.134+0000 7f62437fe640 1 --2- 172.21.15.55:0/278693863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f624406fb50 0x7f6244150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:34.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.134+0000 7f62437fe640 1 -- 172.21.15.55:0/278693863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623400b770 con 0x7f62440cc930 2023-08-25T04:15:34.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.134+0000 7f62437fe640 1 --2- 172.21.15.55:0/278693863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62440cc930 0x7f62440c7b20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f623800c7f0 tx=0x7f623800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:34.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.134+0000 7f6240ff9640 1 -- 172.21.15.55:0/278693863 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6238007820 con 0x7f62440cc930 2023-08-25T04:15:34.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.134+0000 7f6240ff9640 1 -- 172.21.15.55:0/278693863 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6238007980 con 0x7f62440cc930 2023-08-25T04:15:34.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.134+0000 7f6240ff9640 1 -- 172.21.15.55:0/278693863 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6238007d30 con 0x7f62440cc930 2023-08-25T04:15:34.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.134+0000 7f624a337640 1 -- 172.21.15.55:0/278693863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62440c49e0 con 0x7f62440cc930 2023-08-25T04:15:34.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.134+0000 7f624a337640 1 -- 172.21.15.55:0/278693863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6244150cd0 con 0x7f62440cc930 2023-08-25T04:15:34.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.134+0000 7f624a337640 1 -- 172.21.15.55:0/278693863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624404dbe0 con 0x7f62440cc930 2023-08-25T04:15:34.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.134+0000 7f6240ff9640 1 -- 172.21.15.55:0/278693863 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f62380113f0 con 0x7f62440cc930 2023-08-25T04:15:34.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.138+0000 7f6240ff9640 1 --2- 172.21.15.55:0/278693863 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6230065880 0x7f6230067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:34.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.138+0000 7f6240ff9640 1 -- 172.21.15.55:0/278693863 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f62380839b0 con 0x7f62440cc930 2023-08-25T04:15:34.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.138+0000 7f6243fff640 1 --2- 172.21.15.55:0/278693863 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6230065880 0x7f6230067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:34.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.138+0000 7f6243fff640 1 --2- 172.21.15.55:0/278693863 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6230065880 0x7f6230067d40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f62340b1000 tx=0x7f6234008040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:34.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.142+0000 7f6240ff9640 1 -- 172.21.15.55:0/278693863 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6238050c60 con 0x7f62440cc930 2023-08-25T04:15:34.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.318+0000 7f624a337640 1 -- 172.21.15.55:0/278693863 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f62440cd770 con 0x7f6230065880 2023-08-25T04:15:34.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.402+0000 7f6240ff9640 1 -- 172.21.15.55:0/278693863 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f62340a7e90 con 0x7f6230065880 2023-08-25T04:15:34.399 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-08-25T04:15:34.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.402+0000 7f624a337640 1 -- 172.21.15.55:0/278693863 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6230065880 msgr2=0x7f6230067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:34.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.402+0000 7f624a337640 1 --2- 172.21.15.55:0/278693863 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6230065880 0x7f6230067d40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f62340b1000 tx=0x7f6234008040 comp rx=0 tx=0).stop 2023-08-25T04:15:34.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.402+0000 7f624a337640 1 -- 172.21.15.55:0/278693863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62440cc930 msgr2=0x7f62440c7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:34.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.402+0000 7f624a337640 1 --2- 172.21.15.55:0/278693863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62440cc930 0x7f62440c7b20 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f623800c7f0 tx=0x7f623800ccb0 comp rx=0 tx=0).stop 2023-08-25T04:15:34.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.402+0000 7f624a337640 1 -- 172.21.15.55:0/278693863 shutdown_connections 2023-08-25T04:15:34.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.402+0000 7f624a337640 1 --2- 172.21.15.55:0/278693863 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6230065880 0x7f6230067d40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:34.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.402+0000 7f624a337640 1 --2- 172.21.15.55:0/278693863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6244159d00 0x7f62440c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:34.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.402+0000 7f624a337640 1 --2- 172.21.15.55:0/278693863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62440cc930 0x7f62440c7b20 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:34.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.402+0000 7f624a337640 1 --2- 172.21.15.55:0/278693863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f624406fb50 0x7f6244150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.402+0000 7f624a337640 1 -- 172.21.15.55:0/278693863 >> 172.21.15.55:0/278693863 conn(0x7f62440caf90 msgr2=0x7f62440cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.402+0000 7f624a337640 1 -- 172.21.15.55:0/278693863 shutdown_connections 2023-08-25T04:15:34.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:34.402+0000 7f624a337640 1 -- 172.21.15.55:0/278693863 wait complete. 2023-08-25T04:15:34.421 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-08-25T04:15:34.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:34.422 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-08-25T04:15:34.432 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:34.432 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:34.432 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:34.433 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:34.433 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:34.433 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:34.433 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:34.433 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:34.434 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:34.434 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:34.435 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:34.436 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:34.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:34.436 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_05_00_UTC) 2023-08-25T04:15:34.495 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:34.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:34.496 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_06_00_UTC) 2023-08-25T04:15:34.555 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:34.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:34.556 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_07_00_UTC) 2023-08-25T04:15:34.613 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:34.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:34.614 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_08_00_UTC) 2023-08-25T04:15:34.671 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:34.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:34.672 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_09_00_UTC) 2023-08-25T04:15:34.734 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:34.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:34.736 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_10_00_UTC) 2023-08-25T04:15:34.794 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:34.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:34.795 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_11_00_UTC) 2023-08-25T04:15:34.859 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:34.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:34.860 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_12_00_UTC) 2023-08-25T04:15:34.917 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:34.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:34.918 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_13_00_UTC) 2023-08-25T04:15:34.975 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:34.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:34.977 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_14_00_UTC) 2023-08-25T04:15:35.035 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:35.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:35.036 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-08-25-04_15_00_UTC) 2023-08-25T04:15:35.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:35.096 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-08-25T04:15:35.151 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-08-25T04:15:35.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.342+0000 7ff4e8848640 1 Processor -- start 2023-08-25T04:15:35.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.342+0000 7ff4e8848640 1 -- start start 2023-08-25T04:15:35.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.346+0000 7ff4e8848640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4e40afa20 0x7ff4e40b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:35.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.346+0000 7ff4e8848640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e40cae70 con 0x7ff4e40cf9b0 2023-08-25T04:15:35.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.346+0000 7ff4e8848640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e40cb0e0 con 0x7ff4e40cd870 2023-08-25T04:15:35.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.346+0000 7ff4e8848640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e40cfe10 con 0x7ff4e40afa20 2023-08-25T04:15:35.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.346+0000 7ff4dbfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff4e40cf9b0 0x7ff4e40cd160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47848/0 (socket says 172.21.15.55:47848) 2023-08-25T04:15:35.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.346+0000 7ff4e259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4e40afa20 0x7ff4e40b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:35.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.346+0000 7ff4dbfff640 1 -- 172.21.15.55:0/258253924 learned_addr learned my addr 172.21.15.55:0/258253924 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:35.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.346+0000 7ff4e259c640 1 -- 172.21.15.55:0/258253924 >> v1:172.21.15.110:6789/0 conn(0x7ff4e40cd870 legacy=0x7ff4e415c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:35.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.346+0000 7ff4e259c640 1 -- 172.21.15.55:0/258253924 >> v1:172.21.15.55:6789/0 conn(0x7ff4e40cf9b0 legacy=0x7ff4e40cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:35.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.346+0000 7ff4e259c640 1 -- 172.21.15.55:0/258253924 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e40cb3c0 con 0x7ff4e40afa20 2023-08-25T04:15:35.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.346+0000 7ff4e1d9b640 1 -- 172.21.15.55:0/258253924 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928683524 0 0) 0x7ff4e40cae70 con 0x7ff4e40cf9b0 2023-08-25T04:15:35.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.350+0000 7ff4e259c640 1 --2- 172.21.15.55:0/258253924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4e40afa20 0x7ff4e40b00e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff4d40097c0 tx=0x7ff4d401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb86152fd1c5853 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:35.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.350+0000 7ff4e1d9b640 1 -- 172.21.15.55:0/258253924 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d40ab600 con 0x7ff4e40afa20 2023-08-25T04:15:35.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.350+0000 7ff4e1d9b640 1 -- 172.21.15.55:0/258253924 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d40a7050 con 0x7ff4e40afa20 2023-08-25T04:15:35.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.350+0000 7ff4e1d9b640 1 -- 172.21.15.55:0/258253924 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d40ab980 con 0x7ff4e40afa20 2023-08-25T04:15:35.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.350+0000 7ff4e8848640 1 -- 172.21.15.55:0/258253924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4e40afa20 msgr2=0x7ff4e40b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:35.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.350+0000 7ff4e8848640 1 --2- 172.21.15.55:0/258253924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4e40afa20 0x7ff4e40b00e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff4d40097c0 tx=0x7ff4d401c3c0 comp rx=0 tx=0).stop 2023-08-25T04:15:35.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.350+0000 7ff4e8848640 1 -- 172.21.15.55:0/258253924 shutdown_connections 2023-08-25T04:15:35.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.350+0000 7ff4e8848640 1 --2- 172.21.15.55:0/258253924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4e40afa20 0x7ff4e40b00e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:35.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.350+0000 7ff4e8848640 1 -- 172.21.15.55:0/258253924 >> 172.21.15.55:0/258253924 conn(0x7ff4e40d0780 msgr2=0x7ff4e40d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:35.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.350+0000 7ff4e8848640 1 -- 172.21.15.55:0/258253924 shutdown_connections 2023-08-25T04:15:35.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.350+0000 7ff4e8848640 1 -- 172.21.15.55:0/258253924 wait complete. 2023-08-25T04:15:35.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.350+0000 7ff4e8848640 1 Processor -- start 2023-08-25T04:15:35.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.350+0000 7ff4e8848640 1 -- start start 2023-08-25T04:15:35.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4e8848640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4e40afa20 0x7ff4e40b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:35.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4e8848640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4e40cd870 0x7ff4e40b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:35.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4e8848640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e40cf9b0 0x7ff4e4152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:35.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4e8848640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e40b63d0 con 0x7ff4e40cd870 2023-08-25T04:15:35.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4e8848640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e40b5750 con 0x7ff4e40afa20 2023-08-25T04:15:35.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4e8848640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e40b5a30 con 0x7ff4e40cf9b0 2023-08-25T04:15:35.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4dbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4e40cd870 0x7ff4e40b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:35.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4dbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4e40cd870 0x7ff4e40b3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58086/0 (socket says 172.21.15.55:58086) 2023-08-25T04:15:35.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4dbfff640 1 -- 172.21.15.55:0/4168139030 learned_addr learned my addr 172.21.15.55:0/4168139030 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:35.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4e259c640 1 --2- 172.21.15.55:0/4168139030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4e40afa20 0x7ff4e40b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:35.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4e2d9d640 1 --2- 172.21.15.55:0/4168139030 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e40cf9b0 0x7ff4e4152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:35.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4dbfff640 1 -- 172.21.15.55:0/4168139030 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e40cf9b0 msgr2=0x7ff4e4152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:35.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4dbfff640 1 --2- 172.21.15.55:0/4168139030 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e40cf9b0 0x7ff4e4152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:35.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4dbfff640 1 -- 172.21.15.55:0/4168139030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4e40afa20 msgr2=0x7ff4e40b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:35.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4dbfff640 1 --2- 172.21.15.55:0/4168139030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4e40afa20 0x7ff4e40b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:35.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4dbfff640 1 -- 172.21.15.55:0/4168139030 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d4009420 con 0x7ff4e40cd870 2023-08-25T04:15:35.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4e2d9d640 1 --2- 172.21.15.55:0/4168139030 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e40cf9b0 0x7ff4e4152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:35.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4dbfff640 1 --2- 172.21.15.55:0/4168139030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4e40cd870 0x7ff4e40b3520 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00c410 tx=0x7ff4cc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:35.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4daffd640 1 -- 172.21.15.55:0/4168139030 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc0074e0 con 0x7ff4e40cd870 2023-08-25T04:15:35.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4daffd640 1 -- 172.21.15.55:0/4168139030 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc007640 con 0x7ff4e40cd870 2023-08-25T04:15:35.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4daffd640 1 -- 172.21.15.55:0/4168139030 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc004a30 con 0x7ff4e40cd870 2023-08-25T04:15:35.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4e8848640 1 -- 172.21.15.55:0/4168139030 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e40b5d10 con 0x7ff4e40cd870 2023-08-25T04:15:35.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4e8848640 1 -- 172.21.15.55:0/4168139030 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e40b3a60 con 0x7ff4e40cd870 2023-08-25T04:15:35.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4e8848640 1 -- 172.21.15.55:0/4168139030 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e404dbe0 con 0x7ff4e40cd870 2023-08-25T04:15:35.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.354+0000 7ff4daffd640 1 -- 172.21.15.55:0/4168139030 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7ff4cc004b90 con 0x7ff4e40cd870 2023-08-25T04:15:35.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.358+0000 7ff4daffd640 1 --2- 172.21.15.55:0/4168139030 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7ff4c40658b0 0x7ff4c4067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:35.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.358+0000 7ff4daffd640 1 -- 172.21.15.55:0/4168139030 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6757+0+0 (secure 0 0 0) 0x7ff4cc083220 con 0x7ff4e40cd870 2023-08-25T04:15:35.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.358+0000 7ff4e259c640 1 --2- 172.21.15.55:0/4168139030 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7ff4c40658b0 0x7ff4c4067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:35.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.358+0000 7ff4e259c640 1 --2- 172.21.15.55:0/4168139030 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7ff4c40658b0 0x7ff4c4067d70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4d40ad000 tx=0x7ff4d40a6000 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:35.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.362+0000 7ff4daffd640 1 -- 172.21.15.55:0/4168139030 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff4cc050700 con 0x7ff4e40cd870 2023-08-25T04:15:35.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.542+0000 7ff4e8848640 1 -- 172.21.15.55:0/4168139030 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4e40cdeb0 con 0x7ff4c40658b0 2023-08-25T04:15:35.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.962+0000 7ff4daffd640 1 -- 172.21.15.55:0/4168139030 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7ff4d40ab780 con 0x7ff4c40658b0 2023-08-25T04:15:35.960 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-08-25T04:15:35.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.966+0000 7ff4e8848640 1 -- 172.21.15.55:0/4168139030 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7ff4c40658b0 msgr2=0x7ff4c4067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:35.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.966+0000 7ff4e8848640 1 --2- 172.21.15.55:0/4168139030 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7ff4c40658b0 0x7ff4c4067d70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4d40ad000 tx=0x7ff4d40a6000 comp rx=0 tx=0).stop 2023-08-25T04:15:35.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.966+0000 7ff4e8848640 1 -- 172.21.15.55:0/4168139030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4e40cd870 msgr2=0x7ff4e40b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:35.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.966+0000 7ff4e8848640 1 --2- 172.21.15.55:0/4168139030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4e40cd870 0x7ff4e40b3520 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00c410 tx=0x7ff4cc00c8d0 comp rx=0 tx=0).stop 2023-08-25T04:15:35.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.966+0000 7ff4e8848640 1 -- 172.21.15.55:0/4168139030 shutdown_connections 2023-08-25T04:15:35.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.966+0000 7ff4e8848640 1 --2- 172.21.15.55:0/4168139030 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7ff4c40658b0 0x7ff4c4067d70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:35.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.966+0000 7ff4e8848640 1 --2- 172.21.15.55:0/4168139030 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e40cf9b0 0x7ff4e4152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:35.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.966+0000 7ff4e8848640 1 --2- 172.21.15.55:0/4168139030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4e40cd870 0x7ff4e40b3520 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:35.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.966+0000 7ff4e8848640 1 --2- 172.21.15.55:0/4168139030 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4e40afa20 0x7ff4e40b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:35.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.966+0000 7ff4e8848640 1 -- 172.21.15.55:0/4168139030 >> 172.21.15.55:0/4168139030 conn(0x7ff4e40d0780 msgr2=0x7ff4e4072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:35.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.966+0000 7ff4e8848640 1 -- 172.21.15.55:0/4168139030 shutdown_connections 2023-08-25T04:15:35.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:35.966+0000 7ff4e8848640 1 -- 172.21.15.55:0/4168139030 wait complete. 2023-08-25T04:15:35.997 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-08-25T04:15:35.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:35.998 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-08-25T04:15:36.012 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:36.013 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:36.013 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:36.013 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:36.013 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:36.013 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:36.013 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:36.014 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:36.014 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:36.014 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:36.014 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:36.015 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:36.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:36.015 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_05_00_UTC) 2023-08-25T04:15:36.142 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:36.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:36.143 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_06_00_UTC) 2023-08-25T04:15:36.172 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:36.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:36.173 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_07_00_UTC) 2023-08-25T04:15:36.234 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:36.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:36.235 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_08_00_UTC) 2023-08-25T04:15:36.291 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:36.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:36.291 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_09_00_UTC) 2023-08-25T04:15:36.350 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:36.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:36.351 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_10_00_UTC) 2023-08-25T04:15:36.406 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:36.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:36.407 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_11_00_UTC) 2023-08-25T04:15:36.463 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:36.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:36.463 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_12_00_UTC) 2023-08-25T04:15:36.521 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:36.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:36.523 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_13_00_UTC) 2023-08-25T04:15:36.583 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:36.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:36.584 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_14_00_UTC) 2023-08-25T04:15:36.642 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:36.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:36.643 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-08-25-04_15_00_UTC) 2023-08-25T04:15:36.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:36.699 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-08-25T04:15:36.757 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-08-25T04:15:36.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.946+0000 7fedb3256640 1 Processor -- start 2023-08-25T04:15:36.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.946+0000 7fedb3256640 1 -- start start 2023-08-25T04:15:36.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.946+0000 7fedb3256640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fedac155360 0x7fedac15c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:36.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.946+0000 7fedb3256640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedac06fb50 0x7fedac0aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:36.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.946+0000 7fedb3256640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac15fa50 con 0x7fedac155740 2023-08-25T04:15:36.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.946+0000 7fedb3256640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedac15f2a0 con 0x7fedac155360 2023-08-25T04:15:36.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.950+0000 7fedb3256640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac15f490 con 0x7fedac06fb50 2023-08-25T04:15:36.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.950+0000 7fedb0ff2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fedac155360 0x7fedac15c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:36.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.950+0000 7feda3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fedac155740 0x7fedac15eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47850/0 (socket says 172.21.15.55:47850) 2023-08-25T04:15:36.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.950+0000 7feda3fff640 1 -- 172.21.15.55:0/3090764361 learned_addr learned my addr 172.21.15.55:0/3090764361 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:36.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.950+0000 7fedb17f3640 1 --2- 172.21.15.55:0/3090764361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedac06fb50 0x7fedac0aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:36.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.950+0000 7feda37fe640 1 -- 172.21.15.55:0/3090764361 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310869387 0 0) 0x7fedac15fa50 con 0x7fedac155740 2023-08-25T04:15:36.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.950+0000 7fedb0ff2640 1 -- 172.21.15.55:0/3090764361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedac06fb50 msgr2=0x7fedac0aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:36.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.950+0000 7fedb0ff2640 1 --2- 172.21.15.55:0/3090764361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedac06fb50 0x7fedac0aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:36.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.950+0000 7fedb0ff2640 1 -- 172.21.15.55:0/3090764361 >> v1:172.21.15.55:6789/0 conn(0x7fedac155740 legacy=0x7fedac15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:36.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.950+0000 7fedb0ff2640 1 -- 172.21.15.55:0/3090764361 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac15f770 con 0x7fedac155360 2023-08-25T04:15:36.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.950+0000 7fedb0ff2640 1 --2- 172.21.15.55:0/3090764361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedac155360 0x7fedac15c180 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7feda80097c0 tx=0x7feda801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a0f922de084b67 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:36.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.950+0000 7feda37fe640 1 -- 172.21.15.55:0/3090764361 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda80ab600 con 0x7fedac155360 2023-08-25T04:15:36.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.950+0000 7feda37fe640 1 -- 172.21.15.55:0/3090764361 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda80a7050 con 0x7fedac155360 2023-08-25T04:15:36.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.954+0000 7feda37fe640 1 -- 172.21.15.55:0/3090764361 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda80ab980 con 0x7fedac155360 2023-08-25T04:15:36.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.954+0000 7fedb3256640 1 -- 172.21.15.55:0/3090764361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedac155360 msgr2=0x7fedac15c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:36.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.954+0000 7fedb3256640 1 --2- 172.21.15.55:0/3090764361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedac155360 0x7fedac15c180 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7feda80097c0 tx=0x7feda801c360 comp rx=0 tx=0).stop 2023-08-25T04:15:36.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.954+0000 7fedb3256640 1 -- 172.21.15.55:0/3090764361 shutdown_connections 2023-08-25T04:15:36.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.954+0000 7fedb3256640 1 --2- 172.21.15.55:0/3090764361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedac06fb50 0x7fedac0aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:36.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.954+0000 7fedb3256640 1 --2- 172.21.15.55:0/3090764361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedac155360 0x7fedac15c180 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:36.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.954+0000 7fedb3256640 1 -- 172.21.15.55:0/3090764361 >> 172.21.15.55:0/3090764361 conn(0x7fedac0caf90 msgr2=0x7fedac0cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:36.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.954+0000 7fedb3256640 1 -- 172.21.15.55:0/3090764361 shutdown_connections 2023-08-25T04:15:36.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.954+0000 7fedb3256640 1 -- 172.21.15.55:0/3090764361 wait complete. 2023-08-25T04:15:36.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.954+0000 7fedb3256640 1 Processor -- start 2023-08-25T04:15:36.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.954+0000 7fedb3256640 1 -- start start 2023-08-25T04:15:36.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.954+0000 7fedb3256640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedac06fb50 0x7fedac0c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:36.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.954+0000 7fedb3256640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedac155360 0x7fedac1f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:36.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.954+0000 7fedb3256640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedac155740 0x7fedac0c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:36.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.954+0000 7fedb3256640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0c8860 con 0x7fedac155360 2023-08-25T04:15:36.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.954+0000 7fedb3256640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac156e90 con 0x7fedac155740 2023-08-25T04:15:36.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.954+0000 7fedb3256640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac1f63e0 con 0x7fedac06fb50 2023-08-25T04:15:36.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7feda3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedac155360 0x7fedac1f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:36.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7feda3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedac155360 0x7fedac1f5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58096/0 (socket says 172.21.15.55:58096) 2023-08-25T04:15:36.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7feda3fff640 1 -- 172.21.15.55:0/668125856 learned_addr learned my addr 172.21.15.55:0/668125856 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:36.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7fedb0ff2640 1 --2- 172.21.15.55:0/668125856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedac06fb50 0x7fedac0c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:36.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7fedb17f3640 1 --2- 172.21.15.55:0/668125856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedac155740 0x7fedac0c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:36.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7feda3fff640 1 -- 172.21.15.55:0/668125856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedac06fb50 msgr2=0x7fedac0c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:36.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7feda3fff640 1 --2- 172.21.15.55:0/668125856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedac06fb50 0x7fedac0c4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:36.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7feda3fff640 1 -- 172.21.15.55:0/668125856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedac155740 msgr2=0x7fedac0c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:36.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7feda3fff640 1 --2- 172.21.15.55:0/668125856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedac155740 0x7fedac0c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:36.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7feda3fff640 1 -- 172.21.15.55:0/668125856 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda8009420 con 0x7fedac155360 2023-08-25T04:15:36.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7feda3fff640 1 --2- 172.21.15.55:0/668125856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedac155360 0x7fedac1f5920 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0011f0 tx=0x7fed9c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:36.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7feda17fa640 1 -- 172.21.15.55:0/668125856 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c0074e0 con 0x7fedac155360 2023-08-25T04:15:36.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7feda17fa640 1 -- 172.21.15.55:0/668125856 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c007640 con 0x7fedac155360 2023-08-25T04:15:36.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7feda17fa640 1 -- 172.21.15.55:0/668125856 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c004a10 con 0x7fedac155360 2023-08-25T04:15:36.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7fedb3256640 1 -- 172.21.15.55:0/668125856 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedac1f66c0 con 0x7fedac155360 2023-08-25T04:15:36.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7fedb3256640 1 -- 172.21.15.55:0/668125856 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedac0c2b10 con 0x7fedac155360 2023-08-25T04:15:36.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7fedb3256640 1 -- 172.21.15.55:0/668125856 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedac04dbe0 con 0x7fedac155360 2023-08-25T04:15:36.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7feda17fa640 1 -- 172.21.15.55:0/668125856 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7fed9c004b70 con 0x7fedac155360 2023-08-25T04:15:36.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.958+0000 7feda17fa640 1 --2- 172.21.15.55:0/668125856 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fed98065880 0x7fed98067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:36.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.962+0000 7feda17fa640 1 -- 172.21.15.55:0/668125856 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 7061+0+0 (secure 0 0 0) 0x7fed9c082670 con 0x7fedac155360 2023-08-25T04:15:36.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.962+0000 7fedb0ff2640 1 --2- 172.21.15.55:0/668125856 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fed98065880 0x7fed98067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:36.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.962+0000 7fedb0ff2640 1 --2- 172.21.15.55:0/668125856 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fed98065880 0x7fed98067d40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feda80ad000 tx=0x7feda80a6000 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:36.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:36.966+0000 7feda17fa640 1 -- 172.21.15.55:0/668125856 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fed9c04fcb0 con 0x7fedac155360 2023-08-25T04:15:37.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:37.138+0000 7fedb3256640 1 -- 172.21.15.55:0/668125856 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fedac0b08e0 con 0x7fed98065880 2023-08-25T04:15:37.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:37.214+0000 7feda17fa640 1 -- 172.21.15.55:0/668125856 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7feda80ab660 con 0x7fed98065880 2023-08-25T04:15:37.215 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-08-25T04:15:37.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:37.218+0000 7fedb3256640 1 -- 172.21.15.55:0/668125856 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fed98065880 msgr2=0x7fed98067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:37.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:37.218+0000 7fedb3256640 1 --2- 172.21.15.55:0/668125856 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fed98065880 0x7fed98067d40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feda80ad000 tx=0x7feda80a6000 comp rx=0 tx=0).stop 2023-08-25T04:15:37.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:37.218+0000 7fedb3256640 1 -- 172.21.15.55:0/668125856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedac155360 msgr2=0x7fedac1f5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:37.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:37.218+0000 7fedb3256640 1 --2- 172.21.15.55:0/668125856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedac155360 0x7fedac1f5920 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0011f0 tx=0x7fed9c00c9b0 comp rx=0 tx=0).stop 2023-08-25T04:15:37.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:37.218+0000 7fedb3256640 1 -- 172.21.15.55:0/668125856 shutdown_connections 2023-08-25T04:15:37.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:37.218+0000 7fedb3256640 1 --2- 172.21.15.55:0/668125856 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fed98065880 0x7fed98067d40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:37.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:37.218+0000 7fedb3256640 1 --2- 172.21.15.55:0/668125856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedac155740 0x7fedac0c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:37.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:37.218+0000 7fedb3256640 1 --2- 172.21.15.55:0/668125856 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedac155360 0x7fedac1f5920 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:37.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:37.218+0000 7fedb3256640 1 --2- 172.21.15.55:0/668125856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedac06fb50 0x7fedac0c4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:37.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:37.218+0000 7fedb3256640 1 -- 172.21.15.55:0/668125856 >> 172.21.15.55:0/668125856 conn(0x7fedac0caf90 msgr2=0x7fedac0c8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:37.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:37.218+0000 7fedb3256640 1 -- 172.21.15.55:0/668125856 shutdown_connections 2023-08-25T04:15:37.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:37.218+0000 7fedb3256640 1 -- 172.21.15.55:0/668125856 wait complete. 2023-08-25T04:15:37.235 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-08-25T04:15:37.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:37.237 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-08-25T04:15:37.247 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:37.247 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:37.247 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:37.247 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:37.248 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:37.248 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:37.248 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:37.248 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:37.248 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:37.248 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:37.249 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:37.249 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:37.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:37.250 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_05_00_UTC) 2023-08-25T04:15:37.307 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:37.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:37.308 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_06_00_UTC) 2023-08-25T04:15:37.365 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:37.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:37.366 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_07_00_UTC) 2023-08-25T04:15:37.421 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:37.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:37.422 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_08_00_UTC) 2023-08-25T04:15:37.477 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:37.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:37.478 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_09_00_UTC) 2023-08-25T04:15:37.534 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:37.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:37.535 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_10_00_UTC) 2023-08-25T04:15:37.597 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:37.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:37.598 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_11_00_UTC) 2023-08-25T04:15:37.653 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:37.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:37.654 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_12_00_UTC) 2023-08-25T04:15:37.716 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:37.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:37.717 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_13_00_UTC) 2023-08-25T04:15:37.778 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:37.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:37.779 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_14_00_UTC) 2023-08-25T04:15:37.833 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:37.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:37.834 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-08-25-04_15_00_UTC) 2023-08-25T04:15:37.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:37.890 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-08-25T04:15:37.951 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-08-25T04:15:38.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.142+0000 7f9a0ddfa640 1 Processor -- start 2023-08-25T04:15:38.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.142+0000 7f9a0ddfa640 1 -- start start 2023-08-25T04:15:38.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.146+0000 7f9a0ddfa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9a08155360 0x7f9a0815c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:38.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.146+0000 7f9a0ddfa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0815fa50 con 0x7f9a0806fb50 2023-08-25T04:15:38.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.146+0000 7f9a0ddfa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0815f490 con 0x7f9a08155740 2023-08-25T04:15:38.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.146+0000 7f9a0ddfa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0815f2a0 con 0x7f9a08155360 2023-08-25T04:15:38.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.146+0000 7f9a077fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9a08155360 0x7f9a0815c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:38.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.146+0000 7f9a07fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9a0806fb50 0x7f9a080aff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47860/0 (socket says 172.21.15.55:47860) 2023-08-25T04:15:38.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.146+0000 7f9a07fff640 1 -- 172.21.15.55:0/2106730622 learned_addr learned my addr 172.21.15.55:0/2106730622 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:38.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.146+0000 7f9a077fe640 1 -- 172.21.15.55:0/2106730622 >> v1:172.21.15.110:6789/0 conn(0x7f9a08155740 legacy=0x7f9a0815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:38.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.146+0000 7f9a077fe640 1 -- 172.21.15.55:0/2106730622 >> v1:172.21.15.55:6789/0 conn(0x7f9a0806fb50 legacy=0x7f9a080aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:38.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.146+0000 7f9a077fe640 1 -- 172.21.15.55:0/2106730622 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0815f770 con 0x7f9a08155360 2023-08-25T04:15:38.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.146+0000 7f9a067fc640 1 -- 172.21.15.55:0/2106730622 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280315295 0 0) 0x7f9a0815fa50 con 0x7f9a0806fb50 2023-08-25T04:15:38.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.150+0000 7f9a077fe640 1 --2- 172.21.15.55:0/2106730622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a08155360 0x7f9a0815c180 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f99f80097c0 tx=0x7f99f801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1caa84800b182c0e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:38.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.150+0000 7f9a067fc640 1 -- 172.21.15.55:0/2106730622 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f80ab600 con 0x7f9a08155360 2023-08-25T04:15:38.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.150+0000 7f9a067fc640 1 -- 172.21.15.55:0/2106730622 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f80a7050 con 0x7f9a08155360 2023-08-25T04:15:38.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.150+0000 7f9a067fc640 1 -- 172.21.15.55:0/2106730622 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f80ab980 con 0x7f9a08155360 2023-08-25T04:15:38.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.150+0000 7f9a0ddfa640 1 -- 172.21.15.55:0/2106730622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a08155360 msgr2=0x7f9a0815c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:38.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.150+0000 7f9a0ddfa640 1 --2- 172.21.15.55:0/2106730622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a08155360 0x7f9a0815c180 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f99f80097c0 tx=0x7f99f801c360 comp rx=0 tx=0).stop 2023-08-25T04:15:38.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.150+0000 7f9a0ddfa640 1 -- 172.21.15.55:0/2106730622 shutdown_connections 2023-08-25T04:15:38.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.150+0000 7f9a0ddfa640 1 --2- 172.21.15.55:0/2106730622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a08155360 0x7f9a0815c180 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:38.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.150+0000 7f9a0ddfa640 1 -- 172.21.15.55:0/2106730622 >> 172.21.15.55:0/2106730622 conn(0x7f9a080caf90 msgr2=0x7f9a080cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:38.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.150+0000 7f9a0ddfa640 1 -- 172.21.15.55:0/2106730622 shutdown_connections 2023-08-25T04:15:38.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.150+0000 7f9a0ddfa640 1 -- 172.21.15.55:0/2106730622 wait complete. 2023-08-25T04:15:38.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.150+0000 7f9a0ddfa640 1 Processor -- start 2023-08-25T04:15:38.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.150+0000 7f9a0ddfa640 1 -- start start 2023-08-25T04:15:38.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a0ddfa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a0806fb50 0x7f9a08151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:38.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a0ddfa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a08155360 0x7f9a08153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:38.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a0ddfa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a08155740 0x7f9a080ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:38.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a0ddfa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08155220 con 0x7f9a08155360 2023-08-25T04:15:38.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a0ddfa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08154390 con 0x7f9a08155740 2023-08-25T04:15:38.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a0ddfa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08154610 con 0x7f9a0806fb50 2023-08-25T04:15:38.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a06ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a08155360 0x7f9a08153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:38.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a077fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a0806fb50 0x7f9a08151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:38.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a06ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a08155360 0x7f9a08153e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58128/0 (socket says 172.21.15.55:58128) 2023-08-25T04:15:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a06ffd640 1 -- 172.21.15.55:0/3942733262 learned_addr learned my addr 172.21.15.55:0/3942733262 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a07fff640 1 --2- 172.21.15.55:0/3942733262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a08155740 0x7f9a080ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:38.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a06ffd640 1 -- 172.21.15.55:0/3942733262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a0806fb50 msgr2=0x7f9a08151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:38.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a06ffd640 1 --2- 172.21.15.55:0/3942733262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a0806fb50 0x7f9a08151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:38.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a06ffd640 1 -- 172.21.15.55:0/3942733262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a08155740 msgr2=0x7f9a080ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:38.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a06ffd640 1 --2- 172.21.15.55:0/3942733262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a08155740 0x7f9a080ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:38.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a06ffd640 1 -- 172.21.15.55:0/3942733262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f8009420 con 0x7f9a08155360 2023-08-25T04:15:38.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a06ffd640 1 --2- 172.21.15.55:0/3942733262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a08155360 0x7f9a08153e50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00c500 tx=0x7f99fc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:38.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f99effff640 1 -- 172.21.15.55:0/3942733262 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc005220 con 0x7f9a08155360 2023-08-25T04:15:38.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f99effff640 1 -- 172.21.15.55:0/3942733262 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc005380 con 0x7f9a08155360 2023-08-25T04:15:38.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f99effff640 1 -- 172.21.15.55:0/3942733262 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc007270 con 0x7f9a08155360 2023-08-25T04:15:38.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a0ddfa640 1 -- 172.21.15.55:0/3942733262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a081548f0 con 0x7f9a08155360 2023-08-25T04:15:38.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a0ddfa640 1 -- 172.21.15.55:0/3942733262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a08154eb0 con 0x7f9a08155360 2023-08-25T04:15:38.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.154+0000 7f9a0ddfa640 1 -- 172.21.15.55:0/3942733262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a080b1230 con 0x7f9a08155360 2023-08-25T04:15:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.158+0000 7f99effff640 1 -- 172.21.15.55:0/3942733262 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f99fc0073d0 con 0x7f9a08155360 2023-08-25T04:15:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.158+0000 7f99effff640 1 --2- 172.21.15.55:0/3942733262 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f99f4065880 0x7f99f4067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.158+0000 7f99effff640 1 -- 172.21.15.55:0/3942733262 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 7157+0+0 (secure 0 0 0) 0x7f99fc0828c0 con 0x7f9a08155360 2023-08-25T04:15:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.158+0000 7f9a077fe640 1 --2- 172.21.15.55:0/3942733262 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f99f4065880 0x7f99f4067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.158+0000 7f9a077fe640 1 --2- 172.21.15.55:0/3942733262 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f99f4065880 0x7f99f4067d40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f99f80ad000 tx=0x7f99f80a6000 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:38.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.162+0000 7f99effff640 1 -- 172.21.15.55:0/3942733262 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f99fc04fd80 con 0x7f9a08155360 2023-08-25T04:15:38.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.338+0000 7f9a0ddfa640 1 -- 172.21.15.55:0/3942733262 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a0804dbe0 con 0x7f99f4065880 2023-08-25T04:15:38.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.414+0000 7f99effff640 1 -- 172.21.15.55:0/3942733262 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f9a0804dbe0 con 0x7f99f4065880 2023-08-25T04:15:38.413 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-08-25T04:15:38.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.414+0000 7f9a0ddfa640 1 -- 172.21.15.55:0/3942733262 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f99f4065880 msgr2=0x7f99f4067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:38.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.414+0000 7f9a0ddfa640 1 --2- 172.21.15.55:0/3942733262 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f99f4065880 0x7f99f4067d40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f99f80ad000 tx=0x7f99f80a6000 comp rx=0 tx=0).stop 2023-08-25T04:15:38.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.414+0000 7f9a0ddfa640 1 -- 172.21.15.55:0/3942733262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a08155360 msgr2=0x7f9a08153e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:38.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.414+0000 7f9a0ddfa640 1 --2- 172.21.15.55:0/3942733262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a08155360 0x7f9a08153e50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00c500 tx=0x7f99fc00c9c0 comp rx=0 tx=0).stop 2023-08-25T04:15:38.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.414+0000 7f9a0ddfa640 1 -- 172.21.15.55:0/3942733262 shutdown_connections 2023-08-25T04:15:38.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.414+0000 7f9a0ddfa640 1 --2- 172.21.15.55:0/3942733262 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f99f4065880 0x7f99f4067d40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:38.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.414+0000 7f9a0ddfa640 1 --2- 172.21.15.55:0/3942733262 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a08155740 0x7f9a080ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:38.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.414+0000 7f9a0ddfa640 1 --2- 172.21.15.55:0/3942733262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a08155360 0x7f9a08153e50 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:38.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.414+0000 7f9a0ddfa640 1 --2- 172.21.15.55:0/3942733262 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a0806fb50 0x7f9a08151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:38.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.414+0000 7f9a0ddfa640 1 -- 172.21.15.55:0/3942733262 >> 172.21.15.55:0/3942733262 conn(0x7f9a080caf90 msgr2=0x7f9a08158040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:38.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.414+0000 7f9a0ddfa640 1 -- 172.21.15.55:0/3942733262 shutdown_connections 2023-08-25T04:15:38.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:38.418+0000 7f9a0ddfa640 1 -- 172.21.15.55:0/3942733262 wait complete. 2023-08-25T04:15:38.434 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-08-25T04:15:38.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:38.435 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-08-25T04:15:38.445 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:38.445 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:38.445 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:38.446 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:38.446 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:38.446 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:38.446 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:38.446 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:38.446 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:38.446 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:38.447 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:38.447 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:38.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:38.448 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_05_00_UTC) 2023-08-25T04:15:38.507 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:38.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:38.508 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_06_00_UTC) 2023-08-25T04:15:38.594 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:38.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:38.595 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_07_00_UTC) 2023-08-25T04:15:38.653 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:38.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:38.655 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_08_00_UTC) 2023-08-25T04:15:38.716 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:38.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:38.717 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_09_00_UTC) 2023-08-25T04:15:38.774 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:38.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:38.775 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_10_00_UTC) 2023-08-25T04:15:38.829 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:38.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:38.830 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_11_00_UTC) 2023-08-25T04:15:38.885 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:38.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:38.887 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_12_00_UTC) 2023-08-25T04:15:38.941 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:38.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:38.942 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_13_00_UTC) 2023-08-25T04:15:39.001 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:39.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:39.002 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_14_00_UTC) 2023-08-25T04:15:39.070 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:39.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:39.071 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-08-25-04_15_00_UTC) 2023-08-25T04:15:39.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:39.135 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-08-25T04:15:39.190 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-08-25T04:15:39.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.386+0000 7fa8e53e1640 1 Processor -- start 2023-08-25T04:15:39.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.386+0000 7fa8e53e1640 1 -- start start 2023-08-25T04:15:39.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.390+0000 7fa8e53e1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8e0155740 0x7fa8e015c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:39.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.390+0000 7fa8e53e1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa8e006fb50 0x7fa8e00aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:39.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.390+0000 7fa8e53e1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e015fa50 con 0x7fa8e0155360 2023-08-25T04:15:39.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.390+0000 7fa8e53e1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e015f2a0 con 0x7fa8e0155740 2023-08-25T04:15:39.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.390+0000 7fa8e53e1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e015f490 con 0x7fa8e006fb50 2023-08-25T04:15:39.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.390+0000 7fa8deffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa8e0155360 0x7fa8e015eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47864/0 (socket says 172.21.15.55:47864) 2023-08-25T04:15:39.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.390+0000 7fa8d67fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8e0155740 0x7fa8e015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:39.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.390+0000 7fa8deffd640 1 -- 172.21.15.55:0/3014104322 learned_addr learned my addr 172.21.15.55:0/3014104322 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.390+0000 7fa8df7fe640 1 --2- 172.21.15.55:0/3014104322 >> v2:172.21.15.110:3300/0 conn(0x7fa8e006fb50 0x7fa8e00aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.390+0000 7fa8d67fc640 1 -- 172.21.15.55:0/3014104322 >> v2:172.21.15.110:3300/0 conn(0x7fa8e006fb50 msgr2=0x7fa8e00aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.390+0000 7fa8d67fc640 1 --2- 172.21.15.55:0/3014104322 >> v2:172.21.15.110:3300/0 conn(0x7fa8e006fb50 0x7fa8e00aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:39.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.390+0000 7fa8d67fc640 1 -- 172.21.15.55:0/3014104322 >> v1:172.21.15.55:6789/0 conn(0x7fa8e0155360 legacy=0x7fa8e015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.390+0000 7fa8d67fc640 1 -- 172.21.15.55:0/3014104322 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e015f770 con 0x7fa8e0155740 2023-08-25T04:15:39.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.390+0000 7fa8de7fc640 1 -- 172.21.15.55:0/3014104322 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872102306 0 0) 0x7fa8e015fa50 con 0x7fa8e0155360 2023-08-25T04:15:39.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.394+0000 7fa8d67fc640 1 --2- 172.21.15.55:0/3014104322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0155740 0x7fa8e015c180 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa8e01590d0 tx=0x7fa8c801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314f2a8ac3a8230f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:39.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.394+0000 7fa8de7fc640 1 -- 172.21.15.55:0/3014104322 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80ab600 con 0x7fa8e0155740 2023-08-25T04:15:39.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.394+0000 7fa8de7fc640 1 -- 172.21.15.55:0/3014104322 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c80a7050 con 0x7fa8e0155740 2023-08-25T04:15:39.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.394+0000 7fa8de7fc640 1 -- 172.21.15.55:0/3014104322 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80ab980 con 0x7fa8e0155740 2023-08-25T04:15:39.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.394+0000 7fa8e53e1640 1 -- 172.21.15.55:0/3014104322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0155740 msgr2=0x7fa8e015c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:39.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.394+0000 7fa8e53e1640 1 --2- 172.21.15.55:0/3014104322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0155740 0x7fa8e015c180 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa8e01590d0 tx=0x7fa8c801c340 comp rx=0 tx=0).stop 2023-08-25T04:15:39.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.394+0000 7fa8e53e1640 1 -- 172.21.15.55:0/3014104322 shutdown_connections 2023-08-25T04:15:39.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.394+0000 7fa8e53e1640 1 --2- 172.21.15.55:0/3014104322 >> v2:172.21.15.110:3300/0 conn(0x7fa8e006fb50 0x7fa8e00aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:39.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.394+0000 7fa8e53e1640 1 --2- 172.21.15.55:0/3014104322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0155740 0x7fa8e015c180 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:39.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.394+0000 7fa8e53e1640 1 -- 172.21.15.55:0/3014104322 >> 172.21.15.55:0/3014104322 conn(0x7fa8e00caf90 msgr2=0x7fa8e00cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:39.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.394+0000 7fa8e53e1640 1 -- 172.21.15.55:0/3014104322 shutdown_connections 2023-08-25T04:15:39.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.394+0000 7fa8e53e1640 1 -- 172.21.15.55:0/3014104322 wait complete. 2023-08-25T04:15:39.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.394+0000 7fa8e53e1640 1 Processor -- start 2023-08-25T04:15:39.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.394+0000 7fa8e53e1640 1 -- start start 2023-08-25T04:15:39.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8e53e1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8e006fb50 0x7fa8e0154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:39.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8e53e1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8e0155360 0x7fa8e015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:39.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8e53e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0155740 0x7fa8e015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:39.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8e53e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e01f59b0 con 0x7fa8e0155740 2023-08-25T04:15:39.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8e53e1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00c85a0 con 0x7fa8e0155360 2023-08-25T04:15:39.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8e53e1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e01f6790 con 0x7fa8e006fb50 2023-08-25T04:15:39.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8df7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0155740 0x7fa8e015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:39.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8df7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0155740 0x7fa8e015d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58136/0 (socket says 172.21.15.55:58136) 2023-08-25T04:15:39.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8df7fe640 1 -- 172.21.15.55:0/2811935713 learned_addr learned my addr 172.21.15.55:0/2811935713 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:39.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8deffd640 1 --2- 172.21.15.55:0/2811935713 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8e006fb50 0x7fa8e0154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:39.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8d67fc640 1 --2- 172.21.15.55:0/2811935713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8e0155360 0x7fa8e015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:39.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8df7fe640 1 -- 172.21.15.55:0/2811935713 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8e006fb50 msgr2=0x7fa8e0154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:39.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8df7fe640 1 --2- 172.21.15.55:0/2811935713 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8e006fb50 0x7fa8e0154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:39.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8df7fe640 1 -- 172.21.15.55:0/2811935713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8e0155360 msgr2=0x7fa8e015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:39.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8df7fe640 1 --2- 172.21.15.55:0/2811935713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8e0155360 0x7fa8e015d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:39.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8df7fe640 1 -- 172.21.15.55:0/2811935713 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8009420 con 0x7fa8e0155740 2023-08-25T04:15:39.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8df7fe640 1 --2- 172.21.15.55:0/2811935713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0155740 0x7fa8e015d7f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800e7f0 tx=0x7fa8d800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:39.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8d7fff640 1 -- 172.21.15.55:0/2811935713 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8009530 con 0x7fa8e0155740 2023-08-25T04:15:39.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8d7fff640 1 -- 172.21.15.55:0/2811935713 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d800eea0 con 0x7fa8e0155740 2023-08-25T04:15:39.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8d7fff640 1 -- 172.21.15.55:0/2811935713 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d800cb60 con 0x7fa8e0155740 2023-08-25T04:15:39.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8e53e1640 1 -- 172.21.15.55:0/2811935713 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e0155190 con 0x7fa8e0155740 2023-08-25T04:15:39.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8e53e1640 1 -- 172.21.15.55:0/2811935713 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e01f5c20 con 0x7fa8e0155740 2023-08-25T04:15:39.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8e53e1640 1 -- 172.21.15.55:0/2811935713 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e01f6900 con 0x7fa8e0155740 2023-08-25T04:15:39.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.398+0000 7fa8d7fff640 1 -- 172.21.15.55:0/2811935713 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7fa8d800ccc0 con 0x7fa8e0155740 2023-08-25T04:15:39.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.402+0000 7fa8d7fff640 1 --2- 172.21.15.55:0/2811935713 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fa8c0065880 0x7fa8c0067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:39.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.402+0000 7fa8d7fff640 1 -- 172.21.15.55:0/2811935713 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7125+0+0 (secure 0 0 0) 0x7fa8d8083410 con 0x7fa8e0155740 2023-08-25T04:15:39.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.402+0000 7fa8deffd640 1 --2- 172.21.15.55:0/2811935713 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fa8c0065880 0x7fa8c0067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:39.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.402+0000 7fa8deffd640 1 --2- 172.21.15.55:0/2811935713 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fa8c0065880 0x7fa8c0067d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00012f0 tx=0x7fa8d0001770 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:39.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.406+0000 7fa8d7fff640 1 -- 172.21.15.55:0/2811935713 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa8d80508e0 con 0x7fa8e0155740 2023-08-25T04:15:39.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.590+0000 7fa8e53e1640 1 -- 172.21.15.55:0/2811935713 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8e00b08e0 con 0x7fa8c0065880 2023-08-25T04:15:39.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.702+0000 7fa8d7fff640 1 -- 172.21.15.55:0/2811935713 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fa8d0004e10 con 0x7fa8c0065880 2023-08-25T04:15:39.703 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-08-25T04:15:39.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.706+0000 7fa8e53e1640 1 -- 172.21.15.55:0/2811935713 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fa8c0065880 msgr2=0x7fa8c0067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:39.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.706+0000 7fa8e53e1640 1 --2- 172.21.15.55:0/2811935713 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fa8c0065880 0x7fa8c0067d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa8d00012f0 tx=0x7fa8d0001770 comp rx=0 tx=0).stop 2023-08-25T04:15:39.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.706+0000 7fa8e53e1640 1 -- 172.21.15.55:0/2811935713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0155740 msgr2=0x7fa8e015d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:39.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.706+0000 7fa8e53e1640 1 --2- 172.21.15.55:0/2811935713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0155740 0x7fa8e015d7f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa8d800e7f0 tx=0x7fa8d800ecb0 comp rx=0 tx=0).stop 2023-08-25T04:15:39.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.706+0000 7fa8e53e1640 1 -- 172.21.15.55:0/2811935713 shutdown_connections 2023-08-25T04:15:39.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.706+0000 7fa8e53e1640 1 --2- 172.21.15.55:0/2811935713 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fa8c0065880 0x7fa8c0067d40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:39.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.706+0000 7fa8e53e1640 1 --2- 172.21.15.55:0/2811935713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8e0155740 0x7fa8e015d7f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:39.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.706+0000 7fa8e53e1640 1 --2- 172.21.15.55:0/2811935713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8e0155360 0x7fa8e015d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:39.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.706+0000 7fa8e53e1640 1 --2- 172.21.15.55:0/2811935713 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8e006fb50 0x7fa8e0154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:39.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.706+0000 7fa8e53e1640 1 -- 172.21.15.55:0/2811935713 >> 172.21.15.55:0/2811935713 conn(0x7fa8e00caf90 msgr2=0x7fa8e00aeba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:39.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.706+0000 7fa8e53e1640 1 -- 172.21.15.55:0/2811935713 shutdown_connections 2023-08-25T04:15:39.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:39.706+0000 7fa8e53e1640 1 -- 172.21.15.55:0/2811935713 wait complete. 2023-08-25T04:15:39.723 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-08-25T04:15:39.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:39.724 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-08-25T04:15:39.734 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:39.734 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:39.735 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:39.735 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:39.735 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:39.735 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:39.735 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:39.735 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:39.735 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:39.736 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:39.736 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:39.736 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:39.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:39.737 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_05_00_UTC) 2023-08-25T04:15:39.807 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:39.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:39.808 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_06_00_UTC) 2023-08-25T04:15:39.865 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:39.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:39.866 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_07_00_UTC) 2023-08-25T04:15:39.921 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:39.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:39.922 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_08_00_UTC) 2023-08-25T04:15:39.979 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:39.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:39.980 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_09_00_UTC) 2023-08-25T04:15:40.038 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:40.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:40.039 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_10_00_UTC) 2023-08-25T04:15:40.093 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:40.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:40.094 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_11_00_UTC) 2023-08-25T04:15:40.154 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:40.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:40.155 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_12_00_UTC) 2023-08-25T04:15:40.209 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:40.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:40.210 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_13_00_UTC) 2023-08-25T04:15:40.269 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:40.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:40.270 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_14_00_UTC) 2023-08-25T04:15:40.326 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:40.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:40.327 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-08-25-04_15_00_UTC) 2023-08-25T04:15:40.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:40.382 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-08-25T04:15:40.435 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-08-25T04:15:40.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.678+0000 7f66bd883640 1 Processor -- start 2023-08-25T04:15:40.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.678+0000 7f66bd883640 1 -- start start 2023-08-25T04:15:40.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.682+0000 7f66bd883640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66b80ca160 0x7f66b80ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:40.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.682+0000 7f66bd883640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b80c8cc0 con 0x7f66b80ad5e0 2023-08-25T04:15:40.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.682+0000 7f66bd883640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b80cd790 con 0x7f66b80c18b0 2023-08-25T04:15:40.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.682+0000 7f66bd883640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b80cd1d0 con 0x7f66b80ca160 2023-08-25T04:15:40.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.682+0000 7f66bc881640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f66b80ad5e0 0x7f66b80c11a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53500/0 (socket says 172.21.15.55:53500) 2023-08-25T04:15:40.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.682+0000 7f66bc881640 1 -- 172.21.15.55:0/1188947757 learned_addr learned my addr 172.21.15.55:0/1188947757 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:40.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.682+0000 7f66bd082640 1 --2- 172.21.15.55:0/1188947757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66b80ca160 0x7f66b80ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:40.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.682+0000 7f66b77fe640 1 -- 172.21.15.55:0/1188947757 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742516002 0 0) 0x7f66b80c8cc0 con 0x7f66b80ad5e0 2023-08-25T04:15:40.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.682+0000 7f66b77fe640 1 -- 172.21.15.55:0/1188947757 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66a4003530 con 0x7f66b80ad5e0 2023-08-25T04:15:40.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.682+0000 7f66bd082640 1 -- 172.21.15.55:0/1188947757 >> v1:172.21.15.110:6789/0 conn(0x7f66b80c18b0 legacy=0x7f66b80cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:40.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.682+0000 7f66bd082640 1 -- 172.21.15.55:0/1188947757 >> v1:172.21.15.55:6789/0 conn(0x7f66b80ad5e0 legacy=0x7f66b80c11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:40.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.682+0000 7f66bd082640 1 -- 172.21.15.55:0/1188947757 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b80cd4b0 con 0x7f66b80ca160 2023-08-25T04:15:40.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.686+0000 7f66bd082640 1 --2- 172.21.15.55:0/1188947757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66b80ca160 0x7f66b80ccb70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f66a00097f0 tx=0x7f66a001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=baf77f0bb190aa71 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:40.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.686+0000 7f66b77fe640 1 -- 172.21.15.55:0/1188947757 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a00ab610 con 0x7f66b80ca160 2023-08-25T04:15:40.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.686+0000 7f66b77fe640 1 -- 172.21.15.55:0/1188947757 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a00ab770 con 0x7f66b80ca160 2023-08-25T04:15:40.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.686+0000 7f66b77fe640 1 -- 172.21.15.55:0/1188947757 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a00abb00 con 0x7f66b80ca160 2023-08-25T04:15:40.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.690+0000 7f66bd883640 1 -- 172.21.15.55:0/1188947757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66b80ca160 msgr2=0x7f66b80ccb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:40.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.690+0000 7f66bd883640 1 --2- 172.21.15.55:0/1188947757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66b80ca160 0x7f66b80ccb70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f66a00097f0 tx=0x7f66a001c450 comp rx=0 tx=0).stop 2023-08-25T04:15:40.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.690+0000 7f66bd883640 1 -- 172.21.15.55:0/1188947757 shutdown_connections 2023-08-25T04:15:40.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.690+0000 7f66bd883640 1 --2- 172.21.15.55:0/1188947757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66b80ca160 0x7f66b80ccb70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:40.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.690+0000 7f66bd883640 1 -- 172.21.15.55:0/1188947757 >> 172.21.15.55:0/1188947757 conn(0x7f66b80cac50 msgr2=0x7f66b80cb060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:40.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.690+0000 7f66bd883640 1 -- 172.21.15.55:0/1188947757 shutdown_connections 2023-08-25T04:15:40.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.690+0000 7f66bd883640 1 -- 172.21.15.55:0/1188947757 wait complete. 2023-08-25T04:15:40.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.694+0000 7f66bd883640 1 Processor -- start 2023-08-25T04:15:40.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.694+0000 7f66bd883640 1 -- start start 2023-08-25T04:15:40.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bd883640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66b80ad5e0 0x7f66b81584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bd883640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66b80c18b0 0x7f66b815f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bd883640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66b80ca160 0x7f66b815f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bd883640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b8158a10 con 0x7f66b80c18b0 2023-08-25T04:15:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bd883640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b8163470 con 0x7f66b80ad5e0 2023-08-25T04:15:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bd883640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b815ffb0 con 0x7f66b80ca160 2023-08-25T04:15:40.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bc881640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66b80ad5e0 0x7f66b81584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:40.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bc881640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66b80ad5e0 0x7f66b81584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:56344/0 (socket says 172.21.15.55:56344) 2023-08-25T04:15:40.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bc881640 1 -- 172.21.15.55:0/1480450591 learned_addr learned my addr 172.21.15.55:0/1480450591 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:40.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bd082640 1 --2- 172.21.15.55:0/1480450591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66b80ca160 0x7f66b815f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:40.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66b7fff640 1 --2- 172.21.15.55:0/1480450591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66b80c18b0 0x7f66b815f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:40.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bd082640 1 -- 172.21.15.55:0/1480450591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66b80ad5e0 msgr2=0x7f66b81584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:40.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bd082640 1 --2- 172.21.15.55:0/1480450591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66b80ad5e0 0x7f66b81584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:40.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bd082640 1 -- 172.21.15.55:0/1480450591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66b80c18b0 msgr2=0x7f66b815f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:40.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bd082640 1 --2- 172.21.15.55:0/1480450591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66b80c18b0 0x7f66b815f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:40.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bd082640 1 -- 172.21.15.55:0/1480450591 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a0009420 con 0x7f66b80ca160 2023-08-25T04:15:40.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bc881640 1 --2- 172.21.15.55:0/1480450591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66b80ad5e0 0x7f66b81584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:40.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66b7fff640 1 --2- 172.21.15.55:0/1480450591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66b80c18b0 0x7f66b815f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:40.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bd082640 1 --2- 172.21.15.55:0/1480450591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66b80ca160 0x7f66b815f930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f66a00ac000 tx=0x7f66a001ac90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:40.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66b57fa640 1 -- 172.21.15.55:0/1480450591 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a00bf610 con 0x7f66b80ca160 2023-08-25T04:15:40.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66b57fa640 1 -- 172.21.15.55:0/1480450591 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a00bf770 con 0x7f66b80ca160 2023-08-25T04:15:40.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66b57fa640 1 -- 172.21.15.55:0/1480450591 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a00bfb00 con 0x7f66b80ca160 2023-08-25T04:15:40.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bd883640 1 -- 172.21.15.55:0/1480450591 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b8160290 con 0x7f66b80ca160 2023-08-25T04:15:40.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.698+0000 7f66bd883640 1 -- 172.21.15.55:0/1480450591 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b8160850 con 0x7f66b80ca160 2023-08-25T04:15:40.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.702+0000 7f66bd883640 1 -- 172.21.15.55:0/1480450591 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b8160a40 con 0x7f66b80ca160 2023-08-25T04:15:40.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.702+0000 7f66b57fa640 1 -- 172.21.15.55:0/1480450591 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7f66a00b5400 con 0x7f66b80ca160 2023-08-25T04:15:40.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.702+0000 7f66b57fa640 1 --2- 172.21.15.55:0/1480450591 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6698065950 0x7f6698067e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:40.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.702+0000 7f66b57fa640 1 -- 172.21.15.55:0/1480450591 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 8049+0+0 (secure 0 0 0) 0x7f66a011e5f0 con 0x7f66b80ca160 2023-08-25T04:15:40.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.706+0000 7f66bc881640 1 --2- 172.21.15.55:0/1480450591 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6698065950 0x7f6698067e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:40.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.706+0000 7f66bc881640 1 --2- 172.21.15.55:0/1480450591 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6698065950 0x7f6698067e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f66b0004f90 tx=0x7f66b0009040 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:40.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.710+0000 7f66b57fa640 1 -- 172.21.15.55:0/1480450591 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f66a00eb530 con 0x7f66b80ca160 2023-08-25T04:15:40.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:40.898+0000 7f66bd883640 1 -- 172.21.15.55:0/1480450591 --> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f66b8073e50 con 0x7f6698065950 2023-08-25T04:15:41.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.042+0000 7f66b57fa640 1 -- 172.21.15.55:0/1480450591 <== mgr.5009 v2:172.21.15.110:6832/3210220484 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f66b8073e50 con 0x7f6698065950 2023-08-25T04:15:41.042 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-08-25T04:15:41.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.046+0000 7f66bd883640 1 -- 172.21.15.55:0/1480450591 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6698065950 msgr2=0x7f6698067e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:41.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.046+0000 7f66bd883640 1 --2- 172.21.15.55:0/1480450591 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6698065950 0x7f6698067e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f66b0004f90 tx=0x7f66b0009040 comp rx=0 tx=0).stop 2023-08-25T04:15:41.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.046+0000 7f66bd883640 1 -- 172.21.15.55:0/1480450591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66b80ca160 msgr2=0x7f66b815f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:41.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.046+0000 7f66bd883640 1 --2- 172.21.15.55:0/1480450591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66b80ca160 0x7f66b815f930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f66a00ac000 tx=0x7f66a001ac90 comp rx=0 tx=0).stop 2023-08-25T04:15:41.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.046+0000 7f66bd883640 1 -- 172.21.15.55:0/1480450591 shutdown_connections 2023-08-25T04:15:41.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.046+0000 7f66bd883640 1 --2- 172.21.15.55:0/1480450591 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6698065950 0x7f6698067e10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.046+0000 7f66bd883640 1 --2- 172.21.15.55:0/1480450591 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66b80ca160 0x7f66b815f930 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.046+0000 7f66bd883640 1 --2- 172.21.15.55:0/1480450591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66b80c18b0 0x7f66b815f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.046+0000 7f66bd883640 1 --2- 172.21.15.55:0/1480450591 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66b80ad5e0 0x7f66b81584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.046+0000 7f66bd883640 1 -- 172.21.15.55:0/1480450591 >> 172.21.15.55:0/1480450591 conn(0x7f66b80cac50 msgr2=0x7f66b815c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:41.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.046+0000 7f66bd883640 1 -- 172.21.15.55:0/1480450591 shutdown_connections 2023-08-25T04:15:41.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.046+0000 7f66bd883640 1 -- 172.21.15.55:0/1480450591 wait complete. 2023-08-25T04:15:41.070 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-08-25T04:15:41.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:41.073 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-08-25T04:15:41.089 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:41.089 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:41.090 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:41.090 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:41.090 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:41.090 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:41.091 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:41.091 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:41.091 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:41.091 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:41.091 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:41.092 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_05_00_UTC 2023-08-25T04:15:41.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:41.093 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_05_00_UTC) 2023-08-25T04:15:41.177 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_06_00_UTC 2023-08-25T04:15:41.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:41.178 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_06_00_UTC) 2023-08-25T04:15:41.234 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_07_00_UTC 2023-08-25T04:15:41.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:41.235 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_07_00_UTC) 2023-08-25T04:15:41.294 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_08_00_UTC 2023-08-25T04:15:41.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:41.295 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_08_00_UTC) 2023-08-25T04:15:41.354 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_09_00_UTC 2023-08-25T04:15:41.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:41.355 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_09_00_UTC) 2023-08-25T04:15:41.414 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_10_00_UTC 2023-08-25T04:15:41.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:41.415 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_10_00_UTC) 2023-08-25T04:15:41.470 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_11_00_UTC 2023-08-25T04:15:41.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:41.470 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_11_00_UTC) 2023-08-25T04:15:41.525 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_12_00_UTC 2023-08-25T04:15:41.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:41.526 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_12_00_UTC) 2023-08-25T04:15:41.581 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_13_00_UTC 2023-08-25T04:15:41.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:41.582 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_13_00_UTC) 2023-08-25T04:15:41.638 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_14_00_UTC 2023-08-25T04:15:41.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:41.639 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_14_00_UTC) 2023-08-25T04:15:41.698 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_15_00_UTC 2023-08-25T04:15:41.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:41.699 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-08-25-04_15_00_UTC) 2023-08-25T04:15:41.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:41.758 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-08-25T04:15:41.810 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-25T04:15:41.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.998+0000 7fb800ed8640 1 Processor -- start 2023-08-25T04:15:41.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.998+0000 7fb800ed8640 1 -- start start 2023-08-25T04:15:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.998+0000 7fb800ed8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7fc06a010 0x7fb7fc0ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:41.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.998+0000 7fb800ed8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb7fc0ced50 0x7fb7fc15c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:41.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.998+0000 7fb800ed8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7fc06d200 con 0x7fb7fc0ae8e0 2023-08-25T04:15:41.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.998+0000 7fb800ed8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7fc06c5f0 con 0x7fb7fc0ced50 2023-08-25T04:15:41.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.998+0000 7fb800ed8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc06c8d0 con 0x7fb7fc06a010 2023-08-25T04:15:41.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.998+0000 7fb7fad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb7fc0ced50 0x7fb7fc15c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:41.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.998+0000 7fb7fa59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb7fc0ae8e0 0x7fb7fc069900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53510/0 (socket says 172.21.15.55:53510) 2023-08-25T04:15:41.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.998+0000 7fb7fa59c640 1 -- 172.21.15.55:0/995730783 learned_addr learned my addr 172.21.15.55:0/995730783 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:41.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.998+0000 7fb7f3fff640 1 --2- 172.21.15.55:0/995730783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7fc06a010 0x7fb7fc0ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:41.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.998+0000 7fb7f9d9b640 1 -- 172.21.15.55:0/995730783 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912631542 0 0) 0x7fb7fc06d200 con 0x7fb7fc0ae8e0 2023-08-25T04:15:41.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.998+0000 7fb7f9d9b640 1 -- 172.21.15.55:0/995730783 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e8003530 con 0x7fb7fc0ae8e0 2023-08-25T04:15:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.998+0000 7fb7fad9d640 1 -- 172.21.15.55:0/995730783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7fc06a010 msgr2=0x7fb7fc0ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.998+0000 7fb7fad9d640 1 --2- 172.21.15.55:0/995730783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7fc06a010 0x7fb7fc0ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.998+0000 7fb7fad9d640 1 -- 172.21.15.55:0/995730783 >> v1:172.21.15.55:6789/0 conn(0x7fb7fc0ae8e0 legacy=0x7fb7fc069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.998+0000 7fb7fad9d640 1 -- 172.21.15.55:0/995730783 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc06cbb0 con 0x7fb7fc0ced50 2023-08-25T04:15:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:41.998+0000 7fb7f3fff640 1 --2- 172.21.15.55:0/995730783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7fc06a010 0x7fb7fc0ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:42.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.002+0000 7fb7fad9d640 1 --2- 172.21.15.55:0/995730783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7fc0ced50 0x7fb7fc15c150 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009d90 tx=0x7fb7f401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18530a0c06256612 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:42.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.002+0000 7fb7f9d9b640 1 -- 172.21.15.55:0/995730783 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40a57a0 con 0x7fb7fc0ced50 2023-08-25T04:15:42.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.002+0000 7fb7f9d9b640 1 -- 172.21.15.55:0/995730783 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f40a5900 con 0x7fb7fc0ced50 2023-08-25T04:15:42.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.002+0000 7fb7f9d9b640 1 -- 172.21.15.55:0/995730783 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40a5c90 con 0x7fb7fc0ced50 2023-08-25T04:15:42.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.002+0000 7fb800ed8640 1 -- 172.21.15.55:0/995730783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7fc0ced50 msgr2=0x7fb7fc15c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:42.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.002+0000 7fb800ed8640 1 --2- 172.21.15.55:0/995730783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7fc0ced50 0x7fb7fc15c150 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009d90 tx=0x7fb7f401c920 comp rx=0 tx=0).stop 2023-08-25T04:15:42.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.002+0000 7fb800ed8640 1 -- 172.21.15.55:0/995730783 shutdown_connections 2023-08-25T04:15:42.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.002+0000 7fb800ed8640 1 --2- 172.21.15.55:0/995730783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7fc06a010 0x7fb7fc0ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:42.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.002+0000 7fb800ed8640 1 --2- 172.21.15.55:0/995730783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7fc0ced50 0x7fb7fc15c150 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:42.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.002+0000 7fb800ed8640 1 -- 172.21.15.55:0/995730783 >> 172.21.15.55:0/995730783 conn(0x7fb7fc0cf4d0 msgr2=0x7fb7fc0cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:42.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.002+0000 7fb800ed8640 1 -- 172.21.15.55:0/995730783 shutdown_connections 2023-08-25T04:15:42.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.002+0000 7fb800ed8640 1 -- 172.21.15.55:0/995730783 wait complete. 2023-08-25T04:15:42.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.002+0000 7fb800ed8640 1 Processor -- start 2023-08-25T04:15:42.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb800ed8640 1 -- start start 2023-08-25T04:15:42.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb800ed8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7fc06a010 0x7fb7fc0c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:42.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb800ed8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7fc0ae8e0 0x7fb7fc151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:42.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb800ed8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7fc0ced50 0x7fb7fc152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:42.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb800ed8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc152880 con 0x7fb7fc0ced50 2023-08-25T04:15:42.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb800ed8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc152b30 con 0x7fb7fc0ae8e0 2023-08-25T04:15:42.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb800ed8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc152e10 con 0x7fb7fc06a010 2023-08-25T04:15:42.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb7fad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7fc0ced50 0x7fb7fc152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:42.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb7fad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7fc0ced50 0x7fb7fc152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58266/0 (socket says 172.21.15.55:58266) 2023-08-25T04:15:42.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb7fad9d640 1 -- 172.21.15.55:0/1233935054 learned_addr learned my addr 172.21.15.55:0/1233935054 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:42.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb7f3fff640 1 --2- 172.21.15.55:0/1233935054 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7fc0ae8e0 0x7fb7fc151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:42.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb7fa59c640 1 --2- 172.21.15.55:0/1233935054 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7fc06a010 0x7fb7fc0c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb7fad9d640 1 -- 172.21.15.55:0/1233935054 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7fc06a010 msgr2=0x7fb7fc0c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb7fad9d640 1 --2- 172.21.15.55:0/1233935054 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7fc06a010 0x7fb7fc0c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb7fad9d640 1 -- 172.21.15.55:0/1233935054 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7fc0ae8e0 msgr2=0x7fb7fc151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb7fad9d640 1 --2- 172.21.15.55:0/1233935054 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7fc0ae8e0 0x7fb7fc151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb7fad9d640 1 -- 172.21.15.55:0/1233935054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f4009a70 con 0x7fb7fc0ced50 2023-08-25T04:15:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb7fad9d640 1 --2- 172.21.15.55:0/1233935054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7fc0ced50 0x7fb7fc152340 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40b0040 tx=0x7fb7f40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb7f2ffd640 1 -- 172.21.15.55:0/1233935054 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40ad850 con 0x7fb7fc0ced50 2023-08-25T04:15:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb7f2ffd640 1 -- 172.21.15.55:0/1233935054 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f40ad9b0 con 0x7fb7fc0ced50 2023-08-25T04:15:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb7f2ffd640 1 -- 172.21.15.55:0/1233935054 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40add80 con 0x7fb7fc0ced50 2023-08-25T04:15:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb800ed8640 1 -- 172.21.15.55:0/1233935054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7fc1530f0 con 0x7fb7fc0ced50 2023-08-25T04:15:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb800ed8640 1 -- 172.21.15.55:0/1233935054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7fc1536b0 con 0x7fb7fc0ced50 2023-08-25T04:15:42.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.006+0000 7fb800ed8640 1 -- 172.21.15.55:0/1233935054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7fc1538a0 con 0x7fb7fc0ced50 2023-08-25T04:15:42.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.010+0000 7fb7f2ffd640 1 -- 172.21.15.55:0/1233935054 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 13) v1 ==== 85150+0+0 (secure 0 0 0) 0x7fb7f40b4050 con 0x7fb7fc0ced50 2023-08-25T04:15:42.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.010+0000 7fb7f2ffd640 1 --2- 172.21.15.55:0/1233935054 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fb7dc065880 0x7fb7dc067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:42.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.010+0000 7fb7f2ffd640 1 -- 172.21.15.55:0/1233935054 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 8049+0+0 (secure 0 0 0) 0x7fb7f411e9a0 con 0x7fb7fc0ced50 2023-08-25T04:15:42.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.010+0000 7fb7fa59c640 1 --2- 172.21.15.55:0/1233935054 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fb7dc065880 0x7fb7dc067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:42.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.010+0000 7fb7fa59c640 1 --2- 172.21.15.55:0/1233935054 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fb7dc065880 0x7fb7dc067d40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0011f0 tx=0x7fb7ec007d40 comp rx=0 tx=0).ready entity=mgr.5009 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:42.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.014+0000 7fb7f2ffd640 1 -- 172.21.15.55:0/1233935054 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb7f40ebc80 con 0x7fb7fc0ced50 2023-08-25T04:15:42.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.206+0000 7fb800ed8640 1 -- 172.21.15.55:0/1233935054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fb7fc073ec0 con 0x7fb7fc0ced50 2023-08-25T04:15:42.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.614+0000 7fb7f2ffd640 1 -- 172.21.15.55:0/1233935054 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 14) v1 ==== 85133+0+0 (secure 0 0 0) 0x7fb7f40ec050 con 0x7fb7fc0ced50 2023-08-25T04:15:42.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.614+0000 7fb7f2ffd640 1 -- 172.21.15.55:0/1233935054 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v14) v1 ==== 93+0+0 (secure 0 0 0) 0x7fb7f40ef710 con 0x7fb7fc0ced50 2023-08-25T04:15:42.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.618+0000 7fb800ed8640 1 -- 172.21.15.55:0/1233935054 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fb7dc065880 msgr2=0x7fb7dc067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:42.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.618+0000 7fb800ed8640 1 --2- 172.21.15.55:0/1233935054 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fb7dc065880 0x7fb7dc067d40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0011f0 tx=0x7fb7ec007d40 comp rx=0 tx=0).stop 2023-08-25T04:15:42.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.618+0000 7fb800ed8640 1 -- 172.21.15.55:0/1233935054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7fc0ced50 msgr2=0x7fb7fc152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:42.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.618+0000 7fb800ed8640 1 --2- 172.21.15.55:0/1233935054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7fc0ced50 0x7fb7fc152340 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40b0040 tx=0x7fb7f40196c0 comp rx=0 tx=0).stop 2023-08-25T04:15:42.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.618+0000 7fb800ed8640 1 -- 172.21.15.55:0/1233935054 shutdown_connections 2023-08-25T04:15:42.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.618+0000 7fb800ed8640 1 --2- 172.21.15.55:0/1233935054 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fb7dc065880 0x7fb7dc067d40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:42.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.618+0000 7fb800ed8640 1 --2- 172.21.15.55:0/1233935054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7fc0ced50 0x7fb7fc152340 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:42.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.618+0000 7fb800ed8640 1 --2- 172.21.15.55:0/1233935054 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7fc0ae8e0 0x7fb7fc151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:42.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.618+0000 7fb800ed8640 1 --2- 172.21.15.55:0/1233935054 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7fc06a010 0x7fb7fc0c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:42.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.618+0000 7fb800ed8640 1 -- 172.21.15.55:0/1233935054 >> 172.21.15.55:0/1233935054 conn(0x7fb7fc0cf4d0 msgr2=0x7fb7fc0ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:42.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.618+0000 7fb800ed8640 1 -- 172.21.15.55:0/1233935054 shutdown_connections 2023-08-25T04:15:42.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.618+0000 7fb800ed8640 1 -- 172.21.15.55:0/1233935054 wait complete. 2023-08-25T04:15:42.637 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T04:15:42.638 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:15:42.694 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:15:42.759 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T04:15:42.760 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:15:42.760 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:15:42.769 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:15:42.770 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:15:42.788 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:42.790+0000 7f3fa61d4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:15:42.794 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:42.792+0000 7f8ea0e0c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:15:42.797 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:15:42.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.986+0000 7f3d9385f640 1 Processor -- start 2023-08-25T04:15:42.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.986+0000 7f3d9385f640 1 -- start start 2023-08-25T04:15:42.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.986+0000 7f3d9385f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d8c164410 0x7f3d8c0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:42.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.986+0000 7f3d9385f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8c0cc510 con 0x7f3d8c0c1a80 2023-08-25T04:15:42.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.986+0000 7f3d9385f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8c1647f0 con 0x7f3d8c0cddf0 2023-08-25T04:15:42.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.986+0000 7f3d9385f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8c0cc9b0 con 0x7f3d8c164410 2023-08-25T04:15:42.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.986+0000 7f3d915fb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d8c164410 0x7f3d8c0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:42.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.986+0000 7f3d91dfc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3d8c0c1a80 0x7f3d8c06bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53524/0 (socket says 172.21.15.55:53524) 2023-08-25T04:15:42.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.986+0000 7f3d91dfc640 1 -- 172.21.15.55:0/4038468626 learned_addr learned my addr 172.21.15.55:0/4038468626 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:42.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.986+0000 7f3d915fb640 1 -- 172.21.15.55:0/4038468626 >> v1:172.21.15.110:6789/0 conn(0x7f3d8c0cddf0 legacy=0x7f3d8c0c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:42.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.986+0000 7f3d915fb640 1 -- 172.21.15.55:0/4038468626 >> v1:172.21.15.55:6789/0 conn(0x7f3d8c0c1a80 legacy=0x7f3d8c06bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:42.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.986+0000 7f3d83fff640 1 -- 172.21.15.55:0/4038468626 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946651338 0 0) 0x7f3d8c0cc510 con 0x7f3d8c0c1a80 2023-08-25T04:15:42.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.986+0000 7f3d915fb640 1 -- 172.21.15.55:0/4038468626 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c0ccc90 con 0x7f3d8c164410 2023-08-25T04:15:42.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.990+0000 7f3d915fb640 1 --2- 172.21.15.55:0/4038468626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d8c164410 0x7f3d8c0b21b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3d880097c0 tx=0x7f3d8801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15d7f51dd312af3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:42.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.990+0000 7f3d83fff640 1 -- 172.21.15.55:0/4038468626 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d880ab600 con 0x7f3d8c164410 2023-08-25T04:15:42.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.990+0000 7f3d83fff640 1 -- 172.21.15.55:0/4038468626 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d880a7050 con 0x7f3d8c164410 2023-08-25T04:15:42.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.990+0000 7f3d83fff640 1 -- 172.21.15.55:0/4038468626 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d880ab980 con 0x7f3d8c164410 2023-08-25T04:15:42.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.990+0000 7f3d9385f640 1 -- 172.21.15.55:0/4038468626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d8c164410 msgr2=0x7f3d8c0b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:42.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.990+0000 7f3d9385f640 1 --2- 172.21.15.55:0/4038468626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d8c164410 0x7f3d8c0b21b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3d880097c0 tx=0x7f3d8801c480 comp rx=0 tx=0).stop 2023-08-25T04:15:42.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.990+0000 7f3d9385f640 1 -- 172.21.15.55:0/4038468626 shutdown_connections 2023-08-25T04:15:42.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.990+0000 7f3d9385f640 1 --2- 172.21.15.55:0/4038468626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d8c164410 0x7f3d8c0b21b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:42.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.990+0000 7f3d9385f640 1 -- 172.21.15.55:0/4038468626 >> 172.21.15.55:0/4038468626 conn(0x7f3d8c069d00 msgr2=0x7f3d8c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:42.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.990+0000 7f3d9385f640 1 -- 172.21.15.55:0/4038468626 shutdown_connections 2023-08-25T04:15:42.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.990+0000 7f3d9385f640 1 -- 172.21.15.55:0/4038468626 wait complete. 2023-08-25T04:15:42.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d9385f640 1 Processor -- start 2023-08-25T04:15:42.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d9385f640 1 -- start start 2023-08-25T04:15:42.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d9385f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d8c0c1a80 0x7f3d8c157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:42.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d9385f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d8c0cddf0 0x7f3d8c0c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:42.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d9385f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d8c164410 0x7f3d8c15bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:42.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d9385f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0c61b0 con 0x7f3d8c164410 2023-08-25T04:15:42.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d9385f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0c6640 con 0x7f3d8c0cddf0 2023-08-25T04:15:42.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d9385f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8c0c55a0 con 0x7f3d8c0c1a80 2023-08-25T04:15:42.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d91dfc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d8c164410 0x7f3d8c15bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:42.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d91dfc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d8c164410 0x7f3d8c15bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58296/0 (socket says 172.21.15.55:58296) 2023-08-25T04:15:42.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d90dfa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d8c0cddf0 0x7f3d8c0c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:42.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d91dfc640 1 -- 172.21.15.55:0/4271738641 learned_addr learned my addr 172.21.15.55:0/4271738641 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:42.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d915fb640 1 --2- 172.21.15.55:0/4271738641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d8c0c1a80 0x7f3d8c157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:42.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d91dfc640 1 -- 172.21.15.55:0/4271738641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d8c0c1a80 msgr2=0x7f3d8c157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:42.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d91dfc640 1 --2- 172.21.15.55:0/4271738641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d8c0c1a80 0x7f3d8c157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:42.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d91dfc640 1 -- 172.21.15.55:0/4271738641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d8c0cddf0 msgr2=0x7f3d8c0c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:42.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d91dfc640 1 --2- 172.21.15.55:0/4271738641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d8c0cddf0 0x7f3d8c0c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d91dfc640 1 -- 172.21.15.55:0/4271738641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d88009420 con 0x7f3d8c164410 2023-08-25T04:15:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d90dfa640 1 --2- 172.21.15.55:0/4271738641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d8c0cddf0 0x7f3d8c0c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:15:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d915fb640 1 --2- 172.21.15.55:0/4271738641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d8c0c1a80 0x7f3d8c157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:15:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d91dfc640 1 --2- 172.21.15.55:0/4271738641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d8c164410 0x7f3d8c15bbb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3d84002240 tx=0x7f3d8400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d81ffb640 1 -- 172.21.15.55:0/4271738641 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400cea0 con 0x7f3d8c164410 2023-08-25T04:15:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d81ffb640 1 -- 172.21.15.55:0/4271738641 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8400a640 con 0x7f3d8c164410 2023-08-25T04:15:42.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d9385f640 1 -- 172.21.15.55:0/4271738641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8c0c5880 con 0x7f3d8c164410 2023-08-25T04:15:42.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d81ffb640 1 -- 172.21.15.55:0/4271738641 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400a9f0 con 0x7f3d8c164410 2023-08-25T04:15:42.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.994+0000 7f3d9385f640 1 -- 172.21.15.55:0/4271738641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8c0c5e40 con 0x7f3d8c164410 2023-08-25T04:15:42.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.998+0000 7f3d9385f640 1 -- 172.21.15.55:0/4271738641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8c0c6320 con 0x7f3d8c164410 2023-08-25T04:15:42.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.998+0000 7f3d81ffb640 1 -- 172.21.15.55:0/4271738641 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 85133+0+0 (secure 0 0 0) 0x7f3d8400ab50 con 0x7f3d8c164410 2023-08-25T04:15:42.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.998+0000 7f3d81ffb640 1 --2- 172.21.15.55:0/4271738641 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f3d70065830 0x7f3d70067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:42.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.998+0000 7f3d81ffb640 1 -- 172.21.15.55:0/4271738641 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 8049+0+0 (secure 0 0 0) 0x7f3d84082d10 con 0x7f3d8c164410 2023-08-25T04:15:42.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.998+0000 7f3d915fb640 1 -- 172.21.15.55:0/4271738641 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f3d70065830 msgr2=0x7f3d70067cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3210220484 2023-08-25T04:15:42.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:42.998+0000 7f3d915fb640 1 --2- 172.21.15.55:0/4271738641 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f3d70065830 0x7f3d70067cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:15:43.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.002+0000 7f3d81ffb640 1 -- 172.21.15.55:0/4271738641 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3d8404fef0 con 0x7f3d8c164410 2023-08-25T04:15:43.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.162+0000 7f3d9385f640 1 -- 172.21.15.55:0/4271738641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d8c04dbe0 con 0x7f3d8c164410 2023-08-25T04:15:43.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.166+0000 7f3d81ffb640 1 -- 172.21.15.55:0/4271738641 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+21379 (secure 0 0 0) 0x7f3d84018020 con 0x7f3d8c164410 2023-08-25T04:15:43.166 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:43.166 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":48,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:15:40.551166+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:03:56.779789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:57.764926+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":209,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.26","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6833/413962747":"2023-08-26T04:04:16.252224+0000","172.21.15.110:6832/413962747":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/2576650460":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/3898418887":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/2105887625":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/3810476394":"2023-08-26T04:04:16.252224+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1},{"begin":6,"length":1},{"begin":8,"length":1},{"begin":13,"length":1},{"begin":15,"length":1},{"begin":17,"length":1},{"begin":19,"length":1},{"begin":24,"length":1},{"begin":26,"length":1},{"begin":28,"length":1},{"begin":30,"length":1},{"begin":35,"length":1},{"begin":37,"length":1},{"begin":39,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":47,"length":1},{"begin":49,"length":1},{"begin":51,"length":2},{"begin":56,"length":1},{"begin":58,"length":1},{"begin":60,"length":1},{"begin":62,"length":1},{"begin":66,"length":1},{"begin":68,"length":1},{"begin":70,"length":1},{"begin":73,"length":1},{"begin":77,"length":1},{"begin":79,"length":1},{"begin":81,"length":2},{"begin":84,"length":1},{"begin":88,"length":1},{"begin":90,"length":1},{"begin":93,"length":1},{"begin":95,"length":1},{"begin":99,"length":1},{"begin":101,"length":1},{"begin":105,"length":1},{"begin":109,"length":1},{"begin":111,"length":1},{"begin":167,"length":43}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":6,"length":1},{"begin":13,"length":1},{"begin":17,"length":1},{"begin":24,"length":1},{"begin":28,"length":1},{"begin":35,"length":1},{"begin":39,"length":1},{"begin":45,"length":1},{"begin":49,"length":1},{"begin":56,"length":1},{"begin":60,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":77,"length":1},{"begin":81,"length":2},{"begin":88,"length":1},{"begin":93,"length":1},{"begin":99,"length":1},{"begin":109,"length":1},{"begin":189,"length":21}]}],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":5,"length":1},{"begin":7,"length":1},{"begin":9,"length":1},{"begin":11,"length":2},{"begin":16,"length":1},{"begin":18,"length":1},{"begin":20,"length":1},{"begin":23,"length":1},{"begin":27,"length":1},{"begin":29,"length":1},{"begin":31,"length":2},{"begin":34,"length":1},{"begin":38,"length":1},{"begin":40,"length":1},{"begin":42,"length":1},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":50,"length":1},{"begin":53,"length":1},{"begin":55,"length":1},{"begin":59,"length":1},{"begin":61,"length":1},{"begin":63,"length":1},{"begin":65,"length":1},{"begin":69,"length":1},{"begin":71,"length":2},{"begin":74,"length":1},{"begin":76,"length":1},{"begin":80,"length":1},{"begin":83,"length":1},{"begin":85,"length":1},{"begin":87,"length":1},{"begin":91,"length":2},{"begin":94,"length":1},{"begin":96,"length":1},{"begin":98,"length":1},{"begin":102,"length":1},{"begin":104,"length":1},{"begin":106,"length":1},{"begin":108,"length":1},{"begin":123,"length":44}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:15:43.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.166+0000 7f3d9385f640 1 -- 172.21.15.55:0/4271738641 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f3d70065830 msgr2=0x7f3d70067cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:15:43.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.166+0000 7f3d9385f640 1 --2- 172.21.15.55:0/4271738641 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f3d70065830 0x7f3d70067cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.166+0000 7f3d9385f640 1 -- 172.21.15.55:0/4271738641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d8c164410 msgr2=0x7f3d8c15bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:43.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.166+0000 7f3d9385f640 1 --2- 172.21.15.55:0/4271738641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d8c164410 0x7f3d8c15bbb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3d84002240 tx=0x7f3d8400cc50 comp rx=0 tx=0).stop 2023-08-25T04:15:43.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.166+0000 7f3d9385f640 1 -- 172.21.15.55:0/4271738641 shutdown_connections 2023-08-25T04:15:43.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.166+0000 7f3d9385f640 1 --2- 172.21.15.55:0/4271738641 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f3d70065830 0x7f3d70067cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.166+0000 7f3d9385f640 1 --2- 172.21.15.55:0/4271738641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d8c164410 0x7f3d8c15bbb0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.166+0000 7f3d9385f640 1 --2- 172.21.15.55:0/4271738641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d8c0cddf0 0x7f3d8c0c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.166+0000 7f3d9385f640 1 --2- 172.21.15.55:0/4271738641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d8c0c1a80 0x7f3d8c157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.166+0000 7f3d9385f640 1 -- 172.21.15.55:0/4271738641 >> 172.21.15.55:0/4271738641 conn(0x7f3d8c069d00 msgr2=0x7f3d8c0b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:43.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.166+0000 7f3d9385f640 1 -- 172.21.15.55:0/4271738641 shutdown_connections 2023-08-25T04:15:43.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.166+0000 7f3d9385f640 1 -- 172.21.15.55:0/4271738641 wait complete. 2023-08-25T04:15:43.185 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:03:56.779789+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:03:57.764926+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 209, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:15:43.187 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:15:43.208 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:43.204+0000 7f8ea0e0c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:15:43.237 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:43.238+0000 7f3fa61d4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:15:43.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.342+0000 7f7937940640 1 Processor -- start 2023-08-25T04:15:43.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.342+0000 7f7937940640 1 -- start start 2023-08-25T04:15:43.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.342+0000 7f7937940640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f79301601f0 0x7f793015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:43.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.342+0000 7f7937940640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79300cd5a0 con 0x7f793015e3c0 2023-08-25T04:15:43.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.342+0000 7f7937940640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79300cd880 con 0x7f79300d1290 2023-08-25T04:15:43.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.342+0000 7f7937940640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79300cdb60 con 0x7f79301601f0 2023-08-25T04:15:43.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.346+0000 7f7934edb640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f793015e3c0 0x7f79300d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53528/0 (socket says 172.21.15.55:53528) 2023-08-25T04:15:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.346+0000 7f7934edb640 1 -- 172.21.15.55:0/3012337072 learned_addr learned my addr 172.21.15.55:0/3012337072 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.346+0000 7f79356dc640 1 --2- 172.21.15.55:0/3012337072 >> v2:172.21.15.110:3300/0 conn(0x7f79301601f0 0x7f793015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.346+0000 7f7927fff640 1 -- 172.21.15.55:0/3012337072 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3923770674 0 0) 0x7f79300cd5a0 con 0x7f793015e3c0 2023-08-25T04:15:43.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.346+0000 7f7927fff640 1 -- 172.21.15.55:0/3012337072 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f791c003530 con 0x7f793015e3c0 2023-08-25T04:15:43.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.346+0000 7f79356dc640 1 -- 172.21.15.55:0/3012337072 >> v1:172.21.15.110:6789/0 conn(0x7f79300d1290 legacy=0x7f793015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:43.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.346+0000 7f79356dc640 1 -- 172.21.15.55:0/3012337072 >> v1:172.21.15.55:6789/0 conn(0x7f793015e3c0 legacy=0x7f79300d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:43.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.346+0000 7f79356dc640 1 -- 172.21.15.55:0/3012337072 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79300cde40 con 0x7f79301601f0 2023-08-25T04:15:43.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.346+0000 7f79356dc640 1 --2- 172.21.15.55:0/3012337072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79301601f0 0x7f793015d430 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f792c0097a0 tx=0x7f792c01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e950e93f58c26aab server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:43.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.346+0000 7f7927fff640 1 -- 172.21.15.55:0/3012337072 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c004230 con 0x7f79301601f0 2023-08-25T04:15:43.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.346+0000 7f7927fff640 1 -- 172.21.15.55:0/3012337072 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c0a7050 con 0x7f79301601f0 2023-08-25T04:15:43.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.350+0000 7f7927fff640 1 -- 172.21.15.55:0/3012337072 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c003620 con 0x7f79301601f0 2023-08-25T04:15:43.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.350+0000 7f7937940640 1 -- 172.21.15.55:0/3012337072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79301601f0 msgr2=0x7f793015d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:43.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.350+0000 7f7937940640 1 --2- 172.21.15.55:0/3012337072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79301601f0 0x7f793015d430 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f792c0097a0 tx=0x7f792c01c430 comp rx=0 tx=0).stop 2023-08-25T04:15:43.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.350+0000 7f7937940640 1 -- 172.21.15.55:0/3012337072 shutdown_connections 2023-08-25T04:15:43.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.350+0000 7f7937940640 1 --2- 172.21.15.55:0/3012337072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79301601f0 0x7f793015d430 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.350+0000 7f7937940640 1 -- 172.21.15.55:0/3012337072 >> 172.21.15.55:0/3012337072 conn(0x7f79300d27d0 msgr2=0x7f79300d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:43.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.350+0000 7f7937940640 1 -- 172.21.15.55:0/3012337072 shutdown_connections 2023-08-25T04:15:43.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.350+0000 7f7937940640 1 -- 172.21.15.55:0/3012337072 wait complete. 2023-08-25T04:15:43.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.350+0000 7f7937940640 1 Processor -- start 2023-08-25T04:15:43.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.350+0000 7f7937940640 1 -- start start 2023-08-25T04:15:43.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.350+0000 7f7937940640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79300d1290 0x7f7930154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:43.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.350+0000 7f7937940640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f793015e3c0 0x7f79300cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:43.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.350+0000 7f7937940640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79301601f0 0x7f79301576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:43.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.350+0000 7f7937940640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79300c7180 con 0x7f79301601f0 2023-08-25T04:15:43.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.350+0000 7f7937940640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79300c7460 con 0x7f79300d1290 2023-08-25T04:15:43.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.350+0000 7f7937940640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79300c7740 con 0x7f793015e3c0 2023-08-25T04:15:43.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.350+0000 7f7935edd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79301601f0 0x7f79301576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:43.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.354+0000 7f7935edd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79301601f0 0x7f79301576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58298/0 (socket says 172.21.15.55:58298) 2023-08-25T04:15:43.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.354+0000 7f7935edd640 1 -- 172.21.15.55:0/1201228809 learned_addr learned my addr 172.21.15.55:0/1201228809 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:43.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.354+0000 7f79356dc640 1 --2- 172.21.15.55:0/1201228809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79300d1290 0x7f7930154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:43.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.354+0000 7f7934edb640 1 --2- 172.21.15.55:0/1201228809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f793015e3c0 0x7f79300cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:43.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.354+0000 7f7935edd640 1 -- 172.21.15.55:0/1201228809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f793015e3c0 msgr2=0x7f79300cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:43.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.354+0000 7f7935edd640 1 --2- 172.21.15.55:0/1201228809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f793015e3c0 0x7f79300cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.354+0000 7f7935edd640 1 -- 172.21.15.55:0/1201228809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79300d1290 msgr2=0x7f7930154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:43.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.354+0000 7f7935edd640 1 --2- 172.21.15.55:0/1201228809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79300d1290 0x7f7930154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.354+0000 7f7935edd640 1 -- 172.21.15.55:0/1201228809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c0093b0 con 0x7f79301601f0 2023-08-25T04:15:43.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.354+0000 7f7935edd640 1 --2- 172.21.15.55:0/1201228809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79301601f0 0x7f79301576c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f792800c770 tx=0x7f792800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:43.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.354+0000 7f7925ffb640 1 -- 172.21.15.55:0/1201228809 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7928003b80 con 0x7f79301601f0 2023-08-25T04:15:43.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.354+0000 7f7925ffb640 1 -- 172.21.15.55:0/1201228809 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7928003ce0 con 0x7f79301601f0 2023-08-25T04:15:43.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.354+0000 7f7925ffb640 1 -- 172.21.15.55:0/1201228809 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792800aa90 con 0x7f79301601f0 2023-08-25T04:15:43.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.354+0000 7f7937940640 1 -- 172.21.15.55:0/1201228809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79300c7a20 con 0x7f79301601f0 2023-08-25T04:15:43.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.354+0000 7f7937940640 1 -- 172.21.15.55:0/1201228809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7930154f70 con 0x7f79301601f0 2023-08-25T04:15:43.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.354+0000 7f7937940640 1 -- 172.21.15.55:0/1201228809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79300b5260 con 0x7f79301601f0 2023-08-25T04:15:43.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.358+0000 7f7925ffb640 1 -- 172.21.15.55:0/1201228809 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 85133+0+0 (secure 0 0 0) 0x7f792800abf0 con 0x7f79301601f0 2023-08-25T04:15:43.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.358+0000 7f7925ffb640 1 --2- 172.21.15.55:0/1201228809 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f7914065830 0x7f7914067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:43.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.358+0000 7f7925ffb640 1 -- 172.21.15.55:0/1201228809 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 8049+0+0 (secure 0 0 0) 0x7f7928083550 con 0x7f79301601f0 2023-08-25T04:15:43.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.358+0000 7f79356dc640 1 -- 172.21.15.55:0/1201228809 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f7914065830 msgr2=0x7f7914067cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3210220484 2023-08-25T04:15:43.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.358+0000 7f79356dc640 1 --2- 172.21.15.55:0/1201228809 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f7914065830 0x7f7914067cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:15:43.361 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:43.360+0000 7f8ea0e0c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:15:43.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.366+0000 7f7925ffb640 1 -- 172.21.15.55:0/1201228809 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7928050700 con 0x7f79301601f0 2023-08-25T04:15:43.402 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:43.402+0000 7f3fa61d4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:15:43.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.530+0000 7f7937940640 1 -- 172.21.15.55:0/1201228809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7930073ec0 con 0x7f79301601f0 2023-08-25T04:15:43.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.530+0000 7f7925ffb640 1 -- 172.21.15.55:0/1201228809 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7928053d20 con 0x7f79301601f0 2023-08-25T04:15:43.531 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:15:43.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.534+0000 7f7937940640 1 -- 172.21.15.55:0/1201228809 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f7914065830 msgr2=0x7f7914067cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:15:43.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.534+0000 7f7937940640 1 --2- 172.21.15.55:0/1201228809 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f7914065830 0x7f7914067cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.534+0000 7f7937940640 1 -- 172.21.15.55:0/1201228809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79301601f0 msgr2=0x7f79301576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:43.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.534+0000 7f7937940640 1 --2- 172.21.15.55:0/1201228809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79301601f0 0x7f79301576c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f792800c770 tx=0x7f792800cc30 comp rx=0 tx=0).stop 2023-08-25T04:15:43.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.534+0000 7f7937940640 1 -- 172.21.15.55:0/1201228809 shutdown_connections 2023-08-25T04:15:43.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.534+0000 7f7937940640 1 --2- 172.21.15.55:0/1201228809 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f7914065830 0x7f7914067cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.534+0000 7f7937940640 1 --2- 172.21.15.55:0/1201228809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79301601f0 0x7f79301576c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.534+0000 7f7937940640 1 --2- 172.21.15.55:0/1201228809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f793015e3c0 0x7f79300cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.534+0000 7f7937940640 1 --2- 172.21.15.55:0/1201228809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79300d1290 0x7f7930154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.534+0000 7f7937940640 1 -- 172.21.15.55:0/1201228809 >> 172.21.15.55:0/1201228809 conn(0x7f79300d27d0 msgr2=0x7f793006bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:43.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.534+0000 7f7937940640 1 -- 172.21.15.55:0/1201228809 shutdown_connections 2023-08-25T04:15:43.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.534+0000 7f7937940640 1 -- 172.21.15.55:0/1201228809 wait complete. 2023-08-25T04:15:43.553 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:15:43.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.706+0000 7f9808bdf640 1 Processor -- start 2023-08-25T04:15:43.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.706+0000 7f9808bdf640 1 -- start start 2023-08-25T04:15:43.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.706+0000 7f9808bdf640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98041601f0 0x7f980415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:43.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.706+0000 7f9808bdf640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98040cd5a0 con 0x7f98040d1290 2023-08-25T04:15:43.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.706+0000 7f9808bdf640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98040cd880 con 0x7f980415e3c0 2023-08-25T04:15:43.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.706+0000 7f9808bdf640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98040cdb60 con 0x7f98041601f0 2023-08-25T04:15:43.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.706+0000 7f9802d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f98040d1290 0x7f980415e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53544/0 (socket says 172.21.15.55:53544) 2023-08-25T04:15:43.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.706+0000 7f9802d9d640 1 -- 172.21.15.55:0/3255990630 learned_addr learned my addr 172.21.15.55:0/3255990630 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:43.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.706+0000 7f980259c640 1 --2- 172.21.15.55:0/3255990630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98041601f0 0x7f980415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:43.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.706+0000 7f9801d9b640 1 -- 172.21.15.55:0/3255990630 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227314756 0 0) 0x7f98040cd880 con 0x7f980415e3c0 2023-08-25T04:15:43.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.706+0000 7f9801d9b640 1 -- 172.21.15.55:0/3255990630 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97f0003530 con 0x7f980415e3c0 2023-08-25T04:15:43.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.706+0000 7f9801d9b640 1 -- 172.21.15.55:0/3255990630 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1151597665 0 0) 0x7f98040cd5a0 con 0x7f98040d1290 2023-08-25T04:15:43.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.706+0000 7f980259c640 1 -- 172.21.15.55:0/3255990630 >> v1:172.21.15.110:6789/0 conn(0x7f980415e3c0 legacy=0x7f98040d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:43.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.706+0000 7f980259c640 1 -- 172.21.15.55:0/3255990630 >> v1:172.21.15.55:6789/0 conn(0x7f98040d1290 legacy=0x7f980415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:43.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.706+0000 7f980259c640 1 -- 172.21.15.55:0/3255990630 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98040cde40 con 0x7f98041601f0 2023-08-25T04:15:43.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.710+0000 7f980259c640 1 --2- 172.21.15.55:0/3255990630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98041601f0 0x7f980415d430 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f97f40097d0 tx=0x7f97f401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80e742ac19f9997c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:43.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.710+0000 7f9801d9b640 1 -- 172.21.15.55:0/3255990630 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f40a8990 con 0x7f98041601f0 2023-08-25T04:15:43.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.710+0000 7f9801d9b640 1 -- 172.21.15.55:0/3255990630 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f40a8af0 con 0x7f98041601f0 2023-08-25T04:15:43.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.710+0000 7f9801d9b640 1 -- 172.21.15.55:0/3255990630 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f40a8e80 con 0x7f98041601f0 2023-08-25T04:15:43.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.710+0000 7f9808bdf640 1 -- 172.21.15.55:0/3255990630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98041601f0 msgr2=0x7f980415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:43.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.710+0000 7f9808bdf640 1 --2- 172.21.15.55:0/3255990630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98041601f0 0x7f980415d430 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f97f40097d0 tx=0x7f97f401ec90 comp rx=0 tx=0).stop 2023-08-25T04:15:43.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.710+0000 7f9808bdf640 1 -- 172.21.15.55:0/3255990630 shutdown_connections 2023-08-25T04:15:43.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.710+0000 7f9808bdf640 1 --2- 172.21.15.55:0/3255990630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98041601f0 0x7f980415d430 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.710+0000 7f9808bdf640 1 -- 172.21.15.55:0/3255990630 >> 172.21.15.55:0/3255990630 conn(0x7f98040d27d0 msgr2=0x7f98040d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:43.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.710+0000 7f9808bdf640 1 -- 172.21.15.55:0/3255990630 shutdown_connections 2023-08-25T04:15:43.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.710+0000 7f9808bdf640 1 -- 172.21.15.55:0/3255990630 wait complete. 2023-08-25T04:15:43.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f9808bdf640 1 Processor -- start 2023-08-25T04:15:43.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f9808bdf640 1 -- start start 2023-08-25T04:15:43.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f9808bdf640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98040d1290 0x7f980414b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:43.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f9808bdf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f980415e3c0 0x7f980414def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:43.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f9808bdf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98041601f0 0x7f980414e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:43.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f9808bdf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980415b2d0 con 0x7f980415e3c0 2023-08-25T04:15:43.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f9808bdf640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980414ed70 con 0x7f98041601f0 2023-08-25T04:15:43.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f9808bdf640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980414ca70 con 0x7f98040d1290 2023-08-25T04:15:43.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f97f9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f980415e3c0 0x7f980414def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:43.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f97f9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f980415e3c0 0x7f980414def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58300/0 (socket says 172.21.15.55:58300) 2023-08-25T04:15:43.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f97f9d9b640 1 -- 172.21.15.55:0/3149681444 learned_addr learned my addr 172.21.15.55:0/3149681444 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:43.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f980259c640 1 --2- 172.21.15.55:0/3149681444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98040d1290 0x7f980414b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:43.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f9802d9d640 1 --2- 172.21.15.55:0/3149681444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98041601f0 0x7f980414e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:43.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f97f9d9b640 1 -- 172.21.15.55:0/3149681444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98040d1290 msgr2=0x7f980414b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:43.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f97f9d9b640 1 --2- 172.21.15.55:0/3149681444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98040d1290 0x7f980414b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f97f9d9b640 1 -- 172.21.15.55:0/3149681444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98041601f0 msgr2=0x7f980414e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:43.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f97f9d9b640 1 --2- 172.21.15.55:0/3149681444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98041601f0 0x7f980414e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f97f9d9b640 1 -- 172.21.15.55:0/3149681444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f40093b0 con 0x7f980415e3c0 2023-08-25T04:15:43.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f97f9d9b640 1 --2- 172.21.15.55:0/3149681444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f980415e3c0 0x7f980414def0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00c450 tx=0x7f97ec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:43.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f97fb7fe640 1 -- 172.21.15.55:0/3149681444 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec0052d0 con 0x7f980415e3c0 2023-08-25T04:15:43.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f97fb7fe640 1 -- 172.21.15.55:0/3149681444 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ec005430 con 0x7f980415e3c0 2023-08-25T04:15:43.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f97fb7fe640 1 -- 172.21.15.55:0/3149681444 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec012870 con 0x7f980415e3c0 2023-08-25T04:15:43.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f9808bdf640 1 -- 172.21.15.55:0/3149681444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98040ce7c0 con 0x7f980415e3c0 2023-08-25T04:15:43.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.714+0000 7f9808bdf640 1 -- 172.21.15.55:0/3149681444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980414d030 con 0x7f980415e3c0 2023-08-25T04:15:43.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.718+0000 7f9808bdf640 1 -- 172.21.15.55:0/3149681444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98040b5260 con 0x7f980415e3c0 2023-08-25T04:15:43.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.718+0000 7f97fb7fe640 1 -- 172.21.15.55:0/3149681444 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 85133+0+0 (secure 0 0 0) 0x7f97ec0129d0 con 0x7f980415e3c0 2023-08-25T04:15:43.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.718+0000 7f97fb7fe640 1 --2- 172.21.15.55:0/3149681444 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f97e4065830 0x7f97e4067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:43.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.718+0000 7f97fb7fe640 1 -- 172.21.15.55:0/3149681444 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 8049+0+0 (secure 0 0 0) 0x7f97ec083340 con 0x7f980415e3c0 2023-08-25T04:15:43.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.718+0000 7f980259c640 1 -- 172.21.15.55:0/3149681444 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f97e4065830 msgr2=0x7f97e4067cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3210220484 2023-08-25T04:15:43.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.718+0000 7f980259c640 1 --2- 172.21.15.55:0/3149681444 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f97e4065830 0x7f97e4067cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:15:43.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.726+0000 7f97fb7fe640 1 -- 172.21.15.55:0/3149681444 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f97ec050440 con 0x7f980415e3c0 2023-08-25T04:15:43.850 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:43.848+0000 7f8ea0e0c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:15:43.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.886+0000 7f9808bdf640 1 -- 172.21.15.55:0/3149681444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9804073ec0 con 0x7f980415e3c0 2023-08-25T04:15:43.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.886+0000 7f97fb7fe640 1 -- 172.21.15.55:0/3149681444 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v48) v1 ==== 92+0+10 (secure 0 0 0) 0x7f97ec053a60 con 0x7f980415e3c0 2023-08-25T04:15:43.884 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:15:43.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.886+0000 7f9808bdf640 1 -- 172.21.15.55:0/3149681444 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f97e4065830 msgr2=0x7f97e4067cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:15:43.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.886+0000 7f9808bdf640 1 --2- 172.21.15.55:0/3149681444 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f97e4065830 0x7f97e4067cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.886+0000 7f9808bdf640 1 -- 172.21.15.55:0/3149681444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f980415e3c0 msgr2=0x7f980414def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:43.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.886+0000 7f9808bdf640 1 --2- 172.21.15.55:0/3149681444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f980415e3c0 0x7f980414def0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f97ec00c450 tx=0x7f97ec00c910 comp rx=0 tx=0).stop 2023-08-25T04:15:43.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.886+0000 7f9808bdf640 1 -- 172.21.15.55:0/3149681444 shutdown_connections 2023-08-25T04:15:43.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.886+0000 7f9808bdf640 1 --2- 172.21.15.55:0/3149681444 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f97e4065830 0x7f97e4067cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.886+0000 7f9808bdf640 1 --2- 172.21.15.55:0/3149681444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98041601f0 0x7f980414e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.886+0000 7f9808bdf640 1 --2- 172.21.15.55:0/3149681444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f980415e3c0 0x7f980414def0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.886+0000 7f9808bdf640 1 --2- 172.21.15.55:0/3149681444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98040d1290 0x7f980414b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:43.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.886+0000 7f9808bdf640 1 -- 172.21.15.55:0/3149681444 >> 172.21.15.55:0/3149681444 conn(0x7f98040d27d0 msgr2=0x7f980406c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:43.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.886+0000 7f9808bdf640 1 -- 172.21.15.55:0/3149681444 shutdown_connections 2023-08-25T04:15:43.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:43.886+0000 7f9808bdf640 1 -- 172.21.15.55:0/3149681444 wait complete. 2023-08-25T04:15:43.906 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:15:43.909 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:43.908+0000 7f8ea0e0c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:15:43.930 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:43.930+0000 7f3fa61d4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:15:43.965 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:43.964+0000 7f8ea0e0c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:15:43.993 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:43.994+0000 7f3fa61d4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:15:44.050 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:44.048+0000 7f8ea0e0c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:15:44.053 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:44.054+0000 7f3fa61d4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:15:44.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.054+0000 7f86785db640 1 Processor -- start 2023-08-25T04:15:44.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.054+0000 7f86785db640 1 -- start start 2023-08-25T04:15:44.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.058+0000 7f86785db640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86701601f0 0x7f867015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:44.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.058+0000 7f86785db640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86700d1290 0x7f867015e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:44.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.058+0000 7f86785db640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86700cd5a0 con 0x7f867015e3c0 2023-08-25T04:15:44.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.058+0000 7f86785db640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86700cd880 con 0x7f86700d1290 2023-08-25T04:15:44.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.058+0000 7f86785db640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86700cdb60 con 0x7f86701601f0 2023-08-25T04:15:44.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.058+0000 7f8676b78640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86700d1290 0x7f867015e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:44.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.058+0000 7f8676b78640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86700d1290 0x7f867015e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58302/0 (socket says 172.21.15.55:58302) 2023-08-25T04:15:44.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.058+0000 7f8676b78640 1 -- 172.21.15.55:0/1341662545 learned_addr learned my addr 172.21.15.55:0/1341662545 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:44.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.058+0000 7f8676377640 1 --2- 172.21.15.55:0/1341662545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86701601f0 0x7f867015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:44.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.058+0000 7f8676b78640 1 -- 172.21.15.55:0/1341662545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86701601f0 msgr2=0x7f867015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:44.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.058+0000 7f8676b78640 1 --2- 172.21.15.55:0/1341662545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86701601f0 0x7f867015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.058+0000 7f8676b78640 1 -- 172.21.15.55:0/1341662545 >> v1:172.21.15.55:6789/0 conn(0x7f867015e3c0 legacy=0x7f86700d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:44.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.058+0000 7f8676b78640 1 -- 172.21.15.55:0/1341662545 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86700cde40 con 0x7f86700d1290 2023-08-25T04:15:44.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.058+0000 7f8675375640 1 -- 172.21.15.55:0/1341662545 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073395766 0 0) 0x7f86700cd5a0 con 0x7f867015e3c0 2023-08-25T04:15:44.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.062+0000 7f8676b78640 1 --2- 172.21.15.55:0/1341662545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86700d1290 0x7f867015e8a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8668009e50 tx=0x7f866801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce0155a63b6de4d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:44.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.062+0000 7f8675375640 1 -- 172.21.15.55:0/1341662545 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86680af400 con 0x7f86700d1290 2023-08-25T04:15:44.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.062+0000 7f8675375640 1 -- 172.21.15.55:0/1341662545 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86680ab050 con 0x7f86700d1290 2023-08-25T04:15:44.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.062+0000 7f8675375640 1 -- 172.21.15.55:0/1341662545 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86680af780 con 0x7f86700d1290 2023-08-25T04:15:44.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.062+0000 7f86785db640 1 -- 172.21.15.55:0/1341662545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86700d1290 msgr2=0x7f867015e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:44.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.062+0000 7f86785db640 1 --2- 172.21.15.55:0/1341662545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86700d1290 0x7f867015e8a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8668009e50 tx=0x7f866801f1f0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.062+0000 7f86785db640 1 -- 172.21.15.55:0/1341662545 shutdown_connections 2023-08-25T04:15:44.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.062+0000 7f86785db640 1 --2- 172.21.15.55:0/1341662545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86700d1290 0x7f867015e8a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.062+0000 7f86785db640 1 --2- 172.21.15.55:0/1341662545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86701601f0 0x7f867015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.062+0000 7f86785db640 1 -- 172.21.15.55:0/1341662545 >> 172.21.15.55:0/1341662545 conn(0x7f86700d27d0 msgr2=0x7f86700d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:44.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.062+0000 7f86785db640 1 -- 172.21.15.55:0/1341662545 shutdown_connections 2023-08-25T04:15:44.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.062+0000 7f86785db640 1 -- 172.21.15.55:0/1341662545 wait complete. 2023-08-25T04:15:44.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.062+0000 7f86785db640 1 Processor -- start 2023-08-25T04:15:44.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.062+0000 7f86785db640 1 -- start start 2023-08-25T04:15:44.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f86785db640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86700d1290 0x7f86700ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:44.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f86785db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f867015e3c0 0x7f86700cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:44.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f86785db640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86701601f0 0x7f867006b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:44.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f86785db640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867014b760 con 0x7f867015e3c0 2023-08-25T04:15:44.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f86785db640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867014ba20 con 0x7f86700d1290 2023-08-25T04:15:44.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f86785db640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867014bd00 con 0x7f86701601f0 2023-08-25T04:15:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f8675b76640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f867015e3c0 0x7f86700cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f8675b76640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f867015e3c0 0x7f86700cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58316/0 (socket says 172.21.15.55:58316) 2023-08-25T04:15:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f8675b76640 1 -- 172.21.15.55:0/553306537 learned_addr learned my addr 172.21.15.55:0/553306537 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f8676b78640 1 --2- 172.21.15.55:0/553306537 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86701601f0 0x7f867006b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f8676377640 1 --2- 172.21.15.55:0/553306537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86700d1290 0x7f86700ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:44.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f8675b76640 1 -- 172.21.15.55:0/553306537 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86701601f0 msgr2=0x7f867006b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f8675b76640 1 --2- 172.21.15.55:0/553306537 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86701601f0 0x7f867006b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f8675b76640 1 -- 172.21.15.55:0/553306537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86700d1290 msgr2=0x7f86700ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f8675b76640 1 --2- 172.21.15.55:0/553306537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86700d1290 0x7f86700ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f8675b76640 1 -- 172.21.15.55:0/553306537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8668009b30 con 0x7f867015e3c0 2023-08-25T04:15:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f8675b76640 1 --2- 172.21.15.55:0/553306537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f867015e3c0 0x7f86700cc360 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f866000c4d0 tx=0x7f866000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f8666ffd640 1 -- 172.21.15.55:0/553306537 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660005480 con 0x7f867015e3c0 2023-08-25T04:15:44.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f8666ffd640 1 -- 172.21.15.55:0/553306537 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8660003600 con 0x7f867015e3c0 2023-08-25T04:15:44.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f8666ffd640 1 -- 172.21.15.55:0/553306537 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600039b0 con 0x7f867015e3c0 2023-08-25T04:15:44.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f86785db640 1 -- 172.21.15.55:0/553306537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86700ce7c0 con 0x7f867015e3c0 2023-08-25T04:15:44.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f86785db640 1 -- 172.21.15.55:0/553306537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867014c2c0 con 0x7f867015e3c0 2023-08-25T04:15:44.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.066+0000 7f86785db640 1 -- 172.21.15.55:0/553306537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86700b5260 con 0x7f867015e3c0 2023-08-25T04:15:44.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.070+0000 7f8666ffd640 1 -- 172.21.15.55:0/553306537 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 85133+0+0 (secure 0 0 0) 0x7f8660003b10 con 0x7f867015e3c0 2023-08-25T04:15:44.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.070+0000 7f8666ffd640 1 --2- 172.21.15.55:0/553306537 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8654065860 0x7f8654067d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:44.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.070+0000 7f8666ffd640 1 -- 172.21.15.55:0/553306537 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 8049+0+0 (secure 0 0 0) 0x7f8660082dd0 con 0x7f867015e3c0 2023-08-25T04:15:44.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.070+0000 7f8676377640 1 -- 172.21.15.55:0/553306537 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8654065860 msgr2=0x7f8654067d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3210220484 2023-08-25T04:15:44.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.070+0000 7f8676377640 1 --2- 172.21.15.55:0/553306537 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8654065860 0x7f8654067d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:15:44.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.074+0000 7f8666ffd640 1 -- 172.21.15.55:0/553306537 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f866004ffc0 con 0x7f867015e3c0 2023-08-25T04:15:44.109 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:44.108+0000 7f8ea0e0c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:15:44.148 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:44.150+0000 7f3fa61d4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:15:44.193 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:44.192+0000 7f8ea0e0c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:15:44.208 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:44.210+0000 7f3fa61d4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:15:44.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.230+0000 7f86785db640 1 -- 172.21.15.55:0/553306537 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f867014c4e0 con 0x7f867015e3c0 2023-08-25T04:15:44.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.230+0000 7f8666ffd640 1 -- 172.21.15.55:0/553306537 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8660017020 con 0x7f867015e3c0 2023-08-25T04:15:44.229 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:15:44.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.230+0000 7f86785db640 1 -- 172.21.15.55:0/553306537 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8654065860 msgr2=0x7f8654067d20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:15:44.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.230+0000 7f86785db640 1 --2- 172.21.15.55:0/553306537 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8654065860 0x7f8654067d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.230+0000 7f86785db640 1 -- 172.21.15.55:0/553306537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f867015e3c0 msgr2=0x7f86700cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:44.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.230+0000 7f86785db640 1 --2- 172.21.15.55:0/553306537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f867015e3c0 0x7f86700cc360 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f866000c4d0 tx=0x7f866000c990 comp rx=0 tx=0).stop 2023-08-25T04:15:44.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.230+0000 7f86785db640 1 -- 172.21.15.55:0/553306537 shutdown_connections 2023-08-25T04:15:44.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.230+0000 7f86785db640 1 --2- 172.21.15.55:0/553306537 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f8654065860 0x7f8654067d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.230+0000 7f86785db640 1 --2- 172.21.15.55:0/553306537 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86701601f0 0x7f867006b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.230+0000 7f86785db640 1 --2- 172.21.15.55:0/553306537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f867015e3c0 0x7f86700cc360 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.230+0000 7f86785db640 1 --2- 172.21.15.55:0/553306537 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86700d1290 0x7f86700ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.230+0000 7f86785db640 1 -- 172.21.15.55:0/553306537 >> 172.21.15.55:0/553306537 conn(0x7f86700d27d0 msgr2=0x7f867015dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:44.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.230+0000 7f86785db640 1 -- 172.21.15.55:0/553306537 shutdown_connections 2023-08-25T04:15:44.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.234+0000 7f86785db640 1 -- 172.21.15.55:0/553306537 wait complete. 2023-08-25T04:15:44.250 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:44.248+0000 7f8ea0e0c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:15:44.252 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:15:44.298 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:44.302+0000 7f3fa61d4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:15:44.359 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:44.362+0000 7f3fa61d4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:15:44.393 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:44.392+0000 7f8ea0e0c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:15:44.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.442+0000 7ff2ee598640 1 Processor -- start 2023-08-25T04:15:44.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.442+0000 7ff2ee598640 1 -- start start 2023-08-25T04:15:44.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.442+0000 7ff2ee598640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2e815fca0 0x7ff2e80cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:44.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.442+0000 7ff2ee598640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e80cfac0 0x7ff2e80b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:44.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.442+0000 7ff2ee598640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e80cfee0 con 0x7ff2e80b8330 2023-08-25T04:15:44.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.442+0000 7ff2ee598640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e8160080 con 0x7ff2e815fca0 2023-08-25T04:15:44.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.442+0000 7ff2ee598640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e80b70c0 con 0x7ff2e80cfac0 2023-08-25T04:15:44.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.442+0000 7ff2ed596640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2e815fca0 0x7ff2e80cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:44.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.442+0000 7ff2ecd95640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff2e80b8330 0x7ff2e80d0bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53570/0 (socket says 172.21.15.55:53570) 2023-08-25T04:15:44.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.446+0000 7ff2ed596640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2e815fca0 0x7ff2e80cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58324/0 (socket says 172.21.15.55:58324) 2023-08-25T04:15:44.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.446+0000 7ff2ecd95640 1 -- 172.21.15.55:0/3433642026 learned_addr learned my addr 172.21.15.55:0/3433642026 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:44.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.446+0000 7ff2edd97640 1 --2- 172.21.15.55:0/3433642026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e80cfac0 0x7ff2e80b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:44.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.446+0000 7ff2dffff640 1 -- 172.21.15.55:0/3433642026 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190120309 0 0) 0x7ff2e80cfee0 con 0x7ff2e80b8330 2023-08-25T04:15:44.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.446+0000 7ff2dffff640 1 -- 172.21.15.55:0/3433642026 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2d4003530 con 0x7ff2e80b8330 2023-08-25T04:15:44.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.446+0000 7ff2ed596640 1 -- 172.21.15.55:0/3433642026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e80cfac0 msgr2=0x7ff2e80b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:44.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.446+0000 7ff2ed596640 1 --2- 172.21.15.55:0/3433642026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e80cfac0 0x7ff2e80b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.446+0000 7ff2ed596640 1 -- 172.21.15.55:0/3433642026 >> v1:172.21.15.55:6789/0 conn(0x7ff2e80b8330 legacy=0x7ff2e80d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:44.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.446+0000 7ff2ed596640 1 -- 172.21.15.55:0/3433642026 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e80b73a0 con 0x7ff2e815fca0 2023-08-25T04:15:44.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.446+0000 7ff2edd97640 1 --2- 172.21.15.55:0/3433642026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e80cfac0 0x7ff2e80b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:15:44.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.446+0000 7ff2ed596640 1 --2- 172.21.15.55:0/3433642026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e815fca0 0x7ff2e80cf580 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40097c0 tx=0x7ff2e401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0c9491b5acc960 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:44.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.446+0000 7ff2dffff640 1 -- 172.21.15.55:0/3433642026 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40a8970 con 0x7ff2e815fca0 2023-08-25T04:15:44.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.446+0000 7ff2dffff640 1 -- 172.21.15.55:0/3433642026 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e40a8ad0 con 0x7ff2e815fca0 2023-08-25T04:15:44.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.446+0000 7ff2dffff640 1 -- 172.21.15.55:0/3433642026 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40a8e40 con 0x7ff2e815fca0 2023-08-25T04:15:44.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ee598640 1 -- 172.21.15.55:0/3433642026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e815fca0 msgr2=0x7ff2e80cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:44.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ee598640 1 --2- 172.21.15.55:0/3433642026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e815fca0 0x7ff2e80cf580 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40097c0 tx=0x7ff2e401ec70 comp rx=0 tx=0).stop 2023-08-25T04:15:44.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ee598640 1 -- 172.21.15.55:0/3433642026 shutdown_connections 2023-08-25T04:15:44.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ee598640 1 --2- 172.21.15.55:0/3433642026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e80cfac0 0x7ff2e80b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ee598640 1 --2- 172.21.15.55:0/3433642026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e815fca0 0x7ff2e80cf580 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ee598640 1 -- 172.21.15.55:0/3433642026 >> 172.21.15.55:0/3433642026 conn(0x7ff2e80658c0 msgr2=0x7ff2e8065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:44.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ee598640 1 -- 172.21.15.55:0/3433642026 shutdown_connections 2023-08-25T04:15:44.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ee598640 1 -- 172.21.15.55:0/3433642026 wait complete. 2023-08-25T04:15:44.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ee598640 1 Processor -- start 2023-08-25T04:15:44.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ee598640 1 -- start start 2023-08-25T04:15:44.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ee598640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e80b8330 0x7ff2e81f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:44.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ee598640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2e80cfac0 0x7ff2e8150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:44.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ee598640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e815fca0 0x7ff2e8150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:44.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ee598640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8143670 con 0x7ff2e80b8330 2023-08-25T04:15:44.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ee598640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e814f260 con 0x7ff2e80cfac0 2023-08-25T04:15:44.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ee598640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e814f540 con 0x7ff2e815fca0 2023-08-25T04:15:44.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ed596640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e80b8330 0x7ff2e81f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:44.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ed596640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e80b8330 0x7ff2e81f1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58334/0 (socket says 172.21.15.55:58334) 2023-08-25T04:15:44.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ed596640 1 -- 172.21.15.55:0/1770610417 learned_addr learned my addr 172.21.15.55:0/1770610417 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:44.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2ecd95640 1 --2- 172.21.15.55:0/1770610417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2e80cfac0 0x7ff2e8150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:44.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.450+0000 7ff2edd97640 1 --2- 172.21.15.55:0/1770610417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e815fca0 0x7ff2e8150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:44.452 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:44.448+0000 7f8ea0e0c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:15:44.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.454+0000 7ff2ed596640 1 -- 172.21.15.55:0/1770610417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e815fca0 msgr2=0x7ff2e8150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:44.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.454+0000 7ff2ed596640 1 --2- 172.21.15.55:0/1770610417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e815fca0 0x7ff2e8150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.454+0000 7ff2ed596640 1 -- 172.21.15.55:0/1770610417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2e80cfac0 msgr2=0x7ff2e8150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:44.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.454+0000 7ff2ed596640 1 --2- 172.21.15.55:0/1770610417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2e80cfac0 0x7ff2e8150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.454+0000 7ff2ed596640 1 -- 172.21.15.55:0/1770610417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e0009a70 con 0x7ff2e80b8330 2023-08-25T04:15:44.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.454+0000 7ff2edd97640 1 --2- 172.21.15.55:0/1770610417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e815fca0 0x7ff2e8150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:44.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.454+0000 7ff2ed596640 1 --2- 172.21.15.55:0/1770610417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e80b8330 0x7ff2e81f1fa0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4000c10 tx=0x7ff2e401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:44.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.454+0000 7ff2ddffb640 1 -- 172.21.15.55:0/1770610417 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4004450 con 0x7ff2e80b8330 2023-08-25T04:15:44.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.454+0000 7ff2ddffb640 1 -- 172.21.15.55:0/1770610417 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e4003620 con 0x7ff2e80b8330 2023-08-25T04:15:44.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.454+0000 7ff2ddffb640 1 -- 172.21.15.55:0/1770610417 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4003990 con 0x7ff2e80b8330 2023-08-25T04:15:44.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.454+0000 7ff2ee598640 1 -- 172.21.15.55:0/1770610417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e4009420 con 0x7ff2e80b8330 2023-08-25T04:15:44.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.454+0000 7ff2ee598640 1 -- 172.21.15.55:0/1770610417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e814fb00 con 0x7ff2e80b8330 2023-08-25T04:15:44.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.454+0000 7ff2ee598640 1 -- 172.21.15.55:0/1770610417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e8073e50 con 0x7ff2e80b8330 2023-08-25T04:15:44.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.454+0000 7ff2ddffb640 1 -- 172.21.15.55:0/1770610417 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 85133+0+0 (secure 0 0 0) 0x7ff2e40b7040 con 0x7ff2e80b8330 2023-08-25T04:15:44.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.458+0000 7ff2ddffb640 1 --2- 172.21.15.55:0/1770610417 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7ff2cc065830 0x7ff2cc067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:44.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.458+0000 7ff2ddffb640 1 -- 172.21.15.55:0/1770610417 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 8049+0+0 (secure 0 0 0) 0x7ff2e41210b0 con 0x7ff2e80b8330 2023-08-25T04:15:44.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.458+0000 7ff2ecd95640 1 -- 172.21.15.55:0/1770610417 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7ff2cc065830 msgr2=0x7ff2cc067cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3210220484 2023-08-25T04:15:44.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.458+0000 7ff2ecd95640 1 --2- 172.21.15.55:0/1770610417 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7ff2cc065830 0x7ff2cc067cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:15:44.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.462+0000 7ff2ddffb640 1 -- 172.21.15.55:0/1770610417 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff2e40ee000 con 0x7ff2e80b8330 2023-08-25T04:15:44.515 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:44.518+0000 7f3fa61d4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:15:44.577 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:44.578+0000 7f3fa61d4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:15:44.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.618+0000 7ff2ee598640 1 -- 172.21.15.55:0/1770610417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff2e80d19f0 con 0x7ff2e80b8330 2023-08-25T04:15:44.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.618+0000 7ff2ddffb640 1 -- 172.21.15.55:0/1770610417 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff2e40f1620 con 0x7ff2e80b8330 2023-08-25T04:15:44.618 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:15:44.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.622+0000 7ff2ee598640 1 -- 172.21.15.55:0/1770610417 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7ff2cc065830 msgr2=0x7ff2cc067cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:15:44.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.622+0000 7ff2ee598640 1 --2- 172.21.15.55:0/1770610417 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7ff2cc065830 0x7ff2cc067cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.622+0000 7ff2ee598640 1 -- 172.21.15.55:0/1770610417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e80b8330 msgr2=0x7ff2e81f1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:44.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.622+0000 7ff2ee598640 1 --2- 172.21.15.55:0/1770610417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e80b8330 0x7ff2e81f1fa0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4000c10 tx=0x7ff2e401ba10 comp rx=0 tx=0).stop 2023-08-25T04:15:44.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.622+0000 7ff2ee598640 1 -- 172.21.15.55:0/1770610417 shutdown_connections 2023-08-25T04:15:44.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.622+0000 7ff2ee598640 1 --2- 172.21.15.55:0/1770610417 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7ff2cc065830 0x7ff2cc067cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.622+0000 7ff2ee598640 1 --2- 172.21.15.55:0/1770610417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e815fca0 0x7ff2e8150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.622+0000 7ff2ee598640 1 --2- 172.21.15.55:0/1770610417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2e80cfac0 0x7ff2e8150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.622+0000 7ff2ee598640 1 --2- 172.21.15.55:0/1770610417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e80b8330 0x7ff2e81f1fa0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.622+0000 7ff2ee598640 1 -- 172.21.15.55:0/1770610417 >> 172.21.15.55:0/1770610417 conn(0x7ff2e80658c0 msgr2=0x7ff2e80d1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:44.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.622+0000 7ff2ee598640 1 -- 172.21.15.55:0/1770610417 shutdown_connections 2023-08-25T04:15:44.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.622+0000 7ff2ee598640 1 -- 172.21.15.55:0/1770610417 wait complete. 2023-08-25T04:15:44.639 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:15:44.694 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:15:44.694 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:15:44.694 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:15:44.707 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:44.700+0000 7f8ea0e0c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:15:44.835 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:15:44.836 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:15:44.836 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:15:44.839 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:44.836+0000 7f8ea0e0c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:15:44.845 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:44.846+0000 7f3fa61d4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:15:44.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.862+0000 7f6d89a88640 1 Processor -- start 2023-08-25T04:15:44.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.862+0000 7f6d89a88640 1 -- start start 2023-08-25T04:15:44.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.866+0000 7f6d89a88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d840cdde0 0x7f6d840ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:44.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.866+0000 7f6d89a88640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6d840b2e40 0x7f6d840b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:44.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.866+0000 7f6d89a88640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d840b29b0 con 0x7f6d840d0da0 2023-08-25T04:15:44.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.866+0000 7f6d89a88640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d840ce760 con 0x7f6d840b2e40 2023-08-25T04:15:44.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.866+0000 7f6d89a88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d840b1dc0 con 0x7f6d840cdde0 2023-08-25T04:15:44.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.866+0000 7f6d83fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6d840b2e40 0x7f6d840b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:44.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.866+0000 7f6d83fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6d840b2e40 0x7f6d840b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58338/0 (socket says 172.21.15.55:58338) 2023-08-25T04:15:44.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.866+0000 7f6d83fff640 1 -- 172.21.15.55:0/1262400955 learned_addr learned my addr 172.21.15.55:0/1262400955 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:44.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.866+0000 7f6d82ffd640 1 --2- 172.21.15.55:0/1262400955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d840cdde0 0x7f6d840ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:44.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.866+0000 7f6d83fff640 1 -- 172.21.15.55:0/1262400955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d840cdde0 msgr2=0x7f6d840ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:44.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.866+0000 7f6d83fff640 1 --2- 172.21.15.55:0/1262400955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d840cdde0 0x7f6d840ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.866+0000 7f6d83fff640 1 -- 172.21.15.55:0/1262400955 >> v1:172.21.15.110:6789/0 conn(0x7f6d840d0da0 legacy=0x7f6d840d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:44.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.866+0000 7f6d83fff640 1 -- 172.21.15.55:0/1262400955 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d840b2080 con 0x7f6d840b2e40 2023-08-25T04:15:44.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.870+0000 7f6d83fff640 1 --2- 172.21.15.55:0/1262400955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d840b2e40 0x7f6d840b32d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c009e50 tx=0x7f6d7c01f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610b93c4fa152d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:44.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.870+0000 7f6d827fc640 1 -- 172.21.15.55:0/1262400955 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0af400 con 0x7f6d840b2e40 2023-08-25T04:15:44.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.870+0000 7f6d827fc640 1 -- 172.21.15.55:0/1262400955 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c0ab050 con 0x7f6d840b2e40 2023-08-25T04:15:44.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.870+0000 7f6d827fc640 1 -- 172.21.15.55:0/1262400955 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0af780 con 0x7f6d840b2e40 2023-08-25T04:15:44.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.870+0000 7f6d89a88640 1 -- 172.21.15.55:0/1262400955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d840b2e40 msgr2=0x7f6d840b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:44.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.870+0000 7f6d89a88640 1 --2- 172.21.15.55:0/1262400955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d840b2e40 0x7f6d840b32d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c009e50 tx=0x7f6d7c01f1f0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.870+0000 7f6d89a88640 1 -- 172.21.15.55:0/1262400955 shutdown_connections 2023-08-25T04:15:44.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.870+0000 7f6d89a88640 1 --2- 172.21.15.55:0/1262400955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d840b2e40 0x7f6d840b32d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.870+0000 7f6d89a88640 1 --2- 172.21.15.55:0/1262400955 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d840cdde0 0x7f6d840ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.870+0000 7f6d89a88640 1 -- 172.21.15.55:0/1262400955 >> 172.21.15.55:0/1262400955 conn(0x7f6d8409bae0 msgr2=0x7f6d840d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:44.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.870+0000 7f6d89a88640 1 -- 172.21.15.55:0/1262400955 shutdown_connections 2023-08-25T04:15:44.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.870+0000 7f6d89a88640 1 -- 172.21.15.55:0/1262400955 wait complete. 2023-08-25T04:15:44.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.870+0000 7f6d89a88640 1 Processor -- start 2023-08-25T04:15:44.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.870+0000 7f6d89a88640 1 -- start start 2023-08-25T04:15:44.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d89a88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d840b2e40 0x7f6d8414f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:44.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d89a88640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d840cdde0 0x7f6d841f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:44.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d89a88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d840d0da0 0x7f6d840c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:44.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d89a88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d841f67a0 con 0x7f6d840b2e40 2023-08-25T04:15:44.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d89a88640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d840c8580 con 0x7f6d840cdde0 2023-08-25T04:15:44.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d89a88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d840b7c80 con 0x7f6d840d0da0 2023-08-25T04:15:44.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d837fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d840b2e40 0x7f6d8414f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:44.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d837fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d840b2e40 0x7f6d8414f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58340/0 (socket says 172.21.15.55:58340) 2023-08-25T04:15:44.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d837fe640 1 -- 172.21.15.55:0/3883639802 learned_addr learned my addr 172.21.15.55:0/3883639802 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:44.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d83fff640 1 --2- 172.21.15.55:0/3883639802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d840d0da0 0x7f6d840c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:44.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d82ffd640 1 --2- 172.21.15.55:0/3883639802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d840cdde0 0x7f6d841f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:44.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d837fe640 1 -- 172.21.15.55:0/3883639802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d840d0da0 msgr2=0x7f6d840c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:44.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d837fe640 1 --2- 172.21.15.55:0/3883639802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d840d0da0 0x7f6d840c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d837fe640 1 -- 172.21.15.55:0/3883639802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d840cdde0 msgr2=0x7f6d841f6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:44.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d837fe640 1 --2- 172.21.15.55:0/3883639802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d840cdde0 0x7f6d841f6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:44.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d837fe640 1 -- 172.21.15.55:0/3883639802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7c009b30 con 0x7f6d840b2e40 2023-08-25T04:15:44.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d837fe640 1 --2- 172.21.15.55:0/3883639802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d840b2e40 0x7f6d8414f570 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400c450 tx=0x7f6d7400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:44.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d6bfff640 1 -- 172.21.15.55:0/3883639802 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d740052d0 con 0x7f6d840b2e40 2023-08-25T04:15:44.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d6bfff640 1 -- 172.21.15.55:0/3883639802 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d74005430 con 0x7f6d840b2e40 2023-08-25T04:15:44.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d6bfff640 1 -- 172.21.15.55:0/3883639802 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d74003890 con 0x7f6d840b2e40 2023-08-25T04:15:44.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d89a88640 1 -- 172.21.15.55:0/3883639802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d840b7f60 con 0x7f6d840b2e40 2023-08-25T04:15:44.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d89a88640 1 -- 172.21.15.55:0/3883639802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d8414be70 con 0x7f6d840b2e40 2023-08-25T04:15:44.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d89a88640 1 -- 172.21.15.55:0/3883639802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d840b8710 con 0x7f6d840b2e40 2023-08-25T04:15:44.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.874+0000 7f6d6bfff640 1 -- 172.21.15.55:0/3883639802 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 85133+0+0 (secure 0 0 0) 0x7f6d740039f0 con 0x7f6d840b2e40 2023-08-25T04:15:44.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.878+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/3883639802 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6d70065830 0x7f6d70067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:44.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.878+0000 7f6d6bfff640 1 -- 172.21.15.55:0/3883639802 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 8049+0+0 (secure 0 0 0) 0x7f6d74083350 con 0x7f6d840b2e40 2023-08-25T04:15:44.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.878+0000 7f6d82ffd640 1 -- 172.21.15.55:0/3883639802 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6d70065830 msgr2=0x7f6d70067cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3210220484 2023-08-25T04:15:44.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.878+0000 7f6d82ffd640 1 --2- 172.21.15.55:0/3883639802 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6d70065830 0x7f6d70067cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:15:44.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:44.882+0000 7f6d6bfff640 1 -- 172.21.15.55:0/3883639802 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6d74050450 con 0x7f6d840b2e40 2023-08-25T04:15:44.966 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:44.964+0000 7f8ea0e0c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:15:44.992 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:44.994+0000 7f3fa61d4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:15:45.035 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:45.032+0000 7f8ea0e0c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:15:45.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.054+0000 7f6d89a88640 1 -- 172.21.15.55:0/3883639802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6d8414c090 con 0x7f6d840b2e40 2023-08-25T04:15:45.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.054+0000 7f6d6bfff640 1 -- 172.21.15.55:0/3883639802 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v48) v1 ==== 80+0+358 (secure 0 0 0) 0x7f6d74053a70 con 0x7f6d840b2e40 2023-08-25T04:15:45.052 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6833/413962747 2023-08-26T04:04:16.252224+0000 2023-08-25T04:15:45.052 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6832/413962747 2023-08-26T04:04:16.252224+0000 2023-08-25T04:15:45.053 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/2576650460 2023-08-26T04:04:16.252224+0000 2023-08-25T04:15:45.053 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3898418887 2023-08-26T04:04:16.252224+0000 2023-08-25T04:15:45.053 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/2105887625 2023-08-26T04:04:16.252224+0000 2023-08-25T04:15:45.053 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3810476394 2023-08-26T04:04:16.252224+0000 2023-08-25T04:15:45.054 INFO:teuthology.orchestra.run.smithi055.stderr:listed 6 entries 2023-08-25T04:15:45.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.054+0000 7f6d89a88640 1 -- 172.21.15.55:0/3883639802 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6d70065830 msgr2=0x7f6d70067cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:15:45.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.054+0000 7f6d89a88640 1 --2- 172.21.15.55:0/3883639802 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6d70065830 0x7f6d70067cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.054+0000 7f6d89a88640 1 -- 172.21.15.55:0/3883639802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d840b2e40 msgr2=0x7f6d8414f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:45.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.054+0000 7f6d89a88640 1 --2- 172.21.15.55:0/3883639802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d840b2e40 0x7f6d8414f570 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400c450 tx=0x7f6d7400c910 comp rx=0 tx=0).stop 2023-08-25T04:15:45.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.054+0000 7f6d89a88640 1 -- 172.21.15.55:0/3883639802 shutdown_connections 2023-08-25T04:15:45.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.054+0000 7f6d89a88640 1 --2- 172.21.15.55:0/3883639802 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f6d70065830 0x7f6d70067cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.054+0000 7f6d89a88640 1 --2- 172.21.15.55:0/3883639802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d840d0da0 0x7f6d840c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.054+0000 7f6d89a88640 1 --2- 172.21.15.55:0/3883639802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d840cdde0 0x7f6d841f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.054+0000 7f6d89a88640 1 --2- 172.21.15.55:0/3883639802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d840b2e40 0x7f6d8414f570 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.054+0000 7f6d89a88640 1 -- 172.21.15.55:0/3883639802 >> 172.21.15.55:0/3883639802 conn(0x7f6d8409bae0 msgr2=0x7f6d8406b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:45.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.054+0000 7f6d89a88640 1 -- 172.21.15.55:0/3883639802 shutdown_connections 2023-08-25T04:15:45.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.054+0000 7f6d89a88640 1 -- 172.21.15.55:0/3883639802 wait complete. 2023-08-25T04:15:45.074 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-25T04:15:45.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:45.075 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-25T04:15:45.130 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:45.130+0000 7f3fa61d4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:15:45.131 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T04:15:45.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:15:45.133 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-25T04:15:45.144 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:15:45.145 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:15:45.154 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:15:45.155 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:15:45.155 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:15:45.174 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:45.172+0000 7f8ea0e0c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:15:45.196 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T04:15:45.197 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:15:45.197 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:15:45.206 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:15:45.207 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:15:45.208 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:45.210+0000 7f3fa61d4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:15:45.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.354+0000 7fde1d159640 1 Processor -- start 2023-08-25T04:15:45.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.354+0000 7fde1d159640 1 -- start start 2023-08-25T04:15:45.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.358+0000 7fde1d159640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fde180cdde0 0x7fde180ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:45.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.358+0000 7fde1d159640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fde180b2e40 0x7fde180b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:45.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.358+0000 7fde1d159640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde180b29b0 con 0x7fde180d0da0 2023-08-25T04:15:45.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.358+0000 7fde1d159640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde180ce760 con 0x7fde180b2e40 2023-08-25T04:15:45.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.358+0000 7fde1d159640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde180b1dc0 con 0x7fde180cdde0 2023-08-25T04:15:45.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.358+0000 7fde1759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fde180b2e40 0x7fde180b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:45.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.358+0000 7fde1759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fde180b2e40 0x7fde180b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58346/0 (socket says 172.21.15.55:58346) 2023-08-25T04:15:45.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.358+0000 7fde1759e640 1 -- 172.21.15.55:0/1658664434 learned_addr learned my addr 172.21.15.55:0/1658664434 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:45.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.358+0000 7fde16d9d640 1 --1- 172.21.15.55:0/1658664434 >> v1:172.21.15.55:6789/0 conn(0x7fde180d0da0 0x7fde180d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53578/0 (socket says 172.21.15.55:53578) 2023-08-25T04:15:45.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.358+0000 7fde0ffff640 1 --2- 172.21.15.55:0/1658664434 >> v2:172.21.15.110:3300/0 conn(0x7fde180cdde0 0x7fde180ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:45.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.358+0000 7fde1759e640 1 -- 172.21.15.55:0/1658664434 >> v2:172.21.15.110:3300/0 conn(0x7fde180cdde0 msgr2=0x7fde180ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:45.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.358+0000 7fde1759e640 1 --2- 172.21.15.55:0/1658664434 >> v2:172.21.15.110:3300/0 conn(0x7fde180cdde0 0x7fde180ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.358+0000 7fde1759e640 1 -- 172.21.15.55:0/1658664434 >> v1:172.21.15.55:6789/0 conn(0x7fde180d0da0 legacy=0x7fde180d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:45.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.358+0000 7fde1759e640 1 -- 172.21.15.55:0/1658664434 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde180b2080 con 0x7fde180b2e40 2023-08-25T04:15:45.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.358+0000 7fde1659c640 1 -- 172.21.15.55:0/1658664434 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822984235 0 0) 0x7fde180b29b0 con 0x7fde180d0da0 2023-08-25T04:15:45.358 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:45.358+0000 7f3fa61d4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:15:45.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.362+0000 7fde1759e640 1 --2- 172.21.15.55:0/1658664434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde180b2e40 0x7fde180b32b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fde180d38c0 tx=0x7fde1001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e4109f066ed834 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:45.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.362+0000 7fde1659c640 1 -- 172.21.15.55:0/1658664434 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde100af400 con 0x7fde180b2e40 2023-08-25T04:15:45.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.362+0000 7fde1659c640 1 -- 172.21.15.55:0/1658664434 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde100ab050 con 0x7fde180b2e40 2023-08-25T04:15:45.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.362+0000 7fde1659c640 1 -- 172.21.15.55:0/1658664434 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde100af780 con 0x7fde180b2e40 2023-08-25T04:15:45.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.362+0000 7fde1d159640 1 -- 172.21.15.55:0/1658664434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde180b2e40 msgr2=0x7fde180b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:45.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.362+0000 7fde1d159640 1 --2- 172.21.15.55:0/1658664434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde180b2e40 0x7fde180b32b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fde180d38c0 tx=0x7fde1001f1c0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.362+0000 7fde1d159640 1 -- 172.21.15.55:0/1658664434 shutdown_connections 2023-08-25T04:15:45.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.362+0000 7fde1d159640 1 --2- 172.21.15.55:0/1658664434 >> v2:172.21.15.110:3300/0 conn(0x7fde180cdde0 0x7fde180ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.362+0000 7fde1d159640 1 --2- 172.21.15.55:0/1658664434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde180b2e40 0x7fde180b32b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.362+0000 7fde1d159640 1 -- 172.21.15.55:0/1658664434 >> 172.21.15.55:0/1658664434 conn(0x7fde1809bae0 msgr2=0x7fde180d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:45.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.362+0000 7fde1d159640 1 -- 172.21.15.55:0/1658664434 shutdown_connections 2023-08-25T04:15:45.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.362+0000 7fde1d159640 1 -- 172.21.15.55:0/1658664434 wait complete. 2023-08-25T04:15:45.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.362+0000 7fde1d159640 1 Processor -- start 2023-08-25T04:15:45.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.362+0000 7fde1d159640 1 -- start start 2023-08-25T04:15:45.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde1d159640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde180b2e40 0x7fde18151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:45.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde1d159640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde180cdde0 0x7fde180b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:45.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde1d159640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde180d0da0 0x7fde180cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:45.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde1d159640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde180c74f0 con 0x7fde180cdde0 2023-08-25T04:15:45.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde1d159640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde180c7760 con 0x7fde180d0da0 2023-08-25T04:15:45.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde1d159640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde180c7a40 con 0x7fde180b2e40 2023-08-25T04:15:45.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde0ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde180cdde0 0x7fde180b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:45.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde0ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde180cdde0 0x7fde180b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58356/0 (socket says 172.21.15.55:58356) 2023-08-25T04:15:45.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde0ffff640 1 -- 172.21.15.55:0/3338911413 learned_addr learned my addr 172.21.15.55:0/3338911413 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:45.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde1759e640 1 --2- 172.21.15.55:0/3338911413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde180d0da0 0x7fde180cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:45.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde16d9d640 1 --2- 172.21.15.55:0/3338911413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde180b2e40 0x7fde18151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:45.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde0ffff640 1 -- 172.21.15.55:0/3338911413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde180b2e40 msgr2=0x7fde18151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:45.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde0ffff640 1 --2- 172.21.15.55:0/3338911413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde180b2e40 0x7fde18151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde0ffff640 1 -- 172.21.15.55:0/3338911413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde180d0da0 msgr2=0x7fde180cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:45.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde0ffff640 1 --2- 172.21.15.55:0/3338911413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde180d0da0 0x7fde180cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde0ffff640 1 -- 172.21.15.55:0/3338911413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde10009b30 con 0x7fde180cdde0 2023-08-25T04:15:45.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde0ffff640 1 --2- 172.21.15.55:0/3338911413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde180cdde0 0x7fde180b49a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fde0000e930 tx=0x7fde0000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:45.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde0f7fe640 1 -- 172.21.15.55:0/3338911413 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00009690 con 0x7fde180cdde0 2023-08-25T04:15:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde0f7fe640 1 -- 172.21.15.55:0/3338911413 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0000ca00 con 0x7fde180cdde0 2023-08-25T04:15:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde1d159640 1 -- 172.21.15.55:0/3338911413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde180c7d20 con 0x7fde180cdde0 2023-08-25T04:15:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde0f7fe640 1 -- 172.21.15.55:0/3338911413 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0000cd70 con 0x7fde180cdde0 2023-08-25T04:15:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde1d159640 1 -- 172.21.15.55:0/3338911413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde180b4ee0 con 0x7fde180cdde0 2023-08-25T04:15:45.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.366+0000 7fde1d159640 1 -- 172.21.15.55:0/3338911413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1804dbe0 con 0x7fde180cdde0 2023-08-25T04:15:45.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.370+0000 7fde0f7fe640 1 -- 172.21.15.55:0/3338911413 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 85133+0+0 (secure 0 0 0) 0x7fde00013470 con 0x7fde180cdde0 2023-08-25T04:15:45.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.370+0000 7fde0f7fe640 1 --2- 172.21.15.55:0/3338911413 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fddf8065860 0x7fddf8067d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:45.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.370+0000 7fde0f7fe640 1 -- 172.21.15.55:0/3338911413 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 8049+0+0 (secure 0 0 0) 0x7fde00083a00 con 0x7fde180cdde0 2023-08-25T04:15:45.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.370+0000 7fde16d9d640 1 -- 172.21.15.55:0/3338911413 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fddf8065860 msgr2=0x7fddf8067d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3210220484 2023-08-25T04:15:45.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.370+0000 7fde16d9d640 1 --2- 172.21.15.55:0/3338911413 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fddf8065860 0x7fddf8067d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:15:45.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.378+0000 7fde0f7fe640 1 -- 172.21.15.55:0/3338911413 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fde00050c80 con 0x7fde180cdde0 2023-08-25T04:15:45.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.574+0000 7fde16d9d640 1 -- 172.21.15.55:0/3338911413 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fddf8065860 msgr2=0x7fddf8067d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3210220484 2023-08-25T04:15:45.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.574+0000 7fde16d9d640 1 --2- 172.21.15.55:0/3338911413 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fddf8065860 0x7fddf8067d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-25T04:15:45.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.574+0000 7fde1d159640 1 -- 172.21.15.55:0/3338911413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde180d0b80 con 0x7fde180cdde0 2023-08-25T04:15:45.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.574+0000 7fde0f7fe640 1 -- 172.21.15.55:0/3338911413 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4881 (secure 0 0 0) 0x7fde00017090 con 0x7fde180cdde0 2023-08-25T04:15:45.572 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:45.573 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4838,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1920231780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1920231780},{"type":"v1","addr":"172.21.15.110:6837","nonce":1920231780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2215940247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2215940247},{"type":"v1","addr":"172.21.15.55:6835","nonce":2215940247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1708341067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1708341067},{"type":"v1","addr":"172.21.15.110:6836","nonce":1708341067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:03:58.767654+0000","modified":"2023-08-25T04:04:02.406061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5080":{"gid":5080,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6834/2079290775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2079290775},{"type":"v1","addr":"172.21.15.55:6834","nonce":2079290775}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-25T04:15:45.573 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 15 2023-08-25T04:15:45.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.578+0000 7fde1d159640 1 -- 172.21.15.55:0/3338911413 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fddf8065860 msgr2=0x7fddf8067d20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:15:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.578+0000 7fde1d159640 1 --2- 172.21.15.55:0/3338911413 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fddf8065860 0x7fddf8067d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.578+0000 7fde1d159640 1 -- 172.21.15.55:0/3338911413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde180cdde0 msgr2=0x7fde180b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.578+0000 7fde1d159640 1 --2- 172.21.15.55:0/3338911413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde180cdde0 0x7fde180b49a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fde0000e930 tx=0x7fde0000edf0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.578+0000 7fde1d159640 1 -- 172.21.15.55:0/3338911413 shutdown_connections 2023-08-25T04:15:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.578+0000 7fde1d159640 1 --2- 172.21.15.55:0/3338911413 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7fddf8065860 0x7fddf8067d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.578+0000 7fde1d159640 1 --2- 172.21.15.55:0/3338911413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde180d0da0 0x7fde180cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.578+0000 7fde1d159640 1 --2- 172.21.15.55:0/3338911413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde180cdde0 0x7fde180b49a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.578+0000 7fde1d159640 1 --2- 172.21.15.55:0/3338911413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde180b2e40 0x7fde18151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.578+0000 7fde1d159640 1 -- 172.21.15.55:0/3338911413 >> 172.21.15.55:0/3338911413 conn(0x7fde1809bae0 msgr2=0x7fde1815b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:45.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.578+0000 7fde1d159640 1 -- 172.21.15.55:0/3338911413 shutdown_connections 2023-08-25T04:15:45.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.578+0000 7fde1d159640 1 -- 172.21.15.55:0/3338911413 wait complete. 2023-08-25T04:15:45.615 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:15:45.756 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:45.752+0000 7f8ea0e0c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:15:45.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.798+0000 7f951d1d2640 1 Processor -- start 2023-08-25T04:15:45.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.798+0000 7f951d1d2640 1 -- start start 2023-08-25T04:15:45.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.802+0000 7f951d1d2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f951815a300 0x7f951815e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:45.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.802+0000 7f951d1d2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f95180b10d0 0x7f951806f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:45.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.802+0000 7f951d1d2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95180ca9d0 con 0x7f951806fe20 2023-08-25T04:15:45.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.802+0000 7f951d1d2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951815eee0 con 0x7f95180b10d0 2023-08-25T04:15:45.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.802+0000 7f951d1d2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95180702b0 con 0x7f951815a300 2023-08-25T04:15:45.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.802+0000 7f9517fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f951815a300 0x7f951815e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:45.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.802+0000 7f951c9d1640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f951806fe20 0x7f95180c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:41342/0 (socket says 172.21.15.55:41342) 2023-08-25T04:15:45.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.802+0000 7f951c9d1640 1 -- 172.21.15.55:0/4186117762 learned_addr learned my addr 172.21.15.55:0/4186117762 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:45.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.802+0000 7f9516ffd640 1 -- 172.21.15.55:0/4186117762 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2713957870 0 0) 0x7f95180ca9d0 con 0x7f951806fe20 2023-08-25T04:15:45.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.802+0000 7f9516ffd640 1 -- 172.21.15.55:0/4186117762 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9500003530 con 0x7f951806fe20 2023-08-25T04:15:45.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.802+0000 7f9517fff640 1 -- 172.21.15.55:0/4186117762 >> v2:172.21.15.110:3300/0 conn(0x7f95180b10d0 msgr2=0x7f951806f8e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-25T04:15:45.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.802+0000 7f9517fff640 1 --2- 172.21.15.55:0/4186117762 >> v2:172.21.15.110:3300/0 conn(0x7f95180b10d0 0x7f951806f8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.802+0000 7f9517fff640 1 -- 172.21.15.55:0/4186117762 >> v1:172.21.15.110:6789/0 conn(0x7f951806fe20 legacy=0x7f95180c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:45.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.802+0000 7f9517fff640 1 -- 172.21.15.55:0/4186117762 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95180cacb0 con 0x7f951815a300 2023-08-25T04:15:45.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.806+0000 7f9517fff640 1 --2- 172.21.15.55:0/4186117762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f951815a300 0x7f951815e9a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f95080097c0 tx=0x7f950801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b79259f3f458a605 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:45.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.806+0000 7f9516ffd640 1 -- 172.21.15.55:0/4186117762 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95080ad680 con 0x7f951815a300 2023-08-25T04:15:45.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.806+0000 7f9516ffd640 1 -- 172.21.15.55:0/4186117762 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95080ad7e0 con 0x7f951815a300 2023-08-25T04:15:45.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.806+0000 7f9516ffd640 1 -- 172.21.15.55:0/4186117762 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95080adb70 con 0x7f951815a300 2023-08-25T04:15:45.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.806+0000 7f951d1d2640 1 -- 172.21.15.55:0/4186117762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f951815a300 msgr2=0x7f951815e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:45.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.806+0000 7f951d1d2640 1 --2- 172.21.15.55:0/4186117762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f951815a300 0x7f951815e9a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f95080097c0 tx=0x7f950801c470 comp rx=0 tx=0).stop 2023-08-25T04:15:45.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.806+0000 7f951d1d2640 1 -- 172.21.15.55:0/4186117762 shutdown_connections 2023-08-25T04:15:45.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.806+0000 7f951d1d2640 1 --2- 172.21.15.55:0/4186117762 >> v2:172.21.15.110:3300/0 conn(0x7f95180b10d0 0x7f951806f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.806+0000 7f951d1d2640 1 --2- 172.21.15.55:0/4186117762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f951815a300 0x7f951815e9a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.806+0000 7f951d1d2640 1 -- 172.21.15.55:0/4186117762 >> 172.21.15.55:0/4186117762 conn(0x7f9518069f00 msgr2=0x7f95180afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:45.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.806+0000 7f951d1d2640 1 -- 172.21.15.55:0/4186117762 shutdown_connections 2023-08-25T04:15:45.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.806+0000 7f951d1d2640 1 -- 172.21.15.55:0/4186117762 wait complete. 2023-08-25T04:15:45.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f951d1d2640 1 Processor -- start 2023-08-25T04:15:45.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f951d1d2640 1 -- start start 2023-08-25T04:15:45.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f951d1d2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f951806fe20 0x7f951815ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:45.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f951d1d2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95180b10d0 0x7f951814dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:45.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f951d1d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f951815a300 0x7f9518151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:45.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f951d1d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951814e2a0 con 0x7f951815a300 2023-08-25T04:15:45.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f951d1d2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95180c7580 con 0x7f95180b10d0 2023-08-25T04:15:45.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f951d1d2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9518154ad0 con 0x7f951806fe20 2023-08-25T04:15:45.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f9517fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f951806fe20 0x7f951815ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:45.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f9517fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f951806fe20 0x7f951815ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:45702/0 (socket says 172.21.15.55:45702) 2023-08-25T04:15:45.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f9517fff640 1 -- 172.21.15.55:0/2175667583 learned_addr learned my addr 172.21.15.55:0/2175667583 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:45.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f95177fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95180b10d0 0x7f951814dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:45.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f951c9d1640 1 --2- 172.21.15.55:0/2175667583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f951815a300 0x7f9518151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:45.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f95177fe640 1 -- 172.21.15.55:0/2175667583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f951806fe20 msgr2=0x7f951815ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:45.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f95177fe640 1 --2- 172.21.15.55:0/2175667583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f951806fe20 0x7f951815ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f95177fe640 1 -- 172.21.15.55:0/2175667583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f951815a300 msgr2=0x7f9518151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:45.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f95177fe640 1 --2- 172.21.15.55:0/2175667583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f951815a300 0x7f9518151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f95177fe640 1 -- 172.21.15.55:0/2175667583 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9508009420 con 0x7f95180b10d0 2023-08-25T04:15:45.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f9517fff640 1 --2- 172.21.15.55:0/2175667583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f951806fe20 0x7f951815ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:15:45.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f95177fe640 1 --2- 172.21.15.55:0/2175667583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95180b10d0 0x7f951814dd60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f950c00b3c0 tx=0x7f950c00b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:45.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f9514ff9640 1 -- 172.21.15.55:0/2175667583 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c011830 con 0x7f95180b10d0 2023-08-25T04:15:45.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f9514ff9640 1 -- 172.21.15.55:0/2175667583 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c011990 con 0x7f95180b10d0 2023-08-25T04:15:45.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f9514ff9640 1 -- 172.21.15.55:0/2175667583 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c011d80 con 0x7f95180b10d0 2023-08-25T04:15:45.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f951d1d2640 1 -- 172.21.15.55:0/2175667583 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95180c6c50 con 0x7f95180b10d0 2023-08-25T04:15:45.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.810+0000 7f951d1d2640 1 -- 172.21.15.55:0/2175667583 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95180c7210 con 0x7f95180b10d0 2023-08-25T04:15:45.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.814+0000 7f951d1d2640 1 -- 172.21.15.55:0/2175667583 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9518071c30 con 0x7f95180b10d0 2023-08-25T04:15:45.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.814+0000 7f9514ff9640 1 -- 172.21.15.55:0/2175667583 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 14) v1 ==== 85133+0+0 (secure 0 0 0) 0x7f950c01b460 con 0x7f95180b10d0 2023-08-25T04:15:45.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.814+0000 7f9514ff9640 1 --2- 172.21.15.55:0/2175667583 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f9504065860 0x7f9504067d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:45.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.814+0000 7f9514ff9640 1 -- 172.21.15.55:0/2175667583 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 7441+0+0 (secure 0 0 0) 0x7f950c0833b0 con 0x7f95180b10d0 2023-08-25T04:15:45.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.814+0000 7f9517fff640 1 -- 172.21.15.55:0/2175667583 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f9504065860 msgr2=0x7f9504067d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3210220484 2023-08-25T04:15:45.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.814+0000 7f9517fff640 1 --2- 172.21.15.55:0/2175667583 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f9504065860 0x7f9504067d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:15:45.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.818+0000 7f9514ff9640 1 -- 172.21.15.55:0/2175667583 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f950c050690 con 0x7f95180b10d0 2023-08-25T04:15:45.854 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:45.852+0000 7f8ea0e0c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:15:45.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.990+0000 7f951d1d2640 1 -- 172.21.15.55:0/2175667583 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9518073e50 con 0x7f95180b10d0 2023-08-25T04:15:45.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.990+0000 7f9514ff9640 1 -- 172.21.15.55:0/2175667583 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+20471 (secure 0 0 0) 0x7f950c053cb0 con 0x7f95180b10d0 2023-08-25T04:15:45.989 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:45.989 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":49,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:15:45.559703+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:03:56.779789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:57.764926+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.26","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6833/413962747":"2023-08-26T04:04:16.252224+0000","172.21.15.110:6832/413962747":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/2576650460":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/3898418887":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/2105887625":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/3810476394":"2023-08-26T04:04:16.252224+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":10,"length":1},{"begin":21,"length":2},{"begin":33,"length":1},{"begin":43,"length":1},{"begin":54,"length":1},{"begin":64,"length":1},{"begin":75,"length":1},{"begin":86,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":210,"length":12}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":10,"length":1},{"begin":21,"length":2},{"begin":33,"length":1},{"begin":43,"length":1},{"begin":54,"length":1},{"begin":64,"length":1},{"begin":75,"length":1},{"begin":86,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":210,"length":12}]}],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1},{"begin":6,"length":1},{"begin":8,"length":1},{"begin":13,"length":1},{"begin":15,"length":1},{"begin":17,"length":1},{"begin":19,"length":1},{"begin":24,"length":1},{"begin":26,"length":1},{"begin":28,"length":1},{"begin":30,"length":1},{"begin":35,"length":1},{"begin":37,"length":1},{"begin":39,"length":1},{"begin":41,"length":1},{"begin":45,"length":1},{"begin":47,"length":1},{"begin":49,"length":1},{"begin":51,"length":2},{"begin":56,"length":1},{"begin":58,"length":1},{"begin":60,"length":1},{"begin":62,"length":1},{"begin":66,"length":1},{"begin":68,"length":1},{"begin":70,"length":1},{"begin":73,"length":1},{"begin":77,"length":1},{"begin":79,"length":1},{"begin":81,"length":2},{"begin":84,"length":1},{"begin":88,"length":1},{"begin":90,"length":1},{"begin":93,"length":1},{"begin":95,"length":1},{"begin":99,"length":1},{"begin":101,"length":1},{"begin":105,"length":1},{"begin":109,"length":1},{"begin":111,"length":1},{"begin":167,"length":43}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:15:45.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.994+0000 7f951d1d2640 1 -- 172.21.15.55:0/2175667583 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f9504065860 msgr2=0x7f9504067d20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:15:45.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.994+0000 7f951d1d2640 1 --2- 172.21.15.55:0/2175667583 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f9504065860 0x7f9504067d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.994+0000 7f951d1d2640 1 -- 172.21.15.55:0/2175667583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95180b10d0 msgr2=0x7f951814dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:45.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.994+0000 7f951d1d2640 1 --2- 172.21.15.55:0/2175667583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95180b10d0 0x7f951814dd60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f950c00b3c0 tx=0x7f950c00b880 comp rx=0 tx=0).stop 2023-08-25T04:15:45.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.994+0000 7f951d1d2640 1 -- 172.21.15.55:0/2175667583 shutdown_connections 2023-08-25T04:15:45.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.994+0000 7f951d1d2640 1 --2- 172.21.15.55:0/2175667583 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f9504065860 0x7f9504067d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.994+0000 7f951d1d2640 1 --2- 172.21.15.55:0/2175667583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f951815a300 0x7f9518151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.994+0000 7f951d1d2640 1 --2- 172.21.15.55:0/2175667583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95180b10d0 0x7f951814dd60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.994+0000 7f951d1d2640 1 --2- 172.21.15.55:0/2175667583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f951806fe20 0x7f951815ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:45.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.994+0000 7f951d1d2640 1 -- 172.21.15.55:0/2175667583 >> 172.21.15.55:0/2175667583 conn(0x7f9518069f00 msgr2=0x7f95180b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:45.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.994+0000 7f951d1d2640 1 -- 172.21.15.55:0/2175667583 shutdown_connections 2023-08-25T04:15:45.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:45.994+0000 7f951d1d2640 1 -- 172.21.15.55:0/2175667583 wait complete. 2023-08-25T04:15:46.019 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:03:56.779789+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:03:57.764926+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 221, 'snap_epoch': 49, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:15:46.020 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:15:46.025 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:46.026+0000 7f3fa61d4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:15:46.026 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:46.024+0000 7f8ea0e0c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:15:46.117 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:46.116+0000 7f8ea0e0c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:15:46.138 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:46.137+0000 7f3fa61d4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:15:46.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.189+0000 7f94dff67640 1 Processor -- start 2023-08-25T04:15:46.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.189+0000 7f94dff67640 1 -- start start 2023-08-25T04:15:46.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.193+0000 7f94dff67640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f94d815e3c0 0x7f94d815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:46.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.193+0000 7f94dff67640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d80cd5a0 con 0x7f94d80d1290 2023-08-25T04:15:46.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.193+0000 7f94dff67640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94d80cd880 con 0x7f94d81601f0 2023-08-25T04:15:46.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.193+0000 7f94dff67640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94d80cdb60 con 0x7f94d815e3c0 2023-08-25T04:15:46.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.193+0000 7f94de504640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f94d80d1290 0x7f94d815e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53582/0 (socket says 172.21.15.55:53582) 2023-08-25T04:15:46.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.193+0000 7f94de504640 1 -- 172.21.15.55:0/356456120 learned_addr learned my addr 172.21.15.55:0/356456120 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:46.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.193+0000 7f94dd502640 1 --2- 172.21.15.55:0/356456120 >> v2:172.21.15.110:3300/0 conn(0x7f94d815e3c0 0x7f94d815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:46.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.193+0000 7f94dcd01640 1 -- 172.21.15.55:0/356456120 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318562126 0 0) 0x7f94d80cd5a0 con 0x7f94d80d1290 2023-08-25T04:15:46.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.193+0000 7f94dcd01640 1 -- 172.21.15.55:0/356456120 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c4003530 con 0x7f94d80d1290 2023-08-25T04:15:46.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.193+0000 7f94dd502640 1 -- 172.21.15.55:0/356456120 >> v1:172.21.15.110:6789/0 conn(0x7f94d81601f0 legacy=0x7f94d80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:46.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.193+0000 7f94dd502640 1 -- 172.21.15.55:0/356456120 >> v1:172.21.15.55:6789/0 conn(0x7f94d80d1290 legacy=0x7f94d815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:46.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.193+0000 7f94dd502640 1 -- 172.21.15.55:0/356456120 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d80cde40 con 0x7f94d815e3c0 2023-08-25T04:15:46.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.197+0000 7f94dd502640 1 --2- 172.21.15.55:0/356456120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d815e3c0 0x7f94d815d430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f94c80097c0 tx=0x7f94c801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=688fb49942f632b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:46.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.197+0000 7f94dcd01640 1 -- 172.21.15.55:0/356456120 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c80ab600 con 0x7f94d815e3c0 2023-08-25T04:15:46.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.197+0000 7f94dcd01640 1 -- 172.21.15.55:0/356456120 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c80a7050 con 0x7f94d815e3c0 2023-08-25T04:15:46.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.197+0000 7f94dcd01640 1 -- 172.21.15.55:0/356456120 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c80ab960 con 0x7f94d815e3c0 2023-08-25T04:15:46.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.197+0000 7f94dff67640 1 -- 172.21.15.55:0/356456120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d815e3c0 msgr2=0x7f94d815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:46.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.197+0000 7f94dff67640 1 --2- 172.21.15.55:0/356456120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d815e3c0 0x7f94d815d430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f94c80097c0 tx=0x7f94c801c450 comp rx=0 tx=0).stop 2023-08-25T04:15:46.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.197+0000 7f94dff67640 1 -- 172.21.15.55:0/356456120 shutdown_connections 2023-08-25T04:15:46.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.197+0000 7f94dff67640 1 --2- 172.21.15.55:0/356456120 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d815e3c0 0x7f94d815d430 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.197+0000 7f94dff67640 1 -- 172.21.15.55:0/356456120 >> 172.21.15.55:0/356456120 conn(0x7f94d80d27d0 msgr2=0x7f94d80d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:46.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.197+0000 7f94dff67640 1 -- 172.21.15.55:0/356456120 shutdown_connections 2023-08-25T04:15:46.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.197+0000 7f94dff67640 1 -- 172.21.15.55:0/356456120 wait complete. 2023-08-25T04:15:46.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.197+0000 7f94dff67640 1 Processor -- start 2023-08-25T04:15:46.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.197+0000 7f94dff67640 1 -- start start 2023-08-25T04:15:46.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94dff67640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94d80d1290 0x7f94d80b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:46.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94dff67640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d815e3c0 0x7f94d80af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:46.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94dff67640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94d81601f0 0x7f94d80afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:46.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94dff67640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80b0060 con 0x7f94d80d1290 2023-08-25T04:15:46.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94dff67640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d80cc550 con 0x7f94d815e3c0 2023-08-25T04:15:46.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94dff67640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d8157b70 con 0x7f94d81601f0 2023-08-25T04:15:46.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94ddd03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94d80d1290 0x7f94d80b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:46.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94ddd03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94d80d1290 0x7f94d80b2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58374/0 (socket says 172.21.15.55:58374) 2023-08-25T04:15:46.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94ddd03640 1 -- 172.21.15.55:0/3961974637 learned_addr learned my addr 172.21.15.55:0/3961974637 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:46.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94dd502640 1 --2- 172.21.15.55:0/3961974637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d815e3c0 0x7f94d80af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:46.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94de504640 1 --2- 172.21.15.55:0/3961974637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94d81601f0 0x7f94d80afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:46.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94ddd03640 1 -- 172.21.15.55:0/3961974637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94d81601f0 msgr2=0x7f94d80afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:46.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94ddd03640 1 --2- 172.21.15.55:0/3961974637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94d81601f0 0x7f94d80afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94ddd03640 1 -- 172.21.15.55:0/3961974637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d815e3c0 msgr2=0x7f94d80af5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:46.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94ddd03640 1 --2- 172.21.15.55:0/3961974637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d815e3c0 0x7f94d80af5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94ddd03640 1 -- 172.21.15.55:0/3961974637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c8009420 con 0x7f94d80d1290 2023-08-25T04:15:46.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94ddd03640 1 --2- 172.21.15.55:0/3961974637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94d80d1290 0x7f94d80b2f40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c3c0 tx=0x7f94d400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:46.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94ce7fc640 1 -- 172.21.15.55:0/3961974637 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d40052d0 con 0x7f94d80d1290 2023-08-25T04:15:46.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94ce7fc640 1 -- 172.21.15.55:0/3961974637 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d4005470 con 0x7f94d80d1290 2023-08-25T04:15:46.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94ce7fc640 1 -- 172.21.15.55:0/3961974637 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4006a70 con 0x7f94d80d1290 2023-08-25T04:15:46.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94dff67640 1 -- 172.21.15.55:0/3961974637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d80cbe90 con 0x7f94d80d1290 2023-08-25T04:15:46.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94dff67640 1 -- 172.21.15.55:0/3961974637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d809c400 con 0x7f94d80d1290 2023-08-25T04:15:46.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.201+0000 7f94dff67640 1 -- 172.21.15.55:0/3961974637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d80b5260 con 0x7f94d80d1290 2023-08-25T04:15:46.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.205+0000 7f94ce7fc640 1 -- 172.21.15.55:0/3961974637 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 14) v1 ==== 85133+0+0 (secure 0 0 0) 0x7f94d4006bd0 con 0x7f94d80d1290 2023-08-25T04:15:46.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.205+0000 7f94ce7fc640 1 --2- 172.21.15.55:0/3961974637 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f94bc065830 0x7f94bc067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:46.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.205+0000 7f94ce7fc640 1 -- 172.21.15.55:0/3961974637 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 7441+0+0 (secure 0 0 0) 0x7f94d4082900 con 0x7f94d80d1290 2023-08-25T04:15:46.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.205+0000 7f94dd502640 1 -- 172.21.15.55:0/3961974637 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f94bc065830 msgr2=0x7f94bc067cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3210220484 2023-08-25T04:15:46.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.205+0000 7f94dd502640 1 --2- 172.21.15.55:0/3961974637 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f94bc065830 0x7f94bc067cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:15:46.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.209+0000 7f94ce7fc640 1 -- 172.21.15.55:0/3961974637 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f94d404fd20 con 0x7f94d80d1290 2023-08-25T04:15:46.301 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:46.301+0000 7f3fa61d4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:15:46.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.385+0000 7f94dff67640 1 -- 172.21.15.55:0/3961974637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94d8073ec0 con 0x7f94d80d1290 2023-08-25T04:15:46.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.385+0000 7f94ce7fc640 1 -- 172.21.15.55:0/3961974637 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94d4053340 con 0x7f94d80d1290 2023-08-25T04:15:46.386 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:15:46.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.389+0000 7f94dff67640 1 -- 172.21.15.55:0/3961974637 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f94bc065830 msgr2=0x7f94bc067cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:15:46.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.389+0000 7f94dff67640 1 --2- 172.21.15.55:0/3961974637 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f94bc065830 0x7f94bc067cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.389+0000 7f94dff67640 1 -- 172.21.15.55:0/3961974637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94d80d1290 msgr2=0x7f94d80b2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:46.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.389+0000 7f94dff67640 1 --2- 172.21.15.55:0/3961974637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94d80d1290 0x7f94d80b2f40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c3c0 tx=0x7f94d400c880 comp rx=0 tx=0).stop 2023-08-25T04:15:46.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.389+0000 7f94dff67640 1 -- 172.21.15.55:0/3961974637 shutdown_connections 2023-08-25T04:15:46.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.389+0000 7f94dff67640 1 --2- 172.21.15.55:0/3961974637 >> [v2:172.21.15.110:6832/3210220484,v1:172.21.15.110:6833/3210220484] conn(0x7f94bc065830 0x7f94bc067cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.389+0000 7f94dff67640 1 --2- 172.21.15.55:0/3961974637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94d81601f0 0x7f94d80afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.389+0000 7f94dff67640 1 --2- 172.21.15.55:0/3961974637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94d815e3c0 0x7f94d80af5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.389+0000 7f94dff67640 1 --2- 172.21.15.55:0/3961974637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94d80d1290 0x7f94d80b2f40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.389+0000 7f94dff67640 1 -- 172.21.15.55:0/3961974637 >> 172.21.15.55:0/3961974637 conn(0x7f94d80d27d0 msgr2=0x7f94d80cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:46.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.389+0000 7f94dff67640 1 -- 172.21.15.55:0/3961974637 shutdown_connections 2023-08-25T04:15:46.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.389+0000 7f94dff67640 1 -- 172.21.15.55:0/3961974637 wait complete. 2023-08-25T04:15:46.404 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:46.405+0000 7f3fa61d4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:15:46.406 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:15:46.465 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:46.464+0000 7f8ea0e0c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:15:46.526 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:46.524+0000 7f8ea0e0c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:15:46.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.561+0000 7f4b29e56640 1 Processor -- start 2023-08-25T04:15:46.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.561+0000 7f4b29e56640 1 -- start start 2023-08-25T04:15:46.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.561+0000 7f4b29e56640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b241601f0 0x7f4b2415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:46.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.561+0000 7f4b29e56640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b240d1290 0x7f4b2415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:46.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.561+0000 7f4b29e56640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b240cd5a0 con 0x7f4b2415e3c0 2023-08-25T04:15:46.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.561+0000 7f4b29e56640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b240cd880 con 0x7f4b241601f0 2023-08-25T04:15:46.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.561+0000 7f4b29e56640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240cdb60 con 0x7f4b240d1290 2023-08-25T04:15:46.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.565+0000 7f4b22ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4b2415e3c0 0x7f4b240d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53592/0 (socket says 172.21.15.55:53592) 2023-08-25T04:15:46.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.565+0000 7f4b22ffd640 1 -- 172.21.15.55:0/2327790052 learned_addr learned my addr 172.21.15.55:0/2327790052 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:46.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.565+0000 7f4b23fff640 1 --2- 172.21.15.55:0/2327790052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b240d1290 0x7f4b2415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:46.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.561+0000 7f4b237fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b241601f0 0x7f4b2415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:46.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.565+0000 7f4b237fe640 1 -- 172.21.15.55:0/2327790052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b240d1290 msgr2=0x7f4b2415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:46.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.565+0000 7f4b237fe640 1 --2- 172.21.15.55:0/2327790052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b240d1290 0x7f4b2415e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.565+0000 7f4b227fc640 1 -- 172.21.15.55:0/2327790052 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902509362 0 0) 0x7f4b240cd5a0 con 0x7f4b2415e3c0 2023-08-25T04:15:46.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.565+0000 7f4b237fe640 1 -- 172.21.15.55:0/2327790052 >> v1:172.21.15.55:6789/0 conn(0x7f4b2415e3c0 legacy=0x7f4b240d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:46.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.565+0000 7f4b237fe640 1 -- 172.21.15.55:0/2327790052 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b240cde40 con 0x7f4b241601f0 2023-08-25T04:15:46.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.565+0000 7f4b23fff640 1 --2- 172.21.15.55:0/2327790052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b240d1290 0x7f4b2415e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:15:46.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.565+0000 7f4b237fe640 1 --2- 172.21.15.55:0/2327790052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b241601f0 0x7f4b2415d430 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4b140097a0 tx=0x7f4b1401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea0e03dad41f396 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:46.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.565+0000 7f4b227fc640 1 -- 172.21.15.55:0/2327790052 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b140a8950 con 0x7f4b241601f0 2023-08-25T04:15:46.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.565+0000 7f4b227fc640 1 -- 172.21.15.55:0/2327790052 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b140a8ab0 con 0x7f4b241601f0 2023-08-25T04:15:46.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.565+0000 7f4b227fc640 1 -- 172.21.15.55:0/2327790052 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b140a8e40 con 0x7f4b241601f0 2023-08-25T04:15:46.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b29e56640 1 -- 172.21.15.55:0/2327790052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b241601f0 msgr2=0x7f4b2415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:46.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b29e56640 1 --2- 172.21.15.55:0/2327790052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b241601f0 0x7f4b2415d430 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4b140097a0 tx=0x7f4b1401ec50 comp rx=0 tx=0).stop 2023-08-25T04:15:46.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b29e56640 1 -- 172.21.15.55:0/2327790052 shutdown_connections 2023-08-25T04:15:46.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b29e56640 1 --2- 172.21.15.55:0/2327790052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b240d1290 0x7f4b2415e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b29e56640 1 --2- 172.21.15.55:0/2327790052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b241601f0 0x7f4b2415d430 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b29e56640 1 -- 172.21.15.55:0/2327790052 >> 172.21.15.55:0/2327790052 conn(0x7f4b240d27d0 msgr2=0x7f4b240d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:46.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b29e56640 1 -- 172.21.15.55:0/2327790052 shutdown_connections 2023-08-25T04:15:46.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b29e56640 1 -- 172.21.15.55:0/2327790052 wait complete. 2023-08-25T04:15:46.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b29e56640 1 Processor -- start 2023-08-25T04:15:46.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b29e56640 1 -- start start 2023-08-25T04:15:46.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b29e56640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b240d1290 0x7f4b241f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:46.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b29e56640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b2415e3c0 0x7f4b2406b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:46.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b29e56640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b241601f0 0x7f4b2406bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:46.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b29e56640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2415b320 con 0x7f4b240d1290 2023-08-25T04:15:46.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b29e56640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240cb330 con 0x7f4b241601f0 2023-08-25T04:15:46.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b29e56640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b240c8f40 con 0x7f4b2415e3c0 2023-08-25T04:15:46.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b237fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b240d1290 0x7f4b241f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:46.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b237fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b240d1290 0x7f4b241f19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58394/0 (socket says 172.21.15.55:58394) 2023-08-25T04:15:46.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b237fe640 1 -- 172.21.15.55:0/4101206980 learned_addr learned my addr 172.21.15.55:0/4101206980 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:46.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b22ffd640 1 --2- 172.21.15.55:0/4101206980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b2415e3c0 0x7f4b2406b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:46.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.569+0000 7f4b23fff640 1 --2- 172.21.15.55:0/4101206980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b241601f0 0x7f4b2406bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:46.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.573+0000 7f4b237fe640 1 -- 172.21.15.55:0/4101206980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b2415e3c0 msgr2=0x7f4b2406b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:46.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.573+0000 7f4b237fe640 1 --2- 172.21.15.55:0/4101206980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b2415e3c0 0x7f4b2406b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.573+0000 7f4b237fe640 1 -- 172.21.15.55:0/4101206980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b241601f0 msgr2=0x7f4b2406bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:46.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.573+0000 7f4b237fe640 1 --2- 172.21.15.55:0/4101206980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b241601f0 0x7f4b2406bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.573+0000 7f4b237fe640 1 -- 172.21.15.55:0/4101206980 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c009a70 con 0x7f4b240d1290 2023-08-25T04:15:46.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.573+0000 7f4b23fff640 1 --2- 172.21.15.55:0/4101206980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b241601f0 0x7f4b2406bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:46.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.573+0000 7f4b237fe640 1 --2- 172.21.15.55:0/4101206980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b240d1290 0x7f4b241f19c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4b140b3040 tx=0x7f4b1401b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:46.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.573+0000 7f4b0bfff640 1 -- 172.21.15.55:0/4101206980 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b140b0dd0 con 0x7f4b240d1290 2023-08-25T04:15:46.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.573+0000 7f4b0bfff640 1 -- 172.21.15.55:0/4101206980 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b140b9430 con 0x7f4b240d1290 2023-08-25T04:15:46.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.573+0000 7f4b0bfff640 1 -- 172.21.15.55:0/4101206980 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b140b97e0 con 0x7f4b240d1290 2023-08-25T04:15:46.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.573+0000 7f4b29e56640 1 -- 172.21.15.55:0/4101206980 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b140093b0 con 0x7f4b240d1290 2023-08-25T04:15:46.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.573+0000 7f4b29e56640 1 -- 172.21.15.55:0/4101206980 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b240cace0 con 0x7f4b240d1290 2023-08-25T04:15:46.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.573+0000 7f4b29e56640 1 -- 172.21.15.55:0/4101206980 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b240b5260 con 0x7f4b240d1290 2023-08-25T04:15:46.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.573+0000 7f4b0bfff640 1 -- 172.21.15.55:0/4101206980 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 15) v1 ==== 84673+0+0 (secure 0 0 0) 0x7f4b140b7040 con 0x7f4b240d1290 2023-08-25T04:15:46.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.577+0000 7f4b0bfff640 1 -- 172.21.15.55:0/4101206980 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6940+0+0 (secure 0 0 0) 0x7f4b141203e0 con 0x7f4b240d1290 2023-08-25T04:15:46.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.581+0000 7f4b0bfff640 1 -- 172.21.15.55:0/4101206980 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4b140edf80 con 0x7f4b240d1290 2023-08-25T04:15:46.600 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:46.596+0000 7f8e2cc45640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:15:46.600 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:46.596+0000 7f8e2cc45640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:15:46.601 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:46.596+0000 7f8e2cc45640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:15:46.601 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:46.596+0000 7f8e2cc45640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:15:46.601 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:46.596+0000 7f8e2a440640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:15:46.602 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:46.596+0000 7f8e2a440640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:15:46.602 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:46.596+0000 7f8e2a440640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:15:46.602 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:46.596+0000 7f8e2a440640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:15:46.602 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:46.596+0000 7f8e2a440640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:15:46.603 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:15:46.596+0000 7f8e2cc45640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:15:46.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.741+0000 7f4b29e56640 1 -- 172.21.15.55:0/4101206980 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4b24073ec0 con 0x7f4b240d1290 2023-08-25T04:15:46.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.745+0000 7f4b0bfff640 1 -- 172.21.15.55:0/4101206980 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4b140f15a0 con 0x7f4b240d1290 2023-08-25T04:15:46.744 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:15:46.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.745+0000 7f4b29e56640 1 -- 172.21.15.55:0/4101206980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b240d1290 msgr2=0x7f4b241f19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:46.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.745+0000 7f4b29e56640 1 --2- 172.21.15.55:0/4101206980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b240d1290 0x7f4b241f19c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4b140b3040 tx=0x7f4b1401b9f0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.745+0000 7f4b29e56640 1 -- 172.21.15.55:0/4101206980 shutdown_connections 2023-08-25T04:15:46.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.745+0000 7f4b29e56640 1 --2- 172.21.15.55:0/4101206980 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b241601f0 0x7f4b2406bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.745+0000 7f4b29e56640 1 --2- 172.21.15.55:0/4101206980 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b2415e3c0 0x7f4b2406b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.745+0000 7f4b29e56640 1 --2- 172.21.15.55:0/4101206980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b240d1290 0x7f4b241f19c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.745+0000 7f4b29e56640 1 -- 172.21.15.55:0/4101206980 >> 172.21.15.55:0/4101206980 conn(0x7f4b240d27d0 msgr2=0x7f4b2415dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:46.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.745+0000 7f4b29e56640 1 -- 172.21.15.55:0/4101206980 shutdown_connections 2023-08-25T04:15:46.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.745+0000 7f4b29e56640 1 -- 172.21.15.55:0/4101206980 wait complete. 2023-08-25T04:15:46.757 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:46.757+0000 7f3fa61d4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:15:46.765 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:15:46.824 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:15:46.825+0000 7f3fa61d4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:15:46.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.913+0000 7fbe0f434640 1 Processor -- start 2023-08-25T04:15:46.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.913+0000 7fbe0f434640 1 -- start start 2023-08-25T04:15:46.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.913+0000 7fbe0f434640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbe080b11c0 0x7fbe080ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:46.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.913+0000 7fbe0f434640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0806cd40 con 0x7fbe0815cba0 2023-08-25T04:15:46.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.913+0000 7fbe0f434640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0806be90 con 0x7fbe0806dc80 2023-08-25T04:15:46.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.913+0000 7fbe0f434640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0806c130 con 0x7fbe080b11c0 2023-08-25T04:15:46.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.917+0000 7fbe0d9d1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbe080b11c0 0x7fbe080ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:46.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.917+0000 7fbe0d9d1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbe080b11c0 0x7fbe080ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58402/0 (socket says 172.21.15.55:58402) 2023-08-25T04:15:46.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.917+0000 7fbe0d9d1640 1 -- 172.21.15.55:0/1147550280 learned_addr learned my addr 172.21.15.55:0/1147550280 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.917+0000 7fbe0d9d1640 1 -- 172.21.15.55:0/1147550280 >> v1:172.21.15.110:6789/0 conn(0x7fbe0806dc80 legacy=0x7fbe08069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.917+0000 7fbe0d9d1640 1 -- 172.21.15.55:0/1147550280 >> v1:172.21.15.55:6789/0 conn(0x7fbe0815cba0 legacy=0x7fbe0806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.917+0000 7fbe0d9d1640 1 -- 172.21.15.55:0/1147550280 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0806c410 con 0x7fbe080b11c0 2023-08-25T04:15:46.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.917+0000 7fbdfffff640 1 -- 172.21.15.55:0/1147550280 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242710112 0 0) 0x7fbe0806cd40 con 0x7fbe0815cba0 2023-08-25T04:15:46.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.917+0000 7fbe0d9d1640 1 --2- 172.21.15.55:0/1147550280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe080b11c0 0x7fbe080ce600 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009e50 tx=0x7fbe0001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a24755b96cb54c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:46.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.917+0000 7fbdfffff640 1 -- 172.21.15.55:0/1147550280 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe000a58e0 con 0x7fbe080b11c0 2023-08-25T04:15:46.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.917+0000 7fbdfffff640 1 -- 172.21.15.55:0/1147550280 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe000a5a40 con 0x7fbe080b11c0 2023-08-25T04:15:46.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.917+0000 7fbdfffff640 1 -- 172.21.15.55:0/1147550280 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe000a5dd0 con 0x7fbe080b11c0 2023-08-25T04:15:46.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0f434640 1 -- 172.21.15.55:0/1147550280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe080b11c0 msgr2=0x7fbe080ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:46.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0f434640 1 --2- 172.21.15.55:0/1147550280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe080b11c0 0x7fbe080ce600 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fbe00009e50 tx=0x7fbe0001ca10 comp rx=0 tx=0).stop 2023-08-25T04:15:46.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0f434640 1 -- 172.21.15.55:0/1147550280 shutdown_connections 2023-08-25T04:15:46.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0f434640 1 --2- 172.21.15.55:0/1147550280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe080b11c0 0x7fbe080ce600 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0f434640 1 -- 172.21.15.55:0/1147550280 >> 172.21.15.55:0/1147550280 conn(0x7fbe080b06a0 msgr2=0x7fbe080b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:46.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0f434640 1 -- 172.21.15.55:0/1147550280 shutdown_connections 2023-08-25T04:15:46.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0f434640 1 -- 172.21.15.55:0/1147550280 wait complete. 2023-08-25T04:15:46.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0f434640 1 Processor -- start 2023-08-25T04:15:46.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0f434640 1 -- start start 2023-08-25T04:15:46.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0f434640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe0806dc80 0x7fbe0815d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:46.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0f434640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe080b11c0 0x7fbe0815d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:46.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0f434640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe0815cba0 0x7fbe0815bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:46.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0f434640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe08159cf0 con 0x7fbe080b11c0 2023-08-25T04:15:46.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0f434640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0815aa90 con 0x7fbe0815cba0 2023-08-25T04:15:46.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0f434640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0815ad70 con 0x7fbe0806dc80 2023-08-25T04:15:46.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0c9cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe080b11c0 0x7fbe0815d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:46.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0c9cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe080b11c0 0x7fbe0815d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58412/0 (socket says 172.21.15.55:58412) 2023-08-25T04:15:46.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0c9cf640 1 -- 172.21.15.55:0/593508623 learned_addr learned my addr 172.21.15.55:0/593508623 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:46.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0d1d0640 1 --2- 172.21.15.55:0/593508623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe0806dc80 0x7fbe0815d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:46.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0d9d1640 1 --2- 172.21.15.55:0/593508623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe0815cba0 0x7fbe0815bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:46.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0c9cf640 1 -- 172.21.15.55:0/593508623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe0806dc80 msgr2=0x7fbe0815d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:46.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0c9cf640 1 --2- 172.21.15.55:0/593508623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe0806dc80 0x7fbe0815d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0c9cf640 1 -- 172.21.15.55:0/593508623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe0815cba0 msgr2=0x7fbe0815bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:46.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0c9cf640 1 --2- 172.21.15.55:0/593508623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe0815cba0 0x7fbe0815bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:46.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.921+0000 7fbe0c9cf640 1 -- 172.21.15.55:0/593508623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe00009b30 con 0x7fbe080b11c0 2023-08-25T04:15:46.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.925+0000 7fbe0c9cf640 1 --2- 172.21.15.55:0/593508623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe080b11c0 0x7fbe0815d5e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800c500 tx=0x7fbdf800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:46.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.925+0000 7fbdfdffb640 1 -- 172.21.15.55:0/593508623 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8005220 con 0x7fbe080b11c0 2023-08-25T04:15:46.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.925+0000 7fbdfdffb640 1 -- 172.21.15.55:0/593508623 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf8005380 con 0x7fbe080b11c0 2023-08-25T04:15:46.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.925+0000 7fbe0f434640 1 -- 172.21.15.55:0/593508623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0815b050 con 0x7fbe080b11c0 2023-08-25T04:15:46.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.925+0000 7fbdfdffb640 1 -- 172.21.15.55:0/593508623 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8007270 con 0x7fbe080b11c0 2023-08-25T04:15:46.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.925+0000 7fbe0f434640 1 -- 172.21.15.55:0/593508623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0815b610 con 0x7fbe080b11c0 2023-08-25T04:15:46.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.925+0000 7fbe0f434640 1 -- 172.21.15.55:0/593508623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0815b800 con 0x7fbe080b11c0 2023-08-25T04:15:46.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.925+0000 7fbdfdffb640 1 -- 172.21.15.55:0/593508623 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 15) v1 ==== 84673+0+0 (secure 0 0 0) 0x7fbdf80073d0 con 0x7fbe080b11c0 2023-08-25T04:15:46.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.925+0000 7fbdfdffb640 1 -- 172.21.15.55:0/593508623 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6940+0+0 (secure 0 0 0) 0x7fbdf8082460 con 0x7fbe080b11c0 2023-08-25T04:15:46.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:46.929+0000 7fbdfdffb640 1 -- 172.21.15.55:0/593508623 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbdf8050030 con 0x7fbe080b11c0 2023-08-25T04:15:47.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.085+0000 7fbe0f434640 1 -- 172.21.15.55:0/593508623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbe08073ec0 con 0x7fbe080b11c0 2023-08-25T04:15:47.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.085+0000 7fbdfdffb640 1 -- 172.21.15.55:0/593508623 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbdf8053650 con 0x7fbe080b11c0 2023-08-25T04:15:47.087 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:15:47.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.089+0000 7fbe0f434640 1 -- 172.21.15.55:0/593508623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe080b11c0 msgr2=0x7fbe0815d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:47.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.089+0000 7fbe0f434640 1 --2- 172.21.15.55:0/593508623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe080b11c0 0x7fbe0815d5e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800c500 tx=0x7fbdf800c9c0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.089+0000 7fbe0f434640 1 -- 172.21.15.55:0/593508623 shutdown_connections 2023-08-25T04:15:47.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.089+0000 7fbe0f434640 1 --2- 172.21.15.55:0/593508623 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe0815cba0 0x7fbe0815bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.089+0000 7fbe0f434640 1 --2- 172.21.15.55:0/593508623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe080b11c0 0x7fbe0815d5e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.089+0000 7fbe0f434640 1 --2- 172.21.15.55:0/593508623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe0806dc80 0x7fbe0815d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.089+0000 7fbe0f434640 1 -- 172.21.15.55:0/593508623 >> 172.21.15.55:0/593508623 conn(0x7fbe080b06a0 msgr2=0x7fbe080c6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:47.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.089+0000 7fbe0f434640 1 -- 172.21.15.55:0/593508623 shutdown_connections 2023-08-25T04:15:47.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.089+0000 7fbe0f434640 1 -- 172.21.15.55:0/593508623 wait complete. 2023-08-25T04:15:47.107 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:15:47.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.253+0000 7fcc9309e640 1 Processor -- start 2023-08-25T04:15:47.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.253+0000 7fcc9309e640 1 -- start start 2023-08-25T04:15:47.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.253+0000 7fcc9309e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc8c0cfc90 0x7fcc8c0b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:47.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.253+0000 7fcc9309e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcc8c0b8330 0x7fcc8c0b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:47.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.253+0000 7fcc9309e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8c0b70c0 con 0x7fcc8c15fca0 2023-08-25T04:15:47.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.253+0000 7fcc9309e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8c160080 con 0x7fcc8c0b8330 2023-08-25T04:15:47.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.253+0000 7fcc9309e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c0b73a0 con 0x7fcc8c0cfc90 2023-08-25T04:15:47.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.257+0000 7fcc9209c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcc8c15fca0 0x7fcc8c0cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53604/0 (socket says 172.21.15.55:53604) 2023-08-25T04:15:47.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.257+0000 7fcc9209c640 1 -- 172.21.15.55:0/2081207853 learned_addr learned my addr 172.21.15.55:0/2081207853 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:47.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.257+0000 7fcc9189b640 1 --2- 172.21.15.55:0/2081207853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc8c0cfc90 0x7fcc8c0b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:47.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.257+0000 7fcc9289d640 1 --2- 172.21.15.55:0/2081207853 >> v2:172.21.15.110:3300/0 conn(0x7fcc8c0b8330 0x7fcc8c0b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:47.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.257+0000 7fcc9109a640 1 -- 172.21.15.55:0/2081207853 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120145725 0 0) 0x7fcc8c0b70c0 con 0x7fcc8c15fca0 2023-08-25T04:15:47.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.257+0000 7fcc9109a640 1 -- 172.21.15.55:0/2081207853 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc78003530 con 0x7fcc8c15fca0 2023-08-25T04:15:47.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.257+0000 7fcc9189b640 1 -- 172.21.15.55:0/2081207853 >> v2:172.21.15.110:3300/0 conn(0x7fcc8c0b8330 msgr2=0x7fcc8c0b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:47.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.257+0000 7fcc9189b640 1 --2- 172.21.15.55:0/2081207853 >> v2:172.21.15.110:3300/0 conn(0x7fcc8c0b8330 0x7fcc8c0b5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.257+0000 7fcc9189b640 1 -- 172.21.15.55:0/2081207853 >> v1:172.21.15.55:6789/0 conn(0x7fcc8c15fca0 legacy=0x7fcc8c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:47.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.257+0000 7fcc9109a640 1 -- 172.21.15.55:0/2081207853 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 957836124 0 0) 0x7fcc78003530 con 0x7fcc8c15fca0 2023-08-25T04:15:47.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.257+0000 7fcc9189b640 1 -- 172.21.15.55:0/2081207853 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c0b7680 con 0x7fcc8c0cfc90 2023-08-25T04:15:47.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.257+0000 7fcc9189b640 1 --2- 172.21.15.55:0/2081207853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc8c0cfc90 0x7fcc8c0b55d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0097c0 tx=0x7fcc7c01eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ffe78bef75a0d46 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:47.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9109a640 1 -- 172.21.15.55:0/2081207853 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc88001680 con 0x7fcc8c0cfc90 2023-08-25T04:15:47.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9109a640 1 -- 172.21.15.55:0/2081207853 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c0a85d0 con 0x7fcc8c0cfc90 2023-08-25T04:15:47.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9109a640 1 -- 172.21.15.55:0/2081207853 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0a8960 con 0x7fcc8c0cfc90 2023-08-25T04:15:47.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9309e640 1 -- 172.21.15.55:0/2081207853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc8c0cfc90 msgr2=0x7fcc8c0b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:47.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9309e640 1 --2- 172.21.15.55:0/2081207853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc8c0cfc90 0x7fcc8c0b55d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0097c0 tx=0x7fcc7c01eb90 comp rx=0 tx=0).stop 2023-08-25T04:15:47.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9309e640 1 -- 172.21.15.55:0/2081207853 shutdown_connections 2023-08-25T04:15:47.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9309e640 1 --2- 172.21.15.55:0/2081207853 >> v2:172.21.15.110:3300/0 conn(0x7fcc8c0b8330 0x7fcc8c0b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9309e640 1 --2- 172.21.15.55:0/2081207853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc8c0cfc90 0x7fcc8c0b55d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9309e640 1 -- 172.21.15.55:0/2081207853 >> 172.21.15.55:0/2081207853 conn(0x7fcc8c0658c0 msgr2=0x7fcc8c065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:47.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9309e640 1 -- 172.21.15.55:0/2081207853 shutdown_connections 2023-08-25T04:15:47.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9309e640 1 -- 172.21.15.55:0/2081207853 wait complete. 2023-08-25T04:15:47.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9309e640 1 Processor -- start 2023-08-25T04:15:47.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9309e640 1 -- start start 2023-08-25T04:15:47.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9309e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc8c0b8330 0x7fcc8c0b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:47.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9309e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc8c0cfc90 0x7fcc8c15a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:47.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9309e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc8c15fca0 0x7fcc8c0c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:47.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9309e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c1f27b0 con 0x7fcc8c0b8330 2023-08-25T04:15:47.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9309e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c15aaf0 con 0x7fcc8c15fca0 2023-08-25T04:15:47.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9309e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c1f1ec0 con 0x7fcc8c0cfc90 2023-08-25T04:15:47.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.261+0000 7fcc9209c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc8c0b8330 0x7fcc8c0b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:47.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.265+0000 7fcc9209c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc8c0b8330 0x7fcc8c0b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58414/0 (socket says 172.21.15.55:58414) 2023-08-25T04:15:47.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.265+0000 7fcc9209c640 1 -- 172.21.15.55:0/1556969182 learned_addr learned my addr 172.21.15.55:0/1556969182 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:47.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.265+0000 7fcc9189b640 1 --2- 172.21.15.55:0/1556969182 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc8c0cfc90 0x7fcc8c15a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:47.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.265+0000 7fcc9289d640 1 --2- 172.21.15.55:0/1556969182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc8c15fca0 0x7fcc8c0c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:47.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.265+0000 7fcc9189b640 1 -- 172.21.15.55:0/1556969182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc8c15fca0 msgr2=0x7fcc8c0c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:47.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.265+0000 7fcc9189b640 1 --2- 172.21.15.55:0/1556969182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc8c15fca0 0x7fcc8c0c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.265+0000 7fcc9189b640 1 -- 172.21.15.55:0/1556969182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc8c0b8330 msgr2=0x7fcc8c0b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:47.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.265+0000 7fcc9189b640 1 --2- 172.21.15.55:0/1556969182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc8c0b8330 0x7fcc8c0b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.265+0000 7fcc9189b640 1 -- 172.21.15.55:0/1556969182 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c009420 con 0x7fcc8c0cfc90 2023-08-25T04:15:47.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.265+0000 7fcc9209c640 1 --2- 172.21.15.55:0/1556969182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc8c0b8330 0x7fcc8c0b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:15:47.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.265+0000 7fcc9189b640 1 --2- 172.21.15.55:0/1556969182 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc8c0cfc90 0x7fcc8c15a010 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0af000 tx=0x7fcc7c01b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:47.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.265+0000 7fcc82ffd640 1 -- 172.21.15.55:0/1556969182 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0b0850 con 0x7fcc8c0cfc90 2023-08-25T04:15:47.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.265+0000 7fcc82ffd640 1 -- 172.21.15.55:0/1556969182 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c0b09b0 con 0x7fcc8c0cfc90 2023-08-25T04:15:47.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.265+0000 7fcc82ffd640 1 -- 172.21.15.55:0/1556969182 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0b0d60 con 0x7fcc8c0cfc90 2023-08-25T04:15:47.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.265+0000 7fcc9309e640 1 -- 172.21.15.55:0/1556969182 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8c1f2c40 con 0x7fcc8c0cfc90 2023-08-25T04:15:47.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.265+0000 7fcc9309e640 1 -- 172.21.15.55:0/1556969182 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8c1f2440 con 0x7fcc8c0cfc90 2023-08-25T04:15:47.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.265+0000 7fcc9309e640 1 -- 172.21.15.55:0/1556969182 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8c1f2920 con 0x7fcc8c0cfc90 2023-08-25T04:15:47.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.265+0000 7fcc82ffd640 1 -- 172.21.15.55:0/1556969182 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 15) v1 ==== 84673+0+0 (secure 0 0 0) 0x7fcc7c0b7040 con 0x7fcc8c0cfc90 2023-08-25T04:15:47.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.269+0000 7fcc82ffd640 1 -- 172.21.15.55:0/1556969182 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6940+0+0 (secure 0 0 0) 0x7fcc7c120110 con 0x7fcc8c0cfc90 2023-08-25T04:15:47.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.273+0000 7fcc82ffd640 1 -- 172.21.15.55:0/1556969182 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fcc7c0edc70 con 0x7fcc8c0cfc90 2023-08-25T04:15:47.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.429+0000 7fcc9309e640 1 -- 172.21.15.55:0/1556969182 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc8c073e50 con 0x7fcc8c0cfc90 2023-08-25T04:15:47.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.429+0000 7fcc82ffd640 1 -- 172.21.15.55:0/1556969182 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc7c006e20 con 0x7fcc8c0cfc90 2023-08-25T04:15:47.429 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:15:47.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.429+0000 7fcc9309e640 1 -- 172.21.15.55:0/1556969182 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc8c0cfc90 msgr2=0x7fcc8c15a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.429+0000 7fcc9309e640 1 --2- 172.21.15.55:0/1556969182 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc8c0cfc90 0x7fcc8c15a010 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0af000 tx=0x7fcc7c01b930 comp rx=0 tx=0).stop 2023-08-25T04:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.429+0000 7fcc9309e640 1 -- 172.21.15.55:0/1556969182 shutdown_connections 2023-08-25T04:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.429+0000 7fcc9309e640 1 --2- 172.21.15.55:0/1556969182 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc8c15fca0 0x7fcc8c0c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.429+0000 7fcc9309e640 1 --2- 172.21.15.55:0/1556969182 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc8c0cfc90 0x7fcc8c15a010 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.429+0000 7fcc9309e640 1 --2- 172.21.15.55:0/1556969182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc8c0b8330 0x7fcc8c0b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.429+0000 7fcc9309e640 1 -- 172.21.15.55:0/1556969182 >> 172.21.15.55:0/1556969182 conn(0x7fcc8c0658c0 msgr2=0x7fcc8c15d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.429+0000 7fcc9309e640 1 -- 172.21.15.55:0/1556969182 shutdown_connections 2023-08-25T04:15:47.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.429+0000 7fcc9309e640 1 -- 172.21.15.55:0/1556969182 wait complete. 2023-08-25T04:15:47.450 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:15:47.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.597+0000 7fb67af66640 1 Processor -- start 2023-08-25T04:15:47.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.597+0000 7fb67af66640 1 -- start start 2023-08-25T04:15:47.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.597+0000 7fb67af66640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6740cdde0 0x7fb6740ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:47.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.597+0000 7fb67af66640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6740b29b0 con 0x7fb6740b2e40 2023-08-25T04:15:47.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.597+0000 7fb67af66640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6740b1dc0 con 0x7fb6740d0da0 2023-08-25T04:15:47.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.597+0000 7fb67af66640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6740ce760 con 0x7fb6740cdde0 2023-08-25T04:15:47.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.597+0000 7fb679503640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb6740b2e40 0x7fb6740b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53614/0 (socket says 172.21.15.55:53614) 2023-08-25T04:15:47.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.597+0000 7fb679503640 1 -- 172.21.15.55:0/106264378 learned_addr learned my addr 172.21.15.55:0/106264378 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:47.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.597+0000 7fb66bfff640 1 --2- 172.21.15.55:0/106264378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6740cdde0 0x7fb6740ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:47.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.597+0000 7fb66b7fe640 1 -- 172.21.15.55:0/106264378 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844410447 0 0) 0x7fb6740b29b0 con 0x7fb6740b2e40 2023-08-25T04:15:47.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.601+0000 7fb66b7fe640 1 -- 172.21.15.55:0/106264378 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb65c003530 con 0x7fb6740b2e40 2023-08-25T04:15:47.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.601+0000 7fb66b7fe640 1 -- 172.21.15.55:0/106264378 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885640659 0 0) 0x7fb6740b1dc0 con 0x7fb6740d0da0 2023-08-25T04:15:47.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.601+0000 7fb66b7fe640 1 -- 172.21.15.55:0/106264378 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6740b29b0 con 0x7fb6740d0da0 2023-08-25T04:15:47.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.601+0000 7fb66bfff640 1 -- 172.21.15.55:0/106264378 >> v1:172.21.15.110:6789/0 conn(0x7fb6740d0da0 legacy=0x7fb6740d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:47.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.601+0000 7fb66bfff640 1 -- 172.21.15.55:0/106264378 >> v1:172.21.15.55:6789/0 conn(0x7fb6740b2e40 legacy=0x7fb6740b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:47.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.601+0000 7fb66bfff640 1 -- 172.21.15.55:0/106264378 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6740b2080 con 0x7fb6740cdde0 2023-08-25T04:15:47.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.601+0000 7fb66bfff640 1 --2- 172.21.15.55:0/106264378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6740cdde0 0x7fb6740ce220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb6640097f0 tx=0x7fb66401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7ef375a747d0fb4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:47.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.601+0000 7fb66b7fe640 1 -- 172.21.15.55:0/106264378 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640a89b0 con 0x7fb6740cdde0 2023-08-25T04:15:47.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.601+0000 7fb66b7fe640 1 -- 172.21.15.55:0/106264378 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6640a8b10 con 0x7fb6740cdde0 2023-08-25T04:15:47.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.601+0000 7fb66b7fe640 1 -- 172.21.15.55:0/106264378 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640a8ea0 con 0x7fb6740cdde0 2023-08-25T04:15:47.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb67af66640 1 -- 172.21.15.55:0/106264378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6740cdde0 msgr2=0x7fb6740ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:47.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb67af66640 1 --2- 172.21.15.55:0/106264378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6740cdde0 0x7fb6740ce220 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb6640097f0 tx=0x7fb66401ecb0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb67af66640 1 -- 172.21.15.55:0/106264378 shutdown_connections 2023-08-25T04:15:47.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb67af66640 1 --2- 172.21.15.55:0/106264378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6740cdde0 0x7fb6740ce220 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb67af66640 1 -- 172.21.15.55:0/106264378 >> 172.21.15.55:0/106264378 conn(0x7fb67409bae0 msgr2=0x7fb6740d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:47.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb67af66640 1 -- 172.21.15.55:0/106264378 shutdown_connections 2023-08-25T04:15:47.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb67af66640 1 -- 172.21.15.55:0/106264378 wait complete. 2023-08-25T04:15:47.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb67af66640 1 Processor -- start 2023-08-25T04:15:47.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb67af66640 1 -- start start 2023-08-25T04:15:47.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb67af66640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6740b2e40 0x7fb6740cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:47.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb67af66640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6740cdde0 0x7fb6740cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:47.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb67af66640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6740d0da0 0x7fb6740c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:47.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb67af66640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6740c6700 con 0x7fb6740cdde0 2023-08-25T04:15:47.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb67af66640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6740c69a0 con 0x7fb6740d0da0 2023-08-25T04:15:47.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb67af66640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6740c6c80 con 0x7fb6740b2e40 2023-08-25T04:15:47.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb66bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6740cdde0 0x7fb6740cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:47.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb66bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6740cdde0 0x7fb6740cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58422/0 (socket says 172.21.15.55:58422) 2023-08-25T04:15:47.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb66bfff640 1 -- 172.21.15.55:0/2668173215 learned_addr learned my addr 172.21.15.55:0/2668173215 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:47.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb66bfff640 1 -- 172.21.15.55:0/2668173215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6740b2e40 msgr2=0x7fb6740cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:47.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb66bfff640 1 --2- 172.21.15.55:0/2668173215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6740b2e40 0x7fb6740cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb66bfff640 1 -- 172.21.15.55:0/2668173215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6740d0da0 msgr2=0x7fb6740c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb66bfff640 1 --2- 172.21.15.55:0/2668173215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6740d0da0 0x7fb6740c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.605+0000 7fb66bfff640 1 -- 172.21.15.55:0/2668173215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb664009420 con 0x7fb6740cdde0 2023-08-25T04:15:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.609+0000 7fb66bfff640 1 --2- 172.21.15.55:0/2668173215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6740cdde0 0x7fb6740cb920 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb66401b8c0 tx=0x7fb66401ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.609+0000 7fb6697fa640 1 -- 172.21.15.55:0/2668173215 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640b0c60 con 0x7fb6740cdde0 2023-08-25T04:15:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.609+0000 7fb6697fa640 1 -- 172.21.15.55:0/2668173215 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6640b0dc0 con 0x7fb6740cdde0 2023-08-25T04:15:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.609+0000 7fb6697fa640 1 -- 172.21.15.55:0/2668173215 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640b9640 con 0x7fb6740cdde0 2023-08-25T04:15:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.609+0000 7fb67af66640 1 -- 172.21.15.55:0/2668173215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6740c6f60 con 0x7fb6740cdde0 2023-08-25T04:15:47.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.609+0000 7fb67af66640 1 -- 172.21.15.55:0/2668173215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb674151f60 con 0x7fb6740cdde0 2023-08-25T04:15:47.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.609+0000 7fb67af66640 1 -- 172.21.15.55:0/2668173215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67404dbe0 con 0x7fb6740cdde0 2023-08-25T04:15:47.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.609+0000 7fb6697fa640 1 -- 172.21.15.55:0/2668173215 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 84800+0+0 (secure 0 0 0) 0x7fb6640b7040 con 0x7fb6740cdde0 2023-08-25T04:15:47.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.609+0000 7fb6697fa640 1 --2- 172.21.15.55:0/2668173215 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fb6600654d0 0x7fb660067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:47.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.609+0000 7fb6697fa640 1 -- 172.21.15.55:0/2668173215 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6940+0+0 (secure 0 0 0) 0x7fb664120660 con 0x7fb6740cdde0 2023-08-25T04:15:47.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.609+0000 7fb678d02640 1 --2- 172.21.15.55:0/2668173215 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fb6600654d0 0x7fb660067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:47.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.613+0000 7fb678d02640 1 --2- 172.21.15.55:0/2668173215 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fb6600654d0 0x7fb660067990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb670007fd0 tx=0x7fb6700078e0 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:47.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.613+0000 7fb6697fa640 1 -- 172.21.15.55:0/2668173215 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb6640ee0f0 con 0x7fb6740cdde0 2023-08-25T04:15:47.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.805+0000 7fb67af66640 1 -- 172.21.15.55:0/2668173215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6740c7410 con 0x7fb6740cdde0 2023-08-25T04:15:47.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.805+0000 7fb6697fa640 1 -- 172.21.15.55:0/2668173215 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4881 (secure 0 0 0) 0x7fb6640b5090 con 0x7fb6740cdde0 2023-08-25T04:15:47.806 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:47.806 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4838,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1920231780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1920231780},{"type":"v1","addr":"172.21.15.110:6837","nonce":1920231780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2215940247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2215940247},{"type":"v1","addr":"172.21.15.55:6835","nonce":2215940247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1708341067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1708341067},{"type":"v1","addr":"172.21.15.110:6836","nonce":1708341067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:03:58.767654+0000","modified":"2023-08-25T04:04:02.406061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5080":{"gid":5080,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6834/2079290775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2079290775},{"type":"v1","addr":"172.21.15.55:6834","nonce":2079290775}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-25T04:15:47.807 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 15 2023-08-25T04:15:47.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.809+0000 7fb67af66640 1 -- 172.21.15.55:0/2668173215 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fb6600654d0 msgr2=0x7fb660067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:47.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.809+0000 7fb67af66640 1 --2- 172.21.15.55:0/2668173215 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fb6600654d0 0x7fb660067990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb670007fd0 tx=0x7fb6700078e0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.809+0000 7fb67af66640 1 -- 172.21.15.55:0/2668173215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6740cdde0 msgr2=0x7fb6740cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:47.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.809+0000 7fb67af66640 1 --2- 172.21.15.55:0/2668173215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6740cdde0 0x7fb6740cb920 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb66401b8c0 tx=0x7fb66401ba50 comp rx=0 tx=0).stop 2023-08-25T04:15:47.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.809+0000 7fb67af66640 1 -- 172.21.15.55:0/2668173215 shutdown_connections 2023-08-25T04:15:47.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.809+0000 7fb67af66640 1 --2- 172.21.15.55:0/2668173215 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fb6600654d0 0x7fb660067990 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.809+0000 7fb67af66640 1 --2- 172.21.15.55:0/2668173215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6740d0da0 0x7fb6740c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.809+0000 7fb67af66640 1 --2- 172.21.15.55:0/2668173215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6740cdde0 0x7fb6740cb920 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.809+0000 7fb67af66640 1 --2- 172.21.15.55:0/2668173215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6740b2e40 0x7fb6740cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.809+0000 7fb67af66640 1 -- 172.21.15.55:0/2668173215 >> 172.21.15.55:0/2668173215 conn(0x7fb67409bae0 msgr2=0x7fb67415be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:47.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.809+0000 7fb67af66640 1 -- 172.21.15.55:0/2668173215 shutdown_connections 2023-08-25T04:15:47.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.809+0000 7fb67af66640 1 -- 172.21.15.55:0/2668173215 wait complete. 2023-08-25T04:15:47.827 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:15:47.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.969+0000 7f71a426d640 1 Processor -- start 2023-08-25T04:15:47.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.969+0000 7f71a426d640 1 -- start start 2023-08-25T04:15:47.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.973+0000 7f71a426d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f719c15eba0 0x7f719c0b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:47.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.973+0000 7f71a426d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f719c15ef80 0x7f719c0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:47.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.973+0000 7f71a426d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f719c0cece0 0x7f719c0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:47.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.973+0000 7f71a426d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c0cf170 con 0x7f719c0cece0 2023-08-25T04:15:47.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.973+0000 7f71a426d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c0ac3a0 con 0x7f719c15eba0 2023-08-25T04:15:47.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.973+0000 7f71a426d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0b1390 con 0x7f719c15ef80 2023-08-25T04:15:47.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.973+0000 7f71a280a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f719c0cece0 0x7f719c0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:47.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.973+0000 7f71a280a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f719c0cece0 0x7f719c0cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58434/0 (socket says 172.21.15.55:58434) 2023-08-25T04:15:47.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.973+0000 7f71a280a640 1 -- 172.21.15.55:0/94475237 learned_addr learned my addr 172.21.15.55:0/94475237 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:47.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.973+0000 7f71a2009640 1 --2- 172.21.15.55:0/94475237 >> v2:172.21.15.110:3300/0 conn(0x7f719c15eba0 0x7f719c0b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:47.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.973+0000 7f71a1808640 1 --2- 172.21.15.55:0/94475237 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f719c15ef80 0x7f719c0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:47.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.973+0000 7f71a280a640 1 -- 172.21.15.55:0/94475237 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f719c15ef80 msgr2=0x7f719c0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:47.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.973+0000 7f71a280a640 1 --2- 172.21.15.55:0/94475237 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f719c15ef80 0x7f719c0ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.973+0000 7f71a280a640 1 -- 172.21.15.55:0/94475237 >> v2:172.21.15.110:3300/0 conn(0x7f719c15eba0 msgr2=0x7f719c0b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:47.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.973+0000 7f71a280a640 1 --2- 172.21.15.55:0/94475237 >> v2:172.21.15.110:3300/0 conn(0x7f719c15eba0 0x7f719c0b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.973+0000 7f71a280a640 1 -- 172.21.15.55:0/94475237 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c0b1670 con 0x7f719c0cece0 2023-08-25T04:15:47.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.973+0000 7f71a1808640 1 --2- 172.21.15.55:0/94475237 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f719c15ef80 0x7f719c0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:47.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.973+0000 7f71a280a640 1 --2- 172.21.15.55:0/94475237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0cece0 0x7f719c0cd370 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f719c0b4450 tx=0x7f719401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a334ceec332948d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:47.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a1007640 1 -- 172.21.15.55:0/94475237 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71940a5560 con 0x7f719c0cece0 2023-08-25T04:15:47.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a1007640 1 -- 172.21.15.55:0/94475237 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71940a56c0 con 0x7f719c0cece0 2023-08-25T04:15:47.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a1007640 1 -- 172.21.15.55:0/94475237 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71940a5a50 con 0x7f719c0cece0 2023-08-25T04:15:47.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a426d640 1 -- 172.21.15.55:0/94475237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0cece0 msgr2=0x7f719c0cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:47.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a426d640 1 --2- 172.21.15.55:0/94475237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0cece0 0x7f719c0cd370 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f719c0b4450 tx=0x7f719401c6e0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a426d640 1 -- 172.21.15.55:0/94475237 shutdown_connections 2023-08-25T04:15:47.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a426d640 1 --2- 172.21.15.55:0/94475237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c0cece0 0x7f719c0cd370 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a426d640 1 --2- 172.21.15.55:0/94475237 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f719c15ef80 0x7f719c0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a426d640 1 --2- 172.21.15.55:0/94475237 >> v2:172.21.15.110:3300/0 conn(0x7f719c15eba0 0x7f719c0b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a426d640 1 -- 172.21.15.55:0/94475237 >> 172.21.15.55:0/94475237 conn(0x7f719c069d00 msgr2=0x7f719c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:47.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a426d640 1 -- 172.21.15.55:0/94475237 shutdown_connections 2023-08-25T04:15:47.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a426d640 1 -- 172.21.15.55:0/94475237 wait complete. 2023-08-25T04:15:47.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a426d640 1 Processor -- start 2023-08-25T04:15:47.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a426d640 1 -- start start 2023-08-25T04:15:47.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a426d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f719c0cece0 0x7f719c096fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:47.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a426d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c15eba0 0x7f719c156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:47.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a426d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f719c15ef80 0x7f719c0ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:47.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a426d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0974e0 con 0x7f719c15eba0 2023-08-25T04:15:47.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a426d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c157d30 con 0x7f719c0cece0 2023-08-25T04:15:47.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a426d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c153db0 con 0x7f719c15ef80 2023-08-25T04:15:47.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.977+0000 7f71a1808640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c15eba0 0x7f719c156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:47.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f71a1808640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c15eba0 0x7f719c156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58440/0 (socket says 172.21.15.55:58440) 2023-08-25T04:15:47.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f71a1808640 1 -- 172.21.15.55:0/150255004 learned_addr learned my addr 172.21.15.55:0/150255004 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:47.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f71a2009640 1 --2- 172.21.15.55:0/150255004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f719c0cece0 0x7f719c096fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f71a280a640 1 --2- 172.21.15.55:0/150255004 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f719c15ef80 0x7f719c0ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f71a1808640 1 -- 172.21.15.55:0/150255004 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f719c15ef80 msgr2=0x7f719c0ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f71a1808640 1 --2- 172.21.15.55:0/150255004 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f719c15ef80 0x7f719c0ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f71a1808640 1 -- 172.21.15.55:0/150255004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f719c0cece0 msgr2=0x7f719c096fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:47.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f71a1808640 1 --2- 172.21.15.55:0/150255004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f719c0cece0 0x7f719c096fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:47.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f71a1808640 1 -- 172.21.15.55:0/150255004 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7194009b30 con 0x7f719c15eba0 2023-08-25T04:15:47.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f71a1808640 1 --2- 172.21.15.55:0/150255004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c15eba0 0x7f719c156460 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f718c00e810 tx=0x7f718c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:47.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f7192ffd640 1 -- 172.21.15.55:0/150255004 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c00c870 con 0x7f719c15eba0 2023-08-25T04:15:47.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f7192ffd640 1 -- 172.21.15.55:0/150255004 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c00c9d0 con 0x7f719c15eba0 2023-08-25T04:15:47.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f7192ffd640 1 -- 172.21.15.55:0/150255004 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c00cd80 con 0x7f719c15eba0 2023-08-25T04:15:47.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f71a426d640 1 -- 172.21.15.55:0/150255004 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c164980 con 0x7f719c15eba0 2023-08-25T04:15:47.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f71a426d640 1 -- 172.21.15.55:0/150255004 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c164370 con 0x7f719c15eba0 2023-08-25T04:15:47.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f71a426d640 1 -- 172.21.15.55:0/150255004 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c04dbe0 con 0x7f719c15eba0 2023-08-25T04:15:47.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f7192ffd640 1 -- 172.21.15.55:0/150255004 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f718c013410 con 0x7f719c15eba0 2023-08-25T04:15:47.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f7192ffd640 1 --2- 172.21.15.55:0/150255004 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f71800654d0 0x7f7180067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:47.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.981+0000 7f7192ffd640 1 -- 172.21.15.55:0/150255004 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6940+0+0 (secure 0 0 0) 0x7f718c082b90 con 0x7f719c15eba0 2023-08-25T04:15:47.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.985+0000 7f71a2009640 1 --2- 172.21.15.55:0/150255004 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f71800654d0 0x7f7180067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:47.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.985+0000 7f71a2009640 1 --2- 172.21.15.55:0/150255004 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f71800654d0 0x7f7180067990 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7198009ae0 tx=0x7f7198009190 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:47.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:47.989+0000 7f7192ffd640 1 -- 172.21.15.55:0/150255004 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f718c050600 con 0x7f719c15eba0 2023-08-25T04:15:48.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.141+0000 7f71a426d640 1 -- 172.21.15.55:0/150255004 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f719c0ccc40 con 0x7f719c15eba0 2023-08-25T04:15:48.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.145+0000 7f7192ffd640 1 -- 172.21.15.55:0/150255004 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+19702 (secure 0 0 0) 0x7f718c053c20 con 0x7f719c15eba0 2023-08-25T04:15:48.144 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:48.144 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":50,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:15:46.532894+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:03:56.779789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:57.764926+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.26","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3921349352":"2023-08-26T04:15:46.532863+0000","172.21.15.110:0/3810476394":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/3898418887":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/3320584392":"2023-08-26T04:15:46.532863+0000","172.21.15.110:6832/3210220484":"2023-08-26T04:15:46.532863+0000","172.21.15.110:0/2576650460":"2023-08-26T04:04:16.252224+0000","172.21.15.110:6832/413962747":"2023-08-26T04:04:16.252224+0000","172.21.15.110:6833/413962747":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/2038389426":"2023-08-26T04:15:46.532863+0000","172.21.15.110:0/2105887625":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/1030503486":"2023-08-26T04:15:46.532863+0000","172.21.15.110:0/1400443768":"2023-08-26T04:15:46.532863+0000","172.21.15.110:0/1413171589":"2023-08-26T04:15:46.532863+0000","172.21.15.110:6833/3210220484":"2023-08-26T04:15:46.532863+0000","172.21.15.110:0/1790436010":"2023-08-26T04:15:46.532863+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":10,"length":1},{"begin":21,"length":2},{"begin":33,"length":1},{"begin":43,"length":1},{"begin":54,"length":1},{"begin":64,"length":1},{"begin":75,"length":1},{"begin":86,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":210,"length":12}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:15:48.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.145+0000 7f71a426d640 1 -- 172.21.15.55:0/150255004 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f71800654d0 msgr2=0x7f7180067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:48.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.145+0000 7f71a426d640 1 --2- 172.21.15.55:0/150255004 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f71800654d0 0x7f7180067990 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7198009ae0 tx=0x7f7198009190 comp rx=0 tx=0).stop 2023-08-25T04:15:48.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.145+0000 7f71a426d640 1 -- 172.21.15.55:0/150255004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c15eba0 msgr2=0x7f719c156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:48.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.145+0000 7f71a426d640 1 --2- 172.21.15.55:0/150255004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c15eba0 0x7f719c156460 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f718c00e810 tx=0x7f718c00ecd0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.145+0000 7f71a426d640 1 -- 172.21.15.55:0/150255004 shutdown_connections 2023-08-25T04:15:48.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.145+0000 7f71a426d640 1 --2- 172.21.15.55:0/150255004 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f71800654d0 0x7f7180067990 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.145+0000 7f71a426d640 1 --2- 172.21.15.55:0/150255004 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f719c15ef80 0x7f719c0ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.145+0000 7f71a426d640 1 --2- 172.21.15.55:0/150255004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f719c15eba0 0x7f719c156460 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.145+0000 7f71a426d640 1 --2- 172.21.15.55:0/150255004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f719c0cece0 0x7f719c096fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.145+0000 7f71a426d640 1 -- 172.21.15.55:0/150255004 >> 172.21.15.55:0/150255004 conn(0x7f719c069d00 msgr2=0x7f719c06f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:48.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.145+0000 7f71a426d640 1 -- 172.21.15.55:0/150255004 shutdown_connections 2023-08-25T04:15:48.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.145+0000 7f71a426d640 1 -- 172.21.15.55:0/150255004 wait complete. 2023-08-25T04:15:48.165 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-25T04:15:48.166 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:15:48.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.309+0000 7fc2eb0cb640 1 Processor -- start 2023-08-25T04:15:48.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.309+0000 7fc2eb0cb640 1 -- start start 2023-08-25T04:15:48.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.309+0000 7fc2eb0cb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc2e40cdde0 0x7fc2e40ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:48.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.309+0000 7fc2eb0cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e40b2e40 0x7fc2e40b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:48.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.309+0000 7fc2eb0cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e40b29b0 con 0x7fc2e40d0da0 2023-08-25T04:15:48.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.309+0000 7fc2eb0cb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e40ce760 con 0x7fc2e40cdde0 2023-08-25T04:15:48.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.309+0000 7fc2eb0cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40b1dc0 con 0x7fc2e40b2e40 2023-08-25T04:15:48.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.309+0000 7fc2e8e67640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc2e40d0da0 0x7fc2e40d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53618/0 (socket says 172.21.15.55:53618) 2023-08-25T04:15:48.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.309+0000 7fc2e8e67640 1 -- 172.21.15.55:0/3303977802 learned_addr learned my addr 172.21.15.55:0/3303977802 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:48.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.309+0000 7fc2e9668640 1 --2- 172.21.15.55:0/3303977802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e40b2e40 0x7fc2e40b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:48.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.309+0000 7fc2dbfff640 1 --2- 172.21.15.55:0/3303977802 >> v2:172.21.15.110:3300/0 conn(0x7fc2e40cdde0 0x7fc2e40ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:48.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.309+0000 7fc2db7fe640 1 -- 172.21.15.55:0/3303977802 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648260791 0 0) 0x7fc2e40b29b0 con 0x7fc2e40d0da0 2023-08-25T04:15:48.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.309+0000 7fc2db7fe640 1 -- 172.21.15.55:0/3303977802 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2cc003530 con 0x7fc2e40d0da0 2023-08-25T04:15:48.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.309+0000 7fc2dbfff640 1 -- 172.21.15.55:0/3303977802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e40b2e40 msgr2=0x7fc2e40b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:48.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.309+0000 7fc2dbfff640 1 --2- 172.21.15.55:0/3303977802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e40b2e40 0x7fc2e40b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.309+0000 7fc2dbfff640 1 -- 172.21.15.55:0/3303977802 >> v1:172.21.15.55:6789/0 conn(0x7fc2e40d0da0 legacy=0x7fc2e40d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:48.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.309+0000 7fc2dbfff640 1 -- 172.21.15.55:0/3303977802 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e40b2080 con 0x7fc2e40cdde0 2023-08-25T04:15:48.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.309+0000 7fc2e9668640 1 --2- 172.21.15.55:0/3303977802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e40b2e40 0x7fc2e40b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:15:48.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.313+0000 7fc2dbfff640 1 --2- 172.21.15.55:0/3303977802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e40cdde0 0x7fc2e40ce220 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40097c0 tx=0x7fc2d401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=250044d4554d0a88 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.313+0000 7fc2db7fe640 1 -- 172.21.15.55:0/3303977802 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d40a8970 con 0x7fc2e40cdde0 2023-08-25T04:15:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.313+0000 7fc2db7fe640 1 -- 172.21.15.55:0/3303977802 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d40a8ad0 con 0x7fc2e40cdde0 2023-08-25T04:15:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.313+0000 7fc2db7fe640 1 -- 172.21.15.55:0/3303977802 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d40a8e60 con 0x7fc2e40cdde0 2023-08-25T04:15:48.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.313+0000 7fc2eb0cb640 1 -- 172.21.15.55:0/3303977802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e40cdde0 msgr2=0x7fc2e40ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:48.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.313+0000 7fc2eb0cb640 1 --2- 172.21.15.55:0/3303977802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e40cdde0 0x7fc2e40ce220 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40097c0 tx=0x7fc2d401ec70 comp rx=0 tx=0).stop 2023-08-25T04:15:48.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.313+0000 7fc2eb0cb640 1 -- 172.21.15.55:0/3303977802 shutdown_connections 2023-08-25T04:15:48.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.313+0000 7fc2eb0cb640 1 --2- 172.21.15.55:0/3303977802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e40b2e40 0x7fc2e40b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.313+0000 7fc2eb0cb640 1 --2- 172.21.15.55:0/3303977802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e40cdde0 0x7fc2e40ce220 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.313+0000 7fc2eb0cb640 1 -- 172.21.15.55:0/3303977802 >> 172.21.15.55:0/3303977802 conn(0x7fc2e409bae0 msgr2=0x7fc2e40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:48.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.313+0000 7fc2eb0cb640 1 -- 172.21.15.55:0/3303977802 shutdown_connections 2023-08-25T04:15:48.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.313+0000 7fc2eb0cb640 1 -- 172.21.15.55:0/3303977802 wait complete. 2023-08-25T04:15:48.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2eb0cb640 1 Processor -- start 2023-08-25T04:15:48.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2eb0cb640 1 -- start start 2023-08-25T04:15:48.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2eb0cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e40b2e40 0x7fc2e40ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:48.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2eb0cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e40cdde0 0x7fc2e40cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:48.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2eb0cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2e40d0da0 0x7fc2e40cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:48.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2eb0cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40cb420 con 0x7fc2e40d0da0 2023-08-25T04:15:48.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2eb0cb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e4152590 con 0x7fc2e40b2e40 2023-08-25T04:15:48.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2eb0cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e415df30 con 0x7fc2e40cdde0 2023-08-25T04:15:48.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2e9668640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2e40d0da0 0x7fc2e40cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:48.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2e9668640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2e40d0da0 0x7fc2e40cc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58446/0 (socket says 172.21.15.55:58446) 2023-08-25T04:15:48.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2e9668640 1 -- 172.21.15.55:0/1107591634 learned_addr learned my addr 172.21.15.55:0/1107591634 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:48.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2e8e67640 1 --2- 172.21.15.55:0/1107591634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e40b2e40 0x7fc2e40ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2dbfff640 1 --2- 172.21.15.55:0/1107591634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e40cdde0 0x7fc2e40cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2e9668640 1 -- 172.21.15.55:0/1107591634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e40cdde0 msgr2=0x7fc2e40cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2e9668640 1 --2- 172.21.15.55:0/1107591634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e40cdde0 0x7fc2e40cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2e9668640 1 -- 172.21.15.55:0/1107591634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e40b2e40 msgr2=0x7fc2e40ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2e9668640 1 --2- 172.21.15.55:0/1107591634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e40b2e40 0x7fc2e40ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2e9668640 1 -- 172.21.15.55:0/1107591634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc009a70 con 0x7fc2e40d0da0 2023-08-25T04:15:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2dbfff640 1 --2- 172.21.15.55:0/1107591634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e40cdde0 0x7fc2e40cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2e8e67640 1 --2- 172.21.15.55:0/1107591634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e40b2e40 0x7fc2e40ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:48.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2e9668640 1 --2- 172.21.15.55:0/1107591634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2e40d0da0 0x7fc2e40cc1a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00efc0 tx=0x7fc2dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:48.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2d97fa640 1 -- 172.21.15.55:0/1107591634 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc009cd0 con 0x7fc2e40d0da0 2023-08-25T04:15:48.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2d97fa640 1 -- 172.21.15.55:0/1107591634 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc00f040 con 0x7fc2e40d0da0 2023-08-25T04:15:48.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2eb0cb640 1 -- 172.21.15.55:0/1107591634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d4009420 con 0x7fc2e40d0da0 2023-08-25T04:15:48.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2d97fa640 1 -- 172.21.15.55:0/1107591634 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0039a0 con 0x7fc2e40d0da0 2023-08-25T04:15:48.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.317+0000 7fc2eb0cb640 1 -- 172.21.15.55:0/1107591634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e40cae60 con 0x7fc2e40d0da0 2023-08-25T04:15:48.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.321+0000 7fc2eb0cb640 1 -- 172.21.15.55:0/1107591634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e404dbe0 con 0x7fc2e40d0da0 2023-08-25T04:15:48.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.321+0000 7fc2d97fa640 1 -- 172.21.15.55:0/1107591634 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 16) v1 ==== 84800+0+0 (secure 0 0 0) 0x7fc2dc014480 con 0x7fc2e40d0da0 2023-08-25T04:15:48.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.321+0000 7fc2d97fa640 1 --2- 172.21.15.55:0/1107591634 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fc2d0065500 0x7fc2d00679c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:48.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.321+0000 7fc2d97fa640 1 -- 172.21.15.55:0/1107591634 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6940+0+0 (secure 0 0 0) 0x7fc2dc083940 con 0x7fc2e40d0da0 2023-08-25T04:15:48.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.321+0000 7fc2e8e67640 1 --2- 172.21.15.55:0/1107591634 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fc2d0065500 0x7fc2d00679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:48.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.321+0000 7fc2e8e67640 1 --2- 172.21.15.55:0/1107591634 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fc2d0065500 0x7fc2d00679c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00010f0 tx=0x7fc2e0009040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:48.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.325+0000 7fc2d97fa640 1 -- 172.21.15.55:0/1107591634 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc2dc054e60 con 0x7fc2e40d0da0 2023-08-25T04:15:48.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.513+0000 7fc2eb0cb640 1 -- 172.21.15.55:0/1107591634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2e40d0b80 con 0x7fc2e40d0da0 2023-08-25T04:15:48.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.513+0000 7fc2d97fa640 1 -- 172.21.15.55:0/1107591634 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4881 (secure 0 0 0) 0x7fc2dc0549f0 con 0x7fc2e40d0da0 2023-08-25T04:15:48.514 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:48.514 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4838,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1920231780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1920231780},{"type":"v1","addr":"172.21.15.110:6837","nonce":1920231780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2215940247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2215940247},{"type":"v1","addr":"172.21.15.55:6835","nonce":2215940247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1708341067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1708341067},{"type":"v1","addr":"172.21.15.110:6836","nonce":1708341067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:03:58.767654+0000","modified":"2023-08-25T04:04:02.406061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5080":{"gid":5080,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6834/2079290775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2079290775},{"type":"v1","addr":"172.21.15.55:6834","nonce":2079290775}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-25T04:15:48.515 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 15 2023-08-25T04:15:48.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.517+0000 7fc2eb0cb640 1 -- 172.21.15.55:0/1107591634 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fc2d0065500 msgr2=0x7fc2d00679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:48.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.517+0000 7fc2eb0cb640 1 --2- 172.21.15.55:0/1107591634 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fc2d0065500 0x7fc2d00679c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00010f0 tx=0x7fc2e0009040 comp rx=0 tx=0).stop 2023-08-25T04:15:48.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.517+0000 7fc2eb0cb640 1 -- 172.21.15.55:0/1107591634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2e40d0da0 msgr2=0x7fc2e40cc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:48.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.517+0000 7fc2eb0cb640 1 --2- 172.21.15.55:0/1107591634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2e40d0da0 0x7fc2e40cc1a0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00efc0 tx=0x7fc2dc00c490 comp rx=0 tx=0).stop 2023-08-25T04:15:48.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.517+0000 7fc2eb0cb640 1 -- 172.21.15.55:0/1107591634 shutdown_connections 2023-08-25T04:15:48.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.517+0000 7fc2eb0cb640 1 --2- 172.21.15.55:0/1107591634 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fc2d0065500 0x7fc2d00679c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.517+0000 7fc2eb0cb640 1 --2- 172.21.15.55:0/1107591634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2e40d0da0 0x7fc2e40cc1a0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.517+0000 7fc2eb0cb640 1 --2- 172.21.15.55:0/1107591634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e40cdde0 0x7fc2e40cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.517+0000 7fc2eb0cb640 1 --2- 172.21.15.55:0/1107591634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e40b2e40 0x7fc2e40ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.517+0000 7fc2eb0cb640 1 -- 172.21.15.55:0/1107591634 >> 172.21.15.55:0/1107591634 conn(0x7fc2e409bae0 msgr2=0x7fc2e40af440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:48.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.517+0000 7fc2eb0cb640 1 -- 172.21.15.55:0/1107591634 shutdown_connections 2023-08-25T04:15:48.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.517+0000 7fc2eb0cb640 1 -- 172.21.15.55:0/1107591634 wait complete. 2023-08-25T04:15:48.535 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:15:48.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.689+0000 7f076a883640 1 Processor -- start 2023-08-25T04:15:48.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.689+0000 7f076a883640 1 -- start start 2023-08-25T04:15:48.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.689+0000 7f076a883640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f07640d1120 0x7f076406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:48.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.689+0000 7f076a883640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f076406c150 0x7f07640b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:48.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.689+0000 7f076a883640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07640afe20 con 0x7f076415ca50 2023-08-25T04:15:48.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.689+0000 7f076a883640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07640af210 con 0x7f07640d1120 2023-08-25T04:15:48.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.689+0000 7f076a883640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07640af4f0 con 0x7f076406c150 2023-08-25T04:15:48.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.689+0000 7f076a082640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f076406c150 0x7f07640b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:48.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.689+0000 7f0769881640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f076415ca50 0x7f07640d0a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53624/0 (socket says 172.21.15.55:53624) 2023-08-25T04:15:48.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.689+0000 7f0769881640 1 -- 172.21.15.55:0/2319572165 learned_addr learned my addr 172.21.15.55:0/2319572165 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:48.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.689+0000 7f0769080640 1 --2- 172.21.15.55:0/2319572165 >> v2:172.21.15.110:3300/0 conn(0x7f07640d1120 0x7f076406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:48.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.689+0000 7f076887f640 1 -- 172.21.15.55:0/2319572165 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810629043 0 0) 0x7f07640afe20 con 0x7f076415ca50 2023-08-25T04:15:48.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.689+0000 7f076887f640 1 -- 172.21.15.55:0/2319572165 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0750003530 con 0x7f076415ca50 2023-08-25T04:15:48.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.689+0000 7f076a082640 1 -- 172.21.15.55:0/2319572165 >> v2:172.21.15.110:3300/0 conn(0x7f07640d1120 msgr2=0x7f076406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:48.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.689+0000 7f076a082640 1 --2- 172.21.15.55:0/2319572165 >> v2:172.21.15.110:3300/0 conn(0x7f07640d1120 0x7f076406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.689+0000 7f076a082640 1 -- 172.21.15.55:0/2319572165 >> v1:172.21.15.55:6789/0 conn(0x7f076415ca50 legacy=0x7f07640d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:48.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.689+0000 7f076a082640 1 -- 172.21.15.55:0/2319572165 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07640af7d0 con 0x7f076406c150 2023-08-25T04:15:48.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.689+0000 7f0769080640 1 --2- 172.21.15.55:0/2319572165 >> v2:172.21.15.110:3300/0 conn(0x7f07640d1120 0x7f076406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:15:48.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.693+0000 7f076a082640 1 --2- 172.21.15.55:0/2319572165 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f076406c150 0x7f07640b02b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f075c009d90 tx=0x7f075c01d380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=666ae9a250772020 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:48.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.693+0000 7f076887f640 1 -- 172.21.15.55:0/2319572165 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c0a5a00 con 0x7f076406c150 2023-08-25T04:15:48.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.693+0000 7f076887f640 1 -- 172.21.15.55:0/2319572165 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075c0a5b60 con 0x7f076406c150 2023-08-25T04:15:48.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.693+0000 7f076887f640 1 -- 172.21.15.55:0/2319572165 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c0ad440 con 0x7f076406c150 2023-08-25T04:15:48.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.693+0000 7f076a883640 1 -- 172.21.15.55:0/2319572165 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f076406c150 msgr2=0x7f07640b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:48.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.693+0000 7f076a883640 1 --2- 172.21.15.55:0/2319572165 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f076406c150 0x7f07640b02b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f075c009d90 tx=0x7f075c01d380 comp rx=0 tx=0).stop 2023-08-25T04:15:48.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.693+0000 7f076a883640 1 -- 172.21.15.55:0/2319572165 shutdown_connections 2023-08-25T04:15:48.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.693+0000 7f076a883640 1 --2- 172.21.15.55:0/2319572165 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f076406c150 0x7f07640b02b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.693+0000 7f076a883640 1 --2- 172.21.15.55:0/2319572165 >> v2:172.21.15.110:3300/0 conn(0x7f07640d1120 0x7f076406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.693+0000 7f076a883640 1 -- 172.21.15.55:0/2319572165 >> 172.21.15.55:0/2319572165 conn(0x7f0764065f40 msgr2=0x7f076409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:48.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.693+0000 7f076a883640 1 -- 172.21.15.55:0/2319572165 shutdown_connections 2023-08-25T04:15:48.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.693+0000 7f076a883640 1 -- 172.21.15.55:0/2319572165 wait complete. 2023-08-25T04:15:48.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f076a883640 1 Processor -- start 2023-08-25T04:15:48.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f076a883640 1 -- start start 2023-08-25T04:15:48.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f076a883640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f076406c150 0x7f0764157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:48.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f076a883640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07640d1120 0x7f07640c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:48.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f076a883640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f076415ca50 0x7f07640c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:48.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f076a883640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07640c8dd0 con 0x7f076406c150 2023-08-25T04:15:48.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f076a883640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07640c60e0 con 0x7f076415ca50 2023-08-25T04:15:48.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f076a883640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07640c6c60 con 0x7f07640d1120 2023-08-25T04:15:48.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f0769881640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f076406c150 0x7f0764157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:48.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f0769881640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f076406c150 0x7f0764157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58458/0 (socket says 172.21.15.55:58458) 2023-08-25T04:15:48.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f0769881640 1 -- 172.21.15.55:0/1766605539 learned_addr learned my addr 172.21.15.55:0/1766605539 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:48.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f0769080640 1 --2- 172.21.15.55:0/1766605539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07640d1120 0x7f07640c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:48.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f076a082640 1 --2- 172.21.15.55:0/1766605539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f076415ca50 0x7f07640c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:48.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f0769881640 1 -- 172.21.15.55:0/1766605539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07640d1120 msgr2=0x7f07640c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:48.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f0769881640 1 --2- 172.21.15.55:0/1766605539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07640d1120 0x7f07640c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f0769881640 1 -- 172.21.15.55:0/1766605539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f076415ca50 msgr2=0x7f07640c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:48.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f0769881640 1 --2- 172.21.15.55:0/1766605539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f076415ca50 0x7f07640c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f0769881640 1 -- 172.21.15.55:0/1766605539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0754009420 con 0x7f076406c150 2023-08-25T04:15:48.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f0769881640 1 --2- 172.21.15.55:0/1766605539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f076406c150 0x7f0764157d40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f076000c430 tx=0x7f076000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:48.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f075a7fc640 1 -- 172.21.15.55:0/1766605539 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07600074e0 con 0x7f076406c150 2023-08-25T04:15:48.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f075a7fc640 1 -- 172.21.15.55:0/1766605539 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0760007660 con 0x7f076406c150 2023-08-25T04:15:48.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f075a7fc640 1 -- 172.21.15.55:0/1766605539 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07600059f0 con 0x7f076406c150 2023-08-25T04:15:48.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f076a883640 1 -- 172.21.15.55:0/1766605539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075c009a70 con 0x7f076406c150 2023-08-25T04:15:48.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.697+0000 7f076a883640 1 -- 172.21.15.55:0/1766605539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07640c6610 con 0x7f076406c150 2023-08-25T04:15:48.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.701+0000 7f076a883640 1 -- 172.21.15.55:0/1766605539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0764073e50 con 0x7f076406c150 2023-08-25T04:15:48.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.701+0000 7f075a7fc640 1 -- 172.21.15.55:0/1766605539 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f0760005b50 con 0x7f076406c150 2023-08-25T04:15:48.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.701+0000 7f075a7fc640 1 --2- 172.21.15.55:0/1766605539 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f0748065740 0x7f0748067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:48.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.701+0000 7f075a7fc640 1 -- 172.21.15.55:0/1766605539 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6940+0+0 (secure 0 0 0) 0x7f07600825f0 con 0x7f076406c150 2023-08-25T04:15:48.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.701+0000 7f0769080640 1 --2- 172.21.15.55:0/1766605539 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f0748065740 0x7f0748067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:48.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.705+0000 7f0769080640 1 --2- 172.21.15.55:0/1766605539 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f0748065740 0x7f0748067c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f076415d0d0 tx=0x7f0754009190 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:48.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.705+0000 7f075a7fc640 1 -- 172.21.15.55:0/1766605539 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f076004fe90 con 0x7f076406c150 2023-08-25T04:15:48.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.897+0000 7f076a883640 1 -- 172.21.15.55:0/1766605539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f076415e990 con 0x7f076406c150 2023-08-25T04:15:48.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.897+0000 7f075a7fc640 1 -- 172.21.15.55:0/1766605539 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4881 (secure 0 0 0) 0x7f07600534b0 con 0x7f076406c150 2023-08-25T04:15:48.896 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:48.896 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4838,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1920231780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1920231780},{"type":"v1","addr":"172.21.15.110:6837","nonce":1920231780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2215940247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2215940247},{"type":"v1","addr":"172.21.15.55:6835","nonce":2215940247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1708341067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1708341067},{"type":"v1","addr":"172.21.15.110:6836","nonce":1708341067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:03:58.767654+0000","modified":"2023-08-25T04:04:02.406061+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5080":{"gid":5080,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6834/2079290775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2079290775},{"type":"v1","addr":"172.21.15.55:6834","nonce":2079290775}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-25T04:15:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 15 2023-08-25T04:15:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.897+0000 7f076a883640 1 -- 172.21.15.55:0/1766605539 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f0748065740 msgr2=0x7f0748067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.897+0000 7f076a883640 1 --2- 172.21.15.55:0/1766605539 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f0748065740 0x7f0748067c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f076415d0d0 tx=0x7f0754009190 comp rx=0 tx=0).stop 2023-08-25T04:15:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.897+0000 7f076a883640 1 -- 172.21.15.55:0/1766605539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f076406c150 msgr2=0x7f0764157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.897+0000 7f076a883640 1 --2- 172.21.15.55:0/1766605539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f076406c150 0x7f0764157d40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f076000c430 tx=0x7f076000c8f0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.897+0000 7f076a883640 1 -- 172.21.15.55:0/1766605539 shutdown_connections 2023-08-25T04:15:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.897+0000 7f076a883640 1 --2- 172.21.15.55:0/1766605539 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f0748065740 0x7f0748067c00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.897+0000 7f076a883640 1 --2- 172.21.15.55:0/1766605539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f076415ca50 0x7f07640c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.897+0000 7f076a883640 1 --2- 172.21.15.55:0/1766605539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07640d1120 0x7f07640c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.897+0000 7f076a883640 1 --2- 172.21.15.55:0/1766605539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f076406c150 0x7f0764157d40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.897+0000 7f076a883640 1 -- 172.21.15.55:0/1766605539 >> 172.21.15.55:0/1766605539 conn(0x7f0764065f40 msgr2=0x7f076415be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.897+0000 7f076a883640 1 -- 172.21.15.55:0/1766605539 shutdown_connections 2023-08-25T04:15:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:48.897+0000 7f076a883640 1 -- 172.21.15.55:0/1766605539 wait complete. 2023-08-25T04:15:48.917 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:15:49.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.061+0000 7fa8f2737640 1 Processor -- start 2023-08-25T04:15:49.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.061+0000 7fa8f2737640 1 -- start start 2023-08-25T04:15:49.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.061+0000 7fa8f2737640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa8ec0d0da0 0x7fa8ec0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.061+0000 7fa8f2737640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ec0b29b0 con 0x7fa8ec0b3e50 2023-08-25T04:15:49.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.061+0000 7fa8f2737640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ec0cfc80 con 0x7fa8ec0cdde0 2023-08-25T04:15:49.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.061+0000 7fa8f2737640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ec0d16c0 con 0x7fa8ec0d0da0 2023-08-25T04:15:49.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8f0cd4640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa8ec0b3e50 0x7fa8ec0cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53632/0 (socket says 172.21.15.55:53632) 2023-08-25T04:15:49.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8f0cd4640 1 -- 172.21.15.55:0/2951564665 learned_addr learned my addr 172.21.15.55:0/2951564665 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:49.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2951564665 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3644680409 0 0) 0x7fa8ec0b29b0 con 0x7fa8ec0b3e50 2023-08-25T04:15:49.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2951564665 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8d4003530 con 0x7fa8ec0b3e50 2023-08-25T04:15:49.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8ebfff640 1 --2- 172.21.15.55:0/2951564665 >> v2:172.21.15.110:3300/0 conn(0x7fa8ec0d0da0 0x7fa8ec0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2951564665 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3044432825 0 0) 0x7fa8d4003530 con 0x7fa8ec0b3e50 2023-08-25T04:15:49.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2951564665 >> v2:172.21.15.110:3300/0 conn(0x7fa8ec0d0da0 msgr2=0x7fa8ec0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:49.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eaffd640 1 --2- 172.21.15.55:0/2951564665 >> v2:172.21.15.110:3300/0 conn(0x7fa8ec0d0da0 0x7fa8ec0d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2951564665 >> v1:172.21.15.110:6789/0 conn(0x7fa8ec0cdde0 legacy=0x7fa8ec0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:49.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2951564665 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec0b1dc0 con 0x7fa8ec0b3e50 2023-08-25T04:15:49.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2951564665 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fa8e4001a00 con 0x7fa8ec0b3e50 2023-08-25T04:15:49.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2951564665 >> v1:172.21.15.55:6789/0 conn(0x7fa8ec0b3e50 legacy=0x7fa8ec0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:49.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eaffd640 1 --2- 172.21.15.55:0/2951564665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8d4003980 0x7fa8d4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eaffd640 1 --2- 172.21.15.55:0/2951564665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d40047d0 0x7fa8d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eaffd640 1 --2- 172.21.15.55:0/2951564665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d4005190 0x7fa8d400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2951564665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec0d16c0 con 0x7fa8d40047d0 2023-08-25T04:15:49.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2951564665 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d400c040 con 0x7fa8d4005190 2023-08-25T04:15:49.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2951564665 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d400c200 con 0x7fa8d4003980 2023-08-25T04:15:49.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eb7fe640 1 --2- 172.21.15.55:0/2951564665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d40047d0 0x7fa8d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8f0cd4640 1 --2- 172.21.15.55:0/2951564665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d4005190 0x7fa8d400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8ebfff640 1 --2- 172.21.15.55:0/2951564665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8d4003980 0x7fa8d4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eb7fe640 1 -- 172.21.15.55:0/2951564665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8d4003980 msgr2=0x7fa8d4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:49.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eb7fe640 1 --2- 172.21.15.55:0/2951564665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8d4003980 0x7fa8d4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eb7fe640 1 -- 172.21.15.55:0/2951564665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d4005190 msgr2=0x7fa8d400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:49.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eb7fe640 1 --2- 172.21.15.55:0/2951564665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d4005190 0x7fa8d400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8eb7fe640 1 -- 172.21.15.55:0/2951564665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d4003530 con 0x7fa8d40047d0 2023-08-25T04:15:49.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.065+0000 7fa8f0cd4640 1 -- 172.21.15.55:0/2951564665 reap_dead start 2023-08-25T04:15:49.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.069+0000 7fa8eb7fe640 1 --2- 172.21.15.55:0/2951564665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d40047d0 0x7fa8d4004c50 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0001780 tx=0x7fa8e001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc580d12c05e508 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:49.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.069+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2951564665 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e00052d0 con 0x7fa8d40047d0 2023-08-25T04:15:49.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.069+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2951564665 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e00a7050 con 0x7fa8d40047d0 2023-08-25T04:15:49.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.069+0000 7fa8eaffd640 1 -- 172.21.15.55:0/2951564665 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0003600 con 0x7fa8d40047d0 2023-08-25T04:15:49.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.069+0000 7fa8f2737640 1 -- 172.21.15.55:0/2951564665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d40047d0 msgr2=0x7fa8d4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:49.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.069+0000 7fa8f2737640 1 --2- 172.21.15.55:0/2951564665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d40047d0 0x7fa8d4004c50 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0001780 tx=0x7fa8e001c3e0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.069+0000 7fa8f2737640 1 -- 172.21.15.55:0/2951564665 shutdown_connections 2023-08-25T04:15:49.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.069+0000 7fa8f2737640 1 --2- 172.21.15.55:0/2951564665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d40047d0 0x7fa8d4004c50 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.069+0000 7fa8f2737640 1 -- 172.21.15.55:0/2951564665 >> 172.21.15.55:0/2951564665 conn(0x7fa8ec09bae0 msgr2=0x7fa8ec0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:49.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.069+0000 7fa8f2737640 1 -- 172.21.15.55:0/2951564665 shutdown_connections 2023-08-25T04:15:49.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.069+0000 7fa8f2737640 1 -- 172.21.15.55:0/2951564665 wait complete. 2023-08-25T04:15:49.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.069+0000 7fa8f2737640 1 Processor -- start 2023-08-25T04:15:49.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.069+0000 7fa8f2737640 1 -- start start 2023-08-25T04:15:49.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8f2737640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d40047d0 0x7fa8ec0c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8f2737640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8ec0c8f50 0x7fa8ec150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8f2737640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8ec06abc0 0x7fa8ec14d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8f2737640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec0c6490 con 0x7fa8ec0c8f50 2023-08-25T04:15:49.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8f2737640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec0c6730 con 0x7fa8d40047d0 2023-08-25T04:15:49.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8f2737640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec0c6a10 con 0x7fa8ec06abc0 2023-08-25T04:15:49.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8eb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8ec0c8f50 0x7fa8ec150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8eb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8ec0c8f50 0x7fa8ec150cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58466/0 (socket says 172.21.15.55:58466) 2023-08-25T04:15:49.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8eb7fe640 1 -- 172.21.15.55:0/36771377 learned_addr learned my addr 172.21.15.55:0/36771377 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:49.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8ebfff640 1 --2- 172.21.15.55:0/36771377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d40047d0 0x7fa8ec0c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8f0cd4640 1 --2- 172.21.15.55:0/36771377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8ec06abc0 0x7fa8ec14d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8eb7fe640 1 -- 172.21.15.55:0/36771377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8ec06abc0 msgr2=0x7fa8ec14d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:49.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8eb7fe640 1 --2- 172.21.15.55:0/36771377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8ec06abc0 0x7fa8ec14d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8eb7fe640 1 -- 172.21.15.55:0/36771377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d40047d0 msgr2=0x7fa8ec0c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:49.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8eb7fe640 1 --2- 172.21.15.55:0/36771377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d40047d0 0x7fa8ec0c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8eb7fe640 1 -- 172.21.15.55:0/36771377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec0c6cf0 con 0x7fa8ec0c8f50 2023-08-25T04:15:49.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8eb7fe640 1 --2- 172.21.15.55:0/36771377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8ec0c8f50 0x7fa8ec150cc0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa8e001c210 tx=0x7fa8d4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:49.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8e8ff9640 1 -- 172.21.15.55:0/36771377 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0007500 con 0x7fa8ec0c8f50 2023-08-25T04:15:49.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8e8ff9640 1 -- 172.21.15.55:0/36771377 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e0007660 con 0x7fa8ec0c8f50 2023-08-25T04:15:49.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8e8ff9640 1 -- 172.21.15.55:0/36771377 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0006a20 con 0x7fa8ec0c8f50 2023-08-25T04:15:49.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8f2737640 1 -- 172.21.15.55:0/36771377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ec0c6fd0 con 0x7fa8ec0c8f50 2023-08-25T04:15:49.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8f2737640 1 -- 172.21.15.55:0/36771377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ec06b020 con 0x7fa8ec0c8f50 2023-08-25T04:15:49.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8f2737640 1 -- 172.21.15.55:0/36771377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ec04dbe0 con 0x7fa8ec0c8f50 2023-08-25T04:15:49.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.073+0000 7fa8e8ff9640 1 -- 172.21.15.55:0/36771377 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fa8e0006b80 con 0x7fa8ec0c8f50 2023-08-25T04:15:49.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.077+0000 7fa8e8ff9640 1 --2- 172.21.15.55:0/36771377 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fa8d8065740 0x7fa8d8067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.077+0000 7fa8e8ff9640 1 -- 172.21.15.55:0/36771377 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6940+0+0 (secure 0 0 0) 0x7fa8e011d5e0 con 0x7fa8ec0c8f50 2023-08-25T04:15:49.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.077+0000 7fa8ebfff640 1 --2- 172.21.15.55:0/36771377 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fa8d8065740 0x7fa8d8067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.077+0000 7fa8ebfff640 1 --2- 172.21.15.55:0/36771377 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fa8d8065740 0x7fa8d8067c00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0687f0 tx=0x7fa8dc008040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:49.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.081+0000 7fa8e8ff9640 1 -- 172.21.15.55:0/36771377 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa8e00ee650 con 0x7fa8ec0c8f50 2023-08-25T04:15:49.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.237+0000 7fa8f2737640 1 -- 172.21.15.55:0/36771377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8ec0c6b50 con 0x7fa8ec0c8f50 2023-08-25T04:15:49.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.237+0000 7fa8e8ff9640 1 -- 172.21.15.55:0/36771377 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+19702 (secure 0 0 0) 0x7fa8ec0c6b50 con 0x7fa8ec0c8f50 2023-08-25T04:15:49.238 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:49.239 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":50,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:15:46.532894+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:03:56.779789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-25T04:03:57.764926+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":49,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.26","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3921349352":"2023-08-26T04:15:46.532863+0000","172.21.15.110:0/3810476394":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/3898418887":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/3320584392":"2023-08-26T04:15:46.532863+0000","172.21.15.110:6832/3210220484":"2023-08-26T04:15:46.532863+0000","172.21.15.110:0/2576650460":"2023-08-26T04:04:16.252224+0000","172.21.15.110:6832/413962747":"2023-08-26T04:04:16.252224+0000","172.21.15.110:6833/413962747":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/2038389426":"2023-08-26T04:15:46.532863+0000","172.21.15.110:0/2105887625":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/1030503486":"2023-08-26T04:15:46.532863+0000","172.21.15.110:0/1400443768":"2023-08-26T04:15:46.532863+0000","172.21.15.110:0/1413171589":"2023-08-26T04:15:46.532863+0000","172.21.15.110:6833/3210220484":"2023-08-26T04:15:46.532863+0000","172.21.15.110:0/1790436010":"2023-08-26T04:15:46.532863+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":10,"length":1},{"begin":21,"length":2},{"begin":33,"length":1},{"begin":43,"length":1},{"begin":54,"length":1},{"begin":64,"length":1},{"begin":75,"length":1},{"begin":86,"length":1},{"begin":97,"length":1},{"begin":103,"length":1},{"begin":107,"length":1},{"begin":210,"length":12}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:15:49.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.241+0000 7fa8f2737640 1 -- 172.21.15.55:0/36771377 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fa8d8065740 msgr2=0x7fa8d8067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:49.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.241+0000 7fa8f2737640 1 --2- 172.21.15.55:0/36771377 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fa8d8065740 0x7fa8d8067c00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0687f0 tx=0x7fa8dc008040 comp rx=0 tx=0).stop 2023-08-25T04:15:49.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.241+0000 7fa8f2737640 1 -- 172.21.15.55:0/36771377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8ec0c8f50 msgr2=0x7fa8ec150cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:49.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.241+0000 7fa8f2737640 1 --2- 172.21.15.55:0/36771377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8ec0c8f50 0x7fa8ec150cc0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa8e001c210 tx=0x7fa8d4005800 comp rx=0 tx=0).stop 2023-08-25T04:15:49.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.241+0000 7fa8f2737640 1 -- 172.21.15.55:0/36771377 shutdown_connections 2023-08-25T04:15:49.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.241+0000 7fa8f2737640 1 --2- 172.21.15.55:0/36771377 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fa8d8065740 0x7fa8d8067c00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.241+0000 7fa8f2737640 1 --2- 172.21.15.55:0/36771377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8ec06abc0 0x7fa8ec14d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.241+0000 7fa8f2737640 1 --2- 172.21.15.55:0/36771377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8ec0c8f50 0x7fa8ec150cc0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.241+0000 7fa8f2737640 1 --2- 172.21.15.55:0/36771377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8d40047d0 0x7fa8ec0c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.241+0000 7fa8f2737640 1 -- 172.21.15.55:0/36771377 >> 172.21.15.55:0/36771377 conn(0x7fa8ec09bae0 msgr2=0x7fa8ec15c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:49.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.241+0000 7fa8f2737640 1 -- 172.21.15.55:0/36771377 shutdown_connections 2023-08-25T04:15:49.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.241+0000 7fa8f2737640 1 -- 172.21.15.55:0/36771377 wait complete. 2023-08-25T04:15:49.260 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-25T04:15:49.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.405+0000 7f5dacb67640 1 Processor -- start 2023-08-25T04:15:49.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.405+0000 7f5dacb67640 1 -- start start 2023-08-25T04:15:49.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.405+0000 7f5dacb67640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5da80cfa70 0x7f5da8160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.405+0000 7f5dacb67640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5da806b2b0 0x7f5da806b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.405+0000 7f5dacb67640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da806eaf0 con 0x7f5da815c9c0 2023-08-25T04:15:49.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.405+0000 7f5dacb67640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da806e530 con 0x7f5da806b2b0 2023-08-25T04:15:49.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.405+0000 7f5dacb67640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da806e810 con 0x7f5da80cfa70 2023-08-25T04:15:49.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.405+0000 7f5da659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5da815c9c0 0x7f5da8160510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53648/0 (socket says 172.21.15.55:53648) 2023-08-25T04:15:49.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.405+0000 7f5da659c640 1 -- 172.21.15.55:0/852036093 learned_addr learned my addr 172.21.15.55:0/852036093 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:49.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.405+0000 7f5da6d9d640 1 --2- 172.21.15.55:0/852036093 >> v2:172.21.15.55:3300/0 conn(0x7f5da806b2b0 0x7f5da806b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.405+0000 7f5d9dd9b640 1 --2- 172.21.15.55:0/852036093 >> v2:172.21.15.110:3300/0 conn(0x7f5da80cfa70 0x7f5da8160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.405+0000 7f5da5d9b640 1 -- 172.21.15.55:0/852036093 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424800205 0 0) 0x7f5da806eaf0 con 0x7f5da815c9c0 2023-08-25T04:15:49.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.405+0000 7f5da5d9b640 1 -- 172.21.15.55:0/852036093 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d94003530 con 0x7f5da815c9c0 2023-08-25T04:15:49.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.405+0000 7f5da6d9d640 1 -- 172.21.15.55:0/852036093 >> v2:172.21.15.110:3300/0 conn(0x7f5da80cfa70 msgr2=0x7f5da8160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:49.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.405+0000 7f5da6d9d640 1 --2- 172.21.15.55:0/852036093 >> v2:172.21.15.110:3300/0 conn(0x7f5da80cfa70 0x7f5da8160c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.405+0000 7f5da6d9d640 1 -- 172.21.15.55:0/852036093 >> v1:172.21.15.55:6789/0 conn(0x7f5da815c9c0 legacy=0x7f5da8160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:49.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.405+0000 7f5da6d9d640 1 -- 172.21.15.55:0/852036093 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da806aab0 con 0x7f5da806b2b0 2023-08-25T04:15:49.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.409+0000 7f5da6d9d640 1 --2- 172.21.15.55:0/852036093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5da806b2b0 0x7f5da806b740 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5da80d16a0 tx=0x7f5da001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664e30a0957de114 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:49.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.409+0000 7f5da5d9b640 1 -- 172.21.15.55:0/852036093 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da00ab5f0 con 0x7f5da806b2b0 2023-08-25T04:15:49.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.409+0000 7f5da5d9b640 1 -- 172.21.15.55:0/852036093 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da00ab750 con 0x7f5da806b2b0 2023-08-25T04:15:49.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.409+0000 7f5da5d9b640 1 -- 172.21.15.55:0/852036093 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da00abae0 con 0x7f5da806b2b0 2023-08-25T04:15:49.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.409+0000 7f5dacb67640 1 -- 172.21.15.55:0/852036093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5da806b2b0 msgr2=0x7f5da806b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:49.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.409+0000 7f5dacb67640 1 --2- 172.21.15.55:0/852036093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5da806b2b0 0x7f5da806b740 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5da80d16a0 tx=0x7f5da001c430 comp rx=0 tx=0).stop 2023-08-25T04:15:49.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.409+0000 7f5dacb67640 1 -- 172.21.15.55:0/852036093 shutdown_connections 2023-08-25T04:15:49.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.409+0000 7f5dacb67640 1 --2- 172.21.15.55:0/852036093 >> v2:172.21.15.110:3300/0 conn(0x7f5da80cfa70 0x7f5da8160c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.409+0000 7f5dacb67640 1 --2- 172.21.15.55:0/852036093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5da806b2b0 0x7f5da806b740 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.409+0000 7f5dacb67640 1 -- 172.21.15.55:0/852036093 >> 172.21.15.55:0/852036093 conn(0x7f5da80d05a0 msgr2=0x7f5da80d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:49.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.409+0000 7f5dacb67640 1 -- 172.21.15.55:0/852036093 shutdown_connections 2023-08-25T04:15:49.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.409+0000 7f5dacb67640 1 -- 172.21.15.55:0/852036093 wait complete. 2023-08-25T04:15:49.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5dacb67640 1 Processor -- start 2023-08-25T04:15:49.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5dacb67640 1 -- start start 2023-08-25T04:15:49.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5dacb67640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5da806b2b0 0x7f5da8149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5dacb67640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5da80cfa70 0x7f5da80c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5dacb67640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5da815c9c0 0x7f5da81529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5dacb67640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da80c6730 con 0x7f5da80cfa70 2023-08-25T04:15:49.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5dacb67640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da80c6f00 con 0x7f5da815c9c0 2023-08-25T04:15:49.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5dacb67640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da814a340 con 0x7f5da806b2b0 2023-08-25T04:15:49.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5d9dd9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5da80cfa70 0x7f5da80c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5d9dd9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5da80cfa70 0x7f5da80c4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58486/0 (socket says 172.21.15.55:58486) 2023-08-25T04:15:49.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5d9dd9b640 1 -- 172.21.15.55:0/3680137213 learned_addr learned my addr 172.21.15.55:0/3680137213 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:49.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5da659c640 1 --2- 172.21.15.55:0/3680137213 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5da806b2b0 0x7f5da8149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5da6d9d640 1 --2- 172.21.15.55:0/3680137213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5da815c9c0 0x7f5da81529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5d9dd9b640 1 -- 172.21.15.55:0/3680137213 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5da806b2b0 msgr2=0x7f5da8149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:49.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5d9dd9b640 1 --2- 172.21.15.55:0/3680137213 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5da806b2b0 0x7f5da8149700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5d9dd9b640 1 -- 172.21.15.55:0/3680137213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5da815c9c0 msgr2=0x7f5da81529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:49.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5d9dd9b640 1 --2- 172.21.15.55:0/3680137213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5da815c9c0 0x7f5da81529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5d9dd9b640 1 -- 172.21.15.55:0/3680137213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da0009420 con 0x7f5da80cfa70 2023-08-25T04:15:49.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5da659c640 1 --2- 172.21.15.55:0/3680137213 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5da806b2b0 0x7f5da8149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:15:49.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5d9dd9b640 1 --2- 172.21.15.55:0/3680137213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5da80cfa70 0x7f5da80c4cd0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000e930 tx=0x7f5d9000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:49.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5d9f7fe640 1 -- 172.21.15.55:0/3680137213 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d90009690 con 0x7f5da80cfa70 2023-08-25T04:15:49.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5d9f7fe640 1 -- 172.21.15.55:0/3680137213 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9000ca00 con 0x7f5da80cfa70 2023-08-25T04:15:49.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5d9f7fe640 1 -- 172.21.15.55:0/3680137213 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000cd70 con 0x7f5da80cfa70 2023-08-25T04:15:49.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5dacb67640 1 -- 172.21.15.55:0/3680137213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da80c6940 con 0x7f5da80cfa70 2023-08-25T04:15:49.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.413+0000 7f5dacb67640 1 -- 172.21.15.55:0/3680137213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da8149fd0 con 0x7f5da80cfa70 2023-08-25T04:15:49.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.417+0000 7f5dacb67640 1 -- 172.21.15.55:0/3680137213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da814a4b0 con 0x7f5da80cfa70 2023-08-25T04:15:49.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.417+0000 7f5d9f7fe640 1 -- 172.21.15.55:0/3680137213 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f5d90013470 con 0x7f5da80cfa70 2023-08-25T04:15:49.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.417+0000 7f5d9f7fe640 1 --2- 172.21.15.55:0/3680137213 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f5d88065710 0x7f5d88067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.417+0000 7f5d9f7fe640 1 -- 172.21.15.55:0/3680137213 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6940+0+0 (secure 0 0 0) 0x7f5d900837e0 con 0x7f5da80cfa70 2023-08-25T04:15:49.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.417+0000 7f5da659c640 1 --2- 172.21.15.55:0/3680137213 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f5d88065710 0x7f5d88067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.417+0000 7f5da659c640 1 --2- 172.21.15.55:0/3680137213 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f5d88065710 0x7f5d88067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5d98001470 tx=0x7f5d98009040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:49.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.421+0000 7f5d9f7fe640 1 -- 172.21.15.55:0/3680137213 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5d90050f90 con 0x7f5da80cfa70 2023-08-25T04:15:49.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.613+0000 7f5dacb67640 1 -- 172.21.15.55:0/3680137213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5da81610e0 con 0x7f5da80cfa70 2023-08-25T04:15:49.612 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-08-25T04:15:49.613+0000 7f7f18c38640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-25T04:15:49.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.617+0000 7f5d9f7fe640 1 -- 172.21.15.55:0/3680137213 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5d900545b0 con 0x7f5da80cfa70 2023-08-25T04:15:49.618 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-25T04:15:49.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.621+0000 7f5dacb67640 1 -- 172.21.15.55:0/3680137213 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f5d88065710 msgr2=0x7f5d88067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:49.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.621+0000 7f5dacb67640 1 --2- 172.21.15.55:0/3680137213 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f5d88065710 0x7f5d88067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5d98001470 tx=0x7f5d98009040 comp rx=0 tx=0).stop 2023-08-25T04:15:49.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.621+0000 7f5dacb67640 1 -- 172.21.15.55:0/3680137213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5da80cfa70 msgr2=0x7f5da80c4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:49.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.621+0000 7f5dacb67640 1 --2- 172.21.15.55:0/3680137213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5da80cfa70 0x7f5da80c4cd0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000e930 tx=0x7f5d9000edf0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.621+0000 7f5dacb67640 1 -- 172.21.15.55:0/3680137213 shutdown_connections 2023-08-25T04:15:49.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.621+0000 7f5dacb67640 1 --2- 172.21.15.55:0/3680137213 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f5d88065710 0x7f5d88067bd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.621+0000 7f5dacb67640 1 --2- 172.21.15.55:0/3680137213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5da815c9c0 0x7f5da81529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.621+0000 7f5dacb67640 1 --2- 172.21.15.55:0/3680137213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5da80cfa70 0x7f5da80c4cd0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.621+0000 7f5dacb67640 1 --2- 172.21.15.55:0/3680137213 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5da806b2b0 0x7f5da8149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.621+0000 7f5dacb67640 1 -- 172.21.15.55:0/3680137213 >> 172.21.15.55:0/3680137213 conn(0x7f5da80d05a0 msgr2=0x7f5da815b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:49.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.621+0000 7f5dacb67640 1 -- 172.21.15.55:0/3680137213 shutdown_connections 2023-08-25T04:15:49.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.621+0000 7f5dacb67640 1 -- 172.21.15.55:0/3680137213 wait complete. 2023-08-25T04:15:49.650 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-25T04:15:49.695 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T04:15:49.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.797+0000 7f621a7ba640 1 Processor -- start 2023-08-25T04:15:49.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.797+0000 7f621a7ba640 1 -- start start 2023-08-25T04:15:49.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.797+0000 7f621a7ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f62140ae8e0 0x7f6214069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.797+0000 7f621a7ba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f621406a2a0 con 0x7f6214069e40 2023-08-25T04:15:49.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.797+0000 7f621a7ba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f621406d200 con 0x7f62140cef20 2023-08-25T04:15:49.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.797+0000 7f621a7ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f621406c5f0 con 0x7f62140ae8e0 2023-08-25T04:15:49.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.801+0000 7f62137fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6214069e40 0x7f62140ce810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53658/0 (socket says 172.21.15.55:53658) 2023-08-25T04:15:49.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.801+0000 7f62137fe640 1 -- 172.21.15.55:0/1564466275 learned_addr learned my addr 172.21.15.55:0/1564466275 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:49.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.801+0000 7f6213fff640 1 --2- 172.21.15.55:0/1564466275 >> v2:172.21.15.110:3300/0 conn(0x7f62140ae8e0 0x7f6214069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.801+0000 7f6212ffd640 1 -- 172.21.15.55:0/1564466275 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465356789 0 0) 0x7f621406a2a0 con 0x7f6214069e40 2023-08-25T04:15:49.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.801+0000 7f6212ffd640 1 -- 172.21.15.55:0/1564466275 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61fc003530 con 0x7f6214069e40 2023-08-25T04:15:49.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.801+0000 7f6213fff640 1 -- 172.21.15.55:0/1564466275 >> v1:172.21.15.110:6789/0 conn(0x7f62140cef20 legacy=0x7f621415c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:49.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.801+0000 7f6213fff640 1 -- 172.21.15.55:0/1564466275 >> v1:172.21.15.55:6789/0 conn(0x7f6214069e40 legacy=0x7f62140ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:49.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.801+0000 7f6213fff640 1 -- 172.21.15.55:0/1564466275 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621406c8d0 con 0x7f62140ae8e0 2023-08-25T04:15:49.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.801+0000 7f6213fff640 1 --2- 172.21.15.55:0/1564466275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62140ae8e0 0x7f6214069900 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f62040097c0 tx=0x7f620401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d4baaaf5037d6fe server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:49.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.801+0000 7f6212ffd640 1 -- 172.21.15.55:0/1564466275 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62040ab650 con 0x7f62140ae8e0 2023-08-25T04:15:49.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.801+0000 7f6212ffd640 1 -- 172.21.15.55:0/1564466275 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62040ab7b0 con 0x7f62140ae8e0 2023-08-25T04:15:49.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.801+0000 7f6212ffd640 1 -- 172.21.15.55:0/1564466275 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62040abb40 con 0x7f62140ae8e0 2023-08-25T04:15:49.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f621a7ba640 1 -- 172.21.15.55:0/1564466275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62140ae8e0 msgr2=0x7f6214069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:49.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f621a7ba640 1 --2- 172.21.15.55:0/1564466275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62140ae8e0 0x7f6214069900 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f62040097c0 tx=0x7f620401c480 comp rx=0 tx=0).stop 2023-08-25T04:15:49.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f621a7ba640 1 -- 172.21.15.55:0/1564466275 shutdown_connections 2023-08-25T04:15:49.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f621a7ba640 1 --2- 172.21.15.55:0/1564466275 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62140ae8e0 0x7f6214069900 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f621a7ba640 1 -- 172.21.15.55:0/1564466275 >> 172.21.15.55:0/1564466275 conn(0x7f62140cf4d0 msgr2=0x7f62140cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:49.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f621a7ba640 1 -- 172.21.15.55:0/1564466275 shutdown_connections 2023-08-25T04:15:49.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f621a7ba640 1 -- 172.21.15.55:0/1564466275 wait complete. 2023-08-25T04:15:49.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f621a7ba640 1 Processor -- start 2023-08-25T04:15:49.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f621a7ba640 1 -- start start 2023-08-25T04:15:49.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f621a7ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6214069e40 0x7f621414f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f621a7ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62140ae8e0 0x7f6214166eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f621a7ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62140cef20 0x7f62140c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f621a7ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6214167e10 con 0x7f62140cef20 2023-08-25T04:15:49.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f621a7ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6214153db0 con 0x7f62140ae8e0 2023-08-25T04:15:49.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f621a7ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6214167850 con 0x7f6214069e40 2023-08-25T04:15:49.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f6218d57640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62140cef20 0x7f62140c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f6218d57640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62140cef20 0x7f62140c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58504/0 (socket says 172.21.15.55:58504) 2023-08-25T04:15:49.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f6218d57640 1 -- 172.21.15.55:0/539032414 learned_addr learned my addr 172.21.15.55:0/539032414 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:49.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f6213fff640 1 --2- 172.21.15.55:0/539032414 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6214069e40 0x7f621414f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.805+0000 7f62137fe640 1 --2- 172.21.15.55:0/539032414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62140ae8e0 0x7f6214166eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.809+0000 7f6218d57640 1 -- 172.21.15.55:0/539032414 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6214069e40 msgr2=0x7f621414f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:49.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.809+0000 7f6218d57640 1 --2- 172.21.15.55:0/539032414 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6214069e40 0x7f621414f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.809+0000 7f6218d57640 1 -- 172.21.15.55:0/539032414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62140ae8e0 msgr2=0x7f6214166eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:49.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.809+0000 7f6218d57640 1 --2- 172.21.15.55:0/539032414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62140ae8e0 0x7f6214166eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:49.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.809+0000 7f6218d57640 1 -- 172.21.15.55:0/539032414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6204009420 con 0x7f62140cef20 2023-08-25T04:15:49.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.809+0000 7f62137fe640 1 --2- 172.21.15.55:0/539032414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62140ae8e0 0x7f6214166eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:49.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.809+0000 7f6218d57640 1 --2- 172.21.15.55:0/539032414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62140cef20 0x7f62140c75b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f620c00c7a0 tx=0x7f620c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:49.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.809+0000 7f6210ff9640 1 -- 172.21.15.55:0/539032414 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c003b80 con 0x7f62140cef20 2023-08-25T04:15:49.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.809+0000 7f6210ff9640 1 -- 172.21.15.55:0/539032414 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620c003ce0 con 0x7f62140cef20 2023-08-25T04:15:49.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.809+0000 7f6210ff9640 1 -- 172.21.15.55:0/539032414 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c00aa90 con 0x7f62140cef20 2023-08-25T04:15:49.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.809+0000 7f621a7ba640 1 -- 172.21.15.55:0/539032414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6214167b30 con 0x7f62140cef20 2023-08-25T04:15:49.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.809+0000 7f621a7ba640 1 -- 172.21.15.55:0/539032414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621414fd00 con 0x7f62140cef20 2023-08-25T04:15:49.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.809+0000 7f621a7ba640 1 -- 172.21.15.55:0/539032414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62141538a0 con 0x7f62140cef20 2023-08-25T04:15:49.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.809+0000 7f6210ff9640 1 -- 172.21.15.55:0/539032414 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 17) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f620c00abf0 con 0x7f62140cef20 2023-08-25T04:15:49.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.809+0000 7f6210ff9640 1 --2- 172.21.15.55:0/539032414 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f6200065710 0x7f6200067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:49.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.809+0000 7f6210ff9640 1 -- 172.21.15.55:0/539032414 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 7026+0+0 (secure 0 0 0) 0x7f620c082f50 con 0x7f62140cef20 2023-08-25T04:15:49.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.809+0000 7f6213fff640 1 --2- 172.21.15.55:0/539032414 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f6200065710 0x7f6200067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:49.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.813+0000 7f6213fff640 1 --2- 172.21.15.55:0/539032414 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f6200065710 0x7f6200067bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f62040af000 tx=0x7f62040a7000 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:49.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:49.813+0000 7f6210ff9640 1 -- 172.21.15.55:0/539032414 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f620c0b3d90 con 0x7f62140cef20 2023-08-25T04:15:50.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.001+0000 7f621a7ba640 1 -- 172.21.15.55:0/539032414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6214073ec0 con 0x7f62140cef20 2023-08-25T04:15:50.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.645+0000 7f6210ff9640 1 -- 172.21.15.55:0/539032414 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f620c050a20 con 0x7f62140cef20 2023-08-25T04:15:50.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.645+0000 7f6210ff9640 1 -- 172.21.15.55:0/539032414 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f620c053c70 con 0x7f62140cef20 2023-08-25T04:15:50.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.649+0000 7f621a7ba640 1 -- 172.21.15.55:0/539032414 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f6200065710 msgr2=0x7f6200067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:50.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.649+0000 7f621a7ba640 1 --2- 172.21.15.55:0/539032414 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f6200065710 0x7f6200067bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f62040af000 tx=0x7f62040a7000 comp rx=0 tx=0).stop 2023-08-25T04:15:50.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.649+0000 7f621a7ba640 1 -- 172.21.15.55:0/539032414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62140cef20 msgr2=0x7f62140c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:50.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.649+0000 7f621a7ba640 1 --2- 172.21.15.55:0/539032414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62140cef20 0x7f62140c75b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f620c00c7a0 tx=0x7f620c00cc60 comp rx=0 tx=0).stop 2023-08-25T04:15:50.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.649+0000 7f621a7ba640 1 -- 172.21.15.55:0/539032414 shutdown_connections 2023-08-25T04:15:50.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.649+0000 7f621a7ba640 1 --2- 172.21.15.55:0/539032414 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f6200065710 0x7f6200067bd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:50.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.649+0000 7f621a7ba640 1 --2- 172.21.15.55:0/539032414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62140cef20 0x7f62140c75b0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:50.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.649+0000 7f621a7ba640 1 --2- 172.21.15.55:0/539032414 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62140ae8e0 0x7f6214166eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:50.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.649+0000 7f621a7ba640 1 --2- 172.21.15.55:0/539032414 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6214069e40 0x7f621414f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:50.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.649+0000 7f621a7ba640 1 -- 172.21.15.55:0/539032414 >> 172.21.15.55:0/539032414 conn(0x7f62140cf4d0 msgr2=0x7f62140acfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:50.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.649+0000 7f621a7ba640 1 -- 172.21.15.55:0/539032414 shutdown_connections 2023-08-25T04:15:50.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.649+0000 7f621a7ba640 1 -- 172.21.15.55:0/539032414 wait complete. 2023-08-25T04:15:50.669 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-25T04:15:50.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f81302bd640 1 Processor -- start 2023-08-25T04:15:50.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f81302bd640 1 -- start start 2023-08-25T04:15:50.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f81302bd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8128155360 0x7f812815c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:50.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f81302bd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8128155740 0x7f812815eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:50.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f81302bd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f812806fb50 0x7f81280aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:50.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f81302bd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812815fa50 con 0x7f812806fb50 2023-08-25T04:15:50.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f81302bd640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812815f490 con 0x7f8128155740 2023-08-25T04:15:50.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f81302bd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812815f770 con 0x7f8128155360 2023-08-25T04:15:50.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f812e85a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f812806fb50 0x7f81280aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:50.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f812e85a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f812806fb50 0x7f81280aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51686/0 (socket says 172.21.15.55:51686) 2023-08-25T04:15:50.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f812e85a640 1 -- 172.21.15.55:0/3747874412 learned_addr learned my addr 172.21.15.55:0/3747874412 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:50.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f812d858640 1 --2- 172.21.15.55:0/3747874412 >> v2:172.21.15.110:3300/0 conn(0x7f8128155740 0x7f812815eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:50.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f812e059640 1 --2- 172.21.15.55:0/3747874412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8128155360 0x7f812815c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:50.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f812e85a640 1 -- 172.21.15.55:0/3747874412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8128155360 msgr2=0x7f812815c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:50.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f812e85a640 1 --2- 172.21.15.55:0/3747874412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8128155360 0x7f812815c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:50.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f812e85a640 1 -- 172.21.15.55:0/3747874412 >> v2:172.21.15.110:3300/0 conn(0x7f8128155740 msgr2=0x7f812815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:50.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f812e85a640 1 --2- 172.21.15.55:0/3747874412 >> v2:172.21.15.110:3300/0 conn(0x7f8128155740 0x7f812815eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:50.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f812e85a640 1 -- 172.21.15.55:0/3747874412 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81280ccb40 con 0x7f812806fb50 2023-08-25T04:15:50.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.865+0000 7f812d858640 1 --2- 172.21.15.55:0/3747874412 >> v2:172.21.15.110:3300/0 conn(0x7f8128155740 0x7f812815eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:50.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.869+0000 7f812e85a640 1 --2- 172.21.15.55:0/3747874412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f812806fb50 0x7f81280aff90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f812806a910 tx=0x7f812001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c2f47bc3777d63 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:50.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.869+0000 7f812d057640 1 -- 172.21.15.55:0/3747874412 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81200a5530 con 0x7f812806fb50 2023-08-25T04:15:50.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.869+0000 7f812d057640 1 -- 172.21.15.55:0/3747874412 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81200a5690 con 0x7f812806fb50 2023-08-25T04:15:50.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.869+0000 7f812d057640 1 -- 172.21.15.55:0/3747874412 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81200a5a20 con 0x7f812806fb50 2023-08-25T04:15:50.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.869+0000 7f81302bd640 1 -- 172.21.15.55:0/3747874412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f812806fb50 msgr2=0x7f81280aff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:50.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.869+0000 7f81302bd640 1 --2- 172.21.15.55:0/3747874412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f812806fb50 0x7f81280aff90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f812806a910 tx=0x7f812001c8b0 comp rx=0 tx=0).stop 2023-08-25T04:15:50.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.873+0000 7f81302bd640 1 -- 172.21.15.55:0/3747874412 shutdown_connections 2023-08-25T04:15:50.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.873+0000 7f81302bd640 1 --2- 172.21.15.55:0/3747874412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f812806fb50 0x7f81280aff90 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:50.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.873+0000 7f81302bd640 1 --2- 172.21.15.55:0/3747874412 >> v2:172.21.15.110:3300/0 conn(0x7f8128155740 0x7f812815eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:50.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.873+0000 7f81302bd640 1 --2- 172.21.15.55:0/3747874412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8128155360 0x7f812815c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:50.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.873+0000 7f81302bd640 1 -- 172.21.15.55:0/3747874412 >> 172.21.15.55:0/3747874412 conn(0x7f81280caf90 msgr2=0x7f81280cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:50.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.873+0000 7f81302bd640 1 -- 172.21.15.55:0/3747874412 shutdown_connections 2023-08-25T04:15:50.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.873+0000 7f81302bd640 1 -- 172.21.15.55:0/3747874412 wait complete. 2023-08-25T04:15:50.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.873+0000 7f81302bd640 1 Processor -- start 2023-08-25T04:15:50.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.873+0000 7f81302bd640 1 -- start start 2023-08-25T04:15:50.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f81302bd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f812806fb50 0x7f81280b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:50.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f81302bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8128155360 0x7f81280c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:50.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f81302bd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8128155740 0x7f81280b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:50.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f81302bd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81280c6d50 con 0x7f8128155360 2023-08-25T04:15:50.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f81302bd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81281fdfe0 con 0x7f8128155740 2023-08-25T04:15:50.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f81302bd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81281fe2c0 con 0x7f812806fb50 2023-08-25T04:15:50.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f812e059640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f812806fb50 0x7f81280b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:50.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f812e059640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f812806fb50 0x7f81280b3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:50432/0 (socket says 172.21.15.55:50432) 2023-08-25T04:15:50.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f812e059640 1 -- 172.21.15.55:0/3443188140 learned_addr learned my addr 172.21.15.55:0/3443188140 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:50.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f812e85a640 1 --2- 172.21.15.55:0/3443188140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8128155740 0x7f81280b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:50.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f812d858640 1 --2- 172.21.15.55:0/3443188140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8128155360 0x7f81280c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:50.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f812e85a640 1 -- 172.21.15.55:0/3443188140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f812806fb50 msgr2=0x7f81280b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:50.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f812e85a640 1 --2- 172.21.15.55:0/3443188140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f812806fb50 0x7f81280b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:50.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f812e85a640 1 -- 172.21.15.55:0/3443188140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8128155360 msgr2=0x7f81280c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:50.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f812e85a640 1 --2- 172.21.15.55:0/3443188140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8128155360 0x7f81280c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:50.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f812e85a640 1 -- 172.21.15.55:0/3443188140 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8120009b30 con 0x7f8128155740 2023-08-25T04:15:50.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f812e059640 1 --2- 172.21.15.55:0/3443188140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f812806fb50 0x7f81280b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:15:50.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f812e85a640 1 --2- 172.21.15.55:0/3443188140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8128155740 0x7f81280b19b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f81200ab000 tx=0x7f8120019650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:50.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f811effd640 1 -- 172.21.15.55:0/3443188140 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81200a5530 con 0x7f8128155740 2023-08-25T04:15:50.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f811effd640 1 -- 172.21.15.55:0/3443188140 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8120009510 con 0x7f8128155740 2023-08-25T04:15:50.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f81302bd640 1 -- 172.21.15.55:0/3443188140 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81280c69e0 con 0x7f8128155740 2023-08-25T04:15:50.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f811effd640 1 -- 172.21.15.55:0/3443188140 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81200b8690 con 0x7f8128155740 2023-08-25T04:15:50.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.877+0000 7f81302bd640 1 -- 172.21.15.55:0/3443188140 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81280c6620 con 0x7f8128155740 2023-08-25T04:15:50.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.881+0000 7f81302bd640 1 -- 172.21.15.55:0/3443188140 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81280c6ec0 con 0x7f8128155740 2023-08-25T04:15:50.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.881+0000 7f811effd640 1 -- 172.21.15.55:0/3443188140 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f81200b87f0 con 0x7f8128155740 2023-08-25T04:15:50.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.881+0000 7f811effd640 1 --2- 172.21.15.55:0/3443188140 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f810c0657a0 0x7f810c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:50.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.881+0000 7f811effd640 1 -- 172.21.15.55:0/3443188140 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7026+0+0 (secure 0 0 0) 0x7f812011e1f0 con 0x7f8128155740 2023-08-25T04:15:50.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.881+0000 7f812e059640 1 --2- 172.21.15.55:0/3443188140 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f810c0657a0 0x7f810c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:50.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.881+0000 7f812e059640 1 --2- 172.21.15.55:0/3443188140 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f810c0657a0 0x7f810c067c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f812400bf80 tx=0x7f8124008040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:50.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:50.885+0000 7f811effd640 1 -- 172.21.15.55:0/3443188140 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f81200eb990 con 0x7f8128155740 2023-08-25T04:15:51.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.045+0000 7f81302bd640 1 -- 172.21.15.55:0/3443188140 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f812804dbe0 con 0x7f8128155740 2023-08-25T04:15:51.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.653+0000 7f811effd640 1 -- 172.21.15.55:0/3443188140 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) v1 ==== 181+0+0 (secure 0 0 0) 0x7f81200eefb0 con 0x7f8128155740 2023-08-25T04:15:51.655 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-08-25T04:15:51.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.657+0000 7f81302bd640 1 -- 172.21.15.55:0/3443188140 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f810c0657a0 msgr2=0x7f810c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.657+0000 7f81302bd640 1 --2- 172.21.15.55:0/3443188140 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f810c0657a0 0x7f810c067c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f812400bf80 tx=0x7f8124008040 comp rx=0 tx=0).stop 2023-08-25T04:15:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.657+0000 7f81302bd640 1 -- 172.21.15.55:0/3443188140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8128155740 msgr2=0x7f81280b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.657+0000 7f81302bd640 1 --2- 172.21.15.55:0/3443188140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8128155740 0x7f81280b19b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f81200ab000 tx=0x7f8120019650 comp rx=0 tx=0).stop 2023-08-25T04:15:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.657+0000 7f81302bd640 1 -- 172.21.15.55:0/3443188140 shutdown_connections 2023-08-25T04:15:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.657+0000 7f81302bd640 1 --2- 172.21.15.55:0/3443188140 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f810c0657a0 0x7f810c067c60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.657+0000 7f81302bd640 1 --2- 172.21.15.55:0/3443188140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8128155740 0x7f81280b19b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:51.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.657+0000 7f81302bd640 1 --2- 172.21.15.55:0/3443188140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8128155360 0x7f81280c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:51.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.657+0000 7f81302bd640 1 --2- 172.21.15.55:0/3443188140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f812806fb50 0x7f81280b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:51.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.657+0000 7f81302bd640 1 -- 172.21.15.55:0/3443188140 >> 172.21.15.55:0/3443188140 conn(0x7f81280caf90 msgr2=0x7f812806a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:51.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.657+0000 7f81302bd640 1 -- 172.21.15.55:0/3443188140 shutdown_connections 2023-08-25T04:15:51.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.657+0000 7f81302bd640 1 -- 172.21.15.55:0/3443188140 wait complete. 2023-08-25T04:15:51.679 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-25T04:15:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.841+0000 7f41d498f640 1 Processor -- start 2023-08-25T04:15:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.841+0000 7f41d498f640 1 -- start start 2023-08-25T04:15:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.841+0000 7f41d498f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f41d00ca880 0x7f41d0069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.841+0000 7f41d498f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d00cc970 con 0x7f41d00ca4a0 2023-08-25T04:15:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.841+0000 7f41d498f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d00ccc50 con 0x7f41d00c8b60 2023-08-25T04:15:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.841+0000 7f41d498f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d00ccf30 con 0x7f41d00ca880 2023-08-25T04:15:51.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.841+0000 7f41ce59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f41d00ca4a0 0x7f41d015a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44848/0 (socket says 172.21.15.55:44848) 2023-08-25T04:15:51.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.841+0000 7f41ce59c640 1 -- 172.21.15.55:0/2836987744 learned_addr learned my addr 172.21.15.55:0/2836987744 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:51.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.841+0000 7f41cdd9b640 1 --2- 172.21.15.55:0/2836987744 >> v2:172.21.15.55:3300/0 conn(0x7f41d00ca880 0x7f41d0069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:51.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.841+0000 7f41cdd9b640 1 -- 172.21.15.55:0/2836987744 >> v1:172.21.15.110:6789/0 conn(0x7f41d00c8b60 legacy=0x7f41d0153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:51.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.841+0000 7f41cdd9b640 1 -- 172.21.15.55:0/2836987744 >> v1:172.21.15.55:6789/0 conn(0x7f41d00ca4a0 legacy=0x7f41d015a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:51.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.841+0000 7f41cdd9b640 1 -- 172.21.15.55:0/2836987744 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d00cd210 con 0x7f41d00ca880 2023-08-25T04:15:51.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.841+0000 7f41cd59a640 1 -- 172.21.15.55:0/2836987744 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577273829 0 0) 0x7f41d00cc970 con 0x7f41d00ca4a0 2023-08-25T04:15:51.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.845+0000 7f41cdd9b640 1 --2- 172.21.15.55:0/2836987744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41d00ca880 0x7f41d0069900 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f41c40097c0 tx=0x7f41c401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb2af12d940266 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:51.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.845+0000 7f41cd59a640 1 -- 172.21.15.55:0/2836987744 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c4004230 con 0x7f41d00ca880 2023-08-25T04:15:51.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.845+0000 7f41cd59a640 1 -- 172.21.15.55:0/2836987744 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c40a7050 con 0x7f41d00ca880 2023-08-25T04:15:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.845+0000 7f41cd59a640 1 -- 172.21.15.55:0/2836987744 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c4003620 con 0x7f41d00ca880 2023-08-25T04:15:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.845+0000 7f41d498f640 1 -- 172.21.15.55:0/2836987744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41d00ca880 msgr2=0x7f41d0069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.845+0000 7f41d498f640 1 --2- 172.21.15.55:0/2836987744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41d00ca880 0x7f41d0069900 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f41c40097c0 tx=0x7f41c401c3b0 comp rx=0 tx=0).stop 2023-08-25T04:15:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.845+0000 7f41d498f640 1 -- 172.21.15.55:0/2836987744 shutdown_connections 2023-08-25T04:15:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.845+0000 7f41d498f640 1 --2- 172.21.15.55:0/2836987744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41d00ca880 0x7f41d0069900 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.845+0000 7f41d498f640 1 -- 172.21.15.55:0/2836987744 >> 172.21.15.55:0/2836987744 conn(0x7f41d00caf90 msgr2=0x7f41d00cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.845+0000 7f41d498f640 1 -- 172.21.15.55:0/2836987744 shutdown_connections 2023-08-25T04:15:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.845+0000 7f41d498f640 1 -- 172.21.15.55:0/2836987744 wait complete. 2023-08-25T04:15:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41d498f640 1 Processor -- start 2023-08-25T04:15:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41d498f640 1 -- start start 2023-08-25T04:15:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41d498f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d00c8b60 0x7f41d00c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41d498f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41d00ca4a0 0x7f41d00ae970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41d498f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41d00ca880 0x7f41d00aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41d498f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d014cab0 con 0x7f41d00ca880 2023-08-25T04:15:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41d498f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d00abe90 con 0x7f41d00c8b60 2023-08-25T04:15:51.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41d498f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d00ab880 con 0x7f41d00ca4a0 2023-08-25T04:15:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41ced9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41d00ca880 0x7f41d00aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41ced9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41d00ca880 0x7f41d00aeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51704/0 (socket says 172.21.15.55:51704) 2023-08-25T04:15:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41ced9d640 1 -- 172.21.15.55:0/2365806451 learned_addr learned my addr 172.21.15.55:0/2365806451 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41ce59c640 1 --2- 172.21.15.55:0/2365806451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d00c8b60 0x7f41d00c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41cdd9b640 1 --2- 172.21.15.55:0/2365806451 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41d00ca4a0 0x7f41d00ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41ced9d640 1 -- 172.21.15.55:0/2365806451 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41d00ca4a0 msgr2=0x7f41d00ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41ced9d640 1 --2- 172.21.15.55:0/2365806451 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41d00ca4a0 0x7f41d00ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41ced9d640 1 -- 172.21.15.55:0/2365806451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d00c8b60 msgr2=0x7f41d00c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:51.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41ced9d640 1 --2- 172.21.15.55:0/2365806451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d00c8b60 0x7f41d00c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:51.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41ced9d640 1 -- 172.21.15.55:0/2365806451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c4009420 con 0x7f41d00ca880 2023-08-25T04:15:51.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41ced9d640 1 --2- 172.21.15.55:0/2365806451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41d00ca880 0x7f41d00aeeb0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f41c800c780 tx=0x7f41c800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41beffd640 1 -- 172.21.15.55:0/2365806451 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c8004b70 con 0x7f41d00ca880 2023-08-25T04:15:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41beffd640 1 -- 172.21.15.55:0/2365806451 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c800ce90 con 0x7f41d00ca880 2023-08-25T04:15:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41d498f640 1 -- 172.21.15.55:0/2365806451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d014cca0 con 0x7f41d00ca880 2023-08-25T04:15:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41beffd640 1 -- 172.21.15.55:0/2365806451 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c800a850 con 0x7f41d00ca880 2023-08-25T04:15:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41d498f640 1 -- 172.21.15.55:0/2365806451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d00af9c0 con 0x7f41d00ca880 2023-08-25T04:15:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.849+0000 7f41d498f640 1 -- 172.21.15.55:0/2365806451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d00ac020 con 0x7f41d00ca880 2023-08-25T04:15:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.853+0000 7f41beffd640 1 -- 172.21.15.55:0/2365806451 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f41c800a9b0 con 0x7f41d00ca880 2023-08-25T04:15:51.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.853+0000 7f41beffd640 1 --2- 172.21.15.55:0/2365806451 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f41b00657a0 0x7f41b0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:51.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.853+0000 7f41beffd640 1 -- 172.21.15.55:0/2365806451 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f41c8083310 con 0x7f41d00ca880 2023-08-25T04:15:51.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.853+0000 7f41ce59c640 1 --2- 172.21.15.55:0/2365806451 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f41b00657a0 0x7f41b0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.853+0000 7f41ce59c640 1 --2- 172.21.15.55:0/2365806451 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f41b00657a0 0x7f41b0067c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f41c0000f70 tx=0x7f41c0007b80 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:51.857+0000 7f41beffd640 1 -- 172.21.15.55:0/2365806451 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f41c8054590 con 0x7f41d00ca880 2023-08-25T04:15:52.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.013+0000 7f41d498f640 1 -- 172.21.15.55:0/2365806451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f41d004dbe0 con 0x7f41d00ca880 2023-08-25T04:15:52.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.657+0000 7f41beffd640 1 -- 172.21.15.55:0/2365806451 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) v1 ==== 169+0+0 (secure 0 0 0) 0x7f41c8054120 con 0x7f41d00ca880 2023-08-25T04:15:52.657 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-08-25T04:15:52.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.661+0000 7f41d498f640 1 -- 172.21.15.55:0/2365806451 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f41b00657a0 msgr2=0x7f41b0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:52.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.661+0000 7f41d498f640 1 --2- 172.21.15.55:0/2365806451 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f41b00657a0 0x7f41b0067c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f41c0000f70 tx=0x7f41c0007b80 comp rx=0 tx=0).stop 2023-08-25T04:15:52.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.661+0000 7f41d498f640 1 -- 172.21.15.55:0/2365806451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41d00ca880 msgr2=0x7f41d00aeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:52.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.661+0000 7f41d498f640 1 --2- 172.21.15.55:0/2365806451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41d00ca880 0x7f41d00aeeb0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f41c800c780 tx=0x7f41c800cc40 comp rx=0 tx=0).stop 2023-08-25T04:15:52.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.661+0000 7f41d498f640 1 -- 172.21.15.55:0/2365806451 shutdown_connections 2023-08-25T04:15:52.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.661+0000 7f41d498f640 1 --2- 172.21.15.55:0/2365806451 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f41b00657a0 0x7f41b0067c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:52.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.661+0000 7f41d498f640 1 --2- 172.21.15.55:0/2365806451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41d00ca880 0x7f41d00aeeb0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:52.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.661+0000 7f41d498f640 1 --2- 172.21.15.55:0/2365806451 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41d00ca4a0 0x7f41d00ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:52.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.661+0000 7f41d498f640 1 --2- 172.21.15.55:0/2365806451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d00c8b60 0x7f41d00c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:52.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.661+0000 7f41d498f640 1 -- 172.21.15.55:0/2365806451 >> 172.21.15.55:0/2365806451 conn(0x7f41d00caf90 msgr2=0x7f41d01673f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:52.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.661+0000 7f41d498f640 1 -- 172.21.15.55:0/2365806451 shutdown_connections 2023-08-25T04:15:52.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.661+0000 7f41d498f640 1 -- 172.21.15.55:0/2365806451 wait complete. 2023-08-25T04:15:52.685 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-08-25T04:15:52.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.837+0000 7fbfe4488640 1 Processor -- start 2023-08-25T04:15:52.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.837+0000 7fbfe4488640 1 -- start start 2023-08-25T04:15:52.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.837+0000 7fbfe4488640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cb020 0x7fbfdc0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:52.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.837+0000 7fbfe4488640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfdc0cdd50 0x7fbfdc0cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:52.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.837+0000 7fbfe4488640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfdc0cbca0 con 0x7fbfdc06c720 2023-08-25T04:15:52.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.837+0000 7fbfe4488640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfdc0c9470 con 0x7fbfdc0cdd50 2023-08-25T04:15:52.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.837+0000 7fbfe4488640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0ce1b0 con 0x7fbfdc0cb020 2023-08-25T04:15:52.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.837+0000 7fbfe1a23640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfdc0cdd50 0x7fbfdc0cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:52.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.837+0000 7fbfe1a23640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfdc0cdd50 0x7fbfdc0cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51712/0 (socket says 172.21.15.55:51712) 2023-08-25T04:15:52.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.837+0000 7fbfe1a23640 1 -- 172.21.15.55:0/2329304280 learned_addr learned my addr 172.21.15.55:0/2329304280 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:52.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.837+0000 7fbfe2224640 1 --2- 172.21.15.55:0/2329304280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cb020 0x7fbfdc0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:52.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.837+0000 7fbfe1a23640 1 -- 172.21.15.55:0/2329304280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cb020 msgr2=0x7fbfdc0c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:52.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.837+0000 7fbfe1a23640 1 --2- 172.21.15.55:0/2329304280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cb020 0x7fbfdc0c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:52.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.837+0000 7fbfe1a23640 1 -- 172.21.15.55:0/2329304280 >> v1:172.21.15.55:6789/0 conn(0x7fbfdc06c720 legacy=0x7fbfdc0cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:52.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.837+0000 7fbfe1a23640 1 -- 172.21.15.55:0/2329304280 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc0c8b40 con 0x7fbfdc0cdd50 2023-08-25T04:15:52.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.837+0000 7fbfe1222640 1 -- 172.21.15.55:0/2329304280 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741920843 0 0) 0x7fbfdc0cbca0 con 0x7fbfdc06c720 2023-08-25T04:15:52.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.841+0000 7fbfe1a23640 1 --2- 172.21.15.55:0/2329304280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0cdd50 0x7fbfdc0cb400 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00bb10 tx=0x7fbfcc01eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22669b8c7342410d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:52.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.841+0000 7fbfe1222640 1 -- 172.21.15.55:0/2329304280 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0a7a40 con 0x7fbfdc0cdd50 2023-08-25T04:15:52.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.841+0000 7fbfe1222640 1 -- 172.21.15.55:0/2329304280 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc0a7ba0 con 0x7fbfdc0cdd50 2023-08-25T04:15:52.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.841+0000 7fbfe1222640 1 -- 172.21.15.55:0/2329304280 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0af440 con 0x7fbfdc0cdd50 2023-08-25T04:15:52.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.841+0000 7fbfe4488640 1 -- 172.21.15.55:0/2329304280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0cdd50 msgr2=0x7fbfdc0cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:52.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.841+0000 7fbfe4488640 1 --2- 172.21.15.55:0/2329304280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0cdd50 0x7fbfdc0cb400 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00bb10 tx=0x7fbfcc01eb80 comp rx=0 tx=0).stop 2023-08-25T04:15:52.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.841+0000 7fbfe4488640 1 -- 172.21.15.55:0/2329304280 shutdown_connections 2023-08-25T04:15:52.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.841+0000 7fbfe4488640 1 --2- 172.21.15.55:0/2329304280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0cdd50 0x7fbfdc0cb400 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:52.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.841+0000 7fbfe4488640 1 --2- 172.21.15.55:0/2329304280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cb020 0x7fbfdc0c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:52.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.841+0000 7fbfe4488640 1 -- 172.21.15.55:0/2329304280 >> 172.21.15.55:0/2329304280 conn(0x7fbfdc069900 msgr2=0x7fbfdc069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:52.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.841+0000 7fbfe4488640 1 -- 172.21.15.55:0/2329304280 shutdown_connections 2023-08-25T04:15:52.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.841+0000 7fbfe4488640 1 -- 172.21.15.55:0/2329304280 wait complete. 2023-08-25T04:15:52.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe4488640 1 Processor -- start 2023-08-25T04:15:52.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe4488640 1 -- start start 2023-08-25T04:15:52.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe4488640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfdc06c720 0x7fbfdc0b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:52.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe4488640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0cb020 0x7fbfdc099f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:52.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe4488640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cdd50 0x7fbfdc0b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:52.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe4488640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0ade20 con 0x7fbfdc0cb020 2023-08-25T04:15:52.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe4488640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc09a9b0 con 0x7fbfdc06c720 2023-08-25T04:15:52.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe4488640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc09ac90 con 0x7fbfdc0cdd50 2023-08-25T04:15:52.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe1a23640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0cb020 0x7fbfdc099f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:52.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe1a23640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0cb020 0x7fbfdc099f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51722/0 (socket says 172.21.15.55:51722) 2023-08-25T04:15:52.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe1a23640 1 -- 172.21.15.55:0/1609840024 learned_addr learned my addr 172.21.15.55:0/1609840024 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:52.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe2a25640 1 --2- 172.21.15.55:0/1609840024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cdd50 0x7fbfdc0b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:52.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe2224640 1 --2- 172.21.15.55:0/1609840024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfdc06c720 0x7fbfdc0b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:52.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe1a23640 1 -- 172.21.15.55:0/1609840024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cdd50 msgr2=0x7fbfdc0b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:52.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe1a23640 1 --2- 172.21.15.55:0/1609840024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cdd50 0x7fbfdc0b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:52.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe1a23640 1 -- 172.21.15.55:0/1609840024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfdc06c720 msgr2=0x7fbfdc0b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:52.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe1a23640 1 --2- 172.21.15.55:0/1609840024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfdc06c720 0x7fbfdc0b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:52.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe1a23640 1 -- 172.21.15.55:0/1609840024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc00b770 con 0x7fbfdc0cb020 2023-08-25T04:15:52.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe2a25640 1 --2- 172.21.15.55:0/1609840024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cdd50 0x7fbfdc0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:52.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe2224640 1 --2- 172.21.15.55:0/1609840024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfdc06c720 0x7fbfdc0b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:52.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe1a23640 1 --2- 172.21.15.55:0/1609840024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0cb020 0x7fbfdc099f40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00b2c0 tx=0x7fbfcc01b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:52.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfd2ffd640 1 -- 172.21.15.55:0/1609840024 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0be070 con 0x7fbfdc0cb020 2023-08-25T04:15:52.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfd2ffd640 1 -- 172.21.15.55:0/1609840024 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc0afb70 con 0x7fbfdc0cb020 2023-08-25T04:15:52.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfd2ffd640 1 -- 172.21.15.55:0/1609840024 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc0ba440 con 0x7fbfdc0cb020 2023-08-25T04:15:52.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe4488640 1 -- 172.21.15.55:0/1609840024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfdc06d0c0 con 0x7fbfdc0cb020 2023-08-25T04:15:52.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.845+0000 7fbfe4488640 1 -- 172.21.15.55:0/1609840024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfdc09b250 con 0x7fbfdc0cb020 2023-08-25T04:15:52.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.849+0000 7fbfe4488640 1 -- 172.21.15.55:0/1609840024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfdc0adf90 con 0x7fbfdc0cb020 2023-08-25T04:15:52.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.849+0000 7fbfd2ffd640 1 -- 172.21.15.55:0/1609840024 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fbfcc0b6040 con 0x7fbfdc0cb020 2023-08-25T04:15:52.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.849+0000 7fbfd2ffd640 1 --2- 172.21.15.55:0/1609840024 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fbfc00657a0 0x7fbfc0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:52.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.849+0000 7fbfd2ffd640 1 -- 172.21.15.55:0/1609840024 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5941+0+0 (secure 0 0 0) 0x7fbfcc11f780 con 0x7fbfdc0cb020 2023-08-25T04:15:52.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.849+0000 7fbfe2224640 1 --2- 172.21.15.55:0/1609840024 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fbfc00657a0 0x7fbfc0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:52.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.849+0000 7fbfe2224640 1 --2- 172.21.15.55:0/1609840024 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fbfc00657a0 0x7fbfc0067c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009b90 tx=0x7fbfd8008040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:52.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:52.853+0000 7fbfd2ffd640 1 -- 172.21.15.55:0/1609840024 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbfcc0ed220 con 0x7fbfdc0cb020 2023-08-25T04:15:53.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.017+0000 7fbfe4488640 1 -- 172.21.15.55:0/1609840024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fbfdc073ec0 con 0x7fbfdc0cb020 2023-08-25T04:15:53.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.021+0000 7fbfd2ffd640 1 -- 172.21.15.55:0/1609840024 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v13) v1 ==== 115+0+0 (secure 0 0 0) 0x7fbfcc0f0840 con 0x7fbfdc0cb020 2023-08-25T04:15:53.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.021+0000 7fbfe4488640 1 -- 172.21.15.55:0/1609840024 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fbfc00657a0 msgr2=0x7fbfc0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:53.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.021+0000 7fbfe4488640 1 --2- 172.21.15.55:0/1609840024 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fbfc00657a0 0x7fbfc0067c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009b90 tx=0x7fbfd8008040 comp rx=0 tx=0).stop 2023-08-25T04:15:53.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.021+0000 7fbfe4488640 1 -- 172.21.15.55:0/1609840024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0cb020 msgr2=0x7fbfdc099f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:53.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.021+0000 7fbfe4488640 1 --2- 172.21.15.55:0/1609840024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0cb020 0x7fbfdc099f40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00b2c0 tx=0x7fbfcc01b920 comp rx=0 tx=0).stop 2023-08-25T04:15:53.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.021+0000 7fbfe4488640 1 -- 172.21.15.55:0/1609840024 shutdown_connections 2023-08-25T04:15:53.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.021+0000 7fbfe4488640 1 --2- 172.21.15.55:0/1609840024 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fbfc00657a0 0x7fbfc0067c60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.021+0000 7fbfe4488640 1 --2- 172.21.15.55:0/1609840024 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cdd50 0x7fbfdc0b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.021+0000 7fbfe4488640 1 --2- 172.21.15.55:0/1609840024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0cb020 0x7fbfdc099f40 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.021+0000 7fbfe4488640 1 --2- 172.21.15.55:0/1609840024 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfdc06c720 0x7fbfdc0b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.021+0000 7fbfe4488640 1 -- 172.21.15.55:0/1609840024 >> 172.21.15.55:0/1609840024 conn(0x7fbfdc069900 msgr2=0x7fbfdc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:53.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.021+0000 7fbfe4488640 1 -- 172.21.15.55:0/1609840024 shutdown_connections 2023-08-25T04:15:53.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.025+0000 7fbfe4488640 1 -- 172.21.15.55:0/1609840024 wait complete. 2023-08-25T04:15:53.049 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-25T04:15:53.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.193+0000 7fd530856640 1 Processor -- start 2023-08-25T04:15:53.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.193+0000 7fd530856640 1 -- start start 2023-08-25T04:15:53.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.197+0000 7fd530856640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd52c0c9900 0x7fd52c0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:53.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.197+0000 7fd530856640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd52c06c720 0x7fd52c06cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:53.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.197+0000 7fd530856640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52c0c9d90 con 0x7fd52c0cb020 2023-08-25T04:15:53.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.197+0000 7fd530856640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52c0cbca0 con 0x7fd52c0c9900 2023-08-25T04:15:53.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.197+0000 7fd530856640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c0c9470 con 0x7fd52c06c720 2023-08-25T04:15:53.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.197+0000 7fd521d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd52c0c9900 0x7fd52c0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:53.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.197+0000 7fd521d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd52c0c9900 0x7fd52c0cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51738/0 (socket says 172.21.15.55:51738) 2023-08-25T04:15:53.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.197+0000 7fd521d9b640 1 -- 172.21.15.55:0/940953255 learned_addr learned my addr 172.21.15.55:0/940953255 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:53.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.197+0000 7fd52a59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd52c0cb020 0x7fd52c0cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44874/0 (socket says 172.21.15.55:44874) 2023-08-25T04:15:53.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.197+0000 7fd52ad9d640 1 --2- 172.21.15.55:0/940953255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd52c06c720 0x7fd52c06cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:53.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.197+0000 7fd521d9b640 1 -- 172.21.15.55:0/940953255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd52c06c720 msgr2=0x7fd52c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:53.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.197+0000 7fd521d9b640 1 --2- 172.21.15.55:0/940953255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd52c06c720 0x7fd52c06cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.197+0000 7fd521d9b640 1 -- 172.21.15.55:0/940953255 >> v1:172.21.15.55:6789/0 conn(0x7fd52c0cb020 legacy=0x7fd52c0cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:53.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.197+0000 7fd521d9b640 1 -- 172.21.15.55:0/940953255 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c06d070 con 0x7fd52c0c9900 2023-08-25T04:15:53.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.197+0000 7fd529d9b640 1 -- 172.21.15.55:0/940953255 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725775558 0 0) 0x7fd52c0c9d90 con 0x7fd52c0cb020 2023-08-25T04:15:53.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.197+0000 7fd52ad9d640 1 --2- 172.21.15.55:0/940953255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd52c06c720 0x7fd52c06cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:15:53.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.201+0000 7fd521d9b640 1 --2- 172.21.15.55:0/940953255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd52c0c9900 0x7fd52c0cdd50 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd51400bb10 tx=0x7fd51401eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36696214a7a7d42f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:53.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.201+0000 7fd529d9b640 1 -- 172.21.15.55:0/940953255 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5140a7a50 con 0x7fd52c0c9900 2023-08-25T04:15:53.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.201+0000 7fd529d9b640 1 -- 172.21.15.55:0/940953255 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5140a7bb0 con 0x7fd52c0c9900 2023-08-25T04:15:53.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.201+0000 7fd529d9b640 1 -- 172.21.15.55:0/940953255 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5140af440 con 0x7fd52c0c9900 2023-08-25T04:15:53.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.201+0000 7fd530856640 1 -- 172.21.15.55:0/940953255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd52c0c9900 msgr2=0x7fd52c0cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:53.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.201+0000 7fd530856640 1 --2- 172.21.15.55:0/940953255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd52c0c9900 0x7fd52c0cdd50 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd51400bb10 tx=0x7fd51401eb80 comp rx=0 tx=0).stop 2023-08-25T04:15:53.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.201+0000 7fd530856640 1 -- 172.21.15.55:0/940953255 shutdown_connections 2023-08-25T04:15:53.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.201+0000 7fd530856640 1 --2- 172.21.15.55:0/940953255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd52c06c720 0x7fd52c06cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.201+0000 7fd530856640 1 --2- 172.21.15.55:0/940953255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd52c0c9900 0x7fd52c0cdd50 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.201+0000 7fd530856640 1 -- 172.21.15.55:0/940953255 >> 172.21.15.55:0/940953255 conn(0x7fd52c069900 msgr2=0x7fd52c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:53.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.201+0000 7fd530856640 1 -- 172.21.15.55:0/940953255 shutdown_connections 2023-08-25T04:15:53.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.201+0000 7fd530856640 1 -- 172.21.15.55:0/940953255 wait complete. 2023-08-25T04:15:53.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.201+0000 7fd530856640 1 Processor -- start 2023-08-25T04:15:53.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.201+0000 7fd530856640 1 -- start start 2023-08-25T04:15:53.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd530856640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd52c06c720 0x7fd52c1598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:53.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd530856640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd52c0c9900 0x7fd52c0afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd530856640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd52c0cb020 0x7fd52c161d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd530856640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c0c7240 con 0x7fd52c06c720 2023-08-25T04:15:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd530856640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c0c7510 con 0x7fd52c0cb020 2023-08-25T04:15:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd530856640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c0c77f0 con 0x7fd52c0c9900 2023-08-25T04:15:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd52a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd52c06c720 0x7fd52c1598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd52a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd52c06c720 0x7fd52c1598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51752/0 (socket says 172.21.15.55:51752) 2023-08-25T04:15:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd52a59c640 1 -- 172.21.15.55:0/3943350671 learned_addr learned my addr 172.21.15.55:0/3943350671 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:53.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd521d9b640 1 --2- 172.21.15.55:0/3943350671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd52c0c9900 0x7fd52c0afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:53.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd52ad9d640 1 --2- 172.21.15.55:0/3943350671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd52c0cb020 0x7fd52c161d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:53.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd52a59c640 1 -- 172.21.15.55:0/3943350671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd52c0c9900 msgr2=0x7fd52c0afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:53.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd52a59c640 1 --2- 172.21.15.55:0/3943350671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd52c0c9900 0x7fd52c0afb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd52a59c640 1 -- 172.21.15.55:0/3943350671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd52c0cb020 msgr2=0x7fd52c161d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:53.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd52a59c640 1 --2- 172.21.15.55:0/3943350671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd52c0cb020 0x7fd52c161d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd52a59c640 1 -- 172.21.15.55:0/3943350671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51400b770 con 0x7fd52c06c720 2023-08-25T04:15:53.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd52a59c640 1 --2- 172.21.15.55:0/3943350671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd52c06c720 0x7fd52c1598c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00c780 tx=0x7fd51c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:53.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd5237fe640 1 -- 172.21.15.55:0/3943350671 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c00ce90 con 0x7fd52c06c720 2023-08-25T04:15:53.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd5237fe640 1 -- 172.21.15.55:0/3943350671 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c00a640 con 0x7fd52c06c720 2023-08-25T04:15:53.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd5237fe640 1 -- 172.21.15.55:0/3943350671 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c00aa10 con 0x7fd52c06c720 2023-08-25T04:15:53.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd530856640 1 -- 172.21.15.55:0/3943350671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52c0c7ad0 con 0x7fd52c06c720 2023-08-25T04:15:53.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd530856640 1 -- 172.21.15.55:0/3943350671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52c162ad0 con 0x7fd52c06c720 2023-08-25T04:15:53.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd530856640 1 -- 172.21.15.55:0/3943350671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52c073ec0 con 0x7fd52c06c720 2023-08-25T04:15:53.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.205+0000 7fd5237fe640 1 -- 172.21.15.55:0/3943350671 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fd51c00ab70 con 0x7fd52c06c720 2023-08-25T04:15:53.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.209+0000 7fd5237fe640 1 --2- 172.21.15.55:0/3943350671 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fd50c0657a0 0x7fd50c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:53.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.209+0000 7fd5237fe640 1 -- 172.21.15.55:0/3943350671 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5941+0+0 (secure 0 0 0) 0x7fd51c0827d0 con 0x7fd52c06c720 2023-08-25T04:15:53.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.209+0000 7fd521d9b640 1 --2- 172.21.15.55:0/3943350671 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fd50c0657a0 0x7fd50c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:53.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.209+0000 7fd521d9b640 1 --2- 172.21.15.55:0/3943350671 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fd50c0657a0 0x7fd50c067c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd5140b1000 tx=0x7fd5140a9070 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:53.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.213+0000 7fd5237fe640 1 -- 172.21.15.55:0/3943350671 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd51c0501e0 con 0x7fd52c06c720 2023-08-25T04:15:53.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.365+0000 7fd530856640 1 -- 172.21.15.55:0/3943350671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fd52c0cc230 con 0x7fd52c06c720 2023-08-25T04:15:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.373+0000 7fd5237fe640 1 -- 172.21.15.55:0/3943350671 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v14) v1 ==== 120+0+0 (secure 0 0 0) 0x7fd51c053800 con 0x7fd52c06c720 2023-08-25T04:15:53.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.373+0000 7fd530856640 1 -- 172.21.15.55:0/3943350671 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fd50c0657a0 msgr2=0x7fd50c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:53.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.373+0000 7fd530856640 1 --2- 172.21.15.55:0/3943350671 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fd50c0657a0 0x7fd50c067c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd5140b1000 tx=0x7fd5140a9070 comp rx=0 tx=0).stop 2023-08-25T04:15:53.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.373+0000 7fd530856640 1 -- 172.21.15.55:0/3943350671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd52c06c720 msgr2=0x7fd52c1598c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:53.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.373+0000 7fd530856640 1 --2- 172.21.15.55:0/3943350671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd52c06c720 0x7fd52c1598c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00c780 tx=0x7fd51c00cc40 comp rx=0 tx=0).stop 2023-08-25T04:15:53.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.373+0000 7fd530856640 1 -- 172.21.15.55:0/3943350671 shutdown_connections 2023-08-25T04:15:53.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.373+0000 7fd530856640 1 --2- 172.21.15.55:0/3943350671 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fd50c0657a0 0x7fd50c067c60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.373+0000 7fd530856640 1 --2- 172.21.15.55:0/3943350671 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd52c0cb020 0x7fd52c161d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.373+0000 7fd530856640 1 --2- 172.21.15.55:0/3943350671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd52c0c9900 0x7fd52c0afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.373+0000 7fd530856640 1 --2- 172.21.15.55:0/3943350671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd52c06c720 0x7fd52c1598c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.373+0000 7fd530856640 1 -- 172.21.15.55:0/3943350671 >> 172.21.15.55:0/3943350671 conn(0x7fd52c069900 msgr2=0x7fd52c06fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:53.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.373+0000 7fd530856640 1 -- 172.21.15.55:0/3943350671 shutdown_connections 2023-08-25T04:15:53.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.373+0000 7fd530856640 1 -- 172.21.15.55:0/3943350671 wait complete. 2023-08-25T04:15:53.393 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-25T04:15:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.541+0000 7fbdf0ecb640 1 Processor -- start 2023-08-25T04:15:53.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.541+0000 7fbdf0ecb640 1 -- start start 2023-08-25T04:15:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.541+0000 7fbdf0ecb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbdec0c9830 0x7fbdec09bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.541+0000 7fbdf0ecb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdec15abd0 con 0x7fbdec15a7f0 2023-08-25T04:15:53.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.541+0000 7fbdf0ecb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdec0c8ab0 con 0x7fbdec06c020 2023-08-25T04:15:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.541+0000 7fbdf0ecb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdec0c8d50 con 0x7fbdec0c9830 2023-08-25T04:15:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.541+0000 7fbdea59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbdec15a7f0 0x7fbdec070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44880/0 (socket says 172.21.15.55:44880) 2023-08-25T04:15:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.541+0000 7fbdea59c640 1 -- 172.21.15.55:0/2114099208 learned_addr learned my addr 172.21.15.55:0/2114099208 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:53.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.541+0000 7fbde3fff640 1 --2- 172.21.15.55:0/2114099208 >> v2:172.21.15.110:3300/0 conn(0x7fbdec0c9830 0x7fbdec09bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.541+0000 7fbde9d9b640 1 -- 172.21.15.55:0/2114099208 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012700148 0 0) 0x7fbdec15abd0 con 0x7fbdec15a7f0 2023-08-25T04:15:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.541+0000 7fbde9d9b640 1 -- 172.21.15.55:0/2114099208 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdd8003530 con 0x7fbdec15a7f0 2023-08-25T04:15:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.541+0000 7fbde9d9b640 1 -- 172.21.15.55:0/2114099208 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2628101913 0 0) 0x7fbdd8003530 con 0x7fbdec15a7f0 2023-08-25T04:15:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.541+0000 7fbde3fff640 1 -- 172.21.15.55:0/2114099208 >> v1:172.21.15.110:6789/0 conn(0x7fbdec06c020 legacy=0x7fbdec0acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.541+0000 7fbde3fff640 1 -- 172.21.15.55:0/2114099208 >> v1:172.21.15.55:6789/0 conn(0x7fbdec15a7f0 legacy=0x7fbdec070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:53.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.541+0000 7fbde3fff640 1 -- 172.21.15.55:0/2114099208 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec0c9030 con 0x7fbdec0c9830 2023-08-25T04:15:53.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.545+0000 7fbde3fff640 1 --2- 172.21.15.55:0/2114099208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdec0c9830 0x7fbdec09bde0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40097c0 tx=0x7fbdd401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10da6544a0f3a63d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:53.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.545+0000 7fbde9d9b640 1 -- 172.21.15.55:0/2114099208 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc001800 con 0x7fbdec0c9830 2023-08-25T04:15:53.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.545+0000 7fbde9d9b640 1 -- 172.21.15.55:0/2114099208 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd40a7050 con 0x7fbdec0c9830 2023-08-25T04:15:53.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.545+0000 7fbde9d9b640 1 -- 172.21.15.55:0/2114099208 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd40ab600 con 0x7fbdec0c9830 2023-08-25T04:15:53.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.545+0000 7fbdf0ecb640 1 -- 172.21.15.55:0/2114099208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdec0c9830 msgr2=0x7fbdec09bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:53.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.545+0000 7fbdf0ecb640 1 --2- 172.21.15.55:0/2114099208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdec0c9830 0x7fbdec09bde0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40097c0 tx=0x7fbdd401c370 comp rx=0 tx=0).stop 2023-08-25T04:15:53.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.545+0000 7fbdf0ecb640 1 -- 172.21.15.55:0/2114099208 shutdown_connections 2023-08-25T04:15:53.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.545+0000 7fbdf0ecb640 1 --2- 172.21.15.55:0/2114099208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdec0c9830 0x7fbdec09bde0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.545+0000 7fbdf0ecb640 1 -- 172.21.15.55:0/2114099208 >> 172.21.15.55:0/2114099208 conn(0x7fbdec069900 msgr2=0x7fbdec069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:53.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.545+0000 7fbdf0ecb640 1 -- 172.21.15.55:0/2114099208 shutdown_connections 2023-08-25T04:15:53.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.545+0000 7fbdf0ecb640 1 -- 172.21.15.55:0/2114099208 wait complete. 2023-08-25T04:15:53.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdf0ecb640 1 Processor -- start 2023-08-25T04:15:53.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdf0ecb640 1 -- start start 2023-08-25T04:15:53.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdf0ecb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdec06c020 0x7fbdec0c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:53.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdf0ecb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdec0c9830 0x7fbdec0c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:53.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdf0ecb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdec15a7f0 0x7fbdec0ab770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:53.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdf0ecb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec152230 con 0x7fbdec06c020 2023-08-25T04:15:53.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdf0ecb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec1513d0 con 0x7fbdec15a7f0 2023-08-25T04:15:53.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdf0ecb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec0cd570 con 0x7fbdec0c9830 2023-08-25T04:15:53.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdea59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdec06c020 0x7fbdec0c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:53.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdea59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdec06c020 0x7fbdec0c5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51758/0 (socket says 172.21.15.55:51758) 2023-08-25T04:15:53.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdea59c640 1 -- 172.21.15.55:0/3654789384 learned_addr learned my addr 172.21.15.55:0/3654789384 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:53.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbde3fff640 1 --2- 172.21.15.55:0/3654789384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdec0c9830 0x7fbdec0c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:53.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdead9d640 1 --2- 172.21.15.55:0/3654789384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdec15a7f0 0x7fbdec0ab770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:53.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdea59c640 1 -- 172.21.15.55:0/3654789384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdec0c9830 msgr2=0x7fbdec0c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:53.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdea59c640 1 --2- 172.21.15.55:0/3654789384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdec0c9830 0x7fbdec0c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdea59c640 1 -- 172.21.15.55:0/3654789384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdec15a7f0 msgr2=0x7fbdec0ab770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:53.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdea59c640 1 --2- 172.21.15.55:0/3654789384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdec15a7f0 0x7fbdec0ab770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdea59c640 1 -- 172.21.15.55:0/3654789384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd4009420 con 0x7fbdec06c020 2023-08-25T04:15:53.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdead9d640 1 --2- 172.21.15.55:0/3654789384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdec15a7f0 0x7fbdec0ab770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:53.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdea59c640 1 --2- 172.21.15.55:0/3654789384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdec06c020 0x7fbdec0c5490 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00c750 tx=0x7fbddc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:53.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbde2ffd640 1 -- 172.21.15.55:0/3654789384 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc007270 con 0x7fbdec06c020 2023-08-25T04:15:53.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbde2ffd640 1 -- 172.21.15.55:0/3654789384 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc0073d0 con 0x7fbdec06c020 2023-08-25T04:15:53.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbde2ffd640 1 -- 172.21.15.55:0/3654789384 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc0057b0 con 0x7fbdec06c020 2023-08-25T04:15:53.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdf0ecb640 1 -- 172.21.15.55:0/3654789384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdec0adc90 con 0x7fbdec06c020 2023-08-25T04:15:53.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdf0ecb640 1 -- 172.21.15.55:0/3654789384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdec0cdb30 con 0x7fbdec06c020 2023-08-25T04:15:53.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.549+0000 7fbdf0ecb640 1 -- 172.21.15.55:0/3654789384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdec06d5b0 con 0x7fbdec06c020 2023-08-25T04:15:53.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.553+0000 7fbde2ffd640 1 -- 172.21.15.55:0/3654789384 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fbddc005910 con 0x7fbdec06c020 2023-08-25T04:15:53.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.553+0000 7fbde2ffd640 1 --2- 172.21.15.55:0/3654789384 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fbdcc0657a0 0x7fbdcc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:53.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.553+0000 7fbde2ffd640 1 -- 172.21.15.55:0/3654789384 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5941+0+0 (secure 0 0 0) 0x7fbddc082c80 con 0x7fbdec06c020 2023-08-25T04:15:53.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.553+0000 7fbde3fff640 1 --2- 172.21.15.55:0/3654789384 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fbdcc0657a0 0x7fbdcc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:53.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.553+0000 7fbde3fff640 1 --2- 172.21.15.55:0/3654789384 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fbdcc0657a0 0x7fbdcc067c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40ad000 tx=0x7fbdd4008040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:53.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.557+0000 7fbde2ffd640 1 -- 172.21.15.55:0/3654789384 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbddc050600 con 0x7fbdec06c020 2023-08-25T04:15:53.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.713+0000 7fbdf0ecb640 1 -- 172.21.15.55:0/3654789384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbdec073ec0 con 0x7fbdec06c020 2023-08-25T04:15:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.717+0000 7fbde2ffd640 1 -- 172.21.15.55:0/3654789384 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbddc053c20 con 0x7fbdec06c020 2023-08-25T04:15:53.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.721+0000 7fbdf0ecb640 1 -- 172.21.15.55:0/3654789384 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fbdcc0657a0 msgr2=0x7fbdcc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:53.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.721+0000 7fbdf0ecb640 1 --2- 172.21.15.55:0/3654789384 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fbdcc0657a0 0x7fbdcc067c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40ad000 tx=0x7fbdd4008040 comp rx=0 tx=0).stop 2023-08-25T04:15:53.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.721+0000 7fbdf0ecb640 1 -- 172.21.15.55:0/3654789384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdec06c020 msgr2=0x7fbdec0c5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:53.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.721+0000 7fbdf0ecb640 1 --2- 172.21.15.55:0/3654789384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdec06c020 0x7fbdec0c5490 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00c750 tx=0x7fbddc00cc10 comp rx=0 tx=0).stop 2023-08-25T04:15:53.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.721+0000 7fbdf0ecb640 1 -- 172.21.15.55:0/3654789384 shutdown_connections 2023-08-25T04:15:53.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.721+0000 7fbdf0ecb640 1 --2- 172.21.15.55:0/3654789384 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fbdcc0657a0 0x7fbdcc067c60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.721+0000 7fbdf0ecb640 1 --2- 172.21.15.55:0/3654789384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdec15a7f0 0x7fbdec0ab770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.721+0000 7fbdf0ecb640 1 --2- 172.21.15.55:0/3654789384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdec0c9830 0x7fbdec0c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.721+0000 7fbdf0ecb640 1 --2- 172.21.15.55:0/3654789384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdec06c020 0x7fbdec0c5490 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.721+0000 7fbdf0ecb640 1 -- 172.21.15.55:0/3654789384 >> 172.21.15.55:0/3654789384 conn(0x7fbdec069900 msgr2=0x7fbdec069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:53.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.721+0000 7fbdf0ecb640 1 -- 172.21.15.55:0/3654789384 shutdown_connections 2023-08-25T04:15:53.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.721+0000 7fbdf0ecb640 1 -- 172.21.15.55:0/3654789384 wait complete. 2023-08-25T04:15:53.740 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-08-25T04:15:53.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.885+0000 7eff671d2640 1 Processor -- start 2023-08-25T04:15:53.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.885+0000 7eff671d2640 1 -- start start 2023-08-25T04:15:53.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.885+0000 7eff671d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7eff6015c9c0 0x7eff60160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:53.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.885+0000 7eff671d2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff600cfa70 0x7eff60160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:53.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.885+0000 7eff671d2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7eff60160f90 0x7eff600ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:53.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.885+0000 7eff671d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6006eaf0 con 0x7eff6015c9c0 2023-08-25T04:15:53.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.885+0000 7eff671d2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6006e530 con 0x7eff60160f90 2023-08-25T04:15:53.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.885+0000 7eff671d2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6006e810 con 0x7eff600cfa70 2023-08-25T04:15:53.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.885+0000 7eff64f6e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7eff6015c9c0 0x7eff60160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:53.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.885+0000 7eff64f6e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7eff6015c9c0 0x7eff60160510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51764/0 (socket says 172.21.15.55:51764) 2023-08-25T04:15:53.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.885+0000 7eff64f6e640 1 -- 172.21.15.55:0/2605886835 learned_addr learned my addr 172.21.15.55:0/2605886835 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:53.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.885+0000 7eff5ffff640 1 --2- 172.21.15.55:0/2605886835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff600cfa70 0x7eff60160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:53.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.885+0000 7eff6576f640 1 --2- 172.21.15.55:0/2605886835 >> v2:172.21.15.110:3300/0 conn(0x7eff60160f90 0x7eff600ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:53.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.885+0000 7eff64f6e640 1 -- 172.21.15.55:0/2605886835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff600cfa70 msgr2=0x7eff60160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:53.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.885+0000 7eff64f6e640 1 --2- 172.21.15.55:0/2605886835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff600cfa70 0x7eff60160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.885+0000 7eff64f6e640 1 -- 172.21.15.55:0/2605886835 >> v2:172.21.15.110:3300/0 conn(0x7eff60160f90 msgr2=0x7eff600ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:53.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.885+0000 7eff64f6e640 1 --2- 172.21.15.55:0/2605886835 >> v2:172.21.15.110:3300/0 conn(0x7eff60160f90 0x7eff600ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.885+0000 7eff64f6e640 1 -- 172.21.15.55:0/2605886835 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6006aab0 con 0x7eff6015c9c0 2023-08-25T04:15:53.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.889+0000 7eff64f6e640 1 --2- 172.21.15.55:0/2605886835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff6015c9c0 0x7eff60160510 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7eff600c4080 tx=0x7eff5401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f84672d9d24504 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:53.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.889+0000 7eff5f7fe640 1 -- 172.21.15.55:0/2605886835 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff540ac600 con 0x7eff6015c9c0 2023-08-25T04:15:53.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.889+0000 7eff5f7fe640 1 -- 172.21.15.55:0/2605886835 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff540a8050 con 0x7eff6015c9c0 2023-08-25T04:15:53.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.889+0000 7eff5f7fe640 1 -- 172.21.15.55:0/2605886835 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff540ac980 con 0x7eff6015c9c0 2023-08-25T04:15:53.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.889+0000 7eff671d2640 1 -- 172.21.15.55:0/2605886835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff6015c9c0 msgr2=0x7eff60160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:53.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.889+0000 7eff671d2640 1 --2- 172.21.15.55:0/2605886835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff6015c9c0 0x7eff60160510 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7eff600c4080 tx=0x7eff5401c4d0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.889+0000 7eff671d2640 1 -- 172.21.15.55:0/2605886835 shutdown_connections 2023-08-25T04:15:53.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.889+0000 7eff671d2640 1 --2- 172.21.15.55:0/2605886835 >> v2:172.21.15.110:3300/0 conn(0x7eff60160f90 0x7eff600ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.889+0000 7eff671d2640 1 --2- 172.21.15.55:0/2605886835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff600cfa70 0x7eff60160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.889+0000 7eff671d2640 1 --2- 172.21.15.55:0/2605886835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff6015c9c0 0x7eff60160510 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.889+0000 7eff671d2640 1 -- 172.21.15.55:0/2605886835 >> 172.21.15.55:0/2605886835 conn(0x7eff600d05a0 msgr2=0x7eff600d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:53.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.889+0000 7eff671d2640 1 -- 172.21.15.55:0/2605886835 shutdown_connections 2023-08-25T04:15:53.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.889+0000 7eff671d2640 1 -- 172.21.15.55:0/2605886835 wait complete. 2023-08-25T04:15:53.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff671d2640 1 Processor -- start 2023-08-25T04:15:53.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff671d2640 1 -- start start 2023-08-25T04:15:53.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff671d2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff600cfa70 0x7eff6015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:53.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff671d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff6015c9c0 0x7eff60149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:53.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff671d2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff60160f90 0x7eff60153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:53.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff671d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6015c2a0 con 0x7eff6015c9c0 2023-08-25T04:15:53.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff671d2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6014b260 con 0x7eff600cfa70 2023-08-25T04:15:53.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff671d2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6015b460 con 0x7eff60160f90 2023-08-25T04:15:53.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff5ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff6015c9c0 0x7eff60149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:53.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff5ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff6015c9c0 0x7eff60149890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51770/0 (socket says 172.21.15.55:51770) 2023-08-25T04:15:53.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff5ffff640 1 -- 172.21.15.55:0/1114818501 learned_addr learned my addr 172.21.15.55:0/1114818501 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:53.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff64f6e640 1 --2- 172.21.15.55:0/1114818501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff600cfa70 0x7eff6015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:53.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff6576f640 1 --2- 172.21.15.55:0/1114818501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff60160f90 0x7eff60153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:53.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff5ffff640 1 -- 172.21.15.55:0/1114818501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff60160f90 msgr2=0x7eff60153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:53.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff5ffff640 1 --2- 172.21.15.55:0/1114818501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff60160f90 0x7eff60153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff5ffff640 1 -- 172.21.15.55:0/1114818501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff600cfa70 msgr2=0x7eff6015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:53.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff5ffff640 1 --2- 172.21.15.55:0/1114818501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff600cfa70 0x7eff6015bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:53.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff5ffff640 1 -- 172.21.15.55:0/1114818501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff54009480 con 0x7eff6015c9c0 2023-08-25T04:15:53.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff64f6e640 1 --2- 172.21.15.55:0/1114818501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff600cfa70 0x7eff6015bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:53.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff5ffff640 1 --2- 172.21.15.55:0/1114818501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff6015c9c0 0x7eff60149890 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00d800 tx=0x7eff4c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:53.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff5d7fa640 1 -- 172.21.15.55:0/1114818501 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c00b6c0 con 0x7eff6015c9c0 2023-08-25T04:15:53.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff5d7fa640 1 -- 172.21.15.55:0/1114818501 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c00b820 con 0x7eff6015c9c0 2023-08-25T04:15:53.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.893+0000 7eff5d7fa640 1 -- 172.21.15.55:0/1114818501 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c00bbd0 con 0x7eff6015c9c0 2023-08-25T04:15:53.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.897+0000 7eff671d2640 1 -- 172.21.15.55:0/1114818501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6015b180 con 0x7eff6015c9c0 2023-08-25T04:15:53.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.897+0000 7eff671d2640 1 -- 172.21.15.55:0/1114818501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6014aef0 con 0x7eff6015c9c0 2023-08-25T04:15:53.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.897+0000 7eff671d2640 1 -- 172.21.15.55:0/1114818501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6014b3f0 con 0x7eff6015c9c0 2023-08-25T04:15:53.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.897+0000 7eff5d7fa640 1 -- 172.21.15.55:0/1114818501 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7eff4c00bd30 con 0x7eff6015c9c0 2023-08-25T04:15:53.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.897+0000 7eff5d7fa640 1 --2- 172.21.15.55:0/1114818501 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7eff440657a0 0x7eff44067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:53.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.897+0000 7eff5d7fa640 1 -- 172.21.15.55:0/1114818501 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5941+0+0 (secure 0 0 0) 0x7eff4c0834f0 con 0x7eff6015c9c0 2023-08-25T04:15:53.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.897+0000 7eff64f6e640 1 --2- 172.21.15.55:0/1114818501 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7eff440657a0 0x7eff44067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:53.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.901+0000 7eff64f6e640 1 --2- 172.21.15.55:0/1114818501 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7eff440657a0 0x7eff44067c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7eff540ae000 tx=0x7eff54008040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:53.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:53.901+0000 7eff5d7fa640 1 -- 172.21.15.55:0/1114818501 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7eff4c054900 con 0x7eff6015c9c0 2023-08-25T04:15:54.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.113+0000 7eff671d2640 1 -- 172.21.15.55:0/1114818501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7eff6004dbe0 con 0x7eff6015c9c0 2023-08-25T04:15:54.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.673+0000 7eff5d7fa640 1 -- 172.21.15.55:0/1114818501 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v464) v1 ==== 158+0+0 (secure 0 0 0) 0x7eff4c011340 con 0x7eff6015c9c0 2023-08-25T04:15:54.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.677+0000 7eff671d2640 1 -- 172.21.15.55:0/1114818501 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7eff440657a0 msgr2=0x7eff44067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:54.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.677+0000 7eff671d2640 1 --2- 172.21.15.55:0/1114818501 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7eff440657a0 0x7eff44067c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7eff540ae000 tx=0x7eff54008040 comp rx=0 tx=0).stop 2023-08-25T04:15:54.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.677+0000 7eff671d2640 1 -- 172.21.15.55:0/1114818501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff6015c9c0 msgr2=0x7eff60149890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:54.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.677+0000 7eff671d2640 1 --2- 172.21.15.55:0/1114818501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff6015c9c0 0x7eff60149890 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00d800 tx=0x7eff4c00dcc0 comp rx=0 tx=0).stop 2023-08-25T04:15:54.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.677+0000 7eff671d2640 1 -- 172.21.15.55:0/1114818501 shutdown_connections 2023-08-25T04:15:54.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.677+0000 7eff671d2640 1 --2- 172.21.15.55:0/1114818501 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7eff440657a0 0x7eff44067c60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:54.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.677+0000 7eff671d2640 1 --2- 172.21.15.55:0/1114818501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff60160f90 0x7eff60153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:54.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.677+0000 7eff671d2640 1 --2- 172.21.15.55:0/1114818501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7eff6015c9c0 0x7eff60149890 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:54.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.677+0000 7eff671d2640 1 --2- 172.21.15.55:0/1114818501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff600cfa70 0x7eff6015bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:54.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.677+0000 7eff671d2640 1 -- 172.21.15.55:0/1114818501 >> 172.21.15.55:0/1114818501 conn(0x7eff600d05a0 msgr2=0x7eff60155140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:54.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.677+0000 7eff671d2640 1 -- 172.21.15.55:0/1114818501 shutdown_connections 2023-08-25T04:15:54.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.677+0000 7eff671d2640 1 -- 172.21.15.55:0/1114818501 wait complete. 2023-08-25T04:15:54.698 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-08-25T04:15:54.699 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-08-25T04:15:54.699 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-25T04:15:54.699 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-08-25T04:15:54.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.845+0000 7f8fa866d640 1 Processor -- start 2023-08-25T04:15:54.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.849+0000 7f8fa866d640 1 -- start start 2023-08-25T04:15:54.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.849+0000 7f8fa866d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8fa00ceeb0 0x7f8fa00cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:54.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.849+0000 7f8fa866d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8fa00c89f0 0x7f8fa00b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:54.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.849+0000 7f8fa866d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa00cc880 con 0x7f8fa00ad950 2023-08-25T04:15:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.849+0000 7f8fa866d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa00b11f0 con 0x7f8fa00c89f0 2023-08-25T04:15:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.849+0000 7f8fa866d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa0159d50 con 0x7f8fa00ceeb0 2023-08-25T04:15:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.849+0000 7f8fa6c0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8fa00c89f0 0x7f8fa00b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.849+0000 7f8fa6c0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8fa00c89f0 0x7f8fa00b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51772/0 (socket says 172.21.15.55:51772) 2023-08-25T04:15:54.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.849+0000 7f8fa6c0a640 1 -- 172.21.15.55:0/706729157 learned_addr learned my addr 172.21.15.55:0/706729157 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:54.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.849+0000 7f8fa5c08640 1 --2- 172.21.15.55:0/706729157 >> v2:172.21.15.110:3300/0 conn(0x7f8fa00ceeb0 0x7f8fa00cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:54.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.849+0000 7f8fa6c0a640 1 -- 172.21.15.55:0/706729157 >> v2:172.21.15.110:3300/0 conn(0x7f8fa00ceeb0 msgr2=0x7f8fa00cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:54.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.849+0000 7f8fa6c0a640 1 --2- 172.21.15.55:0/706729157 >> v2:172.21.15.110:3300/0 conn(0x7f8fa00ceeb0 0x7f8fa00cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:54.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.849+0000 7f8fa6c0a640 1 -- 172.21.15.55:0/706729157 >> v1:172.21.15.110:6789/0 conn(0x7f8fa00ad950 legacy=0x7f8fa00ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:54.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.849+0000 7f8fa6c0a640 1 -- 172.21.15.55:0/706729157 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa00ccb60 con 0x7f8fa00c89f0 2023-08-25T04:15:54.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.849+0000 7f8fa5c08640 1 --2- 172.21.15.55:0/706729157 >> v2:172.21.15.110:3300/0 conn(0x7f8fa00ceeb0 0x7f8fa00cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:15:54.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.853+0000 7f8fa6c0a640 1 --2- 172.21.15.55:0/706729157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa00c89f0 0x7f8fa00b1640 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8fa006df00 tx=0x7f8f9801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a675002ffed492 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:54.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.853+0000 7f8fa5407640 1 -- 172.21.15.55:0/706729157 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f980a56a0 con 0x7f8fa00c89f0 2023-08-25T04:15:54.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.853+0000 7f8fa5407640 1 -- 172.21.15.55:0/706729157 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f980a5800 con 0x7f8fa00c89f0 2023-08-25T04:15:54.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.853+0000 7f8fa5407640 1 -- 172.21.15.55:0/706729157 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f980a5b90 con 0x7f8fa00c89f0 2023-08-25T04:15:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.853+0000 7f8fa866d640 1 -- 172.21.15.55:0/706729157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa00c89f0 msgr2=0x7f8fa00b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.853+0000 7f8fa866d640 1 --2- 172.21.15.55:0/706729157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa00c89f0 0x7f8fa00b1640 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8fa006df00 tx=0x7f8f9801c8d0 comp rx=0 tx=0).stop 2023-08-25T04:15:54.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.853+0000 7f8fa866d640 1 -- 172.21.15.55:0/706729157 shutdown_connections 2023-08-25T04:15:54.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.853+0000 7f8fa866d640 1 --2- 172.21.15.55:0/706729157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa00c89f0 0x7f8fa00b1640 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:54.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.853+0000 7f8fa866d640 1 --2- 172.21.15.55:0/706729157 >> v2:172.21.15.110:3300/0 conn(0x7f8fa00ceeb0 0x7f8fa00cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:54.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.853+0000 7f8fa866d640 1 -- 172.21.15.55:0/706729157 >> 172.21.15.55:0/706729157 conn(0x7f8fa0069d00 msgr2=0x7f8fa006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:54.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.853+0000 7f8fa866d640 1 -- 172.21.15.55:0/706729157 shutdown_connections 2023-08-25T04:15:54.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.853+0000 7f8fa866d640 1 -- 172.21.15.55:0/706729157 wait complete. 2023-08-25T04:15:54.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.853+0000 7f8fa866d640 1 Processor -- start 2023-08-25T04:15:54.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.853+0000 7f8fa866d640 1 -- start start 2023-08-25T04:15:54.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa866d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa00ad950 0x7f8fa0153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:54.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa866d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fa00c89f0 0x7f8fa015acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:54.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa866d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fa00ceeb0 0x7f8fa015b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:54.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa866d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa01530f0 con 0x7f8fa00ad950 2023-08-25T04:15:54.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa866d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa01524e0 con 0x7f8fa00ceeb0 2023-08-25T04:15:54.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa866d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa01527c0 con 0x7f8fa00c89f0 2023-08-25T04:15:54.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa6409640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa00ad950 0x7f8fa0153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:54.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa6409640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa00ad950 0x7f8fa0153580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51784/0 (socket says 172.21.15.55:51784) 2023-08-25T04:15:54.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa6409640 1 -- 172.21.15.55:0/3964206049 learned_addr learned my addr 172.21.15.55:0/3964206049 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:54.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa6c0a640 1 --2- 172.21.15.55:0/3964206049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fa00ceeb0 0x7f8fa015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:54.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa5c08640 1 --2- 172.21.15.55:0/3964206049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fa00c89f0 0x7f8fa015acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:54.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa6409640 1 -- 172.21.15.55:0/3964206049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fa00c89f0 msgr2=0x7f8fa015acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:54.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa6409640 1 --2- 172.21.15.55:0/3964206049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fa00c89f0 0x7f8fa015acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:54.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa6409640 1 -- 172.21.15.55:0/3964206049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fa00ceeb0 msgr2=0x7f8fa015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:54.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa6409640 1 --2- 172.21.15.55:0/3964206049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fa00ceeb0 0x7f8fa015b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:54.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa6409640 1 -- 172.21.15.55:0/3964206049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f98009b30 con 0x7f8fa00ad950 2023-08-25T04:15:54.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa6409640 1 --2- 172.21.15.55:0/3964206049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa00ad950 0x7f8fa0153580 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00b410 tx=0x7f8f9c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:54.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8f96ffd640 1 -- 172.21.15.55:0/3964206049 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c004020 con 0x7f8fa00ad950 2023-08-25T04:15:54.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8f96ffd640 1 -- 172.21.15.55:0/3964206049 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c004180 con 0x7f8fa00ad950 2023-08-25T04:15:54.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8f96ffd640 1 -- 172.21.15.55:0/3964206049 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c011630 con 0x7f8fa00ad950 2023-08-25T04:15:54.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa866d640 1 -- 172.21.15.55:0/3964206049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa0152aa0 con 0x7f8fa00ad950 2023-08-25T04:15:54.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa866d640 1 -- 172.21.15.55:0/3964206049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa00af7d0 con 0x7f8fa00ad950 2023-08-25T04:15:54.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8fa866d640 1 -- 172.21.15.55:0/3964206049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa004dbe0 con 0x7f8fa00ad950 2023-08-25T04:15:54.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.857+0000 7f8f96ffd640 1 -- 172.21.15.55:0/3964206049 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f8f9c011790 con 0x7f8fa00ad950 2023-08-25T04:15:54.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.861+0000 7f8f96ffd640 1 --2- 172.21.15.55:0/3964206049 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f8f840657a0 0x7f8f84067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:54.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.861+0000 7f8f96ffd640 1 -- 172.21.15.55:0/3964206049 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5941+0+0 (secure 0 0 0) 0x7f8f9c082b40 con 0x7f8fa00ad950 2023-08-25T04:15:54.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.861+0000 7f8fa5c08640 1 --2- 172.21.15.55:0/3964206049 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f8f840657a0 0x7f8f84067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:54.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.861+0000 7f8fa5c08640 1 --2- 172.21.15.55:0/3964206049 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f8f840657a0 0x7f8f84067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00cc780 tx=0x7f8f90008040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:54.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:54.865+0000 7f8f96ffd640 1 -- 172.21.15.55:0/3964206049 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8f9c050610 con 0x7f8fa00ad950 2023-08-25T04:15:55.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.077+0000 7f8fa866d640 1 -- 172.21.15.55:0/3964206049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f8fa00cddf0 con 0x7f8fa00ad950 2023-08-25T04:15:55.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.677+0000 7f8f96ffd640 1 -- 172.21.15.55:0/3964206049 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v465) v1 ==== 157+0+0 (secure 0 0 0) 0x7f8f9c0150e0 con 0x7f8fa00ad950 2023-08-25T04:15:55.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.677+0000 7f8fa866d640 1 -- 172.21.15.55:0/3964206049 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f8f840657a0 msgr2=0x7f8f84067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:55.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.677+0000 7f8fa866d640 1 --2- 172.21.15.55:0/3964206049 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f8f840657a0 0x7f8f84067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00cc780 tx=0x7f8f90008040 comp rx=0 tx=0).stop 2023-08-25T04:15:55.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.677+0000 7f8fa866d640 1 -- 172.21.15.55:0/3964206049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa00ad950 msgr2=0x7f8fa0153580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:55.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.677+0000 7f8fa866d640 1 --2- 172.21.15.55:0/3964206049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa00ad950 0x7f8fa0153580 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c00b410 tx=0x7f8f9c00b8d0 comp rx=0 tx=0).stop 2023-08-25T04:15:55.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.677+0000 7f8fa866d640 1 -- 172.21.15.55:0/3964206049 shutdown_connections 2023-08-25T04:15:55.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.677+0000 7f8fa866d640 1 --2- 172.21.15.55:0/3964206049 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f8f840657a0 0x7f8f84067c60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:55.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.677+0000 7f8fa866d640 1 --2- 172.21.15.55:0/3964206049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fa00ceeb0 0x7f8fa015b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:55.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.677+0000 7f8fa866d640 1 --2- 172.21.15.55:0/3964206049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fa00c89f0 0x7f8fa015acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:55.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.677+0000 7f8fa866d640 1 --2- 172.21.15.55:0/3964206049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa00ad950 0x7f8fa0153580 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:55.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.677+0000 7f8fa866d640 1 -- 172.21.15.55:0/3964206049 >> 172.21.15.55:0/3964206049 conn(0x7f8fa0069d00 msgr2=0x7f8fa00aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:55.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.677+0000 7f8fa866d640 1 -- 172.21.15.55:0/3964206049 shutdown_connections 2023-08-25T04:15:55.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.677+0000 7f8fa866d640 1 -- 172.21.15.55:0/3964206049 wait complete. 2023-08-25T04:15:55.700 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:15:55.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.845+0000 7f1564c93640 1 Processor -- start 2023-08-25T04:15:55.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.849+0000 7f1564c93640 1 -- start start 2023-08-25T04:15:55.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.849+0000 7f1564c93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15600cdde0 0x7f15600ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:55.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.849+0000 7f1564c93640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f15600b2e40 0x7f15600b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:55.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.849+0000 7f1564c93640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15600b29b0 con 0x7f15600d0da0 2023-08-25T04:15:55.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.849+0000 7f1564c93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15600ce760 con 0x7f15600cdde0 2023-08-25T04:15:55.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.849+0000 7f1564c93640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15600b1dc0 con 0x7f15600b2e40 2023-08-25T04:15:55.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.849+0000 7f155dd9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15600cdde0 0x7f15600ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:55.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.849+0000 7f155dd9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15600cdde0 0x7f15600ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51800/0 (socket says 172.21.15.55:51800) 2023-08-25T04:15:55.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.849+0000 7f155dd9b640 1 -- 172.21.15.55:0/3068906666 learned_addr learned my addr 172.21.15.55:0/3068906666 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:55.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.849+0000 7f155ed9d640 1 --2- 172.21.15.55:0/3068906666 >> v2:172.21.15.110:3300/0 conn(0x7f15600b2e40 0x7f15600b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:55.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.849+0000 7f155dd9b640 1 -- 172.21.15.55:0/3068906666 >> v2:172.21.15.110:3300/0 conn(0x7f15600b2e40 msgr2=0x7f15600b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:55.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.849+0000 7f155dd9b640 1 --2- 172.21.15.55:0/3068906666 >> v2:172.21.15.110:3300/0 conn(0x7f15600b2e40 0x7f15600b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:55.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.849+0000 7f155dd9b640 1 -- 172.21.15.55:0/3068906666 >> v1:172.21.15.110:6789/0 conn(0x7f15600d0da0 legacy=0x7f15600d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:55.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.849+0000 7f155dd9b640 1 -- 172.21.15.55:0/3068906666 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15600b2080 con 0x7f15600cdde0 2023-08-25T04:15:55.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.853+0000 7f155dd9b640 1 --2- 172.21.15.55:0/3068906666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15600cdde0 0x7f15600ce220 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f15600ceae0 tx=0x7f155401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc002e336fb4836b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:55.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.853+0000 7f155d59a640 1 -- 172.21.15.55:0/3068906666 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15540a89f0 con 0x7f15600cdde0 2023-08-25T04:15:55.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.853+0000 7f155d59a640 1 -- 172.21.15.55:0/3068906666 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15540a8b50 con 0x7f15600cdde0 2023-08-25T04:15:55.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.853+0000 7f155d59a640 1 -- 172.21.15.55:0/3068906666 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15540b0440 con 0x7f15600cdde0 2023-08-25T04:15:55.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.853+0000 7f1564c93640 1 -- 172.21.15.55:0/3068906666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15600cdde0 msgr2=0x7f15600ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:55.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.853+0000 7f1564c93640 1 --2- 172.21.15.55:0/3068906666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15600cdde0 0x7f15600ce220 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f15600ceae0 tx=0x7f155401ecf0 comp rx=0 tx=0).stop 2023-08-25T04:15:55.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.853+0000 7f1564c93640 1 -- 172.21.15.55:0/3068906666 shutdown_connections 2023-08-25T04:15:55.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.853+0000 7f1564c93640 1 --2- 172.21.15.55:0/3068906666 >> v2:172.21.15.110:3300/0 conn(0x7f15600b2e40 0x7f15600b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:55.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.853+0000 7f1564c93640 1 --2- 172.21.15.55:0/3068906666 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15600cdde0 0x7f15600ce220 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:55.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.853+0000 7f1564c93640 1 -- 172.21.15.55:0/3068906666 >> 172.21.15.55:0/3068906666 conn(0x7f156009bae0 msgr2=0x7f15600d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:55.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.853+0000 7f1564c93640 1 -- 172.21.15.55:0/3068906666 shutdown_connections 2023-08-25T04:15:55.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.853+0000 7f1564c93640 1 -- 172.21.15.55:0/3068906666 wait complete. 2023-08-25T04:15:55.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.853+0000 7f1564c93640 1 Processor -- start 2023-08-25T04:15:55.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f1564c93640 1 -- start start 2023-08-25T04:15:55.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f1564c93640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15600b2e40 0x7f15600cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:55.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f1564c93640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15600cdde0 0x7f15600c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:55.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f1564c93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15600d0da0 0x7f15600cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:55.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f1564c93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15600cb8a0 con 0x7f15600d0da0 2023-08-25T04:15:55.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f1564c93640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156015ee70 con 0x7f15600b2e40 2023-08-25T04:15:55.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f1564c93640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156015e260 con 0x7f15600cdde0 2023-08-25T04:15:55.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f155ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15600d0da0 0x7f15600cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:55.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f155ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15600d0da0 0x7f15600cbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51816/0 (socket says 172.21.15.55:51816) 2023-08-25T04:15:55.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f155ed9d640 1 -- 172.21.15.55:0/224568059 learned_addr learned my addr 172.21.15.55:0/224568059 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:55.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f155e59c640 1 --2- 172.21.15.55:0/224568059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15600b2e40 0x7f15600cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:55.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f155dd9b640 1 --2- 172.21.15.55:0/224568059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15600cdde0 0x7f15600c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:55.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f155ed9d640 1 -- 172.21.15.55:0/224568059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15600cdde0 msgr2=0x7f15600c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:55.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f155ed9d640 1 --2- 172.21.15.55:0/224568059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15600cdde0 0x7f15600c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:55.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f155ed9d640 1 -- 172.21.15.55:0/224568059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15600b2e40 msgr2=0x7f15600cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:55.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f155ed9d640 1 --2- 172.21.15.55:0/224568059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15600b2e40 0x7f15600cb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:55.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f155ed9d640 1 -- 172.21.15.55:0/224568059 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15540094d0 con 0x7f15600d0da0 2023-08-25T04:15:55.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f155ed9d640 1 --2- 172.21.15.55:0/224568059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15600d0da0 0x7f15600cbc60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f1558007e40 tx=0x7f155800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:55.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f154effd640 1 -- 172.21.15.55:0/224568059 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1558014620 con 0x7f15600d0da0 2023-08-25T04:15:55.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f154effd640 1 -- 172.21.15.55:0/224568059 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155800ee90 con 0x7f15600d0da0 2023-08-25T04:15:55.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f154effd640 1 -- 172.21.15.55:0/224568059 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15580149e0 con 0x7f15600d0da0 2023-08-25T04:15:55.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f1564c93640 1 -- 172.21.15.55:0/224568059 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156015e540 con 0x7f15600d0da0 2023-08-25T04:15:55.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f1564c93640 1 -- 172.21.15.55:0/224568059 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156015eb00 con 0x7f15600d0da0 2023-08-25T04:15:55.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.857+0000 7f1564c93640 1 -- 172.21.15.55:0/224568059 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156004dbe0 con 0x7f15600d0da0 2023-08-25T04:15:55.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.861+0000 7f154effd640 1 -- 172.21.15.55:0/224568059 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f1558014b40 con 0x7f15600d0da0 2023-08-25T04:15:55.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.861+0000 7f154effd640 1 --2- 172.21.15.55:0/224568059 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f15400657d0 0x7f1540067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:55.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.861+0000 7f154effd640 1 -- 172.21.15.55:0/224568059 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5941+0+0 (secure 0 0 0) 0x7f1558083a70 con 0x7f15600d0da0 2023-08-25T04:15:55.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.861+0000 7f155e59c640 1 --2- 172.21.15.55:0/224568059 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f15400657d0 0x7f1540067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:55.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.861+0000 7f155e59c640 1 --2- 172.21.15.55:0/224568059 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f15400657d0 0x7f1540067c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1550000fc0 tx=0x7f1550009040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:55.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:55.865+0000 7f154effd640 1 -- 172.21.15.55:0/224568059 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1558051360 con 0x7f15600d0da0 2023-08-25T04:15:56.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.021+0000 7f1564c93640 1 -- 172.21.15.55:0/224568059 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f156015efb0 con 0x7f15600d0da0 2023-08-25T04:15:56.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.021+0000 7f154effd640 1 -- 172.21.15.55:0/224568059 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+15735 (secure 0 0 0) 0x7f1558054980 con 0x7f15600d0da0 2023-08-25T04:15:56.022 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:56.022 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":54,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:15:52.654441+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6833/2079290775":"2023-08-26T04:15:49.617354+0000","172.21.15.110:0/3921349352":"2023-08-26T04:15:46.532863+0000","172.21.15.110:0/3810476394":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/3898418887":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/3320584392":"2023-08-26T04:15:46.532863+0000","172.21.15.110:6832/3210220484":"2023-08-26T04:15:46.532863+0000","172.21.15.110:0/2576650460":"2023-08-26T04:04:16.252224+0000","172.21.15.110:6832/413962747":"2023-08-26T04:04:16.252224+0000","172.21.15.110:6833/413962747":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/2038389426":"2023-08-26T04:15:46.532863+0000","172.21.15.110:0/2105887625":"2023-08-26T04:04:16.252224+0000","172.21.15.110:0/1030503486":"2023-08-26T04:15:46.532863+0000","172.21.15.55:6834/2079290775":"2023-08-26T04:15:49.617354+0000","172.21.15.110:0/1400443768":"2023-08-26T04:15:46.532863+0000","172.21.15.110:0/1413171589":"2023-08-26T04:15:46.532863+0000","172.21.15.110:6833/3210220484":"2023-08-26T04:15:46.532863+0000","172.21.15.110:0/1790436010":"2023-08-26T04:15:46.532863+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:15:56.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.025+0000 7f1564c93640 1 -- 172.21.15.55:0/224568059 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f15400657d0 msgr2=0x7f1540067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.025+0000 7f1564c93640 1 --2- 172.21.15.55:0/224568059 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f15400657d0 0x7f1540067c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1550000fc0 tx=0x7f1550009040 comp rx=0 tx=0).stop 2023-08-25T04:15:56.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.025+0000 7f1564c93640 1 -- 172.21.15.55:0/224568059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15600d0da0 msgr2=0x7f15600cbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.025+0000 7f1564c93640 1 --2- 172.21.15.55:0/224568059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15600d0da0 0x7f15600cbc60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f1558007e40 tx=0x7f155800e4b0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.025+0000 7f1564c93640 1 -- 172.21.15.55:0/224568059 shutdown_connections 2023-08-25T04:15:56.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.025+0000 7f1564c93640 1 --2- 172.21.15.55:0/224568059 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f15400657d0 0x7f1540067c90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.025+0000 7f1564c93640 1 --2- 172.21.15.55:0/224568059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15600d0da0 0x7f15600cbc60 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.025+0000 7f1564c93640 1 --2- 172.21.15.55:0/224568059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15600cdde0 0x7f15600c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.025+0000 7f1564c93640 1 --2- 172.21.15.55:0/224568059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15600b2e40 0x7f15600cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.025+0000 7f1564c93640 1 -- 172.21.15.55:0/224568059 >> 172.21.15.55:0/224568059 conn(0x7f156009bae0 msgr2=0x7f15600b01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:56.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.025+0000 7f1564c93640 1 -- 172.21.15.55:0/224568059 shutdown_connections 2023-08-25T04:15:56.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.025+0000 7f1564c93640 1 -- 172.21.15.55:0/224568059 wait complete. 2023-08-25T04:15:56.043 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:15:56.044 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:15:56.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.193+0000 7fa97eed8640 1 Processor -- start 2023-08-25T04:15:56.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.193+0000 7fa97eed8640 1 -- start start 2023-08-25T04:15:56.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.193+0000 7fa97eed8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa97806ce30 0x7fa9780cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:56.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.193+0000 7fa97eed8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9780c9d90 con 0x7fa9780c9900 2023-08-25T04:15:56.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.193+0000 7fa97eed8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9780cbca0 con 0x7fa9780cb020 2023-08-25T04:15:56.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.193+0000 7fa97eed8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9780c9470 con 0x7fa97806ce30 2023-08-25T04:15:56.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.193+0000 7fa96ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa9780c9900 0x7fa97806c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44892/0 (socket says 172.21.15.55:44892) 2023-08-25T04:15:56.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.193+0000 7fa96ffff640 1 -- 172.21.15.55:0/4125082851 learned_addr learned my addr 172.21.15.55:0/4125082851 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:56.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.193+0000 7fa97d475640 1 --2- 172.21.15.55:0/4125082851 >> v2:172.21.15.110:3300/0 conn(0x7fa97806ce30 0x7fa9780cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:56.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.193+0000 7fa96f7fe640 1 -- 172.21.15.55:0/4125082851 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 78951466 0 0) 0x7fa9780c9d90 con 0x7fa9780c9900 2023-08-25T04:15:56.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.193+0000 7fa96f7fe640 1 -- 172.21.15.55:0/4125082851 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa960005740 con 0x7fa9780c9900 2023-08-25T04:15:56.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.193+0000 7fa96f7fe640 1 -- 172.21.15.55:0/4125082851 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235321061 0 0) 0x7fa9780cbca0 con 0x7fa9780cb020 2023-08-25T04:15:56.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.193+0000 7fa96f7fe640 1 -- 172.21.15.55:0/4125082851 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9780c9d90 con 0x7fa9780cb020 2023-08-25T04:15:56.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.193+0000 7fa97d475640 1 -- 172.21.15.55:0/4125082851 >> v1:172.21.15.110:6789/0 conn(0x7fa9780cb020 legacy=0x7fa9780cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.193+0000 7fa97d475640 1 -- 172.21.15.55:0/4125082851 >> v1:172.21.15.55:6789/0 conn(0x7fa9780c9900 legacy=0x7fa97806c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.193+0000 7fa96f7fe640 1 -- 172.21.15.55:0/4125082851 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3545065086 0 0) 0x7fa960005740 con 0x7fa9780c9900 2023-08-25T04:15:56.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.193+0000 7fa97d475640 1 -- 172.21.15.55:0/4125082851 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9780c8b40 con 0x7fa97806ce30 2023-08-25T04:15:56.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.197+0000 7fa97d475640 1 --2- 172.21.15.55:0/4125082851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa97806ce30 0x7fa9780cdd50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa970009d90 tx=0x7fa97001c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2b8fc2b32859988 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.197+0000 7fa96f7fe640 1 -- 172.21.15.55:0/4125082851 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968001680 con 0x7fa97806ce30 2023-08-25T04:15:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.197+0000 7fa96f7fe640 1 -- 172.21.15.55:0/4125082851 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9700a6430 con 0x7fa97806ce30 2023-08-25T04:15:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.197+0000 7fa96f7fe640 1 -- 172.21.15.55:0/4125082851 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9700a67c0 con 0x7fa97806ce30 2023-08-25T04:15:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.197+0000 7fa97eed8640 1 -- 172.21.15.55:0/4125082851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa97806ce30 msgr2=0x7fa9780cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.197+0000 7fa97eed8640 1 --2- 172.21.15.55:0/4125082851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa97806ce30 0x7fa9780cdd50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa970009d90 tx=0x7fa97001c7e0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.197+0000 7fa97eed8640 1 -- 172.21.15.55:0/4125082851 shutdown_connections 2023-08-25T04:15:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.197+0000 7fa97eed8640 1 --2- 172.21.15.55:0/4125082851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa97806ce30 0x7fa9780cdd50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.197+0000 7fa97eed8640 1 -- 172.21.15.55:0/4125082851 >> 172.21.15.55:0/4125082851 conn(0x7fa978069900 msgr2=0x7fa978069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:56.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.197+0000 7fa97eed8640 1 -- 172.21.15.55:0/4125082851 shutdown_connections 2023-08-25T04:15:56.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.197+0000 7fa97eed8640 1 -- 172.21.15.55:0/4125082851 wait complete. 2023-08-25T04:15:56.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa97eed8640 1 Processor -- start 2023-08-25T04:15:56.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa97eed8640 1 -- start start 2023-08-25T04:15:56.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa97eed8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa97806ce30 0x7fa9780c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:56.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa97eed8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780c9900 0x7fa9780af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:56.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa97eed8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9780cb020 0x7fa9781fd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:56.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa97eed8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9781503c0 con 0x7fa9780c9900 2023-08-25T04:15:56.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa97eed8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9781fd8e0 con 0x7fa9780cb020 2023-08-25T04:15:56.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa97eed8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780aff40 con 0x7fa97806ce30 2023-08-25T04:15:56.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa96ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780c9900 0x7fa9780af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:56.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa96ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780c9900 0x7fa9780af8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51826/0 (socket says 172.21.15.55:51826) 2023-08-25T04:15:56.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa96ffff640 1 -- 172.21.15.55:0/2957045075 learned_addr learned my addr 172.21.15.55:0/2957045075 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:56.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa97cc74640 1 --2- 172.21.15.55:0/2957045075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa97806ce30 0x7fa9780c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:56.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa97d475640 1 --2- 172.21.15.55:0/2957045075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9780cb020 0x7fa9781fd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:56.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa96ffff640 1 -- 172.21.15.55:0/2957045075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa97806ce30 msgr2=0x7fa9780c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa96ffff640 1 --2- 172.21.15.55:0/2957045075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa97806ce30 0x7fa9780c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa96ffff640 1 -- 172.21.15.55:0/2957045075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9780cb020 msgr2=0x7fa9781fd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa96ffff640 1 --2- 172.21.15.55:0/2957045075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9780cb020 0x7fa9781fd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa96ffff640 1 -- 172.21.15.55:0/2957045075 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa970009a70 con 0x7fa9780c9900 2023-08-25T04:15:56.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa96ffff640 1 --2- 172.21.15.55:0/2957045075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780c9900 0x7fa9780af8a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa96800c780 tx=0x7fa96800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:56.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa96d7fa640 1 -- 172.21.15.55:0/2957045075 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968005ae0 con 0x7fa9780c9900 2023-08-25T04:15:56.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa96d7fa640 1 -- 172.21.15.55:0/2957045075 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa968005c40 con 0x7fa9780c9900 2023-08-25T04:15:56.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa96d7fa640 1 -- 172.21.15.55:0/2957045075 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968007070 con 0x7fa9780c9900 2023-08-25T04:15:56.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa97eed8640 1 -- 172.21.15.55:0/2957045075 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9780b0220 con 0x7fa9780c9900 2023-08-25T04:15:56.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.201+0000 7fa97eed8640 1 -- 172.21.15.55:0/2957045075 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9780b07e0 con 0x7fa9780c9900 2023-08-25T04:15:56.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.205+0000 7fa97eed8640 1 -- 172.21.15.55:0/2957045075 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa978073ec0 con 0x7fa9780c9900 2023-08-25T04:15:56.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.205+0000 7fa96d7fa640 1 -- 172.21.15.55:0/2957045075 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fa9680071f0 con 0x7fa9780c9900 2023-08-25T04:15:56.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.205+0000 7fa96d7fa640 1 --2- 172.21.15.55:0/2957045075 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fa9640657a0 0x7fa964067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:56.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.205+0000 7fa96d7fa640 1 -- 172.21.15.55:0/2957045075 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5941+0+0 (secure 0 0 0) 0x7fa968082570 con 0x7fa9780c9900 2023-08-25T04:15:56.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.205+0000 7fa97cc74640 1 --2- 172.21.15.55:0/2957045075 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fa9640657a0 0x7fa964067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:56.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.205+0000 7fa97cc74640 1 --2- 172.21.15.55:0/2957045075 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fa9640657a0 0x7fa964067c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa974001240 tx=0x7fa974009040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:56.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.209+0000 7fa96d7fa640 1 -- 172.21.15.55:0/2957045075 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa968053ac0 con 0x7fa9780c9900 2023-08-25T04:15:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.373+0000 7fa97eed8640 1 -- 172.21.15.55:0/2957045075 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa9780c4fb0 con 0x7fa9780c9900 2023-08-25T04:15:56.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.373+0000 7fa96d7fa640 1 -- 172.21.15.55:0/2957045075 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa968053650 con 0x7fa9780c9900 2023-08-25T04:15:56.372 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:15:56.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.373+0000 7fa97eed8640 1 -- 172.21.15.55:0/2957045075 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fa9640657a0 msgr2=0x7fa964067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.373+0000 7fa97eed8640 1 --2- 172.21.15.55:0/2957045075 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fa9640657a0 0x7fa964067c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa974001240 tx=0x7fa974009040 comp rx=0 tx=0).stop 2023-08-25T04:15:56.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.373+0000 7fa97eed8640 1 -- 172.21.15.55:0/2957045075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780c9900 msgr2=0x7fa9780af8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.373+0000 7fa97eed8640 1 --2- 172.21.15.55:0/2957045075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780c9900 0x7fa9780af8a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa96800c780 tx=0x7fa96800cc40 comp rx=0 tx=0).stop 2023-08-25T04:15:56.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.373+0000 7fa97eed8640 1 -- 172.21.15.55:0/2957045075 shutdown_connections 2023-08-25T04:15:56.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.373+0000 7fa97eed8640 1 --2- 172.21.15.55:0/2957045075 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fa9640657a0 0x7fa964067c60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.373+0000 7fa97eed8640 1 --2- 172.21.15.55:0/2957045075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9780cb020 0x7fa9781fd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.373+0000 7fa97eed8640 1 --2- 172.21.15.55:0/2957045075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780c9900 0x7fa9780af8a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.373+0000 7fa97eed8640 1 --2- 172.21.15.55:0/2957045075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa97806ce30 0x7fa9780c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.373+0000 7fa97eed8640 1 -- 172.21.15.55:0/2957045075 >> 172.21.15.55:0/2957045075 conn(0x7fa978069900 msgr2=0x7fa9780aafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:56.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.373+0000 7fa97eed8640 1 -- 172.21.15.55:0/2957045075 shutdown_connections 2023-08-25T04:15:56.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.373+0000 7fa97eed8640 1 -- 172.21.15.55:0/2957045075 wait complete. 2023-08-25T04:15:56.393 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:15:56.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.541+0000 7fddb4419640 1 Processor -- start 2023-08-25T04:15:56.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.541+0000 7fddb4419640 1 -- start start 2023-08-25T04:15:56.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.541+0000 7fddb4419640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddac06c020 0x7fddac09bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:56.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.541+0000 7fddb4419640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddac15abd0 con 0x7fddac0c9830 2023-08-25T04:15:56.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.541+0000 7fddb4419640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddac0c8ab0 con 0x7fddac15a7f0 2023-08-25T04:15:56.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.541+0000 7fddb4419640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddac0c8d50 con 0x7fddac06c020 2023-08-25T04:15:56.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.541+0000 7fddb19b4640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fddac0c9830 0x7fddac0acff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44904/0 (socket says 172.21.15.55:44904) 2023-08-25T04:15:56.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.541+0000 7fddb19b4640 1 -- 172.21.15.55:0/1336522549 learned_addr learned my addr 172.21.15.55:0/1336522549 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:56.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.541+0000 7fddb29b6640 1 --2- 172.21.15.55:0/1336522549 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddac06c020 0x7fddac09bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:56.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.541+0000 7fddb11b3640 1 -- 172.21.15.55:0/1336522549 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675101964 0 0) 0x7fddac15abd0 con 0x7fddac0c9830 2023-08-25T04:15:56.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.541+0000 7fddb11b3640 1 -- 172.21.15.55:0/1336522549 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd98003530 con 0x7fddac0c9830 2023-08-25T04:15:56.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.541+0000 7fddb29b6640 1 -- 172.21.15.55:0/1336522549 >> v1:172.21.15.110:6789/0 conn(0x7fddac15a7f0 legacy=0x7fddac070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.541+0000 7fddb29b6640 1 -- 172.21.15.55:0/1336522549 >> v1:172.21.15.55:6789/0 conn(0x7fddac0c9830 legacy=0x7fddac0acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.541+0000 7fddb29b6640 1 -- 172.21.15.55:0/1336522549 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac0c9030 con 0x7fddac06c020 2023-08-25T04:15:56.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.545+0000 7fddb29b6640 1 --2- 172.21.15.55:0/1336522549 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddac06c020 0x7fddac09bde0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdda4009dc0 tx=0x7fdda401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4efa6fb7fb90cacc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:56.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.545+0000 7fddb11b3640 1 -- 172.21.15.55:0/1336522549 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda40a5910 con 0x7fddac06c020 2023-08-25T04:15:56.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.545+0000 7fddb11b3640 1 -- 172.21.15.55:0/1336522549 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda40a5a70 con 0x7fddac06c020 2023-08-25T04:15:56.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.545+0000 7fddb11b3640 1 -- 172.21.15.55:0/1336522549 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda40a5e00 con 0x7fddac06c020 2023-08-25T04:15:56.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.545+0000 7fddb4419640 1 -- 172.21.15.55:0/1336522549 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddac06c020 msgr2=0x7fddac09bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.545+0000 7fddb4419640 1 --2- 172.21.15.55:0/1336522549 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddac06c020 0x7fddac09bde0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdda4009dc0 tx=0x7fdda401c940 comp rx=0 tx=0).stop 2023-08-25T04:15:56.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.545+0000 7fddb4419640 1 -- 172.21.15.55:0/1336522549 shutdown_connections 2023-08-25T04:15:56.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.545+0000 7fddb4419640 1 --2- 172.21.15.55:0/1336522549 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddac06c020 0x7fddac09bde0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.545+0000 7fddb4419640 1 -- 172.21.15.55:0/1336522549 >> 172.21.15.55:0/1336522549 conn(0x7fddac069900 msgr2=0x7fddac069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:56.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.545+0000 7fddb4419640 1 -- 172.21.15.55:0/1336522549 shutdown_connections 2023-08-25T04:15:56.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.545+0000 7fddb4419640 1 -- 172.21.15.55:0/1336522549 wait complete. 2023-08-25T04:15:56.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb4419640 1 Processor -- start 2023-08-25T04:15:56.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb4419640 1 -- start start 2023-08-25T04:15:56.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb4419640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddac06c020 0x7fddac1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:56.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb4419640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddac0c9830 0x7fddac1649e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:56.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb4419640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddac15a7f0 0x7fddac158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:56.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb4419640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac165070 con 0x7fddac15a7f0 2023-08-25T04:15:56.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb4419640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac0c5fd0 con 0x7fddac0c9830 2023-08-25T04:15:56.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb4419640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddac0c6270 con 0x7fddac06c020 2023-08-25T04:15:56.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb29b6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddac15a7f0 0x7fddac158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:56.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb21b5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddac06c020 0x7fddac1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:56.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb19b4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddac0c9830 0x7fddac1649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:56.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb29b6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddac15a7f0 0x7fddac158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51834/0 (socket says 172.21.15.55:51834) 2023-08-25T04:15:56.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb29b6640 1 -- 172.21.15.55:0/1555723383 learned_addr learned my addr 172.21.15.55:0/1555723383 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:56.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb29b6640 1 -- 172.21.15.55:0/1555723383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddac06c020 msgr2=0x7fddac1594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb29b6640 1 --2- 172.21.15.55:0/1555723383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddac06c020 0x7fddac1594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb29b6640 1 -- 172.21.15.55:0/1555723383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddac0c9830 msgr2=0x7fddac1649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb29b6640 1 --2- 172.21.15.55:0/1555723383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddac0c9830 0x7fddac1649e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb29b6640 1 -- 172.21.15.55:0/1555723383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda4009a70 con 0x7fddac15a7f0 2023-08-25T04:15:56.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb29b6640 1 --2- 172.21.15.55:0/1555723383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddac15a7f0 0x7fddac158eb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fdda401a570 tx=0x7fdda40196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:56.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fdda2ffd640 1 -- 172.21.15.55:0/1555723383 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda40ad640 con 0x7fddac15a7f0 2023-08-25T04:15:56.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fdda2ffd640 1 -- 172.21.15.55:0/1555723383 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda40ad7a0 con 0x7fddac15a7f0 2023-08-25T04:15:56.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fdda2ffd640 1 -- 172.21.15.55:0/1555723383 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda40adb50 con 0x7fddac15a7f0 2023-08-25T04:15:56.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb4419640 1 -- 172.21.15.55:0/1555723383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddac0adc90 con 0x7fddac15a7f0 2023-08-25T04:15:56.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.549+0000 7fddb4419640 1 -- 172.21.15.55:0/1555723383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddac0c6830 con 0x7fddac15a7f0 2023-08-25T04:15:56.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.553+0000 7fddb4419640 1 -- 172.21.15.55:0/1555723383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddac1651e0 con 0x7fddac15a7f0 2023-08-25T04:15:56.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.553+0000 7fdda2ffd640 1 -- 172.21.15.55:0/1555723383 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fdda40b4050 con 0x7fddac15a7f0 2023-08-25T04:15:56.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.553+0000 7fdda2ffd640 1 --2- 172.21.15.55:0/1555723383 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fdd900657a0 0x7fdd90067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:56.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.553+0000 7fdda2ffd640 1 -- 172.21.15.55:0/1555723383 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5941+0+0 (secure 0 0 0) 0x7fdda411e060 con 0x7fddac15a7f0 2023-08-25T04:15:56.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.553+0000 7fddb21b5640 1 --2- 172.21.15.55:0/1555723383 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fdd900657a0 0x7fdd90067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:56.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.553+0000 7fddb21b5640 1 --2- 172.21.15.55:0/1555723383 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fdd900657a0 0x7fdd90067c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fddac15ddc0 tx=0x7fdda8009040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:56.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.557+0000 7fdda2ffd640 1 -- 172.21.15.55:0/1555723383 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fdda40ebb20 con 0x7fddac15a7f0 2023-08-25T04:15:56.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.717+0000 7fddb4419640 1 -- 172.21.15.55:0/1555723383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fddac06d5b0 con 0x7fddac15a7f0 2023-08-25T04:15:56.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.717+0000 7fdda2ffd640 1 -- 172.21.15.55:0/1555723383 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v54) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdda40b20a0 con 0x7fddac15a7f0 2023-08-25T04:15:56.718 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:15:56.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.721+0000 7fddb4419640 1 -- 172.21.15.55:0/1555723383 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fdd900657a0 msgr2=0x7fdd90067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.721+0000 7fddb4419640 1 --2- 172.21.15.55:0/1555723383 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fdd900657a0 0x7fdd90067c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fddac15ddc0 tx=0x7fdda8009040 comp rx=0 tx=0).stop 2023-08-25T04:15:56.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.721+0000 7fddb4419640 1 -- 172.21.15.55:0/1555723383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddac15a7f0 msgr2=0x7fddac158eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.721+0000 7fddb4419640 1 --2- 172.21.15.55:0/1555723383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddac15a7f0 0x7fddac158eb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fdda401a570 tx=0x7fdda40196e0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.721+0000 7fddb4419640 1 -- 172.21.15.55:0/1555723383 shutdown_connections 2023-08-25T04:15:56.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.721+0000 7fddb4419640 1 --2- 172.21.15.55:0/1555723383 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fdd900657a0 0x7fdd90067c60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.721+0000 7fddb4419640 1 --2- 172.21.15.55:0/1555723383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddac15a7f0 0x7fddac158eb0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.721+0000 7fddb4419640 1 --2- 172.21.15.55:0/1555723383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddac0c9830 0x7fddac1649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.721+0000 7fddb4419640 1 --2- 172.21.15.55:0/1555723383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddac06c020 0x7fddac1594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.721+0000 7fddb4419640 1 -- 172.21.15.55:0/1555723383 >> 172.21.15.55:0/1555723383 conn(0x7fddac069900 msgr2=0x7fddac0af650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:56.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.721+0000 7fddb4419640 1 -- 172.21.15.55:0/1555723383 shutdown_connections 2023-08-25T04:15:56.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.721+0000 7fddb4419640 1 -- 172.21.15.55:0/1555723383 wait complete. 2023-08-25T04:15:56.739 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-25T04:15:56.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.885+0000 7f2932c19640 1 Processor -- start 2023-08-25T04:15:56.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.885+0000 7f2932c19640 1 -- start start 2023-08-25T04:15:56.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.889+0000 7f2932c19640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f292c06e5a0 0x7f292c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:56.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.889+0000 7f2932c19640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f292c0cab90 con 0x7f292c06c3b0 2023-08-25T04:15:56.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.889+0000 7f2932c19640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f292c06dbb0 con 0x7f292c06c790 2023-08-25T04:15:56.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.889+0000 7f2932c19640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f292c0cae50 con 0x7f292c06e5a0 2023-08-25T04:15:56.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.889+0000 7f2923fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f292c06e5a0 0x7f292c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:56.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.889+0000 7f2923fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f292c06e5a0 0x7f292c0cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51842/0 (socket says 172.21.15.55:51842) 2023-08-25T04:15:56.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.889+0000 7f29309b5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f292c06c3b0 0x7f292c06de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44916/0 (socket says 172.21.15.55:44916) 2023-08-25T04:15:56.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.889+0000 7f2923fff640 1 -- 172.21.15.55:0/2351451410 learned_addr learned my addr 172.21.15.55:0/2351451410 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:56.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.889+0000 7f2923fff640 1 -- 172.21.15.55:0/2351451410 >> v1:172.21.15.110:6789/0 conn(0x7f292c06c790 legacy=0x7f292c0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:56.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.889+0000 7f2923fff640 1 -- 172.21.15.55:0/2351451410 >> v1:172.21.15.55:6789/0 conn(0x7f292c06c3b0 legacy=0x7f292c06de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.889+0000 7f2923fff640 1 -- 172.21.15.55:0/2351451410 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292c0cb130 con 0x7f292c06e5a0 2023-08-25T04:15:56.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.889+0000 7f29237fe640 1 -- 172.21.15.55:0/2351451410 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163885059 0 0) 0x7f292c0cab90 con 0x7f292c06c3b0 2023-08-25T04:15:56.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.889+0000 7f2923fff640 1 --2- 172.21.15.55:0/2351451410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f292c06e5a0 0x7f292c0cd7d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f291c009870 tx=0x7f291c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a659ab31f888ca47 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:56.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f29237fe640 1 -- 172.21.15.55:0/2351451410 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c0aa610 con 0x7f292c06e5a0 2023-08-25T04:15:56.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f29237fe640 1 -- 172.21.15.55:0/2351451410 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c0a6040 con 0x7f292c06e5a0 2023-08-25T04:15:56.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f29237fe640 1 -- 172.21.15.55:0/2351451410 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c0aa990 con 0x7f292c06e5a0 2023-08-25T04:15:56.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f2932c19640 1 -- 172.21.15.55:0/2351451410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f292c06e5a0 msgr2=0x7f292c0cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f2932c19640 1 --2- 172.21.15.55:0/2351451410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f292c06e5a0 0x7f292c0cd7d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f291c009870 tx=0x7f291c01c4d0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f2932c19640 1 -- 172.21.15.55:0/2351451410 shutdown_connections 2023-08-25T04:15:56.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f2932c19640 1 --2- 172.21.15.55:0/2351451410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f292c06e5a0 0x7f292c0cd7d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f2932c19640 1 -- 172.21.15.55:0/2351451410 >> 172.21.15.55:0/2351451410 conn(0x7f292c0d0540 msgr2=0x7f292c0d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:56.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f2932c19640 1 -- 172.21.15.55:0/2351451410 shutdown_connections 2023-08-25T04:15:56.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f2932c19640 1 -- 172.21.15.55:0/2351451410 wait complete. 2023-08-25T04:15:56.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f2932c19640 1 Processor -- start 2023-08-25T04:15:56.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f2932c19640 1 -- start start 2023-08-25T04:15:56.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f2932c19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f292c06c3b0 0x7f292c15f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:56.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f2932c19640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f292c06c790 0x7f292c15c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:56.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f2932c19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f292c06e5a0 0x7f292c0c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:56.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f2932c19640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c15dbb0 con 0x7f292c06e5a0 2023-08-25T04:15:56.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f2932c19640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c15ccd0 con 0x7f292c06c790 2023-08-25T04:15:56.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f2932c19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292c15cf30 con 0x7f292c06c3b0 2023-08-25T04:15:56.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.893+0000 7f29311b6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f292c06e5a0 0x7f292c0c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:56.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f29311b6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f292c06e5a0 0x7f292c0c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51850/0 (socket says 172.21.15.55:51850) 2023-08-25T04:15:56.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f29311b6640 1 -- 172.21.15.55:0/2554066783 learned_addr learned my addr 172.21.15.55:0/2554066783 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:56.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f29309b5640 1 --2- 172.21.15.55:0/2554066783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f292c06c3b0 0x7f292c15f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:56.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f2923fff640 1 --2- 172.21.15.55:0/2554066783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f292c06c790 0x7f292c15c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:56.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f29311b6640 1 -- 172.21.15.55:0/2554066783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f292c06c3b0 msgr2=0x7f292c15f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f29311b6640 1 --2- 172.21.15.55:0/2554066783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f292c06c3b0 0x7f292c15f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f29311b6640 1 -- 172.21.15.55:0/2554066783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f292c06c790 msgr2=0x7f292c15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:56.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f29311b6640 1 --2- 172.21.15.55:0/2554066783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f292c06c790 0x7f292c15c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:56.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f29311b6640 1 -- 172.21.15.55:0/2554066783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c0094d0 con 0x7f292c06e5a0 2023-08-25T04:15:56.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f29311b6640 1 --2- 172.21.15.55:0/2554066783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f292c06e5a0 0x7f292c0c5800 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f292400c780 tx=0x7f292400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:56.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f29217fa640 1 -- 172.21.15.55:0/2554066783 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2924004b70 con 0x7f292c06e5a0 2023-08-25T04:15:56.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f29217fa640 1 -- 172.21.15.55:0/2554066783 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292400ce90 con 0x7f292c06e5a0 2023-08-25T04:15:56.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f29217fa640 1 -- 172.21.15.55:0/2554066783 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292400a850 con 0x7f292c06e5a0 2023-08-25T04:15:56.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f2932c19640 1 -- 172.21.15.55:0/2554066783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f292c15d210 con 0x7f292c06e5a0 2023-08-25T04:15:56.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f2932c19640 1 -- 172.21.15.55:0/2554066783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292c15d7d0 con 0x7f292c06e5a0 2023-08-25T04:15:56.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f2932c19640 1 -- 172.21.15.55:0/2554066783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f292c073ec0 con 0x7f292c06e5a0 2023-08-25T04:15:56.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f29217fa640 1 -- 172.21.15.55:0/2554066783 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f292400a9b0 con 0x7f292c06e5a0 2023-08-25T04:15:56.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f29217fa640 1 --2- 172.21.15.55:0/2554066783 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f29180657a0 0x7f2918067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:56.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.897+0000 7f29217fa640 1 -- 172.21.15.55:0/2554066783 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5941+0+0 (secure 0 0 0) 0x7f2924083150 con 0x7f292c06e5a0 2023-08-25T04:15:56.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.901+0000 7f29309b5640 1 --2- 172.21.15.55:0/2554066783 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f29180657a0 0x7f2918067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:56.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.901+0000 7f29309b5640 1 --2- 172.21.15.55:0/2554066783 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f29180657a0 0x7f2918067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2928007fd0 tx=0x7f2928009040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:56.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:56.901+0000 7f29217fa640 1 -- 172.21.15.55:0/2554066783 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f29240545f0 con 0x7f292c06e5a0 2023-08-25T04:15:57.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.061+0000 7f2932c19640 1 -- 172.21.15.55:0/2554066783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f292c06ed00 con 0x7f292c06e5a0 2023-08-25T04:15:57.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.065+0000 7f29217fa640 1 -- 172.21.15.55:0/2554066783 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2924054180 con 0x7f292c06e5a0 2023-08-25T04:15:57.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.069+0000 7f2932c19640 1 -- 172.21.15.55:0/2554066783 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f29180657a0 msgr2=0x7f2918067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:57.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.069+0000 7f2932c19640 1 --2- 172.21.15.55:0/2554066783 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f29180657a0 0x7f2918067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2928007fd0 tx=0x7f2928009040 comp rx=0 tx=0).stop 2023-08-25T04:15:57.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.069+0000 7f2932c19640 1 -- 172.21.15.55:0/2554066783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f292c06e5a0 msgr2=0x7f292c0c5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:57.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.069+0000 7f2932c19640 1 --2- 172.21.15.55:0/2554066783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f292c06e5a0 0x7f292c0c5800 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f292400c780 tx=0x7f292400cc40 comp rx=0 tx=0).stop 2023-08-25T04:15:57.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.069+0000 7f2932c19640 1 -- 172.21.15.55:0/2554066783 shutdown_connections 2023-08-25T04:15:57.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.069+0000 7f2932c19640 1 --2- 172.21.15.55:0/2554066783 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f29180657a0 0x7f2918067c60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.069+0000 7f2932c19640 1 --2- 172.21.15.55:0/2554066783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f292c06e5a0 0x7f292c0c5800 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.069+0000 7f2932c19640 1 --2- 172.21.15.55:0/2554066783 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f292c06c790 0x7f292c15c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.069+0000 7f2932c19640 1 --2- 172.21.15.55:0/2554066783 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f292c06c3b0 0x7f292c15f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.069+0000 7f2932c19640 1 -- 172.21.15.55:0/2554066783 >> 172.21.15.55:0/2554066783 conn(0x7f292c0d0540 msgr2=0x7f292c0ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:57.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.069+0000 7f2932c19640 1 -- 172.21.15.55:0/2554066783 shutdown_connections 2023-08-25T04:15:57.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.069+0000 7f2932c19640 1 -- 172.21.15.55:0/2554066783 wait complete. 2023-08-25T04:15:57.088 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T04:15:57.089 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:15:57.145 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:15:57.207 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T04:15:57.208 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:15:57.209 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:15:57.217 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T04:15:57.218 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:15:57.218 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:15:57.228 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:15:57.228 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:15:57.229 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:15:57.266 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T04:15:57.267 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:15:57.268 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:15:57.277 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:15:57.278 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-25T04:15:57.278 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:15:57.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.453+0000 7f06cccec640 1 Processor -- start 2023-08-25T04:15:57.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.453+0000 7f06cccec640 1 -- start start 2023-08-25T04:15:57.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.453+0000 7f06cccec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c80ad950 0x7f06c80cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:57.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.453+0000 7f06cccec640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f06c80c89f0 0x7f06c80ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:57.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.457+0000 7f06cccec640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06c806c000 0x7f06c80cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:57.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.457+0000 7f06cccec640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c80b11f0 con 0x7f06c806c000 2023-08-25T04:15:57.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.457+0000 7f06cccec640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c8159d50 con 0x7f06c80c89f0 2023-08-25T04:15:57.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.457+0000 7f06cccec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80cc880 con 0x7f06c80ad950 2023-08-25T04:15:57.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.457+0000 7f06c6d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06c806c000 0x7f06c80cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:57.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.457+0000 7f06c6d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06c806c000 0x7f06c80cece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51864/0 (socket says 172.21.15.55:51864) 2023-08-25T04:15:57.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.457+0000 7f06c6d9d640 1 -- 172.21.15.55:0/3320047158 learned_addr learned my addr 172.21.15.55:0/3320047158 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:57.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.457+0000 7f06bffff640 1 --2- 172.21.15.55:0/3320047158 >> v2:172.21.15.110:3300/0 conn(0x7f06c80c89f0 0x7f06c80ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:57.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.457+0000 7f06c659c640 1 --2- 172.21.15.55:0/3320047158 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c80ad950 0x7f06c80cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:57.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.457+0000 7f06c6d9d640 1 -- 172.21.15.55:0/3320047158 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c80ad950 msgr2=0x7f06c80cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:57.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.457+0000 7f06c6d9d640 1 --2- 172.21.15.55:0/3320047158 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c80ad950 0x7f06c80cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.457+0000 7f06c6d9d640 1 -- 172.21.15.55:0/3320047158 >> v2:172.21.15.110:3300/0 conn(0x7f06c80c89f0 msgr2=0x7f06c80ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:57.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.457+0000 7f06c6d9d640 1 --2- 172.21.15.55:0/3320047158 >> v2:172.21.15.110:3300/0 conn(0x7f06c80c89f0 0x7f06c80ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.457+0000 7f06c6d9d640 1 -- 172.21.15.55:0/3320047158 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80ccb60 con 0x7f06c806c000 2023-08-25T04:15:57.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.457+0000 7f06bffff640 1 --2- 172.21.15.55:0/3320047158 >> v2:172.21.15.110:3300/0 conn(0x7f06c80c89f0 0x7f06c80ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:57.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.457+0000 7f06c6d9d640 1 --2- 172.21.15.55:0/3320047158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c806c000 0x7f06c80cece0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f06c806a930 tx=0x7f06c001eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723a174fbeba6a8a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:57.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06c5d9b640 1 -- 172.21.15.55:0/3320047158 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c000b2d0 con 0x7f06c806c000 2023-08-25T04:15:57.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06c5d9b640 1 -- 172.21.15.55:0/3320047158 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c000b430 con 0x7f06c806c000 2023-08-25T04:15:57.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06c5d9b640 1 -- 172.21.15.55:0/3320047158 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c00a7bc0 con 0x7f06c806c000 2023-08-25T04:15:57.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06cccec640 1 -- 172.21.15.55:0/3320047158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c806c000 msgr2=0x7f06c80cece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:57.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06cccec640 1 --2- 172.21.15.55:0/3320047158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c806c000 0x7f06c80cece0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f06c806a930 tx=0x7f06c001eb10 comp rx=0 tx=0).stop 2023-08-25T04:15:57.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06cccec640 1 -- 172.21.15.55:0/3320047158 shutdown_connections 2023-08-25T04:15:57.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06cccec640 1 --2- 172.21.15.55:0/3320047158 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c806c000 0x7f06c80cece0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06cccec640 1 --2- 172.21.15.55:0/3320047158 >> v2:172.21.15.110:3300/0 conn(0x7f06c80c89f0 0x7f06c80ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06cccec640 1 --2- 172.21.15.55:0/3320047158 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c80ad950 0x7f06c80cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06cccec640 1 -- 172.21.15.55:0/3320047158 >> 172.21.15.55:0/3320047158 conn(0x7f06c8069d00 msgr2=0x7f06c806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:57.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06cccec640 1 -- 172.21.15.55:0/3320047158 shutdown_connections 2023-08-25T04:15:57.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06cccec640 1 -- 172.21.15.55:0/3320047158 wait complete. 2023-08-25T04:15:57.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06cccec640 1 Processor -- start 2023-08-25T04:15:57.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06cccec640 1 -- start start 2023-08-25T04:15:57.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06cccec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c806c000 0x7f06c8152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:57.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06cccec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c80ad950 0x7f06c8070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:57.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06cccec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06c80c89f0 0x7f06c80714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:57.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06cccec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c8157070 con 0x7f06c806c000 2023-08-25T04:15:57.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06cccec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c8157280 con 0x7f06c80c89f0 2023-08-25T04:15:57.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06cccec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c8157560 con 0x7f06c80ad950 2023-08-25T04:15:57.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06c659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c806c000 0x7f06c8152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:57.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06c659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c806c000 0x7f06c8152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51880/0 (socket says 172.21.15.55:51880) 2023-08-25T04:15:57.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.461+0000 7f06c659c640 1 -- 172.21.15.55:0/4176468894 learned_addr learned my addr 172.21.15.55:0/4176468894 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:57.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.465+0000 7f06bffff640 1 --2- 172.21.15.55:0/4176468894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c80ad950 0x7f06c8070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:57.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.465+0000 7f06c6d9d640 1 --2- 172.21.15.55:0/4176468894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06c80c89f0 0x7f06c80714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:57.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.465+0000 7f06c659c640 1 -- 172.21.15.55:0/4176468894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c80ad950 msgr2=0x7f06c8070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:57.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.465+0000 7f06c659c640 1 --2- 172.21.15.55:0/4176468894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c80ad950 0x7f06c8070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.465+0000 7f06c659c640 1 -- 172.21.15.55:0/4176468894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06c80c89f0 msgr2=0x7f06c80714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:57.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.465+0000 7f06c659c640 1 --2- 172.21.15.55:0/4176468894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06c80c89f0 0x7f06c80714c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.465+0000 7f06c659c640 1 -- 172.21.15.55:0/4176468894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c000bd40 con 0x7f06c806c000 2023-08-25T04:15:57.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.465+0000 7f06c659c640 1 --2- 172.21.15.55:0/4176468894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c806c000 0x7f06c8152380 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f06b800d800 tx=0x7f06b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:57.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.465+0000 7f06beffd640 1 -- 172.21.15.55:0/4176468894 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b80096a0 con 0x7f06c806c000 2023-08-25T04:15:57.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.465+0000 7f06beffd640 1 -- 172.21.15.55:0/4176468894 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b8009800 con 0x7f06c806c000 2023-08-25T04:15:57.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.465+0000 7f06beffd640 1 -- 172.21.15.55:0/4176468894 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b8009b70 con 0x7f06c806c000 2023-08-25T04:15:57.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.465+0000 7f06cccec640 1 -- 172.21.15.55:0/4176468894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c8157840 con 0x7f06c806c000 2023-08-25T04:15:57.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.465+0000 7f06cccec640 1 -- 172.21.15.55:0/4176468894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c81528c0 con 0x7f06c806c000 2023-08-25T04:15:57.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.465+0000 7f06cccec640 1 -- 172.21.15.55:0/4176468894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c804dbe0 con 0x7f06c806c000 2023-08-25T04:15:57.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.465+0000 7f06beffd640 1 -- 172.21.15.55:0/4176468894 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f06b8009cd0 con 0x7f06c806c000 2023-08-25T04:15:57.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.469+0000 7f06beffd640 1 --2- 172.21.15.55:0/4176468894 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f06a80657a0 0x7f06a8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:57.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.469+0000 7f06beffd640 1 -- 172.21.15.55:0/4176468894 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5941+0+0 (secure 0 0 0) 0x7f06b8083700 con 0x7f06c806c000 2023-08-25T04:15:57.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.469+0000 7f06bffff640 1 --2- 172.21.15.55:0/4176468894 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f06a80657a0 0x7f06a8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:57.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.469+0000 7f06bffff640 1 --2- 172.21.15.55:0/4176468894 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f06a80657a0 0x7f06a8067c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f06c81f81d0 tx=0x7f06b0008040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:57.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.473+0000 7f06beffd640 1 -- 172.21.15.55:0/4176468894 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f06b8051080 con 0x7f06c806c000 2023-08-25T04:15:57.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.661+0000 7f06cccec640 1 -- 172.21.15.55:0/4176468894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06c80cddf0 con 0x7f06c806c000 2023-08-25T04:15:57.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.661+0000 7f06beffd640 1 -- 172.21.15.55:0/4176468894 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f06b80546a0 con 0x7f06c806c000 2023-08-25T04:15:57.660 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:57.660 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4838,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1920231780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1920231780},{"type":"v1","addr":"172.21.15.110:6837","nonce":1920231780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2215940247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2215940247},{"type":"v1","addr":"172.21.15.55:6835","nonce":2215940247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5074,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1708341067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1708341067},{"type":"v1","addr":"172.21.15.110:6836","nonce":1708341067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":6087,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/188387883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":188387883},{"type":"v1","addr":"172.21.15.55:6834","nonce":188387883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17}],"filesystems":[]} 2023-08-25T04:15:57.661 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2023-08-25T04:15:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.661+0000 7f06cccec640 1 -- 172.21.15.55:0/4176468894 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f06a80657a0 msgr2=0x7f06a8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.661+0000 7f06cccec640 1 --2- 172.21.15.55:0/4176468894 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f06a80657a0 0x7f06a8067c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f06c81f81d0 tx=0x7f06b0008040 comp rx=0 tx=0).stop 2023-08-25T04:15:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.661+0000 7f06cccec640 1 -- 172.21.15.55:0/4176468894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c806c000 msgr2=0x7f06c8152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.661+0000 7f06cccec640 1 --2- 172.21.15.55:0/4176468894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c806c000 0x7f06c8152380 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f06b800d800 tx=0x7f06b800dcc0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.661+0000 7f06cccec640 1 -- 172.21.15.55:0/4176468894 shutdown_connections 2023-08-25T04:15:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.661+0000 7f06cccec640 1 --2- 172.21.15.55:0/4176468894 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f06a80657a0 0x7f06a8067c60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.661+0000 7f06cccec640 1 --2- 172.21.15.55:0/4176468894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06c80c89f0 0x7f06c80714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.661+0000 7f06cccec640 1 --2- 172.21.15.55:0/4176468894 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c80ad950 0x7f06c8070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.661+0000 7f06cccec640 1 --2- 172.21.15.55:0/4176468894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c806c000 0x7f06c8152380 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.661+0000 7f06cccec640 1 -- 172.21.15.55:0/4176468894 >> 172.21.15.55:0/4176468894 conn(0x7f06c8069d00 msgr2=0x7f06c80b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:57.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.661+0000 7f06cccec640 1 -- 172.21.15.55:0/4176468894 shutdown_connections 2023-08-25T04:15:57.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.661+0000 7f06cccec640 1 -- 172.21.15.55:0/4176468894 wait complete. 2023-08-25T04:15:57.681 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-25T04:15:57.682 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-25T04:15:57.682 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-25T04:15:57.682 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:15:57.682 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-25T04:15:57.683 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-25T04:15:57.683 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-25T04:15:57.683 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:15:57.684 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-25T04:15:57.684 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-25T04:15:57.684 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-25T04:15:57.684 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:15:57.685 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-25T04:15:57.685 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-25T04:15:57.685 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-25T04:15:57.685 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:15:57.694 INFO:tasks.ceph.mds.a:Stopped 2023-08-25T04:15:57.695 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-25T04:15:57.696 INFO:tasks.ceph.mds.c:Stopped 2023-08-25T04:15:57.697 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-25T04:15:57.699 INFO:tasks.ceph.mds.d:Stopped 2023-08-25T04:15:57.700 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-25T04:15:57.700 INFO:tasks.ceph.mds.b:Stopped 2023-08-25T04:15:57.701 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-25T04:15:57.742 INFO:tasks.ceph.mds.a:Started 2023-08-25T04:15:57.742 DEBUG:teuthology.parallel:result is None 2023-08-25T04:15:57.743 INFO:tasks.ceph.mds.c:Started 2023-08-25T04:15:57.744 DEBUG:teuthology.parallel:result is None 2023-08-25T04:15:57.749 INFO:tasks.ceph.mds.d:Started 2023-08-25T04:15:57.749 DEBUG:teuthology.parallel:result is None 2023-08-25T04:15:57.750 INFO:tasks.ceph.mds.b:Started 2023-08-25T04:15:57.750 DEBUG:teuthology.parallel:result is None 2023-08-25T04:15:57.751 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-25T04:15:57.831 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-08-25T04:15:57.831 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T04:15:57.838 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2023-08-25T04:15:57.838 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2023-08-25T04:15:57.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.901+0000 7fa678767640 1 Processor -- start 2023-08-25T04:15:57.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.901+0000 7fa678767640 1 -- start start 2023-08-25T04:15:57.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.901+0000 7fa678767640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6700ce220 0x7fa6700b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:57.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.901+0000 7fa678767640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6700b29b0 con 0x7fa6700d0da0 2023-08-25T04:15:57.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.901+0000 7fa678767640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6700ce6b0 con 0x7fa6700cdde0 2023-08-25T04:15:57.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.901+0000 7fa678767640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6700b1dc0 con 0x7fa6700ce220 2023-08-25T04:15:57.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.901+0000 7fa676503640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa6700d0da0 0x7fa6700d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44932/0 (socket says 172.21.15.55:44932) 2023-08-25T04:15:57.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.901+0000 7fa676503640 1 -- 172.21.15.55:0/4051086394 learned_addr learned my addr 172.21.15.55:0/4051086394 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:57.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.905+0000 7fa676d04640 1 --2- 172.21.15.55:0/4051086394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6700ce220 0x7fa6700b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:57.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.905+0000 7fa675501640 1 -- 172.21.15.55:0/4051086394 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496471388 0 0) 0x7fa6700b29b0 con 0x7fa6700d0da0 2023-08-25T04:15:57.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.905+0000 7fa675501640 1 -- 172.21.15.55:0/4051086394 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa65c003530 con 0x7fa6700d0da0 2023-08-25T04:15:57.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.905+0000 7fa675501640 1 -- 172.21.15.55:0/4051086394 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666871864 0 0) 0x7fa6700ce6b0 con 0x7fa6700cdde0 2023-08-25T04:15:57.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.905+0000 7fa675501640 1 -- 172.21.15.55:0/4051086394 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6700b29b0 con 0x7fa6700cdde0 2023-08-25T04:15:57.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.905+0000 7fa676d04640 1 -- 172.21.15.55:0/4051086394 >> v1:172.21.15.110:6789/0 conn(0x7fa6700cdde0 legacy=0x7fa6700b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:57.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.905+0000 7fa676d04640 1 -- 172.21.15.55:0/4051086394 >> v1:172.21.15.55:6789/0 conn(0x7fa6700d0da0 legacy=0x7fa6700d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:57.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.905+0000 7fa676d04640 1 -- 172.21.15.55:0/4051086394 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6700b2080 con 0x7fa6700ce220 2023-08-25T04:15:57.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.905+0000 7fa676d04640 1 --2- 172.21.15.55:0/4051086394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6700ce220 0x7fa6700b3550 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa668009dc0 tx=0x7fa66801f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24b7966a8f0aa33f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:57.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.905+0000 7fa675501640 1 -- 172.21.15.55:0/4051086394 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6680af600 con 0x7fa6700ce220 2023-08-25T04:15:57.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.905+0000 7fa675501640 1 -- 172.21.15.55:0/4051086394 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6680ab050 con 0x7fa6700ce220 2023-08-25T04:15:57.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.905+0000 7fa675501640 1 -- 172.21.15.55:0/4051086394 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6680af980 con 0x7fa6700ce220 2023-08-25T04:15:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa678767640 1 -- 172.21.15.55:0/4051086394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6700ce220 msgr2=0x7fa6700b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa678767640 1 --2- 172.21.15.55:0/4051086394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6700ce220 0x7fa6700b3550 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa668009dc0 tx=0x7fa66801f150 comp rx=0 tx=0).stop 2023-08-25T04:15:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa678767640 1 -- 172.21.15.55:0/4051086394 shutdown_connections 2023-08-25T04:15:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa678767640 1 --2- 172.21.15.55:0/4051086394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6700ce220 0x7fa6700b3550 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa678767640 1 -- 172.21.15.55:0/4051086394 >> 172.21.15.55:0/4051086394 conn(0x7fa67009bae0 msgr2=0x7fa6700d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:57.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa678767640 1 -- 172.21.15.55:0/4051086394 shutdown_connections 2023-08-25T04:15:57.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa678767640 1 -- 172.21.15.55:0/4051086394 wait complete. 2023-08-25T04:15:57.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa678767640 1 Processor -- start 2023-08-25T04:15:57.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa678767640 1 -- start start 2023-08-25T04:15:57.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa678767640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6700cdde0 0x7fa670155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:57.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa678767640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6700ce220 0x7fa6700c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:57.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa678767640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6700d0da0 0x7fa670155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:57.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa678767640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6700b5730 con 0x7fa6700cdde0 2023-08-25T04:15:57.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa678767640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa670155890 con 0x7fa6700ce220 2023-08-25T04:15:57.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa678767640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6700b7a90 con 0x7fa6700d0da0 2023-08-25T04:15:57.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa676503640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6700cdde0 0x7fa670155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa676503640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6700cdde0 0x7fa670155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51918/0 (socket says 172.21.15.55:51918) 2023-08-25T04:15:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa676503640 1 -- 172.21.15.55:0/2052702388 learned_addr learned my addr 172.21.15.55:0/2052702388 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.909+0000 7fa675d02640 1 --2- 172.21.15.55:0/2052702388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6700ce220 0x7fa6700c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.913+0000 7fa676d04640 1 --2- 172.21.15.55:0/2052702388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6700d0da0 0x7fa670155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.913+0000 7fa676503640 1 -- 172.21.15.55:0/2052702388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6700d0da0 msgr2=0x7fa670155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.913+0000 7fa676503640 1 --2- 172.21.15.55:0/2052702388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6700d0da0 0x7fa670155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.913+0000 7fa676503640 1 -- 172.21.15.55:0/2052702388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6700ce220 msgr2=0x7fa6700c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:57.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.913+0000 7fa676503640 1 --2- 172.21.15.55:0/2052702388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6700ce220 0x7fa6700c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:57.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.913+0000 7fa676503640 1 -- 172.21.15.55:0/2052702388 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa668009a70 con 0x7fa6700cdde0 2023-08-25T04:15:57.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.913+0000 7fa676503640 1 --2- 172.21.15.55:0/2052702388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6700cdde0 0x7fa670155a70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00c700 tx=0x7fa66c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:57.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.913+0000 7fa666ffd640 1 -- 172.21.15.55:0/2052702388 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c007270 con 0x7fa6700cdde0 2023-08-25T04:15:57.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.913+0000 7fa666ffd640 1 -- 172.21.15.55:0/2052702388 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c0073d0 con 0x7fa6700cdde0 2023-08-25T04:15:57.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.913+0000 7fa666ffd640 1 -- 172.21.15.55:0/2052702388 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c0057b0 con 0x7fa6700cdde0 2023-08-25T04:15:57.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.913+0000 7fa678767640 1 -- 172.21.15.55:0/2052702388 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6700b7d70 con 0x7fa6700cdde0 2023-08-25T04:15:57.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.913+0000 7fa678767640 1 -- 172.21.15.55:0/2052702388 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6700b8330 con 0x7fa6700cdde0 2023-08-25T04:15:57.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.913+0000 7fa678767640 1 -- 172.21.15.55:0/2052702388 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6700c62f0 con 0x7fa6700cdde0 2023-08-25T04:15:57.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.913+0000 7fa666ffd640 1 -- 172.21.15.55:0/2052702388 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fa66c005910 con 0x7fa6700cdde0 2023-08-25T04:15:57.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.913+0000 7fa666ffd640 1 --2- 172.21.15.55:0/2052702388 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fa6540657a0 0x7fa654067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:57.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.917+0000 7fa666ffd640 1 -- 172.21.15.55:0/2052702388 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5941+0+0 (secure 0 0 0) 0x7fa66c082320 con 0x7fa6700cdde0 2023-08-25T04:15:57.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.917+0000 7fa675d02640 1 --2- 172.21.15.55:0/2052702388 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fa6540657a0 0x7fa654067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:57.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.917+0000 7fa675d02640 1 --2- 172.21.15.55:0/2052702388 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fa6540657a0 0x7fa654067c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa6700b4020 tx=0x7fa660009040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:57.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:57.917+0000 7fa666ffd640 1 -- 172.21.15.55:0/2052702388 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa66c04fe80 con 0x7fa6700cdde0 2023-08-25T04:15:58.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.085+0000 7fa678767640 1 -- 172.21.15.55:0/2052702388 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa67004dbe0 con 0x7fa6700cdde0 2023-08-25T04:15:58.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.709+0000 7fa666ffd640 1 -- 172.21.15.55:0/2052702388 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa66c017020 con 0x7fa6700cdde0 2023-08-25T04:15:58.709 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-08-25T04:15:58.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.713+0000 7fa678767640 1 -- 172.21.15.55:0/2052702388 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fa6540657a0 msgr2=0x7fa654067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:58.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.713+0000 7fa678767640 1 --2- 172.21.15.55:0/2052702388 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fa6540657a0 0x7fa654067c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa6700b4020 tx=0x7fa660009040 comp rx=0 tx=0).stop 2023-08-25T04:15:58.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.713+0000 7fa678767640 1 -- 172.21.15.55:0/2052702388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6700cdde0 msgr2=0x7fa670155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:58.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.713+0000 7fa678767640 1 --2- 172.21.15.55:0/2052702388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6700cdde0 0x7fa670155a70 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00c700 tx=0x7fa66c00cbc0 comp rx=0 tx=0).stop 2023-08-25T04:15:58.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.713+0000 7fa678767640 1 -- 172.21.15.55:0/2052702388 shutdown_connections 2023-08-25T04:15:58.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.713+0000 7fa678767640 1 --2- 172.21.15.55:0/2052702388 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fa6540657a0 0x7fa654067c60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:58.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.713+0000 7fa678767640 1 --2- 172.21.15.55:0/2052702388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6700d0da0 0x7fa670155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:58.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.713+0000 7fa678767640 1 --2- 172.21.15.55:0/2052702388 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6700ce220 0x7fa6700c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:58.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.713+0000 7fa678767640 1 --2- 172.21.15.55:0/2052702388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6700cdde0 0x7fa670155a70 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:58.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.713+0000 7fa678767640 1 -- 172.21.15.55:0/2052702388 >> 172.21.15.55:0/2052702388 conn(0x7fa67009bae0 msgr2=0x7fa6700af440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:58.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.713+0000 7fa678767640 1 -- 172.21.15.55:0/2052702388 shutdown_connections 2023-08-25T04:15:58.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.713+0000 7fa678767640 1 -- 172.21.15.55:0/2052702388 wait complete. 2023-08-25T04:15:58.739 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-25T04:15:58.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.885+0000 7f36bc500640 1 Processor -- start 2023-08-25T04:15:58.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.885+0000 7f36bc500640 1 -- start start 2023-08-25T04:15:58.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.889+0000 7f36bc500640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f36b415c9c0 0x7f36b4160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:58.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.889+0000 7f36bc500640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36b406b2b0 0x7f36b406b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:58.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.889+0000 7f36bc500640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b406eaf0 con 0x7f36b40cfa70 2023-08-25T04:15:58.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.889+0000 7f36bc500640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b406e530 con 0x7f36b415c9c0 2023-08-25T04:15:58.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.889+0000 7f36bc500640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b406e810 con 0x7f36b406b2b0 2023-08-25T04:15:58.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.889+0000 7f36b9a9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f36b40cfa70 0x7f36b4160a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44934/0 (socket says 172.21.15.55:44934) 2023-08-25T04:15:58.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.889+0000 7f36b9a9b640 1 -- 172.21.15.55:0/1930977094 learned_addr learned my addr 172.21.15.55:0/1930977094 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:58.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.889+0000 7f36baa9d640 1 --2- 172.21.15.55:0/1930977094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36b406b2b0 0x7f36b406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:58.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.889+0000 7f36ba29c640 1 --2- 172.21.15.55:0/1930977094 >> v2:172.21.15.110:3300/0 conn(0x7f36b415c9c0 0x7f36b4160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:58.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.889+0000 7f36b929a640 1 -- 172.21.15.55:0/1930977094 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971464205 0 0) 0x7f36b406eaf0 con 0x7f36b40cfa70 2023-08-25T04:15:58.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.889+0000 7f36b929a640 1 -- 172.21.15.55:0/1930977094 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36a0003530 con 0x7f36b40cfa70 2023-08-25T04:15:58.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.889+0000 7f36baa9d640 1 -- 172.21.15.55:0/1930977094 >> v2:172.21.15.110:3300/0 conn(0x7f36b415c9c0 msgr2=0x7f36b4160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:58.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.889+0000 7f36baa9d640 1 --2- 172.21.15.55:0/1930977094 >> v2:172.21.15.110:3300/0 conn(0x7f36b415c9c0 0x7f36b4160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:58.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.889+0000 7f36baa9d640 1 -- 172.21.15.55:0/1930977094 >> v1:172.21.15.55:6789/0 conn(0x7f36b40cfa70 legacy=0x7f36b4160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:58.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.889+0000 7f36baa9d640 1 -- 172.21.15.55:0/1930977094 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b406aab0 con 0x7f36b406b2b0 2023-08-25T04:15:58.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.893+0000 7f36baa9d640 1 --2- 172.21.15.55:0/1930977094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36b406b2b0 0x7f36b406b760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009d90 tx=0x7f36ac01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d87c02460918e2d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:58.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.893+0000 7f36b929a640 1 -- 172.21.15.55:0/1930977094 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac0a59a0 con 0x7f36b406b2b0 2023-08-25T04:15:58.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.893+0000 7f36b929a640 1 -- 172.21.15.55:0/1930977094 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac0a5b00 con 0x7f36b406b2b0 2023-08-25T04:15:58.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.893+0000 7f36b929a640 1 -- 172.21.15.55:0/1930977094 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac0a5e90 con 0x7f36b406b2b0 2023-08-25T04:15:58.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.893+0000 7f36bc500640 1 -- 172.21.15.55:0/1930977094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36b406b2b0 msgr2=0x7f36b406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:58.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.893+0000 7f36bc500640 1 --2- 172.21.15.55:0/1930977094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36b406b2b0 0x7f36b406b760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009d90 tx=0x7f36ac01c920 comp rx=0 tx=0).stop 2023-08-25T04:15:58.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.893+0000 7f36bc500640 1 -- 172.21.15.55:0/1930977094 shutdown_connections 2023-08-25T04:15:58.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.893+0000 7f36bc500640 1 --2- 172.21.15.55:0/1930977094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36b406b2b0 0x7f36b406b760 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:58.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.893+0000 7f36bc500640 1 --2- 172.21.15.55:0/1930977094 >> v2:172.21.15.110:3300/0 conn(0x7f36b415c9c0 0x7f36b4160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:58.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.893+0000 7f36bc500640 1 -- 172.21.15.55:0/1930977094 >> 172.21.15.55:0/1930977094 conn(0x7f36b40d05a0 msgr2=0x7f36b40d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:58.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.893+0000 7f36bc500640 1 -- 172.21.15.55:0/1930977094 shutdown_connections 2023-08-25T04:15:58.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.893+0000 7f36bc500640 1 -- 172.21.15.55:0/1930977094 wait complete. 2023-08-25T04:15:58.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.893+0000 7f36bc500640 1 Processor -- start 2023-08-25T04:15:58.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.893+0000 7f36bc500640 1 -- start start 2023-08-25T04:15:58.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36bc500640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36b406b2b0 0x7f36b4149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:58.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36bc500640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36b40cfa70 0x7f36b40c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:58.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36bc500640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36b415c9c0 0x7f36b4157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:58.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36bc500640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b4156b10 con 0x7f36b415c9c0 2023-08-25T04:15:58.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36bc500640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40c50f0 con 0x7f36b406b2b0 2023-08-25T04:15:58.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36bc500640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40c53d0 con 0x7f36b40cfa70 2023-08-25T04:15:58.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36baa9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36b415c9c0 0x7f36b4157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:58.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36baa9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36b415c9c0 0x7f36b4157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51924/0 (socket says 172.21.15.55:51924) 2023-08-25T04:15:58.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36baa9d640 1 -- 172.21.15.55:0/1995053402 learned_addr learned my addr 172.21.15.55:0/1995053402 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:58.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36b9a9b640 1 --2- 172.21.15.55:0/1995053402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36b40cfa70 0x7f36b40c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:58.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36ba29c640 1 --2- 172.21.15.55:0/1995053402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36b406b2b0 0x7f36b4149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:58.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36baa9d640 1 -- 172.21.15.55:0/1995053402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36b40cfa70 msgr2=0x7f36b40c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:58.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36baa9d640 1 --2- 172.21.15.55:0/1995053402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36b40cfa70 0x7f36b40c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:58.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36baa9d640 1 -- 172.21.15.55:0/1995053402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36b406b2b0 msgr2=0x7f36b4149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:58.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36baa9d640 1 --2- 172.21.15.55:0/1995053402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36b406b2b0 0x7f36b4149700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:58.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36baa9d640 1 -- 172.21.15.55:0/1995053402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac009a70 con 0x7f36b415c9c0 2023-08-25T04:15:58.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36baa9d640 1 --2- 172.21.15.55:0/1995053402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36b415c9c0 0x7f36b4157590 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f36ac0b0040 tx=0x7f36ac0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:58.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36aaffd640 1 -- 172.21.15.55:0/1995053402 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac0adce0 con 0x7f36b415c9c0 2023-08-25T04:15:58.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36aaffd640 1 -- 172.21.15.55:0/1995053402 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac0ade40 con 0x7f36b415c9c0 2023-08-25T04:15:58.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36aaffd640 1 -- 172.21.15.55:0/1995053402 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac0b9690 con 0x7f36b415c9c0 2023-08-25T04:15:58.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36bc500640 1 -- 172.21.15.55:0/1995053402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b4156d90 con 0x7f36b415c9c0 2023-08-25T04:15:58.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36bc500640 1 -- 172.21.15.55:0/1995053402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b4149c40 con 0x7f36b415c9c0 2023-08-25T04:15:58.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36bc500640 1 -- 172.21.15.55:0/1995053402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b40af910 con 0x7f36b415c9c0 2023-08-25T04:15:58.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.897+0000 7f36aaffd640 1 -- 172.21.15.55:0/1995053402 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f36ac0b97f0 con 0x7f36b415c9c0 2023-08-25T04:15:58.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.901+0000 7f36aaffd640 1 --2- 172.21.15.55:0/1995053402 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f36980657d0 0x7f3698067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:58.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.901+0000 7f36aaffd640 1 -- 172.21.15.55:0/1995053402 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f36ac11ddb0 con 0x7f36b415c9c0 2023-08-25T04:15:58.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.901+0000 7f36ba29c640 1 --2- 172.21.15.55:0/1995053402 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f36980657d0 0x7f3698067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:58.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.901+0000 7f36ba29c640 1 --2- 172.21.15.55:0/1995053402 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f36980657d0 0x7f3698067c90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f36b0009aa0 tx=0x7f36b0006f90 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:58.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:58.905+0000 7f36aaffd640 1 -- 172.21.15.55:0/1995053402 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f36ac122070 con 0x7f36b415c9c0 2023-08-25T04:15:59.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.117+0000 7f36bc500640 1 -- 172.21.15.55:0/1995053402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f36b4070440 con 0x7f36b415c9c0 2023-08-25T04:15:59.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.117+0000 7f36aaffd640 1 -- 172.21.15.55:0/1995053402 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f36ac0ebb50 con 0x7f36b415c9c0 2023-08-25T04:15:59.117 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:59.118 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T04:15:59.118 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-08-25T04:15:59.118 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.118 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-08-25T04:15:59.118 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkgFrTEBAAoan9rk8Q+qPyMjb2vGUHhA==", 2023-08-25T04:15:59.118 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.118 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:15:59.118 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:15:59.119 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:15:59.119 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:15:59.119 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.119 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:15:59.119 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.120 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-08-25T04:15:59.120 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk18hNHRAAzXuhzQEONXRzRXTeCH9fKQ==", 2023-08-25T04:15:59.120 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.121 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:15:59.121 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:15:59.121 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:15:59.121 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:15:59.121 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.122 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:15:59.122 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.122 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-08-25T04:15:59.122 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkLF9CGBAAqxgRU/02SsZfWuZPSYxuZA==", 2023-08-25T04:15:59.122 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.122 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:15:59.122 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:15:59.123 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:15:59.123 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:15:59.123 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.123 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:15:59.123 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.123 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-08-25T04:15:59.124 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hky6HiJBAAsrXlTDn2cxbk7PnqSgNNkA==", 2023-08-25T04:15:59.124 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.124 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:15:59.124 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:15:59.124 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:15:59.124 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:15:59.125 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.125 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:15:59.125 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.125 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-08-25T04:15:59.125 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC+J+hkY1tDFBAAVQY5Xl8On9pN3jLWwKWGTA==", 2023-08-25T04:15:59.125 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.125 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:15:59.126 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:15:59.126 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:15:59.126 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.126 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:15:59.126 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.126 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-08-25T04:15:59.126 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDBJ+hkpdBCHRAADyMAxTsnQfkD9G0p48H4zQ==", 2023-08-25T04:15:59.126 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.127 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:15:59.127 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:15:59.127 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:15:59.127 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.127 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:15:59.127 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.127 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-08-25T04:15:59.128 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDEJ+hkOR49KRAAudbqAxLItsoczide8ybzAg==", 2023-08-25T04:15:59.128 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.128 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:15:59.128 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:15:59.128 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:15:59.128 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.128 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:15:59.129 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.129 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-08-25T04:15:59.129 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDHJ+hkxun5MBAAAhGtJYVeL3ogL3TQV67diw==", 2023-08-25T04:15:59.129 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.129 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:15:59.129 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:15:59.129 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:15:59.130 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.130 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:15:59.130 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.130 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-08-25T04:15:59.130 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDMJ+hkuosTCRAAqCuwHFZFBVR/7nFtHHByNg==", 2023-08-25T04:15:59.130 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.130 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:15:59.131 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:15:59.131 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:15:59.131 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.131 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:15:59.131 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.131 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-08-25T04:15:59.131 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDPJ+hkJa+SDhAAllo6biVE99BZWvv5K/gXGw==", 2023-08-25T04:15:59.132 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.132 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:15:59.132 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:15:59.132 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:15:59.132 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.132 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:15:59.132 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.133 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-08-25T04:15:59.133 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDSJ+hkUPywFBAA4jua1Eu1nRl2L6hX/mycfw==", 2023-08-25T04:15:59.133 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.133 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:15:59.133 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:15:59.133 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:15:59.133 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.134 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:15:59.134 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.134 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-08-25T04:15:59.134 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDVJ+hkhyDMGxAAmcSWLzJqIE5w5H/E4wIurQ==", 2023-08-25T04:15:59.134 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.134 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:15:59.134 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:15:59.135 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:15:59.135 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.135 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:15:59.135 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.135 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-08-25T04:15:59.135 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g==", 2023-08-25T04:15:59.135 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.135 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:15:59.136 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-08-25T04:15:59.136 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-25T04:15:59.136 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.136 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:15:59.136 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.136 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-08-25T04:15:59.136 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk8KsDMxAAKyK4jMKflYNnJXYIbr2OBQ==", 2023-08-25T04:15:59.137 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.137 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:15:59.137 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:15:59.137 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:15:59.137 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:15:59.137 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.137 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:15:59.137 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.138 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-08-25T04:15:59.138 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjSA4LxAAxzbnHeV85qYZYhSqTOT2rw==", 2023-08-25T04:15:59.138 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.138 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:15:59.138 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:15:59.138 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:15:59.138 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:15:59.138 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.139 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:15:59.139 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.139 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-08-25T04:15:59.139 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkl9AoORAARYZcPObsM/HT/yrTmneZrw==", 2023-08-25T04:15:59.139 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.139 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:15:59.139 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:15:59.139 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:15:59.140 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:15:59.140 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.140 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:15:59.140 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.140 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-08-25T04:15:59.140 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC2J+hkgTdcLxAAqxSepXXhEultFAFYBBKSag==", 2023-08-25T04:15:59.140 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.141 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:15:59.141 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:15:59.141 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:15:59.141 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:15:59.141 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.141 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:15:59.141 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.141 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-08-25T04:15:59.142 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkYGUZDBAAiuDo9hqavWq7zQlGd6x4YQ==", 2023-08-25T04:15:59.142 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.142 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:15:59.142 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T04:15:59.142 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:15:59.142 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.142 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:15:59.142 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:15:59.143 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-08-25T04:15:59.143 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjr9KCBAApSqjtFhLnjHduMBu/eaaKw==", 2023-08-25T04:15:59.143 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:15:59.143 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:15:59.143 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T04:15:59.143 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:15:59.143 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.143 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:15:59.144 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-08-25T04:15:59.144 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T04:15:59.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.121+0000 7f36bc500640 1 -- 172.21.15.55:0/1995053402 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f36980657d0 msgr2=0x7f3698067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.121+0000 7f36bc500640 1 --2- 172.21.15.55:0/1995053402 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f36980657d0 0x7f3698067c90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f36b0009aa0 tx=0x7f36b0006f90 comp rx=0 tx=0).stop 2023-08-25T04:15:59.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.121+0000 7f36bc500640 1 -- 172.21.15.55:0/1995053402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36b415c9c0 msgr2=0x7f36b4157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.121+0000 7f36bc500640 1 --2- 172.21.15.55:0/1995053402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36b415c9c0 0x7f36b4157590 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f36ac0b0040 tx=0x7f36ac0196c0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.121+0000 7f36bc500640 1 -- 172.21.15.55:0/1995053402 shutdown_connections 2023-08-25T04:15:59.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.121+0000 7f36bc500640 1 --2- 172.21.15.55:0/1995053402 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f36980657d0 0x7f3698067c90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.121+0000 7f36bc500640 1 --2- 172.21.15.55:0/1995053402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36b415c9c0 0x7f36b4157590 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.121+0000 7f36bc500640 1 --2- 172.21.15.55:0/1995053402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36b40cfa70 0x7f36b40c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.121+0000 7f36bc500640 1 --2- 172.21.15.55:0/1995053402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36b406b2b0 0x7f36b4149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.121+0000 7f36bc500640 1 -- 172.21.15.55:0/1995053402 >> 172.21.15.55:0/1995053402 conn(0x7f36b40d05a0 msgr2=0x7f36b4155000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:59.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.121+0000 7f36bc500640 1 -- 172.21.15.55:0/1995053402 shutdown_connections 2023-08-25T04:15:59.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.121+0000 7f36bc500640 1 -- 172.21.15.55:0/1995053402 wait complete. 2023-08-25T04:15:59.147 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:15:59.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.289+0000 7f534af03640 1 Processor -- start 2023-08-25T04:15:59.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.289+0000 7f534af03640 1 -- start start 2023-08-25T04:15:59.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.293+0000 7f534af03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53440cfa70 0x7f5344160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:59.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.293+0000 7f534af03640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534406eaf0 con 0x7f534415c9c0 2023-08-25T04:15:59.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.293+0000 7f534af03640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534406e530 con 0x7f534406b2b0 2023-08-25T04:15:59.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.293+0000 7f534af03640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534406e810 con 0x7f53440cfa70 2023-08-25T04:15:59.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.293+0000 7f5348c9f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f534415c9c0 0x7f5344160510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44944/0 (socket says 172.21.15.55:44944) 2023-08-25T04:15:59.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.293+0000 7f5348c9f640 1 -- 172.21.15.55:0/3853030773 learned_addr learned my addr 172.21.15.55:0/3853030773 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:15:59.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.293+0000 7f5343fff640 1 --2- 172.21.15.55:0/3853030773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53440cfa70 0x7f5344160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:59.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.293+0000 7f53437fe640 1 -- 172.21.15.55:0/3853030773 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681636506 0 0) 0x7f534406eaf0 con 0x7f534415c9c0 2023-08-25T04:15:59.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.293+0000 7f53437fe640 1 -- 172.21.15.55:0/3853030773 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5334003530 con 0x7f534415c9c0 2023-08-25T04:15:59.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.293+0000 7f53437fe640 1 -- 172.21.15.55:0/3853030773 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032327422 0 0) 0x7f534406e530 con 0x7f534406b2b0 2023-08-25T04:15:59.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.293+0000 7f53437fe640 1 -- 172.21.15.55:0/3853030773 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f534406eaf0 con 0x7f534406b2b0 2023-08-25T04:15:59.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.293+0000 7f53437fe640 1 -- 172.21.15.55:0/3853030773 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2148835587 0 0) 0x7f5334003530 con 0x7f534415c9c0 2023-08-25T04:15:59.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.293+0000 7f5343fff640 1 -- 172.21.15.55:0/3853030773 >> v1:172.21.15.110:6789/0 conn(0x7f534406b2b0 legacy=0x7f534406b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.293+0000 7f5343fff640 1 -- 172.21.15.55:0/3853030773 >> v1:172.21.15.55:6789/0 conn(0x7f534415c9c0 legacy=0x7f5344160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.293+0000 7f5343fff640 1 -- 172.21.15.55:0/3853030773 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534406aab0 con 0x7f53440cfa70 2023-08-25T04:15:59.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f5343fff640 1 --2- 172.21.15.55:0/3853030773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53440cfa70 0x7f5344160c20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f53300097f0 tx=0x7f533001c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ae1bfb0ca5a5ffc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:59.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f53437fe640 1 -- 172.21.15.55:0/3853030773 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5338001800 con 0x7f53440cfa70 2023-08-25T04:15:59.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f53437fe640 1 -- 172.21.15.55:0/3853030773 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53300a7050 con 0x7f53440cfa70 2023-08-25T04:15:59.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f53437fe640 1 -- 172.21.15.55:0/3853030773 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53300ab620 con 0x7f53440cfa70 2023-08-25T04:15:59.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f534af03640 1 -- 172.21.15.55:0/3853030773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53440cfa70 msgr2=0x7f5344160c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f534af03640 1 --2- 172.21.15.55:0/3853030773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53440cfa70 0x7f5344160c20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f53300097f0 tx=0x7f533001c3b0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f534af03640 1 -- 172.21.15.55:0/3853030773 shutdown_connections 2023-08-25T04:15:59.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f534af03640 1 --2- 172.21.15.55:0/3853030773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53440cfa70 0x7f5344160c20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f534af03640 1 -- 172.21.15.55:0/3853030773 >> 172.21.15.55:0/3853030773 conn(0x7f53440d05a0 msgr2=0x7f53440d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:59.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f534af03640 1 -- 172.21.15.55:0/3853030773 shutdown_connections 2023-08-25T04:15:59.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f534af03640 1 -- 172.21.15.55:0/3853030773 wait complete. 2023-08-25T04:15:59.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f534af03640 1 Processor -- start 2023-08-25T04:15:59.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f534af03640 1 -- start start 2023-08-25T04:15:59.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f534af03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f534406b2b0 0x7f5344159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:59.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f534af03640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53440cfa70 0x7f53440c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:59.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f534af03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f534415c9c0 0x7f5344156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:59.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f534af03640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53440c4610 con 0x7f534415c9c0 2023-08-25T04:15:59.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f534af03640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5344158b50 con 0x7f53440cfa70 2023-08-25T04:15:59.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.297+0000 7f534af03640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5344158e30 con 0x7f534406b2b0 2023-08-25T04:15:59.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.301+0000 7f53494a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f534415c9c0 0x7f5344156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:59.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.301+0000 7f53494a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f534415c9c0 0x7f5344156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51932/0 (socket says 172.21.15.55:51932) 2023-08-25T04:15:59.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.301+0000 7f53494a0640 1 -- 172.21.15.55:0/1224834014 learned_addr learned my addr 172.21.15.55:0/1224834014 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:59.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.301+0000 7f5348c9f640 1 --2- 172.21.15.55:0/1224834014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f534406b2b0 0x7f5344159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:59.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.301+0000 7f5343fff640 1 --2- 172.21.15.55:0/1224834014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53440cfa70 0x7f53440c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:59.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.301+0000 7f53494a0640 1 -- 172.21.15.55:0/1224834014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f534406b2b0 msgr2=0x7f5344159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.301+0000 7f53494a0640 1 --2- 172.21.15.55:0/1224834014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f534406b2b0 0x7f5344159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.301+0000 7f53494a0640 1 -- 172.21.15.55:0/1224834014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53440cfa70 msgr2=0x7f53440c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.301+0000 7f53494a0640 1 --2- 172.21.15.55:0/1224834014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53440cfa70 0x7f53440c40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.301+0000 7f53494a0640 1 -- 172.21.15.55:0/1224834014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5330009420 con 0x7f534415c9c0 2023-08-25T04:15:59.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.301+0000 7f53494a0640 1 --2- 172.21.15.55:0/1224834014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f534415c9c0 0x7f5344156680 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f533c00c730 tx=0x7f533c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:59.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.301+0000 7f53417fa640 1 -- 172.21.15.55:0/1224834014 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c003b80 con 0x7f534415c9c0 2023-08-25T04:15:59.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.301+0000 7f53417fa640 1 -- 172.21.15.55:0/1224834014 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c003ce0 con 0x7f534415c9c0 2023-08-25T04:15:59.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.301+0000 7f53417fa640 1 -- 172.21.15.55:0/1224834014 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c00aa90 con 0x7f534415c9c0 2023-08-25T04:15:59.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.301+0000 7f534af03640 1 -- 172.21.15.55:0/1224834014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53441594c0 con 0x7f534415c9c0 2023-08-25T04:15:59.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.301+0000 7f534af03640 1 -- 172.21.15.55:0/1224834014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5344156bc0 con 0x7f534415c9c0 2023-08-25T04:15:59.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.301+0000 7f534af03640 1 -- 172.21.15.55:0/1224834014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534415a200 con 0x7f534415c9c0 2023-08-25T04:15:59.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.301+0000 7f53417fa640 1 -- 172.21.15.55:0/1224834014 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f533c00abf0 con 0x7f534415c9c0 2023-08-25T04:15:59.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.305+0000 7f53417fa640 1 --2- 172.21.15.55:0/1224834014 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f53280657a0 0x7f5328067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:59.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.305+0000 7f53417fa640 1 -- 172.21.15.55:0/1224834014 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f533c0828f0 con 0x7f534415c9c0 2023-08-25T04:15:59.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.305+0000 7f5348c9f640 1 --2- 172.21.15.55:0/1224834014 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f53280657a0 0x7f5328067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:59.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.305+0000 7f5348c9f640 1 --2- 172.21.15.55:0/1224834014 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f53280657a0 0x7f5328067c60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5338001010 tx=0x7f5338001800 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:59.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.309+0000 7f53417fa640 1 -- 172.21.15.55:0/1224834014 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f533c050730 con 0x7f534415c9c0 2023-08-25T04:15:59.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.465+0000 7f534af03640 1 -- 172.21.15.55:0/1224834014 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f534404dbe0 con 0x7f534415c9c0 2023-08-25T04:15:59.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.465+0000 7f53417fa640 1 -- 172.21.15.55:0/1224834014 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+14651 (secure 0 0 0) 0x7f533c053d50 con 0x7f534415c9c0 2023-08-25T04:15:59.466 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:15:59.466 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":58,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:15:58.722968+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:15:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.469+0000 7f534af03640 1 -- 172.21.15.55:0/1224834014 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f53280657a0 msgr2=0x7f5328067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.469+0000 7f534af03640 1 --2- 172.21.15.55:0/1224834014 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f53280657a0 0x7f5328067c60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5338001010 tx=0x7f5338001800 comp rx=0 tx=0).stop 2023-08-25T04:15:59.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.469+0000 7f534af03640 1 -- 172.21.15.55:0/1224834014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f534415c9c0 msgr2=0x7f5344156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.469+0000 7f534af03640 1 --2- 172.21.15.55:0/1224834014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f534415c9c0 0x7f5344156680 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f533c00c730 tx=0x7f533c00cbf0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.469+0000 7f534af03640 1 -- 172.21.15.55:0/1224834014 shutdown_connections 2023-08-25T04:15:59.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.469+0000 7f534af03640 1 --2- 172.21.15.55:0/1224834014 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f53280657a0 0x7f5328067c60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.469+0000 7f534af03640 1 --2- 172.21.15.55:0/1224834014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f534415c9c0 0x7f5344156680 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.469+0000 7f534af03640 1 --2- 172.21.15.55:0/1224834014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53440cfa70 0x7f53440c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.469+0000 7f534af03640 1 --2- 172.21.15.55:0/1224834014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f534406b2b0 0x7f5344159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.469+0000 7f534af03640 1 -- 172.21.15.55:0/1224834014 >> 172.21.15.55:0/1224834014 conn(0x7f53440d05a0 msgr2=0x7f53440ae420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.469+0000 7f534af03640 1 -- 172.21.15.55:0/1224834014 shutdown_connections 2023-08-25T04:15:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.469+0000 7f534af03640 1 -- 172.21.15.55:0/1224834014 wait complete. 2023-08-25T04:15:59.487 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:15:59.488 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:15:59.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.637+0000 7fd5cd234640 1 Processor -- start 2023-08-25T04:15:59.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.637+0000 7fd5cd234640 1 -- start start 2023-08-25T04:15:59.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.637+0000 7fd5cd234640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd5c80cb020 0x7fd5c80c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:59.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.637+0000 7fd5cd234640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5c80cdd50 0x7fd5c80cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:59.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.637+0000 7fd5cd234640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c80cbca0 con 0x7fd5c806c720 2023-08-25T04:15:59.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.637+0000 7fd5cd234640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c80c9470 con 0x7fd5c80cb020 2023-08-25T04:15:59.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.637+0000 7fd5cd234640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80ce1e0 con 0x7fd5c80cdd50 2023-08-25T04:15:59.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.637+0000 7fd5c6d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd5c80cb020 0x7fd5c80c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:59.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.637+0000 7fd5c6d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd5c80cb020 0x7fd5c80c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51936/0 (socket says 172.21.15.55:51936) 2023-08-25T04:15:59.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.637+0000 7fd5c6d9d640 1 -- 172.21.15.55:0/4121321223 learned_addr learned my addr 172.21.15.55:0/4121321223 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:59.638 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:15:59.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.637+0000 7fd5be59c640 1 --2- 172.21.15.55:0/4121321223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5c80cdd50 0x7fd5c80cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:59.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.637+0000 7fd5c6d9d640 1 -- 172.21.15.55:0/4121321223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5c80cdd50 msgr2=0x7fd5c80cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:59.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.637+0000 7fd5c6d9d640 1 --2- 172.21.15.55:0/4121321223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5c80cdd50 0x7fd5c80cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.637+0000 7fd5c6d9d640 1 -- 172.21.15.55:0/4121321223 >> v1:172.21.15.110:6789/0 conn(0x7fd5c806c720 legacy=0x7fd5c80cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.637+0000 7fd5c6d9d640 1 -- 172.21.15.55:0/4121321223 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c80c8b40 con 0x7fd5c80cb020 2023-08-25T04:15:59.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.641+0000 7fd5c6d9d640 1 --2- 172.21.15.55:0/4121321223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5c80cb020 0x7fd5c80c9900 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0006fd0 tx=0x7fd5b001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee2bbfb73be77b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:59.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.641+0000 7fd5c659c640 1 -- 172.21.15.55:0/4121321223 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b00ad680 con 0x7fd5c80cb020 2023-08-25T04:15:59.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.641+0000 7fd5c659c640 1 -- 172.21.15.55:0/4121321223 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b00ad7e0 con 0x7fd5c80cb020 2023-08-25T04:15:59.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.641+0000 7fd5c659c640 1 -- 172.21.15.55:0/4121321223 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b00adb70 con 0x7fd5c80cb020 2023-08-25T04:15:59.642 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:15:59.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.641+0000 7fd5cd234640 1 -- 172.21.15.55:0/4121321223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5c80cb020 msgr2=0x7fd5c80c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.641+0000 7fd5cd234640 1 --2- 172.21.15.55:0/4121321223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5c80cb020 0x7fd5c80c9900 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0006fd0 tx=0x7fd5b001c490 comp rx=0 tx=0).stop 2023-08-25T04:15:59.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.641+0000 7fd5cd234640 1 -- 172.21.15.55:0/4121321223 shutdown_connections 2023-08-25T04:15:59.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.641+0000 7fd5cd234640 1 --2- 172.21.15.55:0/4121321223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5c80cdd50 0x7fd5c80cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.641+0000 7fd5cd234640 1 --2- 172.21.15.55:0/4121321223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5c80cb020 0x7fd5c80c9900 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.641+0000 7fd5cd234640 1 -- 172.21.15.55:0/4121321223 >> 172.21.15.55:0/4121321223 conn(0x7fd5c8069900 msgr2=0x7fd5c8069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:59.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.641+0000 7fd5cd234640 1 -- 172.21.15.55:0/4121321223 shutdown_connections 2023-08-25T04:15:59.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.641+0000 7fd5cd234640 1 -- 172.21.15.55:0/4121321223 wait complete. 2023-08-25T04:15:59.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.641+0000 7fd5cd234640 1 Processor -- start 2023-08-25T04:15:59.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5cd234640 1 -- start start 2023-08-25T04:15:59.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5cd234640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5c806c720 0x7fd5c81587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:59.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5cd234640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c80cb020 0x7fd5c8151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5cd234640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5c80cdd50 0x7fd5c81507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5cd234640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8158d20 con 0x7fd5c806c720 2023-08-25T04:15:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5cd234640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80c8010 con 0x7fd5c80cb020 2023-08-25T04:15:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5cd234640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80c82f0 con 0x7fd5c80cdd50 2023-08-25T04:15:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5c6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5c806c720 0x7fd5c81587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5be59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c80cb020 0x7fd5c8151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:59.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5c759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5c80cdd50 0x7fd5c81507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:59.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5c6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5c806c720 0x7fd5c81587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51950/0 (socket says 172.21.15.55:51950) 2023-08-25T04:15:59.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5be59c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c80cb020 0x7fd5c8151c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:50532/0 (socket says 172.21.15.55:50532) 2023-08-25T04:15:59.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5c6d9d640 1 -- 172.21.15.55:0/3235999133 learned_addr learned my addr 172.21.15.55:0/3235999133 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:59.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5c6d9d640 1 -- 172.21.15.55:0/3235999133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5c80cdd50 msgr2=0x7fd5c81507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5c6d9d640 1 --2- 172.21.15.55:0/3235999133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5c80cdd50 0x7fd5c81507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5c6d9d640 1 -- 172.21.15.55:0/3235999133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c80cb020 msgr2=0x7fd5c8151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5c6d9d640 1 --2- 172.21.15.55:0/3235999133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c80cb020 0x7fd5c8151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5c6d9d640 1 -- 172.21.15.55:0/3235999133 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b0009480 con 0x7fd5c806c720 2023-08-25T04:15:59.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5be59c640 1 --2- 172.21.15.55:0/3235999133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c80cb020 0x7fd5c8151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:15:59.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5c6d9d640 1 --2- 172.21.15.55:0/3235999133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5c806c720 0x7fd5c81587e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd5b00b0040 tx=0x7fd5b0019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:59.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5bffff640 1 -- 172.21.15.55:0/3235999133 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b00ba070 con 0x7fd5c806c720 2023-08-25T04:15:59.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5bffff640 1 -- 172.21.15.55:0/3235999133 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b0004250 con 0x7fd5c806c720 2023-08-25T04:15:59.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5cd234640 1 -- 172.21.15.55:0/3235999133 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c806d0c0 con 0x7fd5c806c720 2023-08-25T04:15:59.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5bffff640 1 -- 172.21.15.55:0/3235999133 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b00ad950 con 0x7fd5c806c720 2023-08-25T04:15:59.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5cd234640 1 -- 172.21.15.55:0/3235999133 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c8151410 con 0x7fd5c806c720 2023-08-25T04:15:59.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.645+0000 7fd5cd234640 1 -- 172.21.15.55:0/3235999133 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c8073ec0 con 0x7fd5c806c720 2023-08-25T04:15:59.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.649+0000 7fd5bffff640 1 -- 172.21.15.55:0/3235999133 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fd5b00adab0 con 0x7fd5c806c720 2023-08-25T04:15:59.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.649+0000 7fd5bffff640 1 --2- 172.21.15.55:0/3235999133 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fd5a80657d0 0x7fd5a8067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:59.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.649+0000 7fd5bffff640 1 -- 172.21.15.55:0/3235999133 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd5b011c6f0 con 0x7fd5c806c720 2023-08-25T04:15:59.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.649+0000 7fd5be59c640 1 --2- 172.21.15.55:0/3235999133 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fd5a80657d0 0x7fd5a8067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:59.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.649+0000 7fd5be59c640 1 --2- 172.21.15.55:0/3235999133 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fd5a80657d0 0x7fd5a8067c90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80ab630 tx=0x7fd5b8008040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:59.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.653+0000 7fd5bffff640 1 -- 172.21.15.55:0/3235999133 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd5b00ea380 con 0x7fd5c806c720 2023-08-25T04:15:59.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.817+0000 7fd5cd234640 1 -- 172.21.15.55:0/3235999133 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5c80c8630 con 0x7fd5c806c720 2023-08-25T04:15:59.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.817+0000 7fd5bffff640 1 -- 172.21.15.55:0/3235999133 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5b00ed9a0 con 0x7fd5c806c720 2023-08-25T04:15:59.818 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:15:59.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.821+0000 7fd5cd234640 1 -- 172.21.15.55:0/3235999133 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fd5a80657d0 msgr2=0x7fd5a8067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.821+0000 7fd5cd234640 1 --2- 172.21.15.55:0/3235999133 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fd5a80657d0 0x7fd5a8067c90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80ab630 tx=0x7fd5b8008040 comp rx=0 tx=0).stop 2023-08-25T04:15:59.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.821+0000 7fd5cd234640 1 -- 172.21.15.55:0/3235999133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5c806c720 msgr2=0x7fd5c81587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.821+0000 7fd5cd234640 1 --2- 172.21.15.55:0/3235999133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5c806c720 0x7fd5c81587e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd5b00b0040 tx=0x7fd5b0019230 comp rx=0 tx=0).stop 2023-08-25T04:15:59.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.821+0000 7fd5cd234640 1 -- 172.21.15.55:0/3235999133 shutdown_connections 2023-08-25T04:15:59.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.821+0000 7fd5cd234640 1 --2- 172.21.15.55:0/3235999133 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fd5a80657d0 0x7fd5a8067c90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.821+0000 7fd5cd234640 1 --2- 172.21.15.55:0/3235999133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5c80cdd50 0x7fd5c81507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.821+0000 7fd5cd234640 1 --2- 172.21.15.55:0/3235999133 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c80cb020 0x7fd5c8151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.821+0000 7fd5cd234640 1 --2- 172.21.15.55:0/3235999133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5c806c720 0x7fd5c81587e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.821+0000 7fd5cd234640 1 -- 172.21.15.55:0/3235999133 >> 172.21.15.55:0/3235999133 conn(0x7fd5c8069900 msgr2=0x7fd5c80ac7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:59.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.821+0000 7fd5cd234640 1 -- 172.21.15.55:0/3235999133 shutdown_connections 2023-08-25T04:15:59.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.821+0000 7fd5cd234640 1 -- 172.21.15.55:0/3235999133 wait complete. 2023-08-25T04:15:59.839 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:15:59.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.985+0000 7ff20ae3c640 1 Processor -- start 2023-08-25T04:15:59.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.985+0000 7ff20ae3c640 1 -- start start 2023-08-25T04:15:59.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.985+0000 7ff20ae3c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff20415fca0 0x7ff2040cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:59.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.985+0000 7ff20ae3c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2040cfac0 0x7ff2040b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:59.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.985+0000 7ff20ae3c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2040b70c0 con 0x7ff2040b8330 2023-08-25T04:15:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.985+0000 7ff20ae3c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff204160080 con 0x7ff2040cfac0 2023-08-25T04:15:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.985+0000 7ff20ae3c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040cff30 con 0x7ff20415fca0 2023-08-25T04:15:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.985+0000 7ff20a63b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2040cfac0 0x7ff2040b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.989+0000 7ff20a63b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2040cfac0 0x7ff2040b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51966/0 (socket says 172.21.15.55:51966) 2023-08-25T04:15:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.989+0000 7ff20a63b640 1 -- 172.21.15.55:0/3867027942 learned_addr learned my addr 172.21.15.55:0/3867027942 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.989+0000 7ff209e3a640 1 --2- 172.21.15.55:0/3867027942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff20415fca0 0x7ff2040cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.989+0000 7ff20a63b640 1 -- 172.21.15.55:0/3867027942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff20415fca0 msgr2=0x7ff2040cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:15:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.989+0000 7ff20a63b640 1 --2- 172.21.15.55:0/3867027942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff20415fca0 0x7ff2040cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.989+0000 7ff20a63b640 1 -- 172.21.15.55:0/3867027942 >> v1:172.21.15.55:6789/0 conn(0x7ff2040b8330 legacy=0x7ff2040d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.989+0000 7ff20a63b640 1 -- 172.21.15.55:0/3867027942 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2040b73a0 con 0x7ff2040cfac0 2023-08-25T04:15:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.989+0000 7ff209e3a640 1 --2- 172.21.15.55:0/3867027942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff20415fca0 0x7ff2040cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:15:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.989+0000 7ff20a63b640 1 --2- 172.21.15.55:0/3867027942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2040cfac0 0x7ff2040b65e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009e80 tx=0x7ff1fc01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf9247069acd696 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.989+0000 7ff208e38640 1 -- 172.21.15.55:0/3867027942 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc0af400 con 0x7ff2040cfac0 2023-08-25T04:15:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.989+0000 7ff208e38640 1 -- 172.21.15.55:0/3867027942 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1fc0ab050 con 0x7ff2040cfac0 2023-08-25T04:15:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.989+0000 7ff208e38640 1 -- 172.21.15.55:0/3867027942 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc0af780 con 0x7ff2040cfac0 2023-08-25T04:15:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff20ae3c640 1 -- 172.21.15.55:0/3867027942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2040cfac0 msgr2=0x7ff2040b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff20ae3c640 1 --2- 172.21.15.55:0/3867027942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2040cfac0 0x7ff2040b65e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc009e80 tx=0x7ff1fc01f1e0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff20ae3c640 1 -- 172.21.15.55:0/3867027942 shutdown_connections 2023-08-25T04:15:59.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff20ae3c640 1 --2- 172.21.15.55:0/3867027942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2040cfac0 0x7ff2040b65e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff20ae3c640 1 --2- 172.21.15.55:0/3867027942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff20415fca0 0x7ff2040cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff20ae3c640 1 -- 172.21.15.55:0/3867027942 >> 172.21.15.55:0/3867027942 conn(0x7ff2040658c0 msgr2=0x7ff204065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:15:59.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff20ae3c640 1 -- 172.21.15.55:0/3867027942 shutdown_connections 2023-08-25T04:15:59.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff20ae3c640 1 -- 172.21.15.55:0/3867027942 wait complete. 2023-08-25T04:15:59.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff20ae3c640 1 Processor -- start 2023-08-25T04:15:59.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff20ae3c640 1 -- start start 2023-08-25T04:15:59.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff20ae3c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2040b8330 0x7ff204145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:59.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff20ae3c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2040cfac0 0x7ff2041577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:59.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff20ae3c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff20415fca0 0x7ff2040c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:59.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff20ae3c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040c8440 con 0x7ff2040cfac0 2023-08-25T04:15:59.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff20ae3c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040c7870 con 0x7ff2040b8330 2023-08-25T04:15:59.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff20ae3c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2040c7b10 con 0x7ff20415fca0 2023-08-25T04:15:59.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff209639640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2040cfac0 0x7ff2041577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:59.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff209639640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2040cfac0 0x7ff2041577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51972/0 (socket says 172.21.15.55:51972) 2023-08-25T04:15:59.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff209639640 1 -- 172.21.15.55:0/1017116448 learned_addr learned my addr 172.21.15.55:0/1017116448 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:15:59.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff209e3a640 1 --2- 172.21.15.55:0/1017116448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2040b8330 0x7ff204145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:59.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff20a63b640 1 --2- 172.21.15.55:0/1017116448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff20415fca0 0x7ff2040c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:59.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff209639640 1 -- 172.21.15.55:0/1017116448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff20415fca0 msgr2=0x7ff2040c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff209639640 1 --2- 172.21.15.55:0/1017116448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff20415fca0 0x7ff2040c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff209639640 1 -- 172.21.15.55:0/1017116448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2040b8330 msgr2=0x7ff204145a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:15:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff209639640 1 --2- 172.21.15.55:0/1017116448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2040b8330 0x7ff204145a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:15:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff209639640 1 -- 172.21.15.55:0/1017116448 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc009b30 con 0x7ff2040cfac0 2023-08-25T04:15:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.993+0000 7ff209639640 1 --2- 172.21.15.55:0/1017116448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2040cfac0 0x7ff2041577b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400c500 tx=0x7ff1f400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:15:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.997+0000 7ff1fa7fc640 1 -- 172.21.15.55:0/1017116448 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4005220 con 0x7ff2040cfac0 2023-08-25T04:15:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.997+0000 7ff1fa7fc640 1 -- 172.21.15.55:0/1017116448 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f4005380 con 0x7ff2040cfac0 2023-08-25T04:15:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.997+0000 7ff1fa7fc640 1 -- 172.21.15.55:0/1017116448 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4007270 con 0x7ff2040cfac0 2023-08-25T04:15:59.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.997+0000 7ff20ae3c640 1 -- 172.21.15.55:0/1017116448 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2040c7df0 con 0x7ff2040cfac0 2023-08-25T04:15:59.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.997+0000 7ff20ae3c640 1 -- 172.21.15.55:0/1017116448 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff204157cf0 con 0x7ff2040cfac0 2023-08-25T04:15:59.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.997+0000 7ff20ae3c640 1 -- 172.21.15.55:0/1017116448 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff204073e50 con 0x7ff2040cfac0 2023-08-25T04:15:59.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.997+0000 7ff1fa7fc640 1 -- 172.21.15.55:0/1017116448 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7ff1f40073d0 con 0x7ff2040cfac0 2023-08-25T04:15:59.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.997+0000 7ff1fa7fc640 1 --2- 172.21.15.55:0/1017116448 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7ff1e80657d0 0x7ff1e8067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:15:59.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:15:59.997+0000 7ff1fa7fc640 1 -- 172.21.15.55:0/1017116448 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff1f4082550 con 0x7ff2040cfac0 2023-08-25T04:15:59.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.001+0000 7ff209e3a640 1 --2- 172.21.15.55:0/1017116448 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7ff1e80657d0 0x7ff1e8067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:15:59.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.001+0000 7ff209e3a640 1 --2- 172.21.15.55:0/1017116448 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7ff1e80657d0 0x7ff1e8067c90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff20000b9f0 tx=0x7ff200008040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.001+0000 7ff1fa7fc640 1 -- 172.21.15.55:0/1017116448 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff1f40501c0 con 0x7ff2040cfac0 2023-08-25T04:16:00.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.161+0000 7ff20ae3c640 1 -- 172.21.15.55:0/1017116448 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff204151070 con 0x7ff2040cfac0 2023-08-25T04:16:00.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.161+0000 7ff1fa7fc640 1 -- 172.21.15.55:0/1017116448 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v58) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff1f40537e0 con 0x7ff2040cfac0 2023-08-25T04:16:00.163 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:16:00.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.165+0000 7ff20ae3c640 1 -- 172.21.15.55:0/1017116448 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7ff1e80657d0 msgr2=0x7ff1e8067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:00.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.165+0000 7ff20ae3c640 1 --2- 172.21.15.55:0/1017116448 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7ff1e80657d0 0x7ff1e8067c90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff20000b9f0 tx=0x7ff200008040 comp rx=0 tx=0).stop 2023-08-25T04:16:00.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.165+0000 7ff20ae3c640 1 -- 172.21.15.55:0/1017116448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2040cfac0 msgr2=0x7ff2041577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:00.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.165+0000 7ff20ae3c640 1 --2- 172.21.15.55:0/1017116448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2040cfac0 0x7ff2041577b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400c500 tx=0x7ff1f400c9c0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.165+0000 7ff20ae3c640 1 -- 172.21.15.55:0/1017116448 shutdown_connections 2023-08-25T04:16:00.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.165+0000 7ff20ae3c640 1 --2- 172.21.15.55:0/1017116448 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7ff1e80657d0 0x7ff1e8067c90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.165+0000 7ff20ae3c640 1 --2- 172.21.15.55:0/1017116448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff20415fca0 0x7ff2040c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.165+0000 7ff20ae3c640 1 --2- 172.21.15.55:0/1017116448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2040cfac0 0x7ff2041577b0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.165+0000 7ff20ae3c640 1 --2- 172.21.15.55:0/1017116448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2040b8330 0x7ff204145a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.165+0000 7ff20ae3c640 1 -- 172.21.15.55:0/1017116448 >> 172.21.15.55:0/1017116448 conn(0x7ff2040658c0 msgr2=0x7ff20415bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:00.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.165+0000 7ff20ae3c640 1 -- 172.21.15.55:0/1017116448 shutdown_connections 2023-08-25T04:16:00.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.165+0000 7ff20ae3c640 1 -- 172.21.15.55:0/1017116448 wait complete. 2023-08-25T04:16:00.183 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-25T04:16:00.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.329+0000 7f4c0e559640 1 Processor -- start 2023-08-25T04:16:00.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.329+0000 7f4c0e559640 1 -- start start 2023-08-25T04:16:00.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.329+0000 7f4c0e559640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4c080ad950 0x7f4c080cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:00.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.329+0000 7f4c0e559640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c080c89f0 0x7f4c080ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:00.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.329+0000 7f4c0e559640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c080b2650 con 0x7f4c0806c000 2023-08-25T04:16:00.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.329+0000 7f4c0e559640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c080b11f0 con 0x7f4c080c89f0 2023-08-25T04:16:00.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.329+0000 7f4c0e559640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c08159d50 con 0x7f4c080ad950 2023-08-25T04:16:00.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.329+0000 7f4c077fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c080c89f0 0x7f4c080ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:00.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.329+0000 7f4c077fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c080c89f0 0x7f4c080ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51982/0 (socket says 172.21.15.55:51982) 2023-08-25T04:16:00.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.329+0000 7f4c077fe640 1 -- 172.21.15.55:0/241209917 learned_addr learned my addr 172.21.15.55:0/241209917 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:00.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.329+0000 7f4c07fff640 1 --2- 172.21.15.55:0/241209917 >> v2:172.21.15.110:3300/0 conn(0x7f4c080ad950 0x7f4c080cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:00.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.329+0000 7f4c077fe640 1 -- 172.21.15.55:0/241209917 >> v2:172.21.15.110:3300/0 conn(0x7f4c080ad950 msgr2=0x7f4c080cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:00.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.329+0000 7f4c077fe640 1 --2- 172.21.15.55:0/241209917 >> v2:172.21.15.110:3300/0 conn(0x7f4c080ad950 0x7f4c080cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.329+0000 7f4c077fe640 1 -- 172.21.15.55:0/241209917 >> v1:172.21.15.55:6789/0 conn(0x7f4c0806c000 legacy=0x7f4c0815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:00.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.329+0000 7f4c077fe640 1 -- 172.21.15.55:0/241209917 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c080cc880 con 0x7f4c080c89f0 2023-08-25T04:16:00.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.329+0000 7f4c07fff640 1 --2- 172.21.15.55:0/241209917 >> v2:172.21.15.110:3300/0 conn(0x7f4c080ad950 0x7f4c080cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:16:00.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.333+0000 7f4c077fe640 1 --2- 172.21.15.55:0/241209917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c080c89f0 0x7f4c080ce7a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4c080cd4b0 tx=0x7f4bfc01e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a507d21eb4cb0ec9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:00.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.333+0000 7f4c06ffd640 1 -- 172.21.15.55:0/241209917 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc0ab630 con 0x7f4c080c89f0 2023-08-25T04:16:00.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.333+0000 7f4c06ffd640 1 -- 172.21.15.55:0/241209917 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc0ab790 con 0x7f4c080c89f0 2023-08-25T04:16:00.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.333+0000 7f4c06ffd640 1 -- 172.21.15.55:0/241209917 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc0abb20 con 0x7f4c080c89f0 2023-08-25T04:16:00.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.333+0000 7f4c0e559640 1 -- 172.21.15.55:0/241209917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c080c89f0 msgr2=0x7f4c080ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:00.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.333+0000 7f4c0e559640 1 --2- 172.21.15.55:0/241209917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c080c89f0 0x7f4c080ce7a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4c080cd4b0 tx=0x7f4bfc01e650 comp rx=0 tx=0).stop 2023-08-25T04:16:00.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.333+0000 7f4c0e559640 1 -- 172.21.15.55:0/241209917 shutdown_connections 2023-08-25T04:16:00.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.333+0000 7f4c0e559640 1 --2- 172.21.15.55:0/241209917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c080c89f0 0x7f4c080ce7a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.333+0000 7f4c0e559640 1 --2- 172.21.15.55:0/241209917 >> v2:172.21.15.110:3300/0 conn(0x7f4c080ad950 0x7f4c080cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.333+0000 7f4c0e559640 1 -- 172.21.15.55:0/241209917 >> 172.21.15.55:0/241209917 conn(0x7f4c08069d00 msgr2=0x7f4c0806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:00.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.333+0000 7f4c0e559640 1 -- 172.21.15.55:0/241209917 shutdown_connections 2023-08-25T04:16:00.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.333+0000 7f4c0e559640 1 -- 172.21.15.55:0/241209917 wait complete. 2023-08-25T04:16:00.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c0e559640 1 Processor -- start 2023-08-25T04:16:00.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c0e559640 1 -- start start 2023-08-25T04:16:00.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c0e559640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c0806c000 0x7f4c081f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:00.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c0e559640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c080ad950 0x7f4c08152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:00.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c0e559640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c080c89f0 0x7f4c0815bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:00.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c0e559640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0815c430 con 0x7f4c080ad950 2023-08-25T04:16:00.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c0e559640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0815c710 con 0x7f4c080c89f0 2023-08-25T04:16:00.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c0e559640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c081f10b0 con 0x7f4c0806c000 2023-08-25T04:16:00.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c077fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c080ad950 0x7f4c08152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:00.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c077fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c080ad950 0x7f4c08152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51996/0 (socket says 172.21.15.55:51996) 2023-08-25T04:16:00.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c077fe640 1 -- 172.21.15.55:0/2256949827 learned_addr learned my addr 172.21.15.55:0/2256949827 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:00.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c0caf6640 1 --2- 172.21.15.55:0/2256949827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c080c89f0 0x7f4c0815bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:00.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c07fff640 1 --2- 172.21.15.55:0/2256949827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c0806c000 0x7f4c081f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:00.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c077fe640 1 -- 172.21.15.55:0/2256949827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c0806c000 msgr2=0x7f4c081f18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:00.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c077fe640 1 --2- 172.21.15.55:0/2256949827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c0806c000 0x7f4c081f18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c077fe640 1 -- 172.21.15.55:0/2256949827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c080c89f0 msgr2=0x7f4c0815bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:00.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c077fe640 1 --2- 172.21.15.55:0/2256949827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c080c89f0 0x7f4c0815bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c077fe640 1 -- 172.21.15.55:0/2256949827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc0094d0 con 0x7f4c080ad950 2023-08-25T04:16:00.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c0caf6640 1 --2- 172.21.15.55:0/2256949827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c080c89f0 0x7f4c0815bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:16:00.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c07fff640 1 --2- 172.21.15.55:0/2256949827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c0806c000 0x7f4c081f18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:16:00.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c077fe640 1 --2- 172.21.15.55:0/2256949827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c080ad950 0x7f4c08152920 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc01b260 tx=0x7f4bfc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:00.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c04ff9640 1 -- 172.21.15.55:0/2256949827 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc0b3800 con 0x7f4c080ad950 2023-08-25T04:16:00.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c04ff9640 1 -- 172.21.15.55:0/2256949827 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc0b3960 con 0x7f4c080ad950 2023-08-25T04:16:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c04ff9640 1 -- 172.21.15.55:0/2256949827 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc0b3cf0 con 0x7f4c080ad950 2023-08-25T04:16:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c0e559640 1 -- 172.21.15.55:0/2256949827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c081f1390 con 0x7f4c080ad950 2023-08-25T04:16:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.337+0000 7f4c0e559640 1 -- 172.21.15.55:0/2256949827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c08152e60 con 0x7f4c080ad950 2023-08-25T04:16:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.341+0000 7f4c0e559640 1 -- 172.21.15.55:0/2256949827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0804dbe0 con 0x7f4c080ad950 2023-08-25T04:16:00.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.341+0000 7f4c04ff9640 1 -- 172.21.15.55:0/2256949827 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f4bfc0be450 con 0x7f4c080ad950 2023-08-25T04:16:00.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.341+0000 7f4c04ff9640 1 --2- 172.21.15.55:0/2256949827 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f4bf40657a0 0x7f4bf4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:00.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.341+0000 7f4c04ff9640 1 -- 172.21.15.55:0/2256949827 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4bfc11f8f0 con 0x7f4c080ad950 2023-08-25T04:16:00.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.341+0000 7f4c07fff640 1 --2- 172.21.15.55:0/2256949827 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f4bf40657a0 0x7f4bf4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:00.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.341+0000 7f4c07fff640 1 --2- 172.21.15.55:0/2256949827 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f4bf40657a0 0x7f4bf4067c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4c0815cf20 tx=0x7f4bf8008040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:00.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.345+0000 7f4c04ff9640 1 -- 172.21.15.55:0/2256949827 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4bfc0ed440 con 0x7f4c080ad950 2023-08-25T04:16:00.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.505+0000 7f4c0e559640 1 -- 172.21.15.55:0/2256949827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4c080cd0f0 con 0x7f4c080ad950 2023-08-25T04:16:00.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.505+0000 7f4c04ff9640 1 -- 172.21.15.55:0/2256949827 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v58) v1 ==== 84+0+126 (secure 0 0 0) 0x7f4bfc0f0a60 con 0x7f4c080ad950 2023-08-25T04:16:00.507 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:16:00.507 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T04:16:00.507 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:16:00.507 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-08-25T04:16:00.507 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-08-25T04:16:00.508 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:16:00.508 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:16:00.508 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-08-25T04:16:00.508 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-08-25T04:16:00.508 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:16:00.508 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T04:16:00.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.509+0000 7f4c0e559640 1 -- 172.21.15.55:0/2256949827 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f4bf40657a0 msgr2=0x7f4bf4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:00.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.509+0000 7f4c0e559640 1 --2- 172.21.15.55:0/2256949827 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f4bf40657a0 0x7f4bf4067c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4c0815cf20 tx=0x7f4bf8008040 comp rx=0 tx=0).stop 2023-08-25T04:16:00.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.509+0000 7f4c0e559640 1 -- 172.21.15.55:0/2256949827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c080ad950 msgr2=0x7f4c08152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:00.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.509+0000 7f4c0e559640 1 --2- 172.21.15.55:0/2256949827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c080ad950 0x7f4c08152920 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc01b260 tx=0x7f4bfc01ce90 comp rx=0 tx=0).stop 2023-08-25T04:16:00.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.509+0000 7f4c0e559640 1 -- 172.21.15.55:0/2256949827 shutdown_connections 2023-08-25T04:16:00.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.509+0000 7f4c0e559640 1 --2- 172.21.15.55:0/2256949827 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f4bf40657a0 0x7f4bf4067c60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.509+0000 7f4c0e559640 1 --2- 172.21.15.55:0/2256949827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c080c89f0 0x7f4c0815bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.509+0000 7f4c0e559640 1 --2- 172.21.15.55:0/2256949827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c080ad950 0x7f4c08152920 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.509+0000 7f4c0e559640 1 --2- 172.21.15.55:0/2256949827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c0806c000 0x7f4c081f18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.509+0000 7f4c0e559640 1 -- 172.21.15.55:0/2256949827 >> 172.21.15.55:0/2256949827 conn(0x7f4c08069d00 msgr2=0x7f4c080af590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:00.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.509+0000 7f4c0e559640 1 -- 172.21.15.55:0/2256949827 shutdown_connections 2023-08-25T04:16:00.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.509+0000 7f4c0e559640 1 -- 172.21.15.55:0/2256949827 wait complete. 2023-08-25T04:16:00.528 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-25T04:16:00.528 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-25T04:16:00.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.677+0000 7fde7cd8f640 1 Processor -- start 2023-08-25T04:16:00.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.677+0000 7fde7cd8f640 1 -- start start 2023-08-25T04:16:00.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.677+0000 7fde7cd8f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fde78069900 0x7fde78161070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:00.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.677+0000 7fde7cd8f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fde78071500 0x7fde780c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:00.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.677+0000 7fde7cd8f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde78069d60 con 0x7fde7806e690 2023-08-25T04:16:00.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.677+0000 7fde7cd8f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7806b370 con 0x7fde78071500 2023-08-25T04:16:00.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.677+0000 7fde7cd8f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde78071070 con 0x7fde78069900 2023-08-25T04:16:00.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.677+0000 7fde76d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fde78071500 0x7fde780c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:00.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.681+0000 7fde76d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fde78071500 0x7fde780c9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39954/0 (socket says 172.21.15.55:39954) 2023-08-25T04:16:00.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.681+0000 7fde76d9d640 1 -- 172.21.15.55:0/3174425259 learned_addr learned my addr 172.21.15.55:0/3174425259 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:00.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.681+0000 7fde6ffff640 1 --2- 172.21.15.55:0/3174425259 >> v2:172.21.15.110:3300/0 conn(0x7fde78069900 0x7fde78161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:00.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.681+0000 7fde76d9d640 1 -- 172.21.15.55:0/3174425259 >> v2:172.21.15.110:3300/0 conn(0x7fde78069900 msgr2=0x7fde78161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:00.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.681+0000 7fde76d9d640 1 --2- 172.21.15.55:0/3174425259 >> v2:172.21.15.110:3300/0 conn(0x7fde78069900 0x7fde78161070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.681+0000 7fde76d9d640 1 -- 172.21.15.55:0/3174425259 >> v1:172.21.15.110:6789/0 conn(0x7fde7806e690 legacy=0x7fde7806ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:00.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.681+0000 7fde76d9d640 1 -- 172.21.15.55:0/3174425259 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde781615b0 con 0x7fde78071500 2023-08-25T04:16:00.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.681+0000 7fde76d9d640 1 --2- 172.21.15.55:0/3174425259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde78071500 0x7fde780c9be0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fde78070520 tx=0x7fde7001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c0a37c315ac12a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:00.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.681+0000 7fde75d9b640 1 -- 172.21.15.55:0/3174425259 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde700a5780 con 0x7fde78071500 2023-08-25T04:16:00.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.681+0000 7fde75d9b640 1 -- 172.21.15.55:0/3174425259 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde700a58e0 con 0x7fde78071500 2023-08-25T04:16:00.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.681+0000 7fde75d9b640 1 -- 172.21.15.55:0/3174425259 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde700a5c70 con 0x7fde78071500 2023-08-25T04:16:00.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7cd8f640 1 -- 172.21.15.55:0/3174425259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde78071500 msgr2=0x7fde780c9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:00.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7cd8f640 1 --2- 172.21.15.55:0/3174425259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde78071500 0x7fde780c9be0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fde78070520 tx=0x7fde7001c9d0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7cd8f640 1 -- 172.21.15.55:0/3174425259 shutdown_connections 2023-08-25T04:16:00.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7cd8f640 1 --2- 172.21.15.55:0/3174425259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde78071500 0x7fde780c9be0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7cd8f640 1 --2- 172.21.15.55:0/3174425259 >> v2:172.21.15.110:3300/0 conn(0x7fde78069900 0x7fde78161070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7cd8f640 1 -- 172.21.15.55:0/3174425259 >> 172.21.15.55:0/3174425259 conn(0x7fde780cc010 msgr2=0x7fde780cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:00.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7cd8f640 1 -- 172.21.15.55:0/3174425259 shutdown_connections 2023-08-25T04:16:00.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7cd8f640 1 -- 172.21.15.55:0/3174425259 wait complete. 2023-08-25T04:16:00.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7cd8f640 1 Processor -- start 2023-08-25T04:16:00.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7cd8f640 1 -- start start 2023-08-25T04:16:00.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7cd8f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde78069900 0x7fde78150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:00.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7cd8f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde7806e690 0x7fde78153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:00.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7cd8f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde78071500 0x7fde780c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:00.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7cd8f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde78153870 con 0x7fde78069900 2023-08-25T04:16:00.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7cd8f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde780c3e30 con 0x7fde7806e690 2023-08-25T04:16:00.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7cd8f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde78153a80 con 0x7fde78071500 2023-08-25T04:16:00.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde78069900 0x7fde78150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:00.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde78069900 0x7fde78150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39962/0 (socket says 172.21.15.55:39962) 2023-08-25T04:16:00.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7659c640 1 -- 172.21.15.55:0/2886069496 learned_addr learned my addr 172.21.15.55:0/2886069496 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:00.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde6ffff640 1 --2- 172.21.15.55:0/2886069496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde7806e690 0x7fde78153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:00.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde76d9d640 1 --2- 172.21.15.55:0/2886069496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde78071500 0x7fde780c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:00.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7659c640 1 -- 172.21.15.55:0/2886069496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde78071500 msgr2=0x7fde780c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:00.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7659c640 1 --2- 172.21.15.55:0/2886069496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde78071500 0x7fde780c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7659c640 1 -- 172.21.15.55:0/2886069496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde7806e690 msgr2=0x7fde78153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:00.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7659c640 1 --2- 172.21.15.55:0/2886069496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde7806e690 0x7fde78153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:00.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde7659c640 1 -- 172.21.15.55:0/2886069496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde70009b30 con 0x7fde78069900 2023-08-25T04:16:00.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde6ffff640 1 --2- 172.21.15.55:0/2886069496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde7806e690 0x7fde78153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:16:00.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.685+0000 7fde76d9d640 1 --2- 172.21.15.55:0/2886069496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde78071500 0x7fde780c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:16:00.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.689+0000 7fde7659c640 1 --2- 172.21.15.55:0/2886069496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde78069900 0x7fde78150900 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fde6800c500 tx=0x7fde6800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:00.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.689+0000 7fde6effd640 1 -- 172.21.15.55:0/2886069496 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde68005220 con 0x7fde78069900 2023-08-25T04:16:00.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.689+0000 7fde6effd640 1 -- 172.21.15.55:0/2886069496 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde68005380 con 0x7fde78069900 2023-08-25T04:16:00.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.689+0000 7fde6effd640 1 -- 172.21.15.55:0/2886069496 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde68007270 con 0x7fde78069900 2023-08-25T04:16:00.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.689+0000 7fde7cd8f640 1 -- 172.21.15.55:0/2886069496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde78153d60 con 0x7fde78069900 2023-08-25T04:16:00.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.689+0000 7fde7cd8f640 1 -- 172.21.15.55:0/2886069496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde78154320 con 0x7fde78069900 2023-08-25T04:16:00.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.689+0000 7fde7cd8f640 1 -- 172.21.15.55:0/2886069496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7804dbe0 con 0x7fde78069900 2023-08-25T04:16:00.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.689+0000 7fde6effd640 1 -- 172.21.15.55:0/2886069496 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fde680073d0 con 0x7fde78069900 2023-08-25T04:16:00.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.689+0000 7fde6effd640 1 --2- 172.21.15.55:0/2886069496 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fde580657a0 0x7fde58067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:00.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.689+0000 7fde6effd640 1 -- 172.21.15.55:0/2886069496 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fde68082590 con 0x7fde78069900 2023-08-25T04:16:00.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.693+0000 7fde6ffff640 1 --2- 172.21.15.55:0/2886069496 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fde580657a0 0x7fde58067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:00.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.693+0000 7fde6ffff640 1 --2- 172.21.15.55:0/2886069496 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fde580657a0 0x7fde58067c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fde781532e0 tx=0x7fde60008040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:00.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.697+0000 7fde6effd640 1 -- 172.21.15.55:0/2886069496 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fde68050200 con 0x7fde78069900 2023-08-25T04:16:00.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:00.853+0000 7fde7cd8f640 1 -- 172.21.15.55:0/2886069496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fde780d04c0 con 0x7fde78069900 2023-08-25T04:16:01.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.733+0000 7fde6effd640 1 -- 172.21.15.55:0/2886069496 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7fde68053820 con 0x7fde78069900 2023-08-25T04:16:01.732 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-08-25T04:16:01.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.741+0000 7fde7cd8f640 1 -- 172.21.15.55:0/2886069496 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fde580657a0 msgr2=0x7fde58067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:01.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.741+0000 7fde7cd8f640 1 --2- 172.21.15.55:0/2886069496 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fde580657a0 0x7fde58067c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fde781532e0 tx=0x7fde60008040 comp rx=0 tx=0).stop 2023-08-25T04:16:01.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.741+0000 7fde7cd8f640 1 -- 172.21.15.55:0/2886069496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde78069900 msgr2=0x7fde78150900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:01.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.741+0000 7fde7cd8f640 1 --2- 172.21.15.55:0/2886069496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde78069900 0x7fde78150900 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fde6800c500 tx=0x7fde6800c9c0 comp rx=0 tx=0).stop 2023-08-25T04:16:01.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.741+0000 7fde7cd8f640 1 -- 172.21.15.55:0/2886069496 shutdown_connections 2023-08-25T04:16:01.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.741+0000 7fde7cd8f640 1 --2- 172.21.15.55:0/2886069496 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fde580657a0 0x7fde58067c60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:01.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.741+0000 7fde7cd8f640 1 --2- 172.21.15.55:0/2886069496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde78071500 0x7fde780c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:01.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.741+0000 7fde7cd8f640 1 --2- 172.21.15.55:0/2886069496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde7806e690 0x7fde78153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:01.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.741+0000 7fde7cd8f640 1 --2- 172.21.15.55:0/2886069496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde78069900 0x7fde78150900 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:01.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.741+0000 7fde7cd8f640 1 -- 172.21.15.55:0/2886069496 >> 172.21.15.55:0/2886069496 conn(0x7fde780cc010 msgr2=0x7fde780afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:01.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.741+0000 7fde7cd8f640 1 -- 172.21.15.55:0/2886069496 shutdown_connections 2023-08-25T04:16:01.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.741+0000 7fde7cd8f640 1 -- 172.21.15.55:0/2886069496 wait complete. 2023-08-25T04:16:01.764 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-25T04:16:01.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.921+0000 7ff245288640 1 Processor -- start 2023-08-25T04:16:01.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.921+0000 7ff245288640 1 -- start start 2023-08-25T04:16:01.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.921+0000 7ff245288640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff2401601f0 0x7ff24015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:01.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.921+0000 7ff245288640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff24015e3c0 0x7ff2400d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:01.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.921+0000 7ff245288640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff24015f8b0 con 0x7ff2400d10c0 2023-08-25T04:16:01.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.921+0000 7ff245288640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2400cd5a0 con 0x7ff24015e3c0 2023-08-25T04:16:01.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.921+0000 7ff245288640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2400cd880 con 0x7ff2401601f0 2023-08-25T04:16:01.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.921+0000 7ff2367fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff24015e3c0 0x7ff2400d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:01.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.921+0000 7ff2367fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff24015e3c0 0x7ff2400d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39964/0 (socket says 172.21.15.55:39964) 2023-08-25T04:16:01.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.921+0000 7ff23f7fe640 1 --1- 172.21.15.55:0/2480881099 >> v1:172.21.15.55:6789/0 conn(0x7ff2400d10c0 0x7ff2400b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45918/0 (socket says 172.21.15.55:45918) 2023-08-25T04:16:01.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.921+0000 7ff2367fc640 1 -- 172.21.15.55:0/2480881099 learned_addr learned my addr 172.21.15.55:0/2480881099 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:01.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.921+0000 7ff23effd640 1 --2- 172.21.15.55:0/2480881099 >> v2:172.21.15.110:3300/0 conn(0x7ff2401601f0 0x7ff24015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:01.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.921+0000 7ff2367fc640 1 -- 172.21.15.55:0/2480881099 >> v2:172.21.15.110:3300/0 conn(0x7ff2401601f0 msgr2=0x7ff24015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:01.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.921+0000 7ff2367fc640 1 --2- 172.21.15.55:0/2480881099 >> v2:172.21.15.110:3300/0 conn(0x7ff2401601f0 0x7ff24015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:01.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.921+0000 7ff2367fc640 1 -- 172.21.15.55:0/2480881099 >> v1:172.21.15.55:6789/0 conn(0x7ff2400d10c0 legacy=0x7ff2400b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:01.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.921+0000 7ff2367fc640 1 -- 172.21.15.55:0/2480881099 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2400cdb60 con 0x7ff24015e3c0 2023-08-25T04:16:01.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.925+0000 7ff2367fc640 1 --2- 172.21.15.55:0/2480881099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff24015e3c0 0x7ff2400d0b80 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff24008b7f0 tx=0x7ff22801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33fc163e0640e08b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:01.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.925+0000 7ff23e7fc640 1 -- 172.21.15.55:0/2480881099 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2280a5770 con 0x7ff24015e3c0 2023-08-25T04:16:01.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.925+0000 7ff23e7fc640 1 -- 172.21.15.55:0/2480881099 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2280a58d0 con 0x7ff24015e3c0 2023-08-25T04:16:01.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.925+0000 7ff23e7fc640 1 -- 172.21.15.55:0/2480881099 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2280a5c60 con 0x7ff24015e3c0 2023-08-25T04:16:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.925+0000 7ff245288640 1 -- 172.21.15.55:0/2480881099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff24015e3c0 msgr2=0x7ff2400d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.925+0000 7ff245288640 1 --2- 172.21.15.55:0/2480881099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff24015e3c0 0x7ff2400d0b80 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff24008b7f0 tx=0x7ff22801c9a0 comp rx=0 tx=0).stop 2023-08-25T04:16:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.925+0000 7ff245288640 1 -- 172.21.15.55:0/2480881099 shutdown_connections 2023-08-25T04:16:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.925+0000 7ff245288640 1 --2- 172.21.15.55:0/2480881099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff24015e3c0 0x7ff2400d0b80 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.925+0000 7ff245288640 1 --2- 172.21.15.55:0/2480881099 >> v2:172.21.15.110:3300/0 conn(0x7ff2401601f0 0x7ff24015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.925+0000 7ff245288640 1 -- 172.21.15.55:0/2480881099 >> 172.21.15.55:0/2480881099 conn(0x7ff2400d27d0 msgr2=0x7ff2400d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:01.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.925+0000 7ff245288640 1 -- 172.21.15.55:0/2480881099 shutdown_connections 2023-08-25T04:16:01.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.925+0000 7ff245288640 1 -- 172.21.15.55:0/2480881099 wait complete. 2023-08-25T04:16:01.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff245288640 1 Processor -- start 2023-08-25T04:16:01.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff245288640 1 -- start start 2023-08-25T04:16:01.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff245288640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2400d10c0 0x7ff2400c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:01.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff245288640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff24015e3c0 0x7ff24006ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:01.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff245288640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2401601f0 0x7ff24006b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:01.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff245288640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff240154580 con 0x7ff2400d10c0 2023-08-25T04:16:01.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff245288640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff240154a10 con 0x7ff24015e3c0 2023-08-25T04:16:01.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff245288640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff240153690 con 0x7ff2401601f0 2023-08-25T04:16:01.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff23effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2400d10c0 0x7ff2400c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:01.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff23effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2400d10c0 0x7ff2400c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39968/0 (socket says 172.21.15.55:39968) 2023-08-25T04:16:01.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff23effd640 1 -- 172.21.15.55:0/3347902571 learned_addr learned my addr 172.21.15.55:0/3347902571 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:01.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff23f7fe640 1 --2- 172.21.15.55:0/3347902571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2401601f0 0x7ff24006b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:01.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff2367fc640 1 --2- 172.21.15.55:0/3347902571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff24015e3c0 0x7ff24006ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:01.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff23effd640 1 -- 172.21.15.55:0/3347902571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2401601f0 msgr2=0x7ff24006b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:01.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff23effd640 1 --2- 172.21.15.55:0/3347902571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2401601f0 0x7ff24006b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:01.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff23effd640 1 -- 172.21.15.55:0/3347902571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff24015e3c0 msgr2=0x7ff24006ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:01.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff23effd640 1 --2- 172.21.15.55:0/3347902571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff24015e3c0 0x7ff24006ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:01.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff23effd640 1 -- 172.21.15.55:0/3347902571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff228009b30 con 0x7ff2400d10c0 2023-08-25T04:16:01.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff23effd640 1 --2- 172.21.15.55:0/3347902571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2400d10c0 0x7ff2400c6b30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff23000d7d0 tx=0x7ff23000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:01.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff237fff640 1 -- 172.21.15.55:0/3347902571 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23000b6c0 con 0x7ff2400d10c0 2023-08-25T04:16:01.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff237fff640 1 -- 172.21.15.55:0/3347902571 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23000b820 con 0x7ff2400d10c0 2023-08-25T04:16:01.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff237fff640 1 -- 172.21.15.55:0/3347902571 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23000bbd0 con 0x7ff2400d10c0 2023-08-25T04:16:01.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff245288640 1 -- 172.21.15.55:0/3347902571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2400ce7c0 con 0x7ff2400d10c0 2023-08-25T04:16:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff245288640 1 -- 172.21.15.55:0/3347902571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff240153c50 con 0x7ff2400d10c0 2023-08-25T04:16:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.929+0000 7ff245288640 1 -- 172.21.15.55:0/3347902571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2400b5260 con 0x7ff2400d10c0 2023-08-25T04:16:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.933+0000 7ff237fff640 1 -- 172.21.15.55:0/3347902571 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7ff23000bd30 con 0x7ff2400d10c0 2023-08-25T04:16:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.933+0000 7ff237fff640 1 --2- 172.21.15.55:0/3347902571 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7ff2200657a0 0x7ff220067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.933+0000 7ff237fff640 1 -- 172.21.15.55:0/3347902571 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5580+0+0 (secure 0 0 0) 0x7ff2300832f0 con 0x7ff2400d10c0 2023-08-25T04:16:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.933+0000 7ff2367fc640 1 --2- 172.21.15.55:0/3347902571 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7ff2200657a0 0x7ff220067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.933+0000 7ff2367fc640 1 --2- 172.21.15.55:0/3347902571 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7ff2200657a0 0x7ff220067c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff2280ae000 tx=0x7ff2280a7070 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:01.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:01.937+0000 7ff237fff640 1 -- 172.21.15.55:0/3347902571 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff230054900 con 0x7ff2400d10c0 2023-08-25T04:16:02.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.093+0000 7ff245288640 1 -- 172.21.15.55:0/3347902571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff240073ec0 con 0x7ff2400d10c0 2023-08-25T04:16:02.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.741+0000 7ff237fff640 1 -- 172.21.15.55:0/3347902571 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v60) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff230054490 con 0x7ff2400d10c0 2023-08-25T04:16:02.743 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-08-25T04:16:02.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.757+0000 7ff245288640 1 -- 172.21.15.55:0/3347902571 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7ff2200657a0 msgr2=0x7ff220067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:02.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.757+0000 7ff245288640 1 --2- 172.21.15.55:0/3347902571 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7ff2200657a0 0x7ff220067c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff2280ae000 tx=0x7ff2280a7070 comp rx=0 tx=0).stop 2023-08-25T04:16:02.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.757+0000 7ff245288640 1 -- 172.21.15.55:0/3347902571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2400d10c0 msgr2=0x7ff2400c6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:02.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.757+0000 7ff245288640 1 --2- 172.21.15.55:0/3347902571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2400d10c0 0x7ff2400c6b30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff23000d7d0 tx=0x7ff23000dc90 comp rx=0 tx=0).stop 2023-08-25T04:16:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.757+0000 7ff245288640 1 -- 172.21.15.55:0/3347902571 shutdown_connections 2023-08-25T04:16:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.757+0000 7ff245288640 1 --2- 172.21.15.55:0/3347902571 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7ff2200657a0 0x7ff220067c60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.757+0000 7ff245288640 1 --2- 172.21.15.55:0/3347902571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2401601f0 0x7ff24006b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.757+0000 7ff245288640 1 --2- 172.21.15.55:0/3347902571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff24015e3c0 0x7ff24006ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.757+0000 7ff245288640 1 --2- 172.21.15.55:0/3347902571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2400d10c0 0x7ff2400c6b30 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:02.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.757+0000 7ff245288640 1 -- 172.21.15.55:0/3347902571 >> 172.21.15.55:0/3347902571 conn(0x7ff2400d27d0 msgr2=0x7ff2400b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:02.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.757+0000 7ff245288640 1 -- 172.21.15.55:0/3347902571 shutdown_connections 2023-08-25T04:16:02.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.761+0000 7ff245288640 1 -- 172.21.15.55:0/3347902571 wait complete. 2023-08-25T04:16:02.788 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-25T04:16:02.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.937+0000 7f11c6dba640 1 Processor -- start 2023-08-25T04:16:02.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.937+0000 7f11c6dba640 1 -- start start 2023-08-25T04:16:02.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.937+0000 7f11c6dba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f11c006c3b0 0x7f11c00cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:02.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.937+0000 7f11c6dba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f11c006c790 0x7f11c006de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:02.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.937+0000 7f11c6dba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c00cab90 con 0x7f11c00d1060 2023-08-25T04:16:02.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.937+0000 7f11c6dba640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c006dbb0 con 0x7f11c006c790 2023-08-25T04:16:02.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.937+0000 7f11c6dba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c00cae50 con 0x7f11c006c3b0 2023-08-25T04:16:02.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.937+0000 7f11bffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f11c006c790 0x7f11c006de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:02.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.937+0000 7f11bffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f11c006c790 0x7f11c006de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39978/0 (socket says 172.21.15.55:39978) 2023-08-25T04:16:02.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.937+0000 7f11bffff640 1 -- 172.21.15.55:0/639259665 learned_addr learned my addr 172.21.15.55:0/639259665 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:02.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.941+0000 7f11c4b56640 1 --2- 172.21.15.55:0/639259665 >> v2:172.21.15.110:3300/0 conn(0x7f11c006c3b0 0x7f11c00cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:02.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.941+0000 7f11bffff640 1 -- 172.21.15.55:0/639259665 >> v2:172.21.15.110:3300/0 conn(0x7f11c006c3b0 msgr2=0x7f11c00cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:02.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.941+0000 7f11bffff640 1 --2- 172.21.15.55:0/639259665 >> v2:172.21.15.110:3300/0 conn(0x7f11c006c3b0 0x7f11c00cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:02.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.941+0000 7f11bffff640 1 -- 172.21.15.55:0/639259665 >> v1:172.21.15.110:6789/0 conn(0x7f11c00d1060 legacy=0x7f11c015c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:02.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.941+0000 7f11bffff640 1 -- 172.21.15.55:0/639259665 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c00cb130 con 0x7f11c006c790 2023-08-25T04:16:02.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.941+0000 7f11bffff640 1 --2- 172.21.15.55:0/639259665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c006c790 0x7f11c006de90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f11c00718a0 tx=0x7f11b001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff77e1a631472ca server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:02.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.941+0000 7f11bf7fe640 1 -- 172.21.15.55:0/639259665 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b00ac640 con 0x7f11c006c790 2023-08-25T04:16:02.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.941+0000 7f11bf7fe640 1 -- 172.21.15.55:0/639259665 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b00ac7a0 con 0x7f11c006c790 2023-08-25T04:16:02.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.941+0000 7f11bf7fe640 1 -- 172.21.15.55:0/639259665 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b00acb30 con 0x7f11c006c790 2023-08-25T04:16:02.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.941+0000 7f11c6dba640 1 -- 172.21.15.55:0/639259665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c006c790 msgr2=0x7f11c006de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:02.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.941+0000 7f11c6dba640 1 --2- 172.21.15.55:0/639259665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c006c790 0x7f11c006de90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f11c00718a0 tx=0x7f11b001c4d0 comp rx=0 tx=0).stop 2023-08-25T04:16:02.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c6dba640 1 -- 172.21.15.55:0/639259665 shutdown_connections 2023-08-25T04:16:02.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c6dba640 1 --2- 172.21.15.55:0/639259665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c006c790 0x7f11c006de90 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:02.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c6dba640 1 --2- 172.21.15.55:0/639259665 >> v2:172.21.15.110:3300/0 conn(0x7f11c006c3b0 0x7f11c00cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:02.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c6dba640 1 -- 172.21.15.55:0/639259665 >> 172.21.15.55:0/639259665 conn(0x7f11c00d0540 msgr2=0x7f11c00d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:02.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c6dba640 1 -- 172.21.15.55:0/639259665 shutdown_connections 2023-08-25T04:16:02.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c6dba640 1 -- 172.21.15.55:0/639259665 wait complete. 2023-08-25T04:16:02.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c6dba640 1 Processor -- start 2023-08-25T04:16:02.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c6dba640 1 -- start start 2023-08-25T04:16:02.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c6dba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11c006c3b0 0x7f11c014f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:02.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c6dba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11c006c790 0x7f11c01531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:02.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c6dba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c00d1060 0x7f11c00cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:02.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c6dba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c0153af0 con 0x7f11c00d1060 2023-08-25T04:16:02.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c6dba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c0153dd0 con 0x7f11c006c790 2023-08-25T04:16:02.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c6dba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c01540b0 con 0x7f11c006c3b0 2023-08-25T04:16:02.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c5357640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c00d1060 0x7f11c00cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:02.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c5357640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c00d1060 0x7f11c00cc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39980/0 (socket says 172.21.15.55:39980) 2023-08-25T04:16:02.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c5357640 1 -- 172.21.15.55:0/1347338459 learned_addr learned my addr 172.21.15.55:0/1347338459 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:02.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11bffff640 1 --2- 172.21.15.55:0/1347338459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11c006c790 0x7f11c01531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:02.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c4b56640 1 --2- 172.21.15.55:0/1347338459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11c006c3b0 0x7f11c014f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:02.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c5357640 1 -- 172.21.15.55:0/1347338459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11c006c3b0 msgr2=0x7f11c014f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:02.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c5357640 1 --2- 172.21.15.55:0/1347338459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11c006c3b0 0x7f11c014f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:02.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c5357640 1 -- 172.21.15.55:0/1347338459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11c006c790 msgr2=0x7f11c01531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:02.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c5357640 1 --2- 172.21.15.55:0/1347338459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11c006c790 0x7f11c01531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:02.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.945+0000 7f11c5357640 1 -- 172.21.15.55:0/1347338459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b00094d0 con 0x7f11c00d1060 2023-08-25T04:16:02.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.949+0000 7f11c5357640 1 --2- 172.21.15.55:0/1347338459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c00d1060 0x7f11c00cc710 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f11b800c730 tx=0x7f11b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:02.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.949+0000 7f11bd7fa640 1 -- 172.21.15.55:0/1347338459 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b8003b80 con 0x7f11c00d1060 2023-08-25T04:16:02.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.949+0000 7f11bd7fa640 1 -- 172.21.15.55:0/1347338459 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b8003ce0 con 0x7f11c00d1060 2023-08-25T04:16:02.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.949+0000 7f11bd7fa640 1 -- 172.21.15.55:0/1347338459 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b800aa30 con 0x7f11c00d1060 2023-08-25T04:16:02.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.949+0000 7f11c6dba640 1 -- 172.21.15.55:0/1347338459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c0154390 con 0x7f11c00d1060 2023-08-25T04:16:02.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.949+0000 7f11c6dba640 1 -- 172.21.15.55:0/1347338459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c014ff00 con 0x7f11c00d1060 2023-08-25T04:16:02.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.949+0000 7f11c6dba640 1 -- 172.21.15.55:0/1347338459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c0073ec0 con 0x7f11c00d1060 2023-08-25T04:16:02.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.949+0000 7f11bd7fa640 1 -- 172.21.15.55:0/1347338459 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f11b800ab90 con 0x7f11c00d1060 2023-08-25T04:16:02.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.949+0000 7f11bd7fa640 1 --2- 172.21.15.55:0/1347338459 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f11ac0657d0 0x7f11ac067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:02.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.949+0000 7f11bd7fa640 1 -- 172.21.15.55:0/1347338459 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f11b80836e0 con 0x7f11c00d1060 2023-08-25T04:16:02.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.953+0000 7f11c4b56640 1 --2- 172.21.15.55:0/1347338459 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f11ac0657d0 0x7f11ac067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:02.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.953+0000 7f11c4b56640 1 --2- 172.21.15.55:0/1347338459 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f11ac0657d0 0x7f11ac067c90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f11b4006fd0 tx=0x7f11b4008040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:02.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:02.953+0000 7f11bd7fa640 1 -- 172.21.15.55:0/1347338459 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f11b80510f0 con 0x7f11c00d1060 2023-08-25T04:16:03.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.149+0000 7f11c6dba640 1 -- 172.21.15.55:0/1347338459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f11c00ad110 con 0x7f11c00d1060 2023-08-25T04:16:03.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.745+0000 7f11bd7fa640 1 -- 172.21.15.55:0/1347338459 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f11b8054710 con 0x7f11c00d1060 2023-08-25T04:16:03.744 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 7 and data pool 8 2023-08-25T04:16:03.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.753+0000 7f11c6dba640 1 -- 172.21.15.55:0/1347338459 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f11ac0657d0 msgr2=0x7f11ac067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:03.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.753+0000 7f11c6dba640 1 --2- 172.21.15.55:0/1347338459 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f11ac0657d0 0x7f11ac067c90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f11b4006fd0 tx=0x7f11b4008040 comp rx=0 tx=0).stop 2023-08-25T04:16:03.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.753+0000 7f11c6dba640 1 -- 172.21.15.55:0/1347338459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c00d1060 msgr2=0x7f11c00cc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:03.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.753+0000 7f11c6dba640 1 --2- 172.21.15.55:0/1347338459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c00d1060 0x7f11c00cc710 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f11b800c730 tx=0x7f11b800cbf0 comp rx=0 tx=0).stop 2023-08-25T04:16:03.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.753+0000 7f11c6dba640 1 -- 172.21.15.55:0/1347338459 shutdown_connections 2023-08-25T04:16:03.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.753+0000 7f11c6dba640 1 --2- 172.21.15.55:0/1347338459 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f11ac0657d0 0x7f11ac067c90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:03.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.753+0000 7f11c6dba640 1 --2- 172.21.15.55:0/1347338459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11c00d1060 0x7f11c00cc710 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:03.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.753+0000 7f11c6dba640 1 --2- 172.21.15.55:0/1347338459 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11c006c790 0x7f11c01531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:03.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.753+0000 7f11c6dba640 1 --2- 172.21.15.55:0/1347338459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11c006c3b0 0x7f11c014f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:03.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.753+0000 7f11c6dba640 1 -- 172.21.15.55:0/1347338459 >> 172.21.15.55:0/1347338459 conn(0x7f11c00d0540 msgr2=0x7f11c00b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:03.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.757+0000 7f11c6dba640 1 -- 172.21.15.55:0/1347338459 shutdown_connections 2023-08-25T04:16:03.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.757+0000 7f11c6dba640 1 -- 172.21.15.55:0/1347338459 wait complete. 2023-08-25T04:16:03.798 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:16:03.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.941+0000 7feef4c19640 1 Processor -- start 2023-08-25T04:16:03.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.941+0000 7feef4c19640 1 -- start start 2023-08-25T04:16:03.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.945+0000 7feef4c19640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feef00cfa70 0x7feef0160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:03.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.945+0000 7feef4c19640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feef006b2b0 0x7feef006b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:03.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.945+0000 7feef4c19640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef006eaf0 con 0x7feef015c9c0 2023-08-25T04:16:03.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.945+0000 7feef4c19640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef006e530 con 0x7feef006b2b0 2023-08-25T04:16:03.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.945+0000 7feef4c19640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef006e810 con 0x7feef00cfa70 2023-08-25T04:16:03.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.945+0000 7feeeed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feef006b2b0 0x7feef006b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:03.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.945+0000 7feeeed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feef006b2b0 0x7feef006b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39984/0 (socket says 172.21.15.55:39984) 2023-08-25T04:16:03.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.945+0000 7feeeed9d640 1 -- 172.21.15.55:0/855189072 learned_addr learned my addr 172.21.15.55:0/855189072 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:03.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.945+0000 7feee5d9b640 1 --2- 172.21.15.55:0/855189072 >> v2:172.21.15.110:3300/0 conn(0x7feef00cfa70 0x7feef0160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:03.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.945+0000 7feeeed9d640 1 -- 172.21.15.55:0/855189072 >> v2:172.21.15.110:3300/0 conn(0x7feef00cfa70 msgr2=0x7feef0160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:03.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.945+0000 7feeeed9d640 1 --2- 172.21.15.55:0/855189072 >> v2:172.21.15.110:3300/0 conn(0x7feef00cfa70 0x7feef0160c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:03.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.945+0000 7feeeed9d640 1 -- 172.21.15.55:0/855189072 >> v1:172.21.15.55:6789/0 conn(0x7feef015c9c0 legacy=0x7feef0160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:03.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.945+0000 7feeeed9d640 1 -- 172.21.15.55:0/855189072 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef006aab0 con 0x7feef006b2b0 2023-08-25T04:16:03.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.945+0000 7feee5d9b640 1 --2- 172.21.15.55:0/855189072 >> v2:172.21.15.110:3300/0 conn(0x7feef00cfa70 0x7feef0160c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:16:03.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.945+0000 7feeeed9d640 1 --2- 172.21.15.55:0/855189072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feef006b2b0 0x7feef006b740 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7feef00d16a0 tx=0x7feee801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d58c20746f4078d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:03.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feeedd9b640 1 -- 172.21.15.55:0/855189072 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee80a5820 con 0x7feef006b2b0 2023-08-25T04:16:03.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feeedd9b640 1 -- 172.21.15.55:0/855189072 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee80a5980 con 0x7feef006b2b0 2023-08-25T04:16:03.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feeedd9b640 1 -- 172.21.15.55:0/855189072 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee80a5d10 con 0x7feef006b2b0 2023-08-25T04:16:03.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feef4c19640 1 -- 172.21.15.55:0/855189072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feef006b2b0 msgr2=0x7feef006b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:03.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feef4c19640 1 --2- 172.21.15.55:0/855189072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feef006b2b0 0x7feef006b740 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7feef00d16a0 tx=0x7feee801c9a0 comp rx=0 tx=0).stop 2023-08-25T04:16:03.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feef4c19640 1 -- 172.21.15.55:0/855189072 shutdown_connections 2023-08-25T04:16:03.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feef4c19640 1 --2- 172.21.15.55:0/855189072 >> v2:172.21.15.110:3300/0 conn(0x7feef00cfa70 0x7feef0160c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feef4c19640 1 --2- 172.21.15.55:0/855189072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feef006b2b0 0x7feef006b740 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:03.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feef4c19640 1 -- 172.21.15.55:0/855189072 >> 172.21.15.55:0/855189072 conn(0x7feef00d05a0 msgr2=0x7feef00d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:03.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feef4c19640 1 -- 172.21.15.55:0/855189072 shutdown_connections 2023-08-25T04:16:03.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feef4c19640 1 -- 172.21.15.55:0/855189072 wait complete. 2023-08-25T04:16:03.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feef4c19640 1 Processor -- start 2023-08-25T04:16:03.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feef4c19640 1 -- start start 2023-08-25T04:16:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feef4c19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feef006b2b0 0x7feef00b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feef4c19640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feef00cfa70 0x7feef01f8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feef4c19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feef015c9c0 0x7feef01f89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feef4c19640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef00b4970 con 0x7feef006b2b0 2023-08-25T04:16:03.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feef4c19640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef00b40d0 con 0x7feef00cfa70 2023-08-25T04:16:03.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feef4c19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef00b43b0 con 0x7feef015c9c0 2023-08-25T04:16:03.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feeee59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feef006b2b0 0x7feef00b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:03.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.949+0000 7feeee59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feef006b2b0 0x7feef00b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39996/0 (socket says 172.21.15.55:39996) 2023-08-25T04:16:03.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.953+0000 7feeee59c640 1 -- 172.21.15.55:0/2189178126 learned_addr learned my addr 172.21.15.55:0/2189178126 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:03.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.953+0000 7feeee59c640 1 -- 172.21.15.55:0/2189178126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feef015c9c0 msgr2=0x7feef01f89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:03.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.953+0000 7feeee59c640 1 --2- 172.21.15.55:0/2189178126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feef015c9c0 0x7feef01f89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.953+0000 7feeee59c640 1 -- 172.21.15.55:0/2189178126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feef00cfa70 msgr2=0x7feef01f8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.953+0000 7feeee59c640 1 --2- 172.21.15.55:0/2189178126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feef00cfa70 0x7feef01f8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.953+0000 7feeee59c640 1 -- 172.21.15.55:0/2189178126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee8009b30 con 0x7feef006b2b0 2023-08-25T04:16:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.953+0000 7feeee59c640 1 --2- 172.21.15.55:0/2189178126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feef006b2b0 0x7feef00b5dd0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7feed800c3c0 tx=0x7feed800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.953+0000 7feee77fe640 1 -- 172.21.15.55:0/2189178126 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed80054e0 con 0x7feef006b2b0 2023-08-25T04:16:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.953+0000 7feee77fe640 1 -- 172.21.15.55:0/2189178126 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed8003600 con 0x7feef006b2b0 2023-08-25T04:16:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.953+0000 7feef4c19640 1 -- 172.21.15.55:0/2189178126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef00b4690 con 0x7feef006b2b0 2023-08-25T04:16:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.953+0000 7feee77fe640 1 -- 172.21.15.55:0/2189178126 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8003a10 con 0x7feef006b2b0 2023-08-25T04:16:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.953+0000 7feef4c19640 1 -- 172.21.15.55:0/2189178126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef01f9210 con 0x7feef006b2b0 2023-08-25T04:16:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.953+0000 7feef4c19640 1 -- 172.21.15.55:0/2189178126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef0156200 con 0x7feef006b2b0 2023-08-25T04:16:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.953+0000 7feee77fe640 1 -- 172.21.15.55:0/2189178126 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7feed8003b70 con 0x7feef006b2b0 2023-08-25T04:16:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.953+0000 7feee77fe640 1 --2- 172.21.15.55:0/2189178126 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7feed00657a0 0x7feed0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.957+0000 7feee77fe640 1 -- 172.21.15.55:0/2189178126 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feed8082570 con 0x7feef006b2b0 2023-08-25T04:16:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.957+0000 7feee5d9b640 1 --2- 172.21.15.55:0/2189178126 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7feed00657a0 0x7feed0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.957+0000 7feee5d9b640 1 --2- 172.21.15.55:0/2189178126 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7feed00657a0 0x7feed0067c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7feef006d9c0 tx=0x7feee0008040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:03.957+0000 7feee77fe640 1 -- 172.21.15.55:0/2189178126 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7feef0156200 con 0x7feef006b2b0 2023-08-25T04:16:04.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.113+0000 7feef4c19640 1 -- 172.21.15.55:0/2189178126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feef0156200 con 0x7feef006b2b0 2023-08-25T04:16:04.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.117+0000 7feee77fe640 1 -- 172.21.15.55:0/2189178126 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+18376 (secure 0 0 0) 0x7feef0156200 con 0x7feef006b2b0 2023-08-25T04:16:04.116 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:16:04.117 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":61,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:16:03.154782+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:16:00.903688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-25T04:16:02.143304+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:16:04.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.117+0000 7feef4c19640 1 -- 172.21.15.55:0/2189178126 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7feed00657a0 msgr2=0x7feed0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:04.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.117+0000 7feef4c19640 1 --2- 172.21.15.55:0/2189178126 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7feed00657a0 0x7feed0067c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7feef006d9c0 tx=0x7feee0008040 comp rx=0 tx=0).stop 2023-08-25T04:16:04.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.117+0000 7feef4c19640 1 -- 172.21.15.55:0/2189178126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feef006b2b0 msgr2=0x7feef00b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:04.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.117+0000 7feef4c19640 1 --2- 172.21.15.55:0/2189178126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feef006b2b0 0x7feef00b5dd0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7feed800c3c0 tx=0x7feed800c880 comp rx=0 tx=0).stop 2023-08-25T04:16:04.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.117+0000 7feef4c19640 1 -- 172.21.15.55:0/2189178126 shutdown_connections 2023-08-25T04:16:04.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.117+0000 7feef4c19640 1 --2- 172.21.15.55:0/2189178126 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7feed00657a0 0x7feed0067c60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.117+0000 7feef4c19640 1 --2- 172.21.15.55:0/2189178126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feef015c9c0 0x7feef01f89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.117+0000 7feef4c19640 1 --2- 172.21.15.55:0/2189178126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feef00cfa70 0x7feef01f8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.117+0000 7feef4c19640 1 --2- 172.21.15.55:0/2189178126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feef006b2b0 0x7feef00b5dd0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.117+0000 7feef4c19640 1 -- 172.21.15.55:0/2189178126 >> 172.21.15.55:0/2189178126 conn(0x7feef00d05a0 msgr2=0x7feef00b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:04.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.117+0000 7feef4c19640 1 -- 172.21.15.55:0/2189178126 shutdown_connections 2023-08-25T04:16:04.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.117+0000 7feef4c19640 1 -- 172.21.15.55:0/2189178126 wait complete. 2023-08-25T04:16:04.138 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:16:04.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.281+0000 7f458bd44640 1 Processor -- start 2023-08-25T04:16:04.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.281+0000 7f458bd44640 1 -- start start 2023-08-25T04:16:04.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.281+0000 7f458bd44640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f458415c9c0 0x7f4584160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:04.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.281+0000 7f458bd44640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45840cfa70 0x7f4584160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:04.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.281+0000 7f458bd44640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4584160f90 0x7f45840ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.281+0000 7f458bd44640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f458406eaf0 con 0x7f4584160f90 2023-08-25T04:16:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.281+0000 7f458bd44640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f458406e530 con 0x7f458415c9c0 2023-08-25T04:16:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.281+0000 7f458bd44640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458406e810 con 0x7f45840cfa70 2023-08-25T04:16:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.281+0000 7f458a2e1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4584160f90 0x7f45840ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.281+0000 7f458a2e1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4584160f90 0x7f45840ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40012/0 (socket says 172.21.15.55:40012) 2023-08-25T04:16:04.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.281+0000 7f458a2e1640 1 -- 172.21.15.55:0/2596410747 learned_addr learned my addr 172.21.15.55:0/2596410747 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:04.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.281+0000 7f4589ae0640 1 --2- 172.21.15.55:0/2596410747 >> v2:172.21.15.110:3300/0 conn(0x7f458415c9c0 0x7f4584160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:04.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.281+0000 7f45892df640 1 --2- 172.21.15.55:0/2596410747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45840cfa70 0x7f4584160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:04.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.285+0000 7f458a2e1640 1 -- 172.21.15.55:0/2596410747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45840cfa70 msgr2=0x7f4584160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:04.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.285+0000 7f458a2e1640 1 --2- 172.21.15.55:0/2596410747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45840cfa70 0x7f4584160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.285+0000 7f458a2e1640 1 -- 172.21.15.55:0/2596410747 >> v2:172.21.15.110:3300/0 conn(0x7f458415c9c0 msgr2=0x7f4584160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:04.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.285+0000 7f458a2e1640 1 --2- 172.21.15.55:0/2596410747 >> v2:172.21.15.110:3300/0 conn(0x7f458415c9c0 0x7f4584160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.285+0000 7f458a2e1640 1 -- 172.21.15.55:0/2596410747 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458406aab0 con 0x7f4584160f90 2023-08-25T04:16:04.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.285+0000 7f4589ae0640 1 --2- 172.21.15.55:0/2596410747 >> v2:172.21.15.110:3300/0 conn(0x7f458415c9c0 0x7f4584160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:16:04.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.285+0000 7f458a2e1640 1 --2- 172.21.15.55:0/2596410747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4584160f90 0x7f45840ce910 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f4584070600 tx=0x7f457c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce8837e16828d08 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:04.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.285+0000 7f4588ade640 1 -- 172.21.15.55:0/2596410747 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c0a57e0 con 0x7f4584160f90 2023-08-25T04:16:04.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.285+0000 7f4588ade640 1 -- 172.21.15.55:0/2596410747 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457c0a5940 con 0x7f4584160f90 2023-08-25T04:16:04.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.285+0000 7f4588ade640 1 -- 172.21.15.55:0/2596410747 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c0a5cd0 con 0x7f4584160f90 2023-08-25T04:16:04.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.285+0000 7f458bd44640 1 -- 172.21.15.55:0/2596410747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4584160f90 msgr2=0x7f45840ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:04.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.285+0000 7f458bd44640 1 --2- 172.21.15.55:0/2596410747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4584160f90 0x7f45840ce910 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f4584070600 tx=0x7f457c01c9a0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.285+0000 7f458bd44640 1 -- 172.21.15.55:0/2596410747 shutdown_connections 2023-08-25T04:16:04.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.285+0000 7f458bd44640 1 --2- 172.21.15.55:0/2596410747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4584160f90 0x7f45840ce910 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.285+0000 7f458bd44640 1 --2- 172.21.15.55:0/2596410747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45840cfa70 0x7f4584160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.285+0000 7f458bd44640 1 --2- 172.21.15.55:0/2596410747 >> v2:172.21.15.110:3300/0 conn(0x7f458415c9c0 0x7f4584160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.285+0000 7f458bd44640 1 -- 172.21.15.55:0/2596410747 >> 172.21.15.55:0/2596410747 conn(0x7f45840d05a0 msgr2=0x7f45840d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:04.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458bd44640 1 -- 172.21.15.55:0/2596410747 shutdown_connections 2023-08-25T04:16:04.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458bd44640 1 -- 172.21.15.55:0/2596410747 wait complete. 2023-08-25T04:16:04.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458bd44640 1 Processor -- start 2023-08-25T04:16:04.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458bd44640 1 -- start start 2023-08-25T04:16:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458bd44640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45840cfa70 0x7f458414e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458bd44640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f458415c9c0 0x7f458414c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458bd44640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4584160f90 0x7f458415a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458bd44640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458415faa0 con 0x7f4584160f90 2023-08-25T04:16:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458bd44640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4584159fc0 con 0x7f458415c9c0 2023-08-25T04:16:04.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458bd44640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458415a2a0 con 0x7f45840cfa70 2023-08-25T04:16:04.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458a2e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4584160f90 0x7f458415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:04.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458a2e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4584160f90 0x7f458415a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40024/0 (socket says 172.21.15.55:40024) 2023-08-25T04:16:04.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458a2e1640 1 -- 172.21.15.55:0/32557181 learned_addr learned my addr 172.21.15.55:0/32557181 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:04.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f4589ae0640 1 --2- 172.21.15.55:0/32557181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45840cfa70 0x7f458414e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:04.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f45892df640 1 --2- 172.21.15.55:0/32557181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f458415c9c0 0x7f458414c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:04.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458a2e1640 1 -- 172.21.15.55:0/32557181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45840cfa70 msgr2=0x7f458414e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458a2e1640 1 --2- 172.21.15.55:0/32557181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45840cfa70 0x7f458414e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458a2e1640 1 -- 172.21.15.55:0/32557181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f458415c9c0 msgr2=0x7f458414c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458a2e1640 1 --2- 172.21.15.55:0/32557181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f458415c9c0 0x7f458414c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458a2e1640 1 -- 172.21.15.55:0/32557181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c009b30 con 0x7f4584160f90 2023-08-25T04:16:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f45892df640 1 --2- 172.21.15.55:0/32557181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f458415c9c0 0x7f458414c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:16:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f458a2e1640 1 --2- 172.21.15.55:0/32557181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4584160f90 0x7f458415a7c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f457c01b050 tx=0x7f457c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:04.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f457a7fc640 1 -- 172.21.15.55:0/32557181 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c0b8670 con 0x7f4584160f90 2023-08-25T04:16:04.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.289+0000 7f457a7fc640 1 -- 172.21.15.55:0/32557181 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457c0b87d0 con 0x7f4584160f90 2023-08-25T04:16:04.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.293+0000 7f457a7fc640 1 -- 172.21.15.55:0/32557181 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c0b8b80 con 0x7f4584160f90 2023-08-25T04:16:04.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.293+0000 7f458bd44640 1 -- 172.21.15.55:0/32557181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f458415fd80 con 0x7f4584160f90 2023-08-25T04:16:04.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.293+0000 7f458bd44640 1 -- 172.21.15.55:0/32557181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f458414e330 con 0x7f4584160f90 2023-08-25T04:16:04.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.293+0000 7f458bd44640 1 -- 172.21.15.55:0/32557181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f458404dbe0 con 0x7f4584160f90 2023-08-25T04:16:04.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.293+0000 7f457a7fc640 1 -- 172.21.15.55:0/32557181 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f457c0b8ce0 con 0x7f4584160f90 2023-08-25T04:16:04.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.293+0000 7f457a7fc640 1 --2- 172.21.15.55:0/32557181 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f45680657a0 0x7f4568067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:04.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.293+0000 7f457a7fc640 1 -- 172.21.15.55:0/32557181 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f457c11e820 con 0x7f4584160f90 2023-08-25T04:16:04.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.293+0000 7f4589ae0640 1 --2- 172.21.15.55:0/32557181 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f45680657a0 0x7f4568067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:04.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.297+0000 7f4589ae0640 1 --2- 172.21.15.55:0/32557181 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f45680657a0 0x7f4568067c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f45840c7590 tx=0x7f4580008040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:04.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.297+0000 7f457a7fc640 1 -- 172.21.15.55:0/32557181 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f457c0ec250 con 0x7f4584160f90 2023-08-25T04:16:04.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.457+0000 7f458bd44640 1 -- 172.21.15.55:0/32557181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f458415fbe0 con 0x7f4584160f90 2023-08-25T04:16:04.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.461+0000 7f457a7fc640 1 -- 172.21.15.55:0/32557181 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+18376 (secure 0 0 0) 0x7f458415fbe0 con 0x7f4584160f90 2023-08-25T04:16:04.461 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:16:04.462 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":61,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:16:03.154782+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:16:00.903688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-25T04:16:02.143304+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:16:04.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.461+0000 7f458bd44640 1 -- 172.21.15.55:0/32557181 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f45680657a0 msgr2=0x7f4568067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:04.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.461+0000 7f458bd44640 1 --2- 172.21.15.55:0/32557181 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f45680657a0 0x7f4568067c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f45840c7590 tx=0x7f4580008040 comp rx=0 tx=0).stop 2023-08-25T04:16:04.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.461+0000 7f458bd44640 1 -- 172.21.15.55:0/32557181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4584160f90 msgr2=0x7f458415a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:04.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.461+0000 7f458bd44640 1 --2- 172.21.15.55:0/32557181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4584160f90 0x7f458415a7c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f457c01b050 tx=0x7f457c019740 comp rx=0 tx=0).stop 2023-08-25T04:16:04.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.461+0000 7f458bd44640 1 -- 172.21.15.55:0/32557181 shutdown_connections 2023-08-25T04:16:04.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.461+0000 7f458bd44640 1 --2- 172.21.15.55:0/32557181 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f45680657a0 0x7f4568067c60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.461+0000 7f458bd44640 1 --2- 172.21.15.55:0/32557181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4584160f90 0x7f458415a7c0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.461+0000 7f458bd44640 1 --2- 172.21.15.55:0/32557181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f458415c9c0 0x7f458414c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.461+0000 7f458bd44640 1 --2- 172.21.15.55:0/32557181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45840cfa70 0x7f458414e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.461+0000 7f458bd44640 1 -- 172.21.15.55:0/32557181 >> 172.21.15.55:0/32557181 conn(0x7f45840d05a0 msgr2=0x7f45840ad170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:04.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.461+0000 7f458bd44640 1 -- 172.21.15.55:0/32557181 shutdown_connections 2023-08-25T04:16:04.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.461+0000 7f458bd44640 1 -- 172.21.15.55:0/32557181 wait complete. 2023-08-25T04:16:04.482 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-25T04:16:04.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.629+0000 7f2ebb703640 1 Processor -- start 2023-08-25T04:16:04.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.629+0000 7f2ebb703640 1 -- start start 2023-08-25T04:16:04.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.629+0000 7f2ebb703640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2eb406e5a0 0x7f2eb40cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:04.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.633+0000 7f2ebb703640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb40cab90 con 0x7f2eb406c790 2023-08-25T04:16:04.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.633+0000 7f2ebb703640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb406dbb0 con 0x7f2eb406c3b0 2023-08-25T04:16:04.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.633+0000 7f2ebb703640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb40cae50 con 0x7f2eb406e5a0 2023-08-25T04:16:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.633+0000 7f2eb9ca0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2eb406c790 0x7f2eb40ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45938/0 (socket says 172.21.15.55:45938) 2023-08-25T04:16:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.633+0000 7f2eb9ca0640 1 -- 172.21.15.55:0/3353783272 learned_addr learned my addr 172.21.15.55:0/3353783272 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:16:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.633+0000 7f2eb8c9e640 1 --2- 172.21.15.55:0/3353783272 >> v2:172.21.15.110:3300/0 conn(0x7f2eb406e5a0 0x7f2eb40cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.633+0000 7f2eabfff640 1 -- 172.21.15.55:0/3353783272 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772631858 0 0) 0x7f2eb40cab90 con 0x7f2eb406c790 2023-08-25T04:16:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.633+0000 7f2eabfff640 1 -- 172.21.15.55:0/3353783272 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ea0003530 con 0x7f2eb406c790 2023-08-25T04:16:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.633+0000 7f2eb8c9e640 1 -- 172.21.15.55:0/3353783272 >> v1:172.21.15.110:6789/0 conn(0x7f2eb406c3b0 legacy=0x7f2eb406de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.633+0000 7f2eabfff640 1 -- 172.21.15.55:0/3353783272 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236222525 0 0) 0x7f2eb406dbb0 con 0x7f2eb406c3b0 2023-08-25T04:16:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.633+0000 7f2eb8c9e640 1 -- 172.21.15.55:0/3353783272 >> v1:172.21.15.55:6789/0 conn(0x7f2eb406c790 legacy=0x7f2eb40ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.633+0000 7f2eb8c9e640 1 -- 172.21.15.55:0/3353783272 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb40cb130 con 0x7f2eb406e5a0 2023-08-25T04:16:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2eb8c9e640 1 --2- 172.21.15.55:0/3353783272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb406e5a0 0x7f2eb40cd7d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40097c0 tx=0x7f2ea401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2ee024463f827f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2eabfff640 1 -- 172.21.15.55:0/3353783272 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40a7070 con 0x7f2eb406e5a0 2023-08-25T04:16:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2eabfff640 1 -- 172.21.15.55:0/3353783272 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea40ab430 con 0x7f2eb406e5a0 2023-08-25T04:16:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2eabfff640 1 -- 172.21.15.55:0/3353783272 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40ab7c0 con 0x7f2eb406e5a0 2023-08-25T04:16:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2ebb703640 1 -- 172.21.15.55:0/3353783272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb406e5a0 msgr2=0x7f2eb40cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2ebb703640 1 --2- 172.21.15.55:0/3353783272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb406e5a0 0x7f2eb40cd7d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40097c0 tx=0x7f2ea401c450 comp rx=0 tx=0).stop 2023-08-25T04:16:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2ebb703640 1 -- 172.21.15.55:0/3353783272 shutdown_connections 2023-08-25T04:16:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2ebb703640 1 --2- 172.21.15.55:0/3353783272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb406e5a0 0x7f2eb40cd7d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2ebb703640 1 -- 172.21.15.55:0/3353783272 >> 172.21.15.55:0/3353783272 conn(0x7f2eb40d0540 msgr2=0x7f2eb40d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2ebb703640 1 -- 172.21.15.55:0/3353783272 shutdown_connections 2023-08-25T04:16:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2ebb703640 1 -- 172.21.15.55:0/3353783272 wait complete. 2023-08-25T04:16:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2ebb703640 1 Processor -- start 2023-08-25T04:16:04.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2ebb703640 1 -- start start 2023-08-25T04:16:04.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2ebb703640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2eb406c3b0 0x7f2eb41549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2ebb703640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2eb406c790 0x7f2eb40b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2ebb703640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb406e5a0 0x7f2eb415ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2ebb703640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb4154f30 con 0x7f2eb406c790 2023-08-25T04:16:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2ebb703640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb40b3580 con 0x7f2eb406e5a0 2023-08-25T04:16:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2ebb703640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb4157950 con 0x7f2eb406c3b0 2023-08-25T04:16:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.637+0000 7f2eb8c9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2eb406c790 0x7f2eb40b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.641+0000 7f2eb8c9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2eb406c790 0x7f2eb40b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40026/0 (socket says 172.21.15.55:40026) 2023-08-25T04:16:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.641+0000 7f2eb8c9e640 1 -- 172.21.15.55:0/1808494970 learned_addr learned my addr 172.21.15.55:0/1808494970 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:04.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.641+0000 7f2eb9ca0640 1 --2- 172.21.15.55:0/1808494970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb406e5a0 0x7f2eb415ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:04.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.641+0000 7f2eb949f640 1 --2- 172.21.15.55:0/1808494970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2eb406c3b0 0x7f2eb41549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:04.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.641+0000 7f2eb8c9e640 1 -- 172.21.15.55:0/1808494970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2eb406c3b0 msgr2=0x7f2eb41549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:04.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.641+0000 7f2eb8c9e640 1 --2- 172.21.15.55:0/1808494970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2eb406c3b0 0x7f2eb41549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.641+0000 7f2eb8c9e640 1 -- 172.21.15.55:0/1808494970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb406e5a0 msgr2=0x7f2eb415ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:04.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.641+0000 7f2eb8c9e640 1 --2- 172.21.15.55:0/1808494970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb406e5a0 0x7f2eb415ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:04.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.641+0000 7f2eb8c9e640 1 -- 172.21.15.55:0/1808494970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea4009420 con 0x7f2eb406c790 2023-08-25T04:16:04.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.641+0000 7f2eb9ca0640 1 --2- 172.21.15.55:0/1808494970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb406e5a0 0x7f2eb415ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:16:04.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.641+0000 7f2eb8c9e640 1 --2- 172.21.15.55:0/1808494970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2eb406c790 0x7f2eb40b5cf0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40ad040 tx=0x7f2ea401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:04.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.641+0000 7f2ea9ffb640 1 -- 172.21.15.55:0/1808494970 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40bf610 con 0x7f2eb406c790 2023-08-25T04:16:04.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.641+0000 7f2ea9ffb640 1 -- 172.21.15.55:0/1808494970 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea40bf770 con 0x7f2eb406c790 2023-08-25T04:16:04.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.641+0000 7f2ea9ffb640 1 -- 172.21.15.55:0/1808494970 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40bfb20 con 0x7f2eb406c790 2023-08-25T04:16:04.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.641+0000 7f2ebb703640 1 -- 172.21.15.55:0/1808494970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb415e200 con 0x7f2eb406c790 2023-08-25T04:16:04.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.641+0000 7f2ebb703640 1 -- 172.21.15.55:0/1808494970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb415f420 con 0x7f2eb406c790 2023-08-25T04:16:04.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.641+0000 7f2ebb703640 1 -- 172.21.15.55:0/1808494970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb4073ec0 con 0x7f2eb406c790 2023-08-25T04:16:04.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.641+0000 7f2ea9ffb640 1 -- 172.21.15.55:0/1808494970 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f2ea40bfc80 con 0x7f2eb406c790 2023-08-25T04:16:04.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.645+0000 7f2ea9ffb640 1 --2- 172.21.15.55:0/1808494970 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f2e980657a0 0x7f2e98067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.645+0000 7f2ea9ffb640 1 -- 172.21.15.55:0/1808494970 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2ea411d7d0 con 0x7f2eb406c790 2023-08-25T04:16:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.645+0000 7f2eb949f640 1 --2- 172.21.15.55:0/1808494970 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f2e980657a0 0x7f2e98067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.645+0000 7f2eb949f640 1 --2- 172.21.15.55:0/1808494970 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f2e980657a0 0x7f2e98067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0000fc0 tx=0x7f2eb0009040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.645+0000 7f2ea9ffb640 1 -- 172.21.15.55:0/1808494970 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2ea40eb2d0 con 0x7f2eb406c790 2023-08-25T04:16:04.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:04.841+0000 7f2ebb703640 1 -- 172.21.15.55:0/1808494970 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2eb415e470 con 0x7f2eb406c790 2023-08-25T04:16:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.781+0000 7f2ea9ffb640 1 -- 172.21.15.55:0/1808494970 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2ea40ee8f0 con 0x7f2eb406c790 2023-08-25T04:16:05.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.785+0000 7f2ebb703640 1 -- 172.21.15.55:0/1808494970 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f2e980657a0 msgr2=0x7f2e98067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:05.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.785+0000 7f2ebb703640 1 --2- 172.21.15.55:0/1808494970 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f2e980657a0 0x7f2e98067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0000fc0 tx=0x7f2eb0009040 comp rx=0 tx=0).stop 2023-08-25T04:16:05.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.785+0000 7f2ebb703640 1 -- 172.21.15.55:0/1808494970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2eb406c790 msgr2=0x7f2eb40b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:05.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.785+0000 7f2ebb703640 1 --2- 172.21.15.55:0/1808494970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2eb406c790 0x7f2eb40b5cf0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40ad040 tx=0x7f2ea401ac90 comp rx=0 tx=0).stop 2023-08-25T04:16:05.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.785+0000 7f2ebb703640 1 -- 172.21.15.55:0/1808494970 shutdown_connections 2023-08-25T04:16:05.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.785+0000 7f2ebb703640 1 --2- 172.21.15.55:0/1808494970 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f2e980657a0 0x7f2e98067c60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:05.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.785+0000 7f2ebb703640 1 --2- 172.21.15.55:0/1808494970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb406e5a0 0x7f2eb415ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:05.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.785+0000 7f2ebb703640 1 --2- 172.21.15.55:0/1808494970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2eb406c790 0x7f2eb40b5cf0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:05.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.785+0000 7f2ebb703640 1 --2- 172.21.15.55:0/1808494970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2eb406c3b0 0x7f2eb41549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:05.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.785+0000 7f2ebb703640 1 -- 172.21.15.55:0/1808494970 >> 172.21.15.55:0/1808494970 conn(0x7f2eb40d0540 msgr2=0x7f2eb40ad9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:05.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.785+0000 7f2ebb703640 1 -- 172.21.15.55:0/1808494970 shutdown_connections 2023-08-25T04:16:05.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.785+0000 7f2ebb703640 1 -- 172.21.15.55:0/1808494970 wait complete. 2023-08-25T04:16:05.807 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-25T04:16:05.808 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-25T04:16:05.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.957+0000 7fde1a574640 1 Processor -- start 2023-08-25T04:16:05.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.957+0000 7fde1a574640 1 -- start start 2023-08-25T04:16:05.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.957+0000 7fde1a574640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fde1406c020 0x7fde1409bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:05.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.957+0000 7fde1a574640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde1415abd0 con 0x7fde140c9830 2023-08-25T04:16:05.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde1a574640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde140c8ab0 con 0x7fde1415a7f0 2023-08-25T04:16:05.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde1a574640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde140c8d50 con 0x7fde1406c020 2023-08-25T04:16:05.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde137fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fde140c9830 0x7fde140acff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45950/0 (socket says 172.21.15.55:45950) 2023-08-25T04:16:05.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde137fe640 1 -- 172.21.15.55:0/3893162200 learned_addr learned my addr 172.21.15.55:0/3893162200 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:16:05.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde18b11640 1 --2- 172.21.15.55:0/3893162200 >> v2:172.21.15.110:3300/0 conn(0x7fde1406c020 0x7fde1409bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:05.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde12ffd640 1 -- 172.21.15.55:0/3893162200 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062322206 0 0) 0x7fde1415abd0 con 0x7fde140c9830 2023-08-25T04:16:05.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde12ffd640 1 -- 172.21.15.55:0/3893162200 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddfc003530 con 0x7fde140c9830 2023-08-25T04:16:05.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde12ffd640 1 -- 172.21.15.55:0/3893162200 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760107933 0 0) 0x7fde140c8ab0 con 0x7fde1415a7f0 2023-08-25T04:16:05.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde12ffd640 1 -- 172.21.15.55:0/3893162200 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde1415abd0 con 0x7fde1415a7f0 2023-08-25T04:16:05.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde12ffd640 1 -- 172.21.15.55:0/3893162200 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 811061553 0 0) 0x7fddfc003530 con 0x7fde140c9830 2023-08-25T04:16:05.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde12ffd640 1 -- 172.21.15.55:0/3893162200 >> v2:172.21.15.110:3300/0 conn(0x7fde1406c020 msgr2=0x7fde1409bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:05.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde12ffd640 1 --2- 172.21.15.55:0/3893162200 >> v2:172.21.15.110:3300/0 conn(0x7fde1406c020 0x7fde1409bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:05.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde12ffd640 1 -- 172.21.15.55:0/3893162200 >> v1:172.21.15.110:6789/0 conn(0x7fde1415a7f0 legacy=0x7fde14070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:05.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde12ffd640 1 -- 172.21.15.55:0/3893162200 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde140c9030 con 0x7fde140c9830 2023-08-25T04:16:05.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde12ffd640 1 -- 172.21.15.55:0/3893162200 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fde08001680 con 0x7fde140c9830 2023-08-25T04:16:05.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde12ffd640 1 -- 172.21.15.55:0/3893162200 >> v1:172.21.15.55:6789/0 conn(0x7fde140c9830 legacy=0x7fde140acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:05.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde12ffd640 1 --2- 172.21.15.55:0/3893162200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddfc003b10 0x7fddfc003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:05.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde12ffd640 1 --2- 172.21.15.55:0/3893162200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddfc0047d0 0x7fddfc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:05.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde12ffd640 1 --2- 172.21.15.55:0/3893162200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddfc005190 0x7fddfc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:05.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde12ffd640 1 -- 172.21.15.55:0/3893162200 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde140c8d50 con 0x7fddfc005190 2023-08-25T04:16:05.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde12ffd640 1 -- 172.21.15.55:0/3893162200 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc00c010 con 0x7fddfc0047d0 2023-08-25T04:16:05.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde12ffd640 1 -- 172.21.15.55:0/3893162200 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc00c1d0 con 0x7fddfc003b10 2023-08-25T04:16:05.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde18b11640 1 --2- 172.21.15.55:0/3893162200 >> v2:172.21.15.110:3300/0 conn(0x7fde1406c020 0x7fde1409bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:16:05.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde18b11640 1 --2- 172.21.15.55:0/3893162200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddfc005190 0x7fddfc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:05.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde137fe640 1 --2- 172.21.15.55:0/3893162200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddfc0047d0 0x7fddfc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:05.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde13fff640 1 --2- 172.21.15.55:0/3893162200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddfc003b10 0x7fddfc003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:05.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde18b11640 1 -- 172.21.15.55:0/3893162200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddfc003b10 msgr2=0x7fddfc003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:05.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde18b11640 1 --2- 172.21.15.55:0/3893162200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fddfc003b10 0x7fddfc003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:05.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde18b11640 1 -- 172.21.15.55:0/3893162200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddfc0047d0 msgr2=0x7fddfc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:05.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde18b11640 1 --2- 172.21.15.55:0/3893162200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddfc0047d0 0x7fddfc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:05.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.961+0000 7fde18b11640 1 -- 172.21.15.55:0/3893162200 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc003530 con 0x7fddfc005190 2023-08-25T04:16:05.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.965+0000 7fde18b11640 1 -- 172.21.15.55:0/3893162200 reap_dead start 2023-08-25T04:16:05.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.965+0000 7fde18b11640 1 --2- 172.21.15.55:0/3893162200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddfc005190 0x7fddfc00b990 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fde1409c320 tx=0x7fde0c01ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c13e410eb75506d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:05.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.965+0000 7fde12ffd640 1 -- 172.21.15.55:0/3893162200 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde08007ea0 con 0x7fddfc005190 2023-08-25T04:16:05.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.965+0000 7fde12ffd640 1 -- 172.21.15.55:0/3893162200 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0c00f040 con 0x7fddfc005190 2023-08-25T04:16:05.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.965+0000 7fde12ffd640 1 -- 172.21.15.55:0/3893162200 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0c0ad440 con 0x7fddfc005190 2023-08-25T04:16:05.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.965+0000 7fde1a574640 1 -- 172.21.15.55:0/3893162200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddfc005190 msgr2=0x7fddfc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:05.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.965+0000 7fde1a574640 1 --2- 172.21.15.55:0/3893162200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddfc005190 0x7fddfc00b990 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fde1409c320 tx=0x7fde0c01ce00 comp rx=0 tx=0).stop 2023-08-25T04:16:05.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.965+0000 7fde1a574640 1 -- 172.21.15.55:0/3893162200 shutdown_connections 2023-08-25T04:16:05.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.965+0000 7fde1a574640 1 --2- 172.21.15.55:0/3893162200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fddfc005190 0x7fddfc00b990 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:05.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.965+0000 7fde1a574640 1 -- 172.21.15.55:0/3893162200 >> 172.21.15.55:0/3893162200 conn(0x7fde14069900 msgr2=0x7fde14069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:05.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.965+0000 7fde1a574640 1 -- 172.21.15.55:0/3893162200 shutdown_connections 2023-08-25T04:16:05.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.965+0000 7fde1a574640 1 -- 172.21.15.55:0/3893162200 wait complete. 2023-08-25T04:16:05.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.965+0000 7fde1a574640 1 Processor -- start 2023-08-25T04:16:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.965+0000 7fde1a574640 1 -- start start 2023-08-25T04:16:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde1a574640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddfc005190 0x7fde140c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde1a574640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde14155d70 0x7fde140c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde1a574640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde140b12c0 0x7fde140b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde1a574640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde140b1ff0 con 0x7fde14155d70 2023-08-25T04:16:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde1a574640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde140b22d0 con 0x7fddfc005190 2023-08-25T04:16:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde1a574640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde140b25b0 con 0x7fde140b12c0 2023-08-25T04:16:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde137fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde14155d70 0x7fde140c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde137fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde14155d70 0x7fde140c7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40042/0 (socket says 172.21.15.55:40042) 2023-08-25T04:16:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde137fe640 1 -- 172.21.15.55:0/1499536686 learned_addr learned my addr 172.21.15.55:0/1499536686 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde13fff640 1 --2- 172.21.15.55:0/1499536686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddfc005190 0x7fde140c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde18b11640 1 --2- 172.21.15.55:0/1499536686 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde140b12c0 0x7fde140b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde137fe640 1 -- 172.21.15.55:0/1499536686 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde140b12c0 msgr2=0x7fde140b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde137fe640 1 --2- 172.21.15.55:0/1499536686 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde140b12c0 0x7fde140b1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde137fe640 1 -- 172.21.15.55:0/1499536686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddfc005190 msgr2=0x7fde140c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde137fe640 1 --2- 172.21.15.55:0/1499536686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddfc005190 0x7fde140c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde137fe640 1 -- 172.21.15.55:0/1499536686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde140b2890 con 0x7fde14155d70 2023-08-25T04:16:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde137fe640 1 --2- 172.21.15.55:0/1499536686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde14155d70 0x7fde140c7ba0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fde08012540 tx=0x7fde08012940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde10ff9640 1 -- 172.21.15.55:0/1499536686 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde08014750 con 0x7fde14155d70 2023-08-25T04:16:05.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde10ff9640 1 -- 172.21.15.55:0/1499536686 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde080148b0 con 0x7fde14155d70 2023-08-25T04:16:05.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde10ff9640 1 -- 172.21.15.55:0/1499536686 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde08014c60 con 0x7fde14155d70 2023-08-25T04:16:05.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde1a574640 1 -- 172.21.15.55:0/1499536686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde140b2b70 con 0x7fde14155d70 2023-08-25T04:16:05.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde1a574640 1 -- 172.21.15.55:0/1499536686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde14099430 con 0x7fde14155d70 2023-08-25T04:16:05.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde1a574640 1 -- 172.21.15.55:0/1499536686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1406d5b0 con 0x7fde14155d70 2023-08-25T04:16:05.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.969+0000 7fde10ff9640 1 -- 172.21.15.55:0/1499536686 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fde080153e0 con 0x7fde14155d70 2023-08-25T04:16:05.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.973+0000 7fde10ff9640 1 --2- 172.21.15.55:0/1499536686 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fde000657a0 0x7fde00067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:05.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.973+0000 7fde10ff9640 1 -- 172.21.15.55:0/1499536686 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde08085720 con 0x7fde14155d70 2023-08-25T04:16:05.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.973+0000 7fde13fff640 1 --2- 172.21.15.55:0/1499536686 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fde000657a0 0x7fde00067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:05.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.973+0000 7fde13fff640 1 --2- 172.21.15.55:0/1499536686 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fde000657a0 0x7fde00067c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fde04000c10 tx=0x7fde04009040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:05.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:05.977+0000 7fde10ff9640 1 -- 172.21.15.55:0/1499536686 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fde08053230 con 0x7fde14155d70 2023-08-25T04:16:06.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.165+0000 7fde1a574640 1 -- 172.21.15.55:0/1499536686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fde14073ec0 con 0x7fde14155d70 2023-08-25T04:16:06.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.801+0000 7fde10ff9640 1 -- 172.21.15.55:0/1499536686 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7fde0805ae60 con 0x7fde14155d70 2023-08-25T04:16:06.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.805+0000 7fde1a574640 1 -- 172.21.15.55:0/1499536686 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fde000657a0 msgr2=0x7fde00067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:06.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.805+0000 7fde1a574640 1 --2- 172.21.15.55:0/1499536686 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fde000657a0 0x7fde00067c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fde04000c10 tx=0x7fde04009040 comp rx=0 tx=0).stop 2023-08-25T04:16:06.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.805+0000 7fde1a574640 1 -- 172.21.15.55:0/1499536686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde14155d70 msgr2=0x7fde140c7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:06.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.805+0000 7fde1a574640 1 --2- 172.21.15.55:0/1499536686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde14155d70 0x7fde140c7ba0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fde08012540 tx=0x7fde08012940 comp rx=0 tx=0).stop 2023-08-25T04:16:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.805+0000 7fde1a574640 1 -- 172.21.15.55:0/1499536686 shutdown_connections 2023-08-25T04:16:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.805+0000 7fde1a574640 1 --2- 172.21.15.55:0/1499536686 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fde000657a0 0x7fde00067c60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.805+0000 7fde1a574640 1 --2- 172.21.15.55:0/1499536686 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde140b12c0 0x7fde140b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.805+0000 7fde1a574640 1 --2- 172.21.15.55:0/1499536686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde14155d70 0x7fde140c7ba0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:06.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.805+0000 7fde1a574640 1 --2- 172.21.15.55:0/1499536686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fddfc005190 0x7fde140c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:06.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.805+0000 7fde1a574640 1 -- 172.21.15.55:0/1499536686 >> 172.21.15.55:0/1499536686 conn(0x7fde14069900 msgr2=0x7fde140cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:06.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.805+0000 7fde1a574640 1 -- 172.21.15.55:0/1499536686 shutdown_connections 2023-08-25T04:16:06.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.805+0000 7fde1a574640 1 -- 172.21.15.55:0/1499536686 wait complete. 2023-08-25T04:16:06.826 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-25T04:16:06.827 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:16:06.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.977+0000 7f58fb25c640 1 Processor -- start 2023-08-25T04:16:06.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.977+0000 7f58fb25c640 1 -- start start 2023-08-25T04:16:06.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.977+0000 7f58fb25c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58f40cdde0 0x7f58f40ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:06.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.977+0000 7f58fb25c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f58f40b2e40 0x7f58f40b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:06.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.977+0000 7f58fb25c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f40b29b0 con 0x7f58f40d0da0 2023-08-25T04:16:06.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.977+0000 7f58fb25c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f40ce760 con 0x7f58f40b2e40 2023-08-25T04:16:06.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.977+0000 7f58fb25c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40b1dc0 con 0x7f58f40cdde0 2023-08-25T04:16:06.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.977+0000 7f58f8ff8640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f58f40d0da0 0x7f58f40d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45958/0 (socket says 172.21.15.55:45958) 2023-08-25T04:16:06.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.977+0000 7f58f8ff8640 1 -- 172.21.15.55:0/2088363339 learned_addr learned my addr 172.21.15.55:0/2088363339 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:16:06.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.977+0000 7f58ebfff640 1 --2- 172.21.15.55:0/2088363339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58f40cdde0 0x7f58f40ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:06.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.977+0000 7f58f97f9640 1 --2- 172.21.15.55:0/2088363339 >> v2:172.21.15.110:3300/0 conn(0x7f58f40b2e40 0x7f58f40b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:06.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.977+0000 7f58eb7fe640 1 -- 172.21.15.55:0/2088363339 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3540252386 0 0) 0x7f58f40b29b0 con 0x7f58f40d0da0 2023-08-25T04:16:06.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.977+0000 7f58eb7fe640 1 -- 172.21.15.55:0/2088363339 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58dc003530 con 0x7f58f40d0da0 2023-08-25T04:16:06.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58eb7fe640 1 -- 172.21.15.55:0/2088363339 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1929746955 0 0) 0x7f58dc003530 con 0x7f58f40d0da0 2023-08-25T04:16:06.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58eb7fe640 1 -- 172.21.15.55:0/2088363339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58f40cdde0 msgr2=0x7f58f40ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:06.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58eb7fe640 1 --2- 172.21.15.55:0/2088363339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58f40cdde0 0x7f58f40ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:06.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58eb7fe640 1 -- 172.21.15.55:0/2088363339 >> v2:172.21.15.110:3300/0 conn(0x7f58f40b2e40 msgr2=0x7f58f40b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:06.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58eb7fe640 1 --2- 172.21.15.55:0/2088363339 >> v2:172.21.15.110:3300/0 conn(0x7f58f40b2e40 0x7f58f40b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:06.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58eb7fe640 1 -- 172.21.15.55:0/2088363339 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f40b2080 con 0x7f58f40d0da0 2023-08-25T04:16:06.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58eb7fe640 1 -- 172.21.15.55:0/2088363339 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f58f0001800 con 0x7f58f40d0da0 2023-08-25T04:16:06.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58eb7fe640 1 -- 172.21.15.55:0/2088363339 >> v1:172.21.15.55:6789/0 conn(0x7f58f40d0da0 legacy=0x7f58f40d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:06.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58eb7fe640 1 --2- 172.21.15.55:0/2088363339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58f40cdde0 0x7f58dc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:06.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58eb7fe640 1 --2- 172.21.15.55:0/2088363339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58dc003f00 0x7f58dc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:06.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58eb7fe640 1 --2- 172.21.15.55:0/2088363339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58dc004d10 0x7f58dc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:06.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58eb7fe640 1 -- 172.21.15.55:0/2088363339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40ce760 con 0x7f58dc003f00 2023-08-25T04:16:06.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58eb7fe640 1 -- 172.21.15.55:0/2088363339 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40b1dc0 con 0x7f58dc004d10 2023-08-25T04:16:06.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58eb7fe640 1 -- 172.21.15.55:0/2088363339 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc00b9c0 con 0x7f58f40cdde0 2023-08-25T04:16:06.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58ebfff640 1 --2- 172.21.15.55:0/2088363339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58dc003f00 0x7f58dc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:06.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58f8ff8640 1 --2- 172.21.15.55:0/2088363339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58f40cdde0 0x7f58dc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:06.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58f97f9640 1 --2- 172.21.15.55:0/2088363339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58dc004d10 0x7f58dc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:06.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58ebfff640 1 -- 172.21.15.55:0/2088363339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58f40cdde0 msgr2=0x7f58dc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:06.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58ebfff640 1 --2- 172.21.15.55:0/2088363339 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58f40cdde0 0x7f58dc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:06.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58ebfff640 1 -- 172.21.15.55:0/2088363339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58dc004d10 msgr2=0x7f58dc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:06.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58ebfff640 1 --2- 172.21.15.55:0/2088363339 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58dc004d10 0x7f58dc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:06.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58ebfff640 1 -- 172.21.15.55:0/2088363339 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc003530 con 0x7f58dc003f00 2023-08-25T04:16:06.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.981+0000 7f58ebfff640 1 --2- 172.21.15.55:0/2088363339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58dc003f00 0x7f58dc0047d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009ae0 tx=0x7f58e401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809a077bfe5d2f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:06.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58eb7fe640 1 -- 172.21.15.55:0/2088363339 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e40a5640 con 0x7f58dc003f00 2023-08-25T04:16:06.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58eb7fe640 1 -- 172.21.15.55:0/2088363339 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e40a57a0 con 0x7f58dc003f00 2023-08-25T04:16:06.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58eb7fe640 1 -- 172.21.15.55:0/2088363339 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e40a5b50 con 0x7f58dc003f00 2023-08-25T04:16:06.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58fb25c640 1 -- 172.21.15.55:0/2088363339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58dc003f00 msgr2=0x7f58dc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:06.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58fb25c640 1 --2- 172.21.15.55:0/2088363339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58dc003f00 0x7f58dc0047d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009ae0 tx=0x7f58e401ca50 comp rx=0 tx=0).stop 2023-08-25T04:16:06.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58f97f9640 1 -- 172.21.15.55:0/2088363339 reap_dead start 2023-08-25T04:16:06.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58fb25c640 1 -- 172.21.15.55:0/2088363339 shutdown_connections 2023-08-25T04:16:06.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58fb25c640 1 -- 172.21.15.55:0/2088363339 >> 172.21.15.55:0/2088363339 conn(0x7f58f409bae0 msgr2=0x7f58f40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:06.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58fb25c640 1 -- 172.21.15.55:0/2088363339 shutdown_connections 2023-08-25T04:16:06.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58fb25c640 1 -- 172.21.15.55:0/2088363339 wait complete. 2023-08-25T04:16:06.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58fb25c640 1 Processor -- start 2023-08-25T04:16:06.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58fb25c640 1 -- start start 2023-08-25T04:16:06.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58fb25c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58dc003f00 0x7f58f41517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:06.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58fb25c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58f40cb830 0x7f58f40cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:06.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58fb25c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58f40c62f0 0x7f58f40c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:06.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58fb25c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40c6cb0 con 0x7f58dc003f00 2023-08-25T04:16:06.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58fb25c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40cb430 con 0x7f58f40c62f0 2023-08-25T04:16:06.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58fb25c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40cafa0 con 0x7f58f40cb830 2023-08-25T04:16:06.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58f8ff8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58dc003f00 0x7f58f41517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:06.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58f8ff8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58dc003f00 0x7f58f41517f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40050/0 (socket says 172.21.15.55:40050) 2023-08-25T04:16:06.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.985+0000 7f58f8ff8640 1 -- 172.21.15.55:0/2649096578 learned_addr learned my addr 172.21.15.55:0/2649096578 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:06.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.989+0000 7f58ebfff640 1 --2- 172.21.15.55:0/2649096578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58f40cb830 0x7f58f40cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:06.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.989+0000 7f58f97f9640 1 --2- 172.21.15.55:0/2649096578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58f40c62f0 0x7f58f40c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:06.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.989+0000 7f58f8ff8640 1 -- 172.21.15.55:0/2649096578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58f40cb830 msgr2=0x7f58f40cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:06.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.989+0000 7f58f8ff8640 1 --2- 172.21.15.55:0/2649096578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58f40cb830 0x7f58f40cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:06.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.989+0000 7f58f8ff8640 1 -- 172.21.15.55:0/2649096578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58f40c62f0 msgr2=0x7f58f40c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:06.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.989+0000 7f58f8ff8640 1 --2- 172.21.15.55:0/2649096578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58f40c62f0 0x7f58f40c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:06.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.989+0000 7f58f8ff8640 1 -- 172.21.15.55:0/2649096578 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f40ca3d0 con 0x7f58dc003f00 2023-08-25T04:16:06.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.989+0000 7f58f97f9640 1 --2- 172.21.15.55:0/2649096578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58f40c62f0 0x7f58f40c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:16:06.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.989+0000 7f58f8ff8640 1 --2- 172.21.15.55:0/2649096578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58dc003f00 0x7f58f41517f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f58f000f890 tx=0x7f58f000fd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:06.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.989+0000 7f58e97fa640 1 -- 172.21.15.55:0/2649096578 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f00072e0 con 0x7f58dc003f00 2023-08-25T04:16:06.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.989+0000 7f58e97fa640 1 -- 172.21.15.55:0/2649096578 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f0007440 con 0x7f58dc003f00 2023-08-25T04:16:06.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.989+0000 7f58e97fa640 1 -- 172.21.15.55:0/2649096578 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f00057b0 con 0x7f58dc003f00 2023-08-25T04:16:06.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.989+0000 7f58fb25c640 1 -- 172.21.15.55:0/2649096578 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f40ca670 con 0x7f58dc003f00 2023-08-25T04:16:06.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.989+0000 7f58fb25c640 1 -- 172.21.15.55:0/2649096578 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f40cac30 con 0x7f58dc003f00 2023-08-25T04:16:06.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.989+0000 7f58fb25c640 1 -- 172.21.15.55:0/2649096578 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f40cadc0 con 0x7f58dc003f00 2023-08-25T04:16:06.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.989+0000 7f58e97fa640 1 -- 172.21.15.55:0/2649096578 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f58f0005910 con 0x7f58dc003f00 2023-08-25T04:16:06.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.989+0000 7f58e97fa640 1 --2- 172.21.15.55:0/2649096578 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f58e00657a0 0x7f58e0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:06.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.989+0000 7f58e97fa640 1 -- 172.21.15.55:0/2649096578 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f58f0082ff0 con 0x7f58dc003f00 2023-08-25T04:16:06.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.993+0000 7f58ebfff640 1 --2- 172.21.15.55:0/2649096578 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f58e00657a0 0x7f58e0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:06.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.993+0000 7f58ebfff640 1 --2- 172.21.15.55:0/2649096578 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f58e00657a0 0x7f58e0067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f58e40af000 tx=0x7f58e40046d0 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:06.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:06.993+0000 7f58e97fa640 1 -- 172.21.15.55:0/2649096578 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f58f00b3d90 con 0x7f58dc003f00 2023-08-25T04:16:07.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.185+0000 7f58fb25c640 1 -- 172.21.15.55:0/2649096578 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58f404dbe0 con 0x7f58dc003f00 2023-08-25T04:16:07.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.185+0000 7f58e97fa640 1 -- 172.21.15.55:0/2649096578 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4875 (secure 0 0 0) 0x7f58f0054440 con 0x7f58dc003f00 2023-08-25T04:16:07.185 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:16:07.185 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3163426480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3163426480},{"type":"v1","addr":"172.21.15.55:6835","nonce":3163426480}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/397210265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":397210265},{"type":"v1","addr":"172.21.15.110:6836","nonce":397210265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6198,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/894580528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":894580528},{"type":"v1","addr":"172.21.15.55:6834","nonce":894580528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:16:03.155108+0000","modified":"2023-08-25T04:16:06.786907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6837/1578265172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1578265172},{"type":"v1","addr":"172.21.15.110:6837","nonce":1578265172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-25T04:16:07.185 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 24 2023-08-25T04:16:07.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.185+0000 7f58fb25c640 1 -- 172.21.15.55:0/2649096578 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f58e00657a0 msgr2=0x7f58e0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:07.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.185+0000 7f58fb25c640 1 --2- 172.21.15.55:0/2649096578 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f58e00657a0 0x7f58e0067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f58e40af000 tx=0x7f58e40046d0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.185+0000 7f58fb25c640 1 -- 172.21.15.55:0/2649096578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58dc003f00 msgr2=0x7f58f41517f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:07.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.185+0000 7f58fb25c640 1 --2- 172.21.15.55:0/2649096578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58dc003f00 0x7f58f41517f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f58f000f890 tx=0x7f58f000fd50 comp rx=0 tx=0).stop 2023-08-25T04:16:07.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.185+0000 7f58fb25c640 1 -- 172.21.15.55:0/2649096578 shutdown_connections 2023-08-25T04:16:07.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.185+0000 7f58fb25c640 1 --2- 172.21.15.55:0/2649096578 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f58e00657a0 0x7f58e0067c60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.185+0000 7f58fb25c640 1 --2- 172.21.15.55:0/2649096578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58f40c62f0 0x7f58f40c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.189+0000 7f58fb25c640 1 --2- 172.21.15.55:0/2649096578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58f40cb830 0x7f58f40cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.189+0000 7f58fb25c640 1 --2- 172.21.15.55:0/2649096578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58dc003f00 0x7f58f41517f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.189+0000 7f58fb25c640 1 -- 172.21.15.55:0/2649096578 >> 172.21.15.55:0/2649096578 conn(0x7f58f409bae0 msgr2=0x7f58f40cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:07.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.189+0000 7f58fb25c640 1 -- 172.21.15.55:0/2649096578 shutdown_connections 2023-08-25T04:16:07.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.189+0000 7f58fb25c640 1 -- 172.21.15.55:0/2649096578 wait complete. 2023-08-25T04:16:07.206 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:16:07.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.349+0000 7f8f74c26640 1 Processor -- start 2023-08-25T04:16:07.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.349+0000 7f8f74c26640 1 -- start start 2023-08-25T04:16:07.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.349+0000 7f8f74c26640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f7006c2c0 0x7f8f70167840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:07.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.349+0000 7f8f74c26640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f70161330 con 0x7f8f7015c9c0 2023-08-25T04:16:07.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.349+0000 7f8f74c26640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f7006eaf0 con 0x7f8f700cfa70 2023-08-25T04:16:07.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.349+0000 7f8f74c26640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7006e530 con 0x7f8f7006c2c0 2023-08-25T04:16:07.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.349+0000 7f8f6e59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8f7015c9c0 0x7f8f70160510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45964/0 (socket says 172.21.15.55:45964) 2023-08-25T04:16:07.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.349+0000 7f8f6e59c640 1 -- 172.21.15.55:0/1723248191 learned_addr learned my addr 172.21.15.55:0/1723248191 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:16:07.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.349+0000 7f8f6ed9d640 1 --2- 172.21.15.55:0/1723248191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f7006c2c0 0x7f8f70167840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:07.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.349+0000 7f8f6dd9b640 1 -- 172.21.15.55:0/1723248191 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2797323397 0 0) 0x7f8f70161330 con 0x7f8f7015c9c0 2023-08-25T04:16:07.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.349+0000 7f8f6dd9b640 1 -- 172.21.15.55:0/1723248191 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f5c003530 con 0x7f8f7015c9c0 2023-08-25T04:16:07.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6dd9b640 1 -- 172.21.15.55:0/1723248191 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 443728769 0 0) 0x7f8f5c003530 con 0x7f8f7015c9c0 2023-08-25T04:16:07.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6dd9b640 1 -- 172.21.15.55:0/1723248191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f7006c2c0 msgr2=0x7f8f70167840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:07.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6dd9b640 1 --2- 172.21.15.55:0/1723248191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f7006c2c0 0x7f8f70167840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6dd9b640 1 -- 172.21.15.55:0/1723248191 >> v1:172.21.15.110:6789/0 conn(0x7f8f700cfa70 legacy=0x7f8f70160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:07.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6dd9b640 1 -- 172.21.15.55:0/1723248191 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7006e810 con 0x7f8f7015c9c0 2023-08-25T04:16:07.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6dd9b640 1 -- 172.21.15.55:0/1723248191 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f8f60001800 con 0x7f8f7015c9c0 2023-08-25T04:16:07.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6dd9b640 1 -- 172.21.15.55:0/1723248191 >> v1:172.21.15.55:6789/0 conn(0x7f8f7015c9c0 legacy=0x7f8f70160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:07.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6dd9b640 1 --2- 172.21.15.55:0/1723248191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f5c0039b0 0x7f8f5c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:07.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6dd9b640 1 --2- 172.21.15.55:0/1723248191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f7006c2c0 0x7f8f5c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:07.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6dd9b640 1 --2- 172.21.15.55:0/1723248191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c004d10 0x7f8f5c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:07.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6dd9b640 1 -- 172.21.15.55:0/1723248191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7006e530 con 0x7f8f5c004d10 2023-08-25T04:16:07.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6dd9b640 1 -- 172.21.15.55:0/1723248191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c00b990 con 0x7f8f5c0039b0 2023-08-25T04:16:07.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6dd9b640 1 -- 172.21.15.55:0/1723248191 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c00bb50 con 0x7f8f7006c2c0 2023-08-25T04:16:07.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6ed9d640 1 --2- 172.21.15.55:0/1723248191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c004d10 0x7f8f5c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:07.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6e59c640 1 --2- 172.21.15.55:0/1723248191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f5c0039b0 0x7f8f5c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:07.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f67fff640 1 --2- 172.21.15.55:0/1723248191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f7006c2c0 0x7f8f5c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:07.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6e59c640 1 -- 172.21.15.55:0/1723248191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f7006c2c0 msgr2=0x7f8f5c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:07.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6e59c640 1 --2- 172.21.15.55:0/1723248191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f7006c2c0 0x7f8f5c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6e59c640 1 -- 172.21.15.55:0/1723248191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c004d10 msgr2=0x7f8f5c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:07.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6e59c640 1 --2- 172.21.15.55:0/1723248191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c004d10 0x7f8f5c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6e59c640 1 -- 172.21.15.55:0/1723248191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c003530 con 0x7f8f5c0039b0 2023-08-25T04:16:07.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.353+0000 7f8f6ed9d640 1 --2- 172.21.15.55:0/1723248191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c004d10 0x7f8f5c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:16:07.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.357+0000 7f8f6e59c640 1 --2- 172.21.15.55:0/1723248191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f5c0039b0 0x7f8f5c003d90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000c190 tx=0x7f8f6001f270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=682d92dd6f557fb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:07.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.357+0000 7f8f6dd9b640 1 -- 172.21.15.55:0/1723248191 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f600a8e90 con 0x7f8f5c0039b0 2023-08-25T04:16:07.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.357+0000 7f8f6dd9b640 1 -- 172.21.15.55:0/1723248191 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f60007070 con 0x7f8f5c0039b0 2023-08-25T04:16:07.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.357+0000 7f8f6dd9b640 1 -- 172.21.15.55:0/1723248191 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60007420 con 0x7f8f5c0039b0 2023-08-25T04:16:07.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.357+0000 7f8f74c26640 1 -- 172.21.15.55:0/1723248191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f5c0039b0 msgr2=0x7f8f5c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:07.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.357+0000 7f8f74c26640 1 --2- 172.21.15.55:0/1723248191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f5c0039b0 0x7f8f5c003d90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000c190 tx=0x7f8f6001f270 comp rx=0 tx=0).stop 2023-08-25T04:16:07.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.357+0000 7f8f6ed9d640 1 -- 172.21.15.55:0/1723248191 reap_dead start 2023-08-25T04:16:07.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.357+0000 7f8f74c26640 1 -- 172.21.15.55:0/1723248191 shutdown_connections 2023-08-25T04:16:07.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.357+0000 7f8f74c26640 1 -- 172.21.15.55:0/1723248191 >> 172.21.15.55:0/1723248191 conn(0x7f8f700d05a0 msgr2=0x7f8f700d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:07.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.357+0000 7f8f74c26640 1 -- 172.21.15.55:0/1723248191 shutdown_connections 2023-08-25T04:16:07.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.357+0000 7f8f74c26640 1 -- 172.21.15.55:0/1723248191 wait complete. 2023-08-25T04:16:07.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.357+0000 7f8f74c26640 1 Processor -- start 2023-08-25T04:16:07.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.357+0000 7f8f74c26640 1 -- start start 2023-08-25T04:16:07.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f74c26640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c0039b0 0x7f8f700b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:07.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f74c26640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f700c6b20 0x7f8f700b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:07.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f74c26640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f700b5550 0x7f8f70151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:07.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f74c26640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f700b5a00 con 0x7f8f5c0039b0 2023-08-25T04:16:07.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f74c26640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f700c5b10 con 0x7f8f700c6b20 2023-08-25T04:16:07.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f74c26640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f700c5d60 con 0x7f8f700b5550 2023-08-25T04:16:07.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f6e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c0039b0 0x7f8f700b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:07.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f6e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c0039b0 0x7f8f700b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40072/0 (socket says 172.21.15.55:40072) 2023-08-25T04:16:07.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f6e59c640 1 -- 172.21.15.55:0/2681097530 learned_addr learned my addr 172.21.15.55:0/2681097530 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:07.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f6e59c640 1 -- 172.21.15.55:0/2681097530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f700b5550 msgr2=0x7f8f70151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:07.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f6e59c640 1 --2- 172.21.15.55:0/2681097530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f700b5550 0x7f8f70151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f6e59c640 1 -- 172.21.15.55:0/2681097530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f700c6b20 msgr2=0x7f8f700b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:07.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f6e59c640 1 --2- 172.21.15.55:0/2681097530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f700c6b20 0x7f8f700b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f6e59c640 1 -- 172.21.15.55:0/2681097530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f700c6040 con 0x7f8f5c0039b0 2023-08-25T04:16:07.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f6e59c640 1 --2- 172.21.15.55:0/2681097530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c0039b0 0x7f8f700b0c30 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000c190 tx=0x7f8f5c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:07.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f66ffd640 1 -- 172.21.15.55:0/2681097530 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f600b7070 con 0x7f8f5c0039b0 2023-08-25T04:16:07.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f66ffd640 1 -- 172.21.15.55:0/2681097530 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f60000f80 con 0x7f8f5c0039b0 2023-08-25T04:16:07.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f66ffd640 1 -- 172.21.15.55:0/2681097530 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60001800 con 0x7f8f5c0039b0 2023-08-25T04:16:07.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f74c26640 1 -- 172.21.15.55:0/2681097530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f700c6320 con 0x7f8f5c0039b0 2023-08-25T04:16:07.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f74c26640 1 -- 172.21.15.55:0/2681097530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f70146bb0 con 0x7f8f5c0039b0 2023-08-25T04:16:07.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f74c26640 1 -- 172.21.15.55:0/2681097530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f70146da0 con 0x7f8f5c0039b0 2023-08-25T04:16:07.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.361+0000 7f8f66ffd640 1 -- 172.21.15.55:0/2681097530 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f8f600057b0 con 0x7f8f5c0039b0 2023-08-25T04:16:07.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.365+0000 7f8f66ffd640 1 --2- 172.21.15.55:0/2681097530 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f8f500657d0 0x7f8f50067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:07.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.365+0000 7f8f66ffd640 1 -- 172.21.15.55:0/2681097530 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8f6011fe70 con 0x7f8f5c0039b0 2023-08-25T04:16:07.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.365+0000 7f8f67fff640 1 --2- 172.21.15.55:0/2681097530 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f8f500657d0 0x7f8f50067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:07.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.365+0000 7f8f67fff640 1 --2- 172.21.15.55:0/2681097530 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f8f500657d0 0x7f8f50067c90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8f58000c10 tx=0x7f8f58009040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:07.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.369+0000 7f8f66ffd640 1 -- 172.21.15.55:0/2681097530 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8f600ed6f0 con 0x7f8f5c0039b0 2023-08-25T04:16:07.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.525+0000 7f8f74c26640 1 -- 172.21.15.55:0/2681097530 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f700c5ea0 con 0x7f8f5c0039b0 2023-08-25T04:16:07.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.525+0000 7f8f66ffd640 1 -- 172.21.15.55:0/2681097530 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f8f700c5ea0 con 0x7f8f5c0039b0 2023-08-25T04:16:07.525 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:16:07.525 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":62,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:16:04.743829+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:16:00.903688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-25T04:16:02.143304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:16:07.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.525+0000 7f8f74c26640 1 -- 172.21.15.55:0/2681097530 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f8f500657d0 msgr2=0x7f8f50067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:07.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.525+0000 7f8f74c26640 1 --2- 172.21.15.55:0/2681097530 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f8f500657d0 0x7f8f50067c90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8f58000c10 tx=0x7f8f58009040 comp rx=0 tx=0).stop 2023-08-25T04:16:07.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.525+0000 7f8f74c26640 1 -- 172.21.15.55:0/2681097530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c0039b0 msgr2=0x7f8f700b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:07.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.525+0000 7f8f74c26640 1 --2- 172.21.15.55:0/2681097530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c0039b0 0x7f8f700b0c30 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000c190 tx=0x7f8f5c005800 comp rx=0 tx=0).stop 2023-08-25T04:16:07.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.525+0000 7f8f74c26640 1 -- 172.21.15.55:0/2681097530 shutdown_connections 2023-08-25T04:16:07.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.525+0000 7f8f74c26640 1 --2- 172.21.15.55:0/2681097530 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f8f500657d0 0x7f8f50067c90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.525+0000 7f8f74c26640 1 --2- 172.21.15.55:0/2681097530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f700b5550 0x7f8f70151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.525+0000 7f8f74c26640 1 --2- 172.21.15.55:0/2681097530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f700c6b20 0x7f8f700b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.525+0000 7f8f74c26640 1 --2- 172.21.15.55:0/2681097530 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f5c0039b0 0x7f8f700b0c30 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.525+0000 7f8f74c26640 1 -- 172.21.15.55:0/2681097530 >> 172.21.15.55:0/2681097530 conn(0x7f8f700d05a0 msgr2=0x7f8f700ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:07.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.525+0000 7f8f74c26640 1 -- 172.21.15.55:0/2681097530 shutdown_connections 2023-08-25T04:16:07.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.529+0000 7f8f74c26640 1 -- 172.21.15.55:0/2681097530 wait complete. 2023-08-25T04:16:07.546 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-25T04:16:07.547 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:16:07.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.689+0000 7f433a2d8640 1 Processor -- start 2023-08-25T04:16:07.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.689+0000 7f433a2d8640 1 -- start start 2023-08-25T04:16:07.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.693+0000 7f433a2d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f43340b12c0 0x7f433406c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:07.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.693+0000 7f433a2d8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43340afe20 con 0x7f43340d1120 2023-08-25T04:16:07.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.693+0000 7f433a2d8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43340af210 con 0x7f433415ca50 2023-08-25T04:16:07.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.693+0000 7f433a2d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43340af4f0 con 0x7f43340b12c0 2023-08-25T04:16:07.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.693+0000 7f4338ad5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f43340d1120 0x7f433406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45976/0 (socket says 172.21.15.55:45976) 2023-08-25T04:16:07.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.693+0000 7f4338ad5640 1 -- 172.21.15.55:0/537435196 learned_addr learned my addr 172.21.15.55:0/537435196 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:16:07.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.693+0000 7f4339ad7640 1 --2- 172.21.15.55:0/537435196 >> v2:172.21.15.55:3300/0 conn(0x7f43340b12c0 0x7f433406c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:07.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.693+0000 7f4339ad7640 1 -- 172.21.15.55:0/537435196 >> v1:172.21.15.110:6789/0 conn(0x7f433415ca50 legacy=0x7f43340d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:07.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.693+0000 7f4339ad7640 1 -- 172.21.15.55:0/537435196 >> v1:172.21.15.55:6789/0 conn(0x7f43340d1120 legacy=0x7f433406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:07.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.693+0000 7f4339ad7640 1 -- 172.21.15.55:0/537435196 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43340af7d0 con 0x7f43340b12c0 2023-08-25T04:16:07.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f4339ad7640 1 --2- 172.21.15.55:0/537435196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43340b12c0 0x7f433406c320 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f432c009d90 tx=0x7f432c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcc6be90c527fed server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:07.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f432bfff640 1 -- 172.21.15.55:0/537435196 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c0a5a00 con 0x7f43340b12c0 2023-08-25T04:16:07.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f432bfff640 1 -- 172.21.15.55:0/537435196 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c0a5b60 con 0x7f43340b12c0 2023-08-25T04:16:07.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f432bfff640 1 -- 172.21.15.55:0/537435196 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c0ad440 con 0x7f43340b12c0 2023-08-25T04:16:07.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f433a2d8640 1 -- 172.21.15.55:0/537435196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43340b12c0 msgr2=0x7f433406c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:07.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f433a2d8640 1 --2- 172.21.15.55:0/537435196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43340b12c0 0x7f433406c320 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f432c009d90 tx=0x7f432c01c920 comp rx=0 tx=0).stop 2023-08-25T04:16:07.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f433a2d8640 1 -- 172.21.15.55:0/537435196 shutdown_connections 2023-08-25T04:16:07.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f433a2d8640 1 --2- 172.21.15.55:0/537435196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43340b12c0 0x7f433406c320 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f433a2d8640 1 -- 172.21.15.55:0/537435196 >> 172.21.15.55:0/537435196 conn(0x7f4334065f40 msgr2=0x7f433409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:07.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f433a2d8640 1 -- 172.21.15.55:0/537435196 shutdown_connections 2023-08-25T04:16:07.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f433a2d8640 1 -- 172.21.15.55:0/537435196 wait complete. 2023-08-25T04:16:07.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f433a2d8640 1 Processor -- start 2023-08-25T04:16:07.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f433a2d8640 1 -- start start 2023-08-25T04:16:07.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f433a2d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43340b12c0 0x7f4334153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:07.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f433a2d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43340d1120 0x7f43341f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:07.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f433a2d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f433415ca50 0x7f433415d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:07.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f433a2d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4334153870 con 0x7f433415ca50 2023-08-25T04:16:07.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f433a2d8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43340ce650 con 0x7f43340b12c0 2023-08-25T04:16:07.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.697+0000 7f433a2d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43340cd5b0 con 0x7f43340d1120 2023-08-25T04:16:07.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f4339ad7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f433415ca50 0x7f433415d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:07.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f4339ad7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f433415ca50 0x7f433415d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40096/0 (socket says 172.21.15.55:40096) 2023-08-25T04:16:07.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f4339ad7640 1 -- 172.21.15.55:0/2581804438 learned_addr learned my addr 172.21.15.55:0/2581804438 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:07.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f43392d6640 1 --2- 172.21.15.55:0/2581804438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43340b12c0 0x7f4334153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:07.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f4338ad5640 1 --2- 172.21.15.55:0/2581804438 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43340d1120 0x7f43341f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:07.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f4339ad7640 1 -- 172.21.15.55:0/2581804438 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43340d1120 msgr2=0x7f43341f58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:07.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f4339ad7640 1 --2- 172.21.15.55:0/2581804438 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43340d1120 0x7f43341f58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f4339ad7640 1 -- 172.21.15.55:0/2581804438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43340b12c0 msgr2=0x7f4334153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:07.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f4339ad7640 1 --2- 172.21.15.55:0/2581804438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43340b12c0 0x7f4334153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f4339ad7640 1 -- 172.21.15.55:0/2581804438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c009a70 con 0x7f433415ca50 2023-08-25T04:16:07.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f4338ad5640 1 --2- 172.21.15.55:0/2581804438 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43340d1120 0x7f43341f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:16:07.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f4339ad7640 1 --2- 172.21.15.55:0/2581804438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f433415ca50 0x7f433415d8c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f432c0b0040 tx=0x7f432c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f4329ffb640 1 -- 172.21.15.55:0/2581804438 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c0b9650 con 0x7f433415ca50 2023-08-25T04:16:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f4329ffb640 1 -- 172.21.15.55:0/2581804438 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c0b97b0 con 0x7f433415ca50 2023-08-25T04:16:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f433a2d8640 1 -- 172.21.15.55:0/2581804438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43340cd890 con 0x7f433415ca50 2023-08-25T04:16:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f4329ffb640 1 -- 172.21.15.55:0/2581804438 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c0b9b60 con 0x7f433415ca50 2023-08-25T04:16:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f433a2d8640 1 -- 172.21.15.55:0/2581804438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43340cde50 con 0x7f433415ca50 2023-08-25T04:16:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f433a2d8640 1 -- 172.21.15.55:0/2581804438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4334073e50 con 0x7f433415ca50 2023-08-25T04:16:07.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.701+0000 7f4329ffb640 1 -- 172.21.15.55:0/2581804438 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f432c0b9cc0 con 0x7f433415ca50 2023-08-25T04:16:07.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.705+0000 7f4329ffb640 1 --2- 172.21.15.55:0/2581804438 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f43180657d0 0x7f4318067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:07.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.705+0000 7f4329ffb640 1 -- 172.21.15.55:0/2581804438 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f432c11eb70 con 0x7f433415ca50 2023-08-25T04:16:07.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.705+0000 7f43392d6640 1 --2- 172.21.15.55:0/2581804438 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f43180657d0 0x7f4318067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:07.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.705+0000 7f43392d6640 1 --2- 172.21.15.55:0/2581804438 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f43180657d0 0x7f4318067c90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f43340c5ab0 tx=0x7f4330009040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:07.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.709+0000 7f4329ffb640 1 -- 172.21.15.55:0/2581804438 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f432c0ec660 con 0x7f433415ca50 2023-08-25T04:16:07.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.865+0000 7f433a2d8640 1 -- 172.21.15.55:0/2581804438 --> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43340c78c0 con 0x7f43180657d0 2023-08-25T04:16:07.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.877+0000 7f4329ffb640 1 -- 172.21.15.55:0/2581804438 <== mgr.5922 v2:172.21.15.110:6832/1373721950 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299036 (secure 0 0 0) 0x7f43340c78c0 con 0x7f43180657d0 2023-08-25T04:16:07.878 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:16:07.879 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:16:07.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.877+0000 7f433a2d8640 1 -- 172.21.15.55:0/2581804438 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f43180657d0 msgr2=0x7f4318067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:07.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.877+0000 7f433a2d8640 1 --2- 172.21.15.55:0/2581804438 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f43180657d0 0x7f4318067c90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f43340c5ab0 tx=0x7f4330009040 comp rx=0 tx=0).stop 2023-08-25T04:16:07.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.877+0000 7f433a2d8640 1 -- 172.21.15.55:0/2581804438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f433415ca50 msgr2=0x7f433415d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:07.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.877+0000 7f433a2d8640 1 --2- 172.21.15.55:0/2581804438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f433415ca50 0x7f433415d8c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f432c0b0040 tx=0x7f432c0196c0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.877+0000 7f433a2d8640 1 -- 172.21.15.55:0/2581804438 shutdown_connections 2023-08-25T04:16:07.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.877+0000 7f433a2d8640 1 --2- 172.21.15.55:0/2581804438 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f43180657d0 0x7f4318067c90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.877+0000 7f433a2d8640 1 --2- 172.21.15.55:0/2581804438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f433415ca50 0x7f433415d8c0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.877+0000 7f433a2d8640 1 --2- 172.21.15.55:0/2581804438 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43340d1120 0x7f43341f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.877+0000 7f433a2d8640 1 --2- 172.21.15.55:0/2581804438 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43340b12c0 0x7f4334153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:07.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.877+0000 7f433a2d8640 1 -- 172.21.15.55:0/2581804438 >> 172.21.15.55:0/2581804438 conn(0x7f4334065f40 msgr2=0x7f43340c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:07.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.877+0000 7f433a2d8640 1 -- 172.21.15.55:0/2581804438 shutdown_connections 2023-08-25T04:16:07.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:07.877+0000 7f433a2d8640 1 -- 172.21.15.55:0/2581804438 wait complete. 2023-08-25T04:16:07.898 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-25T04:16:06.558065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317048,"kb_used_data":6544,"kb_used_omap":13,"kb_used_meta":310386,"kb_avail":754657672,"statfs":{"total":773094113280,"available":772769456128,"internally_reserved":0,"allocated":6701056,"data_stored":3804428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":317835352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.827561"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.734545+0000","last_change":"2023-08-25T04:16:01.734545+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.734545+0000","last_undegraded":"2023-08-25T04:16:01.734545+0000","last_fullsized":"2023-08-25T04:16:01.734545+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.740559+0000","last_change":"2023-08-25T04:16:01.740559+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.740559+0000","last_undegraded":"2023-08-25T04:16:01.740559+0000","last_fullsized":"2023-08-25T04:16:01.740559+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.739644+0000","last_change":"2023-08-25T04:16:01.739644+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.739644+0000","last_undegraded":"2023-08-25T04:16:01.739644+0000","last_fullsized":"2023-08-25T04:16:01.739644+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.738986+0000","last_change":"2023-08-25T04:16:01.738986+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.738986+0000","last_undegraded":"2023-08-25T04:16:01.738986+0000","last_fullsized":"2023-08-25T04:16:01.738986+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.740309+0000","last_change":"2023-08-25T04:16:01.740309+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.740309+0000","last_undegraded":"2023-08-25T04:16:01.740309+0000","last_fullsized":"2023-08-25T04:16:01.740309+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.733004+0000","last_change":"2023-08-25T04:16:01.733004+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.733004+0000","last_undegraded":"2023-08-25T04:16:01.733004+0000","last_fullsized":"2023-08-25T04:16:01.733004+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.733128+0000","last_change":"2023-08-25T04:16:01.733128+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.733128+0000","last_undegraded":"2023-08-25T04:16:01.733128+0000","last_fullsized":"2023-08-25T04:16:01.733128+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.740623+0000","last_change":"2023-08-25T04:16:01.740623+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.740623+0000","last_undegraded":"2023-08-25T04:16:01.740623+0000","last_fullsized":"2023-08-25T04:16:01.740623+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.736165+0000","last_change":"2023-08-25T04:16:01.736165+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.736165+0000","last_undegraded":"2023-08-25T04:16:01.736165+0000","last_fullsized":"2023-08-25T04:16:01.736165+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.732994+0000","last_change":"2023-08-25T04:16:01.732994+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.732994+0000","last_undegraded":"2023-08-25T04:16:01.732994+0000","last_fullsized":"2023-08-25T04:16:01.732994+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.736736+0000","last_change":"2023-08-25T04:16:01.736736+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.736736+0000","last_undegraded":"2023-08-25T04:16:01.736736+0000","last_fullsized":"2023-08-25T04:16:01.736736+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.742694+0000","last_change":"2023-08-25T04:16:01.742694+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.742694+0000","last_undegraded":"2023-08-25T04:16:01.742694+0000","last_fullsized":"2023-08-25T04:16:01.742694+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.739319+0000","last_change":"2023-08-25T04:16:01.739319+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.739319+0000","last_undegraded":"2023-08-25T04:16:01.739319+0000","last_fullsized":"2023-08-25T04:16:01.739319+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.732995+0000","last_change":"2023-08-25T04:16:01.732995+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.732995+0000","last_undegraded":"2023-08-25T04:16:01.732995+0000","last_fullsized":"2023-08-25T04:16:01.732995+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.736149+0000","last_change":"2023-08-25T04:16:01.736149+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.736149+0000","last_undegraded":"2023-08-25T04:16:01.736149+0000","last_fullsized":"2023-08-25T04:16:01.736149+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.739249+0000","last_change":"2023-08-25T04:16:01.739249+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.739249+0000","last_undegraded":"2023-08-25T04:16:01.739249+0000","last_fullsized":"2023-08-25T04:16:01.739249+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.740954+0000","last_change":"2023-08-25T04:16:01.740954+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.740954+0000","last_undegraded":"2023-08-25T04:16:01.740954+0000","last_fullsized":"2023-08-25T04:16:01.740954+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.738010+0000","last_change":"2023-08-25T04:16:01.738010+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.738010+0000","last_undegraded":"2023-08-25T04:16:01.738010+0000","last_fullsized":"2023-08-25T04:16:01.738010+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.733274+0000","last_change":"2023-08-25T04:16:01.733274+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.733274+0000","last_undegraded":"2023-08-25T04:16:01.733274+0000","last_fullsized":"2023-08-25T04:16:01.733274+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.732994+0000","last_change":"2023-08-25T04:16:01.732994+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.732994+0000","last_undegraded":"2023-08-25T04:16:01.732994+0000","last_fullsized":"2023-08-25T04:16:01.732994+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.740411+0000","last_change":"2023-08-25T04:16:01.740411+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.740411+0000","last_undegraded":"2023-08-25T04:16:01.740411+0000","last_fullsized":"2023-08-25T04:16:01.740411+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.741745+0000","last_change":"2023-08-25T04:16:01.741745+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.741745+0000","last_undegraded":"2023-08-25T04:16:01.741745+0000","last_fullsized":"2023-08-25T04:16:01.741745+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.739903+0000","last_change":"2023-08-25T04:16:01.739903+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.739903+0000","last_undegraded":"2023-08-25T04:16:01.739903+0000","last_fullsized":"2023-08-25T04:16:01.739903+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.737811+0000","last_change":"2023-08-25T04:16:01.737811+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.737811+0000","last_undegraded":"2023-08-25T04:16:01.737811+0000","last_fullsized":"2023-08-25T04:16:01.737811+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.739887+0000","last_change":"2023-08-25T04:16:01.739887+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.739887+0000","last_undegraded":"2023-08-25T04:16:01.739887+0000","last_fullsized":"2023-08-25T04:16:01.739887+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"50'139","reported_seq":319,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-25T04:16:01.737369+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:16:01.737369+0000","last_peered":"2023-08-25T04:16:01.737369+0000","last_clean":"2023-08-25T04:16:01.737369+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:16:01.737369+0000","last_undegraded":"2023-08-25T04:16:01.737369+0000","last_fullsized":"2023-08-25T04:16:01.737369+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:12:19.648161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":83,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-25T04:16:01.739397+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:16:01.739397+0000","last_peered":"2023-08-25T04:16:01.739397+0000","last_clean":"2023-08-25T04:16:01.739397+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:16:01.739397+0000","last_undegraded":"2023-08-25T04:16:01.739397+0000","last_fullsized":"2023-08-25T04:16:01.739397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:51:02.943355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.736090+0000","last_change":"2023-08-25T04:16:01.736090+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.736090+0000","last_undegraded":"2023-08-25T04:16:01.736090+0000","last_fullsized":"2023-08-25T04:16:01.736090+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-25T04:16:01.737315+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:16:01.737315+0000","last_peered":"2023-08-25T04:16:01.737315+0000","last_clean":"2023-08-25T04:16:01.737315+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:16:01.737315+0000","last_undegraded":"2023-08-25T04:16:01.737315+0000","last_fullsized":"2023-08-25T04:16:01.737315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:44.707425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.739499+0000","last_change":"2023-08-25T04:16:01.739499+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.739499+0000","last_undegraded":"2023-08-25T04:16:01.739499+0000","last_fullsized":"2023-08-25T04:16:01.739499+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-25T04:16:01.735732+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:16:01.735732+0000","last_peered":"2023-08-25T04:16:01.735732+0000","last_clean":"2023-08-25T04:16:01.735732+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:16:01.735732+0000","last_undegraded":"2023-08-25T04:16:01.735732+0000","last_fullsized":"2023-08-25T04:16:01.735732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:30:21.208053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.733477+0000","last_change":"2023-08-25T04:16:01.733477+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.733477+0000","last_undegraded":"2023-08-25T04:16:01.733477+0000","last_fullsized":"2023-08-25T04:16:01.733477+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":83,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-25T04:16:01.738716+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:16:01.738716+0000","last_peered":"2023-08-25T04:16:01.738716+0000","last_clean":"2023-08-25T04:16:01.738716+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:16:01.738716+0000","last_undegraded":"2023-08-25T04:16:01.738716+0000","last_fullsized":"2023-08-25T04:16:01.738716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:15:46.802672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.733310+0000","last_change":"2023-08-25T04:16:01.733310+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.733310+0000","last_undegraded":"2023-08-25T04:16:01.733310+0000","last_fullsized":"2023-08-25T04:16:01.733310+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-25T04:16:01.739043+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:16:01.739043+0000","last_peered":"2023-08-25T04:16:01.739043+0000","last_clean":"2023-08-25T04:16:01.739043+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:16:01.739043+0000","last_undegraded":"2023-08-25T04:16:01.739043+0000","last_fullsized":"2023-08-25T04:16:01.739043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:18:32.928485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.738953+0000","last_change":"2023-08-25T04:16:01.738953+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.738953+0000","last_undegraded":"2023-08-25T04:16:01.738953+0000","last_fullsized":"2023-08-25T04:16:01.738953+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-25T04:16:01.737416+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:16:01.737416+0000","last_peered":"2023-08-25T04:16:01.737416+0000","last_clean":"2023-08-25T04:16:01.737416+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:16:01.737416+0000","last_undegraded":"2023-08-25T04:16:01.737416+0000","last_fullsized":"2023-08-25T04:16:01.737416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:59:03.592182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.741564+0000","last_change":"2023-08-25T04:16:01.741564+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.741564+0000","last_undegraded":"2023-08-25T04:16:01.741564+0000","last_fullsized":"2023-08-25T04:16:01.741564+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-25T04:16:01.742684+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:16:01.742684+0000","last_peered":"2023-08-25T04:16:01.742684+0000","last_clean":"2023-08-25T04:16:01.742684+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:16:01.742684+0000","last_undegraded":"2023-08-25T04:16:01.742684+0000","last_fullsized":"2023-08-25T04:16:01.742684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:02.712245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.739093+0000","last_change":"2023-08-25T04:16:01.739093+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.739093+0000","last_undegraded":"2023-08-25T04:16:01.739093+0000","last_fullsized":"2023-08-25T04:16:01.739093+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":89,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-25T04:16:01.735373+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:16:01.735373+0000","last_peered":"2023-08-25T04:16:01.735373+0000","last_clean":"2023-08-25T04:16:01.735373+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:16:01.735373+0000","last_undegraded":"2023-08-25T04:16:01.735373+0000","last_fullsized":"2023-08-25T04:16:01.735373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:07:17.746068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509602,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58804,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313036,"statfs":{"total":96636764160,"available":96576548864,"internally_reserved":0,"allocated":1286144,"data_stored":919872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72399999999999998,"15min":0.71099999999999997},"min":{"1min":0.57999999999999996,"5min":0.442,"15min":0.29199999999999998},"max":{"1min":0.996,"5min":0.996,"15min":1.0189999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.752,"15min":0.71499999999999997},"min":{"1min":0.58199999999999996,"5min":0.42099999999999999,"15min":0.39000000000000001},"max":{"1min":0.89500000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.70299999999999996}]},{"osd":1,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.55100000000000005,"5min":0.45500000000000002,"15min":0.42699999999999999},"max":{"1min":0.95699999999999996,"5min":1.0149999999999999,"15min":1.034},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76900000000000002,"15min":0.73299999999999998},"min":{"1min":0.59299999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.91700000000000004,"5min":0.98799999999999999,"15min":1.036},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.60499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.94499999999999995,"5min":1.018,"15min":1.018},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.751},"min":{"1min":0.51500000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94999999999999996,"5min":0.999,"15min":0.999},"last":0.83699999999999997}]},{"osd":3,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.74399999999999999},"min":{"1min":0.57399999999999995,"5min":0.48199999999999998,"15min":0.41899999999999998},"max":{"1min":0.92900000000000005,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.58499999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0449999999999999},"last":0.86099999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57099999999999995,"15min":0.59499999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.32400000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.98899999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.628},"min":{"1min":0.48299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.75600000000000001,"5min":0.82599999999999996,"15min":0.96699999999999997},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.63600000000000001},"min":{"1min":0.438,"5min":0.433,"15min":0.38100000000000001},"max":{"1min":0.77600000000000002,"5min":0.98399999999999999,"15min":0.998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.63,"15min":0.66100000000000003},"min":{"1min":0.45000000000000001,"5min":0.41799999999999998,"15min":0.40000000000000002},"max":{"1min":0.79400000000000004,"5min":0.93799999999999994,"15min":1.0349999999999999},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.5,"5min":0.498,"15min":0.436},"max":{"1min":0.95699999999999996,"5min":1.0009999999999999,"15min":1.0620000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.68999999999999995},"min":{"1min":0.45100000000000001,"5min":0.433,"15min":0.42399999999999999},"max":{"1min":0.84499999999999997,"5min":0.91700000000000004,"15min":0.98299999999999998},"last":0.64400000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509602,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36016,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335824,"statfs":{"total":96636764160,"available":96599883776,"internally_reserved":0,"allocated":692224,"data_stored":329504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72599999999999998,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.36499999999999999},"max":{"1min":0.93400000000000005,"5min":0.96199999999999997,"15min":1.0369999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.69799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.33800000000000002},"max":{"1min":0.96899999999999997,"5min":1.054,"15min":1.071},"last":0.80400000000000005}]},{"osd":1,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.751,"15min":0.73299999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.436},"max":{"1min":1.002,"5min":1.0369999999999999,"15min":1.1559999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.503,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98699999999999999,"5min":1.077,"15min":1.077},"last":0.78200000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.753,"15min":0.749},"min":{"1min":0.52900000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.97999999999999998,"5min":1.1020000000000001,"15min":1.139},"last":0.876},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.81100000000000005,"15min":0.80600000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54400000000000004},"max":{"1min":0.96699999999999997,"5min":1.0469999999999999,"15min":1.117},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.751,"15min":0.74399999999999999},"min":{"1min":0.58799999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.077},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.56000000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94999999999999996,"5min":1.0249999999999999,"15min":1.679},"last":0.84599999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58299999999999996,"15min":0.622},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79200000000000004,"5min":0.93200000000000005,"15min":0.93400000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57599999999999996,"15min":0.629},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78200000000000003,"5min":0.95799999999999996,"15min":1.306},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.625,"15min":0.68400000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82599999999999996,"5min":1.0329999999999999,"15min":1.123},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71599999999999997,"15min":0.76600000000000001},"min":{"1min":0.443,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.97599999999999998,"5min":1.0209999999999999,"15min":1.5589999999999999},"last":0.59899999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64900000000000002,"15min":0.68999999999999995},"min":{"1min":0.443,"5min":0.434,"15min":0.434},"max":{"1min":0.82899999999999996,"5min":0.99099999999999999,"15min":1.1950000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67200000000000004,"15min":0.72599999999999998},"min":{"1min":0.45200000000000001,"5min":0.44700000000000001,"15min":0.41799999999999998},"max":{"1min":0.91200000000000003,"5min":1.012,"15min":1.4099999999999999},"last":0.55500000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542305,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":692224,"data_stored":329504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72599999999999998,"15min":0.70799999999999996},"min":{"1min":0.53300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90600000000000003,"5min":0.93700000000000006,"15min":1.018},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.60699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.97999999999999998,"5min":0.995,"15min":1.0409999999999999},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76000000000000001,"15min":0.74299999999999999},"min":{"1min":0.58099999999999996,"5min":0.43099999999999999,"15min":0.36499999999999999},"max":{"1min":0.95299999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.753,"15min":0.73399999999999999},"min":{"1min":0.57499999999999996,"5min":0.48699999999999999,"15min":0.46200000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.49399999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.749,"15min":0.72799999999999998},"min":{"1min":0.64300000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.86899999999999999,"5min":0.97499999999999998,"15min":1.0269999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.623,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":0.95999999999999996,"5min":1.006,"15min":1.2290000000000001},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.748,"15min":0.73599999999999999},"min":{"1min":0.59099999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.93500000000000005,"5min":0.94199999999999995,"15min":1.4590000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.57599999999999996,"5min":0.53000000000000003,"15min":0.498},"max":{"1min":0.92000000000000004,"5min":1.018,"15min":1.1479999999999999},"last":0.68899999999999995}]},{"osd":4,"last update":"Fri Aug 25 04:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58399999999999996,"15min":0.61199999999999999},"min":{"1min":0.46400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78700000000000003,"5min":0.97099999999999997,"15min":1.038},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60299999999999998,"15min":0.63700000000000001},"min":{"1min":0.45800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85599999999999998,"5min":0.878,"15min":0.99199999999999999},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.623,"15min":0.66900000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93700000000000006,"5min":1.008,"15min":1.256},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.67800000000000005},"min":{"1min":0.46400000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.78700000000000003,"5min":0.88700000000000001,"15min":1.4650000000000001},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58699999999999997,"15min":0.64700000000000002},"min":{"1min":0.436,"5min":0.375,"15min":0.375},"max":{"1min":0.72299999999999998,"5min":1.032,"15min":1.2769999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68600000000000005,"15min":0.72799999999999998},"min":{"1min":0.51800000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90000000000000002,"5min":1.048,"15min":1.1819999999999999},"last":0.629}]}]},{"osd":4,"up_from":14,"seq":60129542305,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36016,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335824,"statfs":{"total":96636764160,"available":96599883776,"internally_reserved":0,"allocated":692224,"data_stored":329504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72999999999999998,"15min":0.70199999999999996},"min":{"1min":0.60399999999999998,"5min":0.42299999999999999,"15min":0.32700000000000001},"max":{"1min":0.89000000000000001,"5min":0.99299999999999999,"15min":1.2649999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72499999999999998,"15min":0.69699999999999995},"min":{"1min":0.58899999999999997,"5min":0.48499999999999999,"15min":0.441},"max":{"1min":0.86699999999999999,"5min":0.89900000000000002,"15min":1.1639999999999999},"last":0.77300000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.747,"15min":0.71399999999999997},"min":{"1min":0.59799999999999998,"5min":0.46400000000000002,"15min":0.36199999999999999},"max":{"1min":0.96499999999999997,"5min":1.0189999999999999,"15min":1.0449999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77000000000000002,"15min":0.74399999999999999},"min":{"1min":0.58899999999999997,"5min":0.56799999999999995,"15min":0.36799999999999999},"max":{"1min":0.95599999999999996,"5min":1.099,"15min":1.099},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78700000000000003,"15min":0.75900000000000001},"min":{"1min":0.66300000000000003,"5min":0.57599999999999996,"15min":0.39100000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.877},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77300000000000002,"15min":0.73499999999999999},"min":{"1min":0.67200000000000004,"5min":0.503,"15min":0.34000000000000002},"max":{"1min":0.94599999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.83699999999999997}]},{"osd":3,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.76800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.45100000000000001},"max":{"1min":0.98299999999999998,"5min":1.016,"15min":1.048},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.78000000000000003,"15min":0.76000000000000001},"min":{"1min":0.629,"5min":0.52400000000000002,"15min":0.48399999999999999},"max":{"1min":1.008,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.86399999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.41099999999999998,"5min":0.39400000000000002,"15min":0.32200000000000001},"max":{"1min":0.753,"5min":0.88400000000000001,"15min":0.94899999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.60499999999999998},"min":{"1min":0.48299999999999998,"5min":0.38500000000000001,"15min":0.33200000000000002},"max":{"1min":0.73199999999999998,"5min":0.91200000000000003,"15min":0.92100000000000004},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.59399999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.014,"5min":1.0309999999999999,"15min":1.0620000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64500000000000002,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.874,"5min":0.97499999999999998,"15min":1.026},"last":0.63100000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.621,"15min":0.63500000000000001},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.36699999999999999},"max":{"1min":0.87,"5min":0.90400000000000003,"15min":1.0609999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69699999999999995,"15min":0.72199999999999998},"min":{"1min":0.55400000000000005,"5min":0.498,"15min":0.39300000000000002},"max":{"1min":0.88400000000000001,"5min":0.98399999999999999,"15min":1.0940000000000001},"last":0.81200000000000006}]}]},{"osd":3,"up_from":14,"seq":60129542305,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36016,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335824,"statfs":{"total":96636764160,"available":96599883776,"internally_reserved":0,"allocated":692224,"data_stored":329504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46000000000000002,"15min":0.442},"min":{"1min":0.34499999999999997,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.56699999999999995,"5min":0.747,"15min":0.96899999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.77100000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.371}]},{"osd":1,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.497,"15min":0.48699999999999999},"min":{"1min":0.34699999999999998,"5min":0.33600000000000002,"15min":0.27000000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.746},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.58999999999999997},"min":{"1min":0.47199999999999998,"5min":0.41799999999999998,"15min":0.38500000000000001},"max":{"1min":0.76500000000000001,"5min":0.85799999999999998,"15min":0.92600000000000005},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57799999999999996,"15min":0.56499999999999995},"min":{"1min":0.41799999999999998,"5min":0.40600000000000003,"15min":0.34699999999999998},"max":{"1min":0.67300000000000004,"5min":1.01,"15min":1.01},"last":0.441},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.379,"15min":0.35299999999999998},"max":{"1min":0.67700000000000005,"5min":0.81699999999999995,"15min":0.89600000000000002},"last":0.46800000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78100000000000003,"15min":0.75600000000000001},"min":{"1min":0.57999999999999996,"5min":0.53100000000000003,"15min":0.46800000000000003},"max":{"1min":1.214,"5min":1.214,"15min":1.4339999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.81299999999999994},"min":{"1min":0.63800000000000001,"5min":0.59399999999999997,"15min":0.48899999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.343},"last":0.78200000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.61199999999999999,"5min":0.52900000000000003,"15min":0.51500000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.321},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80900000000000005,"15min":0.79500000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.48099999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.4750000000000001},"last":0.84499999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.83499999999999996,"15min":0.80800000000000005},"min":{"1min":0.60399999999999998,"5min":0.55300000000000005,"15min":0.53100000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.2010000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.61199999999999999,"5min":0.52000000000000002,"15min":0.50700000000000001},"max":{"1min":1.0800000000000001,"5min":1.097,"15min":1.3600000000000001},"last":0.72699999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.85199999999999998,"15min":0.83999999999999997},"min":{"1min":0.66200000000000003,"5min":0.60899999999999999,"15min":0.57099999999999995},"max":{"1min":1.077,"5min":1.1080000000000001,"15min":1.383},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80900000000000005,"15min":0.79500000000000004},"min":{"1min":0.58299999999999996,"5min":0.55600000000000005,"15min":0.54000000000000004},"max":{"1min":1.0669999999999999,"5min":1.1160000000000001,"15min":1.4019999999999999},"last":0.82799999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542306,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54052,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317788,"statfs":{"total":96636764160,"available":96581414912,"internally_reserved":0,"allocated":679936,"data_stored":323334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.45900000000000002,"15min":0.46899999999999997},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":0.61599999999999999,"5min":0.76100000000000001,"15min":1.196},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.496},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.28599999999999998},"max":{"1min":0.72499999999999998,"5min":0.75600000000000001,"15min":1.4019999999999999},"last":0.38800000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":1.482},"last":0.5},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60599999999999998,"15min":0.60199999999999998},"min":{"1min":0.44700000000000001,"5min":0.41999999999999998,"15min":0.36699999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":1.458},"last":0.51200000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53300000000000003,"15min":0.52800000000000002},"min":{"1min":0.41699999999999998,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.754,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.44800000000000001,"5min":0.41299999999999998,"15min":0.33700000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.95599999999999996},"last":0.42499999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.80800000000000005,"15min":0.79600000000000004},"min":{"1min":0.61499999999999999,"5min":0.52200000000000002,"15min":0.499},"max":{"1min":0.98899999999999999,"5min":1.2330000000000001,"15min":1.2569999999999999},"last":0.87},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78700000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.47599999999999998},"max":{"1min":1.026,"5min":1.117,"15min":1.5509999999999999},"last":0.80800000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80800000000000005,"15min":0.80100000000000005},"min":{"1min":0.54100000000000004,"5min":0.498,"15min":0.47999999999999998},"max":{"1min":1.014,"5min":1.1140000000000001,"15min":1.2789999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81100000000000005,"15min":0.80800000000000005},"min":{"1min":0.59699999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.026,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84299999999999997,"15min":0.83899999999999997},"min":{"1min":0.67600000000000005,"5min":0.57399999999999995,"15min":0.56000000000000005},"max":{"1min":1.0609999999999999,"5min":1.1910000000000001,"15min":1.2110000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.875,"15min":0.85199999999999998},"min":{"1min":0.65700000000000003,"5min":0.61199999999999999,"15min":0.55600000000000005},"max":{"1min":1.0660000000000001,"5min":1.278,"15min":1.375},"last":0.89900000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.53700000000000003,"15min":0.49199999999999999},"max":{"1min":0.96899999999999997,"5min":1.2090000000000001,"15min":1.339},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.81100000000000005,"15min":0.81299999999999994},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.51000000000000001},"max":{"1min":1.081,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.93999999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542306,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":679936,"data_stored":323334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46999999999999997,"15min":0.47099999999999997},"min":{"1min":0.33300000000000002,"5min":0.28399999999999997,"15min":0.27400000000000002},"max":{"1min":0.68999999999999995,"5min":0.85599999999999998,"15min":1.218},"last":0.439},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.36699999999999999,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":0.93300000000000005,"15min":1.153},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51100000000000001,"15min":0.504},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.30599999999999999},"max":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":1.347},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.48099999999999998,"5min":0.40000000000000002,"15min":0.36499999999999999},"max":{"1min":0.76000000000000001,"5min":1.02,"15min":1.093},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63600000000000001,"15min":0.623},"min":{"1min":0.46800000000000003,"5min":0.45300000000000001,"15min":0.40699999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":1.1459999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":1.2190000000000001},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80800000000000005,"15min":0.79400000000000004},"min":{"1min":0.56799999999999995,"5min":0.51600000000000001,"15min":0.45800000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.47},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83899999999999997,"15min":0.82399999999999995},"min":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.504},"max":{"1min":1.1830000000000001,"5min":1.244,"15min":1.395},"last":0.624}]},{"osd":5,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.82999999999999996,"15min":0.80600000000000005},"min":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.45100000000000001},"max":{"1min":1.1579999999999999,"5min":1.2090000000000001,"15min":1.292},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.83399999999999996,"15min":0.83299999999999996},"min":{"1min":0.64100000000000001,"5min":0.54700000000000004,"15min":0.51000000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.57399999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85299999999999998,"15min":0.85199999999999998},"min":{"1min":0.63500000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.569},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.83199999999999996,"15min":0.81399999999999995},"min":{"1min":0.67800000000000005,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.355},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83999999999999997,"15min":0.82999999999999996},"min":{"1min":0.65400000000000003,"5min":0.59299999999999997,"15min":0.56799999999999995},"max":{"1min":1.1240000000000001,"5min":1.2949999999999999,"15min":1.5429999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.876,"15min":0.85599999999999998},"min":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.54500000000000004},"max":{"1min":1.1140000000000001,"5min":1.3120000000000001,"15min":1.504},"last":0.67900000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542305,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1286144,"data_stored":919872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.48699999999999999,"15min":0.48299999999999998},"min":{"1min":0.35299999999999998,"5min":0.317,"15min":0.26800000000000002},"max":{"1min":0.66400000000000003,"5min":0.70799999999999996,"15min":0.79500000000000004},"last":0.372},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57599999999999996,"15min":0.54900000000000004},"min":{"1min":0.46600000000000003,"5min":0.41399999999999998,"15min":0.35499999999999998},"max":{"1min":0.70599999999999996,"5min":0.78500000000000003,"15min":0.876},"last":0.44}]},{"osd":2,"last update":"Fri Aug 25 04:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.40100000000000002,"5min":0.35899999999999999,"15min":0.32800000000000001},"max":{"1min":0.70899999999999996,"5min":0.90300000000000002,"15min":0.97499999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54300000000000004,"15min":0.52700000000000002},"min":{"1min":0.38300000000000001,"5min":0.35599999999999998,"15min":0.33700000000000002},"max":{"1min":0.76900000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.504}]},{"osd":3,"last update":"Fri Aug 25 04:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.50600000000000001,"15min":0.498},"min":{"1min":0.35599999999999998,"5min":0.313,"15min":0.30199999999999999},"max":{"1min":0.77600000000000002,"5min":0.79800000000000004,"15min":1.266},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.47199999999999998,"5min":0.432,"15min":0.39000000000000001},"max":{"1min":0.85099999999999998,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.78000000000000003,"15min":0.79700000000000004},"min":{"1min":0.68799999999999994,"5min":0.503,"15min":0.503},"max":{"1min":1.028,"5min":1.127,"15min":1.306},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.80800000000000005,"15min":0.80700000000000005},"min":{"1min":0.72999999999999998,"5min":0.57299999999999995,"15min":0.436},"max":{"1min":1.089,"5min":1.131,"15min":1.262},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.64300000000000002,"5min":0.53600000000000003,"15min":0.52400000000000002},"max":{"1min":0.96599999999999997,"5min":1.097,"15min":1.4330000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.80700000000000005,"15min":0.81699999999999995},"min":{"1min":0.622,"5min":0.46999999999999997,"15min":0.45500000000000002},"max":{"1min":1.087,"5min":1.2230000000000001,"15min":1.373},"last":0.74099999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.80200000000000005,"15min":0.79600000000000004},"min":{"1min":0.68000000000000005,"5min":0.56799999999999995,"15min":0.53000000000000003},"max":{"1min":0.98899999999999999,"5min":1.115,"15min":1.349},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.83799999999999997,"15min":0.82699999999999996},"min":{"1min":0.78600000000000003,"5min":0.54800000000000004,"15min":0.47399999999999998},"max":{"1min":1.1060000000000001,"5min":1.194,"15min":1.331},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.84599999999999997,"15min":0.84799999999999998},"min":{"1min":0.753,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0640000000000001,"5min":1.1659999999999999,"15min":1.4059999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.80700000000000005,"15min":0.81499999999999995},"min":{"1min":0.64200000000000002,"5min":0.58299999999999996,"15min":0.499},"max":{"1min":1.0569999999999999,"5min":1.1930000000000001,"15min":1.3169999999999999},"last":0.67200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:16:07.905 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:16:08.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f0909344640 1 Processor -- start 2023-08-25T04:16:08.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f0909344640 1 -- start start 2023-08-25T04:16:08.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f0909344640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09040ad950 0x7f09040cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:08.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f0909344640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f09040c89f0 0x7f09040ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:08.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f0909344640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f090406c000 0x7f09040cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:08.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f0909344640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09040b11f0 con 0x7f09040c89f0 2023-08-25T04:16:08.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f0909344640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0904159d50 con 0x7f090406c000 2023-08-25T04:16:08.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f0909344640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09040cc880 con 0x7f09040ad950 2023-08-25T04:16:08.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f08fa7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f09040c89f0 0x7f09040ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:08.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f08fa7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f09040c89f0 0x7f09040ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40112/0 (socket says 172.21.15.55:40112) 2023-08-25T04:16:08.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f08fa7fc640 1 -- 172.21.15.55:0/2294865585 learned_addr learned my addr 172.21.15.55:0/2294865585 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:08.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f0902ffd640 1 --2- 172.21.15.55:0/2294865585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09040ad950 0x7f09040cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:08.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f09037fe640 1 --2- 172.21.15.55:0/2294865585 >> v2:172.21.15.110:3300/0 conn(0x7f090406c000 0x7f09040cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:08.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f08fa7fc640 1 -- 172.21.15.55:0/2294865585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09040ad950 msgr2=0x7f09040cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:08.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f08fa7fc640 1 --2- 172.21.15.55:0/2294865585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09040ad950 0x7f09040cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f08fa7fc640 1 -- 172.21.15.55:0/2294865585 >> v2:172.21.15.110:3300/0 conn(0x7f090406c000 msgr2=0x7f09040cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:08.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f08fa7fc640 1 --2- 172.21.15.55:0/2294865585 >> v2:172.21.15.110:3300/0 conn(0x7f090406c000 0x7f09040cece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f08fa7fc640 1 -- 172.21.15.55:0/2294865585 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09040ccb60 con 0x7f09040c89f0 2023-08-25T04:16:08.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f0902ffd640 1 --2- 172.21.15.55:0/2294865585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09040ad950 0x7f09040cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:16:08.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.085+0000 7f09037fe640 1 --2- 172.21.15.55:0/2294865585 >> v2:172.21.15.110:3300/0 conn(0x7f090406c000 0x7f09040cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:16:08.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.089+0000 7f08fa7fc640 1 --2- 172.21.15.55:0/2294865585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09040c89f0 0x7f09040ce7a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f09040afe20 tx=0x7f08f401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d62eafd5cd8680b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:08.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.089+0000 7f09027fc640 1 -- 172.21.15.55:0/2294865585 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f40ac640 con 0x7f09040c89f0 2023-08-25T04:16:08.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.089+0000 7f09027fc640 1 -- 172.21.15.55:0/2294865585 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f40ac7a0 con 0x7f09040c89f0 2023-08-25T04:16:08.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.089+0000 7f09027fc640 1 -- 172.21.15.55:0/2294865585 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f40acb30 con 0x7f09040c89f0 2023-08-25T04:16:08.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.089+0000 7f0909344640 1 -- 172.21.15.55:0/2294865585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09040c89f0 msgr2=0x7f09040ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:08.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.089+0000 7f0909344640 1 --2- 172.21.15.55:0/2294865585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09040c89f0 0x7f09040ce7a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f09040afe20 tx=0x7f08f401c440 comp rx=0 tx=0).stop 2023-08-25T04:16:08.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.089+0000 7f0909344640 1 -- 172.21.15.55:0/2294865585 shutdown_connections 2023-08-25T04:16:08.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.089+0000 7f0909344640 1 --2- 172.21.15.55:0/2294865585 >> v2:172.21.15.110:3300/0 conn(0x7f090406c000 0x7f09040cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.089+0000 7f0909344640 1 --2- 172.21.15.55:0/2294865585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09040c89f0 0x7f09040ce7a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.089+0000 7f0909344640 1 --2- 172.21.15.55:0/2294865585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09040ad950 0x7f09040cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.089+0000 7f0909344640 1 -- 172.21.15.55:0/2294865585 >> 172.21.15.55:0/2294865585 conn(0x7f0904069d00 msgr2=0x7f090406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:08.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.089+0000 7f0909344640 1 -- 172.21.15.55:0/2294865585 shutdown_connections 2023-08-25T04:16:08.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.089+0000 7f0909344640 1 -- 172.21.15.55:0/2294865585 wait complete. 2023-08-25T04:16:08.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f0909344640 1 Processor -- start 2023-08-25T04:16:08.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f0909344640 1 -- start start 2023-08-25T04:16:08.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f0909344640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f090406c000 0x7f0904152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:08.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f0909344640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09040ad950 0x7f09041504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:08.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f0909344640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09040c89f0 0x7f0904150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:08.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f0909344640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090414f440 con 0x7f09040c89f0 2023-08-25T04:16:08.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f0909344640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090414f720 con 0x7f09040ad950 2023-08-25T04:16:08.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f0909344640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090414fa00 con 0x7f090406c000 2023-08-25T04:16:08.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f09037fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09040c89f0 0x7f0904150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:08.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f09037fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09040c89f0 0x7f0904150a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40122/0 (socket says 172.21.15.55:40122) 2023-08-25T04:16:08.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f09037fe640 1 -- 172.21.15.55:0/508970309 learned_addr learned my addr 172.21.15.55:0/508970309 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:08.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f08fa7fc640 1 --2- 172.21.15.55:0/508970309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09040ad950 0x7f09041504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:08.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f0902ffd640 1 --2- 172.21.15.55:0/508970309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f090406c000 0x7f0904152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:08.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f09037fe640 1 -- 172.21.15.55:0/508970309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f090406c000 msgr2=0x7f0904152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f09037fe640 1 --2- 172.21.15.55:0/508970309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f090406c000 0x7f0904152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f09037fe640 1 -- 172.21.15.55:0/508970309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09040ad950 msgr2=0x7f09041504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f09037fe640 1 --2- 172.21.15.55:0/508970309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09040ad950 0x7f09041504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f09037fe640 1 -- 172.21.15.55:0/508970309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f40094d0 con 0x7f09040c89f0 2023-08-25T04:16:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f09037fe640 1 --2- 172.21.15.55:0/508970309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09040c89f0 0x7f0904150a20 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00cef0 tx=0x7f08fc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f08fbfff640 1 -- 172.21.15.55:0/508970309 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc00d840 con 0x7f09040c89f0 2023-08-25T04:16:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f08fbfff640 1 -- 172.21.15.55:0/508970309 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08fc00d9a0 con 0x7f09040c89f0 2023-08-25T04:16:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f0909344640 1 -- 172.21.15.55:0/508970309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090414fce0 con 0x7f09040c89f0 2023-08-25T04:16:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f08fbfff640 1 -- 172.21.15.55:0/508970309 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc00dd50 con 0x7f09040c89f0 2023-08-25T04:16:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.093+0000 7f0909344640 1 -- 172.21.15.55:0/508970309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090414f0c0 con 0x7f09040c89f0 2023-08-25T04:16:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.097+0000 7f0909344640 1 -- 172.21.15.55:0/508970309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090404dbe0 con 0x7f09040c89f0 2023-08-25T04:16:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.097+0000 7f08fbfff640 1 -- 172.21.15.55:0/508970309 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f08fc01e3b0 con 0x7f09040c89f0 2023-08-25T04:16:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.097+0000 7f08fbfff640 1 --2- 172.21.15.55:0/508970309 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f08e40657a0 0x7f08e4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.097+0000 7f08fbfff640 1 -- 172.21.15.55:0/508970309 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f08fc0839a0 con 0x7f09040c89f0 2023-08-25T04:16:08.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.097+0000 7f0902ffd640 1 --2- 172.21.15.55:0/508970309 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f08e40657a0 0x7f08e4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:08.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.097+0000 7f0902ffd640 1 --2- 172.21.15.55:0/508970309 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f08e40657a0 0x7f08e4067c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00a9a0 tx=0x7f08ec008040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.101+0000 7f08fbfff640 1 -- 172.21.15.55:0/508970309 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f08fc051360 con 0x7f09040c89f0 2023-08-25T04:16:08.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.253+0000 7f0909344640 1 -- 172.21.15.55:0/508970309 --> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f090414f890 con 0x7f08e40657a0 2023-08-25T04:16:08.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.261+0000 7f08fbfff640 1 -- 172.21.15.55:0/508970309 <== mgr.5922 v2:172.21.15.110:6832/1373721950 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299036 (secure 0 0 0) 0x7f090414f890 con 0x7f08e40657a0 2023-08-25T04:16:08.265 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:16:08.267 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:16:08.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.265+0000 7f0909344640 1 -- 172.21.15.55:0/508970309 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f08e40657a0 msgr2=0x7f08e4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:08.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.265+0000 7f0909344640 1 --2- 172.21.15.55:0/508970309 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f08e40657a0 0x7f08e4067c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00a9a0 tx=0x7f08ec008040 comp rx=0 tx=0).stop 2023-08-25T04:16:08.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.265+0000 7f0909344640 1 -- 172.21.15.55:0/508970309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09040c89f0 msgr2=0x7f0904150a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:08.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.265+0000 7f0909344640 1 --2- 172.21.15.55:0/508970309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09040c89f0 0x7f0904150a20 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00cef0 tx=0x7f08fc00a710 comp rx=0 tx=0).stop 2023-08-25T04:16:08.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.265+0000 7f0909344640 1 -- 172.21.15.55:0/508970309 shutdown_connections 2023-08-25T04:16:08.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.265+0000 7f0909344640 1 --2- 172.21.15.55:0/508970309 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f08e40657a0 0x7f08e4067c60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.265+0000 7f0909344640 1 --2- 172.21.15.55:0/508970309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09040c89f0 0x7f0904150a20 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.265+0000 7f0909344640 1 --2- 172.21.15.55:0/508970309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09040ad950 0x7f09041504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.265+0000 7f0909344640 1 --2- 172.21.15.55:0/508970309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f090406c000 0x7f0904152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.265+0000 7f0909344640 1 -- 172.21.15.55:0/508970309 >> 172.21.15.55:0/508970309 conn(0x7f0904069d00 msgr2=0x7f09040b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:08.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.265+0000 7f0909344640 1 -- 172.21.15.55:0/508970309 shutdown_connections 2023-08-25T04:16:08.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.265+0000 7f0909344640 1 -- 172.21.15.55:0/508970309 wait complete. 2023-08-25T04:16:08.284 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-25T04:16:06.558065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317048,"kb_used_data":6544,"kb_used_omap":13,"kb_used_meta":310386,"kb_avail":754657672,"statfs":{"total":773094113280,"available":772769456128,"internally_reserved":0,"allocated":6701056,"data_stored":3804428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":317835352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.827561"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.734545+0000","last_change":"2023-08-25T04:16:01.734545+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.734545+0000","last_undegraded":"2023-08-25T04:16:01.734545+0000","last_fullsized":"2023-08-25T04:16:01.734545+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.740559+0000","last_change":"2023-08-25T04:16:01.740559+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.740559+0000","last_undegraded":"2023-08-25T04:16:01.740559+0000","last_fullsized":"2023-08-25T04:16:01.740559+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.739644+0000","last_change":"2023-08-25T04:16:01.739644+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.739644+0000","last_undegraded":"2023-08-25T04:16:01.739644+0000","last_fullsized":"2023-08-25T04:16:01.739644+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.738986+0000","last_change":"2023-08-25T04:16:01.738986+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.738986+0000","last_undegraded":"2023-08-25T04:16:01.738986+0000","last_fullsized":"2023-08-25T04:16:01.738986+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.740309+0000","last_change":"2023-08-25T04:16:01.740309+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.740309+0000","last_undegraded":"2023-08-25T04:16:01.740309+0000","last_fullsized":"2023-08-25T04:16:01.740309+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.733004+0000","last_change":"2023-08-25T04:16:01.733004+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.733004+0000","last_undegraded":"2023-08-25T04:16:01.733004+0000","last_fullsized":"2023-08-25T04:16:01.733004+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.733128+0000","last_change":"2023-08-25T04:16:01.733128+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.733128+0000","last_undegraded":"2023-08-25T04:16:01.733128+0000","last_fullsized":"2023-08-25T04:16:01.733128+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.740623+0000","last_change":"2023-08-25T04:16:01.740623+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.740623+0000","last_undegraded":"2023-08-25T04:16:01.740623+0000","last_fullsized":"2023-08-25T04:16:01.740623+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.736165+0000","last_change":"2023-08-25T04:16:01.736165+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.736165+0000","last_undegraded":"2023-08-25T04:16:01.736165+0000","last_fullsized":"2023-08-25T04:16:01.736165+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.732994+0000","last_change":"2023-08-25T04:16:01.732994+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.732994+0000","last_undegraded":"2023-08-25T04:16:01.732994+0000","last_fullsized":"2023-08-25T04:16:01.732994+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.736736+0000","last_change":"2023-08-25T04:16:01.736736+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.736736+0000","last_undegraded":"2023-08-25T04:16:01.736736+0000","last_fullsized":"2023-08-25T04:16:01.736736+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.742694+0000","last_change":"2023-08-25T04:16:01.742694+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.742694+0000","last_undegraded":"2023-08-25T04:16:01.742694+0000","last_fullsized":"2023-08-25T04:16:01.742694+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.739319+0000","last_change":"2023-08-25T04:16:01.739319+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.739319+0000","last_undegraded":"2023-08-25T04:16:01.739319+0000","last_fullsized":"2023-08-25T04:16:01.739319+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.732995+0000","last_change":"2023-08-25T04:16:01.732995+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.732995+0000","last_undegraded":"2023-08-25T04:16:01.732995+0000","last_fullsized":"2023-08-25T04:16:01.732995+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.736149+0000","last_change":"2023-08-25T04:16:01.736149+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.736149+0000","last_undegraded":"2023-08-25T04:16:01.736149+0000","last_fullsized":"2023-08-25T04:16:01.736149+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.739249+0000","last_change":"2023-08-25T04:16:01.739249+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.739249+0000","last_undegraded":"2023-08-25T04:16:01.739249+0000","last_fullsized":"2023-08-25T04:16:01.739249+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.740954+0000","last_change":"2023-08-25T04:16:01.740954+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.740954+0000","last_undegraded":"2023-08-25T04:16:01.740954+0000","last_fullsized":"2023-08-25T04:16:01.740954+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.738010+0000","last_change":"2023-08-25T04:16:01.738010+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.738010+0000","last_undegraded":"2023-08-25T04:16:01.738010+0000","last_fullsized":"2023-08-25T04:16:01.738010+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.733274+0000","last_change":"2023-08-25T04:16:01.733274+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.733274+0000","last_undegraded":"2023-08-25T04:16:01.733274+0000","last_fullsized":"2023-08-25T04:16:01.733274+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.732994+0000","last_change":"2023-08-25T04:16:01.732994+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.732994+0000","last_undegraded":"2023-08-25T04:16:01.732994+0000","last_fullsized":"2023-08-25T04:16:01.732994+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.740411+0000","last_change":"2023-08-25T04:16:01.740411+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.740411+0000","last_undegraded":"2023-08-25T04:16:01.740411+0000","last_fullsized":"2023-08-25T04:16:01.740411+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.741745+0000","last_change":"2023-08-25T04:16:01.741745+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.741745+0000","last_undegraded":"2023-08-25T04:16:01.741745+0000","last_fullsized":"2023-08-25T04:16:01.741745+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.739903+0000","last_change":"2023-08-25T04:16:01.739903+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.739903+0000","last_undegraded":"2023-08-25T04:16:01.739903+0000","last_fullsized":"2023-08-25T04:16:01.739903+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.737811+0000","last_change":"2023-08-25T04:16:01.737811+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.737811+0000","last_undegraded":"2023-08-25T04:16:01.737811+0000","last_fullsized":"2023-08-25T04:16:01.737811+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.739887+0000","last_change":"2023-08-25T04:16:01.739887+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.739887+0000","last_undegraded":"2023-08-25T04:16:01.739887+0000","last_fullsized":"2023-08-25T04:16:01.739887+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"50'139","reported_seq":319,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-25T04:16:01.737369+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:16:01.737369+0000","last_peered":"2023-08-25T04:16:01.737369+0000","last_clean":"2023-08-25T04:16:01.737369+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:16:01.737369+0000","last_undegraded":"2023-08-25T04:16:01.737369+0000","last_fullsized":"2023-08-25T04:16:01.737369+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:12:19.648161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":83,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-25T04:16:01.739397+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:16:01.739397+0000","last_peered":"2023-08-25T04:16:01.739397+0000","last_clean":"2023-08-25T04:16:01.739397+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:16:01.739397+0000","last_undegraded":"2023-08-25T04:16:01.739397+0000","last_fullsized":"2023-08-25T04:16:01.739397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:51:02.943355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.736090+0000","last_change":"2023-08-25T04:16:01.736090+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.736090+0000","last_undegraded":"2023-08-25T04:16:01.736090+0000","last_fullsized":"2023-08-25T04:16:01.736090+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-25T04:16:01.737315+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:16:01.737315+0000","last_peered":"2023-08-25T04:16:01.737315+0000","last_clean":"2023-08-25T04:16:01.737315+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:16:01.737315+0000","last_undegraded":"2023-08-25T04:16:01.737315+0000","last_fullsized":"2023-08-25T04:16:01.737315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:44.707425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.739499+0000","last_change":"2023-08-25T04:16:01.739499+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.739499+0000","last_undegraded":"2023-08-25T04:16:01.739499+0000","last_fullsized":"2023-08-25T04:16:01.739499+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-25T04:16:01.735732+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:16:01.735732+0000","last_peered":"2023-08-25T04:16:01.735732+0000","last_clean":"2023-08-25T04:16:01.735732+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:16:01.735732+0000","last_undegraded":"2023-08-25T04:16:01.735732+0000","last_fullsized":"2023-08-25T04:16:01.735732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:30:21.208053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.733477+0000","last_change":"2023-08-25T04:16:01.733477+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.733477+0000","last_undegraded":"2023-08-25T04:16:01.733477+0000","last_fullsized":"2023-08-25T04:16:01.733477+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":83,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-25T04:16:01.738716+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:16:01.738716+0000","last_peered":"2023-08-25T04:16:01.738716+0000","last_clean":"2023-08-25T04:16:01.738716+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:16:01.738716+0000","last_undegraded":"2023-08-25T04:16:01.738716+0000","last_fullsized":"2023-08-25T04:16:01.738716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:15:46.802672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.733310+0000","last_change":"2023-08-25T04:16:01.733310+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.733310+0000","last_undegraded":"2023-08-25T04:16:01.733310+0000","last_fullsized":"2023-08-25T04:16:01.733310+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-25T04:16:01.739043+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:16:01.739043+0000","last_peered":"2023-08-25T04:16:01.739043+0000","last_clean":"2023-08-25T04:16:01.739043+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:16:01.739043+0000","last_undegraded":"2023-08-25T04:16:01.739043+0000","last_fullsized":"2023-08-25T04:16:01.739043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:18:32.928485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.738953+0000","last_change":"2023-08-25T04:16:01.738953+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.738953+0000","last_undegraded":"2023-08-25T04:16:01.738953+0000","last_fullsized":"2023-08-25T04:16:01.738953+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-25T04:16:01.737416+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:16:01.737416+0000","last_peered":"2023-08-25T04:16:01.737416+0000","last_clean":"2023-08-25T04:16:01.737416+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:16:01.737416+0000","last_undegraded":"2023-08-25T04:16:01.737416+0000","last_fullsized":"2023-08-25T04:16:01.737416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:59:03.592182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.741564+0000","last_change":"2023-08-25T04:16:01.741564+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.741564+0000","last_undegraded":"2023-08-25T04:16:01.741564+0000","last_fullsized":"2023-08-25T04:16:01.741564+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":91,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-25T04:16:01.742684+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:16:01.742684+0000","last_peered":"2023-08-25T04:16:01.742684+0000","last_clean":"2023-08-25T04:16:01.742684+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:16:01.742684+0000","last_undegraded":"2023-08-25T04:16:01.742684+0000","last_fullsized":"2023-08-25T04:16:01.742684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:02.712245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:16:02.732077+0000","last_change":"2023-08-25T04:16:02.732077+0000","last_active":"2023-08-25T04:16:02.732077+0000","last_peered":"2023-08-25T04:16:02.732077+0000","last_clean":"2023-08-25T04:16:02.732077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:02.732077+0000","last_undegraded":"2023-08-25T04:16:02.732077+0000","last_fullsized":"2023-08-25T04:16:02.732077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":59,"state":"creating+peering","last_fresh":"2023-08-25T04:16:01.739093+0000","last_change":"2023-08-25T04:16:01.739093+0000","last_active":"2023-08-25T04:16:01.716301+0000","last_peered":"2023-08-25T04:16:01.716301+0000","last_clean":"2023-08-25T04:16:01.716301+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:16:01.739093+0000","last_undegraded":"2023-08-25T04:16:01.739093+0000","last_fullsized":"2023-08-25T04:16:01.739093+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":89,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-25T04:16:01.735373+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:16:01.735373+0000","last_peered":"2023-08-25T04:16:01.735373+0000","last_clean":"2023-08-25T04:16:01.735373+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:16:01.735373+0000","last_undegraded":"2023-08-25T04:16:01.735373+0000","last_fullsized":"2023-08-25T04:16:01.735373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:07:17.746068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509602,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58804,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313036,"statfs":{"total":96636764160,"available":96576548864,"internally_reserved":0,"allocated":1286144,"data_stored":919872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72399999999999998,"15min":0.71099999999999997},"min":{"1min":0.57999999999999996,"5min":0.442,"15min":0.29199999999999998},"max":{"1min":0.996,"5min":0.996,"15min":1.0189999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.752,"15min":0.71499999999999997},"min":{"1min":0.58199999999999996,"5min":0.42099999999999999,"15min":0.39000000000000001},"max":{"1min":0.89500000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.70299999999999996}]},{"osd":1,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.55100000000000005,"5min":0.45500000000000002,"15min":0.42699999999999999},"max":{"1min":0.95699999999999996,"5min":1.0149999999999999,"15min":1.034},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76900000000000002,"15min":0.73299999999999998},"min":{"1min":0.59299999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.91700000000000004,"5min":0.98799999999999999,"15min":1.036},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.60499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.94499999999999995,"5min":1.018,"15min":1.018},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.751},"min":{"1min":0.51500000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94999999999999996,"5min":0.999,"15min":0.999},"last":0.83699999999999997}]},{"osd":3,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.74399999999999999},"min":{"1min":0.57399999999999995,"5min":0.48199999999999998,"15min":0.41899999999999998},"max":{"1min":0.92900000000000005,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.58499999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0449999999999999},"last":0.86099999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57099999999999995,"15min":0.59499999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.32400000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.98899999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.628},"min":{"1min":0.48299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.75600000000000001,"5min":0.82599999999999996,"15min":0.96699999999999997},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.63600000000000001},"min":{"1min":0.438,"5min":0.433,"15min":0.38100000000000001},"max":{"1min":0.77600000000000002,"5min":0.98399999999999999,"15min":0.998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.63,"15min":0.66100000000000003},"min":{"1min":0.45000000000000001,"5min":0.41799999999999998,"15min":0.40000000000000002},"max":{"1min":0.79400000000000004,"5min":0.93799999999999994,"15min":1.0349999999999999},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.5,"5min":0.498,"15min":0.436},"max":{"1min":0.95699999999999996,"5min":1.0009999999999999,"15min":1.0620000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.68999999999999995},"min":{"1min":0.45100000000000001,"5min":0.433,"15min":0.42399999999999999},"max":{"1min":0.84499999999999997,"5min":0.91700000000000004,"15min":0.98299999999999998},"last":0.64400000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509602,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36016,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335824,"statfs":{"total":96636764160,"available":96599883776,"internally_reserved":0,"allocated":692224,"data_stored":329504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72599999999999998,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.36499999999999999},"max":{"1min":0.93400000000000005,"5min":0.96199999999999997,"15min":1.0369999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.69799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.33800000000000002},"max":{"1min":0.96899999999999997,"5min":1.054,"15min":1.071},"last":0.80400000000000005}]},{"osd":1,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.751,"15min":0.73299999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.436},"max":{"1min":1.002,"5min":1.0369999999999999,"15min":1.1559999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.503,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98699999999999999,"5min":1.077,"15min":1.077},"last":0.78200000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.753,"15min":0.749},"min":{"1min":0.52900000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.97999999999999998,"5min":1.1020000000000001,"15min":1.139},"last":0.876},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.81100000000000005,"15min":0.80600000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54400000000000004},"max":{"1min":0.96699999999999997,"5min":1.0469999999999999,"15min":1.117},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.751,"15min":0.74399999999999999},"min":{"1min":0.58799999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.077},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.56000000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94999999999999996,"5min":1.0249999999999999,"15min":1.679},"last":0.84599999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58299999999999996,"15min":0.622},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79200000000000004,"5min":0.93200000000000005,"15min":0.93400000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57599999999999996,"15min":0.629},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78200000000000003,"5min":0.95799999999999996,"15min":1.306},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.625,"15min":0.68400000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82599999999999996,"5min":1.0329999999999999,"15min":1.123},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71599999999999997,"15min":0.76600000000000001},"min":{"1min":0.443,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.97599999999999998,"5min":1.0209999999999999,"15min":1.5589999999999999},"last":0.59899999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64900000000000002,"15min":0.68999999999999995},"min":{"1min":0.443,"5min":0.434,"15min":0.434},"max":{"1min":0.82899999999999996,"5min":0.99099999999999999,"15min":1.1950000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67200000000000004,"15min":0.72599999999999998},"min":{"1min":0.45200000000000001,"5min":0.44700000000000001,"15min":0.41799999999999998},"max":{"1min":0.91200000000000003,"5min":1.012,"15min":1.4099999999999999},"last":0.55500000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542305,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":692224,"data_stored":329504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72599999999999998,"15min":0.70799999999999996},"min":{"1min":0.53300000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90600000000000003,"5min":0.93700000000000006,"15min":1.018},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.60699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.97999999999999998,"5min":0.995,"15min":1.0409999999999999},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76000000000000001,"15min":0.74299999999999999},"min":{"1min":0.58099999999999996,"5min":0.43099999999999999,"15min":0.36499999999999999},"max":{"1min":0.95299999999999996,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.753,"15min":0.73399999999999999},"min":{"1min":0.57499999999999996,"5min":0.48699999999999999,"15min":0.46200000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.49399999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.749,"15min":0.72799999999999998},"min":{"1min":0.64300000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.86899999999999999,"5min":0.97499999999999998,"15min":1.0269999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.755,"15min":0.75900000000000001},"min":{"1min":0.623,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":0.95999999999999996,"5min":1.006,"15min":1.2290000000000001},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.748,"15min":0.73599999999999999},"min":{"1min":0.59099999999999997,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.93500000000000005,"5min":0.94199999999999995,"15min":1.4590000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78400000000000003,"15min":0.77200000000000002},"min":{"1min":0.57599999999999996,"5min":0.53000000000000003,"15min":0.498},"max":{"1min":0.92000000000000004,"5min":1.018,"15min":1.1479999999999999},"last":0.68899999999999995}]},{"osd":4,"last update":"Fri Aug 25 04:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58399999999999996,"15min":0.61199999999999999},"min":{"1min":0.46400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78700000000000003,"5min":0.97099999999999997,"15min":1.038},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60299999999999998,"15min":0.63700000000000001},"min":{"1min":0.45800000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85599999999999998,"5min":0.878,"15min":0.99199999999999999},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.623,"15min":0.66900000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93700000000000006,"5min":1.008,"15min":1.256},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.67800000000000005},"min":{"1min":0.46400000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.78700000000000003,"5min":0.88700000000000001,"15min":1.4650000000000001},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58699999999999997,"15min":0.64700000000000002},"min":{"1min":0.436,"5min":0.375,"15min":0.375},"max":{"1min":0.72299999999999998,"5min":1.032,"15min":1.2769999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68600000000000005,"15min":0.72799999999999998},"min":{"1min":0.51800000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90000000000000002,"5min":1.048,"15min":1.1819999999999999},"last":0.629}]}]},{"osd":4,"up_from":14,"seq":60129542305,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36016,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335824,"statfs":{"total":96636764160,"available":96599883776,"internally_reserved":0,"allocated":692224,"data_stored":329504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72999999999999998,"15min":0.70199999999999996},"min":{"1min":0.60399999999999998,"5min":0.42299999999999999,"15min":0.32700000000000001},"max":{"1min":0.89000000000000001,"5min":0.99299999999999999,"15min":1.2649999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72499999999999998,"15min":0.69699999999999995},"min":{"1min":0.58899999999999997,"5min":0.48499999999999999,"15min":0.441},"max":{"1min":0.86699999999999999,"5min":0.89900000000000002,"15min":1.1639999999999999},"last":0.77300000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.747,"15min":0.71399999999999997},"min":{"1min":0.59799999999999998,"5min":0.46400000000000002,"15min":0.36199999999999999},"max":{"1min":0.96499999999999997,"5min":1.0189999999999999,"15min":1.0449999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77000000000000002,"15min":0.74399999999999999},"min":{"1min":0.58899999999999997,"5min":0.56799999999999995,"15min":0.36799999999999999},"max":{"1min":0.95599999999999996,"5min":1.099,"15min":1.099},"last":0.74299999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78700000000000003,"15min":0.75900000000000001},"min":{"1min":0.66300000000000003,"5min":0.57599999999999996,"15min":0.39100000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.877},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77300000000000002,"15min":0.73499999999999999},"min":{"1min":0.67200000000000004,"5min":0.503,"15min":0.34000000000000002},"max":{"1min":0.94599999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.83699999999999997}]},{"osd":3,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.76800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.45100000000000001},"max":{"1min":0.98299999999999998,"5min":1.016,"15min":1.048},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.78000000000000003,"15min":0.76000000000000001},"min":{"1min":0.629,"5min":0.52400000000000002,"15min":0.48399999999999999},"max":{"1min":1.008,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.86399999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.41099999999999998,"5min":0.39400000000000002,"15min":0.32200000000000001},"max":{"1min":0.753,"5min":0.88400000000000001,"15min":0.94899999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.60499999999999998},"min":{"1min":0.48299999999999998,"5min":0.38500000000000001,"15min":0.33200000000000002},"max":{"1min":0.73199999999999998,"5min":0.91200000000000003,"15min":0.92100000000000004},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.59399999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.014,"5min":1.0309999999999999,"15min":1.0620000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64500000000000002,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.874,"5min":0.97499999999999998,"15min":1.026},"last":0.63100000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.621,"15min":0.63500000000000001},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.36699999999999999},"max":{"1min":0.87,"5min":0.90400000000000003,"15min":1.0609999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69699999999999995,"15min":0.72199999999999998},"min":{"1min":0.55400000000000005,"5min":0.498,"15min":0.39300000000000002},"max":{"1min":0.88400000000000001,"5min":0.98399999999999999,"15min":1.0940000000000001},"last":0.81200000000000006}]}]},{"osd":3,"up_from":14,"seq":60129542305,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36016,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335824,"statfs":{"total":96636764160,"available":96599883776,"internally_reserved":0,"allocated":692224,"data_stored":329504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46000000000000002,"15min":0.442},"min":{"1min":0.34499999999999997,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.56699999999999995,"5min":0.747,"15min":0.96899999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.77100000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.371}]},{"osd":1,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.497,"15min":0.48699999999999999},"min":{"1min":0.34699999999999998,"5min":0.33600000000000002,"15min":0.27000000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.746},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.58999999999999997},"min":{"1min":0.47199999999999998,"5min":0.41799999999999998,"15min":0.38500000000000001},"max":{"1min":0.76500000000000001,"5min":0.85799999999999998,"15min":0.92600000000000005},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57799999999999996,"15min":0.56499999999999995},"min":{"1min":0.41799999999999998,"5min":0.40600000000000003,"15min":0.34699999999999998},"max":{"1min":0.67300000000000004,"5min":1.01,"15min":1.01},"last":0.441},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.379,"15min":0.35299999999999998},"max":{"1min":0.67700000000000005,"5min":0.81699999999999995,"15min":0.89600000000000002},"last":0.46800000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78100000000000003,"15min":0.75600000000000001},"min":{"1min":0.57999999999999996,"5min":0.53100000000000003,"15min":0.46800000000000003},"max":{"1min":1.214,"5min":1.214,"15min":1.4339999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.81299999999999994},"min":{"1min":0.63800000000000001,"5min":0.59399999999999997,"15min":0.48899999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.343},"last":0.78200000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.61199999999999999,"5min":0.52900000000000003,"15min":0.51500000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.321},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80900000000000005,"15min":0.79500000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.48099999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.4750000000000001},"last":0.84499999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.83499999999999996,"15min":0.80800000000000005},"min":{"1min":0.60399999999999998,"5min":0.55300000000000005,"15min":0.53100000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.2010000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.61199999999999999,"5min":0.52000000000000002,"15min":0.50700000000000001},"max":{"1min":1.0800000000000001,"5min":1.097,"15min":1.3600000000000001},"last":0.72699999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.85199999999999998,"15min":0.83999999999999997},"min":{"1min":0.66200000000000003,"5min":0.60899999999999999,"15min":0.57099999999999995},"max":{"1min":1.077,"5min":1.1080000000000001,"15min":1.383},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80900000000000005,"15min":0.79500000000000004},"min":{"1min":0.58299999999999996,"5min":0.55600000000000005,"15min":0.54000000000000004},"max":{"1min":1.0669999999999999,"5min":1.1160000000000001,"15min":1.4019999999999999},"last":0.82799999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542306,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54052,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317788,"statfs":{"total":96636764160,"available":96581414912,"internally_reserved":0,"allocated":679936,"data_stored":323334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.45900000000000002,"15min":0.46899999999999997},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":0.61599999999999999,"5min":0.76100000000000001,"15min":1.196},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.496},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.28599999999999998},"max":{"1min":0.72499999999999998,"5min":0.75600000000000001,"15min":1.4019999999999999},"last":0.38800000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":1.482},"last":0.5},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60599999999999998,"15min":0.60199999999999998},"min":{"1min":0.44700000000000001,"5min":0.41999999999999998,"15min":0.36699999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":1.458},"last":0.51200000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53300000000000003,"15min":0.52800000000000002},"min":{"1min":0.41699999999999998,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.754,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.44800000000000001,"5min":0.41299999999999998,"15min":0.33700000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.95599999999999996},"last":0.42499999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.80800000000000005,"15min":0.79600000000000004},"min":{"1min":0.61499999999999999,"5min":0.52200000000000002,"15min":0.499},"max":{"1min":0.98899999999999999,"5min":1.2330000000000001,"15min":1.2569999999999999},"last":0.87},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78700000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.47599999999999998},"max":{"1min":1.026,"5min":1.117,"15min":1.5509999999999999},"last":0.80800000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80800000000000005,"15min":0.80100000000000005},"min":{"1min":0.54100000000000004,"5min":0.498,"15min":0.47999999999999998},"max":{"1min":1.014,"5min":1.1140000000000001,"15min":1.2789999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81100000000000005,"15min":0.80800000000000005},"min":{"1min":0.59699999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.026,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84299999999999997,"15min":0.83899999999999997},"min":{"1min":0.67600000000000005,"5min":0.57399999999999995,"15min":0.56000000000000005},"max":{"1min":1.0609999999999999,"5min":1.1910000000000001,"15min":1.2110000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.875,"15min":0.85199999999999998},"min":{"1min":0.65700000000000003,"5min":0.61199999999999999,"15min":0.55600000000000005},"max":{"1min":1.0660000000000001,"5min":1.278,"15min":1.375},"last":0.89900000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.53700000000000003,"15min":0.49199999999999999},"max":{"1min":0.96899999999999997,"5min":1.2090000000000001,"15min":1.339},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.81100000000000005,"15min":0.81299999999999994},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.51000000000000001},"max":{"1min":1.081,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.93999999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542306,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":679936,"data_stored":323334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46999999999999997,"15min":0.47099999999999997},"min":{"1min":0.33300000000000002,"5min":0.28399999999999997,"15min":0.27400000000000002},"max":{"1min":0.68999999999999995,"5min":0.85599999999999998,"15min":1.218},"last":0.439},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.36699999999999999,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":0.93300000000000005,"15min":1.153},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51100000000000001,"15min":0.504},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.30599999999999999},"max":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":1.347},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.48099999999999998,"5min":0.40000000000000002,"15min":0.36499999999999999},"max":{"1min":0.76000000000000001,"5min":1.02,"15min":1.093},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63600000000000001,"15min":0.623},"min":{"1min":0.46800000000000003,"5min":0.45300000000000001,"15min":0.40699999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":1.1459999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":1.2190000000000001},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80800000000000005,"15min":0.79400000000000004},"min":{"1min":0.56799999999999995,"5min":0.51600000000000001,"15min":0.45800000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.47},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83899999999999997,"15min":0.82399999999999995},"min":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.504},"max":{"1min":1.1830000000000001,"5min":1.244,"15min":1.395},"last":0.624}]},{"osd":5,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.82999999999999996,"15min":0.80600000000000005},"min":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.45100000000000001},"max":{"1min":1.1579999999999999,"5min":1.2090000000000001,"15min":1.292},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.83399999999999996,"15min":0.83299999999999996},"min":{"1min":0.64100000000000001,"5min":0.54700000000000004,"15min":0.51000000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.57399999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85299999999999998,"15min":0.85199999999999998},"min":{"1min":0.63500000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.569},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.83199999999999996,"15min":0.81399999999999995},"min":{"1min":0.67800000000000005,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.355},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83999999999999997,"15min":0.82999999999999996},"min":{"1min":0.65400000000000003,"5min":0.59299999999999997,"15min":0.56799999999999995},"max":{"1min":1.1240000000000001,"5min":1.2949999999999999,"15min":1.5429999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.876,"15min":0.85599999999999998},"min":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.54500000000000004},"max":{"1min":1.1140000000000001,"5min":1.3120000000000001,"15min":1.504},"last":0.67900000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542305,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1286144,"data_stored":919872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.48699999999999999,"15min":0.48299999999999998},"min":{"1min":0.35299999999999998,"5min":0.317,"15min":0.26800000000000002},"max":{"1min":0.66400000000000003,"5min":0.70799999999999996,"15min":0.79500000000000004},"last":0.372},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57599999999999996,"15min":0.54900000000000004},"min":{"1min":0.46600000000000003,"5min":0.41399999999999998,"15min":0.35499999999999998},"max":{"1min":0.70599999999999996,"5min":0.78500000000000003,"15min":0.876},"last":0.44}]},{"osd":2,"last update":"Fri Aug 25 04:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.40100000000000002,"5min":0.35899999999999999,"15min":0.32800000000000001},"max":{"1min":0.70899999999999996,"5min":0.90300000000000002,"15min":0.97499999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54300000000000004,"15min":0.52700000000000002},"min":{"1min":0.38300000000000001,"5min":0.35599999999999998,"15min":0.33700000000000002},"max":{"1min":0.76900000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.504}]},{"osd":3,"last update":"Fri Aug 25 04:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.50600000000000001,"15min":0.498},"min":{"1min":0.35599999999999998,"5min":0.313,"15min":0.30199999999999999},"max":{"1min":0.77600000000000002,"5min":0.79800000000000004,"15min":1.266},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.47199999999999998,"5min":0.432,"15min":0.39000000000000001},"max":{"1min":0.85099999999999998,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.45600000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.78000000000000003,"15min":0.79700000000000004},"min":{"1min":0.68799999999999994,"5min":0.503,"15min":0.503},"max":{"1min":1.028,"5min":1.127,"15min":1.306},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.80800000000000005,"15min":0.80700000000000005},"min":{"1min":0.72999999999999998,"5min":0.57299999999999995,"15min":0.436},"max":{"1min":1.089,"5min":1.131,"15min":1.262},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.64300000000000002,"5min":0.53600000000000003,"15min":0.52400000000000002},"max":{"1min":0.96599999999999997,"5min":1.097,"15min":1.4330000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.80700000000000005,"15min":0.81699999999999995},"min":{"1min":0.622,"5min":0.46999999999999997,"15min":0.45500000000000002},"max":{"1min":1.087,"5min":1.2230000000000001,"15min":1.373},"last":0.74099999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.80200000000000005,"15min":0.79600000000000004},"min":{"1min":0.68000000000000005,"5min":0.56799999999999995,"15min":0.53000000000000003},"max":{"1min":0.98899999999999999,"5min":1.115,"15min":1.349},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.83799999999999997,"15min":0.82699999999999996},"min":{"1min":0.78600000000000003,"5min":0.54800000000000004,"15min":0.47399999999999998},"max":{"1min":1.1060000000000001,"5min":1.194,"15min":1.331},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.84599999999999997,"15min":0.84799999999999998},"min":{"1min":0.753,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0640000000000001,"5min":1.1659999999999999,"15min":1.4059999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.80700000000000005,"15min":0.81499999999999995},"min":{"1min":0.64200000000000002,"5min":0.58299999999999996,"15min":0.499},"max":{"1min":1.0569999999999999,"5min":1.1930000000000001,"15min":1.3169999999999999},"last":0.67200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:16:08.291 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:16:08.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.469+0000 7ff966ae6640 1 Processor -- start 2023-08-25T04:16:08.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.469+0000 7ff966ae6640 1 -- start start 2023-08-25T04:16:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.469+0000 7ff966ae6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9600cdde0 0x7ff9600ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.469+0000 7ff966ae6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9600b29b0 con 0x7ff9600b2e40 2023-08-25T04:16:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.469+0000 7ff966ae6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9600b1dc0 con 0x7ff9600d0da0 2023-08-25T04:16:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.469+0000 7ff966ae6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600ce760 con 0x7ff9600cdde0 2023-08-25T04:16:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.469+0000 7ff965083640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff9600b2e40 0x7ff9600b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45984/0 (socket says 172.21.15.55:45984) 2023-08-25T04:16:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.469+0000 7ff965083640 1 -- 172.21.15.55:0/571485447 learned_addr learned my addr 172.21.15.55:0/571485447 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:16:08.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.469+0000 7ff957fff640 1 --2- 172.21.15.55:0/571485447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9600cdde0 0x7ff9600ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:08.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.469+0000 7ff9577fe640 1 -- 172.21.15.55:0/571485447 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888113549 0 0) 0x7ff9600b29b0 con 0x7ff9600b2e40 2023-08-25T04:16:08.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.469+0000 7ff9577fe640 1 -- 172.21.15.55:0/571485447 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff948003530 con 0x7ff9600b2e40 2023-08-25T04:16:08.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.469+0000 7ff9577fe640 1 -- 172.21.15.55:0/571485447 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748818251 0 0) 0x7ff9600b1dc0 con 0x7ff9600d0da0 2023-08-25T04:16:08.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.469+0000 7ff9577fe640 1 -- 172.21.15.55:0/571485447 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9600b29b0 con 0x7ff9600d0da0 2023-08-25T04:16:08.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.469+0000 7ff957fff640 1 -- 172.21.15.55:0/571485447 >> v1:172.21.15.110:6789/0 conn(0x7ff9600d0da0 legacy=0x7ff9600d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:08.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.469+0000 7ff957fff640 1 -- 172.21.15.55:0/571485447 >> v1:172.21.15.55:6789/0 conn(0x7ff9600b2e40 legacy=0x7ff9600b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:08.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.469+0000 7ff957fff640 1 -- 172.21.15.55:0/571485447 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9600b2080 con 0x7ff9600cdde0 2023-08-25T04:16:08.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.473+0000 7ff957fff640 1 --2- 172.21.15.55:0/571485447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9600cdde0 0x7ff9600ce220 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff9500097f0 tx=0x7ff95001ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2e09f7d468e6984 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:08.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.473+0000 7ff9577fe640 1 -- 172.21.15.55:0/571485447 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9500a89b0 con 0x7ff9600cdde0 2023-08-25T04:16:08.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.473+0000 7ff9577fe640 1 -- 172.21.15.55:0/571485447 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9500a8b10 con 0x7ff9600cdde0 2023-08-25T04:16:08.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.473+0000 7ff9577fe640 1 -- 172.21.15.55:0/571485447 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9500a8ea0 con 0x7ff9600cdde0 2023-08-25T04:16:08.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.473+0000 7ff966ae6640 1 -- 172.21.15.55:0/571485447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9600cdde0 msgr2=0x7ff9600ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:08.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.473+0000 7ff966ae6640 1 --2- 172.21.15.55:0/571485447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9600cdde0 0x7ff9600ce220 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff9500097f0 tx=0x7ff95001ecb0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.473+0000 7ff966ae6640 1 -- 172.21.15.55:0/571485447 shutdown_connections 2023-08-25T04:16:08.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.473+0000 7ff966ae6640 1 --2- 172.21.15.55:0/571485447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9600cdde0 0x7ff9600ce220 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.473+0000 7ff966ae6640 1 -- 172.21.15.55:0/571485447 >> 172.21.15.55:0/571485447 conn(0x7ff96009bae0 msgr2=0x7ff9600d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.473+0000 7ff966ae6640 1 -- 172.21.15.55:0/571485447 shutdown_connections 2023-08-25T04:16:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff966ae6640 1 -- 172.21.15.55:0/571485447 wait complete. 2023-08-25T04:16:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff966ae6640 1 Processor -- start 2023-08-25T04:16:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff966ae6640 1 -- start start 2023-08-25T04:16:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff966ae6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9600b2e40 0x7ff9600cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff966ae6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9600cdde0 0x7ff9600cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff966ae6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9600d0da0 0x7ff9600c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff966ae6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600c6700 con 0x7ff9600d0da0 2023-08-25T04:16:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff966ae6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600c69a0 con 0x7ff9600b2e40 2023-08-25T04:16:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff966ae6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9600c6c80 con 0x7ff9600cdde0 2023-08-25T04:16:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff965083640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9600d0da0 0x7ff9600c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff965083640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9600d0da0 0x7ff9600c78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40130/0 (socket says 172.21.15.55:40130) 2023-08-25T04:16:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff965083640 1 -- 172.21.15.55:0/3863316515 learned_addr learned my addr 172.21.15.55:0/3863316515 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff964882640 1 --2- 172.21.15.55:0/3863316515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9600b2e40 0x7ff9600cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff957fff640 1 --2- 172.21.15.55:0/3863316515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9600cdde0 0x7ff9600cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:08.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff965083640 1 -- 172.21.15.55:0/3863316515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9600cdde0 msgr2=0x7ff9600cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:08.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff965083640 1 --2- 172.21.15.55:0/3863316515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9600cdde0 0x7ff9600cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff965083640 1 -- 172.21.15.55:0/3863316515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9600b2e40 msgr2=0x7ff9600cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:08.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff965083640 1 --2- 172.21.15.55:0/3863316515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9600b2e40 0x7ff9600cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff965083640 1 -- 172.21.15.55:0/3863316515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff950009420 con 0x7ff9600d0da0 2023-08-25T04:16:08.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.477+0000 7ff965083640 1 --2- 172.21.15.55:0/3863316515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9600d0da0 0x7ff9600c78b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff95800caa0 tx=0x7ff95800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:08.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.481+0000 7ff9557fa640 1 -- 172.21.15.55:0/3863316515 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95800ac00 con 0x7ff9600d0da0 2023-08-25T04:16:08.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.481+0000 7ff9557fa640 1 -- 172.21.15.55:0/3863316515 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95800ad80 con 0x7ff9600d0da0 2023-08-25T04:16:08.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.481+0000 7ff9557fa640 1 -- 172.21.15.55:0/3863316515 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958012640 con 0x7ff9600d0da0 2023-08-25T04:16:08.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.481+0000 7ff966ae6640 1 -- 172.21.15.55:0/3863316515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9600c6f60 con 0x7ff9600d0da0 2023-08-25T04:16:08.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.481+0000 7ff966ae6640 1 -- 172.21.15.55:0/3863316515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff960151f60 con 0x7ff9600d0da0 2023-08-25T04:16:08.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.481+0000 7ff966ae6640 1 -- 172.21.15.55:0/3863316515 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96004dbe0 con 0x7ff9600d0da0 2023-08-25T04:16:08.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.481+0000 7ff9557fa640 1 -- 172.21.15.55:0/3863316515 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7ff958007070 con 0x7ff9600d0da0 2023-08-25T04:16:08.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.481+0000 7ff9557fa640 1 --2- 172.21.15.55:0/3863316515 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7ff94c0657a0 0x7ff94c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:08.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.481+0000 7ff9557fa640 1 -- 172.21.15.55:0/3863316515 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff958082e30 con 0x7ff9600d0da0 2023-08-25T04:16:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.481+0000 7ff964882640 1 --2- 172.21.15.55:0/3863316515 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7ff94c0657a0 0x7ff94c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.485+0000 7ff964882640 1 --2- 172.21.15.55:0/3863316515 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7ff94c0657a0 0x7ff94c067c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff95c001240 tx=0x7ff95c009040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:08.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.485+0000 7ff9557fa640 1 -- 172.21.15.55:0/3863316515 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff958050890 con 0x7ff9600d0da0 2023-08-25T04:16:08.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.637+0000 7ff966ae6640 1 -- 172.21.15.55:0/3863316515 --> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9600b2640 con 0x7ff94c0657a0 2023-08-25T04:16:08.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.645+0000 7ff9557fa640 1 -- 172.21.15.55:0/3863316515 <== mgr.5922 v2:172.21.15.110:6832/1373721950 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310905 (secure 0 0 0) 0x7ff95c001530 con 0x7ff94c0657a0 2023-08-25T04:16:08.649 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:16:08.650 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:16:08.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.649+0000 7ff966ae6640 1 -- 172.21.15.55:0/3863316515 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7ff94c0657a0 msgr2=0x7ff94c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:08.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.649+0000 7ff966ae6640 1 --2- 172.21.15.55:0/3863316515 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7ff94c0657a0 0x7ff94c067c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff95c001240 tx=0x7ff95c009040 comp rx=0 tx=0).stop 2023-08-25T04:16:08.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.649+0000 7ff966ae6640 1 -- 172.21.15.55:0/3863316515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9600d0da0 msgr2=0x7ff9600c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:08.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.649+0000 7ff966ae6640 1 --2- 172.21.15.55:0/3863316515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9600d0da0 0x7ff9600c78b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff95800caa0 tx=0x7ff95800cf60 comp rx=0 tx=0).stop 2023-08-25T04:16:08.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.649+0000 7ff966ae6640 1 -- 172.21.15.55:0/3863316515 shutdown_connections 2023-08-25T04:16:08.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.649+0000 7ff966ae6640 1 --2- 172.21.15.55:0/3863316515 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7ff94c0657a0 0x7ff94c067c60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.649+0000 7ff966ae6640 1 --2- 172.21.15.55:0/3863316515 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9600d0da0 0x7ff9600c78b0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.649+0000 7ff966ae6640 1 --2- 172.21.15.55:0/3863316515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9600cdde0 0x7ff9600cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.649+0000 7ff966ae6640 1 --2- 172.21.15.55:0/3863316515 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9600b2e40 0x7ff9600cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.649+0000 7ff966ae6640 1 -- 172.21.15.55:0/3863316515 >> 172.21.15.55:0/3863316515 conn(0x7ff96009bae0 msgr2=0x7ff96015be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:08.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.649+0000 7ff966ae6640 1 -- 172.21.15.55:0/3863316515 shutdown_connections 2023-08-25T04:16:08.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.649+0000 7ff966ae6640 1 -- 172.21.15.55:0/3863316515 wait complete. 2023-08-25T04:16:08.669 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-25T04:16:08.558610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":243,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":177,"ondisk_log_size":177,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317440,"kb_used_data":6920,"kb_used_omap":13,"kb_used_meta":310386,"kb_avail":754657280,"statfs":{"total":773094113280,"available":772769054720,"internally_reserved":0,"allocated":7086080,"data_stored":3984860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":317835352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001535"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148559+0000","last_change":"2023-08-25T04:16:03.761499+0000","last_active":"2023-08-25T04:16:05.148559+0000","last_peered":"2023-08-25T04:16:05.148559+0000","last_clean":"2023-08-25T04:16:05.148559+0000","last_became_active":"2023-08-25T04:16:03.761153+0000","last_became_peered":"2023-08-25T04:16:03.761153+0000","last_unstale":"2023-08-25T04:16:05.148559+0000","last_undegraded":"2023-08-25T04:16:05.148559+0000","last_fullsized":"2023-08-25T04:16:05.148559+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:37:23.181361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146928+0000","last_change":"2023-08-25T04:16:03.772387+0000","last_active":"2023-08-25T04:16:05.146928+0000","last_peered":"2023-08-25T04:16:05.146928+0000","last_clean":"2023-08-25T04:16:05.146928+0000","last_became_active":"2023-08-25T04:16:03.772074+0000","last_became_peered":"2023-08-25T04:16:03.772074+0000","last_unstale":"2023-08-25T04:16:05.146928+0000","last_undegraded":"2023-08-25T04:16:05.146928+0000","last_fullsized":"2023-08-25T04:16:05.146928+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:50.801153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765805+0000","last_change":"2023-08-25T04:16:03.784558+0000","last_active":"2023-08-25T04:16:04.765805+0000","last_peered":"2023-08-25T04:16:04.765805+0000","last_clean":"2023-08-25T04:16:04.765805+0000","last_became_active":"2023-08-25T04:16:03.784188+0000","last_became_peered":"2023-08-25T04:16:03.784188+0000","last_unstale":"2023-08-25T04:16:04.765805+0000","last_undegraded":"2023-08-25T04:16:04.765805+0000","last_fullsized":"2023-08-25T04:16:04.765805+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:48:59.520120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147224+0000","last_change":"2023-08-25T04:16:03.777815+0000","last_active":"2023-08-25T04:16:05.147224+0000","last_peered":"2023-08-25T04:16:05.147224+0000","last_clean":"2023-08-25T04:16:05.147224+0000","last_became_active":"2023-08-25T04:16:03.777534+0000","last_became_peered":"2023-08-25T04:16:03.777534+0000","last_unstale":"2023-08-25T04:16:05.147224+0000","last_undegraded":"2023-08-25T04:16:05.147224+0000","last_fullsized":"2023-08-25T04:16:05.147224+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:14:34.423119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748245+0000","last_change":"2023-08-25T04:16:03.773146+0000","last_active":"2023-08-25T04:16:04.748245+0000","last_peered":"2023-08-25T04:16:04.748245+0000","last_clean":"2023-08-25T04:16:04.748245+0000","last_became_active":"2023-08-25T04:16:03.772836+0000","last_became_peered":"2023-08-25T04:16:03.772836+0000","last_unstale":"2023-08-25T04:16:04.748245+0000","last_undegraded":"2023-08-25T04:16:04.748245+0000","last_fullsized":"2023-08-25T04:16:04.748245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:07:03.688469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148148+0000","last_change":"2023-08-25T04:16:03.770177+0000","last_active":"2023-08-25T04:16:05.148148+0000","last_peered":"2023-08-25T04:16:05.148148+0000","last_clean":"2023-08-25T04:16:05.148148+0000","last_became_active":"2023-08-25T04:16:03.769847+0000","last_became_peered":"2023-08-25T04:16:03.769847+0000","last_unstale":"2023-08-25T04:16:05.148148+0000","last_undegraded":"2023-08-25T04:16:05.148148+0000","last_fullsized":"2023-08-25T04:16:05.148148+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:45:01.763265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765553+0000","last_change":"2023-08-25T04:16:03.786842+0000","last_active":"2023-08-25T04:16:04.765553+0000","last_peered":"2023-08-25T04:16:04.765553+0000","last_clean":"2023-08-25T04:16:04.765553+0000","last_became_active":"2023-08-25T04:16:03.786519+0000","last_became_peered":"2023-08-25T04:16:03.786519+0000","last_unstale":"2023-08-25T04:16:04.765553+0000","last_undegraded":"2023-08-25T04:16:04.765553+0000","last_fullsized":"2023-08-25T04:16:04.765553+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:03:20.331759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149084+0000","last_change":"2023-08-25T04:16:03.785429+0000","last_active":"2023-08-25T04:16:05.149084+0000","last_peered":"2023-08-25T04:16:05.149084+0000","last_clean":"2023-08-25T04:16:05.149084+0000","last_became_active":"2023-08-25T04:16:03.785135+0000","last_became_peered":"2023-08-25T04:16:03.785135+0000","last_unstale":"2023-08-25T04:16:05.149084+0000","last_undegraded":"2023-08-25T04:16:05.149084+0000","last_fullsized":"2023-08-25T04:16:05.149084+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:53:50.169207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149288+0000","last_change":"2023-08-25T04:16:03.789063+0000","last_active":"2023-08-25T04:16:05.149288+0000","last_peered":"2023-08-25T04:16:05.149288+0000","last_clean":"2023-08-25T04:16:05.149288+0000","last_became_active":"2023-08-25T04:16:03.788776+0000","last_became_peered":"2023-08-25T04:16:03.788776+0000","last_unstale":"2023-08-25T04:16:05.149288+0000","last_undegraded":"2023-08-25T04:16:05.149288+0000","last_fullsized":"2023-08-25T04:16:05.149288+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:07:11.743677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148632+0000","last_change":"2023-08-25T04:16:03.776557+0000","last_active":"2023-08-25T04:16:05.148632+0000","last_peered":"2023-08-25T04:16:05.148632+0000","last_clean":"2023-08-25T04:16:05.148632+0000","last_became_active":"2023-08-25T04:16:03.776251+0000","last_became_peered":"2023-08-25T04:16:03.776251+0000","last_unstale":"2023-08-25T04:16:05.148632+0000","last_undegraded":"2023-08-25T04:16:05.148632+0000","last_fullsized":"2023-08-25T04:16:05.148632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:54:53.827365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.750560+0000","last_change":"2023-08-25T04:16:03.774830+0000","last_active":"2023-08-25T04:16:04.750560+0000","last_peered":"2023-08-25T04:16:04.750560+0000","last_clean":"2023-08-25T04:16:04.750560+0000","last_became_active":"2023-08-25T04:16:03.774536+0000","last_became_peered":"2023-08-25T04:16:03.774536+0000","last_unstale":"2023-08-25T04:16:04.750560+0000","last_undegraded":"2023-08-25T04:16:04.750560+0000","last_fullsized":"2023-08-25T04:16:04.750560+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:36.325046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148827+0000","last_change":"2023-08-25T04:16:03.756809+0000","last_active":"2023-08-25T04:16:05.148827+0000","last_peered":"2023-08-25T04:16:05.148827+0000","last_clean":"2023-08-25T04:16:05.148827+0000","last_became_active":"2023-08-25T04:16:03.756470+0000","last_became_peered":"2023-08-25T04:16:03.756470+0000","last_unstale":"2023-08-25T04:16:05.148827+0000","last_undegraded":"2023-08-25T04:16:05.148827+0000","last_fullsized":"2023-08-25T04:16:05.148827+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:21.805796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148382+0000","last_change":"2023-08-25T04:16:03.775897+0000","last_active":"2023-08-25T04:16:05.148382+0000","last_peered":"2023-08-25T04:16:05.148382+0000","last_clean":"2023-08-25T04:16:05.148382+0000","last_became_active":"2023-08-25T04:16:03.775606+0000","last_became_peered":"2023-08-25T04:16:03.775606+0000","last_unstale":"2023-08-25T04:16:05.148382+0000","last_undegraded":"2023-08-25T04:16:05.148382+0000","last_fullsized":"2023-08-25T04:16:05.148382+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:37:03.947281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765715+0000","last_change":"2023-08-25T04:16:03.786703+0000","last_active":"2023-08-25T04:16:04.765715+0000","last_peered":"2023-08-25T04:16:04.765715+0000","last_clean":"2023-08-25T04:16:04.765715+0000","last_became_active":"2023-08-25T04:16:03.786381+0000","last_became_peered":"2023-08-25T04:16:03.786381+0000","last_unstale":"2023-08-25T04:16:04.765715+0000","last_undegraded":"2023-08-25T04:16:04.765715+0000","last_fullsized":"2023-08-25T04:16:04.765715+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:33.769674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146248+0000","last_change":"2023-08-25T04:16:03.773379+0000","last_active":"2023-08-25T04:16:05.146248+0000","last_peered":"2023-08-25T04:16:05.146248+0000","last_clean":"2023-08-25T04:16:05.146248+0000","last_became_active":"2023-08-25T04:16:03.771783+0000","last_became_peered":"2023-08-25T04:16:03.771783+0000","last_unstale":"2023-08-25T04:16:05.146248+0000","last_undegraded":"2023-08-25T04:16:05.146248+0000","last_fullsized":"2023-08-25T04:16:05.146248+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:36:19.208784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148110+0000","last_change":"2023-08-25T04:16:03.775960+0000","last_active":"2023-08-25T04:16:05.148110+0000","last_peered":"2023-08-25T04:16:05.148110+0000","last_clean":"2023-08-25T04:16:05.148110+0000","last_became_active":"2023-08-25T04:16:03.775687+0000","last_became_peered":"2023-08-25T04:16:03.775687+0000","last_unstale":"2023-08-25T04:16:05.148110+0000","last_undegraded":"2023-08-25T04:16:05.148110+0000","last_fullsized":"2023-08-25T04:16:05.148110+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:44:04.110996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766206+0000","last_change":"2023-08-25T04:16:03.787692+0000","last_active":"2023-08-25T04:16:04.766206+0000","last_peered":"2023-08-25T04:16:04.766206+0000","last_clean":"2023-08-25T04:16:04.766206+0000","last_became_active":"2023-08-25T04:16:03.787397+0000","last_became_peered":"2023-08-25T04:16:03.787397+0000","last_unstale":"2023-08-25T04:16:04.766206+0000","last_undegraded":"2023-08-25T04:16:04.766206+0000","last_fullsized":"2023-08-25T04:16:04.766206+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:07:03.688469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147055+0000","last_change":"2023-08-25T04:16:03.776606+0000","last_active":"2023-08-25T04:16:05.147055+0000","last_peered":"2023-08-25T04:16:05.147055+0000","last_clean":"2023-08-25T04:16:05.147055+0000","last_became_active":"2023-08-25T04:16:03.776241+0000","last_became_peered":"2023-08-25T04:16:03.776241+0000","last_unstale":"2023-08-25T04:16:05.147055+0000","last_undegraded":"2023-08-25T04:16:05.147055+0000","last_fullsized":"2023-08-25T04:16:05.147055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:05:44.353136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765945+0000","last_change":"2023-08-25T04:16:03.787944+0000","last_active":"2023-08-25T04:16:04.765945+0000","last_peered":"2023-08-25T04:16:04.765945+0000","last_clean":"2023-08-25T04:16:04.765945+0000","last_became_active":"2023-08-25T04:16:03.787621+0000","last_became_peered":"2023-08-25T04:16:03.787621+0000","last_unstale":"2023-08-25T04:16:04.765945+0000","last_undegraded":"2023-08-25T04:16:04.765945+0000","last_fullsized":"2023-08-25T04:16:04.765945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:18:00.835206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748469+0000","last_change":"2023-08-25T04:16:03.776098+0000","last_active":"2023-08-25T04:16:04.748469+0000","last_peered":"2023-08-25T04:16:04.748469+0000","last_clean":"2023-08-25T04:16:04.748469+0000","last_became_active":"2023-08-25T04:16:03.775792+0000","last_became_peered":"2023-08-25T04:16:03.775792+0000","last_unstale":"2023-08-25T04:16:04.748469+0000","last_undegraded":"2023-08-25T04:16:04.748469+0000","last_fullsized":"2023-08-25T04:16:04.748469+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:45:15.044627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748469+0000","last_change":"2023-08-25T04:16:03.768123+0000","last_active":"2023-08-25T04:16:04.748469+0000","last_peered":"2023-08-25T04:16:04.748469+0000","last_clean":"2023-08-25T04:16:04.748469+0000","last_became_active":"2023-08-25T04:16:03.767768+0000","last_became_peered":"2023-08-25T04:16:03.767768+0000","last_unstale":"2023-08-25T04:16:04.748469+0000","last_undegraded":"2023-08-25T04:16:04.748469+0000","last_fullsized":"2023-08-25T04:16:04.748469+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:22:41.895685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148858+0000","last_change":"2023-08-25T04:16:03.785327+0000","last_active":"2023-08-25T04:16:05.148858+0000","last_peered":"2023-08-25T04:16:05.148858+0000","last_clean":"2023-08-25T04:16:05.148858+0000","last_became_active":"2023-08-25T04:16:03.785022+0000","last_became_peered":"2023-08-25T04:16:03.785022+0000","last_unstale":"2023-08-25T04:16:05.148858+0000","last_undegraded":"2023-08-25T04:16:05.148858+0000","last_fullsized":"2023-08-25T04:16:05.148858+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:26:44.775981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.750203+0000","last_change":"2023-08-25T04:16:03.769501+0000","last_active":"2023-08-25T04:16:04.750203+0000","last_peered":"2023-08-25T04:16:04.750203+0000","last_clean":"2023-08-25T04:16:04.750203+0000","last_became_active":"2023-08-25T04:16:03.769236+0000","last_became_peered":"2023-08-25T04:16:03.769236+0000","last_unstale":"2023-08-25T04:16:04.750203+0000","last_undegraded":"2023-08-25T04:16:04.750203+0000","last_fullsized":"2023-08-25T04:16:04.750203+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:58:58.749772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765491+0000","last_change":"2023-08-25T04:16:03.783410+0000","last_active":"2023-08-25T04:16:04.765491+0000","last_peered":"2023-08-25T04:16:04.765491+0000","last_clean":"2023-08-25T04:16:04.765491+0000","last_became_active":"2023-08-25T04:16:03.783117+0000","last_became_peered":"2023-08-25T04:16:03.783117+0000","last_unstale":"2023-08-25T04:16:04.765491+0000","last_undegraded":"2023-08-25T04:16:04.765491+0000","last_fullsized":"2023-08-25T04:16:04.765491+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:10:59.362603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766240+0000","last_change":"2023-08-25T04:16:03.782629+0000","last_active":"2023-08-25T04:16:04.766240+0000","last_peered":"2023-08-25T04:16:04.766240+0000","last_clean":"2023-08-25T04:16:04.766240+0000","last_became_active":"2023-08-25T04:16:03.782344+0000","last_became_peered":"2023-08-25T04:16:03.782344+0000","last_unstale":"2023-08-25T04:16:04.766240+0000","last_undegraded":"2023-08-25T04:16:04.766240+0000","last_fullsized":"2023-08-25T04:16:04.766240+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:55.150693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148884+0000","last_change":"2023-08-25T04:16:03.759410+0000","last_active":"2023-08-25T04:16:05.148884+0000","last_peered":"2023-08-25T04:16:05.148884+0000","last_clean":"2023-08-25T04:16:05.148884+0000","last_became_active":"2023-08-25T04:16:03.758840+0000","last_became_peered":"2023-08-25T04:16:03.758840+0000","last_unstale":"2023-08-25T04:16:05.148884+0000","last_undegraded":"2023-08-25T04:16:05.148884+0000","last_fullsized":"2023-08-25T04:16:05.148884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:24:29.741709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148710+0000","last_change":"2023-08-25T04:16:03.785204+0000","last_active":"2023-08-25T04:16:05.148710+0000","last_peered":"2023-08-25T04:16:05.148710+0000","last_clean":"2023-08-25T04:16:05.148710+0000","last_became_active":"2023-08-25T04:16:03.784847+0000","last_became_peered":"2023-08-25T04:16:03.784847+0000","last_unstale":"2023-08-25T04:16:05.148710+0000","last_undegraded":"2023-08-25T04:16:05.148710+0000","last_fullsized":"2023-08-25T04:16:05.148710+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:46.894701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748640+0000","last_change":"2023-08-25T04:16:03.756349+0000","last_active":"2023-08-25T04:16:04.748640+0000","last_peered":"2023-08-25T04:16:04.748640+0000","last_clean":"2023-08-25T04:16:04.748640+0000","last_became_active":"2023-08-25T04:16:03.755958+0000","last_became_peered":"2023-08-25T04:16:03.755958+0000","last_unstale":"2023-08-25T04:16:04.748640+0000","last_undegraded":"2023-08-25T04:16:04.748640+0000","last_fullsized":"2023-08-25T04:16:04.748640+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:34:35.864224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765730+0000","last_change":"2023-08-25T04:16:03.783135+0000","last_active":"2023-08-25T04:16:04.765730+0000","last_peered":"2023-08-25T04:16:04.765730+0000","last_clean":"2023-08-25T04:16:04.765730+0000","last_became_active":"2023-08-25T04:16:03.782771+0000","last_became_peered":"2023-08-25T04:16:03.782771+0000","last_unstale":"2023-08-25T04:16:04.765730+0000","last_undegraded":"2023-08-25T04:16:04.765730+0000","last_fullsized":"2023-08-25T04:16:04.765730+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:17:20.793802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146616+0000","last_change":"2023-08-25T04:16:03.769209+0000","last_active":"2023-08-25T04:16:05.146616+0000","last_peered":"2023-08-25T04:16:05.146616+0000","last_clean":"2023-08-25T04:16:05.146616+0000","last_became_active":"2023-08-25T04:16:03.768666+0000","last_became_peered":"2023-08-25T04:16:03.768666+0000","last_unstale":"2023-08-25T04:16:05.146616+0000","last_undegraded":"2023-08-25T04:16:05.146616+0000","last_fullsized":"2023-08-25T04:16:05.146616+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:16:49.457554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765637+0000","last_change":"2023-08-25T04:16:03.780860+0000","last_active":"2023-08-25T04:16:04.765637+0000","last_peered":"2023-08-25T04:16:04.765637+0000","last_clean":"2023-08-25T04:16:04.765637+0000","last_became_active":"2023-08-25T04:16:03.780552+0000","last_became_peered":"2023-08-25T04:16:03.780552+0000","last_unstale":"2023-08-25T04:16:04.765637+0000","last_undegraded":"2023-08-25T04:16:04.765637+0000","last_fullsized":"2023-08-25T04:16:04.765637+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:32:56.502762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146400+0000","last_change":"2023-08-25T04:16:03.759257+0000","last_active":"2023-08-25T04:16:05.146400+0000","last_peered":"2023-08-25T04:16:05.146400+0000","last_clean":"2023-08-25T04:16:05.146400+0000","last_became_active":"2023-08-25T04:16:03.758689+0000","last_became_peered":"2023-08-25T04:16:03.758689+0000","last_unstale":"2023-08-25T04:16:05.146400+0000","last_undegraded":"2023-08-25T04:16:05.146400+0000","last_fullsized":"2023-08-25T04:16:05.146400+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:31:23.845883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146117+0000","last_change":"2023-08-25T04:16:03.772450+0000","last_active":"2023-08-25T04:16:05.146117+0000","last_peered":"2023-08-25T04:16:05.146117+0000","last_clean":"2023-08-25T04:16:05.146117+0000","last_became_active":"2023-08-25T04:16:03.772138+0000","last_became_peered":"2023-08-25T04:16:03.772138+0000","last_unstale":"2023-08-25T04:16:05.146117+0000","last_undegraded":"2023-08-25T04:16:05.146117+0000","last_fullsized":"2023-08-25T04:16:05.146117+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:30:15.714145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"61'4","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748428+0000","last_change":"2023-08-25T04:16:02.754044+0000","last_active":"2023-08-25T04:16:04.748428+0000","last_peered":"2023-08-25T04:16:04.748428+0000","last_clean":"2023-08-25T04:16:04.748428+0000","last_became_active":"2023-08-25T04:16:02.753745+0000","last_became_peered":"2023-08-25T04:16:02.753745+0000","last_unstale":"2023-08-25T04:16:04.748428+0000","last_undegraded":"2023-08-25T04:16:04.748428+0000","last_fullsized":"2023-08-25T04:16:04.748428+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:31.834153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146631+0000","last_change":"2023-08-25T04:16:03.770251+0000","last_active":"2023-08-25T04:16:05.146631+0000","last_peered":"2023-08-25T04:16:05.146631+0000","last_clean":"2023-08-25T04:16:05.146631+0000","last_became_active":"2023-08-25T04:16:03.769936+0000","last_became_peered":"2023-08-25T04:16:03.769936+0000","last_unstale":"2023-08-25T04:16:05.146631+0000","last_undegraded":"2023-08-25T04:16:05.146631+0000","last_fullsized":"2023-08-25T04:16:05.146631+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:38.733640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148725+0000","last_change":"2023-08-25T04:16:02.770511+0000","last_active":"2023-08-25T04:16:05.148725+0000","last_peered":"2023-08-25T04:16:05.148725+0000","last_clean":"2023-08-25T04:16:05.148725+0000","last_became_active":"2023-08-25T04:16:02.770243+0000","last_became_peered":"2023-08-25T04:16:02.770243+0000","last_unstale":"2023-08-25T04:16:05.148725+0000","last_undegraded":"2023-08-25T04:16:05.148725+0000","last_fullsized":"2023-08-25T04:16:05.148725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:45.356869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748134+0000","last_change":"2023-08-25T04:16:03.768344+0000","last_active":"2023-08-25T04:16:04.748134+0000","last_peered":"2023-08-25T04:16:04.748134+0000","last_clean":"2023-08-25T04:16:04.748134+0000","last_became_active":"2023-08-25T04:16:03.767937+0000","last_became_peered":"2023-08-25T04:16:03.767937+0000","last_unstale":"2023-08-25T04:16:04.748134+0000","last_undegraded":"2023-08-25T04:16:04.748134+0000","last_fullsized":"2023-08-25T04:16:04.748134+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:31:47.264743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148875+0000","last_change":"2023-08-25T04:16:02.758582+0000","last_active":"2023-08-25T04:16:05.148875+0000","last_peered":"2023-08-25T04:16:05.148875+0000","last_clean":"2023-08-25T04:16:05.148875+0000","last_became_active":"2023-08-25T04:16:02.757685+0000","last_became_peered":"2023-08-25T04:16:02.757685+0000","last_unstale":"2023-08-25T04:16:05.148875+0000","last_undegraded":"2023-08-25T04:16:05.148875+0000","last_fullsized":"2023-08-25T04:16:05.148875+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:44:00.828275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149146+0000","last_change":"2023-08-25T04:16:03.758896+0000","last_active":"2023-08-25T04:16:05.149146+0000","last_peered":"2023-08-25T04:16:05.149146+0000","last_clean":"2023-08-25T04:16:05.149146+0000","last_became_active":"2023-08-25T04:16:03.758622+0000","last_became_peered":"2023-08-25T04:16:03.758622+0000","last_unstale":"2023-08-25T04:16:05.149146+0000","last_undegraded":"2023-08-25T04:16:05.149146+0000","last_fullsized":"2023-08-25T04:16:05.149146+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:25.716695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147155+0000","last_change":"2023-08-25T04:16:02.767008+0000","last_active":"2023-08-25T04:16:05.147155+0000","last_peered":"2023-08-25T04:16:05.147155+0000","last_clean":"2023-08-25T04:16:05.147155+0000","last_became_active":"2023-08-25T04:16:02.766694+0000","last_became_peered":"2023-08-25T04:16:02.766694+0000","last_unstale":"2023-08-25T04:16:05.147155+0000","last_undegraded":"2023-08-25T04:16:05.147155+0000","last_fullsized":"2023-08-25T04:16:05.147155+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:50:23.007130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748939+0000","last_change":"2023-08-25T04:16:03.779198+0000","last_active":"2023-08-25T04:16:04.748939+0000","last_peered":"2023-08-25T04:16:04.748939+0000","last_clean":"2023-08-25T04:16:04.748939+0000","last_became_active":"2023-08-25T04:16:03.778920+0000","last_became_peered":"2023-08-25T04:16:03.778920+0000","last_unstale":"2023-08-25T04:16:04.748939+0000","last_undegraded":"2023-08-25T04:16:04.748939+0000","last_fullsized":"2023-08-25T04:16:04.748939+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:55.150693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765740+0000","last_change":"2023-08-25T04:16:02.766806+0000","last_active":"2023-08-25T04:16:04.765740+0000","last_peered":"2023-08-25T04:16:04.765740+0000","last_clean":"2023-08-25T04:16:04.765740+0000","last_became_active":"2023-08-25T04:16:02.766547+0000","last_became_peered":"2023-08-25T04:16:02.766547+0000","last_unstale":"2023-08-25T04:16:04.765740+0000","last_undegraded":"2023-08-25T04:16:04.765740+0000","last_fullsized":"2023-08-25T04:16:04.765740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:02.787535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146412+0000","last_change":"2023-08-25T04:16:03.775323+0000","last_active":"2023-08-25T04:16:05.146412+0000","last_peered":"2023-08-25T04:16:05.146412+0000","last_clean":"2023-08-25T04:16:05.146412+0000","last_became_active":"2023-08-25T04:16:03.774876+0000","last_became_peered":"2023-08-25T04:16:03.774876+0000","last_unstale":"2023-08-25T04:16:05.146412+0000","last_undegraded":"2023-08-25T04:16:05.146412+0000","last_fullsized":"2023-08-25T04:16:05.146412+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:26:24.667103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.747983+0000","last_change":"2023-08-25T04:16:02.756878+0000","last_active":"2023-08-25T04:16:04.747983+0000","last_peered":"2023-08-25T04:16:04.747983+0000","last_clean":"2023-08-25T04:16:04.747983+0000","last_became_active":"2023-08-25T04:16:02.756603+0000","last_became_peered":"2023-08-25T04:16:02.756603+0000","last_unstale":"2023-08-25T04:16:04.747983+0000","last_undegraded":"2023-08-25T04:16:04.747983+0000","last_fullsized":"2023-08-25T04:16:04.747983+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:49:46.810312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149187+0000","last_change":"2023-08-25T04:16:03.759222+0000","last_active":"2023-08-25T04:16:05.149187+0000","last_peered":"2023-08-25T04:16:05.149187+0000","last_clean":"2023-08-25T04:16:05.149187+0000","last_became_active":"2023-08-25T04:16:03.758489+0000","last_became_peered":"2023-08-25T04:16:03.758489+0000","last_unstale":"2023-08-25T04:16:05.149187+0000","last_undegraded":"2023-08-25T04:16:05.149187+0000","last_fullsized":"2023-08-25T04:16:05.149187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:54:46.607192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748162+0000","last_change":"2023-08-25T04:16:02.757095+0000","last_active":"2023-08-25T04:16:04.748162+0000","last_peered":"2023-08-25T04:16:04.748162+0000","last_clean":"2023-08-25T04:16:04.748162+0000","last_became_active":"2023-08-25T04:16:02.756829+0000","last_became_peered":"2023-08-25T04:16:02.756829+0000","last_unstale":"2023-08-25T04:16:04.748162+0000","last_undegraded":"2023-08-25T04:16:04.748162+0000","last_fullsized":"2023-08-25T04:16:04.748162+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:36.997870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147325+0000","last_change":"2023-08-25T04:16:03.785771+0000","last_active":"2023-08-25T04:16:05.147325+0000","last_peered":"2023-08-25T04:16:05.147325+0000","last_clean":"2023-08-25T04:16:05.147325+0000","last_became_active":"2023-08-25T04:16:03.785442+0000","last_became_peered":"2023-08-25T04:16:03.785442+0000","last_unstale":"2023-08-25T04:16:05.147325+0000","last_undegraded":"2023-08-25T04:16:05.147325+0000","last_fullsized":"2023-08-25T04:16:05.147325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:32:17.663807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765509+0000","last_change":"2023-08-25T04:16:02.766205+0000","last_active":"2023-08-25T04:16:04.765509+0000","last_peered":"2023-08-25T04:16:04.765509+0000","last_clean":"2023-08-25T04:16:04.765509+0000","last_became_active":"2023-08-25T04:16:02.765799+0000","last_became_peered":"2023-08-25T04:16:02.765799+0000","last_unstale":"2023-08-25T04:16:04.765509+0000","last_undegraded":"2023-08-25T04:16:04.765509+0000","last_fullsized":"2023-08-25T04:16:04.765509+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:41:27.023839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748061+0000","last_change":"2023-08-25T04:16:03.772083+0000","last_active":"2023-08-25T04:16:04.748061+0000","last_peered":"2023-08-25T04:16:04.748061+0000","last_clean":"2023-08-25T04:16:04.748061+0000","last_became_active":"2023-08-25T04:16:03.771610+0000","last_became_peered":"2023-08-25T04:16:03.771610+0000","last_unstale":"2023-08-25T04:16:04.748061+0000","last_undegraded":"2023-08-25T04:16:04.748061+0000","last_fullsized":"2023-08-25T04:16:04.748061+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:43:45.063038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147100+0000","last_change":"2023-08-25T04:16:02.759755+0000","last_active":"2023-08-25T04:16:05.147100+0000","last_peered":"2023-08-25T04:16:05.147100+0000","last_clean":"2023-08-25T04:16:05.147100+0000","last_became_active":"2023-08-25T04:16:02.759428+0000","last_became_peered":"2023-08-25T04:16:02.759428+0000","last_unstale":"2023-08-25T04:16:05.147100+0000","last_undegraded":"2023-08-25T04:16:05.147100+0000","last_fullsized":"2023-08-25T04:16:05.147100+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:19.263285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146493+0000","last_change":"2023-08-25T04:16:03.773294+0000","last_active":"2023-08-25T04:16:05.146493+0000","last_peered":"2023-08-25T04:16:05.146493+0000","last_clean":"2023-08-25T04:16:05.146493+0000","last_became_active":"2023-08-25T04:16:03.773030+0000","last_became_peered":"2023-08-25T04:16:03.773030+0000","last_unstale":"2023-08-25T04:16:05.146493+0000","last_undegraded":"2023-08-25T04:16:05.146493+0000","last_fullsized":"2023-08-25T04:16:05.146493+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:05.189822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748935+0000","last_change":"2023-08-25T04:16:02.759993+0000","last_active":"2023-08-25T04:16:04.748935+0000","last_peered":"2023-08-25T04:16:04.748935+0000","last_clean":"2023-08-25T04:16:04.748935+0000","last_became_active":"2023-08-25T04:16:02.759674+0000","last_became_peered":"2023-08-25T04:16:02.759674+0000","last_unstale":"2023-08-25T04:16:04.748935+0000","last_undegraded":"2023-08-25T04:16:04.748935+0000","last_fullsized":"2023-08-25T04:16:04.748935+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:15:38.572849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765882+0000","last_change":"2023-08-25T04:16:03.787042+0000","last_active":"2023-08-25T04:16:04.765882+0000","last_peered":"2023-08-25T04:16:04.765882+0000","last_clean":"2023-08-25T04:16:04.765882+0000","last_became_active":"2023-08-25T04:16:03.786769+0000","last_became_peered":"2023-08-25T04:16:03.786769+0000","last_unstale":"2023-08-25T04:16:04.765882+0000","last_undegraded":"2023-08-25T04:16:04.765882+0000","last_fullsized":"2023-08-25T04:16:04.765882+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:08:24.248450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"61'3","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146559+0000","last_change":"2023-08-25T04:16:02.766795+0000","last_active":"2023-08-25T04:16:05.146559+0000","last_peered":"2023-08-25T04:16:05.146559+0000","last_clean":"2023-08-25T04:16:05.146559+0000","last_became_active":"2023-08-25T04:16:02.766468+0000","last_became_peered":"2023-08-25T04:16:02.766468+0000","last_unstale":"2023-08-25T04:16:05.146559+0000","last_undegraded":"2023-08-25T04:16:05.146559+0000","last_fullsized":"2023-08-25T04:16:05.146559+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:44:50.831742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748381+0000","last_change":"2023-08-25T04:16:03.772422+0000","last_active":"2023-08-25T04:16:04.748381+0000","last_peered":"2023-08-25T04:16:04.748381+0000","last_clean":"2023-08-25T04:16:04.748381+0000","last_became_active":"2023-08-25T04:16:03.771663+0000","last_became_peered":"2023-08-25T04:16:03.771663+0000","last_unstale":"2023-08-25T04:16:04.748381+0000","last_undegraded":"2023-08-25T04:16:04.748381+0000","last_fullsized":"2023-08-25T04:16:04.748381+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:14:16.042804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"61'6","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149058+0000","last_change":"2023-08-25T04:16:02.769516+0000","last_active":"2023-08-25T04:16:05.149058+0000","last_peered":"2023-08-25T04:16:05.149058+0000","last_clean":"2023-08-25T04:16:05.149058+0000","last_became_active":"2023-08-25T04:16:02.769170+0000","last_became_peered":"2023-08-25T04:16:02.769170+0000","last_unstale":"2023-08-25T04:16:05.149058+0000","last_undegraded":"2023-08-25T04:16:05.149058+0000","last_fullsized":"2023-08-25T04:16:05.149058+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:28:32.193662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147032+0000","last_change":"2023-08-25T04:16:03.769713+0000","last_active":"2023-08-25T04:16:05.147032+0000","last_peered":"2023-08-25T04:16:05.147032+0000","last_clean":"2023-08-25T04:16:05.147032+0000","last_became_active":"2023-08-25T04:16:03.769416+0000","last_became_peered":"2023-08-25T04:16:03.769416+0000","last_unstale":"2023-08-25T04:16:05.147032+0000","last_undegraded":"2023-08-25T04:16:05.147032+0000","last_fullsized":"2023-08-25T04:16:05.147032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:13:29.140582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765848+0000","last_change":"2023-08-25T04:16:02.762779+0000","last_active":"2023-08-25T04:16:04.765848+0000","last_peered":"2023-08-25T04:16:04.765848+0000","last_clean":"2023-08-25T04:16:04.765848+0000","last_became_active":"2023-08-25T04:16:02.762491+0000","last_became_peered":"2023-08-25T04:16:02.762491+0000","last_unstale":"2023-08-25T04:16:04.765848+0000","last_undegraded":"2023-08-25T04:16:04.765848+0000","last_fullsized":"2023-08-25T04:16:04.765848+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:54.292750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765959+0000","last_change":"2023-08-25T04:16:03.778616+0000","last_active":"2023-08-25T04:16:04.765959+0000","last_peered":"2023-08-25T04:16:04.765959+0000","last_clean":"2023-08-25T04:16:04.765959+0000","last_became_active":"2023-08-25T04:16:03.778334+0000","last_became_peered":"2023-08-25T04:16:03.778334+0000","last_unstale":"2023-08-25T04:16:04.765959+0000","last_undegraded":"2023-08-25T04:16:04.765959+0000","last_fullsized":"2023-08-25T04:16:04.765959+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:43:45.063038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748234+0000","last_change":"2023-08-25T04:16:02.761507+0000","last_active":"2023-08-25T04:16:04.748234+0000","last_peered":"2023-08-25T04:16:04.748234+0000","last_clean":"2023-08-25T04:16:04.748234+0000","last_became_active":"2023-08-25T04:16:02.761197+0000","last_became_peered":"2023-08-25T04:16:02.761197+0000","last_unstale":"2023-08-25T04:16:04.748234+0000","last_undegraded":"2023-08-25T04:16:04.748234+0000","last_fullsized":"2023-08-25T04:16:04.748234+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:38:28.867182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149039+0000","last_change":"2023-08-25T04:16:03.769037+0000","last_active":"2023-08-25T04:16:05.149039+0000","last_peered":"2023-08-25T04:16:05.149039+0000","last_clean":"2023-08-25T04:16:05.149039+0000","last_became_active":"2023-08-25T04:16:03.768748+0000","last_became_peered":"2023-08-25T04:16:03.768748+0000","last_unstale":"2023-08-25T04:16:05.149039+0000","last_undegraded":"2023-08-25T04:16:05.149039+0000","last_fullsized":"2023-08-25T04:16:05.149039+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:24.524584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146447+0000","last_change":"2023-08-25T04:16:02.761674+0000","last_active":"2023-08-25T04:16:05.146447+0000","last_peered":"2023-08-25T04:16:05.146447+0000","last_clean":"2023-08-25T04:16:05.146447+0000","last_became_active":"2023-08-25T04:16:02.761351+0000","last_became_peered":"2023-08-25T04:16:02.761351+0000","last_unstale":"2023-08-25T04:16:05.146447+0000","last_undegraded":"2023-08-25T04:16:05.146447+0000","last_fullsized":"2023-08-25T04:16:05.146447+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:37:03.966092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765938+0000","last_change":"2023-08-25T04:16:03.787422+0000","last_active":"2023-08-25T04:16:04.765938+0000","last_peered":"2023-08-25T04:16:04.765938+0000","last_clean":"2023-08-25T04:16:04.765938+0000","last_became_active":"2023-08-25T04:16:03.787088+0000","last_became_peered":"2023-08-25T04:16:03.787088+0000","last_unstale":"2023-08-25T04:16:04.765938+0000","last_undegraded":"2023-08-25T04:16:04.765938+0000","last_fullsized":"2023-08-25T04:16:04.765938+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:56:51.258380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"61'8","reported_seq":21,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148959+0000","last_change":"2023-08-25T04:16:02.769884+0000","last_active":"2023-08-25T04:16:05.148959+0000","last_peered":"2023-08-25T04:16:05.148959+0000","last_clean":"2023-08-25T04:16:05.148959+0000","last_became_active":"2023-08-25T04:16:02.768928+0000","last_became_peered":"2023-08-25T04:16:02.768928+0000","last_unstale":"2023-08-25T04:16:05.148959+0000","last_undegraded":"2023-08-25T04:16:05.148959+0000","last_fullsized":"2023-08-25T04:16:05.148959+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:48:31.382356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148863+0000","last_change":"2023-08-25T04:16:03.766212+0000","last_active":"2023-08-25T04:16:05.148863+0000","last_peered":"2023-08-25T04:16:05.148863+0000","last_clean":"2023-08-25T04:16:05.148863+0000","last_became_active":"2023-08-25T04:16:03.765926+0000","last_became_peered":"2023-08-25T04:16:03.765926+0000","last_unstale":"2023-08-25T04:16:05.148863+0000","last_undegraded":"2023-08-25T04:16:05.148863+0000","last_fullsized":"2023-08-25T04:16:05.148863+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:01:07.903863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766278+0000","last_change":"2023-08-25T04:16:02.769909+0000","last_active":"2023-08-25T04:16:04.766278+0000","last_peered":"2023-08-25T04:16:04.766278+0000","last_clean":"2023-08-25T04:16:04.766278+0000","last_became_active":"2023-08-25T04:16:02.769572+0000","last_became_peered":"2023-08-25T04:16:02.769572+0000","last_unstale":"2023-08-25T04:16:04.766278+0000","last_undegraded":"2023-08-25T04:16:04.766278+0000","last_fullsized":"2023-08-25T04:16:04.766278+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:15:38.572849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148148+0000","last_change":"2023-08-25T04:16:03.784206+0000","last_active":"2023-08-25T04:16:05.148148+0000","last_peered":"2023-08-25T04:16:05.148148+0000","last_clean":"2023-08-25T04:16:05.148148+0000","last_became_active":"2023-08-25T04:16:03.783799+0000","last_became_peered":"2023-08-25T04:16:03.783799+0000","last_unstale":"2023-08-25T04:16:05.148148+0000","last_undegraded":"2023-08-25T04:16:05.148148+0000","last_fullsized":"2023-08-25T04:16:05.148148+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:58:05.317914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.750693+0000","last_change":"2023-08-25T04:16:02.761798+0000","last_active":"2023-08-25T04:16:04.750693+0000","last_peered":"2023-08-25T04:16:04.750693+0000","last_clean":"2023-08-25T04:16:04.750693+0000","last_became_active":"2023-08-25T04:16:02.761512+0000","last_became_peered":"2023-08-25T04:16:02.761512+0000","last_unstale":"2023-08-25T04:16:04.750693+0000","last_undegraded":"2023-08-25T04:16:04.750693+0000","last_fullsized":"2023-08-25T04:16:04.750693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:49:42.962115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748094+0000","last_change":"2023-08-25T04:16:03.784616+0000","last_active":"2023-08-25T04:16:04.748094+0000","last_peered":"2023-08-25T04:16:04.748094+0000","last_clean":"2023-08-25T04:16:04.748094+0000","last_became_active":"2023-08-25T04:16:03.784320+0000","last_became_peered":"2023-08-25T04:16:03.784320+0000","last_unstale":"2023-08-25T04:16:04.748094+0000","last_undegraded":"2023-08-25T04:16:04.748094+0000","last_fullsized":"2023-08-25T04:16:04.748094+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:47:23.266030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748522+0000","last_change":"2023-08-25T04:16:02.760117+0000","last_active":"2023-08-25T04:16:04.748522+0000","last_peered":"2023-08-25T04:16:04.748522+0000","last_clean":"2023-08-25T04:16:04.748522+0000","last_became_active":"2023-08-25T04:16:02.758535+0000","last_became_peered":"2023-08-25T04:16:02.758535+0000","last_unstale":"2023-08-25T04:16:04.748522+0000","last_undegraded":"2023-08-25T04:16:04.748522+0000","last_fullsized":"2023-08-25T04:16:04.748522+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:16:27.704115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148413+0000","last_change":"2023-08-25T04:16:03.765306+0000","last_active":"2023-08-25T04:16:05.148413+0000","last_peered":"2023-08-25T04:16:05.148413+0000","last_clean":"2023-08-25T04:16:05.148413+0000","last_became_active":"2023-08-25T04:16:03.764966+0000","last_became_peered":"2023-08-25T04:16:03.764966+0000","last_unstale":"2023-08-25T04:16:05.148413+0000","last_undegraded":"2023-08-25T04:16:05.148413+0000","last_fullsized":"2023-08-25T04:16:05.148413+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:13:43.607156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748638+0000","last_change":"2023-08-25T04:16:02.765158+0000","last_active":"2023-08-25T04:16:04.748638+0000","last_peered":"2023-08-25T04:16:04.748638+0000","last_clean":"2023-08-25T04:16:04.748638+0000","last_became_active":"2023-08-25T04:16:02.764912+0000","last_became_peered":"2023-08-25T04:16:02.764912+0000","last_unstale":"2023-08-25T04:16:04.748638+0000","last_undegraded":"2023-08-25T04:16:04.748638+0000","last_fullsized":"2023-08-25T04:16:04.748638+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:03.782699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147108+0000","last_change":"2023-08-25T04:16:03.774420+0000","last_active":"2023-08-25T04:16:05.147108+0000","last_peered":"2023-08-25T04:16:05.147108+0000","last_clean":"2023-08-25T04:16:05.147108+0000","last_became_active":"2023-08-25T04:16:03.774056+0000","last_became_peered":"2023-08-25T04:16:03.774056+0000","last_unstale":"2023-08-25T04:16:05.147108+0000","last_undegraded":"2023-08-25T04:16:05.147108+0000","last_fullsized":"2023-08-25T04:16:05.147108+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:30:15.714145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148479+0000","last_change":"2023-08-25T04:16:02.765007+0000","last_active":"2023-08-25T04:16:05.148479+0000","last_peered":"2023-08-25T04:16:05.148479+0000","last_clean":"2023-08-25T04:16:05.148479+0000","last_became_active":"2023-08-25T04:16:02.764646+0000","last_became_peered":"2023-08-25T04:16:02.764646+0000","last_unstale":"2023-08-25T04:16:05.148479+0000","last_undegraded":"2023-08-25T04:16:05.148479+0000","last_fullsized":"2023-08-25T04:16:05.148479+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:01:43.514684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748326+0000","last_change":"2023-08-25T04:16:03.775606+0000","last_active":"2023-08-25T04:16:04.748326+0000","last_peered":"2023-08-25T04:16:04.748326+0000","last_clean":"2023-08-25T04:16:04.748326+0000","last_became_active":"2023-08-25T04:16:03.773164+0000","last_became_peered":"2023-08-25T04:16:03.773164+0000","last_unstale":"2023-08-25T04:16:04.748326+0000","last_undegraded":"2023-08-25T04:16:04.748326+0000","last_fullsized":"2023-08-25T04:16:04.748326+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:09.743104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148937+0000","last_change":"2023-08-25T04:16:02.769473+0000","last_active":"2023-08-25T04:16:05.148937+0000","last_peered":"2023-08-25T04:16:05.148937+0000","last_clean":"2023-08-25T04:16:05.148937+0000","last_became_active":"2023-08-25T04:16:02.769146+0000","last_became_peered":"2023-08-25T04:16:02.769146+0000","last_unstale":"2023-08-25T04:16:05.148937+0000","last_undegraded":"2023-08-25T04:16:05.148937+0000","last_fullsized":"2023-08-25T04:16:05.148937+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:01:31.204659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766193+0000","last_change":"2023-08-25T04:16:03.783730+0000","last_active":"2023-08-25T04:16:04.766193+0000","last_peered":"2023-08-25T04:16:04.766193+0000","last_clean":"2023-08-25T04:16:04.766193+0000","last_became_active":"2023-08-25T04:16:03.783468+0000","last_became_peered":"2023-08-25T04:16:03.783468+0000","last_unstale":"2023-08-25T04:16:04.766193+0000","last_undegraded":"2023-08-25T04:16:04.766193+0000","last_fullsized":"2023-08-25T04:16:04.766193+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:51:11.953697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765645+0000","last_change":"2023-08-25T04:16:02.762858+0000","last_active":"2023-08-25T04:16:04.765645+0000","last_peered":"2023-08-25T04:16:04.765645+0000","last_clean":"2023-08-25T04:16:04.765645+0000","last_became_active":"2023-08-25T04:16:02.762516+0000","last_became_peered":"2023-08-25T04:16:02.762516+0000","last_unstale":"2023-08-25T04:16:04.765645+0000","last_undegraded":"2023-08-25T04:16:04.765645+0000","last_fullsized":"2023-08-25T04:16:04.765645+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:19:41.400173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148567+0000","last_change":"2023-08-25T04:16:03.756864+0000","last_active":"2023-08-25T04:16:05.148567+0000","last_peered":"2023-08-25T04:16:05.148567+0000","last_clean":"2023-08-25T04:16:05.148567+0000","last_became_active":"2023-08-25T04:16:03.756575+0000","last_became_peered":"2023-08-25T04:16:03.756575+0000","last_unstale":"2023-08-25T04:16:05.148567+0000","last_undegraded":"2023-08-25T04:16:05.148567+0000","last_fullsized":"2023-08-25T04:16:05.148567+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:30:09.575853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.750115+0000","last_change":"2023-08-25T04:16:02.763728+0000","last_active":"2023-08-25T04:16:04.750115+0000","last_peered":"2023-08-25T04:16:04.750115+0000","last_clean":"2023-08-25T04:16:04.750115+0000","last_became_active":"2023-08-25T04:16:02.763409+0000","last_became_peered":"2023-08-25T04:16:02.763409+0000","last_unstale":"2023-08-25T04:16:04.750115+0000","last_undegraded":"2023-08-25T04:16:04.750115+0000","last_fullsized":"2023-08-25T04:16:04.750115+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:30.338115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748059+0000","last_change":"2023-08-25T04:16:03.762457+0000","last_active":"2023-08-25T04:16:04.748059+0000","last_peered":"2023-08-25T04:16:04.748059+0000","last_clean":"2023-08-25T04:16:04.748059+0000","last_became_active":"2023-08-25T04:16:03.762156+0000","last_became_peered":"2023-08-25T04:16:03.762156+0000","last_unstale":"2023-08-25T04:16:04.748059+0000","last_undegraded":"2023-08-25T04:16:04.748059+0000","last_fullsized":"2023-08-25T04:16:04.748059+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:05:34.107237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766191+0000","last_change":"2023-08-25T04:16:02.764778+0000","last_active":"2023-08-25T04:16:04.766191+0000","last_peered":"2023-08-25T04:16:04.766191+0000","last_clean":"2023-08-25T04:16:04.766191+0000","last_became_active":"2023-08-25T04:16:02.764385+0000","last_became_peered":"2023-08-25T04:16:02.764385+0000","last_unstale":"2023-08-25T04:16:04.766191+0000","last_undegraded":"2023-08-25T04:16:04.766191+0000","last_fullsized":"2023-08-25T04:16:04.766191+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:14:15.027029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"50'139","reported_seq":325,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146453+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:16:05.146453+0000","last_peered":"2023-08-25T04:16:05.146453+0000","last_clean":"2023-08-25T04:16:05.146453+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:16:05.146453+0000","last_undegraded":"2023-08-25T04:16:05.146453+0000","last_fullsized":"2023-08-25T04:16:05.146453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:46:40.938989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146893+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:16:05.146893+0000","last_peered":"2023-08-25T04:16:05.146893+0000","last_clean":"2023-08-25T04:16:05.146893+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:16:05.146893+0000","last_undegraded":"2023-08-25T04:16:05.146893+0000","last_fullsized":"2023-08-25T04:16:05.146893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:49:07.625941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148272+0000","last_change":"2023-08-25T04:16:03.759020+0000","last_active":"2023-08-25T04:16:05.148272+0000","last_peered":"2023-08-25T04:16:05.148272+0000","last_clean":"2023-08-25T04:16:05.148272+0000","last_became_active":"2023-08-25T04:16:03.758518+0000","last_became_peered":"2023-08-25T04:16:03.758518+0000","last_unstale":"2023-08-25T04:16:05.148272+0000","last_undegraded":"2023-08-25T04:16:05.148272+0000","last_fullsized":"2023-08-25T04:16:05.148272+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:19:21.561019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146603+0000","last_change":"2023-08-25T04:16:02.763794+0000","last_active":"2023-08-25T04:16:05.146603+0000","last_peered":"2023-08-25T04:16:05.146603+0000","last_clean":"2023-08-25T04:16:05.146603+0000","last_became_active":"2023-08-25T04:16:02.763451+0000","last_became_peered":"2023-08-25T04:16:02.763451+0000","last_unstale":"2023-08-25T04:16:05.146603+0000","last_undegraded":"2023-08-25T04:16:05.146603+0000","last_fullsized":"2023-08-25T04:16:05.146603+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:13:25.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146096+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:16:05.146096+0000","last_peered":"2023-08-25T04:16:05.146096+0000","last_clean":"2023-08-25T04:16:05.146096+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:16:05.146096+0000","last_undegraded":"2023-08-25T04:16:05.146096+0000","last_fullsized":"2023-08-25T04:16:05.146096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:37:15.930053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149282+0000","last_change":"2023-08-25T04:16:03.777176+0000","last_active":"2023-08-25T04:16:05.149282+0000","last_peered":"2023-08-25T04:16:05.149282+0000","last_clean":"2023-08-25T04:16:05.149282+0000","last_became_active":"2023-08-25T04:16:03.776894+0000","last_became_peered":"2023-08-25T04:16:03.776894+0000","last_unstale":"2023-08-25T04:16:05.149282+0000","last_undegraded":"2023-08-25T04:16:05.149282+0000","last_fullsized":"2023-08-25T04:16:05.149282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:50:06.178179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766084+0000","last_change":"2023-08-25T04:16:02.764873+0000","last_active":"2023-08-25T04:16:04.766084+0000","last_peered":"2023-08-25T04:16:04.766084+0000","last_clean":"2023-08-25T04:16:04.766084+0000","last_became_active":"2023-08-25T04:16:02.764527+0000","last_became_peered":"2023-08-25T04:16:02.764527+0000","last_unstale":"2023-08-25T04:16:04.766084+0000","last_undegraded":"2023-08-25T04:16:04.766084+0000","last_fullsized":"2023-08-25T04:16:04.766084+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:47:22.250255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.750200+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:16:04.750200+0000","last_peered":"2023-08-25T04:16:04.750200+0000","last_clean":"2023-08-25T04:16:04.750200+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:16:04.750200+0000","last_undegraded":"2023-08-25T04:16:04.750200+0000","last_fullsized":"2023-08-25T04:16:04.750200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:10:51.922096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146548+0000","last_change":"2023-08-25T04:16:03.759022+0000","last_active":"2023-08-25T04:16:05.146548+0000","last_peered":"2023-08-25T04:16:05.146548+0000","last_clean":"2023-08-25T04:16:05.146548+0000","last_became_active":"2023-08-25T04:16:03.758338+0000","last_became_peered":"2023-08-25T04:16:03.758338+0000","last_unstale":"2023-08-25T04:16:05.146548+0000","last_undegraded":"2023-08-25T04:16:05.146548+0000","last_fullsized":"2023-08-25T04:16:05.146548+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:49:34.866072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748613+0000","last_change":"2023-08-25T04:16:02.764312+0000","last_active":"2023-08-25T04:16:04.748613+0000","last_peered":"2023-08-25T04:16:04.748613+0000","last_clean":"2023-08-25T04:16:04.748613+0000","last_became_active":"2023-08-25T04:16:02.763932+0000","last_became_peered":"2023-08-25T04:16:02.763932+0000","last_unstale":"2023-08-25T04:16:04.748613+0000","last_undegraded":"2023-08-25T04:16:04.748613+0000","last_fullsized":"2023-08-25T04:16:04.748613+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:47:17.296890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146680+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:16:05.146680+0000","last_peered":"2023-08-25T04:16:05.146680+0000","last_clean":"2023-08-25T04:16:05.146680+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:16:05.146680+0000","last_undegraded":"2023-08-25T04:16:05.146680+0000","last_fullsized":"2023-08-25T04:16:05.146680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:04:15.457844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766110+0000","last_change":"2023-08-25T04:16:03.786814+0000","last_active":"2023-08-25T04:16:04.766110+0000","last_peered":"2023-08-25T04:16:04.766110+0000","last_clean":"2023-08-25T04:16:04.766110+0000","last_became_active":"2023-08-25T04:16:03.786529+0000","last_became_peered":"2023-08-25T04:16:03.786529+0000","last_unstale":"2023-08-25T04:16:04.766110+0000","last_undegraded":"2023-08-25T04:16:04.766110+0000","last_fullsized":"2023-08-25T04:16:04.766110+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:49:47.826087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748144+0000","last_change":"2023-08-25T04:16:02.759432+0000","last_active":"2023-08-25T04:16:04.748144+0000","last_peered":"2023-08-25T04:16:04.748144+0000","last_clean":"2023-08-25T04:16:04.748144+0000","last_became_active":"2023-08-25T04:16:02.759154+0000","last_became_peered":"2023-08-25T04:16:02.759154+0000","last_unstale":"2023-08-25T04:16:04.748144+0000","last_undegraded":"2023-08-25T04:16:04.748144+0000","last_fullsized":"2023-08-25T04:16:04.748144+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:51:10.937922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148428+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:16:05.148428+0000","last_peered":"2023-08-25T04:16:05.148428+0000","last_clean":"2023-08-25T04:16:05.148428+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:16:05.148428+0000","last_undegraded":"2023-08-25T04:16:05.148428+0000","last_fullsized":"2023-08-25T04:16:05.148428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:10:21.541167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149372+0000","last_change":"2023-08-25T04:16:03.759478+0000","last_active":"2023-08-25T04:16:05.149372+0000","last_peered":"2023-08-25T04:16:05.149372+0000","last_clean":"2023-08-25T04:16:05.149372+0000","last_became_active":"2023-08-25T04:16:03.759151+0000","last_became_peered":"2023-08-25T04:16:03.759151+0000","last_unstale":"2023-08-25T04:16:05.149372+0000","last_undegraded":"2023-08-25T04:16:05.149372+0000","last_fullsized":"2023-08-25T04:16:05.149372+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:56:24.570616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146657+0000","last_change":"2023-08-25T04:16:02.762852+0000","last_active":"2023-08-25T04:16:05.146657+0000","last_peered":"2023-08-25T04:16:05.146657+0000","last_clean":"2023-08-25T04:16:05.146657+0000","last_became_active":"2023-08-25T04:16:02.762449+0000","last_became_peered":"2023-08-25T04:16:02.762449+0000","last_unstale":"2023-08-25T04:16:05.146657+0000","last_undegraded":"2023-08-25T04:16:05.146657+0000","last_fullsized":"2023-08-25T04:16:05.146657+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:36:43.770631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146693+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:16:05.146693+0000","last_peered":"2023-08-25T04:16:05.146693+0000","last_clean":"2023-08-25T04:16:05.146693+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:16:05.146693+0000","last_undegraded":"2023-08-25T04:16:05.146693+0000","last_fullsized":"2023-08-25T04:16:05.146693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:16:10.221862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765945+0000","last_change":"2023-08-25T04:16:03.779647+0000","last_active":"2023-08-25T04:16:04.765945+0000","last_peered":"2023-08-25T04:16:04.765945+0000","last_clean":"2023-08-25T04:16:04.765945+0000","last_became_active":"2023-08-25T04:16:03.779369+0000","last_became_peered":"2023-08-25T04:16:03.779369+0000","last_unstale":"2023-08-25T04:16:04.765945+0000","last_undegraded":"2023-08-25T04:16:04.765945+0000","last_fullsized":"2023-08-25T04:16:04.765945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:40:02.394308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149350+0000","last_change":"2023-08-25T04:16:02.769374+0000","last_active":"2023-08-25T04:16:05.149350+0000","last_peered":"2023-08-25T04:16:05.149350+0000","last_clean":"2023-08-25T04:16:05.149350+0000","last_became_active":"2023-08-25T04:16:02.769064+0000","last_became_peered":"2023-08-25T04:16:02.769064+0000","last_unstale":"2023-08-25T04:16:05.149350+0000","last_undegraded":"2023-08-25T04:16:05.149350+0000","last_fullsized":"2023-08-25T04:16:05.149350+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:40:57.150994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148840+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:16:05.148840+0000","last_peered":"2023-08-25T04:16:05.148840+0000","last_clean":"2023-08-25T04:16:05.148840+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:16:05.148840+0000","last_undegraded":"2023-08-25T04:16:05.148840+0000","last_fullsized":"2023-08-25T04:16:05.148840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:20:07.819897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146345+0000","last_change":"2023-08-25T04:16:03.772229+0000","last_active":"2023-08-25T04:16:05.146345+0000","last_peered":"2023-08-25T04:16:05.146345+0000","last_clean":"2023-08-25T04:16:05.146345+0000","last_became_active":"2023-08-25T04:16:03.771917+0000","last_became_peered":"2023-08-25T04:16:03.771917+0000","last_unstale":"2023-08-25T04:16:05.146345+0000","last_undegraded":"2023-08-25T04:16:05.146345+0000","last_fullsized":"2023-08-25T04:16:05.146345+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:35:29.126317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149065+0000","last_change":"2023-08-25T04:16:02.761668+0000","last_active":"2023-08-25T04:16:05.149065+0000","last_peered":"2023-08-25T04:16:05.149065+0000","last_clean":"2023-08-25T04:16:05.149065+0000","last_became_active":"2023-08-25T04:16:02.761013+0000","last_became_peered":"2023-08-25T04:16:02.761013+0000","last_unstale":"2023-08-25T04:16:05.149065+0000","last_undegraded":"2023-08-25T04:16:05.149065+0000","last_fullsized":"2023-08-25T04:16:05.149065+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:35:12.106821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":95,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748705+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:16:04.748705+0000","last_peered":"2023-08-25T04:16:04.748705+0000","last_clean":"2023-08-25T04:16:04.748705+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:16:04.748705+0000","last_undegraded":"2023-08-25T04:16:04.748705+0000","last_fullsized":"2023-08-25T04:16:04.748705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:25:05.043329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509603,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58848,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312992,"statfs":{"total":96636764160,"available":96576503808,"internally_reserved":0,"allocated":1331200,"data_stored":940405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72399999999999998,"15min":0.71099999999999997},"min":{"1min":0.57999999999999996,"5min":0.442,"15min":0.29199999999999998},"max":{"1min":0.996,"5min":0.996,"15min":1.0189999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.752,"15min":0.71499999999999997},"min":{"1min":0.58199999999999996,"5min":0.42099999999999999,"15min":0.39000000000000001},"max":{"1min":0.89500000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.67600000000000005}]},{"osd":1,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.55100000000000005,"5min":0.45500000000000002,"15min":0.42699999999999999},"max":{"1min":0.95699999999999996,"5min":1.0149999999999999,"15min":1.034},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76900000000000002,"15min":0.73299999999999998},"min":{"1min":0.59299999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.91700000000000004,"5min":0.98799999999999999,"15min":1.036},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.60499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.94499999999999995,"5min":1.018,"15min":1.018},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.751},"min":{"1min":0.51500000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94999999999999996,"5min":0.999,"15min":0.999},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.74399999999999999},"min":{"1min":0.57399999999999995,"5min":0.48199999999999998,"15min":0.41899999999999998},"max":{"1min":0.92900000000000005,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.58499999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0449999999999999},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57099999999999995,"15min":0.59499999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.32400000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.98899999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.628},"min":{"1min":0.48299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.75600000000000001,"5min":0.82599999999999996,"15min":0.96699999999999997},"last":0.69099999999999995}]},{"osd":5,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.63600000000000001},"min":{"1min":0.438,"5min":0.433,"15min":0.38100000000000001},"max":{"1min":0.77600000000000002,"5min":0.98399999999999999,"15min":0.998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.63,"15min":0.66100000000000003},"min":{"1min":0.45000000000000001,"5min":0.41799999999999998,"15min":0.40000000000000002},"max":{"1min":0.79400000000000004,"5min":0.93799999999999994,"15min":1.0349999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.5,"5min":0.498,"15min":0.436},"max":{"1min":0.95699999999999996,"5min":1.0009999999999999,"15min":1.0620000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.68999999999999995},"min":{"1min":0.45100000000000001,"5min":0.433,"15min":0.42399999999999999},"max":{"1min":0.84499999999999997,"5min":0.91700000000000004,"15min":0.98299999999999998},"last":0.78300000000000003}]}]},{"osd":6,"up_from":15,"seq":64424509603,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36064,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335776,"statfs":{"total":96636764160,"available":96599834624,"internally_reserved":0,"allocated":737280,"data_stored":350565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72599999999999998,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.36499999999999999},"max":{"1min":0.93400000000000005,"5min":0.96199999999999997,"15min":1.0369999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.69799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.33800000000000002},"max":{"1min":0.96899999999999997,"5min":1.054,"15min":1.071},"last":0.59499999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.751,"15min":0.73299999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.436},"max":{"1min":1.002,"5min":1.0369999999999999,"15min":1.1559999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.503,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98699999999999999,"5min":1.077,"15min":1.077},"last":0.80800000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.753,"15min":0.749},"min":{"1min":0.52900000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.97999999999999998,"5min":1.1020000000000001,"15min":1.139},"last":0.5},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.81100000000000005,"15min":0.80600000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54400000000000004},"max":{"1min":0.96699999999999997,"5min":1.0469999999999999,"15min":1.117},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.751,"15min":0.74399999999999999},"min":{"1min":0.58799999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.077},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.56000000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94999999999999996,"5min":1.0249999999999999,"15min":1.679},"last":0.84099999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58299999999999996,"15min":0.622},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79200000000000004,"5min":0.93200000000000005,"15min":0.93400000000000005},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57599999999999996,"15min":0.629},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78200000000000003,"5min":0.95799999999999996,"15min":1.306},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.625,"15min":0.68400000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82599999999999996,"5min":1.0329999999999999,"15min":1.123},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71599999999999997,"15min":0.76600000000000001},"min":{"1min":0.443,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.97599999999999998,"5min":1.0209999999999999,"15min":1.5589999999999999},"last":0.86499999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64900000000000002,"15min":0.68999999999999995},"min":{"1min":0.443,"5min":0.434,"15min":0.434},"max":{"1min":0.82899999999999996,"5min":0.99099999999999999,"15min":1.1950000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67200000000000004,"15min":0.72599999999999998},"min":{"1min":0.45200000000000001,"5min":0.44700000000000001,"15min":0.41799999999999998},"max":{"1min":0.91200000000000003,"5min":1.012,"15min":1.4099999999999999},"last":0.71299999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542306,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":349913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.70199999999999996,"15min":0.70499999999999996},"min":{"1min":0.40300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91300000000000003,"5min":0.93700000000000006,"15min":1.018},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72499999999999998,"15min":0.72999999999999998},"min":{"1min":0.45500000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89500000000000002,"5min":0.995,"15min":1.0409999999999999},"last":0.79600000000000004}]},{"osd":1,"last update":"Fri Aug 25 04:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.45100000000000001,"5min":0.43099999999999999,"15min":0.36499999999999999},"max":{"1min":0.84799999999999998,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.73599999999999999,"15min":0.73299999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.46200000000000002},"max":{"1min":0.95999999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":0.97499999999999998,"15min":1.0269999999999999},"last":0.626},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.49299999999999999,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":0.94099999999999995,"5min":1.006,"15min":1.2290000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.90700000000000003,"5min":0.94199999999999995,"15min":1.4590000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.94799999999999995,"5min":1.018,"15min":1.1479999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.41799999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92900000000000005,"5min":0.97099999999999997,"15min":1.038},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60799999999999998,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.623,"15min":0.66900000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93700000000000006,"5min":1.008,"15min":1.256},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.67800000000000005},"min":{"1min":0.46400000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.78700000000000003,"5min":0.88700000000000001,"15min":1.4650000000000001},"last":0.81499999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58699999999999997,"15min":0.64700000000000002},"min":{"1min":0.436,"5min":0.375,"15min":0.375},"max":{"1min":0.72299999999999998,"5min":1.032,"15min":1.2769999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68600000000000005,"15min":0.72799999999999998},"min":{"1min":0.51800000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90000000000000002,"5min":1.048,"15min":1.1819999999999999},"last":0.73699999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542306,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36064,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335776,"statfs":{"total":96636764160,"available":96599834624,"internally_reserved":0,"allocated":733184,"data_stored":350495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72999999999999998,"15min":0.70199999999999996},"min":{"1min":0.60399999999999998,"5min":0.42299999999999999,"15min":0.32700000000000001},"max":{"1min":0.89000000000000001,"5min":0.99299999999999999,"15min":1.2649999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72499999999999998,"15min":0.69699999999999995},"min":{"1min":0.58899999999999997,"5min":0.48499999999999999,"15min":0.441},"max":{"1min":0.86699999999999999,"5min":0.89900000000000002,"15min":1.1639999999999999},"last":0.64400000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.747,"15min":0.71399999999999997},"min":{"1min":0.59799999999999998,"5min":0.46400000000000002,"15min":0.36199999999999999},"max":{"1min":0.96499999999999997,"5min":1.0189999999999999,"15min":1.0449999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77000000000000002,"15min":0.74399999999999999},"min":{"1min":0.58899999999999997,"5min":0.56799999999999995,"15min":0.36799999999999999},"max":{"1min":0.95599999999999996,"5min":1.099,"15min":1.099},"last":0.88600000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78700000000000003,"15min":0.75900000000000001},"min":{"1min":0.66300000000000003,"5min":0.57599999999999996,"15min":0.39100000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77300000000000002,"15min":0.73499999999999999},"min":{"1min":0.67200000000000004,"5min":0.503,"15min":0.34000000000000002},"max":{"1min":0.94599999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.76800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.45100000000000001},"max":{"1min":0.98299999999999998,"5min":1.016,"15min":1.048},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.78000000000000003,"15min":0.76000000000000001},"min":{"1min":0.629,"5min":0.52400000000000002,"15min":0.48399999999999999},"max":{"1min":1.008,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.145}]},{"osd":5,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.41099999999999998,"5min":0.39400000000000002,"15min":0.32200000000000001},"max":{"1min":0.753,"5min":0.88400000000000001,"15min":0.94899999999999995},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.60499999999999998},"min":{"1min":0.48299999999999998,"5min":0.38500000000000001,"15min":0.33200000000000002},"max":{"1min":0.73199999999999998,"5min":0.91200000000000003,"15min":0.92100000000000004},"last":1.034}]},{"osd":6,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.59399999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.014,"5min":1.0309999999999999,"15min":1.0620000000000001},"last":1.093},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64500000000000002,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.874,"5min":0.97499999999999998,"15min":1.026},"last":1.2010000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.621,"15min":0.63500000000000001},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.36699999999999999},"max":{"1min":0.87,"5min":0.90400000000000003,"15min":1.0609999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69699999999999995,"15min":0.72199999999999998},"min":{"1min":0.55400000000000005,"5min":0.498,"15min":0.39300000000000002},"max":{"1min":0.88400000000000001,"5min":0.98399999999999999,"15min":1.0940000000000001},"last":0.99399999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542306,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36068,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335772,"statfs":{"total":96636764160,"available":96599830528,"internally_reserved":0,"allocated":745472,"data_stored":351547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46000000000000002,"15min":0.442},"min":{"1min":0.34499999999999997,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.56699999999999995,"5min":0.747,"15min":0.96899999999999997},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.77100000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.443}]},{"osd":1,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.497,"15min":0.48699999999999999},"min":{"1min":0.34699999999999998,"5min":0.33600000000000002,"15min":0.27000000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.746},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.58999999999999997},"min":{"1min":0.47199999999999998,"5min":0.41799999999999998,"15min":0.38500000000000001},"max":{"1min":0.76500000000000001,"5min":0.85799999999999998,"15min":0.92600000000000005},"last":0.502}]},{"osd":2,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57799999999999996,"15min":0.56499999999999995},"min":{"1min":0.41799999999999998,"5min":0.40600000000000003,"15min":0.34699999999999998},"max":{"1min":0.67300000000000004,"5min":1.01,"15min":1.01},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.379,"15min":0.35299999999999998},"max":{"1min":0.67700000000000005,"5min":0.81699999999999995,"15min":0.89600000000000002},"last":0.38}]},{"osd":4,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78100000000000003,"15min":0.75600000000000001},"min":{"1min":0.57999999999999996,"5min":0.53100000000000003,"15min":0.46800000000000003},"max":{"1min":1.214,"5min":1.214,"15min":1.4339999999999999},"last":0.871},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.81299999999999994},"min":{"1min":0.63800000000000001,"5min":0.59399999999999997,"15min":0.48899999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.343},"last":0.88300000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.61199999999999999,"5min":0.52900000000000003,"15min":0.51500000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.321},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80900000000000005,"15min":0.79500000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.48099999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.4750000000000001},"last":0.82299999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.83499999999999996,"15min":0.80800000000000005},"min":{"1min":0.60399999999999998,"5min":0.55300000000000005,"15min":0.53100000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.2010000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.61199999999999999,"5min":0.52000000000000002,"15min":0.50700000000000001},"max":{"1min":1.0800000000000001,"5min":1.097,"15min":1.3600000000000001},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.85199999999999998,"15min":0.83999999999999997},"min":{"1min":0.66200000000000003,"5min":0.60899999999999999,"15min":0.57099999999999995},"max":{"1min":1.077,"5min":1.1080000000000001,"15min":1.383},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80900000000000005,"15min":0.79500000000000004},"min":{"1min":0.58299999999999996,"5min":0.55600000000000005,"15min":0.54000000000000004},"max":{"1min":1.0669999999999999,"5min":1.1160000000000001,"15min":1.4019999999999999},"last":0.84999999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542307,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54116,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317724,"statfs":{"total":96636764160,"available":96581349376,"internally_reserved":0,"allocated":741376,"data_stored":351525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.45900000000000002,"15min":0.46899999999999997},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":0.61599999999999999,"5min":0.76100000000000001,"15min":1.196},"last":0.315},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.496},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.28599999999999998},"max":{"1min":0.72499999999999998,"5min":0.75600000000000001,"15min":1.4019999999999999},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":1.482},"last":0.375},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60599999999999998,"15min":0.60199999999999998},"min":{"1min":0.44700000000000001,"5min":0.41999999999999998,"15min":0.36699999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":1.458},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53300000000000003,"15min":0.52800000000000002},"min":{"1min":0.41699999999999998,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.754,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.436},{"interface":"front","average":{"1min":0.622,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.44800000000000001,"5min":0.41299999999999998,"15min":0.33700000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.95599999999999996},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.80800000000000005,"15min":0.79600000000000004},"min":{"1min":0.61499999999999999,"5min":0.52200000000000002,"15min":0.499},"max":{"1min":0.98899999999999999,"5min":1.2330000000000001,"15min":1.2569999999999999},"last":1.085},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78700000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.47599999999999998},"max":{"1min":1.026,"5min":1.117,"15min":1.5509999999999999},"last":0.90300000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80800000000000005,"15min":0.80100000000000005},"min":{"1min":0.54100000000000004,"5min":0.498,"15min":0.47999999999999998},"max":{"1min":1.014,"5min":1.1140000000000001,"15min":1.2789999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81100000000000005,"15min":0.80800000000000005},"min":{"1min":0.59699999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.026,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.1459999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84299999999999997,"15min":0.83899999999999997},"min":{"1min":0.67600000000000005,"5min":0.57399999999999995,"15min":0.56000000000000005},"max":{"1min":1.0609999999999999,"5min":1.1910000000000001,"15min":1.2110000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.875,"15min":0.85199999999999998},"min":{"1min":0.65700000000000003,"5min":0.61199999999999999,"15min":0.55600000000000005},"max":{"1min":1.0660000000000001,"5min":1.278,"15min":1.375},"last":1.014}]},{"osd":7,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.53700000000000003,"15min":0.49199999999999999},"max":{"1min":0.96899999999999997,"5min":1.2090000000000001,"15min":1.339},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.81100000000000005,"15min":0.81299999999999994},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.51000000000000001},"max":{"1min":1.081,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.95199999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542307,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":737280,"data_stored":350073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46999999999999997,"15min":0.47099999999999997},"min":{"1min":0.33300000000000002,"5min":0.28399999999999997,"15min":0.27400000000000002},"max":{"1min":0.68999999999999995,"5min":0.85599999999999998,"15min":1.218},"last":0.308},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.36699999999999999,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":0.93300000000000005,"15min":1.153},"last":0.44600000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51100000000000001,"15min":0.504},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.30599999999999999},"max":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":1.347},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.48099999999999998,"5min":0.40000000000000002,"15min":0.36499999999999999},"max":{"1min":0.76000000000000001,"5min":1.02,"15min":1.093},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63600000000000001,"15min":0.623},"min":{"1min":0.46800000000000003,"5min":0.45300000000000001,"15min":0.40699999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":1.1459999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":1.2190000000000001},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80800000000000005,"15min":0.79400000000000004},"min":{"1min":0.56799999999999995,"5min":0.51600000000000001,"15min":0.45800000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.47},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83899999999999997,"15min":0.82399999999999995},"min":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.504},"max":{"1min":1.1830000000000001,"5min":1.244,"15min":1.395},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.82999999999999996,"15min":0.80600000000000005},"min":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.45100000000000001},"max":{"1min":1.1579999999999999,"5min":1.2090000000000001,"15min":1.292},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.83399999999999996,"15min":0.83299999999999996},"min":{"1min":0.64100000000000001,"5min":0.54700000000000004,"15min":0.51000000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.64700000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85299999999999998,"15min":0.85199999999999998},"min":{"1min":0.63500000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.569},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.83199999999999996,"15min":0.81399999999999995},"min":{"1min":0.67800000000000005,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.355},"last":0.60399999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83999999999999997,"15min":0.82999999999999996},"min":{"1min":0.65400000000000003,"5min":0.59299999999999997,"15min":0.56799999999999995},"max":{"1min":1.1240000000000001,"5min":1.2949999999999999,"15min":1.5429999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.876,"15min":0.85599999999999998},"min":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.54500000000000004},"max":{"1min":1.1140000000000001,"5min":1.3120000000000001,"15min":1.504},"last":0.68300000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542306,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1331200,"data_stored":940337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48199999999999998,"15min":0.48299999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.79500000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.55800000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":3.5089999999999999,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70699999999999996,"5min":0.90300000000000002,"15min":0.97499999999999998},"last":0.377},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.55900000000000005,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":3.4590000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.49399999999999999,"15min":0.495},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66000000000000003,"5min":0.79800000000000004,"15min":1.266},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76300000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.504}]},{"osd":4,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78200000000000003,"15min":0.79500000000000004},"min":{"1min":0.52600000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.306},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.79500000000000004,"15min":0.80400000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.436},"max":{"1min":1.028,"5min":1.131,"15min":1.262},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.528,"5min":3.528,"15min":3.528},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.79900000000000004,"15min":0.81399999999999995},"min":{"1min":0.47199999999999998,"5min":0.46999999999999997,"15min":0.45500000000000002},"max":{"1min":0.94599999999999995,"5min":1.2230000000000001,"15min":1.373},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.81699999999999995,"15min":0.80400000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.53000000000000003},"max":{"1min":3.4870000000000001,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.82699999999999996,"15min":0.82599999999999996},"min":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.47399999999999998},"max":{"1min":1.0329999999999999,"5min":1.194,"15min":1.331},"last":0.77100000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.61799999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.093,"5min":1.1659999999999999,"15min":1.4059999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.80300000000000005,"15min":0.81200000000000006},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.499},"max":{"1min":1.1220000000000001,"5min":1.1930000000000001,"15min":1.3169999999999999},"last":0.80600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:16:08.677 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-25T04:16:08.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.853+0000 7fedc90f7640 1 Processor -- start 2023-08-25T04:16:08.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.853+0000 7fedc90f7640 1 -- start start 2023-08-25T04:16:08.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.857+0000 7fedc90f7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fedc40d1120 0x7fedc406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:08.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.857+0000 7fedc90f7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc40afe20 con 0x7fedc406c150 2023-08-25T04:16:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.857+0000 7fedc90f7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc40af210 con 0x7fedc415ca50 2023-08-25T04:16:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.857+0000 7fedc90f7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc40af4f0 con 0x7fedc40d1120 2023-08-25T04:16:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.857+0000 7fedc37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fedc40d1120 0x7fedc406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.857+0000 7fedc37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fedc40d1120 0x7fedc406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40134/0 (socket says 172.21.15.55:40134) 2023-08-25T04:16:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.857+0000 7fedc37fe640 1 -- 172.21.15.55:0/3449539664 learned_addr learned my addr 172.21.15.55:0/3449539664 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:08.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.857+0000 7fedc37fe640 1 -- 172.21.15.55:0/3449539664 >> v1:172.21.15.110:6789/0 conn(0x7fedc415ca50 legacy=0x7fedc40d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:08.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.857+0000 7fedc37fe640 1 -- 172.21.15.55:0/3449539664 >> v1:172.21.15.55:6789/0 conn(0x7fedc406c150 legacy=0x7fedc40b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:08.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.857+0000 7fedc37fe640 1 -- 172.21.15.55:0/3449539664 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc40af7d0 con 0x7fedc40d1120 2023-08-25T04:16:08.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.861+0000 7fedc37fe640 1 --2- 172.21.15.55:0/3449539664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedc40d1120 0x7fedc406bc10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fedb8009870 tx=0x7fedb801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7444f316e454c928 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:08.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.861+0000 7fedc2ffd640 1 -- 172.21.15.55:0/3449539664 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb80ab620 con 0x7fedc40d1120 2023-08-25T04:16:08.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.861+0000 7fedc2ffd640 1 -- 172.21.15.55:0/3449539664 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb80ab780 con 0x7fedc40d1120 2023-08-25T04:16:08.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.861+0000 7fedc2ffd640 1 -- 172.21.15.55:0/3449539664 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb80abb10 con 0x7fedc40d1120 2023-08-25T04:16:08.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.861+0000 7fedc90f7640 1 -- 172.21.15.55:0/3449539664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedc40d1120 msgr2=0x7fedc406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:08.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.861+0000 7fedc90f7640 1 --2- 172.21.15.55:0/3449539664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedc40d1120 0x7fedc406bc10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fedb8009870 tx=0x7fedb801c510 comp rx=0 tx=0).stop 2023-08-25T04:16:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.861+0000 7fedc90f7640 1 -- 172.21.15.55:0/3449539664 shutdown_connections 2023-08-25T04:16:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.861+0000 7fedc90f7640 1 --2- 172.21.15.55:0/3449539664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedc40d1120 0x7fedc406bc10 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.861+0000 7fedc90f7640 1 -- 172.21.15.55:0/3449539664 >> 172.21.15.55:0/3449539664 conn(0x7fedc4065f40 msgr2=0x7fedc409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.861+0000 7fedc90f7640 1 -- 172.21.15.55:0/3449539664 shutdown_connections 2023-08-25T04:16:08.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.861+0000 7fedc90f7640 1 -- 172.21.15.55:0/3449539664 wait complete. 2023-08-25T04:16:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.861+0000 7fedc90f7640 1 Processor -- start 2023-08-25T04:16:08.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.861+0000 7fedc90f7640 1 -- start start 2023-08-25T04:16:08.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc90f7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedc406c150 0x7fedc40c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:08.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc90f7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedc40d1120 0x7fedc40b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:08.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc90f7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedc415ca50 0x7fedc4157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:08.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc90f7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc40c9030 con 0x7fedc406c150 2023-08-25T04:16:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc90f7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc4155290 con 0x7fedc415ca50 2023-08-25T04:16:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc90f7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc4154470 con 0x7fedc40d1120 2023-08-25T04:16:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedc406c150 0x7fedc40c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedc406c150 0x7fedc40c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40146/0 (socket says 172.21.15.55:40146) 2023-08-25T04:16:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc3fff640 1 -- 172.21.15.55:0/2451296501 learned_addr learned my addr 172.21.15.55:0/2451296501 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc37fe640 1 --2- 172.21.15.55:0/2451296501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedc40d1120 0x7fedc40b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc88f6640 1 --2- 172.21.15.55:0/2451296501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedc415ca50 0x7fedc4157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:08.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc3fff640 1 -- 172.21.15.55:0/2451296501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedc40d1120 msgr2=0x7fedc40b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:08.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc3fff640 1 --2- 172.21.15.55:0/2451296501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedc40d1120 0x7fedc40b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc3fff640 1 -- 172.21.15.55:0/2451296501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedc415ca50 msgr2=0x7fedc4157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:08.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc3fff640 1 --2- 172.21.15.55:0/2451296501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedc415ca50 0x7fedc4157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:08.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc3fff640 1 -- 172.21.15.55:0/2451296501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb80094d0 con 0x7fedc406c150 2023-08-25T04:16:08.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc3fff640 1 --2- 172.21.15.55:0/2451296501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedc406c150 0x7fedc40c8af0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fedb400c450 tx=0x7fedb400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:08.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc0ff9640 1 -- 172.21.15.55:0/2451296501 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb40052d0 con 0x7fedc406c150 2023-08-25T04:16:08.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc0ff9640 1 -- 172.21.15.55:0/2451296501 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb4005430 con 0x7fedc406c150 2023-08-25T04:16:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc90f7640 1 -- 172.21.15.55:0/2451296501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc4154710 con 0x7fedc406c150 2023-08-25T04:16:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc0ff9640 1 -- 172.21.15.55:0/2451296501 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4003890 con 0x7fedc406c150 2023-08-25T04:16:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc90f7640 1 -- 172.21.15.55:0/2451296501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc4154cd0 con 0x7fedc406c150 2023-08-25T04:16:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc90f7640 1 -- 172.21.15.55:0/2451296501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc4073e50 con 0x7fedc406c150 2023-08-25T04:16:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.865+0000 7fedc0ff9640 1 -- 172.21.15.55:0/2451296501 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fedb40039f0 con 0x7fedc406c150 2023-08-25T04:16:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.869+0000 7fedc0ff9640 1 --2- 172.21.15.55:0/2451296501 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fedb00657a0 0x7fedb0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.869+0000 7fedc0ff9640 1 -- 172.21.15.55:0/2451296501 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fedb4082a00 con 0x7fedc406c150 2023-08-25T04:16:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.869+0000 7fedc37fe640 1 --2- 172.21.15.55:0/2451296501 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fedb00657a0 0x7fedb0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.869+0000 7fedc37fe640 1 --2- 172.21.15.55:0/2451296501 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fedb00657a0 0x7fedb0067c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fedb80af000 tx=0x7fedb80b6040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:08.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:08.873+0000 7fedc0ff9640 1 -- 172.21.15.55:0/2451296501 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fedb4050450 con 0x7fedc406c150 2023-08-25T04:16:09.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.081+0000 7fedc90f7640 1 -- 172.21.15.55:0/2451296501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fedc4156390 con 0x7fedc406c150 2023-08-25T04:16:09.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.085+0000 7fedc0ff9640 1 -- 172.21.15.55:0/2451296501 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3209 (secure 0 0 0) 0x7fedb4053a70 con 0x7fedc406c150 2023-08-25T04:16:09.083 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:16:09.084 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":813,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":62,"num_osds":8,"num_up_osds":8,"osd_up_since":1692936167,"num_in_osds":8,"osd_in_since":1692936158,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592778,"bytes_used":325058560,"bytes_avail":772769054720,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":24,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":6207}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-08-25T04:15:50.554381+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-25T04:16:09.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.085+0000 7fedc90f7640 1 -- 172.21.15.55:0/2451296501 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fedb00657a0 msgr2=0x7fedb0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.085+0000 7fedc90f7640 1 --2- 172.21.15.55:0/2451296501 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fedb00657a0 0x7fedb0067c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fedb80af000 tx=0x7fedb80b6040 comp rx=0 tx=0).stop 2023-08-25T04:16:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.085+0000 7fedc90f7640 1 -- 172.21.15.55:0/2451296501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedc406c150 msgr2=0x7fedc40c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.085+0000 7fedc90f7640 1 --2- 172.21.15.55:0/2451296501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedc406c150 0x7fedc40c8af0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fedb400c450 tx=0x7fedb400c910 comp rx=0 tx=0).stop 2023-08-25T04:16:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.085+0000 7fedc90f7640 1 -- 172.21.15.55:0/2451296501 shutdown_connections 2023-08-25T04:16:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.085+0000 7fedc90f7640 1 --2- 172.21.15.55:0/2451296501 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fedb00657a0 0x7fedb0067c60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.085+0000 7fedc90f7640 1 --2- 172.21.15.55:0/2451296501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fedc415ca50 0x7fedc4157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.085+0000 7fedc90f7640 1 --2- 172.21.15.55:0/2451296501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fedc40d1120 0x7fedc40b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:09.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.085+0000 7fedc90f7640 1 --2- 172.21.15.55:0/2451296501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fedc406c150 0x7fedc40c8af0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:09.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.085+0000 7fedc90f7640 1 -- 172.21.15.55:0/2451296501 >> 172.21.15.55:0/2451296501 conn(0x7fedc4065f40 msgr2=0x7fedc40cf500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:09.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.085+0000 7fedc90f7640 1 -- 172.21.15.55:0/2451296501 shutdown_connections 2023-08-25T04:16:09.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.085+0000 7fedc90f7640 1 -- 172.21.15.55:0/2451296501 wait complete. 2023-08-25T04:16:09.105 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-25T04:16:09.105 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:16:09.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.249+0000 7fb2ec73a640 1 Processor -- start 2023-08-25T04:16:09.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.249+0000 7fb2ec73a640 1 -- start start 2023-08-25T04:16:09.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.249+0000 7fb2ec73a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2e40d0da0 0x7fb2e40d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:09.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.249+0000 7fb2ec73a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb2e40cdde0 0x7fb2e40ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:09.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.249+0000 7fb2ec73a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e40b29b0 con 0x7fb2e40cee60 2023-08-25T04:16:09.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.249+0000 7fb2ec73a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e40ce760 con 0x7fb2e40d0da0 2023-08-25T04:16:09.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.249+0000 7fb2ec73a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e40d16c0 con 0x7fb2e40cdde0 2023-08-25T04:16:09.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.249+0000 7fb2ea4d6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2e40d0da0 0x7fb2e40d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:09.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.249+0000 7fb2ea4d6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2e40d0da0 0x7fb2e40d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40160/0 (socket says 172.21.15.55:40160) 2023-08-25T04:16:09.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.249+0000 7fb2ea4d6640 1 -- 172.21.15.55:0/3520559205 learned_addr learned my addr 172.21.15.55:0/3520559205 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:09.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.249+0000 7fb2e9cd5640 1 --2- 172.21.15.55:0/3520559205 >> v2:172.21.15.110:3300/0 conn(0x7fb2e40cdde0 0x7fb2e40ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:09.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.249+0000 7fb2ea4d6640 1 -- 172.21.15.55:0/3520559205 >> v2:172.21.15.110:3300/0 conn(0x7fb2e40cdde0 msgr2=0x7fb2e40ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:09.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.249+0000 7fb2ea4d6640 1 --2- 172.21.15.55:0/3520559205 >> v2:172.21.15.110:3300/0 conn(0x7fb2e40cdde0 0x7fb2e40ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:09.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.249+0000 7fb2ea4d6640 1 -- 172.21.15.55:0/3520559205 >> v1:172.21.15.110:6789/0 conn(0x7fb2e40cee60 legacy=0x7fb2e40cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:09.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.249+0000 7fb2ea4d6640 1 -- 172.21.15.55:0/3520559205 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e40b1dc0 con 0x7fb2e40d0da0 2023-08-25T04:16:09.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.253+0000 7fb2ea4d6640 1 --2- 172.21.15.55:0/3520559205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e40d0da0 0x7fb2e40d1180 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40d38c0 tx=0x7fb2e001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fc3b86ef6053af server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:09.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.253+0000 7fb2e94d4640 1 -- 172.21.15.55:0/3520559205 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e00a89f0 con 0x7fb2e40d0da0 2023-08-25T04:16:09.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.253+0000 7fb2e94d4640 1 -- 172.21.15.55:0/3520559205 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e00a8b50 con 0x7fb2e40d0da0 2023-08-25T04:16:09.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.253+0000 7fb2e94d4640 1 -- 172.21.15.55:0/3520559205 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e00b0440 con 0x7fb2e40d0da0 2023-08-25T04:16:09.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.253+0000 7fb2ec73a640 1 -- 172.21.15.55:0/3520559205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e40d0da0 msgr2=0x7fb2e40d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:09.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.253+0000 7fb2ec73a640 1 --2- 172.21.15.55:0/3520559205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e40d0da0 0x7fb2e40d1180 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40d38c0 tx=0x7fb2e001ecf0 comp rx=0 tx=0).stop 2023-08-25T04:16:09.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.253+0000 7fb2ec73a640 1 -- 172.21.15.55:0/3520559205 shutdown_connections 2023-08-25T04:16:09.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.253+0000 7fb2ec73a640 1 --2- 172.21.15.55:0/3520559205 >> v2:172.21.15.110:3300/0 conn(0x7fb2e40cdde0 0x7fb2e40ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:09.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.253+0000 7fb2ec73a640 1 --2- 172.21.15.55:0/3520559205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e40d0da0 0x7fb2e40d1180 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:09.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.253+0000 7fb2ec73a640 1 -- 172.21.15.55:0/3520559205 >> 172.21.15.55:0/3520559205 conn(0x7fb2e409bae0 msgr2=0x7fb2e40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:09.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.253+0000 7fb2ec73a640 1 -- 172.21.15.55:0/3520559205 shutdown_connections 2023-08-25T04:16:09.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.253+0000 7fb2ec73a640 1 -- 172.21.15.55:0/3520559205 wait complete. 2023-08-25T04:16:09.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.253+0000 7fb2ec73a640 1 Processor -- start 2023-08-25T04:16:09.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2ec73a640 1 -- start start 2023-08-25T04:16:09.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2ec73a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e40cdde0 0x7fb2e4151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:09.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2ec73a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e40cee60 0x7fb2e40ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:09.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2ec73a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2e40d0da0 0x7fb2e415e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:09.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2ec73a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40c6b70 con 0x7fb2e40cee60 2023-08-25T04:16:09.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2ec73a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e41521f0 con 0x7fb2e40cdde0 2023-08-25T04:16:09.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2ec73a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40cb440 con 0x7fb2e40d0da0 2023-08-25T04:16:09.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2e9cd5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e40cee60 0x7fb2e40ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:09.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2e9cd5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e40cee60 0x7fb2e40ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40176/0 (socket says 172.21.15.55:40176) 2023-08-25T04:16:09.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2e9cd5640 1 -- 172.21.15.55:0/2863564583 learned_addr learned my addr 172.21.15.55:0/2863564583 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:09.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2ea4d6640 1 --2- 172.21.15.55:0/2863564583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e40cdde0 0x7fb2e4151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:09.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2eacd7640 1 --2- 172.21.15.55:0/2863564583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2e40d0da0 0x7fb2e415e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:09.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2e9cd5640 1 -- 172.21.15.55:0/2863564583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2e40d0da0 msgr2=0x7fb2e415e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2e9cd5640 1 --2- 172.21.15.55:0/2863564583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2e40d0da0 0x7fb2e415e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2e9cd5640 1 -- 172.21.15.55:0/2863564583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e40cdde0 msgr2=0x7fb2e4151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2e9cd5640 1 --2- 172.21.15.55:0/2863564583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e40cdde0 0x7fb2e4151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2e9cd5640 1 -- 172.21.15.55:0/2863564583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e0009480 con 0x7fb2e40cee60 2023-08-25T04:16:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2e9cd5640 1 --2- 172.21.15.55:0/2863564583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e40cee60 0x7fb2e40ca2a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400d5f0 tx=0x7fb2d400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2daffd640 1 -- 172.21.15.55:0/2863564583 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d40125f0 con 0x7fb2e40cee60 2023-08-25T04:16:09.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2daffd640 1 -- 172.21.15.55:0/2863564583 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d4012750 con 0x7fb2e40cee60 2023-08-25T04:16:09.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2daffd640 1 -- 172.21.15.55:0/2863564583 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4012ae0 con 0x7fb2e40cee60 2023-08-25T04:16:09.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2ec73a640 1 -- 172.21.15.55:0/2863564583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e40caba0 con 0x7fb2e40cee60 2023-08-25T04:16:09.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2ec73a640 1 -- 172.21.15.55:0/2863564583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e40cb160 con 0x7fb2e40cee60 2023-08-25T04:16:09.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.257+0000 7fb2ec73a640 1 -- 172.21.15.55:0/2863564583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e404dbe0 con 0x7fb2e40cee60 2023-08-25T04:16:09.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.261+0000 7fb2daffd640 1 -- 172.21.15.55:0/2863564583 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fb2d4012c40 con 0x7fb2e40cee60 2023-08-25T04:16:09.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.261+0000 7fb2daffd640 1 --2- 172.21.15.55:0/2863564583 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fb2c80657a0 0x7fb2c8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:09.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.261+0000 7fb2daffd640 1 -- 172.21.15.55:0/2863564583 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb2d4083350 con 0x7fb2e40cee60 2023-08-25T04:16:09.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.261+0000 7fb2ea4d6640 1 --2- 172.21.15.55:0/2863564583 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fb2c80657a0 0x7fb2c8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:09.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.261+0000 7fb2ea4d6640 1 --2- 172.21.15.55:0/2863564583 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fb2c80657a0 0x7fb2c8067c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00b2000 tx=0x7fb2e00aa070 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.265+0000 7fb2daffd640 1 -- 172.21.15.55:0/2863564583 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb2d4050da0 con 0x7fb2e40cee60 2023-08-25T04:16:09.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.417+0000 7fb2ec73a640 1 -- 172.21.15.55:0/2863564583 --> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2e40b2360 con 0x7fb2c80657a0 2023-08-25T04:16:09.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.425+0000 7fb2daffd640 1 -- 172.21.15.55:0/2863564583 <== mgr.5922 v2:172.21.15.110:6832/1373721950 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310905 (secure 0 0 0) 0x7fb2e00b0440 con 0x7fb2c80657a0 2023-08-25T04:16:09.427 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:16:09.429 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:16:09.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.429+0000 7fb2ec73a640 1 -- 172.21.15.55:0/2863564583 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fb2c80657a0 msgr2=0x7fb2c8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:09.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.429+0000 7fb2ec73a640 1 --2- 172.21.15.55:0/2863564583 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fb2c80657a0 0x7fb2c8067c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00b2000 tx=0x7fb2e00aa070 comp rx=0 tx=0).stop 2023-08-25T04:16:09.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.429+0000 7fb2ec73a640 1 -- 172.21.15.55:0/2863564583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e40cee60 msgr2=0x7fb2e40ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:09.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.429+0000 7fb2ec73a640 1 --2- 172.21.15.55:0/2863564583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e40cee60 0x7fb2e40ca2a0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400d5f0 tx=0x7fb2d400dab0 comp rx=0 tx=0).stop 2023-08-25T04:16:09.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.429+0000 7fb2ec73a640 1 -- 172.21.15.55:0/2863564583 shutdown_connections 2023-08-25T04:16:09.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.429+0000 7fb2ec73a640 1 --2- 172.21.15.55:0/2863564583 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fb2c80657a0 0x7fb2c8067c60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:09.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.429+0000 7fb2ec73a640 1 --2- 172.21.15.55:0/2863564583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2e40d0da0 0x7fb2e415e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:09.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.429+0000 7fb2ec73a640 1 --2- 172.21.15.55:0/2863564583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e40cee60 0x7fb2e40ca2a0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:09.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.429+0000 7fb2ec73a640 1 --2- 172.21.15.55:0/2863564583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e40cdde0 0x7fb2e4151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:09.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.429+0000 7fb2ec73a640 1 -- 172.21.15.55:0/2863564583 >> 172.21.15.55:0/2863564583 conn(0x7fb2e409bae0 msgr2=0x7fb2e40b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:09.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.429+0000 7fb2ec73a640 1 -- 172.21.15.55:0/2863564583 shutdown_connections 2023-08-25T04:16:09.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:09.429+0000 7fb2ec73a640 1 -- 172.21.15.55:0/2863564583 wait complete. 2023-08-25T04:16:09.448 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-25T04:16:08.558610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":243,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":177,"ondisk_log_size":177,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317440,"kb_used_data":6920,"kb_used_omap":13,"kb_used_meta":310386,"kb_avail":754657280,"statfs":{"total":773094113280,"available":772769054720,"internally_reserved":0,"allocated":7086080,"data_stored":3984860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":317835352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001535"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148559+0000","last_change":"2023-08-25T04:16:03.761499+0000","last_active":"2023-08-25T04:16:05.148559+0000","last_peered":"2023-08-25T04:16:05.148559+0000","last_clean":"2023-08-25T04:16:05.148559+0000","last_became_active":"2023-08-25T04:16:03.761153+0000","last_became_peered":"2023-08-25T04:16:03.761153+0000","last_unstale":"2023-08-25T04:16:05.148559+0000","last_undegraded":"2023-08-25T04:16:05.148559+0000","last_fullsized":"2023-08-25T04:16:05.148559+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:37:23.181361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146928+0000","last_change":"2023-08-25T04:16:03.772387+0000","last_active":"2023-08-25T04:16:05.146928+0000","last_peered":"2023-08-25T04:16:05.146928+0000","last_clean":"2023-08-25T04:16:05.146928+0000","last_became_active":"2023-08-25T04:16:03.772074+0000","last_became_peered":"2023-08-25T04:16:03.772074+0000","last_unstale":"2023-08-25T04:16:05.146928+0000","last_undegraded":"2023-08-25T04:16:05.146928+0000","last_fullsized":"2023-08-25T04:16:05.146928+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:50.801153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765805+0000","last_change":"2023-08-25T04:16:03.784558+0000","last_active":"2023-08-25T04:16:04.765805+0000","last_peered":"2023-08-25T04:16:04.765805+0000","last_clean":"2023-08-25T04:16:04.765805+0000","last_became_active":"2023-08-25T04:16:03.784188+0000","last_became_peered":"2023-08-25T04:16:03.784188+0000","last_unstale":"2023-08-25T04:16:04.765805+0000","last_undegraded":"2023-08-25T04:16:04.765805+0000","last_fullsized":"2023-08-25T04:16:04.765805+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:48:59.520120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147224+0000","last_change":"2023-08-25T04:16:03.777815+0000","last_active":"2023-08-25T04:16:05.147224+0000","last_peered":"2023-08-25T04:16:05.147224+0000","last_clean":"2023-08-25T04:16:05.147224+0000","last_became_active":"2023-08-25T04:16:03.777534+0000","last_became_peered":"2023-08-25T04:16:03.777534+0000","last_unstale":"2023-08-25T04:16:05.147224+0000","last_undegraded":"2023-08-25T04:16:05.147224+0000","last_fullsized":"2023-08-25T04:16:05.147224+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:14:34.423119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748245+0000","last_change":"2023-08-25T04:16:03.773146+0000","last_active":"2023-08-25T04:16:04.748245+0000","last_peered":"2023-08-25T04:16:04.748245+0000","last_clean":"2023-08-25T04:16:04.748245+0000","last_became_active":"2023-08-25T04:16:03.772836+0000","last_became_peered":"2023-08-25T04:16:03.772836+0000","last_unstale":"2023-08-25T04:16:04.748245+0000","last_undegraded":"2023-08-25T04:16:04.748245+0000","last_fullsized":"2023-08-25T04:16:04.748245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:07:03.688469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148148+0000","last_change":"2023-08-25T04:16:03.770177+0000","last_active":"2023-08-25T04:16:05.148148+0000","last_peered":"2023-08-25T04:16:05.148148+0000","last_clean":"2023-08-25T04:16:05.148148+0000","last_became_active":"2023-08-25T04:16:03.769847+0000","last_became_peered":"2023-08-25T04:16:03.769847+0000","last_unstale":"2023-08-25T04:16:05.148148+0000","last_undegraded":"2023-08-25T04:16:05.148148+0000","last_fullsized":"2023-08-25T04:16:05.148148+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:45:01.763265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765553+0000","last_change":"2023-08-25T04:16:03.786842+0000","last_active":"2023-08-25T04:16:04.765553+0000","last_peered":"2023-08-25T04:16:04.765553+0000","last_clean":"2023-08-25T04:16:04.765553+0000","last_became_active":"2023-08-25T04:16:03.786519+0000","last_became_peered":"2023-08-25T04:16:03.786519+0000","last_unstale":"2023-08-25T04:16:04.765553+0000","last_undegraded":"2023-08-25T04:16:04.765553+0000","last_fullsized":"2023-08-25T04:16:04.765553+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:03:20.331759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149084+0000","last_change":"2023-08-25T04:16:03.785429+0000","last_active":"2023-08-25T04:16:05.149084+0000","last_peered":"2023-08-25T04:16:05.149084+0000","last_clean":"2023-08-25T04:16:05.149084+0000","last_became_active":"2023-08-25T04:16:03.785135+0000","last_became_peered":"2023-08-25T04:16:03.785135+0000","last_unstale":"2023-08-25T04:16:05.149084+0000","last_undegraded":"2023-08-25T04:16:05.149084+0000","last_fullsized":"2023-08-25T04:16:05.149084+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:53:50.169207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149288+0000","last_change":"2023-08-25T04:16:03.789063+0000","last_active":"2023-08-25T04:16:05.149288+0000","last_peered":"2023-08-25T04:16:05.149288+0000","last_clean":"2023-08-25T04:16:05.149288+0000","last_became_active":"2023-08-25T04:16:03.788776+0000","last_became_peered":"2023-08-25T04:16:03.788776+0000","last_unstale":"2023-08-25T04:16:05.149288+0000","last_undegraded":"2023-08-25T04:16:05.149288+0000","last_fullsized":"2023-08-25T04:16:05.149288+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:07:11.743677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148632+0000","last_change":"2023-08-25T04:16:03.776557+0000","last_active":"2023-08-25T04:16:05.148632+0000","last_peered":"2023-08-25T04:16:05.148632+0000","last_clean":"2023-08-25T04:16:05.148632+0000","last_became_active":"2023-08-25T04:16:03.776251+0000","last_became_peered":"2023-08-25T04:16:03.776251+0000","last_unstale":"2023-08-25T04:16:05.148632+0000","last_undegraded":"2023-08-25T04:16:05.148632+0000","last_fullsized":"2023-08-25T04:16:05.148632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:54:53.827365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.750560+0000","last_change":"2023-08-25T04:16:03.774830+0000","last_active":"2023-08-25T04:16:04.750560+0000","last_peered":"2023-08-25T04:16:04.750560+0000","last_clean":"2023-08-25T04:16:04.750560+0000","last_became_active":"2023-08-25T04:16:03.774536+0000","last_became_peered":"2023-08-25T04:16:03.774536+0000","last_unstale":"2023-08-25T04:16:04.750560+0000","last_undegraded":"2023-08-25T04:16:04.750560+0000","last_fullsized":"2023-08-25T04:16:04.750560+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:36.325046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148827+0000","last_change":"2023-08-25T04:16:03.756809+0000","last_active":"2023-08-25T04:16:05.148827+0000","last_peered":"2023-08-25T04:16:05.148827+0000","last_clean":"2023-08-25T04:16:05.148827+0000","last_became_active":"2023-08-25T04:16:03.756470+0000","last_became_peered":"2023-08-25T04:16:03.756470+0000","last_unstale":"2023-08-25T04:16:05.148827+0000","last_undegraded":"2023-08-25T04:16:05.148827+0000","last_fullsized":"2023-08-25T04:16:05.148827+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:21.805796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148382+0000","last_change":"2023-08-25T04:16:03.775897+0000","last_active":"2023-08-25T04:16:05.148382+0000","last_peered":"2023-08-25T04:16:05.148382+0000","last_clean":"2023-08-25T04:16:05.148382+0000","last_became_active":"2023-08-25T04:16:03.775606+0000","last_became_peered":"2023-08-25T04:16:03.775606+0000","last_unstale":"2023-08-25T04:16:05.148382+0000","last_undegraded":"2023-08-25T04:16:05.148382+0000","last_fullsized":"2023-08-25T04:16:05.148382+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:37:03.947281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765715+0000","last_change":"2023-08-25T04:16:03.786703+0000","last_active":"2023-08-25T04:16:04.765715+0000","last_peered":"2023-08-25T04:16:04.765715+0000","last_clean":"2023-08-25T04:16:04.765715+0000","last_became_active":"2023-08-25T04:16:03.786381+0000","last_became_peered":"2023-08-25T04:16:03.786381+0000","last_unstale":"2023-08-25T04:16:04.765715+0000","last_undegraded":"2023-08-25T04:16:04.765715+0000","last_fullsized":"2023-08-25T04:16:04.765715+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:33.769674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146248+0000","last_change":"2023-08-25T04:16:03.773379+0000","last_active":"2023-08-25T04:16:05.146248+0000","last_peered":"2023-08-25T04:16:05.146248+0000","last_clean":"2023-08-25T04:16:05.146248+0000","last_became_active":"2023-08-25T04:16:03.771783+0000","last_became_peered":"2023-08-25T04:16:03.771783+0000","last_unstale":"2023-08-25T04:16:05.146248+0000","last_undegraded":"2023-08-25T04:16:05.146248+0000","last_fullsized":"2023-08-25T04:16:05.146248+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:36:19.208784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148110+0000","last_change":"2023-08-25T04:16:03.775960+0000","last_active":"2023-08-25T04:16:05.148110+0000","last_peered":"2023-08-25T04:16:05.148110+0000","last_clean":"2023-08-25T04:16:05.148110+0000","last_became_active":"2023-08-25T04:16:03.775687+0000","last_became_peered":"2023-08-25T04:16:03.775687+0000","last_unstale":"2023-08-25T04:16:05.148110+0000","last_undegraded":"2023-08-25T04:16:05.148110+0000","last_fullsized":"2023-08-25T04:16:05.148110+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:44:04.110996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766206+0000","last_change":"2023-08-25T04:16:03.787692+0000","last_active":"2023-08-25T04:16:04.766206+0000","last_peered":"2023-08-25T04:16:04.766206+0000","last_clean":"2023-08-25T04:16:04.766206+0000","last_became_active":"2023-08-25T04:16:03.787397+0000","last_became_peered":"2023-08-25T04:16:03.787397+0000","last_unstale":"2023-08-25T04:16:04.766206+0000","last_undegraded":"2023-08-25T04:16:04.766206+0000","last_fullsized":"2023-08-25T04:16:04.766206+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:07:03.688469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147055+0000","last_change":"2023-08-25T04:16:03.776606+0000","last_active":"2023-08-25T04:16:05.147055+0000","last_peered":"2023-08-25T04:16:05.147055+0000","last_clean":"2023-08-25T04:16:05.147055+0000","last_became_active":"2023-08-25T04:16:03.776241+0000","last_became_peered":"2023-08-25T04:16:03.776241+0000","last_unstale":"2023-08-25T04:16:05.147055+0000","last_undegraded":"2023-08-25T04:16:05.147055+0000","last_fullsized":"2023-08-25T04:16:05.147055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:05:44.353136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765945+0000","last_change":"2023-08-25T04:16:03.787944+0000","last_active":"2023-08-25T04:16:04.765945+0000","last_peered":"2023-08-25T04:16:04.765945+0000","last_clean":"2023-08-25T04:16:04.765945+0000","last_became_active":"2023-08-25T04:16:03.787621+0000","last_became_peered":"2023-08-25T04:16:03.787621+0000","last_unstale":"2023-08-25T04:16:04.765945+0000","last_undegraded":"2023-08-25T04:16:04.765945+0000","last_fullsized":"2023-08-25T04:16:04.765945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:18:00.835206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748469+0000","last_change":"2023-08-25T04:16:03.776098+0000","last_active":"2023-08-25T04:16:04.748469+0000","last_peered":"2023-08-25T04:16:04.748469+0000","last_clean":"2023-08-25T04:16:04.748469+0000","last_became_active":"2023-08-25T04:16:03.775792+0000","last_became_peered":"2023-08-25T04:16:03.775792+0000","last_unstale":"2023-08-25T04:16:04.748469+0000","last_undegraded":"2023-08-25T04:16:04.748469+0000","last_fullsized":"2023-08-25T04:16:04.748469+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:45:15.044627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748469+0000","last_change":"2023-08-25T04:16:03.768123+0000","last_active":"2023-08-25T04:16:04.748469+0000","last_peered":"2023-08-25T04:16:04.748469+0000","last_clean":"2023-08-25T04:16:04.748469+0000","last_became_active":"2023-08-25T04:16:03.767768+0000","last_became_peered":"2023-08-25T04:16:03.767768+0000","last_unstale":"2023-08-25T04:16:04.748469+0000","last_undegraded":"2023-08-25T04:16:04.748469+0000","last_fullsized":"2023-08-25T04:16:04.748469+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:22:41.895685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148858+0000","last_change":"2023-08-25T04:16:03.785327+0000","last_active":"2023-08-25T04:16:05.148858+0000","last_peered":"2023-08-25T04:16:05.148858+0000","last_clean":"2023-08-25T04:16:05.148858+0000","last_became_active":"2023-08-25T04:16:03.785022+0000","last_became_peered":"2023-08-25T04:16:03.785022+0000","last_unstale":"2023-08-25T04:16:05.148858+0000","last_undegraded":"2023-08-25T04:16:05.148858+0000","last_fullsized":"2023-08-25T04:16:05.148858+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:26:44.775981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.750203+0000","last_change":"2023-08-25T04:16:03.769501+0000","last_active":"2023-08-25T04:16:04.750203+0000","last_peered":"2023-08-25T04:16:04.750203+0000","last_clean":"2023-08-25T04:16:04.750203+0000","last_became_active":"2023-08-25T04:16:03.769236+0000","last_became_peered":"2023-08-25T04:16:03.769236+0000","last_unstale":"2023-08-25T04:16:04.750203+0000","last_undegraded":"2023-08-25T04:16:04.750203+0000","last_fullsized":"2023-08-25T04:16:04.750203+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:58:58.749772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765491+0000","last_change":"2023-08-25T04:16:03.783410+0000","last_active":"2023-08-25T04:16:04.765491+0000","last_peered":"2023-08-25T04:16:04.765491+0000","last_clean":"2023-08-25T04:16:04.765491+0000","last_became_active":"2023-08-25T04:16:03.783117+0000","last_became_peered":"2023-08-25T04:16:03.783117+0000","last_unstale":"2023-08-25T04:16:04.765491+0000","last_undegraded":"2023-08-25T04:16:04.765491+0000","last_fullsized":"2023-08-25T04:16:04.765491+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:10:59.362603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766240+0000","last_change":"2023-08-25T04:16:03.782629+0000","last_active":"2023-08-25T04:16:04.766240+0000","last_peered":"2023-08-25T04:16:04.766240+0000","last_clean":"2023-08-25T04:16:04.766240+0000","last_became_active":"2023-08-25T04:16:03.782344+0000","last_became_peered":"2023-08-25T04:16:03.782344+0000","last_unstale":"2023-08-25T04:16:04.766240+0000","last_undegraded":"2023-08-25T04:16:04.766240+0000","last_fullsized":"2023-08-25T04:16:04.766240+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:55.150693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148884+0000","last_change":"2023-08-25T04:16:03.759410+0000","last_active":"2023-08-25T04:16:05.148884+0000","last_peered":"2023-08-25T04:16:05.148884+0000","last_clean":"2023-08-25T04:16:05.148884+0000","last_became_active":"2023-08-25T04:16:03.758840+0000","last_became_peered":"2023-08-25T04:16:03.758840+0000","last_unstale":"2023-08-25T04:16:05.148884+0000","last_undegraded":"2023-08-25T04:16:05.148884+0000","last_fullsized":"2023-08-25T04:16:05.148884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:24:29.741709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148710+0000","last_change":"2023-08-25T04:16:03.785204+0000","last_active":"2023-08-25T04:16:05.148710+0000","last_peered":"2023-08-25T04:16:05.148710+0000","last_clean":"2023-08-25T04:16:05.148710+0000","last_became_active":"2023-08-25T04:16:03.784847+0000","last_became_peered":"2023-08-25T04:16:03.784847+0000","last_unstale":"2023-08-25T04:16:05.148710+0000","last_undegraded":"2023-08-25T04:16:05.148710+0000","last_fullsized":"2023-08-25T04:16:05.148710+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:46.894701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748640+0000","last_change":"2023-08-25T04:16:03.756349+0000","last_active":"2023-08-25T04:16:04.748640+0000","last_peered":"2023-08-25T04:16:04.748640+0000","last_clean":"2023-08-25T04:16:04.748640+0000","last_became_active":"2023-08-25T04:16:03.755958+0000","last_became_peered":"2023-08-25T04:16:03.755958+0000","last_unstale":"2023-08-25T04:16:04.748640+0000","last_undegraded":"2023-08-25T04:16:04.748640+0000","last_fullsized":"2023-08-25T04:16:04.748640+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:34:35.864224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765730+0000","last_change":"2023-08-25T04:16:03.783135+0000","last_active":"2023-08-25T04:16:04.765730+0000","last_peered":"2023-08-25T04:16:04.765730+0000","last_clean":"2023-08-25T04:16:04.765730+0000","last_became_active":"2023-08-25T04:16:03.782771+0000","last_became_peered":"2023-08-25T04:16:03.782771+0000","last_unstale":"2023-08-25T04:16:04.765730+0000","last_undegraded":"2023-08-25T04:16:04.765730+0000","last_fullsized":"2023-08-25T04:16:04.765730+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:17:20.793802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146616+0000","last_change":"2023-08-25T04:16:03.769209+0000","last_active":"2023-08-25T04:16:05.146616+0000","last_peered":"2023-08-25T04:16:05.146616+0000","last_clean":"2023-08-25T04:16:05.146616+0000","last_became_active":"2023-08-25T04:16:03.768666+0000","last_became_peered":"2023-08-25T04:16:03.768666+0000","last_unstale":"2023-08-25T04:16:05.146616+0000","last_undegraded":"2023-08-25T04:16:05.146616+0000","last_fullsized":"2023-08-25T04:16:05.146616+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:16:49.457554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765637+0000","last_change":"2023-08-25T04:16:03.780860+0000","last_active":"2023-08-25T04:16:04.765637+0000","last_peered":"2023-08-25T04:16:04.765637+0000","last_clean":"2023-08-25T04:16:04.765637+0000","last_became_active":"2023-08-25T04:16:03.780552+0000","last_became_peered":"2023-08-25T04:16:03.780552+0000","last_unstale":"2023-08-25T04:16:04.765637+0000","last_undegraded":"2023-08-25T04:16:04.765637+0000","last_fullsized":"2023-08-25T04:16:04.765637+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:32:56.502762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146400+0000","last_change":"2023-08-25T04:16:03.759257+0000","last_active":"2023-08-25T04:16:05.146400+0000","last_peered":"2023-08-25T04:16:05.146400+0000","last_clean":"2023-08-25T04:16:05.146400+0000","last_became_active":"2023-08-25T04:16:03.758689+0000","last_became_peered":"2023-08-25T04:16:03.758689+0000","last_unstale":"2023-08-25T04:16:05.146400+0000","last_undegraded":"2023-08-25T04:16:05.146400+0000","last_fullsized":"2023-08-25T04:16:05.146400+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:31:23.845883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146117+0000","last_change":"2023-08-25T04:16:03.772450+0000","last_active":"2023-08-25T04:16:05.146117+0000","last_peered":"2023-08-25T04:16:05.146117+0000","last_clean":"2023-08-25T04:16:05.146117+0000","last_became_active":"2023-08-25T04:16:03.772138+0000","last_became_peered":"2023-08-25T04:16:03.772138+0000","last_unstale":"2023-08-25T04:16:05.146117+0000","last_undegraded":"2023-08-25T04:16:05.146117+0000","last_fullsized":"2023-08-25T04:16:05.146117+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:30:15.714145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"61'4","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748428+0000","last_change":"2023-08-25T04:16:02.754044+0000","last_active":"2023-08-25T04:16:04.748428+0000","last_peered":"2023-08-25T04:16:04.748428+0000","last_clean":"2023-08-25T04:16:04.748428+0000","last_became_active":"2023-08-25T04:16:02.753745+0000","last_became_peered":"2023-08-25T04:16:02.753745+0000","last_unstale":"2023-08-25T04:16:04.748428+0000","last_undegraded":"2023-08-25T04:16:04.748428+0000","last_fullsized":"2023-08-25T04:16:04.748428+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:31.834153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146631+0000","last_change":"2023-08-25T04:16:03.770251+0000","last_active":"2023-08-25T04:16:05.146631+0000","last_peered":"2023-08-25T04:16:05.146631+0000","last_clean":"2023-08-25T04:16:05.146631+0000","last_became_active":"2023-08-25T04:16:03.769936+0000","last_became_peered":"2023-08-25T04:16:03.769936+0000","last_unstale":"2023-08-25T04:16:05.146631+0000","last_undegraded":"2023-08-25T04:16:05.146631+0000","last_fullsized":"2023-08-25T04:16:05.146631+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:38.733640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148725+0000","last_change":"2023-08-25T04:16:02.770511+0000","last_active":"2023-08-25T04:16:05.148725+0000","last_peered":"2023-08-25T04:16:05.148725+0000","last_clean":"2023-08-25T04:16:05.148725+0000","last_became_active":"2023-08-25T04:16:02.770243+0000","last_became_peered":"2023-08-25T04:16:02.770243+0000","last_unstale":"2023-08-25T04:16:05.148725+0000","last_undegraded":"2023-08-25T04:16:05.148725+0000","last_fullsized":"2023-08-25T04:16:05.148725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:45.356869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748134+0000","last_change":"2023-08-25T04:16:03.768344+0000","last_active":"2023-08-25T04:16:04.748134+0000","last_peered":"2023-08-25T04:16:04.748134+0000","last_clean":"2023-08-25T04:16:04.748134+0000","last_became_active":"2023-08-25T04:16:03.767937+0000","last_became_peered":"2023-08-25T04:16:03.767937+0000","last_unstale":"2023-08-25T04:16:04.748134+0000","last_undegraded":"2023-08-25T04:16:04.748134+0000","last_fullsized":"2023-08-25T04:16:04.748134+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:31:47.264743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148875+0000","last_change":"2023-08-25T04:16:02.758582+0000","last_active":"2023-08-25T04:16:05.148875+0000","last_peered":"2023-08-25T04:16:05.148875+0000","last_clean":"2023-08-25T04:16:05.148875+0000","last_became_active":"2023-08-25T04:16:02.757685+0000","last_became_peered":"2023-08-25T04:16:02.757685+0000","last_unstale":"2023-08-25T04:16:05.148875+0000","last_undegraded":"2023-08-25T04:16:05.148875+0000","last_fullsized":"2023-08-25T04:16:05.148875+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:44:00.828275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149146+0000","last_change":"2023-08-25T04:16:03.758896+0000","last_active":"2023-08-25T04:16:05.149146+0000","last_peered":"2023-08-25T04:16:05.149146+0000","last_clean":"2023-08-25T04:16:05.149146+0000","last_became_active":"2023-08-25T04:16:03.758622+0000","last_became_peered":"2023-08-25T04:16:03.758622+0000","last_unstale":"2023-08-25T04:16:05.149146+0000","last_undegraded":"2023-08-25T04:16:05.149146+0000","last_fullsized":"2023-08-25T04:16:05.149146+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:25.716695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147155+0000","last_change":"2023-08-25T04:16:02.767008+0000","last_active":"2023-08-25T04:16:05.147155+0000","last_peered":"2023-08-25T04:16:05.147155+0000","last_clean":"2023-08-25T04:16:05.147155+0000","last_became_active":"2023-08-25T04:16:02.766694+0000","last_became_peered":"2023-08-25T04:16:02.766694+0000","last_unstale":"2023-08-25T04:16:05.147155+0000","last_undegraded":"2023-08-25T04:16:05.147155+0000","last_fullsized":"2023-08-25T04:16:05.147155+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:50:23.007130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748939+0000","last_change":"2023-08-25T04:16:03.779198+0000","last_active":"2023-08-25T04:16:04.748939+0000","last_peered":"2023-08-25T04:16:04.748939+0000","last_clean":"2023-08-25T04:16:04.748939+0000","last_became_active":"2023-08-25T04:16:03.778920+0000","last_became_peered":"2023-08-25T04:16:03.778920+0000","last_unstale":"2023-08-25T04:16:04.748939+0000","last_undegraded":"2023-08-25T04:16:04.748939+0000","last_fullsized":"2023-08-25T04:16:04.748939+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:55.150693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765740+0000","last_change":"2023-08-25T04:16:02.766806+0000","last_active":"2023-08-25T04:16:04.765740+0000","last_peered":"2023-08-25T04:16:04.765740+0000","last_clean":"2023-08-25T04:16:04.765740+0000","last_became_active":"2023-08-25T04:16:02.766547+0000","last_became_peered":"2023-08-25T04:16:02.766547+0000","last_unstale":"2023-08-25T04:16:04.765740+0000","last_undegraded":"2023-08-25T04:16:04.765740+0000","last_fullsized":"2023-08-25T04:16:04.765740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:02.787535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146412+0000","last_change":"2023-08-25T04:16:03.775323+0000","last_active":"2023-08-25T04:16:05.146412+0000","last_peered":"2023-08-25T04:16:05.146412+0000","last_clean":"2023-08-25T04:16:05.146412+0000","last_became_active":"2023-08-25T04:16:03.774876+0000","last_became_peered":"2023-08-25T04:16:03.774876+0000","last_unstale":"2023-08-25T04:16:05.146412+0000","last_undegraded":"2023-08-25T04:16:05.146412+0000","last_fullsized":"2023-08-25T04:16:05.146412+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:26:24.667103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.747983+0000","last_change":"2023-08-25T04:16:02.756878+0000","last_active":"2023-08-25T04:16:04.747983+0000","last_peered":"2023-08-25T04:16:04.747983+0000","last_clean":"2023-08-25T04:16:04.747983+0000","last_became_active":"2023-08-25T04:16:02.756603+0000","last_became_peered":"2023-08-25T04:16:02.756603+0000","last_unstale":"2023-08-25T04:16:04.747983+0000","last_undegraded":"2023-08-25T04:16:04.747983+0000","last_fullsized":"2023-08-25T04:16:04.747983+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:49:46.810312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149187+0000","last_change":"2023-08-25T04:16:03.759222+0000","last_active":"2023-08-25T04:16:05.149187+0000","last_peered":"2023-08-25T04:16:05.149187+0000","last_clean":"2023-08-25T04:16:05.149187+0000","last_became_active":"2023-08-25T04:16:03.758489+0000","last_became_peered":"2023-08-25T04:16:03.758489+0000","last_unstale":"2023-08-25T04:16:05.149187+0000","last_undegraded":"2023-08-25T04:16:05.149187+0000","last_fullsized":"2023-08-25T04:16:05.149187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:54:46.607192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748162+0000","last_change":"2023-08-25T04:16:02.757095+0000","last_active":"2023-08-25T04:16:04.748162+0000","last_peered":"2023-08-25T04:16:04.748162+0000","last_clean":"2023-08-25T04:16:04.748162+0000","last_became_active":"2023-08-25T04:16:02.756829+0000","last_became_peered":"2023-08-25T04:16:02.756829+0000","last_unstale":"2023-08-25T04:16:04.748162+0000","last_undegraded":"2023-08-25T04:16:04.748162+0000","last_fullsized":"2023-08-25T04:16:04.748162+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:36.997870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147325+0000","last_change":"2023-08-25T04:16:03.785771+0000","last_active":"2023-08-25T04:16:05.147325+0000","last_peered":"2023-08-25T04:16:05.147325+0000","last_clean":"2023-08-25T04:16:05.147325+0000","last_became_active":"2023-08-25T04:16:03.785442+0000","last_became_peered":"2023-08-25T04:16:03.785442+0000","last_unstale":"2023-08-25T04:16:05.147325+0000","last_undegraded":"2023-08-25T04:16:05.147325+0000","last_fullsized":"2023-08-25T04:16:05.147325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:32:17.663807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765509+0000","last_change":"2023-08-25T04:16:02.766205+0000","last_active":"2023-08-25T04:16:04.765509+0000","last_peered":"2023-08-25T04:16:04.765509+0000","last_clean":"2023-08-25T04:16:04.765509+0000","last_became_active":"2023-08-25T04:16:02.765799+0000","last_became_peered":"2023-08-25T04:16:02.765799+0000","last_unstale":"2023-08-25T04:16:04.765509+0000","last_undegraded":"2023-08-25T04:16:04.765509+0000","last_fullsized":"2023-08-25T04:16:04.765509+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:41:27.023839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748061+0000","last_change":"2023-08-25T04:16:03.772083+0000","last_active":"2023-08-25T04:16:04.748061+0000","last_peered":"2023-08-25T04:16:04.748061+0000","last_clean":"2023-08-25T04:16:04.748061+0000","last_became_active":"2023-08-25T04:16:03.771610+0000","last_became_peered":"2023-08-25T04:16:03.771610+0000","last_unstale":"2023-08-25T04:16:04.748061+0000","last_undegraded":"2023-08-25T04:16:04.748061+0000","last_fullsized":"2023-08-25T04:16:04.748061+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:43:45.063038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147100+0000","last_change":"2023-08-25T04:16:02.759755+0000","last_active":"2023-08-25T04:16:05.147100+0000","last_peered":"2023-08-25T04:16:05.147100+0000","last_clean":"2023-08-25T04:16:05.147100+0000","last_became_active":"2023-08-25T04:16:02.759428+0000","last_became_peered":"2023-08-25T04:16:02.759428+0000","last_unstale":"2023-08-25T04:16:05.147100+0000","last_undegraded":"2023-08-25T04:16:05.147100+0000","last_fullsized":"2023-08-25T04:16:05.147100+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:19.263285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146493+0000","last_change":"2023-08-25T04:16:03.773294+0000","last_active":"2023-08-25T04:16:05.146493+0000","last_peered":"2023-08-25T04:16:05.146493+0000","last_clean":"2023-08-25T04:16:05.146493+0000","last_became_active":"2023-08-25T04:16:03.773030+0000","last_became_peered":"2023-08-25T04:16:03.773030+0000","last_unstale":"2023-08-25T04:16:05.146493+0000","last_undegraded":"2023-08-25T04:16:05.146493+0000","last_fullsized":"2023-08-25T04:16:05.146493+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:05.189822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748935+0000","last_change":"2023-08-25T04:16:02.759993+0000","last_active":"2023-08-25T04:16:04.748935+0000","last_peered":"2023-08-25T04:16:04.748935+0000","last_clean":"2023-08-25T04:16:04.748935+0000","last_became_active":"2023-08-25T04:16:02.759674+0000","last_became_peered":"2023-08-25T04:16:02.759674+0000","last_unstale":"2023-08-25T04:16:04.748935+0000","last_undegraded":"2023-08-25T04:16:04.748935+0000","last_fullsized":"2023-08-25T04:16:04.748935+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:15:38.572849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765882+0000","last_change":"2023-08-25T04:16:03.787042+0000","last_active":"2023-08-25T04:16:04.765882+0000","last_peered":"2023-08-25T04:16:04.765882+0000","last_clean":"2023-08-25T04:16:04.765882+0000","last_became_active":"2023-08-25T04:16:03.786769+0000","last_became_peered":"2023-08-25T04:16:03.786769+0000","last_unstale":"2023-08-25T04:16:04.765882+0000","last_undegraded":"2023-08-25T04:16:04.765882+0000","last_fullsized":"2023-08-25T04:16:04.765882+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:08:24.248450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"61'3","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146559+0000","last_change":"2023-08-25T04:16:02.766795+0000","last_active":"2023-08-25T04:16:05.146559+0000","last_peered":"2023-08-25T04:16:05.146559+0000","last_clean":"2023-08-25T04:16:05.146559+0000","last_became_active":"2023-08-25T04:16:02.766468+0000","last_became_peered":"2023-08-25T04:16:02.766468+0000","last_unstale":"2023-08-25T04:16:05.146559+0000","last_undegraded":"2023-08-25T04:16:05.146559+0000","last_fullsized":"2023-08-25T04:16:05.146559+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:44:50.831742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748381+0000","last_change":"2023-08-25T04:16:03.772422+0000","last_active":"2023-08-25T04:16:04.748381+0000","last_peered":"2023-08-25T04:16:04.748381+0000","last_clean":"2023-08-25T04:16:04.748381+0000","last_became_active":"2023-08-25T04:16:03.771663+0000","last_became_peered":"2023-08-25T04:16:03.771663+0000","last_unstale":"2023-08-25T04:16:04.748381+0000","last_undegraded":"2023-08-25T04:16:04.748381+0000","last_fullsized":"2023-08-25T04:16:04.748381+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:14:16.042804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"61'6","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149058+0000","last_change":"2023-08-25T04:16:02.769516+0000","last_active":"2023-08-25T04:16:05.149058+0000","last_peered":"2023-08-25T04:16:05.149058+0000","last_clean":"2023-08-25T04:16:05.149058+0000","last_became_active":"2023-08-25T04:16:02.769170+0000","last_became_peered":"2023-08-25T04:16:02.769170+0000","last_unstale":"2023-08-25T04:16:05.149058+0000","last_undegraded":"2023-08-25T04:16:05.149058+0000","last_fullsized":"2023-08-25T04:16:05.149058+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:28:32.193662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147032+0000","last_change":"2023-08-25T04:16:03.769713+0000","last_active":"2023-08-25T04:16:05.147032+0000","last_peered":"2023-08-25T04:16:05.147032+0000","last_clean":"2023-08-25T04:16:05.147032+0000","last_became_active":"2023-08-25T04:16:03.769416+0000","last_became_peered":"2023-08-25T04:16:03.769416+0000","last_unstale":"2023-08-25T04:16:05.147032+0000","last_undegraded":"2023-08-25T04:16:05.147032+0000","last_fullsized":"2023-08-25T04:16:05.147032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:13:29.140582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765848+0000","last_change":"2023-08-25T04:16:02.762779+0000","last_active":"2023-08-25T04:16:04.765848+0000","last_peered":"2023-08-25T04:16:04.765848+0000","last_clean":"2023-08-25T04:16:04.765848+0000","last_became_active":"2023-08-25T04:16:02.762491+0000","last_became_peered":"2023-08-25T04:16:02.762491+0000","last_unstale":"2023-08-25T04:16:04.765848+0000","last_undegraded":"2023-08-25T04:16:04.765848+0000","last_fullsized":"2023-08-25T04:16:04.765848+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:54.292750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765959+0000","last_change":"2023-08-25T04:16:03.778616+0000","last_active":"2023-08-25T04:16:04.765959+0000","last_peered":"2023-08-25T04:16:04.765959+0000","last_clean":"2023-08-25T04:16:04.765959+0000","last_became_active":"2023-08-25T04:16:03.778334+0000","last_became_peered":"2023-08-25T04:16:03.778334+0000","last_unstale":"2023-08-25T04:16:04.765959+0000","last_undegraded":"2023-08-25T04:16:04.765959+0000","last_fullsized":"2023-08-25T04:16:04.765959+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:43:45.063038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748234+0000","last_change":"2023-08-25T04:16:02.761507+0000","last_active":"2023-08-25T04:16:04.748234+0000","last_peered":"2023-08-25T04:16:04.748234+0000","last_clean":"2023-08-25T04:16:04.748234+0000","last_became_active":"2023-08-25T04:16:02.761197+0000","last_became_peered":"2023-08-25T04:16:02.761197+0000","last_unstale":"2023-08-25T04:16:04.748234+0000","last_undegraded":"2023-08-25T04:16:04.748234+0000","last_fullsized":"2023-08-25T04:16:04.748234+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:38:28.867182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149039+0000","last_change":"2023-08-25T04:16:03.769037+0000","last_active":"2023-08-25T04:16:05.149039+0000","last_peered":"2023-08-25T04:16:05.149039+0000","last_clean":"2023-08-25T04:16:05.149039+0000","last_became_active":"2023-08-25T04:16:03.768748+0000","last_became_peered":"2023-08-25T04:16:03.768748+0000","last_unstale":"2023-08-25T04:16:05.149039+0000","last_undegraded":"2023-08-25T04:16:05.149039+0000","last_fullsized":"2023-08-25T04:16:05.149039+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:24.524584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146447+0000","last_change":"2023-08-25T04:16:02.761674+0000","last_active":"2023-08-25T04:16:05.146447+0000","last_peered":"2023-08-25T04:16:05.146447+0000","last_clean":"2023-08-25T04:16:05.146447+0000","last_became_active":"2023-08-25T04:16:02.761351+0000","last_became_peered":"2023-08-25T04:16:02.761351+0000","last_unstale":"2023-08-25T04:16:05.146447+0000","last_undegraded":"2023-08-25T04:16:05.146447+0000","last_fullsized":"2023-08-25T04:16:05.146447+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:37:03.966092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765938+0000","last_change":"2023-08-25T04:16:03.787422+0000","last_active":"2023-08-25T04:16:04.765938+0000","last_peered":"2023-08-25T04:16:04.765938+0000","last_clean":"2023-08-25T04:16:04.765938+0000","last_became_active":"2023-08-25T04:16:03.787088+0000","last_became_peered":"2023-08-25T04:16:03.787088+0000","last_unstale":"2023-08-25T04:16:04.765938+0000","last_undegraded":"2023-08-25T04:16:04.765938+0000","last_fullsized":"2023-08-25T04:16:04.765938+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:56:51.258380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"61'8","reported_seq":21,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148959+0000","last_change":"2023-08-25T04:16:02.769884+0000","last_active":"2023-08-25T04:16:05.148959+0000","last_peered":"2023-08-25T04:16:05.148959+0000","last_clean":"2023-08-25T04:16:05.148959+0000","last_became_active":"2023-08-25T04:16:02.768928+0000","last_became_peered":"2023-08-25T04:16:02.768928+0000","last_unstale":"2023-08-25T04:16:05.148959+0000","last_undegraded":"2023-08-25T04:16:05.148959+0000","last_fullsized":"2023-08-25T04:16:05.148959+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:48:31.382356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148863+0000","last_change":"2023-08-25T04:16:03.766212+0000","last_active":"2023-08-25T04:16:05.148863+0000","last_peered":"2023-08-25T04:16:05.148863+0000","last_clean":"2023-08-25T04:16:05.148863+0000","last_became_active":"2023-08-25T04:16:03.765926+0000","last_became_peered":"2023-08-25T04:16:03.765926+0000","last_unstale":"2023-08-25T04:16:05.148863+0000","last_undegraded":"2023-08-25T04:16:05.148863+0000","last_fullsized":"2023-08-25T04:16:05.148863+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:01:07.903863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766278+0000","last_change":"2023-08-25T04:16:02.769909+0000","last_active":"2023-08-25T04:16:04.766278+0000","last_peered":"2023-08-25T04:16:04.766278+0000","last_clean":"2023-08-25T04:16:04.766278+0000","last_became_active":"2023-08-25T04:16:02.769572+0000","last_became_peered":"2023-08-25T04:16:02.769572+0000","last_unstale":"2023-08-25T04:16:04.766278+0000","last_undegraded":"2023-08-25T04:16:04.766278+0000","last_fullsized":"2023-08-25T04:16:04.766278+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:15:38.572849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148148+0000","last_change":"2023-08-25T04:16:03.784206+0000","last_active":"2023-08-25T04:16:05.148148+0000","last_peered":"2023-08-25T04:16:05.148148+0000","last_clean":"2023-08-25T04:16:05.148148+0000","last_became_active":"2023-08-25T04:16:03.783799+0000","last_became_peered":"2023-08-25T04:16:03.783799+0000","last_unstale":"2023-08-25T04:16:05.148148+0000","last_undegraded":"2023-08-25T04:16:05.148148+0000","last_fullsized":"2023-08-25T04:16:05.148148+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:58:05.317914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.750693+0000","last_change":"2023-08-25T04:16:02.761798+0000","last_active":"2023-08-25T04:16:04.750693+0000","last_peered":"2023-08-25T04:16:04.750693+0000","last_clean":"2023-08-25T04:16:04.750693+0000","last_became_active":"2023-08-25T04:16:02.761512+0000","last_became_peered":"2023-08-25T04:16:02.761512+0000","last_unstale":"2023-08-25T04:16:04.750693+0000","last_undegraded":"2023-08-25T04:16:04.750693+0000","last_fullsized":"2023-08-25T04:16:04.750693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:49:42.962115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748094+0000","last_change":"2023-08-25T04:16:03.784616+0000","last_active":"2023-08-25T04:16:04.748094+0000","last_peered":"2023-08-25T04:16:04.748094+0000","last_clean":"2023-08-25T04:16:04.748094+0000","last_became_active":"2023-08-25T04:16:03.784320+0000","last_became_peered":"2023-08-25T04:16:03.784320+0000","last_unstale":"2023-08-25T04:16:04.748094+0000","last_undegraded":"2023-08-25T04:16:04.748094+0000","last_fullsized":"2023-08-25T04:16:04.748094+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:47:23.266030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748522+0000","last_change":"2023-08-25T04:16:02.760117+0000","last_active":"2023-08-25T04:16:04.748522+0000","last_peered":"2023-08-25T04:16:04.748522+0000","last_clean":"2023-08-25T04:16:04.748522+0000","last_became_active":"2023-08-25T04:16:02.758535+0000","last_became_peered":"2023-08-25T04:16:02.758535+0000","last_unstale":"2023-08-25T04:16:04.748522+0000","last_undegraded":"2023-08-25T04:16:04.748522+0000","last_fullsized":"2023-08-25T04:16:04.748522+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:16:27.704115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148413+0000","last_change":"2023-08-25T04:16:03.765306+0000","last_active":"2023-08-25T04:16:05.148413+0000","last_peered":"2023-08-25T04:16:05.148413+0000","last_clean":"2023-08-25T04:16:05.148413+0000","last_became_active":"2023-08-25T04:16:03.764966+0000","last_became_peered":"2023-08-25T04:16:03.764966+0000","last_unstale":"2023-08-25T04:16:05.148413+0000","last_undegraded":"2023-08-25T04:16:05.148413+0000","last_fullsized":"2023-08-25T04:16:05.148413+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:13:43.607156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748638+0000","last_change":"2023-08-25T04:16:02.765158+0000","last_active":"2023-08-25T04:16:04.748638+0000","last_peered":"2023-08-25T04:16:04.748638+0000","last_clean":"2023-08-25T04:16:04.748638+0000","last_became_active":"2023-08-25T04:16:02.764912+0000","last_became_peered":"2023-08-25T04:16:02.764912+0000","last_unstale":"2023-08-25T04:16:04.748638+0000","last_undegraded":"2023-08-25T04:16:04.748638+0000","last_fullsized":"2023-08-25T04:16:04.748638+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:03.782699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147108+0000","last_change":"2023-08-25T04:16:03.774420+0000","last_active":"2023-08-25T04:16:05.147108+0000","last_peered":"2023-08-25T04:16:05.147108+0000","last_clean":"2023-08-25T04:16:05.147108+0000","last_became_active":"2023-08-25T04:16:03.774056+0000","last_became_peered":"2023-08-25T04:16:03.774056+0000","last_unstale":"2023-08-25T04:16:05.147108+0000","last_undegraded":"2023-08-25T04:16:05.147108+0000","last_fullsized":"2023-08-25T04:16:05.147108+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:30:15.714145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148479+0000","last_change":"2023-08-25T04:16:02.765007+0000","last_active":"2023-08-25T04:16:05.148479+0000","last_peered":"2023-08-25T04:16:05.148479+0000","last_clean":"2023-08-25T04:16:05.148479+0000","last_became_active":"2023-08-25T04:16:02.764646+0000","last_became_peered":"2023-08-25T04:16:02.764646+0000","last_unstale":"2023-08-25T04:16:05.148479+0000","last_undegraded":"2023-08-25T04:16:05.148479+0000","last_fullsized":"2023-08-25T04:16:05.148479+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:01:43.514684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748326+0000","last_change":"2023-08-25T04:16:03.775606+0000","last_active":"2023-08-25T04:16:04.748326+0000","last_peered":"2023-08-25T04:16:04.748326+0000","last_clean":"2023-08-25T04:16:04.748326+0000","last_became_active":"2023-08-25T04:16:03.773164+0000","last_became_peered":"2023-08-25T04:16:03.773164+0000","last_unstale":"2023-08-25T04:16:04.748326+0000","last_undegraded":"2023-08-25T04:16:04.748326+0000","last_fullsized":"2023-08-25T04:16:04.748326+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:09.743104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148937+0000","last_change":"2023-08-25T04:16:02.769473+0000","last_active":"2023-08-25T04:16:05.148937+0000","last_peered":"2023-08-25T04:16:05.148937+0000","last_clean":"2023-08-25T04:16:05.148937+0000","last_became_active":"2023-08-25T04:16:02.769146+0000","last_became_peered":"2023-08-25T04:16:02.769146+0000","last_unstale":"2023-08-25T04:16:05.148937+0000","last_undegraded":"2023-08-25T04:16:05.148937+0000","last_fullsized":"2023-08-25T04:16:05.148937+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:01:31.204659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766193+0000","last_change":"2023-08-25T04:16:03.783730+0000","last_active":"2023-08-25T04:16:04.766193+0000","last_peered":"2023-08-25T04:16:04.766193+0000","last_clean":"2023-08-25T04:16:04.766193+0000","last_became_active":"2023-08-25T04:16:03.783468+0000","last_became_peered":"2023-08-25T04:16:03.783468+0000","last_unstale":"2023-08-25T04:16:04.766193+0000","last_undegraded":"2023-08-25T04:16:04.766193+0000","last_fullsized":"2023-08-25T04:16:04.766193+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:51:11.953697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765645+0000","last_change":"2023-08-25T04:16:02.762858+0000","last_active":"2023-08-25T04:16:04.765645+0000","last_peered":"2023-08-25T04:16:04.765645+0000","last_clean":"2023-08-25T04:16:04.765645+0000","last_became_active":"2023-08-25T04:16:02.762516+0000","last_became_peered":"2023-08-25T04:16:02.762516+0000","last_unstale":"2023-08-25T04:16:04.765645+0000","last_undegraded":"2023-08-25T04:16:04.765645+0000","last_fullsized":"2023-08-25T04:16:04.765645+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:19:41.400173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148567+0000","last_change":"2023-08-25T04:16:03.756864+0000","last_active":"2023-08-25T04:16:05.148567+0000","last_peered":"2023-08-25T04:16:05.148567+0000","last_clean":"2023-08-25T04:16:05.148567+0000","last_became_active":"2023-08-25T04:16:03.756575+0000","last_became_peered":"2023-08-25T04:16:03.756575+0000","last_unstale":"2023-08-25T04:16:05.148567+0000","last_undegraded":"2023-08-25T04:16:05.148567+0000","last_fullsized":"2023-08-25T04:16:05.148567+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:30:09.575853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.750115+0000","last_change":"2023-08-25T04:16:02.763728+0000","last_active":"2023-08-25T04:16:04.750115+0000","last_peered":"2023-08-25T04:16:04.750115+0000","last_clean":"2023-08-25T04:16:04.750115+0000","last_became_active":"2023-08-25T04:16:02.763409+0000","last_became_peered":"2023-08-25T04:16:02.763409+0000","last_unstale":"2023-08-25T04:16:04.750115+0000","last_undegraded":"2023-08-25T04:16:04.750115+0000","last_fullsized":"2023-08-25T04:16:04.750115+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:30.338115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748059+0000","last_change":"2023-08-25T04:16:03.762457+0000","last_active":"2023-08-25T04:16:04.748059+0000","last_peered":"2023-08-25T04:16:04.748059+0000","last_clean":"2023-08-25T04:16:04.748059+0000","last_became_active":"2023-08-25T04:16:03.762156+0000","last_became_peered":"2023-08-25T04:16:03.762156+0000","last_unstale":"2023-08-25T04:16:04.748059+0000","last_undegraded":"2023-08-25T04:16:04.748059+0000","last_fullsized":"2023-08-25T04:16:04.748059+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:05:34.107237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766191+0000","last_change":"2023-08-25T04:16:02.764778+0000","last_active":"2023-08-25T04:16:04.766191+0000","last_peered":"2023-08-25T04:16:04.766191+0000","last_clean":"2023-08-25T04:16:04.766191+0000","last_became_active":"2023-08-25T04:16:02.764385+0000","last_became_peered":"2023-08-25T04:16:02.764385+0000","last_unstale":"2023-08-25T04:16:04.766191+0000","last_undegraded":"2023-08-25T04:16:04.766191+0000","last_fullsized":"2023-08-25T04:16:04.766191+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:14:15.027029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"50'139","reported_seq":325,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146453+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:16:05.146453+0000","last_peered":"2023-08-25T04:16:05.146453+0000","last_clean":"2023-08-25T04:16:05.146453+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:16:05.146453+0000","last_undegraded":"2023-08-25T04:16:05.146453+0000","last_fullsized":"2023-08-25T04:16:05.146453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:46:40.938989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146893+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:16:05.146893+0000","last_peered":"2023-08-25T04:16:05.146893+0000","last_clean":"2023-08-25T04:16:05.146893+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:16:05.146893+0000","last_undegraded":"2023-08-25T04:16:05.146893+0000","last_fullsized":"2023-08-25T04:16:05.146893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:49:07.625941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148272+0000","last_change":"2023-08-25T04:16:03.759020+0000","last_active":"2023-08-25T04:16:05.148272+0000","last_peered":"2023-08-25T04:16:05.148272+0000","last_clean":"2023-08-25T04:16:05.148272+0000","last_became_active":"2023-08-25T04:16:03.758518+0000","last_became_peered":"2023-08-25T04:16:03.758518+0000","last_unstale":"2023-08-25T04:16:05.148272+0000","last_undegraded":"2023-08-25T04:16:05.148272+0000","last_fullsized":"2023-08-25T04:16:05.148272+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:19:21.561019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146603+0000","last_change":"2023-08-25T04:16:02.763794+0000","last_active":"2023-08-25T04:16:05.146603+0000","last_peered":"2023-08-25T04:16:05.146603+0000","last_clean":"2023-08-25T04:16:05.146603+0000","last_became_active":"2023-08-25T04:16:02.763451+0000","last_became_peered":"2023-08-25T04:16:02.763451+0000","last_unstale":"2023-08-25T04:16:05.146603+0000","last_undegraded":"2023-08-25T04:16:05.146603+0000","last_fullsized":"2023-08-25T04:16:05.146603+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:13:25.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146096+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:16:05.146096+0000","last_peered":"2023-08-25T04:16:05.146096+0000","last_clean":"2023-08-25T04:16:05.146096+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:16:05.146096+0000","last_undegraded":"2023-08-25T04:16:05.146096+0000","last_fullsized":"2023-08-25T04:16:05.146096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:37:15.930053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149282+0000","last_change":"2023-08-25T04:16:03.777176+0000","last_active":"2023-08-25T04:16:05.149282+0000","last_peered":"2023-08-25T04:16:05.149282+0000","last_clean":"2023-08-25T04:16:05.149282+0000","last_became_active":"2023-08-25T04:16:03.776894+0000","last_became_peered":"2023-08-25T04:16:03.776894+0000","last_unstale":"2023-08-25T04:16:05.149282+0000","last_undegraded":"2023-08-25T04:16:05.149282+0000","last_fullsized":"2023-08-25T04:16:05.149282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:50:06.178179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766084+0000","last_change":"2023-08-25T04:16:02.764873+0000","last_active":"2023-08-25T04:16:04.766084+0000","last_peered":"2023-08-25T04:16:04.766084+0000","last_clean":"2023-08-25T04:16:04.766084+0000","last_became_active":"2023-08-25T04:16:02.764527+0000","last_became_peered":"2023-08-25T04:16:02.764527+0000","last_unstale":"2023-08-25T04:16:04.766084+0000","last_undegraded":"2023-08-25T04:16:04.766084+0000","last_fullsized":"2023-08-25T04:16:04.766084+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:47:22.250255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.750200+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:16:04.750200+0000","last_peered":"2023-08-25T04:16:04.750200+0000","last_clean":"2023-08-25T04:16:04.750200+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:16:04.750200+0000","last_undegraded":"2023-08-25T04:16:04.750200+0000","last_fullsized":"2023-08-25T04:16:04.750200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:10:51.922096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146548+0000","last_change":"2023-08-25T04:16:03.759022+0000","last_active":"2023-08-25T04:16:05.146548+0000","last_peered":"2023-08-25T04:16:05.146548+0000","last_clean":"2023-08-25T04:16:05.146548+0000","last_became_active":"2023-08-25T04:16:03.758338+0000","last_became_peered":"2023-08-25T04:16:03.758338+0000","last_unstale":"2023-08-25T04:16:05.146548+0000","last_undegraded":"2023-08-25T04:16:05.146548+0000","last_fullsized":"2023-08-25T04:16:05.146548+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:49:34.866072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748613+0000","last_change":"2023-08-25T04:16:02.764312+0000","last_active":"2023-08-25T04:16:04.748613+0000","last_peered":"2023-08-25T04:16:04.748613+0000","last_clean":"2023-08-25T04:16:04.748613+0000","last_became_active":"2023-08-25T04:16:02.763932+0000","last_became_peered":"2023-08-25T04:16:02.763932+0000","last_unstale":"2023-08-25T04:16:04.748613+0000","last_undegraded":"2023-08-25T04:16:04.748613+0000","last_fullsized":"2023-08-25T04:16:04.748613+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:47:17.296890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146680+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:16:05.146680+0000","last_peered":"2023-08-25T04:16:05.146680+0000","last_clean":"2023-08-25T04:16:05.146680+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:16:05.146680+0000","last_undegraded":"2023-08-25T04:16:05.146680+0000","last_fullsized":"2023-08-25T04:16:05.146680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:04:15.457844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766110+0000","last_change":"2023-08-25T04:16:03.786814+0000","last_active":"2023-08-25T04:16:04.766110+0000","last_peered":"2023-08-25T04:16:04.766110+0000","last_clean":"2023-08-25T04:16:04.766110+0000","last_became_active":"2023-08-25T04:16:03.786529+0000","last_became_peered":"2023-08-25T04:16:03.786529+0000","last_unstale":"2023-08-25T04:16:04.766110+0000","last_undegraded":"2023-08-25T04:16:04.766110+0000","last_fullsized":"2023-08-25T04:16:04.766110+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:49:47.826087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748144+0000","last_change":"2023-08-25T04:16:02.759432+0000","last_active":"2023-08-25T04:16:04.748144+0000","last_peered":"2023-08-25T04:16:04.748144+0000","last_clean":"2023-08-25T04:16:04.748144+0000","last_became_active":"2023-08-25T04:16:02.759154+0000","last_became_peered":"2023-08-25T04:16:02.759154+0000","last_unstale":"2023-08-25T04:16:04.748144+0000","last_undegraded":"2023-08-25T04:16:04.748144+0000","last_fullsized":"2023-08-25T04:16:04.748144+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:51:10.937922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148428+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:16:05.148428+0000","last_peered":"2023-08-25T04:16:05.148428+0000","last_clean":"2023-08-25T04:16:05.148428+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:16:05.148428+0000","last_undegraded":"2023-08-25T04:16:05.148428+0000","last_fullsized":"2023-08-25T04:16:05.148428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:10:21.541167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149372+0000","last_change":"2023-08-25T04:16:03.759478+0000","last_active":"2023-08-25T04:16:05.149372+0000","last_peered":"2023-08-25T04:16:05.149372+0000","last_clean":"2023-08-25T04:16:05.149372+0000","last_became_active":"2023-08-25T04:16:03.759151+0000","last_became_peered":"2023-08-25T04:16:03.759151+0000","last_unstale":"2023-08-25T04:16:05.149372+0000","last_undegraded":"2023-08-25T04:16:05.149372+0000","last_fullsized":"2023-08-25T04:16:05.149372+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:56:24.570616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146657+0000","last_change":"2023-08-25T04:16:02.762852+0000","last_active":"2023-08-25T04:16:05.146657+0000","last_peered":"2023-08-25T04:16:05.146657+0000","last_clean":"2023-08-25T04:16:05.146657+0000","last_became_active":"2023-08-25T04:16:02.762449+0000","last_became_peered":"2023-08-25T04:16:02.762449+0000","last_unstale":"2023-08-25T04:16:05.146657+0000","last_undegraded":"2023-08-25T04:16:05.146657+0000","last_fullsized":"2023-08-25T04:16:05.146657+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:36:43.770631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146693+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:16:05.146693+0000","last_peered":"2023-08-25T04:16:05.146693+0000","last_clean":"2023-08-25T04:16:05.146693+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:16:05.146693+0000","last_undegraded":"2023-08-25T04:16:05.146693+0000","last_fullsized":"2023-08-25T04:16:05.146693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:16:10.221862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765945+0000","last_change":"2023-08-25T04:16:03.779647+0000","last_active":"2023-08-25T04:16:04.765945+0000","last_peered":"2023-08-25T04:16:04.765945+0000","last_clean":"2023-08-25T04:16:04.765945+0000","last_became_active":"2023-08-25T04:16:03.779369+0000","last_became_peered":"2023-08-25T04:16:03.779369+0000","last_unstale":"2023-08-25T04:16:04.765945+0000","last_undegraded":"2023-08-25T04:16:04.765945+0000","last_fullsized":"2023-08-25T04:16:04.765945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:40:02.394308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149350+0000","last_change":"2023-08-25T04:16:02.769374+0000","last_active":"2023-08-25T04:16:05.149350+0000","last_peered":"2023-08-25T04:16:05.149350+0000","last_clean":"2023-08-25T04:16:05.149350+0000","last_became_active":"2023-08-25T04:16:02.769064+0000","last_became_peered":"2023-08-25T04:16:02.769064+0000","last_unstale":"2023-08-25T04:16:05.149350+0000","last_undegraded":"2023-08-25T04:16:05.149350+0000","last_fullsized":"2023-08-25T04:16:05.149350+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:40:57.150994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148840+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:16:05.148840+0000","last_peered":"2023-08-25T04:16:05.148840+0000","last_clean":"2023-08-25T04:16:05.148840+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:16:05.148840+0000","last_undegraded":"2023-08-25T04:16:05.148840+0000","last_fullsized":"2023-08-25T04:16:05.148840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:20:07.819897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146345+0000","last_change":"2023-08-25T04:16:03.772229+0000","last_active":"2023-08-25T04:16:05.146345+0000","last_peered":"2023-08-25T04:16:05.146345+0000","last_clean":"2023-08-25T04:16:05.146345+0000","last_became_active":"2023-08-25T04:16:03.771917+0000","last_became_peered":"2023-08-25T04:16:03.771917+0000","last_unstale":"2023-08-25T04:16:05.146345+0000","last_undegraded":"2023-08-25T04:16:05.146345+0000","last_fullsized":"2023-08-25T04:16:05.146345+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:35:29.126317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149065+0000","last_change":"2023-08-25T04:16:02.761668+0000","last_active":"2023-08-25T04:16:05.149065+0000","last_peered":"2023-08-25T04:16:05.149065+0000","last_clean":"2023-08-25T04:16:05.149065+0000","last_became_active":"2023-08-25T04:16:02.761013+0000","last_became_peered":"2023-08-25T04:16:02.761013+0000","last_unstale":"2023-08-25T04:16:05.149065+0000","last_undegraded":"2023-08-25T04:16:05.149065+0000","last_fullsized":"2023-08-25T04:16:05.149065+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:35:12.106821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":95,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748705+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:16:04.748705+0000","last_peered":"2023-08-25T04:16:04.748705+0000","last_clean":"2023-08-25T04:16:04.748705+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:16:04.748705+0000","last_undegraded":"2023-08-25T04:16:04.748705+0000","last_fullsized":"2023-08-25T04:16:04.748705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:25:05.043329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509603,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58848,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312992,"statfs":{"total":96636764160,"available":96576503808,"internally_reserved":0,"allocated":1331200,"data_stored":940405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72399999999999998,"15min":0.71099999999999997},"min":{"1min":0.57999999999999996,"5min":0.442,"15min":0.29199999999999998},"max":{"1min":0.996,"5min":0.996,"15min":1.0189999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.752,"15min":0.71499999999999997},"min":{"1min":0.58199999999999996,"5min":0.42099999999999999,"15min":0.39000000000000001},"max":{"1min":0.89500000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.67600000000000005}]},{"osd":1,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.55100000000000005,"5min":0.45500000000000002,"15min":0.42699999999999999},"max":{"1min":0.95699999999999996,"5min":1.0149999999999999,"15min":1.034},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76900000000000002,"15min":0.73299999999999998},"min":{"1min":0.59299999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.91700000000000004,"5min":0.98799999999999999,"15min":1.036},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.60499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.94499999999999995,"5min":1.018,"15min":1.018},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.751},"min":{"1min":0.51500000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94999999999999996,"5min":0.999,"15min":0.999},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.74399999999999999},"min":{"1min":0.57399999999999995,"5min":0.48199999999999998,"15min":0.41899999999999998},"max":{"1min":0.92900000000000005,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.58499999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0449999999999999},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57099999999999995,"15min":0.59499999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.32400000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.98899999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.628},"min":{"1min":0.48299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.75600000000000001,"5min":0.82599999999999996,"15min":0.96699999999999997},"last":0.69099999999999995}]},{"osd":5,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.63600000000000001},"min":{"1min":0.438,"5min":0.433,"15min":0.38100000000000001},"max":{"1min":0.77600000000000002,"5min":0.98399999999999999,"15min":0.998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.63,"15min":0.66100000000000003},"min":{"1min":0.45000000000000001,"5min":0.41799999999999998,"15min":0.40000000000000002},"max":{"1min":0.79400000000000004,"5min":0.93799999999999994,"15min":1.0349999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.5,"5min":0.498,"15min":0.436},"max":{"1min":0.95699999999999996,"5min":1.0009999999999999,"15min":1.0620000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.68999999999999995},"min":{"1min":0.45100000000000001,"5min":0.433,"15min":0.42399999999999999},"max":{"1min":0.84499999999999997,"5min":0.91700000000000004,"15min":0.98299999999999998},"last":0.78300000000000003}]}]},{"osd":6,"up_from":15,"seq":64424509603,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36064,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335776,"statfs":{"total":96636764160,"available":96599834624,"internally_reserved":0,"allocated":737280,"data_stored":350565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72599999999999998,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.36499999999999999},"max":{"1min":0.93400000000000005,"5min":0.96199999999999997,"15min":1.0369999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.69799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.33800000000000002},"max":{"1min":0.96899999999999997,"5min":1.054,"15min":1.071},"last":0.59499999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.751,"15min":0.73299999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.436},"max":{"1min":1.002,"5min":1.0369999999999999,"15min":1.1559999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.503,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98699999999999999,"5min":1.077,"15min":1.077},"last":0.80800000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.753,"15min":0.749},"min":{"1min":0.52900000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.97999999999999998,"5min":1.1020000000000001,"15min":1.139},"last":0.5},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.81100000000000005,"15min":0.80600000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54400000000000004},"max":{"1min":0.96699999999999997,"5min":1.0469999999999999,"15min":1.117},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.751,"15min":0.74399999999999999},"min":{"1min":0.58799999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.077},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.56000000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94999999999999996,"5min":1.0249999999999999,"15min":1.679},"last":0.84099999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58299999999999996,"15min":0.622},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79200000000000004,"5min":0.93200000000000005,"15min":0.93400000000000005},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57599999999999996,"15min":0.629},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78200000000000003,"5min":0.95799999999999996,"15min":1.306},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.625,"15min":0.68400000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82599999999999996,"5min":1.0329999999999999,"15min":1.123},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71599999999999997,"15min":0.76600000000000001},"min":{"1min":0.443,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.97599999999999998,"5min":1.0209999999999999,"15min":1.5589999999999999},"last":0.86499999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64900000000000002,"15min":0.68999999999999995},"min":{"1min":0.443,"5min":0.434,"15min":0.434},"max":{"1min":0.82899999999999996,"5min":0.99099999999999999,"15min":1.1950000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67200000000000004,"15min":0.72599999999999998},"min":{"1min":0.45200000000000001,"5min":0.44700000000000001,"15min":0.41799999999999998},"max":{"1min":0.91200000000000003,"5min":1.012,"15min":1.4099999999999999},"last":0.71299999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542306,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":349913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.70199999999999996,"15min":0.70499999999999996},"min":{"1min":0.40300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91300000000000003,"5min":0.93700000000000006,"15min":1.018},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72499999999999998,"15min":0.72999999999999998},"min":{"1min":0.45500000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89500000000000002,"5min":0.995,"15min":1.0409999999999999},"last":0.79600000000000004}]},{"osd":1,"last update":"Fri Aug 25 04:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.45100000000000001,"5min":0.43099999999999999,"15min":0.36499999999999999},"max":{"1min":0.84799999999999998,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.73599999999999999,"15min":0.73299999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.46200000000000002},"max":{"1min":0.95999999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":0.97499999999999998,"15min":1.0269999999999999},"last":0.626},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.49299999999999999,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":0.94099999999999995,"5min":1.006,"15min":1.2290000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.90700000000000003,"5min":0.94199999999999995,"15min":1.4590000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.94799999999999995,"5min":1.018,"15min":1.1479999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.41799999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92900000000000005,"5min":0.97099999999999997,"15min":1.038},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60799999999999998,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.623,"15min":0.66900000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93700000000000006,"5min":1.008,"15min":1.256},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.67800000000000005},"min":{"1min":0.46400000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.78700000000000003,"5min":0.88700000000000001,"15min":1.4650000000000001},"last":0.81499999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58699999999999997,"15min":0.64700000000000002},"min":{"1min":0.436,"5min":0.375,"15min":0.375},"max":{"1min":0.72299999999999998,"5min":1.032,"15min":1.2769999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68600000000000005,"15min":0.72799999999999998},"min":{"1min":0.51800000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90000000000000002,"5min":1.048,"15min":1.1819999999999999},"last":0.73699999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542306,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36064,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335776,"statfs":{"total":96636764160,"available":96599834624,"internally_reserved":0,"allocated":733184,"data_stored":350495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72999999999999998,"15min":0.70199999999999996},"min":{"1min":0.60399999999999998,"5min":0.42299999999999999,"15min":0.32700000000000001},"max":{"1min":0.89000000000000001,"5min":0.99299999999999999,"15min":1.2649999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72499999999999998,"15min":0.69699999999999995},"min":{"1min":0.58899999999999997,"5min":0.48499999999999999,"15min":0.441},"max":{"1min":0.86699999999999999,"5min":0.89900000000000002,"15min":1.1639999999999999},"last":0.64400000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.747,"15min":0.71399999999999997},"min":{"1min":0.59799999999999998,"5min":0.46400000000000002,"15min":0.36199999999999999},"max":{"1min":0.96499999999999997,"5min":1.0189999999999999,"15min":1.0449999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77000000000000002,"15min":0.74399999999999999},"min":{"1min":0.58899999999999997,"5min":0.56799999999999995,"15min":0.36799999999999999},"max":{"1min":0.95599999999999996,"5min":1.099,"15min":1.099},"last":0.88600000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78700000000000003,"15min":0.75900000000000001},"min":{"1min":0.66300000000000003,"5min":0.57599999999999996,"15min":0.39100000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77300000000000002,"15min":0.73499999999999999},"min":{"1min":0.67200000000000004,"5min":0.503,"15min":0.34000000000000002},"max":{"1min":0.94599999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.76800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.45100000000000001},"max":{"1min":0.98299999999999998,"5min":1.016,"15min":1.048},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.78000000000000003,"15min":0.76000000000000001},"min":{"1min":0.629,"5min":0.52400000000000002,"15min":0.48399999999999999},"max":{"1min":1.008,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.145}]},{"osd":5,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.41099999999999998,"5min":0.39400000000000002,"15min":0.32200000000000001},"max":{"1min":0.753,"5min":0.88400000000000001,"15min":0.94899999999999995},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.60499999999999998},"min":{"1min":0.48299999999999998,"5min":0.38500000000000001,"15min":0.33200000000000002},"max":{"1min":0.73199999999999998,"5min":0.91200000000000003,"15min":0.92100000000000004},"last":1.034}]},{"osd":6,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.59399999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.014,"5min":1.0309999999999999,"15min":1.0620000000000001},"last":1.093},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64500000000000002,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.874,"5min":0.97499999999999998,"15min":1.026},"last":1.2010000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.621,"15min":0.63500000000000001},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.36699999999999999},"max":{"1min":0.87,"5min":0.90400000000000003,"15min":1.0609999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69699999999999995,"15min":0.72199999999999998},"min":{"1min":0.55400000000000005,"5min":0.498,"15min":0.39300000000000002},"max":{"1min":0.88400000000000001,"5min":0.98399999999999999,"15min":1.0940000000000001},"last":0.99399999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542306,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36068,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335772,"statfs":{"total":96636764160,"available":96599830528,"internally_reserved":0,"allocated":745472,"data_stored":351547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46000000000000002,"15min":0.442},"min":{"1min":0.34499999999999997,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.56699999999999995,"5min":0.747,"15min":0.96899999999999997},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.77100000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.443}]},{"osd":1,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.497,"15min":0.48699999999999999},"min":{"1min":0.34699999999999998,"5min":0.33600000000000002,"15min":0.27000000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.746},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.58999999999999997},"min":{"1min":0.47199999999999998,"5min":0.41799999999999998,"15min":0.38500000000000001},"max":{"1min":0.76500000000000001,"5min":0.85799999999999998,"15min":0.92600000000000005},"last":0.502}]},{"osd":2,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57799999999999996,"15min":0.56499999999999995},"min":{"1min":0.41799999999999998,"5min":0.40600000000000003,"15min":0.34699999999999998},"max":{"1min":0.67300000000000004,"5min":1.01,"15min":1.01},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.379,"15min":0.35299999999999998},"max":{"1min":0.67700000000000005,"5min":0.81699999999999995,"15min":0.89600000000000002},"last":0.38}]},{"osd":4,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78100000000000003,"15min":0.75600000000000001},"min":{"1min":0.57999999999999996,"5min":0.53100000000000003,"15min":0.46800000000000003},"max":{"1min":1.214,"5min":1.214,"15min":1.4339999999999999},"last":0.871},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.81299999999999994},"min":{"1min":0.63800000000000001,"5min":0.59399999999999997,"15min":0.48899999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.343},"last":0.88300000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.61199999999999999,"5min":0.52900000000000003,"15min":0.51500000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.321},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80900000000000005,"15min":0.79500000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.48099999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.4750000000000001},"last":0.82299999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.83499999999999996,"15min":0.80800000000000005},"min":{"1min":0.60399999999999998,"5min":0.55300000000000005,"15min":0.53100000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.2010000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.61199999999999999,"5min":0.52000000000000002,"15min":0.50700000000000001},"max":{"1min":1.0800000000000001,"5min":1.097,"15min":1.3600000000000001},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.85199999999999998,"15min":0.83999999999999997},"min":{"1min":0.66200000000000003,"5min":0.60899999999999999,"15min":0.57099999999999995},"max":{"1min":1.077,"5min":1.1080000000000001,"15min":1.383},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80900000000000005,"15min":0.79500000000000004},"min":{"1min":0.58299999999999996,"5min":0.55600000000000005,"15min":0.54000000000000004},"max":{"1min":1.0669999999999999,"5min":1.1160000000000001,"15min":1.4019999999999999},"last":0.84999999999999998}]}]},{"osd":2,"up_from":14,"seq":60129542307,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54116,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317724,"statfs":{"total":96636764160,"available":96581349376,"internally_reserved":0,"allocated":741376,"data_stored":351525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.45900000000000002,"15min":0.46899999999999997},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":0.61599999999999999,"5min":0.76100000000000001,"15min":1.196},"last":0.315},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.501,"15min":0.496},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.28599999999999998},"max":{"1min":0.72499999999999998,"5min":0.75600000000000001,"15min":1.4019999999999999},"last":0.41899999999999998}]},{"osd":1,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48799999999999999,"15min":0.496},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":1.482},"last":0.375},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60599999999999998,"15min":0.60199999999999998},"min":{"1min":0.44700000000000001,"5min":0.41999999999999998,"15min":0.36699999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":1.458},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53300000000000003,"15min":0.52800000000000002},"min":{"1min":0.41699999999999998,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.754,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.436},{"interface":"front","average":{"1min":0.622,"5min":0.57399999999999995,"15min":0.55700000000000005},"min":{"1min":0.44800000000000001,"5min":0.41299999999999998,"15min":0.33700000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.95599999999999996},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.80800000000000005,"15min":0.79600000000000004},"min":{"1min":0.61499999999999999,"5min":0.52200000000000002,"15min":0.499},"max":{"1min":0.98899999999999999,"5min":1.2330000000000001,"15min":1.2569999999999999},"last":1.085},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78700000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.47599999999999998},"max":{"1min":1.026,"5min":1.117,"15min":1.5509999999999999},"last":0.90300000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80800000000000005,"15min":0.80100000000000005},"min":{"1min":0.54100000000000004,"5min":0.498,"15min":0.47999999999999998},"max":{"1min":1.014,"5min":1.1140000000000001,"15min":1.2789999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81100000000000005,"15min":0.80800000000000005},"min":{"1min":0.59699999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.026,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":1.1459999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84299999999999997,"15min":0.83899999999999997},"min":{"1min":0.67600000000000005,"5min":0.57399999999999995,"15min":0.56000000000000005},"max":{"1min":1.0609999999999999,"5min":1.1910000000000001,"15min":1.2110000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.875,"15min":0.85199999999999998},"min":{"1min":0.65700000000000003,"5min":0.61199999999999999,"15min":0.55600000000000005},"max":{"1min":1.0660000000000001,"5min":1.278,"15min":1.375},"last":1.014}]},{"osd":7,"last update":"Fri Aug 25 04:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80400000000000005,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.53700000000000003,"15min":0.49199999999999999},"max":{"1min":0.96899999999999997,"5min":1.2090000000000001,"15min":1.339},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.81100000000000005,"15min":0.81299999999999994},"min":{"1min":0.626,"5min":0.53800000000000003,"15min":0.51000000000000001},"max":{"1min":1.081,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.95199999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542307,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":737280,"data_stored":350073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46999999999999997,"15min":0.47099999999999997},"min":{"1min":0.33300000000000002,"5min":0.28399999999999997,"15min":0.27400000000000002},"max":{"1min":0.68999999999999995,"5min":0.85599999999999998,"15min":1.218},"last":0.308},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.36699999999999999,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":0.93300000000000005,"15min":1.153},"last":0.44600000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51100000000000001,"15min":0.504},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.30599999999999999},"max":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":1.347},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.48099999999999998,"5min":0.40000000000000002,"15min":0.36499999999999999},"max":{"1min":0.76000000000000001,"5min":1.02,"15min":1.093},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63600000000000001,"15min":0.623},"min":{"1min":0.46800000000000003,"5min":0.45300000000000001,"15min":0.40699999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":1.1459999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":1.2190000000000001},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80800000000000005,"15min":0.79400000000000004},"min":{"1min":0.56799999999999995,"5min":0.51600000000000001,"15min":0.45800000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.47},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83899999999999997,"15min":0.82399999999999995},"min":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.504},"max":{"1min":1.1830000000000001,"5min":1.244,"15min":1.395},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.82999999999999996,"15min":0.80600000000000005},"min":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.45100000000000001},"max":{"1min":1.1579999999999999,"5min":1.2090000000000001,"15min":1.292},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.83399999999999996,"15min":0.83299999999999996},"min":{"1min":0.64100000000000001,"5min":0.54700000000000004,"15min":0.51000000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.64700000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85299999999999998,"15min":0.85199999999999998},"min":{"1min":0.63500000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.569},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.83199999999999996,"15min":0.81399999999999995},"min":{"1min":0.67800000000000005,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.355},"last":0.60399999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83999999999999997,"15min":0.82999999999999996},"min":{"1min":0.65400000000000003,"5min":0.59299999999999997,"15min":0.56799999999999995},"max":{"1min":1.1240000000000001,"5min":1.2949999999999999,"15min":1.5429999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.876,"15min":0.85599999999999998},"min":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.54500000000000004},"max":{"1min":1.1140000000000001,"5min":1.3120000000000001,"15min":1.504},"last":0.68300000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542306,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1331200,"data_stored":940337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48199999999999998,"15min":0.48299999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.79500000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.55800000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":3.5089999999999999,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70699999999999996,"5min":0.90300000000000002,"15min":0.97499999999999998},"last":0.377},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.55900000000000005,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":3.4590000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.49399999999999999,"15min":0.495},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66000000000000003,"5min":0.79800000000000004,"15min":1.266},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76300000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.504}]},{"osd":4,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78200000000000003,"15min":0.79500000000000004},"min":{"1min":0.52600000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.306},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.79500000000000004,"15min":0.80400000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.436},"max":{"1min":1.028,"5min":1.131,"15min":1.262},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.528,"5min":3.528,"15min":3.528},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.79900000000000004,"15min":0.81399999999999995},"min":{"1min":0.47199999999999998,"5min":0.46999999999999997,"15min":0.45500000000000002},"max":{"1min":0.94599999999999995,"5min":1.2230000000000001,"15min":1.373},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.81699999999999995,"15min":0.80400000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.53000000000000003},"max":{"1min":3.4870000000000001,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.82699999999999996,"15min":0.82599999999999996},"min":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.47399999999999998},"max":{"1min":1.0329999999999999,"5min":1.194,"15min":1.331},"last":0.77100000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.61799999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.093,"5min":1.1659999999999999,"15min":1.4059999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.80300000000000005,"15min":0.81200000000000006},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.499},"max":{"1min":1.1220000000000001,"5min":1.1930000000000001,"15min":1.3169999999999999},"last":0.80600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:16:09.708 INFO:tasks.ceph.mds.b.smithi110.stderr:2023-08-25T04:16:09.708+0000 7f7964cce640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T04:16:12.456 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:16:12.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.613+0000 7f9ef57ac640 1 Processor -- start 2023-08-25T04:16:12.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.613+0000 7f9ef57ac640 1 -- start start 2023-08-25T04:16:12.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.613+0000 7f9ef57ac640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9ef00ceeb0 0x7f9ef00cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:12.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.613+0000 7f9ef57ac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef00cc880 con 0x7f9ef00c89f0 2023-08-25T04:16:12.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.613+0000 7f9ef57ac640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef00ccb60 con 0x7f9ef00ad950 2023-08-25T04:16:12.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.613+0000 7f9ef57ac640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef00b11f0 con 0x7f9ef00ceeb0 2023-08-25T04:16:12.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.613+0000 7f9eef7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9ef00c89f0 0x7f9ef00b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50356/0 (socket says 172.21.15.55:50356) 2023-08-25T04:16:12.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.613+0000 7f9eef7fe640 1 -- 172.21.15.55:0/792222911 learned_addr learned my addr 172.21.15.55:0/792222911 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:16:12.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.613+0000 7f9ee67fc640 1 --2- 172.21.15.55:0/792222911 >> v2:172.21.15.110:3300/0 conn(0x7f9ef00ceeb0 0x7f9ef00cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:12.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.613+0000 7f9eee7fc640 1 -- 172.21.15.55:0/792222911 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400706279 0 0) 0x7f9ef00cc880 con 0x7f9ef00c89f0 2023-08-25T04:16:12.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.613+0000 7f9eee7fc640 1 -- 172.21.15.55:0/792222911 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9edc005740 con 0x7f9ef00c89f0 2023-08-25T04:16:12.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.613+0000 7f9ee67fc640 1 -- 172.21.15.55:0/792222911 >> v1:172.21.15.110:6789/0 conn(0x7f9ef00ad950 legacy=0x7f9ef00ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:12.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.613+0000 7f9ee67fc640 1 -- 172.21.15.55:0/792222911 >> v1:172.21.15.55:6789/0 conn(0x7f9ef00c89f0 legacy=0x7f9ef00b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:12.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.613+0000 7f9ee67fc640 1 -- 172.21.15.55:0/792222911 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef00cce40 con 0x7f9ef00ceeb0 2023-08-25T04:16:12.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.617+0000 7f9ee67fc640 1 --2- 172.21.15.55:0/792222911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ef00ceeb0 0x7f9ef00cc2a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00097c0 tx=0x7f9ee001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=652a0ff9c456faa2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:12.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.617+0000 7f9eee7fc640 1 -- 172.21.15.55:0/792222911 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee00ab600 con 0x7f9ef00ceeb0 2023-08-25T04:16:12.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.617+0000 7f9eee7fc640 1 -- 172.21.15.55:0/792222911 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee00a7050 con 0x7f9ef00ceeb0 2023-08-25T04:16:12.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.617+0000 7f9eee7fc640 1 -- 172.21.15.55:0/792222911 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee00ab980 con 0x7f9ef00ceeb0 2023-08-25T04:16:12.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.617+0000 7f9ef57ac640 1 -- 172.21.15.55:0/792222911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ef00ceeb0 msgr2=0x7f9ef00cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:12.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.617+0000 7f9ef57ac640 1 --2- 172.21.15.55:0/792222911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ef00ceeb0 0x7f9ef00cc2a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00097c0 tx=0x7f9ee001c3f0 comp rx=0 tx=0).stop 2023-08-25T04:16:12.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.617+0000 7f9ef57ac640 1 -- 172.21.15.55:0/792222911 shutdown_connections 2023-08-25T04:16:12.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.617+0000 7f9ef57ac640 1 --2- 172.21.15.55:0/792222911 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ef00ceeb0 0x7f9ef00cc2a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:12.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.617+0000 7f9ef57ac640 1 -- 172.21.15.55:0/792222911 >> 172.21.15.55:0/792222911 conn(0x7f9ef0069d00 msgr2=0x7f9ef006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:12.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.617+0000 7f9ef57ac640 1 -- 172.21.15.55:0/792222911 shutdown_connections 2023-08-25T04:16:12.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.617+0000 7f9ef57ac640 1 -- 172.21.15.55:0/792222911 wait complete. 2023-08-25T04:16:12.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ef57ac640 1 Processor -- start 2023-08-25T04:16:12.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ef57ac640 1 -- start start 2023-08-25T04:16:12.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ef57ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ef00ad950 0x7f9ef0097ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:12.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ef57ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00c89f0 0x7f9ef00c1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:12.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ef57ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ef00ceeb0 0x7f9ef015d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:12.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ef57ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00c1640 con 0x7f9ef00c89f0 2023-08-25T04:16:12.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ef57ac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00c7ba0 con 0x7f9ef00ad950 2023-08-25T04:16:12.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ef57ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef0151f20 con 0x7f9ef00ceeb0 2023-08-25T04:16:12.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ee67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00c89f0 0x7f9ef00c1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:12.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ee67fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00c89f0 0x7f9ef00c1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35012/0 (socket says 172.21.15.55:35012) 2023-08-25T04:16:12.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ee67fc640 1 -- 172.21.15.55:0/3446246529 learned_addr learned my addr 172.21.15.55:0/3446246529 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:12.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9eeeffd640 1 --2- 172.21.15.55:0/3446246529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ef00ad950 0x7f9ef0097ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:12.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9eef7fe640 1 --2- 172.21.15.55:0/3446246529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ef00ceeb0 0x7f9ef015d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:12.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ee67fc640 1 -- 172.21.15.55:0/3446246529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ef00ceeb0 msgr2=0x7f9ef015d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:12.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ee67fc640 1 --2- 172.21.15.55:0/3446246529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ef00ceeb0 0x7f9ef015d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:12.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ee67fc640 1 -- 172.21.15.55:0/3446246529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ef00ad950 msgr2=0x7f9ef0097ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:12.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ee67fc640 1 --2- 172.21.15.55:0/3446246529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ef00ad950 0x7f9ef0097ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:12.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ee67fc640 1 -- 172.21.15.55:0/3446246529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee0009420 con 0x7f9ef00c89f0 2023-08-25T04:16:12.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ee67fc640 1 --2- 172.21.15.55:0/3446246529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00c89f0 0x7f9ef00c1100 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00ae040 tx=0x7f9ee0019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:12.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ee7fff640 1 -- 172.21.15.55:0/3446246529 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee00b4430 con 0x7f9ef00c89f0 2023-08-25T04:16:12.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ee7fff640 1 -- 172.21.15.55:0/3446246529 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee00b4590 con 0x7f9ef00c89f0 2023-08-25T04:16:12.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ef57ac640 1 -- 172.21.15.55:0/3446246529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef0096640 con 0x7f9ef00c89f0 2023-08-25T04:16:12.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ee7fff640 1 -- 172.21.15.55:0/3446246529 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee00b4940 con 0x7f9ef00c89f0 2023-08-25T04:16:12.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.621+0000 7f9ef57ac640 1 -- 172.21.15.55:0/3446246529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef00c7dd0 con 0x7f9ef00c89f0 2023-08-25T04:16:12.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.625+0000 7f9ef57ac640 1 -- 172.21.15.55:0/3446246529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef004dbe0 con 0x7f9ef00c89f0 2023-08-25T04:16:12.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.625+0000 7f9ee7fff640 1 -- 172.21.15.55:0/3446246529 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f9ee00b2040 con 0x7f9ef00c89f0 2023-08-25T04:16:12.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.625+0000 7f9ee7fff640 1 --2- 172.21.15.55:0/3446246529 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f9ed00657a0 0x7f9ed0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:12.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.625+0000 7f9ee7fff640 1 -- 172.21.15.55:0/3446246529 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ee011d920 con 0x7f9ef00c89f0 2023-08-25T04:16:12.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.625+0000 7f9eeeffd640 1 --2- 172.21.15.55:0/3446246529 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f9ed00657a0 0x7f9ed0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:12.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.625+0000 7f9eeeffd640 1 --2- 172.21.15.55:0/3446246529 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f9ed00657a0 0x7f9ed0067c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8007fd0 tx=0x7f9ed8009040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:12.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.629+0000 7f9ee7fff640 1 -- 172.21.15.55:0/3446246529 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9ee00eb370 con 0x7f9ef00c89f0 2023-08-25T04:16:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.781+0000 7f9ef57ac640 1 -- 172.21.15.55:0/3446246529 --> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ef0153eb0 con 0x7f9ed00657a0 2023-08-25T04:16:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.789+0000 7f9ee7fff640 1 -- 172.21.15.55:0/3446246529 <== mgr.5922 v2:172.21.15.110:6832/1373721950 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310995 (secure 0 0 0) 0x7f9ef0153eb0 con 0x7f9ed00657a0 2023-08-25T04:16:12.794 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:16:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:16:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.793+0000 7f9ef57ac640 1 -- 172.21.15.55:0/3446246529 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f9ed00657a0 msgr2=0x7f9ed0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.793+0000 7f9ef57ac640 1 --2- 172.21.15.55:0/3446246529 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f9ed00657a0 0x7f9ed0067c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8007fd0 tx=0x7f9ed8009040 comp rx=0 tx=0).stop 2023-08-25T04:16:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.793+0000 7f9ef57ac640 1 -- 172.21.15.55:0/3446246529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00c89f0 msgr2=0x7f9ef00c1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.793+0000 7f9ef57ac640 1 --2- 172.21.15.55:0/3446246529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00c89f0 0x7f9ef00c1100 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00ae040 tx=0x7f9ee0019190 comp rx=0 tx=0).stop 2023-08-25T04:16:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.793+0000 7f9ef57ac640 1 -- 172.21.15.55:0/3446246529 shutdown_connections 2023-08-25T04:16:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.793+0000 7f9ef57ac640 1 --2- 172.21.15.55:0/3446246529 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f9ed00657a0 0x7f9ed0067c60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.793+0000 7f9ef57ac640 1 --2- 172.21.15.55:0/3446246529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ef00ceeb0 0x7f9ef015d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.793+0000 7f9ef57ac640 1 --2- 172.21.15.55:0/3446246529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00c89f0 0x7f9ef00c1100 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.793+0000 7f9ef57ac640 1 --2- 172.21.15.55:0/3446246529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ef00ad950 0x7f9ef0097ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.793+0000 7f9ef57ac640 1 -- 172.21.15.55:0/3446246529 >> 172.21.15.55:0/3446246529 conn(0x7f9ef0069d00 msgr2=0x7f9ef00b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.793+0000 7f9ef57ac640 1 -- 172.21.15.55:0/3446246529 shutdown_connections 2023-08-25T04:16:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:12.793+0000 7f9ef57ac640 1 -- 172.21.15.55:0/3446246529 wait complete. 2023-08-25T04:16:12.813 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-08-25T04:16:12.559514+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":243,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":177,"ondisk_log_size":177,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317440,"kb_used_data":6920,"kb_used_omap":13,"kb_used_meta":310386,"kb_avail":754657280,"statfs":{"total":773094113280,"available":772769054720,"internally_reserved":0,"allocated":7086080,"data_stored":3984860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":317835352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.815093"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148559+0000","last_change":"2023-08-25T04:16:03.761499+0000","last_active":"2023-08-25T04:16:05.148559+0000","last_peered":"2023-08-25T04:16:05.148559+0000","last_clean":"2023-08-25T04:16:05.148559+0000","last_became_active":"2023-08-25T04:16:03.761153+0000","last_became_peered":"2023-08-25T04:16:03.761153+0000","last_unstale":"2023-08-25T04:16:05.148559+0000","last_undegraded":"2023-08-25T04:16:05.148559+0000","last_fullsized":"2023-08-25T04:16:05.148559+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:37:23.181361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146928+0000","last_change":"2023-08-25T04:16:03.772387+0000","last_active":"2023-08-25T04:16:05.146928+0000","last_peered":"2023-08-25T04:16:05.146928+0000","last_clean":"2023-08-25T04:16:05.146928+0000","last_became_active":"2023-08-25T04:16:03.772074+0000","last_became_peered":"2023-08-25T04:16:03.772074+0000","last_unstale":"2023-08-25T04:16:05.146928+0000","last_undegraded":"2023-08-25T04:16:05.146928+0000","last_fullsized":"2023-08-25T04:16:05.146928+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:50.801153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765805+0000","last_change":"2023-08-25T04:16:03.784558+0000","last_active":"2023-08-25T04:16:04.765805+0000","last_peered":"2023-08-25T04:16:04.765805+0000","last_clean":"2023-08-25T04:16:04.765805+0000","last_became_active":"2023-08-25T04:16:03.784188+0000","last_became_peered":"2023-08-25T04:16:03.784188+0000","last_unstale":"2023-08-25T04:16:04.765805+0000","last_undegraded":"2023-08-25T04:16:04.765805+0000","last_fullsized":"2023-08-25T04:16:04.765805+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:48:59.520120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147224+0000","last_change":"2023-08-25T04:16:03.777815+0000","last_active":"2023-08-25T04:16:05.147224+0000","last_peered":"2023-08-25T04:16:05.147224+0000","last_clean":"2023-08-25T04:16:05.147224+0000","last_became_active":"2023-08-25T04:16:03.777534+0000","last_became_peered":"2023-08-25T04:16:03.777534+0000","last_unstale":"2023-08-25T04:16:05.147224+0000","last_undegraded":"2023-08-25T04:16:05.147224+0000","last_fullsized":"2023-08-25T04:16:05.147224+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:14:34.423119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748245+0000","last_change":"2023-08-25T04:16:03.773146+0000","last_active":"2023-08-25T04:16:04.748245+0000","last_peered":"2023-08-25T04:16:04.748245+0000","last_clean":"2023-08-25T04:16:04.748245+0000","last_became_active":"2023-08-25T04:16:03.772836+0000","last_became_peered":"2023-08-25T04:16:03.772836+0000","last_unstale":"2023-08-25T04:16:04.748245+0000","last_undegraded":"2023-08-25T04:16:04.748245+0000","last_fullsized":"2023-08-25T04:16:04.748245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:07:03.688469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148148+0000","last_change":"2023-08-25T04:16:03.770177+0000","last_active":"2023-08-25T04:16:05.148148+0000","last_peered":"2023-08-25T04:16:05.148148+0000","last_clean":"2023-08-25T04:16:05.148148+0000","last_became_active":"2023-08-25T04:16:03.769847+0000","last_became_peered":"2023-08-25T04:16:03.769847+0000","last_unstale":"2023-08-25T04:16:05.148148+0000","last_undegraded":"2023-08-25T04:16:05.148148+0000","last_fullsized":"2023-08-25T04:16:05.148148+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:45:01.763265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765553+0000","last_change":"2023-08-25T04:16:03.786842+0000","last_active":"2023-08-25T04:16:04.765553+0000","last_peered":"2023-08-25T04:16:04.765553+0000","last_clean":"2023-08-25T04:16:04.765553+0000","last_became_active":"2023-08-25T04:16:03.786519+0000","last_became_peered":"2023-08-25T04:16:03.786519+0000","last_unstale":"2023-08-25T04:16:04.765553+0000","last_undegraded":"2023-08-25T04:16:04.765553+0000","last_fullsized":"2023-08-25T04:16:04.765553+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:03:20.331759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149084+0000","last_change":"2023-08-25T04:16:03.785429+0000","last_active":"2023-08-25T04:16:05.149084+0000","last_peered":"2023-08-25T04:16:05.149084+0000","last_clean":"2023-08-25T04:16:05.149084+0000","last_became_active":"2023-08-25T04:16:03.785135+0000","last_became_peered":"2023-08-25T04:16:03.785135+0000","last_unstale":"2023-08-25T04:16:05.149084+0000","last_undegraded":"2023-08-25T04:16:05.149084+0000","last_fullsized":"2023-08-25T04:16:05.149084+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:53:50.169207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149288+0000","last_change":"2023-08-25T04:16:03.789063+0000","last_active":"2023-08-25T04:16:05.149288+0000","last_peered":"2023-08-25T04:16:05.149288+0000","last_clean":"2023-08-25T04:16:05.149288+0000","last_became_active":"2023-08-25T04:16:03.788776+0000","last_became_peered":"2023-08-25T04:16:03.788776+0000","last_unstale":"2023-08-25T04:16:05.149288+0000","last_undegraded":"2023-08-25T04:16:05.149288+0000","last_fullsized":"2023-08-25T04:16:05.149288+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:07:11.743677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148632+0000","last_change":"2023-08-25T04:16:03.776557+0000","last_active":"2023-08-25T04:16:05.148632+0000","last_peered":"2023-08-25T04:16:05.148632+0000","last_clean":"2023-08-25T04:16:05.148632+0000","last_became_active":"2023-08-25T04:16:03.776251+0000","last_became_peered":"2023-08-25T04:16:03.776251+0000","last_unstale":"2023-08-25T04:16:05.148632+0000","last_undegraded":"2023-08-25T04:16:05.148632+0000","last_fullsized":"2023-08-25T04:16:05.148632+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:54:53.827365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.750560+0000","last_change":"2023-08-25T04:16:03.774830+0000","last_active":"2023-08-25T04:16:04.750560+0000","last_peered":"2023-08-25T04:16:04.750560+0000","last_clean":"2023-08-25T04:16:04.750560+0000","last_became_active":"2023-08-25T04:16:03.774536+0000","last_became_peered":"2023-08-25T04:16:03.774536+0000","last_unstale":"2023-08-25T04:16:04.750560+0000","last_undegraded":"2023-08-25T04:16:04.750560+0000","last_fullsized":"2023-08-25T04:16:04.750560+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:36.325046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148827+0000","last_change":"2023-08-25T04:16:03.756809+0000","last_active":"2023-08-25T04:16:05.148827+0000","last_peered":"2023-08-25T04:16:05.148827+0000","last_clean":"2023-08-25T04:16:05.148827+0000","last_became_active":"2023-08-25T04:16:03.756470+0000","last_became_peered":"2023-08-25T04:16:03.756470+0000","last_unstale":"2023-08-25T04:16:05.148827+0000","last_undegraded":"2023-08-25T04:16:05.148827+0000","last_fullsized":"2023-08-25T04:16:05.148827+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:21.805796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148382+0000","last_change":"2023-08-25T04:16:03.775897+0000","last_active":"2023-08-25T04:16:05.148382+0000","last_peered":"2023-08-25T04:16:05.148382+0000","last_clean":"2023-08-25T04:16:05.148382+0000","last_became_active":"2023-08-25T04:16:03.775606+0000","last_became_peered":"2023-08-25T04:16:03.775606+0000","last_unstale":"2023-08-25T04:16:05.148382+0000","last_undegraded":"2023-08-25T04:16:05.148382+0000","last_fullsized":"2023-08-25T04:16:05.148382+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:37:03.947281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765715+0000","last_change":"2023-08-25T04:16:03.786703+0000","last_active":"2023-08-25T04:16:04.765715+0000","last_peered":"2023-08-25T04:16:04.765715+0000","last_clean":"2023-08-25T04:16:04.765715+0000","last_became_active":"2023-08-25T04:16:03.786381+0000","last_became_peered":"2023-08-25T04:16:03.786381+0000","last_unstale":"2023-08-25T04:16:04.765715+0000","last_undegraded":"2023-08-25T04:16:04.765715+0000","last_fullsized":"2023-08-25T04:16:04.765715+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:33.769674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146248+0000","last_change":"2023-08-25T04:16:03.773379+0000","last_active":"2023-08-25T04:16:05.146248+0000","last_peered":"2023-08-25T04:16:05.146248+0000","last_clean":"2023-08-25T04:16:05.146248+0000","last_became_active":"2023-08-25T04:16:03.771783+0000","last_became_peered":"2023-08-25T04:16:03.771783+0000","last_unstale":"2023-08-25T04:16:05.146248+0000","last_undegraded":"2023-08-25T04:16:05.146248+0000","last_fullsized":"2023-08-25T04:16:05.146248+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:36:19.208784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148110+0000","last_change":"2023-08-25T04:16:03.775960+0000","last_active":"2023-08-25T04:16:05.148110+0000","last_peered":"2023-08-25T04:16:05.148110+0000","last_clean":"2023-08-25T04:16:05.148110+0000","last_became_active":"2023-08-25T04:16:03.775687+0000","last_became_peered":"2023-08-25T04:16:03.775687+0000","last_unstale":"2023-08-25T04:16:05.148110+0000","last_undegraded":"2023-08-25T04:16:05.148110+0000","last_fullsized":"2023-08-25T04:16:05.148110+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:44:04.110996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766206+0000","last_change":"2023-08-25T04:16:03.787692+0000","last_active":"2023-08-25T04:16:04.766206+0000","last_peered":"2023-08-25T04:16:04.766206+0000","last_clean":"2023-08-25T04:16:04.766206+0000","last_became_active":"2023-08-25T04:16:03.787397+0000","last_became_peered":"2023-08-25T04:16:03.787397+0000","last_unstale":"2023-08-25T04:16:04.766206+0000","last_undegraded":"2023-08-25T04:16:04.766206+0000","last_fullsized":"2023-08-25T04:16:04.766206+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:07:03.688469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147055+0000","last_change":"2023-08-25T04:16:03.776606+0000","last_active":"2023-08-25T04:16:05.147055+0000","last_peered":"2023-08-25T04:16:05.147055+0000","last_clean":"2023-08-25T04:16:05.147055+0000","last_became_active":"2023-08-25T04:16:03.776241+0000","last_became_peered":"2023-08-25T04:16:03.776241+0000","last_unstale":"2023-08-25T04:16:05.147055+0000","last_undegraded":"2023-08-25T04:16:05.147055+0000","last_fullsized":"2023-08-25T04:16:05.147055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:05:44.353136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765945+0000","last_change":"2023-08-25T04:16:03.787944+0000","last_active":"2023-08-25T04:16:04.765945+0000","last_peered":"2023-08-25T04:16:04.765945+0000","last_clean":"2023-08-25T04:16:04.765945+0000","last_became_active":"2023-08-25T04:16:03.787621+0000","last_became_peered":"2023-08-25T04:16:03.787621+0000","last_unstale":"2023-08-25T04:16:04.765945+0000","last_undegraded":"2023-08-25T04:16:04.765945+0000","last_fullsized":"2023-08-25T04:16:04.765945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:18:00.835206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748469+0000","last_change":"2023-08-25T04:16:03.776098+0000","last_active":"2023-08-25T04:16:04.748469+0000","last_peered":"2023-08-25T04:16:04.748469+0000","last_clean":"2023-08-25T04:16:04.748469+0000","last_became_active":"2023-08-25T04:16:03.775792+0000","last_became_peered":"2023-08-25T04:16:03.775792+0000","last_unstale":"2023-08-25T04:16:04.748469+0000","last_undegraded":"2023-08-25T04:16:04.748469+0000","last_fullsized":"2023-08-25T04:16:04.748469+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:45:15.044627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748469+0000","last_change":"2023-08-25T04:16:03.768123+0000","last_active":"2023-08-25T04:16:04.748469+0000","last_peered":"2023-08-25T04:16:04.748469+0000","last_clean":"2023-08-25T04:16:04.748469+0000","last_became_active":"2023-08-25T04:16:03.767768+0000","last_became_peered":"2023-08-25T04:16:03.767768+0000","last_unstale":"2023-08-25T04:16:04.748469+0000","last_undegraded":"2023-08-25T04:16:04.748469+0000","last_fullsized":"2023-08-25T04:16:04.748469+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:22:41.895685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148858+0000","last_change":"2023-08-25T04:16:03.785327+0000","last_active":"2023-08-25T04:16:05.148858+0000","last_peered":"2023-08-25T04:16:05.148858+0000","last_clean":"2023-08-25T04:16:05.148858+0000","last_became_active":"2023-08-25T04:16:03.785022+0000","last_became_peered":"2023-08-25T04:16:03.785022+0000","last_unstale":"2023-08-25T04:16:05.148858+0000","last_undegraded":"2023-08-25T04:16:05.148858+0000","last_fullsized":"2023-08-25T04:16:05.148858+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:26:44.775981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.750203+0000","last_change":"2023-08-25T04:16:03.769501+0000","last_active":"2023-08-25T04:16:04.750203+0000","last_peered":"2023-08-25T04:16:04.750203+0000","last_clean":"2023-08-25T04:16:04.750203+0000","last_became_active":"2023-08-25T04:16:03.769236+0000","last_became_peered":"2023-08-25T04:16:03.769236+0000","last_unstale":"2023-08-25T04:16:04.750203+0000","last_undegraded":"2023-08-25T04:16:04.750203+0000","last_fullsized":"2023-08-25T04:16:04.750203+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:58:58.749772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765491+0000","last_change":"2023-08-25T04:16:03.783410+0000","last_active":"2023-08-25T04:16:04.765491+0000","last_peered":"2023-08-25T04:16:04.765491+0000","last_clean":"2023-08-25T04:16:04.765491+0000","last_became_active":"2023-08-25T04:16:03.783117+0000","last_became_peered":"2023-08-25T04:16:03.783117+0000","last_unstale":"2023-08-25T04:16:04.765491+0000","last_undegraded":"2023-08-25T04:16:04.765491+0000","last_fullsized":"2023-08-25T04:16:04.765491+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:10:59.362603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766240+0000","last_change":"2023-08-25T04:16:03.782629+0000","last_active":"2023-08-25T04:16:04.766240+0000","last_peered":"2023-08-25T04:16:04.766240+0000","last_clean":"2023-08-25T04:16:04.766240+0000","last_became_active":"2023-08-25T04:16:03.782344+0000","last_became_peered":"2023-08-25T04:16:03.782344+0000","last_unstale":"2023-08-25T04:16:04.766240+0000","last_undegraded":"2023-08-25T04:16:04.766240+0000","last_fullsized":"2023-08-25T04:16:04.766240+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:55.150693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148884+0000","last_change":"2023-08-25T04:16:03.759410+0000","last_active":"2023-08-25T04:16:05.148884+0000","last_peered":"2023-08-25T04:16:05.148884+0000","last_clean":"2023-08-25T04:16:05.148884+0000","last_became_active":"2023-08-25T04:16:03.758840+0000","last_became_peered":"2023-08-25T04:16:03.758840+0000","last_unstale":"2023-08-25T04:16:05.148884+0000","last_undegraded":"2023-08-25T04:16:05.148884+0000","last_fullsized":"2023-08-25T04:16:05.148884+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:24:29.741709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148710+0000","last_change":"2023-08-25T04:16:03.785204+0000","last_active":"2023-08-25T04:16:05.148710+0000","last_peered":"2023-08-25T04:16:05.148710+0000","last_clean":"2023-08-25T04:16:05.148710+0000","last_became_active":"2023-08-25T04:16:03.784847+0000","last_became_peered":"2023-08-25T04:16:03.784847+0000","last_unstale":"2023-08-25T04:16:05.148710+0000","last_undegraded":"2023-08-25T04:16:05.148710+0000","last_fullsized":"2023-08-25T04:16:05.148710+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:21:46.894701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748640+0000","last_change":"2023-08-25T04:16:03.756349+0000","last_active":"2023-08-25T04:16:04.748640+0000","last_peered":"2023-08-25T04:16:04.748640+0000","last_clean":"2023-08-25T04:16:04.748640+0000","last_became_active":"2023-08-25T04:16:03.755958+0000","last_became_peered":"2023-08-25T04:16:03.755958+0000","last_unstale":"2023-08-25T04:16:04.748640+0000","last_undegraded":"2023-08-25T04:16:04.748640+0000","last_fullsized":"2023-08-25T04:16:04.748640+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:34:35.864224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765730+0000","last_change":"2023-08-25T04:16:03.783135+0000","last_active":"2023-08-25T04:16:04.765730+0000","last_peered":"2023-08-25T04:16:04.765730+0000","last_clean":"2023-08-25T04:16:04.765730+0000","last_became_active":"2023-08-25T04:16:03.782771+0000","last_became_peered":"2023-08-25T04:16:03.782771+0000","last_unstale":"2023-08-25T04:16:04.765730+0000","last_undegraded":"2023-08-25T04:16:04.765730+0000","last_fullsized":"2023-08-25T04:16:04.765730+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:17:20.793802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146616+0000","last_change":"2023-08-25T04:16:03.769209+0000","last_active":"2023-08-25T04:16:05.146616+0000","last_peered":"2023-08-25T04:16:05.146616+0000","last_clean":"2023-08-25T04:16:05.146616+0000","last_became_active":"2023-08-25T04:16:03.768666+0000","last_became_peered":"2023-08-25T04:16:03.768666+0000","last_unstale":"2023-08-25T04:16:05.146616+0000","last_undegraded":"2023-08-25T04:16:05.146616+0000","last_fullsized":"2023-08-25T04:16:05.146616+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:16:49.457554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765637+0000","last_change":"2023-08-25T04:16:03.780860+0000","last_active":"2023-08-25T04:16:04.765637+0000","last_peered":"2023-08-25T04:16:04.765637+0000","last_clean":"2023-08-25T04:16:04.765637+0000","last_became_active":"2023-08-25T04:16:03.780552+0000","last_became_peered":"2023-08-25T04:16:03.780552+0000","last_unstale":"2023-08-25T04:16:04.765637+0000","last_undegraded":"2023-08-25T04:16:04.765637+0000","last_fullsized":"2023-08-25T04:16:04.765637+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:32:56.502762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146400+0000","last_change":"2023-08-25T04:16:03.759257+0000","last_active":"2023-08-25T04:16:05.146400+0000","last_peered":"2023-08-25T04:16:05.146400+0000","last_clean":"2023-08-25T04:16:05.146400+0000","last_became_active":"2023-08-25T04:16:03.758689+0000","last_became_peered":"2023-08-25T04:16:03.758689+0000","last_unstale":"2023-08-25T04:16:05.146400+0000","last_undegraded":"2023-08-25T04:16:05.146400+0000","last_fullsized":"2023-08-25T04:16:05.146400+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:31:23.845883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146117+0000","last_change":"2023-08-25T04:16:03.772450+0000","last_active":"2023-08-25T04:16:05.146117+0000","last_peered":"2023-08-25T04:16:05.146117+0000","last_clean":"2023-08-25T04:16:05.146117+0000","last_became_active":"2023-08-25T04:16:03.772138+0000","last_became_peered":"2023-08-25T04:16:03.772138+0000","last_unstale":"2023-08-25T04:16:05.146117+0000","last_undegraded":"2023-08-25T04:16:05.146117+0000","last_fullsized":"2023-08-25T04:16:05.146117+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:30:15.714145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"61'4","reported_seq":17,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748428+0000","last_change":"2023-08-25T04:16:02.754044+0000","last_active":"2023-08-25T04:16:04.748428+0000","last_peered":"2023-08-25T04:16:04.748428+0000","last_clean":"2023-08-25T04:16:04.748428+0000","last_became_active":"2023-08-25T04:16:02.753745+0000","last_became_peered":"2023-08-25T04:16:02.753745+0000","last_unstale":"2023-08-25T04:16:04.748428+0000","last_undegraded":"2023-08-25T04:16:04.748428+0000","last_fullsized":"2023-08-25T04:16:04.748428+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:29:31.834153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146631+0000","last_change":"2023-08-25T04:16:03.770251+0000","last_active":"2023-08-25T04:16:05.146631+0000","last_peered":"2023-08-25T04:16:05.146631+0000","last_clean":"2023-08-25T04:16:05.146631+0000","last_became_active":"2023-08-25T04:16:03.769936+0000","last_became_peered":"2023-08-25T04:16:03.769936+0000","last_unstale":"2023-08-25T04:16:05.146631+0000","last_undegraded":"2023-08-25T04:16:05.146631+0000","last_fullsized":"2023-08-25T04:16:05.146631+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:38.733640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148725+0000","last_change":"2023-08-25T04:16:02.770511+0000","last_active":"2023-08-25T04:16:05.148725+0000","last_peered":"2023-08-25T04:16:05.148725+0000","last_clean":"2023-08-25T04:16:05.148725+0000","last_became_active":"2023-08-25T04:16:02.770243+0000","last_became_peered":"2023-08-25T04:16:02.770243+0000","last_unstale":"2023-08-25T04:16:05.148725+0000","last_undegraded":"2023-08-25T04:16:05.148725+0000","last_fullsized":"2023-08-25T04:16:05.148725+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:45.356869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748134+0000","last_change":"2023-08-25T04:16:03.768344+0000","last_active":"2023-08-25T04:16:04.748134+0000","last_peered":"2023-08-25T04:16:04.748134+0000","last_clean":"2023-08-25T04:16:04.748134+0000","last_became_active":"2023-08-25T04:16:03.767937+0000","last_became_peered":"2023-08-25T04:16:03.767937+0000","last_unstale":"2023-08-25T04:16:04.748134+0000","last_undegraded":"2023-08-25T04:16:04.748134+0000","last_fullsized":"2023-08-25T04:16:04.748134+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:31:47.264743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148875+0000","last_change":"2023-08-25T04:16:02.758582+0000","last_active":"2023-08-25T04:16:05.148875+0000","last_peered":"2023-08-25T04:16:05.148875+0000","last_clean":"2023-08-25T04:16:05.148875+0000","last_became_active":"2023-08-25T04:16:02.757685+0000","last_became_peered":"2023-08-25T04:16:02.757685+0000","last_unstale":"2023-08-25T04:16:05.148875+0000","last_undegraded":"2023-08-25T04:16:05.148875+0000","last_fullsized":"2023-08-25T04:16:05.148875+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:44:00.828275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149146+0000","last_change":"2023-08-25T04:16:03.758896+0000","last_active":"2023-08-25T04:16:05.149146+0000","last_peered":"2023-08-25T04:16:05.149146+0000","last_clean":"2023-08-25T04:16:05.149146+0000","last_became_active":"2023-08-25T04:16:03.758622+0000","last_became_peered":"2023-08-25T04:16:03.758622+0000","last_unstale":"2023-08-25T04:16:05.149146+0000","last_undegraded":"2023-08-25T04:16:05.149146+0000","last_fullsized":"2023-08-25T04:16:05.149146+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:25.716695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147155+0000","last_change":"2023-08-25T04:16:02.767008+0000","last_active":"2023-08-25T04:16:05.147155+0000","last_peered":"2023-08-25T04:16:05.147155+0000","last_clean":"2023-08-25T04:16:05.147155+0000","last_became_active":"2023-08-25T04:16:02.766694+0000","last_became_peered":"2023-08-25T04:16:02.766694+0000","last_unstale":"2023-08-25T04:16:05.147155+0000","last_undegraded":"2023-08-25T04:16:05.147155+0000","last_fullsized":"2023-08-25T04:16:05.147155+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:50:23.007130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748939+0000","last_change":"2023-08-25T04:16:03.779198+0000","last_active":"2023-08-25T04:16:04.748939+0000","last_peered":"2023-08-25T04:16:04.748939+0000","last_clean":"2023-08-25T04:16:04.748939+0000","last_became_active":"2023-08-25T04:16:03.778920+0000","last_became_peered":"2023-08-25T04:16:03.778920+0000","last_unstale":"2023-08-25T04:16:04.748939+0000","last_undegraded":"2023-08-25T04:16:04.748939+0000","last_fullsized":"2023-08-25T04:16:04.748939+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:55.150693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765740+0000","last_change":"2023-08-25T04:16:02.766806+0000","last_active":"2023-08-25T04:16:04.765740+0000","last_peered":"2023-08-25T04:16:04.765740+0000","last_clean":"2023-08-25T04:16:04.765740+0000","last_became_active":"2023-08-25T04:16:02.766547+0000","last_became_peered":"2023-08-25T04:16:02.766547+0000","last_unstale":"2023-08-25T04:16:04.765740+0000","last_undegraded":"2023-08-25T04:16:04.765740+0000","last_fullsized":"2023-08-25T04:16:04.765740+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:02.787535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146412+0000","last_change":"2023-08-25T04:16:03.775323+0000","last_active":"2023-08-25T04:16:05.146412+0000","last_peered":"2023-08-25T04:16:05.146412+0000","last_clean":"2023-08-25T04:16:05.146412+0000","last_became_active":"2023-08-25T04:16:03.774876+0000","last_became_peered":"2023-08-25T04:16:03.774876+0000","last_unstale":"2023-08-25T04:16:05.146412+0000","last_undegraded":"2023-08-25T04:16:05.146412+0000","last_fullsized":"2023-08-25T04:16:05.146412+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:26:24.667103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.747983+0000","last_change":"2023-08-25T04:16:02.756878+0000","last_active":"2023-08-25T04:16:04.747983+0000","last_peered":"2023-08-25T04:16:04.747983+0000","last_clean":"2023-08-25T04:16:04.747983+0000","last_became_active":"2023-08-25T04:16:02.756603+0000","last_became_peered":"2023-08-25T04:16:02.756603+0000","last_unstale":"2023-08-25T04:16:04.747983+0000","last_undegraded":"2023-08-25T04:16:04.747983+0000","last_fullsized":"2023-08-25T04:16:04.747983+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:49:46.810312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149187+0000","last_change":"2023-08-25T04:16:03.759222+0000","last_active":"2023-08-25T04:16:05.149187+0000","last_peered":"2023-08-25T04:16:05.149187+0000","last_clean":"2023-08-25T04:16:05.149187+0000","last_became_active":"2023-08-25T04:16:03.758489+0000","last_became_peered":"2023-08-25T04:16:03.758489+0000","last_unstale":"2023-08-25T04:16:05.149187+0000","last_undegraded":"2023-08-25T04:16:05.149187+0000","last_fullsized":"2023-08-25T04:16:05.149187+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:54:46.607192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748162+0000","last_change":"2023-08-25T04:16:02.757095+0000","last_active":"2023-08-25T04:16:04.748162+0000","last_peered":"2023-08-25T04:16:04.748162+0000","last_clean":"2023-08-25T04:16:04.748162+0000","last_became_active":"2023-08-25T04:16:02.756829+0000","last_became_peered":"2023-08-25T04:16:02.756829+0000","last_unstale":"2023-08-25T04:16:04.748162+0000","last_undegraded":"2023-08-25T04:16:04.748162+0000","last_fullsized":"2023-08-25T04:16:04.748162+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:36.997870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147325+0000","last_change":"2023-08-25T04:16:03.785771+0000","last_active":"2023-08-25T04:16:05.147325+0000","last_peered":"2023-08-25T04:16:05.147325+0000","last_clean":"2023-08-25T04:16:05.147325+0000","last_became_active":"2023-08-25T04:16:03.785442+0000","last_became_peered":"2023-08-25T04:16:03.785442+0000","last_unstale":"2023-08-25T04:16:05.147325+0000","last_undegraded":"2023-08-25T04:16:05.147325+0000","last_fullsized":"2023-08-25T04:16:05.147325+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:32:17.663807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765509+0000","last_change":"2023-08-25T04:16:02.766205+0000","last_active":"2023-08-25T04:16:04.765509+0000","last_peered":"2023-08-25T04:16:04.765509+0000","last_clean":"2023-08-25T04:16:04.765509+0000","last_became_active":"2023-08-25T04:16:02.765799+0000","last_became_peered":"2023-08-25T04:16:02.765799+0000","last_unstale":"2023-08-25T04:16:04.765509+0000","last_undegraded":"2023-08-25T04:16:04.765509+0000","last_fullsized":"2023-08-25T04:16:04.765509+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:41:27.023839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748061+0000","last_change":"2023-08-25T04:16:03.772083+0000","last_active":"2023-08-25T04:16:04.748061+0000","last_peered":"2023-08-25T04:16:04.748061+0000","last_clean":"2023-08-25T04:16:04.748061+0000","last_became_active":"2023-08-25T04:16:03.771610+0000","last_became_peered":"2023-08-25T04:16:03.771610+0000","last_unstale":"2023-08-25T04:16:04.748061+0000","last_undegraded":"2023-08-25T04:16:04.748061+0000","last_fullsized":"2023-08-25T04:16:04.748061+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:43:45.063038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147100+0000","last_change":"2023-08-25T04:16:02.759755+0000","last_active":"2023-08-25T04:16:05.147100+0000","last_peered":"2023-08-25T04:16:05.147100+0000","last_clean":"2023-08-25T04:16:05.147100+0000","last_became_active":"2023-08-25T04:16:02.759428+0000","last_became_peered":"2023-08-25T04:16:02.759428+0000","last_unstale":"2023-08-25T04:16:05.147100+0000","last_undegraded":"2023-08-25T04:16:05.147100+0000","last_fullsized":"2023-08-25T04:16:05.147100+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:19.263285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146493+0000","last_change":"2023-08-25T04:16:03.773294+0000","last_active":"2023-08-25T04:16:05.146493+0000","last_peered":"2023-08-25T04:16:05.146493+0000","last_clean":"2023-08-25T04:16:05.146493+0000","last_became_active":"2023-08-25T04:16:03.773030+0000","last_became_peered":"2023-08-25T04:16:03.773030+0000","last_unstale":"2023-08-25T04:16:05.146493+0000","last_undegraded":"2023-08-25T04:16:05.146493+0000","last_fullsized":"2023-08-25T04:16:05.146493+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:05.189822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748935+0000","last_change":"2023-08-25T04:16:02.759993+0000","last_active":"2023-08-25T04:16:04.748935+0000","last_peered":"2023-08-25T04:16:04.748935+0000","last_clean":"2023-08-25T04:16:04.748935+0000","last_became_active":"2023-08-25T04:16:02.759674+0000","last_became_peered":"2023-08-25T04:16:02.759674+0000","last_unstale":"2023-08-25T04:16:04.748935+0000","last_undegraded":"2023-08-25T04:16:04.748935+0000","last_fullsized":"2023-08-25T04:16:04.748935+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:15:38.572849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765882+0000","last_change":"2023-08-25T04:16:03.787042+0000","last_active":"2023-08-25T04:16:04.765882+0000","last_peered":"2023-08-25T04:16:04.765882+0000","last_clean":"2023-08-25T04:16:04.765882+0000","last_became_active":"2023-08-25T04:16:03.786769+0000","last_became_peered":"2023-08-25T04:16:03.786769+0000","last_unstale":"2023-08-25T04:16:04.765882+0000","last_undegraded":"2023-08-25T04:16:04.765882+0000","last_fullsized":"2023-08-25T04:16:04.765882+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:08:24.248450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"61'3","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146559+0000","last_change":"2023-08-25T04:16:02.766795+0000","last_active":"2023-08-25T04:16:05.146559+0000","last_peered":"2023-08-25T04:16:05.146559+0000","last_clean":"2023-08-25T04:16:05.146559+0000","last_became_active":"2023-08-25T04:16:02.766468+0000","last_became_peered":"2023-08-25T04:16:02.766468+0000","last_unstale":"2023-08-25T04:16:05.146559+0000","last_undegraded":"2023-08-25T04:16:05.146559+0000","last_fullsized":"2023-08-25T04:16:05.146559+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:44:50.831742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748381+0000","last_change":"2023-08-25T04:16:03.772422+0000","last_active":"2023-08-25T04:16:04.748381+0000","last_peered":"2023-08-25T04:16:04.748381+0000","last_clean":"2023-08-25T04:16:04.748381+0000","last_became_active":"2023-08-25T04:16:03.771663+0000","last_became_peered":"2023-08-25T04:16:03.771663+0000","last_unstale":"2023-08-25T04:16:04.748381+0000","last_undegraded":"2023-08-25T04:16:04.748381+0000","last_fullsized":"2023-08-25T04:16:04.748381+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:14:16.042804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"61'6","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149058+0000","last_change":"2023-08-25T04:16:02.769516+0000","last_active":"2023-08-25T04:16:05.149058+0000","last_peered":"2023-08-25T04:16:05.149058+0000","last_clean":"2023-08-25T04:16:05.149058+0000","last_became_active":"2023-08-25T04:16:02.769170+0000","last_became_peered":"2023-08-25T04:16:02.769170+0000","last_unstale":"2023-08-25T04:16:05.149058+0000","last_undegraded":"2023-08-25T04:16:05.149058+0000","last_fullsized":"2023-08-25T04:16:05.149058+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:28:32.193662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147032+0000","last_change":"2023-08-25T04:16:03.769713+0000","last_active":"2023-08-25T04:16:05.147032+0000","last_peered":"2023-08-25T04:16:05.147032+0000","last_clean":"2023-08-25T04:16:05.147032+0000","last_became_active":"2023-08-25T04:16:03.769416+0000","last_became_peered":"2023-08-25T04:16:03.769416+0000","last_unstale":"2023-08-25T04:16:05.147032+0000","last_undegraded":"2023-08-25T04:16:05.147032+0000","last_fullsized":"2023-08-25T04:16:05.147032+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:13:29.140582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765848+0000","last_change":"2023-08-25T04:16:02.762779+0000","last_active":"2023-08-25T04:16:04.765848+0000","last_peered":"2023-08-25T04:16:04.765848+0000","last_clean":"2023-08-25T04:16:04.765848+0000","last_became_active":"2023-08-25T04:16:02.762491+0000","last_became_peered":"2023-08-25T04:16:02.762491+0000","last_unstale":"2023-08-25T04:16:04.765848+0000","last_undegraded":"2023-08-25T04:16:04.765848+0000","last_fullsized":"2023-08-25T04:16:04.765848+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:54.292750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765959+0000","last_change":"2023-08-25T04:16:03.778616+0000","last_active":"2023-08-25T04:16:04.765959+0000","last_peered":"2023-08-25T04:16:04.765959+0000","last_clean":"2023-08-25T04:16:04.765959+0000","last_became_active":"2023-08-25T04:16:03.778334+0000","last_became_peered":"2023-08-25T04:16:03.778334+0000","last_unstale":"2023-08-25T04:16:04.765959+0000","last_undegraded":"2023-08-25T04:16:04.765959+0000","last_fullsized":"2023-08-25T04:16:04.765959+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:43:45.063038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748234+0000","last_change":"2023-08-25T04:16:02.761507+0000","last_active":"2023-08-25T04:16:04.748234+0000","last_peered":"2023-08-25T04:16:04.748234+0000","last_clean":"2023-08-25T04:16:04.748234+0000","last_became_active":"2023-08-25T04:16:02.761197+0000","last_became_peered":"2023-08-25T04:16:02.761197+0000","last_unstale":"2023-08-25T04:16:04.748234+0000","last_undegraded":"2023-08-25T04:16:04.748234+0000","last_fullsized":"2023-08-25T04:16:04.748234+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:38:28.867182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149039+0000","last_change":"2023-08-25T04:16:03.769037+0000","last_active":"2023-08-25T04:16:05.149039+0000","last_peered":"2023-08-25T04:16:05.149039+0000","last_clean":"2023-08-25T04:16:05.149039+0000","last_became_active":"2023-08-25T04:16:03.768748+0000","last_became_peered":"2023-08-25T04:16:03.768748+0000","last_unstale":"2023-08-25T04:16:05.149039+0000","last_undegraded":"2023-08-25T04:16:05.149039+0000","last_fullsized":"2023-08-25T04:16:05.149039+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:24.524584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146447+0000","last_change":"2023-08-25T04:16:02.761674+0000","last_active":"2023-08-25T04:16:05.146447+0000","last_peered":"2023-08-25T04:16:05.146447+0000","last_clean":"2023-08-25T04:16:05.146447+0000","last_became_active":"2023-08-25T04:16:02.761351+0000","last_became_peered":"2023-08-25T04:16:02.761351+0000","last_unstale":"2023-08-25T04:16:05.146447+0000","last_undegraded":"2023-08-25T04:16:05.146447+0000","last_fullsized":"2023-08-25T04:16:05.146447+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:37:03.966092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765938+0000","last_change":"2023-08-25T04:16:03.787422+0000","last_active":"2023-08-25T04:16:04.765938+0000","last_peered":"2023-08-25T04:16:04.765938+0000","last_clean":"2023-08-25T04:16:04.765938+0000","last_became_active":"2023-08-25T04:16:03.787088+0000","last_became_peered":"2023-08-25T04:16:03.787088+0000","last_unstale":"2023-08-25T04:16:04.765938+0000","last_undegraded":"2023-08-25T04:16:04.765938+0000","last_fullsized":"2023-08-25T04:16:04.765938+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:56:51.258380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"61'8","reported_seq":21,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148959+0000","last_change":"2023-08-25T04:16:02.769884+0000","last_active":"2023-08-25T04:16:05.148959+0000","last_peered":"2023-08-25T04:16:05.148959+0000","last_clean":"2023-08-25T04:16:05.148959+0000","last_became_active":"2023-08-25T04:16:02.768928+0000","last_became_peered":"2023-08-25T04:16:02.768928+0000","last_unstale":"2023-08-25T04:16:05.148959+0000","last_undegraded":"2023-08-25T04:16:05.148959+0000","last_fullsized":"2023-08-25T04:16:05.148959+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:48:31.382356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148863+0000","last_change":"2023-08-25T04:16:03.766212+0000","last_active":"2023-08-25T04:16:05.148863+0000","last_peered":"2023-08-25T04:16:05.148863+0000","last_clean":"2023-08-25T04:16:05.148863+0000","last_became_active":"2023-08-25T04:16:03.765926+0000","last_became_peered":"2023-08-25T04:16:03.765926+0000","last_unstale":"2023-08-25T04:16:05.148863+0000","last_undegraded":"2023-08-25T04:16:05.148863+0000","last_fullsized":"2023-08-25T04:16:05.148863+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:01:07.903863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766278+0000","last_change":"2023-08-25T04:16:02.769909+0000","last_active":"2023-08-25T04:16:04.766278+0000","last_peered":"2023-08-25T04:16:04.766278+0000","last_clean":"2023-08-25T04:16:04.766278+0000","last_became_active":"2023-08-25T04:16:02.769572+0000","last_became_peered":"2023-08-25T04:16:02.769572+0000","last_unstale":"2023-08-25T04:16:04.766278+0000","last_undegraded":"2023-08-25T04:16:04.766278+0000","last_fullsized":"2023-08-25T04:16:04.766278+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:15:38.572849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148148+0000","last_change":"2023-08-25T04:16:03.784206+0000","last_active":"2023-08-25T04:16:05.148148+0000","last_peered":"2023-08-25T04:16:05.148148+0000","last_clean":"2023-08-25T04:16:05.148148+0000","last_became_active":"2023-08-25T04:16:03.783799+0000","last_became_peered":"2023-08-25T04:16:03.783799+0000","last_unstale":"2023-08-25T04:16:05.148148+0000","last_undegraded":"2023-08-25T04:16:05.148148+0000","last_fullsized":"2023-08-25T04:16:05.148148+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:58:05.317914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.750693+0000","last_change":"2023-08-25T04:16:02.761798+0000","last_active":"2023-08-25T04:16:04.750693+0000","last_peered":"2023-08-25T04:16:04.750693+0000","last_clean":"2023-08-25T04:16:04.750693+0000","last_became_active":"2023-08-25T04:16:02.761512+0000","last_became_peered":"2023-08-25T04:16:02.761512+0000","last_unstale":"2023-08-25T04:16:04.750693+0000","last_undegraded":"2023-08-25T04:16:04.750693+0000","last_fullsized":"2023-08-25T04:16:04.750693+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:49:42.962115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748094+0000","last_change":"2023-08-25T04:16:03.784616+0000","last_active":"2023-08-25T04:16:04.748094+0000","last_peered":"2023-08-25T04:16:04.748094+0000","last_clean":"2023-08-25T04:16:04.748094+0000","last_became_active":"2023-08-25T04:16:03.784320+0000","last_became_peered":"2023-08-25T04:16:03.784320+0000","last_unstale":"2023-08-25T04:16:04.748094+0000","last_undegraded":"2023-08-25T04:16:04.748094+0000","last_fullsized":"2023-08-25T04:16:04.748094+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:47:23.266030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"61'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748522+0000","last_change":"2023-08-25T04:16:02.760117+0000","last_active":"2023-08-25T04:16:04.748522+0000","last_peered":"2023-08-25T04:16:04.748522+0000","last_clean":"2023-08-25T04:16:04.748522+0000","last_became_active":"2023-08-25T04:16:02.758535+0000","last_became_peered":"2023-08-25T04:16:02.758535+0000","last_unstale":"2023-08-25T04:16:04.748522+0000","last_undegraded":"2023-08-25T04:16:04.748522+0000","last_fullsized":"2023-08-25T04:16:04.748522+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:16:27.704115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148413+0000","last_change":"2023-08-25T04:16:03.765306+0000","last_active":"2023-08-25T04:16:05.148413+0000","last_peered":"2023-08-25T04:16:05.148413+0000","last_clean":"2023-08-25T04:16:05.148413+0000","last_became_active":"2023-08-25T04:16:03.764966+0000","last_became_peered":"2023-08-25T04:16:03.764966+0000","last_unstale":"2023-08-25T04:16:05.148413+0000","last_undegraded":"2023-08-25T04:16:05.148413+0000","last_fullsized":"2023-08-25T04:16:05.148413+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:13:43.607156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748638+0000","last_change":"2023-08-25T04:16:02.765158+0000","last_active":"2023-08-25T04:16:04.748638+0000","last_peered":"2023-08-25T04:16:04.748638+0000","last_clean":"2023-08-25T04:16:04.748638+0000","last_became_active":"2023-08-25T04:16:02.764912+0000","last_became_peered":"2023-08-25T04:16:02.764912+0000","last_unstale":"2023-08-25T04:16:04.748638+0000","last_undegraded":"2023-08-25T04:16:04.748638+0000","last_fullsized":"2023-08-25T04:16:04.748638+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:03.782699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.147108+0000","last_change":"2023-08-25T04:16:03.774420+0000","last_active":"2023-08-25T04:16:05.147108+0000","last_peered":"2023-08-25T04:16:05.147108+0000","last_clean":"2023-08-25T04:16:05.147108+0000","last_became_active":"2023-08-25T04:16:03.774056+0000","last_became_peered":"2023-08-25T04:16:03.774056+0000","last_unstale":"2023-08-25T04:16:05.147108+0000","last_undegraded":"2023-08-25T04:16:05.147108+0000","last_fullsized":"2023-08-25T04:16:05.147108+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:30:15.714145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148479+0000","last_change":"2023-08-25T04:16:02.765007+0000","last_active":"2023-08-25T04:16:05.148479+0000","last_peered":"2023-08-25T04:16:05.148479+0000","last_clean":"2023-08-25T04:16:05.148479+0000","last_became_active":"2023-08-25T04:16:02.764646+0000","last_became_peered":"2023-08-25T04:16:02.764646+0000","last_unstale":"2023-08-25T04:16:05.148479+0000","last_undegraded":"2023-08-25T04:16:05.148479+0000","last_fullsized":"2023-08-25T04:16:05.148479+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:01:43.514684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748326+0000","last_change":"2023-08-25T04:16:03.775606+0000","last_active":"2023-08-25T04:16:04.748326+0000","last_peered":"2023-08-25T04:16:04.748326+0000","last_clean":"2023-08-25T04:16:04.748326+0000","last_became_active":"2023-08-25T04:16:03.773164+0000","last_became_peered":"2023-08-25T04:16:03.773164+0000","last_unstale":"2023-08-25T04:16:04.748326+0000","last_undegraded":"2023-08-25T04:16:04.748326+0000","last_fullsized":"2023-08-25T04:16:04.748326+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:09.743104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148937+0000","last_change":"2023-08-25T04:16:02.769473+0000","last_active":"2023-08-25T04:16:05.148937+0000","last_peered":"2023-08-25T04:16:05.148937+0000","last_clean":"2023-08-25T04:16:05.148937+0000","last_became_active":"2023-08-25T04:16:02.769146+0000","last_became_peered":"2023-08-25T04:16:02.769146+0000","last_unstale":"2023-08-25T04:16:05.148937+0000","last_undegraded":"2023-08-25T04:16:05.148937+0000","last_fullsized":"2023-08-25T04:16:05.148937+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:01:31.204659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766193+0000","last_change":"2023-08-25T04:16:03.783730+0000","last_active":"2023-08-25T04:16:04.766193+0000","last_peered":"2023-08-25T04:16:04.766193+0000","last_clean":"2023-08-25T04:16:04.766193+0000","last_became_active":"2023-08-25T04:16:03.783468+0000","last_became_peered":"2023-08-25T04:16:03.783468+0000","last_unstale":"2023-08-25T04:16:04.766193+0000","last_undegraded":"2023-08-25T04:16:04.766193+0000","last_fullsized":"2023-08-25T04:16:04.766193+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:51:11.953697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765645+0000","last_change":"2023-08-25T04:16:02.762858+0000","last_active":"2023-08-25T04:16:04.765645+0000","last_peered":"2023-08-25T04:16:04.765645+0000","last_clean":"2023-08-25T04:16:04.765645+0000","last_became_active":"2023-08-25T04:16:02.762516+0000","last_became_peered":"2023-08-25T04:16:02.762516+0000","last_unstale":"2023-08-25T04:16:04.765645+0000","last_undegraded":"2023-08-25T04:16:04.765645+0000","last_fullsized":"2023-08-25T04:16:04.765645+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:19:41.400173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148567+0000","last_change":"2023-08-25T04:16:03.756864+0000","last_active":"2023-08-25T04:16:05.148567+0000","last_peered":"2023-08-25T04:16:05.148567+0000","last_clean":"2023-08-25T04:16:05.148567+0000","last_became_active":"2023-08-25T04:16:03.756575+0000","last_became_peered":"2023-08-25T04:16:03.756575+0000","last_unstale":"2023-08-25T04:16:05.148567+0000","last_undegraded":"2023-08-25T04:16:05.148567+0000","last_fullsized":"2023-08-25T04:16:05.148567+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:30:09.575853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.750115+0000","last_change":"2023-08-25T04:16:02.763728+0000","last_active":"2023-08-25T04:16:04.750115+0000","last_peered":"2023-08-25T04:16:04.750115+0000","last_clean":"2023-08-25T04:16:04.750115+0000","last_became_active":"2023-08-25T04:16:02.763409+0000","last_became_peered":"2023-08-25T04:16:02.763409+0000","last_unstale":"2023-08-25T04:16:04.750115+0000","last_undegraded":"2023-08-25T04:16:04.750115+0000","last_fullsized":"2023-08-25T04:16:04.750115+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:30.338115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748059+0000","last_change":"2023-08-25T04:16:03.762457+0000","last_active":"2023-08-25T04:16:04.748059+0000","last_peered":"2023-08-25T04:16:04.748059+0000","last_clean":"2023-08-25T04:16:04.748059+0000","last_became_active":"2023-08-25T04:16:03.762156+0000","last_became_peered":"2023-08-25T04:16:03.762156+0000","last_unstale":"2023-08-25T04:16:04.748059+0000","last_undegraded":"2023-08-25T04:16:04.748059+0000","last_fullsized":"2023-08-25T04:16:04.748059+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:05:34.107237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766191+0000","last_change":"2023-08-25T04:16:02.764778+0000","last_active":"2023-08-25T04:16:04.766191+0000","last_peered":"2023-08-25T04:16:04.766191+0000","last_clean":"2023-08-25T04:16:04.766191+0000","last_became_active":"2023-08-25T04:16:02.764385+0000","last_became_peered":"2023-08-25T04:16:02.764385+0000","last_unstale":"2023-08-25T04:16:04.766191+0000","last_undegraded":"2023-08-25T04:16:04.766191+0000","last_fullsized":"2023-08-25T04:16:04.766191+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:14:15.027029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"50'139","reported_seq":325,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146453+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:16:05.146453+0000","last_peered":"2023-08-25T04:16:05.146453+0000","last_clean":"2023-08-25T04:16:05.146453+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:16:05.146453+0000","last_undegraded":"2023-08-25T04:16:05.146453+0000","last_fullsized":"2023-08-25T04:16:05.146453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:46:40.938989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146893+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:16:05.146893+0000","last_peered":"2023-08-25T04:16:05.146893+0000","last_clean":"2023-08-25T04:16:05.146893+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:16:05.146893+0000","last_undegraded":"2023-08-25T04:16:05.146893+0000","last_fullsized":"2023-08-25T04:16:05.146893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:49:07.625941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148272+0000","last_change":"2023-08-25T04:16:03.759020+0000","last_active":"2023-08-25T04:16:05.148272+0000","last_peered":"2023-08-25T04:16:05.148272+0000","last_clean":"2023-08-25T04:16:05.148272+0000","last_became_active":"2023-08-25T04:16:03.758518+0000","last_became_peered":"2023-08-25T04:16:03.758518+0000","last_unstale":"2023-08-25T04:16:05.148272+0000","last_undegraded":"2023-08-25T04:16:05.148272+0000","last_fullsized":"2023-08-25T04:16:05.148272+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:19:21.561019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146603+0000","last_change":"2023-08-25T04:16:02.763794+0000","last_active":"2023-08-25T04:16:05.146603+0000","last_peered":"2023-08-25T04:16:05.146603+0000","last_clean":"2023-08-25T04:16:05.146603+0000","last_became_active":"2023-08-25T04:16:02.763451+0000","last_became_peered":"2023-08-25T04:16:02.763451+0000","last_unstale":"2023-08-25T04:16:05.146603+0000","last_undegraded":"2023-08-25T04:16:05.146603+0000","last_fullsized":"2023-08-25T04:16:05.146603+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:13:25.432367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":91,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146096+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:16:05.146096+0000","last_peered":"2023-08-25T04:16:05.146096+0000","last_clean":"2023-08-25T04:16:05.146096+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:16:05.146096+0000","last_undegraded":"2023-08-25T04:16:05.146096+0000","last_fullsized":"2023-08-25T04:16:05.146096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:37:15.930053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149282+0000","last_change":"2023-08-25T04:16:03.777176+0000","last_active":"2023-08-25T04:16:05.149282+0000","last_peered":"2023-08-25T04:16:05.149282+0000","last_clean":"2023-08-25T04:16:05.149282+0000","last_became_active":"2023-08-25T04:16:03.776894+0000","last_became_peered":"2023-08-25T04:16:03.776894+0000","last_unstale":"2023-08-25T04:16:05.149282+0000","last_undegraded":"2023-08-25T04:16:05.149282+0000","last_fullsized":"2023-08-25T04:16:05.149282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:50:06.178179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766084+0000","last_change":"2023-08-25T04:16:02.764873+0000","last_active":"2023-08-25T04:16:04.766084+0000","last_peered":"2023-08-25T04:16:04.766084+0000","last_clean":"2023-08-25T04:16:04.766084+0000","last_became_active":"2023-08-25T04:16:02.764527+0000","last_became_peered":"2023-08-25T04:16:02.764527+0000","last_unstale":"2023-08-25T04:16:04.766084+0000","last_undegraded":"2023-08-25T04:16:04.766084+0000","last_fullsized":"2023-08-25T04:16:04.766084+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:47:22.250255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.750200+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:16:04.750200+0000","last_peered":"2023-08-25T04:16:04.750200+0000","last_clean":"2023-08-25T04:16:04.750200+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:16:04.750200+0000","last_undegraded":"2023-08-25T04:16:04.750200+0000","last_fullsized":"2023-08-25T04:16:04.750200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:10:51.922096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146548+0000","last_change":"2023-08-25T04:16:03.759022+0000","last_active":"2023-08-25T04:16:05.146548+0000","last_peered":"2023-08-25T04:16:05.146548+0000","last_clean":"2023-08-25T04:16:05.146548+0000","last_became_active":"2023-08-25T04:16:03.758338+0000","last_became_peered":"2023-08-25T04:16:03.758338+0000","last_unstale":"2023-08-25T04:16:05.146548+0000","last_undegraded":"2023-08-25T04:16:05.146548+0000","last_fullsized":"2023-08-25T04:16:05.146548+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:49:34.866072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"61'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748613+0000","last_change":"2023-08-25T04:16:02.764312+0000","last_active":"2023-08-25T04:16:04.748613+0000","last_peered":"2023-08-25T04:16:04.748613+0000","last_clean":"2023-08-25T04:16:04.748613+0000","last_became_active":"2023-08-25T04:16:02.763932+0000","last_became_peered":"2023-08-25T04:16:02.763932+0000","last_unstale":"2023-08-25T04:16:04.748613+0000","last_undegraded":"2023-08-25T04:16:04.748613+0000","last_fullsized":"2023-08-25T04:16:04.748613+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:47:17.296890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146680+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:16:05.146680+0000","last_peered":"2023-08-25T04:16:05.146680+0000","last_clean":"2023-08-25T04:16:05.146680+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:16:05.146680+0000","last_undegraded":"2023-08-25T04:16:05.146680+0000","last_fullsized":"2023-08-25T04:16:05.146680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:04:15.457844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.766110+0000","last_change":"2023-08-25T04:16:03.786814+0000","last_active":"2023-08-25T04:16:04.766110+0000","last_peered":"2023-08-25T04:16:04.766110+0000","last_clean":"2023-08-25T04:16:04.766110+0000","last_became_active":"2023-08-25T04:16:03.786529+0000","last_became_peered":"2023-08-25T04:16:03.786529+0000","last_unstale":"2023-08-25T04:16:04.766110+0000","last_undegraded":"2023-08-25T04:16:04.766110+0000","last_fullsized":"2023-08-25T04:16:04.766110+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:49:47.826087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748144+0000","last_change":"2023-08-25T04:16:02.759432+0000","last_active":"2023-08-25T04:16:04.748144+0000","last_peered":"2023-08-25T04:16:04.748144+0000","last_clean":"2023-08-25T04:16:04.748144+0000","last_became_active":"2023-08-25T04:16:02.759154+0000","last_became_peered":"2023-08-25T04:16:02.759154+0000","last_unstale":"2023-08-25T04:16:04.748144+0000","last_undegraded":"2023-08-25T04:16:04.748144+0000","last_fullsized":"2023-08-25T04:16:04.748144+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:51:10.937922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148428+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:16:05.148428+0000","last_peered":"2023-08-25T04:16:05.148428+0000","last_clean":"2023-08-25T04:16:05.148428+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:16:05.148428+0000","last_undegraded":"2023-08-25T04:16:05.148428+0000","last_fullsized":"2023-08-25T04:16:05.148428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:10:21.541167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149372+0000","last_change":"2023-08-25T04:16:03.759478+0000","last_active":"2023-08-25T04:16:05.149372+0000","last_peered":"2023-08-25T04:16:05.149372+0000","last_clean":"2023-08-25T04:16:05.149372+0000","last_became_active":"2023-08-25T04:16:03.759151+0000","last_became_peered":"2023-08-25T04:16:03.759151+0000","last_unstale":"2023-08-25T04:16:05.149372+0000","last_undegraded":"2023-08-25T04:16:05.149372+0000","last_fullsized":"2023-08-25T04:16:05.149372+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:56:24.570616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146657+0000","last_change":"2023-08-25T04:16:02.762852+0000","last_active":"2023-08-25T04:16:05.146657+0000","last_peered":"2023-08-25T04:16:05.146657+0000","last_clean":"2023-08-25T04:16:05.146657+0000","last_became_active":"2023-08-25T04:16:02.762449+0000","last_became_peered":"2023-08-25T04:16:02.762449+0000","last_unstale":"2023-08-25T04:16:05.146657+0000","last_undegraded":"2023-08-25T04:16:05.146657+0000","last_fullsized":"2023-08-25T04:16:05.146657+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:36:43.770631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":91,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146693+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:16:05.146693+0000","last_peered":"2023-08-25T04:16:05.146693+0000","last_clean":"2023-08-25T04:16:05.146693+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:16:05.146693+0000","last_undegraded":"2023-08-25T04:16:05.146693+0000","last_fullsized":"2023-08-25T04:16:05.146693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:16:10.221862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.765945+0000","last_change":"2023-08-25T04:16:03.779647+0000","last_active":"2023-08-25T04:16:04.765945+0000","last_peered":"2023-08-25T04:16:04.765945+0000","last_clean":"2023-08-25T04:16:04.765945+0000","last_became_active":"2023-08-25T04:16:03.779369+0000","last_became_peered":"2023-08-25T04:16:03.779369+0000","last_unstale":"2023-08-25T04:16:04.765945+0000","last_undegraded":"2023-08-25T04:16:04.765945+0000","last_fullsized":"2023-08-25T04:16:04.765945+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:40:02.394308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149350+0000","last_change":"2023-08-25T04:16:02.769374+0000","last_active":"2023-08-25T04:16:05.149350+0000","last_peered":"2023-08-25T04:16:05.149350+0000","last_clean":"2023-08-25T04:16:05.149350+0000","last_became_active":"2023-08-25T04:16:02.769064+0000","last_became_peered":"2023-08-25T04:16:02.769064+0000","last_unstale":"2023-08-25T04:16:05.149350+0000","last_undegraded":"2023-08-25T04:16:05.149350+0000","last_fullsized":"2023-08-25T04:16:05.149350+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:40:57.150994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.148840+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:16:05.148840+0000","last_peered":"2023-08-25T04:16:05.148840+0000","last_clean":"2023-08-25T04:16:05.148840+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:16:05.148840+0000","last_undegraded":"2023-08-25T04:16:05.148840+0000","last_fullsized":"2023-08-25T04:16:05.148840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:20:07.819897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.146345+0000","last_change":"2023-08-25T04:16:03.772229+0000","last_active":"2023-08-25T04:16:05.146345+0000","last_peered":"2023-08-25T04:16:05.146345+0000","last_clean":"2023-08-25T04:16:05.146345+0000","last_became_active":"2023-08-25T04:16:03.771917+0000","last_became_peered":"2023-08-25T04:16:03.771917+0000","last_unstale":"2023-08-25T04:16:05.146345+0000","last_undegraded":"2023-08-25T04:16:05.146345+0000","last_fullsized":"2023-08-25T04:16:05.146345+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:02.732077+0000","last_clean_scrub_stamp":"2023-08-25T04:16:02.732077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:35:29.126317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:05.149065+0000","last_change":"2023-08-25T04:16:02.761668+0000","last_active":"2023-08-25T04:16:05.149065+0000","last_peered":"2023-08-25T04:16:05.149065+0000","last_clean":"2023-08-25T04:16:05.149065+0000","last_became_active":"2023-08-25T04:16:02.761013+0000","last_became_peered":"2023-08-25T04:16:02.761013+0000","last_unstale":"2023-08-25T04:16:05.149065+0000","last_undegraded":"2023-08-25T04:16:05.149065+0000","last_fullsized":"2023-08-25T04:16:05.149065+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:16:01.716301+0000","last_clean_scrub_stamp":"2023-08-25T04:16:01.716301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:35:12.106821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":95,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-25T04:16:04.748705+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:16:04.748705+0000","last_peered":"2023-08-25T04:16:04.748705+0000","last_clean":"2023-08-25T04:16:04.748705+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:16:04.748705+0000","last_undegraded":"2023-08-25T04:16:04.748705+0000","last_fullsized":"2023-08-25T04:16:04.748705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:25:05.043329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509603,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58848,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312992,"statfs":{"total":96636764160,"available":96576503808,"internally_reserved":0,"allocated":1331200,"data_stored":940405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72399999999999998,"15min":0.71099999999999997},"min":{"1min":0.57999999999999996,"5min":0.442,"15min":0.29199999999999998},"max":{"1min":0.996,"5min":0.996,"15min":1.0189999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.752,"15min":0.71499999999999997},"min":{"1min":0.58199999999999996,"5min":0.42099999999999999,"15min":0.39000000000000001},"max":{"1min":0.89500000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.67600000000000005}]},{"osd":1,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.55100000000000005,"5min":0.45500000000000002,"15min":0.42699999999999999},"max":{"1min":0.95699999999999996,"5min":1.0149999999999999,"15min":1.034},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76900000000000002,"15min":0.73299999999999998},"min":{"1min":0.59299999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.91700000000000004,"5min":0.98799999999999999,"15min":1.036},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.60499999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.94499999999999995,"5min":1.018,"15min":1.018},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76600000000000001,"15min":0.751},"min":{"1min":0.51500000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94999999999999996,"5min":0.999,"15min":0.999},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.74399999999999999},"min":{"1min":0.57399999999999995,"5min":0.48199999999999998,"15min":0.41899999999999998},"max":{"1min":0.92900000000000005,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.58499999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0449999999999999},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.57099999999999995,"15min":0.59499999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.32400000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.98899999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.628},"min":{"1min":0.48299999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.75600000000000001,"5min":0.82599999999999996,"15min":0.96699999999999997},"last":0.69099999999999995}]},{"osd":5,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.63600000000000001},"min":{"1min":0.438,"5min":0.433,"15min":0.38100000000000001},"max":{"1min":0.77600000000000002,"5min":0.98399999999999999,"15min":0.998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.63,"15min":0.66100000000000003},"min":{"1min":0.45000000000000001,"5min":0.41799999999999998,"15min":0.40000000000000002},"max":{"1min":0.79400000000000004,"5min":0.93799999999999994,"15min":1.0349999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69899999999999995,"15min":0.71199999999999997},"min":{"1min":0.5,"5min":0.498,"15min":0.436},"max":{"1min":0.95699999999999996,"5min":1.0009999999999999,"15min":1.0620000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.68999999999999995},"min":{"1min":0.45100000000000001,"5min":0.433,"15min":0.42399999999999999},"max":{"1min":0.84499999999999997,"5min":0.91700000000000004,"15min":0.98299999999999998},"last":0.78300000000000003}]}]},{"osd":6,"up_from":15,"seq":64424509603,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36064,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335776,"statfs":{"total":96636764160,"available":96599834624,"internally_reserved":0,"allocated":737280,"data_stored":350565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72599999999999998,"15min":0.70699999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.36499999999999999},"max":{"1min":0.93400000000000005,"5min":0.96199999999999997,"15min":1.0369999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.69799999999999995},"min":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.33800000000000002},"max":{"1min":0.96899999999999997,"5min":1.054,"15min":1.071},"last":0.59499999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.751,"15min":0.73299999999999998},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.436},"max":{"1min":1.002,"5min":1.0369999999999999,"15min":1.1559999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.503,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98699999999999999,"5min":1.077,"15min":1.077},"last":0.80800000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.753,"15min":0.749},"min":{"1min":0.52900000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.97999999999999998,"5min":1.1020000000000001,"15min":1.139},"last":0.5},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.81100000000000005,"15min":0.80600000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54400000000000004},"max":{"1min":0.96699999999999997,"5min":1.0469999999999999,"15min":1.117},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.751,"15min":0.74399999999999999},"min":{"1min":0.58799999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.077},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.77400000000000002,"15min":0.77800000000000002},"min":{"1min":0.56000000000000005,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.94999999999999996,"5min":1.0249999999999999,"15min":1.679},"last":0.84099999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58299999999999996,"15min":0.622},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.79200000000000004,"5min":0.93200000000000005,"15min":0.93400000000000005},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57599999999999996,"15min":0.629},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78200000000000003,"5min":0.95799999999999996,"15min":1.306},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.625,"15min":0.68400000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82599999999999996,"5min":1.0329999999999999,"15min":1.123},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71599999999999997,"15min":0.76600000000000001},"min":{"1min":0.443,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.97599999999999998,"5min":1.0209999999999999,"15min":1.5589999999999999},"last":0.86499999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:15:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64900000000000002,"15min":0.68999999999999995},"min":{"1min":0.443,"5min":0.434,"15min":0.434},"max":{"1min":0.82899999999999996,"5min":0.99099999999999999,"15min":1.1950000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.67200000000000004,"15min":0.72599999999999998},"min":{"1min":0.45200000000000001,"5min":0.44700000000000001,"15min":0.41799999999999998},"max":{"1min":0.91200000000000003,"5min":1.012,"15min":1.4099999999999999},"last":0.71299999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542306,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":729088,"data_stored":349913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.70199999999999996,"15min":0.70499999999999996},"min":{"1min":0.40300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.91300000000000003,"5min":0.93700000000000006,"15min":1.018},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.72499999999999998,"15min":0.72999999999999998},"min":{"1min":0.45500000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89500000000000002,"5min":0.995,"15min":1.0409999999999999},"last":0.79600000000000004}]},{"osd":1,"last update":"Fri Aug 25 04:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.45100000000000001,"5min":0.43099999999999999,"15min":0.36499999999999999},"max":{"1min":0.84799999999999998,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.73599999999999999,"15min":0.73299999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.46200000000000002},"max":{"1min":0.95999999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92800000000000005,"5min":0.97499999999999998,"15min":1.0269999999999999},"last":0.626},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.49299999999999999,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":0.94099999999999995,"5min":1.006,"15min":1.2290000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.72699999999999998,"15min":0.73199999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.90700000000000003,"5min":0.94199999999999995,"15min":1.4590000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.94799999999999995,"5min":1.018,"15min":1.1479999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:16:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.41799999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92900000000000005,"5min":0.97099999999999997,"15min":1.038},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60799999999999998,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.623,"15min":0.66900000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.93700000000000006,"5min":1.008,"15min":1.256},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.63100000000000001,"15min":0.67800000000000005},"min":{"1min":0.46400000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.78700000000000003,"5min":0.88700000000000001,"15min":1.4650000000000001},"last":0.81499999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58699999999999997,"15min":0.64700000000000002},"min":{"1min":0.436,"5min":0.375,"15min":0.375},"max":{"1min":0.72299999999999998,"5min":1.032,"15min":1.2769999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68600000000000005,"15min":0.72799999999999998},"min":{"1min":0.51800000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.90000000000000002,"5min":1.048,"15min":1.1819999999999999},"last":0.73699999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542307,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36064,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335776,"statfs":{"total":96636764160,"available":96599834624,"internally_reserved":0,"allocated":733184,"data_stored":350495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.72999999999999998,"15min":0.70199999999999996},"min":{"1min":0.60399999999999998,"5min":0.42299999999999999,"15min":0.32700000000000001},"max":{"1min":0.89000000000000001,"5min":0.99299999999999999,"15min":1.2649999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72499999999999998,"15min":0.69699999999999995},"min":{"1min":0.58899999999999997,"5min":0.48499999999999999,"15min":0.441},"max":{"1min":0.86699999999999999,"5min":0.89900000000000002,"15min":1.1639999999999999},"last":0.81999999999999995}]},{"osd":1,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.747,"15min":0.71399999999999997},"min":{"1min":0.59799999999999998,"5min":0.46400000000000002,"15min":0.36199999999999999},"max":{"1min":0.96499999999999997,"5min":1.0189999999999999,"15min":1.0449999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77000000000000002,"15min":0.74399999999999999},"min":{"1min":0.58899999999999997,"5min":0.56799999999999995,"15min":0.36799999999999999},"max":{"1min":0.95599999999999996,"5min":1.099,"15min":1.099},"last":0.68700000000000006}]},{"osd":2,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78700000000000003,"15min":0.75900000000000001},"min":{"1min":0.66300000000000003,"5min":0.57599999999999996,"15min":0.39100000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77300000000000002,"15min":0.73499999999999999},"min":{"1min":0.67200000000000004,"5min":0.503,"15min":0.34000000000000002},"max":{"1min":0.94599999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.748}]},{"osd":3,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.76800000000000002},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.45100000000000001},"max":{"1min":0.98299999999999998,"5min":1.016,"15min":1.048},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.78000000000000003,"15min":0.76000000000000001},"min":{"1min":0.629,"5min":0.52400000000000002,"15min":0.48399999999999999},"max":{"1min":1.008,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.88300000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.41099999999999998,"5min":0.39400000000000002,"15min":0.32200000000000001},"max":{"1min":0.753,"5min":0.88400000000000001,"15min":0.94899999999999995},"last":0.874},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58699999999999997,"15min":0.60499999999999998},"min":{"1min":0.48299999999999998,"5min":0.38500000000000001,"15min":0.33200000000000002},"max":{"1min":0.73199999999999998,"5min":0.91200000000000003,"15min":0.92100000000000004},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.59399999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.014,"5min":1.0309999999999999,"15min":1.0620000000000001},"last":1.014},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64500000000000002,"15min":0.67000000000000004},"min":{"1min":0.48599999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.874,"5min":0.97499999999999998,"15min":1.026},"last":0.93300000000000005}]},{"osd":7,"last update":"Fri Aug 25 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.621,"15min":0.63500000000000001},"min":{"1min":0.46600000000000003,"5min":0.434,"15min":0.36699999999999999},"max":{"1min":0.87,"5min":0.90400000000000003,"15min":1.0609999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.69699999999999995,"15min":0.72199999999999998},"min":{"1min":0.55400000000000005,"5min":0.498,"15min":0.39300000000000002},"max":{"1min":0.88400000000000001,"5min":0.98399999999999999,"15min":1.0940000000000001},"last":0.96199999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542307,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36068,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335772,"statfs":{"total":96636764160,"available":96599830528,"internally_reserved":0,"allocated":745472,"data_stored":351547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46000000000000002,"15min":0.442},"min":{"1min":0.34499999999999997,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.56699999999999995,"5min":0.747,"15min":0.96899999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51800000000000002,"15min":0.50600000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.77100000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.497,"15min":0.48699999999999999},"min":{"1min":0.34699999999999998,"5min":0.33600000000000002,"15min":0.27000000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.746},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61099999999999999,"15min":0.58999999999999997},"min":{"1min":0.47199999999999998,"5min":0.41799999999999998,"15min":0.38500000000000001},"max":{"1min":0.76500000000000001,"5min":0.85799999999999998,"15min":0.92600000000000005},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57799999999999996,"15min":0.56499999999999995},"min":{"1min":0.41799999999999998,"5min":0.40600000000000003,"15min":0.34699999999999998},"max":{"1min":0.67300000000000004,"5min":1.01,"15min":1.01},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55400000000000005,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.379,"15min":0.35299999999999998},"max":{"1min":0.67700000000000005,"5min":0.81699999999999995,"15min":0.89600000000000002},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78100000000000003,"15min":0.75600000000000001},"min":{"1min":0.57999999999999996,"5min":0.53100000000000003,"15min":0.46800000000000003},"max":{"1min":1.214,"5min":1.214,"15min":1.4339999999999999},"last":0.621},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.81299999999999994},"min":{"1min":0.63800000000000001,"5min":0.59399999999999997,"15min":0.48899999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.343},"last":0.69799999999999995}]},{"osd":5,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79500000000000004,"15min":0.78500000000000003},"min":{"1min":0.61199999999999999,"5min":0.52900000000000003,"15min":0.51500000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.321},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80900000000000005,"15min":0.79500000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.48099999999999998},"max":{"1min":1.181,"5min":1.181,"15min":1.4750000000000001},"last":0.79800000000000004}]},{"osd":6,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.83499999999999996,"15min":0.80800000000000005},"min":{"1min":0.60399999999999998,"5min":0.55300000000000005,"15min":0.53100000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.2010000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.61199999999999999,"5min":0.52000000000000002,"15min":0.50700000000000001},"max":{"1min":1.0800000000000001,"5min":1.097,"15min":1.3600000000000001},"last":0.84399999999999997}]},{"osd":7,"last update":"Fri Aug 25 04:15:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.85199999999999998,"15min":0.83999999999999997},"min":{"1min":0.66200000000000003,"5min":0.60899999999999999,"15min":0.57099999999999995},"max":{"1min":1.077,"5min":1.1080000000000001,"15min":1.383},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80900000000000005,"15min":0.79500000000000004},"min":{"1min":0.58299999999999996,"5min":0.55600000000000005,"15min":0.54000000000000004},"max":{"1min":1.0669999999999999,"5min":1.1160000000000001,"15min":1.4019999999999999},"last":0.76000000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542308,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54116,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317724,"statfs":{"total":96636764160,"available":96581349376,"internally_reserved":0,"allocated":741376,"data_stored":351525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.315,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":1.196},"last":0.373},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.498,"15min":0.496},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69499999999999995,"5min":0.75600000000000001,"15min":1.4019999999999999},"last":0.59699999999999998}]},{"osd":1,"last update":"Fri Aug 25 04:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.32900000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.69599999999999995,"5min":0.78800000000000003,"15min":1.482},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.36699999999999999},"max":{"1min":0.77300000000000002,"5min":0.81599999999999995,"15min":1.458},"last":0.48699999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.36499999999999999,"5min":0.35499999999999998,"15min":0.34499999999999997},"max":{"1min":0.82199999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56999999999999995,"15min":0.55700000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.33700000000000002},"max":{"1min":0.80200000000000005,"5min":0.85399999999999998,"15min":0.95599999999999996},"last":0.46200000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81200000000000006,"15min":0.79800000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.499},"max":{"1min":1.1990000000000001,"5min":1.2330000000000001,"15min":1.2569999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.5509999999999999},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.80900000000000005,"15min":0.80100000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.47999999999999998},"max":{"1min":1.1080000000000001,"5min":1.1140000000000001,"15min":1.2789999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.58999999999999997,"5min":0.56699999999999995,"15min":0.48299999999999998},"max":{"1min":1.2130000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.83199999999999996,"15min":0.83499999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.871,"15min":0.85199999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.55600000000000005},"max":{"1min":1.25,"5min":1.278,"15min":1.375},"last":0.76200000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:16:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.49199999999999999},"max":{"1min":1.0860000000000001,"5min":1.2090000000000001,"15min":1.339},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.81899999999999995,"15min":0.81200000000000006},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1839999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.70999999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542308,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":737280,"data_stored":350073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46999999999999997,"15min":0.47099999999999997},"min":{"1min":0.33300000000000002,"5min":0.28399999999999997,"15min":0.27400000000000002},"max":{"1min":0.68999999999999995,"5min":0.85599999999999998,"15min":1.218},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.54000000000000004,"15min":0.52000000000000002},"min":{"1min":0.36699999999999999,"5min":0.313,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":0.93300000000000005,"15min":1.153},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51100000000000001,"15min":0.504},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.30599999999999999},"max":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":1.347},"last":0.375},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.48099999999999998,"5min":0.40000000000000002,"15min":0.36499999999999999},"max":{"1min":0.76000000000000001,"5min":1.02,"15min":1.093},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63600000000000001,"15min":0.623},"min":{"1min":0.46800000000000003,"5min":0.45300000000000001,"15min":0.40699999999999997},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":1.1459999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.41299999999999998,"5min":0.371,"15min":0.33200000000000002},"max":{"1min":0.78500000000000003,"5min":0.84799999999999998,"15min":1.2190000000000001},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80800000000000005,"15min":0.79400000000000004},"min":{"1min":0.56799999999999995,"5min":0.51600000000000001,"15min":0.45800000000000002},"max":{"1min":1.204,"5min":1.204,"15min":1.47},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83899999999999997,"15min":0.82399999999999995},"min":{"1min":0.57799999999999996,"5min":0.54800000000000004,"15min":0.504},"max":{"1min":1.1830000000000001,"5min":1.244,"15min":1.395},"last":0.78800000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.82999999999999996,"15min":0.80600000000000005},"min":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.45100000000000001},"max":{"1min":1.1579999999999999,"5min":1.2090000000000001,"15min":1.292},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.83399999999999996,"15min":0.83299999999999996},"min":{"1min":0.64100000000000001,"5min":0.54700000000000004,"15min":0.51000000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.82799999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85299999999999998,"15min":0.85199999999999998},"min":{"1min":0.63500000000000001,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.569},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.83199999999999996,"15min":0.81399999999999995},"min":{"1min":0.67800000000000005,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.355},"last":0.877}]},{"osd":7,"last update":"Fri Aug 25 04:15:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83999999999999997,"15min":0.82999999999999996},"min":{"1min":0.65400000000000003,"5min":0.59299999999999997,"15min":0.56799999999999995},"max":{"1min":1.1240000000000001,"5min":1.2949999999999999,"15min":1.5429999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.876,"15min":0.85599999999999998},"min":{"1min":0.69699999999999995,"5min":0.65700000000000003,"15min":0.54500000000000004},"max":{"1min":1.1140000000000001,"5min":1.3120000000000001,"15min":1.504},"last":0.88400000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542306,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1331200,"data_stored":940337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48199999999999998,"15min":0.48299999999999998},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.26800000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.79500000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.55800000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":3.5089999999999999,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70699999999999996,"5min":0.90300000000000002,"15min":0.97499999999999998},"last":0.377},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.55900000000000005,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":3.4590000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.49399999999999999,"15min":0.495},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66000000000000003,"5min":0.79800000000000004,"15min":1.266},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76300000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.504}]},{"osd":4,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78200000000000003,"15min":0.79500000000000004},"min":{"1min":0.52600000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.306},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.79500000000000004,"15min":0.80400000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.436},"max":{"1min":1.028,"5min":1.131,"15min":1.262},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.528,"5min":3.528,"15min":3.528},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.79900000000000004,"15min":0.81399999999999995},"min":{"1min":0.47199999999999998,"5min":0.46999999999999997,"15min":0.45500000000000002},"max":{"1min":0.94599999999999995,"5min":1.2230000000000001,"15min":1.373},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.81699999999999995,"15min":0.80400000000000005},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.53000000000000003},"max":{"1min":3.4870000000000001,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.82699999999999996,"15min":0.82599999999999996},"min":{"1min":0.55400000000000005,"5min":0.54800000000000004,"15min":0.47399999999999998},"max":{"1min":1.0329999999999999,"5min":1.194,"15min":1.331},"last":0.77100000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:16:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.61799999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.093,"5min":1.1659999999999999,"15min":1.4059999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.80300000000000005,"15min":0.81200000000000006},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.499},"max":{"1min":1.1220000000000001,"5min":1.1930000000000001,"15min":1.3169999999999999},"last":0.80600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:16:12.821 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-25T04:16:12.822 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-25T04:16:13.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.005+0000 7f6339fdb640 1 Processor -- start 2023-08-25T04:16:13.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.005+0000 7f6339fdb640 1 -- start start 2023-08-25T04:16:13.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.005+0000 7f6339fdb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f63340cdd80 0x7f633415ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:13.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.005+0000 7f6339fdb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f633415a9f0 0x7f633415ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:13.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.005+0000 7f6339fdb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f63340ce160 0x7f63340cc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:13.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.005+0000 7f6339fdb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633415bf80 con 0x7f63340ce160 2023-08-25T04:16:13.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.005+0000 7f6339fdb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633415f280 con 0x7f63340cdd80 2023-08-25T04:16:13.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.005+0000 7f6339fdb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6334065b10 con 0x7f633415a9f0 2023-08-25T04:16:13.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.005+0000 7f6333fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f63340ce160 0x7f63340cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:13.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.005+0000 7f6333fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f63340ce160 0x7f63340cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35018/0 (socket says 172.21.15.55:35018) 2023-08-25T04:16:13.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.005+0000 7f6333fff640 1 -- 172.21.15.55:0/1820347701 learned_addr learned my addr 172.21.15.55:0/1820347701 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:13.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.005+0000 7f63337fe640 1 --2- 172.21.15.55:0/1820347701 >> v2:172.21.15.110:3300/0 conn(0x7f63340cdd80 0x7f633415ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:13.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.005+0000 7f6332ffd640 1 --2- 172.21.15.55:0/1820347701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f633415a9f0 0x7f633415ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:13.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.005+0000 7f6333fff640 1 -- 172.21.15.55:0/1820347701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f633415a9f0 msgr2=0x7f633415ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:13.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.005+0000 7f6333fff640 1 --2- 172.21.15.55:0/1820347701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f633415a9f0 0x7f633415ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.005+0000 7f6333fff640 1 -- 172.21.15.55:0/1820347701 >> v2:172.21.15.110:3300/0 conn(0x7f63340cdd80 msgr2=0x7f633415ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:13.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.005+0000 7f6333fff640 1 --2- 172.21.15.55:0/1820347701 >> v2:172.21.15.110:3300/0 conn(0x7f63340cdd80 0x7f633415ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.005+0000 7f6333fff640 1 -- 172.21.15.55:0/1820347701 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6334065830 con 0x7f63340ce160 2023-08-25T04:16:13.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.009+0000 7f6333fff640 1 --2- 172.21.15.55:0/1820347701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63340ce160 0x7f63340cc780 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f633406e100 tx=0x7f632c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4c3e693dfd87e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:13.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.009+0000 7f63327fc640 1 -- 172.21.15.55:0/1820347701 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c0a5760 con 0x7f63340ce160 2023-08-25T04:16:13.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.009+0000 7f63327fc640 1 -- 172.21.15.55:0/1820347701 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c0a58c0 con 0x7f63340ce160 2023-08-25T04:16:13.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.009+0000 7f63327fc640 1 -- 172.21.15.55:0/1820347701 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c0a5c50 con 0x7f63340ce160 2023-08-25T04:16:13.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.009+0000 7f6339fdb640 1 -- 172.21.15.55:0/1820347701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63340ce160 msgr2=0x7f63340cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:13.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.009+0000 7f6339fdb640 1 --2- 172.21.15.55:0/1820347701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63340ce160 0x7f63340cc780 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f633406e100 tx=0x7f632c01c8e0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.009+0000 7f6339fdb640 1 -- 172.21.15.55:0/1820347701 shutdown_connections 2023-08-25T04:16:13.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.009+0000 7f6339fdb640 1 --2- 172.21.15.55:0/1820347701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63340ce160 0x7f63340cc780 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.009+0000 7f6339fdb640 1 --2- 172.21.15.55:0/1820347701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f633415a9f0 0x7f633415ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.009+0000 7f6339fdb640 1 --2- 172.21.15.55:0/1820347701 >> v2:172.21.15.110:3300/0 conn(0x7f63340cdd80 0x7f633415ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.009+0000 7f6339fdb640 1 -- 172.21.15.55:0/1820347701 >> 172.21.15.55:0/1820347701 conn(0x7f63340b06a0 msgr2=0x7f63340b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:13.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.009+0000 7f6339fdb640 1 -- 172.21.15.55:0/1820347701 shutdown_connections 2023-08-25T04:16:13.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.009+0000 7f6339fdb640 1 -- 172.21.15.55:0/1820347701 wait complete. 2023-08-25T04:16:13.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f6339fdb640 1 Processor -- start 2023-08-25T04:16:13.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f6339fdb640 1 -- start start 2023-08-25T04:16:13.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f6339fdb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63340cdd80 0x7f63340ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:13.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f6339fdb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63340ce160 0x7f6334164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:13.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f6339fdb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f633415a9f0 0x7f63341537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:13.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f6339fdb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633415eb30 con 0x7f63340cdd80 2023-08-25T04:16:13.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f6339fdb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63340af8f0 con 0x7f633415a9f0 2023-08-25T04:16:13.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f6339fdb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633415e4e0 con 0x7f63340ce160 2023-08-25T04:16:13.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f63337fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63340cdd80 0x7f63340ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:13.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f63337fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63340cdd80 0x7f63340ca9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35020/0 (socket says 172.21.15.55:35020) 2023-08-25T04:16:13.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f63337fe640 1 -- 172.21.15.55:0/3457196058 learned_addr learned my addr 172.21.15.55:0/3457196058 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:13.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f6333fff640 1 --2- 172.21.15.55:0/3457196058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f633415a9f0 0x7f63341537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:13.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f6332ffd640 1 --2- 172.21.15.55:0/3457196058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63340ce160 0x7f6334164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:13.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f63337fe640 1 -- 172.21.15.55:0/3457196058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63340ce160 msgr2=0x7f6334164ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:13.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f63337fe640 1 --2- 172.21.15.55:0/3457196058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63340ce160 0x7f6334164ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f63337fe640 1 -- 172.21.15.55:0/3457196058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f633415a9f0 msgr2=0x7f63341537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:13.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f63337fe640 1 --2- 172.21.15.55:0/3457196058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f633415a9f0 0x7f63341537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f63337fe640 1 -- 172.21.15.55:0/3457196058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c009b30 con 0x7f63340cdd80 2023-08-25T04:16:13.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f63337fe640 1 --2- 172.21.15.55:0/3457196058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63340cdd80 0x7f63340ca9e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f632400d800 tx=0x7f632400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:13.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f631bfff640 1 -- 172.21.15.55:0/3457196058 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63240096a0 con 0x7f63340cdd80 2023-08-25T04:16:13.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f631bfff640 1 -- 172.21.15.55:0/3457196058 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6324009800 con 0x7f63340cdd80 2023-08-25T04:16:13.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f631bfff640 1 -- 172.21.15.55:0/3457196058 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6324009990 con 0x7f63340cdd80 2023-08-25T04:16:13.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f6339fdb640 1 -- 172.21.15.55:0/3457196058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633415e7c0 con 0x7f63340cdd80 2023-08-25T04:16:13.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f6339fdb640 1 -- 172.21.15.55:0/3457196058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633415e100 con 0x7f63340cdd80 2023-08-25T04:16:13.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.013+0000 7f6339fdb640 1 -- 172.21.15.55:0/3457196058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63340c9870 con 0x7f63340cdd80 2023-08-25T04:16:13.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.017+0000 7f631bfff640 1 -- 172.21.15.55:0/3457196058 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f6324009af0 con 0x7f63340cdd80 2023-08-25T04:16:13.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.017+0000 7f631bfff640 1 --2- 172.21.15.55:0/3457196058 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f63200657d0 0x7f6320067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:13.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.017+0000 7f631bfff640 1 -- 172.21.15.55:0/3457196058 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f63240832f0 con 0x7f63340cdd80 2023-08-25T04:16:13.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.017+0000 7f6332ffd640 1 --2- 172.21.15.55:0/3457196058 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f63200657d0 0x7f6320067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:13.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.017+0000 7f6332ffd640 1 --2- 172.21.15.55:0/3457196058 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f63200657d0 0x7f6320067c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6334071350 tx=0x7f6328008040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:13.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.021+0000 7f631bfff640 1 -- 172.21.15.55:0/3457196058 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6324050d50 con 0x7f63340cdd80 2023-08-25T04:16:13.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.229+0000 7f6339fdb640 1 -- 172.21.15.55:0/3457196058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f633415e950 con 0x7f63340cdd80 2023-08-25T04:16:13.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.241+0000 7f631bfff640 1 -- 172.21.15.55:0/3457196058 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f6324054370 con 0x7f63340cdd80 2023-08-25T04:16:13.240 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2023-08-25T04:16:13.240 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g== 2023-08-25T04:16:13.240 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2023-08-25T04:16:13.240 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2023-08-25T04:16:13.240 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-25T04:16:13.241 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-08-25T04:16:13.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.241+0000 7f6339fdb640 1 -- 172.21.15.55:0/3457196058 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f63200657d0 msgr2=0x7f6320067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:13.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.241+0000 7f6339fdb640 1 --2- 172.21.15.55:0/3457196058 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f63200657d0 0x7f6320067c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6334071350 tx=0x7f6328008040 comp rx=0 tx=0).stop 2023-08-25T04:16:13.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.241+0000 7f6339fdb640 1 -- 172.21.15.55:0/3457196058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63340cdd80 msgr2=0x7f63340ca9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:13.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.241+0000 7f6339fdb640 1 --2- 172.21.15.55:0/3457196058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63340cdd80 0x7f63340ca9e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f632400d800 tx=0x7f632400dcc0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.241+0000 7f6339fdb640 1 -- 172.21.15.55:0/3457196058 shutdown_connections 2023-08-25T04:16:13.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.241+0000 7f6339fdb640 1 --2- 172.21.15.55:0/3457196058 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f63200657d0 0x7f6320067c90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.241+0000 7f6339fdb640 1 --2- 172.21.15.55:0/3457196058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f633415a9f0 0x7f63341537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.241+0000 7f6339fdb640 1 --2- 172.21.15.55:0/3457196058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63340ce160 0x7f6334164ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.241+0000 7f6339fdb640 1 --2- 172.21.15.55:0/3457196058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63340cdd80 0x7f63340ca9e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.241+0000 7f6339fdb640 1 -- 172.21.15.55:0/3457196058 >> 172.21.15.55:0/3457196058 conn(0x7f63340b06a0 msgr2=0x7f6334159970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:13.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.241+0000 7f6339fdb640 1 -- 172.21.15.55:0/3457196058 shutdown_connections 2023-08-25T04:16:13.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.241+0000 7f6339fdb640 1 -- 172.21.15.55:0/3457196058 wait complete. 2023-08-25T04:16:13.260 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:16:13.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.405+0000 7fe2bdb00640 1 Processor -- start 2023-08-25T04:16:13.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.405+0000 7fe2bdb00640 1 -- start start 2023-08-25T04:16:13.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.405+0000 7fe2bdb00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2b80d0da0 0x7fe2b80d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:13.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.405+0000 7fe2bdb00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe2b80b3e50 0x7fe2b80ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:13.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.405+0000 7fe2bdb00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b80b29b0 con 0x7fe2b80cdde0 2023-08-25T04:16:13.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.405+0000 7fe2bdb00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b80ce760 con 0x7fe2b80b3e50 2023-08-25T04:16:13.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.405+0000 7fe2bdb00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b80d16c0 con 0x7fe2b80d0da0 2023-08-25T04:16:13.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.405+0000 7fe2b7fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe2b80b3e50 0x7fe2b80ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:13.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.405+0000 7fe2b77fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2b80d0da0 0x7fe2b80d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:13.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.405+0000 7fe2b7fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe2b80b3e50 0x7fe2b80ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:41988/0 (socket says 172.21.15.55:41988) 2023-08-25T04:16:13.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.405+0000 7fe2b7fff640 1 -- 172.21.15.55:0/302821023 learned_addr learned my addr 172.21.15.55:0/302821023 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:13.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.405+0000 7fe2b7fff640 1 -- 172.21.15.55:0/302821023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2b80d0da0 msgr2=0x7fe2b80d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:13.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.405+0000 7fe2b7fff640 1 --2- 172.21.15.55:0/302821023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2b80d0da0 0x7fe2b80d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.405+0000 7fe2b7fff640 1 -- 172.21.15.55:0/302821023 >> v1:172.21.15.110:6789/0 conn(0x7fe2b80cdde0 legacy=0x7fe2b80cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:13.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.405+0000 7fe2b6ffd640 1 -- 172.21.15.55:0/302821023 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173489208 0 0) 0x7fe2b80b29b0 con 0x7fe2b80cdde0 2023-08-25T04:16:13.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.405+0000 7fe2b7fff640 1 -- 172.21.15.55:0/302821023 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b80b1dc0 con 0x7fe2b80b3e50 2023-08-25T04:16:13.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.405+0000 7fe2b77fe640 1 --2- 172.21.15.55:0/302821023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2b80d0da0 0x7fe2b80d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:16:13.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.409+0000 7fe2b7fff640 1 --2- 172.21.15.55:0/302821023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2b80b3e50 0x7fe2b80ce220 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0009e50 tx=0x7fe2b001f1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=954228327fb3dabe server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:13.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.409+0000 7fe2b6ffd640 1 -- 172.21.15.55:0/302821023 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b00af400 con 0x7fe2b80b3e50 2023-08-25T04:16:13.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.409+0000 7fe2b6ffd640 1 -- 172.21.15.55:0/302821023 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b00ab050 con 0x7fe2b80b3e50 2023-08-25T04:16:13.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.409+0000 7fe2b6ffd640 1 -- 172.21.15.55:0/302821023 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b00af780 con 0x7fe2b80b3e50 2023-08-25T04:16:13.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.409+0000 7fe2bdb00640 1 -- 172.21.15.55:0/302821023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2b80b3e50 msgr2=0x7fe2b80ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:13.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.409+0000 7fe2bdb00640 1 --2- 172.21.15.55:0/302821023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2b80b3e50 0x7fe2b80ce220 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0009e50 tx=0x7fe2b001f1f0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.409+0000 7fe2bdb00640 1 -- 172.21.15.55:0/302821023 shutdown_connections 2023-08-25T04:16:13.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.409+0000 7fe2bdb00640 1 --2- 172.21.15.55:0/302821023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2b80b3e50 0x7fe2b80ce220 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.409+0000 7fe2bdb00640 1 --2- 172.21.15.55:0/302821023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2b80d0da0 0x7fe2b80d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.409+0000 7fe2bdb00640 1 -- 172.21.15.55:0/302821023 >> 172.21.15.55:0/302821023 conn(0x7fe2b809bae0 msgr2=0x7fe2b80d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:13.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.409+0000 7fe2bdb00640 1 -- 172.21.15.55:0/302821023 shutdown_connections 2023-08-25T04:16:13.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.409+0000 7fe2bdb00640 1 -- 172.21.15.55:0/302821023 wait complete. 2023-08-25T04:16:13.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2bdb00640 1 Processor -- start 2023-08-25T04:16:13.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2bdb00640 1 -- start start 2023-08-25T04:16:13.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2bdb00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2b80b3e50 0x7fe2b815f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:13.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2bdb00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2b80cdde0 0x7fe2b80ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:13.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2bdb00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b80d0da0 0x7fe2b80b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:13.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2bdb00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b80cc640 con 0x7fe2b80d0da0 2023-08-25T04:16:13.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2bdb00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b80cba30 con 0x7fe2b80cdde0 2023-08-25T04:16:13.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2bdb00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b80cbd10 con 0x7fe2b80b3e50 2023-08-25T04:16:13.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2b7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b80d0da0 0x7fe2b80b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:13.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2b7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b80d0da0 0x7fe2b80b0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35030/0 (socket says 172.21.15.55:35030) 2023-08-25T04:16:13.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2b7fff640 1 -- 172.21.15.55:0/2837405130 learned_addr learned my addr 172.21.15.55:0/2837405130 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:13.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2b77fe640 1 --2- 172.21.15.55:0/2837405130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2b80b3e50 0x7fe2b815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:13.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2affff640 1 --2- 172.21.15.55:0/2837405130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2b80cdde0 0x7fe2b80ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2b7fff640 1 -- 172.21.15.55:0/2837405130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2b80b3e50 msgr2=0x7fe2b815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2b7fff640 1 --2- 172.21.15.55:0/2837405130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2b80b3e50 0x7fe2b815f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2b7fff640 1 -- 172.21.15.55:0/2837405130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2b80cdde0 msgr2=0x7fe2b80ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2b7fff640 1 --2- 172.21.15.55:0/2837405130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2b80cdde0 0x7fe2b80ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2b7fff640 1 -- 172.21.15.55:0/2837405130 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a80093b0 con 0x7fe2b80d0da0 2023-08-25T04:16:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2b7fff640 1 --2- 172.21.15.55:0/2837405130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b80d0da0 0x7fe2b80b0470 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe2b001d8a0 tx=0x7fe2b001bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2b4ff9640 1 -- 172.21.15.55:0/2837405130 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b00bf070 con 0x7fe2b80d0da0 2023-08-25T04:16:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2b4ff9640 1 -- 172.21.15.55:0/2837405130 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b00afa30 con 0x7fe2b80d0da0 2023-08-25T04:16:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2b4ff9640 1 -- 172.21.15.55:0/2837405130 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b00afdc0 con 0x7fe2b80d0da0 2023-08-25T04:16:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2bdb00640 1 -- 172.21.15.55:0/2837405130 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b0009b30 con 0x7fe2b80d0da0 2023-08-25T04:16:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.413+0000 7fe2bdb00640 1 -- 172.21.15.55:0/2837405130 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b80cc2d0 con 0x7fe2b80d0da0 2023-08-25T04:16:13.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.417+0000 7fe2bdb00640 1 -- 172.21.15.55:0/2837405130 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b815d4f0 con 0x7fe2b80d0da0 2023-08-25T04:16:13.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.417+0000 7fe2b4ff9640 1 -- 172.21.15.55:0/2837405130 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fe2b00b6070 con 0x7fe2b80d0da0 2023-08-25T04:16:13.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.417+0000 7fe2b4ff9640 1 --2- 172.21.15.55:0/2837405130 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fe2980657a0 0x7fe298067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:13.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.417+0000 7fe2b4ff9640 1 -- 172.21.15.55:0/2837405130 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe2b01206d0 con 0x7fe2b80d0da0 2023-08-25T04:16:13.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.417+0000 7fe2b77fe640 1 --2- 172.21.15.55:0/2837405130 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fe2980657a0 0x7fe298067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:13.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.417+0000 7fe2b77fe640 1 --2- 172.21.15.55:0/2837405130 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fe2980657a0 0x7fe298067c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe2b815d2e0 tx=0x7fe2a8006f90 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:13.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.421+0000 7fe2b4ff9640 1 -- 172.21.15.55:0/2837405130 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe2b00ee010 con 0x7fe2b80d0da0 2023-08-25T04:16:13.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.609+0000 7fe2bdb00640 1 -- 172.21.15.55:0/2837405130 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2b80b2610 con 0x7fe2b80d0da0 2023-08-25T04:16:13.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.609+0000 7fe2b4ff9640 1 -- 172.21.15.55:0/2837405130 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4875 (secure 0 0 0) 0x7fe2b00f1630 con 0x7fe2b80d0da0 2023-08-25T04:16:13.611 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:16:13.611 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3163426480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3163426480},{"type":"v1","addr":"172.21.15.55:6835","nonce":3163426480}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/397210265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":397210265},{"type":"v1","addr":"172.21.15.110:6836","nonce":397210265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6198,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/894580528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":894580528},{"type":"v1","addr":"172.21.15.55:6834","nonce":894580528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:16:03.155108+0000","modified":"2023-08-25T04:16:06.786907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6837/1578265172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1578265172},{"type":"v1","addr":"172.21.15.110:6837","nonce":1578265172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-25T04:16:13.611 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 24 2023-08-25T04:16:13.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.613+0000 7fe2bdb00640 1 -- 172.21.15.55:0/2837405130 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fe2980657a0 msgr2=0x7fe298067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:13.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.613+0000 7fe2bdb00640 1 --2- 172.21.15.55:0/2837405130 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fe2980657a0 0x7fe298067c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe2b815d2e0 tx=0x7fe2a8006f90 comp rx=0 tx=0).stop 2023-08-25T04:16:13.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.613+0000 7fe2bdb00640 1 -- 172.21.15.55:0/2837405130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b80d0da0 msgr2=0x7fe2b80b0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:13.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.613+0000 7fe2bdb00640 1 --2- 172.21.15.55:0/2837405130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b80d0da0 0x7fe2b80b0470 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe2b001d8a0 tx=0x7fe2b001bf90 comp rx=0 tx=0).stop 2023-08-25T04:16:13.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.613+0000 7fe2bdb00640 1 -- 172.21.15.55:0/2837405130 shutdown_connections 2023-08-25T04:16:13.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.613+0000 7fe2bdb00640 1 --2- 172.21.15.55:0/2837405130 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fe2980657a0 0x7fe298067c60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.613+0000 7fe2bdb00640 1 --2- 172.21.15.55:0/2837405130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2b80d0da0 0x7fe2b80b0470 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.613+0000 7fe2bdb00640 1 --2- 172.21.15.55:0/2837405130 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2b80cdde0 0x7fe2b80ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.613+0000 7fe2bdb00640 1 --2- 172.21.15.55:0/2837405130 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2b80b3e50 0x7fe2b815f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:13.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.613+0000 7fe2bdb00640 1 -- 172.21.15.55:0/2837405130 >> 172.21.15.55:0/2837405130 conn(0x7fe2b809bae0 msgr2=0x7fe2b80cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:13.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.613+0000 7fe2bdb00640 1 -- 172.21.15.55:0/2837405130 shutdown_connections 2023-08-25T04:16:13.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:13.613+0000 7fe2bdb00640 1 -- 172.21.15.55:0/2837405130 wait complete. 2023-08-25T04:16:14.034 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-25T04:16:03.155108+0000', 'modified': '2023-08-25T04:16:06.786907+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6207}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6207': {'gid': 6207, 'name': 'b', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.110:6837/1578265172', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6835', 'nonce': 1578265172}, {'type': 'v1', 'addr': '172.21.15.110:6837', 'nonce': 1578265172}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-25T04:16:14.035 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-25T04:16:14.035 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-25T04:16:14.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.185+0000 7f781ffac640 1 Processor -- start 2023-08-25T04:16:14.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.185+0000 7f781ffac640 1 -- start start 2023-08-25T04:16:14.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.185+0000 7f781ffac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f781815c9c0 0x7f7818160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.185+0000 7f781ffac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78180cfa70 0x7f7818160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.185+0000 7f781ffac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781806eaf0 con 0x7f7818160f90 2023-08-25T04:16:14.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.185+0000 7f781ffac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781806e530 con 0x7f781815c9c0 2023-08-25T04:16:14.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.185+0000 7f781ffac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781806e810 con 0x7f78180cfa70 2023-08-25T04:16:14.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.185+0000 7f781dd48640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f781815c9c0 0x7f7818160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.185+0000 7f781dd48640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f781815c9c0 0x7f7818160510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35040/0 (socket says 172.21.15.55:35040) 2023-08-25T04:16:14.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.185+0000 7f781dd48640 1 -- 172.21.15.55:0/2540651334 learned_addr learned my addr 172.21.15.55:0/2540651334 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:14.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.185+0000 7f781d547640 1 --2- 172.21.15.55:0/2540651334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78180cfa70 0x7f7818160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.185+0000 7f781dd48640 1 -- 172.21.15.55:0/2540651334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78180cfa70 msgr2=0x7f7818160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:14.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.185+0000 7f781dd48640 1 --2- 172.21.15.55:0/2540651334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78180cfa70 0x7f7818160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.185+0000 7f781dd48640 1 -- 172.21.15.55:0/2540651334 >> v1:172.21.15.55:6789/0 conn(0x7f7818160f90 legacy=0x7f78180ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:14.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.185+0000 7f781dd48640 1 -- 172.21.15.55:0/2540651334 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781806aab0 con 0x7f781815c9c0 2023-08-25T04:16:14.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.189+0000 7f781dd48640 1 --2- 172.21.15.55:0/2540651334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f781815c9c0 0x7f7818160510 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7814009ea0 tx=0x7f781401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d7807a190adc6d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:14.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.189+0000 7f781cd46640 1 -- 172.21.15.55:0/2540651334 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78140a5800 con 0x7f781815c9c0 2023-08-25T04:16:14.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.189+0000 7f781cd46640 1 -- 172.21.15.55:0/2540651334 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78140a5960 con 0x7f781815c9c0 2023-08-25T04:16:14.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.189+0000 7f781cd46640 1 -- 172.21.15.55:0/2540651334 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78140a5cf0 con 0x7f781815c9c0 2023-08-25T04:16:14.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.189+0000 7f781ffac640 1 -- 172.21.15.55:0/2540651334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f781815c9c0 msgr2=0x7f7818160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:14.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.189+0000 7f781ffac640 1 --2- 172.21.15.55:0/2540651334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f781815c9c0 0x7f7818160510 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7814009ea0 tx=0x7f781401ca20 comp rx=0 tx=0).stop 2023-08-25T04:16:14.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.189+0000 7f781ffac640 1 -- 172.21.15.55:0/2540651334 shutdown_connections 2023-08-25T04:16:14.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.189+0000 7f781ffac640 1 --2- 172.21.15.55:0/2540651334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78180cfa70 0x7f7818160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.189+0000 7f781ffac640 1 --2- 172.21.15.55:0/2540651334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f781815c9c0 0x7f7818160510 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.189+0000 7f781ffac640 1 -- 172.21.15.55:0/2540651334 >> 172.21.15.55:0/2540651334 conn(0x7f78180d05a0 msgr2=0x7f78180d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:14.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.189+0000 7f781ffac640 1 -- 172.21.15.55:0/2540651334 shutdown_connections 2023-08-25T04:16:14.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.189+0000 7f781ffac640 1 -- 172.21.15.55:0/2540651334 wait complete. 2023-08-25T04:16:14.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.189+0000 7f781ffac640 1 Processor -- start 2023-08-25T04:16:14.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781ffac640 1 -- start start 2023-08-25T04:16:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781ffac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78180cfa70 0x7f78180c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781ffac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f781815c9c0 0x7f7818151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781ffac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7818160f90 0x7f7818150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781ffac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78181523a0 con 0x7f78180cfa70 2023-08-25T04:16:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781ffac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7818151580 con 0x7f781815c9c0 2023-08-25T04:16:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781ffac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7818151820 con 0x7f7818160f90 2023-08-25T04:16:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781dd48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78180cfa70 0x7f78180c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781dd48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78180cfa70 0x7f78180c6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35048/0 (socket says 172.21.15.55:35048) 2023-08-25T04:16:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781dd48640 1 -- 172.21.15.55:0/550309352 learned_addr learned my addr 172.21.15.55:0/550309352 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781e549640 1 --2- 172.21.15.55:0/550309352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7818160f90 0x7f7818150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781d547640 1 --2- 172.21.15.55:0/550309352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f781815c9c0 0x7f7818151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781dd48640 1 -- 172.21.15.55:0/550309352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7818160f90 msgr2=0x7f7818150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781dd48640 1 --2- 172.21.15.55:0/550309352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7818160f90 0x7f7818150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781dd48640 1 -- 172.21.15.55:0/550309352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f781815c9c0 msgr2=0x7f7818151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781dd48640 1 --2- 172.21.15.55:0/550309352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f781815c9c0 0x7f7818151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781dd48640 1 -- 172.21.15.55:0/550309352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7814009b30 con 0x7f78180cfa70 2023-08-25T04:16:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781e549640 1 --2- 172.21.15.55:0/550309352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7818160f90 0x7f7818150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:16:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781d547640 1 --2- 172.21.15.55:0/550309352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f781815c9c0 0x7f7818151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:16:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781dd48640 1 --2- 172.21.15.55:0/550309352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78180cfa70 0x7f78180c6f60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f781401a650 tx=0x7f78140197c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f780e7fc640 1 -- 172.21.15.55:0/550309352 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78140b8670 con 0x7f78180cfa70 2023-08-25T04:16:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f780e7fc640 1 -- 172.21.15.55:0/550309352 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78140b87d0 con 0x7f78180cfa70 2023-08-25T04:16:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781ffac640 1 -- 172.21.15.55:0/550309352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7818151b00 con 0x7f78180cfa70 2023-08-25T04:16:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f780e7fc640 1 -- 172.21.15.55:0/550309352 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78140b8b80 con 0x7f78180cfa70 2023-08-25T04:16:14.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.193+0000 7f781ffac640 1 -- 172.21.15.55:0/550309352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78181520c0 con 0x7f78180cfa70 2023-08-25T04:16:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f780e7fc640 1 -- 172.21.15.55:0/550309352 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f7814006d50 con 0x7f78180cfa70 2023-08-25T04:16:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f780e7fc640 1 --2- 172.21.15.55:0/550309352 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f77fc0657a0 0x7f77fc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f780e7fc640 1 -- 172.21.15.55:0/550309352 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f781411e260 con 0x7f78180cfa70 2023-08-25T04:16:14.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f781d547640 1 --2- 172.21.15.55:0/550309352 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f77fc0657a0 0x7f77fc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f7823319000 1 Processor -- start 2023-08-25T04:16:14.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f7823319000 1 -- start start 2023-08-25T04:16:14.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f781d547640 1 --2- 172.21.15.55:0/550309352 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f77fc0657a0 0x7f77fc067c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f78181556a0 tx=0x7f7808008040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:14.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f7823319000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c0a1c020 0x55e3c0a1c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f7823319000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c940 0x55e3c09d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f7823319000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c09d25b0 0x55e3c09d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f7823319000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c0828440 con 0x55e3c0a1c940 2023-08-25T04:16:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f7823319000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c0825970 con 0x55e3c09d25b0 2023-08-25T04:16:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f7823319000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3c0821260 con 0x55e3c0a1c020 2023-08-25T04:16:14.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f781d547640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c940 0x55e3c09d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f781d547640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c940 0x55e3c09d2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35060/0 (socket says 172.21.15.55:35060) 2023-08-25T04:16:14.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f781d547640 1 -- 172.21.15.55:0/815007439 learned_addr learned my addr 172.21.15.55:0/815007439 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:14.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f781dd48640 1 --2- 172.21.15.55:0/815007439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c0a1c020 0x55e3c0a1c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f781e549640 1 --2- 172.21.15.55:0/815007439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c09d25b0 0x55e3c09d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f781d547640 1 -- 172.21.15.55:0/815007439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c0a1c020 msgr2=0x55e3c0a1c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:14.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f781d547640 1 --2- 172.21.15.55:0/815007439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c0a1c020 0x55e3c0a1c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f781d547640 1 -- 172.21.15.55:0/815007439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c09d25b0 msgr2=0x55e3c09d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:14.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f781d547640 1 --2- 172.21.15.55:0/815007439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c09d25b0 0x55e3c09d2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f781d547640 1 -- 172.21.15.55:0/815007439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3c08b9ec0 con 0x55e3c0a1c940 2023-08-25T04:16:14.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.197+0000 7f781d547640 1 --2- 172.21.15.55:0/815007439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c940 0x55e3c09d2070 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f780800fa30 tx=0x7f7808012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9c64a9b6bb9b5c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:14.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f77fb7fe640 1 -- 172.21.15.55:0/815007439 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808014be0 con 0x55e3c0a1c940 2023-08-25T04:16:14.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f77fb7fe640 1 -- 172.21.15.55:0/815007439 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7808019070 con 0x55e3c0a1c940 2023-08-25T04:16:14.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f77fb7fe640 1 -- 172.21.15.55:0/815007439 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808020440 con 0x55e3c0a1c940 2023-08-25T04:16:14.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f7823319000 1 -- 172.21.15.55:0/815007439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c940 msgr2=0x55e3c09d2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:14.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f7823319000 1 --2- 172.21.15.55:0/815007439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c940 0x55e3c09d2070 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f780800fa30 tx=0x7f7808012000 comp rx=0 tx=0).stop 2023-08-25T04:16:14.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f7823319000 1 -- 172.21.15.55:0/815007439 shutdown_connections 2023-08-25T04:16:14.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f7823319000 1 --2- 172.21.15.55:0/815007439 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c09d25b0 0x55e3c09d2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f7823319000 1 --2- 172.21.15.55:0/815007439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c940 0x55e3c09d2070 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f7823319000 1 --2- 172.21.15.55:0/815007439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c0a1c020 0x55e3c0a1c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f7823319000 1 -- 172.21.15.55:0/815007439 >> 172.21.15.55:0/815007439 conn(0x55e3c09ce560 msgr2=0x55e3c09d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:14.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f7823319000 1 -- 172.21.15.55:0/815007439 shutdown_connections 2023-08-25T04:16:14.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f7823319000 1 -- 172.21.15.55:0/815007439 wait complete. 2023-08-25T04:16:14.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f7823319000 1 -- start start 2023-08-25T04:16:14.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f7823319000 1 Processor -- start 2023-08-25T04:16:14.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f7823319000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c09d25b0 0x55e3c0a23380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f7823319000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c0a1c020 0x55e3c0a238c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f7823319000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c940 0x55e3c0a09dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f7823319000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c07dbf60 con 0x55e3c0a1c940 2023-08-25T04:16:14.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f7823319000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c07dbc00 con 0x55e3c09d25b0 2023-08-25T04:16:14.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f7823319000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3c04dc940 con 0x55e3c0a1c020 2023-08-25T04:16:14.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f7823319000 10 client.0 _ll_register_callbacks cb 0x55e3c09bd900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:16:14.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f781e549640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c940 0x55e3c0a09dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f781e549640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c940 0x55e3c0a09dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35076/0 (socket says 172.21.15.55:35076) 2023-08-25T04:16:14.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f781e549640 1 -- 172.21.15.55:0/483796609 learned_addr learned my addr 172.21.15.55:0/483796609 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:14.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f781d547640 1 --2- 172.21.15.55:0/483796609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c0a1c020 0x55e3c0a238c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f781dd48640 1 --2- 172.21.15.55:0/483796609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c09d25b0 0x55e3c0a23380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f781e549640 1 -- 172.21.15.55:0/483796609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c0a1c020 msgr2=0x55e3c0a238c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:14.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f781e549640 1 --2- 172.21.15.55:0/483796609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c0a1c020 0x55e3c0a238c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f781e549640 1 -- 172.21.15.55:0/483796609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c09d25b0 msgr2=0x55e3c0a23380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:14.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f781e549640 1 --2- 172.21.15.55:0/483796609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c09d25b0 0x55e3c0a23380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f781e549640 1 -- 172.21.15.55:0/483796609 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780800e040 con 0x55e3c0a1c940 2023-08-25T04:16:14.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f781e549640 1 --2- 172.21.15.55:0/483796609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c940 0x55e3c0a09dd0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7810001e60 tx=0x7f78100116e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786d2462a92e39b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:14.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.201+0000 7f77f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T04:16:14.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f77f8ff9640 1 -- 172.21.15.55:0/483796609 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78100052e0 con 0x55e3c0a1c940 2023-08-25T04:16:14.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 1 -- 172.21.15.55:0/483796609 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3c07b89d0 con 0x55e3c0a1c940 2023-08-25T04:16:14.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f77f8ff9640 1 -- 172.21.15.55:0/483796609 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7810005440 con 0x55e3c0a1c940 2023-08-25T04:16:14.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f77f8ff9640 1 -- 172.21.15.55:0/483796609 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7810003600 con 0x55e3c0a1c940 2023-08-25T04:16:14.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 10 client.6366 fetch_fsmap learned FSMap version 24 2023-08-25T04:16:14.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 1 -- 172.21.15.55:0/483796609 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55e3c051b890 con 0x55e3c0a1c940 2023-08-25T04:16:14.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f77f8ff9640 1 -- 172.21.15.55:0/483796609 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e3c07b89d0 con 0x55e3c0a1c940 2023-08-25T04:16:14.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f77f8ff9640 1 -- 172.21.15.55:0/483796609 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7810003760 con 0x55e3c0a1c940 2023-08-25T04:16:14.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 10 client.6366 fetch_fsmap finished waiting for FSMap version 24 2023-08-25T04:16:14.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 10 client.6366 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-25T04:16:14.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 20 client.6366 populate_metadata read hostname 'smithi055' 2023-08-25T04:16:14.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 1 --2- 172.21.15.55:0/483796609 >> [v2:172.21.15.110:6835/1578265172,v1:172.21.15.110:6837/1578265172] conn(0x55e3c0a0ab70 0x55e3c0a0af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 4 client.6366 mds_command: new command op to 6207 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-25T04:16:14.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 1 -- 172.21.15.55:0/483796609 --> [v2:172.21.15.110:6835/1578265172,v1:172.21.15.110:6837/1578265172] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e3c07d87a0 con 0x55e3c0a0ab70 2023-08-25T04:16:14.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f781dd48640 1 --2- 172.21.15.55:0/483796609 >> [v2:172.21.15.110:6835/1578265172,v1:172.21.15.110:6837/1578265172] conn(0x55e3c0a0ab70 0x55e3c0a0af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f77f8ff9640 10 client.6366 ms_handle_connect on v2:172.21.15.110:6835/1578265172 2023-08-25T04:16:14.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f781dd48640 1 --2- 172.21.15.55:0/483796609 >> [v2:172.21.15.110:6835/1578265172,v1:172.21.15.110:6837/1578265172] conn(0x55e3c0a0ab70 0x55e3c0a0af50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da192c8ced1677f6 server_cookie=f70e988ee24d15e4 in_seq=0 out_seq=0 2023-08-25T04:16:14.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f77f8ff9640 1 -- 172.21.15.55:0/483796609 <== mds.0 v2:172.21.15.110:6835/1578265172 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e3c07d87a0 con 0x55e3c0a0ab70 2023-08-25T04:16:14.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f77f8ff9640 10 client.6366 handle_command_reply: tid=0 2023-08-25T04:16:14.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 1 client.6366 shutdown 2023-08-25T04:16:14.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 1 -- 172.21.15.55:0/483796609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c940 msgr2=0x55e3c0a09dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:14.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 1 --2- 172.21.15.55:0/483796609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c940 0x55e3c0a09dd0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7810001e60 tx=0x7f78100116e0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 1 -- 172.21.15.55:0/483796609 shutdown_connections 2023-08-25T04:16:14.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 1 --2- 172.21.15.55:0/483796609 >> [v2:172.21.15.110:6835/1578265172,v1:172.21.15.110:6837/1578265172] conn(0x55e3c0a0ab70 0x55e3c0a0af50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 1 --2- 172.21.15.55:0/483796609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c940 0x55e3c0a09dd0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 1 --2- 172.21.15.55:0/483796609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c0a1c020 0x55e3c0a238c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 1 --2- 172.21.15.55:0/483796609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c09d25b0 0x55e3c0a23380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f77f8ff9640 0 client.6366 ms_handle_reset on v2:172.21.15.110:6835/1578265172 2023-08-25T04:16:14.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 1 -- 172.21.15.55:0/483796609 >> 172.21.15.55:0/483796609 conn(0x55e3c09ce560 msgr2=0x55e3c09d11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:14.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 1 -- 172.21.15.55:0/483796609 shutdown_connections 2023-08-25T04:16:14.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 1 -- 172.21.15.55:0/483796609 wait complete. 2023-08-25T04:16:14.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.205+0000 7f7823319000 20 client.6366 trim_cache size 0 max 16384 2023-08-25T04:16:14.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.221+0000 7f7823319000 1 Processor -- start 2023-08-25T04:16:14.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.221+0000 7f7823319000 1 -- start start 2023-08-25T04:16:14.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.221+0000 7f7823319000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c09ce560 0x55e3c0a765c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.221+0000 7f7823319000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c09d25b0 0x55e3c0a76b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.221+0000 7f7823319000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c0a1c020 0x55e3c0a77040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.221+0000 7f7823319000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c09d78e0 con 0x55e3c09d25b0 2023-08-25T04:16:14.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.221+0000 7f7823319000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c07e1430 con 0x55e3c0a1c020 2023-08-25T04:16:14.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.221+0000 7f7823319000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3c09d4bd0 con 0x55e3c09ce560 2023-08-25T04:16:14.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.221+0000 7f781d547640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c09d25b0 0x55e3c0a76b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.221+0000 7f781d547640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c09d25b0 0x55e3c0a76b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35090/0 (socket says 172.21.15.55:35090) 2023-08-25T04:16:14.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.221+0000 7f781d547640 1 -- 172.21.15.55:0/2762157217 learned_addr learned my addr 172.21.15.55:0/2762157217 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f781dd48640 1 --2- 172.21.15.55:0/2762157217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c09ce560 0x55e3c0a765c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f781e549640 1 --2- 172.21.15.55:0/2762157217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c0a1c020 0x55e3c0a77040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f781d547640 1 -- 172.21.15.55:0/2762157217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c09ce560 msgr2=0x55e3c0a765c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f781d547640 1 --2- 172.21.15.55:0/2762157217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c09ce560 0x55e3c0a765c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f781d547640 1 -- 172.21.15.55:0/2762157217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c0a1c020 msgr2=0x55e3c0a77040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f781d547640 1 --2- 172.21.15.55:0/2762157217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c0a1c020 0x55e3c0a77040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f781d547640 1 -- 172.21.15.55:0/2762157217 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3c07e4190 con 0x55e3c09d25b0 2023-08-25T04:16:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f781e549640 1 --2- 172.21.15.55:0/2762157217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c0a1c020 0x55e3c0a77040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:16:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f781d547640 1 --2- 172.21.15.55:0/2762157217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c09d25b0 0x55e3c0a76b00 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7808022040 tx=0x7f7808014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8f4c9dd5a2c7af server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f77fbfff640 1 -- 172.21.15.55:0/2762157217 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808014ca0 con 0x55e3c09d25b0 2023-08-25T04:16:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f77fbfff640 1 -- 172.21.15.55:0/2762157217 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7808019040 con 0x55e3c09d25b0 2023-08-25T04:16:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f77fbfff640 1 -- 172.21.15.55:0/2762157217 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808020440 con 0x55e3c09d25b0 2023-08-25T04:16:14.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f7823319000 1 -- 172.21.15.55:0/2762157217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c09d25b0 msgr2=0x55e3c0a76b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:14.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f7823319000 1 --2- 172.21.15.55:0/2762157217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c09d25b0 0x55e3c0a76b00 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7808022040 tx=0x7f7808014000 comp rx=0 tx=0).stop 2023-08-25T04:16:14.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f7823319000 1 -- 172.21.15.55:0/2762157217 shutdown_connections 2023-08-25T04:16:14.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f7823319000 1 --2- 172.21.15.55:0/2762157217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c0a1c020 0x55e3c0a77040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f7823319000 1 --2- 172.21.15.55:0/2762157217 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c09d25b0 0x55e3c0a76b00 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f7823319000 1 --2- 172.21.15.55:0/2762157217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c09ce560 0x55e3c0a765c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f7823319000 1 -- 172.21.15.55:0/2762157217 >> 172.21.15.55:0/2762157217 conn(0x55e3c09d7a20 msgr2=0x55e3c0a1b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:14.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f7823319000 1 -- 172.21.15.55:0/2762157217 shutdown_connections 2023-08-25T04:16:14.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f7823319000 1 -- 172.21.15.55:0/2762157217 wait complete. 2023-08-25T04:16:14.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f7823319000 1 -- start start 2023-08-25T04:16:14.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f7823319000 1 Processor -- start 2023-08-25T04:16:14.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f7823319000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c09ce560 0x55e3c0a7b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f7823319000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c09d25b0 0x55e3c0a7b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f7823319000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c020 0x55e3c0a21000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f7823319000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c0823dc0 con 0x55e3c0a1c020 2023-08-25T04:16:14.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f7823319000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3c09ce130 con 0x55e3c09d25b0 2023-08-25T04:16:14.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f7823319000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3c07d8640 con 0x55e3c09ce560 2023-08-25T04:16:14.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f7823319000 10 client.0 _ll_register_callbacks cb 0x7f780800b200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:16:14.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f781e549640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c020 0x55e3c0a21000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f781e549640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c020 0x55e3c0a21000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35106/0 (socket says 172.21.15.55:35106) 2023-08-25T04:16:14.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f781e549640 1 -- 172.21.15.55:0/1225228506 learned_addr learned my addr 172.21.15.55:0/1225228506 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:14.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f781dd48640 1 --2- 172.21.15.55:0/1225228506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c09ce560 0x55e3c0a7b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f781d547640 1 --2- 172.21.15.55:0/1225228506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c09d25b0 0x55e3c0a7b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f781e549640 1 -- 172.21.15.55:0/1225228506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c09ce560 msgr2=0x55e3c0a7b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:14.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f781e549640 1 --2- 172.21.15.55:0/1225228506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c09ce560 0x55e3c0a7b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f781e549640 1 -- 172.21.15.55:0/1225228506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c09d25b0 msgr2=0x55e3c0a7b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:14.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.225+0000 7f781e549640 1 --2- 172.21.15.55:0/1225228506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c09d25b0 0x55e3c0a7b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f781e549640 1 -- 172.21.15.55:0/1225228506 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3c08b9ec0 con 0x55e3c0a1c020 2023-08-25T04:16:14.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f781e549640 1 --2- 172.21.15.55:0/1225228506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c020 0x55e3c0a21000 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7810000c10 tx=0x7f7810001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b1353bf37a8307 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:14.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f77f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T04:16:14.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f77f8ff9640 1 -- 172.21.15.55:0/1225228506 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810011be0 con 0x55e3c0a1c020 2023-08-25T04:16:14.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f77f8ff9640 1 -- 172.21.15.55:0/1225228506 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7810007d40 con 0x55e3c0a1c020 2023-08-25T04:16:14.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 1 -- 172.21.15.55:0/1225228506 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3c07dc880 con 0x55e3c0a1c020 2023-08-25T04:16:14.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f77f8ff9640 1 -- 172.21.15.55:0/1225228506 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7810003810 con 0x55e3c0a1c020 2023-08-25T04:16:14.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 10 client.6372 fetch_fsmap learned FSMap version 24 2023-08-25T04:16:14.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 1 -- 172.21.15.55:0/1225228506 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55e3c07ca420 con 0x55e3c0a1c020 2023-08-25T04:16:14.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f77f8ff9640 1 -- 172.21.15.55:0/1225228506 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e3c07dc880 con 0x55e3c0a1c020 2023-08-25T04:16:14.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f77f8ff9640 1 -- 172.21.15.55:0/1225228506 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 24) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7810015470 con 0x55e3c0a1c020 2023-08-25T04:16:14.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 10 client.6372 fetch_fsmap finished waiting for FSMap version 24 2023-08-25T04:16:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 10 client.6372 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-25T04:16:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 20 client.6372 populate_metadata read hostname 'smithi055' 2023-08-25T04:16:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 1 --2- 172.21.15.55:0/1225228506 >> [v2:172.21.15.110:6835/1578265172,v1:172.21.15.110:6837/1578265172] conn(0x55e3c0a1c940 0x55e3c0a21990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 4 client.6372 mds_command: new command op to 6207 tid=0[{"prefix": "status"}] 2023-08-25T04:16:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 1 -- 172.21.15.55:0/1225228506 --> [v2:172.21.15.110:6835/1578265172,v1:172.21.15.110:6837/1578265172] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e3c081a240 con 0x55e3c0a1c940 2023-08-25T04:16:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f781dd48640 1 --2- 172.21.15.55:0/1225228506 >> [v2:172.21.15.110:6835/1578265172,v1:172.21.15.110:6837/1578265172] conn(0x55e3c0a1c940 0x55e3c0a21990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f781dd48640 1 --2- 172.21.15.55:0/1225228506 >> [v2:172.21.15.110:6835/1578265172,v1:172.21.15.110:6837/1578265172] conn(0x55e3c0a1c940 0x55e3c0a21990 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cc55c586f52437 server_cookie=76b812ca82d4d00e in_seq=0 out_seq=0 2023-08-25T04:16:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f77f8ff9640 10 client.6372 ms_handle_connect on v2:172.21.15.110:6835/1578265172 2023-08-25T04:16:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f77f8ff9640 1 -- 172.21.15.55:0/1225228506 <== mds.0 v2:172.21.15.110:6835/1578265172 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55e3c081a240 con 0x55e3c0a1c940 2023-08-25T04:16:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f77f8ff9640 10 client.6372 handle_command_reply: tid=0 2023-08-25T04:16:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 1 client.6372 shutdown 2023-08-25T04:16:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 1 -- 172.21.15.55:0/1225228506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c020 msgr2=0x55e3c0a21000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 1 --2- 172.21.15.55:0/1225228506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c020 0x55e3c0a21000 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f7810000c10 tx=0x7f7810001090 comp rx=0 tx=0).stop 2023-08-25T04:16:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 1 -- 172.21.15.55:0/1225228506 shutdown_connections 2023-08-25T04:16:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 1 --2- 172.21.15.55:0/1225228506 >> [v2:172.21.15.110:6835/1578265172,v1:172.21.15.110:6837/1578265172] conn(0x55e3c0a1c940 0x55e3c0a21990 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 1 --2- 172.21.15.55:0/1225228506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e3c0a1c020 0x55e3c0a21000 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 1 --2- 172.21.15.55:0/1225228506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55e3c09d25b0 0x55e3c0a7b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f77f8ff9640 0 client.6372 ms_handle_reset on v2:172.21.15.110:6835/1578265172 2023-08-25T04:16:14.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 1 --2- 172.21.15.55:0/1225228506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55e3c09ce560 0x55e3c0a7b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 1 -- 172.21.15.55:0/1225228506 >> 172.21.15.55:0/1225228506 conn(0x55e3c09d7a20 msgr2=0x55e3c0a08f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:14.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 1 -- 172.21.15.55:0/1225228506 shutdown_connections 2023-08-25T04:16:14.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 1 -- 172.21.15.55:0/1225228506 wait complete. 2023-08-25T04:16:14.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f7823319000 20 client.6372 trim_cache size 0 max 16384 2023-08-25T04:16:14.241 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T04:16:14.242 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2d2a9024-b152-4d40-880c-1686d1810590", 2023-08-25T04:16:14.242 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-08-25T04:16:14.242 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 6207, 2023-08-25T04:16:14.242 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-08-25T04:16:14.242 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-08-25T04:16:14.243 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-08-25T04:16:14.243 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.489979550999999, 2023-08-25T04:16:14.243 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 24, 2023-08-25T04:16:14.243 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 62, 2023-08-25T04:16:14.243 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 62, 2023-08-25T04:16:14.244 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 16.387862143 2023-08-25T04:16:14.244 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T04:16:14.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f781ffac640 1 -- 172.21.15.55:0/550309352 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f77fc0657a0 msgr2=0x7f77fc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:14.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f781ffac640 1 --2- 172.21.15.55:0/550309352 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f77fc0657a0 0x7f77fc067c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f78181556a0 tx=0x7f7808008040 comp rx=0 tx=0).stop 2023-08-25T04:16:14.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f781ffac640 1 -- 172.21.15.55:0/550309352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78180cfa70 msgr2=0x7f78180c6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:14.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f781ffac640 1 --2- 172.21.15.55:0/550309352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78180cfa70 0x7f78180c6f60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f781401a650 tx=0x7f78140197c0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f781ffac640 1 -- 172.21.15.55:0/550309352 shutdown_connections 2023-08-25T04:16:14.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f781ffac640 1 --2- 172.21.15.55:0/550309352 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f77fc0657a0 0x7f77fc067c60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f781ffac640 1 --2- 172.21.15.55:0/550309352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7818160f90 0x7f7818150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f781ffac640 1 --2- 172.21.15.55:0/550309352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f781815c9c0 0x7f7818151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f781ffac640 1 --2- 172.21.15.55:0/550309352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78180cfa70 0x7f78180c6f60 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.229+0000 7f781ffac640 1 -- 172.21.15.55:0/550309352 >> 172.21.15.55:0/550309352 conn(0x7f78180d05a0 msgr2=0x7f78180ce910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.233+0000 7f781ffac640 1 -- 172.21.15.55:0/550309352 shutdown_connections 2023-08-25T04:16:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.233+0000 7f781ffac640 1 -- 172.21.15.55:0/550309352 wait complete. 2023-08-25T04:16:14.249 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:16:14.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.393+0000 7f91b06d8640 1 Processor -- start 2023-08-25T04:16:14.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.393+0000 7f91b06d8640 1 -- start start 2023-08-25T04:16:14.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.393+0000 7f91b06d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f91a80aeb10 0x7f91a80ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.393+0000 7f91b06d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91a806a010 0x7f91a80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.393+0000 7f91b06d8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a80cf2b0 con 0x7f91a80cee20 2023-08-25T04:16:14.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.393+0000 7f91b06d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a80d0380 con 0x7f91a80aeb10 2023-08-25T04:16:14.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.393+0000 7f91b06d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a806d590 con 0x7f91a806a010 2023-08-25T04:16:14.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.393+0000 7f91ae474640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f91a80aeb10 0x7f91a80ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.393+0000 7f91ae474640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f91a80aeb10 0x7f91a80ce8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35112/0 (socket says 172.21.15.55:35112) 2023-08-25T04:16:14.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.393+0000 7f91ae474640 1 -- 172.21.15.55:0/3920266531 learned_addr learned my addr 172.21.15.55:0/3920266531 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:14.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.393+0000 7f91aec75640 1 --2- 172.21.15.55:0/3920266531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91a806a010 0x7f91a80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.397+0000 7f91ae474640 1 -- 172.21.15.55:0/3920266531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91a806a010 msgr2=0x7f91a80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:14.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.397+0000 7f91ae474640 1 --2- 172.21.15.55:0/3920266531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91a806a010 0x7f91a80cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.397+0000 7f91ae474640 1 -- 172.21.15.55:0/3920266531 >> v1:172.21.15.110:6789/0 conn(0x7f91a80cee20 legacy=0x7f91a8069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:14.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.397+0000 7f91ae474640 1 -- 172.21.15.55:0/3920266531 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a806c4f0 con 0x7f91a80aeb10 2023-08-25T04:16:14.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.397+0000 7f91ae474640 1 --2- 172.21.15.55:0/3920266531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91a80aeb10 0x7f91a80ce8e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009870 tx=0x7f91a401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c7acca8724eb7e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:14.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.397+0000 7f91ad472640 1 -- 172.21.15.55:0/3920266531 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40a7070 con 0x7f91a80aeb10 2023-08-25T04:16:14.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.397+0000 7f91ad472640 1 -- 172.21.15.55:0/3920266531 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a40ab430 con 0x7f91a80aeb10 2023-08-25T04:16:14.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.397+0000 7f91ad472640 1 -- 172.21.15.55:0/3920266531 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40ab7c0 con 0x7f91a80aeb10 2023-08-25T04:16:14.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.397+0000 7f91b06d8640 1 -- 172.21.15.55:0/3920266531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91a80aeb10 msgr2=0x7f91a80ce8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:14.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.397+0000 7f91b06d8640 1 --2- 172.21.15.55:0/3920266531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91a80aeb10 0x7f91a80ce8e0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009870 tx=0x7f91a401c540 comp rx=0 tx=0).stop 2023-08-25T04:16:14.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91b06d8640 1 -- 172.21.15.55:0/3920266531 shutdown_connections 2023-08-25T04:16:14.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91b06d8640 1 --2- 172.21.15.55:0/3920266531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91a806a010 0x7f91a80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91b06d8640 1 --2- 172.21.15.55:0/3920266531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91a80aeb10 0x7f91a80ce8e0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91b06d8640 1 -- 172.21.15.55:0/3920266531 >> 172.21.15.55:0/3920266531 conn(0x7f91a80cf530 msgr2=0x7f91a80cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:14.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91b06d8640 1 -- 172.21.15.55:0/3920266531 shutdown_connections 2023-08-25T04:16:14.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91b06d8640 1 -- 172.21.15.55:0/3920266531 wait complete. 2023-08-25T04:16:14.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91b06d8640 1 Processor -- start 2023-08-25T04:16:14.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91b06d8640 1 -- start start 2023-08-25T04:16:14.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91b06d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91a806a010 0x7f91a815b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91b06d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91a80aeb10 0x7f91a815c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91b06d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91a80cee20 0x7f91a80c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91b06d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a815b730 con 0x7f91a806a010 2023-08-25T04:16:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91b06d8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a80c5020 con 0x7f91a80cee20 2023-08-25T04:16:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91b06d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a80c5300 con 0x7f91a80aeb10 2023-08-25T04:16:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91ae474640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91a806a010 0x7f91a815b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91ae474640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91a806a010 0x7f91a815b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35118/0 (socket says 172.21.15.55:35118) 2023-08-25T04:16:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91ae474640 1 -- 172.21.15.55:0/1483067226 learned_addr learned my addr 172.21.15.55:0/1483067226 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:14.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91aec75640 1 --2- 172.21.15.55:0/1483067226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91a80cee20 0x7f91a80c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91adc73640 1 --2- 172.21.15.55:0/1483067226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91a80aeb10 0x7f91a815c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91ae474640 1 -- 172.21.15.55:0/1483067226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91a80aeb10 msgr2=0x7f91a815c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:14.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91ae474640 1 --2- 172.21.15.55:0/1483067226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91a80aeb10 0x7f91a815c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91ae474640 1 -- 172.21.15.55:0/1483067226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91a80cee20 msgr2=0x7f91a80c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:14.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91ae474640 1 --2- 172.21.15.55:0/1483067226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91a80cee20 0x7f91a80c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91ae474640 1 -- 172.21.15.55:0/1483067226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a40094d0 con 0x7f91a806a010 2023-08-25T04:16:14.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91aec75640 1 --2- 172.21.15.55:0/1483067226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91a80cee20 0x7f91a80c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:16:14.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91adc73640 1 --2- 172.21.15.55:0/1483067226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91a80aeb10 0x7f91a815c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:16:14.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.401+0000 7f91ae474640 1 --2- 172.21.15.55:0/1483067226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91a806a010 0x7f91a815b1f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f91a40ad040 tx=0x7f91a40192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.405+0000 7f919effd640 1 -- 172.21.15.55:0/1483067226 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40b4620 con 0x7f91a806a010 2023-08-25T04:16:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.405+0000 7f919effd640 1 -- 172.21.15.55:0/1483067226 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a40b4780 con 0x7f91a806a010 2023-08-25T04:16:14.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.405+0000 7f919effd640 1 -- 172.21.15.55:0/1483067226 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a40b4b30 con 0x7f91a806a010 2023-08-25T04:16:14.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.405+0000 7f91b06d8640 1 -- 172.21.15.55:0/1483067226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a80c55e0 con 0x7f91a806a010 2023-08-25T04:16:14.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.405+0000 7f91b06d8640 1 -- 172.21.15.55:0/1483067226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a80c5ba0 con 0x7f91a806a010 2023-08-25T04:16:14.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.405+0000 7f91b06d8640 1 -- 172.21.15.55:0/1483067226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a804dbe0 con 0x7f91a806a010 2023-08-25T04:16:14.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.405+0000 7f919effd640 1 -- 172.21.15.55:0/1483067226 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f91a40b4c90 con 0x7f91a806a010 2023-08-25T04:16:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.405+0000 7f919effd640 1 --2- 172.21.15.55:0/1483067226 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f918c0657a0 0x7f918c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.405+0000 7f919effd640 1 -- 172.21.15.55:0/1483067226 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f91a411d4c0 con 0x7f91a806a010 2023-08-25T04:16:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.405+0000 7f91adc73640 1 --2- 172.21.15.55:0/1483067226 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f918c0657a0 0x7f918c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.405+0000 7f91adc73640 1 --2- 172.21.15.55:0/1483067226 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f918c0657a0 0x7f918c067c60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f91a80c46b0 tx=0x7f9198009040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.409+0000 7f919effd640 1 -- 172.21.15.55:0/1483067226 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f91a40eadf0 con 0x7f91a806a010 2023-08-25T04:16:14.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.601+0000 7f91b06d8640 1 -- 172.21.15.55:0/1483067226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f91a8167690 con 0x7f91a806a010 2023-08-25T04:16:14.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.601+0000 7f919effd640 1 -- 172.21.15.55:0/1483067226 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7f91a40ee410 con 0x7f91a806a010 2023-08-25T04:16:14.601 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T04:16:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.605+0000 7f91b06d8640 1 -- 172.21.15.55:0/1483067226 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f918c0657a0 msgr2=0x7f918c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:14.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.605+0000 7f91b06d8640 1 --2- 172.21.15.55:0/1483067226 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f918c0657a0 0x7f918c067c60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f91a80c46b0 tx=0x7f9198009040 comp rx=0 tx=0).stop 2023-08-25T04:16:14.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.605+0000 7f91b06d8640 1 -- 172.21.15.55:0/1483067226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91a806a010 msgr2=0x7f91a815b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:14.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.605+0000 7f91b06d8640 1 --2- 172.21.15.55:0/1483067226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91a806a010 0x7f91a815b1f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f91a40ad040 tx=0x7f91a40192e0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.605+0000 7f91b06d8640 1 -- 172.21.15.55:0/1483067226 shutdown_connections 2023-08-25T04:16:14.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.605+0000 7f91b06d8640 1 --2- 172.21.15.55:0/1483067226 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f918c0657a0 0x7f918c067c60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.605+0000 7f91b06d8640 1 --2- 172.21.15.55:0/1483067226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91a80cee20 0x7f91a80c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.605+0000 7f91b06d8640 1 --2- 172.21.15.55:0/1483067226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91a80aeb10 0x7f91a815c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.605+0000 7f91b06d8640 1 --2- 172.21.15.55:0/1483067226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91a806a010 0x7f91a815b1f0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:14.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.605+0000 7f91b06d8640 1 -- 172.21.15.55:0/1483067226 >> 172.21.15.55:0/1483067226 conn(0x7f91a80cf530 msgr2=0x7f91a8069900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:14.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.605+0000 7f91b06d8640 1 -- 172.21.15.55:0/1483067226 shutdown_connections 2023-08-25T04:16:14.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:14.605+0000 7f91b06d8640 1 -- 172.21.15.55:0/1483067226 wait complete. 2023-08-25T04:16:14.623 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-25T04:16:14.623 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:16:14.623 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-08-25T04:16:14.624 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-25T04:16:14.624 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T04:16:14.624 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-25T04:16:14.625 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-25T04:16:14.625 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:16:14.625 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:16:14.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:14.626 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-08-25T04:16:14.637 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:16:14.637 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:16:14.637 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:16:14.638 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:16:14.638 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-08-25T04:16:14.638 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:16:14.638 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:16:14.639 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:16:14.639 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-08-25T04:16:14.639 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:16:14.639 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:16:14.639 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-08-25T04:16:14.640 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:16:14.640 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:16:14.640 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-08-25T04:16:14.640 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-08-25T04:16:14.640 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41614sec preferred_lft 41614sec 2023-08-25T04:16:14.641 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-08-25T04:16:14.641 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:16:14.641 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:16:14.641 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:16:14.641 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-08-25T04:16:14.641 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-25T04:16:14.642 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:98:6a:38:6a brd ff:ff:ff:ff:ff:ff 2023-08-25T04:16:14.642 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-25T04:16:14.642 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:16:14.642 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:16:14.642 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-08-25T04:16:14.643 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T04:16:14.643 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:16:14.643 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-08-25T04:16:14.643 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:16:14.643 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:16:14.643 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T04:16:14.644 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-08-25T04:16:14.644 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:16:14.644 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:16:14.644 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-25T04:16:14.644 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-08-25T04:16:14.645 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:16:14.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:14.645 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:16:14.698 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-08-25T04:16:14.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:14.700 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-08-25T04:16:14.752 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-08-25T04:16:14.752 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:16:14.753 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-08-25T04:16:14.753 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-25T04:16:14.753 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-08-25T04:16:14.753 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:16:14.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:14.755 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T04:16:14.755 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T04:16:14.756 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-25T04:16:14.756 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-25T04:16:14.757 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-25T04:16:14.757 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T04:16:14.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:14.853 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-08-25T04:16:14.865 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-25T04:16:14.865 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-25T04:16:14.866 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:16:14.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:14.867 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-08-25T04:16:14.928 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:16:14.929 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-25T04:16:14.983 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:16:14.983 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:16:14.983 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:16:15.034 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-25T04:16:15.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:15.035 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:16:15.127 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:16:15.127 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:16:15.141 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:16:15.141 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:16:15.141 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.110:3300,172.21.15.110:3301" 2023-08-25T04:16:15.142 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2d2a9024-b152-4d40-880c-1686d1810590.cephfs=/ 2023-08-25T04:16:15.142 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2023-08-25T04:16:15.144 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T04:16:15.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:15.145 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:16:15.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:15.167 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:16:15.230 INFO:teuthology.orchestra.run.smithi055.stdout:client5618 2023-08-25T04:16:15.231 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:16:15.231 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:16:15.286 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-25T04:16:15.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.473+0000 7f465f3fa640 1 Processor -- start 2023-08-25T04:16:15.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.473+0000 7f465f3fa640 1 -- start start 2023-08-25T04:16:15.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.473+0000 7f465f3fa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f46580cdde0 0x7f46580ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:15.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.473+0000 7f465f3fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f46580b2e40 0x7f46580b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:15.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.473+0000 7f465f3fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46580b29b0 con 0x7f46580d0da0 2023-08-25T04:16:15.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.473+0000 7f465f3fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46580ce760 con 0x7f46580b2e40 2023-08-25T04:16:15.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.473+0000 7f465f3fa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46580b1dc0 con 0x7f46580cdde0 2023-08-25T04:16:15.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.477+0000 7f465d997640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f46580b2e40 0x7f46580b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:15.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.477+0000 7f465d997640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f46580b2e40 0x7f46580b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35130/0 (socket says 172.21.15.55:35130) 2023-08-25T04:16:15.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.477+0000 7f465d997640 1 -- 172.21.15.55:0/874503664 learned_addr learned my addr 172.21.15.55:0/874503664 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:15.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.477+0000 7f465c995640 1 --2- 172.21.15.55:0/874503664 >> v2:172.21.15.110:3300/0 conn(0x7f46580cdde0 0x7f46580ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:15.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.477+0000 7f465d997640 1 -- 172.21.15.55:0/874503664 >> v2:172.21.15.110:3300/0 conn(0x7f46580cdde0 msgr2=0x7f46580ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:15.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.477+0000 7f465d997640 1 --2- 172.21.15.55:0/874503664 >> v2:172.21.15.110:3300/0 conn(0x7f46580cdde0 0x7f46580ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:15.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.477+0000 7f465d997640 1 -- 172.21.15.55:0/874503664 >> v1:172.21.15.55:6789/0 conn(0x7f46580d0da0 legacy=0x7f46580d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:15.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.477+0000 7f465d997640 1 -- 172.21.15.55:0/874503664 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46580b2080 con 0x7f46580b2e40 2023-08-25T04:16:15.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.477+0000 7f465d997640 1 --2- 172.21.15.55:0/874503664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46580b2e40 0x7f46580b32b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f46580d38c0 tx=0x7f465001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1f9e246312d1ca server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:15.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.477+0000 7f464ffff640 1 -- 172.21.15.55:0/874503664 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500af400 con 0x7f46580b2e40 2023-08-25T04:16:15.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.477+0000 7f464ffff640 1 -- 172.21.15.55:0/874503664 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46500ab050 con 0x7f46580b2e40 2023-08-25T04:16:15.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.477+0000 7f464ffff640 1 -- 172.21.15.55:0/874503664 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500af780 con 0x7f46580b2e40 2023-08-25T04:16:15.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465f3fa640 1 -- 172.21.15.55:0/874503664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46580b2e40 msgr2=0x7f46580b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:15.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465f3fa640 1 --2- 172.21.15.55:0/874503664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46580b2e40 0x7f46580b32b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f46580d38c0 tx=0x7f465001f1c0 comp rx=0 tx=0).stop 2023-08-25T04:16:15.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465f3fa640 1 -- 172.21.15.55:0/874503664 shutdown_connections 2023-08-25T04:16:15.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465f3fa640 1 --2- 172.21.15.55:0/874503664 >> v2:172.21.15.110:3300/0 conn(0x7f46580cdde0 0x7f46580ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:15.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465f3fa640 1 --2- 172.21.15.55:0/874503664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46580b2e40 0x7f46580b32b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:15.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465f3fa640 1 -- 172.21.15.55:0/874503664 >> 172.21.15.55:0/874503664 conn(0x7f465809bae0 msgr2=0x7f46580d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:15.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465f3fa640 1 -- 172.21.15.55:0/874503664 shutdown_connections 2023-08-25T04:16:15.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465f3fa640 1 -- 172.21.15.55:0/874503664 wait complete. 2023-08-25T04:16:15.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465f3fa640 1 Processor -- start 2023-08-25T04:16:15.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465f3fa640 1 -- start start 2023-08-25T04:16:15.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465f3fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46580b2e40 0x7f46580b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:15.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465f3fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46580cdde0 0x7f46580cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:15.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465f3fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46580d0da0 0x7f46581f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:15.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465f3fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46580cbdc0 con 0x7f46580b2e40 2023-08-25T04:16:15.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465f3fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46581f26a0 con 0x7f46580d0da0 2023-08-25T04:16:15.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465f3fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46580c9c30 con 0x7f46580cdde0 2023-08-25T04:16:15.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465d196640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46580b2e40 0x7f46580b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:15.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465d196640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46580b2e40 0x7f46580b7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35142/0 (socket says 172.21.15.55:35142) 2023-08-25T04:16:15.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465d196640 1 -- 172.21.15.55:0/3687999387 learned_addr learned my addr 172.21.15.55:0/3687999387 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:15.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465d997640 1 --2- 172.21.15.55:0/3687999387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46580d0da0 0x7f46581f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:15.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465c995640 1 --2- 172.21.15.55:0/3687999387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46580cdde0 0x7f46580cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:15.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465d196640 1 -- 172.21.15.55:0/3687999387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46580cdde0 msgr2=0x7f46580cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:15.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465d196640 1 --2- 172.21.15.55:0/3687999387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46580cdde0 0x7f46580cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:15.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465d196640 1 -- 172.21.15.55:0/3687999387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46580d0da0 msgr2=0x7f46581f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:15.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465d196640 1 --2- 172.21.15.55:0/3687999387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46580d0da0 0x7f46581f5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:15.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465d196640 1 -- 172.21.15.55:0/3687999387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4650009b30 con 0x7f46580b2e40 2023-08-25T04:16:15.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465d997640 1 --2- 172.21.15.55:0/3687999387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46580d0da0 0x7f46581f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:16:15.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.481+0000 7f465d196640 1 --2- 172.21.15.55:0/3687999387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46580b2e40 0x7f46580b7550 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f465400c3c0 tx=0x7f465400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:15.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.485+0000 7f464dffb640 1 -- 172.21.15.55:0/3687999387 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46540054e0 con 0x7f46580b2e40 2023-08-25T04:16:15.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.485+0000 7f464dffb640 1 -- 172.21.15.55:0/3687999387 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4654003600 con 0x7f46580b2e40 2023-08-25T04:16:15.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.485+0000 7f465f3fa640 1 -- 172.21.15.55:0/3687999387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46580c9f10 con 0x7f46580b2e40 2023-08-25T04:16:15.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.485+0000 7f464dffb640 1 -- 172.21.15.55:0/3687999387 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4654003a10 con 0x7f46580b2e40 2023-08-25T04:16:15.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.485+0000 7f465f3fa640 1 -- 172.21.15.55:0/3687999387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46580ca4d0 con 0x7f46580b2e40 2023-08-25T04:16:15.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.485+0000 7f465f3fa640 1 -- 172.21.15.55:0/3687999387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46581f28c0 con 0x7f46580b2e40 2023-08-25T04:16:15.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.485+0000 7f464dffb640 1 -- 172.21.15.55:0/3687999387 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f4654003b70 con 0x7f46580b2e40 2023-08-25T04:16:15.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.485+0000 7f464dffb640 1 --2- 172.21.15.55:0/3687999387 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f463c0657a0 0x7f463c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:15.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.485+0000 7f464dffb640 1 -- 172.21.15.55:0/3687999387 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46540825a0 con 0x7f46580b2e40 2023-08-25T04:16:15.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.489+0000 7f465c995640 1 --2- 172.21.15.55:0/3687999387 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f463c0657a0 0x7f463c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:15.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.489+0000 7f465c995640 1 --2- 172.21.15.55:0/3687999387 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f463c0657a0 0x7f463c067c60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f46580cb9f0 tx=0x7f4648008040 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:15.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.489+0000 7f464dffb640 1 -- 172.21.15.55:0/3687999387 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f46581f28c0 con 0x7f46580b2e40 2023-08-25T04:16:15.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.669+0000 7f465f3fa640 1 -- 172.21.15.55:0/3687999387 --> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f46580b2640 con 0x7f463c0657a0 2023-08-25T04:16:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.669+0000 7f464dffb640 1 -- 172.21.15.55:0/3687999387 <== mgr.5922 v2:172.21.15.110:6832/1373721950 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f464800b660 con 0x7f463c0657a0 2023-08-25T04:16:15.671 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T04:16:15.671 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:16:15.671 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-08-25T04:16:15.672 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:16:15.672 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T04:16:15.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.673+0000 7f465f3fa640 1 -- 172.21.15.55:0/3687999387 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f463c0657a0 msgr2=0x7f463c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:15.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.673+0000 7f465f3fa640 1 --2- 172.21.15.55:0/3687999387 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f463c0657a0 0x7f463c067c60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f46580cb9f0 tx=0x7f4648008040 comp rx=0 tx=0).stop 2023-08-25T04:16:15.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.673+0000 7f465f3fa640 1 -- 172.21.15.55:0/3687999387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46580b2e40 msgr2=0x7f46580b7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:15.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.673+0000 7f465f3fa640 1 --2- 172.21.15.55:0/3687999387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46580b2e40 0x7f46580b7550 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f465400c3c0 tx=0x7f465400c880 comp rx=0 tx=0).stop 2023-08-25T04:16:15.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.673+0000 7f465f3fa640 1 -- 172.21.15.55:0/3687999387 shutdown_connections 2023-08-25T04:16:15.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.673+0000 7f465f3fa640 1 --2- 172.21.15.55:0/3687999387 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f463c0657a0 0x7f463c067c60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:15.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.673+0000 7f465f3fa640 1 --2- 172.21.15.55:0/3687999387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46580d0da0 0x7f46581f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:15.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.673+0000 7f465f3fa640 1 --2- 172.21.15.55:0/3687999387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46580cdde0 0x7f46580cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:15.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.673+0000 7f465f3fa640 1 --2- 172.21.15.55:0/3687999387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46580b2e40 0x7f46580b7550 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:15.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.673+0000 7f465f3fa640 1 -- 172.21.15.55:0/3687999387 >> 172.21.15.55:0/3687999387 conn(0x7f465809bae0 msgr2=0x7f465806b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:15.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.673+0000 7f465f3fa640 1 -- 172.21.15.55:0/3687999387 shutdown_connections 2023-08-25T04:16:15.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.673+0000 7f465f3fa640 1 -- 172.21.15.55:0/3687999387 wait complete. 2023-08-25T04:16:15.692 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-25T04:16:15.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.837+0000 7f5d24d96640 1 Processor -- start 2023-08-25T04:16:15.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.837+0000 7f5d24d96640 1 -- start start 2023-08-25T04:16:15.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.841+0000 7f5d24d96640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5d200c9830 0x7f5d2009bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:15.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.841+0000 7f5d24d96640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d2006c020 0x7f5d200acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:15.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.841+0000 7f5d24d96640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2015abd0 con 0x7f5d2015a7f0 2023-08-25T04:16:15.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.841+0000 7f5d24d96640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d200c8ab0 con 0x7f5d200c9830 2023-08-25T04:16:15.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.841+0000 7f5d24d96640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d200c8d50 con 0x7f5d2006c020 2023-08-25T04:16:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.841+0000 7f5d1e59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5d2015a7f0 0x7f5d20070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50380/0 (socket says 172.21.15.55:50380) 2023-08-25T04:16:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.841+0000 7f5d1e59c640 1 -- 172.21.15.55:0/3323409665 learned_addr learned my addr 172.21.15.55:0/3323409665 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:16:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.841+0000 7f5d1ed9d640 1 --2- 172.21.15.55:0/3323409665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d2006c020 0x7f5d200acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.841+0000 7f5d17fff640 1 --2- 172.21.15.55:0/3323409665 >> v2:172.21.15.110:3300/0 conn(0x7f5d200c9830 0x7f5d2009bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.841+0000 7f5d1dd9b640 1 -- 172.21.15.55:0/3323409665 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182889723 0 0) 0x7f5d2015abd0 con 0x7f5d2015a7f0 2023-08-25T04:16:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.841+0000 7f5d1dd9b640 1 -- 172.21.15.55:0/3323409665 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d0c003530 con 0x7f5d2015a7f0 2023-08-25T04:16:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.841+0000 7f5d17fff640 1 -- 172.21.15.55:0/3323409665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d2006c020 msgr2=0x7f5d200acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.841+0000 7f5d17fff640 1 --2- 172.21.15.55:0/3323409665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d2006c020 0x7f5d200acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.841+0000 7f5d17fff640 1 -- 172.21.15.55:0/3323409665 >> v1:172.21.15.55:6789/0 conn(0x7f5d2015a7f0 legacy=0x7f5d20070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.841+0000 7f5d17fff640 1 -- 172.21.15.55:0/3323409665 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d200c9030 con 0x7f5d200c9830 2023-08-25T04:16:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.841+0000 7f5d1ed9d640 1 --2- 172.21.15.55:0/3323409665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d2006c020 0x7f5d200acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:16:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.845+0000 7f5d17fff640 1 --2- 172.21.15.55:0/3323409665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d200c9830 0x7f5d2009bde0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5d080097c0 tx=0x7f5d0801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1766ee036f8cf12b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.845+0000 7f5d1dd9b640 1 -- 172.21.15.55:0/3323409665 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d080ad660 con 0x7f5d200c9830 2023-08-25T04:16:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.845+0000 7f5d1dd9b640 1 -- 172.21.15.55:0/3323409665 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d080ad7c0 con 0x7f5d200c9830 2023-08-25T04:16:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.845+0000 7f5d1dd9b640 1 -- 172.21.15.55:0/3323409665 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d080adb50 con 0x7f5d200c9830 2023-08-25T04:16:15.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.845+0000 7f5d24d96640 1 -- 172.21.15.55:0/3323409665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d200c9830 msgr2=0x7f5d2009bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:15.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.845+0000 7f5d24d96640 1 --2- 172.21.15.55:0/3323409665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d200c9830 0x7f5d2009bde0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5d080097c0 tx=0x7f5d0801c450 comp rx=0 tx=0).stop 2023-08-25T04:16:15.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.845+0000 7f5d24d96640 1 -- 172.21.15.55:0/3323409665 shutdown_connections 2023-08-25T04:16:15.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.845+0000 7f5d24d96640 1 --2- 172.21.15.55:0/3323409665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d2006c020 0x7f5d200acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:15.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.845+0000 7f5d24d96640 1 --2- 172.21.15.55:0/3323409665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d200c9830 0x7f5d2009bde0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:15.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.845+0000 7f5d24d96640 1 -- 172.21.15.55:0/3323409665 >> 172.21.15.55:0/3323409665 conn(0x7f5d20069900 msgr2=0x7f5d20069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:15.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.845+0000 7f5d24d96640 1 -- 172.21.15.55:0/3323409665 shutdown_connections 2023-08-25T04:16:15.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.845+0000 7f5d24d96640 1 -- 172.21.15.55:0/3323409665 wait complete. 2023-08-25T04:16:15.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.845+0000 7f5d24d96640 1 Processor -- start 2023-08-25T04:16:15.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d24d96640 1 -- start start 2023-08-25T04:16:15.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d24d96640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d2006c020 0x7f5d2014d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:15.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d24d96640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d200c9830 0x7f5d200cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:15.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d24d96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d2015a7f0 0x7f5d20154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:15.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d24d96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2014dc80 con 0x7f5d2015a7f0 2023-08-25T04:16:15.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d24d96640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d200b19c0 con 0x7f5d200c9830 2023-08-25T04:16:15.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d24d96640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d201638f0 con 0x7f5d2006c020 2023-08-25T04:16:15.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d1ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d2015a7f0 0x7f5d20154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:15.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d1ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d2015a7f0 0x7f5d20154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35154/0 (socket says 172.21.15.55:35154) 2023-08-25T04:16:15.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d1ed9d640 1 -- 172.21.15.55:0/3095804859 learned_addr learned my addr 172.21.15.55:0/3095804859 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:15.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d1e59c640 1 --2- 172.21.15.55:0/3095804859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d2006c020 0x7f5d2014d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:15.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d17fff640 1 --2- 172.21.15.55:0/3095804859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d200c9830 0x7f5d200cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:15.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d1ed9d640 1 -- 172.21.15.55:0/3095804859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d2006c020 msgr2=0x7f5d2014d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:15.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d1ed9d640 1 --2- 172.21.15.55:0/3095804859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d2006c020 0x7f5d2014d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:15.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d1ed9d640 1 -- 172.21.15.55:0/3095804859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d200c9830 msgr2=0x7f5d200cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:15.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d1ed9d640 1 --2- 172.21.15.55:0/3095804859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d200c9830 0x7f5d200cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:15.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d1ed9d640 1 -- 172.21.15.55:0/3095804859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d18009a70 con 0x7f5d2015a7f0 2023-08-25T04:16:15.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d1ed9d640 1 --2- 172.21.15.55:0/3095804859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d2015a7f0 0x7f5d20154d10 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5d1800efb0 tx=0x7f5d1800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:15.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d16ffd640 1 -- 172.21.15.55:0/3095804859 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d180039a0 con 0x7f5d2015a7f0 2023-08-25T04:16:15.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d16ffd640 1 -- 172.21.15.55:0/3095804859 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1800f040 con 0x7f5d2015a7f0 2023-08-25T04:16:15.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d24d96640 1 -- 172.21.15.55:0/3095804859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d08009420 con 0x7f5d2015a7f0 2023-08-25T04:16:15.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d16ffd640 1 -- 172.21.15.55:0/3095804859 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d18003d40 con 0x7f5d2015a7f0 2023-08-25T04:16:15.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d24d96640 1 -- 172.21.15.55:0/3095804859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d200b1ef0 con 0x7f5d2015a7f0 2023-08-25T04:16:15.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.849+0000 7f5d24d96640 1 -- 172.21.15.55:0/3095804859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2006d5b0 con 0x7f5d2015a7f0 2023-08-25T04:16:15.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.853+0000 7f5d16ffd640 1 -- 172.21.15.55:0/3095804859 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 18) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f5d18004030 con 0x7f5d2015a7f0 2023-08-25T04:16:15.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.853+0000 7f5d16ffd640 1 --2- 172.21.15.55:0/3095804859 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f5d000657a0 0x7f5d00067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.853+0000 7f5d16ffd640 1 -- 172.21.15.55:0/3095804859 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d18083f30 con 0x7f5d2015a7f0 2023-08-25T04:16:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.853+0000 7f5d1e59c640 1 --2- 172.21.15.55:0/3095804859 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f5d000657a0 0x7f5d00067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.853+0000 7f5d1e59c640 1 --2- 172.21.15.55:0/3095804859 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f5d000657a0 0x7f5d00067c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5d100010f0 tx=0x7f5d10007bf0 comp rx=0 tx=0).ready entity=mgr.5922 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:15.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:15.857+0000 7f5d16ffd640 1 -- 172.21.15.55:0/3095804859 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5d180517e0 con 0x7f5d2015a7f0 2023-08-25T04:16:16.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.053+0000 7f5d24d96640 1 -- 172.21.15.55:0/3095804859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f5d200ca100 con 0x7f5d2015a7f0 2023-08-25T04:16:16.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.617+0000 7f5d16ffd640 1 -- 172.21.15.55:0/3095804859 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 19) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f5d18051bb0 con 0x7f5d2015a7f0 2023-08-25T04:16:16.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.617+0000 7f5d16ffd640 1 -- 172.21.15.55:0/3095804859 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) v1 ==== 92+0+0 (secure 0 0 0) 0x7f5d180517e0 con 0x7f5d2015a7f0 2023-08-25T04:16:16.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.621+0000 7f5d24d96640 1 -- 172.21.15.55:0/3095804859 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f5d000657a0 msgr2=0x7f5d00067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.621+0000 7f5d24d96640 1 --2- 172.21.15.55:0/3095804859 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f5d000657a0 0x7f5d00067c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5d100010f0 tx=0x7f5d10007bf0 comp rx=0 tx=0).stop 2023-08-25T04:16:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.621+0000 7f5d24d96640 1 -- 172.21.15.55:0/3095804859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d2015a7f0 msgr2=0x7f5d20154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.621+0000 7f5d24d96640 1 --2- 172.21.15.55:0/3095804859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d2015a7f0 0x7f5d20154d10 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5d1800efb0 tx=0x7f5d1800c490 comp rx=0 tx=0).stop 2023-08-25T04:16:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.621+0000 7f5d24d96640 1 -- 172.21.15.55:0/3095804859 shutdown_connections 2023-08-25T04:16:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.621+0000 7f5d24d96640 1 --2- 172.21.15.55:0/3095804859 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f5d000657a0 0x7f5d00067c60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.621+0000 7f5d24d96640 1 --2- 172.21.15.55:0/3095804859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d2015a7f0 0x7f5d20154d10 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.621+0000 7f5d24d96640 1 --2- 172.21.15.55:0/3095804859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d200c9830 0x7f5d200cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.621+0000 7f5d24d96640 1 --2- 172.21.15.55:0/3095804859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d2006c020 0x7f5d2014d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.621+0000 7f5d24d96640 1 -- 172.21.15.55:0/3095804859 >> 172.21.15.55:0/3095804859 conn(0x7f5d20069900 msgr2=0x7f5d20069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.621+0000 7f5d24d96640 1 -- 172.21.15.55:0/3095804859 shutdown_connections 2023-08-25T04:16:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.621+0000 7f5d24d96640 1 -- 172.21.15.55:0/3095804859 wait complete. 2023-08-25T04:16:16.642 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-25T04:16:16.792 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:16.788+0000 7f156a857180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:16:16.793 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:16.793+0000 7fd41eed0180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:16:16.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.793+0000 7fbdc09a3640 1 Processor -- start 2023-08-25T04:16:16.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.793+0000 7fbdc09a3640 1 -- start start 2023-08-25T04:16:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.793+0000 7fbdc09a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdbc1601f0 0x7fbdbc15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.793+0000 7fbdc09a3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbdbc15e3c0 0x7fbdbc0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.793+0000 7fbdc09a3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdbc15f8b0 con 0x7fbdbc0d10c0 2023-08-25T04:16:16.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.793+0000 7fbdc09a3640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdbc0cd5a0 con 0x7fbdbc15e3c0 2023-08-25T04:16:16.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.793+0000 7fbdc09a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc0cd880 con 0x7fbdbc1601f0 2023-08-25T04:16:16.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.793+0000 7fbdba59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdbc1601f0 0x7fbdbc15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:16.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.793+0000 7fbdbad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbdbc0d10c0 0x7fbdbc0b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50396/0 (socket says 172.21.15.55:50396) 2023-08-25T04:16:16.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.793+0000 7fbdbad9d640 1 -- 172.21.15.55:0/4256741942 learned_addr learned my addr 172.21.15.55:0/4256741942 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:16:16.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.793+0000 7fbdb3fff640 1 --2- 172.21.15.55:0/4256741942 >> v2:172.21.15.110:3300/0 conn(0x7fbdbc15e3c0 0x7fbdbc0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:16.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.797+0000 7fbdba59c640 1 -- 172.21.15.55:0/4256741942 >> v2:172.21.15.110:3300/0 conn(0x7fbdbc15e3c0 msgr2=0x7fbdbc0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:16.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.797+0000 7fbdba59c640 1 --2- 172.21.15.55:0/4256741942 >> v2:172.21.15.110:3300/0 conn(0x7fbdbc15e3c0 0x7fbdbc0d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:16.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.797+0000 7fbdb9d9b640 1 -- 172.21.15.55:0/4256741942 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651408325 0 0) 0x7fbdbc15f8b0 con 0x7fbdbc0d10c0 2023-08-25T04:16:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.797+0000 7fbdba59c640 1 -- 172.21.15.55:0/4256741942 >> v1:172.21.15.55:6789/0 conn(0x7fbdbc0d10c0 legacy=0x7fbdbc0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.797+0000 7fbdba59c640 1 -- 172.21.15.55:0/4256741942 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc0cdb60 con 0x7fbdbc1601f0 2023-08-25T04:16:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.797+0000 7fbdba59c640 1 --2- 172.21.15.55:0/4256741942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdbc1601f0 0x7fbdbc15d430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbdac0097a0 tx=0x7fbdac01ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ed723c3c17e666a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.797+0000 7fbdb9d9b640 1 -- 172.21.15.55:0/4256741942 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac0a8950 con 0x7fbdbc1601f0 2023-08-25T04:16:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.797+0000 7fbdb9d9b640 1 -- 172.21.15.55:0/4256741942 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac0a8ab0 con 0x7fbdbc1601f0 2023-08-25T04:16:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.797+0000 7fbdb9d9b640 1 -- 172.21.15.55:0/4256741942 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac0a8e40 con 0x7fbdbc1601f0 2023-08-25T04:16:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdc09a3640 1 -- 172.21.15.55:0/4256741942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdbc1601f0 msgr2=0x7fbdbc15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdc09a3640 1 --2- 172.21.15.55:0/4256741942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdbc1601f0 0x7fbdbc15d430 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbdac0097a0 tx=0x7fbdac01ec50 comp rx=0 tx=0).stop 2023-08-25T04:16:16.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdc09a3640 1 -- 172.21.15.55:0/4256741942 shutdown_connections 2023-08-25T04:16:16.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdc09a3640 1 --2- 172.21.15.55:0/4256741942 >> v2:172.21.15.110:3300/0 conn(0x7fbdbc15e3c0 0x7fbdbc0d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:16.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdc09a3640 1 --2- 172.21.15.55:0/4256741942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdbc1601f0 0x7fbdbc15d430 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:16.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdc09a3640 1 -- 172.21.15.55:0/4256741942 >> 172.21.15.55:0/4256741942 conn(0x7fbdbc0d27d0 msgr2=0x7fbdbc0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:16.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdc09a3640 1 -- 172.21.15.55:0/4256741942 shutdown_connections 2023-08-25T04:16:16.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdc09a3640 1 -- 172.21.15.55:0/4256741942 wait complete. 2023-08-25T04:16:16.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdc09a3640 1 Processor -- start 2023-08-25T04:16:16.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdc09a3640 1 -- start start 2023-08-25T04:16:16.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdc09a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdbc0d10c0 0x7fbdbc0b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:16.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdc09a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdbc15e3c0 0x7fbdbc15be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:16.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdc09a3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdbc1601f0 0x7fbdbc0af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:16.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdc09a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc0b2740 con 0x7fbdbc15e3c0 2023-08-25T04:16:16.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdc09a3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc0b3110 con 0x7fbdbc1601f0 2023-08-25T04:16:16.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdc09a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc0b1b30 con 0x7fbdbc0d10c0 2023-08-25T04:16:16.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdb3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdbc15e3c0 0x7fbdbc15be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:16.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdb3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdbc15e3c0 0x7fbdbc15be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35200/0 (socket says 172.21.15.55:35200) 2023-08-25T04:16:16.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdb3fff640 1 -- 172.21.15.55:0/3213357723 learned_addr learned my addr 172.21.15.55:0/3213357723 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:16.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdba59c640 1 --2- 172.21.15.55:0/3213357723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdbc0d10c0 0x7fbdbc0b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:16.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdbad9d640 1 --2- 172.21.15.55:0/3213357723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdbc1601f0 0x7fbdbc0af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:16.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdb3fff640 1 -- 172.21.15.55:0/3213357723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdbc0d10c0 msgr2=0x7fbdbc0b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:16.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.801+0000 7fbdb3fff640 1 --2- 172.21.15.55:0/3213357723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdbc0d10c0 0x7fbdbc0b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:16.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.805+0000 7fbdb3fff640 1 -- 172.21.15.55:0/3213357723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdbc1601f0 msgr2=0x7fbdbc0af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:16.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.805+0000 7fbdb3fff640 1 --2- 172.21.15.55:0/3213357723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdbc1601f0 0x7fbdbc0af380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.805+0000 7fbdb3fff640 1 -- 172.21.15.55:0/3213357723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac0093b0 con 0x7fbdbc15e3c0 2023-08-25T04:16:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.805+0000 7fbdbad9d640 1 --2- 172.21.15.55:0/3213357723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdbc1601f0 0x7fbdbc0af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:16:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.805+0000 7fbdb3fff640 1 --2- 172.21.15.55:0/3213357723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdbc15e3c0 0x7fbdbc15be10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fbda400e930 tx=0x7fbda400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:16.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.805+0000 7fbdb2ffd640 1 -- 172.21.15.55:0/3213357723 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda4009690 con 0x7fbdbc15e3c0 2023-08-25T04:16:16.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.805+0000 7fbdb2ffd640 1 -- 172.21.15.55:0/3213357723 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda400ca00 con 0x7fbdbc15e3c0 2023-08-25T04:16:16.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.805+0000 7fbdc09a3640 1 -- 172.21.15.55:0/3213357723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdbc0b1e10 con 0x7fbdbc15e3c0 2023-08-25T04:16:16.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.805+0000 7fbdb2ffd640 1 -- 172.21.15.55:0/3213357723 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda400cd70 con 0x7fbdbc15e3c0 2023-08-25T04:16:16.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.805+0000 7fbdc09a3640 1 -- 172.21.15.55:0/3213357723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdbc0b23d0 con 0x7fbdbc15e3c0 2023-08-25T04:16:16.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.805+0000 7fbdc09a3640 1 -- 172.21.15.55:0/3213357723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdbc0b5260 con 0x7fbdbc15e3c0 2023-08-25T04:16:16.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.805+0000 7fbdb2ffd640 1 -- 172.21.15.55:0/3213357723 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 85081+0+0 (secure 0 0 0) 0x7fbda4013470 con 0x7fbdbc15e3c0 2023-08-25T04:16:16.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.809+0000 7fbdb2ffd640 1 --2- 172.21.15.55:0/3213357723 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fbd9c065820 0x7fbd9c067ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:16.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.809+0000 7fbdb2ffd640 1 -- 172.21.15.55:0/3213357723 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbda40838f0 con 0x7fbdbc15e3c0 2023-08-25T04:16:16.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.809+0000 7fbdba59c640 1 -- 172.21.15.55:0/3213357723 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fbd9c065820 msgr2=0x7fbd9c067ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/1373721950 2023-08-25T04:16:16.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.809+0000 7fbdba59c640 1 --2- 172.21.15.55:0/3213357723 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fbd9c065820 0x7fbd9c067ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:16:16.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.809+0000 7fbdb2ffd640 1 -- 172.21.15.55:0/3213357723 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbda4051480 con 0x7fbdbc15e3c0 2023-08-25T04:16:16.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.969+0000 7fbdc09a3640 1 -- 172.21.15.55:0/3213357723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fbdbc073ec0 con 0x7fbdbc15e3c0 2023-08-25T04:16:16.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.973+0000 7fbdb2ffd640 1 -- 172.21.15.55:0/3213357723 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v17)=0 v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbda4054aa0 con 0x7fbdbc15e3c0 2023-08-25T04:16:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.977+0000 7fbdc09a3640 1 -- 172.21.15.55:0/3213357723 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fbd9c065820 msgr2=0x7fbd9c067ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:16:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.977+0000 7fbdc09a3640 1 --2- 172.21.15.55:0/3213357723 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fbd9c065820 0x7fbd9c067ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.977+0000 7fbdc09a3640 1 -- 172.21.15.55:0/3213357723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdbc15e3c0 msgr2=0x7fbdbc15be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.977+0000 7fbdc09a3640 1 --2- 172.21.15.55:0/3213357723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdbc15e3c0 0x7fbdbc15be10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fbda400e930 tx=0x7fbda400edf0 comp rx=0 tx=0).stop 2023-08-25T04:16:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.977+0000 7fbdc09a3640 1 -- 172.21.15.55:0/3213357723 shutdown_connections 2023-08-25T04:16:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.977+0000 7fbdc09a3640 1 --2- 172.21.15.55:0/3213357723 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7fbd9c065820 0x7fbd9c067ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.977+0000 7fbdc09a3640 1 --2- 172.21.15.55:0/3213357723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdbc1601f0 0x7fbdbc0af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.977+0000 7fbdc09a3640 1 --2- 172.21.15.55:0/3213357723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdbc15e3c0 0x7fbdbc15be10 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.977+0000 7fbdc09a3640 1 --2- 172.21.15.55:0/3213357723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdbc0d10c0 0x7fbdbc0b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.977+0000 7fbdc09a3640 1 -- 172.21.15.55:0/3213357723 >> 172.21.15.55:0/3213357723 conn(0x7fbdbc0d27d0 msgr2=0x7fbdbc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:16.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.977+0000 7fbdc09a3640 1 -- 172.21.15.55:0/3213357723 shutdown_connections 2023-08-25T04:16:16.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:16.977+0000 7fbdc09a3640 1 -- 172.21.15.55:0/3213357723 wait complete. 2023-08-25T04:16:16.997 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-08-25T04:16:17.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.145+0000 7f889dce5640 1 Processor -- start 2023-08-25T04:16:17.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.145+0000 7f889dce5640 1 -- start start 2023-08-25T04:16:17.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.145+0000 7f889dce5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f88981601f0 0x7f889815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:17.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.145+0000 7f889dce5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f889815e3c0 0x7f88980d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:17.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.145+0000 7f889dce5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889815f8b0 con 0x7f88980d10c0 2023-08-25T04:16:17.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.145+0000 7f889dce5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88980cd5a0 con 0x7f889815e3c0 2023-08-25T04:16:17.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.145+0000 7f889dce5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88980cd880 con 0x7f88981601f0 2023-08-25T04:16:17.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.145+0000 7f888ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f889815e3c0 0x7f88980d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:17.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.145+0000 7f88977fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f88981601f0 0x7f889815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:17.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.145+0000 7f888ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f889815e3c0 0x7f88980d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35202/0 (socket says 172.21.15.55:35202) 2023-08-25T04:16:17.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.145+0000 7f888ffff640 1 -- 172.21.15.55:0/125794 learned_addr learned my addr 172.21.15.55:0/125794 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:17.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.149+0000 7f888ffff640 1 -- 172.21.15.55:0/125794 >> v2:172.21.15.110:3300/0 conn(0x7f88981601f0 msgr2=0x7f889815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:17.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.149+0000 7f888ffff640 1 --2- 172.21.15.55:0/125794 >> v2:172.21.15.110:3300/0 conn(0x7f88981601f0 0x7f889815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:17.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.149+0000 7f888ffff640 1 -- 172.21.15.55:0/125794 >> v1:172.21.15.110:6789/0 conn(0x7f88980d10c0 legacy=0x7f88980b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:17.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.149+0000 7f888ffff640 1 -- 172.21.15.55:0/125794 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88980cdb60 con 0x7f889815e3c0 2023-08-25T04:16:17.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.149+0000 7f888ffff640 1 --2- 172.21.15.55:0/125794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f889815e3c0 0x7f88980d0b80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f889808b7f0 tx=0x7f888001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2f7f7989f75957 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:17.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.149+0000 7f8896ffd640 1 -- 172.21.15.55:0/125794 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88800ac640 con 0x7f889815e3c0 2023-08-25T04:16:17.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.149+0000 7f8896ffd640 1 -- 172.21.15.55:0/125794 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88800ac7a0 con 0x7f889815e3c0 2023-08-25T04:16:17.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.149+0000 7f8896ffd640 1 -- 172.21.15.55:0/125794 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88800acb30 con 0x7f889815e3c0 2023-08-25T04:16:17.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.149+0000 7f889dce5640 1 -- 172.21.15.55:0/125794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f889815e3c0 msgr2=0x7f88980d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:17.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.149+0000 7f889dce5640 1 --2- 172.21.15.55:0/125794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f889815e3c0 0x7f88980d0b80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f889808b7f0 tx=0x7f888001c4d0 comp rx=0 tx=0).stop 2023-08-25T04:16:17.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f889dce5640 1 -- 172.21.15.55:0/125794 shutdown_connections 2023-08-25T04:16:17.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f889dce5640 1 --2- 172.21.15.55:0/125794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f889815e3c0 0x7f88980d0b80 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f889dce5640 1 --2- 172.21.15.55:0/125794 >> v2:172.21.15.110:3300/0 conn(0x7f88981601f0 0x7f889815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f889dce5640 1 -- 172.21.15.55:0/125794 >> 172.21.15.55:0/125794 conn(0x7f88980d27d0 msgr2=0x7f88980d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f889dce5640 1 -- 172.21.15.55:0/125794 shutdown_connections 2023-08-25T04:16:17.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f889dce5640 1 -- 172.21.15.55:0/125794 wait complete. 2023-08-25T04:16:17.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f889dce5640 1 Processor -- start 2023-08-25T04:16:17.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f889dce5640 1 -- start start 2023-08-25T04:16:17.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f889dce5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88980d10c0 0x7f88980b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:17.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f889dce5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f889815e3c0 0x7f88980c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:17.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f889dce5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88981601f0 0x7f88980b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:17.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f889dce5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88980b5800 con 0x7f88980d10c0 2023-08-25T04:16:17.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f889dce5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88980c8a20 con 0x7f88981601f0 2023-08-25T04:16:17.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f889dce5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88980c8d00 con 0x7f889815e3c0 2023-08-25T04:16:17.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f88977fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88980d10c0 0x7f88980b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:17.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f88977fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88980d10c0 0x7f88980b6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35218/0 (socket says 172.21.15.55:35218) 2023-08-25T04:16:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f88977fe640 1 -- 172.21.15.55:0/2324153411 learned_addr learned my addr 172.21.15.55:0/2324153411 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f888ffff640 1 --2- 172.21.15.55:0/2324153411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f889815e3c0 0x7f88980c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f8897fff640 1 --2- 172.21.15.55:0/2324153411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88981601f0 0x7f88980b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f88977fe640 1 -- 172.21.15.55:0/2324153411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f889815e3c0 msgr2=0x7f88980c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:17.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f88977fe640 1 --2- 172.21.15.55:0/2324153411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f889815e3c0 0x7f88980c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:17.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f88977fe640 1 -- 172.21.15.55:0/2324153411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88981601f0 msgr2=0x7f88980b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:17.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f88977fe640 1 --2- 172.21.15.55:0/2324153411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88981601f0 0x7f88980b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:17.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f88977fe640 1 -- 172.21.15.55:0/2324153411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88800094d0 con 0x7f88980d10c0 2023-08-25T04:16:17.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.153+0000 7f88977fe640 1 --2- 172.21.15.55:0/2324153411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88980d10c0 0x7f88980b6590 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f888800e870 tx=0x7f888800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:17.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.157+0000 7f8894ff9640 1 -- 172.21.15.55:0/2324153411 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88880095d0 con 0x7f88980d10c0 2023-08-25T04:16:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.157+0000 7f8894ff9640 1 -- 172.21.15.55:0/2324153411 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888800c940 con 0x7f88980d10c0 2023-08-25T04:16:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.157+0000 7f8894ff9640 1 -- 172.21.15.55:0/2324153411 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888800ccb0 con 0x7f88980d10c0 2023-08-25T04:16:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.157+0000 7f889dce5640 1 -- 172.21.15.55:0/2324153411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88980ce7c0 con 0x7f88980d10c0 2023-08-25T04:16:17.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.157+0000 7f889dce5640 1 -- 172.21.15.55:0/2324153411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88980b5490 con 0x7f88980d10c0 2023-08-25T04:16:17.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.157+0000 7f889dce5640 1 -- 172.21.15.55:0/2324153411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8898073ec0 con 0x7f88980d10c0 2023-08-25T04:16:17.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.157+0000 7f8894ff9640 1 -- 172.21.15.55:0/2324153411 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f8888013470 con 0x7f88980d10c0 2023-08-25T04:16:17.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.157+0000 7f8894ff9640 1 --2- 172.21.15.55:0/2324153411 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f88780657f0 0x7f8878067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:17.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.157+0000 7f888ffff640 1 -- 172.21.15.55:0/2324153411 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f88780657f0 msgr2=0x7f8878067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/1373721950 2023-08-25T04:16:17.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.157+0000 7f8894ff9640 1 -- 172.21.15.55:0/2324153411 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8888083570 con 0x7f88980d10c0 2023-08-25T04:16:17.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.157+0000 7f888ffff640 1 --2- 172.21.15.55:0/2324153411 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f88780657f0 0x7f8878067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:16:17.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.161+0000 7f8894ff9640 1 -- 172.21.15.55:0/2324153411 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8888050ff0 con 0x7f88980d10c0 2023-08-25T04:16:17.210 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:17.208+0000 7f156a857180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:16:17.244 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:17.245+0000 7fd41eed0180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:16:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.325+0000 7f889dce5640 1 -- 172.21.15.55:0/2324153411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f88980cefc0 con 0x7f88980d10c0 2023-08-25T04:16:17.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.329+0000 7f8894ff9640 1 -- 172.21.15.55:0/2324153411 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v18)=0 v18) v1 ==== 133+0+0 (secure 0 0 0) 0x7f8888054610 con 0x7f88980d10c0 2023-08-25T04:16:17.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.333+0000 7f889dce5640 1 -- 172.21.15.55:0/2324153411 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f88780657f0 msgr2=0x7f8878067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:16:17.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.333+0000 7f889dce5640 1 --2- 172.21.15.55:0/2324153411 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f88780657f0 0x7f8878067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.333+0000 7f889dce5640 1 -- 172.21.15.55:0/2324153411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88980d10c0 msgr2=0x7f88980b6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.333+0000 7f889dce5640 1 --2- 172.21.15.55:0/2324153411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88980d10c0 0x7f88980b6590 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f888800e870 tx=0x7f888800ed30 comp rx=0 tx=0).stop 2023-08-25T04:16:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.333+0000 7f889dce5640 1 -- 172.21.15.55:0/2324153411 shutdown_connections 2023-08-25T04:16:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.333+0000 7f889dce5640 1 --2- 172.21.15.55:0/2324153411 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f88780657f0 0x7f8878067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.333+0000 7f889dce5640 1 --2- 172.21.15.55:0/2324153411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88981601f0 0x7f88980b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:17.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.333+0000 7f889dce5640 1 --2- 172.21.15.55:0/2324153411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f889815e3c0 0x7f88980c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:17.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.333+0000 7f889dce5640 1 --2- 172.21.15.55:0/2324153411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88980d10c0 0x7f88980b6590 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:17.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.333+0000 7f889dce5640 1 -- 172.21.15.55:0/2324153411 >> 172.21.15.55:0/2324153411 conn(0x7f88980d27d0 msgr2=0x7f88980b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:17.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.333+0000 7f889dce5640 1 -- 172.21.15.55:0/2324153411 shutdown_connections 2023-08-25T04:16:17.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.333+0000 7f889dce5640 1 -- 172.21.15.55:0/2324153411 wait complete. 2023-08-25T04:16:17.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:17.351 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-25T04:16:17.362 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:17.360+0000 7f156a857180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:16:17.368 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-08-25T04:16:17.406 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:17.405+0000 7fd41eed0180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:16:17.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.557+0000 7f38903db640 1 Processor -- start 2023-08-25T04:16:17.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.557+0000 7f38903db640 1 -- start start 2023-08-25T04:16:17.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.557+0000 7f38903db640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f388815cb40 0x7f38880d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:17.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.557+0000 7f38903db640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38880d1970 con 0x7f38880cf340 2023-08-25T04:16:17.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.557+0000 7f38903db640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38880b5200 con 0x7f38880b6a00 2023-08-25T04:16:17.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.557+0000 7f38903db640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38880d0d80 con 0x7f388815cb40 2023-08-25T04:16:17.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.557+0000 7f388e177640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f388815cb40 0x7f38880d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.557+0000 7f388d976640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f38880cf340 0x7f38880b43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50400/0 (socket says 172.21.15.55:50400) 2023-08-25T04:16:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.557+0000 7f388e177640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f388815cb40 0x7f38880d2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35226/0 (socket says 172.21.15.55:35226) 2023-08-25T04:16:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.557+0000 7f388d976640 1 -- 172.21.15.55:0/1479519273 learned_addr learned my addr 172.21.15.55:0/1479519273 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:16:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.557+0000 7f388e177640 1 -- 172.21.15.55:0/1479519273 >> v1:172.21.15.110:6789/0 conn(0x7f38880b6a00 legacy=0x7f38880b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.557+0000 7f388e177640 1 -- 172.21.15.55:0/1479519273 >> v1:172.21.15.55:6789/0 conn(0x7f38880cf340 legacy=0x7f38880b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.557+0000 7f388e177640 1 -- 172.21.15.55:0/1479519273 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38880d1040 con 0x7f388815cb40 2023-08-25T04:16:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.557+0000 7f388d175640 1 -- 172.21.15.55:0/1479519273 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552712281 0 0) 0x7f38880d1970 con 0x7f38880cf340 2023-08-25T04:16:17.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.561+0000 7f388e177640 1 --2- 172.21.15.55:0/1479519273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f388815cb40 0x7f38880d2080 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f38840097c0 tx=0x7f388401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69cd65e0b0ad9ad server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:17.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.561+0000 7f388d175640 1 -- 172.21.15.55:0/1479519273 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38840a8970 con 0x7f388815cb40 2023-08-25T04:16:17.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.561+0000 7f388d175640 1 -- 172.21.15.55:0/1479519273 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38840a8ad0 con 0x7f388815cb40 2023-08-25T04:16:17.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.561+0000 7f388d175640 1 -- 172.21.15.55:0/1479519273 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38840a8e60 con 0x7f388815cb40 2023-08-25T04:16:17.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.561+0000 7f38903db640 1 -- 172.21.15.55:0/1479519273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f388815cb40 msgr2=0x7f38880d2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:17.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.561+0000 7f38903db640 1 --2- 172.21.15.55:0/1479519273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f388815cb40 0x7f38880d2080 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f38840097c0 tx=0x7f388401ec70 comp rx=0 tx=0).stop 2023-08-25T04:16:17.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.561+0000 7f38903db640 1 -- 172.21.15.55:0/1479519273 shutdown_connections 2023-08-25T04:16:17.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.561+0000 7f38903db640 1 --2- 172.21.15.55:0/1479519273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f388815cb40 0x7f38880d2080 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:17.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.561+0000 7f38903db640 1 -- 172.21.15.55:0/1479519273 >> 172.21.15.55:0/1479519273 conn(0x7f388806aae0 msgr2=0x7f388806aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:17.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.561+0000 7f38903db640 1 -- 172.21.15.55:0/1479519273 shutdown_connections 2023-08-25T04:16:17.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.561+0000 7f38903db640 1 -- 172.21.15.55:0/1479519273 wait complete. 2023-08-25T04:16:17.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.565+0000 7f38903db640 1 Processor -- start 2023-08-25T04:16:17.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.565+0000 7f38903db640 1 -- start start 2023-08-25T04:16:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.565+0000 7f38903db640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38880b6a00 0x7f38880c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.565+0000 7f38903db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38880cf340 0x7f38880cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.565+0000 7f38903db640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f388815cb40 0x7f38880ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.565+0000 7f38903db640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388815e910 con 0x7f38880cf340 2023-08-25T04:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.565+0000 7f38903db640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38880c7510 con 0x7f388815cb40 2023-08-25T04:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.565+0000 7f38903db640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388815df70 con 0x7f38880b6a00 2023-08-25T04:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.565+0000 7f388d976640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38880cf340 0x7f38880cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.569+0000 7f388e177640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38880b6a00 0x7f38880c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.569+0000 7f388d976640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38880cf340 0x7f38880cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35242/0 (socket says 172.21.15.55:35242) 2023-08-25T04:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.569+0000 7f388d976640 1 -- 172.21.15.55:0/1522000113 learned_addr learned my addr 172.21.15.55:0/1522000113 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.569+0000 7f388e978640 1 --2- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f388815cb40 0x7f38880ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.569+0000 7f388d976640 1 -- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38880b6a00 msgr2=0x7f38880c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.569+0000 7f388d976640 1 --2- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38880b6a00 0x7f38880c6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.569+0000 7f388d976640 1 -- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f388815cb40 msgr2=0x7f38880ca8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.569+0000 7f388d976640 1 --2- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f388815cb40 0x7f38880ca8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:17.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.569+0000 7f388d976640 1 -- 172.21.15.55:0/1522000113 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3884009420 con 0x7f38880cf340 2023-08-25T04:16:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.569+0000 7f388d976640 1 --2- 172.21.15.55:0/1522000113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38880cf340 0x7f38880cc530 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f387800c4a0 tx=0x7f387800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.569+0000 7f387effd640 1 -- 172.21.15.55:0/1522000113 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38780074e0 con 0x7f38880cf340 2023-08-25T04:16:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.569+0000 7f387effd640 1 -- 172.21.15.55:0/1522000113 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3878007640 con 0x7f38880cf340 2023-08-25T04:16:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.569+0000 7f387effd640 1 -- 172.21.15.55:0/1522000113 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3878004a30 con 0x7f38880cf340 2023-08-25T04:16:17.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.569+0000 7f38903db640 1 -- 172.21.15.55:0/1522000113 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f388815e250 con 0x7f38880cf340 2023-08-25T04:16:17.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.569+0000 7f38903db640 1 -- 172.21.15.55:0/1522000113 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38881f2e90 con 0x7f38880cf340 2023-08-25T04:16:17.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.569+0000 7f38903db640 1 -- 172.21.15.55:0/1522000113 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3888071f80 con 0x7f38880cf340 2023-08-25T04:16:17.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.569+0000 7f387effd640 1 -- 172.21.15.55:0/1522000113 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 19) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f3878004b90 con 0x7f38880cf340 2023-08-25T04:16:17.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.573+0000 7f387effd640 1 --2- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f386c0657f0 0x7f386c067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:17.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.573+0000 7f387effd640 1 -- 172.21.15.55:0/1522000113 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38780821f0 con 0x7f38880cf340 2023-08-25T04:16:17.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.573+0000 7f388e177640 1 -- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f386c0657f0 msgr2=0x7f386c067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/1373721950 2023-08-25T04:16:17.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.573+0000 7f388e177640 1 --2- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f386c0657f0 0x7f386c067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:16:17.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.577+0000 7f387effd640 1 -- 172.21.15.55:0/1522000113 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f387804fc40 con 0x7f38880cf340 2023-08-25T04:16:17.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.753+0000 7f38903db640 1 -- 172.21.15.55:0/1522000113 --> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f38880d1600 con 0x7f386c0657f0 2023-08-25T04:16:17.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.777+0000 7f388e177640 1 -- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f386c0657f0 msgr2=0x7f386c067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/1373721950 2023-08-25T04:16:17.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:17.777+0000 7f388e177640 1 --2- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f386c0657f0 0x7f386c067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-25T04:16:17.852 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:17.848+0000 7f156a857180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:16:17.913 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:17.908+0000 7f156a857180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:16:17.929 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:17.929+0000 7fd41eed0180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:16:17.967 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:17.964+0000 7f156a857180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:16:17.991 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:17.989+0000 7fd41eed0180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:16:18.049 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:18.049+0000 7fd41eed0180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:16:18.052 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:18.048+0000 7f156a857180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:16:18.109 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:18.108+0000 7f156a857180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:16:18.141 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:18.141+0000 7fd41eed0180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:16:18.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:18.181+0000 7f388e177640 1 -- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f386c0657f0 msgr2=0x7f386c067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/1373721950 2023-08-25T04:16:18.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:18.181+0000 7f388e177640 1 --2- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f386c0657f0 0x7f386c067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-25T04:16:18.193 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:18.192+0000 7f156a857180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:16:18.200 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:18.201+0000 7fd41eed0180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:16:18.250 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:18.252+0000 7f156a857180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:16:18.289 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:18.289+0000 7fd41eed0180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:16:18.349 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:18.349+0000 7fd41eed0180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:16:18.393 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:18.396+0000 7f156a857180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:16:18.451 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:18.452+0000 7f156a857180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:16:18.500 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:18.501+0000 7fd41eed0180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:16:18.561 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:18.561+0000 7fd41eed0180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:16:18.691 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:16:18.691 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:16:18.691 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:16:18.699 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:18.700+0000 7f156a857180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:16:18.815 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:16:18.816 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:16:18.816 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:16:18.824 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:18.825+0000 7fd41eed0180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:16:18.837 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:18.840+0000 7f156a857180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:16:18.962 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:18.964+0000 7f156a857180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:16:18.967 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:18.965+0000 7fd41eed0180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:16:18.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:18.985+0000 7f388e177640 1 -- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f386c0657f0 msgr2=0x7f386c067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/1373721950 2023-08-25T04:16:18.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:18.985+0000 7f388e177640 1 --2- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f386c0657f0 0x7f386c067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-25T04:16:19.033 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:19.036+0000 7f156a857180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:16:19.099 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:19.101+0000 7fd41eed0180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:16:19.169 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:19.172+0000 7f156a857180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:16:19.173 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:19.173+0000 7fd41eed0180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:16:19.318 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:19.317+0000 7fd41eed0180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:16:19.708 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:19.707+0000 7f156a857180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:16:19.796 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:19.795+0000 7f156a857180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:16:19.897 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:19.897+0000 7fd41eed0180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:16:19.945 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:19.943+0000 7f156a857180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:16:19.986 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:19.985+0000 7fd41eed0180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:16:20.029 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:20.031+0000 7f156a857180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:16:20.144 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:20.145+0000 7fd41eed0180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:16:20.234 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:20.233+0000 7fd41eed0180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:16:20.352 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:20.347+0000 7f156a857180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:16:20.408 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:20.407+0000 7f156a857180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:16:20.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:20.421+0000 7f387effd640 1 -- 172.21.15.55:0/1522000113 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 20) v1 ==== 84690+0+0 (secure 0 0 0) 0x7f3878050010 con 0x7f38880cf340 2023-08-25T04:16:20.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:20.421+0000 7f387effd640 1 -- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f386c0657f0 msgr2=0x7f386c067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:16:20.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:20.421+0000 7f387effd640 1 --2- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:6832/1373721950,v1:172.21.15.110:6833/1373721950] conn(0x7f386c0657f0 0x7f386c067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:20.540 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:20.539+0000 7f14efcea640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:16:20.540 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:20.539+0000 7f14efcea640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:16:20.541 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:20.539+0000 7f14efcea640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:16:20.541 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:20.539+0000 7f14efcea640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:16:20.541 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:20.539+0000 7f14efcea640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:16:20.542 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:20.539+0000 7f14ecce4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:16:20.542 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:20.539+0000 7f14ecce4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:16:20.542 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:20.539+0000 7f14ecce4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:16:20.543 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:20.539+0000 7f14ecce4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:16:20.543 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:16:20.539+0000 7f14ecce4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:16:20.593 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:20.593+0000 7fd41eed0180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:16:20.657 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:16:20.657+0000 7fd41eed0180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:16:21.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.425+0000 7f387effd640 1 -- 172.21.15.55:0/1522000113 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 21) v1 ==== 84817+0+0 (secure 0 0 0) 0x7f3878051720 con 0x7f38880cf340 2023-08-25T04:16:21.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.425+0000 7f387effd640 1 --2- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f386c033910 0x7f386c06fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.425+0000 7f387effd640 1 -- 172.21.15.55:0/1522000113 --> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f386c033cf0 con 0x7f386c033910 2023-08-25T04:16:21.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.433+0000 7f388e177640 1 --2- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f386c033910 0x7f386c06fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:21.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.437+0000 7f388e177640 1 --2- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f386c033910 0x7f386c06fcd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f38840b2000 tx=0x7f38840aa070 comp rx=0 tx=0).ready entity=mgr.6049 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:21.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.497+0000 7f387effd640 1 -- 172.21.15.55:0/1522000113 <== mgr.6049 v2:172.21.15.110:6832/3383442930 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f386c033cf0 con 0x7f386c033910 2023-08-25T04:16:21.498 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path snap_test_dir1 2023-08-25T04:16:21.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.501+0000 7f38903db640 1 -- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f386c033910 msgr2=0x7f386c06fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:21.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.501+0000 7f38903db640 1 --2- 172.21.15.55:0/1522000113 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f386c033910 0x7f386c06fcd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f38840b2000 tx=0x7f38840aa070 comp rx=0 tx=0).stop 2023-08-25T04:16:21.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.501+0000 7f38903db640 1 -- 172.21.15.55:0/1522000113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38880cf340 msgr2=0x7f38880cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:21.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.501+0000 7f38903db640 1 --2- 172.21.15.55:0/1522000113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38880cf340 0x7f38880cc530 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f387800c4a0 tx=0x7f387800c960 comp rx=0 tx=0).stop 2023-08-25T04:16:21.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.501+0000 7f388e978640 1 -- 172.21.15.55:0/1522000113 reap_dead start 2023-08-25T04:16:21.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.501+0000 7f38903db640 1 -- 172.21.15.55:0/1522000113 shutdown_connections 2023-08-25T04:16:21.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.501+0000 7f38903db640 1 -- 172.21.15.55:0/1522000113 >> 172.21.15.55:0/1522000113 conn(0x7f388806aae0 msgr2=0x7f38880b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:21.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.501+0000 7f38903db640 1 -- 172.21.15.55:0/1522000113 shutdown_connections 2023-08-25T04:16:21.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.501+0000 7f38903db640 1 -- 172.21.15.55:0/1522000113 wait complete. 2023-08-25T04:16:21.521 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-25T04:16:21.522 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-08-25T04:16:21.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.673+0000 7fe7b8c34640 1 Processor -- start 2023-08-25T04:16:21.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.673+0000 7fe7b8c34640 1 -- start start 2023-08-25T04:16:21.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.673+0000 7fe7b8c34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b40afa20 0x7fe7b40b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:21.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.673+0000 7fe7b8c34640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe7b40cf9b0 0x7fe7b40ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.673+0000 7fe7b8c34640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b40cae70 con 0x7fe7b40cd160 2023-08-25T04:16:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.673+0000 7fe7b8c34640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b40cfe10 con 0x7fe7b40cf9b0 2023-08-25T04:16:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.673+0000 7fe7b8c34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40cb0e0 con 0x7fe7b40afa20 2023-08-25T04:16:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.673+0000 7fe7b259c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b40afa20 0x7fe7b40b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.673+0000 7fe7b2d9d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fe7b40cd160 0x7fe7b415c3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:42044/0 (socket says 172.21.15.55:42044) 2023-08-25T04:16:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.673+0000 7fe7b2d9d640 1 -- 172.21.15.55:0/388560332 learned_addr learned my addr 172.21.15.55:0/388560332 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:16:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.673+0000 7fe7abfff640 1 --2- 172.21.15.55:0/388560332 >> v2:172.21.15.110:3300/0 conn(0x7fe7b40cf9b0 0x7fe7b40ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.673+0000 7fe7b259c640 1 -- 172.21.15.55:0/388560332 >> v2:172.21.15.110:3300/0 conn(0x7fe7b40cf9b0 msgr2=0x7fe7b40ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:21.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.673+0000 7fe7b259c640 1 --2- 172.21.15.55:0/388560332 >> v2:172.21.15.110:3300/0 conn(0x7fe7b40cf9b0 0x7fe7b40ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:21.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.673+0000 7fe7b1d9b640 1 -- 172.21.15.55:0/388560332 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481911210 0 0) 0x7fe7b40cae70 con 0x7fe7b40cd160 2023-08-25T04:16:21.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.673+0000 7fe7b259c640 1 -- 172.21.15.55:0/388560332 >> v1:172.21.15.110:6789/0 conn(0x7fe7b40cd160 legacy=0x7fe7b415c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:21.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.673+0000 7fe7b259c640 1 -- 172.21.15.55:0/388560332 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b40cb3c0 con 0x7fe7b40afa20 2023-08-25T04:16:21.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.677+0000 7fe7b259c640 1 --2- 172.21.15.55:0/388560332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b40afa20 0x7fe7b40b00e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40097c0 tx=0x7fe7a401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72cd4fe3bf3c81e9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:21.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.677+0000 7fe7b1d9b640 1 -- 172.21.15.55:0/388560332 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40ac620 con 0x7fe7b40afa20 2023-08-25T04:16:21.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.677+0000 7fe7b1d9b640 1 -- 172.21.15.55:0/388560332 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a40ac780 con 0x7fe7b40afa20 2023-08-25T04:16:21.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.677+0000 7fe7b1d9b640 1 -- 172.21.15.55:0/388560332 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a40acb10 con 0x7fe7b40afa20 2023-08-25T04:16:21.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.677+0000 7fe7b8c34640 1 -- 172.21.15.55:0/388560332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b40afa20 msgr2=0x7fe7b40b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:21.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.677+0000 7fe7b8c34640 1 --2- 172.21.15.55:0/388560332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b40afa20 0x7fe7b40b00e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40097c0 tx=0x7fe7a401c3c0 comp rx=0 tx=0).stop 2023-08-25T04:16:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.677+0000 7fe7b8c34640 1 -- 172.21.15.55:0/388560332 shutdown_connections 2023-08-25T04:16:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.677+0000 7fe7b8c34640 1 --2- 172.21.15.55:0/388560332 >> v2:172.21.15.110:3300/0 conn(0x7fe7b40cf9b0 0x7fe7b40ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.677+0000 7fe7b8c34640 1 --2- 172.21.15.55:0/388560332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b40afa20 0x7fe7b40b00e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:21.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.677+0000 7fe7b8c34640 1 -- 172.21.15.55:0/388560332 >> 172.21.15.55:0/388560332 conn(0x7fe7b40d0780 msgr2=0x7fe7b40d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:21.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.677+0000 7fe7b8c34640 1 -- 172.21.15.55:0/388560332 shutdown_connections 2023-08-25T04:16:21.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.677+0000 7fe7b8c34640 1 -- 172.21.15.55:0/388560332 wait complete. 2023-08-25T04:16:21.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b8c34640 1 Processor -- start 2023-08-25T04:16:21.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b8c34640 1 -- start start 2023-08-25T04:16:21.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b8c34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7b40afa20 0x7fe7b41551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:21.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b8c34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b40cd160 0x7fe7b415cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:21.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b8c34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7b40cf9b0 0x7fe7b40c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:21.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b8c34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b415ac30 con 0x7fe7b40cf9b0 2023-08-25T04:16:21.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b8c34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b4155de0 con 0x7fe7b40afa20 2023-08-25T04:16:21.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b8c34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b4155820 con 0x7fe7b40cd160 2023-08-25T04:16:21.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7b40cf9b0 0x7fe7b40c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:21.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7b40cf9b0 0x7fe7b40c6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53742/0 (socket says 172.21.15.55:53742) 2023-08-25T04:16:21.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b2d9d640 1 -- 172.21.15.55:0/209301839 learned_addr learned my addr 172.21.15.55:0/209301839 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:21.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7abfff640 1 --2- 172.21.15.55:0/209301839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b40cd160 0x7fe7b415cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:21.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b259c640 1 --2- 172.21.15.55:0/209301839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7b40afa20 0x7fe7b41551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:21.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b2d9d640 1 -- 172.21.15.55:0/209301839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b40cd160 msgr2=0x7fe7b415cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:21.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b2d9d640 1 --2- 172.21.15.55:0/209301839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b40cd160 0x7fe7b415cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:21.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b2d9d640 1 -- 172.21.15.55:0/209301839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7b40afa20 msgr2=0x7fe7b41551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:21.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b2d9d640 1 --2- 172.21.15.55:0/209301839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7b40afa20 0x7fe7b41551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:21.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b2d9d640 1 -- 172.21.15.55:0/209301839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a4009420 con 0x7fe7b40cf9b0 2023-08-25T04:16:21.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7abfff640 1 --2- 172.21.15.55:0/209301839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b40cd160 0x7fe7b415cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:16:21.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b2d9d640 1 --2- 172.21.15.55:0/209301839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7b40cf9b0 0x7fe7b40c6940 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac00c780 tx=0x7fe7ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:21.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7aaffd640 1 -- 172.21.15.55:0/209301839 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00ce90 con 0x7fe7b40cf9b0 2023-08-25T04:16:21.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b8c34640 1 -- 172.21.15.55:0/209301839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b4155b00 con 0x7fe7b40cf9b0 2023-08-25T04:16:21.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7aaffd640 1 -- 172.21.15.55:0/209301839 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac00a640 con 0x7fe7b40cf9b0 2023-08-25T04:16:21.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7aaffd640 1 -- 172.21.15.55:0/209301839 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac00a9d0 con 0x7fe7b40cf9b0 2023-08-25T04:16:21.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b8c34640 1 -- 172.21.15.55:0/209301839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b40b1370 con 0x7fe7b40cf9b0 2023-08-25T04:16:21.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.681+0000 7fe7b8c34640 1 -- 172.21.15.55:0/209301839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b415ad70 con 0x7fe7b40cf9b0 2023-08-25T04:16:21.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.685+0000 7fe7aaffd640 1 -- 172.21.15.55:0/209301839 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 21) v1 ==== 84817+0+0 (secure 0 0 0) 0x7fe7ac00ab30 con 0x7fe7b40cf9b0 2023-08-25T04:16:21.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.685+0000 7fe7aaffd640 1 --2- 172.21.15.55:0/209301839 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fe794065520 0x7fe7940679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:21.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.685+0000 7fe7aaffd640 1 -- 172.21.15.55:0/209301839 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fe7ac0821c0 con 0x7fe7b40cf9b0 2023-08-25T04:16:21.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.685+0000 7fe7b259c640 1 --2- 172.21.15.55:0/209301839 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fe794065520 0x7fe7940679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:21.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.685+0000 7fe7b259c640 1 --2- 172.21.15.55:0/209301839 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fe794065520 0x7fe7940679e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40ae000 tx=0x7fe7a40a7000 comp rx=0 tx=0).ready entity=mgr.6049 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:21.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.689+0000 7fe7aaffd640 1 -- 172.21.15.55:0/209301839 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe7ac04fdc0 con 0x7fe7b40cf9b0 2023-08-25T04:16:21.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.865+0000 7fe7b8c34640 1 -- 172.21.15.55:0/209301839 --> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7b40cdeb0 con 0x7fe794065520 2023-08-25T04:16:21.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.917+0000 7fe7aaffd640 1 -- 172.21.15.55:0/209301839 <== mgr.6049 v2:172.21.15.110:6832/3383442930 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe7a40ac8f0 con 0x7fe794065520 2023-08-25T04:16:21.917 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path snap_test_dir1 2023-08-25T04:16:21.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.917+0000 7fe7b8c34640 1 -- 172.21.15.55:0/209301839 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fe794065520 msgr2=0x7fe7940679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:21.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.917+0000 7fe7b8c34640 1 --2- 172.21.15.55:0/209301839 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fe794065520 0x7fe7940679e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe7a40ae000 tx=0x7fe7a40a7000 comp rx=0 tx=0).stop 2023-08-25T04:16:21.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.917+0000 7fe7b8c34640 1 -- 172.21.15.55:0/209301839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7b40cf9b0 msgr2=0x7fe7b40c6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:21.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.917+0000 7fe7b8c34640 1 --2- 172.21.15.55:0/209301839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7b40cf9b0 0x7fe7b40c6940 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac00c780 tx=0x7fe7ac00cc40 comp rx=0 tx=0).stop 2023-08-25T04:16:21.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.917+0000 7fe7b8c34640 1 -- 172.21.15.55:0/209301839 shutdown_connections 2023-08-25T04:16:21.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.917+0000 7fe7b8c34640 1 --2- 172.21.15.55:0/209301839 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fe794065520 0x7fe7940679e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:21.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.917+0000 7fe7b8c34640 1 --2- 172.21.15.55:0/209301839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7b40cf9b0 0x7fe7b40c6940 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:21.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.917+0000 7fe7b8c34640 1 --2- 172.21.15.55:0/209301839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7b40cd160 0x7fe7b415cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:21.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.917+0000 7fe7b8c34640 1 --2- 172.21.15.55:0/209301839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7b40afa20 0x7fe7b41551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:21.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.917+0000 7fe7b8c34640 1 -- 172.21.15.55:0/209301839 >> 172.21.15.55:0/209301839 conn(0x7fe7b40d0780 msgr2=0x7fe7b40d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:21.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.917+0000 7fe7b8c34640 1 -- 172.21.15.55:0/209301839 shutdown_connections 2023-08-25T04:16:21.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:21.917+0000 7fe7b8c34640 1 -- 172.21.15.55:0/209301839 wait complete. 2023-08-25T04:16:21.941 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-25T04:16:21.941 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-25-04_17_00 in ~39s... 2023-08-25T04:16:21.942 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-25-04_18_00 in ~99s... 2023-08-25T04:16:21.942 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-08-25T04:16:21.942 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-08-25T04:16:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa864dfa640 1 Processor -- start 2023-08-25T04:16:22.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa864dfa640 1 -- start start 2023-08-25T04:16:22.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa864dfa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa86015cb40 0x7fa8600d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:22.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa864dfa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8600cf340 0x7fa8600cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:22.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa864dfa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8600b43e0 0x7fa8600b4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:22.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa864dfa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8600d1970 con 0x7fa8600b43e0 2023-08-25T04:16:22.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa864dfa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8600cfcc0 con 0x7fa86015cb40 2023-08-25T04:16:22.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa864dfa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600d0d80 con 0x7fa8600cf340 2023-08-25T04:16:22.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa85ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8600b43e0 0x7fa8600b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:22.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa85ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8600b43e0 0x7fa8600b4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53758/0 (socket says 172.21.15.55:53758) 2023-08-25T04:16:22.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa85ed9d640 1 -- 172.21.15.55:0/2420524298 learned_addr learned my addr 172.21.15.55:0/2420524298 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:22.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa857fff640 1 --2- 172.21.15.55:0/2420524298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8600cf340 0x7fa8600cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:22.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa85e59c640 1 --2- 172.21.15.55:0/2420524298 >> v2:172.21.15.110:3300/0 conn(0x7fa86015cb40 0x7fa8600d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:22.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa85ed9d640 1 -- 172.21.15.55:0/2420524298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8600cf340 msgr2=0x7fa8600cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:22.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa85ed9d640 1 --2- 172.21.15.55:0/2420524298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8600cf340 0x7fa8600cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:22.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa85ed9d640 1 -- 172.21.15.55:0/2420524298 >> v2:172.21.15.110:3300/0 conn(0x7fa86015cb40 msgr2=0x7fa8600d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:16:22.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa85ed9d640 1 --2- 172.21.15.55:0/2420524298 >> v2:172.21.15.110:3300/0 conn(0x7fa86015cb40 0x7fa8600d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:22.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa85ed9d640 1 -- 172.21.15.55:0/2420524298 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600d1040 con 0x7fa8600b43e0 2023-08-25T04:16:22.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa85e59c640 1 --2- 172.21.15.55:0/2420524298 >> v2:172.21.15.110:3300/0 conn(0x7fa86015cb40 0x7fa8600d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:16:22.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.089+0000 7fa857fff640 1 --2- 172.21.15.55:0/2420524298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8600cf340 0x7fa8600cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:16:22.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.093+0000 7fa85ed9d640 1 --2- 172.21.15.55:0/2420524298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8600b43e0 0x7fa8600b4850 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa86008b5a0 tx=0x7fa85801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144b2d19d5cfadfc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:22.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.093+0000 7fa85dd9b640 1 -- 172.21.15.55:0/2420524298 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8580af400 con 0x7fa8600b43e0 2023-08-25T04:16:22.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.093+0000 7fa85dd9b640 1 -- 172.21.15.55:0/2420524298 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8580ab050 con 0x7fa8600b43e0 2023-08-25T04:16:22.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.093+0000 7fa85dd9b640 1 -- 172.21.15.55:0/2420524298 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8580af780 con 0x7fa8600b43e0 2023-08-25T04:16:22.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.093+0000 7fa864dfa640 1 -- 172.21.15.55:0/2420524298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8600b43e0 msgr2=0x7fa8600b4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:22.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.093+0000 7fa864dfa640 1 --2- 172.21.15.55:0/2420524298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8600b43e0 0x7fa8600b4850 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa86008b5a0 tx=0x7fa85801f1c0 comp rx=0 tx=0).stop 2023-08-25T04:16:22.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.093+0000 7fa864dfa640 1 -- 172.21.15.55:0/2420524298 shutdown_connections 2023-08-25T04:16:22.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.093+0000 7fa864dfa640 1 --2- 172.21.15.55:0/2420524298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8600b43e0 0x7fa8600b4850 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:22.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.093+0000 7fa864dfa640 1 --2- 172.21.15.55:0/2420524298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8600cf340 0x7fa8600cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:22.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.093+0000 7fa864dfa640 1 --2- 172.21.15.55:0/2420524298 >> v2:172.21.15.110:3300/0 conn(0x7fa86015cb40 0x7fa8600d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:22.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.093+0000 7fa864dfa640 1 -- 172.21.15.55:0/2420524298 >> 172.21.15.55:0/2420524298 conn(0x7fa86006aae0 msgr2=0x7fa86006aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:22.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.093+0000 7fa864dfa640 1 -- 172.21.15.55:0/2420524298 shutdown_connections 2023-08-25T04:16:22.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.093+0000 7fa864dfa640 1 -- 172.21.15.55:0/2420524298 wait complete. 2023-08-25T04:16:22.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa864dfa640 1 Processor -- start 2023-08-25T04:16:22.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa864dfa640 1 -- start start 2023-08-25T04:16:22.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa864dfa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8600b43e0 0x7fa860150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:22.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa864dfa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8600cf340 0x7fa8600c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:22.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa864dfa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa86015cb40 0x7fa8600c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:22.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa864dfa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600c6fe0 con 0x7fa8600cf340 2023-08-25T04:16:22.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa864dfa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600c72c0 con 0x7fa86015cb40 2023-08-25T04:16:22.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa864dfa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600c75a0 con 0x7fa8600b43e0 2023-08-25T04:16:22.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa857fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8600cf340 0x7fa8600c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:22.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa857fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8600cf340 0x7fa8600c6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53774/0 (socket says 172.21.15.55:53774) 2023-08-25T04:16:22.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa857fff640 1 -- 172.21.15.55:0/3350044383 learned_addr learned my addr 172.21.15.55:0/3350044383 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:16:22.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa85e59c640 1 --2- 172.21.15.55:0/3350044383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8600b43e0 0x7fa860150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:22.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa85ed9d640 1 --2- 172.21.15.55:0/3350044383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa86015cb40 0x7fa8600c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:22.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa857fff640 1 -- 172.21.15.55:0/3350044383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8600b43e0 msgr2=0x7fa860150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:22.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa857fff640 1 --2- 172.21.15.55:0/3350044383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8600b43e0 0x7fa860150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:22.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa857fff640 1 -- 172.21.15.55:0/3350044383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa86015cb40 msgr2=0x7fa8600c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:22.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa857fff640 1 --2- 172.21.15.55:0/3350044383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa86015cb40 0x7fa8600c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:22.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa857fff640 1 -- 172.21.15.55:0/3350044383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa858009b30 con 0x7fa8600cf340 2023-08-25T04:16:22.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa85e59c640 1 --2- 172.21.15.55:0/3350044383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8600b43e0 0x7fa860150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:16:22.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa857fff640 1 --2- 172.21.15.55:0/3350044383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8600cf340 0x7fa8600c6490 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fa84800c7f0 tx=0x7fa84800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:22.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa856ffd640 1 -- 172.21.15.55:0/3350044383 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848007820 con 0x7fa8600cf340 2023-08-25T04:16:22.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa856ffd640 1 -- 172.21.15.55:0/3350044383 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa848007980 con 0x7fa8600cf340 2023-08-25T04:16:22.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa856ffd640 1 -- 172.21.15.55:0/3350044383 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848007d30 con 0x7fa8600cf340 2023-08-25T04:16:22.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa864dfa640 1 -- 172.21.15.55:0/3350044383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8600c7880 con 0x7fa8600cf340 2023-08-25T04:16:22.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.097+0000 7fa864dfa640 1 -- 172.21.15.55:0/3350044383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8601512a0 con 0x7fa8600cf340 2023-08-25T04:16:22.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.101+0000 7fa864dfa640 1 -- 172.21.15.55:0/3350044383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa860071f80 con 0x7fa8600cf340 2023-08-25T04:16:22.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.101+0000 7fa856ffd640 1 -- 172.21.15.55:0/3350044383 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 21) v1 ==== 84817+0+0 (secure 0 0 0) 0x7fa8480113f0 con 0x7fa8600cf340 2023-08-25T04:16:22.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.101+0000 7fa856ffd640 1 --2- 172.21.15.55:0/3350044383 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fa840065520 0x7fa8400679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:16:22.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.101+0000 7fa856ffd640 1 -- 172.21.15.55:0/3350044383 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fa848082f90 con 0x7fa8600cf340 2023-08-25T04:16:22.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.101+0000 7fa85e59c640 1 --2- 172.21.15.55:0/3350044383 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fa840065520 0x7fa8400679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:16:22.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.101+0000 7fa85e59c640 1 --2- 172.21.15.55:0/3350044383 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fa840065520 0x7fa8400679e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa85000a930 tx=0x7fa850008040 comp rx=0 tx=0).ready entity=mgr.6049 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:16:22.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.105+0000 7fa856ffd640 1 -- 172.21.15.55:0/3350044383 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa848050c10 con 0x7fa8600cf340 2023-08-25T04:16:22.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.277+0000 7fa864dfa640 1 -- 172.21.15.55:0/3350044383 --> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8600c7430 con 0x7fa840065520 2023-08-25T04:16:22.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.285+0000 7fa856ffd640 1 -- 172.21.15.55:0/3350044383 <== mgr.6049 v2:172.21.15.110:6832/3383442930 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7fa8600c7430 con 0x7fa840065520 2023-08-25T04:16:22.286 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:16:22.286 INFO:teuthology.orchestra.run.smithi055.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-08-25T04:16:22.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.289+0000 7fa864dfa640 1 -- 172.21.15.55:0/3350044383 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fa840065520 msgr2=0x7fa8400679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:22.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.289+0000 7fa864dfa640 1 --2- 172.21.15.55:0/3350044383 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fa840065520 0x7fa8400679e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa85000a930 tx=0x7fa850008040 comp rx=0 tx=0).stop 2023-08-25T04:16:22.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.289+0000 7fa864dfa640 1 -- 172.21.15.55:0/3350044383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8600cf340 msgr2=0x7fa8600c6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:16:22.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.289+0000 7fa864dfa640 1 --2- 172.21.15.55:0/3350044383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8600cf340 0x7fa8600c6490 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fa84800c7f0 tx=0x7fa84800ccb0 comp rx=0 tx=0).stop 2023-08-25T04:16:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.289+0000 7fa864dfa640 1 -- 172.21.15.55:0/3350044383 shutdown_connections 2023-08-25T04:16:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.289+0000 7fa864dfa640 1 --2- 172.21.15.55:0/3350044383 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fa840065520 0x7fa8400679e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.289+0000 7fa864dfa640 1 --2- 172.21.15.55:0/3350044383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa86015cb40 0x7fa8600c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.289+0000 7fa864dfa640 1 --2- 172.21.15.55:0/3350044383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8600cf340 0x7fa8600c6490 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.289+0000 7fa864dfa640 1 --2- 172.21.15.55:0/3350044383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8600b43e0 0x7fa860150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:16:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.289+0000 7fa864dfa640 1 -- 172.21.15.55:0/3350044383 >> 172.21.15.55:0/3350044383 conn(0x7fa86006aae0 msgr2=0x7fa8600ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:16:22.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.289+0000 7fa864dfa640 1 -- 172.21.15.55:0/3350044383 shutdown_connections 2023-08-25T04:16:22.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:16:22.289+0000 7fa864dfa640 1 -- 172.21.15.55:0/3350044383 wait complete. 2023-08-25T04:16:22.307 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-08-25T04:16:22.308 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-08-25T04:16:22.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:22.308 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:22.320 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:22.320 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:22.321 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:23.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:23.322 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:23.335 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:23.336 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:23.336 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:24.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:24.338 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:24.350 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:24.350 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:24.351 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:25.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:25.352 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:25.364 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:25.365 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:25.365 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:26.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:26.366 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:26.380 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:26.380 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:26.381 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:27.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:27.383 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:27.396 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:27.397 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:27.397 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:28.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:28.399 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:28.411 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:28.412 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:28.412 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:29.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:29.413 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:29.425 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:29.426 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:29.426 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:29.794 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:16:29.798 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:16:30.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:30.427 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:30.439 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:30.440 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:30.440 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:31.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:31.442 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:31.454 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:31.455 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:31.455 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:32.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:32.457 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:32.469 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:32.469 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:32.470 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:33.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:33.471 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:33.483 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:33.483 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:33.484 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:34.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:34.485 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:34.497 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:34.498 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:34.498 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:35.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:35.499 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:35.513 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:35.514 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:35.514 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:36.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:36.516 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:36.528 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:36.529 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:36.529 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:37.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:37.531 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:37.544 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:37.545 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:37.546 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:38.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:38.547 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:38.560 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:38.560 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:38.560 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:39.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:39.562 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:39.574 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:39.575 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:39.575 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:40.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:40.577 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:40.590 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:40.590 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:40.591 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:41.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:41.593 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:41.605 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:41.606 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:41.606 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:42.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:42.608 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:42.621 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:42.621 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:42.622 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:43.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:43.624 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:43.636 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:43.637 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:43.637 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:44.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:44.639 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:44.651 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:44.652 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:44.652 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:45.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:45.654 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:45.665 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:45.666 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:45.666 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:46.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:46.668 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:46.680 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:46.680 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:46.680 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:47.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:47.682 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:47.694 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:47.695 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:47.695 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:48.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:48.697 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:48.709 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:48.709 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:48.709 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:49.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:49.711 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:49.723 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:49.723 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:49.723 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:50.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:50.726 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:50.738 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:50.738 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:50.738 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:51.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:51.740 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:51.752 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:51.753 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:51.753 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:52.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:52.755 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:52.768 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:52.768 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:52.768 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:53.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:53.770 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:53.782 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:53.783 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:53.783 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:54.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:54.786 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:54.799 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:54.800 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:54.800 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:55.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:55.802 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:55.814 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:55.815 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:55.815 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:56.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:56.817 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:56.830 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:56.830 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:56.831 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:57.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:57.832 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:57.846 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:57.846 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:57.846 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:58.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:58.847 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:58.860 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:58.861 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:58.861 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:16:59.852 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:16:59.856 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:16:59.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:16:59.863 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:16:59.910 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:16:59.910 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:16:59.910 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:00.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:00.912 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:00.925 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:17:00.925 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:00.925 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:00.929 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:17:00.931+0000 7f14decc8640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:17:00.929 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:17:00.931+0000 7f14decc8640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:17:00.930 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:17:00.931+0000 7f14decc8640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:17:00.930 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:17:00.931+0000 7f14decc8640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:17:00.930 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:17:00.931+0000 7f14decc8640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:17:01.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:01.927 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:01.937 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:01.938 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:01.939 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:01.939 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:01.939 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-08-25-04_17_00_UTC'] 2023-08-25T04:17:01.940 DEBUG:tasks.cephfs.test_snap_schedules:exec=1692936981.9416642, now = 1692937021.9400446, timo = 39 2023-08-25T04:17:02.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:02.941 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:02.952 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:02.954 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:02.954 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:02.954 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:03.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:03.956 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:03.967 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:03.968 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:03.969 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:03.969 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:04.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:04.971 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:04.982 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:04.983 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:04.983 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:04.984 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:05.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:05.985 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:05.997 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:05.998 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:05.998 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:05.998 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:06.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:07.000 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:07.013 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:07.013 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:07.013 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:07.014 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:08.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:08.015 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:08.026 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:08.027 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:08.027 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:08.028 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:09.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:09.030 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:09.041 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:09.042 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:09.043 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:09.043 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:10.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:10.045 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:10.056 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:10.056 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:10.057 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:10.057 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:11.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:11.059 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:11.071 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:11.072 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:11.072 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:11.073 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:12.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:12.074 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:12.088 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:12.089 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:12.089 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:12.089 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:13.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:13.091 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:13.102 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:13.103 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:13.104 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:13.104 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:14.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:14.105 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:14.117 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:14.118 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:14.119 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:14.119 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:15.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:15.121 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:15.132 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:15.133 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:15.134 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:15.134 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:16.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:16.136 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:16.147 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:16.148 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:16.148 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:16.148 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:17.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:17.150 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:17.162 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:17.163 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:17.164 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:17.164 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:18.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:18.166 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:18.178 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:18.180 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:18.180 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:18.181 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:19.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:19.183 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:19.194 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:19.196 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:19.196 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:19.196 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:20.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:20.199 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:20.210 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:20.211 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:20.212 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:20.212 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:21.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:21.214 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:21.226 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:21.227 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:21.228 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:21.228 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:22.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:22.230 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:22.243 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:22.244 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:22.245 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:22.245 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:23.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:23.247 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:23.258 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:23.259 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:23.260 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:23.260 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:24.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:24.261 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:24.273 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:24.274 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:24.274 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:24.274 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:25.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:25.276 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:25.288 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:25.289 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:25.289 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:25.289 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:26.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:26.291 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:26.302 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:26.304 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:26.304 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:26.304 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:27.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:27.306 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:27.319 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:27.320 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:27.321 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:27.321 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:28.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:28.322 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:28.334 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:28.335 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:28.335 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:28.335 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:29.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:29.337 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:29.348 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:29.349 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:29.350 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:29.350 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:29.915 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:17:29.920 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:17:30.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:30.353 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:30.364 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:30.365 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:30.366 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:30.366 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:31.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:31.368 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:31.379 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:31.380 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:31.381 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:31.381 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:32.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:32.383 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:32.394 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:32.395 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:32.396 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:32.396 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:33.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:33.397 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:33.409 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:33.410 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:33.410 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:33.410 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:34.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:34.412 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:34.423 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:34.424 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:34.424 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:34.425 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:35.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:35.426 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:35.438 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:35.439 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:35.439 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:35.439 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:36.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:36.441 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:36.453 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:36.454 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:36.454 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:36.455 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:37.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:37.457 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:37.470 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:37.471 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:37.472 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:37.473 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:38.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:38.475 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:38.486 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:38.487 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:38.487 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:38.488 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:39.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:39.489 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:39.500 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:39.501 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:39.502 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:39.502 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:40.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:40.504 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:40.515 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:40.516 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:40.517 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:40.517 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:41.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:41.518 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:41.531 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:41.532 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:41.532 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:41.533 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:42.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:42.534 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:42.546 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:42.547 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:42.547 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:42.548 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:43.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:43.550 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:43.561 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:43.562 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:43.562 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:43.563 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:44.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:44.564 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:44.575 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:44.576 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:44.576 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:44.577 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:45.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:45.578 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:45.589 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:45.590 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:45.590 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:45.591 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:46.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:46.592 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:46.605 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:46.606 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:46.606 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:46.606 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:47.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:47.607 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:47.624 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:47.625 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:47.625 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:47.626 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:48.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:48.628 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:48.640 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:48.641 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:48.641 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:48.641 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:49.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:49.643 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:49.654 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:49.654 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:49.655 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:49.655 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:50.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:50.656 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:50.668 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:50.669 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:50.669 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:50.669 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:51.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:51.671 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:51.682 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:51.683 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:51.684 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:51.684 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:52.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:52.686 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:52.697 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:52.698 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:52.699 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:52.699 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:53.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:53.700 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:53.712 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:53.713 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:53.714 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:53.714 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:54.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:54.716 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:54.728 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:54.729 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:54.729 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:54.729 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:55.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:55.731 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:55.742 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:55.743 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:55.744 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:55.744 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:56.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:56.746 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:56.757 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:56.758 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:56.758 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:56.759 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:57.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:57.760 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:57.771 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:57.772 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:57.772 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:57.773 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:58.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:58.774 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:58.786 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:58.787 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:58.787 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:58.787 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:59.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:17:59.789 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:17:59.800 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:17:59.801 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:17:59.801 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:17:59.801 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:17:59.972 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:17:59.976 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:18:00.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:00.803 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:18:00.814 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:18:00.815 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC'} 2023-08-25T04:18:00.816 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:18:00.816 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:18:01.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:01.818 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:18:01.829 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:18:01.829 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_18_01_UTC 2023-08-25T04:18:01.830 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_17_00_UTC', 'scheduled-2023-08-25-04_18_01_UTC'} 2023-08-25T04:18:01.831 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-08-25-04_18_01_UTC'} 2023-08-25T04:18:01.831 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:18:01.831 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-08-25-04_18_01_UTC'] 2023-08-25T04:18:01.831 DEBUG:tasks.cephfs.test_snap_schedules:exec=1692936981.9416642, now = 1692937081.8319304, timo = 99 2023-08-25T04:18:02.832 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-25T04:18:02.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.994+0000 7f3ceac9c640 1 Processor -- start 2023-08-25T04:18:02.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.994+0000 7f3ceac9c640 1 -- start start 2023-08-25T04:18:02.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.994+0000 7f3ceac9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ce40afa20 0x7f3ce40b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:02.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.994+0000 7f3ceac9c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ce40cf9b0 0x7f3ce40ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:02.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.994+0000 7f3ceac9c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce40cae70 con 0x7f3ce40cd160 2023-08-25T04:18:02.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.994+0000 7f3ceac9c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce40cfe10 con 0x7f3ce40cf9b0 2023-08-25T04:18:02.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.994+0000 7f3ceac9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce40cb0e0 con 0x7f3ce40afa20 2023-08-25T04:18:02.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.994+0000 7f3cdbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ce40cf9b0 0x7f3ce40ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:02.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.994+0000 7f3cdbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ce40cf9b0 0x7f3ce40ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50738/0 (socket says 172.21.15.55:50738) 2023-08-25T04:18:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.994+0000 7f3cdbfff640 1 -- 172.21.15.55:0/1682720852 learned_addr learned my addr 172.21.15.55:0/1682720852 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.994+0000 7f3ce8a38640 1 --2- 172.21.15.55:0/1682720852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ce40afa20 0x7f3ce40b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.994+0000 7f3cdbfff640 1 -- 172.21.15.55:0/1682720852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ce40afa20 msgr2=0x7f3ce40b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.994+0000 7f3cdbfff640 1 --2- 172.21.15.55:0/1682720852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ce40afa20 0x7f3ce40b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.994+0000 7f3cdbfff640 1 -- 172.21.15.55:0/1682720852 >> v1:172.21.15.110:6789/0 conn(0x7f3ce40cd160 legacy=0x7f3ce415c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.994+0000 7f3cdbfff640 1 -- 172.21.15.55:0/1682720852 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce40cb3c0 con 0x7f3ce40cf9b0 2023-08-25T04:18:02.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.994+0000 7f3ce8a38640 1 --2- 172.21.15.55:0/1682720852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ce40afa20 0x7f3ce40b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:02.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.998+0000 7f3cdbfff640 1 --2- 172.21.15.55:0/1682720852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ce40cf9b0 0x7f3ce40ce9c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009870 tx=0x7f3cd401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bee479101804137 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:02.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.998+0000 7f3cdb7fe640 1 -- 172.21.15.55:0/1682720852 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40ab600 con 0x7f3ce40cf9b0 2023-08-25T04:18:02.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.998+0000 7f3cdb7fe640 1 -- 172.21.15.55:0/1682720852 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd40ab760 con 0x7f3ce40cf9b0 2023-08-25T04:18:02.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.998+0000 7f3cdb7fe640 1 -- 172.21.15.55:0/1682720852 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40abaf0 con 0x7f3ce40cf9b0 2023-08-25T04:18:02.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.998+0000 7f3ceac9c640 1 -- 172.21.15.55:0/1682720852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ce40cf9b0 msgr2=0x7f3ce40ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:02.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.998+0000 7f3ceac9c640 1 --2- 172.21.15.55:0/1682720852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ce40cf9b0 0x7f3ce40ce9c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009870 tx=0x7f3cd401c440 comp rx=0 tx=0).stop 2023-08-25T04:18:02.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.998+0000 7f3ceac9c640 1 -- 172.21.15.55:0/1682720852 shutdown_connections 2023-08-25T04:18:02.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.998+0000 7f3ceac9c640 1 --2- 172.21.15.55:0/1682720852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ce40cf9b0 0x7f3ce40ce9c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:03.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.998+0000 7f3ceac9c640 1 --2- 172.21.15.55:0/1682720852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ce40afa20 0x7f3ce40b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:03.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.998+0000 7f3ceac9c640 1 -- 172.21.15.55:0/1682720852 >> 172.21.15.55:0/1682720852 conn(0x7f3ce40d0780 msgr2=0x7f3ce40d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:03.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.998+0000 7f3ceac9c640 1 -- 172.21.15.55:0/1682720852 shutdown_connections 2023-08-25T04:18:03.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:02.998+0000 7f3ceac9c640 1 -- 172.21.15.55:0/1682720852 wait complete. 2023-08-25T04:18:03.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ceac9c640 1 Processor -- start 2023-08-25T04:18:03.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ceac9c640 1 -- start start 2023-08-25T04:18:03.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ceac9c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ce40afa20 0x7f3ce4154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:03.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ceac9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ce40cd160 0x7f3ce4151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:03.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ceac9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ce40cf9b0 0x7f3ce40b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:03.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ceac9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce4152360 con 0x7f3ce40cf9b0 2023-08-25T04:18:03.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ceac9c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce4153fe0 con 0x7f3ce40afa20 2023-08-25T04:18:03.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ceac9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce4154d60 con 0x7f3ce40cd160 2023-08-25T04:18:03.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ce9239640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ce40cf9b0 0x7f3ce40b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:03.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ce9239640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ce40cf9b0 0x7f3ce40b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50750/0 (socket says 172.21.15.55:50750) 2023-08-25T04:18:03.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ce9239640 1 -- 172.21.15.55:0/423377145 learned_addr learned my addr 172.21.15.55:0/423377145 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:03.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ce8a38640 1 --2- 172.21.15.55:0/423377145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ce40afa20 0x7f3ce4154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:03.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3cdbfff640 1 --2- 172.21.15.55:0/423377145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ce40cd160 0x7f3ce4151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:03.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ce9239640 1 -- 172.21.15.55:0/423377145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ce40cd160 msgr2=0x7f3ce4151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:03.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ce9239640 1 --2- 172.21.15.55:0/423377145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ce40cd160 0x7f3ce4151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:03.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ce9239640 1 -- 172.21.15.55:0/423377145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ce40afa20 msgr2=0x7f3ce4154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:03.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ce9239640 1 --2- 172.21.15.55:0/423377145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ce40afa20 0x7f3ce4154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:03.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ce9239640 1 -- 172.21.15.55:0/423377145 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd40094d0 con 0x7f3ce40cf9b0 2023-08-25T04:18:03.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ce9239640 1 --2- 172.21.15.55:0/423377145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ce40cf9b0 0x7f3ce40b5c90 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00b990 tx=0x7f3cdc00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:03.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3cd97fa640 1 -- 172.21.15.55:0/423377145 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00cba0 con 0x7f3ce40cf9b0 2023-08-25T04:18:03.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3cd97fa640 1 -- 172.21.15.55:0/423377145 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc00cd00 con 0x7f3ce40cf9b0 2023-08-25T04:18:03.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3cd97fa640 1 -- 172.21.15.55:0/423377145 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc014680 con 0x7f3ce40cf9b0 2023-08-25T04:18:03.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ceac9c640 1 -- 172.21.15.55:0/423377145 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce41533d0 con 0x7f3ce40cf9b0 2023-08-25T04:18:03.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.002+0000 7f3ceac9c640 1 -- 172.21.15.55:0/423377145 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce4153990 con 0x7f3ce40cf9b0 2023-08-25T04:18:03.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.006+0000 7f3ceac9c640 1 -- 172.21.15.55:0/423377145 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce404dbe0 con 0x7f3ce40cf9b0 2023-08-25T04:18:03.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.006+0000 7f3cd97fa640 1 -- 172.21.15.55:0/423377145 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 25) v1 ==== 85093+0+0 (secure 0 0 0) 0x7f3cdc0147e0 con 0x7f3ce40cf9b0 2023-08-25T04:18:03.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.006+0000 7f3cd97fa640 1 --2- 172.21.15.55:0/423377145 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f3cd00657f0 0x7f3cd0067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:03.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.006+0000 7f3cd97fa640 1 -- 172.21.15.55:0/423377145 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f3cdc0830d0 con 0x7f3ce40cf9b0 2023-08-25T04:18:03.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.006+0000 7f3ce8a38640 1 --2- 172.21.15.55:0/423377145 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f3cd00657f0 0x7f3cd0067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:03.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.010+0000 7f3ce8a38640 1 --2- 172.21.15.55:0/423377145 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f3cd00657f0 0x7f3cd0067cb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40c77b0 tx=0x7f3ce0008040 comp rx=0 tx=0).ready entity=mgr.6049 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:03.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.014+0000 7f3cd97fa640 1 -- 172.21.15.55:0/423377145 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3cdc050920 con 0x7f3ce40cf9b0 2023-08-25T04:18:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.194+0000 7f3ceac9c640 1 -- 172.21.15.55:0/423377145 --> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ce40cdeb0 con 0x7f3cd00657f0 2023-08-25T04:18:03.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.266+0000 7f3cd97fa640 1 -- 172.21.15.55:0/423377145 <== mgr.6049 v2:172.21.15.110:6832/3383442930 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3ce000c040 con 0x7f3cd00657f0 2023-08-25T04:18:03.265 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path snap_test_dir1 2023-08-25T04:18:03.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.270+0000 7f3ceac9c640 1 -- 172.21.15.55:0/423377145 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f3cd00657f0 msgr2=0x7f3cd0067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.270+0000 7f3ceac9c640 1 --2- 172.21.15.55:0/423377145 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f3cd00657f0 0x7f3cd0067cb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40c77b0 tx=0x7f3ce0008040 comp rx=0 tx=0).stop 2023-08-25T04:18:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.270+0000 7f3ceac9c640 1 -- 172.21.15.55:0/423377145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ce40cf9b0 msgr2=0x7f3ce40b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.270+0000 7f3ceac9c640 1 --2- 172.21.15.55:0/423377145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ce40cf9b0 0x7f3ce40b5c90 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00b990 tx=0x7f3cdc00be50 comp rx=0 tx=0).stop 2023-08-25T04:18:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.270+0000 7f3ceac9c640 1 -- 172.21.15.55:0/423377145 shutdown_connections 2023-08-25T04:18:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.270+0000 7f3ceac9c640 1 --2- 172.21.15.55:0/423377145 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f3cd00657f0 0x7f3cd0067cb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.270+0000 7f3ceac9c640 1 --2- 172.21.15.55:0/423377145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ce40cf9b0 0x7f3ce40b5c90 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.270+0000 7f3ceac9c640 1 --2- 172.21.15.55:0/423377145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ce40cd160 0x7f3ce4151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.270+0000 7f3ceac9c640 1 --2- 172.21.15.55:0/423377145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ce40afa20 0x7f3ce4154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.270+0000 7f3ceac9c640 1 -- 172.21.15.55:0/423377145 >> 172.21.15.55:0/423377145 conn(0x7f3ce40d0780 msgr2=0x7f3ce406e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.270+0000 7f3ceac9c640 1 -- 172.21.15.55:0/423377145 shutdown_connections 2023-08-25T04:18:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.270+0000 7f3ceac9c640 1 -- 172.21.15.55:0/423377145 wait complete. 2023-08-25T04:18:03.286 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-25T04:18:03.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:03.287 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:18:03.298 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:18:03.298 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_18_01_UTC 2023-08-25T04:18:03.298 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_17_00_UTC 2023-08-25T04:18:03.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:03.299 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_17_00_UTC) 2023-08-25T04:18:03.357 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_18_01_UTC 2023-08-25T04:18:03.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:03.358 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_18_01_UTC) 2023-08-25T04:18:03.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:03.413 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-25T04:18:03.466 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-25T04:18:03.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.654+0000 7facd1903640 1 Processor -- start 2023-08-25T04:18:03.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.658+0000 7facd1903640 1 -- start start 2023-08-25T04:18:03.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.658+0000 7facd1903640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faccc0cb020 0x7faccc0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:03.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.658+0000 7facd1903640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faccc0cdd50 0x7faccc0cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:03.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.658+0000 7facd1903640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faccc0cbca0 con 0x7faccc06c720 2023-08-25T04:18:03.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.658+0000 7facd1903640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faccc0c9470 con 0x7faccc0cb020 2023-08-25T04:18:03.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.658+0000 7facd1903640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0ce1e0 con 0x7faccc0cdd50 2023-08-25T04:18:03.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.658+0000 7faccb7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faccc06c720 0x7faccc0cc450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32806/0 (socket says 172.21.15.55:32806) 2023-08-25T04:18:03.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.658+0000 7faccb7fe640 1 -- 172.21.15.55:0/2406831135 learned_addr learned my addr 172.21.15.55:0/2406831135 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:03.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.658+0000 7facc27fc640 1 --2- 172.21.15.55:0/2406831135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faccc0cdd50 0x7faccc0cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:03.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.658+0000 7faccaffd640 1 --2- 172.21.15.55:0/2406831135 >> v2:172.21.15.110:3300/0 conn(0x7faccc0cb020 0x7faccc0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:03.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.658+0000 7facca7fc640 1 -- 172.21.15.55:0/2406831135 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3922619786 0 0) 0x7faccc0cbca0 con 0x7faccc06c720 2023-08-25T04:18:03.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.658+0000 7facca7fc640 1 -- 172.21.15.55:0/2406831135 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facb8003530 con 0x7faccc06c720 2023-08-25T04:18:03.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.658+0000 7facc27fc640 1 -- 172.21.15.55:0/2406831135 >> v2:172.21.15.110:3300/0 conn(0x7faccc0cb020 msgr2=0x7faccc0c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:03.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.658+0000 7facc27fc640 1 --2- 172.21.15.55:0/2406831135 >> v2:172.21.15.110:3300/0 conn(0x7faccc0cb020 0x7faccc0c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:03.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.658+0000 7facc27fc640 1 -- 172.21.15.55:0/2406831135 >> v1:172.21.15.55:6789/0 conn(0x7faccc06c720 legacy=0x7faccc0cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:03.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.658+0000 7facca7fc640 1 -- 172.21.15.55:0/2406831135 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3901208694 0 0) 0x7facb8003530 con 0x7faccc06c720 2023-08-25T04:18:03.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.658+0000 7facc27fc640 1 -- 172.21.15.55:0/2406831135 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc0c8b40 con 0x7faccc0cdd50 2023-08-25T04:18:03.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.658+0000 7faccaffd640 1 --2- 172.21.15.55:0/2406831135 >> v2:172.21.15.110:3300/0 conn(0x7faccc0cb020 0x7faccc0c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:03.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.662+0000 7facc27fc640 1 --2- 172.21.15.55:0/2406831135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faccc0cdd50 0x7faccc0cb400 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7facb40097c0 tx=0x7facb401c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eaa2e3072d699d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:03.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.662+0000 7facca7fc640 1 -- 172.21.15.55:0/2406831135 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc4001a00 con 0x7faccc0cdd50 2023-08-25T04:18:03.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.662+0000 7facca7fc640 1 -- 172.21.15.55:0/2406831135 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb40a7050 con 0x7faccc0cdd50 2023-08-25T04:18:03.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.662+0000 7facca7fc640 1 -- 172.21.15.55:0/2406831135 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb40ab620 con 0x7faccc0cdd50 2023-08-25T04:18:03.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.662+0000 7facd1903640 1 -- 172.21.15.55:0/2406831135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faccc0cdd50 msgr2=0x7faccc0cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.662+0000 7facd1903640 1 --2- 172.21.15.55:0/2406831135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faccc0cdd50 0x7faccc0cb400 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7facb40097c0 tx=0x7facb401c310 comp rx=0 tx=0).stop 2023-08-25T04:18:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.662+0000 7facd1903640 1 -- 172.21.15.55:0/2406831135 shutdown_connections 2023-08-25T04:18:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.662+0000 7facd1903640 1 --2- 172.21.15.55:0/2406831135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faccc0cdd50 0x7faccc0cb400 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.662+0000 7facd1903640 1 --2- 172.21.15.55:0/2406831135 >> v2:172.21.15.110:3300/0 conn(0x7faccc0cb020 0x7faccc0c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.662+0000 7facd1903640 1 -- 172.21.15.55:0/2406831135 >> 172.21.15.55:0/2406831135 conn(0x7faccc069900 msgr2=0x7faccc069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.662+0000 7facd1903640 1 -- 172.21.15.55:0/2406831135 shutdown_connections 2023-08-25T04:18:03.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.662+0000 7facd1903640 1 -- 172.21.15.55:0/2406831135 wait complete. 2023-08-25T04:18:03.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.662+0000 7facd1903640 1 Processor -- start 2023-08-25T04:18:03.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facd1903640 1 -- start start 2023-08-25T04:18:03.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facd1903640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faccc06c720 0x7faccc159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:03.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facd1903640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faccc0cb020 0x7faccc0af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:03.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facd1903640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faccc0cdd50 0x7faccc0ade20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:03.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facd1903640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0af480 con 0x7faccc0cb020 2023-08-25T04:18:03.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facd1903640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0afde0 con 0x7faccc0cdd50 2023-08-25T04:18:03.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facd1903640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0ae800 con 0x7faccc06c720 2023-08-25T04:18:03.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facc27fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faccc0cb020 0x7faccc0af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:03.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facc27fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faccc0cb020 0x7faccc0af8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50760/0 (socket says 172.21.15.55:50760) 2023-08-25T04:18:03.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facc27fc640 1 -- 172.21.15.55:0/1400670452 learned_addr learned my addr 172.21.15.55:0/1400670452 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:03.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7faccaffd640 1 --2- 172.21.15.55:0/1400670452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faccc06c720 0x7faccc159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:03.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7faccb7fe640 1 --2- 172.21.15.55:0/1400670452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faccc0cdd50 0x7faccc0ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:03.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facc27fc640 1 -- 172.21.15.55:0/1400670452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faccc06c720 msgr2=0x7faccc159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:03.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facc27fc640 1 --2- 172.21.15.55:0/1400670452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faccc06c720 0x7faccc159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:03.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facc27fc640 1 -- 172.21.15.55:0/1400670452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faccc0cdd50 msgr2=0x7faccc0ade20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:03.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facc27fc640 1 --2- 172.21.15.55:0/1400670452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faccc0cdd50 0x7faccc0ade20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:03.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facc27fc640 1 -- 172.21.15.55:0/1400670452 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc0093b0 con 0x7faccc0cb020 2023-08-25T04:18:03.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facc27fc640 1 --2- 172.21.15.55:0/1400670452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faccc0cb020 0x7faccc0af8a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7facb401cbb0 tx=0x7facb40190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:03.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facc8ff9640 1 -- 172.21.15.55:0/1400670452 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb40b4400 con 0x7faccc0cb020 2023-08-25T04:18:03.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facc8ff9640 1 -- 172.21.15.55:0/1400670452 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb40b4580 con 0x7faccc0cb020 2023-08-25T04:18:03.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facd1903640 1 -- 172.21.15.55:0/1400670452 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb4009420 con 0x7faccc0cb020 2023-08-25T04:18:03.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facc8ff9640 1 -- 172.21.15.55:0/1400670452 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb40b4930 con 0x7faccc0cb020 2023-08-25T04:18:03.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facd1903640 1 -- 172.21.15.55:0/1400670452 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faccc0aedc0 con 0x7faccc0cb020 2023-08-25T04:18:03.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.666+0000 7facd1903640 1 -- 172.21.15.55:0/1400670452 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faccc073ec0 con 0x7faccc0cb020 2023-08-25T04:18:03.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.670+0000 7facc8ff9640 1 -- 172.21.15.55:0/1400670452 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 25) v1 ==== 85093+0+0 (secure 0 0 0) 0x7facb40b2040 con 0x7faccc0cb020 2023-08-25T04:18:03.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.670+0000 7facc8ff9640 1 --2- 172.21.15.55:0/1400670452 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7facac0657f0 0x7facac067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:03.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.670+0000 7facc8ff9640 1 -- 172.21.15.55:0/1400670452 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6464+0+0 (secure 0 0 0) 0x7facb411d040 con 0x7faccc0cb020 2023-08-25T04:18:03.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.670+0000 7faccaffd640 1 --2- 172.21.15.55:0/1400670452 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7facac0657f0 0x7facac067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:03.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.670+0000 7faccaffd640 1 --2- 172.21.15.55:0/1400670452 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7facac0657f0 0x7facac067cb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faccc0ca490 tx=0x7facbc006f90 comp rx=0 tx=0).ready entity=mgr.6049 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:03.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.674+0000 7facc8ff9640 1 -- 172.21.15.55:0/1400670452 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7facb414dd90 con 0x7faccc0cb020 2023-08-25T04:18:03.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:03.874+0000 7facd1903640 1 -- 172.21.15.55:0/1400670452 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7faccc06a5f0 con 0x7faccc0cb020 2023-08-25T04:18:04.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:04.726+0000 7facc8ff9640 1 -- 172.21.15.55:0/1400670452 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 26) v1 ==== 85076+0+0 (secure 0 0 0) 0x7facb40eabe0 con 0x7faccc0cb020 2023-08-25T04:18:04.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:04.726+0000 7facc8ff9640 1 -- 172.21.15.55:0/1400670452 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v26) v1 ==== 93+0+0 (secure 0 0 0) 0x7facb41057b0 con 0x7faccc0cb020 2023-08-25T04:18:04.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:04.730+0000 7facd1903640 1 -- 172.21.15.55:0/1400670452 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7facac0657f0 msgr2=0x7facac067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:04.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:04.730+0000 7facd1903640 1 --2- 172.21.15.55:0/1400670452 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7facac0657f0 0x7facac067cb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faccc0ca490 tx=0x7facbc006f90 comp rx=0 tx=0).stop 2023-08-25T04:18:04.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:04.730+0000 7facd1903640 1 -- 172.21.15.55:0/1400670452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faccc0cb020 msgr2=0x7faccc0af8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:04.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:04.730+0000 7facd1903640 1 --2- 172.21.15.55:0/1400670452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faccc0cb020 0x7faccc0af8a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7facb401cbb0 tx=0x7facb40190b0 comp rx=0 tx=0).stop 2023-08-25T04:18:04.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:04.730+0000 7facd1903640 1 -- 172.21.15.55:0/1400670452 shutdown_connections 2023-08-25T04:18:04.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:04.730+0000 7facd1903640 1 --2- 172.21.15.55:0/1400670452 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7facac0657f0 0x7facac067cb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:04.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:04.730+0000 7facd1903640 1 --2- 172.21.15.55:0/1400670452 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faccc0cdd50 0x7faccc0ade20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:04.730+0000 7facd1903640 1 --2- 172.21.15.55:0/1400670452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faccc0cb020 0x7faccc0af8a0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:04.730+0000 7facd1903640 1 --2- 172.21.15.55:0/1400670452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faccc06c720 0x7faccc159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:04.730+0000 7facd1903640 1 -- 172.21.15.55:0/1400670452 >> 172.21.15.55:0/1400670452 conn(0x7faccc069900 msgr2=0x7faccc0cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:04.730+0000 7facd1903640 1 -- 172.21.15.55:0/1400670452 shutdown_connections 2023-08-25T04:18:04.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:04.730+0000 7facd1903640 1 -- 172.21.15.55:0/1400670452 wait complete. 2023-08-25T04:18:04.752 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T04:18:04.756 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:18:04.834 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:18:04.895 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T04:18:04.896 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:18:04.896 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:04.900 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:04.902+0000 7fe5c8a19180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:18:04.901 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:04.901+0000 7faaf57e8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:18:04.905 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:18:04.906 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:04.960 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:18:05.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.150+0000 7f2dcb503640 1 Processor -- start 2023-08-25T04:18:05.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.150+0000 7f2dcb503640 1 -- start start 2023-08-25T04:18:05.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.154+0000 7f2dcb503640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2dc40ce220 0x7f2dc40b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:05.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.154+0000 7f2dcb503640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc40b29b0 con 0x7f2dc40d0da0 2023-08-25T04:18:05.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.154+0000 7f2dcb503640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc40ce690 con 0x7f2dc40cdde0 2023-08-25T04:18:05.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.154+0000 7f2dcb503640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc40b1dc0 con 0x7f2dc40ce220 2023-08-25T04:18:05.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.154+0000 7f2dc929f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2dc40d0da0 0x7f2dc40d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32814/0 (socket says 172.21.15.55:32814) 2023-08-25T04:18:05.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.154+0000 7f2dc929f640 1 -- 172.21.15.55:0/3734304501 learned_addr learned my addr 172.21.15.55:0/3734304501 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:05.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.154+0000 7f2dc9aa0640 1 --2- 172.21.15.55:0/3734304501 >> v2:172.21.15.55:3300/0 conn(0x7f2dc40ce220 0x7f2dc40b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:05.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.154+0000 7f2dbbfff640 1 -- 172.21.15.55:0/3734304501 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977930937 0 0) 0x7f2dc40b29b0 con 0x7f2dc40d0da0 2023-08-25T04:18:05.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.154+0000 7f2dbbfff640 1 -- 172.21.15.55:0/3734304501 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2db0003530 con 0x7f2dc40d0da0 2023-08-25T04:18:05.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.154+0000 7f2dc9aa0640 1 -- 172.21.15.55:0/3734304501 >> v1:172.21.15.110:6789/0 conn(0x7f2dc40cdde0 legacy=0x7f2dc40b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:05.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.154+0000 7f2dbbfff640 1 -- 172.21.15.55:0/3734304501 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079023429 0 0) 0x7f2dc40ce690 con 0x7f2dc40cdde0 2023-08-25T04:18:05.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.154+0000 7f2dc9aa0640 1 -- 172.21.15.55:0/3734304501 >> v1:172.21.15.55:6789/0 conn(0x7f2dc40d0da0 legacy=0x7f2dc40d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:05.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.154+0000 7f2dc9aa0640 1 -- 172.21.15.55:0/3734304501 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc40b2080 con 0x7f2dc40ce220 2023-08-25T04:18:05.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.158+0000 7f2dc9aa0640 1 --2- 172.21.15.55:0/3734304501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dc40ce220 0x7f2dc40b3550 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009d90 tx=0x7f2dbc01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b392b5d7fdfafe server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:05.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.158+0000 7f2dbbfff640 1 -- 172.21.15.55:0/3734304501 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc0af600 con 0x7f2dc40ce220 2023-08-25T04:18:05.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.158+0000 7f2dbbfff640 1 -- 172.21.15.55:0/3734304501 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc0ab050 con 0x7f2dc40ce220 2023-08-25T04:18:05.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.158+0000 7f2dbbfff640 1 -- 172.21.15.55:0/3734304501 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc0af980 con 0x7f2dc40ce220 2023-08-25T04:18:05.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.158+0000 7f2dcb503640 1 -- 172.21.15.55:0/3734304501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dc40ce220 msgr2=0x7f2dc40b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:05.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.158+0000 7f2dcb503640 1 --2- 172.21.15.55:0/3734304501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dc40ce220 0x7f2dc40b3550 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009d90 tx=0x7f2dbc01f130 comp rx=0 tx=0).stop 2023-08-25T04:18:05.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.158+0000 7f2dcb503640 1 -- 172.21.15.55:0/3734304501 shutdown_connections 2023-08-25T04:18:05.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.158+0000 7f2dcb503640 1 --2- 172.21.15.55:0/3734304501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dc40ce220 0x7f2dc40b3550 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.158+0000 7f2dcb503640 1 -- 172.21.15.55:0/3734304501 >> 172.21.15.55:0/3734304501 conn(0x7f2dc409bae0 msgr2=0x7f2dc40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:05.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.158+0000 7f2dcb503640 1 -- 172.21.15.55:0/3734304501 shutdown_connections 2023-08-25T04:18:05.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.158+0000 7f2dcb503640 1 -- 172.21.15.55:0/3734304501 wait complete. 2023-08-25T04:18:05.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.158+0000 7f2dcb503640 1 Processor -- start 2023-08-25T04:18:05.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.158+0000 7f2dcb503640 1 -- start start 2023-08-25T04:18:05.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dcb503640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc40cdde0 0x7f2dc41f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:05.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dcb503640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc40ce220 0x7f2dc40c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:05.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dcb503640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dc40d0da0 0x7f2dc415f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:05.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dcb503640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc415df10 con 0x7f2dc40d0da0 2023-08-25T04:18:05.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dcb503640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc40c84c0 con 0x7f2dc40ce220 2023-08-25T04:18:05.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dcb503640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc40c8790 con 0x7f2dc40cdde0 2023-08-25T04:18:05.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dc9aa0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dc40d0da0 0x7f2dc415f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:05.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dc9aa0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dc40d0da0 0x7f2dc415f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50780/0 (socket says 172.21.15.55:50780) 2023-08-25T04:18:05.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dc9aa0640 1 -- 172.21.15.55:0/683732919 learned_addr learned my addr 172.21.15.55:0/683732919 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:05.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dc929f640 1 --2- 172.21.15.55:0/683732919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc40cdde0 0x7f2dc41f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:05.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dc8a9e640 1 --2- 172.21.15.55:0/683732919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc40ce220 0x7f2dc40c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:05.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dc9aa0640 1 -- 172.21.15.55:0/683732919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc40cdde0 msgr2=0x7f2dc41f5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:05.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dc9aa0640 1 --2- 172.21.15.55:0/683732919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc40cdde0 0x7f2dc41f5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dc9aa0640 1 -- 172.21.15.55:0/683732919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc40ce220 msgr2=0x7f2dc40c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:05.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dc9aa0640 1 --2- 172.21.15.55:0/683732919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc40ce220 0x7f2dc40c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dc9aa0640 1 -- 172.21.15.55:0/683732919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dbc009a70 con 0x7f2dc40d0da0 2023-08-25T04:18:05.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dc8a9e640 1 --2- 172.21.15.55:0/683732919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc40ce220 0x7f2dc40c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:05.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dc9aa0640 1 --2- 172.21.15.55:0/683732919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dc40d0da0 0x7f2dc415f7c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009d90 tx=0x7f2dbc01bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:05.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2db9ffb640 1 -- 172.21.15.55:0/683732919 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc009450 con 0x7f2dc40d0da0 2023-08-25T04:18:05.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2db9ffb640 1 -- 172.21.15.55:0/683732919 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc0039a0 con 0x7f2dc40d0da0 2023-08-25T04:18:05.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2db9ffb640 1 -- 172.21.15.55:0/683732919 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc003d50 con 0x7f2dc40d0da0 2023-08-25T04:18:05.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dcb503640 1 -- 172.21.15.55:0/683732919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc40c8a70 con 0x7f2dc40d0da0 2023-08-25T04:18:05.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dcb503640 1 -- 172.21.15.55:0/683732919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc40c9b70 con 0x7f2dc40d0da0 2023-08-25T04:18:05.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.162+0000 7f2dcb503640 1 -- 172.21.15.55:0/683732919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc404dbe0 con 0x7f2dc40d0da0 2023-08-25T04:18:05.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.166+0000 7f2db9ffb640 1 -- 172.21.15.55:0/683732919 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 26) v1 ==== 85076+0+0 (secure 0 0 0) 0x7f2dbc0b6050 con 0x7f2dc40d0da0 2023-08-25T04:18:05.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.166+0000 7f2db9ffb640 1 --2- 172.21.15.55:0/683732919 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f2da80657a0 0x7f2da8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:05.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.166+0000 7f2db9ffb640 1 -- 172.21.15.55:0/683732919 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f2dbc1206d0 con 0x7f2dc40d0da0 2023-08-25T04:18:05.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.166+0000 7f2dc929f640 1 -- 172.21.15.55:0/683732919 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f2da80657a0 msgr2=0x7f2da8067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3383442930 2023-08-25T04:18:05.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.166+0000 7f2dc929f640 1 --2- 172.21.15.55:0/683732919 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f2da80657a0 0x7f2da8067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:05.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.170+0000 7f2db9ffb640 1 -- 172.21.15.55:0/683732919 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2dbc0eded0 con 0x7f2dc40d0da0 2023-08-25T04:18:05.316 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:05.313+0000 7faaf57e8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:18:05.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.330+0000 7f2dcb503640 1 -- 172.21.15.55:0/683732919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2dc40d0b80 con 0x7f2dc40d0da0 2023-08-25T04:18:05.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.330+0000 7f2db9ffb640 1 -- 172.21.15.55:0/683732919 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+18963 (secure 0 0 0) 0x7f2dbc0f14f0 con 0x7f2dc40d0da0 2023-08-25T04:18:05.330 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:05.330 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":65,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:17:21.668052+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:16:00.903688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-25T04:16:02.143304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1a","mappings":[{"from":0,"to":1}]},{"pgid":"8.2d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/746484664":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/894259341":"2023-08-26T04:16:20.415897+0000","172.21.15.110:6833/1373721950":"2023-08-26T04:16:20.415897+0000","172.21.15.110:6832/1373721950":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/1127649499":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/33998418":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/188879394":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/1737595424":"2023-08-26T04:16:20.415897+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:18:05.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.334+0000 7f2dcb503640 1 -- 172.21.15.55:0/683732919 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f2da80657a0 msgr2=0x7f2da8067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:05.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.334+0000 7f2dcb503640 1 --2- 172.21.15.55:0/683732919 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f2da80657a0 0x7f2da8067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.334+0000 7f2dcb503640 1 -- 172.21.15.55:0/683732919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dc40d0da0 msgr2=0x7f2dc415f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:05.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.334+0000 7f2dcb503640 1 --2- 172.21.15.55:0/683732919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dc40d0da0 0x7f2dc415f7c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc009d90 tx=0x7f2dbc01bed0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.334+0000 7f2dcb503640 1 -- 172.21.15.55:0/683732919 shutdown_connections 2023-08-25T04:18:05.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.334+0000 7f2dcb503640 1 --2- 172.21.15.55:0/683732919 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f2da80657a0 0x7f2da8067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.334+0000 7f2dcb503640 1 --2- 172.21.15.55:0/683732919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dc40d0da0 0x7f2dc415f7c0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.334+0000 7f2dcb503640 1 --2- 172.21.15.55:0/683732919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2dc40ce220 0x7f2dc40c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.334+0000 7f2dcb503640 1 --2- 172.21.15.55:0/683732919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2dc40cdde0 0x7f2dc41f5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.334+0000 7f2dcb503640 1 -- 172.21.15.55:0/683732919 >> 172.21.15.55:0/683732919 conn(0x7f2dc409bae0 msgr2=0x7f2dc40af3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:05.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.334+0000 7f2dcb503640 1 -- 172.21.15.55:0/683732919 shutdown_connections 2023-08-25T04:18:05.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.334+0000 7f2dcb503640 1 -- 172.21.15.55:0/683732919 wait complete. 2023-08-25T04:18:05.345 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:05.346+0000 7fe5c8a19180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:18:05.352 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:16:00.903688+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:16:02.143304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:18:05.353 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:18:05.466 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:05.465+0000 7faaf57e8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:18:05.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.506+0000 7fdd73796640 1 Processor -- start 2023-08-25T04:18:05.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.506+0000 7fdd73796640 1 -- start start 2023-08-25T04:18:05.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.506+0000 7fdd73796640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdd6c15e3c0 0x7fdd6c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:05.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.506+0000 7fdd73796640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6c0cd5a0 con 0x7fdd6c1601f0 2023-08-25T04:18:05.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.506+0000 7fdd73796640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6c0cd880 con 0x7fdd6c0d1290 2023-08-25T04:18:05.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.506+0000 7fdd73796640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd6c0cdb60 con 0x7fdd6c15e3c0 2023-08-25T04:18:05.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.506+0000 7fdd71532640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdd6c1601f0 0x7fdd6c0d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32826/0 (socket says 172.21.15.55:32826) 2023-08-25T04:18:05.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.506+0000 7fdd71532640 1 -- 172.21.15.55:0/135355517 learned_addr learned my addr 172.21.15.55:0/135355517 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:05.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.506+0000 7fdd70d31640 1 --2- 172.21.15.55:0/135355517 >> v2:172.21.15.110:3300/0 conn(0x7fdd6c15e3c0 0x7fdd6c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:05.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.506+0000 7fdd63fff640 1 -- 172.21.15.55:0/135355517 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622730412 0 0) 0x7fdd6c0cd5a0 con 0x7fdd6c1601f0 2023-08-25T04:18:05.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.506+0000 7fdd63fff640 1 -- 172.21.15.55:0/135355517 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd58003530 con 0x7fdd6c1601f0 2023-08-25T04:18:05.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.506+0000 7fdd70d31640 1 -- 172.21.15.55:0/135355517 >> v1:172.21.15.110:6789/0 conn(0x7fdd6c0d1290 legacy=0x7fdd6c15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:05.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.506+0000 7fdd70d31640 1 -- 172.21.15.55:0/135355517 >> v1:172.21.15.55:6789/0 conn(0x7fdd6c1601f0 legacy=0x7fdd6c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:05.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.506+0000 7fdd70d31640 1 -- 172.21.15.55:0/135355517 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6c0cde40 con 0x7fdd6c15e3c0 2023-08-25T04:18:05.509 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:05.510+0000 7fe5c8a19180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:18:05.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.510+0000 7fdd70d31640 1 --2- 172.21.15.55:0/135355517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd6c15e3c0 0x7fdd6c15d430 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c0097c0 tx=0x7fdd5c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54900a2026d2aa96 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:05.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.510+0000 7fdd63fff640 1 -- 172.21.15.55:0/135355517 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c0ab600 con 0x7fdd6c15e3c0 2023-08-25T04:18:05.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.510+0000 7fdd63fff640 1 -- 172.21.15.55:0/135355517 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c0a7050 con 0x7fdd6c15e3c0 2023-08-25T04:18:05.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.510+0000 7fdd63fff640 1 -- 172.21.15.55:0/135355517 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c0ab980 con 0x7fdd6c15e3c0 2023-08-25T04:18:05.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.510+0000 7fdd73796640 1 -- 172.21.15.55:0/135355517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd6c15e3c0 msgr2=0x7fdd6c15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:05.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.510+0000 7fdd73796640 1 --2- 172.21.15.55:0/135355517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd6c15e3c0 0x7fdd6c15d430 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c0097c0 tx=0x7fdd5c01c450 comp rx=0 tx=0).stop 2023-08-25T04:18:05.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.510+0000 7fdd73796640 1 -- 172.21.15.55:0/135355517 shutdown_connections 2023-08-25T04:18:05.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.510+0000 7fdd73796640 1 --2- 172.21.15.55:0/135355517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd6c15e3c0 0x7fdd6c15d430 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.510+0000 7fdd73796640 1 -- 172.21.15.55:0/135355517 >> 172.21.15.55:0/135355517 conn(0x7fdd6c0d27d0 msgr2=0x7fdd6c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:05.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.510+0000 7fdd73796640 1 -- 172.21.15.55:0/135355517 shutdown_connections 2023-08-25T04:18:05.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.510+0000 7fdd73796640 1 -- 172.21.15.55:0/135355517 wait complete. 2023-08-25T04:18:05.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd73796640 1 Processor -- start 2023-08-25T04:18:05.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd73796640 1 -- start start 2023-08-25T04:18:05.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd73796640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd6c0d1290 0x7fdd6c156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:05.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd73796640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd6c15e3c0 0x7fdd6c151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:05.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd73796640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd6c1601f0 0x7fdd6c0c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:05.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd73796640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c156600 con 0x7fdd6c0d1290 2023-08-25T04:18:05.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd73796640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c158140 con 0x7fdd6c1601f0 2023-08-25T04:18:05.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd73796640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c155fb0 con 0x7fdd6c15e3c0 2023-08-25T04:18:05.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd71532640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd6c0d1290 0x7fdd6c156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:05.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd71532640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd6c0d1290 0x7fdd6c156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50792/0 (socket says 172.21.15.55:50792) 2023-08-25T04:18:05.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd71532640 1 -- 172.21.15.55:0/500819819 learned_addr learned my addr 172.21.15.55:0/500819819 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:05.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd71d33640 1 --2- 172.21.15.55:0/500819819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd6c1601f0 0x7fdd6c0c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:05.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd70d31640 1 --2- 172.21.15.55:0/500819819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd6c15e3c0 0x7fdd6c151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:05.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd71532640 1 -- 172.21.15.55:0/500819819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd6c15e3c0 msgr2=0x7fdd6c151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:05.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd71532640 1 --2- 172.21.15.55:0/500819819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd6c15e3c0 0x7fdd6c151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd71532640 1 -- 172.21.15.55:0/500819819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd6c1601f0 msgr2=0x7fdd6c0c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:05.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd71532640 1 --2- 172.21.15.55:0/500819819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd6c1601f0 0x7fdd6c0c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd71532640 1 -- 172.21.15.55:0/500819819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c009420 con 0x7fdd6c0d1290 2023-08-25T04:18:05.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd71532640 1 --2- 172.21.15.55:0/500819819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd6c0d1290 0x7fdd6c156ff0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fdd68001270 tx=0x7fdd6800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:05.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd61ffb640 1 -- 172.21.15.55:0/500819819 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd680074e0 con 0x7fdd6c0d1290 2023-08-25T04:18:05.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd61ffb640 1 -- 172.21.15.55:0/500819819 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd68007640 con 0x7fdd6c0d1290 2023-08-25T04:18:05.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd73796640 1 -- 172.21.15.55:0/500819819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6c156290 con 0x7fdd6c0d1290 2023-08-25T04:18:05.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd61ffb640 1 -- 172.21.15.55:0/500819819 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd680059b0 con 0x7fdd6c0d1290 2023-08-25T04:18:05.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.514+0000 7fdd73796640 1 -- 172.21.15.55:0/500819819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6c154cf0 con 0x7fdd6c0d1290 2023-08-25T04:18:05.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.518+0000 7fdd73796640 1 -- 172.21.15.55:0/500819819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6c0b5260 con 0x7fdd6c0d1290 2023-08-25T04:18:05.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.518+0000 7fdd61ffb640 1 -- 172.21.15.55:0/500819819 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 26) v1 ==== 85076+0+0 (secure 0 0 0) 0x7fdd68005b10 con 0x7fdd6c0d1290 2023-08-25T04:18:05.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.518+0000 7fdd61ffb640 1 --2- 172.21.15.55:0/500819819 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fdd500657a0 0x7fdd50067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:05.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.518+0000 7fdd70d31640 1 -- 172.21.15.55:0/500819819 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fdd500657a0 msgr2=0x7fdd50067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3383442930 2023-08-25T04:18:05.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.518+0000 7fdd61ffb640 1 -- 172.21.15.55:0/500819819 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fdd68082690 con 0x7fdd6c0d1290 2023-08-25T04:18:05.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.518+0000 7fdd70d31640 1 --2- 172.21.15.55:0/500819819 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fdd500657a0 0x7fdd50067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:05.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.522+0000 7fdd61ffb640 1 -- 172.21.15.55:0/500819819 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fdd6804ff70 con 0x7fdd6c0d1290 2023-08-25T04:18:05.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.682+0000 7fdd73796640 1 -- 172.21.15.55:0/500819819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd6c073ec0 con 0x7fdd6c0d1290 2023-08-25T04:18:05.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.682+0000 7fdd61ffb640 1 -- 172.21.15.55:0/500819819 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd68017020 con 0x7fdd6c0d1290 2023-08-25T04:18:05.684 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:18:05.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.686+0000 7fdd73796640 1 -- 172.21.15.55:0/500819819 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fdd500657a0 msgr2=0x7fdd50067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:05.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.686+0000 7fdd73796640 1 --2- 172.21.15.55:0/500819819 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fdd500657a0 0x7fdd50067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.686+0000 7fdd73796640 1 -- 172.21.15.55:0/500819819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd6c0d1290 msgr2=0x7fdd6c156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.686+0000 7fdd73796640 1 --2- 172.21.15.55:0/500819819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd6c0d1290 0x7fdd6c156ff0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fdd68001270 tx=0x7fdd6800c8e0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.686+0000 7fdd73796640 1 -- 172.21.15.55:0/500819819 shutdown_connections 2023-08-25T04:18:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.686+0000 7fdd73796640 1 --2- 172.21.15.55:0/500819819 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fdd500657a0 0x7fdd50067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.686+0000 7fdd73796640 1 --2- 172.21.15.55:0/500819819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd6c1601f0 0x7fdd6c0c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.686+0000 7fdd73796640 1 --2- 172.21.15.55:0/500819819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd6c15e3c0 0x7fdd6c151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.686+0000 7fdd73796640 1 --2- 172.21.15.55:0/500819819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd6c0d1290 0x7fdd6c156ff0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.686+0000 7fdd73796640 1 -- 172.21.15.55:0/500819819 >> 172.21.15.55:0/500819819 conn(0x7fdd6c0d27d0 msgr2=0x7fdd6c06bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.686+0000 7fdd73796640 1 -- 172.21.15.55:0/500819819 shutdown_connections 2023-08-25T04:18:05.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.686+0000 7fdd73796640 1 -- 172.21.15.55:0/500819819 wait complete. 2023-08-25T04:18:05.706 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:18:05.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.854+0000 7f5504f8f640 1 Processor -- start 2023-08-25T04:18:05.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.858+0000 7f5504f8f640 1 -- start start 2023-08-25T04:18:05.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.858+0000 7f5504f8f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55001601f0 0x7f550015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:05.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.858+0000 7f5504f8f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f550015e3c0 0x7f55000d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:05.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.858+0000 7f5504f8f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55000d10c0 0x7f55000b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:05.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.858+0000 7f5504f8f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55000cd5a0 con 0x7f550015e3c0 2023-08-25T04:18:05.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.858+0000 7f5504f8f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55000cd880 con 0x7f55001601f0 2023-08-25T04:18:05.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.858+0000 7f5504f8f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55000cdb60 con 0x7f55000d10c0 2023-08-25T04:18:05.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.858+0000 7f54f5d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f550015e3c0 0x7f55000d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:05.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.858+0000 7f54fe59c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55001601f0 0x7f550015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:05.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.858+0000 7f54fed9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55000d10c0 0x7f55000b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:05.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.858+0000 7f54f5d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f550015e3c0 0x7f55000d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50800/0 (socket says 172.21.15.55:50800) 2023-08-25T04:18:05.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.858+0000 7f54f5d9b640 1 -- 172.21.15.55:0/2786615724 learned_addr learned my addr 172.21.15.55:0/2786615724 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:05.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.858+0000 7f54f5d9b640 1 -- 172.21.15.55:0/2786615724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55000d10c0 msgr2=0x7f55000b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:05.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.858+0000 7f54f5d9b640 1 --2- 172.21.15.55:0/2786615724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55000d10c0 0x7f55000b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.858+0000 7f54f5d9b640 1 -- 172.21.15.55:0/2786615724 >> v2:172.21.15.110:3300/0 conn(0x7f55001601f0 msgr2=0x7f550015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:05.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.858+0000 7f54f5d9b640 1 --2- 172.21.15.55:0/2786615724 >> v2:172.21.15.110:3300/0 conn(0x7f55001601f0 0x7f550015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.858+0000 7f54f5d9b640 1 -- 172.21.15.55:0/2786615724 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55000cde40 con 0x7f550015e3c0 2023-08-25T04:18:05.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.862+0000 7f54f5d9b640 1 --2- 172.21.15.55:0/2786615724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f550015e3c0 0x7f55000d0b80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f550008b7f0 tx=0x7f54e801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2709bd9bc4d80cca server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:05.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.862+0000 7f54fdd9b640 1 -- 172.21.15.55:0/2786615724 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e80af400 con 0x7f550015e3c0 2023-08-25T04:18:05.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.862+0000 7f54fdd9b640 1 -- 172.21.15.55:0/2786615724 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e80ab050 con 0x7f550015e3c0 2023-08-25T04:18:05.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.862+0000 7f54fdd9b640 1 -- 172.21.15.55:0/2786615724 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e80af780 con 0x7f550015e3c0 2023-08-25T04:18:05.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.862+0000 7f5504f8f640 1 -- 172.21.15.55:0/2786615724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f550015e3c0 msgr2=0x7f55000d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:05.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.862+0000 7f5504f8f640 1 --2- 172.21.15.55:0/2786615724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f550015e3c0 0x7f55000d0b80 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f550008b7f0 tx=0x7f54e801f1c0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f5504f8f640 1 -- 172.21.15.55:0/2786615724 shutdown_connections 2023-08-25T04:18:05.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f5504f8f640 1 --2- 172.21.15.55:0/2786615724 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55000d10c0 0x7f55000b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f5504f8f640 1 --2- 172.21.15.55:0/2786615724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f550015e3c0 0x7f55000d0b80 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f5504f8f640 1 --2- 172.21.15.55:0/2786615724 >> v2:172.21.15.110:3300/0 conn(0x7f55001601f0 0x7f550015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f5504f8f640 1 -- 172.21.15.55:0/2786615724 >> 172.21.15.55:0/2786615724 conn(0x7f55000d27d0 msgr2=0x7f55000d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:05.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f5504f8f640 1 -- 172.21.15.55:0/2786615724 shutdown_connections 2023-08-25T04:18:05.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f5504f8f640 1 -- 172.21.15.55:0/2786615724 wait complete. 2023-08-25T04:18:05.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f5504f8f640 1 Processor -- start 2023-08-25T04:18:05.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f5504f8f640 1 -- start start 2023-08-25T04:18:05.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f5504f8f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55000d10c0 0x7f550015c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:05.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f5504f8f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f550015e3c0 0x7f550009d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:05.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f5504f8f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55001601f0 0x7f55000c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:05.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f5504f8f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550009fc20 con 0x7f55001601f0 2023-08-25T04:18:05.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f5504f8f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550009ff00 con 0x7f550015e3c0 2023-08-25T04:18:05.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f5504f8f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55000a01e0 con 0x7f55000d10c0 2023-08-25T04:18:05.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f54fed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55001601f0 0x7f55000c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:05.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f54f5d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f550015e3c0 0x7f550009d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:05.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f54fed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55001601f0 0x7f55000c7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50808/0 (socket says 172.21.15.55:50808) 2023-08-25T04:18:05.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f54fe59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55000d10c0 0x7f550015c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:05.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f54fed9d640 1 -- 172.21.15.55:0/1454102936 learned_addr learned my addr 172.21.15.55:0/1454102936 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:05.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f54f5d9b640 1 -- 172.21.15.55:0/1454102936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55000d10c0 msgr2=0x7f550015c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:05.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f54f5d9b640 1 --2- 172.21.15.55:0/1454102936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55000d10c0 0x7f550015c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f54f5d9b640 1 -- 172.21.15.55:0/1454102936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55001601f0 msgr2=0x7f55000c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:05.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.866+0000 7f54f5d9b640 1 --2- 172.21.15.55:0/1454102936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55001601f0 0x7f55000c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:05.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.870+0000 7f54f5d9b640 1 -- 172.21.15.55:0/1454102936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e8009b30 con 0x7f550015e3c0 2023-08-25T04:18:05.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.870+0000 7f54fed9d640 1 --2- 172.21.15.55:0/1454102936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55001601f0 0x7f55000c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:05.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.870+0000 7f54f5d9b640 1 --2- 172.21.15.55:0/1454102936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f550015e3c0 0x7f550009d080 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f54e80ae000 tx=0x7f54e801bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:05.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.870+0000 7f54f77fe640 1 -- 172.21.15.55:0/1454102936 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e80afd60 con 0x7f550015e3c0 2023-08-25T04:18:05.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.870+0000 7f54f77fe640 1 -- 172.21.15.55:0/1454102936 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e8009510 con 0x7f550015e3c0 2023-08-25T04:18:05.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.870+0000 7f54f77fe640 1 -- 172.21.15.55:0/1454102936 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e80ba660 con 0x7f550015e3c0 2023-08-25T04:18:05.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.870+0000 7f5504f8f640 1 -- 172.21.15.55:0/1454102936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55000ce7c0 con 0x7f550015e3c0 2023-08-25T04:18:05.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.870+0000 7f5504f8f640 1 -- 172.21.15.55:0/1454102936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55000caf60 con 0x7f550015e3c0 2023-08-25T04:18:05.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.870+0000 7f5504f8f640 1 -- 172.21.15.55:0/1454102936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55000b5260 con 0x7f550015e3c0 2023-08-25T04:18:05.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.870+0000 7f54f77fe640 1 -- 172.21.15.55:0/1454102936 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) v1 ==== 85076+0+0 (secure 0 0 0) 0x7f54e80b6040 con 0x7f550015e3c0 2023-08-25T04:18:05.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.874+0000 7f54f77fe640 1 --2- 172.21.15.55:0/1454102936 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f54e00657a0 0x7f54e0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:05.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.874+0000 7f54f77fe640 1 -- 172.21.15.55:0/1454102936 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f54e8121330 con 0x7f550015e3c0 2023-08-25T04:18:05.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.874+0000 7f54fe59c640 1 -- 172.21.15.55:0/1454102936 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f54e00657a0 msgr2=0x7f54e0067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3383442930 2023-08-25T04:18:05.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.874+0000 7f54fe59c640 1 --2- 172.21.15.55:0/1454102936 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f54e00657a0 0x7f54e0067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:05.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:05.882+0000 7f54f77fe640 1 -- 172.21.15.55:0/1454102936 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f54e80eec10 con 0x7f550015e3c0 2023-08-25T04:18:05.953 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:05.953+0000 7faaf57e8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:18:06.012 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:06.009+0000 7faaf57e8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:18:06.031 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:06.034+0000 7fe5c8a19180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:18:06.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.038+0000 7f5504f8f640 1 -- 172.21.15.55:0/1454102936 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f55000cb4a0 con 0x7f550015e3c0 2023-08-25T04:18:06.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.042+0000 7f54f77fe640 1 -- 172.21.15.55:0/1454102936 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v65) v1 ==== 92+0+10 (secure 0 0 0) 0x7f55000cb4a0 con 0x7f550015e3c0 2023-08-25T04:18:06.039 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:18:06.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.042+0000 7f5504f8f640 1 -- 172.21.15.55:0/1454102936 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f54e00657a0 msgr2=0x7f54e0067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:06.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.042+0000 7f5504f8f640 1 --2- 172.21.15.55:0/1454102936 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f54e00657a0 0x7f54e0067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.042+0000 7f5504f8f640 1 -- 172.21.15.55:0/1454102936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f550015e3c0 msgr2=0x7f550009d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:06.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.042+0000 7f5504f8f640 1 --2- 172.21.15.55:0/1454102936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f550015e3c0 0x7f550009d080 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f54e80ae000 tx=0x7f54e801bf60 comp rx=0 tx=0).stop 2023-08-25T04:18:06.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.042+0000 7f5504f8f640 1 -- 172.21.15.55:0/1454102936 shutdown_connections 2023-08-25T04:18:06.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.042+0000 7f5504f8f640 1 --2- 172.21.15.55:0/1454102936 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f54e00657a0 0x7f54e0067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.042+0000 7f5504f8f640 1 --2- 172.21.15.55:0/1454102936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55001601f0 0x7f55000c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.042+0000 7f5504f8f640 1 --2- 172.21.15.55:0/1454102936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f550015e3c0 0x7f550009d080 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.042+0000 7f5504f8f640 1 --2- 172.21.15.55:0/1454102936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55000d10c0 0x7f550015c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.042+0000 7f5504f8f640 1 -- 172.21.15.55:0/1454102936 >> 172.21.15.55:0/1454102936 conn(0x7f55000d27d0 msgr2=0x7f55000d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:06.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.042+0000 7f5504f8f640 1 -- 172.21.15.55:0/1454102936 shutdown_connections 2023-08-25T04:18:06.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.042+0000 7f5504f8f640 1 -- 172.21.15.55:0/1454102936 wait complete. 2023-08-25T04:18:06.062 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:18:06.067 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:06.065+0000 7faaf57e8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:18:06.094 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:06.094+0000 7fe5c8a19180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:18:06.153 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:06.149+0000 7faaf57e8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:18:06.154 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:06.154+0000 7fe5c8a19180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:18:06.211 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:06.209+0000 7faaf57e8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:18:06.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.214+0000 7f83abc6d640 1 Processor -- start 2023-08-25T04:18:06.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.214+0000 7f83abc6d640 1 -- start start 2023-08-25T04:18:06.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.214+0000 7f83abc6d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83a415e3c0 0x7f83a415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:06.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.214+0000 7f83abc6d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a40cd5a0 con 0x7f83a41601f0 2023-08-25T04:18:06.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.214+0000 7f83abc6d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a40cd880 con 0x7f83a40d1290 2023-08-25T04:18:06.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.214+0000 7f83abc6d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a40cdb60 con 0x7f83a415e3c0 2023-08-25T04:18:06.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.214+0000 7f83a9a09640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f83a41601f0 0x7f83a40d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32834/0 (socket says 172.21.15.55:32834) 2023-08-25T04:18:06.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.214+0000 7f83a9208640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83a415e3c0 0x7f83a415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:06.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.214+0000 7f83a9a09640 1 -- 172.21.15.55:0/3780743638 learned_addr learned my addr 172.21.15.55:0/3780743638 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:06.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.214+0000 7f83a8a07640 1 -- 172.21.15.55:0/3780743638 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936433128 0 0) 0x7f83a40cd5a0 con 0x7f83a41601f0 2023-08-25T04:18:06.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.214+0000 7f83a8a07640 1 -- 172.21.15.55:0/3780743638 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8390003530 con 0x7f83a41601f0 2023-08-25T04:18:06.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.214+0000 7f83a8a07640 1 -- 172.21.15.55:0/3780743638 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554037060 0 0) 0x7f83a40cd880 con 0x7f83a40d1290 2023-08-25T04:18:06.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.214+0000 7f83a9208640 1 -- 172.21.15.55:0/3780743638 >> v1:172.21.15.110:6789/0 conn(0x7f83a40d1290 legacy=0x7f83a415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:06.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.214+0000 7f83a9208640 1 -- 172.21.15.55:0/3780743638 >> v1:172.21.15.55:6789/0 conn(0x7f83a41601f0 legacy=0x7f83a40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:06.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.214+0000 7f83a9208640 1 -- 172.21.15.55:0/3780743638 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a40cde40 con 0x7f83a415e3c0 2023-08-25T04:18:06.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.218+0000 7f83a9208640 1 --2- 172.21.15.55:0/3780743638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83a415e3c0 0x7f83a415d430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f83940097f0 tx=0x7f839401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1eabdbe6cf5c632 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:06.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.218+0000 7f83a8a07640 1 -- 172.21.15.55:0/3780743638 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83940a89b0 con 0x7f83a415e3c0 2023-08-25T04:18:06.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.218+0000 7f83a8a07640 1 -- 172.21.15.55:0/3780743638 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83940a8b10 con 0x7f83a415e3c0 2023-08-25T04:18:06.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.218+0000 7f83a8a07640 1 -- 172.21.15.55:0/3780743638 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83940a8ea0 con 0x7f83a415e3c0 2023-08-25T04:18:06.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.218+0000 7f83abc6d640 1 -- 172.21.15.55:0/3780743638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83a415e3c0 msgr2=0x7f83a415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:06.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.218+0000 7f83abc6d640 1 --2- 172.21.15.55:0/3780743638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83a415e3c0 0x7f83a415d430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f83940097f0 tx=0x7f839401ecb0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.218+0000 7f83abc6d640 1 -- 172.21.15.55:0/3780743638 shutdown_connections 2023-08-25T04:18:06.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.218+0000 7f83abc6d640 1 --2- 172.21.15.55:0/3780743638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83a415e3c0 0x7f83a415d430 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.218+0000 7f83abc6d640 1 -- 172.21.15.55:0/3780743638 >> 172.21.15.55:0/3780743638 conn(0x7f83a40d27d0 msgr2=0x7f83a40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:06.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.218+0000 7f83abc6d640 1 -- 172.21.15.55:0/3780743638 shutdown_connections 2023-08-25T04:18:06.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.218+0000 7f83abc6d640 1 -- 172.21.15.55:0/3780743638 wait complete. 2023-08-25T04:18:06.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83abc6d640 1 Processor -- start 2023-08-25T04:18:06.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83abc6d640 1 -- start start 2023-08-25T04:18:06.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83abc6d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83a40d1290 0x7f83a40b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:06.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83abc6d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83a415e3c0 0x7f83a40b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:06.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83abc6d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83a41601f0 0x7f83a40afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:06.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83abc6d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a40c72c0 con 0x7f83a40d1290 2023-08-25T04:18:06.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83abc6d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a40b2670 con 0x7f83a41601f0 2023-08-25T04:18:06.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83abc6d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a40b2950 con 0x7f83a415e3c0 2023-08-25T04:18:06.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83a9a09640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83a40d1290 0x7f83a40b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:06.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83a9a09640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83a40d1290 0x7f83a40b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50818/0 (socket says 172.21.15.55:50818) 2023-08-25T04:18:06.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83a9a09640 1 -- 172.21.15.55:0/368849317 learned_addr learned my addr 172.21.15.55:0/368849317 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:06.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83aa20a640 1 --2- 172.21.15.55:0/368849317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83a41601f0 0x7f83a40afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:06.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83a9208640 1 --2- 172.21.15.55:0/368849317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83a415e3c0 0x7f83a40b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:06.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83a9a09640 1 -- 172.21.15.55:0/368849317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83a415e3c0 msgr2=0x7f83a40b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:06.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83a9a09640 1 --2- 172.21.15.55:0/368849317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83a415e3c0 0x7f83a40b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83a9a09640 1 -- 172.21.15.55:0/368849317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83a41601f0 msgr2=0x7f83a40afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:06.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83a9a09640 1 --2- 172.21.15.55:0/368849317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83a41601f0 0x7f83a40afbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83a9a09640 1 -- 172.21.15.55:0/368849317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8394009420 con 0x7f83a40d1290 2023-08-25T04:18:06.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83a9a09640 1 --2- 172.21.15.55:0/368849317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83a40d1290 0x7f83a40b1b20 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f83a000c400 tx=0x7f83a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:06.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f839a7fc640 1 -- 172.21.15.55:0/368849317 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a00074e0 con 0x7f83a40d1290 2023-08-25T04:18:06.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83abc6d640 1 -- 172.21.15.55:0/368849317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a40ce7c0 con 0x7f83a40d1290 2023-08-25T04:18:06.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f839a7fc640 1 -- 172.21.15.55:0/368849317 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a0007660 con 0x7f83a40d1290 2023-08-25T04:18:06.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f839a7fc640 1 -- 172.21.15.55:0/368849317 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a00059f0 con 0x7f83a40d1290 2023-08-25T04:18:06.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.222+0000 7f83abc6d640 1 -- 172.21.15.55:0/368849317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a40b2f10 con 0x7f83a40d1290 2023-08-25T04:18:06.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.226+0000 7f83abc6d640 1 -- 172.21.15.55:0/368849317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a40b5260 con 0x7f83a40d1290 2023-08-25T04:18:06.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.226+0000 7f839a7fc640 1 -- 172.21.15.55:0/368849317 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 26) v1 ==== 85076+0+0 (secure 0 0 0) 0x7f83a0005b50 con 0x7f83a40d1290 2023-08-25T04:18:06.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.226+0000 7f839a7fc640 1 --2- 172.21.15.55:0/368849317 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f83880657a0 0x7f8388067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:06.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.226+0000 7f839a7fc640 1 -- 172.21.15.55:0/368849317 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f83a00826f0 con 0x7f83a40d1290 2023-08-25T04:18:06.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.226+0000 7f83a9208640 1 -- 172.21.15.55:0/368849317 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f83880657a0 msgr2=0x7f8388067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3383442930 2023-08-25T04:18:06.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.226+0000 7f83a9208640 1 --2- 172.21.15.55:0/368849317 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f83880657a0 0x7f8388067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:06.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.230+0000 7f839a7fc640 1 -- 172.21.15.55:0/368849317 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f83a004ff40 con 0x7f83a40d1290 2023-08-25T04:18:06.249 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:06.250+0000 7fe5c8a19180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:18:06.296 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:06.293+0000 7faaf57e8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:18:06.309 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:06.310+0000 7fe5c8a19180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:18:06.352 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:06.349+0000 7faaf57e8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:18:06.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.390+0000 7f83abc6d640 1 -- 172.21.15.55:0/368849317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f83a4073ec0 con 0x7f83a40d1290 2023-08-25T04:18:06.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.390+0000 7f839a7fc640 1 -- 172.21.15.55:0/368849317 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7f83a0053560 con 0x7f83a40d1290 2023-08-25T04:18:06.388 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:18:06.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.390+0000 7f83abc6d640 1 -- 172.21.15.55:0/368849317 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f83880657a0 msgr2=0x7f8388067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:06.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.390+0000 7f83abc6d640 1 --2- 172.21.15.55:0/368849317 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f83880657a0 0x7f8388067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.390+0000 7f83abc6d640 1 -- 172.21.15.55:0/368849317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83a40d1290 msgr2=0x7f83a40b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:06.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.390+0000 7f83abc6d640 1 --2- 172.21.15.55:0/368849317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83a40d1290 0x7f83a40b1b20 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f83a000c400 tx=0x7f83a000c8c0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.390+0000 7f83abc6d640 1 -- 172.21.15.55:0/368849317 shutdown_connections 2023-08-25T04:18:06.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.390+0000 7f83abc6d640 1 --2- 172.21.15.55:0/368849317 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f83880657a0 0x7f8388067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.390+0000 7f83abc6d640 1 --2- 172.21.15.55:0/368849317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83a41601f0 0x7f83a40afbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.390+0000 7f83abc6d640 1 --2- 172.21.15.55:0/368849317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83a415e3c0 0x7f83a40b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.390+0000 7f83abc6d640 1 --2- 172.21.15.55:0/368849317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83a40d1290 0x7f83a40b1b20 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.390+0000 7f83abc6d640 1 -- 172.21.15.55:0/368849317 >> 172.21.15.55:0/368849317 conn(0x7f83a40d27d0 msgr2=0x7f83a415dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:06.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.390+0000 7f83abc6d640 1 -- 172.21.15.55:0/368849317 shutdown_connections 2023-08-25T04:18:06.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.390+0000 7f83abc6d640 1 -- 172.21.15.55:0/368849317 wait complete. 2023-08-25T04:18:06.398 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:06.398+0000 7fe5c8a19180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:18:06.409 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:18:06.457 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:06.458+0000 7fe5c8a19180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:18:06.494 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:06.493+0000 7faaf57e8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:18:06.552 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:06.549+0000 7faaf57e8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:18:06.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.598+0000 7f7d9d7e9640 1 Processor -- start 2023-08-25T04:18:06.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.598+0000 7f7d9d7e9640 1 -- start start 2023-08-25T04:18:06.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.602+0000 7f7d9d7e9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d980c9900 0x7f7d980cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:06.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.602+0000 7f7d9d7e9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7d9806c720 0x7f7d9806cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:06.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.602+0000 7f7d9d7e9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d980c9d90 con 0x7f7d980cb020 2023-08-25T04:18:06.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.602+0000 7f7d9d7e9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d9806d0d0 con 0x7f7d9806c720 2023-08-25T04:18:06.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.602+0000 7f7d9d7e9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d980cbca0 con 0x7f7d980c9900 2023-08-25T04:18:06.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.602+0000 7f7d96ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7d980cb020 0x7f7d980cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32840/0 (socket says 172.21.15.55:32840) 2023-08-25T04:18:06.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.602+0000 7f7d96ffd640 1 -- 172.21.15.55:0/393956501 learned_addr learned my addr 172.21.15.55:0/393956501 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:06.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.602+0000 7f7d8e7fc640 1 --2- 172.21.15.55:0/393956501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d980c9900 0x7f7d980cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:06.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.602+0000 7f7d977fe640 1 --2- 172.21.15.55:0/393956501 >> v2:172.21.15.110:3300/0 conn(0x7f7d9806c720 0x7f7d9806cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:06.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.602+0000 7f7d967fc640 1 -- 172.21.15.55:0/393956501 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513972764 0 0) 0x7f7d980c9d90 con 0x7f7d980cb020 2023-08-25T04:18:06.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.602+0000 7f7d967fc640 1 -- 172.21.15.55:0/393956501 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d84005740 con 0x7f7d980cb020 2023-08-25T04:18:06.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.602+0000 7f7d977fe640 1 -- 172.21.15.55:0/393956501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d980c9900 msgr2=0x7f7d980cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:06.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.602+0000 7f7d977fe640 1 --2- 172.21.15.55:0/393956501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d980c9900 0x7f7d980cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.602+0000 7f7d977fe640 1 -- 172.21.15.55:0/393956501 >> v1:172.21.15.55:6789/0 conn(0x7f7d980cb020 legacy=0x7f7d980cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:06.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.602+0000 7f7d977fe640 1 -- 172.21.15.55:0/393956501 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d980c9470 con 0x7f7d9806c720 2023-08-25T04:18:06.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.606+0000 7f7d977fe640 1 --2- 172.21.15.55:0/393956501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9806c720 0x7f7d9806cb90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009d90 tx=0x7f7d9001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f599d1b4b4ca0b62 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:06.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.606+0000 7f7d967fc640 1 -- 172.21.15.55:0/393956501 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d900a5780 con 0x7f7d9806c720 2023-08-25T04:18:06.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.606+0000 7f7d967fc640 1 -- 172.21.15.55:0/393956501 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d900a58e0 con 0x7f7d9806c720 2023-08-25T04:18:06.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.606+0000 7f7d967fc640 1 -- 172.21.15.55:0/393956501 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d900a5c70 con 0x7f7d9806c720 2023-08-25T04:18:06.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.606+0000 7f7d9d7e9640 1 -- 172.21.15.55:0/393956501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9806c720 msgr2=0x7f7d9806cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:06.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.606+0000 7f7d9d7e9640 1 --2- 172.21.15.55:0/393956501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9806c720 0x7f7d9806cb90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009d90 tx=0x7f7d9001c8c0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.606+0000 7f7d9d7e9640 1 -- 172.21.15.55:0/393956501 shutdown_connections 2023-08-25T04:18:06.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.606+0000 7f7d9d7e9640 1 --2- 172.21.15.55:0/393956501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d9806c720 0x7f7d9806cb90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.606+0000 7f7d9d7e9640 1 --2- 172.21.15.55:0/393956501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d980c9900 0x7f7d980cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.606+0000 7f7d9d7e9640 1 -- 172.21.15.55:0/393956501 >> 172.21.15.55:0/393956501 conn(0x7f7d98069900 msgr2=0x7f7d98069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:06.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.606+0000 7f7d9d7e9640 1 -- 172.21.15.55:0/393956501 shutdown_connections 2023-08-25T04:18:06.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.606+0000 7f7d9d7e9640 1 -- 172.21.15.55:0/393956501 wait complete. 2023-08-25T04:18:06.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.606+0000 7f7d9d7e9640 1 Processor -- start 2023-08-25T04:18:06.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.606+0000 7f7d9d7e9640 1 -- start start 2023-08-25T04:18:06.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d9d7e9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d9806c720 0x7f7d980c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:06.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d9d7e9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d980c9900 0x7f7d980b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:06.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d9d7e9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d980cb020 0x7f7d980b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:06.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d9d7e9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98099410 con 0x7f7d980c9900 2023-08-25T04:18:06.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d9d7e9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d980996f0 con 0x7f7d980cb020 2023-08-25T04:18:06.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d9d7e9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d980c3d50 con 0x7f7d9806c720 2023-08-25T04:18:06.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d8e7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d980c9900 0x7f7d980b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:06.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d96ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d9806c720 0x7f7d980c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:06.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d8e7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d980c9900 0x7f7d980b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50832/0 (socket says 172.21.15.55:50832) 2023-08-25T04:18:06.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d8e7fc640 1 -- 172.21.15.55:0/2943474471 learned_addr learned my addr 172.21.15.55:0/2943474471 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:06.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d977fe640 1 --2- 172.21.15.55:0/2943474471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d980cb020 0x7f7d980b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:06.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d977fe640 1 -- 172.21.15.55:0/2943474471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d9806c720 msgr2=0x7f7d980c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:06.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d977fe640 1 --2- 172.21.15.55:0/2943474471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d9806c720 0x7f7d980c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d977fe640 1 -- 172.21.15.55:0/2943474471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d980c9900 msgr2=0x7f7d980b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:06.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d977fe640 1 --2- 172.21.15.55:0/2943474471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d980c9900 0x7f7d980b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d977fe640 1 -- 172.21.15.55:0/2943474471 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d90009a70 con 0x7f7d980cb020 2023-08-25T04:18:06.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d977fe640 1 --2- 172.21.15.55:0/2943474471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d980cb020 0x7f7d980b0880 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7d900ac000 tx=0x7f7d90019660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:06.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d8ffff640 1 -- 172.21.15.55:0/2943474471 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d900b9450 con 0x7f7d980cb020 2023-08-25T04:18:06.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d8ffff640 1 -- 172.21.15.55:0/2943474471 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d900b95b0 con 0x7f7d980cb020 2023-08-25T04:18:06.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d8ffff640 1 -- 172.21.15.55:0/2943474471 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d900b9920 con 0x7f7d980cb020 2023-08-25T04:18:06.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d9d7e9640 1 -- 172.21.15.55:0/2943474471 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d980c4030 con 0x7f7d980cb020 2023-08-25T04:18:06.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d9d7e9640 1 -- 172.21.15.55:0/2943474471 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d980c86d0 con 0x7f7d980cb020 2023-08-25T04:18:06.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d9d7e9640 1 -- 172.21.15.55:0/2943474471 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d98073ec0 con 0x7f7d980cb020 2023-08-25T04:18:06.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.610+0000 7f7d8ffff640 1 -- 172.21.15.55:0/2943474471 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) v1 ==== 85076+0+0 (secure 0 0 0) 0x7f7d900b9a80 con 0x7f7d980cb020 2023-08-25T04:18:06.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.614+0000 7f7d8ffff640 1 --2- 172.21.15.55:0/2943474471 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f7d78069bb0 0x7f7d7806c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:06.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.614+0000 7f7d8ffff640 1 -- 172.21.15.55:0/2943474471 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f7d9011e040 con 0x7f7d980cb020 2023-08-25T04:18:06.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.614+0000 7f7d96ffd640 1 -- 172.21.15.55:0/2943474471 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f7d78069bb0 msgr2=0x7f7d7806c070 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3383442930 2023-08-25T04:18:06.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.614+0000 7f7d96ffd640 1 --2- 172.21.15.55:0/2943474471 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f7d78069bb0 0x7f7d7806c070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:06.614 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:06.614+0000 7fe5c8a19180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:18:06.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.618+0000 7f7d8ffff640 1 -- 172.21.15.55:0/2943474471 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7d900eb920 con 0x7f7d980cb020 2023-08-25T04:18:06.675 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:06.678+0000 7fe5c8a19180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:18:06.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.774+0000 7f7d9d7e9640 1 -- 172.21.15.55:0/2943474471 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7d98099830 con 0x7f7d980cb020 2023-08-25T04:18:06.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.774+0000 7f7d8ffff640 1 -- 172.21.15.55:0/2943474471 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7d900eef40 con 0x7f7d980cb020 2023-08-25T04:18:06.774 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:18:06.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.774+0000 7f7d9d7e9640 1 -- 172.21.15.55:0/2943474471 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f7d78069bb0 msgr2=0x7f7d7806c070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:06.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.774+0000 7f7d9d7e9640 1 --2- 172.21.15.55:0/2943474471 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f7d78069bb0 0x7f7d7806c070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.774+0000 7f7d9d7e9640 1 -- 172.21.15.55:0/2943474471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d980cb020 msgr2=0x7f7d980b0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:06.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.774+0000 7f7d9d7e9640 1 --2- 172.21.15.55:0/2943474471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d980cb020 0x7f7d980b0880 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7d900ac000 tx=0x7f7d90019660 comp rx=0 tx=0).stop 2023-08-25T04:18:06.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.774+0000 7f7d9d7e9640 1 -- 172.21.15.55:0/2943474471 shutdown_connections 2023-08-25T04:18:06.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.778+0000 7f7d9d7e9640 1 --2- 172.21.15.55:0/2943474471 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f7d78069bb0 0x7f7d7806c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.778+0000 7f7d9d7e9640 1 --2- 172.21.15.55:0/2943474471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d980cb020 0x7f7d980b0880 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.778+0000 7f7d9d7e9640 1 --2- 172.21.15.55:0/2943474471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d980c9900 0x7f7d980b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.778+0000 7f7d9d7e9640 1 --2- 172.21.15.55:0/2943474471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d9806c720 0x7f7d980c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:06.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.778+0000 7f7d9d7e9640 1 -- 172.21.15.55:0/2943474471 >> 172.21.15.55:0/2943474471 conn(0x7f7d98069900 msgr2=0x7f7d9815cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:06.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.778+0000 7f7d9d7e9640 1 -- 172.21.15.55:0/2943474471 shutdown_connections 2023-08-25T04:18:06.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:06.778+0000 7f7d9d7e9640 1 -- 172.21.15.55:0/2943474471 wait complete. 2023-08-25T04:18:06.795 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:18:06.797 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:18:06.797 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:18:06.797 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:18:06.803 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:06.801+0000 7faaf57e8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:18:06.928 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:18:06.928 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:18:06.929 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:18:06.937 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:06.938+0000 7fe5c8a19180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:18:06.937 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:06.937+0000 7faaf57e8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:18:07.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f93a0936640 1 Processor -- start 2023-08-25T04:18:07.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f93a0936640 1 -- start start 2023-08-25T04:18:07.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f93a0936640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f939c15ca50 0x7f939c0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f93a0936640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f939c0d0f50 0x7f939c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f93a0936640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f939c06c150 0x7f939c0b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f93a0936640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939c0d13d0 con 0x7f939c15ca50 2023-08-25T04:18:07.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f93a0936640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939c0afe20 con 0x7f939c06c150 2023-08-25T04:18:07.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f93a0936640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939c0af210 con 0x7f939c0d0f50 2023-08-25T04:18:07.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f939ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f939c15ca50 0x7f939c0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:07.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f939ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f939c15ca50 0x7f939c0d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50844/0 (socket says 172.21.15.55:50844) 2023-08-25T04:18:07.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f939ad9d640 1 -- 172.21.15.55:0/3742776602 learned_addr learned my addr 172.21.15.55:0/3742776602 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:07.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f9393fff640 1 --2- 172.21.15.55:0/3742776602 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f939c0d0f50 0x7f939c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:07.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f939b59e640 1 --2- 172.21.15.55:0/3742776602 >> v2:172.21.15.110:3300/0 conn(0x7f939c06c150 0x7f939c0b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:07.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f939ad9d640 1 -- 172.21.15.55:0/3742776602 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f939c0d0f50 msgr2=0x7f939c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:07.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f939ad9d640 1 --2- 172.21.15.55:0/3742776602 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f939c0d0f50 0x7f939c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f939ad9d640 1 -- 172.21.15.55:0/3742776602 >> v2:172.21.15.110:3300/0 conn(0x7f939c06c150 msgr2=0x7f939c0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f939ad9d640 1 --2- 172.21.15.55:0/3742776602 >> v2:172.21.15.110:3300/0 conn(0x7f939c06c150 0x7f939c0b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f939ad9d640 1 -- 172.21.15.55:0/3742776602 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c0af4f0 con 0x7f939c15ca50 2023-08-25T04:18:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f939b59e640 1 --2- 172.21.15.55:0/3742776602 >> v2:172.21.15.110:3300/0 conn(0x7f939c06c150 0x7f939c0b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:07.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.026+0000 7f9393fff640 1 --2- 172.21.15.55:0/3742776602 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f939c0d0f50 0x7f939c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.030+0000 7f939ad9d640 1 --2- 172.21.15.55:0/3742776602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f939c15ca50 0x7f939c0d0a10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f939c0c6080 tx=0x7f938c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b0888018e2a8a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.030+0000 7f939a59c640 1 -- 172.21.15.55:0/3742776602 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c0ab600 con 0x7f939c15ca50 2023-08-25T04:18:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.030+0000 7f939a59c640 1 -- 172.21.15.55:0/3742776602 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938c0a7050 con 0x7f939c15ca50 2023-08-25T04:18:07.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.030+0000 7f939a59c640 1 -- 172.21.15.55:0/3742776602 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c0ab980 con 0x7f939c15ca50 2023-08-25T04:18:07.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.030+0000 7f93a0936640 1 -- 172.21.15.55:0/3742776602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f939c15ca50 msgr2=0x7f939c0d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:07.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.030+0000 7f93a0936640 1 --2- 172.21.15.55:0/3742776602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f939c15ca50 0x7f939c0d0a10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f939c0c6080 tx=0x7f938c01c210 comp rx=0 tx=0).stop 2023-08-25T04:18:07.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.030+0000 7f93a0936640 1 -- 172.21.15.55:0/3742776602 shutdown_connections 2023-08-25T04:18:07.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.030+0000 7f93a0936640 1 --2- 172.21.15.55:0/3742776602 >> v2:172.21.15.110:3300/0 conn(0x7f939c06c150 0x7f939c0b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.030+0000 7f93a0936640 1 --2- 172.21.15.55:0/3742776602 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f939c0d0f50 0x7f939c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.030+0000 7f93a0936640 1 --2- 172.21.15.55:0/3742776602 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f939c15ca50 0x7f939c0d0a10 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.030+0000 7f93a0936640 1 -- 172.21.15.55:0/3742776602 >> 172.21.15.55:0/3742776602 conn(0x7f939c065f40 msgr2=0x7f939c09b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:07.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.030+0000 7f93a0936640 1 -- 172.21.15.55:0/3742776602 shutdown_connections 2023-08-25T04:18:07.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.030+0000 7f93a0936640 1 -- 172.21.15.55:0/3742776602 wait complete. 2023-08-25T04:18:07.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f93a0936640 1 Processor -- start 2023-08-25T04:18:07.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f93a0936640 1 -- start start 2023-08-25T04:18:07.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f93a0936640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f939c06c150 0x7f939c0b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f93a0936640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f939c0d0f50 0x7f939c14b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f93a0936640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f939c15ca50 0x7f939c0cf470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f93a0936640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939c0cd3a0 con 0x7f939c0d0f50 2023-08-25T04:18:07.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f93a0936640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939c0cd680 con 0x7f939c06c150 2023-08-25T04:18:07.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f93a0936640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939c0cd960 con 0x7f939c15ca50 2023-08-25T04:18:07.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f9393fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f939c0d0f50 0x7f939c14b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:07.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f9393fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f939c0d0f50 0x7f939c14b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50848/0 (socket says 172.21.15.55:50848) 2023-08-25T04:18:07.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f9393fff640 1 -- 172.21.15.55:0/4276554082 learned_addr learned my addr 172.21.15.55:0/4276554082 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:07.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f939ad9d640 1 --2- 172.21.15.55:0/4276554082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f939c06c150 0x7f939c0b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:07.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f939b59e640 1 --2- 172.21.15.55:0/4276554082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f939c15ca50 0x7f939c0cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:07.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f939ad9d640 1 -- 172.21.15.55:0/4276554082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f939c15ca50 msgr2=0x7f939c0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:07.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f939ad9d640 1 --2- 172.21.15.55:0/4276554082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f939c15ca50 0x7f939c0cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f939ad9d640 1 -- 172.21.15.55:0/4276554082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f939c0d0f50 msgr2=0x7f939c14b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:07.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f939ad9d640 1 --2- 172.21.15.55:0/4276554082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f939c0d0f50 0x7f939c14b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f939ad9d640 1 -- 172.21.15.55:0/4276554082 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c009480 con 0x7f939c06c150 2023-08-25T04:18:07.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f9393fff640 1 --2- 172.21.15.55:0/4276554082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f939c0d0f50 0x7f939c14b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:07.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f939ad9d640 1 --2- 172.21.15.55:0/4276554082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f939c06c150 0x7f939c0b3560 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f938c0ab000 tx=0x7f938c018fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:07.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.034+0000 7f93937fe640 1 -- 172.21.15.55:0/4276554082 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c003af0 con 0x7f939c06c150 2023-08-25T04:18:07.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.038+0000 7f93937fe640 1 -- 172.21.15.55:0/4276554082 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938c003c50 con 0x7f939c06c150 2023-08-25T04:18:07.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.038+0000 7f93a0936640 1 -- 172.21.15.55:0/4276554082 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f939c0cdc40 con 0x7f939c06c150 2023-08-25T04:18:07.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.038+0000 7f93937fe640 1 -- 172.21.15.55:0/4276554082 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c0b4460 con 0x7f939c06c150 2023-08-25T04:18:07.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.038+0000 7f93a0936640 1 -- 172.21.15.55:0/4276554082 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939c0ccfe0 con 0x7f939c06c150 2023-08-25T04:18:07.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.038+0000 7f93a0936640 1 -- 172.21.15.55:0/4276554082 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939c0cddd0 con 0x7f939c06c150 2023-08-25T04:18:07.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.038+0000 7f93937fe640 1 -- 172.21.15.55:0/4276554082 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 26) v1 ==== 85076+0+0 (secure 0 0 0) 0x7f938c0b2070 con 0x7f939c06c150 2023-08-25T04:18:07.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.038+0000 7f93937fe640 1 --2- 172.21.15.55:0/4276554082 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f937c0657a0 0x7f937c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.038+0000 7f93937fe640 1 -- 172.21.15.55:0/4276554082 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f938c11bf60 con 0x7f939c06c150 2023-08-25T04:18:07.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.038+0000 7f9393fff640 1 -- 172.21.15.55:0/4276554082 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f937c0657a0 msgr2=0x7f937c067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3383442930 2023-08-25T04:18:07.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.038+0000 7f9393fff640 1 --2- 172.21.15.55:0/4276554082 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f937c0657a0 0x7f937c067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:07.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.042+0000 7f93937fe640 1 -- 172.21.15.55:0/4276554082 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f938c0e9730 con 0x7f939c06c150 2023-08-25T04:18:07.064 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:07.061+0000 7faaf57e8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:18:07.083 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:07.082+0000 7fe5c8a19180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:18:07.135 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:07.133+0000 7faaf57e8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:18:07.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.210+0000 7f93a0936640 1 -- 172.21.15.55:0/4276554082 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f939c0cd7c0 con 0x7f939c06c150 2023-08-25T04:18:07.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.214+0000 7f93937fe640 1 -- 172.21.15.55:0/4276554082 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v65) v1 ==== 80+0+473 (secure 0 0 0) 0x7f938c0b01f0 con 0x7f939c06c150 2023-08-25T04:18:07.212 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/746484664 2023-08-26T04:16:20.415897+0000 2023-08-25T04:18:07.212 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/894259341 2023-08-26T04:16:20.415897+0000 2023-08-25T04:18:07.212 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6833/1373721950 2023-08-26T04:16:20.415897+0000 2023-08-25T04:18:07.212 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6832/1373721950 2023-08-26T04:16:20.415897+0000 2023-08-25T04:18:07.212 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/1127649499 2023-08-26T04:16:20.415897+0000 2023-08-25T04:18:07.212 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/33998418 2023-08-26T04:16:20.415897+0000 2023-08-25T04:18:07.213 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/188879394 2023-08-26T04:16:20.415897+0000 2023-08-25T04:18:07.213 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/1737595424 2023-08-26T04:16:20.415897+0000 2023-08-25T04:18:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:listed 8 entries 2023-08-25T04:18:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.214+0000 7f93a0936640 1 -- 172.21.15.55:0/4276554082 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f937c0657a0 msgr2=0x7f937c067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.214+0000 7f93a0936640 1 --2- 172.21.15.55:0/4276554082 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f937c0657a0 0x7f937c067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.214+0000 7f93a0936640 1 -- 172.21.15.55:0/4276554082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f939c06c150 msgr2=0x7f939c0b3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.214+0000 7f93a0936640 1 --2- 172.21.15.55:0/4276554082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f939c06c150 0x7f939c0b3560 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f938c0ab000 tx=0x7f938c018fb0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.214+0000 7f93a0936640 1 -- 172.21.15.55:0/4276554082 shutdown_connections 2023-08-25T04:18:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.214+0000 7f93a0936640 1 --2- 172.21.15.55:0/4276554082 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f937c0657a0 0x7f937c067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.214+0000 7f93a0936640 1 --2- 172.21.15.55:0/4276554082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f939c15ca50 0x7f939c0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.214+0000 7f93a0936640 1 --2- 172.21.15.55:0/4276554082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f939c0d0f50 0x7f939c14b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.214+0000 7f93a0936640 1 --2- 172.21.15.55:0/4276554082 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f939c06c150 0x7f939c0b3560 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.214+0000 7f93a0936640 1 -- 172.21.15.55:0/4276554082 >> 172.21.15.55:0/4276554082 conn(0x7f939c065f40 msgr2=0x7f939c155580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.214+0000 7f93a0936640 1 -- 172.21.15.55:0/4276554082 shutdown_connections 2023-08-25T04:18:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.214+0000 7f93a0936640 1 -- 172.21.15.55:0/4276554082 wait complete. 2023-08-25T04:18:07.216 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:07.218+0000 7fe5c8a19180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:18:07.233 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-25T04:18:07.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:07.234 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-25T04:18:07.270 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:07.269+0000 7faaf57e8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:18:07.294 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:07.294+0000 7fe5c8a19180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:18:07.295 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T04:18:07.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:07.296 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-25T04:18:07.306 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:18:07.307 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:07.316 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:18:07.317 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:18:07.317 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:07.355 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T04:18:07.356 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:18:07.356 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:07.365 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:18:07.366 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:18:07.437 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:07.438+0000 7fe5c8a19180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:18:07.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.542+0000 7f57091db640 1 Processor -- start 2023-08-25T04:18:07.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.542+0000 7f57091db640 1 -- start start 2023-08-25T04:18:07.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.546+0000 7f57091db640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f57040d0da0 0x7f57040d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.546+0000 7f57091db640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57040cdde0 0x7f57040ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.546+0000 7f57091db640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57040cee60 0x7f57040cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.546+0000 7f57091db640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57040ce760 con 0x7f57040cdde0 2023-08-25T04:18:07.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.546+0000 7f57091db640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57040b29b0 con 0x7f57040d0da0 2023-08-25T04:18:07.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.546+0000 7f57091db640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57040d16c0 con 0x7f57040cee60 2023-08-25T04:18:07.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.546+0000 7f56fbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57040cdde0 0x7f57040ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:07.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.546+0000 7f56fbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57040cdde0 0x7f57040ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50852/0 (socket says 172.21.15.55:50852) 2023-08-25T04:18:07.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.546+0000 7f56fbfff640 1 -- 172.21.15.55:0/3356741551 learned_addr learned my addr 172.21.15.55:0/3356741551 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:07.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.546+0000 7f5702d9d640 1 --2- 172.21.15.55:0/3356741551 >> v2:172.21.15.110:3300/0 conn(0x7f57040d0da0 0x7f57040d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:07.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.546+0000 7f570359e640 1 --2- 172.21.15.55:0/3356741551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57040cee60 0x7f57040cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:07.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.546+0000 7f56fbfff640 1 -- 172.21.15.55:0/3356741551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57040cee60 msgr2=0x7f57040cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:07.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.546+0000 7f56fbfff640 1 --2- 172.21.15.55:0/3356741551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57040cee60 0x7f57040cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.546+0000 7f56fbfff640 1 -- 172.21.15.55:0/3356741551 >> v2:172.21.15.110:3300/0 conn(0x7f57040d0da0 msgr2=0x7f57040d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:07.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.546+0000 7f56fbfff640 1 --2- 172.21.15.55:0/3356741551 >> v2:172.21.15.110:3300/0 conn(0x7f57040d0da0 0x7f57040d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.546+0000 7f56fbfff640 1 -- 172.21.15.55:0/3356741551 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57040b1dc0 con 0x7f57040cdde0 2023-08-25T04:18:07.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.546+0000 7f570359e640 1 --2- 172.21.15.55:0/3356741551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57040cee60 0x7f57040cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:07.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.550+0000 7f56fbfff640 1 --2- 172.21.15.55:0/3356741551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57040cdde0 0x7f57040ce220 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5704073720 tx=0x7f56ec01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb1bab7ddeedf85 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:07.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.550+0000 7f570259c640 1 -- 172.21.15.55:0/3356741551 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec0a89b0 con 0x7f57040cdde0 2023-08-25T04:18:07.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.550+0000 7f570259c640 1 -- 172.21.15.55:0/3356741551 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec0a8b10 con 0x7f57040cdde0 2023-08-25T04:18:07.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.550+0000 7f570259c640 1 -- 172.21.15.55:0/3356741551 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec0a8ea0 con 0x7f57040cdde0 2023-08-25T04:18:07.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.550+0000 7f57091db640 1 -- 172.21.15.55:0/3356741551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57040cdde0 msgr2=0x7f57040ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:07.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.550+0000 7f57091db640 1 --2- 172.21.15.55:0/3356741551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57040cdde0 0x7f57040ce220 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f5704073720 tx=0x7f56ec01ecf0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.550+0000 7f57091db640 1 -- 172.21.15.55:0/3356741551 shutdown_connections 2023-08-25T04:18:07.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.550+0000 7f57091db640 1 --2- 172.21.15.55:0/3356741551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57040cee60 0x7f57040cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.550+0000 7f57091db640 1 --2- 172.21.15.55:0/3356741551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57040cdde0 0x7f57040ce220 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.550+0000 7f57091db640 1 --2- 172.21.15.55:0/3356741551 >> v2:172.21.15.110:3300/0 conn(0x7f57040d0da0 0x7f57040d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.550+0000 7f57091db640 1 -- 172.21.15.55:0/3356741551 >> 172.21.15.55:0/3356741551 conn(0x7f570409bae0 msgr2=0x7f57040d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:07.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.550+0000 7f57091db640 1 -- 172.21.15.55:0/3356741551 shutdown_connections 2023-08-25T04:18:07.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.550+0000 7f57091db640 1 -- 172.21.15.55:0/3356741551 wait complete. 2023-08-25T04:18:07.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.550+0000 7f57091db640 1 Processor -- start 2023-08-25T04:18:07.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.550+0000 7f57091db640 1 -- start start 2023-08-25T04:18:07.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f57091db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57040cdde0 0x7f5704155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f57091db640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57040cee60 0x7f57040b6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f57091db640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57040d0da0 0x7f57040cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f57091db640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5704156450 con 0x7f57040cdde0 2023-08-25T04:18:07.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f57091db640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57040b6970 con 0x7f57040d0da0 2023-08-25T04:18:07.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f57091db640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57040cc430 con 0x7f57040cee60 2023-08-25T04:18:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f5702d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57040cdde0 0x7f5704155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f5702d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57040cdde0 0x7f5704155f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50860/0 (socket says 172.21.15.55:50860) 2023-08-25T04:18:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f5702d9d640 1 -- 172.21.15.55:0/1888869289 learned_addr learned my addr 172.21.15.55:0/1888869289 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f56fbfff640 1 --2- 172.21.15.55:0/1888869289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57040cee60 0x7f57040b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f570359e640 1 --2- 172.21.15.55:0/1888869289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57040d0da0 0x7f57040cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f5702d9d640 1 -- 172.21.15.55:0/1888869289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57040cee60 msgr2=0x7f57040b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f5702d9d640 1 --2- 172.21.15.55:0/1888869289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57040cee60 0x7f57040b6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f5702d9d640 1 -- 172.21.15.55:0/1888869289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57040d0da0 msgr2=0x7f57040cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:07.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f5702d9d640 1 --2- 172.21.15.55:0/1888869289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57040d0da0 0x7f57040cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f5702d9d640 1 -- 172.21.15.55:0/1888869289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec0094d0 con 0x7f57040cdde0 2023-08-25T04:18:07.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f570359e640 1 --2- 172.21.15.55:0/1888869289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57040d0da0 0x7f57040cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:07.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f5702d9d640 1 --2- 172.21.15.55:0/1888869289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57040cdde0 0x7f5704155f10 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f56f400e9b0 tx=0x7f56f400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:07.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f56fb7fe640 1 -- 172.21.15.55:0/1888869289 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f4009670 con 0x7f57040cdde0 2023-08-25T04:18:07.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f56fb7fe640 1 -- 172.21.15.55:0/1888869289 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f400c9a0 con 0x7f57040cdde0 2023-08-25T04:18:07.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f56fb7fe640 1 -- 172.21.15.55:0/1888869289 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f400cd10 con 0x7f57040cdde0 2023-08-25T04:18:07.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f57091db640 1 -- 172.21.15.55:0/1888869289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57040b6b60 con 0x7f57040cdde0 2023-08-25T04:18:07.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f57091db640 1 -- 172.21.15.55:0/1888869289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57040b7120 con 0x7f57040cdde0 2023-08-25T04:18:07.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.554+0000 7f57091db640 1 -- 172.21.15.55:0/1888869289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f570404dbe0 con 0x7f57040cdde0 2023-08-25T04:18:07.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.558+0000 7f56fb7fe640 1 -- 172.21.15.55:0/1888869289 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 26) v1 ==== 85076+0+0 (secure 0 0 0) 0x7f56f4013470 con 0x7f57040cdde0 2023-08-25T04:18:07.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.558+0000 7f56fb7fe640 1 --2- 172.21.15.55:0/1888869289 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f56e40657a0 0x7f56e4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.558+0000 7f56fb7fe640 1 -- 172.21.15.55:0/1888869289 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f56f40836e0 con 0x7f57040cdde0 2023-08-25T04:18:07.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.558+0000 7f56fbfff640 1 -- 172.21.15.55:0/1888869289 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f56e40657a0 msgr2=0x7f56e4067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3383442930 2023-08-25T04:18:07.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.558+0000 7f56fbfff640 1 --2- 172.21.15.55:0/1888869289 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f56e40657a0 0x7f56e4067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:07.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.562+0000 7f56fb7fe640 1 -- 172.21.15.55:0/1888869289 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f56f4050f30 con 0x7f57040cdde0 2023-08-25T04:18:07.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.750+0000 7f57091db640 1 -- 172.21.15.55:0/1888869289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57040d0b80 con 0x7f57040cdde0 2023-08-25T04:18:07.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.750+0000 7f56fb7fe640 1 -- 172.21.15.55:0/1888869289 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4875 (secure 0 0 0) 0x7f56f4054550 con 0x7f57040cdde0 2023-08-25T04:18:07.750 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:07.751 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3163426480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3163426480},{"type":"v1","addr":"172.21.15.55:6835","nonce":3163426480}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/397210265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":397210265},{"type":"v1","addr":"172.21.15.110:6836","nonce":397210265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6198,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/894580528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":894580528},{"type":"v1","addr":"172.21.15.55:6834","nonce":894580528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:16:03.155108+0000","modified":"2023-08-25T04:16:06.786907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6837/1578265172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1578265172},{"type":"v1","addr":"172.21.15.110:6837","nonce":1578265172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-25T04:18:07.751 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 24 2023-08-25T04:18:07.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.754+0000 7f57091db640 1 -- 172.21.15.55:0/1888869289 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f56e40657a0 msgr2=0x7f56e4067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:07.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.754+0000 7f57091db640 1 --2- 172.21.15.55:0/1888869289 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f56e40657a0 0x7f56e4067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.754+0000 7f57091db640 1 -- 172.21.15.55:0/1888869289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57040cdde0 msgr2=0x7f5704155f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.754+0000 7f57091db640 1 --2- 172.21.15.55:0/1888869289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57040cdde0 0x7f5704155f10 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f56f400e9b0 tx=0x7f56f400ee70 comp rx=0 tx=0).stop 2023-08-25T04:18:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.754+0000 7f57091db640 1 -- 172.21.15.55:0/1888869289 shutdown_connections 2023-08-25T04:18:07.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.754+0000 7f57091db640 1 --2- 172.21.15.55:0/1888869289 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7f56e40657a0 0x7f56e4067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.754+0000 7f57091db640 1 --2- 172.21.15.55:0/1888869289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57040d0da0 0x7f57040cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.754+0000 7f57091db640 1 --2- 172.21.15.55:0/1888869289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57040cee60 0x7f57040b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.754+0000 7f57091db640 1 --2- 172.21.15.55:0/1888869289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57040cdde0 0x7f5704155f10 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.754+0000 7f57091db640 1 -- 172.21.15.55:0/1888869289 >> 172.21.15.55:0/1888869289 conn(0x7f570409bae0 msgr2=0x7f570406bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:07.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.754+0000 7f57091db640 1 -- 172.21.15.55:0/1888869289 shutdown_connections 2023-08-25T04:18:07.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.754+0000 7f57091db640 1 -- 172.21.15.55:0/1888869289 wait complete. 2023-08-25T04:18:07.772 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:18:07.814 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:07.813+0000 7faaf57e8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:18:07.899 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:07.897+0000 7faaf57e8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:18:07.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.962+0000 7fccdd626640 1 Processor -- start 2023-08-25T04:18:07.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.962+0000 7fccdd626640 1 -- start start 2023-08-25T04:18:07.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.962+0000 7fccdd626640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fccd815a300 0x7fccd815e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.962+0000 7fccdd626640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fccd80b10d0 0x7fccd806f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.962+0000 7fccdd626640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd80ca9d0 con 0x7fccd806fe20 2023-08-25T04:18:07.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.962+0000 7fccdd626640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd815eee0 con 0x7fccd815a300 2023-08-25T04:18:07.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.962+0000 7fccdd626640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd80702b0 con 0x7fccd80b10d0 2023-08-25T04:18:07.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.962+0000 7fccd7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fccd815a300 0x7fccd815e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:07.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.962+0000 7fccd7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fccd815a300 0x7fccd815e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50872/0 (socket says 172.21.15.55:50872) 2023-08-25T04:18:07.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.962+0000 7fccd7fff640 1 -- 172.21.15.55:0/464784751 learned_addr learned my addr 172.21.15.55:0/464784751 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:07.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.962+0000 7fccdce25640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fccd806fe20 0x7fccd80c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32852/0 (socket says 172.21.15.55:32852) 2023-08-25T04:18:07.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.962+0000 7fccd77fe640 1 --2- 172.21.15.55:0/464784751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fccd80b10d0 0x7fccd806f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:07.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.962+0000 7fccd7fff640 1 -- 172.21.15.55:0/464784751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fccd80b10d0 msgr2=0x7fccd806f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:07.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.962+0000 7fccd7fff640 1 --2- 172.21.15.55:0/464784751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fccd80b10d0 0x7fccd806f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.962+0000 7fccd7fff640 1 -- 172.21.15.55:0/464784751 >> v1:172.21.15.55:6789/0 conn(0x7fccd806fe20 legacy=0x7fccd80c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:07.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.962+0000 7fccd7fff640 1 -- 172.21.15.55:0/464784751 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd80cacb0 con 0x7fccd815a300 2023-08-25T04:18:07.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.966+0000 7fccd7fff640 1 --2- 172.21.15.55:0/464784751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd815a300 0x7fccd815e9a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009870 tx=0x7fccc801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b955e3de8685c76 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:07.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.966+0000 7fccd6ffd640 1 -- 172.21.15.55:0/464784751 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc80aa670 con 0x7fccd815a300 2023-08-25T04:18:07.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.966+0000 7fccd6ffd640 1 -- 172.21.15.55:0/464784751 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc80aa7d0 con 0x7fccd815a300 2023-08-25T04:18:07.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.966+0000 7fccd6ffd640 1 -- 172.21.15.55:0/464784751 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc80aab60 con 0x7fccd815a300 2023-08-25T04:18:07.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.966+0000 7fccdd626640 1 -- 172.21.15.55:0/464784751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd815a300 msgr2=0x7fccd815e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:07.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.966+0000 7fccdd626640 1 --2- 172.21.15.55:0/464784751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd815a300 0x7fccd815e9a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009870 tx=0x7fccc801c510 comp rx=0 tx=0).stop 2023-08-25T04:18:07.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.966+0000 7fccdd626640 1 -- 172.21.15.55:0/464784751 shutdown_connections 2023-08-25T04:18:07.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.966+0000 7fccdd626640 1 --2- 172.21.15.55:0/464784751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fccd80b10d0 0x7fccd806f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.966+0000 7fccdd626640 1 --2- 172.21.15.55:0/464784751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd815a300 0x7fccd815e9a0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.966+0000 7fccdd626640 1 -- 172.21.15.55:0/464784751 >> 172.21.15.55:0/464784751 conn(0x7fccd8069f00 msgr2=0x7fccd80afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:07.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.966+0000 7fccdd626640 1 -- 172.21.15.55:0/464784751 shutdown_connections 2023-08-25T04:18:07.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.966+0000 7fccdd626640 1 -- 172.21.15.55:0/464784751 wait complete. 2023-08-25T04:18:07.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.966+0000 7fccdd626640 1 Processor -- start 2023-08-25T04:18:07.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdd626640 1 -- start start 2023-08-25T04:18:07.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdd626640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccd806fe20 0x7fccd8158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdd626640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fccd80b10d0 0x7fccd8156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdd626640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd815a300 0x7fccd8156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdd626640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd815b8b0 con 0x7fccd815a300 2023-08-25T04:18:07.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdd626640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd8158360 con 0x7fccd806fe20 2023-08-25T04:18:07.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdd626640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd8158fb0 con 0x7fccd80b10d0 2023-08-25T04:18:07.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdce25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd815a300 0x7fccd8156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:07.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdce25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd815a300 0x7fccd8156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50876/0 (socket says 172.21.15.55:50876) 2023-08-25T04:18:07.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdce25640 1 -- 172.21.15.55:0/1334790988 learned_addr learned my addr 172.21.15.55:0/1334790988 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:07.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccd77fe640 1 --2- 172.21.15.55:0/1334790988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fccd80b10d0 0x7fccd8156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:07.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccd7fff640 1 --2- 172.21.15.55:0/1334790988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccd806fe20 0x7fccd8158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:07.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdce25640 1 -- 172.21.15.55:0/1334790988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fccd80b10d0 msgr2=0x7fccd8156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:07.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdce25640 1 --2- 172.21.15.55:0/1334790988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fccd80b10d0 0x7fccd8156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdce25640 1 -- 172.21.15.55:0/1334790988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccd806fe20 msgr2=0x7fccd8158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:07.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdce25640 1 --2- 172.21.15.55:0/1334790988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccd806fe20 0x7fccd8158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:07.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdce25640 1 -- 172.21.15.55:0/1334790988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc80094d0 con 0x7fccd815a300 2023-08-25T04:18:07.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdce25640 1 --2- 172.21.15.55:0/1334790988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd815a300 0x7fccd8156fd0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fccd000cbf0 tx=0x7fccd000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:07.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccd4ff9640 1 -- 172.21.15.55:0/1334790988 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd000ad50 con 0x7fccd815a300 2023-08-25T04:18:07.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccd4ff9640 1 -- 172.21.15.55:0/1334790988 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd0007070 con 0x7fccd815a300 2023-08-25T04:18:07.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdd626640 1 -- 172.21.15.55:0/1334790988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd8157750 con 0x7fccd815a300 2023-08-25T04:18:07.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccd4ff9640 1 -- 172.21.15.55:0/1334790988 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd0007420 con 0x7fccd815a300 2023-08-25T04:18:07.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdd626640 1 -- 172.21.15.55:0/1334790988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd8157d10 con 0x7fccd815a300 2023-08-25T04:18:07.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.970+0000 7fccdd626640 1 -- 172.21.15.55:0/1334790988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd8158510 con 0x7fccd815a300 2023-08-25T04:18:07.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.974+0000 7fccd4ff9640 1 -- 172.21.15.55:0/1334790988 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 26) v1 ==== 85076+0+0 (secure 0 0 0) 0x7fccd0007580 con 0x7fccd815a300 2023-08-25T04:18:07.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.974+0000 7fccd4ff9640 1 --2- 172.21.15.55:0/1334790988 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fccc40657a0 0x7fccc4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:07.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.974+0000 7fccd4ff9640 1 -- 172.21.15.55:0/1334790988 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fccd00830a0 con 0x7fccd815a300 2023-08-25T04:18:07.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.974+0000 7fccd7fff640 1 -- 172.21.15.55:0/1334790988 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fccc40657a0 msgr2=0x7fccc4067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3383442930 2023-08-25T04:18:07.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.974+0000 7fccd7fff640 1 --2- 172.21.15.55:0/1334790988 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fccc40657a0 0x7fccc4067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:07.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:07.978+0000 7fccd4ff9640 1 -- 172.21.15.55:0/1334790988 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fccd8158510 con 0x7fccd815a300 2023-08-25T04:18:08.023 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:08.022+0000 7fe5c8a19180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:18:08.048 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:08.045+0000 7faaf57e8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:18:08.112 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:08.114+0000 7fe5c8a19180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:18:08.131 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:08.129+0000 7faaf57e8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:18:08.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.134+0000 7fccdd626640 1 -- 172.21.15.55:0/1334790988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccd8158510 con 0x7fccd815a300 2023-08-25T04:18:08.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.138+0000 7fccd4ff9640 1 -- 172.21.15.55:0/1334790988 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+18963 (secure 0 0 0) 0x7fccd8158510 con 0x7fccd815a300 2023-08-25T04:18:08.137 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:08.137 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":65,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:17:21.668052+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:16:00.903688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-25T04:16:02.143304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1a","mappings":[{"from":0,"to":1}]},{"pgid":"8.2d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/746484664":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/894259341":"2023-08-26T04:16:20.415897+0000","172.21.15.110:6833/1373721950":"2023-08-26T04:16:20.415897+0000","172.21.15.110:6832/1373721950":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/1127649499":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/33998418":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/188879394":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/1737595424":"2023-08-26T04:16:20.415897+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:18:08.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.138+0000 7fccdd626640 1 -- 172.21.15.55:0/1334790988 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fccc40657a0 msgr2=0x7fccc4067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:08.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.138+0000 7fccdd626640 1 --2- 172.21.15.55:0/1334790988 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fccc40657a0 0x7fccc4067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.138+0000 7fccdd626640 1 -- 172.21.15.55:0/1334790988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd815a300 msgr2=0x7fccd8156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:08.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.138+0000 7fccdd626640 1 --2- 172.21.15.55:0/1334790988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd815a300 0x7fccd8156fd0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fccd000cbf0 tx=0x7fccd000a430 comp rx=0 tx=0).stop 2023-08-25T04:18:08.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.138+0000 7fccdd626640 1 -- 172.21.15.55:0/1334790988 shutdown_connections 2023-08-25T04:18:08.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.138+0000 7fccdd626640 1 --2- 172.21.15.55:0/1334790988 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fccc40657a0 0x7fccc4067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.138+0000 7fccdd626640 1 --2- 172.21.15.55:0/1334790988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd815a300 0x7fccd8156fd0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.138+0000 7fccdd626640 1 --2- 172.21.15.55:0/1334790988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fccd80b10d0 0x7fccd8156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.138+0000 7fccdd626640 1 --2- 172.21.15.55:0/1334790988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccd806fe20 0x7fccd8158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.138+0000 7fccdd626640 1 -- 172.21.15.55:0/1334790988 >> 172.21.15.55:0/1334790988 conn(0x7fccd8069f00 msgr2=0x7fccd80c9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:08.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.138+0000 7fccdd626640 1 -- 172.21.15.55:0/1334790988 shutdown_connections 2023-08-25T04:18:08.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.138+0000 7fccdd626640 1 -- 172.21.15.55:0/1334790988 wait complete. 2023-08-25T04:18:08.159 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:16:00.903688+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:16:02.143304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:18:08.162 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:18:08.272 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:08.274+0000 7fe5c8a19180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:18:08.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.310+0000 7fcd5ae88640 1 Processor -- start 2023-08-25T04:18:08.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.310+0000 7fcd5ae88640 1 -- start start 2023-08-25T04:18:08.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.314+0000 7fcd5ae88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd5415e3c0 0x7fcd5415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:08.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.314+0000 7fcd5ae88640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcd540d1290 0x7fcd5415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:08.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.314+0000 7fcd5ae88640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd540cd5a0 con 0x7fcd541601f0 2023-08-25T04:18:08.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.314+0000 7fcd5ae88640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd540cd880 con 0x7fcd540d1290 2023-08-25T04:18:08.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.314+0000 7fcd5ae88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd540cdb60 con 0x7fcd5415e3c0 2023-08-25T04:18:08.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.314+0000 7fcd59425640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcd540d1290 0x7fcd5415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:08.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.314+0000 7fcd53fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd5415e3c0 0x7fcd5415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:08.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.314+0000 7fcd59425640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcd540d1290 0x7fcd5415e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50888/0 (socket says 172.21.15.55:50888) 2023-08-25T04:18:08.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.314+0000 7fcd59425640 1 -- 172.21.15.55:0/3122026128 learned_addr learned my addr 172.21.15.55:0/3122026128 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:08.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.314+0000 7fcd59425640 1 -- 172.21.15.55:0/3122026128 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd5415e3c0 msgr2=0x7fcd5415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:08.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.314+0000 7fcd59425640 1 --2- 172.21.15.55:0/3122026128 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd5415e3c0 0x7fcd5415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.314+0000 7fcd59425640 1 -- 172.21.15.55:0/3122026128 >> v1:172.21.15.110:6789/0 conn(0x7fcd541601f0 legacy=0x7fcd540d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:08.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.314+0000 7fcd537fe640 1 -- 172.21.15.55:0/3122026128 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386827504 0 0) 0x7fcd540cd5a0 con 0x7fcd541601f0 2023-08-25T04:18:08.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.314+0000 7fcd59425640 1 -- 172.21.15.55:0/3122026128 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd540cde40 con 0x7fcd540d1290 2023-08-25T04:18:08.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.314+0000 7fcd53fff640 1 --2- 172.21.15.55:0/3122026128 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd5415e3c0 0x7fcd5415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:08.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.318+0000 7fcd59425640 1 --2- 172.21.15.55:0/3122026128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd540d1290 0x7fcd5415e8a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009e50 tx=0x7fcd4c01f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190e4db48fe62f07 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:08.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.318+0000 7fcd537fe640 1 -- 172.21.15.55:0/3122026128 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c0af400 con 0x7fcd540d1290 2023-08-25T04:18:08.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.318+0000 7fcd537fe640 1 -- 172.21.15.55:0/3122026128 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c0ab050 con 0x7fcd540d1290 2023-08-25T04:18:08.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.318+0000 7fcd537fe640 1 -- 172.21.15.55:0/3122026128 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c0af780 con 0x7fcd540d1290 2023-08-25T04:18:08.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.318+0000 7fcd5ae88640 1 -- 172.21.15.55:0/3122026128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd540d1290 msgr2=0x7fcd5415e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:08.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.318+0000 7fcd5ae88640 1 --2- 172.21.15.55:0/3122026128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd540d1290 0x7fcd5415e8a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009e50 tx=0x7fcd4c01f1f0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.318+0000 7fcd5ae88640 1 -- 172.21.15.55:0/3122026128 shutdown_connections 2023-08-25T04:18:08.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.318+0000 7fcd5ae88640 1 --2- 172.21.15.55:0/3122026128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd540d1290 0x7fcd5415e8a0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.318+0000 7fcd5ae88640 1 --2- 172.21.15.55:0/3122026128 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd5415e3c0 0x7fcd5415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.318+0000 7fcd5ae88640 1 -- 172.21.15.55:0/3122026128 >> 172.21.15.55:0/3122026128 conn(0x7fcd540d27d0 msgr2=0x7fcd540d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:08.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.318+0000 7fcd5ae88640 1 -- 172.21.15.55:0/3122026128 shutdown_connections 2023-08-25T04:18:08.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.318+0000 7fcd5ae88640 1 -- 172.21.15.55:0/3122026128 wait complete. 2023-08-25T04:18:08.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.318+0000 7fcd5ae88640 1 Processor -- start 2023-08-25T04:18:08.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.318+0000 7fcd5ae88640 1 -- start start 2023-08-25T04:18:08.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd5ae88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd540d1290 0x7fcd54157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:08.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd5ae88640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd5415e3c0 0x7fcd540c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:08.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd5ae88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd541601f0 0x7fcd540c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:08.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd5ae88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd540cb3a0 con 0x7fcd540d1290 2023-08-25T04:18:08.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd5ae88640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5415b8d0 con 0x7fcd5415e3c0 2023-08-25T04:18:08.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd5ae88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd540caa00 con 0x7fcd541601f0 2023-08-25T04:18:08.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd58c24640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd540d1290 0x7fcd54157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd59425640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd541601f0 0x7fcd540c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd58c24640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd540d1290 0x7fcd54157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50898/0 (socket says 172.21.15.55:50898) 2023-08-25T04:18:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd58c24640 1 -- 172.21.15.55:0/3946090116 learned_addr learned my addr 172.21.15.55:0/3946090116 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd53fff640 1 --2- 172.21.15.55:0/3946090116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd5415e3c0 0x7fcd540c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd58c24640 1 -- 172.21.15.55:0/3946090116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd541601f0 msgr2=0x7fcd540c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd58c24640 1 --2- 172.21.15.55:0/3946090116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd541601f0 0x7fcd540c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd58c24640 1 -- 172.21.15.55:0/3946090116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd5415e3c0 msgr2=0x7fcd540c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd58c24640 1 --2- 172.21.15.55:0/3946090116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd5415e3c0 0x7fcd540c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd58c24640 1 -- 172.21.15.55:0/3946090116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd40009420 con 0x7fcd540d1290 2023-08-25T04:18:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd58c24640 1 --2- 172.21.15.55:0/3946090116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd540d1290 0x7fcd54157c20 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800c440 tx=0x7fcd4800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd517fa640 1 -- 172.21.15.55:0/3946090116 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd480054e0 con 0x7fcd540d1290 2023-08-25T04:18:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd517fa640 1 -- 172.21.15.55:0/3946090116 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd48003650 con 0x7fcd540d1290 2023-08-25T04:18:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd517fa640 1 -- 172.21.15.55:0/3946090116 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48003a00 con 0x7fcd540d1290 2023-08-25T04:18:08.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd5ae88640 1 -- 172.21.15.55:0/3946090116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4c009b30 con 0x7fcd540d1290 2023-08-25T04:18:08.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd5ae88640 1 -- 172.21.15.55:0/3946090116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd540ce7c0 con 0x7fcd540d1290 2023-08-25T04:18:08.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.322+0000 7fcd5ae88640 1 -- 172.21.15.55:0/3946090116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd54073ec0 con 0x7fcd540d1290 2023-08-25T04:18:08.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.326+0000 7fcd517fa640 1 -- 172.21.15.55:0/3946090116 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 26) v1 ==== 85076+0+0 (secure 0 0 0) 0x7fcd48003b60 con 0x7fcd540d1290 2023-08-25T04:18:08.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.326+0000 7fcd517fa640 1 --2- 172.21.15.55:0/3946090116 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fcd380657a0 0x7fcd38067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.326+0000 7fcd517fa640 1 -- 172.21.15.55:0/3946090116 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fcd48082600 con 0x7fcd540d1290 2023-08-25T04:18:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.326+0000 7fcd53fff640 1 -- 172.21.15.55:0/3946090116 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fcd380657a0 msgr2=0x7fcd38067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3383442930 2023-08-25T04:18:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.326+0000 7fcd53fff640 1 --2- 172.21.15.55:0/3946090116 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fcd380657a0 0x7fcd38067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.330+0000 7fcd517fa640 1 -- 172.21.15.55:0/3946090116 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fcd4804ff60 con 0x7fcd540d1290 2023-08-25T04:18:08.364 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:08.366+0000 7fe5c8a19180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:18:08.448 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:08.445+0000 7faaf57e8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:18:08.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.490+0000 7fcd5ae88640 1 -- 172.21.15.55:0/3946090116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd540d0040 con 0x7fcd540d1290 2023-08-25T04:18:08.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.490+0000 7fcd517fa640 1 -- 172.21.15.55:0/3946090116 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd48053580 con 0x7fcd540d1290 2023-08-25T04:18:08.490 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:18:08.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.490+0000 7fcd5ae88640 1 -- 172.21.15.55:0/3946090116 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fcd380657a0 msgr2=0x7fcd38067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:08.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.490+0000 7fcd5ae88640 1 --2- 172.21.15.55:0/3946090116 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fcd380657a0 0x7fcd38067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.490+0000 7fcd5ae88640 1 -- 172.21.15.55:0/3946090116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd540d1290 msgr2=0x7fcd54157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:08.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.490+0000 7fcd5ae88640 1 --2- 172.21.15.55:0/3946090116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd540d1290 0x7fcd54157c20 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800c440 tx=0x7fcd4800c900 comp rx=0 tx=0).stop 2023-08-25T04:18:08.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.494+0000 7fcd5ae88640 1 -- 172.21.15.55:0/3946090116 shutdown_connections 2023-08-25T04:18:08.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.494+0000 7fcd5ae88640 1 --2- 172.21.15.55:0/3946090116 >> [v2:172.21.15.110:6832/3383442930,v1:172.21.15.110:6833/3383442930] conn(0x7fcd380657a0 0x7fcd38067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.494+0000 7fcd5ae88640 1 --2- 172.21.15.55:0/3946090116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd541601f0 0x7fcd540c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.494+0000 7fcd5ae88640 1 --2- 172.21.15.55:0/3946090116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd5415e3c0 0x7fcd540c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.494+0000 7fcd5ae88640 1 --2- 172.21.15.55:0/3946090116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd540d1290 0x7fcd54157c20 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.494+0000 7fcd5ae88640 1 -- 172.21.15.55:0/3946090116 >> 172.21.15.55:0/3946090116 conn(0x7fcd540d27d0 msgr2=0x7fcd540cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:08.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.494+0000 7fcd5ae88640 1 -- 172.21.15.55:0/3946090116 shutdown_connections 2023-08-25T04:18:08.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.494+0000 7fcd5ae88640 1 -- 172.21.15.55:0/3946090116 wait complete. 2023-08-25T04:18:08.508 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:08.505+0000 7faaf57e8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:18:08.511 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:18:08.592 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:08.589+0000 7faa7ef1a640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:08.593 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:08.589+0000 7faa7ef1a640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:08.593 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:08.589+0000 7faa7ef1a640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:08.594 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:08.589+0000 7faa7ef1a640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:08.594 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:08.589+0000 7faa7ef1a640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:08.595 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:08.589+0000 7faa81f20640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:08.595 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:08.589+0000 7faa81f20640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:08.596 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:08.589+0000 7faa81f20640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:08.596 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:08.589+0000 7faa81f20640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:08.596 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:08.589+0000 7faa81f20640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:08.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.678+0000 7fcb55c6d640 1 Processor -- start 2023-08-25T04:18:08.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.678+0000 7fcb55c6d640 1 -- start start 2023-08-25T04:18:08.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.678+0000 7fcb55c6d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5015e3c0 0x7fcb5015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:08.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.678+0000 7fcb55c6d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb500cd5a0 con 0x7fcb501601f0 2023-08-25T04:18:08.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.678+0000 7fcb55c6d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb500cd880 con 0x7fcb500d1290 2023-08-25T04:18:08.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.678+0000 7fcb55c6d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb500cdb60 con 0x7fcb5015e3c0 2023-08-25T04:18:08.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.678+0000 7fcb4f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcb501601f0 0x7fcb500d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32866/0 (socket says 172.21.15.55:32866) 2023-08-25T04:18:08.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.678+0000 7fcb4f7fe640 1 -- 172.21.15.55:0/526039851 learned_addr learned my addr 172.21.15.55:0/526039851 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:08.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.678+0000 7fcb47fff640 1 --2- 172.21.15.55:0/526039851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5015e3c0 0x7fcb5015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:08.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.678+0000 7fcb4effd640 1 -- 172.21.15.55:0/526039851 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088721875 0 0) 0x7fcb500cd5a0 con 0x7fcb501601f0 2023-08-25T04:18:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.678+0000 7fcb4effd640 1 -- 172.21.15.55:0/526039851 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb3c003530 con 0x7fcb501601f0 2023-08-25T04:18:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.678+0000 7fcb4effd640 1 -- 172.21.15.55:0/526039851 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228466492 0 0) 0x7fcb500cd880 con 0x7fcb500d1290 2023-08-25T04:18:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.678+0000 7fcb4effd640 1 -- 172.21.15.55:0/526039851 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb500cd5a0 con 0x7fcb500d1290 2023-08-25T04:18:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.678+0000 7fcb47fff640 1 -- 172.21.15.55:0/526039851 >> v1:172.21.15.110:6789/0 conn(0x7fcb500d1290 legacy=0x7fcb5015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:08.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.678+0000 7fcb47fff640 1 -- 172.21.15.55:0/526039851 >> v1:172.21.15.55:6789/0 conn(0x7fcb501601f0 legacy=0x7fcb500d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:08.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.678+0000 7fcb47fff640 1 -- 172.21.15.55:0/526039851 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb500cde40 con 0x7fcb5015e3c0 2023-08-25T04:18:08.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.682+0000 7fcb47fff640 1 --2- 172.21.15.55:0/526039851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5015e3c0 0x7fcb5015d430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcb380097f0 tx=0x7fcb3801ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e56e7cfbdc0e016 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:08.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.682+0000 7fcb4effd640 1 -- 172.21.15.55:0/526039851 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb380a89b0 con 0x7fcb5015e3c0 2023-08-25T04:18:08.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.682+0000 7fcb4effd640 1 -- 172.21.15.55:0/526039851 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb380a8b10 con 0x7fcb5015e3c0 2023-08-25T04:18:08.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.682+0000 7fcb4effd640 1 -- 172.21.15.55:0/526039851 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb380a8ea0 con 0x7fcb5015e3c0 2023-08-25T04:18:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.682+0000 7fcb55c6d640 1 -- 172.21.15.55:0/526039851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5015e3c0 msgr2=0x7fcb5015d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.682+0000 7fcb55c6d640 1 --2- 172.21.15.55:0/526039851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5015e3c0 0x7fcb5015d430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcb380097f0 tx=0x7fcb3801ecb0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.682+0000 7fcb55c6d640 1 -- 172.21.15.55:0/526039851 shutdown_connections 2023-08-25T04:18:08.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.682+0000 7fcb55c6d640 1 --2- 172.21.15.55:0/526039851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5015e3c0 0x7fcb5015d430 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.682+0000 7fcb55c6d640 1 -- 172.21.15.55:0/526039851 >> 172.21.15.55:0/526039851 conn(0x7fcb500d27d0 msgr2=0x7fcb500d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.682+0000 7fcb55c6d640 1 -- 172.21.15.55:0/526039851 shutdown_connections 2023-08-25T04:18:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.682+0000 7fcb55c6d640 1 -- 172.21.15.55:0/526039851 wait complete. 2023-08-25T04:18:08.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb55c6d640 1 Processor -- start 2023-08-25T04:18:08.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb55c6d640 1 -- start start 2023-08-25T04:18:08.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb55c6d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb500d1290 0x7fcb5014c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:08.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb55c6d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb5015e3c0 0x7fcb5014cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:08.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb55c6d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb501601f0 0x7fcb5009c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb55c6d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5009e5f0 con 0x7fcb500d1290 2023-08-25T04:18:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb55c6d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5014c860 con 0x7fcb5015e3c0 2023-08-25T04:18:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb55c6d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5009e820 con 0x7fcb501601f0 2023-08-25T04:18:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb4f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb500d1290 0x7fcb5014c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb4f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb500d1290 0x7fcb5014c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50902/0 (socket says 172.21.15.55:50902) 2023-08-25T04:18:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb4f7fe640 1 -- 172.21.15.55:0/1124868611 learned_addr learned my addr 172.21.15.55:0/1124868611 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb47fff640 1 --2- 172.21.15.55:0/1124868611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb5015e3c0 0x7fcb5014cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb4ffff640 1 --2- 172.21.15.55:0/1124868611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb501601f0 0x7fcb5009c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb4f7fe640 1 -- 172.21.15.55:0/1124868611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb501601f0 msgr2=0x7fcb5009c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb4f7fe640 1 --2- 172.21.15.55:0/1124868611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb501601f0 0x7fcb5009c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb4f7fe640 1 -- 172.21.15.55:0/1124868611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb5015e3c0 msgr2=0x7fcb5014cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb4f7fe640 1 --2- 172.21.15.55:0/1124868611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb5015e3c0 0x7fcb5014cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb4f7fe640 1 -- 172.21.15.55:0/1124868611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb38009420 con 0x7fcb500d1290 2023-08-25T04:18:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb47fff640 1 --2- 172.21.15.55:0/1124868611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb5015e3c0 0x7fcb5014cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb4f7fe640 1 --2- 172.21.15.55:0/1124868611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb500d1290 0x7fcb5014c320 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000c4d0 tx=0x7fcb4000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb4cff9640 1 -- 172.21.15.55:0/1124868611 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40007480 con 0x7fcb500d1290 2023-08-25T04:18:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb4cff9640 1 -- 172.21.15.55:0/1124868611 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb400075e0 con 0x7fcb500d1290 2023-08-25T04:18:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb55c6d640 1 -- 172.21.15.55:0/1124868611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb500ce7c0 con 0x7fcb500d1290 2023-08-25T04:18:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.686+0000 7fcb4cff9640 1 -- 172.21.15.55:0/1124868611 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb400059b0 con 0x7fcb500d1290 2023-08-25T04:18:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.690+0000 7fcb55c6d640 1 -- 172.21.15.55:0/1124868611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5009ede0 con 0x7fcb500d1290 2023-08-25T04:18:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.690+0000 7fcb55c6d640 1 -- 172.21.15.55:0/1124868611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb50073ec0 con 0x7fcb500d1290 2023-08-25T04:18:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.690+0000 7fcb4cff9640 1 -- 172.21.15.55:0/1124868611 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 27) v1 ==== 84673+0+0 (secure 0 0 0) 0x7fcb40005b10 con 0x7fcb500d1290 2023-08-25T04:18:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.690+0000 7fcb4cff9640 1 -- 172.21.15.55:0/1124868611 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6864+0+0 (secure 0 0 0) 0x7fcb40082050 con 0x7fcb500d1290 2023-08-25T04:18:08.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.694+0000 7fcb4cff9640 1 -- 172.21.15.55:0/1124868611 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fcb400b2d90 con 0x7fcb500d1290 2023-08-25T04:18:08.726 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:08.726+0000 7fe5c8a19180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:18:08.790 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:08.790+0000 7fe5c8a19180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:18:08.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.854+0000 7fcb55c6d640 1 -- 172.21.15.55:0/1124868611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcb50069970 con 0x7fcb500d1290 2023-08-25T04:18:08.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.854+0000 7fcb4cff9640 1 -- 172.21.15.55:0/1124868611 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v66) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcb40017020 con 0x7fcb500d1290 2023-08-25T04:18:08.855 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:18:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.858+0000 7fcb55c6d640 1 -- 172.21.15.55:0/1124868611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb500d1290 msgr2=0x7fcb5014c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:08.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.858+0000 7fcb55c6d640 1 --2- 172.21.15.55:0/1124868611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb500d1290 0x7fcb5014c320 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000c4d0 tx=0x7fcb4000c990 comp rx=0 tx=0).stop 2023-08-25T04:18:08.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.858+0000 7fcb55c6d640 1 -- 172.21.15.55:0/1124868611 shutdown_connections 2023-08-25T04:18:08.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.858+0000 7fcb55c6d640 1 --2- 172.21.15.55:0/1124868611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb501601f0 0x7fcb5009c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.858+0000 7fcb55c6d640 1 --2- 172.21.15.55:0/1124868611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb5015e3c0 0x7fcb5014cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.858+0000 7fcb55c6d640 1 --2- 172.21.15.55:0/1124868611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb500d1290 0x7fcb5014c320 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:08.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.858+0000 7fcb55c6d640 1 -- 172.21.15.55:0/1124868611 >> 172.21.15.55:0/1124868611 conn(0x7fcb500d27d0 msgr2=0x7fcb500b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:08.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.858+0000 7fcb55c6d640 1 -- 172.21.15.55:0/1124868611 shutdown_connections 2023-08-25T04:18:08.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:08.858+0000 7fcb55c6d640 1 -- 172.21.15.55:0/1124868611 wait complete. 2023-08-25T04:18:08.876 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:18:09.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.026+0000 7f739e100640 1 Processor -- start 2023-08-25T04:18:09.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.030+0000 7f739e100640 1 -- start start 2023-08-25T04:18:09.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.030+0000 7f739e100640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f739806a010 0x7f73980ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:09.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.030+0000 7f739e100640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f73980ced50 0x7f739815c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:09.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.030+0000 7f739e100640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739806d200 con 0x7f73980ae8e0 2023-08-25T04:18:09.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.030+0000 7f739e100640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739806c5f0 con 0x7f73980ced50 2023-08-25T04:18:09.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.030+0000 7f739e100640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739806c8d0 con 0x7f739806a010 2023-08-25T04:18:09.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.030+0000 7f73977fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f73980ae8e0 0x7f7398069900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32878/0 (socket says 172.21.15.55:32878) 2023-08-25T04:18:09.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.030+0000 7f73977fe640 1 -- 172.21.15.55:0/2779239264 learned_addr learned my addr 172.21.15.55:0/2779239264 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:09.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.030+0000 7f738ffff640 1 --2- 172.21.15.55:0/2779239264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f739806a010 0x7f73980ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:09.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.030+0000 7f7397fff640 1 --2- 172.21.15.55:0/2779239264 >> v2:172.21.15.110:3300/0 conn(0x7f73980ced50 0x7f739815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:09.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.030+0000 7f7396ffd640 1 -- 172.21.15.55:0/2779239264 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326053675 0 0) 0x7f739806d200 con 0x7f73980ae8e0 2023-08-25T04:18:09.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.030+0000 7f7396ffd640 1 -- 172.21.15.55:0/2779239264 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7384003530 con 0x7f73980ae8e0 2023-08-25T04:18:09.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.030+0000 7f738ffff640 1 -- 172.21.15.55:0/2779239264 >> v2:172.21.15.110:3300/0 conn(0x7f73980ced50 msgr2=0x7f739815c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:09.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.030+0000 7f738ffff640 1 --2- 172.21.15.55:0/2779239264 >> v2:172.21.15.110:3300/0 conn(0x7f73980ced50 0x7f739815c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.030+0000 7f738ffff640 1 -- 172.21.15.55:0/2779239264 >> v1:172.21.15.55:6789/0 conn(0x7f73980ae8e0 legacy=0x7f7398069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:09.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.030+0000 7f738ffff640 1 -- 172.21.15.55:0/2779239264 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739806cbb0 con 0x7f739806a010 2023-08-25T04:18:09.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.030+0000 7f7397fff640 1 --2- 172.21.15.55:0/2779239264 >> v2:172.21.15.110:3300/0 conn(0x7f73980ced50 0x7f739815c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:09.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.034+0000 7f738ffff640 1 --2- 172.21.15.55:0/2779239264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f739806a010 0x7f73980ce810 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f73800097c0 tx=0x7f738001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=350f17be8f84124a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:09.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.034+0000 7f7396ffd640 1 -- 172.21.15.55:0/2779239264 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73800ab410 con 0x7f739806a010 2023-08-25T04:18:09.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.034+0000 7f7396ffd640 1 -- 172.21.15.55:0/2779239264 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73800ab570 con 0x7f739806a010 2023-08-25T04:18:09.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.034+0000 7f7396ffd640 1 -- 172.21.15.55:0/2779239264 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73800ab900 con 0x7f739806a010 2023-08-25T04:18:09.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.034+0000 7f739e100640 1 -- 172.21.15.55:0/2779239264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f739806a010 msgr2=0x7f73980ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:09.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.034+0000 7f739e100640 1 --2- 172.21.15.55:0/2779239264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f739806a010 0x7f73980ce810 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f73800097c0 tx=0x7f738001c450 comp rx=0 tx=0).stop 2023-08-25T04:18:09.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.034+0000 7f739e100640 1 -- 172.21.15.55:0/2779239264 shutdown_connections 2023-08-25T04:18:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.034+0000 7f739e100640 1 --2- 172.21.15.55:0/2779239264 >> v2:172.21.15.110:3300/0 conn(0x7f73980ced50 0x7f739815c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.034+0000 7f739e100640 1 --2- 172.21.15.55:0/2779239264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f739806a010 0x7f73980ce810 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.034+0000 7f739e100640 1 -- 172.21.15.55:0/2779239264 >> 172.21.15.55:0/2779239264 conn(0x7f73980cf4d0 msgr2=0x7f73980cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.034+0000 7f739e100640 1 -- 172.21.15.55:0/2779239264 shutdown_connections 2023-08-25T04:18:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.034+0000 7f739e100640 1 -- 172.21.15.55:0/2779239264 wait complete. 2023-08-25T04:18:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.034+0000 7f739e100640 1 Processor -- start 2023-08-25T04:18:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.034+0000 7f739e100640 1 -- start start 2023-08-25T04:18:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f739e100640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f739806a010 0x7f739815b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f739e100640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73980ae8e0 0x7f73981426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f739e100640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73980ced50 0x7f73980c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f739e100640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7398159b90 con 0x7f73980ced50 2023-08-25T04:18:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f739e100640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7398159e70 con 0x7f73980ae8e0 2023-08-25T04:18:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f739e100640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739815a150 con 0x7f739806a010 2023-08-25T04:18:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f7397fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73980ced50 0x7f73980c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f73977fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f739806a010 0x7f739815b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f7397fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73980ced50 0x7f73980c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50908/0 (socket says 172.21.15.55:50908) 2023-08-25T04:18:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f7397fff640 1 -- 172.21.15.55:0/2556383302 learned_addr learned my addr 172.21.15.55:0/2556383302 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f738ffff640 1 --2- 172.21.15.55:0/2556383302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73980ae8e0 0x7f73981426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f7397fff640 1 -- 172.21.15.55:0/2556383302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f739806a010 msgr2=0x7f739815b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f7397fff640 1 --2- 172.21.15.55:0/2556383302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f739806a010 0x7f739815b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f7397fff640 1 -- 172.21.15.55:0/2556383302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73980ae8e0 msgr2=0x7f73981426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f7397fff640 1 --2- 172.21.15.55:0/2556383302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73980ae8e0 0x7f73981426a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f7397fff640 1 -- 172.21.15.55:0/2556383302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7390009a70 con 0x7f73980ced50 2023-08-25T04:18:09.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f7397fff640 1 --2- 172.21.15.55:0/2556383302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73980ced50 0x7f73980c8230 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f739000efc0 tx=0x7f739000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:09.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f7394ff9640 1 -- 172.21.15.55:0/2556383302 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7390009cd0 con 0x7f73980ced50 2023-08-25T04:18:09.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f7394ff9640 1 -- 172.21.15.55:0/2556383302 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739000f040 con 0x7f73980ced50 2023-08-25T04:18:09.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f7394ff9640 1 -- 172.21.15.55:0/2556383302 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73900039a0 con 0x7f73980ced50 2023-08-25T04:18:09.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f739e100640 1 -- 172.21.15.55:0/2556383302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7380009420 con 0x7f73980ced50 2023-08-25T04:18:09.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f739e100640 1 -- 172.21.15.55:0/2556383302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739815a710 con 0x7f73980ced50 2023-08-25T04:18:09.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.038+0000 7f739e100640 1 -- 172.21.15.55:0/2556383302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f739815a900 con 0x7f73980ced50 2023-08-25T04:18:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.042+0000 7f7394ff9640 1 -- 172.21.15.55:0/2556383302 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 27) v1 ==== 84673+0+0 (secure 0 0 0) 0x7f7390014480 con 0x7f73980ced50 2023-08-25T04:18:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.042+0000 7f7394ff9640 1 -- 172.21.15.55:0/2556383302 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6864+0+0 (secure 0 0 0) 0x7f7390083710 con 0x7f73980ced50 2023-08-25T04:18:09.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.046+0000 7f7394ff9640 1 -- 172.21.15.55:0/2556383302 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7390051110 con 0x7f73980ced50 2023-08-25T04:18:09.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.202+0000 7f739e100640 1 -- 172.21.15.55:0/2556383302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7398073ec0 con 0x7f73980ced50 2023-08-25T04:18:09.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.202+0000 7f7394ff9640 1 -- 172.21.15.55:0/2556383302 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7390054900 con 0x7f73980ced50 2023-08-25T04:18:09.201 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:18:09.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.202+0000 7f739e100640 1 -- 172.21.15.55:0/2556383302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73980ced50 msgr2=0x7f73980c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:09.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.202+0000 7f739e100640 1 --2- 172.21.15.55:0/2556383302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73980ced50 0x7f73980c8230 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f739000efc0 tx=0x7f739000c490 comp rx=0 tx=0).stop 2023-08-25T04:18:09.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.202+0000 7f739e100640 1 -- 172.21.15.55:0/2556383302 shutdown_connections 2023-08-25T04:18:09.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.202+0000 7f739e100640 1 --2- 172.21.15.55:0/2556383302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73980ced50 0x7f73980c8230 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.202+0000 7f739e100640 1 --2- 172.21.15.55:0/2556383302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73980ae8e0 0x7f73981426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.202+0000 7f739e100640 1 --2- 172.21.15.55:0/2556383302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f739806a010 0x7f739815b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.202+0000 7f739e100640 1 -- 172.21.15.55:0/2556383302 >> 172.21.15.55:0/2556383302 conn(0x7f73980cf4d0 msgr2=0x7f73981576e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:09.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.202+0000 7f739e100640 1 -- 172.21.15.55:0/2556383302 shutdown_connections 2023-08-25T04:18:09.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.202+0000 7f739e100640 1 -- 172.21.15.55:0/2556383302 wait complete. 2023-08-25T04:18:09.221 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:18:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.370+0000 7fe356215640 1 Processor -- start 2023-08-25T04:18:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.370+0000 7fe356215640 1 -- start start 2023-08-25T04:18:09.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.370+0000 7fe356215640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3500ad6b0 0x7fe3500b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:09.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.370+0000 7fe356215640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe3500cb710 0x7fe35006c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:09.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.370+0000 7fe356215640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3500cdf20 con 0x7fe3500b1750 2023-08-25T04:18:09.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.370+0000 7fe356215640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe35009bc40 con 0x7fe3500cb710 2023-08-25T04:18:09.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.370+0000 7fe356215640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35009bf20 con 0x7fe3500ad6b0 2023-08-25T04:18:09.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.370+0000 7fe34ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe3500b1750 0x7fe3500c8a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32880/0 (socket says 172.21.15.55:32880) 2023-08-25T04:18:09.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.370+0000 7fe347fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe3500cb710 0x7fe35006c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:09.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.370+0000 7fe34ffff640 1 -- 172.21.15.55:0/3715948898 learned_addr learned my addr 172.21.15.55:0/3715948898 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:09.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.370+0000 7fe34f7fe640 1 --2- 172.21.15.55:0/3715948898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3500ad6b0 0x7fe3500b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:09.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.370+0000 7fe347fff640 1 -- 172.21.15.55:0/3715948898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3500ad6b0 msgr2=0x7fe3500b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:09.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.370+0000 7fe347fff640 1 --2- 172.21.15.55:0/3715948898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3500ad6b0 0x7fe3500b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.370+0000 7fe347fff640 1 -- 172.21.15.55:0/3715948898 >> v1:172.21.15.55:6789/0 conn(0x7fe3500b1750 legacy=0x7fe3500c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:09.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.370+0000 7fe347fff640 1 -- 172.21.15.55:0/3715948898 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35006c1c0 con 0x7fe3500cb710 2023-08-25T04:18:09.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.370+0000 7fe34effd640 1 -- 172.21.15.55:0/3715948898 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032771088 0 0) 0x7fe3500cdf20 con 0x7fe3500b1750 2023-08-25T04:18:09.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.374+0000 7fe347fff640 1 --2- 172.21.15.55:0/3715948898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3500cb710 0x7fe35006c9c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe3380097c0 tx=0x7fe33801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174f6aa8608967c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:09.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.374+0000 7fe34effd640 1 -- 172.21.15.55:0/3715948898 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3380ad640 con 0x7fe3500cb710 2023-08-25T04:18:09.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.374+0000 7fe34effd640 1 -- 172.21.15.55:0/3715948898 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3380ad7a0 con 0x7fe3500cb710 2023-08-25T04:18:09.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.374+0000 7fe34effd640 1 -- 172.21.15.55:0/3715948898 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3380adb30 con 0x7fe3500cb710 2023-08-25T04:18:09.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.374+0000 7fe356215640 1 -- 172.21.15.55:0/3715948898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3500cb710 msgr2=0x7fe35006c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:09.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.374+0000 7fe356215640 1 --2- 172.21.15.55:0/3715948898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3500cb710 0x7fe35006c9c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe3380097c0 tx=0x7fe33801c480 comp rx=0 tx=0).stop 2023-08-25T04:18:09.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.374+0000 7fe356215640 1 -- 172.21.15.55:0/3715948898 shutdown_connections 2023-08-25T04:18:09.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.374+0000 7fe356215640 1 --2- 172.21.15.55:0/3715948898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3500cb710 0x7fe35006c9c0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.374+0000 7fe356215640 1 --2- 172.21.15.55:0/3715948898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3500ad6b0 0x7fe3500b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.374+0000 7fe356215640 1 -- 172.21.15.55:0/3715948898 >> 172.21.15.55:0/3715948898 conn(0x7fe350069900 msgr2=0x7fe350069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:09.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.374+0000 7fe356215640 1 -- 172.21.15.55:0/3715948898 shutdown_connections 2023-08-25T04:18:09.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.374+0000 7fe356215640 1 -- 172.21.15.55:0/3715948898 wait complete. 2023-08-25T04:18:09.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe356215640 1 Processor -- start 2023-08-25T04:18:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe356215640 1 -- start start 2023-08-25T04:18:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe356215640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3500ad6b0 0x7fe35014e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe356215640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3500b1750 0x7fe350155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe356215640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3500cb710 0x7fe3501558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe356215640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35014ece0 con 0x7fe3500b1750 2023-08-25T04:18:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe356215640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500c5630 con 0x7fe3500cb710 2023-08-25T04:18:09.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe356215640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500c5910 con 0x7fe3500ad6b0 2023-08-25T04:18:09.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe347fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3500b1750 0x7fe350155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:09.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe347fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3500b1750 0x7fe350155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50936/0 (socket says 172.21.15.55:50936) 2023-08-25T04:18:09.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe347fff640 1 -- 172.21.15.55:0/620034557 learned_addr learned my addr 172.21.15.55:0/620034557 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:09.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe34f7fe640 1 --2- 172.21.15.55:0/620034557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3500ad6b0 0x7fe35014e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:09.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe34ffff640 1 --2- 172.21.15.55:0/620034557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3500cb710 0x7fe3501558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe347fff640 1 -- 172.21.15.55:0/620034557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3500ad6b0 msgr2=0x7fe35014e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe347fff640 1 --2- 172.21.15.55:0/620034557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3500ad6b0 0x7fe35014e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe347fff640 1 -- 172.21.15.55:0/620034557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3500cb710 msgr2=0x7fe3501558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe347fff640 1 --2- 172.21.15.55:0/620034557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3500cb710 0x7fe3501558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe347fff640 1 -- 172.21.15.55:0/620034557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe338009420 con 0x7fe3500b1750 2023-08-25T04:18:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe347fff640 1 --2- 172.21.15.55:0/620034557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3500b1750 0x7fe350155390 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe33801ab30 tx=0x7fe338019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:09.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe34cff9640 1 -- 172.21.15.55:0/620034557 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3380b8620 con 0x7fe3500b1750 2023-08-25T04:18:09.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe34cff9640 1 -- 172.21.15.55:0/620034557 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3380a6040 con 0x7fe3500b1750 2023-08-25T04:18:09.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe34cff9640 1 -- 172.21.15.55:0/620034557 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3380b89c0 con 0x7fe3500b1750 2023-08-25T04:18:09.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe356215640 1 -- 172.21.15.55:0/620034557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3500c5bf0 con 0x7fe3500b1750 2023-08-25T04:18:09.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.378+0000 7fe356215640 1 -- 172.21.15.55:0/620034557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3500c61b0 con 0x7fe3500b1750 2023-08-25T04:18:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.382+0000 7fe356215640 1 -- 172.21.15.55:0/620034557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3500c63a0 con 0x7fe3500b1750 2023-08-25T04:18:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.382+0000 7fe34cff9640 1 -- 172.21.15.55:0/620034557 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 27) v1 ==== 84673+0+0 (secure 0 0 0) 0x7fe3380b4040 con 0x7fe3500b1750 2023-08-25T04:18:09.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.382+0000 7fe34cff9640 1 -- 172.21.15.55:0/620034557 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6864+0+0 (secure 0 0 0) 0x7fe33811d0e0 con 0x7fe3500b1750 2023-08-25T04:18:09.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.386+0000 7fe34cff9640 1 -- 172.21.15.55:0/620034557 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe3380eacb0 con 0x7fe3500b1750 2023-08-25T04:18:09.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.526+0000 7fe34cff9640 1 -- 172.21.15.55:0/620034557 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 28) v1 ==== 84800+0+0 (secure 0 0 0) 0x7fe3380ea760 con 0x7fe3500b1750 2023-08-25T04:18:09.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.526+0000 7fe34cff9640 1 --2- 172.21.15.55:0/620034557 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe33006b600 0x7fe33006d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:09.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.526+0000 7fe34f7fe640 1 --2- 172.21.15.55:0/620034557 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe33006b600 0x7fe33006d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:09.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.530+0000 7fe34f7fe640 1 --2- 172.21.15.55:0/620034557 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe33006b600 0x7fe33006d9f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe3501583b0 tx=0x7fe340008040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:09.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.550+0000 7fe356215640 1 -- 172.21.15.55:0/620034557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe350073ec0 con 0x7fe3500b1750 2023-08-25T04:18:09.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.550+0000 7fe34cff9640 1 -- 172.21.15.55:0/620034557 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe3380f0850 con 0x7fe3500b1750 2023-08-25T04:18:09.549 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:18:09.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.550+0000 7fe356215640 1 -- 172.21.15.55:0/620034557 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe33006b600 msgr2=0x7fe33006d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.550+0000 7fe356215640 1 --2- 172.21.15.55:0/620034557 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe33006b600 0x7fe33006d9f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe3501583b0 tx=0x7fe340008040 comp rx=0 tx=0).stop 2023-08-25T04:18:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.550+0000 7fe356215640 1 -- 172.21.15.55:0/620034557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3500b1750 msgr2=0x7fe350155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.550+0000 7fe356215640 1 --2- 172.21.15.55:0/620034557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3500b1750 0x7fe350155390 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe33801ab30 tx=0x7fe338019220 comp rx=0 tx=0).stop 2023-08-25T04:18:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.550+0000 7fe356215640 1 -- 172.21.15.55:0/620034557 shutdown_connections 2023-08-25T04:18:09.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.550+0000 7fe356215640 1 --2- 172.21.15.55:0/620034557 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe33006b600 0x7fe33006d9f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.550+0000 7fe356215640 1 --2- 172.21.15.55:0/620034557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3500cb710 0x7fe3501558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.550+0000 7fe356215640 1 --2- 172.21.15.55:0/620034557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3500b1750 0x7fe350155390 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.550+0000 7fe356215640 1 --2- 172.21.15.55:0/620034557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3500ad6b0 0x7fe35014e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.550+0000 7fe356215640 1 -- 172.21.15.55:0/620034557 >> 172.21.15.55:0/620034557 conn(0x7fe350069900 msgr2=0x7fe35006c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:09.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.550+0000 7fe356215640 1 -- 172.21.15.55:0/620034557 shutdown_connections 2023-08-25T04:18:09.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.550+0000 7fe356215640 1 -- 172.21.15.55:0/620034557 wait complete. 2023-08-25T04:18:09.570 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:18:09.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.714+0000 7f8746a8a640 1 Processor -- start 2023-08-25T04:18:09.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.714+0000 7f8746a8a640 1 -- start start 2023-08-25T04:18:09.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.718+0000 7f8746a8a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f874015c9f0 0x7f87400b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:09.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.718+0000 7f8746a8a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87400cdd30 0x7f87400ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:09.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.718+0000 7f8746a8a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87400b4b20 con 0x7f87400d0340 2023-08-25T04:18:09.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.718+0000 7f8746a8a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87400b4e00 con 0x7f87400cdd30 2023-08-25T04:18:09.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.718+0000 7f8746a8a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87400cd530 con 0x7f874015c9f0 2023-08-25T04:18:09.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.718+0000 7f8745287640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f87400d0340 0x7f874006a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32890/0 (socket says 172.21.15.55:32890) 2023-08-25T04:18:09.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.718+0000 7f8745287640 1 -- 172.21.15.55:0/187871829 learned_addr learned my addr 172.21.15.55:0/187871829 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:09.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.718+0000 7f8746289640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87400cdd30 0x7f87400ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:09.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.718+0000 7f8745a88640 1 --2- 172.21.15.55:0/187871829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f874015c9f0 0x7f87400b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:09.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.718+0000 7f8746289640 1 -- 172.21.15.55:0/187871829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f874015c9f0 msgr2=0x7f87400b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:09.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.718+0000 7f8746289640 1 --2- 172.21.15.55:0/187871829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f874015c9f0 0x7f87400b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.718+0000 7f8746289640 1 -- 172.21.15.55:0/187871829 >> v1:172.21.15.55:6789/0 conn(0x7f87400d0340 legacy=0x7f874006a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:09.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.718+0000 7f8744a86640 1 -- 172.21.15.55:0/187871829 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447293289 0 0) 0x7f87400b4b20 con 0x7f87400d0340 2023-08-25T04:18:09.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.718+0000 7f8746289640 1 -- 172.21.15.55:0/187871829 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87400cd810 con 0x7f87400cdd30 2023-08-25T04:18:09.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.718+0000 7f8746289640 1 --2- 172.21.15.55:0/187871829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87400cdd30 0x7f87400ce1c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8738009d90 tx=0x7f873801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a22f27d704d65e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:09.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8744a86640 1 -- 172.21.15.55:0/187871829 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87380af600 con 0x7f87400cdd30 2023-08-25T04:18:09.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8744a86640 1 -- 172.21.15.55:0/187871829 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87380ab050 con 0x7f87400cdd30 2023-08-25T04:18:09.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8744a86640 1 -- 172.21.15.55:0/187871829 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87380af980 con 0x7f87400cdd30 2023-08-25T04:18:09.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8746a8a640 1 -- 172.21.15.55:0/187871829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87400cdd30 msgr2=0x7f87400ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:09.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8746a8a640 1 --2- 172.21.15.55:0/187871829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87400cdd30 0x7f87400ce1c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8738009d90 tx=0x7f873801f130 comp rx=0 tx=0).stop 2023-08-25T04:18:09.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8746a8a640 1 -- 172.21.15.55:0/187871829 shutdown_connections 2023-08-25T04:18:09.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8746a8a640 1 --2- 172.21.15.55:0/187871829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87400cdd30 0x7f87400ce1c0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8746a8a640 1 --2- 172.21.15.55:0/187871829 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f874015c9f0 0x7f87400b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8746a8a640 1 -- 172.21.15.55:0/187871829 >> 172.21.15.55:0/187871829 conn(0x7f87400d25f0 msgr2=0x7f87400d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:09.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8746a8a640 1 -- 172.21.15.55:0/187871829 shutdown_connections 2023-08-25T04:18:09.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8746a8a640 1 -- 172.21.15.55:0/187871829 wait complete. 2023-08-25T04:18:09.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8746a8a640 1 Processor -- start 2023-08-25T04:18:09.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8746a8a640 1 -- start start 2023-08-25T04:18:09.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8746a8a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87400cdd30 0x7f87400c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:09.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8746a8a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87400d0340 0x7f874014fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:09.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8746a8a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f874015c9f0 0x7f87400c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:09.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8746a8a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87400c8f00 con 0x7f87400cdd30 2023-08-25T04:18:09.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8746a8a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87400b5720 con 0x7f87400d0340 2023-08-25T04:18:09.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.722+0000 7f8746a8a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8740156070 con 0x7f874015c9f0 2023-08-25T04:18:09.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.726+0000 7f8745a88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87400cdd30 0x7f87400c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:09.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.726+0000 7f8745a88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87400cdd30 0x7f87400c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50950/0 (socket says 172.21.15.55:50950) 2023-08-25T04:18:09.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.726+0000 7f8745a88640 1 -- 172.21.15.55:0/4286869318 learned_addr learned my addr 172.21.15.55:0/4286869318 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:09.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.726+0000 7f8746289640 1 --2- 172.21.15.55:0/4286869318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f874015c9f0 0x7f87400c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:09.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.726+0000 7f8745287640 1 --2- 172.21.15.55:0/4286869318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87400d0340 0x7f874014fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:09.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.726+0000 7f8745a88640 1 -- 172.21.15.55:0/4286869318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f874015c9f0 msgr2=0x7f87400c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:09.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.726+0000 7f8745a88640 1 --2- 172.21.15.55:0/4286869318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f874015c9f0 0x7f87400c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.726+0000 7f8745a88640 1 -- 172.21.15.55:0/4286869318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87400d0340 msgr2=0x7f874014fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:09.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.726+0000 7f8745a88640 1 --2- 172.21.15.55:0/4286869318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87400d0340 0x7f874014fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.726+0000 7f8745a88640 1 -- 172.21.15.55:0/4286869318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8738009a70 con 0x7f87400cdd30 2023-08-25T04:18:09.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.726+0000 7f8745a88640 1 --2- 172.21.15.55:0/4286869318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87400cdd30 0x7f87400c8240 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f873c00d7d0 tx=0x7f873c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:09.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.726+0000 7f87367fc640 1 -- 172.21.15.55:0/4286869318 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c00b6c0 con 0x7f87400cdd30 2023-08-25T04:18:09.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.726+0000 7f87367fc640 1 -- 172.21.15.55:0/4286869318 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c00b820 con 0x7f87400cdd30 2023-08-25T04:18:09.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.726+0000 7f87367fc640 1 -- 172.21.15.55:0/4286869318 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c00bbd0 con 0x7f87400cdd30 2023-08-25T04:18:09.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.726+0000 7f8746a8a640 1 -- 172.21.15.55:0/4286869318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87400c8940 con 0x7f87400cdd30 2023-08-25T04:18:09.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.726+0000 7f8746a8a640 1 -- 172.21.15.55:0/4286869318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87400b53b0 con 0x7f87400cdd30 2023-08-25T04:18:09.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.726+0000 7f8746a8a640 1 -- 172.21.15.55:0/4286869318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8740066d20 con 0x7f87400cdd30 2023-08-25T04:18:09.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.726+0000 7f87367fc640 1 -- 172.21.15.55:0/4286869318 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 28) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f873c00bd30 con 0x7f87400cdd30 2023-08-25T04:18:09.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.730+0000 7f87367fc640 1 --2- 172.21.15.55:0/4286869318 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f87240654d0 0x7f8724067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:09.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.730+0000 7f87367fc640 1 -- 172.21.15.55:0/4286869318 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6864+0+0 (secure 0 0 0) 0x7f873c083180 con 0x7f87400cdd30 2023-08-25T04:18:09.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.730+0000 7f8745287640 1 --2- 172.21.15.55:0/4286869318 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f87240654d0 0x7f8724067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:09.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.730+0000 7f8745287640 1 --2- 172.21.15.55:0/4286869318 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f87240654d0 0x7f8724067990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f87401f5390 tx=0x7f8730007d60 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:09.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.734+0000 7f87367fc640 1 -- 172.21.15.55:0/4286869318 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f873c0546f0 con 0x7f87400cdd30 2023-08-25T04:18:09.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.922+0000 7f8746a8a640 1 -- 172.21.15.55:0/4286869318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87400b8570 con 0x7f87400cdd30 2023-08-25T04:18:09.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.922+0000 7f87367fc640 1 -- 172.21.15.55:0/4286869318 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4875 (secure 0 0 0) 0x7f873c054280 con 0x7f87400cdd30 2023-08-25T04:18:09.922 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:09.923 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3163426480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3163426480},{"type":"v1","addr":"172.21.15.55:6835","nonce":3163426480}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/397210265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":397210265},{"type":"v1","addr":"172.21.15.110:6836","nonce":397210265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6198,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/894580528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":894580528},{"type":"v1","addr":"172.21.15.55:6834","nonce":894580528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:16:03.155108+0000","modified":"2023-08-25T04:16:06.786907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6837/1578265172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1578265172},{"type":"v1","addr":"172.21.15.110:6837","nonce":1578265172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-25T04:18:09.923 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 24 2023-08-25T04:18:09.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.926+0000 7f8746a8a640 1 -- 172.21.15.55:0/4286869318 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f87240654d0 msgr2=0x7f8724067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:09.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.926+0000 7f8746a8a640 1 --2- 172.21.15.55:0/4286869318 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f87240654d0 0x7f8724067990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f87401f5390 tx=0x7f8730007d60 comp rx=0 tx=0).stop 2023-08-25T04:18:09.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.926+0000 7f8746a8a640 1 -- 172.21.15.55:0/4286869318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87400cdd30 msgr2=0x7f87400c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:09.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.926+0000 7f8746a8a640 1 --2- 172.21.15.55:0/4286869318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87400cdd30 0x7f87400c8240 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f873c00d7d0 tx=0x7f873c00dc90 comp rx=0 tx=0).stop 2023-08-25T04:18:09.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.926+0000 7f8746a8a640 1 -- 172.21.15.55:0/4286869318 shutdown_connections 2023-08-25T04:18:09.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.926+0000 7f8746a8a640 1 --2- 172.21.15.55:0/4286869318 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f87240654d0 0x7f8724067990 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.926+0000 7f8746a8a640 1 --2- 172.21.15.55:0/4286869318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f874015c9f0 0x7f87400c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.926+0000 7f8746a8a640 1 --2- 172.21.15.55:0/4286869318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87400d0340 0x7f874014fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.926+0000 7f8746a8a640 1 --2- 172.21.15.55:0/4286869318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87400cdd30 0x7f87400c8240 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:09.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.926+0000 7f8746a8a640 1 -- 172.21.15.55:0/4286869318 >> 172.21.15.55:0/4286869318 conn(0x7f87400d25f0 msgr2=0x7f874015bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:09.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.926+0000 7f8746a8a640 1 -- 172.21.15.55:0/4286869318 shutdown_connections 2023-08-25T04:18:09.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:09.926+0000 7f8746a8a640 1 -- 172.21.15.55:0/4286869318 wait complete. 2023-08-25T04:18:09.943 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:18:10.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.086+0000 7f5ffa337640 1 Processor -- start 2023-08-25T04:18:10.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.086+0000 7f5ffa337640 1 -- start start 2023-08-25T04:18:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ffa337640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff40c89f0 0x7f5ff40cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ffa337640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff40cc880 con 0x7f5ff40ad950 2023-08-25T04:18:10.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ffa337640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff40ccb60 con 0x7f5ff40ceeb0 2023-08-25T04:18:10.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ffa337640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff40b11f0 con 0x7f5ff40c89f0 2023-08-25T04:18:10.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5ff40ad950 0x7f5ff40ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32900/0 (socket says 172.21.15.55:32900) 2023-08-25T04:18:10.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff3fff640 1 -- 172.21.15.55:0/66490210 learned_addr learned my addr 172.21.15.55:0/66490210 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:10.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff88d4640 1 --2- 172.21.15.55:0/66490210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff40c89f0 0x7f5ff40cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff2ffd640 1 -- 172.21.15.55:0/66490210 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086162153 0 0) 0x7f5ff40cc880 con 0x7f5ff40ad950 2023-08-25T04:18:10.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff2ffd640 1 -- 172.21.15.55:0/66490210 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fdc003530 con 0x7f5ff40ad950 2023-08-25T04:18:10.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff2ffd640 1 -- 172.21.15.55:0/66490210 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2914998433 0 0) 0x7f5fdc003530 con 0x7f5ff40ad950 2023-08-25T04:18:10.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff2ffd640 1 -- 172.21.15.55:0/66490210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff40c89f0 msgr2=0x7f5ff40cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:10.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff2ffd640 1 --2- 172.21.15.55:0/66490210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff40c89f0 0x7f5ff40cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff2ffd640 1 -- 172.21.15.55:0/66490210 >> v1:172.21.15.110:6789/0 conn(0x7f5ff40ceeb0 legacy=0x7f5ff40b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:10.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff2ffd640 1 -- 172.21.15.55:0/66490210 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff40cce40 con 0x7f5ff40ad950 2023-08-25T04:18:10.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff2ffd640 1 -- 172.21.15.55:0/66490210 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f5fe4001680 con 0x7f5ff40ad950 2023-08-25T04:18:10.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff2ffd640 1 -- 172.21.15.55:0/66490210 >> v1:172.21.15.55:6789/0 conn(0x7f5ff40ad950 legacy=0x7f5ff40ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:10.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff2ffd640 1 --2- 172.21.15.55:0/66490210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fdc0039b0 0x7f5fdc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff2ffd640 1 --2- 172.21.15.55:0/66490210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff40c89f0 0x7f5fdc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff2ffd640 1 --2- 172.21.15.55:0/66490210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fdc004d10 0x7f5fdc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff2ffd640 1 -- 172.21.15.55:0/66490210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff40b11f0 con 0x7f5fdc004d10 2023-08-25T04:18:10.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff2ffd640 1 -- 172.21.15.55:0/66490210 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc00ba40 con 0x7f5fdc0039b0 2023-08-25T04:18:10.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff2ffd640 1 -- 172.21.15.55:0/66490210 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc00de10 con 0x7f5ff40c89f0 2023-08-25T04:18:10.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff88d4640 1 --2- 172.21.15.55:0/66490210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fdc004d10 0x7f5fdc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff37fe640 1 --2- 172.21.15.55:0/66490210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff40c89f0 0x7f5fdc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff3fff640 1 --2- 172.21.15.55:0/66490210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fdc0039b0 0x7f5fdc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff88d4640 1 -- 172.21.15.55:0/66490210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff40c89f0 msgr2=0x7f5fdc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:10.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff88d4640 1 --2- 172.21.15.55:0/66490210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff40c89f0 0x7f5fdc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff88d4640 1 -- 172.21.15.55:0/66490210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fdc0039b0 msgr2=0x7f5fdc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:10.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff88d4640 1 --2- 172.21.15.55:0/66490210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fdc0039b0 0x7f5fdc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff88d4640 1 -- 172.21.15.55:0/66490210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc003530 con 0x7f5fdc004d10 2023-08-25T04:18:10.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.090+0000 7f5ff3fff640 1 --2- 172.21.15.55:0/66490210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fdc0039b0 0x7f5fdc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:10.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.094+0000 7f5ff88d4640 1 --2- 172.21.15.55:0/66490210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fdc004d10 0x7f5fdc005190 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009fc0 tx=0x7f5fec01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5345830aa4723d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:10.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.094+0000 7f5ff2ffd640 1 -- 172.21.15.55:0/66490210 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0a5c70 con 0x7f5fdc004d10 2023-08-25T04:18:10.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.094+0000 7f5ff2ffd640 1 -- 172.21.15.55:0/66490210 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec00f040 con 0x7f5fdc004d10 2023-08-25T04:18:10.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.094+0000 7f5ff2ffd640 1 -- 172.21.15.55:0/66490210 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0ad440 con 0x7f5fdc004d10 2023-08-25T04:18:10.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.094+0000 7f5ffa337640 1 -- 172.21.15.55:0/66490210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fdc004d10 msgr2=0x7f5fdc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:10.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.094+0000 7f5ffa337640 1 --2- 172.21.15.55:0/66490210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fdc004d10 0x7f5fdc005190 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009fc0 tx=0x7f5fec01cc60 comp rx=0 tx=0).stop 2023-08-25T04:18:10.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.094+0000 7f5ff88d4640 1 -- 172.21.15.55:0/66490210 reap_dead start 2023-08-25T04:18:10.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.094+0000 7f5ffa337640 1 -- 172.21.15.55:0/66490210 shutdown_connections 2023-08-25T04:18:10.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.094+0000 7f5ffa337640 1 -- 172.21.15.55:0/66490210 >> 172.21.15.55:0/66490210 conn(0x7f5ff4069d00 msgr2=0x7f5ff406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:10.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.094+0000 7f5ffa337640 1 -- 172.21.15.55:0/66490210 shutdown_connections 2023-08-25T04:18:10.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.094+0000 7f5ffa337640 1 -- 172.21.15.55:0/66490210 wait complete. 2023-08-25T04:18:10.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.094+0000 7f5ffa337640 1 Processor -- start 2023-08-25T04:18:10.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.094+0000 7f5ffa337640 1 -- start start 2023-08-25T04:18:10.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ffa337640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5fdc004d10 0x7f5ff40c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ffa337640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ff40c5470 0x7f5ff40c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ffa337640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ff40b2470 0x7f5ff40b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ffa337640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff40b2e30 con 0x7f5ff40c5470 2023-08-25T04:18:10.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ffa337640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff40c2e00 con 0x7f5ff40b2470 2023-08-25T04:18:10.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ffa337640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff40c8450 con 0x7f5fdc004d10 2023-08-25T04:18:10.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ff37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ff40c5470 0x7f5ff40c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ff37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ff40c5470 0x7f5ff40c28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50972/0 (socket says 172.21.15.55:50972) 2023-08-25T04:18:10.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ff37fe640 1 -- 172.21.15.55:0/83010504 learned_addr learned my addr 172.21.15.55:0/83010504 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:10.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ff3fff640 1 --2- 172.21.15.55:0/83010504 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5fdc004d10 0x7f5ff40c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ff88d4640 1 --2- 172.21.15.55:0/83010504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ff40b2470 0x7f5ff40b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ff37fe640 1 -- 172.21.15.55:0/83010504 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5fdc004d10 msgr2=0x7f5ff40c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:10.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ff37fe640 1 --2- 172.21.15.55:0/83010504 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5fdc004d10 0x7f5ff40c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ff37fe640 1 -- 172.21.15.55:0/83010504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ff40b2470 msgr2=0x7f5ff40b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:10.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ff37fe640 1 --2- 172.21.15.55:0/83010504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ff40b2470 0x7f5ff40b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ff37fe640 1 -- 172.21.15.55:0/83010504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff40c3610 con 0x7f5ff40c5470 2023-08-25T04:18:10.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ff3fff640 1 --2- 172.21.15.55:0/83010504 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5fdc004d10 0x7f5ff40c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:10.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ff88d4640 1 --2- 172.21.15.55:0/83010504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ff40b2470 0x7f5ff40b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:10.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ff37fe640 1 --2- 172.21.15.55:0/83010504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ff40c5470 0x7f5ff40c28c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80079b0 tx=0x7f5fe800f170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:10.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ff0ff9640 1 -- 172.21.15.55:0/83010504 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800fd50 con 0x7f5ff40c5470 2023-08-25T04:18:10.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ff0ff9640 1 -- 172.21.15.55:0/83010504 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe800feb0 con 0x7f5ff40c5470 2023-08-25T04:18:10.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ff0ff9640 1 -- 172.21.15.55:0/83010504 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe801d620 con 0x7f5ff40c5470 2023-08-25T04:18:10.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ffa337640 1 -- 172.21.15.55:0/83010504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff40c38f0 con 0x7f5ff40c5470 2023-08-25T04:18:10.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ffa337640 1 -- 172.21.15.55:0/83010504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff40ae6c0 con 0x7f5ff40c5470 2023-08-25T04:18:10.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.098+0000 7f5ffa337640 1 -- 172.21.15.55:0/83010504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff40b30f0 con 0x7f5ff40c5470 2023-08-25T04:18:10.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.102+0000 7f5ff0ff9640 1 -- 172.21.15.55:0/83010504 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 28) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f5fe80153f0 con 0x7f5ff40c5470 2023-08-25T04:18:10.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.102+0000 7f5ff0ff9640 1 --2- 172.21.15.55:0/83010504 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f5fe00654d0 0x7f5fe0067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.102+0000 7f5ff0ff9640 1 -- 172.21.15.55:0/83010504 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6864+0+0 (secure 0 0 0) 0x7f5fe8086580 con 0x7f5ff40c5470 2023-08-25T04:18:10.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.102+0000 7f5ff3fff640 1 --2- 172.21.15.55:0/83010504 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f5fe00654d0 0x7f5fe0067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.102+0000 7f5ff3fff640 1 --2- 172.21.15.55:0/83010504 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f5fe00654d0 0x7f5fe0067990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5fe40010f0 tx=0x7f5fe4009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:10.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.106+0000 7f5ff0ff9640 1 -- 172.21.15.55:0/83010504 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5fe8053fb0 con 0x7f5ff40c5470 2023-08-25T04:18:10.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.262+0000 7f5ffa337640 1 -- 172.21.15.55:0/83010504 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ff404dbe0 con 0x7f5ff40c5470 2023-08-25T04:18:10.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.262+0000 7f5ff0ff9640 1 -- 172.21.15.55:0/83010504 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+19579 (secure 0 0 0) 0x7f5fe80575d0 con 0x7f5ff40c5470 2023-08-25T04:18:10.261 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:10.262 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":66,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:18:08.515677+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:16:00.903688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-25T04:16:02.143304+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1a","mappings":[{"from":0,"to":1}]},{"pgid":"8.2d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/4198165212":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/943102433":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/3556108705":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/501517667":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/2165360961":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/3235366703":"2023-08-26T04:18:08.515634+0000","172.21.15.110:6832/3383442930":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/746484664":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/894259341":"2023-08-26T04:16:20.415897+0000","172.21.15.110:6833/1373721950":"2023-08-26T04:16:20.415897+0000","172.21.15.110:6832/1373721950":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/1127649499":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/33998418":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/188879394":"2023-08-26T04:16:20.415897+0000","172.21.15.110:6833/3383442930":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/1737595424":"2023-08-26T04:16:20.415897+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:18:10.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.266+0000 7f5ffa337640 1 -- 172.21.15.55:0/83010504 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f5fe00654d0 msgr2=0x7f5fe0067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:10.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.266+0000 7f5ffa337640 1 --2- 172.21.15.55:0/83010504 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f5fe00654d0 0x7f5fe0067990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5fe40010f0 tx=0x7f5fe4009040 comp rx=0 tx=0).stop 2023-08-25T04:18:10.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.266+0000 7f5ffa337640 1 -- 172.21.15.55:0/83010504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ff40c5470 msgr2=0x7f5ff40c28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:10.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.266+0000 7f5ffa337640 1 --2- 172.21.15.55:0/83010504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ff40c5470 0x7f5ff40c28c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80079b0 tx=0x7f5fe800f170 comp rx=0 tx=0).stop 2023-08-25T04:18:10.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.266+0000 7f5ffa337640 1 -- 172.21.15.55:0/83010504 shutdown_connections 2023-08-25T04:18:10.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.266+0000 7f5ffa337640 1 --2- 172.21.15.55:0/83010504 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f5fe00654d0 0x7f5fe0067990 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.266+0000 7f5ffa337640 1 --2- 172.21.15.55:0/83010504 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ff40b2470 0x7f5ff40b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.266+0000 7f5ffa337640 1 --2- 172.21.15.55:0/83010504 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ff40c5470 0x7f5ff40c28c0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.266+0000 7f5ffa337640 1 --2- 172.21.15.55:0/83010504 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5fdc004d10 0x7f5ff40c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.266+0000 7f5ffa337640 1 -- 172.21.15.55:0/83010504 >> 172.21.15.55:0/83010504 conn(0x7f5ff4069d00 msgr2=0x7f5ff40701b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:10.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.266+0000 7f5ffa337640 1 -- 172.21.15.55:0/83010504 shutdown_connections 2023-08-25T04:18:10.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.266+0000 7f5ffa337640 1 -- 172.21.15.55:0/83010504 wait complete. 2023-08-25T04:18:10.284 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-25T04:18:10.284 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:18:10.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.430+0000 7fc123100640 1 Processor -- start 2023-08-25T04:18:10.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.430+0000 7fc123100640 1 -- start start 2023-08-25T04:18:10.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.430+0000 7fc123100640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc11c0ceeb0 0x7fc11c0cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.430+0000 7fc123100640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc11c0c89f0 0x7fc11c0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.430+0000 7fc123100640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11c0cc880 con 0x7fc11c0ad950 2023-08-25T04:18:10.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.430+0000 7fc123100640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc11c0b11f0 con 0x7fc11c0c89f0 2023-08-25T04:18:10.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.430+0000 7fc123100640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c159d50 con 0x7fc11c0ceeb0 2023-08-25T04:18:10.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.430+0000 7fc12169d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc11c0c89f0 0x7fc11c0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.430+0000 7fc120e9c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc11c0ad950 0x7fc11c0ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32916/0 (socket says 172.21.15.55:32916) 2023-08-25T04:18:10.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.430+0000 7fc120e9c640 1 -- 172.21.15.55:0/1681397940 learned_addr learned my addr 172.21.15.55:0/1681397940 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:10.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.430+0000 7fc12169d640 1 -- 172.21.15.55:0/1681397940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc11c0ceeb0 msgr2=0x7fc11c0cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:10.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.430+0000 7fc113fff640 1 --2- 172.21.15.55:0/1681397940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc11c0ceeb0 0x7fc11c0cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.430+0000 7fc12169d640 1 --2- 172.21.15.55:0/1681397940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc11c0ceeb0 0x7fc11c0cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.430+0000 7fc12169d640 1 -- 172.21.15.55:0/1681397940 >> v1:172.21.15.55:6789/0 conn(0x7fc11c0ad950 legacy=0x7fc11c0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:10.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.430+0000 7fc1137fe640 1 -- 172.21.15.55:0/1681397940 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2887370211 0 0) 0x7fc11c0cc880 con 0x7fc11c0ad950 2023-08-25T04:18:10.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.430+0000 7fc12169d640 1 -- 172.21.15.55:0/1681397940 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c0ccb60 con 0x7fc11c0c89f0 2023-08-25T04:18:10.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.430+0000 7fc113fff640 1 --2- 172.21.15.55:0/1681397940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc11c0ceeb0 0x7fc11c0cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:10.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.434+0000 7fc12169d640 1 --2- 172.21.15.55:0/1681397940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0c89f0 0x7fc11c0b1640 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc114009d90 tx=0x7fc11401eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7332482607760b64 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:10.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.434+0000 7fc1137fe640 1 -- 172.21.15.55:0/1681397940 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1140a7a80 con 0x7fc11c0c89f0 2023-08-25T04:18:10.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.434+0000 7fc1137fe640 1 -- 172.21.15.55:0/1681397940 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1140a7be0 con 0x7fc11c0c89f0 2023-08-25T04:18:10.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.434+0000 7fc1137fe640 1 -- 172.21.15.55:0/1681397940 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1140af440 con 0x7fc11c0c89f0 2023-08-25T04:18:10.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.434+0000 7fc123100640 1 -- 172.21.15.55:0/1681397940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0c89f0 msgr2=0x7fc11c0b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:10.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.434+0000 7fc123100640 1 --2- 172.21.15.55:0/1681397940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0c89f0 0x7fc11c0b1640 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc114009d90 tx=0x7fc11401eaa0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.434+0000 7fc123100640 1 -- 172.21.15.55:0/1681397940 shutdown_connections 2023-08-25T04:18:10.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.434+0000 7fc123100640 1 --2- 172.21.15.55:0/1681397940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc11c0ceeb0 0x7fc11c0cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.434+0000 7fc123100640 1 --2- 172.21.15.55:0/1681397940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0c89f0 0x7fc11c0b1640 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.434+0000 7fc123100640 1 -- 172.21.15.55:0/1681397940 >> 172.21.15.55:0/1681397940 conn(0x7fc11c069d00 msgr2=0x7fc11c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:10.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.434+0000 7fc123100640 1 -- 172.21.15.55:0/1681397940 shutdown_connections 2023-08-25T04:18:10.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.434+0000 7fc123100640 1 -- 172.21.15.55:0/1681397940 wait complete. 2023-08-25T04:18:10.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc123100640 1 Processor -- start 2023-08-25T04:18:10.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc123100640 1 -- start start 2023-08-25T04:18:10.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc123100640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc11c0ad950 0x7fc11c097280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc123100640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc11c0c89f0 0x7fc11c1534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc123100640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0ceeb0 0x7fc11c1492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc123100640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c1530a0 con 0x7fc11c0ceeb0 2023-08-25T04:18:10.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc123100640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c14c510 con 0x7fc11c0c89f0 2023-08-25T04:18:10.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc123100640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c14c7f0 con 0x7fc11c0ad950 2023-08-25T04:18:10.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc12169d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0ceeb0 0x7fc11c1492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc12169d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0ceeb0 0x7fc11c1492c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50990/0 (socket says 172.21.15.55:50990) 2023-08-25T04:18:10.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc12169d640 1 -- 172.21.15.55:0/1890014539 learned_addr learned my addr 172.21.15.55:0/1890014539 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:10.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc120e9c640 1 --2- 172.21.15.55:0/1890014539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc11c0ad950 0x7fc11c097280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc113fff640 1 --2- 172.21.15.55:0/1890014539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc11c0c89f0 0x7fc11c1534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc12169d640 1 -- 172.21.15.55:0/1890014539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc11c0ad950 msgr2=0x7fc11c097280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:10.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc12169d640 1 --2- 172.21.15.55:0/1890014539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc11c0ad950 0x7fc11c097280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc12169d640 1 -- 172.21.15.55:0/1890014539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc11c0c89f0 msgr2=0x7fc11c1534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:10.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc12169d640 1 --2- 172.21.15.55:0/1890014539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc11c0c89f0 0x7fc11c1534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc12169d640 1 -- 172.21.15.55:0/1890014539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc114009a70 con 0x7fc11c0ceeb0 2023-08-25T04:18:10.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc12169d640 1 --2- 172.21.15.55:0/1890014539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0ceeb0 0x7fc11c1492c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc11401d150 tx=0x7fc11401b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:10.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc1117fa640 1 -- 172.21.15.55:0/1890014539 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1140a7a80 con 0x7fc11c0ceeb0 2023-08-25T04:18:10.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc1117fa640 1 -- 172.21.15.55:0/1890014539 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1140afbc0 con 0x7fc11c0ceeb0 2023-08-25T04:18:10.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc123100640 1 -- 172.21.15.55:0/1890014539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11c14cad0 con 0x7fc11c0ceeb0 2023-08-25T04:18:10.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc1117fa640 1 -- 172.21.15.55:0/1890014539 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1140ba470 con 0x7fc11c0ceeb0 2023-08-25T04:18:10.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc123100640 1 -- 172.21.15.55:0/1890014539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11c153a20 con 0x7fc11c0ceeb0 2023-08-25T04:18:10.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.438+0000 7fc123100640 1 -- 172.21.15.55:0/1890014539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11c04dbe0 con 0x7fc11c0ceeb0 2023-08-25T04:18:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.442+0000 7fc1117fa640 1 -- 172.21.15.55:0/1890014539 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 28) v1 ==== 84800+0+0 (secure 0 0 0) 0x7fc1140b6070 con 0x7fc11c0ceeb0 2023-08-25T04:18:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.442+0000 7fc1117fa640 1 --2- 172.21.15.55:0/1890014539 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fc1080654d0 0x7fc108067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.442+0000 7fc1117fa640 1 -- 172.21.15.55:0/1890014539 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6864+0+0 (secure 0 0 0) 0x7fc11411e200 con 0x7fc11c0ceeb0 2023-08-25T04:18:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.442+0000 7fc120e9c640 1 --2- 172.21.15.55:0/1890014539 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fc1080654d0 0x7fc108067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.442+0000 7fc120e9c640 1 --2- 172.21.15.55:0/1890014539 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fc1080654d0 0x7fc108067990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc118000f70 tx=0x7fc118007df0 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:10.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.446+0000 7fc1117fa640 1 -- 172.21.15.55:0/1890014539 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc1140ebe00 con 0x7fc11c0ceeb0 2023-08-25T04:18:10.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.638+0000 7fc123100640 1 -- 172.21.15.55:0/1890014539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc11c14cf80 con 0x7fc11c0ceeb0 2023-08-25T04:18:10.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.638+0000 7fc1117fa640 1 -- 172.21.15.55:0/1890014539 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4875 (secure 0 0 0) 0x7fc1140ef420 con 0x7fc11c0ceeb0 2023-08-25T04:18:10.638 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:10.638 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3163426480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3163426480},{"type":"v1","addr":"172.21.15.55:6835","nonce":3163426480}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/397210265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":397210265},{"type":"v1","addr":"172.21.15.110:6836","nonce":397210265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6198,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/894580528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":894580528},{"type":"v1","addr":"172.21.15.55:6834","nonce":894580528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:16:03.155108+0000","modified":"2023-08-25T04:16:06.786907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6837/1578265172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1578265172},{"type":"v1","addr":"172.21.15.110:6837","nonce":1578265172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-25T04:18:10.641 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 24 2023-08-25T04:18:10.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.638+0000 7fc123100640 1 -- 172.21.15.55:0/1890014539 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fc1080654d0 msgr2=0x7fc108067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:10.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.638+0000 7fc123100640 1 --2- 172.21.15.55:0/1890014539 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fc1080654d0 0x7fc108067990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc118000f70 tx=0x7fc118007df0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.638+0000 7fc123100640 1 -- 172.21.15.55:0/1890014539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0ceeb0 msgr2=0x7fc11c1492c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:10.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.638+0000 7fc123100640 1 --2- 172.21.15.55:0/1890014539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0ceeb0 0x7fc11c1492c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc11401d150 tx=0x7fc11401b840 comp rx=0 tx=0).stop 2023-08-25T04:18:10.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.638+0000 7fc123100640 1 -- 172.21.15.55:0/1890014539 shutdown_connections 2023-08-25T04:18:10.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.638+0000 7fc123100640 1 --2- 172.21.15.55:0/1890014539 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fc1080654d0 0x7fc108067990 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.638+0000 7fc123100640 1 --2- 172.21.15.55:0/1890014539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0ceeb0 0x7fc11c1492c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.638+0000 7fc123100640 1 --2- 172.21.15.55:0/1890014539 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc11c0c89f0 0x7fc11c1534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.638+0000 7fc123100640 1 --2- 172.21.15.55:0/1890014539 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc11c0ad950 0x7fc11c097280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.638+0000 7fc123100640 1 -- 172.21.15.55:0/1890014539 >> 172.21.15.55:0/1890014539 conn(0x7fc11c069d00 msgr2=0x7fc11c06a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:10.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.642+0000 7fc123100640 1 -- 172.21.15.55:0/1890014539 shutdown_connections 2023-08-25T04:18:10.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.642+0000 7fc123100640 1 -- 172.21.15.55:0/1890014539 wait complete. 2023-08-25T04:18:10.660 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:18:10.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.810+0000 7f8182ee6640 1 Processor -- start 2023-08-25T04:18:10.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.810+0000 7f8182ee6640 1 -- start start 2023-08-25T04:18:10.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.814+0000 7f8182ee6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f817c0b3c60 0x7f817c0cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.814+0000 7f8182ee6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f817c0cf6f0 0x7f817c0cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.814+0000 7f817bfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f817c0cf6f0 0x7f817c0cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.814+0000 7f8182ee6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817c0cdfe0 con 0x7f817c0cd810 2023-08-25T04:18:10.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.814+0000 7f817bfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f817c0cf6f0 0x7f817c0cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:48840/0 (socket says 172.21.15.55:48840) 2023-08-25T04:18:10.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.814+0000 7f817bfff640 1 -- 172.21.15.55:0/38914669 learned_addr learned my addr 172.21.15.55:0/38914669 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:10.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.814+0000 7f8182ee6640 1 -- 172.21.15.55:0/38914669 --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f817c0c6010 con 0x7f817c0cf6f0 2023-08-25T04:18:10.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.814+0000 7f8182ee6640 1 -- 172.21.15.55:0/38914669 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817c0cfb70 con 0x7f817c0b3c60 2023-08-25T04:18:10.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.814+0000 7f817bfff640 1 -- 172.21.15.55:0/38914669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f817c0b3c60 msgr2=0x7f817c0cf1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-25T04:18:10.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.814+0000 7f817bfff640 1 --2- 172.21.15.55:0/38914669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f817c0b3c60 0x7f817c0cf1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.814+0000 7f817bfff640 1 -- 172.21.15.55:0/38914669 >> v1:172.21.15.55:6789/0 conn(0x7f817c0cd810 legacy=0x7f817c0d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:10.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.814+0000 7f817bfff640 1 -- 172.21.15.55:0/38914669 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817c0ce2c0 con 0x7f817c0cf6f0 2023-08-25T04:18:10.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.818+0000 7f817bfff640 1 --2- 172.21.15.55:0/38914669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f817c0cf6f0 0x7f817c0cd2d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8168009870 tx=0x7f816801c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8efa322adc00dfa2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:10.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.818+0000 7f817b7fe640 1 -- 172.21.15.55:0/38914669 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81680aa610 con 0x7f817c0cf6f0 2023-08-25T04:18:10.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.818+0000 7f817b7fe640 1 -- 172.21.15.55:0/38914669 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81680a6040 con 0x7f817c0cf6f0 2023-08-25T04:18:10.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.818+0000 7f817b7fe640 1 -- 172.21.15.55:0/38914669 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81680aa990 con 0x7f817c0cf6f0 2023-08-25T04:18:10.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.818+0000 7f8182ee6640 1 -- 172.21.15.55:0/38914669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f817c0cf6f0 msgr2=0x7f817c0cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:10.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.818+0000 7f8182ee6640 1 --2- 172.21.15.55:0/38914669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f817c0cf6f0 0x7f817c0cd2d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8168009870 tx=0x7f816801c4f0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.818+0000 7f8182ee6640 1 -- 172.21.15.55:0/38914669 shutdown_connections 2023-08-25T04:18:10.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.818+0000 7f8182ee6640 1 --2- 172.21.15.55:0/38914669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f817c0cf6f0 0x7f817c0cd2d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.818+0000 7f8182ee6640 1 --2- 172.21.15.55:0/38914669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f817c0b3c60 0x7f817c0cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.818+0000 7f8182ee6640 1 -- 172.21.15.55:0/38914669 >> 172.21.15.55:0/38914669 conn(0x7f817c09bae0 msgr2=0x7f817c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:10.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.818+0000 7f8182ee6640 1 -- 172.21.15.55:0/38914669 shutdown_connections 2023-08-25T04:18:10.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.818+0000 7f8182ee6640 1 -- 172.21.15.55:0/38914669 wait complete. 2023-08-25T04:18:10.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8182ee6640 1 Processor -- start 2023-08-25T04:18:10.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8182ee6640 1 -- start start 2023-08-25T04:18:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8182ee6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f817c0b3c60 0x7f817c0c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8182ee6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f817c0cd810 0x7f817c1629a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8182ee6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f817c0cf6f0 0x7f817c15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8182ee6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c163280 con 0x7f817c0b3c60 2023-08-25T04:18:10.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8182ee6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c163560 con 0x7f817c0cd810 2023-08-25T04:18:10.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8182ee6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817c163840 con 0x7f817c0cf6f0 2023-08-25T04:18:10.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8180c82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f817c0b3c60 0x7f817c0c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8180c82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f817c0b3c60 0x7f817c0c76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56554/0 (socket says 172.21.15.55:56554) 2023-08-25T04:18:10.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8180c82640 1 -- 172.21.15.55:0/3117727183 learned_addr learned my addr 172.21.15.55:0/3117727183 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:10.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f817bfff640 1 --2- 172.21.15.55:0/3117727183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f817c0cd810 0x7f817c1629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8181483640 1 --2- 172.21.15.55:0/3117727183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f817c0cf6f0 0x7f817c15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8180c82640 1 -- 172.21.15.55:0/3117727183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f817c0cf6f0 msgr2=0x7f817c15fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:10.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8180c82640 1 --2- 172.21.15.55:0/3117727183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f817c0cf6f0 0x7f817c15fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8180c82640 1 -- 172.21.15.55:0/3117727183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f817c0cd810 msgr2=0x7f817c1629a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:10.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8180c82640 1 --2- 172.21.15.55:0/3117727183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f817c0cd810 0x7f817c1629a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:10.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8180c82640 1 -- 172.21.15.55:0/3117727183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81680094d0 con 0x7f817c0b3c60 2023-08-25T04:18:10.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8180c82640 1 --2- 172.21.15.55:0/3117727183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f817c0b3c60 0x7f817c0c76a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f817000b3e0 tx=0x7f817000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:10.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f81797fa640 1 -- 172.21.15.55:0/3117727183 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8170005930 con 0x7f817c0b3c60 2023-08-25T04:18:10.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f81797fa640 1 -- 172.21.15.55:0/3117727183 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8170005ab0 con 0x7f817c0b3c60 2023-08-25T04:18:10.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f81797fa640 1 -- 172.21.15.55:0/3117727183 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8170005ea0 con 0x7f817c0b3c60 2023-08-25T04:18:10.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8182ee6640 1 -- 172.21.15.55:0/3117727183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817c163b20 con 0x7f817c0b3c60 2023-08-25T04:18:10.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.822+0000 7f8182ee6640 1 -- 172.21.15.55:0/3117727183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817c164320 con 0x7f817c0b3c60 2023-08-25T04:18:10.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.826+0000 7f8182ee6640 1 -- 172.21.15.55:0/3117727183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817c04dbe0 con 0x7f817c0b3c60 2023-08-25T04:18:10.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.826+0000 7f81797fa640 1 -- 172.21.15.55:0/3117727183 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f8170006000 con 0x7f817c0b3c60 2023-08-25T04:18:10.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.826+0000 7f81797fa640 1 --2- 172.21.15.55:0/3117727183 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f8160065710 0x7f8160067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:10.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.826+0000 7f81797fa640 1 -- 172.21.15.55:0/3117727183 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f8170082de0 con 0x7f817c0b3c60 2023-08-25T04:18:10.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.826+0000 7f817bfff640 1 --2- 172.21.15.55:0/3117727183 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f8160065710 0x7f8160067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:10.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.830+0000 7f817bfff640 1 --2- 172.21.15.55:0/3117727183 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f8160065710 0x7f8160067bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f81680ae000 tx=0x7f81680b5040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:10.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:10.830+0000 7f81797fa640 1 -- 172.21.15.55:0/3117727183 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8170050550 con 0x7f817c0b3c60 2023-08-25T04:18:11.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.018+0000 7f8182ee6640 1 -- 172.21.15.55:0/3117727183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f817c15a870 con 0x7f817c0b3c60 2023-08-25T04:18:11.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.018+0000 7f81797fa640 1 -- 172.21.15.55:0/3117727183 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4875 (secure 0 0 0) 0x7f8170015020 con 0x7f817c0b3c60 2023-08-25T04:18:11.019 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:11.019 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3163426480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3163426480},{"type":"v1","addr":"172.21.15.55:6835","nonce":3163426480}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/397210265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":397210265},{"type":"v1","addr":"172.21.15.110:6836","nonce":397210265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6198,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/894580528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":894580528},{"type":"v1","addr":"172.21.15.55:6834","nonce":894580528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:16:03.155108+0000","modified":"2023-08-25T04:16:06.786907+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6837/1578265172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1578265172},{"type":"v1","addr":"172.21.15.110:6837","nonce":1578265172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-08-25T04:18:11.019 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 24 2023-08-25T04:18:11.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.022+0000 7f8182ee6640 1 -- 172.21.15.55:0/3117727183 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f8160065710 msgr2=0x7f8160067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:11.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.022+0000 7f8182ee6640 1 --2- 172.21.15.55:0/3117727183 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f8160065710 0x7f8160067bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f81680ae000 tx=0x7f81680b5040 comp rx=0 tx=0).stop 2023-08-25T04:18:11.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.022+0000 7f8182ee6640 1 -- 172.21.15.55:0/3117727183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f817c0b3c60 msgr2=0x7f817c0c76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:11.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.022+0000 7f8182ee6640 1 --2- 172.21.15.55:0/3117727183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f817c0b3c60 0x7f817c0c76a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f817000b3e0 tx=0x7f817000b8a0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.022+0000 7f8182ee6640 1 -- 172.21.15.55:0/3117727183 shutdown_connections 2023-08-25T04:18:11.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.022+0000 7f8182ee6640 1 --2- 172.21.15.55:0/3117727183 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f8160065710 0x7f8160067bd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.022+0000 7f8182ee6640 1 --2- 172.21.15.55:0/3117727183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f817c0cf6f0 0x7f817c15fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.022+0000 7f8182ee6640 1 --2- 172.21.15.55:0/3117727183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f817c0cd810 0x7f817c1629a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.022+0000 7f8182ee6640 1 --2- 172.21.15.55:0/3117727183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f817c0b3c60 0x7f817c0c76a0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.022+0000 7f8182ee6640 1 -- 172.21.15.55:0/3117727183 >> 172.21.15.55:0/3117727183 conn(0x7f817c09bae0 msgr2=0x7f817c15ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:11.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.022+0000 7f8182ee6640 1 -- 172.21.15.55:0/3117727183 shutdown_connections 2023-08-25T04:18:11.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.022+0000 7f8182ee6640 1 -- 172.21.15.55:0/3117727183 wait complete. 2023-08-25T04:18:11.040 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:18:11.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.186+0000 7fd9cfc5c640 1 Processor -- start 2023-08-25T04:18:11.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.186+0000 7fd9cfc5c640 1 -- start start 2023-08-25T04:18:11.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.186+0000 7fd9cfc5c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd9c80d0da0 0x7fd9c80d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.186+0000 7fd9cfc5c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c80cdde0 0x7fd9c80ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.186+0000 7fd9cfc5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c80b29b0 con 0x7fd9c80cee60 2023-08-25T04:18:11.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.186+0000 7fd9cfc5c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c80ce760 con 0x7fd9c80d0da0 2023-08-25T04:18:11.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.186+0000 7fd9cfc5c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80d16c0 con 0x7fd9c80cdde0 2023-08-25T04:18:11.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.186+0000 7fd9ce1f9640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd9c80cee60 0x7fd9c80cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54976/0 (socket says 172.21.15.55:54976) 2023-08-25T04:18:11.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.186+0000 7fd9ce1f9640 1 -- 172.21.15.55:0/3805516878 learned_addr learned my addr 172.21.15.55:0/3805516878 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:11.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.186+0000 7fd9cd9f8640 1 --2- 172.21.15.55:0/3805516878 >> v2:172.21.15.110:3300/0 conn(0x7fd9c80d0da0 0x7fd9c80d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:11.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.186+0000 7fd9cd1f7640 1 --2- 172.21.15.55:0/3805516878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c80cdde0 0x7fd9c80ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:11.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.186+0000 7fd9cc9f6640 1 -- 172.21.15.55:0/3805516878 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846236662 0 0) 0x7fd9c80b29b0 con 0x7fd9c80cee60 2023-08-25T04:18:11.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.186+0000 7fd9cc9f6640 1 -- 172.21.15.55:0/3805516878 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9b4003530 con 0x7fd9c80cee60 2023-08-25T04:18:11.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.186+0000 7fd9cd9f8640 1 -- 172.21.15.55:0/3805516878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c80cdde0 msgr2=0x7fd9c80ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:11.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.186+0000 7fd9cd9f8640 1 --2- 172.21.15.55:0/3805516878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c80cdde0 0x7fd9c80ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.186+0000 7fd9cd9f8640 1 -- 172.21.15.55:0/3805516878 >> v1:172.21.15.55:6789/0 conn(0x7fd9c80cee60 legacy=0x7fd9c80cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:11.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.186+0000 7fd9cd9f8640 1 -- 172.21.15.55:0/3805516878 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c80b1dc0 con 0x7fd9c80d0da0 2023-08-25T04:18:11.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.186+0000 7fd9cd1f7640 1 --2- 172.21.15.55:0/3805516878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c80cdde0 0x7fd9c80ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:11.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.190+0000 7fd9cd9f8640 1 --2- 172.21.15.55:0/3805516878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c80d0da0 0x7fd9c80d1180 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40097a0 tx=0x7fd9c401ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1bf41a75fe4c67f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:11.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.190+0000 7fd9cc9f6640 1 -- 172.21.15.55:0/3805516878 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c40a8950 con 0x7fd9c80d0da0 2023-08-25T04:18:11.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.190+0000 7fd9cc9f6640 1 -- 172.21.15.55:0/3805516878 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c40a8ab0 con 0x7fd9c80d0da0 2023-08-25T04:18:11.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.190+0000 7fd9cc9f6640 1 -- 172.21.15.55:0/3805516878 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c40a8e40 con 0x7fd9c80d0da0 2023-08-25T04:18:11.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.190+0000 7fd9cfc5c640 1 -- 172.21.15.55:0/3805516878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c80d0da0 msgr2=0x7fd9c80d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:11.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.190+0000 7fd9cfc5c640 1 --2- 172.21.15.55:0/3805516878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c80d0da0 0x7fd9c80d1180 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40097a0 tx=0x7fd9c401ec50 comp rx=0 tx=0).stop 2023-08-25T04:18:11.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.190+0000 7fd9cfc5c640 1 -- 172.21.15.55:0/3805516878 shutdown_connections 2023-08-25T04:18:11.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.190+0000 7fd9cfc5c640 1 --2- 172.21.15.55:0/3805516878 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c80cdde0 0x7fd9c80ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.190+0000 7fd9cfc5c640 1 --2- 172.21.15.55:0/3805516878 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c80d0da0 0x7fd9c80d1180 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.190+0000 7fd9cfc5c640 1 -- 172.21.15.55:0/3805516878 >> 172.21.15.55:0/3805516878 conn(0x7fd9c809bae0 msgr2=0x7fd9c80d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:11.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.190+0000 7fd9cfc5c640 1 -- 172.21.15.55:0/3805516878 shutdown_connections 2023-08-25T04:18:11.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.190+0000 7fd9cfc5c640 1 -- 172.21.15.55:0/3805516878 wait complete. 2023-08-25T04:18:11.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9cfc5c640 1 Processor -- start 2023-08-25T04:18:11.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9cfc5c640 1 -- start start 2023-08-25T04:18:11.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9cfc5c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c80cdde0 0x7fd9c81f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9cfc5c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c80cee60 0x7fd9c80c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9cfc5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c80d0da0 0x7fd9c80cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9cfc5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80c69b0 con 0x7fd9c80d0da0 2023-08-25T04:18:11.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9cfc5c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c814d4b0 con 0x7fd9c80cee60 2023-08-25T04:18:11.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9cfc5c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c8151800 con 0x7fd9c80cdde0 2023-08-25T04:18:11.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9ce1f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c80d0da0 0x7fd9c80cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:11.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9ce1f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c80d0da0 0x7fd9c80cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56560/0 (socket says 172.21.15.55:56560) 2023-08-25T04:18:11.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9ce1f9640 1 -- 172.21.15.55:0/1449517923 learned_addr learned my addr 172.21.15.55:0/1449517923 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:11.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9cd1f7640 1 --2- 172.21.15.55:0/1449517923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c80cee60 0x7fd9c80c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:11.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9cd9f8640 1 --2- 172.21.15.55:0/1449517923 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c80cdde0 0x7fd9c81f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:11.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9ce1f9640 1 -- 172.21.15.55:0/1449517923 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c80cdde0 msgr2=0x7fd9c81f1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:11.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9ce1f9640 1 --2- 172.21.15.55:0/1449517923 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c80cdde0 0x7fd9c81f1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9ce1f9640 1 -- 172.21.15.55:0/1449517923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c80cee60 msgr2=0x7fd9c80c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:11.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9ce1f9640 1 --2- 172.21.15.55:0/1449517923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c80cee60 0x7fd9c80c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9ce1f9640 1 -- 172.21.15.55:0/1449517923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8009420 con 0x7fd9c80d0da0 2023-08-25T04:18:11.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9ce1f9640 1 --2- 172.21.15.55:0/1449517923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c80d0da0 0x7fd9c80cba60 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd9c000cb70 tx=0x7fd9c000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:11.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9be7fc640 1 -- 172.21.15.55:0/1449517923 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c000ace0 con 0x7fd9c80d0da0 2023-08-25T04:18:11.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9be7fc640 1 -- 172.21.15.55:0/1449517923 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c000ae40 con 0x7fd9c80d0da0 2023-08-25T04:18:11.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9cfc5c640 1 -- 172.21.15.55:0/1449517923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c40093b0 con 0x7fd9c80d0da0 2023-08-25T04:18:11.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9be7fc640 1 -- 172.21.15.55:0/1449517923 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0012620 con 0x7fd9c80d0da0 2023-08-25T04:18:11.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.194+0000 7fd9cfc5c640 1 -- 172.21.15.55:0/1449517923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c8150ed0 con 0x7fd9c80d0da0 2023-08-25T04:18:11.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.198+0000 7fd9cfc5c640 1 -- 172.21.15.55:0/1449517923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c80b2340 con 0x7fd9c80d0da0 2023-08-25T04:18:11.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.198+0000 7fd9be7fc640 1 -- 172.21.15.55:0/1449517923 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fd9c0007070 con 0x7fd9c80d0da0 2023-08-25T04:18:11.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.198+0000 7fd9be7fc640 1 --2- 172.21.15.55:0/1449517923 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fd9ac065710 0x7fd9ac067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.198+0000 7fd9be7fc640 1 -- 172.21.15.55:0/1449517923 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6836+0+0 (secure 0 0 0) 0x7fd9c0083130 con 0x7fd9c80d0da0 2023-08-25T04:18:11.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.198+0000 7fd9cd9f8640 1 --2- 172.21.15.55:0/1449517923 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fd9ac065710 0x7fd9ac067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:11.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.198+0000 7fd9cd9f8640 1 --2- 172.21.15.55:0/1449517923 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fd9ac065710 0x7fd9ac067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40b2000 tx=0x7fd9c4008040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:11.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.202+0000 7fd9be7fc640 1 -- 172.21.15.55:0/1449517923 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd9c80b2340 con 0x7fd9c80d0da0 2023-08-25T04:18:11.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.358+0000 7fd9cfc5c640 1 -- 172.21.15.55:0/1449517923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9c80b2340 con 0x7fd9c80d0da0 2023-08-25T04:18:11.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.358+0000 7fd9be7fc640 1 -- 172.21.15.55:0/1449517923 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+19536 (secure 0 0 0) 0x7fd9c80b2340 con 0x7fd9c80d0da0 2023-08-25T04:18:11.361 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:11.361 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":67,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:18:10.610451+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:16:00.903688+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-25T04:16:02.143304+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":66,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1a","mappings":[{"from":0,"to":1}]},{"pgid":"8.2d","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/4198165212":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/943102433":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/3556108705":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/501517667":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/2165360961":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/3235366703":"2023-08-26T04:18:08.515634+0000","172.21.15.110:6832/3383442930":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/746484664":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/894259341":"2023-08-26T04:16:20.415897+0000","172.21.15.110:6833/1373721950":"2023-08-26T04:16:20.415897+0000","172.21.15.110:6832/1373721950":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/1127649499":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/33998418":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/188879394":"2023-08-26T04:16:20.415897+0000","172.21.15.110:6833/3383442930":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/1737595424":"2023-08-26T04:16:20.415897+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:18:11.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.362+0000 7fd9cfc5c640 1 -- 172.21.15.55:0/1449517923 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fd9ac065710 msgr2=0x7fd9ac067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:11.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.362+0000 7fd9cfc5c640 1 --2- 172.21.15.55:0/1449517923 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fd9ac065710 0x7fd9ac067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd9c40b2000 tx=0x7fd9c4008040 comp rx=0 tx=0).stop 2023-08-25T04:18:11.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.362+0000 7fd9cfc5c640 1 -- 172.21.15.55:0/1449517923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c80d0da0 msgr2=0x7fd9c80cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:11.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.362+0000 7fd9cfc5c640 1 --2- 172.21.15.55:0/1449517923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c80d0da0 0x7fd9c80cba60 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd9c000cb70 tx=0x7fd9c000a430 comp rx=0 tx=0).stop 2023-08-25T04:18:11.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.362+0000 7fd9cfc5c640 1 -- 172.21.15.55:0/1449517923 shutdown_connections 2023-08-25T04:18:11.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.362+0000 7fd9cfc5c640 1 --2- 172.21.15.55:0/1449517923 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fd9ac065710 0x7fd9ac067bd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.362+0000 7fd9cfc5c640 1 --2- 172.21.15.55:0/1449517923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c80d0da0 0x7fd9c80cba60 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.362+0000 7fd9cfc5c640 1 --2- 172.21.15.55:0/1449517923 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c80cee60 0x7fd9c80c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.362+0000 7fd9cfc5c640 1 --2- 172.21.15.55:0/1449517923 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c80cdde0 0x7fd9c81f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.362+0000 7fd9cfc5c640 1 -- 172.21.15.55:0/1449517923 >> 172.21.15.55:0/1449517923 conn(0x7fd9c809bae0 msgr2=0x7fd9c80cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:11.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.362+0000 7fd9cfc5c640 1 -- 172.21.15.55:0/1449517923 shutdown_connections 2023-08-25T04:18:11.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.362+0000 7fd9cfc5c640 1 -- 172.21.15.55:0/1449517923 wait complete. 2023-08-25T04:18:11.381 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-25T04:18:11.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.526+0000 7ff82569e640 1 Processor -- start 2023-08-25T04:18:11.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.530+0000 7ff82569e640 1 -- start start 2023-08-25T04:18:11.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.530+0000 7ff82569e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff82015eba0 0x7ff8200b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.530+0000 7ff82569e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff82015ef80 0x7ff8200ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.530+0000 7ff82569e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8200cece0 0x7ff8200cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.530+0000 7ff82569e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8200cf170 con 0x7ff82015eba0 2023-08-25T04:18:11.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.530+0000 7ff82569e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8200ac3a0 con 0x7ff82015ef80 2023-08-25T04:18:11.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.530+0000 7ff82569e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8200b1390 con 0x7ff8200cece0 2023-08-25T04:18:11.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.530+0000 7ff81effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff82015eba0 0x7ff8200b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:11.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.530+0000 7ff81effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff82015eba0 0x7ff8200b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56576/0 (socket says 172.21.15.55:56576) 2023-08-25T04:18:11.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.530+0000 7ff81effd640 1 -- 172.21.15.55:0/1730778516 learned_addr learned my addr 172.21.15.55:0/1730778516 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:11.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.530+0000 7ff817fff640 1 --2- 172.21.15.55:0/1730778516 >> v2:172.21.15.110:3300/0 conn(0x7ff82015ef80 0x7ff8200ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:11.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.530+0000 7ff81f7fe640 1 --2- 172.21.15.55:0/1730778516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8200cece0 0x7ff8200cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:11.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.530+0000 7ff81effd640 1 -- 172.21.15.55:0/1730778516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8200cece0 msgr2=0x7ff8200cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:11.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.530+0000 7ff81effd640 1 --2- 172.21.15.55:0/1730778516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8200cece0 0x7ff8200cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.530+0000 7ff81effd640 1 -- 172.21.15.55:0/1730778516 >> v2:172.21.15.110:3300/0 conn(0x7ff82015ef80 msgr2=0x7ff8200ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:11.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.530+0000 7ff81effd640 1 --2- 172.21.15.55:0/1730778516 >> v2:172.21.15.110:3300/0 conn(0x7ff82015ef80 0x7ff8200ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.530+0000 7ff81effd640 1 -- 172.21.15.55:0/1730778516 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8200b1670 con 0x7ff82015eba0 2023-08-25T04:18:11.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.534+0000 7ff81effd640 1 --2- 172.21.15.55:0/1730778516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff82015eba0 0x7ff8200b2a40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff8200b3470 tx=0x7ff81001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1532d52f23fa823 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:11.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.534+0000 7ff81e7fc640 1 -- 172.21.15.55:0/1730778516 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8100ab600 con 0x7ff82015eba0 2023-08-25T04:18:11.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.534+0000 7ff81e7fc640 1 -- 172.21.15.55:0/1730778516 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8100a7050 con 0x7ff82015eba0 2023-08-25T04:18:11.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.534+0000 7ff81e7fc640 1 -- 172.21.15.55:0/1730778516 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8100ab980 con 0x7ff82015eba0 2023-08-25T04:18:11.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.534+0000 7ff82569e640 1 -- 172.21.15.55:0/1730778516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff82015eba0 msgr2=0x7ff8200b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:11.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.534+0000 7ff82569e640 1 --2- 172.21.15.55:0/1730778516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff82015eba0 0x7ff8200b2a40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff8200b3470 tx=0x7ff81001c210 comp rx=0 tx=0).stop 2023-08-25T04:18:11.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.534+0000 7ff82569e640 1 -- 172.21.15.55:0/1730778516 shutdown_connections 2023-08-25T04:18:11.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.534+0000 7ff82569e640 1 --2- 172.21.15.55:0/1730778516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8200cece0 0x7ff8200cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.534+0000 7ff82569e640 1 --2- 172.21.15.55:0/1730778516 >> v2:172.21.15.110:3300/0 conn(0x7ff82015ef80 0x7ff8200ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.534+0000 7ff82569e640 1 --2- 172.21.15.55:0/1730778516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff82015eba0 0x7ff8200b2a40 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.534+0000 7ff82569e640 1 -- 172.21.15.55:0/1730778516 >> 172.21.15.55:0/1730778516 conn(0x7ff820069d00 msgr2=0x7ff82006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:11.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.534+0000 7ff82569e640 1 -- 172.21.15.55:0/1730778516 shutdown_connections 2023-08-25T04:18:11.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.534+0000 7ff82569e640 1 -- 172.21.15.55:0/1730778516 wait complete. 2023-08-25T04:18:11.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.534+0000 7ff82569e640 1 Processor -- start 2023-08-25T04:18:11.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.534+0000 7ff82569e640 1 -- start start 2023-08-25T04:18:11.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff82569e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8200cece0 0x7ff82015ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff82569e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff82015eba0 0x7ff8200c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff82569e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff82015ef80 0x7ff8200c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff82569e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8200c3a20 con 0x7ff8200cece0 2023-08-25T04:18:11.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff82569e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8200c6a70 con 0x7ff82015eba0 2023-08-25T04:18:11.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff82569e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8200c7e90 con 0x7ff82015ef80 2023-08-25T04:18:11.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff81effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8200cece0 0x7ff82015ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:11.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff81effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8200cece0 0x7ff82015ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56580/0 (socket says 172.21.15.55:56580) 2023-08-25T04:18:11.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff81effd640 1 -- 172.21.15.55:0/4216810715 learned_addr learned my addr 172.21.15.55:0/4216810715 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:11.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff817fff640 1 --2- 172.21.15.55:0/4216810715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff82015eba0 0x7ff8200c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:11.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff81f7fe640 1 --2- 172.21.15.55:0/4216810715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff82015ef80 0x7ff8200c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:11.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff81effd640 1 -- 172.21.15.55:0/4216810715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff82015ef80 msgr2=0x7ff8200c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:11.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff81effd640 1 --2- 172.21.15.55:0/4216810715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff82015ef80 0x7ff8200c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff81effd640 1 -- 172.21.15.55:0/4216810715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff82015eba0 msgr2=0x7ff8200c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:11.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff81effd640 1 --2- 172.21.15.55:0/4216810715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff82015eba0 0x7ff8200c5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff81effd640 1 -- 172.21.15.55:0/4216810715 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8100094d0 con 0x7ff8200cece0 2023-08-25T04:18:11.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff81effd640 1 --2- 172.21.15.55:0/4216810715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8200cece0 0x7ff82015ad10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff8100ae040 tx=0x7ff810018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:11.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff8177fe640 1 -- 172.21.15.55:0/4216810715 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8100b4440 con 0x7ff8200cece0 2023-08-25T04:18:11.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff8177fe640 1 -- 172.21.15.55:0/4216810715 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8100b45a0 con 0x7ff8200cece0 2023-08-25T04:18:11.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff8177fe640 1 -- 172.21.15.55:0/4216810715 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8100b4930 con 0x7ff8200cece0 2023-08-25T04:18:11.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff82569e640 1 -- 172.21.15.55:0/4216810715 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8200c6790 con 0x7ff8200cece0 2023-08-25T04:18:11.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff82569e640 1 -- 172.21.15.55:0/4216810715 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8200c83f0 con 0x7ff8200cece0 2023-08-25T04:18:11.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff82569e640 1 -- 172.21.15.55:0/4216810715 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82004dbe0 con 0x7ff8200cece0 2023-08-25T04:18:11.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.538+0000 7ff8177fe640 1 -- 172.21.15.55:0/4216810715 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85008+0+0 (secure 0 0 0) 0x7ff8100b2070 con 0x7ff8200cece0 2023-08-25T04:18:11.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.542+0000 7ff8177fe640 1 --2- 172.21.15.55:0/4216810715 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7ff800065710 0x7ff800067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.542+0000 7ff8177fe640 1 -- 172.21.15.55:0/4216810715 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6836+0+0 (secure 0 0 0) 0x7ff81011d000 con 0x7ff8200cece0 2023-08-25T04:18:11.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.542+0000 7ff817fff640 1 --2- 172.21.15.55:0/4216810715 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7ff800065710 0x7ff800067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:11.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.542+0000 7ff817fff640 1 --2- 172.21.15.55:0/4216810715 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7ff800065710 0x7ff800067bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff820152a40 tx=0x7ff808008040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:11.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.546+0000 7ff8177fe640 1 -- 172.21.15.55:0/4216810715 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff8100ea740 con 0x7ff8200cece0 2023-08-25T04:18:11.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.730+0000 7ff82569e640 1 -- 172.21.15.55:0/4216810715 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff8200c94f0 con 0x7ff8200cece0 2023-08-25T04:18:11.730 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-08-25T04:18:11.730+0000 7f7f18c38640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-25T04:18:11.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.738+0000 7ff8177fe640 1 -- 172.21.15.55:0/4216810715 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff8100edd60 con 0x7ff8200cece0 2023-08-25T04:18:11.739 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-25T04:18:11.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.742+0000 7ff82569e640 1 -- 172.21.15.55:0/4216810715 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7ff800065710 msgr2=0x7ff800067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:11.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.742+0000 7ff82569e640 1 --2- 172.21.15.55:0/4216810715 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7ff800065710 0x7ff800067bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff820152a40 tx=0x7ff808008040 comp rx=0 tx=0).stop 2023-08-25T04:18:11.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.742+0000 7ff82569e640 1 -- 172.21.15.55:0/4216810715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8200cece0 msgr2=0x7ff82015ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:11.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.742+0000 7ff82569e640 1 --2- 172.21.15.55:0/4216810715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8200cece0 0x7ff82015ad10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff8100ae040 tx=0x7ff810018fb0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.742+0000 7ff82569e640 1 -- 172.21.15.55:0/4216810715 shutdown_connections 2023-08-25T04:18:11.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.742+0000 7ff82569e640 1 --2- 172.21.15.55:0/4216810715 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7ff800065710 0x7ff800067bd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.742+0000 7ff82569e640 1 --2- 172.21.15.55:0/4216810715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff82015ef80 0x7ff8200c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.742+0000 7ff82569e640 1 --2- 172.21.15.55:0/4216810715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff82015eba0 0x7ff8200c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.742+0000 7ff82569e640 1 --2- 172.21.15.55:0/4216810715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8200cece0 0x7ff82015ad10 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.742+0000 7ff82569e640 1 -- 172.21.15.55:0/4216810715 >> 172.21.15.55:0/4216810715 conn(0x7ff820069d00 msgr2=0x7ff82015e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:11.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.742+0000 7ff82569e640 1 -- 172.21.15.55:0/4216810715 shutdown_connections 2023-08-25T04:18:11.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.742+0000 7ff82569e640 1 -- 172.21.15.55:0/4216810715 wait complete. 2023-08-25T04:18:11.762 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-25T04:18:11.808 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2023-08-25T04:18:11.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.910+0000 7f4ccd367640 1 Processor -- start 2023-08-25T04:18:11.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.910+0000 7f4ccd367640 1 -- start start 2023-08-25T04:18:11.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.910+0000 7f4ccd367640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cc80cb020 0x7f4cc80c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.910+0000 7f4ccd367640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4cc80cdd50 0x7f4cc80cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.910+0000 7f4ccd367640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc80cbca0 con 0x7f4cc806c720 2023-08-25T04:18:11.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.910+0000 7f4ccd367640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc80c9470 con 0x7f4cc80cdd50 2023-08-25T04:18:11.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.910+0000 7f4ccd367640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc80ce1b0 con 0x7f4cc80cb020 2023-08-25T04:18:11.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.910+0000 7f4cbe7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4cc80cdd50 0x7f4cc80cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:11.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.910+0000 7f4cbe7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4cc80cdd50 0x7f4cc80cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56588/0 (socket says 172.21.15.55:56588) 2023-08-25T04:18:11.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.910+0000 7f4cbe7fc640 1 -- 172.21.15.55:0/2504397178 learned_addr learned my addr 172.21.15.55:0/2504397178 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:11.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.910+0000 7f4cc6ffd640 1 --2- 172.21.15.55:0/2504397178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cc80cb020 0x7f4cc80c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:11.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.914+0000 7f4cbe7fc640 1 -- 172.21.15.55:0/2504397178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cc80cb020 msgr2=0x7f4cc80c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:11.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.914+0000 7f4cbe7fc640 1 --2- 172.21.15.55:0/2504397178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cc80cb020 0x7f4cc80c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.914+0000 7f4cbe7fc640 1 -- 172.21.15.55:0/2504397178 >> v1:172.21.15.110:6789/0 conn(0x7f4cc806c720 legacy=0x7f4cc80cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:11.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.914+0000 7f4cbe7fc640 1 -- 172.21.15.55:0/2504397178 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc80c8b40 con 0x7f4cc80cdd50 2023-08-25T04:18:11.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.914+0000 7f4cc67fc640 1 -- 172.21.15.55:0/2504397178 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955456685 0 0) 0x7f4cc80cbca0 con 0x7f4cc806c720 2023-08-25T04:18:11.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.914+0000 7f4cbe7fc640 1 --2- 172.21.15.55:0/2504397178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cc80cdd50 0x7f4cc80cb400 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009870 tx=0x7f4cb001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12db50b4adb206ab server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:11.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.914+0000 7f4cc67fc640 1 -- 172.21.15.55:0/2504397178 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb00ac600 con 0x7f4cc80cdd50 2023-08-25T04:18:11.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.914+0000 7f4cc67fc640 1 -- 172.21.15.55:0/2504397178 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb00a8050 con 0x7f4cc80cdd50 2023-08-25T04:18:11.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.914+0000 7f4cc67fc640 1 -- 172.21.15.55:0/2504397178 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb00ac980 con 0x7f4cc80cdd50 2023-08-25T04:18:11.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.914+0000 7f4ccd367640 1 -- 172.21.15.55:0/2504397178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cc80cdd50 msgr2=0x7f4cc80cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:11.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.914+0000 7f4ccd367640 1 --2- 172.21.15.55:0/2504397178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cc80cdd50 0x7f4cc80cb400 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009870 tx=0x7f4cb001c4b0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.914+0000 7f4ccd367640 1 -- 172.21.15.55:0/2504397178 shutdown_connections 2023-08-25T04:18:11.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.914+0000 7f4ccd367640 1 --2- 172.21.15.55:0/2504397178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cc80cdd50 0x7f4cc80cb400 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.914+0000 7f4ccd367640 1 --2- 172.21.15.55:0/2504397178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cc80cb020 0x7f4cc80c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.914+0000 7f4ccd367640 1 -- 172.21.15.55:0/2504397178 >> 172.21.15.55:0/2504397178 conn(0x7f4cc8069900 msgr2=0x7f4cc8069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:11.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.914+0000 7f4ccd367640 1 -- 172.21.15.55:0/2504397178 shutdown_connections 2023-08-25T04:18:11.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.914+0000 7f4ccd367640 1 -- 172.21.15.55:0/2504397178 wait complete. 2023-08-25T04:18:11.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4ccd367640 1 Processor -- start 2023-08-25T04:18:11.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4ccd367640 1 -- start start 2023-08-25T04:18:11.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4ccd367640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cc806c720 0x7f4cc809b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4ccd367640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cc80cb020 0x7f4cc815b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4ccd367640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cc80cdd50 0x7f4cc8146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4ccd367640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc809af80 con 0x7f4cc806c720 2023-08-25T04:18:11.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4ccd367640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc809a690 con 0x7f4cc80cdd50 2023-08-25T04:18:11.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4ccd367640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc809a930 con 0x7f4cc80cb020 2023-08-25T04:18:11.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4cc6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cc806c720 0x7f4cc809b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:11.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4cc6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cc806c720 0x7f4cc809b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56594/0 (socket says 172.21.15.55:56594) 2023-08-25T04:18:11.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4cc6ffd640 1 -- 172.21.15.55:0/687637183 learned_addr learned my addr 172.21.15.55:0/687637183 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:11.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4cbe7fc640 1 --2- 172.21.15.55:0/687637183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cc80cb020 0x7f4cc815b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:11.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4cc6ffd640 1 -- 172.21.15.55:0/687637183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cc80cb020 msgr2=0x7f4cc815b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:11.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4cc6ffd640 1 --2- 172.21.15.55:0/687637183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cc80cb020 0x7f4cc815b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4cc6ffd640 1 -- 172.21.15.55:0/687637183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cc80cdd50 msgr2=0x7f4cc8146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:11.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4cc6ffd640 1 --2- 172.21.15.55:0/687637183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cc80cdd50 0x7f4cc8146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:11.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4cc6ffd640 1 -- 172.21.15.55:0/687637183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb00094d0 con 0x7f4cc806c720 2023-08-25T04:18:11.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4cbe7fc640 1 --2- 172.21.15.55:0/687637183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cc80cb020 0x7f4cc815b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:11.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4cc6ffd640 1 --2- 172.21.15.55:0/687637183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cc806c720 0x7f4cc809b410 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800e9b0 tx=0x7f4cb800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:11.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4cbffff640 1 -- 172.21.15.55:0/687637183 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8009670 con 0x7f4cc806c720 2023-08-25T04:18:11.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4cbffff640 1 -- 172.21.15.55:0/687637183 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb800c9a0 con 0x7f4cc806c720 2023-08-25T04:18:11.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4cbffff640 1 -- 172.21.15.55:0/687637183 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800cd10 con 0x7f4cc806c720 2023-08-25T04:18:11.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.918+0000 7f4ccd367640 1 -- 172.21.15.55:0/687637183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc806d0c0 con 0x7f4cc806c720 2023-08-25T04:18:11.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.922+0000 7f4ccd367640 1 -- 172.21.15.55:0/687637183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc809b950 con 0x7f4cc806c720 2023-08-25T04:18:11.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.922+0000 7f4ccd367640 1 -- 172.21.15.55:0/687637183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc8073ec0 con 0x7f4cc806c720 2023-08-25T04:18:11.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.922+0000 7f4cbffff640 1 -- 172.21.15.55:0/687637183 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 29) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f4cb8013470 con 0x7f4cc806c720 2023-08-25T04:18:11.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.922+0000 7f4cbffff640 1 --2- 172.21.15.55:0/687637183 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f4ca8065740 0x7f4ca8067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:11.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.922+0000 7f4cbffff640 1 -- 172.21.15.55:0/687637183 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f4cb8083750 con 0x7f4cc806c720 2023-08-25T04:18:11.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.922+0000 7f4cbe7fc640 1 --2- 172.21.15.55:0/687637183 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f4ca8065740 0x7f4ca8067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:11.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.922+0000 7f4cbe7fc640 1 --2- 172.21.15.55:0/687637183 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f4ca8065740 0x7f4ca8067c00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00ae000 tx=0x7f4cb00a7000 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:11.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:11.926+0000 7f4cbffff640 1 -- 172.21.15.55:0/687637183 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4cb8050ee0 con 0x7f4cc806c720 2023-08-25T04:18:12.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.118+0000 7f4ccd367640 1 -- 172.21.15.55:0/687637183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4cc80cc230 con 0x7f4cc806c720 2023-08-25T04:18:12.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.762+0000 7f4cbffff640 1 -- 172.21.15.55:0/687637183 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f4cb80512b0 con 0x7f4cc806c720 2023-08-25T04:18:12.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.766+0000 7f4cbffff640 1 -- 172.21.15.55:0/687637183 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4cb8054970 con 0x7f4cc806c720 2023-08-25T04:18:12.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.766+0000 7f4ccd367640 1 -- 172.21.15.55:0/687637183 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f4ca8065740 msgr2=0x7f4ca8067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:12.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.766+0000 7f4ccd367640 1 --2- 172.21.15.55:0/687637183 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f4ca8065740 0x7f4ca8067c00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00ae000 tx=0x7f4cb00a7000 comp rx=0 tx=0).stop 2023-08-25T04:18:12.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.766+0000 7f4ccd367640 1 -- 172.21.15.55:0/687637183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cc806c720 msgr2=0x7f4cc809b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:12.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.766+0000 7f4ccd367640 1 --2- 172.21.15.55:0/687637183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cc806c720 0x7f4cc809b410 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800e9b0 tx=0x7f4cb800ee70 comp rx=0 tx=0).stop 2023-08-25T04:18:12.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.766+0000 7f4ccd367640 1 -- 172.21.15.55:0/687637183 shutdown_connections 2023-08-25T04:18:12.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.766+0000 7f4ccd367640 1 --2- 172.21.15.55:0/687637183 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f4ca8065740 0x7f4ca8067c00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:12.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.766+0000 7f4ccd367640 1 --2- 172.21.15.55:0/687637183 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cc80cdd50 0x7f4cc8146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:12.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.766+0000 7f4ccd367640 1 --2- 172.21.15.55:0/687637183 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cc80cb020 0x7f4cc815b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:12.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.766+0000 7f4ccd367640 1 --2- 172.21.15.55:0/687637183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4cc806c720 0x7f4cc809b410 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:12.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.770+0000 7f4ccd367640 1 -- 172.21.15.55:0/687637183 >> 172.21.15.55:0/687637183 conn(0x7f4cc8069900 msgr2=0x7f4cc80cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:12.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.770+0000 7f4ccd367640 1 -- 172.21.15.55:0/687637183 shutdown_connections 2023-08-25T04:18:12.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.770+0000 7f4ccd367640 1 -- 172.21.15.55:0/687637183 wait complete. 2023-08-25T04:18:12.791 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-25T04:18:12.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.942+0000 7fc1b22e5640 1 Processor -- start 2023-08-25T04:18:12.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.942+0000 7fc1b22e5640 1 -- start start 2023-08-25T04:18:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.942+0000 7fc1b22e5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc1ac06fb50 0x7fc1ac0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.942+0000 7fc1b22e5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1ac0cc930 0x7fc1ac0ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.942+0000 7fc1b22e5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1ac0c9270 con 0x7fc1ac159d00 2023-08-25T04:18:12.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.942+0000 7fc1b22e5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1ac0cc510 con 0x7fc1ac06fb50 2023-08-25T04:18:12.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.942+0000 7fc1b22e5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac0ce220 con 0x7fc1ac0cc930 2023-08-25T04:18:12.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.946+0000 7fc1ab7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc1ac06fb50 0x7fc1ac0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:12.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.946+0000 7fc1b0882640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1ac0cc930 0x7fc1ac0ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:12.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.946+0000 7fc1b0882640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1ac0cc930 0x7fc1ac0ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:47702/0 (socket says 172.21.15.55:47702) 2023-08-25T04:18:12.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.946+0000 7fc1b0882640 1 -- 172.21.15.55:0/2112313871 learned_addr learned my addr 172.21.15.55:0/2112313871 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:12.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.946+0000 7fc1ab7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc1ac06fb50 0x7fc1ac0cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:48906/0 (socket says 172.21.15.55:48906) 2023-08-25T04:18:12.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.946+0000 7fc1abfff640 1 --1- 172.21.15.55:0/2112313871 >> v1:172.21.15.110:6789/0 conn(0x7fc1ac159d00 0x7fc1ac0c8b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:33676/0 (socket says 172.21.15.55:33676) 2023-08-25T04:18:12.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.946+0000 7fc1b0882640 1 -- 172.21.15.55:0/2112313871 >> v2:172.21.15.110:3300/0 conn(0x7fc1ac06fb50 msgr2=0x7fc1ac0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:12.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.946+0000 7fc1b0882640 1 --2- 172.21.15.55:0/2112313871 >> v2:172.21.15.110:3300/0 conn(0x7fc1ac06fb50 0x7fc1ac0cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:12.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.946+0000 7fc1b0882640 1 -- 172.21.15.55:0/2112313871 >> v1:172.21.15.110:6789/0 conn(0x7fc1ac159d00 legacy=0x7fc1ac0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:12.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.946+0000 7fc1b0882640 1 -- 172.21.15.55:0/2112313871 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac0ca6c0 con 0x7fc1ac0cc930 2023-08-25T04:18:12.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.946+0000 7fc1ab7fe640 1 --2- 172.21.15.55:0/2112313871 >> v2:172.21.15.110:3300/0 conn(0x7fc1ac06fb50 0x7fc1ac0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:12.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.946+0000 7fc1aaffd640 1 -- 172.21.15.55:0/2112313871 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084459110 0 0) 0x7fc1ac0c9270 con 0x7fc1ac159d00 2023-08-25T04:18:12.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.946+0000 7fc1b0882640 1 --2- 172.21.15.55:0/2112313871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1ac0cc930 0x7fc1ac0ccd80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009e50 tx=0x7fc1a401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ff9f32b25b1fcb7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:12.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.946+0000 7fc1aaffd640 1 -- 172.21.15.55:0/2112313871 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40a5810 con 0x7fc1ac0cc930 2023-08-25T04:18:12.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.946+0000 7fc1aaffd640 1 -- 172.21.15.55:0/2112313871 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1a40a5970 con 0x7fc1ac0cc930 2023-08-25T04:18:12.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.946+0000 7fc1aaffd640 1 -- 172.21.15.55:0/2112313871 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a40a5d00 con 0x7fc1ac0cc930 2023-08-25T04:18:12.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1b22e5640 1 -- 172.21.15.55:0/2112313871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1ac0cc930 msgr2=0x7fc1ac0ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:12.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1b22e5640 1 --2- 172.21.15.55:0/2112313871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1ac0cc930 0x7fc1ac0ccd80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009e50 tx=0x7fc1a401c950 comp rx=0 tx=0).stop 2023-08-25T04:18:12.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1b22e5640 1 -- 172.21.15.55:0/2112313871 shutdown_connections 2023-08-25T04:18:12.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1b22e5640 1 --2- 172.21.15.55:0/2112313871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1ac0cc930 0x7fc1ac0ccd80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:12.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1b22e5640 1 --2- 172.21.15.55:0/2112313871 >> v2:172.21.15.110:3300/0 conn(0x7fc1ac06fb50 0x7fc1ac0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:12.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1b22e5640 1 -- 172.21.15.55:0/2112313871 >> 172.21.15.55:0/2112313871 conn(0x7fc1ac0caf90 msgr2=0x7fc1ac0cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:12.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1b22e5640 1 -- 172.21.15.55:0/2112313871 shutdown_connections 2023-08-25T04:18:12.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1b22e5640 1 -- 172.21.15.55:0/2112313871 wait complete. 2023-08-25T04:18:12.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1b22e5640 1 Processor -- start 2023-08-25T04:18:12.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1b22e5640 1 -- start start 2023-08-25T04:18:12.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1b22e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1ac06fb50 0x7fc1ac14e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:12.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1b22e5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1ac0cc930 0x7fc1ac14f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:12.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1b22e5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1ac159d00 0x7fc1ac14f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:12.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1b22e5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac140e20 con 0x7fc1ac06fb50 2023-08-25T04:18:12.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1b22e5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac1f99c0 con 0x7fc1ac0cc930 2023-08-25T04:18:12.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1b22e5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1ac14ed10 con 0x7fc1ac159d00 2023-08-25T04:18:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1abfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1ac06fb50 0x7fc1ac14e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1abfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1ac06fb50 0x7fc1ac14e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56606/0 (socket says 172.21.15.55:56606) 2023-08-25T04:18:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.950+0000 7fc1abfff640 1 -- 172.21.15.55:0/3784584116 learned_addr learned my addr 172.21.15.55:0/3784584116 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.954+0000 7fc1ab7fe640 1 --2- 172.21.15.55:0/3784584116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1ac0cc930 0x7fc1ac14f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.954+0000 7fc1b0882640 1 --2- 172.21.15.55:0/3784584116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1ac159d00 0x7fc1ac14f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.954+0000 7fc1abfff640 1 -- 172.21.15.55:0/3784584116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1ac159d00 msgr2=0x7fc1ac14f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.954+0000 7fc1abfff640 1 --2- 172.21.15.55:0/3784584116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1ac159d00 0x7fc1ac14f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:12.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.954+0000 7fc1abfff640 1 -- 172.21.15.55:0/3784584116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1ac0cc930 msgr2=0x7fc1ac14f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:12.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.954+0000 7fc1abfff640 1 --2- 172.21.15.55:0/3784584116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1ac0cc930 0x7fc1ac14f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:12.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.954+0000 7fc1abfff640 1 -- 172.21.15.55:0/3784584116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a000b6c0 con 0x7fc1ac06fb50 2023-08-25T04:18:12.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.954+0000 7fc1ab7fe640 1 --2- 172.21.15.55:0/3784584116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1ac0cc930 0x7fc1ac14f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:12.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.954+0000 7fc1abfff640 1 --2- 172.21.15.55:0/3784584116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1ac06fb50 0x7fc1ac14e7d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00c4e0 tx=0x7fc19c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.954+0000 7fc1a8ff9640 1 -- 172.21.15.55:0/3784584116 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0074e0 con 0x7fc1ac06fb50 2023-08-25T04:18:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.954+0000 7fc1a8ff9640 1 -- 172.21.15.55:0/3784584116 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c007660 con 0x7fc1ac06fb50 2023-08-25T04:18:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.954+0000 7fc1a8ff9640 1 -- 172.21.15.55:0/3784584116 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c004a30 con 0x7fc1ac06fb50 2023-08-25T04:18:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.954+0000 7fc1b22e5640 1 -- 172.21.15.55:0/3784584116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a4009b30 con 0x7fc1ac06fb50 2023-08-25T04:18:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.954+0000 7fc1b22e5640 1 -- 172.21.15.55:0/3784584116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1ac158dd0 con 0x7fc1ac06fb50 2023-08-25T04:18:12.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.954+0000 7fc1b22e5640 1 -- 172.21.15.55:0/3784584116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1ac158ff0 con 0x7fc1ac06fb50 2023-08-25T04:18:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.954+0000 7fc1a8ff9640 1 -- 172.21.15.55:0/3784584116 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fc19c004b90 con 0x7fc1ac06fb50 2023-08-25T04:18:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.954+0000 7fc1a8ff9640 1 --2- 172.21.15.55:0/3784584116 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fc1980657a0 0x7fc198067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.954+0000 7fc1a8ff9640 1 -- 172.21.15.55:0/3784584116 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6894+0+0 (secure 0 0 0) 0x7fc19c082560 con 0x7fc1ac06fb50 2023-08-25T04:18:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.958+0000 7fc1ab7fe640 1 --2- 172.21.15.55:0/3784584116 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fc1980657a0 0x7fc198067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.958+0000 7fc1ab7fe640 1 --2- 172.21.15.55:0/3784584116 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fc1980657a0 0x7fc198067c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac1fcff0 tx=0x7fc1a000b3a0 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:12.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:12.958+0000 7fc1a8ff9640 1 -- 172.21.15.55:0/3784584116 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc19c0535c0 con 0x7fc1ac06fb50 2023-08-25T04:18:13.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.118+0000 7fc1b22e5640 1 -- 172.21.15.55:0/3784584116 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc1ac0ad6a0 con 0x7fc1ac06fb50 2023-08-25T04:18:13.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.766+0000 7fc1a8ff9640 1 -- 172.21.15.55:0/3784584116 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v69) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc19c053150 con 0x7fc1ac06fb50 2023-08-25T04:18:13.764 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-08-25T04:18:13.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.770+0000 7fc1b22e5640 1 -- 172.21.15.55:0/3784584116 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fc1980657a0 msgr2=0x7fc198067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:13.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.770+0000 7fc1b22e5640 1 --2- 172.21.15.55:0/3784584116 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fc1980657a0 0x7fc198067c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac1fcff0 tx=0x7fc1a000b3a0 comp rx=0 tx=0).stop 2023-08-25T04:18:13.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.770+0000 7fc1b22e5640 1 -- 172.21.15.55:0/3784584116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1ac06fb50 msgr2=0x7fc1ac14e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:13.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.770+0000 7fc1b22e5640 1 --2- 172.21.15.55:0/3784584116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1ac06fb50 0x7fc1ac14e7d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00c4e0 tx=0x7fc19c00c9a0 comp rx=0 tx=0).stop 2023-08-25T04:18:13.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.770+0000 7fc1b22e5640 1 -- 172.21.15.55:0/3784584116 shutdown_connections 2023-08-25T04:18:13.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.770+0000 7fc1b22e5640 1 --2- 172.21.15.55:0/3784584116 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fc1980657a0 0x7fc198067c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:13.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.770+0000 7fc1b22e5640 1 --2- 172.21.15.55:0/3784584116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1ac159d00 0x7fc1ac14f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:13.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.770+0000 7fc1b22e5640 1 --2- 172.21.15.55:0/3784584116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1ac0cc930 0x7fc1ac14f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:13.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.770+0000 7fc1b22e5640 1 --2- 172.21.15.55:0/3784584116 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1ac06fb50 0x7fc1ac14e7d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:13.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.770+0000 7fc1b22e5640 1 -- 172.21.15.55:0/3784584116 >> 172.21.15.55:0/3784584116 conn(0x7fc1ac0caf90 msgr2=0x7fc1ac15d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:13.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.770+0000 7fc1b22e5640 1 -- 172.21.15.55:0/3784584116 shutdown_connections 2023-08-25T04:18:13.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.770+0000 7fc1b22e5640 1 -- 172.21.15.55:0/3784584116 wait complete. 2023-08-25T04:18:13.792 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-25T04:18:13.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.946+0000 7f521359e640 1 Processor -- start 2023-08-25T04:18:13.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.946+0000 7f521359e640 1 -- start start 2023-08-25T04:18:13.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.946+0000 7f521359e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52140b0660 0x7f521406f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:13.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.946+0000 7f521359e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f521406c390 0x7f521406c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:13.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.946+0000 7f521359e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52140b10b0 con 0x7f52140ad780 2023-08-25T04:18:13.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.946+0000 7f521359e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521406cd60 con 0x7f521406c390 2023-08-25T04:18:13.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.946+0000 7f521359e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52140ca0a0 con 0x7f52140b0660 2023-08-25T04:18:13.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.946+0000 7f5212d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f521406c390 0x7f521406c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:13.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.946+0000 7f5212d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f521406c390 0x7f521406c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56618/0 (socket says 172.21.15.55:56618) 2023-08-25T04:18:13.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.946+0000 7f5212d9d640 1 -- 172.21.15.55:0/438650050 learned_addr learned my addr 172.21.15.55:0/438650050 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:13.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.946+0000 7f520bfff640 1 --2- 172.21.15.55:0/438650050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52140b0660 0x7f521406f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:13.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.946+0000 7f5212d9d640 1 -- 172.21.15.55:0/438650050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52140b0660 msgr2=0x7f521406f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:13.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.946+0000 7f5212d9d640 1 --2- 172.21.15.55:0/438650050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52140b0660 0x7f521406f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:13.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.946+0000 7f5212d9d640 1 -- 172.21.15.55:0/438650050 >> v1:172.21.15.55:6789/0 conn(0x7f52140ad780 legacy=0x7f52140c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:13.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.946+0000 7f5212d9d640 1 -- 172.21.15.55:0/438650050 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52140ca380 con 0x7f521406c390 2023-08-25T04:18:13.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.946+0000 7f5211d9b640 1 -- 172.21.15.55:0/438650050 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529030867 0 0) 0x7f52140b10b0 con 0x7f52140ad780 2023-08-25T04:18:13.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.950+0000 7f5212d9d640 1 --2- 172.21.15.55:0/438650050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f521406c390 0x7f521406c820 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f520c009e50 tx=0x7f520c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6454c64561f84e1a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:13.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.950+0000 7f5211d9b640 1 -- 172.21.15.55:0/438650050 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c0a57f0 con 0x7f521406c390 2023-08-25T04:18:13.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.950+0000 7f5211d9b640 1 -- 172.21.15.55:0/438650050 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520c0a5950 con 0x7f521406c390 2023-08-25T04:18:13.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.950+0000 7f5211d9b640 1 -- 172.21.15.55:0/438650050 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c0a5ce0 con 0x7f521406c390 2023-08-25T04:18:13.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.950+0000 7f521359e640 1 -- 172.21.15.55:0/438650050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f521406c390 msgr2=0x7f521406c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:13.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.950+0000 7f521359e640 1 --2- 172.21.15.55:0/438650050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f521406c390 0x7f521406c820 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f520c009e50 tx=0x7f520c01ca10 comp rx=0 tx=0).stop 2023-08-25T04:18:13.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.950+0000 7f521359e640 1 -- 172.21.15.55:0/438650050 shutdown_connections 2023-08-25T04:18:13.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.950+0000 7f521359e640 1 --2- 172.21.15.55:0/438650050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52140b0660 0x7f521406f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:13.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.950+0000 7f521359e640 1 --2- 172.21.15.55:0/438650050 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f521406c390 0x7f521406c820 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:13.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.950+0000 7f521359e640 1 -- 172.21.15.55:0/438650050 >> 172.21.15.55:0/438650050 conn(0x7f52140cac50 msgr2=0x7f52140cb060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:13.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.950+0000 7f521359e640 1 -- 172.21.15.55:0/438650050 shutdown_connections 2023-08-25T04:18:13.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.950+0000 7f521359e640 1 -- 172.21.15.55:0/438650050 wait complete. 2023-08-25T04:18:13.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.950+0000 7f521359e640 1 Processor -- start 2023-08-25T04:18:13.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.950+0000 7f521359e640 1 -- start start 2023-08-25T04:18:13.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f521359e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f521406c390 0x7f5214158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:13.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f521359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52140ad780 0x7f52141594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:13.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f521359e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52140b0660 0x7f521414e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:13.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f521359e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52140cde00 con 0x7f52140ad780 2023-08-25T04:18:13.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f521359e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5214166080 con 0x7f52140b0660 2023-08-25T04:18:13.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f521359e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52141536e0 con 0x7f521406c390 2023-08-25T04:18:13.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f520bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52140ad780 0x7f52141594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:13.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f520bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52140ad780 0x7f52141594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56632/0 (socket says 172.21.15.55:56632) 2023-08-25T04:18:13.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f520bfff640 1 -- 172.21.15.55:0/3924495241 learned_addr learned my addr 172.21.15.55:0/3924495241 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:13.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f521259c640 1 --2- 172.21.15.55:0/3924495241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f521406c390 0x7f5214158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:13.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f5212d9d640 1 --2- 172.21.15.55:0/3924495241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52140b0660 0x7f521414e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:13.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f520bfff640 1 -- 172.21.15.55:0/3924495241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f521406c390 msgr2=0x7f5214158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:13.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f520bfff640 1 --2- 172.21.15.55:0/3924495241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f521406c390 0x7f5214158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:13.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f520bfff640 1 -- 172.21.15.55:0/3924495241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52140b0660 msgr2=0x7f521414e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:13.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f520bfff640 1 --2- 172.21.15.55:0/3924495241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52140b0660 0x7f521414e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:13.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f520bfff640 1 -- 172.21.15.55:0/3924495241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c009b30 con 0x7f52140ad780 2023-08-25T04:18:13.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f520bfff640 1 --2- 172.21.15.55:0/3924495241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52140ad780 0x7f52141594e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00d5f0 tx=0x7f51fc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:13.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f520affd640 1 -- 172.21.15.55:0/3924495241 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc0125f0 con 0x7f52140ad780 2023-08-25T04:18:13.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f520affd640 1 -- 172.21.15.55:0/3924495241 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc012750 con 0x7f52140ad780 2023-08-25T04:18:13.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f520affd640 1 -- 172.21.15.55:0/3924495241 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc012ae0 con 0x7f52140ad780 2023-08-25T04:18:13.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f521359e640 1 -- 172.21.15.55:0/3924495241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5214165ac0 con 0x7f52140ad780 2023-08-25T04:18:13.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f521359e640 1 -- 172.21.15.55:0/3924495241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5214152200 con 0x7f52140ad780 2023-08-25T04:18:13.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.954+0000 7f521359e640 1 -- 172.21.15.55:0/3924495241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52140afe50 con 0x7f52140ad780 2023-08-25T04:18:13.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.958+0000 7f520affd640 1 -- 172.21.15.55:0/3924495241 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f51fc012c40 con 0x7f52140ad780 2023-08-25T04:18:13.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.958+0000 7f520affd640 1 --2- 172.21.15.55:0/3924495241 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f51f40657a0 0x7f51f4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:13.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.958+0000 7f520affd640 1 -- 172.21.15.55:0/3924495241 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f51fc083560 con 0x7f52140ad780 2023-08-25T04:18:13.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.958+0000 7f521259c640 1 --2- 172.21.15.55:0/3924495241 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f51f40657a0 0x7f51f4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:13.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.958+0000 7f521259c640 1 --2- 172.21.15.55:0/3924495241 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f51f40657a0 0x7f51f4067c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f52140c1620 tx=0x7f5204009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:13.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:13.962+0000 7f520affd640 1 -- 172.21.15.55:0/3924495241 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f51fc050e10 con 0x7f52140ad780 2023-08-25T04:18:14.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.118+0000 7f521359e640 1 -- 172.21.15.55:0/3924495241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5214153820 con 0x7f52140ad780 2023-08-25T04:18:14.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.782+0000 7f520affd640 1 -- 172.21.15.55:0/3924495241 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v70) v1 ==== 169+0+0 (secure 0 0 0) 0x7f51fc007380 con 0x7f52140ad780 2023-08-25T04:18:14.783 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-08-25T04:18:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.786+0000 7f521359e640 1 -- 172.21.15.55:0/3924495241 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f51f40657a0 msgr2=0x7f51f4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.786+0000 7f521359e640 1 --2- 172.21.15.55:0/3924495241 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f51f40657a0 0x7f51f4067c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f52140c1620 tx=0x7f5204009040 comp rx=0 tx=0).stop 2023-08-25T04:18:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.786+0000 7f521359e640 1 -- 172.21.15.55:0/3924495241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52140ad780 msgr2=0x7f52141594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.786+0000 7f521359e640 1 --2- 172.21.15.55:0/3924495241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52140ad780 0x7f52141594e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00d5f0 tx=0x7f51fc00dab0 comp rx=0 tx=0).stop 2023-08-25T04:18:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.786+0000 7f521359e640 1 -- 172.21.15.55:0/3924495241 shutdown_connections 2023-08-25T04:18:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.786+0000 7f521359e640 1 --2- 172.21.15.55:0/3924495241 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f51f40657a0 0x7f51f4067c60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.786+0000 7f521359e640 1 --2- 172.21.15.55:0/3924495241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52140b0660 0x7f521414e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.786+0000 7f521359e640 1 --2- 172.21.15.55:0/3924495241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52140ad780 0x7f52141594e0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.786+0000 7f521359e640 1 --2- 172.21.15.55:0/3924495241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f521406c390 0x7f5214158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.786+0000 7f521359e640 1 -- 172.21.15.55:0/3924495241 >> 172.21.15.55:0/3924495241 conn(0x7f52140cac50 msgr2=0x7f52140cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.786+0000 7f521359e640 1 -- 172.21.15.55:0/3924495241 shutdown_connections 2023-08-25T04:18:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.786+0000 7f521359e640 1 -- 172.21.15.55:0/3924495241 wait complete. 2023-08-25T04:18:14.810 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-08-25T04:18:14.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.958+0000 7f6d5e758640 1 Processor -- start 2023-08-25T04:18:14.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.958+0000 7f6d5e758640 1 -- start start 2023-08-25T04:18:14.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.958+0000 7f6d5e758640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6d580cfc90 0x7f6d580b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:14.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.958+0000 7f6d5e758640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6d580b8330 0x7f6d580b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:14.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.958+0000 7f6d5e758640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d580b70c0 con 0x7f6d5815fca0 2023-08-25T04:18:14.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.958+0000 7f6d5e758640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d58160080 con 0x7f6d580b8330 2023-08-25T04:18:14.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.958+0000 7f6d5e758640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d580b73a0 con 0x7f6d580cfc90 2023-08-25T04:18:14.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.958+0000 7f6d5d756640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6d5815fca0 0x7f6d580cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54994/0 (socket says 172.21.15.55:54994) 2023-08-25T04:18:14.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.958+0000 7f6d5d756640 1 -- 172.21.15.55:0/1159719948 learned_addr learned my addr 172.21.15.55:0/1159719948 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:14.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.962+0000 7f6d5df57640 1 --2- 172.21.15.55:0/1159719948 >> v2:172.21.15.55:3300/0 conn(0x7f6d580b8330 0x7f6d580b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:14.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.962+0000 7f6d5cf55640 1 --2- 172.21.15.55:0/1159719948 >> v2:172.21.15.110:3300/0 conn(0x7f6d580cfc90 0x7f6d580b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:14.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.962+0000 7f6d4ffff640 1 -- 172.21.15.55:0/1159719948 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2952382436 0 0) 0x7f6d580b70c0 con 0x7f6d5815fca0 2023-08-25T04:18:14.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.962+0000 7f6d4ffff640 1 -- 172.21.15.55:0/1159719948 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d44003530 con 0x7f6d5815fca0 2023-08-25T04:18:14.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.962+0000 7f6d5df57640 1 -- 172.21.15.55:0/1159719948 >> v2:172.21.15.110:3300/0 conn(0x7f6d580cfc90 msgr2=0x7f6d580b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:14.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.962+0000 7f6d5df57640 1 --2- 172.21.15.55:0/1159719948 >> v2:172.21.15.110:3300/0 conn(0x7f6d580cfc90 0x7f6d580b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:14.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.962+0000 7f6d5df57640 1 -- 172.21.15.55:0/1159719948 >> v1:172.21.15.55:6789/0 conn(0x7f6d5815fca0 legacy=0x7f6d580cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:14.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.962+0000 7f6d5df57640 1 -- 172.21.15.55:0/1159719948 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d580b7680 con 0x7f6d580b8330 2023-08-25T04:18:14.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.962+0000 7f6d5df57640 1 --2- 172.21.15.55:0/1159719948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d580b8330 0x7f6d580b5b10 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f6d580b41a0 tx=0x7f6d5001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958824e8644009a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:14.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.962+0000 7f6d4ffff640 1 -- 172.21.15.55:0/1159719948 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500b0440 con 0x7f6d580b8330 2023-08-25T04:18:14.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.962+0000 7f6d4ffff640 1 -- 172.21.15.55:0/1159719948 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d500b05a0 con 0x7f6d580b8330 2023-08-25T04:18:14.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.962+0000 7f6d4ffff640 1 -- 172.21.15.55:0/1159719948 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500b0930 con 0x7f6d580b8330 2023-08-25T04:18:14.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5e758640 1 -- 172.21.15.55:0/1159719948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d580b8330 msgr2=0x7f6d580b5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:14.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5e758640 1 --2- 172.21.15.55:0/1159719948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d580b8330 0x7f6d580b5b10 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f6d580b41a0 tx=0x7f6d5001f0f0 comp rx=0 tx=0).stop 2023-08-25T04:18:14.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5e758640 1 -- 172.21.15.55:0/1159719948 shutdown_connections 2023-08-25T04:18:14.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5e758640 1 --2- 172.21.15.55:0/1159719948 >> v2:172.21.15.110:3300/0 conn(0x7f6d580cfc90 0x7f6d580b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:14.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5e758640 1 --2- 172.21.15.55:0/1159719948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d580b8330 0x7f6d580b5b10 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:14.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5e758640 1 -- 172.21.15.55:0/1159719948 >> 172.21.15.55:0/1159719948 conn(0x7f6d580658c0 msgr2=0x7f6d58065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:14.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5e758640 1 -- 172.21.15.55:0/1159719948 shutdown_connections 2023-08-25T04:18:14.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5e758640 1 -- 172.21.15.55:0/1159719948 wait complete. 2023-08-25T04:18:14.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5e758640 1 Processor -- start 2023-08-25T04:18:14.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5e758640 1 -- start start 2023-08-25T04:18:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5e758640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d580b8330 0x7f6d581f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5e758640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d580cfc90 0x7f6d5815af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5e758640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d5815fca0 0x7f6d5814c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5e758640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d58158e70 con 0x7f6d5815fca0 2023-08-25T04:18:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5e758640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d581525d0 con 0x7f6d580b8330 2023-08-25T04:18:14.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5e758640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d581528b0 con 0x7f6d580cfc90 2023-08-25T04:18:14.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5df57640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d5815fca0 0x7f6d5814c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:14.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5df57640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d5815fca0 0x7f6d5814c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56638/0 (socket says 172.21.15.55:56638) 2023-08-25T04:18:14.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5df57640 1 -- 172.21.15.55:0/2726107723 learned_addr learned my addr 172.21.15.55:0/2726107723 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:14.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5d756640 1 --2- 172.21.15.55:0/2726107723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d580b8330 0x7f6d581f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:14.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5cf55640 1 --2- 172.21.15.55:0/2726107723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d580cfc90 0x7f6d5815af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:14.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5df57640 1 -- 172.21.15.55:0/2726107723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d580cfc90 msgr2=0x7f6d5815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:14.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5df57640 1 --2- 172.21.15.55:0/2726107723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d580cfc90 0x7f6d5815af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:14.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5df57640 1 -- 172.21.15.55:0/2726107723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d580b8330 msgr2=0x7f6d581f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:14.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5df57640 1 --2- 172.21.15.55:0/2726107723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d580b8330 0x7f6d581f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:14.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5df57640 1 -- 172.21.15.55:0/2726107723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d50009a70 con 0x7f6d5815fca0 2023-08-25T04:18:14.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5cf55640 1 --2- 172.21.15.55:0/2726107723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d580cfc90 0x7f6d5815af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:14.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.966+0000 7f6d5d756640 1 --2- 172.21.15.55:0/2726107723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d580b8330 0x7f6d581f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:14.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.970+0000 7f6d5df57640 1 --2- 172.21.15.55:0/2726107723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d5815fca0 0x7f6d5814c520 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f6d5001bd00 tx=0x7f6d5001be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:14.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.970+0000 7f6d4dffb640 1 -- 172.21.15.55:0/2726107723 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500b0440 con 0x7f6d5815fca0 2023-08-25T04:18:14.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.970+0000 7f6d4dffb640 1 -- 172.21.15.55:0/2726107723 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d500bc650 con 0x7f6d5815fca0 2023-08-25T04:18:14.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.970+0000 7f6d5e758640 1 -- 172.21.15.55:0/2726107723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d581590c0 con 0x7f6d5815fca0 2023-08-25T04:18:14.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.970+0000 7f6d4dffb640 1 -- 172.21.15.55:0/2726107723 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500bca00 con 0x7f6d5815fca0 2023-08-25T04:18:14.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.970+0000 7f6d5e758640 1 -- 172.21.15.55:0/2726107723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5815b4d0 con 0x7f6d5815fca0 2023-08-25T04:18:14.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.970+0000 7f6d5e758640 1 -- 172.21.15.55:0/2726107723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d58073e50 con 0x7f6d5815fca0 2023-08-25T04:18:14.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.970+0000 7f6d4dffb640 1 -- 172.21.15.55:0/2726107723 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f6d500bcb60 con 0x7f6d5815fca0 2023-08-25T04:18:14.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.970+0000 7f6d4dffb640 1 --2- 172.21.15.55:0/2726107723 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f6d3c0657a0 0x7f6d3c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:14.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.970+0000 7f6d4dffb640 1 -- 172.21.15.55:0/2726107723 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f6d50121d40 con 0x7f6d5815fca0 2023-08-25T04:18:14.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.970+0000 7f6d5d756640 1 --2- 172.21.15.55:0/2726107723 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f6d3c0657a0 0x7f6d3c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:14.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.974+0000 7f6d5d756640 1 --2- 172.21.15.55:0/2726107723 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f6d3c0657a0 0x7f6d3c067c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6d540011f0 tx=0x7f6d54009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:14.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:14.974+0000 7f6d4dffb640 1 -- 172.21.15.55:0/2726107723 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6d500ef870 con 0x7f6d5815fca0 2023-08-25T04:18:15.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.130+0000 7f6d5e758640 1 -- 172.21.15.55:0/2726107723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f6d580b7930 con 0x7f6d5815fca0 2023-08-25T04:18:15.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.134+0000 7f6d4dffb640 1 -- 172.21.15.55:0/2726107723 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v19) v1 ==== 115+0+0 (secure 0 0 0) 0x7f6d50009450 con 0x7f6d5815fca0 2023-08-25T04:18:15.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.138+0000 7f6d5e758640 1 -- 172.21.15.55:0/2726107723 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f6d3c0657a0 msgr2=0x7f6d3c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:15.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.138+0000 7f6d5e758640 1 --2- 172.21.15.55:0/2726107723 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f6d3c0657a0 0x7f6d3c067c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6d540011f0 tx=0x7f6d54009040 comp rx=0 tx=0).stop 2023-08-25T04:18:15.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.138+0000 7f6d5e758640 1 -- 172.21.15.55:0/2726107723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d5815fca0 msgr2=0x7f6d5814c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:15.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.138+0000 7f6d5e758640 1 --2- 172.21.15.55:0/2726107723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d5815fca0 0x7f6d5814c520 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f6d5001bd00 tx=0x7f6d5001be90 comp rx=0 tx=0).stop 2023-08-25T04:18:15.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.138+0000 7f6d5e758640 1 -- 172.21.15.55:0/2726107723 shutdown_connections 2023-08-25T04:18:15.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.138+0000 7f6d5e758640 1 --2- 172.21.15.55:0/2726107723 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f6d3c0657a0 0x7f6d3c067c60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.138+0000 7f6d5e758640 1 --2- 172.21.15.55:0/2726107723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d5815fca0 0x7f6d5814c520 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.138+0000 7f6d5e758640 1 --2- 172.21.15.55:0/2726107723 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d580cfc90 0x7f6d5815af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.138+0000 7f6d5e758640 1 --2- 172.21.15.55:0/2726107723 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d580b8330 0x7f6d581f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.138+0000 7f6d5e758640 1 -- 172.21.15.55:0/2726107723 >> 172.21.15.55:0/2726107723 conn(0x7f6d580658c0 msgr2=0x7f6d5815da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:15.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.138+0000 7f6d5e758640 1 -- 172.21.15.55:0/2726107723 shutdown_connections 2023-08-25T04:18:15.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.138+0000 7f6d5e758640 1 -- 172.21.15.55:0/2726107723 wait complete. 2023-08-25T04:18:15.157 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-25T04:18:15.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.302+0000 7fe180ae5640 1 Processor -- start 2023-08-25T04:18:15.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.302+0000 7fe180ae5640 1 -- start start 2023-08-25T04:18:15.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.306+0000 7fe180ae5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe17c1601f0 0x7fe17c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:15.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.306+0000 7fe180ae5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe17c0d1290 0x7fe17c15e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:15.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.306+0000 7fe180ae5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c0cd5a0 con 0x7fe17c15e3c0 2023-08-25T04:18:15.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.306+0000 7fe180ae5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17c0cd880 con 0x7fe17c1601f0 2023-08-25T04:18:15.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.306+0000 7fe180ae5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17c0cdb60 con 0x7fe17c0d1290 2023-08-25T04:18:15.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.306+0000 7fe17a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe17c1601f0 0x7fe17c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:15.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.306+0000 7fe17a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe17c1601f0 0x7fe17c15d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56650/0 (socket says 172.21.15.55:56650) 2023-08-25T04:18:15.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.306+0000 7fe17a59c640 1 -- 172.21.15.55:0/1698106923 learned_addr learned my addr 172.21.15.55:0/1698106923 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:15.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.306+0000 7fe17ad9d640 1 --2- 172.21.15.55:0/1698106923 >> v2:172.21.15.110:3300/0 conn(0x7fe17c0d1290 0x7fe17c15e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:15.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.306+0000 7fe17a59c640 1 -- 172.21.15.55:0/1698106923 >> v2:172.21.15.110:3300/0 conn(0x7fe17c0d1290 msgr2=0x7fe17c15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:15.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.306+0000 7fe17a59c640 1 --2- 172.21.15.55:0/1698106923 >> v2:172.21.15.110:3300/0 conn(0x7fe17c0d1290 0x7fe17c15e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.306+0000 7fe17a59c640 1 -- 172.21.15.55:0/1698106923 >> v1:172.21.15.110:6789/0 conn(0x7fe17c15e3c0 legacy=0x7fe17c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.306+0000 7fe17a59c640 1 -- 172.21.15.55:0/1698106923 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c0cde40 con 0x7fe17c1601f0 2023-08-25T04:18:15.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.306+0000 7fe17ad9d640 1 --2- 172.21.15.55:0/1698106923 >> v2:172.21.15.110:3300/0 conn(0x7fe17c0d1290 0x7fe17c15e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:15.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.310+0000 7fe17a59c640 1 --2- 172.21.15.55:0/1698106923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe17c1601f0 0x7fe17c15d430 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0d2060 tx=0x7fe16c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef98758e4667bcf server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:15.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.310+0000 7fe179d9b640 1 -- 172.21.15.55:0/1698106923 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0ac410 con 0x7fe17c1601f0 2023-08-25T04:18:15.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.310+0000 7fe179d9b640 1 -- 172.21.15.55:0/1698106923 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c0ac570 con 0x7fe17c1601f0 2023-08-25T04:18:15.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.310+0000 7fe179d9b640 1 -- 172.21.15.55:0/1698106923 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0ac900 con 0x7fe17c1601f0 2023-08-25T04:18:15.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.310+0000 7fe180ae5640 1 -- 172.21.15.55:0/1698106923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe17c1601f0 msgr2=0x7fe17c15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:15.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.310+0000 7fe180ae5640 1 --2- 172.21.15.55:0/1698106923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe17c1601f0 0x7fe17c15d430 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0d2060 tx=0x7fe16c01c490 comp rx=0 tx=0).stop 2023-08-25T04:18:15.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.310+0000 7fe180ae5640 1 -- 172.21.15.55:0/1698106923 shutdown_connections 2023-08-25T04:18:15.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.310+0000 7fe180ae5640 1 --2- 172.21.15.55:0/1698106923 >> v2:172.21.15.110:3300/0 conn(0x7fe17c0d1290 0x7fe17c15e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.310+0000 7fe180ae5640 1 --2- 172.21.15.55:0/1698106923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe17c1601f0 0x7fe17c15d430 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.310+0000 7fe180ae5640 1 -- 172.21.15.55:0/1698106923 >> 172.21.15.55:0/1698106923 conn(0x7fe17c0d27d0 msgr2=0x7fe17c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:15.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.310+0000 7fe180ae5640 1 -- 172.21.15.55:0/1698106923 shutdown_connections 2023-08-25T04:18:15.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.310+0000 7fe180ae5640 1 -- 172.21.15.55:0/1698106923 wait complete. 2023-08-25T04:18:15.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.310+0000 7fe180ae5640 1 Processor -- start 2023-08-25T04:18:15.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.310+0000 7fe180ae5640 1 -- start start 2023-08-25T04:18:15.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.310+0000 7fe180ae5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe17c0d1290 0x7fe17c158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:15.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe180ae5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe17c15e3c0 0x7fe17c1503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:15.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe180ae5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe17c1601f0 0x7fe17c1597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:15.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe180ae5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c158090 con 0x7fe17c1601f0 2023-08-25T04:18:15.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe180ae5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c15a0c0 con 0x7fe17c0d1290 2023-08-25T04:18:15.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe180ae5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c1582e0 con 0x7fe17c15e3c0 2023-08-25T04:18:15.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe17ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe17c1601f0 0x7fe17c1597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:15.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe17ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe17c1601f0 0x7fe17c1597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56656/0 (socket says 172.21.15.55:56656) 2023-08-25T04:18:15.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe17ad9d640 1 -- 172.21.15.55:0/780337450 learned_addr learned my addr 172.21.15.55:0/780337450 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:15.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe17a59c640 1 --2- 172.21.15.55:0/780337450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe17c0d1290 0x7fe17c158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:15.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe173fff640 1 --2- 172.21.15.55:0/780337450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe17c15e3c0 0x7fe17c1503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:15.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe17ad9d640 1 -- 172.21.15.55:0/780337450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe17c15e3c0 msgr2=0x7fe17c1503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:15.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe17ad9d640 1 --2- 172.21.15.55:0/780337450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe17c15e3c0 0x7fe17c1503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe17ad9d640 1 -- 172.21.15.55:0/780337450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe17c0d1290 msgr2=0x7fe17c158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:15.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe17ad9d640 1 --2- 172.21.15.55:0/780337450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe17c0d1290 0x7fe17c158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe17ad9d640 1 -- 172.21.15.55:0/780337450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c009480 con 0x7fe17c1601f0 2023-08-25T04:18:15.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe17ad9d640 1 --2- 172.21.15.55:0/780337450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe17c1601f0 0x7fe17c1597e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fe17400cef0 tx=0x7fe17400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:15.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe172ffd640 1 -- 172.21.15.55:0/780337450 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17400d840 con 0x7fe17c1601f0 2023-08-25T04:18:15.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe172ffd640 1 -- 172.21.15.55:0/780337450 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17400d9c0 con 0x7fe17c1601f0 2023-08-25T04:18:15.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe180ae5640 1 -- 172.21.15.55:0/780337450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c1585c0 con 0x7fe17c1601f0 2023-08-25T04:18:15.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe172ffd640 1 -- 172.21.15.55:0/780337450 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17400dd70 con 0x7fe17c1601f0 2023-08-25T04:18:15.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe180ae5640 1 -- 172.21.15.55:0/780337450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c1508e0 con 0x7fe17c1601f0 2023-08-25T04:18:15.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe180ae5640 1 -- 172.21.15.55:0/780337450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c0b5260 con 0x7fe17c1601f0 2023-08-25T04:18:15.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.314+0000 7fe172ffd640 1 -- 172.21.15.55:0/780337450 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fe17401e3b0 con 0x7fe17c1601f0 2023-08-25T04:18:15.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.318+0000 7fe172ffd640 1 --2- 172.21.15.55:0/780337450 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe15c0657a0 0x7fe15c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:15.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.318+0000 7fe172ffd640 1 -- 172.21.15.55:0/780337450 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fe174083850 con 0x7fe17c1601f0 2023-08-25T04:18:15.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.318+0000 7fe17a59c640 1 --2- 172.21.15.55:0/780337450 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe15c0657a0 0x7fe15c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:15.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.318+0000 7fe17a59c640 1 --2- 172.21.15.55:0/780337450 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe15c0657a0 0x7fe15c067c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0ae000 tx=0x7fe16c0a6040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:15.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.322+0000 7fe172ffd640 1 -- 172.21.15.55:0/780337450 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe174051450 con 0x7fe17c1601f0 2023-08-25T04:18:15.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.478+0000 7fe180ae5640 1 -- 172.21.15.55:0/780337450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fe17c158ae0 con 0x7fe17c1601f0 2023-08-25T04:18:15.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.482+0000 7fe172ffd640 1 -- 172.21.15.55:0/780337450 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v20) v1 ==== 120+0+0 (secure 0 0 0) 0x7fe17c158ae0 con 0x7fe17c1601f0 2023-08-25T04:18:15.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.486+0000 7fe180ae5640 1 -- 172.21.15.55:0/780337450 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe15c0657a0 msgr2=0x7fe15c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:15.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.486+0000 7fe180ae5640 1 --2- 172.21.15.55:0/780337450 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe15c0657a0 0x7fe15c067c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0ae000 tx=0x7fe16c0a6040 comp rx=0 tx=0).stop 2023-08-25T04:18:15.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.486+0000 7fe180ae5640 1 -- 172.21.15.55:0/780337450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe17c1601f0 msgr2=0x7fe17c1597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:15.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.486+0000 7fe180ae5640 1 --2- 172.21.15.55:0/780337450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe17c1601f0 0x7fe17c1597e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fe17400cef0 tx=0x7fe17400a710 comp rx=0 tx=0).stop 2023-08-25T04:18:15.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.486+0000 7fe180ae5640 1 -- 172.21.15.55:0/780337450 shutdown_connections 2023-08-25T04:18:15.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.486+0000 7fe180ae5640 1 --2- 172.21.15.55:0/780337450 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe15c0657a0 0x7fe15c067c60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.486+0000 7fe180ae5640 1 --2- 172.21.15.55:0/780337450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe17c1601f0 0x7fe17c1597e0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.486+0000 7fe180ae5640 1 --2- 172.21.15.55:0/780337450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe17c15e3c0 0x7fe17c1503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.486+0000 7fe180ae5640 1 --2- 172.21.15.55:0/780337450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe17c0d1290 0x7fe17c158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.486+0000 7fe180ae5640 1 -- 172.21.15.55:0/780337450 >> 172.21.15.55:0/780337450 conn(0x7fe17c0d27d0 msgr2=0x7fe17c0b5630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:15.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.486+0000 7fe180ae5640 1 -- 172.21.15.55:0/780337450 shutdown_connections 2023-08-25T04:18:15.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.486+0000 7fe180ae5640 1 -- 172.21.15.55:0/780337450 wait complete. 2023-08-25T04:18:15.503 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-25T04:18:15.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.650+0000 7fe35dde9640 1 Processor -- start 2023-08-25T04:18:15.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.650+0000 7fe35dde9640 1 -- start start 2023-08-25T04:18:15.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.650+0000 7fe35dde9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe3580c9830 0x7fe35809bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:15.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.650+0000 7fe35dde9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35815abd0 con 0x7fe35815a7f0 2023-08-25T04:18:15.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.650+0000 7fe35dde9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3580c8ab0 con 0x7fe35806c020 2023-08-25T04:18:15.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.650+0000 7fe35dde9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3580c8d50 con 0x7fe3580c9830 2023-08-25T04:18:15.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.650+0000 7fe34ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe3580c9830 0x7fe35809bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:15.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.650+0000 7fe34ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe3580c9830 0x7fe35809bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56670/0 (socket says 172.21.15.55:56670) 2023-08-25T04:18:15.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.650+0000 7fe34ffff640 1 -- 172.21.15.55:0/2503700959 learned_addr learned my addr 172.21.15.55:0/2503700959 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:15.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.650+0000 7fe34ffff640 1 -- 172.21.15.55:0/2503700959 >> v1:172.21.15.110:6789/0 conn(0x7fe35806c020 legacy=0x7fe3580acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:15.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.650+0000 7fe34ffff640 1 -- 172.21.15.55:0/2503700959 >> v1:172.21.15.55:6789/0 conn(0x7fe35815a7f0 legacy=0x7fe358070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:15.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.650+0000 7fe34ffff640 1 -- 172.21.15.55:0/2503700959 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3580c9030 con 0x7fe3580c9830 2023-08-25T04:18:15.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.650+0000 7fe356ffd640 1 -- 172.21.15.55:0/2503700959 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892698987 0 0) 0x7fe35815abd0 con 0x7fe35815a7f0 2023-08-25T04:18:15.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.654+0000 7fe34ffff640 1 --2- 172.21.15.55:0/2503700959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3580c9830 0x7fe35809bde0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe340009870 tx=0x7fe34001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9dd09be560d21 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:15.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.654+0000 7fe356ffd640 1 -- 172.21.15.55:0/2503700959 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3400ab620 con 0x7fe3580c9830 2023-08-25T04:18:15.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.654+0000 7fe356ffd640 1 -- 172.21.15.55:0/2503700959 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3400ab780 con 0x7fe3580c9830 2023-08-25T04:18:15.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.654+0000 7fe356ffd640 1 -- 172.21.15.55:0/2503700959 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3400abb10 con 0x7fe3580c9830 2023-08-25T04:18:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.654+0000 7fe35dde9640 1 -- 172.21.15.55:0/2503700959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3580c9830 msgr2=0x7fe35809bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.654+0000 7fe35dde9640 1 --2- 172.21.15.55:0/2503700959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3580c9830 0x7fe35809bde0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe340009870 tx=0x7fe34001c510 comp rx=0 tx=0).stop 2023-08-25T04:18:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.654+0000 7fe35dde9640 1 -- 172.21.15.55:0/2503700959 shutdown_connections 2023-08-25T04:18:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.654+0000 7fe35dde9640 1 --2- 172.21.15.55:0/2503700959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3580c9830 0x7fe35809bde0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.654+0000 7fe35dde9640 1 -- 172.21.15.55:0/2503700959 >> 172.21.15.55:0/2503700959 conn(0x7fe358069900 msgr2=0x7fe358069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.654+0000 7fe35dde9640 1 -- 172.21.15.55:0/2503700959 shutdown_connections 2023-08-25T04:18:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.654+0000 7fe35dde9640 1 -- 172.21.15.55:0/2503700959 wait complete. 2023-08-25T04:18:15.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe35dde9640 1 Processor -- start 2023-08-25T04:18:15.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe35dde9640 1 -- start start 2023-08-25T04:18:15.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe35dde9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe35806c020 0x7fe358153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe35dde9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3580c9830 0x7fe358153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe35dde9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe35815a7f0 0x7fe358144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe35dde9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe358152e80 con 0x7fe35815a7f0 2023-08-25T04:18:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe35dde9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580b3370 con 0x7fe35806c020 2023-08-25T04:18:15.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe35dde9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe358154d50 con 0x7fe3580c9830 2023-08-25T04:18:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe357fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe35815a7f0 0x7fe358144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe357fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe35815a7f0 0x7fe358144be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56682/0 (socket says 172.21.15.55:56682) 2023-08-25T04:18:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe357fff640 1 -- 172.21.15.55:0/3207374498 learned_addr learned my addr 172.21.15.55:0/3207374498 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:15.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe34ffff640 1 --2- 172.21.15.55:0/3207374498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3580c9830 0x7fe358153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe3577fe640 1 --2- 172.21.15.55:0/3207374498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe35806c020 0x7fe358153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe357fff640 1 -- 172.21.15.55:0/3207374498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3580c9830 msgr2=0x7fe358153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe357fff640 1 --2- 172.21.15.55:0/3207374498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3580c9830 0x7fe358153600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe357fff640 1 -- 172.21.15.55:0/3207374498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe35806c020 msgr2=0x7fe358153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe357fff640 1 --2- 172.21.15.55:0/3207374498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe35806c020 0x7fe358153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe357fff640 1 -- 172.21.15.55:0/3207374498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3400094d0 con 0x7fe35815a7f0 2023-08-25T04:18:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe3577fe640 1 --2- 172.21.15.55:0/3207374498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe35806c020 0x7fe358153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:15.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe357fff640 1 --2- 172.21.15.55:0/3207374498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe35815a7f0 0x7fe358144be0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe35000c730 tx=0x7fe35000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:15.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe354ff9640 1 -- 172.21.15.55:0/3207374498 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe350003b80 con 0x7fe35815a7f0 2023-08-25T04:18:15.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe354ff9640 1 -- 172.21.15.55:0/3207374498 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe350003ce0 con 0x7fe35815a7f0 2023-08-25T04:18:15.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe354ff9640 1 -- 172.21.15.55:0/3207374498 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe350005310 con 0x7fe35815a7f0 2023-08-25T04:18:15.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe35dde9640 1 -- 172.21.15.55:0/3207374498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3580adc90 con 0x7fe35815a7f0 2023-08-25T04:18:15.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.658+0000 7fe35dde9640 1 -- 172.21.15.55:0/3207374498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3580b3980 con 0x7fe35815a7f0 2023-08-25T04:18:15.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.662+0000 7fe35dde9640 1 -- 172.21.15.55:0/3207374498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe35806d5b0 con 0x7fe35815a7f0 2023-08-25T04:18:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.662+0000 7fe354ff9640 1 -- 172.21.15.55:0/3207374498 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fe350005680 con 0x7fe35815a7f0 2023-08-25T04:18:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.662+0000 7fe354ff9640 1 --2- 172.21.15.55:0/3207374498 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe3380657a0 0x7fe338067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.662+0000 7fe354ff9640 1 -- 172.21.15.55:0/3207374498 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fe350082e50 con 0x7fe35815a7f0 2023-08-25T04:18:15.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.662+0000 7fe3577fe640 1 --2- 172.21.15.55:0/3207374498 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe3380657a0 0x7fe338067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:15.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.662+0000 7fe3577fe640 1 --2- 172.21.15.55:0/3207374498 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe3380657a0 0x7fe338067c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe348000fe0 tx=0x7fe348009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:15.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.666+0000 7fe354ff9640 1 -- 172.21.15.55:0/3207374498 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe3500507d0 con 0x7fe35815a7f0 2023-08-25T04:18:15.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.826+0000 7fe35dde9640 1 -- 172.21.15.55:0/3207374498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe3580b31d0 con 0x7fe35815a7f0 2023-08-25T04:18:15.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.830+0000 7fe354ff9640 1 -- 172.21.15.55:0/3207374498 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe3580b31d0 con 0x7fe35815a7f0 2023-08-25T04:18:15.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.830+0000 7fe35dde9640 1 -- 172.21.15.55:0/3207374498 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe3380657a0 msgr2=0x7fe338067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:15.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.830+0000 7fe35dde9640 1 --2- 172.21.15.55:0/3207374498 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe3380657a0 0x7fe338067c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe348000fe0 tx=0x7fe348009040 comp rx=0 tx=0).stop 2023-08-25T04:18:15.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.830+0000 7fe35dde9640 1 -- 172.21.15.55:0/3207374498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe35815a7f0 msgr2=0x7fe358144be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:15.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.830+0000 7fe35dde9640 1 --2- 172.21.15.55:0/3207374498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe35815a7f0 0x7fe358144be0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe35000c730 tx=0x7fe35000cbf0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.830+0000 7fe35dde9640 1 -- 172.21.15.55:0/3207374498 shutdown_connections 2023-08-25T04:18:15.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.830+0000 7fe35dde9640 1 --2- 172.21.15.55:0/3207374498 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe3380657a0 0x7fe338067c60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.830+0000 7fe35dde9640 1 --2- 172.21.15.55:0/3207374498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe35815a7f0 0x7fe358144be0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.830+0000 7fe35dde9640 1 --2- 172.21.15.55:0/3207374498 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3580c9830 0x7fe358153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.830+0000 7fe35dde9640 1 --2- 172.21.15.55:0/3207374498 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe35806c020 0x7fe358153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:15.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.830+0000 7fe35dde9640 1 -- 172.21.15.55:0/3207374498 >> 172.21.15.55:0/3207374498 conn(0x7fe358069900 msgr2=0x7fe3580cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:15.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.830+0000 7fe35dde9640 1 -- 172.21.15.55:0/3207374498 shutdown_connections 2023-08-25T04:18:15.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.830+0000 7fe35dde9640 1 -- 172.21.15.55:0/3207374498 wait complete. 2023-08-25T04:18:15.854 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-08-25T04:18:15.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.998+0000 7fbe6ad03640 1 Processor -- start 2023-08-25T04:18:15.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.998+0000 7fbe6ad03640 1 -- start start 2023-08-25T04:18:15.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.998+0000 7fbe6ad03640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbe640cdde0 0x7fbe640ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:15.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.998+0000 7fbe6ad03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe640b2e40 0x7fbe640b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:15.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.998+0000 7fbe6ad03640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe640b29b0 con 0x7fbe640d0da0 2023-08-25T04:18:15.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.998+0000 7fbe6ad03640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe640ce760 con 0x7fbe640cdde0 2023-08-25T04:18:15.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.998+0000 7fbe6ad03640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe640b1dc0 con 0x7fbe640b2e40 2023-08-25T04:18:15.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.998+0000 7fbe5bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbe640cdde0 0x7fbe640ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:15.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.998+0000 7fbe68a9f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbe640d0da0 0x7fbe640d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55016/0 (socket says 172.21.15.55:55016) 2023-08-25T04:18:16.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.998+0000 7fbe68a9f640 1 -- 172.21.15.55:0/2775137704 learned_addr learned my addr 172.21.15.55:0/2775137704 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:16.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.998+0000 7fbe692a0640 1 --2- 172.21.15.55:0/2775137704 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe640b2e40 0x7fbe640b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:16.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.998+0000 7fbe5bfff640 1 -- 172.21.15.55:0/2775137704 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe640b2e40 msgr2=0x7fbe640b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:16.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.998+0000 7fbe5bfff640 1 --2- 172.21.15.55:0/2775137704 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe640b2e40 0x7fbe640b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:16.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.998+0000 7fbe5bfff640 1 -- 172.21.15.55:0/2775137704 >> v1:172.21.15.55:6789/0 conn(0x7fbe640d0da0 legacy=0x7fbe640d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:16.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.998+0000 7fbe5bfff640 1 -- 172.21.15.55:0/2775137704 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe640b2080 con 0x7fbe640cdde0 2023-08-25T04:18:16.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:15.998+0000 7fbe5b7fe640 1 -- 172.21.15.55:0/2775137704 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3027207979 0 0) 0x7fbe640b29b0 con 0x7fbe640d0da0 2023-08-25T04:18:16.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.002+0000 7fbe5bfff640 1 --2- 172.21.15.55:0/2775137704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe640cdde0 0x7fbe640ce220 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fbe540097c0 tx=0x7fbe5401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22040ff5e957e3a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:16.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.002+0000 7fbe5b7fe640 1 -- 172.21.15.55:0/2775137704 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe540a8970 con 0x7fbe640cdde0 2023-08-25T04:18:16.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.002+0000 7fbe5b7fe640 1 -- 172.21.15.55:0/2775137704 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe540a8ad0 con 0x7fbe640cdde0 2023-08-25T04:18:16.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.002+0000 7fbe5b7fe640 1 -- 172.21.15.55:0/2775137704 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe540a8e60 con 0x7fbe640cdde0 2023-08-25T04:18:16.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.002+0000 7fbe6ad03640 1 -- 172.21.15.55:0/2775137704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe640cdde0 msgr2=0x7fbe640ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:16.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.002+0000 7fbe6ad03640 1 --2- 172.21.15.55:0/2775137704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe640cdde0 0x7fbe640ce220 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fbe540097c0 tx=0x7fbe5401ec70 comp rx=0 tx=0).stop 2023-08-25T04:18:16.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.002+0000 7fbe6ad03640 1 -- 172.21.15.55:0/2775137704 shutdown_connections 2023-08-25T04:18:16.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.002+0000 7fbe6ad03640 1 --2- 172.21.15.55:0/2775137704 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe640b2e40 0x7fbe640b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:16.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.002+0000 7fbe6ad03640 1 --2- 172.21.15.55:0/2775137704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe640cdde0 0x7fbe640ce220 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:16.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.002+0000 7fbe6ad03640 1 -- 172.21.15.55:0/2775137704 >> 172.21.15.55:0/2775137704 conn(0x7fbe6409bae0 msgr2=0x7fbe640d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:16.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.002+0000 7fbe6ad03640 1 -- 172.21.15.55:0/2775137704 shutdown_connections 2023-08-25T04:18:16.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.002+0000 7fbe6ad03640 1 -- 172.21.15.55:0/2775137704 wait complete. 2023-08-25T04:18:16.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe6ad03640 1 Processor -- start 2023-08-25T04:18:16.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe6ad03640 1 -- start start 2023-08-25T04:18:16.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe6ad03640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe640b2e40 0x7fbe641f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:16.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe6ad03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe640cdde0 0x7fbe6415de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:16.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe6ad03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe640d0da0 0x7fbe641f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:16.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe6ad03640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe64152500 con 0x7fbe640d0da0 2023-08-25T04:18:16.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe6ad03640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe640c8b50 con 0x7fbe640b2e40 2023-08-25T04:18:16.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe6ad03640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe641f1e00 con 0x7fbe640cdde0 2023-08-25T04:18:16.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe692a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe640d0da0 0x7fbe641f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:16.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe692a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe640d0da0 0x7fbe641f5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56686/0 (socket says 172.21.15.55:56686) 2023-08-25T04:18:16.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe692a0640 1 -- 172.21.15.55:0/296332517 learned_addr learned my addr 172.21.15.55:0/296332517 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:16.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe5bfff640 1 --2- 172.21.15.55:0/296332517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe640cdde0 0x7fbe6415de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:16.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe68a9f640 1 --2- 172.21.15.55:0/296332517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe640b2e40 0x7fbe641f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:16.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe692a0640 1 -- 172.21.15.55:0/296332517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe640cdde0 msgr2=0x7fbe6415de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:16.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe692a0640 1 --2- 172.21.15.55:0/296332517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe640cdde0 0x7fbe6415de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:16.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe692a0640 1 -- 172.21.15.55:0/296332517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe640b2e40 msgr2=0x7fbe641f18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:16.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe692a0640 1 --2- 172.21.15.55:0/296332517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe640b2e40 0x7fbe641f18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:16.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe692a0640 1 -- 172.21.15.55:0/296332517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe54009420 con 0x7fbe640d0da0 2023-08-25T04:18:16.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe68a9f640 1 --2- 172.21.15.55:0/296332517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe640b2e40 0x7fbe641f18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:16.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe692a0640 1 --2- 172.21.15.55:0/296332517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe640d0da0 0x7fbe641f5530 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c007e60 tx=0x7fbe5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:16.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe597fa640 1 -- 172.21.15.55:0/296332517 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c014420 con 0x7fbe640d0da0 2023-08-25T04:18:16.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe597fa640 1 -- 172.21.15.55:0/296332517 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5c0145a0 con 0x7fbe640d0da0 2023-08-25T04:18:16.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe6ad03640 1 -- 172.21.15.55:0/296332517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe640c9a30 con 0x7fbe640d0da0 2023-08-25T04:18:16.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe597fa640 1 -- 172.21.15.55:0/296332517 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c014950 con 0x7fbe640d0da0 2023-08-25T04:18:16.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.006+0000 7fbe6ad03640 1 -- 172.21.15.55:0/296332517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe640c9ff0 con 0x7fbe640d0da0 2023-08-25T04:18:16.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.010+0000 7fbe6ad03640 1 -- 172.21.15.55:0/296332517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6404dbe0 con 0x7fbe640d0da0 2023-08-25T04:18:16.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.010+0000 7fbe597fa640 1 -- 172.21.15.55:0/296332517 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fbe5c014ab0 con 0x7fbe640d0da0 2023-08-25T04:18:16.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.010+0000 7fbe597fa640 1 --2- 172.21.15.55:0/296332517 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fbe500657a0 0x7fbe50067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:16.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.010+0000 7fbe597fa640 1 -- 172.21.15.55:0/296332517 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fbe5c083750 con 0x7fbe640d0da0 2023-08-25T04:18:16.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.010+0000 7fbe68a9f640 1 --2- 172.21.15.55:0/296332517 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fbe500657a0 0x7fbe50067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:16.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.014+0000 7fbe68a9f640 1 --2- 172.21.15.55:0/296332517 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fbe500657a0 0x7fbe50067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbe60007fd0 tx=0x7fbe60009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:16.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.014+0000 7fbe597fa640 1 -- 172.21.15.55:0/296332517 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbe5c054c70 con 0x7fbe640d0da0 2023-08-25T04:18:16.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.238+0000 7fbe6ad03640 1 -- 172.21.15.55:0/296332517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7fbe640d0b80 con 0x7fbe640d0da0 2023-08-25T04:18:16.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.790+0000 7fbe597fa640 1 -- 172.21.15.55:0/296332517 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v554) v1 ==== 154+0+0 (secure 0 0 0) 0x7fbe5c054800 con 0x7fbe640d0da0 2023-08-25T04:18:16.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.790+0000 7fbe6ad03640 1 -- 172.21.15.55:0/296332517 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fbe500657a0 msgr2=0x7fbe50067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:16.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.790+0000 7fbe6ad03640 1 --2- 172.21.15.55:0/296332517 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fbe500657a0 0x7fbe50067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbe60007fd0 tx=0x7fbe60009040 comp rx=0 tx=0).stop 2023-08-25T04:18:16.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.790+0000 7fbe6ad03640 1 -- 172.21.15.55:0/296332517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe640d0da0 msgr2=0x7fbe641f5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:16.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.790+0000 7fbe6ad03640 1 --2- 172.21.15.55:0/296332517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe640d0da0 0x7fbe641f5530 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c007e60 tx=0x7fbe5c00e4b0 comp rx=0 tx=0).stop 2023-08-25T04:18:16.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.794+0000 7fbe6ad03640 1 -- 172.21.15.55:0/296332517 shutdown_connections 2023-08-25T04:18:16.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.794+0000 7fbe6ad03640 1 --2- 172.21.15.55:0/296332517 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fbe500657a0 0x7fbe50067c60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.794+0000 7fbe6ad03640 1 --2- 172.21.15.55:0/296332517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe640d0da0 0x7fbe641f5530 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.794+0000 7fbe6ad03640 1 --2- 172.21.15.55:0/296332517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe640cdde0 0x7fbe6415de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.794+0000 7fbe6ad03640 1 --2- 172.21.15.55:0/296332517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe640b2e40 0x7fbe641f18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.794+0000 7fbe6ad03640 1 -- 172.21.15.55:0/296332517 >> 172.21.15.55:0/296332517 conn(0x7fbe6409bae0 msgr2=0x7fbe6415c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.794+0000 7fbe6ad03640 1 -- 172.21.15.55:0/296332517 shutdown_connections 2023-08-25T04:18:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.794+0000 7fbe6ad03640 1 -- 172.21.15.55:0/296332517 wait complete. 2023-08-25T04:18:16.815 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-08-25T04:18:16.815 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-08-25T04:18:16.816 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-25T04:18:16.818 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-08-25T04:18:16.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.970+0000 7f7e86fdf640 1 Processor -- start 2023-08-25T04:18:16.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.970+0000 7f7e86fdf640 1 -- start start 2023-08-25T04:18:16.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.970+0000 7f7e86fdf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e800d0da0 0x7f7e800d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:16.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.970+0000 7f7e86fdf640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e800b29b0 con 0x7f7e800b3e50 2023-08-25T04:18:16.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.970+0000 7f7e86fdf640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e800cfc80 con 0x7f7e800cdde0 2023-08-25T04:18:16.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.970+0000 7f7e86fdf640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e800d16c0 con 0x7f7e800d0da0 2023-08-25T04:18:16.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.970+0000 7f7e84d7b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e800d0da0 0x7f7e800d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:16.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.970+0000 7f7e8557c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7e800b3e50 0x7f7e800cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55024/0 (socket says 172.21.15.55:55024) 2023-08-25T04:18:16.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.970+0000 7f7e8557c640 1 -- 172.21.15.55:0/757563774 learned_addr learned my addr 172.21.15.55:0/757563774 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:16.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.970+0000 7f7e84d7b640 1 -- 172.21.15.55:0/757563774 >> v1:172.21.15.110:6789/0 conn(0x7f7e800cdde0 legacy=0x7f7e800cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:16.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.970+0000 7f7e84d7b640 1 -- 172.21.15.55:0/757563774 >> v1:172.21.15.55:6789/0 conn(0x7f7e800b3e50 legacy=0x7f7e800cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:16.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.970+0000 7f7e84d7b640 1 -- 172.21.15.55:0/757563774 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e800b1dc0 con 0x7f7e800d0da0 2023-08-25T04:18:16.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.974+0000 7f7e84d7b640 1 --2- 172.21.15.55:0/757563774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e800d0da0 0x7f7e800d1180 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009d80 tx=0x7f7e7c01f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ede59b69466cc3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:16.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.974+0000 7f7e777fe640 1 -- 172.21.15.55:0/757563774 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0af600 con 0x7f7e800d0da0 2023-08-25T04:18:16.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.974+0000 7f7e777fe640 1 -- 172.21.15.55:0/757563774 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c0ab050 con 0x7f7e800d0da0 2023-08-25T04:18:16.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.974+0000 7f7e777fe640 1 -- 172.21.15.55:0/757563774 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0af980 con 0x7f7e800d0da0 2023-08-25T04:18:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.974+0000 7f7e86fdf640 1 -- 172.21.15.55:0/757563774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e800d0da0 msgr2=0x7f7e800d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.974+0000 7f7e86fdf640 1 --2- 172.21.15.55:0/757563774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e800d0da0 0x7f7e800d1180 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009d80 tx=0x7f7e7c01f110 comp rx=0 tx=0).stop 2023-08-25T04:18:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.974+0000 7f7e86fdf640 1 -- 172.21.15.55:0/757563774 shutdown_connections 2023-08-25T04:18:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.974+0000 7f7e86fdf640 1 --2- 172.21.15.55:0/757563774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e800d0da0 0x7f7e800d1180 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.974+0000 7f7e86fdf640 1 -- 172.21.15.55:0/757563774 >> 172.21.15.55:0/757563774 conn(0x7f7e8009bae0 msgr2=0x7f7e800d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.974+0000 7f7e86fdf640 1 -- 172.21.15.55:0/757563774 shutdown_connections 2023-08-25T04:18:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.974+0000 7f7e86fdf640 1 -- 172.21.15.55:0/757563774 wait complete. 2023-08-25T04:18:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e86fdf640 1 Processor -- start 2023-08-25T04:18:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e86fdf640 1 -- start start 2023-08-25T04:18:16.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e86fdf640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e800b3e50 0x7f7e801f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:16.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e86fdf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e800cdde0 0x7f7e800cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:16.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e86fdf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e800d0da0 0x7f7e800cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:16.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e86fdf640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80152810 con 0x7f7e800cdde0 2023-08-25T04:18:16.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e86fdf640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8015f9f0 con 0x7f7e800d0da0 2023-08-25T04:18:16.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e86fdf640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8015ede0 con 0x7f7e800b3e50 2023-08-25T04:18:16.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e77fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e800cdde0 0x7f7e800cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:16.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e77fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e800cdde0 0x7f7e800cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56698/0 (socket says 172.21.15.55:56698) 2023-08-25T04:18:16.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e77fff640 1 -- 172.21.15.55:0/2630445833 learned_addr learned my addr 172.21.15.55:0/2630445833 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:16.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e84d7b640 1 --2- 172.21.15.55:0/2630445833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e800b3e50 0x7f7e801f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:16.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e8557c640 1 --2- 172.21.15.55:0/2630445833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e800d0da0 0x7f7e800cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:16.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e77fff640 1 -- 172.21.15.55:0/2630445833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e800b3e50 msgr2=0x7f7e801f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:16.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e77fff640 1 --2- 172.21.15.55:0/2630445833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e800b3e50 0x7f7e801f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:16.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e77fff640 1 -- 172.21.15.55:0/2630445833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e800d0da0 msgr2=0x7f7e800cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:16.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e77fff640 1 --2- 172.21.15.55:0/2630445833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e800d0da0 0x7f7e800cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:16.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e77fff640 1 -- 172.21.15.55:0/2630445833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c009a10 con 0x7f7e800cdde0 2023-08-25T04:18:16.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e77fff640 1 --2- 172.21.15.55:0/2630445833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e800cdde0 0x7f7e800cb330 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000c500 tx=0x7f7e7000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:16.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e757fa640 1 -- 172.21.15.55:0/2630445833 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70005220 con 0x7f7e800cdde0 2023-08-25T04:18:16.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e757fa640 1 -- 172.21.15.55:0/2630445833 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e70005380 con 0x7f7e800cdde0 2023-08-25T04:18:16.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e86fdf640 1 -- 172.21.15.55:0/2630445833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8015f0c0 con 0x7f7e800cdde0 2023-08-25T04:18:16.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e757fa640 1 -- 172.21.15.55:0/2630445833 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70007270 con 0x7f7e800cdde0 2023-08-25T04:18:16.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e86fdf640 1 -- 172.21.15.55:0/2630445833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8015f680 con 0x7f7e800cdde0 2023-08-25T04:18:16.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.978+0000 7f7e86fdf640 1 -- 172.21.15.55:0/2630445833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e8004dbe0 con 0x7f7e800cdde0 2023-08-25T04:18:16.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.982+0000 7f7e757fa640 1 -- 172.21.15.55:0/2630445833 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f7e700073d0 con 0x7f7e800cdde0 2023-08-25T04:18:16.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.982+0000 7f7e757fa640 1 --2- 172.21.15.55:0/2630445833 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f7e6c0657a0 0x7f7e6c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:16.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.982+0000 7f7e757fa640 1 -- 172.21.15.55:0/2630445833 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f7e70082750 con 0x7f7e800cdde0 2023-08-25T04:18:16.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.982+0000 7f7e84d7b640 1 --2- 172.21.15.55:0/2630445833 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f7e6c0657a0 0x7f7e6c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:16.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.982+0000 7f7e84d7b640 1 --2- 172.21.15.55:0/2630445833 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f7e6c0657a0 0x7f7e6c067c60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0b1000 tx=0x7f7e7c0aa000 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:16.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:16.986+0000 7f7e757fa640 1 -- 172.21.15.55:0/2630445833 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7e70050190 con 0x7f7e800cdde0 2023-08-25T04:18:17.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.194+0000 7f7e86fdf640 1 -- 172.21.15.55:0/2630445833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f7e800d0b80 con 0x7f7e800cdde0 2023-08-25T04:18:17.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.790+0000 7f7e757fa640 1 -- 172.21.15.55:0/2630445833 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v555) v1 ==== 159+0+0 (secure 0 0 0) 0x7f7e700537b0 con 0x7f7e800cdde0 2023-08-25T04:18:17.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.794+0000 7f7e86fdf640 1 -- 172.21.15.55:0/2630445833 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f7e6c0657a0 msgr2=0x7f7e6c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:17.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.794+0000 7f7e86fdf640 1 --2- 172.21.15.55:0/2630445833 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f7e6c0657a0 0x7f7e6c067c60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0b1000 tx=0x7f7e7c0aa000 comp rx=0 tx=0).stop 2023-08-25T04:18:17.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.794+0000 7f7e86fdf640 1 -- 172.21.15.55:0/2630445833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e800cdde0 msgr2=0x7f7e800cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:17.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.794+0000 7f7e86fdf640 1 --2- 172.21.15.55:0/2630445833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e800cdde0 0x7f7e800cb330 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000c500 tx=0x7f7e7000c9c0 comp rx=0 tx=0).stop 2023-08-25T04:18:17.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.794+0000 7f7e86fdf640 1 -- 172.21.15.55:0/2630445833 shutdown_connections 2023-08-25T04:18:17.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.794+0000 7f7e86fdf640 1 --2- 172.21.15.55:0/2630445833 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f7e6c0657a0 0x7f7e6c067c60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:17.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.794+0000 7f7e86fdf640 1 --2- 172.21.15.55:0/2630445833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e800d0da0 0x7f7e800cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:17.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.794+0000 7f7e86fdf640 1 --2- 172.21.15.55:0/2630445833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e800cdde0 0x7f7e800cb330 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:17.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.794+0000 7f7e86fdf640 1 --2- 172.21.15.55:0/2630445833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e800b3e50 0x7f7e801f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:17.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.794+0000 7f7e86fdf640 1 -- 172.21.15.55:0/2630445833 >> 172.21.15.55:0/2630445833 conn(0x7f7e8009bae0 msgr2=0x7f7e800b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:17.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.794+0000 7f7e86fdf640 1 -- 172.21.15.55:0/2630445833 shutdown_connections 2023-08-25T04:18:17.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.794+0000 7f7e86fdf640 1 -- 172.21.15.55:0/2630445833 wait complete. 2023-08-25T04:18:17.817 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:18:17.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.966+0000 7efe11703640 1 Processor -- start 2023-08-25T04:18:17.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.966+0000 7efe11703640 1 -- start start 2023-08-25T04:18:17.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.966+0000 7efe11703640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe0c158e10 0x7efe0c0b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:17.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.966+0000 7efe11703640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0c0cdbf0 con 0x7efe0c159f10 2023-08-25T04:18:17.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.966+0000 7efe11703640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0c15a3c0 con 0x7efe0c0cb2a0 2023-08-25T04:18:17.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.966+0000 7efe11703640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0c0ad940 con 0x7efe0c158e10 2023-08-25T04:18:17.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.966+0000 7efe0affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe0c158e10 0x7efe0c0b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:17.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.966+0000 7efe027fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efe0c159f10 0x7efe0c0cab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55040/0 (socket says 172.21.15.55:55040) 2023-08-25T04:18:17.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.966+0000 7efe0affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe0c158e10 0x7efe0c0b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56702/0 (socket says 172.21.15.55:56702) 2023-08-25T04:18:17.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.966+0000 7efe027fc640 1 -- 172.21.15.55:0/3236759979 learned_addr learned my addr 172.21.15.55:0/3236759979 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:17.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.966+0000 7efe0affd640 1 -- 172.21.15.55:0/3236759979 >> v1:172.21.15.110:6789/0 conn(0x7efe0c0cb2a0 legacy=0x7efe0c0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:17.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.966+0000 7efe0affd640 1 -- 172.21.15.55:0/3236759979 >> v1:172.21.15.55:6789/0 conn(0x7efe0c159f10 legacy=0x7efe0c0cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:17.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.966+0000 7efe0affd640 1 -- 172.21.15.55:0/3236759979 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c06d380 con 0x7efe0c158e10 2023-08-25T04:18:17.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.970+0000 7efe0affd640 1 --2- 172.21.15.55:0/3236759979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe0c158e10 0x7efe0c0b2d30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0097c0 tx=0x7efdfc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7118b8ced7b91517 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:17.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.970+0000 7efe0a7fc640 1 -- 172.21.15.55:0/3236759979 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc0ac640 con 0x7efe0c158e10 2023-08-25T04:18:17.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.970+0000 7efe0a7fc640 1 -- 172.21.15.55:0/3236759979 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc0ac7a0 con 0x7efe0c158e10 2023-08-25T04:18:17.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.970+0000 7efe0a7fc640 1 -- 172.21.15.55:0/3236759979 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc0acb30 con 0x7efe0c158e10 2023-08-25T04:18:17.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.970+0000 7efe11703640 1 -- 172.21.15.55:0/3236759979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe0c158e10 msgr2=0x7efe0c0b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:17.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.970+0000 7efe11703640 1 --2- 172.21.15.55:0/3236759979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe0c158e10 0x7efe0c0b2d30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0097c0 tx=0x7efdfc01c480 comp rx=0 tx=0).stop 2023-08-25T04:18:17.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.970+0000 7efe11703640 1 -- 172.21.15.55:0/3236759979 shutdown_connections 2023-08-25T04:18:17.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.970+0000 7efe11703640 1 --2- 172.21.15.55:0/3236759979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe0c158e10 0x7efe0c0b2d30 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:17.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.970+0000 7efe11703640 1 -- 172.21.15.55:0/3236759979 >> 172.21.15.55:0/3236759979 conn(0x7efe0c069d00 msgr2=0x7efe0c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:17.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.970+0000 7efe11703640 1 -- 172.21.15.55:0/3236759979 shutdown_connections 2023-08-25T04:18:17.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.970+0000 7efe11703640 1 -- 172.21.15.55:0/3236759979 wait complete. 2023-08-25T04:18:17.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe11703640 1 Processor -- start 2023-08-25T04:18:17.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe11703640 1 -- start start 2023-08-25T04:18:17.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe11703640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe0c0cb2a0 0x7efe0c0c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:17.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe11703640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe0c158e10 0x7efe0c0aba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:17.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe11703640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe0c159f10 0x7efe0c0afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:17.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe11703640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0c6930 con 0x7efe0c159f10 2023-08-25T04:18:17.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe11703640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0c6c10 con 0x7efe0c0cb2a0 2023-08-25T04:18:17.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe11703640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c0c6ef0 con 0x7efe0c158e10 2023-08-25T04:18:17.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe0b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe0c159f10 0x7efe0c0afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:17.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe0b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe0c159f10 0x7efe0c0afe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56706/0 (socket says 172.21.15.55:56706) 2023-08-25T04:18:17.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe0b7fe640 1 -- 172.21.15.55:0/3293097495 learned_addr learned my addr 172.21.15.55:0/3293097495 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:17.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe0affd640 1 --2- 172.21.15.55:0/3293097495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe0c0cb2a0 0x7efe0c0c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:17.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe027fc640 1 --2- 172.21.15.55:0/3293097495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe0c158e10 0x7efe0c0aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:17.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe0b7fe640 1 -- 172.21.15.55:0/3293097495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe0c158e10 msgr2=0x7efe0c0aba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:17.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe0b7fe640 1 --2- 172.21.15.55:0/3293097495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe0c158e10 0x7efe0c0aba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:17.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe0b7fe640 1 -- 172.21.15.55:0/3293097495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe0c0cb2a0 msgr2=0x7efe0c0c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:17.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe0b7fe640 1 --2- 172.21.15.55:0/3293097495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe0c0cb2a0 0x7efe0c0c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:17.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe0b7fe640 1 -- 172.21.15.55:0/3293097495 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc009420 con 0x7efe0c159f10 2023-08-25T04:18:17.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe027fc640 1 --2- 172.21.15.55:0/3293097495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe0c158e10 0x7efe0c0aba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:17.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe0b7fe640 1 --2- 172.21.15.55:0/3293097495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe0c159f10 0x7efe0c0afe90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7efe0400c730 tx=0x7efe0400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:17.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe03fff640 1 -- 172.21.15.55:0/3293097495 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04003b80 con 0x7efe0c159f10 2023-08-25T04:18:17.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe03fff640 1 -- 172.21.15.55:0/3293097495 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe04003ce0 con 0x7efe0c159f10 2023-08-25T04:18:17.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe11703640 1 -- 172.21.15.55:0/3293097495 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0c159370 con 0x7efe0c159f10 2023-08-25T04:18:17.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe03fff640 1 -- 172.21.15.55:0/3293097495 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0400aa30 con 0x7efe0c159f10 2023-08-25T04:18:17.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.974+0000 7efe11703640 1 -- 172.21.15.55:0/3293097495 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0c0c74b0 con 0x7efe0c159f10 2023-08-25T04:18:17.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.978+0000 7efe11703640 1 -- 172.21.15.55:0/3293097495 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0c071bd0 con 0x7efe0c159f10 2023-08-25T04:18:17.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.978+0000 7efe03fff640 1 -- 172.21.15.55:0/3293097495 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7efe0400ab90 con 0x7efe0c159f10 2023-08-25T04:18:17.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.978+0000 7efe03fff640 1 --2- 172.21.15.55:0/3293097495 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7efdec0657a0 0x7efdec067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:17.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.978+0000 7efe03fff640 1 -- 172.21.15.55:0/3293097495 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5984+0+0 (secure 0 0 0) 0x7efe04082d30 con 0x7efe0c159f10 2023-08-25T04:18:17.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.978+0000 7efe0affd640 1 --2- 172.21.15.55:0/3293097495 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7efdec0657a0 0x7efdec067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:17.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.978+0000 7efe0affd640 1 --2- 172.21.15.55:0/3293097495 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7efdec0657a0 0x7efdec067c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0ae000 tx=0x7efdfc008040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:17.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:17.982+0000 7efe03fff640 1 -- 172.21.15.55:0/3293097495 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7efe04050730 con 0x7efe0c159f10 2023-08-25T04:18:18.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.138+0000 7efe11703640 1 -- 172.21.15.55:0/3293097495 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe0c0c76a0 con 0x7efe0c159f10 2023-08-25T04:18:18.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.142+0000 7efe03fff640 1 -- 172.21.15.55:0/3293097495 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+15795 (secure 0 0 0) 0x7efe04053d50 con 0x7efe0c159f10 2023-08-25T04:18:18.140 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:18.140 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":70,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:18:14.774707+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6837/1578265172":"2023-08-26T04:18:11.735041+0000","172.21.15.110:0/4198165212":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/943102433":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/3556108705":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/501517667":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/2165360961":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/3235366703":"2023-08-26T04:18:08.515634+0000","172.21.15.110:6832/3383442930":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/746484664":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/894259341":"2023-08-26T04:16:20.415897+0000","172.21.15.110:6833/1373721950":"2023-08-26T04:16:20.415897+0000","172.21.15.110:6832/1373721950":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/1127649499":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/33998418":"2023-08-26T04:16:20.415897+0000","172.21.15.110:0/188879394":"2023-08-26T04:16:20.415897+0000","172.21.15.110:6835/1578265172":"2023-08-26T04:18:11.735041+0000","172.21.15.110:6833/3383442930":"2023-08-26T04:18:08.515634+0000","172.21.15.110:0/1737595424":"2023-08-26T04:16:20.415897+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:18:18.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.142+0000 7efe11703640 1 -- 172.21.15.55:0/3293097495 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7efdec0657a0 msgr2=0x7efdec067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:18.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.142+0000 7efe11703640 1 --2- 172.21.15.55:0/3293097495 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7efdec0657a0 0x7efdec067c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efdfc0ae000 tx=0x7efdfc008040 comp rx=0 tx=0).stop 2023-08-25T04:18:18.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.142+0000 7efe11703640 1 -- 172.21.15.55:0/3293097495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe0c159f10 msgr2=0x7efe0c0afe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:18.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.142+0000 7efe11703640 1 --2- 172.21.15.55:0/3293097495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe0c159f10 0x7efe0c0afe90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7efe0400c730 tx=0x7efe0400cbf0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.142+0000 7efe11703640 1 -- 172.21.15.55:0/3293097495 shutdown_connections 2023-08-25T04:18:18.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.142+0000 7efe11703640 1 --2- 172.21.15.55:0/3293097495 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7efdec0657a0 0x7efdec067c60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.142+0000 7efe11703640 1 --2- 172.21.15.55:0/3293097495 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe0c159f10 0x7efe0c0afe90 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.142+0000 7efe11703640 1 --2- 172.21.15.55:0/3293097495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe0c158e10 0x7efe0c0aba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.142+0000 7efe11703640 1 --2- 172.21.15.55:0/3293097495 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe0c0cb2a0 0x7efe0c0c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.142+0000 7efe11703640 1 -- 172.21.15.55:0/3293097495 >> 172.21.15.55:0/3293097495 conn(0x7efe0c069d00 msgr2=0x7efe0c0ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:18.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.142+0000 7efe11703640 1 -- 172.21.15.55:0/3293097495 shutdown_connections 2023-08-25T04:18:18.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.142+0000 7efe11703640 1 -- 172.21.15.55:0/3293097495 wait complete. 2023-08-25T04:18:18.161 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:18:18.162 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:18:18.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.310+0000 7f76d046a640 1 Processor -- start 2023-08-25T04:18:18.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.310+0000 7f76d046a640 1 -- start start 2023-08-25T04:18:18.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.310+0000 7f76d046a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f76c80c9830 0x7f76c809bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:18.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.310+0000 7f76d046a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c815abd0 con 0x7f76c806c020 2023-08-25T04:18:18.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.310+0000 7f76d046a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c80c8ab0 con 0x7f76c815a7f0 2023-08-25T04:18:18.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.310+0000 7f76d046a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c80c8d50 con 0x7f76c80c9830 2023-08-25T04:18:18.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.310+0000 7f76cea07640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f76c806c020 0x7f76c80acff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55052/0 (socket says 172.21.15.55:55052) 2023-08-25T04:18:18.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.310+0000 7f76cea07640 1 -- 172.21.15.55:0/2097560465 learned_addr learned my addr 172.21.15.55:0/2097560465 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:18.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.310+0000 7f76cda05640 1 --2- 172.21.15.55:0/2097560465 >> v2:172.21.15.110:3300/0 conn(0x7f76c80c9830 0x7f76c809bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:18.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.310+0000 7f76cd204640 1 -- 172.21.15.55:0/2097560465 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992621894 0 0) 0x7f76c815abd0 con 0x7f76c806c020 2023-08-25T04:18:18.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.310+0000 7f76cd204640 1 -- 172.21.15.55:0/2097560465 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76b4003530 con 0x7f76c806c020 2023-08-25T04:18:18.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.310+0000 7f76cda05640 1 -- 172.21.15.55:0/2097560465 >> v1:172.21.15.110:6789/0 conn(0x7f76c815a7f0 legacy=0x7f76c8070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:18.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.310+0000 7f76cd204640 1 -- 172.21.15.55:0/2097560465 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435805934 0 0) 0x7f76c80c8ab0 con 0x7f76c815a7f0 2023-08-25T04:18:18.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.310+0000 7f76cda05640 1 -- 172.21.15.55:0/2097560465 >> v1:172.21.15.55:6789/0 conn(0x7f76c806c020 legacy=0x7f76c80acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:18.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.310+0000 7f76cda05640 1 -- 172.21.15.55:0/2097560465 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c80c9030 con 0x7f76c80c9830 2023-08-25T04:18:18.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.314+0000 7f76cda05640 1 --2- 172.21.15.55:0/2097560465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76c80c9830 0x7f76c809bde0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f76b80097c0 tx=0x7f76b801c290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11a76996456cdcc4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:18.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.314+0000 7f76cd204640 1 -- 172.21.15.55:0/2097560465 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c0001980 con 0x7f76c80c9830 2023-08-25T04:18:18.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.314+0000 7f76cd204640 1 -- 172.21.15.55:0/2097560465 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b80a7050 con 0x7f76c80c9830 2023-08-25T04:18:18.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.314+0000 7f76cd204640 1 -- 172.21.15.55:0/2097560465 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b80ab620 con 0x7f76c80c9830 2023-08-25T04:18:18.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.314+0000 7f76d046a640 1 -- 172.21.15.55:0/2097560465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76c80c9830 msgr2=0x7f76c809bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:18.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.314+0000 7f76d046a640 1 --2- 172.21.15.55:0/2097560465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76c80c9830 0x7f76c809bde0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f76b80097c0 tx=0x7f76b801c290 comp rx=0 tx=0).stop 2023-08-25T04:18:18.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.314+0000 7f76d046a640 1 -- 172.21.15.55:0/2097560465 shutdown_connections 2023-08-25T04:18:18.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.314+0000 7f76d046a640 1 --2- 172.21.15.55:0/2097560465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76c80c9830 0x7f76c809bde0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.314+0000 7f76d046a640 1 -- 172.21.15.55:0/2097560465 >> 172.21.15.55:0/2097560465 conn(0x7f76c8069900 msgr2=0x7f76c8069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:18.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.314+0000 7f76d046a640 1 -- 172.21.15.55:0/2097560465 shutdown_connections 2023-08-25T04:18:18.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.314+0000 7f76d046a640 1 -- 172.21.15.55:0/2097560465 wait complete. 2023-08-25T04:18:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76d046a640 1 Processor -- start 2023-08-25T04:18:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76d046a640 1 -- start start 2023-08-25T04:18:18.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76d046a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76c806c020 0x7f76c8157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:18.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76d046a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76c80c9830 0x7f76c8165a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:18.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76d046a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76c815a7f0 0x7f76c8165f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:18.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76d046a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c80cc560 con 0x7f76c80c9830 2023-08-25T04:18:18.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76d046a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c80cc840 con 0x7f76c815a7f0 2023-08-25T04:18:18.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76d046a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c80ccb20 con 0x7f76c806c020 2023-08-25T04:18:18.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76cda05640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76c80c9830 0x7f76c8165a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:18.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76cda05640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76c80c9830 0x7f76c8165a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56716/0 (socket says 172.21.15.55:56716) 2023-08-25T04:18:18.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76cda05640 1 -- 172.21.15.55:0/862030453 learned_addr learned my addr 172.21.15.55:0/862030453 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:18.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76cea07640 1 --2- 172.21.15.55:0/862030453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76c815a7f0 0x7f76c8165f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:18.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76ce206640 1 --2- 172.21.15.55:0/862030453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76c806c020 0x7f76c8157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:18.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76cda05640 1 -- 172.21.15.55:0/862030453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76c806c020 msgr2=0x7f76c8157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:18.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76cda05640 1 --2- 172.21.15.55:0/862030453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76c806c020 0x7f76c8157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76cda05640 1 -- 172.21.15.55:0/862030453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76c815a7f0 msgr2=0x7f76c8165f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:18.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76cda05640 1 --2- 172.21.15.55:0/862030453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76c815a7f0 0x7f76c8165f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76cda05640 1 -- 172.21.15.55:0/862030453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b8009420 con 0x7f76c80c9830 2023-08-25T04:18:18.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76cea07640 1 --2- 172.21.15.55:0/862030453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76c815a7f0 0x7f76c8165f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:18.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76ce206640 1 --2- 172.21.15.55:0/862030453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76c806c020 0x7f76c8157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:18.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76cda05640 1 --2- 172.21.15.55:0/862030453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76c80c9830 0x7f76c8165a50 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f76b80ae040 tx=0x7f76b801aad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:18.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76beffd640 1 -- 172.21.15.55:0/862030453 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b80abd90 con 0x7f76c80c9830 2023-08-25T04:18:18.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76beffd640 1 -- 172.21.15.55:0/862030453 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b8004020 con 0x7f76c80c9830 2023-08-25T04:18:18.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76beffd640 1 -- 172.21.15.55:0/862030453 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b8004390 con 0x7f76c80c9830 2023-08-25T04:18:18.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76d046a640 1 -- 172.21.15.55:0/862030453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c80adc90 con 0x7f76c80c9830 2023-08-25T04:18:18.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.318+0000 7f76d046a640 1 -- 172.21.15.55:0/862030453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c80cd0e0 con 0x7f76c80c9830 2023-08-25T04:18:18.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.322+0000 7f76d046a640 1 -- 172.21.15.55:0/862030453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c80afc50 con 0x7f76c80c9830 2023-08-25T04:18:18.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.322+0000 7f76beffd640 1 -- 172.21.15.55:0/862030453 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f76b8003620 con 0x7f76c80c9830 2023-08-25T04:18:18.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.322+0000 7f76beffd640 1 --2- 172.21.15.55:0/862030453 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f76ac0657a0 0x7f76ac067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:18.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.322+0000 7f76beffd640 1 -- 172.21.15.55:0/862030453 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f76b811c820 con 0x7f76c80c9830 2023-08-25T04:18:18.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.322+0000 7f76ce206640 1 --2- 172.21.15.55:0/862030453 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f76ac0657a0 0x7f76ac067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:18.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.322+0000 7f76ce206640 1 --2- 172.21.15.55:0/862030453 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f76ac0657a0 0x7f76ac067c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f76c4000fc0 tx=0x7f76c4009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:18.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.326+0000 7f76beffd640 1 -- 172.21.15.55:0/862030453 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f76b80ea090 con 0x7f76c80c9830 2023-08-25T04:18:18.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.482+0000 7f76d046a640 1 -- 172.21.15.55:0/862030453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76c8073ec0 con 0x7f76c80c9830 2023-08-25T04:18:18.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.482+0000 7f76beffd640 1 -- 172.21.15.55:0/862030453 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76b80ed6b0 con 0x7f76c80c9830 2023-08-25T04:18:18.483 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:18:18.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.486+0000 7f76d046a640 1 -- 172.21.15.55:0/862030453 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f76ac0657a0 msgr2=0x7f76ac067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:18.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.486+0000 7f76d046a640 1 --2- 172.21.15.55:0/862030453 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f76ac0657a0 0x7f76ac067c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f76c4000fc0 tx=0x7f76c4009040 comp rx=0 tx=0).stop 2023-08-25T04:18:18.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.486+0000 7f76d046a640 1 -- 172.21.15.55:0/862030453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76c80c9830 msgr2=0x7f76c8165a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.486+0000 7f76d046a640 1 --2- 172.21.15.55:0/862030453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76c80c9830 0x7f76c8165a50 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f76b80ae040 tx=0x7f76b801aad0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.486+0000 7f76d046a640 1 -- 172.21.15.55:0/862030453 shutdown_connections 2023-08-25T04:18:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.486+0000 7f76d046a640 1 --2- 172.21.15.55:0/862030453 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f76ac0657a0 0x7f76ac067c60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.486+0000 7f76d046a640 1 --2- 172.21.15.55:0/862030453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76c815a7f0 0x7f76c8165f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.486+0000 7f76d046a640 1 --2- 172.21.15.55:0/862030453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76c80c9830 0x7f76c8165a50 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.486+0000 7f76d046a640 1 --2- 172.21.15.55:0/862030453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76c806c020 0x7f76c8157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.486+0000 7f76d046a640 1 -- 172.21.15.55:0/862030453 >> 172.21.15.55:0/862030453 conn(0x7f76c8069900 msgr2=0x7f76c815e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.486+0000 7f76d046a640 1 -- 172.21.15.55:0/862030453 shutdown_connections 2023-08-25T04:18:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.486+0000 7f76d046a640 1 -- 172.21.15.55:0/862030453 wait complete. 2023-08-25T04:18:18.503 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:18:18.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.650+0000 7fe2c5434640 1 Processor -- start 2023-08-25T04:18:18.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.650+0000 7fe2c5434640 1 -- start start 2023-08-25T04:18:18.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.654+0000 7fe2c5434640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2c015a7f0 0x7fe2c009bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:18.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.654+0000 7fe2c5434640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe2c006c020 0x7fe2c00acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:18.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.654+0000 7fe2c5434640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c015abd0 con 0x7fe2c00c9830 2023-08-25T04:18:18.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.654+0000 7fe2c5434640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c00c8ab0 con 0x7fe2c015a7f0 2023-08-25T04:18:18.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.654+0000 7fe2c5434640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c00c8d50 con 0x7fe2c006c020 2023-08-25T04:18:18.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.654+0000 7fe2beffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2c015a7f0 0x7fe2c009bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:18.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.654+0000 7fe2b7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe2c00c9830 0x7fe2c0070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55054/0 (socket says 172.21.15.55:55054) 2023-08-25T04:18:18.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.654+0000 7fe2b7fff640 1 -- 172.21.15.55:0/131123760 learned_addr learned my addr 172.21.15.55:0/131123760 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:18.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.654+0000 7fe2beffd640 1 -- 172.21.15.55:0/131123760 >> v2:172.21.15.110:3300/0 conn(0x7fe2c006c020 msgr2=0x7fe2c00acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:18.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.654+0000 7fe2beffd640 1 --2- 172.21.15.55:0/131123760 >> v2:172.21.15.110:3300/0 conn(0x7fe2c006c020 0x7fe2c00acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.654+0000 7fe2beffd640 1 -- 172.21.15.55:0/131123760 >> v1:172.21.15.55:6789/0 conn(0x7fe2c00c9830 legacy=0x7fe2c0070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:18.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.654+0000 7fe2beffd640 1 -- 172.21.15.55:0/131123760 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c00c9030 con 0x7fe2c015a7f0 2023-08-25T04:18:18.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.658+0000 7fe2beffd640 1 --2- 172.21.15.55:0/131123760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c015a7f0 0x7fe2c009bde0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00cbf20 tx=0x7fe2b001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cb3a45b7930d61 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:18.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.658+0000 7fe2be7fc640 1 -- 172.21.15.55:0/131123760 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b00ab600 con 0x7fe2c015a7f0 2023-08-25T04:18:18.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.658+0000 7fe2be7fc640 1 -- 172.21.15.55:0/131123760 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b00a7050 con 0x7fe2c015a7f0 2023-08-25T04:18:18.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.658+0000 7fe2be7fc640 1 -- 172.21.15.55:0/131123760 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b00ab980 con 0x7fe2c015a7f0 2023-08-25T04:18:18.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.658+0000 7fe2c5434640 1 -- 172.21.15.55:0/131123760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c015a7f0 msgr2=0x7fe2c009bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:18.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.658+0000 7fe2c5434640 1 --2- 172.21.15.55:0/131123760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c015a7f0 0x7fe2c009bde0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00cbf20 tx=0x7fe2b001c430 comp rx=0 tx=0).stop 2023-08-25T04:18:18.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.658+0000 7fe2c5434640 1 -- 172.21.15.55:0/131123760 shutdown_connections 2023-08-25T04:18:18.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.658+0000 7fe2c5434640 1 --2- 172.21.15.55:0/131123760 >> v2:172.21.15.110:3300/0 conn(0x7fe2c006c020 0x7fe2c00acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.658+0000 7fe2c5434640 1 --2- 172.21.15.55:0/131123760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c015a7f0 0x7fe2c009bde0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.658+0000 7fe2c5434640 1 -- 172.21.15.55:0/131123760 >> 172.21.15.55:0/131123760 conn(0x7fe2c0069900 msgr2=0x7fe2c0069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:18.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.658+0000 7fe2c5434640 1 -- 172.21.15.55:0/131123760 shutdown_connections 2023-08-25T04:18:18.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.658+0000 7fe2c5434640 1 -- 172.21.15.55:0/131123760 wait complete. 2023-08-25T04:18:18.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.658+0000 7fe2c5434640 1 Processor -- start 2023-08-25T04:18:18.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.658+0000 7fe2c5434640 1 -- start start 2023-08-25T04:18:18.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2c5434640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c006c020 0x7fe2c0146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:18.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2c5434640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2c00c9830 0x7fe2c00b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:18.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2c5434640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2c015a7f0 0x7fe2c00c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:18.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2c5434640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c0146f90 con 0x7fe2c006c020 2023-08-25T04:18:18.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2c5434640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00b2b00 con 0x7fe2c00c9830 2023-08-25T04:18:18.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2c5434640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00b1520 con 0x7fe2c015a7f0 2023-08-25T04:18:18.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2beffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c006c020 0x7fe2c0146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:18.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2beffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c006c020 0x7fe2c0146a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56740/0 (socket says 172.21.15.55:56740) 2023-08-25T04:18:18.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2beffd640 1 -- 172.21.15.55:0/2360846935 learned_addr learned my addr 172.21.15.55:0/2360846935 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:18.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2b7fff640 1 --2- 172.21.15.55:0/2360846935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2c00c9830 0x7fe2c00b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:18.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2bf7fe640 1 --2- 172.21.15.55:0/2360846935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2c015a7f0 0x7fe2c00c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:18.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2beffd640 1 -- 172.21.15.55:0/2360846935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2c015a7f0 msgr2=0x7fe2c00c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:18.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2beffd640 1 --2- 172.21.15.55:0/2360846935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2c015a7f0 0x7fe2c00c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2beffd640 1 -- 172.21.15.55:0/2360846935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2c00c9830 msgr2=0x7fe2c00b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:18.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2beffd640 1 --2- 172.21.15.55:0/2360846935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2c00c9830 0x7fe2c00b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2beffd640 1 -- 172.21.15.55:0/2360846935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b00093b0 con 0x7fe2c006c020 2023-08-25T04:18:18.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2beffd640 1 --2- 172.21.15.55:0/2360846935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c006c020 0x7fe2c0146a50 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0019040 tx=0x7fe2b00191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:18.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2b77fe640 1 -- 172.21.15.55:0/2360846935 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b00ba070 con 0x7fe2c006c020 2023-08-25T04:18:18.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2b77fe640 1 -- 172.21.15.55:0/2360846935 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b00abe50 con 0x7fe2c006c020 2023-08-25T04:18:18.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2c5434640 1 -- 172.21.15.55:0/2360846935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c00b1800 con 0x7fe2c006c020 2023-08-25T04:18:18.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2b77fe640 1 -- 172.21.15.55:0/2360846935 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0005bc0 con 0x7fe2c006c020 2023-08-25T04:18:18.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2c5434640 1 -- 172.21.15.55:0/2360846935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c00b1dc0 con 0x7fe2c006c020 2023-08-25T04:18:18.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2c5434640 1 -- 172.21.15.55:0/2360846935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c006d5b0 con 0x7fe2c006c020 2023-08-25T04:18:18.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.662+0000 7fe2b77fe640 1 -- 172.21.15.55:0/2360846935 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fe2b00b2040 con 0x7fe2c006c020 2023-08-25T04:18:18.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.666+0000 7fe2b77fe640 1 --2- 172.21.15.55:0/2360846935 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe2a00657a0 0x7fe2a0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:18.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.666+0000 7fe2b77fe640 1 -- 172.21.15.55:0/2360846935 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fe2b011c900 con 0x7fe2c006c020 2023-08-25T04:18:18.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.666+0000 7fe2b7fff640 1 --2- 172.21.15.55:0/2360846935 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe2a00657a0 0x7fe2a0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:18.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.666+0000 7fe2b7fff640 1 --2- 172.21.15.55:0/2360846935 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe2a00657a0 0x7fe2a0067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00c5690 tx=0x7fe2a8009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:18.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.670+0000 7fe2b77fe640 1 -- 172.21.15.55:0/2360846935 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe2b00ea200 con 0x7fe2c006c020 2023-08-25T04:18:18.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.830+0000 7fe2c5434640 1 -- 172.21.15.55:0/2360846935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe2c0073ec0 con 0x7fe2c006c020 2023-08-25T04:18:18.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.830+0000 7fe2b77fe640 1 -- 172.21.15.55:0/2360846935 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v70) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe2b00ed820 con 0x7fe2c006c020 2023-08-25T04:18:18.831 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:18:18.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.830+0000 7fe2c5434640 1 -- 172.21.15.55:0/2360846935 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe2a00657a0 msgr2=0x7fe2a0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:18.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.830+0000 7fe2c5434640 1 --2- 172.21.15.55:0/2360846935 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe2a00657a0 0x7fe2a0067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00c5690 tx=0x7fe2a8009040 comp rx=0 tx=0).stop 2023-08-25T04:18:18.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.830+0000 7fe2c5434640 1 -- 172.21.15.55:0/2360846935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c006c020 msgr2=0x7fe2c0146a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:18.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.830+0000 7fe2c5434640 1 --2- 172.21.15.55:0/2360846935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c006c020 0x7fe2c0146a50 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0019040 tx=0x7fe2b00191d0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.830+0000 7fe2c5434640 1 -- 172.21.15.55:0/2360846935 shutdown_connections 2023-08-25T04:18:18.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.830+0000 7fe2c5434640 1 --2- 172.21.15.55:0/2360846935 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fe2a00657a0 0x7fe2a0067c60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.830+0000 7fe2c5434640 1 --2- 172.21.15.55:0/2360846935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2c015a7f0 0x7fe2c00c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.830+0000 7fe2c5434640 1 --2- 172.21.15.55:0/2360846935 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2c00c9830 0x7fe2c00b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.830+0000 7fe2c5434640 1 --2- 172.21.15.55:0/2360846935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2c006c020 0x7fe2c0146a50 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:18.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.830+0000 7fe2c5434640 1 -- 172.21.15.55:0/2360846935 >> 172.21.15.55:0/2360846935 conn(0x7fe2c0069900 msgr2=0x7fe2c00cb260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:18.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.834+0000 7fe2c5434640 1 -- 172.21.15.55:0/2360846935 shutdown_connections 2023-08-25T04:18:18.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:18.834+0000 7fe2c5434640 1 -- 172.21.15.55:0/2360846935 wait complete. 2023-08-25T04:18:18.851 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-25T04:18:18.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.002+0000 7fc18c1a3640 1 Processor -- start 2023-08-25T04:18:19.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.002+0000 7fc18c1a3640 1 -- start start 2023-08-25T04:18:19.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.002+0000 7fc18c1a3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc18406e5a0 0x7fc1840cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:19.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.002+0000 7fc18c1a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc18406c790 0x7fc1840ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:19.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.002+0000 7fc18c1a3640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1840cab90 con 0x7fc18406c3b0 2023-08-25T04:18:19.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.002+0000 7fc18c1a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18406dbb0 con 0x7fc18406c790 2023-08-25T04:18:19.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.002+0000 7fc18c1a3640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1840cae50 con 0x7fc18406e5a0 2023-08-25T04:18:19.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.002+0000 7fc18a740640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc18406c790 0x7fc1840ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:19.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.002+0000 7fc18a740640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc18406c790 0x7fc1840ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56756/0 (socket says 172.21.15.55:56756) 2023-08-25T04:18:19.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.002+0000 7fc18a740640 1 -- 172.21.15.55:0/1335298707 learned_addr learned my addr 172.21.15.55:0/1335298707 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:19.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.002+0000 7fc18973e640 1 --2- 172.21.15.55:0/1335298707 >> v2:172.21.15.110:3300/0 conn(0x7fc18406e5a0 0x7fc1840cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:19.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.002+0000 7fc18a740640 1 -- 172.21.15.55:0/1335298707 >> v2:172.21.15.110:3300/0 conn(0x7fc18406e5a0 msgr2=0x7fc1840cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:19.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.002+0000 7fc18a740640 1 --2- 172.21.15.55:0/1335298707 >> v2:172.21.15.110:3300/0 conn(0x7fc18406e5a0 0x7fc1840cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.002+0000 7fc18a740640 1 -- 172.21.15.55:0/1335298707 >> v1:172.21.15.110:6789/0 conn(0x7fc18406c3b0 legacy=0x7fc18406de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:19.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.002+0000 7fc18a740640 1 -- 172.21.15.55:0/1335298707 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1840cb130 con 0x7fc18406c790 2023-08-25T04:18:19.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.006+0000 7fc18a740640 1 --2- 172.21.15.55:0/1335298707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18406c790 0x7fc1840ce8b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc184071900 tx=0x7fc17c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28035b8748cf365d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:19.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.006+0000 7fc188f3d640 1 -- 172.21.15.55:0/1335298707 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c0a5800 con 0x7fc18406c790 2023-08-25T04:18:19.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.006+0000 7fc188f3d640 1 -- 172.21.15.55:0/1335298707 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c0a5960 con 0x7fc18406c790 2023-08-25T04:18:19.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.006+0000 7fc188f3d640 1 -- 172.21.15.55:0/1335298707 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c0a5cf0 con 0x7fc18406c790 2023-08-25T04:18:19.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.006+0000 7fc18c1a3640 1 -- 172.21.15.55:0/1335298707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18406c790 msgr2=0x7fc1840ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:19.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.006+0000 7fc18c1a3640 1 --2- 172.21.15.55:0/1335298707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18406c790 0x7fc1840ce8b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fc184071900 tx=0x7fc17c01c960 comp rx=0 tx=0).stop 2023-08-25T04:18:19.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.006+0000 7fc18c1a3640 1 -- 172.21.15.55:0/1335298707 shutdown_connections 2023-08-25T04:18:19.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.006+0000 7fc18c1a3640 1 --2- 172.21.15.55:0/1335298707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18406c790 0x7fc1840ce8b0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.006+0000 7fc18c1a3640 1 --2- 172.21.15.55:0/1335298707 >> v2:172.21.15.110:3300/0 conn(0x7fc18406e5a0 0x7fc1840cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.006+0000 7fc18c1a3640 1 -- 172.21.15.55:0/1335298707 >> 172.21.15.55:0/1335298707 conn(0x7fc1840d0540 msgr2=0x7fc1840d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:19.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.006+0000 7fc18c1a3640 1 -- 172.21.15.55:0/1335298707 shutdown_connections 2023-08-25T04:18:19.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.006+0000 7fc18c1a3640 1 -- 172.21.15.55:0/1335298707 wait complete. 2023-08-25T04:18:19.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18c1a3640 1 Processor -- start 2023-08-25T04:18:19.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18c1a3640 1 -- start start 2023-08-25T04:18:19.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18c1a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc18406c3b0 0x7fc1840b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:19.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18c1a3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc18406c790 0x7fc18406ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:19.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18c1a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18406e5a0 0x7fc18406b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:19.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18c1a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840c8430 con 0x7fc18406e5a0 2023-08-25T04:18:19.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18c1a3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840c77b0 con 0x7fc18406c790 2023-08-25T04:18:19.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18c1a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840c7a90 con 0x7fc18406c3b0 2023-08-25T04:18:19.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18a740640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18406e5a0 0x7fc18406b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:19.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18a740640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18406e5a0 0x7fc18406b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56760/0 (socket says 172.21.15.55:56760) 2023-08-25T04:18:19.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18a740640 1 -- 172.21.15.55:0/323994646 learned_addr learned my addr 172.21.15.55:0/323994646 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:19.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc189f3f640 1 --2- 172.21.15.55:0/323994646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc18406c3b0 0x7fc1840b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:19.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18973e640 1 --2- 172.21.15.55:0/323994646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc18406c790 0x7fc18406ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18a740640 1 -- 172.21.15.55:0/323994646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc18406c3b0 msgr2=0x7fc1840b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18a740640 1 --2- 172.21.15.55:0/323994646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc18406c3b0 0x7fc1840b5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18a740640 1 -- 172.21.15.55:0/323994646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc18406c790 msgr2=0x7fc18406ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18a740640 1 --2- 172.21.15.55:0/323994646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc18406c790 0x7fc18406ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18a740640 1 -- 172.21.15.55:0/323994646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c009b30 con 0x7fc18406e5a0 2023-08-25T04:18:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18a740640 1 --2- 172.21.15.55:0/323994646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18406e5a0 0x7fc18406b1a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fc17c01a590 tx=0x7fc17c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc17a7fc640 1 -- 172.21.15.55:0/323994646 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c0b8670 con 0x7fc18406e5a0 2023-08-25T04:18:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc17a7fc640 1 -- 172.21.15.55:0/323994646 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c0b87d0 con 0x7fc18406e5a0 2023-08-25T04:18:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc17a7fc640 1 -- 172.21.15.55:0/323994646 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c0b8b80 con 0x7fc18406e5a0 2023-08-25T04:18:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18c1a3640 1 -- 172.21.15.55:0/323994646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1840c7d70 con 0x7fc18406e5a0 2023-08-25T04:18:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18c1a3640 1 -- 172.21.15.55:0/323994646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1840b6050 con 0x7fc18406e5a0 2023-08-25T04:18:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.010+0000 7fc18c1a3640 1 -- 172.21.15.55:0/323994646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1840c8570 con 0x7fc18406e5a0 2023-08-25T04:18:19.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.014+0000 7fc17a7fc640 1 -- 172.21.15.55:0/323994646 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fc17c0b8ce0 con 0x7fc18406e5a0 2023-08-25T04:18:19.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.014+0000 7fc17a7fc640 1 --2- 172.21.15.55:0/323994646 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fc1680657a0 0x7fc168067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:19.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.014+0000 7fc17a7fc640 1 -- 172.21.15.55:0/323994646 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fc17c11e3e0 con 0x7fc18406e5a0 2023-08-25T04:18:19.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.014+0000 7fc189f3f640 1 --2- 172.21.15.55:0/323994646 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fc1680657a0 0x7fc168067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:19.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.014+0000 7fc189f3f640 1 --2- 172.21.15.55:0/323994646 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fc1680657a0 0x7fc168067c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc1840ca6c0 tx=0x7fc180007e90 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:19.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.018+0000 7fc17a7fc640 1 -- 172.21.15.55:0/323994646 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc1840c8570 con 0x7fc18406e5a0 2023-08-25T04:18:19.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.170+0000 7fc18c1a3640 1 -- 172.21.15.55:0/323994646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc1840c8570 con 0x7fc18406e5a0 2023-08-25T04:18:19.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.178+0000 7fc17a7fc640 1 -- 172.21.15.55:0/323994646 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc1840c8570 con 0x7fc18406e5a0 2023-08-25T04:18:19.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.178+0000 7fc18c1a3640 1 -- 172.21.15.55:0/323994646 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fc1680657a0 msgr2=0x7fc168067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:19.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.178+0000 7fc18c1a3640 1 --2- 172.21.15.55:0/323994646 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fc1680657a0 0x7fc168067c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc1840ca6c0 tx=0x7fc180007e90 comp rx=0 tx=0).stop 2023-08-25T04:18:19.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.178+0000 7fc18c1a3640 1 -- 172.21.15.55:0/323994646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18406e5a0 msgr2=0x7fc18406b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:19.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.178+0000 7fc18c1a3640 1 --2- 172.21.15.55:0/323994646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18406e5a0 0x7fc18406b1a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fc17c01a590 tx=0x7fc17c019700 comp rx=0 tx=0).stop 2023-08-25T04:18:19.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.178+0000 7fc18c1a3640 1 -- 172.21.15.55:0/323994646 shutdown_connections 2023-08-25T04:18:19.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.178+0000 7fc18c1a3640 1 --2- 172.21.15.55:0/323994646 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fc1680657a0 0x7fc168067c60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.178+0000 7fc18c1a3640 1 --2- 172.21.15.55:0/323994646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18406e5a0 0x7fc18406b1a0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.178+0000 7fc18c1a3640 1 --2- 172.21.15.55:0/323994646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc18406c790 0x7fc18406ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.178+0000 7fc18c1a3640 1 --2- 172.21.15.55:0/323994646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc18406c3b0 0x7fc1840b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.178+0000 7fc18c1a3640 1 -- 172.21.15.55:0/323994646 >> 172.21.15.55:0/323994646 conn(0x7fc1840d0540 msgr2=0x7fc1841584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:19.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.178+0000 7fc18c1a3640 1 -- 172.21.15.55:0/323994646 shutdown_connections 2023-08-25T04:18:19.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.178+0000 7fc18c1a3640 1 -- 172.21.15.55:0/323994646 wait complete. 2023-08-25T04:18:19.198 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T04:18:19.198 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:18:19.250 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:18:19.316 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T04:18:19.316 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:18:19.317 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:19.327 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T04:18:19.328 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:18:19.328 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:19.338 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:18:19.339 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:18:19.339 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:19.380 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T04:18:19.380 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:18:19.381 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:19.393 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:18:19.394 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-25T04:18:19.394 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:18:19.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.566+0000 7f3d99b00640 1 Processor -- start 2023-08-25T04:18:19.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.566+0000 7f3d99b00640 1 -- start start 2023-08-25T04:18:19.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.566+0000 7f3d99b00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d940cdde0 0x7f3d940ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:19.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.566+0000 7f3d99b00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d940b2e40 0x7f3d940b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:19.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.566+0000 7f3d99b00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d940b29b0 con 0x7f3d940d0da0 2023-08-25T04:18:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.566+0000 7f3d99b00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d940ce760 con 0x7f3d940cdde0 2023-08-25T04:18:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.566+0000 7f3d99b00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940b1dc0 con 0x7f3d940b2e40 2023-08-25T04:18:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.566+0000 7f3d8bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d940cdde0 0x7f3d940ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.566+0000 7f3d8bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d940cdde0 0x7f3d940ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56774/0 (socket says 172.21.15.55:56774) 2023-08-25T04:18:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.566+0000 7f3d8bfff640 1 -- 172.21.15.55:0/2714627119 learned_addr learned my addr 172.21.15.55:0/2714627119 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.566+0000 7f3d93fff640 1 --2- 172.21.15.55:0/2714627119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d940b2e40 0x7f3d940b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:19.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.566+0000 7f3d8bfff640 1 -- 172.21.15.55:0/2714627119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d940b2e40 msgr2=0x7f3d940b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:19.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.566+0000 7f3d8bfff640 1 --2- 172.21.15.55:0/2714627119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d940b2e40 0x7f3d940b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.566+0000 7f3d8bfff640 1 -- 172.21.15.55:0/2714627119 >> v1:172.21.15.55:6789/0 conn(0x7f3d940d0da0 legacy=0x7f3d940d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:19.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.566+0000 7f3d8bfff640 1 -- 172.21.15.55:0/2714627119 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d940b2080 con 0x7f3d940cdde0 2023-08-25T04:18:19.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.570+0000 7f3d8bfff640 1 --2- 172.21.15.55:0/2714627119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d940cdde0 0x7f3d940ce220 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009870 tx=0x7f3d7c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0221979bd0e775 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:19.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.570+0000 7f3d92ffd640 1 -- 172.21.15.55:0/2714627119 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0a8a30 con 0x7f3d940cdde0 2023-08-25T04:18:19.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.570+0000 7f3d92ffd640 1 -- 172.21.15.55:0/2714627119 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c0a8b90 con 0x7f3d940cdde0 2023-08-25T04:18:19.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.570+0000 7f3d92ffd640 1 -- 172.21.15.55:0/2714627119 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0b0440 con 0x7f3d940cdde0 2023-08-25T04:18:19.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.570+0000 7f3d99b00640 1 -- 172.21.15.55:0/2714627119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d940cdde0 msgr2=0x7f3d940ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:19.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.570+0000 7f3d99b00640 1 --2- 172.21.15.55:0/2714627119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d940cdde0 0x7f3d940ce220 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009870 tx=0x7f3d7c01ed30 comp rx=0 tx=0).stop 2023-08-25T04:18:19.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.570+0000 7f3d99b00640 1 -- 172.21.15.55:0/2714627119 shutdown_connections 2023-08-25T04:18:19.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.570+0000 7f3d99b00640 1 --2- 172.21.15.55:0/2714627119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d940b2e40 0x7f3d940b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.570+0000 7f3d99b00640 1 --2- 172.21.15.55:0/2714627119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d940cdde0 0x7f3d940ce220 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.570+0000 7f3d99b00640 1 -- 172.21.15.55:0/2714627119 >> 172.21.15.55:0/2714627119 conn(0x7f3d9409bae0 msgr2=0x7f3d940d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:19.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.570+0000 7f3d99b00640 1 -- 172.21.15.55:0/2714627119 shutdown_connections 2023-08-25T04:18:19.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.570+0000 7f3d99b00640 1 -- 172.21.15.55:0/2714627119 wait complete. 2023-08-25T04:18:19.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d99b00640 1 Processor -- start 2023-08-25T04:18:19.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d99b00640 1 -- start start 2023-08-25T04:18:19.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d99b00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d940b2e40 0x7f3d9414fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:19.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d99b00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d940cdde0 0x7f3d940ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:19.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d99b00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d940d0da0 0x7f3d94153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:19.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d99b00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940c9ca0 con 0x7f3d940d0da0 2023-08-25T04:18:19.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d99b00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9414fff0 con 0x7f3d940b2e40 2023-08-25T04:18:19.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d99b00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94154710 con 0x7f3d940cdde0 2023-08-25T04:18:19.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d93fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d940d0da0 0x7f3d94153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:19.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d93fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d940d0da0 0x7f3d94153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56776/0 (socket says 172.21.15.55:56776) 2023-08-25T04:18:19.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d93fff640 1 -- 172.21.15.55:0/2867570538 learned_addr learned my addr 172.21.15.55:0/2867570538 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:19.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d937fe640 1 --2- 172.21.15.55:0/2867570538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d940b2e40 0x7f3d9414fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:19.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d8bfff640 1 --2- 172.21.15.55:0/2867570538 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d940cdde0 0x7f3d940ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:19.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d93fff640 1 -- 172.21.15.55:0/2867570538 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d940cdde0 msgr2=0x7f3d940ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:19.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d93fff640 1 --2- 172.21.15.55:0/2867570538 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d940cdde0 0x7f3d940ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d93fff640 1 -- 172.21.15.55:0/2867570538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d940b2e40 msgr2=0x7f3d9414fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:19.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d93fff640 1 --2- 172.21.15.55:0/2867570538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d940b2e40 0x7f3d9414fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d93fff640 1 -- 172.21.15.55:0/2867570538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c0094d0 con 0x7f3d940d0da0 2023-08-25T04:18:19.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d8bfff640 1 --2- 172.21.15.55:0/2867570538 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d940cdde0 0x7f3d940ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:19.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d93fff640 1 --2- 172.21.15.55:0/2867570538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d940d0da0 0x7f3d94153ba0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c007e90 tx=0x7f3d8c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:19.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d90ff9640 1 -- 172.21.15.55:0/2867570538 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c014420 con 0x7f3d940d0da0 2023-08-25T04:18:19.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d90ff9640 1 -- 172.21.15.55:0/2867570538 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8c014580 con 0x7f3d940d0da0 2023-08-25T04:18:19.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d90ff9640 1 -- 172.21.15.55:0/2867570538 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c014930 con 0x7f3d940d0da0 2023-08-25T04:18:19.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d99b00640 1 -- 172.21.15.55:0/2867570538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d941549f0 con 0x7f3d940d0da0 2023-08-25T04:18:19.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.574+0000 7f3d99b00640 1 -- 172.21.15.55:0/2867570538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d940b0910 con 0x7f3d940d0da0 2023-08-25T04:18:19.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.578+0000 7f3d99b00640 1 -- 172.21.15.55:0/2867570538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d940c9e50 con 0x7f3d940d0da0 2023-08-25T04:18:19.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.578+0000 7f3d90ff9640 1 -- 172.21.15.55:0/2867570538 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f3d8c014a90 con 0x7f3d940d0da0 2023-08-25T04:18:19.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.578+0000 7f3d90ff9640 1 --2- 172.21.15.55:0/2867570538 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f3d740657a0 0x7f3d74067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:19.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.578+0000 7f3d90ff9640 1 -- 172.21.15.55:0/2867570538 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f3d8c083880 con 0x7f3d940d0da0 2023-08-25T04:18:19.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.578+0000 7f3d937fe640 1 --2- 172.21.15.55:0/2867570538 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f3d740657a0 0x7f3d74067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:19.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.578+0000 7f3d937fe640 1 --2- 172.21.15.55:0/2867570538 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f3d740657a0 0x7f3d74067c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3d84000fe0 tx=0x7f3d84009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:19.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.582+0000 7f3d90ff9640 1 -- 172.21.15.55:0/2867570538 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3d940c9e50 con 0x7f3d940d0da0 2023-08-25T04:18:19.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.770+0000 7f3d99b00640 1 -- 172.21.15.55:0/2867570538 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d940c9e50 con 0x7f3d940d0da0 2023-08-25T04:18:19.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.770+0000 7f3d90ff9640 1 -- 172.21.15.55:0/2867570538 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f3d940c9e50 con 0x7f3d940d0da0 2023-08-25T04:18:19.771 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:19.771 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3163426480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3163426480},{"type":"v1","addr":"172.21.15.55:6835","nonce":3163426480}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":5858,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3186833078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3186833078},{"type":"v1","addr":"172.21.15.110:6837","nonce":3186833078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5881,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/397210265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":397210265},{"type":"v1","addr":"172.21.15.110:6836","nonce":397210265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19},{"gid":6198,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/894580528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":894580528},{"type":"v1","addr":"172.21.15.55:6834","nonce":894580528}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[]} 2023-08-25T04:18:19.771 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 26 2023-08-25T04:18:19.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.774+0000 7f3d99b00640 1 -- 172.21.15.55:0/2867570538 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f3d740657a0 msgr2=0x7f3d74067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:19.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.774+0000 7f3d99b00640 1 --2- 172.21.15.55:0/2867570538 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f3d740657a0 0x7f3d74067c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3d84000fe0 tx=0x7f3d84009040 comp rx=0 tx=0).stop 2023-08-25T04:18:19.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.774+0000 7f3d99b00640 1 -- 172.21.15.55:0/2867570538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d940d0da0 msgr2=0x7f3d94153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:19.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.774+0000 7f3d99b00640 1 --2- 172.21.15.55:0/2867570538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d940d0da0 0x7f3d94153ba0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c007e90 tx=0x7f3d8c00e4b0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.774+0000 7f3d99b00640 1 -- 172.21.15.55:0/2867570538 shutdown_connections 2023-08-25T04:18:19.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.774+0000 7f3d99b00640 1 --2- 172.21.15.55:0/2867570538 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f3d740657a0 0x7f3d74067c60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.774+0000 7f3d99b00640 1 --2- 172.21.15.55:0/2867570538 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d940d0da0 0x7f3d94153ba0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.774+0000 7f3d99b00640 1 --2- 172.21.15.55:0/2867570538 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d940cdde0 0x7f3d940ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.774+0000 7f3d99b00640 1 --2- 172.21.15.55:0/2867570538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d940b2e40 0x7f3d9414fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:19.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.774+0000 7f3d99b00640 1 -- 172.21.15.55:0/2867570538 >> 172.21.15.55:0/2867570538 conn(0x7f3d9409bae0 msgr2=0x7f3d9406b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:19.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.774+0000 7f3d99b00640 1 -- 172.21.15.55:0/2867570538 shutdown_connections 2023-08-25T04:18:19.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:19.774+0000 7f3d99b00640 1 -- 172.21.15.55:0/2867570538 wait complete. 2023-08-25T04:18:19.792 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-25T04:18:19.792 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-25T04:18:19.793 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-25T04:18:19.793 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:18:19.793 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-25T04:18:19.793 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-25T04:18:19.794 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-25T04:18:19.794 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:18:19.794 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-25T04:18:19.794 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-25T04:18:19.795 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-25T04:18:19.795 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:18:19.795 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-25T04:18:19.795 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-25T04:18:19.796 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-25T04:18:19.796 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:18:19.805 INFO:tasks.ceph.mds.a:Stopped 2023-08-25T04:18:19.806 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-25T04:18:19.806 INFO:tasks.ceph.mds.c:Stopped 2023-08-25T04:18:19.807 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-25T04:18:19.809 INFO:tasks.ceph.mds.d:Stopped 2023-08-25T04:18:19.810 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-25T04:18:19.810 INFO:tasks.ceph.mds.b:Stopped 2023-08-25T04:18:19.811 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-25T04:18:19.850 INFO:tasks.ceph.mds.a:Started 2023-08-25T04:18:19.850 DEBUG:teuthology.parallel:result is None 2023-08-25T04:18:19.852 INFO:tasks.ceph.mds.c:Started 2023-08-25T04:18:19.852 DEBUG:teuthology.parallel:result is None 2023-08-25T04:18:19.860 INFO:tasks.ceph.mds.d:Started 2023-08-25T04:18:19.861 DEBUG:teuthology.parallel:result is None 2023-08-25T04:18:19.862 INFO:tasks.ceph.mds.b:Started 2023-08-25T04:18:19.862 DEBUG:teuthology.parallel:result is None 2023-08-25T04:18:19.864 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-25T04:18:19.938 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T04:18:19.939 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-08-25T04:18:19.953 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2023-08-25T04:18:19.954 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2023-08-25T04:18:20.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.018+0000 7fcc11248640 1 Processor -- start 2023-08-25T04:18:20.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.018+0000 7fcc11248640 1 -- start start 2023-08-25T04:18:20.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.018+0000 7fcc11248640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc0c0cdde0 0x7fcc0c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:20.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.018+0000 7fcc11248640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcc0c0b2e40 0x7fcc0c0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:20.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.018+0000 7fcc11248640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0c0b29b0 con 0x7fcc0c0d0da0 2023-08-25T04:18:20.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.018+0000 7fcc11248640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0c0ce760 con 0x7fcc0c0b2e40 2023-08-25T04:18:20.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.018+0000 7fcc11248640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0b1dc0 con 0x7fcc0c0cdde0 2023-08-25T04:18:20.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.018+0000 7fcc0ad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcc0c0d0da0 0x7fcc0c0d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55072/0 (socket says 172.21.15.55:55072) 2023-08-25T04:18:20.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.018+0000 7fcc0ad9d640 1 -- 172.21.15.55:0/886155078 learned_addr learned my addr 172.21.15.55:0/886155078 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:20.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.018+0000 7fcc0b59e640 1 --2- 172.21.15.55:0/886155078 >> v2:172.21.15.110:3300/0 conn(0x7fcc0c0b2e40 0x7fcc0c0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:20.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.018+0000 7fcc0259c640 1 --2- 172.21.15.55:0/886155078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc0c0cdde0 0x7fcc0c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:20.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.018+0000 7fcc0a59c640 1 -- 172.21.15.55:0/886155078 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417106122 0 0) 0x7fcc0c0b29b0 con 0x7fcc0c0d0da0 2023-08-25T04:18:20.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.018+0000 7fcc0259c640 1 -- 172.21.15.55:0/886155078 >> v2:172.21.15.110:3300/0 conn(0x7fcc0c0b2e40 msgr2=0x7fcc0c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:20.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.018+0000 7fcc0259c640 1 --2- 172.21.15.55:0/886155078 >> v2:172.21.15.110:3300/0 conn(0x7fcc0c0b2e40 0x7fcc0c0b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:20.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.018+0000 7fcc0259c640 1 -- 172.21.15.55:0/886155078 >> v1:172.21.15.55:6789/0 conn(0x7fcc0c0d0da0 legacy=0x7fcc0c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:20.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.018+0000 7fcc0259c640 1 -- 172.21.15.55:0/886155078 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0c0b2080 con 0x7fcc0c0cdde0 2023-08-25T04:18:20.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.018+0000 7fcc0b59e640 1 --2- 172.21.15.55:0/886155078 >> v2:172.21.15.110:3300/0 conn(0x7fcc0c0b2e40 0x7fcc0c0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:20.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.022+0000 7fcc0259c640 1 --2- 172.21.15.55:0/886155078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc0c0cdde0 0x7fcc0c0ce220 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40097c0 tx=0x7fcbf401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8543dfc74123d8c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:20.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.022+0000 7fcc0a59c640 1 -- 172.21.15.55:0/886155078 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf40a8970 con 0x7fcc0c0cdde0 2023-08-25T04:18:20.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.022+0000 7fcc0a59c640 1 -- 172.21.15.55:0/886155078 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf40a8ad0 con 0x7fcc0c0cdde0 2023-08-25T04:18:20.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.022+0000 7fcc0a59c640 1 -- 172.21.15.55:0/886155078 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf40a8e60 con 0x7fcc0c0cdde0 2023-08-25T04:18:20.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.022+0000 7fcc11248640 1 -- 172.21.15.55:0/886155078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc0c0cdde0 msgr2=0x7fcc0c0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:20.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.022+0000 7fcc11248640 1 --2- 172.21.15.55:0/886155078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc0c0cdde0 0x7fcc0c0ce220 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40097c0 tx=0x7fcbf401ec70 comp rx=0 tx=0).stop 2023-08-25T04:18:20.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.022+0000 7fcc11248640 1 -- 172.21.15.55:0/886155078 shutdown_connections 2023-08-25T04:18:20.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.022+0000 7fcc11248640 1 --2- 172.21.15.55:0/886155078 >> v2:172.21.15.110:3300/0 conn(0x7fcc0c0b2e40 0x7fcc0c0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:20.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.022+0000 7fcc11248640 1 --2- 172.21.15.55:0/886155078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc0c0cdde0 0x7fcc0c0ce220 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:20.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.022+0000 7fcc11248640 1 -- 172.21.15.55:0/886155078 >> 172.21.15.55:0/886155078 conn(0x7fcc0c09bae0 msgr2=0x7fcc0c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:20.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.022+0000 7fcc11248640 1 -- 172.21.15.55:0/886155078 shutdown_connections 2023-08-25T04:18:20.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.022+0000 7fcc11248640 1 -- 172.21.15.55:0/886155078 wait complete. 2023-08-25T04:18:20.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc11248640 1 Processor -- start 2023-08-25T04:18:20.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc11248640 1 -- start start 2023-08-25T04:18:20.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc11248640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc0c0b2e40 0x7fcc0c151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:20.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc11248640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc0c0cdde0 0x7fcc0c0cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:20.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc11248640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc0c0d0da0 0x7fcc0c15ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:20.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc11248640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c152260 con 0x7fcc0c0d0da0 2023-08-25T04:18:20.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc11248640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0c9d90 con 0x7fcc0c0cdde0 2023-08-25T04:18:20.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc11248640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0ca070 con 0x7fcc0c0b2e40 2023-08-25T04:18:20.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc0b59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc0c0d0da0 0x7fcc0c15ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:20.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc0b59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc0c0d0da0 0x7fcc0c15ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56804/0 (socket says 172.21.15.55:56804) 2023-08-25T04:18:20.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc0b59e640 1 -- 172.21.15.55:0/1488899526 learned_addr learned my addr 172.21.15.55:0/1488899526 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:20.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc0ad9d640 1 --2- 172.21.15.55:0/1488899526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc0c0b2e40 0x7fcc0c151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:20.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc0259c640 1 --2- 172.21.15.55:0/1488899526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc0c0cdde0 0x7fcc0c0cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:20.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc0b59e640 1 -- 172.21.15.55:0/1488899526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc0c0b2e40 msgr2=0x7fcc0c151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:20.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc0b59e640 1 --2- 172.21.15.55:0/1488899526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc0c0b2e40 0x7fcc0c151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:20.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc0b59e640 1 -- 172.21.15.55:0/1488899526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc0c0cdde0 msgr2=0x7fcc0c0cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:20.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc0b59e640 1 --2- 172.21.15.55:0/1488899526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc0c0cdde0 0x7fcc0c0cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:20.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc0b59e640 1 -- 172.21.15.55:0/1488899526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc04009420 con 0x7fcc0c0d0da0 2023-08-25T04:18:20.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc0b59e640 1 --2- 172.21.15.55:0/1488899526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc0c0d0da0 0x7fcc0c15ac50 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400e930 tx=0x7fcc0400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:20.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc03fff640 1 -- 172.21.15.55:0/1488899526 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc04009680 con 0x7fcc0c0d0da0 2023-08-25T04:18:20.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc03fff640 1 -- 172.21.15.55:0/1488899526 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc04004020 con 0x7fcc0c0d0da0 2023-08-25T04:18:20.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc11248640 1 -- 172.21.15.55:0/1488899526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf4009420 con 0x7fcc0c0d0da0 2023-08-25T04:18:20.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc03fff640 1 -- 172.21.15.55:0/1488899526 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc040043f0 con 0x7fcc0c0d0da0 2023-08-25T04:18:20.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.026+0000 7fcc11248640 1 -- 172.21.15.55:0/1488899526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0c0ca630 con 0x7fcc0c0d0da0 2023-08-25T04:18:20.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.030+0000 7fcc11248640 1 -- 172.21.15.55:0/1488899526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0c04dbe0 con 0x7fcc0c0d0da0 2023-08-25T04:18:20.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.030+0000 7fcc03fff640 1 -- 172.21.15.55:0/1488899526 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fcc0400c940 con 0x7fcc0c0d0da0 2023-08-25T04:18:20.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.030+0000 7fcc03fff640 1 --2- 172.21.15.55:0/1488899526 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fcbec0657a0 0x7fcbec067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:20.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.030+0000 7fcc03fff640 1 -- 172.21.15.55:0/1488899526 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fcc04082e60 con 0x7fcc0c0d0da0 2023-08-25T04:18:20.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.030+0000 7fcc0ad9d640 1 --2- 172.21.15.55:0/1488899526 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fcbec0657a0 0x7fcbec067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:20.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.030+0000 7fcc0ad9d640 1 --2- 172.21.15.55:0/1488899526 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fcbec0657a0 0x7fcbec067c60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc001470 tx=0x7fcbfc009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:20.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.034+0000 7fcc03fff640 1 -- 172.21.15.55:0/1488899526 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fcc04050890 con 0x7fcc0c0d0da0 2023-08-25T04:18:20.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:20.202+0000 7fcc11248640 1 -- 172.21.15.55:0/1488899526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcc0c0d0b80 con 0x7fcc0c0d0da0 2023-08-25T04:18:21.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.634+0000 7fcc03fff640 1 -- 172.21.15.55:0/1488899526 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v75) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcc04053eb0 con 0x7fcc0c0d0da0 2023-08-25T04:18:21.635 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-08-25T04:18:21.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.638+0000 7fcc11248640 1 -- 172.21.15.55:0/1488899526 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fcbec0657a0 msgr2=0x7fcbec067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:21.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.638+0000 7fcc11248640 1 --2- 172.21.15.55:0/1488899526 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fcbec0657a0 0x7fcbec067c60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc001470 tx=0x7fcbfc009040 comp rx=0 tx=0).stop 2023-08-25T04:18:21.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.638+0000 7fcc11248640 1 -- 172.21.15.55:0/1488899526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc0c0d0da0 msgr2=0x7fcc0c15ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:21.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.638+0000 7fcc11248640 1 --2- 172.21.15.55:0/1488899526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc0c0d0da0 0x7fcc0c15ac50 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400e930 tx=0x7fcc0400edf0 comp rx=0 tx=0).stop 2023-08-25T04:18:21.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.638+0000 7fcc11248640 1 -- 172.21.15.55:0/1488899526 shutdown_connections 2023-08-25T04:18:21.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.638+0000 7fcc11248640 1 --2- 172.21.15.55:0/1488899526 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fcbec0657a0 0x7fcbec067c60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:21.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.638+0000 7fcc11248640 1 --2- 172.21.15.55:0/1488899526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc0c0d0da0 0x7fcc0c15ac50 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:21.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.638+0000 7fcc11248640 1 --2- 172.21.15.55:0/1488899526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc0c0cdde0 0x7fcc0c0cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:21.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.638+0000 7fcc11248640 1 --2- 172.21.15.55:0/1488899526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc0c0b2e40 0x7fcc0c151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:21.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.638+0000 7fcc11248640 1 -- 172.21.15.55:0/1488899526 >> 172.21.15.55:0/1488899526 conn(0x7fcc0c09bae0 msgr2=0x7fcc0c06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:21.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.638+0000 7fcc11248640 1 -- 172.21.15.55:0/1488899526 shutdown_connections 2023-08-25T04:18:21.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.638+0000 7fcc11248640 1 -- 172.21.15.55:0/1488899526 wait complete. 2023-08-25T04:18:21.662 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-25T04:18:21.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.814+0000 7fbee1488640 1 Processor -- start 2023-08-25T04:18:21.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.814+0000 7fbee1488640 1 -- start start 2023-08-25T04:18:21.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.818+0000 7fbee1488640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbedc06cef0 0x7fbedc06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:21.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.818+0000 7fbee1488640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbedc06d2d0 0x7fbedc164dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:21.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.818+0000 7fbee1488640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbedc0cceb0 con 0x7fbedc0712a0 2023-08-25T04:18:21.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.818+0000 7fbee1488640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbedc0ca3e0 con 0x7fbedc06d2d0 2023-08-25T04:18:21.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.818+0000 7fbee1488640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0ca910 con 0x7fbedc06cef0 2023-08-25T04:18:21.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.818+0000 7fbedb7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbedc0712a0 0x7fbedc0cd3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34420/0 (socket says 172.21.15.55:34420) 2023-08-25T04:18:21.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.818+0000 7fbed27fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbedc06d2d0 0x7fbedc164dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:21.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.818+0000 7fbedb7fe640 1 -- 172.21.15.55:0/176394782 learned_addr learned my addr 172.21.15.55:0/176394782 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:21.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.818+0000 7fbedaffd640 1 --2- 172.21.15.55:0/176394782 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbedc06cef0 0x7fbedc06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:21.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.818+0000 7fbed27fc640 1 -- 172.21.15.55:0/176394782 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbedc06cef0 msgr2=0x7fbedc06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:21.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.818+0000 7fbed27fc640 1 --2- 172.21.15.55:0/176394782 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbedc06cef0 0x7fbedc06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:21.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.818+0000 7fbed27fc640 1 -- 172.21.15.55:0/176394782 >> v1:172.21.15.55:6789/0 conn(0x7fbedc0712a0 legacy=0x7fbedc0cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:21.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.818+0000 7fbeda7fc640 1 -- 172.21.15.55:0/176394782 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853488903 0 0) 0x7fbedc0cceb0 con 0x7fbedc0712a0 2023-08-25T04:18:21.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.818+0000 7fbed27fc640 1 -- 172.21.15.55:0/176394782 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc0cd100 con 0x7fbedc06d2d0 2023-08-25T04:18:21.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.822+0000 7fbed27fc640 1 --2- 172.21.15.55:0/176394782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbedc06d2d0 0x7fbedc164dc0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fbec40097c0 tx=0x7fbec401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d2b1db37eb30b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:21.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.822+0000 7fbeda7fc640 1 -- 172.21.15.55:0/176394782 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec40ab650 con 0x7fbedc06d2d0 2023-08-25T04:18:21.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.822+0000 7fbeda7fc640 1 -- 172.21.15.55:0/176394782 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec40ab7b0 con 0x7fbedc06d2d0 2023-08-25T04:18:21.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.822+0000 7fbeda7fc640 1 -- 172.21.15.55:0/176394782 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec40abb40 con 0x7fbedc06d2d0 2023-08-25T04:18:21.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.822+0000 7fbee1488640 1 -- 172.21.15.55:0/176394782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbedc06d2d0 msgr2=0x7fbedc164dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:21.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.822+0000 7fbee1488640 1 --2- 172.21.15.55:0/176394782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbedc06d2d0 0x7fbedc164dc0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fbec40097c0 tx=0x7fbec401c450 comp rx=0 tx=0).stop 2023-08-25T04:18:21.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.822+0000 7fbee1488640 1 -- 172.21.15.55:0/176394782 shutdown_connections 2023-08-25T04:18:21.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.822+0000 7fbee1488640 1 --2- 172.21.15.55:0/176394782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbedc06d2d0 0x7fbedc164dc0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:21.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.822+0000 7fbee1488640 1 --2- 172.21.15.55:0/176394782 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbedc06cef0 0x7fbedc06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:21.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.822+0000 7fbee1488640 1 -- 172.21.15.55:0/176394782 >> 172.21.15.55:0/176394782 conn(0x7fbedc0cabd0 msgr2=0x7fbedc0cafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:21.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.822+0000 7fbee1488640 1 -- 172.21.15.55:0/176394782 shutdown_connections 2023-08-25T04:18:21.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.822+0000 7fbee1488640 1 -- 172.21.15.55:0/176394782 wait complete. 2023-08-25T04:18:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.822+0000 7fbee1488640 1 Processor -- start 2023-08-25T04:18:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.822+0000 7fbee1488640 1 -- start start 2023-08-25T04:18:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbee1488640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbedc06cef0 0x7fbedc15d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:21.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbee1488640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbedc06d2d0 0x7fbedc098a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbee1488640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbedc0712a0 0x7fbedc098f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbee1488640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0b12d0 con 0x7fbedc06d2d0 2023-08-25T04:18:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbee1488640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0b15b0 con 0x7fbedc06cef0 2023-08-25T04:18:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbee1488640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0b1890 con 0x7fbedc0712a0 2023-08-25T04:18:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbed27fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbedc06d2d0 0x7fbedc098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbed27fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbedc06d2d0 0x7fbedc098a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45736/0 (socket says 172.21.15.55:45736) 2023-08-25T04:18:21.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbed27fc640 1 -- 172.21.15.55:0/3335043645 learned_addr learned my addr 172.21.15.55:0/3335043645 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:21.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbedaffd640 1 --2- 172.21.15.55:0/3335043645 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbedc06cef0 0x7fbedc15d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:21.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbedb7fe640 1 --2- 172.21.15.55:0/3335043645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbedc0712a0 0x7fbedc098f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:21.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbed27fc640 1 -- 172.21.15.55:0/3335043645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbedc0712a0 msgr2=0x7fbedc098f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:21.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbed27fc640 1 --2- 172.21.15.55:0/3335043645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbedc0712a0 0x7fbedc098f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:21.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbed27fc640 1 -- 172.21.15.55:0/3335043645 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbedc06cef0 msgr2=0x7fbedc15d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:21.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbed27fc640 1 --2- 172.21.15.55:0/3335043645 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbedc06cef0 0x7fbedc15d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:21.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbed27fc640 1 -- 172.21.15.55:0/3335043645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec4009420 con 0x7fbedc06d2d0 2023-08-25T04:18:21.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbed27fc640 1 --2- 172.21.15.55:0/3335043645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbedc06d2d0 0x7fbedc098a00 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fbec40ad040 tx=0x7fbec401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:21.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbed3fff640 1 -- 172.21.15.55:0/3335043645 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec40b5810 con 0x7fbedc06d2d0 2023-08-25T04:18:21.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbed3fff640 1 -- 172.21.15.55:0/3335043645 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec40b5970 con 0x7fbedc06d2d0 2023-08-25T04:18:21.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbed3fff640 1 -- 172.21.15.55:0/3335043645 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec40b5d20 con 0x7fbedc06d2d0 2023-08-25T04:18:21.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbee1488640 1 -- 172.21.15.55:0/3335043645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbedc0b1b70 con 0x7fbedc06d2d0 2023-08-25T04:18:21.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbee1488640 1 -- 172.21.15.55:0/3335043645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbedc15d9d0 con 0x7fbedc06d2d0 2023-08-25T04:18:21.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.826+0000 7fbee1488640 1 -- 172.21.15.55:0/3335043645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbedc073e50 con 0x7fbedc06d2d0 2023-08-25T04:18:21.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.830+0000 7fbed3fff640 1 -- 172.21.15.55:0/3335043645 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fbec40bf410 con 0x7fbedc06d2d0 2023-08-25T04:18:21.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.830+0000 7fbed3fff640 1 --2- 172.21.15.55:0/3335043645 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fbebc0657a0 0x7fbebc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:21.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.830+0000 7fbed3fff640 1 -- 172.21.15.55:0/3335043645 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbec411d880 con 0x7fbedc06d2d0 2023-08-25T04:18:21.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.830+0000 7fbedaffd640 1 --2- 172.21.15.55:0/3335043645 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fbebc0657a0 0x7fbebc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:21.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.830+0000 7fbedaffd640 1 --2- 172.21.15.55:0/3335043645 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fbebc0657a0 0x7fbebc067c60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbecc006fd0 tx=0x7fbecc008040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:21.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:21.834+0000 7fbed3fff640 1 -- 172.21.15.55:0/3335043645 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbec40eb740 con 0x7fbedc06d2d0 2023-08-25T04:18:22.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.046+0000 7fbee1488640 1 -- 172.21.15.55:0/3335043645 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbedc0b2020 con 0x7fbedc06d2d0 2023-08-25T04:18:22.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.046+0000 7fbed3fff640 1 -- 172.21.15.55:0/3335043645 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fbec40eed60 con 0x7fbedc06d2d0 2023-08-25T04:18:22.045 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:22.045 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T04:18:22.045 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-08-25T04:18:22.046 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.046 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-08-25T04:18:22.046 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkgFrTEBAAoan9rk8Q+qPyMjb2vGUHhA==", 2023-08-25T04:18:22.047 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.047 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:18:22.047 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:18:22.047 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:18:22.047 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:18:22.047 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.047 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:22.048 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.048 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-08-25T04:18:22.048 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk18hNHRAAzXuhzQEONXRzRXTeCH9fKQ==", 2023-08-25T04:18:22.048 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.048 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:18:22.049 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:18:22.049 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:18:22.049 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:18:22.049 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.049 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:22.049 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.049 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-08-25T04:18:22.050 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkLF9CGBAAqxgRU/02SsZfWuZPSYxuZA==", 2023-08-25T04:18:22.050 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.050 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:18:22.050 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:18:22.050 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:18:22.050 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:18:22.050 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.051 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:22.051 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.051 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-08-25T04:18:22.051 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hky6HiJBAAsrXlTDn2cxbk7PnqSgNNkA==", 2023-08-25T04:18:22.051 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.051 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:18:22.051 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:18:22.052 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:18:22.052 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:18:22.052 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.052 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:22.052 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.052 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-08-25T04:18:22.052 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC+J+hkY1tDFBAAVQY5Xl8On9pN3jLWwKWGTA==", 2023-08-25T04:18:22.053 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.053 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:18:22.053 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:18:22.053 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:18:22.053 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.053 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:22.053 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.054 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-08-25T04:18:22.054 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDBJ+hkpdBCHRAADyMAxTsnQfkD9G0p48H4zQ==", 2023-08-25T04:18:22.054 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.054 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:18:22.055 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:18:22.055 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:18:22.055 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.055 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:22.056 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.056 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-08-25T04:18:22.056 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDEJ+hkOR49KRAAudbqAxLItsoczide8ybzAg==", 2023-08-25T04:18:22.056 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.057 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:18:22.057 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:18:22.057 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:18:22.058 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.058 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:22.058 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.058 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-08-25T04:18:22.059 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDHJ+hkxun5MBAAAhGtJYVeL3ogL3TQV67diw==", 2023-08-25T04:18:22.059 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.059 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:18:22.060 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:18:22.060 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:18:22.060 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.061 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:22.061 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.061 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-08-25T04:18:22.061 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDMJ+hkuosTCRAAqCuwHFZFBVR/7nFtHHByNg==", 2023-08-25T04:18:22.062 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.062 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:18:22.062 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:18:22.062 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:18:22.063 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.063 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:22.063 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.063 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-08-25T04:18:22.063 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDPJ+hkJa+SDhAAllo6biVE99BZWvv5K/gXGw==", 2023-08-25T04:18:22.064 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.064 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:18:22.064 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:18:22.064 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:18:22.064 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.065 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:22.065 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.065 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-08-25T04:18:22.065 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDSJ+hkUPywFBAA4jua1Eu1nRl2L6hX/mycfw==", 2023-08-25T04:18:22.065 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.065 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:18:22.065 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:18:22.065 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:18:22.066 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.066 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:22.066 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.066 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-08-25T04:18:22.066 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDVJ+hkhyDMGxAAmcSWLzJqIE5w5H/E4wIurQ==", 2023-08-25T04:18:22.066 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.066 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:18:22.066 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:18:22.067 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:18:22.067 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.067 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:22.067 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.067 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-08-25T04:18:22.067 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g==", 2023-08-25T04:18:22.067 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.068 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:18:22.068 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-08-25T04:18:22.068 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-25T04:18:22.068 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.068 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:22.068 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.068 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-08-25T04:18:22.068 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk8KsDMxAAKyK4jMKflYNnJXYIbr2OBQ==", 2023-08-25T04:18:22.069 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.069 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:18:22.069 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:18:22.069 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:18:22.069 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:18:22.069 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.069 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:22.069 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.070 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-08-25T04:18:22.070 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjSA4LxAAxzbnHeV85qYZYhSqTOT2rw==", 2023-08-25T04:18:22.070 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.070 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:18:22.070 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:18:22.070 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:18:22.070 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:18:22.070 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.071 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:22.071 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.071 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-08-25T04:18:22.071 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkl9AoORAARYZcPObsM/HT/yrTmneZrw==", 2023-08-25T04:18:22.071 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.071 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:18:22.071 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:18:22.072 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:18:22.072 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:18:22.072 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.072 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:22.072 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.072 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-08-25T04:18:22.072 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC2J+hkgTdcLxAAqxSepXXhEultFAFYBBKSag==", 2023-08-25T04:18:22.073 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.073 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:18:22.073 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:18:22.073 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:18:22.073 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:18:22.073 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.073 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:22.073 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.074 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-08-25T04:18:22.074 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkYGUZDBAAiuDo9hqavWq7zQlGd6x4YQ==", 2023-08-25T04:18:22.074 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.074 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:18:22.074 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T04:18:22.074 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:18:22.074 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.074 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:22.075 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:22.075 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-08-25T04:18:22.075 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjr9KCBAApSqjtFhLnjHduMBu/eaaKw==", 2023-08-25T04:18:22.075 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:18:22.075 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:18:22.075 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T04:18:22.075 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:18:22.075 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.076 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:22.076 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-08-25T04:18:22.076 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T04:18:22.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.046+0000 7fbee1488640 1 -- 172.21.15.55:0/3335043645 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fbebc0657a0 msgr2=0x7fbebc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:22.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.046+0000 7fbee1488640 1 --2- 172.21.15.55:0/3335043645 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fbebc0657a0 0x7fbebc067c60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbecc006fd0 tx=0x7fbecc008040 comp rx=0 tx=0).stop 2023-08-25T04:18:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.046+0000 7fbee1488640 1 -- 172.21.15.55:0/3335043645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbedc06d2d0 msgr2=0x7fbedc098a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.046+0000 7fbee1488640 1 --2- 172.21.15.55:0/3335043645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbedc06d2d0 0x7fbedc098a00 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fbec40ad040 tx=0x7fbec401ac90 comp rx=0 tx=0).stop 2023-08-25T04:18:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.046+0000 7fbee1488640 1 -- 172.21.15.55:0/3335043645 shutdown_connections 2023-08-25T04:18:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.046+0000 7fbee1488640 1 --2- 172.21.15.55:0/3335043645 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fbebc0657a0 0x7fbebc067c60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.046+0000 7fbee1488640 1 --2- 172.21.15.55:0/3335043645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbedc0712a0 0x7fbedc098f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.046+0000 7fbee1488640 1 --2- 172.21.15.55:0/3335043645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbedc06d2d0 0x7fbedc098a00 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.046+0000 7fbee1488640 1 --2- 172.21.15.55:0/3335043645 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbedc06cef0 0x7fbedc15d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.046+0000 7fbee1488640 1 -- 172.21.15.55:0/3335043645 >> 172.21.15.55:0/3335043645 conn(0x7fbedc0cabd0 msgr2=0x7fbedc0ae280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.046+0000 7fbee1488640 1 -- 172.21.15.55:0/3335043645 shutdown_connections 2023-08-25T04:18:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.046+0000 7fbee1488640 1 -- 172.21.15.55:0/3335043645 wait complete. 2023-08-25T04:18:22.079 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:18:22.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.222+0000 7f9354b1e640 1 Processor -- start 2023-08-25T04:18:22.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.222+0000 7f9354b1e640 1 -- start start 2023-08-25T04:18:22.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.226+0000 7f9354b1e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f935015eba0 0x7f93500b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.226+0000 7f9354b1e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f935015ef80 0x7f93500ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.226+0000 7f9354b1e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93500cece0 0x7f93500cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.226+0000 7f9354b1e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93500cf170 con 0x7f93500cece0 2023-08-25T04:18:22.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.226+0000 7f9354b1e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93500ac3a0 con 0x7f935015ef80 2023-08-25T04:18:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.226+0000 7f9354b1e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93500b1390 con 0x7f935015eba0 2023-08-25T04:18:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.226+0000 7f934ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93500cece0 0x7f93500cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.226+0000 7f934ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93500cece0 0x7f93500cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45742/0 (socket says 172.21.15.55:45742) 2023-08-25T04:18:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.226+0000 7f934ed9d640 1 -- 172.21.15.55:0/2013578887 learned_addr learned my addr 172.21.15.55:0/2013578887 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.226+0000 7f9347fff640 1 --2- 172.21.15.55:0/2013578887 >> v2:172.21.15.110:3300/0 conn(0x7f935015ef80 0x7f93500ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.226+0000 7f934e59c640 1 --2- 172.21.15.55:0/2013578887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f935015eba0 0x7f93500b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.226+0000 7f934ed9d640 1 -- 172.21.15.55:0/2013578887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f935015eba0 msgr2=0x7f93500b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:22.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.226+0000 7f934ed9d640 1 --2- 172.21.15.55:0/2013578887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f935015eba0 0x7f93500b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.226+0000 7f934ed9d640 1 -- 172.21.15.55:0/2013578887 >> v2:172.21.15.110:3300/0 conn(0x7f935015ef80 msgr2=0x7f93500ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:22.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.226+0000 7f934ed9d640 1 --2- 172.21.15.55:0/2013578887 >> v2:172.21.15.110:3300/0 conn(0x7f935015ef80 0x7f93500ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.226+0000 7f934ed9d640 1 -- 172.21.15.55:0/2013578887 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93500b1670 con 0x7f93500cece0 2023-08-25T04:18:22.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.226+0000 7f9347fff640 1 --2- 172.21.15.55:0/2013578887 >> v2:172.21.15.110:3300/0 conn(0x7f935015ef80 0x7f93500ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:22.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.226+0000 7f934e59c640 1 --2- 172.21.15.55:0/2013578887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f935015eba0 0x7f93500b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:22.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.230+0000 7f934ed9d640 1 --2- 172.21.15.55:0/2013578887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93500cece0 0x7f93500cd370 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f93500cbe60 tx=0x7f934801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ae4c3bf5661bd4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:22.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.230+0000 7f934dd9b640 1 -- 172.21.15.55:0/2013578887 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93480a5560 con 0x7f93500cece0 2023-08-25T04:18:22.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.230+0000 7f934dd9b640 1 -- 172.21.15.55:0/2013578887 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93480a56c0 con 0x7f93500cece0 2023-08-25T04:18:22.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.230+0000 7f934dd9b640 1 -- 172.21.15.55:0/2013578887 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93480a5a50 con 0x7f93500cece0 2023-08-25T04:18:22.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.230+0000 7f9354b1e640 1 -- 172.21.15.55:0/2013578887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93500cece0 msgr2=0x7f93500cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:22.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.230+0000 7f9354b1e640 1 --2- 172.21.15.55:0/2013578887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93500cece0 0x7f93500cd370 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f93500cbe60 tx=0x7f934801c6e0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.230+0000 7f9354b1e640 1 -- 172.21.15.55:0/2013578887 shutdown_connections 2023-08-25T04:18:22.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.230+0000 7f9354b1e640 1 --2- 172.21.15.55:0/2013578887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93500cece0 0x7f93500cd370 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.230+0000 7f9354b1e640 1 --2- 172.21.15.55:0/2013578887 >> v2:172.21.15.110:3300/0 conn(0x7f935015ef80 0x7f93500ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.230+0000 7f9354b1e640 1 --2- 172.21.15.55:0/2013578887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f935015eba0 0x7f93500b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.230+0000 7f9354b1e640 1 -- 172.21.15.55:0/2013578887 >> 172.21.15.55:0/2013578887 conn(0x7f9350069d00 msgr2=0x7f935006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:22.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.230+0000 7f9354b1e640 1 -- 172.21.15.55:0/2013578887 shutdown_connections 2023-08-25T04:18:22.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.230+0000 7f9354b1e640 1 -- 172.21.15.55:0/2013578887 wait complete. 2023-08-25T04:18:22.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.230+0000 7f9354b1e640 1 Processor -- start 2023-08-25T04:18:22.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.230+0000 7f9354b1e640 1 -- start start 2023-08-25T04:18:22.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f9354b1e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93500cece0 0x7f935006d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f9354b1e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f935015eba0 0x7f9350163770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f9354b1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f935015ef80 0x7f93500caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f9354b1e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935015c1e0 con 0x7f935015ef80 2023-08-25T04:18:22.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f9354b1e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935006d5d0 con 0x7f93500cece0 2023-08-25T04:18:22.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f9354b1e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9350163fc0 con 0x7f935015eba0 2023-08-25T04:18:22.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f934ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f935015ef80 0x7f93500caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f934ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f935015ef80 0x7f93500caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45756/0 (socket says 172.21.15.55:45756) 2023-08-25T04:18:22.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f934ed9d640 1 -- 172.21.15.55:0/1030189005 learned_addr learned my addr 172.21.15.55:0/1030189005 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:22.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f9347fff640 1 --2- 172.21.15.55:0/1030189005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f935015eba0 0x7f9350163770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f934e59c640 1 --2- 172.21.15.55:0/1030189005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93500cece0 0x7f935006d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f934ed9d640 1 -- 172.21.15.55:0/1030189005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f935015eba0 msgr2=0x7f9350163770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:22.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f934ed9d640 1 --2- 172.21.15.55:0/1030189005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f935015eba0 0x7f9350163770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f934ed9d640 1 -- 172.21.15.55:0/1030189005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93500cece0 msgr2=0x7f935006d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:22.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f934ed9d640 1 --2- 172.21.15.55:0/1030189005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93500cece0 0x7f935006d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f934ed9d640 1 -- 172.21.15.55:0/1030189005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9348009b30 con 0x7f935015ef80 2023-08-25T04:18:22.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f9347fff640 1 --2- 172.21.15.55:0/1030189005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f935015eba0 0x7f9350163770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:22.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f934e59c640 1 --2- 172.21.15.55:0/1030189005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93500cece0 0x7f935006d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:22.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f934ed9d640 1 --2- 172.21.15.55:0/1030189005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f935015ef80 0x7f93500caad0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f934801ad90 tx=0x7f9348019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:22.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f9346ffd640 1 -- 172.21.15.55:0/1030189005 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93480a5560 con 0x7f935015ef80 2023-08-25T04:18:22.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f9346ffd640 1 -- 172.21.15.55:0/1030189005 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93480b8670 con 0x7f935015ef80 2023-08-25T04:18:22.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f9354b1e640 1 -- 172.21.15.55:0/1030189005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93501642a0 con 0x7f935015ef80 2023-08-25T04:18:22.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f9346ffd640 1 -- 172.21.15.55:0/1030189005 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93480b8a20 con 0x7f935015ef80 2023-08-25T04:18:22.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f9354b1e640 1 -- 172.21.15.55:0/1030189005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9350164860 con 0x7f935015ef80 2023-08-25T04:18:22.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f9354b1e640 1 -- 172.21.15.55:0/1030189005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f935004dbe0 con 0x7f935015ef80 2023-08-25T04:18:22.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.234+0000 7f9346ffd640 1 -- 172.21.15.55:0/1030189005 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f93480b8b80 con 0x7f935015ef80 2023-08-25T04:18:22.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.238+0000 7f9346ffd640 1 --2- 172.21.15.55:0/1030189005 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f93300657a0 0x7f9330067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.238+0000 7f9346ffd640 1 -- 172.21.15.55:0/1030189005 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f934811dfb0 con 0x7f935015ef80 2023-08-25T04:18:22.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.238+0000 7f934e59c640 1 --2- 172.21.15.55:0/1030189005 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f93300657a0 0x7f9330067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.238+0000 7f934e59c640 1 --2- 172.21.15.55:0/1030189005 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f93300657a0 0x7f9330067c60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f934000d940 tx=0x7f9340008040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:22.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.242+0000 7f9346ffd640 1 -- 172.21.15.55:0/1030189005 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f93480ebd30 con 0x7f935015ef80 2023-08-25T04:18:22.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.398+0000 7f9354b1e640 1 -- 172.21.15.55:0/1030189005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93500ccc40 con 0x7f935015ef80 2023-08-25T04:18:22.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.398+0000 7f9346ffd640 1 -- 172.21.15.55:0/1030189005 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+14651 (secure 0 0 0) 0x7f9348009510 con 0x7f935015ef80 2023-08-25T04:18:22.397 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:22.398 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":75,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:18:21.633160+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:18:22.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.398+0000 7f9354b1e640 1 -- 172.21.15.55:0/1030189005 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f93300657a0 msgr2=0x7f9330067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:22.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.398+0000 7f9354b1e640 1 --2- 172.21.15.55:0/1030189005 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f93300657a0 0x7f9330067c60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f934000d940 tx=0x7f9340008040 comp rx=0 tx=0).stop 2023-08-25T04:18:22.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.398+0000 7f9354b1e640 1 -- 172.21.15.55:0/1030189005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f935015ef80 msgr2=0x7f93500caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:22.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.398+0000 7f9354b1e640 1 --2- 172.21.15.55:0/1030189005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f935015ef80 0x7f93500caad0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f934801ad90 tx=0x7f9348019480 comp rx=0 tx=0).stop 2023-08-25T04:18:22.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.398+0000 7f9354b1e640 1 -- 172.21.15.55:0/1030189005 shutdown_connections 2023-08-25T04:18:22.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.398+0000 7f9354b1e640 1 --2- 172.21.15.55:0/1030189005 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f93300657a0 0x7f9330067c60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.398+0000 7f9354b1e640 1 --2- 172.21.15.55:0/1030189005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f935015ef80 0x7f93500caad0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.398+0000 7f9354b1e640 1 --2- 172.21.15.55:0/1030189005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f935015eba0 0x7f9350163770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.398+0000 7f9354b1e640 1 --2- 172.21.15.55:0/1030189005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93500cece0 0x7f935006d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.398+0000 7f9354b1e640 1 -- 172.21.15.55:0/1030189005 >> 172.21.15.55:0/1030189005 conn(0x7f9350069d00 msgr2=0x7f935006fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:22.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.398+0000 7f9354b1e640 1 -- 172.21.15.55:0/1030189005 shutdown_connections 2023-08-25T04:18:22.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.398+0000 7f9354b1e640 1 -- 172.21.15.55:0/1030189005 wait complete. 2023-08-25T04:18:22.419 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:18:22.420 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:18:22.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.566+0000 7f3b6409c640 1 Processor -- start 2023-08-25T04:18:22.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.566+0000 7f3b6409c640 1 -- start start 2023-08-25T04:18:22.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b6409c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3b5c0ad7b0 0x7f3b5c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b6409c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b5c0c1aa0 0x7f3b5c0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b6409c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5c161440 con 0x7f3b5c164b30 2023-08-25T04:18:22.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b6409c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5c06cb20 con 0x7f3b5c0ad7b0 2023-08-25T04:18:22.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b6409c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c06ce00 con 0x7f3b5c0c1aa0 2023-08-25T04:18:22.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b61637640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3b5c164b30 0x7f3b5c0c1390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34436/0 (socket says 172.21.15.55:34436) 2023-08-25T04:18:22.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b61637640 1 -- 172.21.15.55:0/2192890255 learned_addr learned my addr 172.21.15.55:0/2192890255 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:22.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b60e36640 1 -- 172.21.15.55:0/2192890255 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432958300 0 0) 0x7f3b5c161440 con 0x7f3b5c164b30 2023-08-25T04:18:22.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b62639640 1 --2- 172.21.15.55:0/2192890255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b5c0c1aa0 0x7f3b5c0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b61e38640 1 --2- 172.21.15.55:0/2192890255 >> v2:172.21.15.110:3300/0 conn(0x7f3b5c0ad7b0 0x7f3b5c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b60e36640 1 -- 172.21.15.55:0/2192890255 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b48003530 con 0x7f3b5c164b30 2023-08-25T04:18:22.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b60e36640 1 -- 172.21.15.55:0/2192890255 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2397247057 0 0) 0x7f3b48003530 con 0x7f3b5c164b30 2023-08-25T04:18:22.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b60e36640 1 -- 172.21.15.55:0/2192890255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b5c0c1aa0 msgr2=0x7f3b5c0c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:22.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b60e36640 1 --2- 172.21.15.55:0/2192890255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b5c0c1aa0 0x7f3b5c0c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b60e36640 1 -- 172.21.15.55:0/2192890255 >> v2:172.21.15.110:3300/0 conn(0x7f3b5c0ad7b0 msgr2=0x7f3b5c06c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:22.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b60e36640 1 --2- 172.21.15.55:0/2192890255 >> v2:172.21.15.110:3300/0 conn(0x7f3b5c0ad7b0 0x7f3b5c06c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b60e36640 1 -- 172.21.15.55:0/2192890255 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c06d0e0 con 0x7f3b5c164b30 2023-08-25T04:18:22.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b60e36640 1 -- 172.21.15.55:0/2192890255 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f3b4c001680 con 0x7f3b5c164b30 2023-08-25T04:18:22.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b60e36640 1 -- 172.21.15.55:0/2192890255 >> v1:172.21.15.55:6789/0 conn(0x7f3b5c164b30 legacy=0x7f3b5c0c1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:22.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b60e36640 1 --2- 172.21.15.55:0/2192890255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b5c0c1aa0 0x7f3b48003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b60e36640 1 --2- 172.21.15.55:0/2192890255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b48003f00 0x7f3b480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b60e36640 1 --2- 172.21.15.55:0/2192890255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b48004d10 0x7f3b48005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b60e36640 1 -- 172.21.15.55:0/2192890255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c06cb20 con 0x7f3b48003f00 2023-08-25T04:18:22.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b60e36640 1 -- 172.21.15.55:0/2192890255 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c06ce00 con 0x7f3b48004d10 2023-08-25T04:18:22.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b60e36640 1 -- 172.21.15.55:0/2192890255 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4800b9c0 con 0x7f3b5c0c1aa0 2023-08-25T04:18:22.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b61637640 1 --2- 172.21.15.55:0/2192890255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b48003f00 0x7f3b480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b61e38640 1 --2- 172.21.15.55:0/2192890255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b5c0c1aa0 0x7f3b48003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b62639640 1 --2- 172.21.15.55:0/2192890255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b48004d10 0x7f3b48005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b61637640 1 -- 172.21.15.55:0/2192890255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b5c0c1aa0 msgr2=0x7f3b48003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:22.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b61637640 1 --2- 172.21.15.55:0/2192890255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b5c0c1aa0 0x7f3b48003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b61637640 1 -- 172.21.15.55:0/2192890255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b48004d10 msgr2=0x7f3b48005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:22.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b61637640 1 --2- 172.21.15.55:0/2192890255 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b48004d10 0x7f3b48005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.570+0000 7f3b61637640 1 -- 172.21.15.55:0/2192890255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b48003530 con 0x7f3b48003f00 2023-08-25T04:18:22.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.574+0000 7f3b61637640 1 --2- 172.21.15.55:0/2192890255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b48003f00 0x7f3b480047d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c00c290 tx=0x7f3b4c01cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e17f938177b442 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:22.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.574+0000 7f3b60e36640 1 -- 172.21.15.55:0/2192890255 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0a5950 con 0x7f3b48003f00 2023-08-25T04:18:22.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.574+0000 7f3b60e36640 1 -- 172.21.15.55:0/2192890255 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c0a5ab0 con 0x7f3b48003f00 2023-08-25T04:18:22.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.574+0000 7f3b60e36640 1 -- 172.21.15.55:0/2192890255 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0a5e60 con 0x7f3b48003f00 2023-08-25T04:18:22.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.574+0000 7f3b6409c640 1 -- 172.21.15.55:0/2192890255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b48003f00 msgr2=0x7f3b480047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:22.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.574+0000 7f3b6409c640 1 --2- 172.21.15.55:0/2192890255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b48003f00 0x7f3b480047d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c00c290 tx=0x7f3b4c01cce0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.574+0000 7f3b62639640 1 -- 172.21.15.55:0/2192890255 reap_dead start 2023-08-25T04:18:22.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.574+0000 7f3b6409c640 1 -- 172.21.15.55:0/2192890255 shutdown_connections 2023-08-25T04:18:22.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.574+0000 7f3b6409c640 1 -- 172.21.15.55:0/2192890255 >> 172.21.15.55:0/2192890255 conn(0x7f3b5c069900 msgr2=0x7f3b5c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:22.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.574+0000 7f3b6409c640 1 -- 172.21.15.55:0/2192890255 shutdown_connections 2023-08-25T04:18:22.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.574+0000 7f3b6409c640 1 -- 172.21.15.55:0/2192890255 wait complete. 2023-08-25T04:18:22.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b6409c640 1 Processor -- start 2023-08-25T04:18:22.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b6409c640 1 -- start start 2023-08-25T04:18:22.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b6409c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b48003f00 0x7f3b5c0ac280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b6409c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b5c0c2120 0x7f3b5c1584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b6409c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5c0c25a0 0x7f3b5c158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b6409c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0c2b00 con 0x7f3b5c0c25a0 2023-08-25T04:18:22.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b6409c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0c2de0 con 0x7f3b48003f00 2023-08-25T04:18:22.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b6409c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c0c30c0 con 0x7f3b5c0c2120 2023-08-25T04:18:22.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b62639640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5c0c25a0 0x7f3b5c158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b62639640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5c0c25a0 0x7f3b5c158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45770/0 (socket says 172.21.15.55:45770) 2023-08-25T04:18:22.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b62639640 1 -- 172.21.15.55:0/716279734 learned_addr learned my addr 172.21.15.55:0/716279734 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:22.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b61e38640 1 --2- 172.21.15.55:0/716279734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b48003f00 0x7f3b5c0ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b61637640 1 --2- 172.21.15.55:0/716279734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b5c0c2120 0x7f3b5c1584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b62639640 1 -- 172.21.15.55:0/716279734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b5c0c2120 msgr2=0x7f3b5c1584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:22.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b62639640 1 --2- 172.21.15.55:0/716279734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b5c0c2120 0x7f3b5c1584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b62639640 1 -- 172.21.15.55:0/716279734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b48003f00 msgr2=0x7f3b5c0ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:22.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b62639640 1 --2- 172.21.15.55:0/716279734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b48003f00 0x7f3b5c0ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b62639640 1 -- 172.21.15.55:0/716279734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5c0c33a0 con 0x7f3b5c0c25a0 2023-08-25T04:18:22.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b62639640 1 --2- 172.21.15.55:0/716279734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5c0c25a0 0x7f3b5c158a20 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c06f9d0 tx=0x7f3b5400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:22.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b527fc640 1 -- 172.21.15.55:0/716279734 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5400e040 con 0x7f3b5c0c25a0 2023-08-25T04:18:22.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b527fc640 1 -- 172.21.15.55:0/716279734 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5400f040 con 0x7f3b5c0c25a0 2023-08-25T04:18:22.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b6409c640 1 -- 172.21.15.55:0/716279734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5c1627d0 con 0x7f3b5c0c25a0 2023-08-25T04:18:22.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b527fc640 1 -- 172.21.15.55:0/716279734 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54015430 con 0x7f3b5c0c25a0 2023-08-25T04:18:22.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.578+0000 7f3b6409c640 1 -- 172.21.15.55:0/716279734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5c1f9ce0 con 0x7f3b5c0c25a0 2023-08-25T04:18:22.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.582+0000 7f3b6409c640 1 -- 172.21.15.55:0/716279734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5c073ec0 con 0x7f3b5c0c25a0 2023-08-25T04:18:22.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.582+0000 7f3b527fc640 1 -- 172.21.15.55:0/716279734 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f3b54015590 con 0x7f3b5c0c25a0 2023-08-25T04:18:22.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.582+0000 7f3b527fc640 1 --2- 172.21.15.55:0/716279734 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f3b400657d0 0x7f3b40067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.582+0000 7f3b527fc640 1 -- 172.21.15.55:0/716279734 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3b54084070 con 0x7f3b5c0c25a0 2023-08-25T04:18:22.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.582+0000 7f3b61e38640 1 --2- 172.21.15.55:0/716279734 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f3b400657d0 0x7f3b40067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.582+0000 7f3b61e38640 1 --2- 172.21.15.55:0/716279734 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f3b400657d0 0x7f3b40067c90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3b58009bc0 tx=0x7f3b58006f90 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:22.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.586+0000 7f3b527fc640 1 -- 172.21.15.55:0/716279734 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3b54051c40 con 0x7f3b5c0c25a0 2023-08-25T04:18:22.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.742+0000 7f3b6409c640 1 -- 172.21.15.55:0/716279734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b5c161100 con 0x7f3b5c0c25a0 2023-08-25T04:18:22.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.742+0000 7f3b527fc640 1 -- 172.21.15.55:0/716279734 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b54055260 con 0x7f3b5c0c25a0 2023-08-25T04:18:22.742 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:18:22.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.746+0000 7f3b6409c640 1 -- 172.21.15.55:0/716279734 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f3b400657d0 msgr2=0x7f3b40067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:22.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.746+0000 7f3b6409c640 1 --2- 172.21.15.55:0/716279734 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f3b400657d0 0x7f3b40067c90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3b58009bc0 tx=0x7f3b58006f90 comp rx=0 tx=0).stop 2023-08-25T04:18:22.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.746+0000 7f3b6409c640 1 -- 172.21.15.55:0/716279734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5c0c25a0 msgr2=0x7f3b5c158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:22.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.746+0000 7f3b6409c640 1 --2- 172.21.15.55:0/716279734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5c0c25a0 0x7f3b5c158a20 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c06f9d0 tx=0x7f3b5400f1b0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.746+0000 7f3b6409c640 1 -- 172.21.15.55:0/716279734 shutdown_connections 2023-08-25T04:18:22.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.746+0000 7f3b6409c640 1 --2- 172.21.15.55:0/716279734 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f3b400657d0 0x7f3b40067c90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.746+0000 7f3b6409c640 1 --2- 172.21.15.55:0/716279734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b5c0c25a0 0x7f3b5c158a20 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.746+0000 7f3b6409c640 1 --2- 172.21.15.55:0/716279734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b5c0c2120 0x7f3b5c1584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.746+0000 7f3b6409c640 1 --2- 172.21.15.55:0/716279734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b48003f00 0x7f3b5c0ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.746+0000 7f3b6409c640 1 -- 172.21.15.55:0/716279734 >> 172.21.15.55:0/716279734 conn(0x7f3b5c069900 msgr2=0x7f3b5c071750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:22.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.746+0000 7f3b6409c640 1 -- 172.21.15.55:0/716279734 shutdown_connections 2023-08-25T04:18:22.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.746+0000 7f3b6409c640 1 -- 172.21.15.55:0/716279734 wait complete. 2023-08-25T04:18:22.763 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:18:22.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.910+0000 7f085d758640 1 Processor -- start 2023-08-25T04:18:22.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.910+0000 7f085d758640 1 -- start start 2023-08-25T04:18:22.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.914+0000 7f085d758640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f085815fca0 0x7f08580cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.914+0000 7f085d758640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f08580b8330 0x7f08580cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.914+0000 7f085d758640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08580b70c0 con 0x7f08580d0bd0 2023-08-25T04:18:22.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.914+0000 7f085d758640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0858160080 con 0x7f085815fca0 2023-08-25T04:18:22.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.914+0000 7f085d758640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08580b73a0 con 0x7f08580b8330 2023-08-25T04:18:22.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.914+0000 7f0857fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f085815fca0 0x7f08580cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.914+0000 7f0857fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f085815fca0 0x7f08580cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45776/0 (socket says 172.21.15.55:45776) 2023-08-25T04:18:22.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.914+0000 7f0857fff640 1 -- 172.21.15.55:0/125756641 learned_addr learned my addr 172.21.15.55:0/125756641 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:22.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.914+0000 7f0857fff640 1 -- 172.21.15.55:0/125756641 >> v2:172.21.15.110:3300/0 conn(0x7f08580b8330 msgr2=0x7f08580cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:22.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.914+0000 7f08577fe640 1 --2- 172.21.15.55:0/125756641 >> v2:172.21.15.110:3300/0 conn(0x7f08580b8330 0x7f08580cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.914+0000 7f0857fff640 1 --2- 172.21.15.55:0/125756641 >> v2:172.21.15.110:3300/0 conn(0x7f08580b8330 0x7f08580cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.914+0000 7f0857fff640 1 -- 172.21.15.55:0/125756641 >> v1:172.21.15.110:6789/0 conn(0x7f08580d0bd0 legacy=0x7f08580d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:22.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.914+0000 7f0857fff640 1 -- 172.21.15.55:0/125756641 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08580b7680 con 0x7f085815fca0 2023-08-25T04:18:22.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.914+0000 7f08577fe640 1 --2- 172.21.15.55:0/125756641 >> v2:172.21.15.110:3300/0 conn(0x7f08580b8330 0x7f08580cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:22.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.918+0000 7f0857fff640 1 --2- 172.21.15.55:0/125756641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f085815fca0 0x7f08580cf580 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f08580b4170 tx=0x7f084801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae6846d7c681676 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:22.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.918+0000 7f0856ffd640 1 -- 172.21.15.55:0/125756641 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480a89b0 con 0x7f085815fca0 2023-08-25T04:18:22.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.918+0000 7f0856ffd640 1 -- 172.21.15.55:0/125756641 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08480a8b10 con 0x7f085815fca0 2023-08-25T04:18:22.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.918+0000 7f0856ffd640 1 -- 172.21.15.55:0/125756641 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480a8ea0 con 0x7f085815fca0 2023-08-25T04:18:22.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.918+0000 7f085d758640 1 -- 172.21.15.55:0/125756641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f085815fca0 msgr2=0x7f08580cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.918+0000 7f085d758640 1 --2- 172.21.15.55:0/125756641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f085815fca0 0x7f08580cf580 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f08580b4170 tx=0x7f084801ecb0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.918+0000 7f085d758640 1 -- 172.21.15.55:0/125756641 shutdown_connections 2023-08-25T04:18:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.918+0000 7f085d758640 1 --2- 172.21.15.55:0/125756641 >> v2:172.21.15.110:3300/0 conn(0x7f08580b8330 0x7f08580cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.918+0000 7f085d758640 1 --2- 172.21.15.55:0/125756641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f085815fca0 0x7f08580cf580 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.918+0000 7f085d758640 1 -- 172.21.15.55:0/125756641 >> 172.21.15.55:0/125756641 conn(0x7f08580658c0 msgr2=0x7f0858065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.918+0000 7f085d758640 1 -- 172.21.15.55:0/125756641 shutdown_connections 2023-08-25T04:18:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.918+0000 7f085d758640 1 -- 172.21.15.55:0/125756641 wait complete. 2023-08-25T04:18:22.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.918+0000 7f085d758640 1 Processor -- start 2023-08-25T04:18:22.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.918+0000 7f085d758640 1 -- start start 2023-08-25T04:18:22.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.918+0000 7f085d758640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08580b8330 0x7f085814cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.918+0000 7f085d758640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08580d0bd0 0x7f08580c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.918+0000 7f085d758640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f085815fca0 0x7f085814f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f085d758640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08580c88b0 con 0x7f08580d0bd0 2023-08-25T04:18:22.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f085d758640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085814d040 con 0x7f08580b8330 2023-08-25T04:18:22.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f085d758640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08580c7ca0 con 0x7f085815fca0 2023-08-25T04:18:22.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f08577fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08580d0bd0 0x7f08580c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f08577fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08580d0bd0 0x7f08580c7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45784/0 (socket says 172.21.15.55:45784) 2023-08-25T04:18:22.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f08577fe640 1 -- 172.21.15.55:0/1453942701 learned_addr learned my addr 172.21.15.55:0/1453942701 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:22.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f08577fe640 1 -- 172.21.15.55:0/1453942701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f085815fca0 msgr2=0x7f085814f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:22.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f08577fe640 1 --2- 172.21.15.55:0/1453942701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f085815fca0 0x7f085814f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f0857fff640 1 --2- 172.21.15.55:0/1453942701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08580b8330 0x7f085814cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f08577fe640 1 -- 172.21.15.55:0/1453942701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08580b8330 msgr2=0x7f085814cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:22.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f08577fe640 1 --2- 172.21.15.55:0/1453942701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08580b8330 0x7f085814cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:22.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f08577fe640 1 -- 172.21.15.55:0/1453942701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08480094d0 con 0x7f08580d0bd0 2023-08-25T04:18:22.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f0857fff640 1 --2- 172.21.15.55:0/1453942701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08580b8330 0x7f085814cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:22.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f08577fe640 1 --2- 172.21.15.55:0/1453942701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08580d0bd0 0x7f08580c7290 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f084c00c7f0 tx=0x7f084c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:22.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f0854ff9640 1 -- 172.21.15.55:0/1453942701 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c00cea0 con 0x7f08580d0bd0 2023-08-25T04:18:22.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f0854ff9640 1 -- 172.21.15.55:0/1453942701 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084c007a30 con 0x7f08580d0bd0 2023-08-25T04:18:22.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f0854ff9640 1 -- 172.21.15.55:0/1453942701 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c007dc0 con 0x7f08580d0bd0 2023-08-25T04:18:22.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f085d758640 1 -- 172.21.15.55:0/1453942701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08580c7f80 con 0x7f08580d0bd0 2023-08-25T04:18:22.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f085d758640 1 -- 172.21.15.55:0/1453942701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08580c8540 con 0x7f08580d0bd0 2023-08-25T04:18:22.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f085d758640 1 -- 172.21.15.55:0/1453942701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0858073e50 con 0x7f08580d0bd0 2023-08-25T04:18:22.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.922+0000 7f0854ff9640 1 -- 172.21.15.55:0/1453942701 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f084c0113f0 con 0x7f08580d0bd0 2023-08-25T04:18:22.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.926+0000 7f0854ff9640 1 --2- 172.21.15.55:0/1453942701 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f08440657a0 0x7f0844067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:22.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.926+0000 7f0854ff9640 1 -- 172.21.15.55:0/1453942701 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f084c082ee0 con 0x7f08580d0bd0 2023-08-25T04:18:22.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.926+0000 7f0857fff640 1 --2- 172.21.15.55:0/1453942701 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f08440657a0 0x7f0844067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:22.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.926+0000 7f0857fff640 1 --2- 172.21.15.55:0/1453942701 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f08440657a0 0x7f0844067c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f08480b2000 tx=0x7f08480aa070 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:22.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:22.930+0000 7f0854ff9640 1 -- 172.21.15.55:0/1453942701 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f084c050ac0 con 0x7f08580d0bd0 2023-08-25T04:18:23.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.086+0000 7f085d758640 1 -- 172.21.15.55:0/1453942701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f08580b8110 con 0x7f08580d0bd0 2023-08-25T04:18:23.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.086+0000 7f0854ff9640 1 -- 172.21.15.55:0/1453942701 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v75) v1 ==== 92+0+10 (secure 0 0 0) 0x7f084c0540e0 con 0x7f08580d0bd0 2023-08-25T04:18:23.086 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:18:23.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.090+0000 7f085d758640 1 -- 172.21.15.55:0/1453942701 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f08440657a0 msgr2=0x7f0844067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:23.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.090+0000 7f085d758640 1 --2- 172.21.15.55:0/1453942701 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f08440657a0 0x7f0844067c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f08480b2000 tx=0x7f08480aa070 comp rx=0 tx=0).stop 2023-08-25T04:18:23.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.090+0000 7f085d758640 1 -- 172.21.15.55:0/1453942701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08580d0bd0 msgr2=0x7f08580c7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:23.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.090+0000 7f085d758640 1 --2- 172.21.15.55:0/1453942701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08580d0bd0 0x7f08580c7290 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f084c00c7f0 tx=0x7f084c00ccb0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.090+0000 7f085d758640 1 -- 172.21.15.55:0/1453942701 shutdown_connections 2023-08-25T04:18:23.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.090+0000 7f085d758640 1 --2- 172.21.15.55:0/1453942701 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f08440657a0 0x7f0844067c60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.090+0000 7f085d758640 1 --2- 172.21.15.55:0/1453942701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f085815fca0 0x7f085814f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.090+0000 7f085d758640 1 --2- 172.21.15.55:0/1453942701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08580d0bd0 0x7f08580c7290 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.090+0000 7f085d758640 1 --2- 172.21.15.55:0/1453942701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08580b8330 0x7f085814cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.090+0000 7f085d758640 1 -- 172.21.15.55:0/1453942701 >> 172.21.15.55:0/1453942701 conn(0x7f08580658c0 msgr2=0x7f08580b66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:23.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.090+0000 7f085d758640 1 -- 172.21.15.55:0/1453942701 shutdown_connections 2023-08-25T04:18:23.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.090+0000 7f085d758640 1 -- 172.21.15.55:0/1453942701 wait complete. 2023-08-25T04:18:23.107 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-25T04:18:23.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.250+0000 7f042f234640 1 Processor -- start 2023-08-25T04:18:23.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f042f234640 1 -- start start 2023-08-25T04:18:23.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f042f234640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04280ceeb0 0x7f04280cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:23.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f042f234640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f04280c89f0 0x7f04280b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:23.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f042f234640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04280cc880 con 0x7f04280ad950 2023-08-25T04:18:23.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f042f234640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04280b11f0 con 0x7f04280c89f0 2023-08-25T04:18:23.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f042f234640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0428159d50 con 0x7f04280ceeb0 2023-08-25T04:18:23.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f042cfd0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f04280ad950 0x7f04280ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34442/0 (socket says 172.21.15.55:34442) 2023-08-25T04:18:23.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f042cfd0640 1 -- 172.21.15.55:0/1846803442 learned_addr learned my addr 172.21.15.55:0/1846803442 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:23.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f042d7d1640 1 --2- 172.21.15.55:0/1846803442 >> v2:172.21.15.110:3300/0 conn(0x7f04280c89f0 0x7f04280b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:23.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f0427fff640 1 --2- 172.21.15.55:0/1846803442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04280ceeb0 0x7f04280cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:23.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f04277fe640 1 -- 172.21.15.55:0/1846803442 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302038769 0 0) 0x7f04280cc880 con 0x7f04280ad950 2023-08-25T04:18:23.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f04277fe640 1 -- 172.21.15.55:0/1846803442 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0418003530 con 0x7f04280ad950 2023-08-25T04:18:23.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f04277fe640 1 -- 172.21.15.55:0/1846803442 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1649269842 0 0) 0x7f0418003530 con 0x7f04280ad950 2023-08-25T04:18:23.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f04277fe640 1 -- 172.21.15.55:0/1846803442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04280ceeb0 msgr2=0x7f04280cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:23.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f04277fe640 1 --2- 172.21.15.55:0/1846803442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04280ceeb0 0x7f04280cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f04277fe640 1 -- 172.21.15.55:0/1846803442 >> v2:172.21.15.110:3300/0 conn(0x7f04280c89f0 msgr2=0x7f04280b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:23.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f04277fe640 1 --2- 172.21.15.55:0/1846803442 >> v2:172.21.15.110:3300/0 conn(0x7f04280c89f0 0x7f04280b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f04277fe640 1 -- 172.21.15.55:0/1846803442 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04280ccb60 con 0x7f04280ad950 2023-08-25T04:18:23.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f04277fe640 1 -- 172.21.15.55:0/1846803442 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f041c001680 con 0x7f04280ad950 2023-08-25T04:18:23.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f04277fe640 1 -- 172.21.15.55:0/1846803442 >> v1:172.21.15.55:6789/0 conn(0x7f04280ad950 legacy=0x7f04280ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:23.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f04277fe640 1 --2- 172.21.15.55:0/1846803442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0418003980 0x7f0418003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:23.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f04277fe640 1 --2- 172.21.15.55:0/1846803442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04280ceeb0 0x7f04180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:23.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f04277fe640 1 --2- 172.21.15.55:0/1846803442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04180042e0 0x7f0418004d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:23.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f04277fe640 1 -- 172.21.15.55:0/1846803442 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04280b11f0 con 0x7f04180042e0 2023-08-25T04:18:23.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f04277fe640 1 -- 172.21.15.55:0/1846803442 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0428159d50 con 0x7f0418003980 2023-08-25T04:18:23.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f04277fe640 1 -- 172.21.15.55:0/1846803442 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0418005610 con 0x7f04280ceeb0 2023-08-25T04:18:23.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f042d7d1640 1 --2- 172.21.15.55:0/1846803442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04180042e0 0x7f0418004d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:23.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f042cfd0640 1 --2- 172.21.15.55:0/1846803442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0418003980 0x7f0418003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:23.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f0427fff640 1 --2- 172.21.15.55:0/1846803442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04280ceeb0 0x7f04180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:23.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f042d7d1640 1 -- 172.21.15.55:0/1846803442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04280ceeb0 msgr2=0x7f04180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:23.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f042d7d1640 1 --2- 172.21.15.55:0/1846803442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04280ceeb0 0x7f04180047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f042d7d1640 1 -- 172.21.15.55:0/1846803442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0418003980 msgr2=0x7f0418003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:23.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f042d7d1640 1 --2- 172.21.15.55:0/1846803442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0418003980 0x7f0418003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.254+0000 7f042d7d1640 1 -- 172.21.15.55:0/1846803442 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0418003530 con 0x7f04180042e0 2023-08-25T04:18:23.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.258+0000 7f042d7d1640 1 --2- 172.21.15.55:0/1846803442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04180042e0 0x7f0418004d10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0420009fc0 tx=0x7f042001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1956c334bcf6d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:23.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.258+0000 7f04277fe640 1 -- 172.21.15.55:0/1846803442 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04200a5c70 con 0x7f04180042e0 2023-08-25T04:18:23.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.258+0000 7f04277fe640 1 -- 172.21.15.55:0/1846803442 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042000f040 con 0x7f04180042e0 2023-08-25T04:18:23.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.258+0000 7f04277fe640 1 -- 172.21.15.55:0/1846803442 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04200ad440 con 0x7f04180042e0 2023-08-25T04:18:23.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.258+0000 7f042f234640 1 -- 172.21.15.55:0/1846803442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04180042e0 msgr2=0x7f0418004d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:23.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.258+0000 7f042f234640 1 --2- 172.21.15.55:0/1846803442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04180042e0 0x7f0418004d10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0420009fc0 tx=0x7f042001cc60 comp rx=0 tx=0).stop 2023-08-25T04:18:23.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.258+0000 7f042d7d1640 1 -- 172.21.15.55:0/1846803442 reap_dead start 2023-08-25T04:18:23.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.258+0000 7f042f234640 1 -- 172.21.15.55:0/1846803442 shutdown_connections 2023-08-25T04:18:23.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.258+0000 7f042f234640 1 -- 172.21.15.55:0/1846803442 >> 172.21.15.55:0/1846803442 conn(0x7f0428069d00 msgr2=0x7f042806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:23.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.258+0000 7f042f234640 1 -- 172.21.15.55:0/1846803442 shutdown_connections 2023-08-25T04:18:23.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.258+0000 7f042f234640 1 -- 172.21.15.55:0/1846803442 wait complete. 2023-08-25T04:18:23.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042f234640 1 Processor -- start 2023-08-25T04:18:23.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042f234640 1 -- start start 2023-08-25T04:18:23.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042f234640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04180042e0 0x7f04281f06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:23.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042f234640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04280afdd0 0x7f04280c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:23.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042f234640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04280c9dc0 0x7f04280b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:23.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042f234640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04281f0c10 con 0x7f04180042e0 2023-08-25T04:18:23.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042f234640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04280b0270 con 0x7f04280afdd0 2023-08-25T04:18:23.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042f234640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04280b0550 con 0x7f04280c9dc0 2023-08-25T04:18:23.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042cfd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04180042e0 0x7f04281f06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:23.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042cfd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04180042e0 0x7f04281f06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45796/0 (socket says 172.21.15.55:45796) 2023-08-25T04:18:23.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042cfd0640 1 -- 172.21.15.55:0/1146904669 learned_addr learned my addr 172.21.15.55:0/1146904669 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:23.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f0427fff640 1 --2- 172.21.15.55:0/1146904669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04280afdd0 0x7f04280c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:23.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042d7d1640 1 --2- 172.21.15.55:0/1146904669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04280c9dc0 0x7f04280b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:23.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042cfd0640 1 -- 172.21.15.55:0/1146904669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04280c9dc0 msgr2=0x7f04280b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:23.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042cfd0640 1 --2- 172.21.15.55:0/1146904669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04280c9dc0 0x7f04280b2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042cfd0640 1 -- 172.21.15.55:0/1146904669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04280afdd0 msgr2=0x7f04280c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:23.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042cfd0640 1 --2- 172.21.15.55:0/1146904669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04280afdd0 0x7f04280c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042cfd0640 1 -- 172.21.15.55:0/1146904669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04280b0830 con 0x7f04180042e0 2023-08-25T04:18:23.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042cfd0640 1 --2- 172.21.15.55:0/1146904669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04180042e0 0x7f04281f06d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f041c0017b0 tx=0x7f041c0128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:23.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f04257fa640 1 -- 172.21.15.55:0/1146904669 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c014750 con 0x7f04180042e0 2023-08-25T04:18:23.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f04257fa640 1 -- 172.21.15.55:0/1146904669 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041c0148b0 con 0x7f04180042e0 2023-08-25T04:18:23.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042f234640 1 -- 172.21.15.55:0/1146904669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04280b0b10 con 0x7f04180042e0 2023-08-25T04:18:23.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f04257fa640 1 -- 172.21.15.55:0/1146904669 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c014c60 con 0x7f04180042e0 2023-08-25T04:18:23.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.262+0000 7f042f234640 1 -- 172.21.15.55:0/1146904669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04280b2c80 con 0x7f04180042e0 2023-08-25T04:18:23.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.266+0000 7f042f234640 1 -- 172.21.15.55:0/1146904669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04280b0d50 con 0x7f04180042e0 2023-08-25T04:18:23.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.266+0000 7f04257fa640 1 -- 172.21.15.55:0/1146904669 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f041c0153e0 con 0x7f04180042e0 2023-08-25T04:18:23.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.266+0000 7f04257fa640 1 --2- 172.21.15.55:0/1146904669 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f040c0657a0 0x7f040c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:23.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.266+0000 7f04257fa640 1 -- 172.21.15.55:0/1146904669 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f041c085420 con 0x7f04180042e0 2023-08-25T04:18:23.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.266+0000 7f0427fff640 1 --2- 172.21.15.55:0/1146904669 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f040c0657a0 0x7f040c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:23.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.266+0000 7f0427fff640 1 --2- 172.21.15.55:0/1146904669 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f040c0657a0 0x7f040c067c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f042806d030 tx=0x7f0414009190 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:23.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.270+0000 7f04257fa640 1 -- 172.21.15.55:0/1146904669 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f041c053130 con 0x7f04180042e0 2023-08-25T04:18:23.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.430+0000 7f042f234640 1 -- 172.21.15.55:0/1146904669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f042804dbe0 con 0x7f04180042e0 2023-08-25T04:18:23.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.430+0000 7f04257fa640 1 -- 172.21.15.55:0/1146904669 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) v1 ==== 84+0+126 (secure 0 0 0) 0x7f041c056750 con 0x7f04180042e0 2023-08-25T04:18:23.430 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:23.431 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T04:18:23.431 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:23.432 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-08-25T04:18:23.432 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-08-25T04:18:23.432 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:18:23.432 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:23.432 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-08-25T04:18:23.433 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-08-25T04:18:23.433 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:23.433 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T04:18:23.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.430+0000 7f042f234640 1 -- 172.21.15.55:0/1146904669 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f040c0657a0 msgr2=0x7f040c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:23.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.430+0000 7f042f234640 1 --2- 172.21.15.55:0/1146904669 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f040c0657a0 0x7f040c067c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f042806d030 tx=0x7f0414009190 comp rx=0 tx=0).stop 2023-08-25T04:18:23.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.430+0000 7f042f234640 1 -- 172.21.15.55:0/1146904669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04180042e0 msgr2=0x7f04281f06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:23.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.430+0000 7f042f234640 1 --2- 172.21.15.55:0/1146904669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04180042e0 0x7f04281f06d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f041c0017b0 tx=0x7f041c0128e0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.430+0000 7f042f234640 1 -- 172.21.15.55:0/1146904669 shutdown_connections 2023-08-25T04:18:23.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.430+0000 7f042f234640 1 --2- 172.21.15.55:0/1146904669 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f040c0657a0 0x7f040c067c60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.430+0000 7f042f234640 1 --2- 172.21.15.55:0/1146904669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04280c9dc0 0x7f04280b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.430+0000 7f042f234640 1 --2- 172.21.15.55:0/1146904669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f04280afdd0 0x7f04280c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.430+0000 7f042f234640 1 --2- 172.21.15.55:0/1146904669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04180042e0 0x7f04281f06d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.430+0000 7f042f234640 1 -- 172.21.15.55:0/1146904669 >> 172.21.15.55:0/1146904669 conn(0x7f0428069d00 msgr2=0x7f042806fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:23.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.430+0000 7f042f234640 1 -- 172.21.15.55:0/1146904669 shutdown_connections 2023-08-25T04:18:23.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.430+0000 7f042f234640 1 -- 172.21.15.55:0/1146904669 wait complete. 2023-08-25T04:18:23.449 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-25T04:18:23.450 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-25T04:18:23.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.598+0000 7f538818f640 1 Processor -- start 2023-08-25T04:18:23.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.598+0000 7f538818f640 1 -- start start 2023-08-25T04:18:23.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.598+0000 7f538818f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f53800cf340 0x7f53800cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:23.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.598+0000 7f538818f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53800d1970 con 0x7f538015cb40 2023-08-25T04:18:23.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.598+0000 7f538818f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53800cfcf0 con 0x7f53800b59f0 2023-08-25T04:18:23.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.598+0000 7f538818f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53800d2790 con 0x7f53800cf340 2023-08-25T04:18:23.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.598+0000 7f5385f2b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f538015cb40 0x7f53800d2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34452/0 (socket says 172.21.15.55:34452) 2023-08-25T04:18:23.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.598+0000 7f5385f2b640 1 -- 172.21.15.55:0/287581481 learned_addr learned my addr 172.21.15.55:0/287581481 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:23.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.598+0000 7f538572a640 1 --2- 172.21.15.55:0/287581481 >> v2:172.21.15.110:3300/0 conn(0x7f53800cf340 0x7f53800cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:23.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.598+0000 7f5384f29640 1 -- 172.21.15.55:0/287581481 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124104903 0 0) 0x7f53800d1970 con 0x7f538015cb40 2023-08-25T04:18:23.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.598+0000 7f5384f29640 1 -- 172.21.15.55:0/287581481 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f536c003530 con 0x7f538015cb40 2023-08-25T04:18:23.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.598+0000 7f5384f29640 1 -- 172.21.15.55:0/287581481 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355609792 0 0) 0x7f53800cfcf0 con 0x7f53800b59f0 2023-08-25T04:18:23.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.598+0000 7f5384f29640 1 -- 172.21.15.55:0/287581481 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53800d1970 con 0x7f53800b59f0 2023-08-25T04:18:23.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.598+0000 7f538572a640 1 -- 172.21.15.55:0/287581481 >> v1:172.21.15.110:6789/0 conn(0x7f53800b59f0 legacy=0x7f53800b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:23.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.598+0000 7f538572a640 1 -- 172.21.15.55:0/287581481 >> v1:172.21.15.55:6789/0 conn(0x7f538015cb40 legacy=0x7f53800d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:23.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.598+0000 7f538572a640 1 -- 172.21.15.55:0/287581481 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53800d0d80 con 0x7f53800cf340 2023-08-25T04:18:23.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.602+0000 7f538572a640 1 --2- 172.21.15.55:0/287581481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53800cf340 0x7f53800cf7b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f53700097c0 tx=0x7f537001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5d756d841b2abcc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:23.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.602+0000 7f5384f29640 1 -- 172.21.15.55:0/287581481 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53700a8970 con 0x7f53800cf340 2023-08-25T04:18:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.602+0000 7f5384f29640 1 -- 172.21.15.55:0/287581481 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53700a8ad0 con 0x7f53800cf340 2023-08-25T04:18:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.602+0000 7f5384f29640 1 -- 172.21.15.55:0/287581481 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53700a8e40 con 0x7f53800cf340 2023-08-25T04:18:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.602+0000 7f538818f640 1 -- 172.21.15.55:0/287581481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53800cf340 msgr2=0x7f53800cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.602+0000 7f538818f640 1 --2- 172.21.15.55:0/287581481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53800cf340 0x7f53800cf7b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f53700097c0 tx=0x7f537001ec70 comp rx=0 tx=0).stop 2023-08-25T04:18:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538818f640 1 -- 172.21.15.55:0/287581481 shutdown_connections 2023-08-25T04:18:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538818f640 1 --2- 172.21.15.55:0/287581481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53800cf340 0x7f53800cf7b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538818f640 1 -- 172.21.15.55:0/287581481 >> 172.21.15.55:0/287581481 conn(0x7f538006aae0 msgr2=0x7f538006aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538818f640 1 -- 172.21.15.55:0/287581481 shutdown_connections 2023-08-25T04:18:23.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538818f640 1 -- 172.21.15.55:0/287581481 wait complete. 2023-08-25T04:18:23.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538818f640 1 Processor -- start 2023-08-25T04:18:23.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538818f640 1 -- start start 2023-08-25T04:18:23.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538818f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53800b59f0 0x7f5380159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:23.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538818f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53800cf340 0x7f538015ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:23.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538818f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f538015cb40 0x7f53800ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:23.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538818f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538015e790 con 0x7f53800cf340 2023-08-25T04:18:23.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538818f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53800cc510 con 0x7f53800b59f0 2023-08-25T04:18:23.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538818f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538015a1e0 con 0x7f538015cb40 2023-08-25T04:18:23.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538572a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53800cf340 0x7f538015ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:23.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538572a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53800cf340 0x7f538015ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45798/0 (socket says 172.21.15.55:45798) 2023-08-25T04:18:23.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538572a640 1 -- 172.21.15.55:0/1831211931 learned_addr learned my addr 172.21.15.55:0/1831211931 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:23.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f5385f2b640 1 --2- 172.21.15.55:0/1831211931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53800b59f0 0x7f5380159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:23.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538672c640 1 --2- 172.21.15.55:0/1831211931 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f538015cb40 0x7f53800ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:23.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538572a640 1 -- 172.21.15.55:0/1831211931 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f538015cb40 msgr2=0x7f53800ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:23.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538572a640 1 --2- 172.21.15.55:0/1831211931 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f538015cb40 0x7f53800ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538572a640 1 -- 172.21.15.55:0/1831211931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53800b59f0 msgr2=0x7f5380159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:23.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538572a640 1 --2- 172.21.15.55:0/1831211931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53800b59f0 0x7f5380159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538572a640 1 -- 172.21.15.55:0/1831211931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5370009420 con 0x7f53800cf340 2023-08-25T04:18:23.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f5385f2b640 1 --2- 172.21.15.55:0/1831211931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53800b59f0 0x7f5380159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:23.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.606+0000 7f538572a640 1 --2- 172.21.15.55:0/1831211931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53800cf340 0x7f538015ebb0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f5370000c10 tx=0x7f537001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:23.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.610+0000 7f53767fc640 1 -- 172.21.15.55:0/1831211931 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53700bd070 con 0x7f53800cf340 2023-08-25T04:18:23.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.610+0000 7f53767fc640 1 -- 172.21.15.55:0/1831211931 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5370004250 con 0x7f53800cf340 2023-08-25T04:18:23.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.610+0000 7f538818f640 1 -- 172.21.15.55:0/1831211931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53800b4940 con 0x7f53800cf340 2023-08-25T04:18:23.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.610+0000 7f53767fc640 1 -- 172.21.15.55:0/1831211931 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5370003620 con 0x7f53800cf340 2023-08-25T04:18:23.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.610+0000 7f538818f640 1 -- 172.21.15.55:0/1831211931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538015e3b0 con 0x7f53800cf340 2023-08-25T04:18:23.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.610+0000 7f538818f640 1 -- 172.21.15.55:0/1831211931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5380071f80 con 0x7f53800cf340 2023-08-25T04:18:23.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.610+0000 7f53767fc640 1 -- 172.21.15.55:0/1831211931 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f53700b7040 con 0x7f53800cf340 2023-08-25T04:18:23.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.610+0000 7f53767fc640 1 --2- 172.21.15.55:0/1831211931 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f53640657a0 0x7f5364067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:23.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.610+0000 7f53767fc640 1 -- 172.21.15.55:0/1831211931 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f537011fd60 con 0x7f53800cf340 2023-08-25T04:18:23.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.610+0000 7f5385f2b640 1 --2- 172.21.15.55:0/1831211931 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f53640657a0 0x7f5364067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:23.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.614+0000 7f5385f2b640 1 --2- 172.21.15.55:0/1831211931 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f53640657a0 0x7f5364067c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f537c000f70 tx=0x7f537c009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:23.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.614+0000 7f53767fc640 1 -- 172.21.15.55:0/1831211931 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f53700ed9c0 con 0x7f53800cf340 2023-08-25T04:18:23.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.774+0000 7f538818f640 1 -- 172.21.15.55:0/1831211931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f538004dbe0 con 0x7f53800cf340 2023-08-25T04:18:23.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.874+0000 7f53767fc640 1 -- 172.21.15.55:0/1831211931 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) v1 ==== 138+0+0 (secure 0 0 0) 0x7f53700f0fe0 con 0x7f53800cf340 2023-08-25T04:18:23.874 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-08-25T04:18:23.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.878+0000 7f538818f640 1 -- 172.21.15.55:0/1831211931 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f53640657a0 msgr2=0x7f5364067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:23.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.878+0000 7f538818f640 1 --2- 172.21.15.55:0/1831211931 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f53640657a0 0x7f5364067c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f537c000f70 tx=0x7f537c009040 comp rx=0 tx=0).stop 2023-08-25T04:18:23.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.878+0000 7f538818f640 1 -- 172.21.15.55:0/1831211931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53800cf340 msgr2=0x7f538015ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:23.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.878+0000 7f538818f640 1 --2- 172.21.15.55:0/1831211931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53800cf340 0x7f538015ebb0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f5370000c10 tx=0x7f537001ba10 comp rx=0 tx=0).stop 2023-08-25T04:18:23.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.878+0000 7f538818f640 1 -- 172.21.15.55:0/1831211931 shutdown_connections 2023-08-25T04:18:23.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.878+0000 7f538818f640 1 --2- 172.21.15.55:0/1831211931 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f53640657a0 0x7f5364067c60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.878+0000 7f538818f640 1 --2- 172.21.15.55:0/1831211931 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f538015cb40 0x7f53800ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.878+0000 7f538818f640 1 --2- 172.21.15.55:0/1831211931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53800cf340 0x7f538015ebb0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.878+0000 7f538818f640 1 --2- 172.21.15.55:0/1831211931 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53800b59f0 0x7f5380159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:23.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.878+0000 7f538818f640 1 -- 172.21.15.55:0/1831211931 >> 172.21.15.55:0/1831211931 conn(0x7f538006aae0 msgr2=0x7f538015bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:23.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.878+0000 7f538818f640 1 -- 172.21.15.55:0/1831211931 shutdown_connections 2023-08-25T04:18:23.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:23.878+0000 7f538818f640 1 -- 172.21.15.55:0/1831211931 wait complete. 2023-08-25T04:18:23.899 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-25T04:18:24.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f174225c640 1 Processor -- start 2023-08-25T04:18:24.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f174225c640 1 -- start start 2023-08-25T04:18:24.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f174225c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f173c06c3b0 0x7f173c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:24.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f174225c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173c0cab90 con 0x7f173c06e5a0 2023-08-25T04:18:24.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f174225c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173c06dbb0 con 0x7f173c06c790 2023-08-25T04:18:24.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f174225c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f173c0cae50 con 0x7f173c06c3b0 2023-08-25T04:18:24.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f173bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f173c06e5a0 0x7f173c0ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34458/0 (socket says 172.21.15.55:34458) 2023-08-25T04:18:24.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f173bfff640 1 -- 172.21.15.55:0/2111523236 learned_addr learned my addr 172.21.15.55:0/2111523236 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:24.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f173b7fe640 1 --2- 172.21.15.55:0/2111523236 >> v2:172.21.15.110:3300/0 conn(0x7f173c06c3b0 0x7f173c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:24.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f173a7fc640 1 -- 172.21.15.55:0/2111523236 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029712121 0 0) 0x7f173c0cab90 con 0x7f173c06e5a0 2023-08-25T04:18:24.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f173a7fc640 1 -- 172.21.15.55:0/2111523236 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1724003530 con 0x7f173c06e5a0 2023-08-25T04:18:24.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f173a7fc640 1 -- 172.21.15.55:0/2111523236 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308485340 0 0) 0x7f173c06dbb0 con 0x7f173c06c790 2023-08-25T04:18:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f173a7fc640 1 -- 172.21.15.55:0/2111523236 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f173c0cab90 con 0x7f173c06c790 2023-08-25T04:18:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f173a7fc640 1 -- 172.21.15.55:0/2111523236 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1009500841 0 0) 0x7f1724003530 con 0x7f173c06e5a0 2023-08-25T04:18:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f173a7fc640 1 -- 172.21.15.55:0/2111523236 >> v2:172.21.15.110:3300/0 conn(0x7f173c06c3b0 msgr2=0x7f173c0cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f173a7fc640 1 --2- 172.21.15.55:0/2111523236 >> v2:172.21.15.110:3300/0 conn(0x7f173c06c3b0 0x7f173c0cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f173a7fc640 1 -- 172.21.15.55:0/2111523236 >> v1:172.21.15.110:6789/0 conn(0x7f173c06c790 legacy=0x7f173c06de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f173a7fc640 1 -- 172.21.15.55:0/2111523236 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c0cb130 con 0x7f173c06e5a0 2023-08-25T04:18:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f173a7fc640 1 -- 172.21.15.55:0/2111523236 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f1734001a00 con 0x7f173c06e5a0 2023-08-25T04:18:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f173a7fc640 1 -- 172.21.15.55:0/2111523236 >> v1:172.21.15.55:6789/0 conn(0x7f173c06e5a0 legacy=0x7f173c0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.050+0000 7f173a7fc640 1 --2- 172.21.15.55:0/2111523236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1724003b10 0x7f1724003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173a7fc640 1 --2- 172.21.15.55:0/2111523236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17240047d0 0x7f1724004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173a7fc640 1 --2- 172.21.15.55:0/2111523236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1724005190 0x7f172400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173a7fc640 1 -- 172.21.15.55:0/2111523236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c0cae50 con 0x7f1724005190 2023-08-25T04:18:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173a7fc640 1 -- 172.21.15.55:0/2111523236 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172400c010 con 0x7f1724003b10 2023-08-25T04:18:24.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173a7fc640 1 -- 172.21.15.55:0/2111523236 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172400c1d0 con 0x7f17240047d0 2023-08-25T04:18:24.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173bfff640 1 --2- 172.21.15.55:0/2111523236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1724005190 0x7f172400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:24.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173b7fe640 1 --2- 172.21.15.55:0/2111523236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1724003b10 0x7f1724003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:24.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173affd640 1 --2- 172.21.15.55:0/2111523236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17240047d0 0x7f1724004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:24.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173bfff640 1 -- 172.21.15.55:0/2111523236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17240047d0 msgr2=0x7f1724004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:24.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173bfff640 1 --2- 172.21.15.55:0/2111523236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17240047d0 0x7f1724004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:24.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173bfff640 1 -- 172.21.15.55:0/2111523236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1724003b10 msgr2=0x7f1724003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:24.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173bfff640 1 --2- 172.21.15.55:0/2111523236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1724003b10 0x7f1724003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173bfff640 1 -- 172.21.15.55:0/2111523236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1724003530 con 0x7f1724005190 2023-08-25T04:18:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173affd640 1 --2- 172.21.15.55:0/2111523236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17240047d0 0x7f1724004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:24.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173bfff640 1 -- 172.21.15.55:0/2111523236 reap_dead start 2023-08-25T04:18:24.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173bfff640 1 --2- 172.21.15.55:0/2111523236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1724005190 0x7f172400b990 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f173c06e9b0 tx=0x7f173401f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27975283e0f7d06b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:24.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173a7fc640 1 -- 172.21.15.55:0/2111523236 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17340aa610 con 0x7f1724005190 2023-08-25T04:18:24.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173a7fc640 1 -- 172.21.15.55:0/2111523236 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17340aa790 con 0x7f1724005190 2023-08-25T04:18:24.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.054+0000 7f173a7fc640 1 -- 172.21.15.55:0/2111523236 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17340aab40 con 0x7f1724005190 2023-08-25T04:18:24.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f174225c640 1 -- 172.21.15.55:0/2111523236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1724005190 msgr2=0x7f172400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:24.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f174225c640 1 --2- 172.21.15.55:0/2111523236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1724005190 0x7f172400b990 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f173c06e9b0 tx=0x7f173401f9e0 comp rx=0 tx=0).stop 2023-08-25T04:18:24.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f174225c640 1 -- 172.21.15.55:0/2111523236 shutdown_connections 2023-08-25T04:18:24.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f174225c640 1 --2- 172.21.15.55:0/2111523236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1724005190 0x7f172400b990 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:24.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f174225c640 1 -- 172.21.15.55:0/2111523236 >> 172.21.15.55:0/2111523236 conn(0x7f173c0d0540 msgr2=0x7f173c0d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:24.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f174225c640 1 -- 172.21.15.55:0/2111523236 shutdown_connections 2023-08-25T04:18:24.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f174225c640 1 -- 172.21.15.55:0/2111523236 wait complete. 2023-08-25T04:18:24.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f174225c640 1 Processor -- start 2023-08-25T04:18:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f174225c640 1 -- start start 2023-08-25T04:18:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f174225c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1724005190 0x7f173c157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f174225c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f173c1e5bf0 0x7f173c15da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f174225c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f173c1e6070 0x7f173c15dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f174225c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c0adbc0 con 0x7f173c1e5bf0 2023-08-25T04:18:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f174225c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c0ad290 con 0x7f173c1e6070 2023-08-25T04:18:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f174225c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173c0ad570 con 0x7f1724005190 2023-08-25T04:18:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f173affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f173c1e5bf0 0x7f173c15da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f173affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f173c1e5bf0 0x7f173c15da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45822/0 (socket says 172.21.15.55:45822) 2023-08-25T04:18:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f173affd640 1 -- 172.21.15.55:0/3706555382 learned_addr learned my addr 172.21.15.55:0/3706555382 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f173b7fe640 1 --2- 172.21.15.55:0/3706555382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1724005190 0x7f173c157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f173bfff640 1 --2- 172.21.15.55:0/3706555382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f173c1e6070 0x7f173c15dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f173affd640 1 -- 172.21.15.55:0/3706555382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1724005190 msgr2=0x7f173c157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f173affd640 1 --2- 172.21.15.55:0/3706555382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1724005190 0x7f173c157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f173affd640 1 -- 172.21.15.55:0/3706555382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f173c1e6070 msgr2=0x7f173c15dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f173affd640 1 --2- 172.21.15.55:0/3706555382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f173c1e6070 0x7f173c15dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.058+0000 7f173affd640 1 -- 172.21.15.55:0/3706555382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c0ad850 con 0x7f173c1e5bf0 2023-08-25T04:18:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.062+0000 7f173bfff640 1 --2- 172.21.15.55:0/3706555382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f173c1e6070 0x7f173c15dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.062+0000 7f173affd640 1 --2- 172.21.15.55:0/3706555382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f173c1e5bf0 0x7f173c15da70 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f173000e580 tx=0x7f173000e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.062+0000 7f1723fff640 1 -- 172.21.15.55:0/3706555382 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730017070 con 0x7f173c1e5bf0 2023-08-25T04:18:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.062+0000 7f1723fff640 1 -- 172.21.15.55:0/3706555382 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17300052e0 con 0x7f173c1e5bf0 2023-08-25T04:18:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.062+0000 7f174225c640 1 -- 172.21.15.55:0/3706555382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173c0c7760 con 0x7f173c1e5bf0 2023-08-25T04:18:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.062+0000 7f1723fff640 1 -- 172.21.15.55:0/3706555382 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730005490 con 0x7f173c1e5bf0 2023-08-25T04:18:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.062+0000 7f174225c640 1 -- 172.21.15.55:0/3706555382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173c0c9790 con 0x7f173c1e5bf0 2023-08-25T04:18:24.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.062+0000 7f174225c640 1 -- 172.21.15.55:0/3706555382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f173c073ec0 con 0x7f173c1e5bf0 2023-08-25T04:18:24.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.062+0000 7f1723fff640 1 -- 172.21.15.55:0/3706555382 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f1730007020 con 0x7f173c1e5bf0 2023-08-25T04:18:24.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.066+0000 7f1723fff640 1 --2- 172.21.15.55:0/3706555382 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f17280657a0 0x7f1728067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:24.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.066+0000 7f1723fff640 1 -- 172.21.15.55:0/3706555382 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f1730082f70 con 0x7f173c1e5bf0 2023-08-25T04:18:24.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.066+0000 7f173b7fe640 1 --2- 172.21.15.55:0/3706555382 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f17280657a0 0x7f1728067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:24.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.066+0000 7f173b7fe640 1 --2- 172.21.15.55:0/3706555382 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f17280657a0 0x7f1728067c60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f173c15e750 tx=0x7f172c006f90 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:24.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.066+0000 7f1723fff640 1 -- 172.21.15.55:0/3706555382 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1730050b70 con 0x7f173c1e5bf0 2023-08-25T04:18:24.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.222+0000 7f174225c640 1 -- 172.21.15.55:0/3706555382 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f173c0c7950 con 0x7f173c1e5bf0 2023-08-25T04:18:24.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.882+0000 7f1723fff640 1 -- 172.21.15.55:0/3706555382 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) v1 ==== 170+0+0 (secure 0 0 0) 0x7f173c0c7950 con 0x7f173c1e5bf0 2023-08-25T04:18:24.888 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-08-25T04:18:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.894+0000 7f174225c640 1 -- 172.21.15.55:0/3706555382 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f17280657a0 msgr2=0x7f1728067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:24.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.894+0000 7f174225c640 1 --2- 172.21.15.55:0/3706555382 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f17280657a0 0x7f1728067c60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f173c15e750 tx=0x7f172c006f90 comp rx=0 tx=0).stop 2023-08-25T04:18:24.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.894+0000 7f174225c640 1 -- 172.21.15.55:0/3706555382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f173c1e5bf0 msgr2=0x7f173c15da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:24.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.894+0000 7f174225c640 1 --2- 172.21.15.55:0/3706555382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f173c1e5bf0 0x7f173c15da70 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f173000e580 tx=0x7f173000e980 comp rx=0 tx=0).stop 2023-08-25T04:18:24.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.894+0000 7f174225c640 1 -- 172.21.15.55:0/3706555382 shutdown_connections 2023-08-25T04:18:24.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.894+0000 7f174225c640 1 --2- 172.21.15.55:0/3706555382 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f17280657a0 0x7f1728067c60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:24.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.894+0000 7f174225c640 1 --2- 172.21.15.55:0/3706555382 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f173c1e6070 0x7f173c15dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:24.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.894+0000 7f174225c640 1 --2- 172.21.15.55:0/3706555382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f173c1e5bf0 0x7f173c15da70 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:24.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.894+0000 7f174225c640 1 --2- 172.21.15.55:0/3706555382 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1724005190 0x7f173c157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:24.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.894+0000 7f174225c640 1 -- 172.21.15.55:0/3706555382 >> 172.21.15.55:0/3706555382 conn(0x7f173c0d0540 msgr2=0x7f173c0cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:24.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.898+0000 7f174225c640 1 -- 172.21.15.55:0/3706555382 shutdown_connections 2023-08-25T04:18:24.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:24.898+0000 7f174225c640 1 -- 172.21.15.55:0/3706555382 wait complete. 2023-08-25T04:18:24.926 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-25T04:18:25.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.074+0000 7ff168234640 1 Processor -- start 2023-08-25T04:18:25.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.074+0000 7ff168234640 1 -- start start 2023-08-25T04:18:25.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.078+0000 7ff168234640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff16015a7f0 0x7ff16009bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:25.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.078+0000 7ff168234640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff1600c9830 0x7ff160070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:25.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.078+0000 7ff168234640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16015abd0 con 0x7ff16006c020 2023-08-25T04:18:25.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.078+0000 7ff168234640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1600c8ab0 con 0x7ff1600c9830 2023-08-25T04:18:25.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.078+0000 7ff168234640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600c8d50 con 0x7ff16015a7f0 2023-08-25T04:18:25.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.078+0000 7ff1657cf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff1600c9830 0x7ff160070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:25.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.078+0000 7ff1657cf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff1600c9830 0x7ff160070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45824/0 (socket says 172.21.15.55:45824) 2023-08-25T04:18:25.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.078+0000 7ff1657cf640 1 -- 172.21.15.55:0/385290405 learned_addr learned my addr 172.21.15.55:0/385290405 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:25.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.078+0000 7ff165fd0640 1 --2- 172.21.15.55:0/385290405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff16015a7f0 0x7ff16009bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:25.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.078+0000 7ff1657cf640 1 -- 172.21.15.55:0/385290405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff16015a7f0 msgr2=0x7ff16009bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:25.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.078+0000 7ff1657cf640 1 --2- 172.21.15.55:0/385290405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff16015a7f0 0x7ff16009bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:25.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.078+0000 7ff1657cf640 1 -- 172.21.15.55:0/385290405 >> v1:172.21.15.110:6789/0 conn(0x7ff16006c020 legacy=0x7ff1600acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:25.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.078+0000 7ff1657cf640 1 -- 172.21.15.55:0/385290405 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1600c9030 con 0x7ff1600c9830 2023-08-25T04:18:25.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.082+0000 7ff1657cf640 1 --2- 172.21.15.55:0/385290405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1600c9830 0x7ff160070f00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff150009870 tx=0x7ff15001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d541940833b88f32 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:25.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.082+0000 7ff164fce640 1 -- 172.21.15.55:0/385290405 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1500a95f0 con 0x7ff1600c9830 2023-08-25T04:18:25.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.082+0000 7ff164fce640 1 -- 172.21.15.55:0/385290405 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1500a9750 con 0x7ff1600c9830 2023-08-25T04:18:25.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.082+0000 7ff164fce640 1 -- 172.21.15.55:0/385290405 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1500a9ae0 con 0x7ff1600c9830 2023-08-25T04:18:25.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.082+0000 7ff168234640 1 -- 172.21.15.55:0/385290405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1600c9830 msgr2=0x7ff160070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:25.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.082+0000 7ff168234640 1 --2- 172.21.15.55:0/385290405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1600c9830 0x7ff160070f00 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ff150009870 tx=0x7ff15001c510 comp rx=0 tx=0).stop 2023-08-25T04:18:25.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.082+0000 7ff168234640 1 -- 172.21.15.55:0/385290405 shutdown_connections 2023-08-25T04:18:25.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.082+0000 7ff168234640 1 --2- 172.21.15.55:0/385290405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1600c9830 0x7ff160070f00 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:25.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.082+0000 7ff168234640 1 --2- 172.21.15.55:0/385290405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff16015a7f0 0x7ff16009bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:25.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.082+0000 7ff168234640 1 -- 172.21.15.55:0/385290405 >> 172.21.15.55:0/385290405 conn(0x7ff160069900 msgr2=0x7ff160069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:25.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.082+0000 7ff168234640 1 -- 172.21.15.55:0/385290405 shutdown_connections 2023-08-25T04:18:25.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.082+0000 7ff168234640 1 -- 172.21.15.55:0/385290405 wait complete. 2023-08-25T04:18:25.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.082+0000 7ff168234640 1 Processor -- start 2023-08-25T04:18:25.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.082+0000 7ff168234640 1 -- start start 2023-08-25T04:18:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff168234640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff16006c020 0x7ff1600cd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff168234640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1600c9830 0x7ff1600b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff168234640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff16015a7f0 0x7ff16014c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff168234640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600cd110 con 0x7ff16015a7f0 2023-08-25T04:18:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff168234640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16014cd50 con 0x7ff16006c020 2023-08-25T04:18:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff168234640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1600cc490 con 0x7ff1600c9830 2023-08-25T04:18:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff1667d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff16015a7f0 0x7ff16014c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff165fd0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff16006c020 0x7ff1600cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff1667d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff16015a7f0 0x7ff16014c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45838/0 (socket says 172.21.15.55:45838) 2023-08-25T04:18:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff1667d1640 1 -- 172.21.15.55:0/2260498461 learned_addr learned my addr 172.21.15.55:0/2260498461 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff1657cf640 1 --2- 172.21.15.55:0/2260498461 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1600c9830 0x7ff1600b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff1667d1640 1 -- 172.21.15.55:0/2260498461 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1600c9830 msgr2=0x7ff1600b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff1667d1640 1 --2- 172.21.15.55:0/2260498461 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1600c9830 0x7ff1600b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff1667d1640 1 -- 172.21.15.55:0/2260498461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff16006c020 msgr2=0x7ff1600cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff1667d1640 1 --2- 172.21.15.55:0/2260498461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff16006c020 0x7ff1600cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff1667d1640 1 -- 172.21.15.55:0/2260498461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1500094d0 con 0x7ff16015a7f0 2023-08-25T04:18:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff1667d1640 1 --2- 172.21.15.55:0/2260498461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff16015a7f0 0x7ff16014c810 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff15800c730 tx=0x7ff15800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff1567fc640 1 -- 172.21.15.55:0/2260498461 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158003b80 con 0x7ff16015a7f0 2023-08-25T04:18:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff1567fc640 1 -- 172.21.15.55:0/2260498461 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff158003ce0 con 0x7ff16015a7f0 2023-08-25T04:18:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff1567fc640 1 -- 172.21.15.55:0/2260498461 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158005310 con 0x7ff16015a7f0 2023-08-25T04:18:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff168234640 1 -- 172.21.15.55:0/2260498461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1600adc90 con 0x7ff16015a7f0 2023-08-25T04:18:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff168234640 1 -- 172.21.15.55:0/2260498461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1600cca50 con 0x7ff16015a7f0 2023-08-25T04:18:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff168234640 1 -- 172.21.15.55:0/2260498461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16006d5b0 con 0x7ff16015a7f0 2023-08-25T04:18:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.086+0000 7ff1567fc640 1 -- 172.21.15.55:0/2260498461 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7ff158005680 con 0x7ff16015a7f0 2023-08-25T04:18:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.090+0000 7ff1567fc640 1 --2- 172.21.15.55:0/2260498461 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7ff1440657a0 0x7ff144067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.090+0000 7ff1567fc640 1 -- 172.21.15.55:0/2260498461 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5962+0+0 (secure 0 0 0) 0x7ff158082da0 con 0x7ff16015a7f0 2023-08-25T04:18:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.090+0000 7ff165fd0640 1 --2- 172.21.15.55:0/2260498461 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7ff1440657a0 0x7ff144067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.090+0000 7ff165fd0640 1 --2- 172.21.15.55:0/2260498461 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7ff1440657a0 0x7ff144067c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff15c006fd0 tx=0x7ff15c008040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:25.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.094+0000 7ff1567fc640 1 -- 172.21.15.55:0/2260498461 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff1580507d0 con 0x7ff16015a7f0 2023-08-25T04:18:25.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.282+0000 7ff168234640 1 -- 172.21.15.55:0/2260498461 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff1600cd250 con 0x7ff16015a7f0 2023-08-25T04:18:25.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.882+0000 7ff1567fc640 1 -- 172.21.15.55:0/2260498461 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v28) v1 ==== 173+0+0 (secure 0 0 0) 0x7ff1600cd250 con 0x7ff16015a7f0 2023-08-25T04:18:25.883 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 9 and data pool 10 2023-08-25T04:18:25.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.886+0000 7ff168234640 1 -- 172.21.15.55:0/2260498461 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7ff1440657a0 msgr2=0x7ff144067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:25.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.886+0000 7ff168234640 1 --2- 172.21.15.55:0/2260498461 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7ff1440657a0 0x7ff144067c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff15c006fd0 tx=0x7ff15c008040 comp rx=0 tx=0).stop 2023-08-25T04:18:25.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.886+0000 7ff168234640 1 -- 172.21.15.55:0/2260498461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff16015a7f0 msgr2=0x7ff16014c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:25.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.886+0000 7ff168234640 1 --2- 172.21.15.55:0/2260498461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff16015a7f0 0x7ff16014c810 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff15800c730 tx=0x7ff15800cbf0 comp rx=0 tx=0).stop 2023-08-25T04:18:25.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.890+0000 7ff168234640 1 -- 172.21.15.55:0/2260498461 shutdown_connections 2023-08-25T04:18:25.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.890+0000 7ff168234640 1 --2- 172.21.15.55:0/2260498461 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7ff1440657a0 0x7ff144067c60 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff15c006fd0 tx=0x7ff15c008040 comp rx=0 tx=0).stop 2023-08-25T04:18:25.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.890+0000 7ff168234640 1 --2- 172.21.15.55:0/2260498461 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff16015a7f0 0x7ff16014c810 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:25.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.890+0000 7ff168234640 1 --2- 172.21.15.55:0/2260498461 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1600c9830 0x7ff1600b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:25.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.890+0000 7ff168234640 1 --2- 172.21.15.55:0/2260498461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff16006c020 0x7ff1600cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:25.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.890+0000 7ff168234640 1 -- 172.21.15.55:0/2260498461 >> 172.21.15.55:0/2260498461 conn(0x7ff160069900 msgr2=0x7ff160072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:25.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.890+0000 7ff168234640 1 -- 172.21.15.55:0/2260498461 shutdown_connections 2023-08-25T04:18:25.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:25.890+0000 7ff168234640 1 -- 172.21.15.55:0/2260498461 wait complete. 2023-08-25T04:18:25.911 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:18:26.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.054+0000 7fb92c1d2640 1 Processor -- start 2023-08-25T04:18:26.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.054+0000 7fb92c1d2640 1 -- start start 2023-08-25T04:18:26.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.054+0000 7fb92c1d2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9240ad950 0x7fb9240cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:26.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.054+0000 7fb92c1d2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9240cc880 con 0x7fb9240c89f0 2023-08-25T04:18:26.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.054+0000 7fb92c1d2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9240ccb60 con 0x7fb9240ceeb0 2023-08-25T04:18:26.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.054+0000 7fb92c1d2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9240b11f0 con 0x7fb9240ad950 2023-08-25T04:18:26.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.058+0000 7fb92976d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb9240c89f0 0x7fb9240ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34470/0 (socket says 172.21.15.55:34470) 2023-08-25T04:18:26.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.058+0000 7fb92976d640 1 -- 172.21.15.55:0/3728180678 learned_addr learned my addr 172.21.15.55:0/3728180678 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:26.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.058+0000 7fb929f6e640 1 --2- 172.21.15.55:0/3728180678 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9240ad950 0x7fb9240cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:26.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.058+0000 7fb928f6c640 1 -- 172.21.15.55:0/3728180678 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941947262 0 0) 0x7fb9240cc880 con 0x7fb9240c89f0 2023-08-25T04:18:26.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.058+0000 7fb928f6c640 1 -- 172.21.15.55:0/3728180678 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb910005740 con 0x7fb9240c89f0 2023-08-25T04:18:26.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.058+0000 7fb928f6c640 1 -- 172.21.15.55:0/3728180678 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115393130 0 0) 0x7fb9240ccb60 con 0x7fb9240ceeb0 2023-08-25T04:18:26.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.058+0000 7fb928f6c640 1 -- 172.21.15.55:0/3728180678 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9240cc880 con 0x7fb9240ceeb0 2023-08-25T04:18:26.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.058+0000 7fb929f6e640 1 -- 172.21.15.55:0/3728180678 >> v1:172.21.15.110:6789/0 conn(0x7fb9240ceeb0 legacy=0x7fb9240b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:26.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.058+0000 7fb929f6e640 1 -- 172.21.15.55:0/3728180678 >> v1:172.21.15.55:6789/0 conn(0x7fb9240c89f0 legacy=0x7fb9240ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:26.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.058+0000 7fb929f6e640 1 -- 172.21.15.55:0/3728180678 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9240cce40 con 0x7fb9240ad950 2023-08-25T04:18:26.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.058+0000 7fb929f6e640 1 --2- 172.21.15.55:0/3728180678 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9240ad950 0x7fb9240cc2a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb9200097f0 tx=0x7fb92001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=435be3a7fe101241 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:26.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb928f6c640 1 -- 172.21.15.55:0/3728180678 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9200ab600 con 0x7fb9240ad950 2023-08-25T04:18:26.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb928f6c640 1 -- 172.21.15.55:0/3728180678 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9200a7050 con 0x7fb9240ad950 2023-08-25T04:18:26.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb928f6c640 1 -- 172.21.15.55:0/3728180678 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9200ab960 con 0x7fb9240ad950 2023-08-25T04:18:26.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb92c1d2640 1 -- 172.21.15.55:0/3728180678 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9240ad950 msgr2=0x7fb9240cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:26.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb92c1d2640 1 --2- 172.21.15.55:0/3728180678 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9240ad950 0x7fb9240cc2a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb9200097f0 tx=0x7fb92001c430 comp rx=0 tx=0).stop 2023-08-25T04:18:26.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb92c1d2640 1 -- 172.21.15.55:0/3728180678 shutdown_connections 2023-08-25T04:18:26.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb92c1d2640 1 --2- 172.21.15.55:0/3728180678 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9240ad950 0x7fb9240cc2a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb92c1d2640 1 -- 172.21.15.55:0/3728180678 >> 172.21.15.55:0/3728180678 conn(0x7fb924069d00 msgr2=0x7fb92406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:26.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb92c1d2640 1 -- 172.21.15.55:0/3728180678 shutdown_connections 2023-08-25T04:18:26.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb92c1d2640 1 -- 172.21.15.55:0/3728180678 wait complete. 2023-08-25T04:18:26.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb92c1d2640 1 Processor -- start 2023-08-25T04:18:26.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb92c1d2640 1 -- start start 2023-08-25T04:18:26.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb92c1d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9240ad950 0x7fb9240c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:26.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb92c1d2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9240c89f0 0x7fb9240c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:26.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb92c1d2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9240ceeb0 0x7fb9240979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:26.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb92c1d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb924097ef0 con 0x7fb9240ad950 2023-08-25T04:18:26.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb92c1d2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb924153980 con 0x7fb9240ceeb0 2023-08-25T04:18:26.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb92c1d2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb924153e10 con 0x7fb9240c89f0 2023-08-25T04:18:26.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb929f6e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9240ad950 0x7fb9240c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:26.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb929f6e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9240ad950 0x7fb9240c48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45842/0 (socket says 172.21.15.55:45842) 2023-08-25T04:18:26.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.062+0000 7fb929f6e640 1 -- 172.21.15.55:0/192906063 learned_addr learned my addr 172.21.15.55:0/192906063 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:26.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.066+0000 7fb92a76f640 1 --2- 172.21.15.55:0/192906063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9240ceeb0 0x7fb9240979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:26.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.066+0000 7fb92976d640 1 --2- 172.21.15.55:0/192906063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9240c89f0 0x7fb9240c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:26.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.066+0000 7fb929f6e640 1 -- 172.21.15.55:0/192906063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9240c89f0 msgr2=0x7fb9240c2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:26.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.066+0000 7fb929f6e640 1 --2- 172.21.15.55:0/192906063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9240c89f0 0x7fb9240c2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.066+0000 7fb929f6e640 1 -- 172.21.15.55:0/192906063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9240ceeb0 msgr2=0x7fb9240979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:26.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.066+0000 7fb929f6e640 1 --2- 172.21.15.55:0/192906063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9240ceeb0 0x7fb9240979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.066+0000 7fb929f6e640 1 -- 172.21.15.55:0/192906063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb920009420 con 0x7fb9240ad950 2023-08-25T04:18:26.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.066+0000 7fb92a76f640 1 --2- 172.21.15.55:0/192906063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9240ceeb0 0x7fb9240979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:26.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.066+0000 7fb92976d640 1 --2- 172.21.15.55:0/192906063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9240c89f0 0x7fb9240c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:26.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.066+0000 7fb929f6e640 1 --2- 172.21.15.55:0/192906063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9240ad950 0x7fb9240c48e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb920000c10 tx=0x7fb9200191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:26.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.066+0000 7fb91a7fc640 1 -- 172.21.15.55:0/192906063 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9200b4400 con 0x7fb9240ad950 2023-08-25T04:18:26.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.066+0000 7fb91a7fc640 1 -- 172.21.15.55:0/192906063 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9200b4560 con 0x7fb9240ad950 2023-08-25T04:18:26.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.066+0000 7fb91a7fc640 1 -- 172.21.15.55:0/192906063 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9200b48d0 con 0x7fb9240ad950 2023-08-25T04:18:26.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.066+0000 7fb92c1d2640 1 -- 172.21.15.55:0/192906063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb924154dd0 con 0x7fb9240ad950 2023-08-25T04:18:26.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.066+0000 7fb92c1d2640 1 -- 172.21.15.55:0/192906063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb924153050 con 0x7fb9240ad950 2023-08-25T04:18:26.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.066+0000 7fb92c1d2640 1 -- 172.21.15.55:0/192906063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92404dbe0 con 0x7fb9240ad950 2023-08-25T04:18:26.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.066+0000 7fb91a7fc640 1 -- 172.21.15.55:0/192906063 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fb9200b2040 con 0x7fb9240ad950 2023-08-25T04:18:26.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.070+0000 7fb91a7fc640 1 --2- 172.21.15.55:0/192906063 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fb9080657a0 0x7fb908067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:26.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.070+0000 7fb91a7fc640 1 -- 172.21.15.55:0/192906063 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb92011d180 con 0x7fb9240ad950 2023-08-25T04:18:26.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.070+0000 7fb92976d640 1 --2- 172.21.15.55:0/192906063 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fb9080657a0 0x7fb908067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:26.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.070+0000 7fb92976d640 1 --2- 172.21.15.55:0/192906063 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fb9080657a0 0x7fb908067c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb9240cb810 tx=0x7fb914009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:26.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.074+0000 7fb91a7fc640 1 -- 172.21.15.55:0/192906063 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb9200ea980 con 0x7fb9240ad950 2023-08-25T04:18:26.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.230+0000 7fb92c1d2640 1 -- 172.21.15.55:0/192906063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9240cb560 con 0x7fb9240ad950 2023-08-25T04:18:26.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.230+0000 7fb91a7fc640 1 -- 172.21.15.55:0/192906063 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18318 (secure 0 0 0) 0x7fb9200edfa0 con 0x7fb9240ad950 2023-08-25T04:18:26.230 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:26.230 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":78,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:18:25.286736+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:18:23.823729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-25T04:18:24.273419+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:18:26.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.234+0000 7fb92c1d2640 1 -- 172.21.15.55:0/192906063 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fb9080657a0 msgr2=0x7fb908067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:26.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.234+0000 7fb92c1d2640 1 --2- 172.21.15.55:0/192906063 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fb9080657a0 0x7fb908067c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb9240cb810 tx=0x7fb914009040 comp rx=0 tx=0).stop 2023-08-25T04:18:26.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.234+0000 7fb92c1d2640 1 -- 172.21.15.55:0/192906063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9240ad950 msgr2=0x7fb9240c48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:26.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.234+0000 7fb92c1d2640 1 --2- 172.21.15.55:0/192906063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9240ad950 0x7fb9240c48e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fb920000c10 tx=0x7fb9200191d0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.234+0000 7fb92c1d2640 1 -- 172.21.15.55:0/192906063 shutdown_connections 2023-08-25T04:18:26.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.234+0000 7fb92c1d2640 1 --2- 172.21.15.55:0/192906063 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fb9080657a0 0x7fb908067c60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.234+0000 7fb92c1d2640 1 --2- 172.21.15.55:0/192906063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9240ceeb0 0x7fb9240979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.234+0000 7fb92c1d2640 1 --2- 172.21.15.55:0/192906063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9240c89f0 0x7fb9240c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.234+0000 7fb92c1d2640 1 --2- 172.21.15.55:0/192906063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9240ad950 0x7fb9240c48e0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.234+0000 7fb92c1d2640 1 -- 172.21.15.55:0/192906063 >> 172.21.15.55:0/192906063 conn(0x7fb924069d00 msgr2=0x7fb92406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:26.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.234+0000 7fb92c1d2640 1 -- 172.21.15.55:0/192906063 shutdown_connections 2023-08-25T04:18:26.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.234+0000 7fb92c1d2640 1 -- 172.21.15.55:0/192906063 wait complete. 2023-08-25T04:18:26.251 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:18:26.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.398+0000 7f673d72c640 1 Processor -- start 2023-08-25T04:18:26.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.398+0000 7f673d72c640 1 -- start start 2023-08-25T04:18:26.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.398+0000 7f673d72c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f67380cbe20 0x7f6738071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:26.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.398+0000 7f673d72c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f673806c110 0x7f673806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:26.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.398+0000 7f673d72c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673806ca80 con 0x7f673815c9e0 2023-08-25T04:18:26.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.398+0000 7f673d72c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67380cc3c0 con 0x7f67380cbe20 2023-08-25T04:18:26.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.398+0000 7f673d72c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6738070410 con 0x7f673806c110 2023-08-25T04:18:26.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.398+0000 7f67377fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f673806c110 0x7f673806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:26.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.398+0000 7f6736ffd640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f673815c9e0 0x7f673806b3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:48780/0 (socket says 172.21.15.55:48780) 2023-08-25T04:18:26.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.398+0000 7f67377fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f673806c110 0x7f673806c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:47666/0 (socket says 172.21.15.55:47666) 2023-08-25T04:18:26.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.398+0000 7f67367fc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f67380cbe20 0x7f6738071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:26.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.398+0000 7f6736ffd640 1 -- 172.21.15.55:0/1501701559 learned_addr learned my addr 172.21.15.55:0/1501701559 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:26.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.398+0000 7f67377fe640 1 -- 172.21.15.55:0/1501701559 >> v2:172.21.15.110:3300/0 conn(0x7f67380cbe20 msgr2=0x7f6738071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:26.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.398+0000 7f67377fe640 1 --2- 172.21.15.55:0/1501701559 >> v2:172.21.15.110:3300/0 conn(0x7f67380cbe20 0x7f6738071450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.398+0000 7f67377fe640 1 -- 172.21.15.55:0/1501701559 >> v1:172.21.15.110:6789/0 conn(0x7f673815c9e0 legacy=0x7f673806b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:26.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.398+0000 7f67377fe640 1 -- 172.21.15.55:0/1501701559 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6738070690 con 0x7f673806c110 2023-08-25T04:18:26.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.398+0000 7f6735ffb640 1 -- 172.21.15.55:0/1501701559 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3118410083 0 0) 0x7f673806ca80 con 0x7f673815c9e0 2023-08-25T04:18:26.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.402+0000 7f67377fe640 1 --2- 172.21.15.55:0/1501701559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f673806c110 0x7f673806c540 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6730009d90 tx=0x7f673001c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d97d3066edf8225a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:26.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.402+0000 7f6735ffb640 1 -- 172.21.15.55:0/1501701559 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67300a5870 con 0x7f673806c110 2023-08-25T04:18:26.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.402+0000 7f6735ffb640 1 -- 172.21.15.55:0/1501701559 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67300a59d0 con 0x7f673806c110 2023-08-25T04:18:26.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.402+0000 7f6735ffb640 1 -- 172.21.15.55:0/1501701559 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67300a5d60 con 0x7f673806c110 2023-08-25T04:18:26.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.402+0000 7f673d72c640 1 -- 172.21.15.55:0/1501701559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f673806c110 msgr2=0x7f673806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:26.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.402+0000 7f673d72c640 1 --2- 172.21.15.55:0/1501701559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f673806c110 0x7f673806c540 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6730009d90 tx=0x7f673001c8c0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.402+0000 7f673d72c640 1 -- 172.21.15.55:0/1501701559 shutdown_connections 2023-08-25T04:18:26.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.402+0000 7f673d72c640 1 --2- 172.21.15.55:0/1501701559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f673806c110 0x7f673806c540 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.402+0000 7f673d72c640 1 --2- 172.21.15.55:0/1501701559 >> v2:172.21.15.110:3300/0 conn(0x7f67380cbe20 0x7f6738071450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.402+0000 7f673d72c640 1 -- 172.21.15.55:0/1501701559 >> 172.21.15.55:0/1501701559 conn(0x7f67380cabd0 msgr2=0x7f67380cafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:26.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.402+0000 7f673d72c640 1 -- 172.21.15.55:0/1501701559 shutdown_connections 2023-08-25T04:18:26.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.402+0000 7f673d72c640 1 -- 172.21.15.55:0/1501701559 wait complete. 2023-08-25T04:18:26.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f673d72c640 1 Processor -- start 2023-08-25T04:18:26.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f673d72c640 1 -- start start 2023-08-25T04:18:26.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f673d72c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f673806c110 0x7f6738151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:26.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f673d72c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67380cbe20 0x7f67380c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:26.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f673d72c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673815c9e0 0x7f67380c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:26.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f673d72c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67380b11b0 con 0x7f673815c9e0 2023-08-25T04:18:26.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f673d72c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67380b1490 con 0x7f673806c110 2023-08-25T04:18:26.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f673d72c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67380b1770 con 0x7f67380cbe20 2023-08-25T04:18:26.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f67377fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673815c9e0 0x7f67380c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:26.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f67377fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673815c9e0 0x7f67380c5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45846/0 (socket says 172.21.15.55:45846) 2023-08-25T04:18:26.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f67377fe640 1 -- 172.21.15.55:0/1707994177 learned_addr learned my addr 172.21.15.55:0/1707994177 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:26.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f67367fc640 1 --2- 172.21.15.55:0/1707994177 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67380cbe20 0x7f67380c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:26.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f6736ffd640 1 --2- 172.21.15.55:0/1707994177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f673806c110 0x7f6738151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:26.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f67377fe640 1 -- 172.21.15.55:0/1707994177 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67380cbe20 msgr2=0x7f67380c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:26.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f67377fe640 1 --2- 172.21.15.55:0/1707994177 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67380cbe20 0x7f67380c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f67377fe640 1 -- 172.21.15.55:0/1707994177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f673806c110 msgr2=0x7f6738151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:26.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f67377fe640 1 --2- 172.21.15.55:0/1707994177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f673806c110 0x7f6738151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f67377fe640 1 -- 172.21.15.55:0/1707994177 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6730009a70 con 0x7f673815c9e0 2023-08-25T04:18:26.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f6736ffd640 1 --2- 172.21.15.55:0/1707994177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f673806c110 0x7f6738151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:26.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f67377fe640 1 --2- 172.21.15.55:0/1707994177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673815c9e0 0x7f67380c5190 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f673001af70 tx=0x7f6730019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:26.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f671f7fe640 1 -- 172.21.15.55:0/1707994177 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67300a5830 con 0x7f673815c9e0 2023-08-25T04:18:26.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f671f7fe640 1 -- 172.21.15.55:0/1707994177 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67300ad650 con 0x7f673815c9e0 2023-08-25T04:18:26.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f671f7fe640 1 -- 172.21.15.55:0/1707994177 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67300ad9e0 con 0x7f673815c9e0 2023-08-25T04:18:26.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f673d72c640 1 -- 172.21.15.55:0/1707994177 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67380b1a50 con 0x7f673815c9e0 2023-08-25T04:18:26.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.406+0000 7f673d72c640 1 -- 172.21.15.55:0/1707994177 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67380b0dd0 con 0x7f673815c9e0 2023-08-25T04:18:26.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.410+0000 7f673d72c640 1 -- 172.21.15.55:0/1707994177 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67380b0f60 con 0x7f673815c9e0 2023-08-25T04:18:26.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.410+0000 7f671f7fe640 1 -- 172.21.15.55:0/1707994177 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f67300adb40 con 0x7f673815c9e0 2023-08-25T04:18:26.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.410+0000 7f671f7fe640 1 --2- 172.21.15.55:0/1707994177 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f67240657a0 0x7f6724067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:26.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.410+0000 7f671f7fe640 1 -- 172.21.15.55:0/1707994177 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f673011e250 con 0x7f673815c9e0 2023-08-25T04:18:26.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.410+0000 7f6736ffd640 1 --2- 172.21.15.55:0/1707994177 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f67240657a0 0x7f6724067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:26.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.410+0000 7f6736ffd640 1 --2- 172.21.15.55:0/1707994177 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f67240657a0 0x7f6724067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6728000fc0 tx=0x7f6728009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:26.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.414+0000 7f671f7fe640 1 -- 172.21.15.55:0/1707994177 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f67300ebb60 con 0x7f673815c9e0 2023-08-25T04:18:26.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.570+0000 7f673d72c640 1 -- 172.21.15.55:0/1707994177 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6738073e50 con 0x7f673815c9e0 2023-08-25T04:18:26.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.574+0000 7f671f7fe640 1 -- 172.21.15.55:0/1707994177 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18318 (secure 0 0 0) 0x7f67300ef180 con 0x7f673815c9e0 2023-08-25T04:18:26.572 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:26.572 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":78,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:18:25.286736+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:18:23.823729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-25T04:18:24.273419+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:18:26.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.574+0000 7f673d72c640 1 -- 172.21.15.55:0/1707994177 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f67240657a0 msgr2=0x7f6724067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:26.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.574+0000 7f673d72c640 1 --2- 172.21.15.55:0/1707994177 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f67240657a0 0x7f6724067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6728000fc0 tx=0x7f6728009040 comp rx=0 tx=0).stop 2023-08-25T04:18:26.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.574+0000 7f673d72c640 1 -- 172.21.15.55:0/1707994177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673815c9e0 msgr2=0x7f67380c5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:26.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.574+0000 7f673d72c640 1 --2- 172.21.15.55:0/1707994177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673815c9e0 0x7f67380c5190 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f673001af70 tx=0x7f6730019660 comp rx=0 tx=0).stop 2023-08-25T04:18:26.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.574+0000 7f673d72c640 1 -- 172.21.15.55:0/1707994177 shutdown_connections 2023-08-25T04:18:26.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.574+0000 7f673d72c640 1 --2- 172.21.15.55:0/1707994177 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f67240657a0 0x7f6724067c60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.574+0000 7f673d72c640 1 --2- 172.21.15.55:0/1707994177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673815c9e0 0x7f67380c5190 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.574+0000 7f673d72c640 1 --2- 172.21.15.55:0/1707994177 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67380cbe20 0x7f67380c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.574+0000 7f673d72c640 1 --2- 172.21.15.55:0/1707994177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f673806c110 0x7f6738151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.574+0000 7f673d72c640 1 -- 172.21.15.55:0/1707994177 >> 172.21.15.55:0/1707994177 conn(0x7f67380cabd0 msgr2=0x7f673815b460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:26.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.574+0000 7f673d72c640 1 -- 172.21.15.55:0/1707994177 shutdown_connections 2023-08-25T04:18:26.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.574+0000 7f673d72c640 1 -- 172.21.15.55:0/1707994177 wait complete. 2023-08-25T04:18:26.593 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-25T04:18:26.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.742+0000 7f1d31408640 1 Processor -- start 2023-08-25T04:18:26.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.742+0000 7f1d31408640 1 -- start start 2023-08-25T04:18:26.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.742+0000 7f1d31408640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d2c0cb020 0x7f1d2c0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:26.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.742+0000 7f1d31408640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d2c06c720 0x7f1d2c06cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:26.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.742+0000 7f1d31408640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2c0cbca0 con 0x7f1d2c0cdd50 2023-08-25T04:18:26.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.742+0000 7f1d31408640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d2c0c9470 con 0x7f1d2c0cb020 2023-08-25T04:18:26.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.742+0000 7f1d31408640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c0ce1e0 con 0x7f1d2c06c720 2023-08-25T04:18:26.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.742+0000 7f1d2affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d2c0cb020 0x7f1d2c0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:26.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.742+0000 7f1d2affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d2c0cb020 0x7f1d2c0c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45858/0 (socket says 172.21.15.55:45858) 2023-08-25T04:18:26.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.742+0000 7f1d2affd640 1 -- 172.21.15.55:0/3850818762 learned_addr learned my addr 172.21.15.55:0/3850818762 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:26.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.742+0000 7f1d2b7fe640 1 --2- 172.21.15.55:0/3850818762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d2c06c720 0x7f1d2c06cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:26.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.742+0000 7f1d2affd640 1 -- 172.21.15.55:0/3850818762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d2c06c720 msgr2=0x7f1d2c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:26.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.742+0000 7f1d2affd640 1 --2- 172.21.15.55:0/3850818762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d2c06c720 0x7f1d2c06cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.742+0000 7f1d2affd640 1 -- 172.21.15.55:0/3850818762 >> v1:172.21.15.110:6789/0 conn(0x7f1d2c0cdd50 legacy=0x7f1d2c0cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:26.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.742+0000 7f1d2affd640 1 -- 172.21.15.55:0/3850818762 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c06d070 con 0x7f1d2c0cb020 2023-08-25T04:18:26.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.746+0000 7f1d2affd640 1 --2- 172.21.15.55:0/3850818762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2c0cb020 0x7f1d2c0c9900 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c006fd0 tx=0x7f1d1c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d372fe56f781186 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:26.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.746+0000 7f1d29ffb640 1 -- 172.21.15.55:0/3850818762 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c0ad680 con 0x7f1d2c0cb020 2023-08-25T04:18:26.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.746+0000 7f1d29ffb640 1 -- 172.21.15.55:0/3850818762 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1c0ad7e0 con 0x7f1d2c0cb020 2023-08-25T04:18:26.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.746+0000 7f1d29ffb640 1 -- 172.21.15.55:0/3850818762 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c0adb70 con 0x7f1d2c0cb020 2023-08-25T04:18:26.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.746+0000 7f1d31408640 1 -- 172.21.15.55:0/3850818762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2c0cb020 msgr2=0x7f1d2c0c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:26.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.746+0000 7f1d31408640 1 --2- 172.21.15.55:0/3850818762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2c0cb020 0x7f1d2c0c9900 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c006fd0 tx=0x7f1d1c01c490 comp rx=0 tx=0).stop 2023-08-25T04:18:26.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.746+0000 7f1d31408640 1 -- 172.21.15.55:0/3850818762 shutdown_connections 2023-08-25T04:18:26.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.746+0000 7f1d31408640 1 --2- 172.21.15.55:0/3850818762 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d2c06c720 0x7f1d2c06cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.746+0000 7f1d31408640 1 --2- 172.21.15.55:0/3850818762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2c0cb020 0x7f1d2c0c9900 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.746+0000 7f1d31408640 1 -- 172.21.15.55:0/3850818762 >> 172.21.15.55:0/3850818762 conn(0x7f1d2c069900 msgr2=0x7f1d2c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:26.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.746+0000 7f1d31408640 1 -- 172.21.15.55:0/3850818762 shutdown_connections 2023-08-25T04:18:26.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.746+0000 7f1d31408640 1 -- 172.21.15.55:0/3850818762 wait complete. 2023-08-25T04:18:26.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d31408640 1 Processor -- start 2023-08-25T04:18:26.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d31408640 1 -- start start 2023-08-25T04:18:26.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d31408640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2c06c720 0x7f1d2c154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:26.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d31408640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d2c0cb020 0x7f1d2c0b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:26.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d31408640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2c0cdd50 0x7f1d2c0ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:26.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d31408640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c0ab9d0 con 0x7f1d2c06c720 2023-08-25T04:18:26.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d31408640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c0c8380 con 0x7f1d2c0cdd50 2023-08-25T04:18:26.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d31408640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c0c7e00 con 0x7f1d2c0cb020 2023-08-25T04:18:26.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d2affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2c06c720 0x7f1d2c154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:26.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d2affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2c06c720 0x7f1d2c154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45872/0 (socket says 172.21.15.55:45872) 2023-08-25T04:18:26.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d2affd640 1 -- 172.21.15.55:0/2333137311 learned_addr learned my addr 172.21.15.55:0/2333137311 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:26.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d2a7fc640 1 --2- 172.21.15.55:0/2333137311 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d2c0cb020 0x7f1d2c0b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:26.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d2b7fe640 1 --2- 172.21.15.55:0/2333137311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2c0cdd50 0x7f1d2c0ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:26.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d2affd640 1 -- 172.21.15.55:0/2333137311 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d2c0cb020 msgr2=0x7f1d2c0b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:26.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d2affd640 1 --2- 172.21.15.55:0/2333137311 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d2c0cb020 0x7f1d2c0b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d2affd640 1 -- 172.21.15.55:0/2333137311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2c0cdd50 msgr2=0x7f1d2c0ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:26.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d2affd640 1 --2- 172.21.15.55:0/2333137311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2c0cdd50 0x7f1d2c0ad220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:26.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d2affd640 1 -- 172.21.15.55:0/2333137311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c009480 con 0x7f1d2c06c720 2023-08-25T04:18:26.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d2affd640 1 --2- 172.21.15.55:0/2333137311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2c06c720 0x7f1d2c154f80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0b0040 tx=0x7f1d1c019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:26.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d137fe640 1 -- 172.21.15.55:0/2333137311 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c0ba070 con 0x7f1d2c06c720 2023-08-25T04:18:26.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d137fe640 1 -- 172.21.15.55:0/2333137311 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1c004250 con 0x7f1d2c06c720 2023-08-25T04:18:26.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d31408640 1 -- 172.21.15.55:0/2333137311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2c0b2540 con 0x7f1d2c06c720 2023-08-25T04:18:26.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d137fe640 1 -- 172.21.15.55:0/2333137311 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c0ad950 con 0x7f1d2c06c720 2023-08-25T04:18:26.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d31408640 1 -- 172.21.15.55:0/2333137311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2c0ab660 con 0x7f1d2c06c720 2023-08-25T04:18:26.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.750+0000 7f1d31408640 1 -- 172.21.15.55:0/2333137311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2c073ec0 con 0x7f1d2c06c720 2023-08-25T04:18:26.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.754+0000 7f1d137fe640 1 -- 172.21.15.55:0/2333137311 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f1d1c0adab0 con 0x7f1d2c06c720 2023-08-25T04:18:26.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.754+0000 7f1d137fe640 1 --2- 172.21.15.55:0/2333137311 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f1d180657a0 0x7f1d18067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:26.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.754+0000 7f1d137fe640 1 -- 172.21.15.55:0/2333137311 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1d1c11c760 con 0x7f1d2c06c720 2023-08-25T04:18:26.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.754+0000 7f1d2a7fc640 1 --2- 172.21.15.55:0/2333137311 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f1d180657a0 0x7f1d18067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:26.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.754+0000 7f1d2a7fc640 1 --2- 172.21.15.55:0/2333137311 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f1d180657a0 0x7f1d18067c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0c7a90 tx=0x7f1d20009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:26.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.758+0000 7f1d137fe640 1 -- 172.21.15.55:0/2333137311 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1d1c0ea0a0 con 0x7f1d2c06c720 2023-08-25T04:18:26.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:26.946+0000 7f1d31408640 1 -- 172.21.15.55:0/2333137311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1d2c14dfd0 con 0x7f1d2c06c720 2023-08-25T04:18:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:27.898+0000 7f1d137fe640 1 -- 172.21.15.55:0/2333137311 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1d1c0ed6c0 con 0x7f1d2c06c720 2023-08-25T04:18:27.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:27.902+0000 7f1d31408640 1 -- 172.21.15.55:0/2333137311 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f1d180657a0 msgr2=0x7f1d18067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:27.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:27.902+0000 7f1d31408640 1 --2- 172.21.15.55:0/2333137311 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f1d180657a0 0x7f1d18067c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0c7a90 tx=0x7f1d20009040 comp rx=0 tx=0).stop 2023-08-25T04:18:27.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:27.902+0000 7f1d31408640 1 -- 172.21.15.55:0/2333137311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2c06c720 msgr2=0x7f1d2c154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:27.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:27.902+0000 7f1d31408640 1 --2- 172.21.15.55:0/2333137311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2c06c720 0x7f1d2c154f80 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0b0040 tx=0x7f1d1c019230 comp rx=0 tx=0).stop 2023-08-25T04:18:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:27.902+0000 7f1d31408640 1 -- 172.21.15.55:0/2333137311 shutdown_connections 2023-08-25T04:18:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:27.902+0000 7f1d31408640 1 --2- 172.21.15.55:0/2333137311 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f1d180657a0 0x7f1d18067c60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:27.902+0000 7f1d31408640 1 --2- 172.21.15.55:0/2333137311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d2c0cdd50 0x7f1d2c0ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:27.902+0000 7f1d31408640 1 --2- 172.21.15.55:0/2333137311 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d2c0cb020 0x7f1d2c0b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:27.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:27.902+0000 7f1d31408640 1 --2- 172.21.15.55:0/2333137311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2c06c720 0x7f1d2c154f80 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:27.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:27.902+0000 7f1d31408640 1 -- 172.21.15.55:0/2333137311 >> 172.21.15.55:0/2333137311 conn(0x7f1d2c069900 msgr2=0x7f1d2c157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:27.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:27.902+0000 7f1d31408640 1 -- 172.21.15.55:0/2333137311 shutdown_connections 2023-08-25T04:18:27.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:27.902+0000 7f1d31408640 1 -- 172.21.15.55:0/2333137311 wait complete. 2023-08-25T04:18:27.925 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-25T04:18:27.925 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-25T04:18:28.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.078+0000 7f2e270e5640 1 Processor -- start 2023-08-25T04:18:28.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.078+0000 7f2e270e5640 1 -- start start 2023-08-25T04:18:28.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.078+0000 7f2e270e5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2e2015a7f0 0x7f2e2009bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:28.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.082+0000 7f2e270e5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e2006c020 0x7f2e200acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:28.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.082+0000 7f2e270e5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2015abd0 con 0x7f2e200c9830 2023-08-25T04:18:28.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.082+0000 7f2e270e5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e200c8ab0 con 0x7f2e2015a7f0 2023-08-25T04:18:28.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.082+0000 7f2e270e5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e200c8d50 con 0x7f2e2006c020 2023-08-25T04:18:28.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.082+0000 7f2e25682640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e2006c020 0x7f2e200acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:28.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.082+0000 7f2e25682640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e2006c020 0x7f2e200acff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:47688/0 (socket says 172.21.15.55:47688) 2023-08-25T04:18:28.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.082+0000 7f2e25682640 1 -- 172.21.15.55:0/1068131779 learned_addr learned my addr 172.21.15.55:0/1068131779 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:28.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.082+0000 7f2e17fff640 1 --1- 172.21.15.55:0/1068131779 >> v1:172.21.15.110:6789/0 conn(0x7f2e200c9830 0x7f2e20070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:48800/0 (socket says 172.21.15.55:48800) 2023-08-25T04:18:28.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.082+0000 7f2e24e81640 1 --2- 172.21.15.55:0/1068131779 >> v2:172.21.15.110:3300/0 conn(0x7f2e2015a7f0 0x7f2e2009bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:28.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.082+0000 7f2e24e81640 1 -- 172.21.15.55:0/1068131779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e2006c020 msgr2=0x7f2e200acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:28.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.082+0000 7f2e24e81640 1 --2- 172.21.15.55:0/1068131779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e2006c020 0x7f2e200acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:28.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.082+0000 7f2e24e81640 1 -- 172.21.15.55:0/1068131779 >> v1:172.21.15.110:6789/0 conn(0x7f2e200c9830 legacy=0x7f2e20070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:28.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.082+0000 7f2e24e81640 1 -- 172.21.15.55:0/1068131779 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e200c9030 con 0x7f2e2015a7f0 2023-08-25T04:18:28.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.082+0000 7f2e25682640 1 --2- 172.21.15.55:0/1068131779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e2006c020 0x7f2e200acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:28.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.086+0000 7f2e24e81640 1 --2- 172.21.15.55:0/1068131779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e2015a7f0 0x7f2e2009bde0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0097a0 tx=0x7f2e1c01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4092b987bf90d91 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:28.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.086+0000 7f2e177fe640 1 -- 172.21.15.55:0/1068131779 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c0ab600 con 0x7f2e2015a7f0 2023-08-25T04:18:28.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.086+0000 7f2e177fe640 1 -- 172.21.15.55:0/1068131779 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1c0a7050 con 0x7f2e2015a7f0 2023-08-25T04:18:28.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.086+0000 7f2e177fe640 1 -- 172.21.15.55:0/1068131779 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c0ab980 con 0x7f2e2015a7f0 2023-08-25T04:18:28.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.086+0000 7f2e270e5640 1 -- 172.21.15.55:0/1068131779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e2015a7f0 msgr2=0x7f2e2009bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:28.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.086+0000 7f2e270e5640 1 --2- 172.21.15.55:0/1068131779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e2015a7f0 0x7f2e2009bde0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0097a0 tx=0x7f2e1c01c430 comp rx=0 tx=0).stop 2023-08-25T04:18:28.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.086+0000 7f2e270e5640 1 -- 172.21.15.55:0/1068131779 shutdown_connections 2023-08-25T04:18:28.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.086+0000 7f2e270e5640 1 --2- 172.21.15.55:0/1068131779 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e2006c020 0x7f2e200acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:28.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.086+0000 7f2e270e5640 1 --2- 172.21.15.55:0/1068131779 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e2015a7f0 0x7f2e2009bde0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:28.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.086+0000 7f2e270e5640 1 -- 172.21.15.55:0/1068131779 >> 172.21.15.55:0/1068131779 conn(0x7f2e20069900 msgr2=0x7f2e20069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:28.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.086+0000 7f2e270e5640 1 -- 172.21.15.55:0/1068131779 shutdown_connections 2023-08-25T04:18:28.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.086+0000 7f2e270e5640 1 -- 172.21.15.55:0/1068131779 wait complete. 2023-08-25T04:18:28.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.086+0000 7f2e270e5640 1 Processor -- start 2023-08-25T04:18:28.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.086+0000 7f2e270e5640 1 -- start start 2023-08-25T04:18:28.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.086+0000 7f2e270e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e2006c020 0x7f2e2014b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:28.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e270e5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e200c9830 0x7f2e200c1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:28.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e270e5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e2015a7f0 0x7f2e200ac500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:28.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e270e5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2014b8a0 con 0x7f2e2006c020 2023-08-25T04:18:28.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e270e5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e200c4e10 con 0x7f2e2015a7f0 2023-08-25T04:18:28.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e270e5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2014c240 con 0x7f2e200c9830 2023-08-25T04:18:28.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e24e81640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e2006c020 0x7f2e2014b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:28.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e24e81640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e2006c020 0x7f2e2014b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45876/0 (socket says 172.21.15.55:45876) 2023-08-25T04:18:28.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e24e81640 1 -- 172.21.15.55:0/3139612084 learned_addr learned my addr 172.21.15.55:0/3139612084 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:28.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e24e81640 1 -- 172.21.15.55:0/3139612084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e200c9830 msgr2=0x7f2e200c1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:28.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e25682640 1 --2- 172.21.15.55:0/3139612084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e2015a7f0 0x7f2e200ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:28.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e24e81640 1 --2- 172.21.15.55:0/3139612084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e200c9830 0x7f2e200c1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e24e81640 1 -- 172.21.15.55:0/3139612084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e2015a7f0 msgr2=0x7f2e200ac500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e24e81640 1 --2- 172.21.15.55:0/3139612084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e2015a7f0 0x7f2e200ac500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e24e81640 1 -- 172.21.15.55:0/3139612084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e18009b30 con 0x7f2e2006c020 2023-08-25T04:18:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e25682640 1 --2- 172.21.15.55:0/3139612084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e2015a7f0 0x7f2e200ac500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e24e81640 1 --2- 172.21.15.55:0/3139612084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e2006c020 0x7f2e2014b360 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c01aae0 tx=0x7f2e1c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e157fa640 1 -- 172.21.15.55:0/3139612084 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c0b4460 con 0x7f2e2006c020 2023-08-25T04:18:28.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e157fa640 1 -- 172.21.15.55:0/3139612084 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1c0b45c0 con 0x7f2e2006c020 2023-08-25T04:18:28.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e157fa640 1 -- 172.21.15.55:0/3139612084 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c0b4970 con 0x7f2e2006c020 2023-08-25T04:18:28.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e270e5640 1 -- 172.21.15.55:0/3139612084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1c0093b0 con 0x7f2e2006c020 2023-08-25T04:18:28.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e270e5640 1 -- 172.21.15.55:0/3139612084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2014bbf0 con 0x7f2e2006c020 2023-08-25T04:18:28.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e270e5640 1 -- 172.21.15.55:0/3139612084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2006d5b0 con 0x7f2e2006c020 2023-08-25T04:18:28.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.090+0000 7f2e157fa640 1 -- 172.21.15.55:0/3139612084 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f2e1c0b2070 con 0x7f2e2006c020 2023-08-25T04:18:28.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.094+0000 7f2e157fa640 1 --2- 172.21.15.55:0/3139612084 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f2e0c0657a0 0x7f2e0c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:28.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.094+0000 7f2e157fa640 1 -- 172.21.15.55:0/3139612084 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e1c11cf00 con 0x7f2e2006c020 2023-08-25T04:18:28.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.094+0000 7f2e17fff640 1 --2- 172.21.15.55:0/3139612084 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f2e0c0657a0 0x7f2e0c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:28.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.094+0000 7f2e17fff640 1 --2- 172.21.15.55:0/3139612084 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f2e0c0657a0 0x7f2e0c067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2e201f6bd0 tx=0x7f2e100079d0 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:28.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.098+0000 7f2e157fa640 1 -- 172.21.15.55:0/3139612084 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2e1c0ea7a0 con 0x7f2e2006c020 2023-08-25T04:18:28.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.286+0000 7f2e270e5640 1 -- 172.21.15.55:0/3139612084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2e2014ba50 con 0x7f2e2006c020 2023-08-25T04:18:28.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.918+0000 7f2e157fa640 1 -- 172.21.15.55:0/3139612084 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2e2014ba50 con 0x7f2e2006c020 2023-08-25T04:18:28.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.922+0000 7f2e270e5640 1 -- 172.21.15.55:0/3139612084 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f2e0c0657a0 msgr2=0x7f2e0c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:28.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.922+0000 7f2e270e5640 1 --2- 172.21.15.55:0/3139612084 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f2e0c0657a0 0x7f2e0c067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2e201f6bd0 tx=0x7f2e100079d0 comp rx=0 tx=0).stop 2023-08-25T04:18:28.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.922+0000 7f2e270e5640 1 -- 172.21.15.55:0/3139612084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e2006c020 msgr2=0x7f2e2014b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:28.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.922+0000 7f2e270e5640 1 --2- 172.21.15.55:0/3139612084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e2006c020 0x7f2e2014b360 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c01aae0 tx=0x7f2e1c01ac70 comp rx=0 tx=0).stop 2023-08-25T04:18:28.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.922+0000 7f2e270e5640 1 -- 172.21.15.55:0/3139612084 shutdown_connections 2023-08-25T04:18:28.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.922+0000 7f2e270e5640 1 --2- 172.21.15.55:0/3139612084 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f2e0c0657a0 0x7f2e0c067c60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:28.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.922+0000 7f2e270e5640 1 --2- 172.21.15.55:0/3139612084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e2015a7f0 0x7f2e200ac500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:28.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.922+0000 7f2e270e5640 1 --2- 172.21.15.55:0/3139612084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e200c9830 0x7f2e200c1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:28.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.922+0000 7f2e270e5640 1 --2- 172.21.15.55:0/3139612084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e2006c020 0x7f2e2014b360 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:28.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.922+0000 7f2e270e5640 1 -- 172.21.15.55:0/3139612084 >> 172.21.15.55:0/3139612084 conn(0x7f2e20069900 msgr2=0x7f2e20072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:28.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.922+0000 7f2e270e5640 1 -- 172.21.15.55:0/3139612084 shutdown_connections 2023-08-25T04:18:28.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:28.922+0000 7f2e270e5640 1 -- 172.21.15.55:0/3139612084 wait complete. 2023-08-25T04:18:28.943 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-25T04:18:28.944 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:18:29.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.094+0000 7f4965bfa640 1 Processor -- start 2023-08-25T04:18:29.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.094+0000 7f4965bfa640 1 -- start start 2023-08-25T04:18:29.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.098+0000 7f4965bfa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f49600d0da0 0x7f49600d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:29.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.098+0000 7f4965bfa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49600b3e50 0x7f49600ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:29.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.098+0000 7f4965bfa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49600b29b0 con 0x7f49600cdde0 2023-08-25T04:18:29.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.098+0000 7f4965bfa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49600ce760 con 0x7f49600d0da0 2023-08-25T04:18:29.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.098+0000 7f4965bfa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49600d16c0 con 0x7f49600b3e50 2023-08-25T04:18:29.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.098+0000 7f495ffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49600b3e50 0x7f49600ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:29.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.098+0000 7f495ffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49600b3e50 0x7f49600ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:47694/0 (socket says 172.21.15.55:47694) 2023-08-25T04:18:29.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.098+0000 7f495ffff640 1 -- 172.21.15.55:0/3612390267 learned_addr learned my addr 172.21.15.55:0/3612390267 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:29.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.098+0000 7f495f7fe640 1 --2- 172.21.15.55:0/3612390267 >> v2:172.21.15.110:3300/0 conn(0x7f49600d0da0 0x7f49600d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:29.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.098+0000 7f495effd640 1 -- 172.21.15.55:0/3612390267 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1091381969 0 0) 0x7f49600b29b0 con 0x7f49600cdde0 2023-08-25T04:18:29.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.098+0000 7f495effd640 1 -- 172.21.15.55:0/3612390267 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f494c003530 con 0x7f49600cdde0 2023-08-25T04:18:29.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.098+0000 7f495ffff640 1 -- 172.21.15.55:0/3612390267 >> v2:172.21.15.110:3300/0 conn(0x7f49600d0da0 msgr2=0x7f49600d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:29.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.098+0000 7f495ffff640 1 --2- 172.21.15.55:0/3612390267 >> v2:172.21.15.110:3300/0 conn(0x7f49600d0da0 0x7f49600d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.098+0000 7f495ffff640 1 -- 172.21.15.55:0/3612390267 >> v1:172.21.15.110:6789/0 conn(0x7f49600cdde0 legacy=0x7f49600cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.098+0000 7f495ffff640 1 -- 172.21.15.55:0/3612390267 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49600b1dc0 con 0x7f49600b3e50 2023-08-25T04:18:29.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.098+0000 7f495f7fe640 1 --2- 172.21.15.55:0/3612390267 >> v2:172.21.15.110:3300/0 conn(0x7f49600d0da0 0x7f49600d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:29.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.102+0000 7f495ffff640 1 --2- 172.21.15.55:0/3612390267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49600b3e50 0x7f49600ce220 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4958009e50 tx=0x7f495801f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6472934b2a7fa3f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:29.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.102+0000 7f495effd640 1 -- 172.21.15.55:0/3612390267 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49580af400 con 0x7f49600b3e50 2023-08-25T04:18:29.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.102+0000 7f495effd640 1 -- 172.21.15.55:0/3612390267 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49580ab050 con 0x7f49600b3e50 2023-08-25T04:18:29.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.102+0000 7f495effd640 1 -- 172.21.15.55:0/3612390267 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49580af780 con 0x7f49600b3e50 2023-08-25T04:18:29.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.102+0000 7f4965bfa640 1 -- 172.21.15.55:0/3612390267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49600b3e50 msgr2=0x7f49600ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.102+0000 7f4965bfa640 1 --2- 172.21.15.55:0/3612390267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49600b3e50 0x7f49600ce220 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4958009e50 tx=0x7f495801f1f0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.102+0000 7f4965bfa640 1 -- 172.21.15.55:0/3612390267 shutdown_connections 2023-08-25T04:18:29.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.102+0000 7f4965bfa640 1 --2- 172.21.15.55:0/3612390267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49600b3e50 0x7f49600ce220 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.102+0000 7f4965bfa640 1 --2- 172.21.15.55:0/3612390267 >> v2:172.21.15.110:3300/0 conn(0x7f49600d0da0 0x7f49600d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.102+0000 7f4965bfa640 1 -- 172.21.15.55:0/3612390267 >> 172.21.15.55:0/3612390267 conn(0x7f496009bae0 msgr2=0x7f49600d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:29.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.102+0000 7f4965bfa640 1 -- 172.21.15.55:0/3612390267 shutdown_connections 2023-08-25T04:18:29.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.102+0000 7f4965bfa640 1 -- 172.21.15.55:0/3612390267 wait complete. 2023-08-25T04:18:29.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.102+0000 7f4965bfa640 1 Processor -- start 2023-08-25T04:18:29.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.102+0000 7f4965bfa640 1 -- start start 2023-08-25T04:18:29.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f4965bfa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49600b3e50 0x7f4960151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:29.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f4965bfa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49600cdde0 0x7f49600c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:29.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f4965bfa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49600d0da0 0x7f49600ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:29.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f4965bfa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4960152310 con 0x7f49600b3e50 2023-08-25T04:18:29.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f4965bfa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49600cb330 con 0x7f49600d0da0 2023-08-25T04:18:29.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f4965bfa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49600cb610 con 0x7f49600cdde0 2023-08-25T04:18:29.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f495f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49600b3e50 0x7f4960151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:29.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f495f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49600b3e50 0x7f4960151dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45892/0 (socket says 172.21.15.55:45892) 2023-08-25T04:18:29.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f495f7fe640 1 -- 172.21.15.55:0/1124150222 learned_addr learned my addr 172.21.15.55:0/1124150222 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:29.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f495ffff640 1 --2- 172.21.15.55:0/1124150222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49600d0da0 0x7f49600ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:29.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f4957fff640 1 --2- 172.21.15.55:0/1124150222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49600cdde0 0x7f49600c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:29.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f495f7fe640 1 -- 172.21.15.55:0/1124150222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49600cdde0 msgr2=0x7f49600c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f495f7fe640 1 --2- 172.21.15.55:0/1124150222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49600cdde0 0x7f49600c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f495f7fe640 1 -- 172.21.15.55:0/1124150222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49600d0da0 msgr2=0x7f49600ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f495f7fe640 1 --2- 172.21.15.55:0/1124150222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49600d0da0 0x7f49600ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f495f7fe640 1 -- 172.21.15.55:0/1124150222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49500093b0 con 0x7f49600b3e50 2023-08-25T04:18:29.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f4957fff640 1 --2- 172.21.15.55:0/1124150222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49600cdde0 0x7f49600c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:29.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f495ffff640 1 --2- 172.21.15.55:0/1124150222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49600d0da0 0x7f49600ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:29.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f495f7fe640 1 --2- 172.21.15.55:0/1124150222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49600b3e50 0x7f4960151dd0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f495000ebe0 tx=0x7f495000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:29.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f495cff9640 1 -- 172.21.15.55:0/1124150222 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4950009760 con 0x7f49600b3e50 2023-08-25T04:18:29.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f495cff9640 1 -- 172.21.15.55:0/1124150222 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495000cc30 con 0x7f49600b3e50 2023-08-25T04:18:29.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f495cff9640 1 -- 172.21.15.55:0/1124150222 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495000eee0 con 0x7f49600b3e50 2023-08-25T04:18:29.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f4965bfa640 1 -- 172.21.15.55:0/1124150222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4958009b30 con 0x7f49600b3e50 2023-08-25T04:18:29.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f4965bfa640 1 -- 172.21.15.55:0/1124150222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49600b68a0 con 0x7f49600b3e50 2023-08-25T04:18:29.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f4965bfa640 1 -- 172.21.15.55:0/1124150222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496004dbe0 con 0x7f49600b3e50 2023-08-25T04:18:29.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.106+0000 7f495cff9640 1 -- 172.21.15.55:0/1124150222 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f49500059a0 con 0x7f49600b3e50 2023-08-25T04:18:29.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.110+0000 7f495cff9640 1 --2- 172.21.15.55:0/1124150222 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f49400657d0 0x7f4940067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:29.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.110+0000 7f495cff9640 1 -- 172.21.15.55:0/1124150222 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f49500833a0 con 0x7f49600b3e50 2023-08-25T04:18:29.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.110+0000 7f4957fff640 1 --2- 172.21.15.55:0/1124150222 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f49400657d0 0x7f4940067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:29.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.110+0000 7f4957fff640 1 --2- 172.21.15.55:0/1124150222 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f49400657d0 0x7f4940067c90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f49600a0720 tx=0x7f4948009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:29.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.114+0000 7f495cff9640 1 -- 172.21.15.55:0/1124150222 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f49500547d0 con 0x7f49600b3e50 2023-08-25T04:18:29.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.298+0000 7f4965bfa640 1 -- 172.21.15.55:0/1124150222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49600d0b80 con 0x7f49600b3e50 2023-08-25T04:18:29.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.298+0000 7f495cff9640 1 -- 172.21.15.55:0/1124150222 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4882 (secure 0 0 0) 0x7f4950054360 con 0x7f49600b3e50 2023-08-25T04:18:29.299 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:29.299 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5915,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1922466113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1922466113},{"type":"v1","addr":"172.21.15.110:6836","nonce":1922466113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6367,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1328842039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1328842039},{"type":"v1","addr":"172.21.15.55:6835","nonce":1328842039}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6385,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/4127792530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":4127792530},{"type":"v1","addr":"172.21.15.110:6837","nonce":4127792530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:18:25.287049+0000","modified":"2023-08-25T04:18:28.905334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/1124967220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1124967220},{"type":"v1","addr":"172.21.15.55:6834","nonce":1124967220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-25T04:18:29.300 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 32 2023-08-25T04:18:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.302+0000 7f4965bfa640 1 -- 172.21.15.55:0/1124150222 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f49400657d0 msgr2=0x7f4940067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.302+0000 7f4965bfa640 1 --2- 172.21.15.55:0/1124150222 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f49400657d0 0x7f4940067c90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f49600a0720 tx=0x7f4948009040 comp rx=0 tx=0).stop 2023-08-25T04:18:29.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.302+0000 7f4965bfa640 1 -- 172.21.15.55:0/1124150222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49600b3e50 msgr2=0x7f4960151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.302+0000 7f4965bfa640 1 --2- 172.21.15.55:0/1124150222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49600b3e50 0x7f4960151dd0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f495000ebe0 tx=0x7f495000c520 comp rx=0 tx=0).stop 2023-08-25T04:18:29.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.302+0000 7f4965bfa640 1 -- 172.21.15.55:0/1124150222 shutdown_connections 2023-08-25T04:18:29.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.302+0000 7f4965bfa640 1 --2- 172.21.15.55:0/1124150222 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f49400657d0 0x7f4940067c90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.302+0000 7f4965bfa640 1 --2- 172.21.15.55:0/1124150222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49600d0da0 0x7f49600ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.302+0000 7f4965bfa640 1 --2- 172.21.15.55:0/1124150222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49600cdde0 0x7f49600c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.302+0000 7f4965bfa640 1 --2- 172.21.15.55:0/1124150222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f49600b3e50 0x7f4960151dd0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.302+0000 7f4965bfa640 1 -- 172.21.15.55:0/1124150222 >> 172.21.15.55:0/1124150222 conn(0x7f496009bae0 msgr2=0x7f49600cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:29.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.302+0000 7f4965bfa640 1 -- 172.21.15.55:0/1124150222 shutdown_connections 2023-08-25T04:18:29.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.302+0000 7f4965bfa640 1 -- 172.21.15.55:0/1124150222 wait complete. 2023-08-25T04:18:29.320 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:18:29.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.466+0000 7f927d848640 1 Processor -- start 2023-08-25T04:18:29.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.466+0000 7f927d848640 1 -- start start 2023-08-25T04:18:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.466+0000 7f927d848640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92780ceeb0 0x7f92780cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.466+0000 7f927d848640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92780cc880 con 0x7f92780c89f0 2023-08-25T04:18:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.466+0000 7f927d848640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92780ccb60 con 0x7f92780ad950 2023-08-25T04:18:29.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.466+0000 7f927d848640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92780b11f0 con 0x7f92780ceeb0 2023-08-25T04:18:29.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.466+0000 7f92777fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f92780c89f0 0x7f92780b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34480/0 (socket says 172.21.15.55:34480) 2023-08-25T04:18:29.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.466+0000 7f92777fe640 1 -- 172.21.15.55:0/1223495403 learned_addr learned my addr 172.21.15.55:0/1223495403 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:29.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.466+0000 7f926e7fc640 1 --2- 172.21.15.55:0/1223495403 >> v2:172.21.15.55:3300/0 conn(0x7f92780ceeb0 0x7f92780cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:29.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.466+0000 7f926e7fc640 1 -- 172.21.15.55:0/1223495403 >> v1:172.21.15.110:6789/0 conn(0x7f92780ad950 legacy=0x7f92780ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.466+0000 7f926e7fc640 1 -- 172.21.15.55:0/1223495403 >> v1:172.21.15.55:6789/0 conn(0x7f92780c89f0 legacy=0x7f92780b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.466+0000 7f926e7fc640 1 -- 172.21.15.55:0/1223495403 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92780cce40 con 0x7f92780ceeb0 2023-08-25T04:18:29.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.466+0000 7f92767fc640 1 -- 172.21.15.55:0/1223495403 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388289730 0 0) 0x7f92780ccb60 con 0x7f92780ad950 2023-08-25T04:18:29.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.470+0000 7f926e7fc640 1 --2- 172.21.15.55:0/1223495403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92780ceeb0 0x7f92780cc2a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f92680097c0 tx=0x7f926801c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f643910fc2dec6b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:29.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.470+0000 7f92767fc640 1 -- 172.21.15.55:0/1223495403 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92680ab600 con 0x7f92780ceeb0 2023-08-25T04:18:29.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.470+0000 7f92767fc640 1 -- 172.21.15.55:0/1223495403 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92680a7050 con 0x7f92780ceeb0 2023-08-25T04:18:29.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.470+0000 7f92767fc640 1 -- 172.21.15.55:0/1223495403 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92680ab980 con 0x7f92780ceeb0 2023-08-25T04:18:29.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.470+0000 7f927d848640 1 -- 172.21.15.55:0/1223495403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92780ceeb0 msgr2=0x7f92780cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.470+0000 7f927d848640 1 --2- 172.21.15.55:0/1223495403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92780ceeb0 0x7f92780cc2a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f92680097c0 tx=0x7f926801c280 comp rx=0 tx=0).stop 2023-08-25T04:18:29.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.470+0000 7f927d848640 1 -- 172.21.15.55:0/1223495403 shutdown_connections 2023-08-25T04:18:29.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.470+0000 7f927d848640 1 --2- 172.21.15.55:0/1223495403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92780ceeb0 0x7f92780cc2a0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.470+0000 7f927d848640 1 -- 172.21.15.55:0/1223495403 >> 172.21.15.55:0/1223495403 conn(0x7f9278069d00 msgr2=0x7f927806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:29.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.470+0000 7f927d848640 1 -- 172.21.15.55:0/1223495403 shutdown_connections 2023-08-25T04:18:29.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.470+0000 7f927d848640 1 -- 172.21.15.55:0/1223495403 wait complete. 2023-08-25T04:18:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f927d848640 1 Processor -- start 2023-08-25T04:18:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f927d848640 1 -- start start 2023-08-25T04:18:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f927d848640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92780ad950 0x7f92780c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f927d848640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92780c89f0 0x7f92780c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f927d848640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92780ceeb0 0x7f927815b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f927d848640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92780c2930 con 0x7f92780ceeb0 2023-08-25T04:18:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f927d848640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9278154630 con 0x7f92780ad950 2023-08-25T04:18:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f927d848640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92780c2bc0 con 0x7f92780c89f0 2023-08-25T04:18:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f92777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92780ceeb0 0x7f927815b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f92777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92780ceeb0 0x7f927815b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45916/0 (socket says 172.21.15.55:45916) 2023-08-25T04:18:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f92777fe640 1 -- 172.21.15.55:0/1453301787 learned_addr learned my addr 172.21.15.55:0/1453301787 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f9276ffd640 1 --2- 172.21.15.55:0/1453301787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92780ad950 0x7f92780c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f926e7fc640 1 --2- 172.21.15.55:0/1453301787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92780c89f0 0x7f92780c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f92777fe640 1 -- 172.21.15.55:0/1453301787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92780c89f0 msgr2=0x7f92780c23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f92777fe640 1 --2- 172.21.15.55:0/1453301787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92780c89f0 0x7f92780c23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f92777fe640 1 -- 172.21.15.55:0/1453301787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92780ad950 msgr2=0x7f92780c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f92777fe640 1 --2- 172.21.15.55:0/1453301787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92780ad950 0x7f92780c1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f92777fe640 1 -- 172.21.15.55:0/1453301787 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9268009420 con 0x7f92780ceeb0 2023-08-25T04:18:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f92777fe640 1 --2- 172.21.15.55:0/1453301787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92780ceeb0 0x7f927815b720 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f927000e530 tx=0x7f927000e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f9274ff9640 1 -- 172.21.15.55:0/1453301787 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270012810 con 0x7f92780ceeb0 2023-08-25T04:18:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f9274ff9640 1 -- 172.21.15.55:0/1453301787 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9270012970 con 0x7f92780ceeb0 2023-08-25T04:18:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f927d848640 1 -- 172.21.15.55:0/1453301787 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92780c2ea0 con 0x7f92780ceeb0 2023-08-25T04:18:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f9274ff9640 1 -- 172.21.15.55:0/1453301787 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270012d40 con 0x7f92780ceeb0 2023-08-25T04:18:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f927d848640 1 -- 172.21.15.55:0/1453301787 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92780c3460 con 0x7f92780ceeb0 2023-08-25T04:18:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.474+0000 7f927d848640 1 -- 172.21.15.55:0/1453301787 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927804dbe0 con 0x7f92780ceeb0 2023-08-25T04:18:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.478+0000 7f9274ff9640 1 -- 172.21.15.55:0/1453301787 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f9270009070 con 0x7f92780ceeb0 2023-08-25T04:18:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.478+0000 7f9274ff9640 1 --2- 172.21.15.55:0/1453301787 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f92580657a0 0x7f9258067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.478+0000 7f9274ff9640 1 -- 172.21.15.55:0/1453301787 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9270085cd0 con 0x7f92780ceeb0 2023-08-25T04:18:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.478+0000 7f9276ffd640 1 --2- 172.21.15.55:0/1453301787 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f92580657a0 0x7f9258067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.478+0000 7f9276ffd640 1 --2- 172.21.15.55:0/1453301787 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f92580657a0 0x7f9258067c60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9260007fd0 tx=0x7f9260009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.482+0000 7f9274ff9640 1 -- 172.21.15.55:0/1453301787 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f92700537a0 con 0x7f92780ceeb0 2023-08-25T04:18:29.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.642+0000 7f927d848640 1 -- 172.21.15.55:0/1453301787 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92780cddf0 con 0x7f92780ceeb0 2023-08-25T04:18:29.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.642+0000 7f9274ff9640 1 -- 172.21.15.55:0/1453301787 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18305 (secure 0 0 0) 0x7f9270016020 con 0x7f92780ceeb0 2023-08-25T04:18:29.643 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:29.644 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":79,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:18:26.617585+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:18:23.823729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-25T04:18:24.273419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:18:29.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.646+0000 7f927d848640 1 -- 172.21.15.55:0/1453301787 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f92580657a0 msgr2=0x7f9258067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.646+0000 7f927d848640 1 --2- 172.21.15.55:0/1453301787 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f92580657a0 0x7f9258067c60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9260007fd0 tx=0x7f9260009040 comp rx=0 tx=0).stop 2023-08-25T04:18:29.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.646+0000 7f927d848640 1 -- 172.21.15.55:0/1453301787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92780ceeb0 msgr2=0x7f927815b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.646+0000 7f927d848640 1 --2- 172.21.15.55:0/1453301787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92780ceeb0 0x7f927815b720 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f927000e530 tx=0x7f927000e9f0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.646+0000 7f927d848640 1 -- 172.21.15.55:0/1453301787 shutdown_connections 2023-08-25T04:18:29.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.646+0000 7f927d848640 1 --2- 172.21.15.55:0/1453301787 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f92580657a0 0x7f9258067c60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.646+0000 7f927d848640 1 --2- 172.21.15.55:0/1453301787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92780ceeb0 0x7f927815b720 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.646+0000 7f927d848640 1 --2- 172.21.15.55:0/1453301787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92780c89f0 0x7f92780c23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.646+0000 7f927d848640 1 --2- 172.21.15.55:0/1453301787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92780ad950 0x7f92780c1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.646+0000 7f927d848640 1 -- 172.21.15.55:0/1453301787 >> 172.21.15.55:0/1453301787 conn(0x7f9278069d00 msgr2=0x7f92780ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:29.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.646+0000 7f927d848640 1 -- 172.21.15.55:0/1453301787 shutdown_connections 2023-08-25T04:18:29.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.646+0000 7f927d848640 1 -- 172.21.15.55:0/1453301787 wait complete. 2023-08-25T04:18:29.664 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-25T04:18:29.665 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:18:29.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.810+0000 7f8f85359640 1 Processor -- start 2023-08-25T04:18:29.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.810+0000 7f8f85359640 1 -- start start 2023-08-25T04:18:29.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.810+0000 7f8f85359640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8f800ad950 0x7f8f800cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:29.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.810+0000 7f8f85359640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8f800c89f0 0x7f8f800ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:29.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.810+0000 7f8f85359640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f800b2650 con 0x7f8f8006c000 2023-08-25T04:18:29.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.810+0000 7f8f85359640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f800b11f0 con 0x7f8f800c89f0 2023-08-25T04:18:29.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.810+0000 7f8f85359640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f80159d50 con 0x7f8f800ad950 2023-08-25T04:18:29.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.810+0000 7f8f767fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8f800c89f0 0x7f8f800ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:29.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.810+0000 7f8f7f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8f8006c000 0x7f8f8015d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34496/0 (socket says 172.21.15.55:34496) 2023-08-25T04:18:29.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.810+0000 7f8f7f7fe640 1 -- 172.21.15.55:0/4198417349 learned_addr learned my addr 172.21.15.55:0/4198417349 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:29.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.810+0000 7f8f7effd640 1 --2- 172.21.15.55:0/4198417349 >> v2:172.21.15.110:3300/0 conn(0x7f8f800ad950 0x7f8f800cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:29.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.814+0000 7f8f767fc640 1 -- 172.21.15.55:0/4198417349 >> v2:172.21.15.110:3300/0 conn(0x7f8f800ad950 msgr2=0x7f8f800cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:29.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.814+0000 7f8f767fc640 1 --2- 172.21.15.55:0/4198417349 >> v2:172.21.15.110:3300/0 conn(0x7f8f800ad950 0x7f8f800cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.814+0000 7f8f767fc640 1 -- 172.21.15.55:0/4198417349 >> v1:172.21.15.55:6789/0 conn(0x7f8f8006c000 legacy=0x7f8f8015d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.814+0000 7f8f7e7fc640 1 -- 172.21.15.55:0/4198417349 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1580789026 0 0) 0x7f8f800b2650 con 0x7f8f8006c000 2023-08-25T04:18:29.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.814+0000 7f8f767fc640 1 -- 172.21.15.55:0/4198417349 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f800cc880 con 0x7f8f800c89f0 2023-08-25T04:18:29.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.814+0000 7f8f767fc640 1 --2- 172.21.15.55:0/4198417349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f800c89f0 0x7f8f800ce7a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8f800cd4b0 tx=0x7f8f7001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5fe71f46ff52f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:29.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.814+0000 7f8f7e7fc640 1 -- 172.21.15.55:0/4198417349 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f700ab600 con 0x7f8f800c89f0 2023-08-25T04:18:29.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.814+0000 7f8f7e7fc640 1 -- 172.21.15.55:0/4198417349 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f700a7050 con 0x7f8f800c89f0 2023-08-25T04:18:29.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.814+0000 7f8f7e7fc640 1 -- 172.21.15.55:0/4198417349 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f700ab980 con 0x7f8f800c89f0 2023-08-25T04:18:29.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.814+0000 7f8f85359640 1 -- 172.21.15.55:0/4198417349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f800c89f0 msgr2=0x7f8f800ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.814+0000 7f8f85359640 1 --2- 172.21.15.55:0/4198417349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f800c89f0 0x7f8f800ce7a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8f800cd4b0 tx=0x7f8f7001c3a0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.814+0000 7f8f85359640 1 -- 172.21.15.55:0/4198417349 shutdown_connections 2023-08-25T04:18:29.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.814+0000 7f8f85359640 1 --2- 172.21.15.55:0/4198417349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f800c89f0 0x7f8f800ce7a0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.814+0000 7f8f85359640 1 --2- 172.21.15.55:0/4198417349 >> v2:172.21.15.110:3300/0 conn(0x7f8f800ad950 0x7f8f800cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.814+0000 7f8f85359640 1 -- 172.21.15.55:0/4198417349 >> 172.21.15.55:0/4198417349 conn(0x7f8f80069d00 msgr2=0x7f8f8006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:29.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.814+0000 7f8f85359640 1 -- 172.21.15.55:0/4198417349 shutdown_connections 2023-08-25T04:18:29.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.814+0000 7f8f85359640 1 -- 172.21.15.55:0/4198417349 wait complete. 2023-08-25T04:18:29.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f85359640 1 Processor -- start 2023-08-25T04:18:29.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f85359640 1 -- start start 2023-08-25T04:18:29.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f85359640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f8006c000 0x7f8f80071510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:29.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f85359640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f800ad950 0x7f8f800ac580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:29.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f85359640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f800c89f0 0x7f8f80154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:29.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f85359640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f800ac0f0 con 0x7f8f800ad950 2023-08-25T04:18:29.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f85359640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f801557f0 con 0x7f8f8006c000 2023-08-25T04:18:29.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f85359640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f80155ad0 con 0x7f8f800c89f0 2023-08-25T04:18:29.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f767fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f800ad950 0x7f8f800ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:29.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f767fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f800ad950 0x7f8f800ac580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45934/0 (socket says 172.21.15.55:45934) 2023-08-25T04:18:29.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f767fc640 1 -- 172.21.15.55:0/1455867160 learned_addr learned my addr 172.21.15.55:0/1455867160 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:29.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f7effd640 1 --2- 172.21.15.55:0/1455867160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f8006c000 0x7f8f80071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:29.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f7f7fe640 1 --2- 172.21.15.55:0/1455867160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f800c89f0 0x7f8f80154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:29.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f767fc640 1 -- 172.21.15.55:0/1455867160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f800c89f0 msgr2=0x7f8f80154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f767fc640 1 --2- 172.21.15.55:0/1455867160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f800c89f0 0x7f8f80154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f767fc640 1 -- 172.21.15.55:0/1455867160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f8006c000 msgr2=0x7f8f80071510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f767fc640 1 --2- 172.21.15.55:0/1455867160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f8006c000 0x7f8f80071510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f767fc640 1 -- 172.21.15.55:0/1455867160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f70009420 con 0x7f8f800ad950 2023-08-25T04:18:29.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f7effd640 1 --2- 172.21.15.55:0/1455867160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f8006c000 0x7f8f80071510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:29.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f767fc640 1 --2- 172.21.15.55:0/1455867160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f800ad950 0x7f8f800ac580 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8f70018fb0 tx=0x7f8f70019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:29.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.818+0000 7f8f77fff640 1 -- 172.21.15.55:0/1455867160 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f700b4400 con 0x7f8f800ad950 2023-08-25T04:18:29.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.822+0000 7f8f77fff640 1 -- 172.21.15.55:0/1455867160 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f700b4560 con 0x7f8f800ad950 2023-08-25T04:18:29.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.822+0000 7f8f85359640 1 -- 172.21.15.55:0/1455867160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f800abaa0 con 0x7f8f800ad950 2023-08-25T04:18:29.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.822+0000 7f8f77fff640 1 -- 172.21.15.55:0/1455867160 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f700b48f0 con 0x7f8f800ad950 2023-08-25T04:18:29.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.822+0000 7f8f85359640 1 -- 172.21.15.55:0/1455867160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f800acac0 con 0x7f8f800ad950 2023-08-25T04:18:29.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.822+0000 7f8f85359640 1 -- 172.21.15.55:0/1455867160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f800ac2a0 con 0x7f8f800ad950 2023-08-25T04:18:29.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.822+0000 7f8f77fff640 1 -- 172.21.15.55:0/1455867160 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f8f700b2040 con 0x7f8f800ad950 2023-08-25T04:18:29.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.822+0000 7f8f77fff640 1 --2- 172.21.15.55:0/1455867160 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f8f600657a0 0x7f8f60067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:29.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.822+0000 7f8f77fff640 1 -- 172.21.15.55:0/1455867160 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8f7011ccd0 con 0x7f8f800ad950 2023-08-25T04:18:29.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.822+0000 7f8f7effd640 1 --2- 172.21.15.55:0/1455867160 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f8f600657a0 0x7f8f60067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:29.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.826+0000 7f8f7effd640 1 --2- 172.21.15.55:0/1455867160 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f8f600657a0 0x7f8f60067c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8f68009b10 tx=0x7f8f68008040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:29.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.826+0000 7f8f77fff640 1 -- 172.21.15.55:0/1455867160 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8f800ac2a0 con 0x7f8f800ad950 2023-08-25T04:18:29.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.982+0000 7f8f85359640 1 -- 172.21.15.55:0/1455867160 --> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8f800cd120 con 0x7f8f600657a0 2023-08-25T04:18:29.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.990+0000 7f8f77fff640 1 -- 172.21.15.55:0/1455867160 <== mgr.5720 v2:172.21.15.110:6832/2283645732 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299325 (secure 0 0 0) 0x7f8f68004030 con 0x7f8f600657a0 2023-08-25T04:18:29.994 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:29.995 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:18:29.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.994+0000 7f8f85359640 1 -- 172.21.15.55:0/1455867160 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f8f600657a0 msgr2=0x7f8f60067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.994+0000 7f8f85359640 1 --2- 172.21.15.55:0/1455867160 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f8f600657a0 0x7f8f60067c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8f68009b10 tx=0x7f8f68008040 comp rx=0 tx=0).stop 2023-08-25T04:18:29.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.994+0000 7f8f85359640 1 -- 172.21.15.55:0/1455867160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f800ad950 msgr2=0x7f8f800ac580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:29.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.994+0000 7f8f85359640 1 --2- 172.21.15.55:0/1455867160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f800ad950 0x7f8f800ac580 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8f70018fb0 tx=0x7f8f70019140 comp rx=0 tx=0).stop 2023-08-25T04:18:29.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.994+0000 7f8f85359640 1 -- 172.21.15.55:0/1455867160 shutdown_connections 2023-08-25T04:18:29.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.994+0000 7f8f85359640 1 --2- 172.21.15.55:0/1455867160 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f8f600657a0 0x7f8f60067c60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.994+0000 7f8f85359640 1 --2- 172.21.15.55:0/1455867160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f800c89f0 0x7f8f80154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.994+0000 7f8f85359640 1 --2- 172.21.15.55:0/1455867160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f800ad950 0x7f8f800ac580 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.994+0000 7f8f85359640 1 --2- 172.21.15.55:0/1455867160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f8006c000 0x7f8f80071510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:29.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.994+0000 7f8f85359640 1 -- 172.21.15.55:0/1455867160 >> 172.21.15.55:0/1455867160 conn(0x7f8f80069d00 msgr2=0x7f8f80157170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:29.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.994+0000 7f8f85359640 1 -- 172.21.15.55:0/1455867160 shutdown_connections 2023-08-25T04:18:29.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:29.994+0000 7f8f85359640 1 -- 172.21.15.55:0/1455867160 wait complete. 2023-08-25T04:18:30.015 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-25T04:18:28.545233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":327060,"kb_used_data":8228,"kb_used_omap":13,"kb_used_meta":318706,"kb_avail":754647660,"statfs":{"total":773094113280,"available":772759203840,"internally_reserved":0,"allocated":8425472,"data_stored":4708738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":326355032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.669786"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.882253+0000","last_change":"2023-08-25T04:18:23.882253+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.882253+0000","last_undegraded":"2023-08-25T04:18:23.882253+0000","last_fullsized":"2023-08-25T04:18:23.882253+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.885875+0000","last_change":"2023-08-25T04:18:23.885875+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.885875+0000","last_undegraded":"2023-08-25T04:18:23.885875+0000","last_fullsized":"2023-08-25T04:18:23.885875+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.885943+0000","last_change":"2023-08-25T04:18:23.885943+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.885943+0000","last_undegraded":"2023-08-25T04:18:23.885943+0000","last_fullsized":"2023-08-25T04:18:23.885943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.886271+0000","last_change":"2023-08-25T04:18:23.886271+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.886271+0000","last_undegraded":"2023-08-25T04:18:23.886271+0000","last_fullsized":"2023-08-25T04:18:23.886271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.883970+0000","last_change":"2023-08-25T04:18:23.883970+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.883970+0000","last_undegraded":"2023-08-25T04:18:23.883970+0000","last_fullsized":"2023-08-25T04:18:23.883970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.883870+0000","last_change":"2023-08-25T04:18:23.883870+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.883870+0000","last_undegraded":"2023-08-25T04:18:23.883870+0000","last_fullsized":"2023-08-25T04:18:23.883870+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.883808+0000","last_change":"2023-08-25T04:18:23.883808+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.883808+0000","last_undegraded":"2023-08-25T04:18:23.883808+0000","last_fullsized":"2023-08-25T04:18:23.883808+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.881230+0000","last_change":"2023-08-25T04:18:23.881230+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.881230+0000","last_undegraded":"2023-08-25T04:18:23.881230+0000","last_fullsized":"2023-08-25T04:18:23.881230+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.877576+0000","last_change":"2023-08-25T04:18:23.877576+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.877576+0000","last_undegraded":"2023-08-25T04:18:23.877576+0000","last_fullsized":"2023-08-25T04:18:23.877576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.879329+0000","last_change":"2023-08-25T04:18:23.879329+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.879329+0000","last_undegraded":"2023-08-25T04:18:23.879329+0000","last_fullsized":"2023-08-25T04:18:23.879329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.878371+0000","last_change":"2023-08-25T04:18:23.878371+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.878371+0000","last_undegraded":"2023-08-25T04:18:23.878371+0000","last_fullsized":"2023-08-25T04:18:23.878371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.882654+0000","last_change":"2023-08-25T04:18:23.882654+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.882654+0000","last_undegraded":"2023-08-25T04:18:23.882654+0000","last_fullsized":"2023-08-25T04:18:23.882654+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.878314+0000","last_change":"2023-08-25T04:18:23.878314+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.878314+0000","last_undegraded":"2023-08-25T04:18:23.878314+0000","last_fullsized":"2023-08-25T04:18:23.878314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.886608+0000","last_change":"2023-08-25T04:18:23.886608+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.886608+0000","last_undegraded":"2023-08-25T04:18:23.886608+0000","last_fullsized":"2023-08-25T04:18:23.886608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.877615+0000","last_change":"2023-08-25T04:18:23.877615+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.877615+0000","last_undegraded":"2023-08-25T04:18:23.877615+0000","last_fullsized":"2023-08-25T04:18:23.877615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.879532+0000","last_change":"2023-08-25T04:18:23.879532+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.879532+0000","last_undegraded":"2023-08-25T04:18:23.879532+0000","last_fullsized":"2023-08-25T04:18:23.879532+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.886005+0000","last_change":"2023-08-25T04:18:23.886005+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.886005+0000","last_undegraded":"2023-08-25T04:18:23.886005+0000","last_fullsized":"2023-08-25T04:18:23.886005+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.886031+0000","last_change":"2023-08-25T04:18:23.886031+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.886031+0000","last_undegraded":"2023-08-25T04:18:23.886031+0000","last_fullsized":"2023-08-25T04:18:23.886031+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.886382+0000","last_change":"2023-08-25T04:18:23.886382+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.886382+0000","last_undegraded":"2023-08-25T04:18:23.886382+0000","last_fullsized":"2023-08-25T04:18:23.886382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.882161+0000","last_change":"2023-08-25T04:18:23.882161+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.882161+0000","last_undegraded":"2023-08-25T04:18:23.882161+0000","last_fullsized":"2023-08-25T04:18:23.882161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.877554+0000","last_change":"2023-08-25T04:18:23.877554+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.877554+0000","last_undegraded":"2023-08-25T04:18:23.877554+0000","last_fullsized":"2023-08-25T04:18:23.877554+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.879714+0000","last_change":"2023-08-25T04:18:23.879714+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.879714+0000","last_undegraded":"2023-08-25T04:18:23.879714+0000","last_fullsized":"2023-08-25T04:18:23.879714+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.879698+0000","last_change":"2023-08-25T04:18:23.879698+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.879698+0000","last_undegraded":"2023-08-25T04:18:23.879698+0000","last_fullsized":"2023-08-25T04:18:23.879698+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.882111+0000","last_change":"2023-08-25T04:18:23.882111+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.882111+0000","last_undegraded":"2023-08-25T04:18:23.882111+0000","last_fullsized":"2023-08-25T04:18:23.882111+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.879658+0000","last_change":"2023-08-25T04:18:23.879658+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.879658+0000","last_undegraded":"2023-08-25T04:18:23.879658+0000","last_fullsized":"2023-08-25T04:18:23.879658+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"66'161","reported_seq":426,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-25T04:18:23.878936+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:18:23.878936+0000","last_peered":"2023-08-25T04:18:23.878936+0000","last_clean":"2023-08-25T04:18:23.878936+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:18:23.878936+0000","last_undegraded":"2023-08-25T04:18:23.878936+0000","last_fullsized":"2023-08-25T04:18:23.878936+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:38:38.170395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-25T04:18:23.887063+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:18:23.887063+0000","last_peered":"2023-08-25T04:18:23.887063+0000","last_clean":"2023-08-25T04:18:23.887063+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:18:23.887063+0000","last_undegraded":"2023-08-25T04:18:23.887063+0000","last_fullsized":"2023-08-25T04:18:23.887063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:42:41.939308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.885871+0000","last_change":"2023-08-25T04:18:23.885871+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.885871+0000","last_undegraded":"2023-08-25T04:18:23.885871+0000","last_fullsized":"2023-08-25T04:18:23.885871+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-25T04:18:23.878787+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:18:23.878787+0000","last_peered":"2023-08-25T04:18:23.878787+0000","last_clean":"2023-08-25T04:18:23.878787+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:18:23.878787+0000","last_undegraded":"2023-08-25T04:18:23.878787+0000","last_fullsized":"2023-08-25T04:18:23.878787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:00:34.152493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.885985+0000","last_change":"2023-08-25T04:18:23.885985+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.885985+0000","last_undegraded":"2023-08-25T04:18:23.885985+0000","last_fullsized":"2023-08-25T04:18:23.885985+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-25T04:18:23.886188+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:18:23.886188+0000","last_peered":"2023-08-25T04:18:23.886188+0000","last_clean":"2023-08-25T04:18:23.886188+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:18:23.886188+0000","last_undegraded":"2023-08-25T04:18:23.886188+0000","last_fullsized":"2023-08-25T04:18:23.886188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:03.460628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.885839+0000","last_change":"2023-08-25T04:18:23.885839+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.885839+0000","last_undegraded":"2023-08-25T04:18:23.885839+0000","last_fullsized":"2023-08-25T04:18:23.885839+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-25T04:18:23.887217+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:18:23.887217+0000","last_peered":"2023-08-25T04:18:23.887217+0000","last_clean":"2023-08-25T04:18:23.887217+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:18:23.887217+0000","last_undegraded":"2023-08-25T04:18:23.887217+0000","last_fullsized":"2023-08-25T04:18:23.887217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:09:23.380386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.886597+0000","last_change":"2023-08-25T04:18:23.886597+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.886597+0000","last_undegraded":"2023-08-25T04:18:23.886597+0000","last_fullsized":"2023-08-25T04:18:23.886597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":126,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-25T04:18:23.883130+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:18:23.883130+0000","last_peered":"2023-08-25T04:18:23.883130+0000","last_clean":"2023-08-25T04:18:23.883130+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:18:23.883130+0000","last_undegraded":"2023-08-25T04:18:23.883130+0000","last_fullsized":"2023-08-25T04:18:23.883130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:38:40.243238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.877677+0000","last_change":"2023-08-25T04:18:23.877677+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.877677+0000","last_undegraded":"2023-08-25T04:18:23.877677+0000","last_fullsized":"2023-08-25T04:18:23.877677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-25T04:18:23.879150+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:18:23.879150+0000","last_peered":"2023-08-25T04:18:23.879150+0000","last_clean":"2023-08-25T04:18:23.879150+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:18:23.879150+0000","last_undegraded":"2023-08-25T04:18:23.879150+0000","last_fullsized":"2023-08-25T04:18:23.879150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:10.870694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.877536+0000","last_change":"2023-08-25T04:18:23.877536+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.877536+0000","last_undegraded":"2023-08-25T04:18:23.877536+0000","last_fullsized":"2023-08-25T04:18:23.877536+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":126,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-25T04:18:23.883052+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:18:23.883052+0000","last_peered":"2023-08-25T04:18:23.883052+0000","last_clean":"2023-08-25T04:18:23.883052+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:18:23.883052+0000","last_undegraded":"2023-08-25T04:18:23.883052+0000","last_fullsized":"2023-08-25T04:18:23.883052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:28:26.304131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.879664+0000","last_change":"2023-08-25T04:18:23.879664+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.879664+0000","last_undegraded":"2023-08-25T04:18:23.879664+0000","last_fullsized":"2023-08-25T04:18:23.879664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-25T04:18:23.881995+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:18:23.881995+0000","last_peered":"2023-08-25T04:18:23.881995+0000","last_clean":"2023-08-25T04:18:23.881995+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:18:23.881995+0000","last_undegraded":"2023-08-25T04:18:23.881995+0000","last_fullsized":"2023-08-25T04:18:23.881995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:35:38.959458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509629,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63168,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308672,"statfs":{"total":96636764160,"available":96572080128,"internally_reserved":0,"allocated":1490944,"data_stored":1027512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":63174923},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.45200000000000001,"5min":0.39600000000000002,"15min":0.29199999999999998},"max":{"1min":0.88800000000000001,"5min":0.996,"15min":1.0189999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.67800000000000005}]},{"osd":1,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.42699999999999999},"max":{"1min":0.88,"5min":1.0149999999999999,"15min":1.034},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.47099999999999997,"5min":0.44700000000000001,"15min":0.374},"max":{"1min":0.89600000000000002,"5min":0.96099999999999997,"15min":1.036},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51700000000000002,"5min":0.42299999999999999,"15min":0.34899999999999998},"max":{"1min":0.94299999999999995,"5min":0.94499999999999995,"15min":1.018},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.54400000000000004,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":0.92300000000000004,"5min":0.98699999999999999,"15min":0.999},"last":0.62}]},{"osd":3,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.55000000000000004,"5min":0.47799999999999998,"15min":0.41899999999999998},"max":{"1min":0.90100000000000002,"5min":0.92900000000000005,"15min":0.98399999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.754,"15min":0.75600000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.432},"max":{"1min":1.012,"5min":1.04,"15min":1.0449999999999999},"last":0.65800000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41599999999999998,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.82599999999999996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.437},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":0.90400000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.46999999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60799999999999998,"15min":0.61899999999999999},"min":{"1min":0.46300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.96799999999999997,"5min":0.99199999999999999,"15min":0.998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.48699999999999999,"5min":0.41099999999999998,"15min":0.40000000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.0349999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.436},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.0620000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42399999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.69699999999999995}]}]},{"osd":6,"up_from":15,"seq":64424509629,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36228,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335612,"statfs":{"total":96636764160,"available":96599666688,"internally_reserved":0,"allocated":909312,"data_stored":443314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68600000000000005,"15min":0.70699999999999996},"min":{"1min":0.46300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97599999999999998,"5min":1.0089999999999999,"15min":1.0369999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68500000000000005,"15min":0.69799999999999995},"min":{"1min":0.46800000000000003,"5min":0.40400000000000003,"15min":0.33800000000000002},"max":{"1min":0.91900000000000004,"5min":0.96899999999999997,"15min":1.071},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.73099999999999998},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.1559999999999999},"last":0.751},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.59699999999999998,"5min":0.495,"15min":0.47199999999999998},"max":{"1min":0.93500000000000005,"5min":0.996,"15min":1.077},"last":0.72699999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.47999999999999998,"5min":0.44,"15min":0.434},"max":{"1min":0.95199999999999996,"5min":0.98399999999999999,"15min":1.139},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.56299999999999994,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96099999999999997,"5min":1.0569999999999999,"15min":1.117},"last":0.69899999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.50600000000000001,"15min":0.46899999999999997},"max":{"1min":0.93400000000000005,"5min":1.0600000000000001,"15min":1.077},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90900000000000003,"5min":1.075,"15min":1.679},"last":0.77300000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.60099999999999998},"min":{"1min":0.42999999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93000000000000005,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":0.86799999999999999,"5min":0.92900000000000005,"15min":1.306},"last":0.79000000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.56999999999999995,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":1.1120000000000001,"15min":1.5589999999999999},"last":0.80700000000000005}]},{"osd":7,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.65300000000000002,"15min":0.66600000000000004},"min":{"1min":0.51400000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86699999999999999,"5min":1.032,"15min":1.1950000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.48799999999999999,"5min":0.44700000000000001,"15min":0.41799999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.4099999999999999},"last":0.88200000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542332,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":897024,"data_stored":437144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68200000000000005,"15min":0.70999999999999996},"min":{"1min":0.55800000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88500000000000001,"5min":0.94999999999999996,"15min":1.018},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.57499999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86699999999999999,"5min":0.995,"15min":1.0409999999999999},"last":0.63400000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72299999999999998,"15min":0.73699999999999999},"min":{"1min":0.52100000000000002,"5min":0.43099999999999999,"15min":0.36499999999999999},"max":{"1min":0.878,"5min":0.98699999999999999,"15min":0.99399999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.56899999999999995,"5min":0.47599999999999998,"15min":0.46200000000000002},"max":{"1min":0.90400000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.71599999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.42999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88500000000000001,"5min":0.97499999999999998,"15min":1.0269999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.55300000000000005,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.2290000000000001},"last":0.80000000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.59199999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92100000000000004,"5min":0.94199999999999995,"15min":1.4590000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.76600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.018,"15min":1.1479999999999999},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.67000000000000004,"5min":0.97099999999999997,"15min":1.038},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.79600000000000004,"5min":1.018,"15min":1.018},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.48299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":1.256},"last":0.748},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.50800000000000001,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":0.90400000000000003,"5min":0.98299999999999998,"15min":1.4650000000000001},"last":0.72799999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61199999999999999,"15min":0.626},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.90900000000000003,"5min":1.002,"15min":1.2769999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69299999999999995,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":0.80000000000000004,"5min":0.96899999999999997,"15min":1.1819999999999999},"last":0.78100000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542332,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36228,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335612,"statfs":{"total":96636764160,"available":96599666688,"internally_reserved":0,"allocated":909312,"data_stored":443314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":0.70599999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.86599999999999999,"5min":0.99299999999999999,"15min":1.2649999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.45500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85199999999999998,"5min":0.878,"15min":1.1639999999999999},"last":0.63300000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.45400000000000001,"5min":0.45100000000000001,"15min":0.36199999999999999},"max":{"1min":0.98399999999999999,"5min":1.0189999999999999,"15min":1.0449999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.62}]},{"osd":2,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.47199999999999998,"15min":0.39100000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.74399999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.34000000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.65200000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.45100000000000001},"max":{"1min":0.91100000000000003,"5min":0.98299999999999998,"15min":1.048},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.76300000000000001,"15min":0.75900000000000001},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.48399999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38300000000000001,"5min":0.378,"15min":0.32200000000000001},"max":{"1min":0.77900000000000003,"5min":0.94799999999999995,"15min":0.94899999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.376,"15min":0.33200000000000002},"max":{"1min":0.81799999999999995,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.73699999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.92800000000000005,"5min":1.093,"15min":1.093},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.40300000000000002},"max":{"1min":0.871,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.48299999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.441,"5min":0.435,"15min":0.36699999999999999},"max":{"1min":0.78700000000000003,"5min":0.90100000000000002,"15min":1.0609999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69199999999999995,"15min":0.70399999999999996},"min":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.39300000000000002},"max":{"1min":0.92400000000000004,"5min":0.99399999999999999,"15min":1.0940000000000001},"last":0.66500000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542332,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36228,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335612,"statfs":{"total":96636764160,"available":96599666688,"internally_reserved":0,"allocated":909312,"data_stored":443314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.313,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.67200000000000004,"5min":0.93700000000000006,"15min":0.96899999999999997},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.70799999999999996,"5min":0.77100000000000002,"15min":0.91500000000000004},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.36599999999999999,"5min":0.32800000000000001,"15min":0.27000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.746},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.59499999999999997},"min":{"1min":0.41499999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80300000000000005,"5min":0.83099999999999996,"15min":0.92600000000000005},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":1.01},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.35299999999999998},"max":{"1min":0.72899999999999998,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.36099999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1719999999999999,"5min":1.214,"15min":1.4339999999999999},"last":0.625},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.64200000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98599999999999999,"5min":1.2450000000000001,"15min":1.343},"last":0.77400000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56899999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0549999999999999,"5min":1.254,"15min":1.321},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":1.0900000000000001,"5min":1.1950000000000001,"15min":1.4750000000000001},"last":0.67800000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81000000000000005,"15min":0.80700000000000005},"min":{"1min":0.55800000000000005,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":1.077,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.61699999999999999,"5min":0.51600000000000001,"15min":0.50700000000000001},"max":{"1min":0.99299999999999999,"5min":1.0800000000000001,"15min":1.3600000000000001},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.68100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.042,"5min":1.077,"15min":1.383},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80600000000000005,"15min":0.79900000000000004},"min":{"1min":0.66200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.016,"5min":1.079,"15min":1.4019999999999999},"last":0.69899999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542333,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54280,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317560,"statfs":{"total":96636764160,"available":96581181440,"internally_reserved":0,"allocated":909312,"data_stored":443314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.378,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.65100000000000002,"5min":0.85599999999999998,"15min":1.196},"last":0.309},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.504,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68700000000000006,"5min":0.81000000000000005,"15min":1.4019999999999999},"last":0.44500000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48599999999999999,"15min":0.48899999999999999},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.69999999999999996,"5min":0.78800000000000003,"15min":1.482},"last":0.379},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59599999999999997,"15min":0.60099999999999998},"min":{"1min":0.46100000000000002,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":1.458},"last":0.49099999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.34499999999999997},"max":{"1min":0.80300000000000005,"5min":0.82199999999999995,"15min":0.82299999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.40899999999999997,"5min":0.375,"15min":0.33700000000000002},"max":{"1min":0.751,"5min":0.85399999999999998,"15min":0.95599999999999996},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.80400000000000005,"15min":0.80100000000000005},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.499},"max":{"1min":0.98399999999999999,"5min":1.1990000000000001,"15min":1.2569999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.79000000000000004},"min":{"1min":0.51800000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0069999999999999,"5min":1.151,"15min":1.5509999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.80800000000000005,"15min":0.80400000000000005},"min":{"1min":0.63300000000000001,"5min":0.52600000000000002,"15min":0.47999999999999998},"max":{"1min":0.995,"5min":1.1140000000000001,"15min":1.2789999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.48299999999999998},"max":{"1min":1.02,"5min":1.2130000000000001,"15min":1.3089999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.93100000000000005,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85799999999999998,"15min":0.85699999999999998},"min":{"1min":0.68500000000000005,"5min":0.58799999999999997,"15min":0.55600000000000005},"max":{"1min":1.014,"5min":1.25,"15min":1.375},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81100000000000005,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":0.99199999999999999,"5min":1.2090000000000001,"15min":1.339},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81599999999999995,"15min":0.81299999999999994},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0149999999999999,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.627}]}]},{"osd":1,"up_from":14,"seq":60129542333,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36216,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335624,"statfs":{"total":96636764160,"available":96599678976,"internally_reserved":0,"allocated":897024,"data_stored":437144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.46300000000000002},"min":{"1min":0.27800000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66500000000000004,"5min":0.85599999999999998,"15min":1.218},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56299999999999994,"15min":0.52600000000000002},"min":{"1min":0.374,"5min":0.33200000000000002,"15min":0.29499999999999998},"max":{"1min":0.85099999999999998,"5min":1.212,"15min":1.212},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51500000000000001,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66300000000000003,"5min":0.876,"15min":1.347},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":1.093},"last":0.60099999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.41599999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.74099999999999999,"5min":0.93100000000000005,"15min":1.1459999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.34699999999999998,"5min":0.34599999999999997,"15min":0.33200000000000002},"max":{"1min":0.84299999999999997,"5min":1.165,"15min":1.2190000000000001},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":1.004,"5min":1.204,"15min":1.47},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.80300000000000005,"15min":0.81100000000000005},"min":{"1min":0.60399999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.0269999999999999,"5min":1.2529999999999999,"15min":1.395},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.45100000000000001},"max":{"1min":0.96499999999999997,"5min":1.254,"15min":1.292},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81299999999999994,"15min":0.81499999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51000000000000001},"max":{"1min":1.044,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.79900000000000004}]},{"osd":6,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.70099999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.171,"5min":1.623,"15min":1.623},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82199999999999995,"15min":0.80600000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.54200000000000004},"max":{"1min":1.01,"5min":1.288,"15min":1.355},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.57399999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0760000000000001,"5min":1.1240000000000001,"15min":1.5429999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.63400000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.073,"5min":1.1140000000000001,"15min":1.504},"last":0.85599999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542332,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1503232,"data_stored":1033682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.501,"15min":0.48899999999999999},"min":{"1min":0.30399999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67700000000000005,"5min":0.72499999999999998,"15min":0.79500000000000004},"last":0.63},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.68400000000000005,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70099999999999996,"5min":0.82299999999999995,"15min":0.97499999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55500000000000005,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":0.876,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.499}]},{"osd":3,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48899999999999999,"15min":0.499},"min":{"1min":0.36299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.266},"last":0.432},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.45600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76800000000000002,"5min":0.85099999999999998,"15min":1.2470000000000001},"last":0.59399999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.79900000000000004},"min":{"1min":0.60799999999999998,"5min":0.52600000000000002,"15min":0.503},"max":{"1min":1.048,"5min":1.1739999999999999,"15min":1.306},"last":0.747},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.58699999999999997,"5min":0.497,"15min":0.436},"max":{"1min":1.169,"5min":1.169,"15min":1.262},"last":0.84599999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81499999999999995,"15min":0.80500000000000005},"min":{"1min":0.57499999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.131,"5min":3.528,"15min":3.528},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.53000000000000003,"5min":0.47199999999999998,"15min":0.45500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.373},"last":0.69399999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81699999999999995,"15min":0.80600000000000005},"min":{"1min":0.60599999999999998,"5min":0.54400000000000004,"15min":0.53000000000000003},"max":{"1min":1.0680000000000001,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60999999999999999,"5min":0.52700000000000002,"15min":0.47399999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.331},"last":0.871}]},{"osd":7,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83799999999999997,"15min":0.84699999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.52900000000000003},"max":{"1min":1.151,"5min":1.151,"15min":1.4059999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.64600000000000002,"5min":0.53200000000000003,"15min":0.499},"max":{"1min":1.0940000000000001,"5min":1.1220000000000001,"15min":1.3169999999999999},"last":0.67800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:18:30.022 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:18:30.029 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:18:30.068 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:18:30.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.206+0000 7fd9cb234640 1 Processor -- start 2023-08-25T04:18:30.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.206+0000 7fd9cb234640 1 -- start start 2023-08-25T04:18:30.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.210+0000 7fd9cb234640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd9c40cfa70 0x7fd9c4160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.210+0000 7fd9cb234640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c406b2b0 0x7fd9c406b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.210+0000 7fd9cb234640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c406eaf0 con 0x7fd9c415c9c0 2023-08-25T04:18:30.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.210+0000 7fd9cb234640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c406e530 con 0x7fd9c40cfa70 2023-08-25T04:18:30.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.210+0000 7fd9cb234640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c406e810 con 0x7fd9c406b2b0 2023-08-25T04:18:30.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.210+0000 7fd9c8fd0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd9c415c9c0 0x7fd9c4160510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34506/0 (socket says 172.21.15.55:34506) 2023-08-25T04:18:30.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.210+0000 7fd9c8fd0640 1 -- 172.21.15.55:0/492518558 learned_addr learned my addr 172.21.15.55:0/492518558 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:30.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.210+0000 7fd9c3fff640 1 --2- 172.21.15.55:0/492518558 >> v2:172.21.15.110:3300/0 conn(0x7fd9c40cfa70 0x7fd9c4160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.210+0000 7fd9c97d1640 1 --2- 172.21.15.55:0/492518558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c406b2b0 0x7fd9c406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.210+0000 7fd9c37fe640 1 -- 172.21.15.55:0/492518558 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40981601 0 0) 0x7fd9c406eaf0 con 0x7fd9c415c9c0 2023-08-25T04:18:30.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.210+0000 7fd9c37fe640 1 -- 172.21.15.55:0/492518558 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9b4003530 con 0x7fd9c415c9c0 2023-08-25T04:18:30.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.210+0000 7fd9c3fff640 1 -- 172.21.15.55:0/492518558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c406b2b0 msgr2=0x7fd9c406b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:30.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.210+0000 7fd9c3fff640 1 --2- 172.21.15.55:0/492518558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c406b2b0 0x7fd9c406b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.210+0000 7fd9c3fff640 1 -- 172.21.15.55:0/492518558 >> v1:172.21.15.55:6789/0 conn(0x7fd9c415c9c0 legacy=0x7fd9c4160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:30.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.210+0000 7fd9c37fe640 1 -- 172.21.15.55:0/492518558 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1189694823 0 0) 0x7fd9b4003530 con 0x7fd9c415c9c0 2023-08-25T04:18:30.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.210+0000 7fd9c3fff640 1 -- 172.21.15.55:0/492518558 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c406aab0 con 0x7fd9c40cfa70 2023-08-25T04:18:30.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.214+0000 7fd9c3fff640 1 --2- 172.21.15.55:0/492518558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c40cfa70 0x7fd9c4160c20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00097c0 tx=0x7fd9b001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=799f908b4f18efd3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:30.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.214+0000 7fd9c37fe640 1 -- 172.21.15.55:0/492518558 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8001800 con 0x7fd9c40cfa70 2023-08-25T04:18:30.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.214+0000 7fd9c37fe640 1 -- 172.21.15.55:0/492518558 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b00a7050 con 0x7fd9c40cfa70 2023-08-25T04:18:30.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.214+0000 7fd9c37fe640 1 -- 172.21.15.55:0/492518558 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00ab620 con 0x7fd9c40cfa70 2023-08-25T04:18:30.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.214+0000 7fd9cb234640 1 -- 172.21.15.55:0/492518558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c40cfa70 msgr2=0x7fd9c4160c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:30.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.214+0000 7fd9cb234640 1 --2- 172.21.15.55:0/492518558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c40cfa70 0x7fd9c4160c20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00097c0 tx=0x7fd9b001c370 comp rx=0 tx=0).stop 2023-08-25T04:18:30.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.214+0000 7fd9cb234640 1 -- 172.21.15.55:0/492518558 shutdown_connections 2023-08-25T04:18:30.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.214+0000 7fd9cb234640 1 --2- 172.21.15.55:0/492518558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c406b2b0 0x7fd9c406b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.214+0000 7fd9cb234640 1 --2- 172.21.15.55:0/492518558 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c40cfa70 0x7fd9c4160c20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.214+0000 7fd9cb234640 1 -- 172.21.15.55:0/492518558 >> 172.21.15.55:0/492518558 conn(0x7fd9c40d05a0 msgr2=0x7fd9c40d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:30.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.214+0000 7fd9cb234640 1 -- 172.21.15.55:0/492518558 shutdown_connections 2023-08-25T04:18:30.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.214+0000 7fd9cb234640 1 -- 172.21.15.55:0/492518558 wait complete. 2023-08-25T04:18:30.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.214+0000 7fd9cb234640 1 Processor -- start 2023-08-25T04:18:30.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.214+0000 7fd9cb234640 1 -- start start 2023-08-25T04:18:30.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9cb234640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c406b2b0 0x7fd9c415a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9cb234640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c40cfa70 0x7fd9c41539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9cb234640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c415c9c0 0x7fd9c4153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9cb234640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c415c210 con 0x7fd9c40cfa70 2023-08-25T04:18:30.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9cb234640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c415a540 con 0x7fd9c415c9c0 2023-08-25T04:18:30.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9cb234640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c414e5d0 con 0x7fd9c406b2b0 2023-08-25T04:18:30.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c40cfa70 0x7fd9c41539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c40cfa70 0x7fd9c41539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45948/0 (socket says 172.21.15.55:45948) 2023-08-25T04:18:30.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9c3fff640 1 -- 172.21.15.55:0/367200877 learned_addr learned my addr 172.21.15.55:0/367200877 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:30.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9c8fd0640 1 --2- 172.21.15.55:0/367200877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c406b2b0 0x7fd9c415a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9c97d1640 1 --2- 172.21.15.55:0/367200877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c415c9c0 0x7fd9c4153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9c3fff640 1 -- 172.21.15.55:0/367200877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c406b2b0 msgr2=0x7fd9c415a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:30.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9c3fff640 1 --2- 172.21.15.55:0/367200877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c406b2b0 0x7fd9c415a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9c3fff640 1 -- 172.21.15.55:0/367200877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c415c9c0 msgr2=0x7fd9c4153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:30.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9c3fff640 1 --2- 172.21.15.55:0/367200877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c415c9c0 0x7fd9c4153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9c3fff640 1 -- 172.21.15.55:0/367200877 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b0009420 con 0x7fd9c40cfa70 2023-08-25T04:18:30.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9c8fd0640 1 --2- 172.21.15.55:0/367200877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c406b2b0 0x7fd9c415a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:30.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9c3fff640 1 --2- 172.21.15.55:0/367200877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c40cfa70 0x7fd9c41539b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd9b001aa20 tx=0x7fd9b001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:30.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9c17fa640 1 -- 172.21.15.55:0/367200877 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00b7450 con 0x7fd9c40cfa70 2023-08-25T04:18:30.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9c17fa640 1 -- 172.21.15.55:0/367200877 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b00b75d0 con 0x7fd9c40cfa70 2023-08-25T04:18:30.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9c17fa640 1 -- 172.21.15.55:0/367200877 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00b7980 con 0x7fd9c40cfa70 2023-08-25T04:18:30.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9cb234640 1 -- 172.21.15.55:0/367200877 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c4153520 con 0x7fd9c40cfa70 2023-08-25T04:18:30.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9cb234640 1 -- 172.21.15.55:0/367200877 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c40b5b70 con 0x7fd9c40cfa70 2023-08-25T04:18:30.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9cb234640 1 -- 172.21.15.55:0/367200877 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c41536b0 con 0x7fd9c40cfa70 2023-08-25T04:18:30.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.218+0000 7fd9c17fa640 1 -- 172.21.15.55:0/367200877 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fd9b00b7ae0 con 0x7fd9c40cfa70 2023-08-25T04:18:30.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.222+0000 7fd9c17fa640 1 --2- 172.21.15.55:0/367200877 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fd9a80657a0 0x7fd9a8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.222+0000 7fd9c17fa640 1 -- 172.21.15.55:0/367200877 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd9b011d7e0 con 0x7fd9c40cfa70 2023-08-25T04:18:30.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.222+0000 7fd9c8fd0640 1 --2- 172.21.15.55:0/367200877 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fd9a80657a0 0x7fd9a8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.222+0000 7fd9c8fd0640 1 --2- 172.21.15.55:0/367200877 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fd9a80657a0 0x7fd9a8067c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8000f00 tx=0x7fd9b8009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:30.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.226+0000 7fd9c17fa640 1 -- 172.21.15.55:0/367200877 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd9b00eb070 con 0x7fd9c40cfa70 2023-08-25T04:18:30.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.378+0000 7fd9cb234640 1 -- 172.21.15.55:0/367200877 --> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9c4161160 con 0x7fd9a80657a0 2023-08-25T04:18:30.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.386+0000 7fd9c17fa640 1 -- 172.21.15.55:0/367200877 <== mgr.5720 v2:172.21.15.110:6832/2283645732 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299325 (secure 0 0 0) 0x7fd9b80070d0 con 0x7fd9a80657a0 2023-08-25T04:18:30.387 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:30.389 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:18:30.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.390+0000 7fd9cb234640 1 -- 172.21.15.55:0/367200877 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fd9a80657a0 msgr2=0x7fd9a8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:30.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.390+0000 7fd9cb234640 1 --2- 172.21.15.55:0/367200877 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fd9a80657a0 0x7fd9a8067c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8000f00 tx=0x7fd9b8009040 comp rx=0 tx=0).stop 2023-08-25T04:18:30.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.390+0000 7fd9cb234640 1 -- 172.21.15.55:0/367200877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c40cfa70 msgr2=0x7fd9c41539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:30.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.390+0000 7fd9cb234640 1 --2- 172.21.15.55:0/367200877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c40cfa70 0x7fd9c41539b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd9b001aa20 tx=0x7fd9b001abb0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.390+0000 7fd9cb234640 1 -- 172.21.15.55:0/367200877 shutdown_connections 2023-08-25T04:18:30.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.390+0000 7fd9cb234640 1 --2- 172.21.15.55:0/367200877 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fd9a80657a0 0x7fd9a8067c60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.390+0000 7fd9cb234640 1 --2- 172.21.15.55:0/367200877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9c415c9c0 0x7fd9c4153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.390+0000 7fd9cb234640 1 --2- 172.21.15.55:0/367200877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9c40cfa70 0x7fd9c41539b0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.390+0000 7fd9cb234640 1 --2- 172.21.15.55:0/367200877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9c406b2b0 0x7fd9c415a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.390+0000 7fd9cb234640 1 -- 172.21.15.55:0/367200877 >> 172.21.15.55:0/367200877 conn(0x7fd9c40d05a0 msgr2=0x7fd9c40ad430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:30.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.390+0000 7fd9cb234640 1 -- 172.21.15.55:0/367200877 shutdown_connections 2023-08-25T04:18:30.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.390+0000 7fd9cb234640 1 -- 172.21.15.55:0/367200877 wait complete. 2023-08-25T04:18:30.408 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-25T04:18:28.545233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":327060,"kb_used_data":8228,"kb_used_omap":13,"kb_used_meta":318706,"kb_avail":754647660,"statfs":{"total":773094113280,"available":772759203840,"internally_reserved":0,"allocated":8425472,"data_stored":4708738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":326355032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.669786"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.882253+0000","last_change":"2023-08-25T04:18:23.882253+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.882253+0000","last_undegraded":"2023-08-25T04:18:23.882253+0000","last_fullsized":"2023-08-25T04:18:23.882253+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.885875+0000","last_change":"2023-08-25T04:18:23.885875+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.885875+0000","last_undegraded":"2023-08-25T04:18:23.885875+0000","last_fullsized":"2023-08-25T04:18:23.885875+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.885943+0000","last_change":"2023-08-25T04:18:23.885943+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.885943+0000","last_undegraded":"2023-08-25T04:18:23.885943+0000","last_fullsized":"2023-08-25T04:18:23.885943+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.886271+0000","last_change":"2023-08-25T04:18:23.886271+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.886271+0000","last_undegraded":"2023-08-25T04:18:23.886271+0000","last_fullsized":"2023-08-25T04:18:23.886271+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.883970+0000","last_change":"2023-08-25T04:18:23.883970+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.883970+0000","last_undegraded":"2023-08-25T04:18:23.883970+0000","last_fullsized":"2023-08-25T04:18:23.883970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.883870+0000","last_change":"2023-08-25T04:18:23.883870+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.883870+0000","last_undegraded":"2023-08-25T04:18:23.883870+0000","last_fullsized":"2023-08-25T04:18:23.883870+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.883808+0000","last_change":"2023-08-25T04:18:23.883808+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.883808+0000","last_undegraded":"2023-08-25T04:18:23.883808+0000","last_fullsized":"2023-08-25T04:18:23.883808+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.881230+0000","last_change":"2023-08-25T04:18:23.881230+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.881230+0000","last_undegraded":"2023-08-25T04:18:23.881230+0000","last_fullsized":"2023-08-25T04:18:23.881230+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.877576+0000","last_change":"2023-08-25T04:18:23.877576+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.877576+0000","last_undegraded":"2023-08-25T04:18:23.877576+0000","last_fullsized":"2023-08-25T04:18:23.877576+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.879329+0000","last_change":"2023-08-25T04:18:23.879329+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.879329+0000","last_undegraded":"2023-08-25T04:18:23.879329+0000","last_fullsized":"2023-08-25T04:18:23.879329+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.878371+0000","last_change":"2023-08-25T04:18:23.878371+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.878371+0000","last_undegraded":"2023-08-25T04:18:23.878371+0000","last_fullsized":"2023-08-25T04:18:23.878371+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.882654+0000","last_change":"2023-08-25T04:18:23.882654+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.882654+0000","last_undegraded":"2023-08-25T04:18:23.882654+0000","last_fullsized":"2023-08-25T04:18:23.882654+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.878314+0000","last_change":"2023-08-25T04:18:23.878314+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.878314+0000","last_undegraded":"2023-08-25T04:18:23.878314+0000","last_fullsized":"2023-08-25T04:18:23.878314+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.886608+0000","last_change":"2023-08-25T04:18:23.886608+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.886608+0000","last_undegraded":"2023-08-25T04:18:23.886608+0000","last_fullsized":"2023-08-25T04:18:23.886608+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.877615+0000","last_change":"2023-08-25T04:18:23.877615+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.877615+0000","last_undegraded":"2023-08-25T04:18:23.877615+0000","last_fullsized":"2023-08-25T04:18:23.877615+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.879532+0000","last_change":"2023-08-25T04:18:23.879532+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.879532+0000","last_undegraded":"2023-08-25T04:18:23.879532+0000","last_fullsized":"2023-08-25T04:18:23.879532+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.886005+0000","last_change":"2023-08-25T04:18:23.886005+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.886005+0000","last_undegraded":"2023-08-25T04:18:23.886005+0000","last_fullsized":"2023-08-25T04:18:23.886005+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.886031+0000","last_change":"2023-08-25T04:18:23.886031+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.886031+0000","last_undegraded":"2023-08-25T04:18:23.886031+0000","last_fullsized":"2023-08-25T04:18:23.886031+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.886382+0000","last_change":"2023-08-25T04:18:23.886382+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.886382+0000","last_undegraded":"2023-08-25T04:18:23.886382+0000","last_fullsized":"2023-08-25T04:18:23.886382+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.882161+0000","last_change":"2023-08-25T04:18:23.882161+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.882161+0000","last_undegraded":"2023-08-25T04:18:23.882161+0000","last_fullsized":"2023-08-25T04:18:23.882161+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.877554+0000","last_change":"2023-08-25T04:18:23.877554+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.877554+0000","last_undegraded":"2023-08-25T04:18:23.877554+0000","last_fullsized":"2023-08-25T04:18:23.877554+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.879714+0000","last_change":"2023-08-25T04:18:23.879714+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.879714+0000","last_undegraded":"2023-08-25T04:18:23.879714+0000","last_fullsized":"2023-08-25T04:18:23.879714+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.879698+0000","last_change":"2023-08-25T04:18:23.879698+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.879698+0000","last_undegraded":"2023-08-25T04:18:23.879698+0000","last_fullsized":"2023-08-25T04:18:23.879698+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.882111+0000","last_change":"2023-08-25T04:18:23.882111+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.882111+0000","last_undegraded":"2023-08-25T04:18:23.882111+0000","last_fullsized":"2023-08-25T04:18:23.882111+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.879658+0000","last_change":"2023-08-25T04:18:23.879658+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.879658+0000","last_undegraded":"2023-08-25T04:18:23.879658+0000","last_fullsized":"2023-08-25T04:18:23.879658+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"66'161","reported_seq":426,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-25T04:18:23.878936+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:18:23.878936+0000","last_peered":"2023-08-25T04:18:23.878936+0000","last_clean":"2023-08-25T04:18:23.878936+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:18:23.878936+0000","last_undegraded":"2023-08-25T04:18:23.878936+0000","last_fullsized":"2023-08-25T04:18:23.878936+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:38:38.170395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-25T04:18:23.887063+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:18:23.887063+0000","last_peered":"2023-08-25T04:18:23.887063+0000","last_clean":"2023-08-25T04:18:23.887063+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:18:23.887063+0000","last_undegraded":"2023-08-25T04:18:23.887063+0000","last_fullsized":"2023-08-25T04:18:23.887063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:42:41.939308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.885871+0000","last_change":"2023-08-25T04:18:23.885871+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.885871+0000","last_undegraded":"2023-08-25T04:18:23.885871+0000","last_fullsized":"2023-08-25T04:18:23.885871+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-25T04:18:23.878787+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:18:23.878787+0000","last_peered":"2023-08-25T04:18:23.878787+0000","last_clean":"2023-08-25T04:18:23.878787+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:18:23.878787+0000","last_undegraded":"2023-08-25T04:18:23.878787+0000","last_fullsized":"2023-08-25T04:18:23.878787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:00:34.152493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.885985+0000","last_change":"2023-08-25T04:18:23.885985+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.885985+0000","last_undegraded":"2023-08-25T04:18:23.885985+0000","last_fullsized":"2023-08-25T04:18:23.885985+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-25T04:18:23.886188+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:18:23.886188+0000","last_peered":"2023-08-25T04:18:23.886188+0000","last_clean":"2023-08-25T04:18:23.886188+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:18:23.886188+0000","last_undegraded":"2023-08-25T04:18:23.886188+0000","last_fullsized":"2023-08-25T04:18:23.886188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:03.460628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.885839+0000","last_change":"2023-08-25T04:18:23.885839+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.885839+0000","last_undegraded":"2023-08-25T04:18:23.885839+0000","last_fullsized":"2023-08-25T04:18:23.885839+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":112,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-25T04:18:23.887217+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:18:23.887217+0000","last_peered":"2023-08-25T04:18:23.887217+0000","last_clean":"2023-08-25T04:18:23.887217+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:18:23.887217+0000","last_undegraded":"2023-08-25T04:18:23.887217+0000","last_fullsized":"2023-08-25T04:18:23.887217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:09:23.380386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.886597+0000","last_change":"2023-08-25T04:18:23.886597+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.886597+0000","last_undegraded":"2023-08-25T04:18:23.886597+0000","last_fullsized":"2023-08-25T04:18:23.886597+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":126,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-25T04:18:23.883130+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:18:23.883130+0000","last_peered":"2023-08-25T04:18:23.883130+0000","last_clean":"2023-08-25T04:18:23.883130+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:18:23.883130+0000","last_undegraded":"2023-08-25T04:18:23.883130+0000","last_fullsized":"2023-08-25T04:18:23.883130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:38:40.243238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.877677+0000","last_change":"2023-08-25T04:18:23.877677+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.877677+0000","last_undegraded":"2023-08-25T04:18:23.877677+0000","last_fullsized":"2023-08-25T04:18:23.877677+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":114,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-25T04:18:23.879150+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:18:23.879150+0000","last_peered":"2023-08-25T04:18:23.879150+0000","last_clean":"2023-08-25T04:18:23.879150+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:18:23.879150+0000","last_undegraded":"2023-08-25T04:18:23.879150+0000","last_fullsized":"2023-08-25T04:18:23.879150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:10.870694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.877536+0000","last_change":"2023-08-25T04:18:23.877536+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.877536+0000","last_undegraded":"2023-08-25T04:18:23.877536+0000","last_fullsized":"2023-08-25T04:18:23.877536+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":126,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-25T04:18:23.883052+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:18:23.883052+0000","last_peered":"2023-08-25T04:18:23.883052+0000","last_clean":"2023-08-25T04:18:23.883052+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:18:23.883052+0000","last_undegraded":"2023-08-25T04:18:23.883052+0000","last_fullsized":"2023-08-25T04:18:23.883052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:28:26.304131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:18:24.877156+0000","last_change":"2023-08-25T04:18:24.877156+0000","last_active":"2023-08-25T04:18:24.877156+0000","last_peered":"2023-08-25T04:18:24.877156+0000","last_clean":"2023-08-25T04:18:24.877156+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:24.877156+0000","last_undegraded":"2023-08-25T04:18:24.877156+0000","last_fullsized":"2023-08-25T04:18:24.877156+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":76,"state":"creating+peering","last_fresh":"2023-08-25T04:18:23.879664+0000","last_change":"2023-08-25T04:18:23.879664+0000","last_active":"2023-08-25T04:18:23.873908+0000","last_peered":"2023-08-25T04:18:23.873908+0000","last_clean":"2023-08-25T04:18:23.873908+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:18:23.879664+0000","last_undegraded":"2023-08-25T04:18:23.879664+0000","last_fullsized":"2023-08-25T04:18:23.879664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":124,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-08-25T04:18:23.881995+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:18:23.881995+0000","last_peered":"2023-08-25T04:18:23.881995+0000","last_clean":"2023-08-25T04:18:23.881995+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:18:23.881995+0000","last_undegraded":"2023-08-25T04:18:23.881995+0000","last_fullsized":"2023-08-25T04:18:23.881995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:35:38.959458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509629,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63168,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308672,"statfs":{"total":96636764160,"available":96572080128,"internally_reserved":0,"allocated":1490944,"data_stored":1027512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":63174923},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.45200000000000001,"5min":0.39600000000000002,"15min":0.29199999999999998},"max":{"1min":0.88800000000000001,"5min":0.996,"15min":1.0189999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.67800000000000005}]},{"osd":1,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.42699999999999999},"max":{"1min":0.88,"5min":1.0149999999999999,"15min":1.034},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.47099999999999997,"5min":0.44700000000000001,"15min":0.374},"max":{"1min":0.89600000000000002,"5min":0.96099999999999997,"15min":1.036},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51700000000000002,"5min":0.42299999999999999,"15min":0.34899999999999998},"max":{"1min":0.94299999999999995,"5min":0.94499999999999995,"15min":1.018},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.54400000000000004,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":0.92300000000000004,"5min":0.98699999999999999,"15min":0.999},"last":0.62}]},{"osd":3,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.55000000000000004,"5min":0.47799999999999998,"15min":0.41899999999999998},"max":{"1min":0.90100000000000002,"5min":0.92900000000000005,"15min":0.98399999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.754,"15min":0.75600000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.432},"max":{"1min":1.012,"5min":1.04,"15min":1.0449999999999999},"last":0.65800000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41599999999999998,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.82599999999999996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.437},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":0.90400000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.46999999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60799999999999998,"15min":0.61899999999999999},"min":{"1min":0.46300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.96799999999999997,"5min":0.99199999999999999,"15min":0.998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.48699999999999999,"5min":0.41099999999999998,"15min":0.40000000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.0349999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.436},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.0620000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42399999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.69699999999999995}]}]},{"osd":6,"up_from":15,"seq":64424509629,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36228,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335612,"statfs":{"total":96636764160,"available":96599666688,"internally_reserved":0,"allocated":909312,"data_stored":443314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68600000000000005,"15min":0.70699999999999996},"min":{"1min":0.46300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97599999999999998,"5min":1.0089999999999999,"15min":1.0369999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68500000000000005,"15min":0.69799999999999995},"min":{"1min":0.46800000000000003,"5min":0.40400000000000003,"15min":0.33800000000000002},"max":{"1min":0.91900000000000004,"5min":0.96899999999999997,"15min":1.071},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.73099999999999998},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.1559999999999999},"last":0.751},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.59699999999999998,"5min":0.495,"15min":0.47199999999999998},"max":{"1min":0.93500000000000005,"5min":0.996,"15min":1.077},"last":0.72699999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.47999999999999998,"5min":0.44,"15min":0.434},"max":{"1min":0.95199999999999996,"5min":0.98399999999999999,"15min":1.139},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.56299999999999994,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96099999999999997,"5min":1.0569999999999999,"15min":1.117},"last":0.69899999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.50600000000000001,"15min":0.46899999999999997},"max":{"1min":0.93400000000000005,"5min":1.0600000000000001,"15min":1.077},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90900000000000003,"5min":1.075,"15min":1.679},"last":0.77300000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.60099999999999998},"min":{"1min":0.42999999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93000000000000005,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":0.86799999999999999,"5min":0.92900000000000005,"15min":1.306},"last":0.79000000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.56999999999999995,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":1.1120000000000001,"15min":1.5589999999999999},"last":0.80700000000000005}]},{"osd":7,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.65300000000000002,"15min":0.66600000000000004},"min":{"1min":0.51400000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86699999999999999,"5min":1.032,"15min":1.1950000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.48799999999999999,"5min":0.44700000000000001,"15min":0.41799999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.4099999999999999},"last":0.88200000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542332,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":897024,"data_stored":437144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68200000000000005,"15min":0.70999999999999996},"min":{"1min":0.55800000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88500000000000001,"5min":0.94999999999999996,"15min":1.018},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.57499999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86699999999999999,"5min":0.995,"15min":1.0409999999999999},"last":0.63400000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72299999999999998,"15min":0.73699999999999999},"min":{"1min":0.52100000000000002,"5min":0.43099999999999999,"15min":0.36499999999999999},"max":{"1min":0.878,"5min":0.98699999999999999,"15min":0.99399999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.56899999999999995,"5min":0.47599999999999998,"15min":0.46200000000000002},"max":{"1min":0.90400000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.71599999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.42999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88500000000000001,"5min":0.97499999999999998,"15min":1.0269999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.55300000000000005,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.2290000000000001},"last":0.80000000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.59199999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92100000000000004,"5min":0.94199999999999995,"15min":1.4590000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.76600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.018,"15min":1.1479999999999999},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.67000000000000004,"5min":0.97099999999999997,"15min":1.038},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.79600000000000004,"5min":1.018,"15min":1.018},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.48299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":1.256},"last":0.748},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.50800000000000001,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":0.90400000000000003,"5min":0.98299999999999998,"15min":1.4650000000000001},"last":0.72799999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61199999999999999,"15min":0.626},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.90900000000000003,"5min":1.002,"15min":1.2769999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69299999999999995,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":0.80000000000000004,"5min":0.96899999999999997,"15min":1.1819999999999999},"last":0.78100000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542332,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36228,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335612,"statfs":{"total":96636764160,"available":96599666688,"internally_reserved":0,"allocated":909312,"data_stored":443314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":0.70599999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.86599999999999999,"5min":0.99299999999999999,"15min":1.2649999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.45500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85199999999999998,"5min":0.878,"15min":1.1639999999999999},"last":0.63300000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.45400000000000001,"5min":0.45100000000000001,"15min":0.36199999999999999},"max":{"1min":0.98399999999999999,"5min":1.0189999999999999,"15min":1.0449999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.62}]},{"osd":2,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.47199999999999998,"15min":0.39100000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.74399999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.34000000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.65200000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.45100000000000001},"max":{"1min":0.91100000000000003,"5min":0.98299999999999998,"15min":1.048},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.76300000000000001,"15min":0.75900000000000001},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.48399999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38300000000000001,"5min":0.378,"15min":0.32200000000000001},"max":{"1min":0.77900000000000003,"5min":0.94799999999999995,"15min":0.94899999999999995},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.376,"15min":0.33200000000000002},"max":{"1min":0.81799999999999995,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.73699999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.92800000000000005,"5min":1.093,"15min":1.093},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.40300000000000002},"max":{"1min":0.871,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.48299999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.441,"5min":0.435,"15min":0.36699999999999999},"max":{"1min":0.78700000000000003,"5min":0.90100000000000002,"15min":1.0609999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69199999999999995,"15min":0.70399999999999996},"min":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.39300000000000002},"max":{"1min":0.92400000000000004,"5min":0.99399999999999999,"15min":1.0940000000000001},"last":0.66500000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542332,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36228,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335612,"statfs":{"total":96636764160,"available":96599666688,"internally_reserved":0,"allocated":909312,"data_stored":443314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.313,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.67200000000000004,"5min":0.93700000000000006,"15min":0.96899999999999997},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.70799999999999996,"5min":0.77100000000000002,"15min":0.91500000000000004},"last":0.45400000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.36599999999999999,"5min":0.32800000000000001,"15min":0.27000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.746},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.59499999999999997},"min":{"1min":0.41499999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80300000000000005,"5min":0.83099999999999996,"15min":0.92600000000000005},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":1.01},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.35299999999999998},"max":{"1min":0.72899999999999998,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.36099999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1719999999999999,"5min":1.214,"15min":1.4339999999999999},"last":0.625},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.64200000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98599999999999999,"5min":1.2450000000000001,"15min":1.343},"last":0.77400000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56899999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0549999999999999,"5min":1.254,"15min":1.321},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":1.0900000000000001,"5min":1.1950000000000001,"15min":1.4750000000000001},"last":0.67800000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81000000000000005,"15min":0.80700000000000005},"min":{"1min":0.55800000000000005,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":1.077,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.61699999999999999,"5min":0.51600000000000001,"15min":0.50700000000000001},"max":{"1min":0.99299999999999999,"5min":1.0800000000000001,"15min":1.3600000000000001},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.68100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.042,"5min":1.077,"15min":1.383},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80600000000000005,"15min":0.79900000000000004},"min":{"1min":0.66200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.016,"5min":1.079,"15min":1.4019999999999999},"last":0.69899999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542333,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54280,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317560,"statfs":{"total":96636764160,"available":96581181440,"internally_reserved":0,"allocated":909312,"data_stored":443314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.378,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.65100000000000002,"5min":0.85599999999999998,"15min":1.196},"last":0.309},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.504,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68700000000000006,"5min":0.81000000000000005,"15min":1.4019999999999999},"last":0.44500000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48599999999999999,"15min":0.48899999999999999},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.69999999999999996,"5min":0.78800000000000003,"15min":1.482},"last":0.379},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59599999999999997,"15min":0.60099999999999998},"min":{"1min":0.46100000000000002,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":1.458},"last":0.49099999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.34499999999999997},"max":{"1min":0.80300000000000005,"5min":0.82199999999999995,"15min":0.82299999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.40899999999999997,"5min":0.375,"15min":0.33700000000000002},"max":{"1min":0.751,"5min":0.85399999999999998,"15min":0.95599999999999996},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.80400000000000005,"15min":0.80100000000000005},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.499},"max":{"1min":0.98399999999999999,"5min":1.1990000000000001,"15min":1.2569999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.79000000000000004},"min":{"1min":0.51800000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0069999999999999,"5min":1.151,"15min":1.5509999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.80800000000000005,"15min":0.80400000000000005},"min":{"1min":0.63300000000000001,"5min":0.52600000000000002,"15min":0.47999999999999998},"max":{"1min":0.995,"5min":1.1140000000000001,"15min":1.2789999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.48299999999999998},"max":{"1min":1.02,"5min":1.2130000000000001,"15min":1.3089999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.93100000000000005,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85799999999999998,"15min":0.85699999999999998},"min":{"1min":0.68500000000000005,"5min":0.58799999999999997,"15min":0.55600000000000005},"max":{"1min":1.014,"5min":1.25,"15min":1.375},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81100000000000005,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":0.99199999999999999,"5min":1.2090000000000001,"15min":1.339},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81599999999999995,"15min":0.81299999999999994},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0149999999999999,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.627}]}]},{"osd":1,"up_from":14,"seq":60129542333,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36216,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335624,"statfs":{"total":96636764160,"available":96599678976,"internally_reserved":0,"allocated":897024,"data_stored":437144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.46300000000000002},"min":{"1min":0.27800000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66500000000000004,"5min":0.85599999999999998,"15min":1.218},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56299999999999994,"15min":0.52600000000000002},"min":{"1min":0.374,"5min":0.33200000000000002,"15min":0.29499999999999998},"max":{"1min":0.85099999999999998,"5min":1.212,"15min":1.212},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51500000000000001,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66300000000000003,"5min":0.876,"15min":1.347},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":1.093},"last":0.60099999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.41599999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.74099999999999999,"5min":0.93100000000000005,"15min":1.1459999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.34699999999999998,"5min":0.34599999999999997,"15min":0.33200000000000002},"max":{"1min":0.84299999999999997,"5min":1.165,"15min":1.2190000000000001},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":1.004,"5min":1.204,"15min":1.47},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.80300000000000005,"15min":0.81100000000000005},"min":{"1min":0.60399999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.0269999999999999,"5min":1.2529999999999999,"15min":1.395},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.45100000000000001},"max":{"1min":0.96499999999999997,"5min":1.254,"15min":1.292},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81299999999999994,"15min":0.81499999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51000000000000001},"max":{"1min":1.044,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.79900000000000004}]},{"osd":6,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.70099999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.171,"5min":1.623,"15min":1.623},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82199999999999995,"15min":0.80600000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.54200000000000004},"max":{"1min":1.01,"5min":1.288,"15min":1.355},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.57399999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0760000000000001,"5min":1.1240000000000001,"15min":1.5429999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.63400000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.073,"5min":1.1140000000000001,"15min":1.504},"last":0.85599999999999998}]}]},{"osd":0,"up_from":14,"seq":60129542332,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1503232,"data_stored":1033682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.501,"15min":0.48899999999999999},"min":{"1min":0.30399999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67700000000000005,"5min":0.72499999999999998,"15min":0.79500000000000004},"last":0.63},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.68400000000000005,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70099999999999996,"5min":0.82299999999999995,"15min":0.97499999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55500000000000005,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":0.876,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.499}]},{"osd":3,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48899999999999999,"15min":0.499},"min":{"1min":0.36299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.266},"last":0.432},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.45600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76800000000000002,"5min":0.85099999999999998,"15min":1.2470000000000001},"last":0.59399999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.79900000000000004},"min":{"1min":0.60799999999999998,"5min":0.52600000000000002,"15min":0.503},"max":{"1min":1.048,"5min":1.1739999999999999,"15min":1.306},"last":0.747},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.58699999999999997,"5min":0.497,"15min":0.436},"max":{"1min":1.169,"5min":1.169,"15min":1.262},"last":0.84599999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81499999999999995,"15min":0.80500000000000005},"min":{"1min":0.57499999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.131,"5min":3.528,"15min":3.528},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.53000000000000003,"5min":0.47199999999999998,"15min":0.45500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.373},"last":0.69399999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81699999999999995,"15min":0.80600000000000005},"min":{"1min":0.60599999999999998,"5min":0.54400000000000004,"15min":0.53000000000000003},"max":{"1min":1.0680000000000001,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60999999999999999,"5min":0.52700000000000002,"15min":0.47399999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.331},"last":0.871}]},{"osd":7,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83799999999999997,"15min":0.84699999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.52900000000000003},"max":{"1min":1.151,"5min":1.151,"15min":1.4059999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.64600000000000002,"5min":0.53200000000000003,"15min":0.499},"max":{"1min":1.0940000000000001,"5min":1.1220000000000001,"15min":1.3169999999999999},"last":0.67800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:18:30.415 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:18:30.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.594+0000 7fd5035e1640 1 Processor -- start 2023-08-25T04:18:30.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.594+0000 7fd5035e1640 1 -- start start 2023-08-25T04:18:30.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd5035e1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd4fc15c9c0 0x7fd4fc160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd5035e1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4fc06eaf0 con 0x7fd4fc06b2b0 2023-08-25T04:18:30.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd5035e1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4fc06e530 con 0x7fd4fc0cfa70 2023-08-25T04:18:30.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd5035e1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4fc06e810 con 0x7fd4fc15c9c0 2023-08-25T04:18:30.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd501b7e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd4fc06b2b0 0x7fd4fc06b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44488/0 (socket says 172.21.15.55:44488) 2023-08-25T04:18:30.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd501b7e640 1 -- 172.21.15.55:0/1784668810 learned_addr learned my addr 172.21.15.55:0/1784668810 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:30.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd4f3fff640 1 -- 172.21.15.55:0/1784668810 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667540433 0 0) 0x7fd4fc06eaf0 con 0x7fd4fc06b2b0 2023-08-25T04:18:30.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd50137d640 1 --2- 172.21.15.55:0/1784668810 >> v2:172.21.15.110:3300/0 conn(0x7fd4fc15c9c0 0x7fd4fc160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd4f3fff640 1 -- 172.21.15.55:0/1784668810 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4e8003530 con 0x7fd4fc06b2b0 2023-08-25T04:18:30.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd4f3fff640 1 -- 172.21.15.55:0/1784668810 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2987442780 0 0) 0x7fd4e8003530 con 0x7fd4fc06b2b0 2023-08-25T04:18:30.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd4f3fff640 1 -- 172.21.15.55:0/1784668810 >> v2:172.21.15.110:3300/0 conn(0x7fd4fc15c9c0 msgr2=0x7fd4fc160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:30.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd4f3fff640 1 --2- 172.21.15.55:0/1784668810 >> v2:172.21.15.110:3300/0 conn(0x7fd4fc15c9c0 0x7fd4fc160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd4f3fff640 1 -- 172.21.15.55:0/1784668810 >> v1:172.21.15.110:6789/0 conn(0x7fd4fc0cfa70 legacy=0x7fd4fc160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:30.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd4f3fff640 1 -- 172.21.15.55:0/1784668810 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc06aab0 con 0x7fd4fc06b2b0 2023-08-25T04:18:30.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd4f3fff640 1 -- 172.21.15.55:0/1784668810 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fd4f4001a00 con 0x7fd4fc06b2b0 2023-08-25T04:18:30.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd4f3fff640 1 -- 172.21.15.55:0/1784668810 >> v1:172.21.15.55:6789/0 conn(0x7fd4fc06b2b0 legacy=0x7fd4fc06b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:30.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd4f3fff640 1 --2- 172.21.15.55:0/1784668810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4e8003980 0x7fd4e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd4f3fff640 1 --2- 172.21.15.55:0/1784668810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4e80047d0 0x7fd4e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd4f3fff640 1 --2- 172.21.15.55:0/1784668810 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e8005190 0x7fd4e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd4f3fff640 1 -- 172.21.15.55:0/1784668810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc06e810 con 0x7fd4e8003980 2023-08-25T04:18:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd4f3fff640 1 -- 172.21.15.55:0/1784668810 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e800c030 con 0x7fd4e80047d0 2023-08-25T04:18:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd4f3fff640 1 -- 172.21.15.55:0/1784668810 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e800c1f0 con 0x7fd4e8005190 2023-08-25T04:18:30.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd50137d640 1 --2- 172.21.15.55:0/1784668810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4e8003980 0x7fd4e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd500b7c640 1 --2- 172.21.15.55:0/1784668810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4e80047d0 0x7fd4e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd501b7e640 1 --2- 172.21.15.55:0/1784668810 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e8005190 0x7fd4e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd50137d640 1 -- 172.21.15.55:0/1784668810 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e8005190 msgr2=0x7fd4e800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:30.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd50137d640 1 --2- 172.21.15.55:0/1784668810 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e8005190 0x7fd4e800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd50137d640 1 -- 172.21.15.55:0/1784668810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4e80047d0 msgr2=0x7fd4e8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:30.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd50137d640 1 --2- 172.21.15.55:0/1784668810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4e80047d0 0x7fd4e8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd50137d640 1 -- 172.21.15.55:0/1784668810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e8003530 con 0x7fd4e8003980 2023-08-25T04:18:30.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd500b7c640 1 --2- 172.21.15.55:0/1784668810 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4e80047d0 0x7fd4e8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:30.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.598+0000 7fd501b7e640 1 -- 172.21.15.55:0/1784668810 reap_dead start 2023-08-25T04:18:30.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.602+0000 7fd50137d640 1 --2- 172.21.15.55:0/1784668810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4e8003980 0x7fd4e8003da0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009ac0 tx=0x7fd4f801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9012d6c3495a7e57 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:30.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.602+0000 7fd4f3fff640 1 -- 172.21.15.55:0/1784668810 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80059a0 con 0x7fd4e8003980 2023-08-25T04:18:30.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.602+0000 7fd4f3fff640 1 -- 172.21.15.55:0/1784668810 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f8005b00 con 0x7fd4e8003980 2023-08-25T04:18:30.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.602+0000 7fd4f3fff640 1 -- 172.21.15.55:0/1784668810 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80a56a0 con 0x7fd4e8003980 2023-08-25T04:18:30.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.602+0000 7fd5035e1640 1 -- 172.21.15.55:0/1784668810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4e8003980 msgr2=0x7fd4e8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:30.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.602+0000 7fd5035e1640 1 --2- 172.21.15.55:0/1784668810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4e8003980 0x7fd4e8003da0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009ac0 tx=0x7fd4f801ca20 comp rx=0 tx=0).stop 2023-08-25T04:18:30.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.602+0000 7fd5035e1640 1 -- 172.21.15.55:0/1784668810 shutdown_connections 2023-08-25T04:18:30.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.602+0000 7fd5035e1640 1 --2- 172.21.15.55:0/1784668810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4e8003980 0x7fd4e8003da0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.602+0000 7fd5035e1640 1 -- 172.21.15.55:0/1784668810 >> 172.21.15.55:0/1784668810 conn(0x7fd4fc0d05a0 msgr2=0x7fd4fc0d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:30.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.602+0000 7fd5035e1640 1 -- 172.21.15.55:0/1784668810 shutdown_connections 2023-08-25T04:18:30.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.602+0000 7fd5035e1640 1 -- 172.21.15.55:0/1784668810 wait complete. 2023-08-25T04:18:30.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.602+0000 7fd5035e1640 1 Processor -- start 2023-08-25T04:18:30.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.602+0000 7fd5035e1640 1 -- start start 2023-08-25T04:18:30.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd5035e1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e8003980 0x7fd4fc1e88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd5035e1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4fc156e00 0x7fd4fc145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd5035e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4fc0c5150 0x7fd4fc0c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd5035e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc157b30 con 0x7fd4fc0c5150 2023-08-25T04:18:30.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd5035e1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0c40d0 con 0x7fd4fc156e00 2023-08-25T04:18:30.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd5035e1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0c4390 con 0x7fd4e8003980 2023-08-25T04:18:30.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd501b7e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4fc0c5150 0x7fd4fc0c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd501b7e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4fc0c5150 0x7fd4fc0c55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45254/0 (socket says 172.21.15.55:45254) 2023-08-25T04:18:30.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd501b7e640 1 -- 172.21.15.55:0/3988729056 learned_addr learned my addr 172.21.15.55:0/3988729056 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:30.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd50137d640 1 --2- 172.21.15.55:0/3988729056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e8003980 0x7fd4fc1e88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd500b7c640 1 --2- 172.21.15.55:0/3988729056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4fc156e00 0x7fd4fc145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd501b7e640 1 -- 172.21.15.55:0/3988729056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e8003980 msgr2=0x7fd4fc1e88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:30.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd501b7e640 1 --2- 172.21.15.55:0/3988729056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e8003980 0x7fd4fc1e88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd501b7e640 1 -- 172.21.15.55:0/3988729056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4fc156e00 msgr2=0x7fd4fc145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:30.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd501b7e640 1 --2- 172.21.15.55:0/3988729056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4fc156e00 0x7fd4fc145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd501b7e640 1 -- 172.21.15.55:0/3988729056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc0c4670 con 0x7fd4fc0c5150 2023-08-25T04:18:30.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd501b7e640 1 --2- 172.21.15.55:0/3988729056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4fc0c5150 0x7fd4fc0c55d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc071930 tx=0x7fd4f4007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:30.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd4f1ffb640 1 -- 172.21.15.55:0/3988729056 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400eb00 con 0x7fd4fc0c5150 2023-08-25T04:18:30.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd4f1ffb640 1 -- 172.21.15.55:0/3988729056 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f400ec60 con 0x7fd4fc0c5150 2023-08-25T04:18:30.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd4f1ffb640 1 -- 172.21.15.55:0/3988729056 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4013420 con 0x7fd4fc0c5150 2023-08-25T04:18:30.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd5035e1640 1 -- 172.21.15.55:0/3988729056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4fc0c4950 con 0x7fd4fc0c5150 2023-08-25T04:18:30.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd5035e1640 1 -- 172.21.15.55:0/3988729056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc0c5b10 con 0x7fd4fc0c5150 2023-08-25T04:18:30.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.606+0000 7fd5035e1640 1 -- 172.21.15.55:0/3988729056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc04dbe0 con 0x7fd4fc0c5150 2023-08-25T04:18:30.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.610+0000 7fd4f1ffb640 1 -- 172.21.15.55:0/3988729056 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fd4f4013580 con 0x7fd4fc0c5150 2023-08-25T04:18:30.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.610+0000 7fd4f1ffb640 1 --2- 172.21.15.55:0/3988729056 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fd4e00657d0 0x7fd4e0067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.610+0000 7fd4f1ffb640 1 -- 172.21.15.55:0/3988729056 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd4f4083290 con 0x7fd4fc0c5150 2023-08-25T04:18:30.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.610+0000 7fd50137d640 1 --2- 172.21.15.55:0/3988729056 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fd4e00657d0 0x7fd4e0067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.610+0000 7fd50137d640 1 --2- 172.21.15.55:0/3988729056 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fd4e00657d0 0x7fd4e0067c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80ae000 tx=0x7fd4f80046d0 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:30.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.614+0000 7fd4f1ffb640 1 -- 172.21.15.55:0/3988729056 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd4f4050c50 con 0x7fd4fc0c5150 2023-08-25T04:18:30.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.766+0000 7fd5035e1640 1 -- 172.21.15.55:0/3988729056 --> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4fc15cda0 con 0x7fd4e00657d0 2023-08-25T04:18:30.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.774+0000 7fd4f1ffb640 1 -- 172.21.15.55:0/3988729056 <== mgr.5720 v2:172.21.15.110:6832/2283645732 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311403 (secure 0 0 0) 0x7fd4f80ba070 con 0x7fd4e00657d0 2023-08-25T04:18:30.777 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:30.778 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:18:30.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.778+0000 7fd5035e1640 1 -- 172.21.15.55:0/3988729056 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fd4e00657d0 msgr2=0x7fd4e0067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:30.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.778+0000 7fd5035e1640 1 --2- 172.21.15.55:0/3988729056 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fd4e00657d0 0x7fd4e0067c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd4f80ae000 tx=0x7fd4f80046d0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.778+0000 7fd5035e1640 1 -- 172.21.15.55:0/3988729056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4fc0c5150 msgr2=0x7fd4fc0c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:30.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.778+0000 7fd5035e1640 1 --2- 172.21.15.55:0/3988729056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4fc0c5150 0x7fd4fc0c55d0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc071930 tx=0x7fd4f4007bc0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.778+0000 7fd5035e1640 1 -- 172.21.15.55:0/3988729056 shutdown_connections 2023-08-25T04:18:30.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.778+0000 7fd5035e1640 1 --2- 172.21.15.55:0/3988729056 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fd4e00657d0 0x7fd4e0067c90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.778+0000 7fd5035e1640 1 --2- 172.21.15.55:0/3988729056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4fc0c5150 0x7fd4fc0c55d0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.778+0000 7fd5035e1640 1 --2- 172.21.15.55:0/3988729056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4fc156e00 0x7fd4fc145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.778+0000 7fd5035e1640 1 --2- 172.21.15.55:0/3988729056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4e8003980 0x7fd4fc1e88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.778+0000 7fd5035e1640 1 -- 172.21.15.55:0/3988729056 >> 172.21.15.55:0/3988729056 conn(0x7fd4fc0d05a0 msgr2=0x7fd4fc0b08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:30.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.778+0000 7fd5035e1640 1 -- 172.21.15.55:0/3988729056 shutdown_connections 2023-08-25T04:18:30.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.778+0000 7fd5035e1640 1 -- 172.21.15.55:0/3988729056 wait complete. 2023-08-25T04:18:30.797 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-08-25T04:18:30.545747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":283,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":314996,"kb_used_data":8616,"kb_used_omap":13,"kb_used_meta":306226,"kb_avail":754659724,"statfs":{"total":773094113280,"available":772771557376,"internally_reserved":0,"allocated":8822784,"data_stored":4895276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":313575512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001541"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988082+0000","last_change":"2023-08-25T04:18:25.632248+0000","last_active":"2023-08-25T04:18:27.988082+0000","last_peered":"2023-08-25T04:18:27.988082+0000","last_clean":"2023-08-25T04:18:27.988082+0000","last_became_active":"2023-08-25T04:18:25.631989+0000","last_became_peered":"2023-08-25T04:18:25.631989+0000","last_unstale":"2023-08-25T04:18:27.988082+0000","last_undegraded":"2023-08-25T04:18:27.988082+0000","last_fullsized":"2023-08-25T04:18:27.988082+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:57:44.313097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988169+0000","last_change":"2023-08-25T04:18:25.646606+0000","last_active":"2023-08-25T04:18:27.988169+0000","last_peered":"2023-08-25T04:18:27.988169+0000","last_clean":"2023-08-25T04:18:27.988169+0000","last_became_active":"2023-08-25T04:18:25.646224+0000","last_became_peered":"2023-08-25T04:18:25.646224+0000","last_unstale":"2023-08-25T04:18:27.988169+0000","last_undegraded":"2023-08-25T04:18:27.988169+0000","last_fullsized":"2023-08-25T04:18:27.988169+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:10:21.413051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354105+0000","last_change":"2023-08-25T04:18:25.644136+0000","last_active":"2023-08-25T04:18:27.354105+0000","last_peered":"2023-08-25T04:18:27.354105+0000","last_clean":"2023-08-25T04:18:27.354105+0000","last_became_active":"2023-08-25T04:18:25.643817+0000","last_became_peered":"2023-08-25T04:18:25.643817+0000","last_unstale":"2023-08-25T04:18:27.354105+0000","last_undegraded":"2023-08-25T04:18:27.354105+0000","last_fullsized":"2023-08-25T04:18:27.354105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:26:49.732872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622042+0000","last_change":"2023-08-25T04:18:25.650618+0000","last_active":"2023-08-25T04:18:26.622042+0000","last_peered":"2023-08-25T04:18:26.622042+0000","last_clean":"2023-08-25T04:18:26.622042+0000","last_became_active":"2023-08-25T04:18:25.650299+0000","last_became_peered":"2023-08-25T04:18:25.650299+0000","last_unstale":"2023-08-25T04:18:26.622042+0000","last_undegraded":"2023-08-25T04:18:26.622042+0000","last_fullsized":"2023-08-25T04:18:26.622042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:38:34.910047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622042+0000","last_change":"2023-08-25T04:18:25.650314+0000","last_active":"2023-08-25T04:18:26.622042+0000","last_peered":"2023-08-25T04:18:26.622042+0000","last_clean":"2023-08-25T04:18:26.622042+0000","last_became_active":"2023-08-25T04:18:25.649935+0000","last_became_peered":"2023-08-25T04:18:25.649935+0000","last_unstale":"2023-08-25T04:18:26.622042+0000","last_undegraded":"2023-08-25T04:18:26.622042+0000","last_fullsized":"2023-08-25T04:18:26.622042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:01:19.163570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487485+0000","last_change":"2023-08-25T04:18:25.645148+0000","last_active":"2023-08-25T04:18:27.487485+0000","last_peered":"2023-08-25T04:18:27.487485+0000","last_clean":"2023-08-25T04:18:27.487485+0000","last_became_active":"2023-08-25T04:18:25.644745+0000","last_became_peered":"2023-08-25T04:18:25.644745+0000","last_unstale":"2023-08-25T04:18:27.487485+0000","last_undegraded":"2023-08-25T04:18:27.487485+0000","last_fullsized":"2023-08-25T04:18:27.487485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:46:23.043397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.626230+0000","last_change":"2023-08-25T04:18:25.644903+0000","last_active":"2023-08-25T04:18:26.626230+0000","last_peered":"2023-08-25T04:18:26.626230+0000","last_clean":"2023-08-25T04:18:26.626230+0000","last_became_active":"2023-08-25T04:18:25.644579+0000","last_became_peered":"2023-08-25T04:18:25.644579+0000","last_unstale":"2023-08-25T04:18:26.626230+0000","last_undegraded":"2023-08-25T04:18:26.626230+0000","last_fullsized":"2023-08-25T04:18:26.626230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:07:40.265049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639112+0000","last_change":"2023-08-25T04:18:25.641045+0000","last_active":"2023-08-25T04:18:27.639112+0000","last_peered":"2023-08-25T04:18:27.639112+0000","last_clean":"2023-08-25T04:18:27.639112+0000","last_became_active":"2023-08-25T04:18:25.640675+0000","last_became_peered":"2023-08-25T04:18:25.640675+0000","last_unstale":"2023-08-25T04:18:27.639112+0000","last_undegraded":"2023-08-25T04:18:27.639112+0000","last_fullsized":"2023-08-25T04:18:27.639112+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:26:16.948622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354489+0000","last_change":"2023-08-25T04:18:25.648710+0000","last_active":"2023-08-25T04:18:27.354489+0000","last_peered":"2023-08-25T04:18:27.354489+0000","last_clean":"2023-08-25T04:18:27.354489+0000","last_became_active":"2023-08-25T04:18:25.648216+0000","last_became_peered":"2023-08-25T04:18:25.648216+0000","last_unstale":"2023-08-25T04:18:27.354489+0000","last_undegraded":"2023-08-25T04:18:27.354489+0000","last_fullsized":"2023-08-25T04:18:27.354489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:55:54.614438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354387+0000","last_change":"2023-08-25T04:18:25.638928+0000","last_active":"2023-08-25T04:18:27.354387+0000","last_peered":"2023-08-25T04:18:27.354387+0000","last_clean":"2023-08-25T04:18:27.354387+0000","last_became_active":"2023-08-25T04:18:25.638626+0000","last_became_peered":"2023-08-25T04:18:25.638626+0000","last_unstale":"2023-08-25T04:18:27.354387+0000","last_undegraded":"2023-08-25T04:18:27.354387+0000","last_fullsized":"2023-08-25T04:18:27.354387+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:35:17.203801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622303+0000","last_change":"2023-08-25T04:18:25.649934+0000","last_active":"2023-08-25T04:18:26.622303+0000","last_peered":"2023-08-25T04:18:26.622303+0000","last_clean":"2023-08-25T04:18:26.622303+0000","last_became_active":"2023-08-25T04:18:25.649597+0000","last_became_peered":"2023-08-25T04:18:25.649597+0000","last_unstale":"2023-08-25T04:18:26.622303+0000","last_undegraded":"2023-08-25T04:18:26.622303+0000","last_fullsized":"2023-08-25T04:18:26.622303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:59.285151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639307+0000","last_change":"2023-08-25T04:18:25.633014+0000","last_active":"2023-08-25T04:18:27.639307+0000","last_peered":"2023-08-25T04:18:27.639307+0000","last_clean":"2023-08-25T04:18:27.639307+0000","last_became_active":"2023-08-25T04:18:25.632704+0000","last_became_peered":"2023-08-25T04:18:25.632704+0000","last_unstale":"2023-08-25T04:18:27.639307+0000","last_undegraded":"2023-08-25T04:18:27.639307+0000","last_fullsized":"2023-08-25T04:18:27.639307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:17:27.157990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639481+0000","last_change":"2023-08-25T04:18:25.650920+0000","last_active":"2023-08-25T04:18:27.639481+0000","last_peered":"2023-08-25T04:18:27.639481+0000","last_clean":"2023-08-25T04:18:27.639481+0000","last_became_active":"2023-08-25T04:18:25.650310+0000","last_became_peered":"2023-08-25T04:18:25.650310+0000","last_unstale":"2023-08-25T04:18:27.639481+0000","last_undegraded":"2023-08-25T04:18:27.639481+0000","last_fullsized":"2023-08-25T04:18:27.639481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:16:04.390426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354066+0000","last_change":"2023-08-25T04:18:25.645185+0000","last_active":"2023-08-25T04:18:27.354066+0000","last_peered":"2023-08-25T04:18:27.354066+0000","last_clean":"2023-08-25T04:18:27.354066+0000","last_became_active":"2023-08-25T04:18:25.644849+0000","last_became_peered":"2023-08-25T04:18:25.644849+0000","last_unstale":"2023-08-25T04:18:27.354066+0000","last_undegraded":"2023-08-25T04:18:27.354066+0000","last_fullsized":"2023-08-25T04:18:27.354066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:09.895509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.353927+0000","last_change":"2023-08-25T04:18:25.641201+0000","last_active":"2023-08-25T04:18:27.353927+0000","last_peered":"2023-08-25T04:18:27.353927+0000","last_clean":"2023-08-25T04:18:27.353927+0000","last_became_active":"2023-08-25T04:18:25.640897+0000","last_became_peered":"2023-08-25T04:18:25.640897+0000","last_unstale":"2023-08-25T04:18:27.353927+0000","last_undegraded":"2023-08-25T04:18:27.353927+0000","last_fullsized":"2023-08-25T04:18:27.353927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:37.661289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.626242+0000","last_change":"2023-08-25T04:18:25.639360+0000","last_active":"2023-08-25T04:18:26.626242+0000","last_peered":"2023-08-25T04:18:26.626242+0000","last_clean":"2023-08-25T04:18:26.626242+0000","last_became_active":"2023-08-25T04:18:25.639046+0000","last_became_peered":"2023-08-25T04:18:25.639046+0000","last_unstale":"2023-08-25T04:18:26.626242+0000","last_undegraded":"2023-08-25T04:18:26.626242+0000","last_fullsized":"2023-08-25T04:18:26.626242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:15:41.847995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988094+0000","last_change":"2023-08-25T04:18:25.649762+0000","last_active":"2023-08-25T04:18:27.988094+0000","last_peered":"2023-08-25T04:18:27.988094+0000","last_clean":"2023-08-25T04:18:27.988094+0000","last_became_active":"2023-08-25T04:18:25.649504+0000","last_became_peered":"2023-08-25T04:18:25.649504+0000","last_unstale":"2023-08-25T04:18:27.988094+0000","last_undegraded":"2023-08-25T04:18:27.988094+0000","last_fullsized":"2023-08-25T04:18:27.988094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:46:28.827215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621593+0000","last_change":"2023-08-25T04:18:25.645876+0000","last_active":"2023-08-25T04:18:26.621593+0000","last_peered":"2023-08-25T04:18:26.621593+0000","last_clean":"2023-08-25T04:18:26.621593+0000","last_became_active":"2023-08-25T04:18:25.645451+0000","last_became_peered":"2023-08-25T04:18:25.645451+0000","last_unstale":"2023-08-25T04:18:26.621593+0000","last_undegraded":"2023-08-25T04:18:26.621593+0000","last_fullsized":"2023-08-25T04:18:26.621593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:43:05.117649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621813+0000","last_change":"2023-08-25T04:18:25.635545+0000","last_active":"2023-08-25T04:18:26.621813+0000","last_peered":"2023-08-25T04:18:26.621813+0000","last_clean":"2023-08-25T04:18:26.621813+0000","last_became_active":"2023-08-25T04:18:25.635234+0000","last_became_peered":"2023-08-25T04:18:25.635234+0000","last_unstale":"2023-08-25T04:18:26.621813+0000","last_undegraded":"2023-08-25T04:18:26.621813+0000","last_fullsized":"2023-08-25T04:18:26.621813+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:50:07.971510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913678+0000","last_change":"2023-08-25T04:18:25.638009+0000","last_active":"2023-08-25T04:18:26.913678+0000","last_peered":"2023-08-25T04:18:26.913678+0000","last_clean":"2023-08-25T04:18:26.913678+0000","last_became_active":"2023-08-25T04:18:25.637746+0000","last_became_peered":"2023-08-25T04:18:25.637746+0000","last_unstale":"2023-08-25T04:18:26.913678+0000","last_undegraded":"2023-08-25T04:18:26.913678+0000","last_fullsized":"2023-08-25T04:18:26.913678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:46.047372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639432+0000","last_change":"2023-08-25T04:18:25.626842+0000","last_active":"2023-08-25T04:18:27.639432+0000","last_peered":"2023-08-25T04:18:27.639432+0000","last_clean":"2023-08-25T04:18:27.639432+0000","last_became_active":"2023-08-25T04:18:25.626550+0000","last_became_peered":"2023-08-25T04:18:25.626550+0000","last_unstale":"2023-08-25T04:18:27.639432+0000","last_undegraded":"2023-08-25T04:18:27.639432+0000","last_fullsized":"2023-08-25T04:18:27.639432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:53:42.891883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913419+0000","last_change":"2023-08-25T04:18:25.642862+0000","last_active":"2023-08-25T04:18:26.913419+0000","last_peered":"2023-08-25T04:18:26.913419+0000","last_clean":"2023-08-25T04:18:26.913419+0000","last_became_active":"2023-08-25T04:18:25.642597+0000","last_became_peered":"2023-08-25T04:18:25.642597+0000","last_unstale":"2023-08-25T04:18:26.913419+0000","last_undegraded":"2023-08-25T04:18:26.913419+0000","last_fullsized":"2023-08-25T04:18:26.913419+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:08:11.703878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913345+0000","last_change":"2023-08-25T04:18:25.638154+0000","last_active":"2023-08-25T04:18:26.913345+0000","last_peered":"2023-08-25T04:18:26.913345+0000","last_clean":"2023-08-25T04:18:26.913345+0000","last_became_active":"2023-08-25T04:18:25.637005+0000","last_became_peered":"2023-08-25T04:18:25.637005+0000","last_unstale":"2023-08-25T04:18:26.913345+0000","last_undegraded":"2023-08-25T04:18:26.913345+0000","last_fullsized":"2023-08-25T04:18:26.913345+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:00:33.451750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.353913+0000","last_change":"2023-08-25T04:18:25.644071+0000","last_active":"2023-08-25T04:18:27.353913+0000","last_peered":"2023-08-25T04:18:27.353913+0000","last_clean":"2023-08-25T04:18:27.353913+0000","last_became_active":"2023-08-25T04:18:25.643750+0000","last_became_peered":"2023-08-25T04:18:25.643750+0000","last_unstale":"2023-08-25T04:18:27.353913+0000","last_undegraded":"2023-08-25T04:18:27.353913+0000","last_fullsized":"2023-08-25T04:18:27.353913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:22:07.017092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639550+0000","last_change":"2023-08-25T04:18:25.636859+0000","last_active":"2023-08-25T04:18:27.639550+0000","last_peered":"2023-08-25T04:18:27.639550+0000","last_clean":"2023-08-25T04:18:27.639550+0000","last_became_active":"2023-08-25T04:18:25.636549+0000","last_became_peered":"2023-08-25T04:18:25.636549+0000","last_unstale":"2023-08-25T04:18:27.639550+0000","last_undegraded":"2023-08-25T04:18:27.639550+0000","last_fullsized":"2023-08-25T04:18:27.639550+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:49:39.436600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639320+0000","last_change":"2023-08-25T04:18:25.630695+0000","last_active":"2023-08-25T04:18:27.639320+0000","last_peered":"2023-08-25T04:18:27.639320+0000","last_clean":"2023-08-25T04:18:27.639320+0000","last_became_active":"2023-08-25T04:18:25.630399+0000","last_became_peered":"2023-08-25T04:18:25.630399+0000","last_unstale":"2023-08-25T04:18:27.639320+0000","last_undegraded":"2023-08-25T04:18:27.639320+0000","last_fullsized":"2023-08-25T04:18:27.639320+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:56.085993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622443+0000","last_change":"2023-08-25T04:18:25.650015+0000","last_active":"2023-08-25T04:18:26.622443+0000","last_peered":"2023-08-25T04:18:26.622443+0000","last_clean":"2023-08-25T04:18:26.622443+0000","last_became_active":"2023-08-25T04:18:25.649723+0000","last_became_peered":"2023-08-25T04:18:25.649723+0000","last_unstale":"2023-08-25T04:18:26.622443+0000","last_undegraded":"2023-08-25T04:18:26.622443+0000","last_fullsized":"2023-08-25T04:18:26.622443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:05:46.710064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.987894+0000","last_change":"2023-08-25T04:18:25.631594+0000","last_active":"2023-08-25T04:18:27.987894+0000","last_peered":"2023-08-25T04:18:27.987894+0000","last_clean":"2023-08-25T04:18:27.987894+0000","last_became_active":"2023-08-25T04:18:25.631232+0000","last_became_peered":"2023-08-25T04:18:25.631232+0000","last_unstale":"2023-08-25T04:18:27.987894+0000","last_undegraded":"2023-08-25T04:18:27.987894+0000","last_fullsized":"2023-08-25T04:18:27.987894+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:55:15.459228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354012+0000","last_change":"2023-08-25T04:18:25.651171+0000","last_active":"2023-08-25T04:18:27.354012+0000","last_peered":"2023-08-25T04:18:27.354012+0000","last_clean":"2023-08-25T04:18:27.354012+0000","last_became_active":"2023-08-25T04:18:25.650894+0000","last_became_peered":"2023-08-25T04:18:25.650894+0000","last_unstale":"2023-08-25T04:18:27.354012+0000","last_undegraded":"2023-08-25T04:18:27.354012+0000","last_fullsized":"2023-08-25T04:18:27.354012+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:42:12.796762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639142+0000","last_change":"2023-08-25T04:18:25.637488+0000","last_active":"2023-08-25T04:18:27.639142+0000","last_peered":"2023-08-25T04:18:27.639142+0000","last_clean":"2023-08-25T04:18:27.639142+0000","last_became_active":"2023-08-25T04:18:25.637054+0000","last_became_peered":"2023-08-25T04:18:25.637054+0000","last_unstale":"2023-08-25T04:18:27.639142+0000","last_undegraded":"2023-08-25T04:18:27.639142+0000","last_fullsized":"2023-08-25T04:18:27.639142+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:22:21.162328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621197+0000","last_change":"2023-08-25T04:18:25.646693+0000","last_active":"2023-08-25T04:18:26.621197+0000","last_peered":"2023-08-25T04:18:26.621197+0000","last_clean":"2023-08-25T04:18:26.621197+0000","last_became_active":"2023-08-25T04:18:25.646408+0000","last_became_peered":"2023-08-25T04:18:25.646408+0000","last_unstale":"2023-08-25T04:18:26.621197+0000","last_undegraded":"2023-08-25T04:18:26.621197+0000","last_fullsized":"2023-08-25T04:18:26.621197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:04:39.061279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487347+0000","last_change":"2023-08-25T04:18:25.641416+0000","last_active":"2023-08-25T04:18:27.487347+0000","last_peered":"2023-08-25T04:18:27.487347+0000","last_clean":"2023-08-25T04:18:27.487347+0000","last_became_active":"2023-08-25T04:18:25.641064+0000","last_became_peered":"2023-08-25T04:18:25.641064+0000","last_unstale":"2023-08-25T04:18:27.487347+0000","last_undegraded":"2023-08-25T04:18:27.487347+0000","last_fullsized":"2023-08-25T04:18:27.487347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:16:11.355646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622411+0000","last_change":"2023-08-25T04:18:25.626775+0000","last_active":"2023-08-25T04:18:26.622411+0000","last_peered":"2023-08-25T04:18:26.622411+0000","last_clean":"2023-08-25T04:18:26.622411+0000","last_became_active":"2023-08-25T04:18:25.626462+0000","last_became_peered":"2023-08-25T04:18:25.626462+0000","last_unstale":"2023-08-25T04:18:26.622411+0000","last_undegraded":"2023-08-25T04:18:26.622411+0000","last_fullsized":"2023-08-25T04:18:26.622411+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:51:12.200425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"78'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988192+0000","last_change":"2023-08-25T04:18:24.900671+0000","last_active":"2023-08-25T04:18:27.988192+0000","last_peered":"2023-08-25T04:18:27.988192+0000","last_clean":"2023-08-25T04:18:27.988192+0000","last_became_active":"2023-08-25T04:18:24.900313+0000","last_became_peered":"2023-08-25T04:18:24.900313+0000","last_unstale":"2023-08-25T04:18:27.988192+0000","last_undegraded":"2023-08-25T04:18:27.988192+0000","last_fullsized":"2023-08-25T04:18:27.988192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:36:22.100902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622579+0000","last_change":"2023-08-25T04:18:25.638689+0000","last_active":"2023-08-25T04:18:26.622579+0000","last_peered":"2023-08-25T04:18:26.622579+0000","last_clean":"2023-08-25T04:18:26.622579+0000","last_became_active":"2023-08-25T04:18:25.638409+0000","last_became_peered":"2023-08-25T04:18:25.638409+0000","last_unstale":"2023-08-25T04:18:26.622579+0000","last_undegraded":"2023-08-25T04:18:26.622579+0000","last_fullsized":"2023-08-25T04:18:26.622579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:26:53.571564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487726+0000","last_change":"2023-08-25T04:18:24.906222+0000","last_active":"2023-08-25T04:18:27.487726+0000","last_peered":"2023-08-25T04:18:27.487726+0000","last_clean":"2023-08-25T04:18:27.487726+0000","last_became_active":"2023-08-25T04:18:24.905939+0000","last_became_peered":"2023-08-25T04:18:24.905939+0000","last_unstale":"2023-08-25T04:18:27.487726+0000","last_undegraded":"2023-08-25T04:18:27.487726+0000","last_fullsized":"2023-08-25T04:18:27.487726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:54.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487673+0000","last_change":"2023-08-25T04:18:25.641540+0000","last_active":"2023-08-25T04:18:27.487673+0000","last_peered":"2023-08-25T04:18:27.487673+0000","last_clean":"2023-08-25T04:18:27.487673+0000","last_became_active":"2023-08-25T04:18:25.641036+0000","last_became_peered":"2023-08-25T04:18:25.641036+0000","last_unstale":"2023-08-25T04:18:27.487673+0000","last_undegraded":"2023-08-25T04:18:27.487673+0000","last_fullsized":"2023-08-25T04:18:27.487673+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:51.397620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"78'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487710+0000","last_change":"2023-08-25T04:18:24.909480+0000","last_active":"2023-08-25T04:18:27.487710+0000","last_peered":"2023-08-25T04:18:27.487710+0000","last_clean":"2023-08-25T04:18:27.487710+0000","last_became_active":"2023-08-25T04:18:24.909014+0000","last_became_peered":"2023-08-25T04:18:24.909014+0000","last_unstale":"2023-08-25T04:18:27.487710+0000","last_undegraded":"2023-08-25T04:18:27.487710+0000","last_fullsized":"2023-08-25T04:18:27.487710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:25:15.695930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354470+0000","last_change":"2023-08-25T04:18:25.639484+0000","last_active":"2023-08-25T04:18:27.354470+0000","last_peered":"2023-08-25T04:18:27.354470+0000","last_clean":"2023-08-25T04:18:27.354470+0000","last_became_active":"2023-08-25T04:18:25.639181+0000","last_became_peered":"2023-08-25T04:18:25.639181+0000","last_unstale":"2023-08-25T04:18:27.354470+0000","last_undegraded":"2023-08-25T04:18:27.354470+0000","last_fullsized":"2023-08-25T04:18:27.354470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:19:11.587628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"78'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487781+0000","last_change":"2023-08-25T04:18:24.900981+0000","last_active":"2023-08-25T04:18:27.487781+0000","last_peered":"2023-08-25T04:18:27.487781+0000","last_clean":"2023-08-25T04:18:27.487781+0000","last_became_active":"2023-08-25T04:18:24.900617+0000","last_became_peered":"2023-08-25T04:18:24.900617+0000","last_unstale":"2023-08-25T04:18:27.487781+0000","last_undegraded":"2023-08-25T04:18:27.487781+0000","last_fullsized":"2023-08-25T04:18:27.487781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:52:19.639407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.626387+0000","last_change":"2023-08-25T04:18:25.638325+0000","last_active":"2023-08-25T04:18:26.626387+0000","last_peered":"2023-08-25T04:18:26.626387+0000","last_clean":"2023-08-25T04:18:26.626387+0000","last_became_active":"2023-08-25T04:18:25.638028+0000","last_became_peered":"2023-08-25T04:18:25.638028+0000","last_unstale":"2023-08-25T04:18:26.626387+0000","last_undegraded":"2023-08-25T04:18:26.626387+0000","last_fullsized":"2023-08-25T04:18:26.626387+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:55:04.280318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913716+0000","last_change":"2023-08-25T04:18:24.902167+0000","last_active":"2023-08-25T04:18:26.913716+0000","last_peered":"2023-08-25T04:18:26.913716+0000","last_clean":"2023-08-25T04:18:26.913716+0000","last_became_active":"2023-08-25T04:18:24.901834+0000","last_became_peered":"2023-08-25T04:18:24.901834+0000","last_unstale":"2023-08-25T04:18:26.913716+0000","last_undegraded":"2023-08-25T04:18:26.913716+0000","last_fullsized":"2023-08-25T04:18:26.913716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:25:20.979312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.987618+0000","last_change":"2023-08-25T04:18:25.652459+0000","last_active":"2023-08-25T04:18:27.987618+0000","last_peered":"2023-08-25T04:18:27.987618+0000","last_clean":"2023-08-25T04:18:27.987618+0000","last_became_active":"2023-08-25T04:18:25.652184+0000","last_became_peered":"2023-08-25T04:18:25.652184+0000","last_unstale":"2023-08-25T04:18:27.987618+0000","last_undegraded":"2023-08-25T04:18:27.987618+0000","last_fullsized":"2023-08-25T04:18:27.987618+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:13:02.236309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913360+0000","last_change":"2023-08-25T04:18:24.900982+0000","last_active":"2023-08-25T04:18:26.913360+0000","last_peered":"2023-08-25T04:18:26.913360+0000","last_clean":"2023-08-25T04:18:26.913360+0000","last_became_active":"2023-08-25T04:18:24.900528+0000","last_became_peered":"2023-08-25T04:18:24.900528+0000","last_unstale":"2023-08-25T04:18:26.913360+0000","last_undegraded":"2023-08-25T04:18:26.913360+0000","last_fullsized":"2023-08-25T04:18:26.913360+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:08:11.010203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621634+0000","last_change":"2023-08-25T04:18:25.644003+0000","last_active":"2023-08-25T04:18:26.621634+0000","last_peered":"2023-08-25T04:18:26.621634+0000","last_clean":"2023-08-25T04:18:26.621634+0000","last_became_active":"2023-08-25T04:18:25.643701+0000","last_became_peered":"2023-08-25T04:18:25.643701+0000","last_unstale":"2023-08-25T04:18:26.621634+0000","last_undegraded":"2023-08-25T04:18:26.621634+0000","last_fullsized":"2023-08-25T04:18:26.621634+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:13.067641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913432+0000","last_change":"2023-08-25T04:18:24.905764+0000","last_active":"2023-08-25T04:18:26.913432+0000","last_peered":"2023-08-25T04:18:26.913432+0000","last_clean":"2023-08-25T04:18:26.913432+0000","last_became_active":"2023-08-25T04:18:24.905138+0000","last_became_peered":"2023-08-25T04:18:24.905138+0000","last_unstale":"2023-08-25T04:18:26.913432+0000","last_undegraded":"2023-08-25T04:18:26.913432+0000","last_fullsized":"2023-08-25T04:18:26.913432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:46.932266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913621+0000","last_change":"2023-08-25T04:18:25.650056+0000","last_active":"2023-08-25T04:18:26.913621+0000","last_peered":"2023-08-25T04:18:26.913621+0000","last_clean":"2023-08-25T04:18:26.913621+0000","last_became_active":"2023-08-25T04:18:25.649748+0000","last_became_peered":"2023-08-25T04:18:25.649748+0000","last_unstale":"2023-08-25T04:18:26.913621+0000","last_undegraded":"2023-08-25T04:18:26.913621+0000","last_fullsized":"2023-08-25T04:18:26.913621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:32:45.722559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622118+0000","last_change":"2023-08-25T04:18:24.903496+0000","last_active":"2023-08-25T04:18:26.622118+0000","last_peered":"2023-08-25T04:18:26.622118+0000","last_clean":"2023-08-25T04:18:26.622118+0000","last_became_active":"2023-08-25T04:18:24.903220+0000","last_became_peered":"2023-08-25T04:18:24.903220+0000","last_unstale":"2023-08-25T04:18:26.622118+0000","last_undegraded":"2023-08-25T04:18:26.622118+0000","last_fullsized":"2023-08-25T04:18:26.622118+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:16:43.130858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988031+0000","last_change":"2023-08-25T04:18:25.633482+0000","last_active":"2023-08-25T04:18:27.988031+0000","last_peered":"2023-08-25T04:18:27.988031+0000","last_clean":"2023-08-25T04:18:27.988031+0000","last_became_active":"2023-08-25T04:18:25.633146+0000","last_became_peered":"2023-08-25T04:18:25.633146+0000","last_unstale":"2023-08-25T04:18:27.988031+0000","last_undegraded":"2023-08-25T04:18:27.988031+0000","last_fullsized":"2023-08-25T04:18:27.988031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:54:56.767599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354577+0000","last_change":"2023-08-25T04:18:24.910198+0000","last_active":"2023-08-25T04:18:27.354577+0000","last_peered":"2023-08-25T04:18:27.354577+0000","last_clean":"2023-08-25T04:18:27.354577+0000","last_became_active":"2023-08-25T04:18:24.909872+0000","last_became_peered":"2023-08-25T04:18:24.909872+0000","last_unstale":"2023-08-25T04:18:27.354577+0000","last_undegraded":"2023-08-25T04:18:27.354577+0000","last_fullsized":"2023-08-25T04:18:27.354577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:13:18.535719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913630+0000","last_change":"2023-08-25T04:18:25.635060+0000","last_active":"2023-08-25T04:18:26.913630+0000","last_peered":"2023-08-25T04:18:26.913630+0000","last_clean":"2023-08-25T04:18:26.913630+0000","last_became_active":"2023-08-25T04:18:25.634787+0000","last_became_peered":"2023-08-25T04:18:25.634787+0000","last_unstale":"2023-08-25T04:18:26.913630+0000","last_undegraded":"2023-08-25T04:18:26.913630+0000","last_fullsized":"2023-08-25T04:18:26.913630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:28:01.142506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621684+0000","last_change":"2023-08-25T04:18:24.894667+0000","last_active":"2023-08-25T04:18:26.621684+0000","last_peered":"2023-08-25T04:18:26.621684+0000","last_clean":"2023-08-25T04:18:26.621684+0000","last_became_active":"2023-08-25T04:18:24.894325+0000","last_became_peered":"2023-08-25T04:18:24.894325+0000","last_unstale":"2023-08-25T04:18:26.621684+0000","last_undegraded":"2023-08-25T04:18:26.621684+0000","last_fullsized":"2023-08-25T04:18:26.621684+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:17:40.154585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621965+0000","last_change":"2023-08-25T04:18:25.624915+0000","last_active":"2023-08-25T04:18:26.621965+0000","last_peered":"2023-08-25T04:18:26.621965+0000","last_clean":"2023-08-25T04:18:26.621965+0000","last_became_active":"2023-08-25T04:18:25.624586+0000","last_became_peered":"2023-08-25T04:18:25.624586+0000","last_unstale":"2023-08-25T04:18:26.621965+0000","last_undegraded":"2023-08-25T04:18:26.621965+0000","last_fullsized":"2023-08-25T04:18:26.621965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:45:36.677172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"78'3","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354353+0000","last_change":"2023-08-25T04:18:24.910725+0000","last_active":"2023-08-25T04:18:27.354353+0000","last_peered":"2023-08-25T04:18:27.354353+0000","last_clean":"2023-08-25T04:18:27.354353+0000","last_became_active":"2023-08-25T04:18:24.910425+0000","last_became_peered":"2023-08-25T04:18:24.910425+0000","last_unstale":"2023-08-25T04:18:27.354353+0000","last_undegraded":"2023-08-25T04:18:27.354353+0000","last_fullsized":"2023-08-25T04:18:27.354353+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:00:08.595826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622423+0000","last_change":"2023-08-25T04:18:25.646137+0000","last_active":"2023-08-25T04:18:26.622423+0000","last_peered":"2023-08-25T04:18:26.622423+0000","last_clean":"2023-08-25T04:18:26.622423+0000","last_became_active":"2023-08-25T04:18:25.645761+0000","last_became_peered":"2023-08-25T04:18:25.645761+0000","last_unstale":"2023-08-25T04:18:26.622423+0000","last_undegraded":"2023-08-25T04:18:26.622423+0000","last_fullsized":"2023-08-25T04:18:26.622423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:18:08.394722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"78'6","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988013+0000","last_change":"2023-08-25T04:18:24.898103+0000","last_active":"2023-08-25T04:18:27.988013+0000","last_peered":"2023-08-25T04:18:27.988013+0000","last_clean":"2023-08-25T04:18:27.988013+0000","last_became_active":"2023-08-25T04:18:24.897730+0000","last_became_peered":"2023-08-25T04:18:24.897730+0000","last_unstale":"2023-08-25T04:18:27.988013+0000","last_undegraded":"2023-08-25T04:18:27.988013+0000","last_fullsized":"2023-08-25T04:18:27.988013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:15.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621199+0000","last_change":"2023-08-25T04:18:25.646279+0000","last_active":"2023-08-25T04:18:26.621199+0000","last_peered":"2023-08-25T04:18:26.621199+0000","last_clean":"2023-08-25T04:18:26.621199+0000","last_became_active":"2023-08-25T04:18:25.645802+0000","last_became_peered":"2023-08-25T04:18:25.645802+0000","last_unstale":"2023-08-25T04:18:26.621199+0000","last_undegraded":"2023-08-25T04:18:26.621199+0000","last_fullsized":"2023-08-25T04:18:26.621199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:59:16.075360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"78'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354179+0000","last_change":"2023-08-25T04:18:24.904539+0000","last_active":"2023-08-25T04:18:27.354179+0000","last_peered":"2023-08-25T04:18:27.354179+0000","last_clean":"2023-08-25T04:18:27.354179+0000","last_became_active":"2023-08-25T04:18:24.904139+0000","last_became_peered":"2023-08-25T04:18:24.904139+0000","last_unstale":"2023-08-25T04:18:27.354179+0000","last_undegraded":"2023-08-25T04:18:27.354179+0000","last_fullsized":"2023-08-25T04:18:27.354179+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:41:07.520954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639109+0000","last_change":"2023-08-25T04:18:25.644224+0000","last_active":"2023-08-25T04:18:27.639109+0000","last_peered":"2023-08-25T04:18:27.639109+0000","last_clean":"2023-08-25T04:18:27.639109+0000","last_became_active":"2023-08-25T04:18:25.643896+0000","last_became_peered":"2023-08-25T04:18:25.643896+0000","last_unstale":"2023-08-25T04:18:27.639109+0000","last_undegraded":"2023-08-25T04:18:27.639109+0000","last_fullsized":"2023-08-25T04:18:27.639109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:22.829709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639114+0000","last_change":"2023-08-25T04:18:24.910158+0000","last_active":"2023-08-25T04:18:27.639114+0000","last_peered":"2023-08-25T04:18:27.639114+0000","last_clean":"2023-08-25T04:18:27.639114+0000","last_became_active":"2023-08-25T04:18:24.909888+0000","last_became_peered":"2023-08-25T04:18:24.909888+0000","last_unstale":"2023-08-25T04:18:27.639114+0000","last_undegraded":"2023-08-25T04:18:27.639114+0000","last_fullsized":"2023-08-25T04:18:27.639114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:25:28.377610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621679+0000","last_change":"2023-08-25T04:18:25.635790+0000","last_active":"2023-08-25T04:18:26.621679+0000","last_peered":"2023-08-25T04:18:26.621679+0000","last_clean":"2023-08-25T04:18:26.621679+0000","last_became_active":"2023-08-25T04:18:25.635275+0000","last_became_peered":"2023-08-25T04:18:25.635275+0000","last_unstale":"2023-08-25T04:18:26.621679+0000","last_undegraded":"2023-08-25T04:18:26.621679+0000","last_fullsized":"2023-08-25T04:18:26.621679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:20:10.374336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354168+0000","last_change":"2023-08-25T04:18:24.901753+0000","last_active":"2023-08-25T04:18:27.354168+0000","last_peered":"2023-08-25T04:18:27.354168+0000","last_clean":"2023-08-25T04:18:27.354168+0000","last_became_active":"2023-08-25T04:18:24.901420+0000","last_became_peered":"2023-08-25T04:18:24.901420+0000","last_unstale":"2023-08-25T04:18:27.354168+0000","last_undegraded":"2023-08-25T04:18:27.354168+0000","last_fullsized":"2023-08-25T04:18:27.354168+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:20:11.639973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.987920+0000","last_change":"2023-08-25T04:18:25.642974+0000","last_active":"2023-08-25T04:18:27.987920+0000","last_peered":"2023-08-25T04:18:27.987920+0000","last_clean":"2023-08-25T04:18:27.987920+0000","last_became_active":"2023-08-25T04:18:25.642614+0000","last_became_peered":"2023-08-25T04:18:25.642614+0000","last_unstale":"2023-08-25T04:18:27.987920+0000","last_undegraded":"2023-08-25T04:18:27.987920+0000","last_fullsized":"2023-08-25T04:18:27.987920+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:55:32.232515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"78'8","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621196+0000","last_change":"2023-08-25T04:18:24.903053+0000","last_active":"2023-08-25T04:18:26.621196+0000","last_peered":"2023-08-25T04:18:26.621196+0000","last_clean":"2023-08-25T04:18:26.621196+0000","last_became_active":"2023-08-25T04:18:24.902758+0000","last_became_peered":"2023-08-25T04:18:24.902758+0000","last_unstale":"2023-08-25T04:18:26.621196+0000","last_undegraded":"2023-08-25T04:18:26.621196+0000","last_fullsized":"2023-08-25T04:18:26.621196+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:45:26.997083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487670+0000","last_change":"2023-08-25T04:18:25.652727+0000","last_active":"2023-08-25T04:18:27.487670+0000","last_peered":"2023-08-25T04:18:27.487670+0000","last_clean":"2023-08-25T04:18:27.487670+0000","last_became_active":"2023-08-25T04:18:25.652461+0000","last_became_peered":"2023-08-25T04:18:25.652461+0000","last_unstale":"2023-08-25T04:18:27.487670+0000","last_undegraded":"2023-08-25T04:18:27.487670+0000","last_fullsized":"2023-08-25T04:18:27.487670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:43:51.025053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"78'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639648+0000","last_change":"2023-08-25T04:18:24.907754+0000","last_active":"2023-08-25T04:18:27.639648+0000","last_peered":"2023-08-25T04:18:27.639648+0000","last_clean":"2023-08-25T04:18:27.639648+0000","last_became_active":"2023-08-25T04:18:24.907446+0000","last_became_peered":"2023-08-25T04:18:24.907446+0000","last_unstale":"2023-08-25T04:18:27.639648+0000","last_undegraded":"2023-08-25T04:18:27.639648+0000","last_fullsized":"2023-08-25T04:18:27.639648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:21:53.030966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.626587+0000","last_change":"2023-08-25T04:18:25.646631+0000","last_active":"2023-08-25T04:18:26.626587+0000","last_peered":"2023-08-25T04:18:26.626587+0000","last_clean":"2023-08-25T04:18:26.626587+0000","last_became_active":"2023-08-25T04:18:25.646238+0000","last_became_peered":"2023-08-25T04:18:25.646238+0000","last_unstale":"2023-08-25T04:18:26.626587+0000","last_undegraded":"2023-08-25T04:18:26.626587+0000","last_fullsized":"2023-08-25T04:18:26.626587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:04:23.036827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639521+0000","last_change":"2023-08-25T04:18:24.905286+0000","last_active":"2023-08-25T04:18:27.639521+0000","last_peered":"2023-08-25T04:18:27.639521+0000","last_clean":"2023-08-25T04:18:27.639521+0000","last_became_active":"2023-08-25T04:18:24.904999+0000","last_became_peered":"2023-08-25T04:18:24.904999+0000","last_unstale":"2023-08-25T04:18:27.639521+0000","last_undegraded":"2023-08-25T04:18:27.639521+0000","last_fullsized":"2023-08-25T04:18:27.639521+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:50:36.042403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639402+0000","last_change":"2023-08-25T04:18:25.644341+0000","last_active":"2023-08-25T04:18:27.639402+0000","last_peered":"2023-08-25T04:18:27.639402+0000","last_clean":"2023-08-25T04:18:27.639402+0000","last_became_active":"2023-08-25T04:18:25.644048+0000","last_became_peered":"2023-08-25T04:18:25.644048+0000","last_unstale":"2023-08-25T04:18:27.639402+0000","last_undegraded":"2023-08-25T04:18:27.639402+0000","last_fullsized":"2023-08-25T04:18:27.639402+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:05.098467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487663+0000","last_change":"2023-08-25T04:18:24.909744+0000","last_active":"2023-08-25T04:18:27.487663+0000","last_peered":"2023-08-25T04:18:27.487663+0000","last_clean":"2023-08-25T04:18:27.487663+0000","last_became_active":"2023-08-25T04:18:24.909442+0000","last_became_peered":"2023-08-25T04:18:24.909442+0000","last_unstale":"2023-08-25T04:18:27.487663+0000","last_undegraded":"2023-08-25T04:18:27.487663+0000","last_fullsized":"2023-08-25T04:18:27.487663+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:14.874672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621922+0000","last_change":"2023-08-25T04:18:25.633574+0000","last_active":"2023-08-25T04:18:26.621922+0000","last_peered":"2023-08-25T04:18:26.621922+0000","last_clean":"2023-08-25T04:18:26.621922+0000","last_became_active":"2023-08-25T04:18:25.633286+0000","last_became_peered":"2023-08-25T04:18:25.633286+0000","last_unstale":"2023-08-25T04:18:26.621922+0000","last_undegraded":"2023-08-25T04:18:26.621922+0000","last_fullsized":"2023-08-25T04:18:26.621922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:18:52.114025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988136+0000","last_change":"2023-08-25T04:18:24.898350+0000","last_active":"2023-08-25T04:18:27.988136+0000","last_peered":"2023-08-25T04:18:27.988136+0000","last_clean":"2023-08-25T04:18:27.988136+0000","last_became_active":"2023-08-25T04:18:24.898050+0000","last_became_peered":"2023-08-25T04:18:24.898050+0000","last_unstale":"2023-08-25T04:18:27.988136+0000","last_undegraded":"2023-08-25T04:18:27.988136+0000","last_fullsized":"2023-08-25T04:18:27.988136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:00:32.448501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621215+0000","last_change":"2023-08-25T04:18:25.626522+0000","last_active":"2023-08-25T04:18:26.621215+0000","last_peered":"2023-08-25T04:18:26.621215+0000","last_clean":"2023-08-25T04:18:26.621215+0000","last_became_active":"2023-08-25T04:18:25.626182+0000","last_became_peered":"2023-08-25T04:18:25.626182+0000","last_unstale":"2023-08-25T04:18:26.621215+0000","last_undegraded":"2023-08-25T04:18:26.621215+0000","last_fullsized":"2023-08-25T04:18:26.621215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:02:13.919466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354205+0000","last_change":"2023-08-25T04:18:24.905898+0000","last_active":"2023-08-25T04:18:27.354205+0000","last_peered":"2023-08-25T04:18:27.354205+0000","last_clean":"2023-08-25T04:18:27.354205+0000","last_became_active":"2023-08-25T04:18:24.905597+0000","last_became_peered":"2023-08-25T04:18:24.905597+0000","last_unstale":"2023-08-25T04:18:27.354205+0000","last_undegraded":"2023-08-25T04:18:27.354205+0000","last_fullsized":"2023-08-25T04:18:27.354205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:37:48.723022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621507+0000","last_change":"2023-08-25T04:18:25.647175+0000","last_active":"2023-08-25T04:18:26.621507+0000","last_peered":"2023-08-25T04:18:26.621507+0000","last_clean":"2023-08-25T04:18:26.621507+0000","last_became_active":"2023-08-25T04:18:25.646859+0000","last_became_peered":"2023-08-25T04:18:25.646859+0000","last_unstale":"2023-08-25T04:18:26.621507+0000","last_undegraded":"2023-08-25T04:18:26.621507+0000","last_fullsized":"2023-08-25T04:18:26.621507+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:15:55.660653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913503+0000","last_change":"2023-08-25T04:18:24.900266+0000","last_active":"2023-08-25T04:18:26.913503+0000","last_peered":"2023-08-25T04:18:26.913503+0000","last_clean":"2023-08-25T04:18:26.913503+0000","last_became_active":"2023-08-25T04:18:24.899965+0000","last_became_peered":"2023-08-25T04:18:24.899965+0000","last_unstale":"2023-08-25T04:18:26.913503+0000","last_undegraded":"2023-08-25T04:18:26.913503+0000","last_fullsized":"2023-08-25T04:18:26.913503+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:54:44.514535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.987839+0000","last_change":"2023-08-25T04:18:25.648384+0000","last_active":"2023-08-25T04:18:27.987839+0000","last_peered":"2023-08-25T04:18:27.987839+0000","last_clean":"2023-08-25T04:18:27.987839+0000","last_became_active":"2023-08-25T04:18:25.648109+0000","last_became_peered":"2023-08-25T04:18:25.648109+0000","last_unstale":"2023-08-25T04:18:27.987839+0000","last_undegraded":"2023-08-25T04:18:27.987839+0000","last_fullsized":"2023-08-25T04:18:27.987839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:19:11.163585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913358+0000","last_change":"2023-08-25T04:18:24.905945+0000","last_active":"2023-08-25T04:18:26.913358+0000","last_peered":"2023-08-25T04:18:26.913358+0000","last_clean":"2023-08-25T04:18:26.913358+0000","last_became_active":"2023-08-25T04:18:24.905484+0000","last_became_peered":"2023-08-25T04:18:24.905484+0000","last_unstale":"2023-08-25T04:18:26.913358+0000","last_undegraded":"2023-08-25T04:18:26.913358+0000","last_fullsized":"2023-08-25T04:18:26.913358+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:36:22.100902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.626386+0000","last_change":"2023-08-25T04:18:25.639545+0000","last_active":"2023-08-25T04:18:26.626386+0000","last_peered":"2023-08-25T04:18:26.626386+0000","last_clean":"2023-08-25T04:18:26.626386+0000","last_became_active":"2023-08-25T04:18:25.639248+0000","last_became_peered":"2023-08-25T04:18:25.639248+0000","last_unstale":"2023-08-25T04:18:26.626386+0000","last_undegraded":"2023-08-25T04:18:26.626386+0000","last_fullsized":"2023-08-25T04:18:26.626386+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:11:41.782870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.987676+0000","last_change":"2023-08-25T04:18:24.905989+0000","last_active":"2023-08-25T04:18:27.987676+0000","last_peered":"2023-08-25T04:18:27.987676+0000","last_clean":"2023-08-25T04:18:27.987676+0000","last_became_active":"2023-08-25T04:18:24.905715+0000","last_became_peered":"2023-08-25T04:18:24.905715+0000","last_unstale":"2023-08-25T04:18:27.987676+0000","last_undegraded":"2023-08-25T04:18:27.987676+0000","last_fullsized":"2023-08-25T04:18:27.987676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:29:59.564380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622177+0000","last_change":"2023-08-25T04:18:25.626744+0000","last_active":"2023-08-25T04:18:26.622177+0000","last_peered":"2023-08-25T04:18:26.622177+0000","last_clean":"2023-08-25T04:18:26.622177+0000","last_became_active":"2023-08-25T04:18:25.626420+0000","last_became_peered":"2023-08-25T04:18:25.626420+0000","last_unstale":"2023-08-25T04:18:26.622177+0000","last_undegraded":"2023-08-25T04:18:26.622177+0000","last_fullsized":"2023-08-25T04:18:26.622177+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:03.483804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913290+0000","last_change":"2023-08-25T04:18:24.902518+0000","last_active":"2023-08-25T04:18:26.913290+0000","last_peered":"2023-08-25T04:18:26.913290+0000","last_clean":"2023-08-25T04:18:26.913290+0000","last_became_active":"2023-08-25T04:18:24.901881+0000","last_became_peered":"2023-08-25T04:18:24.901881+0000","last_unstale":"2023-08-25T04:18:26.913290+0000","last_undegraded":"2023-08-25T04:18:26.913290+0000","last_fullsized":"2023-08-25T04:18:26.913290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:10:20.409803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"66'161","reported_seq":432,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354301+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:18:27.354301+0000","last_peered":"2023-08-25T04:18:27.354301+0000","last_clean":"2023-08-25T04:18:27.354301+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:18:27.354301+0000","last_undegraded":"2023-08-25T04:18:27.354301+0000","last_fullsized":"2023-08-25T04:18:27.354301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:00:56.156033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639548+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:18:27.639548+0000","last_peered":"2023-08-25T04:18:27.639548+0000","last_clean":"2023-08-25T04:18:27.639548+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:18:27.639548+0000","last_undegraded":"2023-08-25T04:18:27.639548+0000","last_fullsized":"2023-08-25T04:18:27.639548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:44:10.840769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487481+0000","last_change":"2023-08-25T04:18:25.646053+0000","last_active":"2023-08-25T04:18:27.487481+0000","last_peered":"2023-08-25T04:18:27.487481+0000","last_clean":"2023-08-25T04:18:27.487481+0000","last_became_active":"2023-08-25T04:18:25.645761+0000","last_became_peered":"2023-08-25T04:18:25.645761+0000","last_unstale":"2023-08-25T04:18:27.487481+0000","last_undegraded":"2023-08-25T04:18:27.487481+0000","last_fullsized":"2023-08-25T04:18:27.487481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:16:07.776812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"78'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487406+0000","last_change":"2023-08-25T04:18:24.904470+0000","last_active":"2023-08-25T04:18:27.487406+0000","last_peered":"2023-08-25T04:18:27.487406+0000","last_clean":"2023-08-25T04:18:27.487406+0000","last_became_active":"2023-08-25T04:18:24.904153+0000","last_became_peered":"2023-08-25T04:18:24.904153+0000","last_unstale":"2023-08-25T04:18:27.487406+0000","last_undegraded":"2023-08-25T04:18:27.487406+0000","last_fullsized":"2023-08-25T04:18:27.487406+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:54:42.997672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354106+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:18:27.354106+0000","last_peered":"2023-08-25T04:18:27.354106+0000","last_clean":"2023-08-25T04:18:27.354106+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:18:27.354106+0000","last_undegraded":"2023-08-25T04:18:27.354106+0000","last_fullsized":"2023-08-25T04:18:27.354106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:21:29.823766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639082+0000","last_change":"2023-08-25T04:18:25.634929+0000","last_active":"2023-08-25T04:18:27.639082+0000","last_peered":"2023-08-25T04:18:27.639082+0000","last_clean":"2023-08-25T04:18:27.639082+0000","last_became_active":"2023-08-25T04:18:25.634595+0000","last_became_peered":"2023-08-25T04:18:25.634595+0000","last_unstale":"2023-08-25T04:18:27.639082+0000","last_undegraded":"2023-08-25T04:18:27.639082+0000","last_fullsized":"2023-08-25T04:18:27.639082+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:38.444688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639270+0000","last_change":"2023-08-25T04:18:24.910073+0000","last_active":"2023-08-25T04:18:27.639270+0000","last_peered":"2023-08-25T04:18:27.639270+0000","last_clean":"2023-08-25T04:18:27.639270+0000","last_became_active":"2023-08-25T04:18:24.909786+0000","last_became_peered":"2023-08-25T04:18:24.909786+0000","last_unstale":"2023-08-25T04:18:27.639270+0000","last_undegraded":"2023-08-25T04:18:27.639270+0000","last_fullsized":"2023-08-25T04:18:27.639270+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:03:17.092706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.626273+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:18:26.626273+0000","last_peered":"2023-08-25T04:18:26.626273+0000","last_clean":"2023-08-25T04:18:26.626273+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:18:26.626273+0000","last_undegraded":"2023-08-25T04:18:26.626273+0000","last_fullsized":"2023-08-25T04:18:26.626273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:11:12.903416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621793+0000","last_change":"2023-08-25T04:18:25.639808+0000","last_active":"2023-08-25T04:18:26.621793+0000","last_peered":"2023-08-25T04:18:26.621793+0000","last_clean":"2023-08-25T04:18:26.621793+0000","last_became_active":"2023-08-25T04:18:25.639518+0000","last_became_peered":"2023-08-25T04:18:25.639518+0000","last_unstale":"2023-08-25T04:18:26.621793+0000","last_undegraded":"2023-08-25T04:18:26.621793+0000","last_fullsized":"2023-08-25T04:18:26.621793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:13:54.669554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487259+0000","last_change":"2023-08-25T04:18:24.905940+0000","last_active":"2023-08-25T04:18:27.487259+0000","last_peered":"2023-08-25T04:18:27.487259+0000","last_clean":"2023-08-25T04:18:27.487259+0000","last_became_active":"2023-08-25T04:18:24.905665+0000","last_became_peered":"2023-08-25T04:18:24.905665+0000","last_unstale":"2023-08-25T04:18:27.487259+0000","last_undegraded":"2023-08-25T04:18:27.487259+0000","last_fullsized":"2023-08-25T04:18:27.487259+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:55:40.771068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639453+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:18:27.639453+0000","last_peered":"2023-08-25T04:18:27.639453+0000","last_clean":"2023-08-25T04:18:27.639453+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:18:27.639453+0000","last_undegraded":"2023-08-25T04:18:27.639453+0000","last_fullsized":"2023-08-25T04:18:27.639453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:38:45.203164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354297+0000","last_change":"2023-08-25T04:18:25.650463+0000","last_active":"2023-08-25T04:18:27.354297+0000","last_peered":"2023-08-25T04:18:27.354297+0000","last_clean":"2023-08-25T04:18:27.354297+0000","last_became_active":"2023-08-25T04:18:25.650170+0000","last_became_peered":"2023-08-25T04:18:25.650170+0000","last_unstale":"2023-08-25T04:18:27.354297+0000","last_undegraded":"2023-08-25T04:18:27.354297+0000","last_fullsized":"2023-08-25T04:18:27.354297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:23:22.942225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639460+0000","last_change":"2023-08-25T04:18:24.910069+0000","last_active":"2023-08-25T04:18:27.639460+0000","last_peered":"2023-08-25T04:18:27.639460+0000","last_clean":"2023-08-25T04:18:27.639460+0000","last_became_active":"2023-08-25T04:18:24.909746+0000","last_became_peered":"2023-08-25T04:18:24.909746+0000","last_unstale":"2023-08-25T04:18:27.639460+0000","last_undegraded":"2023-08-25T04:18:27.639460+0000","last_fullsized":"2023-08-25T04:18:27.639460+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:40.105378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988154+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:18:27.988154+0000","last_peered":"2023-08-25T04:18:27.988154+0000","last_clean":"2023-08-25T04:18:27.988154+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:18:27.988154+0000","last_undegraded":"2023-08-25T04:18:27.988154+0000","last_fullsized":"2023-08-25T04:18:27.988154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:41.775519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622270+0000","last_change":"2023-08-25T04:18:25.650779+0000","last_active":"2023-08-25T04:18:26.622270+0000","last_peered":"2023-08-25T04:18:26.622270+0000","last_clean":"2023-08-25T04:18:26.622270+0000","last_became_active":"2023-08-25T04:18:25.650503+0000","last_became_peered":"2023-08-25T04:18:25.650503+0000","last_unstale":"2023-08-25T04:18:26.622270+0000","last_undegraded":"2023-08-25T04:18:26.622270+0000","last_fullsized":"2023-08-25T04:18:26.622270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:58:44.797135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"78'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354588+0000","last_change":"2023-08-25T04:18:24.907797+0000","last_active":"2023-08-25T04:18:27.354588+0000","last_peered":"2023-08-25T04:18:27.354588+0000","last_clean":"2023-08-25T04:18:27.354588+0000","last_became_active":"2023-08-25T04:18:24.907495+0000","last_became_peered":"2023-08-25T04:18:24.907495+0000","last_unstale":"2023-08-25T04:18:27.354588+0000","last_undegraded":"2023-08-25T04:18:27.354588+0000","last_fullsized":"2023-08-25T04:18:27.354588+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:28:01.606160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354446+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:18:27.354446+0000","last_peered":"2023-08-25T04:18:27.354446+0000","last_clean":"2023-08-25T04:18:27.354446+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:18:27.354446+0000","last_undegraded":"2023-08-25T04:18:27.354446+0000","last_fullsized":"2023-08-25T04:18:27.354446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:24:39.830576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621610+0000","last_change":"2023-08-25T04:18:25.646451+0000","last_active":"2023-08-25T04:18:26.621610+0000","last_peered":"2023-08-25T04:18:26.621610+0000","last_clean":"2023-08-25T04:18:26.621610+0000","last_became_active":"2023-08-25T04:18:25.646172+0000","last_became_peered":"2023-08-25T04:18:25.646172+0000","last_unstale":"2023-08-25T04:18:26.621610+0000","last_undegraded":"2023-08-25T04:18:26.621610+0000","last_fullsized":"2023-08-25T04:18:26.621610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:12:16.190797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354255+0000","last_change":"2023-08-25T04:18:24.910218+0000","last_active":"2023-08-25T04:18:27.354255+0000","last_peered":"2023-08-25T04:18:27.354255+0000","last_clean":"2023-08-25T04:18:27.354255+0000","last_became_active":"2023-08-25T04:18:24.909932+0000","last_became_peered":"2023-08-25T04:18:24.909932+0000","last_unstale":"2023-08-25T04:18:27.354255+0000","last_undegraded":"2023-08-25T04:18:27.354255+0000","last_fullsized":"2023-08-25T04:18:27.354255+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:47:06.078944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988138+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:18:27.988138+0000","last_peered":"2023-08-25T04:18:27.988138+0000","last_clean":"2023-08-25T04:18:27.988138+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:18:27.988138+0000","last_undegraded":"2023-08-25T04:18:27.988138+0000","last_fullsized":"2023-08-25T04:18:27.988138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:19:52.647328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622400+0000","last_change":"2023-08-25T04:18:25.631264+0000","last_active":"2023-08-25T04:18:26.622400+0000","last_peered":"2023-08-25T04:18:26.622400+0000","last_clean":"2023-08-25T04:18:26.622400+0000","last_became_active":"2023-08-25T04:18:25.630918+0000","last_became_peered":"2023-08-25T04:18:25.630918+0000","last_unstale":"2023-08-25T04:18:26.622400+0000","last_undegraded":"2023-08-25T04:18:26.622400+0000","last_fullsized":"2023-08-25T04:18:26.622400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:57:21.375228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913607+0000","last_change":"2023-08-25T04:18:24.904317+0000","last_active":"2023-08-25T04:18:26.913607+0000","last_peered":"2023-08-25T04:18:26.913607+0000","last_clean":"2023-08-25T04:18:26.913607+0000","last_became_active":"2023-08-25T04:18:24.904026+0000","last_became_peered":"2023-08-25T04:18:24.904026+0000","last_unstale":"2023-08-25T04:18:26.913607+0000","last_undegraded":"2023-08-25T04:18:26.913607+0000","last_fullsized":"2023-08-25T04:18:26.913607+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:27:00.804890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622101+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:18:26.622101+0000","last_peered":"2023-08-25T04:18:26.622101+0000","last_clean":"2023-08-25T04:18:26.622101+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:18:26.622101+0000","last_undegraded":"2023-08-25T04:18:26.622101+0000","last_fullsized":"2023-08-25T04:18:26.622101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:07:18.885053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509630,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46588,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325252,"statfs":{"total":96636764160,"available":96589058048,"internally_reserved":0,"allocated":1556480,"data_stored":1054859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.45200000000000001,"5min":0.39600000000000002,"15min":0.29199999999999998},"max":{"1min":0.88800000000000001,"5min":0.996,"15min":1.0189999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.80400000000000005}]},{"osd":1,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.42699999999999999},"max":{"1min":0.88,"5min":1.0149999999999999,"15min":1.034},"last":0.749},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.47099999999999997,"5min":0.44700000000000001,"15min":0.374},"max":{"1min":0.89600000000000002,"5min":0.96099999999999997,"15min":1.036},"last":0.83599999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51700000000000002,"5min":0.42299999999999999,"15min":0.34899999999999998},"max":{"1min":0.94299999999999995,"5min":0.94499999999999995,"15min":1.018},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.54400000000000004,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":0.92300000000000004,"5min":0.98699999999999999,"15min":0.999},"last":0.86399999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.55000000000000004,"5min":0.47799999999999998,"15min":0.41899999999999998},"max":{"1min":0.90100000000000002,"5min":0.92900000000000005,"15min":0.98399999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.754,"15min":0.75600000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.432},"max":{"1min":1.012,"5min":1.04,"15min":1.0449999999999999},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41599999999999998,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.82599999999999996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.623},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":0.90400000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.60199999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60799999999999998,"15min":0.61899999999999999},"min":{"1min":0.46300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.96799999999999997,"5min":0.99199999999999999,"15min":0.998},"last":0.502},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.48699999999999999,"5min":0.41099999999999998,"15min":0.40000000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.0349999999999999},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.436},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.0620000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42399999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.77000000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509630,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36276,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":950272,"data_stored":463749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68600000000000005,"15min":0.70699999999999996},"min":{"1min":0.46300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97599999999999998,"5min":1.0089999999999999,"15min":1.0369999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68500000000000005,"15min":0.69799999999999995},"min":{"1min":0.46800000000000003,"5min":0.40400000000000003,"15min":0.33800000000000002},"max":{"1min":0.91900000000000004,"5min":0.96899999999999997,"15min":1.071},"last":0.32300000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.73099999999999998},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.1559999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.59699999999999998,"5min":0.495,"15min":0.47199999999999998},"max":{"1min":0.93500000000000005,"5min":0.996,"15min":1.077},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.47999999999999998,"5min":0.44,"15min":0.434},"max":{"1min":0.95199999999999996,"5min":0.98399999999999999,"15min":1.139},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.56299999999999994,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96099999999999997,"5min":1.0569999999999999,"15min":1.117},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.50600000000000001,"15min":0.46899999999999997},"max":{"1min":0.93400000000000005,"5min":1.0600000000000001,"15min":1.077},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90900000000000003,"5min":1.075,"15min":1.679},"last":0.55500000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.60099999999999998},"min":{"1min":0.42999999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93000000000000005,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":0.86799999999999999,"5min":0.92900000000000005,"15min":1.306},"last":0.56799999999999995}]},{"osd":5,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.56999999999999995,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":1.1120000000000001,"15min":1.5589999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.65300000000000002,"15min":0.66600000000000004},"min":{"1min":0.51400000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86699999999999999,"5min":1.032,"15min":1.1950000000000001},"last":0.441},{"interface":"front","average":{"1min":0.753,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.48799999999999999,"5min":0.44700000000000001,"15min":0.41799999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.4099999999999999},"last":0.625}]}]},{"osd":5,"up_from":14,"seq":60129542333,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":950272,"data_stored":463737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68200000000000005,"15min":0.70999999999999996},"min":{"1min":0.55800000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88500000000000001,"5min":0.94999999999999996,"15min":1.018},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.57499999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86699999999999999,"5min":0.995,"15min":1.0409999999999999},"last":0.78200000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72299999999999998,"15min":0.73699999999999999},"min":{"1min":0.52100000000000002,"5min":0.43099999999999999,"15min":0.36499999999999999},"max":{"1min":0.878,"5min":0.98699999999999999,"15min":0.99399999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.56899999999999995,"5min":0.47599999999999998,"15min":0.46200000000000002},"max":{"1min":0.90400000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.90300000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.42999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88500000000000001,"5min":0.97499999999999998,"15min":1.0269999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.55300000000000005,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.2290000000000001},"last":0.82999999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.59199999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92100000000000004,"5min":0.94199999999999995,"15min":1.4590000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.76600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.018,"15min":1.1479999999999999},"last":0.93700000000000006}]},{"osd":4,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.67000000000000004,"5min":0.97099999999999997,"15min":1.038},"last":0.443},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.79600000000000004,"5min":1.018,"15min":1.018},"last":0.47699999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.48299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":1.256},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.50800000000000001,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":0.90400000000000003,"5min":0.98299999999999998,"15min":1.4650000000000001},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61199999999999999,"15min":0.626},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.90900000000000003,"5min":1.002,"15min":1.2769999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69299999999999995,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":0.80000000000000004,"5min":0.96899999999999997,"15min":1.1819999999999999},"last":0.64000000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542333,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36288,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335552,"statfs":{"total":96636764160,"available":96599605248,"internally_reserved":0,"allocated":958464,"data_stored":465327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":0.70599999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.86599999999999999,"5min":0.99299999999999999,"15min":1.2649999999999999},"last":0.503},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.45500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85199999999999998,"5min":0.878,"15min":1.1639999999999999},"last":0.61599999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.45400000000000001,"5min":0.45100000000000001,"15min":0.36199999999999999},"max":{"1min":0.98399999999999999,"5min":1.0189999999999999,"15min":1.0449999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.47199999999999998,"15min":0.39100000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.74399999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.34000000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.66300000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.45100000000000001},"max":{"1min":0.91100000000000003,"5min":0.98299999999999998,"15min":1.048},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.76300000000000001,"15min":0.75900000000000001},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.48399999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38300000000000001,"5min":0.378,"15min":0.32200000000000001},"max":{"1min":0.77900000000000003,"5min":0.94799999999999995,"15min":0.94899999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.376,"15min":0.33200000000000002},"max":{"1min":0.81799999999999995,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.92800000000000005,"5min":1.093,"15min":1.093},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.40300000000000002},"max":{"1min":0.871,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.63400000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.441,"5min":0.435,"15min":0.36699999999999999},"max":{"1min":0.78700000000000003,"5min":0.90100000000000002,"15min":1.0609999999999999},"last":0.441},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69199999999999995,"15min":0.70399999999999996},"min":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.39300000000000002},"max":{"1min":0.92400000000000004,"5min":0.99399999999999999,"15min":1.0940000000000001},"last":0.64300000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542333,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335572,"statfs":{"total":96636764160,"available":96599625728,"internally_reserved":0,"allocated":946176,"data_stored":463715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.313,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.67200000000000004,"5min":0.93700000000000006,"15min":0.96899999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.70799999999999996,"5min":0.77100000000000002,"15min":0.91500000000000004},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.36599999999999999,"5min":0.32800000000000001,"15min":0.27000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.746},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.59499999999999997},"min":{"1min":0.41499999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80300000000000005,"5min":0.83099999999999996,"15min":0.92600000000000005},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":1.01},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.35299999999999998},"max":{"1min":0.72899999999999998,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.63100000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1719999999999999,"5min":1.214,"15min":1.4339999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.64200000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98599999999999999,"5min":1.2450000000000001,"15min":1.343},"last":1.0760000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56899999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0549999999999999,"5min":1.254,"15min":1.321},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":1.0900000000000001,"5min":1.1950000000000001,"15min":1.4750000000000001},"last":0.99099999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81000000000000005,"15min":0.80700000000000005},"min":{"1min":0.55800000000000005,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":1.077,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.119},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.61699999999999999,"5min":0.51600000000000001,"15min":0.50700000000000001},"max":{"1min":0.99299999999999999,"5min":1.0800000000000001,"15min":1.3600000000000001},"last":0.94699999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.68100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.042,"5min":1.077,"15min":1.383},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80600000000000005,"15min":0.79900000000000004},"min":{"1min":0.66200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.016,"5min":1.079,"15min":1.4019999999999999},"last":1.0049999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542334,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54320,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317520,"statfs":{"total":96636764160,"available":96581140480,"internally_reserved":0,"allocated":946176,"data_stored":463715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.378,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.65100000000000002,"5min":0.85599999999999998,"15min":1.196},"last":0.438},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.504,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68700000000000006,"5min":0.81000000000000005,"15min":1.4019999999999999},"last":0.27500000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48599999999999999,"15min":0.48899999999999999},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.69999999999999996,"5min":0.78800000000000003,"15min":1.482},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59599999999999997,"15min":0.60099999999999998},"min":{"1min":0.46100000000000002,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":1.458},"last":0.40999999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.34499999999999997},"max":{"1min":0.80300000000000005,"5min":0.82199999999999995,"15min":0.82299999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.40899999999999997,"5min":0.375,"15min":0.33700000000000002},"max":{"1min":0.751,"5min":0.85399999999999998,"15min":0.95599999999999996},"last":0.34499999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.80400000000000005,"15min":0.80100000000000005},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.499},"max":{"1min":0.98399999999999999,"5min":1.1990000000000001,"15min":1.2569999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.79000000000000004},"min":{"1min":0.51800000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0069999999999999,"5min":1.151,"15min":1.5509999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.80800000000000005,"15min":0.80400000000000005},"min":{"1min":0.63300000000000001,"5min":0.52600000000000002,"15min":0.47999999999999998},"max":{"1min":0.995,"5min":1.1140000000000001,"15min":1.2789999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.48299999999999998},"max":{"1min":1.02,"5min":1.2130000000000001,"15min":1.3089999999999999},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.93100000000000005,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85799999999999998,"15min":0.85699999999999998},"min":{"1min":0.68500000000000005,"5min":0.58799999999999997,"15min":0.55600000000000005},"max":{"1min":1.014,"5min":1.25,"15min":1.375},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81100000000000005,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":0.99199999999999999,"5min":1.2090000000000001,"15min":1.339},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81599999999999995,"15min":0.81299999999999994},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0149999999999999,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.58599999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542334,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36292,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335548,"statfs":{"total":96636764160,"available":96599601152,"internally_reserved":0,"allocated":974848,"data_stored":466091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.46300000000000002},"min":{"1min":0.27800000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66500000000000004,"5min":0.85599999999999998,"15min":1.218},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56299999999999994,"15min":0.52600000000000002},"min":{"1min":0.374,"5min":0.33200000000000002,"15min":0.29499999999999998},"max":{"1min":0.85099999999999998,"5min":1.212,"15min":1.212},"last":0.67400000000000004}]},{"osd":2,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51500000000000001,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66300000000000003,"5min":0.876,"15min":1.347},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":1.093},"last":0.63900000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.41599999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.74099999999999999,"5min":0.93100000000000005,"15min":1.1459999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.34699999999999998,"5min":0.34599999999999997,"15min":0.33200000000000002},"max":{"1min":0.84299999999999997,"5min":1.165,"15min":1.2190000000000001},"last":0.60299999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":1.004,"5min":1.204,"15min":1.47},"last":1.012},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.80300000000000005,"15min":0.81100000000000005},"min":{"1min":0.60399999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.0269999999999999,"5min":1.2529999999999999,"15min":1.395},"last":0.88}]},{"osd":5,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.45100000000000001},"max":{"1min":0.96499999999999997,"5min":1.254,"15min":1.292},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81299999999999994,"15min":0.81499999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51000000000000001},"max":{"1min":1.044,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.93300000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.70099999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.171,"5min":1.623,"15min":1.623},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82199999999999995,"15min":0.80600000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.54200000000000004},"max":{"1min":1.01,"5min":1.288,"15min":1.355},"last":0.89800000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.57399999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0760000000000001,"5min":1.1240000000000001,"15min":1.5429999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.63400000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.073,"5min":1.1140000000000001,"15min":1.504},"last":1}]}]},{"osd":0,"up_from":14,"seq":60129542333,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36852,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334988,"statfs":{"total":96636764160,"available":96599027712,"internally_reserved":0,"allocated":1540096,"data_stored":1054083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.501,"15min":0.48899999999999999},"min":{"1min":0.30399999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67700000000000005,"5min":0.72499999999999998,"15min":0.79500000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.68400000000000005,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70099999999999996,"5min":0.82299999999999995,"15min":0.97499999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55500000000000005,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":0.876,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48899999999999999,"15min":0.499},"min":{"1min":0.36299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.266},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.45600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76800000000000002,"5min":0.85099999999999998,"15min":1.2470000000000001},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.79900000000000004},"min":{"1min":0.60799999999999998,"5min":0.52600000000000002,"15min":0.503},"max":{"1min":1.048,"5min":1.1739999999999999,"15min":1.306},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.58699999999999997,"5min":0.497,"15min":0.436},"max":{"1min":1.169,"5min":1.169,"15min":1.262},"last":0.73299999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81499999999999995,"15min":0.80500000000000005},"min":{"1min":0.57499999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.131,"5min":3.528,"15min":3.528},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.53000000000000003,"5min":0.47199999999999998,"15min":0.45500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.373},"last":0.752}]},{"osd":6,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81699999999999995,"15min":0.80600000000000005},"min":{"1min":0.60599999999999998,"5min":0.54400000000000004,"15min":0.53000000000000003},"max":{"1min":1.0680000000000001,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60999999999999999,"5min":0.52700000000000002,"15min":0.47399999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.331},"last":0.877}]},{"osd":7,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83799999999999997,"15min":0.84699999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.52900000000000003},"max":{"1min":1.151,"5min":1.151,"15min":1.4059999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.64600000000000002,"5min":0.53200000000000003,"15min":0.499},"max":{"1min":1.0940000000000001,"5min":1.1220000000000001,"15min":1.3169999999999999},"last":0.76900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:18:30.804 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-25T04:18:30.809 INFO:tasks.ceph.mds.a.smithi055.stderr:2023-08-25T04:18:30.810+0000 7fd16fafb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T04:18:30.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.954+0000 7ff86fc5c640 1 Processor -- start 2023-08-25T04:18:30.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.954+0000 7ff86fc5c640 1 -- start start 2023-08-25T04:18:30.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.954+0000 7ff86fc5c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff868160a50 0x7ff868160e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.954+0000 7ff86fc5c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff8680c1ad0 0x7ff8680b2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.954+0000 7ff86fc5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8680b1aa0 con 0x7ff8680b1f30 2023-08-25T04:18:30.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.954+0000 7ff86fc5c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8680b1240 con 0x7ff868160a50 2023-08-25T04:18:30.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.954+0000 7ff86fc5c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8680cbaf0 con 0x7ff8680c1ad0 2023-08-25T04:18:30.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.954+0000 7ff86d9f8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff868160a50 0x7ff868160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.954+0000 7ff86d1f7640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff8680b1f30 0x7ff8680c13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44492/0 (socket says 172.21.15.55:44492) 2023-08-25T04:18:30.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.954+0000 7ff86d1f7640 1 -- 172.21.15.55:0/638163541 learned_addr learned my addr 172.21.15.55:0/638163541 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:30.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.954+0000 7ff86e1f9640 1 --2- 172.21.15.55:0/638163541 >> v2:172.21.15.110:3300/0 conn(0x7ff8680c1ad0 0x7ff8680b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.958+0000 7ff86d9f8640 1 -- 172.21.15.55:0/638163541 >> v2:172.21.15.110:3300/0 conn(0x7ff8680c1ad0 msgr2=0x7ff8680b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:30.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.958+0000 7ff86d9f8640 1 --2- 172.21.15.55:0/638163541 >> v2:172.21.15.110:3300/0 conn(0x7ff8680c1ad0 0x7ff8680b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.958+0000 7ff86d9f8640 1 -- 172.21.15.55:0/638163541 >> v1:172.21.15.55:6789/0 conn(0x7ff8680b1f30 legacy=0x7ff8680c13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:30.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.958+0000 7ff86d9f8640 1 -- 172.21.15.55:0/638163541 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8680b1450 con 0x7ff868160a50 2023-08-25T04:18:30.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.958+0000 7ff86c9f6640 1 -- 172.21.15.55:0/638163541 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308059610 0 0) 0x7ff8680b1aa0 con 0x7ff8680b1f30 2023-08-25T04:18:30.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.958+0000 7ff86d9f8640 1 --2- 172.21.15.55:0/638163541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff868160a50 0x7ff868160e30 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ff8680b1a10 tx=0x7ff86401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db710d35c873e531 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:30.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.958+0000 7ff86c9f6640 1 -- 172.21.15.55:0/638163541 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8640ab650 con 0x7ff868160a50 2023-08-25T04:18:30.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.958+0000 7ff86c9f6640 1 -- 172.21.15.55:0/638163541 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8640ab7b0 con 0x7ff868160a50 2023-08-25T04:18:30.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.958+0000 7ff86c9f6640 1 -- 172.21.15.55:0/638163541 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8640abb40 con 0x7ff868160a50 2023-08-25T04:18:30.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.958+0000 7ff86fc5c640 1 -- 172.21.15.55:0/638163541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff868160a50 msgr2=0x7ff868160e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:30.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.958+0000 7ff86fc5c640 1 --2- 172.21.15.55:0/638163541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff868160a50 0x7ff868160e30 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ff8680b1a10 tx=0x7ff86401c430 comp rx=0 tx=0).stop 2023-08-25T04:18:30.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.958+0000 7ff86fc5c640 1 -- 172.21.15.55:0/638163541 shutdown_connections 2023-08-25T04:18:30.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.958+0000 7ff86fc5c640 1 --2- 172.21.15.55:0/638163541 >> v2:172.21.15.110:3300/0 conn(0x7ff8680c1ad0 0x7ff8680b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.958+0000 7ff86fc5c640 1 --2- 172.21.15.55:0/638163541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff868160a50 0x7ff868160e30 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.958+0000 7ff86fc5c640 1 -- 172.21.15.55:0/638163541 >> 172.21.15.55:0/638163541 conn(0x7ff8680ce7f0 msgr2=0x7ff8680cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:30.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86fc5c640 1 -- 172.21.15.55:0/638163541 shutdown_connections 2023-08-25T04:18:30.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86fc5c640 1 -- 172.21.15.55:0/638163541 wait complete. 2023-08-25T04:18:30.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86fc5c640 1 Processor -- start 2023-08-25T04:18:30.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86fc5c640 1 -- start start 2023-08-25T04:18:30.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86fc5c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8680b1f30 0x7ff868158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86fc5c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8680c1ad0 0x7ff868163580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86fc5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff868160a50 0x7ff868163ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86fc5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8680c6080 con 0x7ff868160a50 2023-08-25T04:18:30.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86fc5c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8680c6360 con 0x7ff8680b1f30 2023-08-25T04:18:30.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86fc5c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8680c6640 con 0x7ff8680c1ad0 2023-08-25T04:18:30.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86e1f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff868160a50 0x7ff868163ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86e1f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff868160a50 0x7ff868163ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45258/0 (socket says 172.21.15.55:45258) 2023-08-25T04:18:30.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86e1f9640 1 -- 172.21.15.55:0/3171396045 learned_addr learned my addr 172.21.15.55:0/3171396045 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:30.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86d9f8640 1 --2- 172.21.15.55:0/3171396045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8680b1f30 0x7ff868158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86d1f7640 1 --2- 172.21.15.55:0/3171396045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8680c1ad0 0x7ff868163580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86e1f9640 1 -- 172.21.15.55:0/3171396045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8680c1ad0 msgr2=0x7ff868163580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:30.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86e1f9640 1 --2- 172.21.15.55:0/3171396045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8680c1ad0 0x7ff868163580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86e1f9640 1 -- 172.21.15.55:0/3171396045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8680b1f30 msgr2=0x7ff868158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:30.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86e1f9640 1 --2- 172.21.15.55:0/3171396045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8680b1f30 0x7ff868158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:30.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86e1f9640 1 -- 172.21.15.55:0/3171396045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff864009420 con 0x7ff868160a50 2023-08-25T04:18:30.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86e1f9640 1 --2- 172.21.15.55:0/3171396045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff868160a50 0x7ff868163ac0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff860007e40 tx=0x7ff86000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:30.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff85e7fc640 1 -- 172.21.15.55:0/3171396045 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff860014620 con 0x7ff868160a50 2023-08-25T04:18:30.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff85e7fc640 1 -- 172.21.15.55:0/3171396045 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86000ee90 con 0x7ff868160a50 2023-08-25T04:18:30.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff85e7fc640 1 -- 172.21.15.55:0/3171396045 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8600149e0 con 0x7ff868160a50 2023-08-25T04:18:30.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.962+0000 7ff86fc5c640 1 -- 172.21.15.55:0/3171396045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8680c6920 con 0x7ff868160a50 2023-08-25T04:18:30.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.966+0000 7ff86fc5c640 1 -- 172.21.15.55:0/3171396045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8681593a0 con 0x7ff868160a50 2023-08-25T04:18:30.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.966+0000 7ff86fc5c640 1 -- 172.21.15.55:0/3171396045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8680661b0 con 0x7ff868160a50 2023-08-25T04:18:30.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.966+0000 7ff85e7fc640 1 -- 172.21.15.55:0/3171396045 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7ff860014b40 con 0x7ff868160a50 2023-08-25T04:18:30.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.966+0000 7ff85e7fc640 1 --2- 172.21.15.55:0/3171396045 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7ff84c0657a0 0x7ff84c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:30.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.966+0000 7ff85e7fc640 1 -- 172.21.15.55:0/3171396045 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff860083970 con 0x7ff868160a50 2023-08-25T04:18:30.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.966+0000 7ff86d9f8640 1 --2- 172.21.15.55:0/3171396045 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7ff84c0657a0 0x7ff84c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:30.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.970+0000 7ff86d9f8640 1 --2- 172.21.15.55:0/3171396045 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7ff84c0657a0 0x7ff84c067c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff8640af000 tx=0x7ff8640a7000 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:30.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:30.970+0000 7ff85e7fc640 1 -- 172.21.15.55:0/3171396045 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff8600512a0 con 0x7ff868160a50 2023-08-25T04:18:31.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.186+0000 7ff86fc5c640 1 -- 172.21.15.55:0/3171396045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff8680c1f20 con 0x7ff868160a50 2023-08-25T04:18:31.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.186+0000 7ff85e7fc640 1 -- 172.21.15.55:0/3171396045 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3209 (secure 0 0 0) 0x7ff8680c1f20 con 0x7ff868160a50 2023-08-25T04:18:31.184 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:31.184 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":955,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":79,"num_osds":8,"num_up_osds":8,"osd_up_since":1692936167,"num_in_osds":8,"osd_in_since":1692936158,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592778,"bytes_used":322555904,"bytes_avail":772771557376,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":32,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6780}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-08-25T04:18:12.541524+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-25T04:18:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.186+0000 7ff86fc5c640 1 -- 172.21.15.55:0/3171396045 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7ff84c0657a0 msgr2=0x7ff84c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.186+0000 7ff86fc5c640 1 --2- 172.21.15.55:0/3171396045 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7ff84c0657a0 0x7ff84c067c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff8640af000 tx=0x7ff8640a7000 comp rx=0 tx=0).stop 2023-08-25T04:18:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.186+0000 7ff86fc5c640 1 -- 172.21.15.55:0/3171396045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff868160a50 msgr2=0x7ff868163ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.186+0000 7ff86fc5c640 1 --2- 172.21.15.55:0/3171396045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff868160a50 0x7ff868163ac0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff860007e40 tx=0x7ff86000e4b0 comp rx=0 tx=0).stop 2023-08-25T04:18:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.186+0000 7ff86fc5c640 1 -- 172.21.15.55:0/3171396045 shutdown_connections 2023-08-25T04:18:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.186+0000 7ff86fc5c640 1 --2- 172.21.15.55:0/3171396045 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7ff84c0657a0 0x7ff84c067c60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.186+0000 7ff86fc5c640 1 --2- 172.21.15.55:0/3171396045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff868160a50 0x7ff868163ac0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.186+0000 7ff86fc5c640 1 --2- 172.21.15.55:0/3171396045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8680c1ad0 0x7ff868163580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:31.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.186+0000 7ff86fc5c640 1 --2- 172.21.15.55:0/3171396045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8680b1f30 0x7ff868158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:31.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.186+0000 7ff86fc5c640 1 -- 172.21.15.55:0/3171396045 >> 172.21.15.55:0/3171396045 conn(0x7ff8680ce7f0 msgr2=0x7ff8680c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:31.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.186+0000 7ff86fc5c640 1 -- 172.21.15.55:0/3171396045 shutdown_connections 2023-08-25T04:18:31.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.186+0000 7ff86fc5c640 1 -- 172.21.15.55:0/3171396045 wait complete. 2023-08-25T04:18:31.204 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-25T04:18:31.205 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:18:31.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.350+0000 7f16873ac640 1 Processor -- start 2023-08-25T04:18:31.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.350+0000 7f16873ac640 1 -- start start 2023-08-25T04:18:31.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.350+0000 7f16873ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1680164410 0x7f16800b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:31.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.350+0000 7f16873ac640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f16800cddf0 0x7f16800c1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:31.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.350+0000 7f16873ac640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16800cc510 con 0x7f16800c18b0 2023-08-25T04:18:31.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.350+0000 7f16873ac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16800c1d20 con 0x7f1680164410 2023-08-25T04:18:31.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.350+0000 7f16873ac640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16801647f0 con 0x7f16800cddf0 2023-08-25T04:18:31.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.350+0000 7f1685148640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1680164410 0x7f16800b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:31.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.350+0000 7f1685148640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1680164410 0x7f16800b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45266/0 (socket says 172.21.15.55:45266) 2023-08-25T04:18:31.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.350+0000 7f1685148640 1 -- 172.21.15.55:0/1723019006 learned_addr learned my addr 172.21.15.55:0/1723019006 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:31.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.354+0000 7f1685148640 1 -- 172.21.15.55:0/1723019006 >> v2:172.21.15.110:3300/0 conn(0x7f16800cddf0 msgr2=0x7f16800c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:31.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.354+0000 7f1684947640 1 --2- 172.21.15.55:0/1723019006 >> v2:172.21.15.110:3300/0 conn(0x7f16800cddf0 0x7f16800c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:31.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.354+0000 7f1685148640 1 --2- 172.21.15.55:0/1723019006 >> v2:172.21.15.110:3300/0 conn(0x7f16800cddf0 0x7f16800c1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:31.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.354+0000 7f1685148640 1 -- 172.21.15.55:0/1723019006 >> v1:172.21.15.110:6789/0 conn(0x7f16800c18b0 legacy=0x7f16800cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:31.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.354+0000 7f1685148640 1 -- 172.21.15.55:0/1723019006 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16800cc9b0 con 0x7f1680164410 2023-08-25T04:18:31.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.354+0000 7f1684947640 1 --2- 172.21.15.55:0/1723019006 >> v2:172.21.15.110:3300/0 conn(0x7f16800cddf0 0x7f16800c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:31.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.354+0000 7f1685148640 1 --2- 172.21.15.55:0/1723019006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1680164410 0x7f16800b21b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f16800cbe80 tx=0x7f167c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec232f914386b744 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:31.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.354+0000 7f1677fff640 1 -- 172.21.15.55:0/1723019006 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c0ab600 con 0x7f1680164410 2023-08-25T04:18:31.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.354+0000 7f1677fff640 1 -- 172.21.15.55:0/1723019006 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167c0a7050 con 0x7f1680164410 2023-08-25T04:18:31.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.354+0000 7f1677fff640 1 -- 172.21.15.55:0/1723019006 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c0ab980 con 0x7f1680164410 2023-08-25T04:18:31.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.354+0000 7f16873ac640 1 -- 172.21.15.55:0/1723019006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1680164410 msgr2=0x7f16800b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:31.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.354+0000 7f16873ac640 1 --2- 172.21.15.55:0/1723019006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1680164410 0x7f16800b21b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f16800cbe80 tx=0x7f167c01c4c0 comp rx=0 tx=0).stop 2023-08-25T04:18:31.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.354+0000 7f16873ac640 1 -- 172.21.15.55:0/1723019006 shutdown_connections 2023-08-25T04:18:31.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.354+0000 7f16873ac640 1 --2- 172.21.15.55:0/1723019006 >> v2:172.21.15.110:3300/0 conn(0x7f16800cddf0 0x7f16800c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:31.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.354+0000 7f16873ac640 1 --2- 172.21.15.55:0/1723019006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1680164410 0x7f16800b21b0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:31.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.354+0000 7f16873ac640 1 -- 172.21.15.55:0/1723019006 >> 172.21.15.55:0/1723019006 conn(0x7f1680069d00 msgr2=0x7f168006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:31.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f16873ac640 1 -- 172.21.15.55:0/1723019006 shutdown_connections 2023-08-25T04:18:31.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f16873ac640 1 -- 172.21.15.55:0/1723019006 wait complete. 2023-08-25T04:18:31.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f16873ac640 1 Processor -- start 2023-08-25T04:18:31.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f16873ac640 1 -- start start 2023-08-25T04:18:31.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f16873ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16800c18b0 0x7f16800c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:31.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f16873ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16800cddf0 0x7f16800b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:31.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f16873ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1680164410 0x7f168015d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:31.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f16873ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16800c28d0 con 0x7f16800cddf0 2023-08-25T04:18:31.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f16873ac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16800c2bb0 con 0x7f1680164410 2023-08-25T04:18:31.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f16873ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16800c2e90 con 0x7f16800c18b0 2023-08-25T04:18:31.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f1684947640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16800cddf0 0x7f16800b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:31.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f1684947640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16800cddf0 0x7f16800b1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45274/0 (socket says 172.21.15.55:45274) 2023-08-25T04:18:31.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f1684947640 1 -- 172.21.15.55:0/649645134 learned_addr learned my addr 172.21.15.55:0/649645134 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:31.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f1685148640 1 --2- 172.21.15.55:0/649645134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16800c18b0 0x7f16800c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:31.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f1685949640 1 --2- 172.21.15.55:0/649645134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1680164410 0x7f168015d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:31.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f1684947640 1 -- 172.21.15.55:0/649645134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16800c18b0 msgr2=0x7f16800c1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:31.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f1684947640 1 --2- 172.21.15.55:0/649645134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16800c18b0 0x7f16800c1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:31.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f1684947640 1 -- 172.21.15.55:0/649645134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1680164410 msgr2=0x7f168015d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:31.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f1684947640 1 --2- 172.21.15.55:0/649645134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1680164410 0x7f168015d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:31.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f1684947640 1 -- 172.21.15.55:0/649645134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167c0094d0 con 0x7f16800cddf0 2023-08-25T04:18:31.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f1685949640 1 --2- 172.21.15.55:0/649645134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1680164410 0x7f168015d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:31.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.358+0000 7f1684947640 1 --2- 172.21.15.55:0/649645134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16800cddf0 0x7f16800b1cd0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f167000c7f0 tx=0x7f167000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:31.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.362+0000 7f1675ffb640 1 -- 172.21.15.55:0/649645134 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167000cea0 con 0x7f16800cddf0 2023-08-25T04:18:31.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.362+0000 7f1675ffb640 1 -- 172.21.15.55:0/649645134 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1670007a30 con 0x7f16800cddf0 2023-08-25T04:18:31.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.362+0000 7f1675ffb640 1 -- 172.21.15.55:0/649645134 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1670007de0 con 0x7f16800cddf0 2023-08-25T04:18:31.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.362+0000 7f16873ac640 1 -- 172.21.15.55:0/649645134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16800c3170 con 0x7f16800cddf0 2023-08-25T04:18:31.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.362+0000 7f16873ac640 1 -- 172.21.15.55:0/649645134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16800c24a0 con 0x7f16800cddf0 2023-08-25T04:18:31.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.362+0000 7f16873ac640 1 -- 172.21.15.55:0/649645134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16800c69b0 con 0x7f16800cddf0 2023-08-25T04:18:31.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.362+0000 7f1675ffb640 1 -- 172.21.15.55:0/649645134 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f16700113f0 con 0x7f16800cddf0 2023-08-25T04:18:31.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.362+0000 7f1675ffb640 1 --2- 172.21.15.55:0/649645134 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f16640657a0 0x7f1664067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:31.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.362+0000 7f1675ffb640 1 -- 172.21.15.55:0/649645134 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1670083170 con 0x7f16800cddf0 2023-08-25T04:18:31.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.362+0000 7f1685148640 1 --2- 172.21.15.55:0/649645134 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f16640657a0 0x7f1664067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:31.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.366+0000 7f1685148640 1 --2- 172.21.15.55:0/649645134 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f16640657a0 0x7f1664067c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f167c0ad000 tx=0x7f167c0a6000 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:31.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.366+0000 7f1675ffb640 1 -- 172.21.15.55:0/649645134 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1670050a20 con 0x7f16800cddf0 2023-08-25T04:18:31.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.522+0000 7f16873ac640 1 -- 172.21.15.55:0/649645134 --> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16800cd530 con 0x7f16640657a0 2023-08-25T04:18:31.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.530+0000 7f1675ffb640 1 -- 172.21.15.55:0/649645134 <== mgr.5720 v2:172.21.15.110:6832/2283645732 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311403 (secure 0 0 0) 0x7f167c0ab760 con 0x7f16640657a0 2023-08-25T04:18:31.533 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:31.534 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:18:31.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.534+0000 7f16873ac640 1 -- 172.21.15.55:0/649645134 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f16640657a0 msgr2=0x7f1664067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:31.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.534+0000 7f16873ac640 1 --2- 172.21.15.55:0/649645134 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f16640657a0 0x7f1664067c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f167c0ad000 tx=0x7f167c0a6000 comp rx=0 tx=0).stop 2023-08-25T04:18:31.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.534+0000 7f16873ac640 1 -- 172.21.15.55:0/649645134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16800cddf0 msgr2=0x7f16800b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:31.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.534+0000 7f16873ac640 1 --2- 172.21.15.55:0/649645134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16800cddf0 0x7f16800b1cd0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f167000c7f0 tx=0x7f167000ccb0 comp rx=0 tx=0).stop 2023-08-25T04:18:31.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.534+0000 7f16873ac640 1 -- 172.21.15.55:0/649645134 shutdown_connections 2023-08-25T04:18:31.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.534+0000 7f16873ac640 1 --2- 172.21.15.55:0/649645134 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f16640657a0 0x7f1664067c60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:31.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.534+0000 7f16873ac640 1 --2- 172.21.15.55:0/649645134 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1680164410 0x7f168015d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:31.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.534+0000 7f16873ac640 1 --2- 172.21.15.55:0/649645134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16800cddf0 0x7f16800b1cd0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:31.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.534+0000 7f16873ac640 1 --2- 172.21.15.55:0/649645134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16800c18b0 0x7f16800c1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:31.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.534+0000 7f16873ac640 1 -- 172.21.15.55:0/649645134 >> 172.21.15.55:0/649645134 conn(0x7f1680069d00 msgr2=0x7f168006f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:31.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.534+0000 7f16873ac640 1 -- 172.21.15.55:0/649645134 shutdown_connections 2023-08-25T04:18:31.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:31.534+0000 7f16873ac640 1 -- 172.21.15.55:0/649645134 wait complete. 2023-08-25T04:18:31.553 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-08-25T04:18:30.545747+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":283,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":314996,"kb_used_data":8616,"kb_used_omap":13,"kb_used_meta":306226,"kb_avail":754659724,"statfs":{"total":773094113280,"available":772771557376,"internally_reserved":0,"allocated":8822784,"data_stored":4895276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":313575512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001541"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988082+0000","last_change":"2023-08-25T04:18:25.632248+0000","last_active":"2023-08-25T04:18:27.988082+0000","last_peered":"2023-08-25T04:18:27.988082+0000","last_clean":"2023-08-25T04:18:27.988082+0000","last_became_active":"2023-08-25T04:18:25.631989+0000","last_became_peered":"2023-08-25T04:18:25.631989+0000","last_unstale":"2023-08-25T04:18:27.988082+0000","last_undegraded":"2023-08-25T04:18:27.988082+0000","last_fullsized":"2023-08-25T04:18:27.988082+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:57:44.313097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988169+0000","last_change":"2023-08-25T04:18:25.646606+0000","last_active":"2023-08-25T04:18:27.988169+0000","last_peered":"2023-08-25T04:18:27.988169+0000","last_clean":"2023-08-25T04:18:27.988169+0000","last_became_active":"2023-08-25T04:18:25.646224+0000","last_became_peered":"2023-08-25T04:18:25.646224+0000","last_unstale":"2023-08-25T04:18:27.988169+0000","last_undegraded":"2023-08-25T04:18:27.988169+0000","last_fullsized":"2023-08-25T04:18:27.988169+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:10:21.413051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354105+0000","last_change":"2023-08-25T04:18:25.644136+0000","last_active":"2023-08-25T04:18:27.354105+0000","last_peered":"2023-08-25T04:18:27.354105+0000","last_clean":"2023-08-25T04:18:27.354105+0000","last_became_active":"2023-08-25T04:18:25.643817+0000","last_became_peered":"2023-08-25T04:18:25.643817+0000","last_unstale":"2023-08-25T04:18:27.354105+0000","last_undegraded":"2023-08-25T04:18:27.354105+0000","last_fullsized":"2023-08-25T04:18:27.354105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:26:49.732872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622042+0000","last_change":"2023-08-25T04:18:25.650618+0000","last_active":"2023-08-25T04:18:26.622042+0000","last_peered":"2023-08-25T04:18:26.622042+0000","last_clean":"2023-08-25T04:18:26.622042+0000","last_became_active":"2023-08-25T04:18:25.650299+0000","last_became_peered":"2023-08-25T04:18:25.650299+0000","last_unstale":"2023-08-25T04:18:26.622042+0000","last_undegraded":"2023-08-25T04:18:26.622042+0000","last_fullsized":"2023-08-25T04:18:26.622042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:38:34.910047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622042+0000","last_change":"2023-08-25T04:18:25.650314+0000","last_active":"2023-08-25T04:18:26.622042+0000","last_peered":"2023-08-25T04:18:26.622042+0000","last_clean":"2023-08-25T04:18:26.622042+0000","last_became_active":"2023-08-25T04:18:25.649935+0000","last_became_peered":"2023-08-25T04:18:25.649935+0000","last_unstale":"2023-08-25T04:18:26.622042+0000","last_undegraded":"2023-08-25T04:18:26.622042+0000","last_fullsized":"2023-08-25T04:18:26.622042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:01:19.163570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487485+0000","last_change":"2023-08-25T04:18:25.645148+0000","last_active":"2023-08-25T04:18:27.487485+0000","last_peered":"2023-08-25T04:18:27.487485+0000","last_clean":"2023-08-25T04:18:27.487485+0000","last_became_active":"2023-08-25T04:18:25.644745+0000","last_became_peered":"2023-08-25T04:18:25.644745+0000","last_unstale":"2023-08-25T04:18:27.487485+0000","last_undegraded":"2023-08-25T04:18:27.487485+0000","last_fullsized":"2023-08-25T04:18:27.487485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:46:23.043397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.626230+0000","last_change":"2023-08-25T04:18:25.644903+0000","last_active":"2023-08-25T04:18:26.626230+0000","last_peered":"2023-08-25T04:18:26.626230+0000","last_clean":"2023-08-25T04:18:26.626230+0000","last_became_active":"2023-08-25T04:18:25.644579+0000","last_became_peered":"2023-08-25T04:18:25.644579+0000","last_unstale":"2023-08-25T04:18:26.626230+0000","last_undegraded":"2023-08-25T04:18:26.626230+0000","last_fullsized":"2023-08-25T04:18:26.626230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:07:40.265049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639112+0000","last_change":"2023-08-25T04:18:25.641045+0000","last_active":"2023-08-25T04:18:27.639112+0000","last_peered":"2023-08-25T04:18:27.639112+0000","last_clean":"2023-08-25T04:18:27.639112+0000","last_became_active":"2023-08-25T04:18:25.640675+0000","last_became_peered":"2023-08-25T04:18:25.640675+0000","last_unstale":"2023-08-25T04:18:27.639112+0000","last_undegraded":"2023-08-25T04:18:27.639112+0000","last_fullsized":"2023-08-25T04:18:27.639112+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:26:16.948622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354489+0000","last_change":"2023-08-25T04:18:25.648710+0000","last_active":"2023-08-25T04:18:27.354489+0000","last_peered":"2023-08-25T04:18:27.354489+0000","last_clean":"2023-08-25T04:18:27.354489+0000","last_became_active":"2023-08-25T04:18:25.648216+0000","last_became_peered":"2023-08-25T04:18:25.648216+0000","last_unstale":"2023-08-25T04:18:27.354489+0000","last_undegraded":"2023-08-25T04:18:27.354489+0000","last_fullsized":"2023-08-25T04:18:27.354489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:55:54.614438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354387+0000","last_change":"2023-08-25T04:18:25.638928+0000","last_active":"2023-08-25T04:18:27.354387+0000","last_peered":"2023-08-25T04:18:27.354387+0000","last_clean":"2023-08-25T04:18:27.354387+0000","last_became_active":"2023-08-25T04:18:25.638626+0000","last_became_peered":"2023-08-25T04:18:25.638626+0000","last_unstale":"2023-08-25T04:18:27.354387+0000","last_undegraded":"2023-08-25T04:18:27.354387+0000","last_fullsized":"2023-08-25T04:18:27.354387+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:35:17.203801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622303+0000","last_change":"2023-08-25T04:18:25.649934+0000","last_active":"2023-08-25T04:18:26.622303+0000","last_peered":"2023-08-25T04:18:26.622303+0000","last_clean":"2023-08-25T04:18:26.622303+0000","last_became_active":"2023-08-25T04:18:25.649597+0000","last_became_peered":"2023-08-25T04:18:25.649597+0000","last_unstale":"2023-08-25T04:18:26.622303+0000","last_undegraded":"2023-08-25T04:18:26.622303+0000","last_fullsized":"2023-08-25T04:18:26.622303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:59.285151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639307+0000","last_change":"2023-08-25T04:18:25.633014+0000","last_active":"2023-08-25T04:18:27.639307+0000","last_peered":"2023-08-25T04:18:27.639307+0000","last_clean":"2023-08-25T04:18:27.639307+0000","last_became_active":"2023-08-25T04:18:25.632704+0000","last_became_peered":"2023-08-25T04:18:25.632704+0000","last_unstale":"2023-08-25T04:18:27.639307+0000","last_undegraded":"2023-08-25T04:18:27.639307+0000","last_fullsized":"2023-08-25T04:18:27.639307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:17:27.157990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639481+0000","last_change":"2023-08-25T04:18:25.650920+0000","last_active":"2023-08-25T04:18:27.639481+0000","last_peered":"2023-08-25T04:18:27.639481+0000","last_clean":"2023-08-25T04:18:27.639481+0000","last_became_active":"2023-08-25T04:18:25.650310+0000","last_became_peered":"2023-08-25T04:18:25.650310+0000","last_unstale":"2023-08-25T04:18:27.639481+0000","last_undegraded":"2023-08-25T04:18:27.639481+0000","last_fullsized":"2023-08-25T04:18:27.639481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:16:04.390426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354066+0000","last_change":"2023-08-25T04:18:25.645185+0000","last_active":"2023-08-25T04:18:27.354066+0000","last_peered":"2023-08-25T04:18:27.354066+0000","last_clean":"2023-08-25T04:18:27.354066+0000","last_became_active":"2023-08-25T04:18:25.644849+0000","last_became_peered":"2023-08-25T04:18:25.644849+0000","last_unstale":"2023-08-25T04:18:27.354066+0000","last_undegraded":"2023-08-25T04:18:27.354066+0000","last_fullsized":"2023-08-25T04:18:27.354066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:09.895509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.353927+0000","last_change":"2023-08-25T04:18:25.641201+0000","last_active":"2023-08-25T04:18:27.353927+0000","last_peered":"2023-08-25T04:18:27.353927+0000","last_clean":"2023-08-25T04:18:27.353927+0000","last_became_active":"2023-08-25T04:18:25.640897+0000","last_became_peered":"2023-08-25T04:18:25.640897+0000","last_unstale":"2023-08-25T04:18:27.353927+0000","last_undegraded":"2023-08-25T04:18:27.353927+0000","last_fullsized":"2023-08-25T04:18:27.353927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:37.661289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.626242+0000","last_change":"2023-08-25T04:18:25.639360+0000","last_active":"2023-08-25T04:18:26.626242+0000","last_peered":"2023-08-25T04:18:26.626242+0000","last_clean":"2023-08-25T04:18:26.626242+0000","last_became_active":"2023-08-25T04:18:25.639046+0000","last_became_peered":"2023-08-25T04:18:25.639046+0000","last_unstale":"2023-08-25T04:18:26.626242+0000","last_undegraded":"2023-08-25T04:18:26.626242+0000","last_fullsized":"2023-08-25T04:18:26.626242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:15:41.847995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988094+0000","last_change":"2023-08-25T04:18:25.649762+0000","last_active":"2023-08-25T04:18:27.988094+0000","last_peered":"2023-08-25T04:18:27.988094+0000","last_clean":"2023-08-25T04:18:27.988094+0000","last_became_active":"2023-08-25T04:18:25.649504+0000","last_became_peered":"2023-08-25T04:18:25.649504+0000","last_unstale":"2023-08-25T04:18:27.988094+0000","last_undegraded":"2023-08-25T04:18:27.988094+0000","last_fullsized":"2023-08-25T04:18:27.988094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:46:28.827215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621593+0000","last_change":"2023-08-25T04:18:25.645876+0000","last_active":"2023-08-25T04:18:26.621593+0000","last_peered":"2023-08-25T04:18:26.621593+0000","last_clean":"2023-08-25T04:18:26.621593+0000","last_became_active":"2023-08-25T04:18:25.645451+0000","last_became_peered":"2023-08-25T04:18:25.645451+0000","last_unstale":"2023-08-25T04:18:26.621593+0000","last_undegraded":"2023-08-25T04:18:26.621593+0000","last_fullsized":"2023-08-25T04:18:26.621593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:43:05.117649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621813+0000","last_change":"2023-08-25T04:18:25.635545+0000","last_active":"2023-08-25T04:18:26.621813+0000","last_peered":"2023-08-25T04:18:26.621813+0000","last_clean":"2023-08-25T04:18:26.621813+0000","last_became_active":"2023-08-25T04:18:25.635234+0000","last_became_peered":"2023-08-25T04:18:25.635234+0000","last_unstale":"2023-08-25T04:18:26.621813+0000","last_undegraded":"2023-08-25T04:18:26.621813+0000","last_fullsized":"2023-08-25T04:18:26.621813+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:50:07.971510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913678+0000","last_change":"2023-08-25T04:18:25.638009+0000","last_active":"2023-08-25T04:18:26.913678+0000","last_peered":"2023-08-25T04:18:26.913678+0000","last_clean":"2023-08-25T04:18:26.913678+0000","last_became_active":"2023-08-25T04:18:25.637746+0000","last_became_peered":"2023-08-25T04:18:25.637746+0000","last_unstale":"2023-08-25T04:18:26.913678+0000","last_undegraded":"2023-08-25T04:18:26.913678+0000","last_fullsized":"2023-08-25T04:18:26.913678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:46.047372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639432+0000","last_change":"2023-08-25T04:18:25.626842+0000","last_active":"2023-08-25T04:18:27.639432+0000","last_peered":"2023-08-25T04:18:27.639432+0000","last_clean":"2023-08-25T04:18:27.639432+0000","last_became_active":"2023-08-25T04:18:25.626550+0000","last_became_peered":"2023-08-25T04:18:25.626550+0000","last_unstale":"2023-08-25T04:18:27.639432+0000","last_undegraded":"2023-08-25T04:18:27.639432+0000","last_fullsized":"2023-08-25T04:18:27.639432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:53:42.891883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913419+0000","last_change":"2023-08-25T04:18:25.642862+0000","last_active":"2023-08-25T04:18:26.913419+0000","last_peered":"2023-08-25T04:18:26.913419+0000","last_clean":"2023-08-25T04:18:26.913419+0000","last_became_active":"2023-08-25T04:18:25.642597+0000","last_became_peered":"2023-08-25T04:18:25.642597+0000","last_unstale":"2023-08-25T04:18:26.913419+0000","last_undegraded":"2023-08-25T04:18:26.913419+0000","last_fullsized":"2023-08-25T04:18:26.913419+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:08:11.703878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913345+0000","last_change":"2023-08-25T04:18:25.638154+0000","last_active":"2023-08-25T04:18:26.913345+0000","last_peered":"2023-08-25T04:18:26.913345+0000","last_clean":"2023-08-25T04:18:26.913345+0000","last_became_active":"2023-08-25T04:18:25.637005+0000","last_became_peered":"2023-08-25T04:18:25.637005+0000","last_unstale":"2023-08-25T04:18:26.913345+0000","last_undegraded":"2023-08-25T04:18:26.913345+0000","last_fullsized":"2023-08-25T04:18:26.913345+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:00:33.451750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.353913+0000","last_change":"2023-08-25T04:18:25.644071+0000","last_active":"2023-08-25T04:18:27.353913+0000","last_peered":"2023-08-25T04:18:27.353913+0000","last_clean":"2023-08-25T04:18:27.353913+0000","last_became_active":"2023-08-25T04:18:25.643750+0000","last_became_peered":"2023-08-25T04:18:25.643750+0000","last_unstale":"2023-08-25T04:18:27.353913+0000","last_undegraded":"2023-08-25T04:18:27.353913+0000","last_fullsized":"2023-08-25T04:18:27.353913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:22:07.017092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639550+0000","last_change":"2023-08-25T04:18:25.636859+0000","last_active":"2023-08-25T04:18:27.639550+0000","last_peered":"2023-08-25T04:18:27.639550+0000","last_clean":"2023-08-25T04:18:27.639550+0000","last_became_active":"2023-08-25T04:18:25.636549+0000","last_became_peered":"2023-08-25T04:18:25.636549+0000","last_unstale":"2023-08-25T04:18:27.639550+0000","last_undegraded":"2023-08-25T04:18:27.639550+0000","last_fullsized":"2023-08-25T04:18:27.639550+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:49:39.436600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639320+0000","last_change":"2023-08-25T04:18:25.630695+0000","last_active":"2023-08-25T04:18:27.639320+0000","last_peered":"2023-08-25T04:18:27.639320+0000","last_clean":"2023-08-25T04:18:27.639320+0000","last_became_active":"2023-08-25T04:18:25.630399+0000","last_became_peered":"2023-08-25T04:18:25.630399+0000","last_unstale":"2023-08-25T04:18:27.639320+0000","last_undegraded":"2023-08-25T04:18:27.639320+0000","last_fullsized":"2023-08-25T04:18:27.639320+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:56.085993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622443+0000","last_change":"2023-08-25T04:18:25.650015+0000","last_active":"2023-08-25T04:18:26.622443+0000","last_peered":"2023-08-25T04:18:26.622443+0000","last_clean":"2023-08-25T04:18:26.622443+0000","last_became_active":"2023-08-25T04:18:25.649723+0000","last_became_peered":"2023-08-25T04:18:25.649723+0000","last_unstale":"2023-08-25T04:18:26.622443+0000","last_undegraded":"2023-08-25T04:18:26.622443+0000","last_fullsized":"2023-08-25T04:18:26.622443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:05:46.710064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.987894+0000","last_change":"2023-08-25T04:18:25.631594+0000","last_active":"2023-08-25T04:18:27.987894+0000","last_peered":"2023-08-25T04:18:27.987894+0000","last_clean":"2023-08-25T04:18:27.987894+0000","last_became_active":"2023-08-25T04:18:25.631232+0000","last_became_peered":"2023-08-25T04:18:25.631232+0000","last_unstale":"2023-08-25T04:18:27.987894+0000","last_undegraded":"2023-08-25T04:18:27.987894+0000","last_fullsized":"2023-08-25T04:18:27.987894+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:55:15.459228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354012+0000","last_change":"2023-08-25T04:18:25.651171+0000","last_active":"2023-08-25T04:18:27.354012+0000","last_peered":"2023-08-25T04:18:27.354012+0000","last_clean":"2023-08-25T04:18:27.354012+0000","last_became_active":"2023-08-25T04:18:25.650894+0000","last_became_peered":"2023-08-25T04:18:25.650894+0000","last_unstale":"2023-08-25T04:18:27.354012+0000","last_undegraded":"2023-08-25T04:18:27.354012+0000","last_fullsized":"2023-08-25T04:18:27.354012+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:42:12.796762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639142+0000","last_change":"2023-08-25T04:18:25.637488+0000","last_active":"2023-08-25T04:18:27.639142+0000","last_peered":"2023-08-25T04:18:27.639142+0000","last_clean":"2023-08-25T04:18:27.639142+0000","last_became_active":"2023-08-25T04:18:25.637054+0000","last_became_peered":"2023-08-25T04:18:25.637054+0000","last_unstale":"2023-08-25T04:18:27.639142+0000","last_undegraded":"2023-08-25T04:18:27.639142+0000","last_fullsized":"2023-08-25T04:18:27.639142+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:22:21.162328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621197+0000","last_change":"2023-08-25T04:18:25.646693+0000","last_active":"2023-08-25T04:18:26.621197+0000","last_peered":"2023-08-25T04:18:26.621197+0000","last_clean":"2023-08-25T04:18:26.621197+0000","last_became_active":"2023-08-25T04:18:25.646408+0000","last_became_peered":"2023-08-25T04:18:25.646408+0000","last_unstale":"2023-08-25T04:18:26.621197+0000","last_undegraded":"2023-08-25T04:18:26.621197+0000","last_fullsized":"2023-08-25T04:18:26.621197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:04:39.061279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487347+0000","last_change":"2023-08-25T04:18:25.641416+0000","last_active":"2023-08-25T04:18:27.487347+0000","last_peered":"2023-08-25T04:18:27.487347+0000","last_clean":"2023-08-25T04:18:27.487347+0000","last_became_active":"2023-08-25T04:18:25.641064+0000","last_became_peered":"2023-08-25T04:18:25.641064+0000","last_unstale":"2023-08-25T04:18:27.487347+0000","last_undegraded":"2023-08-25T04:18:27.487347+0000","last_fullsized":"2023-08-25T04:18:27.487347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:16:11.355646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622411+0000","last_change":"2023-08-25T04:18:25.626775+0000","last_active":"2023-08-25T04:18:26.622411+0000","last_peered":"2023-08-25T04:18:26.622411+0000","last_clean":"2023-08-25T04:18:26.622411+0000","last_became_active":"2023-08-25T04:18:25.626462+0000","last_became_peered":"2023-08-25T04:18:25.626462+0000","last_unstale":"2023-08-25T04:18:26.622411+0000","last_undegraded":"2023-08-25T04:18:26.622411+0000","last_fullsized":"2023-08-25T04:18:26.622411+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:51:12.200425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"78'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988192+0000","last_change":"2023-08-25T04:18:24.900671+0000","last_active":"2023-08-25T04:18:27.988192+0000","last_peered":"2023-08-25T04:18:27.988192+0000","last_clean":"2023-08-25T04:18:27.988192+0000","last_became_active":"2023-08-25T04:18:24.900313+0000","last_became_peered":"2023-08-25T04:18:24.900313+0000","last_unstale":"2023-08-25T04:18:27.988192+0000","last_undegraded":"2023-08-25T04:18:27.988192+0000","last_fullsized":"2023-08-25T04:18:27.988192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:36:22.100902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622579+0000","last_change":"2023-08-25T04:18:25.638689+0000","last_active":"2023-08-25T04:18:26.622579+0000","last_peered":"2023-08-25T04:18:26.622579+0000","last_clean":"2023-08-25T04:18:26.622579+0000","last_became_active":"2023-08-25T04:18:25.638409+0000","last_became_peered":"2023-08-25T04:18:25.638409+0000","last_unstale":"2023-08-25T04:18:26.622579+0000","last_undegraded":"2023-08-25T04:18:26.622579+0000","last_fullsized":"2023-08-25T04:18:26.622579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:26:53.571564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487726+0000","last_change":"2023-08-25T04:18:24.906222+0000","last_active":"2023-08-25T04:18:27.487726+0000","last_peered":"2023-08-25T04:18:27.487726+0000","last_clean":"2023-08-25T04:18:27.487726+0000","last_became_active":"2023-08-25T04:18:24.905939+0000","last_became_peered":"2023-08-25T04:18:24.905939+0000","last_unstale":"2023-08-25T04:18:27.487726+0000","last_undegraded":"2023-08-25T04:18:27.487726+0000","last_fullsized":"2023-08-25T04:18:27.487726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:54.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487673+0000","last_change":"2023-08-25T04:18:25.641540+0000","last_active":"2023-08-25T04:18:27.487673+0000","last_peered":"2023-08-25T04:18:27.487673+0000","last_clean":"2023-08-25T04:18:27.487673+0000","last_became_active":"2023-08-25T04:18:25.641036+0000","last_became_peered":"2023-08-25T04:18:25.641036+0000","last_unstale":"2023-08-25T04:18:27.487673+0000","last_undegraded":"2023-08-25T04:18:27.487673+0000","last_fullsized":"2023-08-25T04:18:27.487673+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:51.397620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"78'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487710+0000","last_change":"2023-08-25T04:18:24.909480+0000","last_active":"2023-08-25T04:18:27.487710+0000","last_peered":"2023-08-25T04:18:27.487710+0000","last_clean":"2023-08-25T04:18:27.487710+0000","last_became_active":"2023-08-25T04:18:24.909014+0000","last_became_peered":"2023-08-25T04:18:24.909014+0000","last_unstale":"2023-08-25T04:18:27.487710+0000","last_undegraded":"2023-08-25T04:18:27.487710+0000","last_fullsized":"2023-08-25T04:18:27.487710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:25:15.695930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354470+0000","last_change":"2023-08-25T04:18:25.639484+0000","last_active":"2023-08-25T04:18:27.354470+0000","last_peered":"2023-08-25T04:18:27.354470+0000","last_clean":"2023-08-25T04:18:27.354470+0000","last_became_active":"2023-08-25T04:18:25.639181+0000","last_became_peered":"2023-08-25T04:18:25.639181+0000","last_unstale":"2023-08-25T04:18:27.354470+0000","last_undegraded":"2023-08-25T04:18:27.354470+0000","last_fullsized":"2023-08-25T04:18:27.354470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:19:11.587628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"78'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487781+0000","last_change":"2023-08-25T04:18:24.900981+0000","last_active":"2023-08-25T04:18:27.487781+0000","last_peered":"2023-08-25T04:18:27.487781+0000","last_clean":"2023-08-25T04:18:27.487781+0000","last_became_active":"2023-08-25T04:18:24.900617+0000","last_became_peered":"2023-08-25T04:18:24.900617+0000","last_unstale":"2023-08-25T04:18:27.487781+0000","last_undegraded":"2023-08-25T04:18:27.487781+0000","last_fullsized":"2023-08-25T04:18:27.487781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:52:19.639407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.626387+0000","last_change":"2023-08-25T04:18:25.638325+0000","last_active":"2023-08-25T04:18:26.626387+0000","last_peered":"2023-08-25T04:18:26.626387+0000","last_clean":"2023-08-25T04:18:26.626387+0000","last_became_active":"2023-08-25T04:18:25.638028+0000","last_became_peered":"2023-08-25T04:18:25.638028+0000","last_unstale":"2023-08-25T04:18:26.626387+0000","last_undegraded":"2023-08-25T04:18:26.626387+0000","last_fullsized":"2023-08-25T04:18:26.626387+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:55:04.280318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913716+0000","last_change":"2023-08-25T04:18:24.902167+0000","last_active":"2023-08-25T04:18:26.913716+0000","last_peered":"2023-08-25T04:18:26.913716+0000","last_clean":"2023-08-25T04:18:26.913716+0000","last_became_active":"2023-08-25T04:18:24.901834+0000","last_became_peered":"2023-08-25T04:18:24.901834+0000","last_unstale":"2023-08-25T04:18:26.913716+0000","last_undegraded":"2023-08-25T04:18:26.913716+0000","last_fullsized":"2023-08-25T04:18:26.913716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:25:20.979312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.987618+0000","last_change":"2023-08-25T04:18:25.652459+0000","last_active":"2023-08-25T04:18:27.987618+0000","last_peered":"2023-08-25T04:18:27.987618+0000","last_clean":"2023-08-25T04:18:27.987618+0000","last_became_active":"2023-08-25T04:18:25.652184+0000","last_became_peered":"2023-08-25T04:18:25.652184+0000","last_unstale":"2023-08-25T04:18:27.987618+0000","last_undegraded":"2023-08-25T04:18:27.987618+0000","last_fullsized":"2023-08-25T04:18:27.987618+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:13:02.236309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913360+0000","last_change":"2023-08-25T04:18:24.900982+0000","last_active":"2023-08-25T04:18:26.913360+0000","last_peered":"2023-08-25T04:18:26.913360+0000","last_clean":"2023-08-25T04:18:26.913360+0000","last_became_active":"2023-08-25T04:18:24.900528+0000","last_became_peered":"2023-08-25T04:18:24.900528+0000","last_unstale":"2023-08-25T04:18:26.913360+0000","last_undegraded":"2023-08-25T04:18:26.913360+0000","last_fullsized":"2023-08-25T04:18:26.913360+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:08:11.010203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621634+0000","last_change":"2023-08-25T04:18:25.644003+0000","last_active":"2023-08-25T04:18:26.621634+0000","last_peered":"2023-08-25T04:18:26.621634+0000","last_clean":"2023-08-25T04:18:26.621634+0000","last_became_active":"2023-08-25T04:18:25.643701+0000","last_became_peered":"2023-08-25T04:18:25.643701+0000","last_unstale":"2023-08-25T04:18:26.621634+0000","last_undegraded":"2023-08-25T04:18:26.621634+0000","last_fullsized":"2023-08-25T04:18:26.621634+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:13.067641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913432+0000","last_change":"2023-08-25T04:18:24.905764+0000","last_active":"2023-08-25T04:18:26.913432+0000","last_peered":"2023-08-25T04:18:26.913432+0000","last_clean":"2023-08-25T04:18:26.913432+0000","last_became_active":"2023-08-25T04:18:24.905138+0000","last_became_peered":"2023-08-25T04:18:24.905138+0000","last_unstale":"2023-08-25T04:18:26.913432+0000","last_undegraded":"2023-08-25T04:18:26.913432+0000","last_fullsized":"2023-08-25T04:18:26.913432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:46.932266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913621+0000","last_change":"2023-08-25T04:18:25.650056+0000","last_active":"2023-08-25T04:18:26.913621+0000","last_peered":"2023-08-25T04:18:26.913621+0000","last_clean":"2023-08-25T04:18:26.913621+0000","last_became_active":"2023-08-25T04:18:25.649748+0000","last_became_peered":"2023-08-25T04:18:25.649748+0000","last_unstale":"2023-08-25T04:18:26.913621+0000","last_undegraded":"2023-08-25T04:18:26.913621+0000","last_fullsized":"2023-08-25T04:18:26.913621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:32:45.722559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622118+0000","last_change":"2023-08-25T04:18:24.903496+0000","last_active":"2023-08-25T04:18:26.622118+0000","last_peered":"2023-08-25T04:18:26.622118+0000","last_clean":"2023-08-25T04:18:26.622118+0000","last_became_active":"2023-08-25T04:18:24.903220+0000","last_became_peered":"2023-08-25T04:18:24.903220+0000","last_unstale":"2023-08-25T04:18:26.622118+0000","last_undegraded":"2023-08-25T04:18:26.622118+0000","last_fullsized":"2023-08-25T04:18:26.622118+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:16:43.130858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988031+0000","last_change":"2023-08-25T04:18:25.633482+0000","last_active":"2023-08-25T04:18:27.988031+0000","last_peered":"2023-08-25T04:18:27.988031+0000","last_clean":"2023-08-25T04:18:27.988031+0000","last_became_active":"2023-08-25T04:18:25.633146+0000","last_became_peered":"2023-08-25T04:18:25.633146+0000","last_unstale":"2023-08-25T04:18:27.988031+0000","last_undegraded":"2023-08-25T04:18:27.988031+0000","last_fullsized":"2023-08-25T04:18:27.988031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:54:56.767599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354577+0000","last_change":"2023-08-25T04:18:24.910198+0000","last_active":"2023-08-25T04:18:27.354577+0000","last_peered":"2023-08-25T04:18:27.354577+0000","last_clean":"2023-08-25T04:18:27.354577+0000","last_became_active":"2023-08-25T04:18:24.909872+0000","last_became_peered":"2023-08-25T04:18:24.909872+0000","last_unstale":"2023-08-25T04:18:27.354577+0000","last_undegraded":"2023-08-25T04:18:27.354577+0000","last_fullsized":"2023-08-25T04:18:27.354577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:13:18.535719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913630+0000","last_change":"2023-08-25T04:18:25.635060+0000","last_active":"2023-08-25T04:18:26.913630+0000","last_peered":"2023-08-25T04:18:26.913630+0000","last_clean":"2023-08-25T04:18:26.913630+0000","last_became_active":"2023-08-25T04:18:25.634787+0000","last_became_peered":"2023-08-25T04:18:25.634787+0000","last_unstale":"2023-08-25T04:18:26.913630+0000","last_undegraded":"2023-08-25T04:18:26.913630+0000","last_fullsized":"2023-08-25T04:18:26.913630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:28:01.142506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621684+0000","last_change":"2023-08-25T04:18:24.894667+0000","last_active":"2023-08-25T04:18:26.621684+0000","last_peered":"2023-08-25T04:18:26.621684+0000","last_clean":"2023-08-25T04:18:26.621684+0000","last_became_active":"2023-08-25T04:18:24.894325+0000","last_became_peered":"2023-08-25T04:18:24.894325+0000","last_unstale":"2023-08-25T04:18:26.621684+0000","last_undegraded":"2023-08-25T04:18:26.621684+0000","last_fullsized":"2023-08-25T04:18:26.621684+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:17:40.154585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621965+0000","last_change":"2023-08-25T04:18:25.624915+0000","last_active":"2023-08-25T04:18:26.621965+0000","last_peered":"2023-08-25T04:18:26.621965+0000","last_clean":"2023-08-25T04:18:26.621965+0000","last_became_active":"2023-08-25T04:18:25.624586+0000","last_became_peered":"2023-08-25T04:18:25.624586+0000","last_unstale":"2023-08-25T04:18:26.621965+0000","last_undegraded":"2023-08-25T04:18:26.621965+0000","last_fullsized":"2023-08-25T04:18:26.621965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:45:36.677172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"78'3","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354353+0000","last_change":"2023-08-25T04:18:24.910725+0000","last_active":"2023-08-25T04:18:27.354353+0000","last_peered":"2023-08-25T04:18:27.354353+0000","last_clean":"2023-08-25T04:18:27.354353+0000","last_became_active":"2023-08-25T04:18:24.910425+0000","last_became_peered":"2023-08-25T04:18:24.910425+0000","last_unstale":"2023-08-25T04:18:27.354353+0000","last_undegraded":"2023-08-25T04:18:27.354353+0000","last_fullsized":"2023-08-25T04:18:27.354353+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:00:08.595826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622423+0000","last_change":"2023-08-25T04:18:25.646137+0000","last_active":"2023-08-25T04:18:26.622423+0000","last_peered":"2023-08-25T04:18:26.622423+0000","last_clean":"2023-08-25T04:18:26.622423+0000","last_became_active":"2023-08-25T04:18:25.645761+0000","last_became_peered":"2023-08-25T04:18:25.645761+0000","last_unstale":"2023-08-25T04:18:26.622423+0000","last_undegraded":"2023-08-25T04:18:26.622423+0000","last_fullsized":"2023-08-25T04:18:26.622423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:18:08.394722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"78'6","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988013+0000","last_change":"2023-08-25T04:18:24.898103+0000","last_active":"2023-08-25T04:18:27.988013+0000","last_peered":"2023-08-25T04:18:27.988013+0000","last_clean":"2023-08-25T04:18:27.988013+0000","last_became_active":"2023-08-25T04:18:24.897730+0000","last_became_peered":"2023-08-25T04:18:24.897730+0000","last_unstale":"2023-08-25T04:18:27.988013+0000","last_undegraded":"2023-08-25T04:18:27.988013+0000","last_fullsized":"2023-08-25T04:18:27.988013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:15.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621199+0000","last_change":"2023-08-25T04:18:25.646279+0000","last_active":"2023-08-25T04:18:26.621199+0000","last_peered":"2023-08-25T04:18:26.621199+0000","last_clean":"2023-08-25T04:18:26.621199+0000","last_became_active":"2023-08-25T04:18:25.645802+0000","last_became_peered":"2023-08-25T04:18:25.645802+0000","last_unstale":"2023-08-25T04:18:26.621199+0000","last_undegraded":"2023-08-25T04:18:26.621199+0000","last_fullsized":"2023-08-25T04:18:26.621199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:59:16.075360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"78'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354179+0000","last_change":"2023-08-25T04:18:24.904539+0000","last_active":"2023-08-25T04:18:27.354179+0000","last_peered":"2023-08-25T04:18:27.354179+0000","last_clean":"2023-08-25T04:18:27.354179+0000","last_became_active":"2023-08-25T04:18:24.904139+0000","last_became_peered":"2023-08-25T04:18:24.904139+0000","last_unstale":"2023-08-25T04:18:27.354179+0000","last_undegraded":"2023-08-25T04:18:27.354179+0000","last_fullsized":"2023-08-25T04:18:27.354179+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:41:07.520954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639109+0000","last_change":"2023-08-25T04:18:25.644224+0000","last_active":"2023-08-25T04:18:27.639109+0000","last_peered":"2023-08-25T04:18:27.639109+0000","last_clean":"2023-08-25T04:18:27.639109+0000","last_became_active":"2023-08-25T04:18:25.643896+0000","last_became_peered":"2023-08-25T04:18:25.643896+0000","last_unstale":"2023-08-25T04:18:27.639109+0000","last_undegraded":"2023-08-25T04:18:27.639109+0000","last_fullsized":"2023-08-25T04:18:27.639109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:22.829709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639114+0000","last_change":"2023-08-25T04:18:24.910158+0000","last_active":"2023-08-25T04:18:27.639114+0000","last_peered":"2023-08-25T04:18:27.639114+0000","last_clean":"2023-08-25T04:18:27.639114+0000","last_became_active":"2023-08-25T04:18:24.909888+0000","last_became_peered":"2023-08-25T04:18:24.909888+0000","last_unstale":"2023-08-25T04:18:27.639114+0000","last_undegraded":"2023-08-25T04:18:27.639114+0000","last_fullsized":"2023-08-25T04:18:27.639114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:25:28.377610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621679+0000","last_change":"2023-08-25T04:18:25.635790+0000","last_active":"2023-08-25T04:18:26.621679+0000","last_peered":"2023-08-25T04:18:26.621679+0000","last_clean":"2023-08-25T04:18:26.621679+0000","last_became_active":"2023-08-25T04:18:25.635275+0000","last_became_peered":"2023-08-25T04:18:25.635275+0000","last_unstale":"2023-08-25T04:18:26.621679+0000","last_undegraded":"2023-08-25T04:18:26.621679+0000","last_fullsized":"2023-08-25T04:18:26.621679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:20:10.374336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354168+0000","last_change":"2023-08-25T04:18:24.901753+0000","last_active":"2023-08-25T04:18:27.354168+0000","last_peered":"2023-08-25T04:18:27.354168+0000","last_clean":"2023-08-25T04:18:27.354168+0000","last_became_active":"2023-08-25T04:18:24.901420+0000","last_became_peered":"2023-08-25T04:18:24.901420+0000","last_unstale":"2023-08-25T04:18:27.354168+0000","last_undegraded":"2023-08-25T04:18:27.354168+0000","last_fullsized":"2023-08-25T04:18:27.354168+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:20:11.639973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.987920+0000","last_change":"2023-08-25T04:18:25.642974+0000","last_active":"2023-08-25T04:18:27.987920+0000","last_peered":"2023-08-25T04:18:27.987920+0000","last_clean":"2023-08-25T04:18:27.987920+0000","last_became_active":"2023-08-25T04:18:25.642614+0000","last_became_peered":"2023-08-25T04:18:25.642614+0000","last_unstale":"2023-08-25T04:18:27.987920+0000","last_undegraded":"2023-08-25T04:18:27.987920+0000","last_fullsized":"2023-08-25T04:18:27.987920+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:55:32.232515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"78'8","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621196+0000","last_change":"2023-08-25T04:18:24.903053+0000","last_active":"2023-08-25T04:18:26.621196+0000","last_peered":"2023-08-25T04:18:26.621196+0000","last_clean":"2023-08-25T04:18:26.621196+0000","last_became_active":"2023-08-25T04:18:24.902758+0000","last_became_peered":"2023-08-25T04:18:24.902758+0000","last_unstale":"2023-08-25T04:18:26.621196+0000","last_undegraded":"2023-08-25T04:18:26.621196+0000","last_fullsized":"2023-08-25T04:18:26.621196+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:45:26.997083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487670+0000","last_change":"2023-08-25T04:18:25.652727+0000","last_active":"2023-08-25T04:18:27.487670+0000","last_peered":"2023-08-25T04:18:27.487670+0000","last_clean":"2023-08-25T04:18:27.487670+0000","last_became_active":"2023-08-25T04:18:25.652461+0000","last_became_peered":"2023-08-25T04:18:25.652461+0000","last_unstale":"2023-08-25T04:18:27.487670+0000","last_undegraded":"2023-08-25T04:18:27.487670+0000","last_fullsized":"2023-08-25T04:18:27.487670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:43:51.025053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"78'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639648+0000","last_change":"2023-08-25T04:18:24.907754+0000","last_active":"2023-08-25T04:18:27.639648+0000","last_peered":"2023-08-25T04:18:27.639648+0000","last_clean":"2023-08-25T04:18:27.639648+0000","last_became_active":"2023-08-25T04:18:24.907446+0000","last_became_peered":"2023-08-25T04:18:24.907446+0000","last_unstale":"2023-08-25T04:18:27.639648+0000","last_undegraded":"2023-08-25T04:18:27.639648+0000","last_fullsized":"2023-08-25T04:18:27.639648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:21:53.030966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.626587+0000","last_change":"2023-08-25T04:18:25.646631+0000","last_active":"2023-08-25T04:18:26.626587+0000","last_peered":"2023-08-25T04:18:26.626587+0000","last_clean":"2023-08-25T04:18:26.626587+0000","last_became_active":"2023-08-25T04:18:25.646238+0000","last_became_peered":"2023-08-25T04:18:25.646238+0000","last_unstale":"2023-08-25T04:18:26.626587+0000","last_undegraded":"2023-08-25T04:18:26.626587+0000","last_fullsized":"2023-08-25T04:18:26.626587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:04:23.036827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639521+0000","last_change":"2023-08-25T04:18:24.905286+0000","last_active":"2023-08-25T04:18:27.639521+0000","last_peered":"2023-08-25T04:18:27.639521+0000","last_clean":"2023-08-25T04:18:27.639521+0000","last_became_active":"2023-08-25T04:18:24.904999+0000","last_became_peered":"2023-08-25T04:18:24.904999+0000","last_unstale":"2023-08-25T04:18:27.639521+0000","last_undegraded":"2023-08-25T04:18:27.639521+0000","last_fullsized":"2023-08-25T04:18:27.639521+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:50:36.042403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639402+0000","last_change":"2023-08-25T04:18:25.644341+0000","last_active":"2023-08-25T04:18:27.639402+0000","last_peered":"2023-08-25T04:18:27.639402+0000","last_clean":"2023-08-25T04:18:27.639402+0000","last_became_active":"2023-08-25T04:18:25.644048+0000","last_became_peered":"2023-08-25T04:18:25.644048+0000","last_unstale":"2023-08-25T04:18:27.639402+0000","last_undegraded":"2023-08-25T04:18:27.639402+0000","last_fullsized":"2023-08-25T04:18:27.639402+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:05.098467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487663+0000","last_change":"2023-08-25T04:18:24.909744+0000","last_active":"2023-08-25T04:18:27.487663+0000","last_peered":"2023-08-25T04:18:27.487663+0000","last_clean":"2023-08-25T04:18:27.487663+0000","last_became_active":"2023-08-25T04:18:24.909442+0000","last_became_peered":"2023-08-25T04:18:24.909442+0000","last_unstale":"2023-08-25T04:18:27.487663+0000","last_undegraded":"2023-08-25T04:18:27.487663+0000","last_fullsized":"2023-08-25T04:18:27.487663+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:14.874672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621922+0000","last_change":"2023-08-25T04:18:25.633574+0000","last_active":"2023-08-25T04:18:26.621922+0000","last_peered":"2023-08-25T04:18:26.621922+0000","last_clean":"2023-08-25T04:18:26.621922+0000","last_became_active":"2023-08-25T04:18:25.633286+0000","last_became_peered":"2023-08-25T04:18:25.633286+0000","last_unstale":"2023-08-25T04:18:26.621922+0000","last_undegraded":"2023-08-25T04:18:26.621922+0000","last_fullsized":"2023-08-25T04:18:26.621922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:18:52.114025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988136+0000","last_change":"2023-08-25T04:18:24.898350+0000","last_active":"2023-08-25T04:18:27.988136+0000","last_peered":"2023-08-25T04:18:27.988136+0000","last_clean":"2023-08-25T04:18:27.988136+0000","last_became_active":"2023-08-25T04:18:24.898050+0000","last_became_peered":"2023-08-25T04:18:24.898050+0000","last_unstale":"2023-08-25T04:18:27.988136+0000","last_undegraded":"2023-08-25T04:18:27.988136+0000","last_fullsized":"2023-08-25T04:18:27.988136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:00:32.448501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621215+0000","last_change":"2023-08-25T04:18:25.626522+0000","last_active":"2023-08-25T04:18:26.621215+0000","last_peered":"2023-08-25T04:18:26.621215+0000","last_clean":"2023-08-25T04:18:26.621215+0000","last_became_active":"2023-08-25T04:18:25.626182+0000","last_became_peered":"2023-08-25T04:18:25.626182+0000","last_unstale":"2023-08-25T04:18:26.621215+0000","last_undegraded":"2023-08-25T04:18:26.621215+0000","last_fullsized":"2023-08-25T04:18:26.621215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:02:13.919466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354205+0000","last_change":"2023-08-25T04:18:24.905898+0000","last_active":"2023-08-25T04:18:27.354205+0000","last_peered":"2023-08-25T04:18:27.354205+0000","last_clean":"2023-08-25T04:18:27.354205+0000","last_became_active":"2023-08-25T04:18:24.905597+0000","last_became_peered":"2023-08-25T04:18:24.905597+0000","last_unstale":"2023-08-25T04:18:27.354205+0000","last_undegraded":"2023-08-25T04:18:27.354205+0000","last_fullsized":"2023-08-25T04:18:27.354205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:37:48.723022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621507+0000","last_change":"2023-08-25T04:18:25.647175+0000","last_active":"2023-08-25T04:18:26.621507+0000","last_peered":"2023-08-25T04:18:26.621507+0000","last_clean":"2023-08-25T04:18:26.621507+0000","last_became_active":"2023-08-25T04:18:25.646859+0000","last_became_peered":"2023-08-25T04:18:25.646859+0000","last_unstale":"2023-08-25T04:18:26.621507+0000","last_undegraded":"2023-08-25T04:18:26.621507+0000","last_fullsized":"2023-08-25T04:18:26.621507+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:15:55.660653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913503+0000","last_change":"2023-08-25T04:18:24.900266+0000","last_active":"2023-08-25T04:18:26.913503+0000","last_peered":"2023-08-25T04:18:26.913503+0000","last_clean":"2023-08-25T04:18:26.913503+0000","last_became_active":"2023-08-25T04:18:24.899965+0000","last_became_peered":"2023-08-25T04:18:24.899965+0000","last_unstale":"2023-08-25T04:18:26.913503+0000","last_undegraded":"2023-08-25T04:18:26.913503+0000","last_fullsized":"2023-08-25T04:18:26.913503+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:54:44.514535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.987839+0000","last_change":"2023-08-25T04:18:25.648384+0000","last_active":"2023-08-25T04:18:27.987839+0000","last_peered":"2023-08-25T04:18:27.987839+0000","last_clean":"2023-08-25T04:18:27.987839+0000","last_became_active":"2023-08-25T04:18:25.648109+0000","last_became_peered":"2023-08-25T04:18:25.648109+0000","last_unstale":"2023-08-25T04:18:27.987839+0000","last_undegraded":"2023-08-25T04:18:27.987839+0000","last_fullsized":"2023-08-25T04:18:27.987839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:19:11.163585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913358+0000","last_change":"2023-08-25T04:18:24.905945+0000","last_active":"2023-08-25T04:18:26.913358+0000","last_peered":"2023-08-25T04:18:26.913358+0000","last_clean":"2023-08-25T04:18:26.913358+0000","last_became_active":"2023-08-25T04:18:24.905484+0000","last_became_peered":"2023-08-25T04:18:24.905484+0000","last_unstale":"2023-08-25T04:18:26.913358+0000","last_undegraded":"2023-08-25T04:18:26.913358+0000","last_fullsized":"2023-08-25T04:18:26.913358+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:36:22.100902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.626386+0000","last_change":"2023-08-25T04:18:25.639545+0000","last_active":"2023-08-25T04:18:26.626386+0000","last_peered":"2023-08-25T04:18:26.626386+0000","last_clean":"2023-08-25T04:18:26.626386+0000","last_became_active":"2023-08-25T04:18:25.639248+0000","last_became_peered":"2023-08-25T04:18:25.639248+0000","last_unstale":"2023-08-25T04:18:26.626386+0000","last_undegraded":"2023-08-25T04:18:26.626386+0000","last_fullsized":"2023-08-25T04:18:26.626386+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:11:41.782870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.987676+0000","last_change":"2023-08-25T04:18:24.905989+0000","last_active":"2023-08-25T04:18:27.987676+0000","last_peered":"2023-08-25T04:18:27.987676+0000","last_clean":"2023-08-25T04:18:27.987676+0000","last_became_active":"2023-08-25T04:18:24.905715+0000","last_became_peered":"2023-08-25T04:18:24.905715+0000","last_unstale":"2023-08-25T04:18:27.987676+0000","last_undegraded":"2023-08-25T04:18:27.987676+0000","last_fullsized":"2023-08-25T04:18:27.987676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:29:59.564380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622177+0000","last_change":"2023-08-25T04:18:25.626744+0000","last_active":"2023-08-25T04:18:26.622177+0000","last_peered":"2023-08-25T04:18:26.622177+0000","last_clean":"2023-08-25T04:18:26.622177+0000","last_became_active":"2023-08-25T04:18:25.626420+0000","last_became_peered":"2023-08-25T04:18:25.626420+0000","last_unstale":"2023-08-25T04:18:26.622177+0000","last_undegraded":"2023-08-25T04:18:26.622177+0000","last_fullsized":"2023-08-25T04:18:26.622177+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:03.483804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913290+0000","last_change":"2023-08-25T04:18:24.902518+0000","last_active":"2023-08-25T04:18:26.913290+0000","last_peered":"2023-08-25T04:18:26.913290+0000","last_clean":"2023-08-25T04:18:26.913290+0000","last_became_active":"2023-08-25T04:18:24.901881+0000","last_became_peered":"2023-08-25T04:18:24.901881+0000","last_unstale":"2023-08-25T04:18:26.913290+0000","last_undegraded":"2023-08-25T04:18:26.913290+0000","last_fullsized":"2023-08-25T04:18:26.913290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:10:20.409803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"66'161","reported_seq":432,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354301+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:18:27.354301+0000","last_peered":"2023-08-25T04:18:27.354301+0000","last_clean":"2023-08-25T04:18:27.354301+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:18:27.354301+0000","last_undegraded":"2023-08-25T04:18:27.354301+0000","last_fullsized":"2023-08-25T04:18:27.354301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:00:56.156033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639548+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:18:27.639548+0000","last_peered":"2023-08-25T04:18:27.639548+0000","last_clean":"2023-08-25T04:18:27.639548+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:18:27.639548+0000","last_undegraded":"2023-08-25T04:18:27.639548+0000","last_fullsized":"2023-08-25T04:18:27.639548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:44:10.840769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487481+0000","last_change":"2023-08-25T04:18:25.646053+0000","last_active":"2023-08-25T04:18:27.487481+0000","last_peered":"2023-08-25T04:18:27.487481+0000","last_clean":"2023-08-25T04:18:27.487481+0000","last_became_active":"2023-08-25T04:18:25.645761+0000","last_became_peered":"2023-08-25T04:18:25.645761+0000","last_unstale":"2023-08-25T04:18:27.487481+0000","last_undegraded":"2023-08-25T04:18:27.487481+0000","last_fullsized":"2023-08-25T04:18:27.487481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:16:07.776812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"78'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487406+0000","last_change":"2023-08-25T04:18:24.904470+0000","last_active":"2023-08-25T04:18:27.487406+0000","last_peered":"2023-08-25T04:18:27.487406+0000","last_clean":"2023-08-25T04:18:27.487406+0000","last_became_active":"2023-08-25T04:18:24.904153+0000","last_became_peered":"2023-08-25T04:18:24.904153+0000","last_unstale":"2023-08-25T04:18:27.487406+0000","last_undegraded":"2023-08-25T04:18:27.487406+0000","last_fullsized":"2023-08-25T04:18:27.487406+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:54:42.997672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354106+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:18:27.354106+0000","last_peered":"2023-08-25T04:18:27.354106+0000","last_clean":"2023-08-25T04:18:27.354106+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:18:27.354106+0000","last_undegraded":"2023-08-25T04:18:27.354106+0000","last_fullsized":"2023-08-25T04:18:27.354106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:21:29.823766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639082+0000","last_change":"2023-08-25T04:18:25.634929+0000","last_active":"2023-08-25T04:18:27.639082+0000","last_peered":"2023-08-25T04:18:27.639082+0000","last_clean":"2023-08-25T04:18:27.639082+0000","last_became_active":"2023-08-25T04:18:25.634595+0000","last_became_peered":"2023-08-25T04:18:25.634595+0000","last_unstale":"2023-08-25T04:18:27.639082+0000","last_undegraded":"2023-08-25T04:18:27.639082+0000","last_fullsized":"2023-08-25T04:18:27.639082+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:38.444688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639270+0000","last_change":"2023-08-25T04:18:24.910073+0000","last_active":"2023-08-25T04:18:27.639270+0000","last_peered":"2023-08-25T04:18:27.639270+0000","last_clean":"2023-08-25T04:18:27.639270+0000","last_became_active":"2023-08-25T04:18:24.909786+0000","last_became_peered":"2023-08-25T04:18:24.909786+0000","last_unstale":"2023-08-25T04:18:27.639270+0000","last_undegraded":"2023-08-25T04:18:27.639270+0000","last_fullsized":"2023-08-25T04:18:27.639270+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:03:17.092706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.626273+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:18:26.626273+0000","last_peered":"2023-08-25T04:18:26.626273+0000","last_clean":"2023-08-25T04:18:26.626273+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:18:26.626273+0000","last_undegraded":"2023-08-25T04:18:26.626273+0000","last_fullsized":"2023-08-25T04:18:26.626273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:11:12.903416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621793+0000","last_change":"2023-08-25T04:18:25.639808+0000","last_active":"2023-08-25T04:18:26.621793+0000","last_peered":"2023-08-25T04:18:26.621793+0000","last_clean":"2023-08-25T04:18:26.621793+0000","last_became_active":"2023-08-25T04:18:25.639518+0000","last_became_peered":"2023-08-25T04:18:25.639518+0000","last_unstale":"2023-08-25T04:18:26.621793+0000","last_undegraded":"2023-08-25T04:18:26.621793+0000","last_fullsized":"2023-08-25T04:18:26.621793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:13:54.669554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487259+0000","last_change":"2023-08-25T04:18:24.905940+0000","last_active":"2023-08-25T04:18:27.487259+0000","last_peered":"2023-08-25T04:18:27.487259+0000","last_clean":"2023-08-25T04:18:27.487259+0000","last_became_active":"2023-08-25T04:18:24.905665+0000","last_became_peered":"2023-08-25T04:18:24.905665+0000","last_unstale":"2023-08-25T04:18:27.487259+0000","last_undegraded":"2023-08-25T04:18:27.487259+0000","last_fullsized":"2023-08-25T04:18:27.487259+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:55:40.771068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639453+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:18:27.639453+0000","last_peered":"2023-08-25T04:18:27.639453+0000","last_clean":"2023-08-25T04:18:27.639453+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:18:27.639453+0000","last_undegraded":"2023-08-25T04:18:27.639453+0000","last_fullsized":"2023-08-25T04:18:27.639453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:38:45.203164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354297+0000","last_change":"2023-08-25T04:18:25.650463+0000","last_active":"2023-08-25T04:18:27.354297+0000","last_peered":"2023-08-25T04:18:27.354297+0000","last_clean":"2023-08-25T04:18:27.354297+0000","last_became_active":"2023-08-25T04:18:25.650170+0000","last_became_peered":"2023-08-25T04:18:25.650170+0000","last_unstale":"2023-08-25T04:18:27.354297+0000","last_undegraded":"2023-08-25T04:18:27.354297+0000","last_fullsized":"2023-08-25T04:18:27.354297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:23:22.942225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639460+0000","last_change":"2023-08-25T04:18:24.910069+0000","last_active":"2023-08-25T04:18:27.639460+0000","last_peered":"2023-08-25T04:18:27.639460+0000","last_clean":"2023-08-25T04:18:27.639460+0000","last_became_active":"2023-08-25T04:18:24.909746+0000","last_became_peered":"2023-08-25T04:18:24.909746+0000","last_unstale":"2023-08-25T04:18:27.639460+0000","last_undegraded":"2023-08-25T04:18:27.639460+0000","last_fullsized":"2023-08-25T04:18:27.639460+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:40.105378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988154+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:18:27.988154+0000","last_peered":"2023-08-25T04:18:27.988154+0000","last_clean":"2023-08-25T04:18:27.988154+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:18:27.988154+0000","last_undegraded":"2023-08-25T04:18:27.988154+0000","last_fullsized":"2023-08-25T04:18:27.988154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:41.775519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622270+0000","last_change":"2023-08-25T04:18:25.650779+0000","last_active":"2023-08-25T04:18:26.622270+0000","last_peered":"2023-08-25T04:18:26.622270+0000","last_clean":"2023-08-25T04:18:26.622270+0000","last_became_active":"2023-08-25T04:18:25.650503+0000","last_became_peered":"2023-08-25T04:18:25.650503+0000","last_unstale":"2023-08-25T04:18:26.622270+0000","last_undegraded":"2023-08-25T04:18:26.622270+0000","last_fullsized":"2023-08-25T04:18:26.622270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:58:44.797135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"78'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354588+0000","last_change":"2023-08-25T04:18:24.907797+0000","last_active":"2023-08-25T04:18:27.354588+0000","last_peered":"2023-08-25T04:18:27.354588+0000","last_clean":"2023-08-25T04:18:27.354588+0000","last_became_active":"2023-08-25T04:18:24.907495+0000","last_became_peered":"2023-08-25T04:18:24.907495+0000","last_unstale":"2023-08-25T04:18:27.354588+0000","last_undegraded":"2023-08-25T04:18:27.354588+0000","last_fullsized":"2023-08-25T04:18:27.354588+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:28:01.606160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354446+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:18:27.354446+0000","last_peered":"2023-08-25T04:18:27.354446+0000","last_clean":"2023-08-25T04:18:27.354446+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:18:27.354446+0000","last_undegraded":"2023-08-25T04:18:27.354446+0000","last_fullsized":"2023-08-25T04:18:27.354446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:24:39.830576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621610+0000","last_change":"2023-08-25T04:18:25.646451+0000","last_active":"2023-08-25T04:18:26.621610+0000","last_peered":"2023-08-25T04:18:26.621610+0000","last_clean":"2023-08-25T04:18:26.621610+0000","last_became_active":"2023-08-25T04:18:25.646172+0000","last_became_peered":"2023-08-25T04:18:25.646172+0000","last_unstale":"2023-08-25T04:18:26.621610+0000","last_undegraded":"2023-08-25T04:18:26.621610+0000","last_fullsized":"2023-08-25T04:18:26.621610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:12:16.190797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354255+0000","last_change":"2023-08-25T04:18:24.910218+0000","last_active":"2023-08-25T04:18:27.354255+0000","last_peered":"2023-08-25T04:18:27.354255+0000","last_clean":"2023-08-25T04:18:27.354255+0000","last_became_active":"2023-08-25T04:18:24.909932+0000","last_became_peered":"2023-08-25T04:18:24.909932+0000","last_unstale":"2023-08-25T04:18:27.354255+0000","last_undegraded":"2023-08-25T04:18:27.354255+0000","last_fullsized":"2023-08-25T04:18:27.354255+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:47:06.078944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988138+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:18:27.988138+0000","last_peered":"2023-08-25T04:18:27.988138+0000","last_clean":"2023-08-25T04:18:27.988138+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:18:27.988138+0000","last_undegraded":"2023-08-25T04:18:27.988138+0000","last_fullsized":"2023-08-25T04:18:27.988138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:19:52.647328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622400+0000","last_change":"2023-08-25T04:18:25.631264+0000","last_active":"2023-08-25T04:18:26.622400+0000","last_peered":"2023-08-25T04:18:26.622400+0000","last_clean":"2023-08-25T04:18:26.622400+0000","last_became_active":"2023-08-25T04:18:25.630918+0000","last_became_peered":"2023-08-25T04:18:25.630918+0000","last_unstale":"2023-08-25T04:18:26.622400+0000","last_undegraded":"2023-08-25T04:18:26.622400+0000","last_fullsized":"2023-08-25T04:18:26.622400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:57:21.375228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913607+0000","last_change":"2023-08-25T04:18:24.904317+0000","last_active":"2023-08-25T04:18:26.913607+0000","last_peered":"2023-08-25T04:18:26.913607+0000","last_clean":"2023-08-25T04:18:26.913607+0000","last_became_active":"2023-08-25T04:18:24.904026+0000","last_became_peered":"2023-08-25T04:18:24.904026+0000","last_unstale":"2023-08-25T04:18:26.913607+0000","last_undegraded":"2023-08-25T04:18:26.913607+0000","last_fullsized":"2023-08-25T04:18:26.913607+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:27:00.804890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622101+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:18:26.622101+0000","last_peered":"2023-08-25T04:18:26.622101+0000","last_clean":"2023-08-25T04:18:26.622101+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:18:26.622101+0000","last_undegraded":"2023-08-25T04:18:26.622101+0000","last_fullsized":"2023-08-25T04:18:26.622101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:07:18.885053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509630,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46588,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325252,"statfs":{"total":96636764160,"available":96589058048,"internally_reserved":0,"allocated":1556480,"data_stored":1054859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.45200000000000001,"5min":0.39600000000000002,"15min":0.29199999999999998},"max":{"1min":0.88800000000000001,"5min":0.996,"15min":1.0189999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.80400000000000005}]},{"osd":1,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.42699999999999999},"max":{"1min":0.88,"5min":1.0149999999999999,"15min":1.034},"last":0.749},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.47099999999999997,"5min":0.44700000000000001,"15min":0.374},"max":{"1min":0.89600000000000002,"5min":0.96099999999999997,"15min":1.036},"last":0.83599999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51700000000000002,"5min":0.42299999999999999,"15min":0.34899999999999998},"max":{"1min":0.94299999999999995,"5min":0.94499999999999995,"15min":1.018},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.54400000000000004,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":0.92300000000000004,"5min":0.98699999999999999,"15min":0.999},"last":0.86399999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.55000000000000004,"5min":0.47799999999999998,"15min":0.41899999999999998},"max":{"1min":0.90100000000000002,"5min":0.92900000000000005,"15min":0.98399999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.754,"15min":0.75600000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.432},"max":{"1min":1.012,"5min":1.04,"15min":1.0449999999999999},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41599999999999998,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.82599999999999996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.623},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":0.90400000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.60199999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60799999999999998,"15min":0.61899999999999999},"min":{"1min":0.46300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.96799999999999997,"5min":0.99199999999999999,"15min":0.998},"last":0.502},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.48699999999999999,"5min":0.41099999999999998,"15min":0.40000000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.0349999999999999},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.436},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.0620000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42399999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.77000000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509630,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36276,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":950272,"data_stored":463749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68600000000000005,"15min":0.70699999999999996},"min":{"1min":0.46300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97599999999999998,"5min":1.0089999999999999,"15min":1.0369999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68500000000000005,"15min":0.69799999999999995},"min":{"1min":0.46800000000000003,"5min":0.40400000000000003,"15min":0.33800000000000002},"max":{"1min":0.91900000000000004,"5min":0.96899999999999997,"15min":1.071},"last":0.32300000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.73099999999999998},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.1559999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.59699999999999998,"5min":0.495,"15min":0.47199999999999998},"max":{"1min":0.93500000000000005,"5min":0.996,"15min":1.077},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.47999999999999998,"5min":0.44,"15min":0.434},"max":{"1min":0.95199999999999996,"5min":0.98399999999999999,"15min":1.139},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.56299999999999994,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96099999999999997,"5min":1.0569999999999999,"15min":1.117},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.50600000000000001,"15min":0.46899999999999997},"max":{"1min":0.93400000000000005,"5min":1.0600000000000001,"15min":1.077},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90900000000000003,"5min":1.075,"15min":1.679},"last":0.55500000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.60099999999999998},"min":{"1min":0.42999999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93000000000000005,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":0.86799999999999999,"5min":0.92900000000000005,"15min":1.306},"last":0.56799999999999995}]},{"osd":5,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.56999999999999995,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":1.1120000000000001,"15min":1.5589999999999999},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.65300000000000002,"15min":0.66600000000000004},"min":{"1min":0.51400000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86699999999999999,"5min":1.032,"15min":1.1950000000000001},"last":0.441},{"interface":"front","average":{"1min":0.753,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.48799999999999999,"5min":0.44700000000000001,"15min":0.41799999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.4099999999999999},"last":0.625}]}]},{"osd":5,"up_from":14,"seq":60129542333,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":950272,"data_stored":463737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68200000000000005,"15min":0.70999999999999996},"min":{"1min":0.55800000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88500000000000001,"5min":0.94999999999999996,"15min":1.018},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.57499999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86699999999999999,"5min":0.995,"15min":1.0409999999999999},"last":0.78200000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72299999999999998,"15min":0.73699999999999999},"min":{"1min":0.52100000000000002,"5min":0.43099999999999999,"15min":0.36499999999999999},"max":{"1min":0.878,"5min":0.98699999999999999,"15min":0.99399999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.56899999999999995,"5min":0.47599999999999998,"15min":0.46200000000000002},"max":{"1min":0.90400000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.90300000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.42999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88500000000000001,"5min":0.97499999999999998,"15min":1.0269999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.55300000000000005,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.2290000000000001},"last":0.82999999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.59199999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92100000000000004,"5min":0.94199999999999995,"15min":1.4590000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.76600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.018,"15min":1.1479999999999999},"last":0.93700000000000006}]},{"osd":4,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.67000000000000004,"5min":0.97099999999999997,"15min":1.038},"last":0.443},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.79600000000000004,"5min":1.018,"15min":1.018},"last":0.47699999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.48299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":1.256},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.50800000000000001,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":0.90400000000000003,"5min":0.98299999999999998,"15min":1.4650000000000001},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61199999999999999,"15min":0.626},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.90900000000000003,"5min":1.002,"15min":1.2769999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69299999999999995,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":0.80000000000000004,"5min":0.96899999999999997,"15min":1.1819999999999999},"last":0.64000000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542333,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36288,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335552,"statfs":{"total":96636764160,"available":96599605248,"internally_reserved":0,"allocated":958464,"data_stored":465327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":0.70599999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.86599999999999999,"5min":0.99299999999999999,"15min":1.2649999999999999},"last":0.503},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.45500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85199999999999998,"5min":0.878,"15min":1.1639999999999999},"last":0.61599999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.45400000000000001,"5min":0.45100000000000001,"15min":0.36199999999999999},"max":{"1min":0.98399999999999999,"5min":1.0189999999999999,"15min":1.0449999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.47199999999999998,"15min":0.39100000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.74399999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.34000000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.66300000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.45100000000000001},"max":{"1min":0.91100000000000003,"5min":0.98299999999999998,"15min":1.048},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.76300000000000001,"15min":0.75900000000000001},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.48399999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38300000000000001,"5min":0.378,"15min":0.32200000000000001},"max":{"1min":0.77900000000000003,"5min":0.94799999999999995,"15min":0.94899999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.376,"15min":0.33200000000000002},"max":{"1min":0.81799999999999995,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.92800000000000005,"5min":1.093,"15min":1.093},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.40300000000000002},"max":{"1min":0.871,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.63400000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.441,"5min":0.435,"15min":0.36699999999999999},"max":{"1min":0.78700000000000003,"5min":0.90100000000000002,"15min":1.0609999999999999},"last":0.441},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69199999999999995,"15min":0.70399999999999996},"min":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.39300000000000002},"max":{"1min":0.92400000000000004,"5min":0.99399999999999999,"15min":1.0940000000000001},"last":0.64300000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542333,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335572,"statfs":{"total":96636764160,"available":96599625728,"internally_reserved":0,"allocated":946176,"data_stored":463715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.313,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.67200000000000004,"5min":0.93700000000000006,"15min":0.96899999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.70799999999999996,"5min":0.77100000000000002,"15min":0.91500000000000004},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.36599999999999999,"5min":0.32800000000000001,"15min":0.27000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.746},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.59499999999999997},"min":{"1min":0.41499999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80300000000000005,"5min":0.83099999999999996,"15min":0.92600000000000005},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":1.01},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.35299999999999998},"max":{"1min":0.72899999999999998,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.63100000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1719999999999999,"5min":1.214,"15min":1.4339999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.64200000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98599999999999999,"5min":1.2450000000000001,"15min":1.343},"last":1.0760000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56899999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0549999999999999,"5min":1.254,"15min":1.321},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":1.0900000000000001,"5min":1.1950000000000001,"15min":1.4750000000000001},"last":0.99099999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81000000000000005,"15min":0.80700000000000005},"min":{"1min":0.55800000000000005,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":1.077,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.119},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.61699999999999999,"5min":0.51600000000000001,"15min":0.50700000000000001},"max":{"1min":0.99299999999999999,"5min":1.0800000000000001,"15min":1.3600000000000001},"last":0.94699999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.68100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.042,"5min":1.077,"15min":1.383},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80600000000000005,"15min":0.79900000000000004},"min":{"1min":0.66200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.016,"5min":1.079,"15min":1.4019999999999999},"last":1.0049999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542334,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54320,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317520,"statfs":{"total":96636764160,"available":96581140480,"internally_reserved":0,"allocated":946176,"data_stored":463715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.378,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.65100000000000002,"5min":0.85599999999999998,"15min":1.196},"last":0.438},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.504,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68700000000000006,"5min":0.81000000000000005,"15min":1.4019999999999999},"last":0.27500000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48599999999999999,"15min":0.48899999999999999},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.69999999999999996,"5min":0.78800000000000003,"15min":1.482},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59599999999999997,"15min":0.60099999999999998},"min":{"1min":0.46100000000000002,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":1.458},"last":0.40999999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.34499999999999997},"max":{"1min":0.80300000000000005,"5min":0.82199999999999995,"15min":0.82299999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.40899999999999997,"5min":0.375,"15min":0.33700000000000002},"max":{"1min":0.751,"5min":0.85399999999999998,"15min":0.95599999999999996},"last":0.34499999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.80400000000000005,"15min":0.80100000000000005},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.499},"max":{"1min":0.98399999999999999,"5min":1.1990000000000001,"15min":1.2569999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.79000000000000004},"min":{"1min":0.51800000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0069999999999999,"5min":1.151,"15min":1.5509999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.80800000000000005,"15min":0.80400000000000005},"min":{"1min":0.63300000000000001,"5min":0.52600000000000002,"15min":0.47999999999999998},"max":{"1min":0.995,"5min":1.1140000000000001,"15min":1.2789999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.48299999999999998},"max":{"1min":1.02,"5min":1.2130000000000001,"15min":1.3089999999999999},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.93100000000000005,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85799999999999998,"15min":0.85699999999999998},"min":{"1min":0.68500000000000005,"5min":0.58799999999999997,"15min":0.55600000000000005},"max":{"1min":1.014,"5min":1.25,"15min":1.375},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81100000000000005,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":0.99199999999999999,"5min":1.2090000000000001,"15min":1.339},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81599999999999995,"15min":0.81299999999999994},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0149999999999999,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.58599999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542334,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36292,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335548,"statfs":{"total":96636764160,"available":96599601152,"internally_reserved":0,"allocated":974848,"data_stored":466091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.46300000000000002},"min":{"1min":0.27800000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66500000000000004,"5min":0.85599999999999998,"15min":1.218},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56299999999999994,"15min":0.52600000000000002},"min":{"1min":0.374,"5min":0.33200000000000002,"15min":0.29499999999999998},"max":{"1min":0.85099999999999998,"5min":1.212,"15min":1.212},"last":0.67400000000000004}]},{"osd":2,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51500000000000001,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66300000000000003,"5min":0.876,"15min":1.347},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":1.093},"last":0.63900000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.41599999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.74099999999999999,"5min":0.93100000000000005,"15min":1.1459999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.34699999999999998,"5min":0.34599999999999997,"15min":0.33200000000000002},"max":{"1min":0.84299999999999997,"5min":1.165,"15min":1.2190000000000001},"last":0.60299999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":1.004,"5min":1.204,"15min":1.47},"last":1.012},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.80300000000000005,"15min":0.81100000000000005},"min":{"1min":0.60399999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.0269999999999999,"5min":1.2529999999999999,"15min":1.395},"last":0.88}]},{"osd":5,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.45100000000000001},"max":{"1min":0.96499999999999997,"5min":1.254,"15min":1.292},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81299999999999994,"15min":0.81499999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51000000000000001},"max":{"1min":1.044,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.93300000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.70099999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.171,"5min":1.623,"15min":1.623},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82199999999999995,"15min":0.80600000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.54200000000000004},"max":{"1min":1.01,"5min":1.288,"15min":1.355},"last":0.89800000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.57399999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0760000000000001,"5min":1.1240000000000001,"15min":1.5429999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.63400000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.073,"5min":1.1140000000000001,"15min":1.504},"last":1}]}]},{"osd":0,"up_from":14,"seq":60129542333,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36852,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334988,"statfs":{"total":96636764160,"available":96599027712,"internally_reserved":0,"allocated":1540096,"data_stored":1054083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.501,"15min":0.48899999999999999},"min":{"1min":0.30399999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67700000000000005,"5min":0.72499999999999998,"15min":0.79500000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.68400000000000005,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70099999999999996,"5min":0.82299999999999995,"15min":0.97499999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55500000000000005,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":0.876,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.45900000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48899999999999999,"15min":0.499},"min":{"1min":0.36299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.266},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.45600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76800000000000002,"5min":0.85099999999999998,"15min":1.2470000000000001},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.79900000000000004},"min":{"1min":0.60799999999999998,"5min":0.52600000000000002,"15min":0.503},"max":{"1min":1.048,"5min":1.1739999999999999,"15min":1.306},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.58699999999999997,"5min":0.497,"15min":0.436},"max":{"1min":1.169,"5min":1.169,"15min":1.262},"last":0.73299999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81499999999999995,"15min":0.80500000000000005},"min":{"1min":0.57499999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.131,"5min":3.528,"15min":3.528},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.53000000000000003,"5min":0.47199999999999998,"15min":0.45500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.373},"last":0.752}]},{"osd":6,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81699999999999995,"15min":0.80600000000000005},"min":{"1min":0.60599999999999998,"5min":0.54400000000000004,"15min":0.53000000000000003},"max":{"1min":1.0680000000000001,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60999999999999999,"5min":0.52700000000000002,"15min":0.47399999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.331},"last":0.877}]},{"osd":7,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83799999999999997,"15min":0.84699999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.52900000000000003},"max":{"1min":1.151,"5min":1.151,"15min":1.4059999999999999},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.64600000000000002,"5min":0.53200000000000003,"15min":0.499},"max":{"1min":1.0940000000000001,"5min":1.1220000000000001,"15min":1.3169999999999999},"last":0.76900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:18:34.562 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:18:34.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.718+0000 7f8161c15640 1 Processor -- start 2023-08-25T04:18:34.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.718+0000 7f8161c15640 1 -- start start 2023-08-25T04:18:34.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.722+0000 7f8161c15640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f815c15eba0 0x7f815c0b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:34.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.722+0000 7f8161c15640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c0ceeb0 0x7f815c0ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:34.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.722+0000 7f8161c15640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f815c0ac3a0 con 0x7f815c15ef80 2023-08-25T04:18:34.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.722+0000 7f8161c15640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f815c0b1390 con 0x7f815c15eba0 2023-08-25T04:18:34.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.722+0000 7f8161c15640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815c0b1670 con 0x7f815c0ceeb0 2023-08-25T04:18:34.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.722+0000 7f8153fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f815c15ef80 0x7f815c0ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44506/0 (socket says 172.21.15.55:44506) 2023-08-25T04:18:34.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.722+0000 7f8153fff640 1 -- 172.21.15.55:0/984511543 learned_addr learned my addr 172.21.15.55:0/984511543 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:34.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.722+0000 7f815bfff640 1 --2- 172.21.15.55:0/984511543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c0ceeb0 0x7f815c0ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:34.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.722+0000 7f815b7fe640 1 --2- 172.21.15.55:0/984511543 >> v2:172.21.15.110:3300/0 conn(0x7f815c15eba0 0x7f815c0b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:34.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.722+0000 7f815affd640 1 -- 172.21.15.55:0/984511543 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913252944 0 0) 0x7f815c0ac3a0 con 0x7f815c15ef80 2023-08-25T04:18:34.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.722+0000 7f815affd640 1 -- 172.21.15.55:0/984511543 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8148003530 con 0x7f815c15ef80 2023-08-25T04:18:34.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.722+0000 7f815bfff640 1 -- 172.21.15.55:0/984511543 >> v2:172.21.15.110:3300/0 conn(0x7f815c15eba0 msgr2=0x7f815c0b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:34.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.722+0000 7f815bfff640 1 --2- 172.21.15.55:0/984511543 >> v2:172.21.15.110:3300/0 conn(0x7f815c15eba0 0x7f815c0b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:34.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.722+0000 7f815bfff640 1 -- 172.21.15.55:0/984511543 >> v1:172.21.15.55:6789/0 conn(0x7f815c15ef80 legacy=0x7f815c0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:34.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.722+0000 7f815bfff640 1 -- 172.21.15.55:0/984511543 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815c0b1950 con 0x7f815c0ceeb0 2023-08-25T04:18:34.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.726+0000 7f815bfff640 1 --2- 172.21.15.55:0/984511543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c0ceeb0 0x7f815c0ab0f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8154009d90 tx=0x7f815401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb088719ed9d2f26 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:34.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.726+0000 7f815affd640 1 -- 172.21.15.55:0/984511543 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81540a59e0 con 0x7f815c0ceeb0 2023-08-25T04:18:34.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.726+0000 7f815affd640 1 -- 172.21.15.55:0/984511543 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81540a5b40 con 0x7f815c0ceeb0 2023-08-25T04:18:34.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.726+0000 7f815affd640 1 -- 172.21.15.55:0/984511543 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81540ad440 con 0x7f815c0ceeb0 2023-08-25T04:18:34.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.726+0000 7f8161c15640 1 -- 172.21.15.55:0/984511543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c0ceeb0 msgr2=0x7f815c0ab0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:34.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.726+0000 7f8161c15640 1 --2- 172.21.15.55:0/984511543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c0ceeb0 0x7f815c0ab0f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8154009d90 tx=0x7f815401c920 comp rx=0 tx=0).stop 2023-08-25T04:18:34.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.726+0000 7f8161c15640 1 -- 172.21.15.55:0/984511543 shutdown_connections 2023-08-25T04:18:34.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.726+0000 7f8161c15640 1 --2- 172.21.15.55:0/984511543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c0ceeb0 0x7f815c0ab0f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:34.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.726+0000 7f8161c15640 1 --2- 172.21.15.55:0/984511543 >> v2:172.21.15.110:3300/0 conn(0x7f815c15eba0 0x7f815c0b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:34.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.726+0000 7f8161c15640 1 -- 172.21.15.55:0/984511543 >> 172.21.15.55:0/984511543 conn(0x7f815c069d00 msgr2=0x7f815c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:34.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.726+0000 7f8161c15640 1 -- 172.21.15.55:0/984511543 shutdown_connections 2023-08-25T04:18:34.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.726+0000 7f8161c15640 1 -- 172.21.15.55:0/984511543 wait complete. 2023-08-25T04:18:34.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.726+0000 7f8161c15640 1 Processor -- start 2023-08-25T04:18:34.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.726+0000 7f8161c15640 1 -- start start 2023-08-25T04:18:34.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f8161c15640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f815c0ceeb0 0x7f815c147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:34.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f8161c15640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f815c15eba0 0x7f815c06b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:34.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f8161c15640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c15ef80 0x7f815c0ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:34.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f8161c15640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c06c360 con 0x7f815c0ceeb0 2023-08-25T04:18:34.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f8161c15640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c06c640 con 0x7f815c15eba0 2023-08-25T04:18:34.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f8161c15640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815c06c920 con 0x7f815c15ef80 2023-08-25T04:18:34.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f815b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f815c0ceeb0 0x7f815c147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:34.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f815b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f815c0ceeb0 0x7f815c147f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45288/0 (socket says 172.21.15.55:45288) 2023-08-25T04:18:34.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f815b7fe640 1 -- 172.21.15.55:0/256865636 learned_addr learned my addr 172.21.15.55:0/256865636 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:34.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f815bfff640 1 --2- 172.21.15.55:0/256865636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c15ef80 0x7f815c0ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:34.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f8153fff640 1 --2- 172.21.15.55:0/256865636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f815c15eba0 0x7f815c06b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:34.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f815b7fe640 1 -- 172.21.15.55:0/256865636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c15ef80 msgr2=0x7f815c0ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:34.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f815b7fe640 1 --2- 172.21.15.55:0/256865636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c15ef80 0x7f815c0ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:34.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f815b7fe640 1 -- 172.21.15.55:0/256865636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f815c15eba0 msgr2=0x7f815c06b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:34.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f815b7fe640 1 --2- 172.21.15.55:0/256865636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f815c15eba0 0x7f815c06b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:34.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f815b7fe640 1 -- 172.21.15.55:0/256865636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8154009a70 con 0x7f815c0ceeb0 2023-08-25T04:18:34.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f8153fff640 1 --2- 172.21.15.55:0/256865636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f815c15eba0 0x7f815c06b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:34.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f815b7fe640 1 --2- 172.21.15.55:0/256865636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f815c0ceeb0 0x7f815c147f90 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f814c00e930 tx=0x7f814c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:34.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f8158ff9640 1 -- 172.21.15.55:0/256865636 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c009690 con 0x7f815c0ceeb0 2023-08-25T04:18:34.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f8158ff9640 1 -- 172.21.15.55:0/256865636 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814c00ca00 con 0x7f815c0ceeb0 2023-08-25T04:18:34.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f8158ff9640 1 -- 172.21.15.55:0/256865636 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c00cd70 con 0x7f815c0ceeb0 2023-08-25T04:18:34.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f8161c15640 1 -- 172.21.15.55:0/256865636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815c06cc00 con 0x7f815c0ceeb0 2023-08-25T04:18:34.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f8161c15640 1 -- 172.21.15.55:0/256865636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815c1484d0 con 0x7f815c0ceeb0 2023-08-25T04:18:34.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.730+0000 7f8161c15640 1 -- 172.21.15.55:0/256865636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815c04dbe0 con 0x7f815c0ceeb0 2023-08-25T04:18:34.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.734+0000 7f8158ff9640 1 -- 172.21.15.55:0/256865636 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f814c013470 con 0x7f815c0ceeb0 2023-08-25T04:18:34.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.734+0000 7f8158ff9640 1 --2- 172.21.15.55:0/256865636 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f813c0657a0 0x7f813c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:34.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.734+0000 7f8158ff9640 1 -- 172.21.15.55:0/256865636 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f814c083300 con 0x7f815c0ceeb0 2023-08-25T04:18:34.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.734+0000 7f8153fff640 1 --2- 172.21.15.55:0/256865636 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f813c0657a0 0x7f813c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:34.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.734+0000 7f8153fff640 1 --2- 172.21.15.55:0/256865636 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f813c0657a0 0x7f813c067c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f815c1f8050 tx=0x7f8144009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:34.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.738+0000 7f8158ff9640 1 -- 172.21.15.55:0/256865636 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f814c050c70 con 0x7f815c0ceeb0 2023-08-25T04:18:34.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.890+0000 7f8161c15640 1 -- 172.21.15.55:0/256865636 --> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f815c0abe40 con 0x7f813c0657a0 2023-08-25T04:18:34.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.898+0000 7f8158ff9640 1 -- 172.21.15.55:0/256865636 <== mgr.5720 v2:172.21.15.110:6832/2283645732 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311339 (secure 0 0 0) 0x7f8144001480 con 0x7f813c0657a0 2023-08-25T04:18:34.900 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:34.901 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:18:34.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.902+0000 7f8161c15640 1 -- 172.21.15.55:0/256865636 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f813c0657a0 msgr2=0x7f813c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:34.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.902+0000 7f8161c15640 1 --2- 172.21.15.55:0/256865636 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f813c0657a0 0x7f813c067c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f815c1f8050 tx=0x7f8144009040 comp rx=0 tx=0).stop 2023-08-25T04:18:34.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.902+0000 7f8161c15640 1 -- 172.21.15.55:0/256865636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f815c0ceeb0 msgr2=0x7f815c147f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:34.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.902+0000 7f8161c15640 1 --2- 172.21.15.55:0/256865636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f815c0ceeb0 0x7f815c147f90 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f814c00e930 tx=0x7f814c00edf0 comp rx=0 tx=0).stop 2023-08-25T04:18:34.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.902+0000 7f8161c15640 1 -- 172.21.15.55:0/256865636 shutdown_connections 2023-08-25T04:18:34.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.902+0000 7f8161c15640 1 --2- 172.21.15.55:0/256865636 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f813c0657a0 0x7f813c067c60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:34.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.902+0000 7f8161c15640 1 --2- 172.21.15.55:0/256865636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f815c15ef80 0x7f815c0ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:34.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.902+0000 7f8161c15640 1 --2- 172.21.15.55:0/256865636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f815c15eba0 0x7f815c06b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:34.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.902+0000 7f8161c15640 1 --2- 172.21.15.55:0/256865636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f815c0ceeb0 0x7f815c147f90 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:34.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.902+0000 7f8161c15640 1 -- 172.21.15.55:0/256865636 >> 172.21.15.55:0/256865636 conn(0x7f815c069d00 msgr2=0x7f815c0ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:34.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.902+0000 7f8161c15640 1 -- 172.21.15.55:0/256865636 shutdown_connections 2023-08-25T04:18:34.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:34.902+0000 7f8161c15640 1 -- 172.21.15.55:0/256865636 wait complete. 2023-08-25T04:18:34.921 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-08-25T04:18:34.546745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":284,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":314996,"kb_used_data":8616,"kb_used_omap":13,"kb_used_meta":306226,"kb_avail":754659724,"statfs":{"total":773094113280,"available":772771557376,"internally_reserved":0,"allocated":8822784,"data_stored":4895276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":313575512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.929679"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988082+0000","last_change":"2023-08-25T04:18:25.632248+0000","last_active":"2023-08-25T04:18:27.988082+0000","last_peered":"2023-08-25T04:18:27.988082+0000","last_clean":"2023-08-25T04:18:27.988082+0000","last_became_active":"2023-08-25T04:18:25.631989+0000","last_became_peered":"2023-08-25T04:18:25.631989+0000","last_unstale":"2023-08-25T04:18:27.988082+0000","last_undegraded":"2023-08-25T04:18:27.988082+0000","last_fullsized":"2023-08-25T04:18:27.988082+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:57:44.313097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988169+0000","last_change":"2023-08-25T04:18:25.646606+0000","last_active":"2023-08-25T04:18:27.988169+0000","last_peered":"2023-08-25T04:18:27.988169+0000","last_clean":"2023-08-25T04:18:27.988169+0000","last_became_active":"2023-08-25T04:18:25.646224+0000","last_became_peered":"2023-08-25T04:18:25.646224+0000","last_unstale":"2023-08-25T04:18:27.988169+0000","last_undegraded":"2023-08-25T04:18:27.988169+0000","last_fullsized":"2023-08-25T04:18:27.988169+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:10:21.413051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354105+0000","last_change":"2023-08-25T04:18:25.644136+0000","last_active":"2023-08-25T04:18:27.354105+0000","last_peered":"2023-08-25T04:18:27.354105+0000","last_clean":"2023-08-25T04:18:27.354105+0000","last_became_active":"2023-08-25T04:18:25.643817+0000","last_became_peered":"2023-08-25T04:18:25.643817+0000","last_unstale":"2023-08-25T04:18:27.354105+0000","last_undegraded":"2023-08-25T04:18:27.354105+0000","last_fullsized":"2023-08-25T04:18:27.354105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:26:49.732872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622042+0000","last_change":"2023-08-25T04:18:25.650618+0000","last_active":"2023-08-25T04:18:26.622042+0000","last_peered":"2023-08-25T04:18:26.622042+0000","last_clean":"2023-08-25T04:18:26.622042+0000","last_became_active":"2023-08-25T04:18:25.650299+0000","last_became_peered":"2023-08-25T04:18:25.650299+0000","last_unstale":"2023-08-25T04:18:26.622042+0000","last_undegraded":"2023-08-25T04:18:26.622042+0000","last_fullsized":"2023-08-25T04:18:26.622042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:38:34.910047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622042+0000","last_change":"2023-08-25T04:18:25.650314+0000","last_active":"2023-08-25T04:18:26.622042+0000","last_peered":"2023-08-25T04:18:26.622042+0000","last_clean":"2023-08-25T04:18:26.622042+0000","last_became_active":"2023-08-25T04:18:25.649935+0000","last_became_peered":"2023-08-25T04:18:25.649935+0000","last_unstale":"2023-08-25T04:18:26.622042+0000","last_undegraded":"2023-08-25T04:18:26.622042+0000","last_fullsized":"2023-08-25T04:18:26.622042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:01:19.163570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487485+0000","last_change":"2023-08-25T04:18:25.645148+0000","last_active":"2023-08-25T04:18:27.487485+0000","last_peered":"2023-08-25T04:18:27.487485+0000","last_clean":"2023-08-25T04:18:27.487485+0000","last_became_active":"2023-08-25T04:18:25.644745+0000","last_became_peered":"2023-08-25T04:18:25.644745+0000","last_unstale":"2023-08-25T04:18:27.487485+0000","last_undegraded":"2023-08-25T04:18:27.487485+0000","last_fullsized":"2023-08-25T04:18:27.487485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:46:23.043397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.626230+0000","last_change":"2023-08-25T04:18:25.644903+0000","last_active":"2023-08-25T04:18:26.626230+0000","last_peered":"2023-08-25T04:18:26.626230+0000","last_clean":"2023-08-25T04:18:26.626230+0000","last_became_active":"2023-08-25T04:18:25.644579+0000","last_became_peered":"2023-08-25T04:18:25.644579+0000","last_unstale":"2023-08-25T04:18:26.626230+0000","last_undegraded":"2023-08-25T04:18:26.626230+0000","last_fullsized":"2023-08-25T04:18:26.626230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:07:40.265049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639112+0000","last_change":"2023-08-25T04:18:25.641045+0000","last_active":"2023-08-25T04:18:27.639112+0000","last_peered":"2023-08-25T04:18:27.639112+0000","last_clean":"2023-08-25T04:18:27.639112+0000","last_became_active":"2023-08-25T04:18:25.640675+0000","last_became_peered":"2023-08-25T04:18:25.640675+0000","last_unstale":"2023-08-25T04:18:27.639112+0000","last_undegraded":"2023-08-25T04:18:27.639112+0000","last_fullsized":"2023-08-25T04:18:27.639112+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:26:16.948622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354489+0000","last_change":"2023-08-25T04:18:25.648710+0000","last_active":"2023-08-25T04:18:27.354489+0000","last_peered":"2023-08-25T04:18:27.354489+0000","last_clean":"2023-08-25T04:18:27.354489+0000","last_became_active":"2023-08-25T04:18:25.648216+0000","last_became_peered":"2023-08-25T04:18:25.648216+0000","last_unstale":"2023-08-25T04:18:27.354489+0000","last_undegraded":"2023-08-25T04:18:27.354489+0000","last_fullsized":"2023-08-25T04:18:27.354489+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:55:54.614438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354387+0000","last_change":"2023-08-25T04:18:25.638928+0000","last_active":"2023-08-25T04:18:27.354387+0000","last_peered":"2023-08-25T04:18:27.354387+0000","last_clean":"2023-08-25T04:18:27.354387+0000","last_became_active":"2023-08-25T04:18:25.638626+0000","last_became_peered":"2023-08-25T04:18:25.638626+0000","last_unstale":"2023-08-25T04:18:27.354387+0000","last_undegraded":"2023-08-25T04:18:27.354387+0000","last_fullsized":"2023-08-25T04:18:27.354387+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:35:17.203801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622303+0000","last_change":"2023-08-25T04:18:25.649934+0000","last_active":"2023-08-25T04:18:26.622303+0000","last_peered":"2023-08-25T04:18:26.622303+0000","last_clean":"2023-08-25T04:18:26.622303+0000","last_became_active":"2023-08-25T04:18:25.649597+0000","last_became_peered":"2023-08-25T04:18:25.649597+0000","last_unstale":"2023-08-25T04:18:26.622303+0000","last_undegraded":"2023-08-25T04:18:26.622303+0000","last_fullsized":"2023-08-25T04:18:26.622303+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:43:59.285151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639307+0000","last_change":"2023-08-25T04:18:25.633014+0000","last_active":"2023-08-25T04:18:27.639307+0000","last_peered":"2023-08-25T04:18:27.639307+0000","last_clean":"2023-08-25T04:18:27.639307+0000","last_became_active":"2023-08-25T04:18:25.632704+0000","last_became_peered":"2023-08-25T04:18:25.632704+0000","last_unstale":"2023-08-25T04:18:27.639307+0000","last_undegraded":"2023-08-25T04:18:27.639307+0000","last_fullsized":"2023-08-25T04:18:27.639307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:17:27.157990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639481+0000","last_change":"2023-08-25T04:18:25.650920+0000","last_active":"2023-08-25T04:18:27.639481+0000","last_peered":"2023-08-25T04:18:27.639481+0000","last_clean":"2023-08-25T04:18:27.639481+0000","last_became_active":"2023-08-25T04:18:25.650310+0000","last_became_peered":"2023-08-25T04:18:25.650310+0000","last_unstale":"2023-08-25T04:18:27.639481+0000","last_undegraded":"2023-08-25T04:18:27.639481+0000","last_fullsized":"2023-08-25T04:18:27.639481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:16:04.390426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354066+0000","last_change":"2023-08-25T04:18:25.645185+0000","last_active":"2023-08-25T04:18:27.354066+0000","last_peered":"2023-08-25T04:18:27.354066+0000","last_clean":"2023-08-25T04:18:27.354066+0000","last_became_active":"2023-08-25T04:18:25.644849+0000","last_became_peered":"2023-08-25T04:18:25.644849+0000","last_unstale":"2023-08-25T04:18:27.354066+0000","last_undegraded":"2023-08-25T04:18:27.354066+0000","last_fullsized":"2023-08-25T04:18:27.354066+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:09.895509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.353927+0000","last_change":"2023-08-25T04:18:25.641201+0000","last_active":"2023-08-25T04:18:27.353927+0000","last_peered":"2023-08-25T04:18:27.353927+0000","last_clean":"2023-08-25T04:18:27.353927+0000","last_became_active":"2023-08-25T04:18:25.640897+0000","last_became_peered":"2023-08-25T04:18:25.640897+0000","last_unstale":"2023-08-25T04:18:27.353927+0000","last_undegraded":"2023-08-25T04:18:27.353927+0000","last_fullsized":"2023-08-25T04:18:27.353927+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:37.661289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.626242+0000","last_change":"2023-08-25T04:18:25.639360+0000","last_active":"2023-08-25T04:18:26.626242+0000","last_peered":"2023-08-25T04:18:26.626242+0000","last_clean":"2023-08-25T04:18:26.626242+0000","last_became_active":"2023-08-25T04:18:25.639046+0000","last_became_peered":"2023-08-25T04:18:25.639046+0000","last_unstale":"2023-08-25T04:18:26.626242+0000","last_undegraded":"2023-08-25T04:18:26.626242+0000","last_fullsized":"2023-08-25T04:18:26.626242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:15:41.847995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988094+0000","last_change":"2023-08-25T04:18:25.649762+0000","last_active":"2023-08-25T04:18:27.988094+0000","last_peered":"2023-08-25T04:18:27.988094+0000","last_clean":"2023-08-25T04:18:27.988094+0000","last_became_active":"2023-08-25T04:18:25.649504+0000","last_became_peered":"2023-08-25T04:18:25.649504+0000","last_unstale":"2023-08-25T04:18:27.988094+0000","last_undegraded":"2023-08-25T04:18:27.988094+0000","last_fullsized":"2023-08-25T04:18:27.988094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:46:28.827215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621593+0000","last_change":"2023-08-25T04:18:25.645876+0000","last_active":"2023-08-25T04:18:26.621593+0000","last_peered":"2023-08-25T04:18:26.621593+0000","last_clean":"2023-08-25T04:18:26.621593+0000","last_became_active":"2023-08-25T04:18:25.645451+0000","last_became_peered":"2023-08-25T04:18:25.645451+0000","last_unstale":"2023-08-25T04:18:26.621593+0000","last_undegraded":"2023-08-25T04:18:26.621593+0000","last_fullsized":"2023-08-25T04:18:26.621593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:43:05.117649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621813+0000","last_change":"2023-08-25T04:18:25.635545+0000","last_active":"2023-08-25T04:18:26.621813+0000","last_peered":"2023-08-25T04:18:26.621813+0000","last_clean":"2023-08-25T04:18:26.621813+0000","last_became_active":"2023-08-25T04:18:25.635234+0000","last_became_peered":"2023-08-25T04:18:25.635234+0000","last_unstale":"2023-08-25T04:18:26.621813+0000","last_undegraded":"2023-08-25T04:18:26.621813+0000","last_fullsized":"2023-08-25T04:18:26.621813+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:50:07.971510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913678+0000","last_change":"2023-08-25T04:18:25.638009+0000","last_active":"2023-08-25T04:18:26.913678+0000","last_peered":"2023-08-25T04:18:26.913678+0000","last_clean":"2023-08-25T04:18:26.913678+0000","last_became_active":"2023-08-25T04:18:25.637746+0000","last_became_peered":"2023-08-25T04:18:25.637746+0000","last_unstale":"2023-08-25T04:18:26.913678+0000","last_undegraded":"2023-08-25T04:18:26.913678+0000","last_fullsized":"2023-08-25T04:18:26.913678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:46.047372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639432+0000","last_change":"2023-08-25T04:18:25.626842+0000","last_active":"2023-08-25T04:18:27.639432+0000","last_peered":"2023-08-25T04:18:27.639432+0000","last_clean":"2023-08-25T04:18:27.639432+0000","last_became_active":"2023-08-25T04:18:25.626550+0000","last_became_peered":"2023-08-25T04:18:25.626550+0000","last_unstale":"2023-08-25T04:18:27.639432+0000","last_undegraded":"2023-08-25T04:18:27.639432+0000","last_fullsized":"2023-08-25T04:18:27.639432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:53:42.891883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913419+0000","last_change":"2023-08-25T04:18:25.642862+0000","last_active":"2023-08-25T04:18:26.913419+0000","last_peered":"2023-08-25T04:18:26.913419+0000","last_clean":"2023-08-25T04:18:26.913419+0000","last_became_active":"2023-08-25T04:18:25.642597+0000","last_became_peered":"2023-08-25T04:18:25.642597+0000","last_unstale":"2023-08-25T04:18:26.913419+0000","last_undegraded":"2023-08-25T04:18:26.913419+0000","last_fullsized":"2023-08-25T04:18:26.913419+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:08:11.703878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913345+0000","last_change":"2023-08-25T04:18:25.638154+0000","last_active":"2023-08-25T04:18:26.913345+0000","last_peered":"2023-08-25T04:18:26.913345+0000","last_clean":"2023-08-25T04:18:26.913345+0000","last_became_active":"2023-08-25T04:18:25.637005+0000","last_became_peered":"2023-08-25T04:18:25.637005+0000","last_unstale":"2023-08-25T04:18:26.913345+0000","last_undegraded":"2023-08-25T04:18:26.913345+0000","last_fullsized":"2023-08-25T04:18:26.913345+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:00:33.451750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.353913+0000","last_change":"2023-08-25T04:18:25.644071+0000","last_active":"2023-08-25T04:18:27.353913+0000","last_peered":"2023-08-25T04:18:27.353913+0000","last_clean":"2023-08-25T04:18:27.353913+0000","last_became_active":"2023-08-25T04:18:25.643750+0000","last_became_peered":"2023-08-25T04:18:25.643750+0000","last_unstale":"2023-08-25T04:18:27.353913+0000","last_undegraded":"2023-08-25T04:18:27.353913+0000","last_fullsized":"2023-08-25T04:18:27.353913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:22:07.017092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639550+0000","last_change":"2023-08-25T04:18:25.636859+0000","last_active":"2023-08-25T04:18:27.639550+0000","last_peered":"2023-08-25T04:18:27.639550+0000","last_clean":"2023-08-25T04:18:27.639550+0000","last_became_active":"2023-08-25T04:18:25.636549+0000","last_became_peered":"2023-08-25T04:18:25.636549+0000","last_unstale":"2023-08-25T04:18:27.639550+0000","last_undegraded":"2023-08-25T04:18:27.639550+0000","last_fullsized":"2023-08-25T04:18:27.639550+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:49:39.436600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639320+0000","last_change":"2023-08-25T04:18:25.630695+0000","last_active":"2023-08-25T04:18:27.639320+0000","last_peered":"2023-08-25T04:18:27.639320+0000","last_clean":"2023-08-25T04:18:27.639320+0000","last_became_active":"2023-08-25T04:18:25.630399+0000","last_became_peered":"2023-08-25T04:18:25.630399+0000","last_unstale":"2023-08-25T04:18:27.639320+0000","last_undegraded":"2023-08-25T04:18:27.639320+0000","last_fullsized":"2023-08-25T04:18:27.639320+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:56.085993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622443+0000","last_change":"2023-08-25T04:18:25.650015+0000","last_active":"2023-08-25T04:18:26.622443+0000","last_peered":"2023-08-25T04:18:26.622443+0000","last_clean":"2023-08-25T04:18:26.622443+0000","last_became_active":"2023-08-25T04:18:25.649723+0000","last_became_peered":"2023-08-25T04:18:25.649723+0000","last_unstale":"2023-08-25T04:18:26.622443+0000","last_undegraded":"2023-08-25T04:18:26.622443+0000","last_fullsized":"2023-08-25T04:18:26.622443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:05:46.710064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.987894+0000","last_change":"2023-08-25T04:18:25.631594+0000","last_active":"2023-08-25T04:18:27.987894+0000","last_peered":"2023-08-25T04:18:27.987894+0000","last_clean":"2023-08-25T04:18:27.987894+0000","last_became_active":"2023-08-25T04:18:25.631232+0000","last_became_peered":"2023-08-25T04:18:25.631232+0000","last_unstale":"2023-08-25T04:18:27.987894+0000","last_undegraded":"2023-08-25T04:18:27.987894+0000","last_fullsized":"2023-08-25T04:18:27.987894+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:55:15.459228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354012+0000","last_change":"2023-08-25T04:18:25.651171+0000","last_active":"2023-08-25T04:18:27.354012+0000","last_peered":"2023-08-25T04:18:27.354012+0000","last_clean":"2023-08-25T04:18:27.354012+0000","last_became_active":"2023-08-25T04:18:25.650894+0000","last_became_peered":"2023-08-25T04:18:25.650894+0000","last_unstale":"2023-08-25T04:18:27.354012+0000","last_undegraded":"2023-08-25T04:18:27.354012+0000","last_fullsized":"2023-08-25T04:18:27.354012+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:42:12.796762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639142+0000","last_change":"2023-08-25T04:18:25.637488+0000","last_active":"2023-08-25T04:18:27.639142+0000","last_peered":"2023-08-25T04:18:27.639142+0000","last_clean":"2023-08-25T04:18:27.639142+0000","last_became_active":"2023-08-25T04:18:25.637054+0000","last_became_peered":"2023-08-25T04:18:25.637054+0000","last_unstale":"2023-08-25T04:18:27.639142+0000","last_undegraded":"2023-08-25T04:18:27.639142+0000","last_fullsized":"2023-08-25T04:18:27.639142+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:22:21.162328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621197+0000","last_change":"2023-08-25T04:18:25.646693+0000","last_active":"2023-08-25T04:18:26.621197+0000","last_peered":"2023-08-25T04:18:26.621197+0000","last_clean":"2023-08-25T04:18:26.621197+0000","last_became_active":"2023-08-25T04:18:25.646408+0000","last_became_peered":"2023-08-25T04:18:25.646408+0000","last_unstale":"2023-08-25T04:18:26.621197+0000","last_undegraded":"2023-08-25T04:18:26.621197+0000","last_fullsized":"2023-08-25T04:18:26.621197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:04:39.061279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487347+0000","last_change":"2023-08-25T04:18:25.641416+0000","last_active":"2023-08-25T04:18:27.487347+0000","last_peered":"2023-08-25T04:18:27.487347+0000","last_clean":"2023-08-25T04:18:27.487347+0000","last_became_active":"2023-08-25T04:18:25.641064+0000","last_became_peered":"2023-08-25T04:18:25.641064+0000","last_unstale":"2023-08-25T04:18:27.487347+0000","last_undegraded":"2023-08-25T04:18:27.487347+0000","last_fullsized":"2023-08-25T04:18:27.487347+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:16:11.355646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622411+0000","last_change":"2023-08-25T04:18:25.626775+0000","last_active":"2023-08-25T04:18:26.622411+0000","last_peered":"2023-08-25T04:18:26.622411+0000","last_clean":"2023-08-25T04:18:26.622411+0000","last_became_active":"2023-08-25T04:18:25.626462+0000","last_became_peered":"2023-08-25T04:18:25.626462+0000","last_unstale":"2023-08-25T04:18:26.622411+0000","last_undegraded":"2023-08-25T04:18:26.622411+0000","last_fullsized":"2023-08-25T04:18:26.622411+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:51:12.200425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"78'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988192+0000","last_change":"2023-08-25T04:18:24.900671+0000","last_active":"2023-08-25T04:18:27.988192+0000","last_peered":"2023-08-25T04:18:27.988192+0000","last_clean":"2023-08-25T04:18:27.988192+0000","last_became_active":"2023-08-25T04:18:24.900313+0000","last_became_peered":"2023-08-25T04:18:24.900313+0000","last_unstale":"2023-08-25T04:18:27.988192+0000","last_undegraded":"2023-08-25T04:18:27.988192+0000","last_fullsized":"2023-08-25T04:18:27.988192+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:36:22.100902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622579+0000","last_change":"2023-08-25T04:18:25.638689+0000","last_active":"2023-08-25T04:18:26.622579+0000","last_peered":"2023-08-25T04:18:26.622579+0000","last_clean":"2023-08-25T04:18:26.622579+0000","last_became_active":"2023-08-25T04:18:25.638409+0000","last_became_peered":"2023-08-25T04:18:25.638409+0000","last_unstale":"2023-08-25T04:18:26.622579+0000","last_undegraded":"2023-08-25T04:18:26.622579+0000","last_fullsized":"2023-08-25T04:18:26.622579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:26:53.571564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487726+0000","last_change":"2023-08-25T04:18:24.906222+0000","last_active":"2023-08-25T04:18:27.487726+0000","last_peered":"2023-08-25T04:18:27.487726+0000","last_clean":"2023-08-25T04:18:27.487726+0000","last_became_active":"2023-08-25T04:18:24.905939+0000","last_became_peered":"2023-08-25T04:18:24.905939+0000","last_unstale":"2023-08-25T04:18:27.487726+0000","last_undegraded":"2023-08-25T04:18:27.487726+0000","last_fullsized":"2023-08-25T04:18:27.487726+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:54.756627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487673+0000","last_change":"2023-08-25T04:18:25.641540+0000","last_active":"2023-08-25T04:18:27.487673+0000","last_peered":"2023-08-25T04:18:27.487673+0000","last_clean":"2023-08-25T04:18:27.487673+0000","last_became_active":"2023-08-25T04:18:25.641036+0000","last_became_peered":"2023-08-25T04:18:25.641036+0000","last_unstale":"2023-08-25T04:18:27.487673+0000","last_undegraded":"2023-08-25T04:18:27.487673+0000","last_fullsized":"2023-08-25T04:18:27.487673+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:51.397620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"78'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487710+0000","last_change":"2023-08-25T04:18:24.909480+0000","last_active":"2023-08-25T04:18:27.487710+0000","last_peered":"2023-08-25T04:18:27.487710+0000","last_clean":"2023-08-25T04:18:27.487710+0000","last_became_active":"2023-08-25T04:18:24.909014+0000","last_became_peered":"2023-08-25T04:18:24.909014+0000","last_unstale":"2023-08-25T04:18:27.487710+0000","last_undegraded":"2023-08-25T04:18:27.487710+0000","last_fullsized":"2023-08-25T04:18:27.487710+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:25:15.695930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354470+0000","last_change":"2023-08-25T04:18:25.639484+0000","last_active":"2023-08-25T04:18:27.354470+0000","last_peered":"2023-08-25T04:18:27.354470+0000","last_clean":"2023-08-25T04:18:27.354470+0000","last_became_active":"2023-08-25T04:18:25.639181+0000","last_became_peered":"2023-08-25T04:18:25.639181+0000","last_unstale":"2023-08-25T04:18:27.354470+0000","last_undegraded":"2023-08-25T04:18:27.354470+0000","last_fullsized":"2023-08-25T04:18:27.354470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:19:11.587628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"78'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487781+0000","last_change":"2023-08-25T04:18:24.900981+0000","last_active":"2023-08-25T04:18:27.487781+0000","last_peered":"2023-08-25T04:18:27.487781+0000","last_clean":"2023-08-25T04:18:27.487781+0000","last_became_active":"2023-08-25T04:18:24.900617+0000","last_became_peered":"2023-08-25T04:18:24.900617+0000","last_unstale":"2023-08-25T04:18:27.487781+0000","last_undegraded":"2023-08-25T04:18:27.487781+0000","last_fullsized":"2023-08-25T04:18:27.487781+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:52:19.639407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.626387+0000","last_change":"2023-08-25T04:18:25.638325+0000","last_active":"2023-08-25T04:18:26.626387+0000","last_peered":"2023-08-25T04:18:26.626387+0000","last_clean":"2023-08-25T04:18:26.626387+0000","last_became_active":"2023-08-25T04:18:25.638028+0000","last_became_peered":"2023-08-25T04:18:25.638028+0000","last_unstale":"2023-08-25T04:18:26.626387+0000","last_undegraded":"2023-08-25T04:18:26.626387+0000","last_fullsized":"2023-08-25T04:18:26.626387+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:55:04.280318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913716+0000","last_change":"2023-08-25T04:18:24.902167+0000","last_active":"2023-08-25T04:18:26.913716+0000","last_peered":"2023-08-25T04:18:26.913716+0000","last_clean":"2023-08-25T04:18:26.913716+0000","last_became_active":"2023-08-25T04:18:24.901834+0000","last_became_peered":"2023-08-25T04:18:24.901834+0000","last_unstale":"2023-08-25T04:18:26.913716+0000","last_undegraded":"2023-08-25T04:18:26.913716+0000","last_fullsized":"2023-08-25T04:18:26.913716+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:25:20.979312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.987618+0000","last_change":"2023-08-25T04:18:25.652459+0000","last_active":"2023-08-25T04:18:27.987618+0000","last_peered":"2023-08-25T04:18:27.987618+0000","last_clean":"2023-08-25T04:18:27.987618+0000","last_became_active":"2023-08-25T04:18:25.652184+0000","last_became_peered":"2023-08-25T04:18:25.652184+0000","last_unstale":"2023-08-25T04:18:27.987618+0000","last_undegraded":"2023-08-25T04:18:27.987618+0000","last_fullsized":"2023-08-25T04:18:27.987618+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:13:02.236309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913360+0000","last_change":"2023-08-25T04:18:24.900982+0000","last_active":"2023-08-25T04:18:26.913360+0000","last_peered":"2023-08-25T04:18:26.913360+0000","last_clean":"2023-08-25T04:18:26.913360+0000","last_became_active":"2023-08-25T04:18:24.900528+0000","last_became_peered":"2023-08-25T04:18:24.900528+0000","last_unstale":"2023-08-25T04:18:26.913360+0000","last_undegraded":"2023-08-25T04:18:26.913360+0000","last_fullsized":"2023-08-25T04:18:26.913360+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:08:11.010203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621634+0000","last_change":"2023-08-25T04:18:25.644003+0000","last_active":"2023-08-25T04:18:26.621634+0000","last_peered":"2023-08-25T04:18:26.621634+0000","last_clean":"2023-08-25T04:18:26.621634+0000","last_became_active":"2023-08-25T04:18:25.643701+0000","last_became_peered":"2023-08-25T04:18:25.643701+0000","last_unstale":"2023-08-25T04:18:26.621634+0000","last_undegraded":"2023-08-25T04:18:26.621634+0000","last_fullsized":"2023-08-25T04:18:26.621634+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:13.067641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913432+0000","last_change":"2023-08-25T04:18:24.905764+0000","last_active":"2023-08-25T04:18:26.913432+0000","last_peered":"2023-08-25T04:18:26.913432+0000","last_clean":"2023-08-25T04:18:26.913432+0000","last_became_active":"2023-08-25T04:18:24.905138+0000","last_became_peered":"2023-08-25T04:18:24.905138+0000","last_unstale":"2023-08-25T04:18:26.913432+0000","last_undegraded":"2023-08-25T04:18:26.913432+0000","last_fullsized":"2023-08-25T04:18:26.913432+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:46.932266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913621+0000","last_change":"2023-08-25T04:18:25.650056+0000","last_active":"2023-08-25T04:18:26.913621+0000","last_peered":"2023-08-25T04:18:26.913621+0000","last_clean":"2023-08-25T04:18:26.913621+0000","last_became_active":"2023-08-25T04:18:25.649748+0000","last_became_peered":"2023-08-25T04:18:25.649748+0000","last_unstale":"2023-08-25T04:18:26.913621+0000","last_undegraded":"2023-08-25T04:18:26.913621+0000","last_fullsized":"2023-08-25T04:18:26.913621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:32:45.722559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622118+0000","last_change":"2023-08-25T04:18:24.903496+0000","last_active":"2023-08-25T04:18:26.622118+0000","last_peered":"2023-08-25T04:18:26.622118+0000","last_clean":"2023-08-25T04:18:26.622118+0000","last_became_active":"2023-08-25T04:18:24.903220+0000","last_became_peered":"2023-08-25T04:18:24.903220+0000","last_unstale":"2023-08-25T04:18:26.622118+0000","last_undegraded":"2023-08-25T04:18:26.622118+0000","last_fullsized":"2023-08-25T04:18:26.622118+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:16:43.130858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988031+0000","last_change":"2023-08-25T04:18:25.633482+0000","last_active":"2023-08-25T04:18:27.988031+0000","last_peered":"2023-08-25T04:18:27.988031+0000","last_clean":"2023-08-25T04:18:27.988031+0000","last_became_active":"2023-08-25T04:18:25.633146+0000","last_became_peered":"2023-08-25T04:18:25.633146+0000","last_unstale":"2023-08-25T04:18:27.988031+0000","last_undegraded":"2023-08-25T04:18:27.988031+0000","last_fullsized":"2023-08-25T04:18:27.988031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:54:56.767599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354577+0000","last_change":"2023-08-25T04:18:24.910198+0000","last_active":"2023-08-25T04:18:27.354577+0000","last_peered":"2023-08-25T04:18:27.354577+0000","last_clean":"2023-08-25T04:18:27.354577+0000","last_became_active":"2023-08-25T04:18:24.909872+0000","last_became_peered":"2023-08-25T04:18:24.909872+0000","last_unstale":"2023-08-25T04:18:27.354577+0000","last_undegraded":"2023-08-25T04:18:27.354577+0000","last_fullsized":"2023-08-25T04:18:27.354577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:13:18.535719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913630+0000","last_change":"2023-08-25T04:18:25.635060+0000","last_active":"2023-08-25T04:18:26.913630+0000","last_peered":"2023-08-25T04:18:26.913630+0000","last_clean":"2023-08-25T04:18:26.913630+0000","last_became_active":"2023-08-25T04:18:25.634787+0000","last_became_peered":"2023-08-25T04:18:25.634787+0000","last_unstale":"2023-08-25T04:18:26.913630+0000","last_undegraded":"2023-08-25T04:18:26.913630+0000","last_fullsized":"2023-08-25T04:18:26.913630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:28:01.142506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621684+0000","last_change":"2023-08-25T04:18:24.894667+0000","last_active":"2023-08-25T04:18:26.621684+0000","last_peered":"2023-08-25T04:18:26.621684+0000","last_clean":"2023-08-25T04:18:26.621684+0000","last_became_active":"2023-08-25T04:18:24.894325+0000","last_became_peered":"2023-08-25T04:18:24.894325+0000","last_unstale":"2023-08-25T04:18:26.621684+0000","last_undegraded":"2023-08-25T04:18:26.621684+0000","last_fullsized":"2023-08-25T04:18:26.621684+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:17:40.154585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621965+0000","last_change":"2023-08-25T04:18:25.624915+0000","last_active":"2023-08-25T04:18:26.621965+0000","last_peered":"2023-08-25T04:18:26.621965+0000","last_clean":"2023-08-25T04:18:26.621965+0000","last_became_active":"2023-08-25T04:18:25.624586+0000","last_became_peered":"2023-08-25T04:18:25.624586+0000","last_unstale":"2023-08-25T04:18:26.621965+0000","last_undegraded":"2023-08-25T04:18:26.621965+0000","last_fullsized":"2023-08-25T04:18:26.621965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:45:36.677172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"78'3","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354353+0000","last_change":"2023-08-25T04:18:24.910725+0000","last_active":"2023-08-25T04:18:27.354353+0000","last_peered":"2023-08-25T04:18:27.354353+0000","last_clean":"2023-08-25T04:18:27.354353+0000","last_became_active":"2023-08-25T04:18:24.910425+0000","last_became_peered":"2023-08-25T04:18:24.910425+0000","last_unstale":"2023-08-25T04:18:27.354353+0000","last_undegraded":"2023-08-25T04:18:27.354353+0000","last_fullsized":"2023-08-25T04:18:27.354353+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:00:08.595826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622423+0000","last_change":"2023-08-25T04:18:25.646137+0000","last_active":"2023-08-25T04:18:26.622423+0000","last_peered":"2023-08-25T04:18:26.622423+0000","last_clean":"2023-08-25T04:18:26.622423+0000","last_became_active":"2023-08-25T04:18:25.645761+0000","last_became_peered":"2023-08-25T04:18:25.645761+0000","last_unstale":"2023-08-25T04:18:26.622423+0000","last_undegraded":"2023-08-25T04:18:26.622423+0000","last_fullsized":"2023-08-25T04:18:26.622423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:18:08.394722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"78'6","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988013+0000","last_change":"2023-08-25T04:18:24.898103+0000","last_active":"2023-08-25T04:18:27.988013+0000","last_peered":"2023-08-25T04:18:27.988013+0000","last_clean":"2023-08-25T04:18:27.988013+0000","last_became_active":"2023-08-25T04:18:24.897730+0000","last_became_peered":"2023-08-25T04:18:24.897730+0000","last_unstale":"2023-08-25T04:18:27.988013+0000","last_undegraded":"2023-08-25T04:18:27.988013+0000","last_fullsized":"2023-08-25T04:18:27.988013+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:15.746024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621199+0000","last_change":"2023-08-25T04:18:25.646279+0000","last_active":"2023-08-25T04:18:26.621199+0000","last_peered":"2023-08-25T04:18:26.621199+0000","last_clean":"2023-08-25T04:18:26.621199+0000","last_became_active":"2023-08-25T04:18:25.645802+0000","last_became_peered":"2023-08-25T04:18:25.645802+0000","last_unstale":"2023-08-25T04:18:26.621199+0000","last_undegraded":"2023-08-25T04:18:26.621199+0000","last_fullsized":"2023-08-25T04:18:26.621199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:59:16.075360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"78'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354179+0000","last_change":"2023-08-25T04:18:24.904539+0000","last_active":"2023-08-25T04:18:27.354179+0000","last_peered":"2023-08-25T04:18:27.354179+0000","last_clean":"2023-08-25T04:18:27.354179+0000","last_became_active":"2023-08-25T04:18:24.904139+0000","last_became_peered":"2023-08-25T04:18:24.904139+0000","last_unstale":"2023-08-25T04:18:27.354179+0000","last_undegraded":"2023-08-25T04:18:27.354179+0000","last_fullsized":"2023-08-25T04:18:27.354179+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:41:07.520954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639109+0000","last_change":"2023-08-25T04:18:25.644224+0000","last_active":"2023-08-25T04:18:27.639109+0000","last_peered":"2023-08-25T04:18:27.639109+0000","last_clean":"2023-08-25T04:18:27.639109+0000","last_became_active":"2023-08-25T04:18:25.643896+0000","last_became_peered":"2023-08-25T04:18:25.643896+0000","last_unstale":"2023-08-25T04:18:27.639109+0000","last_undegraded":"2023-08-25T04:18:27.639109+0000","last_fullsized":"2023-08-25T04:18:27.639109+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:22.829709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639114+0000","last_change":"2023-08-25T04:18:24.910158+0000","last_active":"2023-08-25T04:18:27.639114+0000","last_peered":"2023-08-25T04:18:27.639114+0000","last_clean":"2023-08-25T04:18:27.639114+0000","last_became_active":"2023-08-25T04:18:24.909888+0000","last_became_peered":"2023-08-25T04:18:24.909888+0000","last_unstale":"2023-08-25T04:18:27.639114+0000","last_undegraded":"2023-08-25T04:18:27.639114+0000","last_fullsized":"2023-08-25T04:18:27.639114+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:25:28.377610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621679+0000","last_change":"2023-08-25T04:18:25.635790+0000","last_active":"2023-08-25T04:18:26.621679+0000","last_peered":"2023-08-25T04:18:26.621679+0000","last_clean":"2023-08-25T04:18:26.621679+0000","last_became_active":"2023-08-25T04:18:25.635275+0000","last_became_peered":"2023-08-25T04:18:25.635275+0000","last_unstale":"2023-08-25T04:18:26.621679+0000","last_undegraded":"2023-08-25T04:18:26.621679+0000","last_fullsized":"2023-08-25T04:18:26.621679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:20:10.374336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354168+0000","last_change":"2023-08-25T04:18:24.901753+0000","last_active":"2023-08-25T04:18:27.354168+0000","last_peered":"2023-08-25T04:18:27.354168+0000","last_clean":"2023-08-25T04:18:27.354168+0000","last_became_active":"2023-08-25T04:18:24.901420+0000","last_became_peered":"2023-08-25T04:18:24.901420+0000","last_unstale":"2023-08-25T04:18:27.354168+0000","last_undegraded":"2023-08-25T04:18:27.354168+0000","last_fullsized":"2023-08-25T04:18:27.354168+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:20:11.639973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.987920+0000","last_change":"2023-08-25T04:18:25.642974+0000","last_active":"2023-08-25T04:18:27.987920+0000","last_peered":"2023-08-25T04:18:27.987920+0000","last_clean":"2023-08-25T04:18:27.987920+0000","last_became_active":"2023-08-25T04:18:25.642614+0000","last_became_peered":"2023-08-25T04:18:25.642614+0000","last_unstale":"2023-08-25T04:18:27.987920+0000","last_undegraded":"2023-08-25T04:18:27.987920+0000","last_fullsized":"2023-08-25T04:18:27.987920+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:55:32.232515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"78'8","reported_seq":21,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621196+0000","last_change":"2023-08-25T04:18:24.903053+0000","last_active":"2023-08-25T04:18:26.621196+0000","last_peered":"2023-08-25T04:18:26.621196+0000","last_clean":"2023-08-25T04:18:26.621196+0000","last_became_active":"2023-08-25T04:18:24.902758+0000","last_became_peered":"2023-08-25T04:18:24.902758+0000","last_unstale":"2023-08-25T04:18:26.621196+0000","last_undegraded":"2023-08-25T04:18:26.621196+0000","last_fullsized":"2023-08-25T04:18:26.621196+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:45:26.997083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487670+0000","last_change":"2023-08-25T04:18:25.652727+0000","last_active":"2023-08-25T04:18:27.487670+0000","last_peered":"2023-08-25T04:18:27.487670+0000","last_clean":"2023-08-25T04:18:27.487670+0000","last_became_active":"2023-08-25T04:18:25.652461+0000","last_became_peered":"2023-08-25T04:18:25.652461+0000","last_unstale":"2023-08-25T04:18:27.487670+0000","last_undegraded":"2023-08-25T04:18:27.487670+0000","last_fullsized":"2023-08-25T04:18:27.487670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:43:51.025053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"78'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639648+0000","last_change":"2023-08-25T04:18:24.907754+0000","last_active":"2023-08-25T04:18:27.639648+0000","last_peered":"2023-08-25T04:18:27.639648+0000","last_clean":"2023-08-25T04:18:27.639648+0000","last_became_active":"2023-08-25T04:18:24.907446+0000","last_became_peered":"2023-08-25T04:18:24.907446+0000","last_unstale":"2023-08-25T04:18:27.639648+0000","last_undegraded":"2023-08-25T04:18:27.639648+0000","last_fullsized":"2023-08-25T04:18:27.639648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:21:53.030966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.626587+0000","last_change":"2023-08-25T04:18:25.646631+0000","last_active":"2023-08-25T04:18:26.626587+0000","last_peered":"2023-08-25T04:18:26.626587+0000","last_clean":"2023-08-25T04:18:26.626587+0000","last_became_active":"2023-08-25T04:18:25.646238+0000","last_became_peered":"2023-08-25T04:18:25.646238+0000","last_unstale":"2023-08-25T04:18:26.626587+0000","last_undegraded":"2023-08-25T04:18:26.626587+0000","last_fullsized":"2023-08-25T04:18:26.626587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:04:23.036827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"79'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639560+0000","last_change":"2023-08-25T04:18:24.905286+0000","last_active":"2023-08-25T04:18:27.639560+0000","last_peered":"2023-08-25T04:18:27.639560+0000","last_clean":"2023-08-25T04:18:27.639560+0000","last_became_active":"2023-08-25T04:18:24.904999+0000","last_became_peered":"2023-08-25T04:18:24.904999+0000","last_unstale":"2023-08-25T04:18:27.639560+0000","last_undegraded":"2023-08-25T04:18:27.639560+0000","last_fullsized":"2023-08-25T04:18:27.639560+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:50:36.042403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639402+0000","last_change":"2023-08-25T04:18:25.644341+0000","last_active":"2023-08-25T04:18:27.639402+0000","last_peered":"2023-08-25T04:18:27.639402+0000","last_clean":"2023-08-25T04:18:27.639402+0000","last_became_active":"2023-08-25T04:18:25.644048+0000","last_became_peered":"2023-08-25T04:18:25.644048+0000","last_unstale":"2023-08-25T04:18:27.639402+0000","last_undegraded":"2023-08-25T04:18:27.639402+0000","last_fullsized":"2023-08-25T04:18:27.639402+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:05.098467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487663+0000","last_change":"2023-08-25T04:18:24.909744+0000","last_active":"2023-08-25T04:18:27.487663+0000","last_peered":"2023-08-25T04:18:27.487663+0000","last_clean":"2023-08-25T04:18:27.487663+0000","last_became_active":"2023-08-25T04:18:24.909442+0000","last_became_peered":"2023-08-25T04:18:24.909442+0000","last_unstale":"2023-08-25T04:18:27.487663+0000","last_undegraded":"2023-08-25T04:18:27.487663+0000","last_fullsized":"2023-08-25T04:18:27.487663+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:14.874672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621922+0000","last_change":"2023-08-25T04:18:25.633574+0000","last_active":"2023-08-25T04:18:26.621922+0000","last_peered":"2023-08-25T04:18:26.621922+0000","last_clean":"2023-08-25T04:18:26.621922+0000","last_became_active":"2023-08-25T04:18:25.633286+0000","last_became_peered":"2023-08-25T04:18:25.633286+0000","last_unstale":"2023-08-25T04:18:26.621922+0000","last_undegraded":"2023-08-25T04:18:26.621922+0000","last_fullsized":"2023-08-25T04:18:26.621922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:18:52.114025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988136+0000","last_change":"2023-08-25T04:18:24.898350+0000","last_active":"2023-08-25T04:18:27.988136+0000","last_peered":"2023-08-25T04:18:27.988136+0000","last_clean":"2023-08-25T04:18:27.988136+0000","last_became_active":"2023-08-25T04:18:24.898050+0000","last_became_peered":"2023-08-25T04:18:24.898050+0000","last_unstale":"2023-08-25T04:18:27.988136+0000","last_undegraded":"2023-08-25T04:18:27.988136+0000","last_fullsized":"2023-08-25T04:18:27.988136+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:00:32.448501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621215+0000","last_change":"2023-08-25T04:18:25.626522+0000","last_active":"2023-08-25T04:18:26.621215+0000","last_peered":"2023-08-25T04:18:26.621215+0000","last_clean":"2023-08-25T04:18:26.621215+0000","last_became_active":"2023-08-25T04:18:25.626182+0000","last_became_peered":"2023-08-25T04:18:25.626182+0000","last_unstale":"2023-08-25T04:18:26.621215+0000","last_undegraded":"2023-08-25T04:18:26.621215+0000","last_fullsized":"2023-08-25T04:18:26.621215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:02:13.919466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354205+0000","last_change":"2023-08-25T04:18:24.905898+0000","last_active":"2023-08-25T04:18:27.354205+0000","last_peered":"2023-08-25T04:18:27.354205+0000","last_clean":"2023-08-25T04:18:27.354205+0000","last_became_active":"2023-08-25T04:18:24.905597+0000","last_became_peered":"2023-08-25T04:18:24.905597+0000","last_unstale":"2023-08-25T04:18:27.354205+0000","last_undegraded":"2023-08-25T04:18:27.354205+0000","last_fullsized":"2023-08-25T04:18:27.354205+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:37:48.723022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621507+0000","last_change":"2023-08-25T04:18:25.647175+0000","last_active":"2023-08-25T04:18:26.621507+0000","last_peered":"2023-08-25T04:18:26.621507+0000","last_clean":"2023-08-25T04:18:26.621507+0000","last_became_active":"2023-08-25T04:18:25.646859+0000","last_became_peered":"2023-08-25T04:18:25.646859+0000","last_unstale":"2023-08-25T04:18:26.621507+0000","last_undegraded":"2023-08-25T04:18:26.621507+0000","last_fullsized":"2023-08-25T04:18:26.621507+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:15:55.660653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913503+0000","last_change":"2023-08-25T04:18:24.900266+0000","last_active":"2023-08-25T04:18:26.913503+0000","last_peered":"2023-08-25T04:18:26.913503+0000","last_clean":"2023-08-25T04:18:26.913503+0000","last_became_active":"2023-08-25T04:18:24.899965+0000","last_became_peered":"2023-08-25T04:18:24.899965+0000","last_unstale":"2023-08-25T04:18:26.913503+0000","last_undegraded":"2023-08-25T04:18:26.913503+0000","last_fullsized":"2023-08-25T04:18:26.913503+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:54:44.514535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.987839+0000","last_change":"2023-08-25T04:18:25.648384+0000","last_active":"2023-08-25T04:18:27.987839+0000","last_peered":"2023-08-25T04:18:27.987839+0000","last_clean":"2023-08-25T04:18:27.987839+0000","last_became_active":"2023-08-25T04:18:25.648109+0000","last_became_peered":"2023-08-25T04:18:25.648109+0000","last_unstale":"2023-08-25T04:18:27.987839+0000","last_undegraded":"2023-08-25T04:18:27.987839+0000","last_fullsized":"2023-08-25T04:18:27.987839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:19:11.163585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913358+0000","last_change":"2023-08-25T04:18:24.905945+0000","last_active":"2023-08-25T04:18:26.913358+0000","last_peered":"2023-08-25T04:18:26.913358+0000","last_clean":"2023-08-25T04:18:26.913358+0000","last_became_active":"2023-08-25T04:18:24.905484+0000","last_became_peered":"2023-08-25T04:18:24.905484+0000","last_unstale":"2023-08-25T04:18:26.913358+0000","last_undegraded":"2023-08-25T04:18:26.913358+0000","last_fullsized":"2023-08-25T04:18:26.913358+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:36:22.100902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.626386+0000","last_change":"2023-08-25T04:18:25.639545+0000","last_active":"2023-08-25T04:18:26.626386+0000","last_peered":"2023-08-25T04:18:26.626386+0000","last_clean":"2023-08-25T04:18:26.626386+0000","last_became_active":"2023-08-25T04:18:25.639248+0000","last_became_peered":"2023-08-25T04:18:25.639248+0000","last_unstale":"2023-08-25T04:18:26.626386+0000","last_undegraded":"2023-08-25T04:18:26.626386+0000","last_fullsized":"2023-08-25T04:18:26.626386+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:11:41.782870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.987676+0000","last_change":"2023-08-25T04:18:24.905989+0000","last_active":"2023-08-25T04:18:27.987676+0000","last_peered":"2023-08-25T04:18:27.987676+0000","last_clean":"2023-08-25T04:18:27.987676+0000","last_became_active":"2023-08-25T04:18:24.905715+0000","last_became_peered":"2023-08-25T04:18:24.905715+0000","last_unstale":"2023-08-25T04:18:27.987676+0000","last_undegraded":"2023-08-25T04:18:27.987676+0000","last_fullsized":"2023-08-25T04:18:27.987676+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:29:59.564380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622177+0000","last_change":"2023-08-25T04:18:25.626744+0000","last_active":"2023-08-25T04:18:26.622177+0000","last_peered":"2023-08-25T04:18:26.622177+0000","last_clean":"2023-08-25T04:18:26.622177+0000","last_became_active":"2023-08-25T04:18:25.626420+0000","last_became_peered":"2023-08-25T04:18:25.626420+0000","last_unstale":"2023-08-25T04:18:26.622177+0000","last_undegraded":"2023-08-25T04:18:26.622177+0000","last_fullsized":"2023-08-25T04:18:26.622177+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:34:03.483804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913290+0000","last_change":"2023-08-25T04:18:24.902518+0000","last_active":"2023-08-25T04:18:26.913290+0000","last_peered":"2023-08-25T04:18:26.913290+0000","last_clean":"2023-08-25T04:18:26.913290+0000","last_became_active":"2023-08-25T04:18:24.901881+0000","last_became_peered":"2023-08-25T04:18:24.901881+0000","last_unstale":"2023-08-25T04:18:26.913290+0000","last_undegraded":"2023-08-25T04:18:26.913290+0000","last_fullsized":"2023-08-25T04:18:26.913290+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:10:20.409803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"66'161","reported_seq":432,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354301+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:18:27.354301+0000","last_peered":"2023-08-25T04:18:27.354301+0000","last_clean":"2023-08-25T04:18:27.354301+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:18:27.354301+0000","last_undegraded":"2023-08-25T04:18:27.354301+0000","last_fullsized":"2023-08-25T04:18:27.354301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:00:56.156033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639548+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:18:27.639548+0000","last_peered":"2023-08-25T04:18:27.639548+0000","last_clean":"2023-08-25T04:18:27.639548+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:18:27.639548+0000","last_undegraded":"2023-08-25T04:18:27.639548+0000","last_fullsized":"2023-08-25T04:18:27.639548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:44:10.840769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487481+0000","last_change":"2023-08-25T04:18:25.646053+0000","last_active":"2023-08-25T04:18:27.487481+0000","last_peered":"2023-08-25T04:18:27.487481+0000","last_clean":"2023-08-25T04:18:27.487481+0000","last_became_active":"2023-08-25T04:18:25.645761+0000","last_became_peered":"2023-08-25T04:18:25.645761+0000","last_unstale":"2023-08-25T04:18:27.487481+0000","last_undegraded":"2023-08-25T04:18:27.487481+0000","last_fullsized":"2023-08-25T04:18:27.487481+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:16:07.776812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"78'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487406+0000","last_change":"2023-08-25T04:18:24.904470+0000","last_active":"2023-08-25T04:18:27.487406+0000","last_peered":"2023-08-25T04:18:27.487406+0000","last_clean":"2023-08-25T04:18:27.487406+0000","last_became_active":"2023-08-25T04:18:24.904153+0000","last_became_peered":"2023-08-25T04:18:24.904153+0000","last_unstale":"2023-08-25T04:18:27.487406+0000","last_undegraded":"2023-08-25T04:18:27.487406+0000","last_fullsized":"2023-08-25T04:18:27.487406+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:54:42.997672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354106+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:18:27.354106+0000","last_peered":"2023-08-25T04:18:27.354106+0000","last_clean":"2023-08-25T04:18:27.354106+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:18:27.354106+0000","last_undegraded":"2023-08-25T04:18:27.354106+0000","last_fullsized":"2023-08-25T04:18:27.354106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:21:29.823766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639082+0000","last_change":"2023-08-25T04:18:25.634929+0000","last_active":"2023-08-25T04:18:27.639082+0000","last_peered":"2023-08-25T04:18:27.639082+0000","last_clean":"2023-08-25T04:18:27.639082+0000","last_became_active":"2023-08-25T04:18:25.634595+0000","last_became_peered":"2023-08-25T04:18:25.634595+0000","last_unstale":"2023-08-25T04:18:27.639082+0000","last_undegraded":"2023-08-25T04:18:27.639082+0000","last_fullsized":"2023-08-25T04:18:27.639082+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:38.444688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639270+0000","last_change":"2023-08-25T04:18:24.910073+0000","last_active":"2023-08-25T04:18:27.639270+0000","last_peered":"2023-08-25T04:18:27.639270+0000","last_clean":"2023-08-25T04:18:27.639270+0000","last_became_active":"2023-08-25T04:18:24.909786+0000","last_became_peered":"2023-08-25T04:18:24.909786+0000","last_unstale":"2023-08-25T04:18:27.639270+0000","last_undegraded":"2023-08-25T04:18:27.639270+0000","last_fullsized":"2023-08-25T04:18:27.639270+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:03:17.092706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.626273+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:18:26.626273+0000","last_peered":"2023-08-25T04:18:26.626273+0000","last_clean":"2023-08-25T04:18:26.626273+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:18:26.626273+0000","last_undegraded":"2023-08-25T04:18:26.626273+0000","last_fullsized":"2023-08-25T04:18:26.626273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:11:12.903416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621793+0000","last_change":"2023-08-25T04:18:25.639808+0000","last_active":"2023-08-25T04:18:26.621793+0000","last_peered":"2023-08-25T04:18:26.621793+0000","last_clean":"2023-08-25T04:18:26.621793+0000","last_became_active":"2023-08-25T04:18:25.639518+0000","last_became_peered":"2023-08-25T04:18:25.639518+0000","last_unstale":"2023-08-25T04:18:26.621793+0000","last_undegraded":"2023-08-25T04:18:26.621793+0000","last_fullsized":"2023-08-25T04:18:26.621793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:13:54.669554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.487259+0000","last_change":"2023-08-25T04:18:24.905940+0000","last_active":"2023-08-25T04:18:27.487259+0000","last_peered":"2023-08-25T04:18:27.487259+0000","last_clean":"2023-08-25T04:18:27.487259+0000","last_became_active":"2023-08-25T04:18:24.905665+0000","last_became_peered":"2023-08-25T04:18:24.905665+0000","last_unstale":"2023-08-25T04:18:27.487259+0000","last_undegraded":"2023-08-25T04:18:27.487259+0000","last_fullsized":"2023-08-25T04:18:27.487259+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:55:40.771068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639453+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:18:27.639453+0000","last_peered":"2023-08-25T04:18:27.639453+0000","last_clean":"2023-08-25T04:18:27.639453+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:18:27.639453+0000","last_undegraded":"2023-08-25T04:18:27.639453+0000","last_fullsized":"2023-08-25T04:18:27.639453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:38:45.203164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354297+0000","last_change":"2023-08-25T04:18:25.650463+0000","last_active":"2023-08-25T04:18:27.354297+0000","last_peered":"2023-08-25T04:18:27.354297+0000","last_clean":"2023-08-25T04:18:27.354297+0000","last_became_active":"2023-08-25T04:18:25.650170+0000","last_became_peered":"2023-08-25T04:18:25.650170+0000","last_unstale":"2023-08-25T04:18:27.354297+0000","last_undegraded":"2023-08-25T04:18:27.354297+0000","last_fullsized":"2023-08-25T04:18:27.354297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:23:22.942225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.639460+0000","last_change":"2023-08-25T04:18:24.910069+0000","last_active":"2023-08-25T04:18:27.639460+0000","last_peered":"2023-08-25T04:18:27.639460+0000","last_clean":"2023-08-25T04:18:27.639460+0000","last_became_active":"2023-08-25T04:18:24.909746+0000","last_became_peered":"2023-08-25T04:18:24.909746+0000","last_unstale":"2023-08-25T04:18:27.639460+0000","last_undegraded":"2023-08-25T04:18:27.639460+0000","last_fullsized":"2023-08-25T04:18:27.639460+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:40.105378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988154+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:18:27.988154+0000","last_peered":"2023-08-25T04:18:27.988154+0000","last_clean":"2023-08-25T04:18:27.988154+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:18:27.988154+0000","last_undegraded":"2023-08-25T04:18:27.988154+0000","last_fullsized":"2023-08-25T04:18:27.988154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:52:41.775519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622270+0000","last_change":"2023-08-25T04:18:25.650779+0000","last_active":"2023-08-25T04:18:26.622270+0000","last_peered":"2023-08-25T04:18:26.622270+0000","last_clean":"2023-08-25T04:18:26.622270+0000","last_became_active":"2023-08-25T04:18:25.650503+0000","last_became_peered":"2023-08-25T04:18:25.650503+0000","last_unstale":"2023-08-25T04:18:26.622270+0000","last_undegraded":"2023-08-25T04:18:26.622270+0000","last_fullsized":"2023-08-25T04:18:26.622270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:58:44.797135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"78'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354588+0000","last_change":"2023-08-25T04:18:24.907797+0000","last_active":"2023-08-25T04:18:27.354588+0000","last_peered":"2023-08-25T04:18:27.354588+0000","last_clean":"2023-08-25T04:18:27.354588+0000","last_became_active":"2023-08-25T04:18:24.907495+0000","last_became_peered":"2023-08-25T04:18:24.907495+0000","last_unstale":"2023-08-25T04:18:27.354588+0000","last_undegraded":"2023-08-25T04:18:27.354588+0000","last_fullsized":"2023-08-25T04:18:27.354588+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:28:01.606160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":120,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354446+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:18:27.354446+0000","last_peered":"2023-08-25T04:18:27.354446+0000","last_clean":"2023-08-25T04:18:27.354446+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:18:27.354446+0000","last_undegraded":"2023-08-25T04:18:27.354446+0000","last_fullsized":"2023-08-25T04:18:27.354446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:24:39.830576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.621610+0000","last_change":"2023-08-25T04:18:25.646451+0000","last_active":"2023-08-25T04:18:26.621610+0000","last_peered":"2023-08-25T04:18:26.621610+0000","last_clean":"2023-08-25T04:18:26.621610+0000","last_became_active":"2023-08-25T04:18:25.646172+0000","last_became_peered":"2023-08-25T04:18:25.646172+0000","last_unstale":"2023-08-25T04:18:26.621610+0000","last_undegraded":"2023-08-25T04:18:26.621610+0000","last_fullsized":"2023-08-25T04:18:26.621610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:12:16.190797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.354255+0000","last_change":"2023-08-25T04:18:24.910218+0000","last_active":"2023-08-25T04:18:27.354255+0000","last_peered":"2023-08-25T04:18:27.354255+0000","last_clean":"2023-08-25T04:18:27.354255+0000","last_became_active":"2023-08-25T04:18:24.909932+0000","last_became_peered":"2023-08-25T04:18:24.909932+0000","last_unstale":"2023-08-25T04:18:27.354255+0000","last_undegraded":"2023-08-25T04:18:27.354255+0000","last_fullsized":"2023-08-25T04:18:27.354255+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:47:06.078944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":132,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:27.988138+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:18:27.988138+0000","last_peered":"2023-08-25T04:18:27.988138+0000","last_clean":"2023-08-25T04:18:27.988138+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:18:27.988138+0000","last_undegraded":"2023-08-25T04:18:27.988138+0000","last_fullsized":"2023-08-25T04:18:27.988138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:19:52.647328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622400+0000","last_change":"2023-08-25T04:18:25.631264+0000","last_active":"2023-08-25T04:18:26.622400+0000","last_peered":"2023-08-25T04:18:26.622400+0000","last_clean":"2023-08-25T04:18:26.622400+0000","last_became_active":"2023-08-25T04:18:25.630918+0000","last_became_peered":"2023-08-25T04:18:25.630918+0000","last_unstale":"2023-08-25T04:18:26.622400+0000","last_undegraded":"2023-08-25T04:18:26.622400+0000","last_fullsized":"2023-08-25T04:18:26.622400+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:24.877156+0000","last_clean_scrub_stamp":"2023-08-25T04:18:24.877156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:57:21.375228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.913607+0000","last_change":"2023-08-25T04:18:24.904317+0000","last_active":"2023-08-25T04:18:26.913607+0000","last_peered":"2023-08-25T04:18:26.913607+0000","last_clean":"2023-08-25T04:18:26.913607+0000","last_became_active":"2023-08-25T04:18:24.904026+0000","last_became_peered":"2023-08-25T04:18:24.904026+0000","last_unstale":"2023-08-25T04:18:26.913607+0000","last_undegraded":"2023-08-25T04:18:26.913607+0000","last_fullsized":"2023-08-25T04:18:26.913607+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:18:23.873908+0000","last_clean_scrub_stamp":"2023-08-25T04:18:23.873908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:27:00.804890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-08-25T04:18:26.622101+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:18:26.622101+0000","last_peered":"2023-08-25T04:18:26.622101+0000","last_clean":"2023-08-25T04:18:26.622101+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:18:26.622101+0000","last_undegraded":"2023-08-25T04:18:26.622101+0000","last_fullsized":"2023-08-25T04:18:26.622101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:07:18.885053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509631,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46588,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325252,"statfs":{"total":96636764160,"available":96589058048,"internally_reserved":0,"allocated":1556480,"data_stored":1054859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.45200000000000001,"5min":0.39600000000000002,"15min":0.29199999999999998},"max":{"1min":0.88800000000000001,"5min":0.996,"15min":1.0189999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.92400000000000004}]},{"osd":1,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.42699999999999999},"max":{"1min":0.88,"5min":1.0149999999999999,"15min":1.034},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.47099999999999997,"5min":0.44700000000000001,"15min":0.374},"max":{"1min":0.89600000000000002,"5min":0.96099999999999997,"15min":1.036},"last":0.82399999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51700000000000002,"5min":0.42299999999999999,"15min":0.34899999999999998},"max":{"1min":0.94299999999999995,"5min":0.94499999999999995,"15min":1.018},"last":0.753},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.54400000000000004,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":0.92300000000000004,"5min":0.98699999999999999,"15min":0.999},"last":0.88200000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.55000000000000004,"5min":0.47799999999999998,"15min":0.41899999999999998},"max":{"1min":0.90100000000000002,"5min":0.92900000000000005,"15min":0.98399999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.754,"15min":0.75600000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.432},"max":{"1min":1.012,"5min":1.04,"15min":1.0449999999999999},"last":0.90900000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41599999999999998,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.82599999999999996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":0.90400000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.61299999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60799999999999998,"15min":0.61899999999999999},"min":{"1min":0.46300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.96799999999999997,"5min":0.99199999999999999,"15min":0.998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.48699999999999999,"5min":0.41099999999999998,"15min":0.40000000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.0349999999999999},"last":0.65200000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.436},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.0620000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42399999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.70499999999999996}]}]},{"osd":6,"up_from":15,"seq":64424509631,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36276,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":950272,"data_stored":463749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68600000000000005,"15min":0.70699999999999996},"min":{"1min":0.46300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97599999999999998,"5min":1.0089999999999999,"15min":1.0369999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68500000000000005,"15min":0.69799999999999995},"min":{"1min":0.46800000000000003,"5min":0.40400000000000003,"15min":0.33800000000000002},"max":{"1min":0.91900000000000004,"5min":0.96899999999999997,"15min":1.071},"last":0.61199999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.73099999999999998},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.1559999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.59699999999999998,"5min":0.495,"15min":0.47199999999999998},"max":{"1min":0.93500000000000005,"5min":0.996,"15min":1.077},"last":0.80800000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.47999999999999998,"5min":0.44,"15min":0.434},"max":{"1min":0.95199999999999996,"5min":0.98399999999999999,"15min":1.139},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.56299999999999994,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96099999999999997,"5min":1.0569999999999999,"15min":1.117},"last":0.92400000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.50600000000000001,"15min":0.46899999999999997},"max":{"1min":0.93400000000000005,"5min":1.0600000000000001,"15min":1.077},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90900000000000003,"5min":1.075,"15min":1.679},"last":0.86499999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.60099999999999998},"min":{"1min":0.42999999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93000000000000005,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":0.86799999999999999,"5min":0.92900000000000005,"15min":1.306},"last":0.90300000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":1.026},{"interface":"front","average":{"1min":0.753,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.56999999999999995,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":1.1120000000000001,"15min":1.5589999999999999},"last":1.034}]},{"osd":7,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.65300000000000002,"15min":0.66600000000000004},"min":{"1min":0.51400000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86699999999999999,"5min":1.032,"15min":1.1950000000000001},"last":1.006},{"interface":"front","average":{"1min":0.753,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.48799999999999999,"5min":0.44700000000000001,"15min":0.41799999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.4099999999999999},"last":1.046}]}]},{"osd":5,"up_from":14,"seq":60129542334,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":950272,"data_stored":463737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68200000000000005,"15min":0.70999999999999996},"min":{"1min":0.55800000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88500000000000001,"5min":0.94999999999999996,"15min":1.018},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.57499999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86699999999999999,"5min":0.995,"15min":1.0409999999999999},"last":0.53800000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72299999999999998,"15min":0.73699999999999999},"min":{"1min":0.52100000000000002,"5min":0.43099999999999999,"15min":0.36499999999999999},"max":{"1min":0.878,"5min":0.98699999999999999,"15min":0.99399999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.56899999999999995,"5min":0.47599999999999998,"15min":0.46200000000000002},"max":{"1min":0.90400000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68100000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.42999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88500000000000001,"5min":0.97499999999999998,"15min":1.0269999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.55300000000000005,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.2290000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.59199999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92100000000000004,"5min":0.94199999999999995,"15min":1.4590000000000001},"last":0.746},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.76600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.018,"15min":1.1479999999999999},"last":0.84999999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.67000000000000004,"5min":0.97099999999999997,"15min":1.038},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.79600000000000004,"5min":1.018,"15min":1.018},"last":0.86499999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.48299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":1.256},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.50800000000000001,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":0.90400000000000003,"5min":0.98299999999999998,"15min":1.4650000000000001},"last":0.79500000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61199999999999999,"15min":0.626},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.90900000000000003,"5min":1.002,"15min":1.2769999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69299999999999995,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":0.80000000000000004,"5min":0.96899999999999997,"15min":1.1819999999999999},"last":0.72599999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542334,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36288,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335552,"statfs":{"total":96636764160,"available":96599605248,"internally_reserved":0,"allocated":958464,"data_stored":465327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":0.70599999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.86599999999999999,"5min":0.99299999999999999,"15min":1.2649999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.45500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85199999999999998,"5min":0.878,"15min":1.1639999999999999},"last":0.77300000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.45400000000000001,"5min":0.45100000000000001,"15min":0.36199999999999999},"max":{"1min":0.98399999999999999,"5min":1.0189999999999999,"15min":1.0449999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.78700000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.47199999999999998,"15min":0.39100000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.74399999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.34000000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.45100000000000001},"max":{"1min":0.91100000000000003,"5min":0.98299999999999998,"15min":1.048},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.76300000000000001,"15min":0.75900000000000001},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.48399999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.80700000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38300000000000001,"5min":0.378,"15min":0.32200000000000001},"max":{"1min":0.77900000000000003,"5min":0.94799999999999995,"15min":0.94899999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.376,"15min":0.33200000000000002},"max":{"1min":0.81799999999999995,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.53900000000000003}]},{"osd":6,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.92800000000000005,"5min":1.093,"15min":1.093},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.40300000000000002},"max":{"1min":0.871,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.441,"5min":0.435,"15min":0.36699999999999999},"max":{"1min":0.78700000000000003,"5min":0.90100000000000002,"15min":1.0609999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69199999999999995,"15min":0.70399999999999996},"min":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.39300000000000002},"max":{"1min":0.92400000000000004,"5min":0.99399999999999999,"15min":1.0940000000000001},"last":0.60299999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542334,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335572,"statfs":{"total":96636764160,"available":96599625728,"internally_reserved":0,"allocated":946176,"data_stored":463715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.313,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.67200000000000004,"5min":0.93700000000000006,"15min":0.96899999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.70799999999999996,"5min":0.77100000000000002,"15min":0.91500000000000004},"last":0.59499999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.36599999999999999,"5min":0.32800000000000001,"15min":0.27000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.746},"last":0.748},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.59499999999999997},"min":{"1min":0.41499999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80300000000000005,"5min":0.83099999999999996,"15min":0.92600000000000005},"last":0.66000000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":1.01},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.35299999999999998},"max":{"1min":0.72899999999999998,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.70799999999999996}]},{"osd":4,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1719999999999999,"5min":1.214,"15min":1.4339999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.64200000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98599999999999999,"5min":1.2450000000000001,"15min":1.343},"last":0.98099999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56899999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0549999999999999,"5min":1.254,"15min":1.321},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":1.0900000000000001,"5min":1.1950000000000001,"15min":1.4750000000000001},"last":0.96699999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81000000000000005,"15min":0.80700000000000005},"min":{"1min":0.55800000000000005,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":1.077,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.61699999999999999,"5min":0.51600000000000001,"15min":0.50700000000000001},"max":{"1min":0.99299999999999999,"5min":1.0800000000000001,"15min":1.3600000000000001},"last":0.91900000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.68100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.042,"5min":1.077,"15min":1.383},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80600000000000005,"15min":0.79900000000000004},"min":{"1min":0.66200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.016,"5min":1.079,"15min":1.4019999999999999},"last":0.94399999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542335,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54320,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317520,"statfs":{"total":96636764160,"available":96581140480,"internally_reserved":0,"allocated":946176,"data_stored":463715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.378,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.65100000000000002,"5min":0.85599999999999998,"15min":1.196},"last":0.442},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.504,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68700000000000006,"5min":0.81000000000000005,"15min":1.4019999999999999},"last":0.377}]},{"osd":1,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48599999999999999,"15min":0.48899999999999999},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.69999999999999996,"5min":0.78800000000000003,"15min":1.482},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59599999999999997,"15min":0.60099999999999998},"min":{"1min":0.46100000000000002,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":1.458},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.34499999999999997},"max":{"1min":0.80300000000000005,"5min":0.82199999999999995,"15min":0.82299999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.40899999999999997,"5min":0.375,"15min":0.33700000000000002},"max":{"1min":0.751,"5min":0.85399999999999998,"15min":0.95599999999999996},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.80400000000000005,"15min":0.80100000000000005},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.499},"max":{"1min":0.98399999999999999,"5min":1.1990000000000001,"15min":1.2569999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.79000000000000004},"min":{"1min":0.51800000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0069999999999999,"5min":1.151,"15min":1.5509999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.80800000000000005,"15min":0.80400000000000005},"min":{"1min":0.63300000000000001,"5min":0.52600000000000002,"15min":0.47999999999999998},"max":{"1min":0.995,"5min":1.1140000000000001,"15min":1.2789999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.48299999999999998},"max":{"1min":1.02,"5min":1.2130000000000001,"15min":1.3089999999999999},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.93100000000000005,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85799999999999998,"15min":0.85699999999999998},"min":{"1min":0.68500000000000005,"5min":0.58799999999999997,"15min":0.55600000000000005},"max":{"1min":1.014,"5min":1.25,"15min":1.375},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81100000000000005,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":0.99199999999999999,"5min":1.2090000000000001,"15min":1.339},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81599999999999995,"15min":0.81299999999999994},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0149999999999999,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.61499999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542335,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36292,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335548,"statfs":{"total":96636764160,"available":96599601152,"internally_reserved":0,"allocated":974848,"data_stored":466091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.46300000000000002},"min":{"1min":0.27800000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66500000000000004,"5min":0.85599999999999998,"15min":1.218},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56299999999999994,"15min":0.52600000000000002},"min":{"1min":0.374,"5min":0.33200000000000002,"15min":0.29499999999999998},"max":{"1min":0.85099999999999998,"5min":1.212,"15min":1.212},"last":0.622}]},{"osd":2,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51500000000000001,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66300000000000003,"5min":0.876,"15min":1.347},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":1.093},"last":0.83199999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.41599999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.74099999999999999,"5min":0.93100000000000005,"15min":1.1459999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.34699999999999998,"5min":0.34599999999999997,"15min":0.33200000000000002},"max":{"1min":0.84299999999999997,"5min":1.165,"15min":1.2190000000000001},"last":0.74099999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":1.004,"5min":1.204,"15min":1.47},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.80300000000000005,"15min":0.81100000000000005},"min":{"1min":0.60399999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.0269999999999999,"5min":1.2529999999999999,"15min":1.395},"last":1}]},{"osd":5,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.45100000000000001},"max":{"1min":0.96499999999999997,"5min":1.254,"15min":1.292},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81299999999999994,"15min":0.81499999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51000000000000001},"max":{"1min":1.044,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.97999999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.70099999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.171,"5min":1.623,"15min":1.623},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82199999999999995,"15min":0.80600000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.54200000000000004},"max":{"1min":1.01,"5min":1.288,"15min":1.355},"last":0.88800000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.57399999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0760000000000001,"5min":1.1240000000000001,"15min":1.5429999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.63400000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.073,"5min":1.1140000000000001,"15min":1.504},"last":0.90400000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542334,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36852,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334988,"statfs":{"total":96636764160,"available":96599027712,"internally_reserved":0,"allocated":1540096,"data_stored":1054083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.501,"15min":0.48899999999999999},"min":{"1min":0.30399999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67700000000000005,"5min":0.72499999999999998,"15min":0.79500000000000004},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.68400000000000005,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70099999999999996,"5min":0.82299999999999995,"15min":0.97499999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55500000000000005,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":0.876,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.77600000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48899999999999999,"15min":0.499},"min":{"1min":0.36299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.266},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.45600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76800000000000002,"5min":0.85099999999999998,"15min":1.2470000000000001},"last":0.66200000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.79900000000000004},"min":{"1min":0.60799999999999998,"5min":0.52600000000000002,"15min":0.503},"max":{"1min":1.048,"5min":1.1739999999999999,"15min":1.306},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.58699999999999997,"5min":0.497,"15min":0.436},"max":{"1min":1.169,"5min":1.169,"15min":1.262},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81499999999999995,"15min":0.80500000000000005},"min":{"1min":0.57499999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.131,"5min":3.528,"15min":3.528},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.53000000000000003,"5min":0.47199999999999998,"15min":0.45500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.373},"last":0.80400000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81699999999999995,"15min":0.80600000000000005},"min":{"1min":0.60599999999999998,"5min":0.54400000000000004,"15min":0.53000000000000003},"max":{"1min":1.0680000000000001,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60999999999999999,"5min":0.52700000000000002,"15min":0.47399999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.331},"last":0.753}]},{"osd":7,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83799999999999997,"15min":0.84699999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.52900000000000003},"max":{"1min":1.151,"5min":1.151,"15min":1.4059999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.64600000000000002,"5min":0.53200000000000003,"15min":0.499},"max":{"1min":1.0940000000000001,"5min":1.1220000000000001,"15min":1.3169999999999999},"last":0.76700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:18:34.928 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-25T04:18:34.928 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-25T04:18:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.114+0000 7f4445a9e640 1 Processor -- start 2023-08-25T04:18:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.114+0000 7f4445a9e640 1 -- start start 2023-08-25T04:18:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.114+0000 7f4445a9e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f44401601f0 0x7f444015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:35.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.114+0000 7f4445a9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f444015e3c0 0x7f44400d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:35.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.114+0000 7f4445a9e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f444015f8b0 con 0x7f44400d10c0 2023-08-25T04:18:35.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.114+0000 7f4445a9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44400cd5a0 con 0x7f444015e3c0 2023-08-25T04:18:35.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.114+0000 7f4445a9e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44400cd880 con 0x7f44401601f0 2023-08-25T04:18:35.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.114+0000 7f4437fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f444015e3c0 0x7f44400d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:35.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.114+0000 7f4437fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f444015e3c0 0x7f44400d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45292/0 (socket says 172.21.15.55:45292) 2023-08-25T04:18:35.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.114+0000 7f4437fff640 1 -- 172.21.15.55:0/1224934273 learned_addr learned my addr 172.21.15.55:0/1224934273 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:35.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.114+0000 7f443f7fe640 1 --2- 172.21.15.55:0/1224934273 >> v2:172.21.15.110:3300/0 conn(0x7f44401601f0 0x7f444015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:35.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.114+0000 7f4437fff640 1 -- 172.21.15.55:0/1224934273 >> v2:172.21.15.110:3300/0 conn(0x7f44401601f0 msgr2=0x7f444015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:35.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.114+0000 7f4437fff640 1 --2- 172.21.15.55:0/1224934273 >> v2:172.21.15.110:3300/0 conn(0x7f44401601f0 0x7f444015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.114+0000 7f4437fff640 1 -- 172.21.15.55:0/1224934273 >> v1:172.21.15.110:6789/0 conn(0x7f44400d10c0 legacy=0x7f44400b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:35.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.114+0000 7f4437fff640 1 -- 172.21.15.55:0/1224934273 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44400cdb60 con 0x7f444015e3c0 2023-08-25T04:18:35.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.118+0000 7f4437fff640 1 --2- 172.21.15.55:0/1224934273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f444015e3c0 0x7f44400d0b80 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f444008b7f0 tx=0x7f442801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f0c4915630a656 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:35.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.118+0000 7f443effd640 1 -- 172.21.15.55:0/1224934273 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44280ac640 con 0x7f444015e3c0 2023-08-25T04:18:35.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.118+0000 7f443effd640 1 -- 172.21.15.55:0/1224934273 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44280ac7a0 con 0x7f444015e3c0 2023-08-25T04:18:35.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.118+0000 7f443effd640 1 -- 172.21.15.55:0/1224934273 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44280acb30 con 0x7f444015e3c0 2023-08-25T04:18:35.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.118+0000 7f4445a9e640 1 -- 172.21.15.55:0/1224934273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f444015e3c0 msgr2=0x7f44400d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:35.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.118+0000 7f4445a9e640 1 --2- 172.21.15.55:0/1224934273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f444015e3c0 0x7f44400d0b80 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f444008b7f0 tx=0x7f442801c4d0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.118+0000 7f4445a9e640 1 -- 172.21.15.55:0/1224934273 shutdown_connections 2023-08-25T04:18:35.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.118+0000 7f4445a9e640 1 --2- 172.21.15.55:0/1224934273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f444015e3c0 0x7f44400d0b80 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.118+0000 7f4445a9e640 1 --2- 172.21.15.55:0/1224934273 >> v2:172.21.15.110:3300/0 conn(0x7f44401601f0 0x7f444015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.118+0000 7f4445a9e640 1 -- 172.21.15.55:0/1224934273 >> 172.21.15.55:0/1224934273 conn(0x7f44400d27d0 msgr2=0x7f44400d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:35.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.118+0000 7f4445a9e640 1 -- 172.21.15.55:0/1224934273 shutdown_connections 2023-08-25T04:18:35.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.118+0000 7f4445a9e640 1 -- 172.21.15.55:0/1224934273 wait complete. 2023-08-25T04:18:35.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f4445a9e640 1 Processor -- start 2023-08-25T04:18:35.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f4445a9e640 1 -- start start 2023-08-25T04:18:35.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f4445a9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44400d10c0 0x7f44400b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:35.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f4445a9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f444015e3c0 0x7f44400c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:35.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f4445a9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44401601f0 0x7f44400b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:35.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f4445a9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44400b5800 con 0x7f44400d10c0 2023-08-25T04:18:35.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f4445a9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44400c8a20 con 0x7f44401601f0 2023-08-25T04:18:35.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f4445a9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44400c8d00 con 0x7f444015e3c0 2023-08-25T04:18:35.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f443f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44400d10c0 0x7f44400b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:35.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f443f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44400d10c0 0x7f44400b6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45304/0 (socket says 172.21.15.55:45304) 2023-08-25T04:18:35.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f443f7fe640 1 -- 172.21.15.55:0/1516650127 learned_addr learned my addr 172.21.15.55:0/1516650127 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:35.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f4437fff640 1 --2- 172.21.15.55:0/1516650127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f444015e3c0 0x7f44400c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:35.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f443ffff640 1 --2- 172.21.15.55:0/1516650127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44401601f0 0x7f44400b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:35.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f443f7fe640 1 -- 172.21.15.55:0/1516650127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f444015e3c0 msgr2=0x7f44400c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:35.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f443f7fe640 1 --2- 172.21.15.55:0/1516650127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f444015e3c0 0x7f44400c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f443f7fe640 1 -- 172.21.15.55:0/1516650127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44401601f0 msgr2=0x7f44400b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:35.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f443f7fe640 1 --2- 172.21.15.55:0/1516650127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44401601f0 0x7f44400b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f443f7fe640 1 -- 172.21.15.55:0/1516650127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44280094d0 con 0x7f44400d10c0 2023-08-25T04:18:35.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.122+0000 7f443f7fe640 1 --2- 172.21.15.55:0/1516650127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44400d10c0 0x7f44400b6590 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f443000e870 tx=0x7f443000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:35.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.126+0000 7f443cff9640 1 -- 172.21.15.55:0/1516650127 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44300095d0 con 0x7f44400d10c0 2023-08-25T04:18:35.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.126+0000 7f443cff9640 1 -- 172.21.15.55:0/1516650127 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443000c940 con 0x7f44400d10c0 2023-08-25T04:18:35.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.126+0000 7f443cff9640 1 -- 172.21.15.55:0/1516650127 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443000ccb0 con 0x7f44400d10c0 2023-08-25T04:18:35.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.126+0000 7f4445a9e640 1 -- 172.21.15.55:0/1516650127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44400ce7c0 con 0x7f44400d10c0 2023-08-25T04:18:35.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.126+0000 7f4445a9e640 1 -- 172.21.15.55:0/1516650127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44400b5490 con 0x7f44400d10c0 2023-08-25T04:18:35.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.126+0000 7f4445a9e640 1 -- 172.21.15.55:0/1516650127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4440073ec0 con 0x7f44400d10c0 2023-08-25T04:18:35.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.126+0000 7f443cff9640 1 -- 172.21.15.55:0/1516650127 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f4430013470 con 0x7f44400d10c0 2023-08-25T04:18:35.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.126+0000 7f443cff9640 1 --2- 172.21.15.55:0/1516650127 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f44200657a0 0x7f4420067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:35.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.126+0000 7f443cff9640 1 -- 172.21.15.55:0/1516650127 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4430083510 con 0x7f44400d10c0 2023-08-25T04:18:35.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.126+0000 7f4437fff640 1 --2- 172.21.15.55:0/1516650127 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f44200657a0 0x7f4420067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:35.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.130+0000 7f4437fff640 1 --2- 172.21.15.55:0/1516650127 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f44200657a0 0x7f4420067c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f44280ae000 tx=0x7f4428008040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:35.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.130+0000 7f443cff9640 1 -- 172.21.15.55:0/1516650127 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4430050f90 con 0x7f44400d10c0 2023-08-25T04:18:35.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.342+0000 7f4445a9e640 1 -- 172.21.15.55:0/1516650127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f44400cefc0 con 0x7f44400d10c0 2023-08-25T04:18:35.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.354+0000 7f443cff9640 1 -- 172.21.15.55:0/1516650127 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f44300545b0 con 0x7f44400d10c0 2023-08-25T04:18:35.352 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2023-08-25T04:18:35.352 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g== 2023-08-25T04:18:35.352 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2023-08-25T04:18:35.352 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2023-08-25T04:18:35.353 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-25T04:18:35.353 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-08-25T04:18:35.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.354+0000 7f4445a9e640 1 -- 172.21.15.55:0/1516650127 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f44200657a0 msgr2=0x7f4420067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:35.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.354+0000 7f4445a9e640 1 --2- 172.21.15.55:0/1516650127 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f44200657a0 0x7f4420067c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f44280ae000 tx=0x7f4428008040 comp rx=0 tx=0).stop 2023-08-25T04:18:35.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.354+0000 7f4445a9e640 1 -- 172.21.15.55:0/1516650127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44400d10c0 msgr2=0x7f44400b6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:35.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.354+0000 7f4445a9e640 1 --2- 172.21.15.55:0/1516650127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44400d10c0 0x7f44400b6590 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f443000e870 tx=0x7f443000ed30 comp rx=0 tx=0).stop 2023-08-25T04:18:35.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.354+0000 7f4445a9e640 1 -- 172.21.15.55:0/1516650127 shutdown_connections 2023-08-25T04:18:35.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.354+0000 7f4445a9e640 1 --2- 172.21.15.55:0/1516650127 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f44200657a0 0x7f4420067c60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.354+0000 7f4445a9e640 1 --2- 172.21.15.55:0/1516650127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44401601f0 0x7f44400b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.354+0000 7f4445a9e640 1 --2- 172.21.15.55:0/1516650127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f444015e3c0 0x7f44400c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.354+0000 7f4445a9e640 1 --2- 172.21.15.55:0/1516650127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44400d10c0 0x7f44400b6590 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.354+0000 7f4445a9e640 1 -- 172.21.15.55:0/1516650127 >> 172.21.15.55:0/1516650127 conn(0x7f44400d27d0 msgr2=0x7f44400b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:35.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.354+0000 7f4445a9e640 1 -- 172.21.15.55:0/1516650127 shutdown_connections 2023-08-25T04:18:35.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.354+0000 7f4445a9e640 1 -- 172.21.15.55:0/1516650127 wait complete. 2023-08-25T04:18:35.373 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:18:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.518+0000 7efcb69fa640 1 Processor -- start 2023-08-25T04:18:35.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.518+0000 7efcb69fa640 1 -- start start 2023-08-25T04:18:35.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.518+0000 7efcb69fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efcb015c9c0 0x7efcb0160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:35.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.518+0000 7efcb69fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcb006b2b0 0x7efcb006b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:35.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.518+0000 7efcb69fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb006eaf0 con 0x7efcb00cfa70 2023-08-25T04:18:35.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.518+0000 7efcb69fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb006e530 con 0x7efcb015c9c0 2023-08-25T04:18:35.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.518+0000 7efcb69fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb006e810 con 0x7efcb006b2b0 2023-08-25T04:18:35.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.518+0000 7efcaffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efcb015c9c0 0x7efcb0160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:35.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.518+0000 7efcaf7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efcb00cfa70 0x7efcb0160a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44518/0 (socket says 172.21.15.55:44518) 2023-08-25T04:18:35.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.518+0000 7efcaf7fe640 1 -- 172.21.15.55:0/2240714841 learned_addr learned my addr 172.21.15.55:0/2240714841 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:35.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.518+0000 7efcb4f97640 1 --2- 172.21.15.55:0/2240714841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcb006b2b0 0x7efcb006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:35.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.518+0000 7efcaffff640 1 -- 172.21.15.55:0/2240714841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcb006b2b0 msgr2=0x7efcb006b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:35.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.518+0000 7efcaffff640 1 --2- 172.21.15.55:0/2240714841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcb006b2b0 0x7efcb006b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.518+0000 7efcaffff640 1 -- 172.21.15.55:0/2240714841 >> v1:172.21.15.55:6789/0 conn(0x7efcb00cfa70 legacy=0x7efcb0160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:35.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.518+0000 7efcaeffd640 1 -- 172.21.15.55:0/2240714841 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108249293 0 0) 0x7efcb006eaf0 con 0x7efcb00cfa70 2023-08-25T04:18:35.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.518+0000 7efcaffff640 1 -- 172.21.15.55:0/2240714841 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb006aab0 con 0x7efcb015c9c0 2023-08-25T04:18:35.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.522+0000 7efcaffff640 1 --2- 172.21.15.55:0/2240714841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcb015c9c0 0x7efcb0160510 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7efca00097a0 tx=0x7efca001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a76e62ade5ae48 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:35.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.522+0000 7efcaeffd640 1 -- 172.21.15.55:0/2240714841 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca00ab5f0 con 0x7efcb015c9c0 2023-08-25T04:18:35.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.522+0000 7efcaeffd640 1 -- 172.21.15.55:0/2240714841 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca00ab750 con 0x7efcb015c9c0 2023-08-25T04:18:35.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.522+0000 7efcaeffd640 1 -- 172.21.15.55:0/2240714841 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca00abae0 con 0x7efcb015c9c0 2023-08-25T04:18:35.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.522+0000 7efcb69fa640 1 -- 172.21.15.55:0/2240714841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcb015c9c0 msgr2=0x7efcb0160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:35.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.522+0000 7efcb69fa640 1 --2- 172.21.15.55:0/2240714841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcb015c9c0 0x7efcb0160510 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7efca00097a0 tx=0x7efca001c430 comp rx=0 tx=0).stop 2023-08-25T04:18:35.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.522+0000 7efcb69fa640 1 -- 172.21.15.55:0/2240714841 shutdown_connections 2023-08-25T04:18:35.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.522+0000 7efcb69fa640 1 --2- 172.21.15.55:0/2240714841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcb006b2b0 0x7efcb006b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.522+0000 7efcb69fa640 1 --2- 172.21.15.55:0/2240714841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcb015c9c0 0x7efcb0160510 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.522+0000 7efcb69fa640 1 -- 172.21.15.55:0/2240714841 >> 172.21.15.55:0/2240714841 conn(0x7efcb00d05a0 msgr2=0x7efcb00d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:35.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.522+0000 7efcb69fa640 1 -- 172.21.15.55:0/2240714841 shutdown_connections 2023-08-25T04:18:35.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.522+0000 7efcb69fa640 1 -- 172.21.15.55:0/2240714841 wait complete. 2023-08-25T04:18:35.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcb69fa640 1 Processor -- start 2023-08-25T04:18:35.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcb69fa640 1 -- start start 2023-08-25T04:18:35.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcb69fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcb006b2b0 0x7efcb0154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:35.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcb69fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcb00cfa70 0x7efcb014e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:35.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcb69fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb015c9c0 0x7efcb014ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:35.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcb69fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb0151c00 con 0x7efcb006b2b0 2023-08-25T04:18:35.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcb69fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb014f230 con 0x7efcb015c9c0 2023-08-25T04:18:35.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcb69fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb00c3610 con 0x7efcb00cfa70 2023-08-25T04:18:35.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcaffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcb006b2b0 0x7efcb0154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:35.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcaffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcb006b2b0 0x7efcb0154fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45334/0 (socket says 172.21.15.55:45334) 2023-08-25T04:18:35.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcaffff640 1 -- 172.21.15.55:0/245203309 learned_addr learned my addr 172.21.15.55:0/245203309 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:35.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcaf7fe640 1 --2- 172.21.15.55:0/245203309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcb00cfa70 0x7efcb014e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:35.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcb4f97640 1 --2- 172.21.15.55:0/245203309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb015c9c0 0x7efcb014ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:35.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcaffff640 1 -- 172.21.15.55:0/245203309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcb00cfa70 msgr2=0x7efcb014e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:35.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcaffff640 1 --2- 172.21.15.55:0/245203309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcb00cfa70 0x7efcb014e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcaffff640 1 -- 172.21.15.55:0/245203309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb015c9c0 msgr2=0x7efcb014ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:35.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcaffff640 1 --2- 172.21.15.55:0/245203309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb015c9c0 0x7efcb014ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcaffff640 1 -- 172.21.15.55:0/245203309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca00093b0 con 0x7efcb006b2b0 2023-08-25T04:18:35.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcaffff640 1 --2- 172.21.15.55:0/245203309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcb006b2b0 0x7efcb0154fb0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7efca001aae0 tx=0x7efca001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:35.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcacff9640 1 -- 172.21.15.55:0/245203309 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0005ba0 con 0x7efcb006b2b0 2023-08-25T04:18:35.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcacff9640 1 -- 172.21.15.55:0/245203309 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca0005d00 con 0x7efcb006b2b0 2023-08-25T04:18:35.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcacff9640 1 -- 172.21.15.55:0/245203309 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0006260 con 0x7efcb006b2b0 2023-08-25T04:18:35.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.526+0000 7efcb69fa640 1 -- 172.21.15.55:0/245203309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb00c38f0 con 0x7efcb006b2b0 2023-08-25T04:18:35.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.530+0000 7efcb69fa640 1 -- 172.21.15.55:0/245203309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb0151e10 con 0x7efcb006b2b0 2023-08-25T04:18:35.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.530+0000 7efcb69fa640 1 -- 172.21.15.55:0/245203309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb004dbe0 con 0x7efcb006b2b0 2023-08-25T04:18:35.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.530+0000 7efcacff9640 1 -- 172.21.15.55:0/245203309 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7efca00063c0 con 0x7efcb006b2b0 2023-08-25T04:18:35.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.530+0000 7efcacff9640 1 --2- 172.21.15.55:0/245203309 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7efc9c0657d0 0x7efc9c067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:35.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.530+0000 7efcacff9640 1 -- 172.21.15.55:0/245203309 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efca00a8050 con 0x7efcb006b2b0 2023-08-25T04:18:35.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.530+0000 7efcaf7fe640 1 --2- 172.21.15.55:0/245203309 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7efc9c0657d0 0x7efc9c067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:35.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.530+0000 7efcaf7fe640 1 --2- 172.21.15.55:0/245203309 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7efc9c0657d0 0x7efc9c067c90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efcb00c7510 tx=0x7efca4007b60 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:35.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.534+0000 7efcacff9640 1 -- 172.21.15.55:0/245203309 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7efca00eb110 con 0x7efcb006b2b0 2023-08-25T04:18:35.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.722+0000 7efcb69fa640 1 -- 172.21.15.55:0/245203309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcb0152000 con 0x7efcb006b2b0 2023-08-25T04:18:35.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.722+0000 7efcacff9640 1 -- 172.21.15.55:0/245203309 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4882 (secure 0 0 0) 0x7efca00ee730 con 0x7efcb006b2b0 2023-08-25T04:18:35.722 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:35.722 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5915,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1922466113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1922466113},{"type":"v1","addr":"172.21.15.110:6836","nonce":1922466113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6367,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1328842039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1328842039},{"type":"v1","addr":"172.21.15.55:6835","nonce":1328842039}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6385,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/4127792530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":4127792530},{"type":"v1","addr":"172.21.15.110:6837","nonce":4127792530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:18:25.287049+0000","modified":"2023-08-25T04:18:28.905334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/1124967220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1124967220},{"type":"v1","addr":"172.21.15.55:6834","nonce":1124967220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-25T04:18:35.723 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 32 2023-08-25T04:18:35.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.722+0000 7efcb69fa640 1 -- 172.21.15.55:0/245203309 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7efc9c0657d0 msgr2=0x7efc9c067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:35.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.722+0000 7efcb69fa640 1 --2- 172.21.15.55:0/245203309 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7efc9c0657d0 0x7efc9c067c90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efcb00c7510 tx=0x7efca4007b60 comp rx=0 tx=0).stop 2023-08-25T04:18:35.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.722+0000 7efcb69fa640 1 -- 172.21.15.55:0/245203309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcb006b2b0 msgr2=0x7efcb0154fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:35.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.722+0000 7efcb69fa640 1 --2- 172.21.15.55:0/245203309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcb006b2b0 0x7efcb0154fb0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7efca001aae0 tx=0x7efca001ac70 comp rx=0 tx=0).stop 2023-08-25T04:18:35.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.722+0000 7efcb69fa640 1 -- 172.21.15.55:0/245203309 shutdown_connections 2023-08-25T04:18:35.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.722+0000 7efcb69fa640 1 --2- 172.21.15.55:0/245203309 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7efc9c0657d0 0x7efc9c067c90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.722+0000 7efcb69fa640 1 --2- 172.21.15.55:0/245203309 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efcb015c9c0 0x7efcb014ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.722+0000 7efcb69fa640 1 --2- 172.21.15.55:0/245203309 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efcb00cfa70 0x7efcb014e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.722+0000 7efcb69fa640 1 --2- 172.21.15.55:0/245203309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcb006b2b0 0x7efcb0154fb0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:35.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.722+0000 7efcb69fa640 1 -- 172.21.15.55:0/245203309 >> 172.21.15.55:0/245203309 conn(0x7efcb00d05a0 msgr2=0x7efcb00ad170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:35.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.722+0000 7efcb69fa640 1 -- 172.21.15.55:0/245203309 shutdown_connections 2023-08-25T04:18:35.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:35.722+0000 7efcb69fa640 1 -- 172.21.15.55:0/245203309 wait complete. 2023-08-25T04:18:36.145 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-25T04:18:25.287049+0000', 'modified': '2023-08-25T04:18:28.905334+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6780}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6780': {'gid': 6780, 'name': 'a', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6834/1124967220', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 1124967220}, {'type': 'v1', 'addr': '172.21.15.55:6834', 'nonce': 1124967220}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-25T04:18:36.145 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-25T04:18:36.146 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-25T04:18:36.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.294+0000 7f2d441df640 1 Processor -- start 2023-08-25T04:18:36.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.294+0000 7f2d441df640 1 -- start start 2023-08-25T04:18:36.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.294+0000 7f2d441df640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2d3c0d0da0 0x7f2d3c0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.294+0000 7f2d441df640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0b3e50 0x7f2d3c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.294+0000 7f2d441df640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3c0b29b0 con 0x7f2d3c0cdde0 2023-08-25T04:18:36.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.294+0000 7f2d441df640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d3c0ce760 con 0x7f2d3c0d0da0 2023-08-25T04:18:36.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.294+0000 7f2d441df640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0d16c0 con 0x7f2d3c0b3e50 2023-08-25T04:18:36.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.294+0000 7f2d4177a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2d3c0cdde0 0x7f2d3c0cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44522/0 (socket says 172.21.15.55:44522) 2023-08-25T04:18:36.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.294+0000 7f2d4177a640 1 -- 172.21.15.55:0/3114644635 learned_addr learned my addr 172.21.15.55:0/3114644635 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:36.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.294+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/3114644635 >> v2:172.21.15.110:3300/0 conn(0x7f2d3c0d0da0 0x7f2d3c0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.294+0000 7f2d4277c640 1 --2- 172.21.15.55:0/3114644635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0b3e50 0x7f2d3c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.294+0000 7f2d40f79640 1 -- 172.21.15.55:0/3114644635 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38527800 0 0) 0x7f2d3c0b29b0 con 0x7f2d3c0cdde0 2023-08-25T04:18:36.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.294+0000 7f2d40f79640 1 -- 172.21.15.55:0/3114644635 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d28003530 con 0x7f2d3c0cdde0 2023-08-25T04:18:36.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d40f79640 1 -- 172.21.15.55:0/3114644635 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 205683961 0 0) 0x7f2d28003530 con 0x7f2d3c0cdde0 2023-08-25T04:18:36.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d40f79640 1 -- 172.21.15.55:0/3114644635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0b3e50 msgr2=0x7f2d3c0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:36.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d40f79640 1 --2- 172.21.15.55:0/3114644635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0b3e50 0x7f2d3c0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d40f79640 1 -- 172.21.15.55:0/3114644635 >> v2:172.21.15.110:3300/0 conn(0x7f2d3c0d0da0 msgr2=0x7f2d3c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:36.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d40f79640 1 --2- 172.21.15.55:0/3114644635 >> v2:172.21.15.110:3300/0 conn(0x7f2d3c0d0da0 0x7f2d3c0d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d40f79640 1 -- 172.21.15.55:0/3114644635 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c0b1dc0 con 0x7f2d3c0cdde0 2023-08-25T04:18:36.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d40f79640 1 -- 172.21.15.55:0/3114644635 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f2d2c001680 con 0x7f2d3c0cdde0 2023-08-25T04:18:36.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d40f79640 1 -- 172.21.15.55:0/3114644635 >> v1:172.21.15.55:6789/0 conn(0x7f2d3c0cdde0 legacy=0x7f2d3c0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:36.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d40f79640 1 --2- 172.21.15.55:0/3114644635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d28003980 0x7f2d28003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d40f79640 1 --2- 172.21.15.55:0/3114644635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0b3e50 0x7f2d280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d40f79640 1 --2- 172.21.15.55:0/3114644635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d28004d10 0x7f2d28005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d40f79640 1 -- 172.21.15.55:0/3114644635 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0ce760 con 0x7f2d28004d10 2023-08-25T04:18:36.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d40f79640 1 -- 172.21.15.55:0/3114644635 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0d16c0 con 0x7f2d28003980 2023-08-25T04:18:36.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d40f79640 1 -- 172.21.15.55:0/3114644635 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2800b990 con 0x7f2d3c0b3e50 2023-08-25T04:18:36.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/3114644635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d28003980 0x7f2d28003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d4277c640 1 --2- 172.21.15.55:0/3114644635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d28004d10 0x7f2d28005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d4177a640 1 --2- 172.21.15.55:0/3114644635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0b3e50 0x7f2d280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d41f7b640 1 -- 172.21.15.55:0/3114644635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0b3e50 msgr2=0x7f2d280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:36.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/3114644635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0b3e50 0x7f2d280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d41f7b640 1 -- 172.21.15.55:0/3114644635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d28004d10 msgr2=0x7f2d28005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:36.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/3114644635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d28004d10 0x7f2d28005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d41f7b640 1 -- 172.21.15.55:0/3114644635 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d28003530 con 0x7f2d28003980 2023-08-25T04:18:36.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d4277c640 1 --2- 172.21.15.55:0/3114644635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d28004d10 0x7f2d28005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:36.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.298+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/3114644635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d28003980 0x7f2d28003da0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009ac0 tx=0x7f2d3801ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb3d14b24142d4e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:36.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d40f79640 1 -- 172.21.15.55:0/3114644635 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d380059a0 con 0x7f2d28003980 2023-08-25T04:18:36.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d40f79640 1 -- 172.21.15.55:0/3114644635 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d38005b00 con 0x7f2d28003980 2023-08-25T04:18:36.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d40f79640 1 -- 172.21.15.55:0/3114644635 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d380a5660 con 0x7f2d28003980 2023-08-25T04:18:36.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d441df640 1 -- 172.21.15.55:0/3114644635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d28003980 msgr2=0x7f2d28003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:36.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d441df640 1 --2- 172.21.15.55:0/3114644635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d28003980 0x7f2d28003da0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009ac0 tx=0x7f2d3801ca70 comp rx=0 tx=0).stop 2023-08-25T04:18:36.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d4277c640 1 -- 172.21.15.55:0/3114644635 reap_dead start 2023-08-25T04:18:36.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d441df640 1 -- 172.21.15.55:0/3114644635 shutdown_connections 2023-08-25T04:18:36.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d441df640 1 -- 172.21.15.55:0/3114644635 >> 172.21.15.55:0/3114644635 conn(0x7f2d3c09bae0 msgr2=0x7f2d3c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:36.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d441df640 1 -- 172.21.15.55:0/3114644635 shutdown_connections 2023-08-25T04:18:36.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d441df640 1 -- 172.21.15.55:0/3114644635 wait complete. 2023-08-25T04:18:36.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d441df640 1 Processor -- start 2023-08-25T04:18:36.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d441df640 1 -- start start 2023-08-25T04:18:36.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d441df640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d28003980 0x7f2d3c1515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d441df640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3c0d2a90 0x7f2d3c0d2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d441df640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0c8480 0x7f2d3c0c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d441df640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0ca260 con 0x7f2d3c0d2a90 2023-08-25T04:18:36.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d441df640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0d3450 con 0x7f2d28003980 2023-08-25T04:18:36.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d441df640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0c8e70 con 0x7f2d3c0c8480 2023-08-25T04:18:36.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d4177a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3c0d2a90 0x7f2d3c0d2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d4177a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3c0d2a90 0x7f2d3c0d2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45348/0 (socket says 172.21.15.55:45348) 2023-08-25T04:18:36.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d4177a640 1 -- 172.21.15.55:0/2386460865 learned_addr learned my addr 172.21.15.55:0/2386460865 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:36.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.302+0000 7f2d4277c640 1 --2- 172.21.15.55:0/2386460865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0c8480 0x7f2d3c0c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.306+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/2386460865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d28003980 0x7f2d3c1515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.306+0000 7f2d4177a640 1 -- 172.21.15.55:0/2386460865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0c8480 msgr2=0x7f2d3c0c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:36.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.306+0000 7f2d4177a640 1 --2- 172.21.15.55:0/2386460865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0c8480 0x7f2d3c0c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.306+0000 7f2d4177a640 1 -- 172.21.15.55:0/2386460865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d28003980 msgr2=0x7f2d3c1515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:36.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.306+0000 7f2d4177a640 1 --2- 172.21.15.55:0/2386460865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d28003980 0x7f2d3c1515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.306+0000 7f2d4177a640 1 -- 172.21.15.55:0/2386460865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c0c9930 con 0x7f2d3c0d2a90 2023-08-25T04:18:36.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.306+0000 7f2d4177a640 1 --2- 172.21.15.55:0/2386460865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3c0d2a90 0x7f2d3c0d2f10 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c004fb0 tx=0x7f2d2c0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:36.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.306+0000 7f2d327fc640 1 -- 172.21.15.55:0/2386460865 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c007740 con 0x7f2d3c0d2a90 2023-08-25T04:18:36.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.306+0000 7f2d327fc640 1 -- 172.21.15.55:0/2386460865 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c00f9c0 con 0x7f2d3c0d2a90 2023-08-25T04:18:36.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.306+0000 7f2d441df640 1 -- 172.21.15.55:0/2386460865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3c152130 con 0x7f2d3c0d2a90 2023-08-25T04:18:36.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.306+0000 7f2d327fc640 1 -- 172.21.15.55:0/2386460865 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c00fd30 con 0x7f2d3c0d2a90 2023-08-25T04:18:36.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.306+0000 7f2d441df640 1 -- 172.21.15.55:0/2386460865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3c0c9e80 con 0x7f2d3c0d2a90 2023-08-25T04:18:36.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.306+0000 7f2d327fc640 1 -- 172.21.15.55:0/2386460865 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f2d2c01d360 con 0x7f2d3c0d2a90 2023-08-25T04:18:36.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.306+0000 7f2d327fc640 1 --2- 172.21.15.55:0/2386460865 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f2d200657a0 0x7f2d20067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d327fc640 1 -- 172.21.15.55:0/2386460865 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d2c082bf0 con 0x7f2d3c0d2a90 2023-08-25T04:18:36.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/2386460865 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f2d200657a0 0x7f2d20067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d47537000 1 Processor -- start 2023-08-25T04:18:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d47537000 1 -- start start 2023-08-25T04:18:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/2386460865 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f2d200657a0 0x7f2d20067c60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2d380ae000 tx=0x7f2d380046d0 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d47537000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a94020 0x55f0c1a94400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d47537000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a94940 0x55f0c1a4a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d47537000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a4a5b0 0x55f0c1a4a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d47537000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c18a0440 con 0x55f0c1a94020 2023-08-25T04:18:36.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d47537000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c189d970 con 0x55f0c1a4a5b0 2023-08-25T04:18:36.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d47537000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0c1899260 con 0x55f0c1a94940 2023-08-25T04:18:36.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d41f7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a94020 0x55f0c1a94400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d41f7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a94020 0x55f0c1a94400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45360/0 (socket says 172.21.15.55:45360) 2023-08-25T04:18:36.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d41f7b640 1 -- 172.21.15.55:0/750046710 learned_addr learned my addr 172.21.15.55:0/750046710 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:36.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d4177a640 1 --2- 172.21.15.55:0/750046710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a94940 0x55f0c1a4a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d4277c640 1 --2- 172.21.15.55:0/750046710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a4a5b0 0x55f0c1a4a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d41f7b640 1 -- 172.21.15.55:0/750046710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a94940 msgr2=0x55f0c1a4a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:36.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/750046710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a94940 0x55f0c1a4a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d41f7b640 1 -- 172.21.15.55:0/750046710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a4a5b0 msgr2=0x55f0c1a4a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:36.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/750046710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a4a5b0 0x55f0c1a4a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d41f7b640 1 -- 172.21.15.55:0/750046710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0c1931ec0 con 0x55f0c1a94020 2023-08-25T04:18:36.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/750046710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a94020 0x55f0c1a94400 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f2d38006f30 tx=0x7f2d38004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992c791d08d7420b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:36.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d1f7fe640 1 -- 172.21.15.55:0/750046710 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38006030 con 0x55f0c1a94020 2023-08-25T04:18:36.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d1f7fe640 1 -- 172.21.15.55:0/750046710 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d38006190 con 0x55f0c1a94020 2023-08-25T04:18:36.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d1f7fe640 1 -- 172.21.15.55:0/750046710 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38006500 con 0x55f0c1a94020 2023-08-25T04:18:36.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d47537000 1 -- 172.21.15.55:0/750046710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a94020 msgr2=0x55f0c1a94400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:36.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d47537000 1 --2- 172.21.15.55:0/750046710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a94020 0x55f0c1a94400 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f2d38006f30 tx=0x7f2d38004740 comp rx=0 tx=0).stop 2023-08-25T04:18:36.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d47537000 1 -- 172.21.15.55:0/750046710 shutdown_connections 2023-08-25T04:18:36.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d47537000 1 --2- 172.21.15.55:0/750046710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a4a5b0 0x55f0c1a4a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d47537000 1 --2- 172.21.15.55:0/750046710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a94940 0x55f0c1a4a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d47537000 1 --2- 172.21.15.55:0/750046710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a94020 0x55f0c1a94400 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d47537000 1 -- 172.21.15.55:0/750046710 >> 172.21.15.55:0/750046710 conn(0x55f0c1a46560 msgr2=0x55f0c1a48950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:36.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d47537000 1 -- 172.21.15.55:0/750046710 shutdown_connections 2023-08-25T04:18:36.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.310+0000 7f2d47537000 1 -- 172.21.15.55:0/750046710 wait complete. 2023-08-25T04:18:36.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d47537000 1 -- start start 2023-08-25T04:18:36.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d47537000 1 Processor -- start 2023-08-25T04:18:36.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d47537000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a4a5b0 0x55f0c1a9b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d47537000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a94020 0x55f0c1a9b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d47537000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a94940 0x55f0c1a81dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d47537000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c1853f60 con 0x55f0c1a94940 2023-08-25T04:18:36.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d47537000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c1853c00 con 0x55f0c1a94020 2023-08-25T04:18:36.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d47537000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0c1554940 con 0x55f0c1a4a5b0 2023-08-25T04:18:36.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d47537000 10 client.0 _ll_register_callbacks cb 0x55f0c1a35900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:18:36.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d4277c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a94940 0x55f0c1a81dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d4277c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a94940 0x55f0c1a81dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45362/0 (socket says 172.21.15.55:45362) 2023-08-25T04:18:36.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d4277c640 1 -- 172.21.15.55:0/462287371 learned_addr learned my addr 172.21.15.55:0/462287371 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:36.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/462287371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a4a5b0 0x55f0c1a9b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d4177a640 1 --2- 172.21.15.55:0/462287371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a94020 0x55f0c1a9b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d4277c640 1 -- 172.21.15.55:0/462287371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a4a5b0 msgr2=0x55f0c1a9b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:36.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d4277c640 1 --2- 172.21.15.55:0/462287371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a4a5b0 0x55f0c1a9b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d4277c640 1 -- 172.21.15.55:0/462287371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a94020 msgr2=0x55f0c1a9b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:36.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d4277c640 1 --2- 172.21.15.55:0/462287371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a94020 0x55f0c1a9b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d4277c640 1 -- 172.21.15.55:0/462287371 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d28003530 con 0x55f0c1a94940 2023-08-25T04:18:36.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d4277c640 1 --2- 172.21.15.55:0/462287371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a94940 0x55f0c1a81dd0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0b4280 tx=0x7f2d34015760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9251cba526dcae53 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d1cff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T04:18:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d1cff9640 1 -- 172.21.15.55:0/462287371 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3400e040 con 0x55f0c1a94940 2023-08-25T04:18:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d47537000 1 -- 172.21.15.55:0/462287371 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0c18309d0 con 0x55f0c1a94940 2023-08-25T04:18:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d1cff9640 1 -- 172.21.15.55:0/462287371 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d34021c50 con 0x55f0c1a94940 2023-08-25T04:18:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d1cff9640 1 -- 172.21.15.55:0/462287371 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d34021e10 con 0x55f0c1a94940 2023-08-25T04:18:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d47537000 10 client.6954 fetch_fsmap learned FSMap version 32 2023-08-25T04:18:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d47537000 1 -- 172.21.15.55:0/462287371 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55f0c1593890 con 0x55f0c1a94940 2023-08-25T04:18:36.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d1cff9640 1 -- 172.21.15.55:0/462287371 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f0c18309d0 con 0x55f0c1a94940 2023-08-25T04:18:36.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d1cff9640 1 -- 172.21.15.55:0/462287371 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2d340039a0 con 0x55f0c1a94940 2023-08-25T04:18:36.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d47537000 10 client.6954 fetch_fsmap finished waiting for FSMap version 32 2023-08-25T04:18:36.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d47537000 10 client.6954 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-25T04:18:36.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d47537000 20 client.6954 populate_metadata read hostname 'smithi055' 2023-08-25T04:18:36.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d47537000 1 --2- 172.21.15.55:0/462287371 >> [v2:172.21.15.55:6832/1124967220,v1:172.21.15.55:6834/1124967220] conn(0x55f0c1a82b70 0x55f0c1a82f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d47537000 4 client.6954 mds_command: new command op to 6780 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-25T04:18:36.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.314+0000 7f2d47537000 1 -- 172.21.15.55:0/462287371 --> [v2:172.21.15.55:6832/1124967220,v1:172.21.15.55:6834/1124967220] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f0c18507a0 con 0x55f0c1a82b70 2023-08-25T04:18:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.318+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/462287371 >> [v2:172.21.15.55:6832/1124967220,v1:172.21.15.55:6834/1124967220] conn(0x55f0c1a82b70 0x55f0c1a82f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.318+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/462287371 >> [v2:172.21.15.55:6832/1124967220,v1:172.21.15.55:6834/1124967220] conn(0x55f0c1a82b70 0x55f0c1a82f50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7770c9a3bdcaf82b server_cookie=20cf6c6fa0730baf in_seq=0 out_seq=0 2023-08-25T04:18:36.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.318+0000 7f2d1cff9640 10 client.6954 ms_handle_connect on v2:172.21.15.55:6832/1124967220 2023-08-25T04:18:36.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.318+0000 7f2d1cff9640 1 -- 172.21.15.55:0/462287371 <== mds.0 v2:172.21.15.55:6832/1124967220 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f0c18507a0 con 0x55f0c1a82b70 2023-08-25T04:18:36.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.318+0000 7f2d1cff9640 10 client.6954 handle_command_reply: tid=0 2023-08-25T04:18:36.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.318+0000 7f2d47537000 1 client.6954 shutdown 2023-08-25T04:18:36.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.318+0000 7f2d47537000 1 -- 172.21.15.55:0/462287371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a94940 msgr2=0x55f0c1a81dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:36.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.318+0000 7f2d47537000 1 --2- 172.21.15.55:0/462287371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a94940 0x55f0c1a81dd0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0b4280 tx=0x7f2d34015760 comp rx=0 tx=0).stop 2023-08-25T04:18:36.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.318+0000 7f2d47537000 1 -- 172.21.15.55:0/462287371 shutdown_connections 2023-08-25T04:18:36.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.318+0000 7f2d47537000 1 --2- 172.21.15.55:0/462287371 >> [v2:172.21.15.55:6832/1124967220,v1:172.21.15.55:6834/1124967220] conn(0x55f0c1a82b70 0x55f0c1a82f50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.318+0000 7f2d47537000 1 --2- 172.21.15.55:0/462287371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a94940 0x55f0c1a81dd0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.318+0000 7f2d47537000 1 --2- 172.21.15.55:0/462287371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a94020 0x55f0c1a9b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.318+0000 7f2d47537000 1 --2- 172.21.15.55:0/462287371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a4a5b0 0x55f0c1a9b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.318+0000 7f2d47537000 1 -- 172.21.15.55:0/462287371 >> 172.21.15.55:0/462287371 conn(0x55f0c1a46560 msgr2=0x55f0c1a491e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:36.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.318+0000 7f2d1cff9640 0 client.6954 ms_handle_reset on v2:172.21.15.55:6832/1124967220 2023-08-25T04:18:36.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.318+0000 7f2d47537000 1 -- 172.21.15.55:0/462287371 shutdown_connections 2023-08-25T04:18:36.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.318+0000 7f2d47537000 1 -- 172.21.15.55:0/462287371 wait complete. 2023-08-25T04:18:36.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.318+0000 7f2d47537000 20 client.6954 trim_cache size 0 max 16384 2023-08-25T04:18:36.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d47537000 1 Processor -- start 2023-08-25T04:18:36.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d47537000 1 -- start start 2023-08-25T04:18:36.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d47537000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a4a5b0 0x55f0c1a48950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d47537000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a94020 0x55f0c1a48e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d47537000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a94940 0x55f0c1a96d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d47537000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c1850640 con 0x55f0c1a4a5b0 2023-08-25T04:18:36.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d47537000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c189bdc0 con 0x55f0c1a94940 2023-08-25T04:18:36.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d47537000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0c1836d10 con 0x55f0c1a94020 2023-08-25T04:18:36.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d41f7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a4a5b0 0x55f0c1a48950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d41f7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a4a5b0 0x55f0c1a48950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45376/0 (socket says 172.21.15.55:45376) 2023-08-25T04:18:36.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d41f7b640 1 -- 172.21.15.55:0/2385214303 learned_addr learned my addr 172.21.15.55:0/2385214303 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:36.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d4277c640 1 --2- 172.21.15.55:0/2385214303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a94940 0x55f0c1a96d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d4177a640 1 --2- 172.21.15.55:0/2385214303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a94020 0x55f0c1a48e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d41f7b640 1 -- 172.21.15.55:0/2385214303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a94020 msgr2=0x55f0c1a48e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:36.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/2385214303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a94020 0x55f0c1a48e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d41f7b640 1 -- 172.21.15.55:0/2385214303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a94940 msgr2=0x55f0c1a96d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:36.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/2385214303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a94940 0x55f0c1a96d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d41f7b640 1 -- 172.21.15.55:0/2385214303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0c185c190 con 0x55f0c1a4a5b0 2023-08-25T04:18:36.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/2385214303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a4a5b0 0x55f0c1a48950 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2d38005ad0 tx=0x7f2d380b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e3649bd0395ecc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:36.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d1ffff640 1 -- 172.21.15.55:0/2385214303 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d380cb460 con 0x55f0c1a4a5b0 2023-08-25T04:18:36.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d1ffff640 1 -- 172.21.15.55:0/2385214303 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d380d89d0 con 0x55f0c1a4a5b0 2023-08-25T04:18:36.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.334+0000 7f2d1ffff640 1 -- 172.21.15.55:0/2385214303 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d380d8d40 con 0x55f0c1a4a5b0 2023-08-25T04:18:36.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 -- 172.21.15.55:0/2385214303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a4a5b0 msgr2=0x55f0c1a48950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:36.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 --2- 172.21.15.55:0/2385214303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a4a5b0 0x55f0c1a48950 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f2d38005ad0 tx=0x7f2d380b7000 comp rx=0 tx=0).stop 2023-08-25T04:18:36.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 -- 172.21.15.55:0/2385214303 shutdown_connections 2023-08-25T04:18:36.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 --2- 172.21.15.55:0/2385214303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a94940 0x55f0c1a96d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 --2- 172.21.15.55:0/2385214303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a94020 0x55f0c1a48e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 --2- 172.21.15.55:0/2385214303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a4a5b0 0x55f0c1a48950 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 -- 172.21.15.55:0/2385214303 >> 172.21.15.55:0/2385214303 conn(0x55f0c1a46560 msgr2=0x55f0c1a4f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:36.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 -- 172.21.15.55:0/2385214303 shutdown_connections 2023-08-25T04:18:36.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 -- 172.21.15.55:0/2385214303 wait complete. 2023-08-25T04:18:36.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 -- start start 2023-08-25T04:18:36.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 Processor -- start 2023-08-25T04:18:36.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a4a5b0 0x55f0c1af2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a94020 0x55f0c1af3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a94940 0x55f0c1a99000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c1860e80 con 0x55f0c1a4a5b0 2023-08-25T04:18:36.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c1a46130 con 0x55f0c1a94020 2023-08-25T04:18:36.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0c189d260 con 0x55f0c1a94940 2023-08-25T04:18:36.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 10 client.0 _ll_register_callbacks cb 0x7f2d380ba050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:18:36.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d41f7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a4a5b0 0x55f0c1af2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d41f7b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a4a5b0 0x55f0c1af2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45384/0 (socket says 172.21.15.55:45384) 2023-08-25T04:18:36.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d41f7b640 1 -- 172.21.15.55:0/2396445876 learned_addr learned my addr 172.21.15.55:0/2396445876 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:36.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d4177a640 1 --2- 172.21.15.55:0/2396445876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a94020 0x55f0c1af3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d4277c640 1 --2- 172.21.15.55:0/2396445876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a94940 0x55f0c1a99000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d41f7b640 1 -- 172.21.15.55:0/2396445876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a94940 msgr2=0x55f0c1a99000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:36.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/2396445876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a94940 0x55f0c1a99000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d41f7b640 1 -- 172.21.15.55:0/2396445876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a94020 msgr2=0x55f0c1af3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:36.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/2396445876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a94020 0x55f0c1af3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d41f7b640 1 -- 172.21.15.55:0/2396445876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0c1931ec0 con 0x55f0c1a4a5b0 2023-08-25T04:18:36.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d41f7b640 1 --2- 172.21.15.55:0/2396445876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a4a5b0 0x55f0c1af2b50 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2d38000c10 tx=0x7f2d38019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f660fd0ed993955 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:36.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d1cff9640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T04:18:36.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d1cff9640 1 -- 172.21.15.55:0/2396445876 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d380cb460 con 0x55f0c1a4a5b0 2023-08-25T04:18:36.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d1cff9640 1 -- 172.21.15.55:0/2396445876 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d380d2040 con 0x55f0c1a4a5b0 2023-08-25T04:18:36.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 -- 172.21.15.55:0/2396445876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0c1854880 con 0x55f0c1a4a5b0 2023-08-25T04:18:36.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d1cff9640 1 -- 172.21.15.55:0/2396445876 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d380d8b40 con 0x55f0c1a4a5b0 2023-08-25T04:18:36.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 10 client.6960 fetch_fsmap learned FSMap version 32 2023-08-25T04:18:36.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d47537000 1 -- 172.21.15.55:0/2396445876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55f0c1842420 con 0x55f0c1a4a5b0 2023-08-25T04:18:36.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.338+0000 7f2d1cff9640 1 -- 172.21.15.55:0/2396445876 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d380e8020 con 0x55f0c1a4a5b0 2023-08-25T04:18:36.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d1cff9640 1 -- 172.21.15.55:0/2396445876 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2d380be070 con 0x55f0c1a4a5b0 2023-08-25T04:18:36.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d47537000 10 client.6960 fetch_fsmap finished waiting for FSMap version 32 2023-08-25T04:18:36.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d47537000 10 client.6960 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-25T04:18:36.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d47537000 20 client.6960 populate_metadata read hostname 'smithi055' 2023-08-25T04:18:36.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d47537000 1 --2- 172.21.15.55:0/2396445876 >> [v2:172.21.15.55:6832/1124967220,v1:172.21.15.55:6834/1124967220] conn(0x55f0c1a999c0 0x55f0c1a99da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d47537000 4 client.6960 mds_command: new command op to 6780 tid=0[{"prefix": "status"}] 2023-08-25T04:18:36.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d47537000 1 -- 172.21.15.55:0/2396445876 --> [v2:172.21.15.55:6832/1124967220,v1:172.21.15.55:6834/1124967220] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f0c1892240 con 0x55f0c1a999c0 2023-08-25T04:18:36.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d4177a640 1 --2- 172.21.15.55:0/2396445876 >> [v2:172.21.15.55:6832/1124967220,v1:172.21.15.55:6834/1124967220] conn(0x55f0c1a999c0 0x55f0c1a99da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d4177a640 1 --2- 172.21.15.55:0/2396445876 >> [v2:172.21.15.55:6832/1124967220,v1:172.21.15.55:6834/1124967220] conn(0x55f0c1a999c0 0x55f0c1a99da0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db2000a03795c127 server_cookie=79e4a788bdd54de1 in_seq=0 out_seq=0 2023-08-25T04:18:36.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d1cff9640 10 client.6960 ms_handle_connect on v2:172.21.15.55:6832/1124967220 2023-08-25T04:18:36.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d1cff9640 1 -- 172.21.15.55:0/2396445876 <== mds.0 v2:172.21.15.55:6832/1124967220 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55f0c1892240 con 0x55f0c1a999c0 2023-08-25T04:18:36.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d1cff9640 10 client.6960 handle_command_reply: tid=0 2023-08-25T04:18:36.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d47537000 1 client.6960 shutdown 2023-08-25T04:18:36.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d47537000 1 -- 172.21.15.55:0/2396445876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a4a5b0 msgr2=0x55f0c1af2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:36.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d47537000 1 --2- 172.21.15.55:0/2396445876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a4a5b0 0x55f0c1af2b50 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f2d38000c10 tx=0x7f2d38019810 comp rx=0 tx=0).stop 2023-08-25T04:18:36.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d47537000 1 -- 172.21.15.55:0/2396445876 shutdown_connections 2023-08-25T04:18:36.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d47537000 1 --2- 172.21.15.55:0/2396445876 >> [v2:172.21.15.55:6832/1124967220,v1:172.21.15.55:6834/1124967220] conn(0x55f0c1a999c0 0x55f0c1a99da0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d47537000 1 --2- 172.21.15.55:0/2396445876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f0c1a94940 0x55f0c1a99000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d47537000 1 --2- 172.21.15.55:0/2396445876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f0c1a94020 0x55f0c1af3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d47537000 1 --2- 172.21.15.55:0/2396445876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f0c1a4a5b0 0x55f0c1af2b50 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d1cff9640 0 client.6960 ms_handle_reset on v2:172.21.15.55:6832/1124967220 2023-08-25T04:18:36.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d47537000 1 -- 172.21.15.55:0/2396445876 >> 172.21.15.55:0/2396445876 conn(0x55f0c1a46560 msgr2=0x55f0c1a80f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:36.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d47537000 1 -- 172.21.15.55:0/2396445876 shutdown_connections 2023-08-25T04:18:36.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d47537000 1 -- 172.21.15.55:0/2396445876 wait complete. 2023-08-25T04:18:36.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d47537000 20 client.6960 trim_cache size 0 max 16384 2023-08-25T04:18:36.349 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T04:18:36.349 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2d2a9024-b152-4d40-880c-1686d1810590", 2023-08-25T04:18:36.350 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-08-25T04:18:36.350 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 6780, 2023-08-25T04:18:36.350 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-08-25T04:18:36.350 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-08-25T04:18:36.350 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-08-25T04:18:36.350 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.459071278, 2023-08-25T04:18:36.350 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 32, 2023-08-25T04:18:36.350 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 79, 2023-08-25T04:18:36.351 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 79, 2023-08-25T04:18:36.351 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 16.397957835 2023-08-25T04:18:36.351 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T04:18:36.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d441df640 1 -- 172.21.15.55:0/2386460865 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f2d200657a0 msgr2=0x7f2d20067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:36.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d441df640 1 --2- 172.21.15.55:0/2386460865 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f2d200657a0 0x7f2d20067c60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2d380ae000 tx=0x7f2d380046d0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d441df640 1 -- 172.21.15.55:0/2386460865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3c0d2a90 msgr2=0x7f2d3c0d2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:36.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d441df640 1 --2- 172.21.15.55:0/2386460865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3c0d2a90 0x7f2d3c0d2f10 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c004fb0 tx=0x7f2d2c0074f0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d441df640 1 -- 172.21.15.55:0/2386460865 shutdown_connections 2023-08-25T04:18:36.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d441df640 1 --2- 172.21.15.55:0/2386460865 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f2d200657a0 0x7f2d20067c60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d441df640 1 --2- 172.21.15.55:0/2386460865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0c8480 0x7f2d3c0c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d441df640 1 --2- 172.21.15.55:0/2386460865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3c0d2a90 0x7f2d3c0d2f10 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d441df640 1 --2- 172.21.15.55:0/2386460865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d28003980 0x7f2d3c1515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d441df640 1 -- 172.21.15.55:0/2386460865 >> 172.21.15.55:0/2386460865 conn(0x7f2d3c09bae0 msgr2=0x7f2d3c06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:36.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d441df640 1 -- 172.21.15.55:0/2386460865 shutdown_connections 2023-08-25T04:18:36.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.342+0000 7f2d441df640 1 -- 172.21.15.55:0/2386460865 wait complete. 2023-08-25T04:18:36.360 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:18:36.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.506+0000 7f37599f4640 1 Processor -- start 2023-08-25T04:18:36.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.506+0000 7f37599f4640 1 -- start start 2023-08-25T04:18:36.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.506+0000 7f37599f4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375415c9f0 0x7f37540b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.506+0000 7f37599f4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f37540d0340 0x7f375406a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.506+0000 7f37599f4640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37540b4b20 con 0x7f375406aee0 2023-08-25T04:18:36.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.506+0000 7f37599f4640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37540b4e00 con 0x7f37540d0340 2023-08-25T04:18:36.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.506+0000 7f37599f4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37540cd530 con 0x7f375415c9f0 2023-08-25T04:18:36.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.506+0000 7f3753fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f37540d0340 0x7f375406a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.506+0000 7f3753fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f37540d0340 0x7f375406a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45394/0 (socket says 172.21.15.55:45394) 2023-08-25T04:18:36.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.506+0000 7f3753fff640 1 -- 172.21.15.55:0/540065117 learned_addr learned my addr 172.21.15.55:0/540065117 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:36.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.506+0000 7f37589f2640 1 --2- 172.21.15.55:0/540065117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375415c9f0 0x7f37540b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.506+0000 7f3753fff640 1 -- 172.21.15.55:0/540065117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375415c9f0 msgr2=0x7f37540b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:36.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.506+0000 7f3753fff640 1 --2- 172.21.15.55:0/540065117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375415c9f0 0x7f37540b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.506+0000 7f3753fff640 1 -- 172.21.15.55:0/540065117 >> v1:172.21.15.110:6789/0 conn(0x7f375406aee0 legacy=0x7f37540cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:36.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.506+0000 7f3753fff640 1 -- 172.21.15.55:0/540065117 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37540cd810 con 0x7f37540d0340 2023-08-25T04:18:36.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.510+0000 7f3753fff640 1 --2- 172.21.15.55:0/540065117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37540d0340 0x7f375406a9a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3740009870 tx=0x7f374001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623d2d52b3e1fe5c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:36.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.510+0000 7f37537fe640 1 -- 172.21.15.55:0/540065117 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37400a8a30 con 0x7f37540d0340 2023-08-25T04:18:36.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.510+0000 7f37537fe640 1 -- 172.21.15.55:0/540065117 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37400a8b90 con 0x7f37540d0340 2023-08-25T04:18:36.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.510+0000 7f37537fe640 1 -- 172.21.15.55:0/540065117 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37400b0440 con 0x7f37540d0340 2023-08-25T04:18:36.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.510+0000 7f37599f4640 1 -- 172.21.15.55:0/540065117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37540d0340 msgr2=0x7f375406a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:36.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.510+0000 7f37599f4640 1 --2- 172.21.15.55:0/540065117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37540d0340 0x7f375406a9a0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3740009870 tx=0x7f374001ed30 comp rx=0 tx=0).stop 2023-08-25T04:18:36.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.510+0000 7f37599f4640 1 -- 172.21.15.55:0/540065117 shutdown_connections 2023-08-25T04:18:36.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.510+0000 7f37599f4640 1 --2- 172.21.15.55:0/540065117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37540d0340 0x7f375406a9a0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.510+0000 7f37599f4640 1 --2- 172.21.15.55:0/540065117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375415c9f0 0x7f37540b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.510+0000 7f37599f4640 1 -- 172.21.15.55:0/540065117 >> 172.21.15.55:0/540065117 conn(0x7f37540d25f0 msgr2=0x7f37540d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:36.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.510+0000 7f37599f4640 1 -- 172.21.15.55:0/540065117 shutdown_connections 2023-08-25T04:18:36.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.510+0000 7f37599f4640 1 -- 172.21.15.55:0/540065117 wait complete. 2023-08-25T04:18:36.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.510+0000 7f37599f4640 1 Processor -- start 2023-08-25T04:18:36.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.510+0000 7f37599f4640 1 -- start start 2023-08-25T04:18:36.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37599f4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375406aee0 0x7f3754159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37599f4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37540d0340 0x7f37540c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37599f4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375415c9f0 0x7f37540c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37599f4640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375415a450 con 0x7f375415c9f0 2023-08-25T04:18:36.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37599f4640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375415e080 con 0x7f37540d0340 2023-08-25T04:18:36.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37599f4640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375415dda0 con 0x7f375406aee0 2023-08-25T04:18:36.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37591f3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375415c9f0 0x7f37540c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f3753fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37540d0340 0x7f37540c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37589f2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375406aee0 0x7f3754159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37591f3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375415c9f0 0x7f37540c71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45396/0 (socket says 172.21.15.55:45396) 2023-08-25T04:18:36.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37591f3640 1 -- 172.21.15.55:0/2107707957 learned_addr learned my addr 172.21.15.55:0/2107707957 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37591f3640 1 -- 172.21.15.55:0/2107707957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375406aee0 msgr2=0x7f3754159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37591f3640 1 --2- 172.21.15.55:0/2107707957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375406aee0 0x7f3754159f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37591f3640 1 -- 172.21.15.55:0/2107707957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37540d0340 msgr2=0x7f37540c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37591f3640 1 --2- 172.21.15.55:0/2107707957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37540d0340 0x7f37540c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37591f3640 1 -- 172.21.15.55:0/2107707957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37400094d0 con 0x7f375415c9f0 2023-08-25T04:18:36.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37591f3640 1 --2- 172.21.15.55:0/2107707957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375415c9f0 0x7f37540c71a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f374c00c770 tx=0x7f374c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:36.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37517fa640 1 -- 172.21.15.55:0/2107707957 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c003b80 con 0x7f375415c9f0 2023-08-25T04:18:36.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37517fa640 1 -- 172.21.15.55:0/2107707957 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c003ce0 con 0x7f375415c9f0 2023-08-25T04:18:36.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37517fa640 1 -- 172.21.15.55:0/2107707957 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c00aa90 con 0x7f375415c9f0 2023-08-25T04:18:36.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37599f4640 1 -- 172.21.15.55:0/2107707957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375415e380 con 0x7f375415c9f0 2023-08-25T04:18:36.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37599f4640 1 -- 172.21.15.55:0/2107707957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375415e940 con 0x7f375415c9f0 2023-08-25T04:18:36.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.514+0000 7f37599f4640 1 -- 172.21.15.55:0/2107707957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375415eb30 con 0x7f375415c9f0 2023-08-25T04:18:36.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.518+0000 7f37517fa640 1 -- 172.21.15.55:0/2107707957 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f374c00abf0 con 0x7f375415c9f0 2023-08-25T04:18:36.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.518+0000 7f37517fa640 1 --2- 172.21.15.55:0/2107707957 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f37380657a0 0x7f3738067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:36.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.518+0000 7f37517fa640 1 -- 172.21.15.55:0/2107707957 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f374c082d30 con 0x7f375415c9f0 2023-08-25T04:18:36.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.518+0000 7f37589f2640 1 --2- 172.21.15.55:0/2107707957 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f37380657a0 0x7f3738067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:36.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.518+0000 7f37589f2640 1 --2- 172.21.15.55:0/2107707957 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f37380657a0 0x7f3738067c60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3748006fd0 tx=0x7f3748008040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:36.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.522+0000 7f37517fa640 1 -- 172.21.15.55:0/2107707957 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f374c0506f0 con 0x7f375415c9f0 2023-08-25T04:18:36.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.714+0000 7f37599f4640 1 -- 172.21.15.55:0/2107707957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3754066d20 con 0x7f375415c9f0 2023-08-25T04:18:36.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.714+0000 7f37517fa640 1 -- 172.21.15.55:0/2107707957 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f374c053d10 con 0x7f375415c9f0 2023-08-25T04:18:36.715 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T04:18:36.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.718+0000 7f37599f4640 1 -- 172.21.15.55:0/2107707957 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f37380657a0 msgr2=0x7f3738067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:36.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.718+0000 7f37599f4640 1 --2- 172.21.15.55:0/2107707957 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f37380657a0 0x7f3738067c60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3748006fd0 tx=0x7f3748008040 comp rx=0 tx=0).stop 2023-08-25T04:18:36.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.718+0000 7f37599f4640 1 -- 172.21.15.55:0/2107707957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375415c9f0 msgr2=0x7f37540c71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:36.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.718+0000 7f37599f4640 1 --2- 172.21.15.55:0/2107707957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375415c9f0 0x7f37540c71a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f374c00c770 tx=0x7f374c00cc30 comp rx=0 tx=0).stop 2023-08-25T04:18:36.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.718+0000 7f37599f4640 1 -- 172.21.15.55:0/2107707957 shutdown_connections 2023-08-25T04:18:36.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.718+0000 7f37599f4640 1 --2- 172.21.15.55:0/2107707957 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f37380657a0 0x7f3738067c60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.718+0000 7f37599f4640 1 --2- 172.21.15.55:0/2107707957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375415c9f0 0x7f37540c71a0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.718+0000 7f37599f4640 1 --2- 172.21.15.55:0/2107707957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37540d0340 0x7f37540c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.718+0000 7f37599f4640 1 --2- 172.21.15.55:0/2107707957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f375406aee0 0x7f3754159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:36.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.718+0000 7f37599f4640 1 -- 172.21.15.55:0/2107707957 >> 172.21.15.55:0/2107707957 conn(0x7f37540d25f0 msgr2=0x7f37540b0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:36.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.718+0000 7f37599f4640 1 -- 172.21.15.55:0/2107707957 shutdown_connections 2023-08-25T04:18:36.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:36.718+0000 7f37599f4640 1 -- 172.21.15.55:0/2107707957 wait complete. 2023-08-25T04:18:36.736 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-25T04:18:36.737 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:18:36.737 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-08-25T04:18:36.737 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-25T04:18:36.738 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T04:18:36.738 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-25T04:18:36.738 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-25T04:18:36.739 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:18:36.739 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:18:36.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:36.740 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-08-25T04:18:36.752 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:18:36.753 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:18:36.753 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:18:36.753 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:18:36.753 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-08-25T04:18:36.754 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:18:36.754 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:18:36.754 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:18:36.754 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-08-25T04:18:36.754 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:18:36.755 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:18:36.755 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-08-25T04:18:36.755 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:18:36.756 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:18:36.756 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-08-25T04:18:36.756 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-08-25T04:18:36.756 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41472sec preferred_lft 41472sec 2023-08-25T04:18:36.757 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-08-25T04:18:36.757 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:18:36.757 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:18:36.757 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:18:36.757 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-08-25T04:18:36.758 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-25T04:18:36.758 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:98:6a:38:6a brd ff:ff:ff:ff:ff:ff 2023-08-25T04:18:36.758 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-25T04:18:36.758 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:18:36.758 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:18:36.758 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-08-25T04:18:36.758 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T04:18:36.759 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:18:36.759 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-08-25T04:18:36.759 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:18:36.759 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:18:36.759 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T04:18:36.759 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-08-25T04:18:36.759 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:18:36.760 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:18:36.760 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-25T04:18:36.760 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-08-25T04:18:36.760 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:18:36.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:36.761 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:18:36.818 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-08-25T04:18:36.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:36.822 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-08-25T04:18:36.872 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-08-25T04:18:36.872 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:18:36.872 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-08-25T04:18:36.873 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-25T04:18:36.873 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-08-25T04:18:36.873 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:18:36.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:36.874 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T04:18:36.874 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T04:18:36.875 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-25T04:18:36.875 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-25T04:18:36.875 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-25T04:18:36.876 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T04:18:36.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:36.969 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-08-25T04:18:36.978 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-25T04:18:36.979 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-25T04:18:36.979 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:18:36.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:36.980 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-08-25T04:18:37.040 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:18:37.041 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-25T04:18:37.097 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:18:37.097 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:18:37.097 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:18:37.149 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-25T04:18:37.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:37.150 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:18:37.243 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:18:37.243 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:18:37.256 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:18:37.256 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:18:37.257 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.110:3300,172.21.15.110:3301" 2023-08-25T04:18:37.257 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2d2a9024-b152-4d40-880c-1686d1810590.cephfs=/ 2023-08-25T04:18:37.257 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2023-08-25T04:18:37.259 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T04:18:37.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:37.260 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:18:37.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:37.284 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:18:37.347 INFO:teuthology.orchestra.run.smithi055.stdout:client6041 2023-08-25T04:18:37.349 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:18:37.349 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:37.401 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-25T04:18:37.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.586+0000 7fcba5537640 1 Processor -- start 2023-08-25T04:18:37.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.586+0000 7fcba5537640 1 -- start start 2023-08-25T04:18:37.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.590+0000 7fcba5537640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcba015ef80 0x7fcba00ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:37.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.590+0000 7fcba5537640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcba00cece0 0x7fcba00ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:37.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.590+0000 7fcba5537640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba00ac3a0 con 0x7fcba015eba0 2023-08-25T04:18:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.590+0000 7fcba5537640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba00cf170 con 0x7fcba015ef80 2023-08-25T04:18:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.590+0000 7fcba5537640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba00b3150 con 0x7fcba00cece0 2023-08-25T04:18:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.590+0000 7fcb967fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcba015ef80 0x7fcba00ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.590+0000 7fcb967fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcba015ef80 0x7fcba00ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45406/0 (socket says 172.21.15.55:45406) 2023-08-25T04:18:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.590+0000 7fcb967fc640 1 -- 172.21.15.55:0/2055407117 learned_addr learned my addr 172.21.15.55:0/2055407117 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.590+0000 7fcb9f7fe640 1 --2- 172.21.15.55:0/2055407117 >> v2:172.21.15.110:3300/0 conn(0x7fcba00cece0 0x7fcba00ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:37.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.590+0000 7fcb967fc640 1 -- 172.21.15.55:0/2055407117 >> v2:172.21.15.110:3300/0 conn(0x7fcba00cece0 msgr2=0x7fcba00ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:37.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.590+0000 7fcb967fc640 1 --2- 172.21.15.55:0/2055407117 >> v2:172.21.15.110:3300/0 conn(0x7fcba00cece0 0x7fcba00ab0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:37.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.590+0000 7fcb967fc640 1 -- 172.21.15.55:0/2055407117 >> v1:172.21.15.110:6789/0 conn(0x7fcba015eba0 legacy=0x7fcba00b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:37.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.590+0000 7fcb967fc640 1 -- 172.21.15.55:0/2055407117 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba00b1390 con 0x7fcba015ef80 2023-08-25T04:18:37.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.590+0000 7fcb9f7fe640 1 --2- 172.21.15.55:0/2055407117 >> v2:172.21.15.110:3300/0 conn(0x7fcba00cece0 0x7fcba00ab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:37.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.590+0000 7fcb967fc640 1 --2- 172.21.15.55:0/2055407117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcba015ef80 0x7fcba00ce7a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fcba00add30 tx=0x7fcb9001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f66d3bcd214a626 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:37.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcb9e7fc640 1 -- 172.21.15.55:0/2055407117 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb900aa5f0 con 0x7fcba015ef80 2023-08-25T04:18:37.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcb9e7fc640 1 -- 172.21.15.55:0/2055407117 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb900aa750 con 0x7fcba015ef80 2023-08-25T04:18:37.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcb9e7fc640 1 -- 172.21.15.55:0/2055407117 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb900aaae0 con 0x7fcba015ef80 2023-08-25T04:18:37.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcba5537640 1 -- 172.21.15.55:0/2055407117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcba015ef80 msgr2=0x7fcba00ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:37.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcba5537640 1 --2- 172.21.15.55:0/2055407117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcba015ef80 0x7fcba00ce7a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fcba00add30 tx=0x7fcb9001c490 comp rx=0 tx=0).stop 2023-08-25T04:18:37.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcba5537640 1 -- 172.21.15.55:0/2055407117 shutdown_connections 2023-08-25T04:18:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcba5537640 1 --2- 172.21.15.55:0/2055407117 >> v2:172.21.15.110:3300/0 conn(0x7fcba00cece0 0x7fcba00ab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcba5537640 1 --2- 172.21.15.55:0/2055407117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcba015ef80 0x7fcba00ce7a0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcba5537640 1 -- 172.21.15.55:0/2055407117 >> 172.21.15.55:0/2055407117 conn(0x7fcba0069d00 msgr2=0x7fcba006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcba5537640 1 -- 172.21.15.55:0/2055407117 shutdown_connections 2023-08-25T04:18:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcba5537640 1 -- 172.21.15.55:0/2055407117 wait complete. 2023-08-25T04:18:37.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcba5537640 1 Processor -- start 2023-08-25T04:18:37.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcba5537640 1 -- start start 2023-08-25T04:18:37.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcba5537640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcba00cece0 0x7fcba00c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:37.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcba5537640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcba015eba0 0x7fcba006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:37.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcba5537640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcba015ef80 0x7fcba0158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:37.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcba5537640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba00c4610 con 0x7fcba015eba0 2023-08-25T04:18:37.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcba5537640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba00c3990 con 0x7fcba00cece0 2023-08-25T04:18:37.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.594+0000 7fcba5537640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba00c3c70 con 0x7fcba015ef80 2023-08-25T04:18:37.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcb967fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcba015eba0 0x7fcba006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:37.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcb967fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcba015eba0 0x7fcba006d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45414/0 (socket says 172.21.15.55:45414) 2023-08-25T04:18:37.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcb967fc640 1 -- 172.21.15.55:0/1274557547 learned_addr learned my addr 172.21.15.55:0/1274557547 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:37.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcb9effd640 1 --2- 172.21.15.55:0/1274557547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcba00cece0 0x7fcba00c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcb9f7fe640 1 --2- 172.21.15.55:0/1274557547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcba015ef80 0x7fcba0158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcb967fc640 1 -- 172.21.15.55:0/1274557547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcba015ef80 msgr2=0x7fcba0158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcb967fc640 1 --2- 172.21.15.55:0/1274557547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcba015ef80 0x7fcba0158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcb967fc640 1 -- 172.21.15.55:0/1274557547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcba00cece0 msgr2=0x7fcba00c32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:37.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcb967fc640 1 --2- 172.21.15.55:0/1274557547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcba00cece0 0x7fcba00c32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:37.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcb967fc640 1 -- 172.21.15.55:0/1274557547 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb900094d0 con 0x7fcba015eba0 2023-08-25T04:18:37.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcb9effd640 1 --2- 172.21.15.55:0/1274557547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcba00cece0 0x7fcba00c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:37.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcb9f7fe640 1 --2- 172.21.15.55:0/1274557547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcba015ef80 0x7fcba0158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:37.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcb967fc640 1 --2- 172.21.15.55:0/1274557547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcba015eba0 0x7fcba006d190 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fcb900ac040 tx=0x7fcb90019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcb97fff640 1 -- 172.21.15.55:0/1274557547 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb900b4810 con 0x7fcba015eba0 2023-08-25T04:18:37.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcb97fff640 1 -- 172.21.15.55:0/1274557547 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb900b4990 con 0x7fcba015eba0 2023-08-25T04:18:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcb97fff640 1 -- 172.21.15.55:0/1274557547 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb900b4d40 con 0x7fcba015eba0 2023-08-25T04:18:37.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcba5537640 1 -- 172.21.15.55:0/1274557547 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba00c3f50 con 0x7fcba015eba0 2023-08-25T04:18:37.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcba5537640 1 -- 172.21.15.55:0/1274557547 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba01568d0 con 0x7fcba015eba0 2023-08-25T04:18:37.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcba5537640 1 -- 172.21.15.55:0/1274557547 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba004dbe0 con 0x7fcba015eba0 2023-08-25T04:18:37.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.598+0000 7fcb97fff640 1 -- 172.21.15.55:0/1274557547 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fcb900be410 con 0x7fcba015eba0 2023-08-25T04:18:37.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.602+0000 7fcb97fff640 1 --2- 172.21.15.55:0/1274557547 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fcb800657a0 0x7fcb80067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:37.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.602+0000 7fcb97fff640 1 -- 172.21.15.55:0/1274557547 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb900a7070 con 0x7fcba015eba0 2023-08-25T04:18:37.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.602+0000 7fcb9effd640 1 --2- 172.21.15.55:0/1274557547 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fcb800657a0 0x7fcb80067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:37.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.602+0000 7fcb9effd640 1 --2- 172.21.15.55:0/1274557547 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fcb800657a0 0x7fcb80067c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcb88003ec0 tx=0x7fcb88009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:37.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.606+0000 7fcb97fff640 1 -- 172.21.15.55:0/1274557547 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fcb900eb7d0 con 0x7fcba015eba0 2023-08-25T04:18:37.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.786+0000 7fcba5537640 1 -- 172.21.15.55:0/1274557547 --> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fcba00c4750 con 0x7fcb800657a0 2023-08-25T04:18:37.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.786+0000 7fcb97fff640 1 -- 172.21.15.55:0/1274557547 <== mgr.5720 v2:172.21.15.110:6832/2283645732 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fcba00c4750 con 0x7fcb800657a0 2023-08-25T04:18:37.786 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T04:18:37.786 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:18:37.786 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-08-25T04:18:37.786 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:18:37.786 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T04:18:37.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.790+0000 7fcba5537640 1 -- 172.21.15.55:0/1274557547 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fcb800657a0 msgr2=0x7fcb80067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:37.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.790+0000 7fcba5537640 1 --2- 172.21.15.55:0/1274557547 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fcb800657a0 0x7fcb80067c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcb88003ec0 tx=0x7fcb88009040 comp rx=0 tx=0).stop 2023-08-25T04:18:37.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.790+0000 7fcba5537640 1 -- 172.21.15.55:0/1274557547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcba015eba0 msgr2=0x7fcba006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:37.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.790+0000 7fcba5537640 1 --2- 172.21.15.55:0/1274557547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcba015eba0 0x7fcba006d190 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fcb900ac040 tx=0x7fcb90019230 comp rx=0 tx=0).stop 2023-08-25T04:18:37.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.790+0000 7fcba5537640 1 -- 172.21.15.55:0/1274557547 shutdown_connections 2023-08-25T04:18:37.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.790+0000 7fcba5537640 1 --2- 172.21.15.55:0/1274557547 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fcb800657a0 0x7fcb80067c60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:37.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.790+0000 7fcba5537640 1 --2- 172.21.15.55:0/1274557547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcba015ef80 0x7fcba0158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:37.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.790+0000 7fcba5537640 1 --2- 172.21.15.55:0/1274557547 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcba015eba0 0x7fcba006d190 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:37.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.790+0000 7fcba5537640 1 --2- 172.21.15.55:0/1274557547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcba00cece0 0x7fcba00c32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:37.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.790+0000 7fcba5537640 1 -- 172.21.15.55:0/1274557547 >> 172.21.15.55:0/1274557547 conn(0x7fcba0069d00 msgr2=0x7fcba00ad240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:37.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.790+0000 7fcba5537640 1 -- 172.21.15.55:0/1274557547 shutdown_connections 2023-08-25T04:18:37.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.790+0000 7fcba5537640 1 -- 172.21.15.55:0/1274557547 wait complete. 2023-08-25T04:18:37.807 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-25T04:18:37.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.954+0000 7f63bc419640 1 Processor -- start 2023-08-25T04:18:37.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.954+0000 7f63bc419640 1 -- start start 2023-08-25T04:18:37.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.954+0000 7f63bc419640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f63b406c790 0x7f63b40cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:37.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.954+0000 7f63bc419640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b40cab90 con 0x7f63b406c3b0 2023-08-25T04:18:37.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.954+0000 7f63bc419640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b406dbb0 con 0x7f63b406e5a0 2023-08-25T04:18:37.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.954+0000 7f63bc419640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b40cae50 con 0x7f63b406c790 2023-08-25T04:18:37.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.954+0000 7f63ba9b6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f63b406c790 0x7f63b40cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:37.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.954+0000 7f63ba9b6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f63b406c790 0x7f63b40cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45426/0 (socket says 172.21.15.55:45426) 2023-08-25T04:18:37.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.954+0000 7f63ba1b5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f63b406c3b0 0x7f63b406de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44532/0 (socket says 172.21.15.55:44532) 2023-08-25T04:18:37.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.954+0000 7f63ba9b6640 1 -- 172.21.15.55:0/1142416803 learned_addr learned my addr 172.21.15.55:0/1142416803 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:37.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.954+0000 7f63ba9b6640 1 -- 172.21.15.55:0/1142416803 >> v1:172.21.15.110:6789/0 conn(0x7f63b406e5a0 legacy=0x7f63b40ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:37.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.954+0000 7f63ba9b6640 1 -- 172.21.15.55:0/1142416803 >> v1:172.21.15.55:6789/0 conn(0x7f63b406c3b0 legacy=0x7f63b406de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:37.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.954+0000 7f63ba9b6640 1 -- 172.21.15.55:0/1142416803 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b40cb130 con 0x7f63b406c790 2023-08-25T04:18:37.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.958+0000 7f63ba9b6640 1 --2- 172.21.15.55:0/1142416803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63b406c790 0x7f63b40cd7d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009e50 tx=0x7f63ac01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50845989003ee77 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:37.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.958+0000 7f63b91b3640 1 -- 172.21.15.55:0/1142416803 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac0a5840 con 0x7f63b406c790 2023-08-25T04:18:37.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.958+0000 7f63b91b3640 1 -- 172.21.15.55:0/1142416803 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac0a59a0 con 0x7f63b406c790 2023-08-25T04:18:37.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.958+0000 7f63b91b3640 1 -- 172.21.15.55:0/1142416803 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac0a5d30 con 0x7f63b406c790 2023-08-25T04:18:37.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.958+0000 7f63bc419640 1 -- 172.21.15.55:0/1142416803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63b406c790 msgr2=0x7f63b40cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:37.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.958+0000 7f63bc419640 1 --2- 172.21.15.55:0/1142416803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63b406c790 0x7f63b40cd7d0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009e50 tx=0x7f63ac01c9a0 comp rx=0 tx=0).stop 2023-08-25T04:18:37.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.958+0000 7f63bc419640 1 -- 172.21.15.55:0/1142416803 shutdown_connections 2023-08-25T04:18:37.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.958+0000 7f63bc419640 1 --2- 172.21.15.55:0/1142416803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63b406c790 0x7f63b40cd7d0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:37.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.958+0000 7f63bc419640 1 -- 172.21.15.55:0/1142416803 >> 172.21.15.55:0/1142416803 conn(0x7f63b40d0540 msgr2=0x7f63b40d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:37.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.958+0000 7f63bc419640 1 -- 172.21.15.55:0/1142416803 shutdown_connections 2023-08-25T04:18:37.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.958+0000 7f63bc419640 1 -- 172.21.15.55:0/1142416803 wait complete. 2023-08-25T04:18:37.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63bc419640 1 Processor -- start 2023-08-25T04:18:37.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63bc419640 1 -- start start 2023-08-25T04:18:37.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63bc419640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63b406c3b0 0x7f63b41557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:37.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63bc419640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63b406c790 0x7f63b40c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:37.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63bc419640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63b406e5a0 0x7f63b40c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:37.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63bc419640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40ca460 con 0x7f63b406c790 2023-08-25T04:18:37.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63bc419640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40c54b0 con 0x7f63b406c3b0 2023-08-25T04:18:37.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63bc419640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b40c4b80 con 0x7f63b406e5a0 2023-08-25T04:18:37.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63b99b4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63b406c790 0x7f63b40c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:37.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63b99b4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63b406c790 0x7f63b40c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45430/0 (socket says 172.21.15.55:45430) 2023-08-25T04:18:37.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63ba1b5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63b406c3b0 0x7f63b41557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:37.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63b99b4640 1 -- 172.21.15.55:0/530670583 learned_addr learned my addr 172.21.15.55:0/530670583 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:37.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63ba9b6640 1 --2- 172.21.15.55:0/530670583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63b406e5a0 0x7f63b40c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:37.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63b99b4640 1 -- 172.21.15.55:0/530670583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63b406e5a0 msgr2=0x7f63b40c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:37.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63b99b4640 1 --2- 172.21.15.55:0/530670583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63b406e5a0 0x7f63b40c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:37.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63b99b4640 1 -- 172.21.15.55:0/530670583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63b406c3b0 msgr2=0x7f63b41557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:37.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63b99b4640 1 --2- 172.21.15.55:0/530670583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63b406c3b0 0x7f63b41557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:37.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63b99b4640 1 -- 172.21.15.55:0/530670583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac009b30 con 0x7f63b406c790 2023-08-25T04:18:37.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63ba9b6640 1 --2- 172.21.15.55:0/530670583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63b406e5a0 0x7f63b40c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:37.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63b99b4640 1 --2- 172.21.15.55:0/530670583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63b406c790 0x7f63b40c5940 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f63a400b3e0 tx=0x7f63a400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:37.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63aaffd640 1 -- 172.21.15.55:0/530670583 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4011830 con 0x7f63b406c790 2023-08-25T04:18:37.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63aaffd640 1 -- 172.21.15.55:0/530670583 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a4011990 con 0x7f63b406c790 2023-08-25T04:18:37.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63aaffd640 1 -- 172.21.15.55:0/530670583 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4011d80 con 0x7f63b406c790 2023-08-25T04:18:37.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63bc419640 1 -- 172.21.15.55:0/530670583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b40c4e60 con 0x7f63b406c790 2023-08-25T04:18:37.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63bc419640 1 -- 172.21.15.55:0/530670583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b40cfbc0 con 0x7f63b406c790 2023-08-25T04:18:37.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.962+0000 7f63bc419640 1 -- 172.21.15.55:0/530670583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b40c5620 con 0x7f63b406c790 2023-08-25T04:18:37.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.966+0000 7f63aaffd640 1 -- 172.21.15.55:0/530670583 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 30) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f63a401a400 con 0x7f63b406c790 2023-08-25T04:18:37.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.966+0000 7f63aaffd640 1 --2- 172.21.15.55:0/530670583 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f63980657a0 0x7f6398067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:37.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.966+0000 7f63aaffd640 1 -- 172.21.15.55:0/530670583 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f63a4082d10 con 0x7f63b406c790 2023-08-25T04:18:37.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.966+0000 7f63ba1b5640 1 --2- 172.21.15.55:0/530670583 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f63980657a0 0x7f6398067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:37.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.966+0000 7f63ba1b5640 1 --2- 172.21.15.55:0/530670583 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f63980657a0 0x7f6398067c60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f63b0007fd0 tx=0x7f63b0009040 comp rx=0 tx=0).ready entity=mgr.5720 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:37.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:37.970+0000 7f63aaffd640 1 -- 172.21.15.55:0/530670583 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f63a4050750 con 0x7f63b406c790 2023-08-25T04:18:38.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.170+0000 7f63bc419640 1 -- 172.21.15.55:0/530670583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f63b4073ec0 con 0x7f63b406c790 2023-08-25T04:18:38.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.682+0000 7f63aaffd640 1 -- 172.21.15.55:0/530670583 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 31) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f63a4089080 con 0x7f63b406c790 2023-08-25T04:18:38.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.682+0000 7f63aaffd640 1 -- 172.21.15.55:0/530670583 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v31) v1 ==== 92+0+0 (secure 0 0 0) 0x7f63a40541e0 con 0x7f63b406c790 2023-08-25T04:18:38.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.686+0000 7f63bc419640 1 -- 172.21.15.55:0/530670583 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f63980657a0 msgr2=0x7f6398067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:38.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.686+0000 7f63bc419640 1 --2- 172.21.15.55:0/530670583 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f63980657a0 0x7f6398067c60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f63b0007fd0 tx=0x7f63b0009040 comp rx=0 tx=0).stop 2023-08-25T04:18:38.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.686+0000 7f63bc419640 1 -- 172.21.15.55:0/530670583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63b406c790 msgr2=0x7f63b40c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:38.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.686+0000 7f63bc419640 1 --2- 172.21.15.55:0/530670583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63b406c790 0x7f63b40c5940 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f63a400b3e0 tx=0x7f63a400b8a0 comp rx=0 tx=0).stop 2023-08-25T04:18:38.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.686+0000 7f63bc419640 1 -- 172.21.15.55:0/530670583 shutdown_connections 2023-08-25T04:18:38.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.686+0000 7f63bc419640 1 --2- 172.21.15.55:0/530670583 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f63980657a0 0x7f6398067c60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:38.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.686+0000 7f63bc419640 1 --2- 172.21.15.55:0/530670583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63b406e5a0 0x7f63b40c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:38.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.686+0000 7f63bc419640 1 --2- 172.21.15.55:0/530670583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f63b406c790 0x7f63b40c5940 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:38.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.686+0000 7f63bc419640 1 --2- 172.21.15.55:0/530670583 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63b406c3b0 0x7f63b41557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:38.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.686+0000 7f63bc419640 1 -- 172.21.15.55:0/530670583 >> 172.21.15.55:0/530670583 conn(0x7f63b40d0540 msgr2=0x7f63b40ccb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:38.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.686+0000 7f63bc419640 1 -- 172.21.15.55:0/530670583 shutdown_connections 2023-08-25T04:18:38.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.686+0000 7f63bc419640 1 -- 172.21.15.55:0/530670583 wait complete. 2023-08-25T04:18:38.709 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-25T04:18:38.849 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:38.845+0000 7f96418be180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:18:38.865 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:38.866+0000 7f2da76d2180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:18:38.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.866+0000 7f0df7303640 1 Processor -- start 2023-08-25T04:18:38.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.866+0000 7f0df7303640 1 -- start start 2023-08-25T04:18:38.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.866+0000 7f0df7303640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0df01601f0 0x7f0df015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:38.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.866+0000 7f0df7303640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df015e3c0 0x7f0df00d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:38.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.866+0000 7f0df7303640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df015f8b0 con 0x7f0df00d10c0 2023-08-25T04:18:38.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.866+0000 7f0df7303640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df00cd5a0 con 0x7f0df01601f0 2023-08-25T04:18:38.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.866+0000 7f0df7303640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00cd880 con 0x7f0df015e3c0 2023-08-25T04:18:38.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.870+0000 7f0df509f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0df01601f0 0x7f0df015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:38.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.870+0000 7f0df489e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df015e3c0 0x7f0df00d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:38.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.870+0000 7f0df509f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0df01601f0 0x7f0df015d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45452/0 (socket says 172.21.15.55:45452) 2023-08-25T04:18:38.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.870+0000 7f0df509f640 1 -- 172.21.15.55:0/697725203 learned_addr learned my addr 172.21.15.55:0/697725203 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:38.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.870+0000 7f0df58a0640 1 --1- 172.21.15.55:0/697725203 >> v1:172.21.15.110:6789/0 conn(0x7f0df00d10c0 0x7f0df00b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:36722/0 (socket says 172.21.15.55:36722) 2023-08-25T04:18:38.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.870+0000 7f0df509f640 1 -- 172.21.15.55:0/697725203 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df015e3c0 msgr2=0x7f0df00d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:38.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.870+0000 7f0df509f640 1 --2- 172.21.15.55:0/697725203 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df015e3c0 0x7f0df00d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:38.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.870+0000 7f0df509f640 1 -- 172.21.15.55:0/697725203 >> v1:172.21.15.110:6789/0 conn(0x7f0df00d10c0 legacy=0x7f0df00b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:38.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.870+0000 7f0df509f640 1 -- 172.21.15.55:0/697725203 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df00cdb60 con 0x7f0df01601f0 2023-08-25T04:18:38.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.870+0000 7f0df509f640 1 --2- 172.21.15.55:0/697725203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0df01601f0 0x7f0df015d430 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f0dec006fd0 tx=0x7f0dec01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04348666182231f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:38.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.870+0000 7f0de7fff640 1 -- 172.21.15.55:0/697725203 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec0a8a10 con 0x7f0df01601f0 2023-08-25T04:18:38.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.870+0000 7f0de7fff640 1 -- 172.21.15.55:0/697725203 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec0a8b70 con 0x7f0df01601f0 2023-08-25T04:18:38.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.870+0000 7f0de7fff640 1 -- 172.21.15.55:0/697725203 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec0b0440 con 0x7f0df01601f0 2023-08-25T04:18:38.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df7303640 1 -- 172.21.15.55:0/697725203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0df01601f0 msgr2=0x7f0df015d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:38.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df7303640 1 --2- 172.21.15.55:0/697725203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0df01601f0 0x7f0df015d430 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f0dec006fd0 tx=0x7f0dec01ed10 comp rx=0 tx=0).stop 2023-08-25T04:18:38.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df7303640 1 -- 172.21.15.55:0/697725203 shutdown_connections 2023-08-25T04:18:38.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df7303640 1 --2- 172.21.15.55:0/697725203 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df015e3c0 0x7f0df00d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:38.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df7303640 1 --2- 172.21.15.55:0/697725203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0df01601f0 0x7f0df015d430 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:38.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df7303640 1 -- 172.21.15.55:0/697725203 >> 172.21.15.55:0/697725203 conn(0x7f0df00d27d0 msgr2=0x7f0df00d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:38.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df7303640 1 -- 172.21.15.55:0/697725203 shutdown_connections 2023-08-25T04:18:38.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df7303640 1 -- 172.21.15.55:0/697725203 wait complete. 2023-08-25T04:18:38.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df7303640 1 Processor -- start 2023-08-25T04:18:38.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df7303640 1 -- start start 2023-08-25T04:18:38.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df7303640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df00d10c0 0x7f0df0152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:38.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df7303640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0df015e3c0 0x7f0df009c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df7303640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df01601f0 0x7f0df009f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df7303640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df0153210 con 0x7f0df015e3c0 2023-08-25T04:18:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df7303640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df009e890 con 0x7f0df00d10c0 2023-08-25T04:18:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df7303640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df009eac0 con 0x7f0df01601f0 2023-08-25T04:18:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df489e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0df015e3c0 0x7f0df009c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:38.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df489e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0df015e3c0 0x7f0df009c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45464/0 (socket says 172.21.15.55:45464) 2023-08-25T04:18:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df509f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df00d10c0 0x7f0df0152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df489e640 1 -- 172.21.15.55:0/2754744859 learned_addr learned my addr 172.21.15.55:0/2754744859 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df58a0640 1 --2- 172.21.15.55:0/2754744859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df01601f0 0x7f0df009f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df489e640 1 -- 172.21.15.55:0/2754744859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df01601f0 msgr2=0x7f0df009f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df489e640 1 --2- 172.21.15.55:0/2754744859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df01601f0 0x7f0df009f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df489e640 1 -- 172.21.15.55:0/2754744859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df00d10c0 msgr2=0x7f0df0152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:38.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df489e640 1 --2- 172.21.15.55:0/2754744859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df00d10c0 0x7f0df0152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df489e640 1 -- 172.21.15.55:0/2754744859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dec009480 con 0x7f0df015e3c0 2023-08-25T04:18:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.874+0000 7f0df58a0640 1 --2- 172.21.15.55:0/2754744859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df01601f0 0x7f0df009f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.878+0000 7f0df489e640 1 --2- 172.21.15.55:0/2754744859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0df015e3c0 0x7f0df009c9f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f0de000e930 tx=0x7f0de000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.878+0000 7f0de5ffb640 1 -- 172.21.15.55:0/2754744859 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de0009690 con 0x7f0df015e3c0 2023-08-25T04:18:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.878+0000 7f0de5ffb640 1 -- 172.21.15.55:0/2754744859 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de000ca00 con 0x7f0df015e3c0 2023-08-25T04:18:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.878+0000 7f0df7303640 1 -- 172.21.15.55:0/2754744859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df009eda0 con 0x7f0df015e3c0 2023-08-25T04:18:38.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.878+0000 7f0de5ffb640 1 -- 172.21.15.55:0/2754744859 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de000cd70 con 0x7f0df015e3c0 2023-08-25T04:18:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.878+0000 7f0df7303640 1 -- 172.21.15.55:0/2754744859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df009f360 con 0x7f0df015e3c0 2023-08-25T04:18:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.878+0000 7f0df7303640 1 -- 172.21.15.55:0/2754744859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df00b5260 con 0x7f0df015e3c0 2023-08-25T04:18:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.878+0000 7f0de5ffb640 1 -- 172.21.15.55:0/2754744859 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 31) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f0de0013470 con 0x7f0df015e3c0 2023-08-25T04:18:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.878+0000 7f0de5ffb640 1 --2- 172.21.15.55:0/2754744859 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f0dd40657f0 0x7f0dd4067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.878+0000 7f0de5ffb640 1 -- 172.21.15.55:0/2754744859 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0de0083120 con 0x7f0df015e3c0 2023-08-25T04:18:38.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.878+0000 7f0df509f640 1 -- 172.21.15.55:0/2754744859 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f0dd40657f0 msgr2=0x7f0dd4067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2283645732 2023-08-25T04:18:38.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.878+0000 7f0df509f640 1 --2- 172.21.15.55:0/2754744859 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f0dd40657f0 0x7f0dd4067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:38.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:38.882+0000 7f0de5ffb640 1 -- 172.21.15.55:0/2754744859 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0de0050c40 con 0x7f0df015e3c0 2023-08-25T04:18:39.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.042+0000 7f0df7303640 1 -- 172.21.15.55:0/2754744859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f0df0073ec0 con 0x7f0df015e3c0 2023-08-25T04:18:39.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.050+0000 7f0de5ffb640 1 -- 172.21.15.55:0/2754744859 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0de0054260 con 0x7f0df015e3c0 2023-08-25T04:18:39.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.054+0000 7f0df7303640 1 -- 172.21.15.55:0/2754744859 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f0dd40657f0 msgr2=0x7f0dd4067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:39.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.054+0000 7f0df7303640 1 --2- 172.21.15.55:0/2754744859 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f0dd40657f0 0x7f0dd4067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.054+0000 7f0df7303640 1 -- 172.21.15.55:0/2754744859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0df015e3c0 msgr2=0x7f0df009c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:39.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.054+0000 7f0df7303640 1 --2- 172.21.15.55:0/2754744859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0df015e3c0 0x7f0df009c9f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f0de000e930 tx=0x7f0de000edf0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.054+0000 7f0df7303640 1 -- 172.21.15.55:0/2754744859 shutdown_connections 2023-08-25T04:18:39.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.054+0000 7f0df7303640 1 --2- 172.21.15.55:0/2754744859 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f0dd40657f0 0x7f0dd4067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.054+0000 7f0df7303640 1 --2- 172.21.15.55:0/2754744859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0df01601f0 0x7f0df009f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.054+0000 7f0df7303640 1 --2- 172.21.15.55:0/2754744859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0df015e3c0 0x7f0df009c9f0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.054+0000 7f0df7303640 1 --2- 172.21.15.55:0/2754744859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0df00d10c0 0x7f0df0152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.054+0000 7f0df7303640 1 -- 172.21.15.55:0/2754744859 >> 172.21.15.55:0/2754744859 conn(0x7f0df00d27d0 msgr2=0x7f0df00b7400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:39.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.054+0000 7f0df7303640 1 -- 172.21.15.55:0/2754744859 shutdown_connections 2023-08-25T04:18:39.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.054+0000 7f0df7303640 1 -- 172.21.15.55:0/2754744859 wait complete. 2023-08-25T04:18:39.074 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-08-25T04:18:39.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.222+0000 7fafd3248640 1 Processor -- start 2023-08-25T04:18:39.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.222+0000 7fafd3248640 1 -- start start 2023-08-25T04:18:39.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.226+0000 7fafd3248640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fafcc15e3c0 0x7fafcc15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:39.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.226+0000 7fafd3248640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafcc0d1290 0x7fafcc15e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:39.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.226+0000 7fafd3248640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafcc0cd5a0 con 0x7fafcc1601f0 2023-08-25T04:18:39.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.226+0000 7fafd3248640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafcc0cd880 con 0x7fafcc15e3c0 2023-08-25T04:18:39.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.226+0000 7fafd3248640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc0cdb60 con 0x7fafcc0d1290 2023-08-25T04:18:39.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.226+0000 7fafcbfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fafcc15e3c0 0x7fafcc15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:39.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.226+0000 7fafcbfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fafcc15e3c0 0x7fafcc15d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:42614/0 (socket says 172.21.15.55:42614) 2023-08-25T04:18:39.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.226+0000 7fafcbfff640 1 -- 172.21.15.55:0/4010704820 learned_addr learned my addr 172.21.15.55:0/4010704820 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:39.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.226+0000 7fafd17e5640 1 --2- 172.21.15.55:0/4010704820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafcc0d1290 0x7fafcc15e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:39.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.226+0000 7fafcbfff640 1 -- 172.21.15.55:0/4010704820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafcc0d1290 msgr2=0x7fafcc15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:39.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.226+0000 7fafcbfff640 1 --2- 172.21.15.55:0/4010704820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafcc0d1290 0x7fafcc15e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.226+0000 7fafcbfff640 1 -- 172.21.15.55:0/4010704820 >> v1:172.21.15.110:6789/0 conn(0x7fafcc1601f0 legacy=0x7fafcc0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:39.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.226+0000 7fafcbfff640 1 -- 172.21.15.55:0/4010704820 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc0cde40 con 0x7fafcc15e3c0 2023-08-25T04:18:39.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.230+0000 7fafcbfff640 1 --2- 172.21.15.55:0/4010704820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafcc15e3c0 0x7fafcc15d430 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009870 tx=0x7fafb801ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d42b545d80d00f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:39.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.230+0000 7fafcb7fe640 1 -- 172.21.15.55:0/4010704820 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb80a8a30 con 0x7fafcc15e3c0 2023-08-25T04:18:39.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.230+0000 7fafcb7fe640 1 -- 172.21.15.55:0/4010704820 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb80a8b90 con 0x7fafcc15e3c0 2023-08-25T04:18:39.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.230+0000 7fafcb7fe640 1 -- 172.21.15.55:0/4010704820 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb80b0440 con 0x7fafcc15e3c0 2023-08-25T04:18:39.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.230+0000 7fafd3248640 1 -- 172.21.15.55:0/4010704820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafcc15e3c0 msgr2=0x7fafcc15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:39.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.230+0000 7fafd3248640 1 --2- 172.21.15.55:0/4010704820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafcc15e3c0 0x7fafcc15d430 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009870 tx=0x7fafb801ed30 comp rx=0 tx=0).stop 2023-08-25T04:18:39.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.230+0000 7fafd3248640 1 -- 172.21.15.55:0/4010704820 shutdown_connections 2023-08-25T04:18:39.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.230+0000 7fafd3248640 1 --2- 172.21.15.55:0/4010704820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafcc0d1290 0x7fafcc15e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.230+0000 7fafd3248640 1 --2- 172.21.15.55:0/4010704820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafcc15e3c0 0x7fafcc15d430 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.230+0000 7fafd3248640 1 -- 172.21.15.55:0/4010704820 >> 172.21.15.55:0/4010704820 conn(0x7fafcc0d27d0 msgr2=0x7fafcc0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:39.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.230+0000 7fafd3248640 1 -- 172.21.15.55:0/4010704820 shutdown_connections 2023-08-25T04:18:39.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.230+0000 7fafd3248640 1 -- 172.21.15.55:0/4010704820 wait complete. 2023-08-25T04:18:39.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.230+0000 7fafd3248640 1 Processor -- start 2023-08-25T04:18:39.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.230+0000 7fafd3248640 1 -- start start 2023-08-25T04:18:39.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd3248640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafcc0d1290 0x7fafcc15b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:39.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd3248640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafcc15e3c0 0x7fafcc0c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:39.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd3248640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafcc1601f0 0x7fafcc158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:39.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd3248640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc15bab0 con 0x7fafcc15e3c0 2023-08-25T04:18:39.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd3248640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc15a510 con 0x7fafcc0d1290 2023-08-25T04:18:39.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd3248640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc15a7b0 con 0x7fafcc1601f0 2023-08-25T04:18:39.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd0fe4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafcc0d1290 0x7fafcc15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:39.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafcbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafcc15e3c0 0x7fafcc0c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:39.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd0fe4640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafcc0d1290 0x7fafcc15b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:42624/0 (socket says 172.21.15.55:42624) 2023-08-25T04:18:39.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd0fe4640 1 -- 172.21.15.55:0/76370670 learned_addr learned my addr 172.21.15.55:0/76370670 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:39.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd17e5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafcc1601f0 0x7fafcc158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:39.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd0fe4640 1 -- 172.21.15.55:0/76370670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafcc1601f0 msgr2=0x7fafcc158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:39.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd0fe4640 1 --2- 172.21.15.55:0/76370670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafcc1601f0 0x7fafcc158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd0fe4640 1 -- 172.21.15.55:0/76370670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafcc15e3c0 msgr2=0x7fafcc0c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:39.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd0fe4640 1 --2- 172.21.15.55:0/76370670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafcc15e3c0 0x7fafcc0c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd0fe4640 1 -- 172.21.15.55:0/76370670 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb80094d0 con 0x7fafcc0d1290 2023-08-25T04:18:39.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd0fe4640 1 --2- 172.21.15.55:0/76370670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafcc0d1290 0x7fafcc15b570 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fafc000c3c0 tx=0x7fafc000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:39.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafc97fa640 1 -- 172.21.15.55:0/76370670 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc00052d0 con 0x7fafcc0d1290 2023-08-25T04:18:39.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafc97fa640 1 -- 172.21.15.55:0/76370670 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc0005470 con 0x7fafcc0d1290 2023-08-25T04:18:39.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd3248640 1 -- 172.21.15.55:0/76370670 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc15aa90 con 0x7fafcc0d1290 2023-08-25T04:18:39.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafc97fa640 1 -- 172.21.15.55:0/76370670 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc0006a70 con 0x7fafcc0d1290 2023-08-25T04:18:39.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd3248640 1 -- 172.21.15.55:0/76370670 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafcc15b050 con 0x7fafcc0d1290 2023-08-25T04:18:39.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafd3248640 1 -- 172.21.15.55:0/76370670 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafcc0b5260 con 0x7fafcc0d1290 2023-08-25T04:18:39.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.234+0000 7fafc97fa640 1 -- 172.21.15.55:0/76370670 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 31) v1 ==== 85081+0+0 (secure 0 0 0) 0x7fafc0006bd0 con 0x7fafcc0d1290 2023-08-25T04:18:39.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.238+0000 7fafc97fa640 1 --2- 172.21.15.55:0/76370670 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fafb00657f0 0x7fafb0067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:39.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.238+0000 7fafc97fa640 1 -- 172.21.15.55:0/76370670 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fafc0082380 con 0x7fafcc0d1290 2023-08-25T04:18:39.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.238+0000 7fafcbfff640 1 -- 172.21.15.55:0/76370670 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fafb00657f0 msgr2=0x7fafb0067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2283645732 2023-08-25T04:18:39.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.238+0000 7fafcbfff640 1 --2- 172.21.15.55:0/76370670 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fafb00657f0 0x7fafb0067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:39.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.246+0000 7fafc97fa640 1 -- 172.21.15.55:0/76370670 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fafc004fd40 con 0x7fafcc0d1290 2023-08-25T04:18:39.274 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:39.265+0000 7f96418be180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:18:39.318 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:39.318+0000 7f2da76d2180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:18:39.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.406+0000 7fafd3248640 1 -- 172.21.15.55:0/76370670 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fafcc0cefc0 con 0x7fafcc0d1290 2023-08-25T04:18:39.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.410+0000 7fafc97fa640 1 -- 172.21.15.55:0/76370670 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7fafc0053360 con 0x7fafcc0d1290 2023-08-25T04:18:39.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.414+0000 7fafd3248640 1 -- 172.21.15.55:0/76370670 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fafb00657f0 msgr2=0x7fafb0067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:39.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.414+0000 7fafd3248640 1 --2- 172.21.15.55:0/76370670 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fafb00657f0 0x7fafb0067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.414+0000 7fafd3248640 1 -- 172.21.15.55:0/76370670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafcc0d1290 msgr2=0x7fafcc15b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:39.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.414+0000 7fafd3248640 1 --2- 172.21.15.55:0/76370670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafcc0d1290 0x7fafcc15b570 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fafc000c3c0 tx=0x7fafc000c880 comp rx=0 tx=0).stop 2023-08-25T04:18:39.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.414+0000 7fafd3248640 1 -- 172.21.15.55:0/76370670 shutdown_connections 2023-08-25T04:18:39.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.414+0000 7fafd3248640 1 --2- 172.21.15.55:0/76370670 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7fafb00657f0 0x7fafb0067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.414+0000 7fafd3248640 1 --2- 172.21.15.55:0/76370670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafcc1601f0 0x7fafcc158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.414+0000 7fafd3248640 1 --2- 172.21.15.55:0/76370670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafcc15e3c0 0x7fafcc0c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.414+0000 7fafd3248640 1 --2- 172.21.15.55:0/76370670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafcc0d1290 0x7fafcc15b570 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.414+0000 7fafd3248640 1 -- 172.21.15.55:0/76370670 >> 172.21.15.55:0/76370670 conn(0x7fafcc0d27d0 msgr2=0x7fafcc0cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:39.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.414+0000 7fafd3248640 1 -- 172.21.15.55:0/76370670 shutdown_connections 2023-08-25T04:18:39.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.414+0000 7fafd3248640 1 -- 172.21.15.55:0/76370670 wait complete. 2023-08-25T04:18:39.421 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:39.417+0000 7f96418be180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:18:39.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:39.434 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-25T04:18:39.452 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-08-25T04:18:39.480 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:39.482+0000 7f2da76d2180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:18:39.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.630+0000 7f9e57688640 1 Processor -- start 2023-08-25T04:18:39.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.630+0000 7f9e57688640 1 -- start start 2023-08-25T04:18:39.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.634+0000 7f9e57688640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9e500cf7b0 0x7f9e500b6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:39.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.634+0000 7f9e57688640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e500d1970 con 0x7f9e500cf340 2023-08-25T04:18:39.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.634+0000 7f9e57688640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e500d2790 con 0x7f9e5015cb40 2023-08-25T04:18:39.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.634+0000 7f9e57688640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e500d0d80 con 0x7f9e500cf7b0 2023-08-25T04:18:39.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.634+0000 7f9e54c23640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9e500cf340 0x7f9e500b59f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44560/0 (socket says 172.21.15.55:44560) 2023-08-25T04:18:39.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.634+0000 7f9e54c23640 1 -- 172.21.15.55:0/1204127872 learned_addr learned my addr 172.21.15.55:0/1204127872 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:39.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.634+0000 7f9e55c25640 1 --2- 172.21.15.55:0/1204127872 >> v2:172.21.15.110:3300/0 conn(0x7f9e500cf7b0 0x7f9e500b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:39.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.634+0000 7f9e47fff640 1 -- 172.21.15.55:0/1204127872 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587903721 0 0) 0x7f9e500d1970 con 0x7f9e500cf340 2023-08-25T04:18:39.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.634+0000 7f9e47fff640 1 -- 172.21.15.55:0/1204127872 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e3c003530 con 0x7f9e500cf340 2023-08-25T04:18:39.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.634+0000 7f9e55c25640 1 -- 172.21.15.55:0/1204127872 >> v1:172.21.15.110:6789/0 conn(0x7f9e5015cb40 legacy=0x7f9e500d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:39.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.634+0000 7f9e55c25640 1 -- 172.21.15.55:0/1204127872 >> v1:172.21.15.55:6789/0 conn(0x7f9e500cf340 legacy=0x7f9e500b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:39.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.634+0000 7f9e55c25640 1 -- 172.21.15.55:0/1204127872 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e500d1040 con 0x7f9e500cf7b0 2023-08-25T04:18:39.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.638+0000 7f9e55c25640 1 --2- 172.21.15.55:0/1204127872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e500cf7b0 0x7f9e500b6100 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9e48009d90 tx=0x7f9e4801f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b9f66064d4a986e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:39.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.638+0000 7f9e47fff640 1 -- 172.21.15.55:0/1204127872 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e480af600 con 0x7f9e500cf7b0 2023-08-25T04:18:39.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.638+0000 7f9e47fff640 1 -- 172.21.15.55:0/1204127872 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e480ab050 con 0x7f9e500cf7b0 2023-08-25T04:18:39.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.638+0000 7f9e47fff640 1 -- 172.21.15.55:0/1204127872 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e480af960 con 0x7f9e500cf7b0 2023-08-25T04:18:39.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.638+0000 7f9e57688640 1 -- 172.21.15.55:0/1204127872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e500cf7b0 msgr2=0x7f9e500b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:39.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.638+0000 7f9e57688640 1 --2- 172.21.15.55:0/1204127872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e500cf7b0 0x7f9e500b6100 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9e48009d90 tx=0x7f9e4801f130 comp rx=0 tx=0).stop 2023-08-25T04:18:39.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.638+0000 7f9e57688640 1 -- 172.21.15.55:0/1204127872 shutdown_connections 2023-08-25T04:18:39.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.638+0000 7f9e57688640 1 --2- 172.21.15.55:0/1204127872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e500cf7b0 0x7f9e500b6100 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.638+0000 7f9e57688640 1 -- 172.21.15.55:0/1204127872 >> 172.21.15.55:0/1204127872 conn(0x7f9e5006aae0 msgr2=0x7f9e5006aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:39.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.638+0000 7f9e57688640 1 -- 172.21.15.55:0/1204127872 shutdown_connections 2023-08-25T04:18:39.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.638+0000 7f9e57688640 1 -- 172.21.15.55:0/1204127872 wait complete. 2023-08-25T04:18:39.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.638+0000 7f9e57688640 1 Processor -- start 2023-08-25T04:18:39.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.638+0000 7f9e57688640 1 -- start start 2023-08-25T04:18:39.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e57688640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e500cf340 0x7f9e500b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:39.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e57688640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e500cf7b0 0x7f9e5015f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:39.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e57688640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e5015cb40 0x7f9e50154c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:39.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e57688640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e500b76d0 con 0x7f9e500cf340 2023-08-25T04:18:39.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e57688640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e500b6b50 con 0x7f9e5015cb40 2023-08-25T04:18:39.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e57688640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e500b6e30 con 0x7f9e500cf7b0 2023-08-25T04:18:39.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e55424640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e500cf340 0x7f9e500b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:39.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e55424640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e500cf340 0x7f9e500b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45470/0 (socket says 172.21.15.55:45470) 2023-08-25T04:18:39.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e55424640 1 -- 172.21.15.55:0/2379637842 learned_addr learned my addr 172.21.15.55:0/2379637842 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:39.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e55c25640 1 --2- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e5015cb40 0x7f9e50154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:39.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e54c23640 1 --2- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e500cf7b0 0x7f9e5015f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:39.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e55424640 1 -- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e500cf7b0 msgr2=0x7f9e5015f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:39.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e55424640 1 --2- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e500cf7b0 0x7f9e5015f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e55424640 1 -- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e5015cb40 msgr2=0x7f9e50154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e55424640 1 --2- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e5015cb40 0x7f9e50154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e55424640 1 -- 172.21.15.55:0/2379637842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e48009a70 con 0x7f9e500cf340 2023-08-25T04:18:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e55424640 1 --2- 172.21.15.55:0/2379637842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e500cf340 0x7f9e500b48c0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c00c420 tx=0x7f9e4c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:39.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e45ffb640 1 -- 172.21.15.55:0/2379637842 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c0052d0 con 0x7f9e500cf340 2023-08-25T04:18:39.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e45ffb640 1 -- 172.21.15.55:0/2379637842 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c005430 con 0x7f9e500cf340 2023-08-25T04:18:39.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e57688640 1 -- 172.21.15.55:0/2379637842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e500b7110 con 0x7f9e500cf340 2023-08-25T04:18:39.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e45ffb640 1 -- 172.21.15.55:0/2379637842 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c007260 con 0x7f9e500cf340 2023-08-25T04:18:39.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e57688640 1 -- 172.21.15.55:0/2379637842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e500b8120 con 0x7f9e500cf340 2023-08-25T04:18:39.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e57688640 1 -- 172.21.15.55:0/2379637842 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e50071f80 con 0x7f9e500cf340 2023-08-25T04:18:39.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.642+0000 7f9e45ffb640 1 -- 172.21.15.55:0/2379637842 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 31) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f9e4c0073c0 con 0x7f9e500cf340 2023-08-25T04:18:39.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.646+0000 7f9e45ffb640 1 --2- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f9e34065820 0x7f9e34067ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:39.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.646+0000 7f9e45ffb640 1 -- 172.21.15.55:0/2379637842 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9e4c0823e0 con 0x7f9e500cf340 2023-08-25T04:18:39.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.646+0000 7f9e54c23640 1 -- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f9e34065820 msgr2=0x7f9e34067ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2283645732 2023-08-25T04:18:39.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.646+0000 7f9e54c23640 1 --2- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f9e34065820 0x7f9e34067ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:39.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.650+0000 7f9e45ffb640 1 -- 172.21.15.55:0/2379637842 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9e4c04fd30 con 0x7f9e500cf340 2023-08-25T04:18:39.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.826+0000 7f9e57688640 1 -- 172.21.15.55:0/2379637842 --> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e500d1600 con 0x7f9e34065820 2023-08-25T04:18:39.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.850+0000 7f9e54c23640 1 -- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f9e34065820 msgr2=0x7f9e34067ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2283645732 2023-08-25T04:18:39.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:39.850+0000 7f9e54c23640 1 --2- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f9e34065820 0x7f9e34067ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-25T04:18:39.904 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:39.901+0000 7f96418be180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:18:39.963 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:39.961+0000 7f96418be180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:18:40.002 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:40.002+0000 7f2da76d2180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:18:40.021 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:40.017+0000 7f96418be180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:18:40.065 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:40.066+0000 7f2da76d2180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:18:40.105 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:40.105+0000 7f96418be180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:18:40.124 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:40.126+0000 7f2da76d2180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:18:40.164 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:40.161+0000 7f96418be180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:18:40.215 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:40.214+0000 7f2da76d2180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:18:40.248 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:40.245+0000 7f96418be180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:18:40.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:40.254+0000 7f9e54c23640 1 -- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f9e34065820 msgr2=0x7f9e34067ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2283645732 2023-08-25T04:18:40.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:40.254+0000 7f9e54c23640 1 --2- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f9e34065820 0x7f9e34067ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-25T04:18:40.275 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:40.278+0000 7f2da76d2180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:18:40.303 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:40.301+0000 7f96418be180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:18:40.365 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:40.366+0000 7f2da76d2180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:18:40.424 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:40.426+0000 7f2da76d2180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:18:40.445 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:40.445+0000 7f96418be180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:18:40.503 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:40.501+0000 7f96418be180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:18:40.576 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:40.578+0000 7f2da76d2180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:18:40.640 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:40.642+0000 7f2da76d2180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:18:40.743 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:18:40.744 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:18:40.744 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:18:40.752 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:40.749+0000 7f96418be180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:18:40.886 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:40.885+0000 7f96418be180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:18:40.892 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:18:40.892 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:18:40.892 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:18:40.902 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:40.902+0000 7f2da76d2180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:18:41.013 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:41.013+0000 7f96418be180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:18:41.046 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:41.046+0000 7f2da76d2180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:18:41.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:41.058+0000 7f9e54c23640 1 -- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f9e34065820 msgr2=0x7f9e34067ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2283645732 2023-08-25T04:18:41.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:41.058+0000 7f9e54c23640 1 --2- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f9e34065820 0x7f9e34067ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-25T04:18:41.083 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:41.081+0000 7f96418be180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:18:41.179 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:41.178+0000 7f2da76d2180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:18:41.218 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:41.217+0000 7f96418be180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:18:41.254 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:41.254+0000 7f2da76d2180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:18:41.398 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:41.398+0000 7f2da76d2180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:18:41.756 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:41.753+0000 7f96418be180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:18:41.839 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:41.837+0000 7f96418be180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:18:41.975 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:41.978+0000 7f2da76d2180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:18:41.986 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:41.985+0000 7f96418be180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:18:42.065 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:42.066+0000 7f2da76d2180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:18:42.069 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:42.069+0000 7f96418be180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:18:42.222 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:42.222+0000 7f2da76d2180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:18:42.311 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:42.310+0000 7f2da76d2180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:18:42.383 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:42.381+0000 7f96418be180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:18:42.442 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:42.441+0000 7f96418be180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:18:42.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:42.458+0000 7f9e45ffb640 1 -- 172.21.15.55:0/2379637842 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 32) v1 ==== 84690+0+0 (secure 0 0 0) 0x7f9e4c0807a0 con 0x7f9e500cf340 2023-08-25T04:18:42.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:42.458+0000 7f9e45ffb640 1 -- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f9e34065820 msgr2=0x7f9e34067ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:42.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:42.458+0000 7f9e45ffb640 1 --2- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:6832/2283645732,v1:172.21.15.110:6833/2283645732] conn(0x7f9e34065820 0x7f9e34067ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:42.575 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:42.573+0000 7f95c3ede640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:42.575 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:42.573+0000 7f95c3ede640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:42.576 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:42.573+0000 7f95c3ede640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:42.576 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:42.573+0000 7f95c3ede640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:42.576 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:42.573+0000 7f95c3ede640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:42.576 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:42.573+0000 7f95c76e5640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:42.577 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:42.573+0000 7f95c76e5640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:42.577 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:42.573+0000 7f95c76e5640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:42.577 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:42.573+0000 7f95c76e5640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:42.577 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:42.573+0000 7f95c76e5640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:42.659 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:42.658+0000 7f2da76d2180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:18:42.722 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:42.722+0000 7f2da76d2180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:18:43.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.462+0000 7f9e45ffb640 1 -- 172.21.15.55:0/2379637842 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 33) v1 ==== 84817+0+0 (secure 0 0 0) 0x7f9e4c050100 con 0x7f9e500cf340 2023-08-25T04:18:43.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.462+0000 7f9e45ffb640 1 --2- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f9e34033740 0x7f9e3406fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:43.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.462+0000 7f9e45ffb640 1 -- 172.21.15.55:0/2379637842 --> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e34033b20 con 0x7f9e34033740 2023-08-25T04:18:43.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.462+0000 7f9e54c23640 1 --2- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f9e34033740 0x7f9e3406fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:43.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.466+0000 7f9e54c23640 1 --2- 172.21.15.55:0/2379637842 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f9e34033740 0x7f9e3406fd00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9e40007ad0 tx=0x7f9e40007a40 comp rx=0 tx=0).ready entity=mgr.6553 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:43.480 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:43.477+0000 7f95ce6f3640 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-08-25T04:18:43.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.482+0000 7f9e45ffb640 1 -- 172.21.15.55:0/2379637842 <== mgr.6553 v2:172.21.15.110:6832/3289898378 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f9e34033b20 con 0x7f9e34033740 2023-08-25T04:18:43.481 INFO:teuthology.orchestra.run.smithi055.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-08-25T04:18:43.489 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-08-25T04:18:43.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:43.491 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-25T04:18:43.503 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-25T04:18:43.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.698+0000 7f3521f2c640 1 Processor -- start 2023-08-25T04:18:43.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.698+0000 7f3521f2c640 1 -- start start 2023-08-25T04:18:43.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.698+0000 7f3521f2c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f351c15cba0 0x7f351c0ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:43.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.698+0000 7f3521f2c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f351c0b11c0 0x7f351c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:43.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.698+0000 7f3521f2c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351c06cd40 con 0x7f351c06dab0 2023-08-25T04:18:43.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.698+0000 7f3521f2c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351c06dee0 con 0x7f351c0b11c0 2023-08-25T04:18:43.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.698+0000 7f3521f2c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351c06be90 con 0x7f351c15cba0 2023-08-25T04:18:43.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.698+0000 7f3513fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f351c0b11c0 0x7f351c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:43.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.698+0000 7f3513fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f351c0b11c0 0x7f351c06d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57518/0 (socket says 172.21.15.55:57518) 2023-08-25T04:18:43.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.698+0000 7f3513fff640 1 -- 172.21.15.55:0/2789268617 learned_addr learned my addr 172.21.15.55:0/2789268617 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:43.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.698+0000 7f351b7fe640 1 --2- 172.21.15.55:0/2789268617 >> v2:172.21.15.110:3300/0 conn(0x7f351c15cba0 0x7f351c0ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:43.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.698+0000 7f3513fff640 1 -- 172.21.15.55:0/2789268617 >> v2:172.21.15.110:3300/0 conn(0x7f351c15cba0 msgr2=0x7f351c0ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:43.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.698+0000 7f3513fff640 1 --2- 172.21.15.55:0/2789268617 >> v2:172.21.15.110:3300/0 conn(0x7f351c15cba0 0x7f351c0ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:43.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.698+0000 7f3513fff640 1 -- 172.21.15.55:0/2789268617 >> v1:172.21.15.110:6789/0 conn(0x7f351c06dab0 legacy=0x7f351c1605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:43.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.698+0000 7f3513fff640 1 -- 172.21.15.55:0/2789268617 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351c06c130 con 0x7f351c0b11c0 2023-08-25T04:18:43.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.702+0000 7f3513fff640 1 --2- 172.21.15.55:0/2789268617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f351c0b11c0 0x7f351c06d570 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f351c066e90 tx=0x7f350401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6276e2274c1c570 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:43.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.702+0000 7f351affd640 1 -- 172.21.15.55:0/2789268617 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35040ac640 con 0x7f351c0b11c0 2023-08-25T04:18:43.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.702+0000 7f351affd640 1 -- 172.21.15.55:0/2789268617 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35040ac7a0 con 0x7f351c0b11c0 2023-08-25T04:18:43.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.702+0000 7f351affd640 1 -- 172.21.15.55:0/2789268617 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35040acb30 con 0x7f351c0b11c0 2023-08-25T04:18:43.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.702+0000 7f3521f2c640 1 -- 172.21.15.55:0/2789268617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f351c0b11c0 msgr2=0x7f351c06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:43.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.702+0000 7f3521f2c640 1 --2- 172.21.15.55:0/2789268617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f351c0b11c0 0x7f351c06d570 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f351c066e90 tx=0x7f350401c4c0 comp rx=0 tx=0).stop 2023-08-25T04:18:43.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.702+0000 7f3521f2c640 1 -- 172.21.15.55:0/2789268617 shutdown_connections 2023-08-25T04:18:43.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.702+0000 7f3521f2c640 1 --2- 172.21.15.55:0/2789268617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f351c0b11c0 0x7f351c06d570 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:43.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.702+0000 7f3521f2c640 1 --2- 172.21.15.55:0/2789268617 >> v2:172.21.15.110:3300/0 conn(0x7f351c15cba0 0x7f351c0ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:43.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.702+0000 7f3521f2c640 1 -- 172.21.15.55:0/2789268617 >> 172.21.15.55:0/2789268617 conn(0x7f351c0b06a0 msgr2=0x7f351c0b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:43.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.702+0000 7f3521f2c640 1 -- 172.21.15.55:0/2789268617 shutdown_connections 2023-08-25T04:18:43.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.702+0000 7f3521f2c640 1 -- 172.21.15.55:0/2789268617 wait complete. 2023-08-25T04:18:43.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.702+0000 7f3521f2c640 1 Processor -- start 2023-08-25T04:18:43.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.702+0000 7f3521f2c640 1 -- start start 2023-08-25T04:18:43.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3521f2c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f351c06dab0 0x7f351c1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:43.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3521f2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f351c0b11c0 0x7f351c156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:43.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3521f2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f351c15cba0 0x7f351c157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:43.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3521f2c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c0c7810 con 0x7f351c0b11c0 2023-08-25T04:18:43.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3521f2c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c0c6c00 con 0x7f351c15cba0 2023-08-25T04:18:43.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3521f2c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351c0c6ee0 con 0x7f351c06dab0 2023-08-25T04:18:43.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3513fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f351c0b11c0 0x7f351c156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:43.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3513fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f351c0b11c0 0x7f351c156f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57526/0 (socket says 172.21.15.55:57526) 2023-08-25T04:18:43.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3513fff640 1 -- 172.21.15.55:0/1128651035 learned_addr learned my addr 172.21.15.55:0/1128651035 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:43.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f351b7fe640 1 --2- 172.21.15.55:0/1128651035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f351c06dab0 0x7f351c1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:43.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f351bfff640 1 --2- 172.21.15.55:0/1128651035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f351c15cba0 0x7f351c157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:43.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3513fff640 1 -- 172.21.15.55:0/1128651035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f351c06dab0 msgr2=0x7f351c1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:43.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3513fff640 1 --2- 172.21.15.55:0/1128651035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f351c06dab0 0x7f351c1560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:43.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3513fff640 1 -- 172.21.15.55:0/1128651035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f351c15cba0 msgr2=0x7f351c157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:43.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3513fff640 1 --2- 172.21.15.55:0/1128651035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f351c15cba0 0x7f351c157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:43.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3513fff640 1 -- 172.21.15.55:0/1128651035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35040094d0 con 0x7f351c0b11c0 2023-08-25T04:18:43.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f351b7fe640 1 --2- 172.21.15.55:0/1128651035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f351c06dab0 0x7f351c1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:43.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3513fff640 1 --2- 172.21.15.55:0/1128651035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f351c0b11c0 0x7f351c156f10 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f35040af040 tx=0x7f3504019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:43.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3518ff9640 1 -- 172.21.15.55:0/1128651035 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35040b7670 con 0x7f351c0b11c0 2023-08-25T04:18:43.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3518ff9640 1 -- 172.21.15.55:0/1128651035 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35040b77d0 con 0x7f351c0b11c0 2023-08-25T04:18:43.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3518ff9640 1 -- 172.21.15.55:0/1128651035 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35040b7b60 con 0x7f351c0b11c0 2023-08-25T04:18:43.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3521f2c640 1 -- 172.21.15.55:0/1128651035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351c0c71c0 con 0x7f351c0b11c0 2023-08-25T04:18:43.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3521f2c640 1 -- 172.21.15.55:0/1128651035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351c153820 con 0x7f351c0b11c0 2023-08-25T04:18:43.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3521f2c640 1 -- 172.21.15.55:0/1128651035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351c073ec0 con 0x7f351c0b11c0 2023-08-25T04:18:43.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.706+0000 7f3518ff9640 1 -- 172.21.15.55:0/1128651035 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 33) v1 ==== 84817+0+0 (secure 0 0 0) 0x7f35040b3070 con 0x7f351c0b11c0 2023-08-25T04:18:43.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.710+0000 7f3518ff9640 1 --2- 172.21.15.55:0/1128651035 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f34fc065550 0x7f34fc067a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:43.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.710+0000 7f3518ff9640 1 -- 172.21.15.55:0/1128651035 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f350411d580 con 0x7f351c0b11c0 2023-08-25T04:18:43.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.710+0000 7f351b7fe640 1 --2- 172.21.15.55:0/1128651035 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f34fc065550 0x7f34fc067a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:43.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.710+0000 7f351b7fe640 1 --2- 172.21.15.55:0/1128651035 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f34fc065550 0x7f34fc067a10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f350c00b9f0 tx=0x7f350c008040 comp rx=0 tx=0).ready entity=mgr.6553 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:43.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.714+0000 7f3518ff9640 1 -- 172.21.15.55:0/1128651035 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f35040eb2b0 con 0x7f351c0b11c0 2023-08-25T04:18:43.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:43.906+0000 7f3521f2c640 1 -- 172.21.15.55:0/1128651035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f351c0b4b30 con 0x7f351c0b11c0 2023-08-25T04:18:44.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.510+0000 7f3518ff9640 1 -- 172.21.15.55:0/1128651035 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 34) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f35040eb680 con 0x7f351c0b11c0 2023-08-25T04:18:44.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.510+0000 7f3518ff9640 1 -- 172.21.15.55:0/1128651035 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v34) v1 ==== 93+0+0 (secure 0 0 0) 0x7f35040b4e20 con 0x7f351c0b11c0 2023-08-25T04:18:44.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.514+0000 7f3521f2c640 1 -- 172.21.15.55:0/1128651035 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f34fc065550 msgr2=0x7f34fc067a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:44.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.514+0000 7f3521f2c640 1 --2- 172.21.15.55:0/1128651035 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f34fc065550 0x7f34fc067a10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f350c00b9f0 tx=0x7f350c008040 comp rx=0 tx=0).stop 2023-08-25T04:18:44.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.514+0000 7f3521f2c640 1 -- 172.21.15.55:0/1128651035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f351c0b11c0 msgr2=0x7f351c156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:44.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.514+0000 7f3521f2c640 1 --2- 172.21.15.55:0/1128651035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f351c0b11c0 0x7f351c156f10 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f35040af040 tx=0x7f3504019260 comp rx=0 tx=0).stop 2023-08-25T04:18:44.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.514+0000 7f3521f2c640 1 -- 172.21.15.55:0/1128651035 shutdown_connections 2023-08-25T04:18:44.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.514+0000 7f3521f2c640 1 --2- 172.21.15.55:0/1128651035 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f34fc065550 0x7f34fc067a10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:44.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.514+0000 7f3521f2c640 1 --2- 172.21.15.55:0/1128651035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f351c15cba0 0x7f351c157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:44.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.514+0000 7f3521f2c640 1 --2- 172.21.15.55:0/1128651035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f351c0b11c0 0x7f351c156f10 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:44.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.514+0000 7f3521f2c640 1 --2- 172.21.15.55:0/1128651035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f351c06dab0 0x7f351c1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:44.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.514+0000 7f3521f2c640 1 -- 172.21.15.55:0/1128651035 >> 172.21.15.55:0/1128651035 conn(0x7f351c0b06a0 msgr2=0x7f351c0c92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:44.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.514+0000 7f3521f2c640 1 -- 172.21.15.55:0/1128651035 shutdown_connections 2023-08-25T04:18:44.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.514+0000 7f3521f2c640 1 -- 172.21.15.55:0/1128651035 wait complete. 2023-08-25T04:18:44.538 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T04:18:44.539 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:18:44.599 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:18:44.672 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T04:18:44.672 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:18:44.673 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:44.682 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:18:44.682 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:44.684 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:44.681+0000 7faad17d4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:18:44.694 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:44.694+0000 7fc468c2d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:18:44.704 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:18:44.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.894+0000 7fa57e419640 1 Processor -- start 2023-08-25T04:18:44.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.894+0000 7fa57e419640 1 -- start start 2023-08-25T04:18:44.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.894+0000 7fa57e419640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa5780cdde0 0x7fa5780ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:44.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.894+0000 7fa57e419640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5780b2e40 0x7fa5780b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:44.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.894+0000 7fa57e419640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5780b29b0 con 0x7fa5780d0da0 2023-08-25T04:18:44.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.894+0000 7fa57e419640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5780ce760 con 0x7fa5780b2e40 2023-08-25T04:18:44.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.894+0000 7fa57e419640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5780b1dc0 con 0x7fa5780cdde0 2023-08-25T04:18:44.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.894+0000 7fa57c9b6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5780b2e40 0x7fa5780b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:44.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.894+0000 7fa57c9b6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5780b2e40 0x7fa5780b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57544/0 (socket says 172.21.15.55:57544) 2023-08-25T04:18:44.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.894+0000 7fa57c9b6640 1 -- 172.21.15.55:0/3574117144 learned_addr learned my addr 172.21.15.55:0/3574117144 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:44.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.894+0000 7fa5777fe640 1 --2- 172.21.15.55:0/3574117144 >> v2:172.21.15.110:3300/0 conn(0x7fa5780cdde0 0x7fa5780ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:44.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.894+0000 7fa57c9b6640 1 -- 172.21.15.55:0/3574117144 >> v2:172.21.15.110:3300/0 conn(0x7fa5780cdde0 msgr2=0x7fa5780ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:44.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.894+0000 7fa57c9b6640 1 --2- 172.21.15.55:0/3574117144 >> v2:172.21.15.110:3300/0 conn(0x7fa5780cdde0 0x7fa5780ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:44.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.894+0000 7fa57c9b6640 1 -- 172.21.15.55:0/3574117144 >> v1:172.21.15.110:6789/0 conn(0x7fa5780d0da0 legacy=0x7fa5780d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:44.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.894+0000 7fa57c9b6640 1 -- 172.21.15.55:0/3574117144 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5780b2080 con 0x7fa5780b2e40 2023-08-25T04:18:44.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.898+0000 7fa57c9b6640 1 --2- 172.21.15.55:0/3574117144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5780b2e40 0x7fa5780b32b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fa5780d38c0 tx=0x7fa57001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7793c0baac5729f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:44.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.898+0000 7fa576ffd640 1 -- 172.21.15.55:0/3574117144 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5700af400 con 0x7fa5780b2e40 2023-08-25T04:18:44.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.898+0000 7fa576ffd640 1 -- 172.21.15.55:0/3574117144 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5700ab050 con 0x7fa5780b2e40 2023-08-25T04:18:44.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.898+0000 7fa576ffd640 1 -- 172.21.15.55:0/3574117144 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5700af780 con 0x7fa5780b2e40 2023-08-25T04:18:44.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.898+0000 7fa57e419640 1 -- 172.21.15.55:0/3574117144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5780b2e40 msgr2=0x7fa5780b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:44.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.898+0000 7fa57e419640 1 --2- 172.21.15.55:0/3574117144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5780b2e40 0x7fa5780b32b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fa5780d38c0 tx=0x7fa57001f1c0 comp rx=0 tx=0).stop 2023-08-25T04:18:44.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.898+0000 7fa57e419640 1 -- 172.21.15.55:0/3574117144 shutdown_connections 2023-08-25T04:18:44.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.898+0000 7fa57e419640 1 --2- 172.21.15.55:0/3574117144 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5780b2e40 0x7fa5780b32b0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:44.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.898+0000 7fa57e419640 1 --2- 172.21.15.55:0/3574117144 >> v2:172.21.15.110:3300/0 conn(0x7fa5780cdde0 0x7fa5780ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:44.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.898+0000 7fa57e419640 1 -- 172.21.15.55:0/3574117144 >> 172.21.15.55:0/3574117144 conn(0x7fa57809bae0 msgr2=0x7fa5780d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:44.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.898+0000 7fa57e419640 1 -- 172.21.15.55:0/3574117144 shutdown_connections 2023-08-25T04:18:44.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.898+0000 7fa57e419640 1 -- 172.21.15.55:0/3574117144 wait complete. 2023-08-25T04:18:44.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa57e419640 1 Processor -- start 2023-08-25T04:18:44.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa57e419640 1 -- start start 2023-08-25T04:18:44.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa57e419640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5780b2e40 0x7fa5780b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:44.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa57e419640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5780cdde0 0x7fa578151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:44.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa57e419640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5780d0da0 0x7fa5780b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:44.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa57e419640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5780b6330 con 0x7fa5780cdde0 2023-08-25T04:18:44.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa57e419640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5780cc740 con 0x7fa5780b2e40 2023-08-25T04:18:44.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa57e419640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5780b6540 con 0x7fa5780d0da0 2023-08-25T04:18:44.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa5777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5780cdde0 0x7fa578151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:44.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa5777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5780cdde0 0x7fa578151cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57560/0 (socket says 172.21.15.55:57560) 2023-08-25T04:18:44.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa5777fe640 1 -- 172.21.15.55:0/1576713222 learned_addr learned my addr 172.21.15.55:0/1576713222 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:44.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa577fff640 1 --2- 172.21.15.55:0/1576713222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5780b2e40 0x7fa5780b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:44.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa57c9b6640 1 --2- 172.21.15.55:0/1576713222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5780d0da0 0x7fa5780b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:44.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa5777fe640 1 -- 172.21.15.55:0/1576713222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5780d0da0 msgr2=0x7fa5780b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:44.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa5777fe640 1 --2- 172.21.15.55:0/1576713222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5780d0da0 0x7fa5780b0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:44.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa5777fe640 1 -- 172.21.15.55:0/1576713222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5780b2e40 msgr2=0x7fa5780b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:44.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa5777fe640 1 --2- 172.21.15.55:0/1576713222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5780b2e40 0x7fa5780b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:44.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa5777fe640 1 -- 172.21.15.55:0/1576713222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa570009b30 con 0x7fa5780cdde0 2023-08-25T04:18:44.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa57c9b6640 1 --2- 172.21.15.55:0/1576713222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5780d0da0 0x7fa5780b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:44.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa5777fe640 1 --2- 172.21.15.55:0/1576713222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5780cdde0 0x7fa578151cd0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00e930 tx=0x7fa56c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:44.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa574ff9640 1 -- 172.21.15.55:0/1576713222 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c009690 con 0x7fa5780cdde0 2023-08-25T04:18:44.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa574ff9640 1 -- 172.21.15.55:0/1576713222 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c00ca00 con 0x7fa5780cdde0 2023-08-25T04:18:44.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa574ff9640 1 -- 172.21.15.55:0/1576713222 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c00cd70 con 0x7fa5780cdde0 2023-08-25T04:18:44.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.902+0000 7fa57e419640 1 -- 172.21.15.55:0/1576713222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5780b6820 con 0x7fa5780cdde0 2023-08-25T04:18:44.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.906+0000 7fa57e419640 1 -- 172.21.15.55:0/1576713222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5780b6de0 con 0x7fa5780cdde0 2023-08-25T04:18:44.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.906+0000 7fa57e419640 1 -- 172.21.15.55:0/1576713222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa57804dbe0 con 0x7fa5780cdde0 2023-08-25T04:18:44.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.906+0000 7fa574ff9640 1 -- 172.21.15.55:0/1576713222 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 34) v1 ==== 85065+0+0 (secure 0 0 0) 0x7fa56c013470 con 0x7fa5780cdde0 2023-08-25T04:18:44.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.906+0000 7fa574ff9640 1 --2- 172.21.15.55:0/1576713222 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fa5640657a0 0x7fa564067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:44.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.906+0000 7fa574ff9640 1 -- 172.21.15.55:0/1576713222 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fa56c083320 con 0x7fa5780cdde0 2023-08-25T04:18:44.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.906+0000 7fa577fff640 1 -- 172.21.15.55:0/1576713222 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fa5640657a0 msgr2=0x7fa564067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3289898378 2023-08-25T04:18:44.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.906+0000 7fa577fff640 1 --2- 172.21.15.55:0/1576713222 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fa5640657a0 0x7fa564067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:44.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:44.910+0000 7fa574ff9640 1 -- 172.21.15.55:0/1576713222 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa56c050c40 con 0x7fa5780cdde0 2023-08-25T04:18:45.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.070+0000 7fa57e419640 1 -- 172.21.15.55:0/1576713222 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5780d0b80 con 0x7fa5780cdde0 2023-08-25T04:18:45.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.074+0000 7fa574ff9640 1 -- 172.21.15.55:0/1576713222 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18813 (secure 0 0 0) 0x7fa56c054260 con 0x7fa5780cdde0 2023-08-25T04:18:45.072 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:45.076 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":80,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:18:42.450292+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:18:23.823729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-25T04:18:24.273419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3539787169":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/2505659035":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/1748509305":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/584064839":"2023-08-26T04:18:42.450252+0000","172.21.15.110:6833/2283645732":"2023-08-26T04:18:42.450252+0000","172.21.15.110:6832/2283645732":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/3198972450":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/1819842818":"2023-08-26T04:18:42.450252+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:18:45.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.074+0000 7fa57e419640 1 -- 172.21.15.55:0/1576713222 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fa5640657a0 msgr2=0x7fa564067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:45.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.074+0000 7fa57e419640 1 --2- 172.21.15.55:0/1576713222 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fa5640657a0 0x7fa564067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.074+0000 7fa57e419640 1 -- 172.21.15.55:0/1576713222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5780cdde0 msgr2=0x7fa578151cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:45.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.074+0000 7fa57e419640 1 --2- 172.21.15.55:0/1576713222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5780cdde0 0x7fa578151cd0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00e930 tx=0x7fa56c00edf0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.074+0000 7fa57e419640 1 -- 172.21.15.55:0/1576713222 shutdown_connections 2023-08-25T04:18:45.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.074+0000 7fa57e419640 1 --2- 172.21.15.55:0/1576713222 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fa5640657a0 0x7fa564067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.074+0000 7fa57e419640 1 --2- 172.21.15.55:0/1576713222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5780d0da0 0x7fa5780b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.074+0000 7fa57e419640 1 --2- 172.21.15.55:0/1576713222 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5780cdde0 0x7fa578151cd0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.074+0000 7fa57e419640 1 --2- 172.21.15.55:0/1576713222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5780b2e40 0x7fa5780b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.074+0000 7fa57e419640 1 -- 172.21.15.55:0/1576713222 >> 172.21.15.55:0/1576713222 conn(0x7fa57809bae0 msgr2=0x7fa57806a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:45.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.074+0000 7fa57e419640 1 -- 172.21.15.55:0/1576713222 shutdown_connections 2023-08-25T04:18:45.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.074+0000 7fa57e419640 1 -- 172.21.15.55:0/1576713222 wait complete. 2023-08-25T04:18:45.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:18:23.823729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:18:24.273419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:18:45.096 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:18:45.098 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:45.097+0000 7faad17d4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:18:45.140 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:45.142+0000 7fc468c2d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:18:45.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.246+0000 7fbfea69e640 1 Processor -- start 2023-08-25T04:18:45.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.246+0000 7fbfea69e640 1 -- start start 2023-08-25T04:18:45.247 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:45.245+0000 7faad17d4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:18:45.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.250+0000 7fbfea69e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfe40b8330 0x7fbfe4167290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:45.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.250+0000 7fbfea69e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe40b70c0 con 0x7fbfe415fca0 2023-08-25T04:18:45.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.250+0000 7fbfea69e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe40b73a0 con 0x7fbfe40cfc90 2023-08-25T04:18:45.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.250+0000 7fbfea69e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe4160080 con 0x7fbfe40b8330 2023-08-25T04:18:45.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.250+0000 7fbfe969c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbfe415fca0 0x7fbfe40cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33542/0 (socket says 172.21.15.55:33542) 2023-08-25T04:18:45.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.250+0000 7fbfe969c640 1 -- 172.21.15.55:0/2803271816 learned_addr learned my addr 172.21.15.55:0/2803271816 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:45.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.250+0000 7fbfe9e9d640 1 --2- 172.21.15.55:0/2803271816 >> v2:172.21.15.55:3300/0 conn(0x7fbfe40b8330 0x7fbfe4167290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:45.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.250+0000 7fbfdbfff640 1 -- 172.21.15.55:0/2803271816 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785799054 0 0) 0x7fbfe40b70c0 con 0x7fbfe415fca0 2023-08-25T04:18:45.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.250+0000 7fbfdbfff640 1 -- 172.21.15.55:0/2803271816 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfd0003530 con 0x7fbfe415fca0 2023-08-25T04:18:45.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.250+0000 7fbfdbfff640 1 -- 172.21.15.55:0/2803271816 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96790804 0 0) 0x7fbfe40b73a0 con 0x7fbfe40cfc90 2023-08-25T04:18:45.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.250+0000 7fbfdbfff640 1 -- 172.21.15.55:0/2803271816 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfe40b70c0 con 0x7fbfe40cfc90 2023-08-25T04:18:45.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.250+0000 7fbfe9e9d640 1 -- 172.21.15.55:0/2803271816 >> v1:172.21.15.110:6789/0 conn(0x7fbfe40cfc90 legacy=0x7fbfe40b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:45.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.250+0000 7fbfe9e9d640 1 -- 172.21.15.55:0/2803271816 >> v1:172.21.15.55:6789/0 conn(0x7fbfe415fca0 legacy=0x7fbfe40cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:45.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.250+0000 7fbfe9e9d640 1 -- 172.21.15.55:0/2803271816 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe40b7680 con 0x7fbfe40b8330 2023-08-25T04:18:45.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.254+0000 7fbfe9e9d640 1 --2- 172.21.15.55:0/2803271816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40b8330 0x7fbfe4167290 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009d90 tx=0x7fbfdc01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302ecbe5dfdeda9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:45.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.254+0000 7fbfdbfff640 1 -- 172.21.15.55:0/2803271816 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc0af600 con 0x7fbfe40b8330 2023-08-25T04:18:45.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.254+0000 7fbfdbfff640 1 -- 172.21.15.55:0/2803271816 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc0ab050 con 0x7fbfe40b8330 2023-08-25T04:18:45.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.254+0000 7fbfdbfff640 1 -- 172.21.15.55:0/2803271816 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc0af980 con 0x7fbfe40b8330 2023-08-25T04:18:45.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.254+0000 7fbfea69e640 1 -- 172.21.15.55:0/2803271816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40b8330 msgr2=0x7fbfe4167290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:45.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.254+0000 7fbfea69e640 1 --2- 172.21.15.55:0/2803271816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40b8330 0x7fbfe4167290 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009d90 tx=0x7fbfdc01f130 comp rx=0 tx=0).stop 2023-08-25T04:18:45.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.254+0000 7fbfea69e640 1 -- 172.21.15.55:0/2803271816 shutdown_connections 2023-08-25T04:18:45.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.254+0000 7fbfea69e640 1 --2- 172.21.15.55:0/2803271816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40b8330 0x7fbfe4167290 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.254+0000 7fbfea69e640 1 -- 172.21.15.55:0/2803271816 >> 172.21.15.55:0/2803271816 conn(0x7fbfe40658c0 msgr2=0x7fbfe4065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:45.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.254+0000 7fbfea69e640 1 -- 172.21.15.55:0/2803271816 shutdown_connections 2023-08-25T04:18:45.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.254+0000 7fbfea69e640 1 -- 172.21.15.55:0/2803271816 wait complete. 2023-08-25T04:18:45.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.254+0000 7fbfea69e640 1 Processor -- start 2023-08-25T04:18:45.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.254+0000 7fbfea69e640 1 -- start start 2023-08-25T04:18:45.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfea69e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40b8330 0x7fbfe4159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:45.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfea69e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfe40cfc90 0x7fbfe414b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:45.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfea69e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfe415fca0 0x7fbfe40d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:45.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfea69e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe41f2d30 con 0x7fbfe40b8330 2023-08-25T04:18:45.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfea69e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe415a320 con 0x7fbfe415fca0 2023-08-25T04:18:45.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfea69e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe415a600 con 0x7fbfe40cfc90 2023-08-25T04:18:45.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfe969c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40b8330 0x7fbfe4159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:45.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfe969c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40b8330 0x7fbfe4159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57578/0 (socket says 172.21.15.55:57578) 2023-08-25T04:18:45.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfe969c640 1 -- 172.21.15.55:0/2566895731 learned_addr learned my addr 172.21.15.55:0/2566895731 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:45.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfe9e9d640 1 --2- 172.21.15.55:0/2566895731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfe415fca0 0x7fbfe40d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:45.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfe8e9b640 1 --2- 172.21.15.55:0/2566895731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfe40cfc90 0x7fbfe414b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:45.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfe969c640 1 -- 172.21.15.55:0/2566895731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfe40cfc90 msgr2=0x7fbfe414b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:45.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfe969c640 1 --2- 172.21.15.55:0/2566895731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfe40cfc90 0x7fbfe414b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfe969c640 1 -- 172.21.15.55:0/2566895731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfe415fca0 msgr2=0x7fbfe40d1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:45.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfe969c640 1 --2- 172.21.15.55:0/2566895731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfe415fca0 0x7fbfe40d1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfe969c640 1 -- 172.21.15.55:0/2566895731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc009a70 con 0x7fbfe40b8330 2023-08-25T04:18:45.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfe969c640 1 --2- 172.21.15.55:0/2566895731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40b8330 0x7fbfe4159cb0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000c420 tx=0x7fbfe000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:45.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfd9ffb640 1 -- 172.21.15.55:0/2566895731 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0005cf0 con 0x7fbfe40b8330 2023-08-25T04:18:45.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfd9ffb640 1 -- 172.21.15.55:0/2566895731 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe0005e50 con 0x7fbfe40b8330 2023-08-25T04:18:45.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfd9ffb640 1 -- 172.21.15.55:0/2566895731 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe00072d0 con 0x7fbfe40b8330 2023-08-25T04:18:45.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfea69e640 1 -- 172.21.15.55:0/2566895731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe41f2f10 con 0x7fbfe40b8330 2023-08-25T04:18:45.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfea69e640 1 -- 172.21.15.55:0/2566895731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe40d3280 con 0x7fbfe40b8330 2023-08-25T04:18:45.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.258+0000 7fbfea69e640 1 -- 172.21.15.55:0/2566895731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe415a820 con 0x7fbfe40b8330 2023-08-25T04:18:45.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.262+0000 7fbfd9ffb640 1 -- 172.21.15.55:0/2566895731 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 34) v1 ==== 85065+0+0 (secure 0 0 0) 0x7fbfe0007430 con 0x7fbfe40b8330 2023-08-25T04:18:45.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.262+0000 7fbfd9ffb640 1 --2- 172.21.15.55:0/2566895731 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fbfc80657a0 0x7fbfc8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:45.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.262+0000 7fbfd9ffb640 1 -- 172.21.15.55:0/2566895731 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fbfe00825c0 con 0x7fbfe40b8330 2023-08-25T04:18:45.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.262+0000 7fbfe8e9b640 1 -- 172.21.15.55:0/2566895731 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fbfc80657a0 msgr2=0x7fbfc8067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3289898378 2023-08-25T04:18:45.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.262+0000 7fbfe8e9b640 1 --2- 172.21.15.55:0/2566895731 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fbfc80657a0 0x7fbfc8067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:45.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.266+0000 7fbfd9ffb640 1 -- 172.21.15.55:0/2566895731 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbfe004feb0 con 0x7fbfe40b8330 2023-08-25T04:18:45.301 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:45.302+0000 7fc468c2d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:18:45.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.422+0000 7fbfea69e640 1 -- 172.21.15.55:0/2566895731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbfe40b7930 con 0x7fbfe40b8330 2023-08-25T04:18:45.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.426+0000 7fbfd9ffb640 1 -- 172.21.15.55:0/2566895731 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbfe00534d0 con 0x7fbfe40b8330 2023-08-25T04:18:45.424 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:18:45.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.426+0000 7fbfea69e640 1 -- 172.21.15.55:0/2566895731 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fbfc80657a0 msgr2=0x7fbfc8067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:45.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.426+0000 7fbfea69e640 1 --2- 172.21.15.55:0/2566895731 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fbfc80657a0 0x7fbfc8067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.426+0000 7fbfea69e640 1 -- 172.21.15.55:0/2566895731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40b8330 msgr2=0x7fbfe4159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:45.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.426+0000 7fbfea69e640 1 --2- 172.21.15.55:0/2566895731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40b8330 0x7fbfe4159cb0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fbfe000c420 tx=0x7fbfe000c8e0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.426+0000 7fbfea69e640 1 -- 172.21.15.55:0/2566895731 shutdown_connections 2023-08-25T04:18:45.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.426+0000 7fbfea69e640 1 --2- 172.21.15.55:0/2566895731 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fbfc80657a0 0x7fbfc8067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.426+0000 7fbfea69e640 1 --2- 172.21.15.55:0/2566895731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfe415fca0 0x7fbfe40d1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.426+0000 7fbfea69e640 1 --2- 172.21.15.55:0/2566895731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfe40cfc90 0x7fbfe414b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.426+0000 7fbfea69e640 1 --2- 172.21.15.55:0/2566895731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40b8330 0x7fbfe4159cb0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.426+0000 7fbfea69e640 1 -- 172.21.15.55:0/2566895731 >> 172.21.15.55:0/2566895731 conn(0x7fbfe40658c0 msgr2=0x7fbfe415b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:45.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.426+0000 7fbfea69e640 1 -- 172.21.15.55:0/2566895731 shutdown_connections 2023-08-25T04:18:45.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.426+0000 7fbfea69e640 1 -- 172.21.15.55:0/2566895731 wait complete. 2023-08-25T04:18:45.445 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:18:45.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.642+0000 7f3fd5dba640 1 Processor -- start 2023-08-25T04:18:45.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.642+0000 7f3fd5dba640 1 -- start start 2023-08-25T04:18:45.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.642+0000 7f3fd5dba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3fd01601f0 0x7f3fd015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:45.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.642+0000 7f3fd5dba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd015e3c0 0x7f3fd00d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:45.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.642+0000 7f3fd5dba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd015f8b0 con 0x7f3fd00d10c0 2023-08-25T04:18:45.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.642+0000 7f3fd5dba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd00cd5a0 con 0x7f3fd01601f0 2023-08-25T04:18:45.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.642+0000 7f3fd5dba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd00cd880 con 0x7f3fd015e3c0 2023-08-25T04:18:45.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.642+0000 7f3fceffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd015e3c0 0x7f3fd00d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:45.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.642+0000 7f3fcf7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3fd01601f0 0x7f3fd015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:45.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.642+0000 7f3fcf7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3fd01601f0 0x7f3fd015d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:41182/0 (socket says 172.21.15.55:41182) 2023-08-25T04:18:45.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.642+0000 7f3fcf7fe640 1 -- 172.21.15.55:0/4163372562 learned_addr learned my addr 172.21.15.55:0/4163372562 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:45.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.646+0000 7f3fcf7fe640 1 -- 172.21.15.55:0/4163372562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd015e3c0 msgr2=0x7f3fd00d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:45.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.646+0000 7f3fcf7fe640 1 --2- 172.21.15.55:0/4163372562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd015e3c0 0x7f3fd00d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.646+0000 7f3fcf7fe640 1 -- 172.21.15.55:0/4163372562 >> v1:172.21.15.110:6789/0 conn(0x7f3fd00d10c0 legacy=0x7f3fd00b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:45.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.646+0000 7f3fcf7fe640 1 -- 172.21.15.55:0/4163372562 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd00cdb60 con 0x7f3fd01601f0 2023-08-25T04:18:45.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.646+0000 7f3fcf7fe640 1 --2- 172.21.15.55:0/4163372562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd01601f0 0x7f3fd015d430 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0006fd0 tx=0x7f3fc001ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=631077bd100a017e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:45.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.646+0000 7f3fce7fc640 1 -- 172.21.15.55:0/4163372562 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc00a8a10 con 0x7f3fd01601f0 2023-08-25T04:18:45.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.646+0000 7f3fce7fc640 1 -- 172.21.15.55:0/4163372562 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc00a8b70 con 0x7f3fd01601f0 2023-08-25T04:18:45.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.646+0000 7f3fce7fc640 1 -- 172.21.15.55:0/4163372562 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc00b0440 con 0x7f3fd01601f0 2023-08-25T04:18:45.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fd5dba640 1 -- 172.21.15.55:0/4163372562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd01601f0 msgr2=0x7f3fd015d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:45.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fd5dba640 1 --2- 172.21.15.55:0/4163372562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd01601f0 0x7f3fd015d430 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0006fd0 tx=0x7f3fc001ed10 comp rx=0 tx=0).stop 2023-08-25T04:18:45.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fd5dba640 1 -- 172.21.15.55:0/4163372562 shutdown_connections 2023-08-25T04:18:45.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fd5dba640 1 --2- 172.21.15.55:0/4163372562 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd015e3c0 0x7f3fd00d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fd5dba640 1 --2- 172.21.15.55:0/4163372562 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd01601f0 0x7f3fd015d430 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fd5dba640 1 -- 172.21.15.55:0/4163372562 >> 172.21.15.55:0/4163372562 conn(0x7f3fd00d27d0 msgr2=0x7f3fd00d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:45.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fd5dba640 1 -- 172.21.15.55:0/4163372562 shutdown_connections 2023-08-25T04:18:45.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fd5dba640 1 -- 172.21.15.55:0/4163372562 wait complete. 2023-08-25T04:18:45.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fd5dba640 1 Processor -- start 2023-08-25T04:18:45.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fd5dba640 1 -- start start 2023-08-25T04:18:45.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fd5dba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd00d10c0 0x7f3fd014efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:45.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fd5dba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fd015e3c0 0x7f3fd00c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:45.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fd5dba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd01601f0 0x7f3fd00c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:45.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fd5dba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd00b7130 con 0x7f3fd015e3c0 2023-08-25T04:18:45.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fd5dba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd00b6520 con 0x7f3fd00d10c0 2023-08-25T04:18:45.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fd5dba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd00b6800 con 0x7f3fd01601f0 2023-08-25T04:18:45.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fceffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fd015e3c0 0x7f3fd00c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:45.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fceffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fd015e3c0 0x7f3fd00c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57590/0 (socket says 172.21.15.55:57590) 2023-08-25T04:18:45.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fceffd640 1 -- 172.21.15.55:0/226666187 learned_addr learned my addr 172.21.15.55:0/226666187 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:45.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fcffff640 1 --2- 172.21.15.55:0/226666187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd01601f0 0x7f3fd00c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:45.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fcf7fe640 1 --2- 172.21.15.55:0/226666187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd00d10c0 0x7f3fd014efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:45.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fceffd640 1 -- 172.21.15.55:0/226666187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd01601f0 msgr2=0x7f3fd00c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:45.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fceffd640 1 --2- 172.21.15.55:0/226666187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd01601f0 0x7f3fd00c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fceffd640 1 -- 172.21.15.55:0/226666187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd00d10c0 msgr2=0x7f3fd014efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:45.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fceffd640 1 --2- 172.21.15.55:0/226666187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd00d10c0 0x7f3fd014efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.650+0000 7f3fceffd640 1 -- 172.21.15.55:0/226666187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc0009480 con 0x7f3fd015e3c0 2023-08-25T04:18:45.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.654+0000 7f3fceffd640 1 --2- 172.21.15.55:0/226666187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fd015e3c0 0x7f3fd00c8440 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400e930 tx=0x7f3fc400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:45.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.654+0000 7f3fb7fff640 1 -- 172.21.15.55:0/226666187 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4009690 con 0x7f3fd015e3c0 2023-08-25T04:18:45.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.654+0000 7f3fb7fff640 1 -- 172.21.15.55:0/226666187 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc400ca00 con 0x7f3fd015e3c0 2023-08-25T04:18:45.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.654+0000 7f3fb7fff640 1 -- 172.21.15.55:0/226666187 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc400cd70 con 0x7f3fd015e3c0 2023-08-25T04:18:45.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.654+0000 7f3fd5dba640 1 -- 172.21.15.55:0/226666187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd00b6ae0 con 0x7f3fd015e3c0 2023-08-25T04:18:45.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.654+0000 7f3fd5dba640 1 -- 172.21.15.55:0/226666187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd014f4f0 con 0x7f3fd015e3c0 2023-08-25T04:18:45.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.654+0000 7f3fd5dba640 1 -- 172.21.15.55:0/226666187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd00b72e0 con 0x7f3fd015e3c0 2023-08-25T04:18:45.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.654+0000 7f3fb7fff640 1 -- 172.21.15.55:0/226666187 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 34) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f3fc4013470 con 0x7f3fd015e3c0 2023-08-25T04:18:45.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.654+0000 7f3fb7fff640 1 --2- 172.21.15.55:0/226666187 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f3fbc0657a0 0x7f3fbc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:45.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.654+0000 7f3fb7fff640 1 -- 172.21.15.55:0/226666187 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f3fc4083280 con 0x7f3fd015e3c0 2023-08-25T04:18:45.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.654+0000 7f3fcf7fe640 1 -- 172.21.15.55:0/226666187 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f3fbc0657a0 msgr2=0x7f3fbc067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3289898378 2023-08-25T04:18:45.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.654+0000 7f3fcf7fe640 1 --2- 172.21.15.55:0/226666187 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f3fbc0657a0 0x7f3fbc067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:45.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.658+0000 7f3fb7fff640 1 -- 172.21.15.55:0/226666187 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3fc4050c40 con 0x7f3fd015e3c0 2023-08-25T04:18:45.730 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:45.729+0000 7faad17d4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:18:45.789 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:45.785+0000 7faad17d4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:18:45.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.834+0000 7f3fd5dba640 1 -- 172.21.15.55:0/226666187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3fd0073ec0 con 0x7f3fd015e3c0 2023-08-25T04:18:45.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.834+0000 7f3fb7fff640 1 -- 172.21.15.55:0/226666187 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v80) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3fc4054260 con 0x7f3fd015e3c0 2023-08-25T04:18:45.834 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:18:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.834+0000 7f3fd5dba640 1 -- 172.21.15.55:0/226666187 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f3fbc0657a0 msgr2=0x7f3fbc067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:45.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.834+0000 7f3fd5dba640 1 --2- 172.21.15.55:0/226666187 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f3fbc0657a0 0x7f3fbc067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.834+0000 7f3fd5dba640 1 -- 172.21.15.55:0/226666187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fd015e3c0 msgr2=0x7f3fd00c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:45.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.834+0000 7f3fd5dba640 1 --2- 172.21.15.55:0/226666187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fd015e3c0 0x7f3fd00c8440 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400e930 tx=0x7f3fc400edf0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.834+0000 7f3fd5dba640 1 -- 172.21.15.55:0/226666187 shutdown_connections 2023-08-25T04:18:45.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.834+0000 7f3fd5dba640 1 --2- 172.21.15.55:0/226666187 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f3fbc0657a0 0x7f3fbc067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.834+0000 7f3fd5dba640 1 --2- 172.21.15.55:0/226666187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fd01601f0 0x7f3fd00c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.834+0000 7f3fd5dba640 1 --2- 172.21.15.55:0/226666187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fd015e3c0 0x7f3fd00c8440 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.834+0000 7f3fd5dba640 1 --2- 172.21.15.55:0/226666187 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fd00d10c0 0x7f3fd014efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:45.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.834+0000 7f3fd5dba640 1 -- 172.21.15.55:0/226666187 >> 172.21.15.55:0/226666187 conn(0x7f3fd00d27d0 msgr2=0x7f3fd00b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:45.839 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:45.834+0000 7fc468c2d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:18:45.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.834+0000 7f3fd5dba640 1 -- 172.21.15.55:0/226666187 shutdown_connections 2023-08-25T04:18:45.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:45.838+0000 7f3fd5dba640 1 -- 172.21.15.55:0/226666187 wait complete. 2023-08-25T04:18:45.843 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:45.841+0000 7faad17d4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:18:45.855 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:18:45.899 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:45.898+0000 7fc468c2d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:18:45.928 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:45.925+0000 7faad17d4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:18:45.958 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:45.958+0000 7fc468c2d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:18:45.986 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:45.985+0000 7faad17d4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:18:46.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.006+0000 7f3f62598640 1 Processor -- start 2023-08-25T04:18:46.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.006+0000 7f3f62598640 1 -- start start 2023-08-25T04:18:46.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.010+0000 7f3f62598640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3f5c15fca0 0x7f3f5c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.010+0000 7f3f62598640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f5c0b8330 0x7f3f5c0cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.010+0000 7f3f62598640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c0b70c0 con 0x7f3f5c0d0bd0 2023-08-25T04:18:46.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.010+0000 7f3f62598640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5c160080 con 0x7f3f5c15fca0 2023-08-25T04:18:46.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.010+0000 7f3f62598640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0b73a0 con 0x7f3f5c0b8330 2023-08-25T04:18:46.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.010+0000 7f3f61596640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3f5c15fca0 0x7f3f5c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:46.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.010+0000 7f3f61596640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3f5c15fca0 0x7f3f5c0cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:41194/0 (socket says 172.21.15.55:41194) 2023-08-25T04:18:46.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.010+0000 7f3f61d97640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f3f5c0d0bd0 0x7f3f5c0d1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:54462/0 (socket says 172.21.15.55:54462) 2023-08-25T04:18:46.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.010+0000 7f3f61596640 1 -- 172.21.15.55:0/3310095977 learned_addr learned my addr 172.21.15.55:0/3310095977 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:46.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.010+0000 7f3f60d95640 1 --2- 172.21.15.55:0/3310095977 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f5c0b8330 0x7f3f5c0cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:46.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.010+0000 7f3f61596640 1 -- 172.21.15.55:0/3310095977 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f5c0b8330 msgr2=0x7f3f5c0cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:46.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.010+0000 7f3f61596640 1 --2- 172.21.15.55:0/3310095977 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f5c0b8330 0x7f3f5c0cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.010+0000 7f3f61596640 1 -- 172.21.15.55:0/3310095977 >> v1:172.21.15.110:6789/0 conn(0x7f3f5c0d0bd0 legacy=0x7f3f5c0d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:46.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.010+0000 7f3f61596640 1 -- 172.21.15.55:0/3310095977 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c0b7680 con 0x7f3f5c15fca0 2023-08-25T04:18:46.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.010+0000 7f3f53fff640 1 -- 172.21.15.55:0/3310095977 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169347610 0 0) 0x7f3f5c0b70c0 con 0x7f3f5c0d0bd0 2023-08-25T04:18:46.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.014+0000 7f3f61596640 1 --2- 172.21.15.55:0/3310095977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f5c15fca0 0x7f3f5c0cf580 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009870 tx=0x7f3f5801ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39b92964efb564b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:46.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.014+0000 7f3f53fff640 1 -- 172.21.15.55:0/3310095977 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f580a8a30 con 0x7f3f5c15fca0 2023-08-25T04:18:46.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.014+0000 7f3f53fff640 1 -- 172.21.15.55:0/3310095977 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f580a8b90 con 0x7f3f5c15fca0 2023-08-25T04:18:46.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.014+0000 7f3f53fff640 1 -- 172.21.15.55:0/3310095977 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f580b0440 con 0x7f3f5c15fca0 2023-08-25T04:18:46.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.014+0000 7f3f62598640 1 -- 172.21.15.55:0/3310095977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f5c15fca0 msgr2=0x7f3f5c0cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:46.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.014+0000 7f3f62598640 1 --2- 172.21.15.55:0/3310095977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f5c15fca0 0x7f3f5c0cf580 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009870 tx=0x7f3f5801ed30 comp rx=0 tx=0).stop 2023-08-25T04:18:46.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.014+0000 7f3f62598640 1 -- 172.21.15.55:0/3310095977 shutdown_connections 2023-08-25T04:18:46.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.014+0000 7f3f62598640 1 --2- 172.21.15.55:0/3310095977 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f5c0b8330 0x7f3f5c0cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.014+0000 7f3f62598640 1 --2- 172.21.15.55:0/3310095977 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f5c15fca0 0x7f3f5c0cf580 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.014+0000 7f3f62598640 1 -- 172.21.15.55:0/3310095977 >> 172.21.15.55:0/3310095977 conn(0x7f3f5c0658c0 msgr2=0x7f3f5c065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:46.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.014+0000 7f3f62598640 1 -- 172.21.15.55:0/3310095977 shutdown_connections 2023-08-25T04:18:46.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.014+0000 7f3f62598640 1 -- 172.21.15.55:0/3310095977 wait complete. 2023-08-25T04:18:46.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.014+0000 7f3f62598640 1 Processor -- start 2023-08-25T04:18:46.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.014+0000 7f3f62598640 1 -- start start 2023-08-25T04:18:46.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f62598640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f5c0b8330 0x7f3f5c14f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f62598640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f5c0d0bd0 0x7f3f5c0c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f62598640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f5c15fca0 0x7f3f5c150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f62598640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0c8b10 con 0x7f3f5c0b8330 2023-08-25T04:18:46.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f62598640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c150610 con 0x7f3f5c0d0bd0 2023-08-25T04:18:46.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f62598640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c150fe0 con 0x7f3f5c15fca0 2023-08-25T04:18:46.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f61596640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f5c0b8330 0x7f3f5c14f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:46.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f61596640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f5c0b8330 0x7f3f5c14f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57604/0 (socket says 172.21.15.55:57604) 2023-08-25T04:18:46.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f61596640 1 -- 172.21.15.55:0/1902476708 learned_addr learned my addr 172.21.15.55:0/1902476708 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:46.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f60d95640 1 --2- 172.21.15.55:0/1902476708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f5c0d0bd0 0x7f3f5c0c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:46.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f61d97640 1 --2- 172.21.15.55:0/1902476708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f5c15fca0 0x7f3f5c150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:46.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f61596640 1 -- 172.21.15.55:0/1902476708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f5c15fca0 msgr2=0x7f3f5c150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:46.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f61596640 1 --2- 172.21.15.55:0/1902476708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f5c15fca0 0x7f3f5c150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f61596640 1 -- 172.21.15.55:0/1902476708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f5c0d0bd0 msgr2=0x7f3f5c0c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:46.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f61596640 1 --2- 172.21.15.55:0/1902476708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f5c0d0bd0 0x7f3f5c0c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f61596640 1 -- 172.21.15.55:0/1902476708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f580094d0 con 0x7f3f5c0b8330 2023-08-25T04:18:46.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f61596640 1 --2- 172.21.15.55:0/1902476708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f5c0b8330 0x7f3f5c14f300 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f3f580b3040 tx=0x7f3f5801bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:46.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f51ffb640 1 -- 172.21.15.55:0/1902476708 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f580b0dd0 con 0x7f3f5c0b8330 2023-08-25T04:18:46.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f51ffb640 1 -- 172.21.15.55:0/1902476708 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f580bb460 con 0x7f3f5c0b8330 2023-08-25T04:18:46.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f62598640 1 -- 172.21.15.55:0/1902476708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5c14fa00 con 0x7f3f5c0b8330 2023-08-25T04:18:46.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f51ffb640 1 -- 172.21.15.55:0/1902476708 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f580bb810 con 0x7f3f5c0b8330 2023-08-25T04:18:46.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f62598640 1 -- 172.21.15.55:0/1902476708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5c14ffc0 con 0x7f3f5c0b8330 2023-08-25T04:18:46.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.018+0000 7f3f62598640 1 -- 172.21.15.55:0/1902476708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5c073e50 con 0x7f3f5c0b8330 2023-08-25T04:18:46.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.022+0000 7f3f51ffb640 1 -- 172.21.15.55:0/1902476708 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 34) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f3f580b83f0 con 0x7f3f5c0b8330 2023-08-25T04:18:46.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.022+0000 7f3f51ffb640 1 --2- 172.21.15.55:0/1902476708 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f3f400657a0 0x7f3f40067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.022+0000 7f3f51ffb640 1 -- 172.21.15.55:0/1902476708 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f3f58120a20 con 0x7f3f5c0b8330 2023-08-25T04:18:46.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.022+0000 7f3f60d95640 1 -- 172.21.15.55:0/1902476708 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f3f400657a0 msgr2=0x7f3f40067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3289898378 2023-08-25T04:18:46.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.022+0000 7f3f60d95640 1 --2- 172.21.15.55:0/1902476708 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f3f400657a0 0x7f3f40067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:46.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.026+0000 7f3f51ffb640 1 -- 172.21.15.55:0/1902476708 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3f580ee200 con 0x7f3f5c0b8330 2023-08-25T04:18:46.052 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:46.054+0000 7fc468c2d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:18:46.071 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:46.069+0000 7faad17d4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:18:46.113 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:46.114+0000 7fc468c2d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:18:46.127 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:46.125+0000 7faad17d4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:18:46.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.182+0000 7f3f62598640 1 -- 172.21.15.55:0/1902476708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f5c0b8110 con 0x7f3f5c0b8330 2023-08-25T04:18:46.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.182+0000 7f3f51ffb640 1 -- 172.21.15.55:0/1902476708 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3f580f1820 con 0x7f3f5c0b8330 2023-08-25T04:18:46.181 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:18:46.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.182+0000 7f3f62598640 1 -- 172.21.15.55:0/1902476708 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f3f400657a0 msgr2=0x7f3f40067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:46.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.186+0000 7f3f62598640 1 --2- 172.21.15.55:0/1902476708 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f3f400657a0 0x7f3f40067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.186+0000 7f3f62598640 1 -- 172.21.15.55:0/1902476708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f5c0b8330 msgr2=0x7f3f5c14f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:46.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.186+0000 7f3f62598640 1 --2- 172.21.15.55:0/1902476708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f5c0b8330 0x7f3f5c14f300 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f3f580b3040 tx=0x7f3f5801bad0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.186+0000 7f3f62598640 1 -- 172.21.15.55:0/1902476708 shutdown_connections 2023-08-25T04:18:46.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.186+0000 7f3f62598640 1 --2- 172.21.15.55:0/1902476708 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f3f400657a0 0x7f3f40067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.186+0000 7f3f62598640 1 --2- 172.21.15.55:0/1902476708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f5c15fca0 0x7f3f5c150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.186+0000 7f3f62598640 1 --2- 172.21.15.55:0/1902476708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f5c0d0bd0 0x7f3f5c0c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.186+0000 7f3f62598640 1 --2- 172.21.15.55:0/1902476708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f5c0b8330 0x7f3f5c14f300 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.186+0000 7f3f62598640 1 -- 172.21.15.55:0/1902476708 >> 172.21.15.55:0/1902476708 conn(0x7f3f5c0658c0 msgr2=0x7f3f5c0d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:46.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.186+0000 7f3f62598640 1 -- 172.21.15.55:0/1902476708 shutdown_connections 2023-08-25T04:18:46.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.186+0000 7f3f62598640 1 -- 172.21.15.55:0/1902476708 wait complete. 2023-08-25T04:18:46.203 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:46.202+0000 7fc468c2d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:18:46.204 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:18:46.261 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:46.262+0000 7fc468c2d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:18:46.268 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:46.265+0000 7faad17d4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:18:46.326 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:46.325+0000 7faad17d4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:18:46.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.394+0000 7fc972d59640 1 Processor -- start 2023-08-25T04:18:46.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.394+0000 7fc972d59640 1 -- start start 2023-08-25T04:18:46.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.394+0000 7fc972d59640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc96c1601f0 0x7fc96c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.394+0000 7fc972d59640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc96c0d1290 0x7fc96c15e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.394+0000 7fc972d59640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96c0cd5a0 con 0x7fc96c15e3c0 2023-08-25T04:18:46.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.394+0000 7fc972d59640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c0cd880 con 0x7fc96c0d1290 2023-08-25T04:18:46.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.394+0000 7fc972d59640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c0cdb60 con 0x7fc96c1601f0 2023-08-25T04:18:46.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.394+0000 7fc9712f6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc96c0d1290 0x7fc96c15e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:46.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.394+0000 7fc9712f6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc96c0d1290 0x7fc96c15e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57620/0 (socket says 172.21.15.55:57620) 2023-08-25T04:18:46.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.394+0000 7fc9712f6640 1 -- 172.21.15.55:0/716302877 learned_addr learned my addr 172.21.15.55:0/716302877 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:46.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.394+0000 7fc963fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc96c15e3c0 0x7fc96c0d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33550/0 (socket says 172.21.15.55:33550) 2023-08-25T04:18:46.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.394+0000 7fc970af5640 1 --2- 172.21.15.55:0/716302877 >> v2:172.21.15.110:3300/0 conn(0x7fc96c1601f0 0x7fc96c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:46.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.394+0000 7fc9712f6640 1 -- 172.21.15.55:0/716302877 >> v2:172.21.15.110:3300/0 conn(0x7fc96c1601f0 msgr2=0x7fc96c15d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:46.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.394+0000 7fc9712f6640 1 --2- 172.21.15.55:0/716302877 >> v2:172.21.15.110:3300/0 conn(0x7fc96c1601f0 0x7fc96c15d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.394+0000 7fc9712f6640 1 -- 172.21.15.55:0/716302877 >> v1:172.21.15.55:6789/0 conn(0x7fc96c15e3c0 legacy=0x7fc96c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:46.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.394+0000 7fc9712f6640 1 -- 172.21.15.55:0/716302877 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c0cde40 con 0x7fc96c0d1290 2023-08-25T04:18:46.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.398+0000 7fc9712f6640 1 --2- 172.21.15.55:0/716302877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc96c0d1290 0x7fc96c15e8a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fc96c08b7f0 tx=0x7fc96401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d09b3b6fbc64ffd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:46.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.398+0000 7fc9637fe640 1 -- 172.21.15.55:0/716302877 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9640a5790 con 0x7fc96c0d1290 2023-08-25T04:18:46.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.398+0000 7fc9637fe640 1 -- 172.21.15.55:0/716302877 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9640a58f0 con 0x7fc96c0d1290 2023-08-25T04:18:46.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.398+0000 7fc9637fe640 1 -- 172.21.15.55:0/716302877 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9640a5c80 con 0x7fc96c0d1290 2023-08-25T04:18:46.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.398+0000 7fc972d59640 1 -- 172.21.15.55:0/716302877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc96c0d1290 msgr2=0x7fc96c15e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:46.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.398+0000 7fc972d59640 1 --2- 172.21.15.55:0/716302877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc96c0d1290 0x7fc96c15e8a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fc96c08b7f0 tx=0x7fc96401c9a0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.398+0000 7fc972d59640 1 -- 172.21.15.55:0/716302877 shutdown_connections 2023-08-25T04:18:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.398+0000 7fc972d59640 1 --2- 172.21.15.55:0/716302877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc96c0d1290 0x7fc96c15e8a0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.398+0000 7fc972d59640 1 --2- 172.21.15.55:0/716302877 >> v2:172.21.15.110:3300/0 conn(0x7fc96c1601f0 0x7fc96c15d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.398+0000 7fc972d59640 1 -- 172.21.15.55:0/716302877 >> 172.21.15.55:0/716302877 conn(0x7fc96c0d27d0 msgr2=0x7fc96c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.398+0000 7fc972d59640 1 -- 172.21.15.55:0/716302877 shutdown_connections 2023-08-25T04:18:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.398+0000 7fc972d59640 1 -- 172.21.15.55:0/716302877 wait complete. 2023-08-25T04:18:46.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc972d59640 1 Processor -- start 2023-08-25T04:18:46.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc972d59640 1 -- start start 2023-08-25T04:18:46.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc972d59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc96c0d1290 0x7fc96c153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc972d59640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c15e3c0 0x7fc96c1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc972d59640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c1601f0 0x7fc96c159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc972d59640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c154650 con 0x7fc96c0d1290 2023-08-25T04:18:46.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc972d59640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c0c7ff0 con 0x7fc96c15e3c0 2023-08-25T04:18:46.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc972d59640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c0c82d0 con 0x7fc96c1601f0 2023-08-25T04:18:46.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc970af5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc96c0d1290 0x7fc96c153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:46.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc970af5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc96c0d1290 0x7fc96c153930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57634/0 (socket says 172.21.15.55:57634) 2023-08-25T04:18:46.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc970af5640 1 -- 172.21.15.55:0/1307304371 learned_addr learned my addr 172.21.15.55:0/1307304371 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:46.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc963fff640 1 --2- 172.21.15.55:0/1307304371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c15e3c0 0x7fc96c1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:46.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc9712f6640 1 --2- 172.21.15.55:0/1307304371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c1601f0 0x7fc96c159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:46.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc963fff640 1 -- 172.21.15.55:0/1307304371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c1601f0 msgr2=0x7fc96c159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:46.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc963fff640 1 --2- 172.21.15.55:0/1307304371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c1601f0 0x7fc96c159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc963fff640 1 -- 172.21.15.55:0/1307304371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc96c0d1290 msgr2=0x7fc96c153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:46.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc963fff640 1 --2- 172.21.15.55:0/1307304371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc96c0d1290 0x7fc96c153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc963fff640 1 -- 172.21.15.55:0/1307304371 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc964009b30 con 0x7fc96c15e3c0 2023-08-25T04:18:46.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc970af5640 1 --2- 172.21.15.55:0/1307304371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc96c0d1290 0x7fc96c153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:46.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.402+0000 7fc963fff640 1 --2- 172.21.15.55:0/1307304371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c15e3c0 0x7fc96c1563e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00c430 tx=0x7fc95c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:46.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.406+0000 7fc9617fa640 1 -- 172.21.15.55:0/1307304371 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0074e0 con 0x7fc96c15e3c0 2023-08-25T04:18:46.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.406+0000 7fc9617fa640 1 -- 172.21.15.55:0/1307304371 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c007640 con 0x7fc96c15e3c0 2023-08-25T04:18:46.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.406+0000 7fc9617fa640 1 -- 172.21.15.55:0/1307304371 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c004a10 con 0x7fc96c15e3c0 2023-08-25T04:18:46.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.406+0000 7fc972d59640 1 -- 172.21.15.55:0/1307304371 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96c0ce7c0 con 0x7fc96c15e3c0 2023-08-25T04:18:46.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.406+0000 7fc972d59640 1 -- 172.21.15.55:0/1307304371 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c0c8890 con 0x7fc96c15e3c0 2023-08-25T04:18:46.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.406+0000 7fc972d59640 1 -- 172.21.15.55:0/1307304371 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96c0b5260 con 0x7fc96c15e3c0 2023-08-25T04:18:46.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.406+0000 7fc9617fa640 1 -- 172.21.15.55:0/1307304371 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 34) v1 ==== 85065+0+0 (secure 0 0 0) 0x7fc95c004b70 con 0x7fc96c15e3c0 2023-08-25T04:18:46.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.406+0000 7fc9617fa640 1 --2- 172.21.15.55:0/1307304371 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fc9580657a0 0x7fc958067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.410+0000 7fc9617fa640 1 -- 172.21.15.55:0/1307304371 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fc95c082980 con 0x7fc96c15e3c0 2023-08-25T04:18:46.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.410+0000 7fc970af5640 1 -- 172.21.15.55:0/1307304371 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fc9580657a0 msgr2=0x7fc958067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3289898378 2023-08-25T04:18:46.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.410+0000 7fc970af5640 1 --2- 172.21.15.55:0/1307304371 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fc9580657a0 0x7fc958067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:46.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.414+0000 7fc9617fa640 1 -- 172.21.15.55:0/1307304371 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc95c050270 con 0x7fc96c15e3c0 2023-08-25T04:18:46.419 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:46.422+0000 7fc468c2d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:18:46.481 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:46.482+0000 7fc468c2d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:18:46.565 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:18:46.565 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:18:46.565 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:18:46.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.570+0000 7fc972d59640 1 -- 172.21.15.55:0/1307304371 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc96c1547c0 con 0x7fc96c15e3c0 2023-08-25T04:18:46.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.570+0000 7fc9617fa640 1 -- 172.21.15.55:0/1307304371 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc95c053890 con 0x7fc96c15e3c0 2023-08-25T04:18:46.568 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:18:46.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.570+0000 7fc972d59640 1 -- 172.21.15.55:0/1307304371 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fc9580657a0 msgr2=0x7fc958067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:46.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.570+0000 7fc972d59640 1 --2- 172.21.15.55:0/1307304371 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fc9580657a0 0x7fc958067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.570+0000 7fc972d59640 1 -- 172.21.15.55:0/1307304371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c15e3c0 msgr2=0x7fc96c1563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:46.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.570+0000 7fc972d59640 1 --2- 172.21.15.55:0/1307304371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c15e3c0 0x7fc96c1563e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00c430 tx=0x7fc95c00c8f0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.570+0000 7fc972d59640 1 -- 172.21.15.55:0/1307304371 shutdown_connections 2023-08-25T04:18:46.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.570+0000 7fc972d59640 1 --2- 172.21.15.55:0/1307304371 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fc9580657a0 0x7fc958067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.570+0000 7fc972d59640 1 --2- 172.21.15.55:0/1307304371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc96c1601f0 0x7fc96c159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.570+0000 7fc972d59640 1 --2- 172.21.15.55:0/1307304371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc96c15e3c0 0x7fc96c1563e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.570+0000 7fc972d59640 1 --2- 172.21.15.55:0/1307304371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc96c0d1290 0x7fc96c153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.570+0000 7fc972d59640 1 -- 172.21.15.55:0/1307304371 >> 172.21.15.55:0/1307304371 conn(0x7fc96c0d27d0 msgr2=0x7fc96c0d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:46.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.570+0000 7fc972d59640 1 -- 172.21.15.55:0/1307304371 shutdown_connections 2023-08-25T04:18:46.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.570+0000 7fc972d59640 1 -- 172.21.15.55:0/1307304371 wait complete. 2023-08-25T04:18:46.573 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:46.573+0000 7faad17d4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:18:46.590 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:18:46.708 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:46.705+0000 7faad17d4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:18:46.737 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:18:46.737 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:18:46.738 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:18:46.746 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:46.746+0000 7fc468c2d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:18:46.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.830+0000 7fc16759e640 1 Processor -- start 2023-08-25T04:18:46.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.830+0000 7fc16759e640 1 -- start start 2023-08-25T04:18:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.830+0000 7fc16759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc16815ca50 0x7fc1680d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.830+0000 7fc16759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1680d0f50 0x7fc16806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.830+0000 7fc16759e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc16806c150 0x7fc1680b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.830+0000 7fc16759e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1680d13d0 con 0x7fc16815ca50 2023-08-25T04:18:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.830+0000 7fc16759e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1680afe20 con 0x7fc16806c150 2023-08-25T04:18:46.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.830+0000 7fc16759e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1680af210 con 0x7fc1680d0f50 2023-08-25T04:18:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.830+0000 7fc16659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc16815ca50 0x7fc1680d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.830+0000 7fc16659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc16815ca50 0x7fc1680d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57638/0 (socket says 172.21.15.55:57638) 2023-08-25T04:18:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.830+0000 7fc16659c640 1 -- 172.21.15.55:0/669474496 learned_addr learned my addr 172.21.15.55:0/669474496 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.830+0000 7fc166d9d640 1 --2- 172.21.15.55:0/669474496 >> v2:172.21.15.110:3300/0 conn(0x7fc16806c150 0x7fc1680b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:46.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.830+0000 7fc15dd9b640 1 --2- 172.21.15.55:0/669474496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1680d0f50 0x7fc16806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:46.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.830+0000 7fc16659c640 1 -- 172.21.15.55:0/669474496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1680d0f50 msgr2=0x7fc16806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:46.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.830+0000 7fc16659c640 1 --2- 172.21.15.55:0/669474496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1680d0f50 0x7fc16806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.830+0000 7fc16659c640 1 -- 172.21.15.55:0/669474496 >> v2:172.21.15.110:3300/0 conn(0x7fc16806c150 msgr2=0x7fc1680b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:46.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.830+0000 7fc16659c640 1 --2- 172.21.15.55:0/669474496 >> v2:172.21.15.110:3300/0 conn(0x7fc16806c150 0x7fc1680b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.830+0000 7fc16659c640 1 -- 172.21.15.55:0/669474496 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1680af4f0 con 0x7fc16815ca50 2023-08-25T04:18:46.833 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:46.833+0000 7faad17d4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:18:46.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.834+0000 7fc16659c640 1 --2- 172.21.15.55:0/669474496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16815ca50 0x7fc1680d0a10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc1680c6080 tx=0x7fc15801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79856c1266e203b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:46.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.834+0000 7fc165d9b640 1 -- 172.21.15.55:0/669474496 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1580ab600 con 0x7fc16815ca50 2023-08-25T04:18:46.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.834+0000 7fc165d9b640 1 -- 172.21.15.55:0/669474496 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1580a7050 con 0x7fc16815ca50 2023-08-25T04:18:46.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.834+0000 7fc165d9b640 1 -- 172.21.15.55:0/669474496 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1580ab980 con 0x7fc16815ca50 2023-08-25T04:18:46.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.834+0000 7fc16759e640 1 -- 172.21.15.55:0/669474496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16815ca50 msgr2=0x7fc1680d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:46.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.834+0000 7fc16759e640 1 --2- 172.21.15.55:0/669474496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16815ca50 0x7fc1680d0a10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc1680c6080 tx=0x7fc15801c210 comp rx=0 tx=0).stop 2023-08-25T04:18:46.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.834+0000 7fc16759e640 1 -- 172.21.15.55:0/669474496 shutdown_connections 2023-08-25T04:18:46.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.834+0000 7fc16759e640 1 --2- 172.21.15.55:0/669474496 >> v2:172.21.15.110:3300/0 conn(0x7fc16806c150 0x7fc1680b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.834+0000 7fc16759e640 1 --2- 172.21.15.55:0/669474496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1680d0f50 0x7fc16806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.834+0000 7fc16759e640 1 --2- 172.21.15.55:0/669474496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16815ca50 0x7fc1680d0a10 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.834+0000 7fc16759e640 1 -- 172.21.15.55:0/669474496 >> 172.21.15.55:0/669474496 conn(0x7fc168065f40 msgr2=0x7fc16809b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:46.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.834+0000 7fc16759e640 1 -- 172.21.15.55:0/669474496 shutdown_connections 2023-08-25T04:18:46.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.834+0000 7fc16759e640 1 -- 172.21.15.55:0/669474496 wait complete. 2023-08-25T04:18:46.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc16759e640 1 Processor -- start 2023-08-25T04:18:46.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc16759e640 1 -- start start 2023-08-25T04:18:46.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc16759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc16806c150 0x7fc1680cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc16759e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1680d0f50 0x7fc16814b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc16759e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16815ca50 0x7fc16814bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc16759e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16814c260 con 0x7fc16815ca50 2023-08-25T04:18:46.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc16759e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1680b3ae0 con 0x7fc1680d0f50 2023-08-25T04:18:46.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc16759e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1680b5390 con 0x7fc16806c150 2023-08-25T04:18:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc166d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16815ca50 0x7fc16814bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc166d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16815ca50 0x7fc16814bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57642/0 (socket says 172.21.15.55:57642) 2023-08-25T04:18:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc166d9d640 1 -- 172.21.15.55:0/1445176984 learned_addr learned my addr 172.21.15.55:0/1445176984 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc16659c640 1 --2- 172.21.15.55:0/1445176984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc16806c150 0x7fc1680cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:46.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc15dd9b640 1 --2- 172.21.15.55:0/1445176984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1680d0f50 0x7fc16814b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:46.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc15dd9b640 1 -- 172.21.15.55:0/1445176984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc16806c150 msgr2=0x7fc1680cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:46.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc15dd9b640 1 --2- 172.21.15.55:0/1445176984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc16806c150 0x7fc1680cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc15dd9b640 1 -- 172.21.15.55:0/1445176984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16815ca50 msgr2=0x7fc16814bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:46.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc15dd9b640 1 --2- 172.21.15.55:0/1445176984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16815ca50 0x7fc16814bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:46.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc15dd9b640 1 -- 172.21.15.55:0/1445176984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc158009480 con 0x7fc1680d0f50 2023-08-25T04:18:46.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc166d9d640 1 --2- 172.21.15.55:0/1445176984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16815ca50 0x7fc16814bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:46.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc15dd9b640 1 --2- 172.21.15.55:0/1445176984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1680d0f50 0x7fc16814b7e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc15000e870 tx=0x7fc15000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:46.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc15f7fe640 1 -- 172.21.15.55:0/1445176984 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1500095d0 con 0x7fc1680d0f50 2023-08-25T04:18:46.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc15f7fe640 1 -- 172.21.15.55:0/1445176984 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15000c940 con 0x7fc1680d0f50 2023-08-25T04:18:46.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc15f7fe640 1 -- 172.21.15.55:0/1445176984 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15000ccb0 con 0x7fc1680d0f50 2023-08-25T04:18:46.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.838+0000 7fc16759e640 1 -- 172.21.15.55:0/1445176984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1680b5670 con 0x7fc1680d0f50 2023-08-25T04:18:46.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.842+0000 7fc16759e640 1 -- 172.21.15.55:0/1445176984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1680b5c30 con 0x7fc1680d0f50 2023-08-25T04:18:46.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.842+0000 7fc16759e640 1 -- 172.21.15.55:0/1445176984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1680b0290 con 0x7fc1680d0f50 2023-08-25T04:18:46.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.842+0000 7fc15f7fe640 1 -- 172.21.15.55:0/1445176984 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 34) v1 ==== 85065+0+0 (secure 0 0 0) 0x7fc150013470 con 0x7fc1680d0f50 2023-08-25T04:18:46.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.842+0000 7fc15f7fe640 1 --2- 172.21.15.55:0/1445176984 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fc1480657d0 0x7fc148067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:46.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.842+0000 7fc15f7fe640 1 -- 172.21.15.55:0/1445176984 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fc1500831a0 con 0x7fc1680d0f50 2023-08-25T04:18:46.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.842+0000 7fc16659c640 1 -- 172.21.15.55:0/1445176984 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fc1480657d0 msgr2=0x7fc148067c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3289898378 2023-08-25T04:18:46.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.842+0000 7fc16659c640 1 --2- 172.21.15.55:0/1445176984 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fc1480657d0 0x7fc148067c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:46.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:46.846+0000 7fc15f7fe640 1 -- 172.21.15.55:0/1445176984 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc1680b0290 con 0x7fc1680d0f50 2023-08-25T04:18:46.893 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:46.894+0000 7fc468c2d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:18:46.904 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:46.901+0000 7faad17d4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:18:47.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.018+0000 7fc16759e640 1 -- 172.21.15.55:0/1445176984 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc1680b0290 con 0x7fc1680d0f50 2023-08-25T04:18:47.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.018+0000 7fc15f7fe640 1 -- 172.21.15.55:0/1445176984 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v80) v1 ==== 80+0+477 (secure 0 0 0) 0x7fc1680b0290 con 0x7fc1680d0f50 2023-08-25T04:18:47.016 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3539787169 2023-08-26T04:18:42.450252+0000 2023-08-25T04:18:47.017 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/2505659035 2023-08-26T04:18:42.450252+0000 2023-08-25T04:18:47.017 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/1748509305 2023-08-26T04:18:42.450252+0000 2023-08-25T04:18:47.018 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/584064839 2023-08-26T04:18:42.450252+0000 2023-08-25T04:18:47.018 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6833/2283645732 2023-08-26T04:18:42.450252+0000 2023-08-25T04:18:47.018 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6832/2283645732 2023-08-26T04:18:42.450252+0000 2023-08-25T04:18:47.018 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3198972450 2023-08-26T04:18:42.450252+0000 2023-08-25T04:18:47.018 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/1819842818 2023-08-26T04:18:42.450252+0000 2023-08-25T04:18:47.019 INFO:teuthology.orchestra.run.smithi055.stderr:listed 8 entries 2023-08-25T04:18:47.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.018+0000 7fc16759e640 1 -- 172.21.15.55:0/1445176984 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fc1480657d0 msgr2=0x7fc148067c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:47.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.018+0000 7fc16759e640 1 --2- 172.21.15.55:0/1445176984 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fc1480657d0 0x7fc148067c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.018+0000 7fc16759e640 1 -- 172.21.15.55:0/1445176984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1680d0f50 msgr2=0x7fc16814b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:47.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.018+0000 7fc16759e640 1 --2- 172.21.15.55:0/1445176984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1680d0f50 0x7fc16814b7e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc15000e870 tx=0x7fc15000ed30 comp rx=0 tx=0).stop 2023-08-25T04:18:47.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.022+0000 7fc16759e640 1 -- 172.21.15.55:0/1445176984 shutdown_connections 2023-08-25T04:18:47.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.022+0000 7fc16759e640 1 --2- 172.21.15.55:0/1445176984 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fc1480657d0 0x7fc148067c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.022+0000 7fc16759e640 1 --2- 172.21.15.55:0/1445176984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc16815ca50 0x7fc16814bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.022+0000 7fc16759e640 1 --2- 172.21.15.55:0/1445176984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1680d0f50 0x7fc16814b7e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.022+0000 7fc16759e640 1 --2- 172.21.15.55:0/1445176984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc16806c150 0x7fc1680cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.022+0000 7fc16759e640 1 -- 172.21.15.55:0/1445176984 >> 172.21.15.55:0/1445176984 conn(0x7fc168065f40 msgr2=0x7fc16806b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:47.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.022+0000 7fc16759e640 1 -- 172.21.15.55:0/1445176984 shutdown_connections 2023-08-25T04:18:47.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.022+0000 7fc16759e640 1 -- 172.21.15.55:0/1445176984 wait complete. 2023-08-25T04:18:47.031 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:47.034+0000 7fc468c2d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:18:47.040 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:47.037+0000 7faad17d4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:18:47.047 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-25T04:18:47.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:47.048 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-25T04:18:47.112 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T04:18:47.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:18:47.113 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-25T04:18:47.114 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:47.114+0000 7fc468c2d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:18:47.123 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:18:47.123 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:47.132 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:18:47.133 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:18:47.133 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:47.176 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T04:18:47.176 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:18:47.177 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:47.186 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:18:47.187 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:18:47.257 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:47.258+0000 7fc468c2d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:18:47.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.362+0000 7fd94d06d640 1 Processor -- start 2023-08-25T04:18:47.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.362+0000 7fd94d06d640 1 -- start start 2023-08-25T04:18:47.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.366+0000 7fd94d06d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9480d0da0 0x7fd9480d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:47.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.366+0000 7fd94d06d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd9480cdde0 0x7fd9480ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:47.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.366+0000 7fd94d06d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9480cee60 0x7fd9480cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:47.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.366+0000 7fd94d06d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9480ce760 con 0x7fd9480cee60 2023-08-25T04:18:47.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.366+0000 7fd94d06d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9480b29b0 con 0x7fd9480cdde0 2023-08-25T04:18:47.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.366+0000 7fd94d06d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9480d16c0 con 0x7fd9480d0da0 2023-08-25T04:18:47.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.366+0000 7fd94759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9480cee60 0x7fd9480cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:47.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.366+0000 7fd94759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9480cee60 0x7fd9480cf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57648/0 (socket says 172.21.15.55:57648) 2023-08-25T04:18:47.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.366+0000 7fd94759e640 1 -- 172.21.15.55:0/1119231624 learned_addr learned my addr 172.21.15.55:0/1119231624 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:47.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.366+0000 7fd946d9d640 1 --2- 172.21.15.55:0/1119231624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9480d0da0 0x7fd9480d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:47.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.366+0000 7fd93ffff640 1 --2- 172.21.15.55:0/1119231624 >> v2:172.21.15.110:3300/0 conn(0x7fd9480cdde0 0x7fd9480ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:47.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.366+0000 7fd94759e640 1 -- 172.21.15.55:0/1119231624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9480d0da0 msgr2=0x7fd9480d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:47.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.366+0000 7fd94759e640 1 --2- 172.21.15.55:0/1119231624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9480d0da0 0x7fd9480d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.366+0000 7fd94759e640 1 -- 172.21.15.55:0/1119231624 >> v2:172.21.15.110:3300/0 conn(0x7fd9480cdde0 msgr2=0x7fd9480ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:47.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.366+0000 7fd94759e640 1 --2- 172.21.15.55:0/1119231624 >> v2:172.21.15.110:3300/0 conn(0x7fd9480cdde0 0x7fd9480ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.366+0000 7fd94759e640 1 -- 172.21.15.55:0/1119231624 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9480b1dc0 con 0x7fd9480cee60 2023-08-25T04:18:47.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.370+0000 7fd94759e640 1 --2- 172.21.15.55:0/1119231624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9480cee60 0x7fd9480cf2f0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd94809c210 tx=0x7fd94001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb1ea275441a0bc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:47.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.370+0000 7fd94659c640 1 -- 172.21.15.55:0/1119231624 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9400af400 con 0x7fd9480cee60 2023-08-25T04:18:47.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.370+0000 7fd94659c640 1 -- 172.21.15.55:0/1119231624 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9400ab050 con 0x7fd9480cee60 2023-08-25T04:18:47.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.370+0000 7fd94659c640 1 -- 172.21.15.55:0/1119231624 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9400af780 con 0x7fd9480cee60 2023-08-25T04:18:47.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.370+0000 7fd94d06d640 1 -- 172.21.15.55:0/1119231624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9480cee60 msgr2=0x7fd9480cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:47.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.370+0000 7fd94d06d640 1 --2- 172.21.15.55:0/1119231624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9480cee60 0x7fd9480cf2f0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd94809c210 tx=0x7fd94001f1c0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.370+0000 7fd94d06d640 1 -- 172.21.15.55:0/1119231624 shutdown_connections 2023-08-25T04:18:47.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.370+0000 7fd94d06d640 1 --2- 172.21.15.55:0/1119231624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9480cee60 0x7fd9480cf2f0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.370+0000 7fd94d06d640 1 --2- 172.21.15.55:0/1119231624 >> v2:172.21.15.110:3300/0 conn(0x7fd9480cdde0 0x7fd9480ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.370+0000 7fd94d06d640 1 --2- 172.21.15.55:0/1119231624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9480d0da0 0x7fd9480d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.370+0000 7fd94d06d640 1 -- 172.21.15.55:0/1119231624 >> 172.21.15.55:0/1119231624 conn(0x7fd94809bae0 msgr2=0x7fd9480d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:47.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.370+0000 7fd94d06d640 1 -- 172.21.15.55:0/1119231624 shutdown_connections 2023-08-25T04:18:47.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.370+0000 7fd94d06d640 1 -- 172.21.15.55:0/1119231624 wait complete. 2023-08-25T04:18:47.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.370+0000 7fd94d06d640 1 Processor -- start 2023-08-25T04:18:47.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.370+0000 7fd94d06d640 1 -- start start 2023-08-25T04:18:47.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd94d06d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9480cdde0 0x7fd9481f1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:47.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd94d06d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9480cee60 0x7fd9480b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:47.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd94d06d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9480d0da0 0x7fd94806bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:47.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd94d06d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9480c62f0 con 0x7fd9480d0da0 2023-08-25T04:18:47.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd94d06d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9480c6e70 con 0x7fd9480cdde0 2023-08-25T04:18:47.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd94d06d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9480c6540 con 0x7fd9480cee60 2023-08-25T04:18:47.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd94759e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9480d0da0 0x7fd94806bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:47.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd94759e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9480d0da0 0x7fd94806bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57656/0 (socket says 172.21.15.55:57656) 2023-08-25T04:18:47.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd94759e640 1 -- 172.21.15.55:0/756300029 learned_addr learned my addr 172.21.15.55:0/756300029 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:47.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd946d9d640 1 --2- 172.21.15.55:0/756300029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9480cdde0 0x7fd9481f1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:47.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd93ffff640 1 --2- 172.21.15.55:0/756300029 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9480cee60 0x7fd9480b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:47.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd94759e640 1 -- 172.21.15.55:0/756300029 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9480cee60 msgr2=0x7fd9480b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:47.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd94759e640 1 --2- 172.21.15.55:0/756300029 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9480cee60 0x7fd9480b71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd94759e640 1 -- 172.21.15.55:0/756300029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9480cdde0 msgr2=0x7fd9481f1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:47.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd94759e640 1 --2- 172.21.15.55:0/756300029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9480cdde0 0x7fd9481f1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd94759e640 1 -- 172.21.15.55:0/756300029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd940009b30 con 0x7fd9480d0da0 2023-08-25T04:18:47.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd946d9d640 1 --2- 172.21.15.55:0/756300029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9480cdde0 0x7fd9481f1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:47.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd94759e640 1 --2- 172.21.15.55:0/756300029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9480d0da0 0x7fd94806bae0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fd9400b2040 tx=0x7fd94001bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:47.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd93f7fe640 1 -- 172.21.15.55:0/756300029 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9400afc80 con 0x7fd9480d0da0 2023-08-25T04:18:47.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd93f7fe640 1 -- 172.21.15.55:0/756300029 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9400afe00 con 0x7fd9480d0da0 2023-08-25T04:18:47.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd94d06d640 1 -- 172.21.15.55:0/756300029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9480c6820 con 0x7fd9480d0da0 2023-08-25T04:18:47.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd93f7fe640 1 -- 172.21.15.55:0/756300029 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9400b8640 con 0x7fd9480d0da0 2023-08-25T04:18:47.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd94d06d640 1 -- 172.21.15.55:0/756300029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9481f1fd0 con 0x7fd9480d0da0 2023-08-25T04:18:47.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd94d06d640 1 -- 172.21.15.55:0/756300029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9480c6fe0 con 0x7fd9480d0da0 2023-08-25T04:18:47.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.374+0000 7fd93f7fe640 1 -- 172.21.15.55:0/756300029 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 34) v1 ==== 85065+0+0 (secure 0 0 0) 0x7fd9400b6040 con 0x7fd9480d0da0 2023-08-25T04:18:47.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.378+0000 7fd93f7fe640 1 --2- 172.21.15.55:0/756300029 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fd9280657a0 0x7fd928067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:47.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.378+0000 7fd93f7fe640 1 -- 172.21.15.55:0/756300029 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fd940120db0 con 0x7fd9480d0da0 2023-08-25T04:18:47.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.378+0000 7fd946d9d640 1 -- 172.21.15.55:0/756300029 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fd9280657a0 msgr2=0x7fd928067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3289898378 2023-08-25T04:18:47.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.378+0000 7fd946d9d640 1 --2- 172.21.15.55:0/756300029 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fd9280657a0 0x7fd928067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:47.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.382+0000 7fd93f7fe640 1 -- 172.21.15.55:0/756300029 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd9400ee6f0 con 0x7fd9480d0da0 2023-08-25T04:18:47.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.570+0000 7fd94d06d640 1 -- 172.21.15.55:0/756300029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd94804dbe0 con 0x7fd9480d0da0 2023-08-25T04:18:47.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.570+0000 7fd93f7fe640 1 -- 172.21.15.55:0/756300029 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4882 (secure 0 0 0) 0x7fd9400b4020 con 0x7fd9480d0da0 2023-08-25T04:18:47.571 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:47.571 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5915,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1922466113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1922466113},{"type":"v1","addr":"172.21.15.110:6836","nonce":1922466113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6367,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1328842039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1328842039},{"type":"v1","addr":"172.21.15.55:6835","nonce":1328842039}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6385,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/4127792530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":4127792530},{"type":"v1","addr":"172.21.15.110:6837","nonce":4127792530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:18:25.287049+0000","modified":"2023-08-25T04:18:28.905334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/1124967220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1124967220},{"type":"v1","addr":"172.21.15.55:6834","nonce":1124967220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-25T04:18:47.571 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 32 2023-08-25T04:18:47.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.574+0000 7fd94d06d640 1 -- 172.21.15.55:0/756300029 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fd9280657a0 msgr2=0x7fd928067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:47.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.574+0000 7fd94d06d640 1 --2- 172.21.15.55:0/756300029 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fd9280657a0 0x7fd928067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.574+0000 7fd94d06d640 1 -- 172.21.15.55:0/756300029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9480d0da0 msgr2=0x7fd94806bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:47.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.574+0000 7fd94d06d640 1 --2- 172.21.15.55:0/756300029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9480d0da0 0x7fd94806bae0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fd9400b2040 tx=0x7fd94001bf60 comp rx=0 tx=0).stop 2023-08-25T04:18:47.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.574+0000 7fd94d06d640 1 -- 172.21.15.55:0/756300029 shutdown_connections 2023-08-25T04:18:47.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.574+0000 7fd94d06d640 1 --2- 172.21.15.55:0/756300029 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fd9280657a0 0x7fd928067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.574+0000 7fd94d06d640 1 --2- 172.21.15.55:0/756300029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9480d0da0 0x7fd94806bae0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.574+0000 7fd94d06d640 1 --2- 172.21.15.55:0/756300029 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9480cee60 0x7fd9480b71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.574+0000 7fd94d06d640 1 --2- 172.21.15.55:0/756300029 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9480cdde0 0x7fd9481f1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.574+0000 7fd94d06d640 1 -- 172.21.15.55:0/756300029 >> 172.21.15.55:0/756300029 conn(0x7fd94809bae0 msgr2=0x7fd9480b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:47.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.574+0000 7fd94d06d640 1 -- 172.21.15.55:0/756300029 shutdown_connections 2023-08-25T04:18:47.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.574+0000 7fd94d06d640 1 -- 172.21.15.55:0/756300029 wait complete. 2023-08-25T04:18:47.579 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:47.577+0000 7faad17d4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:18:47.593 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:18:47.665 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:47.661+0000 7faad17d4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:18:47.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd344a9c640 1 Processor -- start 2023-08-25T04:18:47.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd344a9c640 1 -- start start 2023-08-25T04:18:47.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd344a9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3400d0da0 0x7fd3400d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:47.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd344a9c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd3400cdde0 0x7fd3400ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:47.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd344a9c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd3400cee60 0x7fd3400cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:47.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd344a9c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3400ce760 con 0x7fd3400cdde0 2023-08-25T04:18:47.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd344a9c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3400b29b0 con 0x7fd3400cee60 2023-08-25T04:18:47.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd344a9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3400d16c0 con 0x7fd3400d0da0 2023-08-25T04:18:47.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd335d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd3400cdde0 0x7fd3400ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:47.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd335d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd3400cdde0 0x7fd3400ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57658/0 (socket says 172.21.15.55:57658) 2023-08-25T04:18:47.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd335d9b640 1 -- 172.21.15.55:0/501816388 learned_addr learned my addr 172.21.15.55:0/501816388 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:47.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd33ed9d640 1 --2- 172.21.15.55:0/501816388 >> v2:172.21.15.110:3300/0 conn(0x7fd3400cee60 0x7fd3400cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:47.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd33e59c640 1 --2- 172.21.15.55:0/501816388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3400d0da0 0x7fd3400d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:47.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd335d9b640 1 -- 172.21.15.55:0/501816388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3400d0da0 msgr2=0x7fd3400d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:47.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd335d9b640 1 --2- 172.21.15.55:0/501816388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3400d0da0 0x7fd3400d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd335d9b640 1 -- 172.21.15.55:0/501816388 >> v2:172.21.15.110:3300/0 conn(0x7fd3400cee60 msgr2=0x7fd3400cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:47.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd335d9b640 1 --2- 172.21.15.55:0/501816388 >> v2:172.21.15.110:3300/0 conn(0x7fd3400cee60 0x7fd3400cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd335d9b640 1 -- 172.21.15.55:0/501816388 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3400b1dc0 con 0x7fd3400cdde0 2023-08-25T04:18:47.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.782+0000 7fd33ed9d640 1 --2- 172.21.15.55:0/501816388 >> v2:172.21.15.110:3300/0 conn(0x7fd3400cee60 0x7fd3400cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:47.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.786+0000 7fd335d9b640 1 --2- 172.21.15.55:0/501816388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3400cdde0 0x7fd3400ce220 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fd3400b1bd0 tx=0x7fd32801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6938dffa8548901 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:47.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.786+0000 7fd33dd9b640 1 -- 172.21.15.55:0/501816388 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3280a89b0 con 0x7fd3400cdde0 2023-08-25T04:18:47.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.786+0000 7fd33dd9b640 1 -- 172.21.15.55:0/501816388 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3280a8b10 con 0x7fd3400cdde0 2023-08-25T04:18:47.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.786+0000 7fd33dd9b640 1 -- 172.21.15.55:0/501816388 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3280a8ea0 con 0x7fd3400cdde0 2023-08-25T04:18:47.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.786+0000 7fd344a9c640 1 -- 172.21.15.55:0/501816388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3400cdde0 msgr2=0x7fd3400ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:47.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.786+0000 7fd344a9c640 1 --2- 172.21.15.55:0/501816388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3400cdde0 0x7fd3400ce220 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fd3400b1bd0 tx=0x7fd32801ecf0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.786+0000 7fd344a9c640 1 -- 172.21.15.55:0/501816388 shutdown_connections 2023-08-25T04:18:47.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.786+0000 7fd344a9c640 1 --2- 172.21.15.55:0/501816388 >> v2:172.21.15.110:3300/0 conn(0x7fd3400cee60 0x7fd3400cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.786+0000 7fd344a9c640 1 --2- 172.21.15.55:0/501816388 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3400cdde0 0x7fd3400ce220 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.786+0000 7fd344a9c640 1 --2- 172.21.15.55:0/501816388 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3400d0da0 0x7fd3400d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.786+0000 7fd344a9c640 1 -- 172.21.15.55:0/501816388 >> 172.21.15.55:0/501816388 conn(0x7fd34009bae0 msgr2=0x7fd3400d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:47.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.786+0000 7fd344a9c640 1 -- 172.21.15.55:0/501816388 shutdown_connections 2023-08-25T04:18:47.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.786+0000 7fd344a9c640 1 -- 172.21.15.55:0/501816388 wait complete. 2023-08-25T04:18:47.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd344a9c640 1 Processor -- start 2023-08-25T04:18:47.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd344a9c640 1 -- start start 2023-08-25T04:18:47.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd344a9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3400cdde0 0x7fd3400cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:47.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd344a9c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3400cee60 0x7fd3400c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:47.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd344a9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3400d0da0 0x7fd3401f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:47.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd344a9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3400cc050 con 0x7fd3400d0da0 2023-08-25T04:18:47.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd344a9c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3400c7c00 con 0x7fd3400cee60 2023-08-25T04:18:47.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd344a9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3401f60c0 con 0x7fd3400cdde0 2023-08-25T04:18:47.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd33ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3400d0da0 0x7fd3401f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:47.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd33e59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3400cdde0 0x7fd3400cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:47.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd33ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3400d0da0 0x7fd3401f5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57664/0 (socket says 172.21.15.55:57664) 2023-08-25T04:18:47.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd33ed9d640 1 -- 172.21.15.55:0/3826563501 learned_addr learned my addr 172.21.15.55:0/3826563501 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:47.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd335d9b640 1 --2- 172.21.15.55:0/3826563501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3400cee60 0x7fd3400c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:47.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd33ed9d640 1 -- 172.21.15.55:0/3826563501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3400cdde0 msgr2=0x7fd3400cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:47.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd33ed9d640 1 --2- 172.21.15.55:0/3826563501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3400cdde0 0x7fd3400cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd33ed9d640 1 -- 172.21.15.55:0/3826563501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3400cee60 msgr2=0x7fd3400c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:47.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd33ed9d640 1 --2- 172.21.15.55:0/3826563501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3400cee60 0x7fd3400c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd33ed9d640 1 -- 172.21.15.55:0/3826563501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd338009420 con 0x7fd3400d0da0 2023-08-25T04:18:47.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd33e59c640 1 --2- 172.21.15.55:0/3826563501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3400cdde0 0x7fd3400cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:47.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd335d9b640 1 --2- 172.21.15.55:0/3826563501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3400cee60 0x7fd3400c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:47.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd33ed9d640 1 --2- 172.21.15.55:0/3826563501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3400d0da0 0x7fd3401f5550 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd33800e860 tx=0x7fd33800ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:47.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd3377fe640 1 -- 172.21.15.55:0/3826563501 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd338004020 con 0x7fd3400d0da0 2023-08-25T04:18:47.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd3377fe640 1 -- 172.21.15.55:0/3826563501 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3380041a0 con 0x7fd3400d0da0 2023-08-25T04:18:47.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd3377fe640 1 -- 172.21.15.55:0/3826563501 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33800c940 con 0x7fd3400d0da0 2023-08-25T04:18:47.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd344a9c640 1 -- 172.21.15.55:0/3826563501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3280094d0 con 0x7fd3400d0da0 2023-08-25T04:18:47.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.790+0000 7fd344a9c640 1 -- 172.21.15.55:0/3826563501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3400c75b0 con 0x7fd3400d0da0 2023-08-25T04:18:47.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.794+0000 7fd344a9c640 1 -- 172.21.15.55:0/3826563501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34004dbe0 con 0x7fd3400d0da0 2023-08-25T04:18:47.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.794+0000 7fd3377fe640 1 -- 172.21.15.55:0/3826563501 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 34) v1 ==== 85065+0+0 (secure 0 0 0) 0x7fd33800caa0 con 0x7fd3400d0da0 2023-08-25T04:18:47.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.794+0000 7fd3377fe640 1 --2- 172.21.15.55:0/3826563501 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fd3200657a0 0x7fd320067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:47.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.794+0000 7fd3377fe640 1 -- 172.21.15.55:0/3826563501 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fd338083400 con 0x7fd3400d0da0 2023-08-25T04:18:47.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.794+0000 7fd33e59c640 1 -- 172.21.15.55:0/3826563501 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fd3200657a0 msgr2=0x7fd320067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3289898378 2023-08-25T04:18:47.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.794+0000 7fd33e59c640 1 --2- 172.21.15.55:0/3826563501 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fd3200657a0 0x7fd320067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:47.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.798+0000 7fd3377fe640 1 -- 172.21.15.55:0/3826563501 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd338050ca0 con 0x7fd3400d0da0 2023-08-25T04:18:47.817 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:47.813+0000 7faad17d4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:18:47.841 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:47.842+0000 7fc468c2d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:18:47.898 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:47.897+0000 7faad17d4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:18:47.933 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:47.934+0000 7fc468c2d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:18:47.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.958+0000 7fd344a9c640 1 -- 172.21.15.55:0/3826563501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3400d0b80 con 0x7fd3400d0da0 2023-08-25T04:18:47.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.962+0000 7fd3377fe640 1 -- 172.21.15.55:0/3826563501 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18813 (secure 0 0 0) 0x7fd3380542c0 con 0x7fd3400d0da0 2023-08-25T04:18:47.960 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:47.960 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":80,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:18:42.450292+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:18:23.823729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-25T04:18:24.273419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3539787169":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/2505659035":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/1748509305":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/584064839":"2023-08-26T04:18:42.450252+0000","172.21.15.110:6833/2283645732":"2023-08-26T04:18:42.450252+0000","172.21.15.110:6832/2283645732":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/3198972450":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/1819842818":"2023-08-26T04:18:42.450252+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:18:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.962+0000 7fd344a9c640 1 -- 172.21.15.55:0/3826563501 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fd3200657a0 msgr2=0x7fd320067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.962+0000 7fd344a9c640 1 --2- 172.21.15.55:0/3826563501 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fd3200657a0 0x7fd320067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.962+0000 7fd344a9c640 1 -- 172.21.15.55:0/3826563501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3400d0da0 msgr2=0x7fd3401f5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.962+0000 7fd344a9c640 1 --2- 172.21.15.55:0/3826563501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3400d0da0 0x7fd3401f5550 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd33800e860 tx=0x7fd33800ed20 comp rx=0 tx=0).stop 2023-08-25T04:18:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.962+0000 7fd344a9c640 1 -- 172.21.15.55:0/3826563501 shutdown_connections 2023-08-25T04:18:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.962+0000 7fd344a9c640 1 --2- 172.21.15.55:0/3826563501 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7fd3200657a0 0x7fd320067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.962+0000 7fd344a9c640 1 --2- 172.21.15.55:0/3826563501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3400d0da0 0x7fd3401f5550 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.962+0000 7fd344a9c640 1 --2- 172.21.15.55:0/3826563501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3400cee60 0x7fd3400c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.962+0000 7fd344a9c640 1 --2- 172.21.15.55:0/3826563501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3400cdde0 0x7fd3400cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.962+0000 7fd344a9c640 1 -- 172.21.15.55:0/3826563501 >> 172.21.15.55:0/3826563501 conn(0x7fd34009bae0 msgr2=0x7fd3400b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.962+0000 7fd344a9c640 1 -- 172.21.15.55:0/3826563501 shutdown_connections 2023-08-25T04:18:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:47.962+0000 7fd344a9c640 1 -- 172.21.15.55:0/3826563501 wait complete. 2023-08-25T04:18:47.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:18:23.823729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:18:24.273419+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:18:47.982 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:18:48.093 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:48.094+0000 7fc468c2d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:18:48.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.130+0000 7f328df44640 1 Processor -- start 2023-08-25T04:18:48.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.130+0000 7f328df44640 1 -- start start 2023-08-25T04:18:48.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.134+0000 7f328df44640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f328815e3c0 0x7f328815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:48.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.134+0000 7f328df44640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32880d1290 0x7f328815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:48.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.134+0000 7f328df44640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32880cd5a0 con 0x7f32881601f0 2023-08-25T04:18:48.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.134+0000 7f328df44640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32880cd880 con 0x7f328815e3c0 2023-08-25T04:18:48.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.134+0000 7f328df44640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32880cdb60 con 0x7f32880d1290 2023-08-25T04:18:48.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.134+0000 7f32877fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f32881601f0 0x7f32880d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33564/0 (socket says 172.21.15.55:33564) 2023-08-25T04:18:48.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.134+0000 7f32877fe640 1 -- 172.21.15.55:0/2654296972 learned_addr learned my addr 172.21.15.55:0/2654296972 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:48.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.134+0000 7f3287fff640 1 --2- 172.21.15.55:0/2654296972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32880d1290 0x7f328815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:48.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.134+0000 7f327ffff640 1 --2- 172.21.15.55:0/2654296972 >> v2:172.21.15.110:3300/0 conn(0x7f328815e3c0 0x7f328815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:48.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.134+0000 7f3286ffd640 1 -- 172.21.15.55:0/2654296972 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528296791 0 0) 0x7f32880cd5a0 con 0x7f32881601f0 2023-08-25T04:18:48.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.134+0000 7f3286ffd640 1 -- 172.21.15.55:0/2654296972 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3274003530 con 0x7f32881601f0 2023-08-25T04:18:48.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.134+0000 7f327ffff640 1 -- 172.21.15.55:0/2654296972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32880d1290 msgr2=0x7f328815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:48.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.134+0000 7f327ffff640 1 --2- 172.21.15.55:0/2654296972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32880d1290 0x7f328815e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.134+0000 7f327ffff640 1 -- 172.21.15.55:0/2654296972 >> v1:172.21.15.55:6789/0 conn(0x7f32881601f0 legacy=0x7f32880d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:48.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.134+0000 7f327ffff640 1 -- 172.21.15.55:0/2654296972 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32880cde40 con 0x7f328815e3c0 2023-08-25T04:18:48.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.134+0000 7f3287fff640 1 --2- 172.21.15.55:0/2654296972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32880d1290 0x7f328815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:48.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.138+0000 7f327ffff640 1 --2- 172.21.15.55:0/2654296972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f328815e3c0 0x7f328815d430 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f32700097c0 tx=0x7f327001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d6a846d828fb692 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:48.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.138+0000 7f3286ffd640 1 -- 172.21.15.55:0/2654296972 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32700a8970 con 0x7f328815e3c0 2023-08-25T04:18:48.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.138+0000 7f3286ffd640 1 -- 172.21.15.55:0/2654296972 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32700a8ad0 con 0x7f328815e3c0 2023-08-25T04:18:48.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.138+0000 7f3286ffd640 1 -- 172.21.15.55:0/2654296972 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32700a8e60 con 0x7f328815e3c0 2023-08-25T04:18:48.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.138+0000 7f328df44640 1 -- 172.21.15.55:0/2654296972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f328815e3c0 msgr2=0x7f328815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:48.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.138+0000 7f328df44640 1 --2- 172.21.15.55:0/2654296972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f328815e3c0 0x7f328815d430 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f32700097c0 tx=0x7f327001ec70 comp rx=0 tx=0).stop 2023-08-25T04:18:48.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.138+0000 7f328df44640 1 -- 172.21.15.55:0/2654296972 shutdown_connections 2023-08-25T04:18:48.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.138+0000 7f328df44640 1 --2- 172.21.15.55:0/2654296972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32880d1290 0x7f328815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.138+0000 7f328df44640 1 --2- 172.21.15.55:0/2654296972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f328815e3c0 0x7f328815d430 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.138+0000 7f328df44640 1 -- 172.21.15.55:0/2654296972 >> 172.21.15.55:0/2654296972 conn(0x7f32880d27d0 msgr2=0x7f32880d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:48.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.138+0000 7f328df44640 1 -- 172.21.15.55:0/2654296972 shutdown_connections 2023-08-25T04:18:48.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.138+0000 7f328df44640 1 -- 172.21.15.55:0/2654296972 wait complete. 2023-08-25T04:18:48.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.138+0000 7f328df44640 1 Processor -- start 2023-08-25T04:18:48.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.138+0000 7f328df44640 1 -- start start 2023-08-25T04:18:48.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.138+0000 7f328df44640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32880d1290 0x7f32880cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:48.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.138+0000 7f328df44640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f328815e3c0 0x7f32881f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:48.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.138+0000 7f328df44640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32881601f0 0x7f32881f3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:48.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f328df44640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32880ccb80 con 0x7f32880d1290 2023-08-25T04:18:48.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f328df44640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32880ca6c0 con 0x7f32881601f0 2023-08-25T04:18:48.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f328df44640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32880ca390 con 0x7f328815e3c0 2023-08-25T04:18:48.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f32877fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32880d1290 0x7f32880cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:48.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f32877fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32880d1290 0x7f32880cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57670/0 (socket says 172.21.15.55:57670) 2023-08-25T04:18:48.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f32877fe640 1 -- 172.21.15.55:0/420325166 learned_addr learned my addr 172.21.15.55:0/420325166 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:48.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f327ffff640 1 --2- 172.21.15.55:0/420325166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f328815e3c0 0x7f32881f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:48.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f3287fff640 1 --2- 172.21.15.55:0/420325166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32881601f0 0x7f32881f3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:48.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f327ffff640 1 -- 172.21.15.55:0/420325166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32881601f0 msgr2=0x7f32881f3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:48.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f327ffff640 1 --2- 172.21.15.55:0/420325166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32881601f0 0x7f32881f3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f327ffff640 1 -- 172.21.15.55:0/420325166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32880d1290 msgr2=0x7f32880cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:48.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f327ffff640 1 --2- 172.21.15.55:0/420325166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32880d1290 0x7f32880cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f327ffff640 1 -- 172.21.15.55:0/420325166 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3280009a70 con 0x7f328815e3c0 2023-08-25T04:18:48.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f32877fe640 1 --2- 172.21.15.55:0/420325166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32880d1290 0x7f32880cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:48.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f327ffff640 1 --2- 172.21.15.55:0/420325166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f328815e3c0 0x7f32881f2060 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f32700af000 tx=0x7f327001ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:48.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f3284ff9640 1 -- 172.21.15.55:0/420325166 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32700bd070 con 0x7f328815e3c0 2023-08-25T04:18:48.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f3284ff9640 1 -- 172.21.15.55:0/420325166 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270006e20 con 0x7f328815e3c0 2023-08-25T04:18:48.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f3284ff9640 1 -- 172.21.15.55:0/420325166 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32700b0de0 con 0x7f328815e3c0 2023-08-25T04:18:48.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f328df44640 1 -- 172.21.15.55:0/420325166 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3270009420 con 0x7f328815e3c0 2023-08-25T04:18:48.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f328df44640 1 -- 172.21.15.55:0/420325166 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32881f2c30 con 0x7f328815e3c0 2023-08-25T04:18:48.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.142+0000 7f328df44640 1 -- 172.21.15.55:0/420325166 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32880b5260 con 0x7f328815e3c0 2023-08-25T04:18:48.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.146+0000 7f3284ff9640 1 -- 172.21.15.55:0/420325166 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 34) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f32700b7040 con 0x7f328815e3c0 2023-08-25T04:18:48.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.146+0000 7f3284ff9640 1 --2- 172.21.15.55:0/420325166 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f32680657d0 0x7f3268067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:48.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.146+0000 7f3284ff9640 1 -- 172.21.15.55:0/420325166 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f32701205b0 con 0x7f328815e3c0 2023-08-25T04:18:48.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.146+0000 7f32877fe640 1 -- 172.21.15.55:0/420325166 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f32680657d0 msgr2=0x7f3268067c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3289898378 2023-08-25T04:18:48.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.146+0000 7f32877fe640 1 --2- 172.21.15.55:0/420325166 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f32680657d0 0x7f3268067c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:18:48.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.154+0000 7f3284ff9640 1 -- 172.21.15.55:0/420325166 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f32700edfc0 con 0x7f328815e3c0 2023-08-25T04:18:48.184 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:48.186+0000 7fc468c2d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:18:48.221 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:48.221+0000 7faad17d4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:18:48.281 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:48.277+0000 7faad17d4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:18:48.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.298+0000 7f3284ff9640 1 -- 172.21.15.55:0/420325166 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mgrmap(e 35) v1 ==== 84673+0+0 (secure 0 0 0) 0x7f32700ee390 con 0x7f328815e3c0 2023-08-25T04:18:48.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.298+0000 7f3284ff9640 1 -- 172.21.15.55:0/420325166 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f32680657d0 msgr2=0x7f3268067c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:18:48.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.298+0000 7f3284ff9640 1 --2- 172.21.15.55:0/420325166 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f32680657d0 0x7f3268067c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.318+0000 7f328df44640 1 -- 172.21.15.55:0/420325166 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3288073ec0 con 0x7f328815e3c0 2023-08-25T04:18:48.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.322+0000 7f3284ff9640 1 -- 172.21.15.55:0/420325166 <== mon.2 v2:172.21.15.110:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f327011dfe0 con 0x7f328815e3c0 2023-08-25T04:18:48.321 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:18:48.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.322+0000 7f328df44640 1 -- 172.21.15.55:0/420325166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f328815e3c0 msgr2=0x7f32881f2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:48.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.322+0000 7f328df44640 1 --2- 172.21.15.55:0/420325166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f328815e3c0 0x7f32881f2060 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f32700af000 tx=0x7f327001ba10 comp rx=0 tx=0).stop 2023-08-25T04:18:48.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.322+0000 7f328df44640 1 -- 172.21.15.55:0/420325166 shutdown_connections 2023-08-25T04:18:48.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.322+0000 7f328df44640 1 --2- 172.21.15.55:0/420325166 >> [v2:172.21.15.110:6832/3289898378,v1:172.21.15.110:6833/3289898378] conn(0x7f32680657d0 0x7f3268067c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.322+0000 7f328df44640 1 --2- 172.21.15.55:0/420325166 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32881601f0 0x7f32881f3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.322+0000 7f328df44640 1 --2- 172.21.15.55:0/420325166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f328815e3c0 0x7f32881f2060 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.322+0000 7f328df44640 1 --2- 172.21.15.55:0/420325166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f32880d1290 0x7f32880cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.322+0000 7f328df44640 1 -- 172.21.15.55:0/420325166 >> 172.21.15.55:0/420325166 conn(0x7f32880d27d0 msgr2=0x7f32880d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:48.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.322+0000 7f328df44640 1 -- 172.21.15.55:0/420325166 shutdown_connections 2023-08-25T04:18:48.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.322+0000 7f328df44640 1 -- 172.21.15.55:0/420325166 wait complete. 2023-08-25T04:18:48.341 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:18:48.355 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:48.353+0000 7faa5de0d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:48.356 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:48.353+0000 7faa5de0d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:48.356 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:48.353+0000 7faa5de0d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:48.356 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:48.353+0000 7faa5de0d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:48.356 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:48.353+0000 7faa5de0d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:48.357 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:48.357+0000 7faa5ae07640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:48.357 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:48.357+0000 7faa5ae07640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:48.358 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:48.357+0000 7faa5ae07640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:48.358 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:48.357+0000 7faa5ae07640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:48.358 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:18:48.357+0000 7faa5ae07640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:18:48.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.494+0000 7f47c8834640 1 Processor -- start 2023-08-25T04:18:48.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.494+0000 7f47c8834640 1 -- start start 2023-08-25T04:18:48.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.494+0000 7f47c8834640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47c415e3c0 0x7f47c415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:48.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.494+0000 7f47c8834640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f47c40d1290 0x7f47c415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:48.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.494+0000 7f47c8834640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47c40cd5a0 con 0x7f47c41601f0 2023-08-25T04:18:48.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.494+0000 7f47c8834640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47c40cd880 con 0x7f47c40d1290 2023-08-25T04:18:48.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.494+0000 7f47c8834640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c40cdb60 con 0x7f47c415e3c0 2023-08-25T04:18:48.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.494+0000 7f47c259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f47c41601f0 0x7f47c40d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33570/0 (socket says 172.21.15.55:33570) 2023-08-25T04:18:48.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.494+0000 7f47c259c640 1 -- 172.21.15.55:0/635124637 learned_addr learned my addr 172.21.15.55:0/635124637 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:48.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.494+0000 7f47c2d9d640 1 --2- 172.21.15.55:0/635124637 >> v2:172.21.15.110:3300/0 conn(0x7f47c40d1290 0x7f47c415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:48.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.494+0000 7f47b9d9b640 1 --2- 172.21.15.55:0/635124637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47c415e3c0 0x7f47c415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:48.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.494+0000 7f47c1d9b640 1 -- 172.21.15.55:0/635124637 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776641306 0 0) 0x7f47c40cd5a0 con 0x7f47c41601f0 2023-08-25T04:18:48.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.494+0000 7f47c1d9b640 1 -- 172.21.15.55:0/635124637 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47b0003530 con 0x7f47c41601f0 2023-08-25T04:18:48.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.494+0000 7f47c2d9d640 1 -- 172.21.15.55:0/635124637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47c415e3c0 msgr2=0x7f47c415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:48.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.494+0000 7f47c2d9d640 1 --2- 172.21.15.55:0/635124637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47c415e3c0 0x7f47c415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.494+0000 7f47c2d9d640 1 -- 172.21.15.55:0/635124637 >> v1:172.21.15.55:6789/0 conn(0x7f47c41601f0 legacy=0x7f47c40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:48.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.494+0000 7f47c2d9d640 1 -- 172.21.15.55:0/635124637 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c40cde40 con 0x7f47c40d1290 2023-08-25T04:18:48.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.502+0000 7f47c2d9d640 1 --2- 172.21.15.55:0/635124637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47c40d1290 0x7f47c415e8a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0097c0 tx=0x7f47bc01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a70beb22e2c75802 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:48.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.502+0000 7f47c1d9b640 1 -- 172.21.15.55:0/635124637 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0a8970 con 0x7f47c40d1290 2023-08-25T04:18:48.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.502+0000 7f47c1d9b640 1 -- 172.21.15.55:0/635124637 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc0a8ad0 con 0x7f47c40d1290 2023-08-25T04:18:48.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.502+0000 7f47c1d9b640 1 -- 172.21.15.55:0/635124637 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0a8e60 con 0x7f47c40d1290 2023-08-25T04:18:48.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.502+0000 7f47c8834640 1 -- 172.21.15.55:0/635124637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47c40d1290 msgr2=0x7f47c415e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:48.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.502+0000 7f47c8834640 1 --2- 172.21.15.55:0/635124637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47c40d1290 0x7f47c415e8a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0097c0 tx=0x7f47bc01ec70 comp rx=0 tx=0).stop 2023-08-25T04:18:48.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.502+0000 7f47c8834640 1 -- 172.21.15.55:0/635124637 shutdown_connections 2023-08-25T04:18:48.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.502+0000 7f47c8834640 1 --2- 172.21.15.55:0/635124637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47c40d1290 0x7f47c415e8a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.502+0000 7f47c8834640 1 --2- 172.21.15.55:0/635124637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47c415e3c0 0x7f47c415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.502+0000 7f47c8834640 1 -- 172.21.15.55:0/635124637 >> 172.21.15.55:0/635124637 conn(0x7f47c40d27d0 msgr2=0x7f47c40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:48.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.502+0000 7f47c8834640 1 -- 172.21.15.55:0/635124637 shutdown_connections 2023-08-25T04:18:48.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.502+0000 7f47c8834640 1 -- 172.21.15.55:0/635124637 wait complete. 2023-08-25T04:18:48.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.502+0000 7f47c8834640 1 Processor -- start 2023-08-25T04:18:48.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.502+0000 7f47c8834640 1 -- start start 2023-08-25T04:18:48.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c8834640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47c40d1290 0x7f47c41588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:48.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c8834640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47c415e3c0 0x7f47c41f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:48.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c8834640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47c41601f0 0x7f47c41f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:48.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c8834640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c40b63e0 con 0x7f47c40d1290 2023-08-25T04:18:48.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c8834640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c40b60b0 con 0x7f47c415e3c0 2023-08-25T04:18:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c8834640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c40c9f70 con 0x7f47c41601f0 2023-08-25T04:18:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47c40d1290 0x7f47c41588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47c40d1290 0x7f47c41588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57676/0 (socket says 172.21.15.55:57676) 2023-08-25T04:18:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c259c640 1 -- 172.21.15.55:0/946517572 learned_addr learned my addr 172.21.15.55:0/946517572 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47b9d9b640 1 --2- 172.21.15.55:0/946517572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47c415e3c0 0x7f47c41f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:48.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c2d9d640 1 --2- 172.21.15.55:0/946517572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47c41601f0 0x7f47c41f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:48.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c259c640 1 -- 172.21.15.55:0/946517572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47c41601f0 msgr2=0x7f47c41f2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:48.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c259c640 1 --2- 172.21.15.55:0/946517572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47c41601f0 0x7f47c41f2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c259c640 1 -- 172.21.15.55:0/946517572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47c415e3c0 msgr2=0x7f47c41f2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:48.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c259c640 1 --2- 172.21.15.55:0/946517572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47c415e3c0 0x7f47c41f2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c259c640 1 -- 172.21.15.55:0/946517572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc009420 con 0x7f47c40d1290 2023-08-25T04:18:48.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c259c640 1 --2- 172.21.15.55:0/946517572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47c40d1290 0x7f47c41588a0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f47b4001270 tx=0x7f47b400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:48.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47bb7fe640 1 -- 172.21.15.55:0/946517572 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b40074e0 con 0x7f47c40d1290 2023-08-25T04:18:48.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47bb7fe640 1 -- 172.21.15.55:0/946517572 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b4007640 con 0x7f47c40d1290 2023-08-25T04:18:48.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47bb7fe640 1 -- 172.21.15.55:0/946517572 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b40059b0 con 0x7f47c40d1290 2023-08-25T04:18:48.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c8834640 1 -- 172.21.15.55:0/946517572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c40ce7c0 con 0x7f47c40d1290 2023-08-25T04:18:48.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c8834640 1 -- 172.21.15.55:0/946517572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c415b3b0 con 0x7f47c40d1290 2023-08-25T04:18:48.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.506+0000 7f47c8834640 1 -- 172.21.15.55:0/946517572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47c4073ec0 con 0x7f47c40d1290 2023-08-25T04:18:48.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.510+0000 7f47bb7fe640 1 -- 172.21.15.55:0/946517572 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 35) v1 ==== 84673+0+0 (secure 0 0 0) 0x7f47b4005b10 con 0x7f47c40d1290 2023-08-25T04:18:48.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.510+0000 7f47bb7fe640 1 -- 172.21.15.55:0/946517572 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f47b40821c0 con 0x7f47c40d1290 2023-08-25T04:18:48.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.514+0000 7f47bb7fe640 1 -- 172.21.15.55:0/946517572 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f47b404fde0 con 0x7f47c40d1290 2023-08-25T04:18:48.537 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:48.538+0000 7fc468c2d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:18:48.602 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:18:48.602+0000 7fc468c2d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:18:48.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.674+0000 7f47c8834640 1 -- 172.21.15.55:0/946517572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f47c40d0040 con 0x7f47c40d1290 2023-08-25T04:18:48.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.674+0000 7f47bb7fe640 1 -- 172.21.15.55:0/946517572 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v81) v1 ==== 92+0+10 (secure 0 0 0) 0x7f47b4053400 con 0x7f47c40d1290 2023-08-25T04:18:48.674 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:18:48.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.674+0000 7f47c8834640 1 -- 172.21.15.55:0/946517572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47c40d1290 msgr2=0x7f47c41588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:48.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.674+0000 7f47c8834640 1 --2- 172.21.15.55:0/946517572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47c40d1290 0x7f47c41588a0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f47b4001270 tx=0x7f47b400c8e0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.678+0000 7f47c8834640 1 -- 172.21.15.55:0/946517572 shutdown_connections 2023-08-25T04:18:48.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.678+0000 7f47c8834640 1 --2- 172.21.15.55:0/946517572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47c41601f0 0x7f47c41f2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.678+0000 7f47c8834640 1 --2- 172.21.15.55:0/946517572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47c415e3c0 0x7f47c41f2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.678+0000 7f47c8834640 1 --2- 172.21.15.55:0/946517572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47c40d1290 0x7f47c41588a0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.678+0000 7f47c8834640 1 -- 172.21.15.55:0/946517572 >> 172.21.15.55:0/946517572 conn(0x7f47c40d27d0 msgr2=0x7f47c406c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:48.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.678+0000 7f47c8834640 1 -- 172.21.15.55:0/946517572 shutdown_connections 2023-08-25T04:18:48.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.678+0000 7f47c8834640 1 -- 172.21.15.55:0/946517572 wait complete. 2023-08-25T04:18:48.695 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:18:48.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.842+0000 7f37c9173640 1 Processor -- start 2023-08-25T04:18:48.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.842+0000 7f37c9173640 1 -- start start 2023-08-25T04:18:48.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.846+0000 7f37c9173640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f37c415fca0 0x7f37c40cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:48.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.846+0000 7f37c9173640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37c40b8330 0x7f37c40cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:48.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.846+0000 7f37c9173640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c40b70c0 con 0x7f37c40d0bd0 2023-08-25T04:18:48.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.846+0000 7f37c9173640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c4160080 con 0x7f37c415fca0 2023-08-25T04:18:48.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.846+0000 7f37c9173640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c40b73a0 con 0x7f37c40b8330 2023-08-25T04:18:48.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.846+0000 7f37c8972640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f37c40d0bd0 0x7f37c40d1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33574/0 (socket says 172.21.15.55:33574) 2023-08-25T04:18:48.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.846+0000 7f37c8972640 1 -- 172.21.15.55:0/1743005555 learned_addr learned my addr 172.21.15.55:0/1743005555 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:48.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.846+0000 7f37c3fff640 1 --2- 172.21.15.55:0/1743005555 >> v2:172.21.15.110:3300/0 conn(0x7f37c415fca0 0x7f37c40cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:48.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.846+0000 7f37bbfff640 1 --2- 172.21.15.55:0/1743005555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37c40b8330 0x7f37c40cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:48.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.846+0000 7f37c37fe640 1 -- 172.21.15.55:0/1743005555 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930484251 0 0) 0x7f37c40b70c0 con 0x7f37c40d0bd0 2023-08-25T04:18:48.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.846+0000 7f37c37fe640 1 -- 172.21.15.55:0/1743005555 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37b0003530 con 0x7f37c40d0bd0 2023-08-25T04:18:48.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.846+0000 7f37c3fff640 1 -- 172.21.15.55:0/1743005555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37c40b8330 msgr2=0x7f37c40cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:48.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.846+0000 7f37c3fff640 1 --2- 172.21.15.55:0/1743005555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37c40b8330 0x7f37c40cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.846+0000 7f37c3fff640 1 -- 172.21.15.55:0/1743005555 >> v1:172.21.15.55:6789/0 conn(0x7f37c40d0bd0 legacy=0x7f37c40d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:48.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.846+0000 7f37c3fff640 1 -- 172.21.15.55:0/1743005555 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c40b7680 con 0x7f37c415fca0 2023-08-25T04:18:48.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.846+0000 7f37bbfff640 1 --2- 172.21.15.55:0/1743005555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37c40b8330 0x7f37c40cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:48.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.850+0000 7f37c3fff640 1 --2- 172.21.15.55:0/1743005555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37c415fca0 0x7f37c40cf580 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f37b40097c0 tx=0x7f37b401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2119f9c3dc51e243 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:48.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.850+0000 7f37c37fe640 1 -- 172.21.15.55:0/1743005555 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b40a8970 con 0x7f37c415fca0 2023-08-25T04:18:48.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.850+0000 7f37c37fe640 1 -- 172.21.15.55:0/1743005555 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b40a8ad0 con 0x7f37c415fca0 2023-08-25T04:18:48.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.850+0000 7f37c37fe640 1 -- 172.21.15.55:0/1743005555 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b40a8e60 con 0x7f37c415fca0 2023-08-25T04:18:48.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.850+0000 7f37c9173640 1 -- 172.21.15.55:0/1743005555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37c415fca0 msgr2=0x7f37c40cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:48.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.850+0000 7f37c9173640 1 --2- 172.21.15.55:0/1743005555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37c415fca0 0x7f37c40cf580 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f37b40097c0 tx=0x7f37b401ec70 comp rx=0 tx=0).stop 2023-08-25T04:18:48.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.850+0000 7f37c9173640 1 -- 172.21.15.55:0/1743005555 shutdown_connections 2023-08-25T04:18:48.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.850+0000 7f37c9173640 1 --2- 172.21.15.55:0/1743005555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37c40b8330 0x7f37c40cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.850+0000 7f37c9173640 1 --2- 172.21.15.55:0/1743005555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37c415fca0 0x7f37c40cf580 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.850+0000 7f37c9173640 1 -- 172.21.15.55:0/1743005555 >> 172.21.15.55:0/1743005555 conn(0x7f37c40658c0 msgr2=0x7f37c4065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:48.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.850+0000 7f37c9173640 1 -- 172.21.15.55:0/1743005555 shutdown_connections 2023-08-25T04:18:48.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.850+0000 7f37c9173640 1 -- 172.21.15.55:0/1743005555 wait complete. 2023-08-25T04:18:48.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.850+0000 7f37c9173640 1 Processor -- start 2023-08-25T04:18:48.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.850+0000 7f37c9173640 1 -- start start 2023-08-25T04:18:48.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c9173640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37c40b8330 0x7f37c41e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:48.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c9173640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37c40d0bd0 0x7f37c41537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:48.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c9173640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37c415fca0 0x7f37c40cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:48.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c9173640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c40cc050 con 0x7f37c40b8330 2023-08-25T04:18:48.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c9173640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c4146230 con 0x7f37c40d0bd0 2023-08-25T04:18:48.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c9173640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c41e5410 con 0x7f37c415fca0 2023-08-25T04:18:48.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37c40b8330 0x7f37c41e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:48.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37c40b8330 0x7f37c41e4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57688/0 (socket says 172.21.15.55:57688) 2023-08-25T04:18:48.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c3fff640 1 -- 172.21.15.55:0/1874051975 learned_addr learned my addr 172.21.15.55:0/1874051975 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:48.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c3fff640 1 -- 172.21.15.55:0/1874051975 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37c415fca0 msgr2=0x7f37c40cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:48.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c3fff640 1 --2- 172.21.15.55:0/1874051975 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37c415fca0 0x7f37c40cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c3fff640 1 -- 172.21.15.55:0/1874051975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37c40d0bd0 msgr2=0x7f37c41537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:48.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c3fff640 1 --2- 172.21.15.55:0/1874051975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37c40d0bd0 0x7f37c41537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:48.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c3fff640 1 -- 172.21.15.55:0/1874051975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac009420 con 0x7f37c40b8330 2023-08-25T04:18:48.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c3fff640 1 --2- 172.21.15.55:0/1874051975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37c40b8330 0x7f37c41e4ed0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f37b401c8a0 tx=0x7f37b401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:48.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c17fa640 1 -- 172.21.15.55:0/1874051975 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b40b0d60 con 0x7f37c40b8330 2023-08-25T04:18:48.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c17fa640 1 -- 172.21.15.55:0/1874051975 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b40b9430 con 0x7f37c40b8330 2023-08-25T04:18:48.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c9173640 1 -- 172.21.15.55:0/1874051975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b4009420 con 0x7f37c40b8330 2023-08-25T04:18:48.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c17fa640 1 -- 172.21.15.55:0/1874051975 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b40b97e0 con 0x7f37c40b8330 2023-08-25T04:18:48.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c9173640 1 -- 172.21.15.55:0/1874051975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c40cba00 con 0x7f37c40b8330 2023-08-25T04:18:48.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c9173640 1 -- 172.21.15.55:0/1874051975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c4073e50 con 0x7f37c40b8330 2023-08-25T04:18:48.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.854+0000 7f37c17fa640 1 -- 172.21.15.55:0/1874051975 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 35) v1 ==== 84673+0+0 (secure 0 0 0) 0x7f37b40b7040 con 0x7f37c40b8330 2023-08-25T04:18:48.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.858+0000 7f37c17fa640 1 -- 172.21.15.55:0/1874051975 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f37b4120740 con 0x7f37c40b8330 2023-08-25T04:18:48.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:48.862+0000 7f37c17fa640 1 -- 172.21.15.55:0/1874051975 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f37b40ee2b0 con 0x7f37c40b8330 2023-08-25T04:18:49.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.022+0000 7f37c9173640 1 -- 172.21.15.55:0/1874051975 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37c415cef0 con 0x7f37c40b8330 2023-08-25T04:18:49.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.022+0000 7f37c17fa640 1 -- 172.21.15.55:0/1874051975 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f37b40f18d0 con 0x7f37c40b8330 2023-08-25T04:18:49.024 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:18:49.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.026+0000 7f37c9173640 1 -- 172.21.15.55:0/1874051975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37c40b8330 msgr2=0x7f37c41e4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:49.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.026+0000 7f37c9173640 1 --2- 172.21.15.55:0/1874051975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37c40b8330 0x7f37c41e4ed0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f37b401c8a0 tx=0x7f37b401ba10 comp rx=0 tx=0).stop 2023-08-25T04:18:49.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.026+0000 7f37c9173640 1 -- 172.21.15.55:0/1874051975 shutdown_connections 2023-08-25T04:18:49.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.026+0000 7f37c9173640 1 --2- 172.21.15.55:0/1874051975 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37c415fca0 0x7f37c40cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.026+0000 7f37c9173640 1 --2- 172.21.15.55:0/1874051975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37c40d0bd0 0x7f37c41537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.026+0000 7f37c9173640 1 --2- 172.21.15.55:0/1874051975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37c40b8330 0x7f37c41e4ed0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.026+0000 7f37c9173640 1 -- 172.21.15.55:0/1874051975 >> 172.21.15.55:0/1874051975 conn(0x7f37c40658c0 msgr2=0x7f37c415ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:49.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.026+0000 7f37c9173640 1 -- 172.21.15.55:0/1874051975 shutdown_connections 2023-08-25T04:18:49.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.026+0000 7f37c9173640 1 -- 172.21.15.55:0/1874051975 wait complete. 2023-08-25T04:18:49.043 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:18:49.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.190+0000 7f899fc9e640 1 Processor -- start 2023-08-25T04:18:49.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.190+0000 7f899fc9e640 1 -- start start 2023-08-25T04:18:49.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.194+0000 7f899fc9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89980c9830 0x7f899809bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:49.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.194+0000 7f899fc9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f899806c020 0x7f89980acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.194+0000 7f899fc9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899815abd0 con 0x7f899815a7f0 2023-08-25T04:18:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.194+0000 7f899fc9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89980c8ab0 con 0x7f89980c9830 2023-08-25T04:18:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.194+0000 7f899fc9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89980c8d50 con 0x7f899806c020 2023-08-25T04:18:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.194+0000 7f899d239640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89980c9830 0x7f899809bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.194+0000 7f899d239640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89980c9830 0x7f899809bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57704/0 (socket says 172.21.15.55:57704) 2023-08-25T04:18:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.194+0000 7f899d239640 1 -- 172.21.15.55:0/267809599 learned_addr learned my addr 172.21.15.55:0/267809599 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.194+0000 7f899e23b640 1 --2- 172.21.15.55:0/267809599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f899806c020 0x7f89980acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.194+0000 7f899d239640 1 -- 172.21.15.55:0/267809599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f899806c020 msgr2=0x7f89980acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.194+0000 7f899d239640 1 --2- 172.21.15.55:0/267809599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f899806c020 0x7f89980acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.194+0000 7f899d239640 1 -- 172.21.15.55:0/267809599 >> v1:172.21.15.55:6789/0 conn(0x7f899815a7f0 legacy=0x7f8998070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.194+0000 7f899d239640 1 -- 172.21.15.55:0/267809599 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89980c9030 con 0x7f89980c9830 2023-08-25T04:18:49.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.194+0000 7f899d239640 1 --2- 172.21.15.55:0/267809599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89980c9830 0x7f899809bde0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f8988009870 tx=0x7f898801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f131fb424c19dbd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:49.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.194+0000 7f899ca38640 1 -- 172.21.15.55:0/267809599 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89880ab620 con 0x7f89980c9830 2023-08-25T04:18:49.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899ca38640 1 -- 172.21.15.55:0/267809599 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89880ab780 con 0x7f89980c9830 2023-08-25T04:18:49.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899ca38640 1 -- 172.21.15.55:0/267809599 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89880abb10 con 0x7f89980c9830 2023-08-25T04:18:49.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899fc9e640 1 -- 172.21.15.55:0/267809599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89980c9830 msgr2=0x7f899809bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:49.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899fc9e640 1 --2- 172.21.15.55:0/267809599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89980c9830 0x7f899809bde0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f8988009870 tx=0x7f898801c510 comp rx=0 tx=0).stop 2023-08-25T04:18:49.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899fc9e640 1 -- 172.21.15.55:0/267809599 shutdown_connections 2023-08-25T04:18:49.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899fc9e640 1 --2- 172.21.15.55:0/267809599 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f899806c020 0x7f89980acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899fc9e640 1 --2- 172.21.15.55:0/267809599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89980c9830 0x7f899809bde0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899fc9e640 1 -- 172.21.15.55:0/267809599 >> 172.21.15.55:0/267809599 conn(0x7f8998069900 msgr2=0x7f8998069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:49.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899fc9e640 1 -- 172.21.15.55:0/267809599 shutdown_connections 2023-08-25T04:18:49.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899fc9e640 1 -- 172.21.15.55:0/267809599 wait complete. 2023-08-25T04:18:49.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899fc9e640 1 Processor -- start 2023-08-25T04:18:49.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899fc9e640 1 -- start start 2023-08-25T04:18:49.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899fc9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f899806c020 0x7f89980c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:49.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899fc9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89980c9830 0x7f899814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:49.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899fc9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f899815a7f0 0x7f899815adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:49.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899fc9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89980c8270 con 0x7f899815a7f0 2023-08-25T04:18:49.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899fc9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8998164630 con 0x7f89980c9830 2023-08-25T04:18:49.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899fc9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8998164910 con 0x7f899806c020 2023-08-25T04:18:49.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899e23b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f899815a7f0 0x7f899815adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:49.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899da3a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f899806c020 0x7f89980c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:49.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899e23b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f899815a7f0 0x7f899815adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57712/0 (socket says 172.21.15.55:57712) 2023-08-25T04:18:49.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.198+0000 7f899e23b640 1 -- 172.21.15.55:0/3400996330 learned_addr learned my addr 172.21.15.55:0/3400996330 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:49.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.202+0000 7f899d239640 1 --2- 172.21.15.55:0/3400996330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89980c9830 0x7f899814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:49.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.202+0000 7f899e23b640 1 -- 172.21.15.55:0/3400996330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f899806c020 msgr2=0x7f89980c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:49.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.202+0000 7f899e23b640 1 --2- 172.21.15.55:0/3400996330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f899806c020 0x7f89980c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.202+0000 7f899e23b640 1 -- 172.21.15.55:0/3400996330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89980c9830 msgr2=0x7f899814ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:49.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.202+0000 7f899e23b640 1 --2- 172.21.15.55:0/3400996330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89980c9830 0x7f899814ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.202+0000 7f899e23b640 1 -- 172.21.15.55:0/3400996330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89880094d0 con 0x7f899815a7f0 2023-08-25T04:18:49.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.202+0000 7f899e23b640 1 --2- 172.21.15.55:0/3400996330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f899815a7f0 0x7f899815adc0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f8990007e30 tx=0x7f899000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:49.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.202+0000 7f898e7fc640 1 -- 172.21.15.55:0/3400996330 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8990014420 con 0x7f899815a7f0 2023-08-25T04:18:49.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.202+0000 7f898e7fc640 1 -- 172.21.15.55:0/3400996330 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89900145a0 con 0x7f899815a7f0 2023-08-25T04:18:49.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.202+0000 7f898e7fc640 1 -- 172.21.15.55:0/3400996330 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8990014950 con 0x7f899815a7f0 2023-08-25T04:18:49.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.202+0000 7f899fc9e640 1 -- 172.21.15.55:0/3400996330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8998164bf0 con 0x7f899815a7f0 2023-08-25T04:18:49.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.202+0000 7f899fc9e640 1 -- 172.21.15.55:0/3400996330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89981651b0 con 0x7f899815a7f0 2023-08-25T04:18:49.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.202+0000 7f899fc9e640 1 -- 172.21.15.55:0/3400996330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899806d5b0 con 0x7f899815a7f0 2023-08-25T04:18:49.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.202+0000 7f898e7fc640 1 -- 172.21.15.55:0/3400996330 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 35) v1 ==== 84673+0+0 (secure 0 0 0) 0x7f8990014ab0 con 0x7f899815a7f0 2023-08-25T04:18:49.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.202+0000 7f898e7fc640 1 -- 172.21.15.55:0/3400996330 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f89900833a0 con 0x7f899815a7f0 2023-08-25T04:18:49.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.206+0000 7f898e7fc640 1 -- 172.21.15.55:0/3400996330 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8990051050 con 0x7f899815a7f0 2023-08-25T04:18:49.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.298+0000 7f898e7fc640 1 -- 172.21.15.55:0/3400996330 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 36) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f8990050b00 con 0x7f899815a7f0 2023-08-25T04:18:49.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.298+0000 7f898e7fc640 1 --2- 172.21.15.55:0/3400996330 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f897c06b440 0x7f897c06d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:49.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.298+0000 7f899da3a640 1 --2- 172.21.15.55:0/3400996330 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f897c06b440 0x7f897c06d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:49.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.302+0000 7f899da3a640 1 --2- 172.21.15.55:0/3400996330 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f897c06b440 0x7f897c06d830 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8994007fd0 tx=0x7f8994009040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:49.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.366+0000 7f899fc9e640 1 -- 172.21.15.55:0/3400996330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89981653a0 con 0x7f899815a7f0 2023-08-25T04:18:49.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.370+0000 7f898e7fc640 1 -- 172.21.15.55:0/3400996330 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f899007f040 con 0x7f899815a7f0 2023-08-25T04:18:49.367 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:18:49.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.370+0000 7f899fc9e640 1 -- 172.21.15.55:0/3400996330 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f897c06b440 msgr2=0x7f897c06d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:49.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.370+0000 7f899fc9e640 1 --2- 172.21.15.55:0/3400996330 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f897c06b440 0x7f897c06d830 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8994007fd0 tx=0x7f8994009040 comp rx=0 tx=0).stop 2023-08-25T04:18:49.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.370+0000 7f899fc9e640 1 -- 172.21.15.55:0/3400996330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f899815a7f0 msgr2=0x7f899815adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:49.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.370+0000 7f899fc9e640 1 --2- 172.21.15.55:0/3400996330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f899815a7f0 0x7f899815adc0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f8990007e30 tx=0x7f899000e4b0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.370+0000 7f899fc9e640 1 -- 172.21.15.55:0/3400996330 shutdown_connections 2023-08-25T04:18:49.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.370+0000 7f899fc9e640 1 --2- 172.21.15.55:0/3400996330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f899815a7f0 0x7f899815adc0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.370+0000 7f899fc9e640 1 --2- 172.21.15.55:0/3400996330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89980c9830 0x7f899814ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.370+0000 7f899fc9e640 1 --2- 172.21.15.55:0/3400996330 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f897c06b440 0x7f897c06d830 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.370+0000 7f899fc9e640 1 --2- 172.21.15.55:0/3400996330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f899806c020 0x7f89980c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.370+0000 7f899fc9e640 1 -- 172.21.15.55:0/3400996330 >> 172.21.15.55:0/3400996330 conn(0x7f8998069900 msgr2=0x7f89980ac320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:49.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.370+0000 7f899fc9e640 1 -- 172.21.15.55:0/3400996330 shutdown_connections 2023-08-25T04:18:49.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.370+0000 7f899fc9e640 1 -- 172.21.15.55:0/3400996330 wait complete. 2023-08-25T04:18:49.389 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:18:49.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.534+0000 7f15023e9640 1 Processor -- start 2023-08-25T04:18:49.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.534+0000 7f15023e9640 1 -- start start 2023-08-25T04:18:49.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.534+0000 7f15023e9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14fc0d0da0 0x7f14fc0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:49.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.534+0000 7f15023e9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14fc0cdde0 0x7f14fc0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:49.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.534+0000 7f15023e9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14fc0b29b0 con 0x7f14fc0cee60 2023-08-25T04:18:49.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.534+0000 7f15023e9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14fc0ce760 con 0x7f14fc0d0da0 2023-08-25T04:18:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.534+0000 7f15023e9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc0d16c0 con 0x7f14fc0cdde0 2023-08-25T04:18:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.534+0000 7f14fbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14fc0d0da0 0x7f14fc0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.534+0000 7f14fbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14fc0d0da0 0x7f14fc0d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57718/0 (socket says 172.21.15.55:57718) 2023-08-25T04:18:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.534+0000 7f14fbfff640 1 -- 172.21.15.55:0/3831787715 learned_addr learned my addr 172.21.15.55:0/3831787715 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.534+0000 7f14fb7fe640 1 --2- 172.21.15.55:0/3831787715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14fc0cdde0 0x7f14fc0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.534+0000 7f1500986640 1 --1- 172.21.15.55:0/3831787715 >> v1:172.21.15.55:6789/0 conn(0x7f14fc0cee60 0x7f14fc0cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33586/0 (socket says 172.21.15.55:33586) 2023-08-25T04:18:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.534+0000 7f14fbfff640 1 -- 172.21.15.55:0/3831787715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14fc0cdde0 msgr2=0x7f14fc0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.534+0000 7f14fbfff640 1 --2- 172.21.15.55:0/3831787715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14fc0cdde0 0x7f14fc0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.534+0000 7f14fbfff640 1 -- 172.21.15.55:0/3831787715 >> v1:172.21.15.55:6789/0 conn(0x7f14fc0cee60 legacy=0x7f14fc0cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.534+0000 7f14fbfff640 1 -- 172.21.15.55:0/3831787715 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc0b1dc0 con 0x7f14fc0d0da0 2023-08-25T04:18:49.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.538+0000 7f14fbfff640 1 --2- 172.21.15.55:0/3831787715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14fc0d0da0 0x7f14fc0d1180 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f14ec006fd0 tx=0x7f14ec01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d9c9aecf294003 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:49.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.538+0000 7f14faffd640 1 -- 172.21.15.55:0/3831787715 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec0a8a10 con 0x7f14fc0d0da0 2023-08-25T04:18:49.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.538+0000 7f14faffd640 1 -- 172.21.15.55:0/3831787715 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ec0a8b70 con 0x7f14fc0d0da0 2023-08-25T04:18:49.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.538+0000 7f14faffd640 1 -- 172.21.15.55:0/3831787715 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec0b0440 con 0x7f14fc0d0da0 2023-08-25T04:18:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.538+0000 7f15023e9640 1 -- 172.21.15.55:0/3831787715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14fc0d0da0 msgr2=0x7f14fc0d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:49.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.538+0000 7f15023e9640 1 --2- 172.21.15.55:0/3831787715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14fc0d0da0 0x7f14fc0d1180 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f14ec006fd0 tx=0x7f14ec01ed10 comp rx=0 tx=0).stop 2023-08-25T04:18:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.538+0000 7f15023e9640 1 -- 172.21.15.55:0/3831787715 shutdown_connections 2023-08-25T04:18:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.538+0000 7f15023e9640 1 --2- 172.21.15.55:0/3831787715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14fc0cdde0 0x7f14fc0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.538+0000 7f15023e9640 1 --2- 172.21.15.55:0/3831787715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14fc0d0da0 0x7f14fc0d1180 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.538+0000 7f15023e9640 1 -- 172.21.15.55:0/3831787715 >> 172.21.15.55:0/3831787715 conn(0x7f14fc09bae0 msgr2=0x7f14fc0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.538+0000 7f15023e9640 1 -- 172.21.15.55:0/3831787715 shutdown_connections 2023-08-25T04:18:49.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.538+0000 7f15023e9640 1 -- 172.21.15.55:0/3831787715 wait complete. 2023-08-25T04:18:49.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f15023e9640 1 Processor -- start 2023-08-25T04:18:49.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f15023e9640 1 -- start start 2023-08-25T04:18:49.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f15023e9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14fc0cdde0 0x7f14fc15b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:49.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f15023e9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14fc0cee60 0x7f14fc1f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:49.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f15023e9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14fc0d0da0 0x7f14fc0b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:49.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f15023e9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc0c91e0 con 0x7f14fc0cdde0 2023-08-25T04:18:49.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f15023e9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc149490 con 0x7f14fc0d0da0 2023-08-25T04:18:49.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f15023e9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc0c8940 con 0x7f14fc0cee60 2023-08-25T04:18:49.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f14fbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14fc0cdde0 0x7f14fc15b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:49.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f14fbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14fc0cdde0 0x7f14fc15b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57730/0 (socket says 172.21.15.55:57730) 2023-08-25T04:18:49.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f14fbfff640 1 -- 172.21.15.55:0/2587511514 learned_addr learned my addr 172.21.15.55:0/2587511514 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:49.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f14fb7fe640 1 --2- 172.21.15.55:0/2587511514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14fc0cee60 0x7f14fc1f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:49.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f1500986640 1 --2- 172.21.15.55:0/2587511514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14fc0d0da0 0x7f14fc0b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:49.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f14fbfff640 1 -- 172.21.15.55:0/2587511514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14fc0cee60 msgr2=0x7f14fc1f1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:49.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f14fbfff640 1 --2- 172.21.15.55:0/2587511514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14fc0cee60 0x7f14fc1f1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f14fbfff640 1 -- 172.21.15.55:0/2587511514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14fc0d0da0 msgr2=0x7f14fc0b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:49.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f14fbfff640 1 --2- 172.21.15.55:0/2587511514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14fc0d0da0 0x7f14fc0b7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f14fbfff640 1 -- 172.21.15.55:0/2587511514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec009480 con 0x7f14fc0cdde0 2023-08-25T04:18:49.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f1500986640 1 --2- 172.21.15.55:0/2587511514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14fc0d0da0 0x7f14fc0b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:49.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f14fbfff640 1 --2- 172.21.15.55:0/2587511514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14fc0cdde0 0x7f14fc15b2e0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f14ec006fd0 tx=0x7f14ec01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:49.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f14f8ff9640 1 -- 172.21.15.55:0/2587511514 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec0be070 con 0x7f14fc0cdde0 2023-08-25T04:18:49.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f14f8ff9640 1 -- 172.21.15.55:0/2587511514 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ec0059a0 con 0x7f14fc0cdde0 2023-08-25T04:18:49.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f14f8ff9640 1 -- 172.21.15.55:0/2587511514 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec005d30 con 0x7f14fc0cdde0 2023-08-25T04:18:49.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f15023e9640 1 -- 172.21.15.55:0/2587511514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14fc0c8c20 con 0x7f14fc0cdde0 2023-08-25T04:18:49.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.542+0000 7f15023e9640 1 -- 172.21.15.55:0/2587511514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14fc0b76c0 con 0x7f14fc0cdde0 2023-08-25T04:18:49.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.546+0000 7f15023e9640 1 -- 172.21.15.55:0/2587511514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14fc0b78b0 con 0x7f14fc0cdde0 2023-08-25T04:18:49.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.546+0000 7f14f8ff9640 1 -- 172.21.15.55:0/2587511514 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 36) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f14ec0b7070 con 0x7f14fc0cdde0 2023-08-25T04:18:49.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.546+0000 7f14f8ff9640 1 --2- 172.21.15.55:0/2587511514 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f14e80654d0 0x7f14e8067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:49.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.546+0000 7f14f8ff9640 1 -- 172.21.15.55:0/2587511514 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f14ec120050 con 0x7f14fc0cdde0 2023-08-25T04:18:49.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.546+0000 7f14fb7fe640 1 --2- 172.21.15.55:0/2587511514 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f14e80654d0 0x7f14e8067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:49.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.546+0000 7f14fb7fe640 1 --2- 172.21.15.55:0/2587511514 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f14e80654d0 0x7f14e8067990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0cddb0 tx=0x7f14f0009190 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:49.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.550+0000 7f14f8ff9640 1 -- 172.21.15.55:0/2587511514 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f14ec0edad0 con 0x7f14fc0cdde0 2023-08-25T04:18:49.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.742+0000 7f15023e9640 1 -- 172.21.15.55:0/2587511514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14fc04dbe0 con 0x7f14fc0cdde0 2023-08-25T04:18:49.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.742+0000 7f14f8ff9640 1 -- 172.21.15.55:0/2587511514 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4882 (secure 0 0 0) 0x7f14ec0f10f0 con 0x7f14fc0cdde0 2023-08-25T04:18:49.744 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:49.744 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5915,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1922466113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1922466113},{"type":"v1","addr":"172.21.15.110:6836","nonce":1922466113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6367,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1328842039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1328842039},{"type":"v1","addr":"172.21.15.55:6835","nonce":1328842039}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6385,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/4127792530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":4127792530},{"type":"v1","addr":"172.21.15.110:6837","nonce":4127792530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:18:25.287049+0000","modified":"2023-08-25T04:18:28.905334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/1124967220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1124967220},{"type":"v1","addr":"172.21.15.55:6834","nonce":1124967220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-25T04:18:49.746 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 32 2023-08-25T04:18:49.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.746+0000 7f15023e9640 1 -- 172.21.15.55:0/2587511514 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f14e80654d0 msgr2=0x7f14e8067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:49.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.746+0000 7f15023e9640 1 --2- 172.21.15.55:0/2587511514 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f14e80654d0 0x7f14e8067990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0cddb0 tx=0x7f14f0009190 comp rx=0 tx=0).stop 2023-08-25T04:18:49.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.746+0000 7f15023e9640 1 -- 172.21.15.55:0/2587511514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14fc0cdde0 msgr2=0x7f14fc15b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:49.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.746+0000 7f15023e9640 1 --2- 172.21.15.55:0/2587511514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14fc0cdde0 0x7f14fc15b2e0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f14ec006fd0 tx=0x7f14ec01bab0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.746+0000 7f15023e9640 1 -- 172.21.15.55:0/2587511514 shutdown_connections 2023-08-25T04:18:49.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.746+0000 7f15023e9640 1 --2- 172.21.15.55:0/2587511514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14fc0d0da0 0x7f14fc0b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.746+0000 7f15023e9640 1 --2- 172.21.15.55:0/2587511514 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f14e80654d0 0x7f14e8067990 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.746+0000 7f15023e9640 1 --2- 172.21.15.55:0/2587511514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14fc0cee60 0x7f14fc1f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.746+0000 7f15023e9640 1 --2- 172.21.15.55:0/2587511514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14fc0cdde0 0x7f14fc15b2e0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.746+0000 7f15023e9640 1 -- 172.21.15.55:0/2587511514 >> 172.21.15.55:0/2587511514 conn(0x7f14fc09bae0 msgr2=0x7f14fc0b2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:49.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.746+0000 7f15023e9640 1 -- 172.21.15.55:0/2587511514 shutdown_connections 2023-08-25T04:18:49.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.746+0000 7f15023e9640 1 -- 172.21.15.55:0/2587511514 wait complete. 2023-08-25T04:18:49.764 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:18:49.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.906+0000 7fd49ce34640 1 Processor -- start 2023-08-25T04:18:49.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.910+0000 7fd49ce34640 1 -- start start 2023-08-25T04:18:49.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.910+0000 7fd49ce34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd49815c9c0 0x7fd498160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:49.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.910+0000 7fd49ce34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4980cfa70 0x7fd498160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:49.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.910+0000 7fd49ce34640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49806eaf0 con 0x7fd498160f90 2023-08-25T04:18:49.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.910+0000 7fd49ce34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49806e530 con 0x7fd49815c9c0 2023-08-25T04:18:49.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.910+0000 7fd49ce34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49806e810 con 0x7fd4980cfa70 2023-08-25T04:18:49.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.910+0000 7fd49659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd49815c9c0 0x7fd498160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:49.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.910+0000 7fd49659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd49815c9c0 0x7fd498160510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57740/0 (socket says 172.21.15.55:57740) 2023-08-25T04:18:49.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.910+0000 7fd49659c640 1 -- 172.21.15.55:0/258420716 learned_addr learned my addr 172.21.15.55:0/258420716 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:49.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.910+0000 7fd48dd9b640 1 --2- 172.21.15.55:0/258420716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4980cfa70 0x7fd498160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:49.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.910+0000 7fd49659c640 1 -- 172.21.15.55:0/258420716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4980cfa70 msgr2=0x7fd498160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:49.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.910+0000 7fd49659c640 1 --2- 172.21.15.55:0/258420716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4980cfa70 0x7fd498160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.910+0000 7fd49659c640 1 -- 172.21.15.55:0/258420716 >> v1:172.21.15.110:6789/0 conn(0x7fd498160f90 legacy=0x7fd4980ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:49.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.910+0000 7fd49659c640 1 -- 172.21.15.55:0/258420716 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49806aab0 con 0x7fd49815c9c0 2023-08-25T04:18:49.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.910+0000 7fd48dd9b640 1 --2- 172.21.15.55:0/258420716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4980cfa70 0x7fd498160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:49.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.914+0000 7fd49659c640 1 --2- 172.21.15.55:0/258420716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd49815c9c0 0x7fd498160510 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd488006fd0 tx=0x7fd48801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e612fa223785db3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:49.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.914+0000 7fd495d9b640 1 -- 172.21.15.55:0/258420716 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4880a7070 con 0x7fd49815c9c0 2023-08-25T04:18:49.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.914+0000 7fd495d9b640 1 -- 172.21.15.55:0/258420716 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4880ab430 con 0x7fd49815c9c0 2023-08-25T04:18:49.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.914+0000 7fd495d9b640 1 -- 172.21.15.55:0/258420716 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4880ab7c0 con 0x7fd49815c9c0 2023-08-25T04:18:49.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.914+0000 7fd49ce34640 1 -- 172.21.15.55:0/258420716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd49815c9c0 msgr2=0x7fd498160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:49.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.914+0000 7fd49ce34640 1 --2- 172.21.15.55:0/258420716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd49815c9c0 0x7fd498160510 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd488006fd0 tx=0x7fd48801c4b0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.914+0000 7fd49ce34640 1 -- 172.21.15.55:0/258420716 shutdown_connections 2023-08-25T04:18:49.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.914+0000 7fd49ce34640 1 --2- 172.21.15.55:0/258420716 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4980cfa70 0x7fd498160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.914+0000 7fd49ce34640 1 --2- 172.21.15.55:0/258420716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd49815c9c0 0x7fd498160510 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.914+0000 7fd49ce34640 1 -- 172.21.15.55:0/258420716 >> 172.21.15.55:0/258420716 conn(0x7fd4980d05a0 msgr2=0x7fd4980d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:49.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.914+0000 7fd49ce34640 1 -- 172.21.15.55:0/258420716 shutdown_connections 2023-08-25T04:18:49.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.914+0000 7fd49ce34640 1 -- 172.21.15.55:0/258420716 wait complete. 2023-08-25T04:18:49.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.914+0000 7fd49ce34640 1 Processor -- start 2023-08-25T04:18:49.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.914+0000 7fd49ce34640 1 -- start start 2023-08-25T04:18:49.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd49ce34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4980cfa70 0x7fd49815d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:49.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd49ce34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd49815c9c0 0x7fd49814b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:49.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd49ce34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd498160f90 0x7fd49815da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:49.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd49ce34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd498153600 con 0x7fd498160f90 2023-08-25T04:18:49.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd49ce34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49814be80 con 0x7fd4980cfa70 2023-08-25T04:18:49.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd49ce34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49815afc0 con 0x7fd49815c9c0 2023-08-25T04:18:49.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd496d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd498160f90 0x7fd49815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:49.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd496d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd498160f90 0x7fd49815da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57744/0 (socket says 172.21.15.55:57744) 2023-08-25T04:18:49.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd496d9d640 1 -- 172.21.15.55:0/3954417720 learned_addr learned my addr 172.21.15.55:0/3954417720 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:49.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd48dd9b640 1 --2- 172.21.15.55:0/3954417720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd49815c9c0 0x7fd49814b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:49.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd49659c640 1 --2- 172.21.15.55:0/3954417720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4980cfa70 0x7fd49815d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:49.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd496d9d640 1 -- 172.21.15.55:0/3954417720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd49815c9c0 msgr2=0x7fd49814b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:49.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd496d9d640 1 --2- 172.21.15.55:0/3954417720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd49815c9c0 0x7fd49814b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd496d9d640 1 -- 172.21.15.55:0/3954417720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4980cfa70 msgr2=0x7fd49815d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:49.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd496d9d640 1 --2- 172.21.15.55:0/3954417720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4980cfa70 0x7fd49815d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:49.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd496d9d640 1 -- 172.21.15.55:0/3954417720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd488009480 con 0x7fd498160f90 2023-08-25T04:18:49.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd496d9d640 1 --2- 172.21.15.55:0/3954417720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd498160f90 0x7fd49815da00 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c780 tx=0x7fd49000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:49.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd48f7fe640 1 -- 172.21.15.55:0/3954417720 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490003d90 con 0x7fd498160f90 2023-08-25T04:18:49.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd48f7fe640 1 -- 172.21.15.55:0/3954417720 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49000ce90 con 0x7fd498160f90 2023-08-25T04:18:49.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd48f7fe640 1 -- 172.21.15.55:0/3954417720 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4900052b0 con 0x7fd498160f90 2023-08-25T04:18:49.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd49ce34640 1 -- 172.21.15.55:0/3954417720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49815b2a0 con 0x7fd498160f90 2023-08-25T04:18:49.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd49ce34640 1 -- 172.21.15.55:0/3954417720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49815d550 con 0x7fd498160f90 2023-08-25T04:18:49.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.918+0000 7fd49ce34640 1 -- 172.21.15.55:0/3954417720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49815b4e0 con 0x7fd498160f90 2023-08-25T04:18:49.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.922+0000 7fd48f7fe640 1 -- 172.21.15.55:0/3954417720 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 36) v1 ==== 84800+0+0 (secure 0 0 0) 0x7fd490005410 con 0x7fd498160f90 2023-08-25T04:18:49.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.922+0000 7fd48f7fe640 1 --2- 172.21.15.55:0/3954417720 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fd4780654d0 0x7fd478067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:49.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.922+0000 7fd48f7fe640 1 -- 172.21.15.55:0/3954417720 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fd4900821b0 con 0x7fd498160f90 2023-08-25T04:18:49.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.922+0000 7fd49659c640 1 --2- 172.21.15.55:0/3954417720 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fd4780654d0 0x7fd478067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:49.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.922+0000 7fd49659c640 1 --2- 172.21.15.55:0/3954417720 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fd4780654d0 0x7fd478067990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd4880af000 tx=0x7fd4880a7000 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:49.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:49.926+0000 7fd48f7fe640 1 -- 172.21.15.55:0/3954417720 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd49004fce0 con 0x7fd498160f90 2023-08-25T04:18:50.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.085+0000 7fd49ce34640 1 -- 172.21.15.55:0/3954417720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd498153060 con 0x7fd498160f90 2023-08-25T04:18:50.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.085+0000 7fd48f7fe640 1 -- 172.21.15.55:0/3954417720 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+19321 (secure 0 0 0) 0x7fd490053300 con 0x7fd498160f90 2023-08-25T04:18:50.086 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:50.086 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":81,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:18:48.288662+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:18:23.823729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-25T04:18:24.273419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3291454703":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/1630782667":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/3809550274":"2023-08-26T04:18:48.288464+0000","172.21.15.110:6832/3289898378":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/3820039496":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/542484536":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/3539787169":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/696687172":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/2505659035":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/1748509305":"2023-08-26T04:18:42.450252+0000","172.21.15.110:6833/3289898378":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/584064839":"2023-08-26T04:18:42.450252+0000","172.21.15.110:6833/2283645732":"2023-08-26T04:18:42.450252+0000","172.21.15.110:6832/2283645732":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/3198972450":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/1819842818":"2023-08-26T04:18:42.450252+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:18:50.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.085+0000 7fd49ce34640 1 -- 172.21.15.55:0/3954417720 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fd4780654d0 msgr2=0x7fd478067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:50.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.085+0000 7fd49ce34640 1 --2- 172.21.15.55:0/3954417720 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fd4780654d0 0x7fd478067990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd4880af000 tx=0x7fd4880a7000 comp rx=0 tx=0).stop 2023-08-25T04:18:50.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.085+0000 7fd49ce34640 1 -- 172.21.15.55:0/3954417720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd498160f90 msgr2=0x7fd49815da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:50.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.085+0000 7fd49ce34640 1 --2- 172.21.15.55:0/3954417720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd498160f90 0x7fd49815da00 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c780 tx=0x7fd49000cc40 comp rx=0 tx=0).stop 2023-08-25T04:18:50.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.089+0000 7fd49ce34640 1 -- 172.21.15.55:0/3954417720 shutdown_connections 2023-08-25T04:18:50.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.089+0000 7fd49ce34640 1 --2- 172.21.15.55:0/3954417720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd498160f90 0x7fd49815da00 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.089+0000 7fd49ce34640 1 --2- 172.21.15.55:0/3954417720 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fd4780654d0 0x7fd478067990 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.089+0000 7fd49ce34640 1 --2- 172.21.15.55:0/3954417720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd49815c9c0 0x7fd49814b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.089+0000 7fd49ce34640 1 --2- 172.21.15.55:0/3954417720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4980cfa70 0x7fd49815d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.089+0000 7fd49ce34640 1 -- 172.21.15.55:0/3954417720 >> 172.21.15.55:0/3954417720 conn(0x7fd4980d05a0 msgr2=0x7fd4980ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:50.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.089+0000 7fd49ce34640 1 -- 172.21.15.55:0/3954417720 shutdown_connections 2023-08-25T04:18:50.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.089+0000 7fd49ce34640 1 -- 172.21.15.55:0/3954417720 wait complete. 2023-08-25T04:18:50.106 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-25T04:18:50.107 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:18:50.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.249+0000 7f99327db640 1 Processor -- start 2023-08-25T04:18:50.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.249+0000 7f99327db640 1 -- start start 2023-08-25T04:18:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.249+0000 7f99327db640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f992c15eba0 0x7f992c0b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.249+0000 7f99327db640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f992c15ef80 0x7f992c0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:50.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.249+0000 7f99327db640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f992c0cece0 0x7f992c0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:50.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.249+0000 7f99327db640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992c0cf170 con 0x7f992c15eba0 2023-08-25T04:18:50.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.249+0000 7f99327db640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992c0ac3a0 con 0x7f992c15ef80 2023-08-25T04:18:50.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.249+0000 7f99327db640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992c0b1390 con 0x7f992c0cece0 2023-08-25T04:18:50.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.253+0000 7f992bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f992c15eba0 0x7f992c0b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:50.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.253+0000 7f992bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f992c15eba0 0x7f992c0b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57752/0 (socket says 172.21.15.55:57752) 2023-08-25T04:18:50.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.253+0000 7f992bfff640 1 -- 172.21.15.55:0/48241951 learned_addr learned my addr 172.21.15.55:0/48241951 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.253+0000 7f9930d78640 1 --2- 172.21.15.55:0/48241951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f992c0cece0 0x7f992c0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.253+0000 7f992b7fe640 1 --2- 172.21.15.55:0/48241951 >> v2:172.21.15.110:3300/0 conn(0x7f992c15ef80 0x7f992c0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.253+0000 7f992bfff640 1 -- 172.21.15.55:0/48241951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f992c0cece0 msgr2=0x7f992c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.253+0000 7f992bfff640 1 --2- 172.21.15.55:0/48241951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f992c0cece0 0x7f992c0cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.253+0000 7f992bfff640 1 -- 172.21.15.55:0/48241951 >> v2:172.21.15.110:3300/0 conn(0x7f992c15ef80 msgr2=0x7f992c0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.253+0000 7f992bfff640 1 --2- 172.21.15.55:0/48241951 >> v2:172.21.15.110:3300/0 conn(0x7f992c15ef80 0x7f992c0ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.253+0000 7f992bfff640 1 -- 172.21.15.55:0/48241951 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c0b1670 con 0x7f992c15eba0 2023-08-25T04:18:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.253+0000 7f992bfff640 1 --2- 172.21.15.55:0/48241951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c15eba0 0x7f992c0b2a40 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f992c0b3470 tx=0x7f991c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547248dd6453c5bf server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:50.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.253+0000 7f992affd640 1 -- 172.21.15.55:0/48241951 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c0ab600 con 0x7f992c15eba0 2023-08-25T04:18:50.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.253+0000 7f992affd640 1 -- 172.21.15.55:0/48241951 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c0a7050 con 0x7f992c15eba0 2023-08-25T04:18:50.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.253+0000 7f992affd640 1 -- 172.21.15.55:0/48241951 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c0ab980 con 0x7f992c15eba0 2023-08-25T04:18:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f99327db640 1 -- 172.21.15.55:0/48241951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c15eba0 msgr2=0x7f992c0b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f99327db640 1 --2- 172.21.15.55:0/48241951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c15eba0 0x7f992c0b2a40 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f992c0b3470 tx=0x7f991c01c210 comp rx=0 tx=0).stop 2023-08-25T04:18:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f99327db640 1 -- 172.21.15.55:0/48241951 shutdown_connections 2023-08-25T04:18:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f99327db640 1 --2- 172.21.15.55:0/48241951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f992c0cece0 0x7f992c0cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f99327db640 1 --2- 172.21.15.55:0/48241951 >> v2:172.21.15.110:3300/0 conn(0x7f992c15ef80 0x7f992c0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f99327db640 1 --2- 172.21.15.55:0/48241951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c15eba0 0x7f992c0b2a40 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f99327db640 1 -- 172.21.15.55:0/48241951 >> 172.21.15.55:0/48241951 conn(0x7f992c069d00 msgr2=0x7f992c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:50.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f99327db640 1 -- 172.21.15.55:0/48241951 shutdown_connections 2023-08-25T04:18:50.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f99327db640 1 -- 172.21.15.55:0/48241951 wait complete. 2023-08-25T04:18:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f99327db640 1 Processor -- start 2023-08-25T04:18:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f99327db640 1 -- start start 2023-08-25T04:18:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f99327db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c0cece0 0x7f992c06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f99327db640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f992c15eba0 0x7f992c164bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f99327db640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f992c15ef80 0x7f992c154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f99327db640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c1f5e10 con 0x7f992c0cece0 2023-08-25T04:18:50.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f99327db640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c1f4f60 con 0x7f992c15ef80 2023-08-25T04:18:50.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f99327db640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992c0b0b30 con 0x7f992c15eba0 2023-08-25T04:18:50.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f992bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c0cece0 0x7f992c06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:50.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f992bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c0cece0 0x7f992c06d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57756/0 (socket says 172.21.15.55:57756) 2023-08-25T04:18:50.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f992bfff640 1 -- 172.21.15.55:0/896491448 learned_addr learned my addr 172.21.15.55:0/896491448 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:50.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f9930d78640 1 --2- 172.21.15.55:0/896491448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f992c15ef80 0x7f992c154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:50.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.257+0000 7f992b7fe640 1 --2- 172.21.15.55:0/896491448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f992c15eba0 0x7f992c164bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:50.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.261+0000 7f992bfff640 1 -- 172.21.15.55:0/896491448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f992c15eba0 msgr2=0x7f992c164bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:50.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.261+0000 7f992bfff640 1 --2- 172.21.15.55:0/896491448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f992c15eba0 0x7f992c164bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.261+0000 7f992bfff640 1 -- 172.21.15.55:0/896491448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f992c15ef80 msgr2=0x7f992c154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.261+0000 7f992bfff640 1 --2- 172.21.15.55:0/896491448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f992c15ef80 0x7f992c154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.261+0000 7f992bfff640 1 -- 172.21.15.55:0/896491448 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c0094d0 con 0x7f992c0cece0 2023-08-25T04:18:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.261+0000 7f9930d78640 1 --2- 172.21.15.55:0/896491448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f992c15ef80 0x7f992c154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.261+0000 7f992bfff640 1 --2- 172.21.15.55:0/896491448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c0cece0 0x7f992c06d2a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f991c0ae040 tx=0x7f991c018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:50.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.261+0000 7f9928ff9640 1 -- 172.21.15.55:0/896491448 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c0abe90 con 0x7f992c0cece0 2023-08-25T04:18:50.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.261+0000 7f9928ff9640 1 -- 172.21.15.55:0/896491448 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c0b4440 con 0x7f992c0cece0 2023-08-25T04:18:50.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.261+0000 7f9928ff9640 1 -- 172.21.15.55:0/896491448 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c0b47d0 con 0x7f992c0cece0 2023-08-25T04:18:50.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.261+0000 7f99327db640 1 -- 172.21.15.55:0/896491448 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992c1f5200 con 0x7f992c0cece0 2023-08-25T04:18:50.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.261+0000 7f99327db640 1 -- 172.21.15.55:0/896491448 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992c1f57c0 con 0x7f992c0cece0 2023-08-25T04:18:50.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.261+0000 7f99327db640 1 -- 172.21.15.55:0/896491448 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f992c04dbe0 con 0x7f992c0cece0 2023-08-25T04:18:50.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.261+0000 7f9928ff9640 1 -- 172.21.15.55:0/896491448 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 36) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f991c0b2070 con 0x7f992c0cece0 2023-08-25T04:18:50.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.261+0000 7f9928ff9640 1 --2- 172.21.15.55:0/896491448 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f99180654d0 0x7f9918067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:50.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.261+0000 7f9928ff9640 1 -- 172.21.15.55:0/896491448 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f991c11caa0 con 0x7f992c0cece0 2023-08-25T04:18:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.261+0000 7f992b7fe640 1 --2- 172.21.15.55:0/896491448 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f99180654d0 0x7f9918067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.265+0000 7f992b7fe640 1 --2- 172.21.15.55:0/896491448 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f99180654d0 0x7f9918067990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f992c094850 tx=0x7f9920008040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.265+0000 7f9928ff9640 1 -- 172.21.15.55:0/896491448 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f991c0ea520 con 0x7f992c0cece0 2023-08-25T04:18:50.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.461+0000 7f99327db640 1 -- 172.21.15.55:0/896491448 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f992c0ccc40 con 0x7f992c0cece0 2023-08-25T04:18:50.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.461+0000 7f9928ff9640 1 -- 172.21.15.55:0/896491448 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4882 (secure 0 0 0) 0x7f991c0b0090 con 0x7f992c0cece0 2023-08-25T04:18:50.461 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:50.462 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5915,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1922466113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1922466113},{"type":"v1","addr":"172.21.15.110:6836","nonce":1922466113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6367,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1328842039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1328842039},{"type":"v1","addr":"172.21.15.55:6835","nonce":1328842039}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6385,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/4127792530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":4127792530},{"type":"v1","addr":"172.21.15.110:6837","nonce":4127792530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:18:25.287049+0000","modified":"2023-08-25T04:18:28.905334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/1124967220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1124967220},{"type":"v1","addr":"172.21.15.55:6834","nonce":1124967220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-25T04:18:50.463 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 32 2023-08-25T04:18:50.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.461+0000 7f99327db640 1 -- 172.21.15.55:0/896491448 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f99180654d0 msgr2=0x7f9918067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:50.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.461+0000 7f99327db640 1 --2- 172.21.15.55:0/896491448 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f99180654d0 0x7f9918067990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f992c094850 tx=0x7f9920008040 comp rx=0 tx=0).stop 2023-08-25T04:18:50.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.461+0000 7f99327db640 1 -- 172.21.15.55:0/896491448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c0cece0 msgr2=0x7f992c06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:50.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.461+0000 7f99327db640 1 --2- 172.21.15.55:0/896491448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c0cece0 0x7f992c06d2a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f991c0ae040 tx=0x7f991c018fb0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.461+0000 7f99327db640 1 -- 172.21.15.55:0/896491448 shutdown_connections 2023-08-25T04:18:50.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.461+0000 7f99327db640 1 --2- 172.21.15.55:0/896491448 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f992c15ef80 0x7f992c154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.461+0000 7f99327db640 1 --2- 172.21.15.55:0/896491448 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f99180654d0 0x7f9918067990 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.461+0000 7f99327db640 1 --2- 172.21.15.55:0/896491448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f992c15eba0 0x7f992c164bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.461+0000 7f99327db640 1 --2- 172.21.15.55:0/896491448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f992c0cece0 0x7f992c06d2a0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.461+0000 7f99327db640 1 -- 172.21.15.55:0/896491448 >> 172.21.15.55:0/896491448 conn(0x7f992c069d00 msgr2=0x7f992c157490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:50.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.461+0000 7f99327db640 1 -- 172.21.15.55:0/896491448 shutdown_connections 2023-08-25T04:18:50.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.461+0000 7f99327db640 1 -- 172.21.15.55:0/896491448 wait complete. 2023-08-25T04:18:50.481 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:18:50.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.625+0000 7f803a6e6640 1 Processor -- start 2023-08-25T04:18:50.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.625+0000 7f803a6e6640 1 -- start start 2023-08-25T04:18:50.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.629+0000 7f803a6e6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80340d0da0 0x7f80340d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:50.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.629+0000 7f803a6e6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80340cdde0 0x7f80340ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:50.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.629+0000 7f803a6e6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f80340cee60 0x7f80340cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:50.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.629+0000 7f803a6e6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80340ce760 con 0x7f80340d0da0 2023-08-25T04:18:50.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.629+0000 7f803a6e6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80340b29b0 con 0x7f80340cee60 2023-08-25T04:18:50.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.629+0000 7f803a6e6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80340d16c0 con 0x7f80340cdde0 2023-08-25T04:18:50.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.629+0000 7f8033fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80340d0da0 0x7f80340d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.629+0000 7f8033fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80340d0da0 0x7f80340d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50600/0 (socket says 172.21.15.55:50600) 2023-08-25T04:18:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.629+0000 7f8033fff640 1 -- 172.21.15.55:0/2599065842 learned_addr learned my addr 172.21.15.55:0/2599065842 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.629+0000 7f8038c83640 1 --2- 172.21.15.55:0/2599065842 >> v2:172.21.15.110:3300/0 conn(0x7f80340cee60 0x7f80340cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.629+0000 7f80337fe640 1 --2- 172.21.15.55:0/2599065842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80340cdde0 0x7f80340ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.629+0000 7f8033fff640 1 -- 172.21.15.55:0/2599065842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80340cdde0 msgr2=0x7f80340ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.629+0000 7f8033fff640 1 --2- 172.21.15.55:0/2599065842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80340cdde0 0x7f80340ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.629+0000 7f8033fff640 1 -- 172.21.15.55:0/2599065842 >> v2:172.21.15.110:3300/0 conn(0x7f80340cee60 msgr2=0x7f80340cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:50.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.629+0000 7f8033fff640 1 --2- 172.21.15.55:0/2599065842 >> v2:172.21.15.110:3300/0 conn(0x7f80340cee60 0x7f80340cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.629+0000 7f8033fff640 1 -- 172.21.15.55:0/2599065842 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80340b1dc0 con 0x7f80340d0da0 2023-08-25T04:18:50.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.633+0000 7f8033fff640 1 --2- 172.21.15.55:0/2599065842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80340d0da0 0x7f80340d1180 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f80340b1bd0 tx=0x7f802401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae15815453685faf server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:50.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.633+0000 7f8032ffd640 1 -- 172.21.15.55:0/2599065842 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80240a89b0 con 0x7f80340d0da0 2023-08-25T04:18:50.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.633+0000 7f8032ffd640 1 -- 172.21.15.55:0/2599065842 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80240a8b10 con 0x7f80340d0da0 2023-08-25T04:18:50.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.633+0000 7f8032ffd640 1 -- 172.21.15.55:0/2599065842 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80240a8ea0 con 0x7f80340d0da0 2023-08-25T04:18:50.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.633+0000 7f803a6e6640 1 -- 172.21.15.55:0/2599065842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80340d0da0 msgr2=0x7f80340d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:50.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.633+0000 7f803a6e6640 1 --2- 172.21.15.55:0/2599065842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80340d0da0 0x7f80340d1180 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f80340b1bd0 tx=0x7f802401ecf0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.633+0000 7f803a6e6640 1 -- 172.21.15.55:0/2599065842 shutdown_connections 2023-08-25T04:18:50.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.633+0000 7f803a6e6640 1 --2- 172.21.15.55:0/2599065842 >> v2:172.21.15.110:3300/0 conn(0x7f80340cee60 0x7f80340cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.633+0000 7f803a6e6640 1 --2- 172.21.15.55:0/2599065842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80340cdde0 0x7f80340ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.633+0000 7f803a6e6640 1 --2- 172.21.15.55:0/2599065842 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80340d0da0 0x7f80340d1180 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.633+0000 7f803a6e6640 1 -- 172.21.15.55:0/2599065842 >> 172.21.15.55:0/2599065842 conn(0x7f803409bae0 msgr2=0x7f80340d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:50.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.633+0000 7f803a6e6640 1 -- 172.21.15.55:0/2599065842 shutdown_connections 2023-08-25T04:18:50.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.633+0000 7f803a6e6640 1 -- 172.21.15.55:0/2599065842 wait complete. 2023-08-25T04:18:50.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.633+0000 7f803a6e6640 1 Processor -- start 2023-08-25T04:18:50.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.633+0000 7f803a6e6640 1 -- start start 2023-08-25T04:18:50.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f803a6e6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80340cdde0 0x7f8034152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:50.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f803a6e6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80340cee60 0x7f80340b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:50.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f803a6e6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80340d0da0 0x7f803415a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:50.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f803a6e6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80340b6460 con 0x7f80340cee60 2023-08-25T04:18:50.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f803a6e6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80340b5920 con 0x7f80340d0da0 2023-08-25T04:18:50.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f803a6e6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80340b5bc0 con 0x7f80340cdde0 2023-08-25T04:18:50.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f80337fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80340cee60 0x7f80340b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:50.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f8033fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80340cdde0 0x7f8034152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:50.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f80337fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80340cee60 0x7f80340b53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50602/0 (socket says 172.21.15.55:50602) 2023-08-25T04:18:50.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f80337fe640 1 -- 172.21.15.55:0/77163758 learned_addr learned my addr 172.21.15.55:0/77163758 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:50.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f8038c83640 1 --2- 172.21.15.55:0/77163758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80340d0da0 0x7f803415a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:50.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f80337fe640 1 -- 172.21.15.55:0/77163758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80340cdde0 msgr2=0x7f8034152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:50.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f80337fe640 1 --2- 172.21.15.55:0/77163758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80340cdde0 0x7f8034152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f80337fe640 1 -- 172.21.15.55:0/77163758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80340d0da0 msgr2=0x7f803415a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:50.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f80337fe640 1 --2- 172.21.15.55:0/77163758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80340d0da0 0x7f803415a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f80337fe640 1 -- 172.21.15.55:0/77163758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8024009480 con 0x7f80340cee60 2023-08-25T04:18:50.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f80337fe640 1 --2- 172.21.15.55:0/77163758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80340cee60 0x7f80340b53e0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f802800e870 tx=0x7f802800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:50.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f8030ff9640 1 -- 172.21.15.55:0/77163758 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802800ee60 con 0x7f80340cee60 2023-08-25T04:18:50.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f8030ff9640 1 -- 172.21.15.55:0/77163758 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802800c940 con 0x7f80340cee60 2023-08-25T04:18:50.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f803a6e6640 1 -- 172.21.15.55:0/77163758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80340b5ea0 con 0x7f80340cee60 2023-08-25T04:18:50.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f8030ff9640 1 -- 172.21.15.55:0/77163758 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802800ccf0 con 0x7f80340cee60 2023-08-25T04:18:50.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f803a6e6640 1 -- 172.21.15.55:0/77163758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80340c6cc0 con 0x7f80340cee60 2023-08-25T04:18:50.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f803a6e6640 1 -- 172.21.15.55:0/77163758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803404dbe0 con 0x7f80340cee60 2023-08-25T04:18:50.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.637+0000 7f8030ff9640 1 -- 172.21.15.55:0/77163758 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 36) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f8028013470 con 0x7f80340cee60 2023-08-25T04:18:50.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.641+0000 7f8030ff9640 1 --2- 172.21.15.55:0/77163758 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f80200654d0 0x7f8020067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:50.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.641+0000 7f8030ff9640 1 -- 172.21.15.55:0/77163758 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f8028082da0 con 0x7f80340cee60 2023-08-25T04:18:50.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.641+0000 7f8033fff640 1 --2- 172.21.15.55:0/77163758 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f80200654d0 0x7f8020067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:50.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.641+0000 7f8033fff640 1 --2- 172.21.15.55:0/77163758 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f80200654d0 0x7f8020067990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f80240b2000 tx=0x7f80240aa070 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:50.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.645+0000 7f8030ff9640 1 -- 172.21.15.55:0/77163758 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f80280508d0 con 0x7f80340cee60 2023-08-25T04:18:50.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.657+0000 7f8030ff9640 1 -- 172.21.15.55:0/77163758 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 37) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f8028050ca0 con 0x7f80340cee60 2023-08-25T04:18:50.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.837+0000 7f803a6e6640 1 -- 172.21.15.55:0/77163758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80340d0b80 con 0x7f80340cee60 2023-08-25T04:18:50.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.837+0000 7f8030ff9640 1 -- 172.21.15.55:0/77163758 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4882 (secure 0 0 0) 0x7f8028054360 con 0x7f80340cee60 2023-08-25T04:18:50.838 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:50.838 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5915,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1922466113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1922466113},{"type":"v1","addr":"172.21.15.110:6836","nonce":1922466113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6367,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1328842039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1328842039},{"type":"v1","addr":"172.21.15.55:6835","nonce":1328842039}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6385,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/4127792530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":4127792530},{"type":"v1","addr":"172.21.15.110:6837","nonce":4127792530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:18:25.287049+0000","modified":"2023-08-25T04:18:28.905334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6780},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6780":{"gid":6780,"name":"a","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6834/1124967220","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1124967220},{"type":"v1","addr":"172.21.15.55:6834","nonce":1124967220}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-08-25T04:18:50.839 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 32 2023-08-25T04:18:50.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.841+0000 7f803a6e6640 1 -- 172.21.15.55:0/77163758 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f80200654d0 msgr2=0x7f8020067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:50.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.841+0000 7f803a6e6640 1 --2- 172.21.15.55:0/77163758 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f80200654d0 0x7f8020067990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f80240b2000 tx=0x7f80240aa070 comp rx=0 tx=0).stop 2023-08-25T04:18:50.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.841+0000 7f803a6e6640 1 -- 172.21.15.55:0/77163758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80340cee60 msgr2=0x7f80340b53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:50.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.841+0000 7f803a6e6640 1 --2- 172.21.15.55:0/77163758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80340cee60 0x7f80340b53e0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f802800e870 tx=0x7f802800ed30 comp rx=0 tx=0).stop 2023-08-25T04:18:50.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.841+0000 7f803a6e6640 1 -- 172.21.15.55:0/77163758 shutdown_connections 2023-08-25T04:18:50.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.841+0000 7f803a6e6640 1 --2- 172.21.15.55:0/77163758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80340d0da0 0x7f803415a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.841+0000 7f803a6e6640 1 --2- 172.21.15.55:0/77163758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80340cee60 0x7f80340b53e0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.841+0000 7f803a6e6640 1 --2- 172.21.15.55:0/77163758 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f80200654d0 0x7f8020067990 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.841+0000 7f803a6e6640 1 --2- 172.21.15.55:0/77163758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80340cdde0 0x7f8034152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:50.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.841+0000 7f803a6e6640 1 -- 172.21.15.55:0/77163758 >> 172.21.15.55:0/77163758 conn(0x7f803409bae0 msgr2=0x7f803406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:50.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.841+0000 7f803a6e6640 1 -- 172.21.15.55:0/77163758 shutdown_connections 2023-08-25T04:18:50.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:50.841+0000 7f803a6e6640 1 -- 172.21.15.55:0/77163758 wait complete. 2023-08-25T04:18:50.859 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:18:51.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.005+0000 7f731b488640 1 Processor -- start 2023-08-25T04:18:51.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.005+0000 7f731b488640 1 -- start start 2023-08-25T04:18:51.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.005+0000 7f731b488640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73140cdde0 0x7f73140ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.005+0000 7f731b488640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73140b29b0 con 0x7f73140b2e40 2023-08-25T04:18:51.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.005+0000 7f731b488640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73140b1dc0 con 0x7f73140d0da0 2023-08-25T04:18:51.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.005+0000 7f731b488640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73140ce760 con 0x7f73140cdde0 2023-08-25T04:18:51.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.005+0000 7f7319a25640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f73140b2e40 0x7f73140b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47966/0 (socket says 172.21.15.55:47966) 2023-08-25T04:18:51.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.005+0000 7f7319a25640 1 -- 172.21.15.55:0/321834468 learned_addr learned my addr 172.21.15.55:0/321834468 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:51.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.005+0000 7f7318a23640 1 --2- 172.21.15.55:0/321834468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73140cdde0 0x7f73140ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.005+0000 7f730bfff640 1 -- 172.21.15.55:0/321834468 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532218258 0 0) 0x7f73140b29b0 con 0x7f73140b2e40 2023-08-25T04:18:51.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.005+0000 7f730bfff640 1 -- 172.21.15.55:0/321834468 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7300003530 con 0x7f73140b2e40 2023-08-25T04:18:51.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.005+0000 7f730bfff640 1 -- 172.21.15.55:0/321834468 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871046112 0 0) 0x7f73140b1dc0 con 0x7f73140d0da0 2023-08-25T04:18:51.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.005+0000 7f730bfff640 1 -- 172.21.15.55:0/321834468 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73140b29b0 con 0x7f73140d0da0 2023-08-25T04:18:51.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.005+0000 7f7318a23640 1 -- 172.21.15.55:0/321834468 >> v1:172.21.15.110:6789/0 conn(0x7f73140d0da0 legacy=0x7f73140d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:51.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.005+0000 7f7318a23640 1 -- 172.21.15.55:0/321834468 >> v1:172.21.15.55:6789/0 conn(0x7f73140b2e40 legacy=0x7f73140b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:51.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.005+0000 7f7318a23640 1 -- 172.21.15.55:0/321834468 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73140b2080 con 0x7f73140cdde0 2023-08-25T04:18:51.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.009+0000 7f7318a23640 1 --2- 172.21.15.55:0/321834468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73140cdde0 0x7f73140ce220 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f73040097f0 tx=0x7f730401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fcebd8b3cc1f193 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:51.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.009+0000 7f730bfff640 1 -- 172.21.15.55:0/321834468 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73040a89b0 con 0x7f73140cdde0 2023-08-25T04:18:51.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.009+0000 7f730bfff640 1 -- 172.21.15.55:0/321834468 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73040a8b10 con 0x7f73140cdde0 2023-08-25T04:18:51.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.009+0000 7f730bfff640 1 -- 172.21.15.55:0/321834468 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73040a8ea0 con 0x7f73140cdde0 2023-08-25T04:18:51.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.009+0000 7f731b488640 1 -- 172.21.15.55:0/321834468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73140cdde0 msgr2=0x7f73140ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:51.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.009+0000 7f731b488640 1 --2- 172.21.15.55:0/321834468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73140cdde0 0x7f73140ce220 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f73040097f0 tx=0x7f730401ecb0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.009+0000 7f731b488640 1 -- 172.21.15.55:0/321834468 shutdown_connections 2023-08-25T04:18:51.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.009+0000 7f731b488640 1 --2- 172.21.15.55:0/321834468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73140cdde0 0x7f73140ce220 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.009+0000 7f731b488640 1 -- 172.21.15.55:0/321834468 >> 172.21.15.55:0/321834468 conn(0x7f731409bae0 msgr2=0x7f73140d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:51.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.009+0000 7f731b488640 1 -- 172.21.15.55:0/321834468 shutdown_connections 2023-08-25T04:18:51.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.009+0000 7f731b488640 1 -- 172.21.15.55:0/321834468 wait complete. 2023-08-25T04:18:51.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f731b488640 1 Processor -- start 2023-08-25T04:18:51.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f731b488640 1 -- start start 2023-08-25T04:18:51.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f731b488640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73140b2e40 0x7f73140cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f731b488640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73140cdde0 0x7f73140cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f731b488640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73140d0da0 0x7f73140c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f731b488640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73140c6700 con 0x7f73140cdde0 2023-08-25T04:18:51.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f731b488640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73140c69a0 con 0x7f73140b2e40 2023-08-25T04:18:51.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f731b488640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73140c6c80 con 0x7f73140d0da0 2023-08-25T04:18:51.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f7318a23640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73140cdde0 0x7f73140cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f7318a23640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73140cdde0 0x7f73140cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50610/0 (socket says 172.21.15.55:50610) 2023-08-25T04:18:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f7318a23640 1 -- 172.21.15.55:0/709859072 learned_addr learned my addr 172.21.15.55:0/709859072 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f7319a25640 1 --2- 172.21.15.55:0/709859072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73140d0da0 0x7f73140c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f7319224640 1 --2- 172.21.15.55:0/709859072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73140b2e40 0x7f73140cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f7318a23640 1 -- 172.21.15.55:0/709859072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73140d0da0 msgr2=0x7f73140c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f7318a23640 1 --2- 172.21.15.55:0/709859072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73140d0da0 0x7f73140c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f7318a23640 1 -- 172.21.15.55:0/709859072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73140b2e40 msgr2=0x7f73140cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f7318a23640 1 --2- 172.21.15.55:0/709859072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73140b2e40 0x7f73140cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f7318a23640 1 -- 172.21.15.55:0/709859072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7304009420 con 0x7f73140cdde0 2023-08-25T04:18:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f7319224640 1 --2- 172.21.15.55:0/709859072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73140b2e40 0x7f73140cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f7318a23640 1 --2- 172.21.15.55:0/709859072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73140cdde0 0x7f73140cb920 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f730401b8c0 tx=0x7f730401ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f7309ffb640 1 -- 172.21.15.55:0/709859072 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73040b0d80 con 0x7f73140cdde0 2023-08-25T04:18:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f7309ffb640 1 -- 172.21.15.55:0/709859072 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73040b9410 con 0x7f73140cdde0 2023-08-25T04:18:51.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f7309ffb640 1 -- 172.21.15.55:0/709859072 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73040b97c0 con 0x7f73140cdde0 2023-08-25T04:18:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f731b488640 1 -- 172.21.15.55:0/709859072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73140c6f60 con 0x7f73140cdde0 2023-08-25T04:18:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f731b488640 1 -- 172.21.15.55:0/709859072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7314151f60 con 0x7f73140cdde0 2023-08-25T04:18:51.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.013+0000 7f731b488640 1 -- 172.21.15.55:0/709859072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731404dbe0 con 0x7f73140cdde0 2023-08-25T04:18:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.017+0000 7f7309ffb640 1 -- 172.21.15.55:0/709859072 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f73040b7040 con 0x7f73140cdde0 2023-08-25T04:18:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.017+0000 7f7309ffb640 1 --2- 172.21.15.55:0/709859072 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f72f8065710 0x7f72f8067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.017+0000 7f7309ffb640 1 -- 172.21.15.55:0/709859072 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f7304120c10 con 0x7f73140cdde0 2023-08-25T04:18:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.017+0000 7f7319224640 1 --2- 172.21.15.55:0/709859072 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f72f8065710 0x7f72f8067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.017+0000 7f7319224640 1 --2- 172.21.15.55:0/709859072 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f72f8065710 0x7f72f8067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7310001240 tx=0x7f7310009040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:51.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.021+0000 7f7309ffb640 1 -- 172.21.15.55:0/709859072 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f73040ee330 con 0x7f73140cdde0 2023-08-25T04:18:51.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.177+0000 7f731b488640 1 -- 172.21.15.55:0/709859072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73140c7410 con 0x7f73140cdde0 2023-08-25T04:18:51.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.181+0000 7f7309ffb640 1 -- 172.21.15.55:0/709859072 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+19321 (secure 0 0 0) 0x7f73040f1950 con 0x7f73140cdde0 2023-08-25T04:18:51.179 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:51.180 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":81,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:18:48.288662+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:18:23.823729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-25T04:18:24.273419+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3291454703":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/1630782667":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/3809550274":"2023-08-26T04:18:48.288464+0000","172.21.15.110:6832/3289898378":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/3820039496":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/542484536":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/3539787169":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/696687172":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/2505659035":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/1748509305":"2023-08-26T04:18:42.450252+0000","172.21.15.110:6833/3289898378":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/584064839":"2023-08-26T04:18:42.450252+0000","172.21.15.110:6833/2283645732":"2023-08-26T04:18:42.450252+0000","172.21.15.110:6832/2283645732":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/3198972450":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/1819842818":"2023-08-26T04:18:42.450252+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:18:51.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.181+0000 7f731b488640 1 -- 172.21.15.55:0/709859072 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f72f8065710 msgr2=0x7f72f8067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:51.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.181+0000 7f731b488640 1 --2- 172.21.15.55:0/709859072 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f72f8065710 0x7f72f8067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7310001240 tx=0x7f7310009040 comp rx=0 tx=0).stop 2023-08-25T04:18:51.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.181+0000 7f731b488640 1 -- 172.21.15.55:0/709859072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73140cdde0 msgr2=0x7f73140cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:51.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.181+0000 7f731b488640 1 --2- 172.21.15.55:0/709859072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73140cdde0 0x7f73140cb920 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f730401b8c0 tx=0x7f730401ba50 comp rx=0 tx=0).stop 2023-08-25T04:18:51.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.181+0000 7f731b488640 1 -- 172.21.15.55:0/709859072 shutdown_connections 2023-08-25T04:18:51.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.181+0000 7f731b488640 1 --2- 172.21.15.55:0/709859072 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f72f8065710 0x7f72f8067bd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.181+0000 7f731b488640 1 --2- 172.21.15.55:0/709859072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73140d0da0 0x7f73140c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.181+0000 7f731b488640 1 --2- 172.21.15.55:0/709859072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73140cdde0 0x7f73140cb920 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.181+0000 7f731b488640 1 --2- 172.21.15.55:0/709859072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73140b2e40 0x7f73140cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.181+0000 7f731b488640 1 -- 172.21.15.55:0/709859072 >> 172.21.15.55:0/709859072 conn(0x7f731409bae0 msgr2=0x7f731415be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:51.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.181+0000 7f731b488640 1 -- 172.21.15.55:0/709859072 shutdown_connections 2023-08-25T04:18:51.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.181+0000 7f731b488640 1 -- 172.21.15.55:0/709859072 wait complete. 2023-08-25T04:18:51.201 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-25T04:18:51.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.345+0000 7feee49ba640 1 Processor -- start 2023-08-25T04:18:51.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.345+0000 7feee49ba640 1 -- start start 2023-08-25T04:18:51.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feee49ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feee00ad950 0x7feee00cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feee49ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feee00c89f0 0x7feee00ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feee49ba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee00b2650 con 0x7feee006c000 2023-08-25T04:18:51.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feee49ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee00b11f0 con 0x7feee00c89f0 2023-08-25T04:18:51.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feee49ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee0159d50 con 0x7feee00ad950 2023-08-25T04:18:51.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeded9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feee006c000 0x7feee015d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47970/0 (socket says 172.21.15.55:47970) 2023-08-25T04:18:51.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeded9d640 1 -- 172.21.15.55:0/1154398245 learned_addr learned my addr 172.21.15.55:0/1154398245 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:51.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feede59c640 1 --2- 172.21.15.55:0/1154398245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feee00ad950 0x7feee00cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feed7fff640 1 --2- 172.21.15.55:0/1154398245 >> v2:172.21.15.110:3300/0 conn(0x7feee00c89f0 0x7feee00ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeddd9b640 1 -- 172.21.15.55:0/1154398245 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386319521 0 0) 0x7feee00b2650 con 0x7feee006c000 2023-08-25T04:18:51.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeddd9b640 1 -- 172.21.15.55:0/1154398245 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feecc003530 con 0x7feee006c000 2023-08-25T04:18:51.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeddd9b640 1 -- 172.21.15.55:0/1154398245 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3365161386 0 0) 0x7feecc003530 con 0x7feee006c000 2023-08-25T04:18:51.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeddd9b640 1 -- 172.21.15.55:0/1154398245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feee00ad950 msgr2=0x7feee00cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:51.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeddd9b640 1 --2- 172.21.15.55:0/1154398245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feee00ad950 0x7feee00cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeddd9b640 1 -- 172.21.15.55:0/1154398245 >> v2:172.21.15.110:3300/0 conn(0x7feee00c89f0 msgr2=0x7feee00ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:51.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeddd9b640 1 --2- 172.21.15.55:0/1154398245 >> v2:172.21.15.110:3300/0 conn(0x7feee00c89f0 0x7feee00ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeddd9b640 1 -- 172.21.15.55:0/1154398245 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee00cc880 con 0x7feee006c000 2023-08-25T04:18:51.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeddd9b640 1 -- 172.21.15.55:0/1154398245 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7feed8001a00 con 0x7feee006c000 2023-08-25T04:18:51.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeddd9b640 1 -- 172.21.15.55:0/1154398245 >> v1:172.21.15.55:6789/0 conn(0x7feee006c000 legacy=0x7feee015d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:51.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeddd9b640 1 --2- 172.21.15.55:0/1154398245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feecc003980 0x7feecc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeddd9b640 1 --2- 172.21.15.55:0/1154398245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feee00ad950 0x7feecc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeddd9b640 1 --2- 172.21.15.55:0/1154398245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc004d10 0x7feecc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeddd9b640 1 -- 172.21.15.55:0/1154398245 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee00b11f0 con 0x7feecc004d10 2023-08-25T04:18:51.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeddd9b640 1 -- 172.21.15.55:0/1154398245 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee0159d50 con 0x7feecc003980 2023-08-25T04:18:51.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeddd9b640 1 -- 172.21.15.55:0/1154398245 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feecc00b990 con 0x7feee00ad950 2023-08-25T04:18:51.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeded9d640 1 --2- 172.21.15.55:0/1154398245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc004d10 0x7feecc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feede59c640 1 --2- 172.21.15.55:0/1154398245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feecc003980 0x7feecc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feed7fff640 1 --2- 172.21.15.55:0/1154398245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feee00ad950 0x7feecc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feede59c640 1 -- 172.21.15.55:0/1154398245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feee00ad950 msgr2=0x7feecc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:51.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feede59c640 1 --2- 172.21.15.55:0/1154398245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feee00ad950 0x7feecc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feede59c640 1 -- 172.21.15.55:0/1154398245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc004d10 msgr2=0x7feecc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:51.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feede59c640 1 --2- 172.21.15.55:0/1154398245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc004d10 0x7feecc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feede59c640 1 -- 172.21.15.55:0/1154398245 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc003530 con 0x7feecc003980 2023-08-25T04:18:51.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feeded9d640 1 --2- 172.21.15.55:0/1154398245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc004d10 0x7feecc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:51.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.349+0000 7feed7fff640 1 --2- 172.21.15.55:0/1154398245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feee00ad950 0x7feecc0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:18:51.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.353+0000 7feede59c640 1 --2- 172.21.15.55:0/1154398245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feecc003980 0x7feecc003da0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7feed000bd80 tx=0x7feed001f3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cbf78b8ca1fef9e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:51.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.353+0000 7feeddd9b640 1 -- 172.21.15.55:0/1154398245 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed00ae5f0 con 0x7feecc003980 2023-08-25T04:18:51.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.353+0000 7feeddd9b640 1 -- 172.21.15.55:0/1154398245 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed00ae750 con 0x7feecc003980 2023-08-25T04:18:51.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.353+0000 7feeddd9b640 1 -- 172.21.15.55:0/1154398245 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed00aeb00 con 0x7feecc003980 2023-08-25T04:18:51.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.353+0000 7feee49ba640 1 -- 172.21.15.55:0/1154398245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feecc003980 msgr2=0x7feecc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:51.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.353+0000 7feee49ba640 1 --2- 172.21.15.55:0/1154398245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feecc003980 0x7feecc003da0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7feed000bd80 tx=0x7feed001f3a0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.353+0000 7feeded9d640 1 -- 172.21.15.55:0/1154398245 reap_dead start 2023-08-25T04:18:51.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.353+0000 7feee49ba640 1 -- 172.21.15.55:0/1154398245 shutdown_connections 2023-08-25T04:18:51.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.353+0000 7feee49ba640 1 -- 172.21.15.55:0/1154398245 >> 172.21.15.55:0/1154398245 conn(0x7feee0069d00 msgr2=0x7feee006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:51.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.353+0000 7feee49ba640 1 -- 172.21.15.55:0/1154398245 shutdown_connections 2023-08-25T04:18:51.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.353+0000 7feee49ba640 1 -- 172.21.15.55:0/1154398245 wait complete. 2023-08-25T04:18:51.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feee49ba640 1 Processor -- start 2023-08-25T04:18:51.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feee49ba640 1 -- start start 2023-08-25T04:18:51.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feee49ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feecc003980 0x7feee0157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feee49ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feee00cb310 0x7feee00cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feee49ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feee00aba70 0x7feee00abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feee49ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee00c4690 con 0x7feee00cb310 2023-08-25T04:18:51.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feee49ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee00cbcd0 con 0x7feecc003980 2023-08-25T04:18:51.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feee49ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee00c2030 con 0x7feee00aba70 2023-08-25T04:18:51.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feed7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feee00cb310 0x7feee00cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feed7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feee00cb310 0x7feee00cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50626/0 (socket says 172.21.15.55:50626) 2023-08-25T04:18:51.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feed7fff640 1 -- 172.21.15.55:0/212602143 learned_addr learned my addr 172.21.15.55:0/212602143 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:51.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feede59c640 1 --2- 172.21.15.55:0/212602143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feecc003980 0x7feee0157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feeded9d640 1 --2- 172.21.15.55:0/212602143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feee00aba70 0x7feee00abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feed7fff640 1 -- 172.21.15.55:0/212602143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feee00aba70 msgr2=0x7feee00abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:51.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feed7fff640 1 --2- 172.21.15.55:0/212602143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feee00aba70 0x7feee00abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feed7fff640 1 -- 172.21.15.55:0/212602143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feecc003980 msgr2=0x7feee0157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:51.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feed7fff640 1 --2- 172.21.15.55:0/212602143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feecc003980 0x7feee0157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feed7fff640 1 -- 172.21.15.55:0/212602143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee00c2310 con 0x7feee00cb310 2023-08-25T04:18:51.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feed7fff640 1 --2- 172.21.15.55:0/212602143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feee00cb310 0x7feee00cb790 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7feec8011ca0 tx=0x7feec800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:51.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feed6ffd640 1 -- 172.21.15.55:0/212602143 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8011cd0 con 0x7feee00cb310 2023-08-25T04:18:51.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feed6ffd640 1 -- 172.21.15.55:0/212602143 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec8011e30 con 0x7feee00cb310 2023-08-25T04:18:51.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feed6ffd640 1 -- 172.21.15.55:0/212602143 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8004240 con 0x7feee00cb310 2023-08-25T04:18:51.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feee49ba640 1 -- 172.21.15.55:0/212602143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee00c25f0 con 0x7feee00cb310 2023-08-25T04:18:51.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.357+0000 7feee49ba640 1 -- 172.21.15.55:0/212602143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee00c59a0 con 0x7feee00cb310 2023-08-25T04:18:51.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.361+0000 7feee49ba640 1 -- 172.21.15.55:0/212602143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee004dbe0 con 0x7feee00cb310 2023-08-25T04:18:51.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.361+0000 7feed6ffd640 1 -- 172.21.15.55:0/212602143 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 85008+0+0 (secure 0 0 0) 0x7feec80043a0 con 0x7feee00cb310 2023-08-25T04:18:51.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.361+0000 7feed6ffd640 1 --2- 172.21.15.55:0/212602143 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7feec0065740 0x7feec0067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.361+0000 7feed6ffd640 1 -- 172.21.15.55:0/212602143 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6750+0+0 (secure 0 0 0) 0x7feec8083720 con 0x7feee00cb310 2023-08-25T04:18:51.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.361+0000 7feede59c640 1 --2- 172.21.15.55:0/212602143 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7feec0065740 0x7feec0067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.361+0000 7feede59c640 1 --2- 172.21.15.55:0/212602143 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7feec0065740 0x7feec0067c00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feed00b2000 tx=0x7feed00046d0 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:51.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.365+0000 7feed6ffd640 1 -- 172.21.15.55:0/212602143 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7feec8050ef0 con 0x7feee00cb310 2023-08-25T04:18:51.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.553+0000 7feee49ba640 1 -- 172.21.15.55:0/212602143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7feee00c2170 con 0x7feee00cb310 2023-08-25T04:18:51.556 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-08-25T04:18:51.553+0000 7f7f18c38640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-25T04:18:51.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.569+0000 7feed6ffd640 1 -- 172.21.15.55:0/212602143 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7feee00c2170 con 0x7feee00cb310 2023-08-25T04:18:51.568 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-25T04:18:51.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.569+0000 7feee49ba640 1 -- 172.21.15.55:0/212602143 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7feec0065740 msgr2=0x7feec0067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:51.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.569+0000 7feee49ba640 1 --2- 172.21.15.55:0/212602143 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7feec0065740 0x7feec0067c00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feed00b2000 tx=0x7feed00046d0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.569+0000 7feee49ba640 1 -- 172.21.15.55:0/212602143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feee00cb310 msgr2=0x7feee00cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:51.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.569+0000 7feee49ba640 1 --2- 172.21.15.55:0/212602143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feee00cb310 0x7feee00cb790 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7feec8011ca0 tx=0x7feec800f610 comp rx=0 tx=0).stop 2023-08-25T04:18:51.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.569+0000 7feee49ba640 1 -- 172.21.15.55:0/212602143 shutdown_connections 2023-08-25T04:18:51.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.569+0000 7feee49ba640 1 --2- 172.21.15.55:0/212602143 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7feec0065740 0x7feec0067c00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.569+0000 7feee49ba640 1 --2- 172.21.15.55:0/212602143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feee00aba70 0x7feee00abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.569+0000 7feee49ba640 1 --2- 172.21.15.55:0/212602143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feee00cb310 0x7feee00cb790 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.569+0000 7feee49ba640 1 --2- 172.21.15.55:0/212602143 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feecc003980 0x7feee0157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.569+0000 7feee49ba640 1 -- 172.21.15.55:0/212602143 >> 172.21.15.55:0/212602143 conn(0x7feee0069d00 msgr2=0x7feee00ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:51.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.569+0000 7feee49ba640 1 -- 172.21.15.55:0/212602143 shutdown_connections 2023-08-25T04:18:51.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.569+0000 7feee49ba640 1 -- 172.21.15.55:0/212602143 wait complete. 2023-08-25T04:18:51.574 INFO:tasks.ceph.mds.a.smithi055.stderr: -3957> 2023-08-25T04:18:30.810+0000 7fd16fafb640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T04:18:51.590 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-25T04:18:51.622 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-08-25T04:18:51.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.737+0000 7f1fac448640 1 Processor -- start 2023-08-25T04:18:51.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.741+0000 7f1fac448640 1 -- start start 2023-08-25T04:18:51.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.741+0000 7f1fac448640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1fa415a7f0 0x7f1fa409bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.741+0000 7f1fac448640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1fa40c9830 0x7f1fa4070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.741+0000 7f1fac448640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa415abd0 con 0x7f1fa406c020 2023-08-25T04:18:51.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.741+0000 7f1fac448640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa40c8ab0 con 0x7f1fa415a7f0 2023-08-25T04:18:51.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.741+0000 7f1fac448640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa40c8d50 con 0x7f1fa40c9830 2023-08-25T04:18:51.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.741+0000 7f1faa1e4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1fa415a7f0 0x7f1fa409bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.741+0000 7f1faa1e4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1fa415a7f0 0x7f1fa409bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50644/0 (socket says 172.21.15.55:50644) 2023-08-25T04:18:51.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.741+0000 7f1faa1e4640 1 -- 172.21.15.55:0/2766871070 learned_addr learned my addr 172.21.15.55:0/2766871070 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:51.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.741+0000 7f1fa99e3640 1 --2- 172.21.15.55:0/2766871070 >> v2:172.21.15.110:3300/0 conn(0x7f1fa40c9830 0x7f1fa4070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.741+0000 7f1faa1e4640 1 -- 172.21.15.55:0/2766871070 >> v2:172.21.15.110:3300/0 conn(0x7f1fa40c9830 msgr2=0x7f1fa4070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:51.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.741+0000 7f1faa1e4640 1 --2- 172.21.15.55:0/2766871070 >> v2:172.21.15.110:3300/0 conn(0x7f1fa40c9830 0x7f1fa4070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.741+0000 7f1faa1e4640 1 -- 172.21.15.55:0/2766871070 >> v1:172.21.15.110:6789/0 conn(0x7f1fa406c020 legacy=0x7f1fa40acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:51.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.741+0000 7f1faa1e4640 1 -- 172.21.15.55:0/2766871070 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa40c9030 con 0x7f1fa415a7f0 2023-08-25T04:18:51.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.741+0000 7f1fa99e3640 1 --2- 172.21.15.55:0/2766871070 >> v2:172.21.15.110:3300/0 conn(0x7f1fa40c9830 0x7f1fa4070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:51.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.745+0000 7f1faa1e4640 1 --2- 172.21.15.55:0/2766871070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa415a7f0 0x7f1fa409bde0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f1fa406d740 tx=0x7f1fa001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc486db5bd174b0e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:51.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.745+0000 7f1fa91e2640 1 -- 172.21.15.55:0/2766871070 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00aa650 con 0x7f1fa415a7f0 2023-08-25T04:18:51.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.745+0000 7f1fa91e2640 1 -- 172.21.15.55:0/2766871070 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa00aa7b0 con 0x7f1fa415a7f0 2023-08-25T04:18:51.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.745+0000 7f1fa91e2640 1 -- 172.21.15.55:0/2766871070 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00aab40 con 0x7f1fa415a7f0 2023-08-25T04:18:51.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.745+0000 7f1fac448640 1 -- 172.21.15.55:0/2766871070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa415a7f0 msgr2=0x7f1fa409bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:51.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.745+0000 7f1fac448640 1 --2- 172.21.15.55:0/2766871070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa415a7f0 0x7f1fa409bde0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f1fa406d740 tx=0x7f1fa001c4d0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.745+0000 7f1fac448640 1 -- 172.21.15.55:0/2766871070 shutdown_connections 2023-08-25T04:18:51.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.745+0000 7f1fac448640 1 --2- 172.21.15.55:0/2766871070 >> v2:172.21.15.110:3300/0 conn(0x7f1fa40c9830 0x7f1fa4070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.745+0000 7f1fac448640 1 --2- 172.21.15.55:0/2766871070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa415a7f0 0x7f1fa409bde0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.745+0000 7f1fac448640 1 -- 172.21.15.55:0/2766871070 >> 172.21.15.55:0/2766871070 conn(0x7f1fa4069900 msgr2=0x7f1fa4069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:51.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.745+0000 7f1fac448640 1 -- 172.21.15.55:0/2766871070 shutdown_connections 2023-08-25T04:18:51.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.745+0000 7f1fac448640 1 -- 172.21.15.55:0/2766871070 wait complete. 2023-08-25T04:18:51.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.745+0000 7f1fac448640 1 Processor -- start 2023-08-25T04:18:51.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.745+0000 7f1fac448640 1 -- start start 2023-08-25T04:18:51.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1fac448640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa406c020 0x7f1fa41f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1fac448640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa40c9830 0x7f1fa4142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1fac448640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa415a7f0 0x7f1fa4142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1fac448640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa40b3090 con 0x7f1fa406c020 2023-08-25T04:18:51.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1fac448640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa41f5e10 con 0x7f1fa415a7f0 2023-08-25T04:18:51.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1fac448640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa40b2510 con 0x7f1fa40c9830 2023-08-25T04:18:51.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1faa1e4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa406c020 0x7f1fa41f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1faa1e4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa406c020 0x7f1fa41f58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50658/0 (socket says 172.21.15.55:50658) 2023-08-25T04:18:51.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1faa1e4640 1 -- 172.21.15.55:0/1639417177 learned_addr learned my addr 172.21.15.55:0/1639417177 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:51.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1faa9e5640 1 --2- 172.21.15.55:0/1639417177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa415a7f0 0x7f1fa4142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1fa99e3640 1 --2- 172.21.15.55:0/1639417177 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa40c9830 0x7f1fa4142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1faa1e4640 1 -- 172.21.15.55:0/1639417177 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa40c9830 msgr2=0x7f1fa4142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:51.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1faa1e4640 1 --2- 172.21.15.55:0/1639417177 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa40c9830 0x7f1fa4142130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1faa1e4640 1 -- 172.21.15.55:0/1639417177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa415a7f0 msgr2=0x7f1fa4142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:51.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1faa1e4640 1 --2- 172.21.15.55:0/1639417177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa415a7f0 0x7f1fa4142670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:51.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1faa1e4640 1 -- 172.21.15.55:0/1639417177 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa0009480 con 0x7f1fa406c020 2023-08-25T04:18:51.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1fa99e3640 1 --2- 172.21.15.55:0/1639417177 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa40c9830 0x7f1fa4142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:51.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1faa1e4640 1 --2- 172.21.15.55:0/1639417177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa406c020 0x7f1fa41f58d0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f1fa001a100 tx=0x7f1fa0019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:51.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1f9affd640 1 -- 172.21.15.55:0/1639417177 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00aa650 con 0x7f1fa406c020 2023-08-25T04:18:51.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1f9affd640 1 -- 172.21.15.55:0/1639417177 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa00aad50 con 0x7f1fa406c020 2023-08-25T04:18:51.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1f9affd640 1 -- 172.21.15.55:0/1639417177 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0005be0 con 0x7f1fa406c020 2023-08-25T04:18:51.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1fac448640 1 -- 172.21.15.55:0/1639417177 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa40adc90 con 0x7f1fa406c020 2023-08-25T04:18:51.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1fac448640 1 -- 172.21.15.55:0/1639417177 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa40b2ad0 con 0x7f1fa406c020 2023-08-25T04:18:51.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.749+0000 7f1fac448640 1 -- 172.21.15.55:0/1639417177 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa406d5b0 con 0x7f1fa406c020 2023-08-25T04:18:51.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.753+0000 7f1f9affd640 1 -- 172.21.15.55:0/1639417177 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 37) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f1fa0003620 con 0x7f1fa406c020 2023-08-25T04:18:51.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.753+0000 7f1f9affd640 1 --2- 172.21.15.55:0/1639417177 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f1f88065710 0x7f1f88067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:51.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.753+0000 7f1f9affd640 1 -- 172.21.15.55:0/1639417177 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f1fa011d0d0 con 0x7f1fa406c020 2023-08-25T04:18:51.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.753+0000 7f1fa99e3640 1 --2- 172.21.15.55:0/1639417177 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f1f88065710 0x7f1f88067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:51.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.753+0000 7f1fa99e3640 1 --2- 172.21.15.55:0/1639417177 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f1f88065710 0x7f1f88067bd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1fa41f9490 tx=0x7f1f94008040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:51.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.757+0000 7f1f9affd640 1 -- 172.21.15.55:0/1639417177 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1fa00ea810 con 0x7f1fa406c020 2023-08-25T04:18:51.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:51.949+0000 7f1fac448640 1 -- 172.21.15.55:0/1639417177 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1fa40c5520 con 0x7f1fa406c020 2023-08-25T04:18:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.565+0000 7f1f9affd640 1 -- 172.21.15.55:0/1639417177 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1fa00ede30 con 0x7f1fa406c020 2023-08-25T04:18:52.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.569+0000 7f1fac448640 1 -- 172.21.15.55:0/1639417177 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f1f88065710 msgr2=0x7f1f88067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:52.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.569+0000 7f1fac448640 1 --2- 172.21.15.55:0/1639417177 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f1f88065710 0x7f1f88067bd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1fa41f9490 tx=0x7f1f94008040 comp rx=0 tx=0).stop 2023-08-25T04:18:52.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.569+0000 7f1fac448640 1 -- 172.21.15.55:0/1639417177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa406c020 msgr2=0x7f1fa41f58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:52.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.569+0000 7f1fac448640 1 --2- 172.21.15.55:0/1639417177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa406c020 0x7f1fa41f58d0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f1fa001a100 tx=0x7f1fa0019270 comp rx=0 tx=0).stop 2023-08-25T04:18:52.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.569+0000 7f1fac448640 1 -- 172.21.15.55:0/1639417177 shutdown_connections 2023-08-25T04:18:52.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.569+0000 7f1fac448640 1 --2- 172.21.15.55:0/1639417177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa415a7f0 0x7f1fa4142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:52.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.569+0000 7f1fac448640 1 --2- 172.21.15.55:0/1639417177 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f1f88065710 0x7f1f88067bd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:52.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.569+0000 7f1fac448640 1 --2- 172.21.15.55:0/1639417177 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa40c9830 0x7f1fa4142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:52.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.569+0000 7f1fac448640 1 --2- 172.21.15.55:0/1639417177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa406c020 0x7f1fa41f58d0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:52.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.569+0000 7f1fac448640 1 -- 172.21.15.55:0/1639417177 >> 172.21.15.55:0/1639417177 conn(0x7f1fa4069900 msgr2=0x7f1fa4159550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:52.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.569+0000 7f1fac448640 1 -- 172.21.15.55:0/1639417177 shutdown_connections 2023-08-25T04:18:52.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.569+0000 7f1fac448640 1 -- 172.21.15.55:0/1639417177 wait complete. 2023-08-25T04:18:52.592 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-25T04:18:52.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.789+0000 7f1a88688640 1 Processor -- start 2023-08-25T04:18:52.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.789+0000 7f1a88688640 1 -- start start 2023-08-25T04:18:52.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.789+0000 7f1a88688640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1a80155360 0x7f1a8015c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:52.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.789+0000 7f1a88688640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1a80155740 0x7f1a8015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:52.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.789+0000 7f1a88688640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8015fa50 con 0x7f1a8006fb50 2023-08-25T04:18:52.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.789+0000 7f1a88688640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8015f490 con 0x7f1a80155360 2023-08-25T04:18:52.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.789+0000 7f1a88688640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8015f770 con 0x7f1a80155740 2023-08-25T04:18:52.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.789+0000 7f1a86424640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1a80155360 0x7f1a8015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:52.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.789+0000 7f1a86c25640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1a8006fb50 0x7f1a800aff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47984/0 (socket says 172.21.15.55:47984) 2023-08-25T04:18:52.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.789+0000 7f1a86c25640 1 -- 172.21.15.55:0/1278960389 learned_addr learned my addr 172.21.15.55:0/1278960389 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:52.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.789+0000 7f1a85c23640 1 --2- 172.21.15.55:0/1278960389 >> v2:172.21.15.110:3300/0 conn(0x7f1a80155740 0x7f1a8015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:52.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.789+0000 7f1a86424640 1 -- 172.21.15.55:0/1278960389 >> v2:172.21.15.110:3300/0 conn(0x7f1a80155740 msgr2=0x7f1a8015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:52.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.789+0000 7f1a86424640 1 --2- 172.21.15.55:0/1278960389 >> v2:172.21.15.110:3300/0 conn(0x7f1a80155740 0x7f1a8015eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:52.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.789+0000 7f1a86424640 1 -- 172.21.15.55:0/1278960389 >> v1:172.21.15.55:6789/0 conn(0x7f1a8006fb50 legacy=0x7f1a800aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:52.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.789+0000 7f1a86424640 1 -- 172.21.15.55:0/1278960389 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a800ccb40 con 0x7f1a80155360 2023-08-25T04:18:52.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.789+0000 7f1a85422640 1 -- 172.21.15.55:0/1278960389 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818644089 0 0) 0x7f1a8015fa50 con 0x7f1a8006fb50 2023-08-25T04:18:52.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.793+0000 7f1a86424640 1 --2- 172.21.15.55:0/1278960389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a80155360 0x7f1a8015c180 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f1a800b0fe0 tx=0x7f1a7c01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8846de5c2847b1ec server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:52.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.793+0000 7f1a85422640 1 -- 172.21.15.55:0/1278960389 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c0ab600 con 0x7f1a80155360 2023-08-25T04:18:52.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.793+0000 7f1a85422640 1 -- 172.21.15.55:0/1278960389 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7c0a7050 con 0x7f1a80155360 2023-08-25T04:18:52.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.793+0000 7f1a85422640 1 -- 172.21.15.55:0/1278960389 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c0ab980 con 0x7f1a80155360 2023-08-25T04:18:52.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.793+0000 7f1a88688640 1 -- 172.21.15.55:0/1278960389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a80155360 msgr2=0x7f1a8015c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:52.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.793+0000 7f1a88688640 1 --2- 172.21.15.55:0/1278960389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a80155360 0x7f1a8015c180 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f1a800b0fe0 tx=0x7f1a7c01c340 comp rx=0 tx=0).stop 2023-08-25T04:18:52.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.793+0000 7f1a88688640 1 -- 172.21.15.55:0/1278960389 shutdown_connections 2023-08-25T04:18:52.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.793+0000 7f1a88688640 1 --2- 172.21.15.55:0/1278960389 >> v2:172.21.15.110:3300/0 conn(0x7f1a80155740 0x7f1a8015eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:52.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.793+0000 7f1a88688640 1 --2- 172.21.15.55:0/1278960389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a80155360 0x7f1a8015c180 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:52.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.793+0000 7f1a88688640 1 -- 172.21.15.55:0/1278960389 >> 172.21.15.55:0/1278960389 conn(0x7f1a800caf90 msgr2=0x7f1a800cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:52.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.793+0000 7f1a88688640 1 -- 172.21.15.55:0/1278960389 shutdown_connections 2023-08-25T04:18:52.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.793+0000 7f1a88688640 1 -- 172.21.15.55:0/1278960389 wait complete. 2023-08-25T04:18:52.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a88688640 1 Processor -- start 2023-08-25T04:18:52.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a88688640 1 -- start start 2023-08-25T04:18:52.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a88688640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a8006fb50 0x7f1a800acc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:52.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a88688640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a80155360 0x7f1a800af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:52.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a88688640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a80155740 0x7f1a800afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:52.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a88688640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a801564e0 con 0x7f1a80155740 2023-08-25T04:18:52.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a88688640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a80155bd0 con 0x7f1a8006fb50 2023-08-25T04:18:52.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a88688640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800c87c0 con 0x7f1a80155360 2023-08-25T04:18:52.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a86c25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a80155740 0x7f1a800afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:52.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a86c25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a80155740 0x7f1a800afd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50678/0 (socket says 172.21.15.55:50678) 2023-08-25T04:18:52.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a86c25640 1 -- 172.21.15.55:0/3158841508 learned_addr learned my addr 172.21.15.55:0/3158841508 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:52.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a86424640 1 --2- 172.21.15.55:0/3158841508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a8006fb50 0x7f1a800acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:52.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a85c23640 1 --2- 172.21.15.55:0/3158841508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a80155360 0x7f1a800af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:52.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a86c25640 1 -- 172.21.15.55:0/3158841508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a80155360 msgr2=0x7f1a800af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:52.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a86c25640 1 --2- 172.21.15.55:0/3158841508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a80155360 0x7f1a800af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:52.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a86c25640 1 -- 172.21.15.55:0/3158841508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a8006fb50 msgr2=0x7f1a800acc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:52.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a86c25640 1 --2- 172.21.15.55:0/3158841508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a8006fb50 0x7f1a800acc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:52.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a86c25640 1 -- 172.21.15.55:0/3158841508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c009420 con 0x7f1a80155740 2023-08-25T04:18:52.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a86c25640 1 --2- 172.21.15.55:0/3158841508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a80155740 0x7f1a800afd00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800c780 tx=0x7f1a7800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:52.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a76ffd640 1 -- 172.21.15.55:0/3158841508 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7800ce90 con 0x7f1a80155740 2023-08-25T04:18:52.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a76ffd640 1 -- 172.21.15.55:0/3158841508 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7800a640 con 0x7f1a80155740 2023-08-25T04:18:52.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a76ffd640 1 -- 172.21.15.55:0/3158841508 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7800a9d0 con 0x7f1a80155740 2023-08-25T04:18:52.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a88688640 1 -- 172.21.15.55:0/3158841508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a80155e90 con 0x7f1a80155740 2023-08-25T04:18:52.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.797+0000 7f1a88688640 1 -- 172.21.15.55:0/3158841508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a800c7a40 con 0x7f1a80155740 2023-08-25T04:18:52.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.801+0000 7f1a88688640 1 -- 172.21.15.55:0/3158841508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a80156690 con 0x7f1a80155740 2023-08-25T04:18:52.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.801+0000 7f1a76ffd640 1 -- 172.21.15.55:0/3158841508 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f1a7800ab30 con 0x7f1a80155740 2023-08-25T04:18:52.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.801+0000 7f1a76ffd640 1 --2- 172.21.15.55:0/3158841508 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f1a640657d0 0x7f1a64067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:52.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.801+0000 7f1a76ffd640 1 -- 172.21.15.55:0/3158841508 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f1a78082670 con 0x7f1a80155740 2023-08-25T04:18:52.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.801+0000 7f1a86424640 1 --2- 172.21.15.55:0/3158841508 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f1a640657d0 0x7f1a64067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:52.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.801+0000 7f1a86424640 1 --2- 172.21.15.55:0/3158841508 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f1a640657d0 0x7f1a64067c90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c0ad000 tx=0x7f1a7c0a6000 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:52.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.805+0000 7f1a76ffd640 1 -- 172.21.15.55:0/3158841508 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1a80156690 con 0x7f1a80155740 2023-08-25T04:18:52.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:52.965+0000 7f1a88688640 1 -- 172.21.15.55:0/3158841508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1a800b0660 con 0x7f1a80155740 2023-08-25T04:18:53.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.681+0000 7f1a76ffd640 1 -- 172.21.15.55:0/3158841508 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1a7804fd20 con 0x7f1a80155740 2023-08-25T04:18:53.683 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-08-25T04:18:53.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.689+0000 7f1a88688640 1 -- 172.21.15.55:0/3158841508 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f1a640657d0 msgr2=0x7f1a64067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:53.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.689+0000 7f1a88688640 1 --2- 172.21.15.55:0/3158841508 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f1a640657d0 0x7f1a64067c90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c0ad000 tx=0x7f1a7c0a6000 comp rx=0 tx=0).stop 2023-08-25T04:18:53.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.689+0000 7f1a88688640 1 -- 172.21.15.55:0/3158841508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a80155740 msgr2=0x7f1a800afd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:53.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.689+0000 7f1a88688640 1 --2- 172.21.15.55:0/3158841508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a80155740 0x7f1a800afd00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800c780 tx=0x7f1a7800cc40 comp rx=0 tx=0).stop 2023-08-25T04:18:53.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.689+0000 7f1a88688640 1 -- 172.21.15.55:0/3158841508 shutdown_connections 2023-08-25T04:18:53.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.689+0000 7f1a88688640 1 --2- 172.21.15.55:0/3158841508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a80155740 0x7f1a800afd00 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:53.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.689+0000 7f1a88688640 1 --2- 172.21.15.55:0/3158841508 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f1a640657d0 0x7f1a64067c90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:53.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.689+0000 7f1a88688640 1 --2- 172.21.15.55:0/3158841508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a80155360 0x7f1a800af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:53.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.689+0000 7f1a88688640 1 --2- 172.21.15.55:0/3158841508 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a8006fb50 0x7f1a800acc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:53.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.689+0000 7f1a88688640 1 -- 172.21.15.55:0/3158841508 >> 172.21.15.55:0/3158841508 conn(0x7f1a800caf90 msgr2=0x7f1a800b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:53.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.689+0000 7f1a88688640 1 -- 172.21.15.55:0/3158841508 shutdown_connections 2023-08-25T04:18:53.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.689+0000 7f1a88688640 1 -- 172.21.15.55:0/3158841508 wait complete. 2023-08-25T04:18:53.714 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-25T04:18:53.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.865+0000 7fbfe139f640 1 Processor -- start 2023-08-25T04:18:53.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.869+0000 7fbfe139f640 1 -- start start 2023-08-25T04:18:53.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.869+0000 7fbfe139f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cf340 0x7fbfdc0cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:53.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.869+0000 7fbfe139f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfdc0b59f0 0x7fbfdc0b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:53.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.869+0000 7fbfe139f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfdc0d1970 con 0x7fbfdc15cb40 2023-08-25T04:18:53.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.869+0000 7fbfe139f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfdc0d2790 con 0x7fbfdc0b59f0 2023-08-25T04:18:53.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.869+0000 7fbfe139f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0cfcc0 con 0x7fbfdc0cf340 2023-08-25T04:18:53.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.869+0000 7fbfdb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfdc0b59f0 0x7fbfdc0b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:53.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.869+0000 7fbfdb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfdc0b59f0 0x7fbfdc0b5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50694/0 (socket says 172.21.15.55:50694) 2023-08-25T04:18:53.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.869+0000 7fbfdb7fe640 1 -- 172.21.15.55:0/3419431795 learned_addr learned my addr 172.21.15.55:0/3419431795 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:53.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.869+0000 7fbfd3fff640 1 --2- 172.21.15.55:0/3419431795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cf340 0x7fbfdc0cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:53.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.869+0000 7fbfdb7fe640 1 -- 172.21.15.55:0/3419431795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cf340 msgr2=0x7fbfdc0cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:53.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.869+0000 7fbfdb7fe640 1 --2- 172.21.15.55:0/3419431795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cf340 0x7fbfdc0cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:53.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.869+0000 7fbfdb7fe640 1 -- 172.21.15.55:0/3419431795 >> v1:172.21.15.110:6789/0 conn(0x7fbfdc15cb40 legacy=0x7fbfdc0d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:53.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.869+0000 7fbfdb7fe640 1 -- 172.21.15.55:0/3419431795 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc0d0d80 con 0x7fbfdc0b59f0 2023-08-25T04:18:53.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.873+0000 7fbfdb7fe640 1 --2- 172.21.15.55:0/3419431795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0b59f0 0x7fbfdc0b5e60 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4009e50 tx=0x7fbfd401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7501ba19b4efe1e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:53.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.873+0000 7fbfda7fc640 1 -- 172.21.15.55:0/3419431795 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd40af400 con 0x7fbfdc0b59f0 2023-08-25T04:18:53.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.873+0000 7fbfda7fc640 1 -- 172.21.15.55:0/3419431795 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd40ab050 con 0x7fbfdc0b59f0 2023-08-25T04:18:53.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.873+0000 7fbfda7fc640 1 -- 172.21.15.55:0/3419431795 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd40af780 con 0x7fbfdc0b59f0 2023-08-25T04:18:53.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.873+0000 7fbfe139f640 1 -- 172.21.15.55:0/3419431795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0b59f0 msgr2=0x7fbfdc0b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:53.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.873+0000 7fbfe139f640 1 --2- 172.21.15.55:0/3419431795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0b59f0 0x7fbfdc0b5e60 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4009e50 tx=0x7fbfd401f1c0 comp rx=0 tx=0).stop 2023-08-25T04:18:53.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.873+0000 7fbfe139f640 1 -- 172.21.15.55:0/3419431795 shutdown_connections 2023-08-25T04:18:53.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.873+0000 7fbfe139f640 1 --2- 172.21.15.55:0/3419431795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0b59f0 0x7fbfdc0b5e60 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:53.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.873+0000 7fbfe139f640 1 --2- 172.21.15.55:0/3419431795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cf340 0x7fbfdc0cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:53.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.873+0000 7fbfe139f640 1 -- 172.21.15.55:0/3419431795 >> 172.21.15.55:0/3419431795 conn(0x7fbfdc06aae0 msgr2=0x7fbfdc06aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:53.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.873+0000 7fbfe139f640 1 -- 172.21.15.55:0/3419431795 shutdown_connections 2023-08-25T04:18:53.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.873+0000 7fbfe139f640 1 -- 172.21.15.55:0/3419431795 wait complete. 2023-08-25T04:18:53.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.873+0000 7fbfe139f640 1 Processor -- start 2023-08-25T04:18:53.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.873+0000 7fbfe139f640 1 -- start start 2023-08-25T04:18:53.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfe139f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0b59f0 0x7fbfdc0c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:53.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfe139f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cf340 0x7fbfdc1528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:53.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfe139f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfdc15cb40 0x7fbfdc152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:53.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfe139f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc15ec60 con 0x7fbfdc0b59f0 2023-08-25T04:18:53.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfe139f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc15ef40 con 0x7fbfdc15cb40 2023-08-25T04:18:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfe139f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc15f220 con 0x7fbfdc0cf340 2023-08-25T04:18:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfdaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0b59f0 0x7fbfdc0c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfdaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0b59f0 0x7fbfdc0c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50708/0 (socket says 172.21.15.55:50708) 2023-08-25T04:18:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfdaffd640 1 -- 172.21.15.55:0/1923455060 learned_addr learned my addr 172.21.15.55:0/1923455060 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfd3fff640 1 --2- 172.21.15.55:0/1923455060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cf340 0x7fbfdc1528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfdb7fe640 1 --2- 172.21.15.55:0/1923455060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfdc15cb40 0x7fbfdc152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfdaffd640 1 -- 172.21.15.55:0/1923455060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cf340 msgr2=0x7fbfdc1528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:53.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfdaffd640 1 --2- 172.21.15.55:0/1923455060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cf340 0x7fbfdc1528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:53.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfdaffd640 1 -- 172.21.15.55:0/1923455060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfdc15cb40 msgr2=0x7fbfdc152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:53.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfdaffd640 1 --2- 172.21.15.55:0/1923455060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfdc15cb40 0x7fbfdc152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:53.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfdaffd640 1 -- 172.21.15.55:0/1923455060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd4009b30 con 0x7fbfdc0b59f0 2023-08-25T04:18:53.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfd3fff640 1 --2- 172.21.15.55:0/1923455060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cf340 0x7fbfdc1528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:53.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfdb7fe640 1 --2- 172.21.15.55:0/1923455060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfdc15cb40 0x7fbfdc152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfdaffd640 1 --2- 172.21.15.55:0/1923455060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0b59f0 0x7fbfdc0c58a0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00b410 tx=0x7fbfcc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfd37fe640 1 -- 172.21.15.55:0/1923455060 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc004020 con 0x7fbfdc0b59f0 2023-08-25T04:18:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfd37fe640 1 -- 172.21.15.55:0/1923455060 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc004180 con 0x7fbfdc0b59f0 2023-08-25T04:18:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfd37fe640 1 -- 172.21.15.55:0/1923455060 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc011630 con 0x7fbfdc0b59f0 2023-08-25T04:18:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfe139f640 1 -- 172.21.15.55:0/1923455060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfdc15f500 con 0x7fbfdc0b59f0 2023-08-25T04:18:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfe139f640 1 -- 172.21.15.55:0/1923455060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfdc0c5de0 con 0x7fbfdc0b59f0 2023-08-25T04:18:53.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfe139f640 1 -- 172.21.15.55:0/1923455060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfdc071f80 con 0x7fbfdc0b59f0 2023-08-25T04:18:53.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.877+0000 7fbfd37fe640 1 -- 172.21.15.55:0/1923455060 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fbfcc011790 con 0x7fbfdc0b59f0 2023-08-25T04:18:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.881+0000 7fbfd37fe640 1 --2- 172.21.15.55:0/1923455060 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fbfbc0657a0 0x7fbfbc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.881+0000 7fbfd37fe640 1 -- 172.21.15.55:0/1923455060 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6398+0+0 (secure 0 0 0) 0x7fbfcc082da0 con 0x7fbfdc0b59f0 2023-08-25T04:18:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.881+0000 7fbfd3fff640 1 --2- 172.21.15.55:0/1923455060 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fbfbc0657a0 0x7fbfbc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.881+0000 7fbfd3fff640 1 --2- 172.21.15.55:0/1923455060 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fbfbc0657a0 0x7fbfbc067c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc145560 tx=0x7fbfc4008040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:53.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:53.885+0000 7fbfd37fe640 1 -- 172.21.15.55:0/1923455060 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbfcc050690 con 0x7fbfdc0b59f0 2023-08-25T04:18:54.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:54.041+0000 7fbfe139f640 1 -- 172.21.15.55:0/1923455060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbfdc04dbe0 con 0x7fbfdc0b59f0 2023-08-25T04:18:54.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:54.701+0000 7fbfd37fe640 1 -- 172.21.15.55:0/1923455060 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbfcc0150d0 con 0x7fbfdc0b59f0 2023-08-25T04:18:54.701 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-08-25T04:18:54.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:54.705+0000 7fbfe139f640 1 -- 172.21.15.55:0/1923455060 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fbfbc0657a0 msgr2=0x7fbfbc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:54.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:54.705+0000 7fbfe139f640 1 --2- 172.21.15.55:0/1923455060 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fbfbc0657a0 0x7fbfbc067c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc145560 tx=0x7fbfc4008040 comp rx=0 tx=0).stop 2023-08-25T04:18:54.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:54.705+0000 7fbfe139f640 1 -- 172.21.15.55:0/1923455060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0b59f0 msgr2=0x7fbfdc0c58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:54.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:54.705+0000 7fbfe139f640 1 --2- 172.21.15.55:0/1923455060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0b59f0 0x7fbfdc0c58a0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc00b410 tx=0x7fbfcc00b8d0 comp rx=0 tx=0).stop 2023-08-25T04:18:54.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:54.705+0000 7fbfe139f640 1 -- 172.21.15.55:0/1923455060 shutdown_connections 2023-08-25T04:18:54.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:54.705+0000 7fbfe139f640 1 --2- 172.21.15.55:0/1923455060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfdc15cb40 0x7fbfdc152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:54.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:54.705+0000 7fbfe139f640 1 --2- 172.21.15.55:0/1923455060 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fbfbc0657a0 0x7fbfbc067c60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:54.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:54.705+0000 7fbfe139f640 1 --2- 172.21.15.55:0/1923455060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfdc0cf340 0x7fbfdc1528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:54.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:54.705+0000 7fbfe139f640 1 --2- 172.21.15.55:0/1923455060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfdc0b59f0 0x7fbfdc0c58a0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:54.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:54.705+0000 7fbfe139f640 1 -- 172.21.15.55:0/1923455060 >> 172.21.15.55:0/1923455060 conn(0x7fbfdc06aae0 msgr2=0x7fbfdc0ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:54.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:54.705+0000 7fbfe139f640 1 -- 172.21.15.55:0/1923455060 shutdown_connections 2023-08-25T04:18:54.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:54.705+0000 7fbfe139f640 1 -- 172.21.15.55:0/1923455060 wait complete. 2023-08-25T04:18:54.728 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-08-25T04:18:55.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.021+0000 7fa62759e640 1 Processor -- start 2023-08-25T04:18:55.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.021+0000 7fa62759e640 1 -- start start 2023-08-25T04:18:55.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.021+0000 7fa62759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6280b8330 0x7fa628167290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:55.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.021+0000 7fa62759e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6280b70c0 con 0x7fa62815fca0 2023-08-25T04:18:55.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.021+0000 7fa62759e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6280b73a0 con 0x7fa6280cfc90 2023-08-25T04:18:55.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.021+0000 7fa62759e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa628160080 con 0x7fa6280b8330 2023-08-25T04:18:55.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.021+0000 7fa62659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa62815fca0 0x7fa6280cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47986/0 (socket says 172.21.15.55:47986) 2023-08-25T04:18:55.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.021+0000 7fa62659c640 1 -- 172.21.15.55:0/3334841586 learned_addr learned my addr 172.21.15.55:0/3334841586 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:55.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.021+0000 7fa626d9d640 1 --2- 172.21.15.55:0/3334841586 >> v2:172.21.15.55:3300/0 conn(0x7fa6280b8330 0x7fa628167290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:55.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.021+0000 7fa626d9d640 1 -- 172.21.15.55:0/3334841586 >> v1:172.21.15.110:6789/0 conn(0x7fa6280cfc90 legacy=0x7fa6280b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:55.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.021+0000 7fa626d9d640 1 -- 172.21.15.55:0/3334841586 >> v1:172.21.15.55:6789/0 conn(0x7fa62815fca0 legacy=0x7fa6280cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:55.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.021+0000 7fa626d9d640 1 -- 172.21.15.55:0/3334841586 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6280b7680 con 0x7fa6280b8330 2023-08-25T04:18:55.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.021+0000 7fa62559a640 1 -- 172.21.15.55:0/3334841586 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642608192 0 0) 0x7fa6280b70c0 con 0x7fa62815fca0 2023-08-25T04:18:55.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.025+0000 7fa626d9d640 1 --2- 172.21.15.55:0/3334841586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6280b8330 0x7fa628167290 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fa620009d90 tx=0x7fa62001f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84bf98c86abc1ef server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.025+0000 7fa62559a640 1 -- 172.21.15.55:0/3334841586 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6200af600 con 0x7fa6280b8330 2023-08-25T04:18:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.025+0000 7fa62559a640 1 -- 172.21.15.55:0/3334841586 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6200ab050 con 0x7fa6280b8330 2023-08-25T04:18:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.025+0000 7fa62559a640 1 -- 172.21.15.55:0/3334841586 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6200af980 con 0x7fa6280b8330 2023-08-25T04:18:55.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.025+0000 7fa62759e640 1 -- 172.21.15.55:0/3334841586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6280b8330 msgr2=0x7fa628167290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:55.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.025+0000 7fa62759e640 1 --2- 172.21.15.55:0/3334841586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6280b8330 0x7fa628167290 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fa620009d90 tx=0x7fa62001f100 comp rx=0 tx=0).stop 2023-08-25T04:18:55.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.025+0000 7fa62759e640 1 -- 172.21.15.55:0/3334841586 shutdown_connections 2023-08-25T04:18:55.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.025+0000 7fa62759e640 1 --2- 172.21.15.55:0/3334841586 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6280b8330 0x7fa628167290 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.025+0000 7fa62759e640 1 -- 172.21.15.55:0/3334841586 >> 172.21.15.55:0/3334841586 conn(0x7fa6280658c0 msgr2=0x7fa628065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:55.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.025+0000 7fa62759e640 1 -- 172.21.15.55:0/3334841586 shutdown_connections 2023-08-25T04:18:55.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.025+0000 7fa62759e640 1 -- 172.21.15.55:0/3334841586 wait complete. 2023-08-25T04:18:55.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa62759e640 1 Processor -- start 2023-08-25T04:18:55.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa62759e640 1 -- start start 2023-08-25T04:18:55.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa62759e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6280b8330 0x7fa6280c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:55.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa62759e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6280cfc90 0x7fa6281f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:55.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa62759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa62815fca0 0x7fa6280b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:55.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa62759e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280c8430 con 0x7fa6280cfc90 2023-08-25T04:18:55.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa62759e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280c8d10 con 0x7fa6280b8330 2023-08-25T04:18:55.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa62759e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6281f5fe0 con 0x7fa62815fca0 2023-08-25T04:18:55.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa625d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6280cfc90 0x7fa6281f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:55.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa625d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6280cfc90 0x7fa6281f71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50722/0 (socket says 172.21.15.55:50722) 2023-08-25T04:18:55.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa625d9b640 1 -- 172.21.15.55:0/1652893154 learned_addr learned my addr 172.21.15.55:0/1652893154 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:55.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa62659c640 1 --2- 172.21.15.55:0/1652893154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6280b8330 0x7fa6280c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:55.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa626d9d640 1 --2- 172.21.15.55:0/1652893154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa62815fca0 0x7fa6280b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:55.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa625d9b640 1 -- 172.21.15.55:0/1652893154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa62815fca0 msgr2=0x7fa6280b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:55.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa625d9b640 1 --2- 172.21.15.55:0/1652893154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa62815fca0 0x7fa6280b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa625d9b640 1 -- 172.21.15.55:0/1652893154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6280b8330 msgr2=0x7fa6280c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:55.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa625d9b640 1 --2- 172.21.15.55:0/1652893154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6280b8330 0x7fa6280c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa625d9b640 1 -- 172.21.15.55:0/1652893154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa620009a70 con 0x7fa6280cfc90 2023-08-25T04:18:55.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa625d9b640 1 --2- 172.21.15.55:0/1652893154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6280cfc90 0x7fa6281f71a0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00c410 tx=0x7fa61c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:55.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa616ffd640 1 -- 172.21.15.55:0/1652893154 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c011790 con 0x7fa6280cfc90 2023-08-25T04:18:55.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa616ffd640 1 -- 172.21.15.55:0/1652893154 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c0118f0 con 0x7fa6280cfc90 2023-08-25T04:18:55.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa62759e640 1 -- 172.21.15.55:0/1652893154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6280b1c40 con 0x7fa6280cfc90 2023-08-25T04:18:55.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa616ffd640 1 -- 172.21.15.55:0/1652893154 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c011ce0 con 0x7fa6280cfc90 2023-08-25T04:18:55.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa62759e640 1 -- 172.21.15.55:0/1652893154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6280b2200 con 0x7fa6280cfc90 2023-08-25T04:18:55.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.029+0000 7fa62759e640 1 -- 172.21.15.55:0/1652893154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6281f6200 con 0x7fa6280cfc90 2023-08-25T04:18:55.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.033+0000 7fa616ffd640 1 -- 172.21.15.55:0/1652893154 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fa61c01c460 con 0x7fa6280cfc90 2023-08-25T04:18:55.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.033+0000 7fa616ffd640 1 --2- 172.21.15.55:0/1652893154 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa6080657a0 0x7fa608067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:55.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.033+0000 7fa616ffd640 1 -- 172.21.15.55:0/1652893154 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fa61c082c70 con 0x7fa6280cfc90 2023-08-25T04:18:55.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.033+0000 7fa62659c640 1 --2- 172.21.15.55:0/1652893154 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa6080657a0 0x7fa608067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:55.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.033+0000 7fa62659c640 1 --2- 172.21.15.55:0/1652893154 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa6080657a0 0x7fa608067c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa618000f70 tx=0x7fa618007df0 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:55.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.037+0000 7fa616ffd640 1 -- 172.21.15.55:0/1652893154 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa6281f6200 con 0x7fa6280cfc90 2023-08-25T04:18:55.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.193+0000 7fa62759e640 1 -- 172.21.15.55:0/1652893154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fa6281f61a0 con 0x7fa6280cfc90 2023-08-25T04:18:55.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.197+0000 7fa616ffd640 1 -- 172.21.15.55:0/1652893154 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v25) v1 ==== 115+0+0 (secure 0 0 0) 0x7fa61c0505f0 con 0x7fa6280cfc90 2023-08-25T04:18:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.201+0000 7fa62759e640 1 -- 172.21.15.55:0/1652893154 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa6080657a0 msgr2=0x7fa608067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.201+0000 7fa62759e640 1 --2- 172.21.15.55:0/1652893154 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa6080657a0 0x7fa608067c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa618000f70 tx=0x7fa618007df0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.201+0000 7fa62759e640 1 -- 172.21.15.55:0/1652893154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6280cfc90 msgr2=0x7fa6281f71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.201+0000 7fa62759e640 1 --2- 172.21.15.55:0/1652893154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6280cfc90 0x7fa6281f71a0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00c410 tx=0x7fa61c00c8d0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.201+0000 7fa62759e640 1 -- 172.21.15.55:0/1652893154 shutdown_connections 2023-08-25T04:18:55.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.201+0000 7fa62759e640 1 --2- 172.21.15.55:0/1652893154 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa6080657a0 0x7fa608067c60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.201+0000 7fa62759e640 1 --2- 172.21.15.55:0/1652893154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa62815fca0 0x7fa6280b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.201+0000 7fa62759e640 1 --2- 172.21.15.55:0/1652893154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6280cfc90 0x7fa6281f71a0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.201+0000 7fa62759e640 1 --2- 172.21.15.55:0/1652893154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6280b8330 0x7fa6280c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.201+0000 7fa62759e640 1 -- 172.21.15.55:0/1652893154 >> 172.21.15.55:0/1652893154 conn(0x7fa6280658c0 msgr2=0x7fa62815c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:55.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.201+0000 7fa62759e640 1 -- 172.21.15.55:0/1652893154 shutdown_connections 2023-08-25T04:18:55.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.201+0000 7fa62759e640 1 -- 172.21.15.55:0/1652893154 wait complete. 2023-08-25T04:18:55.220 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-25T04:18:55.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.369+0000 7f1811234640 1 Processor -- start 2023-08-25T04:18:55.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.369+0000 7f1811234640 1 -- start start 2023-08-25T04:18:55.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.369+0000 7f1811234640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f180c0c9830 0x7f180c09bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:55.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.369+0000 7f1811234640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f180c06c020 0x7f180c0acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:55.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.369+0000 7f1811234640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180c15abd0 con 0x7f180c15a7f0 2023-08-25T04:18:55.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.369+0000 7f1811234640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180c0c8ab0 con 0x7f180c06c020 2023-08-25T04:18:55.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.369+0000 7f1811234640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180c0c8d50 con 0x7f180c0c9830 2023-08-25T04:18:55.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.369+0000 7f180ad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f180c15a7f0 0x7f180c070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47988/0 (socket says 172.21.15.55:47988) 2023-08-25T04:18:55.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.369+0000 7f180ad9d640 1 -- 172.21.15.55:0/2213064514 learned_addr learned my addr 172.21.15.55:0/2213064514 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:55.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.369+0000 7f180b59e640 1 --2- 172.21.15.55:0/2213064514 >> v2:172.21.15.55:3300/0 conn(0x7f180c06c020 0x7f180c0acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:55.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.369+0000 7f1803fff640 1 --2- 172.21.15.55:0/2213064514 >> v2:172.21.15.110:3300/0 conn(0x7f180c0c9830 0x7f180c09bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:55.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.369+0000 7f180b59e640 1 -- 172.21.15.55:0/2213064514 >> v2:172.21.15.110:3300/0 conn(0x7f180c0c9830 msgr2=0x7f180c09bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:55.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.369+0000 7f180b59e640 1 --2- 172.21.15.55:0/2213064514 >> v2:172.21.15.110:3300/0 conn(0x7f180c0c9830 0x7f180c09bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.369+0000 7f180b59e640 1 -- 172.21.15.55:0/2213064514 >> v1:172.21.15.55:6789/0 conn(0x7f180c15a7f0 legacy=0x7f180c070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:55.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.369+0000 7f180b59e640 1 -- 172.21.15.55:0/2213064514 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c0c9030 con 0x7f180c06c020 2023-08-25T04:18:55.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.369+0000 7f180a59c640 1 -- 172.21.15.55:0/2213064514 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339024277 0 0) 0x7f180c15abd0 con 0x7f180c15a7f0 2023-08-25T04:18:55.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.373+0000 7f180b59e640 1 --2- 172.21.15.55:0/2213064514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f180c06c020 0x7f180c0acff0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f180c06d740 tx=0x7f180401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122879e3f6133c2f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:55.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.373+0000 7f180a59c640 1 -- 172.21.15.55:0/2213064514 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040a58b0 con 0x7f180c06c020 2023-08-25T04:18:55.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.373+0000 7f180a59c640 1 -- 172.21.15.55:0/2213064514 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18040a5a10 con 0x7f180c06c020 2023-08-25T04:18:55.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.373+0000 7f180a59c640 1 -- 172.21.15.55:0/2213064514 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040a5da0 con 0x7f180c06c020 2023-08-25T04:18:55.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.373+0000 7f1811234640 1 -- 172.21.15.55:0/2213064514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f180c06c020 msgr2=0x7f180c0acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:55.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.373+0000 7f1811234640 1 --2- 172.21.15.55:0/2213064514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f180c06c020 0x7f180c0acff0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f180c06d740 tx=0x7f180401c8e0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.373+0000 7f1811234640 1 -- 172.21.15.55:0/2213064514 shutdown_connections 2023-08-25T04:18:55.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.373+0000 7f1811234640 1 --2- 172.21.15.55:0/2213064514 >> v2:172.21.15.110:3300/0 conn(0x7f180c0c9830 0x7f180c09bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.373+0000 7f1811234640 1 --2- 172.21.15.55:0/2213064514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f180c06c020 0x7f180c0acff0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.373+0000 7f1811234640 1 -- 172.21.15.55:0/2213064514 >> 172.21.15.55:0/2213064514 conn(0x7f180c069900 msgr2=0x7f180c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:55.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.373+0000 7f1811234640 1 -- 172.21.15.55:0/2213064514 shutdown_connections 2023-08-25T04:18:55.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.373+0000 7f1811234640 1 -- 172.21.15.55:0/2213064514 wait complete. 2023-08-25T04:18:55.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f1811234640 1 Processor -- start 2023-08-25T04:18:55.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f1811234640 1 -- start start 2023-08-25T04:18:55.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f1811234640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f180c06c020 0x7f180c14dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:55.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f1811234640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f180c0c9830 0x7f180c1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:55.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f1811234640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f180c15a7f0 0x7f180c0b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:55.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f1811234640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c1518c0 con 0x7f180c06c020 2023-08-25T04:18:55.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f1811234640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c14e000 con 0x7f180c15a7f0 2023-08-25T04:18:55.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f1811234640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180c0c7990 con 0x7f180c0c9830 2023-08-25T04:18:55.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f180ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f180c06c020 0x7f180c14dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:55.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f180ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f180c06c020 0x7f180c14dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50742/0 (socket says 172.21.15.55:50742) 2023-08-25T04:18:55.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f180ad9d640 1 -- 172.21.15.55:0/1348950406 learned_addr learned my addr 172.21.15.55:0/1348950406 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:55.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f180ad9d640 1 -- 172.21.15.55:0/1348950406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f180c0c9830 msgr2=0x7f180c1561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:55.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f180ad9d640 1 --2- 172.21.15.55:0/1348950406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f180c0c9830 0x7f180c1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f180ad9d640 1 -- 172.21.15.55:0/1348950406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f180c15a7f0 msgr2=0x7f180c0b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:55.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f180ad9d640 1 --2- 172.21.15.55:0/1348950406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f180c15a7f0 0x7f180c0b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f180ad9d640 1 -- 172.21.15.55:0/1348950406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1804009a70 con 0x7f180c06c020 2023-08-25T04:18:55.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f180ad9d640 1 --2- 172.21.15.55:0/1348950406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f180c06c020 0x7f180c14dac0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00c430 tx=0x7f17fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:55.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f18037fe640 1 -- 172.21.15.55:0/1348950406 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc0074e0 con 0x7f180c06c020 2023-08-25T04:18:55.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f18037fe640 1 -- 172.21.15.55:0/1348950406 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17fc007640 con 0x7f180c06c020 2023-08-25T04:18:55.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f1811234640 1 -- 172.21.15.55:0/1348950406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180c0c7c70 con 0x7f180c06c020 2023-08-25T04:18:55.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f18037fe640 1 -- 172.21.15.55:0/1348950406 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc0059d0 con 0x7f180c06c020 2023-08-25T04:18:55.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f1811234640 1 -- 172.21.15.55:0/1348950406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180c0c8230 con 0x7f180c06c020 2023-08-25T04:18:55.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.377+0000 7f1811234640 1 -- 172.21.15.55:0/1348950406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180c06d5b0 con 0x7f180c06c020 2023-08-25T04:18:55.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.381+0000 7f18037fe640 1 -- 172.21.15.55:0/1348950406 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f17fc005b30 con 0x7f180c06c020 2023-08-25T04:18:55.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.381+0000 7f18037fe640 1 --2- 172.21.15.55:0/1348950406 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f17ec0657a0 0x7f17ec067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:55.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.381+0000 7f18037fe640 1 -- 172.21.15.55:0/1348950406 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f17fc082550 con 0x7f180c06c020 2023-08-25T04:18:55.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.381+0000 7f1803fff640 1 --2- 172.21.15.55:0/1348950406 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f17ec0657a0 0x7f17ec067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:55.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.381+0000 7f1803fff640 1 --2- 172.21.15.55:0/1348950406 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f17ec0657a0 0x7f17ec067c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f180c0b2700 tx=0x7f17f4008040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:55.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.385+0000 7f18037fe640 1 -- 172.21.15.55:0/1348950406 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f17fc053ab0 con 0x7f180c06c020 2023-08-25T04:18:55.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.545+0000 7f1811234640 1 -- 172.21.15.55:0/1348950406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f180c073ec0 con 0x7f180c06c020 2023-08-25T04:18:55.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.549+0000 7f18037fe640 1 -- 172.21.15.55:0/1348950406 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v26) v1 ==== 120+0+0 (secure 0 0 0) 0x7f17fc053640 con 0x7f180c06c020 2023-08-25T04:18:55.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.553+0000 7f1811234640 1 -- 172.21.15.55:0/1348950406 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f17ec0657a0 msgr2=0x7f17ec067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:55.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.553+0000 7f1811234640 1 --2- 172.21.15.55:0/1348950406 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f17ec0657a0 0x7f17ec067c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f180c0b2700 tx=0x7f17f4008040 comp rx=0 tx=0).stop 2023-08-25T04:18:55.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.553+0000 7f1811234640 1 -- 172.21.15.55:0/1348950406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f180c06c020 msgr2=0x7f180c14dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:55.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.553+0000 7f1811234640 1 --2- 172.21.15.55:0/1348950406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f180c06c020 0x7f180c14dac0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00c430 tx=0x7f17fc00c8f0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.553+0000 7f1811234640 1 -- 172.21.15.55:0/1348950406 shutdown_connections 2023-08-25T04:18:55.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.553+0000 7f1811234640 1 --2- 172.21.15.55:0/1348950406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f180c15a7f0 0x7f180c0b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.553+0000 7f1811234640 1 --2- 172.21.15.55:0/1348950406 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f17ec0657a0 0x7f17ec067c60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.553+0000 7f1811234640 1 --2- 172.21.15.55:0/1348950406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f180c0c9830 0x7f180c1561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.553+0000 7f1811234640 1 --2- 172.21.15.55:0/1348950406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f180c06c020 0x7f180c14dac0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.553+0000 7f1811234640 1 -- 172.21.15.55:0/1348950406 >> 172.21.15.55:0/1348950406 conn(0x7f180c069900 msgr2=0x7f180c0af380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:55.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.553+0000 7f1811234640 1 -- 172.21.15.55:0/1348950406 shutdown_connections 2023-08-25T04:18:55.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.553+0000 7f1811234640 1 -- 172.21.15.55:0/1348950406 wait complete. 2023-08-25T04:18:55.571 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-25T04:18:55.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.717+0000 7faa5ad03640 1 Processor -- start 2023-08-25T04:18:55.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.717+0000 7faa5ad03640 1 -- start start 2023-08-25T04:18:55.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.717+0000 7faa5ad03640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faa541601f0 0x7faa5415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:55.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.717+0000 7faa5ad03640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa5415e3c0 0x7faa540d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.717+0000 7faa5ad03640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5415f8b0 con 0x7faa540d10c0 2023-08-25T04:18:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.717+0000 7faa5ad03640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa540cd5a0 con 0x7faa5415e3c0 2023-08-25T04:18:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.717+0000 7faa5ad03640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa540cd880 con 0x7faa541601f0 2023-08-25T04:18:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.717+0000 7faa4bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa5415e3c0 0x7faa540d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.717+0000 7faa4bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa5415e3c0 0x7faa540d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50752/0 (socket says 172.21.15.55:50752) 2023-08-25T04:18:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.717+0000 7faa4bfff640 1 -- 172.21.15.55:0/3123823863 learned_addr learned my addr 172.21.15.55:0/3123823863 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.717+0000 7faa58a9f640 1 --2- 172.21.15.55:0/3123823863 >> v2:172.21.15.110:3300/0 conn(0x7faa541601f0 0x7faa5415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:55.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.721+0000 7faa4bfff640 1 -- 172.21.15.55:0/3123823863 >> v2:172.21.15.110:3300/0 conn(0x7faa541601f0 msgr2=0x7faa5415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:55.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.721+0000 7faa4bfff640 1 --2- 172.21.15.55:0/3123823863 >> v2:172.21.15.110:3300/0 conn(0x7faa541601f0 0x7faa5415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.721+0000 7faa4bfff640 1 -- 172.21.15.55:0/3123823863 >> v1:172.21.15.110:6789/0 conn(0x7faa540d10c0 legacy=0x7faa540b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:55.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.721+0000 7faa4bfff640 1 -- 172.21.15.55:0/3123823863 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa540cdb60 con 0x7faa5415e3c0 2023-08-25T04:18:55.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.721+0000 7faa4bfff640 1 --2- 172.21.15.55:0/3123823863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa5415e3c0 0x7faa540d0b80 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7faa5408b7f0 tx=0x7faa4401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f393666f560a76b7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:55.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.721+0000 7faa4b7fe640 1 -- 172.21.15.55:0/3123823863 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa440ac640 con 0x7faa5415e3c0 2023-08-25T04:18:55.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.721+0000 7faa4b7fe640 1 -- 172.21.15.55:0/3123823863 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa440ac7a0 con 0x7faa5415e3c0 2023-08-25T04:18:55.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.721+0000 7faa4b7fe640 1 -- 172.21.15.55:0/3123823863 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa440acb30 con 0x7faa5415e3c0 2023-08-25T04:18:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa5ad03640 1 -- 172.21.15.55:0/3123823863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa5415e3c0 msgr2=0x7faa540d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa5ad03640 1 --2- 172.21.15.55:0/3123823863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa5415e3c0 0x7faa540d0b80 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7faa5408b7f0 tx=0x7faa4401c4d0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa5ad03640 1 -- 172.21.15.55:0/3123823863 shutdown_connections 2023-08-25T04:18:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa5ad03640 1 --2- 172.21.15.55:0/3123823863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa5415e3c0 0x7faa540d0b80 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa5ad03640 1 --2- 172.21.15.55:0/3123823863 >> v2:172.21.15.110:3300/0 conn(0x7faa541601f0 0x7faa5415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa5ad03640 1 -- 172.21.15.55:0/3123823863 >> 172.21.15.55:0/3123823863 conn(0x7faa540d27d0 msgr2=0x7faa540d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa5ad03640 1 -- 172.21.15.55:0/3123823863 shutdown_connections 2023-08-25T04:18:55.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa5ad03640 1 -- 172.21.15.55:0/3123823863 wait complete. 2023-08-25T04:18:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa5ad03640 1 Processor -- start 2023-08-25T04:18:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa5ad03640 1 -- start start 2023-08-25T04:18:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa5ad03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa540d10c0 0x7faa540b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa5ad03640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa5415e3c0 0x7faa540c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa5ad03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa541601f0 0x7faa540b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa5ad03640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa540b5800 con 0x7faa541601f0 2023-08-25T04:18:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa5ad03640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa540c8a20 con 0x7faa5415e3c0 2023-08-25T04:18:55.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa5ad03640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa540c8d00 con 0x7faa540d10c0 2023-08-25T04:18:55.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa592a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa541601f0 0x7faa540b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:55.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa592a0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa541601f0 0x7faa540b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50762/0 (socket says 172.21.15.55:50762) 2023-08-25T04:18:55.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa4bfff640 1 --2- 172.21.15.55:0/4137331516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa5415e3c0 0x7faa540c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:55.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa592a0640 1 -- 172.21.15.55:0/4137331516 learned_addr learned my addr 172.21.15.55:0/4137331516 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:55.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.725+0000 7faa58a9f640 1 --2- 172.21.15.55:0/4137331516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa540d10c0 0x7faa540b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.729+0000 7faa592a0640 1 -- 172.21.15.55:0/4137331516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa540d10c0 msgr2=0x7faa540b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.729+0000 7faa592a0640 1 --2- 172.21.15.55:0/4137331516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa540d10c0 0x7faa540b6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.729+0000 7faa592a0640 1 -- 172.21.15.55:0/4137331516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa5415e3c0 msgr2=0x7faa540c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.729+0000 7faa592a0640 1 --2- 172.21.15.55:0/4137331516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa5415e3c0 0x7faa540c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.729+0000 7faa592a0640 1 -- 172.21.15.55:0/4137331516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa440094d0 con 0x7faa541601f0 2023-08-25T04:18:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.729+0000 7faa592a0640 1 --2- 172.21.15.55:0/4137331516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa541601f0 0x7faa540b5c90 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00c770 tx=0x7faa4c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.729+0000 7faa497fa640 1 -- 172.21.15.55:0/4137331516 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c003b80 con 0x7faa541601f0 2023-08-25T04:18:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.729+0000 7faa497fa640 1 -- 172.21.15.55:0/4137331516 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c003ce0 con 0x7faa541601f0 2023-08-25T04:18:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.729+0000 7faa497fa640 1 -- 172.21.15.55:0/4137331516 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c00aa90 con 0x7faa541601f0 2023-08-25T04:18:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.729+0000 7faa5ad03640 1 -- 172.21.15.55:0/4137331516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa540ce7c0 con 0x7faa541601f0 2023-08-25T04:18:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.729+0000 7faa5ad03640 1 -- 172.21.15.55:0/4137331516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa540b5490 con 0x7faa541601f0 2023-08-25T04:18:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.729+0000 7faa5ad03640 1 -- 172.21.15.55:0/4137331516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa540b5970 con 0x7faa541601f0 2023-08-25T04:18:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.729+0000 7faa497fa640 1 -- 172.21.15.55:0/4137331516 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7faa4c00abf0 con 0x7faa541601f0 2023-08-25T04:18:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.729+0000 7faa497fa640 1 --2- 172.21.15.55:0/4137331516 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7faa400657a0 0x7faa40067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.729+0000 7faa497fa640 1 -- 172.21.15.55:0/4137331516 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5984+0+0 (secure 0 0 0) 0x7faa4c082cc0 con 0x7faa541601f0 2023-08-25T04:18:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.733+0000 7faa58a9f640 1 --2- 172.21.15.55:0/4137331516 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7faa400657a0 0x7faa40067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.733+0000 7faa58a9f640 1 --2- 172.21.15.55:0/4137331516 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7faa400657a0 0x7faa40067c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faa540b8690 tx=0x7faa50006f90 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:55.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.733+0000 7faa497fa640 1 -- 172.21.15.55:0/4137331516 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7faa4c089080 con 0x7faa541601f0 2023-08-25T04:18:55.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.893+0000 7faa5ad03640 1 -- 172.21.15.55:0/4137331516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7faa54073ec0 con 0x7faa541601f0 2023-08-25T04:18:55.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.897+0000 7faa497fa640 1 -- 172.21.15.55:0/4137331516 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7faa4c0506f0 con 0x7faa541601f0 2023-08-25T04:18:55.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.901+0000 7faa5ad03640 1 -- 172.21.15.55:0/4137331516 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7faa400657a0 msgr2=0x7faa40067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.901+0000 7faa5ad03640 1 --2- 172.21.15.55:0/4137331516 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7faa400657a0 0x7faa40067c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7faa540b8690 tx=0x7faa50006f90 comp rx=0 tx=0).stop 2023-08-25T04:18:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.901+0000 7faa5ad03640 1 -- 172.21.15.55:0/4137331516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa541601f0 msgr2=0x7faa540b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.901+0000 7faa5ad03640 1 --2- 172.21.15.55:0/4137331516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa541601f0 0x7faa540b5c90 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7faa4c00c770 tx=0x7faa4c00cc30 comp rx=0 tx=0).stop 2023-08-25T04:18:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.901+0000 7faa5ad03640 1 -- 172.21.15.55:0/4137331516 shutdown_connections 2023-08-25T04:18:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.901+0000 7faa5ad03640 1 --2- 172.21.15.55:0/4137331516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa541601f0 0x7faa540b5c90 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.901+0000 7faa5ad03640 1 --2- 172.21.15.55:0/4137331516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa5415e3c0 0x7faa540c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.901+0000 7faa5ad03640 1 --2- 172.21.15.55:0/4137331516 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7faa400657a0 0x7faa40067c60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.901+0000 7faa5ad03640 1 --2- 172.21.15.55:0/4137331516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa540d10c0 0x7faa540b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:55.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.901+0000 7faa5ad03640 1 -- 172.21.15.55:0/4137331516 >> 172.21.15.55:0/4137331516 conn(0x7faa540d27d0 msgr2=0x7faa540b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:55.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.901+0000 7faa5ad03640 1 -- 172.21.15.55:0/4137331516 shutdown_connections 2023-08-25T04:18:55.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:55.901+0000 7faa5ad03640 1 -- 172.21.15.55:0/4137331516 wait complete. 2023-08-25T04:18:55.919 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-08-25T04:18:56.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.061+0000 7f0d65537640 1 Processor -- start 2023-08-25T04:18:56.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.061+0000 7f0d65537640 1 -- start start 2023-08-25T04:18:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.065+0000 7f0d65537640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0d600cdde0 0x7f0d600ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.065+0000 7f0d65537640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d600b2e40 0x7f0d600b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.065+0000 7f0d65537640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d600b29b0 con 0x7f0d600d0da0 2023-08-25T04:18:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.065+0000 7f0d65537640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d600ce760 con 0x7f0d600b2e40 2023-08-25T04:18:56.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.065+0000 7f0d65537640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d600b1dc0 con 0x7f0d600cdde0 2023-08-25T04:18:56.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.065+0000 7f0d5effd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0d600d0da0 0x7f0d600d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48000/0 (socket says 172.21.15.55:48000) 2023-08-25T04:18:56.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.065+0000 7f0d5f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d600b2e40 0x7f0d600b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:56.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.065+0000 7f0d5effd640 1 -- 172.21.15.55:0/3079406799 learned_addr learned my addr 172.21.15.55:0/3079406799 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:56.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.065+0000 7f0d567fc640 1 --2- 172.21.15.55:0/3079406799 >> v2:172.21.15.110:3300/0 conn(0x7f0d600cdde0 0x7f0d600ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:56.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.065+0000 7f0d5f7fe640 1 -- 172.21.15.55:0/3079406799 >> v2:172.21.15.110:3300/0 conn(0x7f0d600cdde0 msgr2=0x7f0d600ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:56.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.065+0000 7f0d5f7fe640 1 --2- 172.21.15.55:0/3079406799 >> v2:172.21.15.110:3300/0 conn(0x7f0d600cdde0 0x7f0d600ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:56.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.065+0000 7f0d5f7fe640 1 -- 172.21.15.55:0/3079406799 >> v1:172.21.15.55:6789/0 conn(0x7f0d600d0da0 legacy=0x7f0d600d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:56.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.065+0000 7f0d5f7fe640 1 -- 172.21.15.55:0/3079406799 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d600b2080 con 0x7f0d600b2e40 2023-08-25T04:18:56.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.065+0000 7f0d5e7fc640 1 -- 172.21.15.55:0/3079406799 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295235592 0 0) 0x7f0d600b29b0 con 0x7f0d600d0da0 2023-08-25T04:18:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.069+0000 7f0d5f7fe640 1 --2- 172.21.15.55:0/3079406799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d600b2e40 0x7f0d600b32b0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f0d600d38c0 tx=0x7f0d5801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8bc1e784a044d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.069+0000 7f0d5e7fc640 1 -- 172.21.15.55:0/3079406799 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d580a8950 con 0x7f0d600b2e40 2023-08-25T04:18:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.069+0000 7f0d5e7fc640 1 -- 172.21.15.55:0/3079406799 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d580a8ab0 con 0x7f0d600b2e40 2023-08-25T04:18:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.069+0000 7f0d5e7fc640 1 -- 172.21.15.55:0/3079406799 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d580a8e40 con 0x7f0d600b2e40 2023-08-25T04:18:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.069+0000 7f0d65537640 1 -- 172.21.15.55:0/3079406799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d600b2e40 msgr2=0x7f0d600b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.069+0000 7f0d65537640 1 --2- 172.21.15.55:0/3079406799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d600b2e40 0x7f0d600b32b0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f0d600d38c0 tx=0x7f0d5801ec50 comp rx=0 tx=0).stop 2023-08-25T04:18:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.069+0000 7f0d65537640 1 -- 172.21.15.55:0/3079406799 shutdown_connections 2023-08-25T04:18:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.069+0000 7f0d65537640 1 --2- 172.21.15.55:0/3079406799 >> v2:172.21.15.110:3300/0 conn(0x7f0d600cdde0 0x7f0d600ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.069+0000 7f0d65537640 1 --2- 172.21.15.55:0/3079406799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d600b2e40 0x7f0d600b32b0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:56.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.069+0000 7f0d65537640 1 -- 172.21.15.55:0/3079406799 >> 172.21.15.55:0/3079406799 conn(0x7f0d6009bae0 msgr2=0x7f0d600d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:56.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.069+0000 7f0d65537640 1 -- 172.21.15.55:0/3079406799 shutdown_connections 2023-08-25T04:18:56.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.069+0000 7f0d65537640 1 -- 172.21.15.55:0/3079406799 wait complete. 2023-08-25T04:18:56.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.069+0000 7f0d65537640 1 Processor -- start 2023-08-25T04:18:56.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.069+0000 7f0d65537640 1 -- start start 2023-08-25T04:18:56.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d65537640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d600b2e40 0x7f0d600c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:56.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d65537640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d600cdde0 0x7f0d6015f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:56.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d65537640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d600d0da0 0x7f0d6015fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:56.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d65537640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600c9180 con 0x7f0d600cdde0 2023-08-25T04:18:56.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d65537640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6015d1b0 con 0x7f0d600d0da0 2023-08-25T04:18:56.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d65537640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d600c8ea0 con 0x7f0d600b2e40 2023-08-25T04:18:56.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d567fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d600cdde0 0x7f0d6015f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:56.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d567fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d600cdde0 0x7f0d6015f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50776/0 (socket says 172.21.15.55:50776) 2023-08-25T04:18:56.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d567fc640 1 -- 172.21.15.55:0/2563861604 learned_addr learned my addr 172.21.15.55:0/2563861604 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:56.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d5f7fe640 1 --2- 172.21.15.55:0/2563861604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d600d0da0 0x7f0d6015fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:56.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d5effd640 1 --2- 172.21.15.55:0/2563861604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d600b2e40 0x7f0d600c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:56.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d567fc640 1 -- 172.21.15.55:0/2563861604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d600b2e40 msgr2=0x7f0d600c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:56.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d567fc640 1 --2- 172.21.15.55:0/2563861604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d600b2e40 0x7f0d600c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:56.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d567fc640 1 -- 172.21.15.55:0/2563861604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d600d0da0 msgr2=0x7f0d6015fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:56.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d567fc640 1 --2- 172.21.15.55:0/2563861604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d600d0da0 0x7f0d6015fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:56.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d567fc640 1 -- 172.21.15.55:0/2563861604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d58009420 con 0x7f0d600cdde0 2023-08-25T04:18:56.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d567fc640 1 --2- 172.21.15.55:0/2563861604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d600cdde0 0x7f0d6015f6b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800d800 tx=0x7f0d4800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:56.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d57fff640 1 -- 172.21.15.55:0/2563861604 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4800b6c0 con 0x7f0d600cdde0 2023-08-25T04:18:56.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d57fff640 1 -- 172.21.15.55:0/2563861604 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4800b820 con 0x7f0d600cdde0 2023-08-25T04:18:56.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d57fff640 1 -- 172.21.15.55:0/2563861604 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4800bb90 con 0x7f0d600cdde0 2023-08-25T04:18:56.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d65537640 1 -- 172.21.15.55:0/2563861604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d600af500 con 0x7f0d600cdde0 2023-08-25T04:18:56.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d65537640 1 -- 172.21.15.55:0/2563861604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d600afac0 con 0x7f0d600cdde0 2023-08-25T04:18:56.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d65537640 1 -- 172.21.15.55:0/2563861604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6004dbe0 con 0x7f0d600cdde0 2023-08-25T04:18:56.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.073+0000 7f0d57fff640 1 -- 172.21.15.55:0/2563861604 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f0d4800bcf0 con 0x7f0d600cdde0 2023-08-25T04:18:56.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.077+0000 7f0d57fff640 1 --2- 172.21.15.55:0/2563861604 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f0d400657a0 0x7f0d40067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:56.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.077+0000 7f0d57fff640 1 -- 172.21.15.55:0/2563861604 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f0d480834b0 con 0x7f0d600cdde0 2023-08-25T04:18:56.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.077+0000 7f0d5effd640 1 --2- 172.21.15.55:0/2563861604 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f0d400657a0 0x7f0d40067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:56.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.077+0000 7f0d5effd640 1 --2- 172.21.15.55:0/2563861604 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f0d400657a0 0x7f0d40067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0d50001d80 tx=0x7f0d50009040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:56.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.081+0000 7f0d57fff640 1 -- 172.21.15.55:0/2563861604 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0d48054950 con 0x7f0d600cdde0 2023-08-25T04:18:56.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.293+0000 7f0d65537640 1 -- 172.21.15.55:0/2563861604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f0d600d0b80 con 0x7f0d600cdde0 2023-08-25T04:18:56.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.701+0000 7f0d57fff640 1 -- 172.21.15.55:0/2563861604 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v590) v1 ==== 156+0+0 (secure 0 0 0) 0x7f0d48011340 con 0x7f0d600cdde0 2023-08-25T04:18:56.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.705+0000 7f0d65537640 1 -- 172.21.15.55:0/2563861604 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f0d400657a0 msgr2=0x7f0d40067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:56.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.705+0000 7f0d65537640 1 --2- 172.21.15.55:0/2563861604 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f0d400657a0 0x7f0d40067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0d50001d80 tx=0x7f0d50009040 comp rx=0 tx=0).stop 2023-08-25T04:18:56.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.705+0000 7f0d65537640 1 -- 172.21.15.55:0/2563861604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d600cdde0 msgr2=0x7f0d6015f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:56.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.705+0000 7f0d65537640 1 --2- 172.21.15.55:0/2563861604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d600cdde0 0x7f0d6015f6b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800d800 tx=0x7f0d4800dcc0 comp rx=0 tx=0).stop 2023-08-25T04:18:56.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.705+0000 7f0d65537640 1 -- 172.21.15.55:0/2563861604 shutdown_connections 2023-08-25T04:18:56.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.705+0000 7f0d65537640 1 --2- 172.21.15.55:0/2563861604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d600d0da0 0x7f0d6015fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:56.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.705+0000 7f0d65537640 1 --2- 172.21.15.55:0/2563861604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d600cdde0 0x7f0d6015f6b0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:56.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.705+0000 7f0d65537640 1 --2- 172.21.15.55:0/2563861604 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f0d400657a0 0x7f0d40067c60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:56.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.705+0000 7f0d65537640 1 --2- 172.21.15.55:0/2563861604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d600b2e40 0x7f0d600c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:56.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.705+0000 7f0d65537640 1 -- 172.21.15.55:0/2563861604 >> 172.21.15.55:0/2563861604 conn(0x7f0d6009bae0 msgr2=0x7f0d6006afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:56.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.705+0000 7f0d65537640 1 -- 172.21.15.55:0/2563861604 shutdown_connections 2023-08-25T04:18:56.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.705+0000 7f0d65537640 1 -- 172.21.15.55:0/2563861604 wait complete. 2023-08-25T04:18:56.726 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-08-25T04:18:56.727 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-08-25T04:18:56.727 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-25T04:18:56.727 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-08-25T04:18:56.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.873+0000 7f8928acb640 1 Processor -- start 2023-08-25T04:18:56.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.873+0000 7f8928acb640 1 -- start start 2023-08-25T04:18:56.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.873+0000 7f8928acb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f892415c9c0 0x7f8924160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:56.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.873+0000 7f8928acb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89240cfa70 0x7f8924160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:56.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.873+0000 7f8928acb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f892406eaf0 con 0x7f8924160f90 2023-08-25T04:18:56.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.873+0000 7f8928acb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892406e530 con 0x7f89240cfa70 2023-08-25T04:18:56.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.873+0000 7f8928acb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892406e810 con 0x7f892415c9c0 2023-08-25T04:18:56.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.873+0000 7f891bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89240cfa70 0x7f8924160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:56.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.873+0000 7f891bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89240cfa70 0x7f8924160a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50782/0 (socket says 172.21.15.55:50782) 2023-08-25T04:18:56.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.873+0000 7f891bfff640 1 -- 172.21.15.55:0/1299062489 learned_addr learned my addr 172.21.15.55:0/1299062489 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:56.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.873+0000 7f892259c640 1 --2- 172.21.15.55:0/1299062489 >> v2:172.21.15.110:3300/0 conn(0x7f892415c9c0 0x7f8924160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:56.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.877+0000 7f891bfff640 1 -- 172.21.15.55:0/1299062489 >> v2:172.21.15.110:3300/0 conn(0x7f892415c9c0 msgr2=0x7f8924160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:56.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.877+0000 7f891bfff640 1 --2- 172.21.15.55:0/1299062489 >> v2:172.21.15.110:3300/0 conn(0x7f892415c9c0 0x7f8924160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:56.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.877+0000 7f891bfff640 1 -- 172.21.15.55:0/1299062489 >> v1:172.21.15.110:6789/0 conn(0x7f8924160f90 legacy=0x7f89240ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:56.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.877+0000 7f891bfff640 1 -- 172.21.15.55:0/1299062489 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892406aab0 con 0x7f89240cfa70 2023-08-25T04:18:56.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.877+0000 7f891bfff640 1 --2- 172.21.15.55:0/1299062489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89240cfa70 0x7f8924160a50 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f8924070600 tx=0x7f890c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3b0a931f7d5768 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:56.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.877+0000 7f8921d9b640 1 -- 172.21.15.55:0/1299062489 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c0ac640 con 0x7f89240cfa70 2023-08-25T04:18:56.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.877+0000 7f8921d9b640 1 -- 172.21.15.55:0/1299062489 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c0ac7a0 con 0x7f89240cfa70 2023-08-25T04:18:56.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.877+0000 7f8921d9b640 1 -- 172.21.15.55:0/1299062489 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c0acb30 con 0x7f89240cfa70 2023-08-25T04:18:56.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.877+0000 7f8928acb640 1 -- 172.21.15.55:0/1299062489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89240cfa70 msgr2=0x7f8924160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:56.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.877+0000 7f8928acb640 1 --2- 172.21.15.55:0/1299062489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89240cfa70 0x7f8924160a50 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f8924070600 tx=0x7f890c01c4d0 comp rx=0 tx=0).stop 2023-08-25T04:18:56.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f8928acb640 1 -- 172.21.15.55:0/1299062489 shutdown_connections 2023-08-25T04:18:56.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f8928acb640 1 --2- 172.21.15.55:0/1299062489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89240cfa70 0x7f8924160a50 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:56.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f8928acb640 1 --2- 172.21.15.55:0/1299062489 >> v2:172.21.15.110:3300/0 conn(0x7f892415c9c0 0x7f8924160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:56.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f8928acb640 1 -- 172.21.15.55:0/1299062489 >> 172.21.15.55:0/1299062489 conn(0x7f89240d05a0 msgr2=0x7f89240d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:56.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f8928acb640 1 -- 172.21.15.55:0/1299062489 shutdown_connections 2023-08-25T04:18:56.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f8928acb640 1 -- 172.21.15.55:0/1299062489 wait complete. 2023-08-25T04:18:56.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f8928acb640 1 Processor -- start 2023-08-25T04:18:56.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f8928acb640 1 -- start start 2023-08-25T04:18:56.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f8928acb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89240cfa70 0x7f8924150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:56.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f8928acb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f892415c9c0 0x7f892415e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:56.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f8928acb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8924160f90 0x7f892415e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:56.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f8928acb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89240c4420 con 0x7f892415c9c0 2023-08-25T04:18:56.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f8928acb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8924152550 con 0x7f8924160f90 2023-08-25T04:18:56.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f8928acb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8924151290 con 0x7f89240cfa70 2023-08-25T04:18:56.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f891bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f892415c9c0 0x7f892415e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:56.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f891bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f892415c9c0 0x7f892415e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50786/0 (socket says 172.21.15.55:50786) 2023-08-25T04:18:56.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f891bfff640 1 -- 172.21.15.55:0/67785642 learned_addr learned my addr 172.21.15.55:0/67785642 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:56.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f8922d9d640 1 --2- 172.21.15.55:0/67785642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8924160f90 0x7f892415e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:56.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f892259c640 1 --2- 172.21.15.55:0/67785642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89240cfa70 0x7f8924150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:56.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f891bfff640 1 -- 172.21.15.55:0/67785642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89240cfa70 msgr2=0x7f8924150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:56.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f891bfff640 1 --2- 172.21.15.55:0/67785642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89240cfa70 0x7f8924150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:56.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f891bfff640 1 -- 172.21.15.55:0/67785642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8924160f90 msgr2=0x7f892415e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:56.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f891bfff640 1 --2- 172.21.15.55:0/67785642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8924160f90 0x7f892415e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:56.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f891bfff640 1 -- 172.21.15.55:0/67785642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c0094d0 con 0x7f892415c9c0 2023-08-25T04:18:56.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.881+0000 7f891bfff640 1 --2- 172.21.15.55:0/67785642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f892415c9c0 0x7f892415e090 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f890c0190e0 tx=0x7f890c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:56.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.885+0000 7f891affd640 1 -- 172.21.15.55:0/67785642 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c0b7650 con 0x7f892415c9c0 2023-08-25T04:18:56.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.885+0000 7f891affd640 1 -- 172.21.15.55:0/67785642 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c0b77d0 con 0x7f892415c9c0 2023-08-25T04:18:56.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.885+0000 7f891affd640 1 -- 172.21.15.55:0/67785642 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c0b7b80 con 0x7f892415c9c0 2023-08-25T04:18:56.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.885+0000 7f8928acb640 1 -- 172.21.15.55:0/67785642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8924151940 con 0x7f892415c9c0 2023-08-25T04:18:56.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.885+0000 7f8928acb640 1 -- 172.21.15.55:0/67785642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8924151f00 con 0x7f892415c9c0 2023-08-25T04:18:56.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.885+0000 7f8928acb640 1 -- 172.21.15.55:0/67785642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8924152700 con 0x7f892415c9c0 2023-08-25T04:18:56.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.885+0000 7f891affd640 1 -- 172.21.15.55:0/67785642 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f890c0b3070 con 0x7f892415c9c0 2023-08-25T04:18:56.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.885+0000 7f891affd640 1 --2- 172.21.15.55:0/67785642 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f89040657d0 0x7f8904067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:56.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.885+0000 7f891affd640 1 -- 172.21.15.55:0/67785642 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f890c11d9f0 con 0x7f892415c9c0 2023-08-25T04:18:56.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.885+0000 7f892259c640 1 --2- 172.21.15.55:0/67785642 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f89040657d0 0x7f8904067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:56.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.889+0000 7f892259c640 1 --2- 172.21.15.55:0/67785642 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f89040657d0 0x7f8904067c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8914009aa0 tx=0x7f8914006f90 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:56.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:56.889+0000 7f891affd640 1 -- 172.21.15.55:0/67785642 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8924152700 con 0x7f892415c9c0 2023-08-25T04:18:57.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.101+0000 7f8928acb640 1 -- 172.21.15.55:0/67785642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f8924152700 con 0x7f892415c9c0 2023-08-25T04:18:57.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.709+0000 7f891affd640 1 -- 172.21.15.55:0/67785642 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v591) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8924152700 con 0x7f892415c9c0 2023-08-25T04:18:57.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.713+0000 7f8928acb640 1 -- 172.21.15.55:0/67785642 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f89040657d0 msgr2=0x7f8904067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:57.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.713+0000 7f8928acb640 1 --2- 172.21.15.55:0/67785642 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f89040657d0 0x7f8904067c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8914009aa0 tx=0x7f8914006f90 comp rx=0 tx=0).stop 2023-08-25T04:18:57.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.713+0000 7f8928acb640 1 -- 172.21.15.55:0/67785642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f892415c9c0 msgr2=0x7f892415e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:57.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.713+0000 7f8928acb640 1 --2- 172.21.15.55:0/67785642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f892415c9c0 0x7f892415e090 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f890c0190e0 tx=0x7f890c01ad10 comp rx=0 tx=0).stop 2023-08-25T04:18:57.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.713+0000 7f8928acb640 1 -- 172.21.15.55:0/67785642 shutdown_connections 2023-08-25T04:18:57.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.713+0000 7f8928acb640 1 --2- 172.21.15.55:0/67785642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8924160f90 0x7f892415e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:57.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.713+0000 7f8928acb640 1 --2- 172.21.15.55:0/67785642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f892415c9c0 0x7f892415e090 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:57.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.713+0000 7f8928acb640 1 --2- 172.21.15.55:0/67785642 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f89040657d0 0x7f8904067c90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:57.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.713+0000 7f8928acb640 1 --2- 172.21.15.55:0/67785642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89240cfa70 0x7f8924150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:57.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.713+0000 7f8928acb640 1 -- 172.21.15.55:0/67785642 >> 172.21.15.55:0/67785642 conn(0x7f89240d05a0 msgr2=0x7f89240aeb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:57.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.713+0000 7f8928acb640 1 -- 172.21.15.55:0/67785642 shutdown_connections 2023-08-25T04:18:57.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.713+0000 7f8928acb640 1 -- 172.21.15.55:0/67785642 wait complete. 2023-08-25T04:18:57.736 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:18:57.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.881+0000 7f94c92e2640 1 Processor -- start 2023-08-25T04:18:57.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c92e2640 1 -- start start 2023-08-25T04:18:57.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c92e2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f94c415ca50 0x7f94c40d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:57.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c92e2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c40d0f50 0x7f94c406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:57.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c92e2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f94c406c150 0x7f94c40b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:57.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c92e2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c40d13d0 con 0x7f94c415ca50 2023-08-25T04:18:57.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c92e2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c40afe20 con 0x7f94c406c150 2023-08-25T04:18:57.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c92e2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40af210 con 0x7f94c40d0f50 2023-08-25T04:18:57.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f94c415ca50 0x7f94c40d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:57.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f94c415ca50 0x7f94c40d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50802/0 (socket says 172.21.15.55:50802) 2023-08-25T04:18:57.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c3fff640 1 -- 172.21.15.55:0/4108059089 learned_addr learned my addr 172.21.15.55:0/4108059089 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:57.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c37fe640 1 --2- 172.21.15.55:0/4108059089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c40d0f50 0x7f94c406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:57.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c8ae1640 1 --2- 172.21.15.55:0/4108059089 >> v2:172.21.15.110:3300/0 conn(0x7f94c406c150 0x7f94c40b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:57.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c3fff640 1 -- 172.21.15.55:0/4108059089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c40d0f50 msgr2=0x7f94c406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:57.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c3fff640 1 --2- 172.21.15.55:0/4108059089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c40d0f50 0x7f94c406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:57.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c3fff640 1 -- 172.21.15.55:0/4108059089 >> v2:172.21.15.110:3300/0 conn(0x7f94c406c150 msgr2=0x7f94c40b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:57.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c3fff640 1 --2- 172.21.15.55:0/4108059089 >> v2:172.21.15.110:3300/0 conn(0x7f94c406c150 0x7f94c40b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:57.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c3fff640 1 -- 172.21.15.55:0/4108059089 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c40af4f0 con 0x7f94c415ca50 2023-08-25T04:18:57.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c8ae1640 1 --2- 172.21.15.55:0/4108059089 >> v2:172.21.15.110:3300/0 conn(0x7f94c406c150 0x7f94c40b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:57.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.885+0000 7f94c37fe640 1 --2- 172.21.15.55:0/4108059089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c40d0f50 0x7f94c406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:57.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.889+0000 7f94c3fff640 1 --2- 172.21.15.55:0/4108059089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94c415ca50 0x7f94c40d0a10 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f94c40c6080 tx=0x7f94b401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc593c041bab2e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:57.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.889+0000 7f94c2ffd640 1 -- 172.21.15.55:0/4108059089 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b40ab600 con 0x7f94c415ca50 2023-08-25T04:18:57.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.889+0000 7f94c2ffd640 1 -- 172.21.15.55:0/4108059089 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b40a7050 con 0x7f94c415ca50 2023-08-25T04:18:57.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.889+0000 7f94c2ffd640 1 -- 172.21.15.55:0/4108059089 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b40ab980 con 0x7f94c415ca50 2023-08-25T04:18:57.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.889+0000 7f94c92e2640 1 -- 172.21.15.55:0/4108059089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94c415ca50 msgr2=0x7f94c40d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:57.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.889+0000 7f94c92e2640 1 --2- 172.21.15.55:0/4108059089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94c415ca50 0x7f94c40d0a10 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f94c40c6080 tx=0x7f94b401c210 comp rx=0 tx=0).stop 2023-08-25T04:18:57.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.889+0000 7f94c92e2640 1 -- 172.21.15.55:0/4108059089 shutdown_connections 2023-08-25T04:18:57.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.889+0000 7f94c92e2640 1 --2- 172.21.15.55:0/4108059089 >> v2:172.21.15.110:3300/0 conn(0x7f94c406c150 0x7f94c40b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:57.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.889+0000 7f94c92e2640 1 --2- 172.21.15.55:0/4108059089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c40d0f50 0x7f94c406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:57.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.889+0000 7f94c92e2640 1 --2- 172.21.15.55:0/4108059089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94c415ca50 0x7f94c40d0a10 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:57.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.889+0000 7f94c92e2640 1 -- 172.21.15.55:0/4108059089 >> 172.21.15.55:0/4108059089 conn(0x7f94c4065f40 msgr2=0x7f94c409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:57.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.889+0000 7f94c92e2640 1 -- 172.21.15.55:0/4108059089 shutdown_connections 2023-08-25T04:18:57.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.889+0000 7f94c92e2640 1 -- 172.21.15.55:0/4108059089 wait complete. 2023-08-25T04:18:57.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.889+0000 7f94c92e2640 1 Processor -- start 2023-08-25T04:18:57.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.889+0000 7f94c92e2640 1 -- start start 2023-08-25T04:18:57.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c92e2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94c406c150 0x7f94c414aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:57.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c92e2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94c40d0f50 0x7f94c40b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:57.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c92e2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c415ca50 0x7f94c40cf350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:57.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c92e2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40b3950 con 0x7f94c406c150 2023-08-25T04:18:57.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c92e2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40b3390 con 0x7f94c40d0f50 2023-08-25T04:18:57.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c92e2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c40b3670 con 0x7f94c415ca50 2023-08-25T04:18:57.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94c406c150 0x7f94c414aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:57.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94c406c150 0x7f94c414aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50804/0 (socket says 172.21.15.55:50804) 2023-08-25T04:18:57.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c3fff640 1 -- 172.21.15.55:0/2589864951 learned_addr learned my addr 172.21.15.55:0/2589864951 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:57.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c37fe640 1 --2- 172.21.15.55:0/2589864951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94c40d0f50 0x7f94c40b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:57.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c8ae1640 1 --2- 172.21.15.55:0/2589864951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c415ca50 0x7f94c40cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:57.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c3fff640 1 -- 172.21.15.55:0/2589864951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c415ca50 msgr2=0x7f94c40cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:57.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c3fff640 1 --2- 172.21.15.55:0/2589864951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c415ca50 0x7f94c40cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:57.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c3fff640 1 -- 172.21.15.55:0/2589864951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94c40d0f50 msgr2=0x7f94c40b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:57.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c3fff640 1 --2- 172.21.15.55:0/2589864951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94c40d0f50 0x7f94c40b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:57.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c3fff640 1 -- 172.21.15.55:0/2589864951 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b4009480 con 0x7f94c406c150 2023-08-25T04:18:57.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c3fff640 1 --2- 172.21.15.55:0/2589864951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94c406c150 0x7f94c414aff0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f94b401a8c0 tx=0x7f94b4018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:57.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c0ff9640 1 -- 172.21.15.55:0/2589864951 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4003bf0 con 0x7f94c406c150 2023-08-25T04:18:57.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c0ff9640 1 -- 172.21.15.55:0/2589864951 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b4003d50 con 0x7f94c406c150 2023-08-25T04:18:57.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c0ff9640 1 -- 172.21.15.55:0/2589864951 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b40b4620 con 0x7f94c406c150 2023-08-25T04:18:57.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c92e2640 1 -- 172.21.15.55:0/2589864951 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c415a0a0 con 0x7f94c406c150 2023-08-25T04:18:57.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c92e2640 1 -- 172.21.15.55:0/2589864951 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c414b530 con 0x7f94c406c150 2023-08-25T04:18:57.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c92e2640 1 -- 172.21.15.55:0/2589864951 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c4159f00 con 0x7f94c406c150 2023-08-25T04:18:57.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.893+0000 7f94c0ff9640 1 -- 172.21.15.55:0/2589864951 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f94b40b2070 con 0x7f94c406c150 2023-08-25T04:18:57.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.897+0000 7f94c0ff9640 1 --2- 172.21.15.55:0/2589864951 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f94b00657d0 0x7f94b0067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:57.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.897+0000 7f94c0ff9640 1 -- 172.21.15.55:0/2589864951 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f94b411c160 con 0x7f94c406c150 2023-08-25T04:18:57.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.897+0000 7f94c37fe640 1 --2- 172.21.15.55:0/2589864951 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f94b00657d0 0x7f94b0067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:57.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.897+0000 7f94c37fe640 1 --2- 172.21.15.55:0/2589864951 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f94b00657d0 0x7f94b0067c90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f94c414f780 tx=0x7f94b8008040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:57.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:57.901+0000 7f94c0ff9640 1 -- 172.21.15.55:0/2589864951 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f94c4159f00 con 0x7f94c406c150 2023-08-25T04:18:58.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.057+0000 7f94c92e2640 1 -- 172.21.15.55:0/2589864951 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94c4159f00 con 0x7f94c406c150 2023-08-25T04:18:58.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.057+0000 7f94c0ff9640 1 -- 172.21.15.55:0/2589864951 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+15798 (secure 0 0 0) 0x7f94c4159f00 con 0x7f94c406c150 2023-08-25T04:18:58.057 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:58.057 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":84,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:18:54.693171+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6834/1124967220":"2023-08-26T04:18:51.559197+0000","172.21.15.55:6832/1124967220":"2023-08-26T04:18:51.559197+0000","172.21.15.110:0/3291454703":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/1630782667":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/3809550274":"2023-08-26T04:18:48.288464+0000","172.21.15.110:6832/3289898378":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/3820039496":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/542484536":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/3539787169":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/696687172":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/2505659035":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/1748509305":"2023-08-26T04:18:42.450252+0000","172.21.15.110:6833/3289898378":"2023-08-26T04:18:48.288464+0000","172.21.15.110:0/584064839":"2023-08-26T04:18:42.450252+0000","172.21.15.110:6833/2283645732":"2023-08-26T04:18:42.450252+0000","172.21.15.110:6832/2283645732":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/3198972450":"2023-08-26T04:18:42.450252+0000","172.21.15.110:0/1819842818":"2023-08-26T04:18:42.450252+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:18:58.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.057+0000 7f94c92e2640 1 -- 172.21.15.55:0/2589864951 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f94b00657d0 msgr2=0x7f94b0067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:58.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.057+0000 7f94c92e2640 1 --2- 172.21.15.55:0/2589864951 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f94b00657d0 0x7f94b0067c90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f94c414f780 tx=0x7f94b8008040 comp rx=0 tx=0).stop 2023-08-25T04:18:58.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.057+0000 7f94c92e2640 1 -- 172.21.15.55:0/2589864951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94c406c150 msgr2=0x7f94c414aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:58.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.057+0000 7f94c92e2640 1 --2- 172.21.15.55:0/2589864951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94c406c150 0x7f94c414aff0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f94b401a8c0 tx=0x7f94b4018fb0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.057+0000 7f94c92e2640 1 -- 172.21.15.55:0/2589864951 shutdown_connections 2023-08-25T04:18:58.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.057+0000 7f94c92e2640 1 --2- 172.21.15.55:0/2589864951 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f94b00657d0 0x7f94b0067c90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.057+0000 7f94c92e2640 1 --2- 172.21.15.55:0/2589864951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94c415ca50 0x7f94c40cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.057+0000 7f94c92e2640 1 --2- 172.21.15.55:0/2589864951 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94c40d0f50 0x7f94c40b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.057+0000 7f94c92e2640 1 --2- 172.21.15.55:0/2589864951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94c406c150 0x7f94c414aff0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.057+0000 7f94c92e2640 1 -- 172.21.15.55:0/2589864951 >> 172.21.15.55:0/2589864951 conn(0x7f94c4065f40 msgr2=0x7f94c415ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:58.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.057+0000 7f94c92e2640 1 -- 172.21.15.55:0/2589864951 shutdown_connections 2023-08-25T04:18:58.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.057+0000 7f94c92e2640 1 -- 172.21.15.55:0/2589864951 wait complete. 2023-08-25T04:18:58.078 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:18:58.079 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:18:58.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.225+0000 7f3e7c0d8640 1 Processor -- start 2023-08-25T04:18:58.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.225+0000 7f3e7c0d8640 1 -- start start 2023-08-25T04:18:58.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.229+0000 7f3e7c0d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3e7406c020 0x7f3e7409bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:58.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.229+0000 7f3e7c0d8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e7415abd0 con 0x7f3e740c9830 2023-08-25T04:18:58.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.229+0000 7f3e7c0d8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e740c8ab0 con 0x7f3e7415a7f0 2023-08-25T04:18:58.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.229+0000 7f3e7c0d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e740c8d50 con 0x7f3e7406c020 2023-08-25T04:18:58.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.229+0000 7f3e7a675640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3e7406c020 0x7f3e7409bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:58.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.229+0000 7f3e79673640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3e740c9830 0x7f3e740acff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48008/0 (socket says 172.21.15.55:48008) 2023-08-25T04:18:58.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.229+0000 7f3e7a675640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3e7406c020 0x7f3e7409bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50816/0 (socket says 172.21.15.55:50816) 2023-08-25T04:18:58.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.229+0000 7f3e79673640 1 -- 172.21.15.55:0/2725356877 learned_addr learned my addr 172.21.15.55:0/2725356877 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:58.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.229+0000 7f3e7a675640 1 -- 172.21.15.55:0/2725356877 >> v1:172.21.15.110:6789/0 conn(0x7f3e7415a7f0 legacy=0x7f3e74070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.229+0000 7f3e7a675640 1 -- 172.21.15.55:0/2725356877 >> v1:172.21.15.55:6789/0 conn(0x7f3e740c9830 legacy=0x7f3e740acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.229+0000 7f3e7a675640 1 -- 172.21.15.55:0/2725356877 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e740c9030 con 0x7f3e7406c020 2023-08-25T04:18:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.229+0000 7f3e7a675640 1 --2- 172.21.15.55:0/2725356877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e7406c020 0x7f3e7409bde0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c009d90 tx=0x7f3e6c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b82fcab3b2a9303 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.233+0000 7f3e78e72640 1 -- 172.21.15.55:0/2725356877 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c0a58b0 con 0x7f3e7406c020 2023-08-25T04:18:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.233+0000 7f3e78e72640 1 -- 172.21.15.55:0/2725356877 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c0a5a10 con 0x7f3e7406c020 2023-08-25T04:18:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.233+0000 7f3e78e72640 1 -- 172.21.15.55:0/2725356877 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c0a5da0 con 0x7f3e7406c020 2023-08-25T04:18:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.233+0000 7f3e7c0d8640 1 -- 172.21.15.55:0/2725356877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e7406c020 msgr2=0x7f3e7409bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.233+0000 7f3e7c0d8640 1 --2- 172.21.15.55:0/2725356877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e7406c020 0x7f3e7409bde0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c009d90 tx=0x7f3e6c01c8e0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.233+0000 7f3e7c0d8640 1 -- 172.21.15.55:0/2725356877 shutdown_connections 2023-08-25T04:18:58.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.233+0000 7f3e7c0d8640 1 --2- 172.21.15.55:0/2725356877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e7406c020 0x7f3e7409bde0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.233+0000 7f3e7c0d8640 1 -- 172.21.15.55:0/2725356877 >> 172.21.15.55:0/2725356877 conn(0x7f3e74069900 msgr2=0x7f3e74069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:58.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.233+0000 7f3e7c0d8640 1 -- 172.21.15.55:0/2725356877 shutdown_connections 2023-08-25T04:18:58.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.233+0000 7f3e7c0d8640 1 -- 172.21.15.55:0/2725356877 wait complete. 2023-08-25T04:18:58.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.233+0000 7f3e7c0d8640 1 Processor -- start 2023-08-25T04:18:58.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.233+0000 7f3e7c0d8640 1 -- start start 2023-08-25T04:18:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.233+0000 7f3e7c0d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e7406c020 0x7f3e740c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.233+0000 7f3e7c0d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e740c9830 0x7f3e74159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.233+0000 7f3e7c0d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e7415a7f0 0x7f3e74159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.233+0000 7f3e7c0d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e740acd60 con 0x7f3e740c9830 2023-08-25T04:18:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.233+0000 7f3e7c0d8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e740ac150 con 0x7f3e7415a7f0 2023-08-25T04:18:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.233+0000 7f3e7c0d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e740ac430 con 0x7f3e7406c020 2023-08-25T04:18:58.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e79673640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e740c9830 0x7f3e74159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:58.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e79673640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e740c9830 0x7f3e74159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50824/0 (socket says 172.21.15.55:50824) 2023-08-25T04:18:58.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e79673640 1 -- 172.21.15.55:0/1258385307 learned_addr learned my addr 172.21.15.55:0/1258385307 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:58.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e79e74640 1 --2- 172.21.15.55:0/1258385307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e7406c020 0x7f3e740c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:58.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e7a675640 1 --2- 172.21.15.55:0/1258385307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e7415a7f0 0x7f3e74159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:58.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e79673640 1 -- 172.21.15.55:0/1258385307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e7406c020 msgr2=0x7f3e740c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:58.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e79673640 1 --2- 172.21.15.55:0/1258385307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e7406c020 0x7f3e740c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e79673640 1 -- 172.21.15.55:0/1258385307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e7415a7f0 msgr2=0x7f3e74159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:58.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e79673640 1 --2- 172.21.15.55:0/1258385307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e7415a7f0 0x7f3e74159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e79673640 1 -- 172.21.15.55:0/1258385307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c009a70 con 0x7f3e740c9830 2023-08-25T04:18:58.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e7a675640 1 --2- 172.21.15.55:0/1258385307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e7415a7f0 0x7f3e74159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:58.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e79673640 1 --2- 172.21.15.55:0/1258385307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e740c9830 0x7f3e74159350 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400c400 tx=0x7f3e6400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:58.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e6a7fc640 1 -- 172.21.15.55:0/1258385307 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64005cf0 con 0x7f3e740c9830 2023-08-25T04:18:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e6a7fc640 1 -- 172.21.15.55:0/1258385307 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e64005e50 con 0x7f3e740c9830 2023-08-25T04:18:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e6a7fc640 1 -- 172.21.15.55:0/1258385307 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e640072d0 con 0x7f3e740c9830 2023-08-25T04:18:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e7c0d8640 1 -- 172.21.15.55:0/1258385307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e740adc90 con 0x7f3e740c9830 2023-08-25T04:18:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e7c0d8640 1 -- 172.21.15.55:0/1258385307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e740ac9f0 con 0x7f3e740c9830 2023-08-25T04:18:58.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e7c0d8640 1 -- 172.21.15.55:0/1258385307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e7406d5b0 con 0x7f3e740c9830 2023-08-25T04:18:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e6a7fc640 1 -- 172.21.15.55:0/1258385307 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f3e64007430 con 0x7f3e740c9830 2023-08-25T04:18:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e6a7fc640 1 --2- 172.21.15.55:0/1258385307 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f3e580657a0 0x7f3e58067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.237+0000 7f3e6a7fc640 1 -- 172.21.15.55:0/1258385307 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f3e64082390 con 0x7f3e740c9830 2023-08-25T04:18:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.241+0000 7f3e79e74640 1 --2- 172.21.15.55:0/1258385307 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f3e580657a0 0x7f3e58067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.241+0000 7f3e79e74640 1 --2- 172.21.15.55:0/1258385307 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f3e580657a0 0x7f3e58067c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e70004fc0 tx=0x7f3e70007e90 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.245+0000 7f3e6a7fc640 1 -- 172.21.15.55:0/1258385307 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3e6404fe90 con 0x7f3e740c9830 2023-08-25T04:18:58.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.401+0000 7f3e7c0d8640 1 -- 172.21.15.55:0/1258385307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3e74073ec0 con 0x7f3e740c9830 2023-08-25T04:18:58.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.405+0000 7f3e6a7fc640 1 -- 172.21.15.55:0/1258385307 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3e640534b0 con 0x7f3e740c9830 2023-08-25T04:18:58.404 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:18:58.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.405+0000 7f3e7c0d8640 1 -- 172.21.15.55:0/1258385307 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f3e580657a0 msgr2=0x7f3e58067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:58.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.405+0000 7f3e7c0d8640 1 --2- 172.21.15.55:0/1258385307 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f3e580657a0 0x7f3e58067c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e70004fc0 tx=0x7f3e70007e90 comp rx=0 tx=0).stop 2023-08-25T04:18:58.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.405+0000 7f3e7c0d8640 1 -- 172.21.15.55:0/1258385307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e740c9830 msgr2=0x7f3e74159350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:58.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.405+0000 7f3e7c0d8640 1 --2- 172.21.15.55:0/1258385307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e740c9830 0x7f3e74159350 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f3e6400c400 tx=0x7f3e6400c8c0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.405+0000 7f3e7c0d8640 1 -- 172.21.15.55:0/1258385307 shutdown_connections 2023-08-25T04:18:58.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.405+0000 7f3e7c0d8640 1 --2- 172.21.15.55:0/1258385307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3e7415a7f0 0x7f3e74159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.405+0000 7f3e7c0d8640 1 --2- 172.21.15.55:0/1258385307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e740c9830 0x7f3e74159350 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.405+0000 7f3e7c0d8640 1 --2- 172.21.15.55:0/1258385307 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f3e580657a0 0x7f3e58067c60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.405+0000 7f3e7c0d8640 1 --2- 172.21.15.55:0/1258385307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3e7406c020 0x7f3e740c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.405+0000 7f3e7c0d8640 1 -- 172.21.15.55:0/1258385307 >> 172.21.15.55:0/1258385307 conn(0x7f3e74069900 msgr2=0x7f3e7415e210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:58.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.405+0000 7f3e7c0d8640 1 -- 172.21.15.55:0/1258385307 shutdown_connections 2023-08-25T04:18:58.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.405+0000 7f3e7c0d8640 1 -- 172.21.15.55:0/1258385307 wait complete. 2023-08-25T04:18:58.425 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:18:58.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.573+0000 7fc0b9d82640 1 Processor -- start 2023-08-25T04:18:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.573+0000 7fc0b9d82640 1 -- start start 2023-08-25T04:18:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.573+0000 7fc0b9d82640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0b40c9900 0x7fc0b40cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.573+0000 7fc0b9d82640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b40c9d90 con 0x7fc0b406c720 2023-08-25T04:18:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.573+0000 7fc0b9d82640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b40cbca0 con 0x7fc0b40cb020 2023-08-25T04:18:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.573+0000 7fc0b9d82640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b40c9470 con 0x7fc0b40c9900 2023-08-25T04:18:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.573+0000 7fc0b2ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0b40c9900 0x7fc0b40cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:58.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.573+0000 7fc0b2ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0b40c9900 0x7fc0b40cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50840/0 (socket says 172.21.15.55:50840) 2023-08-25T04:18:58.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.573+0000 7fc0b2ffd640 1 -- 172.21.15.55:0/2123473793 learned_addr learned my addr 172.21.15.55:0/2123473793 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:58.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.573+0000 7fc0b3fff640 1 --1- 172.21.15.55:0/2123473793 >> v1:172.21.15.55:6789/0 conn(0x7fc0b406c720 0x7fc0b406cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48014/0 (socket says 172.21.15.55:48014) 2023-08-25T04:18:58.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.573+0000 7fc0b2ffd640 1 -- 172.21.15.55:0/2123473793 >> v1:172.21.15.110:6789/0 conn(0x7fc0b40cb020 legacy=0x7fc0b40cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:58.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.573+0000 7fc0b2ffd640 1 -- 172.21.15.55:0/2123473793 >> v1:172.21.15.55:6789/0 conn(0x7fc0b406c720 legacy=0x7fc0b406cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:58.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.573+0000 7fc0b2ffd640 1 -- 172.21.15.55:0/2123473793 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b40c8b40 con 0x7fc0b40c9900 2023-08-25T04:18:58.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.577+0000 7fc0b2ffd640 1 --2- 172.21.15.55:0/2123473793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0b40c9900 0x7fc0b40cdd50 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8009870 tx=0x7fc0a801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc0f85ecce5580 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:58.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.577+0000 7fc0b27fc640 1 -- 172.21.15.55:0/2123473793 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a80ab600 con 0x7fc0b40c9900 2023-08-25T04:18:58.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.577+0000 7fc0b27fc640 1 -- 172.21.15.55:0/2123473793 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a80a7050 con 0x7fc0b40c9900 2023-08-25T04:18:58.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.577+0000 7fc0b27fc640 1 -- 172.21.15.55:0/2123473793 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a80ab980 con 0x7fc0b40c9900 2023-08-25T04:18:58.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.577+0000 7fc0b9d82640 1 -- 172.21.15.55:0/2123473793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0b40c9900 msgr2=0x7fc0b40cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:58.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.577+0000 7fc0b9d82640 1 --2- 172.21.15.55:0/2123473793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0b40c9900 0x7fc0b40cdd50 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8009870 tx=0x7fc0a801c470 comp rx=0 tx=0).stop 2023-08-25T04:18:58.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.577+0000 7fc0b9d82640 1 -- 172.21.15.55:0/2123473793 shutdown_connections 2023-08-25T04:18:58.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.577+0000 7fc0b9d82640 1 --2- 172.21.15.55:0/2123473793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0b40c9900 0x7fc0b40cdd50 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.577+0000 7fc0b9d82640 1 -- 172.21.15.55:0/2123473793 >> 172.21.15.55:0/2123473793 conn(0x7fc0b4069900 msgr2=0x7fc0b4069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:58.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.577+0000 7fc0b9d82640 1 -- 172.21.15.55:0/2123473793 shutdown_connections 2023-08-25T04:18:58.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.577+0000 7fc0b9d82640 1 -- 172.21.15.55:0/2123473793 wait complete. 2023-08-25T04:18:58.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.577+0000 7fc0b9d82640 1 Processor -- start 2023-08-25T04:18:58.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b9d82640 1 -- start start 2023-08-25T04:18:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b9d82640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0b406c720 0x7fc0b40c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b9d82640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0b40c9900 0x7fc0b40b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b9d82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0b40cb020 0x7fc0b4157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b9d82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40c8440 con 0x7fc0b40cb020 2023-08-25T04:18:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b9d82640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40b0210 con 0x7fc0b40c9900 2023-08-25T04:18:58.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b9d82640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40af3e0 con 0x7fc0b406c720 2023-08-25T04:18:58.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0b40cb020 0x7fc0b4157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:58.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0b40cb020 0x7fc0b4157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50848/0 (socket says 172.21.15.55:50848) 2023-08-25T04:18:58.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b3fff640 1 -- 172.21.15.55:0/426048867 learned_addr learned my addr 172.21.15.55:0/426048867 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:58.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b37fe640 1 --2- 172.21.15.55:0/426048867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0b406c720 0x7fc0b40c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:58.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b2ffd640 1 --2- 172.21.15.55:0/426048867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0b40c9900 0x7fc0b40b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:58.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b3fff640 1 -- 172.21.15.55:0/426048867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0b406c720 msgr2=0x7fc0b40c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:58.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b3fff640 1 --2- 172.21.15.55:0/426048867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0b406c720 0x7fc0b40c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b3fff640 1 -- 172.21.15.55:0/426048867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0b40c9900 msgr2=0x7fc0b40b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:58.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b3fff640 1 --2- 172.21.15.55:0/426048867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0b40c9900 0x7fc0b40b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b3fff640 1 -- 172.21.15.55:0/426048867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a80094d0 con 0x7fc0b40cb020 2023-08-25T04:18:58.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b2ffd640 1 --2- 172.21.15.55:0/426048867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0b40c9900 0x7fc0b40b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:58.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b3fff640 1 --2- 172.21.15.55:0/426048867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0b40cb020 0x7fc0b4157670 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00c700 tx=0x7fc0ac00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:58.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc09bfff640 1 -- 172.21.15.55:0/426048867 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac00ce10 con 0x7fc0b40cb020 2023-08-25T04:18:58.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc09bfff640 1 -- 172.21.15.55:0/426048867 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ac00a640 con 0x7fc0b40cb020 2023-08-25T04:18:58.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc09bfff640 1 -- 172.21.15.55:0/426048867 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac00a9b0 con 0x7fc0b40cb020 2023-08-25T04:18:58.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b9d82640 1 -- 172.21.15.55:0/426048867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b40af8e0 con 0x7fc0b40cb020 2023-08-25T04:18:58.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b9d82640 1 -- 172.21.15.55:0/426048867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b40afea0 con 0x7fc0b40cb020 2023-08-25T04:18:58.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.581+0000 7fc0b9d82640 1 -- 172.21.15.55:0/426048867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b40b0380 con 0x7fc0b40cb020 2023-08-25T04:18:58.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.585+0000 7fc09bfff640 1 -- 172.21.15.55:0/426048867 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fc0ac00ab10 con 0x7fc0b40cb020 2023-08-25T04:18:58.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.585+0000 7fc09bfff640 1 --2- 172.21.15.55:0/426048867 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc0a00657a0 0x7fc0a0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:58.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.585+0000 7fc09bfff640 1 -- 172.21.15.55:0/426048867 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fc0ac082580 con 0x7fc0b40cb020 2023-08-25T04:18:58.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.585+0000 7fc0b37fe640 1 --2- 172.21.15.55:0/426048867 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc0a00657a0 0x7fc0a0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:58.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.585+0000 7fc0b37fe640 1 --2- 172.21.15.55:0/426048867 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc0a00657a0 0x7fc0a0067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4007fd0 tx=0x7fc0a4009040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:58.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.589+0000 7fc09bfff640 1 -- 172.21.15.55:0/426048867 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc0ac0500c0 con 0x7fc0b40cb020 2023-08-25T04:18:58.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.745+0000 7fc0b9d82640 1 -- 172.21.15.55:0/426048867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc0b4073ec0 con 0x7fc0b40cb020 2023-08-25T04:18:58.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.745+0000 7fc09bfff640 1 -- 172.21.15.55:0/426048867 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc0ac0536e0 con 0x7fc0b40cb020 2023-08-25T04:18:58.746 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:18:58.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.749+0000 7fc0b9d82640 1 -- 172.21.15.55:0/426048867 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc0a00657a0 msgr2=0x7fc0a0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:58.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.749+0000 7fc0b9d82640 1 --2- 172.21.15.55:0/426048867 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc0a00657a0 0x7fc0a0067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4007fd0 tx=0x7fc0a4009040 comp rx=0 tx=0).stop 2023-08-25T04:18:58.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.749+0000 7fc0b9d82640 1 -- 172.21.15.55:0/426048867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0b40cb020 msgr2=0x7fc0b4157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:58.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.749+0000 7fc0b9d82640 1 --2- 172.21.15.55:0/426048867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0b40cb020 0x7fc0b4157670 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00c700 tx=0x7fc0ac00cbc0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.749+0000 7fc0b9d82640 1 -- 172.21.15.55:0/426048867 shutdown_connections 2023-08-25T04:18:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.749+0000 7fc0b9d82640 1 --2- 172.21.15.55:0/426048867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0b40cb020 0x7fc0b4157670 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.749+0000 7fc0b9d82640 1 --2- 172.21.15.55:0/426048867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0b40c9900 0x7fc0b40b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.749+0000 7fc0b9d82640 1 --2- 172.21.15.55:0/426048867 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc0a00657a0 0x7fc0a0067c60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.749+0000 7fc0b9d82640 1 --2- 172.21.15.55:0/426048867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0b406c720 0x7fc0b40c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.749+0000 7fc0b9d82640 1 -- 172.21.15.55:0/426048867 >> 172.21.15.55:0/426048867 conn(0x7fc0b4069900 msgr2=0x7fc0b4069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.749+0000 7fc0b9d82640 1 -- 172.21.15.55:0/426048867 shutdown_connections 2023-08-25T04:18:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.749+0000 7fc0b9d82640 1 -- 172.21.15.55:0/426048867 wait complete. 2023-08-25T04:18:58.767 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-25T04:18:58.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.913+0000 7f9a4ed40640 1 Processor -- start 2023-08-25T04:18:58.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.913+0000 7f9a4ed40640 1 -- start start 2023-08-25T04:18:58.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.913+0000 7f9a4ed40640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9a480cb020 0x7f9a480c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:58.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.913+0000 7f9a4ed40640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a480cdd50 0x7f9a480cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:58.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.913+0000 7f9a4ed40640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a480cbca0 con 0x7f9a4806c720 2023-08-25T04:18:58.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.913+0000 7f9a4ed40640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a480c9470 con 0x7f9a480cb020 2023-08-25T04:18:58.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.913+0000 7f9a4ed40640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a480ce1e0 con 0x7f9a480cdd50 2023-08-25T04:18:58.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.913+0000 7f9a47fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a480cdd50 0x7f9a480cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:58.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.913+0000 7f9a4cadc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9a480cb020 0x7f9a480c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:58.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.913+0000 7f9a4d2dd640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f9a4806c720 0x7f9a480cc450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:41560/0 (socket says 172.21.15.55:41560) 2023-08-25T04:18:58.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.913+0000 7f9a4d2dd640 1 -- 172.21.15.55:0/2888706884 learned_addr learned my addr 172.21.15.55:0/2888706884 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:58.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.913+0000 7f9a47fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a480cdd50 0x7f9a480cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:60752/0 (socket says 172.21.15.55:60752) 2023-08-25T04:18:58.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.917+0000 7f9a477fe640 1 -- 172.21.15.55:0/2888706884 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870677084 0 0) 0x7f9a480cbca0 con 0x7f9a4806c720 2023-08-25T04:18:58.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.917+0000 7f9a47fff640 1 -- 172.21.15.55:0/2888706884 >> v2:172.21.15.110:3300/0 conn(0x7f9a480cb020 msgr2=0x7f9a480c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:58.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.917+0000 7f9a47fff640 1 --2- 172.21.15.55:0/2888706884 >> v2:172.21.15.110:3300/0 conn(0x7f9a480cb020 0x7f9a480c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.917+0000 7f9a47fff640 1 -- 172.21.15.55:0/2888706884 >> v1:172.21.15.110:6789/0 conn(0x7f9a4806c720 legacy=0x7f9a480cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:58.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.917+0000 7f9a47fff640 1 -- 172.21.15.55:0/2888706884 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a480c8b40 con 0x7f9a480cdd50 2023-08-25T04:18:58.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.917+0000 7f9a47fff640 1 --2- 172.21.15.55:0/2888706884 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a480cdd50 0x7f9a480cb400 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9a3400b870 tx=0x7f9a3401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccbec9bd5065abc9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:58.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.917+0000 7f9a477fe640 1 -- 172.21.15.55:0/2888706884 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a340a5760 con 0x7f9a480cdd50 2023-08-25T04:18:58.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.917+0000 7f9a477fe640 1 -- 172.21.15.55:0/2888706884 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a340a58c0 con 0x7f9a480cdd50 2023-08-25T04:18:58.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.917+0000 7f9a477fe640 1 -- 172.21.15.55:0/2888706884 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a340a5c50 con 0x7f9a480cdd50 2023-08-25T04:18:58.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.917+0000 7f9a4ed40640 1 -- 172.21.15.55:0/2888706884 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a480cdd50 msgr2=0x7f9a480cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:58.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.917+0000 7f9a4ed40640 1 --2- 172.21.15.55:0/2888706884 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a480cdd50 0x7f9a480cb400 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9a3400b870 tx=0x7f9a3401c8b0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.917+0000 7f9a4ed40640 1 -- 172.21.15.55:0/2888706884 shutdown_connections 2023-08-25T04:18:58.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.917+0000 7f9a4ed40640 1 --2- 172.21.15.55:0/2888706884 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a480cdd50 0x7f9a480cb400 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.917+0000 7f9a4ed40640 1 --2- 172.21.15.55:0/2888706884 >> v2:172.21.15.110:3300/0 conn(0x7f9a480cb020 0x7f9a480c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.917+0000 7f9a4ed40640 1 -- 172.21.15.55:0/2888706884 >> 172.21.15.55:0/2888706884 conn(0x7f9a48069900 msgr2=0x7f9a48069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:58.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4ed40640 1 -- 172.21.15.55:0/2888706884 shutdown_connections 2023-08-25T04:18:58.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4ed40640 1 -- 172.21.15.55:0/2888706884 wait complete. 2023-08-25T04:18:58.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4ed40640 1 Processor -- start 2023-08-25T04:18:58.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4ed40640 1 -- start start 2023-08-25T04:18:58.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4ed40640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4806c720 0x7f9a480c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:58.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4ed40640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a480cb020 0x7f9a480abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:58.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4ed40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a480cdd50 0x7f9a480c2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4ed40640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a480c7800 con 0x7f9a480cdd50 2023-08-25T04:18:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4ed40640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a480c6bf0 con 0x7f9a480cb020 2023-08-25T04:18:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4ed40640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a480c6ed0 con 0x7f9a4806c720 2023-08-25T04:18:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4d2dd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a480cdd50 0x7f9a480c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:58.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4d2dd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a480cdd50 0x7f9a480c2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50864/0 (socket says 172.21.15.55:50864) 2023-08-25T04:18:58.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4d2dd640 1 -- 172.21.15.55:0/1170409743 learned_addr learned my addr 172.21.15.55:0/1170409743 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:58.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4cadc640 1 --2- 172.21.15.55:0/1170409743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4806c720 0x7f9a480c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:58.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a47fff640 1 --2- 172.21.15.55:0/1170409743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a480cb020 0x7f9a480abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:58.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4d2dd640 1 -- 172.21.15.55:0/1170409743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4806c720 msgr2=0x7f9a480c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:58.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4d2dd640 1 --2- 172.21.15.55:0/1170409743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4806c720 0x7f9a480c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4d2dd640 1 -- 172.21.15.55:0/1170409743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a480cb020 msgr2=0x7f9a480abbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:58.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4d2dd640 1 --2- 172.21.15.55:0/1170409743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a480cb020 0x7f9a480abbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:58.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4d2dd640 1 -- 172.21.15.55:0/1170409743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3400b4d0 con 0x7f9a480cdd50 2023-08-25T04:18:58.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.921+0000 7f9a4d2dd640 1 --2- 172.21.15.55:0/1170409743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a480cdd50 0x7f9a480c2810 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f9a40001570 tx=0x7f9a4000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:58.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.925+0000 7f9a457fa640 1 -- 172.21.15.55:0/1170409743 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4000a640 con 0x7f9a480cdd50 2023-08-25T04:18:58.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.925+0000 7f9a457fa640 1 -- 172.21.15.55:0/1170409743 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4000a7c0 con 0x7f9a480cdd50 2023-08-25T04:18:58.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.925+0000 7f9a4ed40640 1 -- 172.21.15.55:0/1170409743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a480c71b0 con 0x7f9a480cdd50 2023-08-25T04:18:58.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.925+0000 7f9a457fa640 1 -- 172.21.15.55:0/1170409743 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4000ab70 con 0x7f9a480cdd50 2023-08-25T04:18:58.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.925+0000 7f9a4ed40640 1 -- 172.21.15.55:0/1170409743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a480c81d0 con 0x7f9a480cdd50 2023-08-25T04:18:58.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.925+0000 7f9a4ed40640 1 -- 172.21.15.55:0/1170409743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a480c7970 con 0x7f9a480cdd50 2023-08-25T04:18:58.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.925+0000 7f9a457fa640 1 -- 172.21.15.55:0/1170409743 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f9a4000acd0 con 0x7f9a480cdd50 2023-08-25T04:18:58.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.925+0000 7f9a457fa640 1 --2- 172.21.15.55:0/1170409743 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f9a2c0657a0 0x7f9a2c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:58.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.925+0000 7f9a457fa640 1 -- 172.21.15.55:0/1170409743 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f9a40082470 con 0x7f9a480cdd50 2023-08-25T04:18:58.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.925+0000 7f9a4cadc640 1 --2- 172.21.15.55:0/1170409743 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f9a2c0657a0 0x7f9a2c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:58.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.929+0000 7f9a4cadc640 1 --2- 172.21.15.55:0/1170409743 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f9a2c0657a0 0x7f9a2c067c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c015230 tx=0x7f9a3c00f040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:58.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:58.929+0000 7f9a457fa640 1 -- 172.21.15.55:0/1170409743 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9a4004ff30 con 0x7f9a480cdd50 2023-08-25T04:18:59.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.089+0000 7f9a4ed40640 1 -- 172.21.15.55:0/1170409743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9a48073ec0 con 0x7f9a480cdd50 2023-08-25T04:18:59.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.093+0000 7f9a457fa640 1 -- 172.21.15.55:0/1170409743 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9a40053550 con 0x7f9a480cdd50 2023-08-25T04:18:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.093+0000 7f9a4ed40640 1 -- 172.21.15.55:0/1170409743 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f9a2c0657a0 msgr2=0x7f9a2c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.093+0000 7f9a4ed40640 1 --2- 172.21.15.55:0/1170409743 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f9a2c0657a0 0x7f9a2c067c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c015230 tx=0x7f9a3c00f040 comp rx=0 tx=0).stop 2023-08-25T04:18:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.093+0000 7f9a4ed40640 1 -- 172.21.15.55:0/1170409743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a480cdd50 msgr2=0x7f9a480c2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.093+0000 7f9a4ed40640 1 --2- 172.21.15.55:0/1170409743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a480cdd50 0x7f9a480c2810 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f9a40001570 tx=0x7f9a4000cca0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.093+0000 7f9a4ed40640 1 -- 172.21.15.55:0/1170409743 shutdown_connections 2023-08-25T04:18:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.093+0000 7f9a4ed40640 1 --2- 172.21.15.55:0/1170409743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a480cdd50 0x7f9a480c2810 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.093+0000 7f9a4ed40640 1 --2- 172.21.15.55:0/1170409743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a480cb020 0x7f9a480abbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.093+0000 7f9a4ed40640 1 --2- 172.21.15.55:0/1170409743 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f9a2c0657a0 0x7f9a2c067c60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.093+0000 7f9a4ed40640 1 --2- 172.21.15.55:0/1170409743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a4806c720 0x7f9a480c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.093+0000 7f9a4ed40640 1 -- 172.21.15.55:0/1170409743 >> 172.21.15.55:0/1170409743 conn(0x7f9a48069900 msgr2=0x7f9a480cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.093+0000 7f9a4ed40640 1 -- 172.21.15.55:0/1170409743 shutdown_connections 2023-08-25T04:18:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.093+0000 7f9a4ed40640 1 -- 172.21.15.55:0/1170409743 wait complete. 2023-08-25T04:18:59.114 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T04:18:59.115 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:18:59.181 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:18:59.256 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T04:18:59.257 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:18:59.257 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:59.268 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T04:18:59.269 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:18:59.270 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:59.280 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:18:59.280 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:18:59.281 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:59.323 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T04:18:59.323 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:18:59.324 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:18:59.334 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:18:59.335 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-25T04:18:59.336 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:18:59.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.513+0000 7f7ae0137640 1 Processor -- start 2023-08-25T04:18:59.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.513+0000 7f7ae0137640 1 -- start start 2023-08-25T04:18:59.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.513+0000 7f7ae0137640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ad80ad950 0x7f7ad80cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.513+0000 7f7ae0137640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ad80c89f0 0x7f7ad80ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.513+0000 7f7ae0137640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad80b2650 con 0x7f7ad806c000 2023-08-25T04:18:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.513+0000 7f7ae0137640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad80b11f0 con 0x7f7ad80c89f0 2023-08-25T04:18:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.513+0000 7f7ae0137640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad8159d50 con 0x7f7ad80ad950 2023-08-25T04:18:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.513+0000 7f7add6d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ad80c89f0 0x7f7ad80ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.513+0000 7f7add6d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ad80c89f0 0x7f7ad80ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50866/0 (socket says 172.21.15.55:50866) 2023-08-25T04:18:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.513+0000 7f7add6d2640 1 -- 172.21.15.55:0/2907033123 learned_addr learned my addr 172.21.15.55:0/2907033123 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:59.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.513+0000 7f7added3640 1 --2- 172.21.15.55:0/2907033123 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ad80ad950 0x7f7ad80cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:59.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.517+0000 7f7add6d2640 1 -- 172.21.15.55:0/2907033123 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ad80ad950 msgr2=0x7f7ad80cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:59.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.517+0000 7f7add6d2640 1 --2- 172.21.15.55:0/2907033123 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ad80ad950 0x7f7ad80cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.517+0000 7f7add6d2640 1 -- 172.21.15.55:0/2907033123 >> v1:172.21.15.110:6789/0 conn(0x7f7ad806c000 legacy=0x7f7ad815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:59.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.517+0000 7f7add6d2640 1 -- 172.21.15.55:0/2907033123 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad80cc880 con 0x7f7ad80c89f0 2023-08-25T04:18:59.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.517+0000 7f7add6d2640 1 --2- 172.21.15.55:0/2907033123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad80c89f0 0x7f7ad80ce7a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800bb10 tx=0x7f7ac801eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af77de158f4df3e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:59.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.517+0000 7f7adced1640 1 -- 172.21.15.55:0/2907033123 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80a7b30 con 0x7f7ad80c89f0 2023-08-25T04:18:59.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.517+0000 7f7adced1640 1 -- 172.21.15.55:0/2907033123 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac80a7c90 con 0x7f7ad80c89f0 2023-08-25T04:18:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.517+0000 7f7adced1640 1 -- 172.21.15.55:0/2907033123 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80af440 con 0x7f7ad80c89f0 2023-08-25T04:18:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.517+0000 7f7ae0137640 1 -- 172.21.15.55:0/2907033123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad80c89f0 msgr2=0x7f7ad80ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.517+0000 7f7ae0137640 1 --2- 172.21.15.55:0/2907033123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad80c89f0 0x7f7ad80ce7a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800bb10 tx=0x7f7ac801eb50 comp rx=0 tx=0).stop 2023-08-25T04:18:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.517+0000 7f7ae0137640 1 -- 172.21.15.55:0/2907033123 shutdown_connections 2023-08-25T04:18:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.517+0000 7f7ae0137640 1 --2- 172.21.15.55:0/2907033123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad80c89f0 0x7f7ad80ce7a0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.517+0000 7f7ae0137640 1 --2- 172.21.15.55:0/2907033123 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ad80ad950 0x7f7ad80cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.517+0000 7f7ae0137640 1 -- 172.21.15.55:0/2907033123 >> 172.21.15.55:0/2907033123 conn(0x7f7ad8069d00 msgr2=0x7f7ad806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7ae0137640 1 -- 172.21.15.55:0/2907033123 shutdown_connections 2023-08-25T04:18:59.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7ae0137640 1 -- 172.21.15.55:0/2907033123 wait complete. 2023-08-25T04:18:59.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7ae0137640 1 Processor -- start 2023-08-25T04:18:59.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7ae0137640 1 -- start start 2023-08-25T04:18:59.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7ae0137640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad806c000 0x7f7ad80c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:59.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7ae0137640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ad80ad950 0x7f7ad80c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:59.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7ae0137640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ad80c89f0 0x7f7ad8153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:59.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7ae0137640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad8152ee0 con 0x7f7ad806c000 2023-08-25T04:18:59.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7ae0137640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad8153130 con 0x7f7ad80c89f0 2023-08-25T04:18:59.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7ae0137640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad8153410 con 0x7f7ad80ad950 2023-08-25T04:18:59.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7added3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad806c000 0x7f7ad80c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:59.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7added3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad806c000 0x7f7ad80c4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50878/0 (socket says 172.21.15.55:50878) 2023-08-25T04:18:59.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7added3640 1 -- 172.21.15.55:0/2200822876 learned_addr learned my addr 172.21.15.55:0/2200822876 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:59.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7add6d2640 1 --2- 172.21.15.55:0/2200822876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ad80ad950 0x7f7ad80c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:59.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7ade6d4640 1 --2- 172.21.15.55:0/2200822876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ad80c89f0 0x7f7ad8153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:59.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7added3640 1 -- 172.21.15.55:0/2200822876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ad80ad950 msgr2=0x7f7ad80c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:59.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7added3640 1 --2- 172.21.15.55:0/2200822876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ad80ad950 0x7f7ad80c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7added3640 1 -- 172.21.15.55:0/2200822876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ad80c89f0 msgr2=0x7f7ad8153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:59.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7added3640 1 --2- 172.21.15.55:0/2200822876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ad80c89f0 0x7f7ad8153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7added3640 1 -- 172.21.15.55:0/2200822876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac800b770 con 0x7f7ad806c000 2023-08-25T04:18:59.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7ade6d4640 1 --2- 172.21.15.55:0/2200822876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ad80c89f0 0x7f7ad8153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:18:59.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7added3640 1 --2- 172.21.15.55:0/2200822876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad806c000 0x7f7ad80c4510 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400d5f0 tx=0x7f7ad400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:59.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7ace7fc640 1 -- 172.21.15.55:0/2200822876 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad40125f0 con 0x7f7ad806c000 2023-08-25T04:18:59.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7ace7fc640 1 -- 172.21.15.55:0/2200822876 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad4012750 con 0x7f7ad806c000 2023-08-25T04:18:59.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7ace7fc640 1 -- 172.21.15.55:0/2200822876 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4012ae0 con 0x7f7ad806c000 2023-08-25T04:18:59.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7ae0137640 1 -- 172.21.15.55:0/2200822876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad81536f0 con 0x7f7ad806c000 2023-08-25T04:18:59.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.521+0000 7f7ae0137640 1 -- 172.21.15.55:0/2200822876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad80c4a50 con 0x7f7ad806c000 2023-08-25T04:18:59.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.525+0000 7f7ae0137640 1 -- 172.21.15.55:0/2200822876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad80c4c40 con 0x7f7ad806c000 2023-08-25T04:18:59.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.525+0000 7f7ace7fc640 1 -- 172.21.15.55:0/2200822876 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f7ad4012c40 con 0x7f7ad806c000 2023-08-25T04:18:59.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.525+0000 7f7ace7fc640 1 --2- 172.21.15.55:0/2200822876 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f7abc0657a0 0x7f7abc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:59.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.525+0000 7f7ace7fc640 1 -- 172.21.15.55:0/2200822876 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f7ad4083380 con 0x7f7ad806c000 2023-08-25T04:18:59.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.525+0000 7f7add6d2640 1 --2- 172.21.15.55:0/2200822876 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f7abc0657a0 0x7f7abc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:59.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.525+0000 7f7add6d2640 1 --2- 172.21.15.55:0/2200822876 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f7abc0657a0 0x7f7abc067c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80b1000 tx=0x7f7ac80a9070 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:59.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.529+0000 7f7ace7fc640 1 -- 172.21.15.55:0/2200822876 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7ad80c4c40 con 0x7f7ad806c000 2023-08-25T04:18:59.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.717+0000 7f7ae0137640 1 -- 172.21.15.55:0/2200822876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ad80c4c40 con 0x7f7ad806c000 2023-08-25T04:18:59.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.721+0000 7f7ace7fc640 1 -- 172.21.15.55:0/2200822876 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f7ad80c4c40 con 0x7f7ad806c000 2023-08-25T04:18:59.721 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:18:59.721 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5915,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1922466113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1922466113},{"type":"v1","addr":"172.21.15.110:6836","nonce":1922466113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6367,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1328842039","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1328842039},{"type":"v1","addr":"172.21.15.55:6835","nonce":1328842039}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6385,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/4127792530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":4127792530},{"type":"v1","addr":"172.21.15.110:6837","nonce":4127792530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":7224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3880257386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3880257386},{"type":"v1","addr":"172.21.15.55:6834","nonce":3880257386}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":34}],"filesystems":[]} 2023-08-25T04:18:59.721 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 34 2023-08-25T04:18:59.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.721+0000 7f7ae0137640 1 -- 172.21.15.55:0/2200822876 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f7abc0657a0 msgr2=0x7f7abc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:59.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.721+0000 7f7ae0137640 1 --2- 172.21.15.55:0/2200822876 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f7abc0657a0 0x7f7abc067c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80b1000 tx=0x7f7ac80a9070 comp rx=0 tx=0).stop 2023-08-25T04:18:59.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.721+0000 7f7ae0137640 1 -- 172.21.15.55:0/2200822876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad806c000 msgr2=0x7f7ad80c4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:59.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.721+0000 7f7ae0137640 1 --2- 172.21.15.55:0/2200822876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad806c000 0x7f7ad80c4510 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400d5f0 tx=0x7f7ad400dab0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.721+0000 7f7ae0137640 1 -- 172.21.15.55:0/2200822876 shutdown_connections 2023-08-25T04:18:59.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.721+0000 7f7ae0137640 1 --2- 172.21.15.55:0/2200822876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ad80c89f0 0x7f7ad8153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.721+0000 7f7ae0137640 1 --2- 172.21.15.55:0/2200822876 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f7abc0657a0 0x7f7abc067c60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.721+0000 7f7ae0137640 1 --2- 172.21.15.55:0/2200822876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ad80ad950 0x7f7ad80c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.721+0000 7f7ae0137640 1 --2- 172.21.15.55:0/2200822876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ad806c000 0x7f7ad80c4510 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.721+0000 7f7ae0137640 1 -- 172.21.15.55:0/2200822876 >> 172.21.15.55:0/2200822876 conn(0x7f7ad8069d00 msgr2=0x7f7ad806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:59.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.721+0000 7f7ae0137640 1 -- 172.21.15.55:0/2200822876 shutdown_connections 2023-08-25T04:18:59.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.721+0000 7f7ae0137640 1 -- 172.21.15.55:0/2200822876 wait complete. 2023-08-25T04:18:59.741 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-25T04:18:59.741 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-25T04:18:59.742 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-25T04:18:59.742 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:18:59.742 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-25T04:18:59.742 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-25T04:18:59.743 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-25T04:18:59.743 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:18:59.743 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-25T04:18:59.743 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-25T04:18:59.743 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-25T04:18:59.744 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:18:59.744 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-25T04:18:59.744 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-25T04:18:59.744 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-25T04:18:59.745 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:18:59.758 INFO:tasks.ceph.mds.a:Stopped 2023-08-25T04:18:59.758 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-25T04:18:59.759 INFO:tasks.ceph.mds.c:Stopped 2023-08-25T04:18:59.759 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-25T04:18:59.762 INFO:tasks.ceph.mds.b:Stopped 2023-08-25T04:18:59.762 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-25T04:18:59.763 INFO:tasks.ceph.mds.d:Stopped 2023-08-25T04:18:59.763 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-25T04:18:59.802 INFO:tasks.ceph.mds.a:Started 2023-08-25T04:18:59.802 DEBUG:teuthology.parallel:result is None 2023-08-25T04:18:59.804 INFO:tasks.ceph.mds.c:Started 2023-08-25T04:18:59.804 DEBUG:teuthology.parallel:result is None 2023-08-25T04:18:59.808 INFO:tasks.ceph.mds.b:Started 2023-08-25T04:18:59.808 DEBUG:teuthology.parallel:result is None 2023-08-25T04:18:59.810 INFO:tasks.ceph.mds.d:Started 2023-08-25T04:18:59.810 DEBUG:teuthology.parallel:result is None 2023-08-25T04:18:59.810 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-25T04:18:59.892 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-08-25T04:18:59.893 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T04:18:59.902 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2023-08-25T04:18:59.903 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2023-08-25T04:18:59.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.957+0000 7f194ea9e640 1 Processor -- start 2023-08-25T04:18:59.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.957+0000 7f194ea9e640 1 -- start start 2023-08-25T04:18:59.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.961+0000 7f194ea9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f194815fef0 0x7f19480cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:59.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.961+0000 7f194ea9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19480ceeb0 0x7f19480b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:59.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.961+0000 7f194ea9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1948160570 con 0x7f19480b2a40 2023-08-25T04:18:59.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.961+0000 7f194ea9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19481602d0 con 0x7f19480ceeb0 2023-08-25T04:18:59.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.961+0000 7f194ea9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1948160810 con 0x7f194815fef0 2023-08-25T04:18:59.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.961+0000 7f194d03b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19480ceeb0 0x7f19480b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:59.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.961+0000 7f193ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f19480b2a40 0x7f19480ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48044/0 (socket says 172.21.15.55:48044) 2023-08-25T04:18:59.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.961+0000 7f194d03b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19480ceeb0 0x7f19480b14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50904/0 (socket says 172.21.15.55:50904) 2023-08-25T04:18:59.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.961+0000 7f193ffff640 1 -- 172.21.15.55:0/3961570286 learned_addr learned my addr 172.21.15.55:0/3961570286 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:18:59.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.961+0000 7f194c83a640 1 --2- 172.21.15.55:0/3961570286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f194815fef0 0x7f19480cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:59.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.961+0000 7f194d03b640 1 -- 172.21.15.55:0/3961570286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f194815fef0 msgr2=0x7f19480cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:18:59.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.961+0000 7f194d03b640 1 --2- 172.21.15.55:0/3961570286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f194815fef0 0x7f19480cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.961+0000 7f194d03b640 1 -- 172.21.15.55:0/3961570286 >> v1:172.21.15.55:6789/0 conn(0x7f19480b2a40 legacy=0x7f19480ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:59.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.961+0000 7f194d03b640 1 -- 172.21.15.55:0/3961570286 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1948160af0 con 0x7f19480ceeb0 2023-08-25T04:18:59.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.961+0000 7f193f7fe640 1 -- 172.21.15.55:0/3961570286 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271282047 0 0) 0x7f1948160570 con 0x7f19480b2a40 2023-08-25T04:18:59.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.965+0000 7f194d03b640 1 --2- 172.21.15.55:0/3961570286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19480ceeb0 0x7f19480b14d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1940009d90 tx=0x7f194001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fbf2d884191ce3d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:59.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.965+0000 7f193f7fe640 1 -- 172.21.15.55:0/3961570286 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19400a5950 con 0x7f19480ceeb0 2023-08-25T04:18:59.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.965+0000 7f193f7fe640 1 -- 172.21.15.55:0/3961570286 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19400a5ab0 con 0x7f19480ceeb0 2023-08-25T04:18:59.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.965+0000 7f193f7fe640 1 -- 172.21.15.55:0/3961570286 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19400a5e40 con 0x7f19480ceeb0 2023-08-25T04:18:59.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.965+0000 7f194ea9e640 1 -- 172.21.15.55:0/3961570286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19480ceeb0 msgr2=0x7f19480b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:59.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.965+0000 7f194ea9e640 1 --2- 172.21.15.55:0/3961570286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19480ceeb0 0x7f19480b14d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1940009d90 tx=0x7f194001c890 comp rx=0 tx=0).stop 2023-08-25T04:18:59.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.965+0000 7f194ea9e640 1 -- 172.21.15.55:0/3961570286 shutdown_connections 2023-08-25T04:18:59.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.965+0000 7f194ea9e640 1 --2- 172.21.15.55:0/3961570286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19480ceeb0 0x7f19480b14d0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.965+0000 7f194ea9e640 1 --2- 172.21.15.55:0/3961570286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f194815fef0 0x7f19480cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.965+0000 7f194ea9e640 1 -- 172.21.15.55:0/3961570286 >> 172.21.15.55:0/3961570286 conn(0x7f1948069d00 msgr2=0x7f194806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:18:59.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.965+0000 7f194ea9e640 1 -- 172.21.15.55:0/3961570286 shutdown_connections 2023-08-25T04:18:59.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.965+0000 7f194ea9e640 1 -- 172.21.15.55:0/3961570286 wait complete. 2023-08-25T04:18:59.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.965+0000 7f194ea9e640 1 Processor -- start 2023-08-25T04:18:59.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.965+0000 7f194ea9e640 1 -- start start 2023-08-25T04:18:59.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.965+0000 7f194ea9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19480b2a40 0x7f19481513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f194ea9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19480ceeb0 0x7f19481540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f194ea9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f194815fef0 0x7f1948097300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f194ea9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19480ab140 con 0x7f19480b2a40 2023-08-25T04:18:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f194ea9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19480ab830 con 0x7f194815fef0 2023-08-25T04:18:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f194ea9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19480ab390 con 0x7f19480ceeb0 2023-08-25T04:18:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f194c83a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19480b2a40 0x7f19481513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:59.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f194c83a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19480b2a40 0x7f19481513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50916/0 (socket says 172.21.15.55:50916) 2023-08-25T04:18:59.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f194c83a640 1 -- 172.21.15.55:0/2280762235 learned_addr learned my addr 172.21.15.55:0/2280762235 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:18:59.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f193ffff640 1 --2- 172.21.15.55:0/2280762235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19480ceeb0 0x7f19481540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:59.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f194d03b640 1 --2- 172.21.15.55:0/2280762235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f194815fef0 0x7f1948097300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:59.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f194c83a640 1 -- 172.21.15.55:0/2280762235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19480ceeb0 msgr2=0x7f19481540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:59.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f194c83a640 1 --2- 172.21.15.55:0/2280762235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19480ceeb0 0x7f19481540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f194c83a640 1 -- 172.21.15.55:0/2280762235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f194815fef0 msgr2=0x7f1948097300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:18:59.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f194c83a640 1 --2- 172.21.15.55:0/2280762235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f194815fef0 0x7f1948097300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:18:59.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f194c83a640 1 -- 172.21.15.55:0/2280762235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1940009a70 con 0x7f19480b2a40 2023-08-25T04:18:59.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f193ffff640 1 --2- 172.21.15.55:0/2280762235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19480ceeb0 0x7f19481540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:18:59.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f194c83a640 1 --2- 172.21.15.55:0/2280762235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19480b2a40 0x7f19481513a0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f194400e870 tx=0x7f194400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:59.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f193d7fa640 1 -- 172.21.15.55:0/2280762235 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944009510 con 0x7f19480b2a40 2023-08-25T04:18:59.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f193d7fa640 1 -- 172.21.15.55:0/2280762235 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194400eec0 con 0x7f19480b2a40 2023-08-25T04:18:59.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f194ea9e640 1 -- 172.21.15.55:0/2280762235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1948156150 con 0x7f19480b2a40 2023-08-25T04:18:59.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f193d7fa640 1 -- 172.21.15.55:0/2280762235 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194400cb40 con 0x7f19480b2a40 2023-08-25T04:18:59.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f194ea9e640 1 -- 172.21.15.55:0/2280762235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19481518e0 con 0x7f19480b2a40 2023-08-25T04:18:59.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f194ea9e640 1 -- 172.21.15.55:0/2280762235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194804dbe0 con 0x7f19480b2a40 2023-08-25T04:18:59.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.969+0000 7f193d7fa640 1 -- 172.21.15.55:0/2280762235 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f194400cca0 con 0x7f19480b2a40 2023-08-25T04:18:59.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.973+0000 7f193d7fa640 1 --2- 172.21.15.55:0/2280762235 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f19340657d0 0x7f1934067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:18:59.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.973+0000 7f193d7fa640 1 -- 172.21.15.55:0/2280762235 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f1944083030 con 0x7f19480b2a40 2023-08-25T04:18:59.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.973+0000 7f193ffff640 1 --2- 172.21.15.55:0/2280762235 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f19340657d0 0x7f1934067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:18:59.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.973+0000 7f193ffff640 1 --2- 172.21.15.55:0/2280762235 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f19340657d0 0x7f1934067c90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1938007fd0 tx=0x7f1938007c20 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:18:59.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:18:59.977+0000 7f193d7fa640 1 -- 172.21.15.55:0/2280762235 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f19440b3d90 con 0x7f19480b2a40 2023-08-25T04:19:00.129 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:19:00.139 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:19:00.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:00.141+0000 7f194ea9e640 1 -- 172.21.15.55:0/2280762235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1948071a40 con 0x7f19480b2a40 2023-08-25T04:19:01.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.657+0000 7f193d7fa640 1 -- 172.21.15.55:0/2280762235 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v89) v1 ==== 97+0+0 (secure 0 0 0) 0x7f19440544f0 con 0x7f19480b2a40 2023-08-25T04:19:01.657 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-08-25T04:19:01.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.661+0000 7f194ea9e640 1 -- 172.21.15.55:0/2280762235 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f19340657d0 msgr2=0x7f1934067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:01.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.661+0000 7f194ea9e640 1 --2- 172.21.15.55:0/2280762235 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f19340657d0 0x7f1934067c90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1938007fd0 tx=0x7f1938007c20 comp rx=0 tx=0).stop 2023-08-25T04:19:01.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.661+0000 7f194ea9e640 1 -- 172.21.15.55:0/2280762235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19480b2a40 msgr2=0x7f19481513a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:01.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.661+0000 7f194ea9e640 1 --2- 172.21.15.55:0/2280762235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19480b2a40 0x7f19481513a0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f194400e870 tx=0x7f194400ec70 comp rx=0 tx=0).stop 2023-08-25T04:19:01.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.661+0000 7f194ea9e640 1 -- 172.21.15.55:0/2280762235 shutdown_connections 2023-08-25T04:19:01.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.661+0000 7f194ea9e640 1 --2- 172.21.15.55:0/2280762235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f194815fef0 0x7f1948097300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:01.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.661+0000 7f194ea9e640 1 --2- 172.21.15.55:0/2280762235 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f19340657d0 0x7f1934067c90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:01.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.661+0000 7f194ea9e640 1 --2- 172.21.15.55:0/2280762235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19480ceeb0 0x7f19481540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:01.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.661+0000 7f194ea9e640 1 --2- 172.21.15.55:0/2280762235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19480b2a40 0x7f19481513a0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:01.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.661+0000 7f194ea9e640 1 -- 172.21.15.55:0/2280762235 >> 172.21.15.55:0/2280762235 conn(0x7f1948069d00 msgr2=0x7f194815c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:01.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.661+0000 7f194ea9e640 1 -- 172.21.15.55:0/2280762235 shutdown_connections 2023-08-25T04:19:01.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.661+0000 7f194ea9e640 1 -- 172.21.15.55:0/2280762235 wait complete. 2023-08-25T04:19:01.683 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-25T04:19:01.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3efe888640 1 Processor -- start 2023-08-25T04:19:01.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3efe888640 1 -- start start 2023-08-25T04:19:01.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3efe888640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ef80d0da0 0x7f3ef80d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:01.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3efe888640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef80cdde0 0x7f3ef80ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:01.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3efe888640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3ef80cee60 0x7f3ef80cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:01.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3efe888640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef80ce760 con 0x7f3ef80d0da0 2023-08-25T04:19:01.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3efe888640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef80b29b0 con 0x7f3ef80cee60 2023-08-25T04:19:01.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3efe888640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef80d16c0 con 0x7f3ef80cdde0 2023-08-25T04:19:01.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3ef7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ef80d0da0 0x7f3ef80d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:01.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3ef7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ef80d0da0 0x7f3ef80d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47730/0 (socket says 172.21.15.55:47730) 2023-08-25T04:19:01.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3ef7fff640 1 -- 172.21.15.55:0/2120025311 learned_addr learned my addr 172.21.15.55:0/2120025311 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:01.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3eeffff640 1 --2- 172.21.15.55:0/2120025311 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef80cdde0 0x7f3ef80ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:01.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3efce25640 1 --2- 172.21.15.55:0/2120025311 >> v2:172.21.15.110:3300/0 conn(0x7f3ef80cee60 0x7f3ef80cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:01.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3ef7fff640 1 -- 172.21.15.55:0/2120025311 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef80cdde0 msgr2=0x7f3ef80ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:01.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3ef7fff640 1 --2- 172.21.15.55:0/2120025311 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef80cdde0 0x7f3ef80ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:01.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3ef7fff640 1 -- 172.21.15.55:0/2120025311 >> v2:172.21.15.110:3300/0 conn(0x7f3ef80cee60 msgr2=0x7f3ef80cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:01.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3ef7fff640 1 --2- 172.21.15.55:0/2120025311 >> v2:172.21.15.110:3300/0 conn(0x7f3ef80cee60 0x7f3ef80cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:01.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3ef7fff640 1 -- 172.21.15.55:0/2120025311 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef80b1dc0 con 0x7f3ef80d0da0 2023-08-25T04:19:01.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3efce25640 1 --2- 172.21.15.55:0/2120025311 >> v2:172.21.15.110:3300/0 conn(0x7f3ef80cee60 0x7f3ef80cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:01.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.833+0000 7f3eeffff640 1 --2- 172.21.15.55:0/2120025311 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef80cdde0 0x7f3ef80ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:01.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.837+0000 7f3ef7fff640 1 --2- 172.21.15.55:0/2120025311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ef80d0da0 0x7f3ef80d1180 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80b1bd0 tx=0x7f3ee801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18fcd51c9a4c0f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:01.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.837+0000 7f3ef77fe640 1 -- 172.21.15.55:0/2120025311 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee80a89b0 con 0x7f3ef80d0da0 2023-08-25T04:19:01.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.837+0000 7f3ef77fe640 1 -- 172.21.15.55:0/2120025311 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee80a8b10 con 0x7f3ef80d0da0 2023-08-25T04:19:01.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.837+0000 7f3ef77fe640 1 -- 172.21.15.55:0/2120025311 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee80a8ea0 con 0x7f3ef80d0da0 2023-08-25T04:19:01.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.837+0000 7f3efe888640 1 -- 172.21.15.55:0/2120025311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ef80d0da0 msgr2=0x7f3ef80d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:01.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.837+0000 7f3efe888640 1 --2- 172.21.15.55:0/2120025311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ef80d0da0 0x7f3ef80d1180 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80b1bd0 tx=0x7f3ee801ecf0 comp rx=0 tx=0).stop 2023-08-25T04:19:01.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.837+0000 7f3efe888640 1 -- 172.21.15.55:0/2120025311 shutdown_connections 2023-08-25T04:19:01.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.837+0000 7f3efe888640 1 --2- 172.21.15.55:0/2120025311 >> v2:172.21.15.110:3300/0 conn(0x7f3ef80cee60 0x7f3ef80cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:01.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.837+0000 7f3efe888640 1 --2- 172.21.15.55:0/2120025311 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef80cdde0 0x7f3ef80ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:01.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.837+0000 7f3efe888640 1 --2- 172.21.15.55:0/2120025311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ef80d0da0 0x7f3ef80d1180 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:01.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.837+0000 7f3efe888640 1 -- 172.21.15.55:0/2120025311 >> 172.21.15.55:0/2120025311 conn(0x7f3ef809bae0 msgr2=0x7f3ef80d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:01.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.837+0000 7f3efe888640 1 -- 172.21.15.55:0/2120025311 shutdown_connections 2023-08-25T04:19:01.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.837+0000 7f3efe888640 1 -- 172.21.15.55:0/2120025311 wait complete. 2023-08-25T04:19:01.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3efe888640 1 Processor -- start 2023-08-25T04:19:01.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3efe888640 1 -- start start 2023-08-25T04:19:01.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3efe888640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ef80cdde0 0x7f3ef81e6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:01.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3efe888640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef80cee60 0x7f3ef8151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:01.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3efe888640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef80d0da0 0x7f3ef8151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:01.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3efe888640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef8159f30 con 0x7f3ef80cdde0 2023-08-25T04:19:01.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3efe888640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef8159360 con 0x7f3ef80d0da0 2023-08-25T04:19:01.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3efe888640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef8159600 con 0x7f3ef80cee60 2023-08-25T04:19:01.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3ef7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ef80cdde0 0x7f3ef81e6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:01.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3ef7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ef80cdde0 0x7f3ef81e6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47746/0 (socket says 172.21.15.55:47746) 2023-08-25T04:19:01.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3ef7fff640 1 -- 172.21.15.55:0/1864277758 learned_addr learned my addr 172.21.15.55:0/1864277758 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:01.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3eeffff640 1 --2- 172.21.15.55:0/1864277758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef80cee60 0x7f3ef8151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:01.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3efce25640 1 --2- 172.21.15.55:0/1864277758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef80d0da0 0x7f3ef8151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:01.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3ef7fff640 1 -- 172.21.15.55:0/1864277758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef80cee60 msgr2=0x7f3ef8151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:01.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3ef7fff640 1 --2- 172.21.15.55:0/1864277758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef80cee60 0x7f3ef8151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:01.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3ef7fff640 1 -- 172.21.15.55:0/1864277758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef80d0da0 msgr2=0x7f3ef8151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:01.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3ef7fff640 1 --2- 172.21.15.55:0/1864277758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef80d0da0 0x7f3ef8151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:01.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3ef7fff640 1 -- 172.21.15.55:0/1864277758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee8009480 con 0x7f3ef80cdde0 2023-08-25T04:19:01.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3ef7fff640 1 --2- 172.21.15.55:0/1864277758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ef80cdde0 0x7f3ef81e6660 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f3ee801f590 tx=0x7f3ee801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:01.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3ef57fa640 1 -- 172.21.15.55:0/1864277758 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8005ba0 con 0x7f3ef80cdde0 2023-08-25T04:19:01.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3ef57fa640 1 -- 172.21.15.55:0/1864277758 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee8005d00 con 0x7f3ef80cdde0 2023-08-25T04:19:01.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3ef57fa640 1 -- 172.21.15.55:0/1864277758 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8006260 con 0x7f3ef80cdde0 2023-08-25T04:19:01.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3efe888640 1 -- 172.21.15.55:0/1864277758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef81598e0 con 0x7f3ef80cdde0 2023-08-25T04:19:01.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.841+0000 7f3efe888640 1 -- 172.21.15.55:0/1864277758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef81e6ba0 con 0x7f3ef80cdde0 2023-08-25T04:19:01.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.845+0000 7f3efe888640 1 -- 172.21.15.55:0/1864277758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef81e6d90 con 0x7f3ef80cdde0 2023-08-25T04:19:01.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.845+0000 7f3ef57fa640 1 -- 172.21.15.55:0/1864277758 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f3ee80b7070 con 0x7f3ef80cdde0 2023-08-25T04:19:01.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.845+0000 7f3ef57fa640 1 --2- 172.21.15.55:0/1864277758 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f3ed80657d0 0x7f3ed8067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:01.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.845+0000 7f3ef57fa640 1 -- 172.21.15.55:0/1864277758 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3ee811faf0 con 0x7f3ef80cdde0 2023-08-25T04:19:01.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.845+0000 7f3eeffff640 1 --2- 172.21.15.55:0/1864277758 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f3ed80657d0 0x7f3ed8067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:01.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.845+0000 7f3eeffff640 1 --2- 172.21.15.55:0/1864277758 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f3ed80657d0 0x7f3ed8067c90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8159000 tx=0x7f3ee0008040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:01.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:01.849+0000 7f3ef57fa640 1 -- 172.21.15.55:0/1864277758 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3ef81e6d90 con 0x7f3ef80cdde0 2023-08-25T04:19:02.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.057+0000 7f3efe888640 1 -- 172.21.15.55:0/1864277758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3ef81e6d90 con 0x7f3ef80cdde0 2023-08-25T04:19:02.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.057+0000 7f3ef57fa640 1 -- 172.21.15.55:0/1864277758 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3ef81e6d90 con 0x7f3ef80cdde0 2023-08-25T04:19:02.058 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:02.058 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T04:19:02.058 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-08-25T04:19:02.059 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.059 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-08-25T04:19:02.059 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkgFrTEBAAoan9rk8Q+qPyMjb2vGUHhA==", 2023-08-25T04:19:02.059 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.059 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:19:02.059 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:19:02.060 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:19:02.060 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:02.060 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.060 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:02.060 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.060 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-08-25T04:19:02.060 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk18hNHRAAzXuhzQEONXRzRXTeCH9fKQ==", 2023-08-25T04:19:02.061 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.061 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:19:02.061 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:19:02.061 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:19:02.061 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:02.061 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.061 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:02.062 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.062 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-08-25T04:19:02.062 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkLF9CGBAAqxgRU/02SsZfWuZPSYxuZA==", 2023-08-25T04:19:02.062 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.062 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:19:02.062 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:19:02.062 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:19:02.062 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:02.063 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.063 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:02.063 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.063 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-08-25T04:19:02.063 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hky6HiJBAAsrXlTDn2cxbk7PnqSgNNkA==", 2023-08-25T04:19:02.063 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.064 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:19:02.064 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:19:02.064 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:19:02.064 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:02.064 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.064 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:02.065 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.065 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-08-25T04:19:02.065 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC+J+hkY1tDFBAAVQY5Xl8On9pN3jLWwKWGTA==", 2023-08-25T04:19:02.065 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.065 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:19:02.065 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:19:02.066 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:02.067 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.067 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:02.067 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.067 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-08-25T04:19:02.067 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDBJ+hkpdBCHRAADyMAxTsnQfkD9G0p48H4zQ==", 2023-08-25T04:19:02.067 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.067 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:19:02.068 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:19:02.068 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:02.068 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.068 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:02.068 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.068 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-08-25T04:19:02.068 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDEJ+hkOR49KRAAudbqAxLItsoczide8ybzAg==", 2023-08-25T04:19:02.069 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.069 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:19:02.069 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:19:02.069 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:02.069 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.069 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:02.069 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.069 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-08-25T04:19:02.070 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDHJ+hkxun5MBAAAhGtJYVeL3ogL3TQV67diw==", 2023-08-25T04:19:02.070 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.070 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:19:02.070 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:19:02.070 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:02.070 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.070 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:02.071 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.071 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-08-25T04:19:02.071 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDMJ+hkuosTCRAAqCuwHFZFBVR/7nFtHHByNg==", 2023-08-25T04:19:02.071 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.071 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:19:02.071 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:19:02.071 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:02.071 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.072 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:02.072 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.072 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-08-25T04:19:02.072 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDPJ+hkJa+SDhAAllo6biVE99BZWvv5K/gXGw==", 2023-08-25T04:19:02.072 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.072 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:19:02.073 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:19:02.073 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:02.073 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.073 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:02.073 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.073 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-08-25T04:19:02.073 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDSJ+hkUPywFBAA4jua1Eu1nRl2L6hX/mycfw==", 2023-08-25T04:19:02.074 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.074 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:19:02.074 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:19:02.074 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:02.074 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.074 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:02.075 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.075 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-08-25T04:19:02.075 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDVJ+hkhyDMGxAAmcSWLzJqIE5w5H/E4wIurQ==", 2023-08-25T04:19:02.075 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.075 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:19:02.076 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:19:02.076 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:02.076 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.076 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:02.077 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.077 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-08-25T04:19:02.077 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g==", 2023-08-25T04:19:02.077 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.077 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:19:02.077 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-08-25T04:19:02.077 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-25T04:19:02.077 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.078 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:02.078 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.078 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-08-25T04:19:02.078 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk8KsDMxAAKyK4jMKflYNnJXYIbr2OBQ==", 2023-08-25T04:19:02.078 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.078 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:19:02.078 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:19:02.079 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:19:02.079 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:19:02.079 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.079 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:02.079 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.079 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-08-25T04:19:02.079 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjSA4LxAAxzbnHeV85qYZYhSqTOT2rw==", 2023-08-25T04:19:02.079 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.080 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:19:02.080 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:19:02.080 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:19:02.080 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:19:02.080 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.080 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:02.080 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.080 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-08-25T04:19:02.081 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkl9AoORAARYZcPObsM/HT/yrTmneZrw==", 2023-08-25T04:19:02.081 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.081 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:19:02.081 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:19:02.081 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:19:02.081 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:19:02.081 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.082 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:02.082 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.082 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-08-25T04:19:02.082 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC2J+hkgTdcLxAAqxSepXXhEultFAFYBBKSag==", 2023-08-25T04:19:02.082 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.083 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:19:02.083 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:19:02.083 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:19:02.083 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:02.083 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.083 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:02.083 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.083 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-08-25T04:19:02.084 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkYGUZDBAAiuDo9hqavWq7zQlGd6x4YQ==", 2023-08-25T04:19:02.084 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.084 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:19:02.084 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T04:19:02.084 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:02.084 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.084 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:02.085 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:02.085 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-08-25T04:19:02.085 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjr9KCBAApSqjtFhLnjHduMBu/eaaKw==", 2023-08-25T04:19:02.085 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:02.085 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:19:02.085 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T04:19:02.085 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:02.086 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.086 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:02.086 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-08-25T04:19:02.086 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T04:19:02.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.061+0000 7f3efe888640 1 -- 172.21.15.55:0/1864277758 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f3ed80657d0 msgr2=0x7f3ed8067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:02.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.061+0000 7f3efe888640 1 --2- 172.21.15.55:0/1864277758 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f3ed80657d0 0x7f3ed8067c90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8159000 tx=0x7f3ee0008040 comp rx=0 tx=0).stop 2023-08-25T04:19:02.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.061+0000 7f3efe888640 1 -- 172.21.15.55:0/1864277758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ef80cdde0 msgr2=0x7f3ef81e6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:02.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.061+0000 7f3efe888640 1 --2- 172.21.15.55:0/1864277758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ef80cdde0 0x7f3ef81e6660 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f3ee801f590 tx=0x7f3ee801ba90 comp rx=0 tx=0).stop 2023-08-25T04:19:02.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.061+0000 7f3efe888640 1 -- 172.21.15.55:0/1864277758 shutdown_connections 2023-08-25T04:19:02.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.061+0000 7f3efe888640 1 --2- 172.21.15.55:0/1864277758 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ef80d0da0 0x7f3ef8151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.061+0000 7f3efe888640 1 --2- 172.21.15.55:0/1864277758 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f3ed80657d0 0x7f3ed8067c90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.061+0000 7f3efe888640 1 --2- 172.21.15.55:0/1864277758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ef80cee60 0x7f3ef8151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.061+0000 7f3efe888640 1 --2- 172.21.15.55:0/1864277758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ef80cdde0 0x7f3ef81e6660 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.061+0000 7f3efe888640 1 -- 172.21.15.55:0/1864277758 >> 172.21.15.55:0/1864277758 conn(0x7f3ef809bae0 msgr2=0x7f3ef80cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:02.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.061+0000 7f3efe888640 1 -- 172.21.15.55:0/1864277758 shutdown_connections 2023-08-25T04:19:02.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.061+0000 7f3efe888640 1 -- 172.21.15.55:0/1864277758 wait complete. 2023-08-25T04:19:02.089 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:19:02.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.233+0000 7fae14c19640 1 Processor -- start 2023-08-25T04:19:02.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.233+0000 7fae14c19640 1 -- start start 2023-08-25T04:19:02.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.233+0000 7fae14c19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae100ce220 0x7fae100b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:02.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.233+0000 7fae14c19640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae100b29b0 con 0x7fae100d0da0 2023-08-25T04:19:02.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.233+0000 7fae14c19640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae100ce6b0 con 0x7fae100cdde0 2023-08-25T04:19:02.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.233+0000 7fae14c19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae100b1dc0 con 0x7fae100ce220 2023-08-25T04:19:02.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.233+0000 7fae0e59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fae100d0da0 0x7fae100d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46192/0 (socket says 172.21.15.55:46192) 2023-08-25T04:19:02.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.233+0000 7fae0e59c640 1 -- 172.21.15.55:0/3571348229 learned_addr learned my addr 172.21.15.55:0/3571348229 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:02.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.233+0000 7fae0ed9d640 1 --2- 172.21.15.55:0/3571348229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae100ce220 0x7fae100b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:02.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.233+0000 7fae0dd9b640 1 -- 172.21.15.55:0/3571348229 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622990593 0 0) 0x7fae100b29b0 con 0x7fae100d0da0 2023-08-25T04:19:02.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.233+0000 7fae0dd9b640 1 -- 172.21.15.55:0/3571348229 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadfc003530 con 0x7fae100d0da0 2023-08-25T04:19:02.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.233+0000 7fae0dd9b640 1 -- 172.21.15.55:0/3571348229 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414406492 0 0) 0x7fae100ce6b0 con 0x7fae100cdde0 2023-08-25T04:19:02.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.233+0000 7fae0dd9b640 1 -- 172.21.15.55:0/3571348229 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae100b29b0 con 0x7fae100cdde0 2023-08-25T04:19:02.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.233+0000 7fae0ed9d640 1 -- 172.21.15.55:0/3571348229 >> v1:172.21.15.110:6789/0 conn(0x7fae100cdde0 legacy=0x7fae100b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:02.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.233+0000 7fae0ed9d640 1 -- 172.21.15.55:0/3571348229 >> v1:172.21.15.55:6789/0 conn(0x7fae100d0da0 legacy=0x7fae100d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:02.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.233+0000 7fae0ed9d640 1 -- 172.21.15.55:0/3571348229 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae100b2080 con 0x7fae100ce220 2023-08-25T04:19:02.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.237+0000 7fae0ed9d640 1 --2- 172.21.15.55:0/3571348229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae100ce220 0x7fae100b3550 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fae08009dc0 tx=0x7fae0801f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fca684ecbe2b88cd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:02.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.237+0000 7fae0dd9b640 1 -- 172.21.15.55:0/3571348229 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae080af600 con 0x7fae100ce220 2023-08-25T04:19:02.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.237+0000 7fae0dd9b640 1 -- 172.21.15.55:0/3571348229 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae080ab050 con 0x7fae100ce220 2023-08-25T04:19:02.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.237+0000 7fae0dd9b640 1 -- 172.21.15.55:0/3571348229 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae080af980 con 0x7fae100ce220 2023-08-25T04:19:02.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.237+0000 7fae14c19640 1 -- 172.21.15.55:0/3571348229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae100ce220 msgr2=0x7fae100b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:02.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.237+0000 7fae14c19640 1 --2- 172.21.15.55:0/3571348229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae100ce220 0x7fae100b3550 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fae08009dc0 tx=0x7fae0801f150 comp rx=0 tx=0).stop 2023-08-25T04:19:02.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.237+0000 7fae14c19640 1 -- 172.21.15.55:0/3571348229 shutdown_connections 2023-08-25T04:19:02.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.237+0000 7fae14c19640 1 --2- 172.21.15.55:0/3571348229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae100ce220 0x7fae100b3550 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.237+0000 7fae14c19640 1 -- 172.21.15.55:0/3571348229 >> 172.21.15.55:0/3571348229 conn(0x7fae1009bae0 msgr2=0x7fae100d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:02.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.237+0000 7fae14c19640 1 -- 172.21.15.55:0/3571348229 shutdown_connections 2023-08-25T04:19:02.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.237+0000 7fae14c19640 1 -- 172.21.15.55:0/3571348229 wait complete. 2023-08-25T04:19:02.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae14c19640 1 Processor -- start 2023-08-25T04:19:02.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae14c19640 1 -- start start 2023-08-25T04:19:02.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae14c19640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae100cdde0 0x7fae10155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:02.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae14c19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100ce220 0x7fae100c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:02.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae14c19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae100d0da0 0x7fae10155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:02.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae14c19640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae100b5730 con 0x7fae100ce220 2023-08-25T04:19:02.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae14c19640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae10155890 con 0x7fae100cdde0 2023-08-25T04:19:02.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae14c19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae100b7a90 con 0x7fae100d0da0 2023-08-25T04:19:02.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae07fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100ce220 0x7fae100c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:02.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae07fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100ce220 0x7fae100c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47748/0 (socket says 172.21.15.55:47748) 2023-08-25T04:19:02.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae07fff640 1 -- 172.21.15.55:0/4101965374 learned_addr learned my addr 172.21.15.55:0/4101965374 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:02.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae0e59c640 1 --2- 172.21.15.55:0/4101965374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae100cdde0 0x7fae10155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:02.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae0ed9d640 1 --2- 172.21.15.55:0/4101965374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae100d0da0 0x7fae10155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:02.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae07fff640 1 -- 172.21.15.55:0/4101965374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae100d0da0 msgr2=0x7fae10155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:02.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae07fff640 1 --2- 172.21.15.55:0/4101965374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae100d0da0 0x7fae10155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae07fff640 1 -- 172.21.15.55:0/4101965374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae100cdde0 msgr2=0x7fae10155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:02.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae07fff640 1 --2- 172.21.15.55:0/4101965374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae100cdde0 0x7fae10155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae07fff640 1 -- 172.21.15.55:0/4101965374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae08009a70 con 0x7fae100ce220 2023-08-25T04:19:02.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae0ed9d640 1 --2- 172.21.15.55:0/4101965374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae100d0da0 0x7fae10155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:02.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae07fff640 1 --2- 172.21.15.55:0/4101965374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100ce220 0x7fae100c8b80 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fadf800c430 tx=0x7fadf800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:02.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae06ffd640 1 -- 172.21.15.55:0/4101965374 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf80052d0 con 0x7fae100ce220 2023-08-25T04:19:02.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae06ffd640 1 -- 172.21.15.55:0/4101965374 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf8005450 con 0x7fae100ce220 2023-08-25T04:19:02.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae06ffd640 1 -- 172.21.15.55:0/4101965374 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8003840 con 0x7fae100ce220 2023-08-25T04:19:02.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae14c19640 1 -- 172.21.15.55:0/4101965374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae100b7d70 con 0x7fae100ce220 2023-08-25T04:19:02.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.241+0000 7fae14c19640 1 -- 172.21.15.55:0/4101965374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae100b8330 con 0x7fae100ce220 2023-08-25T04:19:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.245+0000 7fae14c19640 1 -- 172.21.15.55:0/4101965374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae100c62f0 con 0x7fae100ce220 2023-08-25T04:19:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.245+0000 7fae06ffd640 1 -- 172.21.15.55:0/4101965374 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fadf80039a0 con 0x7fae100ce220 2023-08-25T04:19:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.245+0000 7fae06ffd640 1 --2- 172.21.15.55:0/4101965374 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fadf00657a0 0x7fadf0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.245+0000 7fae06ffd640 1 -- 172.21.15.55:0/4101965374 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fadf8082190 con 0x7fae100ce220 2023-08-25T04:19:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.245+0000 7fae0e59c640 1 --2- 172.21.15.55:0/4101965374 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fadf00657a0 0x7fadf0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.245+0000 7fae0e59c640 1 --2- 172.21.15.55:0/4101965374 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fadf00657a0 0x7fadf0067c60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fae000010f0 tx=0x7fae00007bf0 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.249+0000 7fae06ffd640 1 -- 172.21.15.55:0/4101965374 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fadf804ff30 con 0x7fae100ce220 2023-08-25T04:19:02.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.405+0000 7fae14c19640 1 -- 172.21.15.55:0/4101965374 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae1004dbe0 con 0x7fae100ce220 2023-08-25T04:19:02.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.409+0000 7fae06ffd640 1 -- 172.21.15.55:0/4101965374 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+14652 (secure 0 0 0) 0x7fadf8053550 con 0x7fae100ce220 2023-08-25T04:19:02.409 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:02.410 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":89,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:19:01.655630+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:19:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.409+0000 7fae14c19640 1 -- 172.21.15.55:0/4101965374 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fadf00657a0 msgr2=0x7fadf0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.409+0000 7fae14c19640 1 --2- 172.21.15.55:0/4101965374 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fadf00657a0 0x7fadf0067c60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fae000010f0 tx=0x7fae00007bf0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.409+0000 7fae14c19640 1 -- 172.21.15.55:0/4101965374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100ce220 msgr2=0x7fae100c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.409+0000 7fae14c19640 1 --2- 172.21.15.55:0/4101965374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100ce220 0x7fae100c8b80 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fadf800c430 tx=0x7fadf800c8f0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.409+0000 7fae14c19640 1 -- 172.21.15.55:0/4101965374 shutdown_connections 2023-08-25T04:19:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.409+0000 7fae14c19640 1 --2- 172.21.15.55:0/4101965374 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fadf00657a0 0x7fadf0067c60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.409+0000 7fae14c19640 1 --2- 172.21.15.55:0/4101965374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae100d0da0 0x7fae10155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.409+0000 7fae14c19640 1 --2- 172.21.15.55:0/4101965374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae100ce220 0x7fae100c8b80 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.409+0000 7fae14c19640 1 --2- 172.21.15.55:0/4101965374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae100cdde0 0x7fae10155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.409+0000 7fae14c19640 1 -- 172.21.15.55:0/4101965374 >> 172.21.15.55:0/4101965374 conn(0x7fae1009bae0 msgr2=0x7fae100af440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.409+0000 7fae14c19640 1 -- 172.21.15.55:0/4101965374 shutdown_connections 2023-08-25T04:19:02.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.409+0000 7fae14c19640 1 -- 172.21.15.55:0/4101965374 wait complete. 2023-08-25T04:19:02.430 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:19:02.431 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:19:02.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.577+0000 7f77e89fa640 1 Processor -- start 2023-08-25T04:19:02.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.577+0000 7f77e89fa640 1 -- start start 2023-08-25T04:19:02.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77e89fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f77e406c3b0 0x7f77e40cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:02.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77e89fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77e406c790 0x7f77e406de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:02.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77e89fa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f77e40d1060 0x7f77e406e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:02.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77e89fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e40cab90 con 0x7f77e406c3b0 2023-08-25T04:19:02.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77e89fa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e406dbb0 con 0x7f77e40d1060 2023-08-25T04:19:02.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77e89fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e40cae50 con 0x7f77e406c790 2023-08-25T04:19:02.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77e259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f77e406c3b0 0x7f77e40cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:02.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77e259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f77e406c3b0 0x7f77e40cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47752/0 (socket says 172.21.15.55:47752) 2023-08-25T04:19:02.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77e259c640 1 -- 172.21.15.55:0/2379584423 learned_addr learned my addr 172.21.15.55:0/2379584423 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:02.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77e259c640 1 -- 172.21.15.55:0/2379584423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77e406c790 msgr2=0x7f77e406de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:02.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77d9d9b640 1 --2- 172.21.15.55:0/2379584423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77e406c790 0x7f77e406de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:02.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77e2d9d640 1 --2- 172.21.15.55:0/2379584423 >> v2:172.21.15.110:3300/0 conn(0x7f77e40d1060 0x7f77e406e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:02.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77e259c640 1 --2- 172.21.15.55:0/2379584423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77e406c790 0x7f77e406de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77e259c640 1 -- 172.21.15.55:0/2379584423 >> v2:172.21.15.110:3300/0 conn(0x7f77e40d1060 msgr2=0x7f77e406e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:02.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77e259c640 1 --2- 172.21.15.55:0/2379584423 >> v2:172.21.15.110:3300/0 conn(0x7f77e40d1060 0x7f77e406e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77e259c640 1 -- 172.21.15.55:0/2379584423 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e40cb130 con 0x7f77e406c3b0 2023-08-25T04:19:02.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77e2d9d640 1 --2- 172.21.15.55:0/2379584423 >> v2:172.21.15.110:3300/0 conn(0x7f77e40d1060 0x7f77e406e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:19:02.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77d9d9b640 1 --2- 172.21.15.55:0/2379584423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77e406c790 0x7f77e406de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:19:02.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.581+0000 7f77e259c640 1 --2- 172.21.15.55:0/2379584423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e406c3b0 0x7f77e40cd7d0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f77e40715a0 tx=0x7f77d401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b909f9d799e354 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:02.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e1d9b640 1 -- 172.21.15.55:0/2379584423 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d40a5860 con 0x7f77e406c3b0 2023-08-25T04:19:02.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e1d9b640 1 -- 172.21.15.55:0/2379584423 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d40a59c0 con 0x7f77e406c3b0 2023-08-25T04:19:02.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e1d9b640 1 -- 172.21.15.55:0/2379584423 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d40a5d50 con 0x7f77e406c3b0 2023-08-25T04:19:02.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e89fa640 1 -- 172.21.15.55:0/2379584423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e406c3b0 msgr2=0x7f77e40cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:02.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e89fa640 1 --2- 172.21.15.55:0/2379584423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e406c3b0 0x7f77e40cd7d0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f77e40715a0 tx=0x7f77d401c9c0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e89fa640 1 -- 172.21.15.55:0/2379584423 shutdown_connections 2023-08-25T04:19:02.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e89fa640 1 --2- 172.21.15.55:0/2379584423 >> v2:172.21.15.110:3300/0 conn(0x7f77e40d1060 0x7f77e406e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e89fa640 1 --2- 172.21.15.55:0/2379584423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77e406c790 0x7f77e406de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e89fa640 1 --2- 172.21.15.55:0/2379584423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e406c3b0 0x7f77e40cd7d0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e89fa640 1 -- 172.21.15.55:0/2379584423 >> 172.21.15.55:0/2379584423 conn(0x7f77e40d0540 msgr2=0x7f77e40d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:02.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e89fa640 1 -- 172.21.15.55:0/2379584423 shutdown_connections 2023-08-25T04:19:02.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e89fa640 1 -- 172.21.15.55:0/2379584423 wait complete. 2023-08-25T04:19:02.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e89fa640 1 Processor -- start 2023-08-25T04:19:02.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e89fa640 1 -- start start 2023-08-25T04:19:02.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e89fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77e406c3b0 0x7f77e415faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:02.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e89fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e406c790 0x7f77e40c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:02.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e89fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77e40d1060 0x7f77e415e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:02.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e89fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e413d3f0 con 0x7f77e406c790 2023-08-25T04:19:02.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e89fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e415ffe0 con 0x7f77e40d1060 2023-08-25T04:19:02.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e89fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e413c7e0 con 0x7f77e406c3b0 2023-08-25T04:19:02.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77d9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e406c790 0x7f77e40c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:02.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77d9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e406c790 0x7f77e40c8c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47758/0 (socket says 172.21.15.55:47758) 2023-08-25T04:19:02.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77d9d9b640 1 -- 172.21.15.55:0/1391004006 learned_addr learned my addr 172.21.15.55:0/1391004006 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:02.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.585+0000 7f77e2d9d640 1 --2- 172.21.15.55:0/1391004006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77e40d1060 0x7f77e415e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:02.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.589+0000 7f77e259c640 1 --2- 172.21.15.55:0/1391004006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77e406c3b0 0x7f77e415faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:02.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.589+0000 7f77d9d9b640 1 -- 172.21.15.55:0/1391004006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77e406c3b0 msgr2=0x7f77e415faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:02.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.589+0000 7f77d9d9b640 1 --2- 172.21.15.55:0/1391004006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77e406c3b0 0x7f77e415faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.589+0000 7f77d9d9b640 1 -- 172.21.15.55:0/1391004006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77e40d1060 msgr2=0x7f77e415e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:02.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.589+0000 7f77d9d9b640 1 --2- 172.21.15.55:0/1391004006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77e40d1060 0x7f77e415e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.589+0000 7f77d9d9b640 1 -- 172.21.15.55:0/1391004006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d4009b30 con 0x7f77e406c790 2023-08-25T04:19:02.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.589+0000 7f77d9d9b640 1 --2- 172.21.15.55:0/1391004006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e406c790 0x7f77e40c8c60 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00c7c0 tx=0x7f77cc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:02.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.589+0000 7f77db7fe640 1 -- 172.21.15.55:0/1391004006 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc007820 con 0x7f77e406c790 2023-08-25T04:19:02.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.589+0000 7f77db7fe640 1 -- 172.21.15.55:0/1391004006 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77cc007980 con 0x7f77e406c790 2023-08-25T04:19:02.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.589+0000 7f77db7fe640 1 -- 172.21.15.55:0/1391004006 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77cc007d10 con 0x7f77e406c790 2023-08-25T04:19:02.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.589+0000 7f77e89fa640 1 -- 172.21.15.55:0/1391004006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e413cac0 con 0x7f77e406c790 2023-08-25T04:19:02.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.589+0000 7f77e89fa640 1 -- 172.21.15.55:0/1391004006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e413d080 con 0x7f77e406c790 2023-08-25T04:19:02.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.589+0000 7f77e89fa640 1 -- 172.21.15.55:0/1391004006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e4073ec0 con 0x7f77e406c790 2023-08-25T04:19:02.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.589+0000 7f77db7fe640 1 -- 172.21.15.55:0/1391004006 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f77cc0113f0 con 0x7f77e406c790 2023-08-25T04:19:02.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.589+0000 7f77db7fe640 1 --2- 172.21.15.55:0/1391004006 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f77c40657a0 0x7f77c4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:02.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.589+0000 7f77db7fe640 1 -- 172.21.15.55:0/1391004006 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f77cc082e90 con 0x7f77e406c790 2023-08-25T04:19:02.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.593+0000 7f77e259c640 1 --2- 172.21.15.55:0/1391004006 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f77c40657a0 0x7f77c4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:02.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.593+0000 7f77e259c640 1 --2- 172.21.15.55:0/1391004006 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f77c40657a0 0x7f77c4067c60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f77d40ae000 tx=0x7f77d40a7070 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:02.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.593+0000 7f77db7fe640 1 -- 172.21.15.55:0/1391004006 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f77cc050a10 con 0x7f77e406c790 2023-08-25T04:19:02.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.753+0000 7f77e89fa640 1 -- 172.21.15.55:0/1391004006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f77e40ceed0 con 0x7f77e406c790 2023-08-25T04:19:02.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.753+0000 7f77db7fe640 1 -- 172.21.15.55:0/1391004006 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f77cc054030 con 0x7f77e406c790 2023-08-25T04:19:02.753 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:19:02.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.753+0000 7f77e89fa640 1 -- 172.21.15.55:0/1391004006 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f77c40657a0 msgr2=0x7f77c4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:02.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.753+0000 7f77e89fa640 1 --2- 172.21.15.55:0/1391004006 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f77c40657a0 0x7f77c4067c60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f77d40ae000 tx=0x7f77d40a7070 comp rx=0 tx=0).stop 2023-08-25T04:19:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.753+0000 7f77e89fa640 1 -- 172.21.15.55:0/1391004006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e406c790 msgr2=0x7f77e40c8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.753+0000 7f77e89fa640 1 --2- 172.21.15.55:0/1391004006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e406c790 0x7f77e40c8c60 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f77cc00c7c0 tx=0x7f77cc00cc80 comp rx=0 tx=0).stop 2023-08-25T04:19:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.753+0000 7f77e89fa640 1 -- 172.21.15.55:0/1391004006 shutdown_connections 2023-08-25T04:19:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.753+0000 7f77e89fa640 1 --2- 172.21.15.55:0/1391004006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77e40d1060 0x7f77e415e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.753+0000 7f77e89fa640 1 --2- 172.21.15.55:0/1391004006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77e406c790 0x7f77e40c8c60 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.753+0000 7f77e89fa640 1 --2- 172.21.15.55:0/1391004006 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f77c40657a0 0x7f77c4067c60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.753+0000 7f77e89fa640 1 --2- 172.21.15.55:0/1391004006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77e406c3b0 0x7f77e415faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.753+0000 7f77e89fa640 1 -- 172.21.15.55:0/1391004006 >> 172.21.15.55:0/1391004006 conn(0x7f77e40d0540 msgr2=0x7f77e40cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:02.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.753+0000 7f77e89fa640 1 -- 172.21.15.55:0/1391004006 shutdown_connections 2023-08-25T04:19:02.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.753+0000 7f77e89fa640 1 -- 172.21.15.55:0/1391004006 wait complete. 2023-08-25T04:19:02.775 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:19:02.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.921+0000 7f6166dba640 1 Processor -- start 2023-08-25T04:19:02.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.921+0000 7f6166dba640 1 -- start start 2023-08-25T04:19:02.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.921+0000 7f6166dba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f61600cb020 0x7f61600c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:02.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.921+0000 7f6166dba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f616006c720 0x7f616006cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:02.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.921+0000 7f6166dba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61600cbca0 con 0x7f61600cdd50 2023-08-25T04:19:02.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.921+0000 7f6166dba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61600c9470 con 0x7f61600cb020 2023-08-25T04:19:02.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.921+0000 7f6166dba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61600ce1e0 con 0x7f616006c720 2023-08-25T04:19:02.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.921+0000 7f615ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f61600cdd50 0x7f61600cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46208/0 (socket says 172.21.15.55:46208) 2023-08-25T04:19:02.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.921+0000 7f615ffff640 1 -- 172.21.15.55:0/4024336842 learned_addr learned my addr 172.21.15.55:0/4024336842 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:02.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.925+0000 7f6165357640 1 --2- 172.21.15.55:0/4024336842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f616006c720 0x7f616006cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:02.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.925+0000 7f6164b56640 1 --2- 172.21.15.55:0/4024336842 >> v2:172.21.15.110:3300/0 conn(0x7f61600cb020 0x7f61600c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:02.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.925+0000 7f615f7fe640 1 -- 172.21.15.55:0/4024336842 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390600776 0 0) 0x7f61600cbca0 con 0x7f61600cdd50 2023-08-25T04:19:02.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.925+0000 7f615f7fe640 1 -- 172.21.15.55:0/4024336842 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6150003530 con 0x7f61600cdd50 2023-08-25T04:19:02.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.925+0000 7f6165357640 1 -- 172.21.15.55:0/4024336842 >> v2:172.21.15.110:3300/0 conn(0x7f61600cb020 msgr2=0x7f61600c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:02.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.925+0000 7f6165357640 1 --2- 172.21.15.55:0/4024336842 >> v2:172.21.15.110:3300/0 conn(0x7f61600cb020 0x7f61600c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.925+0000 7f615f7fe640 1 -- 172.21.15.55:0/4024336842 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4185368052 0 0) 0x7f6150003530 con 0x7f61600cdd50 2023-08-25T04:19:02.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.925+0000 7f6165357640 1 -- 172.21.15.55:0/4024336842 >> v1:172.21.15.55:6789/0 conn(0x7f61600cdd50 legacy=0x7f61600cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:02.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.925+0000 7f6165357640 1 -- 172.21.15.55:0/4024336842 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616006d070 con 0x7f616006c720 2023-08-25T04:19:02.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.925+0000 7f6164b56640 1 --2- 172.21.15.55:0/4024336842 >> v2:172.21.15.110:3300/0 conn(0x7f61600cb020 0x7f61600c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:02.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.925+0000 7f6165357640 1 --2- 172.21.15.55:0/4024336842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f616006c720 0x7f616006cb30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6158009d90 tx=0x7f615801c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bc16233db2959ee server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:02.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.925+0000 7f615f7fe640 1 -- 172.21.15.55:0/4024336842 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c001680 con 0x7f616006c720 2023-08-25T04:19:02.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f615f7fe640 1 -- 172.21.15.55:0/4024336842 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61580a64e0 con 0x7f616006c720 2023-08-25T04:19:02.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f615f7fe640 1 -- 172.21.15.55:0/4024336842 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61580a6870 con 0x7f616006c720 2023-08-25T04:19:02.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f6166dba640 1 -- 172.21.15.55:0/4024336842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f616006c720 msgr2=0x7f616006cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:02.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f6166dba640 1 --2- 172.21.15.55:0/4024336842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f616006c720 0x7f616006cb30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6158009d90 tx=0x7f615801c7e0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f6166dba640 1 -- 172.21.15.55:0/4024336842 shutdown_connections 2023-08-25T04:19:02.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f6166dba640 1 --2- 172.21.15.55:0/4024336842 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f616006c720 0x7f616006cb30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f6166dba640 1 --2- 172.21.15.55:0/4024336842 >> v2:172.21.15.110:3300/0 conn(0x7f61600cb020 0x7f61600c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f6166dba640 1 -- 172.21.15.55:0/4024336842 >> 172.21.15.55:0/4024336842 conn(0x7f6160069900 msgr2=0x7f6160069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:02.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f6166dba640 1 -- 172.21.15.55:0/4024336842 shutdown_connections 2023-08-25T04:19:02.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f6166dba640 1 -- 172.21.15.55:0/4024336842 wait complete. 2023-08-25T04:19:02.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f6166dba640 1 Processor -- start 2023-08-25T04:19:02.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f6166dba640 1 -- start start 2023-08-25T04:19:02.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f6166dba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f616006c720 0x7f61600ac600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:02.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f6166dba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61600cb020 0x7f61600ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:02.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f6166dba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61600cdd50 0x7f61600ade20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:02.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f6166dba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61600acde0 con 0x7f61600cdd50 2023-08-25T04:19:02.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f6166dba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61600acb40 con 0x7f61600cb020 2023-08-25T04:19:02.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f6166dba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6160158e40 con 0x7f616006c720 2023-08-25T04:19:02.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.929+0000 7f6165357640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61600cdd50 0x7f61600ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:02.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.933+0000 7f6165357640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61600cdd50 0x7f61600ade20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47766/0 (socket says 172.21.15.55:47766) 2023-08-25T04:19:02.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.933+0000 7f6165357640 1 -- 172.21.15.55:0/2262349678 learned_addr learned my addr 172.21.15.55:0/2262349678 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:02.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.933+0000 7f615ffff640 1 --2- 172.21.15.55:0/2262349678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61600cb020 0x7f61600ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:02.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.933+0000 7f6164b56640 1 --2- 172.21.15.55:0/2262349678 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f616006c720 0x7f61600ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:02.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.933+0000 7f6165357640 1 -- 172.21.15.55:0/2262349678 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f616006c720 msgr2=0x7f61600ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:02.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.933+0000 7f6165357640 1 --2- 172.21.15.55:0/2262349678 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f616006c720 0x7f61600ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.933+0000 7f6165357640 1 -- 172.21.15.55:0/2262349678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61600cb020 msgr2=0x7f61600ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:02.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.933+0000 7f6165357640 1 --2- 172.21.15.55:0/2262349678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61600cb020 0x7f61600ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:02.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.933+0000 7f6165357640 1 -- 172.21.15.55:0/2262349678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61540093b0 con 0x7f61600cdd50 2023-08-25T04:19:02.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.933+0000 7f6165357640 1 --2- 172.21.15.55:0/2262349678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61600cdd50 0x7f61600ade20 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f615801d080 tx=0x7f6158019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:02.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.933+0000 7f615d7fa640 1 -- 172.21.15.55:0/2262349678 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61580b8630 con 0x7f61600cdd50 2023-08-25T04:19:02.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.933+0000 7f615d7fa640 1 -- 172.21.15.55:0/2262349678 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61580b8790 con 0x7f61600cdd50 2023-08-25T04:19:02.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.933+0000 7f6166dba640 1 -- 172.21.15.55:0/2262349678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6158009a70 con 0x7f61600cdd50 2023-08-25T04:19:02.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.933+0000 7f615d7fa640 1 -- 172.21.15.55:0/2262349678 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61580b8b20 con 0x7f61600cdd50 2023-08-25T04:19:02.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.933+0000 7f6166dba640 1 -- 172.21.15.55:0/2262349678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6160159400 con 0x7f61600cdd50 2023-08-25T04:19:02.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.933+0000 7f6166dba640 1 -- 172.21.15.55:0/2262349678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6160073ec0 con 0x7f61600cdd50 2023-08-25T04:19:02.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.933+0000 7f615d7fa640 1 -- 172.21.15.55:0/2262349678 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f61580b8c80 con 0x7f61600cdd50 2023-08-25T04:19:02.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.933+0000 7f615d7fa640 1 --2- 172.21.15.55:0/2262349678 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f61440657a0 0x7f6144067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:02.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.937+0000 7f615d7fa640 1 -- 172.21.15.55:0/2262349678 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f61580aa070 con 0x7f61600cdd50 2023-08-25T04:19:02.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.937+0000 7f6164b56640 1 --2- 172.21.15.55:0/2262349678 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f61440657a0 0x7f6144067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:02.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.937+0000 7f6164b56640 1 --2- 172.21.15.55:0/2262349678 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f61440657a0 0x7f6144067c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6154009cd0 tx=0x7f6154006f90 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:02.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:02.937+0000 7f615d7fa640 1 -- 172.21.15.55:0/2262349678 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f61580ec3d0 con 0x7f61600cdd50 2023-08-25T04:19:03.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.093+0000 7f6166dba640 1 -- 172.21.15.55:0/2262349678 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6160070d70 con 0x7f61600cdd50 2023-08-25T04:19:03.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.093+0000 7f615d7fa640 1 -- 172.21.15.55:0/2262349678 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v89) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6158009450 con 0x7f61600cdd50 2023-08-25T04:19:03.094 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:19:03.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.097+0000 7f6166dba640 1 -- 172.21.15.55:0/2262349678 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f61440657a0 msgr2=0x7f6144067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:03.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.097+0000 7f6166dba640 1 --2- 172.21.15.55:0/2262349678 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f61440657a0 0x7f6144067c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6154009cd0 tx=0x7f6154006f90 comp rx=0 tx=0).stop 2023-08-25T04:19:03.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.097+0000 7f6166dba640 1 -- 172.21.15.55:0/2262349678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61600cdd50 msgr2=0x7f61600ade20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:03.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.097+0000 7f6166dba640 1 --2- 172.21.15.55:0/2262349678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61600cdd50 0x7f61600ade20 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f615801d080 tx=0x7f6158019580 comp rx=0 tx=0).stop 2023-08-25T04:19:03.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.097+0000 7f6166dba640 1 -- 172.21.15.55:0/2262349678 shutdown_connections 2023-08-25T04:19:03.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.097+0000 7f6166dba640 1 --2- 172.21.15.55:0/2262349678 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61600cdd50 0x7f61600ade20 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:03.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.097+0000 7f6166dba640 1 --2- 172.21.15.55:0/2262349678 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61600cb020 0x7f61600ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:03.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.097+0000 7f6166dba640 1 --2- 172.21.15.55:0/2262349678 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f61440657a0 0x7f6144067c60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:03.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.097+0000 7f6166dba640 1 --2- 172.21.15.55:0/2262349678 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f616006c720 0x7f61600ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:03.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.097+0000 7f6166dba640 1 -- 172.21.15.55:0/2262349678 >> 172.21.15.55:0/2262349678 conn(0x7f6160069900 msgr2=0x7f61600c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:03.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.097+0000 7f6166dba640 1 -- 172.21.15.55:0/2262349678 shutdown_connections 2023-08-25T04:19:03.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.097+0000 7f6166dba640 1 -- 172.21.15.55:0/2262349678 wait complete. 2023-08-25T04:19:03.116 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-25T04:19:03.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.257+0000 7fc369111640 1 Processor -- start 2023-08-25T04:19:03.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.257+0000 7fc369111640 1 -- start start 2023-08-25T04:19:03.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.261+0000 7fc369111640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc36415c9c0 0x7fc364160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:03.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.261+0000 7fc369111640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36406eaf0 con 0x7fc36406b2b0 2023-08-25T04:19:03.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.261+0000 7fc369111640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36406e530 con 0x7fc3640cfa70 2023-08-25T04:19:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.261+0000 7fc369111640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36406e810 con 0x7fc36415c9c0 2023-08-25T04:19:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.261+0000 7fc362d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc36415c9c0 0x7fc364160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.261+0000 7fc36359e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc36406b2b0 0x7fc36406b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46218/0 (socket says 172.21.15.55:46218) 2023-08-25T04:19:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.261+0000 7fc362d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc36415c9c0 0x7fc364160510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47772/0 (socket says 172.21.15.55:47772) 2023-08-25T04:19:03.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.261+0000 7fc36359e640 1 -- 172.21.15.55:0/3985126899 learned_addr learned my addr 172.21.15.55:0/3985126899 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:03.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.261+0000 7fc362d9d640 1 -- 172.21.15.55:0/3985126899 >> v1:172.21.15.110:6789/0 conn(0x7fc3640cfa70 legacy=0x7fc364160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:03.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.261+0000 7fc362d9d640 1 -- 172.21.15.55:0/3985126899 >> v1:172.21.15.55:6789/0 conn(0x7fc36406b2b0 legacy=0x7fc36406b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:03.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.261+0000 7fc36259c640 1 -- 172.21.15.55:0/3985126899 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063661854 0 0) 0x7fc36406eaf0 con 0x7fc36406b2b0 2023-08-25T04:19:03.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.261+0000 7fc362d9d640 1 -- 172.21.15.55:0/3985126899 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36406aab0 con 0x7fc36415c9c0 2023-08-25T04:19:03.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.265+0000 7fc362d9d640 1 --2- 172.21.15.55:0/3985126899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc36415c9c0 0x7fc364160510 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc354009de0 tx=0x7fc35401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91de9f5d15e9090d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:03.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.265+0000 7fc36259c640 1 -- 172.21.15.55:0/3985126899 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3540a59e0 con 0x7fc36415c9c0 2023-08-25T04:19:03.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.265+0000 7fc36259c640 1 -- 172.21.15.55:0/3985126899 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3540a5b40 con 0x7fc36415c9c0 2023-08-25T04:19:03.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.265+0000 7fc36259c640 1 -- 172.21.15.55:0/3985126899 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3540ad440 con 0x7fc36415c9c0 2023-08-25T04:19:03.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.265+0000 7fc369111640 1 -- 172.21.15.55:0/3985126899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc36415c9c0 msgr2=0x7fc364160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:03.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.265+0000 7fc369111640 1 --2- 172.21.15.55:0/3985126899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc36415c9c0 0x7fc364160510 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc354009de0 tx=0x7fc35401c960 comp rx=0 tx=0).stop 2023-08-25T04:19:03.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.265+0000 7fc369111640 1 -- 172.21.15.55:0/3985126899 shutdown_connections 2023-08-25T04:19:03.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.265+0000 7fc369111640 1 --2- 172.21.15.55:0/3985126899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc36415c9c0 0x7fc364160510 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:03.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.265+0000 7fc369111640 1 -- 172.21.15.55:0/3985126899 >> 172.21.15.55:0/3985126899 conn(0x7fc3640d05a0 msgr2=0x7fc3640d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:03.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.265+0000 7fc369111640 1 -- 172.21.15.55:0/3985126899 shutdown_connections 2023-08-25T04:19:03.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.265+0000 7fc369111640 1 -- 172.21.15.55:0/3985126899 wait complete. 2023-08-25T04:19:03.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.265+0000 7fc369111640 1 Processor -- start 2023-08-25T04:19:03.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.265+0000 7fc369111640 1 -- start start 2023-08-25T04:19:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc369111640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc36406b2b0 0x7fc36414a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc369111640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3640cfa70 0x7fc3641524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc369111640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc36415c9c0 0x7fc364154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc369111640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36414ace0 con 0x7fc36406b2b0 2023-08-25T04:19:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc369111640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36415a000 con 0x7fc3640cfa70 2023-08-25T04:19:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc369111640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36415a2e0 con 0x7fc36415c9c0 2023-08-25T04:19:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc362d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc36406b2b0 0x7fc36414a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc362d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc36406b2b0 0x7fc36414a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47778/0 (socket says 172.21.15.55:47778) 2023-08-25T04:19:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc362d9d640 1 -- 172.21.15.55:0/3406093250 learned_addr learned my addr 172.21.15.55:0/3406093250 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:03.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc362d9d640 1 -- 172.21.15.55:0/3406093250 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc36415c9c0 msgr2=0x7fc364154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:03.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc362d9d640 1 --2- 172.21.15.55:0/3406093250 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc36415c9c0 0x7fc364154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:03.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc362d9d640 1 -- 172.21.15.55:0/3406093250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3640cfa70 msgr2=0x7fc3641524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:03.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc362d9d640 1 --2- 172.21.15.55:0/3406093250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3640cfa70 0x7fc3641524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:03.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc362d9d640 1 -- 172.21.15.55:0/3406093250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc354009a70 con 0x7fc36406b2b0 2023-08-25T04:19:03.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc362d9d640 1 --2- 172.21.15.55:0/3406093250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc36406b2b0 0x7fc36414a7a0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc354019570 tx=0x7fc354019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:03.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc35bfff640 1 -- 172.21.15.55:0/3406093250 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3540a59e0 con 0x7fc36406b2b0 2023-08-25T04:19:03.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc35bfff640 1 -- 172.21.15.55:0/3406093250 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3540b7410 con 0x7fc36406b2b0 2023-08-25T04:19:03.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc369111640 1 -- 172.21.15.55:0/3406093250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36415a5c0 con 0x7fc36406b2b0 2023-08-25T04:19:03.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc35bfff640 1 -- 172.21.15.55:0/3406093250 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3540b7780 con 0x7fc36406b2b0 2023-08-25T04:19:03.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc369111640 1 -- 172.21.15.55:0/3406093250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36415ab80 con 0x7fc36406b2b0 2023-08-25T04:19:03.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc369111640 1 -- 172.21.15.55:0/3406093250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36404dbe0 con 0x7fc36406b2b0 2023-08-25T04:19:03.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.269+0000 7fc35bfff640 1 -- 172.21.15.55:0/3406093250 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fc3540b4050 con 0x7fc36406b2b0 2023-08-25T04:19:03.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.273+0000 7fc35bfff640 1 --2- 172.21.15.55:0/3406093250 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc3440657a0 0x7fc344067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:03.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.273+0000 7fc35bfff640 1 -- 172.21.15.55:0/3406093250 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc35411dc20 con 0x7fc36406b2b0 2023-08-25T04:19:03.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.273+0000 7fc35a59c640 1 --2- 172.21.15.55:0/3406093250 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc3440657a0 0x7fc344067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:03.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.273+0000 7fc35a59c640 1 --2- 172.21.15.55:0/3406093250 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc3440657a0 0x7fc344067c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc34c000f70 tx=0x7fc34c0079c0 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:03.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.277+0000 7fc35bfff640 1 -- 172.21.15.55:0/3406093250 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc3540eba50 con 0x7fc36406b2b0 2023-08-25T04:19:03.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.433+0000 7fc369111640 1 -- 172.21.15.55:0/3406093250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc3640cdc20 con 0x7fc36406b2b0 2023-08-25T04:19:03.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.433+0000 7fc35bfff640 1 -- 172.21.15.55:0/3406093250 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v89) v1 ==== 84+0+126 (secure 0 0 0) 0x7fc3540b2090 con 0x7fc36406b2b0 2023-08-25T04:19:03.435 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:03.435 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T04:19:03.436 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:03.436 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-08-25T04:19:03.436 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-08-25T04:19:03.436 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:03.436 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:03.436 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-08-25T04:19:03.436 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-08-25T04:19:03.437 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:03.437 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T04:19:03.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.437+0000 7fc369111640 1 -- 172.21.15.55:0/3406093250 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc3440657a0 msgr2=0x7fc344067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:03.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.437+0000 7fc369111640 1 --2- 172.21.15.55:0/3406093250 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc3440657a0 0x7fc344067c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc34c000f70 tx=0x7fc34c0079c0 comp rx=0 tx=0).stop 2023-08-25T04:19:03.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.437+0000 7fc369111640 1 -- 172.21.15.55:0/3406093250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc36406b2b0 msgr2=0x7fc36414a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:03.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.437+0000 7fc369111640 1 --2- 172.21.15.55:0/3406093250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc36406b2b0 0x7fc36414a7a0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc354019570 tx=0x7fc354019700 comp rx=0 tx=0).stop 2023-08-25T04:19:03.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.437+0000 7fc369111640 1 -- 172.21.15.55:0/3406093250 shutdown_connections 2023-08-25T04:19:03.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.437+0000 7fc369111640 1 --2- 172.21.15.55:0/3406093250 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc3440657a0 0x7fc344067c60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:03.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.437+0000 7fc369111640 1 --2- 172.21.15.55:0/3406093250 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc36415c9c0 0x7fc364154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:03.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.437+0000 7fc369111640 1 --2- 172.21.15.55:0/3406093250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3640cfa70 0x7fc3641524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:03.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.437+0000 7fc369111640 1 --2- 172.21.15.55:0/3406093250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc36406b2b0 0x7fc36414a7a0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:03.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.437+0000 7fc369111640 1 -- 172.21.15.55:0/3406093250 >> 172.21.15.55:0/3406093250 conn(0x7fc3640d05a0 msgr2=0x7fc36415bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:03.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.437+0000 7fc369111640 1 -- 172.21.15.55:0/3406093250 shutdown_connections 2023-08-25T04:19:03.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.437+0000 7fc369111640 1 -- 172.21.15.55:0/3406093250 wait complete. 2023-08-25T04:19:03.457 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-25T04:19:03.458 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-25T04:19:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.605+0000 7f2ee849e640 1 Processor -- start 2023-08-25T04:19:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.605+0000 7f2ee849e640 1 -- start start 2023-08-25T04:19:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.605+0000 7f2ee849e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2ee00cf340 0x7f2ee00cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.605+0000 7f2ee849e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee00d1970 con 0x7f2ee00b59f0 2023-08-25T04:19:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.605+0000 7f2ee849e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee00cfcf0 con 0x7f2ee015cb40 2023-08-25T04:19:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.605+0000 7f2ee849e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee00d2790 con 0x7f2ee00cf340 2023-08-25T04:19:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.605+0000 7f2ee6a3b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2ee00b59f0 0x7f2ee00b5e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46224/0 (socket says 172.21.15.55:46224) 2023-08-25T04:19:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.605+0000 7f2ee6a3b640 1 -- 172.21.15.55:0/1575549950 learned_addr learned my addr 172.21.15.55:0/1575549950 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.605+0000 7f2ee5a39640 1 --2- 172.21.15.55:0/1575549950 >> v2:172.21.15.110:3300/0 conn(0x7f2ee00cf340 0x7f2ee00cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.605+0000 7f2ee5238640 1 -- 172.21.15.55:0/1575549950 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785288990 0 0) 0x7f2ee00d1970 con 0x7f2ee00b59f0 2023-08-25T04:19:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.605+0000 7f2ee5238640 1 -- 172.21.15.55:0/1575549950 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ecc003530 con 0x7f2ee00b59f0 2023-08-25T04:19:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.605+0000 7f2ee5238640 1 -- 172.21.15.55:0/1575549950 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755409464 0 0) 0x7f2ee00cfcf0 con 0x7f2ee015cb40 2023-08-25T04:19:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.605+0000 7f2ee5238640 1 -- 172.21.15.55:0/1575549950 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ee00d1970 con 0x7f2ee015cb40 2023-08-25T04:19:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.609+0000 7f2ee5a39640 1 -- 172.21.15.55:0/1575549950 >> v1:172.21.15.110:6789/0 conn(0x7f2ee015cb40 legacy=0x7f2ee00d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.609+0000 7f2ee5a39640 1 -- 172.21.15.55:0/1575549950 >> v1:172.21.15.55:6789/0 conn(0x7f2ee00b59f0 legacy=0x7f2ee00b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.609+0000 7f2ee5a39640 1 -- 172.21.15.55:0/1575549950 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee00d0d80 con 0x7f2ee00cf340 2023-08-25T04:19:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.609+0000 7f2ee5a39640 1 --2- 172.21.15.55:0/1575549950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee00cf340 0x7f2ee00cf7b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00097c0 tx=0x7f2ed001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f392e39692f7cdc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.609+0000 7f2ee5238640 1 -- 172.21.15.55:0/1575549950 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed00a8970 con 0x7f2ee00cf340 2023-08-25T04:19:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.609+0000 7f2ee5238640 1 -- 172.21.15.55:0/1575549950 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed00a8ad0 con 0x7f2ee00cf340 2023-08-25T04:19:03.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.609+0000 7f2ee5238640 1 -- 172.21.15.55:0/1575549950 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed00a8e60 con 0x7f2ee00cf340 2023-08-25T04:19:03.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.609+0000 7f2ee849e640 1 -- 172.21.15.55:0/1575549950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee00cf340 msgr2=0x7f2ee00cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:03.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.609+0000 7f2ee849e640 1 --2- 172.21.15.55:0/1575549950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee00cf340 0x7f2ee00cf7b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00097c0 tx=0x7f2ed001ec70 comp rx=0 tx=0).stop 2023-08-25T04:19:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee849e640 1 -- 172.21.15.55:0/1575549950 shutdown_connections 2023-08-25T04:19:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee849e640 1 --2- 172.21.15.55:0/1575549950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee00cf340 0x7f2ee00cf7b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee849e640 1 -- 172.21.15.55:0/1575549950 >> 172.21.15.55:0/1575549950 conn(0x7f2ee006aae0 msgr2=0x7f2ee006aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee849e640 1 -- 172.21.15.55:0/1575549950 shutdown_connections 2023-08-25T04:19:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee849e640 1 -- 172.21.15.55:0/1575549950 wait complete. 2023-08-25T04:19:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee849e640 1 Processor -- start 2023-08-25T04:19:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee849e640 1 -- start start 2023-08-25T04:19:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee849e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee00b59f0 0x7f2ee00b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee849e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ee00cf340 0x7f2ee0159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee849e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ee015cb40 0x7f2ee01f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee849e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee015fdd0 con 0x7f2ee015cb40 2023-08-25T04:19:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee849e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee015d9f0 con 0x7f2ee00b59f0 2023-08-25T04:19:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee849e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee015d0c0 con 0x7f2ee00cf340 2023-08-25T04:19:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee6a3b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ee015cb40 0x7f2ee01f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee6a3b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ee015cb40 0x7f2ee01f5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47780/0 (socket says 172.21.15.55:47780) 2023-08-25T04:19:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee6a3b640 1 -- 172.21.15.55:0/2727387264 learned_addr learned my addr 172.21.15.55:0/2727387264 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee623a640 1 --2- 172.21.15.55:0/2727387264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee00b59f0 0x7f2ee00b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee5a39640 1 --2- 172.21.15.55:0/2727387264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ee00cf340 0x7f2ee0159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:03.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee6a3b640 1 -- 172.21.15.55:0/2727387264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ee00cf340 msgr2=0x7f2ee0159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:03.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee6a3b640 1 --2- 172.21.15.55:0/2727387264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ee00cf340 0x7f2ee0159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:03.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee6a3b640 1 -- 172.21.15.55:0/2727387264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee00b59f0 msgr2=0x7f2ee00b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee6a3b640 1 --2- 172.21.15.55:0/2727387264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee00b59f0 0x7f2ee00b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee6a3b640 1 -- 172.21.15.55:0/2727387264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed0009420 con 0x7f2ee015cb40 2023-08-25T04:19:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee5a39640 1 --2- 172.21.15.55:0/2727387264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ee00cf340 0x7f2ee0159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ee6a3b640 1 --2- 172.21.15.55:0/2727387264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ee015cb40 0x7f2ee01f5410 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800caa0 tx=0x7f2ed800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ed6ffd640 1 -- 172.21.15.55:0/2727387264 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed800ac00 con 0x7f2ee015cb40 2023-08-25T04:19:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.613+0000 7f2ed6ffd640 1 -- 172.21.15.55:0/2727387264 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed800ad60 con 0x7f2ee015cb40 2023-08-25T04:19:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.617+0000 7f2ee849e640 1 -- 172.21.15.55:0/2727387264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee015d3a0 con 0x7f2ee015cb40 2023-08-25T04:19:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.617+0000 7f2ed6ffd640 1 -- 172.21.15.55:0/2727387264 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8012600 con 0x7f2ee015cb40 2023-08-25T04:19:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.617+0000 7f2ee849e640 1 -- 172.21.15.55:0/2727387264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee01f1ea0 con 0x7f2ee015cb40 2023-08-25T04:19:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.617+0000 7f2ee849e640 1 -- 172.21.15.55:0/2727387264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee0071f80 con 0x7f2ee015cb40 2023-08-25T04:19:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.617+0000 7f2ed6ffd640 1 -- 172.21.15.55:0/2727387264 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f2ed8007070 con 0x7f2ee015cb40 2023-08-25T04:19:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.617+0000 7f2ed6ffd640 1 --2- 172.21.15.55:0/2727387264 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f2ec40657a0 0x7f2ec4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.617+0000 7f2ed6ffd640 1 -- 172.21.15.55:0/2727387264 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2ed8082ab0 con 0x7f2ee015cb40 2023-08-25T04:19:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.617+0000 7f2ee623a640 1 --2- 172.21.15.55:0/2727387264 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f2ec40657a0 0x7f2ec4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.617+0000 7f2ee623a640 1 --2- 172.21.15.55:0/2727387264 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f2ec40657a0 0x7f2ec4067c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0011f0 tx=0x7f2edc009040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:03.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.621+0000 7f2ed6ffd640 1 -- 172.21.15.55:0/2727387264 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2ed80507e0 con 0x7f2ee015cb40 2023-08-25T04:19:03.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:03.777+0000 7f2ee849e640 1 -- 172.21.15.55:0/2727387264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2ee015db60 con 0x7f2ee015cb40 2023-08-25T04:19:04.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.757+0000 7f2ed6ffd640 1 -- 172.21.15.55:0/2727387264 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v90) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2ed8053e00 con 0x7f2ee015cb40 2023-08-25T04:19:04.758 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-08-25T04:19:04.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.761+0000 7f2ee849e640 1 -- 172.21.15.55:0/2727387264 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f2ec40657a0 msgr2=0x7f2ec4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:04.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.761+0000 7f2ee849e640 1 --2- 172.21.15.55:0/2727387264 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f2ec40657a0 0x7f2ec4067c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2edc0011f0 tx=0x7f2edc009040 comp rx=0 tx=0).stop 2023-08-25T04:19:04.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.761+0000 7f2ee849e640 1 -- 172.21.15.55:0/2727387264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ee015cb40 msgr2=0x7f2ee01f5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:04.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.761+0000 7f2ee849e640 1 --2- 172.21.15.55:0/2727387264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ee015cb40 0x7f2ee01f5410 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800caa0 tx=0x7f2ed800cf60 comp rx=0 tx=0).stop 2023-08-25T04:19:04.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.765+0000 7f2ee849e640 1 -- 172.21.15.55:0/2727387264 shutdown_connections 2023-08-25T04:19:04.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.765+0000 7f2ee849e640 1 --2- 172.21.15.55:0/2727387264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ee015cb40 0x7f2ee01f5410 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:04.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.765+0000 7f2ee849e640 1 --2- 172.21.15.55:0/2727387264 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f2ec40657a0 0x7f2ec4067c60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:04.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.765+0000 7f2ee849e640 1 --2- 172.21.15.55:0/2727387264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ee00cf340 0x7f2ee0159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:04.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.765+0000 7f2ee849e640 1 --2- 172.21.15.55:0/2727387264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ee00b59f0 0x7f2ee00b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:04.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.765+0000 7f2ee849e640 1 -- 172.21.15.55:0/2727387264 >> 172.21.15.55:0/2727387264 conn(0x7f2ee006aae0 msgr2=0x7f2ee00b5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:04.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.765+0000 7f2ee849e640 1 -- 172.21.15.55:0/2727387264 shutdown_connections 2023-08-25T04:19:04.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.765+0000 7f2ee849e640 1 -- 172.21.15.55:0/2727387264 wait complete. 2023-08-25T04:19:04.789 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-25T04:19:04.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.945+0000 7fc4e9b59640 1 Processor -- start 2023-08-25T04:19:04.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.945+0000 7fc4e9b59640 1 -- start start 2023-08-25T04:19:04.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.945+0000 7fc4e9b59640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc4e406c3b0 0x7fc4e40cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:04.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.945+0000 7fc4e9b59640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc4e406e5a0 0x7fc4e40ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:04.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.945+0000 7fc4e9b59640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e40cab90 con 0x7fc4e406c790 2023-08-25T04:19:04.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.945+0000 7fc4e9b59640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e406dbb0 con 0x7fc4e406c3b0 2023-08-25T04:19:04.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.945+0000 7fc4e9b59640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e40cae50 con 0x7fc4e406e5a0 2023-08-25T04:19:04.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.945+0000 7fc4e37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc4e406c3b0 0x7fc4e40cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:04.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.945+0000 7fc4e37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc4e406c3b0 0x7fc4e40cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47788/0 (socket says 172.21.15.55:47788) 2023-08-25T04:19:04.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.945+0000 7fc4e37fe640 1 -- 172.21.15.55:0/1832882052 learned_addr learned my addr 172.21.15.55:0/1832882052 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:04.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.945+0000 7fc4e37fe640 1 -- 172.21.15.55:0/1832882052 >> v2:172.21.15.110:3300/0 conn(0x7fc4e406e5a0 msgr2=0x7fc4e40ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:04.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.945+0000 7fc4e37fe640 1 --2- 172.21.15.55:0/1832882052 >> v2:172.21.15.110:3300/0 conn(0x7fc4e406e5a0 0x7fc4e40ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:04.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.945+0000 7fc4e37fe640 1 -- 172.21.15.55:0/1832882052 >> v1:172.21.15.110:6789/0 conn(0x7fc4e406c790 legacy=0x7fc4e406de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:04.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.945+0000 7fc4e37fe640 1 -- 172.21.15.55:0/1832882052 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e40cb130 con 0x7fc4e406c3b0 2023-08-25T04:19:04.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.949+0000 7fc4e37fe640 1 --2- 172.21.15.55:0/1832882052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4e406c3b0 0x7fc4e40cd7d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4070600 tx=0x7fc4d401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57fbb6c53d880d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:04.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.949+0000 7fc4e2ffd640 1 -- 172.21.15.55:0/1832882052 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d40ab670 con 0x7fc4e406c3b0 2023-08-25T04:19:04.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.949+0000 7fc4e2ffd640 1 -- 172.21.15.55:0/1832882052 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d40ab7d0 con 0x7fc4e406c3b0 2023-08-25T04:19:04.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.949+0000 7fc4e2ffd640 1 -- 172.21.15.55:0/1832882052 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d40abb60 con 0x7fc4e406c3b0 2023-08-25T04:19:04.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.949+0000 7fc4e9b59640 1 -- 172.21.15.55:0/1832882052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4e406c3b0 msgr2=0x7fc4e40cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.949+0000 7fc4e9b59640 1 --2- 172.21.15.55:0/1832882052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4e406c3b0 0x7fc4e40cd7d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4070600 tx=0x7fc4d401c490 comp rx=0 tx=0).stop 2023-08-25T04:19:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.949+0000 7fc4e9b59640 1 -- 172.21.15.55:0/1832882052 shutdown_connections 2023-08-25T04:19:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.949+0000 7fc4e9b59640 1 --2- 172.21.15.55:0/1832882052 >> v2:172.21.15.110:3300/0 conn(0x7fc4e406e5a0 0x7fc4e40ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.949+0000 7fc4e9b59640 1 --2- 172.21.15.55:0/1832882052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4e406c3b0 0x7fc4e40cd7d0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.949+0000 7fc4e9b59640 1 -- 172.21.15.55:0/1832882052 >> 172.21.15.55:0/1832882052 conn(0x7fc4e40d0540 msgr2=0x7fc4e40d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.949+0000 7fc4e9b59640 1 -- 172.21.15.55:0/1832882052 shutdown_connections 2023-08-25T04:19:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.949+0000 7fc4e9b59640 1 -- 172.21.15.55:0/1832882052 wait complete. 2023-08-25T04:19:04.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e9b59640 1 Processor -- start 2023-08-25T04:19:04.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e9b59640 1 -- start start 2023-08-25T04:19:04.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e9b59640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4e406c3b0 0x7fc4e414eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:04.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e9b59640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4e406c790 0x7fc4e40afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:04.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e9b59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4e406e5a0 0x7fc4e40b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:04.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e9b59640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e414eff0 con 0x7fc4e406e5a0 2023-08-25T04:19:04.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e9b59640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e40b3f40 con 0x7fc4e406c3b0 2023-08-25T04:19:04.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e9b59640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e40b4220 con 0x7fc4e406c790 2023-08-25T04:19:04.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4e406e5a0 0x7fc4e40b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:04.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4e406e5a0 0x7fc4e40b01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47794/0 (socket says 172.21.15.55:47794) 2023-08-25T04:19:04.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e3fff640 1 -- 172.21.15.55:0/2750611777 learned_addr learned my addr 172.21.15.55:0/2750611777 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:04.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e37fe640 1 --2- 172.21.15.55:0/2750611777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4e406c3b0 0x7fc4e414eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:04.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4dbfff640 1 --2- 172.21.15.55:0/2750611777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4e406c790 0x7fc4e40afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:04.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e3fff640 1 -- 172.21.15.55:0/2750611777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4e406c790 msgr2=0x7fc4e40afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:04.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e3fff640 1 --2- 172.21.15.55:0/2750611777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4e406c790 0x7fc4e40afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:04.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e3fff640 1 -- 172.21.15.55:0/2750611777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4e406c3b0 msgr2=0x7fc4e414eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:04.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e3fff640 1 --2- 172.21.15.55:0/2750611777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4e406c3b0 0x7fc4e414eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:04.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e3fff640 1 -- 172.21.15.55:0/2750611777 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d4009480 con 0x7fc4e406e5a0 2023-08-25T04:19:04.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4dbfff640 1 --2- 172.21.15.55:0/2750611777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4e406c790 0x7fc4e40afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:04.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e3fff640 1 --2- 172.21.15.55:0/2750611777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4e406e5a0 0x7fc4e40b01e0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00b9e0 tx=0x7fc4dc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:04.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e0ff9640 1 -- 172.21.15.55:0/2750611777 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc00cb20 con 0x7fc4e406e5a0 2023-08-25T04:19:04.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e0ff9640 1 -- 172.21.15.55:0/2750611777 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4dc00cca0 con 0x7fc4e406e5a0 2023-08-25T04:19:04.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e0ff9640 1 -- 172.21.15.55:0/2750611777 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc014680 con 0x7fc4e406e5a0 2023-08-25T04:19:04.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e9b59640 1 -- 172.21.15.55:0/2750611777 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e40b4500 con 0x7fc4e406e5a0 2023-08-25T04:19:04.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.953+0000 7fc4e9b59640 1 -- 172.21.15.55:0/2750611777 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e40b4ac0 con 0x7fc4e406e5a0 2023-08-25T04:19:04.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.957+0000 7fc4e9b59640 1 -- 172.21.15.55:0/2750611777 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e40b4ce0 con 0x7fc4e406e5a0 2023-08-25T04:19:04.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.957+0000 7fc4e0ff9640 1 -- 172.21.15.55:0/2750611777 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fc4dc01d3b0 con 0x7fc4e406e5a0 2023-08-25T04:19:04.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.957+0000 7fc4e0ff9640 1 --2- 172.21.15.55:0/2750611777 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc4c40657a0 0x7fc4c4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:04.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.957+0000 7fc4e0ff9640 1 -- 172.21.15.55:0/2750611777 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fc4dc082ca0 con 0x7fc4e406e5a0 2023-08-25T04:19:04.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.957+0000 7fc4e37fe640 1 --2- 172.21.15.55:0/2750611777 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc4c40657a0 0x7fc4c4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:04.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.961+0000 7fc4e37fe640 1 --2- 172.21.15.55:0/2750611777 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc4c40657a0 0x7fc4c4067c60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40af000 tx=0x7fc4d40a7000 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:04.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:04.961+0000 7fc4e0ff9640 1 -- 172.21.15.55:0/2750611777 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc4dc050840 con 0x7fc4e406e5a0 2023-08-25T04:19:05.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.121+0000 7fc4e9b59640 1 -- 172.21.15.55:0/2750611777 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc4e4073ec0 con 0x7fc4e406e5a0 2023-08-25T04:19:05.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.777+0000 7fc4e0ff9640 1 -- 172.21.15.55:0/2750611777 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v91) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc4dc0190d0 con 0x7fc4e406e5a0 2023-08-25T04:19:05.779 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-08-25T04:19:05.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.789+0000 7fc4e9b59640 1 -- 172.21.15.55:0/2750611777 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc4c40657a0 msgr2=0x7fc4c4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:05.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.789+0000 7fc4e9b59640 1 --2- 172.21.15.55:0/2750611777 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc4c40657a0 0x7fc4c4067c60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40af000 tx=0x7fc4d40a7000 comp rx=0 tx=0).stop 2023-08-25T04:19:05.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.789+0000 7fc4e9b59640 1 -- 172.21.15.55:0/2750611777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4e406e5a0 msgr2=0x7fc4e40b01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:05.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.789+0000 7fc4e9b59640 1 --2- 172.21.15.55:0/2750611777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4e406e5a0 0x7fc4e40b01e0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00b9e0 tx=0x7fc4dc00bea0 comp rx=0 tx=0).stop 2023-08-25T04:19:05.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.793+0000 7fc4e9b59640 1 -- 172.21.15.55:0/2750611777 shutdown_connections 2023-08-25T04:19:05.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.793+0000 7fc4e9b59640 1 --2- 172.21.15.55:0/2750611777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4e406e5a0 0x7fc4e40b01e0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:05.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.793+0000 7fc4e9b59640 1 --2- 172.21.15.55:0/2750611777 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc4c40657a0 0x7fc4c4067c60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:05.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.793+0000 7fc4e9b59640 1 --2- 172.21.15.55:0/2750611777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4e406c790 0x7fc4e40afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:05.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.793+0000 7fc4e9b59640 1 --2- 172.21.15.55:0/2750611777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4e406c3b0 0x7fc4e414eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:05.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.793+0000 7fc4e9b59640 1 -- 172.21.15.55:0/2750611777 >> 172.21.15.55:0/2750611777 conn(0x7fc4e40d0540 msgr2=0x7fc4e40ad6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:05.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.793+0000 7fc4e9b59640 1 -- 172.21.15.55:0/2750611777 shutdown_connections 2023-08-25T04:19:05.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.793+0000 7fc4e9b59640 1 -- 172.21.15.55:0/2750611777 wait complete. 2023-08-25T04:19:05.818 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-25T04:19:05.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.965+0000 7f029b45c640 1 Processor -- start 2023-08-25T04:19:05.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.965+0000 7f029b45c640 1 -- start start 2023-08-25T04:19:05.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.965+0000 7f029b45c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02940cb020 0x7f02940c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:05.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.965+0000 7f029b45c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f029406c720 0x7f029406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:05.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.965+0000 7f029b45c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029406d0b0 con 0x7f02940cdd50 2023-08-25T04:19:05.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.965+0000 7f029b45c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02940cbca0 con 0x7f029406c720 2023-08-25T04:19:05.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.965+0000 7f029b45c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02940c9470 con 0x7f02940cb020 2023-08-25T04:19:05.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.965+0000 7f02999f9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f029406c720 0x7f029406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:05.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.965+0000 7f02999f9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f029406c720 0x7f029406cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47806/0 (socket says 172.21.15.55:47806) 2023-08-25T04:19:05.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.965+0000 7f02999f9640 1 -- 172.21.15.55:0/897085650 learned_addr learned my addr 172.21.15.55:0/897085650 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.965+0000 7f02991f8640 1 --2- 172.21.15.55:0/897085650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02940cb020 0x7f02940c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.965+0000 7f02999f9640 1 -- 172.21.15.55:0/897085650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02940cb020 msgr2=0x7f02940c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.965+0000 7f02999f9640 1 --2- 172.21.15.55:0/897085650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02940cb020 0x7f02940c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.965+0000 7f02999f9640 1 -- 172.21.15.55:0/897085650 >> v1:172.21.15.110:6789/0 conn(0x7f02940cdd50 legacy=0x7f02940cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:05.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.965+0000 7f02999f9640 1 -- 172.21.15.55:0/897085650 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02940ce1b0 con 0x7f029406c720 2023-08-25T04:19:05.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.965+0000 7f02991f8640 1 --2- 172.21.15.55:0/897085650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02940cb020 0x7f02940c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:05.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.969+0000 7f02999f9640 1 --2- 172.21.15.55:0/897085650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029406c720 0x7f029406cb70 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f028c00d150 tx=0x7f028c01eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adde4fa1050ddf2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:05.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.969+0000 7f028bfff640 1 -- 172.21.15.55:0/897085650 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c00b2d0 con 0x7f029406c720 2023-08-25T04:19:05.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.969+0000 7f028bfff640 1 -- 172.21.15.55:0/897085650 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028c00b430 con 0x7f029406c720 2023-08-25T04:19:05.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.969+0000 7f028bfff640 1 -- 172.21.15.55:0/897085650 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c0a7b60 con 0x7f029406c720 2023-08-25T04:19:05.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.969+0000 7f029b45c640 1 -- 172.21.15.55:0/897085650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029406c720 msgr2=0x7f029406cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:05.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.969+0000 7f029b45c640 1 --2- 172.21.15.55:0/897085650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029406c720 0x7f029406cb70 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f028c00d150 tx=0x7f028c01eb80 comp rx=0 tx=0).stop 2023-08-25T04:19:05.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.969+0000 7f029b45c640 1 -- 172.21.15.55:0/897085650 shutdown_connections 2023-08-25T04:19:05.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.969+0000 7f029b45c640 1 --2- 172.21.15.55:0/897085650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029406c720 0x7f029406cb70 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.969+0000 7f029b45c640 1 --2- 172.21.15.55:0/897085650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02940cb020 0x7f02940c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.969+0000 7f029b45c640 1 -- 172.21.15.55:0/897085650 >> 172.21.15.55:0/897085650 conn(0x7f0294069900 msgr2=0x7f0294069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f029b45c640 1 -- 172.21.15.55:0/897085650 shutdown_connections 2023-08-25T04:19:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f029b45c640 1 -- 172.21.15.55:0/897085650 wait complete. 2023-08-25T04:19:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f029b45c640 1 Processor -- start 2023-08-25T04:19:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f029b45c640 1 -- start start 2023-08-25T04:19:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f029b45c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029406c720 0x7f02941f5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f029b45c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02940cb020 0x7f02941517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f029b45c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02940cdd50 0x7f02941f8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f029b45c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029409b760 con 0x7f029406c720 2023-08-25T04:19:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f029b45c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02941f50b0 con 0x7f02940cdd50 2023-08-25T04:19:05.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f029b45c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02941f5a80 con 0x7f02940cb020 2023-08-25T04:19:05.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f02991f8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029406c720 0x7f02941f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:05.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f02991f8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029406c720 0x7f02941f5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47822/0 (socket says 172.21.15.55:47822) 2023-08-25T04:19:05.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f02991f8640 1 -- 172.21.15.55:0/2348445527 learned_addr learned my addr 172.21.15.55:0/2348445527 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:05.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f02989f7640 1 --2- 172.21.15.55:0/2348445527 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02940cb020 0x7f02941517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:05.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f02999f9640 1 --2- 172.21.15.55:0/2348445527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02940cdd50 0x7f02941f8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:05.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f02991f8640 1 -- 172.21.15.55:0/2348445527 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02940cb020 msgr2=0x7f02941517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:05.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f02991f8640 1 --2- 172.21.15.55:0/2348445527 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02940cb020 0x7f02941517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:05.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f02991f8640 1 -- 172.21.15.55:0/2348445527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02940cdd50 msgr2=0x7f02941f8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:05.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f02991f8640 1 --2- 172.21.15.55:0/2348445527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02940cdd50 0x7f02941f8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:05.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f02991f8640 1 -- 172.21.15.55:0/2348445527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028c00bd40 con 0x7f029406c720 2023-08-25T04:19:05.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.973+0000 7f02991f8640 1 --2- 172.21.15.55:0/2348445527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029406c720 0x7f02941f5540 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f029000e730 tx=0x7f029000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:05.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.977+0000 7f0289ffb640 1 -- 172.21.15.55:0/2348445527 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290005ba0 con 0x7f029406c720 2023-08-25T04:19:05.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.977+0000 7f0289ffb640 1 -- 172.21.15.55:0/2348445527 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0290005d00 con 0x7f029406c720 2023-08-25T04:19:05.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.977+0000 7f0289ffb640 1 -- 172.21.15.55:0/2348445527 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290004250 con 0x7f029406c720 2023-08-25T04:19:05.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.977+0000 7f029b45c640 1 -- 172.21.15.55:0/2348445527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0294151d30 con 0x7f029406c720 2023-08-25T04:19:05.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.977+0000 7f029b45c640 1 -- 172.21.15.55:0/2348445527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02941f8de0 con 0x7f029406c720 2023-08-25T04:19:05.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.977+0000 7f029b45c640 1 -- 172.21.15.55:0/2348445527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02941f8fd0 con 0x7f029406c720 2023-08-25T04:19:05.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.977+0000 7f0289ffb640 1 -- 172.21.15.55:0/2348445527 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f02900043b0 con 0x7f029406c720 2023-08-25T04:19:05.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.977+0000 7f0289ffb640 1 --2- 172.21.15.55:0/2348445527 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f02780657a0 0x7f0278067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:05.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.977+0000 7f0289ffb640 1 -- 172.21.15.55:0/2348445527 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f0290082f50 con 0x7f029406c720 2023-08-25T04:19:05.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.981+0000 7f02989f7640 1 --2- 172.21.15.55:0/2348445527 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f02780657a0 0x7f0278067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:05.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.981+0000 7f02989f7640 1 --2- 172.21.15.55:0/2348445527 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f02780657a0 0x7f0278067c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0294071630 tx=0x7f0284009040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:05.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:05.985+0000 7f0289ffb640 1 -- 172.21.15.55:0/2348445527 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f02900508e0 con 0x7f029406c720 2023-08-25T04:19:06.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.177+0000 7f029b45c640 1 -- 172.21.15.55:0/2348445527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0294073ec0 con 0x7f029406c720 2023-08-25T04:19:06.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.793+0000 7f0289ffb640 1 -- 172.21.15.55:0/2348445527 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v36) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0290053f00 con 0x7f029406c720 2023-08-25T04:19:06.794 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 11 and data pool 12 2023-08-25T04:19:06.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.801+0000 7f029b45c640 1 -- 172.21.15.55:0/2348445527 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f02780657a0 msgr2=0x7f0278067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:06.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.801+0000 7f029b45c640 1 --2- 172.21.15.55:0/2348445527 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f02780657a0 0x7f0278067c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0294071630 tx=0x7f0284009040 comp rx=0 tx=0).stop 2023-08-25T04:19:06.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.801+0000 7f029b45c640 1 -- 172.21.15.55:0/2348445527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029406c720 msgr2=0x7f02941f5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:06.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.801+0000 7f029b45c640 1 --2- 172.21.15.55:0/2348445527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029406c720 0x7f02941f5540 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f029000e730 tx=0x7f029000ebf0 comp rx=0 tx=0).stop 2023-08-25T04:19:06.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.805+0000 7f029b45c640 1 -- 172.21.15.55:0/2348445527 shutdown_connections 2023-08-25T04:19:06.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.805+0000 7f029b45c640 1 --2- 172.21.15.55:0/2348445527 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02940cdd50 0x7f02941f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.805+0000 7f029b45c640 1 --2- 172.21.15.55:0/2348445527 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f02780657a0 0x7f0278067c60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:06.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.805+0000 7f029b45c640 1 --2- 172.21.15.55:0/2348445527 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02940cb020 0x7f02941517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:06.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.805+0000 7f029b45c640 1 --2- 172.21.15.55:0/2348445527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029406c720 0x7f02941f5540 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:06.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.805+0000 7f029b45c640 1 -- 172.21.15.55:0/2348445527 >> 172.21.15.55:0/2348445527 conn(0x7f0294069900 msgr2=0x7f02941588f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:06.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.805+0000 7f029b45c640 1 -- 172.21.15.55:0/2348445527 shutdown_connections 2023-08-25T04:19:06.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.805+0000 7f029b45c640 1 -- 172.21.15.55:0/2348445527 wait complete. 2023-08-25T04:19:06.836 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:19:06.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.981+0000 7f2b33340640 1 Processor -- start 2023-08-25T04:19:06.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.981+0000 7f2b33340640 1 -- start start 2023-08-25T04:19:06.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.981+0000 7f2b33340640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b2c15c9c0 0x7f2b2c160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:06.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.981+0000 7f2b33340640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b2c0cfa70 0x7f2b2c160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:06.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.981+0000 7f2b33340640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2c06eaf0 con 0x7f2b2c160f90 2023-08-25T04:19:06.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.981+0000 7f2b33340640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2c06e530 con 0x7f2b2c15c9c0 2023-08-25T04:19:06.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.981+0000 7f2b33340640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c06e810 con 0x7f2b2c0cfa70 2023-08-25T04:19:06.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.981+0000 7f2b310dc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b2c15c9c0 0x7f2b2c160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:06.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.981+0000 7f2b310dc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b2c15c9c0 0x7f2b2c160510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47828/0 (socket says 172.21.15.55:47828) 2023-08-25T04:19:06.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.981+0000 7f2b310dc640 1 -- 172.21.15.55:0/1927490320 learned_addr learned my addr 172.21.15.55:0/1927490320 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:06.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.981+0000 7f2b318dd640 1 --1- 172.21.15.55:0/1927490320 >> v1:172.21.15.55:6789/0 conn(0x7f2b2c160f90 0x7f2b2c0ce910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46230/0 (socket says 172.21.15.55:46230) 2023-08-25T04:19:06.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.985+0000 7f2b310dc640 1 -- 172.21.15.55:0/1927490320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b2c0cfa70 msgr2=0x7f2b2c160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:06.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.985+0000 7f2b310dc640 1 --2- 172.21.15.55:0/1927490320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b2c0cfa70 0x7f2b2c160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:06.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.985+0000 7f2b310dc640 1 -- 172.21.15.55:0/1927490320 >> v1:172.21.15.55:6789/0 conn(0x7f2b2c160f90 legacy=0x7f2b2c0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:06.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.985+0000 7f2b310dc640 1 -- 172.21.15.55:0/1927490320 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c06aab0 con 0x7f2b2c15c9c0 2023-08-25T04:19:06.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.985+0000 7f2b310dc640 1 --2- 172.21.15.55:0/1927490320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b2c15c9c0 0x7f2b2c160510 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2b28006fd0 tx=0x7f2b2801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b590198938d35f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:06.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.985+0000 7f2b23fff640 1 -- 172.21.15.55:0/1927490320 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b280ab600 con 0x7f2b2c15c9c0 2023-08-25T04:19:06.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.985+0000 7f2b23fff640 1 -- 172.21.15.55:0/1927490320 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b280ab760 con 0x7f2b2c15c9c0 2023-08-25T04:19:06.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.985+0000 7f2b23fff640 1 -- 172.21.15.55:0/1927490320 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b280abaf0 con 0x7f2b2c15c9c0 2023-08-25T04:19:06.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.985+0000 7f2b33340640 1 -- 172.21.15.55:0/1927490320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b2c15c9c0 msgr2=0x7f2b2c160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:06.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.985+0000 7f2b33340640 1 --2- 172.21.15.55:0/1927490320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b2c15c9c0 0x7f2b2c160510 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2b28006fd0 tx=0x7f2b2801c4f0 comp rx=0 tx=0).stop 2023-08-25T04:19:06.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.985+0000 7f2b33340640 1 -- 172.21.15.55:0/1927490320 shutdown_connections 2023-08-25T04:19:06.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.985+0000 7f2b33340640 1 --2- 172.21.15.55:0/1927490320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b2c0cfa70 0x7f2b2c160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:06.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.985+0000 7f2b33340640 1 --2- 172.21.15.55:0/1927490320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b2c15c9c0 0x7f2b2c160510 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:06.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.985+0000 7f2b33340640 1 -- 172.21.15.55:0/1927490320 >> 172.21.15.55:0/1927490320 conn(0x7f2b2c0d05a0 msgr2=0x7f2b2c0d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:06.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.985+0000 7f2b33340640 1 -- 172.21.15.55:0/1927490320 shutdown_connections 2023-08-25T04:19:06.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b33340640 1 -- 172.21.15.55:0/1927490320 wait complete. 2023-08-25T04:19:06.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b33340640 1 Processor -- start 2023-08-25T04:19:06.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b33340640 1 -- start start 2023-08-25T04:19:06.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b33340640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b2c0cfa70 0x7f2b2c0c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:06.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b33340640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b2c15c9c0 0x7f2b2c14b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:06.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b33340640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b2c160f90 0x7f2b2c14bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:06.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b33340640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c157f30 con 0x7f2b2c15c9c0 2023-08-25T04:19:06.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b33340640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c157060 con 0x7f2b2c160f90 2023-08-25T04:19:06.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b33340640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c0c6fe0 con 0x7f2b2c0cfa70 2023-08-25T04:19:06.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b308db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b2c15c9c0 0x7f2b2c14b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:06.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b308db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b2c15c9c0 0x7f2b2c14b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47832/0 (socket says 172.21.15.55:47832) 2023-08-25T04:19:06.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b308db640 1 -- 172.21.15.55:0/9860680 learned_addr learned my addr 172.21.15.55:0/9860680 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:06.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b310dc640 1 --2- 172.21.15.55:0/9860680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b2c0cfa70 0x7f2b2c0c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:06.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b318dd640 1 --2- 172.21.15.55:0/9860680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b2c160f90 0x7f2b2c14bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:06.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b308db640 1 -- 172.21.15.55:0/9860680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b2c0cfa70 msgr2=0x7f2b2c0c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:06.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b308db640 1 --2- 172.21.15.55:0/9860680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b2c0cfa70 0x7f2b2c0c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:06.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b308db640 1 -- 172.21.15.55:0/9860680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b2c160f90 msgr2=0x7f2b2c14bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:06.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b308db640 1 --2- 172.21.15.55:0/9860680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b2c160f90 0x7f2b2c14bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:06.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b308db640 1 -- 172.21.15.55:0/9860680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b28009480 con 0x7f2b2c15c9c0 2023-08-25T04:19:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b308db640 1 --2- 172.21.15.55:0/9860680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b2c15c9c0 0x7f2b2c14b650 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00b3f0 tx=0x7f2b1c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b21ffb640 1 -- 172.21.15.55:0/9860680 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c011830 con 0x7f2b2c15c9c0 2023-08-25T04:19:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b21ffb640 1 -- 172.21.15.55:0/9860680 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1c011990 con 0x7f2b2c15c9c0 2023-08-25T04:19:07.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b21ffb640 1 -- 172.21.15.55:0/9860680 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c011d40 con 0x7f2b2c15c9c0 2023-08-25T04:19:07.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.989+0000 7f2b33340640 1 -- 172.21.15.55:0/9860680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2c1572b0 con 0x7f2b2c15c9c0 2023-08-25T04:19:07.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.993+0000 7f2b33340640 1 -- 172.21.15.55:0/9860680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2c157870 con 0x7f2b2c15c9c0 2023-08-25T04:19:07.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.993+0000 7f2b33340640 1 -- 172.21.15.55:0/9860680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2c0b64f0 con 0x7f2b2c15c9c0 2023-08-25T04:19:07.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.993+0000 7f2b21ffb640 1 -- 172.21.15.55:0/9860680 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f2b1c01a400 con 0x7f2b2c15c9c0 2023-08-25T04:19:07.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.993+0000 7f2b21ffb640 1 --2- 172.21.15.55:0/9860680 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f2b100657a0 0x7f2b10067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:07.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.993+0000 7f2b21ffb640 1 -- 172.21.15.55:0/9860680 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b1c083110 con 0x7f2b2c15c9c0 2023-08-25T04:19:07.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.993+0000 7f2b310dc640 1 --2- 172.21.15.55:0/9860680 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f2b100657a0 0x7f2b10067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:07.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.993+0000 7f2b310dc640 1 --2- 172.21.15.55:0/9860680 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f2b100657a0 0x7f2b10067c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2b280af000 tx=0x7f2b28009040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:07.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:06.997+0000 7f2b21ffb640 1 -- 172.21.15.55:0/9860680 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2b1c050a20 con 0x7f2b2c15c9c0 2023-08-25T04:19:07.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.153+0000 7f2b33340640 1 -- 172.21.15.55:0/9860680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b2c04dbe0 con 0x7f2b2c15c9c0 2023-08-25T04:19:07.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.157+0000 7f2b21ffb640 1 -- 172.21.15.55:0/9860680 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+18379 (secure 0 0 0) 0x7f2b1c054040 con 0x7f2b2c15c9c0 2023-08-25T04:19:07.159 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:07.160 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":92,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:19:06.181424+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:19:03.829933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-25T04:19:05.172184+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:19:07.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.157+0000 7f2b33340640 1 -- 172.21.15.55:0/9860680 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f2b100657a0 msgr2=0x7f2b10067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:07.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.157+0000 7f2b33340640 1 --2- 172.21.15.55:0/9860680 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f2b100657a0 0x7f2b10067c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2b280af000 tx=0x7f2b28009040 comp rx=0 tx=0).stop 2023-08-25T04:19:07.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.157+0000 7f2b33340640 1 -- 172.21.15.55:0/9860680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b2c15c9c0 msgr2=0x7f2b2c14b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:07.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.157+0000 7f2b33340640 1 --2- 172.21.15.55:0/9860680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b2c15c9c0 0x7f2b2c14b650 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00b3f0 tx=0x7f2b1c00b8b0 comp rx=0 tx=0).stop 2023-08-25T04:19:07.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.157+0000 7f2b33340640 1 -- 172.21.15.55:0/9860680 shutdown_connections 2023-08-25T04:19:07.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.157+0000 7f2b33340640 1 --2- 172.21.15.55:0/9860680 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b2c160f90 0x7f2b2c14bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:07.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.157+0000 7f2b33340640 1 --2- 172.21.15.55:0/9860680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b2c15c9c0 0x7f2b2c14b650 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:07.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.157+0000 7f2b33340640 1 --2- 172.21.15.55:0/9860680 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f2b100657a0 0x7f2b10067c60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:07.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.157+0000 7f2b33340640 1 --2- 172.21.15.55:0/9860680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b2c0cfa70 0x7f2b2c0c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:07.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.157+0000 7f2b33340640 1 -- 172.21.15.55:0/9860680 >> 172.21.15.55:0/9860680 conn(0x7f2b2c0d05a0 msgr2=0x7f2b2c0af2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:07.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.157+0000 7f2b33340640 1 -- 172.21.15.55:0/9860680 shutdown_connections 2023-08-25T04:19:07.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.157+0000 7f2b33340640 1 -- 172.21.15.55:0/9860680 wait complete. 2023-08-25T04:19:07.177 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:19:07.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.321+0000 7ff3815e8640 1 Processor -- start 2023-08-25T04:19:07.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.321+0000 7ff3815e8640 1 -- start start 2023-08-25T04:19:07.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.321+0000 7ff3815e8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c0d0da0 0x7ff37c0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:07.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.321+0000 7ff3815e8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff37c0b3e50 0x7ff37c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:07.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.321+0000 7ff3815e8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37c0b29b0 con 0x7ff37c0cdde0 2023-08-25T04:19:07.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.321+0000 7ff3815e8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37c0ce760 con 0x7ff37c0b3e50 2023-08-25T04:19:07.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.321+0000 7ff3815e8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c0d16c0 con 0x7ff37c0d0da0 2023-08-25T04:19:07.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.321+0000 7ff37b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff37c0b3e50 0x7ff37c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:07.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.321+0000 7ff373fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff37c0cdde0 0x7ff37c0cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46236/0 (socket says 172.21.15.55:46236) 2023-08-25T04:19:07.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.321+0000 7ff373fff640 1 -- 172.21.15.55:0/2509189389 learned_addr learned my addr 172.21.15.55:0/2509189389 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:07.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.321+0000 7ff37affd640 1 --2- 172.21.15.55:0/2509189389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c0d0da0 0x7ff37c0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:07.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.325+0000 7ff37b7fe640 1 -- 172.21.15.55:0/2509189389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c0d0da0 msgr2=0x7ff37c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:07.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.325+0000 7ff37b7fe640 1 --2- 172.21.15.55:0/2509189389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c0d0da0 0x7ff37c0d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:07.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.325+0000 7ff37b7fe640 1 -- 172.21.15.55:0/2509189389 >> v1:172.21.15.55:6789/0 conn(0x7ff37c0cdde0 legacy=0x7ff37c0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:07.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.325+0000 7ff37b7fe640 1 -- 172.21.15.55:0/2509189389 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c0b1dc0 con 0x7ff37c0b3e50 2023-08-25T04:19:07.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.325+0000 7ff37b7fe640 1 --2- 172.21.15.55:0/2509189389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff37c0b3e50 0x7ff37c0ce220 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7ff374009d90 tx=0x7ff37401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11c81644876976a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:07.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.325+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2509189389 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3740af600 con 0x7ff37c0b3e50 2023-08-25T04:19:07.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.325+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2509189389 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3740ab050 con 0x7ff37c0b3e50 2023-08-25T04:19:07.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.325+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2509189389 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3740af980 con 0x7ff37c0b3e50 2023-08-25T04:19:07.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.325+0000 7ff3815e8640 1 -- 172.21.15.55:0/2509189389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff37c0b3e50 msgr2=0x7ff37c0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:07.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.325+0000 7ff3815e8640 1 --2- 172.21.15.55:0/2509189389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff37c0b3e50 0x7ff37c0ce220 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7ff374009d90 tx=0x7ff37401f130 comp rx=0 tx=0).stop 2023-08-25T04:19:07.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.325+0000 7ff3815e8640 1 -- 172.21.15.55:0/2509189389 shutdown_connections 2023-08-25T04:19:07.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.325+0000 7ff3815e8640 1 --2- 172.21.15.55:0/2509189389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff37c0b3e50 0x7ff37c0ce220 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:07.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.325+0000 7ff3815e8640 1 --2- 172.21.15.55:0/2509189389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c0d0da0 0x7ff37c0d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:07.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.325+0000 7ff3815e8640 1 -- 172.21.15.55:0/2509189389 >> 172.21.15.55:0/2509189389 conn(0x7ff37c09bae0 msgr2=0x7ff37c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:07.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.325+0000 7ff3815e8640 1 -- 172.21.15.55:0/2509189389 shutdown_connections 2023-08-25T04:19:07.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff3815e8640 1 -- 172.21.15.55:0/2509189389 wait complete. 2023-08-25T04:19:07.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff3815e8640 1 Processor -- start 2023-08-25T04:19:07.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff3815e8640 1 -- start start 2023-08-25T04:19:07.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff3815e8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c0b3e50 0x7ff37c0b7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:07.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff3815e8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0cdde0 0x7ff37c0cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:07.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff3815e8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff37c0d0da0 0x7ff37c0c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:07.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff3815e8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c0cb320 con 0x7ff37c0d0da0 2023-08-25T04:19:07.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff3815e8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c0b5b80 con 0x7ff37c0cdde0 2023-08-25T04:19:07.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff3815e8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c0b82a0 con 0x7ff37c0b3e50 2023-08-25T04:19:07.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff37b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff37c0d0da0 0x7ff37c0c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:07.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff37b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff37c0d0da0 0x7ff37c0c7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47856/0 (socket says 172.21.15.55:47856) 2023-08-25T04:19:07.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff37b7fe640 1 -- 172.21.15.55:0/2603808720 learned_addr learned my addr 172.21.15.55:0/2603808720 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:07.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff37affd640 1 --2- 172.21.15.55:0/2603808720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c0b3e50 0x7ff37c0b7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:07.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff373fff640 1 --2- 172.21.15.55:0/2603808720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0cdde0 0x7ff37c0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:07.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff37b7fe640 1 -- 172.21.15.55:0/2603808720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c0b3e50 msgr2=0x7ff37c0b7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:07.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff37b7fe640 1 --2- 172.21.15.55:0/2603808720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c0b3e50 0x7ff37c0b7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:07.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff37b7fe640 1 -- 172.21.15.55:0/2603808720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0cdde0 msgr2=0x7ff37c0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:07.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff37b7fe640 1 --2- 172.21.15.55:0/2603808720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0cdde0 0x7ff37c0cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:07.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff37b7fe640 1 -- 172.21.15.55:0/2603808720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff374009a70 con 0x7ff37c0d0da0 2023-08-25T04:19:07.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.329+0000 7ff37b7fe640 1 --2- 172.21.15.55:0/2603808720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff37c0d0da0 0x7ff37c0c7750 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7ff3740b2040 tx=0x7ff37401bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:07.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.333+0000 7ff3737fe640 1 -- 172.21.15.55:0/2603808720 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3740b9610 con 0x7ff37c0d0da0 2023-08-25T04:19:07.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.333+0000 7ff3737fe640 1 -- 172.21.15.55:0/2603808720 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3740b9770 con 0x7ff37c0d0da0 2023-08-25T04:19:07.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.333+0000 7ff3737fe640 1 -- 172.21.15.55:0/2603808720 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3740b9b20 con 0x7ff37c0d0da0 2023-08-25T04:19:07.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.333+0000 7ff3815e8640 1 -- 172.21.15.55:0/2603808720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37c0ca7a0 con 0x7ff37c0d0da0 2023-08-25T04:19:07.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.333+0000 7ff3815e8640 1 -- 172.21.15.55:0/2603808720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37c0cad60 con 0x7ff37c0d0da0 2023-08-25T04:19:07.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.333+0000 7ff3815e8640 1 -- 172.21.15.55:0/2603808720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff37c04dbe0 con 0x7ff37c0d0da0 2023-08-25T04:19:07.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.333+0000 7ff3737fe640 1 -- 172.21.15.55:0/2603808720 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7ff3740b6050 con 0x7ff37c0d0da0 2023-08-25T04:19:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.333+0000 7ff3737fe640 1 --2- 172.21.15.55:0/2603808720 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7ff35c0657a0 0x7ff35c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.333+0000 7ff3737fe640 1 -- 172.21.15.55:0/2603808720 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff3741215c0 con 0x7ff37c0d0da0 2023-08-25T04:19:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.333+0000 7ff37affd640 1 --2- 172.21.15.55:0/2603808720 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7ff35c0657a0 0x7ff35c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.337+0000 7ff37affd640 1 --2- 172.21.15.55:0/2603808720 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7ff35c0657a0 0x7ff35c067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff37c0b1b50 tx=0x7ff36c008040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:07.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.337+0000 7ff3737fe640 1 -- 172.21.15.55:0/2603808720 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff3740eef90 con 0x7ff37c0d0da0 2023-08-25T04:19:07.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.493+0000 7ff3815e8640 1 -- 172.21.15.55:0/2603808720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff37c0d0b80 con 0x7ff37c0d0da0 2023-08-25T04:19:07.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.497+0000 7ff3737fe640 1 -- 172.21.15.55:0/2603808720 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+18379 (secure 0 0 0) 0x7ff374009450 con 0x7ff37c0d0da0 2023-08-25T04:19:07.496 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:07.496 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":92,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:19:06.181424+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:19:03.829933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-25T04:19:05.172184+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:19:07.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.497+0000 7ff3815e8640 1 -- 172.21.15.55:0/2603808720 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7ff35c0657a0 msgr2=0x7ff35c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:07.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.497+0000 7ff3815e8640 1 --2- 172.21.15.55:0/2603808720 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7ff35c0657a0 0x7ff35c067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff37c0b1b50 tx=0x7ff36c008040 comp rx=0 tx=0).stop 2023-08-25T04:19:07.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.497+0000 7ff3815e8640 1 -- 172.21.15.55:0/2603808720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff37c0d0da0 msgr2=0x7ff37c0c7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:07.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.497+0000 7ff3815e8640 1 --2- 172.21.15.55:0/2603808720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff37c0d0da0 0x7ff37c0c7750 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7ff3740b2040 tx=0x7ff37401bed0 comp rx=0 tx=0).stop 2023-08-25T04:19:07.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.497+0000 7ff3815e8640 1 -- 172.21.15.55:0/2603808720 shutdown_connections 2023-08-25T04:19:07.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.497+0000 7ff3815e8640 1 --2- 172.21.15.55:0/2603808720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff37c0d0da0 0x7ff37c0c7750 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:07.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.497+0000 7ff3815e8640 1 --2- 172.21.15.55:0/2603808720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0cdde0 0x7ff37c0cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:07.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.497+0000 7ff3815e8640 1 --2- 172.21.15.55:0/2603808720 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7ff35c0657a0 0x7ff35c067c60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:07.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.497+0000 7ff3815e8640 1 --2- 172.21.15.55:0/2603808720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c0b3e50 0x7ff37c0b7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:07.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.497+0000 7ff3815e8640 1 -- 172.21.15.55:0/2603808720 >> 172.21.15.55:0/2603808720 conn(0x7ff37c09bae0 msgr2=0x7ff37c0cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:07.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.497+0000 7ff3815e8640 1 -- 172.21.15.55:0/2603808720 shutdown_connections 2023-08-25T04:19:07.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.497+0000 7ff3815e8640 1 -- 172.21.15.55:0/2603808720 wait complete. 2023-08-25T04:19:07.517 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-25T04:19:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.661+0000 7f318cfe9640 1 Processor -- start 2023-08-25T04:19:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.661+0000 7f318cfe9640 1 -- start start 2023-08-25T04:19:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.665+0000 7f318cfe9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f31880cb020 0x7f31880c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.665+0000 7f318cfe9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31880cbca0 con 0x7f318806c720 2023-08-25T04:19:07.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.665+0000 7f318cfe9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31880c9470 con 0x7f31880cdd50 2023-08-25T04:19:07.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.665+0000 7f318cfe9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31880ce1e0 con 0x7f31880cb020 2023-08-25T04:19:07.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.665+0000 7f318659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f31880cb020 0x7f31880c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:07.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.665+0000 7f318659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f31880cb020 0x7f31880c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47860/0 (socket says 172.21.15.55:47860) 2023-08-25T04:19:07.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.665+0000 7f318659c640 1 -- 172.21.15.55:0/700696089 learned_addr learned my addr 172.21.15.55:0/700696089 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:07.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.665+0000 7f3186d9d640 1 --1- 172.21.15.55:0/700696089 >> v1:172.21.15.55:6789/0 conn(0x7f318806c720 0x7f318806cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46238/0 (socket says 172.21.15.55:46238) 2023-08-25T04:19:07.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.665+0000 7f318659c640 1 -- 172.21.15.55:0/700696089 >> v1:172.21.15.110:6789/0 conn(0x7f31880cdd50 legacy=0x7f31880cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:07.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.665+0000 7f318659c640 1 -- 172.21.15.55:0/700696089 >> v1:172.21.15.55:6789/0 conn(0x7f318806c720 legacy=0x7f318806cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:07.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.665+0000 7f318659c640 1 -- 172.21.15.55:0/700696089 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31880c8b40 con 0x7f31880cb020 2023-08-25T04:19:07.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.665+0000 7f3185d9b640 1 -- 172.21.15.55:0/700696089 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601153057 0 0) 0x7f31880cbca0 con 0x7f318806c720 2023-08-25T04:19:07.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.669+0000 7f318659c640 1 --2- 172.21.15.55:0/700696089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31880cb020 0x7f31880c9900 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f3170006fd0 tx=0x7f317001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ce2573cac394bd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:07.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.669+0000 7f3185d9b640 1 -- 172.21.15.55:0/700696089 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31700ad680 con 0x7f31880cb020 2023-08-25T04:19:07.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.669+0000 7f3185d9b640 1 -- 172.21.15.55:0/700696089 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31700ad7e0 con 0x7f31880cb020 2023-08-25T04:19:07.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.669+0000 7f3185d9b640 1 -- 172.21.15.55:0/700696089 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31700adb70 con 0x7f31880cb020 2023-08-25T04:19:07.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.669+0000 7f318cfe9640 1 -- 172.21.15.55:0/700696089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31880cb020 msgr2=0x7f31880c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:07.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.669+0000 7f318cfe9640 1 --2- 172.21.15.55:0/700696089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31880cb020 0x7f31880c9900 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f3170006fd0 tx=0x7f317001c490 comp rx=0 tx=0).stop 2023-08-25T04:19:07.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.669+0000 7f318cfe9640 1 -- 172.21.15.55:0/700696089 shutdown_connections 2023-08-25T04:19:07.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.669+0000 7f318cfe9640 1 --2- 172.21.15.55:0/700696089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31880cb020 0x7f31880c9900 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:07.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.669+0000 7f318cfe9640 1 -- 172.21.15.55:0/700696089 >> 172.21.15.55:0/700696089 conn(0x7f3188069900 msgr2=0x7f3188069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:07.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.669+0000 7f318cfe9640 1 -- 172.21.15.55:0/700696089 shutdown_connections 2023-08-25T04:19:07.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.669+0000 7f318cfe9640 1 -- 172.21.15.55:0/700696089 wait complete. 2023-08-25T04:19:07.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.669+0000 7f318cfe9640 1 Processor -- start 2023-08-25T04:19:07.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.669+0000 7f318cfe9640 1 -- start start 2023-08-25T04:19:07.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f318cfe9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f318806c720 0x7f31880aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:07.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f318cfe9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31880cb020 0x7f3188157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:07.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f318cfe9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31880cdd50 0x7f31881f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:07.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f318cfe9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3188158350 con 0x7f31880cdd50 2023-08-25T04:19:07.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f318cfe9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31881f6a40 con 0x7f31880cb020 2023-08-25T04:19:07.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f318cfe9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31881f6d20 con 0x7f318806c720 2023-08-25T04:19:07.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f3186d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31880cdd50 0x7f31881f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:07.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f3186d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31880cdd50 0x7f31881f6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47870/0 (socket says 172.21.15.55:47870) 2023-08-25T04:19:07.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f3186d9d640 1 -- 172.21.15.55:0/2816678359 learned_addr learned my addr 172.21.15.55:0/2816678359 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:07.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f318659c640 1 --2- 172.21.15.55:0/2816678359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f318806c720 0x7f31880aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:07.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f317dd9b640 1 --2- 172.21.15.55:0/2816678359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31880cb020 0x7f3188157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:07.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f3186d9d640 1 -- 172.21.15.55:0/2816678359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f318806c720 msgr2=0x7f31880aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:07.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f3186d9d640 1 --2- 172.21.15.55:0/2816678359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f318806c720 0x7f31880aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:07.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f3186d9d640 1 -- 172.21.15.55:0/2816678359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31880cb020 msgr2=0x7f3188157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:07.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f3186d9d640 1 --2- 172.21.15.55:0/2816678359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31880cb020 0x7f3188157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:07.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f3186d9d640 1 -- 172.21.15.55:0/2816678359 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3170009480 con 0x7f31880cdd50 2023-08-25T04:19:07.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f3186d9d640 1 --2- 172.21.15.55:0/2816678359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31880cdd50 0x7f31881f6210 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f318000c780 tx=0x7f318000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:07.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f317f7fe640 1 -- 172.21.15.55:0/2816678359 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318000ce90 con 0x7f31880cdd50 2023-08-25T04:19:07.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f317f7fe640 1 -- 172.21.15.55:0/2816678359 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318000a640 con 0x7f31880cdd50 2023-08-25T04:19:07.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f318cfe9640 1 -- 172.21.15.55:0/2816678359 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31881f7000 con 0x7f31880cdd50 2023-08-25T04:19:07.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f317f7fe640 1 -- 172.21.15.55:0/2816678359 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318000a9d0 con 0x7f31880cdd50 2023-08-25T04:19:07.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f318cfe9640 1 -- 172.21.15.55:0/2816678359 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31881f75c0 con 0x7f31880cdd50 2023-08-25T04:19:07.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.673+0000 7f318cfe9640 1 -- 172.21.15.55:0/2816678359 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31881f77e0 con 0x7f31880cdd50 2023-08-25T04:19:07.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.677+0000 7f317f7fe640 1 -- 172.21.15.55:0/2816678359 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f318000ab30 con 0x7f31880cdd50 2023-08-25T04:19:07.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.677+0000 7f317f7fe640 1 --2- 172.21.15.55:0/2816678359 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f31680657a0 0x7f3168067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:07.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.677+0000 7f317f7fe640 1 -- 172.21.15.55:0/2816678359 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f31800826a0 con 0x7f31880cdd50 2023-08-25T04:19:07.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.677+0000 7f318659c640 1 --2- 172.21.15.55:0/2816678359 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f31680657a0 0x7f3168067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:07.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.677+0000 7f318659c640 1 --2- 172.21.15.55:0/2816678359 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f31680657a0 0x7f3168067c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f31700af000 tx=0x7f3170009040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:07.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.681+0000 7f317f7fe640 1 -- 172.21.15.55:0/2816678359 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3180050100 con 0x7f31880cdd50 2023-08-25T04:19:07.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:07.873+0000 7f318cfe9640 1 -- 172.21.15.55:0/2816678359 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3188073ec0 con 0x7f31880cdd50 2023-08-25T04:19:08.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.801+0000 7f317f7fe640 1 -- 172.21.15.55:0/2816678359 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3180053720 con 0x7f31880cdd50 2023-08-25T04:19:08.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.805+0000 7f318cfe9640 1 -- 172.21.15.55:0/2816678359 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f31680657a0 msgr2=0x7f3168067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:08.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.805+0000 7f318cfe9640 1 --2- 172.21.15.55:0/2816678359 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f31680657a0 0x7f3168067c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f31700af000 tx=0x7f3170009040 comp rx=0 tx=0).stop 2023-08-25T04:19:08.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.805+0000 7f318cfe9640 1 -- 172.21.15.55:0/2816678359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31880cdd50 msgr2=0x7f31881f6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:08.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.805+0000 7f318cfe9640 1 --2- 172.21.15.55:0/2816678359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31880cdd50 0x7f31881f6210 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f318000c780 tx=0x7f318000cc40 comp rx=0 tx=0).stop 2023-08-25T04:19:08.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.805+0000 7f318cfe9640 1 -- 172.21.15.55:0/2816678359 shutdown_connections 2023-08-25T04:19:08.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.805+0000 7f318cfe9640 1 --2- 172.21.15.55:0/2816678359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31880cdd50 0x7f31881f6210 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:08.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.805+0000 7f318cfe9640 1 --2- 172.21.15.55:0/2816678359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31880cb020 0x7f3188157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:08.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.805+0000 7f318cfe9640 1 --2- 172.21.15.55:0/2816678359 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f31680657a0 0x7f3168067c60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:08.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.805+0000 7f318cfe9640 1 --2- 172.21.15.55:0/2816678359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f318806c720 0x7f31880aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:08.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.805+0000 7f318cfe9640 1 -- 172.21.15.55:0/2816678359 >> 172.21.15.55:0/2816678359 conn(0x7f3188069900 msgr2=0x7f31880aafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:08.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.805+0000 7f318cfe9640 1 -- 172.21.15.55:0/2816678359 shutdown_connections 2023-08-25T04:19:08.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.805+0000 7f318cfe9640 1 -- 172.21.15.55:0/2816678359 wait complete. 2023-08-25T04:19:08.829 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-25T04:19:08.830 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-25T04:19:08.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f118689e640 1 Processor -- start 2023-08-25T04:19:08.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f118689e640 1 -- start start 2023-08-25T04:19:08.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f118689e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f11800c9830 0x7f118009bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:08.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f118689e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118015abd0 con 0x7f118015a7f0 2023-08-25T04:19:08.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f118689e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11800c8ab0 con 0x7f118006c020 2023-08-25T04:19:08.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f118689e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11800c8d50 con 0x7f11800c9830 2023-08-25T04:19:08.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f117ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f118015a7f0 0x7f1180070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46252/0 (socket says 172.21.15.55:46252) 2023-08-25T04:19:08.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f117ffff640 1 -- 172.21.15.55:0/403387909 learned_addr learned my addr 172.21.15.55:0/403387909 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:08.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f117f7fe640 1 --2- 172.21.15.55:0/403387909 >> v2:172.21.15.110:3300/0 conn(0x7f11800c9830 0x7f118009bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:08.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f117effd640 1 -- 172.21.15.55:0/403387909 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103611423 0 0) 0x7f118015abd0 con 0x7f118015a7f0 2023-08-25T04:19:08.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f117effd640 1 -- 172.21.15.55:0/403387909 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1168003530 con 0x7f118015a7f0 2023-08-25T04:19:08.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f117effd640 1 -- 172.21.15.55:0/403387909 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120298051 0 0) 0x7f11800c8ab0 con 0x7f118006c020 2023-08-25T04:19:08.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f117effd640 1 -- 172.21.15.55:0/403387909 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f118015abd0 con 0x7f118006c020 2023-08-25T04:19:08.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f117effd640 1 -- 172.21.15.55:0/403387909 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2406881840 0 0) 0x7f1168003530 con 0x7f118015a7f0 2023-08-25T04:19:08.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f117effd640 1 -- 172.21.15.55:0/403387909 >> v2:172.21.15.110:3300/0 conn(0x7f11800c9830 msgr2=0x7f118009bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:08.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f117effd640 1 --2- 172.21.15.55:0/403387909 >> v2:172.21.15.110:3300/0 conn(0x7f11800c9830 0x7f118009bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:08.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f117effd640 1 -- 172.21.15.55:0/403387909 >> v1:172.21.15.110:6789/0 conn(0x7f118006c020 legacy=0x7f11800acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:08.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f117effd640 1 -- 172.21.15.55:0/403387909 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11800c9030 con 0x7f118015a7f0 2023-08-25T04:19:08.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f117effd640 1 -- 172.21.15.55:0/403387909 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f1170001800 con 0x7f118015a7f0 2023-08-25T04:19:08.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.981+0000 7f117effd640 1 -- 172.21.15.55:0/403387909 >> v1:172.21.15.55:6789/0 conn(0x7f118015a7f0 legacy=0x7f1180070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:08.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f117effd640 1 --2- 172.21.15.55:0/403387909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1168003b10 0x7f1168003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:08.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f117effd640 1 --2- 172.21.15.55:0/403387909 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11680047d0 0x7f1168004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:08.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f117effd640 1 --2- 172.21.15.55:0/403387909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1168005190 0x7f116800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:08.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f117effd640 1 -- 172.21.15.55:0/403387909 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11800c8d50 con 0x7f1168003b10 2023-08-25T04:19:08.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f117effd640 1 -- 172.21.15.55:0/403387909 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116800c010 con 0x7f1168005190 2023-08-25T04:19:08.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f117effd640 1 -- 172.21.15.55:0/403387909 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116800c1d0 con 0x7f11680047d0 2023-08-25T04:19:08.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f117f7fe640 1 --2- 172.21.15.55:0/403387909 >> v2:172.21.15.110:3300/0 conn(0x7f11800c9830 0x7f118009bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:08.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f117ffff640 1 --2- 172.21.15.55:0/403387909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1168003b10 0x7f1168003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:08.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f1184e3b640 1 --2- 172.21.15.55:0/403387909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1168005190 0x7f116800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:08.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f117f7fe640 1 --2- 172.21.15.55:0/403387909 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11680047d0 0x7f1168004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:08.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f117ffff640 1 -- 172.21.15.55:0/403387909 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11680047d0 msgr2=0x7f1168004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:08.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f117ffff640 1 --2- 172.21.15.55:0/403387909 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11680047d0 0x7f1168004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:08.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f117ffff640 1 -- 172.21.15.55:0/403387909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1168005190 msgr2=0x7f116800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:08.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f117ffff640 1 --2- 172.21.15.55:0/403387909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1168005190 0x7f116800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:08.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f117ffff640 1 -- 172.21.15.55:0/403387909 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1168003530 con 0x7f1168003b10 2023-08-25T04:19:08.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f1184e3b640 1 --2- 172.21.15.55:0/403387909 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1168005190 0x7f116800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:08.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f1184e3b640 1 -- 172.21.15.55:0/403387909 reap_dead start 2023-08-25T04:19:08.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f117ffff640 1 --2- 172.21.15.55:0/403387909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1168003b10 0x7f1168003f10 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f117000c190 tx=0x7f117001cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e61fb858c4d31 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:08.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f117effd640 1 -- 172.21.15.55:0/403387909 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11700a5920 con 0x7f1168003b10 2023-08-25T04:19:08.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f117effd640 1 -- 172.21.15.55:0/403387909 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11700a5a80 con 0x7f1168003b10 2023-08-25T04:19:08.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.985+0000 7f117effd640 1 -- 172.21.15.55:0/403387909 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11700a5e90 con 0x7f1168003b10 2023-08-25T04:19:08.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f118689e640 1 -- 172.21.15.55:0/403387909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1168003b10 msgr2=0x7f1168003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:08.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f118689e640 1 --2- 172.21.15.55:0/403387909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1168003b10 0x7f1168003f10 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f117000c190 tx=0x7f117001cb90 comp rx=0 tx=0).stop 2023-08-25T04:19:08.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f118689e640 1 -- 172.21.15.55:0/403387909 shutdown_connections 2023-08-25T04:19:08.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f118689e640 1 --2- 172.21.15.55:0/403387909 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1168003b10 0x7f1168003f10 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:08.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f118689e640 1 -- 172.21.15.55:0/403387909 >> 172.21.15.55:0/403387909 conn(0x7f1180069900 msgr2=0x7f1180069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:08.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f118689e640 1 -- 172.21.15.55:0/403387909 shutdown_connections 2023-08-25T04:19:08.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f118689e640 1 -- 172.21.15.55:0/403387909 wait complete. 2023-08-25T04:19:08.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f118689e640 1 Processor -- start 2023-08-25T04:19:08.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f118689e640 1 -- start start 2023-08-25T04:19:08.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f118689e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1168003b10 0x7f118014eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:08.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f118689e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11800af3e0 0x7f11800af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:08.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f118689e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11800cd3d0 0x7f11800cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:08.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f118689e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11800afda0 con 0x7f1168003b10 2023-08-25T04:19:08.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f118689e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11800c60a0 con 0x7f11800af3e0 2023-08-25T04:19:08.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f118689e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11800c5490 con 0x7f11800cd3d0 2023-08-25T04:19:08.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f117ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1168003b10 0x7f118014eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:08.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f117ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1168003b10 0x7f118014eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47886/0 (socket says 172.21.15.55:47886) 2023-08-25T04:19:08.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f117ffff640 1 -- 172.21.15.55:0/796826457 learned_addr learned my addr 172.21.15.55:0/796826457 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:08.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f117f7fe640 1 --2- 172.21.15.55:0/796826457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11800af3e0 0x7f11800af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:08.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.989+0000 7f1184e3b640 1 --2- 172.21.15.55:0/796826457 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11800cd3d0 0x7f11800cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:08.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.993+0000 7f117ffff640 1 -- 172.21.15.55:0/796826457 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11800cd3d0 msgr2=0x7f11800cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:08.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.993+0000 7f117ffff640 1 --2- 172.21.15.55:0/796826457 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11800cd3d0 0x7f11800cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:08.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.993+0000 7f117ffff640 1 -- 172.21.15.55:0/796826457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11800af3e0 msgr2=0x7f11800af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:08.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.993+0000 7f117ffff640 1 --2- 172.21.15.55:0/796826457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11800af3e0 0x7f11800af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:08.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.993+0000 7f117ffff640 1 -- 172.21.15.55:0/796826457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11800c5770 con 0x7f1168003b10 2023-08-25T04:19:08.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.993+0000 7f117f7fe640 1 --2- 172.21.15.55:0/796826457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11800af3e0 0x7f11800af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:08.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.993+0000 7f117ffff640 1 --2- 172.21.15.55:0/796826457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1168003b10 0x7f118014eb80 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f117000c190 tx=0x7f1168005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:08.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.993+0000 7f117cff9640 1 -- 172.21.15.55:0/796826457 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11700a5920 con 0x7f1168003b10 2023-08-25T04:19:08.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.993+0000 7f117cff9640 1 -- 172.21.15.55:0/796826457 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11700b2070 con 0x7f1168003b10 2023-08-25T04:19:08.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.993+0000 7f117cff9640 1 -- 172.21.15.55:0/796826457 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1170005bb0 con 0x7f1168003b10 2023-08-25T04:19:08.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.993+0000 7f118689e640 1 -- 172.21.15.55:0/796826457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11800c5a50 con 0x7f1168003b10 2023-08-25T04:19:08.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.993+0000 7f118689e640 1 -- 172.21.15.55:0/796826457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118014f0c0 con 0x7f1168003b10 2023-08-25T04:19:08.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.993+0000 7f118689e640 1 -- 172.21.15.55:0/796826457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118006d5b0 con 0x7f1168003b10 2023-08-25T04:19:08.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.993+0000 7f117cff9640 1 -- 172.21.15.55:0/796826457 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f1170005d10 con 0x7f1168003b10 2023-08-25T04:19:08.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.993+0000 7f117cff9640 1 --2- 172.21.15.55:0/796826457 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f116c0657a0 0x7f116c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:09.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.993+0000 7f117cff9640 1 -- 172.21.15.55:0/796826457 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f117011ca40 con 0x7f1168003b10 2023-08-25T04:19:09.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.993+0000 7f117f7fe640 1 --2- 172.21.15.55:0/796826457 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f116c0657a0 0x7f116c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:09.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.997+0000 7f117f7fe640 1 --2- 172.21.15.55:0/796826457 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f116c0657a0 0x7f116c067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f11800cba90 tx=0x7f1174008040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:09.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:08.997+0000 7f117cff9640 1 -- 172.21.15.55:0/796826457 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f11700ea350 con 0x7f1168003b10 2023-08-25T04:19:09.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.189+0000 7f118689e640 1 -- 172.21.15.55:0/796826457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1180073ec0 con 0x7f1168003b10 2023-08-25T04:19:09.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.805+0000 7f117cff9640 1 -- 172.21.15.55:0/796826457 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7f11700b4020 con 0x7f1168003b10 2023-08-25T04:19:09.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.805+0000 7f118689e640 1 -- 172.21.15.55:0/796826457 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f116c0657a0 msgr2=0x7f116c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:09.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.805+0000 7f118689e640 1 --2- 172.21.15.55:0/796826457 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f116c0657a0 0x7f116c067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f11800cba90 tx=0x7f1174008040 comp rx=0 tx=0).stop 2023-08-25T04:19:09.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.805+0000 7f118689e640 1 -- 172.21.15.55:0/796826457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1168003b10 msgr2=0x7f118014eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:09.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.805+0000 7f118689e640 1 --2- 172.21.15.55:0/796826457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1168003b10 0x7f118014eb80 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f117000c190 tx=0x7f1168005800 comp rx=0 tx=0).stop 2023-08-25T04:19:09.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.805+0000 7f118689e640 1 -- 172.21.15.55:0/796826457 shutdown_connections 2023-08-25T04:19:09.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.805+0000 7f118689e640 1 --2- 172.21.15.55:0/796826457 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f116c0657a0 0x7f116c067c60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:09.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.805+0000 7f118689e640 1 --2- 172.21.15.55:0/796826457 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11800cd3d0 0x7f11800cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:09.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.805+0000 7f118689e640 1 --2- 172.21.15.55:0/796826457 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11800af3e0 0x7f11800af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:09.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.805+0000 7f118689e640 1 --2- 172.21.15.55:0/796826457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1168003b10 0x7f118014eb80 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:09.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.805+0000 7f118689e640 1 -- 172.21.15.55:0/796826457 >> 172.21.15.55:0/796826457 conn(0x7f1180069900 msgr2=0x7f11800b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:09.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.805+0000 7f118689e640 1 -- 172.21.15.55:0/796826457 shutdown_connections 2023-08-25T04:19:09.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.805+0000 7f118689e640 1 -- 172.21.15.55:0/796826457 wait complete. 2023-08-25T04:19:09.832 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-25T04:19:09.833 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:19:09.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.981+0000 7fc023808640 1 Processor -- start 2023-08-25T04:19:09.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.981+0000 7fc023808640 1 -- start start 2023-08-25T04:19:09.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc023808640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc01c070410 0x7fc01c1654f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:09.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc023808640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c06bbe0 con 0x7fc01c0c9210 2023-08-25T04:19:09.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc023808640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c070aa0 con 0x7fc01c15a560 2023-08-25T04:19:09.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc023808640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0708c0 con 0x7fc01c070410 2023-08-25T04:19:09.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc020da3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc01c0c9210 0x7fc01c06fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46260/0 (socket says 172.21.15.55:46260) 2023-08-25T04:19:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc020da3640 1 -- 172.21.15.55:0/3214926257 learned_addr learned my addr 172.21.15.55:0/3214926257 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc021da5640 1 --2- 172.21.15.55:0/3214926257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc01c070410 0x7fc01c1654f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc013fff640 1 -- 172.21.15.55:0/3214926257 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644058975 0 0) 0x7fc01c06bbe0 con 0x7fc01c0c9210 2023-08-25T04:19:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc013fff640 1 -- 172.21.15.55:0/3214926257 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc008003530 con 0x7fc01c0c9210 2023-08-25T04:19:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc013fff640 1 -- 172.21.15.55:0/3214926257 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943605954 0 0) 0x7fc01c070aa0 con 0x7fc01c15a560 2023-08-25T04:19:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc013fff640 1 -- 172.21.15.55:0/3214926257 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc01c06bbe0 con 0x7fc01c15a560 2023-08-25T04:19:09.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc013fff640 1 -- 172.21.15.55:0/3214926257 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1928646637 0 0) 0x7fc008003530 con 0x7fc01c0c9210 2023-08-25T04:19:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc013fff640 1 -- 172.21.15.55:0/3214926257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc01c070410 msgr2=0x7fc01c1654f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc013fff640 1 --2- 172.21.15.55:0/3214926257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc01c070410 0x7fc01c1654f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc013fff640 1 -- 172.21.15.55:0/3214926257 >> v1:172.21.15.110:6789/0 conn(0x7fc01c15a560 legacy=0x7fc01c0c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc013fff640 1 -- 172.21.15.55:0/3214926257 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c06be30 con 0x7fc01c0c9210 2023-08-25T04:19:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc013fff640 1 -- 172.21.15.55:0/3214926257 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fc00c001680 con 0x7fc01c0c9210 2023-08-25T04:19:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc013fff640 1 -- 172.21.15.55:0/3214926257 >> v1:172.21.15.55:6789/0 conn(0x7fc01c0c9210 legacy=0x7fc01c06fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:09.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc013fff640 1 --2- 172.21.15.55:0/3214926257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc008003b40 0x7fc008003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:09.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc013fff640 1 --2- 172.21.15.55:0/3214926257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc01c070410 0x7fc0080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:09.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc013fff640 1 --2- 172.21.15.55:0/3214926257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc008004d10 0x7fc008005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:09.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc013fff640 1 -- 172.21.15.55:0/3214926257 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0708c0 con 0x7fc008004d10 2023-08-25T04:19:09.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc013fff640 1 -- 172.21.15.55:0/3214926257 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00800ba40 con 0x7fc008003b40 2023-08-25T04:19:09.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc013fff640 1 -- 172.21.15.55:0/3214926257 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00800bbb0 con 0x7fc01c070410 2023-08-25T04:19:09.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc0215a4640 1 --2- 172.21.15.55:0/3214926257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc008003b40 0x7fc008003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:09.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc021da5640 1 --2- 172.21.15.55:0/3214926257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc008004d10 0x7fc008005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:09.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc020da3640 1 --2- 172.21.15.55:0/3214926257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc01c070410 0x7fc0080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:09.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc021da5640 1 -- 172.21.15.55:0/3214926257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc01c070410 msgr2=0x7fc0080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:09.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc021da5640 1 --2- 172.21.15.55:0/3214926257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc01c070410 0x7fc0080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:09.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc021da5640 1 -- 172.21.15.55:0/3214926257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc008003b40 msgr2=0x7fc008003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:09.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc021da5640 1 --2- 172.21.15.55:0/3214926257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc008003b40 0x7fc008003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:09.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.985+0000 7fc021da5640 1 -- 172.21.15.55:0/3214926257 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc008003530 con 0x7fc008004d10 2023-08-25T04:19:09.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.989+0000 7fc021da5640 1 --2- 172.21.15.55:0/3214926257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc008004d10 0x7fc008005190 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fc014009fc0 tx=0x7fc01401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785713c2d84a430d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:09.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.989+0000 7fc013fff640 1 -- 172.21.15.55:0/3214926257 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0140a5c70 con 0x7fc008004d10 2023-08-25T04:19:09.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.989+0000 7fc013fff640 1 -- 172.21.15.55:0/3214926257 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01400f040 con 0x7fc008004d10 2023-08-25T04:19:09.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.989+0000 7fc013fff640 1 -- 172.21.15.55:0/3214926257 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0140ad440 con 0x7fc008004d10 2023-08-25T04:19:09.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.989+0000 7fc023808640 1 -- 172.21.15.55:0/3214926257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc008004d10 msgr2=0x7fc008005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:09.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.989+0000 7fc023808640 1 --2- 172.21.15.55:0/3214926257 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc008004d10 0x7fc008005190 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fc014009fc0 tx=0x7fc01401cc60 comp rx=0 tx=0).stop 2023-08-25T04:19:09.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.989+0000 7fc021da5640 1 -- 172.21.15.55:0/3214926257 reap_dead start 2023-08-25T04:19:09.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.989+0000 7fc023808640 1 -- 172.21.15.55:0/3214926257 shutdown_connections 2023-08-25T04:19:09.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.989+0000 7fc023808640 1 -- 172.21.15.55:0/3214926257 >> 172.21.15.55:0/3214926257 conn(0x7fc01c069f00 msgr2=0x7fc01c0affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:09.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.989+0000 7fc023808640 1 -- 172.21.15.55:0/3214926257 shutdown_connections 2023-08-25T04:19:09.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.989+0000 7fc023808640 1 -- 172.21.15.55:0/3214926257 wait complete. 2023-08-25T04:19:09.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.989+0000 7fc023808640 1 Processor -- start 2023-08-25T04:19:09.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc023808640 1 -- start start 2023-08-25T04:19:09.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc023808640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc008004d10 0x7fc01c159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:09.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc023808640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc01c0c2fd0 0x7fc01c0c3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:09.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc023808640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc01c1f31b0 0x7fc01c1f3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:09.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc023808640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0c3990 con 0x7fc01c1f31b0 2023-08-25T04:19:09.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc023808640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c0c1340 con 0x7fc008004d10 2023-08-25T04:19:09.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc023808640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c156690 con 0x7fc01c0c2fd0 2023-08-25T04:19:09.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc021da5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc01c1f31b0 0x7fc01c1f3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:09.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc021da5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc01c1f31b0 0x7fc01c1f3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47908/0 (socket says 172.21.15.55:47908) 2023-08-25T04:19:09.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc021da5640 1 -- 172.21.15.55:0/4266923811 learned_addr learned my addr 172.21.15.55:0/4266923811 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:09.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc0215a4640 1 --2- 172.21.15.55:0/4266923811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc008004d10 0x7fc01c159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:09.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc020da3640 1 --2- 172.21.15.55:0/4266923811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc01c0c2fd0 0x7fc01c0c3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:09.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc021da5640 1 -- 172.21.15.55:0/4266923811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc01c0c2fd0 msgr2=0x7fc01c0c3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:09.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc021da5640 1 --2- 172.21.15.55:0/4266923811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc01c0c2fd0 0x7fc01c0c3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc021da5640 1 -- 172.21.15.55:0/4266923811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc008004d10 msgr2=0x7fc01c159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:10.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc021da5640 1 --2- 172.21.15.55:0/4266923811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc008004d10 0x7fc01c159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc021da5640 1 -- 172.21.15.55:0/4266923811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c159a60 con 0x7fc01c1f31b0 2023-08-25T04:19:10.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc0215a4640 1 --2- 172.21.15.55:0/4266923811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc008004d10 0x7fc01c159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:10.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc021da5640 1 --2- 172.21.15.55:0/4266923811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc01c1f31b0 0x7fc01c1f3660 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fc0140b0040 tx=0x7fc014009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:10.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc011ffb640 1 -- 172.21.15.55:0/4266923811 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0140039a0 con 0x7fc01c1f31b0 2023-08-25T04:19:10.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc011ffb640 1 -- 172.21.15.55:0/4266923811 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc014003b00 con 0x7fc01c1f31b0 2023-08-25T04:19:10.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc023808640 1 -- 172.21.15.55:0/4266923811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01c1f3ee0 con 0x7fc01c1f31b0 2023-08-25T04:19:10.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc011ffb640 1 -- 172.21.15.55:0/4266923811 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc014003e90 con 0x7fc01c1f31b0 2023-08-25T04:19:10.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc023808640 1 -- 172.21.15.55:0/4266923811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01c156c10 con 0x7fc01c1f31b0 2023-08-25T04:19:10.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.993+0000 7fc023808640 1 -- 172.21.15.55:0/4266923811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01c073ec0 con 0x7fc01c1f31b0 2023-08-25T04:19:10.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.997+0000 7fc011ffb640 1 -- 172.21.15.55:0/4266923811 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fc0140b4040 con 0x7fc01c1f31b0 2023-08-25T04:19:10.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.997+0000 7fc011ffb640 1 --2- 172.21.15.55:0/4266923811 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc0000657d0 0x7fc000067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:10.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.997+0000 7fc011ffb640 1 -- 172.21.15.55:0/4266923811 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc01411c900 con 0x7fc01c1f31b0 2023-08-25T04:19:10.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.997+0000 7fc0215a4640 1 --2- 172.21.15.55:0/4266923811 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc0000657d0 0x7fc000067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:10.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:09.997+0000 7fc0215a4640 1 --2- 172.21.15.55:0/4266923811 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc0000657d0 0x7fc000067c90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc018007fd0 tx=0x7fc018009040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:10.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.001+0000 7fc011ffb640 1 -- 172.21.15.55:0/4266923811 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc0140ea540 con 0x7fc01c1f31b0 2023-08-25T04:19:10.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.189+0000 7fc023808640 1 -- 172.21.15.55:0/4266923811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc01c0b0910 con 0x7fc01c1f31b0 2023-08-25T04:19:10.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.189+0000 7fc011ffb640 1 -- 172.21.15.55:0/4266923811 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4880 (secure 0 0 0) 0x7fc0140b2090 con 0x7fc01c1f31b0 2023-08-25T04:19:10.189 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:10.189 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6311,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/976095252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":976095252},{"type":"v1","addr":"172.21.15.110:6836","nonce":976095252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1364761770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1364761770},{"type":"v1","addr":"172.21.15.110:6837","nonce":1364761770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2491496151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2491496151},{"type":"v1","addr":"172.21.15.55:6834","nonce":2491496151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:19:06.181749+0000","modified":"2023-08-25T04:19:09.803812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7329":{"gid":7329,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3432791477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3432791477},{"type":"v1","addr":"172.21.15.55:6835","nonce":3432791477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-25T04:19:10.190 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 40 2023-08-25T04:19:10.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.189+0000 7fc023808640 1 -- 172.21.15.55:0/4266923811 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc0000657d0 msgr2=0x7fc000067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:10.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.189+0000 7fc023808640 1 --2- 172.21.15.55:0/4266923811 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc0000657d0 0x7fc000067c90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc018007fd0 tx=0x7fc018009040 comp rx=0 tx=0).stop 2023-08-25T04:19:10.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.189+0000 7fc023808640 1 -- 172.21.15.55:0/4266923811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc01c1f31b0 msgr2=0x7fc01c1f3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:10.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.189+0000 7fc023808640 1 --2- 172.21.15.55:0/4266923811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc01c1f31b0 0x7fc01c1f3660 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fc0140b0040 tx=0x7fc014009750 comp rx=0 tx=0).stop 2023-08-25T04:19:10.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.189+0000 7fc023808640 1 -- 172.21.15.55:0/4266923811 shutdown_connections 2023-08-25T04:19:10.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.189+0000 7fc023808640 1 --2- 172.21.15.55:0/4266923811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc01c1f31b0 0x7fc01c1f3660 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.189+0000 7fc023808640 1 --2- 172.21.15.55:0/4266923811 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc0000657d0 0x7fc000067c90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.189+0000 7fc023808640 1 --2- 172.21.15.55:0/4266923811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc01c0c2fd0 0x7fc01c0c3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.189+0000 7fc023808640 1 --2- 172.21.15.55:0/4266923811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc008004d10 0x7fc01c159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.189+0000 7fc023808640 1 -- 172.21.15.55:0/4266923811 >> 172.21.15.55:0/4266923811 conn(0x7fc01c069f00 msgr2=0x7fc01c0caa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:10.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.189+0000 7fc023808640 1 -- 172.21.15.55:0/4266923811 shutdown_connections 2023-08-25T04:19:10.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.189+0000 7fc023808640 1 -- 172.21.15.55:0/4266923811 wait complete. 2023-08-25T04:19:10.210 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:19:10.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.353+0000 7f288fe88640 1 Processor -- start 2023-08-25T04:19:10.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.353+0000 7f288fe88640 1 -- start start 2023-08-25T04:19:10.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.353+0000 7f288fe88640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2888164410 0x7f28880b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:10.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.353+0000 7f288fe88640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28880c1a80 0x7f288806bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:10.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.353+0000 7f288fe88640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28880cc510 con 0x7f28880cddf0 2023-08-25T04:19:10.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.353+0000 7f288fe88640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28881647f0 con 0x7f2888164410 2023-08-25T04:19:10.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.353+0000 7f288fe88640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28880cc9b0 con 0x7f28880c1a80 2023-08-25T04:19:10.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.353+0000 7f288dc24640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2888164410 0x7f28880b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:10.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.353+0000 7f288dc24640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2888164410 0x7f28880b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47924/0 (socket says 172.21.15.55:47924) 2023-08-25T04:19:10.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.353+0000 7f288dc24640 1 -- 172.21.15.55:0/605275759 learned_addr learned my addr 172.21.15.55:0/605275759 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:10.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.353+0000 7f288e425640 1 --2- 172.21.15.55:0/605275759 >> v2:172.21.15.110:3300/0 conn(0x7f28880c1a80 0x7f288806bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:10.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.357+0000 7f288dc24640 1 -- 172.21.15.55:0/605275759 >> v2:172.21.15.110:3300/0 conn(0x7f28880c1a80 msgr2=0x7f288806bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:10.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.357+0000 7f288dc24640 1 --2- 172.21.15.55:0/605275759 >> v2:172.21.15.110:3300/0 conn(0x7f28880c1a80 0x7f288806bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.357+0000 7f288dc24640 1 -- 172.21.15.55:0/605275759 >> v1:172.21.15.110:6789/0 conn(0x7f28880cddf0 legacy=0x7f28880c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:10.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.357+0000 7f288dc24640 1 -- 172.21.15.55:0/605275759 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28880ccc90 con 0x7f2888164410 2023-08-25T04:19:10.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.357+0000 7f288dc24640 1 --2- 172.21.15.55:0/605275759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2888164410 0x7f28880b21b0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f28880cbde0 tx=0x7f288401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1593cf26e05a6e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:10.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.357+0000 7f288cc22640 1 -- 172.21.15.55:0/605275759 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28840ab600 con 0x7f2888164410 2023-08-25T04:19:10.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.357+0000 7f288cc22640 1 -- 172.21.15.55:0/605275759 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28840a7050 con 0x7f2888164410 2023-08-25T04:19:10.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.357+0000 7f288cc22640 1 -- 172.21.15.55:0/605275759 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28840ab980 con 0x7f2888164410 2023-08-25T04:19:10.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.357+0000 7f288fe88640 1 -- 172.21.15.55:0/605275759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2888164410 msgr2=0x7f28880b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:10.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.357+0000 7f288fe88640 1 --2- 172.21.15.55:0/605275759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2888164410 0x7f28880b21b0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f28880cbde0 tx=0x7f288401c500 comp rx=0 tx=0).stop 2023-08-25T04:19:10.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.357+0000 7f288fe88640 1 -- 172.21.15.55:0/605275759 shutdown_connections 2023-08-25T04:19:10.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.357+0000 7f288fe88640 1 --2- 172.21.15.55:0/605275759 >> v2:172.21.15.110:3300/0 conn(0x7f28880c1a80 0x7f288806bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.357+0000 7f288fe88640 1 --2- 172.21.15.55:0/605275759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2888164410 0x7f28880b21b0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.357+0000 7f288fe88640 1 -- 172.21.15.55:0/605275759 >> 172.21.15.55:0/605275759 conn(0x7f2888069d00 msgr2=0x7f288806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:10.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288fe88640 1 -- 172.21.15.55:0/605275759 shutdown_connections 2023-08-25T04:19:10.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288fe88640 1 -- 172.21.15.55:0/605275759 wait complete. 2023-08-25T04:19:10.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288fe88640 1 Processor -- start 2023-08-25T04:19:10.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288fe88640 1 -- start start 2023-08-25T04:19:10.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288fe88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28880c1a80 0x7f2888097940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:10.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288fe88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28880cddf0 0x7f288815d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:10.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288fe88640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2888164410 0x7f288815be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:10.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288fe88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28880c4af0 con 0x7f28880cddf0 2023-08-25T04:19:10.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288fe88640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2888097e80 con 0x7f2888164410 2023-08-25T04:19:10.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288fe88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28880c3ee0 con 0x7f28880c1a80 2023-08-25T04:19:10.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288d423640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28880cddf0 0x7f288815d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:10.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288d423640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28880cddf0 0x7f288815d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47928/0 (socket says 172.21.15.55:47928) 2023-08-25T04:19:10.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288dc24640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28880c1a80 0x7f2888097940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:10.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288d423640 1 -- 172.21.15.55:0/1433040636 learned_addr learned my addr 172.21.15.55:0/1433040636 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:10.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288e425640 1 --2- 172.21.15.55:0/1433040636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2888164410 0x7f288815be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:10.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288d423640 1 -- 172.21.15.55:0/1433040636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28880c1a80 msgr2=0x7f2888097940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:10.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288d423640 1 --2- 172.21.15.55:0/1433040636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28880c1a80 0x7f2888097940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288d423640 1 -- 172.21.15.55:0/1433040636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2888164410 msgr2=0x7f288815be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:10.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288d423640 1 --2- 172.21.15.55:0/1433040636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2888164410 0x7f288815be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288d423640 1 -- 172.21.15.55:0/1433040636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28840094d0 con 0x7f28880cddf0 2023-08-25T04:19:10.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f288d423640 1 --2- 172.21.15.55:0/1433040636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28880cddf0 0x7f288815d100 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f287800c4d0 tx=0x7f287800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:10.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.361+0000 7f287e7fc640 1 -- 172.21.15.55:0/1433040636 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28780052d0 con 0x7f28880cddf0 2023-08-25T04:19:10.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.365+0000 7f287e7fc640 1 -- 172.21.15.55:0/1433040636 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2878005430 con 0x7f28880cddf0 2023-08-25T04:19:10.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.365+0000 7f288fe88640 1 -- 172.21.15.55:0/1433040636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28880c41c0 con 0x7f28880cddf0 2023-08-25T04:19:10.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.365+0000 7f287e7fc640 1 -- 172.21.15.55:0/1433040636 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2878012830 con 0x7f28880cddf0 2023-08-25T04:19:10.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.365+0000 7f288fe88640 1 -- 172.21.15.55:0/1433040636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28880c4780 con 0x7f28880cddf0 2023-08-25T04:19:10.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.365+0000 7f288fe88640 1 -- 172.21.15.55:0/1433040636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288804dbe0 con 0x7f28880cddf0 2023-08-25T04:19:10.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.365+0000 7f287e7fc640 1 -- 172.21.15.55:0/1433040636 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f2878012990 con 0x7f28880cddf0 2023-08-25T04:19:10.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.365+0000 7f287e7fc640 1 --2- 172.21.15.55:0/1433040636 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f286c0657a0 0x7f286c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:10.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.365+0000 7f287e7fc640 1 -- 172.21.15.55:0/1433040636 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f28780828b0 con 0x7f28880cddf0 2023-08-25T04:19:10.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.365+0000 7f288dc24640 1 --2- 172.21.15.55:0/1433040636 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f286c0657a0 0x7f286c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:10.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.369+0000 7f288dc24640 1 --2- 172.21.15.55:0/1433040636 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f286c0657a0 0x7f286c067c60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f28840ad000 tx=0x7f2884008040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:10.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.369+0000 7f287e7fc640 1 -- 172.21.15.55:0/1433040636 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f28780503a0 con 0x7f28880cddf0 2023-08-25T04:19:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.529+0000 7f288fe88640 1 -- 172.21.15.55:0/1433040636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28880713c0 con 0x7f28880cddf0 2023-08-25T04:19:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.529+0000 7f287e7fc640 1 -- 172.21.15.55:0/1433040636 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+18366 (secure 0 0 0) 0x7f28780539c0 con 0x7f28880cddf0 2023-08-25T04:19:10.529 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:10.529 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":93,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:19:07.788813+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:19:03.829933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-25T04:19:05.172184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:19:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.529+0000 7f288fe88640 1 -- 172.21.15.55:0/1433040636 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f286c0657a0 msgr2=0x7f286c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.529+0000 7f288fe88640 1 --2- 172.21.15.55:0/1433040636 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f286c0657a0 0x7f286c067c60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f28840ad000 tx=0x7f2884008040 comp rx=0 tx=0).stop 2023-08-25T04:19:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.529+0000 7f288fe88640 1 -- 172.21.15.55:0/1433040636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28880cddf0 msgr2=0x7f288815d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:10.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.529+0000 7f288fe88640 1 --2- 172.21.15.55:0/1433040636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28880cddf0 0x7f288815d100 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f287800c4d0 tx=0x7f287800c990 comp rx=0 tx=0).stop 2023-08-25T04:19:10.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.529+0000 7f288fe88640 1 -- 172.21.15.55:0/1433040636 shutdown_connections 2023-08-25T04:19:10.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.529+0000 7f288fe88640 1 --2- 172.21.15.55:0/1433040636 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2888164410 0x7f288815be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.529+0000 7f288fe88640 1 --2- 172.21.15.55:0/1433040636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28880cddf0 0x7f288815d100 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.529+0000 7f288fe88640 1 --2- 172.21.15.55:0/1433040636 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f286c0657a0 0x7f286c067c60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.529+0000 7f288fe88640 1 --2- 172.21.15.55:0/1433040636 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28880c1a80 0x7f2888097940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.529+0000 7f288fe88640 1 -- 172.21.15.55:0/1433040636 >> 172.21.15.55:0/1433040636 conn(0x7f2888069d00 msgr2=0x7f288806f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:10.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.529+0000 7f288fe88640 1 -- 172.21.15.55:0/1433040636 shutdown_connections 2023-08-25T04:19:10.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.529+0000 7f288fe88640 1 -- 172.21.15.55:0/1433040636 wait complete. 2023-08-25T04:19:10.551 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-25T04:19:10.552 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:19:10.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.697+0000 7f712eb74640 1 Processor -- start 2023-08-25T04:19:10.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.697+0000 7f712eb74640 1 -- start start 2023-08-25T04:19:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.697+0000 7f712eb74640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f712815c9c0 0x7f7128160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.697+0000 7f712eb74640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f71280cfa70 0x7f7128160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.697+0000 7f712eb74640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712806eaf0 con 0x7f7128160f90 2023-08-25T04:19:10.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.697+0000 7f712eb74640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712806e530 con 0x7f71280cfa70 2023-08-25T04:19:10.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.697+0000 7f712eb74640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712806e810 con 0x7f712815c9c0 2023-08-25T04:19:10.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.697+0000 7f712c910640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f712815c9c0 0x7f7128160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:10.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.697+0000 7f7127fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f71280cfa70 0x7f7128160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:10.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.697+0000 7f712c910640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f712815c9c0 0x7f7128160510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:41874/0 (socket says 172.21.15.55:41874) 2023-08-25T04:19:10.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.697+0000 7f712c910640 1 -- 172.21.15.55:0/25026772 learned_addr learned my addr 172.21.15.55:0/25026772 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:10.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.697+0000 7f7127fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f71280cfa70 0x7f7128160a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:43042/0 (socket says 172.21.15.55:43042) 2023-08-25T04:19:10.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.697+0000 7f712d111640 1 --1- 172.21.15.55:0/25026772 >> v1:172.21.15.110:6789/0 conn(0x7f7128160f90 0x7f71280ce910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:58032/0 (socket says 172.21.15.55:58032) 2023-08-25T04:19:10.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.697+0000 7f712c910640 1 -- 172.21.15.55:0/25026772 >> v2:172.21.15.110:3300/0 conn(0x7f71280cfa70 msgr2=0x7f7128160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:10.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.697+0000 7f712c910640 1 --2- 172.21.15.55:0/25026772 >> v2:172.21.15.110:3300/0 conn(0x7f71280cfa70 0x7f7128160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.697+0000 7f712c910640 1 -- 172.21.15.55:0/25026772 >> v1:172.21.15.110:6789/0 conn(0x7f7128160f90 legacy=0x7f71280ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:10.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.697+0000 7f712c910640 1 -- 172.21.15.55:0/25026772 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712806aab0 con 0x7f712815c9c0 2023-08-25T04:19:10.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.697+0000 7f7127fff640 1 --2- 172.21.15.55:0/25026772 >> v2:172.21.15.110:3300/0 conn(0x7f71280cfa70 0x7f7128160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:10.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.701+0000 7f712c910640 1 --2- 172.21.15.55:0/25026772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f712815c9c0 0x7f7128160510 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f711c006fd0 tx=0x7f711c01c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9400577c74e062d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:10.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.701+0000 7f71277fe640 1 -- 172.21.15.55:0/25026772 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c0ab600 con 0x7f712815c9c0 2023-08-25T04:19:10.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.701+0000 7f71277fe640 1 -- 172.21.15.55:0/25026772 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c0ab760 con 0x7f712815c9c0 2023-08-25T04:19:10.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.701+0000 7f71277fe640 1 -- 172.21.15.55:0/25026772 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c0abaf0 con 0x7f712815c9c0 2023-08-25T04:19:10.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.701+0000 7f712eb74640 1 -- 172.21.15.55:0/25026772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f712815c9c0 msgr2=0x7f7128160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.701+0000 7f712eb74640 1 --2- 172.21.15.55:0/25026772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f712815c9c0 0x7f7128160510 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f711c006fd0 tx=0x7f711c01c4f0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.701+0000 7f712eb74640 1 -- 172.21.15.55:0/25026772 shutdown_connections 2023-08-25T04:19:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.701+0000 7f712eb74640 1 --2- 172.21.15.55:0/25026772 >> v2:172.21.15.110:3300/0 conn(0x7f71280cfa70 0x7f7128160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.701+0000 7f712eb74640 1 --2- 172.21.15.55:0/25026772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f712815c9c0 0x7f7128160510 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.701+0000 7f712eb74640 1 -- 172.21.15.55:0/25026772 >> 172.21.15.55:0/25026772 conn(0x7f71280d05a0 msgr2=0x7f71280d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.701+0000 7f712eb74640 1 -- 172.21.15.55:0/25026772 shutdown_connections 2023-08-25T04:19:10.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.701+0000 7f712eb74640 1 -- 172.21.15.55:0/25026772 wait complete. 2023-08-25T04:19:10.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f712eb74640 1 Processor -- start 2023-08-25T04:19:10.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f712eb74640 1 -- start start 2023-08-25T04:19:10.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f712eb74640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71280cfa70 0x7f71280c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:10.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f712eb74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f712815c9c0 0x7f71280b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:10.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f712eb74640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7128160f90 0x7f71281534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:10.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f712eb74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712814a570 con 0x7f712815c9c0 2023-08-25T04:19:10.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f712eb74640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712814b880 con 0x7f71280cfa70 2023-08-25T04:19:10.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f712eb74640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7128149fb0 con 0x7f7128160f90 2023-08-25T04:19:10.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f7127fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f712815c9c0 0x7f71280b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:10.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f7127fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f712815c9c0 0x7f71280b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49218/0 (socket says 172.21.15.55:49218) 2023-08-25T04:19:10.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f7127fff640 1 -- 172.21.15.55:0/4258848362 learned_addr learned my addr 172.21.15.55:0/4258848362 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:10.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f712c910640 1 --2- 172.21.15.55:0/4258848362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71280cfa70 0x7f71280c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:10.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f712d111640 1 --2- 172.21.15.55:0/4258848362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7128160f90 0x7f71281534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:10.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f7127fff640 1 -- 172.21.15.55:0/4258848362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7128160f90 msgr2=0x7f71281534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:10.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f7127fff640 1 --2- 172.21.15.55:0/4258848362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7128160f90 0x7f71281534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f7127fff640 1 -- 172.21.15.55:0/4258848362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71280cfa70 msgr2=0x7f71280c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:10.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f7127fff640 1 --2- 172.21.15.55:0/4258848362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71280cfa70 0x7f71280c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f7127fff640 1 -- 172.21.15.55:0/4258848362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7114009420 con 0x7f712815c9c0 2023-08-25T04:19:10.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f7127fff640 1 --2- 172.21.15.55:0/4258848362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f712815c9c0 0x7f71280b12a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f711400e9b0 tx=0x7f711400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:10.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f71257fa640 1 -- 172.21.15.55:0/4258848362 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711400c9a0 con 0x7f712815c9c0 2023-08-25T04:19:10.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f71257fa640 1 -- 172.21.15.55:0/4258848362 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711400cb00 con 0x7f712815c9c0 2023-08-25T04:19:10.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f71257fa640 1 -- 172.21.15.55:0/4258848362 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114013470 con 0x7f712815c9c0 2023-08-25T04:19:10.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f712eb74640 1 -- 172.21.15.55:0/4258848362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c009480 con 0x7f712815c9c0 2023-08-25T04:19:10.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.705+0000 7f712eb74640 1 -- 172.21.15.55:0/4258848362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71280c5440 con 0x7f712815c9c0 2023-08-25T04:19:10.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.709+0000 7f712eb74640 1 -- 172.21.15.55:0/4258848362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712814a720 con 0x7f712815c9c0 2023-08-25T04:19:10.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.709+0000 7f71257fa640 1 -- 172.21.15.55:0/4258848362 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f71140135d0 con 0x7f712815c9c0 2023-08-25T04:19:10.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.709+0000 7f71257fa640 1 --2- 172.21.15.55:0/4258848362 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f710c0657d0 0x7f710c067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:10.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.709+0000 7f71257fa640 1 -- 172.21.15.55:0/4258848362 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7114082d80 con 0x7f712815c9c0 2023-08-25T04:19:10.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.709+0000 7f712c910640 1 --2- 172.21.15.55:0/4258848362 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f710c0657d0 0x7f710c067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:10.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.709+0000 7f712c910640 1 --2- 172.21.15.55:0/4258848362 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f710c0657d0 0x7f710c067c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f711c0af000 tx=0x7f711c0a7000 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:10.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.713+0000 7f71257fa640 1 -- 172.21.15.55:0/4258848362 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f712814a720 con 0x7f712815c9c0 2023-08-25T04:19:10.731 INFO:tasks.ceph.mds.c.smithi055.stderr:2023-08-25T04:19:10.733+0000 7f5847767640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T04:19:10.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.869+0000 7f712eb74640 1 -- 172.21.15.55:0/4258848362 --> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71280c56a0 con 0x7f710c0657d0 2023-08-25T04:19:10.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.881+0000 7f71257fa640 1 -- 172.21.15.55:0/4258848362 <== mgr.6113 v2:172.21.15.110:6832/2805609132 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311534 (secure 0 0 0) 0x7f71280c56a0 con 0x7f710c0657d0 2023-08-25T04:19:10.882 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:10.883 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:19:10.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.881+0000 7f712eb74640 1 -- 172.21.15.55:0/4258848362 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f710c0657d0 msgr2=0x7f710c067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:10.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.881+0000 7f712eb74640 1 --2- 172.21.15.55:0/4258848362 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f710c0657d0 0x7f710c067c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f711c0af000 tx=0x7f711c0a7000 comp rx=0 tx=0).stop 2023-08-25T04:19:10.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.881+0000 7f712eb74640 1 -- 172.21.15.55:0/4258848362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f712815c9c0 msgr2=0x7f71280b12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:10.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.881+0000 7f712eb74640 1 --2- 172.21.15.55:0/4258848362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f712815c9c0 0x7f71280b12a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f711400e9b0 tx=0x7f711400ee70 comp rx=0 tx=0).stop 2023-08-25T04:19:10.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.885+0000 7f712eb74640 1 -- 172.21.15.55:0/4258848362 shutdown_connections 2023-08-25T04:19:10.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.885+0000 7f712eb74640 1 --2- 172.21.15.55:0/4258848362 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f710c0657d0 0x7f710c067c90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.885+0000 7f712eb74640 1 --2- 172.21.15.55:0/4258848362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7128160f90 0x7f71281534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.885+0000 7f712eb74640 1 --2- 172.21.15.55:0/4258848362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f712815c9c0 0x7f71280b12a0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.885+0000 7f712eb74640 1 --2- 172.21.15.55:0/4258848362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71280cfa70 0x7f71280c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:10.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.885+0000 7f712eb74640 1 -- 172.21.15.55:0/4258848362 >> 172.21.15.55:0/4258848362 conn(0x7f71280d05a0 msgr2=0x7f71280d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:10.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.885+0000 7f712eb74640 1 -- 172.21.15.55:0/4258848362 shutdown_connections 2023-08-25T04:19:10.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:10.885+0000 7f712eb74640 1 -- 172.21.15.55:0/4258848362 wait complete. 2023-08-25T04:19:10.902 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-25T04:19:10.313597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":656,"num_read_kb":1306,"num_write":315,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":316364,"kb_used_data":10000,"kb_used_omap":13,"kb_used_meta":306226,"kb_avail":754658356,"statfs":{"total":773094113280,"available":772770156544,"internally_reserved":0,"allocated":10240000,"data_stored":5620938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":313575512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.554838"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797641+0000","last_change":"2023-08-25T04:19:06.794646+0000","last_active":"2023-08-25T04:19:07.797641+0000","last_peered":"2023-08-25T04:19:07.797641+0000","last_clean":"2023-08-25T04:19:07.797641+0000","last_became_active":"2023-08-25T04:19:06.794316+0000","last_became_peered":"2023-08-25T04:19:06.794316+0000","last_unstale":"2023-08-25T04:19:07.797641+0000","last_undegraded":"2023-08-25T04:19:07.797641+0000","last_fullsized":"2023-08-25T04:19:07.797641+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:59.065930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992930+0000","last_change":"2023-08-25T04:19:06.804890+0000","last_active":"2023-08-25T04:19:07.992930+0000","last_peered":"2023-08-25T04:19:07.992930+0000","last_clean":"2023-08-25T04:19:07.992930+0000","last_became_active":"2023-08-25T04:19:06.804607+0000","last_became_peered":"2023-08-25T04:19:06.804607+0000","last_unstale":"2023-08-25T04:19:07.992930+0000","last_undegraded":"2023-08-25T04:19:07.992930+0000","last_fullsized":"2023-08-25T04:19:07.992930+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:04:46.433360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120925+0000","last_change":"2023-08-25T04:19:06.803924+0000","last_active":"2023-08-25T04:19:09.120925+0000","last_peered":"2023-08-25T04:19:09.120925+0000","last_clean":"2023-08-25T04:19:09.120925+0000","last_became_active":"2023-08-25T04:19:06.803505+0000","last_became_peered":"2023-08-25T04:19:06.803505+0000","last_unstale":"2023-08-25T04:19:09.120925+0000","last_undegraded":"2023-08-25T04:19:09.120925+0000","last_fullsized":"2023-08-25T04:19:09.120925+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:51:08.473197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646205+0000","last_change":"2023-08-25T04:19:06.802997+0000","last_active":"2023-08-25T04:19:08.646205+0000","last_peered":"2023-08-25T04:19:08.646205+0000","last_clean":"2023-08-25T04:19:08.646205+0000","last_became_active":"2023-08-25T04:19:06.802542+0000","last_became_peered":"2023-08-25T04:19:06.802542+0000","last_unstale":"2023-08-25T04:19:08.646205+0000","last_undegraded":"2023-08-25T04:19:08.646205+0000","last_fullsized":"2023-08-25T04:19:08.646205+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:14:27.964537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120226+0000","last_change":"2023-08-25T04:19:06.791228+0000","last_active":"2023-08-25T04:19:09.120226+0000","last_peered":"2023-08-25T04:19:09.120226+0000","last_clean":"2023-08-25T04:19:09.120226+0000","last_became_active":"2023-08-25T04:19:06.790923+0000","last_became_peered":"2023-08-25T04:19:06.790923+0000","last_unstale":"2023-08-25T04:19:09.120226+0000","last_undegraded":"2023-08-25T04:19:09.120226+0000","last_fullsized":"2023-08-25T04:19:09.120226+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:05.335597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800389+0000","last_change":"2023-08-25T04:19:06.817403+0000","last_active":"2023-08-25T04:19:07.800389+0000","last_peered":"2023-08-25T04:19:07.800389+0000","last_clean":"2023-08-25T04:19:07.800389+0000","last_became_active":"2023-08-25T04:19:06.806224+0000","last_became_peered":"2023-08-25T04:19:06.806224+0000","last_unstale":"2023-08-25T04:19:07.800389+0000","last_undegraded":"2023-08-25T04:19:07.800389+0000","last_fullsized":"2023-08-25T04:19:07.800389+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:29:56.321894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118338+0000","last_change":"2023-08-25T04:19:06.790957+0000","last_active":"2023-08-25T04:19:09.118338+0000","last_peered":"2023-08-25T04:19:09.118338+0000","last_clean":"2023-08-25T04:19:09.118338+0000","last_became_active":"2023-08-25T04:19:06.790689+0000","last_became_peered":"2023-08-25T04:19:06.790689+0000","last_unstale":"2023-08-25T04:19:09.118338+0000","last_undegraded":"2023-08-25T04:19:09.118338+0000","last_fullsized":"2023-08-25T04:19:09.118338+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:11:24.568378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.119754+0000","last_change":"2023-08-25T04:19:06.792223+0000","last_active":"2023-08-25T04:19:09.119754+0000","last_peered":"2023-08-25T04:19:09.119754+0000","last_clean":"2023-08-25T04:19:09.119754+0000","last_became_active":"2023-08-25T04:19:06.791842+0000","last_became_peered":"2023-08-25T04:19:06.791842+0000","last_unstale":"2023-08-25T04:19:09.119754+0000","last_undegraded":"2023-08-25T04:19:09.119754+0000","last_fullsized":"2023-08-25T04:19:09.119754+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:36:43.827545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797799+0000","last_change":"2023-08-25T04:19:06.800381+0000","last_active":"2023-08-25T04:19:07.797799+0000","last_peered":"2023-08-25T04:19:07.797799+0000","last_clean":"2023-08-25T04:19:07.797799+0000","last_became_active":"2023-08-25T04:19:06.797923+0000","last_became_peered":"2023-08-25T04:19:06.797923+0000","last_unstale":"2023-08-25T04:19:07.797799+0000","last_undegraded":"2023-08-25T04:19:07.797799+0000","last_fullsized":"2023-08-25T04:19:07.797799+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:51:05.886076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646356+0000","last_change":"2023-08-25T04:19:06.801731+0000","last_active":"2023-08-25T04:19:08.646356+0000","last_peered":"2023-08-25T04:19:08.646356+0000","last_clean":"2023-08-25T04:19:08.646356+0000","last_became_active":"2023-08-25T04:19:06.801434+0000","last_became_peered":"2023-08-25T04:19:06.801434+0000","last_unstale":"2023-08-25T04:19:08.646356+0000","last_undegraded":"2023-08-25T04:19:08.646356+0000","last_fullsized":"2023-08-25T04:19:08.646356+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:20:12.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992979+0000","last_change":"2023-08-25T04:19:06.810916+0000","last_active":"2023-08-25T04:19:07.992979+0000","last_peered":"2023-08-25T04:19:07.992979+0000","last_clean":"2023-08-25T04:19:07.992979+0000","last_became_active":"2023-08-25T04:19:06.810376+0000","last_became_peered":"2023-08-25T04:19:06.810376+0000","last_unstale":"2023-08-25T04:19:07.992979+0000","last_undegraded":"2023-08-25T04:19:07.992979+0000","last_fullsized":"2023-08-25T04:19:07.992979+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:06:33.515548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646327+0000","last_change":"2023-08-25T04:19:06.811820+0000","last_active":"2023-08-25T04:19:08.646327+0000","last_peered":"2023-08-25T04:19:08.646327+0000","last_clean":"2023-08-25T04:19:08.646327+0000","last_became_active":"2023-08-25T04:19:06.811424+0000","last_became_peered":"2023-08-25T04:19:06.811424+0000","last_unstale":"2023-08-25T04:19:08.646327+0000","last_undegraded":"2023-08-25T04:19:08.646327+0000","last_fullsized":"2023-08-25T04:19:08.646327+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:56:09.745452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120243+0000","last_change":"2023-08-25T04:19:06.802082+0000","last_active":"2023-08-25T04:19:09.120243+0000","last_peered":"2023-08-25T04:19:09.120243+0000","last_clean":"2023-08-25T04:19:09.120243+0000","last_became_active":"2023-08-25T04:19:06.801764+0000","last_became_peered":"2023-08-25T04:19:06.801764+0000","last_unstale":"2023-08-25T04:19:09.120243+0000","last_undegraded":"2023-08-25T04:19:09.120243+0000","last_fullsized":"2023-08-25T04:19:09.120243+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:09.565533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800749+0000","last_change":"2023-08-25T04:19:06.798031+0000","last_active":"2023-08-25T04:19:07.800749+0000","last_peered":"2023-08-25T04:19:07.800749+0000","last_clean":"2023-08-25T04:19:07.800749+0000","last_became_active":"2023-08-25T04:19:06.797275+0000","last_became_peered":"2023-08-25T04:19:06.797275+0000","last_unstale":"2023-08-25T04:19:07.800749+0000","last_undegraded":"2023-08-25T04:19:07.800749+0000","last_fullsized":"2023-08-25T04:19:07.800749+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:13:41.159118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992603+0000","last_change":"2023-08-25T04:19:06.805714+0000","last_active":"2023-08-25T04:19:07.992603+0000","last_peered":"2023-08-25T04:19:07.992603+0000","last_clean":"2023-08-25T04:19:07.992603+0000","last_became_active":"2023-08-25T04:19:06.805256+0000","last_became_peered":"2023-08-25T04:19:06.805256+0000","last_unstale":"2023-08-25T04:19:07.992603+0000","last_undegraded":"2023-08-25T04:19:07.992603+0000","last_fullsized":"2023-08-25T04:19:07.992603+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:07:31.026605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.796683+0000","last_change":"2023-08-25T04:19:06.793788+0000","last_active":"2023-08-25T04:19:07.796683+0000","last_peered":"2023-08-25T04:19:07.796683+0000","last_clean":"2023-08-25T04:19:07.796683+0000","last_became_active":"2023-08-25T04:19:06.793243+0000","last_became_peered":"2023-08-25T04:19:06.793243+0000","last_unstale":"2023-08-25T04:19:07.796683+0000","last_undegraded":"2023-08-25T04:19:07.796683+0000","last_fullsized":"2023-08-25T04:19:07.796683+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:00:13.918822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120343+0000","last_change":"2023-08-25T04:19:06.807707+0000","last_active":"2023-08-25T04:19:09.120343+0000","last_peered":"2023-08-25T04:19:09.120343+0000","last_clean":"2023-08-25T04:19:09.120343+0000","last_became_active":"2023-08-25T04:19:06.807373+0000","last_became_peered":"2023-08-25T04:19:06.807373+0000","last_unstale":"2023-08-25T04:19:09.120343+0000","last_undegraded":"2023-08-25T04:19:09.120343+0000","last_fullsized":"2023-08-25T04:19:09.120343+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:42:27.902864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120913+0000","last_change":"2023-08-25T04:19:06.790376+0000","last_active":"2023-08-25T04:19:09.120913+0000","last_peered":"2023-08-25T04:19:09.120913+0000","last_clean":"2023-08-25T04:19:09.120913+0000","last_became_active":"2023-08-25T04:19:06.790019+0000","last_became_peered":"2023-08-25T04:19:06.790019+0000","last_unstale":"2023-08-25T04:19:09.120913+0000","last_undegraded":"2023-08-25T04:19:09.120913+0000","last_fullsized":"2023-08-25T04:19:09.120913+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:05:20.997364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800396+0000","last_change":"2023-08-25T04:19:06.792975+0000","last_active":"2023-08-25T04:19:07.800396+0000","last_peered":"2023-08-25T04:19:07.800396+0000","last_clean":"2023-08-25T04:19:07.800396+0000","last_became_active":"2023-08-25T04:19:06.792706+0000","last_became_peered":"2023-08-25T04:19:06.792706+0000","last_unstale":"2023-08-25T04:19:07.800396+0000","last_undegraded":"2023-08-25T04:19:07.800396+0000","last_fullsized":"2023-08-25T04:19:07.800396+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:38:29.255064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.119936+0000","last_change":"2023-08-25T04:19:06.795936+0000","last_active":"2023-08-25T04:19:09.119936+0000","last_peered":"2023-08-25T04:19:09.119936+0000","last_clean":"2023-08-25T04:19:09.119936+0000","last_became_active":"2023-08-25T04:19:06.795669+0000","last_became_peered":"2023-08-25T04:19:06.795669+0000","last_unstale":"2023-08-25T04:19:09.119936+0000","last_undegraded":"2023-08-25T04:19:09.119936+0000","last_fullsized":"2023-08-25T04:19:09.119936+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:21:36.456902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797236+0000","last_change":"2023-08-25T04:19:06.787913+0000","last_active":"2023-08-25T04:19:07.797236+0000","last_peered":"2023-08-25T04:19:07.797236+0000","last_clean":"2023-08-25T04:19:07.797236+0000","last_became_active":"2023-08-25T04:19:06.787500+0000","last_became_peered":"2023-08-25T04:19:06.787500+0000","last_unstale":"2023-08-25T04:19:07.797236+0000","last_undegraded":"2023-08-25T04:19:07.797236+0000","last_fullsized":"2023-08-25T04:19:07.797236+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:53:05.633120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.119943+0000","last_change":"2023-08-25T04:19:06.799388+0000","last_active":"2023-08-25T04:19:09.119943+0000","last_peered":"2023-08-25T04:19:09.119943+0000","last_clean":"2023-08-25T04:19:09.119943+0000","last_became_active":"2023-08-25T04:19:06.799115+0000","last_became_peered":"2023-08-25T04:19:06.799115+0000","last_unstale":"2023-08-25T04:19:09.119943+0000","last_undegraded":"2023-08-25T04:19:09.119943+0000","last_fullsized":"2023-08-25T04:19:09.119943+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:50:14.521108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797253+0000","last_change":"2023-08-25T04:19:06.793481+0000","last_active":"2023-08-25T04:19:07.797253+0000","last_peered":"2023-08-25T04:19:07.797253+0000","last_clean":"2023-08-25T04:19:07.797253+0000","last_became_active":"2023-08-25T04:19:06.793144+0000","last_became_peered":"2023-08-25T04:19:06.793144+0000","last_unstale":"2023-08-25T04:19:07.797253+0000","last_undegraded":"2023-08-25T04:19:07.797253+0000","last_fullsized":"2023-08-25T04:19:07.797253+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:52:53.685679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992521+0000","last_change":"2023-08-25T04:19:06.807864+0000","last_active":"2023-08-25T04:19:07.992521+0000","last_peered":"2023-08-25T04:19:07.992521+0000","last_clean":"2023-08-25T04:19:07.992521+0000","last_became_active":"2023-08-25T04:19:06.807577+0000","last_became_peered":"2023-08-25T04:19:06.807577+0000","last_unstale":"2023-08-25T04:19:07.992521+0000","last_undegraded":"2023-08-25T04:19:07.992521+0000","last_fullsized":"2023-08-25T04:19:07.992521+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:43:31.509007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992992+0000","last_change":"2023-08-25T04:19:06.806912+0000","last_active":"2023-08-25T04:19:07.992992+0000","last_peered":"2023-08-25T04:19:07.992992+0000","last_clean":"2023-08-25T04:19:07.992992+0000","last_became_active":"2023-08-25T04:19:06.806600+0000","last_became_peered":"2023-08-25T04:19:06.806600+0000","last_unstale":"2023-08-25T04:19:07.992992+0000","last_undegraded":"2023-08-25T04:19:07.992992+0000","last_fullsized":"2023-08-25T04:19:07.992992+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:23:26.660890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646448+0000","last_change":"2023-08-25T04:19:06.806565+0000","last_active":"2023-08-25T04:19:08.646448+0000","last_peered":"2023-08-25T04:19:08.646448+0000","last_clean":"2023-08-25T04:19:08.646448+0000","last_became_active":"2023-08-25T04:19:06.806127+0000","last_became_peered":"2023-08-25T04:19:06.806127+0000","last_unstale":"2023-08-25T04:19:08.646448+0000","last_undegraded":"2023-08-25T04:19:08.646448+0000","last_fullsized":"2023-08-25T04:19:08.646448+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:31:28.616884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797077+0000","last_change":"2023-08-25T04:19:06.793569+0000","last_active":"2023-08-25T04:19:07.797077+0000","last_peered":"2023-08-25T04:19:07.797077+0000","last_clean":"2023-08-25T04:19:07.797077+0000","last_became_active":"2023-08-25T04:19:06.793261+0000","last_became_peered":"2023-08-25T04:19:06.793261+0000","last_unstale":"2023-08-25T04:19:07.797077+0000","last_undegraded":"2023-08-25T04:19:07.797077+0000","last_fullsized":"2023-08-25T04:19:07.797077+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:11:19.156236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120060+0000","last_change":"2023-08-25T04:19:06.805478+0000","last_active":"2023-08-25T04:19:09.120060+0000","last_peered":"2023-08-25T04:19:09.120060+0000","last_clean":"2023-08-25T04:19:09.120060+0000","last_became_active":"2023-08-25T04:19:06.805172+0000","last_became_peered":"2023-08-25T04:19:06.805172+0000","last_unstale":"2023-08-25T04:19:09.120060+0000","last_undegraded":"2023-08-25T04:19:09.120060+0000","last_fullsized":"2023-08-25T04:19:09.120060+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:52:50.367582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992856+0000","last_change":"2023-08-25T04:19:06.812439+0000","last_active":"2023-08-25T04:19:07.992856+0000","last_peered":"2023-08-25T04:19:07.992856+0000","last_clean":"2023-08-25T04:19:07.992856+0000","last_became_active":"2023-08-25T04:19:06.812132+0000","last_became_peered":"2023-08-25T04:19:06.812132+0000","last_unstale":"2023-08-25T04:19:07.992856+0000","last_undegraded":"2023-08-25T04:19:07.992856+0000","last_fullsized":"2023-08-25T04:19:07.992856+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:59:53.411279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.796776+0000","last_change":"2023-08-25T04:19:06.810704+0000","last_active":"2023-08-25T04:19:07.796776+0000","last_peered":"2023-08-25T04:19:07.796776+0000","last_clean":"2023-08-25T04:19:07.796776+0000","last_became_active":"2023-08-25T04:19:06.810401+0000","last_became_peered":"2023-08-25T04:19:06.810401+0000","last_unstale":"2023-08-25T04:19:07.796776+0000","last_undegraded":"2023-08-25T04:19:07.796776+0000","last_fullsized":"2023-08-25T04:19:07.796776+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:05:51.633449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120668+0000","last_change":"2023-08-25T04:19:06.801342+0000","last_active":"2023-08-25T04:19:09.120668+0000","last_peered":"2023-08-25T04:19:09.120668+0000","last_clean":"2023-08-25T04:19:09.120668+0000","last_became_active":"2023-08-25T04:19:06.800925+0000","last_became_peered":"2023-08-25T04:19:06.800925+0000","last_unstale":"2023-08-25T04:19:09.120668+0000","last_undegraded":"2023-08-25T04:19:09.120668+0000","last_fullsized":"2023-08-25T04:19:09.120668+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:56:38.061282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.796786+0000","last_change":"2023-08-25T04:19:06.801799+0000","last_active":"2023-08-25T04:19:07.796786+0000","last_peered":"2023-08-25T04:19:07.796786+0000","last_clean":"2023-08-25T04:19:07.796786+0000","last_became_active":"2023-08-25T04:19:06.801492+0000","last_became_peered":"2023-08-25T04:19:06.801492+0000","last_unstale":"2023-08-25T04:19:07.796786+0000","last_undegraded":"2023-08-25T04:19:07.796786+0000","last_fullsized":"2023-08-25T04:19:07.796786+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:34:25.064236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120669+0000","last_change":"2023-08-25T04:19:06.793218+0000","last_active":"2023-08-25T04:19:09.120669+0000","last_peered":"2023-08-25T04:19:09.120669+0000","last_clean":"2023-08-25T04:19:09.120669+0000","last_became_active":"2023-08-25T04:19:06.792933+0000","last_became_peered":"2023-08-25T04:19:06.792933+0000","last_unstale":"2023-08-25T04:19:09.120669+0000","last_undegraded":"2023-08-25T04:19:09.120669+0000","last_fullsized":"2023-08-25T04:19:09.120669+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:59.643567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"92'4","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120370+0000","last_change":"2023-08-25T04:19:05.803348+0000","last_active":"2023-08-25T04:19:09.120370+0000","last_peered":"2023-08-25T04:19:09.120370+0000","last_clean":"2023-08-25T04:19:09.120370+0000","last_became_active":"2023-08-25T04:19:05.803093+0000","last_became_peered":"2023-08-25T04:19:05.803093+0000","last_unstale":"2023-08-25T04:19:09.120370+0000","last_undegraded":"2023-08-25T04:19:09.120370+0000","last_fullsized":"2023-08-25T04:19:09.120370+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:21:55.237220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992633+0000","last_change":"2023-08-25T04:19:06.805511+0000","last_active":"2023-08-25T04:19:07.992633+0000","last_peered":"2023-08-25T04:19:07.992633+0000","last_clean":"2023-08-25T04:19:07.992633+0000","last_became_active":"2023-08-25T04:19:06.804815+0000","last_became_peered":"2023-08-25T04:19:06.804815+0000","last_unstale":"2023-08-25T04:19:07.992633+0000","last_undegraded":"2023-08-25T04:19:07.992633+0000","last_fullsized":"2023-08-25T04:19:07.992633+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:36:05.491673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"92'1","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797405+0000","last_change":"2023-08-25T04:19:05.796806+0000","last_active":"2023-08-25T04:19:07.797405+0000","last_peered":"2023-08-25T04:19:07.797405+0000","last_clean":"2023-08-25T04:19:07.797405+0000","last_became_active":"2023-08-25T04:19:05.796412+0000","last_became_peered":"2023-08-25T04:19:05.796412+0000","last_unstale":"2023-08-25T04:19:07.797405+0000","last_undegraded":"2023-08-25T04:19:07.797405+0000","last_fullsized":"2023-08-25T04:19:07.797405+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:10:10.867990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797342+0000","last_change":"2023-08-25T04:19:06.800832+0000","last_active":"2023-08-25T04:19:07.797342+0000","last_peered":"2023-08-25T04:19:07.797342+0000","last_clean":"2023-08-25T04:19:07.797342+0000","last_became_active":"2023-08-25T04:19:06.800410+0000","last_became_peered":"2023-08-25T04:19:06.800410+0000","last_unstale":"2023-08-25T04:19:07.797342+0000","last_undegraded":"2023-08-25T04:19:07.797342+0000","last_fullsized":"2023-08-25T04:19:07.797342+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:10:41.379434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"92'2","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797202+0000","last_change":"2023-08-25T04:19:05.799421+0000","last_active":"2023-08-25T04:19:07.797202+0000","last_peered":"2023-08-25T04:19:07.797202+0000","last_clean":"2023-08-25T04:19:07.797202+0000","last_became_active":"2023-08-25T04:19:05.799114+0000","last_became_peered":"2023-08-25T04:19:05.799114+0000","last_unstale":"2023-08-25T04:19:07.797202+0000","last_undegraded":"2023-08-25T04:19:07.797202+0000","last_fullsized":"2023-08-25T04:19:07.797202+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:28:09.669986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797370+0000","last_change":"2023-08-25T04:19:06.789876+0000","last_active":"2023-08-25T04:19:07.797370+0000","last_peered":"2023-08-25T04:19:07.797370+0000","last_clean":"2023-08-25T04:19:07.797370+0000","last_became_active":"2023-08-25T04:19:06.789538+0000","last_became_peered":"2023-08-25T04:19:06.789538+0000","last_unstale":"2023-08-25T04:19:07.797370+0000","last_undegraded":"2023-08-25T04:19:07.797370+0000","last_fullsized":"2023-08-25T04:19:07.797370+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:59:57.455122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"92'2","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118614+0000","last_change":"2023-08-25T04:19:05.793204+0000","last_active":"2023-08-25T04:19:09.118614+0000","last_peered":"2023-08-25T04:19:09.118614+0000","last_clean":"2023-08-25T04:19:09.118614+0000","last_became_active":"2023-08-25T04:19:05.792777+0000","last_became_peered":"2023-08-25T04:19:05.792777+0000","last_unstale":"2023-08-25T04:19:09.118614+0000","last_undegraded":"2023-08-25T04:19:09.118614+0000","last_fullsized":"2023-08-25T04:19:09.118614+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:29:18.313735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992910+0000","last_change":"2023-08-25T04:19:06.808911+0000","last_active":"2023-08-25T04:19:07.992910+0000","last_peered":"2023-08-25T04:19:07.992910+0000","last_clean":"2023-08-25T04:19:07.992910+0000","last_became_active":"2023-08-25T04:19:06.808642+0000","last_became_peered":"2023-08-25T04:19:06.808642+0000","last_unstale":"2023-08-25T04:19:07.992910+0000","last_undegraded":"2023-08-25T04:19:07.992910+0000","last_fullsized":"2023-08-25T04:19:07.992910+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:38:43.810738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"92'1","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797494+0000","last_change":"2023-08-25T04:19:05.793601+0000","last_active":"2023-08-25T04:19:07.797494+0000","last_peered":"2023-08-25T04:19:07.797494+0000","last_clean":"2023-08-25T04:19:07.797494+0000","last_became_active":"2023-08-25T04:19:05.793257+0000","last_became_peered":"2023-08-25T04:19:05.793257+0000","last_unstale":"2023-08-25T04:19:07.797494+0000","last_undegraded":"2023-08-25T04:19:07.797494+0000","last_fullsized":"2023-08-25T04:19:07.797494+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:36.127273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.993001+0000","last_change":"2023-08-25T04:19:06.810689+0000","last_active":"2023-08-25T04:19:07.993001+0000","last_peered":"2023-08-25T04:19:07.993001+0000","last_clean":"2023-08-25T04:19:07.993001+0000","last_became_active":"2023-08-25T04:19:06.809901+0000","last_became_peered":"2023-08-25T04:19:06.809901+0000","last_unstale":"2023-08-25T04:19:07.993001+0000","last_undegraded":"2023-08-25T04:19:07.993001+0000","last_fullsized":"2023-08-25T04:19:07.993001+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:33:28.638377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"92'1","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646223+0000","last_change":"2023-08-25T04:19:05.792191+0000","last_active":"2023-08-25T04:19:08.646223+0000","last_peered":"2023-08-25T04:19:08.646223+0000","last_clean":"2023-08-25T04:19:08.646223+0000","last_became_active":"2023-08-25T04:19:05.791804+0000","last_became_peered":"2023-08-25T04:19:05.791804+0000","last_unstale":"2023-08-25T04:19:08.646223+0000","last_undegraded":"2023-08-25T04:19:08.646223+0000","last_fullsized":"2023-08-25T04:19:08.646223+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:08:49.146959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797709+0000","last_change":"2023-08-25T04:19:06.797933+0000","last_active":"2023-08-25T04:19:07.797709+0000","last_peered":"2023-08-25T04:19:07.797709+0000","last_clean":"2023-08-25T04:19:07.797709+0000","last_became_active":"2023-08-25T04:19:06.797612+0000","last_became_peered":"2023-08-25T04:19:06.797612+0000","last_unstale":"2023-08-25T04:19:07.797709+0000","last_undegraded":"2023-08-25T04:19:07.797709+0000","last_fullsized":"2023-08-25T04:19:07.797709+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:05:13.841755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992749+0000","last_change":"2023-08-25T04:19:05.795442+0000","last_active":"2023-08-25T04:19:07.992749+0000","last_peered":"2023-08-25T04:19:07.992749+0000","last_clean":"2023-08-25T04:19:07.992749+0000","last_became_active":"2023-08-25T04:19:05.795138+0000","last_became_peered":"2023-08-25T04:19:05.795138+0000","last_unstale":"2023-08-25T04:19:07.992749+0000","last_undegraded":"2023-08-25T04:19:07.992749+0000","last_fullsized":"2023-08-25T04:19:07.992749+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:47:12.631302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118700+0000","last_change":"2023-08-25T04:19:06.789154+0000","last_active":"2023-08-25T04:19:09.118700+0000","last_peered":"2023-08-25T04:19:09.118700+0000","last_clean":"2023-08-25T04:19:09.118700+0000","last_became_active":"2023-08-25T04:19:06.788730+0000","last_became_peered":"2023-08-25T04:19:06.788730+0000","last_unstale":"2023-08-25T04:19:09.118700+0000","last_undegraded":"2023-08-25T04:19:09.118700+0000","last_fullsized":"2023-08-25T04:19:09.118700+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:26:57.835309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.119985+0000","last_change":"2023-08-25T04:19:05.797682+0000","last_active":"2023-08-25T04:19:09.119985+0000","last_peered":"2023-08-25T04:19:09.119985+0000","last_clean":"2023-08-25T04:19:09.119985+0000","last_became_active":"2023-08-25T04:19:05.797395+0000","last_became_peered":"2023-08-25T04:19:05.797395+0000","last_unstale":"2023-08-25T04:19:09.119985+0000","last_undegraded":"2023-08-25T04:19:09.119985+0000","last_fullsized":"2023-08-25T04:19:09.119985+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:26:21.525019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992489+0000","last_change":"2023-08-25T04:19:06.804118+0000","last_active":"2023-08-25T04:19:07.992489+0000","last_peered":"2023-08-25T04:19:07.992489+0000","last_clean":"2023-08-25T04:19:07.992489+0000","last_became_active":"2023-08-25T04:19:06.803800+0000","last_became_peered":"2023-08-25T04:19:06.803800+0000","last_unstale":"2023-08-25T04:19:07.992489+0000","last_undegraded":"2023-08-25T04:19:07.992489+0000","last_fullsized":"2023-08-25T04:19:07.992489+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:16:20.222218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797754+0000","last_change":"2023-08-25T04:19:05.795893+0000","last_active":"2023-08-25T04:19:07.797754+0000","last_peered":"2023-08-25T04:19:07.797754+0000","last_clean":"2023-08-25T04:19:07.797754+0000","last_became_active":"2023-08-25T04:19:05.795614+0000","last_became_peered":"2023-08-25T04:19:05.795614+0000","last_unstale":"2023-08-25T04:19:07.797754+0000","last_undegraded":"2023-08-25T04:19:07.797754+0000","last_fullsized":"2023-08-25T04:19:07.797754+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:57:52.441367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646112+0000","last_change":"2023-08-25T04:19:06.794897+0000","last_active":"2023-08-25T04:19:08.646112+0000","last_peered":"2023-08-25T04:19:08.646112+0000","last_clean":"2023-08-25T04:19:08.646112+0000","last_became_active":"2023-08-25T04:19:06.794597+0000","last_became_peered":"2023-08-25T04:19:06.794597+0000","last_unstale":"2023-08-25T04:19:08.646112+0000","last_undegraded":"2023-08-25T04:19:08.646112+0000","last_fullsized":"2023-08-25T04:19:08.646112+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:18:30.397780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646492+0000","last_change":"2023-08-25T04:19:05.790893+0000","last_active":"2023-08-25T04:19:08.646492+0000","last_peered":"2023-08-25T04:19:08.646492+0000","last_clean":"2023-08-25T04:19:08.646492+0000","last_became_active":"2023-08-25T04:19:05.790605+0000","last_became_peered":"2023-08-25T04:19:05.790605+0000","last_unstale":"2023-08-25T04:19:08.646492+0000","last_undegraded":"2023-08-25T04:19:08.646492+0000","last_fullsized":"2023-08-25T04:19:08.646492+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:13:58.362289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800715+0000","last_change":"2023-08-25T04:19:06.800985+0000","last_active":"2023-08-25T04:19:07.800715+0000","last_peered":"2023-08-25T04:19:07.800715+0000","last_clean":"2023-08-25T04:19:07.800715+0000","last_became_active":"2023-08-25T04:19:06.797754+0000","last_became_peered":"2023-08-25T04:19:06.797754+0000","last_unstale":"2023-08-25T04:19:07.800715+0000","last_undegraded":"2023-08-25T04:19:07.800715+0000","last_fullsized":"2023-08-25T04:19:07.800715+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:38:16.085475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"92'3","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120229+0000","last_change":"2023-08-25T04:19:05.801675+0000","last_active":"2023-08-25T04:19:09.120229+0000","last_peered":"2023-08-25T04:19:09.120229+0000","last_clean":"2023-08-25T04:19:09.120229+0000","last_became_active":"2023-08-25T04:19:05.801405+0000","last_became_peered":"2023-08-25T04:19:05.801405+0000","last_unstale":"2023-08-25T04:19:09.120229+0000","last_undegraded":"2023-08-25T04:19:09.120229+0000","last_fullsized":"2023-08-25T04:19:09.120229+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:50:05.808878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120828+0000","last_change":"2023-08-25T04:19:06.814895+0000","last_active":"2023-08-25T04:19:09.120828+0000","last_peered":"2023-08-25T04:19:09.120828+0000","last_clean":"2023-08-25T04:19:09.120828+0000","last_became_active":"2023-08-25T04:19:06.814575+0000","last_became_peered":"2023-08-25T04:19:06.814575+0000","last_unstale":"2023-08-25T04:19:09.120828+0000","last_undegraded":"2023-08-25T04:19:09.120828+0000","last_fullsized":"2023-08-25T04:19:09.120828+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:52:11.696614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"92'6","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118553+0000","last_change":"2023-08-25T04:19:05.785196+0000","last_active":"2023-08-25T04:19:09.118553+0000","last_peered":"2023-08-25T04:19:09.118553+0000","last_clean":"2023-08-25T04:19:09.118553+0000","last_became_active":"2023-08-25T04:19:05.784851+0000","last_became_peered":"2023-08-25T04:19:05.784851+0000","last_unstale":"2023-08-25T04:19:09.118553+0000","last_undegraded":"2023-08-25T04:19:09.118553+0000","last_fullsized":"2023-08-25T04:19:09.118553+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:46:02.698756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646428+0000","last_change":"2023-08-25T04:19:06.799182+0000","last_active":"2023-08-25T04:19:08.646428+0000","last_peered":"2023-08-25T04:19:08.646428+0000","last_clean":"2023-08-25T04:19:08.646428+0000","last_became_active":"2023-08-25T04:19:06.798895+0000","last_became_peered":"2023-08-25T04:19:06.798895+0000","last_unstale":"2023-08-25T04:19:08.646428+0000","last_undegraded":"2023-08-25T04:19:08.646428+0000","last_fullsized":"2023-08-25T04:19:08.646428+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:08:55.045698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"92'2","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646234+0000","last_change":"2023-08-25T04:19:05.793029+0000","last_active":"2023-08-25T04:19:08.646234+0000","last_peered":"2023-08-25T04:19:08.646234+0000","last_clean":"2023-08-25T04:19:08.646234+0000","last_became_active":"2023-08-25T04:19:05.792764+0000","last_became_peered":"2023-08-25T04:19:05.792764+0000","last_unstale":"2023-08-25T04:19:08.646234+0000","last_undegraded":"2023-08-25T04:19:08.646234+0000","last_fullsized":"2023-08-25T04:19:08.646234+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:32:58.130183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118578+0000","last_change":"2023-08-25T04:19:06.789506+0000","last_active":"2023-08-25T04:19:09.118578+0000","last_peered":"2023-08-25T04:19:09.118578+0000","last_clean":"2023-08-25T04:19:09.118578+0000","last_became_active":"2023-08-25T04:19:06.789231+0000","last_became_peered":"2023-08-25T04:19:06.789231+0000","last_unstale":"2023-08-25T04:19:09.118578+0000","last_undegraded":"2023-08-25T04:19:09.118578+0000","last_fullsized":"2023-08-25T04:19:09.118578+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:23:02.049015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.796840+0000","last_change":"2023-08-25T04:19:05.796702+0000","last_active":"2023-08-25T04:19:07.796840+0000","last_peered":"2023-08-25T04:19:07.796840+0000","last_clean":"2023-08-25T04:19:07.796840+0000","last_became_active":"2023-08-25T04:19:05.795927+0000","last_became_peered":"2023-08-25T04:19:05.795927+0000","last_unstale":"2023-08-25T04:19:07.796840+0000","last_undegraded":"2023-08-25T04:19:07.796840+0000","last_fullsized":"2023-08-25T04:19:07.796840+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:29:52.741083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118703+0000","last_change":"2023-08-25T04:19:06.796812+0000","last_active":"2023-08-25T04:19:09.118703+0000","last_peered":"2023-08-25T04:19:09.118703+0000","last_clean":"2023-08-25T04:19:09.118703+0000","last_became_active":"2023-08-25T04:19:06.796488+0000","last_became_peered":"2023-08-25T04:19:06.796488+0000","last_unstale":"2023-08-25T04:19:09.118703+0000","last_undegraded":"2023-08-25T04:19:09.118703+0000","last_fullsized":"2023-08-25T04:19:09.118703+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:26:10.267546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.119824+0000","last_change":"2023-08-25T04:19:05.794685+0000","last_active":"2023-08-25T04:19:09.119824+0000","last_peered":"2023-08-25T04:19:09.119824+0000","last_clean":"2023-08-25T04:19:09.119824+0000","last_became_active":"2023-08-25T04:19:05.794408+0000","last_became_peered":"2023-08-25T04:19:05.794408+0000","last_unstale":"2023-08-25T04:19:09.119824+0000","last_undegraded":"2023-08-25T04:19:09.119824+0000","last_fullsized":"2023-08-25T04:19:09.119824+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:01.173011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118716+0000","last_change":"2023-08-25T04:19:06.795860+0000","last_active":"2023-08-25T04:19:09.118716+0000","last_peered":"2023-08-25T04:19:09.118716+0000","last_clean":"2023-08-25T04:19:09.118716+0000","last_became_active":"2023-08-25T04:19:06.795507+0000","last_became_peered":"2023-08-25T04:19:06.795507+0000","last_unstale":"2023-08-25T04:19:09.118716+0000","last_undegraded":"2023-08-25T04:19:09.118716+0000","last_fullsized":"2023-08-25T04:19:09.118716+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:42:36.972680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"92'8","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992857+0000","last_change":"2023-08-25T04:19:05.801498+0000","last_active":"2023-08-25T04:19:07.992857+0000","last_peered":"2023-08-25T04:19:07.992857+0000","last_clean":"2023-08-25T04:19:07.992857+0000","last_became_active":"2023-08-25T04:19:05.801196+0000","last_became_peered":"2023-08-25T04:19:05.801196+0000","last_unstale":"2023-08-25T04:19:07.992857+0000","last_undegraded":"2023-08-25T04:19:07.992857+0000","last_fullsized":"2023-08-25T04:19:07.992857+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:02:57.649655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797041+0000","last_change":"2023-08-25T04:19:06.800402+0000","last_active":"2023-08-25T04:19:07.797041+0000","last_peered":"2023-08-25T04:19:07.797041+0000","last_clean":"2023-08-25T04:19:07.797041+0000","last_became_active":"2023-08-25T04:19:06.798159+0000","last_became_peered":"2023-08-25T04:19:06.798159+0000","last_unstale":"2023-08-25T04:19:07.797041+0000","last_undegraded":"2023-08-25T04:19:07.797041+0000","last_fullsized":"2023-08-25T04:19:07.797041+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:09:50.378669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"92'2","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646447+0000","last_change":"2023-08-25T04:19:05.798655+0000","last_active":"2023-08-25T04:19:08.646447+0000","last_peered":"2023-08-25T04:19:08.646447+0000","last_clean":"2023-08-25T04:19:08.646447+0000","last_became_active":"2023-08-25T04:19:05.798355+0000","last_became_peered":"2023-08-25T04:19:05.798355+0000","last_unstale":"2023-08-25T04:19:08.646447+0000","last_undegraded":"2023-08-25T04:19:08.646447+0000","last_fullsized":"2023-08-25T04:19:08.646447+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:07:18.926667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118399+0000","last_change":"2023-08-25T04:19:06.795611+0000","last_active":"2023-08-25T04:19:09.118399+0000","last_peered":"2023-08-25T04:19:09.118399+0000","last_clean":"2023-08-25T04:19:09.118399+0000","last_became_active":"2023-08-25T04:19:06.795266+0000","last_became_peered":"2023-08-25T04:19:06.795266+0000","last_unstale":"2023-08-25T04:19:09.118399+0000","last_undegraded":"2023-08-25T04:19:09.118399+0000","last_fullsized":"2023-08-25T04:19:09.118399+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:05:13.841755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.993085+0000","last_change":"2023-08-25T04:19:05.800768+0000","last_active":"2023-08-25T04:19:07.993085+0000","last_peered":"2023-08-25T04:19:07.993085+0000","last_clean":"2023-08-25T04:19:07.993085+0000","last_became_active":"2023-08-25T04:19:05.800468+0000","last_became_peered":"2023-08-25T04:19:05.800468+0000","last_unstale":"2023-08-25T04:19:07.993085+0000","last_undegraded":"2023-08-25T04:19:07.993085+0000","last_fullsized":"2023-08-25T04:19:07.993085+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:40:17.969894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797405+0000","last_change":"2023-08-25T04:19:06.793569+0000","last_active":"2023-08-25T04:19:07.797405+0000","last_peered":"2023-08-25T04:19:07.797405+0000","last_clean":"2023-08-25T04:19:07.797405+0000","last_became_active":"2023-08-25T04:19:06.793284+0000","last_became_peered":"2023-08-25T04:19:06.793284+0000","last_unstale":"2023-08-25T04:19:07.797405+0000","last_undegraded":"2023-08-25T04:19:07.797405+0000","last_fullsized":"2023-08-25T04:19:07.797405+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:11:24.568378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797439+0000","last_change":"2023-08-25T04:19:05.792758+0000","last_active":"2023-08-25T04:19:07.797439+0000","last_peered":"2023-08-25T04:19:07.797439+0000","last_clean":"2023-08-25T04:19:07.797439+0000","last_became_active":"2023-08-25T04:19:05.792491+0000","last_became_peered":"2023-08-25T04:19:05.792491+0000","last_unstale":"2023-08-25T04:19:07.797439+0000","last_undegraded":"2023-08-25T04:19:07.797439+0000","last_fullsized":"2023-08-25T04:19:07.797439+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:52:24.044017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992872+0000","last_change":"2023-08-25T04:19:06.803545+0000","last_active":"2023-08-25T04:19:07.992872+0000","last_peered":"2023-08-25T04:19:07.992872+0000","last_clean":"2023-08-25T04:19:07.992872+0000","last_became_active":"2023-08-25T04:19:06.803259+0000","last_became_peered":"2023-08-25T04:19:06.803259+0000","last_unstale":"2023-08-25T04:19:07.992872+0000","last_undegraded":"2023-08-25T04:19:07.992872+0000","last_fullsized":"2023-08-25T04:19:07.992872+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:08.666434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797186+0000","last_change":"2023-08-25T04:19:05.795779+0000","last_active":"2023-08-25T04:19:07.797186+0000","last_peered":"2023-08-25T04:19:07.797186+0000","last_clean":"2023-08-25T04:19:07.797186+0000","last_became_active":"2023-08-25T04:19:05.795504+0000","last_became_peered":"2023-08-25T04:19:05.795504+0000","last_unstale":"2023-08-25T04:19:07.797186+0000","last_undegraded":"2023-08-25T04:19:07.797186+0000","last_fullsized":"2023-08-25T04:19:07.797186+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:05:06.348539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118350+0000","last_change":"2023-08-25T04:19:06.795930+0000","last_active":"2023-08-25T04:19:09.118350+0000","last_peered":"2023-08-25T04:19:09.118350+0000","last_clean":"2023-08-25T04:19:09.118350+0000","last_became_active":"2023-08-25T04:19:06.795414+0000","last_became_peered":"2023-08-25T04:19:06.795414+0000","last_unstale":"2023-08-25T04:19:09.118350+0000","last_undegraded":"2023-08-25T04:19:09.118350+0000","last_fullsized":"2023-08-25T04:19:09.118350+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:37.144913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118268+0000","last_change":"2023-08-25T04:19:05.790574+0000","last_active":"2023-08-25T04:19:09.118268+0000","last_peered":"2023-08-25T04:19:09.118268+0000","last_clean":"2023-08-25T04:19:09.118268+0000","last_became_active":"2023-08-25T04:19:05.790235+0000","last_became_peered":"2023-08-25T04:19:05.790235+0000","last_unstale":"2023-08-25T04:19:09.118268+0000","last_undegraded":"2023-08-25T04:19:09.118268+0000","last_fullsized":"2023-08-25T04:19:09.118268+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:59:56.437481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118487+0000","last_change":"2023-08-25T04:19:06.788969+0000","last_active":"2023-08-25T04:19:09.118487+0000","last_peered":"2023-08-25T04:19:09.118487+0000","last_clean":"2023-08-25T04:19:09.118487+0000","last_became_active":"2023-08-25T04:19:06.788620+0000","last_became_peered":"2023-08-25T04:19:06.788620+0000","last_unstale":"2023-08-25T04:19:09.118487+0000","last_undegraded":"2023-08-25T04:19:09.118487+0000","last_fullsized":"2023-08-25T04:19:09.118487+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:51:11.868463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120136+0000","last_change":"2023-08-25T04:19:05.796040+0000","last_active":"2023-08-25T04:19:09.120136+0000","last_peered":"2023-08-25T04:19:09.120136+0000","last_clean":"2023-08-25T04:19:09.120136+0000","last_became_active":"2023-08-25T04:19:05.795722+0000","last_became_peered":"2023-08-25T04:19:05.795722+0000","last_unstale":"2023-08-25T04:19:09.120136+0000","last_undegraded":"2023-08-25T04:19:09.120136+0000","last_fullsized":"2023-08-25T04:19:09.120136+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:25:50.855519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120981+0000","last_change":"2023-08-25T04:19:06.814859+0000","last_active":"2023-08-25T04:19:09.120981+0000","last_peered":"2023-08-25T04:19:09.120981+0000","last_clean":"2023-08-25T04:19:09.120981+0000","last_became_active":"2023-08-25T04:19:06.814459+0000","last_became_peered":"2023-08-25T04:19:06.814459+0000","last_unstale":"2023-08-25T04:19:09.120981+0000","last_undegraded":"2023-08-25T04:19:09.120981+0000","last_fullsized":"2023-08-25T04:19:09.120981+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:09:38.684082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118518+0000","last_change":"2023-08-25T04:19:05.787330+0000","last_active":"2023-08-25T04:19:09.118518+0000","last_peered":"2023-08-25T04:19:09.118518+0000","last_clean":"2023-08-25T04:19:09.118518+0000","last_became_active":"2023-08-25T04:19:05.787029+0000","last_became_peered":"2023-08-25T04:19:05.787029+0000","last_unstale":"2023-08-25T04:19:09.118518+0000","last_undegraded":"2023-08-25T04:19:09.118518+0000","last_fullsized":"2023-08-25T04:19:09.118518+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:51:04.868435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.121148+0000","last_change":"2023-08-25T04:19:06.794380+0000","last_active":"2023-08-25T04:19:09.121148+0000","last_peered":"2023-08-25T04:19:09.121148+0000","last_clean":"2023-08-25T04:19:09.121148+0000","last_became_active":"2023-08-25T04:19:06.794114+0000","last_became_peered":"2023-08-25T04:19:06.794114+0000","last_unstale":"2023-08-25T04:19:09.121148+0000","last_undegraded":"2023-08-25T04:19:09.121148+0000","last_fullsized":"2023-08-25T04:19:09.121148+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:33.985591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120602+0000","last_change":"2023-08-25T04:19:05.796058+0000","last_active":"2023-08-25T04:19:09.120602+0000","last_peered":"2023-08-25T04:19:09.120602+0000","last_clean":"2023-08-25T04:19:09.120602+0000","last_became_active":"2023-08-25T04:19:05.795793+0000","last_became_peered":"2023-08-25T04:19:05.795793+0000","last_unstale":"2023-08-25T04:19:09.120602+0000","last_undegraded":"2023-08-25T04:19:09.120602+0000","last_fullsized":"2023-08-25T04:19:09.120602+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:44:05.626322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797329+0000","last_change":"2023-08-25T04:19:06.796635+0000","last_active":"2023-08-25T04:19:07.797329+0000","last_peered":"2023-08-25T04:19:07.797329+0000","last_clean":"2023-08-25T04:19:07.797329+0000","last_became_active":"2023-08-25T04:19:06.796351+0000","last_became_peered":"2023-08-25T04:19:06.796351+0000","last_unstale":"2023-08-25T04:19:07.797329+0000","last_undegraded":"2023-08-25T04:19:07.797329+0000","last_fullsized":"2023-08-25T04:19:07.797329+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:13:30.719086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800845+0000","last_change":"2023-08-25T04:19:05.789915+0000","last_active":"2023-08-25T04:19:07.800845+0000","last_peered":"2023-08-25T04:19:07.800845+0000","last_clean":"2023-08-25T04:19:07.800845+0000","last_became_active":"2023-08-25T04:19:05.789631+0000","last_became_peered":"2023-08-25T04:19:05.789631+0000","last_unstale":"2023-08-25T04:19:07.800845+0000","last_undegraded":"2023-08-25T04:19:07.800845+0000","last_fullsized":"2023-08-25T04:19:07.800845+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:38.229512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"81'179","reported_seq":519,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.796947+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:19:07.796947+0000","last_peered":"2023-08-25T04:19:07.796947+0000","last_clean":"2023-08-25T04:19:07.796947+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:19:07.796947+0000","last_undegraded":"2023-08-25T04:19:07.796947+0000","last_fullsized":"2023-08-25T04:19:07.796947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:30:07.759658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":656,"num_read_kb":1306,"num_write":271,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":138,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.645983+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:19:08.645983+0000","last_peered":"2023-08-25T04:19:08.645983+0000","last_clean":"2023-08-25T04:19:08.645983+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:19:08.645983+0000","last_undegraded":"2023-08-25T04:19:08.645983+0000","last_fullsized":"2023-08-25T04:19:08.645983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:33:29.654937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.993068+0000","last_change":"2023-08-25T04:19:06.806675+0000","last_active":"2023-08-25T04:19:07.993068+0000","last_peered":"2023-08-25T04:19:07.993068+0000","last_clean":"2023-08-25T04:19:07.993068+0000","last_became_active":"2023-08-25T04:19:06.806004+0000","last_became_peered":"2023-08-25T04:19:06.806004+0000","last_unstale":"2023-08-25T04:19:07.993068+0000","last_undegraded":"2023-08-25T04:19:07.993068+0000","last_fullsized":"2023-08-25T04:19:07.993068+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:17.162595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800253+0000","last_change":"2023-08-25T04:19:05.788136+0000","last_active":"2023-08-25T04:19:07.800253+0000","last_peered":"2023-08-25T04:19:07.800253+0000","last_clean":"2023-08-25T04:19:07.800253+0000","last_became_active":"2023-08-25T04:19:05.787861+0000","last_became_peered":"2023-08-25T04:19:05.787861+0000","last_unstale":"2023-08-25T04:19:07.800253+0000","last_undegraded":"2023-08-25T04:19:07.800253+0000","last_fullsized":"2023-08-25T04:19:07.800253+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:16:01.758215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":143,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.796921+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:19:07.796921+0000","last_peered":"2023-08-25T04:19:07.796921+0000","last_clean":"2023-08-25T04:19:07.796921+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:19:07.796921+0000","last_undegraded":"2023-08-25T04:19:07.796921+0000","last_fullsized":"2023-08-25T04:19:07.796921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:25:55.859207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118869+0000","last_change":"2023-08-25T04:19:06.794416+0000","last_active":"2023-08-25T04:19:09.118869+0000","last_peered":"2023-08-25T04:19:09.118869+0000","last_clean":"2023-08-25T04:19:09.118869+0000","last_became_active":"2023-08-25T04:19:06.793607+0000","last_became_peered":"2023-08-25T04:19:06.793607+0000","last_unstale":"2023-08-25T04:19:09.118869+0000","last_undegraded":"2023-08-25T04:19:09.118869+0000","last_fullsized":"2023-08-25T04:19:09.118869+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:03:58.982642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800470+0000","last_change":"2023-08-25T04:19:05.787819+0000","last_active":"2023-08-25T04:19:07.800470+0000","last_peered":"2023-08-25T04:19:07.800470+0000","last_clean":"2023-08-25T04:19:07.800470+0000","last_became_active":"2023-08-25T04:19:05.787425+0000","last_became_peered":"2023-08-25T04:19:05.787425+0000","last_unstale":"2023-08-25T04:19:07.800470+0000","last_undegraded":"2023-08-25T04:19:07.800470+0000","last_fullsized":"2023-08-25T04:19:07.800470+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:47:57.720421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":142,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.119843+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:19:09.119843+0000","last_peered":"2023-08-25T04:19:09.119843+0000","last_clean":"2023-08-25T04:19:09.119843+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:19:09.119843+0000","last_undegraded":"2023-08-25T04:19:09.119843+0000","last_fullsized":"2023-08-25T04:19:09.119843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:28:05.031810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992877+0000","last_change":"2023-08-25T04:19:06.808432+0000","last_active":"2023-08-25T04:19:07.992877+0000","last_peered":"2023-08-25T04:19:07.992877+0000","last_clean":"2023-08-25T04:19:07.992877+0000","last_became_active":"2023-08-25T04:19:06.808103+0000","last_became_peered":"2023-08-25T04:19:06.808103+0000","last_unstale":"2023-08-25T04:19:07.992877+0000","last_undegraded":"2023-08-25T04:19:07.992877+0000","last_fullsized":"2023-08-25T04:19:07.992877+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:18:28.595821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"92'2","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800561+0000","last_change":"2023-08-25T04:19:05.798088+0000","last_active":"2023-08-25T04:19:07.800561+0000","last_peered":"2023-08-25T04:19:07.800561+0000","last_clean":"2023-08-25T04:19:07.800561+0000","last_became_active":"2023-08-25T04:19:05.797713+0000","last_became_peered":"2023-08-25T04:19:05.797713+0000","last_unstale":"2023-08-25T04:19:07.800561+0000","last_undegraded":"2023-08-25T04:19:07.800561+0000","last_fullsized":"2023-08-25T04:19:07.800561+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:51:15.650436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":138,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.645988+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:19:08.645988+0000","last_peered":"2023-08-25T04:19:08.645988+0000","last_clean":"2023-08-25T04:19:08.645988+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:19:08.645988+0000","last_undegraded":"2023-08-25T04:19:08.645988+0000","last_fullsized":"2023-08-25T04:19:08.645988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:57:05.345769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120206+0000","last_change":"2023-08-25T04:19:06.809519+0000","last_active":"2023-08-25T04:19:09.120206+0000","last_peered":"2023-08-25T04:19:09.120206+0000","last_clean":"2023-08-25T04:19:09.120206+0000","last_became_active":"2023-08-25T04:19:06.809252+0000","last_became_peered":"2023-08-25T04:19:06.809252+0000","last_unstale":"2023-08-25T04:19:09.120206+0000","last_undegraded":"2023-08-25T04:19:09.120206+0000","last_fullsized":"2023-08-25T04:19:09.120206+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:46:43.910124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"92'1","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120292+0000","last_change":"2023-08-25T04:19:05.797620+0000","last_active":"2023-08-25T04:19:09.120292+0000","last_peered":"2023-08-25T04:19:09.120292+0000","last_clean":"2023-08-25T04:19:09.120292+0000","last_became_active":"2023-08-25T04:19:05.797319+0000","last_became_peered":"2023-08-25T04:19:05.797319+0000","last_unstale":"2023-08-25T04:19:09.120292+0000","last_undegraded":"2023-08-25T04:19:09.120292+0000","last_fullsized":"2023-08-25T04:19:09.120292+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:58:00.877612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":156,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120826+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:19:09.120826+0000","last_peered":"2023-08-25T04:19:09.120826+0000","last_clean":"2023-08-25T04:19:09.120826+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:19:09.120826+0000","last_undegraded":"2023-08-25T04:19:09.120826+0000","last_fullsized":"2023-08-25T04:19:09.120826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:21:57.892797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800532+0000","last_change":"2023-08-25T04:19:06.797823+0000","last_active":"2023-08-25T04:19:07.800532+0000","last_peered":"2023-08-25T04:19:07.800532+0000","last_clean":"2023-08-25T04:19:07.800532+0000","last_became_active":"2023-08-25T04:19:06.797336+0000","last_became_peered":"2023-08-25T04:19:06.797336+0000","last_unstale":"2023-08-25T04:19:07.800532+0000","last_undegraded":"2023-08-25T04:19:07.800532+0000","last_fullsized":"2023-08-25T04:19:07.800532+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:19:37.299333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120739+0000","last_change":"2023-08-25T04:19:05.796924+0000","last_active":"2023-08-25T04:19:09.120739+0000","last_peered":"2023-08-25T04:19:09.120739+0000","last_clean":"2023-08-25T04:19:09.120739+0000","last_became_active":"2023-08-25T04:19:05.796608+0000","last_became_peered":"2023-08-25T04:19:05.796608+0000","last_unstale":"2023-08-25T04:19:09.120739+0000","last_undegraded":"2023-08-25T04:19:09.120739+0000","last_fullsized":"2023-08-25T04:19:09.120739+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:05:34.802200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797513+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:19:07.797513+0000","last_peered":"2023-08-25T04:19:07.797513+0000","last_clean":"2023-08-25T04:19:07.797513+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:19:07.797513+0000","last_undegraded":"2023-08-25T04:19:07.797513+0000","last_fullsized":"2023-08-25T04:19:07.797513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:06:31.060482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800190+0000","last_change":"2023-08-25T04:19:06.791285+0000","last_active":"2023-08-25T04:19:07.800190+0000","last_peered":"2023-08-25T04:19:07.800190+0000","last_clean":"2023-08-25T04:19:07.800190+0000","last_became_active":"2023-08-25T04:19:06.790990+0000","last_became_peered":"2023-08-25T04:19:06.790990+0000","last_unstale":"2023-08-25T04:19:07.800190+0000","last_undegraded":"2023-08-25T04:19:07.800190+0000","last_fullsized":"2023-08-25T04:19:07.800190+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:18:51.462263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"92'1","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797888+0000","last_change":"2023-08-25T04:19:05.799471+0000","last_active":"2023-08-25T04:19:07.797888+0000","last_peered":"2023-08-25T04:19:07.797888+0000","last_clean":"2023-08-25T04:19:07.797888+0000","last_became_active":"2023-08-25T04:19:05.798984+0000","last_became_peered":"2023-08-25T04:19:05.798984+0000","last_unstale":"2023-08-25T04:19:07.797888+0000","last_undegraded":"2023-08-25T04:19:07.797888+0000","last_fullsized":"2023-08-25T04:19:07.797888+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:06:40.301579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":156,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.121068+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:19:09.121068+0000","last_peered":"2023-08-25T04:19:09.121068+0000","last_clean":"2023-08-25T04:19:09.121068+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:19:09.121068+0000","last_undegraded":"2023-08-25T04:19:09.121068+0000","last_fullsized":"2023-08-25T04:19:09.121068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:31:19.603961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.119762+0000","last_change":"2023-08-25T04:19:06.808048+0000","last_active":"2023-08-25T04:19:09.119762+0000","last_peered":"2023-08-25T04:19:09.119762+0000","last_clean":"2023-08-25T04:19:09.119762+0000","last_became_active":"2023-08-25T04:19:06.807064+0000","last_became_peered":"2023-08-25T04:19:06.807064+0000","last_unstale":"2023-08-25T04:19:09.119762+0000","last_undegraded":"2023-08-25T04:19:09.119762+0000","last_fullsized":"2023-08-25T04:19:09.119762+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:47:17.561647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"92'2","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797742+0000","last_change":"2023-08-25T04:19:05.797775+0000","last_active":"2023-08-25T04:19:07.797742+0000","last_peered":"2023-08-25T04:19:07.797742+0000","last_clean":"2023-08-25T04:19:07.797742+0000","last_became_active":"2023-08-25T04:19:05.797295+0000","last_became_peered":"2023-08-25T04:19:05.797295+0000","last_unstale":"2023-08-25T04:19:07.797742+0000","last_undegraded":"2023-08-25T04:19:07.797742+0000","last_fullsized":"2023-08-25T04:19:07.797742+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:51:10.850823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":158,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118804+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:19:09.118804+0000","last_peered":"2023-08-25T04:19:09.118804+0000","last_clean":"2023-08-25T04:19:09.118804+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:19:09.118804+0000","last_undegraded":"2023-08-25T04:19:09.118804+0000","last_fullsized":"2023-08-25T04:19:09.118804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:01:56.920057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":656,"num_read_kb":1306,"num_write":271,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509637,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46760,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325080,"statfs":{"total":96636764160,"available":96588881920,"internally_reserved":0,"allocated":1724416,"data_stored":1146476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.45200000000000001,"5min":0.39600000000000002,"15min":0.29199999999999998},"max":{"1min":0.88800000000000001,"5min":0.996,"15min":1.0189999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.68300000000000005}]},{"osd":1,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.42699999999999999},"max":{"1min":0.88,"5min":1.0149999999999999,"15min":1.034},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.47099999999999997,"5min":0.44700000000000001,"15min":0.374},"max":{"1min":0.89600000000000002,"5min":0.96099999999999997,"15min":1.036},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51700000000000002,"5min":0.42299999999999999,"15min":0.34899999999999998},"max":{"1min":0.94299999999999995,"5min":0.94499999999999995,"15min":1.018},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.54400000000000004,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":0.92300000000000004,"5min":0.98699999999999999,"15min":0.999},"last":0.55600000000000005}]},{"osd":3,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.55000000000000004,"5min":0.47799999999999998,"15min":0.41899999999999998},"max":{"1min":0.90100000000000002,"5min":0.92900000000000005,"15min":0.98399999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.754,"15min":0.75600000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.432},"max":{"1min":1.012,"5min":1.04,"15min":1.0449999999999999},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41599999999999998,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.82599999999999996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":0.90400000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.49199999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60799999999999998,"15min":0.61899999999999999},"min":{"1min":0.46300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.96799999999999997,"5min":0.99199999999999999,"15min":0.998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.48699999999999999,"5min":0.41099999999999998,"15min":0.40000000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.0349999999999999},"last":0.626}]},{"osd":6,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.436},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.0620000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42399999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66700000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509637,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1138688,"data_stored":557698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68600000000000005,"15min":0.70699999999999996},"min":{"1min":0.46300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97599999999999998,"5min":1.0089999999999999,"15min":1.0369999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68500000000000005,"15min":0.69799999999999995},"min":{"1min":0.46800000000000003,"5min":0.40400000000000003,"15min":0.33800000000000002},"max":{"1min":0.91900000000000004,"5min":0.96899999999999997,"15min":1.071},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.73099999999999998},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.1559999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.59699999999999998,"5min":0.495,"15min":0.47199999999999998},"max":{"1min":0.93500000000000005,"5min":0.996,"15min":1.077},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.47999999999999998,"5min":0.44,"15min":0.434},"max":{"1min":0.95199999999999996,"5min":0.98399999999999999,"15min":1.139},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.56299999999999994,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96099999999999997,"5min":1.0569999999999999,"15min":1.117},"last":0.65400000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.50600000000000001,"15min":0.46899999999999997},"max":{"1min":0.93400000000000005,"5min":1.0600000000000001,"15min":1.077},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90900000000000003,"5min":1.075,"15min":1.679},"last":0.73299999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.60099999999999998},"min":{"1min":0.42999999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93000000000000005,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":0.86799999999999999,"5min":0.92900000000000005,"15min":1.306},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.56999999999999995,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":1.1120000000000001,"15min":1.5589999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.65300000000000002,"15min":0.66600000000000004},"min":{"1min":0.51400000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86699999999999999,"5min":1.032,"15min":1.1950000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.48799999999999999,"5min":0.44700000000000001,"15min":0.41799999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.4099999999999999},"last":0.69499999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542340,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":549467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68200000000000005,"15min":0.70999999999999996},"min":{"1min":0.55800000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88500000000000001,"5min":0.94999999999999996,"15min":1.018},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.57499999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86699999999999999,"5min":0.995,"15min":1.0409999999999999},"last":0.81999999999999995}]},{"osd":1,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72299999999999998,"15min":0.73699999999999999},"min":{"1min":0.52100000000000002,"5min":0.43099999999999999,"15min":0.36499999999999999},"max":{"1min":0.878,"5min":0.98699999999999999,"15min":0.99399999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.56899999999999995,"5min":0.47599999999999998,"15min":0.46200000000000002},"max":{"1min":0.90400000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.90400000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.42999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88500000000000001,"5min":0.97499999999999998,"15min":1.0269999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.55300000000000005,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.2290000000000001},"last":0.92600000000000005}]},{"osd":3,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.59199999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92100000000000004,"5min":0.94199999999999995,"15min":1.4590000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.76600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.018,"15min":1.1479999999999999},"last":1.028}]},{"osd":4,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.67000000000000004,"5min":0.97099999999999997,"15min":1.038},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.79600000000000004,"5min":1.018,"15min":1.018},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.48299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":1.256},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.50800000000000001,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":0.90400000000000003,"5min":0.98299999999999998,"15min":1.4650000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61199999999999999,"15min":0.626},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.90900000000000003,"5min":1.002,"15min":1.2769999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69299999999999995,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":0.80000000000000004,"5min":0.96899999999999997,"15min":1.1819999999999999},"last":0.71899999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542340,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36464,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335376,"statfs":{"total":96636764160,"available":96599425024,"internally_reserved":0,"allocated":1146880,"data_stored":557802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":0.70599999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.86599999999999999,"5min":0.99299999999999999,"15min":1.2649999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.45500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85199999999999998,"5min":0.878,"15min":1.1639999999999999},"last":0.48599999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.45400000000000001,"5min":0.45100000000000001,"15min":0.36199999999999999},"max":{"1min":0.98399999999999999,"5min":1.0189999999999999,"15min":1.0449999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.47199999999999998,"15min":0.39100000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.74399999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.34000000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.67400000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.45100000000000001},"max":{"1min":0.91100000000000003,"5min":0.98299999999999998,"15min":1.048},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.76300000000000001,"15min":0.75900000000000001},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.48399999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38300000000000001,"5min":0.378,"15min":0.32200000000000001},"max":{"1min":0.77900000000000003,"5min":0.94799999999999995,"15min":0.94899999999999995},"last":0.374},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.376,"15min":0.33200000000000002},"max":{"1min":0.81799999999999995,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.437}]},{"osd":6,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.92800000000000005,"5min":1.093,"15min":1.093},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.40300000000000002},"max":{"1min":0.871,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.441,"5min":0.435,"15min":0.36699999999999999},"max":{"1min":0.78700000000000003,"5min":0.90100000000000002,"15min":1.0609999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69199999999999995,"15min":0.70399999999999996},"min":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.39300000000000002},"max":{"1min":0.92400000000000004,"5min":0.99399999999999999,"15min":1.0940000000000001},"last":0.60699999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542340,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36444,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335396,"statfs":{"total":96636764160,"available":96599445504,"internally_reserved":0,"allocated":1130496,"data_stored":556668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.313,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.67200000000000004,"5min":0.93700000000000006,"15min":0.96899999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.70799999999999996,"5min":0.77100000000000002,"15min":0.91500000000000004},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.36599999999999999,"5min":0.32800000000000001,"15min":0.27000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.746},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.59499999999999997},"min":{"1min":0.41499999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80300000000000005,"5min":0.83099999999999996,"15min":0.92600000000000005},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":1.01},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.35299999999999998},"max":{"1min":0.72899999999999998,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.58199999999999996}]},{"osd":4,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1719999999999999,"5min":1.214,"15min":1.4339999999999999},"last":0.621},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.64200000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98599999999999999,"5min":1.2450000000000001,"15min":1.343},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56899999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0549999999999999,"5min":1.254,"15min":1.321},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":1.0900000000000001,"5min":1.1950000000000001,"15min":1.4750000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81000000000000005,"15min":0.80700000000000005},"min":{"1min":0.55800000000000005,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":1.077,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.61699999999999999,"5min":0.51600000000000001,"15min":0.50700000000000001},"max":{"1min":0.99299999999999999,"5min":1.0800000000000001,"15min":1.3600000000000001},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.68100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.042,"5min":1.077,"15min":1.383},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80600000000000005,"15min":0.79900000000000004},"min":{"1min":0.66200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.016,"5min":1.079,"15min":1.4019999999999999},"last":0.81899999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542341,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54504,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317336,"statfs":{"total":96636764160,"available":96580952064,"internally_reserved":0,"allocated":1138688,"data_stored":556828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.378,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.65100000000000002,"5min":0.85599999999999998,"15min":1.196},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.504,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68700000000000006,"5min":0.81000000000000005,"15min":1.4019999999999999},"last":0.442}]},{"osd":1,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48599999999999999,"15min":0.48899999999999999},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.69999999999999996,"5min":0.78800000000000003,"15min":1.482},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59599999999999997,"15min":0.60099999999999998},"min":{"1min":0.46100000000000002,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":1.458},"last":0.51900000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.34499999999999997},"max":{"1min":0.80300000000000005,"5min":0.82199999999999995,"15min":0.82299999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.40899999999999997,"5min":0.375,"15min":0.33700000000000002},"max":{"1min":0.751,"5min":0.85399999999999998,"15min":0.95599999999999996},"last":0.499}]},{"osd":4,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.80400000000000005,"15min":0.80100000000000005},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.499},"max":{"1min":0.98399999999999999,"5min":1.1990000000000001,"15min":1.2569999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.79000000000000004},"min":{"1min":0.51800000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0069999999999999,"5min":1.151,"15min":1.5509999999999999},"last":0.89400000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.80800000000000005,"15min":0.80400000000000005},"min":{"1min":0.63300000000000001,"5min":0.52600000000000002,"15min":0.47999999999999998},"max":{"1min":0.995,"5min":1.1140000000000001,"15min":1.2789999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.48299999999999998},"max":{"1min":1.02,"5min":1.2130000000000001,"15min":1.3089999999999999},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.93100000000000005,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85799999999999998,"15min":0.85699999999999998},"min":{"1min":0.68500000000000005,"5min":0.58799999999999997,"15min":0.55600000000000005},"max":{"1min":1.014,"5min":1.25,"15min":1.375},"last":0.82699999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81100000000000005,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":0.99199999999999999,"5min":1.2090000000000001,"15min":1.339},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81599999999999995,"15min":0.81299999999999994},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0149999999999999,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.79500000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542341,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36436,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335404,"statfs":{"total":96636764160,"available":96599453696,"internally_reserved":0,"allocated":1122304,"data_stored":549545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.46300000000000002},"min":{"1min":0.27800000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66500000000000004,"5min":0.85599999999999998,"15min":1.218},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56299999999999994,"15min":0.52600000000000002},"min":{"1min":0.374,"5min":0.33200000000000002,"15min":0.29499999999999998},"max":{"1min":0.85099999999999998,"5min":1.212,"15min":1.212},"last":0.33500000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51500000000000001,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66300000000000003,"5min":0.876,"15min":1.347},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":1.093},"last":0.45500000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.41599999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.74099999999999999,"5min":0.93100000000000005,"15min":1.1459999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.34699999999999998,"5min":0.34599999999999997,"15min":0.33200000000000002},"max":{"1min":0.84299999999999997,"5min":1.165,"15min":1.2190000000000001},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":1.004,"5min":1.204,"15min":1.47},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.80300000000000005,"15min":0.81100000000000005},"min":{"1min":0.60399999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.0269999999999999,"5min":1.2529999999999999,"15min":1.395},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.45100000000000001},"max":{"1min":0.96499999999999997,"5min":1.254,"15min":1.292},"last":0.626},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81299999999999994,"15min":0.81499999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51000000000000001},"max":{"1min":1.044,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.70099999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.171,"5min":1.623,"15min":1.623},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82199999999999995,"15min":0.80600000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.54200000000000004},"max":{"1min":1.01,"5min":1.288,"15min":1.355},"last":0.68999999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.57399999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0760000000000001,"5min":1.1240000000000001,"15min":1.5429999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.63400000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.073,"5min":1.1140000000000001,"15min":1.504},"last":0.752}]}]},{"osd":0,"up_from":14,"seq":60129542340,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37024,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334816,"statfs":{"total":96636764160,"available":96598851584,"internally_reserved":0,"allocated":1720320,"data_stored":1146454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.501,"15min":0.48899999999999999},"min":{"1min":0.30399999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67700000000000005,"5min":0.72499999999999998,"15min":0.79500000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.68400000000000005,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70099999999999996,"5min":0.82299999999999995,"15min":0.97499999999999998},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55500000000000005,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":0.876,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48899999999999999,"15min":0.499},"min":{"1min":0.36299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.266},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.45600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76800000000000002,"5min":0.85099999999999998,"15min":1.2470000000000001},"last":0.50800000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.79900000000000004},"min":{"1min":0.60799999999999998,"5min":0.52600000000000002,"15min":0.503},"max":{"1min":1.048,"5min":1.1739999999999999,"15min":1.306},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.58699999999999997,"5min":0.497,"15min":0.436},"max":{"1min":1.169,"5min":1.169,"15min":1.262},"last":0.68700000000000006}]},{"osd":5,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81499999999999995,"15min":0.80500000000000005},"min":{"1min":0.57499999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.131,"5min":3.528,"15min":3.528},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.53000000000000003,"5min":0.47199999999999998,"15min":0.45500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.373},"last":0.72499999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81699999999999995,"15min":0.80600000000000005},"min":{"1min":0.60599999999999998,"5min":0.54400000000000004,"15min":0.53000000000000003},"max":{"1min":1.0680000000000001,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60999999999999999,"5min":0.52700000000000002,"15min":0.47399999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.331},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83799999999999997,"15min":0.84699999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.52900000000000003},"max":{"1min":1.151,"5min":1.151,"15min":1.4059999999999999},"last":0.627},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.64600000000000002,"5min":0.53200000000000003,"15min":0.499},"max":{"1min":1.0940000000000001,"5min":1.1220000000000001,"15min":1.3169999999999999},"last":0.75}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:19:10.914 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:19:11.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.085+0000 7fae93759640 1 Processor -- start 2023-08-25T04:19:11.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.085+0000 7fae93759640 1 -- start start 2023-08-25T04:19:11.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae93759640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fae8c0ad950 0x7fae8c0cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae93759640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8c0cc880 con 0x7fae8c0ceeb0 2023-08-25T04:19:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae93759640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8c0ccb60 con 0x7fae8c0c89f0 2023-08-25T04:19:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae93759640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8c0b11f0 con 0x7fae8c0ad950 2023-08-25T04:19:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae91cf6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fae8c0ceeb0 0x7fae8c0b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33416/0 (socket says 172.21.15.55:33416) 2023-08-25T04:19:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae91cf6640 1 -- 172.21.15.55:0/2738217200 learned_addr learned my addr 172.21.15.55:0/2738217200 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:11.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae914f5640 1 --2- 172.21.15.55:0/2738217200 >> v2:172.21.15.110:3300/0 conn(0x7fae8c0ad950 0x7fae8c0cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae83fff640 1 -- 172.21.15.55:0/2738217200 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618971640 0 0) 0x7fae8c0cc880 con 0x7fae8c0ceeb0 2023-08-25T04:19:11.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae83fff640 1 -- 172.21.15.55:0/2738217200 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae78003530 con 0x7fae8c0ceeb0 2023-08-25T04:19:11.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae83fff640 1 -- 172.21.15.55:0/2738217200 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071894911 0 0) 0x7fae8c0ccb60 con 0x7fae8c0c89f0 2023-08-25T04:19:11.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae83fff640 1 -- 172.21.15.55:0/2738217200 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae8c0cc880 con 0x7fae8c0c89f0 2023-08-25T04:19:11.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae83fff640 1 -- 172.21.15.55:0/2738217200 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3677596763 0 0) 0x7fae78003530 con 0x7fae8c0ceeb0 2023-08-25T04:19:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae83fff640 1 -- 172.21.15.55:0/2738217200 >> v2:172.21.15.110:3300/0 conn(0x7fae8c0ad950 msgr2=0x7fae8c0cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae83fff640 1 --2- 172.21.15.55:0/2738217200 >> v2:172.21.15.110:3300/0 conn(0x7fae8c0ad950 0x7fae8c0cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae83fff640 1 -- 172.21.15.55:0/2738217200 >> v1:172.21.15.110:6789/0 conn(0x7fae8c0c89f0 legacy=0x7fae8c0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae83fff640 1 -- 172.21.15.55:0/2738217200 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c0cce40 con 0x7fae8c0ceeb0 2023-08-25T04:19:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae83fff640 1 -- 172.21.15.55:0/2738217200 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fae84001a00 con 0x7fae8c0ceeb0 2023-08-25T04:19:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae83fff640 1 -- 172.21.15.55:0/2738217200 >> v1:172.21.15.55:6789/0 conn(0x7fae8c0ceeb0 legacy=0x7fae8c0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae83fff640 1 --2- 172.21.15.55:0/2738217200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae78003b10 0x7fae78003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae83fff640 1 --2- 172.21.15.55:0/2738217200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae780047d0 0x7fae78004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae83fff640 1 --2- 172.21.15.55:0/2738217200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae78005190 0x7fae7800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae83fff640 1 -- 172.21.15.55:0/2738217200 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0b11f0 con 0x7fae78005190 2023-08-25T04:19:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae83fff640 1 -- 172.21.15.55:0/2738217200 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7800c130 con 0x7fae78003b10 2023-08-25T04:19:11.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae83fff640 1 -- 172.21.15.55:0/2738217200 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7800c2f0 con 0x7fae780047d0 2023-08-25T04:19:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae91cf6640 1 --2- 172.21.15.55:0/2738217200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae78005190 0x7fae7800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae90cf4640 1 --2- 172.21.15.55:0/2738217200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae780047d0 0x7fae78004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae914f5640 1 --2- 172.21.15.55:0/2738217200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae78003b10 0x7fae78003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae91cf6640 1 -- 172.21.15.55:0/2738217200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae780047d0 msgr2=0x7fae78004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae91cf6640 1 --2- 172.21.15.55:0/2738217200 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae780047d0 0x7fae78004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae91cf6640 1 -- 172.21.15.55:0/2738217200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae78003b10 msgr2=0x7fae78003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae91cf6640 1 --2- 172.21.15.55:0/2738217200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae78003b10 0x7fae78003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae91cf6640 1 -- 172.21.15.55:0/2738217200 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae78003530 con 0x7fae78005190 2023-08-25T04:19:11.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.089+0000 7fae914f5640 1 --2- 172.21.15.55:0/2738217200 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae78003b10 0x7fae78003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:11.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.093+0000 7fae91cf6640 1 -- 172.21.15.55:0/2738217200 reap_dead start 2023-08-25T04:19:11.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.093+0000 7fae91cf6640 1 --2- 172.21.15.55:0/2738217200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae78005190 0x7fae7800b990 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fae8c15d330 tx=0x7fae8401d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b8ebb06012ea8b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:11.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.093+0000 7fae83fff640 1 -- 172.21.15.55:0/2738217200 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae840ac620 con 0x7fae78005190 2023-08-25T04:19:11.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.093+0000 7fae83fff640 1 -- 172.21.15.55:0/2738217200 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae840a8070 con 0x7fae78005190 2023-08-25T04:19:11.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.093+0000 7fae83fff640 1 -- 172.21.15.55:0/2738217200 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae840ac9e0 con 0x7fae78005190 2023-08-25T04:19:11.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.093+0000 7fae93759640 1 -- 172.21.15.55:0/2738217200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae78005190 msgr2=0x7fae7800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:11.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.093+0000 7fae93759640 1 --2- 172.21.15.55:0/2738217200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae78005190 0x7fae7800b990 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fae8c15d330 tx=0x7fae8401d280 comp rx=0 tx=0).stop 2023-08-25T04:19:11.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.093+0000 7fae93759640 1 -- 172.21.15.55:0/2738217200 shutdown_connections 2023-08-25T04:19:11.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.093+0000 7fae93759640 1 --2- 172.21.15.55:0/2738217200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae78005190 0x7fae7800b990 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.093+0000 7fae93759640 1 -- 172.21.15.55:0/2738217200 >> 172.21.15.55:0/2738217200 conn(0x7fae8c069d00 msgr2=0x7fae8c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:11.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.093+0000 7fae93759640 1 -- 172.21.15.55:0/2738217200 shutdown_connections 2023-08-25T04:19:11.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.093+0000 7fae93759640 1 -- 172.21.15.55:0/2738217200 wait complete. 2023-08-25T04:19:11.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.093+0000 7fae93759640 1 Processor -- start 2023-08-25T04:19:11.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.093+0000 7fae93759640 1 -- start start 2023-08-25T04:19:11.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae93759640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae78005190 0x7fae8c0c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae93759640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae8c158e80 0x7fae8c0c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae93759640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae8c0ac170 0x7fae8c0ac620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae93759640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0acb60 con 0x7fae8c0ac170 2023-08-25T04:19:11.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae93759640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0c5090 con 0x7fae8c158e80 2023-08-25T04:19:11.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae93759640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c159300 con 0x7fae78005190 2023-08-25T04:19:11.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae91cf6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae8c0ac170 0x7fae8c0ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae91cf6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae8c0ac170 0x7fae8c0ac620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49234/0 (socket says 172.21.15.55:49234) 2023-08-25T04:19:11.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae91cf6640 1 -- 172.21.15.55:0/2817287900 learned_addr learned my addr 172.21.15.55:0/2817287900 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:11.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae914f5640 1 --2- 172.21.15.55:0/2817287900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae78005190 0x7fae8c0c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae90cf4640 1 --2- 172.21.15.55:0/2817287900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae8c158e80 0x7fae8c0c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae91cf6640 1 -- 172.21.15.55:0/2817287900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae78005190 msgr2=0x7fae8c0c32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:11.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae91cf6640 1 --2- 172.21.15.55:0/2817287900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae78005190 0x7fae8c0c32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae91cf6640 1 -- 172.21.15.55:0/2817287900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae8c158e80 msgr2=0x7fae8c0c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:11.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae91cf6640 1 --2- 172.21.15.55:0/2817287900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae8c158e80 0x7fae8c0c4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae91cf6640 1 -- 172.21.15.55:0/2817287900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c0c83f0 con 0x7fae8c0ac170 2023-08-25T04:19:11.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae914f5640 1 --2- 172.21.15.55:0/2817287900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae78005190 0x7fae8c0c32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:11.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae91cf6640 1 --2- 172.21.15.55:0/2817287900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae8c0ac170 0x7fae8c0ac620 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fae8400a030 tx=0x7fae78005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:11.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae81ffb640 1 -- 172.21.15.55:0/2817287900 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae84004b70 con 0x7fae8c0ac170 2023-08-25T04:19:11.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae81ffb640 1 -- 172.21.15.55:0/2817287900 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae84004cd0 con 0x7fae8c0ac170 2023-08-25T04:19:11.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae81ffb640 1 -- 172.21.15.55:0/2817287900 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae840ac640 con 0x7fae8c0ac170 2023-08-25T04:19:11.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae93759640 1 -- 172.21.15.55:0/2817287900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8c159750 con 0x7fae8c0ac170 2023-08-25T04:19:11.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae93759640 1 -- 172.21.15.55:0/2817287900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8c0c7630 con 0x7fae8c0ac170 2023-08-25T04:19:11.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.097+0000 7fae93759640 1 -- 172.21.15.55:0/2817287900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae8c04dbe0 con 0x7fae8c0ac170 2023-08-25T04:19:11.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.101+0000 7fae81ffb640 1 -- 172.21.15.55:0/2817287900 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fae840aa070 con 0x7fae8c0ac170 2023-08-25T04:19:11.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.101+0000 7fae81ffb640 1 --2- 172.21.15.55:0/2817287900 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fae700657d0 0x7fae70067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.101+0000 7fae81ffb640 1 -- 172.21.15.55:0/2817287900 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fae840b3070 con 0x7fae8c0ac170 2023-08-25T04:19:11.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.101+0000 7fae914f5640 1 --2- 172.21.15.55:0/2817287900 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fae700657d0 0x7fae70067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.101+0000 7fae914f5640 1 --2- 172.21.15.55:0/2817287900 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fae700657d0 0x7fae70067c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0acea0 tx=0x7fae88008040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:11.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.105+0000 7fae81ffb640 1 -- 172.21.15.55:0/2817287900 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fae840eda00 con 0x7fae8c0ac170 2023-08-25T04:19:11.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.257+0000 7fae93759640 1 -- 172.21.15.55:0/2817287900 --> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae8c0cd120 con 0x7fae700657d0 2023-08-25T04:19:11.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.265+0000 7fae81ffb640 1 -- 172.21.15.55:0/2817287900 <== mgr.6113 v2:172.21.15.110:6832/2805609132 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311534 (secure 0 0 0) 0x7fae88013a20 con 0x7fae700657d0 2023-08-25T04:19:11.268 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:11.269 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:19:11.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.269+0000 7fae93759640 1 -- 172.21.15.55:0/2817287900 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fae700657d0 msgr2=0x7fae70067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:11.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.269+0000 7fae93759640 1 --2- 172.21.15.55:0/2817287900 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fae700657d0 0x7fae70067c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0acea0 tx=0x7fae88008040 comp rx=0 tx=0).stop 2023-08-25T04:19:11.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.269+0000 7fae93759640 1 -- 172.21.15.55:0/2817287900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae8c0ac170 msgr2=0x7fae8c0ac620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:11.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.269+0000 7fae93759640 1 --2- 172.21.15.55:0/2817287900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae8c0ac170 0x7fae8c0ac620 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fae8400a030 tx=0x7fae78005800 comp rx=0 tx=0).stop 2023-08-25T04:19:11.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.269+0000 7fae93759640 1 -- 172.21.15.55:0/2817287900 shutdown_connections 2023-08-25T04:19:11.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.269+0000 7fae93759640 1 --2- 172.21.15.55:0/2817287900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae8c0ac170 0x7fae8c0ac620 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.269+0000 7fae93759640 1 --2- 172.21.15.55:0/2817287900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae8c158e80 0x7fae8c0c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.269+0000 7fae93759640 1 --2- 172.21.15.55:0/2817287900 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fae700657d0 0x7fae70067c90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.269+0000 7fae93759640 1 --2- 172.21.15.55:0/2817287900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae78005190 0x7fae8c0c32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.269+0000 7fae93759640 1 -- 172.21.15.55:0/2817287900 >> 172.21.15.55:0/2817287900 conn(0x7fae8c069d00 msgr2=0x7fae8c070a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:11.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.269+0000 7fae93759640 1 -- 172.21.15.55:0/2817287900 shutdown_connections 2023-08-25T04:19:11.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.269+0000 7fae93759640 1 -- 172.21.15.55:0/2817287900 wait complete. 2023-08-25T04:19:11.296 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-25T04:19:10.313597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":656,"num_read_kb":1306,"num_write":315,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":316364,"kb_used_data":10000,"kb_used_omap":13,"kb_used_meta":306226,"kb_avail":754658356,"statfs":{"total":773094113280,"available":772770156544,"internally_reserved":0,"allocated":10240000,"data_stored":5620938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":313575512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.554838"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797641+0000","last_change":"2023-08-25T04:19:06.794646+0000","last_active":"2023-08-25T04:19:07.797641+0000","last_peered":"2023-08-25T04:19:07.797641+0000","last_clean":"2023-08-25T04:19:07.797641+0000","last_became_active":"2023-08-25T04:19:06.794316+0000","last_became_peered":"2023-08-25T04:19:06.794316+0000","last_unstale":"2023-08-25T04:19:07.797641+0000","last_undegraded":"2023-08-25T04:19:07.797641+0000","last_fullsized":"2023-08-25T04:19:07.797641+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:59.065930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992930+0000","last_change":"2023-08-25T04:19:06.804890+0000","last_active":"2023-08-25T04:19:07.992930+0000","last_peered":"2023-08-25T04:19:07.992930+0000","last_clean":"2023-08-25T04:19:07.992930+0000","last_became_active":"2023-08-25T04:19:06.804607+0000","last_became_peered":"2023-08-25T04:19:06.804607+0000","last_unstale":"2023-08-25T04:19:07.992930+0000","last_undegraded":"2023-08-25T04:19:07.992930+0000","last_fullsized":"2023-08-25T04:19:07.992930+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:04:46.433360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120925+0000","last_change":"2023-08-25T04:19:06.803924+0000","last_active":"2023-08-25T04:19:09.120925+0000","last_peered":"2023-08-25T04:19:09.120925+0000","last_clean":"2023-08-25T04:19:09.120925+0000","last_became_active":"2023-08-25T04:19:06.803505+0000","last_became_peered":"2023-08-25T04:19:06.803505+0000","last_unstale":"2023-08-25T04:19:09.120925+0000","last_undegraded":"2023-08-25T04:19:09.120925+0000","last_fullsized":"2023-08-25T04:19:09.120925+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:51:08.473197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646205+0000","last_change":"2023-08-25T04:19:06.802997+0000","last_active":"2023-08-25T04:19:08.646205+0000","last_peered":"2023-08-25T04:19:08.646205+0000","last_clean":"2023-08-25T04:19:08.646205+0000","last_became_active":"2023-08-25T04:19:06.802542+0000","last_became_peered":"2023-08-25T04:19:06.802542+0000","last_unstale":"2023-08-25T04:19:08.646205+0000","last_undegraded":"2023-08-25T04:19:08.646205+0000","last_fullsized":"2023-08-25T04:19:08.646205+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:14:27.964537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120226+0000","last_change":"2023-08-25T04:19:06.791228+0000","last_active":"2023-08-25T04:19:09.120226+0000","last_peered":"2023-08-25T04:19:09.120226+0000","last_clean":"2023-08-25T04:19:09.120226+0000","last_became_active":"2023-08-25T04:19:06.790923+0000","last_became_peered":"2023-08-25T04:19:06.790923+0000","last_unstale":"2023-08-25T04:19:09.120226+0000","last_undegraded":"2023-08-25T04:19:09.120226+0000","last_fullsized":"2023-08-25T04:19:09.120226+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:05.335597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800389+0000","last_change":"2023-08-25T04:19:06.817403+0000","last_active":"2023-08-25T04:19:07.800389+0000","last_peered":"2023-08-25T04:19:07.800389+0000","last_clean":"2023-08-25T04:19:07.800389+0000","last_became_active":"2023-08-25T04:19:06.806224+0000","last_became_peered":"2023-08-25T04:19:06.806224+0000","last_unstale":"2023-08-25T04:19:07.800389+0000","last_undegraded":"2023-08-25T04:19:07.800389+0000","last_fullsized":"2023-08-25T04:19:07.800389+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:29:56.321894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118338+0000","last_change":"2023-08-25T04:19:06.790957+0000","last_active":"2023-08-25T04:19:09.118338+0000","last_peered":"2023-08-25T04:19:09.118338+0000","last_clean":"2023-08-25T04:19:09.118338+0000","last_became_active":"2023-08-25T04:19:06.790689+0000","last_became_peered":"2023-08-25T04:19:06.790689+0000","last_unstale":"2023-08-25T04:19:09.118338+0000","last_undegraded":"2023-08-25T04:19:09.118338+0000","last_fullsized":"2023-08-25T04:19:09.118338+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:11:24.568378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.119754+0000","last_change":"2023-08-25T04:19:06.792223+0000","last_active":"2023-08-25T04:19:09.119754+0000","last_peered":"2023-08-25T04:19:09.119754+0000","last_clean":"2023-08-25T04:19:09.119754+0000","last_became_active":"2023-08-25T04:19:06.791842+0000","last_became_peered":"2023-08-25T04:19:06.791842+0000","last_unstale":"2023-08-25T04:19:09.119754+0000","last_undegraded":"2023-08-25T04:19:09.119754+0000","last_fullsized":"2023-08-25T04:19:09.119754+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:36:43.827545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797799+0000","last_change":"2023-08-25T04:19:06.800381+0000","last_active":"2023-08-25T04:19:07.797799+0000","last_peered":"2023-08-25T04:19:07.797799+0000","last_clean":"2023-08-25T04:19:07.797799+0000","last_became_active":"2023-08-25T04:19:06.797923+0000","last_became_peered":"2023-08-25T04:19:06.797923+0000","last_unstale":"2023-08-25T04:19:07.797799+0000","last_undegraded":"2023-08-25T04:19:07.797799+0000","last_fullsized":"2023-08-25T04:19:07.797799+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:51:05.886076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646356+0000","last_change":"2023-08-25T04:19:06.801731+0000","last_active":"2023-08-25T04:19:08.646356+0000","last_peered":"2023-08-25T04:19:08.646356+0000","last_clean":"2023-08-25T04:19:08.646356+0000","last_became_active":"2023-08-25T04:19:06.801434+0000","last_became_peered":"2023-08-25T04:19:06.801434+0000","last_unstale":"2023-08-25T04:19:08.646356+0000","last_undegraded":"2023-08-25T04:19:08.646356+0000","last_fullsized":"2023-08-25T04:19:08.646356+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:20:12.345314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992979+0000","last_change":"2023-08-25T04:19:06.810916+0000","last_active":"2023-08-25T04:19:07.992979+0000","last_peered":"2023-08-25T04:19:07.992979+0000","last_clean":"2023-08-25T04:19:07.992979+0000","last_became_active":"2023-08-25T04:19:06.810376+0000","last_became_peered":"2023-08-25T04:19:06.810376+0000","last_unstale":"2023-08-25T04:19:07.992979+0000","last_undegraded":"2023-08-25T04:19:07.992979+0000","last_fullsized":"2023-08-25T04:19:07.992979+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:06:33.515548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646327+0000","last_change":"2023-08-25T04:19:06.811820+0000","last_active":"2023-08-25T04:19:08.646327+0000","last_peered":"2023-08-25T04:19:08.646327+0000","last_clean":"2023-08-25T04:19:08.646327+0000","last_became_active":"2023-08-25T04:19:06.811424+0000","last_became_peered":"2023-08-25T04:19:06.811424+0000","last_unstale":"2023-08-25T04:19:08.646327+0000","last_undegraded":"2023-08-25T04:19:08.646327+0000","last_fullsized":"2023-08-25T04:19:08.646327+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:56:09.745452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120243+0000","last_change":"2023-08-25T04:19:06.802082+0000","last_active":"2023-08-25T04:19:09.120243+0000","last_peered":"2023-08-25T04:19:09.120243+0000","last_clean":"2023-08-25T04:19:09.120243+0000","last_became_active":"2023-08-25T04:19:06.801764+0000","last_became_peered":"2023-08-25T04:19:06.801764+0000","last_unstale":"2023-08-25T04:19:09.120243+0000","last_undegraded":"2023-08-25T04:19:09.120243+0000","last_fullsized":"2023-08-25T04:19:09.120243+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:09.565533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800749+0000","last_change":"2023-08-25T04:19:06.798031+0000","last_active":"2023-08-25T04:19:07.800749+0000","last_peered":"2023-08-25T04:19:07.800749+0000","last_clean":"2023-08-25T04:19:07.800749+0000","last_became_active":"2023-08-25T04:19:06.797275+0000","last_became_peered":"2023-08-25T04:19:06.797275+0000","last_unstale":"2023-08-25T04:19:07.800749+0000","last_undegraded":"2023-08-25T04:19:07.800749+0000","last_fullsized":"2023-08-25T04:19:07.800749+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:13:41.159118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992603+0000","last_change":"2023-08-25T04:19:06.805714+0000","last_active":"2023-08-25T04:19:07.992603+0000","last_peered":"2023-08-25T04:19:07.992603+0000","last_clean":"2023-08-25T04:19:07.992603+0000","last_became_active":"2023-08-25T04:19:06.805256+0000","last_became_peered":"2023-08-25T04:19:06.805256+0000","last_unstale":"2023-08-25T04:19:07.992603+0000","last_undegraded":"2023-08-25T04:19:07.992603+0000","last_fullsized":"2023-08-25T04:19:07.992603+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:07:31.026605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.796683+0000","last_change":"2023-08-25T04:19:06.793788+0000","last_active":"2023-08-25T04:19:07.796683+0000","last_peered":"2023-08-25T04:19:07.796683+0000","last_clean":"2023-08-25T04:19:07.796683+0000","last_became_active":"2023-08-25T04:19:06.793243+0000","last_became_peered":"2023-08-25T04:19:06.793243+0000","last_unstale":"2023-08-25T04:19:07.796683+0000","last_undegraded":"2023-08-25T04:19:07.796683+0000","last_fullsized":"2023-08-25T04:19:07.796683+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:00:13.918822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120343+0000","last_change":"2023-08-25T04:19:06.807707+0000","last_active":"2023-08-25T04:19:09.120343+0000","last_peered":"2023-08-25T04:19:09.120343+0000","last_clean":"2023-08-25T04:19:09.120343+0000","last_became_active":"2023-08-25T04:19:06.807373+0000","last_became_peered":"2023-08-25T04:19:06.807373+0000","last_unstale":"2023-08-25T04:19:09.120343+0000","last_undegraded":"2023-08-25T04:19:09.120343+0000","last_fullsized":"2023-08-25T04:19:09.120343+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:42:27.902864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120913+0000","last_change":"2023-08-25T04:19:06.790376+0000","last_active":"2023-08-25T04:19:09.120913+0000","last_peered":"2023-08-25T04:19:09.120913+0000","last_clean":"2023-08-25T04:19:09.120913+0000","last_became_active":"2023-08-25T04:19:06.790019+0000","last_became_peered":"2023-08-25T04:19:06.790019+0000","last_unstale":"2023-08-25T04:19:09.120913+0000","last_undegraded":"2023-08-25T04:19:09.120913+0000","last_fullsized":"2023-08-25T04:19:09.120913+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:05:20.997364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800396+0000","last_change":"2023-08-25T04:19:06.792975+0000","last_active":"2023-08-25T04:19:07.800396+0000","last_peered":"2023-08-25T04:19:07.800396+0000","last_clean":"2023-08-25T04:19:07.800396+0000","last_became_active":"2023-08-25T04:19:06.792706+0000","last_became_peered":"2023-08-25T04:19:06.792706+0000","last_unstale":"2023-08-25T04:19:07.800396+0000","last_undegraded":"2023-08-25T04:19:07.800396+0000","last_fullsized":"2023-08-25T04:19:07.800396+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:38:29.255064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.119936+0000","last_change":"2023-08-25T04:19:06.795936+0000","last_active":"2023-08-25T04:19:09.119936+0000","last_peered":"2023-08-25T04:19:09.119936+0000","last_clean":"2023-08-25T04:19:09.119936+0000","last_became_active":"2023-08-25T04:19:06.795669+0000","last_became_peered":"2023-08-25T04:19:06.795669+0000","last_unstale":"2023-08-25T04:19:09.119936+0000","last_undegraded":"2023-08-25T04:19:09.119936+0000","last_fullsized":"2023-08-25T04:19:09.119936+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:21:36.456902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797236+0000","last_change":"2023-08-25T04:19:06.787913+0000","last_active":"2023-08-25T04:19:07.797236+0000","last_peered":"2023-08-25T04:19:07.797236+0000","last_clean":"2023-08-25T04:19:07.797236+0000","last_became_active":"2023-08-25T04:19:06.787500+0000","last_became_peered":"2023-08-25T04:19:06.787500+0000","last_unstale":"2023-08-25T04:19:07.797236+0000","last_undegraded":"2023-08-25T04:19:07.797236+0000","last_fullsized":"2023-08-25T04:19:07.797236+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:53:05.633120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.119943+0000","last_change":"2023-08-25T04:19:06.799388+0000","last_active":"2023-08-25T04:19:09.119943+0000","last_peered":"2023-08-25T04:19:09.119943+0000","last_clean":"2023-08-25T04:19:09.119943+0000","last_became_active":"2023-08-25T04:19:06.799115+0000","last_became_peered":"2023-08-25T04:19:06.799115+0000","last_unstale":"2023-08-25T04:19:09.119943+0000","last_undegraded":"2023-08-25T04:19:09.119943+0000","last_fullsized":"2023-08-25T04:19:09.119943+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:50:14.521108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797253+0000","last_change":"2023-08-25T04:19:06.793481+0000","last_active":"2023-08-25T04:19:07.797253+0000","last_peered":"2023-08-25T04:19:07.797253+0000","last_clean":"2023-08-25T04:19:07.797253+0000","last_became_active":"2023-08-25T04:19:06.793144+0000","last_became_peered":"2023-08-25T04:19:06.793144+0000","last_unstale":"2023-08-25T04:19:07.797253+0000","last_undegraded":"2023-08-25T04:19:07.797253+0000","last_fullsized":"2023-08-25T04:19:07.797253+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:52:53.685679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992521+0000","last_change":"2023-08-25T04:19:06.807864+0000","last_active":"2023-08-25T04:19:07.992521+0000","last_peered":"2023-08-25T04:19:07.992521+0000","last_clean":"2023-08-25T04:19:07.992521+0000","last_became_active":"2023-08-25T04:19:06.807577+0000","last_became_peered":"2023-08-25T04:19:06.807577+0000","last_unstale":"2023-08-25T04:19:07.992521+0000","last_undegraded":"2023-08-25T04:19:07.992521+0000","last_fullsized":"2023-08-25T04:19:07.992521+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:43:31.509007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992992+0000","last_change":"2023-08-25T04:19:06.806912+0000","last_active":"2023-08-25T04:19:07.992992+0000","last_peered":"2023-08-25T04:19:07.992992+0000","last_clean":"2023-08-25T04:19:07.992992+0000","last_became_active":"2023-08-25T04:19:06.806600+0000","last_became_peered":"2023-08-25T04:19:06.806600+0000","last_unstale":"2023-08-25T04:19:07.992992+0000","last_undegraded":"2023-08-25T04:19:07.992992+0000","last_fullsized":"2023-08-25T04:19:07.992992+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:23:26.660890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646448+0000","last_change":"2023-08-25T04:19:06.806565+0000","last_active":"2023-08-25T04:19:08.646448+0000","last_peered":"2023-08-25T04:19:08.646448+0000","last_clean":"2023-08-25T04:19:08.646448+0000","last_became_active":"2023-08-25T04:19:06.806127+0000","last_became_peered":"2023-08-25T04:19:06.806127+0000","last_unstale":"2023-08-25T04:19:08.646448+0000","last_undegraded":"2023-08-25T04:19:08.646448+0000","last_fullsized":"2023-08-25T04:19:08.646448+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:31:28.616884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797077+0000","last_change":"2023-08-25T04:19:06.793569+0000","last_active":"2023-08-25T04:19:07.797077+0000","last_peered":"2023-08-25T04:19:07.797077+0000","last_clean":"2023-08-25T04:19:07.797077+0000","last_became_active":"2023-08-25T04:19:06.793261+0000","last_became_peered":"2023-08-25T04:19:06.793261+0000","last_unstale":"2023-08-25T04:19:07.797077+0000","last_undegraded":"2023-08-25T04:19:07.797077+0000","last_fullsized":"2023-08-25T04:19:07.797077+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:11:19.156236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120060+0000","last_change":"2023-08-25T04:19:06.805478+0000","last_active":"2023-08-25T04:19:09.120060+0000","last_peered":"2023-08-25T04:19:09.120060+0000","last_clean":"2023-08-25T04:19:09.120060+0000","last_became_active":"2023-08-25T04:19:06.805172+0000","last_became_peered":"2023-08-25T04:19:06.805172+0000","last_unstale":"2023-08-25T04:19:09.120060+0000","last_undegraded":"2023-08-25T04:19:09.120060+0000","last_fullsized":"2023-08-25T04:19:09.120060+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:52:50.367582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992856+0000","last_change":"2023-08-25T04:19:06.812439+0000","last_active":"2023-08-25T04:19:07.992856+0000","last_peered":"2023-08-25T04:19:07.992856+0000","last_clean":"2023-08-25T04:19:07.992856+0000","last_became_active":"2023-08-25T04:19:06.812132+0000","last_became_peered":"2023-08-25T04:19:06.812132+0000","last_unstale":"2023-08-25T04:19:07.992856+0000","last_undegraded":"2023-08-25T04:19:07.992856+0000","last_fullsized":"2023-08-25T04:19:07.992856+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:59:53.411279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.796776+0000","last_change":"2023-08-25T04:19:06.810704+0000","last_active":"2023-08-25T04:19:07.796776+0000","last_peered":"2023-08-25T04:19:07.796776+0000","last_clean":"2023-08-25T04:19:07.796776+0000","last_became_active":"2023-08-25T04:19:06.810401+0000","last_became_peered":"2023-08-25T04:19:06.810401+0000","last_unstale":"2023-08-25T04:19:07.796776+0000","last_undegraded":"2023-08-25T04:19:07.796776+0000","last_fullsized":"2023-08-25T04:19:07.796776+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:05:51.633449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120668+0000","last_change":"2023-08-25T04:19:06.801342+0000","last_active":"2023-08-25T04:19:09.120668+0000","last_peered":"2023-08-25T04:19:09.120668+0000","last_clean":"2023-08-25T04:19:09.120668+0000","last_became_active":"2023-08-25T04:19:06.800925+0000","last_became_peered":"2023-08-25T04:19:06.800925+0000","last_unstale":"2023-08-25T04:19:09.120668+0000","last_undegraded":"2023-08-25T04:19:09.120668+0000","last_fullsized":"2023-08-25T04:19:09.120668+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:56:38.061282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.796786+0000","last_change":"2023-08-25T04:19:06.801799+0000","last_active":"2023-08-25T04:19:07.796786+0000","last_peered":"2023-08-25T04:19:07.796786+0000","last_clean":"2023-08-25T04:19:07.796786+0000","last_became_active":"2023-08-25T04:19:06.801492+0000","last_became_peered":"2023-08-25T04:19:06.801492+0000","last_unstale":"2023-08-25T04:19:07.796786+0000","last_undegraded":"2023-08-25T04:19:07.796786+0000","last_fullsized":"2023-08-25T04:19:07.796786+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:34:25.064236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120669+0000","last_change":"2023-08-25T04:19:06.793218+0000","last_active":"2023-08-25T04:19:09.120669+0000","last_peered":"2023-08-25T04:19:09.120669+0000","last_clean":"2023-08-25T04:19:09.120669+0000","last_became_active":"2023-08-25T04:19:06.792933+0000","last_became_peered":"2023-08-25T04:19:06.792933+0000","last_unstale":"2023-08-25T04:19:09.120669+0000","last_undegraded":"2023-08-25T04:19:09.120669+0000","last_fullsized":"2023-08-25T04:19:09.120669+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:59.643567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"92'4","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120370+0000","last_change":"2023-08-25T04:19:05.803348+0000","last_active":"2023-08-25T04:19:09.120370+0000","last_peered":"2023-08-25T04:19:09.120370+0000","last_clean":"2023-08-25T04:19:09.120370+0000","last_became_active":"2023-08-25T04:19:05.803093+0000","last_became_peered":"2023-08-25T04:19:05.803093+0000","last_unstale":"2023-08-25T04:19:09.120370+0000","last_undegraded":"2023-08-25T04:19:09.120370+0000","last_fullsized":"2023-08-25T04:19:09.120370+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:21:55.237220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992633+0000","last_change":"2023-08-25T04:19:06.805511+0000","last_active":"2023-08-25T04:19:07.992633+0000","last_peered":"2023-08-25T04:19:07.992633+0000","last_clean":"2023-08-25T04:19:07.992633+0000","last_became_active":"2023-08-25T04:19:06.804815+0000","last_became_peered":"2023-08-25T04:19:06.804815+0000","last_unstale":"2023-08-25T04:19:07.992633+0000","last_undegraded":"2023-08-25T04:19:07.992633+0000","last_fullsized":"2023-08-25T04:19:07.992633+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:36:05.491673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"92'1","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797405+0000","last_change":"2023-08-25T04:19:05.796806+0000","last_active":"2023-08-25T04:19:07.797405+0000","last_peered":"2023-08-25T04:19:07.797405+0000","last_clean":"2023-08-25T04:19:07.797405+0000","last_became_active":"2023-08-25T04:19:05.796412+0000","last_became_peered":"2023-08-25T04:19:05.796412+0000","last_unstale":"2023-08-25T04:19:07.797405+0000","last_undegraded":"2023-08-25T04:19:07.797405+0000","last_fullsized":"2023-08-25T04:19:07.797405+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:10:10.867990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797342+0000","last_change":"2023-08-25T04:19:06.800832+0000","last_active":"2023-08-25T04:19:07.797342+0000","last_peered":"2023-08-25T04:19:07.797342+0000","last_clean":"2023-08-25T04:19:07.797342+0000","last_became_active":"2023-08-25T04:19:06.800410+0000","last_became_peered":"2023-08-25T04:19:06.800410+0000","last_unstale":"2023-08-25T04:19:07.797342+0000","last_undegraded":"2023-08-25T04:19:07.797342+0000","last_fullsized":"2023-08-25T04:19:07.797342+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:10:41.379434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"92'2","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797202+0000","last_change":"2023-08-25T04:19:05.799421+0000","last_active":"2023-08-25T04:19:07.797202+0000","last_peered":"2023-08-25T04:19:07.797202+0000","last_clean":"2023-08-25T04:19:07.797202+0000","last_became_active":"2023-08-25T04:19:05.799114+0000","last_became_peered":"2023-08-25T04:19:05.799114+0000","last_unstale":"2023-08-25T04:19:07.797202+0000","last_undegraded":"2023-08-25T04:19:07.797202+0000","last_fullsized":"2023-08-25T04:19:07.797202+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:28:09.669986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797370+0000","last_change":"2023-08-25T04:19:06.789876+0000","last_active":"2023-08-25T04:19:07.797370+0000","last_peered":"2023-08-25T04:19:07.797370+0000","last_clean":"2023-08-25T04:19:07.797370+0000","last_became_active":"2023-08-25T04:19:06.789538+0000","last_became_peered":"2023-08-25T04:19:06.789538+0000","last_unstale":"2023-08-25T04:19:07.797370+0000","last_undegraded":"2023-08-25T04:19:07.797370+0000","last_fullsized":"2023-08-25T04:19:07.797370+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:59:57.455122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"92'2","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118614+0000","last_change":"2023-08-25T04:19:05.793204+0000","last_active":"2023-08-25T04:19:09.118614+0000","last_peered":"2023-08-25T04:19:09.118614+0000","last_clean":"2023-08-25T04:19:09.118614+0000","last_became_active":"2023-08-25T04:19:05.792777+0000","last_became_peered":"2023-08-25T04:19:05.792777+0000","last_unstale":"2023-08-25T04:19:09.118614+0000","last_undegraded":"2023-08-25T04:19:09.118614+0000","last_fullsized":"2023-08-25T04:19:09.118614+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:29:18.313735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992910+0000","last_change":"2023-08-25T04:19:06.808911+0000","last_active":"2023-08-25T04:19:07.992910+0000","last_peered":"2023-08-25T04:19:07.992910+0000","last_clean":"2023-08-25T04:19:07.992910+0000","last_became_active":"2023-08-25T04:19:06.808642+0000","last_became_peered":"2023-08-25T04:19:06.808642+0000","last_unstale":"2023-08-25T04:19:07.992910+0000","last_undegraded":"2023-08-25T04:19:07.992910+0000","last_fullsized":"2023-08-25T04:19:07.992910+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:38:43.810738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"92'1","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797494+0000","last_change":"2023-08-25T04:19:05.793601+0000","last_active":"2023-08-25T04:19:07.797494+0000","last_peered":"2023-08-25T04:19:07.797494+0000","last_clean":"2023-08-25T04:19:07.797494+0000","last_became_active":"2023-08-25T04:19:05.793257+0000","last_became_peered":"2023-08-25T04:19:05.793257+0000","last_unstale":"2023-08-25T04:19:07.797494+0000","last_undegraded":"2023-08-25T04:19:07.797494+0000","last_fullsized":"2023-08-25T04:19:07.797494+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:36.127273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.993001+0000","last_change":"2023-08-25T04:19:06.810689+0000","last_active":"2023-08-25T04:19:07.993001+0000","last_peered":"2023-08-25T04:19:07.993001+0000","last_clean":"2023-08-25T04:19:07.993001+0000","last_became_active":"2023-08-25T04:19:06.809901+0000","last_became_peered":"2023-08-25T04:19:06.809901+0000","last_unstale":"2023-08-25T04:19:07.993001+0000","last_undegraded":"2023-08-25T04:19:07.993001+0000","last_fullsized":"2023-08-25T04:19:07.993001+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:33:28.638377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"92'1","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646223+0000","last_change":"2023-08-25T04:19:05.792191+0000","last_active":"2023-08-25T04:19:08.646223+0000","last_peered":"2023-08-25T04:19:08.646223+0000","last_clean":"2023-08-25T04:19:08.646223+0000","last_became_active":"2023-08-25T04:19:05.791804+0000","last_became_peered":"2023-08-25T04:19:05.791804+0000","last_unstale":"2023-08-25T04:19:08.646223+0000","last_undegraded":"2023-08-25T04:19:08.646223+0000","last_fullsized":"2023-08-25T04:19:08.646223+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:08:49.146959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797709+0000","last_change":"2023-08-25T04:19:06.797933+0000","last_active":"2023-08-25T04:19:07.797709+0000","last_peered":"2023-08-25T04:19:07.797709+0000","last_clean":"2023-08-25T04:19:07.797709+0000","last_became_active":"2023-08-25T04:19:06.797612+0000","last_became_peered":"2023-08-25T04:19:06.797612+0000","last_unstale":"2023-08-25T04:19:07.797709+0000","last_undegraded":"2023-08-25T04:19:07.797709+0000","last_fullsized":"2023-08-25T04:19:07.797709+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:05:13.841755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992749+0000","last_change":"2023-08-25T04:19:05.795442+0000","last_active":"2023-08-25T04:19:07.992749+0000","last_peered":"2023-08-25T04:19:07.992749+0000","last_clean":"2023-08-25T04:19:07.992749+0000","last_became_active":"2023-08-25T04:19:05.795138+0000","last_became_peered":"2023-08-25T04:19:05.795138+0000","last_unstale":"2023-08-25T04:19:07.992749+0000","last_undegraded":"2023-08-25T04:19:07.992749+0000","last_fullsized":"2023-08-25T04:19:07.992749+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:47:12.631302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118700+0000","last_change":"2023-08-25T04:19:06.789154+0000","last_active":"2023-08-25T04:19:09.118700+0000","last_peered":"2023-08-25T04:19:09.118700+0000","last_clean":"2023-08-25T04:19:09.118700+0000","last_became_active":"2023-08-25T04:19:06.788730+0000","last_became_peered":"2023-08-25T04:19:06.788730+0000","last_unstale":"2023-08-25T04:19:09.118700+0000","last_undegraded":"2023-08-25T04:19:09.118700+0000","last_fullsized":"2023-08-25T04:19:09.118700+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:26:57.835309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.119985+0000","last_change":"2023-08-25T04:19:05.797682+0000","last_active":"2023-08-25T04:19:09.119985+0000","last_peered":"2023-08-25T04:19:09.119985+0000","last_clean":"2023-08-25T04:19:09.119985+0000","last_became_active":"2023-08-25T04:19:05.797395+0000","last_became_peered":"2023-08-25T04:19:05.797395+0000","last_unstale":"2023-08-25T04:19:09.119985+0000","last_undegraded":"2023-08-25T04:19:09.119985+0000","last_fullsized":"2023-08-25T04:19:09.119985+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:26:21.525019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992489+0000","last_change":"2023-08-25T04:19:06.804118+0000","last_active":"2023-08-25T04:19:07.992489+0000","last_peered":"2023-08-25T04:19:07.992489+0000","last_clean":"2023-08-25T04:19:07.992489+0000","last_became_active":"2023-08-25T04:19:06.803800+0000","last_became_peered":"2023-08-25T04:19:06.803800+0000","last_unstale":"2023-08-25T04:19:07.992489+0000","last_undegraded":"2023-08-25T04:19:07.992489+0000","last_fullsized":"2023-08-25T04:19:07.992489+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:16:20.222218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797754+0000","last_change":"2023-08-25T04:19:05.795893+0000","last_active":"2023-08-25T04:19:07.797754+0000","last_peered":"2023-08-25T04:19:07.797754+0000","last_clean":"2023-08-25T04:19:07.797754+0000","last_became_active":"2023-08-25T04:19:05.795614+0000","last_became_peered":"2023-08-25T04:19:05.795614+0000","last_unstale":"2023-08-25T04:19:07.797754+0000","last_undegraded":"2023-08-25T04:19:07.797754+0000","last_fullsized":"2023-08-25T04:19:07.797754+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:57:52.441367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646112+0000","last_change":"2023-08-25T04:19:06.794897+0000","last_active":"2023-08-25T04:19:08.646112+0000","last_peered":"2023-08-25T04:19:08.646112+0000","last_clean":"2023-08-25T04:19:08.646112+0000","last_became_active":"2023-08-25T04:19:06.794597+0000","last_became_peered":"2023-08-25T04:19:06.794597+0000","last_unstale":"2023-08-25T04:19:08.646112+0000","last_undegraded":"2023-08-25T04:19:08.646112+0000","last_fullsized":"2023-08-25T04:19:08.646112+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:18:30.397780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646492+0000","last_change":"2023-08-25T04:19:05.790893+0000","last_active":"2023-08-25T04:19:08.646492+0000","last_peered":"2023-08-25T04:19:08.646492+0000","last_clean":"2023-08-25T04:19:08.646492+0000","last_became_active":"2023-08-25T04:19:05.790605+0000","last_became_peered":"2023-08-25T04:19:05.790605+0000","last_unstale":"2023-08-25T04:19:08.646492+0000","last_undegraded":"2023-08-25T04:19:08.646492+0000","last_fullsized":"2023-08-25T04:19:08.646492+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:13:58.362289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800715+0000","last_change":"2023-08-25T04:19:06.800985+0000","last_active":"2023-08-25T04:19:07.800715+0000","last_peered":"2023-08-25T04:19:07.800715+0000","last_clean":"2023-08-25T04:19:07.800715+0000","last_became_active":"2023-08-25T04:19:06.797754+0000","last_became_peered":"2023-08-25T04:19:06.797754+0000","last_unstale":"2023-08-25T04:19:07.800715+0000","last_undegraded":"2023-08-25T04:19:07.800715+0000","last_fullsized":"2023-08-25T04:19:07.800715+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:38:16.085475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"92'3","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120229+0000","last_change":"2023-08-25T04:19:05.801675+0000","last_active":"2023-08-25T04:19:09.120229+0000","last_peered":"2023-08-25T04:19:09.120229+0000","last_clean":"2023-08-25T04:19:09.120229+0000","last_became_active":"2023-08-25T04:19:05.801405+0000","last_became_peered":"2023-08-25T04:19:05.801405+0000","last_unstale":"2023-08-25T04:19:09.120229+0000","last_undegraded":"2023-08-25T04:19:09.120229+0000","last_fullsized":"2023-08-25T04:19:09.120229+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:50:05.808878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120828+0000","last_change":"2023-08-25T04:19:06.814895+0000","last_active":"2023-08-25T04:19:09.120828+0000","last_peered":"2023-08-25T04:19:09.120828+0000","last_clean":"2023-08-25T04:19:09.120828+0000","last_became_active":"2023-08-25T04:19:06.814575+0000","last_became_peered":"2023-08-25T04:19:06.814575+0000","last_unstale":"2023-08-25T04:19:09.120828+0000","last_undegraded":"2023-08-25T04:19:09.120828+0000","last_fullsized":"2023-08-25T04:19:09.120828+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:52:11.696614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"92'6","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118553+0000","last_change":"2023-08-25T04:19:05.785196+0000","last_active":"2023-08-25T04:19:09.118553+0000","last_peered":"2023-08-25T04:19:09.118553+0000","last_clean":"2023-08-25T04:19:09.118553+0000","last_became_active":"2023-08-25T04:19:05.784851+0000","last_became_peered":"2023-08-25T04:19:05.784851+0000","last_unstale":"2023-08-25T04:19:09.118553+0000","last_undegraded":"2023-08-25T04:19:09.118553+0000","last_fullsized":"2023-08-25T04:19:09.118553+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:46:02.698756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646428+0000","last_change":"2023-08-25T04:19:06.799182+0000","last_active":"2023-08-25T04:19:08.646428+0000","last_peered":"2023-08-25T04:19:08.646428+0000","last_clean":"2023-08-25T04:19:08.646428+0000","last_became_active":"2023-08-25T04:19:06.798895+0000","last_became_peered":"2023-08-25T04:19:06.798895+0000","last_unstale":"2023-08-25T04:19:08.646428+0000","last_undegraded":"2023-08-25T04:19:08.646428+0000","last_fullsized":"2023-08-25T04:19:08.646428+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:08:55.045698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"92'2","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646234+0000","last_change":"2023-08-25T04:19:05.793029+0000","last_active":"2023-08-25T04:19:08.646234+0000","last_peered":"2023-08-25T04:19:08.646234+0000","last_clean":"2023-08-25T04:19:08.646234+0000","last_became_active":"2023-08-25T04:19:05.792764+0000","last_became_peered":"2023-08-25T04:19:05.792764+0000","last_unstale":"2023-08-25T04:19:08.646234+0000","last_undegraded":"2023-08-25T04:19:08.646234+0000","last_fullsized":"2023-08-25T04:19:08.646234+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:32:58.130183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118578+0000","last_change":"2023-08-25T04:19:06.789506+0000","last_active":"2023-08-25T04:19:09.118578+0000","last_peered":"2023-08-25T04:19:09.118578+0000","last_clean":"2023-08-25T04:19:09.118578+0000","last_became_active":"2023-08-25T04:19:06.789231+0000","last_became_peered":"2023-08-25T04:19:06.789231+0000","last_unstale":"2023-08-25T04:19:09.118578+0000","last_undegraded":"2023-08-25T04:19:09.118578+0000","last_fullsized":"2023-08-25T04:19:09.118578+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:23:02.049015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.796840+0000","last_change":"2023-08-25T04:19:05.796702+0000","last_active":"2023-08-25T04:19:07.796840+0000","last_peered":"2023-08-25T04:19:07.796840+0000","last_clean":"2023-08-25T04:19:07.796840+0000","last_became_active":"2023-08-25T04:19:05.795927+0000","last_became_peered":"2023-08-25T04:19:05.795927+0000","last_unstale":"2023-08-25T04:19:07.796840+0000","last_undegraded":"2023-08-25T04:19:07.796840+0000","last_fullsized":"2023-08-25T04:19:07.796840+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:29:52.741083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118703+0000","last_change":"2023-08-25T04:19:06.796812+0000","last_active":"2023-08-25T04:19:09.118703+0000","last_peered":"2023-08-25T04:19:09.118703+0000","last_clean":"2023-08-25T04:19:09.118703+0000","last_became_active":"2023-08-25T04:19:06.796488+0000","last_became_peered":"2023-08-25T04:19:06.796488+0000","last_unstale":"2023-08-25T04:19:09.118703+0000","last_undegraded":"2023-08-25T04:19:09.118703+0000","last_fullsized":"2023-08-25T04:19:09.118703+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:26:10.267546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.119824+0000","last_change":"2023-08-25T04:19:05.794685+0000","last_active":"2023-08-25T04:19:09.119824+0000","last_peered":"2023-08-25T04:19:09.119824+0000","last_clean":"2023-08-25T04:19:09.119824+0000","last_became_active":"2023-08-25T04:19:05.794408+0000","last_became_peered":"2023-08-25T04:19:05.794408+0000","last_unstale":"2023-08-25T04:19:09.119824+0000","last_undegraded":"2023-08-25T04:19:09.119824+0000","last_fullsized":"2023-08-25T04:19:09.119824+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:01.173011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118716+0000","last_change":"2023-08-25T04:19:06.795860+0000","last_active":"2023-08-25T04:19:09.118716+0000","last_peered":"2023-08-25T04:19:09.118716+0000","last_clean":"2023-08-25T04:19:09.118716+0000","last_became_active":"2023-08-25T04:19:06.795507+0000","last_became_peered":"2023-08-25T04:19:06.795507+0000","last_unstale":"2023-08-25T04:19:09.118716+0000","last_undegraded":"2023-08-25T04:19:09.118716+0000","last_fullsized":"2023-08-25T04:19:09.118716+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:42:36.972680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"92'8","reported_seq":21,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992857+0000","last_change":"2023-08-25T04:19:05.801498+0000","last_active":"2023-08-25T04:19:07.992857+0000","last_peered":"2023-08-25T04:19:07.992857+0000","last_clean":"2023-08-25T04:19:07.992857+0000","last_became_active":"2023-08-25T04:19:05.801196+0000","last_became_peered":"2023-08-25T04:19:05.801196+0000","last_unstale":"2023-08-25T04:19:07.992857+0000","last_undegraded":"2023-08-25T04:19:07.992857+0000","last_fullsized":"2023-08-25T04:19:07.992857+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:02:57.649655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797041+0000","last_change":"2023-08-25T04:19:06.800402+0000","last_active":"2023-08-25T04:19:07.797041+0000","last_peered":"2023-08-25T04:19:07.797041+0000","last_clean":"2023-08-25T04:19:07.797041+0000","last_became_active":"2023-08-25T04:19:06.798159+0000","last_became_peered":"2023-08-25T04:19:06.798159+0000","last_unstale":"2023-08-25T04:19:07.797041+0000","last_undegraded":"2023-08-25T04:19:07.797041+0000","last_fullsized":"2023-08-25T04:19:07.797041+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:09:50.378669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"92'2","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.646447+0000","last_change":"2023-08-25T04:19:05.798655+0000","last_active":"2023-08-25T04:19:08.646447+0000","last_peered":"2023-08-25T04:19:08.646447+0000","last_clean":"2023-08-25T04:19:08.646447+0000","last_became_active":"2023-08-25T04:19:05.798355+0000","last_became_peered":"2023-08-25T04:19:05.798355+0000","last_unstale":"2023-08-25T04:19:08.646447+0000","last_undegraded":"2023-08-25T04:19:08.646447+0000","last_fullsized":"2023-08-25T04:19:08.646447+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:07:18.926667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118399+0000","last_change":"2023-08-25T04:19:06.795611+0000","last_active":"2023-08-25T04:19:09.118399+0000","last_peered":"2023-08-25T04:19:09.118399+0000","last_clean":"2023-08-25T04:19:09.118399+0000","last_became_active":"2023-08-25T04:19:06.795266+0000","last_became_peered":"2023-08-25T04:19:06.795266+0000","last_unstale":"2023-08-25T04:19:09.118399+0000","last_undegraded":"2023-08-25T04:19:09.118399+0000","last_fullsized":"2023-08-25T04:19:09.118399+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:05:13.841755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.993085+0000","last_change":"2023-08-25T04:19:05.800768+0000","last_active":"2023-08-25T04:19:07.993085+0000","last_peered":"2023-08-25T04:19:07.993085+0000","last_clean":"2023-08-25T04:19:07.993085+0000","last_became_active":"2023-08-25T04:19:05.800468+0000","last_became_peered":"2023-08-25T04:19:05.800468+0000","last_unstale":"2023-08-25T04:19:07.993085+0000","last_undegraded":"2023-08-25T04:19:07.993085+0000","last_fullsized":"2023-08-25T04:19:07.993085+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:40:17.969894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797405+0000","last_change":"2023-08-25T04:19:06.793569+0000","last_active":"2023-08-25T04:19:07.797405+0000","last_peered":"2023-08-25T04:19:07.797405+0000","last_clean":"2023-08-25T04:19:07.797405+0000","last_became_active":"2023-08-25T04:19:06.793284+0000","last_became_peered":"2023-08-25T04:19:06.793284+0000","last_unstale":"2023-08-25T04:19:07.797405+0000","last_undegraded":"2023-08-25T04:19:07.797405+0000","last_fullsized":"2023-08-25T04:19:07.797405+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:11:24.568378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797439+0000","last_change":"2023-08-25T04:19:05.792758+0000","last_active":"2023-08-25T04:19:07.797439+0000","last_peered":"2023-08-25T04:19:07.797439+0000","last_clean":"2023-08-25T04:19:07.797439+0000","last_became_active":"2023-08-25T04:19:05.792491+0000","last_became_peered":"2023-08-25T04:19:05.792491+0000","last_unstale":"2023-08-25T04:19:07.797439+0000","last_undegraded":"2023-08-25T04:19:07.797439+0000","last_fullsized":"2023-08-25T04:19:07.797439+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:52:24.044017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992872+0000","last_change":"2023-08-25T04:19:06.803545+0000","last_active":"2023-08-25T04:19:07.992872+0000","last_peered":"2023-08-25T04:19:07.992872+0000","last_clean":"2023-08-25T04:19:07.992872+0000","last_became_active":"2023-08-25T04:19:06.803259+0000","last_became_peered":"2023-08-25T04:19:06.803259+0000","last_unstale":"2023-08-25T04:19:07.992872+0000","last_undegraded":"2023-08-25T04:19:07.992872+0000","last_fullsized":"2023-08-25T04:19:07.992872+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:08.666434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797186+0000","last_change":"2023-08-25T04:19:05.795779+0000","last_active":"2023-08-25T04:19:07.797186+0000","last_peered":"2023-08-25T04:19:07.797186+0000","last_clean":"2023-08-25T04:19:07.797186+0000","last_became_active":"2023-08-25T04:19:05.795504+0000","last_became_peered":"2023-08-25T04:19:05.795504+0000","last_unstale":"2023-08-25T04:19:07.797186+0000","last_undegraded":"2023-08-25T04:19:07.797186+0000","last_fullsized":"2023-08-25T04:19:07.797186+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:05:06.348539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118350+0000","last_change":"2023-08-25T04:19:06.795930+0000","last_active":"2023-08-25T04:19:09.118350+0000","last_peered":"2023-08-25T04:19:09.118350+0000","last_clean":"2023-08-25T04:19:09.118350+0000","last_became_active":"2023-08-25T04:19:06.795414+0000","last_became_peered":"2023-08-25T04:19:06.795414+0000","last_unstale":"2023-08-25T04:19:09.118350+0000","last_undegraded":"2023-08-25T04:19:09.118350+0000","last_fullsized":"2023-08-25T04:19:09.118350+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:37.144913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118268+0000","last_change":"2023-08-25T04:19:05.790574+0000","last_active":"2023-08-25T04:19:09.118268+0000","last_peered":"2023-08-25T04:19:09.118268+0000","last_clean":"2023-08-25T04:19:09.118268+0000","last_became_active":"2023-08-25T04:19:05.790235+0000","last_became_peered":"2023-08-25T04:19:05.790235+0000","last_unstale":"2023-08-25T04:19:09.118268+0000","last_undegraded":"2023-08-25T04:19:09.118268+0000","last_fullsized":"2023-08-25T04:19:09.118268+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:59:56.437481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118487+0000","last_change":"2023-08-25T04:19:06.788969+0000","last_active":"2023-08-25T04:19:09.118487+0000","last_peered":"2023-08-25T04:19:09.118487+0000","last_clean":"2023-08-25T04:19:09.118487+0000","last_became_active":"2023-08-25T04:19:06.788620+0000","last_became_peered":"2023-08-25T04:19:06.788620+0000","last_unstale":"2023-08-25T04:19:09.118487+0000","last_undegraded":"2023-08-25T04:19:09.118487+0000","last_fullsized":"2023-08-25T04:19:09.118487+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:51:11.868463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120136+0000","last_change":"2023-08-25T04:19:05.796040+0000","last_active":"2023-08-25T04:19:09.120136+0000","last_peered":"2023-08-25T04:19:09.120136+0000","last_clean":"2023-08-25T04:19:09.120136+0000","last_became_active":"2023-08-25T04:19:05.795722+0000","last_became_peered":"2023-08-25T04:19:05.795722+0000","last_unstale":"2023-08-25T04:19:09.120136+0000","last_undegraded":"2023-08-25T04:19:09.120136+0000","last_fullsized":"2023-08-25T04:19:09.120136+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:25:50.855519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120981+0000","last_change":"2023-08-25T04:19:06.814859+0000","last_active":"2023-08-25T04:19:09.120981+0000","last_peered":"2023-08-25T04:19:09.120981+0000","last_clean":"2023-08-25T04:19:09.120981+0000","last_became_active":"2023-08-25T04:19:06.814459+0000","last_became_peered":"2023-08-25T04:19:06.814459+0000","last_unstale":"2023-08-25T04:19:09.120981+0000","last_undegraded":"2023-08-25T04:19:09.120981+0000","last_fullsized":"2023-08-25T04:19:09.120981+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:09:38.684082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118518+0000","last_change":"2023-08-25T04:19:05.787330+0000","last_active":"2023-08-25T04:19:09.118518+0000","last_peered":"2023-08-25T04:19:09.118518+0000","last_clean":"2023-08-25T04:19:09.118518+0000","last_became_active":"2023-08-25T04:19:05.787029+0000","last_became_peered":"2023-08-25T04:19:05.787029+0000","last_unstale":"2023-08-25T04:19:09.118518+0000","last_undegraded":"2023-08-25T04:19:09.118518+0000","last_fullsized":"2023-08-25T04:19:09.118518+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:51:04.868435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.121148+0000","last_change":"2023-08-25T04:19:06.794380+0000","last_active":"2023-08-25T04:19:09.121148+0000","last_peered":"2023-08-25T04:19:09.121148+0000","last_clean":"2023-08-25T04:19:09.121148+0000","last_became_active":"2023-08-25T04:19:06.794114+0000","last_became_peered":"2023-08-25T04:19:06.794114+0000","last_unstale":"2023-08-25T04:19:09.121148+0000","last_undegraded":"2023-08-25T04:19:09.121148+0000","last_fullsized":"2023-08-25T04:19:09.121148+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:26:33.985591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120602+0000","last_change":"2023-08-25T04:19:05.796058+0000","last_active":"2023-08-25T04:19:09.120602+0000","last_peered":"2023-08-25T04:19:09.120602+0000","last_clean":"2023-08-25T04:19:09.120602+0000","last_became_active":"2023-08-25T04:19:05.795793+0000","last_became_peered":"2023-08-25T04:19:05.795793+0000","last_unstale":"2023-08-25T04:19:09.120602+0000","last_undegraded":"2023-08-25T04:19:09.120602+0000","last_fullsized":"2023-08-25T04:19:09.120602+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:44:05.626322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797329+0000","last_change":"2023-08-25T04:19:06.796635+0000","last_active":"2023-08-25T04:19:07.797329+0000","last_peered":"2023-08-25T04:19:07.797329+0000","last_clean":"2023-08-25T04:19:07.797329+0000","last_became_active":"2023-08-25T04:19:06.796351+0000","last_became_peered":"2023-08-25T04:19:06.796351+0000","last_unstale":"2023-08-25T04:19:07.797329+0000","last_undegraded":"2023-08-25T04:19:07.797329+0000","last_fullsized":"2023-08-25T04:19:07.797329+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:13:30.719086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800845+0000","last_change":"2023-08-25T04:19:05.789915+0000","last_active":"2023-08-25T04:19:07.800845+0000","last_peered":"2023-08-25T04:19:07.800845+0000","last_clean":"2023-08-25T04:19:07.800845+0000","last_became_active":"2023-08-25T04:19:05.789631+0000","last_became_peered":"2023-08-25T04:19:05.789631+0000","last_unstale":"2023-08-25T04:19:07.800845+0000","last_undegraded":"2023-08-25T04:19:07.800845+0000","last_fullsized":"2023-08-25T04:19:07.800845+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:38.229512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"81'179","reported_seq":519,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.796947+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:19:07.796947+0000","last_peered":"2023-08-25T04:19:07.796947+0000","last_clean":"2023-08-25T04:19:07.796947+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:19:07.796947+0000","last_undegraded":"2023-08-25T04:19:07.796947+0000","last_fullsized":"2023-08-25T04:19:07.796947+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:30:07.759658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":656,"num_read_kb":1306,"num_write":271,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":138,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.645983+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:19:08.645983+0000","last_peered":"2023-08-25T04:19:08.645983+0000","last_clean":"2023-08-25T04:19:08.645983+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:19:08.645983+0000","last_undegraded":"2023-08-25T04:19:08.645983+0000","last_fullsized":"2023-08-25T04:19:08.645983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:33:29.654937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.993068+0000","last_change":"2023-08-25T04:19:06.806675+0000","last_active":"2023-08-25T04:19:07.993068+0000","last_peered":"2023-08-25T04:19:07.993068+0000","last_clean":"2023-08-25T04:19:07.993068+0000","last_became_active":"2023-08-25T04:19:06.806004+0000","last_became_peered":"2023-08-25T04:19:06.806004+0000","last_unstale":"2023-08-25T04:19:07.993068+0000","last_undegraded":"2023-08-25T04:19:07.993068+0000","last_fullsized":"2023-08-25T04:19:07.993068+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:17.162595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800253+0000","last_change":"2023-08-25T04:19:05.788136+0000","last_active":"2023-08-25T04:19:07.800253+0000","last_peered":"2023-08-25T04:19:07.800253+0000","last_clean":"2023-08-25T04:19:07.800253+0000","last_became_active":"2023-08-25T04:19:05.787861+0000","last_became_peered":"2023-08-25T04:19:05.787861+0000","last_unstale":"2023-08-25T04:19:07.800253+0000","last_undegraded":"2023-08-25T04:19:07.800253+0000","last_fullsized":"2023-08-25T04:19:07.800253+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:16:01.758215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":143,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.796921+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:19:07.796921+0000","last_peered":"2023-08-25T04:19:07.796921+0000","last_clean":"2023-08-25T04:19:07.796921+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:19:07.796921+0000","last_undegraded":"2023-08-25T04:19:07.796921+0000","last_fullsized":"2023-08-25T04:19:07.796921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:25:55.859207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118869+0000","last_change":"2023-08-25T04:19:06.794416+0000","last_active":"2023-08-25T04:19:09.118869+0000","last_peered":"2023-08-25T04:19:09.118869+0000","last_clean":"2023-08-25T04:19:09.118869+0000","last_became_active":"2023-08-25T04:19:06.793607+0000","last_became_peered":"2023-08-25T04:19:06.793607+0000","last_unstale":"2023-08-25T04:19:09.118869+0000","last_undegraded":"2023-08-25T04:19:09.118869+0000","last_fullsized":"2023-08-25T04:19:09.118869+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:03:58.982642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800470+0000","last_change":"2023-08-25T04:19:05.787819+0000","last_active":"2023-08-25T04:19:07.800470+0000","last_peered":"2023-08-25T04:19:07.800470+0000","last_clean":"2023-08-25T04:19:07.800470+0000","last_became_active":"2023-08-25T04:19:05.787425+0000","last_became_peered":"2023-08-25T04:19:05.787425+0000","last_unstale":"2023-08-25T04:19:07.800470+0000","last_undegraded":"2023-08-25T04:19:07.800470+0000","last_fullsized":"2023-08-25T04:19:07.800470+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:47:57.720421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":142,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.119843+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:19:09.119843+0000","last_peered":"2023-08-25T04:19:09.119843+0000","last_clean":"2023-08-25T04:19:09.119843+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:19:09.119843+0000","last_undegraded":"2023-08-25T04:19:09.119843+0000","last_fullsized":"2023-08-25T04:19:09.119843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:28:05.031810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.992877+0000","last_change":"2023-08-25T04:19:06.808432+0000","last_active":"2023-08-25T04:19:07.992877+0000","last_peered":"2023-08-25T04:19:07.992877+0000","last_clean":"2023-08-25T04:19:07.992877+0000","last_became_active":"2023-08-25T04:19:06.808103+0000","last_became_peered":"2023-08-25T04:19:06.808103+0000","last_unstale":"2023-08-25T04:19:07.992877+0000","last_undegraded":"2023-08-25T04:19:07.992877+0000","last_fullsized":"2023-08-25T04:19:07.992877+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:18:28.595821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"92'2","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800561+0000","last_change":"2023-08-25T04:19:05.798088+0000","last_active":"2023-08-25T04:19:07.800561+0000","last_peered":"2023-08-25T04:19:07.800561+0000","last_clean":"2023-08-25T04:19:07.800561+0000","last_became_active":"2023-08-25T04:19:05.797713+0000","last_became_peered":"2023-08-25T04:19:05.797713+0000","last_unstale":"2023-08-25T04:19:07.800561+0000","last_undegraded":"2023-08-25T04:19:07.800561+0000","last_fullsized":"2023-08-25T04:19:07.800561+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:51:15.650436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":138,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:08.645988+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:19:08.645988+0000","last_peered":"2023-08-25T04:19:08.645988+0000","last_clean":"2023-08-25T04:19:08.645988+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:19:08.645988+0000","last_undegraded":"2023-08-25T04:19:08.645988+0000","last_fullsized":"2023-08-25T04:19:08.645988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:57:05.345769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120206+0000","last_change":"2023-08-25T04:19:06.809519+0000","last_active":"2023-08-25T04:19:09.120206+0000","last_peered":"2023-08-25T04:19:09.120206+0000","last_clean":"2023-08-25T04:19:09.120206+0000","last_became_active":"2023-08-25T04:19:06.809252+0000","last_became_peered":"2023-08-25T04:19:06.809252+0000","last_unstale":"2023-08-25T04:19:09.120206+0000","last_undegraded":"2023-08-25T04:19:09.120206+0000","last_fullsized":"2023-08-25T04:19:09.120206+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:46:43.910124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"92'1","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120292+0000","last_change":"2023-08-25T04:19:05.797620+0000","last_active":"2023-08-25T04:19:09.120292+0000","last_peered":"2023-08-25T04:19:09.120292+0000","last_clean":"2023-08-25T04:19:09.120292+0000","last_became_active":"2023-08-25T04:19:05.797319+0000","last_became_peered":"2023-08-25T04:19:05.797319+0000","last_unstale":"2023-08-25T04:19:09.120292+0000","last_undegraded":"2023-08-25T04:19:09.120292+0000","last_fullsized":"2023-08-25T04:19:09.120292+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:58:00.877612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":156,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120826+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:19:09.120826+0000","last_peered":"2023-08-25T04:19:09.120826+0000","last_clean":"2023-08-25T04:19:09.120826+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:19:09.120826+0000","last_undegraded":"2023-08-25T04:19:09.120826+0000","last_fullsized":"2023-08-25T04:19:09.120826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:21:57.892797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800532+0000","last_change":"2023-08-25T04:19:06.797823+0000","last_active":"2023-08-25T04:19:07.800532+0000","last_peered":"2023-08-25T04:19:07.800532+0000","last_clean":"2023-08-25T04:19:07.800532+0000","last_became_active":"2023-08-25T04:19:06.797336+0000","last_became_peered":"2023-08-25T04:19:06.797336+0000","last_unstale":"2023-08-25T04:19:07.800532+0000","last_undegraded":"2023-08-25T04:19:07.800532+0000","last_fullsized":"2023-08-25T04:19:07.800532+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:19:37.299333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.120739+0000","last_change":"2023-08-25T04:19:05.796924+0000","last_active":"2023-08-25T04:19:09.120739+0000","last_peered":"2023-08-25T04:19:09.120739+0000","last_clean":"2023-08-25T04:19:09.120739+0000","last_became_active":"2023-08-25T04:19:05.796608+0000","last_became_peered":"2023-08-25T04:19:05.796608+0000","last_unstale":"2023-08-25T04:19:09.120739+0000","last_undegraded":"2023-08-25T04:19:09.120739+0000","last_fullsized":"2023-08-25T04:19:09.120739+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:05:34.802200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797513+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:19:07.797513+0000","last_peered":"2023-08-25T04:19:07.797513+0000","last_clean":"2023-08-25T04:19:07.797513+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:19:07.797513+0000","last_undegraded":"2023-08-25T04:19:07.797513+0000","last_fullsized":"2023-08-25T04:19:07.797513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:06:31.060482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.800190+0000","last_change":"2023-08-25T04:19:06.791285+0000","last_active":"2023-08-25T04:19:07.800190+0000","last_peered":"2023-08-25T04:19:07.800190+0000","last_clean":"2023-08-25T04:19:07.800190+0000","last_became_active":"2023-08-25T04:19:06.790990+0000","last_became_peered":"2023-08-25T04:19:06.790990+0000","last_unstale":"2023-08-25T04:19:07.800190+0000","last_undegraded":"2023-08-25T04:19:07.800190+0000","last_fullsized":"2023-08-25T04:19:07.800190+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:18:51.462263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"92'1","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797888+0000","last_change":"2023-08-25T04:19:05.799471+0000","last_active":"2023-08-25T04:19:07.797888+0000","last_peered":"2023-08-25T04:19:07.797888+0000","last_clean":"2023-08-25T04:19:07.797888+0000","last_became_active":"2023-08-25T04:19:05.798984+0000","last_became_peered":"2023-08-25T04:19:05.798984+0000","last_unstale":"2023-08-25T04:19:07.797888+0000","last_undegraded":"2023-08-25T04:19:07.797888+0000","last_fullsized":"2023-08-25T04:19:07.797888+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:06:40.301579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":156,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.121068+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:19:09.121068+0000","last_peered":"2023-08-25T04:19:09.121068+0000","last_clean":"2023-08-25T04:19:09.121068+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:19:09.121068+0000","last_undegraded":"2023-08-25T04:19:09.121068+0000","last_fullsized":"2023-08-25T04:19:09.121068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:31:19.603961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.119762+0000","last_change":"2023-08-25T04:19:06.808048+0000","last_active":"2023-08-25T04:19:09.119762+0000","last_peered":"2023-08-25T04:19:09.119762+0000","last_clean":"2023-08-25T04:19:09.119762+0000","last_became_active":"2023-08-25T04:19:06.807064+0000","last_became_peered":"2023-08-25T04:19:06.807064+0000","last_unstale":"2023-08-25T04:19:09.119762+0000","last_undegraded":"2023-08-25T04:19:09.119762+0000","last_fullsized":"2023-08-25T04:19:09.119762+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:05.763844+0000","last_clean_scrub_stamp":"2023-08-25T04:19:05.763844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:47:17.561647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"92'2","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:07.797742+0000","last_change":"2023-08-25T04:19:05.797775+0000","last_active":"2023-08-25T04:19:07.797742+0000","last_peered":"2023-08-25T04:19:07.797742+0000","last_clean":"2023-08-25T04:19:07.797742+0000","last_became_active":"2023-08-25T04:19:05.797295+0000","last_became_peered":"2023-08-25T04:19:05.797295+0000","last_unstale":"2023-08-25T04:19:07.797742+0000","last_undegraded":"2023-08-25T04:19:07.797742+0000","last_fullsized":"2023-08-25T04:19:07.797742+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:04.746203+0000","last_clean_scrub_stamp":"2023-08-25T04:19:04.746203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:51:10.850823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":158,"reported_epoch":93,"state":"active+clean","last_fresh":"2023-08-25T04:19:09.118804+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:19:09.118804+0000","last_peered":"2023-08-25T04:19:09.118804+0000","last_clean":"2023-08-25T04:19:09.118804+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:19:09.118804+0000","last_undegraded":"2023-08-25T04:19:09.118804+0000","last_fullsized":"2023-08-25T04:19:09.118804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:01:56.920057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":656,"num_read_kb":1306,"num_write":271,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":179,"ondisk_log_size":179,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509637,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46760,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325080,"statfs":{"total":96636764160,"available":96588881920,"internally_reserved":0,"allocated":1724416,"data_stored":1146476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.45200000000000001,"5min":0.39600000000000002,"15min":0.29199999999999998},"max":{"1min":0.88800000000000001,"5min":0.996,"15min":1.0189999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.435,"5min":0.38,"15min":0.38},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.68300000000000005}]},{"osd":1,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.42699999999999999},"max":{"1min":0.88,"5min":1.0149999999999999,"15min":1.034},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.47099999999999997,"5min":0.44700000000000001,"15min":0.374},"max":{"1min":0.89600000000000002,"5min":0.96099999999999997,"15min":1.036},"last":0.52100000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51700000000000002,"5min":0.42299999999999999,"15min":0.34899999999999998},"max":{"1min":0.94299999999999995,"5min":0.94499999999999995,"15min":1.018},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.54400000000000004,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":0.92300000000000004,"5min":0.98699999999999999,"15min":0.999},"last":0.55600000000000005}]},{"osd":3,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.55000000000000004,"5min":0.47799999999999998,"15min":0.41899999999999998},"max":{"1min":0.90100000000000002,"5min":0.92900000000000005,"15min":0.98399999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.754,"15min":0.75600000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.432},"max":{"1min":1.012,"5min":1.04,"15min":1.0449999999999999},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41599999999999998,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.82599999999999996,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58999999999999997,"15min":0.60999999999999999},"min":{"1min":0.40600000000000003,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":0.90400000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.49199999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60799999999999998,"15min":0.61899999999999999},"min":{"1min":0.46300000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.96799999999999997,"5min":0.99199999999999999,"15min":0.998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.63700000000000001,"15min":0.63900000000000001},"min":{"1min":0.48699999999999999,"5min":0.41099999999999998,"15min":0.40000000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.0349999999999999},"last":0.626}]},{"osd":6,"last update":"Fri Aug 25 04:18:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.68999999999999995,"15min":0.69699999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.436},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.0620000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65100000000000002,"15min":0.66700000000000004},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42399999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66700000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509637,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1138688,"data_stored":557698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68600000000000005,"15min":0.70699999999999996},"min":{"1min":0.46300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97599999999999998,"5min":1.0089999999999999,"15min":1.0369999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68500000000000005,"15min":0.69799999999999995},"min":{"1min":0.46800000000000003,"5min":0.40400000000000003,"15min":0.33800000000000002},"max":{"1min":0.91900000000000004,"5min":0.96899999999999997,"15min":1.071},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71099999999999997,"15min":0.73099999999999998},"min":{"1min":0.44600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.1559999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.59699999999999998,"5min":0.495,"15min":0.47199999999999998},"max":{"1min":0.93500000000000005,"5min":0.996,"15min":1.077},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.47999999999999998,"5min":0.44,"15min":0.434},"max":{"1min":0.95199999999999996,"5min":0.98399999999999999,"15min":1.139},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77300000000000002,"15min":0.79500000000000004},"min":{"1min":0.56299999999999994,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.96099999999999997,"5min":1.0569999999999999,"15min":1.117},"last":0.65400000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.746,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.50600000000000001,"15min":0.46899999999999997},"max":{"1min":0.93400000000000005,"5min":1.0600000000000001,"15min":1.077},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.90900000000000003,"5min":1.075,"15min":1.679},"last":0.73299999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59699999999999998,"15min":0.60099999999999998},"min":{"1min":0.42999999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93000000000000005,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.60099999999999998},"min":{"1min":0.41599999999999998,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":0.86799999999999999,"5min":0.92900000000000005,"15min":1.306},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.41299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.73299999999999998,"15min":0.73999999999999999},"min":{"1min":0.56999999999999995,"5min":0.434,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":1.1120000000000001,"15min":1.5589999999999999},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.65300000000000002,"15min":0.66600000000000004},"min":{"1min":0.51400000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86699999999999999,"5min":1.032,"15min":1.1950000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.71199999999999997,"15min":0.70499999999999996},"min":{"1min":0.48799999999999999,"5min":0.44700000000000001,"15min":0.41799999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.4099999999999999},"last":0.69499999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542340,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":549467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.68200000000000005,"15min":0.70999999999999996},"min":{"1min":0.55800000000000005,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.88500000000000001,"5min":0.94999999999999996,"15min":1.018},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.57499999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86699999999999999,"5min":0.995,"15min":1.0409999999999999},"last":0.81999999999999995}]},{"osd":1,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72299999999999998,"15min":0.73699999999999999},"min":{"1min":0.52100000000000002,"5min":0.43099999999999999,"15min":0.36499999999999999},"max":{"1min":0.878,"5min":0.98699999999999999,"15min":0.99399999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.56899999999999995,"5min":0.47599999999999998,"15min":0.46200000000000002},"max":{"1min":0.90400000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.90400000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.72999999999999998},"min":{"1min":0.42999999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88500000000000001,"5min":0.97499999999999998,"15min":1.0269999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.751},"min":{"1min":0.55300000000000005,"5min":0.47699999999999998,"15min":0.46300000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.2290000000000001},"last":0.92600000000000005}]},{"osd":3,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.59199999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92100000000000004,"5min":0.94199999999999995,"15min":1.4590000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73799999999999999,"15min":0.76600000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.018,"15min":1.1479999999999999},"last":1.028}]},{"osd":4,"last update":"Fri Aug 25 04:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.67000000000000004,"5min":0.97099999999999997,"15min":1.038},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.79600000000000004,"5min":1.018,"15min":1.018},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.626,"15min":0.64000000000000001},"min":{"1min":0.48299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":1.256},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.65900000000000003},"min":{"1min":0.50800000000000001,"5min":0.46400000000000002,"15min":0.45800000000000002},"max":{"1min":0.90400000000000003,"5min":0.98299999999999998,"15min":1.4650000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61199999999999999,"15min":0.626},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.90900000000000003,"5min":1.002,"15min":1.2769999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69299999999999995,"15min":0.70499999999999996},"min":{"1min":0.51900000000000002,"5min":0.47799999999999998,"15min":0.45100000000000001},"max":{"1min":0.80000000000000004,"5min":0.96899999999999997,"15min":1.1819999999999999},"last":0.71899999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542340,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36464,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335376,"statfs":{"total":96636764160,"available":96599425024,"internally_reserved":0,"allocated":1146880,"data_stored":557802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.71399999999999997,"15min":0.70599999999999996},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.86599999999999999,"5min":0.99299999999999999,"15min":1.2649999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.45500000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85199999999999998,"5min":0.878,"15min":1.1639999999999999},"last":0.48599999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.73299999999999998,"15min":0.72499999999999998},"min":{"1min":0.45400000000000001,"5min":0.45100000000000001,"15min":0.36199999999999999},"max":{"1min":0.98399999999999999,"5min":1.0189999999999999,"15min":1.0449999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.56499999999999995,"5min":0.47199999999999998,"15min":0.39100000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.74399999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.34000000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.67400000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.45100000000000001},"max":{"1min":0.91100000000000003,"5min":0.98299999999999998,"15min":1.048},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.76300000000000001,"15min":0.75900000000000001},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.48399999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38300000000000001,"5min":0.378,"15min":0.32200000000000001},"max":{"1min":0.77900000000000003,"5min":0.94799999999999995,"15min":0.94899999999999995},"last":0.374},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.376,"15min":0.33200000000000002},"max":{"1min":0.81799999999999995,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.437}]},{"osd":6,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.92800000000000005,"5min":1.093,"15min":1.093},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64600000000000002,"15min":0.64700000000000002},"min":{"1min":0.44500000000000001,"5min":0.40999999999999998,"15min":0.40300000000000002},"max":{"1min":0.871,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.441,"5min":0.435,"15min":0.36699999999999999},"max":{"1min":0.78700000000000003,"5min":0.90100000000000002,"15min":1.0609999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69199999999999995,"15min":0.70399999999999996},"min":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.39300000000000002},"max":{"1min":0.92400000000000004,"5min":0.99399999999999999,"15min":1.0940000000000001},"last":0.60699999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542340,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36444,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335396,"statfs":{"total":96636764160,"available":96599445504,"internally_reserved":0,"allocated":1130496,"data_stored":556668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44400000000000001,"15min":0.44800000000000001},"min":{"1min":0.313,"5min":0.27300000000000002,"15min":0.247},"max":{"1min":0.67200000000000004,"5min":0.93700000000000006,"15min":0.96899999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.308},"max":{"1min":0.70799999999999996,"5min":0.77100000000000002,"15min":0.91500000000000004},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.495},"min":{"1min":0.36599999999999999,"5min":0.32800000000000001,"15min":0.27000000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.746},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.59499999999999997},"min":{"1min":0.41499999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80300000000000005,"5min":0.83099999999999996,"15min":0.92600000000000005},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.57099999999999995},"min":{"1min":0.45400000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":1.01},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.35299999999999998},"max":{"1min":0.72899999999999998,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.58199999999999996}]},{"osd":4,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76200000000000001,"15min":0.75800000000000001},"min":{"1min":0.52300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1719999999999999,"5min":1.214,"15min":1.4339999999999999},"last":0.621},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.64200000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98599999999999999,"5min":1.2450000000000001,"15min":1.343},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56899999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0549999999999999,"5min":1.254,"15min":1.321},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":1.0900000000000001,"5min":1.1950000000000001,"15min":1.4750000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81000000000000005,"15min":0.80700000000000005},"min":{"1min":0.55800000000000005,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":1.077,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.79100000000000004,"15min":0.80700000000000005},"min":{"1min":0.61699999999999999,"5min":0.51600000000000001,"15min":0.50700000000000001},"max":{"1min":0.99299999999999999,"5min":1.0800000000000001,"15min":1.3600000000000001},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.68100000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.042,"5min":1.077,"15min":1.383},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80600000000000005,"15min":0.79900000000000004},"min":{"1min":0.66200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.016,"5min":1.079,"15min":1.4019999999999999},"last":0.81899999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542341,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54504,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317336,"statfs":{"total":96636764160,"available":96580952064,"internally_reserved":0,"allocated":1138688,"data_stored":556828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.378,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.65100000000000002,"5min":0.85599999999999998,"15min":1.196},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.504,"15min":0.501},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68700000000000006,"5min":0.81000000000000005,"15min":1.4019999999999999},"last":0.442}]},{"osd":1,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48599999999999999,"15min":0.48899999999999999},"min":{"1min":0.32600000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.69999999999999996,"5min":0.78800000000000003,"15min":1.482},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59599999999999997,"15min":0.60099999999999998},"min":{"1min":0.46100000000000002,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":1.458},"last":0.51900000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.41999999999999998,"5min":0.36499999999999999,"15min":0.34499999999999997},"max":{"1min":0.80300000000000005,"5min":0.82199999999999995,"15min":0.82299999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56899999999999995,"15min":0.56499999999999995},"min":{"1min":0.40899999999999997,"5min":0.375,"15min":0.33700000000000002},"max":{"1min":0.751,"5min":0.85399999999999998,"15min":0.95599999999999996},"last":0.499}]},{"osd":4,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.80400000000000005,"15min":0.80100000000000005},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.499},"max":{"1min":0.98399999999999999,"5min":1.1990000000000001,"15min":1.2569999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78800000000000003,"15min":0.79000000000000004},"min":{"1min":0.51800000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0069999999999999,"5min":1.151,"15min":1.5509999999999999},"last":0.89400000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.80800000000000005,"15min":0.80400000000000005},"min":{"1min":0.63300000000000001,"5min":0.52600000000000002,"15min":0.47999999999999998},"max":{"1min":0.995,"5min":1.1140000000000001,"15min":1.2789999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.59899999999999998,"5min":0.58499999999999996,"15min":0.48299999999999998},"max":{"1min":1.02,"5min":1.2130000000000001,"15min":1.3089999999999999},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.93100000000000005,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.85799999999999998,"15min":0.85699999999999998},"min":{"1min":0.68500000000000005,"5min":0.58799999999999997,"15min":0.55600000000000005},"max":{"1min":1.014,"5min":1.25,"15min":1.375},"last":0.82699999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:18:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81100000000000005,"15min":0.80700000000000005},"min":{"1min":0.58299999999999996,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":0.99199999999999999,"5min":1.2090000000000001,"15min":1.339},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81599999999999995,"15min":0.81299999999999994},"min":{"1min":0.55200000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0149999999999999,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.79500000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542341,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36436,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335404,"statfs":{"total":96636764160,"available":96599453696,"internally_reserved":0,"allocated":1122304,"data_stored":549545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46500000000000002,"15min":0.46300000000000002},"min":{"1min":0.27800000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.66500000000000004,"5min":0.85599999999999998,"15min":1.218},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56299999999999994,"15min":0.52600000000000002},"min":{"1min":0.374,"5min":0.33200000000000002,"15min":0.29499999999999998},"max":{"1min":0.85099999999999998,"5min":1.212,"15min":1.212},"last":0.33500000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51500000000000001,"15min":0.502},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.66300000000000003,"5min":0.876,"15min":1.347},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":1.093},"last":0.45500000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.62},"min":{"1min":0.41599999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.74099999999999999,"5min":0.93100000000000005,"15min":1.1459999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.34699999999999998,"5min":0.34599999999999997,"15min":0.33200000000000002},"max":{"1min":0.84299999999999997,"5min":1.165,"15min":1.2190000000000001},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.51600000000000001,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":1.004,"5min":1.204,"15min":1.47},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.80300000000000005,"15min":0.81100000000000005},"min":{"1min":0.60399999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.0269999999999999,"5min":1.2529999999999999,"15min":1.395},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.45100000000000001},"max":{"1min":0.96499999999999997,"5min":1.254,"15min":1.292},"last":0.626},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81299999999999994,"15min":0.81499999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51000000000000001},"max":{"1min":1.044,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.70099999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.171,"5min":1.623,"15min":1.623},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.82199999999999995,"15min":0.80600000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.54200000000000004},"max":{"1min":1.01,"5min":1.288,"15min":1.355},"last":0.68999999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.57399999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0760000000000001,"5min":1.1240000000000001,"15min":1.5429999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.63400000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.073,"5min":1.1140000000000001,"15min":1.504},"last":0.752}]}]},{"osd":0,"up_from":14,"seq":60129542340,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37024,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334816,"statfs":{"total":96636764160,"available":96598851584,"internally_reserved":0,"allocated":1720320,"data_stored":1146454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.501,"15min":0.48899999999999999},"min":{"1min":0.30399999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67700000000000005,"5min":0.72499999999999998,"15min":0.79500000000000004},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57199999999999995,"15min":0.56399999999999995},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.35499999999999998},"max":{"1min":0.68400000000000005,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.35399999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70099999999999996,"5min":0.82299999999999995,"15min":0.97499999999999998},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55500000000000005,"15min":0.54000000000000004},"min":{"1min":0.39500000000000002,"5min":0.34999999999999998,"15min":0.33700000000000002},"max":{"1min":0.876,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.48899999999999999,"15min":0.499},"min":{"1min":0.36299999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":1.266},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.45600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76800000000000002,"5min":0.85099999999999998,"15min":1.2470000000000001},"last":0.50800000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.79900000000000004},"min":{"1min":0.60799999999999998,"5min":0.52600000000000002,"15min":0.503},"max":{"1min":1.048,"5min":1.1739999999999999,"15min":1.306},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.58699999999999997,"5min":0.497,"15min":0.436},"max":{"1min":1.169,"5min":1.169,"15min":1.262},"last":0.68700000000000006}]},{"osd":5,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81499999999999995,"15min":0.80500000000000005},"min":{"1min":0.57499999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.131,"5min":3.528,"15min":3.528},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.53000000000000003,"5min":0.47199999999999998,"15min":0.45500000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.373},"last":0.72499999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.81699999999999995,"15min":0.80600000000000005},"min":{"1min":0.60599999999999998,"5min":0.54400000000000004,"15min":0.53000000000000003},"max":{"1min":1.0680000000000001,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.60999999999999999,"5min":0.52700000000000002,"15min":0.47399999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.331},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83799999999999997,"15min":0.84699999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.52900000000000003},"max":{"1min":1.151,"5min":1.151,"15min":1.4059999999999999},"last":0.627},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.64600000000000002,"5min":0.53200000000000003,"15min":0.499},"max":{"1min":1.0940000000000001,"5min":1.1220000000000001,"15min":1.3169999999999999},"last":0.75}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:19:11.307 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-25T04:19:11.307 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-25T04:19:11.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa74dc5f640 1 Processor -- start 2023-08-25T04:19:11.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa74dc5f640 1 -- start start 2023-08-25T04:19:11.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa74dc5f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7480ad6b0 0x7fa7480b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa74dc5f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa74806d0d0 0x7fa7480cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa74dc5f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7480cdf20 con 0x7fa7480cb710 2023-08-25T04:19:11.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa74dc5f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74809bc40 con 0x7fa74806d0d0 2023-08-25T04:19:11.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa74dc5f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74809bf20 con 0x7fa7480ad6b0 2023-08-25T04:19:11.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa73ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa7480cb710 0x7fa74806c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33432/0 (socket says 172.21.15.55:33432) 2023-08-25T04:19:11.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa73ffff640 1 -- 172.21.15.55:0/746065317 learned_addr learned my addr 172.21.15.55:0/746065317 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:11.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa7477fe640 1 --2- 172.21.15.55:0/746065317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7480ad6b0 0x7fa7480b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa747fff640 1 --2- 172.21.15.55:0/746065317 >> v2:172.21.15.110:3300/0 conn(0x7fa74806d0d0 0x7fa7480cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa746ffd640 1 -- 172.21.15.55:0/746065317 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154328413 0 0) 0x7fa7480cdf20 con 0x7fa7480cb710 2023-08-25T04:19:11.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa746ffd640 1 -- 172.21.15.55:0/746065317 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa734003530 con 0x7fa7480cb710 2023-08-25T04:19:11.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa746ffd640 1 -- 172.21.15.55:0/746065317 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1303109795 0 0) 0x7fa734003530 con 0x7fa7480cb710 2023-08-25T04:19:11.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa746ffd640 1 -- 172.21.15.55:0/746065317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7480ad6b0 msgr2=0x7fa7480b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:11.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa746ffd640 1 --2- 172.21.15.55:0/746065317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7480ad6b0 0x7fa7480b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa746ffd640 1 -- 172.21.15.55:0/746065317 >> v2:172.21.15.110:3300/0 conn(0x7fa74806d0d0 msgr2=0x7fa7480cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:11.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa746ffd640 1 --2- 172.21.15.55:0/746065317 >> v2:172.21.15.110:3300/0 conn(0x7fa74806d0d0 0x7fa7480cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa746ffd640 1 -- 172.21.15.55:0/746065317 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74806c1c0 con 0x7fa7480cb710 2023-08-25T04:19:11.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa746ffd640 1 -- 172.21.15.55:0/746065317 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fa730001680 con 0x7fa7480cb710 2023-08-25T04:19:11.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa7477fe640 1 --2- 172.21.15.55:0/746065317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7480ad6b0 0x7fa7480b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:11.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa746ffd640 1 -- 172.21.15.55:0/746065317 >> v1:172.21.15.55:6789/0 conn(0x7fa7480cb710 legacy=0x7fa74806c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:11.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa746ffd640 1 --2- 172.21.15.55:0/746065317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa734003980 0x7fa734003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa746ffd640 1 --2- 172.21.15.55:0/746065317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7340047d0 0x7fa734004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa746ffd640 1 --2- 172.21.15.55:0/746065317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7480ad6b0 0x7fa734005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa746ffd640 1 -- 172.21.15.55:0/746065317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74809bc40 con 0x7fa734003980 2023-08-25T04:19:11.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa746ffd640 1 -- 172.21.15.55:0/746065317 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74809bf20 con 0x7fa7340047d0 2023-08-25T04:19:11.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa746ffd640 1 -- 172.21.15.55:0/746065317 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73400dba0 con 0x7fa7480ad6b0 2023-08-25T04:19:11.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa7477fe640 1 --2- 172.21.15.55:0/746065317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa734003980 0x7fa734003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa73ffff640 1 --2- 172.21.15.55:0/746065317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7340047d0 0x7fa734004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.489+0000 7fa747fff640 1 --2- 172.21.15.55:0/746065317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7480ad6b0 0x7fa734005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.493+0000 7fa7477fe640 1 -- 172.21.15.55:0/746065317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7480ad6b0 msgr2=0x7fa734005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:11.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.493+0000 7fa7477fe640 1 --2- 172.21.15.55:0/746065317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7480ad6b0 0x7fa734005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.493+0000 7fa7477fe640 1 -- 172.21.15.55:0/746065317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7340047d0 msgr2=0x7fa734004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:11.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.493+0000 7fa7477fe640 1 --2- 172.21.15.55:0/746065317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7340047d0 0x7fa734004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.493+0000 7fa7477fe640 1 -- 172.21.15.55:0/746065317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7380093b0 con 0x7fa734003980 2023-08-25T04:19:11.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.493+0000 7fa73ffff640 1 --2- 172.21.15.55:0/746065317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7340047d0 0x7fa734004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:11.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.493+0000 7fa7477fe640 1 --2- 172.21.15.55:0/746065317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa734003980 0x7fa734003da0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fa738009c90 tx=0x7fa73801cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae706f45f58739b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:11.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.493+0000 7fa746ffd640 1 -- 172.21.15.55:0/746065317 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7380a5620 con 0x7fa734003980 2023-08-25T04:19:11.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.493+0000 7fa746ffd640 1 -- 172.21.15.55:0/746065317 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7380a5780 con 0x7fa734003980 2023-08-25T04:19:11.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.493+0000 7fa746ffd640 1 -- 172.21.15.55:0/746065317 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7380a5b30 con 0x7fa734003980 2023-08-25T04:19:11.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.493+0000 7fa74dc5f640 1 -- 172.21.15.55:0/746065317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa734003980 msgr2=0x7fa734003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:11.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.493+0000 7fa74dc5f640 1 --2- 172.21.15.55:0/746065317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa734003980 0x7fa734003da0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fa738009c90 tx=0x7fa73801cbd0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.493+0000 7fa747fff640 1 -- 172.21.15.55:0/746065317 reap_dead start 2023-08-25T04:19:11.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.493+0000 7fa74dc5f640 1 -- 172.21.15.55:0/746065317 shutdown_connections 2023-08-25T04:19:11.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.493+0000 7fa74dc5f640 1 -- 172.21.15.55:0/746065317 >> 172.21.15.55:0/746065317 conn(0x7fa748069900 msgr2=0x7fa748069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:11.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa74dc5f640 1 -- 172.21.15.55:0/746065317 shutdown_connections 2023-08-25T04:19:11.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa74dc5f640 1 -- 172.21.15.55:0/746065317 wait complete. 2023-08-25T04:19:11.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa74dc5f640 1 Processor -- start 2023-08-25T04:19:11.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa74dc5f640 1 -- start start 2023-08-25T04:19:11.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa74dc5f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa734003980 0x7fa74815b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa74dc5f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa748147960 0x7fa7480c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa74dc5f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa748147de0 0x7fa7480c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa74dc5f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74815b1e0 con 0x7fa734003980 2023-08-25T04:19:11.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa74dc5f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74815a5d0 con 0x7fa748147960 2023-08-25T04:19:11.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa74dc5f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74815a8b0 con 0x7fa748147de0 2023-08-25T04:19:11.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa7477fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa734003980 0x7fa74815b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa7477fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa734003980 0x7fa74815b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49250/0 (socket says 172.21.15.55:49250) 2023-08-25T04:19:11.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa7477fe640 1 -- 172.21.15.55:0/2069119042 learned_addr learned my addr 172.21.15.55:0/2069119042 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:11.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa747fff640 1 --2- 172.21.15.55:0/2069119042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa748147de0 0x7fa7480c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa73ffff640 1 --2- 172.21.15.55:0/2069119042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa748147960 0x7fa7480c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa7477fe640 1 -- 172.21.15.55:0/2069119042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa748147de0 msgr2=0x7fa7480c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:11.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa7477fe640 1 --2- 172.21.15.55:0/2069119042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa748147de0 0x7fa7480c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa7477fe640 1 -- 172.21.15.55:0/2069119042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa748147960 msgr2=0x7fa7480c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:11.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa7477fe640 1 --2- 172.21.15.55:0/2069119042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa748147960 0x7fa7480c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa7477fe640 1 -- 172.21.15.55:0/2069119042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74815ab90 con 0x7fa734003980 2023-08-25T04:19:11.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa747fff640 1 --2- 172.21.15.55:0/2069119042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa748147de0 0x7fa7480c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:19:11.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa73ffff640 1 --2- 172.21.15.55:0/2069119042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa748147960 0x7fa7480c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:19:11.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa7477fe640 1 --2- 172.21.15.55:0/2069119042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa734003980 0x7fa74815b670 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fa738009c90 tx=0x7fa734005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:11.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa744ff9640 1 -- 172.21.15.55:0/2069119042 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa738006de0 con 0x7fa734003980 2023-08-25T04:19:11.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa744ff9640 1 -- 172.21.15.55:0/2069119042 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa738004020 con 0x7fa734003980 2023-08-25T04:19:11.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa744ff9640 1 -- 172.21.15.55:0/2069119042 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7380043b0 con 0x7fa734003980 2023-08-25T04:19:11.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.497+0000 7fa74dc5f640 1 -- 172.21.15.55:0/2069119042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74815ae70 con 0x7fa734003980 2023-08-25T04:19:11.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.501+0000 7fa74dc5f640 1 -- 172.21.15.55:0/2069119042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74815bbb0 con 0x7fa734003980 2023-08-25T04:19:11.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.501+0000 7fa74dc5f640 1 -- 172.21.15.55:0/2069119042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa748073ec0 con 0x7fa734003980 2023-08-25T04:19:11.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.501+0000 7fa744ff9640 1 -- 172.21.15.55:0/2069119042 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fa7380b4040 con 0x7fa734003980 2023-08-25T04:19:11.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.501+0000 7fa744ff9640 1 --2- 172.21.15.55:0/2069119042 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa7280657d0 0x7fa728067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.501+0000 7fa744ff9640 1 -- 172.21.15.55:0/2069119042 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa73811d2b0 con 0x7fa734003980 2023-08-25T04:19:11.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.501+0000 7fa73ffff640 1 --2- 172.21.15.55:0/2069119042 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa7280657d0 0x7fa728067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.501+0000 7fa73ffff640 1 --2- 172.21.15.55:0/2069119042 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa7280657d0 0x7fa728067c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa7480c9610 tx=0x7fa730000f20 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:11.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.505+0000 7fa744ff9640 1 -- 172.21.15.55:0/2069119042 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa7380eae20 con 0x7fa734003980 2023-08-25T04:19:11.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.717+0000 7fa74dc5f640 1 -- 172.21.15.55:0/2069119042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa7480ccfd0 con 0x7fa734003980 2023-08-25T04:19:11.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.725+0000 7fa744ff9640 1 -- 172.21.15.55:0/2069119042 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa7380ee440 con 0x7fa734003980 2023-08-25T04:19:11.724 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2023-08-25T04:19:11.724 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g== 2023-08-25T04:19:11.724 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2023-08-25T04:19:11.724 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2023-08-25T04:19:11.724 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-25T04:19:11.725 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-08-25T04:19:11.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.725+0000 7fa74dc5f640 1 -- 172.21.15.55:0/2069119042 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa7280657d0 msgr2=0x7fa728067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:11.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.725+0000 7fa74dc5f640 1 --2- 172.21.15.55:0/2069119042 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa7280657d0 0x7fa728067c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa7480c9610 tx=0x7fa730000f20 comp rx=0 tx=0).stop 2023-08-25T04:19:11.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.725+0000 7fa74dc5f640 1 -- 172.21.15.55:0/2069119042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa734003980 msgr2=0x7fa74815b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:11.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.725+0000 7fa74dc5f640 1 --2- 172.21.15.55:0/2069119042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa734003980 0x7fa74815b670 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fa738009c90 tx=0x7fa734005800 comp rx=0 tx=0).stop 2023-08-25T04:19:11.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.725+0000 7fa74dc5f640 1 -- 172.21.15.55:0/2069119042 shutdown_connections 2023-08-25T04:19:11.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.725+0000 7fa74dc5f640 1 --2- 172.21.15.55:0/2069119042 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa7280657d0 0x7fa728067c90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.725+0000 7fa74dc5f640 1 --2- 172.21.15.55:0/2069119042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa748147de0 0x7fa7480c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.725+0000 7fa74dc5f640 1 --2- 172.21.15.55:0/2069119042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa748147960 0x7fa7480c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.725+0000 7fa74dc5f640 1 --2- 172.21.15.55:0/2069119042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa734003980 0x7fa74815b670 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.725+0000 7fa74dc5f640 1 -- 172.21.15.55:0/2069119042 >> 172.21.15.55:0/2069119042 conn(0x7fa748069900 msgr2=0x7fa748155a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:11.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.725+0000 7fa74dc5f640 1 -- 172.21.15.55:0/2069119042 shutdown_connections 2023-08-25T04:19:11.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.725+0000 7fa74dc5f640 1 -- 172.21.15.55:0/2069119042 wait complete. 2023-08-25T04:19:11.745 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:19:11.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.889+0000 7f6b71eec640 1 Processor -- start 2023-08-25T04:19:11.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.893+0000 7f6b71eec640 1 -- start start 2023-08-25T04:19:11.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.893+0000 7f6b71eec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b6c15c9c0 0x7f6b6c160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.893+0000 7f6b71eec640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6b6c0cfa70 0x7f6b6c160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.893+0000 7f6b71eec640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6c06eaf0 con 0x7f6b6c160f90 2023-08-25T04:19:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.893+0000 7f6b71eec640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6c06e530 con 0x7f6b6c0cfa70 2023-08-25T04:19:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.893+0000 7f6b71eec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c06e810 con 0x7f6b6c15c9c0 2023-08-25T04:19:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.893+0000 7f6b6bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6b6c160f90 0x7f6b6c0ce910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33434/0 (socket says 172.21.15.55:33434) 2023-08-25T04:19:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.893+0000 7f6b6bfff640 1 -- 172.21.15.55:0/638393189 learned_addr learned my addr 172.21.15.55:0/638393189 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.893+0000 7f6b63fff640 1 --2- 172.21.15.55:0/638393189 >> v2:172.21.15.110:3300/0 conn(0x7f6b6c0cfa70 0x7f6b6c160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.893+0000 7f6b6b7fe640 1 --2- 172.21.15.55:0/638393189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b6c15c9c0 0x7f6b6c160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.893+0000 7f6b6affd640 1 -- 172.21.15.55:0/638393189 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468757017 0 0) 0x7f6b6c06eaf0 con 0x7f6b6c160f90 2023-08-25T04:19:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.893+0000 7f6b6affd640 1 -- 172.21.15.55:0/638393189 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b58003530 con 0x7f6b6c160f90 2023-08-25T04:19:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.893+0000 7f6b63fff640 1 -- 172.21.15.55:0/638393189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b6c15c9c0 msgr2=0x7f6b6c160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:11.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.893+0000 7f6b6affd640 1 -- 172.21.15.55:0/638393189 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 784585494 0 0) 0x7f6b58003530 con 0x7f6b6c160f90 2023-08-25T04:19:11.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.893+0000 7f6b63fff640 1 --2- 172.21.15.55:0/638393189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b6c15c9c0 0x7f6b6c160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.893+0000 7f6b63fff640 1 -- 172.21.15.55:0/638393189 >> v1:172.21.15.55:6789/0 conn(0x7f6b6c160f90 legacy=0x7f6b6c0ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:11.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.893+0000 7f6b63fff640 1 -- 172.21.15.55:0/638393189 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c06aab0 con 0x7f6b6c0cfa70 2023-08-25T04:19:11.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.893+0000 7f6b6b7fe640 1 --2- 172.21.15.55:0/638393189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b6c15c9c0 0x7f6b6c160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:11.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.897+0000 7f6b63fff640 1 --2- 172.21.15.55:0/638393189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b6c0cfa70 0x7f6b6c160a50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6b540097c0 tx=0x7f6b5401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66f7e0df9bbb10f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:11.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.897+0000 7f6b6affd640 1 -- 172.21.15.55:0/638393189 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64001a00 con 0x7f6b6c0cfa70 2023-08-25T04:19:11.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.897+0000 7f6b6affd640 1 -- 172.21.15.55:0/638393189 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b540a7050 con 0x7f6b6c0cfa70 2023-08-25T04:19:11.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.897+0000 7f6b6affd640 1 -- 172.21.15.55:0/638393189 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b540ab620 con 0x7f6b6c0cfa70 2023-08-25T04:19:11.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.897+0000 7f6b71eec640 1 -- 172.21.15.55:0/638393189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b6c0cfa70 msgr2=0x7f6b6c160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:11.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.897+0000 7f6b71eec640 1 --2- 172.21.15.55:0/638393189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b6c0cfa70 0x7f6b6c160a50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6b540097c0 tx=0x7f6b5401c370 comp rx=0 tx=0).stop 2023-08-25T04:19:11.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.897+0000 7f6b71eec640 1 -- 172.21.15.55:0/638393189 shutdown_connections 2023-08-25T04:19:11.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.897+0000 7f6b71eec640 1 --2- 172.21.15.55:0/638393189 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b6c0cfa70 0x7f6b6c160a50 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.897+0000 7f6b71eec640 1 --2- 172.21.15.55:0/638393189 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b6c15c9c0 0x7f6b6c160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.897+0000 7f6b71eec640 1 -- 172.21.15.55:0/638393189 >> 172.21.15.55:0/638393189 conn(0x7f6b6c0d05a0 msgr2=0x7f6b6c0d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:11.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.897+0000 7f6b71eec640 1 -- 172.21.15.55:0/638393189 shutdown_connections 2023-08-25T04:19:11.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.897+0000 7f6b71eec640 1 -- 172.21.15.55:0/638393189 wait complete. 2023-08-25T04:19:11.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b71eec640 1 Processor -- start 2023-08-25T04:19:11.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b71eec640 1 -- start start 2023-08-25T04:19:11.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b71eec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b6c0cfa70 0x7f6b6c1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b71eec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b6c15c9c0 0x7f6b6c0c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b71eec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b6c160f90 0x7f6b6c14e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b71eec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c15fd20 con 0x7f6b6c15c9c0 2023-08-25T04:19:11.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b71eec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c1556e0 con 0x7f6b6c160f90 2023-08-25T04:19:11.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b71eec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c15f480 con 0x7f6b6c0cfa70 2023-08-25T04:19:11.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b63fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b6c15c9c0 0x7f6b6c0c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b63fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b6c15c9c0 0x7f6b6c0c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49260/0 (socket says 172.21.15.55:49260) 2023-08-25T04:19:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b63fff640 1 -- 172.21.15.55:0/3699029054 learned_addr learned my addr 172.21.15.55:0/3699029054 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b6bfff640 1 --2- 172.21.15.55:0/3699029054 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b6c160f90 0x7f6b6c14e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b6b7fe640 1 --2- 172.21.15.55:0/3699029054 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b6c0cfa70 0x7f6b6c1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b63fff640 1 -- 172.21.15.55:0/3699029054 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b6c0cfa70 msgr2=0x7f6b6c1551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b63fff640 1 --2- 172.21.15.55:0/3699029054 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b6c0cfa70 0x7f6b6c1551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b63fff640 1 -- 172.21.15.55:0/3699029054 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b6c160f90 msgr2=0x7f6b6c14e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b63fff640 1 --2- 172.21.15.55:0/3699029054 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b6c160f90 0x7f6b6c14e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:11.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b63fff640 1 -- 172.21.15.55:0/3699029054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c0093b0 con 0x7f6b6c15c9c0 2023-08-25T04:19:11.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b63fff640 1 --2- 172.21.15.55:0/3699029054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b6c15c9c0 0x7f6b6c0c5ec0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f6b5401aa20 tx=0x7f6b54019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:11.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b68ff9640 1 -- 172.21.15.55:0/3699029054 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b540b4400 con 0x7f6b6c15c9c0 2023-08-25T04:19:11.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b68ff9640 1 -- 172.21.15.55:0/3699029054 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b540b4560 con 0x7f6b6c15c9c0 2023-08-25T04:19:11.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b68ff9640 1 -- 172.21.15.55:0/3699029054 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b540b48d0 con 0x7f6b6c15c9c0 2023-08-25T04:19:11.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b71eec640 1 -- 172.21.15.55:0/3699029054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b54009420 con 0x7f6b6c15c9c0 2023-08-25T04:19:11.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b71eec640 1 -- 172.21.15.55:0/3699029054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6c15fa40 con 0x7f6b6c15c9c0 2023-08-25T04:19:11.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.901+0000 7f6b71eec640 1 -- 172.21.15.55:0/3699029054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6c04dbe0 con 0x7f6b6c15c9c0 2023-08-25T04:19:11.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.905+0000 7f6b68ff9640 1 -- 172.21.15.55:0/3699029054 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f6b540b2040 con 0x7f6b6c15c9c0 2023-08-25T04:19:11.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.905+0000 7f6b68ff9640 1 --2- 172.21.15.55:0/3699029054 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f6b4c0657a0 0x7f6b4c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:11.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.905+0000 7f6b68ff9640 1 -- 172.21.15.55:0/3699029054 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6b5411cff0 con 0x7f6b6c15c9c0 2023-08-25T04:19:11.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.905+0000 7f6b6b7fe640 1 --2- 172.21.15.55:0/3699029054 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f6b4c0657a0 0x7f6b4c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:11.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.905+0000 7f6b6b7fe640 1 --2- 172.21.15.55:0/3699029054 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f6b4c0657a0 0x7f6b4c067c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009c30 tx=0x7f6b5c006f90 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:11.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:11.909+0000 7f6b68ff9640 1 -- 172.21.15.55:0/3699029054 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6b540ea930 con 0x7f6b6c15c9c0 2023-08-25T04:19:12.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.097+0000 7f6b71eec640 1 -- 172.21.15.55:0/3699029054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b6c0cdc20 con 0x7f6b6c15c9c0 2023-08-25T04:19:12.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.097+0000 7f6b68ff9640 1 -- 172.21.15.55:0/3699029054 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f6b540b0090 con 0x7f6b6c15c9c0 2023-08-25T04:19:12.098 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:12.098 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6311,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/976095252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":976095252},{"type":"v1","addr":"172.21.15.110:6836","nonce":976095252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1364761770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1364761770},{"type":"v1","addr":"172.21.15.110:6837","nonce":1364761770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2491496151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2491496151},{"type":"v1","addr":"172.21.15.55:6834","nonce":2491496151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:19:06.181749+0000","modified":"2023-08-25T04:19:09.803812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7329":{"gid":7329,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3432791477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3432791477},{"type":"v1","addr":"172.21.15.55:6835","nonce":3432791477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-25T04:19:12.099 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 40 2023-08-25T04:19:12.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.101+0000 7f6b71eec640 1 -- 172.21.15.55:0/3699029054 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f6b4c0657a0 msgr2=0x7f6b4c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:12.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.101+0000 7f6b71eec640 1 --2- 172.21.15.55:0/3699029054 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f6b4c0657a0 0x7f6b4c067c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009c30 tx=0x7f6b5c006f90 comp rx=0 tx=0).stop 2023-08-25T04:19:12.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.101+0000 7f6b71eec640 1 -- 172.21.15.55:0/3699029054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b6c15c9c0 msgr2=0x7f6b6c0c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:12.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.101+0000 7f6b71eec640 1 --2- 172.21.15.55:0/3699029054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b6c15c9c0 0x7f6b6c0c5ec0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f6b5401aa20 tx=0x7f6b54019110 comp rx=0 tx=0).stop 2023-08-25T04:19:12.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.101+0000 7f6b71eec640 1 -- 172.21.15.55:0/3699029054 shutdown_connections 2023-08-25T04:19:12.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.101+0000 7f6b71eec640 1 --2- 172.21.15.55:0/3699029054 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b6c160f90 0x7f6b6c14e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.101+0000 7f6b71eec640 1 --2- 172.21.15.55:0/3699029054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b6c15c9c0 0x7f6b6c0c5ec0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.101+0000 7f6b71eec640 1 --2- 172.21.15.55:0/3699029054 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f6b4c0657a0 0x7f6b4c067c60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.101+0000 7f6b71eec640 1 --2- 172.21.15.55:0/3699029054 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b6c0cfa70 0x7f6b6c1551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.101+0000 7f6b71eec640 1 -- 172.21.15.55:0/3699029054 >> 172.21.15.55:0/3699029054 conn(0x7f6b6c0d05a0 msgr2=0x7f6b6c0c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:12.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.101+0000 7f6b71eec640 1 -- 172.21.15.55:0/3699029054 shutdown_connections 2023-08-25T04:19:12.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.101+0000 7f6b71eec640 1 -- 172.21.15.55:0/3699029054 wait complete. 2023-08-25T04:19:12.523 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-25T04:19:06.181749+0000', 'modified': '2023-08-25T04:19:09.803812+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7329}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7329': {'gid': 7329, 'name': 'c', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6835/3432791477', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6833', 'nonce': 3432791477}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 3432791477}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-25T04:19:12.524 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-25T04:19:12.524 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-25T04:19:12.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.673+0000 7fdc56e88640 1 Processor -- start 2023-08-25T04:19:12.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.673+0000 7fdc56e88640 1 -- start start 2023-08-25T04:19:12.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.677+0000 7fdc56e88640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc500ceeb0 0x7fdc500b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.677+0000 7fdc56e88640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc50160570 con 0x7fdc5015fef0 2023-08-25T04:19:12.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.677+0000 7fdc56e88640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc501602d0 con 0x7fdc500cce60 2023-08-25T04:19:12.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.677+0000 7fdc56e88640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc500cd2f0 con 0x7fdc500ceeb0 2023-08-25T04:19:12.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.677+0000 7fdc54c24640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdc5015fef0 0x7fdc500b2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33438/0 (socket says 172.21.15.55:33438) 2023-08-25T04:19:12.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.677+0000 7fdc54c24640 1 -- 172.21.15.55:0/2523511514 learned_addr learned my addr 172.21.15.55:0/2523511514 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:12.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.677+0000 7fdc55425640 1 --2- 172.21.15.55:0/2523511514 >> v2:172.21.15.55:3300/0 conn(0x7fdc500ceeb0 0x7fdc500b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.677+0000 7fdc4f7fe640 1 -- 172.21.15.55:0/2523511514 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109153029 0 0) 0x7fdc50160570 con 0x7fdc5015fef0 2023-08-25T04:19:12.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.677+0000 7fdc4f7fe640 1 -- 172.21.15.55:0/2523511514 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc40003530 con 0x7fdc5015fef0 2023-08-25T04:19:12.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.677+0000 7fdc55425640 1 -- 172.21.15.55:0/2523511514 >> v1:172.21.15.110:6789/0 conn(0x7fdc500cce60 legacy=0x7fdc500ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:12.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.677+0000 7fdc4f7fe640 1 -- 172.21.15.55:0/2523511514 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25589720 0 0) 0x7fdc501602d0 con 0x7fdc500cce60 2023-08-25T04:19:12.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.677+0000 7fdc55425640 1 -- 172.21.15.55:0/2523511514 >> v1:172.21.15.55:6789/0 conn(0x7fdc5015fef0 legacy=0x7fdc500b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:12.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.677+0000 7fdc55425640 1 -- 172.21.15.55:0/2523511514 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc50160810 con 0x7fdc500ceeb0 2023-08-25T04:19:12.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.681+0000 7fdc55425640 1 --2- 172.21.15.55:0/2523511514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc500ceeb0 0x7fdc500b14d0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009d90 tx=0x7fdc4801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0da4beef3f854bf server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:12.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.681+0000 7fdc4f7fe640 1 -- 172.21.15.55:0/2523511514 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc480a5900 con 0x7fdc500ceeb0 2023-08-25T04:19:12.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.681+0000 7fdc4f7fe640 1 -- 172.21.15.55:0/2523511514 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc480a5a60 con 0x7fdc500ceeb0 2023-08-25T04:19:12.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.681+0000 7fdc4f7fe640 1 -- 172.21.15.55:0/2523511514 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc480a5df0 con 0x7fdc500ceeb0 2023-08-25T04:19:12.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.681+0000 7fdc56e88640 1 -- 172.21.15.55:0/2523511514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc500ceeb0 msgr2=0x7fdc500b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:12.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.681+0000 7fdc56e88640 1 --2- 172.21.15.55:0/2523511514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc500ceeb0 0x7fdc500b14d0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009d90 tx=0x7fdc4801c950 comp rx=0 tx=0).stop 2023-08-25T04:19:12.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.681+0000 7fdc56e88640 1 -- 172.21.15.55:0/2523511514 shutdown_connections 2023-08-25T04:19:12.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.681+0000 7fdc56e88640 1 --2- 172.21.15.55:0/2523511514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc500ceeb0 0x7fdc500b14d0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.681+0000 7fdc56e88640 1 -- 172.21.15.55:0/2523511514 >> 172.21.15.55:0/2523511514 conn(0x7fdc50069d00 msgr2=0x7fdc5006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:12.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.681+0000 7fdc56e88640 1 -- 172.21.15.55:0/2523511514 shutdown_connections 2023-08-25T04:19:12.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.681+0000 7fdc56e88640 1 -- 172.21.15.55:0/2523511514 wait complete. 2023-08-25T04:19:12.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.681+0000 7fdc56e88640 1 Processor -- start 2023-08-25T04:19:12.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.681+0000 7fdc56e88640 1 -- start start 2023-08-25T04:19:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.681+0000 7fdc56e88640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc500cce60 0x7fdc500ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.681+0000 7fdc56e88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc500ceeb0 0x7fdc50154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.681+0000 7fdc56e88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc5015fef0 0x7fdc50155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc56e88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc50155f10 con 0x7fdc500ceeb0 2023-08-25T04:19:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc56e88640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc501f9630 con 0x7fdc500cce60 2023-08-25T04:19:12.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc56e88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc50156340 con 0x7fdc5015fef0 2023-08-25T04:19:12.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc4ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc500ceeb0 0x7fdc50154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc4ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc500ceeb0 0x7fdc50154fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49286/0 (socket says 172.21.15.55:49286) 2023-08-25T04:19:12.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc4ffff640 1 -- 172.21.15.55:0/616730590 learned_addr learned my addr 172.21.15.55:0/616730590 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:12.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc54c24640 1 --2- 172.21.15.55:0/616730590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc500cce60 0x7fdc500ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc55425640 1 --2- 172.21.15.55:0/616730590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc5015fef0 0x7fdc50155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc4ffff640 1 -- 172.21.15.55:0/616730590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc5015fef0 msgr2=0x7fdc50155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:12.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc4ffff640 1 --2- 172.21.15.55:0/616730590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc5015fef0 0x7fdc50155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc4ffff640 1 -- 172.21.15.55:0/616730590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc500cce60 msgr2=0x7fdc500ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:12.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc4ffff640 1 --2- 172.21.15.55:0/616730590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc500cce60 0x7fdc500ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc4ffff640 1 -- 172.21.15.55:0/616730590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc48009a70 con 0x7fdc500ceeb0 2023-08-25T04:19:12.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc4ffff640 1 --2- 172.21.15.55:0/616730590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc500ceeb0 0x7fdc50154fc0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c001ec0 tx=0x7fdc3c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:12.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc4d7fa640 1 -- 172.21.15.55:0/616730590 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0054e0 con 0x7fdc500ceeb0 2023-08-25T04:19:12.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc4d7fa640 1 -- 172.21.15.55:0/616730590 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c003600 con 0x7fdc500ceeb0 2023-08-25T04:19:12.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc56e88640 1 -- 172.21.15.55:0/616730590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc501f8870 con 0x7fdc500ceeb0 2023-08-25T04:19:12.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc4d7fa640 1 -- 172.21.15.55:0/616730590 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0039b0 con 0x7fdc500ceeb0 2023-08-25T04:19:12.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc56e88640 1 -- 172.21.15.55:0/616730590 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc501f8e30 con 0x7fdc500ceeb0 2023-08-25T04:19:12.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.685+0000 7fdc4d7fa640 1 -- 172.21.15.55:0/616730590 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fdc3c003b10 con 0x7fdc500ceeb0 2023-08-25T04:19:12.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc4d7fa640 1 --2- 172.21.15.55:0/616730590 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fdc340657a0 0x7fdc34067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc4d7fa640 1 -- 172.21.15.55:0/616730590 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc3c082540 con 0x7fdc500ceeb0 2023-08-25T04:19:12.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc54c24640 1 --2- 172.21.15.55:0/616730590 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fdc340657a0 0x7fdc34067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc5a1ea000 1 Processor -- start 2023-08-25T04:19:12.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc5a1ea000 1 -- start start 2023-08-25T04:19:12.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc54c24640 1 --2- 172.21.15.55:0/616730590 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fdc340657a0 0x7fdc34067c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdc44007fd0 tx=0x7fdc44009040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:12.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc5a1ea000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 0x55865b010400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc5a1ea000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010940 0x55865afc6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc5a1ea000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865afc65b0 0x55865afc6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc5a1ea000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865ae1c440 con 0x55865b010020 2023-08-25T04:19:12.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc5a1ea000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865ae19970 con 0x55865b010940 2023-08-25T04:19:12.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc5a1ea000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55865ae15260 con 0x55865afc65b0 2023-08-25T04:19:12.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc54c24640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 0x55865b010400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc4ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010940 0x55865afc6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc54c24640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 0x55865b010400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49294/0 (socket says 172.21.15.55:49294) 2023-08-25T04:19:12.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc54c24640 1 -- 172.21.15.55:0/4199877248 learned_addr learned my addr 172.21.15.55:0/4199877248 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:12.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc55425640 1 --2- 172.21.15.55:0/4199877248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865afc65b0 0x55865afc6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc54c24640 1 -- 172.21.15.55:0/4199877248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865afc65b0 msgr2=0x55865afc6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:12.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc54c24640 1 --2- 172.21.15.55:0/4199877248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865afc65b0 0x55865afc6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc54c24640 1 -- 172.21.15.55:0/4199877248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010940 msgr2=0x55865afc6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:12.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc54c24640 1 --2- 172.21.15.55:0/4199877248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010940 0x55865afc6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc54c24640 1 -- 172.21.15.55:0/4199877248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55865aeadec0 con 0x55865b010020 2023-08-25T04:19:12.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc54c24640 1 --2- 172.21.15.55:0/4199877248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 0x55865b010400 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400f950 tx=0x7fdc44000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1cd4457ef6b738 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:12.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc3a7fc640 1 -- 172.21.15.55:0/4199877248 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc44015bf0 con 0x55865b010020 2023-08-25T04:19:12.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc3a7fc640 1 -- 172.21.15.55:0/4199877248 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc44015d50 con 0x55865b010020 2023-08-25T04:19:12.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc3a7fc640 1 -- 172.21.15.55:0/4199877248 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc44020620 con 0x55865b010020 2023-08-25T04:19:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/4199877248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 msgr2=0x55865b010400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/4199877248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 0x55865b010400 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400f950 tx=0x7fdc44000ee0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/4199877248 shutdown_connections 2023-08-25T04:19:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/4199877248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865afc65b0 0x55865afc6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/4199877248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010940 0x55865afc6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/4199877248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 0x55865b010400 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.689+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/4199877248 >> 172.21.15.55:0/4199877248 conn(0x55865afc2560 msgr2=0x55865afc4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/4199877248 shutdown_connections 2023-08-25T04:19:12.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/4199877248 wait complete. 2023-08-25T04:19:12.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 1 -- start start 2023-08-25T04:19:12.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 1 Processor -- start 2023-08-25T04:19:12.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865afc65b0 0x55865b017380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 0x55865b0178c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010940 0x55865affddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865adcff60 con 0x55865b010020 2023-08-25T04:19:12.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865adcfc00 con 0x55865b010940 2023-08-25T04:19:12.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55865aad0940 con 0x55865afc65b0 2023-08-25T04:19:12.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 10 client.0 _ll_register_callbacks cb 0x55865afb1900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:19:12.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc4ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 0x55865b0178c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc4ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 0x55865b0178c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49300/0 (socket says 172.21.15.55:49300) 2023-08-25T04:19:12.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc4ffff640 1 -- 172.21.15.55:0/1060807658 learned_addr learned my addr 172.21.15.55:0/1060807658 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:12.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc54c24640 1 --2- 172.21.15.55:0/1060807658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865afc65b0 0x55865b017380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc55425640 1 --2- 172.21.15.55:0/1060807658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010940 0x55865affddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc4ffff640 1 -- 172.21.15.55:0/1060807658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865afc65b0 msgr2=0x55865b017380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:12.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc4ffff640 1 --2- 172.21.15.55:0/1060807658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865afc65b0 0x55865b017380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc4ffff640 1 -- 172.21.15.55:0/1060807658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010940 msgr2=0x55865affddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:12.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc4ffff640 1 --2- 172.21.15.55:0/1060807658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010940 0x55865affddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc4ffff640 1 -- 172.21.15.55:0/1060807658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc40003530 con 0x55865b010020 2023-08-25T04:19:12.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc4ffff640 1 --2- 172.21.15.55:0/1060807658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 0x55865b0178c0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0538c0 tx=0x7fdc3c051f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd5a8cf8125aabe server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:12.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T04:19:12.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc2f7fe640 1 -- 172.21.15.55:0/1060807658 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0822c0 con 0x55865b010020 2023-08-25T04:19:12.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc2f7fe640 1 -- 172.21.15.55:0/1060807658 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc3c057b30 con 0x55865b010020 2023-08-25T04:19:12.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/1060807658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55865adac9d0 con 0x55865b010020 2023-08-25T04:19:12.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc2f7fe640 1 -- 172.21.15.55:0/1060807658 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc3c06aea0 con 0x55865b010020 2023-08-25T04:19:12.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 10 client.7482 fetch_fsmap learned FSMap version 40 2023-08-25T04:19:12.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/1060807658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x55865ab0f890 con 0x55865b010020 2023-08-25T04:19:12.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc2f7fe640 1 -- 172.21.15.55:0/1060807658 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55865adac9d0 con 0x55865b010020 2023-08-25T04:19:12.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc2f7fe640 1 -- 172.21.15.55:0/1060807658 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 40) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdc3c057cf0 con 0x55865b010020 2023-08-25T04:19:12.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 10 client.7482 fetch_fsmap finished waiting for FSMap version 40 2023-08-25T04:19:12.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 10 client.7482 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T04:19:12.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 20 client.7482 populate_metadata read hostname 'smithi055' 2023-08-25T04:19:12.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/1060807658 >> [v2:172.21.15.55:6833/3432791477,v1:172.21.15.55:6835/3432791477] conn(0x55865affeb40 0x55865affef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 4 client.7482 mds_command: new command op to 7329 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-25T04:19:12.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.693+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/1060807658 --> [v2:172.21.15.55:6833/3432791477,v1:172.21.15.55:6835/3432791477] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55865adcc7a0 con 0x55865affeb40 2023-08-25T04:19:12.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.697+0000 7fdc54c24640 1 --2- 172.21.15.55:0/1060807658 >> [v2:172.21.15.55:6833/3432791477,v1:172.21.15.55:6835/3432791477] conn(0x55865affeb40 0x55865affef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.697+0000 7fdc54c24640 1 --2- 172.21.15.55:0/1060807658 >> [v2:172.21.15.55:6833/3432791477,v1:172.21.15.55:6835/3432791477] conn(0x55865affeb40 0x55865affef20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6de3f498ea10b831 server_cookie=998951132630d32c in_seq=0 out_seq=0 2023-08-25T04:19:12.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.697+0000 7fdc2f7fe640 10 client.7482 ms_handle_connect on v2:172.21.15.55:6833/3432791477 2023-08-25T04:19:12.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.697+0000 7fdc2f7fe640 1 -- 172.21.15.55:0/1060807658 <== mds.0 v2:172.21.15.55:6833/3432791477 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55865adcc7a0 con 0x55865affeb40 2023-08-25T04:19:12.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.697+0000 7fdc2f7fe640 10 client.7482 handle_command_reply: tid=0 2023-08-25T04:19:12.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.697+0000 7fdc5a1ea000 1 client.7482 shutdown 2023-08-25T04:19:12.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.697+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/1060807658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 msgr2=0x55865b0178c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:12.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.697+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/1060807658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 0x55865b0178c0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0538c0 tx=0x7fdc3c051f60 comp rx=0 tx=0).stop 2023-08-25T04:19:12.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.697+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/1060807658 shutdown_connections 2023-08-25T04:19:12.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.697+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/1060807658 >> [v2:172.21.15.55:6833/3432791477,v1:172.21.15.55:6835/3432791477] conn(0x55865affeb40 0x55865affef20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.697+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/1060807658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010940 0x55865affddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.697+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/1060807658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 0x55865b0178c0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.697+0000 7fdc2f7fe640 0 client.7482 ms_handle_reset on v2:172.21.15.55:6833/3432791477 2023-08-25T04:19:12.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.697+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/1060807658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865afc65b0 0x55865b017380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.697+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/1060807658 >> 172.21.15.55:0/1060807658 conn(0x55865afc2560 msgr2=0x55865afc51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:12.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.697+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/1060807658 shutdown_connections 2023-08-25T04:19:12.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.697+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/1060807658 wait complete. 2023-08-25T04:19:12.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.697+0000 7fdc5a1ea000 20 client.7482 trim_cache size 0 max 16384 2023-08-25T04:19:12.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc5a1ea000 1 Processor -- start 2023-08-25T04:19:12.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc5a1ea000 1 -- start start 2023-08-25T04:19:12.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc5a1ea000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865afc65b0 0x55865afc4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc5a1ea000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 0x55865afc4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc5a1ea000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010940 0x55865b012d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc5a1ea000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865afc9370 con 0x55865b010020 2023-08-25T04:19:12.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc5a1ea000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865ade6e80 con 0x55865b010940 2023-08-25T04:19:12.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc5a1ea000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55865add5430 con 0x55865afc65b0 2023-08-25T04:19:12.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc4ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 0x55865afc4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc4ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 0x55865afc4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49316/0 (socket says 172.21.15.55:49316) 2023-08-25T04:19:12.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc4ffff640 1 -- 172.21.15.55:0/2819213822 learned_addr learned my addr 172.21.15.55:0/2819213822 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:12.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc4ffff640 1 -- 172.21.15.55:0/2819213822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865afc65b0 msgr2=0x55865afc4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:12.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc4ffff640 1 --2- 172.21.15.55:0/2819213822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865afc65b0 0x55865afc4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc4ffff640 1 -- 172.21.15.55:0/2819213822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010940 msgr2=0x55865b012d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:12.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc4ffff640 1 --2- 172.21.15.55:0/2819213822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010940 0x55865b012d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc4ffff640 1 -- 172.21.15.55:0/2819213822 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55865add8190 con 0x55865b010020 2023-08-25T04:19:12.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc4ffff640 1 --2- 172.21.15.55:0/2819213822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 0x55865afc4e90 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c000fc0 tx=0x7fdc3c059050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2985c06d72ed2e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:12.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc3affd640 1 -- 172.21.15.55:0/2819213822 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c06aea0 con 0x55865b010020 2023-08-25T04:19:12.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc3affd640 1 -- 172.21.15.55:0/2819213822 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c00e040 con 0x55865b010020 2023-08-25T04:19:12.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.713+0000 7fdc3affd640 1 -- 172.21.15.55:0/2819213822 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0822c0 con 0x55865b010020 2023-08-25T04:19:12.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/2819213822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 msgr2=0x55865afc4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:12.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/2819213822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 0x55865afc4e90 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c000fc0 tx=0x7fdc3c059050 comp rx=0 tx=0).stop 2023-08-25T04:19:12.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/2819213822 shutdown_connections 2023-08-25T04:19:12.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/2819213822 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010940 0x55865b012d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/2819213822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865b010020 0x55865afc4e90 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/2819213822 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865afc65b0 0x55865afc4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/2819213822 >> 172.21.15.55:0/2819213822 conn(0x55865afc2560 msgr2=0x55865afcb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:12.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/2819213822 shutdown_connections 2023-08-25T04:19:12.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/2819213822 wait complete. 2023-08-25T04:19:12.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 1 -- start start 2023-08-25T04:19:12.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 1 Processor -- start 2023-08-25T04:19:12.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865afc65b0 0x55865b06e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010020 0x55865b015460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865b010940 0x55865b0159a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865ae17dc0 con 0x55865afc65b0 2023-08-25T04:19:12.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865ae19260 con 0x55865b010020 2023-08-25T04:19:12.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55865afc8bd0 con 0x55865b010940 2023-08-25T04:19:12.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 10 client.0 _ll_register_callbacks cb 0x7fdc440012e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:19:12.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc54c24640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865afc65b0 0x55865b06e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc54c24640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865afc65b0 0x55865b06e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49320/0 (socket says 172.21.15.55:49320) 2023-08-25T04:19:12.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc54c24640 1 -- 172.21.15.55:0/2238075443 learned_addr learned my addr 172.21.15.55:0/2238075443 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:12.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc4ffff640 1 --2- 172.21.15.55:0/2238075443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010020 0x55865b015460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc55425640 1 --2- 172.21.15.55:0/2238075443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865b010940 0x55865b0159a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc54c24640 1 -- 172.21.15.55:0/2238075443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865b010940 msgr2=0x55865b0159a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:12.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc54c24640 1 --2- 172.21.15.55:0/2238075443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865b010940 0x55865b0159a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc54c24640 1 -- 172.21.15.55:0/2238075443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010020 msgr2=0x55865b015460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:12.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc54c24640 1 --2- 172.21.15.55:0/2238075443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010020 0x55865b015460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc54c24640 1 -- 172.21.15.55:0/2238075443 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55865ab0f890 con 0x55865afc65b0 2023-08-25T04:19:12.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc54c24640 1 --2- 172.21.15.55:0/2238075443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865afc65b0 0x55865b06e520 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400f8f0 tx=0x7fdc44007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e18447cfe12206e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:12.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T04:19:12.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc2f7fe640 1 -- 172.21.15.55:0/2238075443 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc44006520 con 0x55865afc65b0 2023-08-25T04:19:12.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc2f7fe640 1 -- 172.21.15.55:0/2238075443 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc44006680 con 0x55865afc65b0 2023-08-25T04:19:12.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.717+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/2238075443 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55865add0880 con 0x55865afc65b0 2023-08-25T04:19:12.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc2f7fe640 1 -- 172.21.15.55:0/2238075443 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc440047f0 con 0x55865afc65b0 2023-08-25T04:19:12.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 10 client.7488 fetch_fsmap learned FSMap version 40 2023-08-25T04:19:12.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/2238075443 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x55865adbe420 con 0x55865afc65b0 2023-08-25T04:19:12.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc2f7fe640 1 -- 172.21.15.55:0/2238075443 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55865add0880 con 0x55865afc65b0 2023-08-25T04:19:12.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc2f7fe640 1 -- 172.21.15.55:0/2238075443 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 40) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdc44012070 con 0x55865afc65b0 2023-08-25T04:19:12.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 10 client.7488 fetch_fsmap finished waiting for FSMap version 40 2023-08-25T04:19:12.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 10 client.7488 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T04:19:12.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 20 client.7488 populate_metadata read hostname 'smithi055' 2023-08-25T04:19:12.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/2238075443 >> [v2:172.21.15.55:6833/3432791477,v1:172.21.15.55:6835/3432791477] conn(0x55865b075c40 0x55865b078030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 4 client.7488 mds_command: new command op to 7329 tid=0[{"prefix": "status"}] 2023-08-25T04:19:12.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/2238075443 --> [v2:172.21.15.55:6833/3432791477,v1:172.21.15.55:6835/3432791477] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55865ae0e240 con 0x55865b075c40 2023-08-25T04:19:12.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc4ffff640 1 --2- 172.21.15.55:0/2238075443 >> [v2:172.21.15.55:6833/3432791477,v1:172.21.15.55:6835/3432791477] conn(0x55865b075c40 0x55865b078030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc2f7fe640 10 client.7488 ms_handle_connect on v2:172.21.15.55:6833/3432791477 2023-08-25T04:19:12.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc4ffff640 1 --2- 172.21.15.55:0/2238075443 >> [v2:172.21.15.55:6833/3432791477,v1:172.21.15.55:6835/3432791477] conn(0x55865b075c40 0x55865b078030 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be44a1e51eb20d33 server_cookie=d3e6346b8d61936b in_seq=0 out_seq=0 2023-08-25T04:19:12.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc2f7fe640 1 -- 172.21.15.55:0/2238075443 <== mds.0 v2:172.21.15.55:6833/3432791477 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55865ae0e240 con 0x55865b075c40 2023-08-25T04:19:12.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc2f7fe640 10 client.7488 handle_command_reply: tid=0 2023-08-25T04:19:12.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 1 client.7488 shutdown 2023-08-25T04:19:12.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/2238075443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865afc65b0 msgr2=0x55865b06e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:12.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/2238075443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865afc65b0 0x55865b06e520 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fdc4400f8f0 tx=0x7fdc44007d20 comp rx=0 tx=0).stop 2023-08-25T04:19:12.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/2238075443 shutdown_connections 2023-08-25T04:19:12.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/2238075443 >> [v2:172.21.15.55:6833/3432791477,v1:172.21.15.55:6835/3432791477] conn(0x55865b075c40 0x55865b078030 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/2238075443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55865b010940 0x55865b0159a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/2238075443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55865b010020 0x55865b015460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 1 --2- 172.21.15.55:0/2238075443 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55865afc65b0 0x55865b06e520 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc2f7fe640 0 client.7488 ms_handle_reset on v2:172.21.15.55:6833/3432791477 2023-08-25T04:19:12.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/2238075443 >> 172.21.15.55:0/2238075443 conn(0x55865afc2560 msgr2=0x55865affcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:12.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/2238075443 shutdown_connections 2023-08-25T04:19:12.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 1 -- 172.21.15.55:0/2238075443 wait complete. 2023-08-25T04:19:12.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc5a1ea000 20 client.7488 trim_cache size 0 max 16384 2023-08-25T04:19:12.728 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T04:19:12.729 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2d2a9024-b152-4d40-880c-1686d1810590", 2023-08-25T04:19:12.729 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-08-25T04:19:12.729 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 7329, 2023-08-25T04:19:12.729 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-08-25T04:19:12.729 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-08-25T04:19:12.729 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-08-25T04:19:12.729 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 5.9328641759999998, 2023-08-25T04:19:12.729 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 40, 2023-08-25T04:19:12.730 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 93, 2023-08-25T04:19:12.730 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 93, 2023-08-25T04:19:12.730 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 12.824676774 2023-08-25T04:19:12.730 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T04:19:12.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc56e88640 1 -- 172.21.15.55:0/616730590 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fdc340657a0 msgr2=0x7fdc34067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:12.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc56e88640 1 --2- 172.21.15.55:0/616730590 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fdc340657a0 0x7fdc34067c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdc44007fd0 tx=0x7fdc44009040 comp rx=0 tx=0).stop 2023-08-25T04:19:12.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc56e88640 1 -- 172.21.15.55:0/616730590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc500ceeb0 msgr2=0x7fdc50154fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:12.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc56e88640 1 --2- 172.21.15.55:0/616730590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc500ceeb0 0x7fdc50154fc0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c001ec0 tx=0x7fdc3c00c8e0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc56e88640 1 -- 172.21.15.55:0/616730590 shutdown_connections 2023-08-25T04:19:12.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc56e88640 1 --2- 172.21.15.55:0/616730590 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fdc340657a0 0x7fdc34067c60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc56e88640 1 --2- 172.21.15.55:0/616730590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc5015fef0 0x7fdc50155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc56e88640 1 --2- 172.21.15.55:0/616730590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc500ceeb0 0x7fdc50154fc0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc56e88640 1 --2- 172.21.15.55:0/616730590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc500cce60 0x7fdc500ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc56e88640 1 -- 172.21.15.55:0/616730590 >> 172.21.15.55:0/616730590 conn(0x7fdc50069d00 msgr2=0x7fdc500c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:12.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc56e88640 1 -- 172.21.15.55:0/616730590 shutdown_connections 2023-08-25T04:19:12.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.721+0000 7fdc56e88640 1 -- 172.21.15.55:0/616730590 wait complete. 2023-08-25T04:19:12.741 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:19:12.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.885+0000 7f42bbb8f640 1 Processor -- start 2023-08-25T04:19:12.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.885+0000 7f42bbb8f640 1 -- start start 2023-08-25T04:19:12.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.885+0000 7f42bbb8f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f42b4164410 0x7f42b40b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.885+0000 7f42bbb8f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f42b40c1a80 0x7f42b406bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.885+0000 7f42bbb8f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b40cc510 con 0x7f42b40cddf0 2023-08-25T04:19:12.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.885+0000 7f42bbb8f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b41647f0 con 0x7f42b40c1a80 2023-08-25T04:19:12.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.885+0000 7f42bbb8f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b40cc9b0 con 0x7f42b4164410 2023-08-25T04:19:12.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.885+0000 7f42ba12c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f42b40c1a80 0x7f42b406bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.885+0000 7f42ba12c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f42b40c1a80 0x7f42b406bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49328/0 (socket says 172.21.15.55:49328) 2023-08-25T04:19:12.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.885+0000 7f42ba12c640 1 -- 172.21.15.55:0/3494412425 learned_addr learned my addr 172.21.15.55:0/3494412425 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:12.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.889+0000 7f42b992b640 1 --2- 172.21.15.55:0/3494412425 >> v2:172.21.15.110:3300/0 conn(0x7f42b4164410 0x7f42b40b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.889+0000 7f42ba12c640 1 -- 172.21.15.55:0/3494412425 >> v2:172.21.15.110:3300/0 conn(0x7f42b4164410 msgr2=0x7f42b40b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:12.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.889+0000 7f42ba12c640 1 --2- 172.21.15.55:0/3494412425 >> v2:172.21.15.110:3300/0 conn(0x7f42b4164410 0x7f42b40b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.889+0000 7f42ba12c640 1 -- 172.21.15.55:0/3494412425 >> v1:172.21.15.110:6789/0 conn(0x7f42b40cddf0 legacy=0x7f42b40c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:12.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.889+0000 7f42ba12c640 1 -- 172.21.15.55:0/3494412425 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b40ccc90 con 0x7f42b40c1a80 2023-08-25T04:19:12.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.889+0000 7f42b992b640 1 --2- 172.21.15.55:0/3494412425 >> v2:172.21.15.110:3300/0 conn(0x7f42b4164410 0x7f42b40b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:19:12.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.889+0000 7f42ba12c640 1 --2- 172.21.15.55:0/3494412425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42b40c1a80 0x7f42b406bb40 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f42b40cec10 tx=0x7f42ac01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304995589cb229e9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:12.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.889+0000 7f42b8929640 1 -- 172.21.15.55:0/3494412425 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac0a5630 con 0x7f42b40c1a80 2023-08-25T04:19:12.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.889+0000 7f42b8929640 1 -- 172.21.15.55:0/3494412425 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac0a5790 con 0x7f42b40c1a80 2023-08-25T04:19:12.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.889+0000 7f42b8929640 1 -- 172.21.15.55:0/3494412425 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac0a5b20 con 0x7f42b40c1a80 2023-08-25T04:19:12.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.889+0000 7f42bbb8f640 1 -- 172.21.15.55:0/3494412425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42b40c1a80 msgr2=0x7f42b406bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:12.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.889+0000 7f42bbb8f640 1 --2- 172.21.15.55:0/3494412425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42b40c1a80 0x7f42b406bb40 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f42b40cec10 tx=0x7f42ac01c990 comp rx=0 tx=0).stop 2023-08-25T04:19:12.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.889+0000 7f42bbb8f640 1 -- 172.21.15.55:0/3494412425 shutdown_connections 2023-08-25T04:19:12.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.889+0000 7f42bbb8f640 1 --2- 172.21.15.55:0/3494412425 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42b40c1a80 0x7f42b406bb40 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.889+0000 7f42bbb8f640 1 --2- 172.21.15.55:0/3494412425 >> v2:172.21.15.110:3300/0 conn(0x7f42b4164410 0x7f42b40b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.889+0000 7f42bbb8f640 1 -- 172.21.15.55:0/3494412425 >> 172.21.15.55:0/3494412425 conn(0x7f42b4069d00 msgr2=0x7f42b406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:12.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.889+0000 7f42bbb8f640 1 -- 172.21.15.55:0/3494412425 shutdown_connections 2023-08-25T04:19:12.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.889+0000 7f42bbb8f640 1 -- 172.21.15.55:0/3494412425 wait complete. 2023-08-25T04:19:12.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42bbb8f640 1 Processor -- start 2023-08-25T04:19:12.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42bbb8f640 1 -- start start 2023-08-25T04:19:12.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42bbb8f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42b40c1a80 0x7f42b415ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42bbb8f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42b40cddf0 0x7f42b415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42bbb8f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42b4164410 0x7f42b40c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42bbb8f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40b0aa0 con 0x7f42b40c1a80 2023-08-25T04:19:12.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42bbb8f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b415c5b0 con 0x7f42b40cddf0 2023-08-25T04:19:12.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42bbb8f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b415c2c0 con 0x7f42b4164410 2023-08-25T04:19:12.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42b992b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42b40c1a80 0x7f42b415ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42b992b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42b40c1a80 0x7f42b415ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49330/0 (socket says 172.21.15.55:49330) 2023-08-25T04:19:12.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42b992b640 1 -- 172.21.15.55:0/2545990825 learned_addr learned my addr 172.21.15.55:0/2545990825 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:12.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42b912a640 1 --2- 172.21.15.55:0/2545990825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42b40cddf0 0x7f42b415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42ba12c640 1 --2- 172.21.15.55:0/2545990825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42b4164410 0x7f42b40c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42b992b640 1 -- 172.21.15.55:0/2545990825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42b4164410 msgr2=0x7f42b40c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:12.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42b992b640 1 --2- 172.21.15.55:0/2545990825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42b4164410 0x7f42b40c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42b992b640 1 -- 172.21.15.55:0/2545990825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42b40cddf0 msgr2=0x7f42b415b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:12.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42b992b640 1 --2- 172.21.15.55:0/2545990825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42b40cddf0 0x7f42b415b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:12.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42b992b640 1 -- 172.21.15.55:0/2545990825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac009b30 con 0x7f42b40c1a80 2023-08-25T04:19:12.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42ba12c640 1 --2- 172.21.15.55:0/2545990825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42b4164410 0x7f42b40c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:12.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42b912a640 1 --2- 172.21.15.55:0/2545990825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42b40cddf0 0x7f42b415b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:12.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42b992b640 1 --2- 172.21.15.55:0/2545990825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42b40c1a80 0x7f42b415ad60 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f42b000c7f0 tx=0x7f42b000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:12.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42aa7fc640 1 -- 172.21.15.55:0/2545990825 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b0007820 con 0x7f42b40c1a80 2023-08-25T04:19:12.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42aa7fc640 1 -- 172.21.15.55:0/2545990825 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b0007980 con 0x7f42b40c1a80 2023-08-25T04:19:12.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42aa7fc640 1 -- 172.21.15.55:0/2545990825 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b0007d30 con 0x7f42b40c1a80 2023-08-25T04:19:12.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42bbb8f640 1 -- 172.21.15.55:0/2545990825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b415d1b0 con 0x7f42b40c1a80 2023-08-25T04:19:12.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.893+0000 7f42bbb8f640 1 -- 172.21.15.55:0/2545990825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b40b07c0 con 0x7f42b40c1a80 2023-08-25T04:19:12.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.897+0000 7f42bbb8f640 1 -- 172.21.15.55:0/2545990825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b404dbe0 con 0x7f42b40c1a80 2023-08-25T04:19:12.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.897+0000 7f42aa7fc640 1 -- 172.21.15.55:0/2545990825 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f42b00113f0 con 0x7f42b40c1a80 2023-08-25T04:19:12.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.897+0000 7f42aa7fc640 1 --2- 172.21.15.55:0/2545990825 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f42980657a0 0x7f4298067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:12.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.897+0000 7f42aa7fc640 1 -- 172.21.15.55:0/2545990825 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f42b00833f0 con 0x7f42b40c1a80 2023-08-25T04:19:12.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.897+0000 7f42b912a640 1 --2- 172.21.15.55:0/2545990825 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f42980657a0 0x7f4298067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:12.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.897+0000 7f42b912a640 1 --2- 172.21.15.55:0/2545990825 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f42980657a0 0x7f4298067c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42b406f990 tx=0x7f42a4009040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:12.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:12.901+0000 7f42aa7fc640 1 -- 172.21.15.55:0/2545990825 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f42b0050c80 con 0x7f42b40c1a80 2023-08-25T04:19:13.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.089+0000 7f42bbb8f640 1 -- 172.21.15.55:0/2545990825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f42b40c1860 con 0x7f42b40c1a80 2023-08-25T04:19:13.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.093+0000 7f42aa7fc640 1 -- 172.21.15.55:0/2545990825 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7f42b00542a0 con 0x7f42b40c1a80 2023-08-25T04:19:13.092 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T04:19:13.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.093+0000 7f42bbb8f640 1 -- 172.21.15.55:0/2545990825 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f42980657a0 msgr2=0x7f4298067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:13.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.093+0000 7f42bbb8f640 1 --2- 172.21.15.55:0/2545990825 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f42980657a0 0x7f4298067c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f42b406f990 tx=0x7f42a4009040 comp rx=0 tx=0).stop 2023-08-25T04:19:13.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.093+0000 7f42bbb8f640 1 -- 172.21.15.55:0/2545990825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42b40c1a80 msgr2=0x7f42b415ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:13.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.093+0000 7f42bbb8f640 1 --2- 172.21.15.55:0/2545990825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42b40c1a80 0x7f42b415ad60 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f42b000c7f0 tx=0x7f42b000ccb0 comp rx=0 tx=0).stop 2023-08-25T04:19:13.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.093+0000 7f42bbb8f640 1 -- 172.21.15.55:0/2545990825 shutdown_connections 2023-08-25T04:19:13.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.093+0000 7f42bbb8f640 1 --2- 172.21.15.55:0/2545990825 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f42980657a0 0x7f4298067c60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:13.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.093+0000 7f42bbb8f640 1 --2- 172.21.15.55:0/2545990825 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42b4164410 0x7f42b40c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:13.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.093+0000 7f42bbb8f640 1 --2- 172.21.15.55:0/2545990825 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42b40cddf0 0x7f42b415b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:13.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.093+0000 7f42bbb8f640 1 --2- 172.21.15.55:0/2545990825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42b40c1a80 0x7f42b415ad60 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:13.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.093+0000 7f42bbb8f640 1 -- 172.21.15.55:0/2545990825 >> 172.21.15.55:0/2545990825 conn(0x7f42b4069d00 msgr2=0x7f42b4160140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:13.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.093+0000 7f42bbb8f640 1 -- 172.21.15.55:0/2545990825 shutdown_connections 2023-08-25T04:19:13.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.093+0000 7f42bbb8f640 1 -- 172.21.15.55:0/2545990825 wait complete. 2023-08-25T04:19:13.112 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-25T04:19:13.113 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:19:13.113 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-08-25T04:19:13.114 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-25T04:19:13.114 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T04:19:13.114 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-25T04:19:13.115 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-25T04:19:13.115 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:19:13.115 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:19:13.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:13.116 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-08-25T04:19:13.126 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:19:13.127 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:19:13.127 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:19:13.127 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:19:13.127 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-08-25T04:19:13.127 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:19:13.127 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:19:13.128 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:19:13.128 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-08-25T04:19:13.128 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:19:13.128 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:19:13.128 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-08-25T04:19:13.128 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:19:13.128 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:19:13.129 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-08-25T04:19:13.129 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-08-25T04:19:13.129 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41435sec preferred_lft 41435sec 2023-08-25T04:19:13.130 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-08-25T04:19:13.130 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:19:13.130 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:19:13.130 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:19:13.130 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-08-25T04:19:13.130 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-25T04:19:13.130 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:98:6a:38:6a brd ff:ff:ff:ff:ff:ff 2023-08-25T04:19:13.131 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-25T04:19:13.131 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:19:13.131 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:19:13.131 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-08-25T04:19:13.131 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T04:19:13.131 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:19:13.132 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-08-25T04:19:13.132 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:19:13.132 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:19:13.132 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T04:19:13.133 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-08-25T04:19:13.133 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:19:13.133 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:19:13.133 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-25T04:19:13.133 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-08-25T04:19:13.133 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:19:13.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:13.134 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:19:13.190 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-08-25T04:19:13.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:13.193 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-08-25T04:19:13.250 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-08-25T04:19:13.250 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:19:13.250 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-08-25T04:19:13.251 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-25T04:19:13.251 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-08-25T04:19:13.251 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:19:13.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:13.253 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T04:19:13.254 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T04:19:13.254 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-25T04:19:13.255 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-25T04:19:13.256 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-25T04:19:13.256 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T04:19:13.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:13.345 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-08-25T04:19:13.355 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-25T04:19:13.355 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-25T04:19:13.356 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:19:13.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:13.357 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-08-25T04:19:13.425 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:19:13.426 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-25T04:19:13.482 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:19:13.483 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:19:13.483 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:19:13.535 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-25T04:19:13.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:13.536 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:19:13.630 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:19:13.631 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:19:13.644 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:19:13.644 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:19:13.645 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.110:3300,172.21.15.110:3301" 2023-08-25T04:19:13.645 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2d2a9024-b152-4d40-880c-1686d1810590.cephfs=/ 2023-08-25T04:19:13.645 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2023-08-25T04:19:13.648 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T04:19:13.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:13.649 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:19:13.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:13.678 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:19:13.735 INFO:teuthology.orchestra.run.smithi055.stdout:client7000 2023-08-25T04:19:13.736 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:19:13.737 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:19:13.787 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-25T04:19:13.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.977+0000 7f4d88311640 1 Processor -- start 2023-08-25T04:19:13.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.977+0000 7f4d88311640 1 -- start start 2023-08-25T04:19:13.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.977+0000 7f4d88311640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4d8015c9c0 0x7f4d80160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:13.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.977+0000 7f4d88311640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4d800cfa70 0x7f4d80160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:13.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.977+0000 7f4d88311640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8006eaf0 con 0x7f4d80160f90 2023-08-25T04:19:13.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.977+0000 7f4d88311640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8006e530 con 0x7f4d800cfa70 2023-08-25T04:19:13.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.977+0000 7f4d88311640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8006e810 con 0x7f4d8015c9c0 2023-08-25T04:19:13.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.981+0000 7f4d858ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4d800cfa70 0x7f4d80160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:13.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.981+0000 7f4d858ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4d800cfa70 0x7f4d80160a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49344/0 (socket says 172.21.15.55:49344) 2023-08-25T04:19:13.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.981+0000 7f4d858ac640 1 -- 172.21.15.55:0/543366881 learned_addr learned my addr 172.21.15.55:0/543366881 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:13.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.981+0000 7f4d860ad640 1 --2- 172.21.15.55:0/543366881 >> v2:172.21.15.110:3300/0 conn(0x7f4d8015c9c0 0x7f4d80160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:13.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.981+0000 7f4d858ac640 1 -- 172.21.15.55:0/543366881 >> v2:172.21.15.110:3300/0 conn(0x7f4d8015c9c0 msgr2=0x7f4d80160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:13.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.981+0000 7f4d858ac640 1 --2- 172.21.15.55:0/543366881 >> v2:172.21.15.110:3300/0 conn(0x7f4d8015c9c0 0x7f4d80160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:13.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.981+0000 7f4d858ac640 1 -- 172.21.15.55:0/543366881 >> v1:172.21.15.110:6789/0 conn(0x7f4d80160f90 legacy=0x7f4d800ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:13.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.981+0000 7f4d858ac640 1 -- 172.21.15.55:0/543366881 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8006aab0 con 0x7f4d800cfa70 2023-08-25T04:19:13.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.981+0000 7f4d860ad640 1 --2- 172.21.15.55:0/543366881 >> v2:172.21.15.110:3300/0 conn(0x7f4d8015c9c0 0x7f4d80160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:13.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.981+0000 7f4d858ac640 1 --2- 172.21.15.55:0/543366881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d800cfa70 0x7f4d80160a50 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f4d80070600 tx=0x7f4d7001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ad7c9a38ec8b1d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:13.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.981+0000 7f4d850ab640 1 -- 172.21.15.55:0/543366881 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d700ac640 con 0x7f4d800cfa70 2023-08-25T04:19:13.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.981+0000 7f4d850ab640 1 -- 172.21.15.55:0/543366881 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d700ac7a0 con 0x7f4d800cfa70 2023-08-25T04:19:13.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.981+0000 7f4d850ab640 1 -- 172.21.15.55:0/543366881 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d700acb30 con 0x7f4d800cfa70 2023-08-25T04:19:13.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d88311640 1 -- 172.21.15.55:0/543366881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d800cfa70 msgr2=0x7f4d80160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:13.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d88311640 1 --2- 172.21.15.55:0/543366881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d800cfa70 0x7f4d80160a50 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f4d80070600 tx=0x7f4d7001c4d0 comp rx=0 tx=0).stop 2023-08-25T04:19:13.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d88311640 1 -- 172.21.15.55:0/543366881 shutdown_connections 2023-08-25T04:19:13.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d88311640 1 --2- 172.21.15.55:0/543366881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d800cfa70 0x7f4d80160a50 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:13.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d88311640 1 --2- 172.21.15.55:0/543366881 >> v2:172.21.15.110:3300/0 conn(0x7f4d8015c9c0 0x7f4d80160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:13.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d88311640 1 -- 172.21.15.55:0/543366881 >> 172.21.15.55:0/543366881 conn(0x7f4d800d05a0 msgr2=0x7f4d800d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:13.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d88311640 1 -- 172.21.15.55:0/543366881 shutdown_connections 2023-08-25T04:19:13.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d88311640 1 -- 172.21.15.55:0/543366881 wait complete. 2023-08-25T04:19:13.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d88311640 1 Processor -- start 2023-08-25T04:19:13.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d88311640 1 -- start start 2023-08-25T04:19:13.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d88311640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d800cfa70 0x7f4d8014ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:13.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d88311640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d8015c9c0 0x7f4d801f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:13.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d88311640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d80160f90 0x7f4d80157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:13.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d88311640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d801f5f00 con 0x7f4d800cfa70 2023-08-25T04:19:13.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d88311640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d801f5920 con 0x7f4d80160f90 2023-08-25T04:19:13.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d88311640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8014f350 con 0x7f4d8015c9c0 2023-08-25T04:19:13.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d860ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d800cfa70 0x7f4d8014ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:13.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d860ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d800cfa70 0x7f4d8014ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49356/0 (socket says 172.21.15.55:49356) 2023-08-25T04:19:13.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d860ad640 1 -- 172.21.15.55:0/3456677233 learned_addr learned my addr 172.21.15.55:0/3456677233 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:13.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d868ae640 1 --2- 172.21.15.55:0/3456677233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d80160f90 0x7f4d80157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:13.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d858ac640 1 --2- 172.21.15.55:0/3456677233 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d8015c9c0 0x7f4d801f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:13.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d860ad640 1 -- 172.21.15.55:0/3456677233 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d8015c9c0 msgr2=0x7f4d801f6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:13.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d860ad640 1 --2- 172.21.15.55:0/3456677233 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d8015c9c0 0x7f4d801f6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:13.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d860ad640 1 -- 172.21.15.55:0/3456677233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d80160f90 msgr2=0x7f4d80157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:13.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d860ad640 1 --2- 172.21.15.55:0/3456677233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d80160f90 0x7f4d80157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:13.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d860ad640 1 -- 172.21.15.55:0/3456677233 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d700094d0 con 0x7f4d800cfa70 2023-08-25T04:19:13.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d868ae640 1 --2- 172.21.15.55:0/3456677233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d80160f90 0x7f4d80157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:13.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.985+0000 7f4d858ac640 1 --2- 172.21.15.55:0/3456677233 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d8015c9c0 0x7f4d801f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:13.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.989+0000 7f4d860ad640 1 --2- 172.21.15.55:0/3456677233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d800cfa70 0x7f4d8014ee10 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00d830 tx=0x7f4d7c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:13.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.989+0000 7f4d76ffd640 1 -- 172.21.15.55:0/3456677233 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c0059a0 con 0x7f4d800cfa70 2023-08-25T04:19:13.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.989+0000 7f4d76ffd640 1 -- 172.21.15.55:0/3456677233 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7c005b00 con 0x7f4d800cfa70 2023-08-25T04:19:13.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.989+0000 7f4d76ffd640 1 -- 172.21.15.55:0/3456677233 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c005e90 con 0x7f4d800cfa70 2023-08-25T04:19:13.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.989+0000 7f4d88311640 1 -- 172.21.15.55:0/3456677233 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d801582d0 con 0x7f4d800cfa70 2023-08-25T04:19:13.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.989+0000 7f4d88311640 1 -- 172.21.15.55:0/3456677233 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d801f5b90 con 0x7f4d800cfa70 2023-08-25T04:19:13.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.989+0000 7f4d88311640 1 -- 172.21.15.55:0/3456677233 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8004dbe0 con 0x7f4d800cfa70 2023-08-25T04:19:13.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.989+0000 7f4d76ffd640 1 -- 172.21.15.55:0/3456677233 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f4d7c004240 con 0x7f4d800cfa70 2023-08-25T04:19:13.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.989+0000 7f4d76ffd640 1 --2- 172.21.15.55:0/3456677233 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f4d640657a0 0x7f4d64067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:13.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.989+0000 7f4d76ffd640 1 -- 172.21.15.55:0/3456677233 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4d7c083160 con 0x7f4d800cfa70 2023-08-25T04:19:13.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.993+0000 7f4d858ac640 1 --2- 172.21.15.55:0/3456677233 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f4d640657a0 0x7f4d64067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:13.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.993+0000 7f4d858ac640 1 --2- 172.21.15.55:0/3456677233 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f4d640657a0 0x7f4d64067c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d700ae000 tx=0x7f4d70008040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:13.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:13.993+0000 7f4d76ffd640 1 -- 172.21.15.55:0/3456677233 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4d7c050b00 con 0x7f4d800cfa70 2023-08-25T04:19:14.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.173+0000 7f4d88311640 1 -- 172.21.15.55:0/3456677233 --> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d80169850 con 0x7f4d640657a0 2023-08-25T04:19:14.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.173+0000 7f4d76ffd640 1 -- 172.21.15.55:0/3456677233 <== mgr.6113 v2:172.21.15.110:6832/2805609132 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f4d700aca10 con 0x7f4d640657a0 2023-08-25T04:19:14.174 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T04:19:14.174 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:14.174 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-08-25T04:19:14.175 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:14.175 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T04:19:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.177+0000 7f4d88311640 1 -- 172.21.15.55:0/3456677233 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f4d640657a0 msgr2=0x7f4d64067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.177+0000 7f4d88311640 1 --2- 172.21.15.55:0/3456677233 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f4d640657a0 0x7f4d64067c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d700ae000 tx=0x7f4d70008040 comp rx=0 tx=0).stop 2023-08-25T04:19:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.177+0000 7f4d88311640 1 -- 172.21.15.55:0/3456677233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d800cfa70 msgr2=0x7f4d8014ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.177+0000 7f4d88311640 1 --2- 172.21.15.55:0/3456677233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d800cfa70 0x7f4d8014ee10 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00d830 tx=0x7f4d7c00dcf0 comp rx=0 tx=0).stop 2023-08-25T04:19:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.177+0000 7f4d88311640 1 -- 172.21.15.55:0/3456677233 shutdown_connections 2023-08-25T04:19:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.177+0000 7f4d88311640 1 --2- 172.21.15.55:0/3456677233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d80160f90 0x7f4d80157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.177+0000 7f4d88311640 1 --2- 172.21.15.55:0/3456677233 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7f4d640657a0 0x7f4d64067c60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.177+0000 7f4d88311640 1 --2- 172.21.15.55:0/3456677233 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d8015c9c0 0x7f4d801f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.177+0000 7f4d88311640 1 --2- 172.21.15.55:0/3456677233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d800cfa70 0x7f4d8014ee10 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.177+0000 7f4d88311640 1 -- 172.21.15.55:0/3456677233 >> 172.21.15.55:0/3456677233 conn(0x7f4d800d05a0 msgr2=0x7f4d800aecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.177+0000 7f4d88311640 1 -- 172.21.15.55:0/3456677233 shutdown_connections 2023-08-25T04:19:14.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.177+0000 7f4d88311640 1 -- 172.21.15.55:0/3456677233 wait complete. 2023-08-25T04:19:14.195 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-25T04:19:14.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.341+0000 7fc2ba9ba640 1 Processor -- start 2023-08-25T04:19:14.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.341+0000 7fc2ba9ba640 1 -- start start 2023-08-25T04:19:14.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.341+0000 7fc2ba9ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc2b40afd30 0x7fc2b40ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:14.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.341+0000 7fc2ba9ba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b40c9a80 con 0x7fc2b40b26a0 2023-08-25T04:19:14.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.341+0000 7fc2ba9ba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b40b1600 con 0x7fc2b40b1100 2023-08-25T04:19:14.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.341+0000 7fc2ba9ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b40b18e0 con 0x7fc2b40afd30 2023-08-25T04:19:14.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.341+0000 7fc2b8f57640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc2b40b26a0 0x7fc2b406b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33450/0 (socket says 172.21.15.55:33450) 2023-08-25T04:19:14.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.341+0000 7fc2b8f57640 1 -- 172.21.15.55:0/2717038628 learned_addr learned my addr 172.21.15.55:0/2717038628 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:14.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.345+0000 7fc2b3fff640 1 --2- 172.21.15.55:0/2717038628 >> v2:172.21.15.110:3300/0 conn(0x7fc2b40afd30 0x7fc2b40ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:14.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.345+0000 7fc2b2ffd640 1 -- 172.21.15.55:0/2717038628 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80892860 0 0) 0x7fc2b40c9a80 con 0x7fc2b40b26a0 2023-08-25T04:19:14.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.345+0000 7fc2b2ffd640 1 -- 172.21.15.55:0/2717038628 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc29c003530 con 0x7fc2b40b26a0 2023-08-25T04:19:14.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.345+0000 7fc2b2ffd640 1 -- 172.21.15.55:0/2717038628 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105034814 0 0) 0x7fc2b40b1600 con 0x7fc2b40b1100 2023-08-25T04:19:14.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.345+0000 7fc2b2ffd640 1 -- 172.21.15.55:0/2717038628 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2b40c9a80 con 0x7fc2b40b1100 2023-08-25T04:19:14.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.345+0000 7fc2b3fff640 1 -- 172.21.15.55:0/2717038628 >> v1:172.21.15.110:6789/0 conn(0x7fc2b40b1100 legacy=0x7fc2b40b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:14.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.345+0000 7fc2b3fff640 1 -- 172.21.15.55:0/2717038628 >> v1:172.21.15.55:6789/0 conn(0x7fc2b40b26a0 legacy=0x7fc2b406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:14.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.345+0000 7fc2b3fff640 1 -- 172.21.15.55:0/2717038628 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b40b1bc0 con 0x7fc2b40afd30 2023-08-25T04:19:14.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.345+0000 7fc2b3fff640 1 --2- 172.21.15.55:0/2717038628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b40afd30 0x7fc2b40ca710 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40097c0 tx=0x7fc2a401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0c436744098c1cf server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:14.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.345+0000 7fc2b2ffd640 1 -- 172.21.15.55:0/2717038628 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a40ab600 con 0x7fc2b40afd30 2023-08-25T04:19:14.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.345+0000 7fc2b2ffd640 1 -- 172.21.15.55:0/2717038628 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a40a7050 con 0x7fc2b40afd30 2023-08-25T04:19:14.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.345+0000 7fc2b2ffd640 1 -- 172.21.15.55:0/2717038628 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a40ab980 con 0x7fc2b40afd30 2023-08-25T04:19:14.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2ba9ba640 1 -- 172.21.15.55:0/2717038628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b40afd30 msgr2=0x7fc2b40ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:14.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2ba9ba640 1 --2- 172.21.15.55:0/2717038628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b40afd30 0x7fc2b40ca710 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40097c0 tx=0x7fc2a401c480 comp rx=0 tx=0).stop 2023-08-25T04:19:14.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2ba9ba640 1 -- 172.21.15.55:0/2717038628 shutdown_connections 2023-08-25T04:19:14.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2ba9ba640 1 --2- 172.21.15.55:0/2717038628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b40afd30 0x7fc2b40ca710 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:14.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2ba9ba640 1 -- 172.21.15.55:0/2717038628 >> 172.21.15.55:0/2717038628 conn(0x7fc2b40cad30 msgr2=0x7fc2b40cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:14.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2ba9ba640 1 -- 172.21.15.55:0/2717038628 shutdown_connections 2023-08-25T04:19:14.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2ba9ba640 1 -- 172.21.15.55:0/2717038628 wait complete. 2023-08-25T04:19:14.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2ba9ba640 1 Processor -- start 2023-08-25T04:19:14.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2ba9ba640 1 -- start start 2023-08-25T04:19:14.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2ba9ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2b40afd30 0x7fc2b415a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:14.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2ba9ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2b40b1100 0x7fc2b4150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:14.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2ba9ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b40b26a0 0x7fc2b40c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:14.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2ba9ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b4163880 con 0x7fc2b40afd30 2023-08-25T04:19:14.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2ba9ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b4163a90 con 0x7fc2b40b26a0 2023-08-25T04:19:14.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2ba9ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b4150a40 con 0x7fc2b40b1100 2023-08-25T04:19:14.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2b3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2b40afd30 0x7fc2b415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:14.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2b3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2b40afd30 0x7fc2b415a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49358/0 (socket says 172.21.15.55:49358) 2023-08-25T04:19:14.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2b3fff640 1 -- 172.21.15.55:0/2942563289 learned_addr learned my addr 172.21.15.55:0/2942563289 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:14.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2b37fe640 1 --2- 172.21.15.55:0/2942563289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2b40b1100 0x7fc2b4150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:14.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2b8f57640 1 --2- 172.21.15.55:0/2942563289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b40b26a0 0x7fc2b40c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:14.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2b3fff640 1 -- 172.21.15.55:0/2942563289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2b40b1100 msgr2=0x7fc2b4150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:14.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2b3fff640 1 --2- 172.21.15.55:0/2942563289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2b40b1100 0x7fc2b4150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:14.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2b3fff640 1 -- 172.21.15.55:0/2942563289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b40b26a0 msgr2=0x7fc2b40c0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:14.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2b3fff640 1 --2- 172.21.15.55:0/2942563289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b40b26a0 0x7fc2b40c0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:14.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2b3fff640 1 -- 172.21.15.55:0/2942563289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a4009420 con 0x7fc2b40afd30 2023-08-25T04:19:14.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.349+0000 7fc2b8f57640 1 --2- 172.21.15.55:0/2942563289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b40b26a0 0x7fc2b40c0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:14.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.353+0000 7fc2b3fff640 1 --2- 172.21.15.55:0/2942563289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2b40afd30 0x7fc2b415a350 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4019090 tx=0x7fc2a4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:14.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.353+0000 7fc2b0ff9640 1 -- 172.21.15.55:0/2942563289 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a40b4400 con 0x7fc2b40afd30 2023-08-25T04:19:14.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.353+0000 7fc2b0ff9640 1 -- 172.21.15.55:0/2942563289 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a40b4580 con 0x7fc2b40afd30 2023-08-25T04:19:14.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.353+0000 7fc2ba9ba640 1 -- 172.21.15.55:0/2942563289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b4150d20 con 0x7fc2b40afd30 2023-08-25T04:19:14.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.353+0000 7fc2b0ff9640 1 -- 172.21.15.55:0/2942563289 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a40b4930 con 0x7fc2b40afd30 2023-08-25T04:19:14.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.353+0000 7fc2ba9ba640 1 -- 172.21.15.55:0/2942563289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b4155c60 con 0x7fc2b40afd30 2023-08-25T04:19:14.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.353+0000 7fc2ba9ba640 1 -- 172.21.15.55:0/2942563289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b40cc890 con 0x7fc2b40afd30 2023-08-25T04:19:14.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.353+0000 7fc2b0ff9640 1 -- 172.21.15.55:0/2942563289 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 38) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fc2a40b2040 con 0x7fc2b40afd30 2023-08-25T04:19:14.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.353+0000 7fc2b0ff9640 1 --2- 172.21.15.55:0/2942563289 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc2a00657a0 0x7fc2a0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:14.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.353+0000 7fc2b0ff9640 1 -- 172.21.15.55:0/2942563289 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc2a411ce00 con 0x7fc2b40afd30 2023-08-25T04:19:14.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.357+0000 7fc2b37fe640 1 --2- 172.21.15.55:0/2942563289 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc2a00657a0 0x7fc2a0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:14.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.357+0000 7fc2b37fe640 1 --2- 172.21.15.55:0/2942563289 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc2a00657a0 0x7fc2a0067c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4155b40 tx=0x7fc2a8009040 comp rx=0 tx=0).ready entity=mgr.6113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:14.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.357+0000 7fc2b0ff9640 1 -- 172.21.15.55:0/2942563289 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc2a40ea7c0 con 0x7fc2b40afd30 2023-08-25T04:19:14.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.553+0000 7fc2ba9ba640 1 -- 172.21.15.55:0/2942563289 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fc2b404e430 con 0x7fc2b40afd30 2023-08-25T04:19:14.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.841+0000 7fc2b0ff9640 1 -- 172.21.15.55:0/2942563289 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 39) v1 ==== 85081+0+0 (secure 0 0 0) 0x7fc2a4121070 con 0x7fc2b40afd30 2023-08-25T04:19:14.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.841+0000 7fc2b0ff9640 1 -- 172.21.15.55:0/2942563289 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v39) v1 ==== 92+0+0 (secure 0 0 0) 0x7fc2a4102410 con 0x7fc2b40afd30 2023-08-25T04:19:14.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.845+0000 7fc2ba9ba640 1 -- 172.21.15.55:0/2942563289 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc2a00657a0 msgr2=0x7fc2a0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:14.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.845+0000 7fc2ba9ba640 1 --2- 172.21.15.55:0/2942563289 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc2a00657a0 0x7fc2a0067c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4155b40 tx=0x7fc2a8009040 comp rx=0 tx=0).stop 2023-08-25T04:19:14.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.845+0000 7fc2ba9ba640 1 -- 172.21.15.55:0/2942563289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2b40afd30 msgr2=0x7fc2b415a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:14.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.845+0000 7fc2ba9ba640 1 --2- 172.21.15.55:0/2942563289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2b40afd30 0x7fc2b415a350 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4019090 tx=0x7fc2a4019220 comp rx=0 tx=0).stop 2023-08-25T04:19:14.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.845+0000 7fc2ba9ba640 1 -- 172.21.15.55:0/2942563289 shutdown_connections 2023-08-25T04:19:14.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.845+0000 7fc2ba9ba640 1 --2- 172.21.15.55:0/2942563289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2b40b26a0 0x7fc2b40c0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:14.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.845+0000 7fc2ba9ba640 1 --2- 172.21.15.55:0/2942563289 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fc2a00657a0 0x7fc2a0067c60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:14.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.845+0000 7fc2ba9ba640 1 --2- 172.21.15.55:0/2942563289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2b40b1100 0x7fc2b4150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:14.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.845+0000 7fc2ba9ba640 1 --2- 172.21.15.55:0/2942563289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2b40afd30 0x7fc2b415a350 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:14.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.845+0000 7fc2ba9ba640 1 -- 172.21.15.55:0/2942563289 >> 172.21.15.55:0/2942563289 conn(0x7fc2b40cad30 msgr2=0x7fc2b406fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:14.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.845+0000 7fc2ba9ba640 1 -- 172.21.15.55:0/2942563289 shutdown_connections 2023-08-25T04:19:14.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:14.845+0000 7fc2ba9ba640 1 -- 172.21.15.55:0/2942563289 wait complete. 2023-08-25T04:19:14.865 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-25T04:19:15.017 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:15.012+0000 7f8c14284180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:19:15.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.013+0000 7fdf8352c640 1 Processor -- start 2023-08-25T04:19:15.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.017+0000 7fdf8352c640 1 -- start start 2023-08-25T04:19:15.019 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:15.017+0000 7f7fe7be8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:19:15.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.017+0000 7fdf8352c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdf7c15e3c0 0x7fdf7c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:15.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.017+0000 7fdf8352c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf7c0cd5a0 con 0x7fdf7c1601f0 2023-08-25T04:19:15.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.017+0000 7fdf8352c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf7c0cd880 con 0x7fdf7c0d1290 2023-08-25T04:19:15.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.017+0000 7fdf8352c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf7c0cdb60 con 0x7fdf7c15e3c0 2023-08-25T04:19:15.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.017+0000 7fdf812c8640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdf7c1601f0 0x7fdf7c0d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33464/0 (socket says 172.21.15.55:33464) 2023-08-25T04:19:15.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.017+0000 7fdf812c8640 1 -- 172.21.15.55:0/1276764397 learned_addr learned my addr 172.21.15.55:0/1276764397 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:15.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.017+0000 7fdf80ac7640 1 --2- 172.21.15.55:0/1276764397 >> v2:172.21.15.110:3300/0 conn(0x7fdf7c15e3c0 0x7fdf7c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:15.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.017+0000 7fdf73fff640 1 -- 172.21.15.55:0/1276764397 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278528899 0 0) 0x7fdf7c0cd5a0 con 0x7fdf7c1601f0 2023-08-25T04:19:15.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.017+0000 7fdf73fff640 1 -- 172.21.15.55:0/1276764397 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf68003530 con 0x7fdf7c1601f0 2023-08-25T04:19:15.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.017+0000 7fdf80ac7640 1 -- 172.21.15.55:0/1276764397 >> v1:172.21.15.110:6789/0 conn(0x7fdf7c0d1290 legacy=0x7fdf7c15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:15.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.017+0000 7fdf73fff640 1 -- 172.21.15.55:0/1276764397 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161513838 0 0) 0x7fdf7c0cd880 con 0x7fdf7c0d1290 2023-08-25T04:19:15.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.017+0000 7fdf80ac7640 1 -- 172.21.15.55:0/1276764397 >> v1:172.21.15.55:6789/0 conn(0x7fdf7c1601f0 legacy=0x7fdf7c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:15.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.017+0000 7fdf80ac7640 1 -- 172.21.15.55:0/1276764397 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c0cde40 con 0x7fdf7c15e3c0 2023-08-25T04:19:15.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.021+0000 7fdf80ac7640 1 --2- 172.21.15.55:0/1276764397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf7c15e3c0 0x7fdf7c15d430 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0097c0 tx=0x7fdf6c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46d4b84353ca659 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:15.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.021+0000 7fdf73fff640 1 -- 172.21.15.55:0/1276764397 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c0ab600 con 0x7fdf7c15e3c0 2023-08-25T04:19:15.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.021+0000 7fdf73fff640 1 -- 172.21.15.55:0/1276764397 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c0a7050 con 0x7fdf7c15e3c0 2023-08-25T04:19:15.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.021+0000 7fdf73fff640 1 -- 172.21.15.55:0/1276764397 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c0ab960 con 0x7fdf7c15e3c0 2023-08-25T04:19:15.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.021+0000 7fdf8352c640 1 -- 172.21.15.55:0/1276764397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf7c15e3c0 msgr2=0x7fdf7c15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:15.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.021+0000 7fdf8352c640 1 --2- 172.21.15.55:0/1276764397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf7c15e3c0 0x7fdf7c15d430 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0097c0 tx=0x7fdf6c01c450 comp rx=0 tx=0).stop 2023-08-25T04:19:15.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.021+0000 7fdf8352c640 1 -- 172.21.15.55:0/1276764397 shutdown_connections 2023-08-25T04:19:15.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.021+0000 7fdf8352c640 1 --2- 172.21.15.55:0/1276764397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf7c15e3c0 0x7fdf7c15d430 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.021+0000 7fdf8352c640 1 -- 172.21.15.55:0/1276764397 >> 172.21.15.55:0/1276764397 conn(0x7fdf7c0d27d0 msgr2=0x7fdf7c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:15.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.021+0000 7fdf8352c640 1 -- 172.21.15.55:0/1276764397 shutdown_connections 2023-08-25T04:19:15.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.021+0000 7fdf8352c640 1 -- 172.21.15.55:0/1276764397 wait complete. 2023-08-25T04:19:15.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf8352c640 1 Processor -- start 2023-08-25T04:19:15.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf8352c640 1 -- start start 2023-08-25T04:19:15.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf8352c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf7c0d1290 0x7fdf7c150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:15.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf8352c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf7c15e3c0 0x7fdf7c0c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:15.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf8352c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf7c1601f0 0x7fdf7c0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:15.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf8352c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c152440 con 0x7fdf7c15e3c0 2023-08-25T04:19:15.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf8352c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c0c7520 con 0x7fdf7c0d1290 2023-08-25T04:19:15.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf8352c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c151680 con 0x7fdf7c1601f0 2023-08-25T04:19:15.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf812c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf7c0d1290 0x7fdf7c150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:15.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf80ac7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf7c15e3c0 0x7fdf7c0c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:15.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf812c8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf7c0d1290 0x7fdf7c150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:43248/0 (socket says 172.21.15.55:43248) 2023-08-25T04:19:15.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf812c8640 1 -- 172.21.15.55:0/3047924949 learned_addr learned my addr 172.21.15.55:0/3047924949 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:15.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf81ac9640 1 --2- 172.21.15.55:0/3047924949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf7c1601f0 0x7fdf7c0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:15.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf80ac7640 1 -- 172.21.15.55:0/3047924949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf7c1601f0 msgr2=0x7fdf7c0b7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:15.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf80ac7640 1 --2- 172.21.15.55:0/3047924949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf7c1601f0 0x7fdf7c0b7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf80ac7640 1 -- 172.21.15.55:0/3047924949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf7c0d1290 msgr2=0x7fdf7c150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:15.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf80ac7640 1 --2- 172.21.15.55:0/3047924949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf7c0d1290 0x7fdf7c150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf80ac7640 1 -- 172.21.15.55:0/3047924949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c009420 con 0x7fdf7c15e3c0 2023-08-25T04:19:15.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf80ac7640 1 --2- 172.21.15.55:0/3047924949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf7c15e3c0 0x7fdf7c0c6ad0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0ab000 tx=0x7fdf6c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:15.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf71ffb640 1 -- 172.21.15.55:0/3047924949 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c003bf0 con 0x7fdf7c15e3c0 2023-08-25T04:19:15.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf71ffb640 1 -- 172.21.15.55:0/3047924949 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c003d50 con 0x7fdf7c15e3c0 2023-08-25T04:19:15.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf71ffb640 1 -- 172.21.15.55:0/3047924949 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c0ab600 con 0x7fdf7c15e3c0 2023-08-25T04:19:15.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf8352c640 1 -- 172.21.15.55:0/3047924949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7c151960 con 0x7fdf7c15e3c0 2023-08-25T04:19:15.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.025+0000 7fdf8352c640 1 -- 172.21.15.55:0/3047924949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf7c151f20 con 0x7fdf7c15e3c0 2023-08-25T04:19:15.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.029+0000 7fdf8352c640 1 -- 172.21.15.55:0/3047924949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf7c0b5260 con 0x7fdf7c15e3c0 2023-08-25T04:19:15.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.029+0000 7fdf71ffb640 1 -- 172.21.15.55:0/3047924949 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 39) v1 ==== 85081+0+0 (secure 0 0 0) 0x7fdf6c0b2040 con 0x7fdf7c15e3c0 2023-08-25T04:19:15.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.029+0000 7fdf71ffb640 1 --2- 172.21.15.55:0/3047924949 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fdf600657f0 0x7fdf60067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:15.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.029+0000 7fdf71ffb640 1 -- 172.21.15.55:0/3047924949 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdf6c11cf50 con 0x7fdf7c15e3c0 2023-08-25T04:19:15.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.029+0000 7fdf812c8640 1 -- 172.21.15.55:0/3047924949 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fdf600657f0 msgr2=0x7fdf60067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2805609132 2023-08-25T04:19:15.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.029+0000 7fdf812c8640 1 --2- 172.21.15.55:0/3047924949 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fdf600657f0 0x7fdf60067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:19:15.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.037+0000 7fdf71ffb640 1 -- 172.21.15.55:0/3047924949 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fdf6c0ea750 con 0x7fdf7c15e3c0 2023-08-25T04:19:15.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.193+0000 7fdf8352c640 1 -- 172.21.15.55:0/3047924949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fdf7c073ec0 con 0x7fdf7c15e3c0 2023-08-25T04:19:15.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.201+0000 7fdf71ffb640 1 -- 172.21.15.55:0/3047924949 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdf6c0b00d0 con 0x7fdf7c15e3c0 2023-08-25T04:19:15.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.201+0000 7fdf8352c640 1 -- 172.21.15.55:0/3047924949 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fdf600657f0 msgr2=0x7fdf60067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:19:15.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.201+0000 7fdf8352c640 1 --2- 172.21.15.55:0/3047924949 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fdf600657f0 0x7fdf60067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.201+0000 7fdf8352c640 1 -- 172.21.15.55:0/3047924949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf7c15e3c0 msgr2=0x7fdf7c0c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:15.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.201+0000 7fdf8352c640 1 --2- 172.21.15.55:0/3047924949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf7c15e3c0 0x7fdf7c0c6ad0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0ab000 tx=0x7fdf6c0191f0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.201+0000 7fdf8352c640 1 -- 172.21.15.55:0/3047924949 shutdown_connections 2023-08-25T04:19:15.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.201+0000 7fdf8352c640 1 --2- 172.21.15.55:0/3047924949 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fdf600657f0 0x7fdf60067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.201+0000 7fdf8352c640 1 --2- 172.21.15.55:0/3047924949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf7c1601f0 0x7fdf7c0b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.201+0000 7fdf8352c640 1 --2- 172.21.15.55:0/3047924949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf7c15e3c0 0x7fdf7c0c6ad0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.201+0000 7fdf8352c640 1 --2- 172.21.15.55:0/3047924949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf7c0d1290 0x7fdf7c150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.201+0000 7fdf8352c640 1 -- 172.21.15.55:0/3047924949 >> 172.21.15.55:0/3047924949 conn(0x7fdf7c0d27d0 msgr2=0x7fdf7c0b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:15.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.201+0000 7fdf8352c640 1 -- 172.21.15.55:0/3047924949 shutdown_connections 2023-08-25T04:19:15.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.201+0000 7fdf8352c640 1 -- 172.21.15.55:0/3047924949 wait complete. 2023-08-25T04:19:15.222 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-08-25T04:19:15.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.369+0000 7fdcae0f7640 1 Processor -- start 2023-08-25T04:19:15.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.369+0000 7fdcae0f7640 1 -- start start 2023-08-25T04:19:15.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.373+0000 7fdcae0f7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdca80cd190 0x7fdca80d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:15.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.373+0000 7fdcae0f7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdca80d10a0 0x7fdca80b1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:15.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.373+0000 7fdcae0f7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca80d14f0 con 0x7fdca815c8a0 2023-08-25T04:19:15.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.373+0000 7fdcae0f7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca80d0690 con 0x7fdca80d10a0 2023-08-25T04:19:15.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.373+0000 7fdcae0f7640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca80cd6c0 con 0x7fdca80cd190 2023-08-25T04:19:15.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.373+0000 7fdcad8f6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdca80d10a0 0x7fdca80b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:15.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.373+0000 7fdcad8f6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdca80d10a0 0x7fdca80b1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49400/0 (socket says 172.21.15.55:49400) 2023-08-25T04:19:15.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.373+0000 7fdcad8f6640 1 -- 172.21.15.55:0/269304344 learned_addr learned my addr 172.21.15.55:0/269304344 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.373+0000 7fdcac8f4640 1 --2- 172.21.15.55:0/269304344 >> v2:172.21.15.110:3300/0 conn(0x7fdca80cd190 0x7fdca80d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.373+0000 7fdcad8f6640 1 -- 172.21.15.55:0/269304344 >> v2:172.21.15.110:3300/0 conn(0x7fdca80cd190 msgr2=0x7fdca80d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.373+0000 7fdcad8f6640 1 --2- 172.21.15.55:0/269304344 >> v2:172.21.15.110:3300/0 conn(0x7fdca80cd190 0x7fdca80d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.373+0000 7fdcad8f6640 1 -- 172.21.15.55:0/269304344 >> v1:172.21.15.110:6789/0 conn(0x7fdca815c8a0 legacy=0x7fdca80b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.373+0000 7fdcad8f6640 1 -- 172.21.15.55:0/269304344 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca80cd9a0 con 0x7fdca80d10a0 2023-08-25T04:19:15.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.377+0000 7fdcad8f6640 1 --2- 172.21.15.55:0/269304344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdca80d10a0 0x7fdca80b1160 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fdca808b430 tx=0x7fdca001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b83c892c3da052 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:15.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.377+0000 7fdc9ffff640 1 -- 172.21.15.55:0/269304344 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca00a5860 con 0x7fdca80d10a0 2023-08-25T04:19:15.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.377+0000 7fdc9ffff640 1 -- 172.21.15.55:0/269304344 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca00a59c0 con 0x7fdca80d10a0 2023-08-25T04:19:15.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.377+0000 7fdc9ffff640 1 -- 172.21.15.55:0/269304344 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca00a5d50 con 0x7fdca80d10a0 2023-08-25T04:19:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.377+0000 7fdcae0f7640 1 -- 172.21.15.55:0/269304344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdca80d10a0 msgr2=0x7fdca80b1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.377+0000 7fdcae0f7640 1 --2- 172.21.15.55:0/269304344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdca80d10a0 0x7fdca80b1160 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fdca808b430 tx=0x7fdca001c9a0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.377+0000 7fdcae0f7640 1 -- 172.21.15.55:0/269304344 shutdown_connections 2023-08-25T04:19:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.377+0000 7fdcae0f7640 1 --2- 172.21.15.55:0/269304344 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdca80d10a0 0x7fdca80b1160 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.377+0000 7fdcae0f7640 1 --2- 172.21.15.55:0/269304344 >> v2:172.21.15.110:3300/0 conn(0x7fdca80cd190 0x7fdca80d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.377+0000 7fdcae0f7640 1 -- 172.21.15.55:0/269304344 >> 172.21.15.55:0/269304344 conn(0x7fdca80d2610 msgr2=0x7fdca80d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.377+0000 7fdcae0f7640 1 -- 172.21.15.55:0/269304344 shutdown_connections 2023-08-25T04:19:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.377+0000 7fdcae0f7640 1 -- 172.21.15.55:0/269304344 wait complete. 2023-08-25T04:19:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.377+0000 7fdcae0f7640 1 Processor -- start 2023-08-25T04:19:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.377+0000 7fdcae0f7640 1 -- start start 2023-08-25T04:19:15.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcae0f7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdca80cd190 0x7fdca814c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:15.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcae0f7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdca80d10a0 0x7fdca80b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:15.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcae0f7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdca815c8a0 0x7fdca80b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:15.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcae0f7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca8156ba0 con 0x7fdca80d10a0 2023-08-25T04:19:15.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcae0f7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca8155ff0 con 0x7fdca815c8a0 2023-08-25T04:19:15.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcae0f7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca8156200 con 0x7fdca80cd190 2023-08-25T04:19:15.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcac8f4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdca80d10a0 0x7fdca80b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:15.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcac8f4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdca80d10a0 0x7fdca80b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49412/0 (socket says 172.21.15.55:49412) 2023-08-25T04:19:15.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcac8f4640 1 -- 172.21.15.55:0/2373895901 learned_addr learned my addr 172.21.15.55:0/2373895901 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:15.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcad0f5640 1 --2- 172.21.15.55:0/2373895901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdca80cd190 0x7fdca814c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:15.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcad8f6640 1 --2- 172.21.15.55:0/2373895901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdca815c8a0 0x7fdca80b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:15.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcac8f4640 1 -- 172.21.15.55:0/2373895901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdca80cd190 msgr2=0x7fdca814c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:15.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcac8f4640 1 --2- 172.21.15.55:0/2373895901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdca80cd190 0x7fdca814c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcac8f4640 1 -- 172.21.15.55:0/2373895901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdca815c8a0 msgr2=0x7fdca80b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:15.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcac8f4640 1 --2- 172.21.15.55:0/2373895901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdca815c8a0 0x7fdca80b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcac8f4640 1 -- 172.21.15.55:0/2373895901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0009b30 con 0x7fdca80d10a0 2023-08-25T04:19:15.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcac8f4640 1 --2- 172.21.15.55:0/2373895901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdca80d10a0 0x7fdca80b5dd0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800e870 tx=0x7fdc9800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:15.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdc9dffb640 1 -- 172.21.15.55:0/2373895901 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98009510 con 0x7fdca80d10a0 2023-08-25T04:19:15.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdc9dffb640 1 -- 172.21.15.55:0/2373895901 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9800eec0 con 0x7fdca80d10a0 2023-08-25T04:19:15.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdc9dffb640 1 -- 172.21.15.55:0/2373895901 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9800cb40 con 0x7fdca80d10a0 2023-08-25T04:19:15.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcae0f7640 1 -- 172.21.15.55:0/2373895901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca81564e0 con 0x7fdca80d10a0 2023-08-25T04:19:15.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcae0f7640 1 -- 172.21.15.55:0/2373895901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca80b5400 con 0x7fdca80d10a0 2023-08-25T04:19:15.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.381+0000 7fdcae0f7640 1 -- 172.21.15.55:0/2373895901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca8066d20 con 0x7fdca80d10a0 2023-08-25T04:19:15.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.385+0000 7fdc9dffb640 1 -- 172.21.15.55:0/2373895901 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 39) v1 ==== 85081+0+0 (secure 0 0 0) 0x7fdc9800cca0 con 0x7fdca80d10a0 2023-08-25T04:19:15.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.385+0000 7fdc9dffb640 1 --2- 172.21.15.55:0/2373895901 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fdc8c0657f0 0x7fdc8c067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:15.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.385+0000 7fdc9dffb640 1 -- 172.21.15.55:0/2373895901 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc980830e0 con 0x7fdca80d10a0 2023-08-25T04:19:15.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.385+0000 7fdcad0f5640 1 -- 172.21.15.55:0/2373895901 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fdc8c0657f0 msgr2=0x7fdc8c067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2805609132 2023-08-25T04:19:15.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.385+0000 7fdcad0f5640 1 --2- 172.21.15.55:0/2373895901 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fdc8c0657f0 0x7fdc8c067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:19:15.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.389+0000 7fdc9dffb640 1 -- 172.21.15.55:0/2373895901 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fdc98050aa0 con 0x7fdca80d10a0 2023-08-25T04:19:15.434 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:15.432+0000 7f8c14284180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:19:15.464 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:15.465+0000 7f7fe7be8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:19:15.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.549+0000 7fdcae0f7640 1 -- 172.21.15.55:0/2373895901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fdca80d0940 con 0x7fdca80d10a0 2023-08-25T04:19:15.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.553+0000 7fdc9dffb640 1 -- 172.21.15.55:0/2373895901 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) v1 ==== 133+0+0 (secure 0 0 0) 0x7fdc980540c0 con 0x7fdca80d10a0 2023-08-25T04:19:15.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.557+0000 7fdcae0f7640 1 -- 172.21.15.55:0/2373895901 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fdc8c0657f0 msgr2=0x7fdc8c067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:19:15.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.557+0000 7fdcae0f7640 1 --2- 172.21.15.55:0/2373895901 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fdc8c0657f0 0x7fdc8c067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.557+0000 7fdcae0f7640 1 -- 172.21.15.55:0/2373895901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdca80d10a0 msgr2=0x7fdca80b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:15.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.557+0000 7fdcae0f7640 1 --2- 172.21.15.55:0/2373895901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdca80d10a0 0x7fdca80b5dd0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800e870 tx=0x7fdc9800ec70 comp rx=0 tx=0).stop 2023-08-25T04:19:15.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.557+0000 7fdcae0f7640 1 -- 172.21.15.55:0/2373895901 shutdown_connections 2023-08-25T04:19:15.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.557+0000 7fdcae0f7640 1 --2- 172.21.15.55:0/2373895901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdca815c8a0 0x7fdca80b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.557+0000 7fdcae0f7640 1 --2- 172.21.15.55:0/2373895901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdca80d10a0 0x7fdca80b5dd0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.557+0000 7fdcae0f7640 1 --2- 172.21.15.55:0/2373895901 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fdc8c0657f0 0x7fdc8c067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.557+0000 7fdcae0f7640 1 --2- 172.21.15.55:0/2373895901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdca80cd190 0x7fdca814c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.557+0000 7fdcae0f7640 1 -- 172.21.15.55:0/2373895901 >> 172.21.15.55:0/2373895901 conn(0x7fdca80d2610 msgr2=0x7fdca80b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:15.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.557+0000 7fdcae0f7640 1 -- 172.21.15.55:0/2373895901 shutdown_connections 2023-08-25T04:19:15.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.557+0000 7fdcae0f7640 1 -- 172.21.15.55:0/2373895901 wait complete. 2023-08-25T04:19:15.575 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-08-25T04:19:15.583 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:15.580+0000 7f8c14284180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:19:15.628 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:15.629+0000 7f7fe7be8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:19:15.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.729+0000 7fa629b82640 1 Processor -- start 2023-08-25T04:19:15.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.729+0000 7fa629b82640 1 -- start start 2023-08-25T04:19:15.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.729+0000 7fa629b82640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa62415cb40 0x7fa6240d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:15.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.729+0000 7fa629b82640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6240b59f0 0x7fa6240b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:15.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.729+0000 7fa629b82640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6240d1970 con 0x7fa6240cf340 2023-08-25T04:19:15.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.729+0000 7fa629b82640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6240d0d80 con 0x7fa6240b59f0 2023-08-25T04:19:15.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.729+0000 7fa629b82640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6240d1040 con 0x7fa62415cb40 2023-08-25T04:19:15.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.729+0000 7fa623fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6240b59f0 0x7fa6240b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:15.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.729+0000 7fa623fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa6240b59f0 0x7fa6240b5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49414/0 (socket says 172.21.15.55:49414) 2023-08-25T04:19:15.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.729+0000 7fa623fff640 1 -- 172.21.15.55:0/2485122037 learned_addr learned my addr 172.21.15.55:0/2485122037 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:15.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.729+0000 7fa6237fe640 1 --2- 172.21.15.55:0/2485122037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa62415cb40 0x7fa6240d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:15.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.729+0000 7fa623fff640 1 -- 172.21.15.55:0/2485122037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa62415cb40 msgr2=0x7fa6240d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:15.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.729+0000 7fa623fff640 1 --2- 172.21.15.55:0/2485122037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa62415cb40 0x7fa6240d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.729+0000 7fa623fff640 1 -- 172.21.15.55:0/2485122037 >> v1:172.21.15.55:6789/0 conn(0x7fa6240cf340 legacy=0x7fa6240cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:15.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.729+0000 7fa622ffd640 1 -- 172.21.15.55:0/2485122037 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095756065 0 0) 0x7fa6240d1970 con 0x7fa6240cf340 2023-08-25T04:19:15.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.733+0000 7fa623fff640 1 -- 172.21.15.55:0/2485122037 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6240d1320 con 0x7fa6240b59f0 2023-08-25T04:19:15.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.733+0000 7fa623fff640 1 --2- 172.21.15.55:0/2485122037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240b59f0 0x7fa6240b5e60 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009e50 tx=0x7fa61c01f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8bad6b541e45fc4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:15.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.733+0000 7fa622ffd640 1 -- 172.21.15.55:0/2485122037 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c0af400 con 0x7fa6240b59f0 2023-08-25T04:19:15.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.733+0000 7fa622ffd640 1 -- 172.21.15.55:0/2485122037 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c0ab050 con 0x7fa6240b59f0 2023-08-25T04:19:15.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.733+0000 7fa622ffd640 1 -- 172.21.15.55:0/2485122037 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c0af780 con 0x7fa6240b59f0 2023-08-25T04:19:15.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.733+0000 7fa629b82640 1 -- 172.21.15.55:0/2485122037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240b59f0 msgr2=0x7fa6240b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:15.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.733+0000 7fa629b82640 1 --2- 172.21.15.55:0/2485122037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240b59f0 0x7fa6240b5e60 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009e50 tx=0x7fa61c01f1f0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.733+0000 7fa629b82640 1 -- 172.21.15.55:0/2485122037 shutdown_connections 2023-08-25T04:19:15.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.733+0000 7fa629b82640 1 --2- 172.21.15.55:0/2485122037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240b59f0 0x7fa6240b5e60 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.733+0000 7fa629b82640 1 --2- 172.21.15.55:0/2485122037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa62415cb40 0x7fa6240d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.733+0000 7fa629b82640 1 -- 172.21.15.55:0/2485122037 >> 172.21.15.55:0/2485122037 conn(0x7fa62406aae0 msgr2=0x7fa62406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:15.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa629b82640 1 -- 172.21.15.55:0/2485122037 shutdown_connections 2023-08-25T04:19:15.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa629b82640 1 -- 172.21.15.55:0/2485122037 wait complete. 2023-08-25T04:19:15.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa629b82640 1 Processor -- start 2023-08-25T04:19:15.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa629b82640 1 -- start start 2023-08-25T04:19:15.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa629b82640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6240b59f0 0x7fa6240c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:15.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa629b82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240cf340 0x7fa624159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:15.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa629b82640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa62415cb40 0x7fa6240b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:15.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa629b82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6240c87b0 con 0x7fa6240cf340 2023-08-25T04:19:15.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa629b82640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6240c84d0 con 0x7fa62415cb40 2023-08-25T04:19:15.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa629b82640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62415cfc0 con 0x7fa6240b59f0 2023-08-25T04:19:15.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa6237fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6240b59f0 0x7fa6240c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:15.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa61bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240cf340 0x7fa624159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:15.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa6237fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6240b59f0 0x7fa6240c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:42078/0 (socket says 172.21.15.55:42078) 2023-08-25T04:19:15.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa6237fe640 1 -- 172.21.15.55:0/2565268700 learned_addr learned my addr 172.21.15.55:0/2565268700 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:15.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa623fff640 1 --2- 172.21.15.55:0/2565268700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa62415cb40 0x7fa6240b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:15.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa6237fe640 1 -- 172.21.15.55:0/2565268700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa62415cb40 msgr2=0x7fa6240b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:15.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa6237fe640 1 --2- 172.21.15.55:0/2565268700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa62415cb40 0x7fa6240b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa6237fe640 1 -- 172.21.15.55:0/2565268700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240cf340 msgr2=0x7fa624159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:15.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa6237fe640 1 --2- 172.21.15.55:0/2565268700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240cf340 0x7fa624159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:15.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa6237fe640 1 -- 172.21.15.55:0/2565268700 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c009b30 con 0x7fa6240b59f0 2023-08-25T04:19:15.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.737+0000 7fa61bfff640 1 --2- 172.21.15.55:0/2565268700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6240cf340 0x7fa624159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:15.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.741+0000 7fa6237fe640 1 --2- 172.21.15.55:0/2565268700 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6240b59f0 0x7fa6240c7ef0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa61400e930 tx=0x7fa61400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:15.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.741+0000 7fa620ff9640 1 -- 172.21.15.55:0/2565268700 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614009690 con 0x7fa6240b59f0 2023-08-25T04:19:15.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.741+0000 7fa620ff9640 1 -- 172.21.15.55:0/2565268700 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61400ca00 con 0x7fa6240b59f0 2023-08-25T04:19:15.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.741+0000 7fa629b82640 1 -- 172.21.15.55:0/2565268700 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62415d2a0 con 0x7fa6240b59f0 2023-08-25T04:19:15.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.741+0000 7fa620ff9640 1 -- 172.21.15.55:0/2565268700 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61400cd70 con 0x7fa6240b59f0 2023-08-25T04:19:15.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.741+0000 7fa629b82640 1 -- 172.21.15.55:0/2565268700 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62415a410 con 0x7fa6240b59f0 2023-08-25T04:19:15.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.741+0000 7fa629b82640 1 -- 172.21.15.55:0/2565268700 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa624071f80 con 0x7fa6240b59f0 2023-08-25T04:19:15.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.741+0000 7fa620ff9640 1 -- 172.21.15.55:0/2565268700 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 39) v1 ==== 85081+0+0 (secure 0 0 0) 0x7fa614013470 con 0x7fa6240b59f0 2023-08-25T04:19:15.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.741+0000 7fa620ff9640 1 --2- 172.21.15.55:0/2565268700 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa6040657f0 0x7fa604067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:15.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.741+0000 7fa620ff9640 1 -- 172.21.15.55:0/2565268700 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa6140832d0 con 0x7fa6240b59f0 2023-08-25T04:19:15.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.741+0000 7fa61bfff640 1 -- 172.21.15.55:0/2565268700 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa6040657f0 msgr2=0x7fa604067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2805609132 2023-08-25T04:19:15.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.741+0000 7fa61bfff640 1 --2- 172.21.15.55:0/2565268700 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa6040657f0 0x7fa604067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:19:15.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.745+0000 7fa620ff9640 1 -- 172.21.15.55:0/2565268700 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa614050d50 con 0x7fa6240b59f0 2023-08-25T04:19:15.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.921+0000 7fa629b82640 1 -- 172.21.15.55:0/2565268700 --> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6240b1f00 con 0x7fa6040657f0 2023-08-25T04:19:15.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.945+0000 7fa61bfff640 1 -- 172.21.15.55:0/2565268700 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa6040657f0 msgr2=0x7fa604067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2805609132 2023-08-25T04:19:15.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:15.945+0000 7fa61bfff640 1 --2- 172.21.15.55:0/2565268700 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa6040657f0 0x7fa604067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-25T04:19:16.068 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:16.064+0000 7f8c14284180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:19:16.126 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:16.124+0000 7f8c14284180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:19:16.142 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:16.141+0000 7f7fe7be8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:19:16.182 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:16.180+0000 7f8c14284180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:19:16.203 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:16.205+0000 7f7fe7be8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:19:16.262 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:16.261+0000 7f7fe7be8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:19:16.267 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:16.264+0000 7f8c14284180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:19:16.325 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:16.324+0000 7f8c14284180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:19:16.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:16.349+0000 7fa61bfff640 1 -- 172.21.15.55:0/2565268700 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa6040657f0 msgr2=0x7fa604067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2805609132 2023-08-25T04:19:16.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:16.349+0000 7fa61bfff640 1 --2- 172.21.15.55:0/2565268700 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa6040657f0 0x7fa604067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-25T04:19:16.353 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:16.353+0000 7f7fe7be8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:19:16.409 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:16.404+0000 7f8c14284180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:19:16.413 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:16.413+0000 7f7fe7be8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:19:16.464 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:16.460+0000 7f8c14284180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:19:16.501 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:16.501+0000 7f7fe7be8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:19:16.560 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:16.561+0000 7f7fe7be8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:19:16.607 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:16.604+0000 7f8c14284180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:19:16.666 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:16.664+0000 7f8c14284180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:19:16.710 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:16.709+0000 7f7fe7be8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:19:16.771 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:16.773+0000 7f7fe7be8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:19:16.904 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:19:16.905 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:19:16.905 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:19:16.913 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:16.912+0000 7f8c14284180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:19:17.022 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:19:17.023 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:19:17.023 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:19:17.030 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:17.029+0000 7f7fe7be8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:19:17.046 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:17.044+0000 7f8c14284180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:19:17.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:17.153+0000 7fa61bfff640 1 -- 172.21.15.55:0/2565268700 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa6040657f0 msgr2=0x7fa604067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2805609132 2023-08-25T04:19:17.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:17.153+0000 7fa61bfff640 1 --2- 172.21.15.55:0/2565268700 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa6040657f0 0x7fa604067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-25T04:19:17.170 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:17.168+0000 7f8c14284180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:19:17.172 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:17.173+0000 7f7fe7be8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:19:17.240 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:17.236+0000 7f8c14284180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:19:17.303 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:17.301+0000 7f7fe7be8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:19:17.375 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:17.372+0000 7f8c14284180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:19:17.376 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:17.377+0000 7f7fe7be8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:19:17.519 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:17.521+0000 7f7fe7be8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:19:17.912 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:17.908+0000 7f8c14284180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:19:17.996 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:17.992+0000 7f8c14284180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:19:18.088 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:18.089+0000 7f7fe7be8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:19:18.145 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:18.140+0000 7f8c14284180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:19:18.178 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:18.177+0000 7f7fe7be8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:19:18.226 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:18.224+0000 7f8c14284180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:19:18.333 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:18.333+0000 7f7fe7be8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:19:18.420 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:18.421+0000 7f7fe7be8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:19:18.539 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:18.536+0000 7f8c14284180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:19:18.599 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:18.596+0000 7f8c14284180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:19:18.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:18.613+0000 7fa620ff9640 1 -- 172.21.15.55:0/2565268700 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mgrmap(e 40) v1 ==== 84690+0+0 (secure 0 0 0) 0x7fa614051120 con 0x7fa6240b59f0 2023-08-25T04:19:18.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:18.613+0000 7fa620ff9640 1 -- 172.21.15.55:0/2565268700 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa6040657f0 msgr2=0x7fa604067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:19:18.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:18.613+0000 7fa620ff9640 1 --2- 172.21.15.55:0/2565268700 >> [v2:172.21.15.110:6832/2805609132,v1:172.21.15.110:6833/2805609132] conn(0x7fa6040657f0 0x7fa604067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:18.730 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:18.724+0000 7f8b970b3640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:18.730 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:18.724+0000 7f8b970b3640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:18.730 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:18.724+0000 7f8b970b3640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:18.730 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:18.724+0000 7f8b970b3640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:18.730 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:18.724+0000 7f8b970b3640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:18.731 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:18.728+0000 7f8b9a0b9640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:18.731 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:18.728+0000 7f8b9a0b9640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:18.731 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:18.728+0000 7f8b9a0b9640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:18.731 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:18.728+0000 7f8b9a0b9640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:18.731 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:18.728+0000 7f8b9a0b9640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:18.772 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:18.773+0000 7f7fe7be8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:19:18.836 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:18.837+0000 7f7fe7be8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:19:19.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.621+0000 7fa620ff9640 1 -- 172.21.15.55:0/2565268700 <== mon.2 v2:172.21.15.110:3301/0 8 ==== mgrmap(e 41) v1 ==== 84817+0+0 (secure 0 0 0) 0x7fa6140815f0 con 0x7fa6240b59f0 2023-08-25T04:19:19.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.621+0000 7fa620ff9640 1 --2- 172.21.15.55:0/2565268700 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fa604033910 0x7fa60406fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:19.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.621+0000 7fa620ff9640 1 -- 172.21.15.55:0/2565268700 --> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa604033cf0 con 0x7fa604033910 2023-08-25T04:19:19.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.625+0000 7fa61bfff640 1 --2- 172.21.15.55:0/2565268700 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fa604033910 0x7fa60406fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:19.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.625+0000 7fa61bfff640 1 --2- 172.21.15.55:0/2565268700 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fa604033910 0x7fa60406fcd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa62415ae00 tx=0x7fa60c007dc0 comp rx=0 tx=0).ready entity=mgr.6425 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:19.635 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:19.632+0000 7f8ba10c7640 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-08-25T04:19:19.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.637+0000 7fa620ff9640 1 -- 172.21.15.55:0/2565268700 <== mgr.6425 v2:172.21.15.110:6832/3580388085 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fa604033cf0 con 0x7fa604033910 2023-08-25T04:19:19.636 INFO:teuthology.orchestra.run.smithi055.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-08-25T04:19:19.646 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-08-25T04:19:19.647 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-25T04:19:19.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.797+0000 7fc2f15ba640 1 Processor -- start 2023-08-25T04:19:19.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.797+0000 7fc2f15ba640 1 -- start start 2023-08-25T04:19:19.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.801+0000 7fc2f15ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc2ec15a7f0 0x7fc2ec09bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:19.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.801+0000 7fc2f15ba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ec15abd0 con 0x7fc2ec0c9830 2023-08-25T04:19:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.801+0000 7fc2f15ba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ec0c8ab0 con 0x7fc2ec06c020 2023-08-25T04:19:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.801+0000 7fc2f15ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ec0c8d50 con 0x7fc2ec15a7f0 2023-08-25T04:19:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.801+0000 7fc2e27fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc2ec0c9830 0x7fc2ec070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33490/0 (socket says 172.21.15.55:33490) 2023-08-25T04:19:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.801+0000 7fc2e27fc640 1 -- 172.21.15.55:0/1641610360 learned_addr learned my addr 172.21.15.55:0/1641610360 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.801+0000 7fc2eaffd640 1 --2- 172.21.15.55:0/1641610360 >> v2:172.21.15.110:3300/0 conn(0x7fc2ec15a7f0 0x7fc2ec09bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.801+0000 7fc2ea7fc640 1 -- 172.21.15.55:0/1641610360 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014979548 0 0) 0x7fc2ec15abd0 con 0x7fc2ec0c9830 2023-08-25T04:19:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.801+0000 7fc2ea7fc640 1 -- 172.21.15.55:0/1641610360 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2d8003530 con 0x7fc2ec0c9830 2023-08-25T04:19:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.801+0000 7fc2ea7fc640 1 -- 172.21.15.55:0/1641610360 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012374137 0 0) 0x7fc2ec0c8ab0 con 0x7fc2ec06c020 2023-08-25T04:19:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.801+0000 7fc2eaffd640 1 -- 172.21.15.55:0/1641610360 >> v1:172.21.15.110:6789/0 conn(0x7fc2ec06c020 legacy=0x7fc2ec0acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.801+0000 7fc2eaffd640 1 -- 172.21.15.55:0/1641610360 >> v1:172.21.15.55:6789/0 conn(0x7fc2ec0c9830 legacy=0x7fc2ec070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.801+0000 7fc2eaffd640 1 -- 172.21.15.55:0/1641610360 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec0c9030 con 0x7fc2ec15a7f0 2023-08-25T04:19:19.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.805+0000 7fc2eaffd640 1 --2- 172.21.15.55:0/1641610360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2ec15a7f0 0x7fc2ec09bde0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009de0 tx=0x7fc2dc01c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72613f17d3674282 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:19.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.805+0000 7fc2ea7fc640 1 -- 172.21.15.55:0/1641610360 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0a5930 con 0x7fc2ec15a7f0 2023-08-25T04:19:19.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.805+0000 7fc2ea7fc640 1 -- 172.21.15.55:0/1641610360 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc0a5a90 con 0x7fc2ec15a7f0 2023-08-25T04:19:19.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.805+0000 7fc2ea7fc640 1 -- 172.21.15.55:0/1641610360 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0a5e20 con 0x7fc2ec15a7f0 2023-08-25T04:19:19.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.805+0000 7fc2f15ba640 1 -- 172.21.15.55:0/1641610360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2ec15a7f0 msgr2=0x7fc2ec09bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:19.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.805+0000 7fc2f15ba640 1 --2- 172.21.15.55:0/1641610360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2ec15a7f0 0x7fc2ec09bde0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009de0 tx=0x7fc2dc01c960 comp rx=0 tx=0).stop 2023-08-25T04:19:19.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.805+0000 7fc2f15ba640 1 -- 172.21.15.55:0/1641610360 shutdown_connections 2023-08-25T04:19:19.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.805+0000 7fc2f15ba640 1 --2- 172.21.15.55:0/1641610360 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2ec15a7f0 0x7fc2ec09bde0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.805+0000 7fc2f15ba640 1 -- 172.21.15.55:0/1641610360 >> 172.21.15.55:0/1641610360 conn(0x7fc2ec069900 msgr2=0x7fc2ec069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.805+0000 7fc2f15ba640 1 -- 172.21.15.55:0/1641610360 shutdown_connections 2023-08-25T04:19:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.805+0000 7fc2f15ba640 1 -- 172.21.15.55:0/1641610360 wait complete. 2023-08-25T04:19:19.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.805+0000 7fc2f15ba640 1 Processor -- start 2023-08-25T04:19:19.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.805+0000 7fc2f15ba640 1 -- start start 2023-08-25T04:19:19.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2f15ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2ec06c020 0x7fc2ec144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:19.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2f15ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2ec0c9830 0x7fc2ec0cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:19.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2f15ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2ec15a7f0 0x7fc2ec164830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:19.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2f15ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec163790 con 0x7fc2ec06c020 2023-08-25T04:19:19.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2f15ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec163a70 con 0x7fc2ec0c9830 2023-08-25T04:19:19.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2f15ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec163d50 con 0x7fc2ec15a7f0 2023-08-25T04:19:19.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2eaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2ec06c020 0x7fc2ec144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:19.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2eaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2ec06c020 0x7fc2ec144800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49436/0 (socket says 172.21.15.55:49436) 2023-08-25T04:19:19.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2eaffd640 1 -- 172.21.15.55:0/886670288 learned_addr learned my addr 172.21.15.55:0/886670288 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:19.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2e27fc640 1 --2- 172.21.15.55:0/886670288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2ec0c9830 0x7fc2ec0cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:19.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2eb7fe640 1 --2- 172.21.15.55:0/886670288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2ec15a7f0 0x7fc2ec164830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:19.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2eaffd640 1 -- 172.21.15.55:0/886670288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2ec15a7f0 msgr2=0x7fc2ec164830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:19.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2eaffd640 1 --2- 172.21.15.55:0/886670288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2ec15a7f0 0x7fc2ec164830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:19.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2eaffd640 1 -- 172.21.15.55:0/886670288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2ec0c9830 msgr2=0x7fc2ec0cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:19.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2eaffd640 1 --2- 172.21.15.55:0/886670288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2ec0c9830 0x7fc2ec0cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:19.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2eaffd640 1 -- 172.21.15.55:0/886670288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc009a70 con 0x7fc2ec06c020 2023-08-25T04:19:19.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2eb7fe640 1 --2- 172.21.15.55:0/886670288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2ec15a7f0 0x7fc2ec164830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:19:19.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2eaffd640 1 --2- 172.21.15.55:0/886670288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2ec06c020 0x7fc2ec144800 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc01a590 tx=0x7fc2dc019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:19.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2e3fff640 1 -- 172.21.15.55:0/886670288 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0ade10 con 0x7fc2ec06c020 2023-08-25T04:19:19.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2e3fff640 1 -- 172.21.15.55:0/886670288 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc009450 con 0x7fc2ec06c020 2023-08-25T04:19:19.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2e3fff640 1 -- 172.21.15.55:0/886670288 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc003be0 con 0x7fc2ec06c020 2023-08-25T04:19:19.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2f15ba640 1 -- 172.21.15.55:0/886670288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ec0adc90 con 0x7fc2ec06c020 2023-08-25T04:19:19.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2f15ba640 1 -- 172.21.15.55:0/886670288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ec164310 con 0x7fc2ec06c020 2023-08-25T04:19:19.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.809+0000 7fc2f15ba640 1 -- 172.21.15.55:0/886670288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ec06d5b0 con 0x7fc2ec06c020 2023-08-25T04:19:19.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.813+0000 7fc2e3fff640 1 -- 172.21.15.55:0/886670288 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 41) v1 ==== 84817+0+0 (secure 0 0 0) 0x7fc2dc0b4050 con 0x7fc2ec06c020 2023-08-25T04:19:19.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.813+0000 7fc2e3fff640 1 --2- 172.21.15.55:0/886670288 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fc2cc065520 0x7fc2cc0679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:19.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.813+0000 7fc2e3fff640 1 -- 172.21.15.55:0/886670288 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fc2dc11d380 con 0x7fc2ec06c020 2023-08-25T04:19:19.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.813+0000 7fc2e27fc640 1 --2- 172.21.15.55:0/886670288 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fc2cc065520 0x7fc2cc0679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:19.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.813+0000 7fc2e27fc640 1 --2- 172.21.15.55:0/886670288 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fc2cc065520 0x7fc2cc0679e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0cbb00 tx=0x7fc2d4009040 comp rx=0 tx=0).ready entity=mgr.6425 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:19.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:19.817+0000 7fc2e3fff640 1 -- 172.21.15.55:0/886670288 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc2dc0eaf50 con 0x7fc2ec06c020 2023-08-25T04:19:20.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:20.013+0000 7fc2f15ba640 1 -- 172.21.15.55:0/886670288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fc2ec164500 con 0x7fc2ec06c020 2023-08-25T04:19:20.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:20.665+0000 7fc2e3fff640 1 -- 172.21.15.55:0/886670288 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 42) v1 ==== 85065+0+0 (secure 0 0 0) 0x7fc2dc006d50 con 0x7fc2ec06c020 2023-08-25T04:19:20.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:20.669+0000 7fc2e3fff640 1 -- 172.21.15.55:0/886670288 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v42) v1 ==== 93+0+0 (secure 0 0 0) 0x7fc2dc0ecd50 con 0x7fc2ec06c020 2023-08-25T04:19:20.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:20.669+0000 7fc2f15ba640 1 -- 172.21.15.55:0/886670288 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fc2cc065520 msgr2=0x7fc2cc0679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:20.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:20.669+0000 7fc2f15ba640 1 --2- 172.21.15.55:0/886670288 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fc2cc065520 0x7fc2cc0679e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0cbb00 tx=0x7fc2d4009040 comp rx=0 tx=0).stop 2023-08-25T04:19:20.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:20.669+0000 7fc2f15ba640 1 -- 172.21.15.55:0/886670288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2ec06c020 msgr2=0x7fc2ec144800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:20.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:20.669+0000 7fc2f15ba640 1 --2- 172.21.15.55:0/886670288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2ec06c020 0x7fc2ec144800 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc01a590 tx=0x7fc2dc019700 comp rx=0 tx=0).stop 2023-08-25T04:19:20.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:20.669+0000 7fc2f15ba640 1 -- 172.21.15.55:0/886670288 shutdown_connections 2023-08-25T04:19:20.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:20.669+0000 7fc2f15ba640 1 --2- 172.21.15.55:0/886670288 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fc2cc065520 0x7fc2cc0679e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:20.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:20.669+0000 7fc2f15ba640 1 --2- 172.21.15.55:0/886670288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2ec15a7f0 0x7fc2ec164830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:20.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:20.669+0000 7fc2f15ba640 1 --2- 172.21.15.55:0/886670288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2ec0c9830 0x7fc2ec0cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:20.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:20.669+0000 7fc2f15ba640 1 --2- 172.21.15.55:0/886670288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2ec06c020 0x7fc2ec144800 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:20.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:20.669+0000 7fc2f15ba640 1 -- 172.21.15.55:0/886670288 >> 172.21.15.55:0/886670288 conn(0x7fc2ec069900 msgr2=0x7fc2ec0aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:20.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:20.669+0000 7fc2f15ba640 1 -- 172.21.15.55:0/886670288 shutdown_connections 2023-08-25T04:19:20.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:20.673+0000 7fc2f15ba640 1 -- 172.21.15.55:0/886670288 wait complete. 2023-08-25T04:19:20.697 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T04:19:20.699 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:19:20.767 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:19:20.816 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T04:19:20.816 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:19:20.817 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:19:20.827 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:19:20.926 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:19:20.927 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:20.840+0000 7fd1157d4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:19:20.928 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:20.849+0000 7f151a07d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:19:20.937 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:19:21.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.121+0000 7f1b2db44640 1 Processor -- start 2023-08-25T04:19:21.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.121+0000 7f1b2db44640 1 -- start start 2023-08-25T04:19:21.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.125+0000 7f1b2db44640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b280d0da0 0x7f1b280d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:21.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.125+0000 7f1b2db44640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1b280cdde0 0x7f1b280ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:21.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.125+0000 7f1b2db44640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1b280cee60 0x7f1b280cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:21.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.125+0000 7f1b2db44640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b280ce760 con 0x7f1b280cdde0 2023-08-25T04:19:21.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.125+0000 7f1b2db44640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b280b29b0 con 0x7f1b280cee60 2023-08-25T04:19:21.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.125+0000 7f1b2db44640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b280d16c0 con 0x7f1b280d0da0 2023-08-25T04:19:21.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.125+0000 7f1b1ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1b280cdde0 0x7f1b280ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:21.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.125+0000 7f1b1ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1b280cdde0 0x7f1b280ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58606/0 (socket says 172.21.15.55:58606) 2023-08-25T04:19:21.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.125+0000 7f1b1ffff640 1 -- 172.21.15.55:0/1181314340 learned_addr learned my addr 172.21.15.55:0/1181314340 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:21.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.125+0000 7f1b277fe640 1 --2- 172.21.15.55:0/1181314340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b280d0da0 0x7f1b280d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:21.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.125+0000 7f1b27fff640 1 --2- 172.21.15.55:0/1181314340 >> v2:172.21.15.110:3300/0 conn(0x7f1b280cee60 0x7f1b280cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:21.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.125+0000 7f1b1ffff640 1 -- 172.21.15.55:0/1181314340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b280d0da0 msgr2=0x7f1b280d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:21.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.125+0000 7f1b1ffff640 1 --2- 172.21.15.55:0/1181314340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b280d0da0 0x7f1b280d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.125+0000 7f1b1ffff640 1 -- 172.21.15.55:0/1181314340 >> v2:172.21.15.110:3300/0 conn(0x7f1b280cee60 msgr2=0x7f1b280cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:21.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.125+0000 7f1b1ffff640 1 --2- 172.21.15.55:0/1181314340 >> v2:172.21.15.110:3300/0 conn(0x7f1b280cee60 0x7f1b280cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.125+0000 7f1b1ffff640 1 -- 172.21.15.55:0/1181314340 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b280b1dc0 con 0x7f1b280cdde0 2023-08-25T04:19:21.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.125+0000 7f1b27fff640 1 --2- 172.21.15.55:0/1181314340 >> v2:172.21.15.110:3300/0 conn(0x7f1b280cee60 0x7f1b280cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:21.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.129+0000 7f1b1ffff640 1 --2- 172.21.15.55:0/1181314340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280cdde0 0x7f1b280ce220 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f1b280b1bd0 tx=0x7f1b1001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130e7d7b6c66cd66 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:21.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.129+0000 7f1b26ffd640 1 -- 172.21.15.55:0/1181314340 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100a89b0 con 0x7f1b280cdde0 2023-08-25T04:19:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.129+0000 7f1b26ffd640 1 -- 172.21.15.55:0/1181314340 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b100a8b10 con 0x7f1b280cdde0 2023-08-25T04:19:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.129+0000 7f1b26ffd640 1 -- 172.21.15.55:0/1181314340 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100a8ea0 con 0x7f1b280cdde0 2023-08-25T04:19:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.129+0000 7f1b2db44640 1 -- 172.21.15.55:0/1181314340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280cdde0 msgr2=0x7f1b280ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.129+0000 7f1b2db44640 1 --2- 172.21.15.55:0/1181314340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280cdde0 0x7f1b280ce220 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f1b280b1bd0 tx=0x7f1b1001ecf0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.129+0000 7f1b2db44640 1 -- 172.21.15.55:0/1181314340 shutdown_connections 2023-08-25T04:19:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.129+0000 7f1b2db44640 1 --2- 172.21.15.55:0/1181314340 >> v2:172.21.15.110:3300/0 conn(0x7f1b280cee60 0x7f1b280cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.129+0000 7f1b2db44640 1 --2- 172.21.15.55:0/1181314340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280cdde0 0x7f1b280ce220 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.129+0000 7f1b2db44640 1 --2- 172.21.15.55:0/1181314340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b280d0da0 0x7f1b280d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.129+0000 7f1b2db44640 1 -- 172.21.15.55:0/1181314340 >> 172.21.15.55:0/1181314340 conn(0x7f1b2809bae0 msgr2=0x7f1b280d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.129+0000 7f1b2db44640 1 -- 172.21.15.55:0/1181314340 shutdown_connections 2023-08-25T04:19:21.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.129+0000 7f1b2db44640 1 -- 172.21.15.55:0/1181314340 wait complete. 2023-08-25T04:19:21.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.129+0000 7f1b2db44640 1 Processor -- start 2023-08-25T04:19:21.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.129+0000 7f1b2db44640 1 -- start start 2023-08-25T04:19:21.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b2db44640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b280cdde0 0x7f1b280cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:21.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b2db44640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280cee60 0x7f1b280c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:21.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b2db44640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b280d0da0 0x7f1b281f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:21.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b2db44640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b280cc050 con 0x7f1b280cee60 2023-08-25T04:19:21.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b2db44640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b280c7c00 con 0x7f1b280cdde0 2023-08-25T04:19:21.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b2db44640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b281f60c0 con 0x7f1b280d0da0 2023-08-25T04:19:21.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b1ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280cee60 0x7f1b280c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:21.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b277fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b280cdde0 0x7f1b280cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:21.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b27fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b280d0da0 0x7f1b281f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:21.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b1ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280cee60 0x7f1b280c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58620/0 (socket says 172.21.15.55:58620) 2023-08-25T04:19:21.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b277fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b280cdde0 0x7f1b280cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:42402/0 (socket says 172.21.15.55:42402) 2023-08-25T04:19:21.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b1ffff640 1 -- 172.21.15.55:0/4199793174 learned_addr learned my addr 172.21.15.55:0/4199793174 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:21.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b1ffff640 1 -- 172.21.15.55:0/4199793174 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b280d0da0 msgr2=0x7f1b281f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:21.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b1ffff640 1 --2- 172.21.15.55:0/4199793174 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b280d0da0 0x7f1b281f5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b1ffff640 1 -- 172.21.15.55:0/4199793174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b280cdde0 msgr2=0x7f1b280cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:21.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b1ffff640 1 --2- 172.21.15.55:0/4199793174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b280cdde0 0x7f1b280cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b1ffff640 1 -- 172.21.15.55:0/4199793174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b100094d0 con 0x7f1b280cee60 2023-08-25T04:19:21.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b27fff640 1 --2- 172.21.15.55:0/4199793174 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b280d0da0 0x7f1b281f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:21.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b277fe640 1 --2- 172.21.15.55:0/4199793174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b280cdde0 0x7f1b280cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:21.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b1ffff640 1 --2- 172.21.15.55:0/4199793174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280cee60 0x7f1b280c8090 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f1b100b3040 tx=0x7f1b1001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:21.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b24ff9640 1 -- 172.21.15.55:0/4199793174 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100b0cd0 con 0x7f1b280cee60 2023-08-25T04:19:21.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b24ff9640 1 -- 172.21.15.55:0/4199793174 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b100b0e50 con 0x7f1b280cee60 2023-08-25T04:19:21.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b2db44640 1 -- 172.21.15.55:0/4199793174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b281f63a0 con 0x7f1b280cee60 2023-08-25T04:19:21.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b24ff9640 1 -- 172.21.15.55:0/4199793174 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100bb6b0 con 0x7f1b280cee60 2023-08-25T04:19:21.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b2db44640 1 -- 172.21.15.55:0/4199793174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b280c7890 con 0x7f1b280cee60 2023-08-25T04:19:21.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.133+0000 7f1b2db44640 1 -- 172.21.15.55:0/4199793174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2804dbe0 con 0x7f1b280cee60 2023-08-25T04:19:21.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.137+0000 7f1b24ff9640 1 -- 172.21.15.55:0/4199793174 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 42) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f1b100b7070 con 0x7f1b280cee60 2023-08-25T04:19:21.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.137+0000 7f1b24ff9640 1 --2- 172.21.15.55:0/4199793174 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f1b080657a0 0x7f1b08067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:21.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.137+0000 7f1b24ff9640 1 -- 172.21.15.55:0/4199793174 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f1b10121200 con 0x7f1b280cee60 2023-08-25T04:19:21.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.137+0000 7f1b277fe640 1 -- 172.21.15.55:0/4199793174 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f1b080657a0 msgr2=0x7f1b08067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3580388085 2023-08-25T04:19:21.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.137+0000 7f1b277fe640 1 --2- 172.21.15.55:0/4199793174 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f1b080657a0 0x7f1b08067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:19:21.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.141+0000 7f1b24ff9640 1 -- 172.21.15.55:0/4199793174 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1b100eeb00 con 0x7f1b280cee60 2023-08-25T04:19:21.257 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:21.252+0000 7fd1157d4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:19:21.288 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:21.289+0000 7f151a07d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:19:21.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.301+0000 7f1b2db44640 1 -- 172.21.15.55:0/4199793174 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b280c7d40 con 0x7f1b280cee60 2023-08-25T04:19:21.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.301+0000 7f1b24ff9640 1 -- 172.21.15.55:0/4199793174 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+18872 (secure 0 0 0) 0x7f1b100f2120 con 0x7f1b280cee60 2023-08-25T04:19:21.303 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:21.303 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":94,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:19:18.606641+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:19:03.829933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-25T04:19:05.172184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3373349369":"2023-08-26T04:19:18.606592+0000","172.21.15.110:6833/2805609132":"2023-08-26T04:19:18.606592+0000","172.21.15.110:6832/2805609132":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/3316375931":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/7066739":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/2684620126":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/3401969959":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/3496245024":"2023-08-26T04:19:18.606592+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:19:21.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.305+0000 7f1b2db44640 1 -- 172.21.15.55:0/4199793174 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f1b080657a0 msgr2=0x7f1b08067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:19:21.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.305+0000 7f1b2db44640 1 --2- 172.21.15.55:0/4199793174 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f1b080657a0 0x7f1b08067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.305+0000 7f1b2db44640 1 -- 172.21.15.55:0/4199793174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280cee60 msgr2=0x7f1b280c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:21.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.305+0000 7f1b2db44640 1 --2- 172.21.15.55:0/4199793174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280cee60 0x7f1b280c8090 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f1b100b3040 tx=0x7f1b1001ba90 comp rx=0 tx=0).stop 2023-08-25T04:19:21.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.305+0000 7f1b2db44640 1 -- 172.21.15.55:0/4199793174 shutdown_connections 2023-08-25T04:19:21.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.305+0000 7f1b2db44640 1 --2- 172.21.15.55:0/4199793174 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f1b080657a0 0x7f1b08067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.305+0000 7f1b2db44640 1 --2- 172.21.15.55:0/4199793174 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b280d0da0 0x7f1b281f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.305+0000 7f1b2db44640 1 --2- 172.21.15.55:0/4199793174 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280cee60 0x7f1b280c8090 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.305+0000 7f1b2db44640 1 --2- 172.21.15.55:0/4199793174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b280cdde0 0x7f1b280cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.305+0000 7f1b2db44640 1 -- 172.21.15.55:0/4199793174 >> 172.21.15.55:0/4199793174 conn(0x7f1b2809bae0 msgr2=0x7f1b280b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:21.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.305+0000 7f1b2db44640 1 -- 172.21.15.55:0/4199793174 shutdown_connections 2023-08-25T04:19:21.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.305+0000 7f1b2db44640 1 -- 172.21.15.55:0/4199793174 wait complete. 2023-08-25T04:19:21.327 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:19:03.829933+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:19:05.172184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:19:21.328 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:19:21.405 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:21.400+0000 7fd1157d4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:19:21.450 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:21.449+0000 7f151a07d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:19:21.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.477+0000 7f7652f3a640 1 Processor -- start 2023-08-25T04:19:21.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.477+0000 7f7652f3a640 1 -- start start 2023-08-25T04:19:21.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.481+0000 7f7652f3a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f764c06ce30 0x7f764c0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:21.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.481+0000 7f7652f3a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764c0c9d90 con 0x7f764c0c9900 2023-08-25T04:19:21.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.481+0000 7f7652f3a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764c0cbca0 con 0x7f764c0cb020 2023-08-25T04:19:21.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.481+0000 7f7652f3a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c0c9470 con 0x7f764c06ce30 2023-08-25T04:19:21.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.481+0000 7f7643fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f764c0c9900 0x7f764c06c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54160/0 (socket says 172.21.15.55:54160) 2023-08-25T04:19:21.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.481+0000 7f7643fff640 1 -- 172.21.15.55:0/4017118439 learned_addr learned my addr 172.21.15.55:0/4017118439 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:21.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.481+0000 7f76514d7640 1 --2- 172.21.15.55:0/4017118439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f764c06ce30 0x7f764c0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:21.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.481+0000 7f76437fe640 1 -- 172.21.15.55:0/4017118439 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631748260 0 0) 0x7f764c0c9d90 con 0x7f764c0c9900 2023-08-25T04:19:21.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.481+0000 7f76437fe640 1 -- 172.21.15.55:0/4017118439 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7634005740 con 0x7f764c0c9900 2023-08-25T04:19:21.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.481+0000 7f76437fe640 1 -- 172.21.15.55:0/4017118439 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982009888 0 0) 0x7f764c0cbca0 con 0x7f764c0cb020 2023-08-25T04:19:21.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.481+0000 7f76437fe640 1 -- 172.21.15.55:0/4017118439 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f764c0c9d90 con 0x7f764c0cb020 2023-08-25T04:19:21.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.481+0000 7f76514d7640 1 -- 172.21.15.55:0/4017118439 >> v1:172.21.15.110:6789/0 conn(0x7f764c0cb020 legacy=0x7f764c0cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:21.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.481+0000 7f76514d7640 1 -- 172.21.15.55:0/4017118439 >> v1:172.21.15.55:6789/0 conn(0x7f764c0c9900 legacy=0x7f764c06c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:21.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.481+0000 7f76514d7640 1 -- 172.21.15.55:0/4017118439 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c0c8b40 con 0x7f764c06ce30 2023-08-25T04:19:21.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.481+0000 7f76514d7640 1 --2- 172.21.15.55:0/4017118439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f764c06ce30 0x7f764c0cdd50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7644009dc0 tx=0x7f764401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bff1f26ccb00ac96 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:21.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.485+0000 7f76437fe640 1 -- 172.21.15.55:0/4017118439 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76440a57a0 con 0x7f764c06ce30 2023-08-25T04:19:21.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.485+0000 7f76437fe640 1 -- 172.21.15.55:0/4017118439 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76440a5900 con 0x7f764c06ce30 2023-08-25T04:19:21.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.485+0000 7f76437fe640 1 -- 172.21.15.55:0/4017118439 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76440a5c90 con 0x7f764c06ce30 2023-08-25T04:19:21.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.485+0000 7f7652f3a640 1 -- 172.21.15.55:0/4017118439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f764c06ce30 msgr2=0x7f764c0cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:21.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.485+0000 7f7652f3a640 1 --2- 172.21.15.55:0/4017118439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f764c06ce30 0x7f764c0cdd50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7644009dc0 tx=0x7f764401c8e0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.485+0000 7f7652f3a640 1 -- 172.21.15.55:0/4017118439 shutdown_connections 2023-08-25T04:19:21.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.485+0000 7f7652f3a640 1 --2- 172.21.15.55:0/4017118439 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f764c06ce30 0x7f764c0cdd50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.485+0000 7f7652f3a640 1 -- 172.21.15.55:0/4017118439 >> 172.21.15.55:0/4017118439 conn(0x7f764c069900 msgr2=0x7f764c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:21.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.485+0000 7f7652f3a640 1 -- 172.21.15.55:0/4017118439 shutdown_connections 2023-08-25T04:19:21.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.485+0000 7f7652f3a640 1 -- 172.21.15.55:0/4017118439 wait complete. 2023-08-25T04:19:21.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.485+0000 7f7652f3a640 1 Processor -- start 2023-08-25T04:19:21.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.485+0000 7f7652f3a640 1 -- start start 2023-08-25T04:19:21.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.485+0000 7f7652f3a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f764c06ce30 0x7f764c0c2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:21.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.485+0000 7f7652f3a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f764c0c9900 0x7f764c0c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:21.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.485+0000 7f7652f3a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f764c0cb020 0x7f764c099410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:21.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.485+0000 7f7652f3a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c161790 con 0x7f764c06ce30 2023-08-25T04:19:21.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.485+0000 7f7652f3a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c161a70 con 0x7f764c0c9900 2023-08-25T04:19:21.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.485+0000 7f7652f3a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c161d50 con 0x7f764c0cb020 2023-08-25T04:19:21.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.489+0000 7f7650cd6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f764c06ce30 0x7f764c0c2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:21.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.489+0000 7f7650cd6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f764c06ce30 0x7f764c0c2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58626/0 (socket says 172.21.15.55:58626) 2023-08-25T04:19:21.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.489+0000 7f7650cd6640 1 -- 172.21.15.55:0/277858544 learned_addr learned my addr 172.21.15.55:0/277858544 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:21.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.489+0000 7f7643fff640 1 --2- 172.21.15.55:0/277858544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f764c0c9900 0x7f764c0c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:21.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.489+0000 7f76514d7640 1 --2- 172.21.15.55:0/277858544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f764c0cb020 0x7f764c099410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:21.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.489+0000 7f7650cd6640 1 -- 172.21.15.55:0/277858544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f764c0cb020 msgr2=0x7f764c099410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:21.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.489+0000 7f7650cd6640 1 --2- 172.21.15.55:0/277858544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f764c0cb020 0x7f764c099410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.489+0000 7f7650cd6640 1 -- 172.21.15.55:0/277858544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f764c0c9900 msgr2=0x7f764c0c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:21.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.489+0000 7f7650cd6640 1 --2- 172.21.15.55:0/277858544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f764c0c9900 0x7f764c0c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.489+0000 7f7650cd6640 1 -- 172.21.15.55:0/277858544 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7644009a70 con 0x7f764c06ce30 2023-08-25T04:19:21.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.489+0000 7f7650cd6640 1 --2- 172.21.15.55:0/277858544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f764c06ce30 0x7f764c0c2ae0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f764800c4d0 tx=0x7f764800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:21.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.489+0000 7f76417fa640 1 -- 172.21.15.55:0/277858544 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76480052d0 con 0x7f764c06ce30 2023-08-25T04:19:21.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.489+0000 7f76417fa640 1 -- 172.21.15.55:0/277858544 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7648005430 con 0x7f764c06ce30 2023-08-25T04:19:21.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.489+0000 7f7652f3a640 1 -- 172.21.15.55:0/277858544 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764c162030 con 0x7f764c06ce30 2023-08-25T04:19:21.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.489+0000 7f76417fa640 1 -- 172.21.15.55:0/277858544 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648003850 con 0x7f764c06ce30 2023-08-25T04:19:21.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.489+0000 7f7652f3a640 1 -- 172.21.15.55:0/277858544 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764c099df0 con 0x7f764c06ce30 2023-08-25T04:19:21.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.489+0000 7f7652f3a640 1 -- 172.21.15.55:0/277858544 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764c073ec0 con 0x7f764c06ce30 2023-08-25T04:19:21.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.493+0000 7f76417fa640 1 -- 172.21.15.55:0/277858544 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 42) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f76480039b0 con 0x7f764c06ce30 2023-08-25T04:19:21.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.493+0000 7f76417fa640 1 --2- 172.21.15.55:0/277858544 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f76380657a0 0x7f7638067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:21.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.493+0000 7f76417fa640 1 -- 172.21.15.55:0/277858544 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f7648082c00 con 0x7f764c06ce30 2023-08-25T04:19:21.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.493+0000 7f7643fff640 1 -- 172.21.15.55:0/277858544 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f76380657a0 msgr2=0x7f7638067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3580388085 2023-08-25T04:19:21.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.493+0000 7f7643fff640 1 --2- 172.21.15.55:0/277858544 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f76380657a0 0x7f7638067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:19:21.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.497+0000 7f76417fa640 1 -- 172.21.15.55:0/277858544 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7648089080 con 0x7f764c06ce30 2023-08-25T04:19:21.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.657+0000 7f7652f3a640 1 -- 172.21.15.55:0/277858544 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f764c0cc230 con 0x7f764c06ce30 2023-08-25T04:19:21.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.657+0000 7f76417fa640 1 -- 172.21.15.55:0/277858544 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7648050500 con 0x7f764c06ce30 2023-08-25T04:19:21.657 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:19:21.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.657+0000 7f7652f3a640 1 -- 172.21.15.55:0/277858544 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f76380657a0 msgr2=0x7f7638067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:19:21.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.657+0000 7f7652f3a640 1 --2- 172.21.15.55:0/277858544 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f76380657a0 0x7f7638067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.657+0000 7f7652f3a640 1 -- 172.21.15.55:0/277858544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f764c06ce30 msgr2=0x7f764c0c2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:21.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.657+0000 7f7652f3a640 1 --2- 172.21.15.55:0/277858544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f764c06ce30 0x7f764c0c2ae0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f764800c4d0 tx=0x7f764800c990 comp rx=0 tx=0).stop 2023-08-25T04:19:21.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.657+0000 7f7652f3a640 1 -- 172.21.15.55:0/277858544 shutdown_connections 2023-08-25T04:19:21.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.657+0000 7f7652f3a640 1 --2- 172.21.15.55:0/277858544 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f76380657a0 0x7f7638067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.657+0000 7f7652f3a640 1 --2- 172.21.15.55:0/277858544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f764c0cb020 0x7f764c099410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.657+0000 7f7652f3a640 1 --2- 172.21.15.55:0/277858544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f764c0c9900 0x7f764c0c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.657+0000 7f7652f3a640 1 --2- 172.21.15.55:0/277858544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f764c06ce30 0x7f764c0c2ae0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.657+0000 7f7652f3a640 1 -- 172.21.15.55:0/277858544 >> 172.21.15.55:0/277858544 conn(0x7f764c069900 msgr2=0x7f764c164f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:21.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.661+0000 7f7652f3a640 1 -- 172.21.15.55:0/277858544 shutdown_connections 2023-08-25T04:19:21.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.661+0000 7f7652f3a640 1 -- 172.21.15.55:0/277858544 wait complete. 2023-08-25T04:19:21.680 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:19:21.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.829+0000 7f8cf0834640 1 Processor -- start 2023-08-25T04:19:21.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.829+0000 7f8cf0834640 1 -- start start 2023-08-25T04:19:21.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.829+0000 7f8cf0834640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cec15e3c0 0x7f8cec15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:21.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.829+0000 7f8cf0834640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cec0cd5a0 con 0x7f8cec1601f0 2023-08-25T04:19:21.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.829+0000 7f8cf0834640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cec0cd880 con 0x7f8cec0d1290 2023-08-25T04:19:21.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.829+0000 7f8cf0834640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec0cdb60 con 0x7f8cec15e3c0 2023-08-25T04:19:21.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.833+0000 7f8cea59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8cec1601f0 0x7f8cec0d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54172/0 (socket says 172.21.15.55:54172) 2023-08-25T04:19:21.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.833+0000 7f8cea59c640 1 -- 172.21.15.55:0/3253196689 learned_addr learned my addr 172.21.15.55:0/3253196689 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:21.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.833+0000 7f8ce3fff640 1 --2- 172.21.15.55:0/3253196689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cec15e3c0 0x7f8cec15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:21.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.833+0000 7f8ce9d9b640 1 -- 172.21.15.55:0/3253196689 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525112249 0 0) 0x7f8cec0cd5a0 con 0x7f8cec1601f0 2023-08-25T04:19:21.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.833+0000 7f8ce9d9b640 1 -- 172.21.15.55:0/3253196689 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cd8003530 con 0x7f8cec1601f0 2023-08-25T04:19:21.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.833+0000 7f8ce9d9b640 1 -- 172.21.15.55:0/3253196689 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438841243 0 0) 0x7f8cec0cd880 con 0x7f8cec0d1290 2023-08-25T04:19:21.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.833+0000 7f8ce9d9b640 1 -- 172.21.15.55:0/3253196689 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cec0cd5a0 con 0x7f8cec0d1290 2023-08-25T04:19:21.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.833+0000 7f8ce3fff640 1 -- 172.21.15.55:0/3253196689 >> v1:172.21.15.110:6789/0 conn(0x7f8cec0d1290 legacy=0x7f8cec15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:21.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.833+0000 7f8ce3fff640 1 -- 172.21.15.55:0/3253196689 >> v1:172.21.15.55:6789/0 conn(0x7f8cec1601f0 legacy=0x7f8cec0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:21.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.833+0000 7f8ce3fff640 1 -- 172.21.15.55:0/3253196689 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec0cde40 con 0x7f8cec15e3c0 2023-08-25T04:19:21.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.833+0000 7f8ce3fff640 1 --2- 172.21.15.55:0/3253196689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cec15e3c0 0x7f8cec15d430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40097f0 tx=0x7f8cd401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aafdf745630eadb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.833+0000 7f8ce9d9b640 1 -- 172.21.15.55:0/3253196689 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40a89b0 con 0x7f8cec15e3c0 2023-08-25T04:19:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.837+0000 7f8ce9d9b640 1 -- 172.21.15.55:0/3253196689 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd40a8b10 con 0x7f8cec15e3c0 2023-08-25T04:19:21.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.837+0000 7f8ce9d9b640 1 -- 172.21.15.55:0/3253196689 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40a8e80 con 0x7f8cec15e3c0 2023-08-25T04:19:21.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.837+0000 7f8cf0834640 1 -- 172.21.15.55:0/3253196689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cec15e3c0 msgr2=0x7f8cec15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:21.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.837+0000 7f8cf0834640 1 --2- 172.21.15.55:0/3253196689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cec15e3c0 0x7f8cec15d430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40097f0 tx=0x7f8cd401ecb0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.837+0000 7f8cf0834640 1 -- 172.21.15.55:0/3253196689 shutdown_connections 2023-08-25T04:19:21.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.837+0000 7f8cf0834640 1 --2- 172.21.15.55:0/3253196689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cec15e3c0 0x7f8cec15d430 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.837+0000 7f8cf0834640 1 -- 172.21.15.55:0/3253196689 >> 172.21.15.55:0/3253196689 conn(0x7f8cec0d27d0 msgr2=0x7f8cec0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:21.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.837+0000 7f8cf0834640 1 -- 172.21.15.55:0/3253196689 shutdown_connections 2023-08-25T04:19:21.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.837+0000 7f8cf0834640 1 -- 172.21.15.55:0/3253196689 wait complete. 2023-08-25T04:19:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.837+0000 7f8cf0834640 1 Processor -- start 2023-08-25T04:19:21.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.837+0000 7f8cf0834640 1 -- start start 2023-08-25T04:19:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.837+0000 7f8cf0834640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cec0d1290 0x7f8cec0c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.837+0000 7f8cf0834640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cec15e3c0 0x7f8cec0c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.837+0000 7f8cf0834640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cec1601f0 0x7f8cec06be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.837+0000 7f8cf0834640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec0c81d0 con 0x7f8cec1601f0 2023-08-25T04:19:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.837+0000 7f8cf0834640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec0c6c70 con 0x7f8cec15e3c0 2023-08-25T04:19:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.837+0000 7f8cf0834640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec0c6ed0 con 0x7f8cec0d1290 2023-08-25T04:19:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.841+0000 7f8cead9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cec1601f0 0x7f8cec06be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.841+0000 7f8cea59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cec0d1290 0x7f8cec0c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.841+0000 7f8cead9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cec1601f0 0x7f8cec06be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58630/0 (socket says 172.21.15.55:58630) 2023-08-25T04:19:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.841+0000 7f8cead9d640 1 -- 172.21.15.55:0/142642423 learned_addr learned my addr 172.21.15.55:0/142642423 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.841+0000 7f8ce3fff640 1 --2- 172.21.15.55:0/142642423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cec15e3c0 0x7f8cec0c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.841+0000 7f8cead9d640 1 -- 172.21.15.55:0/142642423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cec0d1290 msgr2=0x7f8cec0c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.841+0000 7f8cead9d640 1 --2- 172.21.15.55:0/142642423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cec0d1290 0x7f8cec0c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.841+0000 7f8cead9d640 1 -- 172.21.15.55:0/142642423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cec15e3c0 msgr2=0x7f8cec0c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:21.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.841+0000 7f8cead9d640 1 --2- 172.21.15.55:0/142642423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cec15e3c0 0x7f8cec0c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:21.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.841+0000 7f8cead9d640 1 -- 172.21.15.55:0/142642423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd4009420 con 0x7f8cec1601f0 2023-08-25T04:19:21.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.841+0000 7f8cead9d640 1 --2- 172.21.15.55:0/142642423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cec1601f0 0x7f8cec06be10 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400c790 tx=0x7f8ce400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:21.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.841+0000 7f8ce2ffd640 1 -- 172.21.15.55:0/142642423 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce400cea0 con 0x7f8cec1601f0 2023-08-25T04:19:21.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.841+0000 7f8ce2ffd640 1 -- 172.21.15.55:0/142642423 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce4003b80 con 0x7f8cec1601f0 2023-08-25T04:19:21.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.841+0000 7f8cf0834640 1 -- 172.21.15.55:0/142642423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cec0ce7c0 con 0x7f8cec1601f0 2023-08-25T04:19:21.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.841+0000 7f8ce2ffd640 1 -- 172.21.15.55:0/142642423 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce400a850 con 0x7f8cec1601f0 2023-08-25T04:19:21.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.841+0000 7f8cf0834640 1 -- 172.21.15.55:0/142642423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cec0c7490 con 0x7f8cec1601f0 2023-08-25T04:19:21.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.841+0000 7f8cf0834640 1 -- 172.21.15.55:0/142642423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cec0b5260 con 0x7f8cec1601f0 2023-08-25T04:19:21.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.841+0000 7f8ce2ffd640 1 -- 172.21.15.55:0/142642423 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 42) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f8ce400a9b0 con 0x7f8cec1601f0 2023-08-25T04:19:21.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.845+0000 7f8ce2ffd640 1 --2- 172.21.15.55:0/142642423 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f8ccc0657a0 0x7f8ccc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:21.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.845+0000 7f8ce2ffd640 1 -- 172.21.15.55:0/142642423 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f8ce4082f00 con 0x7f8cec1601f0 2023-08-25T04:19:21.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.845+0000 7f8cea59c640 1 -- 172.21.15.55:0/142642423 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f8ccc0657a0 msgr2=0x7f8ccc067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3580388085 2023-08-25T04:19:21.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.845+0000 7f8cea59c640 1 --2- 172.21.15.55:0/142642423 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f8ccc0657a0 0x7f8ccc067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:19:21.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:21.849+0000 7f8ce2ffd640 1 -- 172.21.15.55:0/142642423 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8ce4050760 con 0x7f8cec1601f0 2023-08-25T04:19:21.886 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:21.884+0000 7fd1157d4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:19:21.944 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:21.940+0000 7fd1157d4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:19:21.971 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:21.969+0000 7f151a07d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:19:21.999 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:21.996+0000 7fd1157d4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:19:22.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.005+0000 7f8cf0834640 1 -- 172.21.15.55:0/142642423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8cec073ec0 con 0x7f8cec1601f0 2023-08-25T04:19:22.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.005+0000 7f8ce2ffd640 1 -- 172.21.15.55:0/142642423 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v94) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8ce4053d80 con 0x7f8cec1601f0 2023-08-25T04:19:22.006 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:19:22.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.009+0000 7f8cf0834640 1 -- 172.21.15.55:0/142642423 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f8ccc0657a0 msgr2=0x7f8ccc067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:19:22.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.009+0000 7f8cf0834640 1 --2- 172.21.15.55:0/142642423 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f8ccc0657a0 0x7f8ccc067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.009+0000 7f8cf0834640 1 -- 172.21.15.55:0/142642423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cec1601f0 msgr2=0x7f8cec06be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:22.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.009+0000 7f8cf0834640 1 --2- 172.21.15.55:0/142642423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cec1601f0 0x7f8cec06be10 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400c790 tx=0x7f8ce400cc50 comp rx=0 tx=0).stop 2023-08-25T04:19:22.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.009+0000 7f8cf0834640 1 -- 172.21.15.55:0/142642423 shutdown_connections 2023-08-25T04:19:22.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.009+0000 7f8cf0834640 1 --2- 172.21.15.55:0/142642423 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f8ccc0657a0 0x7f8ccc067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.009+0000 7f8cf0834640 1 --2- 172.21.15.55:0/142642423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8cec1601f0 0x7f8cec06be10 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.009+0000 7f8cf0834640 1 --2- 172.21.15.55:0/142642423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8cec15e3c0 0x7f8cec0c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.009+0000 7f8cf0834640 1 --2- 172.21.15.55:0/142642423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8cec0d1290 0x7f8cec0c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.009+0000 7f8cf0834640 1 -- 172.21.15.55:0/142642423 >> 172.21.15.55:0/142642423 conn(0x7f8cec0d27d0 msgr2=0x7f8cec0b78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:22.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.009+0000 7f8cf0834640 1 -- 172.21.15.55:0/142642423 shutdown_connections 2023-08-25T04:19:22.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.009+0000 7f8cf0834640 1 -- 172.21.15.55:0/142642423 wait complete. 2023-08-25T04:19:22.029 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:19:22.035 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:22.033+0000 7f151a07d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:19:22.084 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:22.080+0000 7fd1157d4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:19:22.095 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:22.093+0000 7f151a07d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:19:22.142 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:22.140+0000 7fd1157d4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:19:22.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.177+0000 7f3715a9c640 1 Processor -- start 2023-08-25T04:19:22.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.177+0000 7f3715a9c640 1 -- start start 2023-08-25T04:19:22.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.181+0000 7f3715a9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f371015d430 0x7f37101679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:22.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.181+0000 7f3715a9c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371015f8b0 con 0x7f37101601f0 2023-08-25T04:19:22.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.181+0000 7f3715a9c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37100cd5a0 con 0x7f371015e3c0 2023-08-25T04:19:22.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.181+0000 7f3715a9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37100cd880 con 0x7f371015d430 2023-08-25T04:19:22.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.181+0000 7f370f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f37101601f0 0x7f37100d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54184/0 (socket says 172.21.15.55:54184) 2023-08-25T04:19:22.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.181+0000 7f370f7fe640 1 -- 172.21.15.55:0/1850691813 learned_addr learned my addr 172.21.15.55:0/1850691813 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:22.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.181+0000 7f370ffff640 1 --2- 172.21.15.55:0/1850691813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f371015d430 0x7f37101679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:22.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.181+0000 7f370e7fc640 1 -- 172.21.15.55:0/1850691813 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001875696 0 0) 0x7f371015f8b0 con 0x7f37101601f0 2023-08-25T04:19:22.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.181+0000 7f370e7fc640 1 -- 172.21.15.55:0/1850691813 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36f8003530 con 0x7f37101601f0 2023-08-25T04:19:22.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.181+0000 7f370e7fc640 1 -- 172.21.15.55:0/1850691813 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245285830 0 0) 0x7f37100cd5a0 con 0x7f371015e3c0 2023-08-25T04:19:22.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.181+0000 7f370e7fc640 1 -- 172.21.15.55:0/1850691813 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f371015f8b0 con 0x7f371015e3c0 2023-08-25T04:19:22.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.181+0000 7f370ffff640 1 -- 172.21.15.55:0/1850691813 >> v1:172.21.15.110:6789/0 conn(0x7f371015e3c0 legacy=0x7f37100d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:22.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.181+0000 7f370ffff640 1 -- 172.21.15.55:0/1850691813 >> v1:172.21.15.55:6789/0 conn(0x7f37101601f0 legacy=0x7f37100d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:22.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.181+0000 7f370e7fc640 1 -- 172.21.15.55:0/1850691813 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3232124674 0 0) 0x7f36f8003530 con 0x7f37101601f0 2023-08-25T04:19:22.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.181+0000 7f370ffff640 1 -- 172.21.15.55:0/1850691813 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37100cdb60 con 0x7f371015d430 2023-08-25T04:19:22.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.185+0000 7f370ffff640 1 --2- 172.21.15.55:0/1850691813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f371015d430 0x7f37101679e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3708009df0 tx=0x7f370801f080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f116085a76a88317 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:22.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.185+0000 7f370e7fc640 1 -- 172.21.15.55:0/1850691813 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3700001800 con 0x7f371015d430 2023-08-25T04:19:22.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.185+0000 7f370e7fc640 1 -- 172.21.15.55:0/1850691813 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37080a8c50 con 0x7f371015d430 2023-08-25T04:19:22.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.185+0000 7f370e7fc640 1 -- 172.21.15.55:0/1850691813 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37080b0440 con 0x7f371015d430 2023-08-25T04:19:22.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.185+0000 7f3715a9c640 1 -- 172.21.15.55:0/1850691813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f371015d430 msgr2=0x7f37101679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:22.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.185+0000 7f3715a9c640 1 --2- 172.21.15.55:0/1850691813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f371015d430 0x7f37101679e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3708009df0 tx=0x7f370801f080 comp rx=0 tx=0).stop 2023-08-25T04:19:22.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f3715a9c640 1 -- 172.21.15.55:0/1850691813 shutdown_connections 2023-08-25T04:19:22.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f3715a9c640 1 --2- 172.21.15.55:0/1850691813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f371015d430 0x7f37101679e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f3715a9c640 1 -- 172.21.15.55:0/1850691813 >> 172.21.15.55:0/1850691813 conn(0x7f37100d27d0 msgr2=0x7f37100d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:22.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f3715a9c640 1 -- 172.21.15.55:0/1850691813 shutdown_connections 2023-08-25T04:19:22.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f3715a9c640 1 -- 172.21.15.55:0/1850691813 wait complete. 2023-08-25T04:19:22.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f3715a9c640 1 Processor -- start 2023-08-25T04:19:22.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f3715a9c640 1 -- start start 2023-08-25T04:19:22.190 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f151a07d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:19:22.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f3715a9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f371015d430 0x7f3710151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:22.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f3715a9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f371015e3c0 0x7f37100c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:22.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f3715a9c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37101601f0 0x7f37100ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:22.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f3715a9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37100cb6b0 con 0x7f371015e3c0 2023-08-25T04:19:22.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f3715a9c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37100ca760 con 0x7f37101601f0 2023-08-25T04:19:22.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f3715a9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37100caa30 con 0x7f371015d430 2023-08-25T04:19:22.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f370effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f371015e3c0 0x7f37100c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:22.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f370effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f371015e3c0 0x7f37100c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58634/0 (socket says 172.21.15.55:58634) 2023-08-25T04:19:22.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f370effd640 1 -- 172.21.15.55:0/2339730604 learned_addr learned my addr 172.21.15.55:0/2339730604 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:22.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f370f7fe640 1 --2- 172.21.15.55:0/2339730604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f371015d430 0x7f3710151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:22.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f370ffff640 1 --2- 172.21.15.55:0/2339730604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37101601f0 0x7f37100ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:22.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f370effd640 1 -- 172.21.15.55:0/2339730604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f371015d430 msgr2=0x7f3710151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:22.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f370effd640 1 --2- 172.21.15.55:0/2339730604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f371015d430 0x7f3710151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f370effd640 1 -- 172.21.15.55:0/2339730604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37101601f0 msgr2=0x7f37100ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:22.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f370effd640 1 --2- 172.21.15.55:0/2339730604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37101601f0 0x7f37100ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.189+0000 7f370effd640 1 -- 172.21.15.55:0/2339730604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3708009a70 con 0x7f371015e3c0 2023-08-25T04:19:22.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.193+0000 7f370effd640 1 --2- 172.21.15.55:0/2339730604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f371015e3c0 0x7f37100c9ce0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f370400c490 tx=0x7f370400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:22.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.193+0000 7f36f7fff640 1 -- 172.21.15.55:0/2339730604 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37040052d0 con 0x7f371015e3c0 2023-08-25T04:19:22.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.193+0000 7f36f7fff640 1 -- 172.21.15.55:0/2339730604 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3704005430 con 0x7f371015e3c0 2023-08-25T04:19:22.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.193+0000 7f3715a9c640 1 -- 172.21.15.55:0/2339730604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37100cad10 con 0x7f371015e3c0 2023-08-25T04:19:22.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.193+0000 7f36f7fff640 1 -- 172.21.15.55:0/2339730604 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704012870 con 0x7f371015e3c0 2023-08-25T04:19:22.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.193+0000 7f3715a9c640 1 -- 172.21.15.55:0/2339730604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37100cb2d0 con 0x7f371015e3c0 2023-08-25T04:19:22.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.193+0000 7f3715a9c640 1 -- 172.21.15.55:0/2339730604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3710073ec0 con 0x7f371015e3c0 2023-08-25T04:19:22.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.193+0000 7f36f7fff640 1 -- 172.21.15.55:0/2339730604 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 42) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f37040129d0 con 0x7f371015e3c0 2023-08-25T04:19:22.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.193+0000 7f36f7fff640 1 --2- 172.21.15.55:0/2339730604 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f36fc0657a0 0x7f36fc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:22.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.193+0000 7f36f7fff640 1 -- 172.21.15.55:0/2339730604 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f3704082ab0 con 0x7f371015e3c0 2023-08-25T04:19:22.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.193+0000 7f370f7fe640 1 -- 172.21.15.55:0/2339730604 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f36fc0657a0 msgr2=0x7f36fc067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3580388085 2023-08-25T04:19:22.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.193+0000 7f370f7fe640 1 --2- 172.21.15.55:0/2339730604 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f36fc0657a0 0x7f36fc067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:19:22.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.197+0000 7f36f7fff640 1 -- 172.21.15.55:0/2339730604 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3704053ed0 con 0x7f371015e3c0 2023-08-25T04:19:22.225 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:22.224+0000 7fd1157d4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:19:22.251 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:22.249+0000 7f151a07d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:19:22.281 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:22.280+0000 7fd1157d4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:19:22.340 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:22.341+0000 7f151a07d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:19:22.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.353+0000 7f3715a9c640 1 -- 172.21.15.55:0/2339730604 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37100cefc0 con 0x7f371015e3c0 2023-08-25T04:19:22.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.353+0000 7f36f7fff640 1 -- 172.21.15.55:0/2339730604 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3704053a60 con 0x7f371015e3c0 2023-08-25T04:19:22.355 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:19:22.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.357+0000 7f3715a9c640 1 -- 172.21.15.55:0/2339730604 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f36fc0657a0 msgr2=0x7f36fc067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:19:22.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.357+0000 7f3715a9c640 1 --2- 172.21.15.55:0/2339730604 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f36fc0657a0 0x7f36fc067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.357+0000 7f3715a9c640 1 -- 172.21.15.55:0/2339730604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f371015e3c0 msgr2=0x7f37100c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:22.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.357+0000 7f3715a9c640 1 --2- 172.21.15.55:0/2339730604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f371015e3c0 0x7f37100c9ce0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f370400c490 tx=0x7f370400c950 comp rx=0 tx=0).stop 2023-08-25T04:19:22.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.357+0000 7f3715a9c640 1 -- 172.21.15.55:0/2339730604 shutdown_connections 2023-08-25T04:19:22.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.357+0000 7f3715a9c640 1 --2- 172.21.15.55:0/2339730604 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f36fc0657a0 0x7f36fc067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.357+0000 7f3715a9c640 1 --2- 172.21.15.55:0/2339730604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37101601f0 0x7f37100ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.357+0000 7f3715a9c640 1 --2- 172.21.15.55:0/2339730604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f371015e3c0 0x7f37100c9ce0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.357+0000 7f3715a9c640 1 --2- 172.21.15.55:0/2339730604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f371015d430 0x7f3710151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.357+0000 7f3715a9c640 1 -- 172.21.15.55:0/2339730604 >> 172.21.15.55:0/2339730604 conn(0x7f37100d27d0 msgr2=0x7f371015cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:22.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.357+0000 7f3715a9c640 1 -- 172.21.15.55:0/2339730604 shutdown_connections 2023-08-25T04:19:22.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.357+0000 7f3715a9c640 1 -- 172.21.15.55:0/2339730604 wait complete. 2023-08-25T04:19:22.377 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:19:22.400 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:22.401+0000 7f151a07d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:19:22.422 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:22.420+0000 7fd1157d4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:19:22.479 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:22.476+0000 7fd1157d4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:19:22.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.545+0000 7f5e6723c640 1 Processor -- start 2023-08-25T04:19:22.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.545+0000 7f5e6723c640 1 -- start start 2023-08-25T04:19:22.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.549+0000 7f5e6723c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e600cd190 0x7f5e600d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:22.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.549+0000 7f5e6723c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5e600d10a0 0x7f5e600b1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:22.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.549+0000 7f5e6723c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e600d0690 con 0x7f5e6015c8a0 2023-08-25T04:19:22.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.549+0000 7f5e6723c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e600d1530 con 0x7f5e600d10a0 2023-08-25T04:19:22.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.549+0000 7f5e6723c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e600cd6c0 con 0x7f5e600cd190 2023-08-25T04:19:22.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.549+0000 7f5e66a3b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5e600d10a0 0x7f5e600b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:22.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.549+0000 7f5e66a3b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5e600d10a0 0x7f5e600b1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58650/0 (socket says 172.21.15.55:58650) 2023-08-25T04:19:22.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.549+0000 7f5e66a3b640 1 -- 172.21.15.55:0/1805425789 learned_addr learned my addr 172.21.15.55:0/1805425789 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:22.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.549+0000 7f5e65a39640 1 --2- 172.21.15.55:0/1805425789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e600cd190 0x7f5e600d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:22.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.549+0000 7f5e66a3b640 1 -- 172.21.15.55:0/1805425789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e600cd190 msgr2=0x7f5e600d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:22.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.549+0000 7f5e66a3b640 1 --2- 172.21.15.55:0/1805425789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e600cd190 0x7f5e600d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.549+0000 7f5e66a3b640 1 -- 172.21.15.55:0/1805425789 >> v1:172.21.15.110:6789/0 conn(0x7f5e6015c8a0 legacy=0x7f5e600b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.549+0000 7f5e66a3b640 1 -- 172.21.15.55:0/1805425789 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e600cd9a0 con 0x7f5e600d10a0 2023-08-25T04:19:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e66a3b640 1 --2- 172.21.15.55:0/1805425789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e600d10a0 0x7f5e600b1160 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009e50 tx=0x7f5e5801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450c2c26301d8268 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e65238640 1 -- 172.21.15.55:0/1805425789 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580a5860 con 0x7f5e600d10a0 2023-08-25T04:19:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e65238640 1 -- 172.21.15.55:0/1805425789 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e580a59c0 con 0x7f5e600d10a0 2023-08-25T04:19:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e65238640 1 -- 172.21.15.55:0/1805425789 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580a5d50 con 0x7f5e600d10a0 2023-08-25T04:19:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e6723c640 1 -- 172.21.15.55:0/1805425789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e600d10a0 msgr2=0x7f5e600b1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:22.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e6723c640 1 --2- 172.21.15.55:0/1805425789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e600d10a0 0x7f5e600b1160 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009e50 tx=0x7f5e5801c9e0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e6723c640 1 -- 172.21.15.55:0/1805425789 shutdown_connections 2023-08-25T04:19:22.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e6723c640 1 --2- 172.21.15.55:0/1805425789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e600d10a0 0x7f5e600b1160 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e6723c640 1 --2- 172.21.15.55:0/1805425789 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e600cd190 0x7f5e600d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e6723c640 1 -- 172.21.15.55:0/1805425789 >> 172.21.15.55:0/1805425789 conn(0x7f5e600d2610 msgr2=0x7f5e600d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e6723c640 1 -- 172.21.15.55:0/1805425789 shutdown_connections 2023-08-25T04:19:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e6723c640 1 -- 172.21.15.55:0/1805425789 wait complete. 2023-08-25T04:19:22.560 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f151a07d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:19:22.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e6723c640 1 Processor -- start 2023-08-25T04:19:22.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e6723c640 1 -- start start 2023-08-25T04:19:22.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e6723c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e600cd190 0x7f5e600b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:22.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e6723c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e600d10a0 0x7f5e60153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:22.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e6723c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e6015c8a0 0x7f5e6015cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e6723c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e601f6680 con 0x7f5e6015c8a0 2023-08-25T04:19:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e6723c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e601f6960 con 0x7f5e600d10a0 2023-08-25T04:19:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.553+0000 7f5e6723c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e601f6c40 con 0x7f5e600cd190 2023-08-25T04:19:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e66a3b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e6015c8a0 0x7f5e6015cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e66a3b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e6015c8a0 0x7f5e6015cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58662/0 (socket says 172.21.15.55:58662) 2023-08-25T04:19:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e66a3b640 1 -- 172.21.15.55:0/1470829882 learned_addr learned my addr 172.21.15.55:0/1470829882 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e6623a640 1 --2- 172.21.15.55:0/1470829882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e600cd190 0x7f5e600b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e65a39640 1 --2- 172.21.15.55:0/1470829882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e600d10a0 0x7f5e60153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e66a3b640 1 -- 172.21.15.55:0/1470829882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e600cd190 msgr2=0x7f5e600b6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e66a3b640 1 --2- 172.21.15.55:0/1470829882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e600cd190 0x7f5e600b6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e66a3b640 1 -- 172.21.15.55:0/1470829882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e600d10a0 msgr2=0x7f5e60153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e66a3b640 1 --2- 172.21.15.55:0/1470829882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e600d10a0 0x7f5e60153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e66a3b640 1 -- 172.21.15.55:0/1470829882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e58009b30 con 0x7f5e6015c8a0 2023-08-25T04:19:22.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e66a3b640 1 --2- 172.21.15.55:0/1470829882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e6015c8a0 0x7f5e6015cff0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f5e580af040 tx=0x7f5e58019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:22.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e56ffd640 1 -- 172.21.15.55:0/1470829882 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580b8670 con 0x7f5e6015c8a0 2023-08-25T04:19:22.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e56ffd640 1 -- 172.21.15.55:0/1470829882 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e580b87d0 con 0x7f5e6015c8a0 2023-08-25T04:19:22.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e56ffd640 1 -- 172.21.15.55:0/1470829882 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580b8b80 con 0x7f5e6015c8a0 2023-08-25T04:19:22.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e6723c640 1 -- 172.21.15.55:0/1470829882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e601f6f20 con 0x7f5e6015c8a0 2023-08-25T04:19:22.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e6723c640 1 -- 172.21.15.55:0/1470829882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e600b7e50 con 0x7f5e6015c8a0 2023-08-25T04:19:22.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e6723c640 1 -- 172.21.15.55:0/1470829882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e60066d20 con 0x7f5e6015c8a0 2023-08-25T04:19:22.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e56ffd640 1 -- 172.21.15.55:0/1470829882 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 42) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f5e580b8ce0 con 0x7f5e6015c8a0 2023-08-25T04:19:22.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.557+0000 7f5e56ffd640 1 --2- 172.21.15.55:0/1470829882 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f5e440657a0 0x7f5e44067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:22.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.561+0000 7f5e56ffd640 1 -- 172.21.15.55:0/1470829882 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f5e5811e5f0 con 0x7f5e6015c8a0 2023-08-25T04:19:22.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.561+0000 7f5e6623a640 1 -- 172.21.15.55:0/1470829882 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f5e440657a0 msgr2=0x7f5e44067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3580388085 2023-08-25T04:19:22.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.561+0000 7f5e6623a640 1 --2- 172.21.15.55:0/1470829882 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f5e440657a0 0x7f5e44067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:19:22.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.565+0000 7f5e56ffd640 1 -- 172.21.15.55:0/1470829882 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5e580ebf70 con 0x7f5e6015c8a0 2023-08-25T04:19:22.616 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:22.617+0000 7f151a07d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:19:22.719 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:19:22.720 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:19:22.720 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:19:22.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.721+0000 7f5e6723c640 1 -- 172.21.15.55:0/1470829882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e601f73d0 con 0x7f5e6015c8a0 2023-08-25T04:19:22.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.721+0000 7f5e56ffd640 1 -- 172.21.15.55:0/1470829882 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e580ef590 con 0x7f5e6015c8a0 2023-08-25T04:19:22.723 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:19:22.728 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:22.724+0000 7fd1157d4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:19:22.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.725+0000 7f5e6723c640 1 -- 172.21.15.55:0/1470829882 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f5e440657a0 msgr2=0x7f5e44067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:19:22.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.725+0000 7f5e6723c640 1 --2- 172.21.15.55:0/1470829882 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f5e440657a0 0x7f5e44067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.725+0000 7f5e6723c640 1 -- 172.21.15.55:0/1470829882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e6015c8a0 msgr2=0x7f5e6015cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:22.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.725+0000 7f5e6723c640 1 --2- 172.21.15.55:0/1470829882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e6015c8a0 0x7f5e6015cff0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f5e580af040 tx=0x7f5e58019780 comp rx=0 tx=0).stop 2023-08-25T04:19:22.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.725+0000 7f5e6723c640 1 -- 172.21.15.55:0/1470829882 shutdown_connections 2023-08-25T04:19:22.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.725+0000 7f5e6723c640 1 --2- 172.21.15.55:0/1470829882 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f5e440657a0 0x7f5e44067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.725+0000 7f5e6723c640 1 --2- 172.21.15.55:0/1470829882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e6015c8a0 0x7f5e6015cff0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.725+0000 7f5e6723c640 1 --2- 172.21.15.55:0/1470829882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e600d10a0 0x7f5e60153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.725+0000 7f5e6723c640 1 --2- 172.21.15.55:0/1470829882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e600cd190 0x7f5e600b6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.725+0000 7f5e6723c640 1 -- 172.21.15.55:0/1470829882 >> 172.21.15.55:0/1470829882 conn(0x7f5e600d2610 msgr2=0x7f5e600b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:22.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.725+0000 7f5e6723c640 1 -- 172.21.15.55:0/1470829882 shutdown_connections 2023-08-25T04:19:22.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.725+0000 7f5e6723c640 1 -- 172.21.15.55:0/1470829882 wait complete. 2023-08-25T04:19:22.744 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:19:22.865 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:22.864+0000 7fd1157d4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:19:22.886 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:19:22.887 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:19:22.887 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:19:22.895 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:22.897+0000 7f151a07d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:19:22.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.925+0000 7f14ec8cb640 1 Processor -- start 2023-08-25T04:19:22.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.925+0000 7f14ec8cb640 1 -- start start 2023-08-25T04:19:22.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.929+0000 7f14ec8cb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f14e80d0da0 0x7f14e80d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:22.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.929+0000 7f14ec8cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e80b29b0 con 0x7f14e80b3e50 2023-08-25T04:19:22.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.929+0000 7f14ec8cb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e80cfc80 con 0x7f14e80cdde0 2023-08-25T04:19:22.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.929+0000 7f14ec8cb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e80d16c0 con 0x7f14e80d0da0 2023-08-25T04:19:22.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.929+0000 7f14e6d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f14e80b3e50 0x7f14e80cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54192/0 (socket says 172.21.15.55:54192) 2023-08-25T04:19:22.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.929+0000 7f14e6d9d640 1 -- 172.21.15.55:0/3748940894 learned_addr learned my addr 172.21.15.55:0/3748940894 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:22.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.929+0000 7f14e659c640 1 --2- 172.21.15.55:0/3748940894 >> v2:172.21.15.110:3300/0 conn(0x7f14e80d0da0 0x7f14e80d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:22.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.929+0000 7f14e659c640 1 -- 172.21.15.55:0/3748940894 >> v1:172.21.15.110:6789/0 conn(0x7f14e80cdde0 legacy=0x7f14e80cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:22.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.929+0000 7f14e659c640 1 -- 172.21.15.55:0/3748940894 >> v1:172.21.15.55:6789/0 conn(0x7f14e80b3e50 legacy=0x7f14e80cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:22.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.929+0000 7f14e659c640 1 -- 172.21.15.55:0/3748940894 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e80b1dc0 con 0x7f14e80d0da0 2023-08-25T04:19:22.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.929+0000 7f14e5d9b640 1 -- 172.21.15.55:0/3748940894 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799219873 0 0) 0x7f14e80b29b0 con 0x7f14e80b3e50 2023-08-25T04:19:22.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.933+0000 7f14e659c640 1 --2- 172.21.15.55:0/3748940894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e80d0da0 0x7f14e80d1180 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f14d80097a0 tx=0x7f14d801ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ef402f8900f0ada server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:22.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.933+0000 7f14e5d9b640 1 -- 172.21.15.55:0/3748940894 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d80a8950 con 0x7f14e80d0da0 2023-08-25T04:19:22.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.933+0000 7f14e5d9b640 1 -- 172.21.15.55:0/3748940894 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d80a8ab0 con 0x7f14e80d0da0 2023-08-25T04:19:22.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.933+0000 7f14e5d9b640 1 -- 172.21.15.55:0/3748940894 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d80a8e40 con 0x7f14e80d0da0 2023-08-25T04:19:22.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.933+0000 7f14ec8cb640 1 -- 172.21.15.55:0/3748940894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e80d0da0 msgr2=0x7f14e80d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:22.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.933+0000 7f14ec8cb640 1 --2- 172.21.15.55:0/3748940894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e80d0da0 0x7f14e80d1180 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f14d80097a0 tx=0x7f14d801ec50 comp rx=0 tx=0).stop 2023-08-25T04:19:22.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.933+0000 7f14ec8cb640 1 -- 172.21.15.55:0/3748940894 shutdown_connections 2023-08-25T04:19:22.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.933+0000 7f14ec8cb640 1 --2- 172.21.15.55:0/3748940894 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e80d0da0 0x7f14e80d1180 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.933+0000 7f14ec8cb640 1 -- 172.21.15.55:0/3748940894 >> 172.21.15.55:0/3748940894 conn(0x7f14e809bae0 msgr2=0x7f14e80d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:22.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.933+0000 7f14ec8cb640 1 -- 172.21.15.55:0/3748940894 shutdown_connections 2023-08-25T04:19:22.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.933+0000 7f14ec8cb640 1 -- 172.21.15.55:0/3748940894 wait complete. 2023-08-25T04:19:22.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.933+0000 7f14ec8cb640 1 Processor -- start 2023-08-25T04:19:22.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.933+0000 7f14ec8cb640 1 -- start start 2023-08-25T04:19:22.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14ec8cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14e80b3e50 0x7f14e81f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:22.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14ec8cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14e80cdde0 0x7f14e80cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:22.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14ec8cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e80d0da0 0x7f14e80cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:22.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14ec8cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80b6140 con 0x7f14e80cdde0 2023-08-25T04:19:22.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14ec8cb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80c8be0 con 0x7f14e80d0da0 2023-08-25T04:19:22.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14ec8cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e80cb830 con 0x7f14e80b3e50 2023-08-25T04:19:22.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14e80cdde0 0x7f14e80cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:22.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14e80cdde0 0x7f14e80cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58672/0 (socket says 172.21.15.55:58672) 2023-08-25T04:19:22.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14dffff640 1 -- 172.21.15.55:0/2965340016 learned_addr learned my addr 172.21.15.55:0/2965340016 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:22.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14e659c640 1 --2- 172.21.15.55:0/2965340016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14e80b3e50 0x7f14e81f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:22.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14e6d9d640 1 --2- 172.21.15.55:0/2965340016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e80d0da0 0x7f14e80cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:22.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14dffff640 1 -- 172.21.15.55:0/2965340016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14e80b3e50 msgr2=0x7f14e81f1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:22.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14dffff640 1 --2- 172.21.15.55:0/2965340016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14e80b3e50 0x7f14e81f1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14dffff640 1 -- 172.21.15.55:0/2965340016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e80d0da0 msgr2=0x7f14e80cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:22.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14dffff640 1 --2- 172.21.15.55:0/2965340016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e80d0da0 0x7f14e80cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:22.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14dffff640 1 -- 172.21.15.55:0/2965340016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d80093b0 con 0x7f14e80cdde0 2023-08-25T04:19:22.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14dffff640 1 --2- 172.21.15.55:0/2965340016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14e80cdde0 0x7f14e80cb2f0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f14d000c500 tx=0x7f14d000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:22.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14deffd640 1 -- 172.21.15.55:0/2965340016 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0005220 con 0x7f14e80cdde0 2023-08-25T04:19:22.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14deffd640 1 -- 172.21.15.55:0/2965340016 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d0005380 con 0x7f14e80cdde0 2023-08-25T04:19:22.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14deffd640 1 -- 172.21.15.55:0/2965340016 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0007270 con 0x7f14e80cdde0 2023-08-25T04:19:22.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14ec8cb640 1 -- 172.21.15.55:0/2965340016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e80c7f60 con 0x7f14e80cdde0 2023-08-25T04:19:22.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14ec8cb640 1 -- 172.21.15.55:0/2965340016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e80c8520 con 0x7f14e80cdde0 2023-08-25T04:19:22.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.937+0000 7f14ec8cb640 1 -- 172.21.15.55:0/2965340016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e804dbe0 con 0x7f14e80cdde0 2023-08-25T04:19:22.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.941+0000 7f14deffd640 1 -- 172.21.15.55:0/2965340016 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 42) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f14d00073d0 con 0x7f14e80cdde0 2023-08-25T04:19:22.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.941+0000 7f14deffd640 1 --2- 172.21.15.55:0/2965340016 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f14c80657a0 0x7f14c8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:22.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.941+0000 7f14deffd640 1 -- 172.21.15.55:0/2965340016 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f14d0082920 con 0x7f14e80cdde0 2023-08-25T04:19:22.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.941+0000 7f14e659c640 1 -- 172.21.15.55:0/2965340016 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f14c80657a0 msgr2=0x7f14c8067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3580388085 2023-08-25T04:19:22.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.941+0000 7f14e659c640 1 --2- 172.21.15.55:0/2965340016 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f14c80657a0 0x7f14c8067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:19:22.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:22.945+0000 7f14deffd640 1 -- 172.21.15.55:0/2965340016 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f14d0050190 con 0x7f14e80cdde0 2023-08-25T04:19:22.990 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:22.988+0000 7fd1157d4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:19:23.041 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:23.041+0000 7f151a07d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:19:23.060 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:23.056+0000 7fd1157d4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:19:23.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.113+0000 7f14ec8cb640 1 -- 172.21.15.55:0/2965340016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f14e80d0b80 con 0x7f14e80cdde0 2023-08-25T04:19:23.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.113+0000 7f14deffd640 1 -- 172.21.15.55:0/2965340016 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v94) v1 ==== 80+0+475 (secure 0 0 0) 0x7f14d00537b0 con 0x7f14e80cdde0 2023-08-25T04:19:23.115 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3373349369 2023-08-26T04:19:18.606592+0000 2023-08-25T04:19:23.115 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6833/2805609132 2023-08-26T04:19:18.606592+0000 2023-08-25T04:19:23.115 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6832/2805609132 2023-08-26T04:19:18.606592+0000 2023-08-25T04:19:23.116 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3316375931 2023-08-26T04:19:18.606592+0000 2023-08-25T04:19:23.116 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/7066739 2023-08-26T04:19:18.606592+0000 2023-08-25T04:19:23.116 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/2684620126 2023-08-26T04:19:18.606592+0000 2023-08-25T04:19:23.116 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3401969959 2023-08-26T04:19:18.606592+0000 2023-08-25T04:19:23.117 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3496245024 2023-08-26T04:19:18.606592+0000 2023-08-25T04:19:23.119 INFO:teuthology.orchestra.run.smithi055.stderr:listed 8 entries 2023-08-25T04:19:23.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.117+0000 7f14ec8cb640 1 -- 172.21.15.55:0/2965340016 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f14c80657a0 msgr2=0x7f14c8067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:19:23.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.117+0000 7f14ec8cb640 1 --2- 172.21.15.55:0/2965340016 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f14c80657a0 0x7f14c8067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.117+0000 7f14ec8cb640 1 -- 172.21.15.55:0/2965340016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14e80cdde0 msgr2=0x7f14e80cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:23.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.117+0000 7f14ec8cb640 1 --2- 172.21.15.55:0/2965340016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14e80cdde0 0x7f14e80cb2f0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f14d000c500 tx=0x7f14d000c9c0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.117+0000 7f14ec8cb640 1 -- 172.21.15.55:0/2965340016 shutdown_connections 2023-08-25T04:19:23.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.117+0000 7f14ec8cb640 1 --2- 172.21.15.55:0/2965340016 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f14c80657a0 0x7f14c8067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.117+0000 7f14ec8cb640 1 --2- 172.21.15.55:0/2965340016 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14e80d0da0 0x7f14e80cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.117+0000 7f14ec8cb640 1 --2- 172.21.15.55:0/2965340016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14e80cdde0 0x7f14e80cb2f0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.117+0000 7f14ec8cb640 1 --2- 172.21.15.55:0/2965340016 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14e80b3e50 0x7f14e81f1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.117+0000 7f14ec8cb640 1 -- 172.21.15.55:0/2965340016 >> 172.21.15.55:0/2965340016 conn(0x7f14e809bae0 msgr2=0x7f14e80b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:23.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.117+0000 7f14ec8cb640 1 -- 172.21.15.55:0/2965340016 shutdown_connections 2023-08-25T04:19:23.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.117+0000 7f14ec8cb640 1 -- 172.21.15.55:0/2965340016 wait complete. 2023-08-25T04:19:23.136 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-25T04:19:23.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:23.137 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-25T04:19:23.174 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:23.173+0000 7f151a07d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:19:23.195 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T04:19:23.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:23.196 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-25T04:19:23.197 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:23.192+0000 7fd1157d4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:19:23.249 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:19:23.250 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:19:23.252 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:23.249+0000 7f151a07d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:19:23.260 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:19:23.261 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:19:23.261 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:19:23.299 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T04:19:23.300 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:19:23.300 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:19:23.310 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:19:23.312 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:19:23.391 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:23.393+0000 7f151a07d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:19:23.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f032c0e6640 1 Processor -- start 2023-08-25T04:19:23.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f032c0e6640 1 -- start start 2023-08-25T04:19:23.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f032c0e6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f032415eba0 0x7f03240b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:23.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f032c0e6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f032415ef80 0x7f03240ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:23.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f032c0e6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f03240cece0 0x7f03240cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:23.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f032c0e6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03240cf170 con 0x7f032415ef80 2023-08-25T04:19:23.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f032c0e6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03240ac3a0 con 0x7f03240cece0 2023-08-25T04:19:23.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f032c0e6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03240b1390 con 0x7f032415eba0 2023-08-25T04:19:23.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f0329681640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f032415ef80 0x7f03240ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:23.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f0329681640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f032415ef80 0x7f03240ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58686/0 (socket says 172.21.15.55:58686) 2023-08-25T04:19:23.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f0329681640 1 -- 172.21.15.55:0/4022985304 learned_addr learned my addr 172.21.15.55:0/4022985304 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:23.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f0329e82640 1 --2- 172.21.15.55:0/4022985304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f032415eba0 0x7f03240b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:23.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f032a683640 1 --2- 172.21.15.55:0/4022985304 >> v2:172.21.15.110:3300/0 conn(0x7f03240cece0 0x7f03240cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:23.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f0329681640 1 -- 172.21.15.55:0/4022985304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f032415eba0 msgr2=0x7f03240b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:23.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f0329681640 1 --2- 172.21.15.55:0/4022985304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f032415eba0 0x7f03240b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f0329681640 1 -- 172.21.15.55:0/4022985304 >> v2:172.21.15.110:3300/0 conn(0x7f03240cece0 msgr2=0x7f03240cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:23.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f0329681640 1 --2- 172.21.15.55:0/4022985304 >> v2:172.21.15.110:3300/0 conn(0x7f03240cece0 0x7f03240cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f0329681640 1 -- 172.21.15.55:0/4022985304 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03240b1670 con 0x7f032415ef80 2023-08-25T04:19:23.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f0329e82640 1 --2- 172.21.15.55:0/4022985304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f032415eba0 0x7f03240b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:23.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.489+0000 7f032a683640 1 --2- 172.21.15.55:0/4022985304 >> v2:172.21.15.110:3300/0 conn(0x7f03240cece0 0x7f03240cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:23.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.493+0000 7f0329681640 1 --2- 172.21.15.55:0/4022985304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f032415ef80 0x7f03240ce7a0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f032406a8c0 tx=0x7f031401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f783619bc706a74 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:23.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.493+0000 7f0328e80640 1 -- 172.21.15.55:0/4022985304 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03140ab600 con 0x7f032415ef80 2023-08-25T04:19:23.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.493+0000 7f0328e80640 1 -- 172.21.15.55:0/4022985304 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03140a7050 con 0x7f032415ef80 2023-08-25T04:19:23.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.493+0000 7f0328e80640 1 -- 172.21.15.55:0/4022985304 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03140ab980 con 0x7f032415ef80 2023-08-25T04:19:23.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.493+0000 7f032c0e6640 1 -- 172.21.15.55:0/4022985304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f032415ef80 msgr2=0x7f03240ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:23.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.493+0000 7f032c0e6640 1 --2- 172.21.15.55:0/4022985304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f032415ef80 0x7f03240ce7a0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f032406a8c0 tx=0x7f031401c210 comp rx=0 tx=0).stop 2023-08-25T04:19:23.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.493+0000 7f032c0e6640 1 -- 172.21.15.55:0/4022985304 shutdown_connections 2023-08-25T04:19:23.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.493+0000 7f032c0e6640 1 --2- 172.21.15.55:0/4022985304 >> v2:172.21.15.110:3300/0 conn(0x7f03240cece0 0x7f03240cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.493+0000 7f032c0e6640 1 --2- 172.21.15.55:0/4022985304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f032415ef80 0x7f03240ce7a0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.493+0000 7f032c0e6640 1 --2- 172.21.15.55:0/4022985304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f032415eba0 0x7f03240b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.493+0000 7f032c0e6640 1 -- 172.21.15.55:0/4022985304 >> 172.21.15.55:0/4022985304 conn(0x7f0324069d00 msgr2=0x7f032406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:23.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.493+0000 7f032c0e6640 1 -- 172.21.15.55:0/4022985304 shutdown_connections 2023-08-25T04:19:23.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.493+0000 7f032c0e6640 1 -- 172.21.15.55:0/4022985304 wait complete. 2023-08-25T04:19:23.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f032c0e6640 1 Processor -- start 2023-08-25T04:19:23.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f032c0e6640 1 -- start start 2023-08-25T04:19:23.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f032c0e6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03240cece0 0x7f03241f9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:23.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f032c0e6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f032415eba0 0x7f03240c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:23.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f032c0e6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f032415ef80 0x7f032406ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:23.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f032c0e6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03240c8350 con 0x7f03240cece0 2023-08-25T04:19:23.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f032c0e6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032406d660 con 0x7f032415ef80 2023-08-25T04:19:23.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f032c0e6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03240c6db0 con 0x7f032415eba0 2023-08-25T04:19:23.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f0329e82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03240cece0 0x7f03241f9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:23.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f0329681640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f032415eba0 0x7f03240c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:23.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f0329681640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f032415eba0 0x7f03240c7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:36572/0 (socket says 172.21.15.55:36572) 2023-08-25T04:19:23.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f0329681640 1 -- 172.21.15.55:0/3227979641 learned_addr learned my addr 172.21.15.55:0/3227979641 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:23.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f032a683640 1 --2- 172.21.15.55:0/3227979641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f032415ef80 0x7f032406ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:23.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f0329681640 1 -- 172.21.15.55:0/3227979641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f032415ef80 msgr2=0x7f032406ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:23.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f0329681640 1 --2- 172.21.15.55:0/3227979641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f032415ef80 0x7f032406ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f0329681640 1 -- 172.21.15.55:0/3227979641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03240cece0 msgr2=0x7f03241f9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:23.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f0329681640 1 --2- 172.21.15.55:0/3227979641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03240cece0 0x7f03241f9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f0329681640 1 -- 172.21.15.55:0/3227979641 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03140094d0 con 0x7f032415eba0 2023-08-25T04:19:23.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f0329e82640 1 --2- 172.21.15.55:0/3227979641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03240cece0 0x7f03241f9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:23.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f0329681640 1 --2- 172.21.15.55:0/3227979641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f032415eba0 0x7f03240c7e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f03140ae040 tx=0x7f0314018fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:23.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f031a7fc640 1 -- 172.21.15.55:0/3227979641 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03140b4440 con 0x7f032415eba0 2023-08-25T04:19:23.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f031a7fc640 1 -- 172.21.15.55:0/3227979641 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03140b45a0 con 0x7f032415eba0 2023-08-25T04:19:23.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f031a7fc640 1 -- 172.21.15.55:0/3227979641 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03140b4930 con 0x7f032415eba0 2023-08-25T04:19:23.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f032c0e6640 1 -- 172.21.15.55:0/3227979641 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f032406d3c0 con 0x7f032415eba0 2023-08-25T04:19:23.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.497+0000 7f032c0e6640 1 -- 172.21.15.55:0/3227979641 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03240c7330 con 0x7f032415eba0 2023-08-25T04:19:23.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.501+0000 7f032c0e6640 1 -- 172.21.15.55:0/3227979641 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f032404dbe0 con 0x7f032415eba0 2023-08-25T04:19:23.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.501+0000 7f031a7fc640 1 -- 172.21.15.55:0/3227979641 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 42) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f03140b2070 con 0x7f032415eba0 2023-08-25T04:19:23.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.501+0000 7f031a7fc640 1 --2- 172.21.15.55:0/3227979641 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f03080657a0 0x7f0308067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:23.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.501+0000 7f031a7fc640 1 -- 172.21.15.55:0/3227979641 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f031411cfb0 con 0x7f032415eba0 2023-08-25T04:19:23.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.501+0000 7f0329e82640 1 -- 172.21.15.55:0/3227979641 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f03080657a0 msgr2=0x7f0308067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3580388085 2023-08-25T04:19:23.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.501+0000 7f0329e82640 1 --2- 172.21.15.55:0/3227979641 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f03080657a0 0x7f0308067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:19:23.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.505+0000 7f031a7fc640 1 -- 172.21.15.55:0/3227979641 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f03140ea700 con 0x7f032415eba0 2023-08-25T04:19:23.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.705+0000 7f0329e82640 1 -- 172.21.15.55:0/3227979641 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f03080657a0 msgr2=0x7f0308067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3580388085 2023-08-25T04:19:23.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.705+0000 7f0329e82640 1 --2- 172.21.15.55:0/3227979641 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f03080657a0 0x7f0308067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-25T04:19:23.737 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:23.732+0000 7fd1157d4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:19:23.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.793+0000 7f032c0e6640 1 -- 172.21.15.55:0/3227979641 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03240afc00 con 0x7f032415eba0 2023-08-25T04:19:23.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.797+0000 7f031a7fc640 1 -- 172.21.15.55:0/3227979641 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f03140b0020 con 0x7f032415eba0 2023-08-25T04:19:23.796 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:23.796 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6311,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/976095252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":976095252},{"type":"v1","addr":"172.21.15.110:6836","nonce":976095252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1364761770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1364761770},{"type":"v1","addr":"172.21.15.110:6837","nonce":1364761770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2491496151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2491496151},{"type":"v1","addr":"172.21.15.55:6834","nonce":2491496151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:19:06.181749+0000","modified":"2023-08-25T04:19:09.803812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7329":{"gid":7329,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3432791477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3432791477},{"type":"v1","addr":"172.21.15.55:6835","nonce":3432791477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-25T04:19:23.798 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 40 2023-08-25T04:19:23.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.797+0000 7f032c0e6640 1 -- 172.21.15.55:0/3227979641 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f03080657a0 msgr2=0x7f0308067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:19:23.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.797+0000 7f032c0e6640 1 --2- 172.21.15.55:0/3227979641 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f03080657a0 0x7f0308067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.797+0000 7f032c0e6640 1 -- 172.21.15.55:0/3227979641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f032415eba0 msgr2=0x7f03240c7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:23.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.797+0000 7f032c0e6640 1 --2- 172.21.15.55:0/3227979641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f032415eba0 0x7f03240c7e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f03140ae040 tx=0x7f0314018fb0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.797+0000 7f032c0e6640 1 -- 172.21.15.55:0/3227979641 shutdown_connections 2023-08-25T04:19:23.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.797+0000 7f032c0e6640 1 --2- 172.21.15.55:0/3227979641 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7f03080657a0 0x7f0308067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.797+0000 7f032c0e6640 1 --2- 172.21.15.55:0/3227979641 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f032415ef80 0x7f032406ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.797+0000 7f032c0e6640 1 --2- 172.21.15.55:0/3227979641 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f032415eba0 0x7f03240c7e10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.797+0000 7f032c0e6640 1 --2- 172.21.15.55:0/3227979641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03240cece0 0x7f03241f9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.797+0000 7f032c0e6640 1 -- 172.21.15.55:0/3227979641 >> 172.21.15.55:0/3227979641 conn(0x7f0324069d00 msgr2=0x7f03240ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:23.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.797+0000 7f032c0e6640 1 -- 172.21.15.55:0/3227979641 shutdown_connections 2023-08-25T04:19:23.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.797+0000 7f032c0e6640 1 -- 172.21.15.55:0/3227979641 wait complete. 2023-08-25T04:19:23.817 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:19:23.822 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:23.820+0000 7fd1157d4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:19:23.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.965+0000 7fada22e6640 1 Processor -- start 2023-08-25T04:19:23.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.969+0000 7fada22e6640 1 -- start start 2023-08-25T04:19:23.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.969+0000 7fada22e6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c0d0da0 0x7fad9c0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:23.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.969+0000 7fada22e6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fad9c0cdde0 0x7fad9c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:23.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.969+0000 7fada22e6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9c0b29b0 con 0x7fad9c0cee60 2023-08-25T04:19:23.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.969+0000 7fada22e6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad9c0ce760 con 0x7fad9c0cdde0 2023-08-25T04:19:23.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.969+0000 7fada22e6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c0d16c0 con 0x7fad9c0d0da0 2023-08-25T04:19:23.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.969+0000 7fad9b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fad9c0cdde0 0x7fad9c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:23.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.969+0000 7fad9b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fad9c0cdde0 0x7fad9c0ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58696/0 (socket says 172.21.15.55:58696) 2023-08-25T04:19:23.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.969+0000 7fad9b7fe640 1 -- 172.21.15.55:0/1931392974 learned_addr learned my addr 172.21.15.55:0/1931392974 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:23.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.969+0000 7fad9bfff640 1 --2- 172.21.15.55:0/1931392974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c0d0da0 0x7fad9c0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:23.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.969+0000 7fad9b7fe640 1 -- 172.21.15.55:0/1931392974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c0d0da0 msgr2=0x7fad9c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:23.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.969+0000 7fad9b7fe640 1 --2- 172.21.15.55:0/1931392974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c0d0da0 0x7fad9c0d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.969+0000 7fad9b7fe640 1 -- 172.21.15.55:0/1931392974 >> v1:172.21.15.110:6789/0 conn(0x7fad9c0cee60 legacy=0x7fad9c0cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:23.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.969+0000 7fad9b7fe640 1 -- 172.21.15.55:0/1931392974 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c0b1dc0 con 0x7fad9c0cdde0 2023-08-25T04:19:23.973 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:23.964+0000 7fd1157d4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:19:23.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.973+0000 7fad9b7fe640 1 --2- 172.21.15.55:0/1931392974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad9c0cdde0 0x7fad9c0ce220 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fad90009870 tx=0x7fad9001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0d45b9e684b431 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:23.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.973+0000 7fad9affd640 1 -- 172.21.15.55:0/1931392974 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad900a8a30 con 0x7fad9c0cdde0 2023-08-25T04:19:23.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.973+0000 7fad9affd640 1 -- 172.21.15.55:0/1931392974 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad900a8b90 con 0x7fad9c0cdde0 2023-08-25T04:19:23.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.973+0000 7fad9affd640 1 -- 172.21.15.55:0/1931392974 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad900b0440 con 0x7fad9c0cdde0 2023-08-25T04:19:23.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.973+0000 7fada22e6640 1 -- 172.21.15.55:0/1931392974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad9c0cdde0 msgr2=0x7fad9c0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:23.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.973+0000 7fada22e6640 1 --2- 172.21.15.55:0/1931392974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad9c0cdde0 0x7fad9c0ce220 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fad90009870 tx=0x7fad9001ed30 comp rx=0 tx=0).stop 2023-08-25T04:19:23.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.973+0000 7fada22e6640 1 -- 172.21.15.55:0/1931392974 shutdown_connections 2023-08-25T04:19:23.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.973+0000 7fada22e6640 1 --2- 172.21.15.55:0/1931392974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad9c0cdde0 0x7fad9c0ce220 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.973+0000 7fada22e6640 1 --2- 172.21.15.55:0/1931392974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c0d0da0 0x7fad9c0d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.973+0000 7fada22e6640 1 -- 172.21.15.55:0/1931392974 >> 172.21.15.55:0/1931392974 conn(0x7fad9c09bae0 msgr2=0x7fad9c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:23.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.973+0000 7fada22e6640 1 -- 172.21.15.55:0/1931392974 shutdown_connections 2023-08-25T04:19:23.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.973+0000 7fada22e6640 1 -- 172.21.15.55:0/1931392974 wait complete. 2023-08-25T04:19:23.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.973+0000 7fada22e6640 1 Processor -- start 2023-08-25T04:19:23.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fada22e6640 1 -- start start 2023-08-25T04:19:23.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fada22e6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad9c0cdde0 0x7fad9c0c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:23.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fada22e6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad9c0cee60 0x7fad9c0ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:23.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fada22e6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c0d0da0 0x7fad9c151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:23.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fada22e6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c0ca7e0 con 0x7fad9c0cdde0 2023-08-25T04:19:23.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fada22e6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c1521f0 con 0x7fad9c0cee60 2023-08-25T04:19:23.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fada22e6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c0c7b60 con 0x7fad9c0d0da0 2023-08-25T04:19:23.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fad9bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad9c0cdde0 0x7fad9c0c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:23.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fad9bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad9c0cdde0 0x7fad9c0c7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58700/0 (socket says 172.21.15.55:58700) 2023-08-25T04:19:23.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fad9bfff640 1 -- 172.21.15.55:0/1773862129 learned_addr learned my addr 172.21.15.55:0/1773862129 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:23.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fad9b7fe640 1 --2- 172.21.15.55:0/1773862129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad9c0cee60 0x7fad9c0ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:23.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fada0883640 1 --2- 172.21.15.55:0/1773862129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c0d0da0 0x7fad9c151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:23.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fad9bfff640 1 -- 172.21.15.55:0/1773862129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c0d0da0 msgr2=0x7fad9c151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:23.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fad9bfff640 1 --2- 172.21.15.55:0/1773862129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c0d0da0 0x7fad9c151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fad9bfff640 1 -- 172.21.15.55:0/1773862129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad9c0cee60 msgr2=0x7fad9c0ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:23.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fad9bfff640 1 --2- 172.21.15.55:0/1773862129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad9c0cee60 0x7fad9c0ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:23.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fad9bfff640 1 -- 172.21.15.55:0/1773862129 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad900094d0 con 0x7fad9c0cdde0 2023-08-25T04:19:23.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fad9bfff640 1 --2- 172.21.15.55:0/1773862129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad9c0cdde0 0x7fad9c0c7510 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00e870 tx=0x7fad8c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:23.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fad98ff9640 1 -- 172.21.15.55:0/1773862129 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c0095d0 con 0x7fad9c0cdde0 2023-08-25T04:19:23.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fad98ff9640 1 -- 172.21.15.55:0/1773862129 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c00c940 con 0x7fad9c0cdde0 2023-08-25T04:19:23.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fad98ff9640 1 -- 172.21.15.55:0/1773862129 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c00ccb0 con 0x7fad9c0cdde0 2023-08-25T04:19:23.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fada22e6640 1 -- 172.21.15.55:0/1773862129 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9c0c7e40 con 0x7fad9c0cdde0 2023-08-25T04:19:23.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fada22e6640 1 -- 172.21.15.55:0/1773862129 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9c0c8400 con 0x7fad9c0cdde0 2023-08-25T04:19:23.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.977+0000 7fada22e6640 1 -- 172.21.15.55:0/1773862129 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9c0c8920 con 0x7fad9c0cdde0 2023-08-25T04:19:23.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.981+0000 7fad98ff9640 1 -- 172.21.15.55:0/1773862129 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 42) v1 ==== 85065+0+0 (secure 0 0 0) 0x7fad8c013470 con 0x7fad9c0cdde0 2023-08-25T04:19:23.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.981+0000 7fad98ff9640 1 --2- 172.21.15.55:0/1773862129 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fad880657a0 0x7fad88067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:23.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.981+0000 7fad98ff9640 1 -- 172.21.15.55:0/1773862129 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fad8c083610 con 0x7fad9c0cdde0 2023-08-25T04:19:23.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.981+0000 7fad9b7fe640 1 -- 172.21.15.55:0/1773862129 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fad880657a0 msgr2=0x7fad88067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3580388085 2023-08-25T04:19:23.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.981+0000 7fad9b7fe640 1 --2- 172.21.15.55:0/1773862129 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fad880657a0 0x7fad88067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:19:23.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:23.985+0000 7fad98ff9640 1 -- 172.21.15.55:0/1773862129 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fad8c050f30 con 0x7fad9c0cdde0 2023-08-25T04:19:24.052 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:24.048+0000 7fd1157d4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:19:24.060 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:24.061+0000 7f151a07d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:19:24.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.141+0000 7fada22e6640 1 -- 172.21.15.55:0/1773862129 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad9c04dbe0 con 0x7fad9c0cdde0 2023-08-25T04:19:24.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.145+0000 7fad98ff9640 1 -- 172.21.15.55:0/1773862129 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+18872 (secure 0 0 0) 0x7fad8c054550 con 0x7fad9c0cdde0 2023-08-25T04:19:24.145 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:24.145 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":94,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:19:18.606641+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:19:03.829933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-25T04:19:05.172184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3373349369":"2023-08-26T04:19:18.606592+0000","172.21.15.110:6833/2805609132":"2023-08-26T04:19:18.606592+0000","172.21.15.110:6832/2805609132":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/3316375931":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/7066739":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/2684620126":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/3401969959":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/3496245024":"2023-08-26T04:19:18.606592+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:19:24.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.145+0000 7fada22e6640 1 -- 172.21.15.55:0/1773862129 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fad880657a0 msgr2=0x7fad88067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:19:24.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.145+0000 7fada22e6640 1 --2- 172.21.15.55:0/1773862129 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fad880657a0 0x7fad88067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.145+0000 7fada22e6640 1 -- 172.21.15.55:0/1773862129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad9c0cdde0 msgr2=0x7fad9c0c7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:24.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.145+0000 7fada22e6640 1 --2- 172.21.15.55:0/1773862129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad9c0cdde0 0x7fad9c0c7510 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00e870 tx=0x7fad8c00ed30 comp rx=0 tx=0).stop 2023-08-25T04:19:24.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.145+0000 7fada22e6640 1 -- 172.21.15.55:0/1773862129 shutdown_connections 2023-08-25T04:19:24.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.145+0000 7fada22e6640 1 --2- 172.21.15.55:0/1773862129 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fad880657a0 0x7fad88067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.145+0000 7fada22e6640 1 --2- 172.21.15.55:0/1773862129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fad9c0d0da0 0x7fad9c151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.145+0000 7fada22e6640 1 --2- 172.21.15.55:0/1773862129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fad9c0cee60 0x7fad9c0ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.145+0000 7fada22e6640 1 --2- 172.21.15.55:0/1773862129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad9c0cdde0 0x7fad9c0c7510 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.145+0000 7fada22e6640 1 -- 172.21.15.55:0/1773862129 >> 172.21.15.55:0/1773862129 conn(0x7fad9c09bae0 msgr2=0x7fad9c0b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:24.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.145+0000 7fada22e6640 1 -- 172.21.15.55:0/1773862129 shutdown_connections 2023-08-25T04:19:24.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.145+0000 7fada22e6640 1 -- 172.21.15.55:0/1773862129 wait complete. 2023-08-25T04:19:24.151 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:24.149+0000 7f151a07d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:19:24.166 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:19:03.829933+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:19:05.172184+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:19:24.167 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:19:24.310 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:24.309+0000 7f151a07d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:19:24.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.317+0000 7fc474f3a640 1 Processor -- start 2023-08-25T04:19:24.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.317+0000 7fc474f3a640 1 -- start start 2023-08-25T04:19:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.321+0000 7fc474f3a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc47015e3c0 0x7fc47015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.321+0000 7fc474f3a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc4700d1290 0x7fc47015e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.321+0000 7fc474f3a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4700cd5a0 con 0x7fc4701601f0 2023-08-25T04:19:24.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.321+0000 7fc474f3a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4700cd880 con 0x7fc4700d1290 2023-08-25T04:19:24.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.321+0000 7fc474f3a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4700cdb60 con 0x7fc47015e3c0 2023-08-25T04:19:24.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.321+0000 7fc46ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc4700d1290 0x7fc47015e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:24.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.321+0000 7fc46ed9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc4700d1290 0x7fc47015e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58706/0 (socket says 172.21.15.55:58706) 2023-08-25T04:19:24.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.321+0000 7fc46ed9d640 1 -- 172.21.15.55:0/2104578694 learned_addr learned my addr 172.21.15.55:0/2104578694 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:24.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.321+0000 7fc467fff640 1 --2- 172.21.15.55:0/2104578694 >> v2:172.21.15.110:3300/0 conn(0x7fc47015e3c0 0x7fc47015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:24.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.321+0000 7fc46ed9d640 1 -- 172.21.15.55:0/2104578694 >> v2:172.21.15.110:3300/0 conn(0x7fc47015e3c0 msgr2=0x7fc47015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:24.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.321+0000 7fc46ed9d640 1 --2- 172.21.15.55:0/2104578694 >> v2:172.21.15.110:3300/0 conn(0x7fc47015e3c0 0x7fc47015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.321+0000 7fc46ed9d640 1 -- 172.21.15.55:0/2104578694 >> v1:172.21.15.110:6789/0 conn(0x7fc4701601f0 legacy=0x7fc4700d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:24.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.321+0000 7fc46ed9d640 1 -- 172.21.15.55:0/2104578694 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4700cde40 con 0x7fc4700d1290 2023-08-25T04:19:24.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.321+0000 7fc46dd9b640 1 -- 172.21.15.55:0/2104578694 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760893584 0 0) 0x7fc4700cd5a0 con 0x7fc4701601f0 2023-08-25T04:19:24.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.321+0000 7fc46ed9d640 1 --2- 172.21.15.55:0/2104578694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4700d1290 0x7fc47015e8a0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fc4700cd350 tx=0x7fc46801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47ba46130ded321 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.321+0000 7fc46dd9b640 1 -- 172.21.15.55:0/2104578694 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4680a5790 con 0x7fc4700d1290 2023-08-25T04:19:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.321+0000 7fc46dd9b640 1 -- 172.21.15.55:0/2104578694 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4680a58f0 con 0x7fc4700d1290 2023-08-25T04:19:24.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.321+0000 7fc46dd9b640 1 -- 172.21.15.55:0/2104578694 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4680a5c80 con 0x7fc4700d1290 2023-08-25T04:19:24.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.325+0000 7fc474f3a640 1 -- 172.21.15.55:0/2104578694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4700d1290 msgr2=0x7fc47015e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:24.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.325+0000 7fc474f3a640 1 --2- 172.21.15.55:0/2104578694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4700d1290 0x7fc47015e8a0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fc4700cd350 tx=0x7fc46801c9a0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.325+0000 7fc474f3a640 1 -- 172.21.15.55:0/2104578694 shutdown_connections 2023-08-25T04:19:24.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.325+0000 7fc474f3a640 1 --2- 172.21.15.55:0/2104578694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4700d1290 0x7fc47015e8a0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.325+0000 7fc474f3a640 1 --2- 172.21.15.55:0/2104578694 >> v2:172.21.15.110:3300/0 conn(0x7fc47015e3c0 0x7fc47015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.325+0000 7fc474f3a640 1 -- 172.21.15.55:0/2104578694 >> 172.21.15.55:0/2104578694 conn(0x7fc4700d27d0 msgr2=0x7fc4700d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:24.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.325+0000 7fc474f3a640 1 -- 172.21.15.55:0/2104578694 shutdown_connections 2023-08-25T04:19:24.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.325+0000 7fc474f3a640 1 -- 172.21.15.55:0/2104578694 wait complete. 2023-08-25T04:19:24.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.325+0000 7fc474f3a640 1 Processor -- start 2023-08-25T04:19:24.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.325+0000 7fc474f3a640 1 -- start start 2023-08-25T04:19:24.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.325+0000 7fc474f3a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4700d1290 0x7fc4700b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:24.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.325+0000 7fc474f3a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc47015e3c0 0x7fc470151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:24.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.325+0000 7fc474f3a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4701601f0 0x7fc47015c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:24.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.325+0000 7fc474f3a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4700b7290 con 0x7fc4701601f0 2023-08-25T04:19:24.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.325+0000 7fc474f3a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4701f5590 con 0x7fc4700d1290 2023-08-25T04:19:24.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.325+0000 7fc474f3a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4701f5870 con 0x7fc47015e3c0 2023-08-25T04:19:24.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.329+0000 7fc46ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4701601f0 0x7fc47015c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:24.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.329+0000 7fc46ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4701601f0 0x7fc47015c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58708/0 (socket says 172.21.15.55:58708) 2023-08-25T04:19:24.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.329+0000 7fc467fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc47015e3c0 0x7fc470151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:24.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.329+0000 7fc46ed9d640 1 -- 172.21.15.55:0/1783683627 learned_addr learned my addr 172.21.15.55:0/1783683627 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:24.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.329+0000 7fc46e59c640 1 --2- 172.21.15.55:0/1783683627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4700d1290 0x7fc4700b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:24.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.329+0000 7fc46ed9d640 1 -- 172.21.15.55:0/1783683627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc47015e3c0 msgr2=0x7fc470151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:24.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.329+0000 7fc46ed9d640 1 --2- 172.21.15.55:0/1783683627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc47015e3c0 0x7fc470151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.329+0000 7fc46ed9d640 1 -- 172.21.15.55:0/1783683627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4700d1290 msgr2=0x7fc4700b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:24.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.329+0000 7fc46ed9d640 1 --2- 172.21.15.55:0/1783683627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4700d1290 0x7fc4700b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.329+0000 7fc46ed9d640 1 -- 172.21.15.55:0/1783683627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc468009b30 con 0x7fc4701601f0 2023-08-25T04:19:24.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.329+0000 7fc46ed9d640 1 --2- 172.21.15.55:0/1783683627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4701601f0 0x7fc47015c820 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fc4680af040 tx=0x7fc468019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:24.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.329+0000 7fc466ffd640 1 -- 172.21.15.55:0/1783683627 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4680b8670 con 0x7fc4701601f0 2023-08-25T04:19:24.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.329+0000 7fc466ffd640 1 -- 172.21.15.55:0/1783683627 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4680b87f0 con 0x7fc4701601f0 2023-08-25T04:19:24.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.329+0000 7fc474f3a640 1 -- 172.21.15.55:0/1783683627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4700ce7c0 con 0x7fc4701601f0 2023-08-25T04:19:24.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.329+0000 7fc466ffd640 1 -- 172.21.15.55:0/1783683627 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4680b8ba0 con 0x7fc4701601f0 2023-08-25T04:19:24.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.329+0000 7fc474f3a640 1 -- 172.21.15.55:0/1783683627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4701f5e30 con 0x7fc4701601f0 2023-08-25T04:19:24.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.329+0000 7fc464ff9640 1 -- 172.21.15.55:0/1783683627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc448005260 con 0x7fc4701601f0 2023-08-25T04:19:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.329+0000 7fc466ffd640 1 -- 172.21.15.55:0/1783683627 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 42) v1 ==== 85065+0+0 (secure 0 0 0) 0x7fc4680b8d00 con 0x7fc4701601f0 2023-08-25T04:19:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.333+0000 7fc466ffd640 1 --2- 172.21.15.55:0/1783683627 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fc450065770 0x7fc450067c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.333+0000 7fc466ffd640 1 -- 172.21.15.55:0/1783683627 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fc46811e4e0 con 0x7fc4701601f0 2023-08-25T04:19:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.333+0000 7fc46e59c640 1 -- 172.21.15.55:0/1783683627 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fc450065770 msgr2=0x7fc450067c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3580388085 2023-08-25T04:19:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.333+0000 7fc46e59c640 1 --2- 172.21.15.55:0/1783683627 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fc450065770 0x7fc450067c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:19:24.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.337+0000 7fc466ffd640 1 -- 172.21.15.55:0/1783683627 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc4680ebd40 con 0x7fc4701601f0 2023-08-25T04:19:24.368 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:24.364+0000 7fd1157d4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:19:24.401 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:24.401+0000 7f151a07d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:19:24.427 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:24.424+0000 7fd1157d4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:19:24.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.445+0000 7fc466ffd640 1 -- 172.21.15.55:0/1783683627 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 43) v1 ==== 84673+0+0 (secure 0 0 0) 0x7fc4680ec110 con 0x7fc4701601f0 2023-08-25T04:19:24.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.445+0000 7fc466ffd640 1 -- 172.21.15.55:0/1783683627 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fc450065770 msgr2=0x7fc450067c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:19:24.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.445+0000 7fc466ffd640 1 --2- 172.21.15.55:0/1783683627 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fc450065770 0x7fc450067c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.505+0000 7fc464ff9640 1 -- 172.21.15.55:0/1783683627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc448005a90 con 0x7fc4701601f0 2023-08-25T04:19:24.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.505+0000 7fc466ffd640 1 -- 172.21.15.55:0/1783683627 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc4680f08f0 con 0x7fc4701601f0 2023-08-25T04:19:24.505 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:19:24.506 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:24.500+0000 7fd09d604640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:24.506 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:24.500+0000 7fd09d604640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:24.508 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:24.500+0000 7fd09d604640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:24.508 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:24.500+0000 7fd09d604640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:24.508 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:24.500+0000 7fd09d604640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:24.509 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:24.504+0000 7fd0a1e0d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:24.509 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:24.504+0000 7fd0a1e0d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:24.509 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:24.504+0000 7fd0a1e0d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:24.511 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:24.504+0000 7fd0a1e0d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:24.511 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:24.504+0000 7fd0a1e0d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.505+0000 7fc464ff9640 1 -- 172.21.15.55:0/1783683627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4701601f0 msgr2=0x7fc47015c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.505+0000 7fc464ff9640 1 --2- 172.21.15.55:0/1783683627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4701601f0 0x7fc47015c820 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fc4680af040 tx=0x7fc468019740 comp rx=0 tx=0).stop 2023-08-25T04:19:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.505+0000 7fc464ff9640 1 -- 172.21.15.55:0/1783683627 shutdown_connections 2023-08-25T04:19:24.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.505+0000 7fc464ff9640 1 --2- 172.21.15.55:0/1783683627 >> [v2:172.21.15.110:6832/3580388085,v1:172.21.15.110:6833/3580388085] conn(0x7fc450065770 0x7fc450067c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.505+0000 7fc464ff9640 1 --2- 172.21.15.55:0/1783683627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4701601f0 0x7fc47015c820 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.505+0000 7fc464ff9640 1 --2- 172.21.15.55:0/1783683627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc47015e3c0 0x7fc470151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.505+0000 7fc464ff9640 1 --2- 172.21.15.55:0/1783683627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4700d1290 0x7fc4700b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.505+0000 7fc464ff9640 1 -- 172.21.15.55:0/1783683627 >> 172.21.15.55:0/1783683627 conn(0x7fc4700d27d0 msgr2=0x7fc4700cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.505+0000 7fc464ff9640 1 -- 172.21.15.55:0/1783683627 shutdown_connections 2023-08-25T04:19:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.505+0000 7fc464ff9640 1 -- 172.21.15.55:0/1783683627 wait complete. 2023-08-25T04:19:24.531 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:19:24.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.677+0000 7f172bb1e640 1 Processor -- start 2023-08-25T04:19:24.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.681+0000 7f172bb1e640 1 -- start start 2023-08-25T04:19:24.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.681+0000 7f172bb1e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f172415d430 0x7f17241679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:24.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.681+0000 7f172bb1e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172415f8b0 con 0x7f17241601f0 2023-08-25T04:19:24.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.681+0000 7f172bb1e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17240cd5a0 con 0x7f172415e3c0 2023-08-25T04:19:24.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.681+0000 7f172bb1e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17240cd880 con 0x7f172415d430 2023-08-25T04:19:24.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.681+0000 7f17298ba640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f17241601f0 0x7f17240d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54196/0 (socket says 172.21.15.55:54196) 2023-08-25T04:19:24.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.681+0000 7f17298ba640 1 -- 172.21.15.55:0/1270169560 learned_addr learned my addr 172.21.15.55:0/1270169560 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.681+0000 7f172a0bb640 1 --2- 172.21.15.55:0/1270169560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f172415d430 0x7f17241679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.681+0000 7f17288b8640 1 -- 172.21.15.55:0/1270169560 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006903997 0 0) 0x7f172415f8b0 con 0x7f17241601f0 2023-08-25T04:19:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.681+0000 7f17288b8640 1 -- 172.21.15.55:0/1270169560 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1710003530 con 0x7f17241601f0 2023-08-25T04:19:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.681+0000 7f172a0bb640 1 -- 172.21.15.55:0/1270169560 >> v1:172.21.15.110:6789/0 conn(0x7f172415e3c0 legacy=0x7f17240d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.681+0000 7f172a0bb640 1 -- 172.21.15.55:0/1270169560 >> v1:172.21.15.55:6789/0 conn(0x7f17241601f0 legacy=0x7f17240d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.681+0000 7f172a0bb640 1 -- 172.21.15.55:0/1270169560 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17240cdb60 con 0x7f172415d430 2023-08-25T04:19:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.685+0000 7f172a0bb640 1 --2- 172.21.15.55:0/1270169560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f172415d430 0x7f17241679e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f171c009df0 tx=0x7f171c01f160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efbef95206cccfc2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.689+0000 7f17288b8640 1 -- 172.21.15.55:0/1270169560 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c0af600 con 0x7f172415d430 2023-08-25T04:19:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.689+0000 7f17288b8640 1 -- 172.21.15.55:0/1270169560 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c0ab050 con 0x7f172415d430 2023-08-25T04:19:24.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.689+0000 7f17288b8640 1 -- 172.21.15.55:0/1270169560 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c0af980 con 0x7f172415d430 2023-08-25T04:19:24.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.689+0000 7f172bb1e640 1 -- 172.21.15.55:0/1270169560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f172415d430 msgr2=0x7f17241679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:24.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.689+0000 7f172bb1e640 1 --2- 172.21.15.55:0/1270169560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f172415d430 0x7f17241679e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f171c009df0 tx=0x7f171c01f160 comp rx=0 tx=0).stop 2023-08-25T04:19:24.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.689+0000 7f172bb1e640 1 -- 172.21.15.55:0/1270169560 shutdown_connections 2023-08-25T04:19:24.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.689+0000 7f172bb1e640 1 --2- 172.21.15.55:0/1270169560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f172415d430 0x7f17241679e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.689+0000 7f172bb1e640 1 -- 172.21.15.55:0/1270169560 >> 172.21.15.55:0/1270169560 conn(0x7f17240d27d0 msgr2=0x7f17240d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:24.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.689+0000 7f172bb1e640 1 -- 172.21.15.55:0/1270169560 shutdown_connections 2023-08-25T04:19:24.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.689+0000 7f172bb1e640 1 -- 172.21.15.55:0/1270169560 wait complete. 2023-08-25T04:19:24.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f172bb1e640 1 Processor -- start 2023-08-25T04:19:24.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f172bb1e640 1 -- start start 2023-08-25T04:19:24.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f172bb1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f172415d430 0x7f17241f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:24.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f172bb1e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f172415e3c0 0x7f17240c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:24.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f172bb1e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17241601f0 0x7f17240b7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:24.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f172bb1e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17240c83c0 con 0x7f172415d430 2023-08-25T04:19:24.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f172bb1e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17241f2340 con 0x7f17241601f0 2023-08-25T04:19:24.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f172bb1e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17240c7740 con 0x7f172415e3c0 2023-08-25T04:19:24.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f17298ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f172415d430 0x7f17241f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:24.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f17290b9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f172415e3c0 0x7f17240c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:24.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f172a0bb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17241601f0 0x7f17240b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:24.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f17298ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f172415d430 0x7f17241f1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58716/0 (socket says 172.21.15.55:58716) 2023-08-25T04:19:24.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f17290b9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f172415e3c0 0x7f17240c6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:36624/0 (socket says 172.21.15.55:36624) 2023-08-25T04:19:24.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f17298ba640 1 -- 172.21.15.55:0/2394257330 learned_addr learned my addr 172.21.15.55:0/2394257330 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:24.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f17290b9640 1 -- 172.21.15.55:0/2394257330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17241601f0 msgr2=0x7f17240b7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:24.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f17290b9640 1 --2- 172.21.15.55:0/2394257330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17241601f0 0x7f17240b7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f17290b9640 1 -- 172.21.15.55:0/2394257330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f172415d430 msgr2=0x7f17241f1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:24.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f17290b9640 1 --2- 172.21.15.55:0/2394257330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f172415d430 0x7f17241f1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f17290b9640 1 -- 172.21.15.55:0/2394257330 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c009a70 con 0x7f172415e3c0 2023-08-25T04:19:24.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f17290b9640 1 --2- 172.21.15.55:0/2394257330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f172415e3c0 0x7f17240c6c80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1714000f70 tx=0x7f171400c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:24.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f171a7fc640 1 -- 172.21.15.55:0/2394257330 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17140052d0 con 0x7f172415e3c0 2023-08-25T04:19:24.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f171a7fc640 1 -- 172.21.15.55:0/2394257330 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1714005430 con 0x7f172415e3c0 2023-08-25T04:19:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f172bb1e640 1 -- 172.21.15.55:0/2394257330 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17240c7a20 con 0x7f172415e3c0 2023-08-25T04:19:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.693+0000 7f171a7fc640 1 -- 172.21.15.55:0/2394257330 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1714003840 con 0x7f172415e3c0 2023-08-25T04:19:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.697+0000 7f172bb1e640 1 -- 172.21.15.55:0/2394257330 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17240c7fe0 con 0x7f172415e3c0 2023-08-25T04:19:24.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.697+0000 7f172bb1e640 1 -- 172.21.15.55:0/2394257330 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17241f2500 con 0x7f172415e3c0 2023-08-25T04:19:24.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.697+0000 7f171a7fc640 1 -- 172.21.15.55:0/2394257330 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 43) v1 ==== 84673+0+0 (secure 0 0 0) 0x7f17140039a0 con 0x7f172415e3c0 2023-08-25T04:19:24.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.697+0000 7f171a7fc640 1 -- 172.21.15.55:0/2394257330 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f1714082130 con 0x7f172415e3c0 2023-08-25T04:19:24.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.701+0000 7f171a7fc640 1 -- 172.21.15.55:0/2394257330 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f171404fd50 con 0x7f172415e3c0 2023-08-25T04:19:24.746 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:24.745+0000 7f151a07d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:19:24.810 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:24.809+0000 7f151a07d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:19:24.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.897+0000 7f172bb1e640 1 -- 172.21.15.55:0/2394257330 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f17240b5260 con 0x7f172415e3c0 2023-08-25T04:19:24.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.897+0000 7f171a7fc640 1 -- 172.21.15.55:0/2394257330 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v95) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1714053370 con 0x7f172415e3c0 2023-08-25T04:19:24.897 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:19:24.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.897+0000 7f172bb1e640 1 -- 172.21.15.55:0/2394257330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f172415e3c0 msgr2=0x7f17240c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:24.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.897+0000 7f172bb1e640 1 --2- 172.21.15.55:0/2394257330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f172415e3c0 0x7f17240c6c80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1714000f70 tx=0x7f171400c890 comp rx=0 tx=0).stop 2023-08-25T04:19:24.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.897+0000 7f172bb1e640 1 -- 172.21.15.55:0/2394257330 shutdown_connections 2023-08-25T04:19:24.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.897+0000 7f172bb1e640 1 --2- 172.21.15.55:0/2394257330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17241601f0 0x7f17240b7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.897+0000 7f172bb1e640 1 --2- 172.21.15.55:0/2394257330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f172415e3c0 0x7f17240c6c80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.897+0000 7f172bb1e640 1 --2- 172.21.15.55:0/2394257330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f172415d430 0x7f17241f1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:24.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.897+0000 7f172bb1e640 1 -- 172.21.15.55:0/2394257330 >> 172.21.15.55:0/2394257330 conn(0x7f17240d27d0 msgr2=0x7f172406c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:24.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.897+0000 7f172bb1e640 1 -- 172.21.15.55:0/2394257330 shutdown_connections 2023-08-25T04:19:24.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:24.897+0000 7f172bb1e640 1 -- 172.21.15.55:0/2394257330 wait complete. 2023-08-25T04:19:24.918 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:19:25.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.065+0000 7f2b0ea88640 1 Processor -- start 2023-08-25T04:19:25.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.065+0000 7f2b0ea88640 1 -- start start 2023-08-25T04:19:25.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.065+0000 7f2b0ea88640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2b0806ce30 0x7f2b080cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.065+0000 7f2b0ea88640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b080c9d90 con 0x7f2b080c9900 2023-08-25T04:19:25.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.065+0000 7f2b0ea88640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b080cbca0 con 0x7f2b080cb020 2023-08-25T04:19:25.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.065+0000 7f2b0ea88640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b080c9470 con 0x7f2b0806ce30 2023-08-25T04:19:25.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b07fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2b080c9900 0x7f2b0806c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54198/0 (socket says 172.21.15.55:54198) 2023-08-25T04:19:25.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b07fff640 1 -- 172.21.15.55:0/4038058331 learned_addr learned my addr 172.21.15.55:0/4038058331 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:25.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b0d025640 1 --2- 172.21.15.55:0/4038058331 >> v2:172.21.15.110:3300/0 conn(0x7f2b0806ce30 0x7f2b080cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b077fe640 1 -- 172.21.15.55:0/4038058331 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19889274 0 0) 0x7f2b080c9d90 con 0x7f2b080c9900 2023-08-25T04:19:25.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b077fe640 1 -- 172.21.15.55:0/4038058331 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2af8005740 con 0x7f2b080c9900 2023-08-25T04:19:25.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b077fe640 1 -- 172.21.15.55:0/4038058331 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3362224059 0 0) 0x7f2af8005740 con 0x7f2b080c9900 2023-08-25T04:19:25.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b077fe640 1 -- 172.21.15.55:0/4038058331 >> v2:172.21.15.110:3300/0 conn(0x7f2b0806ce30 msgr2=0x7f2b080cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:25.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b077fe640 1 --2- 172.21.15.55:0/4038058331 >> v2:172.21.15.110:3300/0 conn(0x7f2b0806ce30 0x7f2b080cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b077fe640 1 -- 172.21.15.55:0/4038058331 >> v1:172.21.15.110:6789/0 conn(0x7f2b080cb020 legacy=0x7f2b080cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:25.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b077fe640 1 -- 172.21.15.55:0/4038058331 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b080c8b40 con 0x7f2b080c9900 2023-08-25T04:19:25.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b077fe640 1 -- 172.21.15.55:0/4038058331 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f2af4001680 con 0x7f2b080c9900 2023-08-25T04:19:25.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b0d025640 1 --2- 172.21.15.55:0/4038058331 >> v2:172.21.15.110:3300/0 conn(0x7f2b0806ce30 0x7f2b080cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:25.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b077fe640 1 -- 172.21.15.55:0/4038058331 >> v1:172.21.15.55:6789/0 conn(0x7f2b080c9900 legacy=0x7f2b0806c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:25.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b077fe640 1 --2- 172.21.15.55:0/4038058331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2af8005b90 0x7f2af8005f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b077fe640 1 --2- 172.21.15.55:0/4038058331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2af8006590 0x7f2af8006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b077fe640 1 --2- 172.21.15.55:0/4038058331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2af8007300 0x7f2af800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b077fe640 1 -- 172.21.15.55:0/4038058331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080c9470 con 0x7f2af8006590 2023-08-25T04:19:25.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b077fe640 1 -- 172.21.15.55:0/4038058331 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af800e240 con 0x7f2af8007300 2023-08-25T04:19:25.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b077fe640 1 -- 172.21.15.55:0/4038058331 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af800e400 con 0x7f2af8005b90 2023-08-25T04:19:25.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b07fff640 1 --2- 172.21.15.55:0/4038058331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2af8006590 0x7f2af8006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b0d025640 1 --2- 172.21.15.55:0/4038058331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2af8007300 0x7f2af800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b0c824640 1 --2- 172.21.15.55:0/4038058331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2af8005b90 0x7f2af8005f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b07fff640 1 -- 172.21.15.55:0/4038058331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2af8005b90 msgr2=0x7f2af8005f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:25.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b07fff640 1 --2- 172.21.15.55:0/4038058331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2af8005b90 0x7f2af8005f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b07fff640 1 -- 172.21.15.55:0/4038058331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2af8007300 msgr2=0x7f2af800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:25.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b07fff640 1 --2- 172.21.15.55:0/4038058331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2af8007300 0x7f2af800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b07fff640 1 -- 172.21.15.55:0/4038058331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af8005740 con 0x7f2af8006590 2023-08-25T04:19:25.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b0d025640 1 --2- 172.21.15.55:0/4038058331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2af8007300 0x7f2af800dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:25.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.069+0000 7f2b0d025640 1 -- 172.21.15.55:0/4038058331 reap_dead start 2023-08-25T04:19:25.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.073+0000 7f2b07fff640 1 --2- 172.21.15.55:0/4038058331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2af8006590 0x7f2af8006a60 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f2af400c210 tx=0x7f2af401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f20685b14ccce6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:25.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.073+0000 7f2b077fe640 1 -- 172.21.15.55:0/4038058331 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4005ae0 con 0x7f2af8006590 2023-08-25T04:19:25.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.073+0000 7f2b077fe640 1 -- 172.21.15.55:0/4038058331 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af4005c60 con 0x7f2af8006590 2023-08-25T04:19:25.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.073+0000 7f2b077fe640 1 -- 172.21.15.55:0/4038058331 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af40072b0 con 0x7f2af8006590 2023-08-25T04:19:25.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.073+0000 7f2b0ea88640 1 -- 172.21.15.55:0/4038058331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2af8006590 msgr2=0x7f2af8006a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:25.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.073+0000 7f2b0ea88640 1 --2- 172.21.15.55:0/4038058331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2af8006590 0x7f2af8006a60 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f2af400c210 tx=0x7f2af401cbc0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.073+0000 7f2b0ea88640 1 -- 172.21.15.55:0/4038058331 shutdown_connections 2023-08-25T04:19:25.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.073+0000 7f2b0ea88640 1 --2- 172.21.15.55:0/4038058331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2af8006590 0x7f2af8006a60 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.073+0000 7f2b0ea88640 1 -- 172.21.15.55:0/4038058331 >> 172.21.15.55:0/4038058331 conn(0x7f2b08069900 msgr2=0x7f2b08069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:25.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.073+0000 7f2b0ea88640 1 -- 172.21.15.55:0/4038058331 shutdown_connections 2023-08-25T04:19:25.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.073+0000 7f2b0ea88640 1 -- 172.21.15.55:0/4038058331 wait complete. 2023-08-25T04:19:25.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.073+0000 7f2b0ea88640 1 Processor -- start 2023-08-25T04:19:25.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.073+0000 7f2b0ea88640 1 -- start start 2023-08-25T04:19:25.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0ea88640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2af8006590 0x7f2b081e8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0ea88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b081e8dd0 0x7f2b080b3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0ea88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b080b3760 0x7f2b0815a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0ea88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b081f8fb0 con 0x7f2b080b3760 2023-08-25T04:19:25.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0ea88640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080c5810 con 0x7f2af8006590 2023-08-25T04:19:25.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0ea88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080c5ad0 con 0x7f2b081e8dd0 2023-08-25T04:19:25.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0d025640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b080b3760 0x7f2b0815a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0d025640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b080b3760 0x7f2b0815a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58728/0 (socket says 172.21.15.55:58728) 2023-08-25T04:19:25.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0d025640 1 -- 172.21.15.55:0/2084728094 learned_addr learned my addr 172.21.15.55:0/2084728094 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:25.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b07fff640 1 --2- 172.21.15.55:0/2084728094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b081e8dd0 0x7f2b080b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0c824640 1 --2- 172.21.15.55:0/2084728094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2af8006590 0x7f2b081e8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0d025640 1 -- 172.21.15.55:0/2084728094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b081e8dd0 msgr2=0x7f2b080b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:25.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0d025640 1 --2- 172.21.15.55:0/2084728094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b081e8dd0 0x7f2b080b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0d025640 1 -- 172.21.15.55:0/2084728094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2af8006590 msgr2=0x7f2b081e8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:25.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0d025640 1 --2- 172.21.15.55:0/2084728094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2af8006590 0x7f2b081e8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0d025640 1 -- 172.21.15.55:0/2084728094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b080c5db0 con 0x7f2b080b3760 2023-08-25T04:19:25.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0d025640 1 --2- 172.21.15.55:0/2084728094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b080b3760 0x7f2b0815a470 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f2b0806def0 tx=0x7f2b0000f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:25.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b057fa640 1 -- 172.21.15.55:0/2084728094 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0000e040 con 0x7f2b080b3760 2023-08-25T04:19:25.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b057fa640 1 -- 172.21.15.55:0/2084728094 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0000f040 con 0x7f2b080b3760 2023-08-25T04:19:25.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b057fa640 1 -- 172.21.15.55:0/2084728094 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b00003dc0 con 0x7f2b080b3760 2023-08-25T04:19:25.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0ea88640 1 -- 172.21.15.55:0/2084728094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b080c6090 con 0x7f2b080b3760 2023-08-25T04:19:25.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0ea88640 1 -- 172.21.15.55:0/2084728094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0815a9b0 con 0x7f2b080b3760 2023-08-25T04:19:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b0ea88640 1 -- 172.21.15.55:0/2084728094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b081f9120 con 0x7f2b080b3760 2023-08-25T04:19:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.077+0000 7f2b057fa640 1 -- 172.21.15.55:0/2084728094 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 43) v1 ==== 84673+0+0 (secure 0 0 0) 0x7f2b00004030 con 0x7f2b080b3760 2023-08-25T04:19:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.081+0000 7f2b057fa640 1 -- 172.21.15.55:0/2084728094 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f2b00083640 con 0x7f2b080b3760 2023-08-25T04:19:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.085+0000 7f2b057fa640 1 -- 172.21.15.55:0/2084728094 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2b00051260 con 0x7f2b080b3760 2023-08-25T04:19:25.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.241+0000 7f2b0ea88640 1 -- 172.21.15.55:0/2084728094 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2b08073ec0 con 0x7f2b080b3760 2023-08-25T04:19:25.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.241+0000 7f2b057fa640 1 -- 172.21.15.55:0/2084728094 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2b00054880 con 0x7f2b080b3760 2023-08-25T04:19:25.242 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:19:25.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.245+0000 7f2b0ea88640 1 -- 172.21.15.55:0/2084728094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b080b3760 msgr2=0x7f2b0815a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:25.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.245+0000 7f2b0ea88640 1 --2- 172.21.15.55:0/2084728094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b080b3760 0x7f2b0815a470 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f2b0806def0 tx=0x7f2b0000f870 comp rx=0 tx=0).stop 2023-08-25T04:19:25.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.245+0000 7f2b0ea88640 1 -- 172.21.15.55:0/2084728094 shutdown_connections 2023-08-25T04:19:25.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.245+0000 7f2b0ea88640 1 --2- 172.21.15.55:0/2084728094 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b080b3760 0x7f2b0815a470 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.245+0000 7f2b0ea88640 1 --2- 172.21.15.55:0/2084728094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b081e8dd0 0x7f2b080b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.245+0000 7f2b0ea88640 1 --2- 172.21.15.55:0/2084728094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2af8006590 0x7f2b081e8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.245+0000 7f2b0ea88640 1 -- 172.21.15.55:0/2084728094 >> 172.21.15.55:0/2084728094 conn(0x7f2b08069900 msgr2=0x7f2b080ac740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:25.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.245+0000 7f2b0ea88640 1 -- 172.21.15.55:0/2084728094 shutdown_connections 2023-08-25T04:19:25.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.245+0000 7f2b0ea88640 1 -- 172.21.15.55:0/2084728094 wait complete. 2023-08-25T04:19:25.262 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:19:25.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.409+0000 7fd4163e9640 1 Processor -- start 2023-08-25T04:19:25.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.409+0000 7fd4163e9640 1 -- start start 2023-08-25T04:19:25.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.409+0000 7fd4163e9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd41015a7f0 0x7fd41009bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.409+0000 7fd4163e9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd4100c9830 0x7fd410070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.409+0000 7fd4163e9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41015abd0 con 0x7fd41006c020 2023-08-25T04:19:25.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.409+0000 7fd4163e9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4100c8ab0 con 0x7fd41015a7f0 2023-08-25T04:19:25.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.409+0000 7fd4163e9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4100c8d50 con 0x7fd4100c9830 2023-08-25T04:19:25.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.413+0000 7fd40ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd41015a7f0 0x7fd41009bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.413+0000 7fd414986640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd41006c020 0x7fd4100acff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54206/0 (socket says 172.21.15.55:54206) 2023-08-25T04:19:25.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.413+0000 7fd414986640 1 -- 172.21.15.55:0/2241957427 learned_addr learned my addr 172.21.15.55:0/2241957427 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:25.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.413+0000 7fd40f7fe640 1 --2- 172.21.15.55:0/2241957427 >> v2:172.21.15.110:3300/0 conn(0x7fd4100c9830 0x7fd410070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.413+0000 7fd40effd640 1 -- 172.21.15.55:0/2241957427 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350597439 0 0) 0x7fd41015abd0 con 0x7fd41006c020 2023-08-25T04:19:25.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.413+0000 7fd40effd640 1 -- 172.21.15.55:0/2241957427 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3f8003530 con 0x7fd41006c020 2023-08-25T04:19:25.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.413+0000 7fd40ffff640 1 -- 172.21.15.55:0/2241957427 >> v2:172.21.15.110:3300/0 conn(0x7fd4100c9830 msgr2=0x7fd410070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:25.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.413+0000 7fd40ffff640 1 --2- 172.21.15.55:0/2241957427 >> v2:172.21.15.110:3300/0 conn(0x7fd4100c9830 0x7fd410070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.413+0000 7fd40ffff640 1 -- 172.21.15.55:0/2241957427 >> v1:172.21.15.55:6789/0 conn(0x7fd41006c020 legacy=0x7fd4100acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:25.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.413+0000 7fd40ffff640 1 -- 172.21.15.55:0/2241957427 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4100c9030 con 0x7fd41015a7f0 2023-08-25T04:19:25.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.413+0000 7fd40ffff640 1 --2- 172.21.15.55:0/2241957427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd41015a7f0 0x7fd41009bde0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fd41006d740 tx=0x7fd40001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1b3447f7a16506 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:25.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.413+0000 7fd40effd640 1 -- 172.21.15.55:0/2241957427 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4000a7070 con 0x7fd41015a7f0 2023-08-25T04:19:25.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd40effd640 1 -- 172.21.15.55:0/2241957427 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4000ab430 con 0x7fd41015a7f0 2023-08-25T04:19:25.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd40effd640 1 -- 172.21.15.55:0/2241957427 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4000ab7c0 con 0x7fd41015a7f0 2023-08-25T04:19:25.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd4163e9640 1 -- 172.21.15.55:0/2241957427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd41015a7f0 msgr2=0x7fd41009bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:25.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd4163e9640 1 --2- 172.21.15.55:0/2241957427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd41015a7f0 0x7fd41009bde0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fd41006d740 tx=0x7fd40001c410 comp rx=0 tx=0).stop 2023-08-25T04:19:25.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd4163e9640 1 -- 172.21.15.55:0/2241957427 shutdown_connections 2023-08-25T04:19:25.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd4163e9640 1 --2- 172.21.15.55:0/2241957427 >> v2:172.21.15.110:3300/0 conn(0x7fd4100c9830 0x7fd410070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd4163e9640 1 --2- 172.21.15.55:0/2241957427 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd41015a7f0 0x7fd41009bde0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd4163e9640 1 -- 172.21.15.55:0/2241957427 >> 172.21.15.55:0/2241957427 conn(0x7fd410069900 msgr2=0x7fd410069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:25.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd4163e9640 1 -- 172.21.15.55:0/2241957427 shutdown_connections 2023-08-25T04:19:25.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd4163e9640 1 -- 172.21.15.55:0/2241957427 wait complete. 2023-08-25T04:19:25.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd4163e9640 1 Processor -- start 2023-08-25T04:19:25.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd4163e9640 1 -- start start 2023-08-25T04:19:25.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd4163e9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd41006c020 0x7fd410153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd4163e9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4100c9830 0x7fd410159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd4163e9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd41015a7f0 0x7fd410159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd4163e9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4100c6d30 con 0x7fd4100c9830 2023-08-25T04:19:25.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd4163e9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4100c7010 con 0x7fd41006c020 2023-08-25T04:19:25.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd4163e9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4100c72f0 con 0x7fd41015a7f0 2023-08-25T04:19:25.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd40f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4100c9830 0x7fd410159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd40f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4100c9830 0x7fd410159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58746/0 (socket says 172.21.15.55:58746) 2023-08-25T04:19:25.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.417+0000 7fd40f7fe640 1 -- 172.21.15.55:0/3670192839 learned_addr learned my addr 172.21.15.55:0/3670192839 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:25.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.421+0000 7fd414986640 1 --2- 172.21.15.55:0/3670192839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd41015a7f0 0x7fd410159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.421+0000 7fd40ffff640 1 --2- 172.21.15.55:0/3670192839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd41006c020 0x7fd410153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.421+0000 7fd40f7fe640 1 -- 172.21.15.55:0/3670192839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd41015a7f0 msgr2=0x7fd410159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:25.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.421+0000 7fd40f7fe640 1 --2- 172.21.15.55:0/3670192839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd41015a7f0 0x7fd410159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.421+0000 7fd40f7fe640 1 -- 172.21.15.55:0/3670192839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd41006c020 msgr2=0x7fd410153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:25.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.421+0000 7fd40f7fe640 1 --2- 172.21.15.55:0/3670192839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd41006c020 0x7fd410153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.421+0000 7fd40f7fe640 1 -- 172.21.15.55:0/3670192839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4000093b0 con 0x7fd4100c9830 2023-08-25T04:19:25.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.421+0000 7fd40ffff640 1 --2- 172.21.15.55:0/3670192839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd41006c020 0x7fd410153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:19:25.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.421+0000 7fd414986640 1 --2- 172.21.15.55:0/3670192839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd41015a7f0 0x7fd410159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:19:25.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.421+0000 7fd40f7fe640 1 --2- 172.21.15.55:0/3670192839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4100c9830 0x7fd410159710 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fd40400e900 tx=0x7fd40400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:25.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.421+0000 7fd40cff9640 1 -- 172.21.15.55:0/3670192839 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd404009690 con 0x7fd4100c9830 2023-08-25T04:19:25.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.421+0000 7fd40cff9640 1 -- 172.21.15.55:0/3670192839 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40400ca00 con 0x7fd4100c9830 2023-08-25T04:19:25.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.421+0000 7fd40cff9640 1 -- 172.21.15.55:0/3670192839 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40400cdb0 con 0x7fd4100c9830 2023-08-25T04:19:25.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.421+0000 7fd4163e9640 1 -- 172.21.15.55:0/3670192839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4100adc90 con 0x7fd4100c9830 2023-08-25T04:19:25.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.421+0000 7fd4163e9640 1 -- 172.21.15.55:0/3670192839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4100c78b0 con 0x7fd4100c9830 2023-08-25T04:19:25.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.421+0000 7fd4163e9640 1 -- 172.21.15.55:0/3670192839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4100c7a70 con 0x7fd4100c9830 2023-08-25T04:19:25.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.421+0000 7fd40cff9640 1 -- 172.21.15.55:0/3670192839 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 43) v1 ==== 84673+0+0 (secure 0 0 0) 0x7fd404013470 con 0x7fd4100c9830 2023-08-25T04:19:25.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.421+0000 7fd40cff9640 1 -- 172.21.15.55:0/3670192839 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fd404082eb0 con 0x7fd4100c9830 2023-08-25T04:19:25.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.425+0000 7fd40cff9640 1 -- 172.21.15.55:0/3670192839 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd404050a20 con 0x7fd4100c9830 2023-08-25T04:19:25.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.449+0000 7fd40cff9640 1 -- 172.21.15.55:0/3670192839 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 44) v1 ==== 84800+0+0 (secure 0 0 0) 0x7fd4040504d0 con 0x7fd4100c9830 2023-08-25T04:19:25.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.449+0000 7fd40cff9640 1 --2- 172.21.15.55:0/3670192839 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd3fc06b440 0x7fd3fc06d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.453+0000 7fd40ffff640 1 --2- 172.21.15.55:0/3670192839 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd3fc06b440 0x7fd3fc06d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.453+0000 7fd40ffff640 1 --2- 172.21.15.55:0/3670192839 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd3fc06b440 0x7fd3fc06d830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd4000af000 tx=0x7fd400008040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:25.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.593+0000 7fd4163e9640 1 -- 172.21.15.55:0/3670192839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd41006d5b0 con 0x7fd4100c9830 2023-08-25T04:19:25.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.593+0000 7fd40cff9640 1 -- 172.21.15.55:0/3670192839 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd40407fc70 con 0x7fd4100c9830 2023-08-25T04:19:25.593 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:19:25.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.593+0000 7fd4163e9640 1 -- 172.21.15.55:0/3670192839 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd3fc06b440 msgr2=0x7fd3fc06d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:25.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.593+0000 7fd4163e9640 1 --2- 172.21.15.55:0/3670192839 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd3fc06b440 0x7fd3fc06d830 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd4000af000 tx=0x7fd400008040 comp rx=0 tx=0).stop 2023-08-25T04:19:25.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.593+0000 7fd4163e9640 1 -- 172.21.15.55:0/3670192839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4100c9830 msgr2=0x7fd410159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:25.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.593+0000 7fd4163e9640 1 --2- 172.21.15.55:0/3670192839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4100c9830 0x7fd410159710 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fd40400e900 tx=0x7fd40400edc0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.593+0000 7fd4163e9640 1 -- 172.21.15.55:0/3670192839 shutdown_connections 2023-08-25T04:19:25.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.593+0000 7fd4163e9640 1 --2- 172.21.15.55:0/3670192839 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd3fc06b440 0x7fd3fc06d830 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.593+0000 7fd4163e9640 1 --2- 172.21.15.55:0/3670192839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd41015a7f0 0x7fd410159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.593+0000 7fd4163e9640 1 --2- 172.21.15.55:0/3670192839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4100c9830 0x7fd410159710 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.593+0000 7fd4163e9640 1 --2- 172.21.15.55:0/3670192839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd41006c020 0x7fd410153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.593+0000 7fd4163e9640 1 -- 172.21.15.55:0/3670192839 >> 172.21.15.55:0/3670192839 conn(0x7fd410069900 msgr2=0x7fd410069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:25.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.593+0000 7fd4163e9640 1 -- 172.21.15.55:0/3670192839 shutdown_connections 2023-08-25T04:19:25.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.593+0000 7fd4163e9640 1 -- 172.21.15.55:0/3670192839 wait complete. 2023-08-25T04:19:25.613 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:19:25.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.761+0000 7f6900e3c640 1 Processor -- start 2023-08-25T04:19:25.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.761+0000 7f6900e3c640 1 -- start start 2023-08-25T04:19:25.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.761+0000 7f6900e3c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68fc15ca50 0x7f68fc0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.761+0000 7f6900e3c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68fc0d0f50 0x7f68fc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.761+0000 7f6900e3c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68fc0afe20 con 0x7f68fc06c150 2023-08-25T04:19:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.761+0000 7f6900e3c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68fc0d13d0 con 0x7f68fc15ca50 2023-08-25T04:19:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.761+0000 7f6900e3c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc0af210 con 0x7f68fc0d0f50 2023-08-25T04:19:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.761+0000 7f68fb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68fc15ca50 0x7f68fc0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.761+0000 7f68fb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68fc15ca50 0x7f68fc0d0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58762/0 (socket says 172.21.15.55:58762) 2023-08-25T04:19:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.761+0000 7f68fb7fe640 1 -- 172.21.15.55:0/3184945132 learned_addr learned my addr 172.21.15.55:0/3184945132 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.761+0000 7f68faffd640 1 --2- 172.21.15.55:0/3184945132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68fc0d0f50 0x7f68fc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.761+0000 7f68fb7fe640 1 -- 172.21.15.55:0/3184945132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68fc0d0f50 msgr2=0x7f68fc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.761+0000 7f68fb7fe640 1 --2- 172.21.15.55:0/3184945132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68fc0d0f50 0x7f68fc06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.761+0000 7f68fb7fe640 1 -- 172.21.15.55:0/3184945132 >> v1:172.21.15.55:6789/0 conn(0x7f68fc06c150 legacy=0x7f68fc0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.761+0000 7f68fb7fe640 1 -- 172.21.15.55:0/3184945132 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc0af4f0 con 0x7f68fc15ca50 2023-08-25T04:19:25.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.765+0000 7f68fb7fe640 1 --2- 172.21.15.55:0/3184945132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68fc15ca50 0x7f68fc0d0a10 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f68ec006fd0 tx=0x7f68ec01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b793982e178c50ca server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:25.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.765+0000 7f68fa7fc640 1 -- 172.21.15.55:0/3184945132 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec0aa650 con 0x7f68fc15ca50 2023-08-25T04:19:25.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.765+0000 7f68fa7fc640 1 -- 172.21.15.55:0/3184945132 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec0aa7b0 con 0x7f68fc15ca50 2023-08-25T04:19:25.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.765+0000 7f68fa7fc640 1 -- 172.21.15.55:0/3184945132 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec0aab40 con 0x7f68fc15ca50 2023-08-25T04:19:25.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.765+0000 7f6900e3c640 1 -- 172.21.15.55:0/3184945132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68fc15ca50 msgr2=0x7f68fc0d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:25.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.765+0000 7f6900e3c640 1 --2- 172.21.15.55:0/3184945132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68fc15ca50 0x7f68fc0d0a10 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f68ec006fd0 tx=0x7f68ec01c4f0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.765+0000 7f6900e3c640 1 -- 172.21.15.55:0/3184945132 shutdown_connections 2023-08-25T04:19:25.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.765+0000 7f6900e3c640 1 --2- 172.21.15.55:0/3184945132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68fc0d0f50 0x7f68fc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.765+0000 7f6900e3c640 1 --2- 172.21.15.55:0/3184945132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68fc15ca50 0x7f68fc0d0a10 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.765+0000 7f6900e3c640 1 -- 172.21.15.55:0/3184945132 >> 172.21.15.55:0/3184945132 conn(0x7f68fc065f40 msgr2=0x7f68fc09b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:25.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.765+0000 7f6900e3c640 1 -- 172.21.15.55:0/3184945132 shutdown_connections 2023-08-25T04:19:25.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.765+0000 7f6900e3c640 1 -- 172.21.15.55:0/3184945132 wait complete. 2023-08-25T04:19:25.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f6900e3c640 1 Processor -- start 2023-08-25T04:19:25.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f6900e3c640 1 -- start start 2023-08-25T04:19:25.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f6900e3c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68fc06c150 0x7f68fc15bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f6900e3c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68fc0d0f50 0x7f68fc14a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f6900e3c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68fc15ca50 0x7f68fc0b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f6900e3c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc15c330 con 0x7f68fc15ca50 2023-08-25T04:19:25.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f6900e3c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc15a0e0 con 0x7f68fc0d0f50 2023-08-25T04:19:25.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f6900e3c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc14a8c0 con 0x7f68fc06c150 2023-08-25T04:19:25.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f68fbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68fc15ca50 0x7f68fc0b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f68fbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68fc15ca50 0x7f68fc0b1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58774/0 (socket says 172.21.15.55:58774) 2023-08-25T04:19:25.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f68fbfff640 1 -- 172.21.15.55:0/2897224698 learned_addr learned my addr 172.21.15.55:0/2897224698 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:25.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f68fb7fe640 1 --2- 172.21.15.55:0/2897224698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68fc06c150 0x7f68fc15bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f68faffd640 1 --2- 172.21.15.55:0/2897224698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68fc0d0f50 0x7f68fc14a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f68fbfff640 1 -- 172.21.15.55:0/2897224698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68fc06c150 msgr2=0x7f68fc15bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:25.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f68fbfff640 1 --2- 172.21.15.55:0/2897224698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68fc06c150 0x7f68fc15bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f68fbfff640 1 -- 172.21.15.55:0/2897224698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68fc0d0f50 msgr2=0x7f68fc14a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:25.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f68fbfff640 1 --2- 172.21.15.55:0/2897224698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68fc0d0f50 0x7f68fc14a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f68fbfff640 1 -- 172.21.15.55:0/2897224698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec009480 con 0x7f68fc15ca50 2023-08-25T04:19:25.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f68faffd640 1 --2- 172.21.15.55:0/2897224698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68fc0d0f50 0x7f68fc14a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:25.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f68fbfff640 1 --2- 172.21.15.55:0/2897224698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68fc15ca50 0x7f68fc0b1fa0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f68f400c770 tx=0x7f68f400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:25.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f68e3fff640 1 -- 172.21.15.55:0/2897224698 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f4003b80 con 0x7f68fc15ca50 2023-08-25T04:19:25.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f68e3fff640 1 -- 172.21.15.55:0/2897224698 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f4003ce0 con 0x7f68fc15ca50 2023-08-25T04:19:25.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f68e3fff640 1 -- 172.21.15.55:0/2897224698 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f400aa90 con 0x7f68fc15ca50 2023-08-25T04:19:25.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f6900e3c640 1 -- 172.21.15.55:0/2897224698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68fc0b2920 con 0x7f68fc15ca50 2023-08-25T04:19:25.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f6900e3c640 1 -- 172.21.15.55:0/2897224698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68fc14ab90 con 0x7f68fc15ca50 2023-08-25T04:19:25.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.769+0000 7f6900e3c640 1 -- 172.21.15.55:0/2897224698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68fc073e50 con 0x7f68fc15ca50 2023-08-25T04:19:25.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.773+0000 7f68e3fff640 1 -- 172.21.15.55:0/2897224698 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 44) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f68f400abf0 con 0x7f68fc15ca50 2023-08-25T04:19:25.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.773+0000 7f68e3fff640 1 --2- 172.21.15.55:0/2897224698 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f68e80654d0 0x7f68e8067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:25.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.773+0000 7f68e3fff640 1 -- 172.21.15.55:0/2897224698 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f68f4082b20 con 0x7f68fc15ca50 2023-08-25T04:19:25.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.773+0000 7f68fb7fe640 1 --2- 172.21.15.55:0/2897224698 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f68e80654d0 0x7f68e8067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:25.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.773+0000 7f68fb7fe640 1 --2- 172.21.15.55:0/2897224698 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f68e80654d0 0x7f68e8067990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0ae000 tx=0x7f68ec0a7000 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:25.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.777+0000 7f68e3fff640 1 -- 172.21.15.55:0/2897224698 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f68f40505a0 con 0x7f68fc15ca50 2023-08-25T04:19:25.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.965+0000 7f6900e3c640 1 -- 172.21.15.55:0/2897224698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68fc0c7790 con 0x7f68fc15ca50 2023-08-25T04:19:25.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.965+0000 7f68e3fff640 1 -- 172.21.15.55:0/2897224698 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f68f4053bc0 con 0x7f68fc15ca50 2023-08-25T04:19:25.972 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:25.972 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6311,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/976095252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":976095252},{"type":"v1","addr":"172.21.15.110:6836","nonce":976095252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1364761770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1364761770},{"type":"v1","addr":"172.21.15.110:6837","nonce":1364761770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2491496151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2491496151},{"type":"v1","addr":"172.21.15.55:6834","nonce":2491496151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:19:06.181749+0000","modified":"2023-08-25T04:19:09.803812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7329":{"gid":7329,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3432791477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3432791477},{"type":"v1","addr":"172.21.15.55:6835","nonce":3432791477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-25T04:19:25.973 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 40 2023-08-25T04:19:25.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.969+0000 7f6900e3c640 1 -- 172.21.15.55:0/2897224698 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f68e80654d0 msgr2=0x7f68e8067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:25.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.969+0000 7f6900e3c640 1 --2- 172.21.15.55:0/2897224698 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f68e80654d0 0x7f68e8067990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0ae000 tx=0x7f68ec0a7000 comp rx=0 tx=0).stop 2023-08-25T04:19:25.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.969+0000 7f6900e3c640 1 -- 172.21.15.55:0/2897224698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68fc15ca50 msgr2=0x7f68fc0b1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:25.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.969+0000 7f6900e3c640 1 --2- 172.21.15.55:0/2897224698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68fc15ca50 0x7f68fc0b1fa0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f68f400c770 tx=0x7f68f400cc30 comp rx=0 tx=0).stop 2023-08-25T04:19:25.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.969+0000 7f6900e3c640 1 -- 172.21.15.55:0/2897224698 shutdown_connections 2023-08-25T04:19:25.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.969+0000 7f6900e3c640 1 --2- 172.21.15.55:0/2897224698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68fc15ca50 0x7f68fc0b1fa0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.969+0000 7f6900e3c640 1 --2- 172.21.15.55:0/2897224698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68fc0d0f50 0x7f68fc14a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.969+0000 7f6900e3c640 1 --2- 172.21.15.55:0/2897224698 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f68e80654d0 0x7f68e8067990 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.969+0000 7f6900e3c640 1 --2- 172.21.15.55:0/2897224698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68fc06c150 0x7f68fc15bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:25.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.969+0000 7f6900e3c640 1 -- 172.21.15.55:0/2897224698 >> 172.21.15.55:0/2897224698 conn(0x7f68fc065f40 msgr2=0x7f68fc1593a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:25.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.969+0000 7f6900e3c640 1 -- 172.21.15.55:0/2897224698 shutdown_connections 2023-08-25T04:19:25.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:25.969+0000 7f6900e3c640 1 -- 172.21.15.55:0/2897224698 wait complete. 2023-08-25T04:19:25.989 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:19:26.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.141+0000 7fd47b1ac640 1 Processor -- start 2023-08-25T04:19:26.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.141+0000 7fd47b1ac640 1 -- start start 2023-08-25T04:19:26.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.141+0000 7fd47b1ac640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd4740cddc0 0x7fd4740b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:26.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.141+0000 7fd47b1ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4740ce1a0 0x7fd4740ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:26.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.141+0000 7fd47b1ac640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd474069ba0 con 0x7fd4740caa50 2023-08-25T04:19:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.141+0000 7fd47b1ac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4740ceab0 con 0x7fd4740ce1a0 2023-08-25T04:19:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.141+0000 7fd47b1ac640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd474069900 con 0x7fd4740cddc0 2023-08-25T04:19:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.141+0000 7fd473fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4740ce1a0 0x7fd4740ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.141+0000 7fd473fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4740ce1a0 0x7fd4740ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58788/0 (socket says 172.21.15.55:58788) 2023-08-25T04:19:26.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.141+0000 7fd473fff640 1 -- 172.21.15.55:0/4192088313 learned_addr learned my addr 172.21.15.55:0/4192088313 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:26.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.141+0000 7fd478f48640 1 --2- 172.21.15.55:0/4192088313 >> v2:172.21.15.110:3300/0 conn(0x7fd4740cddc0 0x7fd4740b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:26.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.145+0000 7fd473fff640 1 -- 172.21.15.55:0/4192088313 >> v2:172.21.15.110:3300/0 conn(0x7fd4740cddc0 msgr2=0x7fd4740b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:26.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.145+0000 7fd473fff640 1 --2- 172.21.15.55:0/4192088313 >> v2:172.21.15.110:3300/0 conn(0x7fd4740cddc0 0x7fd4740b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.145+0000 7fd473fff640 1 -- 172.21.15.55:0/4192088313 >> v1:172.21.15.110:6789/0 conn(0x7fd4740caa50 legacy=0x7fd4740caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:26.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.145+0000 7fd473fff640 1 -- 172.21.15.55:0/4192088313 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4740cd390 con 0x7fd4740ce1a0 2023-08-25T04:19:26.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.145+0000 7fd473fff640 1 --2- 172.21.15.55:0/4192088313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740ce1a0 0x7fd4740ca510 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd47406f9f0 tx=0x7fd46001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff1e3d8c385b336 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.145+0000 7fd4737fe640 1 -- 172.21.15.55:0/4192088313 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4600ac630 con 0x7fd4740ce1a0 2023-08-25T04:19:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.145+0000 7fd4737fe640 1 -- 172.21.15.55:0/4192088313 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4600ac790 con 0x7fd4740ce1a0 2023-08-25T04:19:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.145+0000 7fd4737fe640 1 -- 172.21.15.55:0/4192088313 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4600acb20 con 0x7fd4740ce1a0 2023-08-25T04:19:26.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.145+0000 7fd47b1ac640 1 -- 172.21.15.55:0/4192088313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740ce1a0 msgr2=0x7fd4740ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:26.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.145+0000 7fd47b1ac640 1 --2- 172.21.15.55:0/4192088313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740ce1a0 0x7fd4740ca510 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd47406f9f0 tx=0x7fd46001c440 comp rx=0 tx=0).stop 2023-08-25T04:19:26.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.145+0000 7fd47b1ac640 1 -- 172.21.15.55:0/4192088313 shutdown_connections 2023-08-25T04:19:26.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.145+0000 7fd47b1ac640 1 --2- 172.21.15.55:0/4192088313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740ce1a0 0x7fd4740ca510 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.145+0000 7fd47b1ac640 1 --2- 172.21.15.55:0/4192088313 >> v2:172.21.15.110:3300/0 conn(0x7fd4740cddc0 0x7fd4740b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.145+0000 7fd47b1ac640 1 -- 172.21.15.55:0/4192088313 >> 172.21.15.55:0/4192088313 conn(0x7fd4740b0700 msgr2=0x7fd4740b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:26.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.145+0000 7fd47b1ac640 1 -- 172.21.15.55:0/4192088313 shutdown_connections 2023-08-25T04:19:26.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd47b1ac640 1 -- 172.21.15.55:0/4192088313 wait complete. 2023-08-25T04:19:26.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd47b1ac640 1 Processor -- start 2023-08-25T04:19:26.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd47b1ac640 1 -- start start 2023-08-25T04:19:26.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd47b1ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740caa50 0x7fd474155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:26.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd47b1ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4740cddc0 0x7fd474159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:26.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd47b1ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4740ce1a0 0x7fd474159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:26.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd47b1ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47415b030 con 0x7fd4740caa50 2023-08-25T04:19:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd47b1ac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47415b310 con 0x7fd4740cddc0 2023-08-25T04:19:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd47b1ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4740c5e80 con 0x7fd4740ce1a0 2023-08-25T04:19:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd478f48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740caa50 0x7fd474155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:26.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd478f48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740caa50 0x7fd474155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58792/0 (socket says 172.21.15.55:58792) 2023-08-25T04:19:26.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd478f48640 1 -- 172.21.15.55:0/220631956 learned_addr learned my addr 172.21.15.55:0/220631956 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:26.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd473fff640 1 --2- 172.21.15.55:0/220631956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4740cddc0 0x7fd474159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:26.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd479749640 1 --2- 172.21.15.55:0/220631956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4740ce1a0 0x7fd474159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:26.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd478f48640 1 -- 172.21.15.55:0/220631956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4740ce1a0 msgr2=0x7fd474159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:26.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd478f48640 1 --2- 172.21.15.55:0/220631956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4740ce1a0 0x7fd474159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd478f48640 1 -- 172.21.15.55:0/220631956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4740cddc0 msgr2=0x7fd474159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd478f48640 1 --2- 172.21.15.55:0/220631956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4740cddc0 0x7fd474159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd478f48640 1 -- 172.21.15.55:0/220631956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4600094d0 con 0x7fd4740caa50 2023-08-25T04:19:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd473fff640 1 --2- 172.21.15.55:0/220631956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4740cddc0 0x7fd474159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd478f48640 1 --2- 172.21.15.55:0/220631956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740caa50 0x7fd474155640 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd46800e870 tx=0x7fd46800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.149+0000 7fd4717fa640 1 -- 172.21.15.55:0/220631956 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd468009510 con 0x7fd4740caa50 2023-08-25T04:19:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.153+0000 7fd4717fa640 1 -- 172.21.15.55:0/220631956 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46800eec0 con 0x7fd4740caa50 2023-08-25T04:19:26.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.153+0000 7fd47b1ac640 1 -- 172.21.15.55:0/220631956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4740c6160 con 0x7fd4740caa50 2023-08-25T04:19:26.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.153+0000 7fd4717fa640 1 -- 172.21.15.55:0/220631956 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46800cb40 con 0x7fd4740caa50 2023-08-25T04:19:26.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.153+0000 7fd47b1ac640 1 -- 172.21.15.55:0/220631956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47415ac70 con 0x7fd4740caa50 2023-08-25T04:19:26.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.153+0000 7fd47b1ac640 1 -- 172.21.15.55:0/220631956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4740c5cc0 con 0x7fd4740caa50 2023-08-25T04:19:26.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.153+0000 7fd4717fa640 1 -- 172.21.15.55:0/220631956 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 44) v1 ==== 84800+0+0 (secure 0 0 0) 0x7fd46800cca0 con 0x7fd4740caa50 2023-08-25T04:19:26.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.153+0000 7fd4717fa640 1 --2- 172.21.15.55:0/220631956 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd458065500 0x7fd4580679c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:26.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.153+0000 7fd4717fa640 1 -- 172.21.15.55:0/220631956 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fd468082e60 con 0x7fd4740caa50 2023-08-25T04:19:26.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.153+0000 7fd473fff640 1 --2- 172.21.15.55:0/220631956 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd458065500 0x7fd4580679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:26.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.157+0000 7fd473fff640 1 --2- 172.21.15.55:0/220631956 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd458065500 0x7fd4580679c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd4600ae000 tx=0x7fd4600a7000 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:26.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.157+0000 7fd4717fa640 1 -- 172.21.15.55:0/220631956 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd4680508e0 con 0x7fd4740caa50 2023-08-25T04:19:26.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.313+0000 7fd47b1ac640 1 -- 172.21.15.55:0/220631956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd47404dbe0 con 0x7fd4740caa50 2023-08-25T04:19:26.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.317+0000 7fd4717fa640 1 -- 172.21.15.55:0/220631956 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+19382 (secure 0 0 0) 0x7fd468053f00 con 0x7fd4740caa50 2023-08-25T04:19:26.315 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:26.316 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":95,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:19:24.435122+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:19:03.829933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-25T04:19:05.172184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6832/3580388085":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/4195307464":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/2448806631":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/3256947721":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/2126097154":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/3373349369":"2023-08-26T04:19:18.606592+0000","172.21.15.110:6833/2805609132":"2023-08-26T04:19:18.606592+0000","172.21.15.110:6833/3580388085":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/2070659651":"2023-08-26T04:19:24.435086+0000","172.21.15.110:6832/2805609132":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/3316375931":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/3413496344":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/7066739":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/2684620126":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/3401969959":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/3496245024":"2023-08-26T04:19:18.606592+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:19:26.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.317+0000 7fd47b1ac640 1 -- 172.21.15.55:0/220631956 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd458065500 msgr2=0x7fd4580679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:26.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.317+0000 7fd47b1ac640 1 --2- 172.21.15.55:0/220631956 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd458065500 0x7fd4580679c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd4600ae000 tx=0x7fd4600a7000 comp rx=0 tx=0).stop 2023-08-25T04:19:26.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.317+0000 7fd47b1ac640 1 -- 172.21.15.55:0/220631956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740caa50 msgr2=0x7fd474155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:26.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.317+0000 7fd47b1ac640 1 --2- 172.21.15.55:0/220631956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740caa50 0x7fd474155640 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd46800e870 tx=0x7fd46800ec70 comp rx=0 tx=0).stop 2023-08-25T04:19:26.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.317+0000 7fd47b1ac640 1 -- 172.21.15.55:0/220631956 shutdown_connections 2023-08-25T04:19:26.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.317+0000 7fd47b1ac640 1 --2- 172.21.15.55:0/220631956 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd458065500 0x7fd4580679c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.317+0000 7fd47b1ac640 1 --2- 172.21.15.55:0/220631956 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4740ce1a0 0x7fd474159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.317+0000 7fd47b1ac640 1 --2- 172.21.15.55:0/220631956 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4740cddc0 0x7fd474159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.317+0000 7fd47b1ac640 1 --2- 172.21.15.55:0/220631956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4740caa50 0x7fd474155640 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.317+0000 7fd47b1ac640 1 -- 172.21.15.55:0/220631956 >> 172.21.15.55:0/220631956 conn(0x7fd4740b0700 msgr2=0x7fd4740b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:26.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.317+0000 7fd47b1ac640 1 -- 172.21.15.55:0/220631956 shutdown_connections 2023-08-25T04:19:26.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.317+0000 7fd47b1ac640 1 -- 172.21.15.55:0/220631956 wait complete. 2023-08-25T04:19:26.336 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-25T04:19:26.337 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:19:26.476 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:26.472+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:26.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.481+0000 7f848e567640 1 Processor -- start 2023-08-25T04:19:26.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.481+0000 7f848e567640 1 -- start start 2023-08-25T04:19:26.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.485+0000 7f848e567640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815c9c0 0x7f8488160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:26.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.485+0000 7f848e567640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848806eaf0 con 0x7f848806b2b0 2023-08-25T04:19:26.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.485+0000 7f848e567640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848806e530 con 0x7f84880cfa70 2023-08-25T04:19:26.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.485+0000 7f848e567640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848806e810 con 0x7f848815c9c0 2023-08-25T04:19:26.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.485+0000 7f848cb04640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f848806b2b0 0x7f848806b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54232/0 (socket says 172.21.15.55:54232) 2023-08-25T04:19:26.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.485+0000 7f848cb04640 1 -- 172.21.15.55:0/366017632 learned_addr learned my addr 172.21.15.55:0/366017632 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:26.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.485+0000 7f8487fff640 1 --2- 172.21.15.55:0/366017632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815c9c0 0x7f8488160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.485+0000 7f8486ffd640 1 -- 172.21.15.55:0/366017632 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502320839 0 0) 0x7f848806eaf0 con 0x7f848806b2b0 2023-08-25T04:19:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.485+0000 7f8486ffd640 1 -- 172.21.15.55:0/366017632 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8470003530 con 0x7f848806b2b0 2023-08-25T04:19:26.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.485+0000 7f8486ffd640 1 -- 172.21.15.55:0/366017632 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769113346 0 0) 0x7f848806e530 con 0x7f84880cfa70 2023-08-25T04:19:26.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.485+0000 7f8486ffd640 1 -- 172.21.15.55:0/366017632 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f848806eaf0 con 0x7f84880cfa70 2023-08-25T04:19:26.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.485+0000 7f8487fff640 1 -- 172.21.15.55:0/366017632 >> v1:172.21.15.110:6789/0 conn(0x7f84880cfa70 legacy=0x7f8488160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:26.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.485+0000 7f8487fff640 1 -- 172.21.15.55:0/366017632 >> v1:172.21.15.55:6789/0 conn(0x7f848806b2b0 legacy=0x7f848806b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:26.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.485+0000 7f8487fff640 1 -- 172.21.15.55:0/366017632 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848806aab0 con 0x7f848815c9c0 2023-08-25T04:19:26.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.489+0000 7f8487fff640 1 --2- 172.21.15.55:0/366017632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815c9c0 0x7f8488160510 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f84780097d0 tx=0x7f847801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccc45a4a2af959eb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:26.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.489+0000 7f8486ffd640 1 -- 172.21.15.55:0/366017632 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84780a7070 con 0x7f848815c9c0 2023-08-25T04:19:26.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.489+0000 7f8486ffd640 1 -- 172.21.15.55:0/366017632 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84780ab430 con 0x7f848815c9c0 2023-08-25T04:19:26.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.489+0000 7f8486ffd640 1 -- 172.21.15.55:0/366017632 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84780ab7c0 con 0x7f848815c9c0 2023-08-25T04:19:26.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.489+0000 7f848e567640 1 -- 172.21.15.55:0/366017632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815c9c0 msgr2=0x7f8488160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:26.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.489+0000 7f848e567640 1 --2- 172.21.15.55:0/366017632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815c9c0 0x7f8488160510 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f84780097d0 tx=0x7f847801c470 comp rx=0 tx=0).stop 2023-08-25T04:19:26.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.489+0000 7f848e567640 1 -- 172.21.15.55:0/366017632 shutdown_connections 2023-08-25T04:19:26.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.489+0000 7f848e567640 1 --2- 172.21.15.55:0/366017632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815c9c0 0x7f8488160510 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.489+0000 7f848e567640 1 -- 172.21.15.55:0/366017632 >> 172.21.15.55:0/366017632 conn(0x7f84880d05a0 msgr2=0x7f84880d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:26.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.489+0000 7f848e567640 1 -- 172.21.15.55:0/366017632 shutdown_connections 2023-08-25T04:19:26.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.489+0000 7f848e567640 1 -- 172.21.15.55:0/366017632 wait complete. 2023-08-25T04:19:26.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.489+0000 7f848e567640 1 Processor -- start 2023-08-25T04:19:26.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.489+0000 7f848e567640 1 -- start start 2023-08-25T04:19:26.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f848e567640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f848806b2b0 0x7f84880b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:26.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f848e567640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84880cfa70 0x7f8488146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:26.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f848e567640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815c9c0 0x7f8488149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:26.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f848e567640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8488151950 con 0x7f848806b2b0 2023-08-25T04:19:26.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f848e567640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84880b57c0 con 0x7f84880cfa70 2023-08-25T04:19:26.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f848e567640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84880b5aa0 con 0x7f848815c9c0 2023-08-25T04:19:26.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f8487fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f848806b2b0 0x7f84880b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:26.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f8487fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f848806b2b0 0x7f84880b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58796/0 (socket says 172.21.15.55:58796) 2023-08-25T04:19:26.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f8487fff640 1 -- 172.21.15.55:0/2004791781 learned_addr learned my addr 172.21.15.55:0/2004791781 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:26.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f848cb04640 1 --2- 172.21.15.55:0/2004791781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815c9c0 0x7f8488149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:26.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f84877fe640 1 --2- 172.21.15.55:0/2004791781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84880cfa70 0x7f8488146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:26.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f8487fff640 1 -- 172.21.15.55:0/2004791781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815c9c0 msgr2=0x7f8488149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:26.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f8487fff640 1 --2- 172.21.15.55:0/2004791781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815c9c0 0x7f8488149ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f8487fff640 1 -- 172.21.15.55:0/2004791781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84880cfa70 msgr2=0x7f8488146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:26.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f8487fff640 1 --2- 172.21.15.55:0/2004791781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84880cfa70 0x7f8488146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f8487fff640 1 -- 172.21.15.55:0/2004791781 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84780093b0 con 0x7f848806b2b0 2023-08-25T04:19:26.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f8487fff640 1 --2- 172.21.15.55:0/2004791781 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f848806b2b0 0x7f84880b31c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f84780ad040 tx=0x7f8478019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:26.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f8484ff9640 1 -- 172.21.15.55:0/2004791781 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84780ab9a0 con 0x7f848806b2b0 2023-08-25T04:19:26.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f8484ff9640 1 -- 172.21.15.55:0/2004791781 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84780abb20 con 0x7f848806b2b0 2023-08-25T04:19:26.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f8484ff9640 1 -- 172.21.15.55:0/2004791781 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84780be3f0 con 0x7f848806b2b0 2023-08-25T04:19:26.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f848e567640 1 -- 172.21.15.55:0/2004791781 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84880b5d80 con 0x7f848806b2b0 2023-08-25T04:19:26.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f848e567640 1 -- 172.21.15.55:0/2004791781 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84880b6340 con 0x7f848806b2b0 2023-08-25T04:19:26.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.493+0000 7f848e567640 1 -- 172.21.15.55:0/2004791781 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848804dbe0 con 0x7f848806b2b0 2023-08-25T04:19:26.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.497+0000 7f8484ff9640 1 -- 172.21.15.55:0/2004791781 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 44) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f84780b43f0 con 0x7f848806b2b0 2023-08-25T04:19:26.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.497+0000 7f8484ff9640 1 --2- 172.21.15.55:0/2004791781 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f84740654d0 0x7f8474067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:26.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.497+0000 7f8484ff9640 1 -- 172.21.15.55:0/2004791781 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f847811cca0 con 0x7f848806b2b0 2023-08-25T04:19:26.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.497+0000 7f84877fe640 1 --2- 172.21.15.55:0/2004791781 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f84740654d0 0x7f8474067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:26.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.497+0000 7f84877fe640 1 --2- 172.21.15.55:0/2004791781 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f84740654d0 0x7f8474067990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f84880ad650 tx=0x7f847c009040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:26.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.501+0000 7f8484ff9640 1 -- 172.21.15.55:0/2004791781 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f84780ea7d0 con 0x7f848806b2b0 2023-08-25T04:19:26.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.693+0000 7f848e567640 1 -- 172.21.15.55:0/2004791781 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84880cdc20 con 0x7f848806b2b0 2023-08-25T04:19:26.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.693+0000 7f8484ff9640 1 -- 172.21.15.55:0/2004791781 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f84780c3090 con 0x7f848806b2b0 2023-08-25T04:19:26.695 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:26.695 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6311,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/976095252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":976095252},{"type":"v1","addr":"172.21.15.110:6836","nonce":976095252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1364761770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1364761770},{"type":"v1","addr":"172.21.15.110:6837","nonce":1364761770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2491496151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2491496151},{"type":"v1","addr":"172.21.15.55:6834","nonce":2491496151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:19:06.181749+0000","modified":"2023-08-25T04:19:09.803812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7329":{"gid":7329,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3432791477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3432791477},{"type":"v1","addr":"172.21.15.55:6835","nonce":3432791477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-25T04:19:26.697 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 40 2023-08-25T04:19:26.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.697+0000 7f848e567640 1 -- 172.21.15.55:0/2004791781 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f84740654d0 msgr2=0x7f8474067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:26.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.697+0000 7f848e567640 1 --2- 172.21.15.55:0/2004791781 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f84740654d0 0x7f8474067990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f84880ad650 tx=0x7f847c009040 comp rx=0 tx=0).stop 2023-08-25T04:19:26.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.697+0000 7f848e567640 1 -- 172.21.15.55:0/2004791781 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f848806b2b0 msgr2=0x7f84880b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:26.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.697+0000 7f848e567640 1 --2- 172.21.15.55:0/2004791781 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f848806b2b0 0x7f84880b31c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f84780ad040 tx=0x7f8478019210 comp rx=0 tx=0).stop 2023-08-25T04:19:26.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.697+0000 7f848e567640 1 -- 172.21.15.55:0/2004791781 shutdown_connections 2023-08-25T04:19:26.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.697+0000 7f848e567640 1 --2- 172.21.15.55:0/2004791781 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f84740654d0 0x7f8474067990 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.697+0000 7f848e567640 1 --2- 172.21.15.55:0/2004791781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f848815c9c0 0x7f8488149ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.697+0000 7f848e567640 1 --2- 172.21.15.55:0/2004791781 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84880cfa70 0x7f8488146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.697+0000 7f848e567640 1 --2- 172.21.15.55:0/2004791781 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f848806b2b0 0x7f84880b31c0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.697+0000 7f848e567640 1 -- 172.21.15.55:0/2004791781 >> 172.21.15.55:0/2004791781 conn(0x7f84880d05a0 msgr2=0x7f84880ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:26.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.697+0000 7f848e567640 1 -- 172.21.15.55:0/2004791781 shutdown_connections 2023-08-25T04:19:26.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.697+0000 7f848e567640 1 -- 172.21.15.55:0/2004791781 wait complete. 2023-08-25T04:19:26.717 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:19:26.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.865+0000 7f43d7737640 1 Processor -- start 2023-08-25T04:19:26.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.865+0000 7f43d7737640 1 -- start start 2023-08-25T04:19:26.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.865+0000 7f43d7737640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43d00ce220 0x7f43d00b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:26.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.865+0000 7f43d7737640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d00b29b0 con 0x7f43d00cdde0 2023-08-25T04:19:26.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.865+0000 7f43d7737640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d00ce6b0 con 0x7f43d00d0da0 2023-08-25T04:19:26.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.865+0000 7f43d7737640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00b1dc0 con 0x7f43d00ce220 2023-08-25T04:19:26.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.865+0000 7f43d4cd2640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f43d00cdde0 0x7f43d00b2e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54246/0 (socket says 172.21.15.55:54246) 2023-08-25T04:19:26.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.865+0000 7f43d4cd2640 1 -- 172.21.15.55:0/1967040933 learned_addr learned my addr 172.21.15.55:0/1967040933 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:26.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.865+0000 7f43d5cd4640 1 --2- 172.21.15.55:0/1967040933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43d00ce220 0x7f43d00b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:26.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.865+0000 7f43c7fff640 1 -- 172.21.15.55:0/1967040933 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086358654 0 0) 0x7f43d00b29b0 con 0x7f43d00cdde0 2023-08-25T04:19:26.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.865+0000 7f43c7fff640 1 -- 172.21.15.55:0/1967040933 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43bc003530 con 0x7f43d00cdde0 2023-08-25T04:19:26.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.865+0000 7f43c7fff640 1 -- 172.21.15.55:0/1967040933 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063704475 0 0) 0x7f43d00ce6b0 con 0x7f43d00d0da0 2023-08-25T04:19:26.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.865+0000 7f43c7fff640 1 -- 172.21.15.55:0/1967040933 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43d00b29b0 con 0x7f43d00d0da0 2023-08-25T04:19:26.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.865+0000 7f43d5cd4640 1 -- 172.21.15.55:0/1967040933 >> v1:172.21.15.110:6789/0 conn(0x7f43d00d0da0 legacy=0x7f43d00d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:26.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.865+0000 7f43d5cd4640 1 -- 172.21.15.55:0/1967040933 >> v1:172.21.15.55:6789/0 conn(0x7f43d00cdde0 legacy=0x7f43d00b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:26.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.865+0000 7f43d5cd4640 1 -- 172.21.15.55:0/1967040933 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d00b2080 con 0x7f43d00ce220 2023-08-25T04:19:26.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.869+0000 7f43d5cd4640 1 --2- 172.21.15.55:0/1967040933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43d00ce220 0x7f43d00b3550 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009dc0 tx=0x7f43c801f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4efc71c603328cda server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:26.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.869+0000 7f43c7fff640 1 -- 172.21.15.55:0/1967040933 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c80af600 con 0x7f43d00ce220 2023-08-25T04:19:26.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.869+0000 7f43c7fff640 1 -- 172.21.15.55:0/1967040933 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c80ab050 con 0x7f43d00ce220 2023-08-25T04:19:26.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.869+0000 7f43c7fff640 1 -- 172.21.15.55:0/1967040933 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c80af980 con 0x7f43d00ce220 2023-08-25T04:19:26.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.869+0000 7f43d7737640 1 -- 172.21.15.55:0/1967040933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43d00ce220 msgr2=0x7f43d00b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:26.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.869+0000 7f43d7737640 1 --2- 172.21.15.55:0/1967040933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43d00ce220 0x7f43d00b3550 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009dc0 tx=0x7f43c801f150 comp rx=0 tx=0).stop 2023-08-25T04:19:26.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.869+0000 7f43d7737640 1 -- 172.21.15.55:0/1967040933 shutdown_connections 2023-08-25T04:19:26.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.869+0000 7f43d7737640 1 --2- 172.21.15.55:0/1967040933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43d00ce220 0x7f43d00b3550 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.869+0000 7f43d7737640 1 -- 172.21.15.55:0/1967040933 >> 172.21.15.55:0/1967040933 conn(0x7f43d009bae0 msgr2=0x7f43d00d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:26.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.869+0000 7f43d7737640 1 -- 172.21.15.55:0/1967040933 shutdown_connections 2023-08-25T04:19:26.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.869+0000 7f43d7737640 1 -- 172.21.15.55:0/1967040933 wait complete. 2023-08-25T04:19:26.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d7737640 1 Processor -- start 2023-08-25T04:19:26.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d7737640 1 -- start start 2023-08-25T04:19:26.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d7737640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43d00cdde0 0x7f43d01f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:26.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d7737640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43d00ce220 0x7f43d00ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:26.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d7737640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43d00d0da0 0x7f43d00cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:26.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d7737640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00c62f0 con 0x7f43d00ce220 2023-08-25T04:19:26.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d7737640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d01585c0 con 0x7f43d00d0da0 2023-08-25T04:19:26.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d7737640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d00c6540 con 0x7f43d00cdde0 2023-08-25T04:19:26.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d4cd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43d00ce220 0x7f43d00ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:26.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d4cd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43d00ce220 0x7f43d00ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58800/0 (socket says 172.21.15.55:58800) 2023-08-25T04:19:26.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d4cd2640 1 -- 172.21.15.55:0/3090386009 learned_addr learned my addr 172.21.15.55:0/3090386009 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:26.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d5cd4640 1 --2- 172.21.15.55:0/3090386009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43d00d0da0 0x7f43d00cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:26.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d54d3640 1 --2- 172.21.15.55:0/3090386009 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43d00cdde0 0x7f43d01f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:26.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d4cd2640 1 -- 172.21.15.55:0/3090386009 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43d00cdde0 msgr2=0x7f43d01f1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:26.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d4cd2640 1 --2- 172.21.15.55:0/3090386009 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43d00cdde0 0x7f43d01f1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d4cd2640 1 -- 172.21.15.55:0/3090386009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43d00d0da0 msgr2=0x7f43d00cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d4cd2640 1 --2- 172.21.15.55:0/3090386009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43d00d0da0 0x7f43d00cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d4cd2640 1 -- 172.21.15.55:0/3090386009 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c8009a70 con 0x7f43d00ce220 2023-08-25T04:19:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d4cd2640 1 --2- 172.21.15.55:0/3090386009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43d00ce220 0x7f43d00ca8e0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f43c000c4d0 tx=0x7f43c000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43c5ffb640 1 -- 172.21.15.55:0/3090386009 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0005cf0 con 0x7f43d00ce220 2023-08-25T04:19:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43c5ffb640 1 -- 172.21.15.55:0/3090386009 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c0005e50 con 0x7f43d00ce220 2023-08-25T04:19:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43c5ffb640 1 -- 172.21.15.55:0/3090386009 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0007290 con 0x7f43d00ce220 2023-08-25T04:19:26.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d7737640 1 -- 172.21.15.55:0/3090386009 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d00c6820 con 0x7f43d00ce220 2023-08-25T04:19:26.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.873+0000 7f43d7737640 1 -- 172.21.15.55:0/3090386009 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d00cc5e0 con 0x7f43d00ce220 2023-08-25T04:19:26.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.877+0000 7f43d7737640 1 -- 172.21.15.55:0/3090386009 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d004dbe0 con 0x7f43d00ce220 2023-08-25T04:19:26.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.877+0000 7f43c5ffb640 1 -- 172.21.15.55:0/3090386009 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f43c00073f0 con 0x7f43d00ce220 2023-08-25T04:19:26.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.877+0000 7f43c5ffb640 1 --2- 172.21.15.55:0/3090386009 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f43b4065710 0x7f43b4067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:26.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.877+0000 7f43c5ffb640 1 -- 172.21.15.55:0/3090386009 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f43c0082720 con 0x7f43d00ce220 2023-08-25T04:19:26.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.877+0000 7f43d54d3640 1 --2- 172.21.15.55:0/3090386009 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f43b4065710 0x7f43b4067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:26.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.877+0000 7f43d54d3640 1 --2- 172.21.15.55:0/3090386009 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f43b4065710 0x7f43b4067bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f43cc001240 tx=0x7f43cc009040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:26.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:26.881+0000 7f43c5ffb640 1 -- 172.21.15.55:0/3090386009 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f43c004fed0 con 0x7f43d00ce220 2023-08-25T04:19:27.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.069+0000 7f43d7737640 1 -- 172.21.15.55:0/3090386009 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43d00b3550 con 0x7f43d00ce220 2023-08-25T04:19:27.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.069+0000 7f43c5ffb640 1 -- 172.21.15.55:0/3090386009 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f43c00534f0 con 0x7f43d00ce220 2023-08-25T04:19:27.072 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:27.072 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6311,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/976095252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":976095252},{"type":"v1","addr":"172.21.15.110:6836","nonce":976095252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1364761770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1364761770},{"type":"v1","addr":"172.21.15.110:6837","nonce":1364761770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2491496151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2491496151},{"type":"v1","addr":"172.21.15.55:6834","nonce":2491496151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:19:06.181749+0000","modified":"2023-08-25T04:19:09.803812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7329":{"gid":7329,"name":"c","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3432791477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3432791477},{"type":"v1","addr":"172.21.15.55:6835","nonce":3432791477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-08-25T04:19:27.074 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 40 2023-08-25T04:19:27.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.073+0000 7f43d7737640 1 -- 172.21.15.55:0/3090386009 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f43b4065710 msgr2=0x7f43b4067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:27.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.073+0000 7f43d7737640 1 --2- 172.21.15.55:0/3090386009 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f43b4065710 0x7f43b4067bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f43cc001240 tx=0x7f43cc009040 comp rx=0 tx=0).stop 2023-08-25T04:19:27.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.073+0000 7f43d7737640 1 -- 172.21.15.55:0/3090386009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43d00ce220 msgr2=0x7f43d00ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:27.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.073+0000 7f43d7737640 1 --2- 172.21.15.55:0/3090386009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43d00ce220 0x7f43d00ca8e0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f43c000c4d0 tx=0x7f43c000c990 comp rx=0 tx=0).stop 2023-08-25T04:19:27.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.073+0000 7f43d7737640 1 -- 172.21.15.55:0/3090386009 shutdown_connections 2023-08-25T04:19:27.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.073+0000 7f43d7737640 1 --2- 172.21.15.55:0/3090386009 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43d00d0da0 0x7f43d00cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.073+0000 7f43d7737640 1 --2- 172.21.15.55:0/3090386009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43d00ce220 0x7f43d00ca8e0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.073+0000 7f43d7737640 1 --2- 172.21.15.55:0/3090386009 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f43b4065710 0x7f43b4067bd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.073+0000 7f43d7737640 1 --2- 172.21.15.55:0/3090386009 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43d00cdde0 0x7f43d01f1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.073+0000 7f43d7737640 1 -- 172.21.15.55:0/3090386009 >> 172.21.15.55:0/3090386009 conn(0x7f43d009bae0 msgr2=0x7f43d00af440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:27.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.073+0000 7f43d7737640 1 -- 172.21.15.55:0/3090386009 shutdown_connections 2023-08-25T04:19:27.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.073+0000 7f43d7737640 1 -- 172.21.15.55:0/3090386009 wait complete. 2023-08-25T04:19:27.092 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:19:27.175 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:27.172+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:27.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f134d303640 1 Processor -- start 2023-08-25T04:19:27.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f134d303640 1 -- start start 2023-08-25T04:19:27.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f134d303640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13480d0da0 0x7f13480d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:27.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f134d303640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13480cdde0 0x7f13480ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:27.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f134d303640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f13480cee60 0x7f13480cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:27.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f134d303640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13480ce760 con 0x7f13480d0da0 2023-08-25T04:19:27.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f134d303640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13480b29b0 con 0x7f13480cee60 2023-08-25T04:19:27.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f134d303640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13480d16c0 con 0x7f13480cdde0 2023-08-25T04:19:27.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f1346ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13480d0da0 0x7f13480d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:27.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f13467fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13480cdde0 0x7f13480ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:27.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f1346ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13480d0da0 0x7f13480d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58806/0 (socket says 172.21.15.55:58806) 2023-08-25T04:19:27.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f1346ffd640 1 -- 172.21.15.55:0/916789115 learned_addr learned my addr 172.21.15.55:0/916789115 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:27.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f13477fe640 1 --2- 172.21.15.55:0/916789115 >> v2:172.21.15.110:3300/0 conn(0x7f13480cee60 0x7f13480cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:27.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f1346ffd640 1 -- 172.21.15.55:0/916789115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13480cdde0 msgr2=0x7f13480ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:27.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f1346ffd640 1 --2- 172.21.15.55:0/916789115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13480cdde0 0x7f13480ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f1346ffd640 1 -- 172.21.15.55:0/916789115 >> v2:172.21.15.110:3300/0 conn(0x7f13480cee60 msgr2=0x7f13480cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:27.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f1346ffd640 1 --2- 172.21.15.55:0/916789115 >> v2:172.21.15.110:3300/0 conn(0x7f13480cee60 0x7f13480cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f1346ffd640 1 -- 172.21.15.55:0/916789115 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13480b1dc0 con 0x7f13480d0da0 2023-08-25T04:19:27.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.237+0000 7f13477fe640 1 --2- 172.21.15.55:0/916789115 >> v2:172.21.15.110:3300/0 conn(0x7f13480cee60 0x7f13480cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:27.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.241+0000 7f1346ffd640 1 --2- 172.21.15.55:0/916789115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13480d0da0 0x7f13480d1180 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f13480b1bd0 tx=0x7f133801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11b8085e4bacda8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:27.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.241+0000 7f1345ffb640 1 -- 172.21.15.55:0/916789115 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380a89b0 con 0x7f13480d0da0 2023-08-25T04:19:27.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.241+0000 7f1345ffb640 1 -- 172.21.15.55:0/916789115 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13380a8b10 con 0x7f13480d0da0 2023-08-25T04:19:27.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.241+0000 7f1345ffb640 1 -- 172.21.15.55:0/916789115 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380a8ea0 con 0x7f13480d0da0 2023-08-25T04:19:27.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.241+0000 7f134d303640 1 -- 172.21.15.55:0/916789115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13480d0da0 msgr2=0x7f13480d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:27.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.241+0000 7f134d303640 1 --2- 172.21.15.55:0/916789115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13480d0da0 0x7f13480d1180 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f13480b1bd0 tx=0x7f133801ecf0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.241+0000 7f134d303640 1 -- 172.21.15.55:0/916789115 shutdown_connections 2023-08-25T04:19:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.241+0000 7f134d303640 1 --2- 172.21.15.55:0/916789115 >> v2:172.21.15.110:3300/0 conn(0x7f13480cee60 0x7f13480cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.241+0000 7f134d303640 1 --2- 172.21.15.55:0/916789115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13480cdde0 0x7f13480ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.241+0000 7f134d303640 1 --2- 172.21.15.55:0/916789115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13480d0da0 0x7f13480d1180 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.241+0000 7f134d303640 1 -- 172.21.15.55:0/916789115 >> 172.21.15.55:0/916789115 conn(0x7f134809bae0 msgr2=0x7f13480d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.241+0000 7f134d303640 1 -- 172.21.15.55:0/916789115 shutdown_connections 2023-08-25T04:19:27.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.241+0000 7f134d303640 1 -- 172.21.15.55:0/916789115 wait complete. 2023-08-25T04:19:27.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f134d303640 1 Processor -- start 2023-08-25T04:19:27.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f134d303640 1 -- start start 2023-08-25T04:19:27.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f134d303640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13480cdde0 0x7f1348151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:27.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f134d303640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13480cee60 0x7f13480ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:27.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f134d303640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13480d0da0 0x7f13480b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:27.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f134d303640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13480cc520 con 0x7f13480cee60 2023-08-25T04:19:27.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f134d303640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13480cb900 con 0x7f13480cdde0 2023-08-25T04:19:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f134d303640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13480b58a0 con 0x7f13480d0da0 2023-08-25T04:19:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f13467fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13480cee60 0x7f13480ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:27.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f13467fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13480cee60 0x7f13480ca2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58818/0 (socket says 172.21.15.55:58818) 2023-08-25T04:19:27.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f13467fc640 1 -- 172.21.15.55:0/2819250524 learned_addr learned my addr 172.21.15.55:0/2819250524 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:27.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f13477fe640 1 --2- 172.21.15.55:0/2819250524 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13480d0da0 0x7f13480b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:27.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f1346ffd640 1 --2- 172.21.15.55:0/2819250524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13480cdde0 0x7f1348151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:27.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f13467fc640 1 -- 172.21.15.55:0/2819250524 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13480d0da0 msgr2=0x7f13480b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:27.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f13467fc640 1 --2- 172.21.15.55:0/2819250524 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13480d0da0 0x7f13480b0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f13467fc640 1 -- 172.21.15.55:0/2819250524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13480cdde0 msgr2=0x7f1348151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:27.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f13467fc640 1 --2- 172.21.15.55:0/2819250524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13480cdde0 0x7f1348151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f13467fc640 1 -- 172.21.15.55:0/2819250524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1340009a70 con 0x7f13480cee60 2023-08-25T04:19:27.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f13467fc640 1 --2- 172.21.15.55:0/2819250524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13480cee60 0x7f13480ca2a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f133c00e870 tx=0x7f133c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:27.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f132f7fe640 1 -- 172.21.15.55:0/2819250524 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c0094b0 con 0x7f13480cee60 2023-08-25T04:19:27.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f132f7fe640 1 -- 172.21.15.55:0/2819250524 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c00c730 con 0x7f13480cee60 2023-08-25T04:19:27.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.245+0000 7f132f7fe640 1 -- 172.21.15.55:0/2819250524 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c00cac0 con 0x7f13480cee60 2023-08-25T04:19:27.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.249+0000 7f134d303640 1 -- 172.21.15.55:0/2819250524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1338009470 con 0x7f13480cee60 2023-08-25T04:19:27.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.249+0000 7f134d303640 1 -- 172.21.15.55:0/2819250524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13480cb2b0 con 0x7f13480cee60 2023-08-25T04:19:27.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.249+0000 7f134d303640 1 -- 172.21.15.55:0/2819250524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134804dbe0 con 0x7f13480cee60 2023-08-25T04:19:27.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.249+0000 7f132f7fe640 1 -- 172.21.15.55:0/2819250524 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f133c00cc20 con 0x7f13480cee60 2023-08-25T04:19:27.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.249+0000 7f132f7fe640 1 --2- 172.21.15.55:0/2819250524 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f1334065710 0x7f1334067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:27.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.249+0000 7f132f7fe640 1 -- 172.21.15.55:0/2819250524 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f133c0830a0 con 0x7f13480cee60 2023-08-25T04:19:27.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.249+0000 7f1346ffd640 1 --2- 172.21.15.55:0/2819250524 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f1334065710 0x7f1334067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:27.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.253+0000 7f1346ffd640 1 --2- 172.21.15.55:0/2819250524 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f1334065710 0x7f1334067bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f13380b2000 tx=0x7f1338008040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:27.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.253+0000 7f132f7fe640 1 -- 172.21.15.55:0/2819250524 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f133c050870 con 0x7f13480cee60 2023-08-25T04:19:27.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.421+0000 7f134d303640 1 -- 172.21.15.55:0/2819250524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13480d0b80 con 0x7f13480cee60 2023-08-25T04:19:27.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.421+0000 7f132f7fe640 1 -- 172.21.15.55:0/2819250524 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+19382 (secure 0 0 0) 0x7f133c053e90 con 0x7f13480cee60 2023-08-25T04:19:27.421 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:27.422 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":95,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:19:24.435122+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:19:03.829933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-25T04:19:05.172184+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6832/3580388085":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/4195307464":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/2448806631":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/3256947721":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/2126097154":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/3373349369":"2023-08-26T04:19:18.606592+0000","172.21.15.110:6833/2805609132":"2023-08-26T04:19:18.606592+0000","172.21.15.110:6833/3580388085":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/2070659651":"2023-08-26T04:19:24.435086+0000","172.21.15.110:6832/2805609132":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/3316375931":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/3413496344":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/7066739":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/2684620126":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/3401969959":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/3496245024":"2023-08-26T04:19:18.606592+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:19:27.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.421+0000 7f134d303640 1 -- 172.21.15.55:0/2819250524 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f1334065710 msgr2=0x7f1334067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:27.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.421+0000 7f134d303640 1 --2- 172.21.15.55:0/2819250524 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f1334065710 0x7f1334067bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f13380b2000 tx=0x7f1338008040 comp rx=0 tx=0).stop 2023-08-25T04:19:27.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.421+0000 7f134d303640 1 -- 172.21.15.55:0/2819250524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13480cee60 msgr2=0x7f13480ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:27.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.421+0000 7f134d303640 1 --2- 172.21.15.55:0/2819250524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13480cee60 0x7f13480ca2a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f133c00e870 tx=0x7f133c00ec70 comp rx=0 tx=0).stop 2023-08-25T04:19:27.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.421+0000 7f134d303640 1 -- 172.21.15.55:0/2819250524 shutdown_connections 2023-08-25T04:19:27.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.421+0000 7f134d303640 1 --2- 172.21.15.55:0/2819250524 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f1334065710 0x7f1334067bd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.421+0000 7f134d303640 1 --2- 172.21.15.55:0/2819250524 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13480d0da0 0x7f13480b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.421+0000 7f134d303640 1 --2- 172.21.15.55:0/2819250524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13480cee60 0x7f13480ca2a0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.421+0000 7f134d303640 1 --2- 172.21.15.55:0/2819250524 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13480cdde0 0x7f1348151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.421+0000 7f134d303640 1 -- 172.21.15.55:0/2819250524 >> 172.21.15.55:0/2819250524 conn(0x7f134809bae0 msgr2=0x7f13480cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:27.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.421+0000 7f134d303640 1 -- 172.21.15.55:0/2819250524 shutdown_connections 2023-08-25T04:19:27.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.421+0000 7f134d303640 1 -- 172.21.15.55:0/2819250524 wait complete. 2023-08-25T04:19:27.443 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-25T04:19:27.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.593+0000 7fae724ec640 1 Processor -- start 2023-08-25T04:19:27.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.593+0000 7fae724ec640 1 -- start start 2023-08-25T04:19:27.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.593+0000 7fae724ec640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fae6c0cdde0 0x7fae6c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:27.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.593+0000 7fae724ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c0b2e40 0x7fae6c0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:27.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.593+0000 7fae724ec640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6c0b29b0 con 0x7fae6c0d0da0 2023-08-25T04:19:27.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.593+0000 7fae724ec640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae6c0ce760 con 0x7fae6c0cdde0 2023-08-25T04:19:27.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.593+0000 7fae724ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0b1dc0 con 0x7fae6c0b2e40 2023-08-25T04:19:27.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.593+0000 7fae6bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fae6c0d0da0 0x7fae6c0d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54254/0 (socket says 172.21.15.55:54254) 2023-08-25T04:19:27.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.593+0000 7fae6bfff640 1 -- 172.21.15.55:0/331983480 learned_addr learned my addr 172.21.15.55:0/331983480 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:27.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.593+0000 7fae6b7fe640 1 --2- 172.21.15.55:0/331983480 >> v2:172.21.15.110:3300/0 conn(0x7fae6c0cdde0 0x7fae6c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:27.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.593+0000 7fae70a89640 1 --2- 172.21.15.55:0/331983480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c0b2e40 0x7fae6c0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:27.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.593+0000 7fae6affd640 1 -- 172.21.15.55:0/331983480 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636135335 0 0) 0x7fae6c0b29b0 con 0x7fae6c0d0da0 2023-08-25T04:19:27.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.593+0000 7fae6affd640 1 -- 172.21.15.55:0/331983480 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae54003530 con 0x7fae6c0d0da0 2023-08-25T04:19:27.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.597+0000 7fae6b7fe640 1 -- 172.21.15.55:0/331983480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c0b2e40 msgr2=0x7fae6c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:27.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.597+0000 7fae6b7fe640 1 --2- 172.21.15.55:0/331983480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c0b2e40 0x7fae6c0b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.597+0000 7fae6b7fe640 1 -- 172.21.15.55:0/331983480 >> v1:172.21.15.55:6789/0 conn(0x7fae6c0d0da0 legacy=0x7fae6c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.597+0000 7fae6b7fe640 1 -- 172.21.15.55:0/331983480 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c0b2080 con 0x7fae6c0cdde0 2023-08-25T04:19:27.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.597+0000 7fae70a89640 1 --2- 172.21.15.55:0/331983480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c0b2e40 0x7fae6c0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:27.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.597+0000 7fae6b7fe640 1 --2- 172.21.15.55:0/331983480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6c0cdde0 0x7fae6c0ce220 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fae600097c0 tx=0x7fae6001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a4e97bef2604f80 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:27.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.597+0000 7fae6affd640 1 -- 172.21.15.55:0/331983480 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae600a8970 con 0x7fae6c0cdde0 2023-08-25T04:19:27.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.597+0000 7fae6affd640 1 -- 172.21.15.55:0/331983480 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae600a8ad0 con 0x7fae6c0cdde0 2023-08-25T04:19:27.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.597+0000 7fae6affd640 1 -- 172.21.15.55:0/331983480 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae600a8e60 con 0x7fae6c0cdde0 2023-08-25T04:19:27.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.597+0000 7fae724ec640 1 -- 172.21.15.55:0/331983480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6c0cdde0 msgr2=0x7fae6c0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:27.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.597+0000 7fae724ec640 1 --2- 172.21.15.55:0/331983480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6c0cdde0 0x7fae6c0ce220 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fae600097c0 tx=0x7fae6001ec70 comp rx=0 tx=0).stop 2023-08-25T04:19:27.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae724ec640 1 -- 172.21.15.55:0/331983480 shutdown_connections 2023-08-25T04:19:27.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae724ec640 1 --2- 172.21.15.55:0/331983480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c0b2e40 0x7fae6c0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae724ec640 1 --2- 172.21.15.55:0/331983480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6c0cdde0 0x7fae6c0ce220 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae724ec640 1 -- 172.21.15.55:0/331983480 >> 172.21.15.55:0/331983480 conn(0x7fae6c09bae0 msgr2=0x7fae6c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:27.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae724ec640 1 -- 172.21.15.55:0/331983480 shutdown_connections 2023-08-25T04:19:27.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae724ec640 1 -- 172.21.15.55:0/331983480 wait complete. 2023-08-25T04:19:27.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae724ec640 1 Processor -- start 2023-08-25T04:19:27.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae724ec640 1 -- start start 2023-08-25T04:19:27.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae724ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6c0b2e40 0x7fae6c151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:27.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae724ec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6c0cdde0 0x7fae6c06b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:27.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae724ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c0d0da0 0x7fae6c06b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:27.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae724ec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0cc420 con 0x7fae6c0b2e40 2023-08-25T04:19:27.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae724ec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0ca6f0 con 0x7fae6c0cdde0 2023-08-25T04:19:27.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae724ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0cb8a0 con 0x7fae6c0d0da0 2023-08-25T04:19:27.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae6bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6c0b2e40 0x7fae6c151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:27.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae6bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6c0b2e40 0x7fae6c151a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58832/0 (socket says 172.21.15.55:58832) 2023-08-25T04:19:27.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae6b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6c0cdde0 0x7fae6c06b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:27.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae6bfff640 1 -- 172.21.15.55:0/3844755638 learned_addr learned my addr 172.21.15.55:0/3844755638 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:27.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae70a89640 1 --2- 172.21.15.55:0/3844755638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c0d0da0 0x7fae6c06b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:27.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae6bfff640 1 -- 172.21.15.55:0/3844755638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c0d0da0 msgr2=0x7fae6c06b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:27.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae6bfff640 1 --2- 172.21.15.55:0/3844755638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c0d0da0 0x7fae6c06b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae6bfff640 1 -- 172.21.15.55:0/3844755638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6c0cdde0 msgr2=0x7fae6c06b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:27.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae6bfff640 1 --2- 172.21.15.55:0/3844755638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6c0cdde0 0x7fae6c06b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae6bfff640 1 -- 172.21.15.55:0/3844755638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae64009a70 con 0x7fae6c0b2e40 2023-08-25T04:19:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.601+0000 7fae6b7fe640 1 --2- 172.21.15.55:0/3844755638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6c0cdde0 0x7fae6c06b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.605+0000 7fae6bfff640 1 --2- 172.21.15.55:0/3844755638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6c0b2e40 0x7fae6c151a10 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fae5c001270 tx=0x7fae5c00ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.605+0000 7fae68ff9640 1 -- 172.21.15.55:0/3844755638 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c0074e0 con 0x7fae6c0b2e40 2023-08-25T04:19:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.605+0000 7fae68ff9640 1 -- 172.21.15.55:0/3844755638 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5c007640 con 0x7fae6c0b2e40 2023-08-25T04:19:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.605+0000 7fae68ff9640 1 -- 172.21.15.55:0/3844755638 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c0059b0 con 0x7fae6c0b2e40 2023-08-25T04:19:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.605+0000 7fae724ec640 1 -- 172.21.15.55:0/3844755638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae60009420 con 0x7fae6c0b2e40 2023-08-25T04:19:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.605+0000 7fae724ec640 1 -- 172.21.15.55:0/3844755638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6c0cbdd0 con 0x7fae6c0b2e40 2023-08-25T04:19:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.605+0000 7fae724ec640 1 -- 172.21.15.55:0/3844755638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6c04dbe0 con 0x7fae6c0b2e40 2023-08-25T04:19:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.605+0000 7fae68ff9640 1 -- 172.21.15.55:0/3844755638 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fae5c005b10 con 0x7fae6c0b2e40 2023-08-25T04:19:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.605+0000 7fae68ff9640 1 --2- 172.21.15.55:0/3844755638 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fae58065710 0x7fae58067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.605+0000 7fae68ff9640 1 -- 172.21.15.55:0/3844755638 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fae5c082720 con 0x7fae6c0b2e40 2023-08-25T04:19:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.605+0000 7fae6b7fe640 1 --2- 172.21.15.55:0/3844755638 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fae58065710 0x7fae58067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.609+0000 7fae6b7fe640 1 --2- 172.21.15.55:0/3844755638 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fae58065710 0x7fae58067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fae600b2000 tx=0x7fae60008040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:27.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.609+0000 7fae68ff9640 1 -- 172.21.15.55:0/3844755638 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fae5c04fef0 con 0x7fae6c0b2e40 2023-08-25T04:19:27.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.805+0000 7fae724ec640 1 -- 172.21.15.55:0/3844755638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fae6c0d0b80 con 0x7fae6c0b2e40 2023-08-25T04:19:27.806 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-08-25T04:19:27.805+0000 7f7f18c38640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-25T04:19:27.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.817+0000 7fae68ff9640 1 -- 172.21.15.55:0/3844755638 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7fae5c053510 con 0x7fae6c0b2e40 2023-08-25T04:19:27.817 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-25T04:19:27.818 INFO:tasks.ceph.mds.c.smithi055.stderr: -2581> 2023-08-25T04:19:10.733+0000 7f5847767640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T04:19:27.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.817+0000 7fae724ec640 1 -- 172.21.15.55:0/3844755638 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fae58065710 msgr2=0x7fae58067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:27.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.817+0000 7fae724ec640 1 --2- 172.21.15.55:0/3844755638 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fae58065710 0x7fae58067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fae600b2000 tx=0x7fae60008040 comp rx=0 tx=0).stop 2023-08-25T04:19:27.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.821+0000 7fae724ec640 1 -- 172.21.15.55:0/3844755638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6c0b2e40 msgr2=0x7fae6c151a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:27.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.821+0000 7fae724ec640 1 --2- 172.21.15.55:0/3844755638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6c0b2e40 0x7fae6c151a10 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fae5c001270 tx=0x7fae5c00ca50 comp rx=0 tx=0).stop 2023-08-25T04:19:27.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.821+0000 7fae724ec640 1 -- 172.21.15.55:0/3844755638 shutdown_connections 2023-08-25T04:19:27.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.821+0000 7fae724ec640 1 --2- 172.21.15.55:0/3844755638 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fae58065710 0x7fae58067bd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.821+0000 7fae724ec640 1 --2- 172.21.15.55:0/3844755638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c0d0da0 0x7fae6c06b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.821+0000 7fae724ec640 1 --2- 172.21.15.55:0/3844755638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6c0cdde0 0x7fae6c06b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.821+0000 7fae724ec640 1 --2- 172.21.15.55:0/3844755638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae6c0b2e40 0x7fae6c151a10 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.821+0000 7fae724ec640 1 -- 172.21.15.55:0/3844755638 >> 172.21.15.55:0/3844755638 conn(0x7fae6c09bae0 msgr2=0x7fae6c06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:27.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.821+0000 7fae724ec640 1 -- 172.21.15.55:0/3844755638 shutdown_connections 2023-08-25T04:19:27.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.821+0000 7fae724ec640 1 -- 172.21.15.55:0/3844755638 wait complete. 2023-08-25T04:19:27.841 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-25T04:19:27.866 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:27.864+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:27.868 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T04:19:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.993+0000 7f772b582640 1 Processor -- start 2023-08-25T04:19:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.993+0000 7f772b582640 1 -- start start 2023-08-25T04:19:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.993+0000 7f772b582640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f77241601f0 0x7f772415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.993+0000 7f772b582640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f772415e3c0 0x7f77240d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.993+0000 7f772b582640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f77240d10c0 0x7f77240b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.993+0000 7f772b582640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77240cd5a0 con 0x7f77240d10c0 2023-08-25T04:19:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.993+0000 7f772b582640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77240cd880 con 0x7f77241601f0 2023-08-25T04:19:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.993+0000 7f772b582640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77240cdb60 con 0x7f772415e3c0 2023-08-25T04:19:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.993+0000 7f7729b1f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f77240d10c0 0x7f77240b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.993+0000 7f7729b1f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f77240d10c0 0x7f77240b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58866/0 (socket says 172.21.15.55:58866) 2023-08-25T04:19:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.993+0000 7f7729b1f640 1 -- 172.21.15.55:0/625776817 learned_addr learned my addr 172.21.15.55:0/625776817 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.993+0000 7f772931e640 1 --2- 172.21.15.55:0/625776817 >> v2:172.21.15.110:3300/0 conn(0x7f77241601f0 0x7f772415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.993+0000 7f7728b1d640 1 --2- 172.21.15.55:0/625776817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f772415e3c0 0x7f77240d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.993+0000 7f7729b1f640 1 -- 172.21.15.55:0/625776817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f772415e3c0 msgr2=0x7f77240d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.993+0000 7f7729b1f640 1 --2- 172.21.15.55:0/625776817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f772415e3c0 0x7f77240d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.993+0000 7f7729b1f640 1 -- 172.21.15.55:0/625776817 >> v2:172.21.15.110:3300/0 conn(0x7f77241601f0 msgr2=0x7f772415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:27.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.993+0000 7f7729b1f640 1 --2- 172.21.15.55:0/625776817 >> v2:172.21.15.110:3300/0 conn(0x7f77241601f0 0x7f772415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.993+0000 7f7729b1f640 1 -- 172.21.15.55:0/625776817 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77240cde40 con 0x7f77240d10c0 2023-08-25T04:19:27.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.997+0000 7f7729b1f640 1 --2- 172.21.15.55:0/625776817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77240d10c0 0x7f77240b4250 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f772408b7f0 tx=0x7f771c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93121933462305ca server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.997+0000 7f771bfff640 1 -- 172.21.15.55:0/625776817 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c0af400 con 0x7f77240d10c0 2023-08-25T04:19:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.997+0000 7f771bfff640 1 -- 172.21.15.55:0/625776817 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771c0ab050 con 0x7f77240d10c0 2023-08-25T04:19:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.997+0000 7f771bfff640 1 -- 172.21.15.55:0/625776817 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c0af780 con 0x7f77240d10c0 2023-08-25T04:19:27.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.997+0000 7f772b582640 1 -- 172.21.15.55:0/625776817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77240d10c0 msgr2=0x7f77240b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:27.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.997+0000 7f772b582640 1 --2- 172.21.15.55:0/625776817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77240d10c0 0x7f77240b4250 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f772408b7f0 tx=0x7f771c01f1c0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.997+0000 7f772b582640 1 -- 172.21.15.55:0/625776817 shutdown_connections 2023-08-25T04:19:27.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.997+0000 7f772b582640 1 --2- 172.21.15.55:0/625776817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77240d10c0 0x7f77240b4250 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.997+0000 7f772b582640 1 --2- 172.21.15.55:0/625776817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f772415e3c0 0x7f77240d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:27.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.997+0000 7f772b582640 1 --2- 172.21.15.55:0/625776817 >> v2:172.21.15.110:3300/0 conn(0x7f77241601f0 0x7f772415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:28.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.997+0000 7f772b582640 1 -- 172.21.15.55:0/625776817 >> 172.21.15.55:0/625776817 conn(0x7f77240d27d0 msgr2=0x7f77240d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:28.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.997+0000 7f772b582640 1 -- 172.21.15.55:0/625776817 shutdown_connections 2023-08-25T04:19:28.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:27.997+0000 7f772b582640 1 -- 172.21.15.55:0/625776817 wait complete. 2023-08-25T04:19:28.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772b582640 1 Processor -- start 2023-08-25T04:19:28.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772b582640 1 -- start start 2023-08-25T04:19:28.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772b582640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77240d10c0 0x7f7724156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772b582640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f772415e3c0 0x7f77241f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772b582640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77241601f0 0x7f77240cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772b582640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77240c62e0 con 0x7f77240d10c0 2023-08-25T04:19:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772b582640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77240ca7e0 con 0x7f772415e3c0 2023-08-25T04:19:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772b582640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77241f68f0 con 0x7f77241601f0 2023-08-25T04:19:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772931e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77240d10c0 0x7f7724156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:28.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772931e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77240d10c0 0x7f7724156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58870/0 (socket says 172.21.15.55:58870) 2023-08-25T04:19:28.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772931e640 1 -- 172.21.15.55:0/108563612 learned_addr learned my addr 172.21.15.55:0/108563612 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:28.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f7729b1f640 1 --2- 172.21.15.55:0/108563612 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77241601f0 0x7f77240cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:28.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f7728b1d640 1 --2- 172.21.15.55:0/108563612 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f772415e3c0 0x7f77241f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:28.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772931e640 1 -- 172.21.15.55:0/108563612 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77241601f0 msgr2=0x7f77240cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:28.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772931e640 1 --2- 172.21.15.55:0/108563612 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77241601f0 0x7f77240cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:28.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772931e640 1 -- 172.21.15.55:0/108563612 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f772415e3c0 msgr2=0x7f77241f63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:28.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772931e640 1 --2- 172.21.15.55:0/108563612 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f772415e3c0 0x7f77241f63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:28.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772931e640 1 -- 172.21.15.55:0/108563612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771c009b30 con 0x7f77240d10c0 2023-08-25T04:19:28.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f7728b1d640 1 --2- 172.21.15.55:0/108563612 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f772415e3c0 0x7f77241f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:28.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772931e640 1 --2- 172.21.15.55:0/108563612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77240d10c0 0x7f7724156850 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f772000e8a0 tx=0x7f772000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:28.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f7719ffb640 1 -- 172.21.15.55:0/108563612 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77200095d0 con 0x7f77240d10c0 2023-08-25T04:19:28.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f7719ffb640 1 -- 172.21.15.55:0/108563612 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772000c8e0 con 0x7f77240d10c0 2023-08-25T04:19:28.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f7719ffb640 1 -- 172.21.15.55:0/108563612 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772000cc50 con 0x7f77240d10c0 2023-08-25T04:19:28.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772b582640 1 -- 172.21.15.55:0/108563612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77240ce7c0 con 0x7f77240d10c0 2023-08-25T04:19:28.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.001+0000 7f772b582640 1 -- 172.21.15.55:0/108563612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77240c9eb0 con 0x7f77240d10c0 2023-08-25T04:19:28.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.005+0000 7f772b582640 1 -- 172.21.15.55:0/108563612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7724073ec0 con 0x7f77240d10c0 2023-08-25T04:19:28.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.005+0000 7f7719ffb640 1 -- 172.21.15.55:0/108563612 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f7720013470 con 0x7f77240d10c0 2023-08-25T04:19:28.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.005+0000 7f7719ffb640 1 --2- 172.21.15.55:0/108563612 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7708065740 0x7f7708067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:28.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.005+0000 7f7719ffb640 1 -- 172.21.15.55:0/108563612 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f7720083610 con 0x7f77240d10c0 2023-08-25T04:19:28.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.005+0000 7f7728b1d640 1 --2- 172.21.15.55:0/108563612 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7708065740 0x7f7708067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:28.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.005+0000 7f7728b1d640 1 --2- 172.21.15.55:0/108563612 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7708065740 0x7f7708067c00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f77240cc5a0 tx=0x7f7714008040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:28.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.009+0000 7f7719ffb640 1 -- 172.21.15.55:0/108563612 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7720054810 con 0x7f77240d10c0 2023-08-25T04:19:28.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.205+0000 7f772b582640 1 -- 172.21.15.55:0/108563612 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f77240cefc0 con 0x7f77240d10c0 2023-08-25T04:19:28.545 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:28.540+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:28.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.817+0000 7f7719ffb640 1 -- 172.21.15.55:0/108563612 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7f77200543a0 con 0x7f77240d10c0 2023-08-25T04:19:28.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.817+0000 7f772b582640 1 -- 172.21.15.55:0/108563612 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7708065740 msgr2=0x7f7708067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:28.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.817+0000 7f772b582640 1 --2- 172.21.15.55:0/108563612 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7708065740 0x7f7708067c00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f77240cc5a0 tx=0x7f7714008040 comp rx=0 tx=0).stop 2023-08-25T04:19:28.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.817+0000 7f772b582640 1 -- 172.21.15.55:0/108563612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77240d10c0 msgr2=0x7f7724156850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:28.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.817+0000 7f772b582640 1 --2- 172.21.15.55:0/108563612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77240d10c0 0x7f7724156850 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f772000e8a0 tx=0x7f772000ed60 comp rx=0 tx=0).stop 2023-08-25T04:19:28.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.817+0000 7f772b582640 1 -- 172.21.15.55:0/108563612 shutdown_connections 2023-08-25T04:19:28.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.817+0000 7f772b582640 1 --2- 172.21.15.55:0/108563612 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7708065740 0x7f7708067c00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:28.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.817+0000 7f772b582640 1 --2- 172.21.15.55:0/108563612 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77241601f0 0x7f77240cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:28.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.817+0000 7f772b582640 1 --2- 172.21.15.55:0/108563612 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f772415e3c0 0x7f77241f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:28.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.817+0000 7f772b582640 1 --2- 172.21.15.55:0/108563612 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77240d10c0 0x7f7724156850 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:28.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.817+0000 7f772b582640 1 -- 172.21.15.55:0/108563612 >> 172.21.15.55:0/108563612 conn(0x7f77240d27d0 msgr2=0x7f772406aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:28.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.817+0000 7f772b582640 1 -- 172.21.15.55:0/108563612 shutdown_connections 2023-08-25T04:19:28.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:28.817+0000 7f772b582640 1 -- 172.21.15.55:0/108563612 wait complete. 2023-08-25T04:19:28.839 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-25T04:19:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.033+0000 7f0225759640 1 Processor -- start 2023-08-25T04:19:29.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.033+0000 7f0225759640 1 -- start start 2023-08-25T04:19:29.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.033+0000 7f0225759640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f022015cbe0 0x7f02200b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:29.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.033+0000 7f0225759640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02200cd260 0x7f02200cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:29.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.033+0000 7f0225759640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02200cdc00 con 0x7f02200cf230 2023-08-25T04:19:29.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.033+0000 7f0225759640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02200d0f70 con 0x7f022015cbe0 2023-08-25T04:19:29.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.033+0000 7f0225759640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0220160b80 con 0x7f02200cd260 2023-08-25T04:19:29.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.033+0000 7f021effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f022015cbe0 0x7f02200b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:29.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.033+0000 7f021effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f022015cbe0 0x7f02200b5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58878/0 (socket says 172.21.15.55:58878) 2023-08-25T04:19:29.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.033+0000 7f021effd640 1 -- 172.21.15.55:0/715902228 learned_addr learned my addr 172.21.15.55:0/715902228 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:29.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.033+0000 7f02167fc640 1 --2- 172.21.15.55:0/715902228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02200cd260 0x7f02200cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:29.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.033+0000 7f021effd640 1 -- 172.21.15.55:0/715902228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02200cd260 msgr2=0x7f02200cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:29.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.033+0000 7f021effd640 1 --2- 172.21.15.55:0/715902228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02200cd260 0x7f02200cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:29.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.033+0000 7f021effd640 1 -- 172.21.15.55:0/715902228 >> v1:172.21.15.110:6789/0 conn(0x7f02200cf230 legacy=0x7f02200cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:29.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.033+0000 7f021effd640 1 -- 172.21.15.55:0/715902228 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02200b6150 con 0x7f022015cbe0 2023-08-25T04:19:29.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.033+0000 7f02167fc640 1 --2- 172.21.15.55:0/715902228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02200cd260 0x7f02200cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:19:29.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.037+0000 7f021effd640 1 --2- 172.21.15.55:0/715902228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f022015cbe0 0x7f02200b5c10 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f0210009870 tx=0x7f021001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8a6e8534930791 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:29.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.037+0000 7f021e7fc640 1 -- 172.21.15.55:0/715902228 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02100aa670 con 0x7f022015cbe0 2023-08-25T04:19:29.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.037+0000 7f021e7fc640 1 -- 172.21.15.55:0/715902228 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02100aa7d0 con 0x7f022015cbe0 2023-08-25T04:19:29.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.037+0000 7f021e7fc640 1 -- 172.21.15.55:0/715902228 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02100aab60 con 0x7f022015cbe0 2023-08-25T04:19:29.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.037+0000 7f0225759640 1 -- 172.21.15.55:0/715902228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f022015cbe0 msgr2=0x7f02200b5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:29.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.037+0000 7f0225759640 1 --2- 172.21.15.55:0/715902228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f022015cbe0 0x7f02200b5c10 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f0210009870 tx=0x7f021001c510 comp rx=0 tx=0).stop 2023-08-25T04:19:29.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.037+0000 7f0225759640 1 -- 172.21.15.55:0/715902228 shutdown_connections 2023-08-25T04:19:29.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.037+0000 7f0225759640 1 --2- 172.21.15.55:0/715902228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02200cd260 0x7f02200cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:29.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.037+0000 7f0225759640 1 --2- 172.21.15.55:0/715902228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f022015cbe0 0x7f02200b5c10 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:29.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.037+0000 7f0225759640 1 -- 172.21.15.55:0/715902228 >> 172.21.15.55:0/715902228 conn(0x7f02200b4480 msgr2=0x7f02200b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:29.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.037+0000 7f0225759640 1 -- 172.21.15.55:0/715902228 shutdown_connections 2023-08-25T04:19:29.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.037+0000 7f0225759640 1 -- 172.21.15.55:0/715902228 wait complete. 2023-08-25T04:19:29.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f0225759640 1 Processor -- start 2023-08-25T04:19:29.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f0225759640 1 -- start start 2023-08-25T04:19:29.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f0225759640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02200cd260 0x7f022015b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:29.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f0225759640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02200cf230 0x7f022015be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:29.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f0225759640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f022015cbe0 0x7f02201528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:29.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f0225759640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02201f9390 con 0x7f02200cf230 2023-08-25T04:19:29.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f0225759640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022013c6b0 con 0x7f022015cbe0 2023-08-25T04:19:29.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f0225759640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022013c990 con 0x7f02200cd260 2023-08-25T04:19:29.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f02167fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02200cf230 0x7f022015be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:29.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f02167fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02200cf230 0x7f022015be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58888/0 (socket says 172.21.15.55:58888) 2023-08-25T04:19:29.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f02167fc640 1 -- 172.21.15.55:0/1772131328 learned_addr learned my addr 172.21.15.55:0/1772131328 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:29.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f021effd640 1 --2- 172.21.15.55:0/1772131328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02200cd260 0x7f022015b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:29.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f021f7fe640 1 --2- 172.21.15.55:0/1772131328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f022015cbe0 0x7f02201528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:29.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f02167fc640 1 -- 172.21.15.55:0/1772131328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02200cd260 msgr2=0x7f022015b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:29.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f02167fc640 1 --2- 172.21.15.55:0/1772131328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02200cd260 0x7f022015b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:29.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f02167fc640 1 -- 172.21.15.55:0/1772131328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f022015cbe0 msgr2=0x7f02201528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:29.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f02167fc640 1 --2- 172.21.15.55:0/1772131328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f022015cbe0 0x7f02201528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:29.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f02167fc640 1 -- 172.21.15.55:0/1772131328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02100094d0 con 0x7f02200cf230 2023-08-25T04:19:29.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f02167fc640 1 --2- 172.21.15.55:0/1772131328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02200cf230 0x7f022015be90 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f020800c7f0 tx=0x7f020800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:29.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f0217fff640 1 -- 172.21.15.55:0/1772131328 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208007820 con 0x7f02200cf230 2023-08-25T04:19:29.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f0217fff640 1 -- 172.21.15.55:0/1772131328 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0208007980 con 0x7f02200cf230 2023-08-25T04:19:29.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f0225759640 1 -- 172.21.15.55:0/1772131328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022013cc70 con 0x7f02200cf230 2023-08-25T04:19:29.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f0217fff640 1 -- 172.21.15.55:0/1772131328 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208007d30 con 0x7f02200cf230 2023-08-25T04:19:29.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.041+0000 7f0225759640 1 -- 172.21.15.55:0/1772131328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022013d230 con 0x7f02200cf230 2023-08-25T04:19:29.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.045+0000 7f0225759640 1 -- 172.21.15.55:0/1772131328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0220066d20 con 0x7f02200cf230 2023-08-25T04:19:29.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.045+0000 7f0217fff640 1 -- 172.21.15.55:0/1772131328 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f02080113f0 con 0x7f02200cf230 2023-08-25T04:19:29.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.045+0000 7f0217fff640 1 --2- 172.21.15.55:0/1772131328 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f0200065740 0x7f0200067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:29.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.045+0000 7f0217fff640 1 -- 172.21.15.55:0/1772131328 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f0208083440 con 0x7f02200cf230 2023-08-25T04:19:29.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.045+0000 7f021effd640 1 --2- 172.21.15.55:0/1772131328 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f0200065740 0x7f0200067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:29.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.045+0000 7f021effd640 1 --2- 172.21.15.55:0/1772131328 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f0200065740 0x7f0200067c00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f02100ae000 tx=0x7f02100b5040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:29.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.049+0000 7f0217fff640 1 -- 172.21.15.55:0/1772131328 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0208050c30 con 0x7f02200cf230 2023-08-25T04:19:29.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.205+0000 7f0225759640 1 -- 172.21.15.55:0/1772131328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f02200cd040 con 0x7f02200cf230 2023-08-25T04:19:29.225 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:29.224+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:29.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.821+0000 7f0217fff640 1 -- 172.21.15.55:0/1772131328 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0208054250 con 0x7f02200cf230 2023-08-25T04:19:29.821 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-08-25T04:19:29.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.825+0000 7f0225759640 1 -- 172.21.15.55:0/1772131328 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f0200065740 msgr2=0x7f0200067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:29.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.825+0000 7f0225759640 1 --2- 172.21.15.55:0/1772131328 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f0200065740 0x7f0200067c00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f02100ae000 tx=0x7f02100b5040 comp rx=0 tx=0).stop 2023-08-25T04:19:29.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.825+0000 7f0225759640 1 -- 172.21.15.55:0/1772131328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02200cf230 msgr2=0x7f022015be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:29.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.825+0000 7f0225759640 1 --2- 172.21.15.55:0/1772131328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02200cf230 0x7f022015be90 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f020800c7f0 tx=0x7f020800ccb0 comp rx=0 tx=0).stop 2023-08-25T04:19:29.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.825+0000 7f0225759640 1 -- 172.21.15.55:0/1772131328 shutdown_connections 2023-08-25T04:19:29.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.825+0000 7f0225759640 1 --2- 172.21.15.55:0/1772131328 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f022015cbe0 0x7f02201528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:29.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.825+0000 7f0225759640 1 --2- 172.21.15.55:0/1772131328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02200cf230 0x7f022015be90 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:29.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.825+0000 7f0225759640 1 --2- 172.21.15.55:0/1772131328 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f0200065740 0x7f0200067c00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:29.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.825+0000 7f0225759640 1 --2- 172.21.15.55:0/1772131328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02200cd260 0x7f022015b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:29.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.825+0000 7f0225759640 1 -- 172.21.15.55:0/1772131328 >> 172.21.15.55:0/1772131328 conn(0x7f02200b4480 msgr2=0x7f02200c5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:29.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.825+0000 7f0225759640 1 -- 172.21.15.55:0/1772131328 shutdown_connections 2023-08-25T04:19:29.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.825+0000 7f0225759640 1 -- 172.21.15.55:0/1772131328 wait complete. 2023-08-25T04:19:29.845 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-25T04:19:29.908 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:29.904+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:29.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.993+0000 7f2001db7640 1 Processor -- start 2023-08-25T04:19:29.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.993+0000 7f2001db7640 1 -- start start 2023-08-25T04:19:29.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.997+0000 7f2001db7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1ffc0b4080 0x7f1ffc0b4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:29.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.997+0000 7f2001db7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1ffc0b23b0 0x7f1ffc0b2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:29.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.997+0000 7f2001db7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ffc0b1b90 con 0x7f1ffc160120 2023-08-25T04:19:29.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.997+0000 7f2001db7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ffc0b4a50 con 0x7f1ffc0b23b0 2023-08-25T04:19:29.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.997+0000 7f2001db7640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ffc0b1f20 con 0x7f1ffc0b4080 2023-08-25T04:19:29.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.997+0000 7f20015b6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1ffc0b23b0 0x7f1ffc0b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:29.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.997+0000 7f20015b6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1ffc0b23b0 0x7f1ffc0b2840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58902/0 (socket says 172.21.15.55:58902) 2023-08-25T04:19:29.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.997+0000 7f20015b6640 1 -- 172.21.15.55:0/3146257103 learned_addr learned my addr 172.21.15.55:0/3146257103 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:29.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.997+0000 7f2000db5640 1 --1- 172.21.15.55:0/3146257103 >> v1:172.21.15.55:6789/0 conn(0x7f1ffc160120 0x7f1ffc0b1480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54264/0 (socket says 172.21.15.55:54264) 2023-08-25T04:19:29.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.997+0000 7f1ff3fff640 1 --2- 172.21.15.55:0/3146257103 >> v2:172.21.15.110:3300/0 conn(0x7f1ffc0b4080 0x7f1ffc0b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:29.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.997+0000 7f20015b6640 1 -- 172.21.15.55:0/3146257103 >> v2:172.21.15.110:3300/0 conn(0x7f1ffc0b4080 msgr2=0x7f1ffc0b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:29.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.997+0000 7f20015b6640 1 --2- 172.21.15.55:0/3146257103 >> v2:172.21.15.110:3300/0 conn(0x7f1ffc0b4080 0x7f1ffc0b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:29.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.997+0000 7f20015b6640 1 -- 172.21.15.55:0/3146257103 >> v1:172.21.15.55:6789/0 conn(0x7f1ffc160120 legacy=0x7f1ffc0b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:29.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.997+0000 7f20015b6640 1 -- 172.21.15.55:0/3146257103 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc0cddf0 con 0x7f1ffc0b23b0 2023-08-25T04:19:29.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:29.997+0000 7f1ff37fe640 1 -- 172.21.15.55:0/3146257103 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282639424 0 0) 0x7f1ff80011e0 con 0x7f1ffc160120 2023-08-25T04:19:29.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.001+0000 7f20015b6640 1 --2- 172.21.15.55:0/3146257103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ffc0b23b0 0x7f1ffc0b2840 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009e50 tx=0x7f1ff401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5b6f733c7819b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:30.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.001+0000 7f1ff37fe640 1 -- 172.21.15.55:0/3146257103 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff40a5860 con 0x7f1ffc0b23b0 2023-08-25T04:19:30.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.001+0000 7f1ff37fe640 1 -- 172.21.15.55:0/3146257103 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff40a59c0 con 0x7f1ffc0b23b0 2023-08-25T04:19:30.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.001+0000 7f1ff37fe640 1 -- 172.21.15.55:0/3146257103 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff40a5d50 con 0x7f1ffc0b23b0 2023-08-25T04:19:30.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.001+0000 7f2001db7640 1 -- 172.21.15.55:0/3146257103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ffc0b23b0 msgr2=0x7f1ffc0b2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:30.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.001+0000 7f2001db7640 1 --2- 172.21.15.55:0/3146257103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ffc0b23b0 0x7f1ffc0b2840 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009e50 tx=0x7f1ff401c9a0 comp rx=0 tx=0).stop 2023-08-25T04:19:30.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.001+0000 7f2001db7640 1 -- 172.21.15.55:0/3146257103 shutdown_connections 2023-08-25T04:19:30.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.001+0000 7f2001db7640 1 --2- 172.21.15.55:0/3146257103 >> v2:172.21.15.110:3300/0 conn(0x7f1ffc0b4080 0x7f1ffc0b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:30.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.001+0000 7f2001db7640 1 --2- 172.21.15.55:0/3146257103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ffc0b23b0 0x7f1ffc0b2840 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:30.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.001+0000 7f2001db7640 1 -- 172.21.15.55:0/3146257103 >> 172.21.15.55:0/3146257103 conn(0x7f1ffc09b950 msgr2=0x7f1ffc0d2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:30.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.001+0000 7f2001db7640 1 -- 172.21.15.55:0/3146257103 shutdown_connections 2023-08-25T04:19:30.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.001+0000 7f2001db7640 1 -- 172.21.15.55:0/3146257103 wait complete. 2023-08-25T04:19:30.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.001+0000 7f2001db7640 1 Processor -- start 2023-08-25T04:19:30.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.001+0000 7f2001db7640 1 -- start start 2023-08-25T04:19:30.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f2001db7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ffc0b23b0 0x7f1ffc0c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:30.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f2001db7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ffc0b4080 0x7f1ffc0c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:30.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f2001db7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ffc160120 0x7f1ffc15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:30.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f2001db7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0ca4e0 con 0x7f1ffc0b4080 2023-08-25T04:19:30.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f2001db7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0c9c40 con 0x7f1ffc160120 2023-08-25T04:19:30.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f2001db7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0c9f20 con 0x7f1ffc0b23b0 2023-08-25T04:19:30.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f1ff3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ffc0b4080 0x7f1ffc0c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:30.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f1ff3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ffc0b4080 0x7f1ffc0c8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58916/0 (socket says 172.21.15.55:58916) 2023-08-25T04:19:30.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f1ff3fff640 1 -- 172.21.15.55:0/2512603302 learned_addr learned my addr 172.21.15.55:0/2512603302 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:30.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f20015b6640 1 --2- 172.21.15.55:0/2512603302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ffc160120 0x7f1ffc15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:30.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f2000db5640 1 --2- 172.21.15.55:0/2512603302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ffc0b23b0 0x7f1ffc0c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:30.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f1ff3fff640 1 -- 172.21.15.55:0/2512603302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ffc0b23b0 msgr2=0x7f1ffc0c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:30.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f1ff3fff640 1 --2- 172.21.15.55:0/2512603302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ffc0b23b0 0x7f1ffc0c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:30.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f1ff3fff640 1 -- 172.21.15.55:0/2512603302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ffc160120 msgr2=0x7f1ffc15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:30.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f1ff3fff640 1 --2- 172.21.15.55:0/2512603302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ffc160120 0x7f1ffc15ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:30.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f1ff3fff640 1 -- 172.21.15.55:0/2512603302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff4009b30 con 0x7f1ffc0b4080 2023-08-25T04:19:30.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f1ff3fff640 1 --2- 172.21.15.55:0/2512603302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ffc0b4080 0x7f1ffc0c8c80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00e930 tx=0x7f1fec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:30.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f1ff17fa640 1 -- 172.21.15.55:0/2512603302 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec009690 con 0x7f1ffc0b4080 2023-08-25T04:19:30.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f1ff17fa640 1 -- 172.21.15.55:0/2512603302 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fec00ca00 con 0x7f1ffc0b4080 2023-08-25T04:19:30.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f1ff17fa640 1 -- 172.21.15.55:0/2512603302 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec00cd70 con 0x7f1ffc0b4080 2023-08-25T04:19:30.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f2001db7640 1 -- 172.21.15.55:0/2512603302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ffc0ca200 con 0x7f1ffc0b4080 2023-08-25T04:19:30.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f2001db7640 1 -- 172.21.15.55:0/2512603302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ffc1591c0 con 0x7f1ffc0b4080 2023-08-25T04:19:30.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.005+0000 7f2001db7640 1 -- 172.21.15.55:0/2512603302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ffc073e50 con 0x7f1ffc0b4080 2023-08-25T04:19:30.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.009+0000 7f1ff17fa640 1 -- 172.21.15.55:0/2512603302 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f1fec013470 con 0x7f1ffc0b4080 2023-08-25T04:19:30.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.009+0000 7f1ff17fa640 1 --2- 172.21.15.55:0/2512603302 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f1fe8065710 0x7f1fe8067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:30.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.009+0000 7f1ff17fa640 1 -- 172.21.15.55:0/2512603302 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6398+0+0 (secure 0 0 0) 0x7f1fec0830b0 con 0x7f1ffc0b4080 2023-08-25T04:19:30.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.009+0000 7f2000db5640 1 --2- 172.21.15.55:0/2512603302 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f1fe8065710 0x7f1fe8067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:30.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.009+0000 7f2000db5640 1 --2- 172.21.15.55:0/2512603302 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f1fe8065710 0x7f1fe8067bd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8007fd0 tx=0x7f1ff8009040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:30.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.013+0000 7f1ff17fa640 1 -- 172.21.15.55:0/2512603302 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1fec050c30 con 0x7f1ffc0b4080 2023-08-25T04:19:30.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.181+0000 7f2001db7640 1 -- 172.21.15.55:0/2512603302 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1ffc0d3360 con 0x7f1ffc0b4080 2023-08-25T04:19:30.385 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:19:30.389 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:19:30.608 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:30.604+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:30.828 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-08-25T04:19:30.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.829+0000 7f1ff17fa640 1 -- 172.21.15.55:0/2512603302 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1fec054250 con 0x7f1ffc0b4080 2023-08-25T04:19:30.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.833+0000 7f2001db7640 1 -- 172.21.15.55:0/2512603302 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f1fe8065710 msgr2=0x7f1fe8067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:30.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.833+0000 7f2001db7640 1 --2- 172.21.15.55:0/2512603302 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f1fe8065710 0x7f1fe8067bd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8007fd0 tx=0x7f1ff8009040 comp rx=0 tx=0).stop 2023-08-25T04:19:30.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.833+0000 7f2001db7640 1 -- 172.21.15.55:0/2512603302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ffc0b4080 msgr2=0x7f1ffc0c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:30.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.833+0000 7f2001db7640 1 --2- 172.21.15.55:0/2512603302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ffc0b4080 0x7f1ffc0c8c80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00e930 tx=0x7f1fec00edf0 comp rx=0 tx=0).stop 2023-08-25T04:19:30.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.833+0000 7f2001db7640 1 -- 172.21.15.55:0/2512603302 shutdown_connections 2023-08-25T04:19:30.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.833+0000 7f2001db7640 1 --2- 172.21.15.55:0/2512603302 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ffc160120 0x7f1ffc15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:30.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.833+0000 7f2001db7640 1 --2- 172.21.15.55:0/2512603302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ffc0b4080 0x7f1ffc0c8c80 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:30.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.833+0000 7f2001db7640 1 --2- 172.21.15.55:0/2512603302 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f1fe8065710 0x7f1fe8067bd0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:30.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.833+0000 7f2001db7640 1 --2- 172.21.15.55:0/2512603302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ffc0b23b0 0x7f1ffc0c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:30.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.833+0000 7f2001db7640 1 -- 172.21.15.55:0/2512603302 >> 172.21.15.55:0/2512603302 conn(0x7f1ffc09b950 msgr2=0x7f1ffc0b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:30.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.833+0000 7f2001db7640 1 -- 172.21.15.55:0/2512603302 shutdown_connections 2023-08-25T04:19:30.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:30.833+0000 7f2001db7640 1 -- 172.21.15.55:0/2512603302 wait complete. 2023-08-25T04:19:30.856 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-08-25T04:19:31.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.005+0000 7f853053a640 1 Processor -- start 2023-08-25T04:19:31.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.005+0000 7f853053a640 1 -- start start 2023-08-25T04:19:31.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.005+0000 7f853053a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f852815e3c0 0x7f852815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:31.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.005+0000 7f853053a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85280cd5a0 con 0x7f85281601f0 2023-08-25T04:19:31.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.005+0000 7f853053a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85280cd880 con 0x7f85280d1290 2023-08-25T04:19:31.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.005+0000 7f853053a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85280cdb60 con 0x7f852815e3c0 2023-08-25T04:19:31.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.005+0000 7f852e2d6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f85281601f0 0x7f85280d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56136/0 (socket says 172.21.15.55:56136) 2023-08-25T04:19:31.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.005+0000 7f852e2d6640 1 -- 172.21.15.55:0/4186988004 learned_addr learned my addr 172.21.15.55:0/4186988004 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:31.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.005+0000 7f852dad5640 1 --2- 172.21.15.55:0/4186988004 >> v2:172.21.15.55:3300/0 conn(0x7f852815e3c0 0x7f852815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:31.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.005+0000 7f852dad5640 1 -- 172.21.15.55:0/4186988004 >> v1:172.21.15.110:6789/0 conn(0x7f85280d1290 legacy=0x7f852815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:31.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.005+0000 7f852dad5640 1 -- 172.21.15.55:0/4186988004 >> v1:172.21.15.55:6789/0 conn(0x7f85281601f0 legacy=0x7f85280d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:31.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.005+0000 7f852d2d4640 1 -- 172.21.15.55:0/4186988004 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328671705 0 0) 0x7f85280cd5a0 con 0x7f85281601f0 2023-08-25T04:19:31.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.005+0000 7f852dad5640 1 -- 172.21.15.55:0/4186988004 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85280cde40 con 0x7f852815e3c0 2023-08-25T04:19:31.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.009+0000 7f852dad5640 1 --2- 172.21.15.55:0/4186988004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f852815e3c0 0x7f852815d430 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f85180097c0 tx=0x7f851801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece76c4ee75580fa server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:31.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.009+0000 7f852d2d4640 1 -- 172.21.15.55:0/4186988004 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85180ab600 con 0x7f852815e3c0 2023-08-25T04:19:31.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.009+0000 7f852d2d4640 1 -- 172.21.15.55:0/4186988004 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85180a7050 con 0x7f852815e3c0 2023-08-25T04:19:31.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.009+0000 7f852d2d4640 1 -- 172.21.15.55:0/4186988004 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85180ab980 con 0x7f852815e3c0 2023-08-25T04:19:31.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.009+0000 7f853053a640 1 -- 172.21.15.55:0/4186988004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f852815e3c0 msgr2=0x7f852815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:31.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.009+0000 7f853053a640 1 --2- 172.21.15.55:0/4186988004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f852815e3c0 0x7f852815d430 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f85180097c0 tx=0x7f851801c450 comp rx=0 tx=0).stop 2023-08-25T04:19:31.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.009+0000 7f853053a640 1 -- 172.21.15.55:0/4186988004 shutdown_connections 2023-08-25T04:19:31.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.009+0000 7f853053a640 1 --2- 172.21.15.55:0/4186988004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f852815e3c0 0x7f852815d430 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.009+0000 7f853053a640 1 -- 172.21.15.55:0/4186988004 >> 172.21.15.55:0/4186988004 conn(0x7f85280d27d0 msgr2=0x7f85280d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:31.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.009+0000 7f853053a640 1 -- 172.21.15.55:0/4186988004 shutdown_connections 2023-08-25T04:19:31.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.009+0000 7f853053a640 1 -- 172.21.15.55:0/4186988004 wait complete. 2023-08-25T04:19:31.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f853053a640 1 Processor -- start 2023-08-25T04:19:31.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f853053a640 1 -- start start 2023-08-25T04:19:31.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f853053a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85280d1290 0x7f8528156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:31.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f853053a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f852815e3c0 0x7f8528151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:31.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f853053a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85281601f0 0x7f85280c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:31.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f853053a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8528156600 con 0x7f85280d1290 2023-08-25T04:19:31.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f853053a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8528158140 con 0x7f85281601f0 2023-08-25T04:19:31.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f853053a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8528155fb0 con 0x7f852815e3c0 2023-08-25T04:19:31.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f852e2d6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85280d1290 0x7f8528156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:31.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f852e2d6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85280d1290 0x7f8528156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41870/0 (socket says 172.21.15.55:41870) 2023-08-25T04:19:31.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f852e2d6640 1 -- 172.21.15.55:0/2099087895 learned_addr learned my addr 172.21.15.55:0/2099087895 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:31.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f852ead7640 1 --2- 172.21.15.55:0/2099087895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85281601f0 0x7f85280c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:31.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f852dad5640 1 --2- 172.21.15.55:0/2099087895 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f852815e3c0 0x7f8528151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:31.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f852e2d6640 1 -- 172.21.15.55:0/2099087895 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f852815e3c0 msgr2=0x7f8528151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:31.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f852e2d6640 1 --2- 172.21.15.55:0/2099087895 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f852815e3c0 0x7f8528151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f852e2d6640 1 -- 172.21.15.55:0/2099087895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85281601f0 msgr2=0x7f85280c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:31.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f852e2d6640 1 --2- 172.21.15.55:0/2099087895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85281601f0 0x7f85280c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f852e2d6640 1 -- 172.21.15.55:0/2099087895 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8518009420 con 0x7f85280d1290 2023-08-25T04:19:31.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f852e2d6640 1 --2- 172.21.15.55:0/2099087895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85280d1290 0x7f8528156ff0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f852400c3f0 tx=0x7f852400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:31.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f851effd640 1 -- 172.21.15.55:0/2099087895 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85240074e0 con 0x7f85280d1290 2023-08-25T04:19:31.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f851effd640 1 -- 172.21.15.55:0/2099087895 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8524007640 con 0x7f85280d1290 2023-08-25T04:19:31.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f853053a640 1 -- 172.21.15.55:0/2099087895 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8528156290 con 0x7f85280d1290 2023-08-25T04:19:31.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f851effd640 1 -- 172.21.15.55:0/2099087895 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85240059f0 con 0x7f85280d1290 2023-08-25T04:19:31.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.013+0000 7f853053a640 1 -- 172.21.15.55:0/2099087895 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8528154cf0 con 0x7f85280d1290 2023-08-25T04:19:31.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.017+0000 7f853053a640 1 -- 172.21.15.55:0/2099087895 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85280b5260 con 0x7f85280d1290 2023-08-25T04:19:31.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.017+0000 7f851effd640 1 -- 172.21.15.55:0/2099087895 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f8524005b50 con 0x7f85280d1290 2023-08-25T04:19:31.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.017+0000 7f851effd640 1 --2- 172.21.15.55:0/2099087895 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f850c065710 0x7f850c067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:31.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.017+0000 7f851effd640 1 -- 172.21.15.55:0/2099087895 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f8524082230 con 0x7f85280d1290 2023-08-25T04:19:31.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.017+0000 7f852dad5640 1 --2- 172.21.15.55:0/2099087895 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f850c065710 0x7f850c067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:31.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.017+0000 7f852dad5640 1 --2- 172.21.15.55:0/2099087895 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f850c065710 0x7f850c067bd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f85180ad000 tx=0x7f85180a6000 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:31.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.021+0000 7f851effd640 1 -- 172.21.15.55:0/2099087895 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f852404feb0 con 0x7f85280d1290 2023-08-25T04:19:31.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.193+0000 7f853053a640 1 -- 172.21.15.55:0/2099087895 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f8528073ec0 con 0x7f85280d1290 2023-08-25T04:19:31.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.197+0000 7f851effd640 1 -- 172.21.15.55:0/2099087895 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v31) v1 ==== 115+0+0 (secure 0 0 0) 0x7f85240534d0 con 0x7f85280d1290 2023-08-25T04:19:31.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.201+0000 7f853053a640 1 -- 172.21.15.55:0/2099087895 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f850c065710 msgr2=0x7f850c067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:31.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.201+0000 7f853053a640 1 --2- 172.21.15.55:0/2099087895 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f850c065710 0x7f850c067bd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f85180ad000 tx=0x7f85180a6000 comp rx=0 tx=0).stop 2023-08-25T04:19:31.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.201+0000 7f853053a640 1 -- 172.21.15.55:0/2099087895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85280d1290 msgr2=0x7f8528156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:31.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.201+0000 7f853053a640 1 --2- 172.21.15.55:0/2099087895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85280d1290 0x7f8528156ff0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f852400c3f0 tx=0x7f852400c8b0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.201+0000 7f853053a640 1 -- 172.21.15.55:0/2099087895 shutdown_connections 2023-08-25T04:19:31.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.201+0000 7f853053a640 1 --2- 172.21.15.55:0/2099087895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85281601f0 0x7f85280c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.201+0000 7f853053a640 1 --2- 172.21.15.55:0/2099087895 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f850c065710 0x7f850c067bd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.201+0000 7f853053a640 1 --2- 172.21.15.55:0/2099087895 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f852815e3c0 0x7f8528151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.201+0000 7f853053a640 1 --2- 172.21.15.55:0/2099087895 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85280d1290 0x7f8528156ff0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.201+0000 7f853053a640 1 -- 172.21.15.55:0/2099087895 >> 172.21.15.55:0/2099087895 conn(0x7f85280d27d0 msgr2=0x7f852806bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:31.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.201+0000 7f853053a640 1 -- 172.21.15.55:0/2099087895 shutdown_connections 2023-08-25T04:19:31.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.201+0000 7f853053a640 1 -- 172.21.15.55:0/2099087895 wait complete. 2023-08-25T04:19:31.219 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-25T04:19:31.314 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:31.312+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:31.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff63d52c640 1 Processor -- start 2023-08-25T04:19:31.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff63d52c640 1 -- start start 2023-08-25T04:19:31.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff63d52c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6381601f0 0x7ff63815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:31.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff63d52c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff63815e3c0 0x7ff6380d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:31.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff63d52c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff6380d10c0 0x7ff6380b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:31.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff63d52c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6380cd5a0 con 0x7ff6381601f0 2023-08-25T04:19:31.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff63d52c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6380cd880 con 0x7ff6380d10c0 2023-08-25T04:19:31.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff63d52c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6380cdb60 con 0x7ff63815e3c0 2023-08-25T04:19:31.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff636ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6381601f0 0x7ff63815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:31.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff636ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6381601f0 0x7ff63815d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41880/0 (socket says 172.21.15.55:41880) 2023-08-25T04:19:31.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff636ffd640 1 -- 172.21.15.55:0/73276613 learned_addr learned my addr 172.21.15.55:0/73276613 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:31.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff6367fc640 1 --2- 172.21.15.55:0/73276613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff63815e3c0 0x7ff6380d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:31.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff6377fe640 1 --2- 172.21.15.55:0/73276613 >> v2:172.21.15.110:3300/0 conn(0x7ff6380d10c0 0x7ff6380b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:31.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff636ffd640 1 -- 172.21.15.55:0/73276613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff63815e3c0 msgr2=0x7ff6380d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:31.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff636ffd640 1 --2- 172.21.15.55:0/73276613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff63815e3c0 0x7ff6380d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff636ffd640 1 -- 172.21.15.55:0/73276613 >> v2:172.21.15.110:3300/0 conn(0x7ff6380d10c0 msgr2=0x7ff6380b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:31.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff636ffd640 1 --2- 172.21.15.55:0/73276613 >> v2:172.21.15.110:3300/0 conn(0x7ff6380d10c0 0x7ff6380b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff636ffd640 1 -- 172.21.15.55:0/73276613 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6380cde40 con 0x7ff6381601f0 2023-08-25T04:19:31.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff6367fc640 1 --2- 172.21.15.55:0/73276613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff63815e3c0 0x7ff6380d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:31.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.369+0000 7ff6377fe640 1 --2- 172.21.15.55:0/73276613 >> v2:172.21.15.110:3300/0 conn(0x7ff6380d10c0 0x7ff6380b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:31.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.373+0000 7ff636ffd640 1 --2- 172.21.15.55:0/73276613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6381601f0 0x7ff63815d430 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7ff6380d0540 tx=0x7ff62801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd238ed7de64aee server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:31.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.373+0000 7ff635ffb640 1 -- 172.21.15.55:0/73276613 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6280a89b0 con 0x7ff6381601f0 2023-08-25T04:19:31.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.373+0000 7ff635ffb640 1 -- 172.21.15.55:0/73276613 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6280a8b10 con 0x7ff6381601f0 2023-08-25T04:19:31.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.373+0000 7ff635ffb640 1 -- 172.21.15.55:0/73276613 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6280a8ea0 con 0x7ff6381601f0 2023-08-25T04:19:31.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.373+0000 7ff63d52c640 1 -- 172.21.15.55:0/73276613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6381601f0 msgr2=0x7ff63815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:31.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.373+0000 7ff63d52c640 1 --2- 172.21.15.55:0/73276613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6381601f0 0x7ff63815d430 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7ff6380d0540 tx=0x7ff62801ecf0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.373+0000 7ff63d52c640 1 -- 172.21.15.55:0/73276613 shutdown_connections 2023-08-25T04:19:31.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.373+0000 7ff63d52c640 1 --2- 172.21.15.55:0/73276613 >> v2:172.21.15.110:3300/0 conn(0x7ff6380d10c0 0x7ff6380b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.373+0000 7ff63d52c640 1 --2- 172.21.15.55:0/73276613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff63815e3c0 0x7ff6380d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.373+0000 7ff63d52c640 1 --2- 172.21.15.55:0/73276613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6381601f0 0x7ff63815d430 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.373+0000 7ff63d52c640 1 -- 172.21.15.55:0/73276613 >> 172.21.15.55:0/73276613 conn(0x7ff6380d27d0 msgr2=0x7ff6380d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:31.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.373+0000 7ff63d52c640 1 -- 172.21.15.55:0/73276613 shutdown_connections 2023-08-25T04:19:31.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.373+0000 7ff63d52c640 1 -- 172.21.15.55:0/73276613 wait complete. 2023-08-25T04:19:31.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff63d52c640 1 Processor -- start 2023-08-25T04:19:31.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff63d52c640 1 -- start start 2023-08-25T04:19:31.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff63d52c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6380d10c0 0x7ff6380b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:31.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff63d52c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff63815e3c0 0x7ff6380b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:31.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff63d52c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6381601f0 0x7ff6381535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:31.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff63d52c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6380b7360 con 0x7ff63815e3c0 2023-08-25T04:19:31.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff63d52c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6381545c0 con 0x7ff6381601f0 2023-08-25T04:19:31.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff63d52c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff638153b30 con 0x7ff6380d10c0 2023-08-25T04:19:31.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff6367fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff63815e3c0 0x7ff6380b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:31.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff636ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6380d10c0 0x7ff6380b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:31.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff636ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6380d10c0 0x7ff6380b53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:52864/0 (socket says 172.21.15.55:52864) 2023-08-25T04:19:31.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff636ffd640 1 -- 172.21.15.55:0/566968153 learned_addr learned my addr 172.21.15.55:0/566968153 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:31.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff6377fe640 1 --2- 172.21.15.55:0/566968153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6381601f0 0x7ff6381535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:31.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff636ffd640 1 -- 172.21.15.55:0/566968153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6381601f0 msgr2=0x7ff6381535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:31.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff636ffd640 1 --2- 172.21.15.55:0/566968153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6381601f0 0x7ff6381535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff636ffd640 1 -- 172.21.15.55:0/566968153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff63815e3c0 msgr2=0x7ff6380b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:31.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff636ffd640 1 --2- 172.21.15.55:0/566968153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff63815e3c0 0x7ff6380b75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff636ffd640 1 -- 172.21.15.55:0/566968153 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff628009480 con 0x7ff6380d10c0 2023-08-25T04:19:31.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff636ffd640 1 --2- 172.21.15.55:0/566968153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6380d10c0 0x7ff6380b53f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff62801f590 tx=0x7ff62801ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:31.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff61f7fe640 1 -- 172.21.15.55:0/566968153 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff628003820 con 0x7ff6380d10c0 2023-08-25T04:19:31.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff61f7fe640 1 -- 172.21.15.55:0/566968153 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff628003980 con 0x7ff6380d10c0 2023-08-25T04:19:31.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff63d52c640 1 -- 172.21.15.55:0/566968153 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6380ce7c0 con 0x7ff6380d10c0 2023-08-25T04:19:31.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff61f7fe640 1 -- 172.21.15.55:0/566968153 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff628003d10 con 0x7ff6380d10c0 2023-08-25T04:19:31.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.377+0000 7ff63d52c640 1 -- 172.21.15.55:0/566968153 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6380b5cb0 con 0x7ff6380d10c0 2023-08-25T04:19:31.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.381+0000 7ff63d52c640 1 -- 172.21.15.55:0/566968153 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6380b5260 con 0x7ff6380d10c0 2023-08-25T04:19:31.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.381+0000 7ff61f7fe640 1 -- 172.21.15.55:0/566968153 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7ff6280b7070 con 0x7ff6380d10c0 2023-08-25T04:19:31.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.381+0000 7ff61f7fe640 1 --2- 172.21.15.55:0/566968153 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7ff624065740 0x7ff624067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:31.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.381+0000 7ff61f7fe640 1 -- 172.21.15.55:0/566968153 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5984+0+0 (secure 0 0 0) 0x7ff6281204a0 con 0x7ff6380d10c0 2023-08-25T04:19:31.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.381+0000 7ff6367fc640 1 --2- 172.21.15.55:0/566968153 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7ff624065740 0x7ff624067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:31.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.381+0000 7ff6367fc640 1 --2- 172.21.15.55:0/566968153 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7ff624065740 0x7ff624067c00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff6380cea80 tx=0x7ff62c008040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:31.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.385+0000 7ff61f7fe640 1 -- 172.21.15.55:0/566968153 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff6280ee020 con 0x7ff6380d10c0 2023-08-25T04:19:31.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.545+0000 7ff63d52c640 1 -- 172.21.15.55:0/566968153 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ff638073ec0 con 0x7ff6380d10c0 2023-08-25T04:19:31.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.553+0000 7ff61f7fe640 1 -- 172.21.15.55:0/566968153 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v32) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff6280f1640 con 0x7ff6380d10c0 2023-08-25T04:19:31.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.557+0000 7ff63d52c640 1 -- 172.21.15.55:0/566968153 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7ff624065740 msgr2=0x7ff624067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:31.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.557+0000 7ff63d52c640 1 --2- 172.21.15.55:0/566968153 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7ff624065740 0x7ff624067c00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff6380cea80 tx=0x7ff62c008040 comp rx=0 tx=0).stop 2023-08-25T04:19:31.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.557+0000 7ff63d52c640 1 -- 172.21.15.55:0/566968153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6380d10c0 msgr2=0x7ff6380b53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:31.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.557+0000 7ff63d52c640 1 --2- 172.21.15.55:0/566968153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6380d10c0 0x7ff6380b53f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff62801f590 tx=0x7ff62801ba90 comp rx=0 tx=0).stop 2023-08-25T04:19:31.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.557+0000 7ff63d52c640 1 -- 172.21.15.55:0/566968153 shutdown_connections 2023-08-25T04:19:31.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.557+0000 7ff63d52c640 1 --2- 172.21.15.55:0/566968153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6381601f0 0x7ff6381535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.557+0000 7ff63d52c640 1 --2- 172.21.15.55:0/566968153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff63815e3c0 0x7ff6380b75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.557+0000 7ff63d52c640 1 --2- 172.21.15.55:0/566968153 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7ff624065740 0x7ff624067c00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.557+0000 7ff63d52c640 1 --2- 172.21.15.55:0/566968153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6380d10c0 0x7ff6380b53f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.557+0000 7ff63d52c640 1 -- 172.21.15.55:0/566968153 >> 172.21.15.55:0/566968153 conn(0x7ff6380d27d0 msgr2=0x7ff6380cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:31.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.557+0000 7ff63d52c640 1 -- 172.21.15.55:0/566968153 shutdown_connections 2023-08-25T04:19:31.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.557+0000 7ff63d52c640 1 -- 172.21.15.55:0/566968153 wait complete. 2023-08-25T04:19:31.575 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-25T04:19:31.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.725+0000 7fd9228cb640 1 Processor -- start 2023-08-25T04:19:31.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.725+0000 7fd9228cb640 1 -- start start 2023-08-25T04:19:31.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.725+0000 7fd9228cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd91c1601f0 0x7fd91c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:31.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.725+0000 7fd9228cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd91c15e3c0 0x7fd91c0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:31.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.725+0000 7fd9228cb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91c15f8b0 con 0x7fd91c0d10c0 2023-08-25T04:19:31.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.725+0000 7fd9228cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91c0cd5a0 con 0x7fd91c1601f0 2023-08-25T04:19:31.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.725+0000 7fd9228cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0cd880 con 0x7fd91c15e3c0 2023-08-25T04:19:31.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.725+0000 7fd91bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd91c1601f0 0x7fd91c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:31.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.725+0000 7fd91bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd91c1601f0 0x7fd91c15d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41892/0 (socket says 172.21.15.55:41892) 2023-08-25T04:19:31.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.725+0000 7fd91bfff640 1 -- 172.21.15.55:0/1421943019 learned_addr learned my addr 172.21.15.55:0/1421943019 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:31.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.725+0000 7fd91b7fe640 1 --2- 172.21.15.55:0/1421943019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd91c15e3c0 0x7fd91c0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:31.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.725+0000 7fd91bfff640 1 -- 172.21.15.55:0/1421943019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd91c15e3c0 msgr2=0x7fd91c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:31.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.725+0000 7fd91bfff640 1 --2- 172.21.15.55:0/1421943019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd91c15e3c0 0x7fd91c0d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.725+0000 7fd91bfff640 1 -- 172.21.15.55:0/1421943019 >> v1:172.21.15.110:6789/0 conn(0x7fd91c0d10c0 legacy=0x7fd91c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:31.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.725+0000 7fd91bfff640 1 -- 172.21.15.55:0/1421943019 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c0cdb60 con 0x7fd91c1601f0 2023-08-25T04:19:31.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.729+0000 7fd91bfff640 1 --2- 172.21.15.55:0/1421943019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd91c1601f0 0x7fd91c15d430 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fd90c006fd0 tx=0x7fd90c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23fd39d97bcdad96 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:31.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.729+0000 7fd91affd640 1 -- 172.21.15.55:0/1421943019 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0a8a10 con 0x7fd91c1601f0 2023-08-25T04:19:31.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.729+0000 7fd91affd640 1 -- 172.21.15.55:0/1421943019 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c0a8b70 con 0x7fd91c1601f0 2023-08-25T04:19:31.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.729+0000 7fd91affd640 1 -- 172.21.15.55:0/1421943019 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0b0440 con 0x7fd91c1601f0 2023-08-25T04:19:31.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.729+0000 7fd9228cb640 1 -- 172.21.15.55:0/1421943019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd91c1601f0 msgr2=0x7fd91c15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:31.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.729+0000 7fd9228cb640 1 --2- 172.21.15.55:0/1421943019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd91c1601f0 0x7fd91c15d430 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fd90c006fd0 tx=0x7fd90c01ed10 comp rx=0 tx=0).stop 2023-08-25T04:19:31.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.729+0000 7fd9228cb640 1 -- 172.21.15.55:0/1421943019 shutdown_connections 2023-08-25T04:19:31.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.729+0000 7fd9228cb640 1 --2- 172.21.15.55:0/1421943019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd91c15e3c0 0x7fd91c0d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.729+0000 7fd9228cb640 1 --2- 172.21.15.55:0/1421943019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd91c1601f0 0x7fd91c15d430 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.729+0000 7fd9228cb640 1 -- 172.21.15.55:0/1421943019 >> 172.21.15.55:0/1421943019 conn(0x7fd91c0d27d0 msgr2=0x7fd91c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:31.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.729+0000 7fd9228cb640 1 -- 172.21.15.55:0/1421943019 shutdown_connections 2023-08-25T04:19:31.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.729+0000 7fd9228cb640 1 -- 172.21.15.55:0/1421943019 wait complete. 2023-08-25T04:19:31.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.729+0000 7fd9228cb640 1 Processor -- start 2023-08-25T04:19:31.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.729+0000 7fd9228cb640 1 -- start start 2023-08-25T04:19:31.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd9228cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd91c0d10c0 0x7fd91c0c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:31.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd9228cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd91c15e3c0 0x7fd91c1f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:31.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd9228cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd91c1601f0 0x7fd91c1f34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:31.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd9228cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0c8980 con 0x7fd91c15e3c0 2023-08-25T04:19:31.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd9228cb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0c63a0 con 0x7fd91c1601f0 2023-08-25T04:19:31.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd9228cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0c6680 con 0x7fd91c0d10c0 2023-08-25T04:19:31.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd91b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd91c15e3c0 0x7fd91c1f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:31.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd91b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd91c15e3c0 0x7fd91c1f2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41900/0 (socket says 172.21.15.55:41900) 2023-08-25T04:19:31.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd91b7fe640 1 -- 172.21.15.55:0/3656766751 learned_addr learned my addr 172.21.15.55:0/3656766751 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:31.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd91bfff640 1 --2- 172.21.15.55:0/3656766751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd91c0d10c0 0x7fd91c0c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:31.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd920e68640 1 --2- 172.21.15.55:0/3656766751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd91c1601f0 0x7fd91c1f34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:31.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd91bfff640 1 -- 172.21.15.55:0/3656766751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd91c1601f0 msgr2=0x7fd91c1f34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:31.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd91bfff640 1 --2- 172.21.15.55:0/3656766751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd91c1601f0 0x7fd91c1f34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd91bfff640 1 -- 172.21.15.55:0/3656766751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd91c15e3c0 msgr2=0x7fd91c1f2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:31.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd91bfff640 1 --2- 172.21.15.55:0/3656766751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd91c15e3c0 0x7fd91c1f2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd91bfff640 1 -- 172.21.15.55:0/3656766751 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c009480 con 0x7fd91c0d10c0 2023-08-25T04:19:31.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd91b7fe640 1 --2- 172.21.15.55:0/3656766751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd91c15e3c0 0x7fd91c1f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:31.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd91bfff640 1 --2- 172.21.15.55:0/3656766751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd91c0d10c0 0x7fd91c0c8440 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0af000 tx=0x7fd90c01bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:31.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd918ff9640 1 -- 172.21.15.55:0/3656766751 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0bd070 con 0x7fd91c0d10c0 2023-08-25T04:19:31.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd918ff9640 1 -- 172.21.15.55:0/3656766751 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c0a9e30 con 0x7fd91c0d10c0 2023-08-25T04:19:31.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd918ff9640 1 -- 172.21.15.55:0/3656766751 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c003860 con 0x7fd91c0d10c0 2023-08-25T04:19:31.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd9228cb640 1 -- 172.21.15.55:0/3656766751 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91c0c6960 con 0x7fd91c0d10c0 2023-08-25T04:19:31.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd9228cb640 1 -- 172.21.15.55:0/3656766751 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91c0c6f20 con 0x7fd91c0d10c0 2023-08-25T04:19:31.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.733+0000 7fd9228cb640 1 -- 172.21.15.55:0/3656766751 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91c073ec0 con 0x7fd91c0d10c0 2023-08-25T04:19:31.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.737+0000 7fd918ff9640 1 -- 172.21.15.55:0/3656766751 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fd90c0039c0 con 0x7fd91c0d10c0 2023-08-25T04:19:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.737+0000 7fd918ff9640 1 --2- 172.21.15.55:0/3656766751 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd908065710 0x7fd908067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.737+0000 7fd918ff9640 1 -- 172.21.15.55:0/3656766751 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fd90c11fcf0 con 0x7fd91c0d10c0 2023-08-25T04:19:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.737+0000 7fd91b7fe640 1 --2- 172.21.15.55:0/3656766751 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd908065710 0x7fd908067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.737+0000 7fd91b7fe640 1 --2- 172.21.15.55:0/3656766751 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd908065710 0x7fd908067bd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd91c06b0a0 tx=0x7fd910009190 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:31.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.741+0000 7fd918ff9640 1 -- 172.21.15.55:0/3656766751 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd90c0ed870 con 0x7fd91c0d10c0 2023-08-25T04:19:31.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.905+0000 7fd9228cb640 1 -- 172.21.15.55:0/3656766751 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd91c0c67c0 con 0x7fd91c0d10c0 2023-08-25T04:19:31.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.913+0000 7fd918ff9640 1 -- 172.21.15.55:0/3656766751 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd91c0c67c0 con 0x7fd91c0d10c0 2023-08-25T04:19:31.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.917+0000 7fd9228cb640 1 -- 172.21.15.55:0/3656766751 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd908065710 msgr2=0x7fd908067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.917+0000 7fd9228cb640 1 --2- 172.21.15.55:0/3656766751 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd908065710 0x7fd908067bd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd91c06b0a0 tx=0x7fd910009190 comp rx=0 tx=0).stop 2023-08-25T04:19:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.917+0000 7fd9228cb640 1 -- 172.21.15.55:0/3656766751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd91c0d10c0 msgr2=0x7fd91c0c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.917+0000 7fd9228cb640 1 --2- 172.21.15.55:0/3656766751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd91c0d10c0 0x7fd91c0c8440 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0af000 tx=0x7fd90c01bab0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.917+0000 7fd9228cb640 1 -- 172.21.15.55:0/3656766751 shutdown_connections 2023-08-25T04:19:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.917+0000 7fd9228cb640 1 --2- 172.21.15.55:0/3656766751 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd91c1601f0 0x7fd91c1f34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.917+0000 7fd9228cb640 1 --2- 172.21.15.55:0/3656766751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd91c15e3c0 0x7fd91c1f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.917+0000 7fd9228cb640 1 --2- 172.21.15.55:0/3656766751 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd908065710 0x7fd908067bd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.917+0000 7fd9228cb640 1 --2- 172.21.15.55:0/3656766751 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd91c0d10c0 0x7fd91c0c8440 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.917+0000 7fd9228cb640 1 -- 172.21.15.55:0/3656766751 >> 172.21.15.55:0/3656766751 conn(0x7fd91c0d27d0 msgr2=0x7fd91c06b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.917+0000 7fd9228cb640 1 -- 172.21.15.55:0/3656766751 shutdown_connections 2023-08-25T04:19:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:31.917+0000 7fd9228cb640 1 -- 172.21.15.55:0/3656766751 wait complete. 2023-08-25T04:19:31.936 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-08-25T04:19:32.010 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:32.008+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:32.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.081+0000 7f7ca7e93640 1 Processor -- start 2023-08-25T04:19:32.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.081+0000 7f7ca7e93640 1 -- start start 2023-08-25T04:19:32.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.081+0000 7f7ca7e93640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ca00ad950 0x7f7ca00cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:32.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.081+0000 7f7ca7e93640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca00ceeb0 0x7f7ca00b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:32.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.081+0000 7f7ca7e93640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca00cc880 con 0x7f7ca00c89f0 2023-08-25T04:19:32.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.081+0000 7f7ca7e93640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca00b11f0 con 0x7f7ca00ad950 2023-08-25T04:19:32.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.081+0000 7f7ca7e93640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca0159d50 con 0x7f7ca00ceeb0 2023-08-25T04:19:32.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.081+0000 7f7ca5c2f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ca00ad950 0x7f7ca00cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:32.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.081+0000 7f7ca542e640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7ca00c89f0 0x7f7ca00ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:47710/0 (socket says 172.21.15.55:47710) 2023-08-25T04:19:32.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.081+0000 7f7ca542e640 1 -- 172.21.15.55:0/3023464135 learned_addr learned my addr 172.21.15.55:0/3023464135 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:32.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.081+0000 7f7ca6430640 1 --2- 172.21.15.55:0/3023464135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca00ceeb0 0x7f7ca00b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:32.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.081+0000 7f7ca4c2d640 1 -- 172.21.15.55:0/3023464135 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178537968 0 0) 0x7f7ca00cc880 con 0x7f7ca00c89f0 2023-08-25T04:19:32.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.081+0000 7f7ca4c2d640 1 -- 172.21.15.55:0/3023464135 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c8c003530 con 0x7f7ca00c89f0 2023-08-25T04:19:32.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.081+0000 7f7ca5c2f640 1 -- 172.21.15.55:0/3023464135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca00ceeb0 msgr2=0x7f7ca00b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:32.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.081+0000 7f7ca5c2f640 1 --2- 172.21.15.55:0/3023464135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca00ceeb0 0x7f7ca00b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:32.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.081+0000 7f7ca5c2f640 1 -- 172.21.15.55:0/3023464135 >> v1:172.21.15.110:6789/0 conn(0x7f7ca00c89f0 legacy=0x7f7ca00ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:32.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.081+0000 7f7ca5c2f640 1 -- 172.21.15.55:0/3023464135 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca00ccb60 con 0x7f7ca00ad950 2023-08-25T04:19:32.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.081+0000 7f7ca6430640 1 --2- 172.21.15.55:0/3023464135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca00ceeb0 0x7f7ca00b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:32.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.085+0000 7f7ca5c2f640 1 --2- 172.21.15.55:0/3023464135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca00ad950 0x7f7ca00cc2a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0097c0 tx=0x7f7c9c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4b9330882a8e086 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:32.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.085+0000 7f7ca4c2d640 1 -- 172.21.15.55:0/3023464135 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c0ab600 con 0x7f7ca00ad950 2023-08-25T04:19:32.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.085+0000 7f7ca4c2d640 1 -- 172.21.15.55:0/3023464135 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c0a7050 con 0x7f7ca00ad950 2023-08-25T04:19:32.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.085+0000 7f7ca4c2d640 1 -- 172.21.15.55:0/3023464135 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c0ab980 con 0x7f7ca00ad950 2023-08-25T04:19:32.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.085+0000 7f7ca7e93640 1 -- 172.21.15.55:0/3023464135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca00ad950 msgr2=0x7f7ca00cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:32.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.085+0000 7f7ca7e93640 1 --2- 172.21.15.55:0/3023464135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca00ad950 0x7f7ca00cc2a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0097c0 tx=0x7f7c9c01c3c0 comp rx=0 tx=0).stop 2023-08-25T04:19:32.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.085+0000 7f7ca7e93640 1 -- 172.21.15.55:0/3023464135 shutdown_connections 2023-08-25T04:19:32.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.085+0000 7f7ca7e93640 1 --2- 172.21.15.55:0/3023464135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca00ceeb0 0x7f7ca00b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:32.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.085+0000 7f7ca7e93640 1 --2- 172.21.15.55:0/3023464135 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca00ad950 0x7f7ca00cc2a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:32.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.085+0000 7f7ca7e93640 1 -- 172.21.15.55:0/3023464135 >> 172.21.15.55:0/3023464135 conn(0x7f7ca0069d00 msgr2=0x7f7ca006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:32.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.085+0000 7f7ca7e93640 1 -- 172.21.15.55:0/3023464135 shutdown_connections 2023-08-25T04:19:32.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.085+0000 7f7ca7e93640 1 -- 172.21.15.55:0/3023464135 wait complete. 2023-08-25T04:19:32.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca7e93640 1 Processor -- start 2023-08-25T04:19:32.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca7e93640 1 -- start start 2023-08-25T04:19:32.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca7e93640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca00ad950 0x7f7ca014e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:32.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca7e93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ca00c89f0 0x7f7ca014e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:32.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca7e93640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca00ceeb0 0x7f7ca01509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:32.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca7e93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca014ef20 con 0x7f7ca00c89f0 2023-08-25T04:19:32.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca7e93640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca0097650 con 0x7f7ca00ad950 2023-08-25T04:19:32.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca7e93640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca014f150 con 0x7f7ca00ceeb0 2023-08-25T04:19:32.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca542e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ca00c89f0 0x7f7ca014e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:32.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca542e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ca00c89f0 0x7f7ca014e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41916/0 (socket says 172.21.15.55:41916) 2023-08-25T04:19:32.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca542e640 1 -- 172.21.15.55:0/906496726 learned_addr learned my addr 172.21.15.55:0/906496726 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:32.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca5c2f640 1 --2- 172.21.15.55:0/906496726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca00ad950 0x7f7ca014e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:32.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca6430640 1 --2- 172.21.15.55:0/906496726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca00ceeb0 0x7f7ca01509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:32.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca5c2f640 1 -- 172.21.15.55:0/906496726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca00ceeb0 msgr2=0x7f7ca01509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:32.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca5c2f640 1 --2- 172.21.15.55:0/906496726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca00ceeb0 0x7f7ca01509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:32.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca5c2f640 1 -- 172.21.15.55:0/906496726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ca00c89f0 msgr2=0x7f7ca014e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:32.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca5c2f640 1 --2- 172.21.15.55:0/906496726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ca00c89f0 0x7f7ca014e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:32.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca5c2f640 1 -- 172.21.15.55:0/906496726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c98009a70 con 0x7f7ca00ad950 2023-08-25T04:19:32.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca5c2f640 1 --2- 172.21.15.55:0/906496726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca00ad950 0x7f7ca014e1e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0ab000 tx=0x7f7c9c01ac00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:32.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7c967fc640 1 -- 172.21.15.55:0/906496726 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c006e20 con 0x7f7ca00ad950 2023-08-25T04:19:32.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7c967fc640 1 -- 172.21.15.55:0/906496726 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c0b7450 con 0x7f7ca00ad950 2023-08-25T04:19:32.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7ca7e93640 1 -- 172.21.15.55:0/906496726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9c009420 con 0x7f7ca00ad950 2023-08-25T04:19:32.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.089+0000 7f7c967fc640 1 -- 172.21.15.55:0/906496726 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c0b77e0 con 0x7f7ca00ad950 2023-08-25T04:19:32.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.093+0000 7f7ca7e93640 1 -- 172.21.15.55:0/906496726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca0097090 con 0x7f7ca00ad950 2023-08-25T04:19:32.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.093+0000 7f7ca7e93640 1 -- 172.21.15.55:0/906496726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca004dbe0 con 0x7f7ca00ad950 2023-08-25T04:19:32.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.093+0000 7f7c967fc640 1 -- 172.21.15.55:0/906496726 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f7c9c0b7940 con 0x7f7ca00ad950 2023-08-25T04:19:32.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.093+0000 7f7c967fc640 1 --2- 172.21.15.55:0/906496726 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7c84065710 0x7f7c84067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:32.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.093+0000 7f7c967fc640 1 -- 172.21.15.55:0/906496726 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f7c9c11d4b0 con 0x7f7ca00ad950 2023-08-25T04:19:32.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.093+0000 7f7ca542e640 1 --2- 172.21.15.55:0/906496726 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7c84065710 0x7f7c84067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:32.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.093+0000 7f7ca542e640 1 --2- 172.21.15.55:0/906496726 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7c84065710 0x7f7c84067bd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7ca006a230 tx=0x7f7c90009040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:32.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.097+0000 7f7c967fc640 1 -- 172.21.15.55:0/906496726 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7c9c0eafa0 con 0x7f7ca00ad950 2023-08-25T04:19:32.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.309+0000 7f7ca7e93640 1 -- 172.21.15.55:0/906496726 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f7ca00addc0 con 0x7f7ca00ad950 2023-08-25T04:19:32.711 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:32.708+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:32.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.829+0000 7f7c967fc640 1 -- 172.21.15.55:0/906496726 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v624) v1 ==== 166+0+0 (secure 0 0 0) 0x7f7c9c0ee5c0 con 0x7f7ca00ad950 2023-08-25T04:19:32.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.829+0000 7f7ca7e93640 1 -- 172.21.15.55:0/906496726 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7c84065710 msgr2=0x7f7c84067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:32.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.829+0000 7f7ca7e93640 1 --2- 172.21.15.55:0/906496726 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7c84065710 0x7f7c84067bd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7ca006a230 tx=0x7f7c90009040 comp rx=0 tx=0).stop 2023-08-25T04:19:32.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.829+0000 7f7ca7e93640 1 -- 172.21.15.55:0/906496726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca00ad950 msgr2=0x7f7ca014e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:32.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.829+0000 7f7ca7e93640 1 --2- 172.21.15.55:0/906496726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca00ad950 0x7f7ca014e1e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0ab000 tx=0x7f7c9c01ac00 comp rx=0 tx=0).stop 2023-08-25T04:19:32.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.829+0000 7f7ca7e93640 1 -- 172.21.15.55:0/906496726 shutdown_connections 2023-08-25T04:19:32.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.829+0000 7f7ca7e93640 1 --2- 172.21.15.55:0/906496726 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7c84065710 0x7f7c84067bd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:32.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.829+0000 7f7ca7e93640 1 --2- 172.21.15.55:0/906496726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ca00ceeb0 0x7f7ca01509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:32.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.829+0000 7f7ca7e93640 1 --2- 172.21.15.55:0/906496726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ca00c89f0 0x7f7ca014e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:32.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.829+0000 7f7ca7e93640 1 --2- 172.21.15.55:0/906496726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ca00ad950 0x7f7ca014e1e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:32.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.829+0000 7f7ca7e93640 1 -- 172.21.15.55:0/906496726 >> 172.21.15.55:0/906496726 conn(0x7f7ca0069d00 msgr2=0x7f7ca015d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:32.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.829+0000 7f7ca7e93640 1 -- 172.21.15.55:0/906496726 shutdown_connections 2023-08-25T04:19:32.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.829+0000 7f7ca7e93640 1 -- 172.21.15.55:0/906496726 wait complete. 2023-08-25T04:19:32.849 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-08-25T04:19:32.850 INFO:tasks.cephfs_test_runner:Starting test: test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-25T04:19:32.850 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-08-25T04:19:32.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.997+0000 7fb845419640 1 Processor -- start 2023-08-25T04:19:32.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.997+0000 7fb845419640 1 -- start start 2023-08-25T04:19:32.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.997+0000 7fb845419640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb8400b56c0 0x7fb8400b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:32.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.997+0000 7fb845419640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8400afd80 con 0x7fb8400d0770 2023-08-25T04:19:32.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.997+0000 7fb845419640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8400b0000 con 0x7fb8401600f0 2023-08-25T04:19:32.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.997+0000 7fb845419640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8400b02e0 con 0x7fb8400b56c0 2023-08-25T04:19:32.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.997+0000 7fb83f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb8400d0770 0x7fb8400d0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56140/0 (socket says 172.21.15.55:56140) 2023-08-25T04:19:32.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.997+0000 7fb83f7fe640 1 -- 172.21.15.55:0/2862602141 learned_addr learned my addr 172.21.15.55:0/2862602141 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:32.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.997+0000 7fb837fff640 1 --2- 172.21.15.55:0/2862602141 >> v2:172.21.15.110:3300/0 conn(0x7fb8400b56c0 0x7fb8400b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:32.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.997+0000 7fb83e7fc640 1 -- 172.21.15.55:0/2862602141 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912520117 0 0) 0x7fb8400afd80 con 0x7fb8400d0770 2023-08-25T04:19:33.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.997+0000 7fb837fff640 1 -- 172.21.15.55:0/2862602141 >> v1:172.21.15.110:6789/0 conn(0x7fb8401600f0 legacy=0x7fb8400b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:33.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.997+0000 7fb837fff640 1 -- 172.21.15.55:0/2862602141 >> v1:172.21.15.55:6789/0 conn(0x7fb8400d0770 legacy=0x7fb8400d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:33.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:32.997+0000 7fb837fff640 1 -- 172.21.15.55:0/2862602141 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8400b05c0 con 0x7fb8400b56c0 2023-08-25T04:19:33.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.001+0000 7fb837fff640 1 --2- 172.21.15.55:0/2862602141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8400b56c0 0x7fb8400b17b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb828009740 tx=0x7fb82801c2b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddb1244b3aca9437 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:33.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.001+0000 7fb83e7fc640 1 -- 172.21.15.55:0/2862602141 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8280ab600 con 0x7fb8400b56c0 2023-08-25T04:19:33.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.001+0000 7fb83e7fc640 1 -- 172.21.15.55:0/2862602141 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8280a7050 con 0x7fb8400b56c0 2023-08-25T04:19:33.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.001+0000 7fb83e7fc640 1 -- 172.21.15.55:0/2862602141 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8280ab980 con 0x7fb8400b56c0 2023-08-25T04:19:33.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.001+0000 7fb845419640 1 -- 172.21.15.55:0/2862602141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8400b56c0 msgr2=0x7fb8400b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:33.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.001+0000 7fb845419640 1 --2- 172.21.15.55:0/2862602141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8400b56c0 0x7fb8400b17b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb828009740 tx=0x7fb82801c2b0 comp rx=0 tx=0).stop 2023-08-25T04:19:33.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.001+0000 7fb845419640 1 -- 172.21.15.55:0/2862602141 shutdown_connections 2023-08-25T04:19:33.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.001+0000 7fb845419640 1 --2- 172.21.15.55:0/2862602141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8400b56c0 0x7fb8400b17b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:33.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.001+0000 7fb845419640 1 -- 172.21.15.55:0/2862602141 >> 172.21.15.55:0/2862602141 conn(0x7fb8400d2870 msgr2=0x7fb8400d2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:33.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.001+0000 7fb845419640 1 -- 172.21.15.55:0/2862602141 shutdown_connections 2023-08-25T04:19:33.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.001+0000 7fb845419640 1 -- 172.21.15.55:0/2862602141 wait complete. 2023-08-25T04:19:33.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb845419640 1 Processor -- start 2023-08-25T04:19:33.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb845419640 1 -- start start 2023-08-25T04:19:33.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb845419640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8400b56c0 0x7fb8400cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:33.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb845419640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8400d0770 0x7fb8401579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:33.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb845419640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8401600f0 0x7fb840157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:33.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb845419640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400c6440 con 0x7fb8400b56c0 2023-08-25T04:19:33.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb845419640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400c6720 con 0x7fb8400d0770 2023-08-25T04:19:33.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb845419640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8400c6a00 con 0x7fb8401600f0 2023-08-25T04:19:33.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb83effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8400b56c0 0x7fb8400cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:33.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb83effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8400b56c0 0x7fb8400cdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41920/0 (socket says 172.21.15.55:41920) 2023-08-25T04:19:33.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb83effd640 1 -- 172.21.15.55:0/3195503827 learned_addr learned my addr 172.21.15.55:0/3195503827 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:33.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb837fff640 1 --2- 172.21.15.55:0/3195503827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8400d0770 0x7fb8401579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:33.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb83f7fe640 1 --2- 172.21.15.55:0/3195503827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8401600f0 0x7fb840157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:33.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb83effd640 1 -- 172.21.15.55:0/3195503827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8401600f0 msgr2=0x7fb840157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:33.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb83effd640 1 --2- 172.21.15.55:0/3195503827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8401600f0 0x7fb840157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:33.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb83effd640 1 -- 172.21.15.55:0/3195503827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8400d0770 msgr2=0x7fb8401579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:33.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb83effd640 1 --2- 172.21.15.55:0/3195503827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8400d0770 0x7fb8401579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:33.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb83effd640 1 -- 172.21.15.55:0/3195503827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb828009420 con 0x7fb8400b56c0 2023-08-25T04:19:33.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb837fff640 1 --2- 172.21.15.55:0/3195503827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8400d0770 0x7fb8401579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:33.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb83effd640 1 --2- 172.21.15.55:0/3195503827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8400b56c0 0x7fb8400cdd30 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fb83000c750 tx=0x7fb83000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:33.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb8377fe640 1 -- 172.21.15.55:0/3195503827 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830005270 con 0x7fb8400b56c0 2023-08-25T04:19:33.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb8377fe640 1 -- 172.21.15.55:0/3195503827 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8300053d0 con 0x7fb8400b56c0 2023-08-25T04:19:33.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb8377fe640 1 -- 172.21.15.55:0/3195503827 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83000a880 con 0x7fb8400b56c0 2023-08-25T04:19:33.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb845419640 1 -- 172.21.15.55:0/3195503827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8400c6ce0 con 0x7fb8400b56c0 2023-08-25T04:19:33.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.005+0000 7fb845419640 1 -- 172.21.15.55:0/3195503827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8400ce270 con 0x7fb8400b56c0 2023-08-25T04:19:33.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.009+0000 7fb845419640 1 -- 172.21.15.55:0/3195503827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8400c7190 con 0x7fb8400b56c0 2023-08-25T04:19:33.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.009+0000 7fb8377fe640 1 -- 172.21.15.55:0/3195503827 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fb83000a9e0 con 0x7fb8400b56c0 2023-08-25T04:19:33.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.009+0000 7fb8377fe640 1 --2- 172.21.15.55:0/3195503827 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fb820065740 0x7fb820067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:33.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.009+0000 7fb8377fe640 1 -- 172.21.15.55:0/3195503827 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fb8300823d0 con 0x7fb8400b56c0 2023-08-25T04:19:33.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.009+0000 7fb837fff640 1 --2- 172.21.15.55:0/3195503827 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fb820065740 0x7fb820067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:33.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.009+0000 7fb837fff640 1 --2- 172.21.15.55:0/3195503827 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fb820065740 0x7fb820067c00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb8280ad000 tx=0x7fb8280a6000 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:33.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.013+0000 7fb8377fe640 1 -- 172.21.15.55:0/3195503827 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb83004ff50 con 0x7fb8400b56c0 2023-08-25T04:19:33.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.233+0000 7fb845419640 1 -- 172.21.15.55:0/3195503827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7fb8400afcf0 con 0x7fb8400b56c0 2023-08-25T04:19:33.410 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:33.408+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:33.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.829+0000 7fb8377fe640 1 -- 172.21.15.55:0/3195503827 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v625) v1 ==== 186+0+0 (secure 0 0 0) 0x7fb8300012c0 con 0x7fb8400b56c0 2023-08-25T04:19:33.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.829+0000 7fb845419640 1 -- 172.21.15.55:0/3195503827 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fb820065740 msgr2=0x7fb820067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:33.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.829+0000 7fb845419640 1 --2- 172.21.15.55:0/3195503827 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fb820065740 0x7fb820067c00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb8280ad000 tx=0x7fb8280a6000 comp rx=0 tx=0).stop 2023-08-25T04:19:33.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.829+0000 7fb845419640 1 -- 172.21.15.55:0/3195503827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8400b56c0 msgr2=0x7fb8400cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:33.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.829+0000 7fb845419640 1 --2- 172.21.15.55:0/3195503827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8400b56c0 0x7fb8400cdd30 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fb83000c750 tx=0x7fb83000cc10 comp rx=0 tx=0).stop 2023-08-25T04:19:33.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.829+0000 7fb845419640 1 -- 172.21.15.55:0/3195503827 shutdown_connections 2023-08-25T04:19:33.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.829+0000 7fb845419640 1 --2- 172.21.15.55:0/3195503827 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fb820065740 0x7fb820067c00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:33.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.829+0000 7fb845419640 1 --2- 172.21.15.55:0/3195503827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8401600f0 0x7fb840157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:33.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.829+0000 7fb845419640 1 --2- 172.21.15.55:0/3195503827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8400d0770 0x7fb8401579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:33.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.829+0000 7fb845419640 1 --2- 172.21.15.55:0/3195503827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8400b56c0 0x7fb8400cdd30 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:33.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.829+0000 7fb845419640 1 -- 172.21.15.55:0/3195503827 >> 172.21.15.55:0/3195503827 conn(0x7fb8400d2870 msgr2=0x7fb8400b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:33.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.829+0000 7fb845419640 1 -- 172.21.15.55:0/3195503827 shutdown_connections 2023-08-25T04:19:33.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.829+0000 7fb845419640 1 -- 172.21.15.55:0/3195503827 wait complete. 2023-08-25T04:19:33.850 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:19:33.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.997+0000 7f36fe888640 1 Processor -- start 2023-08-25T04:19:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:33.997+0000 7f36fe888640 1 -- start start 2023-08-25T04:19:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.001+0000 7f36fe888640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f36f80d0da0 0x7f36f80d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.001+0000 7f36fe888640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f80b29b0 con 0x7f36f80b3e50 2023-08-25T04:19:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.001+0000 7f36fe888640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f80cfc80 con 0x7f36f80cdde0 2023-08-25T04:19:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.001+0000 7f36fe888640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f80d16c0 con 0x7f36f80d0da0 2023-08-25T04:19:34.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.001+0000 7f36fce25640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f36f80b3e50 0x7f36f80cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56150/0 (socket says 172.21.15.55:56150) 2023-08-25T04:19:34.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.001+0000 7f36fce25640 1 -- 172.21.15.55:0/2897421384 learned_addr learned my addr 172.21.15.55:0/2897421384 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:34.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.001+0000 7f36f7fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f36f80d0da0 0x7f36f80d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:34.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.001+0000 7f36f7fff640 1 -- 172.21.15.55:0/2897421384 >> v1:172.21.15.110:6789/0 conn(0x7f36f80cdde0 legacy=0x7f36f80cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.001+0000 7f36f6ffd640 1 -- 172.21.15.55:0/2897421384 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1673780733 0 0) 0x7f36f80b29b0 con 0x7f36f80b3e50 2023-08-25T04:19:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.001+0000 7f36f7fff640 1 -- 172.21.15.55:0/2897421384 >> v1:172.21.15.55:6789/0 conn(0x7f36f80b3e50 legacy=0x7f36f80cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.001+0000 7f36f7fff640 1 -- 172.21.15.55:0/2897421384 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f80b1dc0 con 0x7f36f80d0da0 2023-08-25T04:19:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.001+0000 7f36f7fff640 1 --2- 172.21.15.55:0/2897421384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36f80d0da0 0x7f36f80d1180 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f36e80097a0 tx=0x7f36e801ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f04b1e4de6609da server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.005+0000 7f36f6ffd640 1 -- 172.21.15.55:0/2897421384 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e80a8950 con 0x7f36f80d0da0 2023-08-25T04:19:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.005+0000 7f36f6ffd640 1 -- 172.21.15.55:0/2897421384 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e80a8ab0 con 0x7f36f80d0da0 2023-08-25T04:19:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.005+0000 7f36f6ffd640 1 -- 172.21.15.55:0/2897421384 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e80a8e40 con 0x7f36f80d0da0 2023-08-25T04:19:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.005+0000 7f36fe888640 1 -- 172.21.15.55:0/2897421384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36f80d0da0 msgr2=0x7f36f80d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:34.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.005+0000 7f36fe888640 1 --2- 172.21.15.55:0/2897421384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36f80d0da0 0x7f36f80d1180 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f36e80097a0 tx=0x7f36e801ec50 comp rx=0 tx=0).stop 2023-08-25T04:19:34.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.005+0000 7f36fe888640 1 -- 172.21.15.55:0/2897421384 shutdown_connections 2023-08-25T04:19:34.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.005+0000 7f36fe888640 1 --2- 172.21.15.55:0/2897421384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36f80d0da0 0x7f36f80d1180 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.005+0000 7f36fe888640 1 -- 172.21.15.55:0/2897421384 >> 172.21.15.55:0/2897421384 conn(0x7f36f809bae0 msgr2=0x7f36f80d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:34.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.005+0000 7f36fe888640 1 -- 172.21.15.55:0/2897421384 shutdown_connections 2023-08-25T04:19:34.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.005+0000 7f36fe888640 1 -- 172.21.15.55:0/2897421384 wait complete. 2023-08-25T04:19:34.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.005+0000 7f36fe888640 1 Processor -- start 2023-08-25T04:19:34.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.005+0000 7f36fe888640 1 -- start start 2023-08-25T04:19:34.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.005+0000 7f36fe888640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36f80b3e50 0x7f36f814fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:34.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.005+0000 7f36fe888640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36f80cdde0 0x7f36f80c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:34.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.005+0000 7f36fe888640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36f80d0da0 0x7f36f81f1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:34.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.005+0000 7f36fe888640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f814c4c0 con 0x7f36f80cdde0 2023-08-25T04:19:34.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.005+0000 7f36fe888640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80b6430 con 0x7f36f80d0da0 2023-08-25T04:19:34.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.005+0000 7f36fe888640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80ca170 con 0x7f36f80b3e50 2023-08-25T04:19:34.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36f77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36f80cdde0 0x7f36f80c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:34.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36fce25640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36f80d0da0 0x7f36f81f1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36f7fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36f80b3e50 0x7f36f814fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36f7fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36f80b3e50 0x7f36f814fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:52934/0 (socket says 172.21.15.55:52934) 2023-08-25T04:19:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36fce25640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36f80d0da0 0x7f36f81f1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:56224/0 (socket says 172.21.15.55:56224) 2023-08-25T04:19:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36f7fff640 1 -- 172.21.15.55:0/172744769 learned_addr learned my addr 172.21.15.55:0/172744769 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36f7fff640 1 -- 172.21.15.55:0/172744769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36f80d0da0 msgr2=0x7f36f81f1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36f7fff640 1 --2- 172.21.15.55:0/172744769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36f80d0da0 0x7f36f81f1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36f7fff640 1 -- 172.21.15.55:0/172744769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36f80cdde0 msgr2=0x7f36f80c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36f7fff640 1 --2- 172.21.15.55:0/172744769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36f80cdde0 0x7f36f80c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36f7fff640 1 -- 172.21.15.55:0/172744769 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e80093b0 con 0x7f36f80b3e50 2023-08-25T04:19:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36fce25640 1 --2- 172.21.15.55:0/172744769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36f80d0da0 0x7f36f81f1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36f7fff640 1 --2- 172.21.15.55:0/172744769 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36f80b3e50 0x7f36f814fbb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f36e801b860 tx=0x7f36e801b9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:34.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36f4ff9640 1 -- 172.21.15.55:0/172744769 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e80b9630 con 0x7f36f80b3e50 2023-08-25T04:19:34.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36f4ff9640 1 -- 172.21.15.55:0/172744769 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e80b9790 con 0x7f36f80b3e50 2023-08-25T04:19:34.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36f4ff9640 1 -- 172.21.15.55:0/172744769 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e80b9b40 con 0x7f36f80b3e50 2023-08-25T04:19:34.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36fe888640 1 -- 172.21.15.55:0/172744769 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f80ca450 con 0x7f36f80b3e50 2023-08-25T04:19:34.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36fe888640 1 -- 172.21.15.55:0/172744769 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f80b6680 con 0x7f36f80b3e50 2023-08-25T04:19:34.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36fe888640 1 -- 172.21.15.55:0/172744769 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f80b6870 con 0x7f36f80b3e50 2023-08-25T04:19:34.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.009+0000 7f36f4ff9640 1 -- 172.21.15.55:0/172744769 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f36e80b7040 con 0x7f36f80b3e50 2023-08-25T04:19:34.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.013+0000 7f36f4ff9640 1 --2- 172.21.15.55:0/172744769 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f36e4065710 0x7f36e4067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:34.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.013+0000 7f36f4ff9640 1 -- 172.21.15.55:0/172744769 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f36e8120d90 con 0x7f36f80b3e50 2023-08-25T04:19:34.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.013+0000 7f36f77fe640 1 --2- 172.21.15.55:0/172744769 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f36e4065710 0x7f36e4067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:34.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.013+0000 7f36f77fe640 1 --2- 172.21.15.55:0/172744769 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f36e4065710 0x7f36e4067bd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f36f80cfb40 tx=0x7f36ec009040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:34.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.017+0000 7f36f4ff9640 1 -- 172.21.15.55:0/172744769 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f36e80ee890 con 0x7f36f80b3e50 2023-08-25T04:19:34.120 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:34.116+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:34.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.177+0000 7f36fe888640 1 -- 172.21.15.55:0/172744769 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36f804dbe0 con 0x7f36f80b3e50 2023-08-25T04:19:34.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.181+0000 7f36f4ff9640 1 -- 172.21.15.55:0/172744769 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+15798 (secure 0 0 0) 0x7f36e80b5090 con 0x7f36f80b3e50 2023-08-25T04:19:34.180 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:34.180 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":98,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:19:30.821263+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6833/3432791477":"2023-08-26T04:19:27.811862+0000","172.21.15.55:6835/3432791477":"2023-08-26T04:19:27.811862+0000","172.21.15.110:6832/3580388085":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/4195307464":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/2448806631":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/3256947721":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/2126097154":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/3373349369":"2023-08-26T04:19:18.606592+0000","172.21.15.110:6833/2805609132":"2023-08-26T04:19:18.606592+0000","172.21.15.110:6833/3580388085":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/2070659651":"2023-08-26T04:19:24.435086+0000","172.21.15.110:6832/2805609132":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/3316375931":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/3413496344":"2023-08-26T04:19:24.435086+0000","172.21.15.110:0/7066739":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/2684620126":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/3401969959":"2023-08-26T04:19:18.606592+0000","172.21.15.110:0/3496245024":"2023-08-26T04:19:18.606592+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:19:34.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.181+0000 7f36fe888640 1 -- 172.21.15.55:0/172744769 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f36e4065710 msgr2=0x7f36e4067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:34.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.181+0000 7f36fe888640 1 --2- 172.21.15.55:0/172744769 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f36e4065710 0x7f36e4067bd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f36f80cfb40 tx=0x7f36ec009040 comp rx=0 tx=0).stop 2023-08-25T04:19:34.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.181+0000 7f36fe888640 1 -- 172.21.15.55:0/172744769 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36f80b3e50 msgr2=0x7f36f814fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:34.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.181+0000 7f36fe888640 1 --2- 172.21.15.55:0/172744769 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36f80b3e50 0x7f36f814fbb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f36e801b860 tx=0x7f36e801b9f0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.181+0000 7f36fe888640 1 -- 172.21.15.55:0/172744769 shutdown_connections 2023-08-25T04:19:34.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.181+0000 7f36fe888640 1 --2- 172.21.15.55:0/172744769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36f80d0da0 0x7f36f81f1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.181+0000 7f36fe888640 1 --2- 172.21.15.55:0/172744769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36f80cdde0 0x7f36f80c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.181+0000 7f36fe888640 1 --2- 172.21.15.55:0/172744769 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f36e4065710 0x7f36e4067bd0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.181+0000 7f36fe888640 1 --2- 172.21.15.55:0/172744769 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36f80b3e50 0x7f36f814fbb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.181+0000 7f36fe888640 1 -- 172.21.15.55:0/172744769 >> 172.21.15.55:0/172744769 conn(0x7f36f809bae0 msgr2=0x7f36f80d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:34.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.181+0000 7f36fe888640 1 -- 172.21.15.55:0/172744769 shutdown_connections 2023-08-25T04:19:34.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.181+0000 7f36fe888640 1 -- 172.21.15.55:0/172744769 wait complete. 2023-08-25T04:19:34.201 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:19:34.202 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:19:34.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.353+0000 7fb0f1888640 1 Processor -- start 2023-08-25T04:19:34.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.353+0000 7fb0f1888640 1 -- start start 2023-08-25T04:19:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.353+0000 7fb0f1888640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb0ec1601f0 0x7fb0ec15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.353+0000 7fb0f1888640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb0ec0d1290 0x7fb0ec15e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.353+0000 7fb0f1888640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0ec0cd5a0 con 0x7fb0ec15e3c0 2023-08-25T04:19:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.353+0000 7fb0f1888640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ec0cd880 con 0x7fb0ec1601f0 2023-08-25T04:19:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.353+0000 7fb0f1888640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ec0cdb60 con 0x7fb0ec0d1290 2023-08-25T04:19:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.353+0000 7fb0eaffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb0ec1601f0 0x7fb0ec15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.353+0000 7fb0eaffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb0ec1601f0 0x7fb0ec15d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41934/0 (socket says 172.21.15.55:41934) 2023-08-25T04:19:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.353+0000 7fb0eaffd640 1 -- 172.21.15.55:0/2573737899 learned_addr learned my addr 172.21.15.55:0/2573737899 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.353+0000 7fb0eb7fe640 1 --2- 172.21.15.55:0/2573737899 >> v2:172.21.15.110:3300/0 conn(0x7fb0ec0d1290 0x7fb0ec15e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.353+0000 7fb0eaffd640 1 -- 172.21.15.55:0/2573737899 >> v2:172.21.15.110:3300/0 conn(0x7fb0ec0d1290 msgr2=0x7fb0ec15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.353+0000 7fb0eaffd640 1 --2- 172.21.15.55:0/2573737899 >> v2:172.21.15.110:3300/0 conn(0x7fb0ec0d1290 0x7fb0ec15e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.353+0000 7fb0eaffd640 1 -- 172.21.15.55:0/2573737899 >> v1:172.21.15.110:6789/0 conn(0x7fb0ec15e3c0 legacy=0x7fb0ec0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:34.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.353+0000 7fb0eaffd640 1 -- 172.21.15.55:0/2573737899 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec0cde40 con 0x7fb0ec1601f0 2023-08-25T04:19:34.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.357+0000 7fb0eaffd640 1 --2- 172.21.15.55:0/2573737899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0ec1601f0 0x7fb0ec15d430 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0d2060 tx=0x7fb0dc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d802b1e051d0ba75 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:34.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.357+0000 7fb0ea7fc640 1 -- 172.21.15.55:0/2573737899 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc0ac410 con 0x7fb0ec1601f0 2023-08-25T04:19:34.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.357+0000 7fb0ea7fc640 1 -- 172.21.15.55:0/2573737899 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0dc0ac570 con 0x7fb0ec1601f0 2023-08-25T04:19:34.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.357+0000 7fb0ea7fc640 1 -- 172.21.15.55:0/2573737899 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc0ac900 con 0x7fb0ec1601f0 2023-08-25T04:19:34.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.357+0000 7fb0f1888640 1 -- 172.21.15.55:0/2573737899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0ec1601f0 msgr2=0x7fb0ec15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:34.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.357+0000 7fb0f1888640 1 --2- 172.21.15.55:0/2573737899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0ec1601f0 0x7fb0ec15d430 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0d2060 tx=0x7fb0dc01c490 comp rx=0 tx=0).stop 2023-08-25T04:19:34.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.357+0000 7fb0f1888640 1 -- 172.21.15.55:0/2573737899 shutdown_connections 2023-08-25T04:19:34.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.357+0000 7fb0f1888640 1 --2- 172.21.15.55:0/2573737899 >> v2:172.21.15.110:3300/0 conn(0x7fb0ec0d1290 0x7fb0ec15e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.357+0000 7fb0f1888640 1 --2- 172.21.15.55:0/2573737899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0ec1601f0 0x7fb0ec15d430 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.357+0000 7fb0f1888640 1 -- 172.21.15.55:0/2573737899 >> 172.21.15.55:0/2573737899 conn(0x7fb0ec0d27d0 msgr2=0x7fb0ec0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:34.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.357+0000 7fb0f1888640 1 -- 172.21.15.55:0/2573737899 shutdown_connections 2023-08-25T04:19:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.357+0000 7fb0f1888640 1 -- 172.21.15.55:0/2573737899 wait complete. 2023-08-25T04:19:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0f1888640 1 Processor -- start 2023-08-25T04:19:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0f1888640 1 -- start start 2023-08-25T04:19:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0f1888640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0ec0d1290 0x7fb0ec0c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0f1888640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0ec15e3c0 0x7fb0ec0c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0f1888640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0ec1601f0 0x7fb0ec15b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0f1888640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec0cc9b0 con 0x7fb0ec1601f0 2023-08-25T04:19:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0f1888640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec0c6270 con 0x7fb0ec0d1290 2023-08-25T04:19:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0f1888640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec0c6550 con 0x7fb0ec15e3c0 2023-08-25T04:19:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0eb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0ec1601f0 0x7fb0ec15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0eb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0ec1601f0 0x7fb0ec15b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41940/0 (socket says 172.21.15.55:41940) 2023-08-25T04:19:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0eb7fe640 1 -- 172.21.15.55:0/4178054500 learned_addr learned my addr 172.21.15.55:0/4178054500 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0eaffd640 1 --2- 172.21.15.55:0/4178054500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0ec0d1290 0x7fb0ec0c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:34.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0e27fc640 1 --2- 172.21.15.55:0/4178054500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0ec15e3c0 0x7fb0ec0c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:34.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0eb7fe640 1 -- 172.21.15.55:0/4178054500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0ec15e3c0 msgr2=0x7fb0ec0c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:34.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0eb7fe640 1 --2- 172.21.15.55:0/4178054500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0ec15e3c0 0x7fb0ec0c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0eb7fe640 1 -- 172.21.15.55:0/4178054500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0ec0d1290 msgr2=0x7fb0ec0c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:34.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0eb7fe640 1 --2- 172.21.15.55:0/4178054500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0ec0d1290 0x7fb0ec0c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0eb7fe640 1 -- 172.21.15.55:0/4178054500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0dc009480 con 0x7fb0ec1601f0 2023-08-25T04:19:34.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0eb7fe640 1 --2- 172.21.15.55:0/4178054500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0ec1601f0 0x7fb0ec15b710 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4007e40 tx=0x7fb0e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:34.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0e8ff9640 1 -- 172.21.15.55:0/4178054500 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4014620 con 0x7fb0ec1601f0 2023-08-25T04:19:34.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0e8ff9640 1 -- 172.21.15.55:0/4178054500 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e400ee90 con 0x7fb0ec1601f0 2023-08-25T04:19:34.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0f1888640 1 -- 172.21.15.55:0/4178054500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ec0c6830 con 0x7fb0ec1601f0 2023-08-25T04:19:34.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0e8ff9640 1 -- 172.21.15.55:0/4178054500 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40149e0 con 0x7fb0ec1601f0 2023-08-25T04:19:34.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.361+0000 7fb0f1888640 1 -- 172.21.15.55:0/4178054500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ec0c9a30 con 0x7fb0ec1601f0 2023-08-25T04:19:34.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.365+0000 7fb0f1888640 1 -- 172.21.15.55:0/4178054500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ec0b5260 con 0x7fb0ec1601f0 2023-08-25T04:19:34.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.365+0000 7fb0e8ff9640 1 -- 172.21.15.55:0/4178054500 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fb0e4014b40 con 0x7fb0ec1601f0 2023-08-25T04:19:34.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.365+0000 7fb0e8ff9640 1 --2- 172.21.15.55:0/4178054500 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fb0cc065710 0x7fb0cc067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:34.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.365+0000 7fb0e8ff9640 1 -- 172.21.15.55:0/4178054500 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fb0e4083680 con 0x7fb0ec1601f0 2023-08-25T04:19:34.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.365+0000 7fb0eaffd640 1 --2- 172.21.15.55:0/4178054500 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fb0cc065710 0x7fb0cc067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:34.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.365+0000 7fb0eaffd640 1 --2- 172.21.15.55:0/4178054500 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fb0cc065710 0x7fb0cc067bd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0ae000 tx=0x7fb0dc0a6040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:34.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.369+0000 7fb0e8ff9640 1 -- 172.21.15.55:0/4178054500 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb0e40511f0 con 0x7fb0ec1601f0 2023-08-25T04:19:34.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.529+0000 7fb0f1888640 1 -- 172.21.15.55:0/4178054500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0ec073ec0 con 0x7fb0ec1601f0 2023-08-25T04:19:34.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.529+0000 7fb0e8ff9640 1 -- 172.21.15.55:0/4178054500 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0e4054810 con 0x7fb0ec1601f0 2023-08-25T04:19:34.531 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:19:34.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.533+0000 7fb0f1888640 1 -- 172.21.15.55:0/4178054500 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fb0cc065710 msgr2=0x7fb0cc067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:34.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.533+0000 7fb0f1888640 1 --2- 172.21.15.55:0/4178054500 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fb0cc065710 0x7fb0cc067bd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0ae000 tx=0x7fb0dc0a6040 comp rx=0 tx=0).stop 2023-08-25T04:19:34.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.533+0000 7fb0f1888640 1 -- 172.21.15.55:0/4178054500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0ec1601f0 msgr2=0x7fb0ec15b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:34.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.533+0000 7fb0f1888640 1 --2- 172.21.15.55:0/4178054500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0ec1601f0 0x7fb0ec15b710 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4007e40 tx=0x7fb0e400e4b0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.533+0000 7fb0f1888640 1 -- 172.21.15.55:0/4178054500 shutdown_connections 2023-08-25T04:19:34.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.533+0000 7fb0f1888640 1 --2- 172.21.15.55:0/4178054500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0ec1601f0 0x7fb0ec15b710 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.533+0000 7fb0f1888640 1 --2- 172.21.15.55:0/4178054500 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fb0cc065710 0x7fb0cc067bd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.533+0000 7fb0f1888640 1 --2- 172.21.15.55:0/4178054500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0ec15e3c0 0x7fb0ec0c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.533+0000 7fb0f1888640 1 --2- 172.21.15.55:0/4178054500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0ec0d1290 0x7fb0ec0c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.533+0000 7fb0f1888640 1 -- 172.21.15.55:0/4178054500 >> 172.21.15.55:0/4178054500 conn(0x7fb0ec0d27d0 msgr2=0x7fb0ec0b7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:34.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.533+0000 7fb0f1888640 1 -- 172.21.15.55:0/4178054500 shutdown_connections 2023-08-25T04:19:34.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.533+0000 7fb0f1888640 1 -- 172.21.15.55:0/4178054500 wait complete. 2023-08-25T04:19:34.551 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:19:34.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.701+0000 7f669cfa2640 1 Processor -- start 2023-08-25T04:19:34.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.701+0000 7f669cfa2640 1 -- start start 2023-08-25T04:19:34.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.701+0000 7f669cfa2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f669815c8a0 0x7f66980b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:34.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.701+0000 7f669cfa2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66980d1270 0x7f66980b1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:34.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.701+0000 7f669cfa2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66980d0690 con 0x7f66980cd190 2023-08-25T04:19:34.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.701+0000 7f669cfa2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66980cd6c0 con 0x7f66980d1270 2023-08-25T04:19:34.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.701+0000 7f669cfa2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66980cd9a0 con 0x7f669815c8a0 2023-08-25T04:19:34.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.701+0000 7f6697fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66980d1270 0x7f66980b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:34.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.701+0000 7f6697fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66980d1270 0x7f66980b1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41946/0 (socket says 172.21.15.55:41946) 2023-08-25T04:19:34.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.701+0000 7f6697fff640 1 -- 172.21.15.55:0/1059705588 learned_addr learned my addr 172.21.15.55:0/1059705588 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:34.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.701+0000 7f66977fe640 1 --2- 172.21.15.55:0/1059705588 >> v2:172.21.15.110:3300/0 conn(0x7f669815c8a0 0x7f66980b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:34.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.701+0000 7f6697fff640 1 -- 172.21.15.55:0/1059705588 >> v2:172.21.15.110:3300/0 conn(0x7f669815c8a0 msgr2=0x7f66980b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:34.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.701+0000 7f6697fff640 1 --2- 172.21.15.55:0/1059705588 >> v2:172.21.15.110:3300/0 conn(0x7f669815c8a0 0x7f66980b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.701+0000 7f6697fff640 1 -- 172.21.15.55:0/1059705588 >> v1:172.21.15.55:6789/0 conn(0x7f66980cd190 legacy=0x7f66980d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:34.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.701+0000 7f6697fff640 1 -- 172.21.15.55:0/1059705588 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66980cdc80 con 0x7f66980d1270 2023-08-25T04:19:34.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.705+0000 7f6697fff640 1 --2- 172.21.15.55:0/1059705588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66980d1270 0x7f66980b1160 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f669808b4b0 tx=0x7f669001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52837e8423c17964 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.705+0000 7f6696ffd640 1 -- 172.21.15.55:0/1059705588 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66900a5860 con 0x7f66980d1270 2023-08-25T04:19:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.705+0000 7f6696ffd640 1 -- 172.21.15.55:0/1059705588 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66900a59c0 con 0x7f66980d1270 2023-08-25T04:19:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.705+0000 7f6696ffd640 1 -- 172.21.15.55:0/1059705588 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66900a5d50 con 0x7f66980d1270 2023-08-25T04:19:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.705+0000 7f669cfa2640 1 -- 172.21.15.55:0/1059705588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66980d1270 msgr2=0x7f66980b1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.705+0000 7f669cfa2640 1 --2- 172.21.15.55:0/1059705588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66980d1270 0x7f66980b1160 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f669808b4b0 tx=0x7f669001c9a0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.705+0000 7f669cfa2640 1 -- 172.21.15.55:0/1059705588 shutdown_connections 2023-08-25T04:19:34.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.705+0000 7f669cfa2640 1 --2- 172.21.15.55:0/1059705588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66980d1270 0x7f66980b1160 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.705+0000 7f669cfa2640 1 --2- 172.21.15.55:0/1059705588 >> v2:172.21.15.110:3300/0 conn(0x7f669815c8a0 0x7f66980b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.705+0000 7f669cfa2640 1 -- 172.21.15.55:0/1059705588 >> 172.21.15.55:0/1059705588 conn(0x7f66980d2610 msgr2=0x7f66980d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:34.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.705+0000 7f669cfa2640 1 -- 172.21.15.55:0/1059705588 shutdown_connections 2023-08-25T04:19:34.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.705+0000 7f669cfa2640 1 -- 172.21.15.55:0/1059705588 wait complete. 2023-08-25T04:19:34.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f669cfa2640 1 Processor -- start 2023-08-25T04:19:34.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f669cfa2640 1 -- start start 2023-08-25T04:19:34.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f669cfa2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66980cd190 0x7f669815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:34.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f669cfa2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66980d1270 0x7f669814e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:34.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f669cfa2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f669815c8a0 0x7f669814ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:34.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f669cfa2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66980b80a0 con 0x7f669815c8a0 2023-08-25T04:19:34.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f669cfa2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66980c9880 con 0x7f66980d1270 2023-08-25T04:19:34.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f669cfa2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66980b7800 con 0x7f66980cd190 2023-08-25T04:19:34.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f6697fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f669815c8a0 0x7f669814ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:34.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f668ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66980d1270 0x7f669814e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:34.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f66977fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66980cd190 0x7f669815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:34.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f6697fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f669815c8a0 0x7f669814ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41962/0 (socket says 172.21.15.55:41962) 2023-08-25T04:19:34.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f6697fff640 1 -- 172.21.15.55:0/1972543854 learned_addr learned my addr 172.21.15.55:0/1972543854 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:34.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f668ffff640 1 -- 172.21.15.55:0/1972543854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66980cd190 msgr2=0x7f669815fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:34.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f668ffff640 1 --2- 172.21.15.55:0/1972543854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66980cd190 0x7f669815fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f668ffff640 1 -- 172.21.15.55:0/1972543854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f669815c8a0 msgr2=0x7f669814ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:34.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f668ffff640 1 --2- 172.21.15.55:0/1972543854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f669815c8a0 0x7f669814ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f668ffff640 1 -- 172.21.15.55:0/1972543854 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6690009b30 con 0x7f66980d1270 2023-08-25T04:19:34.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f6697fff640 1 --2- 172.21.15.55:0/1972543854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f669815c8a0 0x7f669814ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f668ffff640 1 --2- 172.21.15.55:0/1972543854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66980d1270 0x7f669814e800 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6680000f70 tx=0x7f668000c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f6694ff9640 1 -- 172.21.15.55:0/1972543854 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66800052d0 con 0x7f66980d1270 2023-08-25T04:19:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f6694ff9640 1 -- 172.21.15.55:0/1972543854 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6680005430 con 0x7f66980d1270 2023-08-25T04:19:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f6694ff9640 1 -- 172.21.15.55:0/1972543854 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6680003840 con 0x7f66980d1270 2023-08-25T04:19:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f669cfa2640 1 -- 172.21.15.55:0/1972543854 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66980b7ae0 con 0x7f66980d1270 2023-08-25T04:19:34.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.709+0000 7f669cfa2640 1 -- 172.21.15.55:0/1972543854 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669815fff0 con 0x7f66980d1270 2023-08-25T04:19:34.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.713+0000 7f669cfa2640 1 -- 172.21.15.55:0/1972543854 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66980c9650 con 0x7f66980d1270 2023-08-25T04:19:34.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.713+0000 7f6694ff9640 1 -- 172.21.15.55:0/1972543854 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f66800039a0 con 0x7f66980d1270 2023-08-25T04:19:34.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.713+0000 7f6694ff9640 1 --2- 172.21.15.55:0/1972543854 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f6678065740 0x7f6678067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:34.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.713+0000 7f6694ff9640 1 -- 172.21.15.55:0/1972543854 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f6680082350 con 0x7f66980d1270 2023-08-25T04:19:34.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.713+0000 7f66977fe640 1 --2- 172.21.15.55:0/1972543854 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f6678065740 0x7f6678067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:34.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.713+0000 7f66977fe640 1 --2- 172.21.15.55:0/1972543854 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f6678065740 0x7f6678067c00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6688009aa0 tx=0x7f6688006f90 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:34.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.717+0000 7f6694ff9640 1 -- 172.21.15.55:0/1972543854 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f66980c9650 con 0x7f66980d1270 2023-08-25T04:19:34.834 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:34.832+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:34.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.877+0000 7f669cfa2640 1 -- 172.21.15.55:0/1972543854 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f66980c9650 con 0x7f66980d1270 2023-08-25T04:19:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.877+0000 7f6694ff9640 1 -- 172.21.15.55:0/1972543854 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v98) v1 ==== 92+0+10 (secure 0 0 0) 0x7f66980c9650 con 0x7f66980d1270 2023-08-25T04:19:34.879 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:19:34.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.881+0000 7f669cfa2640 1 -- 172.21.15.55:0/1972543854 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f6678065740 msgr2=0x7f6678067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:34.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.881+0000 7f669cfa2640 1 --2- 172.21.15.55:0/1972543854 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f6678065740 0x7f6678067c00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6688009aa0 tx=0x7f6688006f90 comp rx=0 tx=0).stop 2023-08-25T04:19:34.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.881+0000 7f669cfa2640 1 -- 172.21.15.55:0/1972543854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66980d1270 msgr2=0x7f669814e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:34.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.881+0000 7f669cfa2640 1 --2- 172.21.15.55:0/1972543854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66980d1270 0x7f669814e800 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6680000f70 tx=0x7f668000c890 comp rx=0 tx=0).stop 2023-08-25T04:19:34.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.881+0000 7f669cfa2640 1 -- 172.21.15.55:0/1972543854 shutdown_connections 2023-08-25T04:19:34.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.881+0000 7f669cfa2640 1 --2- 172.21.15.55:0/1972543854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f669815c8a0 0x7f669814ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.881+0000 7f669cfa2640 1 --2- 172.21.15.55:0/1972543854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66980d1270 0x7f669814e800 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.881+0000 7f669cfa2640 1 --2- 172.21.15.55:0/1972543854 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f6678065740 0x7f6678067c00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.881+0000 7f669cfa2640 1 --2- 172.21.15.55:0/1972543854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66980cd190 0x7f669815fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:34.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.881+0000 7f669cfa2640 1 -- 172.21.15.55:0/1972543854 >> 172.21.15.55:0/1972543854 conn(0x7f66980d2610 msgr2=0x7f66980b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:34.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.881+0000 7f669cfa2640 1 -- 172.21.15.55:0/1972543854 shutdown_connections 2023-08-25T04:19:34.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:34.881+0000 7f669cfa2640 1 -- 172.21.15.55:0/1972543854 wait complete. 2023-08-25T04:19:34.901 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-25T04:19:35.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f30697ac640 1 Processor -- start 2023-08-25T04:19:35.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f30697ac640 1 -- start start 2023-08-25T04:19:35.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f30697ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30641601f0 0x7f306415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:35.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f30697ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f306415e3c0 0x7f30640d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:35.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f30697ac640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f30640d10c0 0x7f30640b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:35.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f30697ac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30640cd5a0 con 0x7f306415e3c0 2023-08-25T04:19:35.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f30697ac640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30640cd880 con 0x7f30640d10c0 2023-08-25T04:19:35.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f30697ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30640cdb60 con 0x7f30641601f0 2023-08-25T04:19:35.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f30627fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f306415e3c0 0x7f30640d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:35.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f30627fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f306415e3c0 0x7f30640d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41964/0 (socket says 172.21.15.55:41964) 2023-08-25T04:19:35.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f30627fc640 1 -- 172.21.15.55:0/744014744 learned_addr learned my addr 172.21.15.55:0/744014744 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:35.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f3062ffd640 1 --2- 172.21.15.55:0/744014744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30641601f0 0x7f306415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:35.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f30637fe640 1 --2- 172.21.15.55:0/744014744 >> v2:172.21.15.110:3300/0 conn(0x7f30640d10c0 0x7f30640b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:35.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f30627fc640 1 -- 172.21.15.55:0/744014744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30641601f0 msgr2=0x7f306415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:35.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f30627fc640 1 --2- 172.21.15.55:0/744014744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30641601f0 0x7f306415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f30627fc640 1 -- 172.21.15.55:0/744014744 >> v2:172.21.15.110:3300/0 conn(0x7f30640d10c0 msgr2=0x7f30640b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:35.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f30627fc640 1 --2- 172.21.15.55:0/744014744 >> v2:172.21.15.110:3300/0 conn(0x7f30640d10c0 0x7f30640b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f30627fc640 1 -- 172.21.15.55:0/744014744 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30640cde40 con 0x7f306415e3c0 2023-08-25T04:19:35.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f30637fe640 1 --2- 172.21.15.55:0/744014744 >> v2:172.21.15.110:3300/0 conn(0x7f30640d10c0 0x7f30640b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:35.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.053+0000 7f3062ffd640 1 --2- 172.21.15.55:0/744014744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30641601f0 0x7f306415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:35.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.057+0000 7f30627fc640 1 --2- 172.21.15.55:0/744014744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f306415e3c0 0x7f30640d0b80 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f30640d0540 tx=0x7f305801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47466a34a2b4e062 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:35.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.057+0000 7f3061ffb640 1 -- 172.21.15.55:0/744014744 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30580a89b0 con 0x7f306415e3c0 2023-08-25T04:19:35.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.057+0000 7f3061ffb640 1 -- 172.21.15.55:0/744014744 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30580a8b10 con 0x7f306415e3c0 2023-08-25T04:19:35.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.057+0000 7f3061ffb640 1 -- 172.21.15.55:0/744014744 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30580a8ea0 con 0x7f306415e3c0 2023-08-25T04:19:35.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.057+0000 7f30697ac640 1 -- 172.21.15.55:0/744014744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f306415e3c0 msgr2=0x7f30640d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:35.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.057+0000 7f30697ac640 1 --2- 172.21.15.55:0/744014744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f306415e3c0 0x7f30640d0b80 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f30640d0540 tx=0x7f305801ecf0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.057+0000 7f30697ac640 1 -- 172.21.15.55:0/744014744 shutdown_connections 2023-08-25T04:19:35.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.057+0000 7f30697ac640 1 --2- 172.21.15.55:0/744014744 >> v2:172.21.15.110:3300/0 conn(0x7f30640d10c0 0x7f30640b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.057+0000 7f30697ac640 1 --2- 172.21.15.55:0/744014744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f306415e3c0 0x7f30640d0b80 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.057+0000 7f30697ac640 1 --2- 172.21.15.55:0/744014744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30641601f0 0x7f306415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.057+0000 7f30697ac640 1 -- 172.21.15.55:0/744014744 >> 172.21.15.55:0/744014744 conn(0x7f30640d27d0 msgr2=0x7f30640d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.057+0000 7f30697ac640 1 -- 172.21.15.55:0/744014744 shutdown_connections 2023-08-25T04:19:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.057+0000 7f30697ac640 1 -- 172.21.15.55:0/744014744 wait complete. 2023-08-25T04:19:35.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f30697ac640 1 Processor -- start 2023-08-25T04:19:35.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f30697ac640 1 -- start start 2023-08-25T04:19:35.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f30697ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30640d10c0 0x7f306415a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:35.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f30697ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f306415e3c0 0x7f30640c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:35.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f30697ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30641601f0 0x7f30640cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:35.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f30697ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306415acd0 con 0x7f30640d10c0 2023-08-25T04:19:35.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f30697ac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30640c9b80 con 0x7f306415e3c0 2023-08-25T04:19:35.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f30697ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30640c9e60 con 0x7f30641601f0 2023-08-25T04:19:35.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f3062ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30640d10c0 0x7f306415a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:35.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f3062ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30640d10c0 0x7f306415a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41970/0 (socket says 172.21.15.55:41970) 2023-08-25T04:19:35.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f3062ffd640 1 -- 172.21.15.55:0/1722114260 learned_addr learned my addr 172.21.15.55:0/1722114260 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:35.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f30627fc640 1 --2- 172.21.15.55:0/1722114260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f306415e3c0 0x7f30640c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:35.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f30637fe640 1 --2- 172.21.15.55:0/1722114260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30641601f0 0x7f30640cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:35.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f3062ffd640 1 -- 172.21.15.55:0/1722114260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30641601f0 msgr2=0x7f30640cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:35.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f3062ffd640 1 --2- 172.21.15.55:0/1722114260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30641601f0 0x7f30640cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f3062ffd640 1 -- 172.21.15.55:0/1722114260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f306415e3c0 msgr2=0x7f30640c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:35.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f3062ffd640 1 --2- 172.21.15.55:0/1722114260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f306415e3c0 0x7f30640c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f3062ffd640 1 -- 172.21.15.55:0/1722114260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580094d0 con 0x7f30640d10c0 2023-08-25T04:19:35.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f30627fc640 1 --2- 172.21.15.55:0/1722114260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f306415e3c0 0x7f30640c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:19:35.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f30637fe640 1 --2- 172.21.15.55:0/1722114260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30641601f0 0x7f30640cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:19:35.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f3062ffd640 1 --2- 172.21.15.55:0/1722114260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30640d10c0 0x7f306415a790 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f305400d7d0 tx=0x7f305400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:35.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f304b7fe640 1 -- 172.21.15.55:0/1722114260 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30540059a0 con 0x7f30640d10c0 2023-08-25T04:19:35.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f304b7fe640 1 -- 172.21.15.55:0/1722114260 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3054005b00 con 0x7f30640d10c0 2023-08-25T04:19:35.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f304b7fe640 1 -- 172.21.15.55:0/1722114260 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054005e90 con 0x7f30640d10c0 2023-08-25T04:19:35.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f30697ac640 1 -- 172.21.15.55:0/1722114260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30640ce7c0 con 0x7f30640d10c0 2023-08-25T04:19:35.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.061+0000 7f30697ac640 1 -- 172.21.15.55:0/1722114260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30640ca420 con 0x7f30640d10c0 2023-08-25T04:19:35.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.065+0000 7f30697ac640 1 -- 172.21.15.55:0/1722114260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30640b5260 con 0x7f30640d10c0 2023-08-25T04:19:35.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.065+0000 7f304b7fe640 1 -- 172.21.15.55:0/1722114260 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f3054004030 con 0x7f30640d10c0 2023-08-25T04:19:35.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.065+0000 7f304b7fe640 1 --2- 172.21.15.55:0/1722114260 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f3050065710 0x7f3050067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:35.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.065+0000 7f304b7fe640 1 -- 172.21.15.55:0/1722114260 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f3054082e60 con 0x7f30640d10c0 2023-08-25T04:19:35.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.065+0000 7f30627fc640 1 --2- 172.21.15.55:0/1722114260 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f3050065710 0x7f3050067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:35.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.065+0000 7f30627fc640 1 --2- 172.21.15.55:0/1722114260 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f3050065710 0x7f3050067bd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f30580b2000 tx=0x7f30580aa070 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:35.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.069+0000 7f304b7fe640 1 -- 172.21.15.55:0/1722114260 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f30540543c0 con 0x7f30640d10c0 2023-08-25T04:19:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.225+0000 7f30697ac640 1 -- 172.21.15.55:0/1722114260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3064073ec0 con 0x7f30640d10c0 2023-08-25T04:19:35.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.233+0000 7f304b7fe640 1 -- 172.21.15.55:0/1722114260 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3054053f50 con 0x7f30640d10c0 2023-08-25T04:19:35.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.233+0000 7f30697ac640 1 -- 172.21.15.55:0/1722114260 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f3050065710 msgr2=0x7f3050067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.233+0000 7f30697ac640 1 --2- 172.21.15.55:0/1722114260 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f3050065710 0x7f3050067bd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f30580b2000 tx=0x7f30580aa070 comp rx=0 tx=0).stop 2023-08-25T04:19:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.233+0000 7f30697ac640 1 -- 172.21.15.55:0/1722114260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30640d10c0 msgr2=0x7f306415a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.233+0000 7f30697ac640 1 --2- 172.21.15.55:0/1722114260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30640d10c0 0x7f306415a790 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f305400d7d0 tx=0x7f305400dc90 comp rx=0 tx=0).stop 2023-08-25T04:19:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.233+0000 7f30697ac640 1 -- 172.21.15.55:0/1722114260 shutdown_connections 2023-08-25T04:19:35.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.233+0000 7f30697ac640 1 --2- 172.21.15.55:0/1722114260 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f3050065710 0x7f3050067bd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.233+0000 7f30697ac640 1 --2- 172.21.15.55:0/1722114260 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f30641601f0 0x7f30640cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.233+0000 7f30697ac640 1 --2- 172.21.15.55:0/1722114260 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f306415e3c0 0x7f30640c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.233+0000 7f30697ac640 1 --2- 172.21.15.55:0/1722114260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30640d10c0 0x7f306415a790 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.233+0000 7f30697ac640 1 -- 172.21.15.55:0/1722114260 >> 172.21.15.55:0/1722114260 conn(0x7f30640d27d0 msgr2=0x7f30640cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:35.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.233+0000 7f30697ac640 1 -- 172.21.15.55:0/1722114260 shutdown_connections 2023-08-25T04:19:35.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.233+0000 7f30697ac640 1 -- 172.21.15.55:0/1722114260 wait complete. 2023-08-25T04:19:35.253 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T04:19:35.254 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:19:35.309 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:19:35.363 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T04:19:35.364 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:19:35.364 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:19:35.376 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T04:19:35.377 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:19:35.377 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:19:35.387 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:19:35.387 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:19:35.388 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:19:35.430 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T04:19:35.431 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:19:35.431 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:19:35.440 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:19:35.441 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-25T04:19:35.441 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:19:35.549 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:35.544+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:35.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.625+0000 7f1a27688640 1 Processor -- start 2023-08-25T04:19:35.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.625+0000 7f1a27688640 1 -- start start 2023-08-25T04:19:35.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.625+0000 7f1a27688640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1a20164410 0x7f1a200b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:35.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.625+0000 7f1a27688640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a200c1a80 0x7f1a2006bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:35.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.625+0000 7f1a27688640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a200cc510 con 0x7f1a200cddf0 2023-08-25T04:19:35.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.625+0000 7f1a27688640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a201647f0 con 0x7f1a20164410 2023-08-25T04:19:35.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.625+0000 7f1a27688640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a200cc9b0 con 0x7f1a200c1a80 2023-08-25T04:19:35.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.625+0000 7f1a24c23640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1a200cddf0 0x7f1a200c1370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56162/0 (socket says 172.21.15.55:56162) 2023-08-25T04:19:35.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.625+0000 7f1a24c23640 1 -- 172.21.15.55:0/1069548074 learned_addr learned my addr 172.21.15.55:0/1069548074 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:35.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.625+0000 7f1a25424640 1 --2- 172.21.15.55:0/1069548074 >> v2:172.21.15.55:3300/0 conn(0x7f1a20164410 0x7f1a200b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:35.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.625+0000 7f1a25c25640 1 --2- 172.21.15.55:0/1069548074 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a200c1a80 0x7f1a2006bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:35.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.629+0000 7f1a25424640 1 -- 172.21.15.55:0/1069548074 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a200c1a80 msgr2=0x7f1a2006bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:35.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.629+0000 7f1a25424640 1 --2- 172.21.15.55:0/1069548074 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a200c1a80 0x7f1a2006bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.629+0000 7f1a25424640 1 -- 172.21.15.55:0/1069548074 >> v1:172.21.15.55:6789/0 conn(0x7f1a200cddf0 legacy=0x7f1a200c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:35.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.629+0000 7f1a25424640 1 -- 172.21.15.55:0/1069548074 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a200ccc90 con 0x7f1a20164410 2023-08-25T04:19:35.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.629+0000 7f1a25424640 1 --2- 172.21.15.55:0/1069548074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a20164410 0x7f1a200b21b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0097c0 tx=0x7f1a1c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4334d10b7466de3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:35.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.629+0000 7f1a17fff640 1 -- 172.21.15.55:0/1069548074 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0ab600 con 0x7f1a20164410 2023-08-25T04:19:35.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.629+0000 7f1a17fff640 1 -- 172.21.15.55:0/1069548074 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c0a7050 con 0x7f1a20164410 2023-08-25T04:19:35.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.629+0000 7f1a17fff640 1 -- 172.21.15.55:0/1069548074 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0ab980 con 0x7f1a20164410 2023-08-25T04:19:35.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.629+0000 7f1a27688640 1 -- 172.21.15.55:0/1069548074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a20164410 msgr2=0x7f1a200b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:35.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.629+0000 7f1a27688640 1 --2- 172.21.15.55:0/1069548074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a20164410 0x7f1a200b21b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0097c0 tx=0x7f1a1c01c480 comp rx=0 tx=0).stop 2023-08-25T04:19:35.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a27688640 1 -- 172.21.15.55:0/1069548074 shutdown_connections 2023-08-25T04:19:35.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a27688640 1 --2- 172.21.15.55:0/1069548074 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a200c1a80 0x7f1a2006bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a27688640 1 --2- 172.21.15.55:0/1069548074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a20164410 0x7f1a200b21b0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a27688640 1 -- 172.21.15.55:0/1069548074 >> 172.21.15.55:0/1069548074 conn(0x7f1a20069d00 msgr2=0x7f1a2006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:35.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a27688640 1 -- 172.21.15.55:0/1069548074 shutdown_connections 2023-08-25T04:19:35.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a27688640 1 -- 172.21.15.55:0/1069548074 wait complete. 2023-08-25T04:19:35.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a27688640 1 Processor -- start 2023-08-25T04:19:35.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a27688640 1 -- start start 2023-08-25T04:19:35.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a27688640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a200c1a80 0x7f1a201633a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:35.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a27688640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a200cddf0 0x7f1a2015f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:35.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a27688640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a20164410 0x7f1a2015bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:35.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a27688640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2015b7e0 con 0x7f1a20164410 2023-08-25T04:19:35.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a27688640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2015a8f0 con 0x7f1a200cddf0 2023-08-25T04:19:35.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a27688640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2015abd0 con 0x7f1a200c1a80 2023-08-25T04:19:35.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a25c25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a20164410 0x7f1a2015bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:35.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a25424640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a200c1a80 0x7f1a201633a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:35.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a24c23640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a200cddf0 0x7f1a2015f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:35.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a25424640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a200c1a80 0x7f1a201633a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:53010/0 (socket says 172.21.15.55:53010) 2023-08-25T04:19:35.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.633+0000 7f1a25424640 1 -- 172.21.15.55:0/1029445104 learned_addr learned my addr 172.21.15.55:0/1029445104 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:35.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.637+0000 7f1a25c25640 1 -- 172.21.15.55:0/1029445104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a200c1a80 msgr2=0x7f1a201633a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:35.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.637+0000 7f1a25c25640 1 --2- 172.21.15.55:0/1029445104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a200c1a80 0x7f1a201633a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.637+0000 7f1a25c25640 1 -- 172.21.15.55:0/1029445104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a200cddf0 msgr2=0x7f1a2015f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:35.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.637+0000 7f1a25c25640 1 --2- 172.21.15.55:0/1029445104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a200cddf0 0x7f1a2015f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.637+0000 7f1a25c25640 1 -- 172.21.15.55:0/1029445104 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c009420 con 0x7f1a20164410 2023-08-25T04:19:35.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.637+0000 7f1a25424640 1 --2- 172.21.15.55:0/1029445104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a200c1a80 0x7f1a201633a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:35.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.637+0000 7f1a25c25640 1 --2- 172.21.15.55:0/1029445104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a20164410 0x7f1a2015bcb0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f1a200b3370 tx=0x7f1a1800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:35.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.637+0000 7f1a15ffb640 1 -- 172.21.15.55:0/1029445104 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18009c00 con 0x7f1a20164410 2023-08-25T04:19:35.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.637+0000 7f1a27688640 1 -- 172.21.15.55:0/1029445104 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2015aeb0 con 0x7f1a20164410 2023-08-25T04:19:35.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.637+0000 7f1a15ffb640 1 -- 172.21.15.55:0/1029445104 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1800f040 con 0x7f1a20164410 2023-08-25T04:19:35.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.637+0000 7f1a15ffb640 1 -- 172.21.15.55:0/1029445104 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a180146c0 con 0x7f1a20164410 2023-08-25T04:19:35.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.637+0000 7f1a27688640 1 -- 172.21.15.55:0/1029445104 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2015b470 con 0x7f1a20164410 2023-08-25T04:19:35.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.637+0000 7f1a27688640 1 -- 172.21.15.55:0/1029445104 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2004dbe0 con 0x7f1a20164410 2023-08-25T04:19:35.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.641+0000 7f1a15ffb640 1 -- 172.21.15.55:0/1029445104 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f1a18014820 con 0x7f1a20164410 2023-08-25T04:19:35.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.641+0000 7f1a15ffb640 1 --2- 172.21.15.55:0/1029445104 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f1a04065710 0x7f1a04067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:35.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.641+0000 7f1a15ffb640 1 -- 172.21.15.55:0/1029445104 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f1a18083cc0 con 0x7f1a20164410 2023-08-25T04:19:35.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.641+0000 7f1a25424640 1 --2- 172.21.15.55:0/1029445104 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f1a04065710 0x7f1a04067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:35.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.641+0000 7f1a25424640 1 --2- 172.21.15.55:0/1029445104 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f1a04065710 0x7f1a04067bd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0097c0 tx=0x7f1a1c0a6000 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:35.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.649+0000 7f1a15ffb640 1 -- 172.21.15.55:0/1029445104 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1a1808a080 con 0x7f1a20164410 2023-08-25T04:19:35.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.841+0000 7f1a27688640 1 -- 172.21.15.55:0/1029445104 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a20160fd0 con 0x7f1a20164410 2023-08-25T04:19:35.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.841+0000 7f1a15ffb640 1 -- 172.21.15.55:0/1029445104 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f1a18018090 con 0x7f1a20164410 2023-08-25T04:19:35.842 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:35.843 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6311,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/976095252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":976095252},{"type":"v1","addr":"172.21.15.110:6836","nonce":976095252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":6314,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1364761770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1364761770},{"type":"v1","addr":"172.21.15.110:6837","nonce":1364761770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2491496151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2491496151},{"type":"v1","addr":"172.21.15.55:6834","nonce":2491496151}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":35},{"gid":7743,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/1058259694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1058259694},{"type":"v1","addr":"172.21.15.55:6835","nonce":1058259694}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[]} 2023-08-25T04:19:35.843 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 42 2023-08-25T04:19:35.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.845+0000 7f1a27688640 1 -- 172.21.15.55:0/1029445104 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f1a04065710 msgr2=0x7f1a04067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:35.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.845+0000 7f1a27688640 1 --2- 172.21.15.55:0/1029445104 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f1a04065710 0x7f1a04067bd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0097c0 tx=0x7f1a1c0a6000 comp rx=0 tx=0).stop 2023-08-25T04:19:35.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.845+0000 7f1a27688640 1 -- 172.21.15.55:0/1029445104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a20164410 msgr2=0x7f1a2015bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:35.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.845+0000 7f1a27688640 1 --2- 172.21.15.55:0/1029445104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a20164410 0x7f1a2015bcb0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f1a200b3370 tx=0x7f1a1800ef90 comp rx=0 tx=0).stop 2023-08-25T04:19:35.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.845+0000 7f1a27688640 1 -- 172.21.15.55:0/1029445104 shutdown_connections 2023-08-25T04:19:35.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.845+0000 7f1a27688640 1 --2- 172.21.15.55:0/1029445104 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a20164410 0x7f1a2015bcb0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.845+0000 7f1a27688640 1 --2- 172.21.15.55:0/1029445104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a200cddf0 0x7f1a2015f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.845+0000 7f1a27688640 1 --2- 172.21.15.55:0/1029445104 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f1a04065710 0x7f1a04067bd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.845+0000 7f1a27688640 1 --2- 172.21.15.55:0/1029445104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a200c1a80 0x7f1a201633a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:35.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.845+0000 7f1a27688640 1 -- 172.21.15.55:0/1029445104 >> 172.21.15.55:0/1029445104 conn(0x7f1a20069d00 msgr2=0x7f1a200ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:35.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.845+0000 7f1a27688640 1 -- 172.21.15.55:0/1029445104 shutdown_connections 2023-08-25T04:19:35.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:35.845+0000 7f1a27688640 1 -- 172.21.15.55:0/1029445104 wait complete. 2023-08-25T04:19:35.864 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-25T04:19:35.865 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-25T04:19:35.865 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-25T04:19:35.866 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:19:35.866 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-25T04:19:35.867 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-25T04:19:35.867 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-25T04:19:35.867 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:19:35.868 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-25T04:19:35.868 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-25T04:19:35.868 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-25T04:19:35.869 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:19:35.869 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-25T04:19:35.869 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-25T04:19:35.869 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-25T04:19:35.870 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:19:35.879 INFO:tasks.ceph.mds.a:Stopped 2023-08-25T04:19:35.879 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-25T04:19:35.880 INFO:tasks.ceph.mds.c:Stopped 2023-08-25T04:19:35.881 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-25T04:19:35.882 INFO:tasks.ceph.mds.b:Stopped 2023-08-25T04:19:35.883 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-25T04:19:35.884 INFO:tasks.ceph.mds.d:Stopped 2023-08-25T04:19:35.884 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-25T04:19:35.928 INFO:tasks.ceph.mds.b:Started 2023-08-25T04:19:35.929 DEBUG:teuthology.parallel:result is None 2023-08-25T04:19:35.930 INFO:tasks.ceph.mds.a:Started 2023-08-25T04:19:35.931 INFO:tasks.ceph.mds.d:Started 2023-08-25T04:19:35.931 DEBUG:teuthology.parallel:result is None 2023-08-25T04:19:35.932 DEBUG:teuthology.parallel:result is None 2023-08-25T04:19:35.932 INFO:tasks.ceph.mds.c:Started 2023-08-25T04:19:35.933 DEBUG:teuthology.parallel:result is None 2023-08-25T04:19:35.933 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-25T04:19:36.018 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2023-08-25T04:19:36.019 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2023-08-25T04:19:36.021 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-08-25T04:19:36.022 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T04:19:36.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.089+0000 7f74658e5640 1 Processor -- start 2023-08-25T04:19:36.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.089+0000 7f74658e5640 1 -- start start 2023-08-25T04:19:36.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.089+0000 7f74658e5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74600d0da0 0x7f74600d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:36.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.089+0000 7f74658e5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74600b29b0 con 0x7f74600b3e50 2023-08-25T04:19:36.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.089+0000 7f74658e5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74600cfc80 con 0x7f74600cdde0 2023-08-25T04:19:36.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.089+0000 7f74658e5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74600d16c0 con 0x7f74600d0da0 2023-08-25T04:19:36.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.089+0000 7f745effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74600d0da0 0x7f74600d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:36.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.089+0000 7f745f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f74600b3e50 0x7f74600cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56180/0 (socket says 172.21.15.55:56180) 2023-08-25T04:19:36.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.089+0000 7f745f7fe640 1 -- 172.21.15.55:0/2424522383 learned_addr learned my addr 172.21.15.55:0/2424522383 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:36.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.089+0000 7f745effd640 1 -- 172.21.15.55:0/2424522383 >> v1:172.21.15.110:6789/0 conn(0x7f74600cdde0 legacy=0x7f74600cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:36.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.089+0000 7f745effd640 1 -- 172.21.15.55:0/2424522383 >> v1:172.21.15.55:6789/0 conn(0x7f74600b3e50 legacy=0x7f74600cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:36.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.089+0000 7f745dffb640 1 -- 172.21.15.55:0/2424522383 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145316070 0 0) 0x7f74600b29b0 con 0x7f74600b3e50 2023-08-25T04:19:36.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.089+0000 7f745effd640 1 -- 172.21.15.55:0/2424522383 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74600b1dc0 con 0x7f74600d0da0 2023-08-25T04:19:36.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.093+0000 7f745effd640 1 --2- 172.21.15.55:0/2424522383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74600d0da0 0x7f74600d1180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f74500097d0 tx=0x7f745001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18334c6abeef3268 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:36.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.093+0000 7f745dffb640 1 -- 172.21.15.55:0/2424522383 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74500a8990 con 0x7f74600d0da0 2023-08-25T04:19:36.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.093+0000 7f745dffb640 1 -- 172.21.15.55:0/2424522383 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74500a8af0 con 0x7f74600d0da0 2023-08-25T04:19:36.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.093+0000 7f745dffb640 1 -- 172.21.15.55:0/2424522383 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74500a8e80 con 0x7f74600d0da0 2023-08-25T04:19:36.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.093+0000 7f74658e5640 1 -- 172.21.15.55:0/2424522383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74600d0da0 msgr2=0x7f74600d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:36.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.093+0000 7f74658e5640 1 --2- 172.21.15.55:0/2424522383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74600d0da0 0x7f74600d1180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f74500097d0 tx=0x7f745001ec90 comp rx=0 tx=0).stop 2023-08-25T04:19:36.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.093+0000 7f74658e5640 1 -- 172.21.15.55:0/2424522383 shutdown_connections 2023-08-25T04:19:36.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.093+0000 7f74658e5640 1 --2- 172.21.15.55:0/2424522383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74600d0da0 0x7f74600d1180 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:36.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.093+0000 7f74658e5640 1 -- 172.21.15.55:0/2424522383 >> 172.21.15.55:0/2424522383 conn(0x7f746009bae0 msgr2=0x7f74600d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:36.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.093+0000 7f74658e5640 1 -- 172.21.15.55:0/2424522383 shutdown_connections 2023-08-25T04:19:36.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.093+0000 7f74658e5640 1 -- 172.21.15.55:0/2424522383 wait complete. 2023-08-25T04:19:36.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f74658e5640 1 Processor -- start 2023-08-25T04:19:36.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f74658e5640 1 -- start start 2023-08-25T04:19:36.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f74658e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74600b3e50 0x7f746014f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:36.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f74658e5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74600cdde0 0x7f746015ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:36.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f74658e5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74600d0da0 0x7f74600cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:36.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f74658e5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746015d930 con 0x7f74600b3e50 2023-08-25T04:19:36.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f74658e5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746014f880 con 0x7f74600cdde0 2023-08-25T04:19:36.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f74658e5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746015dbd0 con 0x7f74600d0da0 2023-08-25T04:19:36.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f745effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74600b3e50 0x7f746014f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:36.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f745effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74600b3e50 0x7f746014f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42024/0 (socket says 172.21.15.55:42024) 2023-08-25T04:19:36.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f745effd640 1 -- 172.21.15.55:0/1856658770 learned_addr learned my addr 172.21.15.55:0/1856658770 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:36.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f745e7fc640 1 --2- 172.21.15.55:0/1856658770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74600cdde0 0x7f746015ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:36.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f745f7fe640 1 --2- 172.21.15.55:0/1856658770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74600d0da0 0x7f74600cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:36.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f745effd640 1 -- 172.21.15.55:0/1856658770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74600d0da0 msgr2=0x7f74600cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:36.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f745effd640 1 --2- 172.21.15.55:0/1856658770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74600d0da0 0x7f74600cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:36.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f745effd640 1 -- 172.21.15.55:0/1856658770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74600cdde0 msgr2=0x7f746015ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:36.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f745effd640 1 --2- 172.21.15.55:0/1856658770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74600cdde0 0x7f746015ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:36.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f745effd640 1 -- 172.21.15.55:0/1856658770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74500093b0 con 0x7f74600b3e50 2023-08-25T04:19:36.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f745f7fe640 1 --2- 172.21.15.55:0/1856658770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74600d0da0 0x7f74600cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:36.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f745effd640 1 --2- 172.21.15.55:0/1856658770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74600b3e50 0x7f746014f340 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f74500b3040 tx=0x7f745001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:36.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f7447fff640 1 -- 172.21.15.55:0/1856658770 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74500a8990 con 0x7f74600b3e50 2023-08-25T04:19:36.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f7447fff640 1 -- 172.21.15.55:0/1856658770 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74500b9410 con 0x7f74600b3e50 2023-08-25T04:19:36.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f7447fff640 1 -- 172.21.15.55:0/1856658770 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74500b97a0 con 0x7f74600b3e50 2023-08-25T04:19:36.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f74658e5640 1 -- 172.21.15.55:0/1856658770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f746015deb0 con 0x7f74600b3e50 2023-08-25T04:19:36.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.097+0000 7f74658e5640 1 -- 172.21.15.55:0/1856658770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746015e470 con 0x7f74600b3e50 2023-08-25T04:19:36.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.101+0000 7f74658e5640 1 -- 172.21.15.55:0/1856658770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74601600b0 con 0x7f74600b3e50 2023-08-25T04:19:36.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.101+0000 7f7447fff640 1 -- 172.21.15.55:0/1856658770 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f74500b7040 con 0x7f74600b3e50 2023-08-25T04:19:36.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.101+0000 7f7447fff640 1 --2- 172.21.15.55:0/1856658770 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f744c065740 0x7f744c067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:36.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.101+0000 7f7447fff640 1 -- 172.21.15.55:0/1856658770 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f7450120ae0 con 0x7f74600b3e50 2023-08-25T04:19:36.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.101+0000 7f745e7fc640 1 --2- 172.21.15.55:0/1856658770 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f744c065740 0x7f744c067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:36.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.101+0000 7f745e7fc640 1 --2- 172.21.15.55:0/1856658770 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f744c065740 0x7f744c067c00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f74600cc890 tx=0x7f7454009040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:36.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.105+0000 7f7447fff640 1 -- 172.21.15.55:0/1856658770 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f74500ee530 con 0x7f74600b3e50 2023-08-25T04:19:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.273+0000 7f74658e5640 1 -- 172.21.15.55:0/1856658770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f746004dbe0 con 0x7f74600b3e50 2023-08-25T04:19:36.281 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:36.276+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:36.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.853+0000 7f7447fff640 1 -- 172.21.15.55:0/1856658770 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v100) v1 ==== 97+0+0 (secure 0 0 0) 0x7f74500b5080 con 0x7f74600b3e50 2023-08-25T04:19:36.855 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-08-25T04:19:36.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.853+0000 7f74658e5640 1 -- 172.21.15.55:0/1856658770 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f744c065740 msgr2=0x7f744c067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:36.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.853+0000 7f74658e5640 1 --2- 172.21.15.55:0/1856658770 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f744c065740 0x7f744c067c00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f74600cc890 tx=0x7f7454009040 comp rx=0 tx=0).stop 2023-08-25T04:19:36.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.853+0000 7f74658e5640 1 -- 172.21.15.55:0/1856658770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74600b3e50 msgr2=0x7f746014f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:36.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.853+0000 7f74658e5640 1 --2- 172.21.15.55:0/1856658770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74600b3e50 0x7f746014f340 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f74500b3040 tx=0x7f745001ba30 comp rx=0 tx=0).stop 2023-08-25T04:19:36.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.853+0000 7f74658e5640 1 -- 172.21.15.55:0/1856658770 shutdown_connections 2023-08-25T04:19:36.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.853+0000 7f74658e5640 1 --2- 172.21.15.55:0/1856658770 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f744c065740 0x7f744c067c00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:36.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.853+0000 7f74658e5640 1 --2- 172.21.15.55:0/1856658770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74600d0da0 0x7f74600cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:36.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.853+0000 7f74658e5640 1 --2- 172.21.15.55:0/1856658770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74600cdde0 0x7f746015ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:36.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.853+0000 7f74658e5640 1 --2- 172.21.15.55:0/1856658770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74600b3e50 0x7f746014f340 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:36.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.853+0000 7f74658e5640 1 -- 172.21.15.55:0/1856658770 >> 172.21.15.55:0/1856658770 conn(0x7f746009bae0 msgr2=0x7f746015c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:36.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.853+0000 7f74658e5640 1 -- 172.21.15.55:0/1856658770 shutdown_connections 2023-08-25T04:19:36.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:36.853+0000 7f74658e5640 1 -- 172.21.15.55:0/1856658770 wait complete. 2023-08-25T04:19:36.876 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-25T04:19:37.001 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:37.000+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:37.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.025+0000 7fd61292c640 1 Processor -- start 2023-08-25T04:19:37.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.025+0000 7fd61292c640 1 -- start start 2023-08-25T04:19:37.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.025+0000 7fd61292c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd60c0d0da0 0x7fd60c0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:37.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.025+0000 7fd61292c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd60c0b3e50 0x7fd60c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:37.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.025+0000 7fd61292c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60c0b29b0 con 0x7fd60c0cdde0 2023-08-25T04:19:37.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.025+0000 7fd61292c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60c0ce760 con 0x7fd60c0b3e50 2023-08-25T04:19:37.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.025+0000 7fd61292c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60c0d16c0 con 0x7fd60c0d0da0 2023-08-25T04:19:37.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.025+0000 7fd610ec9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd60c0b3e50 0x7fd60c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:37.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.025+0000 7fd610ec9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd60c0b3e50 0x7fd60c0ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42036/0 (socket says 172.21.15.55:42036) 2023-08-25T04:19:37.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.025+0000 7fd610ec9640 1 -- 172.21.15.55:0/986465240 learned_addr learned my addr 172.21.15.55:0/986465240 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:37.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.025+0000 7fd60b7fe640 1 --1- 172.21.15.55:0/986465240 >> v1:172.21.15.55:6789/0 conn(0x7fd60c0cdde0 0x7fd60c0cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56186/0 (socket says 172.21.15.55:56186) 2023-08-25T04:19:37.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.025+0000 7fd60bfff640 1 --2- 172.21.15.55:0/986465240 >> v2:172.21.15.110:3300/0 conn(0x7fd60c0d0da0 0x7fd60c0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:37.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.025+0000 7fd610ec9640 1 -- 172.21.15.55:0/986465240 >> v2:172.21.15.110:3300/0 conn(0x7fd60c0d0da0 msgr2=0x7fd60c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:37.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.025+0000 7fd610ec9640 1 --2- 172.21.15.55:0/986465240 >> v2:172.21.15.110:3300/0 conn(0x7fd60c0d0da0 0x7fd60c0d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.025+0000 7fd610ec9640 1 -- 172.21.15.55:0/986465240 >> v1:172.21.15.55:6789/0 conn(0x7fd60c0cdde0 legacy=0x7fd60c0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.025+0000 7fd610ec9640 1 -- 172.21.15.55:0/986465240 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c0b1dc0 con 0x7fd60c0b3e50 2023-08-25T04:19:37.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.025+0000 7fd60affd640 1 -- 172.21.15.55:0/986465240 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269206450 0 0) 0x7fd60c0b29b0 con 0x7fd60c0cdde0 2023-08-25T04:19:37.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.029+0000 7fd610ec9640 1 --2- 172.21.15.55:0/986465240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd60c0b3e50 0x7fd60c0ce220 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fd60c073720 tx=0x7fd60401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcc764d49a4497b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:37.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.029+0000 7fd60affd640 1 -- 172.21.15.55:0/986465240 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6040af400 con 0x7fd60c0b3e50 2023-08-25T04:19:37.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.029+0000 7fd60affd640 1 -- 172.21.15.55:0/986465240 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6040ab050 con 0x7fd60c0b3e50 2023-08-25T04:19:37.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.029+0000 7fd60affd640 1 -- 172.21.15.55:0/986465240 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6040af780 con 0x7fd60c0b3e50 2023-08-25T04:19:37.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.029+0000 7fd61292c640 1 -- 172.21.15.55:0/986465240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd60c0b3e50 msgr2=0x7fd60c0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.029+0000 7fd61292c640 1 --2- 172.21.15.55:0/986465240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd60c0b3e50 0x7fd60c0ce220 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fd60c073720 tx=0x7fd60401f1c0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.029+0000 7fd61292c640 1 -- 172.21.15.55:0/986465240 shutdown_connections 2023-08-25T04:19:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.029+0000 7fd61292c640 1 --2- 172.21.15.55:0/986465240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd60c0b3e50 0x7fd60c0ce220 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.029+0000 7fd61292c640 1 --2- 172.21.15.55:0/986465240 >> v2:172.21.15.110:3300/0 conn(0x7fd60c0d0da0 0x7fd60c0d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.029+0000 7fd61292c640 1 -- 172.21.15.55:0/986465240 >> 172.21.15.55:0/986465240 conn(0x7fd60c09bae0 msgr2=0x7fd60c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.029+0000 7fd61292c640 1 -- 172.21.15.55:0/986465240 shutdown_connections 2023-08-25T04:19:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.029+0000 7fd61292c640 1 -- 172.21.15.55:0/986465240 wait complete. 2023-08-25T04:19:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd61292c640 1 Processor -- start 2023-08-25T04:19:37.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd61292c640 1 -- start start 2023-08-25T04:19:37.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd61292c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd60c0b3e50 0x7fd60c0cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:37.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd61292c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd60c0cdde0 0x7fd60c1f9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:37.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd61292c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd60c0d0da0 0x7fd60c1f9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:37.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd61292c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c1f7530 con 0x7fd60c0cdde0 2023-08-25T04:19:37.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd61292c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c0ca780 con 0x7fd60c0b3e50 2023-08-25T04:19:37.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd61292c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c0caa60 con 0x7fd60c0d0da0 2023-08-25T04:19:37.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd60b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd60c0cdde0 0x7fd60c1f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:37.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd60bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd60c0b3e50 0x7fd60c0cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:37.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd60bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd60c0b3e50 0x7fd60c0cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:56350/0 (socket says 172.21.15.55:56350) 2023-08-25T04:19:37.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd60b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd60c0cdde0 0x7fd60c1f9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42050/0 (socket says 172.21.15.55:42050) 2023-08-25T04:19:37.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd60bfff640 1 -- 172.21.15.55:0/2084710236 learned_addr learned my addr 172.21.15.55:0/2084710236 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:37.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd610ec9640 1 --2- 172.21.15.55:0/2084710236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd60c0d0da0 0x7fd60c1f9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:37.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd60b7fe640 1 -- 172.21.15.55:0/2084710236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd60c0d0da0 msgr2=0x7fd60c1f9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd60b7fe640 1 --2- 172.21.15.55:0/2084710236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd60c0d0da0 0x7fd60c1f9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd60b7fe640 1 -- 172.21.15.55:0/2084710236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd60c0b3e50 msgr2=0x7fd60c0cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd60b7fe640 1 --2- 172.21.15.55:0/2084710236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd60c0b3e50 0x7fd60c0cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd60b7fe640 1 -- 172.21.15.55:0/2084710236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd604009b30 con 0x7fd60c0cdde0 2023-08-25T04:19:37.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd610ec9640 1 --2- 172.21.15.55:0/2084710236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd60c0d0da0 0x7fd60c1f9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:37.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd60b7fe640 1 --2- 172.21.15.55:0/2084710236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd60c0cdde0 0x7fd60c1f9080 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fd60000c430 tx=0x7fd60000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd608ff9640 1 -- 172.21.15.55:0/2084710236 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6000074e0 con 0x7fd60c0cdde0 2023-08-25T04:19:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd608ff9640 1 -- 172.21.15.55:0/2084710236 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd600007660 con 0x7fd60c0cdde0 2023-08-25T04:19:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd61292c640 1 -- 172.21.15.55:0/2084710236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60c0cad40 con 0x7fd60c0cdde0 2023-08-25T04:19:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd608ff9640 1 -- 172.21.15.55:0/2084710236 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd600004a30 con 0x7fd60c0cdde0 2023-08-25T04:19:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.033+0000 7fd61292c640 1 -- 172.21.15.55:0/2084710236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c0cbfc0 con 0x7fd60c0cdde0 2023-08-25T04:19:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.037+0000 7fd61292c640 1 -- 172.21.15.55:0/2084710236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60c1f76a0 con 0x7fd60c0cdde0 2023-08-25T04:19:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.037+0000 7fd608ff9640 1 -- 172.21.15.55:0/2084710236 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fd600004b90 con 0x7fd60c0cdde0 2023-08-25T04:19:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.037+0000 7fd608ff9640 1 --2- 172.21.15.55:0/2084710236 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd5f8065710 0x7fd5f8067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.037+0000 7fd608ff9640 1 -- 172.21.15.55:0/2084710236 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd6000828c0 con 0x7fd60c0cdde0 2023-08-25T04:19:37.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.037+0000 7fd60bfff640 1 --2- 172.21.15.55:0/2084710236 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd5f8065710 0x7fd5f8067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:37.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.037+0000 7fd60bfff640 1 --2- 172.21.15.55:0/2084710236 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd5f8065710 0x7fd5f8067bd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc007b10 tx=0x7fd5fc008040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:37.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.041+0000 7fd608ff9640 1 -- 172.21.15.55:0/2084710236 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd60c1f76a0 con 0x7fd60c0cdde0 2023-08-25T04:19:37.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.249+0000 7fd61292c640 1 -- 172.21.15.55:0/2084710236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd60c1f76a0 con 0x7fd60c0cdde0 2023-08-25T04:19:37.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.253+0000 7fd608ff9640 1 -- 172.21.15.55:0/2084710236 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd60c1f76a0 con 0x7fd60c0cdde0 2023-08-25T04:19:37.252 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:37.253 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T04:19:37.253 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-08-25T04:19:37.253 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.254 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-08-25T04:19:37.254 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkgFrTEBAAoan9rk8Q+qPyMjb2vGUHhA==", 2023-08-25T04:19:37.254 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.254 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:19:37.255 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:19:37.255 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:19:37.255 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:37.255 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.256 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:37.256 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.256 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-08-25T04:19:37.257 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk18hNHRAAzXuhzQEONXRzRXTeCH9fKQ==", 2023-08-25T04:19:37.257 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.257 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:19:37.257 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:19:37.258 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:19:37.258 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:37.258 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.259 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:37.259 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.259 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-08-25T04:19:37.259 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkLF9CGBAAqxgRU/02SsZfWuZPSYxuZA==", 2023-08-25T04:19:37.260 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.260 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:19:37.261 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:19:37.261 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:19:37.261 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:37.261 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.262 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:37.262 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.262 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-08-25T04:19:37.263 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hky6HiJBAAsrXlTDn2cxbk7PnqSgNNkA==", 2023-08-25T04:19:37.263 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.263 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:19:37.264 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:19:37.264 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:19:37.264 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:37.265 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.265 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:37.265 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.266 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-08-25T04:19:37.266 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC+J+hkY1tDFBAAVQY5Xl8On9pN3jLWwKWGTA==", 2023-08-25T04:19:37.266 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.267 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:19:37.267 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:19:37.267 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:37.267 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.268 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:37.268 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.268 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-08-25T04:19:37.269 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDBJ+hkpdBCHRAADyMAxTsnQfkD9G0p48H4zQ==", 2023-08-25T04:19:37.269 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.269 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:19:37.269 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:19:37.270 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:37.270 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.270 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:37.270 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.271 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-08-25T04:19:37.271 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDEJ+hkOR49KRAAudbqAxLItsoczide8ybzAg==", 2023-08-25T04:19:37.271 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.271 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:19:37.271 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:19:37.272 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:37.272 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.272 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:37.273 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.273 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-08-25T04:19:37.273 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDHJ+hkxun5MBAAAhGtJYVeL3ogL3TQV67diw==", 2023-08-25T04:19:37.273 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.274 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:19:37.274 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:19:37.274 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:37.275 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.276 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:37.276 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.276 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-08-25T04:19:37.276 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDMJ+hkuosTCRAAqCuwHFZFBVR/7nFtHHByNg==", 2023-08-25T04:19:37.276 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.277 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:19:37.277 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:19:37.277 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:37.277 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.277 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:37.277 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.278 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-08-25T04:19:37.278 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDPJ+hkJa+SDhAAllo6biVE99BZWvv5K/gXGw==", 2023-08-25T04:19:37.278 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.278 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:19:37.278 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:19:37.279 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:37.279 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.279 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:37.279 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.279 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-08-25T04:19:37.279 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDSJ+hkUPywFBAA4jua1Eu1nRl2L6hX/mycfw==", 2023-08-25T04:19:37.279 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.280 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:19:37.280 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:19:37.280 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:37.280 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.280 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:37.280 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.280 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-08-25T04:19:37.281 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDVJ+hkhyDMGxAAmcSWLzJqIE5w5H/E4wIurQ==", 2023-08-25T04:19:37.281 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.281 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:19:37.281 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:19:37.281 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:37.281 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.281 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:37.281 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.282 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-08-25T04:19:37.282 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g==", 2023-08-25T04:19:37.282 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.282 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:19:37.282 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-08-25T04:19:37.282 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-25T04:19:37.282 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.283 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:37.283 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.283 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-08-25T04:19:37.283 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk8KsDMxAAKyK4jMKflYNnJXYIbr2OBQ==", 2023-08-25T04:19:37.283 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.283 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:19:37.283 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:19:37.284 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:19:37.284 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:19:37.284 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.284 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:37.284 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.284 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-08-25T04:19:37.285 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjSA4LxAAxzbnHeV85qYZYhSqTOT2rw==", 2023-08-25T04:19:37.285 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.285 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:19:37.285 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:19:37.286 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:19:37.286 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:19:37.286 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.286 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:37.286 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.286 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-08-25T04:19:37.287 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkl9AoORAARYZcPObsM/HT/yrTmneZrw==", 2023-08-25T04:19:37.287 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.287 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:19:37.287 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:19:37.287 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:19:37.287 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:19:37.288 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.288 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:37.288 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.288 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-08-25T04:19:37.288 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC2J+hkgTdcLxAAqxSepXXhEultFAFYBBKSag==", 2023-08-25T04:19:37.288 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.288 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:19:37.288 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:19:37.289 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:19:37.289 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:37.289 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.289 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:37.289 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.289 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-08-25T04:19:37.289 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkYGUZDBAAiuDo9hqavWq7zQlGd6x4YQ==", 2023-08-25T04:19:37.289 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.290 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:19:37.290 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T04:19:37.290 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:37.290 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.290 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:37.290 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:37.291 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-08-25T04:19:37.291 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjr9KCBAApSqjtFhLnjHduMBu/eaaKw==", 2023-08-25T04:19:37.291 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:19:37.291 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:19:37.291 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T04:19:37.291 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:19:37.292 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.292 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:37.292 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-08-25T04:19:37.292 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T04:19:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.253+0000 7fd61292c640 1 -- 172.21.15.55:0/2084710236 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd5f8065710 msgr2=0x7fd5f8067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.253+0000 7fd61292c640 1 --2- 172.21.15.55:0/2084710236 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd5f8065710 0x7fd5f8067bd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc007b10 tx=0x7fd5fc008040 comp rx=0 tx=0).stop 2023-08-25T04:19:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.253+0000 7fd61292c640 1 -- 172.21.15.55:0/2084710236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd60c0cdde0 msgr2=0x7fd60c1f9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.253+0000 7fd61292c640 1 --2- 172.21.15.55:0/2084710236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd60c0cdde0 0x7fd60c1f9080 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fd60000c430 tx=0x7fd60000c8f0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.253+0000 7fd61292c640 1 -- 172.21.15.55:0/2084710236 shutdown_connections 2023-08-25T04:19:37.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.253+0000 7fd61292c640 1 --2- 172.21.15.55:0/2084710236 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd5f8065710 0x7fd5f8067bd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.253+0000 7fd61292c640 1 --2- 172.21.15.55:0/2084710236 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd60c0d0da0 0x7fd60c1f9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.253+0000 7fd61292c640 1 --2- 172.21.15.55:0/2084710236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd60c0cdde0 0x7fd60c1f9080 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.253+0000 7fd61292c640 1 --2- 172.21.15.55:0/2084710236 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd60c0b3e50 0x7fd60c0cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.253+0000 7fd61292c640 1 -- 172.21.15.55:0/2084710236 >> 172.21.15.55:0/2084710236 conn(0x7fd60c09bae0 msgr2=0x7fd60c15c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:37.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.253+0000 7fd61292c640 1 -- 172.21.15.55:0/2084710236 shutdown_connections 2023-08-25T04:19:37.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.253+0000 7fd61292c640 1 -- 172.21.15.55:0/2084710236 wait complete. 2023-08-25T04:19:37.297 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:19:37.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.445+0000 7f758df1e640 1 Processor -- start 2023-08-25T04:19:37.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.445+0000 7f758df1e640 1 -- start start 2023-08-25T04:19:37.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.445+0000 7f758df1e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75880cfa70 0x7f7588160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:37.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.445+0000 7f758df1e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f758806eaf0 con 0x7f758806b2b0 2023-08-25T04:19:37.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.445+0000 7f758df1e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f758806e530 con 0x7f758815c9c0 2023-08-25T04:19:37.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.445+0000 7f758df1e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f758806e810 con 0x7f75880cfa70 2023-08-25T04:19:37.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.445+0000 7f7586ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75880cfa70 0x7f7588160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:37.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.445+0000 7f7587fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f758806b2b0 0x7f758806b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56192/0 (socket says 172.21.15.55:56192) 2023-08-25T04:19:37.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.445+0000 7f7587fff640 1 -- 172.21.15.55:0/1155589680 learned_addr learned my addr 172.21.15.55:0/1155589680 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:37.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.445+0000 7f7586ffd640 1 -- 172.21.15.55:0/1155589680 >> v1:172.21.15.110:6789/0 conn(0x7f758815c9c0 legacy=0x7f7588160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.445+0000 7f7586ffd640 1 -- 172.21.15.55:0/1155589680 >> v1:172.21.15.55:6789/0 conn(0x7f758806b2b0 legacy=0x7f758806b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.445+0000 7f7586ffd640 1 -- 172.21.15.55:0/1155589680 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758806aab0 con 0x7f75880cfa70 2023-08-25T04:19:37.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.445+0000 7f75867fc640 1 -- 172.21.15.55:0/1155589680 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478962430 0 0) 0x7f758806eaf0 con 0x7f758806b2b0 2023-08-25T04:19:37.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.449+0000 7f7586ffd640 1 --2- 172.21.15.55:0/1155589680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75880cfa70 0x7f7588160c20 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f757c0097c0 tx=0x7f757c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9dc07f9f1b946b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:37.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.449+0000 7f75867fc640 1 -- 172.21.15.55:0/1155589680 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c0ab610 con 0x7f75880cfa70 2023-08-25T04:19:37.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.449+0000 7f75867fc640 1 -- 172.21.15.55:0/1155589680 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c0ab770 con 0x7f75880cfa70 2023-08-25T04:19:37.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.449+0000 7f75867fc640 1 -- 172.21.15.55:0/1155589680 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c0abb00 con 0x7f75880cfa70 2023-08-25T04:19:37.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.449+0000 7f758df1e640 1 -- 172.21.15.55:0/1155589680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75880cfa70 msgr2=0x7f7588160c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.449+0000 7f758df1e640 1 --2- 172.21.15.55:0/1155589680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75880cfa70 0x7f7588160c20 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f757c0097c0 tx=0x7f757c01c450 comp rx=0 tx=0).stop 2023-08-25T04:19:37.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.449+0000 7f758df1e640 1 -- 172.21.15.55:0/1155589680 shutdown_connections 2023-08-25T04:19:37.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.449+0000 7f758df1e640 1 --2- 172.21.15.55:0/1155589680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75880cfa70 0x7f7588160c20 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.449+0000 7f758df1e640 1 -- 172.21.15.55:0/1155589680 >> 172.21.15.55:0/1155589680 conn(0x7f75880d05a0 msgr2=0x7f75880d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:37.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.449+0000 7f758df1e640 1 -- 172.21.15.55:0/1155589680 shutdown_connections 2023-08-25T04:19:37.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.449+0000 7f758df1e640 1 -- 172.21.15.55:0/1155589680 wait complete. 2023-08-25T04:19:37.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f758df1e640 1 Processor -- start 2023-08-25T04:19:37.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f758df1e640 1 -- start start 2023-08-25T04:19:37.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f758df1e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f758806b2b0 0x7f75881596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:37.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f758df1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75880cfa70 0x7f7588152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:37.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f758df1e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f758815c9c0 0x7f75881470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:37.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f758df1e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7588152990 con 0x7f75880cfa70 2023-08-25T04:19:37.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f758df1e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7588147600 con 0x7f758806b2b0 2023-08-25T04:19:37.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f758df1e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758815a920 con 0x7f758815c9c0 2023-08-25T04:19:37.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f7586ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75880cfa70 0x7f7588152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:37.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f7586ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75880cfa70 0x7f7588152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42068/0 (socket says 172.21.15.55:42068) 2023-08-25T04:19:37.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f7586ffd640 1 -- 172.21.15.55:0/1430743793 learned_addr learned my addr 172.21.15.55:0/1430743793 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:37.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f75877fe640 1 --2- 172.21.15.55:0/1430743793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f758806b2b0 0x7f75881596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:37.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f7587fff640 1 --2- 172.21.15.55:0/1430743793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f758815c9c0 0x7f75881470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:37.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f7586ffd640 1 -- 172.21.15.55:0/1430743793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f758815c9c0 msgr2=0x7f75881470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f7586ffd640 1 --2- 172.21.15.55:0/1430743793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f758815c9c0 0x7f75881470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f7586ffd640 1 -- 172.21.15.55:0/1430743793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f758806b2b0 msgr2=0x7f75881596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f7586ffd640 1 --2- 172.21.15.55:0/1430743793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f758806b2b0 0x7f75881596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f7586ffd640 1 -- 172.21.15.55:0/1430743793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c009420 con 0x7f75880cfa70 2023-08-25T04:19:37.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f7586ffd640 1 --2- 172.21.15.55:0/1430743793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75880cfa70 0x7f7588152450 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f757c0ad040 tx=0x7f757c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:37.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f756ffff640 1 -- 172.21.15.55:0/1430743793 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c0b5810 con 0x7f75880cfa70 2023-08-25T04:19:37.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f756ffff640 1 -- 172.21.15.55:0/1430743793 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c0b59b0 con 0x7f75880cfa70 2023-08-25T04:19:37.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f758df1e640 1 -- 172.21.15.55:0/1430743793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75881536b0 con 0x7f75880cfa70 2023-08-25T04:19:37.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f756ffff640 1 -- 172.21.15.55:0/1430743793 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c0b5d60 con 0x7f75880cfa70 2023-08-25T04:19:37.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.453+0000 7f758df1e640 1 -- 172.21.15.55:0/1430743793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7588159ff0 con 0x7f75880cfa70 2023-08-25T04:19:37.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.457+0000 7f758df1e640 1 -- 172.21.15.55:0/1430743793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75880b64f0 con 0x7f75880cfa70 2023-08-25T04:19:37.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.457+0000 7f756ffff640 1 -- 172.21.15.55:0/1430743793 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f757c0c83f0 con 0x7f75880cfa70 2023-08-25T04:19:37.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.457+0000 7f756ffff640 1 --2- 172.21.15.55:0/1430743793 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7574065710 0x7f7574067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:37.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.457+0000 7f756ffff640 1 -- 172.21.15.55:0/1430743793 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f757c11d8a0 con 0x7f75880cfa70 2023-08-25T04:19:37.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.457+0000 7f75877fe640 1 --2- 172.21.15.55:0/1430743793 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7574065710 0x7f7574067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:37.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.457+0000 7f75877fe640 1 --2- 172.21.15.55:0/1430743793 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7574065710 0x7f7574067bd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7578000fc0 tx=0x7f7578009040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:37.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.461+0000 7f756ffff640 1 -- 172.21.15.55:0/1430743793 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f757c0eb560 con 0x7f75880cfa70 2023-08-25T04:19:37.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.625+0000 7f758df1e640 1 -- 172.21.15.55:0/1430743793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f758804dbe0 con 0x7f75880cfa70 2023-08-25T04:19:37.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.625+0000 7f756ffff640 1 -- 172.21.15.55:0/1430743793 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+14653 (secure 0 0 0) 0x7f757c0eeb80 con 0x7f75880cfa70 2023-08-25T04:19:37.625 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:37.625 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":102,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:19:36.862471+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:19:37.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.625+0000 7f758df1e640 1 -- 172.21.15.55:0/1430743793 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7574065710 msgr2=0x7f7574067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.625+0000 7f758df1e640 1 --2- 172.21.15.55:0/1430743793 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7574065710 0x7f7574067bd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7578000fc0 tx=0x7f7578009040 comp rx=0 tx=0).stop 2023-08-25T04:19:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.625+0000 7f758df1e640 1 -- 172.21.15.55:0/1430743793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75880cfa70 msgr2=0x7f7588152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.625+0000 7f758df1e640 1 --2- 172.21.15.55:0/1430743793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75880cfa70 0x7f7588152450 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f757c0ad040 tx=0x7f757c01ac90 comp rx=0 tx=0).stop 2023-08-25T04:19:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.629+0000 7f758df1e640 1 -- 172.21.15.55:0/1430743793 shutdown_connections 2023-08-25T04:19:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.629+0000 7f758df1e640 1 --2- 172.21.15.55:0/1430743793 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7574065710 0x7f7574067bd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.629+0000 7f758df1e640 1 --2- 172.21.15.55:0/1430743793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f758815c9c0 0x7f75881470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.629+0000 7f758df1e640 1 --2- 172.21.15.55:0/1430743793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75880cfa70 0x7f7588152450 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.629+0000 7f758df1e640 1 --2- 172.21.15.55:0/1430743793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f758806b2b0 0x7f75881596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.629+0000 7f758df1e640 1 -- 172.21.15.55:0/1430743793 >> 172.21.15.55:0/1430743793 conn(0x7f75880d05a0 msgr2=0x7f758815ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:37.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.629+0000 7f758df1e640 1 -- 172.21.15.55:0/1430743793 shutdown_connections 2023-08-25T04:19:37.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.629+0000 7f758df1e640 1 -- 172.21.15.55:0/1430743793 wait complete. 2023-08-25T04:19:37.647 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:19:37.648 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:19:37.729 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:37.728+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:37.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.797+0000 7f9776056640 1 Processor -- start 2023-08-25T04:19:37.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.797+0000 7f9776056640 1 -- start start 2023-08-25T04:19:37.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.797+0000 7f9776056640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f97700ad6b0 0x7f97700b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:37.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.797+0000 7f9776056640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f977006d0d0 0x7f97700cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:37.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.797+0000 7f9776056640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97700cdf20 con 0x7f97700cb710 2023-08-25T04:19:37.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.797+0000 7f9776056640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977009bc40 con 0x7f977006d0d0 2023-08-25T04:19:37.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.797+0000 7f9776056640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977009bf20 con 0x7f97700ad6b0 2023-08-25T04:19:37.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.797+0000 7f976ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f977006d0d0 0x7f97700cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:37.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.797+0000 7f976effd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f97700cb710 0x7f977006c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56198/0 (socket says 172.21.15.55:56198) 2023-08-25T04:19:37.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.797+0000 7f976effd640 1 -- 172.21.15.55:0/3490845829 learned_addr learned my addr 172.21.15.55:0/3490845829 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:37.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.797+0000 7f976f7fe640 1 --2- 172.21.15.55:0/3490845829 >> v2:172.21.15.110:3300/0 conn(0x7f97700ad6b0 0x7f97700b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:37.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.797+0000 7f976ffff640 1 -- 172.21.15.55:0/3490845829 >> v2:172.21.15.110:3300/0 conn(0x7f97700ad6b0 msgr2=0x7f97700b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:37.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.797+0000 7f976ffff640 1 --2- 172.21.15.55:0/3490845829 >> v2:172.21.15.110:3300/0 conn(0x7f97700ad6b0 0x7f97700b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.797+0000 7f976ffff640 1 -- 172.21.15.55:0/3490845829 >> v1:172.21.15.55:6789/0 conn(0x7f97700cb710 legacy=0x7f977006c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.797+0000 7f976ffff640 1 -- 172.21.15.55:0/3490845829 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977006c1c0 con 0x7f977006d0d0 2023-08-25T04:19:37.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.801+0000 7f976ffff640 1 --2- 172.21.15.55:0/3490845829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977006d0d0 0x7f97700cd1b0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f977006d720 tx=0x7f976801da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b55c243e934aa00 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:37.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.801+0000 7f976e7fc640 1 -- 172.21.15.55:0/3490845829 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97680a6990 con 0x7f977006d0d0 2023-08-25T04:19:37.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.801+0000 7f976e7fc640 1 -- 172.21.15.55:0/3490845829 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97680a6af0 con 0x7f977006d0d0 2023-08-25T04:19:37.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.801+0000 7f976e7fc640 1 -- 172.21.15.55:0/3490845829 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97680a6e80 con 0x7f977006d0d0 2023-08-25T04:19:37.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.801+0000 7f9776056640 1 -- 172.21.15.55:0/3490845829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977006d0d0 msgr2=0x7f97700cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.801+0000 7f9776056640 1 --2- 172.21.15.55:0/3490845829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977006d0d0 0x7f97700cd1b0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f977006d720 tx=0x7f976801da20 comp rx=0 tx=0).stop 2023-08-25T04:19:37.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.801+0000 7f9776056640 1 -- 172.21.15.55:0/3490845829 shutdown_connections 2023-08-25T04:19:37.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.801+0000 7f9776056640 1 --2- 172.21.15.55:0/3490845829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977006d0d0 0x7f97700cd1b0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.801+0000 7f9776056640 1 --2- 172.21.15.55:0/3490845829 >> v2:172.21.15.110:3300/0 conn(0x7f97700ad6b0 0x7f97700b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.801+0000 7f9776056640 1 -- 172.21.15.55:0/3490845829 >> 172.21.15.55:0/3490845829 conn(0x7f9770069900 msgr2=0x7f9770069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:37.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.801+0000 7f9776056640 1 -- 172.21.15.55:0/3490845829 shutdown_connections 2023-08-25T04:19:37.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.801+0000 7f9776056640 1 -- 172.21.15.55:0/3490845829 wait complete. 2023-08-25T04:19:37.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f9776056640 1 Processor -- start 2023-08-25T04:19:37.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f9776056640 1 -- start start 2023-08-25T04:19:37.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f9776056640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97700ad6b0 0x7f97701539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:37.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f9776056640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97700cb710 0x7f97701428e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:37.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f9776056640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977015bf30 0x7f977013fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:37.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f9776056640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9770159ab0 con 0x7f977015bf30 2023-08-25T04:19:37.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f9776056640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97700c6df0 con 0x7f97700cb710 2023-08-25T04:19:37.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f9776056640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9770142e20 con 0x7f97700ad6b0 2023-08-25T04:19:37.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f976ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977015bf30 0x7f977013fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:37.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f976ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977015bf30 0x7f977013fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42092/0 (socket says 172.21.15.55:42092) 2023-08-25T04:19:37.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f976ffff640 1 -- 172.21.15.55:0/2239985051 learned_addr learned my addr 172.21.15.55:0/2239985051 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:37.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f976effd640 1 --2- 172.21.15.55:0/2239985051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97700cb710 0x7f97701428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:37.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f976f7fe640 1 --2- 172.21.15.55:0/2239985051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97700ad6b0 0x7f97701539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:37.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f976ffff640 1 -- 172.21.15.55:0/2239985051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97700ad6b0 msgr2=0x7f97701539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f976ffff640 1 --2- 172.21.15.55:0/2239985051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97700ad6b0 0x7f97701539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f976ffff640 1 -- 172.21.15.55:0/2239985051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97700cb710 msgr2=0x7f97701428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f976ffff640 1 --2- 172.21.15.55:0/2239985051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97700cb710 0x7f97701428e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f976ffff640 1 -- 172.21.15.55:0/2239985051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9768009a70 con 0x7f977015bf30 2023-08-25T04:19:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f976ffff640 1 --2- 172.21.15.55:0/2239985051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977015bf30 0x7f977013fe80 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f976801a630 tx=0x7f976801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f9757fff640 1 -- 172.21.15.55:0/2239985051 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97680aee20 con 0x7f977015bf30 2023-08-25T04:19:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f9757fff640 1 -- 172.21.15.55:0/2239985051 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9768009450 con 0x7f977015bf30 2023-08-25T04:19:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f9757fff640 1 -- 172.21.15.55:0/2239985051 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97680b96b0 con 0x7f977015bf30 2023-08-25T04:19:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.805+0000 7f9776056640 1 -- 172.21.15.55:0/2239985051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97701594f0 con 0x7f977015bf30 2023-08-25T04:19:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.809+0000 7f9776056640 1 -- 172.21.15.55:0/2239985051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97700c7090 con 0x7f977015bf30 2023-08-25T04:19:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.809+0000 7f9776056640 1 -- 172.21.15.55:0/2239985051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9770073ec0 con 0x7f977015bf30 2023-08-25T04:19:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.809+0000 7f9757fff640 1 -- 172.21.15.55:0/2239985051 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f97680b5070 con 0x7f977015bf30 2023-08-25T04:19:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.809+0000 7f9757fff640 1 --2- 172.21.15.55:0/2239985051 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f975c065740 0x7f975c067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.809+0000 7f9757fff640 1 -- 172.21.15.55:0/2239985051 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f976811da10 con 0x7f977015bf30 2023-08-25T04:19:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.809+0000 7f976f7fe640 1 --2- 172.21.15.55:0/2239985051 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f975c065740 0x7f975c067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:37.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.809+0000 7f976f7fe640 1 --2- 172.21.15.55:0/2239985051 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f975c065740 0x7f975c067c00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9760006fd0 tx=0x7f9760008040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:37.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.813+0000 7f9757fff640 1 -- 172.21.15.55:0/2239985051 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f97680eb7e0 con 0x7f977015bf30 2023-08-25T04:19:37.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.981+0000 7f9776056640 1 -- 172.21.15.55:0/2239985051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97700ab430 con 0x7f977015bf30 2023-08-25T04:19:37.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.981+0000 7f9757fff640 1 -- 172.21.15.55:0/2239985051 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97680eee00 con 0x7f977015bf30 2023-08-25T04:19:37.982 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:19:37.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.981+0000 7f9776056640 1 -- 172.21.15.55:0/2239985051 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f975c065740 msgr2=0x7f975c067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.981+0000 7f9776056640 1 --2- 172.21.15.55:0/2239985051 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f975c065740 0x7f975c067c00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9760006fd0 tx=0x7f9760008040 comp rx=0 tx=0).stop 2023-08-25T04:19:37.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.981+0000 7f9776056640 1 -- 172.21.15.55:0/2239985051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977015bf30 msgr2=0x7f977013fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:37.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.981+0000 7f9776056640 1 --2- 172.21.15.55:0/2239985051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977015bf30 0x7f977013fe80 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f976801a630 tx=0x7f976801c260 comp rx=0 tx=0).stop 2023-08-25T04:19:37.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.981+0000 7f9776056640 1 -- 172.21.15.55:0/2239985051 shutdown_connections 2023-08-25T04:19:37.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.981+0000 7f9776056640 1 --2- 172.21.15.55:0/2239985051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f977015bf30 0x7f977013fe80 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.981+0000 7f9776056640 1 --2- 172.21.15.55:0/2239985051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97700cb710 0x7f97701428e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.981+0000 7f9776056640 1 --2- 172.21.15.55:0/2239985051 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f975c065740 0x7f975c067c00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.981+0000 7f9776056640 1 --2- 172.21.15.55:0/2239985051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97700ad6b0 0x7f97701539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:37.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.981+0000 7f9776056640 1 -- 172.21.15.55:0/2239985051 >> 172.21.15.55:0/2239985051 conn(0x7f9770069900 msgr2=0x7f97700b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:37.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.985+0000 7f9776056640 1 -- 172.21.15.55:0/2239985051 shutdown_connections 2023-08-25T04:19:37.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:37.985+0000 7f9776056640 1 -- 172.21.15.55:0/2239985051 wait complete. 2023-08-25T04:19:38.003 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:19:38.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.153+0000 7f12562bd640 1 Processor -- start 2023-08-25T04:19:38.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.153+0000 7f12562bd640 1 -- start start 2023-08-25T04:19:38.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.153+0000 7f12562bd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f125015e3c0 0x7f125015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:38.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.157+0000 7f12562bd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12500cd5a0 con 0x7f12501601f0 2023-08-25T04:19:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.157+0000 7f12562bd640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12500cd880 con 0x7f12500d1290 2023-08-25T04:19:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.157+0000 7f12562bd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12500cdb60 con 0x7f125015e3c0 2023-08-25T04:19:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.157+0000 7f124ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f12501601f0 0x7f12500d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56214/0 (socket says 172.21.15.55:56214) 2023-08-25T04:19:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.157+0000 7f124ffff640 1 -- 172.21.15.55:0/211304911 learned_addr learned my addr 172.21.15.55:0/211304911 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:38.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.157+0000 7f124f7fe640 1 --2- 172.21.15.55:0/211304911 >> v2:172.21.15.55:3300/0 conn(0x7f125015e3c0 0x7f125015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.157+0000 7f124f7fe640 1 -- 172.21.15.55:0/211304911 >> v1:172.21.15.110:6789/0 conn(0x7f12500d1290 legacy=0x7f125015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.157+0000 7f124f7fe640 1 -- 172.21.15.55:0/211304911 >> v1:172.21.15.55:6789/0 conn(0x7f12501601f0 legacy=0x7f12500d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.157+0000 7f124f7fe640 1 -- 172.21.15.55:0/211304911 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12500cde40 con 0x7f125015e3c0 2023-08-25T04:19:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.157+0000 7f124effd640 1 -- 172.21.15.55:0/211304911 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153055211 0 0) 0x7f12500cd5a0 con 0x7f12501601f0 2023-08-25T04:19:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.157+0000 7f124f7fe640 1 --2- 172.21.15.55:0/211304911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f125015e3c0 0x7f125015d430 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f12440097c0 tx=0x7f124401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f6f121e2c7d906 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:38.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.157+0000 7f124effd640 1 -- 172.21.15.55:0/211304911 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12440ab600 con 0x7f125015e3c0 2023-08-25T04:19:38.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f124effd640 1 -- 172.21.15.55:0/211304911 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12440a7050 con 0x7f125015e3c0 2023-08-25T04:19:38.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f124effd640 1 -- 172.21.15.55:0/211304911 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12440ab980 con 0x7f125015e3c0 2023-08-25T04:19:38.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f12562bd640 1 -- 172.21.15.55:0/211304911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f125015e3c0 msgr2=0x7f125015d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:38.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f12562bd640 1 --2- 172.21.15.55:0/211304911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f125015e3c0 0x7f125015d430 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f12440097c0 tx=0x7f124401c450 comp rx=0 tx=0).stop 2023-08-25T04:19:38.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f12562bd640 1 -- 172.21.15.55:0/211304911 shutdown_connections 2023-08-25T04:19:38.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f12562bd640 1 --2- 172.21.15.55:0/211304911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f125015e3c0 0x7f125015d430 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f12562bd640 1 -- 172.21.15.55:0/211304911 >> 172.21.15.55:0/211304911 conn(0x7f12500d27d0 msgr2=0x7f12500d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:38.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f12562bd640 1 -- 172.21.15.55:0/211304911 shutdown_connections 2023-08-25T04:19:38.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f12562bd640 1 -- 172.21.15.55:0/211304911 wait complete. 2023-08-25T04:19:38.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f12562bd640 1 Processor -- start 2023-08-25T04:19:38.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f12562bd640 1 -- start start 2023-08-25T04:19:38.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f12562bd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12500d1290 0x7f1250156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:38.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f12562bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f125015e3c0 0x7f1250151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:38.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f12562bd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12501601f0 0x7f12500c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:38.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f12562bd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1250156600 con 0x7f125015e3c0 2023-08-25T04:19:38.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f12562bd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1250158140 con 0x7f12501601f0 2023-08-25T04:19:38.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f12562bd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1250155fb0 con 0x7f12500d1290 2023-08-25T04:19:38.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f124f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f125015e3c0 0x7f1250151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:38.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f124f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f125015e3c0 0x7f1250151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42120/0 (socket says 172.21.15.55:42120) 2023-08-25T04:19:38.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.161+0000 7f124f7fe640 1 -- 172.21.15.55:0/1292661674 learned_addr learned my addr 172.21.15.55:0/1292661674 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:38.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.165+0000 7f125485a640 1 --2- 172.21.15.55:0/1292661674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12501601f0 0x7f12500c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:38.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.165+0000 7f124ffff640 1 --2- 172.21.15.55:0/1292661674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12500d1290 0x7f1250156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:38.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.165+0000 7f124f7fe640 1 -- 172.21.15.55:0/1292661674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12500d1290 msgr2=0x7f1250156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:38.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.165+0000 7f124f7fe640 1 --2- 172.21.15.55:0/1292661674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12500d1290 0x7f1250156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.165+0000 7f124f7fe640 1 -- 172.21.15.55:0/1292661674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12501601f0 msgr2=0x7f12500c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:38.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.165+0000 7f124f7fe640 1 --2- 172.21.15.55:0/1292661674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12501601f0 0x7f12500c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.165+0000 7f124f7fe640 1 -- 172.21.15.55:0/1292661674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1244009420 con 0x7f125015e3c0 2023-08-25T04:19:38.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.165+0000 7f125485a640 1 --2- 172.21.15.55:0/1292661674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12501601f0 0x7f12500c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:19:38.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.165+0000 7f124ffff640 1 --2- 172.21.15.55:0/1292661674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12500d1290 0x7f1250156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:19:38.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.165+0000 7f124f7fe640 1 --2- 172.21.15.55:0/1292661674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f125015e3c0 0x7f1250151de0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f12440ae040 tx=0x7f124401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:38.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.165+0000 7f124cff9640 1 -- 172.21.15.55:0/1292661674 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12440b7650 con 0x7f125015e3c0 2023-08-25T04:19:38.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.165+0000 7f124cff9640 1 -- 172.21.15.55:0/1292661674 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12440b77b0 con 0x7f125015e3c0 2023-08-25T04:19:38.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.165+0000 7f124cff9640 1 -- 172.21.15.55:0/1292661674 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12440b7b60 con 0x7f125015e3c0 2023-08-25T04:19:38.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.165+0000 7f12562bd640 1 -- 172.21.15.55:0/1292661674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1250156290 con 0x7f125015e3c0 2023-08-25T04:19:38.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.165+0000 7f12562bd640 1 -- 172.21.15.55:0/1292661674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1250154cf0 con 0x7f125015e3c0 2023-08-25T04:19:38.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.165+0000 7f12562bd640 1 -- 172.21.15.55:0/1292661674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12500b5260 con 0x7f125015e3c0 2023-08-25T04:19:38.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.165+0000 7f124cff9640 1 -- 172.21.15.55:0/1292661674 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f12440b7cc0 con 0x7f125015e3c0 2023-08-25T04:19:38.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.169+0000 7f124cff9640 1 --2- 172.21.15.55:0/1292661674 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f123c065710 0x7f123c067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:38.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.169+0000 7f124cff9640 1 -- 172.21.15.55:0/1292661674 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f124411d5f0 con 0x7f125015e3c0 2023-08-25T04:19:38.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.169+0000 7f124ffff640 1 --2- 172.21.15.55:0/1292661674 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f123c065710 0x7f123c067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:38.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.169+0000 7f124ffff640 1 --2- 172.21.15.55:0/1292661674 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f123c065710 0x7f123c067bd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1240000c10 tx=0x7f1240009040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:38.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.173+0000 7f124cff9640 1 -- 172.21.15.55:0/1292661674 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f12440eb430 con 0x7f125015e3c0 2023-08-25T04:19:38.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.333+0000 7f12562bd640 1 -- 172.21.15.55:0/1292661674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1250156420 con 0x7f125015e3c0 2023-08-25T04:19:38.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.333+0000 7f124cff9640 1 -- 172.21.15.55:0/1292661674 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v102) v1 ==== 92+0+10 (secure 0 0 0) 0x7f12440eea50 con 0x7f125015e3c0 2023-08-25T04:19:38.334 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:19:38.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.337+0000 7f12562bd640 1 -- 172.21.15.55:0/1292661674 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f123c065710 msgr2=0x7f123c067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:38.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.337+0000 7f12562bd640 1 --2- 172.21.15.55:0/1292661674 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f123c065710 0x7f123c067bd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1240000c10 tx=0x7f1240009040 comp rx=0 tx=0).stop 2023-08-25T04:19:38.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.337+0000 7f12562bd640 1 -- 172.21.15.55:0/1292661674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f125015e3c0 msgr2=0x7f1250151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:38.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.337+0000 7f12562bd640 1 --2- 172.21.15.55:0/1292661674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f125015e3c0 0x7f1250151de0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f12440ae040 tx=0x7f124401ac90 comp rx=0 tx=0).stop 2023-08-25T04:19:38.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.337+0000 7f12562bd640 1 -- 172.21.15.55:0/1292661674 shutdown_connections 2023-08-25T04:19:38.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.337+0000 7f12562bd640 1 --2- 172.21.15.55:0/1292661674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12501601f0 0x7f12500c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.337+0000 7f12562bd640 1 --2- 172.21.15.55:0/1292661674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f125015e3c0 0x7f1250151de0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.337+0000 7f12562bd640 1 --2- 172.21.15.55:0/1292661674 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f123c065710 0x7f123c067bd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.337+0000 7f12562bd640 1 --2- 172.21.15.55:0/1292661674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12500d1290 0x7f1250156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.337+0000 7f12562bd640 1 -- 172.21.15.55:0/1292661674 >> 172.21.15.55:0/1292661674 conn(0x7f12500d27d0 msgr2=0x7f125006bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:38.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.337+0000 7f12562bd640 1 -- 172.21.15.55:0/1292661674 shutdown_connections 2023-08-25T04:19:38.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.337+0000 7f12562bd640 1 -- 172.21.15.55:0/1292661674 wait complete. 2023-08-25T04:19:38.357 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-25T04:19:38.465 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:38.460+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:38.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.505+0000 7f8fc5634640 1 Processor -- start 2023-08-25T04:19:38.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.505+0000 7f8fc5634640 1 -- start start 2023-08-25T04:19:38.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.505+0000 7f8fc5634640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8fc00d0da0 0x7f8fc00d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:38.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.505+0000 7f8fc5634640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8fc00cdde0 0x7f8fc00ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:38.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.505+0000 7f8fc5634640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fc00cee60 0x7f8fc00cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:38.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.505+0000 7f8fc5634640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc00ce760 con 0x7f8fc00cdde0 2023-08-25T04:19:38.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.505+0000 7f8fc5634640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc00b29b0 con 0x7f8fc00d0da0 2023-08-25T04:19:38.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.505+0000 7f8fc5634640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00d16c0 con 0x7f8fc00cee60 2023-08-25T04:19:38.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.505+0000 7f8fbeffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8fc00d0da0 0x7f8fc00d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:38.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.505+0000 7f8fb67fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8fc00cdde0 0x7f8fc00ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:38.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.505+0000 7f8fbf7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fc00cee60 0x7f8fc00cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:38.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.505+0000 7f8fbeffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8fc00d0da0 0x7f8fc00d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:56392/0 (socket says 172.21.15.55:56392) 2023-08-25T04:19:38.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.505+0000 7f8fbeffd640 1 -- 172.21.15.55:0/1437738921 learned_addr learned my addr 172.21.15.55:0/1437738921 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:38.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.505+0000 7f8fbeffd640 1 -- 172.21.15.55:0/1437738921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fc00cee60 msgr2=0x7f8fc00cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:38.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.505+0000 7f8fbeffd640 1 --2- 172.21.15.55:0/1437738921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fc00cee60 0x7f8fc00cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.505+0000 7f8fbeffd640 1 -- 172.21.15.55:0/1437738921 >> v2:172.21.15.55:3300/0 conn(0x7f8fc00cdde0 msgr2=0x7f8fc00ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:38.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.505+0000 7f8fbeffd640 1 --2- 172.21.15.55:0/1437738921 >> v2:172.21.15.55:3300/0 conn(0x7f8fc00cdde0 0x7f8fc00ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.505+0000 7f8fbeffd640 1 -- 172.21.15.55:0/1437738921 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc00b1dc0 con 0x7f8fc00d0da0 2023-08-25T04:19:38.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.509+0000 7f8fbeffd640 1 --2- 172.21.15.55:0/1437738921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fc00d0da0 0x7f8fc00d1180 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0073720 tx=0x7f8fb001ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99205197cd1d157 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:38.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.509+0000 7f8fbe7fc640 1 -- 172.21.15.55:0/1437738921 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb00a89b0 con 0x7f8fc00d0da0 2023-08-25T04:19:38.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.509+0000 7f8fbe7fc640 1 -- 172.21.15.55:0/1437738921 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb00a8b10 con 0x7f8fc00d0da0 2023-08-25T04:19:38.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.509+0000 7f8fbe7fc640 1 -- 172.21.15.55:0/1437738921 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb00a8ea0 con 0x7f8fc00d0da0 2023-08-25T04:19:38.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.509+0000 7f8fc5634640 1 -- 172.21.15.55:0/1437738921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fc00d0da0 msgr2=0x7f8fc00d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:38.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.509+0000 7f8fc5634640 1 --2- 172.21.15.55:0/1437738921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fc00d0da0 0x7f8fc00d1180 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0073720 tx=0x7f8fb001ecf0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.509+0000 7f8fc5634640 1 -- 172.21.15.55:0/1437738921 shutdown_connections 2023-08-25T04:19:38.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.509+0000 7f8fc5634640 1 --2- 172.21.15.55:0/1437738921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fc00cee60 0x7f8fc00cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.509+0000 7f8fc5634640 1 --2- 172.21.15.55:0/1437738921 >> v2:172.21.15.55:3300/0 conn(0x7f8fc00cdde0 0x7f8fc00ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.509+0000 7f8fc5634640 1 --2- 172.21.15.55:0/1437738921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fc00d0da0 0x7f8fc00d1180 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.509+0000 7f8fc5634640 1 -- 172.21.15.55:0/1437738921 >> 172.21.15.55:0/1437738921 conn(0x7f8fc009bae0 msgr2=0x7f8fc00d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:38.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.509+0000 7f8fc5634640 1 -- 172.21.15.55:0/1437738921 shutdown_connections 2023-08-25T04:19:38.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.509+0000 7f8fc5634640 1 -- 172.21.15.55:0/1437738921 wait complete. 2023-08-25T04:19:38.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fc5634640 1 Processor -- start 2023-08-25T04:19:38.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fc5634640 1 -- start start 2023-08-25T04:19:38.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fc5634640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fc00cdde0 0x7f8fc00cf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:38.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fc5634640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fc00cee60 0x7f8fc0151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:38.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fc5634640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fc00d0da0 0x7f8fc0152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:38.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fc5634640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00cbbf0 con 0x7f8fc00d0da0 2023-08-25T04:19:38.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fc5634640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00cbed0 con 0x7f8fc00cee60 2023-08-25T04:19:38.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fc5634640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00cc1b0 con 0x7f8fc00cdde0 2023-08-25T04:19:38.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fbf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fc00d0da0 0x7f8fc0152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:38.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fbeffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fc00cdde0 0x7f8fc00cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:38.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fbeffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fc00cdde0 0x7f8fc00cf550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:53090/0 (socket says 172.21.15.55:53090) 2023-08-25T04:19:38.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fbeffd640 1 -- 172.21.15.55:0/645242805 learned_addr learned my addr 172.21.15.55:0/645242805 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:38.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fb67fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fc00cee60 0x7f8fc0151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:38.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fbeffd640 1 -- 172.21.15.55:0/645242805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fc00cee60 msgr2=0x7f8fc0151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:38.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fbeffd640 1 --2- 172.21.15.55:0/645242805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fc00cee60 0x7f8fc0151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fbeffd640 1 -- 172.21.15.55:0/645242805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fc00d0da0 msgr2=0x7f8fc0152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:38.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fbeffd640 1 --2- 172.21.15.55:0/645242805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fc00d0da0 0x7f8fc0152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fbeffd640 1 -- 172.21.15.55:0/645242805 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb0009480 con 0x7f8fc00cdde0 2023-08-25T04:19:38.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fbeffd640 1 --2- 172.21.15.55:0/645242805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fc00cdde0 0x7f8fc00cf550 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8fb001f590 tx=0x7f8fb001ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:38.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fb7fff640 1 -- 172.21.15.55:0/645242805 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0003820 con 0x7f8fc00cdde0 2023-08-25T04:19:38.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fb7fff640 1 -- 172.21.15.55:0/645242805 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb0003980 con 0x7f8fc00cdde0 2023-08-25T04:19:38.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fc5634640 1 -- 172.21.15.55:0/645242805 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc00cc490 con 0x7f8fc00cdde0 2023-08-25T04:19:38.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fb7fff640 1 -- 172.21.15.55:0/645242805 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0003d10 con 0x7f8fc00cdde0 2023-08-25T04:19:38.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.513+0000 7f8fc5634640 1 -- 172.21.15.55:0/645242805 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc00cfc60 con 0x7f8fc00cdde0 2023-08-25T04:19:38.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.517+0000 7f8fc5634640 1 -- 172.21.15.55:0/645242805 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc004dbe0 con 0x7f8fc00cdde0 2023-08-25T04:19:38.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.517+0000 7f8fb7fff640 1 -- 172.21.15.55:0/645242805 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f8fb00b7070 con 0x7f8fc00cdde0 2023-08-25T04:19:38.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.517+0000 7f8fb7fff640 1 --2- 172.21.15.55:0/645242805 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f8fa0065710 0x7f8fa0067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:38.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.517+0000 7f8fb7fff640 1 -- 172.21.15.55:0/645242805 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8fb011fdd0 con 0x7f8fc00cdde0 2023-08-25T04:19:38.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.517+0000 7f8fb67fc640 1 --2- 172.21.15.55:0/645242805 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f8fa0065710 0x7f8fa0067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:38.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.517+0000 7f8fb67fc640 1 --2- 172.21.15.55:0/645242805 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f8fa0065710 0x7f8fa0067bd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0071000 tx=0x7f8fa8009190 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:38.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.521+0000 7f8fb7fff640 1 -- 172.21.15.55:0/645242805 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8fb00edc20 con 0x7f8fc00cdde0 2023-08-25T04:19:38.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.685+0000 7f8fc5634640 1 -- 172.21.15.55:0/645242805 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8fc00cc2f0 con 0x7f8fc00cdde0 2023-08-25T04:19:38.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.685+0000 7f8fb7fff640 1 -- 172.21.15.55:0/645242805 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v102) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8fc00cc2f0 con 0x7f8fc00cdde0 2023-08-25T04:19:38.687 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:38.687 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T04:19:38.687 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:38.687 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-08-25T04:19:38.687 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-08-25T04:19:38.687 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:19:38.687 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:38.688 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-08-25T04:19:38.688 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-08-25T04:19:38.688 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:38.688 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T04:19:38.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.689+0000 7f8fc5634640 1 -- 172.21.15.55:0/645242805 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f8fa0065710 msgr2=0x7f8fa0067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:38.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.689+0000 7f8fc5634640 1 --2- 172.21.15.55:0/645242805 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f8fa0065710 0x7f8fa0067bd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0071000 tx=0x7f8fa8009190 comp rx=0 tx=0).stop 2023-08-25T04:19:38.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.689+0000 7f8fc5634640 1 -- 172.21.15.55:0/645242805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fc00cdde0 msgr2=0x7f8fc00cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:38.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.689+0000 7f8fc5634640 1 --2- 172.21.15.55:0/645242805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fc00cdde0 0x7f8fc00cf550 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8fb001f590 tx=0x7f8fb001ba90 comp rx=0 tx=0).stop 2023-08-25T04:19:38.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.689+0000 7f8fc5634640 1 -- 172.21.15.55:0/645242805 shutdown_connections 2023-08-25T04:19:38.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.689+0000 7f8fc5634640 1 --2- 172.21.15.55:0/645242805 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fc00d0da0 0x7f8fc0152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.689+0000 7f8fc5634640 1 --2- 172.21.15.55:0/645242805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8fc00cee60 0x7f8fc0151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.689+0000 7f8fc5634640 1 --2- 172.21.15.55:0/645242805 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f8fa0065710 0x7f8fa0067bd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.689+0000 7f8fc5634640 1 --2- 172.21.15.55:0/645242805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8fc00cdde0 0x7f8fc00cf550 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.689+0000 7f8fc5634640 1 -- 172.21.15.55:0/645242805 >> 172.21.15.55:0/645242805 conn(0x7f8fc009bae0 msgr2=0x7f8fc006c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:38.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.689+0000 7f8fc5634640 1 -- 172.21.15.55:0/645242805 shutdown_connections 2023-08-25T04:19:38.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.689+0000 7f8fc5634640 1 -- 172.21.15.55:0/645242805 wait complete. 2023-08-25T04:19:38.707 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-25T04:19:38.710 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-25T04:19:38.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.865+0000 7fbf8bc88640 1 Processor -- start 2023-08-25T04:19:38.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.865+0000 7fbf8bc88640 1 -- start start 2023-08-25T04:19:38.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.865+0000 7fbf8bc88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf840cf340 0x7fbf840cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:38.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.865+0000 7fbf8bc88640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf840d1970 con 0x7fbf8415cb40 2023-08-25T04:19:38.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.865+0000 7fbf8bc88640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf840d2790 con 0x7fbf840b59f0 2023-08-25T04:19:38.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.865+0000 7fbf8bc88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf840cfcc0 con 0x7fbf840cf340 2023-08-25T04:19:38.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.865+0000 7fbf89a24640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbf8415cb40 0x7fbf840d2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56222/0 (socket says 172.21.15.55:56222) 2023-08-25T04:19:38.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.865+0000 7fbf89a24640 1 -- 172.21.15.55:0/925642564 learned_addr learned my addr 172.21.15.55:0/925642564 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:38.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.865+0000 7fbf89223640 1 --2- 172.21.15.55:0/925642564 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf840cf340 0x7fbf840cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:38.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.865+0000 7fbf88a22640 1 -- 172.21.15.55:0/925642564 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179679802 0 0) 0x7fbf840d2790 con 0x7fbf840b59f0 2023-08-25T04:19:38.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.865+0000 7fbf88a22640 1 -- 172.21.15.55:0/925642564 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf70003530 con 0x7fbf840b59f0 2023-08-25T04:19:38.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.865+0000 7fbf88a22640 1 -- 172.21.15.55:0/925642564 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023312174 0 0) 0x7fbf840d1970 con 0x7fbf8415cb40 2023-08-25T04:19:38.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.865+0000 7fbf88a22640 1 -- 172.21.15.55:0/925642564 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf840d2790 con 0x7fbf8415cb40 2023-08-25T04:19:38.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.865+0000 7fbf89223640 1 -- 172.21.15.55:0/925642564 >> v1:172.21.15.110:6789/0 conn(0x7fbf840b59f0 legacy=0x7fbf840b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:38.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.865+0000 7fbf89223640 1 -- 172.21.15.55:0/925642564 >> v1:172.21.15.55:6789/0 conn(0x7fbf8415cb40 legacy=0x7fbf840d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:38.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.865+0000 7fbf89223640 1 -- 172.21.15.55:0/925642564 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf840d0d80 con 0x7fbf840cf340 2023-08-25T04:19:38.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.869+0000 7fbf89223640 1 --2- 172.21.15.55:0/925642564 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf840cf340 0x7fbf840cf780 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbf740097f0 tx=0x7fbf7401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8117132a9f7c99be server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:38.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.869+0000 7fbf88a22640 1 -- 172.21.15.55:0/925642564 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf740a89b0 con 0x7fbf840cf340 2023-08-25T04:19:38.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.869+0000 7fbf88a22640 1 -- 172.21.15.55:0/925642564 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf740a8b10 con 0x7fbf840cf340 2023-08-25T04:19:38.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.869+0000 7fbf88a22640 1 -- 172.21.15.55:0/925642564 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf740a8ea0 con 0x7fbf840cf340 2023-08-25T04:19:38.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.869+0000 7fbf8bc88640 1 -- 172.21.15.55:0/925642564 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf840cf340 msgr2=0x7fbf840cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:38.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.869+0000 7fbf8bc88640 1 --2- 172.21.15.55:0/925642564 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf840cf340 0x7fbf840cf780 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbf740097f0 tx=0x7fbf7401ecb0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.869+0000 7fbf8bc88640 1 -- 172.21.15.55:0/925642564 shutdown_connections 2023-08-25T04:19:38.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.869+0000 7fbf8bc88640 1 --2- 172.21.15.55:0/925642564 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf840cf340 0x7fbf840cf780 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.869+0000 7fbf8bc88640 1 -- 172.21.15.55:0/925642564 >> 172.21.15.55:0/925642564 conn(0x7fbf8406aae0 msgr2=0x7fbf8406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:38.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.869+0000 7fbf8bc88640 1 -- 172.21.15.55:0/925642564 shutdown_connections 2023-08-25T04:19:38.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.869+0000 7fbf8bc88640 1 -- 172.21.15.55:0/925642564 wait complete. 2023-08-25T04:19:38.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf8bc88640 1 Processor -- start 2023-08-25T04:19:38.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf8bc88640 1 -- start start 2023-08-25T04:19:38.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf8bc88640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf840b59f0 0x7fbf84154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:38.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf8bc88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf840cf340 0x7fbf841f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:38.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf8bc88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf8415cb40 0x7fbf841f59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:38.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf8bc88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf84154d70 con 0x7fbf840cf340 2023-08-25T04:19:38.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf8bc88640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8415ee00 con 0x7fbf840b59f0 2023-08-25T04:19:38.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf8bc88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8415f920 con 0x7fbf8415cb40 2023-08-25T04:19:38.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf89223640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf840cf340 0x7fbf841f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:38.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf89223640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf840cf340 0x7fbf841f5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42132/0 (socket says 172.21.15.55:42132) 2023-08-25T04:19:38.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf89223640 1 -- 172.21.15.55:0/494312421 learned_addr learned my addr 172.21.15.55:0/494312421 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:38.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf89a24640 1 --2- 172.21.15.55:0/494312421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf840b59f0 0x7fbf84154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:38.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf8a225640 1 --2- 172.21.15.55:0/494312421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf8415cb40 0x7fbf841f59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:38.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf89223640 1 -- 172.21.15.55:0/494312421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf8415cb40 msgr2=0x7fbf841f59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:38.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf89223640 1 --2- 172.21.15.55:0/494312421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf8415cb40 0x7fbf841f59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf89223640 1 -- 172.21.15.55:0/494312421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf840b59f0 msgr2=0x7fbf84154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:38.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf89223640 1 --2- 172.21.15.55:0/494312421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf840b59f0 0x7fbf84154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:38.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf89223640 1 -- 172.21.15.55:0/494312421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf74009420 con 0x7fbf840cf340 2023-08-25T04:19:38.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf89223640 1 --2- 172.21.15.55:0/494312421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf840cf340 0x7fbf841f5460 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fbf7401b8c0 tx=0x7fbf7401ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:38.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf7a7fc640 1 -- 172.21.15.55:0/494312421 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf740b1cf0 con 0x7fbf840cf340 2023-08-25T04:19:38.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf7a7fc640 1 -- 172.21.15.55:0/494312421 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf740b1e70 con 0x7fbf840cf340 2023-08-25T04:19:38.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf7a7fc640 1 -- 172.21.15.55:0/494312421 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf740b9630 con 0x7fbf840cf340 2023-08-25T04:19:38.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf8bc88640 1 -- 172.21.15.55:0/494312421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8415f080 con 0x7fbf840cf340 2023-08-25T04:19:38.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.873+0000 7fbf8bc88640 1 -- 172.21.15.55:0/494312421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8415f640 con 0x7fbf840cf340 2023-08-25T04:19:38.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.877+0000 7fbf8bc88640 1 -- 172.21.15.55:0/494312421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf84071f80 con 0x7fbf840cf340 2023-08-25T04:19:38.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.877+0000 7fbf7a7fc640 1 -- 172.21.15.55:0/494312421 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fbf740b7040 con 0x7fbf840cf340 2023-08-25T04:19:38.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.877+0000 7fbf7a7fc640 1 --2- 172.21.15.55:0/494312421 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fbf68065710 0x7fbf68067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:38.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.877+0000 7fbf7a7fc640 1 -- 172.21.15.55:0/494312421 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbf74120230 con 0x7fbf840cf340 2023-08-25T04:19:38.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.877+0000 7fbf89a24640 1 --2- 172.21.15.55:0/494312421 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fbf68065710 0x7fbf68067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:38.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.877+0000 7fbf89a24640 1 --2- 172.21.15.55:0/494312421 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fbf68065710 0x7fbf68067bd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbf80007fd0 tx=0x7fbf80009040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:38.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:38.881+0000 7fbf7a7fc640 1 -- 172.21.15.55:0/494312421 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbf740ee000 con 0x7fbf840cf340 2023-08-25T04:19:39.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:39.037+0000 7fbf8bc88640 1 -- 172.21.15.55:0/494312421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbf840c7bc0 con 0x7fbf840cf340 2023-08-25T04:19:39.195 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:39.192+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:39.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:39.865+0000 7fbf7a7fc640 1 -- 172.21.15.55:0/494312421 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v103) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbf840c7bc0 con 0x7fbf840cf340 2023-08-25T04:19:39.865 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-08-25T04:19:39.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:39.869+0000 7fbf8bc88640 1 -- 172.21.15.55:0/494312421 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fbf68065710 msgr2=0x7fbf68067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:39.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:39.869+0000 7fbf8bc88640 1 --2- 172.21.15.55:0/494312421 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fbf68065710 0x7fbf68067bd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbf80007fd0 tx=0x7fbf80009040 comp rx=0 tx=0).stop 2023-08-25T04:19:39.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:39.869+0000 7fbf8bc88640 1 -- 172.21.15.55:0/494312421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf840cf340 msgr2=0x7fbf841f5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:39.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:39.869+0000 7fbf8bc88640 1 --2- 172.21.15.55:0/494312421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf840cf340 0x7fbf841f5460 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fbf7401b8c0 tx=0x7fbf7401ba50 comp rx=0 tx=0).stop 2023-08-25T04:19:39.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:39.869+0000 7fbf8bc88640 1 -- 172.21.15.55:0/494312421 shutdown_connections 2023-08-25T04:19:39.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:39.869+0000 7fbf8bc88640 1 --2- 172.21.15.55:0/494312421 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fbf68065710 0x7fbf68067bd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:39.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:39.869+0000 7fbf8bc88640 1 --2- 172.21.15.55:0/494312421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf8415cb40 0x7fbf841f59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:39.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:39.869+0000 7fbf8bc88640 1 --2- 172.21.15.55:0/494312421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf840cf340 0x7fbf841f5460 secure :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fbf7401b8c0 tx=0x7fbf7401ba50 comp rx=0 tx=0).stop 2023-08-25T04:19:39.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:39.869+0000 7fbf8bc88640 1 --2- 172.21.15.55:0/494312421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf840b59f0 0x7fbf84154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:39.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:39.869+0000 7fbf8bc88640 1 -- 172.21.15.55:0/494312421 >> 172.21.15.55:0/494312421 conn(0x7fbf8406aae0 msgr2=0x7fbf840ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:39.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:39.869+0000 7fbf8bc88640 1 -- 172.21.15.55:0/494312421 shutdown_connections 2023-08-25T04:19:39.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:39.869+0000 7fbf8bc88640 1 -- 172.21.15.55:0/494312421 wait complete. 2023-08-25T04:19:39.892 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-25T04:19:39.933 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:39.928+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.049+0000 7f7971937640 1 Processor -- start 2023-08-25T04:19:40.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.049+0000 7f7971937640 1 -- start start 2023-08-25T04:19:40.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.049+0000 7f7971937640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f796c15c950 0x7f796c0b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:40.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.049+0000 7f7971937640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f796c0b4be0 0x7f796c0b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:40.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.049+0000 7f7971937640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c0cd020 con 0x7f796c0b4040 2023-08-25T04:19:40.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.049+0000 7f7971937640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f796c0cd650 con 0x7f796c15c950 2023-08-25T04:19:40.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.049+0000 7f7971937640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f796c0cd8f0 con 0x7f796c0b4be0 2023-08-25T04:19:40.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.049+0000 7f796a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f796c15c950 0x7f796c0b7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:40.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.049+0000 7f796a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f796c15c950 0x7f796c0b7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42140/0 (socket says 172.21.15.55:42140) 2023-08-25T04:19:40.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.049+0000 7f796a7fc640 1 -- 172.21.15.55:0/1487031168 learned_addr learned my addr 172.21.15.55:0/1487031168 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:40.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.049+0000 7f796b7fe640 1 --2- 172.21.15.55:0/1487031168 >> v2:172.21.15.110:3300/0 conn(0x7f796c0b4be0 0x7f796c0b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:40.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.049+0000 7f796a7fc640 1 -- 172.21.15.55:0/1487031168 >> v2:172.21.15.110:3300/0 conn(0x7f796c0b4be0 msgr2=0x7f796c0b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:40.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.049+0000 7f796a7fc640 1 --2- 172.21.15.55:0/1487031168 >> v2:172.21.15.110:3300/0 conn(0x7f796c0b4be0 0x7f796c0b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:40.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.049+0000 7f796a7fc640 1 -- 172.21.15.55:0/1487031168 >> v1:172.21.15.110:6789/0 conn(0x7f796c0b4040 legacy=0x7f796c0b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.049+0000 7f796a7fc640 1 -- 172.21.15.55:0/1487031168 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0cccb0 con 0x7f796c15c950 2023-08-25T04:19:40.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.053+0000 7f796a7fc640 1 --2- 172.21.15.55:0/1487031168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f796c15c950 0x7f796c0b7ee0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f796c0cfed0 tx=0x7f796001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4fccac98d01ef1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.053+0000 7f7969ffb640 1 -- 172.21.15.55:0/1487031168 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79600ab600 con 0x7f796c15c950 2023-08-25T04:19:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.053+0000 7f7969ffb640 1 -- 172.21.15.55:0/1487031168 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79600ab760 con 0x7f796c15c950 2023-08-25T04:19:40.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.053+0000 7f7969ffb640 1 -- 172.21.15.55:0/1487031168 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79600abaf0 con 0x7f796c15c950 2023-08-25T04:19:40.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.053+0000 7f7971937640 1 -- 172.21.15.55:0/1487031168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f796c15c950 msgr2=0x7f796c0b7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:40.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.053+0000 7f7971937640 1 --2- 172.21.15.55:0/1487031168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f796c15c950 0x7f796c0b7ee0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f796c0cfed0 tx=0x7f796001c3e0 comp rx=0 tx=0).stop 2023-08-25T04:19:40.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.053+0000 7f7971937640 1 -- 172.21.15.55:0/1487031168 shutdown_connections 2023-08-25T04:19:40.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.053+0000 7f7971937640 1 --2- 172.21.15.55:0/1487031168 >> v2:172.21.15.110:3300/0 conn(0x7f796c0b4be0 0x7f796c0b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:40.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.053+0000 7f7971937640 1 --2- 172.21.15.55:0/1487031168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f796c15c950 0x7f796c0b7ee0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:40.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.053+0000 7f7971937640 1 -- 172.21.15.55:0/1487031168 >> 172.21.15.55:0/1487031168 conn(0x7f796c0658c0 msgr2=0x7f796c065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:40.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.053+0000 7f7971937640 1 -- 172.21.15.55:0/1487031168 shutdown_connections 2023-08-25T04:19:40.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.053+0000 7f7971937640 1 -- 172.21.15.55:0/1487031168 wait complete. 2023-08-25T04:19:40.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.053+0000 7f7971937640 1 Processor -- start 2023-08-25T04:19:40.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f7971937640 1 -- start start 2023-08-25T04:19:40.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f7971937640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f796c0b4040 0x7f796c15bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:40.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f7971937640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f796c0b4be0 0x7f796c157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:40.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f7971937640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f796c15c950 0x7f796c158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:40.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f7971937640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c15c200 con 0x7f796c0b4be0 2023-08-25T04:19:40.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f7971937640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0ca060 con 0x7f796c0b4040 2023-08-25T04:19:40.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f7971937640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0ca4f0 con 0x7f796c15c950 2023-08-25T04:19:40.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f796a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f796c0b4be0 0x7f796c157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:40.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f796a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f796c0b4be0 0x7f796c157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42150/0 (socket says 172.21.15.55:42150) 2023-08-25T04:19:40.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f796a7fc640 1 -- 172.21.15.55:0/4268826839 learned_addr learned my addr 172.21.15.55:0/4268826839 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:40.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f796b7fe640 1 --2- 172.21.15.55:0/4268826839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f796c15c950 0x7f796c158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:40.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f796affd640 1 --2- 172.21.15.55:0/4268826839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f796c0b4040 0x7f796c15bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:40.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f796a7fc640 1 -- 172.21.15.55:0/4268826839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f796c15c950 msgr2=0x7f796c158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:40.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f796a7fc640 1 --2- 172.21.15.55:0/4268826839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f796c15c950 0x7f796c158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:40.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f796a7fc640 1 -- 172.21.15.55:0/4268826839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f796c0b4040 msgr2=0x7f796c15bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:40.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f796a7fc640 1 --2- 172.21.15.55:0/4268826839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f796c0b4040 0x7f796c15bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:40.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f796a7fc640 1 -- 172.21.15.55:0/4268826839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79600094d0 con 0x7f796c0b4be0 2023-08-25T04:19:40.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f796a7fc640 1 --2- 172.21.15.55:0/4268826839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f796c0b4be0 0x7f796c157b00 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f7960018ff0 tx=0x7f796001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:40.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f7953fff640 1 -- 172.21.15.55:0/4268826839 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79600b4800 con 0x7f796c0b4be0 2023-08-25T04:19:40.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f7971937640 1 -- 172.21.15.55:0/4268826839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c159bd0 con 0x7f796c0b4be0 2023-08-25T04:19:40.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f7953fff640 1 -- 172.21.15.55:0/4268826839 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79600b4960 con 0x7f796c0b4be0 2023-08-25T04:19:40.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f7953fff640 1 -- 172.21.15.55:0/4268826839 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79600b4cd0 con 0x7f796c0b4be0 2023-08-25T04:19:40.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f7971937640 1 -- 172.21.15.55:0/4268826839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c0c9730 con 0x7f796c0b4be0 2023-08-25T04:19:40.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.057+0000 7f7971937640 1 -- 172.21.15.55:0/4268826839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796c0b4420 con 0x7f796c0b4be0 2023-08-25T04:19:40.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.061+0000 7f7953fff640 1 -- 172.21.15.55:0/4268826839 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f79600c7440 con 0x7f796c0b4be0 2023-08-25T04:19:40.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.061+0000 7f7953fff640 1 --2- 172.21.15.55:0/4268826839 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7958065710 0x7f7958067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:40.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.061+0000 7f7953fff640 1 -- 172.21.15.55:0/4268826839 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f796011da40 con 0x7f796c0b4be0 2023-08-25T04:19:40.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.061+0000 7f796affd640 1 --2- 172.21.15.55:0/4268826839 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7958065710 0x7f7958067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:40.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.061+0000 7f796affd640 1 --2- 172.21.15.55:0/4268826839 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7958065710 0x7f7958067bd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f795c007fd0 tx=0x7f795c009040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:40.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.065+0000 7f7953fff640 1 -- 172.21.15.55:0/4268826839 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f79600eb6b0 con 0x7f796c0b4be0 2023-08-25T04:19:40.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.221+0000 7f7971937640 1 -- 172.21.15.55:0/4268826839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f796c0668d0 con 0x7f796c0b4be0 2023-08-25T04:19:40.666 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:40.664+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:40.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.873+0000 7f7953fff640 1 -- 172.21.15.55:0/4268826839 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v104) v1 ==== 170+0+0 (secure 0 0 0) 0x7f79600eecd0 con 0x7f796c0b4be0 2023-08-25T04:19:40.874 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-08-25T04:19:40.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.885+0000 7f7971937640 1 -- 172.21.15.55:0/4268826839 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7958065710 msgr2=0x7f7958067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:40.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.885+0000 7f7971937640 1 --2- 172.21.15.55:0/4268826839 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7958065710 0x7f7958067bd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f795c007fd0 tx=0x7f795c009040 comp rx=0 tx=0).stop 2023-08-25T04:19:40.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.885+0000 7f7971937640 1 -- 172.21.15.55:0/4268826839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f796c0b4be0 msgr2=0x7f796c157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:40.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.885+0000 7f7971937640 1 --2- 172.21.15.55:0/4268826839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f796c0b4be0 0x7f796c157b00 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f7960018ff0 tx=0x7f796001ac20 comp rx=0 tx=0).stop 2023-08-25T04:19:40.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.885+0000 7f7971937640 1 -- 172.21.15.55:0/4268826839 shutdown_connections 2023-08-25T04:19:40.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.885+0000 7f7971937640 1 --2- 172.21.15.55:0/4268826839 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f7958065710 0x7f7958067bd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:40.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.885+0000 7f7971937640 1 --2- 172.21.15.55:0/4268826839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f796c15c950 0x7f796c158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:40.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.885+0000 7f7971937640 1 --2- 172.21.15.55:0/4268826839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f796c0b4be0 0x7f796c157b00 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:40.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.885+0000 7f7971937640 1 --2- 172.21.15.55:0/4268826839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f796c0b4040 0x7f796c15bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:40.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.885+0000 7f7971937640 1 -- 172.21.15.55:0/4268826839 >> 172.21.15.55:0/4268826839 conn(0x7f796c0658c0 msgr2=0x7f796c06b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:40.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.889+0000 7f7971937640 1 -- 172.21.15.55:0/4268826839 shutdown_connections 2023-08-25T04:19:40.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:40.889+0000 7f7971937640 1 -- 172.21.15.55:0/4268826839 wait complete. 2023-08-25T04:19:40.918 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-25T04:19:41.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.069+0000 7f5357bfa640 1 Processor -- start 2023-08-25T04:19:41.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.073+0000 7f5357bfa640 1 -- start start 2023-08-25T04:19:41.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.073+0000 7f5357bfa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53501601f0 0x7f535015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:41.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.073+0000 7f5357bfa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53500d1290 0x7f535015e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:41.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.073+0000 7f5357bfa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53500cd5a0 con 0x7f535015e3c0 2023-08-25T04:19:41.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.073+0000 7f5357bfa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53500cd880 con 0x7f53500d1290 2023-08-25T04:19:41.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.073+0000 7f5357bfa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53500cdb60 con 0x7f53501601f0 2023-08-25T04:19:41.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.073+0000 7f5356197640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53500d1290 0x7f535015e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:41.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.073+0000 7f5356197640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53500d1290 0x7f535015e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58504/0 (socket says 172.21.15.55:58504) 2023-08-25T04:19:41.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.073+0000 7f5356197640 1 -- 172.21.15.55:0/3901179615 learned_addr learned my addr 172.21.15.55:0/3901179615 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:41.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.073+0000 7f5355996640 1 --2- 172.21.15.55:0/3901179615 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53501601f0 0x7f535015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:41.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.073+0000 7f5356197640 1 -- 172.21.15.55:0/3901179615 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53501601f0 msgr2=0x7f535015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:41.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.073+0000 7f5356197640 1 --2- 172.21.15.55:0/3901179615 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53501601f0 0x7f535015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:41.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.073+0000 7f5356197640 1 -- 172.21.15.55:0/3901179615 >> v1:172.21.15.110:6789/0 conn(0x7f535015e3c0 legacy=0x7f53500d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:41.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.073+0000 7f5356197640 1 -- 172.21.15.55:0/3901179615 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53500cde40 con 0x7f53500d1290 2023-08-25T04:19:41.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.073+0000 7f5355996640 1 --2- 172.21.15.55:0/3901179615 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53501601f0 0x7f535015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:41.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.077+0000 7f5356197640 1 --2- 172.21.15.55:0/3901179615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53500d1290 0x7f535015e8a0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f5348009e50 tx=0x7f534801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f86b201aa07f393 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:41.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.077+0000 7f5354994640 1 -- 172.21.15.55:0/3901179615 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53480af400 con 0x7f53500d1290 2023-08-25T04:19:41.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.077+0000 7f5354994640 1 -- 172.21.15.55:0/3901179615 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53480ab050 con 0x7f53500d1290 2023-08-25T04:19:41.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.077+0000 7f5354994640 1 -- 172.21.15.55:0/3901179615 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53480af780 con 0x7f53500d1290 2023-08-25T04:19:41.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.077+0000 7f5357bfa640 1 -- 172.21.15.55:0/3901179615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53500d1290 msgr2=0x7f535015e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:41.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.077+0000 7f5357bfa640 1 --2- 172.21.15.55:0/3901179615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53500d1290 0x7f535015e8a0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f5348009e50 tx=0x7f534801f1f0 comp rx=0 tx=0).stop 2023-08-25T04:19:41.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.077+0000 7f5357bfa640 1 -- 172.21.15.55:0/3901179615 shutdown_connections 2023-08-25T04:19:41.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.077+0000 7f5357bfa640 1 --2- 172.21.15.55:0/3901179615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53500d1290 0x7f535015e8a0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:41.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.077+0000 7f5357bfa640 1 --2- 172.21.15.55:0/3901179615 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53501601f0 0x7f535015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:41.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.077+0000 7f5357bfa640 1 -- 172.21.15.55:0/3901179615 >> 172.21.15.55:0/3901179615 conn(0x7f53500d27d0 msgr2=0x7f53500d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:41.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.077+0000 7f5357bfa640 1 -- 172.21.15.55:0/3901179615 shutdown_connections 2023-08-25T04:19:41.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.077+0000 7f5357bfa640 1 -- 172.21.15.55:0/3901179615 wait complete. 2023-08-25T04:19:41.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.077+0000 7f5357bfa640 1 Processor -- start 2023-08-25T04:19:41.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5357bfa640 1 -- start start 2023-08-25T04:19:41.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5357bfa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53500d1290 0x7f53500c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:41.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5357bfa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f535015e3c0 0x7f53501f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:41.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5357bfa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53501601f0 0x7f53501f5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:41.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5357bfa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53501f6780 con 0x7f53501601f0 2023-08-25T04:19:41.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5357bfa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53500c7a40 con 0x7f535015e3c0 2023-08-25T04:19:41.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5357bfa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535009f220 con 0x7f53500d1290 2023-08-25T04:19:41.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5356197640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53501601f0 0x7f53501f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:41.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5355996640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53500d1290 0x7f53500c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:41.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5355996640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53500d1290 0x7f53500c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:52504/0 (socket says 172.21.15.55:52504) 2023-08-25T04:19:41.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5355996640 1 -- 172.21.15.55:0/1430126867 learned_addr learned my addr 172.21.15.55:0/1430126867 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:41.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5356197640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53501601f0 0x7f53501f5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58506/0 (socket says 172.21.15.55:58506) 2023-08-25T04:19:41.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5355195640 1 --2- 172.21.15.55:0/1430126867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f535015e3c0 0x7f53501f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:41.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5356197640 1 -- 172.21.15.55:0/1430126867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53500d1290 msgr2=0x7f53500c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:41.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5356197640 1 --2- 172.21.15.55:0/1430126867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53500d1290 0x7f53500c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:41.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5356197640 1 -- 172.21.15.55:0/1430126867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f535015e3c0 msgr2=0x7f53501f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:41.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5356197640 1 --2- 172.21.15.55:0/1430126867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f535015e3c0 0x7f53501f19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:41.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5356197640 1 -- 172.21.15.55:0/1430126867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5348009b30 con 0x7f53501601f0 2023-08-25T04:19:41.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5356197640 1 --2- 172.21.15.55:0/1430126867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53501601f0 0x7f53501f5790 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f53480ae000 tx=0x7f534801bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:41.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f53467fc640 1 -- 172.21.15.55:0/1430126867 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53480afda0 con 0x7f53501601f0 2023-08-25T04:19:41.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f53467fc640 1 -- 172.21.15.55:0/1430126867 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5348009510 con 0x7f53501601f0 2023-08-25T04:19:41.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f53467fc640 1 -- 172.21.15.55:0/1430126867 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53480ba660 con 0x7f53501601f0 2023-08-25T04:19:41.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5357bfa640 1 -- 172.21.15.55:0/1430126867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53500ce7c0 con 0x7f53501601f0 2023-08-25T04:19:41.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5357bfa640 1 -- 172.21.15.55:0/1430126867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53501f61c0 con 0x7f53501601f0 2023-08-25T04:19:41.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.081+0000 7f5357bfa640 1 -- 172.21.15.55:0/1430126867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535009f390 con 0x7f53501601f0 2023-08-25T04:19:41.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.085+0000 7f53467fc640 1 -- 172.21.15.55:0/1430126867 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f53480b6040 con 0x7f53501601f0 2023-08-25T04:19:41.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.085+0000 7f53467fc640 1 --2- 172.21.15.55:0/1430126867 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f5334065710 0x7f5334067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:41.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.085+0000 7f53467fc640 1 -- 172.21.15.55:0/1430126867 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f5348120ff0 con 0x7f53501601f0 2023-08-25T04:19:41.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.085+0000 7f5355996640 1 --2- 172.21.15.55:0/1430126867 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f5334065710 0x7f5334067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:41.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.085+0000 7f5355996640 1 --2- 172.21.15.55:0/1430126867 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f5334065710 0x7f5334067bd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f534c006cf0 tx=0x7f534c008040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:41.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.089+0000 7f53467fc640 1 -- 172.21.15.55:0/1430126867 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f53480ee9e0 con 0x7f53501601f0 2023-08-25T04:19:41.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.277+0000 7f5357bfa640 1 -- 172.21.15.55:0/1430126867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5350073ec0 con 0x7f53501601f0 2023-08-25T04:19:41.423 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:41.420+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:41.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.893+0000 7f53467fc640 1 -- 172.21.15.55:0/1430126867 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v45) v1 ==== 174+0+0 (secure 0 0 0) 0x7f53480f2000 con 0x7f53501601f0 2023-08-25T04:19:41.897 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 13 and data pool 14 2023-08-25T04:19:41.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.909+0000 7f5357bfa640 1 -- 172.21.15.55:0/1430126867 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f5334065710 msgr2=0x7f5334067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.909+0000 7f5357bfa640 1 --2- 172.21.15.55:0/1430126867 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f5334065710 0x7f5334067bd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f534c006cf0 tx=0x7f534c008040 comp rx=0 tx=0).stop 2023-08-25T04:19:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.909+0000 7f5357bfa640 1 -- 172.21.15.55:0/1430126867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53501601f0 msgr2=0x7f53501f5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.909+0000 7f5357bfa640 1 --2- 172.21.15.55:0/1430126867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53501601f0 0x7f53501f5790 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f53480ae000 tx=0x7f534801bf90 comp rx=0 tx=0).stop 2023-08-25T04:19:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.909+0000 7f5357bfa640 1 -- 172.21.15.55:0/1430126867 shutdown_connections 2023-08-25T04:19:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.909+0000 7f5357bfa640 1 --2- 172.21.15.55:0/1430126867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53501601f0 0x7f53501f5790 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.909+0000 7f5357bfa640 1 --2- 172.21.15.55:0/1430126867 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f535015e3c0 0x7f53501f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.909+0000 7f5357bfa640 1 --2- 172.21.15.55:0/1430126867 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f5334065710 0x7f5334067bd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.909+0000 7f5357bfa640 1 --2- 172.21.15.55:0/1430126867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53500d1290 0x7f53500c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.909+0000 7f5357bfa640 1 -- 172.21.15.55:0/1430126867 >> 172.21.15.55:0/1430126867 conn(0x7f53500d27d0 msgr2=0x7f53500b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.909+0000 7f5357bfa640 1 -- 172.21.15.55:0/1430126867 shutdown_connections 2023-08-25T04:19:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:41.909+0000 7f5357bfa640 1 -- 172.21.15.55:0/1430126867 wait complete. 2023-08-25T04:19:41.933 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:19:42.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.077+0000 7f0ff5019640 1 Processor -- start 2023-08-25T04:19:42.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.077+0000 7f0ff5019640 1 -- start start 2023-08-25T04:19:42.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.077+0000 7f0ff5019640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff00ad950 0x7f0ff00cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.077+0000 7f0ff5019640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0ff00c89f0 0x7f0ff00ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.077+0000 7f0ff5019640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff00b2650 con 0x7f0ff006c000 2023-08-25T04:19:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.077+0000 7f0ff5019640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff00b11f0 con 0x7f0ff00c89f0 2023-08-25T04:19:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.077+0000 7f0ff5019640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff0159d50 con 0x7f0ff00ad950 2023-08-25T04:19:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.077+0000 7f0fef59e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0ff006c000 0x7f0ff015d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43866/0 (socket says 172.21.15.55:43866) 2023-08-25T04:19:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.077+0000 7f0fef59e640 1 -- 172.21.15.55:0/4212087087 learned_addr learned my addr 172.21.15.55:0/4212087087 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.077+0000 7f0feed9d640 1 --2- 172.21.15.55:0/4212087087 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff00ad950 0x7f0ff00cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.077+0000 7f0fee59c640 1 --2- 172.21.15.55:0/4212087087 >> v2:172.21.15.110:3300/0 conn(0x7f0ff00c89f0 0x7f0ff00ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.077+0000 7f0fedd9b640 1 -- 172.21.15.55:0/4212087087 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865457006 0 0) 0x7f0ff00b2650 con 0x7f0ff006c000 2023-08-25T04:19:42.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.077+0000 7f0fee59c640 1 -- 172.21.15.55:0/4212087087 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff00ad950 msgr2=0x7f0ff00cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:42.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.077+0000 7f0fee59c640 1 --2- 172.21.15.55:0/4212087087 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff00ad950 0x7f0ff00cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.077+0000 7f0fee59c640 1 -- 172.21.15.55:0/4212087087 >> v1:172.21.15.55:6789/0 conn(0x7f0ff006c000 legacy=0x7f0ff015d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:42.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.077+0000 7f0fee59c640 1 -- 172.21.15.55:0/4212087087 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff00cc880 con 0x7f0ff00c89f0 2023-08-25T04:19:42.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.077+0000 7f0feed9d640 1 --2- 172.21.15.55:0/4212087087 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff00ad950 0x7f0ff00cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:42.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.081+0000 7f0fee59c640 1 --2- 172.21.15.55:0/4212087087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ff00c89f0 0x7f0ff00ce7a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40097c0 tx=0x7f0fe401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3022b41dac33ddb3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:42.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.081+0000 7f0fedd9b640 1 -- 172.21.15.55:0/4212087087 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe40ab600 con 0x7f0ff00c89f0 2023-08-25T04:19:42.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.081+0000 7f0fedd9b640 1 -- 172.21.15.55:0/4212087087 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe40a7050 con 0x7f0ff00c89f0 2023-08-25T04:19:42.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.081+0000 7f0fedd9b640 1 -- 172.21.15.55:0/4212087087 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe40ab980 con 0x7f0ff00c89f0 2023-08-25T04:19:42.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.081+0000 7f0ff5019640 1 -- 172.21.15.55:0/4212087087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ff00c89f0 msgr2=0x7f0ff00ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:42.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.081+0000 7f0ff5019640 1 --2- 172.21.15.55:0/4212087087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ff00c89f0 0x7f0ff00ce7a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40097c0 tx=0x7f0fe401c3c0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.081+0000 7f0ff5019640 1 -- 172.21.15.55:0/4212087087 shutdown_connections 2023-08-25T04:19:42.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.081+0000 7f0ff5019640 1 --2- 172.21.15.55:0/4212087087 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ff00c89f0 0x7f0ff00ce7a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.081+0000 7f0ff5019640 1 --2- 172.21.15.55:0/4212087087 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff00ad950 0x7f0ff00cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0ff5019640 1 -- 172.21.15.55:0/4212087087 >> 172.21.15.55:0/4212087087 conn(0x7f0ff0069d00 msgr2=0x7f0ff006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:42.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0ff5019640 1 -- 172.21.15.55:0/4212087087 shutdown_connections 2023-08-25T04:19:42.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0ff5019640 1 -- 172.21.15.55:0/4212087087 wait complete. 2023-08-25T04:19:42.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0ff5019640 1 Processor -- start 2023-08-25T04:19:42.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0ff5019640 1 -- start start 2023-08-25T04:19:42.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0ff5019640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff006c000 0x7f0ff00cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0ff5019640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff00ad950 0x7f0ff00972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0ff5019640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ff00c89f0 0x7f0ff015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0ff5019640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff0097810 con 0x7f0ff006c000 2023-08-25T04:19:42.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0ff5019640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff00abf00 con 0x7f0ff00c89f0 2023-08-25T04:19:42.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0ff5019640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff00ac1e0 con 0x7f0ff00ad950 2023-08-25T04:19:42.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0feed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff006c000 0x7f0ff00cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0fee59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff00ad950 0x7f0ff00972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0feed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff006c000 0x7f0ff00cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58510/0 (socket says 172.21.15.55:58510) 2023-08-25T04:19:42.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0fef59e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ff00c89f0 0x7f0ff015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0feed9d640 1 -- 172.21.15.55:0/2522252638 learned_addr learned my addr 172.21.15.55:0/2522252638 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0fee59c640 1 -- 172.21.15.55:0/2522252638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ff00c89f0 msgr2=0x7f0ff015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0fee59c640 1 --2- 172.21.15.55:0/2522252638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ff00c89f0 0x7f0ff015baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0fee59c640 1 -- 172.21.15.55:0/2522252638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff006c000 msgr2=0x7f0ff00cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0fee59c640 1 --2- 172.21.15.55:0/2522252638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff006c000 0x7f0ff00cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0fee59c640 1 -- 172.21.15.55:0/2522252638 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe0009420 con 0x7f0ff00ad950 2023-08-25T04:19:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.085+0000 7f0feed9d640 1 --2- 172.21.15.55:0/2522252638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff006c000 0x7f0ff00cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.089+0000 7f0fee59c640 1 --2- 172.21.15.55:0/2522252638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff00ad950 0x7f0ff00972d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40ab000 tx=0x7f0fe4019160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.089+0000 7f0fd77fe640 1 -- 172.21.15.55:0/2522252638 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe40b4610 con 0x7f0ff00ad950 2023-08-25T04:19:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.089+0000 7f0fd77fe640 1 -- 172.21.15.55:0/2522252638 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe40b4770 con 0x7f0ff00ad950 2023-08-25T04:19:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.089+0000 7f0ff5019640 1 -- 172.21.15.55:0/2522252638 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe4009420 con 0x7f0ff00ad950 2023-08-25T04:19:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.089+0000 7f0fd77fe640 1 -- 172.21.15.55:0/2522252638 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe40b4b20 con 0x7f0ff00ad950 2023-08-25T04:19:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.089+0000 7f0ff5019640 1 -- 172.21.15.55:0/2522252638 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff00ac7a0 con 0x7f0ff00ad950 2023-08-25T04:19:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.089+0000 7f0ff5019640 1 -- 172.21.15.55:0/2522252638 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff004dbe0 con 0x7f0ff00ad950 2023-08-25T04:19:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.089+0000 7f0fd77fe640 1 -- 172.21.15.55:0/2522252638 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f0fe40b2040 con 0x7f0ff00ad950 2023-08-25T04:19:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.089+0000 7f0fd77fe640 1 --2- 172.21.15.55:0/2522252638 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f0fdc065790 0x7f0fdc067c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.089+0000 7f0fd77fe640 1 -- 172.21.15.55:0/2522252638 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0fe411cc90 con 0x7f0ff00ad950 2023-08-25T04:19:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.089+0000 7f0feed9d640 1 --2- 172.21.15.55:0/2522252638 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f0fdc065790 0x7f0fdc067c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.093+0000 7f0feed9d640 1 --2- 172.21.15.55:0/2522252638 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f0fdc065790 0x7f0fdc067c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ff006bf10 tx=0x7f0fe0009190 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:42.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.093+0000 7f0fd77fe640 1 -- 172.21.15.55:0/2522252638 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0fe40ea680 con 0x7f0ff00ad950 2023-08-25T04:19:42.191 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:42.188+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:42.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.253+0000 7f0ff5019640 1 -- 172.21.15.55:0/2522252638 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ff00c8f20 con 0x7f0ff00ad950 2023-08-25T04:19:42.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.257+0000 7f0fd77fe640 1 -- 172.21.15.55:0/2522252638 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+18330 (secure 0 0 0) 0x7f0fe40b0090 con 0x7f0ff00ad950 2023-08-25T04:19:42.257 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:42.257 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":105,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:19:41.282566+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:19:39.091781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-25T04:19:40.272091+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:19:42.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.257+0000 7f0ff5019640 1 -- 172.21.15.55:0/2522252638 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f0fdc065790 msgr2=0x7f0fdc067c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:42.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.257+0000 7f0ff5019640 1 --2- 172.21.15.55:0/2522252638 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f0fdc065790 0x7f0fdc067c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0ff006bf10 tx=0x7f0fe0009190 comp rx=0 tx=0).stop 2023-08-25T04:19:42.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.257+0000 7f0ff5019640 1 -- 172.21.15.55:0/2522252638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff00ad950 msgr2=0x7f0ff00972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:42.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.257+0000 7f0ff5019640 1 --2- 172.21.15.55:0/2522252638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff00ad950 0x7f0ff00972d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0fe40ab000 tx=0x7f0fe4019160 comp rx=0 tx=0).stop 2023-08-25T04:19:42.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.257+0000 7f0ff5019640 1 -- 172.21.15.55:0/2522252638 shutdown_connections 2023-08-25T04:19:42.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.257+0000 7f0ff5019640 1 --2- 172.21.15.55:0/2522252638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ff00c89f0 0x7f0ff015baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.257+0000 7f0ff5019640 1 --2- 172.21.15.55:0/2522252638 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f0fdc065790 0x7f0fdc067c50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.257+0000 7f0ff5019640 1 --2- 172.21.15.55:0/2522252638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ff00ad950 0x7f0ff00972d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.257+0000 7f0ff5019640 1 --2- 172.21.15.55:0/2522252638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ff006c000 0x7f0ff00cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.257+0000 7f0ff5019640 1 -- 172.21.15.55:0/2522252638 >> 172.21.15.55:0/2522252638 conn(0x7f0ff0069d00 msgr2=0x7f0ff006b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:42.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.257+0000 7f0ff5019640 1 -- 172.21.15.55:0/2522252638 shutdown_connections 2023-08-25T04:19:42.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.257+0000 7f0ff5019640 1 -- 172.21.15.55:0/2522252638 wait complete. 2023-08-25T04:19:42.279 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:19:42.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.425+0000 7f431609e640 1 Processor -- start 2023-08-25T04:19:42.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.425+0000 7f431609e640 1 -- start start 2023-08-25T04:19:42.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.429+0000 7f431609e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f43100d0da0 0x7f43100d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.429+0000 7f431609e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f43100cdde0 0x7f43100ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.429+0000 7f431609e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43100cee60 0x7f43100cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.429+0000 7f431609e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43100ce760 con 0x7f43100cdde0 2023-08-25T04:19:42.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.429+0000 7f431609e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43100b29b0 con 0x7f43100d0da0 2023-08-25T04:19:42.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.429+0000 7f431609e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43100d16c0 con 0x7f43100cee60 2023-08-25T04:19:42.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.429+0000 7f430effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f43100cdde0 0x7f43100ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.429+0000 7f430effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f43100cdde0 0x7f43100ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58512/0 (socket says 172.21.15.55:58512) 2023-08-25T04:19:42.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.429+0000 7f430effd640 1 -- 172.21.15.55:0/506111 learned_addr learned my addr 172.21.15.55:0/506111 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:42.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.429+0000 7f430f7fe640 1 --2- 172.21.15.55:0/506111 >> v2:172.21.15.110:3300/0 conn(0x7f43100d0da0 0x7f43100d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.429+0000 7f430ffff640 1 --2- 172.21.15.55:0/506111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43100cee60 0x7f43100cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.429+0000 7f430effd640 1 -- 172.21.15.55:0/506111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43100cee60 msgr2=0x7f43100cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:42.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.429+0000 7f430effd640 1 --2- 172.21.15.55:0/506111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43100cee60 0x7f43100cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.429+0000 7f430effd640 1 -- 172.21.15.55:0/506111 >> v2:172.21.15.110:3300/0 conn(0x7f43100d0da0 msgr2=0x7f43100d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:42.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.429+0000 7f430effd640 1 --2- 172.21.15.55:0/506111 >> v2:172.21.15.110:3300/0 conn(0x7f43100d0da0 0x7f43100d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.429+0000 7f430effd640 1 -- 172.21.15.55:0/506111 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43100b1dc0 con 0x7f43100cdde0 2023-08-25T04:19:42.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.429+0000 7f430effd640 1 --2- 172.21.15.55:0/506111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100cdde0 0x7f43100ce220 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f4310073720 tx=0x7f430401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58686b06fcf4e64e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:42.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f430e7fc640 1 -- 172.21.15.55:0/506111 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43040a89b0 con 0x7f43100cdde0 2023-08-25T04:19:42.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f430e7fc640 1 -- 172.21.15.55:0/506111 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43040a8b10 con 0x7f43100cdde0 2023-08-25T04:19:42.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f430e7fc640 1 -- 172.21.15.55:0/506111 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43040a8ea0 con 0x7f43100cdde0 2023-08-25T04:19:42.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f431609e640 1 -- 172.21.15.55:0/506111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100cdde0 msgr2=0x7f43100ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:42.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f431609e640 1 --2- 172.21.15.55:0/506111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100cdde0 0x7f43100ce220 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f4310073720 tx=0x7f430401ecf0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f431609e640 1 -- 172.21.15.55:0/506111 shutdown_connections 2023-08-25T04:19:42.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f431609e640 1 --2- 172.21.15.55:0/506111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43100cee60 0x7f43100cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f431609e640 1 --2- 172.21.15.55:0/506111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100cdde0 0x7f43100ce220 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f431609e640 1 --2- 172.21.15.55:0/506111 >> v2:172.21.15.110:3300/0 conn(0x7f43100d0da0 0x7f43100d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f431609e640 1 -- 172.21.15.55:0/506111 >> 172.21.15.55:0/506111 conn(0x7f431009bae0 msgr2=0x7f43100d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:42.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f431609e640 1 -- 172.21.15.55:0/506111 shutdown_connections 2023-08-25T04:19:42.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f431609e640 1 -- 172.21.15.55:0/506111 wait complete. 2023-08-25T04:19:42.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f431609e640 1 Processor -- start 2023-08-25T04:19:42.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f431609e640 1 -- start start 2023-08-25T04:19:42.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f431609e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43100cdde0 0x7f43100b7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f431609e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100cee60 0x7f43100cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f431609e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43100d0da0 0x7f43100cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f431609e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43100cb400 con 0x7f43100cee60 2023-08-25T04:19:42.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f431609e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43100ca780 con 0x7f43100d0da0 2023-08-25T04:19:42.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.433+0000 7f431609e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43100caa60 con 0x7f43100cdde0 2023-08-25T04:19:42.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f430effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100cee60 0x7f43100cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f430f7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43100cdde0 0x7f43100b7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f430ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43100d0da0 0x7f43100cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f430f7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43100cdde0 0x7f43100b7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:52540/0 (socket says 172.21.15.55:52540) 2023-08-25T04:19:42.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f430f7fe640 1 -- 172.21.15.55:0/1774952521 learned_addr learned my addr 172.21.15.55:0/1774952521 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:42.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f430effd640 1 -- 172.21.15.55:0/1774952521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43100cdde0 msgr2=0x7f43100b7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:42.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f430effd640 1 --2- 172.21.15.55:0/1774952521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43100cdde0 0x7f43100b7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f430effd640 1 -- 172.21.15.55:0/1774952521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43100d0da0 msgr2=0x7f43100cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:42.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f430effd640 1 --2- 172.21.15.55:0/1774952521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43100d0da0 0x7f43100cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f430effd640 1 -- 172.21.15.55:0/1774952521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43040094d0 con 0x7f43100cee60 2023-08-25T04:19:42.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f430f7fe640 1 --2- 172.21.15.55:0/1774952521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43100cdde0 0x7f43100b7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:42.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f430effd640 1 --2- 172.21.15.55:0/1774952521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100cee60 0x7f43100cb910 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f43040af000 tx=0x7f430401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:42.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f42f7fff640 1 -- 172.21.15.55:0/1774952521 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43040b0da0 con 0x7f43100cee60 2023-08-25T04:19:42.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f42f7fff640 1 -- 172.21.15.55:0/1774952521 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43040bb460 con 0x7f43100cee60 2023-08-25T04:19:42.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f42f7fff640 1 -- 172.21.15.55:0/1774952521 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43040bb810 con 0x7f43100cee60 2023-08-25T04:19:42.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f431609e640 1 -- 172.21.15.55:0/1774952521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43100cad40 con 0x7f43100cee60 2023-08-25T04:19:42.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f431609e640 1 -- 172.21.15.55:0/1774952521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43100b81d0 con 0x7f43100cee60 2023-08-25T04:19:42.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f431609e640 1 -- 172.21.15.55:0/1774952521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f431004dbe0 con 0x7f43100cee60 2023-08-25T04:19:42.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.437+0000 7f42f7fff640 1 -- 172.21.15.55:0/1774952521 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f43040b83f0 con 0x7f43100cee60 2023-08-25T04:19:42.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.441+0000 7f42f7fff640 1 --2- 172.21.15.55:0/1774952521 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f42fc065710 0x7f42fc067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.441+0000 7f42f7fff640 1 -- 172.21.15.55:0/1774952521 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43041208d0 con 0x7f43100cee60 2023-08-25T04:19:42.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.441+0000 7f430f7fe640 1 --2- 172.21.15.55:0/1774952521 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f42fc065710 0x7f42fc067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.441+0000 7f430f7fe640 1 --2- 172.21.15.55:0/1774952521 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f42fc065710 0x7f42fc067bd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f43000112c0 tx=0x7f4300006f90 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:42.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.445+0000 7f42f7fff640 1 -- 172.21.15.55:0/1774952521 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f43040ee460 con 0x7f43100cee60 2023-08-25T04:19:42.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.601+0000 7f431609e640 1 -- 172.21.15.55:0/1774952521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43100d0b80 con 0x7f43100cee60 2023-08-25T04:19:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.601+0000 7f42f7fff640 1 -- 172.21.15.55:0/1774952521 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+18330 (secure 0 0 0) 0x7f43040c0090 con 0x7f43100cee60 2023-08-25T04:19:42.604 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:42.604 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":105,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:19:41.282566+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:19:39.091781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-25T04:19:40.272091+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:19:42.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.605+0000 7f431609e640 1 -- 172.21.15.55:0/1774952521 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f42fc065710 msgr2=0x7f42fc067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:42.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.605+0000 7f431609e640 1 --2- 172.21.15.55:0/1774952521 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f42fc065710 0x7f42fc067bd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f43000112c0 tx=0x7f4300006f90 comp rx=0 tx=0).stop 2023-08-25T04:19:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.605+0000 7f431609e640 1 -- 172.21.15.55:0/1774952521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100cee60 msgr2=0x7f43100cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.605+0000 7f431609e640 1 --2- 172.21.15.55:0/1774952521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100cee60 0x7f43100cb910 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f43040af000 tx=0x7f430401ba90 comp rx=0 tx=0).stop 2023-08-25T04:19:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.605+0000 7f431609e640 1 -- 172.21.15.55:0/1774952521 shutdown_connections 2023-08-25T04:19:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.605+0000 7f431609e640 1 --2- 172.21.15.55:0/1774952521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43100d0da0 0x7f43100cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.605+0000 7f431609e640 1 --2- 172.21.15.55:0/1774952521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43100cee60 0x7f43100cb910 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.605+0000 7f431609e640 1 --2- 172.21.15.55:0/1774952521 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f42fc065710 0x7f42fc067bd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.605+0000 7f431609e640 1 --2- 172.21.15.55:0/1774952521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43100cdde0 0x7f43100b7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.605+0000 7f431609e640 1 -- 172.21.15.55:0/1774952521 >> 172.21.15.55:0/1774952521 conn(0x7f431009bae0 msgr2=0x7f431006bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:42.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.605+0000 7f431609e640 1 -- 172.21.15.55:0/1774952521 shutdown_connections 2023-08-25T04:19:42.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.605+0000 7f431609e640 1 -- 172.21.15.55:0/1774952521 wait complete. 2023-08-25T04:19:42.626 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-25T04:19:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.777+0000 7fb41fffa640 1 Processor -- start 2023-08-25T04:19:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.777+0000 7fb41fffa640 1 -- start start 2023-08-25T04:19:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.777+0000 7fb41fffa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb4180ad660 0x7fb4180cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.777+0000 7fb41fffa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb4180ada40 0x7fb41806c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.777+0000 7fb41fffa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4180cdf40 con 0x7fb41809bde0 2023-08-25T04:19:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.777+0000 7fb41fffa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41806c7b0 con 0x7fb4180ada40 2023-08-25T04:19:42.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.777+0000 7fb41fffa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41806b7b0 con 0x7fb4180ad660 2023-08-25T04:19:42.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.777+0000 7fb41d595640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb4180ada40 0x7fb41806c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.777+0000 7fb41d595640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb4180ada40 0x7fb41806c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58538/0 (socket says 172.21.15.55:58538) 2023-08-25T04:19:42.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.777+0000 7fb41e597640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb41809bde0 0x7fb4180cbf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43880/0 (socket says 172.21.15.55:43880) 2023-08-25T04:19:42.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.777+0000 7fb41d595640 1 -- 172.21.15.55:0/4006407780 learned_addr learned my addr 172.21.15.55:0/4006407780 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:42.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.777+0000 7fb41dd96640 1 --2- 172.21.15.55:0/4006407780 >> v2:172.21.15.110:3300/0 conn(0x7fb4180ad660 0x7fb4180cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.777+0000 7fb41d595640 1 -- 172.21.15.55:0/4006407780 >> v2:172.21.15.110:3300/0 conn(0x7fb4180ad660 msgr2=0x7fb4180cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:42.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.777+0000 7fb41d595640 1 --2- 172.21.15.55:0/4006407780 >> v2:172.21.15.110:3300/0 conn(0x7fb4180ad660 0x7fb4180cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.777+0000 7fb41d595640 1 -- 172.21.15.55:0/4006407780 >> v1:172.21.15.55:6789/0 conn(0x7fb41809bde0 legacy=0x7fb4180cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:42.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.777+0000 7fb41d595640 1 -- 172.21.15.55:0/4006407780 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41806ba90 con 0x7fb4180ada40 2023-08-25T04:19:42.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.781+0000 7fb41d595640 1 --2- 172.21.15.55:0/4006407780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4180ada40 0x7fb41806c270 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fb41806dd00 tx=0x7fb40801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe073a5aa13347c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:42.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.781+0000 7fb41cd94640 1 -- 172.21.15.55:0/4006407780 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4080ac630 con 0x7fb4180ada40 2023-08-25T04:19:42.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.781+0000 7fb41cd94640 1 -- 172.21.15.55:0/4006407780 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4080ac790 con 0x7fb4180ada40 2023-08-25T04:19:42.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.781+0000 7fb41cd94640 1 -- 172.21.15.55:0/4006407780 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4080acb20 con 0x7fb4180ada40 2023-08-25T04:19:42.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.781+0000 7fb41fffa640 1 -- 172.21.15.55:0/4006407780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4180ada40 msgr2=0x7fb41806c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:42.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.781+0000 7fb41fffa640 1 --2- 172.21.15.55:0/4006407780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4180ada40 0x7fb41806c270 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fb41806dd00 tx=0x7fb40801c500 comp rx=0 tx=0).stop 2023-08-25T04:19:42.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.781+0000 7fb41fffa640 1 -- 172.21.15.55:0/4006407780 shutdown_connections 2023-08-25T04:19:42.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.781+0000 7fb41fffa640 1 --2- 172.21.15.55:0/4006407780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4180ada40 0x7fb41806c270 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.781+0000 7fb41fffa640 1 --2- 172.21.15.55:0/4006407780 >> v2:172.21.15.110:3300/0 conn(0x7fb4180ad660 0x7fb4180cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.781+0000 7fb41fffa640 1 -- 172.21.15.55:0/4006407780 >> 172.21.15.55:0/4006407780 conn(0x7fb418069900 msgr2=0x7fb418069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:42.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.781+0000 7fb41fffa640 1 -- 172.21.15.55:0/4006407780 shutdown_connections 2023-08-25T04:19:42.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.781+0000 7fb41fffa640 1 -- 172.21.15.55:0/4006407780 wait complete. 2023-08-25T04:19:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41fffa640 1 Processor -- start 2023-08-25T04:19:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41fffa640 1 -- start start 2023-08-25T04:19:42.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41fffa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb41809bde0 0x7fb418153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41fffa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4180ad660 0x7fb41806fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41fffa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4180ada40 0x7fb41806ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41fffa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180b2e10 con 0x7fb4180ad660 2023-08-25T04:19:42.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41fffa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41815d730 con 0x7fb41809bde0 2023-08-25T04:19:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41fffa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41815da10 con 0x7fb4180ada40 2023-08-25T04:19:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41d595640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4180ad660 0x7fb41806fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41d595640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4180ad660 0x7fb41806fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58550/0 (socket says 172.21.15.55:58550) 2023-08-25T04:19:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41d595640 1 -- 172.21.15.55:0/2496128786 learned_addr learned my addr 172.21.15.55:0/2496128786 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41dd96640 1 --2- 172.21.15.55:0/2496128786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb41809bde0 0x7fb418153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41e597640 1 --2- 172.21.15.55:0/2496128786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4180ada40 0x7fb41806ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41d595640 1 -- 172.21.15.55:0/2496128786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4180ada40 msgr2=0x7fb41806ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41d595640 1 --2- 172.21.15.55:0/2496128786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4180ada40 0x7fb41806ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41d595640 1 -- 172.21.15.55:0/2496128786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb41809bde0 msgr2=0x7fb418153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41d595640 1 --2- 172.21.15.55:0/2496128786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb41809bde0 0x7fb418153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41d595640 1 -- 172.21.15.55:0/2496128786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4080094d0 con 0x7fb4180ad660 2023-08-25T04:19:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41d595640 1 --2- 172.21.15.55:0/2496128786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4180ad660 0x7fb41806fa20 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fb408019110 tx=0x7fb4080192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb40e7fc640 1 -- 172.21.15.55:0/2496128786 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4080b5640 con 0x7fb4180ad660 2023-08-25T04:19:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb40e7fc640 1 -- 172.21.15.55:0/2496128786 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4080b57a0 con 0x7fb4180ad660 2023-08-25T04:19:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb40e7fc640 1 -- 172.21.15.55:0/2496128786 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4080b5b30 con 0x7fb4180ad660 2023-08-25T04:19:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41fffa640 1 -- 172.21.15.55:0/2496128786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41815dcf0 con 0x7fb4180ad660 2023-08-25T04:19:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.785+0000 7fb41fffa640 1 -- 172.21.15.55:0/2496128786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb418153cc0 con 0x7fb4180ad660 2023-08-25T04:19:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.789+0000 7fb41fffa640 1 -- 172.21.15.55:0/2496128786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb418073ec0 con 0x7fb4180ad660 2023-08-25T04:19:42.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.789+0000 7fb40e7fc640 1 -- 172.21.15.55:0/2496128786 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fb4080b3070 con 0x7fb4180ad660 2023-08-25T04:19:42.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.789+0000 7fb40e7fc640 1 --2- 172.21.15.55:0/2496128786 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fb3fc065710 0x7fb3fc067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:42.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.789+0000 7fb40e7fc640 1 -- 172.21.15.55:0/2496128786 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb40811ce20 con 0x7fb4180ad660 2023-08-25T04:19:42.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.789+0000 7fb41dd96640 1 --2- 172.21.15.55:0/2496128786 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fb3fc065710 0x7fb3fc067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:42.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.789+0000 7fb41dd96640 1 --2- 172.21.15.55:0/2496128786 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fb3fc065710 0x7fb3fc067bd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb4181f82c0 tx=0x7fb414006f90 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:42.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.793+0000 7fb40e7fc640 1 -- 172.21.15.55:0/2496128786 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb4080ea790 con 0x7fb4180ad660 2023-08-25T04:19:42.947 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:42.944+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:42.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:42.993+0000 7fb41fffa640 1 -- 172.21.15.55:0/2496128786 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb41815e1a0 con 0x7fb4180ad660 2023-08-25T04:19:43.699 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:43.696+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:43.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:43.909+0000 7fb40e7fc640 1 -- 172.21.15.55:0/2496128786 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb4080a80b0 con 0x7fb4180ad660 2023-08-25T04:19:43.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:43.909+0000 7fb41fffa640 1 -- 172.21.15.55:0/2496128786 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fb3fc065710 msgr2=0x7fb3fc067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:43.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:43.909+0000 7fb41fffa640 1 --2- 172.21.15.55:0/2496128786 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fb3fc065710 0x7fb3fc067bd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb4181f82c0 tx=0x7fb414006f90 comp rx=0 tx=0).stop 2023-08-25T04:19:43.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:43.909+0000 7fb41fffa640 1 -- 172.21.15.55:0/2496128786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4180ad660 msgr2=0x7fb41806fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:43.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:43.909+0000 7fb41fffa640 1 --2- 172.21.15.55:0/2496128786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4180ad660 0x7fb41806fa20 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fb408019110 tx=0x7fb4080192a0 comp rx=0 tx=0).stop 2023-08-25T04:19:43.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:43.909+0000 7fb41fffa640 1 -- 172.21.15.55:0/2496128786 shutdown_connections 2023-08-25T04:19:43.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:43.909+0000 7fb41fffa640 1 --2- 172.21.15.55:0/2496128786 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fb3fc065710 0x7fb3fc067bd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:43.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:43.909+0000 7fb41fffa640 1 --2- 172.21.15.55:0/2496128786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4180ada40 0x7fb41806ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:43.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:43.909+0000 7fb41fffa640 1 --2- 172.21.15.55:0/2496128786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4180ad660 0x7fb41806fa20 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:43.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:43.909+0000 7fb41fffa640 1 --2- 172.21.15.55:0/2496128786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb41809bde0 0x7fb418153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:43.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:43.909+0000 7fb41fffa640 1 -- 172.21.15.55:0/2496128786 >> 172.21.15.55:0/2496128786 conn(0x7fb418069900 msgr2=0x7fb41806cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:43.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:43.909+0000 7fb41fffa640 1 -- 172.21.15.55:0/2496128786 shutdown_connections 2023-08-25T04:19:43.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:43.909+0000 7fb41fffa640 1 -- 172.21.15.55:0/2496128786 wait complete. 2023-08-25T04:19:43.931 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-25T04:19:43.931 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-25T04:19:44.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.081+0000 7f5078737640 1 Processor -- start 2023-08-25T04:19:44.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.081+0000 7f5078737640 1 -- start start 2023-08-25T04:19:44.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.081+0000 7f5078737640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f50700cb020 0x7f50700c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:44.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.081+0000 7f5078737640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50700cdd50 0x7f50700cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:44.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.081+0000 7f5078737640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50700cbca0 con 0x7f507006c720 2023-08-25T04:19:44.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.081+0000 7f5078737640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50700c9470 con 0x7f50700cb020 2023-08-25T04:19:44.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.081+0000 7f5078737640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50700ce1e0 con 0x7f50700cdd50 2023-08-25T04:19:44.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.081+0000 7f50764d3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f50700cb020 0x7f50700c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:44.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.081+0000 7f50764d3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f50700cb020 0x7f50700c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58554/0 (socket says 172.21.15.55:58554) 2023-08-25T04:19:44.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.081+0000 7f50764d3640 1 -- 172.21.15.55:0/4294964166 learned_addr learned my addr 172.21.15.55:0/4294964166 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:44.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.081+0000 7f5075cd2640 1 --2- 172.21.15.55:0/4294964166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50700cdd50 0x7f50700cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:44.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.081+0000 7f50764d3640 1 -- 172.21.15.55:0/4294964166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50700cdd50 msgr2=0x7f50700cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:44.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.081+0000 7f50764d3640 1 --2- 172.21.15.55:0/4294964166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50700cdd50 0x7f50700cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:44.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.081+0000 7f50764d3640 1 -- 172.21.15.55:0/4294964166 >> v1:172.21.15.110:6789/0 conn(0x7f507006c720 legacy=0x7f50700cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:44.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.081+0000 7f50764d3640 1 -- 172.21.15.55:0/4294964166 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50700c8b40 con 0x7f50700cb020 2023-08-25T04:19:44.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.085+0000 7f50764d3640 1 --2- 172.21.15.55:0/4294964166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50700cb020 0x7f50700c9900 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f506c006fd0 tx=0x7f506c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace73021c877ccba server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:44.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.085+0000 7f50754d1640 1 -- 172.21.15.55:0/4294964166 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c0ad680 con 0x7f50700cb020 2023-08-25T04:19:44.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.085+0000 7f50754d1640 1 -- 172.21.15.55:0/4294964166 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c0ad7e0 con 0x7f50700cb020 2023-08-25T04:19:44.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.085+0000 7f50754d1640 1 -- 172.21.15.55:0/4294964166 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c0adb70 con 0x7f50700cb020 2023-08-25T04:19:44.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.085+0000 7f5078737640 1 -- 172.21.15.55:0/4294964166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50700cb020 msgr2=0x7f50700c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:44.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.085+0000 7f5078737640 1 --2- 172.21.15.55:0/4294964166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50700cb020 0x7f50700c9900 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f506c006fd0 tx=0x7f506c01c490 comp rx=0 tx=0).stop 2023-08-25T04:19:44.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.085+0000 7f5078737640 1 -- 172.21.15.55:0/4294964166 shutdown_connections 2023-08-25T04:19:44.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.085+0000 7f5078737640 1 --2- 172.21.15.55:0/4294964166 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50700cdd50 0x7f50700cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:44.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.085+0000 7f5078737640 1 --2- 172.21.15.55:0/4294964166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50700cb020 0x7f50700c9900 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:44.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.085+0000 7f5078737640 1 -- 172.21.15.55:0/4294964166 >> 172.21.15.55:0/4294964166 conn(0x7f5070069900 msgr2=0x7f5070069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:44.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.085+0000 7f5078737640 1 -- 172.21.15.55:0/4294964166 shutdown_connections 2023-08-25T04:19:44.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.085+0000 7f5078737640 1 -- 172.21.15.55:0/4294964166 wait complete. 2023-08-25T04:19:44.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f5078737640 1 Processor -- start 2023-08-25T04:19:44.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f5078737640 1 -- start start 2023-08-25T04:19:44.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f5078737640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f507006c720 0x7f5070166660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:44.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f5078737640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50700cb020 0x7f50701557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:44.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f5078737640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50700cdd50 0x7f5070155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:44.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f5078737640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5070156390 con 0x7f50700cdd50 2023-08-25T04:19:44.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f5078737640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5070165690 con 0x7f507006c720 2023-08-25T04:19:44.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f5078737640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50701676d0 con 0x7f50700cb020 2023-08-25T04:19:44.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f50764d3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f507006c720 0x7f5070166660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:44.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f5076cd4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50700cdd50 0x7f5070155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:44.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f50764d3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f507006c720 0x7f5070166660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:35440/0 (socket says 172.21.15.55:35440) 2023-08-25T04:19:44.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f50764d3640 1 -- 172.21.15.55:0/3004948765 learned_addr learned my addr 172.21.15.55:0/3004948765 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:44.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f5075cd2640 1 --2- 172.21.15.55:0/3004948765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50700cb020 0x7f50701557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:44.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f50764d3640 1 -- 172.21.15.55:0/3004948765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50700cb020 msgr2=0x7f50701557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:44.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f50764d3640 1 --2- 172.21.15.55:0/3004948765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50700cb020 0x7f50701557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:44.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f50764d3640 1 -- 172.21.15.55:0/3004948765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50700cdd50 msgr2=0x7f5070155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:44.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f50764d3640 1 --2- 172.21.15.55:0/3004948765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50700cdd50 0x7f5070155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:44.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f50764d3640 1 -- 172.21.15.55:0/3004948765 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c009480 con 0x7f507006c720 2023-08-25T04:19:44.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f5076cd4640 1 --2- 172.21.15.55:0/3004948765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50700cdd50 0x7f5070155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:44.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f50764d3640 1 --2- 172.21.15.55:0/3004948765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f507006c720 0x7f5070166660 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f506c0b0040 tx=0x7f506c019230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:44.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f5066ffd640 1 -- 172.21.15.55:0/3004948765 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c0ba070 con 0x7f507006c720 2023-08-25T04:19:44.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f5066ffd640 1 -- 172.21.15.55:0/3004948765 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506c004250 con 0x7f507006c720 2023-08-25T04:19:44.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f5078737640 1 -- 172.21.15.55:0/3004948765 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f507006d0c0 con 0x7f507006c720 2023-08-25T04:19:44.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f5066ffd640 1 -- 172.21.15.55:0/3004948765 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506c0ad950 con 0x7f507006c720 2023-08-25T04:19:44.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.089+0000 7f5078737640 1 -- 172.21.15.55:0/3004948765 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5070151140 con 0x7f507006c720 2023-08-25T04:19:44.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.093+0000 7f5078737640 1 -- 172.21.15.55:0/3004948765 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5070073ec0 con 0x7f507006c720 2023-08-25T04:19:44.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.093+0000 7f5066ffd640 1 -- 172.21.15.55:0/3004948765 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f506c0adab0 con 0x7f507006c720 2023-08-25T04:19:44.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.093+0000 7f5066ffd640 1 --2- 172.21.15.55:0/3004948765 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f5054065710 0x7f5054067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:44.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.093+0000 7f5066ffd640 1 -- 172.21.15.55:0/3004948765 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f506c11c870 con 0x7f507006c720 2023-08-25T04:19:44.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.093+0000 7f5075cd2640 1 --2- 172.21.15.55:0/3004948765 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f5054065710 0x7f5054067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:44.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.093+0000 7f5075cd2640 1 --2- 172.21.15.55:0/3004948765 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f5054065710 0x7f5054067bd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f507006da50 tx=0x7f5060009190 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:44.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.097+0000 7f5066ffd640 1 -- 172.21.15.55:0/3004948765 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f506c0ea270 con 0x7f507006c720 2023-08-25T04:19:44.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.297+0000 7f5078737640 1 -- 172.21.15.55:0/3004948765 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f507006a5f0 con 0x7f507006c720 2023-08-25T04:19:44.445 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:44.440+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:44.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.917+0000 7f5066ffd640 1 -- 172.21.15.55:0/3004948765 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v49) v1 ==== 122+0+0 (secure 0 0 0) 0x7f506c0ed890 con 0x7f507006c720 2023-08-25T04:19:44.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.917+0000 7f5078737640 1 -- 172.21.15.55:0/3004948765 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f5054065710 msgr2=0x7f5054067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:44.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.917+0000 7f5078737640 1 --2- 172.21.15.55:0/3004948765 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f5054065710 0x7f5054067bd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f507006da50 tx=0x7f5060009190 comp rx=0 tx=0).stop 2023-08-25T04:19:44.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.917+0000 7f5078737640 1 -- 172.21.15.55:0/3004948765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f507006c720 msgr2=0x7f5070166660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:44.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.917+0000 7f5078737640 1 --2- 172.21.15.55:0/3004948765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f507006c720 0x7f5070166660 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f506c0b0040 tx=0x7f506c019230 comp rx=0 tx=0).stop 2023-08-25T04:19:44.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.917+0000 7f5078737640 1 -- 172.21.15.55:0/3004948765 shutdown_connections 2023-08-25T04:19:44.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.917+0000 7f5078737640 1 --2- 172.21.15.55:0/3004948765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50700cdd50 0x7f5070155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:44.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.917+0000 7f5078737640 1 --2- 172.21.15.55:0/3004948765 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f5054065710 0x7f5054067bd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:44.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.917+0000 7f5078737640 1 --2- 172.21.15.55:0/3004948765 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50700cb020 0x7f50701557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:44.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.917+0000 7f5078737640 1 --2- 172.21.15.55:0/3004948765 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f507006c720 0x7f5070166660 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:44.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.917+0000 7f5078737640 1 -- 172.21.15.55:0/3004948765 >> 172.21.15.55:0/3004948765 conn(0x7f5070069900 msgr2=0x7f5070071090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:44.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.917+0000 7f5078737640 1 -- 172.21.15.55:0/3004948765 shutdown_connections 2023-08-25T04:19:44.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:44.917+0000 7f5078737640 1 -- 172.21.15.55:0/3004948765 wait complete. 2023-08-25T04:19:44.938 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-25T04:19:44.939 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:19:45.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.085+0000 7f03ca026640 1 Processor -- start 2023-08-25T04:19:45.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.085+0000 7f03ca026640 1 -- start start 2023-08-25T04:19:45.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.089+0000 7f03ca026640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f03c415ca50 0x7f03c40d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.089+0000 7f03ca026640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f03c40d0f50 0x7f03c406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.089+0000 7f03ca026640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c40afe20 con 0x7f03c406c150 2023-08-25T04:19:45.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.089+0000 7f03ca026640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c40d13d0 con 0x7f03c40d0f50 2023-08-25T04:19:45.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.089+0000 7f03ca026640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c40af210 con 0x7f03c415ca50 2023-08-25T04:19:45.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.089+0000 7f03c8823640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f03c40d0f50 0x7f03c406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:45.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.089+0000 7f03c8823640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f03c40d0f50 0x7f03c406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58568/0 (socket says 172.21.15.55:58568) 2023-08-25T04:19:45.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.089+0000 7f03c8823640 1 -- 172.21.15.55:0/2098636091 learned_addr learned my addr 172.21.15.55:0/2098636091 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:45.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.089+0000 7f03c9024640 1 --2- 172.21.15.55:0/2098636091 >> v2:172.21.15.110:3300/0 conn(0x7f03c415ca50 0x7f03c40d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:45.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.089+0000 7f03c8823640 1 -- 172.21.15.55:0/2098636091 >> v2:172.21.15.110:3300/0 conn(0x7f03c415ca50 msgr2=0x7f03c40d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:45.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.089+0000 7f03c8823640 1 --2- 172.21.15.55:0/2098636091 >> v2:172.21.15.110:3300/0 conn(0x7f03c415ca50 0x7f03c40d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.089+0000 7f03c8823640 1 -- 172.21.15.55:0/2098636091 >> v1:172.21.15.110:6789/0 conn(0x7f03c406c150 legacy=0x7f03c40b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:45.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.089+0000 7f03c8823640 1 -- 172.21.15.55:0/2098636091 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c40af4f0 con 0x7f03c40d0f50 2023-08-25T04:19:45.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.093+0000 7f03c8823640 1 --2- 172.21.15.55:0/2098636091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c40d0f50 0x7f03c406bc10 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f03c408bec0 tx=0x7f03b401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73359b1dbbe0ef18 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:45.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.093+0000 7f03bbfff640 1 -- 172.21.15.55:0/2098636091 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b40aa430 con 0x7f03c40d0f50 2023-08-25T04:19:45.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.093+0000 7f03bbfff640 1 -- 172.21.15.55:0/2098636091 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b40aa590 con 0x7f03c40d0f50 2023-08-25T04:19:45.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.093+0000 7f03bbfff640 1 -- 172.21.15.55:0/2098636091 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b40aa920 con 0x7f03c40d0f50 2023-08-25T04:19:45.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.093+0000 7f03ca026640 1 -- 172.21.15.55:0/2098636091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c40d0f50 msgr2=0x7f03c406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:45.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.093+0000 7f03ca026640 1 --2- 172.21.15.55:0/2098636091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c40d0f50 0x7f03c406bc10 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f03c408bec0 tx=0x7f03b401c4d0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.093+0000 7f03ca026640 1 -- 172.21.15.55:0/2098636091 shutdown_connections 2023-08-25T04:19:45.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.093+0000 7f03ca026640 1 --2- 172.21.15.55:0/2098636091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c40d0f50 0x7f03c406bc10 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.093+0000 7f03ca026640 1 --2- 172.21.15.55:0/2098636091 >> v2:172.21.15.110:3300/0 conn(0x7f03c415ca50 0x7f03c40d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.093+0000 7f03ca026640 1 -- 172.21.15.55:0/2098636091 >> 172.21.15.55:0/2098636091 conn(0x7f03c4065f40 msgr2=0x7f03c409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:45.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.093+0000 7f03ca026640 1 -- 172.21.15.55:0/2098636091 shutdown_connections 2023-08-25T04:19:45.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.093+0000 7f03ca026640 1 -- 172.21.15.55:0/2098636091 wait complete. 2023-08-25T04:19:45.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.093+0000 7f03ca026640 1 Processor -- start 2023-08-25T04:19:45.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.093+0000 7f03ca026640 1 -- start start 2023-08-25T04:19:45.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03ca026640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03c406c150 0x7f03c414cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03ca026640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03c40d0f50 0x7f03c414c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03ca026640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c415ca50 0x7f03c415bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03ca026640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c414d3f0 con 0x7f03c415ca50 2023-08-25T04:19:45.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03ca026640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c415c1b0 con 0x7f03c406c150 2023-08-25T04:19:45.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03ca026640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c414b8a0 con 0x7f03c40d0f50 2023-08-25T04:19:45.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03c9825640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c415ca50 0x7f03c415bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:45.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03c9024640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03c406c150 0x7f03c414cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:45.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03c9825640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c415ca50 0x7f03c415bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58576/0 (socket says 172.21.15.55:58576) 2023-08-25T04:19:45.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03c9825640 1 -- 172.21.15.55:0/2157186462 learned_addr learned my addr 172.21.15.55:0/2157186462 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:45.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03c8823640 1 --2- 172.21.15.55:0/2157186462 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03c40d0f50 0x7f03c414c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:45.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03c9825640 1 -- 172.21.15.55:0/2157186462 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03c40d0f50 msgr2=0x7f03c414c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:45.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03c9825640 1 --2- 172.21.15.55:0/2157186462 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03c40d0f50 0x7f03c414c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03c9825640 1 -- 172.21.15.55:0/2157186462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03c406c150 msgr2=0x7f03c414cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:45.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03c9825640 1 --2- 172.21.15.55:0/2157186462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03c406c150 0x7f03c414cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03c9825640 1 -- 172.21.15.55:0/2157186462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b40094d0 con 0x7f03c415ca50 2023-08-25T04:19:45.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03c9825640 1 --2- 172.21.15.55:0/2157186462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c415ca50 0x7f03c415bc70 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00c770 tx=0x7f03bc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:45.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03b9ffb640 1 -- 172.21.15.55:0/2157186462 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc003b80 con 0x7f03c415ca50 2023-08-25T04:19:45.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03b9ffb640 1 -- 172.21.15.55:0/2157186462 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc003ce0 con 0x7f03c415ca50 2023-08-25T04:19:45.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03b9ffb640 1 -- 172.21.15.55:0/2157186462 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc00aa90 con 0x7f03c415ca50 2023-08-25T04:19:45.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03ca026640 1 -- 172.21.15.55:0/2157186462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c414bb80 con 0x7f03c415ca50 2023-08-25T04:19:45.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03ca026640 1 -- 172.21.15.55:0/2157186462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c414c140 con 0x7f03c415ca50 2023-08-25T04:19:45.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03ca026640 1 -- 172.21.15.55:0/2157186462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c414c330 con 0x7f03c415ca50 2023-08-25T04:19:45.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.097+0000 7f03b9ffb640 1 -- 172.21.15.55:0/2157186462 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f03bc00abf0 con 0x7f03c415ca50 2023-08-25T04:19:45.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.101+0000 7f03b9ffb640 1 --2- 172.21.15.55:0/2157186462 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f03a8065710 0x7f03a8067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.101+0000 7f03b9ffb640 1 -- 172.21.15.55:0/2157186462 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f03bc082b70 con 0x7f03c415ca50 2023-08-25T04:19:45.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.101+0000 7f03c9024640 1 --2- 172.21.15.55:0/2157186462 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f03a8065710 0x7f03a8067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:45.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.101+0000 7f03c9024640 1 --2- 172.21.15.55:0/2157186462 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f03a8065710 0x7f03a8067bd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f03c40c2b10 tx=0x7f03c0008040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:45.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.105+0000 7f03b9ffb640 1 -- 172.21.15.55:0/2157186462 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f03bc050670 con 0x7f03c415ca50 2023-08-25T04:19:45.199 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:45.196+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:45.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.289+0000 7f03ca026640 1 -- 172.21.15.55:0/2157186462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03c4073e50 con 0x7f03c415ca50 2023-08-25T04:19:45.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.289+0000 7f03b9ffb640 1 -- 172.21.15.55:0/2157186462 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f03bc053c90 con 0x7f03c415ca50 2023-08-25T04:19:45.291 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:45.291 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3111804785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3111804785},{"type":"v1","addr":"172.21.15.110:6836","nonce":3111804785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3444442085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3444442085},{"type":"v1","addr":"172.21.15.110:6837","nonce":3444442085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":7857,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2022633620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2022633620},{"type":"v1","addr":"172.21.15.55:6834","nonce":2022633620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:19:41.282901+0000","modified":"2023-08-25T04:19:44.912410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1173226599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1173226599},{"type":"v1","addr":"172.21.15.55:6835","nonce":1173226599}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-25T04:19:45.292 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 49 2023-08-25T04:19:45.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.293+0000 7f03ca026640 1 -- 172.21.15.55:0/2157186462 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f03a8065710 msgr2=0x7f03a8067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:45.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.293+0000 7f03ca026640 1 --2- 172.21.15.55:0/2157186462 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f03a8065710 0x7f03a8067bd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f03c40c2b10 tx=0x7f03c0008040 comp rx=0 tx=0).stop 2023-08-25T04:19:45.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.293+0000 7f03ca026640 1 -- 172.21.15.55:0/2157186462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c415ca50 msgr2=0x7f03c415bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:45.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.293+0000 7f03ca026640 1 --2- 172.21.15.55:0/2157186462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c415ca50 0x7f03c415bc70 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00c770 tx=0x7f03bc00cc30 comp rx=0 tx=0).stop 2023-08-25T04:19:45.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.293+0000 7f03ca026640 1 -- 172.21.15.55:0/2157186462 shutdown_connections 2023-08-25T04:19:45.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.293+0000 7f03ca026640 1 --2- 172.21.15.55:0/2157186462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03c415ca50 0x7f03c415bc70 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.293+0000 7f03ca026640 1 --2- 172.21.15.55:0/2157186462 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f03a8065710 0x7f03a8067bd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.293+0000 7f03ca026640 1 --2- 172.21.15.55:0/2157186462 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f03c40d0f50 0x7f03c414c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.293+0000 7f03ca026640 1 --2- 172.21.15.55:0/2157186462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f03c406c150 0x7f03c414cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.293+0000 7f03ca026640 1 -- 172.21.15.55:0/2157186462 >> 172.21.15.55:0/2157186462 conn(0x7f03c4065f40 msgr2=0x7f03c40ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:45.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.293+0000 7f03ca026640 1 -- 172.21.15.55:0/2157186462 shutdown_connections 2023-08-25T04:19:45.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.293+0000 7f03ca026640 1 -- 172.21.15.55:0/2157186462 wait complete. 2023-08-25T04:19:45.312 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:19:45.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.461+0000 7fbd75796640 1 Processor -- start 2023-08-25T04:19:45.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.461+0000 7fbd75796640 1 -- start start 2023-08-25T04:19:45.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.461+0000 7fbd75796640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd700cdde0 0x7fbd700ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.461+0000 7fbd75796640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd700b2e40 0x7fbd700b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.461+0000 7fbd75796640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd700b29b0 con 0x7fbd700d0da0 2023-08-25T04:19:45.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.461+0000 7fbd75796640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd700ce760 con 0x7fbd700cdde0 2023-08-25T04:19:45.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.461+0000 7fbd75796640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd700b1dc0 con 0x7fbd700b2e40 2023-08-25T04:19:45.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.461+0000 7fbd67fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd700cdde0 0x7fbd700ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:45.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.461+0000 7fbd67fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbd700cdde0 0x7fbd700ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:35466/0 (socket says 172.21.15.55:35466) 2023-08-25T04:19:45.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.461+0000 7fbd6effd640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbd700d0da0 0x7fbd700d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:43680/0 (socket says 172.21.15.55:43680) 2023-08-25T04:19:45.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.461+0000 7fbd67fff640 1 -- 172.21.15.55:0/3012068245 learned_addr learned my addr 172.21.15.55:0/3012068245 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:45.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.461+0000 7fbd6f7fe640 1 --2- 172.21.15.55:0/3012068245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd700b2e40 0x7fbd700b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:45.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.461+0000 7fbd67fff640 1 -- 172.21.15.55:0/3012068245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd700b2e40 msgr2=0x7fbd700b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:45.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.461+0000 7fbd67fff640 1 --2- 172.21.15.55:0/3012068245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd700b2e40 0x7fbd700b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.461+0000 7fbd67fff640 1 -- 172.21.15.55:0/3012068245 >> v1:172.21.15.110:6789/0 conn(0x7fbd700d0da0 legacy=0x7fbd700d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:45.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.461+0000 7fbd67fff640 1 -- 172.21.15.55:0/3012068245 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd700b2080 con 0x7fbd700cdde0 2023-08-25T04:19:45.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.461+0000 7fbd6f7fe640 1 --2- 172.21.15.55:0/3012068245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd700b2e40 0x7fbd700b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:45.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.465+0000 7fbd67fff640 1 --2- 172.21.15.55:0/3012068245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd700cdde0 0x7fbd700ce220 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009870 tx=0x7fbd5801ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=843ae4dfdc26da48 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:45.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.465+0000 7fbd6e7fc640 1 -- 172.21.15.55:0/3012068245 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd580a8a30 con 0x7fbd700cdde0 2023-08-25T04:19:45.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.465+0000 7fbd6e7fc640 1 -- 172.21.15.55:0/3012068245 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd580a8b90 con 0x7fbd700cdde0 2023-08-25T04:19:45.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.465+0000 7fbd6e7fc640 1 -- 172.21.15.55:0/3012068245 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd580b0440 con 0x7fbd700cdde0 2023-08-25T04:19:45.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.465+0000 7fbd75796640 1 -- 172.21.15.55:0/3012068245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd700cdde0 msgr2=0x7fbd700ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:45.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.465+0000 7fbd75796640 1 --2- 172.21.15.55:0/3012068245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd700cdde0 0x7fbd700ce220 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009870 tx=0x7fbd5801ed30 comp rx=0 tx=0).stop 2023-08-25T04:19:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.465+0000 7fbd75796640 1 -- 172.21.15.55:0/3012068245 shutdown_connections 2023-08-25T04:19:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.465+0000 7fbd75796640 1 --2- 172.21.15.55:0/3012068245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd700b2e40 0x7fbd700b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.465+0000 7fbd75796640 1 --2- 172.21.15.55:0/3012068245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd700cdde0 0x7fbd700ce220 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.465+0000 7fbd75796640 1 -- 172.21.15.55:0/3012068245 >> 172.21.15.55:0/3012068245 conn(0x7fbd7009bae0 msgr2=0x7fbd700d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:45.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.465+0000 7fbd75796640 1 -- 172.21.15.55:0/3012068245 shutdown_connections 2023-08-25T04:19:45.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.465+0000 7fbd75796640 1 -- 172.21.15.55:0/3012068245 wait complete. 2023-08-25T04:19:45.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd75796640 1 Processor -- start 2023-08-25T04:19:45.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd75796640 1 -- start start 2023-08-25T04:19:45.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd75796640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd700b2e40 0x7fbd700b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd75796640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd700cdde0 0x7fbd700c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd75796640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd700d0da0 0x7fbd700b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd75796640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd701f21d0 con 0x7fbd700b2e40 2023-08-25T04:19:45.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd75796640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd700cac90 con 0x7fbd700cdde0 2023-08-25T04:19:45.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd75796640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd700c9dd0 con 0x7fbd700d0da0 2023-08-25T04:19:45.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd6effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd700b2e40 0x7fbd700b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:45.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd6effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd700b2e40 0x7fbd700b7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58584/0 (socket says 172.21.15.55:58584) 2023-08-25T04:19:45.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd6effd640 1 -- 172.21.15.55:0/3156451603 learned_addr learned my addr 172.21.15.55:0/3156451603 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:45.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd67fff640 1 --2- 172.21.15.55:0/3156451603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd700cdde0 0x7fbd700c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:45.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd6f7fe640 1 --2- 172.21.15.55:0/3156451603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd700d0da0 0x7fbd700b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:45.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd6effd640 1 -- 172.21.15.55:0/3156451603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd700d0da0 msgr2=0x7fbd700b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:45.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd6effd640 1 --2- 172.21.15.55:0/3156451603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd700d0da0 0x7fbd700b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd6effd640 1 -- 172.21.15.55:0/3156451603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd700cdde0 msgr2=0x7fbd700c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:45.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd6effd640 1 --2- 172.21.15.55:0/3156451603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd700cdde0 0x7fbd700c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd6effd640 1 -- 172.21.15.55:0/3156451603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd68009a70 con 0x7fbd700b2e40 2023-08-25T04:19:45.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd6f7fe640 1 --2- 172.21.15.55:0/3156451603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd700d0da0 0x7fbd700b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:45.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd6effd640 1 --2- 172.21.15.55:0/3156451603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd700b2e40 0x7fbd700b7ef0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000c500 tx=0x7fbd6000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:45.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd677fe640 1 -- 172.21.15.55:0/3156451603 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd60005c80 con 0x7fbd700b2e40 2023-08-25T04:19:45.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd677fe640 1 -- 172.21.15.55:0/3156451603 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd60005de0 con 0x7fbd700b2e40 2023-08-25T04:19:45.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd75796640 1 -- 172.21.15.55:0/3156451603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd580094d0 con 0x7fbd700b2e40 2023-08-25T04:19:45.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd677fe640 1 -- 172.21.15.55:0/3156451603 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd600072f0 con 0x7fbd700b2e40 2023-08-25T04:19:45.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.469+0000 7fbd75796640 1 -- 172.21.15.55:0/3156451603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd700ca360 con 0x7fbd700b2e40 2023-08-25T04:19:45.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.473+0000 7fbd75796640 1 -- 172.21.15.55:0/3156451603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd700b2620 con 0x7fbd700b2e40 2023-08-25T04:19:45.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.473+0000 7fbd677fe640 1 -- 172.21.15.55:0/3156451603 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fbd60007450 con 0x7fbd700b2e40 2023-08-25T04:19:45.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.473+0000 7fbd677fe640 1 --2- 172.21.15.55:0/3156451603 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fbd50065710 0x7fbd50067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.473+0000 7fbd677fe640 1 -- 172.21.15.55:0/3156451603 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbd60082340 con 0x7fbd700b2e40 2023-08-25T04:19:45.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.473+0000 7fbd67fff640 1 --2- 172.21.15.55:0/3156451603 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fbd50065710 0x7fbd50067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:45.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.473+0000 7fbd67fff640 1 --2- 172.21.15.55:0/3156451603 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fbd50065710 0x7fbd50067bd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd580b2000 tx=0x7fbd58009040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:45.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.477+0000 7fbd677fe640 1 -- 172.21.15.55:0/3156451603 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbd700b2620 con 0x7fbd700b2e40 2023-08-25T04:19:45.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.645+0000 7fbd75796640 1 -- 172.21.15.55:0/3156451603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd700b2620 con 0x7fbd700b2e40 2023-08-25T04:19:45.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.645+0000 7fbd677fe640 1 -- 172.21.15.55:0/3156451603 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+18317 (secure 0 0 0) 0x7fbd700b2620 con 0x7fbd700b2e40 2023-08-25T04:19:45.645 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:45.646 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":106,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:19:42.877008+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:19:39.091781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-25T04:19:40.272091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:19:45.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.645+0000 7fbd75796640 1 -- 172.21.15.55:0/3156451603 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fbd50065710 msgr2=0x7fbd50067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:45.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.645+0000 7fbd75796640 1 --2- 172.21.15.55:0/3156451603 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fbd50065710 0x7fbd50067bd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd580b2000 tx=0x7fbd58009040 comp rx=0 tx=0).stop 2023-08-25T04:19:45.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.645+0000 7fbd75796640 1 -- 172.21.15.55:0/3156451603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd700b2e40 msgr2=0x7fbd700b7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:45.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.645+0000 7fbd75796640 1 --2- 172.21.15.55:0/3156451603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd700b2e40 0x7fbd700b7ef0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000c500 tx=0x7fbd6000c9c0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.645+0000 7fbd75796640 1 -- 172.21.15.55:0/3156451603 shutdown_connections 2023-08-25T04:19:45.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.645+0000 7fbd75796640 1 --2- 172.21.15.55:0/3156451603 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fbd50065710 0x7fbd50067bd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.645+0000 7fbd75796640 1 --2- 172.21.15.55:0/3156451603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbd700d0da0 0x7fbd700b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.645+0000 7fbd75796640 1 --2- 172.21.15.55:0/3156451603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbd700cdde0 0x7fbd700c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.645+0000 7fbd75796640 1 --2- 172.21.15.55:0/3156451603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd700b2e40 0x7fbd700b7ef0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.645+0000 7fbd75796640 1 -- 172.21.15.55:0/3156451603 >> 172.21.15.55:0/3156451603 conn(0x7fbd7009bae0 msgr2=0x7fbd7006b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:45.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.649+0000 7fbd75796640 1 -- 172.21.15.55:0/3156451603 shutdown_connections 2023-08-25T04:19:45.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.649+0000 7fbd75796640 1 -- 172.21.15.55:0/3156451603 wait complete. 2023-08-25T04:19:45.667 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-25T04:19:45.668 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:19:45.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc4613ba640 1 Processor -- start 2023-08-25T04:19:45.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc4613ba640 1 -- start start 2023-08-25T04:19:45.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc4613ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc45c0d0da0 0x7fc45c0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc4613ba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc45c0cdde0 0x7fc45c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc4613ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc45c0cee60 0x7fc45c0cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc4613ba640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45c0ce760 con 0x7fc45c0cdde0 2023-08-25T04:19:45.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc4613ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45c0b29b0 con 0x7fc45c0cee60 2023-08-25T04:19:45.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc4613ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c0d16c0 con 0x7fc45c0d0da0 2023-08-25T04:19:45.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc453fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc45c0cdde0 0x7fc45c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:45.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc453fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc45c0cdde0 0x7fc45c0ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58590/0 (socket says 172.21.15.55:58590) 2023-08-25T04:19:45.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc453fff640 1 -- 172.21.15.55:0/1642098718 learned_addr learned my addr 172.21.15.55:0/1642098718 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:45.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc45b7fe640 1 --2- 172.21.15.55:0/1642098718 >> v2:172.21.15.110:3300/0 conn(0x7fc45c0cee60 0x7fc45c0cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:45.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc45affd640 1 --2- 172.21.15.55:0/1642098718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc45c0d0da0 0x7fc45c0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:45.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc453fff640 1 -- 172.21.15.55:0/1642098718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc45c0d0da0 msgr2=0x7fc45c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:45.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc453fff640 1 --2- 172.21.15.55:0/1642098718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc45c0d0da0 0x7fc45c0d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc453fff640 1 -- 172.21.15.55:0/1642098718 >> v2:172.21.15.110:3300/0 conn(0x7fc45c0cee60 msgr2=0x7fc45c0cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:45.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc453fff640 1 --2- 172.21.15.55:0/1642098718 >> v2:172.21.15.110:3300/0 conn(0x7fc45c0cee60 0x7fc45c0cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc453fff640 1 -- 172.21.15.55:0/1642098718 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c0b1dc0 con 0x7fc45c0cdde0 2023-08-25T04:19:45.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc45affd640 1 --2- 172.21.15.55:0/1642098718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc45c0d0da0 0x7fc45c0d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:45.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.817+0000 7fc45b7fe640 1 --2- 172.21.15.55:0/1642098718 >> v2:172.21.15.110:3300/0 conn(0x7fc45c0cee60 0x7fc45c0cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:45.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.821+0000 7fc453fff640 1 --2- 172.21.15.55:0/1642098718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc45c0cdde0 0x7fc45c0ce220 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0b1bd0 tx=0x7fc44401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4cacff00b0cbf4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:45.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.821+0000 7fc45a7fc640 1 -- 172.21.15.55:0/1642098718 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4440a89b0 con 0x7fc45c0cdde0 2023-08-25T04:19:45.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.821+0000 7fc45a7fc640 1 -- 172.21.15.55:0/1642098718 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4440a8b10 con 0x7fc45c0cdde0 2023-08-25T04:19:45.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.821+0000 7fc45a7fc640 1 -- 172.21.15.55:0/1642098718 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4440a8ea0 con 0x7fc45c0cdde0 2023-08-25T04:19:45.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.821+0000 7fc4613ba640 1 -- 172.21.15.55:0/1642098718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc45c0cdde0 msgr2=0x7fc45c0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:45.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.821+0000 7fc4613ba640 1 --2- 172.21.15.55:0/1642098718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc45c0cdde0 0x7fc45c0ce220 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0b1bd0 tx=0x7fc44401ecf0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.821+0000 7fc4613ba640 1 -- 172.21.15.55:0/1642098718 shutdown_connections 2023-08-25T04:19:45.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.821+0000 7fc4613ba640 1 --2- 172.21.15.55:0/1642098718 >> v2:172.21.15.110:3300/0 conn(0x7fc45c0cee60 0x7fc45c0cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.821+0000 7fc4613ba640 1 --2- 172.21.15.55:0/1642098718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc45c0cdde0 0x7fc45c0ce220 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.821+0000 7fc4613ba640 1 --2- 172.21.15.55:0/1642098718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc45c0d0da0 0x7fc45c0d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.821+0000 7fc4613ba640 1 -- 172.21.15.55:0/1642098718 >> 172.21.15.55:0/1642098718 conn(0x7fc45c09bae0 msgr2=0x7fc45c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:45.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.821+0000 7fc4613ba640 1 -- 172.21.15.55:0/1642098718 shutdown_connections 2023-08-25T04:19:45.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.821+0000 7fc4613ba640 1 -- 172.21.15.55:0/1642098718 wait complete. 2023-08-25T04:19:45.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc4613ba640 1 Processor -- start 2023-08-25T04:19:45.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc4613ba640 1 -- start start 2023-08-25T04:19:45.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc4613ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc45c0cdde0 0x7fc45c0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc4613ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc45c0cee60 0x7fc45c0c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc4613ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc45c0d0da0 0x7fc45c1f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc4613ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c0cc050 con 0x7fc45c0cdde0 2023-08-25T04:19:45.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc4613ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c0c7c00 con 0x7fc45c0cee60 2023-08-25T04:19:45.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc4613ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c1f60c0 con 0x7fc45c0d0da0 2023-08-25T04:19:45.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc45affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc45c0cdde0 0x7fc45c0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:45.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc45affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc45c0cdde0 0x7fc45c0cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58600/0 (socket says 172.21.15.55:58600) 2023-08-25T04:19:45.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc45affd640 1 -- 172.21.15.55:0/1890903274 learned_addr learned my addr 172.21.15.55:0/1890903274 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:45.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc45affd640 1 -- 172.21.15.55:0/1890903274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc45c0d0da0 msgr2=0x7fc45c1f5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:45.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc45affd640 1 --2- 172.21.15.55:0/1890903274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc45c0d0da0 0x7fc45c1f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc45affd640 1 -- 172.21.15.55:0/1890903274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc45c0cee60 msgr2=0x7fc45c0c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:45.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc45affd640 1 --2- 172.21.15.55:0/1890903274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc45c0cee60 0x7fc45c0c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:45.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc45affd640 1 -- 172.21.15.55:0/1890903274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4440094d0 con 0x7fc45c0cdde0 2023-08-25T04:19:45.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc45affd640 1 --2- 172.21.15.55:0/1890903274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc45c0cdde0 0x7fc45c0cbb10 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00e7e0 tx=0x7fc44c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:45.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc4537fe640 1 -- 172.21.15.55:0/1890903274 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c0059a0 con 0x7fc45c0cdde0 2023-08-25T04:19:45.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc4537fe640 1 -- 172.21.15.55:0/1890903274 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c005b00 con 0x7fc45c0cdde0 2023-08-25T04:19:45.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc4613ba640 1 -- 172.21.15.55:0/1890903274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45c1f63a0 con 0x7fc45c0cdde0 2023-08-25T04:19:45.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc4537fe640 1 -- 172.21.15.55:0/1890903274 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c005e90 con 0x7fc45c0cdde0 2023-08-25T04:19:45.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc4613ba640 1 -- 172.21.15.55:0/1890903274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45c0c7890 con 0x7fc45c0cdde0 2023-08-25T04:19:45.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.825+0000 7fc4613ba640 1 -- 172.21.15.55:0/1890903274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45c04dbe0 con 0x7fc45c0cdde0 2023-08-25T04:19:45.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.829+0000 7fc4537fe640 1 -- 172.21.15.55:0/1890903274 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fc44c004030 con 0x7fc45c0cdde0 2023-08-25T04:19:45.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.829+0000 7fc4537fe640 1 --2- 172.21.15.55:0/1890903274 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fc43c065710 0x7fc43c067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:45.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.829+0000 7fc4537fe640 1 -- 172.21.15.55:0/1890903274 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc44c082fc0 con 0x7fc45c0cdde0 2023-08-25T04:19:45.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.829+0000 7fc453fff640 1 --2- 172.21.15.55:0/1890903274 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fc43c065710 0x7fc43c067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:45.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.829+0000 7fc453fff640 1 --2- 172.21.15.55:0/1890903274 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fc43c065710 0x7fc43c067bd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc4440b2000 tx=0x7fc444004740 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:45.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.833+0000 7fc4537fe640 1 -- 172.21.15.55:0/1890903274 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc44c054390 con 0x7fc45c0cdde0 2023-08-25T04:19:45.973 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:45.968+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:45.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:45.993+0000 7fc4613ba640 1 -- 172.21.15.55:0/1890903274 --> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc45c0b2360 con 0x7fc43c065710 2023-08-25T04:19:46.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.001+0000 7fc4537fe640 1 -- 172.21.15.55:0/1890903274 <== mgr.7111 v2:172.21.15.110:6832/1337211678 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299649 (secure 0 0 0) 0x7fc4440a8890 con 0x7fc43c065710 2023-08-25T04:19:46.005 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:46.006 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:19:46.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.005+0000 7fc4613ba640 1 -- 172.21.15.55:0/1890903274 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fc43c065710 msgr2=0x7fc43c067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:46.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.005+0000 7fc4613ba640 1 --2- 172.21.15.55:0/1890903274 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fc43c065710 0x7fc43c067bd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc4440b2000 tx=0x7fc444004740 comp rx=0 tx=0).stop 2023-08-25T04:19:46.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.005+0000 7fc4613ba640 1 -- 172.21.15.55:0/1890903274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc45c0cdde0 msgr2=0x7fc45c0cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:46.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.005+0000 7fc4613ba640 1 --2- 172.21.15.55:0/1890903274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc45c0cdde0 0x7fc45c0cbb10 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00e7e0 tx=0x7fc44c00eca0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.005+0000 7fc4613ba640 1 -- 172.21.15.55:0/1890903274 shutdown_connections 2023-08-25T04:19:46.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.005+0000 7fc4613ba640 1 --2- 172.21.15.55:0/1890903274 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fc43c065710 0x7fc43c067bd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.005+0000 7fc4613ba640 1 --2- 172.21.15.55:0/1890903274 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc45c0d0da0 0x7fc45c1f5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.005+0000 7fc4613ba640 1 --2- 172.21.15.55:0/1890903274 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc45c0cee60 0x7fc45c0c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.005+0000 7fc4613ba640 1 --2- 172.21.15.55:0/1890903274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc45c0cdde0 0x7fc45c0cbb10 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.005+0000 7fc4613ba640 1 -- 172.21.15.55:0/1890903274 >> 172.21.15.55:0/1890903274 conn(0x7fc45c09bae0 msgr2=0x7fc45c0b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:46.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.005+0000 7fc4613ba640 1 -- 172.21.15.55:0/1890903274 shutdown_connections 2023-08-25T04:19:46.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.005+0000 7fc4613ba640 1 -- 172.21.15.55:0/1890903274 wait complete. 2023-08-25T04:19:46.025 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-25T04:19:44.460381+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":743,"num_read_kb":1508,"num_write":285,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2161,"ondisk_log_size":2161,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329776,"kb_used_data":10948,"kb_used_omap":13,"kb_used_meta":318706,"kb_avail":754644944,"statfs":{"total":773094113280,"available":772756422656,"internally_reserved":0,"allocated":11210752,"data_stored":6124754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":326355032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.594148"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.868714+0000","last_change":"2023-08-25T04:19:39.868714+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.868714+0000","last_undegraded":"2023-08-25T04:19:39.868714+0000","last_fullsized":"2023-08-25T04:19:39.868714+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.868549+0000","last_change":"2023-08-25T04:19:39.868549+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.868549+0000","last_undegraded":"2023-08-25T04:19:39.868549+0000","last_fullsized":"2023-08-25T04:19:39.868549+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.871642+0000","last_change":"2023-08-25T04:19:39.871642+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.871642+0000","last_undegraded":"2023-08-25T04:19:39.871642+0000","last_fullsized":"2023-08-25T04:19:39.871642+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.869750+0000","last_change":"2023-08-25T04:19:39.869750+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.869750+0000","last_undegraded":"2023-08-25T04:19:39.869750+0000","last_fullsized":"2023-08-25T04:19:39.869750+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.868055+0000","last_change":"2023-08-25T04:19:39.868055+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.868055+0000","last_undegraded":"2023-08-25T04:19:39.868055+0000","last_fullsized":"2023-08-25T04:19:39.868055+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.871208+0000","last_change":"2023-08-25T04:19:39.871208+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.871208+0000","last_undegraded":"2023-08-25T04:19:39.871208+0000","last_fullsized":"2023-08-25T04:19:39.871208+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.877491+0000","last_change":"2023-08-25T04:19:39.877491+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.877491+0000","last_undegraded":"2023-08-25T04:19:39.877491+0000","last_fullsized":"2023-08-25T04:19:39.877491+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.871611+0000","last_change":"2023-08-25T04:19:39.871611+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.871611+0000","last_undegraded":"2023-08-25T04:19:39.871611+0000","last_fullsized":"2023-08-25T04:19:39.871611+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.872416+0000","last_change":"2023-08-25T04:19:39.872416+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.872416+0000","last_undegraded":"2023-08-25T04:19:39.872416+0000","last_fullsized":"2023-08-25T04:19:39.872416+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.877526+0000","last_change":"2023-08-25T04:19:39.877526+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.877526+0000","last_undegraded":"2023-08-25T04:19:39.877526+0000","last_fullsized":"2023-08-25T04:19:39.877526+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.869703+0000","last_change":"2023-08-25T04:19:39.869703+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.869703+0000","last_undegraded":"2023-08-25T04:19:39.869703+0000","last_fullsized":"2023-08-25T04:19:39.869703+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.874490+0000","last_change":"2023-08-25T04:19:39.874490+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.874490+0000","last_undegraded":"2023-08-25T04:19:39.874490+0000","last_fullsized":"2023-08-25T04:19:39.874490+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.871629+0000","last_change":"2023-08-25T04:19:39.871629+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.871629+0000","last_undegraded":"2023-08-25T04:19:39.871629+0000","last_fullsized":"2023-08-25T04:19:39.871629+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.874386+0000","last_change":"2023-08-25T04:19:39.874386+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.874386+0000","last_undegraded":"2023-08-25T04:19:39.874386+0000","last_fullsized":"2023-08-25T04:19:39.874386+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.871079+0000","last_change":"2023-08-25T04:19:39.871079+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.871079+0000","last_undegraded":"2023-08-25T04:19:39.871079+0000","last_fullsized":"2023-08-25T04:19:39.871079+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.871143+0000","last_change":"2023-08-25T04:19:39.871143+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.871143+0000","last_undegraded":"2023-08-25T04:19:39.871143+0000","last_fullsized":"2023-08-25T04:19:39.871143+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.871810+0000","last_change":"2023-08-25T04:19:39.871810+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.871810+0000","last_undegraded":"2023-08-25T04:19:39.871810+0000","last_fullsized":"2023-08-25T04:19:39.871810+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.868056+0000","last_change":"2023-08-25T04:19:39.868056+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.868056+0000","last_undegraded":"2023-08-25T04:19:39.868056+0000","last_fullsized":"2023-08-25T04:19:39.868056+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.868863+0000","last_change":"2023-08-25T04:19:39.868863+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.868863+0000","last_undegraded":"2023-08-25T04:19:39.868863+0000","last_fullsized":"2023-08-25T04:19:39.868863+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.868222+0000","last_change":"2023-08-25T04:19:39.868222+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.868222+0000","last_undegraded":"2023-08-25T04:19:39.868222+0000","last_fullsized":"2023-08-25T04:19:39.868222+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.874401+0000","last_change":"2023-08-25T04:19:39.874401+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.874401+0000","last_undegraded":"2023-08-25T04:19:39.874401+0000","last_fullsized":"2023-08-25T04:19:39.874401+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.872952+0000","last_change":"2023-08-25T04:19:39.872952+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.872952+0000","last_undegraded":"2023-08-25T04:19:39.872952+0000","last_fullsized":"2023-08-25T04:19:39.872952+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.868193+0000","last_change":"2023-08-25T04:19:39.868193+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.868193+0000","last_undegraded":"2023-08-25T04:19:39.868193+0000","last_fullsized":"2023-08-25T04:19:39.868193+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.872525+0000","last_change":"2023-08-25T04:19:39.872525+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.872525+0000","last_undegraded":"2023-08-25T04:19:39.872525+0000","last_fullsized":"2023-08-25T04:19:39.872525+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.871034+0000","last_change":"2023-08-25T04:19:39.871034+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.871034+0000","last_undegraded":"2023-08-25T04:19:39.871034+0000","last_fullsized":"2023-08-25T04:19:39.871034+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"103'2161","reported_seq":2555,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-25T04:19:40.454024+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:19:40.454024+0000","last_peered":"2023-08-25T04:19:40.454024+0000","last_clean":"2023-08-25T04:19:40.454024+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:19:40.454024+0000","last_undegraded":"2023-08-25T04:19:40.454024+0000","last_fullsized":"2023-08-25T04:19:40.454024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":2161,"log_dups_size":0,"ondisk_log_size":2161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:11:20.538146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":743,"num_read_kb":1508,"num_write":285,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":155,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-25T04:19:39.873595+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:19:39.873595+0000","last_peered":"2023-08-25T04:19:39.873595+0000","last_clean":"2023-08-25T04:19:39.873595+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:19:39.873595+0000","last_undegraded":"2023-08-25T04:19:39.873595+0000","last_fullsized":"2023-08-25T04:19:39.873595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:51:52.898181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.869263+0000","last_change":"2023-08-25T04:19:39.869263+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.869263+0000","last_undegraded":"2023-08-25T04:19:39.869263+0000","last_fullsized":"2023-08-25T04:19:39.869263+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-25T04:19:39.873241+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:19:39.873241+0000","last_peered":"2023-08-25T04:19:39.873241+0000","last_clean":"2023-08-25T04:19:39.873241+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:19:39.873241+0000","last_undegraded":"2023-08-25T04:19:39.873241+0000","last_fullsized":"2023-08-25T04:19:39.873241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:42:03.452558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.871769+0000","last_change":"2023-08-25T04:19:39.871769+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.871769+0000","last_undegraded":"2023-08-25T04:19:39.871769+0000","last_fullsized":"2023-08-25T04:19:39.871769+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":159,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-25T04:19:39.873408+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:19:39.873408+0000","last_peered":"2023-08-25T04:19:39.873408+0000","last_clean":"2023-08-25T04:19:39.873408+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:19:39.873408+0000","last_undegraded":"2023-08-25T04:19:39.873408+0000","last_fullsized":"2023-08-25T04:19:39.873408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:11:14.092952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.869321+0000","last_change":"2023-08-25T04:19:39.869321+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.869321+0000","last_undegraded":"2023-08-25T04:19:39.869321+0000","last_fullsized":"2023-08-25T04:19:39.869321+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":155,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-25T04:19:39.873776+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:19:39.873776+0000","last_peered":"2023-08-25T04:19:39.873776+0000","last_clean":"2023-08-25T04:19:39.873776+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:19:39.873776+0000","last_undegraded":"2023-08-25T04:19:39.873776+0000","last_fullsized":"2023-08-25T04:19:39.873776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:13:25.975850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.872863+0000","last_change":"2023-08-25T04:19:39.872863+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.872863+0000","last_undegraded":"2023-08-25T04:19:39.872863+0000","last_fullsized":"2023-08-25T04:19:39.872863+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-25T04:19:39.869935+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:19:39.869935+0000","last_peered":"2023-08-25T04:19:39.869935+0000","last_clean":"2023-08-25T04:19:39.869935+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:19:39.869935+0000","last_undegraded":"2023-08-25T04:19:39.869935+0000","last_fullsized":"2023-08-25T04:19:39.869935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:06:51.750933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.872807+0000","last_change":"2023-08-25T04:19:39.872807+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.872807+0000","last_undegraded":"2023-08-25T04:19:39.872807+0000","last_fullsized":"2023-08-25T04:19:39.872807+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":156,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-25T04:19:39.873597+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:19:39.873597+0000","last_peered":"2023-08-25T04:19:39.873597+0000","last_clean":"2023-08-25T04:19:39.873597+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:19:39.873597+0000","last_undegraded":"2023-08-25T04:19:39.873597+0000","last_fullsized":"2023-08-25T04:19:39.873597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:58:58.766185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.872422+0000","last_change":"2023-08-25T04:19:39.872422+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.872422+0000","last_undegraded":"2023-08-25T04:19:39.872422+0000","last_fullsized":"2023-08-25T04:19:39.872422+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-25T04:19:39.869938+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:19:39.869938+0000","last_peered":"2023-08-25T04:19:39.869938+0000","last_clean":"2023-08-25T04:19:39.869938+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:19:39.869938+0000","last_undegraded":"2023-08-25T04:19:39.869938+0000","last_fullsized":"2023-08-25T04:19:39.869938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:55:53.976713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.872757+0000","last_change":"2023-08-25T04:19:39.872757+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.872757+0000","last_undegraded":"2023-08-25T04:19:39.872757+0000","last_fullsized":"2023-08-25T04:19:39.872757+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-25T04:19:39.869512+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:19:39.869512+0000","last_peered":"2023-08-25T04:19:39.869512+0000","last_clean":"2023-08-25T04:19:39.869512+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:19:39.869512+0000","last_undegraded":"2023-08-25T04:19:39.869512+0000","last_fullsized":"2023-08-25T04:19:39.869512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:25:19.409440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":743,"num_read_kb":1508,"num_write":285,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2161,"ondisk_log_size":2161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509643,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55196,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316644,"statfs":{"total":96636764160,"available":96580243456,"internally_reserved":0,"allocated":1851392,"data_stored":1210684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.69199999999999995,"15min":0.70699999999999996},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.33700000000000002},"max":{"1min":0.85199999999999998,"5min":0.996,"15min":0.996},"last":0.502},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70799999999999996,"15min":0.72299999999999998},"min":{"1min":0.51500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.92400000000000004,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.51400000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.42699999999999999},"max":{"1min":0.92100000000000004,"5min":0.95699999999999996,"15min":1.034},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.44700000000000001,"15min":0.374},"max":{"1min":0.995,"5min":0.995,"15min":1.036},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70399999999999996,"15min":0.71599999999999997},"min":{"1min":0.52400000000000002,"5min":0.42299999999999999,"15min":0.34899999999999998},"max":{"1min":0.84199999999999997,"5min":0.94499999999999995,"15min":1.018},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71799999999999997,"15min":0.747},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.57299999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.54400000000000004,"5min":0.47799999999999998,"15min":0.41899999999999998},"max":{"1min":0.877,"5min":0.92900000000000005,"15min":0.98399999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.432},"max":{"1min":0.90900000000000003,"5min":1.04,"15min":1.04},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.81599999999999995,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.441,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47699999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.86099999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.40000000000000002},"max":{"1min":0.83599999999999997,"5min":1.032,"15min":1.0349999999999999},"last":0.45400000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.53000000000000003,"5min":0.46700000000000003,"15min":0.436},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66100000000000003,"15min":0.66200000000000003},"min":{"1min":0.46999999999999997,"5min":0.42699999999999999,"15min":0.42399999999999999},"max":{"1min":0.94399999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.55100000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509643,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36572,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335268,"statfs":{"total":96636764160,"available":96599314432,"internally_reserved":0,"allocated":1257472,"data_stored":620316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66800000000000004,"15min":0.70399999999999996},"min":{"1min":0.34999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97099999999999997,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67700000000000005,"15min":0.69599999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95999999999999996,"5min":0.96899999999999997,"15min":1.054},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.69899999999999995,"15min":0.72999999999999998},"min":{"1min":0.41599999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.93600000000000005,"5min":1.0269999999999999,"15min":1.0369999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.72799999999999998},"min":{"1min":0.50700000000000001,"5min":0.495,"15min":0.47199999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70699999999999996,"15min":0.73599999999999999},"min":{"1min":0.48999999999999999,"5min":0.44,"15min":0.434},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.1020000000000001},"last":0.434},{"interface":"front","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0169999999999999,"5min":1.0569999999999999,"15min":1.117},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.745,"15min":0.747},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.46899999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.76000000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49199999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.36499999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.40500000000000003,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.0820000000000001},"last":0.47399999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66800000000000004,"15min":0.65200000000000002},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.1220000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.442},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.745,"15min":0.73399999999999999},"min":{"1min":0.55500000000000005,"5min":0.443,"15min":0.40000000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.67200000000000004,"15min":0.66200000000000003},"min":{"1min":0.441,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.1950000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73199999999999998,"15min":0.70299999999999996},"min":{"1min":0.50600000000000001,"5min":0.45200000000000001,"15min":0.41799999999999998},"max":{"1min":1.1359999999999999,"5min":1.373,"15min":1.373},"last":0.58399999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542346,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1245184,"data_stored":614146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66900000000000004,"15min":0.70899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.018},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68899999999999995,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81999999999999995,"5min":0.97999999999999998,"15min":1.0409999999999999},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.69899999999999995,"15min":0.72999999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.36499999999999999},"max":{"1min":0.78000000000000003,"5min":0.95299999999999996,"15min":0.99399999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71499999999999997,"15min":0.73799999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90400000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68000000000000005,"15min":0.72599999999999998},"min":{"1min":0.44800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83999999999999997,"5min":0.92800000000000005,"15min":0.97499999999999998},"last":0.435},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92600000000000005,"5min":0.98499999999999999,"15min":1.0449999999999999},"last":0.51700000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.70999999999999996,"15min":0.73099999999999998},"min":{"1min":0.52600000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86499999999999999,"5min":0.93500000000000005,"15min":0.96999999999999997},"last":0.503},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72499999999999998,"15min":0.76500000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.55200000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.40999999999999998,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.91000000000000003,"5min":0.92900000000000005,"15min":0.97099999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.86499999999999999,"5min":1.018,"15min":1.018},"last":0.38}]},{"osd":6,"last update":"Fri Aug 25 04:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.47399999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.008},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.878,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.46899999999999997}]},{"osd":7,"last update":"Fri Aug 25 04:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.622,"15min":0.62},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.89300000000000002,"5min":1.002,"15min":1.032},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68899999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.96899999999999997,"15min":1.048},"last":0.61599999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542346,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36568,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335272,"statfs":{"total":96636764160,"available":96599318528,"internally_reserved":0,"allocated":1257472,"data_stored":620316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.67800000000000005,"15min":0.70099999999999996},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.84299999999999997,"5min":0.97399999999999998,"15min":0.99299999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68600000000000005,"15min":0.70099999999999996},"min":{"1min":0.48599999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.96699999999999997},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.49399999999999999,"5min":0.45100000000000001,"15min":0.36199999999999999},"max":{"1min":0.85699999999999998,"5min":0.98399999999999999,"15min":1.0449999999999999},"last":0.437},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70399999999999996,"15min":0.73499999999999999},"min":{"1min":0.44,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.872,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.39400000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39100000000000001},"max":{"1min":0.879,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":0.91600000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.52900000000000003,"5min":0.51300000000000001,"15min":0.45100000000000001},"max":{"1min":0.90200000000000002,"5min":0.98299999999999998,"15min":1.048},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.72999999999999998,"15min":0.752},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80700000000000005,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.498}]},{"osd":5,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.59099999999999997},"min":{"1min":0.42599999999999999,"5min":0.376,"15min":0.33200000000000002},"max":{"1min":0.91400000000000003,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.36799999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.745,"15min":0.73499999999999999},"min":{"1min":0.496,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.96299999999999997,"5min":1.093,"15min":1.093},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65300000000000002,"15min":0.64000000000000001},"min":{"1min":0.48299999999999998,"5min":0.42299999999999999,"15min":0.40300000000000002},"max":{"1min":0.85999999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.33900000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.36699999999999999},"max":{"1min":0.84899999999999998,"5min":0.90100000000000002,"15min":0.94499999999999995},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.60299999999999998,"5min":0.48099999999999998,"15min":0.39300000000000002},"max":{"1min":0.94299999999999995,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.54000000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542346,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36568,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335272,"statfs":{"total":96636764160,"available":96599318528,"internally_reserved":0,"allocated":1257472,"data_stored":620316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.439,"15min":0.45000000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27300000000000002},"max":{"1min":0.70199999999999996,"5min":0.93700000000000006,"15min":0.96899999999999997},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51100000000000001,"15min":0.52200000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66200000000000003,"5min":0.77100000000000002,"15min":0.91500000000000004},"last":0.59299999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.49199999999999999,"15min":0.5},"min":{"1min":0.34000000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.42199999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.748,"5min":0.80300000000000005,"15min":0.92600000000000005},"last":0.438}]},{"osd":2,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55500000000000005,"15min":0.57199999999999995},"min":{"1min":0.38700000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":0.85499999999999998,"15min":1.01},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.54500000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.70799999999999996,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.752,"15min":0.75600000000000001},"min":{"1min":0.56399999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0209999999999999,"5min":1.214,"15min":1.214},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.57899999999999996,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0760000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.52900000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0349999999999999,"5min":1.254,"15min":1.254},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.78600000000000003},"min":{"1min":0.53700000000000003,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":0.99099999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.59499999999999997,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":1.119,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77700000000000002,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.51600000000000001,"15min":0.50700000000000001},"max":{"1min":0.94699999999999995,"5min":1.0800000000000001,"15min":1.177},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79100000000000004,"15min":0.82599999999999996},"min":{"1min":0.57199999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.96899999999999997,"5min":1.077,"15min":1.194},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.79400000000000004,"15min":0.79700000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0049999999999999,"5min":1.079,"15min":1.1160000000000001},"last":0.51600000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542347,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54608,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317232,"statfs":{"total":96636764160,"available":96580845568,"internally_reserved":0,"allocated":1245184,"data_stored":614146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.28799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59699999999999998,"5min":0.85599999999999998,"15min":0.92000000000000004},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.47899999999999998,"15min":0.495},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.61899999999999999,"5min":0.81000000000000005,"15min":0.93100000000000005},"last":0.29799999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.61299999999999999,"5min":0.78800000000000003,"15min":0.85499999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.57199999999999995,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.56699999999999995,"5min":0.81699999999999995,"15min":0.89800000000000002},"last":0.65500000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.51800000000000002,"15min":0.53200000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":0.65700000000000003,"5min":0.82199999999999995,"15min":0.82299999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59099999999999997,"5min":0.85399999999999998,"15min":0.89400000000000002},"last":0.623}]},{"osd":4,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.77600000000000002,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.502,"15min":0.502},"max":{"1min":0.82199999999999995,"5min":1.1990000000000001,"15min":1.2569999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.52000000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89400000000000002,"5min":1.151,"15min":1.5509999999999999},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.77900000000000003,"15min":0.79900000000000004},"min":{"1min":0.53000000000000003,"5min":0.52600000000000002,"15min":0.498},"max":{"1min":0.93700000000000006,"5min":1.1080000000000001,"15min":1.2789999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77700000000000002,"15min":0.80400000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.48299999999999998},"max":{"1min":0.86799999999999999,"5min":1.2130000000000001,"15min":1.3089999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.78200000000000003,"15min":0.82099999999999995},"min":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.82799999999999996,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.84999999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.90200000000000002,"5min":1.25,"15min":1.375},"last":0.60599999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.77600000000000002,"15min":0.79800000000000004},"min":{"1min":0.54200000000000004,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":0.878,"5min":1.0860000000000001,"15min":1.339},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.77900000000000003,"15min":0.80500000000000005},"min":{"1min":0.57099999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.80600000000000005,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.54300000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542347,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36568,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335272,"statfs":{"total":96636764160,"available":96599318528,"internally_reserved":0,"allocated":1257472,"data_stored":620316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.27400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.96899999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.54400000000000004,"15min":0.52200000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67400000000000004,"5min":1.212,"15min":1.212},"last":0.438}]},{"osd":2,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.30499999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79200000000000004,"5min":0.876,"15min":0.876},"last":0.628},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.36299999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83199999999999996,"5min":0.877,"15min":1.02},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.59899999999999998,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71699999999999997,"5min":0.93100000000000005,"15min":1.018},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74099999999999999,"5min":1.165,"15min":1.165},"last":0.502}]},{"osd":4,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.747,"15min":0.76900000000000002},"min":{"1min":0.48899999999999999,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":1.012,"5min":1.204,"15min":1.204},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78900000000000003,"15min":0.80400000000000005},"min":{"1min":0.53900000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.753,"15min":0.78400000000000003},"min":{"1min":0.496,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96899999999999997,"5min":1.254,"15min":1.254},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.77900000000000003,"15min":0.80300000000000005},"min":{"1min":0.54700000000000004,"5min":0.51400000000000001,"15min":0.51000000000000001},"max":{"1min":0.97999999999999998,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.45700000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.97599999999999998,"5min":1.623,"15min":1.623},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93700000000000006,"5min":1.288,"15min":1.288},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77900000000000003,"15min":0.80700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.99199999999999999,"5min":1.1240000000000001,"15min":1.2949999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.60899999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1,"5min":1.1140000000000001,"15min":1.3120000000000001},"last":0.59299999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542346,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41296,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330544,"statfs":{"total":96636764160,"available":96594477056,"internally_reserved":0,"allocated":1839104,"data_stored":1204514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36099999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63,"5min":0.72499999999999998,"15min":0.79500000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.55200000000000005,"15min":0.56499999999999995},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.502,"15min":0.52000000000000002},"min":{"1min":0.32800000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.97499999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.51700000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48699999999999999,"15min":0.499},"min":{"1min":0.30499999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.85099999999999998,"15min":1.2470000000000001},"last":0.54200000000000004}]},{"osd":4,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79300000000000004,"15min":0.79500000000000004},"min":{"1min":0.55900000000000005,"5min":0.52600000000000002,"15min":0.503},"max":{"1min":0.95599999999999996,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":1.2},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.79200000000000004,"15min":0.80600000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.436},"max":{"1min":0.86799999999999999,"5min":1.169,"15min":1.234},"last":0.626}]},{"osd":5,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.52800000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.97799999999999998,"5min":3.528,"15min":3.528},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.56399999999999995,"5min":0.47199999999999998,"15min":0.45500000000000002},"max":{"1min":1.0680000000000001,"5min":1.121,"15min":1.2230000000000001},"last":1.244}]},{"osd":6,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.80100000000000005,"15min":0.80000000000000004},"min":{"1min":0.56699999999999995,"5min":0.54400000000000004,"15min":0.53700000000000003},"max":{"1min":0.89200000000000002,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.82099999999999995,"15min":0.82999999999999996},"min":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.502},"max":{"1min":1.0349999999999999,"5min":1.1870000000000001,"15min":1.194},"last":1.3180000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82499999999999996,"15min":0.84299999999999997},"min":{"1min":0.59699999999999998,"5min":0.56399999999999995,"15min":0.52900000000000003},"max":{"1min":1.101,"5min":1.151,"15min":1.2849999999999999},"last":1.28},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96999999999999997,"5min":1.1220000000000001,"15min":1.1930000000000001},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:19:46.033 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:19:46.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.213+0000 7fed38ad8640 1 Processor -- start 2023-08-25T04:19:46.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.213+0000 7fed38ad8640 1 -- start start 2023-08-25T04:19:46.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.213+0000 7fed38ad8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed340d0da0 0x7fed340d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:46.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.213+0000 7fed38ad8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed340b29b0 con 0x7fed340cdde0 2023-08-25T04:19:46.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.213+0000 7fed38ad8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed340cfc80 con 0x7fed340b3e50 2023-08-25T04:19:46.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.213+0000 7fed38ad8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed340d16c0 con 0x7fed340d0da0 2023-08-25T04:19:46.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.213+0000 7fed31d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fed340cdde0 0x7fed340cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43890/0 (socket says 172.21.15.55:43890) 2023-08-25T04:19:46.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.213+0000 7fed31d9b640 1 -- 172.21.15.55:0/2454658600 learned_addr learned my addr 172.21.15.55:0/2454658600 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:46.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.213+0000 7fed3259c640 1 --2- 172.21.15.55:0/2454658600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed340d0da0 0x7fed340d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:46.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.213+0000 7fed3159a640 1 -- 172.21.15.55:0/2454658600 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734855764 0 0) 0x7fed340b29b0 con 0x7fed340cdde0 2023-08-25T04:19:46.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.213+0000 7fed3159a640 1 -- 172.21.15.55:0/2454658600 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed1c003530 con 0x7fed340cdde0 2023-08-25T04:19:46.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.213+0000 7fed3159a640 1 -- 172.21.15.55:0/2454658600 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787910013 0 0) 0x7fed340cfc80 con 0x7fed340b3e50 2023-08-25T04:19:46.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.213+0000 7fed3159a640 1 -- 172.21.15.55:0/2454658600 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed340b29b0 con 0x7fed340b3e50 2023-08-25T04:19:46.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.213+0000 7fed3259c640 1 -- 172.21.15.55:0/2454658600 >> v1:172.21.15.110:6789/0 conn(0x7fed340b3e50 legacy=0x7fed340cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:46.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.213+0000 7fed3259c640 1 -- 172.21.15.55:0/2454658600 >> v1:172.21.15.55:6789/0 conn(0x7fed340cdde0 legacy=0x7fed340cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:46.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.213+0000 7fed3259c640 1 -- 172.21.15.55:0/2454658600 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed340b1dc0 con 0x7fed340d0da0 2023-08-25T04:19:46.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.217+0000 7fed3259c640 1 --2- 172.21.15.55:0/2454658600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed340d0da0 0x7fed340d1180 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fed240097d0 tx=0x7fed2401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a5e937f04d0fc69 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:46.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.217+0000 7fed3159a640 1 -- 172.21.15.55:0/2454658600 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240a8990 con 0x7fed340d0da0 2023-08-25T04:19:46.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.217+0000 7fed3159a640 1 -- 172.21.15.55:0/2454658600 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed240a8af0 con 0x7fed340d0da0 2023-08-25T04:19:46.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.217+0000 7fed3159a640 1 -- 172.21.15.55:0/2454658600 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240a8e80 con 0x7fed340d0da0 2023-08-25T04:19:46.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.217+0000 7fed38ad8640 1 -- 172.21.15.55:0/2454658600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed340d0da0 msgr2=0x7fed340d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:46.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.217+0000 7fed38ad8640 1 --2- 172.21.15.55:0/2454658600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed340d0da0 0x7fed340d1180 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fed240097d0 tx=0x7fed2401ec90 comp rx=0 tx=0).stop 2023-08-25T04:19:46.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.217+0000 7fed38ad8640 1 -- 172.21.15.55:0/2454658600 shutdown_connections 2023-08-25T04:19:46.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.217+0000 7fed38ad8640 1 --2- 172.21.15.55:0/2454658600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed340d0da0 0x7fed340d1180 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.217+0000 7fed38ad8640 1 -- 172.21.15.55:0/2454658600 >> 172.21.15.55:0/2454658600 conn(0x7fed3409bae0 msgr2=0x7fed340d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:46.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.217+0000 7fed38ad8640 1 -- 172.21.15.55:0/2454658600 shutdown_connections 2023-08-25T04:19:46.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.217+0000 7fed38ad8640 1 -- 172.21.15.55:0/2454658600 wait complete. 2023-08-25T04:19:46.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed38ad8640 1 Processor -- start 2023-08-25T04:19:46.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed38ad8640 1 -- start start 2023-08-25T04:19:46.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed38ad8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed340b3e50 0x7fed3415ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:46.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed38ad8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed340cdde0 0x7fed341f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:46.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed38ad8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed340d0da0 0x7fed340af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:46.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed38ad8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed340afb20 con 0x7fed340d0da0 2023-08-25T04:19:46.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed38ad8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed340afe00 con 0x7fed340cdde0 2023-08-25T04:19:46.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed38ad8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed340b00e0 con 0x7fed340b3e50 2023-08-25T04:19:46.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed31d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed340cdde0 0x7fed341f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:46.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed32d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed340d0da0 0x7fed340af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:46.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed3259c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed340b3e50 0x7fed3415ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:46.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed3259c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed340b3e50 0x7fed3415ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:52648/0 (socket says 172.21.15.55:52648) 2023-08-25T04:19:46.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed3259c640 1 -- 172.21.15.55:0/3813406914 learned_addr learned my addr 172.21.15.55:0/3813406914 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:46.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed32d9d640 1 -- 172.21.15.55:0/3813406914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed340b3e50 msgr2=0x7fed3415ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:46.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed32d9d640 1 --2- 172.21.15.55:0/3813406914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed340b3e50 0x7fed3415ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed32d9d640 1 -- 172.21.15.55:0/3813406914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed340cdde0 msgr2=0x7fed341f2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:46.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed32d9d640 1 --2- 172.21.15.55:0/3813406914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed340cdde0 0x7fed341f2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed32d9d640 1 -- 172.21.15.55:0/3813406914 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed240093b0 con 0x7fed340d0da0 2023-08-25T04:19:46.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.221+0000 7fed3259c640 1 --2- 172.21.15.55:0/3813406914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed340b3e50 0x7fed3415ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:46.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.225+0000 7fed32d9d640 1 --2- 172.21.15.55:0/3813406914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed340d0da0 0x7fed340af420 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fed340b4280 tx=0x7fed2c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:46.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.225+0000 7fed22ffd640 1 -- 172.21.15.55:0/3813406914 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c006d60 con 0x7fed340d0da0 2023-08-25T04:19:46.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.225+0000 7fed22ffd640 1 -- 172.21.15.55:0/3813406914 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2c005020 con 0x7fed340d0da0 2023-08-25T04:19:46.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.225+0000 7fed22ffd640 1 -- 172.21.15.55:0/3813406914 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2c005430 con 0x7fed340d0da0 2023-08-25T04:19:46.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.225+0000 7fed38ad8640 1 -- 172.21.15.55:0/3813406914 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3415e870 con 0x7fed340d0da0 2023-08-25T04:19:46.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.225+0000 7fed38ad8640 1 -- 172.21.15.55:0/3813406914 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed34155b50 con 0x7fed340d0da0 2023-08-25T04:19:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.225+0000 7fed38ad8640 1 -- 172.21.15.55:0/3813406914 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3415ea60 con 0x7fed340d0da0 2023-08-25T04:19:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.225+0000 7fed22ffd640 1 -- 172.21.15.55:0/3813406914 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fed2c005590 con 0x7fed340d0da0 2023-08-25T04:19:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.225+0000 7fed22ffd640 1 --2- 172.21.15.55:0/3813406914 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fed14065710 0x7fed14067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.225+0000 7fed22ffd640 1 -- 172.21.15.55:0/3813406914 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed2c0826f0 con 0x7fed340d0da0 2023-08-25T04:19:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.225+0000 7fed3259c640 1 --2- 172.21.15.55:0/3813406914 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fed14065710 0x7fed14067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:46.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.229+0000 7fed3259c640 1 --2- 172.21.15.55:0/3813406914 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fed14065710 0x7fed14067bd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fed240097d0 tx=0x7fed24008040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:46.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.229+0000 7fed22ffd640 1 -- 172.21.15.55:0/3813406914 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fed2c050300 con 0x7fed340d0da0 2023-08-25T04:19:46.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.389+0000 7fed38ad8640 1 -- 172.21.15.55:0/3813406914 --> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed340aff70 con 0x7fed14065710 2023-08-25T04:19:46.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.397+0000 7fed22ffd640 1 -- 172.21.15.55:0/3813406914 <== mgr.7111 v2:172.21.15.110:6832/1337211678 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299649 (secure 0 0 0) 0x7fed340aff70 con 0x7fed14065710 2023-08-25T04:19:46.399 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:46.400 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:19:46.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.401+0000 7fed38ad8640 1 -- 172.21.15.55:0/3813406914 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fed14065710 msgr2=0x7fed14067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:46.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.401+0000 7fed38ad8640 1 --2- 172.21.15.55:0/3813406914 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fed14065710 0x7fed14067bd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fed240097d0 tx=0x7fed24008040 comp rx=0 tx=0).stop 2023-08-25T04:19:46.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.401+0000 7fed38ad8640 1 -- 172.21.15.55:0/3813406914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed340d0da0 msgr2=0x7fed340af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:46.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.401+0000 7fed38ad8640 1 --2- 172.21.15.55:0/3813406914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed340d0da0 0x7fed340af420 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fed340b4280 tx=0x7fed2c00cb90 comp rx=0 tx=0).stop 2023-08-25T04:19:46.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.401+0000 7fed38ad8640 1 -- 172.21.15.55:0/3813406914 shutdown_connections 2023-08-25T04:19:46.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.401+0000 7fed38ad8640 1 --2- 172.21.15.55:0/3813406914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed340d0da0 0x7fed340af420 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.401+0000 7fed38ad8640 1 --2- 172.21.15.55:0/3813406914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fed340cdde0 0x7fed341f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.401+0000 7fed38ad8640 1 --2- 172.21.15.55:0/3813406914 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fed14065710 0x7fed14067bd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.401+0000 7fed38ad8640 1 --2- 172.21.15.55:0/3813406914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fed340b3e50 0x7fed3415ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.401+0000 7fed38ad8640 1 -- 172.21.15.55:0/3813406914 >> 172.21.15.55:0/3813406914 conn(0x7fed3409bae0 msgr2=0x7fed340cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:46.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.401+0000 7fed38ad8640 1 -- 172.21.15.55:0/3813406914 shutdown_connections 2023-08-25T04:19:46.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.401+0000 7fed38ad8640 1 -- 172.21.15.55:0/3813406914 wait complete. 2023-08-25T04:19:46.419 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-25T04:19:44.460381+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":743,"num_read_kb":1508,"num_write":285,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2161,"ondisk_log_size":2161,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329776,"kb_used_data":10948,"kb_used_omap":13,"kb_used_meta":318706,"kb_avail":754644944,"statfs":{"total":773094113280,"available":772756422656,"internally_reserved":0,"allocated":11210752,"data_stored":6124754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":326355032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.594148"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.868714+0000","last_change":"2023-08-25T04:19:39.868714+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.868714+0000","last_undegraded":"2023-08-25T04:19:39.868714+0000","last_fullsized":"2023-08-25T04:19:39.868714+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.868549+0000","last_change":"2023-08-25T04:19:39.868549+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.868549+0000","last_undegraded":"2023-08-25T04:19:39.868549+0000","last_fullsized":"2023-08-25T04:19:39.868549+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.871642+0000","last_change":"2023-08-25T04:19:39.871642+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.871642+0000","last_undegraded":"2023-08-25T04:19:39.871642+0000","last_fullsized":"2023-08-25T04:19:39.871642+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.869750+0000","last_change":"2023-08-25T04:19:39.869750+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.869750+0000","last_undegraded":"2023-08-25T04:19:39.869750+0000","last_fullsized":"2023-08-25T04:19:39.869750+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.868055+0000","last_change":"2023-08-25T04:19:39.868055+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.868055+0000","last_undegraded":"2023-08-25T04:19:39.868055+0000","last_fullsized":"2023-08-25T04:19:39.868055+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.871208+0000","last_change":"2023-08-25T04:19:39.871208+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.871208+0000","last_undegraded":"2023-08-25T04:19:39.871208+0000","last_fullsized":"2023-08-25T04:19:39.871208+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.877491+0000","last_change":"2023-08-25T04:19:39.877491+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.877491+0000","last_undegraded":"2023-08-25T04:19:39.877491+0000","last_fullsized":"2023-08-25T04:19:39.877491+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.871611+0000","last_change":"2023-08-25T04:19:39.871611+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.871611+0000","last_undegraded":"2023-08-25T04:19:39.871611+0000","last_fullsized":"2023-08-25T04:19:39.871611+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.872416+0000","last_change":"2023-08-25T04:19:39.872416+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.872416+0000","last_undegraded":"2023-08-25T04:19:39.872416+0000","last_fullsized":"2023-08-25T04:19:39.872416+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.877526+0000","last_change":"2023-08-25T04:19:39.877526+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.877526+0000","last_undegraded":"2023-08-25T04:19:39.877526+0000","last_fullsized":"2023-08-25T04:19:39.877526+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.869703+0000","last_change":"2023-08-25T04:19:39.869703+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.869703+0000","last_undegraded":"2023-08-25T04:19:39.869703+0000","last_fullsized":"2023-08-25T04:19:39.869703+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.874490+0000","last_change":"2023-08-25T04:19:39.874490+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.874490+0000","last_undegraded":"2023-08-25T04:19:39.874490+0000","last_fullsized":"2023-08-25T04:19:39.874490+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.871629+0000","last_change":"2023-08-25T04:19:39.871629+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.871629+0000","last_undegraded":"2023-08-25T04:19:39.871629+0000","last_fullsized":"2023-08-25T04:19:39.871629+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.874386+0000","last_change":"2023-08-25T04:19:39.874386+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.874386+0000","last_undegraded":"2023-08-25T04:19:39.874386+0000","last_fullsized":"2023-08-25T04:19:39.874386+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.871079+0000","last_change":"2023-08-25T04:19:39.871079+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.871079+0000","last_undegraded":"2023-08-25T04:19:39.871079+0000","last_fullsized":"2023-08-25T04:19:39.871079+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.871143+0000","last_change":"2023-08-25T04:19:39.871143+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.871143+0000","last_undegraded":"2023-08-25T04:19:39.871143+0000","last_fullsized":"2023-08-25T04:19:39.871143+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.871810+0000","last_change":"2023-08-25T04:19:39.871810+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.871810+0000","last_undegraded":"2023-08-25T04:19:39.871810+0000","last_fullsized":"2023-08-25T04:19:39.871810+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.868056+0000","last_change":"2023-08-25T04:19:39.868056+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.868056+0000","last_undegraded":"2023-08-25T04:19:39.868056+0000","last_fullsized":"2023-08-25T04:19:39.868056+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.868863+0000","last_change":"2023-08-25T04:19:39.868863+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.868863+0000","last_undegraded":"2023-08-25T04:19:39.868863+0000","last_fullsized":"2023-08-25T04:19:39.868863+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.868222+0000","last_change":"2023-08-25T04:19:39.868222+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.868222+0000","last_undegraded":"2023-08-25T04:19:39.868222+0000","last_fullsized":"2023-08-25T04:19:39.868222+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.874401+0000","last_change":"2023-08-25T04:19:39.874401+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.874401+0000","last_undegraded":"2023-08-25T04:19:39.874401+0000","last_fullsized":"2023-08-25T04:19:39.874401+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.872952+0000","last_change":"2023-08-25T04:19:39.872952+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.872952+0000","last_undegraded":"2023-08-25T04:19:39.872952+0000","last_fullsized":"2023-08-25T04:19:39.872952+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.868193+0000","last_change":"2023-08-25T04:19:39.868193+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.868193+0000","last_undegraded":"2023-08-25T04:19:39.868193+0000","last_fullsized":"2023-08-25T04:19:39.868193+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.872525+0000","last_change":"2023-08-25T04:19:39.872525+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.872525+0000","last_undegraded":"2023-08-25T04:19:39.872525+0000","last_fullsized":"2023-08-25T04:19:39.872525+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.871034+0000","last_change":"2023-08-25T04:19:39.871034+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.871034+0000","last_undegraded":"2023-08-25T04:19:39.871034+0000","last_fullsized":"2023-08-25T04:19:39.871034+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"103'2161","reported_seq":2555,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-25T04:19:40.454024+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:19:40.454024+0000","last_peered":"2023-08-25T04:19:40.454024+0000","last_clean":"2023-08-25T04:19:40.454024+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:19:40.454024+0000","last_undegraded":"2023-08-25T04:19:40.454024+0000","last_fullsized":"2023-08-25T04:19:40.454024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":2161,"log_dups_size":0,"ondisk_log_size":2161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:11:20.538146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":743,"num_read_kb":1508,"num_write":285,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":155,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-25T04:19:39.873595+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:19:39.873595+0000","last_peered":"2023-08-25T04:19:39.873595+0000","last_clean":"2023-08-25T04:19:39.873595+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:19:39.873595+0000","last_undegraded":"2023-08-25T04:19:39.873595+0000","last_fullsized":"2023-08-25T04:19:39.873595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:51:52.898181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.869263+0000","last_change":"2023-08-25T04:19:39.869263+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.869263+0000","last_undegraded":"2023-08-25T04:19:39.869263+0000","last_fullsized":"2023-08-25T04:19:39.869263+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-25T04:19:39.873241+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:19:39.873241+0000","last_peered":"2023-08-25T04:19:39.873241+0000","last_clean":"2023-08-25T04:19:39.873241+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:19:39.873241+0000","last_undegraded":"2023-08-25T04:19:39.873241+0000","last_fullsized":"2023-08-25T04:19:39.873241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:42:03.452558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.871769+0000","last_change":"2023-08-25T04:19:39.871769+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.871769+0000","last_undegraded":"2023-08-25T04:19:39.871769+0000","last_fullsized":"2023-08-25T04:19:39.871769+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":159,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-25T04:19:39.873408+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:19:39.873408+0000","last_peered":"2023-08-25T04:19:39.873408+0000","last_clean":"2023-08-25T04:19:39.873408+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:19:39.873408+0000","last_undegraded":"2023-08-25T04:19:39.873408+0000","last_fullsized":"2023-08-25T04:19:39.873408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:11:14.092952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.869321+0000","last_change":"2023-08-25T04:19:39.869321+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.869321+0000","last_undegraded":"2023-08-25T04:19:39.869321+0000","last_fullsized":"2023-08-25T04:19:39.869321+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":155,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-25T04:19:39.873776+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:19:39.873776+0000","last_peered":"2023-08-25T04:19:39.873776+0000","last_clean":"2023-08-25T04:19:39.873776+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:19:39.873776+0000","last_undegraded":"2023-08-25T04:19:39.873776+0000","last_fullsized":"2023-08-25T04:19:39.873776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:13:25.975850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.872863+0000","last_change":"2023-08-25T04:19:39.872863+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.872863+0000","last_undegraded":"2023-08-25T04:19:39.872863+0000","last_fullsized":"2023-08-25T04:19:39.872863+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-25T04:19:39.869935+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:19:39.869935+0000","last_peered":"2023-08-25T04:19:39.869935+0000","last_clean":"2023-08-25T04:19:39.869935+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:19:39.869935+0000","last_undegraded":"2023-08-25T04:19:39.869935+0000","last_fullsized":"2023-08-25T04:19:39.869935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:06:51.750933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.872807+0000","last_change":"2023-08-25T04:19:39.872807+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.872807+0000","last_undegraded":"2023-08-25T04:19:39.872807+0000","last_fullsized":"2023-08-25T04:19:39.872807+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":156,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-25T04:19:39.873597+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:19:39.873597+0000","last_peered":"2023-08-25T04:19:39.873597+0000","last_clean":"2023-08-25T04:19:39.873597+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:19:39.873597+0000","last_undegraded":"2023-08-25T04:19:39.873597+0000","last_fullsized":"2023-08-25T04:19:39.873597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:58:58.766185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.872422+0000","last_change":"2023-08-25T04:19:39.872422+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.872422+0000","last_undegraded":"2023-08-25T04:19:39.872422+0000","last_fullsized":"2023-08-25T04:19:39.872422+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-25T04:19:39.869938+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:19:39.869938+0000","last_peered":"2023-08-25T04:19:39.869938+0000","last_clean":"2023-08-25T04:19:39.869938+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:19:39.869938+0000","last_undegraded":"2023-08-25T04:19:39.869938+0000","last_fullsized":"2023-08-25T04:19:39.869938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:55:53.976713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:19:40.868084+0000","last_change":"2023-08-25T04:19:40.868084+0000","last_active":"2023-08-25T04:19:40.868084+0000","last_peered":"2023-08-25T04:19:40.868084+0000","last_clean":"2023-08-25T04:19:40.868084+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:40.868084+0000","last_undegraded":"2023-08-25T04:19:40.868084+0000","last_fullsized":"2023-08-25T04:19:40.868084+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":103,"state":"creating+peering","last_fresh":"2023-08-25T04:19:39.872757+0000","last_change":"2023-08-25T04:19:39.872757+0000","last_active":"2023-08-25T04:19:39.860177+0000","last_peered":"2023-08-25T04:19:39.860177+0000","last_clean":"2023-08-25T04:19:39.860177+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:19:39.872757+0000","last_undegraded":"2023-08-25T04:19:39.872757+0000","last_fullsized":"2023-08-25T04:19:39.872757+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2023-08-25T04:19:39.869512+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:19:39.869512+0000","last_peered":"2023-08-25T04:19:39.869512+0000","last_clean":"2023-08-25T04:19:39.869512+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:19:39.869512+0000","last_undegraded":"2023-08-25T04:19:39.869512+0000","last_fullsized":"2023-08-25T04:19:39.869512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:25:19.409440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":743,"num_read_kb":1508,"num_write":285,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2161,"ondisk_log_size":2161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509643,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55196,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316644,"statfs":{"total":96636764160,"available":96580243456,"internally_reserved":0,"allocated":1851392,"data_stored":1210684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.69199999999999995,"15min":0.70699999999999996},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.33700000000000002},"max":{"1min":0.85199999999999998,"5min":0.996,"15min":0.996},"last":0.502},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70799999999999996,"15min":0.72299999999999998},"min":{"1min":0.51500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.92400000000000004,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.51400000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.42699999999999999},"max":{"1min":0.92100000000000004,"5min":0.95699999999999996,"15min":1.034},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.44700000000000001,"15min":0.374},"max":{"1min":0.995,"5min":0.995,"15min":1.036},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70399999999999996,"15min":0.71599999999999997},"min":{"1min":0.52400000000000002,"5min":0.42299999999999999,"15min":0.34899999999999998},"max":{"1min":0.84199999999999997,"5min":0.94499999999999995,"15min":1.018},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71799999999999997,"15min":0.747},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.57299999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.54400000000000004,"5min":0.47799999999999998,"15min":0.41899999999999998},"max":{"1min":0.877,"5min":0.92900000000000005,"15min":0.98399999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.432},"max":{"1min":0.90900000000000003,"5min":1.04,"15min":1.04},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.81599999999999995,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.441,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47699999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.86099999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.40000000000000002},"max":{"1min":0.83599999999999997,"5min":1.032,"15min":1.0349999999999999},"last":0.45400000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.53000000000000003,"5min":0.46700000000000003,"15min":0.436},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66100000000000003,"15min":0.66200000000000003},"min":{"1min":0.46999999999999997,"5min":0.42699999999999999,"15min":0.42399999999999999},"max":{"1min":0.94399999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.55100000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509643,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36572,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335268,"statfs":{"total":96636764160,"available":96599314432,"internally_reserved":0,"allocated":1257472,"data_stored":620316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66800000000000004,"15min":0.70399999999999996},"min":{"1min":0.34999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97099999999999997,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67700000000000005,"15min":0.69599999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95999999999999996,"5min":0.96899999999999997,"15min":1.054},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.69899999999999995,"15min":0.72999999999999998},"min":{"1min":0.41599999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.93600000000000005,"5min":1.0269999999999999,"15min":1.0369999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.72799999999999998},"min":{"1min":0.50700000000000001,"5min":0.495,"15min":0.47199999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70699999999999996,"15min":0.73599999999999999},"min":{"1min":0.48999999999999999,"5min":0.44,"15min":0.434},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.1020000000000001},"last":0.434},{"interface":"front","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0169999999999999,"5min":1.0569999999999999,"15min":1.117},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.745,"15min":0.747},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.46899999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.76000000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49199999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.36499999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.40500000000000003,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.0820000000000001},"last":0.47399999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66800000000000004,"15min":0.65200000000000002},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.1220000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.442},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.745,"15min":0.73399999999999999},"min":{"1min":0.55500000000000005,"5min":0.443,"15min":0.40000000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.67200000000000004,"15min":0.66200000000000003},"min":{"1min":0.441,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.1950000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73199999999999998,"15min":0.70299999999999996},"min":{"1min":0.50600000000000001,"5min":0.45200000000000001,"15min":0.41799999999999998},"max":{"1min":1.1359999999999999,"5min":1.373,"15min":1.373},"last":0.58399999999999996}]}]},{"osd":5,"up_from":14,"seq":60129542346,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1245184,"data_stored":614146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66900000000000004,"15min":0.70899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.018},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68899999999999995,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81999999999999995,"5min":0.97999999999999998,"15min":1.0409999999999999},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.69899999999999995,"15min":0.72999999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.36499999999999999},"max":{"1min":0.78000000000000003,"5min":0.95299999999999996,"15min":0.99399999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71499999999999997,"15min":0.73799999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90400000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68000000000000005,"15min":0.72599999999999998},"min":{"1min":0.44800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83999999999999997,"5min":0.92800000000000005,"15min":0.97499999999999998},"last":0.435},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92600000000000005,"5min":0.98499999999999999,"15min":1.0449999999999999},"last":0.51700000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.70999999999999996,"15min":0.73099999999999998},"min":{"1min":0.52600000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86499999999999999,"5min":0.93500000000000005,"15min":0.96999999999999997},"last":0.503},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72499999999999998,"15min":0.76500000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.55200000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.40999999999999998,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.91000000000000003,"5min":0.92900000000000005,"15min":0.97099999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.86499999999999999,"5min":1.018,"15min":1.018},"last":0.38}]},{"osd":6,"last update":"Fri Aug 25 04:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.47399999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.008},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.878,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.46899999999999997}]},{"osd":7,"last update":"Fri Aug 25 04:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.622,"15min":0.62},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.89300000000000002,"5min":1.002,"15min":1.032},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68899999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.96899999999999997,"15min":1.048},"last":0.61599999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542346,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36568,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335272,"statfs":{"total":96636764160,"available":96599318528,"internally_reserved":0,"allocated":1257472,"data_stored":620316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.67800000000000005,"15min":0.70099999999999996},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.84299999999999997,"5min":0.97399999999999998,"15min":0.99299999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68600000000000005,"15min":0.70099999999999996},"min":{"1min":0.48599999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.96699999999999997},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.49399999999999999,"5min":0.45100000000000001,"15min":0.36199999999999999},"max":{"1min":0.85699999999999998,"5min":0.98399999999999999,"15min":1.0449999999999999},"last":0.437},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70399999999999996,"15min":0.73499999999999999},"min":{"1min":0.44,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.872,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.39400000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39100000000000001},"max":{"1min":0.879,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":0.91600000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.52900000000000003,"5min":0.51300000000000001,"15min":0.45100000000000001},"max":{"1min":0.90200000000000002,"5min":0.98299999999999998,"15min":1.048},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.72999999999999998,"15min":0.752},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80700000000000005,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.498}]},{"osd":5,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.59099999999999997},"min":{"1min":0.42599999999999999,"5min":0.376,"15min":0.33200000000000002},"max":{"1min":0.91400000000000003,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.36799999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.745,"15min":0.73499999999999999},"min":{"1min":0.496,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.96299999999999997,"5min":1.093,"15min":1.093},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65300000000000002,"15min":0.64000000000000001},"min":{"1min":0.48299999999999998,"5min":0.42299999999999999,"15min":0.40300000000000002},"max":{"1min":0.85999999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.33900000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.36699999999999999},"max":{"1min":0.84899999999999998,"5min":0.90100000000000002,"15min":0.94499999999999995},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.60299999999999998,"5min":0.48099999999999998,"15min":0.39300000000000002},"max":{"1min":0.94299999999999995,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.54000000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542346,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36568,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335272,"statfs":{"total":96636764160,"available":96599318528,"internally_reserved":0,"allocated":1257472,"data_stored":620316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.439,"15min":0.45000000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27300000000000002},"max":{"1min":0.70199999999999996,"5min":0.93700000000000006,"15min":0.96899999999999997},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51100000000000001,"15min":0.52200000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66200000000000003,"5min":0.77100000000000002,"15min":0.91500000000000004},"last":0.59299999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.49199999999999999,"15min":0.5},"min":{"1min":0.34000000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.42199999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.748,"5min":0.80300000000000005,"15min":0.92600000000000005},"last":0.438}]},{"osd":2,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55500000000000005,"15min":0.57199999999999995},"min":{"1min":0.38700000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":0.85499999999999998,"15min":1.01},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.54500000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.70799999999999996,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.40300000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.752,"15min":0.75600000000000001},"min":{"1min":0.56399999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0209999999999999,"5min":1.214,"15min":1.214},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.57899999999999996,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0760000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.52900000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0349999999999999,"5min":1.254,"15min":1.254},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.78600000000000003},"min":{"1min":0.53700000000000003,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":0.99099999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.59499999999999997,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":1.119,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77700000000000002,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.51600000000000001,"15min":0.50700000000000001},"max":{"1min":0.94699999999999995,"5min":1.0800000000000001,"15min":1.177},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79100000000000004,"15min":0.82599999999999996},"min":{"1min":0.57199999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.96899999999999997,"5min":1.077,"15min":1.194},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.79400000000000004,"15min":0.79700000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0049999999999999,"5min":1.079,"15min":1.1160000000000001},"last":0.51600000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542347,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54608,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317232,"statfs":{"total":96636764160,"available":96580845568,"internally_reserved":0,"allocated":1245184,"data_stored":614146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.28799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59699999999999998,"5min":0.85599999999999998,"15min":0.92000000000000004},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.47899999999999998,"15min":0.495},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.61899999999999999,"5min":0.81000000000000005,"15min":0.93100000000000005},"last":0.29799999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.61299999999999999,"5min":0.78800000000000003,"15min":0.85499999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.57199999999999995,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.56699999999999995,"5min":0.81699999999999995,"15min":0.89800000000000002},"last":0.65500000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.51800000000000002,"15min":0.53200000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":0.65700000000000003,"5min":0.82199999999999995,"15min":0.82299999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59099999999999997,"5min":0.85399999999999998,"15min":0.89400000000000002},"last":0.623}]},{"osd":4,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.77600000000000002,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.502,"15min":0.502},"max":{"1min":0.82199999999999995,"5min":1.1990000000000001,"15min":1.2569999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.52000000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89400000000000002,"5min":1.151,"15min":1.5509999999999999},"last":0.51300000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.77900000000000003,"15min":0.79900000000000004},"min":{"1min":0.53000000000000003,"5min":0.52600000000000002,"15min":0.498},"max":{"1min":0.93700000000000006,"5min":1.1080000000000001,"15min":1.2789999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77700000000000002,"15min":0.80400000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.48299999999999998},"max":{"1min":0.86799999999999999,"5min":1.2130000000000001,"15min":1.3089999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.78200000000000003,"15min":0.82099999999999995},"min":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.82799999999999996,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.84999999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.90200000000000002,"5min":1.25,"15min":1.375},"last":0.60599999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.77600000000000002,"15min":0.79800000000000004},"min":{"1min":0.54200000000000004,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":0.878,"5min":1.0860000000000001,"15min":1.339},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.77900000000000003,"15min":0.80500000000000005},"min":{"1min":0.57099999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.80600000000000005,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.54300000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542347,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36568,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335272,"statfs":{"total":96636764160,"available":96599318528,"internally_reserved":0,"allocated":1257472,"data_stored":620316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.27400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.96899999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.54400000000000004,"15min":0.52200000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67400000000000004,"5min":1.212,"15min":1.212},"last":0.438}]},{"osd":2,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.30499999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79200000000000004,"5min":0.876,"15min":0.876},"last":0.628},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.36299999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83199999999999996,"5min":0.877,"15min":1.02},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.59899999999999998,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71699999999999997,"5min":0.93100000000000005,"15min":1.018},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74099999999999999,"5min":1.165,"15min":1.165},"last":0.502}]},{"osd":4,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.747,"15min":0.76900000000000002},"min":{"1min":0.48899999999999999,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":1.012,"5min":1.204,"15min":1.204},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78900000000000003,"15min":0.80400000000000005},"min":{"1min":0.53900000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.753,"15min":0.78400000000000003},"min":{"1min":0.496,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96899999999999997,"5min":1.254,"15min":1.254},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.77900000000000003,"15min":0.80300000000000005},"min":{"1min":0.54700000000000004,"5min":0.51400000000000001,"15min":0.51000000000000001},"max":{"1min":0.97999999999999998,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.45700000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.97599999999999998,"5min":1.623,"15min":1.623},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93700000000000006,"5min":1.288,"15min":1.288},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77900000000000003,"15min":0.80700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.99199999999999999,"5min":1.1240000000000001,"15min":1.2949999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.60899999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1,"5min":1.1140000000000001,"15min":1.3120000000000001},"last":0.59299999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542346,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41296,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330544,"statfs":{"total":96636764160,"available":96594477056,"internally_reserved":0,"allocated":1839104,"data_stored":1204514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36099999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63,"5min":0.72499999999999998,"15min":0.79500000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.55200000000000005,"15min":0.56499999999999995},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.40699999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.502,"15min":0.52000000000000002},"min":{"1min":0.32800000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.97499999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.51700000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48699999999999999,"15min":0.499},"min":{"1min":0.30499999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.85099999999999998,"15min":1.2470000000000001},"last":0.54200000000000004}]},{"osd":4,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79300000000000004,"15min":0.79500000000000004},"min":{"1min":0.55900000000000005,"5min":0.52600000000000002,"15min":0.503},"max":{"1min":0.95599999999999996,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":1.2},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.79200000000000004,"15min":0.80600000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.436},"max":{"1min":0.86799999999999999,"5min":1.169,"15min":1.234},"last":0.626}]},{"osd":5,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.52800000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.97799999999999998,"5min":3.528,"15min":3.528},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.56399999999999995,"5min":0.47199999999999998,"15min":0.45500000000000002},"max":{"1min":1.0680000000000001,"5min":1.121,"15min":1.2230000000000001},"last":1.244}]},{"osd":6,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.80100000000000005,"15min":0.80000000000000004},"min":{"1min":0.56699999999999995,"5min":0.54400000000000004,"15min":0.53700000000000003},"max":{"1min":0.89200000000000002,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.82099999999999995,"15min":0.82999999999999996},"min":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.502},"max":{"1min":1.0349999999999999,"5min":1.1870000000000001,"15min":1.194},"last":1.3180000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82499999999999996,"15min":0.84299999999999997},"min":{"1min":0.59699999999999998,"5min":0.56399999999999995,"15min":0.52900000000000003},"max":{"1min":1.101,"5min":1.151,"15min":1.2849999999999999},"last":1.28},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96999999999999997,"5min":1.1220000000000001,"15min":1.1930000000000001},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:19:46.427 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:19:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.609+0000 7f4a5ae9e640 1 Processor -- start 2023-08-25T04:19:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.609+0000 7f4a5ae9e640 1 -- start start 2023-08-25T04:19:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.609+0000 7f4a5ae9e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4a5415ca50 0x7f4a540d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.609+0000 7f4a5ae9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4a5406c320 0x7f4a540b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.609+0000 7f4a5ae9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a540afe20 con 0x7f4a540d0f50 2023-08-25T04:19:46.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.609+0000 7f4a5ae9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a540d13d0 con 0x7f4a5406c320 2023-08-25T04:19:46.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.609+0000 7f4a5ae9e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a540af210 con 0x7f4a5415ca50 2023-08-25T04:19:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.609+0000 7f4a5a69d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4a5406c320 0x7f4a540b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.609+0000 7f4a5a69d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4a5406c320 0x7f4a540b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58614/0 (socket says 172.21.15.55:58614) 2023-08-25T04:19:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.609+0000 7f4a5a69d640 1 -- 172.21.15.55:0/1837066247 learned_addr learned my addr 172.21.15.55:0/1837066247 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.609+0000 7f4a59e9c640 1 --2- 172.21.15.55:0/1837066247 >> v2:172.21.15.110:3300/0 conn(0x7f4a5415ca50 0x7f4a540d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.609+0000 7f4a5a69d640 1 -- 172.21.15.55:0/1837066247 >> v2:172.21.15.110:3300/0 conn(0x7f4a5415ca50 msgr2=0x7f4a540d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:46.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.609+0000 7f4a5a69d640 1 --2- 172.21.15.55:0/1837066247 >> v2:172.21.15.110:3300/0 conn(0x7f4a5415ca50 0x7f4a540d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.609+0000 7f4a5a69d640 1 -- 172.21.15.55:0/1837066247 >> v1:172.21.15.55:6789/0 conn(0x7f4a540d0f50 legacy=0x7f4a5406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:46.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.609+0000 7f4a5a69d640 1 -- 172.21.15.55:0/1837066247 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a540af4f0 con 0x7f4a5406c320 2023-08-25T04:19:46.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.609+0000 7f4a58e9a640 1 -- 172.21.15.55:0/1837066247 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055112122 0 0) 0x7f4a540afe20 con 0x7f4a540d0f50 2023-08-25T04:19:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.613+0000 7f4a5a69d640 1 --2- 172.21.15.55:0/1837066247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a5406c320 0x7f4a540b02b0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f4a5408bec0 tx=0x7f4a4c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e8bc11ed85f884 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.613+0000 7f4a58e9a640 1 -- 172.21.15.55:0/1837066247 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c0a5860 con 0x7f4a5406c320 2023-08-25T04:19:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.613+0000 7f4a58e9a640 1 -- 172.21.15.55:0/1837066247 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4c0a59c0 con 0x7f4a5406c320 2023-08-25T04:19:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.613+0000 7f4a58e9a640 1 -- 172.21.15.55:0/1837066247 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c0a5d50 con 0x7f4a5406c320 2023-08-25T04:19:46.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.613+0000 7f4a5ae9e640 1 -- 172.21.15.55:0/1837066247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a5406c320 msgr2=0x7f4a540b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:46.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.613+0000 7f4a5ae9e640 1 --2- 172.21.15.55:0/1837066247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a5406c320 0x7f4a540b02b0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f4a5408bec0 tx=0x7f4a4c01c9a0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.613+0000 7f4a5ae9e640 1 -- 172.21.15.55:0/1837066247 shutdown_connections 2023-08-25T04:19:46.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.613+0000 7f4a5ae9e640 1 --2- 172.21.15.55:0/1837066247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a5406c320 0x7f4a540b02b0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.613+0000 7f4a5ae9e640 1 --2- 172.21.15.55:0/1837066247 >> v2:172.21.15.110:3300/0 conn(0x7f4a5415ca50 0x7f4a540d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.613+0000 7f4a5ae9e640 1 -- 172.21.15.55:0/1837066247 >> 172.21.15.55:0/1837066247 conn(0x7f4a54065f40 msgr2=0x7f4a5409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:46.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.613+0000 7f4a5ae9e640 1 -- 172.21.15.55:0/1837066247 shutdown_connections 2023-08-25T04:19:46.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.613+0000 7f4a5ae9e640 1 -- 172.21.15.55:0/1837066247 wait complete. 2023-08-25T04:19:46.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a5ae9e640 1 Processor -- start 2023-08-25T04:19:46.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a5ae9e640 1 -- start start 2023-08-25T04:19:46.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a5ae9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a5406c320 0x7f4a540c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:46.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a5ae9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a540d0f50 0x7f4a54156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:46.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a5ae9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a5415ca50 0x7f4a5415aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:46.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a5ae9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a54156830 con 0x7f4a5406c320 2023-08-25T04:19:46.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a5ae9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a54157200 con 0x7f4a540d0f50 2023-08-25T04:19:46.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a5ae9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a54156220 con 0x7f4a5415ca50 2023-08-25T04:19:46.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a59e9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a5406c320 0x7f4a540c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:46.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a59e9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a5406c320 0x7f4a540c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58628/0 (socket says 172.21.15.55:58628) 2023-08-25T04:19:46.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a59e9c640 1 -- 172.21.15.55:0/314385063 learned_addr learned my addr 172.21.15.55:0/314385063 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:46.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a5969b640 1 --2- 172.21.15.55:0/314385063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a540d0f50 0x7f4a54156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:46.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a5a69d640 1 --2- 172.21.15.55:0/314385063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a5415ca50 0x7f4a5415aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:46.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a59e9c640 1 -- 172.21.15.55:0/314385063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a5415ca50 msgr2=0x7f4a5415aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:46.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a59e9c640 1 --2- 172.21.15.55:0/314385063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a5415ca50 0x7f4a5415aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a59e9c640 1 -- 172.21.15.55:0/314385063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a540d0f50 msgr2=0x7f4a54156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:46.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a59e9c640 1 --2- 172.21.15.55:0/314385063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a540d0f50 0x7f4a54156cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a59e9c640 1 -- 172.21.15.55:0/314385063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c009b30 con 0x7f4a5406c320 2023-08-25T04:19:46.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a5a69d640 1 --2- 172.21.15.55:0/314385063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a5415ca50 0x7f4a5415aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:46.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a59e9c640 1 --2- 172.21.15.55:0/314385063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a5406c320 0x7f4a540c7390 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000d7d0 tx=0x7f4a5000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:46.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a4a7fc640 1 -- 172.21.15.55:0/314385063 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5000b6c0 con 0x7f4a5406c320 2023-08-25T04:19:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a4a7fc640 1 -- 172.21.15.55:0/314385063 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5000b820 con 0x7f4a5406c320 2023-08-25T04:19:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a4a7fc640 1 -- 172.21.15.55:0/314385063 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5000bbd0 con 0x7f4a5406c320 2023-08-25T04:19:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a5ae9e640 1 -- 172.21.15.55:0/314385063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540c7f60 con 0x7f4a5406c320 2023-08-25T04:19:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a5ae9e640 1 -- 172.21.15.55:0/314385063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a540c8240 con 0x7f4a5406c320 2023-08-25T04:19:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.617+0000 7f4a5ae9e640 1 -- 172.21.15.55:0/314385063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a54073e50 con 0x7f4a5406c320 2023-08-25T04:19:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.621+0000 7f4a4a7fc640 1 -- 172.21.15.55:0/314385063 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f4a5000bd30 con 0x7f4a5406c320 2023-08-25T04:19:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.621+0000 7f4a4a7fc640 1 --2- 172.21.15.55:0/314385063 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f4a38065740 0x7f4a38067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.621+0000 7f4a4a7fc640 1 -- 172.21.15.55:0/314385063 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a50083320 con 0x7f4a5406c320 2023-08-25T04:19:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.621+0000 7f4a5969b640 1 --2- 172.21.15.55:0/314385063 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f4a38065740 0x7f4a38067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.621+0000 7f4a5969b640 1 --2- 172.21.15.55:0/314385063 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f4a38065740 0x7f4a38067c00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a540c6000 tx=0x7f4a44009040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.625+0000 7f4a4a7fc640 1 -- 172.21.15.55:0/314385063 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4a50050cf0 con 0x7f4a5406c320 2023-08-25T04:19:46.746 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:46.744+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:46.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.789+0000 7f4a5ae9e640 1 -- 172.21.15.55:0/314385063 --> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4a54156970 con 0x7f4a38065740 2023-08-25T04:19:46.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.797+0000 7f4a4a7fc640 1 -- 172.21.15.55:0/314385063 <== mgr.7111 v2:172.21.15.110:6832/1337211678 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311896 (secure 0 0 0) 0x7f4a4400f820 con 0x7f4a38065740 2023-08-25T04:19:46.799 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:46.801 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:19:46.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.801+0000 7f4a5ae9e640 1 -- 172.21.15.55:0/314385063 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f4a38065740 msgr2=0x7f4a38067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:46.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.801+0000 7f4a5ae9e640 1 --2- 172.21.15.55:0/314385063 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f4a38065740 0x7f4a38067c00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a540c6000 tx=0x7f4a44009040 comp rx=0 tx=0).stop 2023-08-25T04:19:46.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.801+0000 7f4a5ae9e640 1 -- 172.21.15.55:0/314385063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a5406c320 msgr2=0x7f4a540c7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:46.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.801+0000 7f4a5ae9e640 1 --2- 172.21.15.55:0/314385063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a5406c320 0x7f4a540c7390 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000d7d0 tx=0x7f4a5000dc90 comp rx=0 tx=0).stop 2023-08-25T04:19:46.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.801+0000 7f4a5ae9e640 1 -- 172.21.15.55:0/314385063 shutdown_connections 2023-08-25T04:19:46.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.801+0000 7f4a5ae9e640 1 --2- 172.21.15.55:0/314385063 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f4a38065740 0x7f4a38067c00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.801+0000 7f4a5ae9e640 1 --2- 172.21.15.55:0/314385063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a5415ca50 0x7f4a5415aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.801+0000 7f4a5ae9e640 1 --2- 172.21.15.55:0/314385063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a540d0f50 0x7f4a54156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.801+0000 7f4a5ae9e640 1 --2- 172.21.15.55:0/314385063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a5406c320 0x7f4a540c7390 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:46.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.801+0000 7f4a5ae9e640 1 -- 172.21.15.55:0/314385063 >> 172.21.15.55:0/314385063 conn(0x7f4a54065f40 msgr2=0x7f4a5415bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:46.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.801+0000 7f4a5ae9e640 1 -- 172.21.15.55:0/314385063 shutdown_connections 2023-08-25T04:19:46.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:46.801+0000 7f4a5ae9e640 1 -- 172.21.15.55:0/314385063 wait complete. 2023-08-25T04:19:46.820 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-25T04:19:46.460696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":750,"num_read_kb":1515,"num_write":329,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2860,"ondisk_log_size":2860,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":205,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317676,"kb_used_data":11336,"kb_used_omap":13,"kb_used_meta":306226,"kb_avail":754657044,"statfs":{"total":773094113280,"available":772768813056,"internally_reserved":0,"allocated":11608064,"data_stored":6311356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":313575512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000945"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665857+0000","last_change":"2023-08-25T04:19:41.911968+0000","last_active":"2023-08-25T04:19:43.665857+0000","last_peered":"2023-08-25T04:19:43.665857+0000","last_clean":"2023-08-25T04:19:43.665857+0000","last_became_active":"2023-08-25T04:19:41.911670+0000","last_became_peered":"2023-08-25T04:19:41.911670+0000","last_unstale":"2023-08-25T04:19:43.665857+0000","last_undegraded":"2023-08-25T04:19:43.665857+0000","last_fullsized":"2023-08-25T04:19:43.665857+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:53:47.690264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663541+0000","last_change":"2023-08-25T04:19:41.892316+0000","last_active":"2023-08-25T04:19:43.663541+0000","last_peered":"2023-08-25T04:19:43.663541+0000","last_clean":"2023-08-25T04:19:43.663541+0000","last_became_active":"2023-08-25T04:19:41.892060+0000","last_became_peered":"2023-08-25T04:19:41.892060+0000","last_unstale":"2023-08-25T04:19:43.663541+0000","last_undegraded":"2023-08-25T04:19:43.663541+0000","last_fullsized":"2023-08-25T04:19:43.663541+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:24:14.597393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665728+0000","last_change":"2023-08-25T04:19:41.897841+0000","last_active":"2023-08-25T04:19:43.665728+0000","last_peered":"2023-08-25T04:19:43.665728+0000","last_clean":"2023-08-25T04:19:43.665728+0000","last_became_active":"2023-08-25T04:19:41.896231+0000","last_became_peered":"2023-08-25T04:19:41.896231+0000","last_unstale":"2023-08-25T04:19:43.665728+0000","last_undegraded":"2023-08-25T04:19:43.665728+0000","last_fullsized":"2023-08-25T04:19:43.665728+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:00:42.950350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898716+0000","last_change":"2023-08-25T04:19:41.886280+0000","last_active":"2023-08-25T04:19:42.898716+0000","last_peered":"2023-08-25T04:19:42.898716+0000","last_clean":"2023-08-25T04:19:42.898716+0000","last_became_active":"2023-08-25T04:19:41.885639+0000","last_became_peered":"2023-08-25T04:19:41.885639+0000","last_unstale":"2023-08-25T04:19:42.898716+0000","last_undegraded":"2023-08-25T04:19:42.898716+0000","last_fullsized":"2023-08-25T04:19:42.898716+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:11.504511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892382+0000","last_change":"2023-08-25T04:19:41.883507+0000","last_active":"2023-08-25T04:19:42.892382+0000","last_peered":"2023-08-25T04:19:42.892382+0000","last_clean":"2023-08-25T04:19:42.892382+0000","last_became_active":"2023-08-25T04:19:41.883243+0000","last_became_peered":"2023-08-25T04:19:41.883243+0000","last_unstale":"2023-08-25T04:19:42.892382+0000","last_undegraded":"2023-08-25T04:19:42.892382+0000","last_fullsized":"2023-08-25T04:19:42.892382+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:39:23.545519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.893868+0000","last_change":"2023-08-25T04:19:41.908334+0000","last_active":"2023-08-25T04:19:42.893868+0000","last_peered":"2023-08-25T04:19:42.893868+0000","last_clean":"2023-08-25T04:19:42.893868+0000","last_became_active":"2023-08-25T04:19:41.908055+0000","last_became_peered":"2023-08-25T04:19:41.908055+0000","last_unstale":"2023-08-25T04:19:42.893868+0000","last_undegraded":"2023-08-25T04:19:42.893868+0000","last_fullsized":"2023-08-25T04:19:42.893868+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:58:53.278718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895721+0000","last_change":"2023-08-25T04:19:41.903035+0000","last_active":"2023-08-25T04:19:42.895721+0000","last_peered":"2023-08-25T04:19:42.895721+0000","last_clean":"2023-08-25T04:19:42.895721+0000","last_became_active":"2023-08-25T04:19:41.902730+0000","last_became_peered":"2023-08-25T04:19:41.902730+0000","last_unstale":"2023-08-25T04:19:42.895721+0000","last_undegraded":"2023-08-25T04:19:42.895721+0000","last_fullsized":"2023-08-25T04:19:42.895721+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:01.500747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898638+0000","last_change":"2023-08-25T04:19:41.900303+0000","last_active":"2023-08-25T04:19:42.898638+0000","last_peered":"2023-08-25T04:19:42.898638+0000","last_clean":"2023-08-25T04:19:42.898638+0000","last_became_active":"2023-08-25T04:19:41.899626+0000","last_became_peered":"2023-08-25T04:19:41.899626+0000","last_unstale":"2023-08-25T04:19:42.898638+0000","last_undegraded":"2023-08-25T04:19:42.898638+0000","last_fullsized":"2023-08-25T04:19:42.898638+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:52:19.962525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892095+0000","last_change":"2023-08-25T04:19:41.890680+0000","last_active":"2023-08-25T04:19:42.892095+0000","last_peered":"2023-08-25T04:19:42.892095+0000","last_clean":"2023-08-25T04:19:42.892095+0000","last_became_active":"2023-08-25T04:19:41.890417+0000","last_became_peered":"2023-08-25T04:19:41.890417+0000","last_unstale":"2023-08-25T04:19:42.892095+0000","last_undegraded":"2023-08-25T04:19:42.892095+0000","last_fullsized":"2023-08-25T04:19:42.892095+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:11:00.286732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665426+0000","last_change":"2023-08-25T04:19:41.894756+0000","last_active":"2023-08-25T04:19:43.665426+0000","last_peered":"2023-08-25T04:19:43.665426+0000","last_clean":"2023-08-25T04:19:43.665426+0000","last_became_active":"2023-08-25T04:19:41.893942+0000","last_became_peered":"2023-08-25T04:19:41.893942+0000","last_unstale":"2023-08-25T04:19:43.665426+0000","last_undegraded":"2023-08-25T04:19:43.665426+0000","last_fullsized":"2023-08-25T04:19:43.665426+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:54:06.413955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892313+0000","last_change":"2023-08-25T04:19:41.912192+0000","last_active":"2023-08-25T04:19:42.892313+0000","last_peered":"2023-08-25T04:19:42.892313+0000","last_clean":"2023-08-25T04:19:42.892313+0000","last_became_active":"2023-08-25T04:19:41.911494+0000","last_became_peered":"2023-08-25T04:19:41.911494+0000","last_unstale":"2023-08-25T04:19:42.892313+0000","last_undegraded":"2023-08-25T04:19:42.892313+0000","last_fullsized":"2023-08-25T04:19:42.892313+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:24:10.949292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665293+0000","last_change":"2023-08-25T04:19:41.901272+0000","last_active":"2023-08-25T04:19:43.665293+0000","last_peered":"2023-08-25T04:19:43.665293+0000","last_clean":"2023-08-25T04:19:43.665293+0000","last_became_active":"2023-08-25T04:19:41.901006+0000","last_became_peered":"2023-08-25T04:19:41.901006+0000","last_unstale":"2023-08-25T04:19:43.665293+0000","last_undegraded":"2023-08-25T04:19:43.665293+0000","last_fullsized":"2023-08-25T04:19:43.665293+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:08:15.762948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898547+0000","last_change":"2023-08-25T04:19:41.897597+0000","last_active":"2023-08-25T04:19:42.898547+0000","last_peered":"2023-08-25T04:19:42.898547+0000","last_clean":"2023-08-25T04:19:42.898547+0000","last_became_active":"2023-08-25T04:19:41.897344+0000","last_became_peered":"2023-08-25T04:19:41.897344+0000","last_unstale":"2023-08-25T04:19:42.898547+0000","last_undegraded":"2023-08-25T04:19:42.898547+0000","last_fullsized":"2023-08-25T04:19:42.898547+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:20:31.993666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.891823+0000","last_change":"2023-08-25T04:19:41.885014+0000","last_active":"2023-08-25T04:19:42.891823+0000","last_peered":"2023-08-25T04:19:42.891823+0000","last_clean":"2023-08-25T04:19:42.891823+0000","last_became_active":"2023-08-25T04:19:41.884760+0000","last_became_peered":"2023-08-25T04:19:41.884760+0000","last_unstale":"2023-08-25T04:19:42.891823+0000","last_undegraded":"2023-08-25T04:19:42.891823+0000","last_fullsized":"2023-08-25T04:19:42.891823+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:57:31.166188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898389+0000","last_change":"2023-08-25T04:19:41.895842+0000","last_active":"2023-08-25T04:19:42.898389+0000","last_peered":"2023-08-25T04:19:42.898389+0000","last_clean":"2023-08-25T04:19:42.898389+0000","last_became_active":"2023-08-25T04:19:41.895156+0000","last_became_peered":"2023-08-25T04:19:41.895156+0000","last_unstale":"2023-08-25T04:19:42.898389+0000","last_undegraded":"2023-08-25T04:19:42.898389+0000","last_fullsized":"2023-08-25T04:19:42.898389+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:48:22.850815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.893884+0000","last_change":"2023-08-25T04:19:41.904119+0000","last_active":"2023-08-25T04:19:42.893884+0000","last_peered":"2023-08-25T04:19:42.893884+0000","last_clean":"2023-08-25T04:19:42.893884+0000","last_became_active":"2023-08-25T04:19:41.903770+0000","last_became_peered":"2023-08-25T04:19:41.903770+0000","last_unstale":"2023-08-25T04:19:42.893884+0000","last_undegraded":"2023-08-25T04:19:42.893884+0000","last_fullsized":"2023-08-25T04:19:42.893884+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:47:36.436499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894510+0000","last_change":"2023-08-25T04:19:41.908096+0000","last_active":"2023-08-25T04:19:42.894510+0000","last_peered":"2023-08-25T04:19:42.894510+0000","last_clean":"2023-08-25T04:19:42.894510+0000","last_became_active":"2023-08-25T04:19:41.907796+0000","last_became_peered":"2023-08-25T04:19:41.907796+0000","last_unstale":"2023-08-25T04:19:42.894510+0000","last_undegraded":"2023-08-25T04:19:42.894510+0000","last_fullsized":"2023-08-25T04:19:42.894510+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:11:54.260476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665630+0000","last_change":"2023-08-25T04:19:41.893948+0000","last_active":"2023-08-25T04:19:43.665630+0000","last_peered":"2023-08-25T04:19:43.665630+0000","last_clean":"2023-08-25T04:19:43.665630+0000","last_became_active":"2023-08-25T04:19:41.893665+0000","last_became_peered":"2023-08-25T04:19:41.893665+0000","last_unstale":"2023-08-25T04:19:43.665630+0000","last_undegraded":"2023-08-25T04:19:43.665630+0000","last_fullsized":"2023-08-25T04:19:43.665630+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:12:40.205573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892326+0000","last_change":"2023-08-25T04:19:41.885024+0000","last_active":"2023-08-25T04:19:42.892326+0000","last_peered":"2023-08-25T04:19:42.892326+0000","last_clean":"2023-08-25T04:19:42.892326+0000","last_became_active":"2023-08-25T04:19:41.884792+0000","last_became_peered":"2023-08-25T04:19:41.884792+0000","last_unstale":"2023-08-25T04:19:42.892326+0000","last_undegraded":"2023-08-25T04:19:42.892326+0000","last_fullsized":"2023-08-25T04:19:42.892326+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:44:28.053044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898827+0000","last_change":"2023-08-25T04:19:41.901272+0000","last_active":"2023-08-25T04:19:42.898827+0000","last_peered":"2023-08-25T04:19:42.898827+0000","last_clean":"2023-08-25T04:19:42.898827+0000","last_became_active":"2023-08-25T04:19:41.901014+0000","last_became_peered":"2023-08-25T04:19:41.901014+0000","last_unstale":"2023-08-25T04:19:42.898827+0000","last_undegraded":"2023-08-25T04:19:42.898827+0000","last_fullsized":"2023-08-25T04:19:42.898827+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:05:02.557336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.891956+0000","last_change":"2023-08-25T04:19:41.895507+0000","last_active":"2023-08-25T04:19:42.891956+0000","last_peered":"2023-08-25T04:19:42.891956+0000","last_clean":"2023-08-25T04:19:42.891956+0000","last_became_active":"2023-08-25T04:19:41.895251+0000","last_became_peered":"2023-08-25T04:19:41.895251+0000","last_unstale":"2023-08-25T04:19:42.891956+0000","last_undegraded":"2023-08-25T04:19:42.891956+0000","last_fullsized":"2023-08-25T04:19:42.891956+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:18:11.850527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.891835+0000","last_change":"2023-08-25T04:19:41.888255+0000","last_active":"2023-08-25T04:19:42.891835+0000","last_peered":"2023-08-25T04:19:42.891835+0000","last_clean":"2023-08-25T04:19:42.891835+0000","last_became_active":"2023-08-25T04:19:41.887900+0000","last_became_peered":"2023-08-25T04:19:41.887900+0000","last_unstale":"2023-08-25T04:19:42.891835+0000","last_undegraded":"2023-08-25T04:19:42.891835+0000","last_fullsized":"2023-08-25T04:19:42.891835+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:19.617236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663262+0000","last_change":"2023-08-25T04:19:41.889004+0000","last_active":"2023-08-25T04:19:43.663262+0000","last_peered":"2023-08-25T04:19:43.663262+0000","last_clean":"2023-08-25T04:19:43.663262+0000","last_became_active":"2023-08-25T04:19:41.888757+0000","last_became_peered":"2023-08-25T04:19:41.888757+0000","last_unstale":"2023-08-25T04:19:43.663262+0000","last_undegraded":"2023-08-25T04:19:43.663262+0000","last_fullsized":"2023-08-25T04:19:43.663262+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:30:57.139654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665392+0000","last_change":"2023-08-25T04:19:41.891005+0000","last_active":"2023-08-25T04:19:43.665392+0000","last_peered":"2023-08-25T04:19:43.665392+0000","last_clean":"2023-08-25T04:19:43.665392+0000","last_became_active":"2023-08-25T04:19:41.890761+0000","last_became_peered":"2023-08-25T04:19:41.890761+0000","last_unstale":"2023-08-25T04:19:43.665392+0000","last_undegraded":"2023-08-25T04:19:43.665392+0000","last_fullsized":"2023-08-25T04:19:43.665392+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:19:13.885326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663719+0000","last_change":"2023-08-25T04:19:41.891428+0000","last_active":"2023-08-25T04:19:43.663719+0000","last_peered":"2023-08-25T04:19:43.663719+0000","last_clean":"2023-08-25T04:19:43.663719+0000","last_became_active":"2023-08-25T04:19:41.891014+0000","last_became_peered":"2023-08-25T04:19:41.891014+0000","last_unstale":"2023-08-25T04:19:43.663719+0000","last_undegraded":"2023-08-25T04:19:43.663719+0000","last_fullsized":"2023-08-25T04:19:43.663719+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:32:10.185969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892185+0000","last_change":"2023-08-25T04:19:41.889902+0000","last_active":"2023-08-25T04:19:42.892185+0000","last_peered":"2023-08-25T04:19:42.892185+0000","last_clean":"2023-08-25T04:19:42.892185+0000","last_became_active":"2023-08-25T04:19:41.889618+0000","last_became_peered":"2023-08-25T04:19:41.889618+0000","last_unstale":"2023-08-25T04:19:42.892185+0000","last_undegraded":"2023-08-25T04:19:42.892185+0000","last_fullsized":"2023-08-25T04:19:42.892185+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:15:51.000962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665450+0000","last_change":"2023-08-25T04:19:41.890594+0000","last_active":"2023-08-25T04:19:43.665450+0000","last_peered":"2023-08-25T04:19:43.665450+0000","last_clean":"2023-08-25T04:19:43.665450+0000","last_became_active":"2023-08-25T04:19:41.890295+0000","last_became_peered":"2023-08-25T04:19:41.890295+0000","last_unstale":"2023-08-25T04:19:43.665450+0000","last_undegraded":"2023-08-25T04:19:43.665450+0000","last_fullsized":"2023-08-25T04:19:43.665450+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:16:52.693910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898910+0000","last_change":"2023-08-25T04:19:41.886482+0000","last_active":"2023-08-25T04:19:42.898910+0000","last_peered":"2023-08-25T04:19:42.898910+0000","last_clean":"2023-08-25T04:19:42.898910+0000","last_became_active":"2023-08-25T04:19:41.885947+0000","last_became_peered":"2023-08-25T04:19:41.885947+0000","last_unstale":"2023-08-25T04:19:42.898910+0000","last_undegraded":"2023-08-25T04:19:42.898910+0000","last_fullsized":"2023-08-25T04:19:42.898910+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:29.868669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895796+0000","last_change":"2023-08-25T04:19:41.907800+0000","last_active":"2023-08-25T04:19:42.895796+0000","last_peered":"2023-08-25T04:19:42.895796+0000","last_clean":"2023-08-25T04:19:42.895796+0000","last_became_active":"2023-08-25T04:19:41.907533+0000","last_became_peered":"2023-08-25T04:19:41.907533+0000","last_unstale":"2023-08-25T04:19:42.895796+0000","last_undegraded":"2023-08-25T04:19:42.895796+0000","last_fullsized":"2023-08-25T04:19:42.895796+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:40:51.393385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.891985+0000","last_change":"2023-08-25T04:19:41.889825+0000","last_active":"2023-08-25T04:19:42.891985+0000","last_peered":"2023-08-25T04:19:42.891985+0000","last_clean":"2023-08-25T04:19:42.891985+0000","last_became_active":"2023-08-25T04:19:41.889520+0000","last_became_peered":"2023-08-25T04:19:41.889520+0000","last_unstale":"2023-08-25T04:19:42.891985+0000","last_undegraded":"2023-08-25T04:19:42.891985+0000","last_fullsized":"2023-08-25T04:19:42.891985+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:56:53.998165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.662912+0000","last_change":"2023-08-25T04:19:41.892895+0000","last_active":"2023-08-25T04:19:43.662912+0000","last_peered":"2023-08-25T04:19:43.662912+0000","last_clean":"2023-08-25T04:19:43.662912+0000","last_became_active":"2023-08-25T04:19:41.892623+0000","last_became_peered":"2023-08-25T04:19:41.892623+0000","last_unstale":"2023-08-25T04:19:43.662912+0000","last_undegraded":"2023-08-25T04:19:43.662912+0000","last_fullsized":"2023-08-25T04:19:43.662912+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:29:17.679853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.893874+0000","last_change":"2023-08-25T04:19:41.907732+0000","last_active":"2023-08-25T04:19:42.893874+0000","last_peered":"2023-08-25T04:19:42.893874+0000","last_clean":"2023-08-25T04:19:42.893874+0000","last_became_active":"2023-08-25T04:19:41.907433+0000","last_became_peered":"2023-08-25T04:19:41.907433+0000","last_unstale":"2023-08-25T04:19:42.893874+0000","last_undegraded":"2023-08-25T04:19:42.893874+0000","last_fullsized":"2023-08-25T04:19:42.893874+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:02:08.662125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894225+0000","last_change":"2023-08-25T04:19:41.912135+0000","last_active":"2023-08-25T04:19:42.894225+0000","last_peered":"2023-08-25T04:19:42.894225+0000","last_clean":"2023-08-25T04:19:42.894225+0000","last_became_active":"2023-08-25T04:19:41.908659+0000","last_became_peered":"2023-08-25T04:19:41.908659+0000","last_unstale":"2023-08-25T04:19:42.894225+0000","last_undegraded":"2023-08-25T04:19:42.894225+0000","last_fullsized":"2023-08-25T04:19:42.894225+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:38:28.530195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"105'4","reported_seq":17,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663426+0000","last_change":"2023-08-25T04:19:40.898787+0000","last_active":"2023-08-25T04:19:43.663426+0000","last_peered":"2023-08-25T04:19:43.663426+0000","last_clean":"2023-08-25T04:19:43.663426+0000","last_became_active":"2023-08-25T04:19:40.898515+0000","last_became_peered":"2023-08-25T04:19:40.898515+0000","last_unstale":"2023-08-25T04:19:43.663426+0000","last_undegraded":"2023-08-25T04:19:43.663426+0000","last_fullsized":"2023-08-25T04:19:43.663426+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:53:47.519111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894264+0000","last_change":"2023-08-25T04:19:41.911106+0000","last_active":"2023-08-25T04:19:42.894264+0000","last_peered":"2023-08-25T04:19:42.894264+0000","last_clean":"2023-08-25T04:19:42.894264+0000","last_became_active":"2023-08-25T04:19:41.910685+0000","last_became_peered":"2023-08-25T04:19:41.910685+0000","last_unstale":"2023-08-25T04:19:42.894264+0000","last_undegraded":"2023-08-25T04:19:42.894264+0000","last_fullsized":"2023-08-25T04:19:42.894264+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:00:49.023062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892254+0000","last_change":"2023-08-25T04:19:40.885801+0000","last_active":"2023-08-25T04:19:42.892254+0000","last_peered":"2023-08-25T04:19:42.892254+0000","last_clean":"2023-08-25T04:19:42.892254+0000","last_became_active":"2023-08-25T04:19:40.885527+0000","last_became_peered":"2023-08-25T04:19:40.885527+0000","last_unstale":"2023-08-25T04:19:42.892254+0000","last_undegraded":"2023-08-25T04:19:42.892254+0000","last_fullsized":"2023-08-25T04:19:42.892254+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:27.110975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895966+0000","last_change":"2023-08-25T04:19:41.903603+0000","last_active":"2023-08-25T04:19:42.895966+0000","last_peered":"2023-08-25T04:19:42.895966+0000","last_clean":"2023-08-25T04:19:42.895966+0000","last_became_active":"2023-08-25T04:19:41.903265+0000","last_became_peered":"2023-08-25T04:19:41.903265+0000","last_unstale":"2023-08-25T04:19:42.895966+0000","last_undegraded":"2023-08-25T04:19:42.895966+0000","last_fullsized":"2023-08-25T04:19:42.895966+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:41:01.030543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895884+0000","last_change":"2023-08-25T04:19:40.891925+0000","last_active":"2023-08-25T04:19:42.895884+0000","last_peered":"2023-08-25T04:19:42.895884+0000","last_clean":"2023-08-25T04:19:42.895884+0000","last_became_active":"2023-08-25T04:19:40.891676+0000","last_became_peered":"2023-08-25T04:19:40.891676+0000","last_unstale":"2023-08-25T04:19:42.895884+0000","last_undegraded":"2023-08-25T04:19:42.895884+0000","last_fullsized":"2023-08-25T04:19:42.895884+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:20:29.662430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894581+0000","last_change":"2023-08-25T04:19:41.907564+0000","last_active":"2023-08-25T04:19:42.894581+0000","last_peered":"2023-08-25T04:19:42.894581+0000","last_clean":"2023-08-25T04:19:42.894581+0000","last_became_active":"2023-08-25T04:19:41.907280+0000","last_became_peered":"2023-08-25T04:19:41.907280+0000","last_unstale":"2023-08-25T04:19:42.894581+0000","last_undegraded":"2023-08-25T04:19:42.894581+0000","last_fullsized":"2023-08-25T04:19:42.894581+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:05:42.470420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663343+0000","last_change":"2023-08-25T04:19:40.896552+0000","last_active":"2023-08-25T04:19:43.663343+0000","last_peered":"2023-08-25T04:19:43.663343+0000","last_clean":"2023-08-25T04:19:43.663343+0000","last_became_active":"2023-08-25T04:19:40.896374+0000","last_became_peered":"2023-08-25T04:19:40.896374+0000","last_unstale":"2023-08-25T04:19:43.663343+0000","last_undegraded":"2023-08-25T04:19:43.663343+0000","last_fullsized":"2023-08-25T04:19:43.663343+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:13:44.596252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.899106+0000","last_change":"2023-08-25T04:19:41.889967+0000","last_active":"2023-08-25T04:19:42.899106+0000","last_peered":"2023-08-25T04:19:42.899106+0000","last_clean":"2023-08-25T04:19:42.899106+0000","last_became_active":"2023-08-25T04:19:41.889213+0000","last_became_peered":"2023-08-25T04:19:41.889213+0000","last_unstale":"2023-08-25T04:19:42.899106+0000","last_undegraded":"2023-08-25T04:19:42.899106+0000","last_fullsized":"2023-08-25T04:19:42.899106+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:14:40.897561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892082+0000","last_change":"2023-08-25T04:19:40.887257+0000","last_active":"2023-08-25T04:19:42.892082+0000","last_peered":"2023-08-25T04:19:42.892082+0000","last_clean":"2023-08-25T04:19:42.892082+0000","last_became_active":"2023-08-25T04:19:40.886960+0000","last_became_peered":"2023-08-25T04:19:40.886960+0000","last_unstale":"2023-08-25T04:19:42.892082+0000","last_undegraded":"2023-08-25T04:19:42.892082+0000","last_fullsized":"2023-08-25T04:19:42.892082+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:05:38.594325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663630+0000","last_change":"2023-08-25T04:19:41.903870+0000","last_active":"2023-08-25T04:19:43.663630+0000","last_peered":"2023-08-25T04:19:43.663630+0000","last_clean":"2023-08-25T04:19:43.663630+0000","last_became_active":"2023-08-25T04:19:41.902846+0000","last_became_peered":"2023-08-25T04:19:41.902846+0000","last_unstale":"2023-08-25T04:19:43.663630+0000","last_undegraded":"2023-08-25T04:19:43.663630+0000","last_fullsized":"2023-08-25T04:19:43.663630+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:03:27.491490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898651+0000","last_change":"2023-08-25T04:19:40.890630+0000","last_active":"2023-08-25T04:19:42.898651+0000","last_peered":"2023-08-25T04:19:42.898651+0000","last_clean":"2023-08-25T04:19:42.898651+0000","last_became_active":"2023-08-25T04:19:40.890342+0000","last_became_peered":"2023-08-25T04:19:40.890342+0000","last_unstale":"2023-08-25T04:19:42.898651+0000","last_undegraded":"2023-08-25T04:19:42.898651+0000","last_fullsized":"2023-08-25T04:19:42.898651+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:33.068046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894021+0000","last_change":"2023-08-25T04:19:41.911955+0000","last_active":"2023-08-25T04:19:42.894021+0000","last_peered":"2023-08-25T04:19:42.894021+0000","last_clean":"2023-08-25T04:19:42.894021+0000","last_became_active":"2023-08-25T04:19:41.911696+0000","last_became_peered":"2023-08-25T04:19:41.911696+0000","last_unstale":"2023-08-25T04:19:42.894021+0000","last_undegraded":"2023-08-25T04:19:42.894021+0000","last_fullsized":"2023-08-25T04:19:42.894021+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:17:15.554678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665687+0000","last_change":"2023-08-25T04:19:40.892468+0000","last_active":"2023-08-25T04:19:43.665687+0000","last_peered":"2023-08-25T04:19:43.665687+0000","last_clean":"2023-08-25T04:19:43.665687+0000","last_became_active":"2023-08-25T04:19:40.892134+0000","last_became_peered":"2023-08-25T04:19:40.892134+0000","last_unstale":"2023-08-25T04:19:43.665687+0000","last_undegraded":"2023-08-25T04:19:43.665687+0000","last_fullsized":"2023-08-25T04:19:43.665687+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:32:15.053322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898672+0000","last_change":"2023-08-25T04:19:41.886919+0000","last_active":"2023-08-25T04:19:42.898672+0000","last_peered":"2023-08-25T04:19:42.898672+0000","last_clean":"2023-08-25T04:19:42.898672+0000","last_became_active":"2023-08-25T04:19:41.886598+0000","last_became_peered":"2023-08-25T04:19:41.886598+0000","last_unstale":"2023-08-25T04:19:42.898672+0000","last_undegraded":"2023-08-25T04:19:42.898672+0000","last_fullsized":"2023-08-25T04:19:42.898672+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:30:55.735155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895758+0000","last_change":"2023-08-25T04:19:40.899648+0000","last_active":"2023-08-25T04:19:42.895758+0000","last_peered":"2023-08-25T04:19:42.895758+0000","last_clean":"2023-08-25T04:19:42.895758+0000","last_became_active":"2023-08-25T04:19:40.899405+0000","last_became_peered":"2023-08-25T04:19:40.899405+0000","last_unstale":"2023-08-25T04:19:42.895758+0000","last_undegraded":"2023-08-25T04:19:42.895758+0000","last_fullsized":"2023-08-25T04:19:42.895758+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:22:15.682094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892174+0000","last_change":"2023-08-25T04:19:41.897500+0000","last_active":"2023-08-25T04:19:42.892174+0000","last_peered":"2023-08-25T04:19:42.892174+0000","last_clean":"2023-08-25T04:19:42.892174+0000","last_became_active":"2023-08-25T04:19:41.897228+0000","last_became_peered":"2023-08-25T04:19:41.897228+0000","last_unstale":"2023-08-25T04:19:42.892174+0000","last_undegraded":"2023-08-25T04:19:42.892174+0000","last_fullsized":"2023-08-25T04:19:42.892174+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:25:23.161265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663793+0000","last_change":"2023-08-25T04:19:40.889045+0000","last_active":"2023-08-25T04:19:43.663793+0000","last_peered":"2023-08-25T04:19:43.663793+0000","last_clean":"2023-08-25T04:19:43.663793+0000","last_became_active":"2023-08-25T04:19:40.888607+0000","last_became_peered":"2023-08-25T04:19:40.888607+0000","last_unstale":"2023-08-25T04:19:43.663793+0000","last_undegraded":"2023-08-25T04:19:43.663793+0000","last_fullsized":"2023-08-25T04:19:43.663793+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:15:53.081071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895763+0000","last_change":"2023-08-25T04:19:41.899010+0000","last_active":"2023-08-25T04:19:42.895763+0000","last_peered":"2023-08-25T04:19:42.895763+0000","last_clean":"2023-08-25T04:19:42.895763+0000","last_became_active":"2023-08-25T04:19:41.898739+0000","last_became_peered":"2023-08-25T04:19:41.898739+0000","last_unstale":"2023-08-25T04:19:42.895763+0000","last_undegraded":"2023-08-25T04:19:42.895763+0000","last_fullsized":"2023-08-25T04:19:42.895763+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:58.849460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665734+0000","last_change":"2023-08-25T04:19:40.899283+0000","last_active":"2023-08-25T04:19:43.665734+0000","last_peered":"2023-08-25T04:19:43.665734+0000","last_clean":"2023-08-25T04:19:43.665734+0000","last_became_active":"2023-08-25T04:19:40.898940+0000","last_became_peered":"2023-08-25T04:19:40.898940+0000","last_unstale":"2023-08-25T04:19:43.665734+0000","last_undegraded":"2023-08-25T04:19:43.665734+0000","last_fullsized":"2023-08-25T04:19:43.665734+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:31.402164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665688+0000","last_change":"2023-08-25T04:19:41.905509+0000","last_active":"2023-08-25T04:19:43.665688+0000","last_peered":"2023-08-25T04:19:43.665688+0000","last_clean":"2023-08-25T04:19:43.665688+0000","last_became_active":"2023-08-25T04:19:41.905242+0000","last_became_peered":"2023-08-25T04:19:41.905242+0000","last_unstale":"2023-08-25T04:19:43.665688+0000","last_undegraded":"2023-08-25T04:19:43.665688+0000","last_fullsized":"2023-08-25T04:19:43.665688+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:23:37.979793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"105'3","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892413+0000","last_change":"2023-08-25T04:19:40.898940+0000","last_active":"2023-08-25T04:19:42.892413+0000","last_peered":"2023-08-25T04:19:42.892413+0000","last_clean":"2023-08-25T04:19:42.892413+0000","last_became_active":"2023-08-25T04:19:40.898474+0000","last_became_peered":"2023-08-25T04:19:40.898474+0000","last_unstale":"2023-08-25T04:19:42.892413+0000","last_undegraded":"2023-08-25T04:19:42.892413+0000","last_fullsized":"2023-08-25T04:19:42.892413+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:09:59.626997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.899096+0000","last_change":"2023-08-25T04:19:41.893039+0000","last_active":"2023-08-25T04:19:42.899096+0000","last_peered":"2023-08-25T04:19:42.899096+0000","last_clean":"2023-08-25T04:19:42.899096+0000","last_became_active":"2023-08-25T04:19:41.892753+0000","last_became_peered":"2023-08-25T04:19:41.892753+0000","last_unstale":"2023-08-25T04:19:42.899096+0000","last_undegraded":"2023-08-25T04:19:42.899096+0000","last_fullsized":"2023-08-25T04:19:42.899096+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:20:29.110139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"105'6","reported_seq":19,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894323+0000","last_change":"2023-08-25T04:19:40.900998+0000","last_active":"2023-08-25T04:19:42.894323+0000","last_peered":"2023-08-25T04:19:42.894323+0000","last_clean":"2023-08-25T04:19:42.894323+0000","last_became_active":"2023-08-25T04:19:40.900729+0000","last_became_peered":"2023-08-25T04:19:40.900729+0000","last_unstale":"2023-08-25T04:19:42.894323+0000","last_undegraded":"2023-08-25T04:19:42.894323+0000","last_fullsized":"2023-08-25T04:19:42.894323+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:27.855057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898332+0000","last_change":"2023-08-25T04:19:41.900468+0000","last_active":"2023-08-25T04:19:42.898332+0000","last_peered":"2023-08-25T04:19:42.898332+0000","last_clean":"2023-08-25T04:19:42.898332+0000","last_became_active":"2023-08-25T04:19:41.900027+0000","last_became_peered":"2023-08-25T04:19:41.900027+0000","last_unstale":"2023-08-25T04:19:42.898332+0000","last_undegraded":"2023-08-25T04:19:42.898332+0000","last_fullsized":"2023-08-25T04:19:42.898332+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:27:32.656198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895791+0000","last_change":"2023-08-25T04:19:40.899588+0000","last_active":"2023-08-25T04:19:42.895791+0000","last_peered":"2023-08-25T04:19:42.895791+0000","last_clean":"2023-08-25T04:19:42.895791+0000","last_became_active":"2023-08-25T04:19:40.899317+0000","last_became_peered":"2023-08-25T04:19:40.899317+0000","last_unstale":"2023-08-25T04:19:42.895791+0000","last_undegraded":"2023-08-25T04:19:42.895791+0000","last_fullsized":"2023-08-25T04:19:42.895791+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:27:22.727108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.891800+0000","last_change":"2023-08-25T04:19:41.882821+0000","last_active":"2023-08-25T04:19:42.891800+0000","last_peered":"2023-08-25T04:19:42.891800+0000","last_clean":"2023-08-25T04:19:42.891800+0000","last_became_active":"2023-08-25T04:19:41.882550+0000","last_became_peered":"2023-08-25T04:19:41.882550+0000","last_unstale":"2023-08-25T04:19:42.891800+0000","last_undegraded":"2023-08-25T04:19:42.891800+0000","last_fullsized":"2023-08-25T04:19:42.891800+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:50:08.947936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.893997+0000","last_change":"2023-08-25T04:19:40.900933+0000","last_active":"2023-08-25T04:19:42.893997+0000","last_peered":"2023-08-25T04:19:42.893997+0000","last_clean":"2023-08-25T04:19:42.893997+0000","last_became_active":"2023-08-25T04:19:40.900610+0000","last_became_peered":"2023-08-25T04:19:40.900610+0000","last_unstale":"2023-08-25T04:19:42.893997+0000","last_undegraded":"2023-08-25T04:19:42.893997+0000","last_fullsized":"2023-08-25T04:19:42.893997+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:13:38.475112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665119+0000","last_change":"2023-08-25T04:19:41.893371+0000","last_active":"2023-08-25T04:19:43.665119+0000","last_peered":"2023-08-25T04:19:43.665119+0000","last_clean":"2023-08-25T04:19:43.665119+0000","last_became_active":"2023-08-25T04:19:41.893099+0000","last_became_peered":"2023-08-25T04:19:41.893099+0000","last_unstale":"2023-08-25T04:19:43.665119+0000","last_undegraded":"2023-08-25T04:19:43.665119+0000","last_fullsized":"2023-08-25T04:19:43.665119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:44:30.148605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.899225+0000","last_change":"2023-08-25T04:19:40.889107+0000","last_active":"2023-08-25T04:19:42.899225+0000","last_peered":"2023-08-25T04:19:42.899225+0000","last_clean":"2023-08-25T04:19:42.899225+0000","last_became_active":"2023-08-25T04:19:40.888769+0000","last_became_peered":"2023-08-25T04:19:40.888769+0000","last_unstale":"2023-08-25T04:19:42.899225+0000","last_undegraded":"2023-08-25T04:19:42.899225+0000","last_fullsized":"2023-08-25T04:19:42.899225+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:33:03.241173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665330+0000","last_change":"2023-08-25T04:19:41.894694+0000","last_active":"2023-08-25T04:19:43.665330+0000","last_peered":"2023-08-25T04:19:43.665330+0000","last_clean":"2023-08-25T04:19:43.665330+0000","last_became_active":"2023-08-25T04:19:41.894434+0000","last_became_peered":"2023-08-25T04:19:41.894434+0000","last_unstale":"2023-08-25T04:19:43.665330+0000","last_undegraded":"2023-08-25T04:19:43.665330+0000","last_fullsized":"2023-08-25T04:19:43.665330+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:59:49.857880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"105'8","reported_seq":21,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898438+0000","last_change":"2023-08-25T04:19:40.890314+0000","last_active":"2023-08-25T04:19:42.898438+0000","last_peered":"2023-08-25T04:19:42.898438+0000","last_clean":"2023-08-25T04:19:42.898438+0000","last_became_active":"2023-08-25T04:19:40.890039+0000","last_became_peered":"2023-08-25T04:19:40.890039+0000","last_unstale":"2023-08-25T04:19:42.898438+0000","last_undegraded":"2023-08-25T04:19:42.898438+0000","last_fullsized":"2023-08-25T04:19:42.898438+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:18:19.534084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663268+0000","last_change":"2023-08-25T04:19:41.895417+0000","last_active":"2023-08-25T04:19:43.663268+0000","last_peered":"2023-08-25T04:19:43.663268+0000","last_clean":"2023-08-25T04:19:43.663268+0000","last_became_active":"2023-08-25T04:19:41.895138+0000","last_became_peered":"2023-08-25T04:19:41.895138+0000","last_unstale":"2023-08-25T04:19:43.663268+0000","last_undegraded":"2023-08-25T04:19:43.663268+0000","last_fullsized":"2023-08-25T04:19:43.663268+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:24:45.202315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.896039+0000","last_change":"2023-08-25T04:19:40.891823+0000","last_active":"2023-08-25T04:19:42.896039+0000","last_peered":"2023-08-25T04:19:42.896039+0000","last_clean":"2023-08-25T04:19:42.896039+0000","last_became_active":"2023-08-25T04:19:40.891569+0000","last_became_peered":"2023-08-25T04:19:40.891569+0000","last_unstale":"2023-08-25T04:19:42.896039+0000","last_undegraded":"2023-08-25T04:19:42.896039+0000","last_fullsized":"2023-08-25T04:19:42.896039+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:57:01.386059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894336+0000","last_change":"2023-08-25T04:19:41.910936+0000","last_active":"2023-08-25T04:19:42.894336+0000","last_peered":"2023-08-25T04:19:42.894336+0000","last_clean":"2023-08-25T04:19:42.894336+0000","last_became_active":"2023-08-25T04:19:41.910413+0000","last_became_peered":"2023-08-25T04:19:41.910413+0000","last_unstale":"2023-08-25T04:19:42.894336+0000","last_undegraded":"2023-08-25T04:19:42.894336+0000","last_fullsized":"2023-08-25T04:19:42.894336+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:35:00.168476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892266+0000","last_change":"2023-08-25T04:19:40.888478+0000","last_active":"2023-08-25T04:19:42.892266+0000","last_peered":"2023-08-25T04:19:42.892266+0000","last_clean":"2023-08-25T04:19:42.892266+0000","last_became_active":"2023-08-25T04:19:40.888095+0000","last_became_peered":"2023-08-25T04:19:40.888095+0000","last_unstale":"2023-08-25T04:19:42.892266+0000","last_undegraded":"2023-08-25T04:19:42.892266+0000","last_fullsized":"2023-08-25T04:19:42.892266+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:21:29.749789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894399+0000","last_change":"2023-08-25T04:19:41.910119+0000","last_active":"2023-08-25T04:19:42.894399+0000","last_peered":"2023-08-25T04:19:42.894399+0000","last_clean":"2023-08-25T04:19:42.894399+0000","last_became_active":"2023-08-25T04:19:41.908668+0000","last_became_peered":"2023-08-25T04:19:41.908668+0000","last_unstale":"2023-08-25T04:19:42.894399+0000","last_undegraded":"2023-08-25T04:19:42.894399+0000","last_fullsized":"2023-08-25T04:19:42.894399+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:47:01.021287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892481+0000","last_change":"2023-08-25T04:19:40.898764+0000","last_active":"2023-08-25T04:19:42.892481+0000","last_peered":"2023-08-25T04:19:42.892481+0000","last_clean":"2023-08-25T04:19:42.892481+0000","last_became_active":"2023-08-25T04:19:40.898484+0000","last_became_peered":"2023-08-25T04:19:40.898484+0000","last_unstale":"2023-08-25T04:19:42.892481+0000","last_undegraded":"2023-08-25T04:19:42.892481+0000","last_fullsized":"2023-08-25T04:19:42.892481+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:21.641112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663774+0000","last_change":"2023-08-25T04:19:41.895638+0000","last_active":"2023-08-25T04:19:43.663774+0000","last_peered":"2023-08-25T04:19:43.663774+0000","last_clean":"2023-08-25T04:19:43.663774+0000","last_became_active":"2023-08-25T04:19:41.895377+0000","last_became_peered":"2023-08-25T04:19:41.895377+0000","last_unstale":"2023-08-25T04:19:43.663774+0000","last_undegraded":"2023-08-25T04:19:43.663774+0000","last_fullsized":"2023-08-25T04:19:43.663774+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:55:43.951635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663367+0000","last_change":"2023-08-25T04:19:40.886820+0000","last_active":"2023-08-25T04:19:43.663367+0000","last_peered":"2023-08-25T04:19:43.663367+0000","last_clean":"2023-08-25T04:19:43.663367+0000","last_became_active":"2023-08-25T04:19:40.886510+0000","last_became_peered":"2023-08-25T04:19:40.886510+0000","last_unstale":"2023-08-25T04:19:43.663367+0000","last_undegraded":"2023-08-25T04:19:43.663367+0000","last_fullsized":"2023-08-25T04:19:43.663367+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:53:56.409846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665011+0000","last_change":"2023-08-25T04:19:41.911130+0000","last_active":"2023-08-25T04:19:43.665011+0000","last_peered":"2023-08-25T04:19:43.665011+0000","last_clean":"2023-08-25T04:19:43.665011+0000","last_became_active":"2023-08-25T04:19:41.909973+0000","last_became_peered":"2023-08-25T04:19:41.909973+0000","last_unstale":"2023-08-25T04:19:43.665011+0000","last_undegraded":"2023-08-25T04:19:43.665011+0000","last_fullsized":"2023-08-25T04:19:43.665011+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:38:07.090247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894279+0000","last_change":"2023-08-25T04:19:40.901212+0000","last_active":"2023-08-25T04:19:42.894279+0000","last_peered":"2023-08-25T04:19:42.894279+0000","last_clean":"2023-08-25T04:19:42.894279+0000","last_became_active":"2023-08-25T04:19:40.900450+0000","last_became_peered":"2023-08-25T04:19:40.900450+0000","last_unstale":"2023-08-25T04:19:42.894279+0000","last_undegraded":"2023-08-25T04:19:42.894279+0000","last_fullsized":"2023-08-25T04:19:42.894279+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:06:25.729783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665546+0000","last_change":"2023-08-25T04:19:41.897014+0000","last_active":"2023-08-25T04:19:43.665546+0000","last_peered":"2023-08-25T04:19:43.665546+0000","last_clean":"2023-08-25T04:19:43.665546+0000","last_became_active":"2023-08-25T04:19:41.896368+0000","last_became_peered":"2023-08-25T04:19:41.896368+0000","last_unstale":"2023-08-25T04:19:43.665546+0000","last_undegraded":"2023-08-25T04:19:43.665546+0000","last_fullsized":"2023-08-25T04:19:43.665546+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:58.694119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663114+0000","last_change":"2023-08-25T04:19:40.887802+0000","last_active":"2023-08-25T04:19:43.663114+0000","last_peered":"2023-08-25T04:19:43.663114+0000","last_clean":"2023-08-25T04:19:43.663114+0000","last_became_active":"2023-08-25T04:19:40.887524+0000","last_became_peered":"2023-08-25T04:19:40.887524+0000","last_unstale":"2023-08-25T04:19:43.663114+0000","last_undegraded":"2023-08-25T04:19:43.663114+0000","last_fullsized":"2023-08-25T04:19:43.663114+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:13:42.252860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663000+0000","last_change":"2023-08-25T04:19:41.888396+0000","last_active":"2023-08-25T04:19:43.663000+0000","last_peered":"2023-08-25T04:19:43.663000+0000","last_clean":"2023-08-25T04:19:43.663000+0000","last_became_active":"2023-08-25T04:19:41.888159+0000","last_became_peered":"2023-08-25T04:19:41.888159+0000","last_unstale":"2023-08-25T04:19:43.663000+0000","last_undegraded":"2023-08-25T04:19:43.663000+0000","last_fullsized":"2023-08-25T04:19:43.663000+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:30:51.066940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663653+0000","last_change":"2023-08-25T04:19:40.887614+0000","last_active":"2023-08-25T04:19:43.663653+0000","last_peered":"2023-08-25T04:19:43.663653+0000","last_clean":"2023-08-25T04:19:43.663653+0000","last_became_active":"2023-08-25T04:19:40.887354+0000","last_became_peered":"2023-08-25T04:19:40.887354+0000","last_unstale":"2023-08-25T04:19:43.663653+0000","last_undegraded":"2023-08-25T04:19:43.663653+0000","last_fullsized":"2023-08-25T04:19:43.663653+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:50.169800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894173+0000","last_change":"2023-08-25T04:19:41.902881+0000","last_active":"2023-08-25T04:19:42.894173+0000","last_peered":"2023-08-25T04:19:42.894173+0000","last_clean":"2023-08-25T04:19:42.894173+0000","last_became_active":"2023-08-25T04:19:41.902588+0000","last_became_peered":"2023-08-25T04:19:41.902588+0000","last_unstale":"2023-08-25T04:19:42.894173+0000","last_undegraded":"2023-08-25T04:19:42.894173+0000","last_fullsized":"2023-08-25T04:19:42.894173+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:27:16.063317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895576+0000","last_change":"2023-08-25T04:19:40.897361+0000","last_active":"2023-08-25T04:19:42.895576+0000","last_peered":"2023-08-25T04:19:42.895576+0000","last_clean":"2023-08-25T04:19:42.895576+0000","last_became_active":"2023-08-25T04:19:40.897118+0000","last_became_peered":"2023-08-25T04:19:40.897118+0000","last_unstale":"2023-08-25T04:19:42.895576+0000","last_undegraded":"2023-08-25T04:19:42.895576+0000","last_fullsized":"2023-08-25T04:19:42.895576+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:26:11.555112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.896018+0000","last_change":"2023-08-25T04:19:41.903029+0000","last_active":"2023-08-25T04:19:42.896018+0000","last_peered":"2023-08-25T04:19:42.896018+0000","last_clean":"2023-08-25T04:19:42.896018+0000","last_became_active":"2023-08-25T04:19:41.902460+0000","last_became_peered":"2023-08-25T04:19:41.902460+0000","last_unstale":"2023-08-25T04:19:42.896018+0000","last_undegraded":"2023-08-25T04:19:42.896018+0000","last_fullsized":"2023-08-25T04:19:42.896018+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:06:52.404331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898914+0000","last_change":"2023-08-25T04:19:40.893346+0000","last_active":"2023-08-25T04:19:42.898914+0000","last_peered":"2023-08-25T04:19:42.898914+0000","last_clean":"2023-08-25T04:19:42.898914+0000","last_became_active":"2023-08-25T04:19:40.892055+0000","last_became_peered":"2023-08-25T04:19:40.892055+0000","last_unstale":"2023-08-25T04:19:42.898914+0000","last_undegraded":"2023-08-25T04:19:42.898914+0000","last_fullsized":"2023-08-25T04:19:42.898914+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:35:39.736125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"106'2822","reported_seq":3229,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:45.449134+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:19:45.449134+0000","last_peered":"2023-08-25T04:19:45.449134+0000","last_clean":"2023-08-25T04:19:45.449134+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:19:45.449134+0000","last_undegraded":"2023-08-25T04:19:45.449134+0000","last_fullsized":"2023-08-25T04:19:45.449134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":2822,"log_dups_size":0,"ondisk_log_size":2822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:06:43.866997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":750,"num_read_kb":1515,"num_write":285,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":161,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663187+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:19:43.663187+0000","last_peered":"2023-08-25T04:19:43.663187+0000","last_clean":"2023-08-25T04:19:43.663187+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:19:43.663187+0000","last_undegraded":"2023-08-25T04:19:43.663187+0000","last_fullsized":"2023-08-25T04:19:43.663187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:50:11.429397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894376+0000","last_change":"2023-08-25T04:19:41.903347+0000","last_active":"2023-08-25T04:19:42.894376+0000","last_peered":"2023-08-25T04:19:42.894376+0000","last_clean":"2023-08-25T04:19:42.894376+0000","last_became_active":"2023-08-25T04:19:41.903097+0000","last_became_peered":"2023-08-25T04:19:41.903097+0000","last_unstale":"2023-08-25T04:19:42.894376+0000","last_undegraded":"2023-08-25T04:19:42.894376+0000","last_fullsized":"2023-08-25T04:19:42.894376+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:42:42.088067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663310+0000","last_change":"2023-08-25T04:19:40.886640+0000","last_active":"2023-08-25T04:19:43.663310+0000","last_peered":"2023-08-25T04:19:43.663310+0000","last_clean":"2023-08-25T04:19:43.663310+0000","last_became_active":"2023-08-25T04:19:40.886327+0000","last_became_peered":"2023-08-25T04:19:40.886327+0000","last_unstale":"2023-08-25T04:19:43.663310+0000","last_undegraded":"2023-08-25T04:19:43.663310+0000","last_fullsized":"2023-08-25T04:19:43.663310+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:30:11.680409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895784+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:19:42.895784+0000","last_peered":"2023-08-25T04:19:42.895784+0000","last_clean":"2023-08-25T04:19:42.895784+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:19:42.895784+0000","last_undegraded":"2023-08-25T04:19:42.895784+0000","last_fullsized":"2023-08-25T04:19:42.895784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:27:04.060862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663405+0000","last_change":"2023-08-25T04:19:41.891179+0000","last_active":"2023-08-25T04:19:43.663405+0000","last_peered":"2023-08-25T04:19:43.663405+0000","last_clean":"2023-08-25T04:19:43.663405+0000","last_became_active":"2023-08-25T04:19:41.890922+0000","last_became_peered":"2023-08-25T04:19:41.890922+0000","last_unstale":"2023-08-25T04:19:43.663405+0000","last_undegraded":"2023-08-25T04:19:43.663405+0000","last_fullsized":"2023-08-25T04:19:43.663405+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:37.458532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895944+0000","last_change":"2023-08-25T04:19:40.893815+0000","last_active":"2023-08-25T04:19:42.895944+0000","last_peered":"2023-08-25T04:19:42.895944+0000","last_clean":"2023-08-25T04:19:42.895944+0000","last_became_active":"2023-08-25T04:19:40.893541+0000","last_became_peered":"2023-08-25T04:19:40.893541+0000","last_unstale":"2023-08-25T04:19:42.895944+0000","last_undegraded":"2023-08-25T04:19:42.895944+0000","last_fullsized":"2023-08-25T04:19:42.895944+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:49:32.003310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.664981+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:19:43.664981+0000","last_peered":"2023-08-25T04:19:43.664981+0000","last_clean":"2023-08-25T04:19:43.664981+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:19:43.664981+0000","last_undegraded":"2023-08-25T04:19:43.664981+0000","last_fullsized":"2023-08-25T04:19:43.664981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:15:08.893461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892167+0000","last_change":"2023-08-25T04:19:41.886006+0000","last_active":"2023-08-25T04:19:42.892167+0000","last_peered":"2023-08-25T04:19:42.892167+0000","last_clean":"2023-08-25T04:19:42.892167+0000","last_became_active":"2023-08-25T04:19:41.885711+0000","last_became_peered":"2023-08-25T04:19:41.885711+0000","last_unstale":"2023-08-25T04:19:42.892167+0000","last_undegraded":"2023-08-25T04:19:42.892167+0000","last_fullsized":"2023-08-25T04:19:42.892167+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:01:14.895211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892479+0000","last_change":"2023-08-25T04:19:40.887520+0000","last_active":"2023-08-25T04:19:42.892479+0000","last_peered":"2023-08-25T04:19:42.892479+0000","last_clean":"2023-08-25T04:19:42.892479+0000","last_became_active":"2023-08-25T04:19:40.887274+0000","last_became_peered":"2023-08-25T04:19:40.887274+0000","last_unstale":"2023-08-25T04:19:42.892479+0000","last_undegraded":"2023-08-25T04:19:42.892479+0000","last_fullsized":"2023-08-25T04:19:42.892479+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:53.057687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":161,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663219+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:19:43.663219+0000","last_peered":"2023-08-25T04:19:43.663219+0000","last_clean":"2023-08-25T04:19:43.663219+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:19:43.663219+0000","last_undegraded":"2023-08-25T04:19:43.663219+0000","last_fullsized":"2023-08-25T04:19:43.663219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:31:11.801727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.893991+0000","last_change":"2023-08-25T04:19:41.904671+0000","last_active":"2023-08-25T04:19:42.893991+0000","last_peered":"2023-08-25T04:19:42.893991+0000","last_clean":"2023-08-25T04:19:42.893991+0000","last_became_active":"2023-08-25T04:19:41.904380+0000","last_became_peered":"2023-08-25T04:19:41.904380+0000","last_unstale":"2023-08-25T04:19:42.893991+0000","last_undegraded":"2023-08-25T04:19:42.893991+0000","last_fullsized":"2023-08-25T04:19:42.893991+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:07.428454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663069+0000","last_change":"2023-08-25T04:19:40.888193+0000","last_active":"2023-08-25T04:19:43.663069+0000","last_peered":"2023-08-25T04:19:43.663069+0000","last_clean":"2023-08-25T04:19:43.663069+0000","last_became_active":"2023-08-25T04:19:40.887920+0000","last_became_peered":"2023-08-25T04:19:40.887920+0000","last_unstale":"2023-08-25T04:19:43.663069+0000","last_undegraded":"2023-08-25T04:19:43.663069+0000","last_fullsized":"2023-08-25T04:19:43.663069+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:58:58.763723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":177,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898997+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:19:42.898997+0000","last_peered":"2023-08-25T04:19:42.898997+0000","last_clean":"2023-08-25T04:19:42.898997+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:19:42.898997+0000","last_undegraded":"2023-08-25T04:19:42.898997+0000","last_fullsized":"2023-08-25T04:19:42.898997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:22:41.607949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.662935+0000","last_change":"2023-08-25T04:19:41.892591+0000","last_active":"2023-08-25T04:19:43.662935+0000","last_peered":"2023-08-25T04:19:43.662935+0000","last_clean":"2023-08-25T04:19:43.662935+0000","last_became_active":"2023-08-25T04:19:41.892253+0000","last_became_peered":"2023-08-25T04:19:41.892253+0000","last_unstale":"2023-08-25T04:19:43.662935+0000","last_undegraded":"2023-08-25T04:19:43.662935+0000","last_fullsized":"2023-08-25T04:19:43.662935+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:04:00.127628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665546+0000","last_change":"2023-08-25T04:19:40.898534+0000","last_active":"2023-08-25T04:19:43.665546+0000","last_peered":"2023-08-25T04:19:43.665546+0000","last_clean":"2023-08-25T04:19:43.665546+0000","last_became_active":"2023-08-25T04:19:40.898239+0000","last_became_peered":"2023-08-25T04:19:40.898239+0000","last_unstale":"2023-08-25T04:19:43.665546+0000","last_undegraded":"2023-08-25T04:19:43.665546+0000","last_fullsized":"2023-08-25T04:19:43.665546+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:04:10.020209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895889+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:19:42.895889+0000","last_peered":"2023-08-25T04:19:42.895889+0000","last_clean":"2023-08-25T04:19:42.895889+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:19:42.895889+0000","last_undegraded":"2023-08-25T04:19:42.895889+0000","last_fullsized":"2023-08-25T04:19:42.895889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:40:54.717094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663035+0000","last_change":"2023-08-25T04:19:41.897006+0000","last_active":"2023-08-25T04:19:43.663035+0000","last_peered":"2023-08-25T04:19:43.663035+0000","last_clean":"2023-08-25T04:19:43.663035+0000","last_became_active":"2023-08-25T04:19:41.896575+0000","last_became_peered":"2023-08-25T04:19:41.896575+0000","last_unstale":"2023-08-25T04:19:43.663035+0000","last_undegraded":"2023-08-25T04:19:43.663035+0000","last_fullsized":"2023-08-25T04:19:43.663035+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:49:20.325758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.662995+0000","last_change":"2023-08-25T04:19:40.898734+0000","last_active":"2023-08-25T04:19:43.662995+0000","last_peered":"2023-08-25T04:19:43.662995+0000","last_clean":"2023-08-25T04:19:43.662995+0000","last_became_active":"2023-08-25T04:19:40.898469+0000","last_became_peered":"2023-08-25T04:19:40.898469+0000","last_unstale":"2023-08-25T04:19:43.662995+0000","last_undegraded":"2023-08-25T04:19:43.662995+0000","last_fullsized":"2023-08-25T04:19:43.662995+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:14.479380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":176,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898973+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:19:42.898973+0000","last_peered":"2023-08-25T04:19:42.898973+0000","last_clean":"2023-08-25T04:19:42.898973+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:19:42.898973+0000","last_undegraded":"2023-08-25T04:19:42.898973+0000","last_fullsized":"2023-08-25T04:19:42.898973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:37:30.611911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894160+0000","last_change":"2023-08-25T04:19:41.905480+0000","last_active":"2023-08-25T04:19:42.894160+0000","last_peered":"2023-08-25T04:19:42.894160+0000","last_clean":"2023-08-25T04:19:42.894160+0000","last_became_active":"2023-08-25T04:19:41.905233+0000","last_became_peered":"2023-08-25T04:19:41.905233+0000","last_unstale":"2023-08-25T04:19:42.894160+0000","last_undegraded":"2023-08-25T04:19:42.894160+0000","last_fullsized":"2023-08-25T04:19:42.894160+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:11:44.431231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665040+0000","last_change":"2023-08-25T04:19:40.890287+0000","last_active":"2023-08-25T04:19:43.665040+0000","last_peered":"2023-08-25T04:19:43.665040+0000","last_clean":"2023-08-25T04:19:43.665040+0000","last_became_active":"2023-08-25T04:19:40.890025+0000","last_became_peered":"2023-08-25T04:19:40.890025+0000","last_unstale":"2023-08-25T04:19:43.665040+0000","last_undegraded":"2023-08-25T04:19:43.665040+0000","last_fullsized":"2023-08-25T04:19:43.665040+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:45:28.004590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663491+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:19:43.663491+0000","last_peered":"2023-08-25T04:19:43.663491+0000","last_clean":"2023-08-25T04:19:43.663491+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:19:43.663491+0000","last_undegraded":"2023-08-25T04:19:43.663491+0000","last_fullsized":"2023-08-25T04:19:43.663491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:30:49.149494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":750,"num_read_kb":1515,"num_write":285,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2822,"ondisk_log_size":2822,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509644,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55236,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316604,"statfs":{"total":96636764160,"available":96580202496,"internally_reserved":0,"allocated":1896448,"data_stored":1231149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.69199999999999995,"15min":0.70699999999999996},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.33700000000000002},"max":{"1min":0.85199999999999998,"5min":0.996,"15min":0.996},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70799999999999996,"15min":0.72299999999999998},"min":{"1min":0.51500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.92400000000000004,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.30299999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.42699999999999999},"max":{"1min":0.92100000000000004,"5min":0.95699999999999996,"15min":1.034},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.44700000000000001,"15min":0.374},"max":{"1min":0.995,"5min":0.995,"15min":1.036},"last":0.377}]},{"osd":2,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70399999999999996,"15min":0.71599999999999997},"min":{"1min":0.52400000000000002,"5min":0.42299999999999999,"15min":0.34899999999999998},"max":{"1min":0.84199999999999997,"5min":0.94499999999999995,"15min":1.018},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71799999999999997,"15min":0.747},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.54200000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.54400000000000004,"5min":0.47799999999999998,"15min":0.41899999999999998},"max":{"1min":0.877,"5min":0.92900000000000005,"15min":0.98399999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.432},"max":{"1min":0.90900000000000003,"5min":1.04,"15min":1.04},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.81599999999999995,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.441,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47099999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.86099999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.40000000000000002},"max":{"1min":0.83599999999999997,"5min":1.032,"15min":1.0349999999999999},"last":0.52600000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.53000000000000003,"5min":0.46700000000000003,"15min":0.436},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.497},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66100000000000003,"15min":0.66200000000000003},"min":{"1min":0.46999999999999997,"5min":0.42699999999999999,"15min":0.42399999999999999},"max":{"1min":0.94399999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.437}]}]},{"osd":6,"up_from":15,"seq":64424509644,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36624,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335216,"statfs":{"total":96636764160,"available":96599261184,"internally_reserved":0,"allocated":1314816,"data_stored":642941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66800000000000004,"15min":0.70399999999999996},"min":{"1min":0.34999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97099999999999997,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.497},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67700000000000005,"15min":0.69599999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95999999999999996,"5min":0.96899999999999997,"15min":1.054},"last":0.46800000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.69899999999999995,"15min":0.72999999999999998},"min":{"1min":0.41599999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.93600000000000005,"5min":1.0269999999999999,"15min":1.0369999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.72799999999999998},"min":{"1min":0.50700000000000001,"5min":0.495,"15min":0.47199999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70699999999999996,"15min":0.73599999999999999},"min":{"1min":0.48999999999999999,"5min":0.44,"15min":0.434},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.1020000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0169999999999999,"5min":1.0569999999999999,"15min":1.117},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.745,"15min":0.747},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.46899999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.76000000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49199999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.36499999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.443},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.40500000000000003,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.0820000000000001},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66800000000000004,"15min":0.65200000000000002},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.1220000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.745,"15min":0.73399999999999999},"min":{"1min":0.55500000000000005,"5min":0.443,"15min":0.40000000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.67200000000000004,"15min":0.66200000000000003},"min":{"1min":0.441,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.1950000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73199999999999998,"15min":0.70299999999999996},"min":{"1min":0.50600000000000001,"5min":0.45200000000000001,"15min":0.41799999999999998},"max":{"1min":1.1359999999999999,"5min":1.373,"15min":1.373},"last":0.66800000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542347,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":640725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66900000000000004,"15min":0.70899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.018},"last":0.495},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68899999999999995,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81999999999999995,"5min":0.97999999999999998,"15min":1.0409999999999999},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.69899999999999995,"15min":0.72999999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.36499999999999999},"max":{"1min":0.78000000000000003,"5min":0.95299999999999996,"15min":0.99399999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71499999999999997,"15min":0.73799999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90400000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.442}]},{"osd":2,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68000000000000005,"15min":0.72599999999999998},"min":{"1min":0.44800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83999999999999997,"5min":0.92800000000000005,"15min":0.97499999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92600000000000005,"5min":0.98499999999999999,"15min":1.0449999999999999},"last":0.57599999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.70999999999999996,"15min":0.73099999999999998},"min":{"1min":0.52600000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86499999999999999,"5min":0.93500000000000005,"15min":0.96999999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72499999999999998,"15min":0.76500000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.55200000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.40999999999999998,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.91000000000000003,"5min":0.92900000000000005,"15min":0.97099999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.86499999999999999,"5min":1.018,"15min":1.018},"last":0.46100000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.47399999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.008},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.878,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.54000000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.622,"15min":0.62},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.89300000000000002,"5min":1.002,"15min":1.032},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68899999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.96899999999999997,"15min":1.048},"last":0.52600000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542347,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36612,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335228,"statfs":{"total":96636764160,"available":96599273472,"internally_reserved":0,"allocated":1302528,"data_stored":640885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.67800000000000005,"15min":0.70099999999999996},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.84299999999999997,"5min":0.97399999999999998,"15min":0.99299999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68600000000000005,"15min":0.70099999999999996},"min":{"1min":0.48599999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.96699999999999997},"last":0.52600000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.49399999999999999,"5min":0.45100000000000001,"15min":0.36199999999999999},"max":{"1min":0.85699999999999998,"5min":0.98399999999999999,"15min":1.0449999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70399999999999996,"15min":0.73499999999999999},"min":{"1min":0.44,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.872,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39100000000000001},"max":{"1min":0.879,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":0.91600000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.52900000000000003,"5min":0.51300000000000001,"15min":0.45100000000000001},"max":{"1min":0.90200000000000002,"5min":0.98299999999999998,"15min":1.048},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.72999999999999998,"15min":0.752},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80700000000000005,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.40899999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.59099999999999997},"min":{"1min":0.42599999999999999,"5min":0.376,"15min":0.33200000000000002},"max":{"1min":0.91400000000000003,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.45400000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.745,"15min":0.73499999999999999},"min":{"1min":0.496,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.96299999999999997,"5min":1.093,"15min":1.093},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65300000000000002,"15min":0.64000000000000001},"min":{"1min":0.48299999999999998,"5min":0.42299999999999999,"15min":0.40300000000000002},"max":{"1min":0.85999999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.50600000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.36699999999999999},"max":{"1min":0.84899999999999998,"5min":0.90100000000000002,"15min":0.94499999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.60299999999999998,"5min":0.48099999999999998,"15min":0.39300000000000002},"max":{"1min":0.94299999999999995,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.49199999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542347,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36612,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335228,"statfs":{"total":96636764160,"available":96599273472,"internally_reserved":0,"allocated":1294336,"data_stored":640725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.439,"15min":0.45000000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27300000000000002},"max":{"1min":0.70199999999999996,"5min":0.93700000000000006,"15min":0.96899999999999997},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51100000000000001,"15min":0.52200000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66200000000000003,"5min":0.77100000000000002,"15min":0.91500000000000004},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.49199999999999999,"15min":0.5},"min":{"1min":0.34000000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.42199999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.748,"5min":0.80300000000000005,"15min":0.92600000000000005},"last":0.46200000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55500000000000005,"15min":0.57199999999999995},"min":{"1min":0.38700000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":0.85499999999999998,"15min":1.01},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.54500000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.70799999999999996,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.58499999999999996}]},{"osd":4,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.752,"15min":0.75600000000000001},"min":{"1min":0.56399999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0209999999999999,"5min":1.214,"15min":1.214},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.57899999999999996,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0760000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.502}]},{"osd":5,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.52900000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0349999999999999,"5min":1.254,"15min":1.254},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.78600000000000003},"min":{"1min":0.53700000000000003,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":0.99099999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.59499999999999997,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":1.119,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77700000000000002,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.51600000000000001,"15min":0.50700000000000001},"max":{"1min":0.94699999999999995,"5min":1.0800000000000001,"15min":1.177},"last":0.55400000000000005}]},{"osd":7,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79100000000000004,"15min":0.82599999999999996},"min":{"1min":0.57199999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.96899999999999997,"5min":1.077,"15min":1.194},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.79400000000000004,"15min":0.79700000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0049999999999999,"5min":1.079,"15min":1.1160000000000001},"last":0.67100000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542348,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54652,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317188,"statfs":{"total":96636764160,"available":96580800512,"internally_reserved":0,"allocated":1294336,"data_stored":640725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.28799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59699999999999998,"5min":0.85599999999999998,"15min":0.92000000000000004},"last":0.255},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.47899999999999998,"15min":0.495},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.61899999999999999,"5min":0.81000000000000005,"15min":0.93100000000000005},"last":0.312}]},{"osd":1,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.61299999999999999,"5min":0.78800000000000003,"15min":0.85499999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.57199999999999995,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.56699999999999995,"5min":0.81699999999999995,"15min":0.89800000000000002},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.51800000000000002,"15min":0.53200000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":0.65700000000000003,"5min":0.82199999999999995,"15min":0.82299999999999995},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59099999999999997,"5min":0.85399999999999998,"15min":0.89400000000000002},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.77600000000000002,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.502,"15min":0.502},"max":{"1min":0.82199999999999995,"5min":1.1990000000000001,"15min":1.2569999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.52000000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89400000000000002,"5min":1.151,"15min":1.5509999999999999},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.77900000000000003,"15min":0.79900000000000004},"min":{"1min":0.53000000000000003,"5min":0.52600000000000002,"15min":0.498},"max":{"1min":0.93700000000000006,"5min":1.1080000000000001,"15min":1.2789999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77700000000000002,"15min":0.80400000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.48299999999999998},"max":{"1min":0.86799999999999999,"5min":1.2130000000000001,"15min":1.3089999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.78200000000000003,"15min":0.82099999999999995},"min":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.82799999999999996,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.496},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.84999999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.90200000000000002,"5min":1.25,"15min":1.375},"last":0.57099999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.77600000000000002,"15min":0.79800000000000004},"min":{"1min":0.54200000000000004,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":0.878,"5min":1.0860000000000001,"15min":1.339},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.77900000000000003,"15min":0.80500000000000005},"min":{"1min":0.57099999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.80600000000000005,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.44}]}]},{"osd":1,"up_from":14,"seq":60129542348,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36608,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335232,"statfs":{"total":96636764160,"available":96599277568,"internally_reserved":0,"allocated":1298432,"data_stored":640795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.27400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.96899999999999997},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.54400000000000004,"15min":0.52200000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67400000000000004,"5min":1.212,"15min":1.212},"last":0.34300000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.30499999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79200000000000004,"5min":0.876,"15min":0.876},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.36299999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83199999999999996,"5min":0.877,"15min":1.02},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.59899999999999998,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71699999999999997,"5min":0.93100000000000005,"15min":1.018},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74099999999999999,"5min":1.165,"15min":1.165},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.747,"15min":0.76900000000000002},"min":{"1min":0.48899999999999999,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":1.012,"5min":1.204,"15min":1.204},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78900000000000003,"15min":0.80400000000000005},"min":{"1min":0.53900000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.5}]},{"osd":5,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.753,"15min":0.78400000000000003},"min":{"1min":0.496,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96899999999999997,"5min":1.254,"15min":1.254},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.77900000000000003,"15min":0.80300000000000005},"min":{"1min":0.54700000000000004,"5min":0.51400000000000001,"15min":0.51000000000000001},"max":{"1min":0.97999999999999998,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.97599999999999998,"5min":1.623,"15min":1.623},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93700000000000006,"5min":1.288,"15min":1.288},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77900000000000003,"15min":0.80700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.99199999999999999,"5min":1.1240000000000001,"15min":1.2949999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.60899999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1,"5min":1.1140000000000001,"15min":1.3120000000000001},"last":0.60899999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542347,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28888,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342952,"statfs":{"total":96636764160,"available":96607182848,"internally_reserved":0,"allocated":1912832,"data_stored":1233411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36099999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63,"5min":0.72499999999999998,"15min":0.79500000000000004},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.55200000000000005,"15min":0.56499999999999995},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.502,"15min":0.52000000000000002},"min":{"1min":0.32800000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.97499999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.64700000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48699999999999999,"15min":0.499},"min":{"1min":0.30499999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.85099999999999998,"15min":1.2470000000000001},"last":0.504}]},{"osd":4,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79300000000000004,"15min":0.79500000000000004},"min":{"1min":0.55900000000000005,"5min":0.52600000000000002,"15min":0.503},"max":{"1min":0.95599999999999996,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.79200000000000004,"15min":0.80600000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.436},"max":{"1min":0.86799999999999999,"5min":1.169,"15min":1.234},"last":0.60699999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.52800000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.97799999999999998,"5min":3.528,"15min":3.528},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.56399999999999995,"5min":0.47199999999999998,"15min":0.45500000000000002},"max":{"1min":1.0680000000000001,"5min":1.121,"15min":1.2230000000000001},"last":0.625}]},{"osd":6,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.80100000000000005,"15min":0.80000000000000004},"min":{"1min":0.56699999999999995,"5min":0.54400000000000004,"15min":0.53700000000000003},"max":{"1min":0.89200000000000002,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.82099999999999995,"15min":0.82999999999999996},"min":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.502},"max":{"1min":1.0349999999999999,"5min":1.1870000000000001,"15min":1.194},"last":0.67100000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82499999999999996,"15min":0.84299999999999997},"min":{"1min":0.59699999999999998,"5min":0.56399999999999995,"15min":0.52900000000000003},"max":{"1min":1.101,"5min":1.151,"15min":1.2849999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96999999999999997,"5min":1.1220000000000001,"15min":1.1930000000000001},"last":0.54600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:19:46.829 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-25T04:19:47.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.017+0000 7faa7e434640 1 Processor -- start 2023-08-25T04:19:47.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.017+0000 7faa7e434640 1 -- start start 2023-08-25T04:19:47.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.021+0000 7faa7e434640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa780d0d30 0x7faa780b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:47.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.021+0000 7faa7e434640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa780cd9d0 0x7faa780cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:47.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.021+0000 7faa7e434640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa780cfbc0 con 0x7faa780d1110 2023-08-25T04:19:47.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.021+0000 7faa7e434640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa780cd5b0 con 0x7faa780cd9d0 2023-08-25T04:19:47.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.021+0000 7faa7e434640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa780cf320 con 0x7faa780d0d30 2023-08-25T04:19:47.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.021+0000 7faa7c9d1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa780cd9d0 0x7faa780cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:47.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.021+0000 7faa7c9d1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa780cd9d0 0x7faa780cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58632/0 (socket says 172.21.15.55:58632) 2023-08-25T04:19:47.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.021+0000 7faa7c9d1640 1 -- 172.21.15.55:0/1552507255 learned_addr learned my addr 172.21.15.55:0/1552507255 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:47.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.021+0000 7faa77fff640 1 --2- 172.21.15.55:0/1552507255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa780d0d30 0x7faa780b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:47.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.021+0000 7faa7c9d1640 1 -- 172.21.15.55:0/1552507255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa780d0d30 msgr2=0x7faa780b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:47.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.021+0000 7faa7c9d1640 1 --2- 172.21.15.55:0/1552507255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa780d0d30 0x7faa780b55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.021+0000 7faa7c9d1640 1 -- 172.21.15.55:0/1552507255 >> v1:172.21.15.55:6789/0 conn(0x7faa780d1110 legacy=0x7faa780d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:47.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.021+0000 7faa7c9d1640 1 -- 172.21.15.55:0/1552507255 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa780cf600 con 0x7faa780cd9d0 2023-08-25T04:19:47.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.021+0000 7faa77fff640 1 --2- 172.21.15.55:0/1552507255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa780d0d30 0x7faa780b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:47.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.021+0000 7faa7c9d1640 1 --2- 172.21.15.55:0/1552507255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa780cd9d0 0x7faa780cde60 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7faa70009e50 tx=0x7faa7001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f92785673ec64b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.021+0000 7faa76ffd640 1 -- 172.21.15.55:0/1552507255 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa700a5830 con 0x7faa780cd9d0 2023-08-25T04:19:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa76ffd640 1 -- 172.21.15.55:0/1552507255 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa700a5990 con 0x7faa780cd9d0 2023-08-25T04:19:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa76ffd640 1 -- 172.21.15.55:0/1552507255 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa700a5d20 con 0x7faa780cd9d0 2023-08-25T04:19:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa7e434640 1 -- 172.21.15.55:0/1552507255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa780cd9d0 msgr2=0x7faa780cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa7e434640 1 --2- 172.21.15.55:0/1552507255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa780cd9d0 0x7faa780cde60 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7faa70009e50 tx=0x7faa7001c950 comp rx=0 tx=0).stop 2023-08-25T04:19:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa7e434640 1 -- 172.21.15.55:0/1552507255 shutdown_connections 2023-08-25T04:19:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa7e434640 1 --2- 172.21.15.55:0/1552507255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa780cd9d0 0x7faa780cde60 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa7e434640 1 --2- 172.21.15.55:0/1552507255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa780d0d30 0x7faa780b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa7e434640 1 -- 172.21.15.55:0/1552507255 >> 172.21.15.55:0/1552507255 conn(0x7faa7809baf0 msgr2=0x7faa780d2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa7e434640 1 -- 172.21.15.55:0/1552507255 shutdown_connections 2023-08-25T04:19:47.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa7e434640 1 -- 172.21.15.55:0/1552507255 wait complete. 2023-08-25T04:19:47.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa7e434640 1 Processor -- start 2023-08-25T04:19:47.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa7e434640 1 -- start start 2023-08-25T04:19:47.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa7e434640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa780cd9d0 0x7faa78154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:47.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa7e434640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa780d0d30 0x7faa780cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:47.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa7e434640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa780d1110 0x7faa78150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:47.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa7e434640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7815aaa0 con 0x7faa780d0d30 2023-08-25T04:19:47.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa7e434640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa781f98e0 con 0x7faa780d1110 2023-08-25T04:19:47.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa7e434640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7815acf0 con 0x7faa780cd9d0 2023-08-25T04:19:47.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa780d0d30 0x7faa780cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:47.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa77fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa780cd9d0 0x7faa78154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:47.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.025+0000 7faa777fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa780d0d30 0x7faa780cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58636/0 (socket says 172.21.15.55:58636) 2023-08-25T04:19:47.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.029+0000 7faa777fe640 1 -- 172.21.15.55:0/146777052 learned_addr learned my addr 172.21.15.55:0/146777052 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:47.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.029+0000 7faa7c9d1640 1 --2- 172.21.15.55:0/146777052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa780d1110 0x7faa78150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:47.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.029+0000 7faa777fe640 1 -- 172.21.15.55:0/146777052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa780cd9d0 msgr2=0x7faa78154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:47.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.029+0000 7faa777fe640 1 --2- 172.21.15.55:0/146777052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa780cd9d0 0x7faa78154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.029+0000 7faa777fe640 1 -- 172.21.15.55:0/146777052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa780d1110 msgr2=0x7faa78150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.029+0000 7faa777fe640 1 --2- 172.21.15.55:0/146777052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa780d1110 0x7faa78150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.029+0000 7faa777fe640 1 -- 172.21.15.55:0/146777052 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa70009b30 con 0x7faa780d0d30 2023-08-25T04:19:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.029+0000 7faa777fe640 1 --2- 172.21.15.55:0/146777052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa780d0d30 0x7faa780cbf40 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00c500 tx=0x7faa6c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.029+0000 7faa74ff9640 1 -- 172.21.15.55:0/146777052 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c005220 con 0x7faa780d0d30 2023-08-25T04:19:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.029+0000 7faa74ff9640 1 -- 172.21.15.55:0/146777052 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c005380 con 0x7faa780d0d30 2023-08-25T04:19:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.029+0000 7faa74ff9640 1 -- 172.21.15.55:0/146777052 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c007270 con 0x7faa780d0d30 2023-08-25T04:19:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.029+0000 7faa7e434640 1 -- 172.21.15.55:0/146777052 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7815afd0 con 0x7faa780d0d30 2023-08-25T04:19:47.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.029+0000 7faa7e434640 1 -- 172.21.15.55:0/146777052 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7815b590 con 0x7faa780d0d30 2023-08-25T04:19:47.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.029+0000 7faa7e434640 1 -- 172.21.15.55:0/146777052 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa7804dbe0 con 0x7faa780d0d30 2023-08-25T04:19:47.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.029+0000 7faa74ff9640 1 -- 172.21.15.55:0/146777052 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7faa6c0073d0 con 0x7faa780d0d30 2023-08-25T04:19:47.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.029+0000 7faa74ff9640 1 --2- 172.21.15.55:0/146777052 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7faa64065710 0x7faa64067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:47.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.029+0000 7faa74ff9640 1 -- 172.21.15.55:0/146777052 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faa6c082660 con 0x7faa780d0d30 2023-08-25T04:19:47.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.033+0000 7faa77fff640 1 --2- 172.21.15.55:0/146777052 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7faa64065710 0x7faa64067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:47.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.033+0000 7faa77fff640 1 --2- 172.21.15.55:0/146777052 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7faa64065710 0x7faa64067bd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faa68006fd0 tx=0x7faa68008040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:47.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.033+0000 7faa74ff9640 1 -- 172.21.15.55:0/146777052 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7faa6c0500f0 con 0x7faa780d0d30 2023-08-25T04:19:47.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.252+0000 7faa7e434640 1 -- 172.21.15.55:0/146777052 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7faa78159620 con 0x7faa780d0d30 2023-08-25T04:19:47.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.252+0000 7faa74ff9640 1 -- 172.21.15.55:0/146777052 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3233 (secure 0 0 0) 0x7faa6c053710 con 0x7faa780d0d30 2023-08-25T04:19:47.255 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:47.255 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1031,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":106,"num_osds":8,"num_up_osds":8,"osd_up_since":1692936167,"num_in_osds":8,"osd_in_since":1692936158,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592778,"bytes_used":325300224,"bytes_avail":772768813056,"bytes_total":773094113280,"read_bytes_sec":2388,"write_bytes_sec":2388,"read_op_per_sec":2,"write_op_per_sec":7},"fsmap":{"epoch":49,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7860}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2023-08-25T04:19:28.457714+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-25T04:19:47.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.256+0000 7faa7e434640 1 -- 172.21.15.55:0/146777052 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7faa64065710 msgr2=0x7faa64067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:47.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.256+0000 7faa7e434640 1 --2- 172.21.15.55:0/146777052 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7faa64065710 0x7faa64067bd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faa68006fd0 tx=0x7faa68008040 comp rx=0 tx=0).stop 2023-08-25T04:19:47.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.256+0000 7faa7e434640 1 -- 172.21.15.55:0/146777052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa780d0d30 msgr2=0x7faa780cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:47.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.256+0000 7faa7e434640 1 --2- 172.21.15.55:0/146777052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa780d0d30 0x7faa780cbf40 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7faa6c00c500 tx=0x7faa6c00c9c0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.256+0000 7faa7e434640 1 -- 172.21.15.55:0/146777052 shutdown_connections 2023-08-25T04:19:47.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.256+0000 7faa7e434640 1 --2- 172.21.15.55:0/146777052 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa780d1110 0x7faa78150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.256+0000 7faa7e434640 1 --2- 172.21.15.55:0/146777052 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa780d0d30 0x7faa780cbf40 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.256+0000 7faa7e434640 1 --2- 172.21.15.55:0/146777052 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7faa64065710 0x7faa64067bd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.256+0000 7faa7e434640 1 --2- 172.21.15.55:0/146777052 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa780cd9d0 0x7faa78154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.256+0000 7faa7e434640 1 -- 172.21.15.55:0/146777052 >> 172.21.15.55:0/146777052 conn(0x7faa7809baf0 msgr2=0x7faa780b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:47.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.256+0000 7faa7e434640 1 -- 172.21.15.55:0/146777052 shutdown_connections 2023-08-25T04:19:47.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.256+0000 7faa7e434640 1 -- 172.21.15.55:0/146777052 wait complete. 2023-08-25T04:19:47.277 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-25T04:19:47.278 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:19:47.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.428+0000 7f98a4137640 1 Processor -- start 2023-08-25T04:19:47.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.428+0000 7f98a4137640 1 -- start start 2023-08-25T04:19:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.428+0000 7f98a4137640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f989c0d0da0 0x7f989c0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:47.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.432+0000 7f98a4137640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f989c0b3e50 0x7f989c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:47.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.432+0000 7f98a4137640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989c0b29b0 con 0x7f989c0cdde0 2023-08-25T04:19:47.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.432+0000 7f98a4137640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989c0ce760 con 0x7f989c0d0da0 2023-08-25T04:19:47.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.432+0000 7f98a4137640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0d16c0 con 0x7f989c0b3e50 2023-08-25T04:19:47.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.432+0000 7f98a16d2640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f989c0cdde0 0x7f989c0cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43928/0 (socket says 172.21.15.55:43928) 2023-08-25T04:19:47.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.432+0000 7f98a16d2640 1 -- 172.21.15.55:0/373506112 learned_addr learned my addr 172.21.15.55:0/373506112 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:47.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.432+0000 7f98a1ed3640 1 --2- 172.21.15.55:0/373506112 >> v2:172.21.15.110:3300/0 conn(0x7f989c0d0da0 0x7f989c0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:47.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.432+0000 7f98a26d4640 1 --2- 172.21.15.55:0/373506112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f989c0b3e50 0x7f989c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:47.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.432+0000 7f98a0ed1640 1 -- 172.21.15.55:0/373506112 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910607508 0 0) 0x7f989c0b29b0 con 0x7f989c0cdde0 2023-08-25T04:19:47.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.432+0000 7f98a0ed1640 1 -- 172.21.15.55:0/373506112 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9888003530 con 0x7f989c0cdde0 2023-08-25T04:19:47.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.432+0000 7f98a1ed3640 1 -- 172.21.15.55:0/373506112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f989c0b3e50 msgr2=0x7f989c0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:47.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.432+0000 7f98a1ed3640 1 --2- 172.21.15.55:0/373506112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f989c0b3e50 0x7f989c0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.432+0000 7f98a1ed3640 1 -- 172.21.15.55:0/373506112 >> v1:172.21.15.55:6789/0 conn(0x7f989c0cdde0 legacy=0x7f989c0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.432+0000 7f98a1ed3640 1 -- 172.21.15.55:0/373506112 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c0b1dc0 con 0x7f989c0d0da0 2023-08-25T04:19:47.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.432+0000 7f98a26d4640 1 --2- 172.21.15.55:0/373506112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f989c0b3e50 0x7f989c0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.432+0000 7f98a1ed3640 1 --2- 172.21.15.55:0/373506112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c0d0da0 0x7f989c0d1180 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f98980097a0 tx=0x7f989801ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59ac75802bfc1b3a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a0ed1640 1 -- 172.21.15.55:0/373506112 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98980a8950 con 0x7f989c0d0da0 2023-08-25T04:19:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a0ed1640 1 -- 172.21.15.55:0/373506112 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98980a8ab0 con 0x7f989c0d0da0 2023-08-25T04:19:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a0ed1640 1 -- 172.21.15.55:0/373506112 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98980a8e40 con 0x7f989c0d0da0 2023-08-25T04:19:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a4137640 1 -- 172.21.15.55:0/373506112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c0d0da0 msgr2=0x7f989c0d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a4137640 1 --2- 172.21.15.55:0/373506112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c0d0da0 0x7f989c0d1180 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f98980097a0 tx=0x7f989801ec50 comp rx=0 tx=0).stop 2023-08-25T04:19:47.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a4137640 1 -- 172.21.15.55:0/373506112 shutdown_connections 2023-08-25T04:19:47.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a4137640 1 --2- 172.21.15.55:0/373506112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f989c0b3e50 0x7f989c0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a4137640 1 --2- 172.21.15.55:0/373506112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c0d0da0 0x7f989c0d1180 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a4137640 1 -- 172.21.15.55:0/373506112 >> 172.21.15.55:0/373506112 conn(0x7f989c09bae0 msgr2=0x7f989c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:47.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a4137640 1 -- 172.21.15.55:0/373506112 shutdown_connections 2023-08-25T04:19:47.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a4137640 1 -- 172.21.15.55:0/373506112 wait complete. 2023-08-25T04:19:47.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a4137640 1 Processor -- start 2023-08-25T04:19:47.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a4137640 1 -- start start 2023-08-25T04:19:47.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a4137640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f989c0b3e50 0x7f989c0cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:47.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a4137640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c0cdde0 0x7f989c15fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:47.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a4137640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f989c0d0da0 0x7f989c0c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:47.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a4137640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c160080 con 0x7f989c0b3e50 2023-08-25T04:19:47.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a4137640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0c6830 con 0x7f989c0cdde0 2023-08-25T04:19:47.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.436+0000 7f98a4137640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0c6a60 con 0x7f989c0d0da0 2023-08-25T04:19:47.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.440+0000 7f98a1ed3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f989c0b3e50 0x7f989c0cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:47.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.440+0000 7f98a1ed3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f989c0b3e50 0x7f989c0cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58648/0 (socket says 172.21.15.55:58648) 2023-08-25T04:19:47.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.440+0000 7f98a1ed3640 1 -- 172.21.15.55:0/1215351705 learned_addr learned my addr 172.21.15.55:0/1215351705 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:47.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.440+0000 7f98a16d2640 1 --2- 172.21.15.55:0/1215351705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c0cdde0 0x7f989c15fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:47.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.440+0000 7f98a26d4640 1 --2- 172.21.15.55:0/1215351705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f989c0d0da0 0x7f989c0c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:47.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.440+0000 7f98a1ed3640 1 -- 172.21.15.55:0/1215351705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f989c0d0da0 msgr2=0x7f989c0c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:47.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.440+0000 7f98a1ed3640 1 --2- 172.21.15.55:0/1215351705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f989c0d0da0 0x7f989c0c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.440+0000 7f98a1ed3640 1 -- 172.21.15.55:0/1215351705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c0cdde0 msgr2=0x7f989c15fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:47.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.440+0000 7f98a1ed3640 1 --2- 172.21.15.55:0/1215351705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c0cdde0 0x7f989c15fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.440+0000 7f98a1ed3640 1 -- 172.21.15.55:0/1215351705 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9894009a70 con 0x7f989c0b3e50 2023-08-25T04:19:47.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.440+0000 7f98a1ed3640 1 --2- 172.21.15.55:0/1215351705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f989c0b3e50 0x7f989c0cc2b0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f989801d300 tx=0x7f989801b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:47.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.440+0000 7f98927fc640 1 -- 172.21.15.55:0/1215351705 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98980b0d20 con 0x7f989c0b3e50 2023-08-25T04:19:47.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.440+0000 7f98927fc640 1 -- 172.21.15.55:0/1215351705 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9898006dc0 con 0x7f989c0b3e50 2023-08-25T04:19:47.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.440+0000 7f98927fc640 1 -- 172.21.15.55:0/1215351705 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98980b0ea0 con 0x7f989c0b3e50 2023-08-25T04:19:47.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.440+0000 7f98a4137640 1 -- 172.21.15.55:0/1215351705 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98980093b0 con 0x7f989c0b3e50 2023-08-25T04:19:47.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.440+0000 7f98a4137640 1 -- 172.21.15.55:0/1215351705 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989c0c7020 con 0x7f989c0b3e50 2023-08-25T04:19:47.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.440+0000 7f98a4137640 1 -- 172.21.15.55:0/1215351705 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989c04dbe0 con 0x7f989c0b3e50 2023-08-25T04:19:47.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.440+0000 7f98927fc640 1 -- 172.21.15.55:0/1215351705 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f98980b7040 con 0x7f989c0b3e50 2023-08-25T04:19:47.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.444+0000 7f98927fc640 1 --2- 172.21.15.55:0/1215351705 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f9880065710 0x7f9880067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:47.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.444+0000 7f98927fc640 1 -- 172.21.15.55:0/1215351705 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f98981208b0 con 0x7f989c0b3e50 2023-08-25T04:19:47.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.444+0000 7f98a16d2640 1 --2- 172.21.15.55:0/1215351705 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f9880065710 0x7f9880067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:47.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.444+0000 7f98a16d2640 1 --2- 172.21.15.55:0/1215351705 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f9880065710 0x7f9880067bd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f989c06c790 tx=0x7f988c007d40 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:47.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.448+0000 7f98927fc640 1 -- 172.21.15.55:0/1215351705 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f98980ee280 con 0x7f989c0b3e50 2023-08-25T04:19:47.522 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:47.520+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:47.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.608+0000 7f98a4137640 1 -- 172.21.15.55:0/1215351705 --> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f989c0b2360 con 0x7f9880065710 2023-08-25T04:19:47.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.616+0000 7f98927fc640 1 -- 172.21.15.55:0/1215351705 <== mgr.7111 v2:172.21.15.110:6832/1337211678 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311896 (secure 0 0 0) 0x7f988c001510 con 0x7f9880065710 2023-08-25T04:19:47.618 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:47.621 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:19:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.620+0000 7f98a4137640 1 -- 172.21.15.55:0/1215351705 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f9880065710 msgr2=0x7f9880067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:47.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.620+0000 7f98a4137640 1 --2- 172.21.15.55:0/1215351705 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f9880065710 0x7f9880067bd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f989c06c790 tx=0x7f988c007d40 comp rx=0 tx=0).stop 2023-08-25T04:19:47.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.620+0000 7f98a4137640 1 -- 172.21.15.55:0/1215351705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f989c0b3e50 msgr2=0x7f989c0cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:47.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.620+0000 7f98a4137640 1 --2- 172.21.15.55:0/1215351705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f989c0b3e50 0x7f989c0cc2b0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f989801d300 tx=0x7f989801b9f0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.620+0000 7f98a4137640 1 -- 172.21.15.55:0/1215351705 shutdown_connections 2023-08-25T04:19:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.620+0000 7f98a4137640 1 --2- 172.21.15.55:0/1215351705 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f9880065710 0x7f9880067bd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.620+0000 7f98a4137640 1 --2- 172.21.15.55:0/1215351705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f989c0d0da0 0x7f989c0c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.620+0000 7f98a4137640 1 --2- 172.21.15.55:0/1215351705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f989c0cdde0 0x7f989c15fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.620+0000 7f98a4137640 1 --2- 172.21.15.55:0/1215351705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f989c0b3e50 0x7f989c0cc2b0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.620+0000 7f98a4137640 1 -- 172.21.15.55:0/1215351705 >> 172.21.15.55:0/1215351705 conn(0x7f989c09bae0 msgr2=0x7f989c06b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.620+0000 7f98a4137640 1 -- 172.21.15.55:0/1215351705 shutdown_connections 2023-08-25T04:19:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:47.620+0000 7f98a4137640 1 -- 172.21.15.55:0/1215351705 wait complete. 2023-08-25T04:19:47.641 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-25T04:19:46.460696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":750,"num_read_kb":1515,"num_write":329,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2860,"ondisk_log_size":2860,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":205,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317676,"kb_used_data":11336,"kb_used_omap":13,"kb_used_meta":306226,"kb_avail":754657044,"statfs":{"total":773094113280,"available":772768813056,"internally_reserved":0,"allocated":11608064,"data_stored":6311356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":313575512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000945"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665857+0000","last_change":"2023-08-25T04:19:41.911968+0000","last_active":"2023-08-25T04:19:43.665857+0000","last_peered":"2023-08-25T04:19:43.665857+0000","last_clean":"2023-08-25T04:19:43.665857+0000","last_became_active":"2023-08-25T04:19:41.911670+0000","last_became_peered":"2023-08-25T04:19:41.911670+0000","last_unstale":"2023-08-25T04:19:43.665857+0000","last_undegraded":"2023-08-25T04:19:43.665857+0000","last_fullsized":"2023-08-25T04:19:43.665857+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:53:47.690264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663541+0000","last_change":"2023-08-25T04:19:41.892316+0000","last_active":"2023-08-25T04:19:43.663541+0000","last_peered":"2023-08-25T04:19:43.663541+0000","last_clean":"2023-08-25T04:19:43.663541+0000","last_became_active":"2023-08-25T04:19:41.892060+0000","last_became_peered":"2023-08-25T04:19:41.892060+0000","last_unstale":"2023-08-25T04:19:43.663541+0000","last_undegraded":"2023-08-25T04:19:43.663541+0000","last_fullsized":"2023-08-25T04:19:43.663541+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:24:14.597393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665728+0000","last_change":"2023-08-25T04:19:41.897841+0000","last_active":"2023-08-25T04:19:43.665728+0000","last_peered":"2023-08-25T04:19:43.665728+0000","last_clean":"2023-08-25T04:19:43.665728+0000","last_became_active":"2023-08-25T04:19:41.896231+0000","last_became_peered":"2023-08-25T04:19:41.896231+0000","last_unstale":"2023-08-25T04:19:43.665728+0000","last_undegraded":"2023-08-25T04:19:43.665728+0000","last_fullsized":"2023-08-25T04:19:43.665728+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:00:42.950350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898716+0000","last_change":"2023-08-25T04:19:41.886280+0000","last_active":"2023-08-25T04:19:42.898716+0000","last_peered":"2023-08-25T04:19:42.898716+0000","last_clean":"2023-08-25T04:19:42.898716+0000","last_became_active":"2023-08-25T04:19:41.885639+0000","last_became_peered":"2023-08-25T04:19:41.885639+0000","last_unstale":"2023-08-25T04:19:42.898716+0000","last_undegraded":"2023-08-25T04:19:42.898716+0000","last_fullsized":"2023-08-25T04:19:42.898716+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:11.504511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892382+0000","last_change":"2023-08-25T04:19:41.883507+0000","last_active":"2023-08-25T04:19:42.892382+0000","last_peered":"2023-08-25T04:19:42.892382+0000","last_clean":"2023-08-25T04:19:42.892382+0000","last_became_active":"2023-08-25T04:19:41.883243+0000","last_became_peered":"2023-08-25T04:19:41.883243+0000","last_unstale":"2023-08-25T04:19:42.892382+0000","last_undegraded":"2023-08-25T04:19:42.892382+0000","last_fullsized":"2023-08-25T04:19:42.892382+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:39:23.545519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.893868+0000","last_change":"2023-08-25T04:19:41.908334+0000","last_active":"2023-08-25T04:19:42.893868+0000","last_peered":"2023-08-25T04:19:42.893868+0000","last_clean":"2023-08-25T04:19:42.893868+0000","last_became_active":"2023-08-25T04:19:41.908055+0000","last_became_peered":"2023-08-25T04:19:41.908055+0000","last_unstale":"2023-08-25T04:19:42.893868+0000","last_undegraded":"2023-08-25T04:19:42.893868+0000","last_fullsized":"2023-08-25T04:19:42.893868+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:58:53.278718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895721+0000","last_change":"2023-08-25T04:19:41.903035+0000","last_active":"2023-08-25T04:19:42.895721+0000","last_peered":"2023-08-25T04:19:42.895721+0000","last_clean":"2023-08-25T04:19:42.895721+0000","last_became_active":"2023-08-25T04:19:41.902730+0000","last_became_peered":"2023-08-25T04:19:41.902730+0000","last_unstale":"2023-08-25T04:19:42.895721+0000","last_undegraded":"2023-08-25T04:19:42.895721+0000","last_fullsized":"2023-08-25T04:19:42.895721+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:01.500747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898638+0000","last_change":"2023-08-25T04:19:41.900303+0000","last_active":"2023-08-25T04:19:42.898638+0000","last_peered":"2023-08-25T04:19:42.898638+0000","last_clean":"2023-08-25T04:19:42.898638+0000","last_became_active":"2023-08-25T04:19:41.899626+0000","last_became_peered":"2023-08-25T04:19:41.899626+0000","last_unstale":"2023-08-25T04:19:42.898638+0000","last_undegraded":"2023-08-25T04:19:42.898638+0000","last_fullsized":"2023-08-25T04:19:42.898638+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:52:19.962525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892095+0000","last_change":"2023-08-25T04:19:41.890680+0000","last_active":"2023-08-25T04:19:42.892095+0000","last_peered":"2023-08-25T04:19:42.892095+0000","last_clean":"2023-08-25T04:19:42.892095+0000","last_became_active":"2023-08-25T04:19:41.890417+0000","last_became_peered":"2023-08-25T04:19:41.890417+0000","last_unstale":"2023-08-25T04:19:42.892095+0000","last_undegraded":"2023-08-25T04:19:42.892095+0000","last_fullsized":"2023-08-25T04:19:42.892095+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:11:00.286732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665426+0000","last_change":"2023-08-25T04:19:41.894756+0000","last_active":"2023-08-25T04:19:43.665426+0000","last_peered":"2023-08-25T04:19:43.665426+0000","last_clean":"2023-08-25T04:19:43.665426+0000","last_became_active":"2023-08-25T04:19:41.893942+0000","last_became_peered":"2023-08-25T04:19:41.893942+0000","last_unstale":"2023-08-25T04:19:43.665426+0000","last_undegraded":"2023-08-25T04:19:43.665426+0000","last_fullsized":"2023-08-25T04:19:43.665426+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:54:06.413955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892313+0000","last_change":"2023-08-25T04:19:41.912192+0000","last_active":"2023-08-25T04:19:42.892313+0000","last_peered":"2023-08-25T04:19:42.892313+0000","last_clean":"2023-08-25T04:19:42.892313+0000","last_became_active":"2023-08-25T04:19:41.911494+0000","last_became_peered":"2023-08-25T04:19:41.911494+0000","last_unstale":"2023-08-25T04:19:42.892313+0000","last_undegraded":"2023-08-25T04:19:42.892313+0000","last_fullsized":"2023-08-25T04:19:42.892313+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:24:10.949292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665293+0000","last_change":"2023-08-25T04:19:41.901272+0000","last_active":"2023-08-25T04:19:43.665293+0000","last_peered":"2023-08-25T04:19:43.665293+0000","last_clean":"2023-08-25T04:19:43.665293+0000","last_became_active":"2023-08-25T04:19:41.901006+0000","last_became_peered":"2023-08-25T04:19:41.901006+0000","last_unstale":"2023-08-25T04:19:43.665293+0000","last_undegraded":"2023-08-25T04:19:43.665293+0000","last_fullsized":"2023-08-25T04:19:43.665293+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:08:15.762948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898547+0000","last_change":"2023-08-25T04:19:41.897597+0000","last_active":"2023-08-25T04:19:42.898547+0000","last_peered":"2023-08-25T04:19:42.898547+0000","last_clean":"2023-08-25T04:19:42.898547+0000","last_became_active":"2023-08-25T04:19:41.897344+0000","last_became_peered":"2023-08-25T04:19:41.897344+0000","last_unstale":"2023-08-25T04:19:42.898547+0000","last_undegraded":"2023-08-25T04:19:42.898547+0000","last_fullsized":"2023-08-25T04:19:42.898547+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:20:31.993666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.891823+0000","last_change":"2023-08-25T04:19:41.885014+0000","last_active":"2023-08-25T04:19:42.891823+0000","last_peered":"2023-08-25T04:19:42.891823+0000","last_clean":"2023-08-25T04:19:42.891823+0000","last_became_active":"2023-08-25T04:19:41.884760+0000","last_became_peered":"2023-08-25T04:19:41.884760+0000","last_unstale":"2023-08-25T04:19:42.891823+0000","last_undegraded":"2023-08-25T04:19:42.891823+0000","last_fullsized":"2023-08-25T04:19:42.891823+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:57:31.166188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898389+0000","last_change":"2023-08-25T04:19:41.895842+0000","last_active":"2023-08-25T04:19:42.898389+0000","last_peered":"2023-08-25T04:19:42.898389+0000","last_clean":"2023-08-25T04:19:42.898389+0000","last_became_active":"2023-08-25T04:19:41.895156+0000","last_became_peered":"2023-08-25T04:19:41.895156+0000","last_unstale":"2023-08-25T04:19:42.898389+0000","last_undegraded":"2023-08-25T04:19:42.898389+0000","last_fullsized":"2023-08-25T04:19:42.898389+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:48:22.850815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.893884+0000","last_change":"2023-08-25T04:19:41.904119+0000","last_active":"2023-08-25T04:19:42.893884+0000","last_peered":"2023-08-25T04:19:42.893884+0000","last_clean":"2023-08-25T04:19:42.893884+0000","last_became_active":"2023-08-25T04:19:41.903770+0000","last_became_peered":"2023-08-25T04:19:41.903770+0000","last_unstale":"2023-08-25T04:19:42.893884+0000","last_undegraded":"2023-08-25T04:19:42.893884+0000","last_fullsized":"2023-08-25T04:19:42.893884+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:47:36.436499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894510+0000","last_change":"2023-08-25T04:19:41.908096+0000","last_active":"2023-08-25T04:19:42.894510+0000","last_peered":"2023-08-25T04:19:42.894510+0000","last_clean":"2023-08-25T04:19:42.894510+0000","last_became_active":"2023-08-25T04:19:41.907796+0000","last_became_peered":"2023-08-25T04:19:41.907796+0000","last_unstale":"2023-08-25T04:19:42.894510+0000","last_undegraded":"2023-08-25T04:19:42.894510+0000","last_fullsized":"2023-08-25T04:19:42.894510+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:11:54.260476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665630+0000","last_change":"2023-08-25T04:19:41.893948+0000","last_active":"2023-08-25T04:19:43.665630+0000","last_peered":"2023-08-25T04:19:43.665630+0000","last_clean":"2023-08-25T04:19:43.665630+0000","last_became_active":"2023-08-25T04:19:41.893665+0000","last_became_peered":"2023-08-25T04:19:41.893665+0000","last_unstale":"2023-08-25T04:19:43.665630+0000","last_undegraded":"2023-08-25T04:19:43.665630+0000","last_fullsized":"2023-08-25T04:19:43.665630+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:12:40.205573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892326+0000","last_change":"2023-08-25T04:19:41.885024+0000","last_active":"2023-08-25T04:19:42.892326+0000","last_peered":"2023-08-25T04:19:42.892326+0000","last_clean":"2023-08-25T04:19:42.892326+0000","last_became_active":"2023-08-25T04:19:41.884792+0000","last_became_peered":"2023-08-25T04:19:41.884792+0000","last_unstale":"2023-08-25T04:19:42.892326+0000","last_undegraded":"2023-08-25T04:19:42.892326+0000","last_fullsized":"2023-08-25T04:19:42.892326+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:44:28.053044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898827+0000","last_change":"2023-08-25T04:19:41.901272+0000","last_active":"2023-08-25T04:19:42.898827+0000","last_peered":"2023-08-25T04:19:42.898827+0000","last_clean":"2023-08-25T04:19:42.898827+0000","last_became_active":"2023-08-25T04:19:41.901014+0000","last_became_peered":"2023-08-25T04:19:41.901014+0000","last_unstale":"2023-08-25T04:19:42.898827+0000","last_undegraded":"2023-08-25T04:19:42.898827+0000","last_fullsized":"2023-08-25T04:19:42.898827+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:05:02.557336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.891956+0000","last_change":"2023-08-25T04:19:41.895507+0000","last_active":"2023-08-25T04:19:42.891956+0000","last_peered":"2023-08-25T04:19:42.891956+0000","last_clean":"2023-08-25T04:19:42.891956+0000","last_became_active":"2023-08-25T04:19:41.895251+0000","last_became_peered":"2023-08-25T04:19:41.895251+0000","last_unstale":"2023-08-25T04:19:42.891956+0000","last_undegraded":"2023-08-25T04:19:42.891956+0000","last_fullsized":"2023-08-25T04:19:42.891956+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:18:11.850527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.891835+0000","last_change":"2023-08-25T04:19:41.888255+0000","last_active":"2023-08-25T04:19:42.891835+0000","last_peered":"2023-08-25T04:19:42.891835+0000","last_clean":"2023-08-25T04:19:42.891835+0000","last_became_active":"2023-08-25T04:19:41.887900+0000","last_became_peered":"2023-08-25T04:19:41.887900+0000","last_unstale":"2023-08-25T04:19:42.891835+0000","last_undegraded":"2023-08-25T04:19:42.891835+0000","last_fullsized":"2023-08-25T04:19:42.891835+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:19.617236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663262+0000","last_change":"2023-08-25T04:19:41.889004+0000","last_active":"2023-08-25T04:19:43.663262+0000","last_peered":"2023-08-25T04:19:43.663262+0000","last_clean":"2023-08-25T04:19:43.663262+0000","last_became_active":"2023-08-25T04:19:41.888757+0000","last_became_peered":"2023-08-25T04:19:41.888757+0000","last_unstale":"2023-08-25T04:19:43.663262+0000","last_undegraded":"2023-08-25T04:19:43.663262+0000","last_fullsized":"2023-08-25T04:19:43.663262+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:30:57.139654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665392+0000","last_change":"2023-08-25T04:19:41.891005+0000","last_active":"2023-08-25T04:19:43.665392+0000","last_peered":"2023-08-25T04:19:43.665392+0000","last_clean":"2023-08-25T04:19:43.665392+0000","last_became_active":"2023-08-25T04:19:41.890761+0000","last_became_peered":"2023-08-25T04:19:41.890761+0000","last_unstale":"2023-08-25T04:19:43.665392+0000","last_undegraded":"2023-08-25T04:19:43.665392+0000","last_fullsized":"2023-08-25T04:19:43.665392+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:19:13.885326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663719+0000","last_change":"2023-08-25T04:19:41.891428+0000","last_active":"2023-08-25T04:19:43.663719+0000","last_peered":"2023-08-25T04:19:43.663719+0000","last_clean":"2023-08-25T04:19:43.663719+0000","last_became_active":"2023-08-25T04:19:41.891014+0000","last_became_peered":"2023-08-25T04:19:41.891014+0000","last_unstale":"2023-08-25T04:19:43.663719+0000","last_undegraded":"2023-08-25T04:19:43.663719+0000","last_fullsized":"2023-08-25T04:19:43.663719+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:32:10.185969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892185+0000","last_change":"2023-08-25T04:19:41.889902+0000","last_active":"2023-08-25T04:19:42.892185+0000","last_peered":"2023-08-25T04:19:42.892185+0000","last_clean":"2023-08-25T04:19:42.892185+0000","last_became_active":"2023-08-25T04:19:41.889618+0000","last_became_peered":"2023-08-25T04:19:41.889618+0000","last_unstale":"2023-08-25T04:19:42.892185+0000","last_undegraded":"2023-08-25T04:19:42.892185+0000","last_fullsized":"2023-08-25T04:19:42.892185+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:15:51.000962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665450+0000","last_change":"2023-08-25T04:19:41.890594+0000","last_active":"2023-08-25T04:19:43.665450+0000","last_peered":"2023-08-25T04:19:43.665450+0000","last_clean":"2023-08-25T04:19:43.665450+0000","last_became_active":"2023-08-25T04:19:41.890295+0000","last_became_peered":"2023-08-25T04:19:41.890295+0000","last_unstale":"2023-08-25T04:19:43.665450+0000","last_undegraded":"2023-08-25T04:19:43.665450+0000","last_fullsized":"2023-08-25T04:19:43.665450+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:16:52.693910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898910+0000","last_change":"2023-08-25T04:19:41.886482+0000","last_active":"2023-08-25T04:19:42.898910+0000","last_peered":"2023-08-25T04:19:42.898910+0000","last_clean":"2023-08-25T04:19:42.898910+0000","last_became_active":"2023-08-25T04:19:41.885947+0000","last_became_peered":"2023-08-25T04:19:41.885947+0000","last_unstale":"2023-08-25T04:19:42.898910+0000","last_undegraded":"2023-08-25T04:19:42.898910+0000","last_fullsized":"2023-08-25T04:19:42.898910+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:29.868669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895796+0000","last_change":"2023-08-25T04:19:41.907800+0000","last_active":"2023-08-25T04:19:42.895796+0000","last_peered":"2023-08-25T04:19:42.895796+0000","last_clean":"2023-08-25T04:19:42.895796+0000","last_became_active":"2023-08-25T04:19:41.907533+0000","last_became_peered":"2023-08-25T04:19:41.907533+0000","last_unstale":"2023-08-25T04:19:42.895796+0000","last_undegraded":"2023-08-25T04:19:42.895796+0000","last_fullsized":"2023-08-25T04:19:42.895796+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:40:51.393385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.891985+0000","last_change":"2023-08-25T04:19:41.889825+0000","last_active":"2023-08-25T04:19:42.891985+0000","last_peered":"2023-08-25T04:19:42.891985+0000","last_clean":"2023-08-25T04:19:42.891985+0000","last_became_active":"2023-08-25T04:19:41.889520+0000","last_became_peered":"2023-08-25T04:19:41.889520+0000","last_unstale":"2023-08-25T04:19:42.891985+0000","last_undegraded":"2023-08-25T04:19:42.891985+0000","last_fullsized":"2023-08-25T04:19:42.891985+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:56:53.998165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.662912+0000","last_change":"2023-08-25T04:19:41.892895+0000","last_active":"2023-08-25T04:19:43.662912+0000","last_peered":"2023-08-25T04:19:43.662912+0000","last_clean":"2023-08-25T04:19:43.662912+0000","last_became_active":"2023-08-25T04:19:41.892623+0000","last_became_peered":"2023-08-25T04:19:41.892623+0000","last_unstale":"2023-08-25T04:19:43.662912+0000","last_undegraded":"2023-08-25T04:19:43.662912+0000","last_fullsized":"2023-08-25T04:19:43.662912+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:29:17.679853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.893874+0000","last_change":"2023-08-25T04:19:41.907732+0000","last_active":"2023-08-25T04:19:42.893874+0000","last_peered":"2023-08-25T04:19:42.893874+0000","last_clean":"2023-08-25T04:19:42.893874+0000","last_became_active":"2023-08-25T04:19:41.907433+0000","last_became_peered":"2023-08-25T04:19:41.907433+0000","last_unstale":"2023-08-25T04:19:42.893874+0000","last_undegraded":"2023-08-25T04:19:42.893874+0000","last_fullsized":"2023-08-25T04:19:42.893874+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:02:08.662125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894225+0000","last_change":"2023-08-25T04:19:41.912135+0000","last_active":"2023-08-25T04:19:42.894225+0000","last_peered":"2023-08-25T04:19:42.894225+0000","last_clean":"2023-08-25T04:19:42.894225+0000","last_became_active":"2023-08-25T04:19:41.908659+0000","last_became_peered":"2023-08-25T04:19:41.908659+0000","last_unstale":"2023-08-25T04:19:42.894225+0000","last_undegraded":"2023-08-25T04:19:42.894225+0000","last_fullsized":"2023-08-25T04:19:42.894225+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:38:28.530195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"105'4","reported_seq":17,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663426+0000","last_change":"2023-08-25T04:19:40.898787+0000","last_active":"2023-08-25T04:19:43.663426+0000","last_peered":"2023-08-25T04:19:43.663426+0000","last_clean":"2023-08-25T04:19:43.663426+0000","last_became_active":"2023-08-25T04:19:40.898515+0000","last_became_peered":"2023-08-25T04:19:40.898515+0000","last_unstale":"2023-08-25T04:19:43.663426+0000","last_undegraded":"2023-08-25T04:19:43.663426+0000","last_fullsized":"2023-08-25T04:19:43.663426+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:53:47.519111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894264+0000","last_change":"2023-08-25T04:19:41.911106+0000","last_active":"2023-08-25T04:19:42.894264+0000","last_peered":"2023-08-25T04:19:42.894264+0000","last_clean":"2023-08-25T04:19:42.894264+0000","last_became_active":"2023-08-25T04:19:41.910685+0000","last_became_peered":"2023-08-25T04:19:41.910685+0000","last_unstale":"2023-08-25T04:19:42.894264+0000","last_undegraded":"2023-08-25T04:19:42.894264+0000","last_fullsized":"2023-08-25T04:19:42.894264+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:00:49.023062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892254+0000","last_change":"2023-08-25T04:19:40.885801+0000","last_active":"2023-08-25T04:19:42.892254+0000","last_peered":"2023-08-25T04:19:42.892254+0000","last_clean":"2023-08-25T04:19:42.892254+0000","last_became_active":"2023-08-25T04:19:40.885527+0000","last_became_peered":"2023-08-25T04:19:40.885527+0000","last_unstale":"2023-08-25T04:19:42.892254+0000","last_undegraded":"2023-08-25T04:19:42.892254+0000","last_fullsized":"2023-08-25T04:19:42.892254+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:27.110975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895966+0000","last_change":"2023-08-25T04:19:41.903603+0000","last_active":"2023-08-25T04:19:42.895966+0000","last_peered":"2023-08-25T04:19:42.895966+0000","last_clean":"2023-08-25T04:19:42.895966+0000","last_became_active":"2023-08-25T04:19:41.903265+0000","last_became_peered":"2023-08-25T04:19:41.903265+0000","last_unstale":"2023-08-25T04:19:42.895966+0000","last_undegraded":"2023-08-25T04:19:42.895966+0000","last_fullsized":"2023-08-25T04:19:42.895966+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:41:01.030543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895884+0000","last_change":"2023-08-25T04:19:40.891925+0000","last_active":"2023-08-25T04:19:42.895884+0000","last_peered":"2023-08-25T04:19:42.895884+0000","last_clean":"2023-08-25T04:19:42.895884+0000","last_became_active":"2023-08-25T04:19:40.891676+0000","last_became_peered":"2023-08-25T04:19:40.891676+0000","last_unstale":"2023-08-25T04:19:42.895884+0000","last_undegraded":"2023-08-25T04:19:42.895884+0000","last_fullsized":"2023-08-25T04:19:42.895884+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:20:29.662430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894581+0000","last_change":"2023-08-25T04:19:41.907564+0000","last_active":"2023-08-25T04:19:42.894581+0000","last_peered":"2023-08-25T04:19:42.894581+0000","last_clean":"2023-08-25T04:19:42.894581+0000","last_became_active":"2023-08-25T04:19:41.907280+0000","last_became_peered":"2023-08-25T04:19:41.907280+0000","last_unstale":"2023-08-25T04:19:42.894581+0000","last_undegraded":"2023-08-25T04:19:42.894581+0000","last_fullsized":"2023-08-25T04:19:42.894581+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:05:42.470420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663343+0000","last_change":"2023-08-25T04:19:40.896552+0000","last_active":"2023-08-25T04:19:43.663343+0000","last_peered":"2023-08-25T04:19:43.663343+0000","last_clean":"2023-08-25T04:19:43.663343+0000","last_became_active":"2023-08-25T04:19:40.896374+0000","last_became_peered":"2023-08-25T04:19:40.896374+0000","last_unstale":"2023-08-25T04:19:43.663343+0000","last_undegraded":"2023-08-25T04:19:43.663343+0000","last_fullsized":"2023-08-25T04:19:43.663343+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:13:44.596252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.899106+0000","last_change":"2023-08-25T04:19:41.889967+0000","last_active":"2023-08-25T04:19:42.899106+0000","last_peered":"2023-08-25T04:19:42.899106+0000","last_clean":"2023-08-25T04:19:42.899106+0000","last_became_active":"2023-08-25T04:19:41.889213+0000","last_became_peered":"2023-08-25T04:19:41.889213+0000","last_unstale":"2023-08-25T04:19:42.899106+0000","last_undegraded":"2023-08-25T04:19:42.899106+0000","last_fullsized":"2023-08-25T04:19:42.899106+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:14:40.897561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892082+0000","last_change":"2023-08-25T04:19:40.887257+0000","last_active":"2023-08-25T04:19:42.892082+0000","last_peered":"2023-08-25T04:19:42.892082+0000","last_clean":"2023-08-25T04:19:42.892082+0000","last_became_active":"2023-08-25T04:19:40.886960+0000","last_became_peered":"2023-08-25T04:19:40.886960+0000","last_unstale":"2023-08-25T04:19:42.892082+0000","last_undegraded":"2023-08-25T04:19:42.892082+0000","last_fullsized":"2023-08-25T04:19:42.892082+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:05:38.594325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663630+0000","last_change":"2023-08-25T04:19:41.903870+0000","last_active":"2023-08-25T04:19:43.663630+0000","last_peered":"2023-08-25T04:19:43.663630+0000","last_clean":"2023-08-25T04:19:43.663630+0000","last_became_active":"2023-08-25T04:19:41.902846+0000","last_became_peered":"2023-08-25T04:19:41.902846+0000","last_unstale":"2023-08-25T04:19:43.663630+0000","last_undegraded":"2023-08-25T04:19:43.663630+0000","last_fullsized":"2023-08-25T04:19:43.663630+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:03:27.491490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898651+0000","last_change":"2023-08-25T04:19:40.890630+0000","last_active":"2023-08-25T04:19:42.898651+0000","last_peered":"2023-08-25T04:19:42.898651+0000","last_clean":"2023-08-25T04:19:42.898651+0000","last_became_active":"2023-08-25T04:19:40.890342+0000","last_became_peered":"2023-08-25T04:19:40.890342+0000","last_unstale":"2023-08-25T04:19:42.898651+0000","last_undegraded":"2023-08-25T04:19:42.898651+0000","last_fullsized":"2023-08-25T04:19:42.898651+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:33.068046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894021+0000","last_change":"2023-08-25T04:19:41.911955+0000","last_active":"2023-08-25T04:19:42.894021+0000","last_peered":"2023-08-25T04:19:42.894021+0000","last_clean":"2023-08-25T04:19:42.894021+0000","last_became_active":"2023-08-25T04:19:41.911696+0000","last_became_peered":"2023-08-25T04:19:41.911696+0000","last_unstale":"2023-08-25T04:19:42.894021+0000","last_undegraded":"2023-08-25T04:19:42.894021+0000","last_fullsized":"2023-08-25T04:19:42.894021+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:17:15.554678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665687+0000","last_change":"2023-08-25T04:19:40.892468+0000","last_active":"2023-08-25T04:19:43.665687+0000","last_peered":"2023-08-25T04:19:43.665687+0000","last_clean":"2023-08-25T04:19:43.665687+0000","last_became_active":"2023-08-25T04:19:40.892134+0000","last_became_peered":"2023-08-25T04:19:40.892134+0000","last_unstale":"2023-08-25T04:19:43.665687+0000","last_undegraded":"2023-08-25T04:19:43.665687+0000","last_fullsized":"2023-08-25T04:19:43.665687+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:32:15.053322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898672+0000","last_change":"2023-08-25T04:19:41.886919+0000","last_active":"2023-08-25T04:19:42.898672+0000","last_peered":"2023-08-25T04:19:42.898672+0000","last_clean":"2023-08-25T04:19:42.898672+0000","last_became_active":"2023-08-25T04:19:41.886598+0000","last_became_peered":"2023-08-25T04:19:41.886598+0000","last_unstale":"2023-08-25T04:19:42.898672+0000","last_undegraded":"2023-08-25T04:19:42.898672+0000","last_fullsized":"2023-08-25T04:19:42.898672+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:30:55.735155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895758+0000","last_change":"2023-08-25T04:19:40.899648+0000","last_active":"2023-08-25T04:19:42.895758+0000","last_peered":"2023-08-25T04:19:42.895758+0000","last_clean":"2023-08-25T04:19:42.895758+0000","last_became_active":"2023-08-25T04:19:40.899405+0000","last_became_peered":"2023-08-25T04:19:40.899405+0000","last_unstale":"2023-08-25T04:19:42.895758+0000","last_undegraded":"2023-08-25T04:19:42.895758+0000","last_fullsized":"2023-08-25T04:19:42.895758+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:22:15.682094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892174+0000","last_change":"2023-08-25T04:19:41.897500+0000","last_active":"2023-08-25T04:19:42.892174+0000","last_peered":"2023-08-25T04:19:42.892174+0000","last_clean":"2023-08-25T04:19:42.892174+0000","last_became_active":"2023-08-25T04:19:41.897228+0000","last_became_peered":"2023-08-25T04:19:41.897228+0000","last_unstale":"2023-08-25T04:19:42.892174+0000","last_undegraded":"2023-08-25T04:19:42.892174+0000","last_fullsized":"2023-08-25T04:19:42.892174+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:25:23.161265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663793+0000","last_change":"2023-08-25T04:19:40.889045+0000","last_active":"2023-08-25T04:19:43.663793+0000","last_peered":"2023-08-25T04:19:43.663793+0000","last_clean":"2023-08-25T04:19:43.663793+0000","last_became_active":"2023-08-25T04:19:40.888607+0000","last_became_peered":"2023-08-25T04:19:40.888607+0000","last_unstale":"2023-08-25T04:19:43.663793+0000","last_undegraded":"2023-08-25T04:19:43.663793+0000","last_fullsized":"2023-08-25T04:19:43.663793+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:15:53.081071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895763+0000","last_change":"2023-08-25T04:19:41.899010+0000","last_active":"2023-08-25T04:19:42.895763+0000","last_peered":"2023-08-25T04:19:42.895763+0000","last_clean":"2023-08-25T04:19:42.895763+0000","last_became_active":"2023-08-25T04:19:41.898739+0000","last_became_peered":"2023-08-25T04:19:41.898739+0000","last_unstale":"2023-08-25T04:19:42.895763+0000","last_undegraded":"2023-08-25T04:19:42.895763+0000","last_fullsized":"2023-08-25T04:19:42.895763+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:58.849460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665734+0000","last_change":"2023-08-25T04:19:40.899283+0000","last_active":"2023-08-25T04:19:43.665734+0000","last_peered":"2023-08-25T04:19:43.665734+0000","last_clean":"2023-08-25T04:19:43.665734+0000","last_became_active":"2023-08-25T04:19:40.898940+0000","last_became_peered":"2023-08-25T04:19:40.898940+0000","last_unstale":"2023-08-25T04:19:43.665734+0000","last_undegraded":"2023-08-25T04:19:43.665734+0000","last_fullsized":"2023-08-25T04:19:43.665734+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:31.402164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665688+0000","last_change":"2023-08-25T04:19:41.905509+0000","last_active":"2023-08-25T04:19:43.665688+0000","last_peered":"2023-08-25T04:19:43.665688+0000","last_clean":"2023-08-25T04:19:43.665688+0000","last_became_active":"2023-08-25T04:19:41.905242+0000","last_became_peered":"2023-08-25T04:19:41.905242+0000","last_unstale":"2023-08-25T04:19:43.665688+0000","last_undegraded":"2023-08-25T04:19:43.665688+0000","last_fullsized":"2023-08-25T04:19:43.665688+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:23:37.979793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"105'3","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892413+0000","last_change":"2023-08-25T04:19:40.898940+0000","last_active":"2023-08-25T04:19:42.892413+0000","last_peered":"2023-08-25T04:19:42.892413+0000","last_clean":"2023-08-25T04:19:42.892413+0000","last_became_active":"2023-08-25T04:19:40.898474+0000","last_became_peered":"2023-08-25T04:19:40.898474+0000","last_unstale":"2023-08-25T04:19:42.892413+0000","last_undegraded":"2023-08-25T04:19:42.892413+0000","last_fullsized":"2023-08-25T04:19:42.892413+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:09:59.626997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.899096+0000","last_change":"2023-08-25T04:19:41.893039+0000","last_active":"2023-08-25T04:19:42.899096+0000","last_peered":"2023-08-25T04:19:42.899096+0000","last_clean":"2023-08-25T04:19:42.899096+0000","last_became_active":"2023-08-25T04:19:41.892753+0000","last_became_peered":"2023-08-25T04:19:41.892753+0000","last_unstale":"2023-08-25T04:19:42.899096+0000","last_undegraded":"2023-08-25T04:19:42.899096+0000","last_fullsized":"2023-08-25T04:19:42.899096+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:20:29.110139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"105'6","reported_seq":19,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894323+0000","last_change":"2023-08-25T04:19:40.900998+0000","last_active":"2023-08-25T04:19:42.894323+0000","last_peered":"2023-08-25T04:19:42.894323+0000","last_clean":"2023-08-25T04:19:42.894323+0000","last_became_active":"2023-08-25T04:19:40.900729+0000","last_became_peered":"2023-08-25T04:19:40.900729+0000","last_unstale":"2023-08-25T04:19:42.894323+0000","last_undegraded":"2023-08-25T04:19:42.894323+0000","last_fullsized":"2023-08-25T04:19:42.894323+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:27.855057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898332+0000","last_change":"2023-08-25T04:19:41.900468+0000","last_active":"2023-08-25T04:19:42.898332+0000","last_peered":"2023-08-25T04:19:42.898332+0000","last_clean":"2023-08-25T04:19:42.898332+0000","last_became_active":"2023-08-25T04:19:41.900027+0000","last_became_peered":"2023-08-25T04:19:41.900027+0000","last_unstale":"2023-08-25T04:19:42.898332+0000","last_undegraded":"2023-08-25T04:19:42.898332+0000","last_fullsized":"2023-08-25T04:19:42.898332+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:27:32.656198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895791+0000","last_change":"2023-08-25T04:19:40.899588+0000","last_active":"2023-08-25T04:19:42.895791+0000","last_peered":"2023-08-25T04:19:42.895791+0000","last_clean":"2023-08-25T04:19:42.895791+0000","last_became_active":"2023-08-25T04:19:40.899317+0000","last_became_peered":"2023-08-25T04:19:40.899317+0000","last_unstale":"2023-08-25T04:19:42.895791+0000","last_undegraded":"2023-08-25T04:19:42.895791+0000","last_fullsized":"2023-08-25T04:19:42.895791+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:27:22.727108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.891800+0000","last_change":"2023-08-25T04:19:41.882821+0000","last_active":"2023-08-25T04:19:42.891800+0000","last_peered":"2023-08-25T04:19:42.891800+0000","last_clean":"2023-08-25T04:19:42.891800+0000","last_became_active":"2023-08-25T04:19:41.882550+0000","last_became_peered":"2023-08-25T04:19:41.882550+0000","last_unstale":"2023-08-25T04:19:42.891800+0000","last_undegraded":"2023-08-25T04:19:42.891800+0000","last_fullsized":"2023-08-25T04:19:42.891800+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:50:08.947936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.893997+0000","last_change":"2023-08-25T04:19:40.900933+0000","last_active":"2023-08-25T04:19:42.893997+0000","last_peered":"2023-08-25T04:19:42.893997+0000","last_clean":"2023-08-25T04:19:42.893997+0000","last_became_active":"2023-08-25T04:19:40.900610+0000","last_became_peered":"2023-08-25T04:19:40.900610+0000","last_unstale":"2023-08-25T04:19:42.893997+0000","last_undegraded":"2023-08-25T04:19:42.893997+0000","last_fullsized":"2023-08-25T04:19:42.893997+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:13:38.475112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665119+0000","last_change":"2023-08-25T04:19:41.893371+0000","last_active":"2023-08-25T04:19:43.665119+0000","last_peered":"2023-08-25T04:19:43.665119+0000","last_clean":"2023-08-25T04:19:43.665119+0000","last_became_active":"2023-08-25T04:19:41.893099+0000","last_became_peered":"2023-08-25T04:19:41.893099+0000","last_unstale":"2023-08-25T04:19:43.665119+0000","last_undegraded":"2023-08-25T04:19:43.665119+0000","last_fullsized":"2023-08-25T04:19:43.665119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:44:30.148605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.899225+0000","last_change":"2023-08-25T04:19:40.889107+0000","last_active":"2023-08-25T04:19:42.899225+0000","last_peered":"2023-08-25T04:19:42.899225+0000","last_clean":"2023-08-25T04:19:42.899225+0000","last_became_active":"2023-08-25T04:19:40.888769+0000","last_became_peered":"2023-08-25T04:19:40.888769+0000","last_unstale":"2023-08-25T04:19:42.899225+0000","last_undegraded":"2023-08-25T04:19:42.899225+0000","last_fullsized":"2023-08-25T04:19:42.899225+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:33:03.241173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665330+0000","last_change":"2023-08-25T04:19:41.894694+0000","last_active":"2023-08-25T04:19:43.665330+0000","last_peered":"2023-08-25T04:19:43.665330+0000","last_clean":"2023-08-25T04:19:43.665330+0000","last_became_active":"2023-08-25T04:19:41.894434+0000","last_became_peered":"2023-08-25T04:19:41.894434+0000","last_unstale":"2023-08-25T04:19:43.665330+0000","last_undegraded":"2023-08-25T04:19:43.665330+0000","last_fullsized":"2023-08-25T04:19:43.665330+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:59:49.857880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"105'8","reported_seq":21,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898438+0000","last_change":"2023-08-25T04:19:40.890314+0000","last_active":"2023-08-25T04:19:42.898438+0000","last_peered":"2023-08-25T04:19:42.898438+0000","last_clean":"2023-08-25T04:19:42.898438+0000","last_became_active":"2023-08-25T04:19:40.890039+0000","last_became_peered":"2023-08-25T04:19:40.890039+0000","last_unstale":"2023-08-25T04:19:42.898438+0000","last_undegraded":"2023-08-25T04:19:42.898438+0000","last_fullsized":"2023-08-25T04:19:42.898438+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:18:19.534084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663268+0000","last_change":"2023-08-25T04:19:41.895417+0000","last_active":"2023-08-25T04:19:43.663268+0000","last_peered":"2023-08-25T04:19:43.663268+0000","last_clean":"2023-08-25T04:19:43.663268+0000","last_became_active":"2023-08-25T04:19:41.895138+0000","last_became_peered":"2023-08-25T04:19:41.895138+0000","last_unstale":"2023-08-25T04:19:43.663268+0000","last_undegraded":"2023-08-25T04:19:43.663268+0000","last_fullsized":"2023-08-25T04:19:43.663268+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:24:45.202315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.896039+0000","last_change":"2023-08-25T04:19:40.891823+0000","last_active":"2023-08-25T04:19:42.896039+0000","last_peered":"2023-08-25T04:19:42.896039+0000","last_clean":"2023-08-25T04:19:42.896039+0000","last_became_active":"2023-08-25T04:19:40.891569+0000","last_became_peered":"2023-08-25T04:19:40.891569+0000","last_unstale":"2023-08-25T04:19:42.896039+0000","last_undegraded":"2023-08-25T04:19:42.896039+0000","last_fullsized":"2023-08-25T04:19:42.896039+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:57:01.386059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894336+0000","last_change":"2023-08-25T04:19:41.910936+0000","last_active":"2023-08-25T04:19:42.894336+0000","last_peered":"2023-08-25T04:19:42.894336+0000","last_clean":"2023-08-25T04:19:42.894336+0000","last_became_active":"2023-08-25T04:19:41.910413+0000","last_became_peered":"2023-08-25T04:19:41.910413+0000","last_unstale":"2023-08-25T04:19:42.894336+0000","last_undegraded":"2023-08-25T04:19:42.894336+0000","last_fullsized":"2023-08-25T04:19:42.894336+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:35:00.168476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892266+0000","last_change":"2023-08-25T04:19:40.888478+0000","last_active":"2023-08-25T04:19:42.892266+0000","last_peered":"2023-08-25T04:19:42.892266+0000","last_clean":"2023-08-25T04:19:42.892266+0000","last_became_active":"2023-08-25T04:19:40.888095+0000","last_became_peered":"2023-08-25T04:19:40.888095+0000","last_unstale":"2023-08-25T04:19:42.892266+0000","last_undegraded":"2023-08-25T04:19:42.892266+0000","last_fullsized":"2023-08-25T04:19:42.892266+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:21:29.749789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894399+0000","last_change":"2023-08-25T04:19:41.910119+0000","last_active":"2023-08-25T04:19:42.894399+0000","last_peered":"2023-08-25T04:19:42.894399+0000","last_clean":"2023-08-25T04:19:42.894399+0000","last_became_active":"2023-08-25T04:19:41.908668+0000","last_became_peered":"2023-08-25T04:19:41.908668+0000","last_unstale":"2023-08-25T04:19:42.894399+0000","last_undegraded":"2023-08-25T04:19:42.894399+0000","last_fullsized":"2023-08-25T04:19:42.894399+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:47:01.021287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892481+0000","last_change":"2023-08-25T04:19:40.898764+0000","last_active":"2023-08-25T04:19:42.892481+0000","last_peered":"2023-08-25T04:19:42.892481+0000","last_clean":"2023-08-25T04:19:42.892481+0000","last_became_active":"2023-08-25T04:19:40.898484+0000","last_became_peered":"2023-08-25T04:19:40.898484+0000","last_unstale":"2023-08-25T04:19:42.892481+0000","last_undegraded":"2023-08-25T04:19:42.892481+0000","last_fullsized":"2023-08-25T04:19:42.892481+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:21.641112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663774+0000","last_change":"2023-08-25T04:19:41.895638+0000","last_active":"2023-08-25T04:19:43.663774+0000","last_peered":"2023-08-25T04:19:43.663774+0000","last_clean":"2023-08-25T04:19:43.663774+0000","last_became_active":"2023-08-25T04:19:41.895377+0000","last_became_peered":"2023-08-25T04:19:41.895377+0000","last_unstale":"2023-08-25T04:19:43.663774+0000","last_undegraded":"2023-08-25T04:19:43.663774+0000","last_fullsized":"2023-08-25T04:19:43.663774+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:55:43.951635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663367+0000","last_change":"2023-08-25T04:19:40.886820+0000","last_active":"2023-08-25T04:19:43.663367+0000","last_peered":"2023-08-25T04:19:43.663367+0000","last_clean":"2023-08-25T04:19:43.663367+0000","last_became_active":"2023-08-25T04:19:40.886510+0000","last_became_peered":"2023-08-25T04:19:40.886510+0000","last_unstale":"2023-08-25T04:19:43.663367+0000","last_undegraded":"2023-08-25T04:19:43.663367+0000","last_fullsized":"2023-08-25T04:19:43.663367+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:53:56.409846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665011+0000","last_change":"2023-08-25T04:19:41.911130+0000","last_active":"2023-08-25T04:19:43.665011+0000","last_peered":"2023-08-25T04:19:43.665011+0000","last_clean":"2023-08-25T04:19:43.665011+0000","last_became_active":"2023-08-25T04:19:41.909973+0000","last_became_peered":"2023-08-25T04:19:41.909973+0000","last_unstale":"2023-08-25T04:19:43.665011+0000","last_undegraded":"2023-08-25T04:19:43.665011+0000","last_fullsized":"2023-08-25T04:19:43.665011+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:38:07.090247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894279+0000","last_change":"2023-08-25T04:19:40.901212+0000","last_active":"2023-08-25T04:19:42.894279+0000","last_peered":"2023-08-25T04:19:42.894279+0000","last_clean":"2023-08-25T04:19:42.894279+0000","last_became_active":"2023-08-25T04:19:40.900450+0000","last_became_peered":"2023-08-25T04:19:40.900450+0000","last_unstale":"2023-08-25T04:19:42.894279+0000","last_undegraded":"2023-08-25T04:19:42.894279+0000","last_fullsized":"2023-08-25T04:19:42.894279+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:06:25.729783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665546+0000","last_change":"2023-08-25T04:19:41.897014+0000","last_active":"2023-08-25T04:19:43.665546+0000","last_peered":"2023-08-25T04:19:43.665546+0000","last_clean":"2023-08-25T04:19:43.665546+0000","last_became_active":"2023-08-25T04:19:41.896368+0000","last_became_peered":"2023-08-25T04:19:41.896368+0000","last_unstale":"2023-08-25T04:19:43.665546+0000","last_undegraded":"2023-08-25T04:19:43.665546+0000","last_fullsized":"2023-08-25T04:19:43.665546+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:58.694119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663114+0000","last_change":"2023-08-25T04:19:40.887802+0000","last_active":"2023-08-25T04:19:43.663114+0000","last_peered":"2023-08-25T04:19:43.663114+0000","last_clean":"2023-08-25T04:19:43.663114+0000","last_became_active":"2023-08-25T04:19:40.887524+0000","last_became_peered":"2023-08-25T04:19:40.887524+0000","last_unstale":"2023-08-25T04:19:43.663114+0000","last_undegraded":"2023-08-25T04:19:43.663114+0000","last_fullsized":"2023-08-25T04:19:43.663114+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:13:42.252860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663000+0000","last_change":"2023-08-25T04:19:41.888396+0000","last_active":"2023-08-25T04:19:43.663000+0000","last_peered":"2023-08-25T04:19:43.663000+0000","last_clean":"2023-08-25T04:19:43.663000+0000","last_became_active":"2023-08-25T04:19:41.888159+0000","last_became_peered":"2023-08-25T04:19:41.888159+0000","last_unstale":"2023-08-25T04:19:43.663000+0000","last_undegraded":"2023-08-25T04:19:43.663000+0000","last_fullsized":"2023-08-25T04:19:43.663000+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:30:51.066940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663653+0000","last_change":"2023-08-25T04:19:40.887614+0000","last_active":"2023-08-25T04:19:43.663653+0000","last_peered":"2023-08-25T04:19:43.663653+0000","last_clean":"2023-08-25T04:19:43.663653+0000","last_became_active":"2023-08-25T04:19:40.887354+0000","last_became_peered":"2023-08-25T04:19:40.887354+0000","last_unstale":"2023-08-25T04:19:43.663653+0000","last_undegraded":"2023-08-25T04:19:43.663653+0000","last_fullsized":"2023-08-25T04:19:43.663653+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:50.169800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894173+0000","last_change":"2023-08-25T04:19:41.902881+0000","last_active":"2023-08-25T04:19:42.894173+0000","last_peered":"2023-08-25T04:19:42.894173+0000","last_clean":"2023-08-25T04:19:42.894173+0000","last_became_active":"2023-08-25T04:19:41.902588+0000","last_became_peered":"2023-08-25T04:19:41.902588+0000","last_unstale":"2023-08-25T04:19:42.894173+0000","last_undegraded":"2023-08-25T04:19:42.894173+0000","last_fullsized":"2023-08-25T04:19:42.894173+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:27:16.063317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895576+0000","last_change":"2023-08-25T04:19:40.897361+0000","last_active":"2023-08-25T04:19:42.895576+0000","last_peered":"2023-08-25T04:19:42.895576+0000","last_clean":"2023-08-25T04:19:42.895576+0000","last_became_active":"2023-08-25T04:19:40.897118+0000","last_became_peered":"2023-08-25T04:19:40.897118+0000","last_unstale":"2023-08-25T04:19:42.895576+0000","last_undegraded":"2023-08-25T04:19:42.895576+0000","last_fullsized":"2023-08-25T04:19:42.895576+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:26:11.555112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.896018+0000","last_change":"2023-08-25T04:19:41.903029+0000","last_active":"2023-08-25T04:19:42.896018+0000","last_peered":"2023-08-25T04:19:42.896018+0000","last_clean":"2023-08-25T04:19:42.896018+0000","last_became_active":"2023-08-25T04:19:41.902460+0000","last_became_peered":"2023-08-25T04:19:41.902460+0000","last_unstale":"2023-08-25T04:19:42.896018+0000","last_undegraded":"2023-08-25T04:19:42.896018+0000","last_fullsized":"2023-08-25T04:19:42.896018+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:06:52.404331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898914+0000","last_change":"2023-08-25T04:19:40.893346+0000","last_active":"2023-08-25T04:19:42.898914+0000","last_peered":"2023-08-25T04:19:42.898914+0000","last_clean":"2023-08-25T04:19:42.898914+0000","last_became_active":"2023-08-25T04:19:40.892055+0000","last_became_peered":"2023-08-25T04:19:40.892055+0000","last_unstale":"2023-08-25T04:19:42.898914+0000","last_undegraded":"2023-08-25T04:19:42.898914+0000","last_fullsized":"2023-08-25T04:19:42.898914+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:35:39.736125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"106'2822","reported_seq":3229,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:45.449134+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:19:45.449134+0000","last_peered":"2023-08-25T04:19:45.449134+0000","last_clean":"2023-08-25T04:19:45.449134+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:19:45.449134+0000","last_undegraded":"2023-08-25T04:19:45.449134+0000","last_fullsized":"2023-08-25T04:19:45.449134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":2822,"log_dups_size":0,"ondisk_log_size":2822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:06:43.866997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":750,"num_read_kb":1515,"num_write":285,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":161,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663187+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:19:43.663187+0000","last_peered":"2023-08-25T04:19:43.663187+0000","last_clean":"2023-08-25T04:19:43.663187+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:19:43.663187+0000","last_undegraded":"2023-08-25T04:19:43.663187+0000","last_fullsized":"2023-08-25T04:19:43.663187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:50:11.429397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894376+0000","last_change":"2023-08-25T04:19:41.903347+0000","last_active":"2023-08-25T04:19:42.894376+0000","last_peered":"2023-08-25T04:19:42.894376+0000","last_clean":"2023-08-25T04:19:42.894376+0000","last_became_active":"2023-08-25T04:19:41.903097+0000","last_became_peered":"2023-08-25T04:19:41.903097+0000","last_unstale":"2023-08-25T04:19:42.894376+0000","last_undegraded":"2023-08-25T04:19:42.894376+0000","last_fullsized":"2023-08-25T04:19:42.894376+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:42:42.088067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663310+0000","last_change":"2023-08-25T04:19:40.886640+0000","last_active":"2023-08-25T04:19:43.663310+0000","last_peered":"2023-08-25T04:19:43.663310+0000","last_clean":"2023-08-25T04:19:43.663310+0000","last_became_active":"2023-08-25T04:19:40.886327+0000","last_became_peered":"2023-08-25T04:19:40.886327+0000","last_unstale":"2023-08-25T04:19:43.663310+0000","last_undegraded":"2023-08-25T04:19:43.663310+0000","last_fullsized":"2023-08-25T04:19:43.663310+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:30:11.680409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895784+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:19:42.895784+0000","last_peered":"2023-08-25T04:19:42.895784+0000","last_clean":"2023-08-25T04:19:42.895784+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:19:42.895784+0000","last_undegraded":"2023-08-25T04:19:42.895784+0000","last_fullsized":"2023-08-25T04:19:42.895784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:27:04.060862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663405+0000","last_change":"2023-08-25T04:19:41.891179+0000","last_active":"2023-08-25T04:19:43.663405+0000","last_peered":"2023-08-25T04:19:43.663405+0000","last_clean":"2023-08-25T04:19:43.663405+0000","last_became_active":"2023-08-25T04:19:41.890922+0000","last_became_peered":"2023-08-25T04:19:41.890922+0000","last_unstale":"2023-08-25T04:19:43.663405+0000","last_undegraded":"2023-08-25T04:19:43.663405+0000","last_fullsized":"2023-08-25T04:19:43.663405+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:37.458532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895944+0000","last_change":"2023-08-25T04:19:40.893815+0000","last_active":"2023-08-25T04:19:42.895944+0000","last_peered":"2023-08-25T04:19:42.895944+0000","last_clean":"2023-08-25T04:19:42.895944+0000","last_became_active":"2023-08-25T04:19:40.893541+0000","last_became_peered":"2023-08-25T04:19:40.893541+0000","last_unstale":"2023-08-25T04:19:42.895944+0000","last_undegraded":"2023-08-25T04:19:42.895944+0000","last_fullsized":"2023-08-25T04:19:42.895944+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:49:32.003310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.664981+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:19:43.664981+0000","last_peered":"2023-08-25T04:19:43.664981+0000","last_clean":"2023-08-25T04:19:43.664981+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:19:43.664981+0000","last_undegraded":"2023-08-25T04:19:43.664981+0000","last_fullsized":"2023-08-25T04:19:43.664981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:15:08.893461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892167+0000","last_change":"2023-08-25T04:19:41.886006+0000","last_active":"2023-08-25T04:19:42.892167+0000","last_peered":"2023-08-25T04:19:42.892167+0000","last_clean":"2023-08-25T04:19:42.892167+0000","last_became_active":"2023-08-25T04:19:41.885711+0000","last_became_peered":"2023-08-25T04:19:41.885711+0000","last_unstale":"2023-08-25T04:19:42.892167+0000","last_undegraded":"2023-08-25T04:19:42.892167+0000","last_fullsized":"2023-08-25T04:19:42.892167+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:01:14.895211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892479+0000","last_change":"2023-08-25T04:19:40.887520+0000","last_active":"2023-08-25T04:19:42.892479+0000","last_peered":"2023-08-25T04:19:42.892479+0000","last_clean":"2023-08-25T04:19:42.892479+0000","last_became_active":"2023-08-25T04:19:40.887274+0000","last_became_peered":"2023-08-25T04:19:40.887274+0000","last_unstale":"2023-08-25T04:19:42.892479+0000","last_undegraded":"2023-08-25T04:19:42.892479+0000","last_fullsized":"2023-08-25T04:19:42.892479+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:53.057687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":161,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663219+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:19:43.663219+0000","last_peered":"2023-08-25T04:19:43.663219+0000","last_clean":"2023-08-25T04:19:43.663219+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:19:43.663219+0000","last_undegraded":"2023-08-25T04:19:43.663219+0000","last_fullsized":"2023-08-25T04:19:43.663219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:31:11.801727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.893991+0000","last_change":"2023-08-25T04:19:41.904671+0000","last_active":"2023-08-25T04:19:42.893991+0000","last_peered":"2023-08-25T04:19:42.893991+0000","last_clean":"2023-08-25T04:19:42.893991+0000","last_became_active":"2023-08-25T04:19:41.904380+0000","last_became_peered":"2023-08-25T04:19:41.904380+0000","last_unstale":"2023-08-25T04:19:42.893991+0000","last_undegraded":"2023-08-25T04:19:42.893991+0000","last_fullsized":"2023-08-25T04:19:42.893991+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:07.428454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663069+0000","last_change":"2023-08-25T04:19:40.888193+0000","last_active":"2023-08-25T04:19:43.663069+0000","last_peered":"2023-08-25T04:19:43.663069+0000","last_clean":"2023-08-25T04:19:43.663069+0000","last_became_active":"2023-08-25T04:19:40.887920+0000","last_became_peered":"2023-08-25T04:19:40.887920+0000","last_unstale":"2023-08-25T04:19:43.663069+0000","last_undegraded":"2023-08-25T04:19:43.663069+0000","last_fullsized":"2023-08-25T04:19:43.663069+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:58:58.763723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":177,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898997+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:19:42.898997+0000","last_peered":"2023-08-25T04:19:42.898997+0000","last_clean":"2023-08-25T04:19:42.898997+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:19:42.898997+0000","last_undegraded":"2023-08-25T04:19:42.898997+0000","last_fullsized":"2023-08-25T04:19:42.898997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:22:41.607949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.662935+0000","last_change":"2023-08-25T04:19:41.892591+0000","last_active":"2023-08-25T04:19:43.662935+0000","last_peered":"2023-08-25T04:19:43.662935+0000","last_clean":"2023-08-25T04:19:43.662935+0000","last_became_active":"2023-08-25T04:19:41.892253+0000","last_became_peered":"2023-08-25T04:19:41.892253+0000","last_unstale":"2023-08-25T04:19:43.662935+0000","last_undegraded":"2023-08-25T04:19:43.662935+0000","last_fullsized":"2023-08-25T04:19:43.662935+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:04:00.127628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665546+0000","last_change":"2023-08-25T04:19:40.898534+0000","last_active":"2023-08-25T04:19:43.665546+0000","last_peered":"2023-08-25T04:19:43.665546+0000","last_clean":"2023-08-25T04:19:43.665546+0000","last_became_active":"2023-08-25T04:19:40.898239+0000","last_became_peered":"2023-08-25T04:19:40.898239+0000","last_unstale":"2023-08-25T04:19:43.665546+0000","last_undegraded":"2023-08-25T04:19:43.665546+0000","last_fullsized":"2023-08-25T04:19:43.665546+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:04:10.020209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895889+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:19:42.895889+0000","last_peered":"2023-08-25T04:19:42.895889+0000","last_clean":"2023-08-25T04:19:42.895889+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:19:42.895889+0000","last_undegraded":"2023-08-25T04:19:42.895889+0000","last_fullsized":"2023-08-25T04:19:42.895889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:40:54.717094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663035+0000","last_change":"2023-08-25T04:19:41.897006+0000","last_active":"2023-08-25T04:19:43.663035+0000","last_peered":"2023-08-25T04:19:43.663035+0000","last_clean":"2023-08-25T04:19:43.663035+0000","last_became_active":"2023-08-25T04:19:41.896575+0000","last_became_peered":"2023-08-25T04:19:41.896575+0000","last_unstale":"2023-08-25T04:19:43.663035+0000","last_undegraded":"2023-08-25T04:19:43.663035+0000","last_fullsized":"2023-08-25T04:19:43.663035+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:49:20.325758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.662995+0000","last_change":"2023-08-25T04:19:40.898734+0000","last_active":"2023-08-25T04:19:43.662995+0000","last_peered":"2023-08-25T04:19:43.662995+0000","last_clean":"2023-08-25T04:19:43.662995+0000","last_became_active":"2023-08-25T04:19:40.898469+0000","last_became_peered":"2023-08-25T04:19:40.898469+0000","last_unstale":"2023-08-25T04:19:43.662995+0000","last_undegraded":"2023-08-25T04:19:43.662995+0000","last_fullsized":"2023-08-25T04:19:43.662995+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:14.479380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":176,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898973+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:19:42.898973+0000","last_peered":"2023-08-25T04:19:42.898973+0000","last_clean":"2023-08-25T04:19:42.898973+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:19:42.898973+0000","last_undegraded":"2023-08-25T04:19:42.898973+0000","last_fullsized":"2023-08-25T04:19:42.898973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:37:30.611911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894160+0000","last_change":"2023-08-25T04:19:41.905480+0000","last_active":"2023-08-25T04:19:42.894160+0000","last_peered":"2023-08-25T04:19:42.894160+0000","last_clean":"2023-08-25T04:19:42.894160+0000","last_became_active":"2023-08-25T04:19:41.905233+0000","last_became_peered":"2023-08-25T04:19:41.905233+0000","last_unstale":"2023-08-25T04:19:42.894160+0000","last_undegraded":"2023-08-25T04:19:42.894160+0000","last_fullsized":"2023-08-25T04:19:42.894160+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:11:44.431231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665040+0000","last_change":"2023-08-25T04:19:40.890287+0000","last_active":"2023-08-25T04:19:43.665040+0000","last_peered":"2023-08-25T04:19:43.665040+0000","last_clean":"2023-08-25T04:19:43.665040+0000","last_became_active":"2023-08-25T04:19:40.890025+0000","last_became_peered":"2023-08-25T04:19:40.890025+0000","last_unstale":"2023-08-25T04:19:43.665040+0000","last_undegraded":"2023-08-25T04:19:43.665040+0000","last_fullsized":"2023-08-25T04:19:43.665040+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:45:28.004590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663491+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:19:43.663491+0000","last_peered":"2023-08-25T04:19:43.663491+0000","last_clean":"2023-08-25T04:19:43.663491+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:19:43.663491+0000","last_undegraded":"2023-08-25T04:19:43.663491+0000","last_fullsized":"2023-08-25T04:19:43.663491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:30:49.149494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":750,"num_read_kb":1515,"num_write":285,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2822,"ondisk_log_size":2822,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509644,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55236,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316604,"statfs":{"total":96636764160,"available":96580202496,"internally_reserved":0,"allocated":1896448,"data_stored":1231149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.69199999999999995,"15min":0.70699999999999996},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.33700000000000002},"max":{"1min":0.85199999999999998,"5min":0.996,"15min":0.996},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70799999999999996,"15min":0.72299999999999998},"min":{"1min":0.51500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.92400000000000004,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.30299999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.42699999999999999},"max":{"1min":0.92100000000000004,"5min":0.95699999999999996,"15min":1.034},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.44700000000000001,"15min":0.374},"max":{"1min":0.995,"5min":0.995,"15min":1.036},"last":0.377}]},{"osd":2,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70399999999999996,"15min":0.71599999999999997},"min":{"1min":0.52400000000000002,"5min":0.42299999999999999,"15min":0.34899999999999998},"max":{"1min":0.84199999999999997,"5min":0.94499999999999995,"15min":1.018},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71799999999999997,"15min":0.747},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.54200000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.54400000000000004,"5min":0.47799999999999998,"15min":0.41899999999999998},"max":{"1min":0.877,"5min":0.92900000000000005,"15min":0.98399999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.432},"max":{"1min":0.90900000000000003,"5min":1.04,"15min":1.04},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.81599999999999995,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.441,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47099999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.86099999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.40000000000000002},"max":{"1min":0.83599999999999997,"5min":1.032,"15min":1.0349999999999999},"last":0.52600000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.53000000000000003,"5min":0.46700000000000003,"15min":0.436},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.497},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66100000000000003,"15min":0.66200000000000003},"min":{"1min":0.46999999999999997,"5min":0.42699999999999999,"15min":0.42399999999999999},"max":{"1min":0.94399999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.437}]}]},{"osd":6,"up_from":15,"seq":64424509644,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36624,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335216,"statfs":{"total":96636764160,"available":96599261184,"internally_reserved":0,"allocated":1314816,"data_stored":642941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66800000000000004,"15min":0.70399999999999996},"min":{"1min":0.34999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97099999999999997,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.497},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67700000000000005,"15min":0.69599999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95999999999999996,"5min":0.96899999999999997,"15min":1.054},"last":0.46800000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.69899999999999995,"15min":0.72999999999999998},"min":{"1min":0.41599999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.93600000000000005,"5min":1.0269999999999999,"15min":1.0369999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.72799999999999998},"min":{"1min":0.50700000000000001,"5min":0.495,"15min":0.47199999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70699999999999996,"15min":0.73599999999999999},"min":{"1min":0.48999999999999999,"5min":0.44,"15min":0.434},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.1020000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0169999999999999,"5min":1.0569999999999999,"15min":1.117},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.745,"15min":0.747},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.46899999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.76000000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49199999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.36499999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.443},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.40500000000000003,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.0820000000000001},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66800000000000004,"15min":0.65200000000000002},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.1220000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.745,"15min":0.73399999999999999},"min":{"1min":0.55500000000000005,"5min":0.443,"15min":0.40000000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.67200000000000004,"15min":0.66200000000000003},"min":{"1min":0.441,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.1950000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73199999999999998,"15min":0.70299999999999996},"min":{"1min":0.50600000000000001,"5min":0.45200000000000001,"15min":0.41799999999999998},"max":{"1min":1.1359999999999999,"5min":1.373,"15min":1.373},"last":0.66800000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542347,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":640725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66900000000000004,"15min":0.70899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.018},"last":0.495},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68899999999999995,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81999999999999995,"5min":0.97999999999999998,"15min":1.0409999999999999},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.69899999999999995,"15min":0.72999999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.36499999999999999},"max":{"1min":0.78000000000000003,"5min":0.95299999999999996,"15min":0.99399999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71499999999999997,"15min":0.73799999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90400000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.442}]},{"osd":2,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68000000000000005,"15min":0.72599999999999998},"min":{"1min":0.44800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83999999999999997,"5min":0.92800000000000005,"15min":0.97499999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92600000000000005,"5min":0.98499999999999999,"15min":1.0449999999999999},"last":0.57599999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.70999999999999996,"15min":0.73099999999999998},"min":{"1min":0.52600000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86499999999999999,"5min":0.93500000000000005,"15min":0.96999999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72499999999999998,"15min":0.76500000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.55200000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.40999999999999998,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.91000000000000003,"5min":0.92900000000000005,"15min":0.97099999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.86499999999999999,"5min":1.018,"15min":1.018},"last":0.46100000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.47399999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.008},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.878,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.54000000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.622,"15min":0.62},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.89300000000000002,"5min":1.002,"15min":1.032},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68899999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.96899999999999997,"15min":1.048},"last":0.52600000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542347,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36612,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335228,"statfs":{"total":96636764160,"available":96599273472,"internally_reserved":0,"allocated":1302528,"data_stored":640885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.67800000000000005,"15min":0.70099999999999996},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.84299999999999997,"5min":0.97399999999999998,"15min":0.99299999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68600000000000005,"15min":0.70099999999999996},"min":{"1min":0.48599999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.96699999999999997},"last":0.52600000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.49399999999999999,"5min":0.45100000000000001,"15min":0.36199999999999999},"max":{"1min":0.85699999999999998,"5min":0.98399999999999999,"15min":1.0449999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70399999999999996,"15min":0.73499999999999999},"min":{"1min":0.44,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.872,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39100000000000001},"max":{"1min":0.879,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":0.91600000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.52900000000000003,"5min":0.51300000000000001,"15min":0.45100000000000001},"max":{"1min":0.90200000000000002,"5min":0.98299999999999998,"15min":1.048},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.72999999999999998,"15min":0.752},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80700000000000005,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.40899999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.59099999999999997},"min":{"1min":0.42599999999999999,"5min":0.376,"15min":0.33200000000000002},"max":{"1min":0.91400000000000003,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.45400000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.745,"15min":0.73499999999999999},"min":{"1min":0.496,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.96299999999999997,"5min":1.093,"15min":1.093},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65300000000000002,"15min":0.64000000000000001},"min":{"1min":0.48299999999999998,"5min":0.42299999999999999,"15min":0.40300000000000002},"max":{"1min":0.85999999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.50600000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.36699999999999999},"max":{"1min":0.84899999999999998,"5min":0.90100000000000002,"15min":0.94499999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.60299999999999998,"5min":0.48099999999999998,"15min":0.39300000000000002},"max":{"1min":0.94299999999999995,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.49199999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542347,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36612,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335228,"statfs":{"total":96636764160,"available":96599273472,"internally_reserved":0,"allocated":1294336,"data_stored":640725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.439,"15min":0.45000000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27300000000000002},"max":{"1min":0.70199999999999996,"5min":0.93700000000000006,"15min":0.96899999999999997},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51100000000000001,"15min":0.52200000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66200000000000003,"5min":0.77100000000000002,"15min":0.91500000000000004},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.49199999999999999,"15min":0.5},"min":{"1min":0.34000000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.42199999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.748,"5min":0.80300000000000005,"15min":0.92600000000000005},"last":0.46200000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55500000000000005,"15min":0.57199999999999995},"min":{"1min":0.38700000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":0.85499999999999998,"15min":1.01},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.54500000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.70799999999999996,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.58499999999999996}]},{"osd":4,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.752,"15min":0.75600000000000001},"min":{"1min":0.56399999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0209999999999999,"5min":1.214,"15min":1.214},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.57899999999999996,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0760000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.502}]},{"osd":5,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.52900000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0349999999999999,"5min":1.254,"15min":1.254},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.78600000000000003},"min":{"1min":0.53700000000000003,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":0.99099999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.59499999999999997,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":1.119,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77700000000000002,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.51600000000000001,"15min":0.50700000000000001},"max":{"1min":0.94699999999999995,"5min":1.0800000000000001,"15min":1.177},"last":0.55400000000000005}]},{"osd":7,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79100000000000004,"15min":0.82599999999999996},"min":{"1min":0.57199999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.96899999999999997,"5min":1.077,"15min":1.194},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.79400000000000004,"15min":0.79700000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0049999999999999,"5min":1.079,"15min":1.1160000000000001},"last":0.67100000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542348,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54652,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317188,"statfs":{"total":96636764160,"available":96580800512,"internally_reserved":0,"allocated":1294336,"data_stored":640725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.28799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59699999999999998,"5min":0.85599999999999998,"15min":0.92000000000000004},"last":0.255},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.47899999999999998,"15min":0.495},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.61899999999999999,"5min":0.81000000000000005,"15min":0.93100000000000005},"last":0.312}]},{"osd":1,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.61299999999999999,"5min":0.78800000000000003,"15min":0.85499999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.57199999999999995,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.56699999999999995,"5min":0.81699999999999995,"15min":0.89800000000000002},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.51800000000000002,"15min":0.53200000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":0.65700000000000003,"5min":0.82199999999999995,"15min":0.82299999999999995},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59099999999999997,"5min":0.85399999999999998,"15min":0.89400000000000002},"last":0.40899999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.77600000000000002,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.502,"15min":0.502},"max":{"1min":0.82199999999999995,"5min":1.1990000000000001,"15min":1.2569999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.52000000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89400000000000002,"5min":1.151,"15min":1.5509999999999999},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.77900000000000003,"15min":0.79900000000000004},"min":{"1min":0.53000000000000003,"5min":0.52600000000000002,"15min":0.498},"max":{"1min":0.93700000000000006,"5min":1.1080000000000001,"15min":1.2789999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77700000000000002,"15min":0.80400000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.48299999999999998},"max":{"1min":0.86799999999999999,"5min":1.2130000000000001,"15min":1.3089999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.78200000000000003,"15min":0.82099999999999995},"min":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.82799999999999996,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.496},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.84999999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.90200000000000002,"5min":1.25,"15min":1.375},"last":0.57099999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.77600000000000002,"15min":0.79800000000000004},"min":{"1min":0.54200000000000004,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":0.878,"5min":1.0860000000000001,"15min":1.339},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.77900000000000003,"15min":0.80500000000000005},"min":{"1min":0.57099999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.80600000000000005,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.44}]}]},{"osd":1,"up_from":14,"seq":60129542348,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36608,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335232,"statfs":{"total":96636764160,"available":96599277568,"internally_reserved":0,"allocated":1298432,"data_stored":640795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.27400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.96899999999999997},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.54400000000000004,"15min":0.52200000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67400000000000004,"5min":1.212,"15min":1.212},"last":0.34300000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.30499999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79200000000000004,"5min":0.876,"15min":0.876},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.36299999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83199999999999996,"5min":0.877,"15min":1.02},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.59899999999999998,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71699999999999997,"5min":0.93100000000000005,"15min":1.018},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74099999999999999,"5min":1.165,"15min":1.165},"last":0.42399999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.747,"15min":0.76900000000000002},"min":{"1min":0.48899999999999999,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":1.012,"5min":1.204,"15min":1.204},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78900000000000003,"15min":0.80400000000000005},"min":{"1min":0.53900000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.5}]},{"osd":5,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.753,"15min":0.78400000000000003},"min":{"1min":0.496,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96899999999999997,"5min":1.254,"15min":1.254},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.77900000000000003,"15min":0.80300000000000005},"min":{"1min":0.54700000000000004,"5min":0.51400000000000001,"15min":0.51000000000000001},"max":{"1min":0.97999999999999998,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.97599999999999998,"5min":1.623,"15min":1.623},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93700000000000006,"5min":1.288,"15min":1.288},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77900000000000003,"15min":0.80700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.99199999999999999,"5min":1.1240000000000001,"15min":1.2949999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.60899999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1,"5min":1.1140000000000001,"15min":1.3120000000000001},"last":0.60899999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542347,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28888,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342952,"statfs":{"total":96636764160,"available":96607182848,"internally_reserved":0,"allocated":1912832,"data_stored":1233411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36099999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63,"5min":0.72499999999999998,"15min":0.79500000000000004},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.55200000000000005,"15min":0.56499999999999995},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.502,"15min":0.52000000000000002},"min":{"1min":0.32800000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.97499999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.64700000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48699999999999999,"15min":0.499},"min":{"1min":0.30499999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.85099999999999998,"15min":1.2470000000000001},"last":0.504}]},{"osd":4,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79300000000000004,"15min":0.79500000000000004},"min":{"1min":0.55900000000000005,"5min":0.52600000000000002,"15min":0.503},"max":{"1min":0.95599999999999996,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.79200000000000004,"15min":0.80600000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.436},"max":{"1min":0.86799999999999999,"5min":1.169,"15min":1.234},"last":0.60699999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.52800000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.97799999999999998,"5min":3.528,"15min":3.528},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.56399999999999995,"5min":0.47199999999999998,"15min":0.45500000000000002},"max":{"1min":1.0680000000000001,"5min":1.121,"15min":1.2230000000000001},"last":0.625}]},{"osd":6,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.80100000000000005,"15min":0.80000000000000004},"min":{"1min":0.56699999999999995,"5min":0.54400000000000004,"15min":0.53700000000000003},"max":{"1min":0.89200000000000002,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.82099999999999995,"15min":0.82999999999999996},"min":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.502},"max":{"1min":1.0349999999999999,"5min":1.1870000000000001,"15min":1.194},"last":0.67100000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82499999999999996,"15min":0.84299999999999997},"min":{"1min":0.59699999999999998,"5min":0.56399999999999995,"15min":0.52900000000000003},"max":{"1min":1.101,"5min":1.151,"15min":1.2849999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96999999999999997,"5min":1.1220000000000001,"15min":1.1930000000000001},"last":0.54600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:19:47.852 INFO:tasks.ceph.mds.c.smithi055.stderr:2023-08-25T04:19:47.852+0000 7f36d3cf2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T04:19:48.287 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:48.284+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:49.054 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:49.052+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:49.826 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:49.824+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:50.594 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:50.592+0000 7fd0b5734640 -1 client.6533: SimpleRADOSStriper: lock: main.db: waiting for locks: lockers exclusive=1 tag= lockers=[client.6443:761b7aae-5efe-4958-b370-723fcff282b1:v1:172.21.15.110:0/3256947721] 2023-08-25T04:19:50.650 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:19:50.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.796+0000 7fd39b7d2640 1 Processor -- start 2023-08-25T04:19:50.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.796+0000 7fd39b7d2640 1 -- start start 2023-08-25T04:19:50.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.796+0000 7fd39b7d2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd3940cdde0 0x7fd3940ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:50.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.796+0000 7fd39b7d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd3940b2e40 0x7fd3940b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:50.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.796+0000 7fd39b7d2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3940b29b0 con 0x7fd3940d0da0 2023-08-25T04:19:50.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.796+0000 7fd39b7d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3940ce760 con 0x7fd3940b2e40 2023-08-25T04:19:50.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.796+0000 7fd39b7d2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3940b1dc0 con 0x7fd3940cdde0 2023-08-25T04:19:50.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.796+0000 7fd399d6f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd3940b2e40 0x7fd3940b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:50.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.796+0000 7fd399d6f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd3940b2e40 0x7fd3940b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51788/0 (socket says 172.21.15.55:51788) 2023-08-25T04:19:50.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.796+0000 7fd399d6f640 1 -- 172.21.15.55:0/2389264560 learned_addr learned my addr 172.21.15.55:0/2389264560 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:50.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.796+0000 7fd398d6d640 1 --2- 172.21.15.55:0/2389264560 >> v2:172.21.15.110:3300/0 conn(0x7fd3940cdde0 0x7fd3940ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:50.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.796+0000 7fd399d6f640 1 -- 172.21.15.55:0/2389264560 >> v2:172.21.15.110:3300/0 conn(0x7fd3940cdde0 msgr2=0x7fd3940ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:50.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.796+0000 7fd399d6f640 1 --2- 172.21.15.55:0/2389264560 >> v2:172.21.15.110:3300/0 conn(0x7fd3940cdde0 0x7fd3940ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:50.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.796+0000 7fd399d6f640 1 -- 172.21.15.55:0/2389264560 >> v1:172.21.15.110:6789/0 conn(0x7fd3940d0da0 legacy=0x7fd3940d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:50.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.796+0000 7fd399d6f640 1 -- 172.21.15.55:0/2389264560 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3940b2080 con 0x7fd3940b2e40 2023-08-25T04:19:50.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.800+0000 7fd399d6f640 1 --2- 172.21.15.55:0/2389264560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3940b2e40 0x7fd3940b32b0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fd3940d38c0 tx=0x7fd38c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9255045ccdd13b87 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:50.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.800+0000 7fd38bfff640 1 -- 172.21.15.55:0/2389264560 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0af400 con 0x7fd3940b2e40 2023-08-25T04:19:50.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.800+0000 7fd38bfff640 1 -- 172.21.15.55:0/2389264560 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c0ab050 con 0x7fd3940b2e40 2023-08-25T04:19:50.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.800+0000 7fd38bfff640 1 -- 172.21.15.55:0/2389264560 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0af780 con 0x7fd3940b2e40 2023-08-25T04:19:50.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.800+0000 7fd39b7d2640 1 -- 172.21.15.55:0/2389264560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3940b2e40 msgr2=0x7fd3940b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:50.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.800+0000 7fd39b7d2640 1 --2- 172.21.15.55:0/2389264560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3940b2e40 0x7fd3940b32b0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fd3940d38c0 tx=0x7fd38c01f1c0 comp rx=0 tx=0).stop 2023-08-25T04:19:50.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.800+0000 7fd39b7d2640 1 -- 172.21.15.55:0/2389264560 shutdown_connections 2023-08-25T04:19:50.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.800+0000 7fd39b7d2640 1 --2- 172.21.15.55:0/2389264560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3940b2e40 0x7fd3940b32b0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:50.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.800+0000 7fd39b7d2640 1 --2- 172.21.15.55:0/2389264560 >> v2:172.21.15.110:3300/0 conn(0x7fd3940cdde0 0x7fd3940ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:50.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.800+0000 7fd39b7d2640 1 -- 172.21.15.55:0/2389264560 >> 172.21.15.55:0/2389264560 conn(0x7fd39409bae0 msgr2=0x7fd3940d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:50.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.800+0000 7fd39b7d2640 1 -- 172.21.15.55:0/2389264560 shutdown_connections 2023-08-25T04:19:50.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.800+0000 7fd39b7d2640 1 -- 172.21.15.55:0/2389264560 wait complete. 2023-08-25T04:19:50.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd39b7d2640 1 Processor -- start 2023-08-25T04:19:50.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd39b7d2640 1 -- start start 2023-08-25T04:19:50.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd39b7d2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3940b2e40 0x7fd3940b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:50.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd39b7d2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3940cdde0 0x7fd394151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:50.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd39b7d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3940d0da0 0x7fd3940b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:50.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd39b7d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3940b6330 con 0x7fd3940d0da0 2023-08-25T04:19:50.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd39b7d2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3940cc740 con 0x7fd3940b2e40 2023-08-25T04:19:50.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd39b7d2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3940b6540 con 0x7fd3940cdde0 2023-08-25T04:19:50.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd399d6f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3940d0da0 0x7fd3940b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:50.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd399d6f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3940d0da0 0x7fd3940b0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51796/0 (socket says 172.21.15.55:51796) 2023-08-25T04:19:50.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd399d6f640 1 -- 172.21.15.55:0/240348686 learned_addr learned my addr 172.21.15.55:0/240348686 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:50.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd39956e640 1 --2- 172.21.15.55:0/240348686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3940b2e40 0x7fd3940b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:50.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd398d6d640 1 --2- 172.21.15.55:0/240348686 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3940cdde0 0x7fd394151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:50.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd399d6f640 1 -- 172.21.15.55:0/240348686 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3940cdde0 msgr2=0x7fd394151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:50.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd399d6f640 1 --2- 172.21.15.55:0/240348686 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3940cdde0 0x7fd394151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:50.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd399d6f640 1 -- 172.21.15.55:0/240348686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3940b2e40 msgr2=0x7fd3940b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:50.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd399d6f640 1 --2- 172.21.15.55:0/240348686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3940b2e40 0x7fd3940b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:50.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd399d6f640 1 -- 172.21.15.55:0/240348686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38c009b30 con 0x7fd3940d0da0 2023-08-25T04:19:50.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd399d6f640 1 --2- 172.21.15.55:0/240348686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3940d0da0 0x7fd3940b0420 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0b2040 tx=0x7fd38c01bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:50.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd389ffb640 1 -- 172.21.15.55:0/240348686 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0afd30 con 0x7fd3940d0da0 2023-08-25T04:19:50.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd389ffb640 1 -- 172.21.15.55:0/240348686 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c009510 con 0x7fd3940d0da0 2023-08-25T04:19:50.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd389ffb640 1 -- 172.21.15.55:0/240348686 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c0ba660 con 0x7fd3940d0da0 2023-08-25T04:19:50.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.804+0000 7fd39b7d2640 1 -- 172.21.15.55:0/240348686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3940b6820 con 0x7fd3940d0da0 2023-08-25T04:19:50.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.808+0000 7fd39b7d2640 1 -- 172.21.15.55:0/240348686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3940b6de0 con 0x7fd3940d0da0 2023-08-25T04:19:50.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.808+0000 7fd39b7d2640 1 -- 172.21.15.55:0/240348686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39404dbe0 con 0x7fd3940d0da0 2023-08-25T04:19:50.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.808+0000 7fd389ffb640 1 -- 172.21.15.55:0/240348686 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fd38c0b6040 con 0x7fd3940d0da0 2023-08-25T04:19:50.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.808+0000 7fd389ffb640 1 --2- 172.21.15.55:0/240348686 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd378065710 0x7fd378067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:50.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.808+0000 7fd389ffb640 1 -- 172.21.15.55:0/240348686 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd38c121080 con 0x7fd3940d0da0 2023-08-25T04:19:50.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.808+0000 7fd39956e640 1 --2- 172.21.15.55:0/240348686 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd378065710 0x7fd378067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:50.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.812+0000 7fd39956e640 1 --2- 172.21.15.55:0/240348686 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd378065710 0x7fd378067bd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd390000fc0 tx=0x7fd390009040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:50.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.812+0000 7fd389ffb640 1 -- 172.21.15.55:0/240348686 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd38c0eebd0 con 0x7fd3940d0da0 2023-08-25T04:19:50.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.968+0000 7fd39b7d2640 1 -- 172.21.15.55:0/240348686 --> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3940c67b0 con 0x7fd378065710 2023-08-25T04:19:50.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.976+0000 7fd389ffb640 1 -- 172.21.15.55:0/240348686 <== mgr.7111 v2:172.21.15.110:6832/1337211678 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311854 (secure 0 0 0) 0x7fd3940c67b0 con 0x7fd378065710 2023-08-25T04:19:50.981 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:50.983 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:19:50.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.980+0000 7fd39b7d2640 1 -- 172.21.15.55:0/240348686 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd378065710 msgr2=0x7fd378067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:50.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.980+0000 7fd39b7d2640 1 --2- 172.21.15.55:0/240348686 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd378065710 0x7fd378067bd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd390000fc0 tx=0x7fd390009040 comp rx=0 tx=0).stop 2023-08-25T04:19:50.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.980+0000 7fd39b7d2640 1 -- 172.21.15.55:0/240348686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3940d0da0 msgr2=0x7fd3940b0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:50.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.980+0000 7fd39b7d2640 1 --2- 172.21.15.55:0/240348686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3940d0da0 0x7fd3940b0420 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0b2040 tx=0x7fd38c01bf60 comp rx=0 tx=0).stop 2023-08-25T04:19:50.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.980+0000 7fd39b7d2640 1 -- 172.21.15.55:0/240348686 shutdown_connections 2023-08-25T04:19:50.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.980+0000 7fd39b7d2640 1 --2- 172.21.15.55:0/240348686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3940d0da0 0x7fd3940b0420 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:50.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.980+0000 7fd39b7d2640 1 --2- 172.21.15.55:0/240348686 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd378065710 0x7fd378067bd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:50.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.980+0000 7fd39b7d2640 1 --2- 172.21.15.55:0/240348686 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3940cdde0 0x7fd394151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:50.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.980+0000 7fd39b7d2640 1 --2- 172.21.15.55:0/240348686 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd3940b2e40 0x7fd3940b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:50.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.980+0000 7fd39b7d2640 1 -- 172.21.15.55:0/240348686 >> 172.21.15.55:0/240348686 conn(0x7fd39409bae0 msgr2=0x7fd39406a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:50.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.980+0000 7fd39b7d2640 1 -- 172.21.15.55:0/240348686 shutdown_connections 2023-08-25T04:19:50.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:50.980+0000 7fd39b7d2640 1 -- 172.21.15.55:0/240348686 wait complete. 2023-08-25T04:19:51.000 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-08-25T04:19:50.461417+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":750,"num_read_kb":1515,"num_write":329,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2860,"ondisk_log_size":2860,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":205,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":317676,"kb_used_data":11336,"kb_used_omap":13,"kb_used_meta":306226,"kb_avail":754657044,"statfs":{"total":773094113280,"available":772768813056,"internally_reserved":0,"allocated":11608064,"data_stored":6311356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":313575512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.585643"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665857+0000","last_change":"2023-08-25T04:19:41.911968+0000","last_active":"2023-08-25T04:19:43.665857+0000","last_peered":"2023-08-25T04:19:43.665857+0000","last_clean":"2023-08-25T04:19:43.665857+0000","last_became_active":"2023-08-25T04:19:41.911670+0000","last_became_peered":"2023-08-25T04:19:41.911670+0000","last_unstale":"2023-08-25T04:19:43.665857+0000","last_undegraded":"2023-08-25T04:19:43.665857+0000","last_fullsized":"2023-08-25T04:19:43.665857+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:53:47.690264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663541+0000","last_change":"2023-08-25T04:19:41.892316+0000","last_active":"2023-08-25T04:19:43.663541+0000","last_peered":"2023-08-25T04:19:43.663541+0000","last_clean":"2023-08-25T04:19:43.663541+0000","last_became_active":"2023-08-25T04:19:41.892060+0000","last_became_peered":"2023-08-25T04:19:41.892060+0000","last_unstale":"2023-08-25T04:19:43.663541+0000","last_undegraded":"2023-08-25T04:19:43.663541+0000","last_fullsized":"2023-08-25T04:19:43.663541+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:24:14.597393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665728+0000","last_change":"2023-08-25T04:19:41.897841+0000","last_active":"2023-08-25T04:19:43.665728+0000","last_peered":"2023-08-25T04:19:43.665728+0000","last_clean":"2023-08-25T04:19:43.665728+0000","last_became_active":"2023-08-25T04:19:41.896231+0000","last_became_peered":"2023-08-25T04:19:41.896231+0000","last_unstale":"2023-08-25T04:19:43.665728+0000","last_undegraded":"2023-08-25T04:19:43.665728+0000","last_fullsized":"2023-08-25T04:19:43.665728+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:00:42.950350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898716+0000","last_change":"2023-08-25T04:19:41.886280+0000","last_active":"2023-08-25T04:19:42.898716+0000","last_peered":"2023-08-25T04:19:42.898716+0000","last_clean":"2023-08-25T04:19:42.898716+0000","last_became_active":"2023-08-25T04:19:41.885639+0000","last_became_peered":"2023-08-25T04:19:41.885639+0000","last_unstale":"2023-08-25T04:19:42.898716+0000","last_undegraded":"2023-08-25T04:19:42.898716+0000","last_fullsized":"2023-08-25T04:19:42.898716+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:14:11.504511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892382+0000","last_change":"2023-08-25T04:19:41.883507+0000","last_active":"2023-08-25T04:19:42.892382+0000","last_peered":"2023-08-25T04:19:42.892382+0000","last_clean":"2023-08-25T04:19:42.892382+0000","last_became_active":"2023-08-25T04:19:41.883243+0000","last_became_peered":"2023-08-25T04:19:41.883243+0000","last_unstale":"2023-08-25T04:19:42.892382+0000","last_undegraded":"2023-08-25T04:19:42.892382+0000","last_fullsized":"2023-08-25T04:19:42.892382+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:39:23.545519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.893868+0000","last_change":"2023-08-25T04:19:41.908334+0000","last_active":"2023-08-25T04:19:42.893868+0000","last_peered":"2023-08-25T04:19:42.893868+0000","last_clean":"2023-08-25T04:19:42.893868+0000","last_became_active":"2023-08-25T04:19:41.908055+0000","last_became_peered":"2023-08-25T04:19:41.908055+0000","last_unstale":"2023-08-25T04:19:42.893868+0000","last_undegraded":"2023-08-25T04:19:42.893868+0000","last_fullsized":"2023-08-25T04:19:42.893868+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:58:53.278718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895721+0000","last_change":"2023-08-25T04:19:41.903035+0000","last_active":"2023-08-25T04:19:42.895721+0000","last_peered":"2023-08-25T04:19:42.895721+0000","last_clean":"2023-08-25T04:19:42.895721+0000","last_became_active":"2023-08-25T04:19:41.902730+0000","last_became_peered":"2023-08-25T04:19:41.902730+0000","last_unstale":"2023-08-25T04:19:42.895721+0000","last_undegraded":"2023-08-25T04:19:42.895721+0000","last_fullsized":"2023-08-25T04:19:42.895721+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:01.500747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898638+0000","last_change":"2023-08-25T04:19:41.900303+0000","last_active":"2023-08-25T04:19:42.898638+0000","last_peered":"2023-08-25T04:19:42.898638+0000","last_clean":"2023-08-25T04:19:42.898638+0000","last_became_active":"2023-08-25T04:19:41.899626+0000","last_became_peered":"2023-08-25T04:19:41.899626+0000","last_unstale":"2023-08-25T04:19:42.898638+0000","last_undegraded":"2023-08-25T04:19:42.898638+0000","last_fullsized":"2023-08-25T04:19:42.898638+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:52:19.962525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892095+0000","last_change":"2023-08-25T04:19:41.890680+0000","last_active":"2023-08-25T04:19:42.892095+0000","last_peered":"2023-08-25T04:19:42.892095+0000","last_clean":"2023-08-25T04:19:42.892095+0000","last_became_active":"2023-08-25T04:19:41.890417+0000","last_became_peered":"2023-08-25T04:19:41.890417+0000","last_unstale":"2023-08-25T04:19:42.892095+0000","last_undegraded":"2023-08-25T04:19:42.892095+0000","last_fullsized":"2023-08-25T04:19:42.892095+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:11:00.286732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665426+0000","last_change":"2023-08-25T04:19:41.894756+0000","last_active":"2023-08-25T04:19:43.665426+0000","last_peered":"2023-08-25T04:19:43.665426+0000","last_clean":"2023-08-25T04:19:43.665426+0000","last_became_active":"2023-08-25T04:19:41.893942+0000","last_became_peered":"2023-08-25T04:19:41.893942+0000","last_unstale":"2023-08-25T04:19:43.665426+0000","last_undegraded":"2023-08-25T04:19:43.665426+0000","last_fullsized":"2023-08-25T04:19:43.665426+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:54:06.413955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892313+0000","last_change":"2023-08-25T04:19:41.912192+0000","last_active":"2023-08-25T04:19:42.892313+0000","last_peered":"2023-08-25T04:19:42.892313+0000","last_clean":"2023-08-25T04:19:42.892313+0000","last_became_active":"2023-08-25T04:19:41.911494+0000","last_became_peered":"2023-08-25T04:19:41.911494+0000","last_unstale":"2023-08-25T04:19:42.892313+0000","last_undegraded":"2023-08-25T04:19:42.892313+0000","last_fullsized":"2023-08-25T04:19:42.892313+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:24:10.949292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665293+0000","last_change":"2023-08-25T04:19:41.901272+0000","last_active":"2023-08-25T04:19:43.665293+0000","last_peered":"2023-08-25T04:19:43.665293+0000","last_clean":"2023-08-25T04:19:43.665293+0000","last_became_active":"2023-08-25T04:19:41.901006+0000","last_became_peered":"2023-08-25T04:19:41.901006+0000","last_unstale":"2023-08-25T04:19:43.665293+0000","last_undegraded":"2023-08-25T04:19:43.665293+0000","last_fullsized":"2023-08-25T04:19:43.665293+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:08:15.762948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898547+0000","last_change":"2023-08-25T04:19:41.897597+0000","last_active":"2023-08-25T04:19:42.898547+0000","last_peered":"2023-08-25T04:19:42.898547+0000","last_clean":"2023-08-25T04:19:42.898547+0000","last_became_active":"2023-08-25T04:19:41.897344+0000","last_became_peered":"2023-08-25T04:19:41.897344+0000","last_unstale":"2023-08-25T04:19:42.898547+0000","last_undegraded":"2023-08-25T04:19:42.898547+0000","last_fullsized":"2023-08-25T04:19:42.898547+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:20:31.993666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.891823+0000","last_change":"2023-08-25T04:19:41.885014+0000","last_active":"2023-08-25T04:19:42.891823+0000","last_peered":"2023-08-25T04:19:42.891823+0000","last_clean":"2023-08-25T04:19:42.891823+0000","last_became_active":"2023-08-25T04:19:41.884760+0000","last_became_peered":"2023-08-25T04:19:41.884760+0000","last_unstale":"2023-08-25T04:19:42.891823+0000","last_undegraded":"2023-08-25T04:19:42.891823+0000","last_fullsized":"2023-08-25T04:19:42.891823+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:57:31.166188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898389+0000","last_change":"2023-08-25T04:19:41.895842+0000","last_active":"2023-08-25T04:19:42.898389+0000","last_peered":"2023-08-25T04:19:42.898389+0000","last_clean":"2023-08-25T04:19:42.898389+0000","last_became_active":"2023-08-25T04:19:41.895156+0000","last_became_peered":"2023-08-25T04:19:41.895156+0000","last_unstale":"2023-08-25T04:19:42.898389+0000","last_undegraded":"2023-08-25T04:19:42.898389+0000","last_fullsized":"2023-08-25T04:19:42.898389+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:48:22.850815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.893884+0000","last_change":"2023-08-25T04:19:41.904119+0000","last_active":"2023-08-25T04:19:42.893884+0000","last_peered":"2023-08-25T04:19:42.893884+0000","last_clean":"2023-08-25T04:19:42.893884+0000","last_became_active":"2023-08-25T04:19:41.903770+0000","last_became_peered":"2023-08-25T04:19:41.903770+0000","last_unstale":"2023-08-25T04:19:42.893884+0000","last_undegraded":"2023-08-25T04:19:42.893884+0000","last_fullsized":"2023-08-25T04:19:42.893884+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:47:36.436499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894510+0000","last_change":"2023-08-25T04:19:41.908096+0000","last_active":"2023-08-25T04:19:42.894510+0000","last_peered":"2023-08-25T04:19:42.894510+0000","last_clean":"2023-08-25T04:19:42.894510+0000","last_became_active":"2023-08-25T04:19:41.907796+0000","last_became_peered":"2023-08-25T04:19:41.907796+0000","last_unstale":"2023-08-25T04:19:42.894510+0000","last_undegraded":"2023-08-25T04:19:42.894510+0000","last_fullsized":"2023-08-25T04:19:42.894510+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:11:54.260476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665630+0000","last_change":"2023-08-25T04:19:41.893948+0000","last_active":"2023-08-25T04:19:43.665630+0000","last_peered":"2023-08-25T04:19:43.665630+0000","last_clean":"2023-08-25T04:19:43.665630+0000","last_became_active":"2023-08-25T04:19:41.893665+0000","last_became_peered":"2023-08-25T04:19:41.893665+0000","last_unstale":"2023-08-25T04:19:43.665630+0000","last_undegraded":"2023-08-25T04:19:43.665630+0000","last_fullsized":"2023-08-25T04:19:43.665630+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:12:40.205573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892326+0000","last_change":"2023-08-25T04:19:41.885024+0000","last_active":"2023-08-25T04:19:42.892326+0000","last_peered":"2023-08-25T04:19:42.892326+0000","last_clean":"2023-08-25T04:19:42.892326+0000","last_became_active":"2023-08-25T04:19:41.884792+0000","last_became_peered":"2023-08-25T04:19:41.884792+0000","last_unstale":"2023-08-25T04:19:42.892326+0000","last_undegraded":"2023-08-25T04:19:42.892326+0000","last_fullsized":"2023-08-25T04:19:42.892326+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:44:28.053044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898827+0000","last_change":"2023-08-25T04:19:41.901272+0000","last_active":"2023-08-25T04:19:42.898827+0000","last_peered":"2023-08-25T04:19:42.898827+0000","last_clean":"2023-08-25T04:19:42.898827+0000","last_became_active":"2023-08-25T04:19:41.901014+0000","last_became_peered":"2023-08-25T04:19:41.901014+0000","last_unstale":"2023-08-25T04:19:42.898827+0000","last_undegraded":"2023-08-25T04:19:42.898827+0000","last_fullsized":"2023-08-25T04:19:42.898827+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:05:02.557336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.891956+0000","last_change":"2023-08-25T04:19:41.895507+0000","last_active":"2023-08-25T04:19:42.891956+0000","last_peered":"2023-08-25T04:19:42.891956+0000","last_clean":"2023-08-25T04:19:42.891956+0000","last_became_active":"2023-08-25T04:19:41.895251+0000","last_became_peered":"2023-08-25T04:19:41.895251+0000","last_unstale":"2023-08-25T04:19:42.891956+0000","last_undegraded":"2023-08-25T04:19:42.891956+0000","last_fullsized":"2023-08-25T04:19:42.891956+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:18:11.850527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.891835+0000","last_change":"2023-08-25T04:19:41.888255+0000","last_active":"2023-08-25T04:19:42.891835+0000","last_peered":"2023-08-25T04:19:42.891835+0000","last_clean":"2023-08-25T04:19:42.891835+0000","last_became_active":"2023-08-25T04:19:41.887900+0000","last_became_peered":"2023-08-25T04:19:41.887900+0000","last_unstale":"2023-08-25T04:19:42.891835+0000","last_undegraded":"2023-08-25T04:19:42.891835+0000","last_fullsized":"2023-08-25T04:19:42.891835+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:19.617236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663262+0000","last_change":"2023-08-25T04:19:41.889004+0000","last_active":"2023-08-25T04:19:43.663262+0000","last_peered":"2023-08-25T04:19:43.663262+0000","last_clean":"2023-08-25T04:19:43.663262+0000","last_became_active":"2023-08-25T04:19:41.888757+0000","last_became_peered":"2023-08-25T04:19:41.888757+0000","last_unstale":"2023-08-25T04:19:43.663262+0000","last_undegraded":"2023-08-25T04:19:43.663262+0000","last_fullsized":"2023-08-25T04:19:43.663262+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:30:57.139654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665392+0000","last_change":"2023-08-25T04:19:41.891005+0000","last_active":"2023-08-25T04:19:43.665392+0000","last_peered":"2023-08-25T04:19:43.665392+0000","last_clean":"2023-08-25T04:19:43.665392+0000","last_became_active":"2023-08-25T04:19:41.890761+0000","last_became_peered":"2023-08-25T04:19:41.890761+0000","last_unstale":"2023-08-25T04:19:43.665392+0000","last_undegraded":"2023-08-25T04:19:43.665392+0000","last_fullsized":"2023-08-25T04:19:43.665392+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:19:13.885326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663719+0000","last_change":"2023-08-25T04:19:41.891428+0000","last_active":"2023-08-25T04:19:43.663719+0000","last_peered":"2023-08-25T04:19:43.663719+0000","last_clean":"2023-08-25T04:19:43.663719+0000","last_became_active":"2023-08-25T04:19:41.891014+0000","last_became_peered":"2023-08-25T04:19:41.891014+0000","last_unstale":"2023-08-25T04:19:43.663719+0000","last_undegraded":"2023-08-25T04:19:43.663719+0000","last_fullsized":"2023-08-25T04:19:43.663719+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:32:10.185969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892185+0000","last_change":"2023-08-25T04:19:41.889902+0000","last_active":"2023-08-25T04:19:42.892185+0000","last_peered":"2023-08-25T04:19:42.892185+0000","last_clean":"2023-08-25T04:19:42.892185+0000","last_became_active":"2023-08-25T04:19:41.889618+0000","last_became_peered":"2023-08-25T04:19:41.889618+0000","last_unstale":"2023-08-25T04:19:42.892185+0000","last_undegraded":"2023-08-25T04:19:42.892185+0000","last_fullsized":"2023-08-25T04:19:42.892185+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:15:51.000962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665450+0000","last_change":"2023-08-25T04:19:41.890594+0000","last_active":"2023-08-25T04:19:43.665450+0000","last_peered":"2023-08-25T04:19:43.665450+0000","last_clean":"2023-08-25T04:19:43.665450+0000","last_became_active":"2023-08-25T04:19:41.890295+0000","last_became_peered":"2023-08-25T04:19:41.890295+0000","last_unstale":"2023-08-25T04:19:43.665450+0000","last_undegraded":"2023-08-25T04:19:43.665450+0000","last_fullsized":"2023-08-25T04:19:43.665450+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:16:52.693910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898910+0000","last_change":"2023-08-25T04:19:41.886482+0000","last_active":"2023-08-25T04:19:42.898910+0000","last_peered":"2023-08-25T04:19:42.898910+0000","last_clean":"2023-08-25T04:19:42.898910+0000","last_became_active":"2023-08-25T04:19:41.885947+0000","last_became_peered":"2023-08-25T04:19:41.885947+0000","last_unstale":"2023-08-25T04:19:42.898910+0000","last_undegraded":"2023-08-25T04:19:42.898910+0000","last_fullsized":"2023-08-25T04:19:42.898910+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:29.868669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895796+0000","last_change":"2023-08-25T04:19:41.907800+0000","last_active":"2023-08-25T04:19:42.895796+0000","last_peered":"2023-08-25T04:19:42.895796+0000","last_clean":"2023-08-25T04:19:42.895796+0000","last_became_active":"2023-08-25T04:19:41.907533+0000","last_became_peered":"2023-08-25T04:19:41.907533+0000","last_unstale":"2023-08-25T04:19:42.895796+0000","last_undegraded":"2023-08-25T04:19:42.895796+0000","last_fullsized":"2023-08-25T04:19:42.895796+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:40:51.393385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.891985+0000","last_change":"2023-08-25T04:19:41.889825+0000","last_active":"2023-08-25T04:19:42.891985+0000","last_peered":"2023-08-25T04:19:42.891985+0000","last_clean":"2023-08-25T04:19:42.891985+0000","last_became_active":"2023-08-25T04:19:41.889520+0000","last_became_peered":"2023-08-25T04:19:41.889520+0000","last_unstale":"2023-08-25T04:19:42.891985+0000","last_undegraded":"2023-08-25T04:19:42.891985+0000","last_fullsized":"2023-08-25T04:19:42.891985+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:56:53.998165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.662912+0000","last_change":"2023-08-25T04:19:41.892895+0000","last_active":"2023-08-25T04:19:43.662912+0000","last_peered":"2023-08-25T04:19:43.662912+0000","last_clean":"2023-08-25T04:19:43.662912+0000","last_became_active":"2023-08-25T04:19:41.892623+0000","last_became_peered":"2023-08-25T04:19:41.892623+0000","last_unstale":"2023-08-25T04:19:43.662912+0000","last_undegraded":"2023-08-25T04:19:43.662912+0000","last_fullsized":"2023-08-25T04:19:43.662912+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:29:17.679853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.893874+0000","last_change":"2023-08-25T04:19:41.907732+0000","last_active":"2023-08-25T04:19:42.893874+0000","last_peered":"2023-08-25T04:19:42.893874+0000","last_clean":"2023-08-25T04:19:42.893874+0000","last_became_active":"2023-08-25T04:19:41.907433+0000","last_became_peered":"2023-08-25T04:19:41.907433+0000","last_unstale":"2023-08-25T04:19:42.893874+0000","last_undegraded":"2023-08-25T04:19:42.893874+0000","last_fullsized":"2023-08-25T04:19:42.893874+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:02:08.662125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894225+0000","last_change":"2023-08-25T04:19:41.912135+0000","last_active":"2023-08-25T04:19:42.894225+0000","last_peered":"2023-08-25T04:19:42.894225+0000","last_clean":"2023-08-25T04:19:42.894225+0000","last_became_active":"2023-08-25T04:19:41.908659+0000","last_became_peered":"2023-08-25T04:19:41.908659+0000","last_unstale":"2023-08-25T04:19:42.894225+0000","last_undegraded":"2023-08-25T04:19:42.894225+0000","last_fullsized":"2023-08-25T04:19:42.894225+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:38:28.530195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"105'4","reported_seq":17,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663426+0000","last_change":"2023-08-25T04:19:40.898787+0000","last_active":"2023-08-25T04:19:43.663426+0000","last_peered":"2023-08-25T04:19:43.663426+0000","last_clean":"2023-08-25T04:19:43.663426+0000","last_became_active":"2023-08-25T04:19:40.898515+0000","last_became_peered":"2023-08-25T04:19:40.898515+0000","last_unstale":"2023-08-25T04:19:43.663426+0000","last_undegraded":"2023-08-25T04:19:43.663426+0000","last_fullsized":"2023-08-25T04:19:43.663426+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:53:47.519111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894264+0000","last_change":"2023-08-25T04:19:41.911106+0000","last_active":"2023-08-25T04:19:42.894264+0000","last_peered":"2023-08-25T04:19:42.894264+0000","last_clean":"2023-08-25T04:19:42.894264+0000","last_became_active":"2023-08-25T04:19:41.910685+0000","last_became_peered":"2023-08-25T04:19:41.910685+0000","last_unstale":"2023-08-25T04:19:42.894264+0000","last_undegraded":"2023-08-25T04:19:42.894264+0000","last_fullsized":"2023-08-25T04:19:42.894264+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:00:49.023062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892254+0000","last_change":"2023-08-25T04:19:40.885801+0000","last_active":"2023-08-25T04:19:42.892254+0000","last_peered":"2023-08-25T04:19:42.892254+0000","last_clean":"2023-08-25T04:19:42.892254+0000","last_became_active":"2023-08-25T04:19:40.885527+0000","last_became_peered":"2023-08-25T04:19:40.885527+0000","last_unstale":"2023-08-25T04:19:42.892254+0000","last_undegraded":"2023-08-25T04:19:42.892254+0000","last_fullsized":"2023-08-25T04:19:42.892254+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:27.110975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895966+0000","last_change":"2023-08-25T04:19:41.903603+0000","last_active":"2023-08-25T04:19:42.895966+0000","last_peered":"2023-08-25T04:19:42.895966+0000","last_clean":"2023-08-25T04:19:42.895966+0000","last_became_active":"2023-08-25T04:19:41.903265+0000","last_became_peered":"2023-08-25T04:19:41.903265+0000","last_unstale":"2023-08-25T04:19:42.895966+0000","last_undegraded":"2023-08-25T04:19:42.895966+0000","last_fullsized":"2023-08-25T04:19:42.895966+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:41:01.030543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895884+0000","last_change":"2023-08-25T04:19:40.891925+0000","last_active":"2023-08-25T04:19:42.895884+0000","last_peered":"2023-08-25T04:19:42.895884+0000","last_clean":"2023-08-25T04:19:42.895884+0000","last_became_active":"2023-08-25T04:19:40.891676+0000","last_became_peered":"2023-08-25T04:19:40.891676+0000","last_unstale":"2023-08-25T04:19:42.895884+0000","last_undegraded":"2023-08-25T04:19:42.895884+0000","last_fullsized":"2023-08-25T04:19:42.895884+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:20:29.662430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894581+0000","last_change":"2023-08-25T04:19:41.907564+0000","last_active":"2023-08-25T04:19:42.894581+0000","last_peered":"2023-08-25T04:19:42.894581+0000","last_clean":"2023-08-25T04:19:42.894581+0000","last_became_active":"2023-08-25T04:19:41.907280+0000","last_became_peered":"2023-08-25T04:19:41.907280+0000","last_unstale":"2023-08-25T04:19:42.894581+0000","last_undegraded":"2023-08-25T04:19:42.894581+0000","last_fullsized":"2023-08-25T04:19:42.894581+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:05:42.470420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663343+0000","last_change":"2023-08-25T04:19:40.896552+0000","last_active":"2023-08-25T04:19:43.663343+0000","last_peered":"2023-08-25T04:19:43.663343+0000","last_clean":"2023-08-25T04:19:43.663343+0000","last_became_active":"2023-08-25T04:19:40.896374+0000","last_became_peered":"2023-08-25T04:19:40.896374+0000","last_unstale":"2023-08-25T04:19:43.663343+0000","last_undegraded":"2023-08-25T04:19:43.663343+0000","last_fullsized":"2023-08-25T04:19:43.663343+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:13:44.596252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.899106+0000","last_change":"2023-08-25T04:19:41.889967+0000","last_active":"2023-08-25T04:19:42.899106+0000","last_peered":"2023-08-25T04:19:42.899106+0000","last_clean":"2023-08-25T04:19:42.899106+0000","last_became_active":"2023-08-25T04:19:41.889213+0000","last_became_peered":"2023-08-25T04:19:41.889213+0000","last_unstale":"2023-08-25T04:19:42.899106+0000","last_undegraded":"2023-08-25T04:19:42.899106+0000","last_fullsized":"2023-08-25T04:19:42.899106+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:14:40.897561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892082+0000","last_change":"2023-08-25T04:19:40.887257+0000","last_active":"2023-08-25T04:19:42.892082+0000","last_peered":"2023-08-25T04:19:42.892082+0000","last_clean":"2023-08-25T04:19:42.892082+0000","last_became_active":"2023-08-25T04:19:40.886960+0000","last_became_peered":"2023-08-25T04:19:40.886960+0000","last_unstale":"2023-08-25T04:19:42.892082+0000","last_undegraded":"2023-08-25T04:19:42.892082+0000","last_fullsized":"2023-08-25T04:19:42.892082+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:05:38.594325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663630+0000","last_change":"2023-08-25T04:19:41.903870+0000","last_active":"2023-08-25T04:19:43.663630+0000","last_peered":"2023-08-25T04:19:43.663630+0000","last_clean":"2023-08-25T04:19:43.663630+0000","last_became_active":"2023-08-25T04:19:41.902846+0000","last_became_peered":"2023-08-25T04:19:41.902846+0000","last_unstale":"2023-08-25T04:19:43.663630+0000","last_undegraded":"2023-08-25T04:19:43.663630+0000","last_fullsized":"2023-08-25T04:19:43.663630+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:03:27.491490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898651+0000","last_change":"2023-08-25T04:19:40.890630+0000","last_active":"2023-08-25T04:19:42.898651+0000","last_peered":"2023-08-25T04:19:42.898651+0000","last_clean":"2023-08-25T04:19:42.898651+0000","last_became_active":"2023-08-25T04:19:40.890342+0000","last_became_peered":"2023-08-25T04:19:40.890342+0000","last_unstale":"2023-08-25T04:19:42.898651+0000","last_undegraded":"2023-08-25T04:19:42.898651+0000","last_fullsized":"2023-08-25T04:19:42.898651+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:33.068046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894021+0000","last_change":"2023-08-25T04:19:41.911955+0000","last_active":"2023-08-25T04:19:42.894021+0000","last_peered":"2023-08-25T04:19:42.894021+0000","last_clean":"2023-08-25T04:19:42.894021+0000","last_became_active":"2023-08-25T04:19:41.911696+0000","last_became_peered":"2023-08-25T04:19:41.911696+0000","last_unstale":"2023-08-25T04:19:42.894021+0000","last_undegraded":"2023-08-25T04:19:42.894021+0000","last_fullsized":"2023-08-25T04:19:42.894021+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:17:15.554678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665687+0000","last_change":"2023-08-25T04:19:40.892468+0000","last_active":"2023-08-25T04:19:43.665687+0000","last_peered":"2023-08-25T04:19:43.665687+0000","last_clean":"2023-08-25T04:19:43.665687+0000","last_became_active":"2023-08-25T04:19:40.892134+0000","last_became_peered":"2023-08-25T04:19:40.892134+0000","last_unstale":"2023-08-25T04:19:43.665687+0000","last_undegraded":"2023-08-25T04:19:43.665687+0000","last_fullsized":"2023-08-25T04:19:43.665687+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:32:15.053322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898672+0000","last_change":"2023-08-25T04:19:41.886919+0000","last_active":"2023-08-25T04:19:42.898672+0000","last_peered":"2023-08-25T04:19:42.898672+0000","last_clean":"2023-08-25T04:19:42.898672+0000","last_became_active":"2023-08-25T04:19:41.886598+0000","last_became_peered":"2023-08-25T04:19:41.886598+0000","last_unstale":"2023-08-25T04:19:42.898672+0000","last_undegraded":"2023-08-25T04:19:42.898672+0000","last_fullsized":"2023-08-25T04:19:42.898672+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:30:55.735155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895758+0000","last_change":"2023-08-25T04:19:40.899648+0000","last_active":"2023-08-25T04:19:42.895758+0000","last_peered":"2023-08-25T04:19:42.895758+0000","last_clean":"2023-08-25T04:19:42.895758+0000","last_became_active":"2023-08-25T04:19:40.899405+0000","last_became_peered":"2023-08-25T04:19:40.899405+0000","last_unstale":"2023-08-25T04:19:42.895758+0000","last_undegraded":"2023-08-25T04:19:42.895758+0000","last_fullsized":"2023-08-25T04:19:42.895758+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:22:15.682094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892174+0000","last_change":"2023-08-25T04:19:41.897500+0000","last_active":"2023-08-25T04:19:42.892174+0000","last_peered":"2023-08-25T04:19:42.892174+0000","last_clean":"2023-08-25T04:19:42.892174+0000","last_became_active":"2023-08-25T04:19:41.897228+0000","last_became_peered":"2023-08-25T04:19:41.897228+0000","last_unstale":"2023-08-25T04:19:42.892174+0000","last_undegraded":"2023-08-25T04:19:42.892174+0000","last_fullsized":"2023-08-25T04:19:42.892174+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:25:23.161265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663793+0000","last_change":"2023-08-25T04:19:40.889045+0000","last_active":"2023-08-25T04:19:43.663793+0000","last_peered":"2023-08-25T04:19:43.663793+0000","last_clean":"2023-08-25T04:19:43.663793+0000","last_became_active":"2023-08-25T04:19:40.888607+0000","last_became_peered":"2023-08-25T04:19:40.888607+0000","last_unstale":"2023-08-25T04:19:43.663793+0000","last_undegraded":"2023-08-25T04:19:43.663793+0000","last_fullsized":"2023-08-25T04:19:43.663793+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:15:53.081071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895763+0000","last_change":"2023-08-25T04:19:41.899010+0000","last_active":"2023-08-25T04:19:42.895763+0000","last_peered":"2023-08-25T04:19:42.895763+0000","last_clean":"2023-08-25T04:19:42.895763+0000","last_became_active":"2023-08-25T04:19:41.898739+0000","last_became_peered":"2023-08-25T04:19:41.898739+0000","last_unstale":"2023-08-25T04:19:42.895763+0000","last_undegraded":"2023-08-25T04:19:42.895763+0000","last_fullsized":"2023-08-25T04:19:42.895763+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:58.849460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665734+0000","last_change":"2023-08-25T04:19:40.899283+0000","last_active":"2023-08-25T04:19:43.665734+0000","last_peered":"2023-08-25T04:19:43.665734+0000","last_clean":"2023-08-25T04:19:43.665734+0000","last_became_active":"2023-08-25T04:19:40.898940+0000","last_became_peered":"2023-08-25T04:19:40.898940+0000","last_unstale":"2023-08-25T04:19:43.665734+0000","last_undegraded":"2023-08-25T04:19:43.665734+0000","last_fullsized":"2023-08-25T04:19:43.665734+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:31.402164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665688+0000","last_change":"2023-08-25T04:19:41.905509+0000","last_active":"2023-08-25T04:19:43.665688+0000","last_peered":"2023-08-25T04:19:43.665688+0000","last_clean":"2023-08-25T04:19:43.665688+0000","last_became_active":"2023-08-25T04:19:41.905242+0000","last_became_peered":"2023-08-25T04:19:41.905242+0000","last_unstale":"2023-08-25T04:19:43.665688+0000","last_undegraded":"2023-08-25T04:19:43.665688+0000","last_fullsized":"2023-08-25T04:19:43.665688+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:23:37.979793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"105'3","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892413+0000","last_change":"2023-08-25T04:19:40.898940+0000","last_active":"2023-08-25T04:19:42.892413+0000","last_peered":"2023-08-25T04:19:42.892413+0000","last_clean":"2023-08-25T04:19:42.892413+0000","last_became_active":"2023-08-25T04:19:40.898474+0000","last_became_peered":"2023-08-25T04:19:40.898474+0000","last_unstale":"2023-08-25T04:19:42.892413+0000","last_undegraded":"2023-08-25T04:19:42.892413+0000","last_fullsized":"2023-08-25T04:19:42.892413+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:09:59.626997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.899096+0000","last_change":"2023-08-25T04:19:41.893039+0000","last_active":"2023-08-25T04:19:42.899096+0000","last_peered":"2023-08-25T04:19:42.899096+0000","last_clean":"2023-08-25T04:19:42.899096+0000","last_became_active":"2023-08-25T04:19:41.892753+0000","last_became_peered":"2023-08-25T04:19:41.892753+0000","last_unstale":"2023-08-25T04:19:42.899096+0000","last_undegraded":"2023-08-25T04:19:42.899096+0000","last_fullsized":"2023-08-25T04:19:42.899096+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:20:29.110139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"105'6","reported_seq":19,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894323+0000","last_change":"2023-08-25T04:19:40.900998+0000","last_active":"2023-08-25T04:19:42.894323+0000","last_peered":"2023-08-25T04:19:42.894323+0000","last_clean":"2023-08-25T04:19:42.894323+0000","last_became_active":"2023-08-25T04:19:40.900729+0000","last_became_peered":"2023-08-25T04:19:40.900729+0000","last_unstale":"2023-08-25T04:19:42.894323+0000","last_undegraded":"2023-08-25T04:19:42.894323+0000","last_fullsized":"2023-08-25T04:19:42.894323+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:30:27.855057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898332+0000","last_change":"2023-08-25T04:19:41.900468+0000","last_active":"2023-08-25T04:19:42.898332+0000","last_peered":"2023-08-25T04:19:42.898332+0000","last_clean":"2023-08-25T04:19:42.898332+0000","last_became_active":"2023-08-25T04:19:41.900027+0000","last_became_peered":"2023-08-25T04:19:41.900027+0000","last_unstale":"2023-08-25T04:19:42.898332+0000","last_undegraded":"2023-08-25T04:19:42.898332+0000","last_fullsized":"2023-08-25T04:19:42.898332+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:27:32.656198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895791+0000","last_change":"2023-08-25T04:19:40.899588+0000","last_active":"2023-08-25T04:19:42.895791+0000","last_peered":"2023-08-25T04:19:42.895791+0000","last_clean":"2023-08-25T04:19:42.895791+0000","last_became_active":"2023-08-25T04:19:40.899317+0000","last_became_peered":"2023-08-25T04:19:40.899317+0000","last_unstale":"2023-08-25T04:19:42.895791+0000","last_undegraded":"2023-08-25T04:19:42.895791+0000","last_fullsized":"2023-08-25T04:19:42.895791+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:27:22.727108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.891800+0000","last_change":"2023-08-25T04:19:41.882821+0000","last_active":"2023-08-25T04:19:42.891800+0000","last_peered":"2023-08-25T04:19:42.891800+0000","last_clean":"2023-08-25T04:19:42.891800+0000","last_became_active":"2023-08-25T04:19:41.882550+0000","last_became_peered":"2023-08-25T04:19:41.882550+0000","last_unstale":"2023-08-25T04:19:42.891800+0000","last_undegraded":"2023-08-25T04:19:42.891800+0000","last_fullsized":"2023-08-25T04:19:42.891800+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:50:08.947936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.893997+0000","last_change":"2023-08-25T04:19:40.900933+0000","last_active":"2023-08-25T04:19:42.893997+0000","last_peered":"2023-08-25T04:19:42.893997+0000","last_clean":"2023-08-25T04:19:42.893997+0000","last_became_active":"2023-08-25T04:19:40.900610+0000","last_became_peered":"2023-08-25T04:19:40.900610+0000","last_unstale":"2023-08-25T04:19:42.893997+0000","last_undegraded":"2023-08-25T04:19:42.893997+0000","last_fullsized":"2023-08-25T04:19:42.893997+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:13:38.475112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665119+0000","last_change":"2023-08-25T04:19:41.893371+0000","last_active":"2023-08-25T04:19:43.665119+0000","last_peered":"2023-08-25T04:19:43.665119+0000","last_clean":"2023-08-25T04:19:43.665119+0000","last_became_active":"2023-08-25T04:19:41.893099+0000","last_became_peered":"2023-08-25T04:19:41.893099+0000","last_unstale":"2023-08-25T04:19:43.665119+0000","last_undegraded":"2023-08-25T04:19:43.665119+0000","last_fullsized":"2023-08-25T04:19:43.665119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:44:30.148605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.899225+0000","last_change":"2023-08-25T04:19:40.889107+0000","last_active":"2023-08-25T04:19:42.899225+0000","last_peered":"2023-08-25T04:19:42.899225+0000","last_clean":"2023-08-25T04:19:42.899225+0000","last_became_active":"2023-08-25T04:19:40.888769+0000","last_became_peered":"2023-08-25T04:19:40.888769+0000","last_unstale":"2023-08-25T04:19:42.899225+0000","last_undegraded":"2023-08-25T04:19:42.899225+0000","last_fullsized":"2023-08-25T04:19:42.899225+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:33:03.241173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665330+0000","last_change":"2023-08-25T04:19:41.894694+0000","last_active":"2023-08-25T04:19:43.665330+0000","last_peered":"2023-08-25T04:19:43.665330+0000","last_clean":"2023-08-25T04:19:43.665330+0000","last_became_active":"2023-08-25T04:19:41.894434+0000","last_became_peered":"2023-08-25T04:19:41.894434+0000","last_unstale":"2023-08-25T04:19:43.665330+0000","last_undegraded":"2023-08-25T04:19:43.665330+0000","last_fullsized":"2023-08-25T04:19:43.665330+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:59:49.857880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"105'8","reported_seq":21,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898438+0000","last_change":"2023-08-25T04:19:40.890314+0000","last_active":"2023-08-25T04:19:42.898438+0000","last_peered":"2023-08-25T04:19:42.898438+0000","last_clean":"2023-08-25T04:19:42.898438+0000","last_became_active":"2023-08-25T04:19:40.890039+0000","last_became_peered":"2023-08-25T04:19:40.890039+0000","last_unstale":"2023-08-25T04:19:42.898438+0000","last_undegraded":"2023-08-25T04:19:42.898438+0000","last_fullsized":"2023-08-25T04:19:42.898438+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:18:19.534084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663268+0000","last_change":"2023-08-25T04:19:41.895417+0000","last_active":"2023-08-25T04:19:43.663268+0000","last_peered":"2023-08-25T04:19:43.663268+0000","last_clean":"2023-08-25T04:19:43.663268+0000","last_became_active":"2023-08-25T04:19:41.895138+0000","last_became_peered":"2023-08-25T04:19:41.895138+0000","last_unstale":"2023-08-25T04:19:43.663268+0000","last_undegraded":"2023-08-25T04:19:43.663268+0000","last_fullsized":"2023-08-25T04:19:43.663268+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:24:45.202315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.896039+0000","last_change":"2023-08-25T04:19:40.891823+0000","last_active":"2023-08-25T04:19:42.896039+0000","last_peered":"2023-08-25T04:19:42.896039+0000","last_clean":"2023-08-25T04:19:42.896039+0000","last_became_active":"2023-08-25T04:19:40.891569+0000","last_became_peered":"2023-08-25T04:19:40.891569+0000","last_unstale":"2023-08-25T04:19:42.896039+0000","last_undegraded":"2023-08-25T04:19:42.896039+0000","last_fullsized":"2023-08-25T04:19:42.896039+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:57:01.386059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894336+0000","last_change":"2023-08-25T04:19:41.910936+0000","last_active":"2023-08-25T04:19:42.894336+0000","last_peered":"2023-08-25T04:19:42.894336+0000","last_clean":"2023-08-25T04:19:42.894336+0000","last_became_active":"2023-08-25T04:19:41.910413+0000","last_became_peered":"2023-08-25T04:19:41.910413+0000","last_unstale":"2023-08-25T04:19:42.894336+0000","last_undegraded":"2023-08-25T04:19:42.894336+0000","last_fullsized":"2023-08-25T04:19:42.894336+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:35:00.168476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892266+0000","last_change":"2023-08-25T04:19:40.888478+0000","last_active":"2023-08-25T04:19:42.892266+0000","last_peered":"2023-08-25T04:19:42.892266+0000","last_clean":"2023-08-25T04:19:42.892266+0000","last_became_active":"2023-08-25T04:19:40.888095+0000","last_became_peered":"2023-08-25T04:19:40.888095+0000","last_unstale":"2023-08-25T04:19:42.892266+0000","last_undegraded":"2023-08-25T04:19:42.892266+0000","last_fullsized":"2023-08-25T04:19:42.892266+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:21:29.749789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894399+0000","last_change":"2023-08-25T04:19:41.910119+0000","last_active":"2023-08-25T04:19:42.894399+0000","last_peered":"2023-08-25T04:19:42.894399+0000","last_clean":"2023-08-25T04:19:42.894399+0000","last_became_active":"2023-08-25T04:19:41.908668+0000","last_became_peered":"2023-08-25T04:19:41.908668+0000","last_unstale":"2023-08-25T04:19:42.894399+0000","last_undegraded":"2023-08-25T04:19:42.894399+0000","last_fullsized":"2023-08-25T04:19:42.894399+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:47:01.021287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892481+0000","last_change":"2023-08-25T04:19:40.898764+0000","last_active":"2023-08-25T04:19:42.892481+0000","last_peered":"2023-08-25T04:19:42.892481+0000","last_clean":"2023-08-25T04:19:42.892481+0000","last_became_active":"2023-08-25T04:19:40.898484+0000","last_became_peered":"2023-08-25T04:19:40.898484+0000","last_unstale":"2023-08-25T04:19:42.892481+0000","last_undegraded":"2023-08-25T04:19:42.892481+0000","last_fullsized":"2023-08-25T04:19:42.892481+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:01:21.641112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663774+0000","last_change":"2023-08-25T04:19:41.895638+0000","last_active":"2023-08-25T04:19:43.663774+0000","last_peered":"2023-08-25T04:19:43.663774+0000","last_clean":"2023-08-25T04:19:43.663774+0000","last_became_active":"2023-08-25T04:19:41.895377+0000","last_became_peered":"2023-08-25T04:19:41.895377+0000","last_unstale":"2023-08-25T04:19:43.663774+0000","last_undegraded":"2023-08-25T04:19:43.663774+0000","last_fullsized":"2023-08-25T04:19:43.663774+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:55:43.951635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663367+0000","last_change":"2023-08-25T04:19:40.886820+0000","last_active":"2023-08-25T04:19:43.663367+0000","last_peered":"2023-08-25T04:19:43.663367+0000","last_clean":"2023-08-25T04:19:43.663367+0000","last_became_active":"2023-08-25T04:19:40.886510+0000","last_became_peered":"2023-08-25T04:19:40.886510+0000","last_unstale":"2023-08-25T04:19:43.663367+0000","last_undegraded":"2023-08-25T04:19:43.663367+0000","last_fullsized":"2023-08-25T04:19:43.663367+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:53:56.409846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665011+0000","last_change":"2023-08-25T04:19:41.911130+0000","last_active":"2023-08-25T04:19:43.665011+0000","last_peered":"2023-08-25T04:19:43.665011+0000","last_clean":"2023-08-25T04:19:43.665011+0000","last_became_active":"2023-08-25T04:19:41.909973+0000","last_became_peered":"2023-08-25T04:19:41.909973+0000","last_unstale":"2023-08-25T04:19:43.665011+0000","last_undegraded":"2023-08-25T04:19:43.665011+0000","last_fullsized":"2023-08-25T04:19:43.665011+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:38:07.090247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894279+0000","last_change":"2023-08-25T04:19:40.901212+0000","last_active":"2023-08-25T04:19:42.894279+0000","last_peered":"2023-08-25T04:19:42.894279+0000","last_clean":"2023-08-25T04:19:42.894279+0000","last_became_active":"2023-08-25T04:19:40.900450+0000","last_became_peered":"2023-08-25T04:19:40.900450+0000","last_unstale":"2023-08-25T04:19:42.894279+0000","last_undegraded":"2023-08-25T04:19:42.894279+0000","last_fullsized":"2023-08-25T04:19:42.894279+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:06:25.729783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665546+0000","last_change":"2023-08-25T04:19:41.897014+0000","last_active":"2023-08-25T04:19:43.665546+0000","last_peered":"2023-08-25T04:19:43.665546+0000","last_clean":"2023-08-25T04:19:43.665546+0000","last_became_active":"2023-08-25T04:19:41.896368+0000","last_became_peered":"2023-08-25T04:19:41.896368+0000","last_unstale":"2023-08-25T04:19:43.665546+0000","last_undegraded":"2023-08-25T04:19:43.665546+0000","last_fullsized":"2023-08-25T04:19:43.665546+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:58.694119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663114+0000","last_change":"2023-08-25T04:19:40.887802+0000","last_active":"2023-08-25T04:19:43.663114+0000","last_peered":"2023-08-25T04:19:43.663114+0000","last_clean":"2023-08-25T04:19:43.663114+0000","last_became_active":"2023-08-25T04:19:40.887524+0000","last_became_peered":"2023-08-25T04:19:40.887524+0000","last_unstale":"2023-08-25T04:19:43.663114+0000","last_undegraded":"2023-08-25T04:19:43.663114+0000","last_fullsized":"2023-08-25T04:19:43.663114+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:13:42.252860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663000+0000","last_change":"2023-08-25T04:19:41.888396+0000","last_active":"2023-08-25T04:19:43.663000+0000","last_peered":"2023-08-25T04:19:43.663000+0000","last_clean":"2023-08-25T04:19:43.663000+0000","last_became_active":"2023-08-25T04:19:41.888159+0000","last_became_peered":"2023-08-25T04:19:41.888159+0000","last_unstale":"2023-08-25T04:19:43.663000+0000","last_undegraded":"2023-08-25T04:19:43.663000+0000","last_fullsized":"2023-08-25T04:19:43.663000+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:30:51.066940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663653+0000","last_change":"2023-08-25T04:19:40.887614+0000","last_active":"2023-08-25T04:19:43.663653+0000","last_peered":"2023-08-25T04:19:43.663653+0000","last_clean":"2023-08-25T04:19:43.663653+0000","last_became_active":"2023-08-25T04:19:40.887354+0000","last_became_peered":"2023-08-25T04:19:40.887354+0000","last_unstale":"2023-08-25T04:19:43.663653+0000","last_undegraded":"2023-08-25T04:19:43.663653+0000","last_fullsized":"2023-08-25T04:19:43.663653+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:50.169800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894173+0000","last_change":"2023-08-25T04:19:41.902881+0000","last_active":"2023-08-25T04:19:42.894173+0000","last_peered":"2023-08-25T04:19:42.894173+0000","last_clean":"2023-08-25T04:19:42.894173+0000","last_became_active":"2023-08-25T04:19:41.902588+0000","last_became_peered":"2023-08-25T04:19:41.902588+0000","last_unstale":"2023-08-25T04:19:42.894173+0000","last_undegraded":"2023-08-25T04:19:42.894173+0000","last_fullsized":"2023-08-25T04:19:42.894173+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:27:16.063317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895576+0000","last_change":"2023-08-25T04:19:40.897361+0000","last_active":"2023-08-25T04:19:42.895576+0000","last_peered":"2023-08-25T04:19:42.895576+0000","last_clean":"2023-08-25T04:19:42.895576+0000","last_became_active":"2023-08-25T04:19:40.897118+0000","last_became_peered":"2023-08-25T04:19:40.897118+0000","last_unstale":"2023-08-25T04:19:42.895576+0000","last_undegraded":"2023-08-25T04:19:42.895576+0000","last_fullsized":"2023-08-25T04:19:42.895576+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:26:11.555112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.896018+0000","last_change":"2023-08-25T04:19:41.903029+0000","last_active":"2023-08-25T04:19:42.896018+0000","last_peered":"2023-08-25T04:19:42.896018+0000","last_clean":"2023-08-25T04:19:42.896018+0000","last_became_active":"2023-08-25T04:19:41.902460+0000","last_became_peered":"2023-08-25T04:19:41.902460+0000","last_unstale":"2023-08-25T04:19:42.896018+0000","last_undegraded":"2023-08-25T04:19:42.896018+0000","last_fullsized":"2023-08-25T04:19:42.896018+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:06:52.404331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898914+0000","last_change":"2023-08-25T04:19:40.893346+0000","last_active":"2023-08-25T04:19:42.898914+0000","last_peered":"2023-08-25T04:19:42.898914+0000","last_clean":"2023-08-25T04:19:42.898914+0000","last_became_active":"2023-08-25T04:19:40.892055+0000","last_became_peered":"2023-08-25T04:19:40.892055+0000","last_unstale":"2023-08-25T04:19:42.898914+0000","last_undegraded":"2023-08-25T04:19:42.898914+0000","last_fullsized":"2023-08-25T04:19:42.898914+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:35:39.736125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"106'2822","reported_seq":3229,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:45.449134+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:19:45.449134+0000","last_peered":"2023-08-25T04:19:45.449134+0000","last_clean":"2023-08-25T04:19:45.449134+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:19:45.449134+0000","last_undegraded":"2023-08-25T04:19:45.449134+0000","last_fullsized":"2023-08-25T04:19:45.449134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":2822,"log_dups_size":0,"ondisk_log_size":2822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:06:43.866997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":750,"num_read_kb":1515,"num_write":285,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":161,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663187+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:19:43.663187+0000","last_peered":"2023-08-25T04:19:43.663187+0000","last_clean":"2023-08-25T04:19:43.663187+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:19:43.663187+0000","last_undegraded":"2023-08-25T04:19:43.663187+0000","last_fullsized":"2023-08-25T04:19:43.663187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:50:11.429397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894376+0000","last_change":"2023-08-25T04:19:41.903347+0000","last_active":"2023-08-25T04:19:42.894376+0000","last_peered":"2023-08-25T04:19:42.894376+0000","last_clean":"2023-08-25T04:19:42.894376+0000","last_became_active":"2023-08-25T04:19:41.903097+0000","last_became_peered":"2023-08-25T04:19:41.903097+0000","last_unstale":"2023-08-25T04:19:42.894376+0000","last_undegraded":"2023-08-25T04:19:42.894376+0000","last_fullsized":"2023-08-25T04:19:42.894376+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:42:42.088067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663310+0000","last_change":"2023-08-25T04:19:40.886640+0000","last_active":"2023-08-25T04:19:43.663310+0000","last_peered":"2023-08-25T04:19:43.663310+0000","last_clean":"2023-08-25T04:19:43.663310+0000","last_became_active":"2023-08-25T04:19:40.886327+0000","last_became_peered":"2023-08-25T04:19:40.886327+0000","last_unstale":"2023-08-25T04:19:43.663310+0000","last_undegraded":"2023-08-25T04:19:43.663310+0000","last_fullsized":"2023-08-25T04:19:43.663310+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:30:11.680409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895784+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:19:42.895784+0000","last_peered":"2023-08-25T04:19:42.895784+0000","last_clean":"2023-08-25T04:19:42.895784+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:19:42.895784+0000","last_undegraded":"2023-08-25T04:19:42.895784+0000","last_fullsized":"2023-08-25T04:19:42.895784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:27:04.060862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663405+0000","last_change":"2023-08-25T04:19:41.891179+0000","last_active":"2023-08-25T04:19:43.663405+0000","last_peered":"2023-08-25T04:19:43.663405+0000","last_clean":"2023-08-25T04:19:43.663405+0000","last_became_active":"2023-08-25T04:19:41.890922+0000","last_became_peered":"2023-08-25T04:19:41.890922+0000","last_unstale":"2023-08-25T04:19:43.663405+0000","last_undegraded":"2023-08-25T04:19:43.663405+0000","last_fullsized":"2023-08-25T04:19:43.663405+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:37.458532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895944+0000","last_change":"2023-08-25T04:19:40.893815+0000","last_active":"2023-08-25T04:19:42.895944+0000","last_peered":"2023-08-25T04:19:42.895944+0000","last_clean":"2023-08-25T04:19:42.895944+0000","last_became_active":"2023-08-25T04:19:40.893541+0000","last_became_peered":"2023-08-25T04:19:40.893541+0000","last_unstale":"2023-08-25T04:19:42.895944+0000","last_undegraded":"2023-08-25T04:19:42.895944+0000","last_fullsized":"2023-08-25T04:19:42.895944+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:49:32.003310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":165,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.664981+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:19:43.664981+0000","last_peered":"2023-08-25T04:19:43.664981+0000","last_clean":"2023-08-25T04:19:43.664981+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:19:43.664981+0000","last_undegraded":"2023-08-25T04:19:43.664981+0000","last_fullsized":"2023-08-25T04:19:43.664981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:15:08.893461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892167+0000","last_change":"2023-08-25T04:19:41.886006+0000","last_active":"2023-08-25T04:19:42.892167+0000","last_peered":"2023-08-25T04:19:42.892167+0000","last_clean":"2023-08-25T04:19:42.892167+0000","last_became_active":"2023-08-25T04:19:41.885711+0000","last_became_peered":"2023-08-25T04:19:41.885711+0000","last_unstale":"2023-08-25T04:19:42.892167+0000","last_undegraded":"2023-08-25T04:19:42.892167+0000","last_fullsized":"2023-08-25T04:19:42.892167+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:01:14.895211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"105'1","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.892479+0000","last_change":"2023-08-25T04:19:40.887520+0000","last_active":"2023-08-25T04:19:42.892479+0000","last_peered":"2023-08-25T04:19:42.892479+0000","last_clean":"2023-08-25T04:19:42.892479+0000","last_became_active":"2023-08-25T04:19:40.887274+0000","last_became_peered":"2023-08-25T04:19:40.887274+0000","last_unstale":"2023-08-25T04:19:42.892479+0000","last_undegraded":"2023-08-25T04:19:42.892479+0000","last_fullsized":"2023-08-25T04:19:42.892479+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:53.057687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":161,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663219+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:19:43.663219+0000","last_peered":"2023-08-25T04:19:43.663219+0000","last_clean":"2023-08-25T04:19:43.663219+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:19:43.663219+0000","last_undegraded":"2023-08-25T04:19:43.663219+0000","last_fullsized":"2023-08-25T04:19:43.663219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:31:11.801727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.893991+0000","last_change":"2023-08-25T04:19:41.904671+0000","last_active":"2023-08-25T04:19:42.893991+0000","last_peered":"2023-08-25T04:19:42.893991+0000","last_clean":"2023-08-25T04:19:42.893991+0000","last_became_active":"2023-08-25T04:19:41.904380+0000","last_became_peered":"2023-08-25T04:19:41.904380+0000","last_unstale":"2023-08-25T04:19:42.893991+0000","last_undegraded":"2023-08-25T04:19:42.893991+0000","last_fullsized":"2023-08-25T04:19:42.893991+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:07.428454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"105'2","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663069+0000","last_change":"2023-08-25T04:19:40.888193+0000","last_active":"2023-08-25T04:19:43.663069+0000","last_peered":"2023-08-25T04:19:43.663069+0000","last_clean":"2023-08-25T04:19:43.663069+0000","last_became_active":"2023-08-25T04:19:40.887920+0000","last_became_peered":"2023-08-25T04:19:40.887920+0000","last_unstale":"2023-08-25T04:19:43.663069+0000","last_undegraded":"2023-08-25T04:19:43.663069+0000","last_fullsized":"2023-08-25T04:19:43.663069+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:58:58.763723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":177,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898997+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:19:42.898997+0000","last_peered":"2023-08-25T04:19:42.898997+0000","last_clean":"2023-08-25T04:19:42.898997+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:19:42.898997+0000","last_undegraded":"2023-08-25T04:19:42.898997+0000","last_fullsized":"2023-08-25T04:19:42.898997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:22:41.607949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.662935+0000","last_change":"2023-08-25T04:19:41.892591+0000","last_active":"2023-08-25T04:19:43.662935+0000","last_peered":"2023-08-25T04:19:43.662935+0000","last_clean":"2023-08-25T04:19:43.662935+0000","last_became_active":"2023-08-25T04:19:41.892253+0000","last_became_peered":"2023-08-25T04:19:41.892253+0000","last_unstale":"2023-08-25T04:19:43.662935+0000","last_undegraded":"2023-08-25T04:19:43.662935+0000","last_fullsized":"2023-08-25T04:19:43.662935+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:04:00.127628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665546+0000","last_change":"2023-08-25T04:19:40.898534+0000","last_active":"2023-08-25T04:19:43.665546+0000","last_peered":"2023-08-25T04:19:43.665546+0000","last_clean":"2023-08-25T04:19:43.665546+0000","last_became_active":"2023-08-25T04:19:40.898239+0000","last_became_peered":"2023-08-25T04:19:40.898239+0000","last_unstale":"2023-08-25T04:19:43.665546+0000","last_undegraded":"2023-08-25T04:19:43.665546+0000","last_fullsized":"2023-08-25T04:19:43.665546+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:04:10.020209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.895889+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:19:42.895889+0000","last_peered":"2023-08-25T04:19:42.895889+0000","last_clean":"2023-08-25T04:19:42.895889+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:19:42.895889+0000","last_undegraded":"2023-08-25T04:19:42.895889+0000","last_fullsized":"2023-08-25T04:19:42.895889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:40:54.717094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663035+0000","last_change":"2023-08-25T04:19:41.897006+0000","last_active":"2023-08-25T04:19:43.663035+0000","last_peered":"2023-08-25T04:19:43.663035+0000","last_clean":"2023-08-25T04:19:43.663035+0000","last_became_active":"2023-08-25T04:19:41.896575+0000","last_became_peered":"2023-08-25T04:19:41.896575+0000","last_unstale":"2023-08-25T04:19:43.663035+0000","last_undegraded":"2023-08-25T04:19:43.663035+0000","last_fullsized":"2023-08-25T04:19:43.663035+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:49:20.325758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.662995+0000","last_change":"2023-08-25T04:19:40.898734+0000","last_active":"2023-08-25T04:19:43.662995+0000","last_peered":"2023-08-25T04:19:43.662995+0000","last_clean":"2023-08-25T04:19:43.662995+0000","last_became_active":"2023-08-25T04:19:40.898469+0000","last_became_peered":"2023-08-25T04:19:40.898469+0000","last_unstale":"2023-08-25T04:19:43.662995+0000","last_undegraded":"2023-08-25T04:19:43.662995+0000","last_fullsized":"2023-08-25T04:19:43.662995+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:14.479380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":176,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.898973+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:19:42.898973+0000","last_peered":"2023-08-25T04:19:42.898973+0000","last_clean":"2023-08-25T04:19:42.898973+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:19:42.898973+0000","last_undegraded":"2023-08-25T04:19:42.898973+0000","last_fullsized":"2023-08-25T04:19:42.898973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:37:30.611911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:42.894160+0000","last_change":"2023-08-25T04:19:41.905480+0000","last_active":"2023-08-25T04:19:42.894160+0000","last_peered":"2023-08-25T04:19:42.894160+0000","last_clean":"2023-08-25T04:19:42.894160+0000","last_became_active":"2023-08-25T04:19:41.905233+0000","last_became_peered":"2023-08-25T04:19:41.905233+0000","last_unstale":"2023-08-25T04:19:42.894160+0000","last_undegraded":"2023-08-25T04:19:42.894160+0000","last_fullsized":"2023-08-25T04:19:42.894160+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:40.868084+0000","last_clean_scrub_stamp":"2023-08-25T04:19:40.868084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:11:44.431231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.665040+0000","last_change":"2023-08-25T04:19:40.890287+0000","last_active":"2023-08-25T04:19:43.665040+0000","last_peered":"2023-08-25T04:19:43.665040+0000","last_clean":"2023-08-25T04:19:43.665040+0000","last_became_active":"2023-08-25T04:19:40.890025+0000","last_became_peered":"2023-08-25T04:19:40.890025+0000","last_unstale":"2023-08-25T04:19:43.665040+0000","last_undegraded":"2023-08-25T04:19:43.665040+0000","last_fullsized":"2023-08-25T04:19:43.665040+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":103,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:19:39.860177+0000","last_clean_scrub_stamp":"2023-08-25T04:19:39.860177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:45:28.004590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-08-25T04:19:43.663491+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:19:43.663491+0000","last_peered":"2023-08-25T04:19:43.663491+0000","last_clean":"2023-08-25T04:19:43.663491+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:19:43.663491+0000","last_undegraded":"2023-08-25T04:19:43.663491+0000","last_fullsized":"2023-08-25T04:19:43.663491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:30:49.149494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":750,"num_read_kb":1515,"num_write":285,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2822,"ondisk_log_size":2822,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509644,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55236,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316604,"statfs":{"total":96636764160,"available":96580202496,"internally_reserved":0,"allocated":1896448,"data_stored":1231149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.69199999999999995,"15min":0.70699999999999996},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.33700000000000002},"max":{"1min":0.85199999999999998,"5min":0.996,"15min":0.996},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70799999999999996,"15min":0.72299999999999998},"min":{"1min":0.51500000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.92400000000000004,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.30299999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.42699999999999999},"max":{"1min":0.92100000000000004,"5min":0.95699999999999996,"15min":1.034},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.71599999999999997,"15min":0.73599999999999999},"min":{"1min":0.45400000000000001,"5min":0.44700000000000001,"15min":0.374},"max":{"1min":0.995,"5min":0.995,"15min":1.036},"last":0.377}]},{"osd":2,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70399999999999996,"15min":0.71599999999999997},"min":{"1min":0.52400000000000002,"5min":0.42299999999999999,"15min":0.34899999999999998},"max":{"1min":0.84199999999999997,"5min":0.94499999999999995,"15min":1.018},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71799999999999997,"15min":0.747},"min":{"1min":0.46500000000000002,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.54200000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.54400000000000004,"5min":0.47799999999999998,"15min":0.41899999999999998},"max":{"1min":0.877,"5min":0.92900000000000005,"15min":0.98399999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.432},"max":{"1min":0.90900000000000003,"5min":1.04,"15min":1.04},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.58299999999999996,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.32400000000000001},"max":{"1min":0.81599999999999995,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.441,"5min":0.39600000000000002,"15min":0.374},"max":{"1min":0.84799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.47099999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.86099999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.40000000000000002},"max":{"1min":0.83599999999999997,"5min":1.032,"15min":1.0349999999999999},"last":0.52600000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.53000000000000003,"5min":0.46700000000000003,"15min":0.436},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.497},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66100000000000003,"15min":0.66200000000000003},"min":{"1min":0.46999999999999997,"5min":0.42699999999999999,"15min":0.42399999999999999},"max":{"1min":0.94399999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.437}]}]},{"osd":6,"up_from":15,"seq":64424509644,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36624,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335216,"statfs":{"total":96636764160,"available":96599261184,"internally_reserved":0,"allocated":1314816,"data_stored":642941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.66800000000000004,"15min":0.70399999999999996},"min":{"1min":0.34999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97099999999999997,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.497},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67700000000000005,"15min":0.69599999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.95999999999999996,"5min":0.96899999999999997,"15min":1.054},"last":0.46800000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.69899999999999995,"15min":0.72999999999999998},"min":{"1min":0.41599999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.93600000000000005,"5min":1.0269999999999999,"15min":1.0369999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.72799999999999998},"min":{"1min":0.50700000000000001,"5min":0.495,"15min":0.47199999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.70699999999999996,"15min":0.73599999999999999},"min":{"1min":0.48999999999999999,"5min":0.44,"15min":0.434},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.1020000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.76100000000000001,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0169999999999999,"5min":1.0569999999999999,"15min":1.117},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.745,"15min":0.747},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.46899999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.76000000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49199999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60799999999999998,"15min":0.59599999999999997},"min":{"1min":0.36499999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.443},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.61299999999999999,"15min":0.59499999999999997},"min":{"1min":0.40500000000000003,"5min":0.40400000000000003,"15min":0.39500000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.0820000000000001},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.66800000000000004,"15min":0.65200000000000002},"min":{"1min":0.39200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.1220000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.745,"15min":0.73399999999999999},"min":{"1min":0.55500000000000005,"5min":0.443,"15min":0.40000000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:19:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.67200000000000004,"15min":0.66200000000000003},"min":{"1min":0.441,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.1950000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73199999999999998,"15min":0.70299999999999996},"min":{"1min":0.50600000000000001,"5min":0.45200000000000001,"15min":0.41799999999999998},"max":{"1min":1.1359999999999999,"5min":1.373,"15min":1.373},"last":0.66800000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542347,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":640725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66900000000000004,"15min":0.70899999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.018},"last":0.495},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.68899999999999995,"15min":0.72199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81999999999999995,"5min":0.97999999999999998,"15min":1.0409999999999999},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.69899999999999995,"15min":0.72999999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.36499999999999999},"max":{"1min":0.78000000000000003,"5min":0.95299999999999996,"15min":0.99399999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.71499999999999997,"15min":0.73799999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90400000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.442}]},{"osd":2,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68000000000000005,"15min":0.72599999999999998},"min":{"1min":0.44800000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83999999999999997,"5min":0.92800000000000005,"15min":0.97499999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92600000000000005,"5min":0.98499999999999999,"15min":1.0449999999999999},"last":0.57599999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.70999999999999996,"15min":0.73099999999999998},"min":{"1min":0.52600000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.86499999999999999,"5min":0.93500000000000005,"15min":0.96999999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72499999999999998,"15min":0.76500000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.55200000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.40999999999999998,"5min":0.40100000000000002,"15min":0.35399999999999998},"max":{"1min":0.91000000000000003,"5min":0.92900000000000005,"15min":0.97099999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.39300000000000002},"max":{"1min":0.86499999999999999,"5min":1.018,"15min":1.018},"last":0.46100000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.63800000000000001,"15min":0.63400000000000001},"min":{"1min":0.47399999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.008},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.878,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.54000000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:19:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.622,"15min":0.62},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.89300000000000002,"5min":1.002,"15min":1.032},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68899999999999995,"15min":0.69799999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.96899999999999997,"15min":1.048},"last":0.52600000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542347,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36612,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335228,"statfs":{"total":96636764160,"available":96599273472,"internally_reserved":0,"allocated":1302528,"data_stored":640885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.67800000000000005,"15min":0.70099999999999996},"min":{"1min":0.39100000000000001,"5min":0.35499999999999998,"15min":0.32700000000000001},"max":{"1min":0.84299999999999997,"5min":0.97399999999999998,"15min":0.99299999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68600000000000005,"15min":0.70099999999999996},"min":{"1min":0.48599999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.96699999999999997},"last":0.52600000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.49399999999999999,"5min":0.45100000000000001,"15min":0.36199999999999999},"max":{"1min":0.85699999999999998,"5min":0.98399999999999999,"15min":1.0449999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70399999999999996,"15min":0.73499999999999999},"min":{"1min":0.44,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.872,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.47299999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39100000000000001},"max":{"1min":0.879,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72499999999999998,"15min":0.74199999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":0.91600000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.52900000000000003,"5min":0.51300000000000001,"15min":0.45100000000000001},"max":{"1min":0.90200000000000002,"5min":0.98299999999999998,"15min":1.048},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.72999999999999998,"15min":0.752},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.80700000000000005,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.40899999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.32200000000000001},"max":{"1min":0.76400000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.59099999999999997},"min":{"1min":0.42599999999999999,"5min":0.376,"15min":0.33200000000000002},"max":{"1min":0.91400000000000003,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.45400000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.745,"15min":0.73499999999999999},"min":{"1min":0.496,"5min":0.41499999999999998,"15min":0.40699999999999997},"max":{"1min":0.96299999999999997,"5min":1.093,"15min":1.093},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.65300000000000002,"15min":0.64000000000000001},"min":{"1min":0.48299999999999998,"5min":0.42299999999999999,"15min":0.40300000000000002},"max":{"1min":0.85999999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.50600000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:19:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.36699999999999999},"max":{"1min":0.84899999999999998,"5min":0.90100000000000002,"15min":0.94499999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69999999999999996,"15min":0.69699999999999995},"min":{"1min":0.60299999999999998,"5min":0.48099999999999998,"15min":0.39300000000000002},"max":{"1min":0.94299999999999995,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.49199999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542348,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36612,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335228,"statfs":{"total":96636764160,"available":96599273472,"internally_reserved":0,"allocated":1294336,"data_stored":640725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.439,"15min":0.45000000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27300000000000002},"max":{"1min":0.70199999999999996,"5min":0.93700000000000006,"15min":0.96899999999999997},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.51100000000000001,"15min":0.52200000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.66200000000000003,"5min":0.77100000000000002,"15min":0.91500000000000004},"last":0.30099999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.49199999999999999,"15min":0.5},"min":{"1min":0.34000000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.59699999999999998},"min":{"1min":0.42199999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.748,"5min":0.80300000000000005,"15min":0.92600000000000005},"last":0.62}]},{"osd":2,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55500000000000005,"15min":0.57199999999999995},"min":{"1min":0.38700000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":0.85499999999999998,"15min":1.01},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53000000000000003,"15min":0.54500000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.70799999999999996,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.434}]},{"osd":4,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.752,"15min":0.75600000000000001},"min":{"1min":0.56399999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0209999999999999,"5min":1.214,"15min":1.214},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.57899999999999996,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0760000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.67800000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.52900000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0349999999999999,"5min":1.254,"15min":1.254},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.78600000000000003},"min":{"1min":0.53700000000000003,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":0.99099999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.59999999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.59499999999999997,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":1.119,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77700000000000002,"15min":0.80100000000000005},"min":{"1min":0.56899999999999995,"5min":0.51600000000000001,"15min":0.50700000000000001},"max":{"1min":0.94699999999999995,"5min":1.0800000000000001,"15min":1.177},"last":0.55600000000000005}]},{"osd":7,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79100000000000004,"15min":0.82599999999999996},"min":{"1min":0.57199999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.96899999999999997,"5min":1.077,"15min":1.194},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.79400000000000004,"15min":0.79700000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0049999999999999,"5min":1.079,"15min":1.1160000000000001},"last":0.63800000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542349,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54652,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317188,"statfs":{"total":96636764160,"available":96580800512,"internally_reserved":0,"allocated":1294336,"data_stored":640725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.45300000000000001,"15min":0.46400000000000002},"min":{"1min":0.28799999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.59699999999999998,"5min":0.85599999999999998,"15min":0.92000000000000004},"last":0.37},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.47899999999999998,"15min":0.495},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.61899999999999999,"5min":0.81000000000000005,"15min":0.93100000000000005},"last":0.32700000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.47299999999999998,"15min":0.48299999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.61299999999999999,"5min":0.78800000000000003,"15min":0.85499999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.57199999999999995,"15min":0.59399999999999997},"min":{"1min":0.40999999999999998,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.56699999999999995,"5min":0.81699999999999995,"15min":0.89800000000000002},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.51800000000000002,"15min":0.53200000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":0.65700000000000003,"5min":0.82199999999999995,"15min":0.82299999999999995},"last":0.505},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.55100000000000005,"15min":0.56200000000000006},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59099999999999997,"5min":0.85399999999999998,"15min":0.89400000000000002},"last":0.42999999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.77600000000000002,"15min":0.79500000000000004},"min":{"1min":0.56999999999999995,"5min":0.502,"15min":0.502},"max":{"1min":0.82199999999999995,"5min":1.1990000000000001,"15min":1.2569999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.52000000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89400000000000002,"5min":1.151,"15min":1.5509999999999999},"last":0.63}]},{"osd":5,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.77900000000000003,"15min":0.79900000000000004},"min":{"1min":0.53000000000000003,"5min":0.52600000000000002,"15min":0.498},"max":{"1min":0.93700000000000006,"5min":1.1080000000000001,"15min":1.2789999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.77700000000000002,"15min":0.80400000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.48299999999999998},"max":{"1min":0.86799999999999999,"5min":1.2130000000000001,"15min":1.3089999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.78200000000000003,"15min":0.82099999999999995},"min":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.82799999999999996,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.81399999999999995,"15min":0.84999999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.90200000000000002,"5min":1.25,"15min":1.375},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Aug 25 04:19:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.77600000000000002,"15min":0.79800000000000004},"min":{"1min":0.54200000000000004,"5min":0.504,"15min":0.49199999999999999},"max":{"1min":0.878,"5min":1.0860000000000001,"15min":1.339},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.77900000000000003,"15min":0.80500000000000005},"min":{"1min":0.57099999999999995,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.80600000000000005,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.65400000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542349,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36608,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335232,"statfs":{"total":96636764160,"available":96599277568,"internally_reserved":0,"allocated":1298432,"data_stored":640795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.45300000000000001,"15min":0.46000000000000002},"min":{"1min":0.27400000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.96899999999999997},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.54400000000000004,"15min":0.52200000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67400000000000004,"5min":1.212,"15min":1.212},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.50600000000000001,"15min":0.5},"min":{"1min":0.30499999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79200000000000004,"5min":0.876,"15min":0.876},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.36299999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.83199999999999996,"5min":0.877,"15min":1.02},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.59899999999999998,"15min":0.61599999999999999},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.71699999999999997,"5min":0.93100000000000005,"15min":1.018},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.56899999999999995,"15min":0.57599999999999996},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74099999999999999,"5min":1.165,"15min":1.165},"last":0.32200000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.747,"15min":0.76900000000000002},"min":{"1min":0.48899999999999999,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":1.012,"5min":1.204,"15min":1.204},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78900000000000003,"15min":0.80400000000000005},"min":{"1min":0.53900000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.52900000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.753,"15min":0.78400000000000003},"min":{"1min":0.496,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96899999999999997,"5min":1.254,"15min":1.254},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.77900000000000003,"15min":0.80300000000000005},"min":{"1min":0.54700000000000004,"5min":0.51400000000000001,"15min":0.51000000000000001},"max":{"1min":0.97999999999999998,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.42399999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.54900000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.97599999999999998,"5min":1.623,"15min":1.623},"last":0.497},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.93700000000000006,"5min":1.288,"15min":1.288},"last":0.56899999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.77900000000000003,"15min":0.80700000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.99199999999999999,"5min":1.1240000000000001,"15min":1.2949999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.60899999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1,"5min":1.1140000000000001,"15min":1.3120000000000001},"last":0.55500000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542347,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28888,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342952,"statfs":{"total":96636764160,"available":96607182848,"internally_reserved":0,"allocated":1912832,"data_stored":1233411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.36099999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63,"5min":0.72499999999999998,"15min":0.79500000000000004},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.55200000000000005,"15min":0.56499999999999995},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72099999999999997,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.502,"15min":0.52000000000000002},"min":{"1min":0.32800000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.97499999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.77600000000000002,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.64700000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48699999999999999,"15min":0.499},"min":{"1min":0.30499999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.752,"5min":0.85099999999999998,"15min":1.2470000000000001},"last":0.504}]},{"osd":4,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79300000000000004,"15min":0.79500000000000004},"min":{"1min":0.55900000000000005,"5min":0.52600000000000002,"15min":0.503},"max":{"1min":0.95599999999999996,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.79200000000000004,"15min":0.80600000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.436},"max":{"1min":0.86799999999999999,"5min":1.169,"15min":1.234},"last":0.60699999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.52800000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.97799999999999998,"5min":3.528,"15min":3.528},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.79900000000000004,"15min":0.81000000000000005},"min":{"1min":0.56399999999999995,"5min":0.47199999999999998,"15min":0.45500000000000002},"max":{"1min":1.0680000000000001,"5min":1.121,"15min":1.2230000000000001},"last":0.625}]},{"osd":6,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.80100000000000005,"15min":0.80000000000000004},"min":{"1min":0.56699999999999995,"5min":0.54400000000000004,"15min":0.53700000000000003},"max":{"1min":0.89200000000000002,"5min":3.4870000000000001,"15min":3.4870000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.82099999999999995,"15min":0.82999999999999996},"min":{"1min":0.53200000000000003,"5min":0.52700000000000002,"15min":0.502},"max":{"1min":1.0349999999999999,"5min":1.1870000000000001,"15min":1.194},"last":0.67100000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.82499999999999996,"15min":0.84299999999999997},"min":{"1min":0.59699999999999998,"5min":0.56399999999999995,"15min":0.52900000000000003},"max":{"1min":1.101,"5min":1.151,"15min":1.2849999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.80100000000000005,"15min":0.80900000000000005},"min":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.96999999999999997,"5min":1.1220000000000001,"15min":1.1930000000000001},"last":0.54600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:19:51.009 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-25T04:19:51.010 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-25T04:19:51.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.192+0000 7f8d91d11640 1 Processor -- start 2023-08-25T04:19:51.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.192+0000 7f8d91d11640 1 -- start start 2023-08-25T04:19:51.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.192+0000 7f8d91d11640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8d8c06c790 0x7f8d8c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:51.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.192+0000 7f8d91d11640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8c0cab90 con 0x7f8d8c06e5a0 2023-08-25T04:19:51.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.192+0000 7f8d91d11640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8c06dbb0 con 0x7f8d8c06c3b0 2023-08-25T04:19:51.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.192+0000 7f8d91d11640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8c0cae50 con 0x7f8d8c06c790 2023-08-25T04:19:51.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.192+0000 7f8d83fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8d8c06e5a0 0x7f8d8c0ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50154/0 (socket says 172.21.15.55:50154) 2023-08-25T04:19:51.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.192+0000 7f8d83fff640 1 -- 172.21.15.55:0/468928518 learned_addr learned my addr 172.21.15.55:0/468928518 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:51.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.192+0000 7f8d8bfff640 1 --2- 172.21.15.55:0/468928518 >> v2:172.21.15.55:3300/0 conn(0x7f8d8c06c790 0x7f8d8c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:51.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.192+0000 7f8d8affd640 1 -- 172.21.15.55:0/468928518 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120038958 0 0) 0x7f8d8c0cab90 con 0x7f8d8c06e5a0 2023-08-25T04:19:51.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.192+0000 7f8d8affd640 1 -- 172.21.15.55:0/468928518 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d78003530 con 0x7f8d8c06e5a0 2023-08-25T04:19:51.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.192+0000 7f8d8affd640 1 -- 172.21.15.55:0/468928518 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701813026 0 0) 0x7f8d8c06dbb0 con 0x7f8d8c06c3b0 2023-08-25T04:19:51.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.192+0000 7f8d8affd640 1 -- 172.21.15.55:0/468928518 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d8c0cab90 con 0x7f8d8c06c3b0 2023-08-25T04:19:51.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.192+0000 7f8d8bfff640 1 -- 172.21.15.55:0/468928518 >> v1:172.21.15.110:6789/0 conn(0x7f8d8c06c3b0 legacy=0x7f8d8c06de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:51.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.192+0000 7f8d8bfff640 1 -- 172.21.15.55:0/468928518 >> v1:172.21.15.55:6789/0 conn(0x7f8d8c06e5a0 legacy=0x7f8d8c0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:51.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.192+0000 7f8d8bfff640 1 -- 172.21.15.55:0/468928518 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c0cb130 con 0x7f8d8c06c790 2023-08-25T04:19:51.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.196+0000 7f8d8bfff640 1 --2- 172.21.15.55:0/468928518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d8c06c790 0x7f8d8c0cd7d0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009d90 tx=0x7f8d8401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7120ea580b7081b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:51.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.196+0000 7f8d8affd640 1 -- 172.21.15.55:0/468928518 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d840a59c0 con 0x7f8d8c06c790 2023-08-25T04:19:51.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.196+0000 7f8d8affd640 1 -- 172.21.15.55:0/468928518 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d840a5b20 con 0x7f8d8c06c790 2023-08-25T04:19:51.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.196+0000 7f8d8affd640 1 -- 172.21.15.55:0/468928518 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d840ad440 con 0x7f8d8c06c790 2023-08-25T04:19:51.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.196+0000 7f8d91d11640 1 -- 172.21.15.55:0/468928518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d8c06c790 msgr2=0x7f8d8c0cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:51.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.196+0000 7f8d91d11640 1 --2- 172.21.15.55:0/468928518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d8c06c790 0x7f8d8c0cd7d0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009d90 tx=0x7f8d8401c920 comp rx=0 tx=0).stop 2023-08-25T04:19:51.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.196+0000 7f8d91d11640 1 -- 172.21.15.55:0/468928518 shutdown_connections 2023-08-25T04:19:51.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.196+0000 7f8d91d11640 1 --2- 172.21.15.55:0/468928518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d8c06c790 0x7f8d8c0cd7d0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:51.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.196+0000 7f8d91d11640 1 -- 172.21.15.55:0/468928518 >> 172.21.15.55:0/468928518 conn(0x7f8d8c0d0540 msgr2=0x7f8d8c0d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:51.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.196+0000 7f8d91d11640 1 -- 172.21.15.55:0/468928518 shutdown_connections 2023-08-25T04:19:51.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.196+0000 7f8d91d11640 1 -- 172.21.15.55:0/468928518 wait complete. 2023-08-25T04:19:51.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d91d11640 1 Processor -- start 2023-08-25T04:19:51.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d91d11640 1 -- start start 2023-08-25T04:19:51.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d91d11640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d8c06c3b0 0x7f8d8c14e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:51.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d91d11640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d8c06c790 0x7f8d8c1553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:51.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d91d11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d8c06e5a0 0x7f8d8c15acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:51.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d91d11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c154fa0 con 0x7f8d8c06e5a0 2023-08-25T04:19:51.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d91d11640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c159880 con 0x7f8d8c06c790 2023-08-25T04:19:51.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d91d11640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c155900 con 0x7f8d8c06c3b0 2023-08-25T04:19:51.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d8bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d8c06e5a0 0x7f8d8c15acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:51.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d8bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d8c06e5a0 0x7f8d8c15acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51810/0 (socket says 172.21.15.55:51810) 2023-08-25T04:19:51.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d8bfff640 1 -- 172.21.15.55:0/229695401 learned_addr learned my addr 172.21.15.55:0/229695401 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:51.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d83fff640 1 --2- 172.21.15.55:0/229695401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d8c06c790 0x7f8d8c1553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:51.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d8b7fe640 1 --2- 172.21.15.55:0/229695401 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d8c06c3b0 0x7f8d8c14e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:51.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d8bfff640 1 -- 172.21.15.55:0/229695401 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d8c06c3b0 msgr2=0x7f8d8c14e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:51.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d8bfff640 1 --2- 172.21.15.55:0/229695401 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d8c06c3b0 0x7f8d8c14e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:51.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d8bfff640 1 -- 172.21.15.55:0/229695401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d8c06c790 msgr2=0x7f8d8c1553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:51.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d8bfff640 1 --2- 172.21.15.55:0/229695401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d8c06c790 0x7f8d8c1553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:51.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d8bfff640 1 -- 172.21.15.55:0/229695401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d84009a70 con 0x7f8d8c06e5a0 2023-08-25T04:19:51.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d8bfff640 1 --2- 172.21.15.55:0/229695401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d8c06e5a0 0x7f8d8c15acc0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f8d8401a550 tx=0x7f8d840196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:51.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d88ff9640 1 -- 172.21.15.55:0/229695401 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d840adce0 con 0x7f8d8c06e5a0 2023-08-25T04:19:51.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d88ff9640 1 -- 172.21.15.55:0/229695401 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d840ade40 con 0x7f8d8c06e5a0 2023-08-25T04:19:51.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d88ff9640 1 -- 172.21.15.55:0/229695401 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d840b9670 con 0x7f8d8c06e5a0 2023-08-25T04:19:51.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d91d11640 1 -- 172.21.15.55:0/229695401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8c159300 con 0x7f8d8c06e5a0 2023-08-25T04:19:51.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.200+0000 7f8d91d11640 1 -- 172.21.15.55:0/229695401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8c154bc0 con 0x7f8d8c06e5a0 2023-08-25T04:19:51.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.204+0000 7f8d91d11640 1 -- 172.21.15.55:0/229695401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8c154a10 con 0x7f8d8c06e5a0 2023-08-25T04:19:51.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.204+0000 7f8d88ff9640 1 -- 172.21.15.55:0/229695401 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f8d840b97d0 con 0x7f8d8c06e5a0 2023-08-25T04:19:51.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.204+0000 7f8d88ff9640 1 --2- 172.21.15.55:0/229695401 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f8d6c065710 0x7f8d6c067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:51.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.204+0000 7f8d88ff9640 1 -- 172.21.15.55:0/229695401 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8d8411e400 con 0x7f8d8c06e5a0 2023-08-25T04:19:51.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.204+0000 7f8d8b7fe640 1 --2- 172.21.15.55:0/229695401 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f8d6c065710 0x7f8d6c067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:51.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.204+0000 7f8d8b7fe640 1 --2- 172.21.15.55:0/229695401 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f8d6c065710 0x7f8d6c067bd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c001240 tx=0x7f8d7c009040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:51.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.208+0000 7f8d88ff9640 1 -- 172.21.15.55:0/229695401 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8d840ec030 con 0x7f8d8c06e5a0 2023-08-25T04:19:51.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.416+0000 7f8d91d11640 1 -- 172.21.15.55:0/229695401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f8d8c073ec0 con 0x7f8d8c06e5a0 2023-08-25T04:19:51.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.420+0000 7f8d88ff9640 1 -- 172.21.15.55:0/229695401 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7f8d84009450 con 0x7f8d8c06e5a0 2023-08-25T04:19:51.423 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2023-08-25T04:19:51.423 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g== 2023-08-25T04:19:51.423 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2023-08-25T04:19:51.423 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2023-08-25T04:19:51.423 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-25T04:19:51.424 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-08-25T04:19:51.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.424+0000 7f8d91d11640 1 -- 172.21.15.55:0/229695401 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f8d6c065710 msgr2=0x7f8d6c067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:51.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.424+0000 7f8d91d11640 1 --2- 172.21.15.55:0/229695401 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f8d6c065710 0x7f8d6c067bd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c001240 tx=0x7f8d7c009040 comp rx=0 tx=0).stop 2023-08-25T04:19:51.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.424+0000 7f8d91d11640 1 -- 172.21.15.55:0/229695401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d8c06e5a0 msgr2=0x7f8d8c15acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:51.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.424+0000 7f8d91d11640 1 --2- 172.21.15.55:0/229695401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d8c06e5a0 0x7f8d8c15acc0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f8d8401a550 tx=0x7f8d840196c0 comp rx=0 tx=0).stop 2023-08-25T04:19:51.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.424+0000 7f8d91d11640 1 -- 172.21.15.55:0/229695401 shutdown_connections 2023-08-25T04:19:51.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.424+0000 7f8d91d11640 1 --2- 172.21.15.55:0/229695401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d8c06e5a0 0x7f8d8c15acc0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:51.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.424+0000 7f8d91d11640 1 --2- 172.21.15.55:0/229695401 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d8c06c790 0x7f8d8c1553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:51.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.424+0000 7f8d91d11640 1 --2- 172.21.15.55:0/229695401 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f8d6c065710 0x7f8d6c067bd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:51.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.424+0000 7f8d91d11640 1 --2- 172.21.15.55:0/229695401 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d8c06c3b0 0x7f8d8c14e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:51.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.424+0000 7f8d91d11640 1 -- 172.21.15.55:0/229695401 >> 172.21.15.55:0/229695401 conn(0x7f8d8c0d0540 msgr2=0x7f8d8c0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:51.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.424+0000 7f8d91d11640 1 -- 172.21.15.55:0/229695401 shutdown_connections 2023-08-25T04:19:51.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.424+0000 7f8d91d11640 1 -- 172.21.15.55:0/229695401 wait complete. 2023-08-25T04:19:51.444 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:19:51.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.584+0000 7fce9fcbd640 1 Processor -- start 2023-08-25T04:19:51.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.584+0000 7fce9fcbd640 1 -- start start 2023-08-25T04:19:51.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.588+0000 7fce9fcbd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fce980ad950 0x7fce980cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:51.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.588+0000 7fce9fcbd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce980ceeb0 0x7fce980b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:51.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.588+0000 7fce9fcbd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce980cc880 con 0x7fce980c89f0 2023-08-25T04:19:51.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.588+0000 7fce9fcbd640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce980b11f0 con 0x7fce980ad950 2023-08-25T04:19:51.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.588+0000 7fce9fcbd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce98159d50 con 0x7fce980ceeb0 2023-08-25T04:19:51.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.588+0000 7fce9d258640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fce980c89f0 0x7fce980ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50166/0 (socket says 172.21.15.55:50166) 2023-08-25T04:19:51.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.588+0000 7fce9d258640 1 -- 172.21.15.55:0/1092994508 learned_addr learned my addr 172.21.15.55:0/1092994508 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:51.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.588+0000 7fce9e25a640 1 --2- 172.21.15.55:0/1092994508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce980ceeb0 0x7fce980b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:51.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.588+0000 7fce9da59640 1 --2- 172.21.15.55:0/1092994508 >> v2:172.21.15.110:3300/0 conn(0x7fce980ad950 0x7fce980cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:51.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.588+0000 7fce9ca57640 1 -- 172.21.15.55:0/1092994508 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250693143 0 0) 0x7fce980cc880 con 0x7fce980c89f0 2023-08-25T04:19:51.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.588+0000 7fce9ca57640 1 -- 172.21.15.55:0/1092994508 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce84003530 con 0x7fce980c89f0 2023-08-25T04:19:51.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.588+0000 7fce9e25a640 1 -- 172.21.15.55:0/1092994508 >> v2:172.21.15.110:3300/0 conn(0x7fce980ad950 msgr2=0x7fce980cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:51.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.588+0000 7fce9e25a640 1 --2- 172.21.15.55:0/1092994508 >> v2:172.21.15.110:3300/0 conn(0x7fce980ad950 0x7fce980cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:51.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.588+0000 7fce9e25a640 1 -- 172.21.15.55:0/1092994508 >> v1:172.21.15.55:6789/0 conn(0x7fce980c89f0 legacy=0x7fce980ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:51.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.588+0000 7fce9e25a640 1 -- 172.21.15.55:0/1092994508 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce980ccb60 con 0x7fce980ceeb0 2023-08-25T04:19:51.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.588+0000 7fce9da59640 1 --2- 172.21.15.55:0/1092994508 >> v2:172.21.15.110:3300/0 conn(0x7fce980ad950 0x7fce980cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:51.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.592+0000 7fce9e25a640 1 --2- 172.21.15.55:0/1092994508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce980ceeb0 0x7fce980b1640 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fce90009d90 tx=0x7fce9001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20b9c5dd05f3edc0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:51.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.592+0000 7fce9ca57640 1 -- 172.21.15.55:0/1092994508 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce900a5860 con 0x7fce980ceeb0 2023-08-25T04:19:51.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.592+0000 7fce9ca57640 1 -- 172.21.15.55:0/1092994508 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce900a59c0 con 0x7fce980ceeb0 2023-08-25T04:19:51.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.592+0000 7fce9ca57640 1 -- 172.21.15.55:0/1092994508 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce900a5d50 con 0x7fce980ceeb0 2023-08-25T04:19:51.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.592+0000 7fce9fcbd640 1 -- 172.21.15.55:0/1092994508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce980ceeb0 msgr2=0x7fce980b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:51.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.592+0000 7fce9fcbd640 1 --2- 172.21.15.55:0/1092994508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce980ceeb0 0x7fce980b1640 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fce90009d90 tx=0x7fce9001c890 comp rx=0 tx=0).stop 2023-08-25T04:19:51.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.592+0000 7fce9fcbd640 1 -- 172.21.15.55:0/1092994508 shutdown_connections 2023-08-25T04:19:51.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.592+0000 7fce9fcbd640 1 --2- 172.21.15.55:0/1092994508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce980ceeb0 0x7fce980b1640 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:51.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.592+0000 7fce9fcbd640 1 --2- 172.21.15.55:0/1092994508 >> v2:172.21.15.110:3300/0 conn(0x7fce980ad950 0x7fce980cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:51.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.592+0000 7fce9fcbd640 1 -- 172.21.15.55:0/1092994508 >> 172.21.15.55:0/1092994508 conn(0x7fce98069d00 msgr2=0x7fce9806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:51.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.592+0000 7fce9fcbd640 1 -- 172.21.15.55:0/1092994508 shutdown_connections 2023-08-25T04:19:51.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.592+0000 7fce9fcbd640 1 -- 172.21.15.55:0/1092994508 wait complete. 2023-08-25T04:19:51.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.592+0000 7fce9fcbd640 1 Processor -- start 2023-08-25T04:19:51.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.592+0000 7fce9fcbd640 1 -- start start 2023-08-25T04:19:51.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9fcbd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce980ad950 0x7fce98097110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:51.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9fcbd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce980c89f0 0x7fce98161cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:51.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9fcbd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce980ceeb0 0x7fce981578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:51.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9fcbd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce98097650 con 0x7fce980ceeb0 2023-08-25T04:19:51.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9fcbd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce98155110 con 0x7fce980c89f0 2023-08-25T04:19:51.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9fcbd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce98163130 con 0x7fce980ad950 2023-08-25T04:19:51.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9e25a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce980ceeb0 0x7fce981578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:51.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9e25a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce980ceeb0 0x7fce981578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51816/0 (socket says 172.21.15.55:51816) 2023-08-25T04:19:51.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9e25a640 1 -- 172.21.15.55:0/2331103308 learned_addr learned my addr 172.21.15.55:0/2331103308 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:51.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9d258640 1 --2- 172.21.15.55:0/2331103308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce980c89f0 0x7fce98161cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:51.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9da59640 1 --2- 172.21.15.55:0/2331103308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce980ad950 0x7fce98097110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:51.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9e25a640 1 -- 172.21.15.55:0/2331103308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce980ad950 msgr2=0x7fce98097110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:51.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9e25a640 1 --2- 172.21.15.55:0/2331103308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce980ad950 0x7fce98097110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:51.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9e25a640 1 -- 172.21.15.55:0/2331103308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce980c89f0 msgr2=0x7fce98161cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:51.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9e25a640 1 --2- 172.21.15.55:0/2331103308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce980c89f0 0x7fce98161cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:51.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9e25a640 1 -- 172.21.15.55:0/2331103308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce94009420 con 0x7fce980ceeb0 2023-08-25T04:19:51.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9e25a640 1 --2- 172.21.15.55:0/2331103308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce980ceeb0 0x7fce981578f0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fce9001af40 tx=0x7fce90019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:51.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce8e7fc640 1 -- 172.21.15.55:0/2331103308 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce900b9650 con 0x7fce980ceeb0 2023-08-25T04:19:51.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce8e7fc640 1 -- 172.21.15.55:0/2331103308 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce900b97b0 con 0x7fce980ceeb0 2023-08-25T04:19:51.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce8e7fc640 1 -- 172.21.15.55:0/2331103308 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce900b9b20 con 0x7fce980ceeb0 2023-08-25T04:19:51.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9fcbd640 1 -- 172.21.15.55:0/2331103308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce90009a70 con 0x7fce980ceeb0 2023-08-25T04:19:51.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9fcbd640 1 -- 172.21.15.55:0/2331103308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce981636f0 con 0x7fce980ceeb0 2023-08-25T04:19:51.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.596+0000 7fce9fcbd640 1 -- 172.21.15.55:0/2331103308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce981638e0 con 0x7fce980ceeb0 2023-08-25T04:19:51.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.600+0000 7fce8e7fc640 1 -- 172.21.15.55:0/2331103308 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fce900b9c80 con 0x7fce980ceeb0 2023-08-25T04:19:51.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.600+0000 7fce8e7fc640 1 --2- 172.21.15.55:0/2331103308 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fce7c065710 0x7fce7c067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:51.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.600+0000 7fce8e7fc640 1 -- 172.21.15.55:0/2331103308 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fce9011dff0 con 0x7fce980ceeb0 2023-08-25T04:19:51.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.600+0000 7fce9da59640 1 --2- 172.21.15.55:0/2331103308 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fce7c065710 0x7fce7c067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:51.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.600+0000 7fce9da59640 1 --2- 172.21.15.55:0/2331103308 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fce7c065710 0x7fce7c067bd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fce98157370 tx=0x7fce94009190 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:51.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.604+0000 7fce8e7fc640 1 -- 172.21.15.55:0/2331103308 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fce900ebaf0 con 0x7fce980ceeb0 2023-08-25T04:19:51.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.796+0000 7fce9fcbd640 1 -- 172.21.15.55:0/2331103308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce9804dbe0 con 0x7fce980ceeb0 2023-08-25T04:19:51.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.796+0000 7fce8e7fc640 1 -- 172.21.15.55:0/2331103308 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4883 (secure 0 0 0) 0x7fce900ef110 con 0x7fce980ceeb0 2023-08-25T04:19:51.799 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:51.799 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3111804785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3111804785},{"type":"v1","addr":"172.21.15.110:6836","nonce":3111804785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3444442085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3444442085},{"type":"v1","addr":"172.21.15.110:6837","nonce":3444442085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":7857,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2022633620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2022633620},{"type":"v1","addr":"172.21.15.55:6834","nonce":2022633620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:19:41.282901+0000","modified":"2023-08-25T04:19:44.912410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1173226599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1173226599},{"type":"v1","addr":"172.21.15.55:6835","nonce":1173226599}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-25T04:19:51.800 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 49 2023-08-25T04:19:51.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.800+0000 7fce9fcbd640 1 -- 172.21.15.55:0/2331103308 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fce7c065710 msgr2=0x7fce7c067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:51.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.800+0000 7fce9fcbd640 1 --2- 172.21.15.55:0/2331103308 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fce7c065710 0x7fce7c067bd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fce98157370 tx=0x7fce94009190 comp rx=0 tx=0).stop 2023-08-25T04:19:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.800+0000 7fce9fcbd640 1 -- 172.21.15.55:0/2331103308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce980ceeb0 msgr2=0x7fce981578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.800+0000 7fce9fcbd640 1 --2- 172.21.15.55:0/2331103308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce980ceeb0 0x7fce981578f0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fce9001af40 tx=0x7fce90019630 comp rx=0 tx=0).stop 2023-08-25T04:19:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.800+0000 7fce9fcbd640 1 -- 172.21.15.55:0/2331103308 shutdown_connections 2023-08-25T04:19:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.800+0000 7fce9fcbd640 1 --2- 172.21.15.55:0/2331103308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce980ceeb0 0x7fce981578f0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.800+0000 7fce9fcbd640 1 --2- 172.21.15.55:0/2331103308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce980c89f0 0x7fce98161cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.800+0000 7fce9fcbd640 1 --2- 172.21.15.55:0/2331103308 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fce7c065710 0x7fce7c067bd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:51.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.800+0000 7fce9fcbd640 1 --2- 172.21.15.55:0/2331103308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce980ad950 0x7fce98097110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:51.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.800+0000 7fce9fcbd640 1 -- 172.21.15.55:0/2331103308 >> 172.21.15.55:0/2331103308 conn(0x7fce98069d00 msgr2=0x7fce98070560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:51.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.800+0000 7fce9fcbd640 1 -- 172.21.15.55:0/2331103308 shutdown_connections 2023-08-25T04:19:51.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:51.800+0000 7fce9fcbd640 1 -- 172.21.15.55:0/2331103308 wait complete. 2023-08-25T04:19:52.222 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-25T04:19:41.282901+0000', 'modified': '2023-08-25T04:19:44.912410+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7860}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7860': {'gid': 7860, 'name': 'c', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6835/1173226599', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6833', 'nonce': 1173226599}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 1173226599}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-25T04:19:52.223 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-25T04:19:52.223 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-25T04:19:52.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.368+0000 7f8ecade9640 1 Processor -- start 2023-08-25T04:19:52.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.368+0000 7f8ecade9640 1 -- start start 2023-08-25T04:19:52.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.372+0000 7f8ecade9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ec40ad950 0x7f8ec40cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.372+0000 7f8ecade9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8ec40ceeb0 0x7f8ec40b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.372+0000 7f8ecade9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec40cc880 con 0x7f8ec40c89f0 2023-08-25T04:19:52.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.372+0000 7f8ecade9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec40b11f0 con 0x7f8ec40ceeb0 2023-08-25T04:19:52.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.372+0000 7f8ecade9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4159d50 con 0x7f8ec40ad950 2023-08-25T04:19:52.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.372+0000 7f8ec8b85640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ec40ad950 0x7f8ec40cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.372+0000 7f8ec8b85640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ec40ad950 0x7f8ec40cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:38088/0 (socket says 172.21.15.55:38088) 2023-08-25T04:19:52.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.372+0000 7f8ec8b85640 1 -- 172.21.15.55:0/3772025965 learned_addr learned my addr 172.21.15.55:0/3772025965 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:52.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.372+0000 7f8ec9386640 1 --2- 172.21.15.55:0/3772025965 >> v2:172.21.15.110:3300/0 conn(0x7f8ec40ceeb0 0x7f8ec40b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.372+0000 7f8ec8b85640 1 -- 172.21.15.55:0/3772025965 >> v2:172.21.15.110:3300/0 conn(0x7f8ec40ceeb0 msgr2=0x7f8ec40b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:52.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.372+0000 7f8ec8b85640 1 --2- 172.21.15.55:0/3772025965 >> v2:172.21.15.110:3300/0 conn(0x7f8ec40ceeb0 0x7f8ec40b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.372+0000 7f8ec8b85640 1 -- 172.21.15.55:0/3772025965 >> v1:172.21.15.110:6789/0 conn(0x7f8ec40c89f0 legacy=0x7f8ec40ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:52.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.372+0000 7f8ec8b85640 1 -- 172.21.15.55:0/3772025965 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec40ccb60 con 0x7f8ec40ad950 2023-08-25T04:19:52.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.372+0000 7f8ec9386640 1 --2- 172.21.15.55:0/3772025965 >> v2:172.21.15.110:3300/0 conn(0x7f8ec40ceeb0 0x7f8ec40b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:52.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.376+0000 7f8ec8b85640 1 --2- 172.21.15.55:0/3772025965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ec40ad950 0x7f8ec40cc2a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800bb10 tx=0x7f8eb801eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a62a97e0540a3e62 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:52.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.376+0000 7f8ec37fe640 1 -- 172.21.15.55:0/3772025965 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80a7b30 con 0x7f8ec40ad950 2023-08-25T04:19:52.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.376+0000 7f8ec37fe640 1 -- 172.21.15.55:0/3772025965 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb80a7c90 con 0x7f8ec40ad950 2023-08-25T04:19:52.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.376+0000 7f8ec37fe640 1 -- 172.21.15.55:0/3772025965 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80af440 con 0x7f8ec40ad950 2023-08-25T04:19:52.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.376+0000 7f8ecade9640 1 -- 172.21.15.55:0/3772025965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ec40ad950 msgr2=0x7f8ec40cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:52.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.376+0000 7f8ecade9640 1 --2- 172.21.15.55:0/3772025965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ec40ad950 0x7f8ec40cc2a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800bb10 tx=0x7f8eb801eb50 comp rx=0 tx=0).stop 2023-08-25T04:19:52.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.376+0000 7f8ecade9640 1 -- 172.21.15.55:0/3772025965 shutdown_connections 2023-08-25T04:19:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.376+0000 7f8ecade9640 1 --2- 172.21.15.55:0/3772025965 >> v2:172.21.15.110:3300/0 conn(0x7f8ec40ceeb0 0x7f8ec40b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.376+0000 7f8ecade9640 1 --2- 172.21.15.55:0/3772025965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ec40ad950 0x7f8ec40cc2a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.376+0000 7f8ecade9640 1 -- 172.21.15.55:0/3772025965 >> 172.21.15.55:0/3772025965 conn(0x7f8ec4069d00 msgr2=0x7f8ec406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.376+0000 7f8ecade9640 1 -- 172.21.15.55:0/3772025965 shutdown_connections 2023-08-25T04:19:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.376+0000 7f8ecade9640 1 -- 172.21.15.55:0/3772025965 wait complete. 2023-08-25T04:19:52.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.376+0000 7f8ecade9640 1 Processor -- start 2023-08-25T04:19:52.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.376+0000 7f8ecade9640 1 -- start start 2023-08-25T04:19:52.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ecade9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ec40ad950 0x7f8ec4096c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ecade9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ec40c89f0 0x7f8ec40ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ecade9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ec40ceeb0 0x7f8ec4153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ecade9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4097190 con 0x7f8ec40c89f0 2023-08-25T04:19:52.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ecade9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec40abef0 con 0x7f8ec40ad950 2023-08-25T04:19:52.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ecade9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4097bb0 con 0x7f8ec40ceeb0 2023-08-25T04:19:52.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ec3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ec40c89f0 0x7f8ec40ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ec3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ec40c89f0 0x7f8ec40ac380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51832/0 (socket says 172.21.15.55:51832) 2023-08-25T04:19:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ec3fff640 1 -- 172.21.15.55:0/2623623717 learned_addr learned my addr 172.21.15.55:0/2623623717 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ec8b85640 1 --2- 172.21.15.55:0/2623623717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ec40ad950 0x7f8ec4096c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ec9386640 1 --2- 172.21.15.55:0/2623623717 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ec40ceeb0 0x7f8ec4153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ec3fff640 1 -- 172.21.15.55:0/2623623717 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ec40ceeb0 msgr2=0x7f8ec4153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ec3fff640 1 --2- 172.21.15.55:0/2623623717 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ec40ceeb0 0x7f8ec4153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ec3fff640 1 -- 172.21.15.55:0/2623623717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ec40ad950 msgr2=0x7f8ec4096c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ec3fff640 1 --2- 172.21.15.55:0/2623623717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ec40ad950 0x7f8ec4096c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ec3fff640 1 -- 172.21.15.55:0/2623623717 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ebc009a70 con 0x7f8ec40c89f0 2023-08-25T04:19:52.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ec9386640 1 --2- 172.21.15.55:0/2623623717 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ec40ceeb0 0x7f8ec4153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:52.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ec3fff640 1 --2- 172.21.15.55:0/2623623717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ec40c89f0 0x7f8ec40ac380 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000c4d0 tx=0x7f8eb000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:52.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ec17fa640 1 -- 172.21.15.55:0/2623623717 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb00052d0 con 0x7f8ec40c89f0 2023-08-25T04:19:52.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ec17fa640 1 -- 172.21.15.55:0/2623623717 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb0005430 con 0x7f8ec40c89f0 2023-08-25T04:19:52.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ec17fa640 1 -- 172.21.15.55:0/2623623717 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0012830 con 0x7f8ec40c89f0 2023-08-25T04:19:52.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ecade9640 1 -- 172.21.15.55:0/2623623717 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb800b770 con 0x7f8ec40c89f0 2023-08-25T04:19:52.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.380+0000 7f8ecade9640 1 -- 172.21.15.55:0/2623623717 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec40abb80 con 0x7f8ec40c89f0 2023-08-25T04:19:52.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ec17fa640 1 -- 172.21.15.55:0/2623623717 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f8eb0012990 con 0x7f8ec40c89f0 2023-08-25T04:19:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ec17fa640 1 --2- 172.21.15.55:0/2623623717 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f8ea8065710 0x7f8ea8067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ece158000 1 Processor -- start 2023-08-25T04:19:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ec17fa640 1 -- 172.21.15.55:0/2623623717 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f8eb0082920 con 0x7f8ec40c89f0 2023-08-25T04:19:52.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ece158000 1 -- start start 2023-08-25T04:19:52.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ec8b85640 1 --2- 172.21.15.55:0/2623623717 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f8ea8065710 0x7f8ea8067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ec8b85640 1 --2- 172.21.15.55:0/2623623717 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f8ea8065710 0x7f8ea8067bd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80b1000 tx=0x7f8eb8008040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:52.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ece158000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511f6020 0x55c0511f6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ece158000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6940 0x55c0511ac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ece158000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511ac5b0 0x55c0511ac990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ece158000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c051002440 con 0x55c0511ac5b0 2023-08-25T04:19:52.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ece158000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c050fff970 con 0x55c0511f6940 2023-08-25T04:19:52.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ece158000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c050ffb260 con 0x55c0511f6020 2023-08-25T04:19:52.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ec9386640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511ac5b0 0x55c0511ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ec8b85640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511f6020 0x55c0511f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ec9386640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511ac5b0 0x55c0511ac990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51838/0 (socket says 172.21.15.55:51838) 2023-08-25T04:19:52.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ec9386640 1 -- 172.21.15.55:0/3127290966 learned_addr learned my addr 172.21.15.55:0/3127290966 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:52.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ec3fff640 1 --2- 172.21.15.55:0/3127290966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6940 0x55c0511ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ec9386640 1 -- 172.21.15.55:0/3127290966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511f6020 msgr2=0x55c0511f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:52.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ec9386640 1 --2- 172.21.15.55:0/3127290966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511f6020 0x55c0511f6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ec9386640 1 -- 172.21.15.55:0/3127290966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6940 msgr2=0x55c0511ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:52.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ec9386640 1 --2- 172.21.15.55:0/3127290966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6940 0x55c0511ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.384+0000 7f8ec9386640 1 -- 172.21.15.55:0/3127290966 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c051093ec0 con 0x55c0511ac5b0 2023-08-25T04:19:52.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ec9386640 1 --2- 172.21.15.55:0/3127290966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511ac5b0 0x55c0511ac990 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc007650 tx=0x7f8ebc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8e82d47a26a70 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:52.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8eae7fc640 1 -- 172.21.15.55:0/3127290966 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc00e050 con 0x55c0511ac5b0 2023-08-25T04:19:52.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8eae7fc640 1 -- 172.21.15.55:0/3127290966 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc00f040 con 0x55c0511ac5b0 2023-08-25T04:19:52.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8eae7fc640 1 -- 172.21.15.55:0/3127290966 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc010b30 con 0x55c0511ac5b0 2023-08-25T04:19:52.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ece158000 1 -- 172.21.15.55:0/3127290966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511ac5b0 msgr2=0x55c0511ac990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:52.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ece158000 1 --2- 172.21.15.55:0/3127290966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511ac5b0 0x55c0511ac990 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc007650 tx=0x7f8ebc009750 comp rx=0 tx=0).stop 2023-08-25T04:19:52.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ece158000 1 -- 172.21.15.55:0/3127290966 shutdown_connections 2023-08-25T04:19:52.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ece158000 1 --2- 172.21.15.55:0/3127290966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511ac5b0 0x55c0511ac990 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ece158000 1 --2- 172.21.15.55:0/3127290966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6940 0x55c0511ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ece158000 1 --2- 172.21.15.55:0/3127290966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511f6020 0x55c0511f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ece158000 1 -- 172.21.15.55:0/3127290966 >> 172.21.15.55:0/3127290966 conn(0x55c0511a8560 msgr2=0x55c0511aa950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:52.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ece158000 1 -- 172.21.15.55:0/3127290966 shutdown_connections 2023-08-25T04:19:52.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ece158000 1 -- 172.21.15.55:0/3127290966 wait complete. 2023-08-25T04:19:52.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ece158000 1 -- start start 2023-08-25T04:19:52.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ece158000 1 Processor -- start 2023-08-25T04:19:52.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ece158000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511ac5b0 0x55c0511fd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ece158000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511f6020 0x55c0511fd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ece158000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6940 0x55c0511e3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ece158000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c050fb5f60 con 0x55c0511ac5b0 2023-08-25T04:19:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ece158000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c050fb5c00 con 0x55c0511f6940 2023-08-25T04:19:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ece158000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c050cb6940 con 0x55c0511f6020 2023-08-25T04:19:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ece158000 10 client.0 _ll_register_callbacks cb 0x55c051197900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:19:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ec8b85640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511ac5b0 0x55c0511fd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ec8b85640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511ac5b0 0x55c0511fd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51848/0 (socket says 172.21.15.55:51848) 2023-08-25T04:19:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ec8b85640 1 -- 172.21.15.55:0/4069015160 learned_addr learned my addr 172.21.15.55:0/4069015160 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ec9386640 1 --2- 172.21.15.55:0/4069015160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6940 0x55c0511e3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ec3fff640 1 --2- 172.21.15.55:0/4069015160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511f6020 0x55c0511fd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ec8b85640 1 -- 172.21.15.55:0/4069015160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511f6020 msgr2=0x55c0511fd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.388+0000 7f8ec8b85640 1 --2- 172.21.15.55:0/4069015160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511f6020 0x55c0511fd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ec8b85640 1 -- 172.21.15.55:0/4069015160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6940 msgr2=0x55c0511e3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:52.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ec8b85640 1 --2- 172.21.15.55:0/4069015160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6940 0x55c0511e3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ec8b85640 1 -- 172.21.15.55:0/4069015160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ebc007330 con 0x55c0511ac5b0 2023-08-25T04:19:52.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ec3fff640 1 --2- 172.21.15.55:0/4069015160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511f6020 0x55c0511fd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:19:52.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ec9386640 1 --2- 172.21.15.55:0/4069015160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6940 0x55c0511e3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:52.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ec8b85640 1 --2- 172.21.15.55:0/4069015160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511ac5b0 0x55c0511fd380 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8025160 tx=0x7f8eb80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987d1c9719cdf09b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:52.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ea37fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T04:19:52.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ea37fe640 1 -- 172.21.15.55:0/4069015160 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80c1040 con 0x55c0511ac5b0 2023-08-25T04:19:52.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ea37fe640 1 -- 172.21.15.55:0/4069015160 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f8eb80afc40 con 0x55c0511ac5b0 2023-08-25T04:19:52.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 1 -- 172.21.15.55:0/4069015160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c050f929d0 con 0x55c0511ac5b0 2023-08-25T04:19:52.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ea37fe640 1 -- 172.21.15.55:0/4069015160 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8eb80afe00 con 0x55c0511ac5b0 2023-08-25T04:19:52.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 10 client.8034 fetch_fsmap learned FSMap version 49 2023-08-25T04:19:52.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 1 -- 172.21.15.55:0/4069015160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55c050cf5890 con 0x55c0511ac5b0 2023-08-25T04:19:52.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ea37fe640 1 -- 172.21.15.55:0/4069015160 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c050f929d0 con 0x55c0511ac5b0 2023-08-25T04:19:52.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ea37fe640 1 -- 172.21.15.55:0/4069015160 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 49) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8eb80c5420 con 0x55c0511ac5b0 2023-08-25T04:19:52.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 10 client.8034 fetch_fsmap finished waiting for FSMap version 49 2023-08-25T04:19:52.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 10 client.8034 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T04:19:52.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 20 client.8034 populate_metadata read hostname 'smithi055' 2023-08-25T04:19:52.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 1 --2- 172.21.15.55:0/4069015160 >> [v2:172.21.15.55:6833/1173226599,v1:172.21.15.55:6835/1173226599] conn(0x55c0511e4b40 0x55c0511e4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 4 client.8034 mds_command: new command op to 7860 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-25T04:19:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 1 -- 172.21.15.55:0/4069015160 --> [v2:172.21.15.55:6833/1173226599,v1:172.21.15.55:6835/1173226599] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c050fb27a0 con 0x55c0511e4b40 2023-08-25T04:19:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ec3fff640 1 --2- 172.21.15.55:0/4069015160 >> [v2:172.21.15.55:6833/1173226599,v1:172.21.15.55:6835/1173226599] conn(0x55c0511e4b40 0x55c0511e4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ea37fe640 10 client.8034 ms_handle_connect on v2:172.21.15.55:6833/1173226599 2023-08-25T04:19:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ec3fff640 1 --2- 172.21.15.55:0/4069015160 >> [v2:172.21.15.55:6833/1173226599,v1:172.21.15.55:6835/1173226599] conn(0x55c0511e4b40 0x55c0511e4f20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92a8f513da4275c3 server_cookie=1e0691760a561035 in_seq=0 out_seq=0 2023-08-25T04:19:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ea37fe640 1 -- 172.21.15.55:0/4069015160 <== mds.0 v2:172.21.15.55:6833/1173226599 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c050fb27a0 con 0x55c0511e4b40 2023-08-25T04:19:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ea37fe640 10 client.8034 handle_command_reply: tid=0 2023-08-25T04:19:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 1 client.8034 shutdown 2023-08-25T04:19:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 1 -- 172.21.15.55:0/4069015160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511ac5b0 msgr2=0x55c0511fd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 1 --2- 172.21.15.55:0/4069015160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511ac5b0 0x55c0511fd380 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8025160 tx=0x7f8eb80046d0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 1 -- 172.21.15.55:0/4069015160 shutdown_connections 2023-08-25T04:19:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 1 --2- 172.21.15.55:0/4069015160 >> [v2:172.21.15.55:6833/1173226599,v1:172.21.15.55:6835/1173226599] conn(0x55c0511e4b40 0x55c0511e4f20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 1 --2- 172.21.15.55:0/4069015160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6940 0x55c0511e3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 1 --2- 172.21.15.55:0/4069015160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511f6020 0x55c0511fd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 1 --2- 172.21.15.55:0/4069015160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511ac5b0 0x55c0511fd380 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ea37fe640 0 client.8034 ms_handle_reset on v2:172.21.15.55:6833/1173226599 2023-08-25T04:19:52.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 1 -- 172.21.15.55:0/4069015160 >> 172.21.15.55:0/4069015160 conn(0x55c0511a8560 msgr2=0x55c0511ab1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:52.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 1 -- 172.21.15.55:0/4069015160 shutdown_connections 2023-08-25T04:19:52.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 1 -- 172.21.15.55:0/4069015160 wait complete. 2023-08-25T04:19:52.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.392+0000 7f8ece158000 20 client.8034 trim_cache size 0 max 16384 2023-08-25T04:19:52.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.408+0000 7f8ece158000 1 Processor -- start 2023-08-25T04:19:52.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.408+0000 7f8ece158000 1 -- start start 2023-08-25T04:19:52.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.408+0000 7f8ece158000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511ac5b0 0x55c05124fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.408+0000 7f8ece158000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6020 0x55c0512502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.408+0000 7f8ece158000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511f6940 0x55c051250800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.408+0000 7f8ece158000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c050fc2e80 con 0x55c0511f6940 2023-08-25T04:19:52.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.408+0000 7f8ece158000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c050cf61b0 con 0x55c0511f6020 2023-08-25T04:19:52.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.408+0000 7f8ece158000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c051000b10 con 0x55c0511ac5b0 2023-08-25T04:19:52.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.408+0000 7f8ec9386640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511f6940 0x55c051250800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.408+0000 7f8ec9386640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511f6940 0x55c051250800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51852/0 (socket says 172.21.15.55:51852) 2023-08-25T04:19:52.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.408+0000 7f8ec9386640 1 -- 172.21.15.55:0/1501171436 learned_addr learned my addr 172.21.15.55:0/1501171436 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:52.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.408+0000 7f8ec8b85640 1 --2- 172.21.15.55:0/1501171436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511ac5b0 0x55c05124fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.408+0000 7f8ec3fff640 1 --2- 172.21.15.55:0/1501171436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6020 0x55c0512502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ec9386640 1 -- 172.21.15.55:0/1501171436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511ac5b0 msgr2=0x55c05124fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:52.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ec9386640 1 --2- 172.21.15.55:0/1501171436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511ac5b0 0x55c05124fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ec9386640 1 -- 172.21.15.55:0/1501171436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6020 msgr2=0x55c0512502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:52.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ec9386640 1 --2- 172.21.15.55:0/1501171436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6020 0x55c0512502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ec9386640 1 -- 172.21.15.55:0/1501171436 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c050fbe190 con 0x55c0511f6940 2023-08-25T04:19:52.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ec9386640 1 --2- 172.21.15.55:0/1501171436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511f6940 0x55c051250800 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00b010 tx=0x7f8ebc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c25532dbc82f50 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:52.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8eaeffd640 1 -- 172.21.15.55:0/1501171436 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc003ba0 con 0x55c0511f6940 2023-08-25T04:19:52.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8eaeffd640 1 -- 172.21.15.55:0/1501171436 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc003d00 con 0x55c0511f6940 2023-08-25T04:19:52.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8eaeffd640 1 -- 172.21.15.55:0/1501171436 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc0109d0 con 0x55c0511f6940 2023-08-25T04:19:52.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ece158000 1 -- 172.21.15.55:0/1501171436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511f6940 msgr2=0x55c051250800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:52.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ece158000 1 --2- 172.21.15.55:0/1501171436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511f6940 0x55c051250800 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc00b010 tx=0x7f8ebc016000 comp rx=0 tx=0).stop 2023-08-25T04:19:52.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ece158000 1 -- 172.21.15.55:0/1501171436 shutdown_connections 2023-08-25T04:19:52.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ece158000 1 --2- 172.21.15.55:0/1501171436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511f6940 0x55c051250800 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ece158000 1 --2- 172.21.15.55:0/1501171436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6020 0x55c0512502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ece158000 1 --2- 172.21.15.55:0/1501171436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511ac5b0 0x55c05124fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ece158000 1 -- 172.21.15.55:0/1501171436 >> 172.21.15.55:0/1501171436 conn(0x55c0511a8560 msgr2=0x55c0511f4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:52.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ece158000 1 -- 172.21.15.55:0/1501171436 shutdown_connections 2023-08-25T04:19:52.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ece158000 1 -- 172.21.15.55:0/1501171436 wait complete. 2023-08-25T04:19:52.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ece158000 1 -- start start 2023-08-25T04:19:52.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ece158000 1 Processor -- start 2023-08-25T04:19:52.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ece158000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511ac5b0 0x55c05124f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ece158000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511f6020 0x55c0511fa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ece158000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6940 0x55c0511fac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ece158000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0511aebd0 con 0x55c0511f6020 2023-08-25T04:19:52.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ece158000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c050f98d10 con 0x55c0511f6940 2023-08-25T04:19:52.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ece158000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c050fb2640 con 0x55c0511ac5b0 2023-08-25T04:19:52.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ece158000 10 client.0 _ll_register_callbacks cb 0x7f8ebc009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:19:52.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ec3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511f6020 0x55c0511fa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ec3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511f6020 0x55c0511fa6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51858/0 (socket says 172.21.15.55:51858) 2023-08-25T04:19:52.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ec3fff640 1 -- 172.21.15.55:0/2271071456 learned_addr learned my addr 172.21.15.55:0/2271071456 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:52.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ec8b85640 1 --2- 172.21.15.55:0/2271071456 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511ac5b0 0x55c05124f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.412+0000 7f8ec9386640 1 --2- 172.21.15.55:0/2271071456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6940 0x55c0511fac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ec3fff640 1 -- 172.21.15.55:0/2271071456 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511ac5b0 msgr2=0x55c05124f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:52.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ec3fff640 1 --2- 172.21.15.55:0/2271071456 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511ac5b0 0x55c05124f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ec3fff640 1 -- 172.21.15.55:0/2271071456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6940 msgr2=0x55c0511fac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:52.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ec3fff640 1 --2- 172.21.15.55:0/2271071456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6940 0x55c0511fac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ec3fff640 1 -- 172.21.15.55:0/2271071456 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c051093ec0 con 0x55c0511f6020 2023-08-25T04:19:52.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ec3fff640 1 --2- 172.21.15.55:0/2271071456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511f6020 0x55c0511fa6f0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0000fc0 tx=0x7f8eb0005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9409becfc777fb85 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:52.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ea37fe640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T04:19:52.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ea37fe640 1 -- 172.21.15.55:0/2271071456 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0012c40 con 0x55c0511f6020 2023-08-25T04:19:52.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ea37fe640 1 -- 172.21.15.55:0/2271071456 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f8eb0012da0 con 0x55c0511f6020 2023-08-25T04:19:52.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 1 -- 172.21.15.55:0/2271071456 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c050fb6880 con 0x55c0511f6020 2023-08-25T04:19:52.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ea37fe640 1 -- 172.21.15.55:0/2271071456 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8eb004fe00 con 0x55c0511f6020 2023-08-25T04:19:52.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 10 client.8040 fetch_fsmap learned FSMap version 49 2023-08-25T04:19:52.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 1 -- 172.21.15.55:0/2271071456 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55c050fa4420 con 0x55c0511f6020 2023-08-25T04:19:52.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ea37fe640 1 -- 172.21.15.55:0/2271071456 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c050fb6880 con 0x55c0511f6020 2023-08-25T04:19:52.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ea37fe640 1 -- 172.21.15.55:0/2271071456 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 49) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8eb0019020 con 0x55c0511f6020 2023-08-25T04:19:52.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 10 client.8040 fetch_fsmap finished waiting for FSMap version 49 2023-08-25T04:19:52.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 10 client.8040 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T04:19:52.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 20 client.8040 populate_metadata read hostname 'smithi055' 2023-08-25T04:19:52.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 1 --2- 172.21.15.55:0/2271071456 >> [v2:172.21.15.55:6833/1173226599,v1:172.21.15.55:6835/1173226599] conn(0x55c0511fb170 0x55c0511fb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 4 client.8040 mds_command: new command op to 7860 tid=0[{"prefix": "status"}] 2023-08-25T04:19:52.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 1 -- 172.21.15.55:0/2271071456 --> [v2:172.21.15.55:6833/1173226599,v1:172.21.15.55:6835/1173226599] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c050ff4240 con 0x55c0511fb170 2023-08-25T04:19:52.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ec8b85640 1 --2- 172.21.15.55:0/2271071456 >> [v2:172.21.15.55:6833/1173226599,v1:172.21.15.55:6835/1173226599] conn(0x55c0511fb170 0x55c0511fb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ec8b85640 1 --2- 172.21.15.55:0/2271071456 >> [v2:172.21.15.55:6833/1173226599,v1:172.21.15.55:6835/1173226599] conn(0x55c0511fb170 0x55c0511fb550 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=158687f99078525a server_cookie=500e44e57162b38e in_seq=0 out_seq=0 2023-08-25T04:19:52.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ea37fe640 10 client.8040 ms_handle_connect on v2:172.21.15.55:6833/1173226599 2023-08-25T04:19:52.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ea37fe640 1 -- 172.21.15.55:0/2271071456 <== mds.0 v2:172.21.15.55:6833/1173226599 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55c050ff4240 con 0x55c0511fb170 2023-08-25T04:19:52.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ea37fe640 10 client.8040 handle_command_reply: tid=0 2023-08-25T04:19:52.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 1 client.8040 shutdown 2023-08-25T04:19:52.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 1 -- 172.21.15.55:0/2271071456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511f6020 msgr2=0x55c0511fa6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:52.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 1 --2- 172.21.15.55:0/2271071456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511f6020 0x55c0511fa6f0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0000fc0 tx=0x7f8eb0005040 comp rx=0 tx=0).stop 2023-08-25T04:19:52.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 1 -- 172.21.15.55:0/2271071456 shutdown_connections 2023-08-25T04:19:52.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 1 --2- 172.21.15.55:0/2271071456 >> [v2:172.21.15.55:6833/1173226599,v1:172.21.15.55:6835/1173226599] conn(0x55c0511fb170 0x55c0511fb550 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 1 --2- 172.21.15.55:0/2271071456 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c0511f6940 0x55c0511fac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 1 --2- 172.21.15.55:0/2271071456 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c0511f6020 0x55c0511fa6f0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 1 --2- 172.21.15.55:0/2271071456 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c0511ac5b0 0x55c05124f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ea37fe640 0 client.8040 ms_handle_reset on v2:172.21.15.55:6833/1173226599 2023-08-25T04:19:52.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 1 -- 172.21.15.55:0/2271071456 >> 172.21.15.55:0/2271071456 conn(0x55c0511a8560 msgr2=0x55c0511f5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:52.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 1 -- 172.21.15.55:0/2271071456 shutdown_connections 2023-08-25T04:19:52.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 1 -- 172.21.15.55:0/2271071456 wait complete. 2023-08-25T04:19:52.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ece158000 20 client.8040 trim_cache size 0 max 16384 2023-08-25T04:19:52.425 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T04:19:52.425 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2d2a9024-b152-4d40-880c-1686d1810590", 2023-08-25T04:19:52.426 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-08-25T04:19:52.426 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 7860, 2023-08-25T04:19:52.426 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-08-25T04:19:52.426 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-08-25T04:19:52.426 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-08-25T04:19:52.426 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.531125146000001, 2023-08-25T04:19:52.426 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 49, 2023-08-25T04:19:52.426 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 107, 2023-08-25T04:19:52.427 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 106, 2023-08-25T04:19:52.427 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 16.390307073999999 2023-08-25T04:19:52.427 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T04:19:52.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ecade9640 1 -- 172.21.15.55:0/2623623717 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f8ea8065710 msgr2=0x7f8ea8067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:52.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ecade9640 1 --2- 172.21.15.55:0/2623623717 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f8ea8065710 0x7f8ea8067bd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80b1000 tx=0x7f8eb8008040 comp rx=0 tx=0).stop 2023-08-25T04:19:52.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ecade9640 1 -- 172.21.15.55:0/2623623717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ec40c89f0 msgr2=0x7f8ec40ac380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:52.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ecade9640 1 --2- 172.21.15.55:0/2623623717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ec40c89f0 0x7f8ec40ac380 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000c4d0 tx=0x7f8eb000c990 comp rx=0 tx=0).stop 2023-08-25T04:19:52.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ecade9640 1 -- 172.21.15.55:0/2623623717 shutdown_connections 2023-08-25T04:19:52.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ecade9640 1 --2- 172.21.15.55:0/2623623717 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f8ea8065710 0x7f8ea8067bd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ecade9640 1 --2- 172.21.15.55:0/2623623717 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ec40ceeb0 0x7f8ec4153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ecade9640 1 --2- 172.21.15.55:0/2623623717 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ec40c89f0 0x7f8ec40ac380 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ecade9640 1 --2- 172.21.15.55:0/2623623717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ec40ad950 0x7f8ec4096c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ecade9640 1 -- 172.21.15.55:0/2623623717 >> 172.21.15.55:0/2623623717 conn(0x7f8ec4069d00 msgr2=0x7f8ec40c95b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:52.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ecade9640 1 -- 172.21.15.55:0/2623623717 shutdown_connections 2023-08-25T04:19:52.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.416+0000 7f8ecade9640 1 -- 172.21.15.55:0/2623623717 wait complete. 2023-08-25T04:19:52.437 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:19:52.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.580+0000 7fd0f152c640 1 Processor -- start 2023-08-25T04:19:52.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.580+0000 7fd0f152c640 1 -- start start 2023-08-25T04:19:52.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.580+0000 7fd0f152c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd0ec0cdde0 0x7fd0ec0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.580+0000 7fd0f152c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd0ec0b2e40 0x7fd0ec0b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.580+0000 7fd0f152c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ec0b29b0 con 0x7fd0ec0d0da0 2023-08-25T04:19:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.580+0000 7fd0f152c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ec0ce760 con 0x7fd0ec0b2e40 2023-08-25T04:19:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.580+0000 7fd0f152c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ec0b1dc0 con 0x7fd0ec0cdde0 2023-08-25T04:19:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.580+0000 7fd0eb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd0ec0b2e40 0x7fd0ec0b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.580+0000 7fd0eb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd0ec0b2e40 0x7fd0ec0b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51864/0 (socket says 172.21.15.55:51864) 2023-08-25T04:19:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.580+0000 7fd0eb7fe640 1 -- 172.21.15.55:0/4228859881 learned_addr learned my addr 172.21.15.55:0/4228859881 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.580+0000 7fd0e27fc640 1 --2- 172.21.15.55:0/4228859881 >> v2:172.21.15.110:3300/0 conn(0x7fd0ec0cdde0 0x7fd0ec0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.580+0000 7fd0eb7fe640 1 -- 172.21.15.55:0/4228859881 >> v2:172.21.15.110:3300/0 conn(0x7fd0ec0cdde0 msgr2=0x7fd0ec0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.580+0000 7fd0eb7fe640 1 --2- 172.21.15.55:0/4228859881 >> v2:172.21.15.110:3300/0 conn(0x7fd0ec0cdde0 0x7fd0ec0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.580+0000 7fd0eb7fe640 1 -- 172.21.15.55:0/4228859881 >> v1:172.21.15.110:6789/0 conn(0x7fd0ec0d0da0 legacy=0x7fd0ec0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.580+0000 7fd0eb7fe640 1 -- 172.21.15.55:0/4228859881 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec0b2080 con 0x7fd0ec0b2e40 2023-08-25T04:19:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.584+0000 7fd0eb7fe640 1 --2- 172.21.15.55:0/4228859881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0ec0b2e40 0x7fd0ec0b32b0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0d38c0 tx=0x7fd0e401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a98b768b601d76a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.584+0000 7fd0ea7fc640 1 -- 172.21.15.55:0/4228859881 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e40a89f0 con 0x7fd0ec0b2e40 2023-08-25T04:19:52.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.584+0000 7fd0ea7fc640 1 -- 172.21.15.55:0/4228859881 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e40a8b50 con 0x7fd0ec0b2e40 2023-08-25T04:19:52.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.584+0000 7fd0ea7fc640 1 -- 172.21.15.55:0/4228859881 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e40b0440 con 0x7fd0ec0b2e40 2023-08-25T04:19:52.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.584+0000 7fd0f152c640 1 -- 172.21.15.55:0/4228859881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0ec0b2e40 msgr2=0x7fd0ec0b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:52.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.584+0000 7fd0f152c640 1 --2- 172.21.15.55:0/4228859881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0ec0b2e40 0x7fd0ec0b32b0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0d38c0 tx=0x7fd0e401ecf0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.584+0000 7fd0f152c640 1 -- 172.21.15.55:0/4228859881 shutdown_connections 2023-08-25T04:19:52.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.584+0000 7fd0f152c640 1 --2- 172.21.15.55:0/4228859881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0ec0b2e40 0x7fd0ec0b32b0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.584+0000 7fd0f152c640 1 --2- 172.21.15.55:0/4228859881 >> v2:172.21.15.110:3300/0 conn(0x7fd0ec0cdde0 0x7fd0ec0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.584+0000 7fd0f152c640 1 -- 172.21.15.55:0/4228859881 >> 172.21.15.55:0/4228859881 conn(0x7fd0ec09bae0 msgr2=0x7fd0ec0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:52.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.584+0000 7fd0f152c640 1 -- 172.21.15.55:0/4228859881 shutdown_connections 2023-08-25T04:19:52.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.584+0000 7fd0f152c640 1 -- 172.21.15.55:0/4228859881 wait complete. 2023-08-25T04:19:52.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0f152c640 1 Processor -- start 2023-08-25T04:19:52.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0f152c640 1 -- start start 2023-08-25T04:19:52.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0f152c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0ec0b2e40 0x7fd0ec0b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0f152c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0ec0cdde0 0x7fd0ec151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0f152c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0ec0d0da0 0x7fd0ec0b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0f152c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0b6330 con 0x7fd0ec0b2e40 2023-08-25T04:19:52.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0f152c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0cc740 con 0x7fd0ec0cdde0 2023-08-25T04:19:52.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0f152c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec0b6540 con 0x7fd0ec0d0da0 2023-08-25T04:19:52.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0eaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0ec0b2e40 0x7fd0ec0b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0e27fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0ec0cdde0 0x7fd0ec151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0eaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0ec0b2e40 0x7fd0ec0b5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51868/0 (socket says 172.21.15.55:51868) 2023-08-25T04:19:52.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0e27fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0ec0cdde0 0x7fd0ec151cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:59854/0 (socket says 172.21.15.55:59854) 2023-08-25T04:19:52.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0eaffd640 1 -- 172.21.15.55:0/1837842921 learned_addr learned my addr 172.21.15.55:0/1837842921 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:52.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0eb7fe640 1 --2- 172.21.15.55:0/1837842921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0ec0d0da0 0x7fd0ec0b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0e27fc640 1 -- 172.21.15.55:0/1837842921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0ec0d0da0 msgr2=0x7fd0ec0b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:52.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0e27fc640 1 --2- 172.21.15.55:0/1837842921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0ec0d0da0 0x7fd0ec0b0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0e27fc640 1 -- 172.21.15.55:0/1837842921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0ec0b2e40 msgr2=0x7fd0ec0b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:52.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0e27fc640 1 --2- 172.21.15.55:0/1837842921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0ec0b2e40 0x7fd0ec0b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0e27fc640 1 -- 172.21.15.55:0/1837842921 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e40094d0 con 0x7fd0ec0cdde0 2023-08-25T04:19:52.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0eaffd640 1 --2- 172.21.15.55:0/1837842921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0ec0b2e40 0x7fd0ec0b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:52.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0e27fc640 1 --2- 172.21.15.55:0/1837842921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0ec0cdde0 0x7fd0ec151cd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400e870 tx=0x7fd0d400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0e3fff640 1 -- 172.21.15.55:0/1837842921 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d40095d0 con 0x7fd0ec0cdde0 2023-08-25T04:19:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0e3fff640 1 -- 172.21.15.55:0/1837842921 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d400c940 con 0x7fd0ec0cdde0 2023-08-25T04:19:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0f152c640 1 -- 172.21.15.55:0/1837842921 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ec0b6820 con 0x7fd0ec0cdde0 2023-08-25T04:19:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0e3fff640 1 -- 172.21.15.55:0/1837842921 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400ccb0 con 0x7fd0ec0cdde0 2023-08-25T04:19:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.588+0000 7fd0f152c640 1 -- 172.21.15.55:0/1837842921 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ec0b6de0 con 0x7fd0ec0cdde0 2023-08-25T04:19:52.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.592+0000 7fd0f152c640 1 -- 172.21.15.55:0/1837842921 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ec04dbe0 con 0x7fd0ec0cdde0 2023-08-25T04:19:52.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.592+0000 7fd0e3fff640 1 -- 172.21.15.55:0/1837842921 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 45) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fd0d40059a0 con 0x7fd0ec0cdde0 2023-08-25T04:19:52.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.592+0000 7fd0e3fff640 1 --2- 172.21.15.55:0/1837842921 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd0cc065710 0x7fd0cc067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:52.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.592+0000 7fd0e3fff640 1 -- 172.21.15.55:0/1837842921 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fd0d4082fe0 con 0x7fd0ec0cdde0 2023-08-25T04:19:52.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.592+0000 7fd0eaffd640 1 --2- 172.21.15.55:0/1837842921 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd0cc065710 0x7fd0cc067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:52.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.592+0000 7fd0eaffd640 1 --2- 172.21.15.55:0/1837842921 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd0cc065710 0x7fd0cc067bd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00f290 tx=0x7fd0dc009040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.596+0000 7fd0e3fff640 1 -- 172.21.15.55:0/1837842921 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd0d4050af0 con 0x7fd0ec0cdde0 2023-08-25T04:19:52.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.664+0000 7fd0e3fff640 1 -- 172.21.15.55:0/1837842921 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mgrmap(e 46) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fd0d4050ec0 con 0x7fd0ec0cdde0 2023-08-25T04:19:52.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.792+0000 7fd0f152c640 1 -- 172.21.15.55:0/1837842921 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd0ec0d0b80 con 0x7fd0ec0cdde0 2023-08-25T04:19:52.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.792+0000 7fd0e3fff640 1 -- 172.21.15.55:0/1837842921 <== mon.1 v2:172.21.15.110:3300/0 8 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd0d4054580 con 0x7fd0ec0cdde0 2023-08-25T04:19:52.794 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T04:19:52.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.796+0000 7fd0f152c640 1 -- 172.21.15.55:0/1837842921 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd0cc065710 msgr2=0x7fd0cc067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:52.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.796+0000 7fd0f152c640 1 --2- 172.21.15.55:0/1837842921 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd0cc065710 0x7fd0cc067bd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00f290 tx=0x7fd0dc009040 comp rx=0 tx=0).stop 2023-08-25T04:19:52.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.796+0000 7fd0f152c640 1 -- 172.21.15.55:0/1837842921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0ec0cdde0 msgr2=0x7fd0ec151cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:52.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.796+0000 7fd0f152c640 1 --2- 172.21.15.55:0/1837842921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0ec0cdde0 0x7fd0ec151cd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400e870 tx=0x7fd0d400ed30 comp rx=0 tx=0).stop 2023-08-25T04:19:52.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.796+0000 7fd0f152c640 1 -- 172.21.15.55:0/1837842921 shutdown_connections 2023-08-25T04:19:52.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.796+0000 7fd0f152c640 1 --2- 172.21.15.55:0/1837842921 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fd0cc065710 0x7fd0cc067bd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.796+0000 7fd0f152c640 1 --2- 172.21.15.55:0/1837842921 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0ec0d0da0 0x7fd0ec0b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.796+0000 7fd0f152c640 1 --2- 172.21.15.55:0/1837842921 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0ec0cdde0 0x7fd0ec151cd0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.796+0000 7fd0f152c640 1 --2- 172.21.15.55:0/1837842921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0ec0b2e40 0x7fd0ec0b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:52.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.796+0000 7fd0f152c640 1 -- 172.21.15.55:0/1837842921 >> 172.21.15.55:0/1837842921 conn(0x7fd0ec09bae0 msgr2=0x7fd0ec06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:52.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.796+0000 7fd0f152c640 1 -- 172.21.15.55:0/1837842921 shutdown_connections 2023-08-25T04:19:52.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:52.796+0000 7fd0f152c640 1 -- 172.21.15.55:0/1837842921 wait complete. 2023-08-25T04:19:52.815 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-25T04:19:52.815 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:19:52.816 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-08-25T04:19:52.816 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-25T04:19:52.816 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T04:19:52.817 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-25T04:19:52.817 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-25T04:19:52.817 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:19:52.818 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:19:52.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:52.818 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-08-25T04:19:52.828 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:19:52.828 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:19:52.828 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:19:52.828 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:19:52.828 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-08-25T04:19:52.828 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:19:52.829 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:19:52.829 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:19:52.829 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-08-25T04:19:52.829 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:19:52.829 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:19:52.829 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-08-25T04:19:52.829 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:19:52.830 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:19:52.830 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-08-25T04:19:52.830 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-08-25T04:19:52.830 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41396sec preferred_lft 41396sec 2023-08-25T04:19:52.831 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-08-25T04:19:52.831 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:19:52.831 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:19:52.831 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:19:52.831 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-08-25T04:19:52.832 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-25T04:19:52.832 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:98:6a:38:6a brd ff:ff:ff:ff:ff:ff 2023-08-25T04:19:52.832 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-25T04:19:52.832 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:19:52.832 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:19:52.832 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-08-25T04:19:52.832 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T04:19:52.833 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:19:52.833 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-08-25T04:19:52.833 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:19:52.833 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:19:52.833 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T04:19:52.833 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-08-25T04:19:52.833 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:19:52.833 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:19:52.834 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-25T04:19:52.834 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-08-25T04:19:52.834 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:19:52.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:52.835 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:19:52.902 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-08-25T04:19:52.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:52.905 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-08-25T04:19:52.956 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-08-25T04:19:52.957 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:19:52.957 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-08-25T04:19:52.957 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-25T04:19:52.957 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-08-25T04:19:52.957 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:19:52.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:52.958 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T04:19:52.958 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T04:19:52.959 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-25T04:19:52.959 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-25T04:19:52.959 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-25T04:19:52.959 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T04:19:53.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:53.056 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-08-25T04:19:53.066 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-25T04:19:53.066 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-25T04:19:53.067 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:19:53.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:53.068 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-08-25T04:19:53.127 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:19:53.128 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-25T04:19:53.179 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:19:53.179 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:19:53.179 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:19:53.234 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-25T04:19:53.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:53.235 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:19:53.326 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:19:53.326 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:19:53.339 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:19:53.339 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:19:53.339 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.110:3300,172.21.15.110:3301" 2023-08-25T04:19:53.339 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2d2a9024-b152-4d40-880c-1686d1810590.cephfs=/ 2023-08-25T04:19:53.340 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2023-08-25T04:19:53.343 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T04:19:53.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:53.351 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:19:53.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:19:53.373 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:19:53.430 INFO:teuthology.orchestra.run.smithi055.stdout:client8049 2023-08-25T04:19:53.431 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:19:53.432 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:19:53.488 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-25T04:19:53.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.676+0000 7f0d2a25c640 1 Processor -- start 2023-08-25T04:19:53.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.676+0000 7f0d2a25c640 1 -- start start 2023-08-25T04:19:53.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d2a25c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d240cb2a0 0x7f0d240b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:53.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d2a25c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d240cdbf0 con 0x7f0d24158e10 2023-08-25T04:19:53.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d2a25c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d2415a380 con 0x7f0d24159f10 2023-08-25T04:19:53.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d2a25c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d240ad940 con 0x7f0d240cb2a0 2023-08-25T04:19:53.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d237fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0d24158e10 0x7f0d240cab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50176/0 (socket says 172.21.15.55:50176) 2023-08-25T04:19:53.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d237fe640 1 -- 172.21.15.55:0/422542696 learned_addr learned my addr 172.21.15.55:0/422542696 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:53.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d1bfff640 1 --2- 172.21.15.55:0/422542696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d240cb2a0 0x7f0d240b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:53.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d22ffd640 1 -- 172.21.15.55:0/422542696 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260362296 0 0) 0x7f0d240cdbf0 con 0x7f0d24158e10 2023-08-25T04:19:53.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d22ffd640 1 -- 172.21.15.55:0/422542696 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d10003530 con 0x7f0d24158e10 2023-08-25T04:19:53.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d22ffd640 1 -- 172.21.15.55:0/422542696 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2480631468 0 0) 0x7f0d10003530 con 0x7f0d24158e10 2023-08-25T04:19:53.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d22ffd640 1 -- 172.21.15.55:0/422542696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d240cb2a0 msgr2=0x7f0d240b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:53.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d22ffd640 1 --2- 172.21.15.55:0/422542696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d240cb2a0 0x7f0d240b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:53.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d22ffd640 1 -- 172.21.15.55:0/422542696 >> v1:172.21.15.110:6789/0 conn(0x7f0d24159f10 legacy=0x7f0d240c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:53.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d22ffd640 1 -- 172.21.15.55:0/422542696 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2406d380 con 0x7f0d24158e10 2023-08-25T04:19:53.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d22ffd640 1 -- 172.21.15.55:0/422542696 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f0d14001680 con 0x7f0d24158e10 2023-08-25T04:19:53.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d22ffd640 1 -- 172.21.15.55:0/422542696 >> v1:172.21.15.55:6789/0 conn(0x7f0d24158e10 legacy=0x7f0d240cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:53.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d22ffd640 1 --2- 172.21.15.55:0/422542696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d240cb2a0 0x7f0d100039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:53.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d22ffd640 1 --2- 172.21.15.55:0/422542696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d10003f30 0x7f0d100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:53.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d22ffd640 1 --2- 172.21.15.55:0/422542696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d10004d10 0x7f0d10005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:53.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d22ffd640 1 -- 172.21.15.55:0/422542696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1000ba40 con 0x7f0d10004d10 2023-08-25T04:19:53.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d22ffd640 1 -- 172.21.15.55:0/422542696 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1000bbb0 con 0x7f0d10003f30 2023-08-25T04:19:53.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d22ffd640 1 -- 172.21.15.55:0/422542696 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1000df80 con 0x7f0d240cb2a0 2023-08-25T04:19:53.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d237fe640 1 --2- 172.21.15.55:0/422542696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d240cb2a0 0x7f0d100039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:53.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d23fff640 1 --2- 172.21.15.55:0/422542696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d10004d10 0x7f0d10005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:53.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d1bfff640 1 --2- 172.21.15.55:0/422542696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d10003f30 0x7f0d100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:53.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d23fff640 1 -- 172.21.15.55:0/422542696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d240cb2a0 msgr2=0x7f0d100039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:53.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d23fff640 1 --2- 172.21.15.55:0/422542696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d240cb2a0 0x7f0d100039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:53.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d23fff640 1 -- 172.21.15.55:0/422542696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d10003f30 msgr2=0x7f0d100047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:53.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d23fff640 1 --2- 172.21.15.55:0/422542696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d10003f30 0x7f0d100047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:53.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d23fff640 1 -- 172.21.15.55:0/422542696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d10003530 con 0x7f0d10004d10 2023-08-25T04:19:53.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.680+0000 7f0d237fe640 1 --2- 172.21.15.55:0/422542696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d240cb2a0 0x7f0d100039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:53.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.684+0000 7f0d23fff640 1 --2- 172.21.15.55:0/422542696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d10004d10 0x7f0d10005190 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c001e70 tx=0x7f0d1c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=971621887f90f17a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:53.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.684+0000 7f0d22ffd640 1 -- 172.21.15.55:0/422542696 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c003b80 con 0x7f0d10004d10 2023-08-25T04:19:53.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.684+0000 7f0d22ffd640 1 -- 172.21.15.55:0/422542696 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c003ce0 con 0x7f0d10004d10 2023-08-25T04:19:53.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.684+0000 7f0d22ffd640 1 -- 172.21.15.55:0/422542696 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c0052c0 con 0x7f0d10004d10 2023-08-25T04:19:53.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.684+0000 7f0d2a25c640 1 -- 172.21.15.55:0/422542696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d10004d10 msgr2=0x7f0d10005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:53.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.684+0000 7f0d2a25c640 1 --2- 172.21.15.55:0/422542696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d10004d10 0x7f0d10005190 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c001e70 tx=0x7f0d1c01c760 comp rx=0 tx=0).stop 2023-08-25T04:19:53.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.684+0000 7f0d23fff640 1 -- 172.21.15.55:0/422542696 reap_dead start 2023-08-25T04:19:53.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.684+0000 7f0d2a25c640 1 -- 172.21.15.55:0/422542696 shutdown_connections 2023-08-25T04:19:53.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.684+0000 7f0d2a25c640 1 -- 172.21.15.55:0/422542696 >> 172.21.15.55:0/422542696 conn(0x7f0d24069d00 msgr2=0x7f0d2406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:53.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.684+0000 7f0d2a25c640 1 -- 172.21.15.55:0/422542696 shutdown_connections 2023-08-25T04:19:53.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.684+0000 7f0d2a25c640 1 -- 172.21.15.55:0/422542696 wait complete. 2023-08-25T04:19:53.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d2a25c640 1 Processor -- start 2023-08-25T04:19:53.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d2a25c640 1 -- start start 2023-08-25T04:19:53.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d2a25c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d10004d10 0x7f0d240c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:53.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d2a25c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d24157ff0 0x7f0d24157700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:53.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d2a25c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d240b0560 0x7f0d240b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:53.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d2a25c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d240c59b0 con 0x7f0d10004d10 2023-08-25T04:19:53.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d2a25c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d240c2d70 con 0x7f0d24157ff0 2023-08-25T04:19:53.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d2a25c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d240c3010 con 0x7f0d240b0560 2023-08-25T04:19:53.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d237fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d10004d10 0x7f0d240c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:53.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d237fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d10004d10 0x7f0d240c5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51886/0 (socket says 172.21.15.55:51886) 2023-08-25T04:19:53.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d237fe640 1 -- 172.21.15.55:0/802650946 learned_addr learned my addr 172.21.15.55:0/802650946 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:53.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d23fff640 1 --2- 172.21.15.55:0/802650946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d240b0560 0x7f0d240b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:53.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d1bfff640 1 --2- 172.21.15.55:0/802650946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d24157ff0 0x7f0d24157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:53.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d237fe640 1 -- 172.21.15.55:0/802650946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d240b0560 msgr2=0x7f0d240b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:53.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d237fe640 1 --2- 172.21.15.55:0/802650946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d240b0560 0x7f0d240b1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:53.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d237fe640 1 -- 172.21.15.55:0/802650946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d24157ff0 msgr2=0x7f0d24157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:53.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d237fe640 1 --2- 172.21.15.55:0/802650946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d24157ff0 0x7f0d24157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:53.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d237fe640 1 -- 172.21.15.55:0/802650946 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d240c32f0 con 0x7f0d10004d10 2023-08-25T04:19:53.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d1bfff640 1 --2- 172.21.15.55:0/802650946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d24157ff0 0x7f0d24157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:19:53.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d237fe640 1 --2- 172.21.15.55:0/802650946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d10004d10 0x7f0d240c5470 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f0d14007300 tx=0x7f0d140077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:53.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d20ff9640 1 -- 172.21.15.55:0/802650946 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400fab0 con 0x7f0d10004d10 2023-08-25T04:19:53.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d20ff9640 1 -- 172.21.15.55:0/802650946 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1400fc10 con 0x7f0d10004d10 2023-08-25T04:19:53.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d20ff9640 1 -- 172.21.15.55:0/802650946 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d140133f0 con 0x7f0d10004d10 2023-08-25T04:19:53.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d2a25c640 1 -- 172.21.15.55:0/802650946 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d240c35d0 con 0x7f0d10004d10 2023-08-25T04:19:53.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.688+0000 7f0d2a25c640 1 -- 172.21.15.55:0/802650946 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d24157c40 con 0x7f0d10004d10 2023-08-25T04:19:53.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.692+0000 7f0d2a25c640 1 -- 172.21.15.55:0/802650946 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2404dbe0 con 0x7f0d10004d10 2023-08-25T04:19:53.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.692+0000 7f0d20ff9640 1 -- 172.21.15.55:0/802650946 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 46) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f0d14013550 con 0x7f0d10004d10 2023-08-25T04:19:53.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.692+0000 7f0d20ff9640 1 --2- 172.21.15.55:0/802650946 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f0d040657d0 0x7f0d04067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:53.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.692+0000 7f0d20ff9640 1 -- 172.21.15.55:0/802650946 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f0d14083390 con 0x7f0d10004d10 2023-08-25T04:19:53.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.692+0000 7f0d1bfff640 1 --2- 172.21.15.55:0/802650946 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f0d040657d0 0x7f0d04067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:53.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.692+0000 7f0d1bfff640 1 --2- 172.21.15.55:0/802650946 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f0d040657d0 0x7f0d04067c90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0d24158430 tx=0x7f0d0c008040 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:53.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.696+0000 7f0d20ff9640 1 -- 172.21.15.55:0/802650946 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0d14050c70 con 0x7f0d10004d10 2023-08-25T04:19:53.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.872+0000 7f0d2a25c640 1 -- 172.21.15.55:0/802650946 --> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d2406d660 con 0x7f0d040657d0 2023-08-25T04:19:53.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.876+0000 7f0d20ff9640 1 -- 172.21.15.55:0/802650946 <== mgr.7111 v2:172.21.15.110:6832/1337211678 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f0d0c014b30 con 0x7f0d040657d0 2023-08-25T04:19:53.877 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T04:19:53.877 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:19:53.878 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-08-25T04:19:53.878 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:19:53.878 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T04:19:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.876+0000 7f0d2a25c640 1 -- 172.21.15.55:0/802650946 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f0d040657d0 msgr2=0x7f0d04067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.876+0000 7f0d2a25c640 1 --2- 172.21.15.55:0/802650946 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f0d040657d0 0x7f0d04067c90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0d24158430 tx=0x7f0d0c008040 comp rx=0 tx=0).stop 2023-08-25T04:19:53.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.880+0000 7f0d2a25c640 1 -- 172.21.15.55:0/802650946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d10004d10 msgr2=0x7f0d240c5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:53.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.880+0000 7f0d2a25c640 1 --2- 172.21.15.55:0/802650946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d10004d10 0x7f0d240c5470 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f0d14007300 tx=0x7f0d140077c0 comp rx=0 tx=0).stop 2023-08-25T04:19:53.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.880+0000 7f0d2a25c640 1 -- 172.21.15.55:0/802650946 shutdown_connections 2023-08-25T04:19:53.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.880+0000 7f0d2a25c640 1 --2- 172.21.15.55:0/802650946 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f0d040657d0 0x7f0d04067c90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:53.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.880+0000 7f0d2a25c640 1 --2- 172.21.15.55:0/802650946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d240b0560 0x7f0d240b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:53.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.880+0000 7f0d2a25c640 1 --2- 172.21.15.55:0/802650946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d24157ff0 0x7f0d24157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:53.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.880+0000 7f0d2a25c640 1 --2- 172.21.15.55:0/802650946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d10004d10 0x7f0d240c5470 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:53.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.880+0000 7f0d2a25c640 1 -- 172.21.15.55:0/802650946 >> 172.21.15.55:0/802650946 conn(0x7f0d24069d00 msgr2=0x7f0d2415aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:53.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.880+0000 7f0d2a25c640 1 -- 172.21.15.55:0/802650946 shutdown_connections 2023-08-25T04:19:53.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:53.880+0000 7f0d2a25c640 1 -- 172.21.15.55:0/802650946 wait complete. 2023-08-25T04:19:53.900 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-25T04:19:54.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.044+0000 7f0291fe1640 1 Processor -- start 2023-08-25T04:19:54.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.044+0000 7f0291fe1640 1 -- start start 2023-08-25T04:19:54.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.048+0000 7f0291fe1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f028c15cba0 0x7f028c0ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:54.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.048+0000 7f0291fe1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f028c0b11c0 0x7f028c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:54.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.048+0000 7f0291fe1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f028c06cd40 con 0x7f028c06dab0 2023-08-25T04:19:54.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.048+0000 7f0291fe1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f028c06df20 con 0x7f028c15cba0 2023-08-25T04:19:54.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.048+0000 7f0291fe1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028c06be90 con 0x7f028c0b11c0 2023-08-25T04:19:54.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.048+0000 7f0283fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f028c0b11c0 0x7f028c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:54.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.048+0000 7f0283fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f028c0b11c0 0x7f028c06d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:38166/0 (socket says 172.21.15.55:38166) 2023-08-25T04:19:54.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.048+0000 7f0283fff640 1 -- 172.21.15.55:0/1930670903 learned_addr learned my addr 172.21.15.55:0/1930670903 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:54.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.048+0000 7f028b7fe640 1 --2- 172.21.15.55:0/1930670903 >> v2:172.21.15.110:3300/0 conn(0x7f028c15cba0 0x7f028c0ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:54.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.048+0000 7f0283fff640 1 -- 172.21.15.55:0/1930670903 >> v2:172.21.15.110:3300/0 conn(0x7f028c15cba0 msgr2=0x7f028c0ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:54.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.048+0000 7f0283fff640 1 --2- 172.21.15.55:0/1930670903 >> v2:172.21.15.110:3300/0 conn(0x7f028c15cba0 0x7f028c0ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:54.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.048+0000 7f0283fff640 1 -- 172.21.15.55:0/1930670903 >> v1:172.21.15.110:6789/0 conn(0x7f028c06dab0 legacy=0x7f028c1605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:54.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.048+0000 7f0283fff640 1 -- 172.21.15.55:0/1930670903 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028c06c130 con 0x7f028c0b11c0 2023-08-25T04:19:54.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.048+0000 7f028affd640 1 -- 172.21.15.55:0/1930670903 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976369417 0 0) 0x7f028c06cd40 con 0x7f028c06dab0 2023-08-25T04:19:54.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.052+0000 7f0283fff640 1 --2- 172.21.15.55:0/1930670903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f028c0b11c0 0x7f028c06d570 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0274009870 tx=0x7f027401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eba315309111258 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:54.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.052+0000 7f028affd640 1 -- 172.21.15.55:0/1930670903 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02740ab660 con 0x7f028c0b11c0 2023-08-25T04:19:54.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.052+0000 7f028affd640 1 -- 172.21.15.55:0/1930670903 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02740ab7c0 con 0x7f028c0b11c0 2023-08-25T04:19:54.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.052+0000 7f028affd640 1 -- 172.21.15.55:0/1930670903 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02740abb50 con 0x7f028c0b11c0 2023-08-25T04:19:54.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.052+0000 7f0291fe1640 1 -- 172.21.15.55:0/1930670903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f028c0b11c0 msgr2=0x7f028c06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:54.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.052+0000 7f0291fe1640 1 --2- 172.21.15.55:0/1930670903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f028c0b11c0 0x7f028c06d570 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0274009870 tx=0x7f027401c540 comp rx=0 tx=0).stop 2023-08-25T04:19:54.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.052+0000 7f0291fe1640 1 -- 172.21.15.55:0/1930670903 shutdown_connections 2023-08-25T04:19:54.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.052+0000 7f0291fe1640 1 --2- 172.21.15.55:0/1930670903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f028c0b11c0 0x7f028c06d570 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:54.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.052+0000 7f0291fe1640 1 --2- 172.21.15.55:0/1930670903 >> v2:172.21.15.110:3300/0 conn(0x7f028c15cba0 0x7f028c0ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:54.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.052+0000 7f0291fe1640 1 -- 172.21.15.55:0/1930670903 >> 172.21.15.55:0/1930670903 conn(0x7f028c0b06a0 msgr2=0x7f028c0b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:54.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.052+0000 7f0291fe1640 1 -- 172.21.15.55:0/1930670903 shutdown_connections 2023-08-25T04:19:54.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.052+0000 7f0291fe1640 1 -- 172.21.15.55:0/1930670903 wait complete. 2023-08-25T04:19:54.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.052+0000 7f0291fe1640 1 Processor -- start 2023-08-25T04:19:54.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.052+0000 7f0291fe1640 1 -- start start 2023-08-25T04:19:54.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.052+0000 7f0291fe1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f028c06dab0 0x7f028c152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:54.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.052+0000 7f0291fe1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f028c0b11c0 0x7f028c0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:54.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f0291fe1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f028c15cba0 0x7f028c0c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:54.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f0291fe1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028c156520 con 0x7f028c15cba0 2023-08-25T04:19:54.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f0291fe1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028c156800 con 0x7f028c06dab0 2023-08-25T04:19:54.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f0291fe1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028c156ae0 con 0x7f028c0b11c0 2023-08-25T04:19:54.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f028bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f028c15cba0 0x7f028c0c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:54.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f028b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f028c06dab0 0x7f028c152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:54.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f0283fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f028c0b11c0 0x7f028c0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:54.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f028b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f028c06dab0 0x7f028c152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:59896/0 (socket says 172.21.15.55:59896) 2023-08-25T04:19:54.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f028b7fe640 1 -- 172.21.15.55:0/2438287794 learned_addr learned my addr 172.21.15.55:0/2438287794 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:54.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f028b7fe640 1 -- 172.21.15.55:0/2438287794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f028c0b11c0 msgr2=0x7f028c0c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:54.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f028b7fe640 1 --2- 172.21.15.55:0/2438287794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f028c0b11c0 0x7f028c0c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:54.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f028b7fe640 1 -- 172.21.15.55:0/2438287794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f028c15cba0 msgr2=0x7f028c0c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:54.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f028b7fe640 1 --2- 172.21.15.55:0/2438287794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f028c15cba0 0x7f028c0c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:54.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f028b7fe640 1 -- 172.21.15.55:0/2438287794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02740094d0 con 0x7f028c06dab0 2023-08-25T04:19:54.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f028bfff640 1 --2- 172.21.15.55:0/2438287794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f028c15cba0 0x7f028c0c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:54.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f028b7fe640 1 --2- 172.21.15.55:0/2438287794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f028c06dab0 0x7f028c152640 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f027c00e870 tx=0x7f027c00ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:54.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f0288ff9640 1 -- 172.21.15.55:0/2438287794 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c009510 con 0x7f028c06dab0 2023-08-25T04:19:54.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f0288ff9640 1 -- 172.21.15.55:0/2438287794 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c00eec0 con 0x7f028c06dab0 2023-08-25T04:19:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f0291fe1640 1 -- 172.21.15.55:0/2438287794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028c156dc0 con 0x7f028c06dab0 2023-08-25T04:19:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f0288ff9640 1 -- 172.21.15.55:0/2438287794 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c00cb40 con 0x7f028c06dab0 2023-08-25T04:19:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f0291fe1640 1 -- 172.21.15.55:0/2438287794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028c1576a0 con 0x7f028c06dab0 2023-08-25T04:19:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f0291fe1640 1 -- 172.21.15.55:0/2438287794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028c073ec0 con 0x7f028c06dab0 2023-08-25T04:19:54.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.056+0000 7f0288ff9640 1 -- 172.21.15.55:0/2438287794 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 46) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f027c00cca0 con 0x7f028c06dab0 2023-08-25T04:19:54.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.060+0000 7f0288ff9640 1 --2- 172.21.15.55:0/2438287794 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f026c0657a0 0x7f026c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:54.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.060+0000 7f0288ff9640 1 -- 172.21.15.55:0/2438287794 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f027c0838a0 con 0x7f028c06dab0 2023-08-25T04:19:54.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.060+0000 7f0283fff640 1 --2- 172.21.15.55:0/2438287794 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f026c0657a0 0x7f026c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:54.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.060+0000 7f0283fff640 1 --2- 172.21.15.55:0/2438287794 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f026c0657a0 0x7f026c067c60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f02740af000 tx=0x7f02740a7000 comp rx=0 tx=0).ready entity=mgr.7111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:54.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.064+0000 7f0288ff9640 1 -- 172.21.15.55:0/2438287794 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f027c0512b0 con 0x7f028c06dab0 2023-08-25T04:19:54.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.256+0000 7f0291fe1640 1 -- 172.21.15.55:0/2438287794 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f028c156940 con 0x7f028c06dab0 2023-08-25T04:19:54.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.676+0000 7f0288ff9640 1 -- 172.21.15.55:0/2438287794 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mgrmap(e 47) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f027c051680 con 0x7f028c06dab0 2023-08-25T04:19:54.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.676+0000 7f0288ff9640 1 -- 172.21.15.55:0/2438287794 <== mon.1 v2:172.21.15.110:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v47) v1 ==== 92+0+0 (secure 0 0 0) 0x7f027c054ab0 con 0x7f028c06dab0 2023-08-25T04:19:54.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.680+0000 7f0291fe1640 1 -- 172.21.15.55:0/2438287794 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f026c0657a0 msgr2=0x7f026c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:54.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.680+0000 7f0291fe1640 1 --2- 172.21.15.55:0/2438287794 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f026c0657a0 0x7f026c067c60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f02740af000 tx=0x7f02740a7000 comp rx=0 tx=0).stop 2023-08-25T04:19:54.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.680+0000 7f0291fe1640 1 -- 172.21.15.55:0/2438287794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f028c06dab0 msgr2=0x7f028c152640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:54.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.680+0000 7f0291fe1640 1 --2- 172.21.15.55:0/2438287794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f028c06dab0 0x7f028c152640 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f027c00e870 tx=0x7f027c00ec70 comp rx=0 tx=0).stop 2023-08-25T04:19:54.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.680+0000 7f0291fe1640 1 -- 172.21.15.55:0/2438287794 shutdown_connections 2023-08-25T04:19:54.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.680+0000 7f0291fe1640 1 --2- 172.21.15.55:0/2438287794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f028c15cba0 0x7f028c0c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:54.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.680+0000 7f0291fe1640 1 --2- 172.21.15.55:0/2438287794 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f026c0657a0 0x7f026c067c60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:54.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.680+0000 7f0291fe1640 1 --2- 172.21.15.55:0/2438287794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f028c0b11c0 0x7f028c0c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:54.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.680+0000 7f0291fe1640 1 --2- 172.21.15.55:0/2438287794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f028c06dab0 0x7f028c152640 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:54.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.680+0000 7f0291fe1640 1 -- 172.21.15.55:0/2438287794 >> 172.21.15.55:0/2438287794 conn(0x7f028c0b06a0 msgr2=0x7f028c0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:54.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.680+0000 7f0291fe1640 1 -- 172.21.15.55:0/2438287794 shutdown_connections 2023-08-25T04:19:54.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.680+0000 7f0291fe1640 1 -- 172.21.15.55:0/2438287794 wait complete. 2023-08-25T04:19:54.701 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-25T04:19:54.852 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:54.848+0000 7f6ba4246180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:19:54.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.852+0000 7f835e6cb640 1 Processor -- start 2023-08-25T04:19:54.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.852+0000 7f835e6cb640 1 -- start start 2023-08-25T04:19:54.853 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:54.852+0000 7fba61a17180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:19:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.852+0000 7f835e6cb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f835815e3c0 0x7f835815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:54.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.852+0000 7f835e6cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f83580d1290 0x7f835815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:54.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.852+0000 7f835e6cb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83580cd5a0 con 0x7f83581601f0 2023-08-25T04:19:54.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.852+0000 7f835e6cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83580cd880 con 0x7f83580d1290 2023-08-25T04:19:54.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.852+0000 7f835e6cb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83580cdb60 con 0x7f835815e3c0 2023-08-25T04:19:54.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.852+0000 7f835cc68640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f83580d1290 0x7f835815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:54.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.852+0000 7f83577fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f835815e3c0 0x7f835815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:54.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.852+0000 7f835cc68640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f83580d1290 0x7f835815e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51920/0 (socket says 172.21.15.55:51920) 2023-08-25T04:19:54.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.852+0000 7f835cc68640 1 -- 172.21.15.55:0/1969234707 learned_addr learned my addr 172.21.15.55:0/1969234707 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:54.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.852+0000 7f835cc68640 1 -- 172.21.15.55:0/1969234707 >> v2:172.21.15.110:3300/0 conn(0x7f835815e3c0 msgr2=0x7f835815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:54.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.852+0000 7f835cc68640 1 --2- 172.21.15.55:0/1969234707 >> v2:172.21.15.110:3300/0 conn(0x7f835815e3c0 0x7f835815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:54.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.852+0000 7f835cc68640 1 -- 172.21.15.55:0/1969234707 >> v1:172.21.15.110:6789/0 conn(0x7f83581601f0 legacy=0x7f83580d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:54.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.852+0000 7f835cc68640 1 -- 172.21.15.55:0/1969234707 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83580cde40 con 0x7f83580d1290 2023-08-25T04:19:54.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.852+0000 7f83577fe640 1 --2- 172.21.15.55:0/1969234707 >> v2:172.21.15.110:3300/0 conn(0x7f835815e3c0 0x7f835815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:54.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.856+0000 7f835cc68640 1 --2- 172.21.15.55:0/1969234707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83580d1290 0x7f835815e8a0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f83580cd350 tx=0x7f835001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d6e9cdffc663c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:54.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.856+0000 7f8356ffd640 1 -- 172.21.15.55:0/1969234707 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83500a5790 con 0x7f83580d1290 2023-08-25T04:19:54.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.856+0000 7f8356ffd640 1 -- 172.21.15.55:0/1969234707 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83500a58f0 con 0x7f83580d1290 2023-08-25T04:19:54.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.856+0000 7f8356ffd640 1 -- 172.21.15.55:0/1969234707 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83500a5c80 con 0x7f83580d1290 2023-08-25T04:19:54.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f835e6cb640 1 -- 172.21.15.55:0/1969234707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83580d1290 msgr2=0x7f835815e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:54.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f835e6cb640 1 --2- 172.21.15.55:0/1969234707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83580d1290 0x7f835815e8a0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f83580cd350 tx=0x7f835001c9a0 comp rx=0 tx=0).stop 2023-08-25T04:19:54.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f835e6cb640 1 -- 172.21.15.55:0/1969234707 shutdown_connections 2023-08-25T04:19:54.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f835e6cb640 1 --2- 172.21.15.55:0/1969234707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83580d1290 0x7f835815e8a0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:54.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f835e6cb640 1 --2- 172.21.15.55:0/1969234707 >> v2:172.21.15.110:3300/0 conn(0x7f835815e3c0 0x7f835815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:54.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f835e6cb640 1 -- 172.21.15.55:0/1969234707 >> 172.21.15.55:0/1969234707 conn(0x7f83580d27d0 msgr2=0x7f83580d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:54.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f835e6cb640 1 -- 172.21.15.55:0/1969234707 shutdown_connections 2023-08-25T04:19:54.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f835e6cb640 1 -- 172.21.15.55:0/1969234707 wait complete. 2023-08-25T04:19:54.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f835e6cb640 1 Processor -- start 2023-08-25T04:19:54.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f835e6cb640 1 -- start start 2023-08-25T04:19:54.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f835e6cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83580d1290 0x7f8358153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:54.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f835e6cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f835815e3c0 0x7f835815c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:54.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f835e6cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83581601f0 0x7f835815c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:54.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f835e6cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83580b6190 con 0x7f83581601f0 2023-08-25T04:19:54.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f835e6cb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83580c8370 con 0x7f83580d1290 2023-08-25T04:19:54.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f835e6cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83580c8650 con 0x7f835815e3c0 2023-08-25T04:19:54.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f8357fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83580d1290 0x7f8358153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:54.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f8357fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83580d1290 0x7f8358153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:59916/0 (socket says 172.21.15.55:59916) 2023-08-25T04:19:54.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f8357fff640 1 -- 172.21.15.55:0/4184840714 learned_addr learned my addr 172.21.15.55:0/4184840714 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:54.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f835cc68640 1 --2- 172.21.15.55:0/4184840714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83581601f0 0x7f835815c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:54.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.860+0000 7f83577fe640 1 --2- 172.21.15.55:0/4184840714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f835815e3c0 0x7f835815c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:54.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.864+0000 7f8357fff640 1 -- 172.21.15.55:0/4184840714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f835815e3c0 msgr2=0x7f835815c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:54.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.864+0000 7f8357fff640 1 --2- 172.21.15.55:0/4184840714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f835815e3c0 0x7f835815c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:54.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.864+0000 7f8357fff640 1 -- 172.21.15.55:0/4184840714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83581601f0 msgr2=0x7f835815c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:54.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.864+0000 7f8357fff640 1 --2- 172.21.15.55:0/4184840714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83581601f0 0x7f835815c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:54.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.864+0000 7f8357fff640 1 -- 172.21.15.55:0/4184840714 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834c009420 con 0x7f83580d1290 2023-08-25T04:19:54.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.864+0000 7f8357fff640 1 --2- 172.21.15.55:0/4184840714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83580d1290 0x7f8358153f20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f834800c400 tx=0x7f834800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:54.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.864+0000 7f8354ff9640 1 -- 172.21.15.55:0/4184840714 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83480052d0 con 0x7f83580d1290 2023-08-25T04:19:54.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.864+0000 7f8354ff9640 1 -- 172.21.15.55:0/4184840714 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8348005430 con 0x7f83580d1290 2023-08-25T04:19:54.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.864+0000 7f835e6cb640 1 -- 172.21.15.55:0/4184840714 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8350009b30 con 0x7f83580d1290 2023-08-25T04:19:54.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.864+0000 7f8354ff9640 1 -- 172.21.15.55:0/4184840714 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8348003890 con 0x7f83580d1290 2023-08-25T04:19:54.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.864+0000 7f835e6cb640 1 -- 172.21.15.55:0/4184840714 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83580ce7c0 con 0x7f83580d1290 2023-08-25T04:19:54.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.864+0000 7f835e6cb640 1 -- 172.21.15.55:0/4184840714 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83580b5260 con 0x7f83580d1290 2023-08-25T04:19:54.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.864+0000 7f8354ff9640 1 -- 172.21.15.55:0/4184840714 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 47) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f83480039f0 con 0x7f83580d1290 2023-08-25T04:19:54.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.864+0000 7f8354ff9640 1 --2- 172.21.15.55:0/4184840714 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f83440657f0 0x7f8344067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:54.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.868+0000 7f8354ff9640 1 -- 172.21.15.55:0/4184840714 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f8348082550 con 0x7f83580d1290 2023-08-25T04:19:54.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.868+0000 7f83577fe640 1 -- 172.21.15.55:0/4184840714 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f83440657f0 msgr2=0x7f8344067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/1337211678 2023-08-25T04:19:54.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.868+0000 7f83577fe640 1 --2- 172.21.15.55:0/4184840714 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f83440657f0 0x7f8344067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:19:54.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:54.872+0000 7f8354ff9640 1 -- 172.21.15.55:0/4184840714 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f834804ff70 con 0x7f83580d1290 2023-08-25T04:19:55.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.032+0000 7f835e6cb640 1 -- 172.21.15.55:0/4184840714 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f8358073ec0 con 0x7f83580d1290 2023-08-25T04:19:55.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.040+0000 7f8354ff9640 1 -- 172.21.15.55:0/4184840714 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8348053590 con 0x7f83580d1290 2023-08-25T04:19:55.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.044+0000 7f835e6cb640 1 -- 172.21.15.55:0/4184840714 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f83440657f0 msgr2=0x7f8344067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:19:55.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.044+0000 7f835e6cb640 1 --2- 172.21.15.55:0/4184840714 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f83440657f0 0x7f8344067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.044+0000 7f835e6cb640 1 -- 172.21.15.55:0/4184840714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83580d1290 msgr2=0x7f8358153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:55.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.044+0000 7f835e6cb640 1 --2- 172.21.15.55:0/4184840714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83580d1290 0x7f8358153f20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f834800c400 tx=0x7f834800c8c0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.044+0000 7f835e6cb640 1 -- 172.21.15.55:0/4184840714 shutdown_connections 2023-08-25T04:19:55.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.044+0000 7f835e6cb640 1 --2- 172.21.15.55:0/4184840714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83581601f0 0x7f835815c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.044+0000 7f835e6cb640 1 --2- 172.21.15.55:0/4184840714 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f83440657f0 0x7f8344067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.044+0000 7f835e6cb640 1 --2- 172.21.15.55:0/4184840714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f835815e3c0 0x7f835815c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.044+0000 7f835e6cb640 1 --2- 172.21.15.55:0/4184840714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83580d1290 0x7f8358153f20 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.044+0000 7f835e6cb640 1 -- 172.21.15.55:0/4184840714 >> 172.21.15.55:0/4184840714 conn(0x7f83580d27d0 msgr2=0x7f83580cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:55.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.044+0000 7f835e6cb640 1 -- 172.21.15.55:0/4184840714 shutdown_connections 2023-08-25T04:19:55.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.044+0000 7f835e6cb640 1 -- 172.21.15.55:0/4184840714 wait complete. 2023-08-25T04:19:55.064 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-08-25T04:19:55.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.212+0000 7f75d4f03640 1 Processor -- start 2023-08-25T04:19:55.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.212+0000 7f75d4f03640 1 -- start start 2023-08-25T04:19:55.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.212+0000 7f75d4f03640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f75d01601f0 0x7f75d015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:55.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.212+0000 7f75d4f03640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75d015e3c0 0x7f75d00d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:55.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.212+0000 7f75d4f03640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d015f8b0 con 0x7f75d00d10c0 2023-08-25T04:19:55.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.212+0000 7f75d4f03640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d00cd5a0 con 0x7f75d015e3c0 2023-08-25T04:19:55.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.212+0000 7f75d4f03640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d00cd880 con 0x7f75d01601f0 2023-08-25T04:19:55.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.212+0000 7f75c5d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75d015e3c0 0x7f75d00d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:55.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.212+0000 7f75c5d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75d015e3c0 0x7f75d00d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51940/0 (socket says 172.21.15.55:51940) 2023-08-25T04:19:55.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.212+0000 7f75c5d9b640 1 -- 172.21.15.55:0/869798531 learned_addr learned my addr 172.21.15.55:0/869798531 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:55.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.212+0000 7f75ce59c640 1 --2- 172.21.15.55:0/869798531 >> v2:172.21.15.110:3300/0 conn(0x7f75d01601f0 0x7f75d015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:55.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.212+0000 7f75c5d9b640 1 -- 172.21.15.55:0/869798531 >> v2:172.21.15.110:3300/0 conn(0x7f75d01601f0 msgr2=0x7f75d015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:55.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.212+0000 7f75c5d9b640 1 --2- 172.21.15.55:0/869798531 >> v2:172.21.15.110:3300/0 conn(0x7f75d01601f0 0x7f75d015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.212+0000 7f75c5d9b640 1 -- 172.21.15.55:0/869798531 >> v1:172.21.15.110:6789/0 conn(0x7f75d00d10c0 legacy=0x7f75d00b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:55.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.212+0000 7f75c5d9b640 1 -- 172.21.15.55:0/869798531 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d00cdb60 con 0x7f75d015e3c0 2023-08-25T04:19:55.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.216+0000 7f75c5d9b640 1 --2- 172.21.15.55:0/869798531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d015e3c0 0x7f75d00d0b80 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f75d008b7f0 tx=0x7f75b801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5f8e2e2f61f735 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:55.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.220+0000 7f75cdd9b640 1 -- 172.21.15.55:0/869798531 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b80a5770 con 0x7f75d015e3c0 2023-08-25T04:19:55.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.220+0000 7f75cdd9b640 1 -- 172.21.15.55:0/869798531 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b80a58d0 con 0x7f75d015e3c0 2023-08-25T04:19:55.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.220+0000 7f75cdd9b640 1 -- 172.21.15.55:0/869798531 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b80a5c60 con 0x7f75d015e3c0 2023-08-25T04:19:55.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.220+0000 7f75d4f03640 1 -- 172.21.15.55:0/869798531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d015e3c0 msgr2=0x7f75d00d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:55.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.220+0000 7f75d4f03640 1 --2- 172.21.15.55:0/869798531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d015e3c0 0x7f75d00d0b80 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f75d008b7f0 tx=0x7f75b801c9a0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.220+0000 7f75d4f03640 1 -- 172.21.15.55:0/869798531 shutdown_connections 2023-08-25T04:19:55.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.220+0000 7f75d4f03640 1 --2- 172.21.15.55:0/869798531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d015e3c0 0x7f75d00d0b80 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.220+0000 7f75d4f03640 1 --2- 172.21.15.55:0/869798531 >> v2:172.21.15.110:3300/0 conn(0x7f75d01601f0 0x7f75d015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.220+0000 7f75d4f03640 1 -- 172.21.15.55:0/869798531 >> 172.21.15.55:0/869798531 conn(0x7f75d00d27d0 msgr2=0x7f75d00d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:55.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.220+0000 7f75d4f03640 1 -- 172.21.15.55:0/869798531 shutdown_connections 2023-08-25T04:19:55.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.220+0000 7f75d4f03640 1 -- 172.21.15.55:0/869798531 wait complete. 2023-08-25T04:19:55.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.220+0000 7f75d4f03640 1 Processor -- start 2023-08-25T04:19:55.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.220+0000 7f75d4f03640 1 -- start start 2023-08-25T04:19:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.220+0000 7f75d4f03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75d00d10c0 0x7f75d0150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.220+0000 7f75d4f03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d015e3c0 0x7f75d0149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.220+0000 7f75d4f03640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75d01601f0 0x7f75d006aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:55.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75d4f03640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d00c5e70 con 0x7f75d015e3c0 2023-08-25T04:19:55.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75d4f03640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d014a250 con 0x7f75d01601f0 2023-08-25T04:19:55.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75d4f03640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d00b7810 con 0x7f75d00d10c0 2023-08-25T04:19:55.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75c5d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d015e3c0 0x7f75d0149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:55.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75c5d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d015e3c0 0x7f75d0149aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51952/0 (socket says 172.21.15.55:51952) 2023-08-25T04:19:55.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75c5d9b640 1 -- 172.21.15.55:0/1300501971 learned_addr learned my addr 172.21.15.55:0/1300501971 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:55.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75ce59c640 1 --2- 172.21.15.55:0/1300501971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75d00d10c0 0x7f75d0150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:55.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75ced9d640 1 --2- 172.21.15.55:0/1300501971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75d01601f0 0x7f75d006aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:55.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75c5d9b640 1 -- 172.21.15.55:0/1300501971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75d00d10c0 msgr2=0x7f75d0150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:55.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75c5d9b640 1 --2- 172.21.15.55:0/1300501971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75d00d10c0 0x7f75d0150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75c5d9b640 1 -- 172.21.15.55:0/1300501971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75d01601f0 msgr2=0x7f75d006aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:55.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75c5d9b640 1 --2- 172.21.15.55:0/1300501971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75d01601f0 0x7f75d006aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75c5d9b640 1 -- 172.21.15.55:0/1300501971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b8009b30 con 0x7f75d015e3c0 2023-08-25T04:19:55.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75ce59c640 1 --2- 172.21.15.55:0/1300501971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75d00d10c0 0x7f75d0150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:55.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75c5d9b640 1 --2- 172.21.15.55:0/1300501971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d015e3c0 0x7f75d0149aa0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f75b80af040 tx=0x7f75b8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:55.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75c77fe640 1 -- 172.21.15.55:0/1300501971 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b80b8670 con 0x7f75d015e3c0 2023-08-25T04:19:55.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75c77fe640 1 -- 172.21.15.55:0/1300501971 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b80b87d0 con 0x7f75d015e3c0 2023-08-25T04:19:55.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75c77fe640 1 -- 172.21.15.55:0/1300501971 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b80b8b80 con 0x7f75d015e3c0 2023-08-25T04:19:55.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75d4f03640 1 -- 172.21.15.55:0/1300501971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d00ce7c0 con 0x7f75d015e3c0 2023-08-25T04:19:55.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75d4f03640 1 -- 172.21.15.55:0/1300501971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d00b7dd0 con 0x7f75d015e3c0 2023-08-25T04:19:55.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.224+0000 7f75d4f03640 1 -- 172.21.15.55:0/1300501971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d00b5260 con 0x7f75d015e3c0 2023-08-25T04:19:55.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.228+0000 7f75c77fe640 1 -- 172.21.15.55:0/1300501971 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f75b80b8ce0 con 0x7f75d015e3c0 2023-08-25T04:19:55.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.228+0000 7f75c77fe640 1 --2- 172.21.15.55:0/1300501971 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f75b0065820 0x7f75b0067ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:55.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.228+0000 7f75c77fe640 1 -- 172.21.15.55:0/1300501971 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6105+0+0 (secure 0 0 0) 0x7f75b811df30 con 0x7f75d015e3c0 2023-08-25T04:19:55.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.228+0000 7f75ce59c640 1 -- 172.21.15.55:0/1300501971 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f75b0065820 msgr2=0x7f75b0067ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/1337211678 2023-08-25T04:19:55.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.228+0000 7f75ce59c640 1 --2- 172.21.15.55:0/1300501971 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f75b0065820 0x7f75b0067ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:19:55.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.232+0000 7f75c77fe640 1 -- 172.21.15.55:0/1300501971 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f75b80eb9f0 con 0x7f75d015e3c0 2023-08-25T04:19:55.268 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:55.264+0000 7f6ba4246180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:19:55.306 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:55.304+0000 7fba61a17180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:19:55.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.392+0000 7f75d4f03640 1 -- 172.21.15.55:0/1300501971 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f75d00b7fc0 con 0x7f75d015e3c0 2023-08-25T04:19:55.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.400+0000 7f75c77fe640 1 -- 172.21.15.55:0/1300501971 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v36)=0 v36) v1 ==== 133+0+0 (secure 0 0 0) 0x7f75b80bc0c0 con 0x7f75d015e3c0 2023-08-25T04:19:55.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.400+0000 7f75d4f03640 1 -- 172.21.15.55:0/1300501971 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f75b0065820 msgr2=0x7f75b0067ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:19:55.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.400+0000 7f75d4f03640 1 --2- 172.21.15.55:0/1300501971 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f75b0065820 0x7f75b0067ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.400+0000 7f75d4f03640 1 -- 172.21.15.55:0/1300501971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d015e3c0 msgr2=0x7f75d0149aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:55.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.400+0000 7f75d4f03640 1 --2- 172.21.15.55:0/1300501971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d015e3c0 0x7f75d0149aa0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f75b80af040 tx=0x7f75b8019740 comp rx=0 tx=0).stop 2023-08-25T04:19:55.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.400+0000 7f75d4f03640 1 -- 172.21.15.55:0/1300501971 shutdown_connections 2023-08-25T04:19:55.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.400+0000 7f75d4f03640 1 --2- 172.21.15.55:0/1300501971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75d01601f0 0x7f75d006aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.400+0000 7f75d4f03640 1 --2- 172.21.15.55:0/1300501971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75d015e3c0 0x7f75d0149aa0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.400+0000 7f75d4f03640 1 --2- 172.21.15.55:0/1300501971 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7f75b0065820 0x7f75b0067ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.400+0000 7f75d4f03640 1 --2- 172.21.15.55:0/1300501971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75d00d10c0 0x7f75d0150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.400+0000 7f75d4f03640 1 -- 172.21.15.55:0/1300501971 >> 172.21.15.55:0/1300501971 conn(0x7f75d00d27d0 msgr2=0x7f75d00b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:55.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.400+0000 7f75d4f03640 1 -- 172.21.15.55:0/1300501971 shutdown_connections 2023-08-25T04:19:55.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.400+0000 7f75d4f03640 1 -- 172.21.15.55:0/1300501971 wait complete. 2023-08-25T04:19:55.421 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:55.420+0000 7f6ba4246180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:19:55.423 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /bad-path 1M 2023-08-25T04:19:55.468 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:55.468+0000 7fba61a17180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:19:55.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.572+0000 7fa54c1a3640 1 Processor -- start 2023-08-25T04:19:55.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.572+0000 7fa54c1a3640 1 -- start start 2023-08-25T04:19:55.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.572+0000 7fa54c1a3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa5440cf7b0 0x7fa5440b6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:55.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.572+0000 7fa54c1a3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5440d1970 con 0x7fa54415cb40 2023-08-25T04:19:55.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.572+0000 7fa54c1a3640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5440d2790 con 0x7fa5440cf340 2023-08-25T04:19:55.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.572+0000 7fa54c1a3640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5440d0d80 con 0x7fa5440cf7b0 2023-08-25T04:19:55.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.572+0000 7fa549f3f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa54415cb40 0x7fa5440d2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50180/0 (socket says 172.21.15.55:50180) 2023-08-25T04:19:55.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.572+0000 7fa549f3f640 1 -- 172.21.15.55:0/3876559458 learned_addr learned my addr 172.21.15.55:0/3876559458 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:19:55.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.572+0000 7fa54a740640 1 --2- 172.21.15.55:0/3876559458 >> v2:172.21.15.110:3300/0 conn(0x7fa5440cf7b0 0x7fa5440b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:55.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.572+0000 7fa548f3d640 1 -- 172.21.15.55:0/3876559458 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030493982 0 0) 0x7fa5440d1970 con 0x7fa54415cb40 2023-08-25T04:19:55.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.572+0000 7fa548f3d640 1 -- 172.21.15.55:0/3876559458 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa530003530 con 0x7fa54415cb40 2023-08-25T04:19:55.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.572+0000 7fa54a740640 1 -- 172.21.15.55:0/3876559458 >> v1:172.21.15.110:6789/0 conn(0x7fa5440cf340 legacy=0x7fa5440b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:55.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.572+0000 7fa54a740640 1 -- 172.21.15.55:0/3876559458 >> v1:172.21.15.55:6789/0 conn(0x7fa54415cb40 legacy=0x7fa5440d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:55.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.572+0000 7fa54a740640 1 -- 172.21.15.55:0/3876559458 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5440d1040 con 0x7fa5440cf7b0 2023-08-25T04:19:55.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.576+0000 7fa54a740640 1 --2- 172.21.15.55:0/3876559458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5440cf7b0 0x7fa5440b6100 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009d90 tx=0x7fa53c01f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fbd4cdd8b104192 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:55.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.576+0000 7fa548f3d640 1 -- 172.21.15.55:0/3876559458 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c0af600 con 0x7fa5440cf7b0 2023-08-25T04:19:55.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.576+0000 7fa548f3d640 1 -- 172.21.15.55:0/3876559458 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c0ab050 con 0x7fa5440cf7b0 2023-08-25T04:19:55.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.576+0000 7fa548f3d640 1 -- 172.21.15.55:0/3876559458 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c0af980 con 0x7fa5440cf7b0 2023-08-25T04:19:55.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.576+0000 7fa54c1a3640 1 -- 172.21.15.55:0/3876559458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5440cf7b0 msgr2=0x7fa5440b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:55.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.576+0000 7fa54c1a3640 1 --2- 172.21.15.55:0/3876559458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5440cf7b0 0x7fa5440b6100 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009d90 tx=0x7fa53c01f130 comp rx=0 tx=0).stop 2023-08-25T04:19:55.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.576+0000 7fa54c1a3640 1 -- 172.21.15.55:0/3876559458 shutdown_connections 2023-08-25T04:19:55.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.576+0000 7fa54c1a3640 1 --2- 172.21.15.55:0/3876559458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5440cf7b0 0x7fa5440b6100 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.576+0000 7fa54c1a3640 1 -- 172.21.15.55:0/3876559458 >> 172.21.15.55:0/3876559458 conn(0x7fa54406aae0 msgr2=0x7fa54406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:55.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.576+0000 7fa54c1a3640 1 -- 172.21.15.55:0/3876559458 shutdown_connections 2023-08-25T04:19:55.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.576+0000 7fa54c1a3640 1 -- 172.21.15.55:0/3876559458 wait complete. 2023-08-25T04:19:55.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54c1a3640 1 Processor -- start 2023-08-25T04:19:55.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54c1a3640 1 -- start start 2023-08-25T04:19:55.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54c1a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5440cf340 0x7fa544152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:55.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54c1a3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5440cf7b0 0x7fa54415e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:55.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54c1a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa54415cb40 0x7fa5440b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:55.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54c1a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5440c6470 con 0x7fa54415cb40 2023-08-25T04:19:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54c1a3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54415ecf0 con 0x7fa5440cf7b0 2023-08-25T04:19:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54c1a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54415efd0 con 0x7fa5440cf340 2023-08-25T04:19:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54a740640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa54415cb40 0x7fa5440b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54a740640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa54415cb40 0x7fa5440b21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51956/0 (socket says 172.21.15.55:51956) 2023-08-25T04:19:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54a740640 1 -- 172.21.15.55:0/484151919 learned_addr learned my addr 172.21.15.55:0/484151919 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54973e640 1 --2- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5440cf7b0 0x7fa54415e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:55.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa549f3f640 1 --2- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5440cf340 0x7fa544152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:55.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54a740640 1 -- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5440cf340 msgr2=0x7fa544152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:55.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54a740640 1 --2- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa5440cf340 0x7fa544152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54a740640 1 -- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5440cf7b0 msgr2=0x7fa54415e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:55.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54a740640 1 --2- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5440cf7b0 0x7fa54415e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:55.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54a740640 1 -- 172.21.15.55:0/484151919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c009a70 con 0x7fa54415cb40 2023-08-25T04:19:55.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54973e640 1 --2- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5440cf7b0 0x7fa54415e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:55.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.580+0000 7fa54a740640 1 --2- 172.21.15.55:0/484151919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa54415cb40 0x7fa5440b21a0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0b2040 tx=0x7fa53c01bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:55.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.584+0000 7fa53a7fc640 1 -- 172.21.15.55:0/484151919 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c009450 con 0x7fa54415cb40 2023-08-25T04:19:55.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.584+0000 7fa53a7fc640 1 -- 172.21.15.55:0/484151919 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c0b9410 con 0x7fa54415cb40 2023-08-25T04:19:55.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.584+0000 7fa53a7fc640 1 -- 172.21.15.55:0/484151919 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c0b97c0 con 0x7fa54415cb40 2023-08-25T04:19:55.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.584+0000 7fa54c1a3640 1 -- 172.21.15.55:0/484151919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54415f2b0 con 0x7fa54415cb40 2023-08-25T04:19:55.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.584+0000 7fa54c1a3640 1 -- 172.21.15.55:0/484151919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54415e8c0 con 0x7fa54415cb40 2023-08-25T04:19:55.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.584+0000 7fa54c1a3640 1 -- 172.21.15.55:0/484151919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa544071f80 con 0x7fa54415cb40 2023-08-25T04:19:55.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.584+0000 7fa53a7fc640 1 -- 172.21.15.55:0/484151919 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 47) v1 ==== 85081+0+0 (secure 0 0 0) 0x7fa53c0b6050 con 0x7fa54415cb40 2023-08-25T04:19:55.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.584+0000 7fa53a7fc640 1 --2- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fa5280657f0 0x7fa528067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:55.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.584+0000 7fa53a7fc640 1 -- 172.21.15.55:0/484151919 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6105+0+0 (secure 0 0 0) 0x7fa53c121e50 con 0x7fa54415cb40 2023-08-25T04:19:55.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.584+0000 7fa549f3f640 1 -- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fa5280657f0 msgr2=0x7fa528067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/1337211678 2023-08-25T04:19:55.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.584+0000 7fa549f3f640 1 --2- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fa5280657f0 0x7fa528067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:19:55.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.588+0000 7fa53a7fc640 1 -- 172.21.15.55:0/484151919 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa53c0ef8e0 con 0x7fa54415cb40 2023-08-25T04:19:55.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.768+0000 7fa54c1a3640 1 -- 172.21.15.55:0/484151919 --> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5440d1600 con 0x7fa5280657f0 2023-08-25T04:19:55.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.788+0000 7fa549f3f640 1 -- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fa5280657f0 msgr2=0x7fa528067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/1337211678 2023-08-25T04:19:55.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:55.788+0000 7fa549f3f640 1 --2- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fa5280657f0 0x7fa528067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-25T04:19:55.964 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:55.960+0000 7f6ba4246180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:19:56.019 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:56.016+0000 7fba61a17180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:19:56.025 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:56.020+0000 7f6ba4246180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:19:56.078 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:56.076+0000 7f6ba4246180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:19:56.080 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:56.080+0000 7fba61a17180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:19:56.139 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:56.140+0000 7fba61a17180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:19:56.164 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:56.160+0000 7f6ba4246180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:19:56.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:56.192+0000 7fa549f3f640 1 -- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fa5280657f0 msgr2=0x7fa528067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/1337211678 2023-08-25T04:19:56.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:56.192+0000 7fa549f3f640 1 --2- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fa5280657f0 0x7fa528067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-25T04:19:56.221 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:56.216+0000 7f6ba4246180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:19:56.241 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:56.228+0000 7fba61a17180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:19:56.289 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:56.288+0000 7fba61a17180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:19:56.303 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:56.300+0000 7f6ba4246180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:19:56.359 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:56.356+0000 7f6ba4246180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:19:56.377 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:56.376+0000 7fba61a17180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:19:56.436 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:56.436+0000 7fba61a17180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:19:56.501 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:56.496+0000 7f6ba4246180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:19:56.558 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:56.556+0000 7f6ba4246180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:19:56.587 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:56.584+0000 7fba61a17180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:19:56.648 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:56.648+0000 7fba61a17180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:19:56.796 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:19:56.796 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:19:56.796 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:19:56.804 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:56.800+0000 7f6ba4246180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:19:56.899 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:19:56.900 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:19:56.900 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:19:56.908 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:56.908+0000 7fba61a17180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:19:56.940 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:56.936+0000 7f6ba4246180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:19:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:56.996+0000 7fa549f3f640 1 -- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fa5280657f0 msgr2=0x7fa528067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/1337211678 2023-08-25T04:19:56.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:56.996+0000 7fa549f3f640 1 --2- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fa5280657f0 0x7fa528067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-25T04:19:57.051 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:57.048+0000 7fba61a17180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:19:57.065 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:57.060+0000 7f6ba4246180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:19:57.135 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:57.132+0000 7f6ba4246180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:19:57.182 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:57.180+0000 7fba61a17180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:19:57.256 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:57.256+0000 7fba61a17180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:19:57.268 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:57.264+0000 7f6ba4246180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:19:57.399 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:57.396+0000 7fba61a17180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:19:57.805 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:57.804+0000 7f6ba4246180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:19:57.890 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:57.888+0000 7f6ba4246180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:19:57.974 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:57.972+0000 7fba61a17180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:19:58.039 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:58.036+0000 7f6ba4246180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:19:58.063 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:58.064+0000 7fba61a17180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:19:58.122 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:58.120+0000 7f6ba4246180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:19:58.220 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:58.220+0000 7fba61a17180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:19:58.308 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:58.308+0000 7fba61a17180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:19:58.436 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:58.432+0000 7f6ba4246180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:19:58.498 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:58.492+0000 7f6ba4246180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:19:58.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:58.508+0000 7fa53a7fc640 1 -- 172.21.15.55:0/484151919 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 48) v1 ==== 84690+0+0 (secure 0 0 0) 0x7fa53c0efcb0 con 0x7fa54415cb40 2023-08-25T04:19:58.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:58.508+0000 7fa53a7fc640 1 -- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fa5280657f0 msgr2=0x7fa528067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:19:58.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:58.508+0000 7fa53a7fc640 1 --2- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:6832/1337211678,v1:172.21.15.110:6833/1337211678] conn(0x7fa5280657f0 0x7fa528067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:58.623 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:58.620+0000 7f6b265b8640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:58.623 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:58.620+0000 7f6b265b8640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:58.623 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:58.620+0000 7f6b265b8640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:58.623 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:58.620+0000 7f6b265b8640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:58.623 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:58.620+0000 7f6b265b8640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:58.624 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:58.620+0000 7f6b295be640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:58.624 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:58.620+0000 7f6b295be640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:58.624 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:58.620+0000 7f6b295be640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:58.624 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:58.620+0000 7f6b295be640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:58.624 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:19:58.620+0000 7f6b295be640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:19:58.658 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:58.656+0000 7fba61a17180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:19:58.722 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:19:58.720+0000 7fba61a17180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:19:59.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.512+0000 7fa53a7fc640 1 -- 172.21.15.55:0/484151919 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 49) v1 ==== 84817+0+0 (secure 0 0 0) 0x7fa53c111140 con 0x7fa54415cb40 2023-08-25T04:19:59.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.512+0000 7fa53a7fc640 1 --2- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7fa528033910 0x7fa52806fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:59.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.512+0000 7fa53a7fc640 1 -- 172.21.15.55:0/484151919 --> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa528033cf0 con 0x7fa528033910 2023-08-25T04:19:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.512+0000 7fa549f3f640 1 --2- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7fa528033910 0x7fa52806fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.520+0000 7fa549f3f640 1 --2- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7fa528033910 0x7fa52806fd90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa5400011f0 tx=0x7fa540007d40 comp rx=0 tx=0).ready entity=mgr.7573 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:59.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.580+0000 7fa53a7fc640 1 -- 172.21.15.55:0/484151919 <== mgr.7573 v2:172.21.15.110:6832/4020134262 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fa528033cf0 con 0x7fa528033910 2023-08-25T04:19:59.582 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /bad-path 2023-08-25T04:19:59.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.584+0000 7fa54c1a3640 1 -- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7fa528033910 msgr2=0x7fa52806fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:59.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.584+0000 7fa54c1a3640 1 --2- 172.21.15.55:0/484151919 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7fa528033910 0x7fa52806fd90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa5400011f0 tx=0x7fa540007d40 comp rx=0 tx=0).stop 2023-08-25T04:19:59.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.584+0000 7fa54c1a3640 1 -- 172.21.15.55:0/484151919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa54415cb40 msgr2=0x7fa5440b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:59.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.584+0000 7fa54c1a3640 1 --2- 172.21.15.55:0/484151919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa54415cb40 0x7fa5440b21a0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fa53c0b2040 tx=0x7fa53c01bed0 comp rx=0 tx=0).stop 2023-08-25T04:19:59.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.584+0000 7fa54a740640 1 -- 172.21.15.55:0/484151919 reap_dead start 2023-08-25T04:19:59.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.584+0000 7fa54c1a3640 1 -- 172.21.15.55:0/484151919 shutdown_connections 2023-08-25T04:19:59.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.584+0000 7fa54c1a3640 1 -- 172.21.15.55:0/484151919 >> 172.21.15.55:0/484151919 conn(0x7fa54406aae0 msgr2=0x7fa5440c5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:59.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.584+0000 7fa54c1a3640 1 -- 172.21.15.55:0/484151919 shutdown_connections 2023-08-25T04:19:59.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.584+0000 7fa54c1a3640 1 -- 172.21.15.55:0/484151919 wait complete. 2023-08-25T04:19:59.605 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /bad-path 2023-08-25T04:19:59.606 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-08-25T04:19:59.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.800+0000 7fcdad303640 1 Processor -- start 2023-08-25T04:19:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.800+0000 7fcdad303640 1 -- start start 2023-08-25T04:19:59.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.800+0000 7fcdad303640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcda8159d00 0x7fcda80cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.800+0000 7fcdad303640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcda806fb50 0x7fcda80c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.800+0000 7fcdad303640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcda80cc930 0x7fcda80ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:59.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.800+0000 7fcdad303640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda80cc510 con 0x7fcda80cc930 2023-08-25T04:19:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.800+0000 7fcdad303640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda80ce220 con 0x7fcda806fb50 2023-08-25T04:19:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.800+0000 7fcdad303640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda80ca6c0 con 0x7fcda8159d00 2023-08-25T04:19:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.800+0000 7fcda77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcda80cc930 0x7fcda80ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:59.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.800+0000 7fcda77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcda80cc930 0x7fcda80ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51964/0 (socket says 172.21.15.55:51964) 2023-08-25T04:19:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.800+0000 7fcda77fe640 1 -- 172.21.15.55:0/2039251122 learned_addr learned my addr 172.21.15.55:0/2039251122 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.800+0000 7fcda6ffd640 1 --2- 172.21.15.55:0/2039251122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcda8159d00 0x7fcda80cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.800+0000 7fcd9ffff640 1 --2- 172.21.15.55:0/2039251122 >> v2:172.21.15.110:3300/0 conn(0x7fcda806fb50 0x7fcda80c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:59.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.800+0000 7fcda77fe640 1 -- 172.21.15.55:0/2039251122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcda8159d00 msgr2=0x7fcda80cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:59.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.800+0000 7fcda77fe640 1 --2- 172.21.15.55:0/2039251122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcda8159d00 0x7fcda80cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:59.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.804+0000 7fcda77fe640 1 -- 172.21.15.55:0/2039251122 >> v2:172.21.15.110:3300/0 conn(0x7fcda806fb50 msgr2=0x7fcda80c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:19:59.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.804+0000 7fcda77fe640 1 --2- 172.21.15.55:0/2039251122 >> v2:172.21.15.110:3300/0 conn(0x7fcda806fb50 0x7fcda80c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:59.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.804+0000 7fcda77fe640 1 -- 172.21.15.55:0/2039251122 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda80ca9a0 con 0x7fcda80cc930 2023-08-25T04:19:59.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.804+0000 7fcd9ffff640 1 --2- 172.21.15.55:0/2039251122 >> v2:172.21.15.110:3300/0 conn(0x7fcda806fb50 0x7fcda80c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:19:59.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.804+0000 7fcda6ffd640 1 --2- 172.21.15.55:0/2039251122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcda8159d00 0x7fcda80cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:19:59.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.804+0000 7fcda77fe640 1 --2- 172.21.15.55:0/2039251122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda80cc930 0x7fcda80ccda0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fcda80b1100 tx=0x7fcda001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c51f3e7bf80a82d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:59.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.804+0000 7fcda67fc640 1 -- 172.21.15.55:0/2039251122 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda00a57b0 con 0x7fcda80cc930 2023-08-25T04:19:59.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.804+0000 7fcda67fc640 1 -- 172.21.15.55:0/2039251122 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda00a5910 con 0x7fcda80cc930 2023-08-25T04:19:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.804+0000 7fcda67fc640 1 -- 172.21.15.55:0/2039251122 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda00a5ca0 con 0x7fcda80cc930 2023-08-25T04:19:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.804+0000 7fcdad303640 1 -- 172.21.15.55:0/2039251122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda80cc930 msgr2=0x7fcda80ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.804+0000 7fcdad303640 1 --2- 172.21.15.55:0/2039251122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda80cc930 0x7fcda80ccda0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fcda80b1100 tx=0x7fcda001c910 comp rx=0 tx=0).stop 2023-08-25T04:19:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.804+0000 7fcdad303640 1 -- 172.21.15.55:0/2039251122 shutdown_connections 2023-08-25T04:19:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.804+0000 7fcdad303640 1 --2- 172.21.15.55:0/2039251122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda80cc930 0x7fcda80ccda0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.804+0000 7fcdad303640 1 --2- 172.21.15.55:0/2039251122 >> v2:172.21.15.110:3300/0 conn(0x7fcda806fb50 0x7fcda80c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.804+0000 7fcdad303640 1 --2- 172.21.15.55:0/2039251122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcda8159d00 0x7fcda80cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.804+0000 7fcdad303640 1 -- 172.21.15.55:0/2039251122 >> 172.21.15.55:0/2039251122 conn(0x7fcda80caf90 msgr2=0x7fcda80cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:19:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.804+0000 7fcdad303640 1 -- 172.21.15.55:0/2039251122 shutdown_connections 2023-08-25T04:19:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.804+0000 7fcdad303640 1 -- 172.21.15.55:0/2039251122 wait complete. 2023-08-25T04:19:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcdad303640 1 Processor -- start 2023-08-25T04:19:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcdad303640 1 -- start start 2023-08-25T04:19:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcdad303640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcda806fb50 0x7fcda80b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcdad303640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda80cc930 0x7fcda8154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcdad303640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcda8159d00 0x7fcda8152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcdad303640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda8154e40 con 0x7fcda80cc930 2023-08-25T04:19:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcdad303640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda81550e0 con 0x7fcda806fb50 2023-08-25T04:19:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcdad303640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda81553c0 con 0x7fcda8159d00 2023-08-25T04:19:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcd9ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda80cc930 0x7fcda8154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcd9ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda80cc930 0x7fcda8154900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51980/0 (socket says 172.21.15.55:51980) 2023-08-25T04:19:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcd9ffff640 1 -- 172.21.15.55:0/3262757359 learned_addr learned my addr 172.21.15.55:0/3262757359 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:19:59.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcda77fe640 1 --2- 172.21.15.55:0/3262757359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcda8159d00 0x7fcda8152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:59.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcda6ffd640 1 --2- 172.21.15.55:0/3262757359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcda806fb50 0x7fcda80b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:59.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcda77fe640 1 -- 172.21.15.55:0/3262757359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcda806fb50 msgr2=0x7fcda80b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:59.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcda77fe640 1 --2- 172.21.15.55:0/3262757359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcda806fb50 0x7fcda80b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:59.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcda77fe640 1 -- 172.21.15.55:0/3262757359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda80cc930 msgr2=0x7fcda8154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:19:59.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcda77fe640 1 --2- 172.21.15.55:0/3262757359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda80cc930 0x7fcda8154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:19:59.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcda77fe640 1 -- 172.21.15.55:0/3262757359 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda0009b30 con 0x7fcda8159d00 2023-08-25T04:19:59.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcd9ffff640 1 --2- 172.21.15.55:0/3262757359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda80cc930 0x7fcda8154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:19:59.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcda77fe640 1 --2- 172.21.15.55:0/3262757359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcda8159d00 0x7fcda8152d80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcda00ab000 tx=0x7fcda00196b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:59.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcd9f7fe640 1 -- 172.21.15.55:0/3262757359 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda00b8470 con 0x7fcda8159d00 2023-08-25T04:19:59.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcd9f7fe640 1 -- 172.21.15.55:0/3262757359 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda00b85f0 con 0x7fcda8159d00 2023-08-25T04:19:59.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcd9f7fe640 1 -- 172.21.15.55:0/3262757359 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda00b89a0 con 0x7fcda8159d00 2023-08-25T04:19:59.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.808+0000 7fcdad303640 1 -- 172.21.15.55:0/3262757359 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda81556a0 con 0x7fcda8159d00 2023-08-25T04:19:59.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.812+0000 7fcdad303640 1 -- 172.21.15.55:0/3262757359 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda81532c0 con 0x7fcda8159d00 2023-08-25T04:19:59.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.812+0000 7fcdad303640 1 -- 172.21.15.55:0/3262757359 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda8155ea0 con 0x7fcda8159d00 2023-08-25T04:19:59.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.812+0000 7fcd9f7fe640 1 -- 172.21.15.55:0/3262757359 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 49) v1 ==== 84817+0+0 (secure 0 0 0) 0x7fcda00b8b00 con 0x7fcda8159d00 2023-08-25T04:19:59.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.812+0000 7fcd9f7fe640 1 --2- 172.21.15.55:0/3262757359 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7fcd88065520 0x7fcd880679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:19:59.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.812+0000 7fcd9f7fe640 1 -- 172.21.15.55:0/3262757359 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6449+0+0 (secure 0 0 0) 0x7fcda011db50 con 0x7fcda8159d00 2023-08-25T04:19:59.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.812+0000 7fcda6ffd640 1 --2- 172.21.15.55:0/3262757359 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7fcd88065520 0x7fcd880679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:19:59.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.812+0000 7fcda6ffd640 1 --2- 172.21.15.55:0/3262757359 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7fcd88065520 0x7fcd880679e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcda8166510 tx=0x7fcd98008040 comp rx=0 tx=0).ready entity=mgr.7573 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:19:59.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.816+0000 7fcd9f7fe640 1 -- 172.21.15.55:0/3262757359 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fcda00eb7a0 con 0x7fcda8159d00 2023-08-25T04:19:59.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:19:59.992+0000 7fcdad303640 1 -- 172.21.15.55:0/3262757359 --> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcda80cd770 con 0x7fcd88065520 2023-08-25T04:19:59.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:20:00.000+0000 7fcd9f7fe640 1 -- 172.21.15.55:0/3262757359 <== mgr.7573 v2:172.21.15.110:6832/4020134262 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+287 (secure 0 0 0) 0x7fcd9800c040 con 0x7fcd88065520 2023-08-25T04:19:59.999 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:19:59.999 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:19:59", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-08-25T04:20:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:20:00.000+0000 7fcdad303640 1 -- 172.21.15.55:0/3262757359 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7fcd88065520 msgr2=0x7fcd880679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:20:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:20:00.000+0000 7fcdad303640 1 --2- 172.21.15.55:0/3262757359 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7fcd88065520 0x7fcd880679e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcda8166510 tx=0x7fcd98008040 comp rx=0 tx=0).stop 2023-08-25T04:20:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:20:00.000+0000 7fcdad303640 1 -- 172.21.15.55:0/3262757359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcda8159d00 msgr2=0x7fcda8152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:20:00.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:20:00.000+0000 7fcdad303640 1 --2- 172.21.15.55:0/3262757359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcda8159d00 0x7fcda8152d80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fcda00ab000 tx=0x7fcda00196b0 comp rx=0 tx=0).stop 2023-08-25T04:20:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:20:00.000+0000 7fcdad303640 1 -- 172.21.15.55:0/3262757359 shutdown_connections 2023-08-25T04:20:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:20:00.000+0000 7fcdad303640 1 --2- 172.21.15.55:0/3262757359 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7fcd88065520 0x7fcd880679e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:20:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:20:00.000+0000 7fcdad303640 1 --2- 172.21.15.55:0/3262757359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcda8159d00 0x7fcda8152d80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:20:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:20:00.000+0000 7fcdad303640 1 --2- 172.21.15.55:0/3262757359 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcda80cc930 0x7fcda8154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:20:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:20:00.000+0000 7fcdad303640 1 --2- 172.21.15.55:0/3262757359 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcda806fb50 0x7fcda80b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:20:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:20:00.000+0000 7fcdad303640 1 -- 172.21.15.55:0/3262757359 >> 172.21.15.55:0/3262757359 conn(0x7fcda80caf90 msgr2=0x7fcda80cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:20:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:20:00.000+0000 7fcdad303640 1 -- 172.21.15.55:0/3262757359 shutdown_connections 2023-08-25T04:20:00.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:20:00.000+0000 7fcdad303640 1 -- 172.21.15.55:0/3262757359 wait complete. 2023-08-25T04:20:00.020 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:19:59", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-08-25T04:20:00.470 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:20:00.474 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:20:00.593 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:20:00.592+0000 7f6b18d9d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:20:00.593 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:20:00.592+0000 7f6b18d9d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:20:00.593 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:20:00.592+0000 7f6b18d9d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:20:00.594 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:20:00.592+0000 7f6b18d9d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:20:00.594 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:20:00.592+0000 7f6b18d9d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:20:30.526 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:20:30.531 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:21:00.022 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-08-25T04:21:00.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.183+0000 7f549c45f640 1 Processor -- start 2023-08-25T04:21:00.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.183+0000 7f549c45f640 1 -- start start 2023-08-25T04:21:00.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.187+0000 7f549c45f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f549415c8e0 0x7f54940cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:00.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.187+0000 7f549c45f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f549406ea10 0x7f54940cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:00.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.187+0000 7f549c45f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54940cdcd0 con 0x7f54940cd8a0 2023-08-25T04:21:00.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.187+0000 7f549c45f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54940c4d50 con 0x7f549415c8e0 2023-08-25T04:21:00.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.187+0000 7f549c45f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549406eea0 con 0x7f549406ea10 2023-08-25T04:21:00.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.187+0000 7f549a1fb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f549415c8e0 0x7f54940cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:00.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.187+0000 7f549a1fb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f549415c8e0 0x7f54940cc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51580/0 (socket says 172.21.15.55:51580) 2023-08-25T04:21:00.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.187+0000 7f549a1fb640 1 -- 172.21.15.55:0/1209774063 learned_addr learned my addr 172.21.15.55:0/1209774063 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:00.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.187+0000 7f54999fa640 1 --2- 172.21.15.55:0/1209774063 >> v2:172.21.15.110:3300/0 conn(0x7f549406ea10 0x7f54940cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:00.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.187+0000 7f549a1fb640 1 -- 172.21.15.55:0/1209774063 >> v2:172.21.15.110:3300/0 conn(0x7f549406ea10 msgr2=0x7f54940cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:00.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.187+0000 7f549a1fb640 1 --2- 172.21.15.55:0/1209774063 >> v2:172.21.15.110:3300/0 conn(0x7f549406ea10 0x7f54940cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.187+0000 7f549a1fb640 1 -- 172.21.15.55:0/1209774063 >> v1:172.21.15.110:6789/0 conn(0x7f54940cd8a0 legacy=0x7f54941604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:00.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.187+0000 7f549a1fb640 1 -- 172.21.15.55:0/1209774063 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54940c4f40 con 0x7f549415c8e0 2023-08-25T04:21:00.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.187+0000 7f549a1fb640 1 --2- 172.21.15.55:0/1209774063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549415c8e0 0x7f54940cc8e0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f54940cec70 tx=0x7f549001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e18ff1eddcd555 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:00.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f54991f9640 1 -- 172.21.15.55:0/1209774063 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54900ab670 con 0x7f549415c8e0 2023-08-25T04:21:00.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f54991f9640 1 -- 172.21.15.55:0/1209774063 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54900ab7d0 con 0x7f549415c8e0 2023-08-25T04:21:00.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f54991f9640 1 -- 172.21.15.55:0/1209774063 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54900abb60 con 0x7f549415c8e0 2023-08-25T04:21:00.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549c45f640 1 -- 172.21.15.55:0/1209774063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549415c8e0 msgr2=0x7f54940cc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:00.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549c45f640 1 --2- 172.21.15.55:0/1209774063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549415c8e0 0x7f54940cc8e0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f54940cec70 tx=0x7f549001c470 comp rx=0 tx=0).stop 2023-08-25T04:21:00.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549c45f640 1 -- 172.21.15.55:0/1209774063 shutdown_connections 2023-08-25T04:21:00.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549c45f640 1 --2- 172.21.15.55:0/1209774063 >> v2:172.21.15.110:3300/0 conn(0x7f549406ea10 0x7f54940cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549c45f640 1 --2- 172.21.15.55:0/1209774063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549415c8e0 0x7f54940cc8e0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549c45f640 1 -- 172.21.15.55:0/1209774063 >> 172.21.15.55:0/1209774063 conn(0x7f54940cb790 msgr2=0x7f54940cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:00.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549c45f640 1 -- 172.21.15.55:0/1209774063 shutdown_connections 2023-08-25T04:21:00.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549c45f640 1 -- 172.21.15.55:0/1209774063 wait complete. 2023-08-25T04:21:00.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549c45f640 1 Processor -- start 2023-08-25T04:21:00.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549c45f640 1 -- start start 2023-08-25T04:21:00.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549c45f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f549406ea10 0x7f5494145660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:00.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549c45f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54940cd8a0 0x7f549415f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:00.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549c45f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549415c8e0 0x7f5494153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:00.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549c45f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54940b46b0 con 0x7f549415c8e0 2023-08-25T04:21:00.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549c45f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549415eac0 con 0x7f54940cd8a0 2023-08-25T04:21:00.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549c45f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549415eda0 con 0x7f549406ea10 2023-08-25T04:21:00.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549a9fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549415c8e0 0x7f5494153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:00.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549a1fb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f549406ea10 0x7f5494145660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:00.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f549a9fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549415c8e0 0x7f5494153660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51594/0 (socket says 172.21.15.55:51594) 2023-08-25T04:21:00.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.191+0000 7f54999fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54940cd8a0 0x7f549415f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:00.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.195+0000 7f549a9fc640 1 -- 172.21.15.55:0/740132146 learned_addr learned my addr 172.21.15.55:0/740132146 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:00.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.195+0000 7f549a9fc640 1 -- 172.21.15.55:0/740132146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f549406ea10 msgr2=0x7f5494145660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:00.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.195+0000 7f549a9fc640 1 --2- 172.21.15.55:0/740132146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f549406ea10 0x7f5494145660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.195+0000 7f549a9fc640 1 -- 172.21.15.55:0/740132146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54940cd8a0 msgr2=0x7f549415f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:00.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.195+0000 7f549a9fc640 1 --2- 172.21.15.55:0/740132146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54940cd8a0 0x7f549415f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.195+0000 7f549a9fc640 1 -- 172.21.15.55:0/740132146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54900094d0 con 0x7f549415c8e0 2023-08-25T04:21:00.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.195+0000 7f549a9fc640 1 --2- 172.21.15.55:0/740132146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549415c8e0 0x7f5494153660 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f548c00b970 tx=0x7f548c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:00.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.195+0000 7f548affd640 1 -- 172.21.15.55:0/740132146 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c00cb40 con 0x7f549415c8e0 2023-08-25T04:21:00.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.195+0000 7f548affd640 1 -- 172.21.15.55:0/740132146 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c00cca0 con 0x7f549415c8e0 2023-08-25T04:21:00.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.195+0000 7f548affd640 1 -- 172.21.15.55:0/740132146 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c014680 con 0x7f549415c8e0 2023-08-25T04:21:00.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.195+0000 7f549c45f640 1 -- 172.21.15.55:0/740132146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f549415f080 con 0x7f549415c8e0 2023-08-25T04:21:00.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.195+0000 7f549c45f640 1 -- 172.21.15.55:0/740132146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549415e7b0 con 0x7f549415c8e0 2023-08-25T04:21:00.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.195+0000 7f549c45f640 1 -- 172.21.15.55:0/740132146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f549415f270 con 0x7f549415c8e0 2023-08-25T04:21:00.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.195+0000 7f548affd640 1 -- 172.21.15.55:0/740132146 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 51) v1 ==== 85195+0+0 (secure 0 0 0) 0x7f548c01d3b0 con 0x7f549415c8e0 2023-08-25T04:21:00.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.195+0000 7f548affd640 1 --2- 172.21.15.55:0/740132146 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f5478065910 0x7f5478067dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:00.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.199+0000 7f548affd640 1 -- 172.21.15.55:0/740132146 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f548c083190 con 0x7f549415c8e0 2023-08-25T04:21:00.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.199+0000 7f549a1fb640 1 --2- 172.21.15.55:0/740132146 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f5478065910 0x7f5478067dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:00.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.199+0000 7f549a1fb640 1 --2- 172.21.15.55:0/740132146 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f5478065910 0x7f5478067dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f54900af000 tx=0x7f54900b6040 comp rx=0 tx=0).ready entity=mgr.7573 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:00.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.203+0000 7f548affd640 1 -- 172.21.15.55:0/740132146 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f548c050830 con 0x7f549415c8e0 2023-08-25T04:21:00.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.375+0000 7f549c45f640 1 -- 172.21.15.55:0/740132146 --> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54940c57e0 con 0x7f5478065910 2023-08-25T04:21:00.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.383+0000 7f548affd640 1 -- 172.21.15.55:0/740132146 <== mgr.7573 v2:172.21.15.110:6832/4020134262 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7f54900ab940 con 0x7f5478065910 2023-08-25T04:21:00.380 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:00.381 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:19:59", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-08-25T04:21:00.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.383+0000 7f549c45f640 1 -- 172.21.15.55:0/740132146 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f5478065910 msgr2=0x7f5478067dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:00.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.383+0000 7f549c45f640 1 --2- 172.21.15.55:0/740132146 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f5478065910 0x7f5478067dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f54900af000 tx=0x7f54900b6040 comp rx=0 tx=0).stop 2023-08-25T04:21:00.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.383+0000 7f549c45f640 1 -- 172.21.15.55:0/740132146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549415c8e0 msgr2=0x7f5494153660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:00.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.383+0000 7f549c45f640 1 --2- 172.21.15.55:0/740132146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549415c8e0 0x7f5494153660 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f548c00b970 tx=0x7f548c00be30 comp rx=0 tx=0).stop 2023-08-25T04:21:00.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.383+0000 7f549c45f640 1 -- 172.21.15.55:0/740132146 shutdown_connections 2023-08-25T04:21:00.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.383+0000 7f549c45f640 1 --2- 172.21.15.55:0/740132146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f549415c8e0 0x7f5494153660 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.383+0000 7f549c45f640 1 --2- 172.21.15.55:0/740132146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54940cd8a0 0x7f549415f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.383+0000 7f549c45f640 1 --2- 172.21.15.55:0/740132146 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f5478065910 0x7f5478067dd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.383+0000 7f549c45f640 1 --2- 172.21.15.55:0/740132146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f549406ea10 0x7f5494145660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.383+0000 7f549c45f640 1 -- 172.21.15.55:0/740132146 >> 172.21.15.55:0/740132146 conn(0x7f54940cb790 msgr2=0x7f54940af760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:00.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.383+0000 7f549c45f640 1 -- 172.21.15.55:0/740132146 shutdown_connections 2023-08-25T04:21:00.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.383+0000 7f549c45f640 1 -- 172.21.15.55:0/740132146 wait complete. 2023-08-25T04:21:00.401 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:19:59", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-08-25T04:21:00.401 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /bad-path 2023-08-25T04:21:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.551+0000 7f976d893640 1 Processor -- start 2023-08-25T04:21:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.551+0000 7f976d893640 1 -- start start 2023-08-25T04:21:00.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.551+0000 7f976d893640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f97680cf7b0 0x7f97680b6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:00.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.551+0000 7f976d893640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97680d1970 con 0x7f976815cb40 2023-08-25T04:21:00.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.551+0000 7f976d893640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97680d2790 con 0x7f97680cf340 2023-08-25T04:21:00.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.551+0000 7f976d893640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97680d0d80 con 0x7f97680cf7b0 2023-08-25T04:21:00.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.551+0000 7f9766ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f976815cb40 0x7f97680d2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39050/0 (socket says 172.21.15.55:39050) 2023-08-25T04:21:00.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.551+0000 7f9766ffd640 1 -- 172.21.15.55:0/2767122252 learned_addr learned my addr 172.21.15.55:0/2767122252 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:00.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.551+0000 7f97677fe640 1 --2- 172.21.15.55:0/2767122252 >> v2:172.21.15.55:3300/0 conn(0x7f97680cf7b0 0x7f97680b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:00.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.551+0000 7f97667fc640 1 -- 172.21.15.55:0/2767122252 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748351580 0 0) 0x7f97680d1970 con 0x7f976815cb40 2023-08-25T04:21:00.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.551+0000 7f97667fc640 1 -- 172.21.15.55:0/2767122252 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9754003530 con 0x7f976815cb40 2023-08-25T04:21:00.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.551+0000 7f97677fe640 1 -- 172.21.15.55:0/2767122252 >> v1:172.21.15.110:6789/0 conn(0x7f97680cf340 legacy=0x7f97680b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:00.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.551+0000 7f97677fe640 1 -- 172.21.15.55:0/2767122252 >> v1:172.21.15.55:6789/0 conn(0x7f976815cb40 legacy=0x7f97680d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:00.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.551+0000 7f97677fe640 1 -- 172.21.15.55:0/2767122252 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97680d1040 con 0x7f97680cf7b0 2023-08-25T04:21:00.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.555+0000 7f97677fe640 1 --2- 172.21.15.55:0/2767122252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cf7b0 0x7f97680b6100 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f9760009d90 tx=0x7f976001f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f2d21fcfba882c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:00.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.555+0000 7f97667fc640 1 -- 172.21.15.55:0/2767122252 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97600af600 con 0x7f97680cf7b0 2023-08-25T04:21:00.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.555+0000 7f97667fc640 1 -- 172.21.15.55:0/2767122252 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97600ab050 con 0x7f97680cf7b0 2023-08-25T04:21:00.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.555+0000 7f97667fc640 1 -- 172.21.15.55:0/2767122252 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97600af960 con 0x7f97680cf7b0 2023-08-25T04:21:00.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.555+0000 7f976d893640 1 -- 172.21.15.55:0/2767122252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cf7b0 msgr2=0x7f97680b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:00.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.555+0000 7f976d893640 1 --2- 172.21.15.55:0/2767122252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cf7b0 0x7f97680b6100 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f9760009d90 tx=0x7f976001f100 comp rx=0 tx=0).stop 2023-08-25T04:21:00.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.555+0000 7f976d893640 1 -- 172.21.15.55:0/2767122252 shutdown_connections 2023-08-25T04:21:00.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.555+0000 7f976d893640 1 --2- 172.21.15.55:0/2767122252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cf7b0 0x7f97680b6100 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.555+0000 7f976d893640 1 -- 172.21.15.55:0/2767122252 >> 172.21.15.55:0/2767122252 conn(0x7f976806aae0 msgr2=0x7f976806aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:00.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.555+0000 7f976d893640 1 -- 172.21.15.55:0/2767122252 shutdown_connections 2023-08-25T04:21:00.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.555+0000 7f976d893640 1 -- 172.21.15.55:0/2767122252 wait complete. 2023-08-25T04:21:00.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f976d893640 1 Processor -- start 2023-08-25T04:21:00.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f976d893640 1 -- start start 2023-08-25T04:21:00.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f976d893640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cf340 0x7f97680b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:00.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f976d893640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97680cf7b0 0x7f97680c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:00.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f976d893640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f976815cb40 0x7f976815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:00.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f976d893640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97680c92b0 con 0x7f97680cf340 2023-08-25T04:21:00.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f976d893640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97680b4130 con 0x7f97680cf7b0 2023-08-25T04:21:00.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f976d893640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97681f2c60 con 0x7f976815cb40 2023-08-25T04:21:00.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f9766ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cf340 0x7f97680b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:00.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f9766ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cf340 0x7f97680b3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57004/0 (socket says 172.21.15.55:57004) 2023-08-25T04:21:00.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f9766ffd640 1 -- 172.21.15.55:0/471271102 learned_addr learned my addr 172.21.15.55:0/471271102 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:00.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f975e7fc640 1 --2- 172.21.15.55:0/471271102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97680cf7b0 0x7f97680c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:00.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f97677fe640 1 --2- 172.21.15.55:0/471271102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f976815cb40 0x7f976815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:00.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f9766ffd640 1 -- 172.21.15.55:0/471271102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f976815cb40 msgr2=0x7f976815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:00.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f9766ffd640 1 --2- 172.21.15.55:0/471271102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f976815cb40 0x7f976815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f9766ffd640 1 -- 172.21.15.55:0/471271102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97680cf7b0 msgr2=0x7f97680c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:00.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f9766ffd640 1 --2- 172.21.15.55:0/471271102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97680cf7b0 0x7f97680c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f9766ffd640 1 -- 172.21.15.55:0/471271102 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9760009a70 con 0x7f97680cf340 2023-08-25T04:21:00.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f975e7fc640 1 --2- 172.21.15.55:0/471271102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97680cf7b0 0x7f97680c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:00.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f9766ffd640 1 --2- 172.21.15.55:0/471271102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cf340 0x7f97680b3a50 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f975800c450 tx=0x7f975800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:00.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f9764ff9640 1 -- 172.21.15.55:0/471271102 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9758005cf0 con 0x7f97680cf340 2023-08-25T04:21:00.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f9764ff9640 1 -- 172.21.15.55:0/471271102 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9758005e50 con 0x7f97680cf340 2023-08-25T04:21:00.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f9764ff9640 1 -- 172.21.15.55:0/471271102 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9758007290 con 0x7f97680cf340 2023-08-25T04:21:00.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f976d893640 1 -- 172.21.15.55:0/471271102 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976815daa0 con 0x7f97680cf340 2023-08-25T04:21:00.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.559+0000 7f976d893640 1 -- 172.21.15.55:0/471271102 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97681f30f0 con 0x7f97680cf340 2023-08-25T04:21:00.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.563+0000 7f976d893640 1 -- 172.21.15.55:0/471271102 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9768071f80 con 0x7f97680cf340 2023-08-25T04:21:00.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.563+0000 7f9764ff9640 1 -- 172.21.15.55:0/471271102 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 51) v1 ==== 85195+0+0 (secure 0 0 0) 0x7f97580073f0 con 0x7f97680cf340 2023-08-25T04:21:00.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.563+0000 7f9764ff9640 1 --2- 172.21.15.55:0/471271102 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f9748065910 0x7f9748067dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:00.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.563+0000 7f9764ff9640 1 -- 172.21.15.55:0/471271102 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9758082a80 con 0x7f97680cf340 2023-08-25T04:21:00.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.563+0000 7f975e7fc640 1 --2- 172.21.15.55:0/471271102 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f9748065910 0x7f9748067dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:00.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.567+0000 7f975e7fc640 1 --2- 172.21.15.55:0/471271102 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f9748065910 0x7f9748067dd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f97681602d0 tx=0x7f9750008040 comp rx=0 tx=0).ready entity=mgr.7573 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:00.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.567+0000 7f9764ff9640 1 -- 172.21.15.55:0/471271102 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f975804ffd0 con 0x7f97680cf340 2023-08-25T04:21:00.630 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:21:00.634 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:21:00.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.743+0000 7f976d893640 1 -- 172.21.15.55:0/471271102 --> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""]}) v1 -- 0x7f97680d1320 con 0x7f9748065910 2023-08-25T04:21:00.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.811+0000 7f9764ff9640 1 -- 172.21.15.55:0/471271102 <== mgr.7573 v2:172.21.15.110:6832/4020134262 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7f97500094a0 con 0x7f9748065910 2023-08-25T04:21:00.810 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /bad-path 2023-08-25T04:21:00.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.815+0000 7f976d893640 1 -- 172.21.15.55:0/471271102 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f9748065910 msgr2=0x7f9748067dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:00.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.815+0000 7f976d893640 1 --2- 172.21.15.55:0/471271102 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f9748065910 0x7f9748067dd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f97681602d0 tx=0x7f9750008040 comp rx=0 tx=0).stop 2023-08-25T04:21:00.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.815+0000 7f976d893640 1 -- 172.21.15.55:0/471271102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cf340 msgr2=0x7f97680b3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:00.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.815+0000 7f976d893640 1 --2- 172.21.15.55:0/471271102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cf340 0x7f97680b3a50 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f975800c450 tx=0x7f975800c910 comp rx=0 tx=0).stop 2023-08-25T04:21:00.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.815+0000 7f976d893640 1 -- 172.21.15.55:0/471271102 shutdown_connections 2023-08-25T04:21:00.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.815+0000 7f976d893640 1 --2- 172.21.15.55:0/471271102 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f9748065910 0x7f9748067dd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.815+0000 7f976d893640 1 --2- 172.21.15.55:0/471271102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f976815cb40 0x7f976815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.815+0000 7f976d893640 1 --2- 172.21.15.55:0/471271102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97680cf7b0 0x7f97680c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.815+0000 7f976d893640 1 --2- 172.21.15.55:0/471271102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cf340 0x7f97680b3a50 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.815+0000 7f976d893640 1 -- 172.21.15.55:0/471271102 >> 172.21.15.55:0/471271102 conn(0x7f976806aae0 msgr2=0x7f97680ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:00.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.815+0000 7f976d893640 1 -- 172.21.15.55:0/471271102 shutdown_connections 2023-08-25T04:21:00.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.815+0000 7f976d893640 1 -- 172.21.15.55:0/471271102 wait complete. 2023-08-25T04:21:00.831 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /bad-path 2023-08-25T04:21:00.831 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-25T04:21:00.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.983+0000 7feb6ed44640 1 Processor -- start 2023-08-25T04:21:00.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.983+0000 7feb6ed44640 1 -- start start 2023-08-25T04:21:00.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.983+0000 7feb6ed44640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb6806c3b0 0x7feb680cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:00.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.983+0000 7feb6ed44640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb6806e5a0 0x7feb680ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:00.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.983+0000 7feb6ed44640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb680cab90 con 0x7feb6806c790 2023-08-25T04:21:00.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.983+0000 7feb6ed44640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb6806dbb0 con 0x7feb6806e5a0 2023-08-25T04:21:00.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.983+0000 7feb6ed44640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb680cae50 con 0x7feb6806c3b0 2023-08-25T04:21:00.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.983+0000 7feb5ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feb6806c790 0x7feb6806de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39064/0 (socket says 172.21.15.55:39064) 2023-08-25T04:21:00.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.983+0000 7feb5ffff640 1 -- 172.21.15.55:0/444186463 learned_addr learned my addr 172.21.15.55:0/444186463 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:00.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.983+0000 7feb6d2e1640 1 --2- 172.21.15.55:0/444186463 >> v2:172.21.15.55:3300/0 conn(0x7feb6806e5a0 0x7feb680ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:00.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.983+0000 7feb6cae0640 1 --2- 172.21.15.55:0/444186463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb6806c3b0 0x7feb680cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:00.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.983+0000 7feb6d2e1640 1 -- 172.21.15.55:0/444186463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb6806c3b0 msgr2=0x7feb680cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:00.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.983+0000 7feb6d2e1640 1 --2- 172.21.15.55:0/444186463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb6806c3b0 0x7feb680cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.983+0000 7feb6d2e1640 1 -- 172.21.15.55:0/444186463 >> v1:172.21.15.55:6789/0 conn(0x7feb6806c790 legacy=0x7feb6806de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:00.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.983+0000 7feb6d2e1640 1 -- 172.21.15.55:0/444186463 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb680cb130 con 0x7feb6806e5a0 2023-08-25T04:21:00.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.983+0000 7feb5f7fe640 1 -- 172.21.15.55:0/444186463 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567053954 0 0) 0x7feb680cab90 con 0x7feb6806c790 2023-08-25T04:21:00.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.987+0000 7feb6d2e1640 1 --2- 172.21.15.55:0/444186463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb6806e5a0 0x7feb680ce8b0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7feb60009d90 tx=0x7feb6001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122bc1d3a4d595ed server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:00.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.987+0000 7feb5f7fe640 1 -- 172.21.15.55:0/444186463 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb600a59c0 con 0x7feb6806e5a0 2023-08-25T04:21:00.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.987+0000 7feb5f7fe640 1 -- 172.21.15.55:0/444186463 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb600a5b20 con 0x7feb6806e5a0 2023-08-25T04:21:00.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.987+0000 7feb5f7fe640 1 -- 172.21.15.55:0/444186463 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb600ad440 con 0x7feb6806e5a0 2023-08-25T04:21:00.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.987+0000 7feb6ed44640 1 -- 172.21.15.55:0/444186463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb6806e5a0 msgr2=0x7feb680ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:00.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.987+0000 7feb6ed44640 1 --2- 172.21.15.55:0/444186463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb6806e5a0 0x7feb680ce8b0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7feb60009d90 tx=0x7feb6001c920 comp rx=0 tx=0).stop 2023-08-25T04:21:00.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.987+0000 7feb6ed44640 1 -- 172.21.15.55:0/444186463 shutdown_connections 2023-08-25T04:21:00.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.987+0000 7feb6ed44640 1 --2- 172.21.15.55:0/444186463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb6806e5a0 0x7feb680ce8b0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.987+0000 7feb6ed44640 1 --2- 172.21.15.55:0/444186463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb6806c3b0 0x7feb680cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.987+0000 7feb6ed44640 1 -- 172.21.15.55:0/444186463 >> 172.21.15.55:0/444186463 conn(0x7feb680d0540 msgr2=0x7feb680d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:00.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.987+0000 7feb6ed44640 1 -- 172.21.15.55:0/444186463 shutdown_connections 2023-08-25T04:21:00.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.987+0000 7feb6ed44640 1 -- 172.21.15.55:0/444186463 wait complete. 2023-08-25T04:21:00.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb6ed44640 1 Processor -- start 2023-08-25T04:21:00.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb6ed44640 1 -- start start 2023-08-25T04:21:00.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb6ed44640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb6806c3b0 0x7feb680b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:00.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb6ed44640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb6806c790 0x7feb6815e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:00.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb6ed44640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb6806e5a0 0x7feb680c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:00.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb6ed44640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb680b5440 con 0x7feb6806c790 2023-08-25T04:21:00.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb6ed44640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb680b47c0 con 0x7feb6806c3b0 2023-08-25T04:21:00.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb6ed44640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb680b4aa0 con 0x7feb6806e5a0 2023-08-25T04:21:00.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb5ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb6806c790 0x7feb6815e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:00.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb5ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb6806c790 0x7feb6815e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57018/0 (socket says 172.21.15.55:57018) 2023-08-25T04:21:00.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb5ffff640 1 -- 172.21.15.55:0/1432195549 learned_addr learned my addr 172.21.15.55:0/1432195549 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:00.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb6cae0640 1 --2- 172.21.15.55:0/1432195549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb6806c3b0 0x7feb680b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:00.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb6d2e1640 1 --2- 172.21.15.55:0/1432195549 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb6806e5a0 0x7feb680c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:00.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb5ffff640 1 -- 172.21.15.55:0/1432195549 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb6806e5a0 msgr2=0x7feb680c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:00.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb5ffff640 1 --2- 172.21.15.55:0/1432195549 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb6806e5a0 0x7feb680c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb5ffff640 1 -- 172.21.15.55:0/1432195549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb6806c3b0 msgr2=0x7feb680b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:00.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb5ffff640 1 --2- 172.21.15.55:0/1432195549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb6806c3b0 0x7feb680b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:00.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb5ffff640 1 -- 172.21.15.55:0/1432195549 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb60009a70 con 0x7feb6806c790 2023-08-25T04:21:00.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb5ffff640 1 --2- 172.21.15.55:0/1432195549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb6806c790 0x7feb6815e7c0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7feb5800c4b0 tx=0x7feb5800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:00.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb5d7fa640 1 -- 172.21.15.55:0/1432195549 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb580074e0 con 0x7feb6806c790 2023-08-25T04:21:00.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb5d7fa640 1 -- 172.21.15.55:0/1432195549 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb58007660 con 0x7feb6806c790 2023-08-25T04:21:00.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb6ed44640 1 -- 172.21.15.55:0/1432195549 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb680b4d80 con 0x7feb6806c790 2023-08-25T04:21:01.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb5d7fa640 1 -- 172.21.15.55:0/1432195549 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58004a30 con 0x7feb6806c790 2023-08-25T04:21:01.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.991+0000 7feb6ed44640 1 -- 172.21.15.55:0/1432195549 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb680b43b0 con 0x7feb6806c790 2023-08-25T04:21:01.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.995+0000 7feb6ed44640 1 -- 172.21.15.55:0/1432195549 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb680b5580 con 0x7feb6806c790 2023-08-25T04:21:01.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.995+0000 7feb5d7fa640 1 -- 172.21.15.55:0/1432195549 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 51) v1 ==== 85195+0+0 (secure 0 0 0) 0x7feb58004b90 con 0x7feb6806c790 2023-08-25T04:21:01.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.995+0000 7feb5d7fa640 1 --2- 172.21.15.55:0/1432195549 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7feb54065910 0x7feb54067dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:01.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.995+0000 7feb5d7fa640 1 -- 172.21.15.55:0/1432195549 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6565+0+0 (secure 0 0 0) 0x7feb58082950 con 0x7feb6806c790 2023-08-25T04:21:01.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.995+0000 7feb6cae0640 1 --2- 172.21.15.55:0/1432195549 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7feb54065910 0x7feb54067dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:01.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.995+0000 7feb6cae0640 1 --2- 172.21.15.55:0/1432195549 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7feb54065910 0x7feb54067dd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feb64009b40 tx=0x7feb64006f90 comp rx=0 tx=0).ready entity=mgr.7573 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:01.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:00.999+0000 7feb5d7fa640 1 -- 172.21.15.55:0/1432195549 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7feb680b5580 con 0x7feb6806c790 2023-08-25T04:21:01.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:01.195+0000 7feb6ed44640 1 -- 172.21.15.55:0/1432195549 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7feb680b5580 con 0x7feb6806c790 2023-08-25T04:21:01.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:01.755+0000 7feb5d7fa640 1 -- 172.21.15.55:0/1432195549 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 52) v1 ==== 85178+0+0 (secure 0 0 0) 0x7feb580503f0 con 0x7feb6806c790 2023-08-25T04:21:01.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:01.755+0000 7feb5d7fa640 1 -- 172.21.15.55:0/1432195549 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v52) v1 ==== 93+0+0 (secure 0 0 0) 0x7feb58050020 con 0x7feb6806c790 2023-08-25T04:21:01.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:01.759+0000 7feb6ed44640 1 -- 172.21.15.55:0/1432195549 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7feb54065910 msgr2=0x7feb54067dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:01.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:01.759+0000 7feb6ed44640 1 --2- 172.21.15.55:0/1432195549 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7feb54065910 0x7feb54067dd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feb64009b40 tx=0x7feb64006f90 comp rx=0 tx=0).stop 2023-08-25T04:21:01.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:01.759+0000 7feb6ed44640 1 -- 172.21.15.55:0/1432195549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb6806c790 msgr2=0x7feb6815e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:01.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:01.759+0000 7feb6ed44640 1 --2- 172.21.15.55:0/1432195549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb6806c790 0x7feb6815e7c0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7feb5800c4b0 tx=0x7feb5800c970 comp rx=0 tx=0).stop 2023-08-25T04:21:01.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:01.759+0000 7feb6ed44640 1 -- 172.21.15.55:0/1432195549 shutdown_connections 2023-08-25T04:21:01.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:01.759+0000 7feb6ed44640 1 --2- 172.21.15.55:0/1432195549 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7feb54065910 0x7feb54067dd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:01.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:01.759+0000 7feb6ed44640 1 --2- 172.21.15.55:0/1432195549 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb6806e5a0 0x7feb680c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:01.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:01.759+0000 7feb6ed44640 1 --2- 172.21.15.55:0/1432195549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb6806c790 0x7feb6815e7c0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:01.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:01.759+0000 7feb6ed44640 1 --2- 172.21.15.55:0/1432195549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb6806c3b0 0x7feb680b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:01.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:01.759+0000 7feb6ed44640 1 -- 172.21.15.55:0/1432195549 >> 172.21.15.55:0/1432195549 conn(0x7feb680d0540 msgr2=0x7feb680cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:01.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:01.759+0000 7feb6ed44640 1 -- 172.21.15.55:0/1432195549 shutdown_connections 2023-08-25T04:21:01.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:01.759+0000 7feb6ed44640 1 -- 172.21.15.55:0/1432195549 wait complete. 2023-08-25T04:21:01.779 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T04:21:01.780 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:21:01.861 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:21:01.911 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T04:21:01.912 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:21:01.912 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:21:01.922 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:21:01.922 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:21:01.933 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:01.935+0000 7fa0dc446180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:21:01.936 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:01.935+0000 7fcb5900c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:21:01.942 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:21:02.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.135+0000 7f657131e640 1 Processor -- start 2023-08-25T04:21:02.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.135+0000 7f657131e640 1 -- start start 2023-08-25T04:21:02.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.135+0000 7f657131e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f656c0d0da0 0x7f656c0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.135+0000 7f657131e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f656c0cdde0 0x7f656c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.135+0000 7f657131e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656c0b29b0 con 0x7f656c0cee60 2023-08-25T04:21:02.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.135+0000 7f657131e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f656c0ce760 con 0x7f656c0cdde0 2023-08-25T04:21:02.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.135+0000 7f657131e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656c0d16c0 con 0x7f656c0d0da0 2023-08-25T04:21:02.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.135+0000 7f6563fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f656c0cdde0 0x7f656c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:02.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.135+0000 7f6563fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f656c0cdde0 0x7f656c0ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57036/0 (socket says 172.21.15.55:57036) 2023-08-25T04:21:02.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.135+0000 7f6563fff640 1 -- 172.21.15.55:0/3827376795 learned_addr learned my addr 172.21.15.55:0/3827376795 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:02.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.135+0000 7f656b7fe640 1 --1- 172.21.15.55:0/3827376795 >> v1:172.21.15.55:6789/0 conn(0x7f656c0cee60 0x7f656c0cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39076/0 (socket says 172.21.15.55:39076) 2023-08-25T04:21:02.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.135+0000 7f656affd640 1 --2- 172.21.15.55:0/3827376795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f656c0d0da0 0x7f656c0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:02.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.139+0000 7f6563fff640 1 -- 172.21.15.55:0/3827376795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f656c0d0da0 msgr2=0x7f656c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:02.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.139+0000 7f6563fff640 1 --2- 172.21.15.55:0/3827376795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f656c0d0da0 0x7f656c0d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.139+0000 7f6563fff640 1 -- 172.21.15.55:0/3827376795 >> v1:172.21.15.55:6789/0 conn(0x7f656c0cee60 legacy=0x7f656c0cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:02.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.139+0000 7f6563fff640 1 -- 172.21.15.55:0/3827376795 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656c0b1dc0 con 0x7f656c0cdde0 2023-08-25T04:21:02.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.139+0000 7f6563fff640 1 --2- 172.21.15.55:0/3827376795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f656c0cdde0 0x7f656c0ce220 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f6554009870 tx=0x7f655401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb24b33ce057da61 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:02.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.139+0000 7f656a7fc640 1 -- 172.21.15.55:0/3827376795 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65540a8a30 con 0x7f656c0cdde0 2023-08-25T04:21:02.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.139+0000 7f656a7fc640 1 -- 172.21.15.55:0/3827376795 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65540a8b90 con 0x7f656c0cdde0 2023-08-25T04:21:02.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.139+0000 7f656a7fc640 1 -- 172.21.15.55:0/3827376795 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65540b0440 con 0x7f656c0cdde0 2023-08-25T04:21:02.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.139+0000 7f657131e640 1 -- 172.21.15.55:0/3827376795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f656c0cdde0 msgr2=0x7f656c0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:02.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.139+0000 7f657131e640 1 --2- 172.21.15.55:0/3827376795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f656c0cdde0 0x7f656c0ce220 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f6554009870 tx=0x7f655401ed30 comp rx=0 tx=0).stop 2023-08-25T04:21:02.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f657131e640 1 -- 172.21.15.55:0/3827376795 shutdown_connections 2023-08-25T04:21:02.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f657131e640 1 --2- 172.21.15.55:0/3827376795 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f656c0cdde0 0x7f656c0ce220 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f657131e640 1 --2- 172.21.15.55:0/3827376795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f656c0d0da0 0x7f656c0d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f657131e640 1 -- 172.21.15.55:0/3827376795 >> 172.21.15.55:0/3827376795 conn(0x7f656c09bae0 msgr2=0x7f656c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:02.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f657131e640 1 -- 172.21.15.55:0/3827376795 shutdown_connections 2023-08-25T04:21:02.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f657131e640 1 -- 172.21.15.55:0/3827376795 wait complete. 2023-08-25T04:21:02.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f657131e640 1 Processor -- start 2023-08-25T04:21:02.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f657131e640 1 -- start start 2023-08-25T04:21:02.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f657131e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f656c0cdde0 0x7f656c0c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f657131e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f656c0cee60 0x7f656c0ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f657131e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f656c0d0da0 0x7f656c151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f657131e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c0ca7e0 con 0x7f656c0cdde0 2023-08-25T04:21:02.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f657131e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c1521f0 con 0x7f656c0cee60 2023-08-25T04:21:02.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f657131e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656c0c7b60 con 0x7f656c0d0da0 2023-08-25T04:21:02.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f656affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f656c0cdde0 0x7f656c0c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:02.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f656affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f656c0cdde0 0x7f656c0c7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57044/0 (socket says 172.21.15.55:57044) 2023-08-25T04:21:02.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f656affd640 1 -- 172.21.15.55:0/2701713720 learned_addr learned my addr 172.21.15.55:0/2701713720 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:02.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f656b7fe640 1 --2- 172.21.15.55:0/2701713720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f656c0d0da0 0x7f656c151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:02.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f6563fff640 1 --2- 172.21.15.55:0/2701713720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f656c0cee60 0x7f656c0ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:02.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f656affd640 1 -- 172.21.15.55:0/2701713720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f656c0d0da0 msgr2=0x7f656c151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:02.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f656affd640 1 --2- 172.21.15.55:0/2701713720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f656c0d0da0 0x7f656c151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f656affd640 1 -- 172.21.15.55:0/2701713720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f656c0cee60 msgr2=0x7f656c0ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:02.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f656affd640 1 --2- 172.21.15.55:0/2701713720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f656c0cee60 0x7f656c0ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f656affd640 1 -- 172.21.15.55:0/2701713720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65540094d0 con 0x7f656c0cdde0 2023-08-25T04:21:02.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f6563fff640 1 --2- 172.21.15.55:0/2701713720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f656c0cee60 0x7f656c0ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:02.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f656affd640 1 --2- 172.21.15.55:0/2701713720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f656c0cdde0 0x7f656c0c7510 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f655c00e870 tx=0x7f655c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:02.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.143+0000 7f65637fe640 1 -- 172.21.15.55:0/2701713720 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c0095d0 con 0x7f656c0cdde0 2023-08-25T04:21:02.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.147+0000 7f65637fe640 1 -- 172.21.15.55:0/2701713720 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655c00c940 con 0x7f656c0cdde0 2023-08-25T04:21:02.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.147+0000 7f657131e640 1 -- 172.21.15.55:0/2701713720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f656c0c7e40 con 0x7f656c0cdde0 2023-08-25T04:21:02.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.147+0000 7f65637fe640 1 -- 172.21.15.55:0/2701713720 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c00ccb0 con 0x7f656c0cdde0 2023-08-25T04:21:02.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.147+0000 7f657131e640 1 -- 172.21.15.55:0/2701713720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f656c0c8400 con 0x7f656c0cdde0 2023-08-25T04:21:02.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.147+0000 7f657131e640 1 -- 172.21.15.55:0/2701713720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f656c0c8920 con 0x7f656c0cdde0 2023-08-25T04:21:02.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.147+0000 7f65637fe640 1 -- 172.21.15.55:0/2701713720 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 52) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f655c013470 con 0x7f656c0cdde0 2023-08-25T04:21:02.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.147+0000 7f65637fe640 1 --2- 172.21.15.55:0/2701713720 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f654c0658c0 0x7f654c067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.147+0000 7f65637fe640 1 -- 172.21.15.55:0/2701713720 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f655c083970 con 0x7f656c0cdde0 2023-08-25T04:21:02.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.147+0000 7f6563fff640 1 -- 172.21.15.55:0/2701713720 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f654c0658c0 msgr2=0x7f654c067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4020134262 2023-08-25T04:21:02.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.147+0000 7f6563fff640 1 --2- 172.21.15.55:0/2701713720 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f654c0658c0 0x7f654c067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:21:02.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.155+0000 7f65637fe640 1 -- 172.21.15.55:0/2701713720 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f655c054a30 con 0x7f656c0cdde0 2023-08-25T04:21:02.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.315+0000 7f657131e640 1 -- 172.21.15.55:0/2701713720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f656c04dbe0 con 0x7f656c0cdde0 2023-08-25T04:21:02.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.315+0000 7f65637fe640 1 -- 172.21.15.55:0/2701713720 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+19082 (secure 0 0 0) 0x7f655c0545c0 con 0x7f656c0cdde0 2023-08-25T04:21:02.315 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:02.315 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":110,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:20:59.718757+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:19:39.091781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-25T04:19:40.272091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.26","mappings":[{"from":1,"to":7}]},{"pgid":"14.2a","mappings":[{"from":1,"to":5}]},{"pgid":"14.2c","mappings":[{"from":1,"to":7}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/1316478715":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/2779991692":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/3403132554":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/2984642613":"2023-08-26T04:19:58.502978+0000","172.21.15.110:6833/1337211678":"2023-08-26T04:19:58.502978+0000","172.21.15.110:6832/1337211678":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/499210753":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/3677413256":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/3256947721":"2023-08-25T05:19:50.681655+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:21:02.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.319+0000 7f657131e640 1 -- 172.21.15.55:0/2701713720 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f654c0658c0 msgr2=0x7f654c067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:21:02.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.319+0000 7f657131e640 1 --2- 172.21.15.55:0/2701713720 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f654c0658c0 0x7f654c067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.319+0000 7f657131e640 1 -- 172.21.15.55:0/2701713720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f656c0cdde0 msgr2=0x7f656c0c7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:02.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.319+0000 7f657131e640 1 --2- 172.21.15.55:0/2701713720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f656c0cdde0 0x7f656c0c7510 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f655c00e870 tx=0x7f655c00ed30 comp rx=0 tx=0).stop 2023-08-25T04:21:02.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.319+0000 7f657131e640 1 -- 172.21.15.55:0/2701713720 shutdown_connections 2023-08-25T04:21:02.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.319+0000 7f657131e640 1 --2- 172.21.15.55:0/2701713720 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f654c0658c0 0x7f654c067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.319+0000 7f657131e640 1 --2- 172.21.15.55:0/2701713720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f656c0d0da0 0x7f656c151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.319+0000 7f657131e640 1 --2- 172.21.15.55:0/2701713720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f656c0cee60 0x7f656c0ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.319+0000 7f657131e640 1 --2- 172.21.15.55:0/2701713720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f656c0cdde0 0x7f656c0c7510 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.319+0000 7f657131e640 1 -- 172.21.15.55:0/2701713720 >> 172.21.15.55:0/2701713720 conn(0x7f656c09bae0 msgr2=0x7f656c0b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:02.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.319+0000 7f657131e640 1 -- 172.21.15.55:0/2701713720 shutdown_connections 2023-08-25T04:21:02.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.319+0000 7f657131e640 1 -- 172.21.15.55:0/2701713720 wait complete. 2023-08-25T04:21:02.336 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:19:39.091781+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:19:40.272091+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:21:02.338 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:21:02.348 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:02.347+0000 7fcb5900c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:21:02.384 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:02.387+0000 7fa0dc446180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:21:02.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.491+0000 7f1249a04640 1 Processor -- start 2023-08-25T04:21:02.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.491+0000 7f1249a04640 1 -- start start 2023-08-25T04:21:02.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.491+0000 7f1249a04640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12440b4040 0x7f12440b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.491+0000 7f1249a04640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f124415c950 0x7f12440b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.491+0000 7f1249a04640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f12440b4be0 0x7f12440b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.491+0000 7f1249a04640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12440cd020 con 0x7f12440b4be0 2023-08-25T04:21:02.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.491+0000 7f1249a04640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12440cd650 con 0x7f124415c950 2023-08-25T04:21:02.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.491+0000 7f1249a04640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12440b4960 con 0x7f12440b4040 2023-08-25T04:21:02.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.491+0000 7f12437fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f12440b4be0 0x7f12440b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:02.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.491+0000 7f1242ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12440b4040 0x7f12440b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:02.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.491+0000 7f12437fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f12440b4be0 0x7f12440b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57056/0 (socket says 172.21.15.55:57056) 2023-08-25T04:21:02.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.491+0000 7f12437fe640 1 -- 172.21.15.55:0/2179392318 learned_addr learned my addr 172.21.15.55:0/2179392318 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:02.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.491+0000 7f123a7fc640 1 --2- 172.21.15.55:0/2179392318 >> v2:172.21.15.110:3300/0 conn(0x7f124415c950 0x7f12440b7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:02.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.491+0000 7f12437fe640 1 -- 172.21.15.55:0/2179392318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12440b4040 msgr2=0x7f12440b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:02.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.491+0000 7f12437fe640 1 --2- 172.21.15.55:0/2179392318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12440b4040 0x7f12440b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.491+0000 7f12437fe640 1 -- 172.21.15.55:0/2179392318 >> v2:172.21.15.110:3300/0 conn(0x7f124415c950 msgr2=0x7f12440b7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:02.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.491+0000 7f12437fe640 1 --2- 172.21.15.55:0/2179392318 >> v2:172.21.15.110:3300/0 conn(0x7f124415c950 0x7f12440b7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.491+0000 7f12437fe640 1 -- 172.21.15.55:0/2179392318 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12440cd8f0 con 0x7f12440b4be0 2023-08-25T04:21:02.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.495+0000 7f12437fe640 1 --2- 172.21.15.55:0/2179392318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12440b4be0 0x7f12440b56f0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f124406b980 tx=0x7f123c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a003eab84267ae server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:02.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f12427fc640 1 -- 172.21.15.55:0/2179392318 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c0a5720 con 0x7f12440b4be0 2023-08-25T04:21:02.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f12427fc640 1 -- 172.21.15.55:0/2179392318 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123c0a5880 con 0x7f12440b4be0 2023-08-25T04:21:02.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f12427fc640 1 -- 172.21.15.55:0/2179392318 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c0a5c10 con 0x7f12440b4be0 2023-08-25T04:21:02.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f1249a04640 1 -- 172.21.15.55:0/2179392318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12440b4be0 msgr2=0x7f12440b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:02.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f1249a04640 1 --2- 172.21.15.55:0/2179392318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12440b4be0 0x7f12440b56f0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f124406b980 tx=0x7f123c01c880 comp rx=0 tx=0).stop 2023-08-25T04:21:02.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f1249a04640 1 -- 172.21.15.55:0/2179392318 shutdown_connections 2023-08-25T04:21:02.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f1249a04640 1 --2- 172.21.15.55:0/2179392318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12440b4be0 0x7f12440b56f0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f1249a04640 1 --2- 172.21.15.55:0/2179392318 >> v2:172.21.15.110:3300/0 conn(0x7f124415c950 0x7f12440b7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f1249a04640 1 --2- 172.21.15.55:0/2179392318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12440b4040 0x7f12440b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f1249a04640 1 -- 172.21.15.55:0/2179392318 >> 172.21.15.55:0/2179392318 conn(0x7f12440658c0 msgr2=0x7f1244065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:02.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f1249a04640 1 -- 172.21.15.55:0/2179392318 shutdown_connections 2023-08-25T04:21:02.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f1249a04640 1 -- 172.21.15.55:0/2179392318 wait complete. 2023-08-25T04:21:02.498 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:02.495+0000 7fcb5900c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:21:02.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f1249a04640 1 Processor -- start 2023-08-25T04:21:02.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f1249a04640 1 -- start start 2023-08-25T04:21:02.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f1249a04640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12440b4040 0x7f1244150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f1249a04640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12440b4be0 0x7f12440caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f1249a04640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f124415c950 0x7f124415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f1249a04640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12440cc010 con 0x7f12440b4040 2023-08-25T04:21:02.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f1249a04640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12440cba50 con 0x7f124415c950 2023-08-25T04:21:02.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.499+0000 7f1249a04640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12440cbd30 con 0x7f12440b4be0 2023-08-25T04:21:02.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.503+0000 7f1242ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12440b4040 0x7f1244150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:02.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.503+0000 7f1242ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12440b4040 0x7f1244150910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57066/0 (socket says 172.21.15.55:57066) 2023-08-25T04:21:02.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.503+0000 7f1242ffd640 1 -- 172.21.15.55:0/2358234215 learned_addr learned my addr 172.21.15.55:0/2358234215 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:02.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.503+0000 7f123a7fc640 1 --2- 172.21.15.55:0/2358234215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12440b4be0 0x7f12440caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:02.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.503+0000 7f12437fe640 1 --2- 172.21.15.55:0/2358234215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f124415c950 0x7f124415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:02.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.503+0000 7f1242ffd640 1 -- 172.21.15.55:0/2358234215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12440b4be0 msgr2=0x7f12440caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:02.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.503+0000 7f1242ffd640 1 --2- 172.21.15.55:0/2358234215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12440b4be0 0x7f12440caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.503+0000 7f1242ffd640 1 -- 172.21.15.55:0/2358234215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f124415c950 msgr2=0x7f124415aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:02.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.503+0000 7f1242ffd640 1 --2- 172.21.15.55:0/2358234215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f124415c950 0x7f124415aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.503+0000 7f1242ffd640 1 -- 172.21.15.55:0/2358234215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c009b30 con 0x7f12440b4040 2023-08-25T04:21:02.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.503+0000 7f1242ffd640 1 --2- 172.21.15.55:0/2358234215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12440b4040 0x7f1244150910 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f123400e8b0 tx=0x7f123400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:02.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.503+0000 7f1240ff9640 1 -- 172.21.15.55:0/2358234215 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123400c940 con 0x7f12440b4040 2023-08-25T04:21:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.503+0000 7f1240ff9640 1 -- 172.21.15.55:0/2358234215 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123400caa0 con 0x7f12440b4040 2023-08-25T04:21:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.503+0000 7f1249a04640 1 -- 172.21.15.55:0/2358234215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1244153540 con 0x7f12440b4040 2023-08-25T04:21:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.503+0000 7f1240ff9640 1 -- 172.21.15.55:0/2358234215 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123400ce30 con 0x7f12440b4040 2023-08-25T04:21:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.503+0000 7f1249a04640 1 -- 172.21.15.55:0/2358234215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12440b2110 con 0x7f12440b4040 2023-08-25T04:21:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.503+0000 7f1249a04640 1 -- 172.21.15.55:0/2358234215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12440668d0 con 0x7f12440b4040 2023-08-25T04:21:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.507+0000 7f1240ff9640 1 -- 172.21.15.55:0/2358234215 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 52) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f1234013470 con 0x7f12440b4040 2023-08-25T04:21:02.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.507+0000 7f1240ff9640 1 --2- 172.21.15.55:0/2358234215 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f12240658f0 0x7f1224067db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.507+0000 7f1240ff9640 1 -- 172.21.15.55:0/2358234215 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f12340834b0 con 0x7f12440b4040 2023-08-25T04:21:02.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.507+0000 7f123a7fc640 1 -- 172.21.15.55:0/2358234215 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f12240658f0 msgr2=0x7f1224067db0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4020134262 2023-08-25T04:21:02.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.507+0000 7f123a7fc640 1 --2- 172.21.15.55:0/2358234215 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f12240658f0 0x7f1224067db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:21:02.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.511+0000 7f1240ff9640 1 -- 172.21.15.55:0/2358234215 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1234050b50 con 0x7f12440b4040 2023-08-25T04:21:02.550 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:02.551+0000 7fa0dc446180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:21:02.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.671+0000 7f1249a04640 1 -- 172.21.15.55:0/2358234215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1244073e50 con 0x7f12440b4040 2023-08-25T04:21:02.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.671+0000 7f1240ff9640 1 -- 172.21.15.55:0/2358234215 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1234054170 con 0x7f12440b4040 2023-08-25T04:21:02.670 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:21:02.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.675+0000 7f1249a04640 1 -- 172.21.15.55:0/2358234215 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f12240658f0 msgr2=0x7f1224067db0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:21:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.675+0000 7f1249a04640 1 --2- 172.21.15.55:0/2358234215 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f12240658f0 0x7f1224067db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.675+0000 7f1249a04640 1 -- 172.21.15.55:0/2358234215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12440b4040 msgr2=0x7f1244150910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.675+0000 7f1249a04640 1 --2- 172.21.15.55:0/2358234215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12440b4040 0x7f1244150910 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f123400e8b0 tx=0x7f123400ed70 comp rx=0 tx=0).stop 2023-08-25T04:21:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.675+0000 7f1249a04640 1 -- 172.21.15.55:0/2358234215 shutdown_connections 2023-08-25T04:21:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.675+0000 7f1249a04640 1 --2- 172.21.15.55:0/2358234215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f124415c950 0x7f124415aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.675+0000 7f1249a04640 1 --2- 172.21.15.55:0/2358234215 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f12240658f0 0x7f1224067db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.675+0000 7f1249a04640 1 --2- 172.21.15.55:0/2358234215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12440b4be0 0x7f12440caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.675+0000 7f1249a04640 1 --2- 172.21.15.55:0/2358234215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12440b4040 0x7f1244150910 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.675+0000 7f1249a04640 1 -- 172.21.15.55:0/2358234215 >> 172.21.15.55:0/2358234215 conn(0x7f12440658c0 msgr2=0x7f12440d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:02.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.675+0000 7f1249a04640 1 -- 172.21.15.55:0/2358234215 shutdown_connections 2023-08-25T04:21:02.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.675+0000 7f1249a04640 1 -- 172.21.15.55:0/2358234215 wait complete. 2023-08-25T04:21:02.691 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:21:02.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.847+0000 7f23cb503640 1 Processor -- start 2023-08-25T04:21:02.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.847+0000 7f23cb503640 1 -- start start 2023-08-25T04:21:02.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.847+0000 7f23cb503640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23c41601f0 0x7f23c415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.847+0000 7f23cb503640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c415e3c0 0x7f23c40d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.847+0000 7f23cb503640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c415f8b0 con 0x7f23c40d10c0 2023-08-25T04:21:02.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.847+0000 7f23cb503640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c40cd5a0 con 0x7f23c41601f0 2023-08-25T04:21:02.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.847+0000 7f23cb503640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c40cd880 con 0x7f23c415e3c0 2023-08-25T04:21:02.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.847+0000 7f23c8a9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c415e3c0 0x7f23c40d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:02.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.847+0000 7f23c929f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23c41601f0 0x7f23c415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:02.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.847+0000 7f23c8a9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c415e3c0 0x7f23c40d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:60834/0 (socket says 172.21.15.55:60834) 2023-08-25T04:21:02.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.847+0000 7f23c929f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23c41601f0 0x7f23c415d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:50566/0 (socket says 172.21.15.55:50566) 2023-08-25T04:21:02.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.847+0000 7f23c8a9e640 1 -- 172.21.15.55:0/3082614127 learned_addr learned my addr 172.21.15.55:0/3082614127 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:02.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.847+0000 7f23c9aa0640 1 --1- 172.21.15.55:0/3082614127 >> v1:172.21.15.110:6789/0 conn(0x7f23c40d10c0 0x7f23c40b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:53754/0 (socket says 172.21.15.55:53754) 2023-08-25T04:21:02.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.847+0000 7f23c8a9e640 1 -- 172.21.15.55:0/3082614127 >> v2:172.21.15.110:3300/0 conn(0x7f23c41601f0 msgr2=0x7f23c415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:02.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.847+0000 7f23c8a9e640 1 --2- 172.21.15.55:0/3082614127 >> v2:172.21.15.110:3300/0 conn(0x7f23c41601f0 0x7f23c415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.847+0000 7f23c8a9e640 1 -- 172.21.15.55:0/3082614127 >> v1:172.21.15.110:6789/0 conn(0x7f23c40d10c0 legacy=0x7f23c40b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:02.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.847+0000 7f23c8a9e640 1 -- 172.21.15.55:0/3082614127 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c40cdb60 con 0x7f23c415e3c0 2023-08-25T04:21:02.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.851+0000 7f23c8a9e640 1 --2- 172.21.15.55:0/3082614127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c415e3c0 0x7f23c40d0b80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009870 tx=0x7f23b401ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bcb1aa6b75af080 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:02.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.851+0000 7f23bbfff640 1 -- 172.21.15.55:0/3082614127 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b40a8a30 con 0x7f23c415e3c0 2023-08-25T04:21:02.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.851+0000 7f23bbfff640 1 -- 172.21.15.55:0/3082614127 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b40a8b90 con 0x7f23c415e3c0 2023-08-25T04:21:02.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.851+0000 7f23bbfff640 1 -- 172.21.15.55:0/3082614127 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b40b0440 con 0x7f23c415e3c0 2023-08-25T04:21:02.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.851+0000 7f23cb503640 1 -- 172.21.15.55:0/3082614127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c415e3c0 msgr2=0x7f23c40d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:02.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.851+0000 7f23cb503640 1 --2- 172.21.15.55:0/3082614127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c415e3c0 0x7f23c40d0b80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f23b4009870 tx=0x7f23b401ed30 comp rx=0 tx=0).stop 2023-08-25T04:21:02.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.851+0000 7f23cb503640 1 -- 172.21.15.55:0/3082614127 shutdown_connections 2023-08-25T04:21:02.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.851+0000 7f23cb503640 1 --2- 172.21.15.55:0/3082614127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c415e3c0 0x7f23c40d0b80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.851+0000 7f23cb503640 1 --2- 172.21.15.55:0/3082614127 >> v2:172.21.15.110:3300/0 conn(0x7f23c41601f0 0x7f23c415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.851+0000 7f23cb503640 1 -- 172.21.15.55:0/3082614127 >> 172.21.15.55:0/3082614127 conn(0x7f23c40d27d0 msgr2=0x7f23c40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:02.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.851+0000 7f23cb503640 1 -- 172.21.15.55:0/3082614127 shutdown_connections 2023-08-25T04:21:02.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.851+0000 7f23cb503640 1 -- 172.21.15.55:0/3082614127 wait complete. 2023-08-25T04:21:02.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23cb503640 1 Processor -- start 2023-08-25T04:21:02.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23cb503640 1 -- start start 2023-08-25T04:21:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23cb503640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c40d10c0 0x7f23c415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23cb503640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c415e3c0 0x7f23c409e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23cb503640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c41601f0 0x7f23c40cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23cb503640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c415d340 con 0x7f23c415e3c0 2023-08-25T04:21:02.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23cb503640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c40a0230 con 0x7f23c41601f0 2023-08-25T04:21:02.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23cb503640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c409ea00 con 0x7f23c40d10c0 2023-08-25T04:21:02.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23c8a9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c415e3c0 0x7f23c409e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:02.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23c929f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c40d10c0 0x7f23c415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:02.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23c929f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c40d10c0 0x7f23c415ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:60836/0 (socket says 172.21.15.55:60836) 2023-08-25T04:21:02.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23c929f640 1 -- 172.21.15.55:0/3414399148 learned_addr learned my addr 172.21.15.55:0/3414399148 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:02.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23c9aa0640 1 --2- 172.21.15.55:0/3414399148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c41601f0 0x7f23c40cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:02.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23c8a9e640 1 -- 172.21.15.55:0/3414399148 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c40d10c0 msgr2=0x7f23c415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:02.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23c8a9e640 1 --2- 172.21.15.55:0/3414399148 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c40d10c0 0x7f23c415ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23c8a9e640 1 -- 172.21.15.55:0/3414399148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c41601f0 msgr2=0x7f23c40cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:02.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23c8a9e640 1 --2- 172.21.15.55:0/3414399148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c41601f0 0x7f23c40cba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:02.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23c8a9e640 1 -- 172.21.15.55:0/3414399148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b40094d0 con 0x7f23c415e3c0 2023-08-25T04:21:02.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23c929f640 1 --2- 172.21.15.55:0/3414399148 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c40d10c0 0x7f23c415ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:02.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23c8a9e640 1 --2- 172.21.15.55:0/3414399148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c415e3c0 0x7f23c409e4c0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f23b40af000 tx=0x7f23b401bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:02.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23b9ffb640 1 -- 172.21.15.55:0/3414399148 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b40ba600 con 0x7f23c415e3c0 2023-08-25T04:21:02.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23b9ffb640 1 -- 172.21.15.55:0/3414399148 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b40ba780 con 0x7f23c415e3c0 2023-08-25T04:21:02.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23b9ffb640 1 -- 172.21.15.55:0/3414399148 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b40bab30 con 0x7f23c415e3c0 2023-08-25T04:21:02.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23cb503640 1 -- 172.21.15.55:0/3414399148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c41f3420 con 0x7f23c415e3c0 2023-08-25T04:21:02.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.855+0000 7f23cb503640 1 -- 172.21.15.55:0/3414399148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c409d9e0 con 0x7f23c415e3c0 2023-08-25T04:21:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.859+0000 7f23cb503640 1 -- 172.21.15.55:0/3414399148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c40b5260 con 0x7f23c415e3c0 2023-08-25T04:21:02.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.859+0000 7f23b9ffb640 1 -- 172.21.15.55:0/3414399148 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 52) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f23b40bac90 con 0x7f23c415e3c0 2023-08-25T04:21:02.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.859+0000 7f23b9ffb640 1 --2- 172.21.15.55:0/3414399148 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f23a80658c0 0x7f23a8067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:02.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.859+0000 7f23b9ffb640 1 -- 172.21.15.55:0/3414399148 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f23b41218c0 con 0x7f23c415e3c0 2023-08-25T04:21:02.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.859+0000 7f23c929f640 1 -- 172.21.15.55:0/3414399148 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f23a80658c0 msgr2=0x7f23a8067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4020134262 2023-08-25T04:21:02.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.859+0000 7f23c929f640 1 --2- 172.21.15.55:0/3414399148 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f23a80658c0 0x7f23a8067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:21:02.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:02.863+0000 7f23b9ffb640 1 -- 172.21.15.55:0/3414399148 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f23b40eedb0 con 0x7f23c415e3c0 2023-08-25T04:21:02.974 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:02.975+0000 7fcb5900c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:21:03.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.019+0000 7f23cb503640 1 -- 172.21.15.55:0/3414399148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f23c4073ec0 con 0x7f23c415e3c0 2023-08-25T04:21:03.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.019+0000 7f23b9ffb640 1 -- 172.21.15.55:0/3414399148 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v110) v1 ==== 92+0+10 (secure 0 0 0) 0x7f23b40f23d0 con 0x7f23c415e3c0 2023-08-25T04:21:03.017 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:21:03.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.023+0000 7f23cb503640 1 -- 172.21.15.55:0/3414399148 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f23a80658c0 msgr2=0x7f23a8067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:21:03.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.023+0000 7f23cb503640 1 --2- 172.21.15.55:0/3414399148 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f23a80658c0 0x7f23a8067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.023+0000 7f23cb503640 1 -- 172.21.15.55:0/3414399148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c415e3c0 msgr2=0x7f23c409e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:03.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.023+0000 7f23cb503640 1 --2- 172.21.15.55:0/3414399148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c415e3c0 0x7f23c409e4c0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f23b40af000 tx=0x7f23b401bad0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.023+0000 7f23cb503640 1 -- 172.21.15.55:0/3414399148 shutdown_connections 2023-08-25T04:21:03.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.023+0000 7f23cb503640 1 --2- 172.21.15.55:0/3414399148 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c41601f0 0x7f23c40cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.023+0000 7f23cb503640 1 --2- 172.21.15.55:0/3414399148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c415e3c0 0x7f23c409e4c0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.023+0000 7f23cb503640 1 --2- 172.21.15.55:0/3414399148 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f23a80658c0 0x7f23a8067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.023+0000 7f23cb503640 1 --2- 172.21.15.55:0/3414399148 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c40d10c0 0x7f23c415ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.023+0000 7f23cb503640 1 -- 172.21.15.55:0/3414399148 >> 172.21.15.55:0/3414399148 conn(0x7f23c40d27d0 msgr2=0x7f23c406aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:03.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.023+0000 7f23cb503640 1 -- 172.21.15.55:0/3414399148 shutdown_connections 2023-08-25T04:21:03.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.023+0000 7f23cb503640 1 -- 172.21.15.55:0/3414399148 wait complete. 2023-08-25T04:21:03.032 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:03.031+0000 7fcb5900c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:21:03.039 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:21:03.070 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:03.071+0000 7fa0dc446180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:21:03.087 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:03.087+0000 7fcb5900c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:21:03.133 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:03.135+0000 7fa0dc446180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:21:03.171 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:03.171+0000 7fcb5900c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:21:03.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.191+0000 7f111d25f640 1 Processor -- start 2023-08-25T04:21:03.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.191+0000 7f111d25f640 1 -- start start 2023-08-25T04:21:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.191+0000 7f111d25f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f111815e3c0 0x7f111815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.191+0000 7f111d25f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11180cd5a0 con 0x7f11180d1290 2023-08-25T04:21:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.191+0000 7f111d25f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11180cd880 con 0x7f11181601f0 2023-08-25T04:21:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.191+0000 7f111d25f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11180cdb60 con 0x7f111815e3c0 2023-08-25T04:21:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.191+0000 7f110ffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f111815e3c0 0x7f111815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.191+0000 7f111759e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f11180d1290 0x7f111815e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39084/0 (socket says 172.21.15.55:39084) 2023-08-25T04:21:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.191+0000 7f111759e640 1 -- 172.21.15.55:0/3823676222 learned_addr learned my addr 172.21.15.55:0/3823676222 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:03.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.191+0000 7f110ffff640 1 -- 172.21.15.55:0/3823676222 >> v1:172.21.15.110:6789/0 conn(0x7f11181601f0 legacy=0x7f11180d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:03.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.191+0000 7f110ffff640 1 -- 172.21.15.55:0/3823676222 >> v1:172.21.15.55:6789/0 conn(0x7f11180d1290 legacy=0x7f111815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:03.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.191+0000 7f110ffff640 1 -- 172.21.15.55:0/3823676222 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11180cde40 con 0x7f111815e3c0 2023-08-25T04:21:03.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.191+0000 7f111659c640 1 -- 172.21.15.55:0/3823676222 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283231794 0 0) 0x7f11180cd5a0 con 0x7f11180d1290 2023-08-25T04:21:03.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.195+0000 7f110ffff640 1 --2- 172.21.15.55:0/3823676222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f111815e3c0 0x7f111815d430 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f11000097c0 tx=0x7f110001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f13733e7f98882a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.195+0000 7f111659c640 1 -- 172.21.15.55:0/3823676222 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11000ab600 con 0x7f111815e3c0 2023-08-25T04:21:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.195+0000 7f111659c640 1 -- 172.21.15.55:0/3823676222 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11000a7050 con 0x7f111815e3c0 2023-08-25T04:21:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.195+0000 7f111659c640 1 -- 172.21.15.55:0/3823676222 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11000ab980 con 0x7f111815e3c0 2023-08-25T04:21:03.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.195+0000 7f111d25f640 1 -- 172.21.15.55:0/3823676222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f111815e3c0 msgr2=0x7f111815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:03.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.195+0000 7f111d25f640 1 --2- 172.21.15.55:0/3823676222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f111815e3c0 0x7f111815d430 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f11000097c0 tx=0x7f110001c450 comp rx=0 tx=0).stop 2023-08-25T04:21:03.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.195+0000 7f111d25f640 1 -- 172.21.15.55:0/3823676222 shutdown_connections 2023-08-25T04:21:03.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.195+0000 7f111d25f640 1 --2- 172.21.15.55:0/3823676222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f111815e3c0 0x7f111815d430 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.195+0000 7f111d25f640 1 -- 172.21.15.55:0/3823676222 >> 172.21.15.55:0/3823676222 conn(0x7f11180d27d0 msgr2=0x7f11180d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:03.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.195+0000 7f111d25f640 1 -- 172.21.15.55:0/3823676222 shutdown_connections 2023-08-25T04:21:03.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.195+0000 7f111d25f640 1 -- 172.21.15.55:0/3823676222 wait complete. 2023-08-25T04:21:03.195 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:03.195+0000 7fa0dc446180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:21:03.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f111d25f640 1 Processor -- start 2023-08-25T04:21:03.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f111d25f640 1 -- start start 2023-08-25T04:21:03.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f111d25f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11180d1290 0x7f1118157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f111d25f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f111815e3c0 0x7f11180affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f111d25f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11181601f0 0x7f11180b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f111d25f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11181580c0 con 0x7f111815e3c0 2023-08-25T04:21:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f111d25f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11181f5cf0 con 0x7f11180d1290 2023-08-25T04:21:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f111d25f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11181f62b0 con 0x7f11181601f0 2023-08-25T04:21:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f110ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f111815e3c0 0x7f11180affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f110ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f111815e3c0 0x7f11180affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57090/0 (socket says 172.21.15.55:57090) 2023-08-25T04:21:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f110ffff640 1 -- 172.21.15.55:0/3492954175 learned_addr learned my addr 172.21.15.55:0/3492954175 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f111759e640 1 --2- 172.21.15.55:0/3492954175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11181601f0 0x7f11180b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f1116d9d640 1 --2- 172.21.15.55:0/3492954175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11180d1290 0x7f1118157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f110ffff640 1 -- 172.21.15.55:0/3492954175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11181601f0 msgr2=0x7f11180b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f110ffff640 1 --2- 172.21.15.55:0/3492954175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11181601f0 0x7f11180b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f110ffff640 1 -- 172.21.15.55:0/3492954175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11180d1290 msgr2=0x7f1118157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f110ffff640 1 --2- 172.21.15.55:0/3492954175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11180d1290 0x7f1118157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f110ffff640 1 -- 172.21.15.55:0/3492954175 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1100009420 con 0x7f111815e3c0 2023-08-25T04:21:03.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f1116d9d640 1 --2- 172.21.15.55:0/3492954175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11180d1290 0x7f1118157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:03.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f110ffff640 1 --2- 172.21.15.55:0/3492954175 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f111815e3c0 0x7f11180affa0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f1100019060 tx=0x7f11000191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:03.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f110f7fe640 1 -- 172.21.15.55:0/3492954175 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11000b4840 con 0x7f111815e3c0 2023-08-25T04:21:03.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f110f7fe640 1 -- 172.21.15.55:0/3492954175 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11000b49c0 con 0x7f111815e3c0 2023-08-25T04:21:03.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f111d25f640 1 -- 172.21.15.55:0/3492954175 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11180b08d0 con 0x7f111815e3c0 2023-08-25T04:21:03.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f110f7fe640 1 -- 172.21.15.55:0/3492954175 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11000b4d70 con 0x7f111815e3c0 2023-08-25T04:21:03.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.199+0000 7f111d25f640 1 -- 172.21.15.55:0/3492954175 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11181f5f40 con 0x7f111815e3c0 2023-08-25T04:21:03.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.203+0000 7f111d25f640 1 -- 172.21.15.55:0/3492954175 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11180b5260 con 0x7f111815e3c0 2023-08-25T04:21:03.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.203+0000 7f110f7fe640 1 -- 172.21.15.55:0/3492954175 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 52) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f11000b2040 con 0x7f111815e3c0 2023-08-25T04:21:03.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.203+0000 7f110f7fe640 1 --2- 172.21.15.55:0/3492954175 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f10f80658c0 0x7f10f8067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:03.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.203+0000 7f110f7fe640 1 -- 172.21.15.55:0/3492954175 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f110011d7b0 con 0x7f111815e3c0 2023-08-25T04:21:03.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.203+0000 7f1116d9d640 1 -- 172.21.15.55:0/3492954175 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f10f80658c0 msgr2=0x7f10f8067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4020134262 2023-08-25T04:21:03.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.203+0000 7f1116d9d640 1 --2- 172.21.15.55:0/3492954175 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f10f80658c0 0x7f10f8067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:21:03.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.207+0000 7f110f7fe640 1 -- 172.21.15.55:0/3492954175 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f11000eacc0 con 0x7f111815e3c0 2023-08-25T04:21:03.230 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:03.231+0000 7fcb5900c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:21:03.288 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:03.291+0000 7fa0dc446180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:21:03.313 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:03.315+0000 7fcb5900c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:21:03.347 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:03.351+0000 7fa0dc446180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:21:03.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.363+0000 7f111d25f640 1 -- 172.21.15.55:0/3492954175 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1118073ec0 con 0x7f111815e3c0 2023-08-25T04:21:03.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.363+0000 7f110f7fe640 1 -- 172.21.15.55:0/3492954175 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7f11000ee2e0 con 0x7f111815e3c0 2023-08-25T04:21:03.363 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:21:03.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.367+0000 7f111d25f640 1 -- 172.21.15.55:0/3492954175 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f10f80658c0 msgr2=0x7f10f8067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:21:03.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.367+0000 7f111d25f640 1 --2- 172.21.15.55:0/3492954175 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f10f80658c0 0x7f10f8067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.367+0000 7f111d25f640 1 -- 172.21.15.55:0/3492954175 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f111815e3c0 msgr2=0x7f11180affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:03.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.367+0000 7f111d25f640 1 --2- 172.21.15.55:0/3492954175 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f111815e3c0 0x7f11180affa0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f1100019060 tx=0x7f11000191f0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.367+0000 7f111d25f640 1 -- 172.21.15.55:0/3492954175 shutdown_connections 2023-08-25T04:21:03.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.367+0000 7f111d25f640 1 --2- 172.21.15.55:0/3492954175 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f10f80658c0 0x7f10f8067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.367+0000 7f111d25f640 1 --2- 172.21.15.55:0/3492954175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11181601f0 0x7f11180b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.367+0000 7f111d25f640 1 --2- 172.21.15.55:0/3492954175 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f111815e3c0 0x7f11180affa0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.367+0000 7f111d25f640 1 --2- 172.21.15.55:0/3492954175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f11180d1290 0x7f1118157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.367+0000 7f111d25f640 1 -- 172.21.15.55:0/3492954175 >> 172.21.15.55:0/3492954175 conn(0x7f11180d27d0 msgr2=0x7f11180cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:03.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.367+0000 7f111d25f640 1 -- 172.21.15.55:0/3492954175 shutdown_connections 2023-08-25T04:21:03.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.367+0000 7f111d25f640 1 -- 172.21.15.55:0/3492954175 wait complete. 2023-08-25T04:21:03.368 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:03.367+0000 7fcb5900c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:21:03.385 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:21:03.438 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:03.439+0000 7fa0dc446180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:21:03.499 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:03.499+0000 7fa0dc446180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:21:03.510 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:03.511+0000 7fcb5900c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:21:03.567 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:03.567+0000 7fcb5900c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:21:03.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.575+0000 7f28df893640 1 Processor -- start 2023-08-25T04:21:03.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.575+0000 7f28df893640 1 -- start start 2023-08-25T04:21:03.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.579+0000 7f28df893640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28d81601f0 0x7f28d815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:03.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.579+0000 7f28df893640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28d815e3c0 0x7f28d80d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:03.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.579+0000 7f28df893640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d80d10c0 0x7f28d80b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:03.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.579+0000 7f28df893640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d80cd5a0 con 0x7f28d81601f0 2023-08-25T04:21:03.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.579+0000 7f28df893640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d80cd880 con 0x7f28d815e3c0 2023-08-25T04:21:03.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.579+0000 7f28df893640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d80cdb60 con 0x7f28d80d10c0 2023-08-25T04:21:03.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.579+0000 7f28dd62f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28d81601f0 0x7f28d815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:03.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.579+0000 7f28dd62f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f28d81601f0 0x7f28d815d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57106/0 (socket says 172.21.15.55:57106) 2023-08-25T04:21:03.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.579+0000 7f28dd62f640 1 -- 172.21.15.55:0/3425829100 learned_addr learned my addr 172.21.15.55:0/3425829100 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:03.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.579+0000 7f28dce2e640 1 --2- 172.21.15.55:0/3425829100 >> v2:172.21.15.110:3300/0 conn(0x7f28d815e3c0 0x7f28d80d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:03.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.579+0000 7f28dde30640 1 --2- 172.21.15.55:0/3425829100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d80d10c0 0x7f28d80b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:03.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.579+0000 7f28dd62f640 1 -- 172.21.15.55:0/3425829100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d80d10c0 msgr2=0x7f28d80b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:03.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.579+0000 7f28dd62f640 1 --2- 172.21.15.55:0/3425829100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d80d10c0 0x7f28d80b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.579+0000 7f28dd62f640 1 -- 172.21.15.55:0/3425829100 >> v2:172.21.15.110:3300/0 conn(0x7f28d815e3c0 msgr2=0x7f28d80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:03.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.579+0000 7f28dd62f640 1 --2- 172.21.15.55:0/3425829100 >> v2:172.21.15.110:3300/0 conn(0x7f28d815e3c0 0x7f28d80d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.579+0000 7f28dd62f640 1 -- 172.21.15.55:0/3425829100 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d80cde40 con 0x7f28d81601f0 2023-08-25T04:21:03.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.579+0000 7f28dce2e640 1 --2- 172.21.15.55:0/3425829100 >> v2:172.21.15.110:3300/0 conn(0x7f28d815e3c0 0x7f28d80d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:03.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.583+0000 7f28dd62f640 1 --2- 172.21.15.55:0/3425829100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d81601f0 0x7f28d815d430 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f28d80cd350 tx=0x7f28d401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9101dbaa5df41f12 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:03.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.583+0000 7f28cffff640 1 -- 172.21.15.55:0/3425829100 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d40a89b0 con 0x7f28d81601f0 2023-08-25T04:21:03.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.583+0000 7f28cffff640 1 -- 172.21.15.55:0/3425829100 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d40a8b10 con 0x7f28d81601f0 2023-08-25T04:21:03.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.583+0000 7f28cffff640 1 -- 172.21.15.55:0/3425829100 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d40a8ea0 con 0x7f28d81601f0 2023-08-25T04:21:03.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.583+0000 7f28df893640 1 -- 172.21.15.55:0/3425829100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d81601f0 msgr2=0x7f28d815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:03.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.583+0000 7f28df893640 1 --2- 172.21.15.55:0/3425829100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d81601f0 0x7f28d815d430 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f28d80cd350 tx=0x7f28d401ecf0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.583+0000 7f28df893640 1 -- 172.21.15.55:0/3425829100 shutdown_connections 2023-08-25T04:21:03.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.583+0000 7f28df893640 1 --2- 172.21.15.55:0/3425829100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d80d10c0 0x7f28d80b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.583+0000 7f28df893640 1 --2- 172.21.15.55:0/3425829100 >> v2:172.21.15.110:3300/0 conn(0x7f28d815e3c0 0x7f28d80d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.583+0000 7f28df893640 1 --2- 172.21.15.55:0/3425829100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d81601f0 0x7f28d815d430 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.583+0000 7f28df893640 1 -- 172.21.15.55:0/3425829100 >> 172.21.15.55:0/3425829100 conn(0x7f28d80d27d0 msgr2=0x7f28d80d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:03.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.583+0000 7f28df893640 1 -- 172.21.15.55:0/3425829100 shutdown_connections 2023-08-25T04:21:03.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.583+0000 7f28df893640 1 -- 172.21.15.55:0/3425829100 wait complete. 2023-08-25T04:21:03.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.583+0000 7f28df893640 1 Processor -- start 2023-08-25T04:21:03.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.583+0000 7f28df893640 1 -- start start 2023-08-25T04:21:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28df893640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d80d10c0 0x7f28d815ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28df893640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d815e3c0 0x7f28d80cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28df893640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28d81601f0 0x7f28d80c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28df893640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d815b220 con 0x7f28d815e3c0 2023-08-25T04:21:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28df893640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d80c71d0 con 0x7f28d81601f0 2023-08-25T04:21:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28df893640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d80c74b0 con 0x7f28d80d10c0 2023-08-25T04:21:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28dce2e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d815e3c0 0x7f28d80cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28dd62f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d80d10c0 0x7f28d815ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28dce2e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d815e3c0 0x7f28d80cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57112/0 (socket says 172.21.15.55:57112) 2023-08-25T04:21:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28dce2e640 1 -- 172.21.15.55:0/1554450353 learned_addr learned my addr 172.21.15.55:0/1554450353 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28dde30640 1 --2- 172.21.15.55:0/1554450353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28d81601f0 0x7f28d80c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28dce2e640 1 -- 172.21.15.55:0/1554450353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d80d10c0 msgr2=0x7f28d815ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28dce2e640 1 --2- 172.21.15.55:0/1554450353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d80d10c0 0x7f28d815ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28dce2e640 1 -- 172.21.15.55:0/1554450353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28d81601f0 msgr2=0x7f28d80c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28dce2e640 1 --2- 172.21.15.55:0/1554450353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28d81601f0 0x7f28d80c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28dce2e640 1 -- 172.21.15.55:0/1554450353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c8009420 con 0x7f28d815e3c0 2023-08-25T04:21:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28dd62f640 1 --2- 172.21.15.55:0/1554450353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d80d10c0 0x7f28d815ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28dce2e640 1 --2- 172.21.15.55:0/1554450353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d815e3c0 0x7f28d80cbc30 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f28c800ebe0 tx=0x7f28c800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:03.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28cdffb640 1 -- 172.21.15.55:0/1554450353 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c800eee0 con 0x7f28d815e3c0 2023-08-25T04:21:03.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28cdffb640 1 -- 172.21.15.55:0/1554450353 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c800cc30 con 0x7f28d815e3c0 2023-08-25T04:21:03.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28cdffb640 1 -- 172.21.15.55:0/1554450353 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c8013470 con 0x7f28d815e3c0 2023-08-25T04:21:03.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28df893640 1 -- 172.21.15.55:0/1554450353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d4009480 con 0x7f28d815e3c0 2023-08-25T04:21:03.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28df893640 1 -- 172.21.15.55:0/1554450353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d80ce7c0 con 0x7f28d815e3c0 2023-08-25T04:21:03.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.587+0000 7f28df893640 1 -- 172.21.15.55:0/1554450353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d80b5260 con 0x7f28d815e3c0 2023-08-25T04:21:03.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.591+0000 7f28cdffb640 1 -- 172.21.15.55:0/1554450353 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 52) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f28c80135d0 con 0x7f28d815e3c0 2023-08-25T04:21:03.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.591+0000 7f28cdffb640 1 --2- 172.21.15.55:0/1554450353 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f28bc0658c0 0x7f28bc067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:03.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.591+0000 7f28cdffb640 1 -- 172.21.15.55:0/1554450353 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f28c8083700 con 0x7f28d815e3c0 2023-08-25T04:21:03.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.591+0000 7f28dd62f640 1 -- 172.21.15.55:0/1554450353 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f28bc0658c0 msgr2=0x7f28bc067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4020134262 2023-08-25T04:21:03.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.591+0000 7f28dd62f640 1 --2- 172.21.15.55:0/1554450353 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f28bc0658c0 0x7f28bc067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:21:03.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.595+0000 7f28cdffb640 1 -- 172.21.15.55:0/1554450353 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f28c8050c70 con 0x7f28d815e3c0 2023-08-25T04:21:03.654 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:03.655+0000 7fa0dc446180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:21:03.717 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:03.719+0000 7fa0dc446180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:21:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.751+0000 7f28df893640 1 -- 172.21.15.55:0/1554450353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28d8073ec0 con 0x7f28d815e3c0 2023-08-25T04:21:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.751+0000 7f28cdffb640 1 -- 172.21.15.55:0/1554450353 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28c8054290 con 0x7f28d815e3c0 2023-08-25T04:21:03.750 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:21:03.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.755+0000 7f28df893640 1 -- 172.21.15.55:0/1554450353 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f28bc0658c0 msgr2=0x7f28bc067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:21:03.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.755+0000 7f28df893640 1 --2- 172.21.15.55:0/1554450353 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f28bc0658c0 0x7f28bc067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.755+0000 7f28df893640 1 -- 172.21.15.55:0/1554450353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d815e3c0 msgr2=0x7f28d80cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:03.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.755+0000 7f28df893640 1 --2- 172.21.15.55:0/1554450353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d815e3c0 0x7f28d80cbc30 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f28c800ebe0 tx=0x7f28c800c520 comp rx=0 tx=0).stop 2023-08-25T04:21:03.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.755+0000 7f28df893640 1 -- 172.21.15.55:0/1554450353 shutdown_connections 2023-08-25T04:21:03.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.755+0000 7f28df893640 1 --2- 172.21.15.55:0/1554450353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28d81601f0 0x7f28d80c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.755+0000 7f28df893640 1 --2- 172.21.15.55:0/1554450353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28d815e3c0 0x7f28d80cbc30 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.755+0000 7f28df893640 1 --2- 172.21.15.55:0/1554450353 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f28bc0658c0 0x7f28bc067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.755+0000 7f28df893640 1 --2- 172.21.15.55:0/1554450353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28d80d10c0 0x7f28d815ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:03.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.755+0000 7f28df893640 1 -- 172.21.15.55:0/1554450353 >> 172.21.15.55:0/1554450353 conn(0x7f28d80d27d0 msgr2=0x7f28d806c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:03.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.755+0000 7f28df893640 1 -- 172.21.15.55:0/1554450353 shutdown_connections 2023-08-25T04:21:03.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.755+0000 7f28df893640 1 -- 172.21.15.55:0/1554450353 wait complete. 2023-08-25T04:21:03.774 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:21:03.807 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:21:03.807 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:21:03.807 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:21:03.816 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:03.815+0000 7fcb5900c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:21:03.949 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:03.951+0000 7fcb5900c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:21:03.977 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:21:03.978 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:21:03.978 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:21:03.987 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:03.987+0000 7fa0dc446180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:21:03.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.999+0000 7f7e3238f640 1 Processor -- start 2023-08-25T04:21:03.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.999+0000 7f7e3238f640 1 -- start start 2023-08-25T04:21:03.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.999+0000 7f7e3238f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7e2c0d0da0 0x7f7e2c0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:03.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.999+0000 7f7e3238f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e2c0b3e50 0x7f7e2c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:03.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.999+0000 7f7e3238f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2c0b29b0 con 0x7f7e2c0cdde0 2023-08-25T04:21:03.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.999+0000 7f7e3238f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2c0ce760 con 0x7f7e2c0d0da0 2023-08-25T04:21:03.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.999+0000 7f7e3238f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0d16c0 con 0x7f7e2c0b3e50 2023-08-25T04:21:03.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.999+0000 7f7e2bfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7e2c0d0da0 0x7f7e2c0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:04.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.999+0000 7f7e3092c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e2c0b3e50 0x7f7e2c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:04.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.999+0000 7f7e2bfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7e2c0d0da0 0x7f7e2c0d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:50612/0 (socket says 172.21.15.55:50612) 2023-08-25T04:21:04.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.999+0000 7f7e2bfff640 1 -- 172.21.15.55:0/3848364308 learned_addr learned my addr 172.21.15.55:0/3848364308 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:04.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.999+0000 7f7e2bfff640 1 -- 172.21.15.55:0/3848364308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e2c0b3e50 msgr2=0x7f7e2c0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:04.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.999+0000 7f7e2bfff640 1 --2- 172.21.15.55:0/3848364308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e2c0b3e50 0x7f7e2c0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.999+0000 7f7e2bfff640 1 -- 172.21.15.55:0/3848364308 >> v1:172.21.15.110:6789/0 conn(0x7f7e2c0cdde0 legacy=0x7f7e2c0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:04.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:03.999+0000 7f7e2bfff640 1 -- 172.21.15.55:0/3848364308 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c0b1dc0 con 0x7f7e2c0d0da0 2023-08-25T04:21:04.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.003+0000 7f7e2bfff640 1 --2- 172.21.15.55:0/3848364308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2c0d0da0 0x7f7e2c0d1180 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c006fd0 tx=0x7f7e1c01ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2dd1255944c75ff server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:04.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.003+0000 7f7e2affd640 1 -- 172.21.15.55:0/3848364308 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0a8a10 con 0x7f7e2c0d0da0 2023-08-25T04:21:04.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.003+0000 7f7e2affd640 1 -- 172.21.15.55:0/3848364308 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c0a8b70 con 0x7f7e2c0d0da0 2023-08-25T04:21:04.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.003+0000 7f7e2affd640 1 -- 172.21.15.55:0/3848364308 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0b0440 con 0x7f7e2c0d0da0 2023-08-25T04:21:04.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.003+0000 7f7e3238f640 1 -- 172.21.15.55:0/3848364308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2c0d0da0 msgr2=0x7f7e2c0d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:04.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.003+0000 7f7e3238f640 1 --2- 172.21.15.55:0/3848364308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2c0d0da0 0x7f7e2c0d1180 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c006fd0 tx=0x7f7e1c01ed10 comp rx=0 tx=0).stop 2023-08-25T04:21:04.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.003+0000 7f7e3238f640 1 -- 172.21.15.55:0/3848364308 shutdown_connections 2023-08-25T04:21:04.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.003+0000 7f7e3238f640 1 --2- 172.21.15.55:0/3848364308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e2c0b3e50 0x7f7e2c0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.003+0000 7f7e3238f640 1 --2- 172.21.15.55:0/3848364308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2c0d0da0 0x7f7e2c0d1180 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.003+0000 7f7e3238f640 1 -- 172.21.15.55:0/3848364308 >> 172.21.15.55:0/3848364308 conn(0x7f7e2c09bae0 msgr2=0x7f7e2c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:04.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.003+0000 7f7e3238f640 1 -- 172.21.15.55:0/3848364308 shutdown_connections 2023-08-25T04:21:04.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.003+0000 7f7e3238f640 1 -- 172.21.15.55:0/3848364308 wait complete. 2023-08-25T04:21:04.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e3238f640 1 Processor -- start 2023-08-25T04:21:04.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e3238f640 1 -- start start 2023-08-25T04:21:04.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e3238f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e2c0b3e50 0x7f7e2c14df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:04.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e3238f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2c0cdde0 0x7f7e2c0c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:04.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e3238f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e2c0d0da0 0x7f7e2c0d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:04.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e3238f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0c7420 con 0x7f7e2c0d0da0 2023-08-25T04:21:04.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e3238f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c14e460 con 0x7f7e2c0cdde0 2023-08-25T04:21:04.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e3238f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0c6db0 con 0x7f7e2c0b3e50 2023-08-25T04:21:04.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e3092c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e2c0d0da0 0x7f7e2c0d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:04.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e2bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e2c0b3e50 0x7f7e2c14df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:04.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e2bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e2c0b3e50 0x7f7e2c14df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:60876/0 (socket says 172.21.15.55:60876) 2023-08-25T04:21:04.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e2bfff640 1 -- 172.21.15.55:0/1820604004 learned_addr learned my addr 172.21.15.55:0/1820604004 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:04.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e3092c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e2c0d0da0 0x7f7e2c0d2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57124/0 (socket says 172.21.15.55:57124) 2023-08-25T04:21:04.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e2b7fe640 1 --2- 172.21.15.55:0/1820604004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2c0cdde0 0x7f7e2c0c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:04.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e2bfff640 1 -- 172.21.15.55:0/1820604004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2c0cdde0 msgr2=0x7f7e2c0c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:04.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e2bfff640 1 --2- 172.21.15.55:0/1820604004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2c0cdde0 0x7f7e2c0c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e2bfff640 1 -- 172.21.15.55:0/1820604004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e2c0d0da0 msgr2=0x7f7e2c0d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:04.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e2bfff640 1 --2- 172.21.15.55:0/1820604004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e2c0d0da0 0x7f7e2c0d2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e2bfff640 1 -- 172.21.15.55:0/1820604004 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c009480 con 0x7f7e2c0b3e50 2023-08-25T04:21:04.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e3092c640 1 --2- 172.21.15.55:0/1820604004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e2c0d0da0 0x7f7e2c0d2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:04.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e2bfff640 1 --2- 172.21.15.55:0/1820604004 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e2c0b3e50 0x7f7e2c14df20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c01d3c0 tx=0x7f7e1c01bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:04.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e28ff9640 1 -- 172.21.15.55:0/1820604004 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0bd070 con 0x7f7e2c0b3e50 2023-08-25T04:21:04.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e28ff9640 1 -- 172.21.15.55:0/1820604004 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c0a8810 con 0x7f7e2c0b3e50 2023-08-25T04:21:04.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e28ff9640 1 -- 172.21.15.55:0/1820604004 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c003840 con 0x7f7e2c0b3e50 2023-08-25T04:21:04.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e3238f640 1 -- 172.21.15.55:0/1820604004 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2c0c7090 con 0x7f7e2c0b3e50 2023-08-25T04:21:04.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.007+0000 7f7e3238f640 1 -- 172.21.15.55:0/1820604004 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c0c79c0 con 0x7f7e2c0b3e50 2023-08-25T04:21:04.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.011+0000 7f7e3238f640 1 -- 172.21.15.55:0/1820604004 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2c04dbe0 con 0x7f7e2c0b3e50 2023-08-25T04:21:04.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.011+0000 7f7e28ff9640 1 -- 172.21.15.55:0/1820604004 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 52) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f7e1c0039a0 con 0x7f7e2c0b3e50 2023-08-25T04:21:04.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.011+0000 7f7e28ff9640 1 --2- 172.21.15.55:0/1820604004 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f7e180658c0 0x7f7e18067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:04.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.011+0000 7f7e28ff9640 1 -- 172.21.15.55:0/1820604004 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7e1c1204d0 con 0x7f7e2c0b3e50 2023-08-25T04:21:04.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.011+0000 7f7e2b7fe640 1 -- 172.21.15.55:0/1820604004 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f7e180658c0 msgr2=0x7f7e18067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4020134262 2023-08-25T04:21:04.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.011+0000 7f7e2b7fe640 1 --2- 172.21.15.55:0/1820604004 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f7e180658c0 0x7f7e18067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:21:04.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.015+0000 7f7e28ff9640 1 -- 172.21.15.55:0/1820604004 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7e1c0edad0 con 0x7f7e2c0b3e50 2023-08-25T04:21:04.075 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:04.075+0000 7fcb5900c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:21:04.134 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:04.135+0000 7fa0dc446180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:21:04.144 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:04.143+0000 7fcb5900c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:21:04.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.187+0000 7f7e3238f640 1 -- 172.21.15.55:0/1820604004 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7e2c0d0b80 con 0x7f7e2c0b3e50 2023-08-25T04:21:04.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.187+0000 7f7e28ff9640 1 -- 172.21.15.55:0/1820604004 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 9 entries v110) v1 ==== 80+0+536 (secure 0 0 0) 0x7f7e1c0f10f0 con 0x7f7e2c0b3e50 2023-08-25T04:21:04.187 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/1316478715 2023-08-26T04:19:58.502978+0000 2023-08-25T04:21:04.187 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/2779991692 2023-08-26T04:19:58.502978+0000 2023-08-25T04:21:04.187 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3403132554 2023-08-26T04:19:58.502978+0000 2023-08-25T04:21:04.187 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/2984642613 2023-08-26T04:19:58.502978+0000 2023-08-25T04:21:04.187 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6833/1337211678 2023-08-26T04:19:58.502978+0000 2023-08-25T04:21:04.188 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6832/1337211678 2023-08-26T04:19:58.502978+0000 2023-08-25T04:21:04.188 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/499210753 2023-08-26T04:19:58.502978+0000 2023-08-25T04:21:04.188 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3677413256 2023-08-26T04:19:58.502978+0000 2023-08-25T04:21:04.188 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3256947721 2023-08-25T05:19:50.681655+0000 2023-08-25T04:21:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:listed 9 entries 2023-08-25T04:21:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.191+0000 7f7e3238f640 1 -- 172.21.15.55:0/1820604004 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f7e180658c0 msgr2=0x7f7e18067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:21:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.191+0000 7f7e3238f640 1 --2- 172.21.15.55:0/1820604004 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f7e180658c0 0x7f7e18067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.191+0000 7f7e3238f640 1 -- 172.21.15.55:0/1820604004 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e2c0b3e50 msgr2=0x7f7e2c14df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.191+0000 7f7e3238f640 1 --2- 172.21.15.55:0/1820604004 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e2c0b3e50 0x7f7e2c14df20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c01d3c0 tx=0x7f7e1c01bab0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.191+0000 7f7e3238f640 1 -- 172.21.15.55:0/1820604004 shutdown_connections 2023-08-25T04:21:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.191+0000 7f7e3238f640 1 --2- 172.21.15.55:0/1820604004 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e2c0d0da0 0x7f7e2c0d2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.191+0000 7f7e3238f640 1 --2- 172.21.15.55:0/1820604004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e2c0cdde0 0x7f7e2c0c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.191+0000 7f7e3238f640 1 --2- 172.21.15.55:0/1820604004 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f7e180658c0 0x7f7e18067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.191+0000 7f7e3238f640 1 --2- 172.21.15.55:0/1820604004 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e2c0b3e50 0x7f7e2c14df20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.191+0000 7f7e3238f640 1 -- 172.21.15.55:0/1820604004 >> 172.21.15.55:0/1820604004 conn(0x7f7e2c09bae0 msgr2=0x7f7e2c06b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.191+0000 7f7e3238f640 1 -- 172.21.15.55:0/1820604004 shutdown_connections 2023-08-25T04:21:04.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.191+0000 7f7e3238f640 1 -- 172.21.15.55:0/1820604004 wait complete. 2023-08-25T04:21:04.208 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-25T04:21:04.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:04.209 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-25T04:21:04.263 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T04:21:04.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:04.264 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-25T04:21:04.273 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:04.275+0000 7fa0dc446180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:21:04.276 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:21:04.276 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:21:04.281 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:04.279+0000 7fcb5900c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:21:04.286 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:21:04.287 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:21:04.287 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:21:04.328 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T04:21:04.329 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:21:04.329 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:21:04.338 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:21:04.338 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:21:04.351 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:04.351+0000 7fa0dc446180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:21:04.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.499+0000 7f99c3434640 1 Processor -- start 2023-08-25T04:21:04.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.499+0000 7f99c3434640 1 -- start start 2023-08-25T04:21:04.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.499+0000 7f99c3434640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99bc164410 0x7f99bc0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:04.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.499+0000 7f99c3434640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f99bc0cddf0 0x7f99bc0c1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:04.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.499+0000 7f99c3434640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0cc510 con 0x7f99bc0c18b0 2023-08-25T04:21:04.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.499+0000 7f99c3434640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc0c1d60 con 0x7f99bc0cddf0 2023-08-25T04:21:04.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.499+0000 7f99c3434640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc1647f0 con 0x7f99bc164410 2023-08-25T04:21:04.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.499+0000 7f99c19d1640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f99bc0c18b0 0x7f99bc0cac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39088/0 (socket says 172.21.15.55:39088) 2023-08-25T04:21:04.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.499+0000 7f99c19d1640 1 -- 172.21.15.55:0/2109324535 learned_addr learned my addr 172.21.15.55:0/2109324535 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:04.501 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:04.499+0000 7fa0dc446180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:21:04.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.499+0000 7f99c09cf640 1 --2- 172.21.15.55:0/2109324535 >> v2:172.21.15.110:3300/0 conn(0x7f99bc0cddf0 0x7f99bc0c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:04.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.499+0000 7f99c11d0640 1 --2- 172.21.15.55:0/2109324535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99bc164410 0x7f99bc0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:04.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.503+0000 7f99b3fff640 1 -- 172.21.15.55:0/2109324535 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4099941428 0 0) 0x7f99bc0cc510 con 0x7f99bc0c18b0 2023-08-25T04:21:04.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.503+0000 7f99b3fff640 1 -- 172.21.15.55:0/2109324535 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a8003530 con 0x7f99bc0c18b0 2023-08-25T04:21:04.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.503+0000 7f99c09cf640 1 -- 172.21.15.55:0/2109324535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99bc164410 msgr2=0x7f99bc0b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:04.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.503+0000 7f99c09cf640 1 --2- 172.21.15.55:0/2109324535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99bc164410 0x7f99bc0b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.503+0000 7f99c09cf640 1 -- 172.21.15.55:0/2109324535 >> v1:172.21.15.55:6789/0 conn(0x7f99bc0c18b0 legacy=0x7f99bc0cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:04.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.503+0000 7f99c09cf640 1 -- 172.21.15.55:0/2109324535 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0cc9b0 con 0x7f99bc0cddf0 2023-08-25T04:21:04.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.503+0000 7f99c11d0640 1 --2- 172.21.15.55:0/2109324535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99bc164410 0x7f99bc0b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:04.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.503+0000 7f99c09cf640 1 --2- 172.21.15.55:0/2109324535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99bc0cddf0 0x7f99bc0c1370 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f99ac0097c0 tx=0x7f99ac01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=577628f43f1e547d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:04.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.503+0000 7f99b3fff640 1 -- 172.21.15.55:0/2109324535 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0ab600 con 0x7f99bc0cddf0 2023-08-25T04:21:04.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.503+0000 7f99b3fff640 1 -- 172.21.15.55:0/2109324535 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac0a7050 con 0x7f99bc0cddf0 2023-08-25T04:21:04.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.503+0000 7f99b3fff640 1 -- 172.21.15.55:0/2109324535 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0ab980 con 0x7f99bc0cddf0 2023-08-25T04:21:04.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.503+0000 7f99c3434640 1 -- 172.21.15.55:0/2109324535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99bc0cddf0 msgr2=0x7f99bc0c1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:04.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.503+0000 7f99c3434640 1 --2- 172.21.15.55:0/2109324535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99bc0cddf0 0x7f99bc0c1370 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f99ac0097c0 tx=0x7f99ac01c480 comp rx=0 tx=0).stop 2023-08-25T04:21:04.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c3434640 1 -- 172.21.15.55:0/2109324535 shutdown_connections 2023-08-25T04:21:04.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c3434640 1 --2- 172.21.15.55:0/2109324535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99bc0cddf0 0x7f99bc0c1370 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c3434640 1 --2- 172.21.15.55:0/2109324535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99bc164410 0x7f99bc0b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c3434640 1 -- 172.21.15.55:0/2109324535 >> 172.21.15.55:0/2109324535 conn(0x7f99bc069d00 msgr2=0x7f99bc06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:04.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c3434640 1 -- 172.21.15.55:0/2109324535 shutdown_connections 2023-08-25T04:21:04.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c3434640 1 -- 172.21.15.55:0/2109324535 wait complete. 2023-08-25T04:21:04.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c3434640 1 Processor -- start 2023-08-25T04:21:04.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c3434640 1 -- start start 2023-08-25T04:21:04.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c3434640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99bc0c18b0 0x7f99bc0c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:04.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c3434640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99bc0cddf0 0x7f99bc0c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:04.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c3434640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99bc164410 0x7f99bc0ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:04.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c3434640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0c28b0 con 0x7f99bc0cddf0 2023-08-25T04:21:04.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c3434640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0c4b70 con 0x7f99bc0c18b0 2023-08-25T04:21:04.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c3434640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0c2b00 con 0x7f99bc164410 2023-08-25T04:21:04.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c09cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99bc0cddf0 0x7f99bc0c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:04.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c11d0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99bc0c18b0 0x7f99bc0c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:04.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c09cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99bc0cddf0 0x7f99bc0c20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57132/0 (socket says 172.21.15.55:57132) 2023-08-25T04:21:04.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c09cf640 1 -- 172.21.15.55:0/701175800 learned_addr learned my addr 172.21.15.55:0/701175800 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:04.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c11d0640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99bc0c18b0 0x7f99bc0c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:50636/0 (socket says 172.21.15.55:50636) 2023-08-25T04:21:04.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c19d1640 1 --2- 172.21.15.55:0/701175800 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99bc164410 0x7f99bc0ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:04.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c09cf640 1 -- 172.21.15.55:0/701175800 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99bc164410 msgr2=0x7f99bc0ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:04.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c09cf640 1 --2- 172.21.15.55:0/701175800 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99bc164410 0x7f99bc0ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c09cf640 1 -- 172.21.15.55:0/701175800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99bc0c18b0 msgr2=0x7f99bc0c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:04.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c09cf640 1 --2- 172.21.15.55:0/701175800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99bc0c18b0 0x7f99bc0c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c09cf640 1 -- 172.21.15.55:0/701175800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b8009420 con 0x7f99bc0cddf0 2023-08-25T04:21:04.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c11d0640 1 --2- 172.21.15.55:0/701175800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99bc0c18b0 0x7f99bc0c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:04.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.507+0000 7f99c09cf640 1 --2- 172.21.15.55:0/701175800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99bc0cddf0 0x7f99bc0c20b0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f99ac01a0b0 tx=0x7f99ac01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:04.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.511+0000 7f99b1ffb640 1 -- 172.21.15.55:0/701175800 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0b7450 con 0x7f99bc0cddf0 2023-08-25T04:21:04.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.511+0000 7f99b1ffb640 1 -- 172.21.15.55:0/701175800 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac0b75d0 con 0x7f99bc0cddf0 2023-08-25T04:21:04.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.511+0000 7f99b1ffb640 1 -- 172.21.15.55:0/701175800 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0b7980 con 0x7f99bc0cddf0 2023-08-25T04:21:04.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.511+0000 7f99c3434640 1 -- 172.21.15.55:0/701175800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ac009420 con 0x7f99bc0cddf0 2023-08-25T04:21:04.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.511+0000 7f99c3434640 1 -- 172.21.15.55:0/701175800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc0c30c0 con 0x7f99bc0cddf0 2023-08-25T04:21:04.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.511+0000 7f99c3434640 1 -- 172.21.15.55:0/701175800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc04dbe0 con 0x7f99bc0cddf0 2023-08-25T04:21:04.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.511+0000 7f99b1ffb640 1 -- 172.21.15.55:0/701175800 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 52) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f99ac0b7ae0 con 0x7f99bc0cddf0 2023-08-25T04:21:04.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.511+0000 7f99b1ffb640 1 --2- 172.21.15.55:0/701175800 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f99a00658c0 0x7f99a0067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:04.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.515+0000 7f99b1ffb640 1 -- 172.21.15.55:0/701175800 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f99ac11d9f0 con 0x7f99bc0cddf0 2023-08-25T04:21:04.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.515+0000 7f99c11d0640 1 -- 172.21.15.55:0/701175800 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f99a00658c0 msgr2=0x7f99a0067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4020134262 2023-08-25T04:21:04.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.515+0000 7f99c11d0640 1 --2- 172.21.15.55:0/701175800 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f99a00658c0 0x7f99a0067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:21:04.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.515+0000 7f99b1ffb640 1 -- 172.21.15.55:0/701175800 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f99ac0eb0c0 con 0x7f99bc0cddf0 2023-08-25T04:21:04.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.703+0000 7f99c3434640 1 -- 172.21.15.55:0/701175800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99bc15b800 con 0x7f99bc0cddf0 2023-08-25T04:21:04.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.707+0000 7f99b1ffb640 1 -- 172.21.15.55:0/701175800 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f99ac0ee6e0 con 0x7f99bc0cddf0 2023-08-25T04:21:04.703 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:04.704 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3111804785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3111804785},{"type":"v1","addr":"172.21.15.110:6836","nonce":3111804785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3444442085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3444442085},{"type":"v1","addr":"172.21.15.110:6837","nonce":3444442085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":7857,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2022633620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2022633620},{"type":"v1","addr":"172.21.15.55:6834","nonce":2022633620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:19:41.282901+0000","modified":"2023-08-25T04:19:44.912410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1173226599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1173226599},{"type":"v1","addr":"172.21.15.55:6835","nonce":1173226599}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-25T04:21:04.704 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 49 2023-08-25T04:21:04.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.707+0000 7f99c3434640 1 -- 172.21.15.55:0/701175800 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f99a00658c0 msgr2=0x7f99a0067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:21:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.707+0000 7f99c3434640 1 --2- 172.21.15.55:0/701175800 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f99a00658c0 0x7f99a0067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.707+0000 7f99c3434640 1 -- 172.21.15.55:0/701175800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99bc0cddf0 msgr2=0x7f99bc0c20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.707+0000 7f99c3434640 1 --2- 172.21.15.55:0/701175800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99bc0cddf0 0x7f99bc0c20b0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f99ac01a0b0 tx=0x7f99ac01acc0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.707+0000 7f99c3434640 1 -- 172.21.15.55:0/701175800 shutdown_connections 2023-08-25T04:21:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.707+0000 7f99c3434640 1 --2- 172.21.15.55:0/701175800 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f99a00658c0 0x7f99a0067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.707+0000 7f99c3434640 1 --2- 172.21.15.55:0/701175800 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99bc164410 0x7f99bc0ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.707+0000 7f99c3434640 1 --2- 172.21.15.55:0/701175800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99bc0cddf0 0x7f99bc0c20b0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.707+0000 7f99c3434640 1 --2- 172.21.15.55:0/701175800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99bc0c18b0 0x7f99bc0c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.707+0000 7f99c3434640 1 -- 172.21.15.55:0/701175800 >> 172.21.15.55:0/701175800 conn(0x7f99bc069d00 msgr2=0x7f99bc0c94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:04.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.707+0000 7f99c3434640 1 -- 172.21.15.55:0/701175800 shutdown_connections 2023-08-25T04:21:04.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.707+0000 7f99c3434640 1 -- 172.21.15.55:0/701175800 wait complete. 2023-08-25T04:21:04.725 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:21:04.818 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:04.819+0000 7fcb5900c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:21:04.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.871+0000 7f9f36903640 1 Processor -- start 2023-08-25T04:21:04.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.871+0000 7f9f36903640 1 -- start start 2023-08-25T04:21:04.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.875+0000 7f9f36903640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f300d0da0 0x7f9f300d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:04.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.875+0000 7f9f36903640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f300b3e50 0x7f9f300ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:04.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.875+0000 7f9f36903640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f300b29b0 con 0x7f9f300cdde0 2023-08-25T04:21:04.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.875+0000 7f9f36903640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f300ce760 con 0x7f9f300d0da0 2023-08-25T04:21:04.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.875+0000 7f9f36903640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300d16c0 con 0x7f9f300b3e50 2023-08-25T04:21:04.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.875+0000 7f9f2f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9f300cdde0 0x7f9f300cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39104/0 (socket says 172.21.15.55:39104) 2023-08-25T04:21:04.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.875+0000 7f9f2f7fe640 1 -- 172.21.15.55:0/4098762849 learned_addr learned my addr 172.21.15.55:0/4098762849 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:04.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.875+0000 7f9f2ffff640 1 --2- 172.21.15.55:0/4098762849 >> v2:172.21.15.110:3300/0 conn(0x7f9f300d0da0 0x7f9f300d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:04.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.875+0000 7f9f34ea0640 1 --2- 172.21.15.55:0/4098762849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f300b3e50 0x7f9f300ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:04.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.875+0000 7f9f2effd640 1 -- 172.21.15.55:0/4098762849 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369446533 0 0) 0x7f9f300b29b0 con 0x7f9f300cdde0 2023-08-25T04:21:04.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.875+0000 7f9f2effd640 1 -- 172.21.15.55:0/4098762849 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f18003530 con 0x7f9f300cdde0 2023-08-25T04:21:04.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.875+0000 7f9f2ffff640 1 -- 172.21.15.55:0/4098762849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f300b3e50 msgr2=0x7f9f300ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:04.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.875+0000 7f9f2ffff640 1 --2- 172.21.15.55:0/4098762849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f300b3e50 0x7f9f300ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.875+0000 7f9f2ffff640 1 -- 172.21.15.55:0/4098762849 >> v1:172.21.15.55:6789/0 conn(0x7f9f300cdde0 legacy=0x7f9f300cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:04.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.875+0000 7f9f2ffff640 1 -- 172.21.15.55:0/4098762849 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f300b1dc0 con 0x7f9f300d0da0 2023-08-25T04:21:04.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.875+0000 7f9f34ea0640 1 --2- 172.21.15.55:0/4098762849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f300b3e50 0x7f9f300ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:04.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.879+0000 7f9f2ffff640 1 --2- 172.21.15.55:0/4098762849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f300d0da0 0x7f9f300d1180 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9f200097a0 tx=0x7f9f2001ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfc73f92a5240f86 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:04.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.879+0000 7f9f2effd640 1 -- 172.21.15.55:0/4098762849 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f200a8950 con 0x7f9f300d0da0 2023-08-25T04:21:04.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.879+0000 7f9f2effd640 1 -- 172.21.15.55:0/4098762849 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f200a8ab0 con 0x7f9f300d0da0 2023-08-25T04:21:04.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.879+0000 7f9f2effd640 1 -- 172.21.15.55:0/4098762849 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f200a8e40 con 0x7f9f300d0da0 2023-08-25T04:21:04.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.879+0000 7f9f36903640 1 -- 172.21.15.55:0/4098762849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f300d0da0 msgr2=0x7f9f300d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:04.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.879+0000 7f9f36903640 1 --2- 172.21.15.55:0/4098762849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f300d0da0 0x7f9f300d1180 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9f200097a0 tx=0x7f9f2001ec50 comp rx=0 tx=0).stop 2023-08-25T04:21:04.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.879+0000 7f9f36903640 1 -- 172.21.15.55:0/4098762849 shutdown_connections 2023-08-25T04:21:04.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.879+0000 7f9f36903640 1 --2- 172.21.15.55:0/4098762849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f300b3e50 0x7f9f300ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.879+0000 7f9f36903640 1 --2- 172.21.15.55:0/4098762849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f300d0da0 0x7f9f300d1180 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.879+0000 7f9f36903640 1 -- 172.21.15.55:0/4098762849 >> 172.21.15.55:0/4098762849 conn(0x7f9f3009bae0 msgr2=0x7f9f300d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:04.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.879+0000 7f9f36903640 1 -- 172.21.15.55:0/4098762849 shutdown_connections 2023-08-25T04:21:04.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.879+0000 7f9f36903640 1 -- 172.21.15.55:0/4098762849 wait complete. 2023-08-25T04:21:04.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.879+0000 7f9f36903640 1 Processor -- start 2023-08-25T04:21:04.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.879+0000 7f9f36903640 1 -- start start 2023-08-25T04:21:04.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f36903640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f300b3e50 0x7f9f30151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f36903640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f300cdde0 0x7f9f300cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f36903640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f300d0da0 0x7f9f300cef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f36903640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300c8210 con 0x7f9f300cdde0 2023-08-25T04:21:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f36903640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f301521f0 con 0x7f9f300d0da0 2023-08-25T04:21:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f36903640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300c7640 con 0x7f9f300b3e50 2023-08-25T04:21:04.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f300cdde0 0x7f9f300cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:04.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f300cdde0 0x7f9f300cbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57146/0 (socket says 172.21.15.55:57146) 2023-08-25T04:21:04.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f2f7fe640 1 -- 172.21.15.55:0/3834541418 learned_addr learned my addr 172.21.15.55:0/3834541418 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:04.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f2ffff640 1 --2- 172.21.15.55:0/3834541418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f300b3e50 0x7f9f30151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:04.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f34ea0640 1 --2- 172.21.15.55:0/3834541418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f300d0da0 0x7f9f300cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:04.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f34ea0640 1 -- 172.21.15.55:0/3834541418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f300b3e50 msgr2=0x7f9f30151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:04.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f34ea0640 1 --2- 172.21.15.55:0/3834541418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f300b3e50 0x7f9f30151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f34ea0640 1 -- 172.21.15.55:0/3834541418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f300cdde0 msgr2=0x7f9f300cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:04.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f34ea0640 1 --2- 172.21.15.55:0/3834541418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f300cdde0 0x7f9f300cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:04.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f34ea0640 1 -- 172.21.15.55:0/3834541418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f28009a70 con 0x7f9f300d0da0 2023-08-25T04:21:04.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f2f7fe640 1 --2- 172.21.15.55:0/3834541418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f300cdde0 0x7f9f300cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:04.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f34ea0640 1 --2- 172.21.15.55:0/3834541418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f300d0da0 0x7f9f300cef80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9f300b4280 tx=0x7f9f2800ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:04.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f2cff9640 1 -- 172.21.15.55:0/3834541418 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2800ccc0 con 0x7f9f300d0da0 2023-08-25T04:21:04.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f2cff9640 1 -- 172.21.15.55:0/3834541418 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2800f040 con 0x7f9f300d0da0 2023-08-25T04:21:04.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f2cff9640 1 -- 172.21.15.55:0/3834541418 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f28003be0 con 0x7f9f300d0da0 2023-08-25T04:21:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f36903640 1 -- 172.21.15.55:0/3834541418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f200093b0 con 0x7f9f300d0da0 2023-08-25T04:21:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f36903640 1 -- 172.21.15.55:0/3834541418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f300c7bc0 con 0x7f9f300d0da0 2023-08-25T04:21:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.883+0000 7f9f36903640 1 -- 172.21.15.55:0/3834541418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f300c8380 con 0x7f9f300d0da0 2023-08-25T04:21:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.887+0000 7f9f2cff9640 1 -- 172.21.15.55:0/3834541418 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 52) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f9f28014480 con 0x7f9f300d0da0 2023-08-25T04:21:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.887+0000 7f9f2cff9640 1 --2- 172.21.15.55:0/3834541418 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f9f1c0658f0 0x7f9f1c067db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.887+0000 7f9f2cff9640 1 -- 172.21.15.55:0/3834541418 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9f28083f20 con 0x7f9f300d0da0 2023-08-25T04:21:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.887+0000 7f9f2ffff640 1 -- 172.21.15.55:0/3834541418 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f9f1c0658f0 msgr2=0x7f9f1c067db0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4020134262 2023-08-25T04:21:04.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.887+0000 7f9f2ffff640 1 --2- 172.21.15.55:0/3834541418 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f9f1c0658f0 0x7f9f1c067db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:21:04.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:04.891+0000 7f9f2cff9640 1 -- 172.21.15.55:0/3834541418 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9f28051380 con 0x7f9f300d0da0 2023-08-25T04:21:04.905 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:04.907+0000 7fcb5900c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:21:05.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.047+0000 7f9f36903640 1 -- 172.21.15.55:0/3834541418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f3004dbe0 con 0x7f9f300d0da0 2023-08-25T04:21:05.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.051+0000 7f9f2cff9640 1 -- 172.21.15.55:0/3834541418 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+19082 (secure 0 0 0) 0x7f9f280549a0 con 0x7f9f300d0da0 2023-08-25T04:21:05.048 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:05.049 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":110,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:20:59.718757+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:19:39.091781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-25T04:19:40.272091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.26","mappings":[{"from":1,"to":7}]},{"pgid":"14.2a","mappings":[{"from":1,"to":5}]},{"pgid":"14.2c","mappings":[{"from":1,"to":7}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/1316478715":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/2779991692":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/3403132554":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/2984642613":"2023-08-26T04:19:58.502978+0000","172.21.15.110:6833/1337211678":"2023-08-26T04:19:58.502978+0000","172.21.15.110:6832/1337211678":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/499210753":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/3677413256":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/3256947721":"2023-08-25T05:19:50.681655+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:21:05.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.051+0000 7f9f36903640 1 -- 172.21.15.55:0/3834541418 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f9f1c0658f0 msgr2=0x7f9f1c067db0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:21:05.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.051+0000 7f9f36903640 1 --2- 172.21.15.55:0/3834541418 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f9f1c0658f0 0x7f9f1c067db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.051+0000 7f9f36903640 1 -- 172.21.15.55:0/3834541418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f300d0da0 msgr2=0x7f9f300cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:05.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.051+0000 7f9f36903640 1 --2- 172.21.15.55:0/3834541418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f300d0da0 0x7f9f300cef80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9f300b4280 tx=0x7f9f2800ef90 comp rx=0 tx=0).stop 2023-08-25T04:21:05.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.051+0000 7f9f36903640 1 -- 172.21.15.55:0/3834541418 shutdown_connections 2023-08-25T04:21:05.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.051+0000 7f9f36903640 1 --2- 172.21.15.55:0/3834541418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f300d0da0 0x7f9f300cef80 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.051+0000 7f9f36903640 1 --2- 172.21.15.55:0/3834541418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f300cdde0 0x7f9f300cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.051+0000 7f9f36903640 1 --2- 172.21.15.55:0/3834541418 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f9f1c0658f0 0x7f9f1c067db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.051+0000 7f9f36903640 1 --2- 172.21.15.55:0/3834541418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f300b3e50 0x7f9f30151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.051+0000 7f9f36903640 1 -- 172.21.15.55:0/3834541418 >> 172.21.15.55:0/3834541418 conn(0x7f9f3009bae0 msgr2=0x7f9f3006b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:05.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.051+0000 7f9f36903640 1 -- 172.21.15.55:0/3834541418 shutdown_connections 2023-08-25T04:21:05.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.051+0000 7f9f36903640 1 -- 172.21.15.55:0/3834541418 wait complete. 2023-08-25T04:21:05.053 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:05.051+0000 7fcb5900c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:21:05.071 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:19:39.091781+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '105', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:19:40.272091+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:21:05.072 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:21:05.083 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:05.087+0000 7fa0dc446180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:21:05.135 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:05.135+0000 7fcb5900c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:21:05.177 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:05.179+0000 7fa0dc446180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:21:05.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.223+0000 7f2ebb7ba640 1 Processor -- start 2023-08-25T04:21:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.223+0000 7f2ebb7ba640 1 -- start start 2023-08-25T04:21:05.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.223+0000 7f2ebb7ba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2eb41601f0 0x7f2eb415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:05.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.223+0000 7f2ebb7ba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb40cd5a0 con 0x7f2eb40d1290 2023-08-25T04:21:05.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.223+0000 7f2ebb7ba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb40cd880 con 0x7f2eb415e3c0 2023-08-25T04:21:05.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.223+0000 7f2ebb7ba640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb40cdb60 con 0x7f2eb41601f0 2023-08-25T04:21:05.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.223+0000 7f2eb9556640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2eb41601f0 0x7f2eb415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:05.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.223+0000 7f2eb9556640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2eb41601f0 0x7f2eb415d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57148/0 (socket says 172.21.15.55:57148) 2023-08-25T04:21:05.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.223+0000 7f2eb9556640 1 -- 172.21.15.55:0/1037302817 learned_addr learned my addr 172.21.15.55:0/1037302817 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:05.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.227+0000 7f2eb9556640 1 -- 172.21.15.55:0/1037302817 >> v1:172.21.15.110:6789/0 conn(0x7f2eb415e3c0 legacy=0x7f2eb40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:05.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.227+0000 7f2eb9556640 1 -- 172.21.15.55:0/1037302817 >> v1:172.21.15.55:6789/0 conn(0x7f2eb40d1290 legacy=0x7f2eb415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:05.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.227+0000 7f2eb9556640 1 -- 172.21.15.55:0/1037302817 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb40cde40 con 0x7f2eb41601f0 2023-08-25T04:21:05.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.227+0000 7f2eb9556640 1 --2- 172.21.15.55:0/1037302817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2eb41601f0 0x7f2eb415d430 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009860 tx=0x7f2eb001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6edf42284b8f1e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:05.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.227+0000 7f2eabfff640 1 -- 172.21.15.55:0/1037302817 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00ab610 con 0x7f2eb41601f0 2023-08-25T04:21:05.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.227+0000 7f2eabfff640 1 -- 172.21.15.55:0/1037302817 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb00ab770 con 0x7f2eb41601f0 2023-08-25T04:21:05.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.227+0000 7f2eabfff640 1 -- 172.21.15.55:0/1037302817 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00abb00 con 0x7f2eb41601f0 2023-08-25T04:21:05.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2ebb7ba640 1 -- 172.21.15.55:0/1037302817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2eb41601f0 msgr2=0x7f2eb415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:05.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2ebb7ba640 1 --2- 172.21.15.55:0/1037302817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2eb41601f0 0x7f2eb415d430 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009860 tx=0x7f2eb001c4f0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2ebb7ba640 1 -- 172.21.15.55:0/1037302817 shutdown_connections 2023-08-25T04:21:05.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2ebb7ba640 1 --2- 172.21.15.55:0/1037302817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2eb41601f0 0x7f2eb415d430 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2ebb7ba640 1 -- 172.21.15.55:0/1037302817 >> 172.21.15.55:0/1037302817 conn(0x7f2eb40d27d0 msgr2=0x7f2eb40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:05.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2ebb7ba640 1 -- 172.21.15.55:0/1037302817 shutdown_connections 2023-08-25T04:21:05.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2ebb7ba640 1 -- 172.21.15.55:0/1037302817 wait complete. 2023-08-25T04:21:05.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2ebb7ba640 1 Processor -- start 2023-08-25T04:21:05.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2ebb7ba640 1 -- start start 2023-08-25T04:21:05.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2ebb7ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2eb40d1290 0x7f2eb4155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:05.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2ebb7ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2eb415e3c0 0x7f2eb40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:05.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2ebb7ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb41601f0 0x7f2eb40cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:05.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2ebb7ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb40c8c40 con 0x7f2eb40d1290 2023-08-25T04:21:05.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2ebb7ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb40ca900 con 0x7f2eb41601f0 2023-08-25T04:21:05.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2ebb7ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb40caba0 con 0x7f2eb415e3c0 2023-08-25T04:21:05.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2eb9556640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2eb40d1290 0x7f2eb4155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:05.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2eb9556640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2eb40d1290 0x7f2eb4155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57164/0 (socket says 172.21.15.55:57164) 2023-08-25T04:21:05.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2eb9556640 1 -- 172.21.15.55:0/3644381486 learned_addr learned my addr 172.21.15.55:0/3644381486 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:05.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2eb8d55640 1 --2- 172.21.15.55:0/3644381486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2eb415e3c0 0x7f2eb40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:05.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.231+0000 7f2eb9d57640 1 --2- 172.21.15.55:0/3644381486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb41601f0 0x7f2eb40cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:05.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.235+0000 7f2eb9556640 1 -- 172.21.15.55:0/3644381486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2eb415e3c0 msgr2=0x7f2eb40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:05.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.235+0000 7f2eb9556640 1 --2- 172.21.15.55:0/3644381486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2eb415e3c0 0x7f2eb40cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.235+0000 7f2eb9556640 1 -- 172.21.15.55:0/3644381486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb41601f0 msgr2=0x7f2eb40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:05.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.235+0000 7f2eb9556640 1 --2- 172.21.15.55:0/3644381486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb41601f0 0x7f2eb40cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.235+0000 7f2eb9556640 1 -- 172.21.15.55:0/3644381486 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb0009470 con 0x7f2eb40d1290 2023-08-25T04:21:05.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.235+0000 7f2eb9556640 1 --2- 172.21.15.55:0/3644381486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2eb40d1290 0x7f2eb4155d00 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00ad040 tx=0x7f2eb001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:05.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.235+0000 7f2ea9ffb640 1 -- 172.21.15.55:0/3644381486 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00b4800 con 0x7f2eb40d1290 2023-08-25T04:21:05.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.235+0000 7f2ea9ffb640 1 -- 172.21.15.55:0/3644381486 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb00b4980 con 0x7f2eb40d1290 2023-08-25T04:21:05.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.235+0000 7f2ebb7ba640 1 -- 172.21.15.55:0/3644381486 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb40cae80 con 0x7f2eb40d1290 2023-08-25T04:21:05.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.235+0000 7f2ea9ffb640 1 -- 172.21.15.55:0/3644381486 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00b4d30 con 0x7f2eb40d1290 2023-08-25T04:21:05.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.235+0000 7f2ebb7ba640 1 -- 172.21.15.55:0/3644381486 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb40cb440 con 0x7f2eb40d1290 2023-08-25T04:21:05.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.235+0000 7f2ebb7ba640 1 -- 172.21.15.55:0/3644381486 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb40b5260 con 0x7f2eb40d1290 2023-08-25T04:21:05.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.235+0000 7f2ea9ffb640 1 -- 172.21.15.55:0/3644381486 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 52) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f2eb00c83a0 con 0x7f2eb40d1290 2023-08-25T04:21:05.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.235+0000 7f2ea9ffb640 1 --2- 172.21.15.55:0/3644381486 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f2e980658c0 0x7f2e98067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:05.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.239+0000 7f2ea9ffb640 1 -- 172.21.15.55:0/3644381486 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2eb011dfe0 con 0x7f2eb40d1290 2023-08-25T04:21:05.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.239+0000 7f2eb8d55640 1 -- 172.21.15.55:0/3644381486 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f2e980658c0 msgr2=0x7f2e98067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4020134262 2023-08-25T04:21:05.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.239+0000 7f2eb8d55640 1 --2- 172.21.15.55:0/3644381486 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f2e980658c0 0x7f2e98067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:21:05.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.239+0000 7f2ea9ffb640 1 -- 172.21.15.55:0/3644381486 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2eb00eb540 con 0x7f2eb40d1290 2023-08-25T04:21:05.339 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:05.339+0000 7fa0dc446180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:21:05.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.403+0000 7f2ebb7ba640 1 -- 172.21.15.55:0/3644381486 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2eb4073ec0 con 0x7f2eb40d1290 2023-08-25T04:21:05.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.403+0000 7f2ea9ffb640 1 -- 172.21.15.55:0/3644381486 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2eb00c40a0 con 0x7f2eb40d1290 2023-08-25T04:21:05.401 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:21:05.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.403+0000 7f2ebb7ba640 1 -- 172.21.15.55:0/3644381486 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f2e980658c0 msgr2=0x7f2e98067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:21:05.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.407+0000 7f2ebb7ba640 1 --2- 172.21.15.55:0/3644381486 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f2e980658c0 0x7f2e98067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.407+0000 7f2ebb7ba640 1 -- 172.21.15.55:0/3644381486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2eb40d1290 msgr2=0x7f2eb4155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:05.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.407+0000 7f2ebb7ba640 1 --2- 172.21.15.55:0/3644381486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2eb40d1290 0x7f2eb4155d00 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00ad040 tx=0x7f2eb001ad30 comp rx=0 tx=0).stop 2023-08-25T04:21:05.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.407+0000 7f2ebb7ba640 1 -- 172.21.15.55:0/3644381486 shutdown_connections 2023-08-25T04:21:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.407+0000 7f2ebb7ba640 1 --2- 172.21.15.55:0/3644381486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2eb41601f0 0x7f2eb40cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.407+0000 7f2ebb7ba640 1 --2- 172.21.15.55:0/3644381486 >> [v2:172.21.15.110:6832/4020134262,v1:172.21.15.110:6833/4020134262] conn(0x7f2e980658c0 0x7f2e98067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.407+0000 7f2ebb7ba640 1 --2- 172.21.15.55:0/3644381486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2eb415e3c0 0x7f2eb40cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.407+0000 7f2ebb7ba640 1 --2- 172.21.15.55:0/3644381486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2eb40d1290 0x7f2eb4155d00 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.407+0000 7f2ebb7ba640 1 -- 172.21.15.55:0/3644381486 >> 172.21.15.55:0/3644381486 conn(0x7f2eb40d27d0 msgr2=0x7f2eb40b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:05.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.407+0000 7f2ebb7ba640 1 -- 172.21.15.55:0/3644381486 shutdown_connections 2023-08-25T04:21:05.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.407+0000 7f2ebb7ba640 1 -- 172.21.15.55:0/3644381486 wait complete. 2023-08-25T04:21:05.423 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:21:05.428 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:05.431+0000 7fa0dc446180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:21:05.450 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:05.451+0000 7fcb5900c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:21:05.510 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:05.511+0000 7fcb5900c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:21:05.585 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:05.583+0000 7fcae5646640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:05.585 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:05.587+0000 7fcae5646640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:05.585 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:05.587+0000 7fcae5646640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:05.585 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:05.587+0000 7fcae5646640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:05.586 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:05.587+0000 7fcae5646640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.587+0000 7ff87ef11640 1 Processor -- start 2023-08-25T04:21:05.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.587+0000 7ff87ef11640 1 -- start start 2023-08-25T04:21:05.591 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:05.587+0000 7fcae2640640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:05.591 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:05.587+0000 7fcae2640640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:05.591 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:05.587+0000 7fcae2640640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:05.591 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:05.587+0000 7fcae2640640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:05.592 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:05.587+0000 7fcae2640640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:05.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.591+0000 7ff87ef11640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff87815e3c0 0x7ff87815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.591+0000 7ff87ef11640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8780cd5a0 con 0x7ff8781601f0 2023-08-25T04:21:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.591+0000 7ff87ef11640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8780cd880 con 0x7ff8780d1290 2023-08-25T04:21:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.591+0000 7ff87ef11640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780cdb60 con 0x7ff87815e3c0 2023-08-25T04:21:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.591+0000 7ff87ccad640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff8781601f0 0x7ff8780d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39118/0 (socket says 172.21.15.55:39118) 2023-08-25T04:21:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.591+0000 7ff87ccad640 1 -- 172.21.15.55:0/3746819496 learned_addr learned my addr 172.21.15.55:0/3746819496 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.591+0000 7ff877fff640 1 --2- 172.21.15.55:0/3746819496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff87815e3c0 0x7ff87815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.591+0000 7ff8777fe640 1 -- 172.21.15.55:0/3746819496 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838195737 0 0) 0x7ff8780cd5a0 con 0x7ff8781601f0 2023-08-25T04:21:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.591+0000 7ff8777fe640 1 -- 172.21.15.55:0/3746819496 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff868003530 con 0x7ff8781601f0 2023-08-25T04:21:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.591+0000 7ff8777fe640 1 -- 172.21.15.55:0/3746819496 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511011220 0 0) 0x7ff8780cd880 con 0x7ff8780d1290 2023-08-25T04:21:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.591+0000 7ff8777fe640 1 -- 172.21.15.55:0/3746819496 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8780cd5a0 con 0x7ff8780d1290 2023-08-25T04:21:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.591+0000 7ff877fff640 1 -- 172.21.15.55:0/3746819496 >> v1:172.21.15.110:6789/0 conn(0x7ff8780d1290 legacy=0x7ff87815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.591+0000 7ff877fff640 1 -- 172.21.15.55:0/3746819496 >> v1:172.21.15.55:6789/0 conn(0x7ff8781601f0 legacy=0x7ff8780d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.591+0000 7ff8777fe640 1 -- 172.21.15.55:0/3746819496 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 902660974 0 0) 0x7ff868003530 con 0x7ff8781601f0 2023-08-25T04:21:05.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.591+0000 7ff877fff640 1 -- 172.21.15.55:0/3746819496 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8780cde40 con 0x7ff87815e3c0 2023-08-25T04:21:05.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.595+0000 7ff877fff640 1 --2- 172.21.15.55:0/3746819496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff87815e3c0 0x7ff87815d430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff8640097f0 tx=0x7ff86401ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=640ede1f07f7c0d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:05.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.595+0000 7ff8777fe640 1 -- 172.21.15.55:0/3746819496 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c0050a0 con 0x7ff87815e3c0 2023-08-25T04:21:05.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.595+0000 7ff8777fe640 1 -- 172.21.15.55:0/3746819496 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8640a8650 con 0x7ff87815e3c0 2023-08-25T04:21:05.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.595+0000 7ff8777fe640 1 -- 172.21.15.55:0/3746819496 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8640a89e0 con 0x7ff87815e3c0 2023-08-25T04:21:05.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.595+0000 7ff87ef11640 1 -- 172.21.15.55:0/3746819496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff87815e3c0 msgr2=0x7ff87815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:05.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.595+0000 7ff87ef11640 1 --2- 172.21.15.55:0/3746819496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff87815e3c0 0x7ff87815d430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff8640097f0 tx=0x7ff86401ebd0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.595+0000 7ff87ef11640 1 -- 172.21.15.55:0/3746819496 shutdown_connections 2023-08-25T04:21:05.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.595+0000 7ff87ef11640 1 --2- 172.21.15.55:0/3746819496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff87815e3c0 0x7ff87815d430 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.595+0000 7ff87ef11640 1 -- 172.21.15.55:0/3746819496 >> 172.21.15.55:0/3746819496 conn(0x7ff8780d27d0 msgr2=0x7ff8780d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:05.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.595+0000 7ff87ef11640 1 -- 172.21.15.55:0/3746819496 shutdown_connections 2023-08-25T04:21:05.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.595+0000 7ff87ef11640 1 -- 172.21.15.55:0/3746819496 wait complete. 2023-08-25T04:21:05.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.599+0000 7ff87ef11640 1 Processor -- start 2023-08-25T04:21:05.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.599+0000 7ff87ef11640 1 -- start start 2023-08-25T04:21:05.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.599+0000 7ff87ef11640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8780d1290 0x7ff87809ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:05.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.599+0000 7ff87ef11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87815e3c0 0x7ff87815cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:05.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.599+0000 7ff87ef11640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8781601f0 0x7ff8781f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:05.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.599+0000 7ff87ef11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87815d300 con 0x7ff87815e3c0 2023-08-25T04:21:05.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.599+0000 7ff87ef11640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87815a850 con 0x7ff8781601f0 2023-08-25T04:21:05.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.599+0000 7ff87ef11640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87815b3d0 con 0x7ff8780d1290 2023-08-25T04:21:05.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.599+0000 7ff877fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87815e3c0 0x7ff87815cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:05.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.599+0000 7ff87ccad640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8780d1290 0x7ff87809ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:05.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.599+0000 7ff877fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87815e3c0 0x7ff87815cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57166/0 (socket says 172.21.15.55:57166) 2023-08-25T04:21:05.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.599+0000 7ff877fff640 1 -- 172.21.15.55:0/2655590228 learned_addr learned my addr 172.21.15.55:0/2655590228 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:05.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.599+0000 7ff87d4ae640 1 --2- 172.21.15.55:0/2655590228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8781601f0 0x7ff8781f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:05.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.603+0000 7ff877fff640 1 -- 172.21.15.55:0/2655590228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8780d1290 msgr2=0x7ff87809ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:05.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.603+0000 7ff877fff640 1 --2- 172.21.15.55:0/2655590228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8780d1290 0x7ff87809ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.603+0000 7ff877fff640 1 -- 172.21.15.55:0/2655590228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8781601f0 msgr2=0x7ff8781f1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:05.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.603+0000 7ff877fff640 1 --2- 172.21.15.55:0/2655590228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8781601f0 0x7ff8781f1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.603+0000 7ff877fff640 1 -- 172.21.15.55:0/2655590228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff864009420 con 0x7ff87815e3c0 2023-08-25T04:21:05.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.603+0000 7ff877fff640 1 --2- 172.21.15.55:0/2655590228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87815e3c0 0x7ff87815cdc0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7ff864009740 tx=0x7ff86401b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:05.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.603+0000 7ff8757fa640 1 -- 172.21.15.55:0/2655590228 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8640b0850 con 0x7ff87815e3c0 2023-08-25T04:21:05.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.603+0000 7ff8757fa640 1 -- 172.21.15.55:0/2655590228 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8640b09b0 con 0x7ff87815e3c0 2023-08-25T04:21:05.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.603+0000 7ff87ef11640 1 -- 172.21.15.55:0/2655590228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8780ce7c0 con 0x7ff87815e3c0 2023-08-25T04:21:05.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.603+0000 7ff8757fa640 1 -- 172.21.15.55:0/2655590228 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8640b0d40 con 0x7ff87815e3c0 2023-08-25T04:21:05.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.603+0000 7ff87ef11640 1 -- 172.21.15.55:0/2655590228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87815ad80 con 0x7ff87815e3c0 2023-08-25T04:21:05.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.603+0000 7ff87ef11640 1 -- 172.21.15.55:0/2655590228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8780b5260 con 0x7ff87815e3c0 2023-08-25T04:21:05.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.603+0000 7ff8757fa640 1 -- 172.21.15.55:0/2655590228 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 53) v1 ==== 84673+0+0 (secure 0 0 0) 0x7ff8640b7040 con 0x7ff87815e3c0 2023-08-25T04:21:05.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.603+0000 7ff8757fa640 1 -- 172.21.15.55:0/2655590228 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6995+0+0 (secure 0 0 0) 0x7ff864120440 con 0x7ff87815e3c0 2023-08-25T04:21:05.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.607+0000 7ff8757fa640 1 -- 172.21.15.55:0/2655590228 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff8640edf60 con 0x7ff87815e3c0 2023-08-25T04:21:05.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.767+0000 7ff87ef11640 1 -- 172.21.15.55:0/2655590228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff87815b560 con 0x7ff87815e3c0 2023-08-25T04:21:05.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.767+0000 7ff8757fa640 1 -- 172.21.15.55:0/2655590228 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v111) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff864006e20 con 0x7ff87815e3c0 2023-08-25T04:21:05.766 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:21:05.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.771+0000 7ff87ef11640 1 -- 172.21.15.55:0/2655590228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87815e3c0 msgr2=0x7ff87815cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:05.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.771+0000 7ff87ef11640 1 --2- 172.21.15.55:0/2655590228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87815e3c0 0x7ff87815cdc0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7ff864009740 tx=0x7ff86401b970 comp rx=0 tx=0).stop 2023-08-25T04:21:05.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.771+0000 7ff87ef11640 1 -- 172.21.15.55:0/2655590228 shutdown_connections 2023-08-25T04:21:05.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.771+0000 7ff87ef11640 1 --2- 172.21.15.55:0/2655590228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8781601f0 0x7ff8781f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.771+0000 7ff87ef11640 1 --2- 172.21.15.55:0/2655590228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff87815e3c0 0x7ff87815cdc0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.771+0000 7ff87ef11640 1 --2- 172.21.15.55:0/2655590228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8780d1290 0x7ff87809ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.771+0000 7ff87ef11640 1 -- 172.21.15.55:0/2655590228 >> 172.21.15.55:0/2655590228 conn(0x7ff8780d27d0 msgr2=0x7ff87806b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:05.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.771+0000 7ff87ef11640 1 -- 172.21.15.55:0/2655590228 shutdown_connections 2023-08-25T04:21:05.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.771+0000 7ff87ef11640 1 -- 172.21.15.55:0/2655590228 wait complete. 2023-08-25T04:21:05.785 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:05.787+0000 7fa0dc446180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:21:05.787 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:21:05.851 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:05.851+0000 7fa0dc446180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:21:05.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.935+0000 7f5b04d37640 1 Processor -- start 2023-08-25T04:21:05.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.935+0000 7f5b04d37640 1 -- start start 2023-08-25T04:21:05.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.939+0000 7f5b04d37640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5b000c9830 0x7f5b0009bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:05.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.939+0000 7f5b04d37640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0015abd0 con 0x7f5b0006c020 2023-08-25T04:21:05.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.939+0000 7f5b04d37640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b000c8ab0 con 0x7f5b0015a7f0 2023-08-25T04:21:05.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.939+0000 7f5b04d37640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b000c8d50 con 0x7f5b000c9830 2023-08-25T04:21:05.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.939+0000 7f5afed9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5b0006c020 0x7f5b000acff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39130/0 (socket says 172.21.15.55:39130) 2023-08-25T04:21:05.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.939+0000 7f5afed9d640 1 -- 172.21.15.55:0/485801019 learned_addr learned my addr 172.21.15.55:0/485801019 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:05.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.939+0000 7f5af5d9b640 1 --2- 172.21.15.55:0/485801019 >> v2:172.21.15.110:3300/0 conn(0x7f5b000c9830 0x7f5b0009bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:05.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.939+0000 7f5afdd9b640 1 -- 172.21.15.55:0/485801019 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214404042 0 0) 0x7f5b0015abd0 con 0x7f5b0006c020 2023-08-25T04:21:05.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.939+0000 7f5afdd9b640 1 -- 172.21.15.55:0/485801019 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5aec003530 con 0x7f5b0006c020 2023-08-25T04:21:05.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.939+0000 7f5afdd9b640 1 -- 172.21.15.55:0/485801019 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248504482 0 0) 0x7f5b000c8ab0 con 0x7f5b0015a7f0 2023-08-25T04:21:05.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.939+0000 7f5afdd9b640 1 -- 172.21.15.55:0/485801019 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b0015abd0 con 0x7f5b0015a7f0 2023-08-25T04:21:05.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.939+0000 7f5af5d9b640 1 -- 172.21.15.55:0/485801019 >> v1:172.21.15.110:6789/0 conn(0x7f5b0015a7f0 legacy=0x7f5b00070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:05.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.939+0000 7f5af5d9b640 1 -- 172.21.15.55:0/485801019 >> v1:172.21.15.55:6789/0 conn(0x7f5b0006c020 legacy=0x7f5b000acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:05.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.939+0000 7f5af5d9b640 1 -- 172.21.15.55:0/485801019 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b000c9030 con 0x7f5b000c9830 2023-08-25T04:21:05.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.939+0000 7f5af5d9b640 1 --2- 172.21.15.55:0/485801019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b000c9830 0x7f5b0009bde0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009d90 tx=0x7f5ae801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3d922629960243c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:05.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.943+0000 7f5afdd9b640 1 -- 172.21.15.55:0/485801019 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80a58f0 con 0x7f5b000c9830 2023-08-25T04:21:05.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.943+0000 7f5afdd9b640 1 -- 172.21.15.55:0/485801019 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae80a5a50 con 0x7f5b000c9830 2023-08-25T04:21:05.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.943+0000 7f5afdd9b640 1 -- 172.21.15.55:0/485801019 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80a5de0 con 0x7f5b000c9830 2023-08-25T04:21:05.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.943+0000 7f5b04d37640 1 -- 172.21.15.55:0/485801019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b000c9830 msgr2=0x7f5b0009bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:05.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.943+0000 7f5b04d37640 1 --2- 172.21.15.55:0/485801019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b000c9830 0x7f5b0009bde0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009d90 tx=0x7f5ae801c920 comp rx=0 tx=0).stop 2023-08-25T04:21:05.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.943+0000 7f5b04d37640 1 -- 172.21.15.55:0/485801019 shutdown_connections 2023-08-25T04:21:05.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.943+0000 7f5b04d37640 1 --2- 172.21.15.55:0/485801019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b000c9830 0x7f5b0009bde0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.943+0000 7f5b04d37640 1 -- 172.21.15.55:0/485801019 >> 172.21.15.55:0/485801019 conn(0x7f5b00069900 msgr2=0x7f5b00069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:05.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.943+0000 7f5b04d37640 1 -- 172.21.15.55:0/485801019 shutdown_connections 2023-08-25T04:21:05.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.943+0000 7f5b04d37640 1 -- 172.21.15.55:0/485801019 wait complete. 2023-08-25T04:21:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.943+0000 7f5b04d37640 1 Processor -- start 2023-08-25T04:21:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.943+0000 7f5b04d37640 1 -- start start 2023-08-25T04:21:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.943+0000 7f5b04d37640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b0006c020 0x7f5b00154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:05.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5b04d37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b000c9830 0x7f5b00154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:05.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5b04d37640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b0015a7f0 0x7f5b000c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:05.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5b04d37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000c6620 con 0x7f5b000c9830 2023-08-25T04:21:05.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5b04d37640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b00152a80 con 0x7f5b0006c020 2023-08-25T04:21:05.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5b04d37640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000c5f60 con 0x7f5b0015a7f0 2023-08-25T04:21:05.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5af5d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b000c9830 0x7f5b00154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:05.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5afed9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b0015a7f0 0x7f5b000c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:05.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5af5d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b000c9830 0x7f5b00154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57172/0 (socket says 172.21.15.55:57172) 2023-08-25T04:21:05.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5af5d9b640 1 -- 172.21.15.55:0/2041265942 learned_addr learned my addr 172.21.15.55:0/2041265942 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:05.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5afe59c640 1 --2- 172.21.15.55:0/2041265942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b0006c020 0x7f5b00154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:05.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5afed9d640 1 -- 172.21.15.55:0/2041265942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b0006c020 msgr2=0x7f5b00154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:05.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5afed9d640 1 --2- 172.21.15.55:0/2041265942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b0006c020 0x7f5b00154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5afed9d640 1 -- 172.21.15.55:0/2041265942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b000c9830 msgr2=0x7f5b00154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:05.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5afed9d640 1 --2- 172.21.15.55:0/2041265942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b000c9830 0x7f5b00154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:05.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5afed9d640 1 -- 172.21.15.55:0/2041265942 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae8009a70 con 0x7f5b0015a7f0 2023-08-25T04:21:05.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5afed9d640 1 --2- 172.21.15.55:0/2041265942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b0015a7f0 0x7f5b000c2f40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5b0006a9c0 tx=0x7f5af8001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:05.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5af77fe640 1 -- 172.21.15.55:0/2041265942 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8005cf0 con 0x7f5b0015a7f0 2023-08-25T04:21:05.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5af77fe640 1 -- 172.21.15.55:0/2041265942 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af8005e50 con 0x7f5b0015a7f0 2023-08-25T04:21:05.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5b04d37640 1 -- 172.21.15.55:0/2041265942 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b000adc90 con 0x7f5b0015a7f0 2023-08-25T04:21:05.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5af77fe640 1 -- 172.21.15.55:0/2041265942 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8007310 con 0x7f5b0015a7f0 2023-08-25T04:21:05.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5b04d37640 1 -- 172.21.15.55:0/2041265942 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b000c5ae0 con 0x7f5b0015a7f0 2023-08-25T04:21:05.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5b04d37640 1 -- 172.21.15.55:0/2041265942 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0006d5b0 con 0x7f5b0015a7f0 2023-08-25T04:21:05.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.947+0000 7f5af77fe640 1 -- 172.21.15.55:0/2041265942 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 53) v1 ==== 84673+0+0 (secure 0 0 0) 0x7f5af8007470 con 0x7f5b0015a7f0 2023-08-25T04:21:05.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.951+0000 7f5af77fe640 1 -- 172.21.15.55:0/2041265942 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6995+0+0 (secure 0 0 0) 0x7f5af8082460 con 0x7f5b0015a7f0 2023-08-25T04:21:05.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:05.951+0000 7f5af77fe640 1 -- 172.21.15.55:0/2041265942 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5af8050000 con 0x7f5b0015a7f0 2023-08-25T04:21:06.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.111+0000 7f5b04d37640 1 -- 172.21.15.55:0/2041265942 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5b000c6760 con 0x7f5b0015a7f0 2023-08-25T04:21:06.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.111+0000 7f5af77fe640 1 -- 172.21.15.55:0/2041265942 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v111) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5af8053620 con 0x7f5b0015a7f0 2023-08-25T04:21:06.109 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:21:06.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.111+0000 7f5b04d37640 1 -- 172.21.15.55:0/2041265942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b0015a7f0 msgr2=0x7f5b000c2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:06.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.111+0000 7f5b04d37640 1 --2- 172.21.15.55:0/2041265942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b0015a7f0 0x7f5b000c2f40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5b0006a9c0 tx=0x7f5af8001e80 comp rx=0 tx=0).stop 2023-08-25T04:21:06.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.111+0000 7f5b04d37640 1 -- 172.21.15.55:0/2041265942 shutdown_connections 2023-08-25T04:21:06.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.111+0000 7f5b04d37640 1 --2- 172.21.15.55:0/2041265942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b0015a7f0 0x7f5b000c2f40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.111+0000 7f5b04d37640 1 --2- 172.21.15.55:0/2041265942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b000c9830 0x7f5b00154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.111+0000 7f5b04d37640 1 --2- 172.21.15.55:0/2041265942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b0006c020 0x7f5b00154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.111+0000 7f5b04d37640 1 -- 172.21.15.55:0/2041265942 >> 172.21.15.55:0/2041265942 conn(0x7f5b00069900 msgr2=0x7f5b000b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:06.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.111+0000 7f5b04d37640 1 -- 172.21.15.55:0/2041265942 shutdown_connections 2023-08-25T04:21:06.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.111+0000 7f5b04d37640 1 -- 172.21.15.55:0/2041265942 wait complete. 2023-08-25T04:21:06.129 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:21:06.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a46e19640 1 Processor -- start 2023-08-25T04:21:06.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a46e19640 1 -- start start 2023-08-25T04:21:06.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a46e19640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a4006c3b0 0x7f8a400cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:06.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a46e19640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8a4006c790 0x7f8a4006de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:06.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a46e19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a400d1060 0x7f8a4006e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:06.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a46e19640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a400cab90 con 0x7f8a4006c3b0 2023-08-25T04:21:06.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a46e19640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4006dbb0 con 0x7f8a4006c790 2023-08-25T04:21:06.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a46e19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a400cae50 con 0x7f8a400d1060 2023-08-25T04:21:06.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a44bb5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a4006c3b0 0x7f8a400cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:06.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a44bb5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a4006c3b0 0x7f8a400cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57176/0 (socket says 172.21.15.55:57176) 2023-08-25T04:21:06.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a44bb5640 1 -- 172.21.15.55:0/1333638061 learned_addr learned my addr 172.21.15.55:0/1333638061 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:06.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a453b6640 1 --2- 172.21.15.55:0/1333638061 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a400d1060 0x7f8a4006e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:06.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a37fff640 1 --2- 172.21.15.55:0/1333638061 >> v2:172.21.15.110:3300/0 conn(0x7f8a4006c790 0x7f8a4006de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:06.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a44bb5640 1 -- 172.21.15.55:0/1333638061 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a400d1060 msgr2=0x7f8a4006e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:06.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a44bb5640 1 --2- 172.21.15.55:0/1333638061 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a400d1060 0x7f8a4006e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a44bb5640 1 -- 172.21.15.55:0/1333638061 >> v2:172.21.15.110:3300/0 conn(0x7f8a4006c790 msgr2=0x7f8a4006de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:06.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a44bb5640 1 --2- 172.21.15.55:0/1333638061 >> v2:172.21.15.110:3300/0 conn(0x7f8a4006c790 0x7f8a4006de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a44bb5640 1 -- 172.21.15.55:0/1333638061 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a400cb130 con 0x7f8a4006c3b0 2023-08-25T04:21:06.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.279+0000 7f8a453b6640 1 --2- 172.21.15.55:0/1333638061 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a400d1060 0x7f8a4006e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:06.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.283+0000 7f8a44bb5640 1 --2- 172.21.15.55:0/1333638061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4006c3b0 0x7f8a400cd7d0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f8a40071900 tx=0x7f8a3c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17aa025d565ae174 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:06.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.283+0000 7f8a377fe640 1 -- 172.21.15.55:0/1333638061 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c0ac640 con 0x7f8a4006c3b0 2023-08-25T04:21:06.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.283+0000 7f8a377fe640 1 -- 172.21.15.55:0/1333638061 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c0ac7a0 con 0x7f8a4006c3b0 2023-08-25T04:21:06.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.283+0000 7f8a377fe640 1 -- 172.21.15.55:0/1333638061 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c0acb30 con 0x7f8a4006c3b0 2023-08-25T04:21:06.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.283+0000 7f8a46e19640 1 -- 172.21.15.55:0/1333638061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4006c3b0 msgr2=0x7f8a400cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:06.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.283+0000 7f8a46e19640 1 --2- 172.21.15.55:0/1333638061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4006c3b0 0x7f8a400cd7d0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f8a40071900 tx=0x7f8a3c01c400 comp rx=0 tx=0).stop 2023-08-25T04:21:06.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.283+0000 7f8a46e19640 1 -- 172.21.15.55:0/1333638061 shutdown_connections 2023-08-25T04:21:06.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.283+0000 7f8a46e19640 1 --2- 172.21.15.55:0/1333638061 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a400d1060 0x7f8a4006e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.283+0000 7f8a46e19640 1 --2- 172.21.15.55:0/1333638061 >> v2:172.21.15.110:3300/0 conn(0x7f8a4006c790 0x7f8a4006de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.283+0000 7f8a46e19640 1 --2- 172.21.15.55:0/1333638061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4006c3b0 0x7f8a400cd7d0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.283+0000 7f8a46e19640 1 -- 172.21.15.55:0/1333638061 >> 172.21.15.55:0/1333638061 conn(0x7f8a400d0540 msgr2=0x7f8a400d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:06.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.283+0000 7f8a46e19640 1 -- 172.21.15.55:0/1333638061 shutdown_connections 2023-08-25T04:21:06.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.283+0000 7f8a46e19640 1 -- 172.21.15.55:0/1333638061 wait complete. 2023-08-25T04:21:06.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.283+0000 7f8a46e19640 1 Processor -- start 2023-08-25T04:21:06.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.283+0000 7f8a46e19640 1 -- start start 2023-08-25T04:21:06.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a46e19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a4006c3b0 0x7f8a400b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:06.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a46e19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4006c790 0x7f8a4014b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:06.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a46e19640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a400d1060 0x7f8a4014bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:06.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a46e19640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a40148060 con 0x7f8a4006c790 2023-08-25T04:21:06.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a46e19640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a40156b00 con 0x7f8a400d1060 2023-08-25T04:21:06.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a46e19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a40155ef0 con 0x7f8a4006c3b0 2023-08-25T04:21:06.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a37fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4006c790 0x7f8a4014b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:06.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a37fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4006c790 0x7f8a4014b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57180/0 (socket says 172.21.15.55:57180) 2023-08-25T04:21:06.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a37fff640 1 -- 172.21.15.55:0/3008962912 learned_addr learned my addr 172.21.15.55:0/3008962912 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:06.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a44bb5640 1 --2- 172.21.15.55:0/3008962912 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a4006c3b0 0x7f8a400b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:06.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a453b6640 1 --2- 172.21.15.55:0/3008962912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a400d1060 0x7f8a4014bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:06.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a37fff640 1 -- 172.21.15.55:0/3008962912 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a4006c3b0 msgr2=0x7f8a400b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:06.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a37fff640 1 --2- 172.21.15.55:0/3008962912 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a4006c3b0 0x7f8a400b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a37fff640 1 -- 172.21.15.55:0/3008962912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a400d1060 msgr2=0x7f8a4014bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:06.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a37fff640 1 --2- 172.21.15.55:0/3008962912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a400d1060 0x7f8a4014bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a37fff640 1 -- 172.21.15.55:0/3008962912 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a38009a70 con 0x7f8a4006c790 2023-08-25T04:21:06.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a37fff640 1 --2- 172.21.15.55:0/3008962912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4006c790 0x7f8a4014b7a0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000e8b0 tx=0x7f8a3000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:06.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a357fa640 1 -- 172.21.15.55:0/3008962912 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30009610 con 0x7f8a4006c790 2023-08-25T04:21:06.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a357fa640 1 -- 172.21.15.55:0/3008962912 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3000c940 con 0x7f8a4006c790 2023-08-25T04:21:06.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a46e19640 1 -- 172.21.15.55:0/3008962912 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3c009480 con 0x7f8a4006c790 2023-08-25T04:21:06.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a357fa640 1 -- 172.21.15.55:0/3008962912 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3000ccd0 con 0x7f8a4006c790 2023-08-25T04:21:06.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a46e19640 1 -- 172.21.15.55:0/3008962912 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a401564b0 con 0x7f8a4006c790 2023-08-25T04:21:06.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.287+0000 7f8a46e19640 1 -- 172.21.15.55:0/3008962912 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a40156cb0 con 0x7f8a4006c790 2023-08-25T04:21:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.291+0000 7f8a357fa640 1 -- 172.21.15.55:0/3008962912 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 53) v1 ==== 84673+0+0 (secure 0 0 0) 0x7f8a30013470 con 0x7f8a4006c790 2023-08-25T04:21:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.291+0000 7f8a357fa640 1 -- 172.21.15.55:0/3008962912 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6995+0+0 (secure 0 0 0) 0x7f8a30082dd0 con 0x7f8a4006c790 2023-08-25T04:21:06.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.295+0000 7f8a357fa640 1 -- 172.21.15.55:0/3008962912 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8a40156cb0 con 0x7f8a4006c790 2023-08-25T04:21:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.451+0000 7f8a46e19640 1 -- 172.21.15.55:0/3008962912 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8a40156cb0 con 0x7f8a4006c790 2023-08-25T04:21:06.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.455+0000 7f8a357fa640 1 -- 172.21.15.55:0/3008962912 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v111) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8a30021020 con 0x7f8a4006c790 2023-08-25T04:21:06.452 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:21:06.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.455+0000 7f8a46e19640 1 -- 172.21.15.55:0/3008962912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4006c790 msgr2=0x7f8a4014b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:06.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.455+0000 7f8a46e19640 1 --2- 172.21.15.55:0/3008962912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4006c790 0x7f8a4014b7a0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000e8b0 tx=0x7f8a3000ecb0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.455+0000 7f8a46e19640 1 -- 172.21.15.55:0/3008962912 shutdown_connections 2023-08-25T04:21:06.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.455+0000 7f8a46e19640 1 --2- 172.21.15.55:0/3008962912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8a400d1060 0x7f8a4014bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.455+0000 7f8a46e19640 1 --2- 172.21.15.55:0/3008962912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a4006c790 0x7f8a4014b7a0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.455+0000 7f8a46e19640 1 --2- 172.21.15.55:0/3008962912 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8a4006c3b0 0x7f8a400b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.455+0000 7f8a46e19640 1 -- 172.21.15.55:0/3008962912 >> 172.21.15.55:0/3008962912 conn(0x7f8a400d0540 msgr2=0x7f8a400cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:06.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.455+0000 7f8a46e19640 1 -- 172.21.15.55:0/3008962912 shutdown_connections 2023-08-25T04:21:06.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.455+0000 7f8a46e19640 1 -- 172.21.15.55:0/3008962912 wait complete. 2023-08-25T04:21:06.472 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:21:06.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.623+0000 7f135abba640 1 Processor -- start 2023-08-25T04:21:06.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.623+0000 7f135abba640 1 -- start start 2023-08-25T04:21:06.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.623+0000 7f135abba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13540d0da0 0x7f13540d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:06.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.623+0000 7f135abba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13540cdde0 0x7f13540ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:06.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.623+0000 7f135abba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13540b29b0 con 0x7f13540cee60 2023-08-25T04:21:06.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.623+0000 7f135abba640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13540ce760 con 0x7f13540d0da0 2023-08-25T04:21:06.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.623+0000 7f135abba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13540d16c0 con 0x7f13540cdde0 2023-08-25T04:21:06.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.623+0000 7f1358956640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13540d0da0 0x7f13540d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:06.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.623+0000 7f1358956640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13540d0da0 0x7f13540d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57182/0 (socket says 172.21.15.55:57182) 2023-08-25T04:21:06.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.623+0000 7f1358956640 1 -- 172.21.15.55:0/2143976965 learned_addr learned my addr 172.21.15.55:0/2143976965 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:06.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.623+0000 7f1353fff640 1 --2- 172.21.15.55:0/2143976965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13540cdde0 0x7f13540ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:06.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.623+0000 7f1358956640 1 -- 172.21.15.55:0/2143976965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13540cdde0 msgr2=0x7f13540ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:06.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.623+0000 7f1358956640 1 --2- 172.21.15.55:0/2143976965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13540cdde0 0x7f13540ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.623+0000 7f1358956640 1 -- 172.21.15.55:0/2143976965 >> v1:172.21.15.110:6789/0 conn(0x7f13540cee60 legacy=0x7f13540cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:06.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.623+0000 7f1358956640 1 -- 172.21.15.55:0/2143976965 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13540b1dc0 con 0x7f13540d0da0 2023-08-25T04:21:06.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.627+0000 7f1358956640 1 --2- 172.21.15.55:0/2143976965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13540d0da0 0x7f13540d1180 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f1348006fd0 tx=0x7f134801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4fea43d3faa0b30 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:06.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.627+0000 7f13537fe640 1 -- 172.21.15.55:0/2143976965 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13480a8a10 con 0x7f13540d0da0 2023-08-25T04:21:06.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.627+0000 7f13537fe640 1 -- 172.21.15.55:0/2143976965 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13480a8b70 con 0x7f13540d0da0 2023-08-25T04:21:06.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.627+0000 7f13537fe640 1 -- 172.21.15.55:0/2143976965 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13480b0440 con 0x7f13540d0da0 2023-08-25T04:21:06.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.627+0000 7f135abba640 1 -- 172.21.15.55:0/2143976965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13540d0da0 msgr2=0x7f13540d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:06.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.627+0000 7f135abba640 1 --2- 172.21.15.55:0/2143976965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13540d0da0 0x7f13540d1180 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f1348006fd0 tx=0x7f134801ed10 comp rx=0 tx=0).stop 2023-08-25T04:21:06.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.627+0000 7f135abba640 1 -- 172.21.15.55:0/2143976965 shutdown_connections 2023-08-25T04:21:06.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.627+0000 7f135abba640 1 --2- 172.21.15.55:0/2143976965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13540cdde0 0x7f13540ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.627+0000 7f135abba640 1 --2- 172.21.15.55:0/2143976965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13540d0da0 0x7f13540d1180 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.627+0000 7f135abba640 1 -- 172.21.15.55:0/2143976965 >> 172.21.15.55:0/2143976965 conn(0x7f135409bae0 msgr2=0x7f13540d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:06.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.627+0000 7f135abba640 1 -- 172.21.15.55:0/2143976965 shutdown_connections 2023-08-25T04:21:06.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.627+0000 7f135abba640 1 -- 172.21.15.55:0/2143976965 wait complete. 2023-08-25T04:21:06.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.627+0000 7f135abba640 1 Processor -- start 2023-08-25T04:21:06.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f135abba640 1 -- start start 2023-08-25T04:21:06.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f135abba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13540cdde0 0x7f135415b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:06.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f135abba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13540cee60 0x7f13541f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:06.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f135abba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13540d0da0 0x7f13540b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:06.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f135abba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13540c91e0 con 0x7f13540cdde0 2023-08-25T04:21:06.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f135abba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1354149490 con 0x7f13540cee60 2023-08-25T04:21:06.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f135abba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13540c8940 con 0x7f13540d0da0 2023-08-25T04:21:06.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f1358956640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13540cdde0 0x7f135415b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:06.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f1358956640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13540cdde0 0x7f135415b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57192/0 (socket says 172.21.15.55:57192) 2023-08-25T04:21:06.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f1358956640 1 -- 172.21.15.55:0/2471192138 learned_addr learned my addr 172.21.15.55:0/2471192138 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:06.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f1353fff640 1 --2- 172.21.15.55:0/2471192138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13540cee60 0x7f13541f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:06.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f1359157640 1 --2- 172.21.15.55:0/2471192138 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13540d0da0 0x7f13540b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:06.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f1358956640 1 -- 172.21.15.55:0/2471192138 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13540d0da0 msgr2=0x7f13540b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:06.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f1358956640 1 --2- 172.21.15.55:0/2471192138 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13540d0da0 0x7f13540b7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f1358956640 1 -- 172.21.15.55:0/2471192138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13540cee60 msgr2=0x7f13541f1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:06.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f1358956640 1 --2- 172.21.15.55:0/2471192138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13540cee60 0x7f13541f1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f1358956640 1 -- 172.21.15.55:0/2471192138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1348009480 con 0x7f13540cdde0 2023-08-25T04:21:06.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f1358956640 1 --2- 172.21.15.55:0/2471192138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13540cdde0 0x7f135415b2e0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f1348006fd0 tx=0x7f134801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:06.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f13517fa640 1 -- 172.21.15.55:0/2471192138 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13480be070 con 0x7f13540cdde0 2023-08-25T04:21:06.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f13517fa640 1 -- 172.21.15.55:0/2471192138 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13480059a0 con 0x7f13540cdde0 2023-08-25T04:21:06.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f13517fa640 1 -- 172.21.15.55:0/2471192138 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348005d30 con 0x7f13540cdde0 2023-08-25T04:21:06.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f135abba640 1 -- 172.21.15.55:0/2471192138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13540c8c20 con 0x7f13540cdde0 2023-08-25T04:21:06.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f135abba640 1 -- 172.21.15.55:0/2471192138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13540b76c0 con 0x7f13540cdde0 2023-08-25T04:21:06.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.631+0000 7f135abba640 1 -- 172.21.15.55:0/2471192138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13540b78b0 con 0x7f13540cdde0 2023-08-25T04:21:06.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.635+0000 7f13517fa640 1 -- 172.21.15.55:0/2471192138 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 54) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f13480b7070 con 0x7f13540cdde0 2023-08-25T04:21:06.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.635+0000 7f13517fa640 1 --2- 172.21.15.55:0/2471192138 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f13380654d0 0x7f1338067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:06.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.635+0000 7f13517fa640 1 -- 172.21.15.55:0/2471192138 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6995+0+0 (secure 0 0 0) 0x7f13481200c0 con 0x7f13540cdde0 2023-08-25T04:21:06.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.635+0000 7f1353fff640 1 --2- 172.21.15.55:0/2471192138 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f13380654d0 0x7f1338067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:06.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.635+0000 7f1353fff640 1 --2- 172.21.15.55:0/2471192138 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f13380654d0 0x7f1338067990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f13540cddb0 tx=0x7f1340009190 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:06.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.639+0000 7f13517fa640 1 -- 172.21.15.55:0/2471192138 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f13480edaf0 con 0x7f13540cdde0 2023-08-25T04:21:06.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.831+0000 7f135abba640 1 -- 172.21.15.55:0/2471192138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f135404dbe0 con 0x7f13540cdde0 2023-08-25T04:21:06.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.831+0000 7f13517fa640 1 -- 172.21.15.55:0/2471192138 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f13480f1110 con 0x7f13540cdde0 2023-08-25T04:21:06.829 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:06.829 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3111804785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3111804785},{"type":"v1","addr":"172.21.15.110:6836","nonce":3111804785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3444442085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3444442085},{"type":"v1","addr":"172.21.15.110:6837","nonce":3444442085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":7857,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2022633620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2022633620},{"type":"v1","addr":"172.21.15.55:6834","nonce":2022633620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:19:41.282901+0000","modified":"2023-08-25T04:19:44.912410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1173226599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1173226599},{"type":"v1","addr":"172.21.15.55:6835","nonce":1173226599}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-25T04:21:06.830 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 49 2023-08-25T04:21:06.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.831+0000 7f135abba640 1 -- 172.21.15.55:0/2471192138 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f13380654d0 msgr2=0x7f1338067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:06.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.831+0000 7f135abba640 1 --2- 172.21.15.55:0/2471192138 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f13380654d0 0x7f1338067990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f13540cddb0 tx=0x7f1340009190 comp rx=0 tx=0).stop 2023-08-25T04:21:06.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.831+0000 7f135abba640 1 -- 172.21.15.55:0/2471192138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13540cdde0 msgr2=0x7f135415b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:06.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.831+0000 7f135abba640 1 --2- 172.21.15.55:0/2471192138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13540cdde0 0x7f135415b2e0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f1348006fd0 tx=0x7f134801bab0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.831+0000 7f135abba640 1 -- 172.21.15.55:0/2471192138 shutdown_connections 2023-08-25T04:21:06.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.831+0000 7f135abba640 1 --2- 172.21.15.55:0/2471192138 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13540d0da0 0x7f13540b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.831+0000 7f135abba640 1 --2- 172.21.15.55:0/2471192138 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13540cee60 0x7f13541f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.831+0000 7f135abba640 1 --2- 172.21.15.55:0/2471192138 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f13380654d0 0x7f1338067990 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.831+0000 7f135abba640 1 --2- 172.21.15.55:0/2471192138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13540cdde0 0x7f135415b2e0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:06.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.831+0000 7f135abba640 1 -- 172.21.15.55:0/2471192138 >> 172.21.15.55:0/2471192138 conn(0x7f135409bae0 msgr2=0x7f13540b2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:06.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.831+0000 7f135abba640 1 -- 172.21.15.55:0/2471192138 shutdown_connections 2023-08-25T04:21:06.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.831+0000 7f135abba640 1 -- 172.21.15.55:0/2471192138 wait complete. 2023-08-25T04:21:06.849 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:21:06.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.995+0000 7f0fb7711640 1 Processor -- start 2023-08-25T04:21:06.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.995+0000 7f0fb7711640 1 -- start start 2023-08-25T04:21:06.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.995+0000 7f0fb7711640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0fb006c2c0 0x7f0fb0167840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:06.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.995+0000 7f0fb7711640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb0161330 con 0x7f0fb00cfa70 2023-08-25T04:21:06.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.995+0000 7f0fb7711640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb006eaf0 con 0x7f0fb015c9c0 2023-08-25T04:21:06.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.995+0000 7f0fb7711640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb006e530 con 0x7f0fb006c2c0 2023-08-25T04:21:06.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.995+0000 7f0fb4cac640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0fb00cfa70 0x7f0fb0160c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39136/0 (socket says 172.21.15.55:39136) 2023-08-25T04:21:06.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.995+0000 7f0fb4cac640 1 -- 172.21.15.55:0/2784085276 learned_addr learned my addr 172.21.15.55:0/2784085276 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:06.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.995+0000 7f0fb5cae640 1 --2- 172.21.15.55:0/2784085276 >> v2:172.21.15.110:3300/0 conn(0x7f0fb006c2c0 0x7f0fb0167840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:06.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.995+0000 7f0fa7fff640 1 -- 172.21.15.55:0/2784085276 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014823338 0 0) 0x7f0fb0161330 con 0x7f0fb00cfa70 2023-08-25T04:21:06.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.995+0000 7f0fa7fff640 1 -- 172.21.15.55:0/2784085276 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f9c003530 con 0x7f0fb00cfa70 2023-08-25T04:21:06.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.999+0000 7f0fb5cae640 1 -- 172.21.15.55:0/2784085276 >> v1:172.21.15.110:6789/0 conn(0x7f0fb015c9c0 legacy=0x7f0fb0160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:06.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.999+0000 7f0fa7fff640 1 -- 172.21.15.55:0/2784085276 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891987246 0 0) 0x7f0fb006eaf0 con 0x7f0fb015c9c0 2023-08-25T04:21:06.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.999+0000 7f0fb5cae640 1 -- 172.21.15.55:0/2784085276 >> v1:172.21.15.55:6789/0 conn(0x7f0fb00cfa70 legacy=0x7f0fb0160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:06.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.999+0000 7f0fb5cae640 1 -- 172.21.15.55:0/2784085276 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb006e810 con 0x7f0fb006c2c0 2023-08-25T04:21:06.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.999+0000 7f0fb5cae640 1 --2- 172.21.15.55:0/2784085276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fb006c2c0 0x7f0fb0167840 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8009d90 tx=0x7f0fa801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdbe2e674abbc3f3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:06.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.999+0000 7f0fa7fff640 1 -- 172.21.15.55:0/2784085276 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa80a59e0 con 0x7f0fb006c2c0 2023-08-25T04:21:06.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.999+0000 7f0fa7fff640 1 -- 172.21.15.55:0/2784085276 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa80a5b40 con 0x7f0fb006c2c0 2023-08-25T04:21:06.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.999+0000 7f0fa7fff640 1 -- 172.21.15.55:0/2784085276 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa80ad440 con 0x7f0fb006c2c0 2023-08-25T04:21:06.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.999+0000 7f0fb7711640 1 -- 172.21.15.55:0/2784085276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fb006c2c0 msgr2=0x7f0fb0167840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:06.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.999+0000 7f0fb7711640 1 --2- 172.21.15.55:0/2784085276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fb006c2c0 0x7f0fb0167840 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8009d90 tx=0x7f0fa801c920 comp rx=0 tx=0).stop 2023-08-25T04:21:06.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.999+0000 7f0fb7711640 1 -- 172.21.15.55:0/2784085276 shutdown_connections 2023-08-25T04:21:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.999+0000 7f0fb7711640 1 --2- 172.21.15.55:0/2784085276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fb006c2c0 0x7f0fb0167840 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:06.999+0000 7f0fb7711640 1 -- 172.21.15.55:0/2784085276 >> 172.21.15.55:0/2784085276 conn(0x7f0fb00d05a0 msgr2=0x7f0fb00d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb7711640 1 -- 172.21.15.55:0/2784085276 shutdown_connections 2023-08-25T04:21:07.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb7711640 1 -- 172.21.15.55:0/2784085276 wait complete. 2023-08-25T04:21:07.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb7711640 1 Processor -- start 2023-08-25T04:21:07.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb7711640 1 -- start start 2023-08-25T04:21:07.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb7711640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fb006c2c0 0x7f0fb015b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:07.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb7711640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fb00cfa70 0x7f0fb015f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:07.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb7711640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fb015c9c0 0x7f0fb014bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:07.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb7711640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb015db60 con 0x7f0fb015c9c0 2023-08-25T04:21:07.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb7711640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb015de40 con 0x7f0fb00cfa70 2023-08-25T04:21:07.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb7711640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb015cf20 con 0x7f0fb006c2c0 2023-08-25T04:21:07.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb5cae640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fb015c9c0 0x7f0fb014bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:07.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb5cae640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fb015c9c0 0x7f0fb014bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57198/0 (socket says 172.21.15.55:57198) 2023-08-25T04:21:07.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb5cae640 1 -- 172.21.15.55:0/3470580446 learned_addr learned my addr 172.21.15.55:0/3470580446 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:07.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb4cac640 1 --2- 172.21.15.55:0/3470580446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fb00cfa70 0x7f0fb015f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:07.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb54ad640 1 --2- 172.21.15.55:0/3470580446 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fb006c2c0 0x7f0fb015b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:07.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb5cae640 1 -- 172.21.15.55:0/3470580446 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fb006c2c0 msgr2=0x7f0fb015b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:07.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb5cae640 1 --2- 172.21.15.55:0/3470580446 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fb006c2c0 0x7f0fb015b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb5cae640 1 -- 172.21.15.55:0/3470580446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fb00cfa70 msgr2=0x7f0fb015f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:07.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb5cae640 1 --2- 172.21.15.55:0/3470580446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fb00cfa70 0x7f0fb015f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb5cae640 1 -- 172.21.15.55:0/3470580446 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa8009a70 con 0x7f0fb015c9c0 2023-08-25T04:21:07.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb54ad640 1 --2- 172.21.15.55:0/3470580446 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fb006c2c0 0x7f0fb015b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:07.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.003+0000 7f0fb5cae640 1 --2- 172.21.15.55:0/3470580446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fb015c9c0 0x7f0fb014bba0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8009d90 tx=0x7f0fa80196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:07.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.007+0000 7f0fa5ffb640 1 -- 172.21.15.55:0/3470580446 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa80add30 con 0x7f0fb015c9c0 2023-08-25T04:21:07.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.007+0000 7f0fa5ffb640 1 -- 172.21.15.55:0/3470580446 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa80ade90 con 0x7f0fb015c9c0 2023-08-25T04:21:07.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.007+0000 7f0fb7711640 1 -- 172.21.15.55:0/3470580446 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb015d1c0 con 0x7f0fb015c9c0 2023-08-25T04:21:07.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.007+0000 7f0fa5ffb640 1 -- 172.21.15.55:0/3470580446 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8003ba0 con 0x7f0fb015c9c0 2023-08-25T04:21:07.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.007+0000 7f0fb7711640 1 -- 172.21.15.55:0/3470580446 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb015d780 con 0x7f0fb015c9c0 2023-08-25T04:21:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.007+0000 7f0fb7711640 1 -- 172.21.15.55:0/3470580446 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb015dca0 con 0x7f0fb015c9c0 2023-08-25T04:21:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.007+0000 7f0fa5ffb640 1 -- 172.21.15.55:0/3470580446 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 54) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f0fa80c2450 con 0x7f0fb015c9c0 2023-08-25T04:21:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.007+0000 7f0fa5ffb640 1 --2- 172.21.15.55:0/3470580446 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f0f940654d0 0x7f0f94067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.007+0000 7f0fa5ffb640 1 -- 172.21.15.55:0/3470580446 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6995+0+0 (secure 0 0 0) 0x7f0fa811e3b0 con 0x7f0fb015c9c0 2023-08-25T04:21:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.007+0000 7f0fb54ad640 1 --2- 172.21.15.55:0/3470580446 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f0f940654d0 0x7f0f94067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.011+0000 7f0fb54ad640 1 --2- 172.21.15.55:0/3470580446 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f0f940654d0 0x7f0f94067990 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0fac000fc0 tx=0x7f0fac009040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:07.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.011+0000 7f0fa5ffb640 1 -- 172.21.15.55:0/3470580446 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0fb015dca0 con 0x7f0fb015c9c0 2023-08-25T04:21:07.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.171+0000 7f0fb7711640 1 -- 172.21.15.55:0/3470580446 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fb015dca0 con 0x7f0fb015c9c0 2023-08-25T04:21:07.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.171+0000 7f0fa5ffb640 1 -- 172.21.15.55:0/3470580446 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+19717 (secure 0 0 0) 0x7f0fb015dca0 con 0x7f0fb015c9c0 2023-08-25T04:21:07.174 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:07.174 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":111,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:21:05.518359+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:19:39.091781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-25T04:19:40.272091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.26","mappings":[{"from":1,"to":7}]},{"pgid":"14.2a","mappings":[{"from":1,"to":5}]},{"pgid":"14.2c","mappings":[{"from":1,"to":7}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/2314442939":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/2377772956":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/2047388026":"2023-08-26T04:21:05.518300+0000","172.21.15.110:6833/4020134262":"2023-08-26T04:21:05.518300+0000","172.21.15.110:6832/4020134262":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/628153163":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/3139288378":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/3461148215":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/1316478715":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/1419068877":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/4165332902":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/2779991692":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/3403132554":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/2984642613":"2023-08-26T04:19:58.502978+0000","172.21.15.110:6833/1337211678":"2023-08-26T04:19:58.502978+0000","172.21.15.110:6832/1337211678":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/499210753":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/3677413256":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/3256947721":"2023-08-25T05:19:50.681655+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:21:07.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.175+0000 7f0fb7711640 1 -- 172.21.15.55:0/3470580446 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f0f940654d0 msgr2=0x7f0f94067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:07.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.175+0000 7f0fb7711640 1 --2- 172.21.15.55:0/3470580446 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f0f940654d0 0x7f0f94067990 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0fac000fc0 tx=0x7f0fac009040 comp rx=0 tx=0).stop 2023-08-25T04:21:07.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.175+0000 7f0fb7711640 1 -- 172.21.15.55:0/3470580446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fb015c9c0 msgr2=0x7f0fb014bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:07.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.175+0000 7f0fb7711640 1 --2- 172.21.15.55:0/3470580446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fb015c9c0 0x7f0fb014bba0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8009d90 tx=0x7f0fa80196c0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.175+0000 7f0fb7711640 1 -- 172.21.15.55:0/3470580446 shutdown_connections 2023-08-25T04:21:07.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.175+0000 7f0fb7711640 1 --2- 172.21.15.55:0/3470580446 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f0f940654d0 0x7f0f94067990 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.175+0000 7f0fb7711640 1 --2- 172.21.15.55:0/3470580446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fb015c9c0 0x7f0fb014bba0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.175+0000 7f0fb7711640 1 --2- 172.21.15.55:0/3470580446 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fb00cfa70 0x7f0fb015f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.175+0000 7f0fb7711640 1 --2- 172.21.15.55:0/3470580446 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fb006c2c0 0x7f0fb015b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.175+0000 7f0fb7711640 1 -- 172.21.15.55:0/3470580446 >> 172.21.15.55:0/3470580446 conn(0x7f0fb00d05a0 msgr2=0x7f0fb01574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:07.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.175+0000 7f0fb7711640 1 -- 172.21.15.55:0/3470580446 shutdown_connections 2023-08-25T04:21:07.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.175+0000 7f0fb7711640 1 -- 172.21.15.55:0/3470580446 wait complete. 2023-08-25T04:21:07.191 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-25T04:21:07.191 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:21:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.339+0000 7f5ae144f640 1 Processor -- start 2023-08-25T04:21:07.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.339+0000 7f5ae144f640 1 -- start start 2023-08-25T04:21:07.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.339+0000 7f5ae144f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5adc160120 0x7f5adc0b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:07.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.339+0000 7f5ae144f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5adc0b1f20 con 0x7f5adc0b33c0 2023-08-25T04:21:07.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.339+0000 7f5ae144f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5adc0d1320 con 0x7f5adc0b4080 2023-08-25T04:21:07.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.339+0000 7f5ae144f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5adc0cddf0 con 0x7f5adc160120 2023-08-25T04:21:07.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.339+0000 7f5adb7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5adc0b33c0 0x7f5adc0d0c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39138/0 (socket says 172.21.15.55:39138) 2023-08-25T04:21:07.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.339+0000 7f5adb7fe640 1 -- 172.21.15.55:0/560916174 learned_addr learned my addr 172.21.15.55:0/560916174 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:07.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.339+0000 7f5adaffd640 1 --2- 172.21.15.55:0/560916174 >> v2:172.21.15.110:3300/0 conn(0x7f5adc160120 0x7f5adc0b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:07.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.339+0000 7f5ada7fc640 1 -- 172.21.15.55:0/560916174 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509999652 0 0) 0x7f5adc0b1f20 con 0x7f5adc0b33c0 2023-08-25T04:21:07.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.339+0000 7f5ada7fc640 1 -- 172.21.15.55:0/560916174 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ac8003530 con 0x7f5adc0b33c0 2023-08-25T04:21:07.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.339+0000 7f5adaffd640 1 -- 172.21.15.55:0/560916174 >> v1:172.21.15.110:6789/0 conn(0x7f5adc0b4080 legacy=0x7f5adc0d0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:07.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.339+0000 7f5adaffd640 1 -- 172.21.15.55:0/560916174 >> v1:172.21.15.55:6789/0 conn(0x7f5adc0b33c0 legacy=0x7f5adc0d0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:07.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.339+0000 7f5adaffd640 1 -- 172.21.15.55:0/560916174 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc0ce0d0 con 0x7f5adc160120 2023-08-25T04:21:07.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.343+0000 7f5adaffd640 1 --2- 172.21.15.55:0/560916174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5adc160120 0x7f5adc0b1480 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0097d0 tx=0x7f5acc01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f24e2d7a0bfe51a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:07.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.343+0000 7f5ada7fc640 1 -- 172.21.15.55:0/560916174 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0a7070 con 0x7f5adc160120 2023-08-25T04:21:07.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.343+0000 7f5ada7fc640 1 -- 172.21.15.55:0/560916174 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc0ab430 con 0x7f5adc160120 2023-08-25T04:21:07.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.343+0000 7f5ada7fc640 1 -- 172.21.15.55:0/560916174 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc0ab7c0 con 0x7f5adc160120 2023-08-25T04:21:07.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.343+0000 7f5ae144f640 1 -- 172.21.15.55:0/560916174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5adc160120 msgr2=0x7f5adc0b1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:07.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.343+0000 7f5ae144f640 1 --2- 172.21.15.55:0/560916174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5adc160120 0x7f5adc0b1480 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0097d0 tx=0x7f5acc01c430 comp rx=0 tx=0).stop 2023-08-25T04:21:07.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.343+0000 7f5ae144f640 1 -- 172.21.15.55:0/560916174 shutdown_connections 2023-08-25T04:21:07.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.343+0000 7f5ae144f640 1 --2- 172.21.15.55:0/560916174 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5adc160120 0x7f5adc0b1480 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.343+0000 7f5ae144f640 1 -- 172.21.15.55:0/560916174 >> 172.21.15.55:0/560916174 conn(0x7f5adc09b950 msgr2=0x7f5adc0d2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:07.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.343+0000 7f5ae144f640 1 -- 172.21.15.55:0/560916174 shutdown_connections 2023-08-25T04:21:07.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.343+0000 7f5ae144f640 1 -- 172.21.15.55:0/560916174 wait complete. 2023-08-25T04:21:07.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.343+0000 7f5ae144f640 1 Processor -- start 2023-08-25T04:21:07.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ae144f640 1 -- start start 2023-08-25T04:21:07.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ae144f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5adc0b33c0 0x7f5adc154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:07.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ae144f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5adc0b4080 0x7f5adc0c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:07.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ae144f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5adc160120 0x7f5adc0b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:07.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ae144f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0cc1b0 con 0x7f5adc0b4080 2023-08-25T04:21:07.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ae144f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0b6610 con 0x7f5adc0b33c0 2023-08-25T04:21:07.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ae144f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0b68f0 con 0x7f5adc160120 2023-08-25T04:21:07.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ad3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5adc0b4080 0x7f5adc0c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:07.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ad3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5adc0b4080 0x7f5adc0c6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57204/0 (socket says 172.21.15.55:57204) 2023-08-25T04:21:07.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ad3fff640 1 -- 172.21.15.55:0/3439514413 learned_addr learned my addr 172.21.15.55:0/3439514413 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:07.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5adaffd640 1 --2- 172.21.15.55:0/3439514413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5adc0b33c0 0x7f5adc154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:07.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5adb7fe640 1 --2- 172.21.15.55:0/3439514413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5adc160120 0x7f5adc0b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:07.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ad3fff640 1 -- 172.21.15.55:0/3439514413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5adc160120 msgr2=0x7f5adc0b79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:07.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ad3fff640 1 --2- 172.21.15.55:0/3439514413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5adc160120 0x7f5adc0b79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ad3fff640 1 -- 172.21.15.55:0/3439514413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5adc0b33c0 msgr2=0x7f5adc154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:07.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ad3fff640 1 --2- 172.21.15.55:0/3439514413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5adc0b33c0 0x7f5adc154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ad3fff640 1 -- 172.21.15.55:0/3439514413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc0093b0 con 0x7f5adc0b4080 2023-08-25T04:21:07.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ad3fff640 1 --2- 172.21.15.55:0/3439514413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5adc0b4080 0x7f5adc0c6f40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400c500 tx=0x7f5ac400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:07.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ad37fe640 1 -- 172.21.15.55:0/3439514413 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4005220 con 0x7f5adc0b4080 2023-08-25T04:21:07.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ad37fe640 1 -- 172.21.15.55:0/3439514413 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac4005380 con 0x7f5adc0b4080 2023-08-25T04:21:07.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ae144f640 1 -- 172.21.15.55:0/3439514413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5adc0b4a20 con 0x7f5adc0b4080 2023-08-25T04:21:07.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ad37fe640 1 -- 172.21.15.55:0/3439514413 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4007270 con 0x7f5adc0b4080 2023-08-25T04:21:07.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ae144f640 1 -- 172.21.15.55:0/3439514413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5adc0b6eb0 con 0x7f5adc0b4080 2023-08-25T04:21:07.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.347+0000 7f5ae144f640 1 -- 172.21.15.55:0/3439514413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5adc073e50 con 0x7f5adc0b4080 2023-08-25T04:21:07.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.351+0000 7f5ad37fe640 1 -- 172.21.15.55:0/3439514413 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 54) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f5ac40073d0 con 0x7f5adc0b4080 2023-08-25T04:21:07.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.351+0000 7f5ad37fe640 1 --2- 172.21.15.55:0/3439514413 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f5abc0654d0 0x7f5abc067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:07.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.351+0000 7f5ad37fe640 1 -- 172.21.15.55:0/3439514413 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6995+0+0 (secure 0 0 0) 0x7f5ac4082670 con 0x7f5adc0b4080 2023-08-25T04:21:07.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.351+0000 7f5adaffd640 1 --2- 172.21.15.55:0/3439514413 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f5abc0654d0 0x7f5abc067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:07.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.351+0000 7f5adaffd640 1 --2- 172.21.15.55:0/3439514413 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f5abc0654d0 0x7f5abc067990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0af000 tx=0x7f5acc0a7000 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:07.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.355+0000 7f5ad37fe640 1 -- 172.21.15.55:0/3439514413 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5ac4050020 con 0x7f5adc0b4080 2023-08-25T04:21:07.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.543+0000 7f5ae144f640 1 -- 172.21.15.55:0/3439514413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5adc0af1b0 con 0x7f5adc0b4080 2023-08-25T04:21:07.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.543+0000 7f5ad37fe640 1 -- 172.21.15.55:0/3439514413 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f5ac4053640 con 0x7f5adc0b4080 2023-08-25T04:21:07.541 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:07.542 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3111804785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3111804785},{"type":"v1","addr":"172.21.15.110:6836","nonce":3111804785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3444442085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3444442085},{"type":"v1","addr":"172.21.15.110:6837","nonce":3444442085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":7857,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2022633620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2022633620},{"type":"v1","addr":"172.21.15.55:6834","nonce":2022633620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:19:41.282901+0000","modified":"2023-08-25T04:19:44.912410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1173226599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1173226599},{"type":"v1","addr":"172.21.15.55:6835","nonce":1173226599}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-25T04:21:07.542 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 49 2023-08-25T04:21:07.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.543+0000 7f5ae144f640 1 -- 172.21.15.55:0/3439514413 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f5abc0654d0 msgr2=0x7f5abc067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:07.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.543+0000 7f5ae144f640 1 --2- 172.21.15.55:0/3439514413 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f5abc0654d0 0x7f5abc067990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5acc0af000 tx=0x7f5acc0a7000 comp rx=0 tx=0).stop 2023-08-25T04:21:07.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.543+0000 7f5ae144f640 1 -- 172.21.15.55:0/3439514413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5adc0b4080 msgr2=0x7f5adc0c6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:07.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.543+0000 7f5ae144f640 1 --2- 172.21.15.55:0/3439514413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5adc0b4080 0x7f5adc0c6f40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400c500 tx=0x7f5ac400c9c0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.543+0000 7f5ae144f640 1 -- 172.21.15.55:0/3439514413 shutdown_connections 2023-08-25T04:21:07.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.543+0000 7f5ae144f640 1 --2- 172.21.15.55:0/3439514413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5adc160120 0x7f5adc0b79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.543+0000 7f5ae144f640 1 --2- 172.21.15.55:0/3439514413 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f5abc0654d0 0x7f5abc067990 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.543+0000 7f5ae144f640 1 --2- 172.21.15.55:0/3439514413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5adc0b4080 0x7f5adc0c6f40 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.543+0000 7f5ae144f640 1 --2- 172.21.15.55:0/3439514413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5adc0b33c0 0x7f5adc154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.543+0000 7f5ae144f640 1 -- 172.21.15.55:0/3439514413 >> 172.21.15.55:0/3439514413 conn(0x7f5adc09b950 msgr2=0x7f5adc0af6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:07.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.543+0000 7f5ae144f640 1 -- 172.21.15.55:0/3439514413 shutdown_connections 2023-08-25T04:21:07.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.543+0000 7f5ae144f640 1 -- 172.21.15.55:0/3439514413 wait complete. 2023-08-25T04:21:07.562 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:21:07.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.711+0000 7ff90eddb640 1 Processor -- start 2023-08-25T04:21:07.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.711+0000 7ff90eddb640 1 -- start start 2023-08-25T04:21:07.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.711+0000 7ff90eddb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff9080d0da0 0x7ff9080d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:07.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.711+0000 7ff90eddb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9080b29b0 con 0x7ff9080cdde0 2023-08-25T04:21:07.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.711+0000 7ff90eddb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9080cfc80 con 0x7ff9080b3e50 2023-08-25T04:21:07.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.711+0000 7ff90eddb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9080d16c0 con 0x7ff9080d0da0 2023-08-25T04:21:07.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.711+0000 7ff8fffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff9080cdde0 0x7ff9080cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39148/0 (socket says 172.21.15.55:39148) 2023-08-25T04:21:07.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.711+0000 7ff8fffff640 1 -- 172.21.15.55:0/1494186806 learned_addr learned my addr 172.21.15.55:0/1494186806 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:07.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.711+0000 7ff90cb77640 1 --2- 172.21.15.55:0/1494186806 >> v2:172.21.15.110:3300/0 conn(0x7ff9080d0da0 0x7ff9080d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:07.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.711+0000 7ff8ff7fe640 1 -- 172.21.15.55:0/1494186806 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931818767 0 0) 0x7ff9080b29b0 con 0x7ff9080cdde0 2023-08-25T04:21:07.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.711+0000 7ff8ff7fe640 1 -- 172.21.15.55:0/1494186806 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8f0003530 con 0x7ff9080cdde0 2023-08-25T04:21:07.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.711+0000 7ff8ff7fe640 1 -- 172.21.15.55:0/1494186806 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459838783 0 0) 0x7ff9080cfc80 con 0x7ff9080b3e50 2023-08-25T04:21:07.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.711+0000 7ff8ff7fe640 1 -- 172.21.15.55:0/1494186806 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9080b29b0 con 0x7ff9080b3e50 2023-08-25T04:21:07.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.711+0000 7ff8ff7fe640 1 -- 172.21.15.55:0/1494186806 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2431236480 0 0) 0x7ff8f0003530 con 0x7ff9080cdde0 2023-08-25T04:21:07.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.711+0000 7ff90cb77640 1 -- 172.21.15.55:0/1494186806 >> v1:172.21.15.110:6789/0 conn(0x7ff9080b3e50 legacy=0x7ff9080cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:07.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.711+0000 7ff90cb77640 1 -- 172.21.15.55:0/1494186806 >> v1:172.21.15.55:6789/0 conn(0x7ff9080cdde0 legacy=0x7ff9080cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:07.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.711+0000 7ff90cb77640 1 -- 172.21.15.55:0/1494186806 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9080b1dc0 con 0x7ff9080d0da0 2023-08-25T04:21:07.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.715+0000 7ff90cb77640 1 --2- 172.21.15.55:0/1494186806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9080d0da0 0x7ff9080d1180 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff9040097a0 tx=0x7ff90401eb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=addc0c305bdb170c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:07.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.715+0000 7ff8ff7fe640 1 -- 172.21.15.55:0/1494186806 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8001680 con 0x7ff9080d0da0 2023-08-25T04:21:07.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.715+0000 7ff8ff7fe640 1 -- 172.21.15.55:0/1494186806 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9040a85f0 con 0x7ff9080d0da0 2023-08-25T04:21:07.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.715+0000 7ff8ff7fe640 1 -- 172.21.15.55:0/1494186806 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9040a8980 con 0x7ff9080d0da0 2023-08-25T04:21:07.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.715+0000 7ff90eddb640 1 -- 172.21.15.55:0/1494186806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9080d0da0 msgr2=0x7ff9080d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:07.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.715+0000 7ff90eddb640 1 --2- 172.21.15.55:0/1494186806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9080d0da0 0x7ff9080d1180 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff9040097a0 tx=0x7ff90401eb70 comp rx=0 tx=0).stop 2023-08-25T04:21:07.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.715+0000 7ff90eddb640 1 -- 172.21.15.55:0/1494186806 shutdown_connections 2023-08-25T04:21:07.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.715+0000 7ff90eddb640 1 --2- 172.21.15.55:0/1494186806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9080d0da0 0x7ff9080d1180 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.715+0000 7ff90eddb640 1 -- 172.21.15.55:0/1494186806 >> 172.21.15.55:0/1494186806 conn(0x7ff90809bae0 msgr2=0x7ff9080d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:07.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.715+0000 7ff90eddb640 1 -- 172.21.15.55:0/1494186806 shutdown_connections 2023-08-25T04:21:07.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.715+0000 7ff90eddb640 1 -- 172.21.15.55:0/1494186806 wait complete. 2023-08-25T04:21:07.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90eddb640 1 Processor -- start 2023-08-25T04:21:07.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90eddb640 1 -- start start 2023-08-25T04:21:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90eddb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9080b3e50 0x7ff90815b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90eddb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9080cdde0 0x7ff9080b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90eddb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9080d0da0 0x7ff9080b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90eddb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9080ca8e0 con 0x7ff9080d0da0 2023-08-25T04:21:07.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90eddb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90815d240 con 0x7ff9080b3e50 2023-08-25T04:21:07.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90eddb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90815d520 con 0x7ff9080cdde0 2023-08-25T04:21:07.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90d378640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9080d0da0 0x7ff9080b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:07.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90cb77640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9080b3e50 0x7ff90815b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:07.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90d378640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9080d0da0 0x7ff9080b7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57214/0 (socket says 172.21.15.55:57214) 2023-08-25T04:21:07.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90d378640 1 -- 172.21.15.55:0/2743551235 learned_addr learned my addr 172.21.15.55:0/2743551235 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:07.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90cb77640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9080b3e50 0x7ff90815b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:50760/0 (socket says 172.21.15.55:50760) 2023-08-25T04:21:07.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff8fffff640 1 --2- 172.21.15.55:0/2743551235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9080cdde0 0x7ff9080b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:07.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90d378640 1 -- 172.21.15.55:0/2743551235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9080cdde0 msgr2=0x7ff9080b73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:07.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90d378640 1 --2- 172.21.15.55:0/2743551235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9080cdde0 0x7ff9080b73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90d378640 1 -- 172.21.15.55:0/2743551235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9080b3e50 msgr2=0x7ff90815b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:07.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90d378640 1 --2- 172.21.15.55:0/2743551235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9080b3e50 0x7ff90815b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90d378640 1 -- 172.21.15.55:0/2743551235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9040093b0 con 0x7ff9080d0da0 2023-08-25T04:21:07.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90d378640 1 --2- 172.21.15.55:0/2743551235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9080d0da0 0x7ff9080b7930 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7ff90000c6c0 tx=0x7ff90000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:07.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff8fd7fa640 1 -- 172.21.15.55:0/2743551235 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff900003b80 con 0x7ff9080d0da0 2023-08-25T04:21:07.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff8fd7fa640 1 -- 172.21.15.55:0/2743551235 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff900003ce0 con 0x7ff9080d0da0 2023-08-25T04:21:07.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff8fd7fa640 1 -- 172.21.15.55:0/2743551235 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9000052f0 con 0x7ff9080d0da0 2023-08-25T04:21:07.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90eddb640 1 -- 172.21.15.55:0/2743551235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90815d800 con 0x7ff9080d0da0 2023-08-25T04:21:07.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.719+0000 7ff90eddb640 1 -- 172.21.15.55:0/2743551235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90815b7b0 con 0x7ff9080d0da0 2023-08-25T04:21:07.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.723+0000 7ff90eddb640 1 -- 172.21.15.55:0/2743551235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff90815d9f0 con 0x7ff9080d0da0 2023-08-25T04:21:07.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.723+0000 7ff8fd7fa640 1 -- 172.21.15.55:0/2743551235 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 54) v1 ==== 84800+0+0 (secure 0 0 0) 0x7ff900005450 con 0x7ff9080d0da0 2023-08-25T04:21:07.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.723+0000 7ff8fd7fa640 1 --2- 172.21.15.55:0/2743551235 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7ff8f40654d0 0x7ff8f4067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:07.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.723+0000 7ff8fd7fa640 1 -- 172.21.15.55:0/2743551235 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6995+0+0 (secure 0 0 0) 0x7ff900082a60 con 0x7ff9080d0da0 2023-08-25T04:21:07.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.723+0000 7ff90cb77640 1 --2- 172.21.15.55:0/2743551235 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7ff8f40654d0 0x7ff8f4067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:07.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.723+0000 7ff90cb77640 1 --2- 172.21.15.55:0/2743551235 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7ff8f40654d0 0x7ff8f4067990 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff9040b2000 tx=0x7ff904008040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:07.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.727+0000 7ff8fd7fa640 1 -- 172.21.15.55:0/2743551235 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff900050560 con 0x7ff9080d0da0 2023-08-25T04:21:07.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.775+0000 7ff8fd7fa640 1 -- 172.21.15.55:0/2743551235 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 55) v1 ==== 85008+0+0 (secure 0 0 0) 0x7ff900005700 con 0x7ff9080d0da0 2023-08-25T04:21:07.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.919+0000 7ff90eddb640 1 -- 172.21.15.55:0/2743551235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff90804dbe0 con 0x7ff9080d0da0 2023-08-25T04:21:07.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.919+0000 7ff8fd7fa640 1 -- 172.21.15.55:0/2743551235 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4883 (secure 0 0 0) 0x7ff900053ff0 con 0x7ff9080d0da0 2023-08-25T04:21:07.916 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:07.916 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3111804785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3111804785},{"type":"v1","addr":"172.21.15.110:6836","nonce":3111804785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3444442085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3444442085},{"type":"v1","addr":"172.21.15.110:6837","nonce":3444442085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":7857,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2022633620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2022633620},{"type":"v1","addr":"172.21.15.55:6834","nonce":2022633620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:19:41.282901+0000","modified":"2023-08-25T04:19:44.912410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7860},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7860":{"gid":7860,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1173226599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1173226599},{"type":"v1","addr":"172.21.15.55:6835","nonce":1173226599}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-08-25T04:21:07.917 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 49 2023-08-25T04:21:07.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.919+0000 7ff90eddb640 1 -- 172.21.15.55:0/2743551235 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7ff8f40654d0 msgr2=0x7ff8f4067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:07.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.919+0000 7ff90eddb640 1 --2- 172.21.15.55:0/2743551235 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7ff8f40654d0 0x7ff8f4067990 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff9040b2000 tx=0x7ff904008040 comp rx=0 tx=0).stop 2023-08-25T04:21:07.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.919+0000 7ff90eddb640 1 -- 172.21.15.55:0/2743551235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9080d0da0 msgr2=0x7ff9080b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:07.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.919+0000 7ff90eddb640 1 --2- 172.21.15.55:0/2743551235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9080d0da0 0x7ff9080b7930 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7ff90000c6c0 tx=0x7ff90000cb80 comp rx=0 tx=0).stop 2023-08-25T04:21:07.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.919+0000 7ff90eddb640 1 -- 172.21.15.55:0/2743551235 shutdown_connections 2023-08-25T04:21:07.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.919+0000 7ff90eddb640 1 --2- 172.21.15.55:0/2743551235 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7ff8f40654d0 0x7ff8f4067990 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.919+0000 7ff90eddb640 1 --2- 172.21.15.55:0/2743551235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9080d0da0 0x7ff9080b7930 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.919+0000 7ff90eddb640 1 --2- 172.21.15.55:0/2743551235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9080cdde0 0x7ff9080b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.919+0000 7ff90eddb640 1 --2- 172.21.15.55:0/2743551235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9080b3e50 0x7ff90815b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:07.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.919+0000 7ff90eddb640 1 -- 172.21.15.55:0/2743551235 >> 172.21.15.55:0/2743551235 conn(0x7ff90809bae0 msgr2=0x7ff90806b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:07.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.919+0000 7ff90eddb640 1 -- 172.21.15.55:0/2743551235 shutdown_connections 2023-08-25T04:21:07.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:07.919+0000 7ff90eddb640 1 -- 172.21.15.55:0/2743551235 wait complete. 2023-08-25T04:21:07.937 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:21:08.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.083+0000 7f0afa4e5640 1 Processor -- start 2023-08-25T04:21:08.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.083+0000 7f0afa4e5640 1 -- start start 2023-08-25T04:21:08.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.083+0000 7f0afa4e5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40d0da0 0x7f0af40d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:08.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.083+0000 7f0afa4e5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0af40cdde0 0x7f0af40ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:08.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.083+0000 7f0afa4e5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af40b29b0 con 0x7f0af40cee60 2023-08-25T04:21:08.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.083+0000 7f0afa4e5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af40ce760 con 0x7f0af40cdde0 2023-08-25T04:21:08.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.083+0000 7f0afa4e5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af40d16c0 con 0x7f0af40d0da0 2023-08-25T04:21:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.083+0000 7f0af3fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40d0da0 0x7f0af40d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.083+0000 7f0af37fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0af40cdde0 0x7f0af40ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.083+0000 7f0af3fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40d0da0 0x7f0af40d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:32786/0 (socket says 172.21.15.55:32786) 2023-08-25T04:21:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.083+0000 7f0af3fff640 1 -- 172.21.15.55:0/4068362373 learned_addr learned my addr 172.21.15.55:0/4068362373 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.083+0000 7f0af3fff640 1 -- 172.21.15.55:0/4068362373 >> v2:172.21.15.110:3300/0 conn(0x7f0af40cdde0 msgr2=0x7f0af40ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.083+0000 7f0af3fff640 1 --2- 172.21.15.55:0/4068362373 >> v2:172.21.15.110:3300/0 conn(0x7f0af40cdde0 0x7f0af40ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.083+0000 7f0af3fff640 1 -- 172.21.15.55:0/4068362373 >> v1:172.21.15.110:6789/0 conn(0x7f0af40cee60 legacy=0x7f0af40cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:08.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.083+0000 7f0af3fff640 1 -- 172.21.15.55:0/4068362373 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af40b1dc0 con 0x7f0af40d0da0 2023-08-25T04:21:08.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.083+0000 7f0af37fe640 1 --2- 172.21.15.55:0/4068362373 >> v2:172.21.15.110:3300/0 conn(0x7f0af40cdde0 0x7f0af40ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:08.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.087+0000 7f0af3fff640 1 --2- 172.21.15.55:0/4068362373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40d0da0 0x7f0af40d1180 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4006fd0 tx=0x7f0ae401ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34868a8387c60db0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:08.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.087+0000 7f0af2ffd640 1 -- 172.21.15.55:0/4068362373 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40a8a10 con 0x7f0af40d0da0 2023-08-25T04:21:08.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.087+0000 7f0af2ffd640 1 -- 172.21.15.55:0/4068362373 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae40a8b70 con 0x7f0af40d0da0 2023-08-25T04:21:08.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.087+0000 7f0af2ffd640 1 -- 172.21.15.55:0/4068362373 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40b0440 con 0x7f0af40d0da0 2023-08-25T04:21:08.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.087+0000 7f0afa4e5640 1 -- 172.21.15.55:0/4068362373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40d0da0 msgr2=0x7f0af40d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:08.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.087+0000 7f0afa4e5640 1 --2- 172.21.15.55:0/4068362373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40d0da0 0x7f0af40d1180 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4006fd0 tx=0x7f0ae401ed10 comp rx=0 tx=0).stop 2023-08-25T04:21:08.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.087+0000 7f0afa4e5640 1 -- 172.21.15.55:0/4068362373 shutdown_connections 2023-08-25T04:21:08.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.087+0000 7f0afa4e5640 1 --2- 172.21.15.55:0/4068362373 >> v2:172.21.15.110:3300/0 conn(0x7f0af40cdde0 0x7f0af40ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.087+0000 7f0afa4e5640 1 --2- 172.21.15.55:0/4068362373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40d0da0 0x7f0af40d1180 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.087+0000 7f0afa4e5640 1 -- 172.21.15.55:0/4068362373 >> 172.21.15.55:0/4068362373 conn(0x7f0af409bae0 msgr2=0x7f0af40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:08.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.087+0000 7f0afa4e5640 1 -- 172.21.15.55:0/4068362373 shutdown_connections 2023-08-25T04:21:08.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.087+0000 7f0afa4e5640 1 -- 172.21.15.55:0/4068362373 wait complete. 2023-08-25T04:21:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0afa4e5640 1 Processor -- start 2023-08-25T04:21:08.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0afa4e5640 1 -- start start 2023-08-25T04:21:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0afa4e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40cdde0 0x7f0af415ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0afa4e5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40cee60 0x7f0af415e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:08.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0afa4e5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0af40d0da0 0x7f0af40b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0afa4e5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af415e2a0 con 0x7f0af40cdde0 2023-08-25T04:21:08.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0afa4e5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af415d3c0 con 0x7f0af40d0da0 2023-08-25T04:21:08.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0afa4e5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af415d690 con 0x7f0af40cee60 2023-08-25T04:21:08.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0af3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40cdde0 0x7f0af415ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:08.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0af3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40cdde0 0x7f0af415ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57222/0 (socket says 172.21.15.55:57222) 2023-08-25T04:21:08.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0af3fff640 1 -- 172.21.15.55:0/741217737 learned_addr learned my addr 172.21.15.55:0/741217737 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:08.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0af37fe640 1 --2- 172.21.15.55:0/741217737 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40cee60 0x7f0af415e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0af3fff640 1 -- 172.21.15.55:0/741217737 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40cee60 msgr2=0x7f0af415e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0af8a82640 1 --2- 172.21.15.55:0/741217737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0af40d0da0 0x7f0af40b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0af3fff640 1 --2- 172.21.15.55:0/741217737 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40cee60 0x7f0af415e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0af3fff640 1 -- 172.21.15.55:0/741217737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0af40d0da0 msgr2=0x7f0af40b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0af3fff640 1 --2- 172.21.15.55:0/741217737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0af40d0da0 0x7f0af40b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0af3fff640 1 -- 172.21.15.55:0/741217737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae8009420 con 0x7f0af40cdde0 2023-08-25T04:21:08.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0af37fe640 1 --2- 172.21.15.55:0/741217737 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40cee60 0x7f0af415e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:08.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0af8a82640 1 --2- 172.21.15.55:0/741217737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0af40d0da0 0x7f0af40b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:08.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0af3fff640 1 --2- 172.21.15.55:0/741217737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40cdde0 0x7f0af415ce80 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4006fd0 tx=0x7f0ae401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:08.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0af0ff9640 1 -- 172.21.15.55:0/741217737 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4005ba0 con 0x7f0af40cdde0 2023-08-25T04:21:08.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0af0ff9640 1 -- 172.21.15.55:0/741217737 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae4005d00 con 0x7f0af40cdde0 2023-08-25T04:21:08.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0af0ff9640 1 -- 172.21.15.55:0/741217737 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4006240 con 0x7f0af40cdde0 2023-08-25T04:21:08.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.091+0000 7f0afa4e5640 1 -- 172.21.15.55:0/741217737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae4009480 con 0x7f0af40cdde0 2023-08-25T04:21:08.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.095+0000 7f0afa4e5640 1 -- 172.21.15.55:0/741217737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af415dc50 con 0x7f0af40cdde0 2023-08-25T04:21:08.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.095+0000 7f0afa4e5640 1 -- 172.21.15.55:0/741217737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af404dbe0 con 0x7f0af40cdde0 2023-08-25T04:21:08.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.095+0000 7f0af0ff9640 1 -- 172.21.15.55:0/741217737 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 55) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f0ae40b7070 con 0x7f0af40cdde0 2023-08-25T04:21:08.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.095+0000 7f0af0ff9640 1 --2- 172.21.15.55:0/741217737 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f0ae0065740 0x7f0ae0067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:08.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.095+0000 7f0af0ff9640 1 -- 172.21.15.55:0/741217737 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6995+0+0 (secure 0 0 0) 0x7f0ae411fe20 con 0x7f0af40cdde0 2023-08-25T04:21:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.095+0000 7f0af37fe640 1 --2- 172.21.15.55:0/741217737 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f0ae0065740 0x7f0ae0067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.095+0000 7f0af37fe640 1 --2- 172.21.15.55:0/741217737 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f0ae0065740 0x7f0ae0067c00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0af415c3f0 tx=0x7f0ae8008040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:08.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.099+0000 7f0af0ff9640 1 -- 172.21.15.55:0/741217737 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0ae40ed4d0 con 0x7f0af40cdde0 2023-08-25T04:21:08.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.255+0000 7f0afa4e5640 1 -- 172.21.15.55:0/741217737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0af41521c0 con 0x7f0af40cdde0 2023-08-25T04:21:08.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.255+0000 7f0af0ff9640 1 -- 172.21.15.55:0/741217737 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+19717 (secure 0 0 0) 0x7f0ae40be090 con 0x7f0af40cdde0 2023-08-25T04:21:08.255 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:08.255 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":111,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:21:05.518359+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:19:39.091781+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-25T04:19:40.272091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.26","mappings":[{"from":1,"to":7}]},{"pgid":"14.2a","mappings":[{"from":1,"to":5}]},{"pgid":"14.2c","mappings":[{"from":1,"to":7}]},{"pgid":"14.33","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/2314442939":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/2377772956":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/2047388026":"2023-08-26T04:21:05.518300+0000","172.21.15.110:6833/4020134262":"2023-08-26T04:21:05.518300+0000","172.21.15.110:6832/4020134262":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/628153163":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/3139288378":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/3461148215":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/1316478715":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/1419068877":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/4165332902":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/2779991692":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/3403132554":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/2984642613":"2023-08-26T04:19:58.502978+0000","172.21.15.110:6833/1337211678":"2023-08-26T04:19:58.502978+0000","172.21.15.110:6832/1337211678":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/499210753":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/3677413256":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/3256947721":"2023-08-25T05:19:50.681655+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:21:08.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.259+0000 7f0afa4e5640 1 -- 172.21.15.55:0/741217737 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f0ae0065740 msgr2=0x7f0ae0067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:08.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.259+0000 7f0afa4e5640 1 --2- 172.21.15.55:0/741217737 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f0ae0065740 0x7f0ae0067c00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0af415c3f0 tx=0x7f0ae8008040 comp rx=0 tx=0).stop 2023-08-25T04:21:08.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.259+0000 7f0afa4e5640 1 -- 172.21.15.55:0/741217737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40cdde0 msgr2=0x7f0af415ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:08.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.259+0000 7f0afa4e5640 1 --2- 172.21.15.55:0/741217737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40cdde0 0x7f0af415ce80 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4006fd0 tx=0x7f0ae401bab0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.259+0000 7f0afa4e5640 1 -- 172.21.15.55:0/741217737 shutdown_connections 2023-08-25T04:21:08.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.259+0000 7f0afa4e5640 1 --2- 172.21.15.55:0/741217737 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0af40d0da0 0x7f0af40b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.259+0000 7f0afa4e5640 1 --2- 172.21.15.55:0/741217737 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40cee60 0x7f0af415e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.259+0000 7f0afa4e5640 1 --2- 172.21.15.55:0/741217737 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f0ae0065740 0x7f0ae0067c00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.259+0000 7f0afa4e5640 1 --2- 172.21.15.55:0/741217737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40cdde0 0x7f0af415ce80 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.259+0000 7f0afa4e5640 1 -- 172.21.15.55:0/741217737 >> 172.21.15.55:0/741217737 conn(0x7f0af409bae0 msgr2=0x7f0af40b36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:08.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.259+0000 7f0afa4e5640 1 -- 172.21.15.55:0/741217737 shutdown_connections 2023-08-25T04:21:08.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.259+0000 7f0afa4e5640 1 -- 172.21.15.55:0/741217737 wait complete. 2023-08-25T04:21:08.276 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-25T04:21:08.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.423+0000 7f207cf74640 1 Processor -- start 2023-08-25T04:21:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.423+0000 7f207cf74640 1 -- start start 2023-08-25T04:21:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.423+0000 7f207cf74640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f207815c9c0 0x7f2078160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.423+0000 7f207cf74640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207806eaf0 con 0x7f207806b2b0 2023-08-25T04:21:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.423+0000 7f207cf74640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207806e530 con 0x7f20780cfa70 2023-08-25T04:21:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.423+0000 7f207cf74640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f207806e810 con 0x7f207815c9c0 2023-08-25T04:21:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.423+0000 7f207659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f207815c9c0 0x7f2078160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:08.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.423+0000 7f207659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f207815c9c0 0x7f2078160510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57226/0 (socket says 172.21.15.55:57226) 2023-08-25T04:21:08.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.423+0000 7f207659c640 1 -- 172.21.15.55:0/1430264130 learned_addr learned my addr 172.21.15.55:0/1430264130 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:08.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.427+0000 7f207659c640 1 -- 172.21.15.55:0/1430264130 >> v1:172.21.15.110:6789/0 conn(0x7f20780cfa70 legacy=0x7f2078160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:08.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.427+0000 7f207659c640 1 -- 172.21.15.55:0/1430264130 >> v1:172.21.15.55:6789/0 conn(0x7f207806b2b0 legacy=0x7f207806b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:08.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.427+0000 7f207659c640 1 -- 172.21.15.55:0/1430264130 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207806aab0 con 0x7f207815c9c0 2023-08-25T04:21:08.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.427+0000 7f207659c640 1 --2- 172.21.15.55:0/1430264130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f207815c9c0 0x7f2078160510 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f2068009860 tx=0x7f206801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a037634527d1b27a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:08.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.427+0000 7f2075d9b640 1 -- 172.21.15.55:0/1430264130 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20680aa610 con 0x7f207815c9c0 2023-08-25T04:21:08.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.427+0000 7f2075d9b640 1 -- 172.21.15.55:0/1430264130 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20680a6040 con 0x7f207815c9c0 2023-08-25T04:21:08.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.427+0000 7f2075d9b640 1 -- 172.21.15.55:0/1430264130 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20680aa990 con 0x7f207815c9c0 2023-08-25T04:21:08.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f207cf74640 1 -- 172.21.15.55:0/1430264130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f207815c9c0 msgr2=0x7f2078160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:08.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f207cf74640 1 --2- 172.21.15.55:0/1430264130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f207815c9c0 0x7f2078160510 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f2068009860 tx=0x7f206801c4f0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f207cf74640 1 -- 172.21.15.55:0/1430264130 shutdown_connections 2023-08-25T04:21:08.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f207cf74640 1 --2- 172.21.15.55:0/1430264130 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f207815c9c0 0x7f2078160510 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f207cf74640 1 -- 172.21.15.55:0/1430264130 >> 172.21.15.55:0/1430264130 conn(0x7f20780d05a0 msgr2=0x7f20780d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:08.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f207cf74640 1 -- 172.21.15.55:0/1430264130 shutdown_connections 2023-08-25T04:21:08.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f207cf74640 1 -- 172.21.15.55:0/1430264130 wait complete. 2023-08-25T04:21:08.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f207cf74640 1 Processor -- start 2023-08-25T04:21:08.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f207cf74640 1 -- start start 2023-08-25T04:21:08.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f207cf74640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f207806b2b0 0x7f2078158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:08.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f207cf74640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20780cfa70 0x7f2078153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:08.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f207cf74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f207815c9c0 0x7f20780b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:08.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f207cf74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2078152580 con 0x7f207815c9c0 2023-08-25T04:21:08.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f207cf74640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2078158e90 con 0x7f207806b2b0 2023-08-25T04:21:08.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f207cf74640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2078152840 con 0x7f20780cfa70 2023-08-25T04:21:08.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f2076d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f207815c9c0 0x7f20780b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:08.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f2076d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f207815c9c0 0x7f20780b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57238/0 (socket says 172.21.15.55:57238) 2023-08-25T04:21:08.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f2076d9d640 1 -- 172.21.15.55:0/561434365 learned_addr learned my addr 172.21.15.55:0/561434365 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:08.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f207659c640 1 --2- 172.21.15.55:0/561434365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f207806b2b0 0x7f2078158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:08.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f206ffff640 1 --2- 172.21.15.55:0/561434365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20780cfa70 0x7f2078153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:08.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f2076d9d640 1 -- 172.21.15.55:0/561434365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20780cfa70 msgr2=0x7f2078153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:08.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f2076d9d640 1 --2- 172.21.15.55:0/561434365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20780cfa70 0x7f2078153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f2076d9d640 1 -- 172.21.15.55:0/561434365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f207806b2b0 msgr2=0x7f2078158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:08.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f2076d9d640 1 --2- 172.21.15.55:0/561434365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f207806b2b0 0x7f2078158840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f2076d9d640 1 -- 172.21.15.55:0/561434365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2068009470 con 0x7f207815c9c0 2023-08-25T04:21:08.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f207659c640 1 --2- 172.21.15.55:0/561434365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f207806b2b0 0x7f2078158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:08.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f206ffff640 1 --2- 172.21.15.55:0/561434365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20780cfa70 0x7f2078153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:08.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.431+0000 7f2076d9d640 1 --2- 172.21.15.55:0/561434365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f207815c9c0 0x7f20780b59a0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f207000c770 tx=0x7f207000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:08.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.435+0000 7f206effd640 1 -- 172.21.15.55:0/561434365 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2070003b80 con 0x7f207815c9c0 2023-08-25T04:21:08.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.435+0000 7f206effd640 1 -- 172.21.15.55:0/561434365 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2070003ce0 con 0x7f207815c9c0 2023-08-25T04:21:08.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.435+0000 7f206effd640 1 -- 172.21.15.55:0/561434365 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207000aa90 con 0x7f207815c9c0 2023-08-25T04:21:08.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.435+0000 7f207cf74640 1 -- 172.21.15.55:0/561434365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2078152b20 con 0x7f207815c9c0 2023-08-25T04:21:08.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.435+0000 7f207cf74640 1 -- 172.21.15.55:0/561434365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20780b5ee0 con 0x7f207815c9c0 2023-08-25T04:21:08.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.435+0000 7f207cf74640 1 -- 172.21.15.55:0/561434365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f207804dbe0 con 0x7f207815c9c0 2023-08-25T04:21:08.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.435+0000 7f206effd640 1 -- 172.21.15.55:0/561434365 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 55) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f207000abf0 con 0x7f207815c9c0 2023-08-25T04:21:08.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.435+0000 7f206effd640 1 --2- 172.21.15.55:0/561434365 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f2058065710 0x7f2058067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:08.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.435+0000 7f206effd640 1 -- 172.21.15.55:0/561434365 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6995+0+0 (secure 0 0 0) 0x7f2070082fe0 con 0x7f207815c9c0 2023-08-25T04:21:08.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.435+0000 7f207659c640 1 --2- 172.21.15.55:0/561434365 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f2058065710 0x7f2058067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:08.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.439+0000 7f207659c640 1 --2- 172.21.15.55:0/561434365 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f2058065710 0x7f2058067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f20680ae000 tx=0x7f2068008040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:08.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.439+0000 7f206effd640 1 -- 172.21.15.55:0/561434365 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2070050700 con 0x7f207815c9c0 2023-08-25T04:21:08.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.631+0000 7f207cf74640 1 -- 172.21.15.55:0/561434365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2078152fd0 con 0x7f207815c9c0 2023-08-25T04:21:08.629 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-08-25T04:21:08.631+0000 7f7f18c38640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-25T04:21:08.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.639+0000 7f206effd640 1 -- 172.21.15.55:0/561434365 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2070053d20 con 0x7f207815c9c0 2023-08-25T04:21:08.637 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-25T04:21:08.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.639+0000 7f207cf74640 1 -- 172.21.15.55:0/561434365 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f2058065710 msgr2=0x7f2058067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:08.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.639+0000 7f207cf74640 1 --2- 172.21.15.55:0/561434365 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f2058065710 0x7f2058067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f20680ae000 tx=0x7f2068008040 comp rx=0 tx=0).stop 2023-08-25T04:21:08.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.639+0000 7f207cf74640 1 -- 172.21.15.55:0/561434365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f207815c9c0 msgr2=0x7f20780b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:08.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.639+0000 7f207cf74640 1 --2- 172.21.15.55:0/561434365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f207815c9c0 0x7f20780b59a0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f207000c770 tx=0x7f207000cc30 comp rx=0 tx=0).stop 2023-08-25T04:21:08.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.643+0000 7f207cf74640 1 -- 172.21.15.55:0/561434365 shutdown_connections 2023-08-25T04:21:08.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.643+0000 7f207cf74640 1 --2- 172.21.15.55:0/561434365 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f2058065710 0x7f2058067bd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.643+0000 7f207cf74640 1 --2- 172.21.15.55:0/561434365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f207815c9c0 0x7f20780b59a0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.643+0000 7f207cf74640 1 --2- 172.21.15.55:0/561434365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20780cfa70 0x7f2078153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.643+0000 7f207cf74640 1 --2- 172.21.15.55:0/561434365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f207806b2b0 0x7f2078158840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.643+0000 7f207cf74640 1 -- 172.21.15.55:0/561434365 >> 172.21.15.55:0/561434365 conn(0x7f20780d05a0 msgr2=0x7f20780cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:08.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.643+0000 7f207cf74640 1 -- 172.21.15.55:0/561434365 shutdown_connections 2023-08-25T04:21:08.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.643+0000 7f207cf74640 1 -- 172.21.15.55:0/561434365 wait complete. 2023-08-25T04:21:08.646 INFO:tasks.ceph.mds.c.smithi055.stderr: -7643> 2023-08-25T04:19:47.852+0000 7f36d3cf2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T04:21:08.658 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-25T04:21:08.700 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T04:21:08.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.811+0000 7f385359e640 1 Processor -- start 2023-08-25T04:21:08.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.811+0000 7f385359e640 1 -- start start 2023-08-25T04:21:08.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.811+0000 7f385359e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f385415c8a0 0x7f38540b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:08.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.815+0000 7f385359e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38540d1270 0x7f38540b1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:08.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.815+0000 7f385359e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38540d0690 con 0x7f38540cd190 2023-08-25T04:21:08.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.815+0000 7f385359e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38540cd6c0 con 0x7f38540d1270 2023-08-25T04:21:08.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.815+0000 7f385359e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38540cd9a0 con 0x7f385415c8a0 2023-08-25T04:21:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.815+0000 7f3852d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38540d1270 0x7f38540b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.815+0000 7f3852d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38540d1270 0x7f38540b1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57252/0 (socket says 172.21.15.55:57252) 2023-08-25T04:21:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.815+0000 7f3852d9d640 1 -- 172.21.15.55:0/3181338637 learned_addr learned my addr 172.21.15.55:0/3181338637 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.815+0000 7f384bfff640 1 --1- 172.21.15.55:0/3181338637 >> v1:172.21.15.55:6789/0 conn(0x7f38540cd190 0x7f38540d0b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39170/0 (socket says 172.21.15.55:39170) 2023-08-25T04:21:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.815+0000 7f385259c640 1 --2- 172.21.15.55:0/3181338637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f385415c8a0 0x7f38540b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.815+0000 7f3852d9d640 1 -- 172.21.15.55:0/3181338637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f385415c8a0 msgr2=0x7f38540b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.815+0000 7f3852d9d640 1 --2- 172.21.15.55:0/3181338637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f385415c8a0 0x7f38540b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.815+0000 7f3852d9d640 1 -- 172.21.15.55:0/3181338637 >> v1:172.21.15.55:6789/0 conn(0x7f38540cd190 legacy=0x7f38540d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.815+0000 7f3851d9b640 1 -- 172.21.15.55:0/3181338637 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607725508 0 0) 0x7f38540d0690 con 0x7f38540cd190 2023-08-25T04:21:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.815+0000 7f3852d9d640 1 -- 172.21.15.55:0/3181338637 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38540cdc80 con 0x7f38540d1270 2023-08-25T04:21:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.815+0000 7f3852d9d640 1 --2- 172.21.15.55:0/3181338637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38540d1270 0x7f38540b1160 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f384c009e50 tx=0x7f384c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c6a6e594d71788 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.815+0000 7f3851d9b640 1 -- 172.21.15.55:0/3181338637 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c0a5860 con 0x7f38540d1270 2023-08-25T04:21:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.815+0000 7f3851d9b640 1 -- 172.21.15.55:0/3181338637 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384c0a59c0 con 0x7f38540d1270 2023-08-25T04:21:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.815+0000 7f3851d9b640 1 -- 172.21.15.55:0/3181338637 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c0a5d50 con 0x7f38540d1270 2023-08-25T04:21:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f385359e640 1 -- 172.21.15.55:0/3181338637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38540d1270 msgr2=0x7f38540b1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f385359e640 1 --2- 172.21.15.55:0/3181338637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38540d1270 0x7f38540b1160 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f384c009e50 tx=0x7f384c01c9e0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f385359e640 1 -- 172.21.15.55:0/3181338637 shutdown_connections 2023-08-25T04:21:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f385359e640 1 --2- 172.21.15.55:0/3181338637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38540d1270 0x7f38540b1160 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f385359e640 1 --2- 172.21.15.55:0/3181338637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f385415c8a0 0x7f38540b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f385359e640 1 -- 172.21.15.55:0/3181338637 >> 172.21.15.55:0/3181338637 conn(0x7f38540d2610 msgr2=0x7f38540d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:08.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f385359e640 1 -- 172.21.15.55:0/3181338637 shutdown_connections 2023-08-25T04:21:08.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f385359e640 1 -- 172.21.15.55:0/3181338637 wait complete. 2023-08-25T04:21:08.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f385359e640 1 Processor -- start 2023-08-25T04:21:08.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f385359e640 1 -- start start 2023-08-25T04:21:08.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f385359e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38540cd190 0x7f3854151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:08.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f385359e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38540d1270 0x7f385415dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:08.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f385359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385415c8a0 0x7f38540b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:08.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f385359e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385415e9f0 con 0x7f385415c8a0 2023-08-25T04:21:08.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f385359e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385415ecd0 con 0x7f38540cd190 2023-08-25T04:21:08.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f385359e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385415efb0 con 0x7f38540d1270 2023-08-25T04:21:08.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f3852d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385415c8a0 0x7f38540b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:08.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f3852d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385415c8a0 0x7f38540b68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57262/0 (socket says 172.21.15.55:57262) 2023-08-25T04:21:08.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.819+0000 7f3852d9d640 1 -- 172.21.15.55:0/3291352841 learned_addr learned my addr 172.21.15.55:0/3291352841 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:08.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.823+0000 7f3852d9d640 1 -- 172.21.15.55:0/3291352841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38540d1270 msgr2=0x7f385415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:08.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.823+0000 7f3852d9d640 1 --2- 172.21.15.55:0/3291352841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38540d1270 0x7f385415dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.823+0000 7f3852d9d640 1 -- 172.21.15.55:0/3291352841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38540cd190 msgr2=0x7f3854151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:08.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.823+0000 7f3852d9d640 1 --2- 172.21.15.55:0/3291352841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38540cd190 0x7f3854151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:08.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.823+0000 7f3852d9d640 1 -- 172.21.15.55:0/3291352841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c009b30 con 0x7f385415c8a0 2023-08-25T04:21:08.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.823+0000 7f3852d9d640 1 --2- 172.21.15.55:0/3291352841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385415c8a0 0x7f38540b68e0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f384c01b090 tx=0x7f384c019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:08.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.823+0000 7f384affd640 1 -- 172.21.15.55:0/3291352841 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c0bd070 con 0x7f385415c8a0 2023-08-25T04:21:08.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.823+0000 7f384affd640 1 -- 172.21.15.55:0/3291352841 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384c0b8470 con 0x7f385415c8a0 2023-08-25T04:21:08.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.823+0000 7f384affd640 1 -- 172.21.15.55:0/3291352841 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c0b8860 con 0x7f385415c8a0 2023-08-25T04:21:08.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.823+0000 7f385359e640 1 -- 172.21.15.55:0/3291352841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385415f290 con 0x7f385415c8a0 2023-08-25T04:21:08.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.823+0000 7f385359e640 1 -- 172.21.15.55:0/3291352841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3854151950 con 0x7f385415c8a0 2023-08-25T04:21:08.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.823+0000 7f385359e640 1 -- 172.21.15.55:0/3291352841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3854066d20 con 0x7f385415c8a0 2023-08-25T04:21:08.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.823+0000 7f384affd640 1 -- 172.21.15.55:0/3291352841 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 55) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f384c0b89c0 con 0x7f385415c8a0 2023-08-25T04:21:08.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.823+0000 7f384affd640 1 --2- 172.21.15.55:0/3291352841 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f3834065710 0x7f3834067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:08.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.823+0000 7f384affd640 1 -- 172.21.15.55:0/3291352841 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7081+0+0 (secure 0 0 0) 0x7f384c11e320 con 0x7f385415c8a0 2023-08-25T04:21:08.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.827+0000 7f385259c640 1 --2- 172.21.15.55:0/3291352841 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f3834065710 0x7f3834067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:08.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.827+0000 7f385259c640 1 --2- 172.21.15.55:0/3291352841 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f3834065710 0x7f3834067bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3844006fd0 tx=0x7f3844008040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:08.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:08.827+0000 7f384affd640 1 -- 172.21.15.55:0/3291352841 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f384c0eb8f0 con 0x7f385415c8a0 2023-08-25T04:21:09.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.019+0000 7f385359e640 1 -- 172.21.15.55:0/3291352841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f385415f740 con 0x7f385415c8a0 2023-08-25T04:21:09.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.639+0000 7f384affd640 1 -- 172.21.15.55:0/3291352841 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7f384c0eef10 con 0x7f385415c8a0 2023-08-25T04:21:09.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.643+0000 7f385359e640 1 -- 172.21.15.55:0/3291352841 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f3834065710 msgr2=0x7f3834067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:09.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.643+0000 7f385359e640 1 --2- 172.21.15.55:0/3291352841 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f3834065710 0x7f3834067bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3844006fd0 tx=0x7f3844008040 comp rx=0 tx=0).stop 2023-08-25T04:21:09.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.643+0000 7f385359e640 1 -- 172.21.15.55:0/3291352841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385415c8a0 msgr2=0x7f38540b68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:09.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.643+0000 7f385359e640 1 --2- 172.21.15.55:0/3291352841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385415c8a0 0x7f38540b68e0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f384c01b090 tx=0x7f384c019780 comp rx=0 tx=0).stop 2023-08-25T04:21:09.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.643+0000 7f385359e640 1 -- 172.21.15.55:0/3291352841 shutdown_connections 2023-08-25T04:21:09.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.643+0000 7f385359e640 1 --2- 172.21.15.55:0/3291352841 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f3834065710 0x7f3834067bd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:09.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.643+0000 7f385359e640 1 --2- 172.21.15.55:0/3291352841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f385415c8a0 0x7f38540b68e0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:09.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.643+0000 7f385359e640 1 --2- 172.21.15.55:0/3291352841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38540d1270 0x7f385415dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:09.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.643+0000 7f385359e640 1 --2- 172.21.15.55:0/3291352841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38540cd190 0x7f3854151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:09.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.643+0000 7f385359e640 1 -- 172.21.15.55:0/3291352841 >> 172.21.15.55:0/3291352841 conn(0x7f38540d2610 msgr2=0x7f38540d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:09.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.643+0000 7f385359e640 1 -- 172.21.15.55:0/3291352841 shutdown_connections 2023-08-25T04:21:09.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.643+0000 7f385359e640 1 -- 172.21.15.55:0/3291352841 wait complete. 2023-08-25T04:21:09.664 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-25T04:21:09.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.863+0000 7fbdce3fa640 1 Processor -- start 2023-08-25T04:21:09.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.867+0000 7fbdce3fa640 1 -- start start 2023-08-25T04:21:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.867+0000 7fbdce3fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc80afa20 0x7fbdc80b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:09.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.867+0000 7fbdce3fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbdc80cd870 0x7fbdc80ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:09.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.867+0000 7fbdce3fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc80cae70 con 0x7fbdc80cf9b0 2023-08-25T04:21:09.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.867+0000 7fbdce3fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc80cfe10 con 0x7fbdc80cd870 2023-08-25T04:21:09.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.867+0000 7fbdce3fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc80cb0e0 con 0x7fbdc80afa20 2023-08-25T04:21:09.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.867+0000 7fbdcc997640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbdc80cd870 0x7fbdc80ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:09.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.867+0000 7fbdcc997640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbdc80cd870 0x7fbdc80ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57274/0 (socket says 172.21.15.55:57274) 2023-08-25T04:21:09.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.867+0000 7fbdcc997640 1 -- 172.21.15.55:0/3413506688 learned_addr learned my addr 172.21.15.55:0/3413506688 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:09.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.867+0000 7fbdc77fe640 1 --1- 172.21.15.55:0/3413506688 >> v1:172.21.15.55:6789/0 conn(0x7fbdc80cf9b0 0x7fbdc80cd160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39186/0 (socket says 172.21.15.55:39186) 2023-08-25T04:21:09.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.867+0000 7fbdc7fff640 1 --2- 172.21.15.55:0/3413506688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc80afa20 0x7fbdc80b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:09.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.867+0000 7fbdcc997640 1 -- 172.21.15.55:0/3413506688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc80afa20 msgr2=0x7fbdc80b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:09.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.867+0000 7fbdcc997640 1 --2- 172.21.15.55:0/3413506688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc80afa20 0x7fbdc80b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:09.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.867+0000 7fbdcc997640 1 -- 172.21.15.55:0/3413506688 >> v1:172.21.15.55:6789/0 conn(0x7fbdc80cf9b0 legacy=0x7fbdc80cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:09.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.867+0000 7fbdcc997640 1 -- 172.21.15.55:0/3413506688 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc80cb3c0 con 0x7fbdc80cd870 2023-08-25T04:21:09.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.867+0000 7fbdc7fff640 1 --2- 172.21.15.55:0/3413506688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc80afa20 0x7fbdc80b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:09.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.871+0000 7fbdcc997640 1 --2- 172.21.15.55:0/3413506688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdc80cd870 0x7fbdc80ce9c0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009e50 tx=0x7fbdc001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5f3015132101a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:09.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.871+0000 7fbdc6ffd640 1 -- 172.21.15.55:0/3413506688 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc00a5810 con 0x7fbdc80cd870 2023-08-25T04:21:09.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.871+0000 7fbdc6ffd640 1 -- 172.21.15.55:0/3413506688 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc00a5970 con 0x7fbdc80cd870 2023-08-25T04:21:09.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.871+0000 7fbdc6ffd640 1 -- 172.21.15.55:0/3413506688 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc00a5d00 con 0x7fbdc80cd870 2023-08-25T04:21:09.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.871+0000 7fbdce3fa640 1 -- 172.21.15.55:0/3413506688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdc80cd870 msgr2=0x7fbdc80ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:09.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.871+0000 7fbdce3fa640 1 --2- 172.21.15.55:0/3413506688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdc80cd870 0x7fbdc80ce9c0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009e50 tx=0x7fbdc001c950 comp rx=0 tx=0).stop 2023-08-25T04:21:09.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.871+0000 7fbdce3fa640 1 -- 172.21.15.55:0/3413506688 shutdown_connections 2023-08-25T04:21:09.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.871+0000 7fbdce3fa640 1 --2- 172.21.15.55:0/3413506688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdc80cd870 0x7fbdc80ce9c0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:09.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.871+0000 7fbdce3fa640 1 --2- 172.21.15.55:0/3413506688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc80afa20 0x7fbdc80b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:09.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.871+0000 7fbdce3fa640 1 -- 172.21.15.55:0/3413506688 >> 172.21.15.55:0/3413506688 conn(0x7fbdc80d0780 msgr2=0x7fbdc80d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:09.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.871+0000 7fbdce3fa640 1 -- 172.21.15.55:0/3413506688 shutdown_connections 2023-08-25T04:21:09.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.871+0000 7fbdce3fa640 1 -- 172.21.15.55:0/3413506688 wait complete. 2023-08-25T04:21:09.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.871+0000 7fbdce3fa640 1 Processor -- start 2023-08-25T04:21:09.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.871+0000 7fbdce3fa640 1 -- start start 2023-08-25T04:21:09.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdce3fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdc80afa20 0x7fbdc8148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:09.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdce3fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc80cd870 0x7fbdc8153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:09.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdce3fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdc80cf9b0 0x7fbdc8154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:09.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdce3fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc8148cc0 con 0x7fbdc80cf9b0 2023-08-25T04:21:09.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdce3fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc8153ab0 con 0x7fbdc80afa20 2023-08-25T04:21:09.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdce3fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc8153d90 con 0x7fbdc80cd870 2023-08-25T04:21:09.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdcc997640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdc80cf9b0 0x7fbdc8154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:09.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdcc997640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdc80cf9b0 0x7fbdc8154b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57290/0 (socket says 172.21.15.55:57290) 2023-08-25T04:21:09.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdcc997640 1 -- 172.21.15.55:0/3198638714 learned_addr learned my addr 172.21.15.55:0/3198638714 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:09.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdc77fe640 1 --2- 172.21.15.55:0/3198638714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc80cd870 0x7fbdc8153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:09.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdc7fff640 1 --2- 172.21.15.55:0/3198638714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdc80afa20 0x7fbdc8148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:09.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdcc997640 1 -- 172.21.15.55:0/3198638714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc80cd870 msgr2=0x7fbdc8153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:09.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdcc997640 1 --2- 172.21.15.55:0/3198638714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc80cd870 0x7fbdc8153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:09.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdcc997640 1 -- 172.21.15.55:0/3198638714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdc80afa20 msgr2=0x7fbdc8148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:09.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdcc997640 1 --2- 172.21.15.55:0/3198638714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdc80afa20 0x7fbdc8148780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:09.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdcc997640 1 -- 172.21.15.55:0/3198638714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc0009b30 con 0x7fbdc80cf9b0 2023-08-25T04:21:09.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdc7fff640 1 --2- 172.21.15.55:0/3198638714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdc80afa20 0x7fbdc8148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:09.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdc77fe640 1 --2- 172.21.15.55:0/3198638714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc80cd870 0x7fbdc8153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:09.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdcc997640 1 --2- 172.21.15.55:0/3198638714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdc80cf9b0 0x7fbdc8154b50 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fbdc001a580 tx=0x7fbdc00196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:09.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdc4ff9640 1 -- 172.21.15.55:0/3198638714 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc00b8670 con 0x7fbdc80cf9b0 2023-08-25T04:21:09.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdc4ff9640 1 -- 172.21.15.55:0/3198638714 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc00b87d0 con 0x7fbdc80cf9b0 2023-08-25T04:21:09.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdc4ff9640 1 -- 172.21.15.55:0/3198638714 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc00b8b80 con 0x7fbdc80cf9b0 2023-08-25T04:21:09.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdce3fa640 1 -- 172.21.15.55:0/3198638714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc8154070 con 0x7fbdc80cf9b0 2023-08-25T04:21:09.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdce3fa640 1 -- 172.21.15.55:0/3198638714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc8154630 con 0x7fbdc80cf9b0 2023-08-25T04:21:09.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.875+0000 7fbdce3fa640 1 -- 172.21.15.55:0/3198638714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc8154820 con 0x7fbdc80cf9b0 2023-08-25T04:21:09.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.879+0000 7fbdc4ff9640 1 -- 172.21.15.55:0/3198638714 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fbdc00b8ce0 con 0x7fbdc80cf9b0 2023-08-25T04:21:09.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.879+0000 7fbdc4ff9640 1 --2- 172.21.15.55:0/3198638714 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fbdb40657a0 0x7fbdb4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:09.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.879+0000 7fbdc4ff9640 1 -- 172.21.15.55:0/3198638714 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 7081+0+0 (secure 0 0 0) 0x7fbdc011e9c0 con 0x7fbdc80cf9b0 2023-08-25T04:21:09.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.879+0000 7fbdc7fff640 1 --2- 172.21.15.55:0/3198638714 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fbdb40657a0 0x7fbdb4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:09.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.879+0000 7fbdc7fff640 1 --2- 172.21.15.55:0/3198638714 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fbdb40657a0 0x7fbdb4067c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009980 tx=0x7fbdb8008040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:09.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:09.883+0000 7fbdc4ff9640 1 -- 172.21.15.55:0/3198638714 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbdc00ec010 con 0x7fbdc80cf9b0 2023-08-25T04:21:10.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.043+0000 7fbdce3fa640 1 -- 172.21.15.55:0/3198638714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbdc8153ed0 con 0x7fbdc80cf9b0 2023-08-25T04:21:10.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.795+0000 7fbdc4ff9640 1 -- 172.21.15.55:0/3198638714 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v113) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbdc8153ed0 con 0x7fbdc80cf9b0 2023-08-25T04:21:10.795 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-08-25T04:21:10.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.799+0000 7fbdce3fa640 1 -- 172.21.15.55:0/3198638714 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fbdb40657a0 msgr2=0x7fbdb4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:10.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.799+0000 7fbdce3fa640 1 --2- 172.21.15.55:0/3198638714 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fbdb40657a0 0x7fbdb4067c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009980 tx=0x7fbdb8008040 comp rx=0 tx=0).stop 2023-08-25T04:21:10.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.799+0000 7fbdce3fa640 1 -- 172.21.15.55:0/3198638714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdc80cf9b0 msgr2=0x7fbdc8154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:10.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.799+0000 7fbdce3fa640 1 --2- 172.21.15.55:0/3198638714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdc80cf9b0 0x7fbdc8154b50 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fbdc001a580 tx=0x7fbdc00196f0 comp rx=0 tx=0).stop 2023-08-25T04:21:10.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.799+0000 7fbdce3fa640 1 -- 172.21.15.55:0/3198638714 shutdown_connections 2023-08-25T04:21:10.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.799+0000 7fbdce3fa640 1 --2- 172.21.15.55:0/3198638714 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fbdb40657a0 0x7fbdb4067c60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:10.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.799+0000 7fbdce3fa640 1 --2- 172.21.15.55:0/3198638714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdc80cf9b0 0x7fbdc8154b50 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:10.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.799+0000 7fbdce3fa640 1 --2- 172.21.15.55:0/3198638714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdc80cd870 0x7fbdc8153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:10.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.799+0000 7fbdce3fa640 1 --2- 172.21.15.55:0/3198638714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdc80afa20 0x7fbdc8148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:10.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.799+0000 7fbdce3fa640 1 -- 172.21.15.55:0/3198638714 >> 172.21.15.55:0/3198638714 conn(0x7fbdc80d0780 msgr2=0x7fbdc80b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:10.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.799+0000 7fbdce3fa640 1 -- 172.21.15.55:0/3198638714 shutdown_connections 2023-08-25T04:21:10.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.799+0000 7fbdce3fa640 1 -- 172.21.15.55:0/3198638714 wait complete. 2023-08-25T04:21:10.822 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-25T04:21:10.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.979+0000 7f4a343fa640 1 Processor -- start 2023-08-25T04:21:10.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.979+0000 7f4a343fa640 1 -- start start 2023-08-25T04:21:10.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.983+0000 7f4a343fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a2c159d00 0x7f4a2c0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:10.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.983+0000 7f4a343fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4a2c06fb50 0x7f4a2c0c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:10.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.983+0000 7f4a343fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a2c0ce220 con 0x7f4a2c0cc930 2023-08-25T04:21:10.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.983+0000 7f4a343fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2c0cc510 con 0x7f4a2c06fb50 2023-08-25T04:21:10.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.983+0000 7f4a343fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c0ca6c0 con 0x7f4a2c159d00 2023-08-25T04:21:10.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.983+0000 7f4a31995640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4a2c06fb50 0x7f4a2c0c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:10.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.983+0000 7f4a32997640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4a2c0cc930 0x7f4a2c0ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44934/0 (socket says 172.21.15.55:44934) 2023-08-25T04:21:10.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.983+0000 7f4a32997640 1 -- 172.21.15.55:0/2918062619 learned_addr learned my addr 172.21.15.55:0/2918062619 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:10.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.983+0000 7f4a31995640 1 -- 172.21.15.55:0/2918062619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a2c159d00 msgr2=0x7f4a2c0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:10.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.983+0000 7f4a32196640 1 --2- 172.21.15.55:0/2918062619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a2c159d00 0x7f4a2c0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:10.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.983+0000 7f4a31995640 1 --2- 172.21.15.55:0/2918062619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a2c159d00 0x7f4a2c0cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:10.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.983+0000 7f4a31194640 1 -- 172.21.15.55:0/2918062619 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813844003 0 0) 0x7f4a2c0ce220 con 0x7f4a2c0cc930 2023-08-25T04:21:10.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.983+0000 7f4a31995640 1 -- 172.21.15.55:0/2918062619 >> v1:172.21.15.55:6789/0 conn(0x7f4a2c0cc930 legacy=0x7f4a2c0ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:10.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.983+0000 7f4a31995640 1 -- 172.21.15.55:0/2918062619 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2c0ca9a0 con 0x7f4a2c06fb50 2023-08-25T04:21:10.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.983+0000 7f4a32196640 1 --2- 172.21.15.55:0/2918062619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a2c159d00 0x7f4a2c0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:10.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.983+0000 7f4a31995640 1 --2- 172.21.15.55:0/2918062619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2c06fb50 0x7f4a2c0c8b60 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0097c0 tx=0x7f4a1c01cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e858cb149999f1e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:10.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.983+0000 7f4a31194640 1 -- 172.21.15.55:0/2918062619 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c004230 con 0x7f4a2c06fb50 2023-08-25T04:21:10.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a31194640 1 -- 172.21.15.55:0/2918062619 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c0a7050 con 0x7f4a2c06fb50 2023-08-25T04:21:10.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a31194640 1 -- 172.21.15.55:0/2918062619 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c003620 con 0x7f4a2c06fb50 2023-08-25T04:21:10.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a343fa640 1 -- 172.21.15.55:0/2918062619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2c06fb50 msgr2=0x7f4a2c0c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:10.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a343fa640 1 --2- 172.21.15.55:0/2918062619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2c06fb50 0x7f4a2c0c8b60 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0097c0 tx=0x7f4a1c01cd90 comp rx=0 tx=0).stop 2023-08-25T04:21:10.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a343fa640 1 -- 172.21.15.55:0/2918062619 shutdown_connections 2023-08-25T04:21:10.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a343fa640 1 --2- 172.21.15.55:0/2918062619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2c06fb50 0x7f4a2c0c8b60 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:10.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a343fa640 1 --2- 172.21.15.55:0/2918062619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a2c159d00 0x7f4a2c0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:10.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a343fa640 1 -- 172.21.15.55:0/2918062619 >> 172.21.15.55:0/2918062619 conn(0x7f4a2c0caf90 msgr2=0x7f4a2c0cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:10.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a343fa640 1 -- 172.21.15.55:0/2918062619 shutdown_connections 2023-08-25T04:21:10.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a343fa640 1 -- 172.21.15.55:0/2918062619 wait complete. 2023-08-25T04:21:10.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a343fa640 1 Processor -- start 2023-08-25T04:21:10.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a343fa640 1 -- start start 2023-08-25T04:21:10.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a343fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a2c06fb50 0x7f4a2c151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:10.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a343fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a2c0cc930 0x7f4a2c15d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:10.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a343fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2c159d00 0x7f4a2c0c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:10.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a343fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c0af470 con 0x7f4a2c159d00 2023-08-25T04:21:10.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a343fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c15e740 con 0x7f4a2c0cc930 2023-08-25T04:21:10.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a343fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2c15e180 con 0x7f4a2c06fb50 2023-08-25T04:21:10.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a32997640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2c159d00 0x7f4a2c0c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:10.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a32997640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2c159d00 0x7f4a2c0c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50962/0 (socket says 172.21.15.55:50962) 2023-08-25T04:21:10.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a32997640 1 -- 172.21.15.55:0/839620234 learned_addr learned my addr 172.21.15.55:0/839620234 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:10.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.987+0000 7f4a32196640 1 --2- 172.21.15.55:0/839620234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a2c06fb50 0x7f4a2c151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:10.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.991+0000 7f4a31995640 1 --2- 172.21.15.55:0/839620234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a2c0cc930 0x7f4a2c15d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:10.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.991+0000 7f4a32997640 1 -- 172.21.15.55:0/839620234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a2c06fb50 msgr2=0x7f4a2c151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:10.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.991+0000 7f4a32997640 1 --2- 172.21.15.55:0/839620234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a2c06fb50 0x7f4a2c151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:10.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.991+0000 7f4a32997640 1 -- 172.21.15.55:0/839620234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a2c0cc930 msgr2=0x7f4a2c15d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:10.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.991+0000 7f4a32997640 1 --2- 172.21.15.55:0/839620234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a2c0cc930 0x7f4a2c15d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:10.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.991+0000 7f4a32997640 1 -- 172.21.15.55:0/839620234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c009420 con 0x7f4a2c159d00 2023-08-25T04:21:10.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.991+0000 7f4a32997640 1 --2- 172.21.15.55:0/839620234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2c159d00 0x7f4a2c0c57c0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c810 tx=0x7f4a2400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:10.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.991+0000 7f4a22ffd640 1 -- 172.21.15.55:0/839620234 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2400a640 con 0x7f4a2c159d00 2023-08-25T04:21:10.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.991+0000 7f4a22ffd640 1 -- 172.21.15.55:0/839620234 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2400a7c0 con 0x7f4a2c159d00 2023-08-25T04:21:10.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.991+0000 7f4a22ffd640 1 -- 172.21.15.55:0/839620234 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2400ab70 con 0x7f4a2c159d00 2023-08-25T04:21:10.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.991+0000 7f4a343fa640 1 -- 172.21.15.55:0/839620234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a2c15e460 con 0x7f4a2c159d00 2023-08-25T04:21:10.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.991+0000 7f4a343fa640 1 -- 172.21.15.55:0/839620234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2c0c4ac0 con 0x7f4a2c159d00 2023-08-25T04:21:10.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.991+0000 7f4a343fa640 1 -- 172.21.15.55:0/839620234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a2c0c4d10 con 0x7f4a2c159d00 2023-08-25T04:21:10.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.991+0000 7f4a22ffd640 1 -- 172.21.15.55:0/839620234 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f4a2400acd0 con 0x7f4a2c159d00 2023-08-25T04:21:10.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.991+0000 7f4a22ffd640 1 --2- 172.21.15.55:0/839620234 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f4a100657a0 0x7f4a10067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:10.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.991+0000 7f4a22ffd640 1 -- 172.21.15.55:0/839620234 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6643+0+0 (secure 0 0 0) 0x7f4a24082730 con 0x7f4a2c159d00 2023-08-25T04:21:10.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.995+0000 7f4a32196640 1 --2- 172.21.15.55:0/839620234 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f4a100657a0 0x7f4a10067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:10.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.995+0000 7f4a32196640 1 --2- 172.21.15.55:0/839620234 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f4a100657a0 0x7f4a10067c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4a28006fd0 tx=0x7f4a28008040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:10.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:10.999+0000 7f4a22ffd640 1 -- 172.21.15.55:0/839620234 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4a2404fe00 con 0x7f4a2c159d00 2023-08-25T04:21:11.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.151+0000 7f4a343fa640 1 -- 172.21.15.55:0/839620234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4a2c04dbe0 con 0x7f4a2c159d00 2023-08-25T04:21:11.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.807+0000 7f4a22ffd640 1 -- 172.21.15.55:0/839620234 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v114) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4a240180d0 con 0x7f4a2c159d00 2023-08-25T04:21:11.805 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-08-25T04:21:11.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.811+0000 7f4a343fa640 1 -- 172.21.15.55:0/839620234 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f4a100657a0 msgr2=0x7f4a10067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:11.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.811+0000 7f4a343fa640 1 --2- 172.21.15.55:0/839620234 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f4a100657a0 0x7f4a10067c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4a28006fd0 tx=0x7f4a28008040 comp rx=0 tx=0).stop 2023-08-25T04:21:11.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.811+0000 7f4a343fa640 1 -- 172.21.15.55:0/839620234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2c159d00 msgr2=0x7f4a2c0c57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:11.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.811+0000 7f4a343fa640 1 --2- 172.21.15.55:0/839620234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2c159d00 0x7f4a2c0c57c0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c810 tx=0x7f4a2400ccd0 comp rx=0 tx=0).stop 2023-08-25T04:21:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.811+0000 7f4a343fa640 1 -- 172.21.15.55:0/839620234 shutdown_connections 2023-08-25T04:21:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.811+0000 7f4a343fa640 1 --2- 172.21.15.55:0/839620234 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f4a100657a0 0x7f4a10067c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.811+0000 7f4a343fa640 1 --2- 172.21.15.55:0/839620234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a2c159d00 0x7f4a2c0c57c0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.811+0000 7f4a343fa640 1 --2- 172.21.15.55:0/839620234 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a2c0cc930 0x7f4a2c15d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.811+0000 7f4a343fa640 1 --2- 172.21.15.55:0/839620234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a2c06fb50 0x7f4a2c151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.811+0000 7f4a343fa640 1 -- 172.21.15.55:0/839620234 >> 172.21.15.55:0/839620234 conn(0x7f4a2c0caf90 msgr2=0x7f4a2c0cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:11.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.811+0000 7f4a343fa640 1 -- 172.21.15.55:0/839620234 shutdown_connections 2023-08-25T04:21:11.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.811+0000 7f4a343fa640 1 -- 172.21.15.55:0/839620234 wait complete. 2023-08-25T04:21:11.834 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-08-25T04:21:11.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.987+0000 7f05056ec640 1 Processor -- start 2023-08-25T04:21:11.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.987+0000 7f05056ec640 1 -- start start 2023-08-25T04:21:11.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.987+0000 7f05056ec640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05000cb020 0x7f05000c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:11.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.987+0000 7f05056ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05000cdd50 0x7f05000cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:11.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.987+0000 7f05056ec640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f050006c720 0x7f050006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:11.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.987+0000 7f05056ec640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050006d0d0 con 0x7f05000cb020 2023-08-25T04:21:11.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.987+0000 7f05056ec640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05000cbca0 con 0x7f050006c720 2023-08-25T04:21:11.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.987+0000 7f05056ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05000c9470 con 0x7f05000cdd50 2023-08-25T04:21:11.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.987+0000 7f04feffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05000cb020 0x7f05000c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:11.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.987+0000 7f04feffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05000cb020 0x7f05000c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50974/0 (socket says 172.21.15.55:50974) 2023-08-25T04:21:11.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.987+0000 7f04feffd640 1 -- 172.21.15.55:0/1331539809 learned_addr learned my addr 172.21.15.55:0/1331539809 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:11.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.987+0000 7f04feffd640 1 -- 172.21.15.55:0/1331539809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05000cdd50 msgr2=0x7f05000cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:11.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.987+0000 7f04feffd640 1 --2- 172.21.15.55:0/1331539809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05000cdd50 0x7f05000cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:11.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.987+0000 7f04feffd640 1 -- 172.21.15.55:0/1331539809 >> v2:172.21.15.110:3300/0 conn(0x7f050006c720 msgr2=0x7f050006cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:11.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.987+0000 7f04feffd640 1 --2- 172.21.15.55:0/1331539809 >> v2:172.21.15.110:3300/0 conn(0x7f050006c720 0x7f050006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:11.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.987+0000 7f04feffd640 1 -- 172.21.15.55:0/1331539809 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05000ce1e0 con 0x7f05000cb020 2023-08-25T04:21:11.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.991+0000 7f04feffd640 1 --2- 172.21.15.55:0/1331539809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000cb020 0x7f05000c9900 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f05000c5400 tx=0x7f04f001eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f12ea6d896f23dc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:11.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.991+0000 7f04fe7fc640 1 -- 172.21.15.55:0/1331539809 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f00a7aa0 con 0x7f05000cb020 2023-08-25T04:21:11.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.991+0000 7f04fe7fc640 1 -- 172.21.15.55:0/1331539809 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f00a7c00 con 0x7f05000cb020 2023-08-25T04:21:11.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.991+0000 7f04fe7fc640 1 -- 172.21.15.55:0/1331539809 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f00af440 con 0x7f05000cb020 2023-08-25T04:21:11.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.991+0000 7f05056ec640 1 -- 172.21.15.55:0/1331539809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000cb020 msgr2=0x7f05000c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:11.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.991+0000 7f05056ec640 1 --2- 172.21.15.55:0/1331539809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000cb020 0x7f05000c9900 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f05000c5400 tx=0x7f04f001eb20 comp rx=0 tx=0).stop 2023-08-25T04:21:11.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.991+0000 7f05056ec640 1 -- 172.21.15.55:0/1331539809 shutdown_connections 2023-08-25T04:21:11.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.991+0000 7f05056ec640 1 --2- 172.21.15.55:0/1331539809 >> v2:172.21.15.110:3300/0 conn(0x7f050006c720 0x7f050006cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:11.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.991+0000 7f05056ec640 1 --2- 172.21.15.55:0/1331539809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05000cdd50 0x7f05000cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:11.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.991+0000 7f05056ec640 1 --2- 172.21.15.55:0/1331539809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000cb020 0x7f05000c9900 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:11.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.991+0000 7f05056ec640 1 -- 172.21.15.55:0/1331539809 >> 172.21.15.55:0/1331539809 conn(0x7f0500069900 msgr2=0x7f0500069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:11.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.991+0000 7f05056ec640 1 -- 172.21.15.55:0/1331539809 shutdown_connections 2023-08-25T04:21:11.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.991+0000 7f05056ec640 1 -- 172.21.15.55:0/1331539809 wait complete. 2023-08-25T04:21:11.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f05056ec640 1 Processor -- start 2023-08-25T04:21:11.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f05056ec640 1 -- start start 2023-08-25T04:21:11.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f05056ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f050006c720 0x7f05001f9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:11.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f05056ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000cb020 0x7f05000707e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:11.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f05056ec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05000cdd50 0x7f0500148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:11.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f05056ec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05001f8ea0 con 0x7f05000cb020 2023-08-25T04:21:11.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f05056ec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050014c810 con 0x7f05000cdd50 2023-08-25T04:21:11.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f05056ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05001493f0 con 0x7f050006c720 2023-08-25T04:21:11.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000cb020 0x7f05000707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:11.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000cb020 0x7f05000707e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50980/0 (socket says 172.21.15.55:50980) 2023-08-25T04:21:11.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f04feffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f050006c720 0x7f05001f9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:11.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f04f7fff640 1 -- 172.21.15.55:0/3899587215 learned_addr learned my addr 172.21.15.55:0/3899587215 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:11.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f04ff7fe640 1 --2- 172.21.15.55:0/3899587215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05000cdd50 0x7f0500148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:11.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f04f7fff640 1 -- 172.21.15.55:0/3899587215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f050006c720 msgr2=0x7f05001f9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:11.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f04f7fff640 1 --2- 172.21.15.55:0/3899587215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f050006c720 0x7f05001f9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:11.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f04f7fff640 1 -- 172.21.15.55:0/3899587215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05000cdd50 msgr2=0x7f0500148530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:11.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f04f7fff640 1 --2- 172.21.15.55:0/3899587215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05000cdd50 0x7f0500148530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:11.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f04f7fff640 1 -- 172.21.15.55:0/3899587215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f000b720 con 0x7f05000cb020 2023-08-25T04:21:11.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f04f7fff640 1 --2- 172.21.15.55:0/3899587215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000cb020 0x7f05000707e0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f04e800b440 tx=0x7f04e800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:11.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f04f77fe640 1 -- 172.21.15.55:0/3899587215 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8011890 con 0x7f05000cb020 2023-08-25T04:21:11.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f04f77fe640 1 -- 172.21.15.55:0/3899587215 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e8011a10 con 0x7f05000cb020 2023-08-25T04:21:11.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f04f77fe640 1 -- 172.21.15.55:0/3899587215 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8011dc0 con 0x7f05000cb020 2023-08-25T04:21:11.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f05056ec640 1 -- 172.21.15.55:0/3899587215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0500149110 con 0x7f05000cb020 2023-08-25T04:21:11.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f05056ec640 1 -- 172.21.15.55:0/3899587215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05001f8b30 con 0x7f05000cb020 2023-08-25T04:21:11.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.995+0000 7f05056ec640 1 -- 172.21.15.55:0/3899587215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0500073ec0 con 0x7f05000cb020 2023-08-25T04:21:11.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.999+0000 7f04f77fe640 1 -- 172.21.15.55:0/3899587215 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f04e801a400 con 0x7f05000cb020 2023-08-25T04:21:11.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.999+0000 7f04f77fe640 1 --2- 172.21.15.55:0/3899587215 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f04e00657a0 0x7f04e0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:11.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.999+0000 7f04f77fe640 1 -- 172.21.15.55:0/3899587215 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6113+0+0 (secure 0 0 0) 0x7f04e8083280 con 0x7f05000cb020 2023-08-25T04:21:11.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.999+0000 7f04feffd640 1 --2- 172.21.15.55:0/3899587215 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f04e00657a0 0x7f04e0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:11.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:11.999+0000 7f04feffd640 1 --2- 172.21.15.55:0/3899587215 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f04e00657a0 0x7f04e0067c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f04f00b1000 tx=0x7f04f0008040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:12.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.003+0000 7f04f77fe640 1 -- 172.21.15.55:0/3899587215 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f04e8050c00 con 0x7f05000cb020 2023-08-25T04:21:12.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.159+0000 7f05056ec640 1 -- 172.21.15.55:0/3899587215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f05000cc230 con 0x7f05000cb020 2023-08-25T04:21:12.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.167+0000 7f04f77fe640 1 -- 172.21.15.55:0/3899587215 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v37) v1 ==== 115+0+0 (secure 0 0 0) 0x7f04e8054220 con 0x7f05000cb020 2023-08-25T04:21:12.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.167+0000 7f05056ec640 1 -- 172.21.15.55:0/3899587215 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f04e00657a0 msgr2=0x7f04e0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:12.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.167+0000 7f05056ec640 1 --2- 172.21.15.55:0/3899587215 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f04e00657a0 0x7f04e0067c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f04f00b1000 tx=0x7f04f0008040 comp rx=0 tx=0).stop 2023-08-25T04:21:12.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.167+0000 7f05056ec640 1 -- 172.21.15.55:0/3899587215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000cb020 msgr2=0x7f05000707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:12.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.167+0000 7f05056ec640 1 --2- 172.21.15.55:0/3899587215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000cb020 0x7f05000707e0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f04e800b440 tx=0x7f04e800b900 comp rx=0 tx=0).stop 2023-08-25T04:21:12.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.167+0000 7f05056ec640 1 -- 172.21.15.55:0/3899587215 shutdown_connections 2023-08-25T04:21:12.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.167+0000 7f05056ec640 1 --2- 172.21.15.55:0/3899587215 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05000cdd50 0x7f0500148530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.167+0000 7f05056ec640 1 --2- 172.21.15.55:0/3899587215 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f04e00657a0 0x7f04e0067c60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.167+0000 7f05056ec640 1 --2- 172.21.15.55:0/3899587215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000cb020 0x7f05000707e0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.167+0000 7f05056ec640 1 --2- 172.21.15.55:0/3899587215 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f050006c720 0x7f05001f9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.167+0000 7f05056ec640 1 -- 172.21.15.55:0/3899587215 >> 172.21.15.55:0/3899587215 conn(0x7f0500069900 msgr2=0x7f05001637b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:12.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.167+0000 7f05056ec640 1 -- 172.21.15.55:0/3899587215 shutdown_connections 2023-08-25T04:21:12.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.167+0000 7f05056ec640 1 -- 172.21.15.55:0/3899587215 wait complete. 2023-08-25T04:21:12.185 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-25T04:21:12.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.331+0000 7fe79ec34640 1 Processor -- start 2023-08-25T04:21:12.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.331+0000 7fe79ec34640 1 -- start start 2023-08-25T04:21:12.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.335+0000 7fe79ec34640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe79815a7f0 0x7fe79809bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:12.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.335+0000 7fe79ec34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79806c020 0x7fe7980acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:12.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.335+0000 7fe79ec34640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79815abd0 con 0x7fe7980c9830 2023-08-25T04:21:12.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.335+0000 7fe79ec34640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7980c8ab0 con 0x7fe79815a7f0 2023-08-25T04:21:12.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.335+0000 7fe79ec34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7980c8d50 con 0x7fe79806c020 2023-08-25T04:21:12.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.335+0000 7fe79d1d1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79806c020 0x7fe7980acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:12.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.335+0000 7fe79c9d0640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe79815a7f0 0x7fe79809bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:12.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.335+0000 7fe79d1d1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79806c020 0x7fe7980acff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:35698/0 (socket says 172.21.15.55:35698) 2023-08-25T04:21:12.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.335+0000 7fe79d1d1640 1 -- 172.21.15.55:0/332094653 learned_addr learned my addr 172.21.15.55:0/332094653 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:12.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.335+0000 7fe79d1d1640 1 -- 172.21.15.55:0/332094653 >> v2:172.21.15.110:3300/0 conn(0x7fe79815a7f0 msgr2=0x7fe79809bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:12.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.335+0000 7fe79d1d1640 1 --2- 172.21.15.55:0/332094653 >> v2:172.21.15.110:3300/0 conn(0x7fe79815a7f0 0x7fe79809bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.335+0000 7fe79d1d1640 1 -- 172.21.15.55:0/332094653 >> v1:172.21.15.110:6789/0 conn(0x7fe7980c9830 legacy=0x7fe798070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:12.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.335+0000 7fe79d1d1640 1 -- 172.21.15.55:0/332094653 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7980c9030 con 0x7fe79806c020 2023-08-25T04:21:12.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.335+0000 7fe79c9d0640 1 --2- 172.21.15.55:0/332094653 >> v2:172.21.15.110:3300/0 conn(0x7fe79815a7f0 0x7fe79809bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:12.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.339+0000 7fe79d1d1640 1 --2- 172.21.15.55:0/332094653 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79806c020 0x7fe7980acff0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe790009e50 tx=0x7fe79001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0e819c1e8498153 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:12.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.339+0000 7fe7977fe640 1 -- 172.21.15.55:0/332094653 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7900a57c0 con 0x7fe79806c020 2023-08-25T04:21:12.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.343+0000 7fe7977fe640 1 -- 172.21.15.55:0/332094653 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7900a5920 con 0x7fe79806c020 2023-08-25T04:21:12.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.343+0000 7fe7977fe640 1 -- 172.21.15.55:0/332094653 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7900a5cb0 con 0x7fe79806c020 2023-08-25T04:21:12.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.343+0000 7fe79ec34640 1 -- 172.21.15.55:0/332094653 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79806c020 msgr2=0x7fe7980acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:12.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.343+0000 7fe79ec34640 1 --2- 172.21.15.55:0/332094653 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79806c020 0x7fe7980acff0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe790009e50 tx=0x7fe79001c9e0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.343+0000 7fe79ec34640 1 -- 172.21.15.55:0/332094653 shutdown_connections 2023-08-25T04:21:12.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.343+0000 7fe79ec34640 1 --2- 172.21.15.55:0/332094653 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe79806c020 0x7fe7980acff0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.343+0000 7fe79ec34640 1 --2- 172.21.15.55:0/332094653 >> v2:172.21.15.110:3300/0 conn(0x7fe79815a7f0 0x7fe79809bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.343+0000 7fe79ec34640 1 -- 172.21.15.55:0/332094653 >> 172.21.15.55:0/332094653 conn(0x7fe798069900 msgr2=0x7fe798069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:12.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.343+0000 7fe79ec34640 1 -- 172.21.15.55:0/332094653 shutdown_connections 2023-08-25T04:21:12.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.343+0000 7fe79ec34640 1 -- 172.21.15.55:0/332094653 wait complete. 2023-08-25T04:21:12.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.343+0000 7fe79ec34640 1 Processor -- start 2023-08-25T04:21:12.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.343+0000 7fe79ec34640 1 -- start start 2023-08-25T04:21:12.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79ec34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe79806c020 0x7fe798159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:12.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79ec34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7980c9830 0x7fe7980c1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:12.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79ec34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe79815a7f0 0x7fe798099230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:12.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79ec34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe798159b80 con 0x7fe79815a7f0 2023-08-25T04:21:12.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79ec34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7980c2580 con 0x7fe79806c020 2023-08-25T04:21:12.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79ec34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7980c2860 con 0x7fe7980c9830 2023-08-25T04:21:12.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79d1d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe79815a7f0 0x7fe798099230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:12.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79d1d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe79815a7f0 0x7fe798099230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50982/0 (socket says 172.21.15.55:50982) 2023-08-25T04:21:12.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79d1d1640 1 -- 172.21.15.55:0/3652522325 learned_addr learned my addr 172.21.15.55:0/3652522325 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:12.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79c9d0640 1 --2- 172.21.15.55:0/3652522325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe79806c020 0x7fe798159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:12.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe797fff640 1 --2- 172.21.15.55:0/3652522325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7980c9830 0x7fe7980c1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:12.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79d1d1640 1 -- 172.21.15.55:0/3652522325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7980c9830 msgr2=0x7fe7980c1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:12.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79d1d1640 1 --2- 172.21.15.55:0/3652522325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7980c9830 0x7fe7980c1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79d1d1640 1 -- 172.21.15.55:0/3652522325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe79806c020 msgr2=0x7fe798159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:12.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79d1d1640 1 --2- 172.21.15.55:0/3652522325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe79806c020 0x7fe798159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79d1d1640 1 -- 172.21.15.55:0/3652522325 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c0093b0 con 0x7fe79815a7f0 2023-08-25T04:21:12.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79d1d1640 1 --2- 172.21.15.55:0/3652522325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe79815a7f0 0x7fe798099230 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fe79001a610 tx=0x7fe790019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:12.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe7957fa640 1 -- 172.21.15.55:0/3652522325 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7900b8670 con 0x7fe79815a7f0 2023-08-25T04:21:12.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe7957fa640 1 -- 172.21.15.55:0/3652522325 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7900b8810 con 0x7fe79815a7f0 2023-08-25T04:21:12.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79ec34640 1 -- 172.21.15.55:0/3652522325 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe790009b30 con 0x7fe79815a7f0 2023-08-25T04:21:12.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe7957fa640 1 -- 172.21.15.55:0/3652522325 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7900b8bc0 con 0x7fe79815a7f0 2023-08-25T04:21:12.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79ec34640 1 -- 172.21.15.55:0/3652522325 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7980c2e20 con 0x7fe79815a7f0 2023-08-25T04:21:12.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.347+0000 7fe79ec34640 1 -- 172.21.15.55:0/3652522325 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79806d5b0 con 0x7fe79815a7f0 2023-08-25T04:21:12.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.351+0000 7fe7957fa640 1 -- 172.21.15.55:0/3652522325 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fe7900b8d20 con 0x7fe79815a7f0 2023-08-25T04:21:12.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.351+0000 7fe7957fa640 1 --2- 172.21.15.55:0/3652522325 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fe77c0657a0 0x7fe77c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:12.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.351+0000 7fe7957fa640 1 -- 172.21.15.55:0/3652522325 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6113+0+0 (secure 0 0 0) 0x7fe79011e6e0 con 0x7fe79815a7f0 2023-08-25T04:21:12.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.351+0000 7fe79c9d0640 1 --2- 172.21.15.55:0/3652522325 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fe77c0657a0 0x7fe77c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:12.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.351+0000 7fe79c9d0640 1 --2- 172.21.15.55:0/3652522325 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fe77c0657a0 0x7fe77c067c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009c30 tx=0x7fe78c006f90 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:12.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.355+0000 7fe7957fa640 1 -- 172.21.15.55:0/3652522325 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe7900ec190 con 0x7fe79815a7f0 2023-08-25T04:21:12.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.523+0000 7fe79ec34640 1 -- 172.21.15.55:0/3652522325 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fe798073ec0 con 0x7fe79815a7f0 2023-08-25T04:21:12.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.527+0000 7fe7957fa640 1 -- 172.21.15.55:0/3652522325 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v38) v1 ==== 120+0+0 (secure 0 0 0) 0x7fe7900ef7b0 con 0x7fe79815a7f0 2023-08-25T04:21:12.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.527+0000 7fe79ec34640 1 -- 172.21.15.55:0/3652522325 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fe77c0657a0 msgr2=0x7fe77c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:12.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.527+0000 7fe79ec34640 1 --2- 172.21.15.55:0/3652522325 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fe77c0657a0 0x7fe77c067c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009c30 tx=0x7fe78c006f90 comp rx=0 tx=0).stop 2023-08-25T04:21:12.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.527+0000 7fe79ec34640 1 -- 172.21.15.55:0/3652522325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe79815a7f0 msgr2=0x7fe798099230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:12.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.527+0000 7fe79ec34640 1 --2- 172.21.15.55:0/3652522325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe79815a7f0 0x7fe798099230 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fe79001a610 tx=0x7fe790019780 comp rx=0 tx=0).stop 2023-08-25T04:21:12.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.527+0000 7fe79ec34640 1 -- 172.21.15.55:0/3652522325 shutdown_connections 2023-08-25T04:21:12.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.527+0000 7fe79ec34640 1 --2- 172.21.15.55:0/3652522325 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fe77c0657a0 0x7fe77c067c60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.527+0000 7fe79ec34640 1 --2- 172.21.15.55:0/3652522325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe79815a7f0 0x7fe798099230 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.527+0000 7fe79ec34640 1 --2- 172.21.15.55:0/3652522325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7980c9830 0x7fe7980c1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.527+0000 7fe79ec34640 1 --2- 172.21.15.55:0/3652522325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe79806c020 0x7fe798159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.527+0000 7fe79ec34640 1 -- 172.21.15.55:0/3652522325 >> 172.21.15.55:0/3652522325 conn(0x7fe798069900 msgr2=0x7fe7980cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:12.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.527+0000 7fe79ec34640 1 -- 172.21.15.55:0/3652522325 shutdown_connections 2023-08-25T04:21:12.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.527+0000 7fe79ec34640 1 -- 172.21.15.55:0/3652522325 wait complete. 2023-08-25T04:21:12.546 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-25T04:21:12.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.695+0000 7fc153d96640 1 Processor -- start 2023-08-25T04:21:12.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.695+0000 7fc153d96640 1 -- start start 2023-08-25T04:21:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.695+0000 7fc153d96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc14c06c020 0x7fc14c09bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.695+0000 7fc153d96640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14c15abd0 con 0x7fc14c0c9830 2023-08-25T04:21:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.695+0000 7fc153d96640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14c0c8ab0 con 0x7fc14c15a7f0 2023-08-25T04:21:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.695+0000 7fc153d96640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14c0c8d50 con 0x7fc14c06c020 2023-08-25T04:21:12.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.695+0000 7fc151331640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc14c0c9830 0x7fc14c0acff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44948/0 (socket says 172.21.15.55:44948) 2023-08-25T04:21:12.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.695+0000 7fc151331640 1 -- 172.21.15.55:0/1433141214 learned_addr learned my addr 172.21.15.55:0/1433141214 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:12.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.695+0000 7fc152333640 1 --2- 172.21.15.55:0/1433141214 >> v2:172.21.15.55:3300/0 conn(0x7fc14c06c020 0x7fc14c09bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:12.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.695+0000 7fc150b30640 1 -- 172.21.15.55:0/1433141214 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275720662 0 0) 0x7fc14c15abd0 con 0x7fc14c0c9830 2023-08-25T04:21:12.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.695+0000 7fc150b30640 1 -- 172.21.15.55:0/1433141214 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc138003530 con 0x7fc14c0c9830 2023-08-25T04:21:12.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.695+0000 7fc152333640 1 -- 172.21.15.55:0/1433141214 >> v1:172.21.15.110:6789/0 conn(0x7fc14c15a7f0 legacy=0x7fc14c070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:12.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.695+0000 7fc152333640 1 -- 172.21.15.55:0/1433141214 >> v1:172.21.15.55:6789/0 conn(0x7fc14c0c9830 legacy=0x7fc14c0acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:12.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.695+0000 7fc152333640 1 -- 172.21.15.55:0/1433141214 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c0c9030 con 0x7fc14c06c020 2023-08-25T04:21:12.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.699+0000 7fc152333640 1 --2- 172.21.15.55:0/1433141214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c06c020 0x7fc14c09bde0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fc144009d90 tx=0x7fc14401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b07682c7a7a1be server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:12.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.699+0000 7fc150b30640 1 -- 172.21.15.55:0/1433141214 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1440a58f0 con 0x7fc14c06c020 2023-08-25T04:21:12.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.699+0000 7fc150b30640 1 -- 172.21.15.55:0/1433141214 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1440a5a50 con 0x7fc14c06c020 2023-08-25T04:21:12.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.699+0000 7fc150b30640 1 -- 172.21.15.55:0/1433141214 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1440a5de0 con 0x7fc14c06c020 2023-08-25T04:21:12.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.699+0000 7fc153d96640 1 -- 172.21.15.55:0/1433141214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c06c020 msgr2=0x7fc14c09bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:12.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.699+0000 7fc153d96640 1 --2- 172.21.15.55:0/1433141214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c06c020 0x7fc14c09bde0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fc144009d90 tx=0x7fc14401c920 comp rx=0 tx=0).stop 2023-08-25T04:21:12.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.699+0000 7fc153d96640 1 -- 172.21.15.55:0/1433141214 shutdown_connections 2023-08-25T04:21:12.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.699+0000 7fc153d96640 1 --2- 172.21.15.55:0/1433141214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c06c020 0x7fc14c09bde0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.699+0000 7fc153d96640 1 -- 172.21.15.55:0/1433141214 >> 172.21.15.55:0/1433141214 conn(0x7fc14c069900 msgr2=0x7fc14c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:12.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.699+0000 7fc153d96640 1 -- 172.21.15.55:0/1433141214 shutdown_connections 2023-08-25T04:21:12.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.699+0000 7fc153d96640 1 -- 172.21.15.55:0/1433141214 wait complete. 2023-08-25T04:21:12.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc153d96640 1 Processor -- start 2023-08-25T04:21:12.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc153d96640 1 -- start start 2023-08-25T04:21:12.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc153d96640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc14c06c020 0x7fc14c0c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:12.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc153d96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c0c9830 0x7fc14c0cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:12.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc153d96640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc14c15a7f0 0x7fc14c0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:12.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc153d96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c0c2cc0 con 0x7fc14c0c9830 2023-08-25T04:21:12.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc153d96640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c15e9b0 con 0x7fc14c15a7f0 2023-08-25T04:21:12.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc153d96640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c0c6810 con 0x7fc14c06c020 2023-08-25T04:21:12.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc151331640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c0c9830 0x7fc14c0cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:12.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc151331640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c0c9830 0x7fc14c0cd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51004/0 (socket says 172.21.15.55:51004) 2023-08-25T04:21:12.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc151331640 1 -- 172.21.15.55:0/2527537907 learned_addr learned my addr 172.21.15.55:0/2527537907 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:12.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc152333640 1 --2- 172.21.15.55:0/2527537907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc14c15a7f0 0x7fc14c0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:12.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc151b32640 1 --2- 172.21.15.55:0/2527537907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc14c06c020 0x7fc14c0c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:12.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc151331640 1 -- 172.21.15.55:0/2527537907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc14c06c020 msgr2=0x7fc14c0c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:12.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc151331640 1 --2- 172.21.15.55:0/2527537907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc14c06c020 0x7fc14c0c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc151331640 1 -- 172.21.15.55:0/2527537907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc14c15a7f0 msgr2=0x7fc14c0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:12.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc151331640 1 --2- 172.21.15.55:0/2527537907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc14c15a7f0 0x7fc14c0cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc151331640 1 -- 172.21.15.55:0/2527537907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc144009a70 con 0x7fc14c0c9830 2023-08-25T04:21:12.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc152333640 1 --2- 172.21.15.55:0/2527537907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc14c15a7f0 0x7fc14c0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:12.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc151b32640 1 --2- 172.21.15.55:0/2527537907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc14c06c020 0x7fc14c0c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:12.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc151331640 1 --2- 172.21.15.55:0/2527537907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c0c9830 0x7fc14c0cd360 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00c450 tx=0x7fc13c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:12.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc1427fc640 1 -- 172.21.15.55:0/2527537907 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c005cf0 con 0x7fc14c0c9830 2023-08-25T04:21:12.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc1427fc640 1 -- 172.21.15.55:0/2527537907 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c005e50 con 0x7fc14c0c9830 2023-08-25T04:21:12.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc153d96640 1 -- 172.21.15.55:0/2527537907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14c0adc90 con 0x7fc14c0c9830 2023-08-25T04:21:12.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc1427fc640 1 -- 172.21.15.55:0/2527537907 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c0072d0 con 0x7fc14c0c9830 2023-08-25T04:21:12.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc153d96640 1 -- 172.21.15.55:0/2527537907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14c0c5490 con 0x7fc14c0c9830 2023-08-25T04:21:12.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.703+0000 7fc153d96640 1 -- 172.21.15.55:0/2527537907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14c06d5b0 con 0x7fc14c0c9830 2023-08-25T04:21:12.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.707+0000 7fc1427fc640 1 -- 172.21.15.55:0/2527537907 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fc13c007430 con 0x7fc14c0c9830 2023-08-25T04:21:12.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.707+0000 7fc1427fc640 1 --2- 172.21.15.55:0/2527537907 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fc1300657a0 0x7fc130067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:12.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.707+0000 7fc1427fc640 1 -- 172.21.15.55:0/2527537907 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6113+0+0 (secure 0 0 0) 0x7fc13c082520 con 0x7fc14c0c9830 2023-08-25T04:21:12.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.707+0000 7fc151b32640 1 --2- 172.21.15.55:0/2527537907 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fc1300657a0 0x7fc130067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:12.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.707+0000 7fc151b32640 1 --2- 172.21.15.55:0/2527537907 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fc1300657a0 0x7fc130067c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc148000fc0 tx=0x7fc148009040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:12.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.711+0000 7fc1427fc640 1 -- 172.21.15.55:0/2527537907 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc13c04fea0 con 0x7fc14c0c9830 2023-08-25T04:21:12.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.871+0000 7fc153d96640 1 -- 172.21.15.55:0/2527537907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc14c0c1d00 con 0x7fc14c0c9830 2023-08-25T04:21:12.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.875+0000 7fc1427fc640 1 -- 172.21.15.55:0/2527537907 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc13c0534c0 con 0x7fc14c0c9830 2023-08-25T04:21:12.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.875+0000 7fc153d96640 1 -- 172.21.15.55:0/2527537907 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fc1300657a0 msgr2=0x7fc130067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:12.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.875+0000 7fc153d96640 1 --2- 172.21.15.55:0/2527537907 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fc1300657a0 0x7fc130067c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc148000fc0 tx=0x7fc148009040 comp rx=0 tx=0).stop 2023-08-25T04:21:12.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.875+0000 7fc153d96640 1 -- 172.21.15.55:0/2527537907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c0c9830 msgr2=0x7fc14c0cd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:12.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.875+0000 7fc153d96640 1 --2- 172.21.15.55:0/2527537907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c0c9830 0x7fc14c0cd360 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fc13c00c450 tx=0x7fc13c00c910 comp rx=0 tx=0).stop 2023-08-25T04:21:12.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.875+0000 7fc153d96640 1 -- 172.21.15.55:0/2527537907 shutdown_connections 2023-08-25T04:21:12.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.875+0000 7fc153d96640 1 --2- 172.21.15.55:0/2527537907 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc14c15a7f0 0x7fc14c0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.875+0000 7fc153d96640 1 --2- 172.21.15.55:0/2527537907 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fc1300657a0 0x7fc130067c60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.875+0000 7fc153d96640 1 --2- 172.21.15.55:0/2527537907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc14c0c9830 0x7fc14c0cd360 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.875+0000 7fc153d96640 1 --2- 172.21.15.55:0/2527537907 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc14c06c020 0x7fc14c0c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:12.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.875+0000 7fc153d96640 1 -- 172.21.15.55:0/2527537907 >> 172.21.15.55:0/2527537907 conn(0x7fc14c069900 msgr2=0x7fc14c0aecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:12.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.879+0000 7fc153d96640 1 -- 172.21.15.55:0/2527537907 shutdown_connections 2023-08-25T04:21:12.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:12.879+0000 7fc153d96640 1 -- 172.21.15.55:0/2527537907 wait complete. 2023-08-25T04:21:12.894 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-08-25T04:21:13.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.039+0000 7f96cfe88640 1 Processor -- start 2023-08-25T04:21:13.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.039+0000 7f96cfe88640 1 -- start start 2023-08-25T04:21:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.039+0000 7f96cfe88640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96c815a830 0x7f96c80cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.039+0000 7f96cfe88640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c80ce170 con 0x7f96c80cc2b0 2023-08-25T04:21:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.039+0000 7f96cfe88640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c80ce3a0 con 0x7f96c80cd630 2023-08-25T04:21:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.039+0000 7f96cfe88640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c80cc6f0 con 0x7f96c815a830 2023-08-25T04:21:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.039+0000 7f96cdc24640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96c815a830 0x7f96c80cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.043+0000 7f96cd423640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f96c80cc2b0 0x7f96c80ccf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44950/0 (socket says 172.21.15.55:44950) 2023-08-25T04:21:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.043+0000 7f96cd423640 1 -- 172.21.15.55:0/4127266621 learned_addr learned my addr 172.21.15.55:0/4127266621 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.043+0000 7f96cdc24640 1 -- 172.21.15.55:0/4127266621 >> v1:172.21.15.110:6789/0 conn(0x7f96c80cd630 legacy=0x7f96c806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:13.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.043+0000 7f96cdc24640 1 -- 172.21.15.55:0/4127266621 >> v1:172.21.15.55:6789/0 conn(0x7f96c80cc2b0 legacy=0x7f96c80ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:13.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.043+0000 7f96cdc24640 1 -- 172.21.15.55:0/4127266621 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c80ce660 con 0x7f96c815a830 2023-08-25T04:21:13.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.043+0000 7f96ccc22640 1 -- 172.21.15.55:0/4127266621 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957492524 0 0) 0x7f96c80ce170 con 0x7f96c80cc2b0 2023-08-25T04:21:13.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.043+0000 7f96cdc24640 1 --2- 172.21.15.55:0/4127266621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96c815a830 0x7f96c80cbd70 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f96c40097a0 tx=0x7f96c401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a13d5662ff66c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:13.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.043+0000 7f96ccc22640 1 -- 172.21.15.55:0/4127266621 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c40ab5f0 con 0x7f96c815a830 2023-08-25T04:21:13.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.043+0000 7f96ccc22640 1 -- 172.21.15.55:0/4127266621 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c40ab750 con 0x7f96c815a830 2023-08-25T04:21:13.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.043+0000 7f96ccc22640 1 -- 172.21.15.55:0/4127266621 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c40abae0 con 0x7f96c815a830 2023-08-25T04:21:13.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cfe88640 1 -- 172.21.15.55:0/4127266621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96c815a830 msgr2=0x7f96c80cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:13.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cfe88640 1 --2- 172.21.15.55:0/4127266621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96c815a830 0x7f96c80cbd70 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f96c40097a0 tx=0x7f96c401c3f0 comp rx=0 tx=0).stop 2023-08-25T04:21:13.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cfe88640 1 -- 172.21.15.55:0/4127266621 shutdown_connections 2023-08-25T04:21:13.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cfe88640 1 --2- 172.21.15.55:0/4127266621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96c815a830 0x7f96c80cbd70 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:13.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cfe88640 1 -- 172.21.15.55:0/4127266621 >> 172.21.15.55:0/4127266621 conn(0x7f96c80d05a0 msgr2=0x7f96c80d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:13.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cfe88640 1 -- 172.21.15.55:0/4127266621 shutdown_connections 2023-08-25T04:21:13.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cfe88640 1 -- 172.21.15.55:0/4127266621 wait complete. 2023-08-25T04:21:13.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cfe88640 1 Processor -- start 2023-08-25T04:21:13.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cfe88640 1 -- start start 2023-08-25T04:21:13.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cfe88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96c80cc2b0 0x7f96c815d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:13.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cfe88640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96c80cd630 0x7f96c80c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:13.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cfe88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96c815a830 0x7f96c80c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:13.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cfe88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c815bf50 con 0x7f96c80cc2b0 2023-08-25T04:21:13.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cfe88640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c814dc90 con 0x7f96c80cd630 2023-08-25T04:21:13.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cfe88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c815c6f0 con 0x7f96c815a830 2023-08-25T04:21:13.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cdc24640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96c80cc2b0 0x7f96c815d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:13.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cdc24640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96c80cc2b0 0x7f96c815d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51012/0 (socket says 172.21.15.55:51012) 2023-08-25T04:21:13.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cdc24640 1 -- 172.21.15.55:0/449581386 learned_addr learned my addr 172.21.15.55:0/449581386 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:13.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96ce425640 1 --2- 172.21.15.55:0/449581386 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96c815a830 0x7f96c80c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:13.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cd423640 1 --2- 172.21.15.55:0/449581386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96c80cd630 0x7f96c80c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:13.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cdc24640 1 -- 172.21.15.55:0/449581386 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96c815a830 msgr2=0x7f96c80c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:13.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cdc24640 1 --2- 172.21.15.55:0/449581386 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96c815a830 0x7f96c80c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:13.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cdc24640 1 -- 172.21.15.55:0/449581386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96c80cd630 msgr2=0x7f96c80c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:13.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cdc24640 1 --2- 172.21.15.55:0/449581386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96c80cd630 0x7f96c80c4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:13.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cdc24640 1 -- 172.21.15.55:0/449581386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c40093b0 con 0x7f96c80cc2b0 2023-08-25T04:21:13.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.047+0000 7f96cd423640 1 --2- 172.21.15.55:0/449581386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96c80cd630 0x7f96c80c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:13.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.051+0000 7f96cdc24640 1 --2- 172.21.15.55:0/449581386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96c80cc2b0 0x7f96c815d7f0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f96c40ad040 tx=0x7f96c401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:13.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.051+0000 7f96be7fc640 1 -- 172.21.15.55:0/449581386 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c4005ba0 con 0x7f96c80cc2b0 2023-08-25T04:21:13.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.051+0000 7f96be7fc640 1 -- 172.21.15.55:0/449581386 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c4005d20 con 0x7f96c80cc2b0 2023-08-25T04:21:13.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.051+0000 7f96cfe88640 1 -- 172.21.15.55:0/449581386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c815c9d0 con 0x7f96c80cc2b0 2023-08-25T04:21:13.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.051+0000 7f96be7fc640 1 -- 172.21.15.55:0/449581386 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c4006260 con 0x7f96c80cc2b0 2023-08-25T04:21:13.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.051+0000 7f96cfe88640 1 -- 172.21.15.55:0/449581386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c815cf90 con 0x7f96c80cc2b0 2023-08-25T04:21:13.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.051+0000 7f96cfe88640 1 -- 172.21.15.55:0/449581386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c804dbe0 con 0x7f96c80cc2b0 2023-08-25T04:21:13.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.051+0000 7f96be7fc640 1 -- 172.21.15.55:0/449581386 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f96c40063c0 con 0x7f96c80cc2b0 2023-08-25T04:21:13.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.051+0000 7f96be7fc640 1 --2- 172.21.15.55:0/449581386 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f96ac0657d0 0x7f96ac067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:13.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.051+0000 7f96be7fc640 1 -- 172.21.15.55:0/449581386 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6113+0+0 (secure 0 0 0) 0x7f96c40a8050 con 0x7f96c80cc2b0 2023-08-25T04:21:13.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.051+0000 7f96cd423640 1 --2- 172.21.15.55:0/449581386 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f96ac0657d0 0x7f96ac067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:13.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.055+0000 7f96cd423640 1 --2- 172.21.15.55:0/449581386 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f96ac0657d0 0x7f96ac067c90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f96c80b64f0 tx=0x7f96b8009040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:13.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.055+0000 7f96be7fc640 1 -- 172.21.15.55:0/449581386 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f96c40eb250 con 0x7f96c80cc2b0 2023-08-25T04:21:13.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.263+0000 7f96cfe88640 1 -- 172.21.15.55:0/449581386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f96c80b04c0 con 0x7f96c80cc2b0 2023-08-25T04:21:13.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.811+0000 7f96be7fc640 1 -- 172.21.15.55:0/449581386 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v693) v1 ==== 183+0+0 (secure 0 0 0) 0x7f96c40ee870 con 0x7f96c80cc2b0 2023-08-25T04:21:13.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.811+0000 7f96cfe88640 1 -- 172.21.15.55:0/449581386 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f96ac0657d0 msgr2=0x7f96ac067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:13.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.811+0000 7f96cfe88640 1 --2- 172.21.15.55:0/449581386 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f96ac0657d0 0x7f96ac067c90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f96c80b64f0 tx=0x7f96b8009040 comp rx=0 tx=0).stop 2023-08-25T04:21:13.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.811+0000 7f96cfe88640 1 -- 172.21.15.55:0/449581386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96c80cc2b0 msgr2=0x7f96c815d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:13.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.811+0000 7f96cfe88640 1 --2- 172.21.15.55:0/449581386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96c80cc2b0 0x7f96c815d7f0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f96c40ad040 tx=0x7f96c401ac30 comp rx=0 tx=0).stop 2023-08-25T04:21:13.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.811+0000 7f96cfe88640 1 -- 172.21.15.55:0/449581386 shutdown_connections 2023-08-25T04:21:13.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.811+0000 7f96cfe88640 1 --2- 172.21.15.55:0/449581386 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96c815a830 0x7f96c80c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:13.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.811+0000 7f96cfe88640 1 --2- 172.21.15.55:0/449581386 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96c80cd630 0x7f96c80c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:13.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.811+0000 7f96cfe88640 1 --2- 172.21.15.55:0/449581386 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f96ac0657d0 0x7f96ac067c90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:13.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.811+0000 7f96cfe88640 1 --2- 172.21.15.55:0/449581386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96c80cc2b0 0x7f96c815d7f0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:13.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.811+0000 7f96cfe88640 1 -- 172.21.15.55:0/449581386 >> 172.21.15.55:0/449581386 conn(0x7f96c80d05a0 msgr2=0x7f96c8154b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:13.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.811+0000 7f96cfe88640 1 -- 172.21.15.55:0/449581386 shutdown_connections 2023-08-25T04:21:13.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.811+0000 7f96cfe88640 1 -- 172.21.15.55:0/449581386 wait complete. 2023-08-25T04:21:13.833 INFO:tasks.cephfs_test_runner:test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) ... ok 2023-08-25T04:21:13.833 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-08-25T04:21:13.834 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-25T04:21:13.834 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-08-25T04:21:13.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.983+0000 7fe311488640 1 Processor -- start 2023-08-25T04:21:13.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.983+0000 7fe311488640 1 -- start start 2023-08-25T04:21:13.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.987+0000 7fe311488640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe30c0c1a80 0x7fe30c0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:13.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.987+0000 7fe311488640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe30c0cddf0 0x7fe30c06bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:13.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.987+0000 7fe311488640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30c0cc510 con 0x7fe30c164410 2023-08-25T04:21:13.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.987+0000 7fe311488640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30c1647f0 con 0x7fe30c0c1a80 2023-08-25T04:21:13.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.987+0000 7fe311488640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0cc9b0 con 0x7fe30c0cddf0 2023-08-25T04:21:13.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.987+0000 7fe303fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe30c0c1a80 0x7fe30c0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:13.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.987+0000 7fe303fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe30c0c1a80 0x7fe30c0b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51022/0 (socket says 172.21.15.55:51022) 2023-08-25T04:21:13.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.987+0000 7fe303fff640 1 -- 172.21.15.55:0/3202413163 learned_addr learned my addr 172.21.15.55:0/3202413163 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:13.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.987+0000 7fe30affd640 1 --1- 172.21.15.55:0/3202413163 >> v1:172.21.15.55:6789/0 conn(0x7fe30c164410 0x7fe30c0c1370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44966/0 (socket says 172.21.15.55:44966) 2023-08-25T04:21:13.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.987+0000 7fe30b7fe640 1 --2- 172.21.15.55:0/3202413163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe30c0cddf0 0x7fe30c06bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:13.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.987+0000 7fe303fff640 1 -- 172.21.15.55:0/3202413163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe30c0cddf0 msgr2=0x7fe30c06bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:13.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.987+0000 7fe303fff640 1 --2- 172.21.15.55:0/3202413163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe30c0cddf0 0x7fe30c06bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:13.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.987+0000 7fe303fff640 1 -- 172.21.15.55:0/3202413163 >> v1:172.21.15.55:6789/0 conn(0x7fe30c164410 legacy=0x7fe30c0c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:13.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.987+0000 7fe303fff640 1 -- 172.21.15.55:0/3202413163 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c0ccc90 con 0x7fe30c0c1a80 2023-08-25T04:21:13.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.987+0000 7fe30a7fc640 1 -- 172.21.15.55:0/3202413163 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062707672 0 0) 0x7fe30c0cc510 con 0x7fe30c164410 2023-08-25T04:21:13.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.991+0000 7fe303fff640 1 --2- 172.21.15.55:0/3202413163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c0c1a80 0x7fe30c0b21b0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009870 tx=0x7fe2f401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32d2e6889d384b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:13.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.991+0000 7fe30a7fc640 1 -- 172.21.15.55:0/3202413163 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40ab600 con 0x7fe30c0c1a80 2023-08-25T04:21:13.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.991+0000 7fe30a7fc640 1 -- 172.21.15.55:0/3202413163 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f40a7050 con 0x7fe30c0c1a80 2023-08-25T04:21:13.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.991+0000 7fe30a7fc640 1 -- 172.21.15.55:0/3202413163 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f40ab980 con 0x7fe30c0c1a80 2023-08-25T04:21:13.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.991+0000 7fe311488640 1 -- 172.21.15.55:0/3202413163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c0c1a80 msgr2=0x7fe30c0b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:13.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.991+0000 7fe311488640 1 --2- 172.21.15.55:0/3202413163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c0c1a80 0x7fe30c0b21b0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009870 tx=0x7fe2f401c540 comp rx=0 tx=0).stop 2023-08-25T04:21:13.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.991+0000 7fe311488640 1 -- 172.21.15.55:0/3202413163 shutdown_connections 2023-08-25T04:21:13.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.991+0000 7fe311488640 1 --2- 172.21.15.55:0/3202413163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe30c0cddf0 0x7fe30c06bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:13.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.991+0000 7fe311488640 1 --2- 172.21.15.55:0/3202413163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c0c1a80 0x7fe30c0b21b0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:13.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.991+0000 7fe311488640 1 -- 172.21.15.55:0/3202413163 >> 172.21.15.55:0/3202413163 conn(0x7fe30c069d00 msgr2=0x7fe30c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:13.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.991+0000 7fe311488640 1 -- 172.21.15.55:0/3202413163 shutdown_connections 2023-08-25T04:21:13.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.991+0000 7fe311488640 1 -- 172.21.15.55:0/3202413163 wait complete. 2023-08-25T04:21:13.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.991+0000 7fe311488640 1 Processor -- start 2023-08-25T04:21:13.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.991+0000 7fe311488640 1 -- start start 2023-08-25T04:21:13.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe311488640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe30c0c1a80 0x7fe30c0af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:13.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe311488640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe30c0cddf0 0x7fe30c160620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:13.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe311488640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c164410 0x7fe30c070460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:13.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe311488640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c160b60 con 0x7fe30c164410 2023-08-25T04:21:13.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe311488640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0c34e0 con 0x7fe30c0cddf0 2023-08-25T04:21:13.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe311488640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c160d90 con 0x7fe30c0c1a80 2023-08-25T04:21:13.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe30b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c164410 0x7fe30c070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:13.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe30b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c164410 0x7fe30c070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51038/0 (socket says 172.21.15.55:51038) 2023-08-25T04:21:13.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe303fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe30c0cddf0 0x7fe30c160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:13.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe30b7fe640 1 -- 172.21.15.55:0/1237389521 learned_addr learned my addr 172.21.15.55:0/1237389521 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:13.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe30affd640 1 --2- 172.21.15.55:0/1237389521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe30c0c1a80 0x7fe30c0af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:13.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe30b7fe640 1 -- 172.21.15.55:0/1237389521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe30c0c1a80 msgr2=0x7fe30c0af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:13.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe30b7fe640 1 --2- 172.21.15.55:0/1237389521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe30c0c1a80 0x7fe30c0af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:13.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe30b7fe640 1 -- 172.21.15.55:0/1237389521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe30c0cddf0 msgr2=0x7fe30c160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:13.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe30b7fe640 1 --2- 172.21.15.55:0/1237389521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe30c0cddf0 0x7fe30c160620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:13.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe30b7fe640 1 -- 172.21.15.55:0/1237389521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f40094d0 con 0x7fe30c164410 2023-08-25T04:21:13.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe30b7fe640 1 --2- 172.21.15.55:0/1237389521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c164410 0x7fe30c070460 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fe304007e40 tx=0x7fe30400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:13.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe3037fe640 1 -- 172.21.15.55:0/1237389521 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe304014620 con 0x7fe30c164410 2023-08-25T04:21:13.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe3037fe640 1 -- 172.21.15.55:0/1237389521 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30400ee90 con 0x7fe30c164410 2023-08-25T04:21:13.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe3037fe640 1 -- 172.21.15.55:0/1237389521 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3040149e0 con 0x7fe30c164410 2023-08-25T04:21:13.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe311488640 1 -- 172.21.15.55:0/1237389521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30c0c2bb0 con 0x7fe30c164410 2023-08-25T04:21:13.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe311488640 1 -- 172.21.15.55:0/1237389521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30c0c3170 con 0x7fe30c164410 2023-08-25T04:21:13.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe311488640 1 -- 172.21.15.55:0/1237389521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30c04dbe0 con 0x7fe30c164410 2023-08-25T04:21:13.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.995+0000 7fe3037fe640 1 -- 172.21.15.55:0/1237389521 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fe304014b40 con 0x7fe30c164410 2023-08-25T04:21:13.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.999+0000 7fe3037fe640 1 --2- 172.21.15.55:0/1237389521 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fe2ec0657a0 0x7fe2ec067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:13.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.999+0000 7fe3037fe640 1 -- 172.21.15.55:0/1237389521 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6113+0+0 (secure 0 0 0) 0x7fe304083920 con 0x7fe30c164410 2023-08-25T04:21:13.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.999+0000 7fe30affd640 1 --2- 172.21.15.55:0/1237389521 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fe2ec0657a0 0x7fe2ec067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:13.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:13.999+0000 7fe30affd640 1 --2- 172.21.15.55:0/1237389521 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fe2ec0657a0 0x7fe2ec067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc000f70 tx=0x7fe2fc007df0 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:13.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.003+0000 7fe3037fe640 1 -- 172.21.15.55:0/1237389521 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe3040512a0 con 0x7fe30c164410 2023-08-25T04:21:14.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.211+0000 7fe311488640 1 -- 172.21.15.55:0/1237389521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7fe30c06bca0 con 0x7fe30c164410 2023-08-25T04:21:14.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.815+0000 7fe3037fe640 1 -- 172.21.15.55:0/1237389521 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v694) v1 ==== 151+0+0 (secure 0 0 0) 0x7fe3040548c0 con 0x7fe30c164410 2023-08-25T04:21:14.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.815+0000 7fe311488640 1 -- 172.21.15.55:0/1237389521 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fe2ec0657a0 msgr2=0x7fe2ec067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:14.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.815+0000 7fe311488640 1 --2- 172.21.15.55:0/1237389521 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fe2ec0657a0 0x7fe2ec067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc000f70 tx=0x7fe2fc007df0 comp rx=0 tx=0).stop 2023-08-25T04:21:14.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.815+0000 7fe311488640 1 -- 172.21.15.55:0/1237389521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c164410 msgr2=0x7fe30c070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:14.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.815+0000 7fe311488640 1 --2- 172.21.15.55:0/1237389521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c164410 0x7fe30c070460 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fe304007e40 tx=0x7fe30400e4b0 comp rx=0 tx=0).stop 2023-08-25T04:21:14.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.815+0000 7fe311488640 1 -- 172.21.15.55:0/1237389521 shutdown_connections 2023-08-25T04:21:14.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.815+0000 7fe311488640 1 --2- 172.21.15.55:0/1237389521 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fe2ec0657a0 0x7fe2ec067c60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:14.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.815+0000 7fe311488640 1 --2- 172.21.15.55:0/1237389521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe30c164410 0x7fe30c070460 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:14.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.815+0000 7fe311488640 1 --2- 172.21.15.55:0/1237389521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe30c0cddf0 0x7fe30c160620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:14.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.815+0000 7fe311488640 1 --2- 172.21.15.55:0/1237389521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe30c0c1a80 0x7fe30c0af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:14.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.815+0000 7fe311488640 1 -- 172.21.15.55:0/1237389521 >> 172.21.15.55:0/1237389521 conn(0x7fe30c069d00 msgr2=0x7fe30c06f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:14.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.815+0000 7fe311488640 1 -- 172.21.15.55:0/1237389521 shutdown_connections 2023-08-25T04:21:14.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.815+0000 7fe311488640 1 -- 172.21.15.55:0/1237389521 wait complete. 2023-08-25T04:21:14.837 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:21:14.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.987+0000 7f2a87acb640 1 Processor -- start 2023-08-25T04:21:14.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.987+0000 7f2a87acb640 1 -- start start 2023-08-25T04:21:14.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.987+0000 7f2a87acb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a800d0da0 0x7f2a800d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:14.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.987+0000 7f2a87acb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2a800b3e50 0x7f2a800ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:14.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.987+0000 7f2a87acb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a800b29b0 con 0x7f2a800cdde0 2023-08-25T04:21:14.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.987+0000 7f2a87acb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a800ce760 con 0x7f2a800d0da0 2023-08-25T04:21:14.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.987+0000 7f2a87acb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a800d16c0 con 0x7f2a800b3e50 2023-08-25T04:21:14.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.987+0000 7f2a85867640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a800d0da0 0x7f2a800d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:14.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.987+0000 7f2a85867640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a800d0da0 0x7f2a800d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51054/0 (socket says 172.21.15.55:51054) 2023-08-25T04:21:14.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.987+0000 7f2a85867640 1 -- 172.21.15.55:0/3852279002 learned_addr learned my addr 172.21.15.55:0/3852279002 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:14.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.987+0000 7f2a85066640 1 --1- 172.21.15.55:0/3852279002 >> v1:172.21.15.55:6789/0 conn(0x7f2a800cdde0 0x7f2a800cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44968/0 (socket says 172.21.15.55:44968) 2023-08-25T04:21:14.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.987+0000 7f2a86068640 1 --2- 172.21.15.55:0/3852279002 >> v2:172.21.15.110:3300/0 conn(0x7f2a800b3e50 0x7f2a800ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:14.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.987+0000 7f2a85867640 1 -- 172.21.15.55:0/3852279002 >> v2:172.21.15.110:3300/0 conn(0x7f2a800b3e50 msgr2=0x7f2a800ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:14.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.987+0000 7f2a85867640 1 --2- 172.21.15.55:0/3852279002 >> v2:172.21.15.110:3300/0 conn(0x7f2a800b3e50 0x7f2a800ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:14.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.987+0000 7f2a85867640 1 -- 172.21.15.55:0/3852279002 >> v1:172.21.15.55:6789/0 conn(0x7f2a800cdde0 legacy=0x7f2a800cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:14.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.987+0000 7f2a85867640 1 -- 172.21.15.55:0/3852279002 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a800b1dc0 con 0x7f2a800d0da0 2023-08-25T04:21:14.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.991+0000 7f2a85867640 1 --2- 172.21.15.55:0/3852279002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a800d0da0 0x7f2a800d1180 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f2a8009c1c0 tx=0x7f2a7c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eab26be724f1cdd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:14.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.991+0000 7f2a84865640 1 -- 172.21.15.55:0/3852279002 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c0a89f0 con 0x7f2a800d0da0 2023-08-25T04:21:14.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.991+0000 7f2a84865640 1 -- 172.21.15.55:0/3852279002 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c0a8b50 con 0x7f2a800d0da0 2023-08-25T04:21:14.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.991+0000 7f2a84865640 1 -- 172.21.15.55:0/3852279002 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c0b0440 con 0x7f2a800d0da0 2023-08-25T04:21:14.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.991+0000 7f2a87acb640 1 -- 172.21.15.55:0/3852279002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a800d0da0 msgr2=0x7f2a800d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:14.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.991+0000 7f2a87acb640 1 --2- 172.21.15.55:0/3852279002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a800d0da0 0x7f2a800d1180 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f2a8009c1c0 tx=0x7f2a7c01ecf0 comp rx=0 tx=0).stop 2023-08-25T04:21:14.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.991+0000 7f2a87acb640 1 -- 172.21.15.55:0/3852279002 shutdown_connections 2023-08-25T04:21:14.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.991+0000 7f2a87acb640 1 --2- 172.21.15.55:0/3852279002 >> v2:172.21.15.110:3300/0 conn(0x7f2a800b3e50 0x7f2a800ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:14.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.991+0000 7f2a87acb640 1 --2- 172.21.15.55:0/3852279002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a800d0da0 0x7f2a800d1180 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:14.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.991+0000 7f2a87acb640 1 -- 172.21.15.55:0/3852279002 >> 172.21.15.55:0/3852279002 conn(0x7f2a8009bae0 msgr2=0x7f2a800d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:14.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.991+0000 7f2a87acb640 1 -- 172.21.15.55:0/3852279002 shutdown_connections 2023-08-25T04:21:14.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.991+0000 7f2a87acb640 1 -- 172.21.15.55:0/3852279002 wait complete. 2023-08-25T04:21:14.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a87acb640 1 Processor -- start 2023-08-25T04:21:14.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a87acb640 1 -- start start 2023-08-25T04:21:14.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a87acb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a800b3e50 0x7f2a800ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:14.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a87acb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a800cdde0 0x7f2a800cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:14.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a87acb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a800d0da0 0x7f2a800cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:14.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a87acb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800cb880 con 0x7f2a800cdde0 2023-08-25T04:21:14.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a87acb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800cc680 con 0x7f2a800b3e50 2023-08-25T04:21:14.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a87acb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800c7060 con 0x7f2a800d0da0 2023-08-25T04:21:14.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a85066640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a800cdde0 0x7f2a800cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:14.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a85066640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a800cdde0 0x7f2a800cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51058/0 (socket says 172.21.15.55:51058) 2023-08-25T04:21:14.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a85066640 1 -- 172.21.15.55:0/385929672 learned_addr learned my addr 172.21.15.55:0/385929672 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:14.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a85867640 1 --2- 172.21.15.55:0/385929672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a800b3e50 0x7f2a800ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:14.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a86068640 1 --2- 172.21.15.55:0/385929672 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a800d0da0 0x7f2a800cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:14.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a85066640 1 -- 172.21.15.55:0/385929672 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a800d0da0 msgr2=0x7f2a800cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a85066640 1 --2- 172.21.15.55:0/385929672 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a800d0da0 0x7f2a800cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a85066640 1 -- 172.21.15.55:0/385929672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a800b3e50 msgr2=0x7f2a800ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a85066640 1 --2- 172.21.15.55:0/385929672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a800b3e50 0x7f2a800ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a85066640 1 -- 172.21.15.55:0/385929672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c009480 con 0x7f2a800cdde0 2023-08-25T04:21:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a85867640 1 --2- 172.21.15.55:0/385929672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a800b3e50 0x7f2a800ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a85066640 1 --2- 172.21.15.55:0/385929672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a800cdde0 0x7f2a800cc140 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f2a7000c4c0 tx=0x7f2a7000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a767fc640 1 -- 172.21.15.55:0/385929672 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a70007480 con 0x7f2a800cdde0 2023-08-25T04:21:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a767fc640 1 -- 172.21.15.55:0/385929672 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a700075e0 con 0x7f2a800cdde0 2023-08-25T04:21:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a767fc640 1 -- 172.21.15.55:0/385929672 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a70004a10 con 0x7f2a800cdde0 2023-08-25T04:21:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a87acb640 1 -- 172.21.15.55:0/385929672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a800c6d30 con 0x7f2a800cdde0 2023-08-25T04:21:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.995+0000 7f2a87acb640 1 -- 172.21.15.55:0/385929672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a800cb2c0 con 0x7f2a800cdde0 2023-08-25T04:21:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.999+0000 7f2a87acb640 1 -- 172.21.15.55:0/385929672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a8004dbe0 con 0x7f2a800cdde0 2023-08-25T04:21:15.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.999+0000 7f2a767fc640 1 -- 172.21.15.55:0/385929672 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f2a70004b70 con 0x7f2a800cdde0 2023-08-25T04:21:15.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.999+0000 7f2a767fc640 1 --2- 172.21.15.55:0/385929672 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f2a640657d0 0x7f2a64067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:15.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.999+0000 7f2a767fc640 1 -- 172.21.15.55:0/385929672 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6113+0+0 (secure 0 0 0) 0x7f2a700821a0 con 0x7f2a800cdde0 2023-08-25T04:21:15.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.999+0000 7f2a85867640 1 --2- 172.21.15.55:0/385929672 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f2a640657d0 0x7f2a64067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:15.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:14.999+0000 7f2a85867640 1 --2- 172.21.15.55:0/385929672 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f2a640657d0 0x7f2a64067c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0b2000 tx=0x7f2a7c0aa070 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:15.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.003+0000 7f2a767fc640 1 -- 172.21.15.55:0/385929672 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2a7004fb20 con 0x7f2a800cdde0 2023-08-25T04:21:15.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.159+0000 7f2a87acb640 1 -- 172.21.15.55:0/385929672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a800d0b80 con 0x7f2a800cdde0 2023-08-25T04:21:15.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.159+0000 7f2a767fc640 1 -- 172.21.15.55:0/385929672 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+15997 (secure 0 0 0) 0x7f2a70053140 con 0x7f2a800cdde0 2023-08-25T04:21:15.158 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:15.158 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":114,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:21:11.796475+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6833/1173226599":"2023-08-26T04:21:08.634948+0000","172.21.15.110:0/2314442939":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/2377772956":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/2047388026":"2023-08-26T04:21:05.518300+0000","172.21.15.110:6833/4020134262":"2023-08-26T04:21:05.518300+0000","172.21.15.110:6832/4020134262":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/628153163":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/3139288378":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/3461148215":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/1316478715":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/1419068877":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/4165332902":"2023-08-26T04:21:05.518300+0000","172.21.15.110:0/2779991692":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/3403132554":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/2984642613":"2023-08-26T04:19:58.502978+0000","172.21.15.110:6833/1337211678":"2023-08-26T04:19:58.502978+0000","172.21.15.55:6835/1173226599":"2023-08-26T04:21:08.634948+0000","172.21.15.110:6832/1337211678":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/499210753":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/3677413256":"2023-08-26T04:19:58.502978+0000","172.21.15.110:0/3256947721":"2023-08-25T05:19:50.681655+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:21:15.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.163+0000 7f2a87acb640 1 -- 172.21.15.55:0/385929672 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f2a640657d0 msgr2=0x7f2a64067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:15.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.163+0000 7f2a87acb640 1 --2- 172.21.15.55:0/385929672 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f2a640657d0 0x7f2a64067c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0b2000 tx=0x7f2a7c0aa070 comp rx=0 tx=0).stop 2023-08-25T04:21:15.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.163+0000 7f2a87acb640 1 -- 172.21.15.55:0/385929672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a800cdde0 msgr2=0x7f2a800cc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:15.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.163+0000 7f2a87acb640 1 --2- 172.21.15.55:0/385929672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a800cdde0 0x7f2a800cc140 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f2a7000c4c0 tx=0x7f2a7000c980 comp rx=0 tx=0).stop 2023-08-25T04:21:15.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.163+0000 7f2a87acb640 1 -- 172.21.15.55:0/385929672 shutdown_connections 2023-08-25T04:21:15.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.163+0000 7f2a87acb640 1 --2- 172.21.15.55:0/385929672 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a800d0da0 0x7f2a800cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.163+0000 7f2a87acb640 1 --2- 172.21.15.55:0/385929672 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f2a640657d0 0x7f2a64067c90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.163+0000 7f2a87acb640 1 --2- 172.21.15.55:0/385929672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a800cdde0 0x7f2a800cc140 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.163+0000 7f2a87acb640 1 --2- 172.21.15.55:0/385929672 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a800b3e50 0x7f2a800ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.163+0000 7f2a87acb640 1 -- 172.21.15.55:0/385929672 >> 172.21.15.55:0/385929672 conn(0x7f2a8009bae0 msgr2=0x7f2a8006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:15.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.163+0000 7f2a87acb640 1 -- 172.21.15.55:0/385929672 shutdown_connections 2023-08-25T04:21:15.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.163+0000 7f2a87acb640 1 -- 172.21.15.55:0/385929672 wait complete. 2023-08-25T04:21:15.179 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:21:15.180 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:21:15.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.331+0000 7fb6fcd2c640 1 Processor -- start 2023-08-25T04:21:15.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.331+0000 7fb6fcd2c640 1 -- start start 2023-08-25T04:21:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.331+0000 7fb6fcd2c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb6f806a010 0x7fb6f80ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.331+0000 7fb6fcd2c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb6f80ced50 0x7fb6f815c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.331+0000 7fb6fcd2c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f806d200 con 0x7fb6f80ae8e0 2023-08-25T04:21:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.331+0000 7fb6fcd2c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f806c5f0 con 0x7fb6f806a010 2023-08-25T04:21:15.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.331+0000 7fb6fcd2c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f806c8d0 con 0x7fb6f80ced50 2023-08-25T04:21:15.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.331+0000 7fb6effff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb6f806a010 0x7fb6f80ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:15.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.331+0000 7fb6effff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb6f806a010 0x7fb6f80ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51074/0 (socket says 172.21.15.55:51074) 2023-08-25T04:21:15.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.331+0000 7fb6effff640 1 -- 172.21.15.55:0/3137159660 learned_addr learned my addr 172.21.15.55:0/3137159660 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:15.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.331+0000 7fb6f6d9d640 1 --2- 172.21.15.55:0/3137159660 >> v2:172.21.15.110:3300/0 conn(0x7fb6f80ced50 0x7fb6f815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:15.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.331+0000 7fb6effff640 1 -- 172.21.15.55:0/3137159660 >> v2:172.21.15.110:3300/0 conn(0x7fb6f80ced50 msgr2=0x7fb6f815c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:15.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.331+0000 7fb6effff640 1 --2- 172.21.15.55:0/3137159660 >> v2:172.21.15.110:3300/0 conn(0x7fb6f80ced50 0x7fb6f815c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.331+0000 7fb6effff640 1 -- 172.21.15.55:0/3137159660 >> v1:172.21.15.110:6789/0 conn(0x7fb6f80ae8e0 legacy=0x7fb6f8069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:15.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.331+0000 7fb6effff640 1 -- 172.21.15.55:0/3137159660 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f806cbb0 con 0x7fb6f806a010 2023-08-25T04:21:15.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.335+0000 7fb6effff640 1 --2- 172.21.15.55:0/3137159660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f806a010 0x7fb6f80ce810 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fb6f806b790 tx=0x7fb6e001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0e78bf23fa5b4b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:15.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.335+0000 7fb6f5d9b640 1 -- 172.21.15.55:0/3137159660 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e00aa3f0 con 0x7fb6f806a010 2023-08-25T04:21:15.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.335+0000 7fb6f5d9b640 1 -- 172.21.15.55:0/3137159660 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e00aa550 con 0x7fb6f806a010 2023-08-25T04:21:15.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.335+0000 7fb6f5d9b640 1 -- 172.21.15.55:0/3137159660 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e00aa8e0 con 0x7fb6f806a010 2023-08-25T04:21:15.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.335+0000 7fb6fcd2c640 1 -- 172.21.15.55:0/3137159660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f806a010 msgr2=0x7fb6f80ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:15.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.335+0000 7fb6fcd2c640 1 --2- 172.21.15.55:0/3137159660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f806a010 0x7fb6f80ce810 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fb6f806b790 tx=0x7fb6e001c4d0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.335+0000 7fb6fcd2c640 1 -- 172.21.15.55:0/3137159660 shutdown_connections 2023-08-25T04:21:15.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.335+0000 7fb6fcd2c640 1 --2- 172.21.15.55:0/3137159660 >> v2:172.21.15.110:3300/0 conn(0x7fb6f80ced50 0x7fb6f815c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.335+0000 7fb6fcd2c640 1 --2- 172.21.15.55:0/3137159660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f806a010 0x7fb6f80ce810 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.335+0000 7fb6fcd2c640 1 -- 172.21.15.55:0/3137159660 >> 172.21.15.55:0/3137159660 conn(0x7fb6f80cf4d0 msgr2=0x7fb6f80cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:15.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.335+0000 7fb6fcd2c640 1 -- 172.21.15.55:0/3137159660 shutdown_connections 2023-08-25T04:21:15.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.335+0000 7fb6fcd2c640 1 -- 172.21.15.55:0/3137159660 wait complete. 2023-08-25T04:21:15.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.335+0000 7fb6fcd2c640 1 Processor -- start 2023-08-25T04:21:15.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.335+0000 7fb6fcd2c640 1 -- start start 2023-08-25T04:21:15.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6fcd2c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6f806a010 0x7fb6f80c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:15.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6fcd2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f80ae8e0 0x7fb6f8158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:15.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6fcd2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6f80ced50 0x7fb6f8159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:15.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6fcd2c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f814d4f0 con 0x7fb6f80ae8e0 2023-08-25T04:21:15.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6fcd2c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f81f5020 con 0x7fb6f80ced50 2023-08-25T04:21:15.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6fcd2c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f81f5300 con 0x7fb6f806a010 2023-08-25T04:21:15.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6effff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f80ae8e0 0x7fb6f8158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:15.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6effff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f80ae8e0 0x7fb6f8158dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51088/0 (socket says 172.21.15.55:51088) 2023-08-25T04:21:15.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6effff640 1 -- 172.21.15.55:0/832346445 learned_addr learned my addr 172.21.15.55:0/832346445 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:15.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6f659c640 1 --2- 172.21.15.55:0/832346445 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6f806a010 0x7fb6f80c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:15.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6f6d9d640 1 --2- 172.21.15.55:0/832346445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6f80ced50 0x7fb6f8159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:15.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6effff640 1 -- 172.21.15.55:0/832346445 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6f806a010 msgr2=0x7fb6f80c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:15.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6effff640 1 --2- 172.21.15.55:0/832346445 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6f806a010 0x7fb6f80c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6effff640 1 -- 172.21.15.55:0/832346445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6f80ced50 msgr2=0x7fb6f8159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:15.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6effff640 1 --2- 172.21.15.55:0/832346445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6f80ced50 0x7fb6f8159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6effff640 1 -- 172.21.15.55:0/832346445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e00094d0 con 0x7fb6f80ae8e0 2023-08-25T04:21:15.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6effff640 1 --2- 172.21.15.55:0/832346445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f80ae8e0 0x7fb6f8158dc0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00190e0 tx=0x7fb6e001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:15.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6eeffd640 1 -- 172.21.15.55:0/832346445 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e00aa3f0 con 0x7fb6f80ae8e0 2023-08-25T04:21:15.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6eeffd640 1 -- 172.21.15.55:0/832346445 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e00b3800 con 0x7fb6f80ae8e0 2023-08-25T04:21:15.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6eeffd640 1 -- 172.21.15.55:0/832346445 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e00b3bb0 con 0x7fb6f80ae8e0 2023-08-25T04:21:15.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6fcd2c640 1 -- 172.21.15.55:0/832346445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f81f55e0 con 0x7fb6f80ae8e0 2023-08-25T04:21:15.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6fcd2c640 1 -- 172.21.15.55:0/832346445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f81f5ba0 con 0x7fb6f80ae8e0 2023-08-25T04:21:15.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.339+0000 7fb6fcd2c640 1 -- 172.21.15.55:0/832346445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f8073ec0 con 0x7fb6f80ae8e0 2023-08-25T04:21:15.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.343+0000 7fb6eeffd640 1 -- 172.21.15.55:0/832346445 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fb6e00b3d10 con 0x7fb6f80ae8e0 2023-08-25T04:21:15.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.343+0000 7fb6eeffd640 1 --2- 172.21.15.55:0/832346445 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fb6d80657a0 0x7fb6d8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:15.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.343+0000 7fb6eeffd640 1 -- 172.21.15.55:0/832346445 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6113+0+0 (secure 0 0 0) 0x7fb6e00a7070 con 0x7fb6f80ae8e0 2023-08-25T04:21:15.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.343+0000 7fb6f659c640 1 --2- 172.21.15.55:0/832346445 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fb6d80657a0 0x7fb6d8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:15.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.343+0000 7fb6f659c640 1 --2- 172.21.15.55:0/832346445 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fb6d80657a0 0x7fb6d8067c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8007fd0 tx=0x7fb6e8009040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:15.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.347+0000 7fb6eeffd640 1 -- 172.21.15.55:0/832346445 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb6e00eae30 con 0x7fb6f80ae8e0 2023-08-25T04:21:15.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.503+0000 7fb6fcd2c640 1 -- 172.21.15.55:0/832346445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb6f8070e60 con 0x7fb6f80ae8e0 2023-08-25T04:21:15.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.503+0000 7fb6eeffd640 1 -- 172.21.15.55:0/832346445 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v114) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb6e00ee450 con 0x7fb6f80ae8e0 2023-08-25T04:21:15.502 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:21:15.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.503+0000 7fb6fcd2c640 1 -- 172.21.15.55:0/832346445 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fb6d80657a0 msgr2=0x7fb6d8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:15.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.503+0000 7fb6fcd2c640 1 --2- 172.21.15.55:0/832346445 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fb6d80657a0 0x7fb6d8067c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb6e8007fd0 tx=0x7fb6e8009040 comp rx=0 tx=0).stop 2023-08-25T04:21:15.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.503+0000 7fb6fcd2c640 1 -- 172.21.15.55:0/832346445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f80ae8e0 msgr2=0x7fb6f8158dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:15.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.503+0000 7fb6fcd2c640 1 --2- 172.21.15.55:0/832346445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f80ae8e0 0x7fb6f8158dc0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00190e0 tx=0x7fb6e001ad10 comp rx=0 tx=0).stop 2023-08-25T04:21:15.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.503+0000 7fb6fcd2c640 1 -- 172.21.15.55:0/832346445 shutdown_connections 2023-08-25T04:21:15.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.503+0000 7fb6fcd2c640 1 --2- 172.21.15.55:0/832346445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb6f80ced50 0x7fb6f8159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.503+0000 7fb6fcd2c640 1 --2- 172.21.15.55:0/832346445 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fb6d80657a0 0x7fb6d8067c60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.503+0000 7fb6fcd2c640 1 --2- 172.21.15.55:0/832346445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6f80ae8e0 0x7fb6f8158dc0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.503+0000 7fb6fcd2c640 1 --2- 172.21.15.55:0/832346445 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb6f806a010 0x7fb6f80c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.503+0000 7fb6fcd2c640 1 -- 172.21.15.55:0/832346445 >> 172.21.15.55:0/832346445 conn(0x7fb6f80cf4d0 msgr2=0x7fb6f8157960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:15.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.503+0000 7fb6fcd2c640 1 -- 172.21.15.55:0/832346445 shutdown_connections 2023-08-25T04:21:15.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.503+0000 7fb6fcd2c640 1 -- 172.21.15.55:0/832346445 wait complete. 2023-08-25T04:21:15.522 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:21:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.671+0000 7f7f03a6d640 1 Processor -- start 2023-08-25T04:21:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.671+0000 7f7f03a6d640 1 -- start start 2023-08-25T04:21:15.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.671+0000 7f7f03a6d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7efc1598e0 0x7f7efc0cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:15.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.675+0000 7f7f03a6d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7efc0cb0d0 0x7f7efc0cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:15.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.675+0000 7f7f03a6d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7efc0ccbe0 con 0x7f7efc0cdab0 2023-08-25T04:21:15.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.675+0000 7f7f03a6d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7efc159cc0 con 0x7f7efc0cb0d0 2023-08-25T04:21:15.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.675+0000 7f7f03a6d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0ce430 con 0x7f7efc1598e0 2023-08-25T04:21:15.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.675+0000 7f7f0200a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7efc0cb0d0 0x7f7efc0cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:15.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.675+0000 7f7f01809640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7efc1598e0 0x7f7efc0cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:15.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.675+0000 7f7f0200a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7efc0cb0d0 0x7f7efc0cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:54676/0 (socket says 172.21.15.55:54676) 2023-08-25T04:21:15.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.675+0000 7f7f0200a640 1 -- 172.21.15.55:0/900779032 learned_addr learned my addr 172.21.15.55:0/900779032 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:15.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.675+0000 7f7f0200a640 1 -- 172.21.15.55:0/900779032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7efc1598e0 msgr2=0x7f7efc0cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:15.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.675+0000 7f7f0200a640 1 --2- 172.21.15.55:0/900779032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7efc1598e0 0x7f7efc0cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.675+0000 7f7f0200a640 1 -- 172.21.15.55:0/900779032 >> v1:172.21.15.110:6789/0 conn(0x7f7efc0cdab0 legacy=0x7f7efc15d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:15.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.675+0000 7f7f0200a640 1 -- 172.21.15.55:0/900779032 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc0cbfd0 con 0x7f7efc0cb0d0 2023-08-25T04:21:15.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.679+0000 7f7f0200a640 1 --2- 172.21.15.55:0/900779032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc0cb0d0 0x7f7efc0cdef0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009e80 tx=0x7f7ef401f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27d845c230371c3f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:15.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.679+0000 7f7f00807640 1 -- 172.21.15.55:0/900779032 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40af400 con 0x7f7efc0cb0d0 2023-08-25T04:21:15.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.679+0000 7f7f00807640 1 -- 172.21.15.55:0/900779032 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef40ab050 con 0x7f7efc0cb0d0 2023-08-25T04:21:15.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.679+0000 7f7f00807640 1 -- 172.21.15.55:0/900779032 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40af780 con 0x7f7efc0cb0d0 2023-08-25T04:21:15.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.679+0000 7f7f03a6d640 1 -- 172.21.15.55:0/900779032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc0cb0d0 msgr2=0x7f7efc0cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:15.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.679+0000 7f7f03a6d640 1 --2- 172.21.15.55:0/900779032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc0cb0d0 0x7f7efc0cdef0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009e80 tx=0x7f7ef401f1e0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.679+0000 7f7f03a6d640 1 -- 172.21.15.55:0/900779032 shutdown_connections 2023-08-25T04:21:15.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.679+0000 7f7f03a6d640 1 --2- 172.21.15.55:0/900779032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc0cb0d0 0x7f7efc0cdef0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.679+0000 7f7f03a6d640 1 --2- 172.21.15.55:0/900779032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7efc1598e0 0x7f7efc0cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.679+0000 7f7f03a6d640 1 -- 172.21.15.55:0/900779032 >> 172.21.15.55:0/900779032 conn(0x7f7efc0cf4d0 msgr2=0x7f7efc0cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:15.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.679+0000 7f7f03a6d640 1 -- 172.21.15.55:0/900779032 shutdown_connections 2023-08-25T04:21:15.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.679+0000 7f7f03a6d640 1 -- 172.21.15.55:0/900779032 wait complete. 2023-08-25T04:21:15.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f03a6d640 1 Processor -- start 2023-08-25T04:21:15.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f03a6d640 1 -- start start 2023-08-25T04:21:15.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f03a6d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc0cb0d0 0x7f7efc06c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:15.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f03a6d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7efc0cdab0 0x7f7efc06c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:15.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f03a6d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7efc1598e0 0x7f7efc0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:15.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f03a6d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0b0ea0 con 0x7f7efc1598e0 2023-08-25T04:21:15.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f03a6d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0b0290 con 0x7f7efc0cb0d0 2023-08-25T04:21:15.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f03a6d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0b0570 con 0x7f7efc0cdab0 2023-08-25T04:21:15.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f0200a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7efc1598e0 0x7f7efc0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:15.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f0200a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7efc1598e0 0x7f7efc0c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51102/0 (socket says 172.21.15.55:51102) 2023-08-25T04:21:15.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f0200a640 1 -- 172.21.15.55:0/2029983715 learned_addr learned my addr 172.21.15.55:0/2029983715 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f01809640 1 --2- 172.21.15.55:0/2029983715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc0cb0d0 0x7f7efc06c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f01008640 1 --2- 172.21.15.55:0/2029983715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7efc0cdab0 0x7f7efc06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:15.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f0200a640 1 -- 172.21.15.55:0/2029983715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7efc0cdab0 msgr2=0x7f7efc06c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:15.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f0200a640 1 --2- 172.21.15.55:0/2029983715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7efc0cdab0 0x7f7efc06c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f0200a640 1 -- 172.21.15.55:0/2029983715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc0cb0d0 msgr2=0x7f7efc06c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:15.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f0200a640 1 --2- 172.21.15.55:0/2029983715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc0cb0d0 0x7f7efc06c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f0200a640 1 -- 172.21.15.55:0/2029983715 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef4009b30 con 0x7f7efc1598e0 2023-08-25T04:21:15.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f01008640 1 --2- 172.21.15.55:0/2029983715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7efc0cdab0 0x7f7efc06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:15.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f0200a640 1 --2- 172.21.15.55:0/2029983715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7efc1598e0 0x7f7efc0c9fe0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f7ef401bdf0 tx=0x7f7ef401bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:15.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7ef27fc640 1 -- 172.21.15.55:0/2029983715 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40afc90 con 0x7f7efc1598e0 2023-08-25T04:21:15.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7ef27fc640 1 -- 172.21.15.55:0/2029983715 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef40afe10 con 0x7f7efc1598e0 2023-08-25T04:21:15.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7ef27fc640 1 -- 172.21.15.55:0/2029983715 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40b9650 con 0x7f7efc1598e0 2023-08-25T04:21:15.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f03a6d640 1 -- 172.21.15.55:0/2029983715 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7efc0b0850 con 0x7f7efc1598e0 2023-08-25T04:21:15.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.683+0000 7f7f03a6d640 1 -- 172.21.15.55:0/2029983715 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7efc0b1330 con 0x7f7efc1598e0 2023-08-25T04:21:15.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.687+0000 7f7f03a6d640 1 -- 172.21.15.55:0/2029983715 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7efc0b1050 con 0x7f7efc1598e0 2023-08-25T04:21:15.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.687+0000 7f7ef27fc640 1 -- 172.21.15.55:0/2029983715 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f7ef40b6070 con 0x7f7efc1598e0 2023-08-25T04:21:15.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.687+0000 7f7ef27fc640 1 --2- 172.21.15.55:0/2029983715 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f7ee00657d0 0x7f7ee0067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:15.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.687+0000 7f7ef27fc640 1 -- 172.21.15.55:0/2029983715 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6113+0+0 (secure 0 0 0) 0x7f7ef4120ed0 con 0x7f7efc1598e0 2023-08-25T04:21:15.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.687+0000 7f7f01809640 1 --2- 172.21.15.55:0/2029983715 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f7ee00657d0 0x7f7ee0067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:15.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.687+0000 7f7f01809640 1 --2- 172.21.15.55:0/2029983715 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f7ee00657d0 0x7f7ee0067c90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7efc145e80 tx=0x7f7ef8009190 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:15.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.691+0000 7f7ef27fc640 1 -- 172.21.15.55:0/2029983715 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7efc0b1050 con 0x7f7efc1598e0 2023-08-25T04:21:15.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.851+0000 7f7f03a6d640 1 -- 172.21.15.55:0/2029983715 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7efc073ec0 con 0x7f7efc1598e0 2023-08-25T04:21:15.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.851+0000 7f7ef27fc640 1 -- 172.21.15.55:0/2029983715 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v114) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7ef40ee7b0 con 0x7f7efc1598e0 2023-08-25T04:21:15.848 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:21:15.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.851+0000 7f7f03a6d640 1 -- 172.21.15.55:0/2029983715 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f7ee00657d0 msgr2=0x7f7ee0067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:15.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.851+0000 7f7f03a6d640 1 --2- 172.21.15.55:0/2029983715 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f7ee00657d0 0x7f7ee0067c90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7efc145e80 tx=0x7f7ef8009190 comp rx=0 tx=0).stop 2023-08-25T04:21:15.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.851+0000 7f7f03a6d640 1 -- 172.21.15.55:0/2029983715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7efc1598e0 msgr2=0x7f7efc0c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:15.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.851+0000 7f7f03a6d640 1 --2- 172.21.15.55:0/2029983715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7efc1598e0 0x7f7efc0c9fe0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f7ef401bdf0 tx=0x7f7ef401bf80 comp rx=0 tx=0).stop 2023-08-25T04:21:15.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.851+0000 7f7f03a6d640 1 -- 172.21.15.55:0/2029983715 shutdown_connections 2023-08-25T04:21:15.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.851+0000 7f7f03a6d640 1 --2- 172.21.15.55:0/2029983715 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f7ee00657d0 0x7f7ee0067c90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.851+0000 7f7f03a6d640 1 --2- 172.21.15.55:0/2029983715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7efc1598e0 0x7f7efc0c9fe0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.851+0000 7f7f03a6d640 1 --2- 172.21.15.55:0/2029983715 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7efc0cdab0 0x7f7efc06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.851+0000 7f7f03a6d640 1 --2- 172.21.15.55:0/2029983715 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7efc0cb0d0 0x7f7efc06c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:15.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.851+0000 7f7f03a6d640 1 -- 172.21.15.55:0/2029983715 >> 172.21.15.55:0/2029983715 conn(0x7f7efc0cf4d0 msgr2=0x7f7efc0ad9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:15.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.851+0000 7f7f03a6d640 1 -- 172.21.15.55:0/2029983715 shutdown_connections 2023-08-25T04:21:15.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:15.851+0000 7f7f03a6d640 1 -- 172.21.15.55:0/2029983715 wait complete. 2023-08-25T04:21:15.869 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-25T04:21:16.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51bf3e9640 1 Processor -- start 2023-08-25T04:21:16.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51bf3e9640 1 -- start start 2023-08-25T04:21:16.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51bf3e9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b80ce110 0x7f51b80cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:16.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51bf3e9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b80ce5a0 con 0x7f51b815a840 2023-08-25T04:21:16.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51bf3e9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b80ce880 con 0x7f51b80cd620 2023-08-25T04:21:16.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51bf3e9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b80cf640 con 0x7f51b80ce110 2023-08-25T04:21:16.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51bd185640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f51b815a840 0x7f51b80ccf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44982/0 (socket says 172.21.15.55:44982) 2023-08-25T04:21:16.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51bd185640 1 -- 172.21.15.55:0/2134219169 learned_addr learned my addr 172.21.15.55:0/2134219169 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:16.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51affff640 1 -- 172.21.15.55:0/2134219169 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3700401376 0 0) 0x7f51b80ce5a0 con 0x7f51b815a840 2023-08-25T04:21:16.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51bc984640 1 --2- 172.21.15.55:0/2134219169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b80ce110 0x7f51b80cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:16.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51affff640 1 -- 172.21.15.55:0/2134219169 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51a4003530 con 0x7f51b815a840 2023-08-25T04:21:16.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51affff640 1 -- 172.21.15.55:0/2134219169 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 930594042 0 0) 0x7f51a4003530 con 0x7f51b815a840 2023-08-25T04:21:16.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51affff640 1 -- 172.21.15.55:0/2134219169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b80ce110 msgr2=0x7f51b80cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:16.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51affff640 1 --2- 172.21.15.55:0/2134219169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51b80ce110 0x7f51b80cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:16.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51affff640 1 -- 172.21.15.55:0/2134219169 >> v1:172.21.15.110:6789/0 conn(0x7f51b80cd620 legacy=0x7f51b81646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:16.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51affff640 1 -- 172.21.15.55:0/2134219169 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b80ceb60 con 0x7f51b815a840 2023-08-25T04:21:16.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51affff640 1 -- 172.21.15.55:0/2134219169 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f51b4001800 con 0x7f51b815a840 2023-08-25T04:21:16.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51affff640 1 -- 172.21.15.55:0/2134219169 >> v1:172.21.15.55:6789/0 conn(0x7f51b815a840 legacy=0x7f51b80ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:16.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51affff640 1 --2- 172.21.15.55:0/2134219169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51a40039b0 0x7f51a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:16.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51affff640 1 --2- 172.21.15.55:0/2134219169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51a40047d0 0x7f51a4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:16.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51affff640 1 --2- 172.21.15.55:0/2134219169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51a4005190 0x7f51a400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:16.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51affff640 1 -- 172.21.15.55:0/2134219169 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b80cf640 con 0x7f51a40039b0 2023-08-25T04:21:16.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51affff640 1 -- 172.21.15.55:0/2134219169 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a400bed0 con 0x7f51a40047d0 2023-08-25T04:21:16.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51affff640 1 -- 172.21.15.55:0/2134219169 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a400c010 con 0x7f51a4005190 2023-08-25T04:21:16.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51bd185640 1 --2- 172.21.15.55:0/2134219169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51a40039b0 0x7f51a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:16.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51bc984640 1 --2- 172.21.15.55:0/2134219169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51a40047d0 0x7f51a4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51bd986640 1 --2- 172.21.15.55:0/2134219169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51a4005190 0x7f51a400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51bd185640 1 -- 172.21.15.55:0/2134219169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51a4005190 msgr2=0x7f51a400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51bd185640 1 --2- 172.21.15.55:0/2134219169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51a4005190 0x7f51a400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51bd185640 1 -- 172.21.15.55:0/2134219169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51a40047d0 msgr2=0x7f51a4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51bd185640 1 --2- 172.21.15.55:0/2134219169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51a40047d0 0x7f51a4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.019+0000 7f51bd185640 1 -- 172.21.15.55:0/2134219169 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a4003530 con 0x7f51a40039b0 2023-08-25T04:21:16.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.023+0000 7f51bd185640 1 --2- 172.21.15.55:0/2134219169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51a40039b0 0x7f51a4003dd0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f51b400c240 tx=0x7f51b401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81da1872238fb7b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:16.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.023+0000 7f51affff640 1 -- 172.21.15.55:0/2134219169 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b40a5ad0 con 0x7f51a40039b0 2023-08-25T04:21:16.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.023+0000 7f51affff640 1 -- 172.21.15.55:0/2134219169 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b40a5c50 con 0x7f51a40039b0 2023-08-25T04:21:16.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.023+0000 7f51affff640 1 -- 172.21.15.55:0/2134219169 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4007070 con 0x7f51a40039b0 2023-08-25T04:21:16.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.023+0000 7f51bf3e9640 1 -- 172.21.15.55:0/2134219169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51a40039b0 msgr2=0x7f51a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:16.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.023+0000 7f51bf3e9640 1 --2- 172.21.15.55:0/2134219169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51a40039b0 0x7f51a4003dd0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f51b400c240 tx=0x7f51b401cbf0 comp rx=0 tx=0).stop 2023-08-25T04:21:16.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.023+0000 7f51bd986640 1 -- 172.21.15.55:0/2134219169 reap_dead start 2023-08-25T04:21:16.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.023+0000 7f51bf3e9640 1 -- 172.21.15.55:0/2134219169 shutdown_connections 2023-08-25T04:21:16.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.023+0000 7f51bf3e9640 1 -- 172.21.15.55:0/2134219169 >> 172.21.15.55:0/2134219169 conn(0x7f51b80d0540 msgr2=0x7f51b80d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:16.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.023+0000 7f51bf3e9640 1 -- 172.21.15.55:0/2134219169 shutdown_connections 2023-08-25T04:21:16.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.023+0000 7f51bf3e9640 1 -- 172.21.15.55:0/2134219169 wait complete. 2023-08-25T04:21:16.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bf3e9640 1 Processor -- start 2023-08-25T04:21:16.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bf3e9640 1 -- start start 2023-08-25T04:21:16.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bf3e9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51a40039b0 0x7f51b806b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bf3e9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b81565e0 0x7f51b80b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bf3e9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51b8158490 0x7f51b8158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bf3e9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b80b5b40 con 0x7f51b8158490 2023-08-25T04:21:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bf3e9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b8158e50 con 0x7f51b81565e0 2023-08-25T04:21:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bf3e9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b806c550 con 0x7f51a40039b0 2023-08-25T04:21:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bd986640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51b8158490 0x7f51b8158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bd986640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51b8158490 0x7f51b8158910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51130/0 (socket says 172.21.15.55:51130) 2023-08-25T04:21:16.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bd986640 1 -- 172.21.15.55:0/218879687 learned_addr learned my addr 172.21.15.55:0/218879687 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:16.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bd185640 1 --2- 172.21.15.55:0/218879687 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51a40039b0 0x7f51b806b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:16.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bc984640 1 --2- 172.21.15.55:0/218879687 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b81565e0 0x7f51b80b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:16.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bd986640 1 -- 172.21.15.55:0/218879687 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51a40039b0 msgr2=0x7f51b806b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:16.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bd986640 1 --2- 172.21.15.55:0/218879687 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51a40039b0 0x7f51b806b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:16.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bd986640 1 -- 172.21.15.55:0/218879687 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b81565e0 msgr2=0x7f51b80b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:16.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bd986640 1 --2- 172.21.15.55:0/218879687 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b81565e0 0x7f51b80b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:16.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bd986640 1 -- 172.21.15.55:0/218879687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b806c9e0 con 0x7f51b8158490 2023-08-25T04:21:16.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bd986640 1 --2- 172.21.15.55:0/218879687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51b8158490 0x7f51b8158910 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f51b808a6a0 tx=0x7f51b000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:16.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51adffb640 1 -- 172.21.15.55:0/218879687 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b000ee90 con 0x7f51b8158490 2023-08-25T04:21:16.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51adffb640 1 -- 172.21.15.55:0/218879687 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b0003980 con 0x7f51b8158490 2023-08-25T04:21:16.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51adffb640 1 -- 172.21.15.55:0/218879687 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b0003d30 con 0x7f51b8158490 2023-08-25T04:21:16.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.027+0000 7f51bf3e9640 1 -- 172.21.15.55:0/218879687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b806b940 con 0x7f51b8158490 2023-08-25T04:21:16.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.031+0000 7f51bf3e9640 1 -- 172.21.15.55:0/218879687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b806bf00 con 0x7f51b8158490 2023-08-25T04:21:16.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.031+0000 7f51bf3e9640 1 -- 172.21.15.55:0/218879687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b806c6e0 con 0x7f51b8158490 2023-08-25T04:21:16.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.031+0000 7f51adffb640 1 -- 172.21.15.55:0/218879687 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f51b00050d0 con 0x7f51b8158490 2023-08-25T04:21:16.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.031+0000 7f51adffb640 1 --2- 172.21.15.55:0/218879687 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f519c0657a0 0x7f519c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:16.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.031+0000 7f51adffb640 1 -- 172.21.15.55:0/218879687 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6113+0+0 (secure 0 0 0) 0x7f51b0082cd0 con 0x7f51b8158490 2023-08-25T04:21:16.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.031+0000 7f51bd185640 1 --2- 172.21.15.55:0/218879687 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f519c0657a0 0x7f519c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:16.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.031+0000 7f51bd185640 1 --2- 172.21.15.55:0/218879687 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f519c0657a0 0x7f519c067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f51b40ab000 tx=0x7f51b40a7070 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:16.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.035+0000 7f51adffb640 1 -- 172.21.15.55:0/218879687 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f51b00505a0 con 0x7f51b8158490 2023-08-25T04:21:16.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.191+0000 7f51bf3e9640 1 -- 172.21.15.55:0/218879687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f51b80cb3f0 con 0x7f51b8158490 2023-08-25T04:21:16.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.195+0000 7f51adffb640 1 -- 172.21.15.55:0/218879687 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7f51b0053bc0 con 0x7f51b8158490 2023-08-25T04:21:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.199+0000 7f51bf3e9640 1 -- 172.21.15.55:0/218879687 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f519c0657a0 msgr2=0x7f519c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.199+0000 7f51bf3e9640 1 --2- 172.21.15.55:0/218879687 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f519c0657a0 0x7f519c067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f51b40ab000 tx=0x7f51b40a7070 comp rx=0 tx=0).stop 2023-08-25T04:21:16.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.199+0000 7f51bf3e9640 1 -- 172.21.15.55:0/218879687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51b8158490 msgr2=0x7f51b8158910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.199+0000 7f51bf3e9640 1 --2- 172.21.15.55:0/218879687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51b8158490 0x7f51b8158910 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f51b808a6a0 tx=0x7f51b000eb50 comp rx=0 tx=0).stop 2023-08-25T04:21:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.199+0000 7f51bf3e9640 1 -- 172.21.15.55:0/218879687 shutdown_connections 2023-08-25T04:21:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.199+0000 7f51bf3e9640 1 --2- 172.21.15.55:0/218879687 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f519c0657a0 0x7f519c067c60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.199+0000 7f51bf3e9640 1 --2- 172.21.15.55:0/218879687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51b8158490 0x7f51b8158910 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.199+0000 7f51bf3e9640 1 --2- 172.21.15.55:0/218879687 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51b81565e0 0x7f51b80b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:16.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.199+0000 7f51bf3e9640 1 --2- 172.21.15.55:0/218879687 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51a40039b0 0x7f51b806b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.199+0000 7f51bf3e9640 1 -- 172.21.15.55:0/218879687 >> 172.21.15.55:0/218879687 conn(0x7f51b80d0540 msgr2=0x7f51b8159b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.199+0000 7f51bf3e9640 1 -- 172.21.15.55:0/218879687 shutdown_connections 2023-08-25T04:21:16.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.199+0000 7f51bf3e9640 1 -- 172.21.15.55:0/218879687 wait complete. 2023-08-25T04:21:16.216 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T04:21:16.217 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:21:16.298 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:21:16.368 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T04:21:16.368 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:21:16.369 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:21:16.378 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T04:21:16.379 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:21:16.380 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:21:16.390 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:21:16.390 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:21:16.390 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:21:16.426 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T04:21:16.427 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:21:16.427 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:21:16.441 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:21:16.441 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-25T04:21:16.442 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:21:16.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.615+0000 7f65bd166640 1 Processor -- start 2023-08-25T04:21:16.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.615+0000 7f65bd166640 1 -- start start 2023-08-25T04:21:16.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.619+0000 7f65bd166640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f65b80ce220 0x7f65b80b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:16.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.619+0000 7f65bd166640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b80b29b0 con 0x7f65b80cdde0 2023-08-25T04:21:16.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.619+0000 7f65bd166640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b80ce690 con 0x7f65b80d0da0 2023-08-25T04:21:16.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.619+0000 7f65bd166640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b80b1dc0 con 0x7f65b80ce220 2023-08-25T04:21:16.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.619+0000 7f65b759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f65b80ce220 0x7f65b80b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:16.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.619+0000 7f65ae59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f65b80cdde0 0x7f65b80b2e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44998/0 (socket says 172.21.15.55:44998) 2023-08-25T04:21:16.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.619+0000 7f65b759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f65b80ce220 0x7f65b80b3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51134/0 (socket says 172.21.15.55:51134) 2023-08-25T04:21:16.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.619+0000 7f65ae59c640 1 -- 172.21.15.55:0/4176919725 learned_addr learned my addr 172.21.15.55:0/4176919725 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:16.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.619+0000 7f65b759e640 1 -- 172.21.15.55:0/4176919725 >> v1:172.21.15.110:6789/0 conn(0x7f65b80d0da0 legacy=0x7f65b80d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:16.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.619+0000 7f65b759e640 1 -- 172.21.15.55:0/4176919725 >> v1:172.21.15.55:6789/0 conn(0x7f65b80cdde0 legacy=0x7f65b80b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:16.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.619+0000 7f65b759e640 1 -- 172.21.15.55:0/4176919725 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b80b2080 con 0x7f65b80ce220 2023-08-25T04:21:16.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.619+0000 7f65b659c640 1 -- 172.21.15.55:0/4176919725 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284629577 0 0) 0x7f65b80b29b0 con 0x7f65b80cdde0 2023-08-25T04:21:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.619+0000 7f65b759e640 1 --2- 172.21.15.55:0/4176919725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b80ce220 0x7f65b80b3550 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f65b00097c0 tx=0x7f65b001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbcfd0eaa1fd72c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.619+0000 7f65b659c640 1 -- 172.21.15.55:0/4176919725 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00a8970 con 0x7f65b80ce220 2023-08-25T04:21:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.619+0000 7f65b659c640 1 -- 172.21.15.55:0/4176919725 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b00a8ad0 con 0x7f65b80ce220 2023-08-25T04:21:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.619+0000 7f65b659c640 1 -- 172.21.15.55:0/4176919725 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00a8e60 con 0x7f65b80ce220 2023-08-25T04:21:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.623+0000 7f65bd166640 1 -- 172.21.15.55:0/4176919725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b80ce220 msgr2=0x7f65b80b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.623+0000 7f65bd166640 1 --2- 172.21.15.55:0/4176919725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b80ce220 0x7f65b80b3550 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f65b00097c0 tx=0x7f65b001ec70 comp rx=0 tx=0).stop 2023-08-25T04:21:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.623+0000 7f65bd166640 1 -- 172.21.15.55:0/4176919725 shutdown_connections 2023-08-25T04:21:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.623+0000 7f65bd166640 1 --2- 172.21.15.55:0/4176919725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b80ce220 0x7f65b80b3550 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:16.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.623+0000 7f65bd166640 1 -- 172.21.15.55:0/4176919725 >> 172.21.15.55:0/4176919725 conn(0x7f65b809bae0 msgr2=0x7f65b80d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:16.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.623+0000 7f65bd166640 1 -- 172.21.15.55:0/4176919725 shutdown_connections 2023-08-25T04:21:16.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.623+0000 7f65bd166640 1 -- 172.21.15.55:0/4176919725 wait complete. 2023-08-25T04:21:16.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.623+0000 7f65bd166640 1 Processor -- start 2023-08-25T04:21:16.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.623+0000 7f65bd166640 1 -- start start 2023-08-25T04:21:16.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.623+0000 7f65bd166640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b80cdde0 0x7f65b8150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:16.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.623+0000 7f65bd166640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65b80ce220 0x7f65b80b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:16.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.623+0000 7f65bd166640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65b80d0da0 0x7f65b80b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:16.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.623+0000 7f65bd166640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b8151450 con 0x7f65b80cdde0 2023-08-25T04:21:16.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.623+0000 7f65bd166640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b8152250 con 0x7f65b80d0da0 2023-08-25T04:21:16.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.623+0000 7f65bd166640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b8151640 con 0x7f65b80ce220 2023-08-25T04:21:16.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.623+0000 7f65b6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b80cdde0 0x7f65b8150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:16.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.623+0000 7f65b6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b80cdde0 0x7f65b8150f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51138/0 (socket says 172.21.15.55:51138) 2023-08-25T04:21:16.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.623+0000 7f65b6d9d640 1 -- 172.21.15.55:0/3842146784 learned_addr learned my addr 172.21.15.55:0/3842146784 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:16.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.627+0000 7f65b759e640 1 --2- 172.21.15.55:0/3842146784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65b80d0da0 0x7f65b80b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:16.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.627+0000 7f65ae59c640 1 --2- 172.21.15.55:0/3842146784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65b80ce220 0x7f65b80b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:16.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.627+0000 7f65b6d9d640 1 -- 172.21.15.55:0/3842146784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65b80ce220 msgr2=0x7f65b80b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:16.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.627+0000 7f65b6d9d640 1 --2- 172.21.15.55:0/3842146784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65b80ce220 0x7f65b80b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:16.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.627+0000 7f65b6d9d640 1 -- 172.21.15.55:0/3842146784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65b80d0da0 msgr2=0x7f65b80b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:16.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.627+0000 7f65b6d9d640 1 --2- 172.21.15.55:0/3842146784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65b80d0da0 0x7f65b80b5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:16.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.627+0000 7f65b6d9d640 1 -- 172.21.15.55:0/3842146784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b0009420 con 0x7f65b80cdde0 2023-08-25T04:21:16.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.627+0000 7f65ae59c640 1 --2- 172.21.15.55:0/3842146784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65b80ce220 0x7f65b80b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:16.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.627+0000 7f65b6d9d640 1 --2- 172.21.15.55:0/3842146784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b80cdde0 0x7f65b8150f10 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f65a800c450 tx=0x7f65a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:16.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.627+0000 7f65affff640 1 -- 172.21.15.55:0/3842146784 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a80052d0 con 0x7f65b80cdde0 2023-08-25T04:21:16.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.627+0000 7f65affff640 1 -- 172.21.15.55:0/3842146784 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a8005430 con 0x7f65b80cdde0 2023-08-25T04:21:16.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.627+0000 7f65affff640 1 -- 172.21.15.55:0/3842146784 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a8003890 con 0x7f65b80cdde0 2023-08-25T04:21:16.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.627+0000 7f65bd166640 1 -- 172.21.15.55:0/3842146784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b8151920 con 0x7f65b80cdde0 2023-08-25T04:21:16.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.627+0000 7f65bd166640 1 -- 172.21.15.55:0/3842146784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b8151ee0 con 0x7f65b80cdde0 2023-08-25T04:21:16.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.627+0000 7f65bd166640 1 -- 172.21.15.55:0/3842146784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b804dbe0 con 0x7f65b80cdde0 2023-08-25T04:21:16.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.627+0000 7f65affff640 1 -- 172.21.15.55:0/3842146784 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f65a80039f0 con 0x7f65b80cdde0 2023-08-25T04:21:16.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.627+0000 7f65affff640 1 --2- 172.21.15.55:0/3842146784 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f65980657a0 0x7f6598067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:16.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.627+0000 7f65affff640 1 -- 172.21.15.55:0/3842146784 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6113+0+0 (secure 0 0 0) 0x7f65a8082c20 con 0x7f65b80cdde0 2023-08-25T04:21:16.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.631+0000 7f65ae59c640 1 --2- 172.21.15.55:0/3842146784 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f65980657a0 0x7f6598067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:16.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.631+0000 7f65ae59c640 1 --2- 172.21.15.55:0/3842146784 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f65980657a0 0x7f6598067c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f65a0007fd0 tx=0x7f65a0009040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:16.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.631+0000 7f65affff640 1 -- 172.21.15.55:0/3842146784 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f65a80504f0 con 0x7f65b80cdde0 2023-08-25T04:21:16.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.823+0000 7f65bd166640 1 -- 172.21.15.55:0/3842146784 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65b80d0b80 con 0x7f65b80cdde0 2023-08-25T04:21:16.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.827+0000 7f65affff640 1 -- 172.21.15.55:0/3842146784 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f65a8053b10 con 0x7f65b80cdde0 2023-08-25T04:21:16.824 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:16.824 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6662,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/3111804785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3111804785},{"type":"v1","addr":"172.21.15.110:6836","nonce":3111804785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3444442085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3444442085},{"type":"v1","addr":"172.21.15.110:6837","nonce":3444442085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":7857,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2022633620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2022633620},{"type":"v1","addr":"172.21.15.55:6834","nonce":2022633620}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":44},{"gid":8325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3829299687","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3829299687},{"type":"v1","addr":"172.21.15.55:6835","nonce":3829299687}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":51}],"filesystems":[]} 2023-08-25T04:21:16.824 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 51 2023-08-25T04:21:16.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.827+0000 7f65bd166640 1 -- 172.21.15.55:0/3842146784 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f65980657a0 msgr2=0x7f6598067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:16.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.827+0000 7f65bd166640 1 --2- 172.21.15.55:0/3842146784 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f65980657a0 0x7f6598067c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f65a0007fd0 tx=0x7f65a0009040 comp rx=0 tx=0).stop 2023-08-25T04:21:16.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.827+0000 7f65bd166640 1 -- 172.21.15.55:0/3842146784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b80cdde0 msgr2=0x7f65b8150f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:16.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.827+0000 7f65bd166640 1 --2- 172.21.15.55:0/3842146784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b80cdde0 0x7f65b8150f10 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f65a800c450 tx=0x7f65a800c910 comp rx=0 tx=0).stop 2023-08-25T04:21:16.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.827+0000 7f65bd166640 1 -- 172.21.15.55:0/3842146784 shutdown_connections 2023-08-25T04:21:16.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.827+0000 7f65bd166640 1 --2- 172.21.15.55:0/3842146784 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65b80d0da0 0x7f65b80b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:16.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.827+0000 7f65bd166640 1 --2- 172.21.15.55:0/3842146784 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65b80ce220 0x7f65b80b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:16.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.827+0000 7f65bd166640 1 --2- 172.21.15.55:0/3842146784 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f65980657a0 0x7f6598067c60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:16.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.827+0000 7f65bd166640 1 --2- 172.21.15.55:0/3842146784 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65b80cdde0 0x7f65b8150f10 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:16.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.827+0000 7f65bd166640 1 -- 172.21.15.55:0/3842146784 >> 172.21.15.55:0/3842146784 conn(0x7f65b809bae0 msgr2=0x7f65b806c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:16.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.827+0000 7f65bd166640 1 -- 172.21.15.55:0/3842146784 shutdown_connections 2023-08-25T04:21:16.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:16.827+0000 7f65bd166640 1 -- 172.21.15.55:0/3842146784 wait complete. 2023-08-25T04:21:16.845 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-25T04:21:16.846 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-25T04:21:16.846 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-25T04:21:16.846 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:21:16.847 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-25T04:21:16.847 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-25T04:21:16.847 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-25T04:21:16.847 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:21:16.848 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-25T04:21:16.848 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-25T04:21:16.848 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-25T04:21:16.848 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:21:16.849 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-25T04:21:16.849 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-25T04:21:16.849 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-25T04:21:16.849 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:21:16.862 INFO:tasks.ceph.mds.a:Stopped 2023-08-25T04:21:16.862 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-25T04:21:16.863 INFO:tasks.ceph.mds.c:Stopped 2023-08-25T04:21:16.863 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-25T04:21:16.864 INFO:tasks.ceph.mds.b:Stopped 2023-08-25T04:21:16.865 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-25T04:21:16.867 INFO:tasks.ceph.mds.d:Stopped 2023-08-25T04:21:16.867 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-25T04:21:16.906 INFO:tasks.ceph.mds.a:Started 2023-08-25T04:21:16.906 DEBUG:teuthology.parallel:result is None 2023-08-25T04:21:16.908 INFO:tasks.ceph.mds.c:Started 2023-08-25T04:21:16.908 DEBUG:teuthology.parallel:result is None 2023-08-25T04:21:16.916 INFO:tasks.ceph.mds.b:Started 2023-08-25T04:21:16.916 DEBUG:teuthology.parallel:result is None 2023-08-25T04:21:16.918 INFO:tasks.ceph.mds.d:Started 2023-08-25T04:21:16.918 DEBUG:teuthology.parallel:result is None 2023-08-25T04:21:16.919 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-25T04:21:16.994 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-08-25T04:21:16.996 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T04:21:17.011 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2023-08-25T04:21:17.012 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2023-08-25T04:21:17.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.071+0000 7f55d6bba640 1 Processor -- start 2023-08-25T04:21:17.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.071+0000 7f55d6bba640 1 -- start start 2023-08-25T04:21:17.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.071+0000 7f55d6bba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55d00c89f0 0x7f55d00cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.071+0000 7f55d6bba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d00cc880 con 0x7f55d00ad950 2023-08-25T04:21:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.071+0000 7f55d6bba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d00ccb60 con 0x7f55d00ceeb0 2023-08-25T04:21:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.071+0000 7f55d6bba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d00b11f0 con 0x7f55d00c89f0 2023-08-25T04:21:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.075+0000 7f55d4956640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f55d00ad950 0x7f55d00ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45018/0 (socket says 172.21.15.55:45018) 2023-08-25T04:21:17.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.075+0000 7f55d4956640 1 -- 172.21.15.55:0/2326002788 learned_addr learned my addr 172.21.15.55:0/2326002788 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:17.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.075+0000 7f55d5157640 1 --2- 172.21.15.55:0/2326002788 >> v2:172.21.15.110:3300/0 conn(0x7f55d00c89f0 0x7f55d00cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:17.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.075+0000 7f55c77fe640 1 -- 172.21.15.55:0/2326002788 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214254056 0 0) 0x7f55d00cc880 con 0x7f55d00ad950 2023-08-25T04:21:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.075+0000 7f55c77fe640 1 -- 172.21.15.55:0/2326002788 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55b8003530 con 0x7f55d00ad950 2023-08-25T04:21:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.075+0000 7f55c77fe640 1 -- 172.21.15.55:0/2326002788 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1760284435 0 0) 0x7f55b8003530 con 0x7f55d00ad950 2023-08-25T04:21:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.075+0000 7f55d5157640 1 -- 172.21.15.55:0/2326002788 >> v1:172.21.15.110:6789/0 conn(0x7f55d00ceeb0 legacy=0x7f55d00b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:17.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.075+0000 7f55d5157640 1 -- 172.21.15.55:0/2326002788 >> v1:172.21.15.55:6789/0 conn(0x7f55d00ad950 legacy=0x7f55d00ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:17.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.075+0000 7f55d5157640 1 -- 172.21.15.55:0/2326002788 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d00cce40 con 0x7f55d00c89f0 2023-08-25T04:21:17.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.075+0000 7f55d5157640 1 --2- 172.21.15.55:0/2326002788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55d00c89f0 0x7f55d00cc2a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009d90 tx=0x7f55c801c690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=321f85291e412f90 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:17.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.075+0000 7f55c77fe640 1 -- 172.21.15.55:0/2326002788 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc001680 con 0x7f55d00c89f0 2023-08-25T04:21:17.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55c77fe640 1 -- 172.21.15.55:0/2326002788 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c80a9420 con 0x7f55d00c89f0 2023-08-25T04:21:17.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55c77fe640 1 -- 172.21.15.55:0/2326002788 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c80a9790 con 0x7f55d00c89f0 2023-08-25T04:21:17.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d6bba640 1 -- 172.21.15.55:0/2326002788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55d00c89f0 msgr2=0x7f55d00cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:17.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d6bba640 1 --2- 172.21.15.55:0/2326002788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55d00c89f0 0x7f55d00cc2a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f55c8009d90 tx=0x7f55c801c690 comp rx=0 tx=0).stop 2023-08-25T04:21:17.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d6bba640 1 -- 172.21.15.55:0/2326002788 shutdown_connections 2023-08-25T04:21:17.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d6bba640 1 --2- 172.21.15.55:0/2326002788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55d00c89f0 0x7f55d00cc2a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:17.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d6bba640 1 -- 172.21.15.55:0/2326002788 >> 172.21.15.55:0/2326002788 conn(0x7f55d0069d00 msgr2=0x7f55d006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:17.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d6bba640 1 -- 172.21.15.55:0/2326002788 shutdown_connections 2023-08-25T04:21:17.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d6bba640 1 -- 172.21.15.55:0/2326002788 wait complete. 2023-08-25T04:21:17.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d6bba640 1 Processor -- start 2023-08-25T04:21:17.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d6bba640 1 -- start start 2023-08-25T04:21:17.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d6bba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55d00ad950 0x7f55d0071560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:17.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d6bba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55d00c89f0 0x7f55d00acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:17.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d6bba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55d00ceeb0 0x7f55d00937e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:17.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d6bba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d00ac610 con 0x7f55d00ceeb0 2023-08-25T04:21:17.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d6bba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d00acfe0 con 0x7f55d00ad950 2023-08-25T04:21:17.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d6bba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d00aba00 con 0x7f55d00c89f0 2023-08-25T04:21:17.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d5157640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55d00ceeb0 0x7f55d00937e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:17.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d5157640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55d00ceeb0 0x7f55d00937e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51178/0 (socket says 172.21.15.55:51178) 2023-08-25T04:21:17.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d5157640 1 -- 172.21.15.55:0/3311580693 learned_addr learned my addr 172.21.15.55:0/3311580693 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:17.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55d4956640 1 --2- 172.21.15.55:0/3311580693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55d00ad950 0x7f55d0071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:17.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.079+0000 7f55c7fff640 1 --2- 172.21.15.55:0/3311580693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55d00c89f0 0x7f55d00acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:17.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.083+0000 7f55d5157640 1 -- 172.21.15.55:0/3311580693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55d00c89f0 msgr2=0x7f55d00acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:17.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.083+0000 7f55d5157640 1 --2- 172.21.15.55:0/3311580693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55d00c89f0 0x7f55d00acaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:17.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.083+0000 7f55d5157640 1 -- 172.21.15.55:0/3311580693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55d00ad950 msgr2=0x7f55d0071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:17.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.083+0000 7f55d5157640 1 --2- 172.21.15.55:0/3311580693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55d00ad950 0x7f55d0071560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:17.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.083+0000 7f55d5157640 1 -- 172.21.15.55:0/3311580693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c8009a70 con 0x7f55d00ceeb0 2023-08-25T04:21:17.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.083+0000 7f55d4956640 1 --2- 172.21.15.55:0/3311580693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55d00ad950 0x7f55d0071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:17.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.083+0000 7f55d5157640 1 --2- 172.21.15.55:0/3311580693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55d00ceeb0 0x7f55d00937e0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f55c801ad40 tx=0x7f55c8019430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:17.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.083+0000 7f55c57fa640 1 -- 172.21.15.55:0/3311580693 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c80b8070 con 0x7f55d00ceeb0 2023-08-25T04:21:17.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.083+0000 7f55c57fa640 1 -- 172.21.15.55:0/3311580693 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c8003e40 con 0x7f55d00ceeb0 2023-08-25T04:21:17.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.083+0000 7f55d6bba640 1 -- 172.21.15.55:0/3311580693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d00abce0 con 0x7f55d00ceeb0 2023-08-25T04:21:17.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.083+0000 7f55c57fa640 1 -- 172.21.15.55:0/3311580693 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c8004260 con 0x7f55d00ceeb0 2023-08-25T04:21:17.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.083+0000 7f55d6bba640 1 -- 172.21.15.55:0/3311580693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d00ac2a0 con 0x7f55d00ceeb0 2023-08-25T04:21:17.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.083+0000 7f55d6bba640 1 -- 172.21.15.55:0/3311580693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d00ac7c0 con 0x7f55d00ceeb0 2023-08-25T04:21:17.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.083+0000 7f55c57fa640 1 -- 172.21.15.55:0/3311580693 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f55c80043c0 con 0x7f55d00ceeb0 2023-08-25T04:21:17.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.083+0000 7f55c57fa640 1 --2- 172.21.15.55:0/3311580693 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f55bc0657f0 0x7f55bc067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:17.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.083+0000 7f55c57fa640 1 -- 172.21.15.55:0/3311580693 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6113+0+0 (secure 0 0 0) 0x7f55c811d9b0 con 0x7f55d00ceeb0 2023-08-25T04:21:17.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.087+0000 7f55d4956640 1 --2- 172.21.15.55:0/3311580693 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f55bc0657f0 0x7f55bc067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:17.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.087+0000 7f55d4956640 1 --2- 172.21.15.55:0/3311580693 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f55bc0657f0 0x7f55bc067cb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f55cc001ec0 tx=0x7f55cc001c90 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:17.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.087+0000 7f55c57fa640 1 -- 172.21.15.55:0/3311580693 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f55d00ac7c0 con 0x7f55d00ceeb0 2023-08-25T04:21:17.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.255+0000 7f55d6bba640 1 -- 172.21.15.55:0/3311580693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f55d00ac7c0 con 0x7f55d00ceeb0 2023-08-25T04:21:17.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.843+0000 7f55c57fa640 1 -- 172.21.15.55:0/3311580693 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v116) v1 ==== 97+0+0 (secure 0 0 0) 0x7f55d00ac7c0 con 0x7f55d00ceeb0 2023-08-25T04:21:17.843 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-08-25T04:21:17.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.847+0000 7f55d6bba640 1 -- 172.21.15.55:0/3311580693 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f55bc0657f0 msgr2=0x7f55bc067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:17.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.847+0000 7f55d6bba640 1 --2- 172.21.15.55:0/3311580693 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f55bc0657f0 0x7f55bc067cb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f55cc001ec0 tx=0x7f55cc001c90 comp rx=0 tx=0).stop 2023-08-25T04:21:17.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.847+0000 7f55d6bba640 1 -- 172.21.15.55:0/3311580693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55d00ceeb0 msgr2=0x7f55d00937e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:17.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.847+0000 7f55d6bba640 1 --2- 172.21.15.55:0/3311580693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55d00ceeb0 0x7f55d00937e0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f55c801ad40 tx=0x7f55c8019430 comp rx=0 tx=0).stop 2023-08-25T04:21:17.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.847+0000 7f55d6bba640 1 -- 172.21.15.55:0/3311580693 shutdown_connections 2023-08-25T04:21:17.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.847+0000 7f55d6bba640 1 --2- 172.21.15.55:0/3311580693 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f55bc0657f0 0x7f55bc067cb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:17.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.847+0000 7f55d6bba640 1 --2- 172.21.15.55:0/3311580693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55d00ceeb0 0x7f55d00937e0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:17.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.847+0000 7f55d6bba640 1 --2- 172.21.15.55:0/3311580693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55d00c89f0 0x7f55d00acaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:17.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.847+0000 7f55d6bba640 1 --2- 172.21.15.55:0/3311580693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55d00ad950 0x7f55d0071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:17.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.847+0000 7f55d6bba640 1 -- 172.21.15.55:0/3311580693 >> 172.21.15.55:0/3311580693 conn(0x7f55d0069d00 msgr2=0x7f55d00ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:17.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.847+0000 7f55d6bba640 1 -- 172.21.15.55:0/3311580693 shutdown_connections 2023-08-25T04:21:17.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:17.847+0000 7f55d6bba640 1 -- 172.21.15.55:0/3311580693 wait complete. 2023-08-25T04:21:17.870 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-25T04:21:18.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.019+0000 7f654572c640 1 Processor -- start 2023-08-25T04:21:18.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.019+0000 7f654572c640 1 -- start start 2023-08-25T04:21:18.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.019+0000 7f654572c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f65400cdde0 0x7f65400ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:18.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.019+0000 7f654572c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65400b29b0 con 0x7f65400d0da0 2023-08-25T04:21:18.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.019+0000 7f654572c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65400b1dc0 con 0x7f65400b2e40 2023-08-25T04:21:18.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.019+0000 7f654572c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65400ce760 con 0x7f65400cdde0 2023-08-25T04:21:18.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.019+0000 7f653effd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f65400d0da0 0x7f65400d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45024/0 (socket says 172.21.15.55:45024) 2023-08-25T04:21:18.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.019+0000 7f653effd640 1 -- 172.21.15.55:0/501600132 learned_addr learned my addr 172.21.15.55:0/501600132 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:18.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.019+0000 7f65367fc640 1 --2- 172.21.15.55:0/501600132 >> v2:172.21.15.110:3300/0 conn(0x7f65400cdde0 0x7f65400ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:18.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.019+0000 7f653e7fc640 1 -- 172.21.15.55:0/501600132 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994837655 0 0) 0x7f65400b29b0 con 0x7f65400d0da0 2023-08-25T04:21:18.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.019+0000 7f653e7fc640 1 -- 172.21.15.55:0/501600132 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f652c003530 con 0x7f65400d0da0 2023-08-25T04:21:18.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.019+0000 7f65367fc640 1 -- 172.21.15.55:0/501600132 >> v1:172.21.15.110:6789/0 conn(0x7f65400b2e40 legacy=0x7f65400b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:18.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.019+0000 7f65367fc640 1 -- 172.21.15.55:0/501600132 >> v1:172.21.15.55:6789/0 conn(0x7f65400d0da0 legacy=0x7f65400d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:18.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.019+0000 7f65367fc640 1 -- 172.21.15.55:0/501600132 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65400b2080 con 0x7f65400cdde0 2023-08-25T04:21:18.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.023+0000 7f65367fc640 1 --2- 172.21.15.55:0/501600132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65400cdde0 0x7f65400ce220 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6528009d90 tx=0x7f652801f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a06924e5ac48cc92 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.023+0000 7f653e7fc640 1 -- 172.21.15.55:0/501600132 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65280af600 con 0x7f65400cdde0 2023-08-25T04:21:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.023+0000 7f653e7fc640 1 -- 172.21.15.55:0/501600132 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65280ab050 con 0x7f65400cdde0 2023-08-25T04:21:18.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.023+0000 7f653e7fc640 1 -- 172.21.15.55:0/501600132 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65280af980 con 0x7f65400cdde0 2023-08-25T04:21:18.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.023+0000 7f654572c640 1 -- 172.21.15.55:0/501600132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65400cdde0 msgr2=0x7f65400ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:18.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.023+0000 7f654572c640 1 --2- 172.21.15.55:0/501600132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65400cdde0 0x7f65400ce220 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6528009d90 tx=0x7f652801f130 comp rx=0 tx=0).stop 2023-08-25T04:21:18.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.023+0000 7f654572c640 1 -- 172.21.15.55:0/501600132 shutdown_connections 2023-08-25T04:21:18.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.023+0000 7f654572c640 1 --2- 172.21.15.55:0/501600132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65400cdde0 0x7f65400ce220 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.023+0000 7f654572c640 1 -- 172.21.15.55:0/501600132 >> 172.21.15.55:0/501600132 conn(0x7f654009bae0 msgr2=0x7f65400d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:18.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f654572c640 1 -- 172.21.15.55:0/501600132 shutdown_connections 2023-08-25T04:21:18.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f654572c640 1 -- 172.21.15.55:0/501600132 wait complete. 2023-08-25T04:21:18.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f654572c640 1 Processor -- start 2023-08-25T04:21:18.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f654572c640 1 -- start start 2023-08-25T04:21:18.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f654572c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65400b2e40 0x7f65401f1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:18.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f654572c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65400cdde0 0x7f65400caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f654572c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65400d0da0 0x7f65400cf010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f654572c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6540155ed0 con 0x7f65400d0da0 2023-08-25T04:21:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f654572c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65400ca5d0 con 0x7f65400cdde0 2023-08-25T04:21:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f654572c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65400c99c0 con 0x7f65400b2e40 2023-08-25T04:21:18.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f653f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65400d0da0 0x7f65400cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f653f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65400d0da0 0x7f65400cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51194/0 (socket says 172.21.15.55:51194) 2023-08-25T04:21:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f653f7fe640 1 -- 172.21.15.55:0/1807581124 learned_addr learned my addr 172.21.15.55:0/1807581124 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f653effd640 1 --2- 172.21.15.55:0/1807581124 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65400b2e40 0x7f65401f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f65367fc640 1 --2- 172.21.15.55:0/1807581124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65400cdde0 0x7f65400caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f653f7fe640 1 -- 172.21.15.55:0/1807581124 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65400b2e40 msgr2=0x7f65401f1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f653f7fe640 1 --2- 172.21.15.55:0/1807581124 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65400b2e40 0x7f65401f1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f653f7fe640 1 -- 172.21.15.55:0/1807581124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65400cdde0 msgr2=0x7f65400caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f653f7fe640 1 --2- 172.21.15.55:0/1807581124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65400cdde0 0x7f65400caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f653f7fe640 1 -- 172.21.15.55:0/1807581124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6528009a70 con 0x7f65400d0da0 2023-08-25T04:21:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f653effd640 1 --2- 172.21.15.55:0/1807581124 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65400b2e40 0x7f65401f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.027+0000 7f653f7fe640 1 --2- 172.21.15.55:0/1807581124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65400d0da0 0x7f65400cf010 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f653800c430 tx=0x7f653800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.031+0000 7f6537fff640 1 -- 172.21.15.55:0/1807581124 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538005220 con 0x7f65400d0da0 2023-08-25T04:21:18.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.031+0000 7f6537fff640 1 -- 172.21.15.55:0/1807581124 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6538005380 con 0x7f65400d0da0 2023-08-25T04:21:18.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.031+0000 7f654572c640 1 -- 172.21.15.55:0/1807581124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65400c9ca0 con 0x7f65400d0da0 2023-08-25T04:21:18.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.031+0000 7f6537fff640 1 -- 172.21.15.55:0/1807581124 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538007270 con 0x7f65400d0da0 2023-08-25T04:21:18.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.031+0000 7f654572c640 1 -- 172.21.15.55:0/1807581124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65400ca260 con 0x7f65400d0da0 2023-08-25T04:21:18.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.031+0000 7f654572c640 1 -- 172.21.15.55:0/1807581124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65400ca740 con 0x7f65400d0da0 2023-08-25T04:21:18.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.031+0000 7f6537fff640 1 -- 172.21.15.55:0/1807581124 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f65380073d0 con 0x7f65400d0da0 2023-08-25T04:21:18.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.031+0000 7f6537fff640 1 --2- 172.21.15.55:0/1807581124 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f65200657d0 0x7f6520067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:18.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.031+0000 7f6537fff640 1 -- 172.21.15.55:0/1807581124 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6538082120 con 0x7f65400d0da0 2023-08-25T04:21:18.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.031+0000 7f653effd640 1 --2- 172.21.15.55:0/1807581124 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f65200657d0 0x7f6520067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:18.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.035+0000 7f653effd640 1 --2- 172.21.15.55:0/1807581124 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f65200657d0 0x7f6520067c90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f65300010f0 tx=0x7f6530009040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:18.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.035+0000 7f6537fff640 1 -- 172.21.15.55:0/1807581124 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f653804fd80 con 0x7f65400d0da0 2023-08-25T04:21:18.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.247+0000 7f654572c640 1 -- 172.21.15.55:0/1807581124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f65400b2330 con 0x7f65400d0da0 2023-08-25T04:21:18.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.247+0000 7f6537fff640 1 -- 172.21.15.55:0/1807581124 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f65380533a0 con 0x7f65400d0da0 2023-08-25T04:21:18.245 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:18.245 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T04:21:18.245 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-08-25T04:21:18.245 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.246 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-08-25T04:21:18.246 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkgFrTEBAAoan9rk8Q+qPyMjb2vGUHhA==", 2023-08-25T04:21:18.246 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.246 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:21:18.246 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:21:18.246 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:21:18.246 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:21:18.247 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.247 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:18.247 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.247 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-08-25T04:21:18.247 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk18hNHRAAzXuhzQEONXRzRXTeCH9fKQ==", 2023-08-25T04:21:18.247 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.247 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:21:18.247 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:21:18.248 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:21:18.248 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:21:18.248 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.248 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:18.248 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.248 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-08-25T04:21:18.248 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkLF9CGBAAqxgRU/02SsZfWuZPSYxuZA==", 2023-08-25T04:21:18.249 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.249 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:21:18.249 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:21:18.249 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:21:18.249 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:21:18.250 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.250 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:18.250 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.250 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-08-25T04:21:18.250 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hky6HiJBAAsrXlTDn2cxbk7PnqSgNNkA==", 2023-08-25T04:21:18.250 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.250 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:21:18.251 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:21:18.251 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:21:18.251 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:21:18.251 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.251 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:18.252 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.252 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-08-25T04:21:18.252 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC+J+hkY1tDFBAAVQY5Xl8On9pN3jLWwKWGTA==", 2023-08-25T04:21:18.252 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.252 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:21:18.252 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:21:18.252 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:21:18.253 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.253 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:18.253 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.253 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-08-25T04:21:18.253 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDBJ+hkpdBCHRAADyMAxTsnQfkD9G0p48H4zQ==", 2023-08-25T04:21:18.253 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.253 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:21:18.254 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:21:18.254 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:21:18.254 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.254 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:18.254 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.254 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-08-25T04:21:18.255 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDEJ+hkOR49KRAAudbqAxLItsoczide8ybzAg==", 2023-08-25T04:21:18.255 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.255 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:21:18.255 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:21:18.255 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:21:18.256 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.256 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:18.256 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.256 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-08-25T04:21:18.257 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDHJ+hkxun5MBAAAhGtJYVeL3ogL3TQV67diw==", 2023-08-25T04:21:18.257 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.257 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:21:18.257 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:21:18.257 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:21:18.257 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.258 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:18.258 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.258 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-08-25T04:21:18.258 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDMJ+hkuosTCRAAqCuwHFZFBVR/7nFtHHByNg==", 2023-08-25T04:21:18.258 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.258 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:21:18.259 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:21:18.259 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:21:18.259 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.259 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:18.259 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.259 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-08-25T04:21:18.259 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDPJ+hkJa+SDhAAllo6biVE99BZWvv5K/gXGw==", 2023-08-25T04:21:18.259 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.260 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:21:18.260 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:21:18.260 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:21:18.260 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.260 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:18.261 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.261 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-08-25T04:21:18.261 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDSJ+hkUPywFBAA4jua1Eu1nRl2L6hX/mycfw==", 2023-08-25T04:21:18.261 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.261 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:21:18.262 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:21:18.262 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:21:18.262 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.262 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:18.262 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.262 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-08-25T04:21:18.262 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDVJ+hkhyDMGxAAmcSWLzJqIE5w5H/E4wIurQ==", 2023-08-25T04:21:18.263 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.263 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:21:18.263 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:21:18.263 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:21:18.263 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.263 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:18.263 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.264 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-08-25T04:21:18.264 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g==", 2023-08-25T04:21:18.264 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.264 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:21:18.264 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-08-25T04:21:18.264 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-25T04:21:18.264 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.265 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:18.265 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.265 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-08-25T04:21:18.265 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk8KsDMxAAKyK4jMKflYNnJXYIbr2OBQ==", 2023-08-25T04:21:18.265 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.265 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:21:18.265 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:21:18.265 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:21:18.266 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:21:18.266 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.266 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:18.266 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.266 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-08-25T04:21:18.266 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjSA4LxAAxzbnHeV85qYZYhSqTOT2rw==", 2023-08-25T04:21:18.266 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.266 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:21:18.267 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:21:18.267 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:21:18.267 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:21:18.267 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.267 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:18.267 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.267 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-08-25T04:21:18.268 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkl9AoORAARYZcPObsM/HT/yrTmneZrw==", 2023-08-25T04:21:18.268 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.268 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:21:18.268 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:21:18.268 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:21:18.268 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:21:18.268 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.269 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:18.269 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.269 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-08-25T04:21:18.269 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC2J+hkgTdcLxAAqxSepXXhEultFAFYBBKSag==", 2023-08-25T04:21:18.269 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.269 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:21:18.269 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:21:18.269 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:21:18.270 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:21:18.270 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.270 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:18.270 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.270 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-08-25T04:21:18.270 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkYGUZDBAAiuDo9hqavWq7zQlGd6x4YQ==", 2023-08-25T04:21:18.270 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.270 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:21:18.271 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T04:21:18.271 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:21:18.271 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.271 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:18.271 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:18.272 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-08-25T04:21:18.272 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjr9KCBAApSqjtFhLnjHduMBu/eaaKw==", 2023-08-25T04:21:18.272 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:21:18.272 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:21:18.272 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T04:21:18.272 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:21:18.272 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.273 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:18.273 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-08-25T04:21:18.273 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T04:21:18.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.247+0000 7f654572c640 1 -- 172.21.15.55:0/1807581124 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f65200657d0 msgr2=0x7f6520067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.247+0000 7f654572c640 1 --2- 172.21.15.55:0/1807581124 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f65200657d0 0x7f6520067c90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f65300010f0 tx=0x7f6530009040 comp rx=0 tx=0).stop 2023-08-25T04:21:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.247+0000 7f654572c640 1 -- 172.21.15.55:0/1807581124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65400d0da0 msgr2=0x7f65400cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.247+0000 7f654572c640 1 --2- 172.21.15.55:0/1807581124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65400d0da0 0x7f65400cf010 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f653800c430 tx=0x7f653800c8f0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.247+0000 7f654572c640 1 -- 172.21.15.55:0/1807581124 shutdown_connections 2023-08-25T04:21:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.247+0000 7f654572c640 1 --2- 172.21.15.55:0/1807581124 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f65200657d0 0x7f6520067c90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.247+0000 7f654572c640 1 --2- 172.21.15.55:0/1807581124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65400d0da0 0x7f65400cf010 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.247+0000 7f654572c640 1 --2- 172.21.15.55:0/1807581124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f65400cdde0 0x7f65400caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.247+0000 7f654572c640 1 --2- 172.21.15.55:0/1807581124 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f65400b2e40 0x7f65401f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.247+0000 7f654572c640 1 -- 172.21.15.55:0/1807581124 >> 172.21.15.55:0/1807581124 conn(0x7f654009bae0 msgr2=0x7f65400b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:18.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.247+0000 7f654572c640 1 -- 172.21.15.55:0/1807581124 shutdown_connections 2023-08-25T04:21:18.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.247+0000 7f654572c640 1 -- 172.21.15.55:0/1807581124 wait complete. 2023-08-25T04:21:18.278 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:21:18.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.423+0000 7f86c0d37640 1 Processor -- start 2023-08-25T04:21:18.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.423+0000 7f86c0d37640 1 -- start start 2023-08-25T04:21:18.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.427+0000 7f86c0d37640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86bc0cfa70 0x7f86bc160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:18.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.427+0000 7f86c0d37640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86bc06b2b0 0x7f86bc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:18.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.427+0000 7f86c0d37640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86bc06eaf0 con 0x7f86bc15c9c0 2023-08-25T04:21:18.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.427+0000 7f86c0d37640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86bc06e530 con 0x7f86bc0cfa70 2023-08-25T04:21:18.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.427+0000 7f86c0d37640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc06e810 con 0x7f86bc06b2b0 2023-08-25T04:21:18.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.427+0000 7f86b3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86bc0cfa70 0x7f86bc160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:18.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.427+0000 7f86b3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86bc0cfa70 0x7f86bc160c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51202/0 (socket says 172.21.15.55:51202) 2023-08-25T04:21:18.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.427+0000 7f86b3fff640 1 -- 172.21.15.55:0/2537344280 learned_addr learned my addr 172.21.15.55:0/2537344280 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:18.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.427+0000 7f86bad9d640 1 --2- 172.21.15.55:0/2537344280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86bc06b2b0 0x7f86bc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:18.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.427+0000 7f86b3fff640 1 -- 172.21.15.55:0/2537344280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86bc06b2b0 msgr2=0x7f86bc06b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:18.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.427+0000 7f86b3fff640 1 --2- 172.21.15.55:0/2537344280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86bc06b2b0 0x7f86bc06b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.427+0000 7f86b3fff640 1 -- 172.21.15.55:0/2537344280 >> v1:172.21.15.110:6789/0 conn(0x7f86bc15c9c0 legacy=0x7f86bc160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:18.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.427+0000 7f86b3fff640 1 -- 172.21.15.55:0/2537344280 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86bc06aab0 con 0x7f86bc0cfa70 2023-08-25T04:21:18.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.431+0000 7f86b3fff640 1 --2- 172.21.15.55:0/2537344280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86bc0cfa70 0x7f86bc160c20 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009870 tx=0x7f86a401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279fcc1639a0ec4d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:18.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.431+0000 7f86b9d9b640 1 -- 172.21.15.55:0/2537344280 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a40aa430 con 0x7f86bc0cfa70 2023-08-25T04:21:18.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.431+0000 7f86b9d9b640 1 -- 172.21.15.55:0/2537344280 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a40aa590 con 0x7f86bc0cfa70 2023-08-25T04:21:18.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.431+0000 7f86b9d9b640 1 -- 172.21.15.55:0/2537344280 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a40aa920 con 0x7f86bc0cfa70 2023-08-25T04:21:18.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.431+0000 7f86c0d37640 1 -- 172.21.15.55:0/2537344280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86bc0cfa70 msgr2=0x7f86bc160c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:18.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.431+0000 7f86c0d37640 1 --2- 172.21.15.55:0/2537344280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86bc0cfa70 0x7f86bc160c20 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f86a4009870 tx=0x7f86a401c510 comp rx=0 tx=0).stop 2023-08-25T04:21:18.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.431+0000 7f86c0d37640 1 -- 172.21.15.55:0/2537344280 shutdown_connections 2023-08-25T04:21:18.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.431+0000 7f86c0d37640 1 --2- 172.21.15.55:0/2537344280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86bc06b2b0 0x7f86bc06b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.431+0000 7f86c0d37640 1 --2- 172.21.15.55:0/2537344280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86bc0cfa70 0x7f86bc160c20 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.431+0000 7f86c0d37640 1 -- 172.21.15.55:0/2537344280 >> 172.21.15.55:0/2537344280 conn(0x7f86bc0d05a0 msgr2=0x7f86bc0d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:18.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.431+0000 7f86c0d37640 1 -- 172.21.15.55:0/2537344280 shutdown_connections 2023-08-25T04:21:18.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.431+0000 7f86c0d37640 1 -- 172.21.15.55:0/2537344280 wait complete. 2023-08-25T04:21:18.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.431+0000 7f86c0d37640 1 Processor -- start 2023-08-25T04:21:18.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.431+0000 7f86c0d37640 1 -- start start 2023-08-25T04:21:18.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86c0d37640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86bc06b2b0 0x7f86bc155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:18.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86c0d37640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86bc0cfa70 0x7f86bc14fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:18.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86c0d37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86bc15c9c0 0x7f86bc1f92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:18.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86c0d37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc1f8880 con 0x7f86bc15c9c0 2023-08-25T04:21:18.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86c0d37640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc14c8e0 con 0x7f86bc06b2b0 2023-08-25T04:21:18.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86c0d37640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc152620 con 0x7f86bc0cfa70 2023-08-25T04:21:18.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86bad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86bc15c9c0 0x7f86bc1f92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:18.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86bad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86bc15c9c0 0x7f86bc1f92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51204/0 (socket says 172.21.15.55:51204) 2023-08-25T04:21:18.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86bad9d640 1 -- 172.21.15.55:0/1402460126 learned_addr learned my addr 172.21.15.55:0/1402460126 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:18.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86ba59c640 1 --2- 172.21.15.55:0/1402460126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86bc06b2b0 0x7f86bc155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:18.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86b3fff640 1 --2- 172.21.15.55:0/1402460126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86bc0cfa70 0x7f86bc14fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:18.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86bad9d640 1 -- 172.21.15.55:0/1402460126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86bc0cfa70 msgr2=0x7f86bc14fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:18.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86bad9d640 1 --2- 172.21.15.55:0/1402460126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86bc0cfa70 0x7f86bc14fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86bad9d640 1 -- 172.21.15.55:0/1402460126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86bc06b2b0 msgr2=0x7f86bc155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:18.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86bad9d640 1 --2- 172.21.15.55:0/1402460126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86bc06b2b0 0x7f86bc155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86bad9d640 1 -- 172.21.15.55:0/1402460126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a40094d0 con 0x7f86bc15c9c0 2023-08-25T04:21:18.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86bad9d640 1 --2- 172.21.15.55:0/1402460126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86bc15c9c0 0x7f86bc1f92d0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f86b400efc0 tx=0x7f86b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:18.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86b2ffd640 1 -- 172.21.15.55:0/1402460126 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4014480 con 0x7f86bc15c9c0 2023-08-25T04:21:18.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86b2ffd640 1 -- 172.21.15.55:0/1402460126 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b400f040 con 0x7f86bc15c9c0 2023-08-25T04:21:18.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86c0d37640 1 -- 172.21.15.55:0/1402460126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86bc152900 con 0x7f86bc15c9c0 2023-08-25T04:21:18.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86b2ffd640 1 -- 172.21.15.55:0/1402460126 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4014820 con 0x7f86bc15c9c0 2023-08-25T04:21:18.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86c0d37640 1 -- 172.21.15.55:0/1402460126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86bc1f8db0 con 0x7f86bc15c9c0 2023-08-25T04:21:18.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86c0d37640 1 -- 172.21.15.55:0/1402460126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86bc161140 con 0x7f86bc15c9c0 2023-08-25T04:21:18.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.435+0000 7f86b2ffd640 1 -- 172.21.15.55:0/1402460126 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f86b4014980 con 0x7f86bc15c9c0 2023-08-25T04:21:18.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.439+0000 7f86b2ffd640 1 --2- 172.21.15.55:0/1402460126 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f869c0657a0 0x7f869c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:18.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.439+0000 7f86b2ffd640 1 -- 172.21.15.55:0/1402460126 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f86b4083790 con 0x7f86bc15c9c0 2023-08-25T04:21:18.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.439+0000 7f86ba59c640 1 --2- 172.21.15.55:0/1402460126 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f869c0657a0 0x7f869c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:18.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.439+0000 7f86ba59c640 1 --2- 172.21.15.55:0/1402460126 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f869c0657a0 0x7f869c067c60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f86ac000fc0 tx=0x7f86ac009040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:18.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.443+0000 7f86b2ffd640 1 -- 172.21.15.55:0/1402460126 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f86bc161140 con 0x7f86bc15c9c0 2023-08-25T04:21:18.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.599+0000 7f86c0d37640 1 -- 172.21.15.55:0/1402460126 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86bc161140 con 0x7f86bc15c9c0 2023-08-25T04:21:18.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.599+0000 7f86b2ffd640 1 -- 172.21.15.55:0/1402460126 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+14661 (secure 0 0 0) 0x7f86bc161140 con 0x7f86bc15c9c0 2023-08-25T04:21:18.598 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:18.599 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":118,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:21:17.853183+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":109,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:21:18.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.603+0000 7f86c0d37640 1 -- 172.21.15.55:0/1402460126 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f869c0657a0 msgr2=0x7f869c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:18.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.603+0000 7f86c0d37640 1 --2- 172.21.15.55:0/1402460126 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f869c0657a0 0x7f869c067c60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f86ac000fc0 tx=0x7f86ac009040 comp rx=0 tx=0).stop 2023-08-25T04:21:18.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.603+0000 7f86c0d37640 1 -- 172.21.15.55:0/1402460126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86bc15c9c0 msgr2=0x7f86bc1f92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:18.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.603+0000 7f86c0d37640 1 --2- 172.21.15.55:0/1402460126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86bc15c9c0 0x7f86bc1f92d0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f86b400efc0 tx=0x7f86b400c490 comp rx=0 tx=0).stop 2023-08-25T04:21:18.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.603+0000 7f86c0d37640 1 -- 172.21.15.55:0/1402460126 shutdown_connections 2023-08-25T04:21:18.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.603+0000 7f86c0d37640 1 --2- 172.21.15.55:0/1402460126 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f869c0657a0 0x7f869c067c60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.603+0000 7f86c0d37640 1 --2- 172.21.15.55:0/1402460126 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86bc15c9c0 0x7f86bc1f92d0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.603+0000 7f86c0d37640 1 --2- 172.21.15.55:0/1402460126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86bc0cfa70 0x7f86bc14fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.603+0000 7f86c0d37640 1 --2- 172.21.15.55:0/1402460126 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86bc06b2b0 0x7f86bc155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.603+0000 7f86c0d37640 1 -- 172.21.15.55:0/1402460126 >> 172.21.15.55:0/1402460126 conn(0x7f86bc0d05a0 msgr2=0x7f86bc0ad170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:18.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.603+0000 7f86c0d37640 1 -- 172.21.15.55:0/1402460126 shutdown_connections 2023-08-25T04:21:18.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.603+0000 7f86c0d37640 1 -- 172.21.15.55:0/1402460126 wait complete. 2023-08-25T04:21:18.620 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:21:18.621 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:21:18.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe391fa640 1 Processor -- start 2023-08-25T04:21:18.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe391fa640 1 -- start start 2023-08-25T04:21:18.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe391fa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efe341601f0 0x7efe3415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:18.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe391fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe3415e3c0 0x7efe340d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:18.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe391fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe340d10c0 0x7efe340b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:18.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe391fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe340cd5a0 con 0x7efe340d10c0 2023-08-25T04:21:18.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe391fa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe340cd880 con 0x7efe341601f0 2023-08-25T04:21:18.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe391fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe340cdb60 con 0x7efe3415e3c0 2023-08-25T04:21:18.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe3359e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe340d10c0 0x7efe340b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:18.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe3359e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe340d10c0 0x7efe340b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51212/0 (socket says 172.21.15.55:51212) 2023-08-25T04:21:18.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe3359e640 1 -- 172.21.15.55:0/883511194 learned_addr learned my addr 172.21.15.55:0/883511194 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:18.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe3259c640 1 --2- 172.21.15.55:0/883511194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe3415e3c0 0x7efe340d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:18.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe32d9d640 1 --2- 172.21.15.55:0/883511194 >> v2:172.21.15.110:3300/0 conn(0x7efe341601f0 0x7efe3415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:18.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe3359e640 1 -- 172.21.15.55:0/883511194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe3415e3c0 msgr2=0x7efe340d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:18.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe3359e640 1 --2- 172.21.15.55:0/883511194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe3415e3c0 0x7efe340d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe3359e640 1 -- 172.21.15.55:0/883511194 >> v2:172.21.15.110:3300/0 conn(0x7efe341601f0 msgr2=0x7efe3415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:18.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe3359e640 1 --2- 172.21.15.55:0/883511194 >> v2:172.21.15.110:3300/0 conn(0x7efe341601f0 0x7efe3415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe3359e640 1 -- 172.21.15.55:0/883511194 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe340cde40 con 0x7efe340d10c0 2023-08-25T04:21:18.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.771+0000 7efe3259c640 1 --2- 172.21.15.55:0/883511194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe3415e3c0 0x7efe340d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:18.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.775+0000 7efe3359e640 1 --2- 172.21.15.55:0/883511194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe340d10c0 0x7efe340b4250 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7efe3408b7f0 tx=0x7efe2c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b5b06537cc65da server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:18.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.775+0000 7efe31d9b640 1 -- 172.21.15.55:0/883511194 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c0af400 con 0x7efe340d10c0 2023-08-25T04:21:18.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.775+0000 7efe31d9b640 1 -- 172.21.15.55:0/883511194 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c0ab050 con 0x7efe340d10c0 2023-08-25T04:21:18.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.775+0000 7efe31d9b640 1 -- 172.21.15.55:0/883511194 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c0af780 con 0x7efe340d10c0 2023-08-25T04:21:18.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.775+0000 7efe391fa640 1 -- 172.21.15.55:0/883511194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe340d10c0 msgr2=0x7efe340b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:18.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.775+0000 7efe391fa640 1 --2- 172.21.15.55:0/883511194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe340d10c0 0x7efe340b4250 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7efe3408b7f0 tx=0x7efe2c01f1c0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.775+0000 7efe391fa640 1 -- 172.21.15.55:0/883511194 shutdown_connections 2023-08-25T04:21:18.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.775+0000 7efe391fa640 1 --2- 172.21.15.55:0/883511194 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe340d10c0 0x7efe340b4250 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.775+0000 7efe391fa640 1 --2- 172.21.15.55:0/883511194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe3415e3c0 0x7efe340d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.775+0000 7efe391fa640 1 --2- 172.21.15.55:0/883511194 >> v2:172.21.15.110:3300/0 conn(0x7efe341601f0 0x7efe3415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.775+0000 7efe391fa640 1 -- 172.21.15.55:0/883511194 >> 172.21.15.55:0/883511194 conn(0x7efe340d27d0 msgr2=0x7efe340d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:18.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.775+0000 7efe391fa640 1 -- 172.21.15.55:0/883511194 shutdown_connections 2023-08-25T04:21:18.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.775+0000 7efe391fa640 1 -- 172.21.15.55:0/883511194 wait complete. 2023-08-25T04:21:18.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe391fa640 1 Processor -- start 2023-08-25T04:21:18.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe391fa640 1 -- start start 2023-08-25T04:21:18.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe391fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe340d10c0 0x7efe341f1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:18.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe391fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe3415e3c0 0x7efe340c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:18.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe391fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe341601f0 0x7efe3414d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:18.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe391fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3409c930 con 0x7efe3415e3c0 2023-08-25T04:21:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe391fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe341f2010 con 0x7efe340d10c0 2023-08-25T04:21:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe391fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3414b990 con 0x7efe341601f0 2023-08-25T04:21:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe3259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe3415e3c0 0x7efe340c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe3259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe3415e3c0 0x7efe340c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51214/0 (socket says 172.21.15.55:51214) 2023-08-25T04:21:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe3259c640 1 -- 172.21.15.55:0/1823718898 learned_addr learned my addr 172.21.15.55:0/1823718898 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe3359e640 1 --2- 172.21.15.55:0/1823718898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe341601f0 0x7efe3414d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:18.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe32d9d640 1 --2- 172.21.15.55:0/1823718898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe340d10c0 0x7efe341f1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:18.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe3259c640 1 -- 172.21.15.55:0/1823718898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe341601f0 msgr2=0x7efe3414d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:18.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe3259c640 1 --2- 172.21.15.55:0/1823718898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe341601f0 0x7efe3414d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe3259c640 1 -- 172.21.15.55:0/1823718898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe340d10c0 msgr2=0x7efe341f1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:18.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe3259c640 1 --2- 172.21.15.55:0/1823718898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe340d10c0 0x7efe341f1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe3259c640 1 -- 172.21.15.55:0/1823718898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c009b30 con 0x7efe3415e3c0 2023-08-25T04:21:18.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe3359e640 1 --2- 172.21.15.55:0/1823718898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe341601f0 0x7efe3414d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:18.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe32d9d640 1 --2- 172.21.15.55:0/1823718898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe340d10c0 0x7efe341f1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:18.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe3259c640 1 --2- 172.21.15.55:0/1823718898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe3415e3c0 0x7efe340c8270 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7efe2800e810 tx=0x7efe2800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:18.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe1b7fe640 1 -- 172.21.15.55:0/1823718898 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe28004030 con 0x7efe3415e3c0 2023-08-25T04:21:18.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe1b7fe640 1 -- 172.21.15.55:0/1823718898 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe28004190 con 0x7efe3415e3c0 2023-08-25T04:21:18.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe1b7fe640 1 -- 172.21.15.55:0/1823718898 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe28004520 con 0x7efe3415e3c0 2023-08-25T04:21:18.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe391fa640 1 -- 172.21.15.55:0/1823718898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe340ce7c0 con 0x7efe3415e3c0 2023-08-25T04:21:18.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe391fa640 1 -- 172.21.15.55:0/1823718898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe340c9010 con 0x7efe3415e3c0 2023-08-25T04:21:18.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.779+0000 7efe391fa640 1 -- 172.21.15.55:0/1823718898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3414bc00 con 0x7efe3415e3c0 2023-08-25T04:21:18.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.783+0000 7efe1b7fe640 1 -- 172.21.15.55:0/1823718898 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7efe2800c670 con 0x7efe3415e3c0 2023-08-25T04:21:18.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.783+0000 7efe1b7fe640 1 --2- 172.21.15.55:0/1823718898 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7efe200657a0 0x7efe20067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:18.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.783+0000 7efe1b7fe640 1 -- 172.21.15.55:0/1823718898 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efe28082900 con 0x7efe3415e3c0 2023-08-25T04:21:18.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.783+0000 7efe32d9d640 1 --2- 172.21.15.55:0/1823718898 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7efe200657a0 0x7efe20067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:18.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.783+0000 7efe32d9d640 1 --2- 172.21.15.55:0/1823718898 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7efe200657a0 0x7efe20067c60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efe24006fd0 tx=0x7efe24008040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:18.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.787+0000 7efe1b7fe640 1 -- 172.21.15.55:0/1823718898 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7efe280504e0 con 0x7efe3415e3c0 2023-08-25T04:21:18.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.947+0000 7efe391fa640 1 -- 172.21.15.55:0/1823718898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe340b5260 con 0x7efe3415e3c0 2023-08-25T04:21:18.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.947+0000 7efe1b7fe640 1 -- 172.21.15.55:0/1823718898 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v118) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe280200a0 con 0x7efe3415e3c0 2023-08-25T04:21:18.946 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:21:18.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.951+0000 7efe391fa640 1 -- 172.21.15.55:0/1823718898 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7efe200657a0 msgr2=0x7efe20067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:18.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.951+0000 7efe391fa640 1 --2- 172.21.15.55:0/1823718898 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7efe200657a0 0x7efe20067c60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efe24006fd0 tx=0x7efe24008040 comp rx=0 tx=0).stop 2023-08-25T04:21:18.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.951+0000 7efe391fa640 1 -- 172.21.15.55:0/1823718898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe3415e3c0 msgr2=0x7efe340c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:18.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.951+0000 7efe391fa640 1 --2- 172.21.15.55:0/1823718898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe3415e3c0 0x7efe340c8270 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7efe2800e810 tx=0x7efe2800ecd0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.951+0000 7efe391fa640 1 -- 172.21.15.55:0/1823718898 shutdown_connections 2023-08-25T04:21:18.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.951+0000 7efe391fa640 1 --2- 172.21.15.55:0/1823718898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe341601f0 0x7efe3414d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.951+0000 7efe391fa640 1 --2- 172.21.15.55:0/1823718898 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7efe200657a0 0x7efe20067c60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.951+0000 7efe391fa640 1 --2- 172.21.15.55:0/1823718898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe3415e3c0 0x7efe340c8270 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.951+0000 7efe391fa640 1 --2- 172.21.15.55:0/1823718898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe340d10c0 0x7efe341f1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:18.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.951+0000 7efe391fa640 1 -- 172.21.15.55:0/1823718898 >> 172.21.15.55:0/1823718898 conn(0x7efe340d27d0 msgr2=0x7efe3406aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:18.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.951+0000 7efe391fa640 1 -- 172.21.15.55:0/1823718898 shutdown_connections 2023-08-25T04:21:18.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:18.951+0000 7efe391fa640 1 -- 172.21.15.55:0/1823718898 wait complete. 2023-08-25T04:21:18.967 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:21:19.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.115+0000 7f470da5b640 1 Processor -- start 2023-08-25T04:21:19.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.115+0000 7f470da5b640 1 -- start start 2023-08-25T04:21:19.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.119+0000 7f470da5b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f470815fca0 0x7f47080cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:19.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.119+0000 7f470da5b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f47080b8330 0x7f47080cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:19.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.119+0000 7f470da5b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47080d0bd0 0x7f47080d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:19.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.119+0000 7f470da5b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4708160080 con 0x7f470815fca0 2023-08-25T04:21:19.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.119+0000 7f470da5b640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47080b70c0 con 0x7f47080b8330 2023-08-25T04:21:19.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.119+0000 7f470da5b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47080b73a0 con 0x7f47080d0bd0 2023-08-25T04:21:19.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.119+0000 7f470ca59640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f470815fca0 0x7f47080cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:19.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.119+0000 7f470ca59640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f470815fca0 0x7f47080cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51228/0 (socket says 172.21.15.55:51228) 2023-08-25T04:21:19.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.119+0000 7f470ca59640 1 -- 172.21.15.55:0/3183028817 learned_addr learned my addr 172.21.15.55:0/3183028817 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:19.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.119+0000 7f4707fff640 1 --2- 172.21.15.55:0/3183028817 >> v2:172.21.15.110:3300/0 conn(0x7f47080b8330 0x7f47080cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:19.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.119+0000 7f470d25a640 1 --2- 172.21.15.55:0/3183028817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47080d0bd0 0x7f47080d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:19.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.119+0000 7f470ca59640 1 -- 172.21.15.55:0/3183028817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47080d0bd0 msgr2=0x7f47080d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:19.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.119+0000 7f470ca59640 1 --2- 172.21.15.55:0/3183028817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47080d0bd0 0x7f47080d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.119+0000 7f470ca59640 1 -- 172.21.15.55:0/3183028817 >> v2:172.21.15.110:3300/0 conn(0x7f47080b8330 msgr2=0x7f47080cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:19.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.119+0000 7f470ca59640 1 --2- 172.21.15.55:0/3183028817 >> v2:172.21.15.110:3300/0 conn(0x7f47080b8330 0x7f47080cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.119+0000 7f470ca59640 1 -- 172.21.15.55:0/3183028817 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47080b7680 con 0x7f470815fca0 2023-08-25T04:21:19.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.119+0000 7f470d25a640 1 --2- 172.21.15.55:0/3183028817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47080d0bd0 0x7f47080d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:19.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.123+0000 7f470ca59640 1 --2- 172.21.15.55:0/3183028817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f470815fca0 0x7f47080cf580 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f47080b4170 tx=0x7f46fc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124c17e63a3a308d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:19.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.123+0000 7f47077fe640 1 -- 172.21.15.55:0/3183028817 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc0a89b0 con 0x7f470815fca0 2023-08-25T04:21:19.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.123+0000 7f47077fe640 1 -- 172.21.15.55:0/3183028817 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc0a8b10 con 0x7f470815fca0 2023-08-25T04:21:19.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.123+0000 7f47077fe640 1 -- 172.21.15.55:0/3183028817 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc0a8ea0 con 0x7f470815fca0 2023-08-25T04:21:19.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.123+0000 7f470da5b640 1 -- 172.21.15.55:0/3183028817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f470815fca0 msgr2=0x7f47080cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:19.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.123+0000 7f470da5b640 1 --2- 172.21.15.55:0/3183028817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f470815fca0 0x7f47080cf580 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f47080b4170 tx=0x7f46fc01ecf0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.123+0000 7f470da5b640 1 -- 172.21.15.55:0/3183028817 shutdown_connections 2023-08-25T04:21:19.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.123+0000 7f470da5b640 1 --2- 172.21.15.55:0/3183028817 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47080d0bd0 0x7f47080d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.123+0000 7f470da5b640 1 --2- 172.21.15.55:0/3183028817 >> v2:172.21.15.110:3300/0 conn(0x7f47080b8330 0x7f47080cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.123+0000 7f470da5b640 1 --2- 172.21.15.55:0/3183028817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f470815fca0 0x7f47080cf580 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.123+0000 7f470da5b640 1 -- 172.21.15.55:0/3183028817 >> 172.21.15.55:0/3183028817 conn(0x7f47080658c0 msgr2=0x7f4708065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:19.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.123+0000 7f470da5b640 1 -- 172.21.15.55:0/3183028817 shutdown_connections 2023-08-25T04:21:19.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.123+0000 7f470da5b640 1 -- 172.21.15.55:0/3183028817 wait complete. 2023-08-25T04:21:19.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.123+0000 7f470da5b640 1 Processor -- start 2023-08-25T04:21:19.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.123+0000 7f470da5b640 1 -- start start 2023-08-25T04:21:19.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470da5b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47080b8330 0x7f470814ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:19.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470da5b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47080d0bd0 0x7f4708151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:19.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470da5b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f470815fca0 0x7f470814fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:19.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470da5b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47080c6280 con 0x7f47080b8330 2023-08-25T04:21:19.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470da5b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47080c6560 con 0x7f470815fca0 2023-08-25T04:21:19.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470da5b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47080c6840 con 0x7f47080d0bd0 2023-08-25T04:21:19.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470ca59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47080b8330 0x7f470814ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:19.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470ca59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47080b8330 0x7f470814ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51240/0 (socket says 172.21.15.55:51240) 2023-08-25T04:21:19.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470ca59640 1 -- 172.21.15.55:0/1518366455 learned_addr learned my addr 172.21.15.55:0/1518366455 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:19.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470d25a640 1 --2- 172.21.15.55:0/1518366455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f470815fca0 0x7f470814fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:19.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f4707fff640 1 --2- 172.21.15.55:0/1518366455 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47080d0bd0 0x7f4708151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:19.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470ca59640 1 -- 172.21.15.55:0/1518366455 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47080d0bd0 msgr2=0x7f4708151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:19.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470ca59640 1 --2- 172.21.15.55:0/1518366455 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47080d0bd0 0x7f4708151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470ca59640 1 -- 172.21.15.55:0/1518366455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f470815fca0 msgr2=0x7f470814fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:19.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470ca59640 1 --2- 172.21.15.55:0/1518366455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f470815fca0 0x7f470814fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470ca59640 1 -- 172.21.15.55:0/1518366455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc0094d0 con 0x7f47080b8330 2023-08-25T04:21:19.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470d25a640 1 --2- 172.21.15.55:0/1518366455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f470815fca0 0x7f470814fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:19.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470ca59640 1 --2- 172.21.15.55:0/1518366455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47080b8330 0x7f470814ccd0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f46fc01d3a0 tx=0x7f46fc01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:19.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f47057fa640 1 -- 172.21.15.55:0/1518366455 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc0ba600 con 0x7f47080b8330 2023-08-25T04:21:19.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f47057fa640 1 -- 172.21.15.55:0/1518366455 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc0ba760 con 0x7f47080b8330 2023-08-25T04:21:19.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f47057fa640 1 -- 172.21.15.55:0/1518366455 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc0bab10 con 0x7f47080b8330 2023-08-25T04:21:19.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470da5b640 1 -- 172.21.15.55:0/1518366455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47080c6b20 con 0x7f47080b8330 2023-08-25T04:21:19.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470da5b640 1 -- 172.21.15.55:0/1518366455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4708153fc0 con 0x7f47080b8330 2023-08-25T04:21:19.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f470da5b640 1 -- 172.21.15.55:0/1518366455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4708073e50 con 0x7f47080b8330 2023-08-25T04:21:19.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.127+0000 7f47057fa640 1 -- 172.21.15.55:0/1518366455 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f46fc0bac70 con 0x7f47080b8330 2023-08-25T04:21:19.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.131+0000 7f47057fa640 1 --2- 172.21.15.55:0/1518366455 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f46ec0657a0 0x7f46ec067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:19.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.131+0000 7f47057fa640 1 -- 172.21.15.55:0/1518366455 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f46fc121220 con 0x7f47080b8330 2023-08-25T04:21:19.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.131+0000 7f4707fff640 1 --2- 172.21.15.55:0/1518366455 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f46ec0657a0 0x7f46ec067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:19.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.131+0000 7f4707fff640 1 --2- 172.21.15.55:0/1518366455 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f46ec0657a0 0x7f46ec067c60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f470815e1c0 tx=0x7f46f4008040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:19.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.135+0000 7f47057fa640 1 -- 172.21.15.55:0/1518366455 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f46fc0eee80 con 0x7f47080b8330 2023-08-25T04:21:19.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.287+0000 7f470da5b640 1 -- 172.21.15.55:0/1518366455 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f47080c6980 con 0x7f47080b8330 2023-08-25T04:21:19.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.291+0000 7f47057fa640 1 -- 172.21.15.55:0/1518366455 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v118) v1 ==== 92+0+10 (secure 0 0 0) 0x7f47080c6980 con 0x7f47080b8330 2023-08-25T04:21:19.289 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:21:19.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.291+0000 7f470da5b640 1 -- 172.21.15.55:0/1518366455 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f46ec0657a0 msgr2=0x7f46ec067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:19.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.291+0000 7f470da5b640 1 --2- 172.21.15.55:0/1518366455 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f46ec0657a0 0x7f46ec067c60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f470815e1c0 tx=0x7f46f4008040 comp rx=0 tx=0).stop 2023-08-25T04:21:19.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.291+0000 7f470da5b640 1 -- 172.21.15.55:0/1518366455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47080b8330 msgr2=0x7f470814ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:19.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.291+0000 7f470da5b640 1 --2- 172.21.15.55:0/1518366455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47080b8330 0x7f470814ccd0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f46fc01d3a0 tx=0x7f46fc01ba90 comp rx=0 tx=0).stop 2023-08-25T04:21:19.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.291+0000 7f470da5b640 1 -- 172.21.15.55:0/1518366455 shutdown_connections 2023-08-25T04:21:19.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.291+0000 7f470da5b640 1 --2- 172.21.15.55:0/1518366455 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f470815fca0 0x7f470814fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.291+0000 7f470da5b640 1 --2- 172.21.15.55:0/1518366455 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47080d0bd0 0x7f4708151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.291+0000 7f470da5b640 1 --2- 172.21.15.55:0/1518366455 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f46ec0657a0 0x7f46ec067c60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.291+0000 7f470da5b640 1 --2- 172.21.15.55:0/1518366455 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47080b8330 0x7f470814ccd0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.291+0000 7f470da5b640 1 -- 172.21.15.55:0/1518366455 >> 172.21.15.55:0/1518366455 conn(0x7f47080658c0 msgr2=0x7f47080d2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.291+0000 7f470da5b640 1 -- 172.21.15.55:0/1518366455 shutdown_connections 2023-08-25T04:21:19.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.291+0000 7f470da5b640 1 -- 172.21.15.55:0/1518366455 wait complete. 2023-08-25T04:21:19.309 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-25T04:21:19.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.455+0000 7f156106d640 1 Processor -- start 2023-08-25T04:21:19.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.455+0000 7f156106d640 1 -- start start 2023-08-25T04:21:19.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.455+0000 7f156106d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f155c06c2c0 0x7f155c167840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:19.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.455+0000 7f156106d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c161330 con 0x7f155c0cfa70 2023-08-25T04:21:19.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.455+0000 7f156106d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c06eaf0 con 0x7f155c15c9c0 2023-08-25T04:21:19.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.455+0000 7f156106d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155c06e530 con 0x7f155c06c2c0 2023-08-25T04:21:19.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.455+0000 7f155259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f155c0cfa70 0x7f155c160c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45036/0 (socket says 172.21.15.55:45036) 2023-08-25T04:21:19.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.455+0000 7f155259c640 1 -- 172.21.15.55:0/2607503624 learned_addr learned my addr 172.21.15.55:0/2607503624 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:19.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.455+0000 7f155b59e640 1 --2- 172.21.15.55:0/2607503624 >> v2:172.21.15.110:3300/0 conn(0x7f155c06c2c0 0x7f155c167840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.459+0000 7f155a59c640 1 -- 172.21.15.55:0/2607503624 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136583984 0 0) 0x7f155c161330 con 0x7f155c0cfa70 2023-08-25T04:21:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.459+0000 7f155a59c640 1 -- 172.21.15.55:0/2607503624 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f153c003530 con 0x7f155c0cfa70 2023-08-25T04:21:19.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.459+0000 7f155b59e640 1 -- 172.21.15.55:0/2607503624 >> v1:172.21.15.110:6789/0 conn(0x7f155c15c9c0 legacy=0x7f155c160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:19.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.459+0000 7f155a59c640 1 -- 172.21.15.55:0/2607503624 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970641354 0 0) 0x7f155c06eaf0 con 0x7f155c15c9c0 2023-08-25T04:21:19.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.459+0000 7f155b59e640 1 -- 172.21.15.55:0/2607503624 >> v1:172.21.15.55:6789/0 conn(0x7f155c0cfa70 legacy=0x7f155c160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:19.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.459+0000 7f155b59e640 1 -- 172.21.15.55:0/2607503624 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c06e810 con 0x7f155c06c2c0 2023-08-25T04:21:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.459+0000 7f155b59e640 1 --2- 172.21.15.55:0/2607503624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f155c06c2c0 0x7f155c167840 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1554009d90 tx=0x7f155401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2eaa1dc48a963f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.459+0000 7f155a59c640 1 -- 172.21.15.55:0/2607503624 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15540a59e0 con 0x7f155c06c2c0 2023-08-25T04:21:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.459+0000 7f155a59c640 1 -- 172.21.15.55:0/2607503624 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15540a5b40 con 0x7f155c06c2c0 2023-08-25T04:21:19.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.459+0000 7f155a59c640 1 -- 172.21.15.55:0/2607503624 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15540ad440 con 0x7f155c06c2c0 2023-08-25T04:21:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f156106d640 1 -- 172.21.15.55:0/2607503624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f155c06c2c0 msgr2=0x7f155c167840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f156106d640 1 --2- 172.21.15.55:0/2607503624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f155c06c2c0 0x7f155c167840 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1554009d90 tx=0x7f155401c920 comp rx=0 tx=0).stop 2023-08-25T04:21:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f156106d640 1 -- 172.21.15.55:0/2607503624 shutdown_connections 2023-08-25T04:21:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f156106d640 1 --2- 172.21.15.55:0/2607503624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f155c06c2c0 0x7f155c167840 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f156106d640 1 -- 172.21.15.55:0/2607503624 >> 172.21.15.55:0/2607503624 conn(0x7f155c0d05a0 msgr2=0x7f155c0d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f156106d640 1 -- 172.21.15.55:0/2607503624 shutdown_connections 2023-08-25T04:21:19.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f156106d640 1 -- 172.21.15.55:0/2607503624 wait complete. 2023-08-25T04:21:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f156106d640 1 Processor -- start 2023-08-25T04:21:19.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f156106d640 1 -- start start 2023-08-25T04:21:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f156106d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f155c06c2c0 0x7f155c15b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f156106d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155c0cfa70 0x7f155c15f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:19.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f156106d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f155c15c9c0 0x7f155c14bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:19.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f156106d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c15db60 con 0x7f155c0cfa70 2023-08-25T04:21:19.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f156106d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c15de40 con 0x7f155c15c9c0 2023-08-25T04:21:19.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f156106d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c15cf20 con 0x7f155c06c2c0 2023-08-25T04:21:19.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f155259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155c0cfa70 0x7f155c15f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:19.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f155259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155c0cfa70 0x7f155c15f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51248/0 (socket says 172.21.15.55:51248) 2023-08-25T04:21:19.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f155259c640 1 -- 172.21.15.55:0/1295269674 learned_addr learned my addr 172.21.15.55:0/1295269674 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f155b59e640 1 --2- 172.21.15.55:0/1295269674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f155c15c9c0 0x7f155c14bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f155259c640 1 -- 172.21.15.55:0/1295269674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f155c06c2c0 msgr2=0x7f155c15b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.463+0000 7f155ad9d640 1 --2- 172.21.15.55:0/1295269674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f155c06c2c0 0x7f155c15b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.467+0000 7f155259c640 1 --2- 172.21.15.55:0/1295269674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f155c06c2c0 0x7f155c15b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.467+0000 7f155259c640 1 -- 172.21.15.55:0/1295269674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f155c15c9c0 msgr2=0x7f155c14bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.467+0000 7f155259c640 1 --2- 172.21.15.55:0/1295269674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f155c15c9c0 0x7f155c14bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.467+0000 7f155259c640 1 -- 172.21.15.55:0/1295269674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1554009a70 con 0x7f155c0cfa70 2023-08-25T04:21:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.467+0000 7f155b59e640 1 --2- 172.21.15.55:0/1295269674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f155c15c9c0 0x7f155c14bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.467+0000 7f155ad9d640 1 --2- 172.21.15.55:0/1295269674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f155c06c2c0 0x7f155c15b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.467+0000 7f155259c640 1 --2- 172.21.15.55:0/1295269674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155c0cfa70 0x7f155c15f580 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f154c00c3c0 tx=0x7f154c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:19.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.467+0000 7f1553fff640 1 -- 172.21.15.55:0/1295269674 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c005cf0 con 0x7f155c0cfa70 2023-08-25T04:21:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.467+0000 7f1553fff640 1 -- 172.21.15.55:0/1295269674 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c005e50 con 0x7f155c0cfa70 2023-08-25T04:21:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.467+0000 7f1553fff640 1 -- 172.21.15.55:0/1295269674 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c0072f0 con 0x7f155c0cfa70 2023-08-25T04:21:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.467+0000 7f156106d640 1 -- 172.21.15.55:0/1295269674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155c15d1c0 con 0x7f155c0cfa70 2023-08-25T04:21:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.467+0000 7f156106d640 1 -- 172.21.15.55:0/1295269674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155c15d780 con 0x7f155c0cfa70 2023-08-25T04:21:19.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.467+0000 7f156106d640 1 -- 172.21.15.55:0/1295269674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155c15dca0 con 0x7f155c0cfa70 2023-08-25T04:21:19.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.467+0000 7f1553fff640 1 -- 172.21.15.55:0/1295269674 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f154c007450 con 0x7f155c0cfa70 2023-08-25T04:21:19.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.467+0000 7f1553fff640 1 --2- 172.21.15.55:0/1295269674 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f15400657a0 0x7f1540067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:19.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.467+0000 7f1553fff640 1 -- 172.21.15.55:0/1295269674 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f154c082220 con 0x7f155c0cfa70 2023-08-25T04:21:19.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.471+0000 7f155ad9d640 1 --2- 172.21.15.55:0/1295269674 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f15400657a0 0x7f1540067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:19.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.471+0000 7f155ad9d640 1 --2- 172.21.15.55:0/1295269674 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f15400657a0 0x7f1540067c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1544000fc0 tx=0x7f1544009040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:19.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.471+0000 7f1553fff640 1 -- 172.21.15.55:0/1295269674 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f155c15dca0 con 0x7f155c0cfa70 2023-08-25T04:21:19.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.631+0000 7f156106d640 1 -- 172.21.15.55:0/1295269674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f155c15dca0 con 0x7f155c0cfa70 2023-08-25T04:21:19.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.631+0000 7f1553fff640 1 -- 172.21.15.55:0/1295269674 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v118) v1 ==== 84+0+126 (secure 0 0 0) 0x7f154c017090 con 0x7f155c0cfa70 2023-08-25T04:21:19.629 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:19.630 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T04:21:19.630 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:19.630 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-08-25T04:21:19.630 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-08-25T04:21:19.631 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:21:19.631 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:19.631 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-08-25T04:21:19.632 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-08-25T04:21:19.632 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:19.632 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T04:21:19.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.631+0000 7f156106d640 1 -- 172.21.15.55:0/1295269674 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f15400657a0 msgr2=0x7f1540067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:19.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.631+0000 7f156106d640 1 --2- 172.21.15.55:0/1295269674 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f15400657a0 0x7f1540067c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1544000fc0 tx=0x7f1544009040 comp rx=0 tx=0).stop 2023-08-25T04:21:19.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.631+0000 7f156106d640 1 -- 172.21.15.55:0/1295269674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155c0cfa70 msgr2=0x7f155c15f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:19.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.631+0000 7f156106d640 1 --2- 172.21.15.55:0/1295269674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155c0cfa70 0x7f155c15f580 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f154c00c3c0 tx=0x7f154c00c880 comp rx=0 tx=0).stop 2023-08-25T04:21:19.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.631+0000 7f156106d640 1 -- 172.21.15.55:0/1295269674 shutdown_connections 2023-08-25T04:21:19.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.631+0000 7f156106d640 1 --2- 172.21.15.55:0/1295269674 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f155c15c9c0 0x7f155c14bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.631+0000 7f156106d640 1 --2- 172.21.15.55:0/1295269674 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f15400657a0 0x7f1540067c60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.631+0000 7f156106d640 1 --2- 172.21.15.55:0/1295269674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f155c0cfa70 0x7f155c15f580 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.631+0000 7f156106d640 1 --2- 172.21.15.55:0/1295269674 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f155c06c2c0 0x7f155c15b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.631+0000 7f156106d640 1 -- 172.21.15.55:0/1295269674 >> 172.21.15.55:0/1295269674 conn(0x7f155c0d05a0 msgr2=0x7f155c1574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:19.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.631+0000 7f156106d640 1 -- 172.21.15.55:0/1295269674 shutdown_connections 2023-08-25T04:21:19.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.631+0000 7f156106d640 1 -- 172.21.15.55:0/1295269674 wait complete. 2023-08-25T04:21:19.650 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-25T04:21:19.651 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-25T04:21:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.799+0000 7f72ec3e1640 1 Processor -- start 2023-08-25T04:21:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.799+0000 7f72ec3e1640 1 -- start start 2023-08-25T04:21:19.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.799+0000 7f72ec3e1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e406c3f0 0x7f72e40b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:19.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.799+0000 7f72ec3e1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e4160660 con 0x7f72e40ce2c0 2023-08-25T04:21:19.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.799+0000 7f72ec3e1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72e406c880 con 0x7f72e415cf60 2023-08-25T04:21:19.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.799+0000 7f72ec3e1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e40b30c0 con 0x7f72e406c3f0 2023-08-25T04:21:19.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.803+0000 7f72ea17d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f72e40ce2c0 0x7f72e40ce6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45044/0 (socket says 172.21.15.55:45044) 2023-08-25T04:21:19.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.803+0000 7f72ea17d640 1 -- 172.21.15.55:0/361790512 learned_addr learned my addr 172.21.15.55:0/361790512 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:19.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.803+0000 7f72e997c640 1 --2- 172.21.15.55:0/361790512 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e406c3f0 0x7f72e40b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:19.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.803+0000 7f72e917b640 1 -- 172.21.15.55:0/361790512 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214936552 0 0) 0x7f72e4160660 con 0x7f72e40ce2c0 2023-08-25T04:21:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.803+0000 7f72e917b640 1 -- 172.21.15.55:0/361790512 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72d0003530 con 0x7f72e40ce2c0 2023-08-25T04:21:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.803+0000 7f72e917b640 1 -- 172.21.15.55:0/361790512 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675595047 0 0) 0x7f72e406c880 con 0x7f72e415cf60 2023-08-25T04:21:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.803+0000 7f72e917b640 1 -- 172.21.15.55:0/361790512 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72e4160660 con 0x7f72e415cf60 2023-08-25T04:21:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.803+0000 7f72e997c640 1 -- 172.21.15.55:0/361790512 >> v1:172.21.15.110:6789/0 conn(0x7f72e415cf60 legacy=0x7f72e415d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.803+0000 7f72e997c640 1 -- 172.21.15.55:0/361790512 >> v1:172.21.15.55:6789/0 conn(0x7f72e40ce2c0 legacy=0x7f72e40ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.803+0000 7f72e997c640 1 -- 172.21.15.55:0/361790512 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e41608b0 con 0x7f72e406c3f0 2023-08-25T04:21:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.803+0000 7f72e997c640 1 --2- 172.21.15.55:0/361790512 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e406c3f0 0x7f72e40b2b80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f72d40097f0 tx=0x7f72d401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb5d212b30e85afd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72e917b640 1 -- 172.21.15.55:0/361790512 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d40ab600 con 0x7f72e406c3f0 2023-08-25T04:21:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72e917b640 1 -- 172.21.15.55:0/361790512 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d40ab760 con 0x7f72e406c3f0 2023-08-25T04:21:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72e917b640 1 -- 172.21.15.55:0/361790512 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d40abaf0 con 0x7f72e406c3f0 2023-08-25T04:21:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72ec3e1640 1 -- 172.21.15.55:0/361790512 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e406c3f0 msgr2=0x7f72e40b2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72ec3e1640 1 --2- 172.21.15.55:0/361790512 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e406c3f0 0x7f72e40b2b80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f72d40097f0 tx=0x7f72d401c400 comp rx=0 tx=0).stop 2023-08-25T04:21:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72ec3e1640 1 -- 172.21.15.55:0/361790512 shutdown_connections 2023-08-25T04:21:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72ec3e1640 1 --2- 172.21.15.55:0/361790512 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e406c3f0 0x7f72e40b2b80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72ec3e1640 1 -- 172.21.15.55:0/361790512 >> 172.21.15.55:0/361790512 conn(0x7f72e406dd60 msgr2=0x7f72e406e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72ec3e1640 1 -- 172.21.15.55:0/361790512 shutdown_connections 2023-08-25T04:21:19.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72ec3e1640 1 -- 172.21.15.55:0/361790512 wait complete. 2023-08-25T04:21:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72ec3e1640 1 Processor -- start 2023-08-25T04:21:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72ec3e1640 1 -- start start 2023-08-25T04:21:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72ec3e1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72e40ce2c0 0x7f72e41495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72ec3e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72e415cf60 0x7f72e40b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72ec3e1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e415fb30 0x7f72e4157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72ec3e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e4151b80 con 0x7f72e415cf60 2023-08-25T04:21:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72ec3e1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e4149d90 con 0x7f72e40ce2c0 2023-08-25T04:21:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72ec3e1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e415f640 con 0x7f72e415fb30 2023-08-25T04:21:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72e997c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72e415cf60 0x7f72e40b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72e997c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72e415cf60 0x7f72e40b01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51252/0 (socket says 172.21.15.55:51252) 2023-08-25T04:21:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.807+0000 7f72e997c640 1 -- 172.21.15.55:0/303724925 learned_addr learned my addr 172.21.15.55:0/303724925 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72ea17d640 1 --2- 172.21.15.55:0/303724925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72e40ce2c0 0x7f72e41495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72ea97e640 1 --2- 172.21.15.55:0/303724925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e415fb30 0x7f72e4157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72e997c640 1 -- 172.21.15.55:0/303724925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e415fb30 msgr2=0x7f72e4157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72e997c640 1 --2- 172.21.15.55:0/303724925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e415fb30 0x7f72e4157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72e997c640 1 -- 172.21.15.55:0/303724925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72e40ce2c0 msgr2=0x7f72e41495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72e997c640 1 --2- 172.21.15.55:0/303724925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72e40ce2c0 0x7f72e41495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:19.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72e997c640 1 -- 172.21.15.55:0/303724925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d4009420 con 0x7f72e415cf60 2023-08-25T04:21:19.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72ea97e640 1 --2- 172.21.15.55:0/303724925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e415fb30 0x7f72e4157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:19.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72e997c640 1 --2- 172.21.15.55:0/303724925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72e415cf60 0x7f72e40b01f0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f72d4019010 tx=0x7f72d401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:19.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72daffd640 1 -- 172.21.15.55:0/303724925 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d40bf610 con 0x7f72e415cf60 2023-08-25T04:21:19.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72daffd640 1 -- 172.21.15.55:0/303724925 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d40bf790 con 0x7f72e415cf60 2023-08-25T04:21:19.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72daffd640 1 -- 172.21.15.55:0/303724925 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d40bfb40 con 0x7f72e415cf60 2023-08-25T04:21:19.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72ec3e1640 1 -- 172.21.15.55:0/303724925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e4149b10 con 0x7f72e415cf60 2023-08-25T04:21:19.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72ec3e1640 1 -- 172.21.15.55:0/303724925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e415f360 con 0x7f72e415cf60 2023-08-25T04:21:19.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72ec3e1640 1 -- 172.21.15.55:0/303724925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e4151cc0 con 0x7f72e415cf60 2023-08-25T04:21:19.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72daffd640 1 -- 172.21.15.55:0/303724925 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f72d40b5400 con 0x7f72e415cf60 2023-08-25T04:21:19.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72daffd640 1 --2- 172.21.15.55:0/303724925 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f72c80657a0 0x7f72c8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:19.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72daffd640 1 -- 172.21.15.55:0/303724925 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f72d411d910 con 0x7f72e415cf60 2023-08-25T04:21:19.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.811+0000 7f72ea17d640 1 --2- 172.21.15.55:0/303724925 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f72c80657a0 0x7f72c8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:19.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.815+0000 7f72ea17d640 1 --2- 172.21.15.55:0/303724925 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f72c80657a0 0x7f72c8067c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f72e0000f70 tx=0x7f72e0009040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:19.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.815+0000 7f72daffd640 1 -- 172.21.15.55:0/303724925 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f72e4151cc0 con 0x7f72e415cf60 2023-08-25T04:21:19.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:19.975+0000 7f72ec3e1640 1 -- 172.21.15.55:0/303724925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f72e4151cc0 con 0x7f72e415cf60 2023-08-25T04:21:20.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:20.867+0000 7f72daffd640 1 -- 172.21.15.55:0/303724925 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v119) v1 ==== 138+0+0 (secure 0 0 0) 0x7f72e4151cc0 con 0x7f72e415cf60 2023-08-25T04:21:20.866 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-08-25T04:21:20.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:20.871+0000 7f72ec3e1640 1 -- 172.21.15.55:0/303724925 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f72c80657a0 msgr2=0x7f72c8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:20.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:20.871+0000 7f72ec3e1640 1 --2- 172.21.15.55:0/303724925 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f72c80657a0 0x7f72c8067c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f72e0000f70 tx=0x7f72e0009040 comp rx=0 tx=0).stop 2023-08-25T04:21:20.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:20.871+0000 7f72ec3e1640 1 -- 172.21.15.55:0/303724925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72e415cf60 msgr2=0x7f72e40b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:20.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:20.871+0000 7f72ec3e1640 1 --2- 172.21.15.55:0/303724925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72e415cf60 0x7f72e40b01f0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f72d4019010 tx=0x7f72d401ac40 comp rx=0 tx=0).stop 2023-08-25T04:21:20.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:20.871+0000 7f72ec3e1640 1 -- 172.21.15.55:0/303724925 shutdown_connections 2023-08-25T04:21:20.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:20.871+0000 7f72ec3e1640 1 --2- 172.21.15.55:0/303724925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72e415fb30 0x7f72e4157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:20.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:20.871+0000 7f72ec3e1640 1 --2- 172.21.15.55:0/303724925 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f72c80657a0 0x7f72c8067c60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:20.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:20.871+0000 7f72ec3e1640 1 --2- 172.21.15.55:0/303724925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72e415cf60 0x7f72e40b01f0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:20.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:20.871+0000 7f72ec3e1640 1 --2- 172.21.15.55:0/303724925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72e40ce2c0 0x7f72e41495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:20.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:20.871+0000 7f72ec3e1640 1 -- 172.21.15.55:0/303724925 >> 172.21.15.55:0/303724925 conn(0x7f72e406dd60 msgr2=0x7f72e40ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:20.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:20.875+0000 7f72ec3e1640 1 -- 172.21.15.55:0/303724925 shutdown_connections 2023-08-25T04:21:20.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:20.875+0000 7f72ec3e1640 1 -- 172.21.15.55:0/303724925 wait complete. 2023-08-25T04:21:20.897 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-25T04:21:21.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.055+0000 7f1ed36e6640 1 Processor -- start 2023-08-25T04:21:21.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.055+0000 7f1ed36e6640 1 -- start start 2023-08-25T04:21:21.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.055+0000 7f1ed36e6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1ecc0ad7b0 0x7f1ecc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:21.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.055+0000 7f1ed36e6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ecc164b30 0x7f1ecc0c1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:21.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.055+0000 7f1ed36e6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ecc161440 con 0x7f1ecc0c18d0 2023-08-25T04:21:21.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.055+0000 7f1ed36e6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ecc0c1d60 con 0x7f1ecc0ad7b0 2023-08-25T04:21:21.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.055+0000 7f1ed36e6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc0caba0 con 0x7f1ecc164b30 2023-08-25T04:21:21.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.055+0000 7f1ed1482640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1ecc0ad7b0 0x7f1ecc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:21.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.055+0000 7f1ed1482640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1ecc0ad7b0 0x7f1ecc06c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:49922/0 (socket says 172.21.15.55:49922) 2023-08-25T04:21:21.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.055+0000 7f1ed1482640 1 -- 172.21.15.55:0/2602945228 learned_addr learned my addr 172.21.15.55:0/2602945228 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:21.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.055+0000 7f1ed0c81640 1 --2- 172.21.15.55:0/2602945228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ecc164b30 0x7f1ecc0c1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:21.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.059+0000 7f1ed1482640 1 -- 172.21.15.55:0/2602945228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ecc164b30 msgr2=0x7f1ecc0c1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:21.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.059+0000 7f1ed1482640 1 --2- 172.21.15.55:0/2602945228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ecc164b30 0x7f1ecc0c1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:21.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.059+0000 7f1ed1482640 1 -- 172.21.15.55:0/2602945228 >> v1:172.21.15.110:6789/0 conn(0x7f1ecc0c18d0 legacy=0x7f1ecc0cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:21.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.059+0000 7f1ed1482640 1 -- 172.21.15.55:0/2602945228 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc06cb20 con 0x7f1ecc0ad7b0 2023-08-25T04:21:21.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.059+0000 7f1ed1482640 1 --2- 172.21.15.55:0/2602945228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ecc0ad7b0 0x7f1ecc06c540 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8006fd0 tx=0x7f1ec801ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7594da1f28a6aad0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:21.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.059+0000 7f1ec3fff640 1 -- 172.21.15.55:0/2602945228 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80a8a10 con 0x7f1ecc0ad7b0 2023-08-25T04:21:21.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.059+0000 7f1ec3fff640 1 -- 172.21.15.55:0/2602945228 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec80a8b70 con 0x7f1ecc0ad7b0 2023-08-25T04:21:21.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.059+0000 7f1ec3fff640 1 -- 172.21.15.55:0/2602945228 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80b0440 con 0x7f1ecc0ad7b0 2023-08-25T04:21:21.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed36e6640 1 -- 172.21.15.55:0/2602945228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ecc0ad7b0 msgr2=0x7f1ecc06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:21.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed36e6640 1 --2- 172.21.15.55:0/2602945228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ecc0ad7b0 0x7f1ecc06c540 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8006fd0 tx=0x7f1ec801ed10 comp rx=0 tx=0).stop 2023-08-25T04:21:21.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed36e6640 1 -- 172.21.15.55:0/2602945228 shutdown_connections 2023-08-25T04:21:21.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed36e6640 1 --2- 172.21.15.55:0/2602945228 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ecc164b30 0x7f1ecc0c1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:21.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed36e6640 1 --2- 172.21.15.55:0/2602945228 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ecc0ad7b0 0x7f1ecc06c540 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:21.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed36e6640 1 -- 172.21.15.55:0/2602945228 >> 172.21.15.55:0/2602945228 conn(0x7f1ecc069900 msgr2=0x7f1ecc069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:21.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed36e6640 1 -- 172.21.15.55:0/2602945228 shutdown_connections 2023-08-25T04:21:21.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed36e6640 1 -- 172.21.15.55:0/2602945228 wait complete. 2023-08-25T04:21:21.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed36e6640 1 Processor -- start 2023-08-25T04:21:21.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed36e6640 1 -- start start 2023-08-25T04:21:21.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed36e6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ecc0ad7b0 0x7f1ecc1f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:21.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed36e6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ecc0c18d0 0x7f1ecc0b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:21.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed36e6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ecc164b30 0x7f1ecc0ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:21.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed36e6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc0ae600 con 0x7f1ecc164b30 2023-08-25T04:21:21.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed36e6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc0c63b0 con 0x7f1ecc0ad7b0 2023-08-25T04:21:21.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed36e6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc1602c0 con 0x7f1ecc0c18d0 2023-08-25T04:21:21.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed1c83640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ecc164b30 0x7f1ecc0ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:21.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed1c83640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ecc164b30 0x7f1ecc0ae0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55354/0 (socket says 172.21.15.55:55354) 2023-08-25T04:21:21.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed1c83640 1 -- 172.21.15.55:0/745833278 learned_addr learned my addr 172.21.15.55:0/745833278 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:21.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed0c81640 1 --2- 172.21.15.55:0/745833278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ecc0c18d0 0x7f1ecc0b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:21.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed1482640 1 --2- 172.21.15.55:0/745833278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ecc0ad7b0 0x7f1ecc1f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:21.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed1c83640 1 -- 172.21.15.55:0/745833278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ecc0c18d0 msgr2=0x7f1ecc0b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:21.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed1c83640 1 --2- 172.21.15.55:0/745833278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ecc0c18d0 0x7f1ecc0b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:21.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed1c83640 1 -- 172.21.15.55:0/745833278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ecc0ad7b0 msgr2=0x7f1ecc1f5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:21.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed1c83640 1 --2- 172.21.15.55:0/745833278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ecc0ad7b0 0x7f1ecc1f5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:21.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed1c83640 1 -- 172.21.15.55:0/745833278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec8009480 con 0x7f1ecc164b30 2023-08-25T04:21:21.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.063+0000 7f1ed1482640 1 --2- 172.21.15.55:0/745833278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ecc0ad7b0 0x7f1ecc1f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:21.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.067+0000 7f1ed1c83640 1 --2- 172.21.15.55:0/745833278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ecc164b30 0x7f1ecc0ae0c0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f1ec400c770 tx=0x7f1ec400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:21.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.067+0000 7f1ec1ffb640 1 -- 172.21.15.55:0/745833278 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4003b80 con 0x7f1ecc164b30 2023-08-25T04:21:21.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.067+0000 7f1ec1ffb640 1 -- 172.21.15.55:0/745833278 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec4003ce0 con 0x7f1ecc164b30 2023-08-25T04:21:21.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.067+0000 7f1ec1ffb640 1 -- 172.21.15.55:0/745833278 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec400aa90 con 0x7f1ecc164b30 2023-08-25T04:21:21.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.067+0000 7f1ed36e6640 1 -- 172.21.15.55:0/745833278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ecc1605a0 con 0x7f1ecc164b30 2023-08-25T04:21:21.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.067+0000 7f1ed36e6640 1 -- 172.21.15.55:0/745833278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ecc0ae8b0 con 0x7f1ecc164b30 2023-08-25T04:21:21.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.067+0000 7f1ed36e6640 1 -- 172.21.15.55:0/745833278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ecc1607e0 con 0x7f1ecc164b30 2023-08-25T04:21:21.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.067+0000 7f1ec1ffb640 1 -- 172.21.15.55:0/745833278 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f1ec400abf0 con 0x7f1ecc164b30 2023-08-25T04:21:21.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.067+0000 7f1ec1ffb640 1 --2- 172.21.15.55:0/745833278 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f1eb00657d0 0x7f1eb0067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:21.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.067+0000 7f1ec1ffb640 1 -- 172.21.15.55:0/745833278 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f1ec4082a60 con 0x7f1ecc164b30 2023-08-25T04:21:21.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.071+0000 7f1ed1482640 1 --2- 172.21.15.55:0/745833278 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f1eb00657d0 0x7f1eb0067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:21.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.071+0000 7f1ed1482640 1 --2- 172.21.15.55:0/745833278 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f1eb00657d0 0x7f1eb0067c90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80b2000 tx=0x7f1ec80aa070 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:21.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.075+0000 7f1ec1ffb640 1 -- 172.21.15.55:0/745833278 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1ecc1607e0 con 0x7f1ecc164b30 2023-08-25T04:21:21.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.231+0000 7f1ed36e6640 1 -- 172.21.15.55:0/745833278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1ecc0c5ea0 con 0x7f1ecc164b30 2023-08-25T04:21:21.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.879+0000 7f1ec1ffb640 1 -- 172.21.15.55:0/745833278 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v120) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1ecc0c5ea0 con 0x7f1ecc164b30 2023-08-25T04:21:21.879 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-08-25T04:21:21.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.895+0000 7f1ed36e6640 1 -- 172.21.15.55:0/745833278 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f1eb00657d0 msgr2=0x7f1eb0067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:21.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.895+0000 7f1ed36e6640 1 --2- 172.21.15.55:0/745833278 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f1eb00657d0 0x7f1eb0067c90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80b2000 tx=0x7f1ec80aa070 comp rx=0 tx=0).stop 2023-08-25T04:21:21.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.895+0000 7f1ed36e6640 1 -- 172.21.15.55:0/745833278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ecc164b30 msgr2=0x7f1ecc0ae0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.895+0000 7f1ed36e6640 1 --2- 172.21.15.55:0/745833278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ecc164b30 0x7f1ecc0ae0c0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f1ec400c770 tx=0x7f1ec400cc30 comp rx=0 tx=0).stop 2023-08-25T04:21:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.895+0000 7f1ed36e6640 1 -- 172.21.15.55:0/745833278 shutdown_connections 2023-08-25T04:21:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.895+0000 7f1ed36e6640 1 --2- 172.21.15.55:0/745833278 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f1eb00657d0 0x7f1eb0067c90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.895+0000 7f1ed36e6640 1 --2- 172.21.15.55:0/745833278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ecc164b30 0x7f1ecc0ae0c0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.895+0000 7f1ed36e6640 1 --2- 172.21.15.55:0/745833278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ecc0c18d0 0x7f1ecc0b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.895+0000 7f1ed36e6640 1 --2- 172.21.15.55:0/745833278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ecc0ad7b0 0x7f1ecc1f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:21.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.895+0000 7f1ed36e6640 1 -- 172.21.15.55:0/745833278 >> 172.21.15.55:0/745833278 conn(0x7f1ecc069900 msgr2=0x7f1ecc0b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:21.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.899+0000 7f1ed36e6640 1 -- 172.21.15.55:0/745833278 shutdown_connections 2023-08-25T04:21:21.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:21.899+0000 7f1ed36e6640 1 -- 172.21.15.55:0/745833278 wait complete. 2023-08-25T04:21:21.922 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-25T04:21:22.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.075+0000 7f0e019ac640 1 Processor -- start 2023-08-25T04:21:22.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.075+0000 7f0e019ac640 1 -- start start 2023-08-25T04:21:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.075+0000 7f0e019ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dfc0cb020 0x7f0dfc0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.075+0000 7f0e019ac640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0dfc0cdd50 0x7f0dfc0cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.075+0000 7f0e019ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0dfc06c720 0x7f0dfc06cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.075+0000 7f0e019ac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dfc06d0b0 con 0x7f0dfc06c720 2023-08-25T04:21:22.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.075+0000 7f0e019ac640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dfc0cbca0 con 0x7f0dfc0cdd50 2023-08-25T04:21:22.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.075+0000 7f0e019ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc0c9470 con 0x7f0dfc0cb020 2023-08-25T04:21:22.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.075+0000 7f0dfb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0dfc06c720 0x7f0dfc06cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:22.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.075+0000 7f0dfb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0dfc06c720 0x7f0dfc06cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55364/0 (socket says 172.21.15.55:55364) 2023-08-25T04:21:22.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.075+0000 7f0dfb7fe640 1 -- 172.21.15.55:0/3017728648 learned_addr learned my addr 172.21.15.55:0/3017728648 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:22.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.075+0000 7f0dfaffd640 1 --2- 172.21.15.55:0/3017728648 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dfc0cb020 0x7f0dfc0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:22.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.075+0000 7f0df3fff640 1 --2- 172.21.15.55:0/3017728648 >> v2:172.21.15.110:3300/0 conn(0x7f0dfc0cdd50 0x7f0dfc0cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:22.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.075+0000 7f0dfb7fe640 1 -- 172.21.15.55:0/3017728648 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dfc0cb020 msgr2=0x7f0dfc0c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:22.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.075+0000 7f0dfb7fe640 1 --2- 172.21.15.55:0/3017728648 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dfc0cb020 0x7f0dfc0c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:22.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.075+0000 7f0dfb7fe640 1 -- 172.21.15.55:0/3017728648 >> v2:172.21.15.110:3300/0 conn(0x7f0dfc0cdd50 msgr2=0x7f0dfc0cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:22.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.075+0000 7f0dfb7fe640 1 --2- 172.21.15.55:0/3017728648 >> v2:172.21.15.110:3300/0 conn(0x7f0dfc0cdd50 0x7f0dfc0cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:22.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.075+0000 7f0dfb7fe640 1 -- 172.21.15.55:0/3017728648 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc0ce1b0 con 0x7f0dfc06c720 2023-08-25T04:21:22.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.079+0000 7f0dfb7fe640 1 --2- 172.21.15.55:0/3017728648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dfc06c720 0x7f0dfc06cb70 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0cbea0 tx=0x7f0df401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a90b5985afcf01 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:22.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.079+0000 7f0dfa7fc640 1 -- 172.21.15.55:0/3017728648 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df40a56b0 con 0x7f0dfc06c720 2023-08-25T04:21:22.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.079+0000 7f0dfa7fc640 1 -- 172.21.15.55:0/3017728648 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df40a5810 con 0x7f0dfc06c720 2023-08-25T04:21:22.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.079+0000 7f0dfa7fc640 1 -- 172.21.15.55:0/3017728648 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df40a5ba0 con 0x7f0dfc06c720 2023-08-25T04:21:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.079+0000 7f0e019ac640 1 -- 172.21.15.55:0/3017728648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dfc06c720 msgr2=0x7f0dfc06cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.079+0000 7f0e019ac640 1 --2- 172.21.15.55:0/3017728648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dfc06c720 0x7f0dfc06cb70 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc0cbea0 tx=0x7f0df401c940 comp rx=0 tx=0).stop 2023-08-25T04:21:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.079+0000 7f0e019ac640 1 -- 172.21.15.55:0/3017728648 shutdown_connections 2023-08-25T04:21:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.079+0000 7f0e019ac640 1 --2- 172.21.15.55:0/3017728648 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dfc06c720 0x7f0dfc06cb70 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.079+0000 7f0e019ac640 1 --2- 172.21.15.55:0/3017728648 >> v2:172.21.15.110:3300/0 conn(0x7f0dfc0cdd50 0x7f0dfc0cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.079+0000 7f0e019ac640 1 --2- 172.21.15.55:0/3017728648 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dfc0cb020 0x7f0dfc0c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.079+0000 7f0e019ac640 1 -- 172.21.15.55:0/3017728648 >> 172.21.15.55:0/3017728648 conn(0x7f0dfc069900 msgr2=0x7f0dfc069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.079+0000 7f0e019ac640 1 -- 172.21.15.55:0/3017728648 shutdown_connections 2023-08-25T04:21:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.079+0000 7f0e019ac640 1 -- 172.21.15.55:0/3017728648 wait complete. 2023-08-25T04:21:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0e019ac640 1 Processor -- start 2023-08-25T04:21:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0e019ac640 1 -- start start 2023-08-25T04:21:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0e019ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dfc06c720 0x7f0dfc14f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0e019ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dfc0cb020 0x7f0dfc0b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0e019ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dfc0cdd50 0x7f0dfc0b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0e019ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc150f60 con 0x7f0dfc0cdd50 2023-08-25T04:21:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0e019ac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc14fcf0 con 0x7f0dfc06c720 2023-08-25T04:21:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0e019ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc150350 con 0x7f0dfc0cb020 2023-08-25T04:21:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0dfb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dfc0cdd50 0x7f0dfc0b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0dfb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dfc0cdd50 0x7f0dfc0b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55380/0 (socket says 172.21.15.55:55380) 2023-08-25T04:21:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0dfb7fe640 1 -- 172.21.15.55:0/171765972 learned_addr learned my addr 172.21.15.55:0/171765972 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:22.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0dfb7fe640 1 -- 172.21.15.55:0/171765972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dfc0cb020 msgr2=0x7f0dfc0b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:22.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0df3fff640 1 --2- 172.21.15.55:0/171765972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dfc0cb020 0x7f0dfc0b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:22.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0dfaffd640 1 --2- 172.21.15.55:0/171765972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dfc06c720 0x7f0dfc14f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:22.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0dfb7fe640 1 --2- 172.21.15.55:0/171765972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dfc0cb020 0x7f0dfc0b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:22.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0dfb7fe640 1 -- 172.21.15.55:0/171765972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dfc06c720 msgr2=0x7f0dfc14f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:22.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0dfb7fe640 1 --2- 172.21.15.55:0/171765972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dfc06c720 0x7f0dfc14f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:22.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0dfb7fe640 1 -- 172.21.15.55:0/171765972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df4009b30 con 0x7f0dfc0cdd50 2023-08-25T04:21:22.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0df3fff640 1 --2- 172.21.15.55:0/171765972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dfc0cb020 0x7f0dfc0b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:22.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0dfaffd640 1 --2- 172.21.15.55:0/171765972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dfc06c720 0x7f0dfc14f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:22.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0dfb7fe640 1 --2- 172.21.15.55:0/171765972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dfc0cdd50 0x7f0dfc0b0120 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f0df401aff0 tx=0x7f0df40196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:22.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0df8ff9640 1 -- 172.21.15.55:0/171765972 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df40b8670 con 0x7f0dfc0cdd50 2023-08-25T04:21:22.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0df8ff9640 1 -- 172.21.15.55:0/171765972 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df40b87d0 con 0x7f0dfc0cdd50 2023-08-25T04:21:22.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0e019ac640 1 -- 172.21.15.55:0/171765972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dfc150630 con 0x7f0dfc0cdd50 2023-08-25T04:21:22.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0df8ff9640 1 -- 172.21.15.55:0/171765972 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df40b8b80 con 0x7f0dfc0cdd50 2023-08-25T04:21:22.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0e019ac640 1 -- 172.21.15.55:0/171765972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dfc150bf0 con 0x7f0dfc0cdd50 2023-08-25T04:21:22.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.083+0000 7f0e019ac640 1 -- 172.21.15.55:0/171765972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dfc073ec0 con 0x7f0dfc0cdd50 2023-08-25T04:21:22.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.087+0000 7f0df8ff9640 1 -- 172.21.15.55:0/171765972 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f0df40b8ce0 con 0x7f0dfc0cdd50 2023-08-25T04:21:22.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.087+0000 7f0df8ff9640 1 --2- 172.21.15.55:0/171765972 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f0ddc0657d0 0x7f0ddc067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:22.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.087+0000 7f0df8ff9640 1 -- 172.21.15.55:0/171765972 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f0df411e360 con 0x7f0dfc0cdd50 2023-08-25T04:21:22.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.087+0000 7f0dfaffd640 1 --2- 172.21.15.55:0/171765972 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f0ddc0657d0 0x7f0ddc067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:22.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.087+0000 7f0dfaffd640 1 --2- 172.21.15.55:0/171765972 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f0ddc0657d0 0x7f0ddc067c90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009ac0 tx=0x7f0dec008040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:22.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.091+0000 7f0df8ff9640 1 -- 172.21.15.55:0/171765972 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0df40ebe40 con 0x7f0dfc0cdd50 2023-08-25T04:21:22.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.279+0000 7f0e019ac640 1 -- 172.21.15.55:0/171765972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0dfc0c4fb0 con 0x7f0dfc0cdd50 2023-08-25T04:21:22.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.899+0000 7f0df8ff9640 1 -- 172.21.15.55:0/171765972 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v54) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0df4009510 con 0x7f0dfc0cdd50 2023-08-25T04:21:22.911 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 15 and data pool 16 2023-08-25T04:21:22.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.919+0000 7f0e019ac640 1 -- 172.21.15.55:0/171765972 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f0ddc0657d0 msgr2=0x7f0ddc067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:22.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.919+0000 7f0e019ac640 1 --2- 172.21.15.55:0/171765972 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f0ddc0657d0 0x7f0ddc067c90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009ac0 tx=0x7f0dec008040 comp rx=0 tx=0).stop 2023-08-25T04:21:22.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.919+0000 7f0e019ac640 1 -- 172.21.15.55:0/171765972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dfc0cdd50 msgr2=0x7f0dfc0b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:22.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.919+0000 7f0e019ac640 1 --2- 172.21.15.55:0/171765972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dfc0cdd50 0x7f0dfc0b0120 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f0df401aff0 tx=0x7f0df40196e0 comp rx=0 tx=0).stop 2023-08-25T04:21:22.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.919+0000 7f0e019ac640 1 -- 172.21.15.55:0/171765972 shutdown_connections 2023-08-25T04:21:22.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.919+0000 7f0e019ac640 1 --2- 172.21.15.55:0/171765972 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f0ddc0657d0 0x7f0ddc067c90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:22.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.919+0000 7f0e019ac640 1 --2- 172.21.15.55:0/171765972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0dfc0cdd50 0x7f0dfc0b0120 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:22.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.919+0000 7f0e019ac640 1 --2- 172.21.15.55:0/171765972 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0dfc0cb020 0x7f0dfc0b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:22.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.919+0000 7f0e019ac640 1 --2- 172.21.15.55:0/171765972 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0dfc06c720 0x7f0dfc14f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.919+0000 7f0e019ac640 1 -- 172.21.15.55:0/171765972 >> 172.21.15.55:0/171765972 conn(0x7f0dfc069900 msgr2=0x7f0dfc070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:22.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.919+0000 7f0e019ac640 1 -- 172.21.15.55:0/171765972 shutdown_connections 2023-08-25T04:21:22.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:22.923+0000 7f0e019ac640 1 -- 172.21.15.55:0/171765972 wait complete. 2023-08-25T04:21:22.941 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:21:23.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.087+0000 7fa822344640 1 Processor -- start 2023-08-25T04:21:23.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.087+0000 7fa822344640 1 -- start start 2023-08-25T04:21:23.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.091+0000 7fa822344640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa81c0d0da0 0x7fa81c0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.091+0000 7fa822344640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa81c0b3e50 0x7fa81c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.091+0000 7fa822344640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81c0b29b0 con 0x7fa81c0cdde0 2023-08-25T04:21:23.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.091+0000 7fa822344640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81c0ce760 con 0x7fa81c0b3e50 2023-08-25T04:21:23.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.091+0000 7fa822344640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81c0d16c0 con 0x7fa81c0d0da0 2023-08-25T04:21:23.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.091+0000 7fa81b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa81c0cdde0 0x7fa81c0cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40348/0 (socket says 172.21.15.55:40348) 2023-08-25T04:21:23.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.091+0000 7fa81b7fe640 1 -- 172.21.15.55:0/3683719166 learned_addr learned my addr 172.21.15.55:0/3683719166 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:23.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.091+0000 7fa8208e1640 1 --2- 172.21.15.55:0/3683719166 >> v2:172.21.15.55:3300/0 conn(0x7fa81c0b3e50 0x7fa81c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.091+0000 7fa81bfff640 1 --2- 172.21.15.55:0/3683719166 >> v2:172.21.15.110:3300/0 conn(0x7fa81c0d0da0 0x7fa81c0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.091+0000 7fa8208e1640 1 -- 172.21.15.55:0/3683719166 >> v2:172.21.15.110:3300/0 conn(0x7fa81c0d0da0 msgr2=0x7fa81c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:23.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.091+0000 7fa8208e1640 1 --2- 172.21.15.55:0/3683719166 >> v2:172.21.15.110:3300/0 conn(0x7fa81c0d0da0 0x7fa81c0d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.091+0000 7fa8208e1640 1 -- 172.21.15.55:0/3683719166 >> v1:172.21.15.55:6789/0 conn(0x7fa81c0cdde0 legacy=0x7fa81c0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:23.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.091+0000 7fa8208e1640 1 -- 172.21.15.55:0/3683719166 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c0b1dc0 con 0x7fa81c0b3e50 2023-08-25T04:21:23.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.091+0000 7fa81affd640 1 -- 172.21.15.55:0/3683719166 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456963314 0 0) 0x7fa81c0b29b0 con 0x7fa81c0cdde0 2023-08-25T04:21:23.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.091+0000 7fa81bfff640 1 --2- 172.21.15.55:0/3683719166 >> v2:172.21.15.110:3300/0 conn(0x7fa81c0d0da0 0x7fa81c0d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:23.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.095+0000 7fa8208e1640 1 --2- 172.21.15.55:0/3683719166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa81c0b3e50 0x7fa81c0ce220 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fa81c073720 tx=0x7fa81401f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee188d7b6392c4d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:23.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.095+0000 7fa81affd640 1 -- 172.21.15.55:0/3683719166 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8140b0440 con 0x7fa81c0b3e50 2023-08-25T04:21:23.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.095+0000 7fa81affd640 1 -- 172.21.15.55:0/3683719166 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8140b05a0 con 0x7fa81c0b3e50 2023-08-25T04:21:23.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.095+0000 7fa81affd640 1 -- 172.21.15.55:0/3683719166 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8140b0930 con 0x7fa81c0b3e50 2023-08-25T04:21:23.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.095+0000 7fa822344640 1 -- 172.21.15.55:0/3683719166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa81c0b3e50 msgr2=0x7fa81c0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:23.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.095+0000 7fa822344640 1 --2- 172.21.15.55:0/3683719166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa81c0b3e50 0x7fa81c0ce220 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fa81c073720 tx=0x7fa81401f0f0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.095+0000 7fa822344640 1 -- 172.21.15.55:0/3683719166 shutdown_connections 2023-08-25T04:21:23.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.095+0000 7fa822344640 1 --2- 172.21.15.55:0/3683719166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa81c0b3e50 0x7fa81c0ce220 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.095+0000 7fa822344640 1 --2- 172.21.15.55:0/3683719166 >> v2:172.21.15.110:3300/0 conn(0x7fa81c0d0da0 0x7fa81c0d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.095+0000 7fa822344640 1 -- 172.21.15.55:0/3683719166 >> 172.21.15.55:0/3683719166 conn(0x7fa81c09bae0 msgr2=0x7fa81c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:23.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.095+0000 7fa822344640 1 -- 172.21.15.55:0/3683719166 shutdown_connections 2023-08-25T04:21:23.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.095+0000 7fa822344640 1 -- 172.21.15.55:0/3683719166 wait complete. 2023-08-25T04:21:23.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.095+0000 7fa822344640 1 Processor -- start 2023-08-25T04:21:23.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.095+0000 7fa822344640 1 -- start start 2023-08-25T04:21:23.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.095+0000 7fa822344640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa81c0b3e50 0x7fa81c151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa822344640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa81c0cdde0 0x7fa81c0c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa822344640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa81c0d0da0 0x7fa81c0cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa822344640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0c8be0 con 0x7fa81c0cdde0 2023-08-25T04:21:23.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa822344640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c151dc0 con 0x7fa81c0d0da0 2023-08-25T04:21:23.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa822344640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c0c8060 con 0x7fa81c0b3e50 2023-08-25T04:21:23.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa81b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa81c0cdde0 0x7fa81c0c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa81b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa81c0cdde0 0x7fa81c0c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55392/0 (socket says 172.21.15.55:55392) 2023-08-25T04:21:23.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa81b7fe640 1 -- 172.21.15.55:0/4224893313 learned_addr learned my addr 172.21.15.55:0/4224893313 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:23.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa81bfff640 1 --2- 172.21.15.55:0/4224893313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa81c0b3e50 0x7fa81c151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa8208e1640 1 --2- 172.21.15.55:0/4224893313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa81c0d0da0 0x7fa81c0cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa81b7fe640 1 -- 172.21.15.55:0/4224893313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa81c0b3e50 msgr2=0x7fa81c151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:23.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa81b7fe640 1 --2- 172.21.15.55:0/4224893313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa81c0b3e50 0x7fa81c151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa81b7fe640 1 -- 172.21.15.55:0/4224893313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa81c0d0da0 msgr2=0x7fa81c0cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:23.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa81b7fe640 1 --2- 172.21.15.55:0/4224893313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa81c0d0da0 0x7fa81c0cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa81b7fe640 1 -- 172.21.15.55:0/4224893313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa814009a70 con 0x7fa81c0cdde0 2023-08-25T04:21:23.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa81b7fe640 1 --2- 172.21.15.55:0/4224893313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa81c0cdde0 0x7fa81c0c75a0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fa8100011f0 tx=0x7fa81000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:23.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa818ff9640 1 -- 172.21.15.55:0/4224893313 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100074e0 con 0x7fa81c0cdde0 2023-08-25T04:21:23.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa818ff9640 1 -- 172.21.15.55:0/4224893313 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa810007640 con 0x7fa81c0cdde0 2023-08-25T04:21:23.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa822344640 1 -- 172.21.15.55:0/4224893313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81c0c8340 con 0x7fa81c0cdde0 2023-08-25T04:21:23.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa818ff9640 1 -- 172.21.15.55:0/4224893313 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa810004a10 con 0x7fa81c0cdde0 2023-08-25T04:21:23.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa822344640 1 -- 172.21.15.55:0/4224893313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c0c8900 con 0x7fa81c0cdde0 2023-08-25T04:21:23.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa822344640 1 -- 172.21.15.55:0/4224893313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81c04dbe0 con 0x7fa81c0cdde0 2023-08-25T04:21:23.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.099+0000 7fa818ff9640 1 -- 172.21.15.55:0/4224893313 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fa810004b70 con 0x7fa81c0cdde0 2023-08-25T04:21:23.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.103+0000 7fa818ff9640 1 --2- 172.21.15.55:0/4224893313 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fa8080657a0 0x7fa808067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.103+0000 7fa818ff9640 1 -- 172.21.15.55:0/4224893313 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa8100824e0 con 0x7fa81c0cdde0 2023-08-25T04:21:23.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.103+0000 7fa81bfff640 1 --2- 172.21.15.55:0/4224893313 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fa8080657a0 0x7fa808067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.103+0000 7fa81bfff640 1 --2- 172.21.15.55:0/4224893313 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fa8080657a0 0x7fa808067c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa80c006fd0 tx=0x7fa80c008040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:23.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.107+0000 7fa818ff9640 1 -- 172.21.15.55:0/4224893313 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa81004fe80 con 0x7fa81c0cdde0 2023-08-25T04:21:23.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.263+0000 7fa822344640 1 -- 172.21.15.55:0/4224893313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa81c0d0b80 con 0x7fa81c0cdde0 2023-08-25T04:21:23.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.267+0000 7fa818ff9640 1 -- 172.21.15.55:0/4224893313 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+18318 (secure 0 0 0) 0x7fa8100534a0 con 0x7fa81c0cdde0 2023-08-25T04:21:23.265 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:23.265 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":121,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:21:22.282280+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:21:20.028451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-25T04:21:21.281198+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:21:23.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.267+0000 7fa822344640 1 -- 172.21.15.55:0/4224893313 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fa8080657a0 msgr2=0x7fa808067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:23.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.267+0000 7fa822344640 1 --2- 172.21.15.55:0/4224893313 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fa8080657a0 0x7fa808067c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa80c006fd0 tx=0x7fa80c008040 comp rx=0 tx=0).stop 2023-08-25T04:21:23.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.267+0000 7fa822344640 1 -- 172.21.15.55:0/4224893313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa81c0cdde0 msgr2=0x7fa81c0c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:23.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.267+0000 7fa822344640 1 --2- 172.21.15.55:0/4224893313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa81c0cdde0 0x7fa81c0c75a0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fa8100011f0 tx=0x7fa81000c9b0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.267+0000 7fa822344640 1 -- 172.21.15.55:0/4224893313 shutdown_connections 2023-08-25T04:21:23.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.267+0000 7fa822344640 1 --2- 172.21.15.55:0/4224893313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa81c0d0da0 0x7fa81c0cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.267+0000 7fa822344640 1 --2- 172.21.15.55:0/4224893313 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fa8080657a0 0x7fa808067c60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.267+0000 7fa822344640 1 --2- 172.21.15.55:0/4224893313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa81c0cdde0 0x7fa81c0c75a0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.267+0000 7fa822344640 1 --2- 172.21.15.55:0/4224893313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa81c0b3e50 0x7fa81c151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.267+0000 7fa822344640 1 -- 172.21.15.55:0/4224893313 >> 172.21.15.55:0/4224893313 conn(0x7fa81c09bae0 msgr2=0x7fa81c0cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:23.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.267+0000 7fa822344640 1 -- 172.21.15.55:0/4224893313 shutdown_connections 2023-08-25T04:21:23.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.267+0000 7fa822344640 1 -- 172.21.15.55:0/4224893313 wait complete. 2023-08-25T04:21:23.286 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:21:23.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.431+0000 7efda9019640 1 Processor -- start 2023-08-25T04:21:23.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.431+0000 7efda9019640 1 -- start start 2023-08-25T04:21:23.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.431+0000 7efda9019640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efda415eba0 0x7efda40b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.431+0000 7efda9019640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efda415ef80 0x7efda40ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.431+0000 7efda9019640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda40ac100 con 0x7efda40cece0 2023-08-25T04:21:23.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.431+0000 7efda9019640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda40cf170 con 0x7efda415eba0 2023-08-25T04:21:23.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.431+0000 7efda9019640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda40ac3a0 con 0x7efda415ef80 2023-08-25T04:21:23.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.435+0000 7efda2d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efda415eba0 0x7efda40b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.435+0000 7efda359e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efda40cece0 0x7efda40cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40354/0 (socket says 172.21.15.55:40354) 2023-08-25T04:21:23.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.435+0000 7efda2d9d640 1 --2- 172.21.15.55:0/4203880032 >> v2:172.21.15.55:3300/0 conn(0x7efda415eba0 0x7efda40b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55402/0 (socket says 172.21.15.55:55402) 2023-08-25T04:21:23.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.435+0000 7efda359e640 1 -- 172.21.15.55:0/4203880032 learned_addr learned my addr 172.21.15.55:0/4203880032 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:23.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.435+0000 7efd9bfff640 1 --2- 172.21.15.55:0/4203880032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efda415ef80 0x7efda40ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.435+0000 7efda2d9d640 1 -- 172.21.15.55:0/4203880032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efda415ef80 msgr2=0x7efda40ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:23.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.435+0000 7efda2d9d640 1 --2- 172.21.15.55:0/4203880032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efda415ef80 0x7efda40ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.435+0000 7efda2d9d640 1 -- 172.21.15.55:0/4203880032 >> v1:172.21.15.55:6789/0 conn(0x7efda40cece0 legacy=0x7efda40cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:23.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.435+0000 7efda2d9d640 1 -- 172.21.15.55:0/4203880032 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda40b1390 con 0x7efda415eba0 2023-08-25T04:21:23.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.435+0000 7efda259c640 1 -- 172.21.15.55:0/4203880032 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666967012 0 0) 0x7efda40ac100 con 0x7efda40cece0 2023-08-25T04:21:23.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.435+0000 7efda2d9d640 1 --2- 172.21.15.55:0/4203880032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efda415eba0 0x7efda40b2a40 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7efd940097c0 tx=0x7efd9401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf05c007c8f8b0a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:23.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.435+0000 7efda259c640 1 -- 172.21.15.55:0/4203880032 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd940ab600 con 0x7efda415eba0 2023-08-25T04:21:23.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.435+0000 7efda259c640 1 -- 172.21.15.55:0/4203880032 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd940a7050 con 0x7efda415eba0 2023-08-25T04:21:23.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.435+0000 7efda259c640 1 -- 172.21.15.55:0/4203880032 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd940ab980 con 0x7efda415eba0 2023-08-25T04:21:23.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda9019640 1 -- 172.21.15.55:0/4203880032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efda415eba0 msgr2=0x7efda40b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:23.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda9019640 1 --2- 172.21.15.55:0/4203880032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efda415eba0 0x7efda40b2a40 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7efd940097c0 tx=0x7efd9401c450 comp rx=0 tx=0).stop 2023-08-25T04:21:23.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda9019640 1 -- 172.21.15.55:0/4203880032 shutdown_connections 2023-08-25T04:21:23.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda9019640 1 --2- 172.21.15.55:0/4203880032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efda415ef80 0x7efda40ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda9019640 1 --2- 172.21.15.55:0/4203880032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efda415eba0 0x7efda40b2a40 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda9019640 1 -- 172.21.15.55:0/4203880032 >> 172.21.15.55:0/4203880032 conn(0x7efda4069d00 msgr2=0x7efda406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:23.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda9019640 1 -- 172.21.15.55:0/4203880032 shutdown_connections 2023-08-25T04:21:23.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda9019640 1 -- 172.21.15.55:0/4203880032 wait complete. 2023-08-25T04:21:23.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda9019640 1 Processor -- start 2023-08-25T04:21:23.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda9019640 1 -- start start 2023-08-25T04:21:23.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda9019640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efda40cece0 0x7efda4156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda9019640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efda415eba0 0x7efda406fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda9019640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efda415ef80 0x7efda406b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda9019640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda4156870 con 0x7efda415ef80 2023-08-25T04:21:23.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda9019640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda4159cf0 con 0x7efda40cece0 2023-08-25T04:21:23.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda9019640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda406c630 con 0x7efda415eba0 2023-08-25T04:21:23.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efda415ef80 0x7efda406b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efda415ef80 0x7efda406b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55410/0 (socket says 172.21.15.55:55410) 2023-08-25T04:21:23.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda359e640 1 -- 172.21.15.55:0/2107460411 learned_addr learned my addr 172.21.15.55:0/2107460411 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:23.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efd9bfff640 1 --2- 172.21.15.55:0/2107460411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efda415eba0 0x7efda406fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda2d9d640 1 --2- 172.21.15.55:0/2107460411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efda40cece0 0x7efda4156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda359e640 1 -- 172.21.15.55:0/2107460411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efda415eba0 msgr2=0x7efda406fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:23.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda359e640 1 --2- 172.21.15.55:0/2107460411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efda415eba0 0x7efda406fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda359e640 1 -- 172.21.15.55:0/2107460411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efda40cece0 msgr2=0x7efda4156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:23.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda359e640 1 --2- 172.21.15.55:0/2107460411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efda40cece0 0x7efda4156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda359e640 1 -- 172.21.15.55:0/2107460411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd94009420 con 0x7efda415ef80 2023-08-25T04:21:23.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.439+0000 7efda2d9d640 1 --2- 172.21.15.55:0/2107460411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efda40cece0 0x7efda4156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:23.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.443+0000 7efda359e640 1 --2- 172.21.15.55:0/2107460411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efda415ef80 0x7efda406b5f0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00c700 tx=0x7efd9c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:23.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.443+0000 7efd9b7fe640 1 -- 172.21.15.55:0/2107460411 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c00ce10 con 0x7efda415ef80 2023-08-25T04:21:23.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.443+0000 7efd9b7fe640 1 -- 172.21.15.55:0/2107460411 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c00a640 con 0x7efda415ef80 2023-08-25T04:21:23.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.443+0000 7efd9b7fe640 1 -- 172.21.15.55:0/2107460411 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c00aa30 con 0x7efda415ef80 2023-08-25T04:21:23.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.443+0000 7efda9019640 1 -- 172.21.15.55:0/2107460411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda406c910 con 0x7efda415ef80 2023-08-25T04:21:23.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.443+0000 7efda9019640 1 -- 172.21.15.55:0/2107460411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda40c62d0 con 0x7efda415ef80 2023-08-25T04:21:23.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.443+0000 7efda9019640 1 -- 172.21.15.55:0/2107460411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda40c6130 con 0x7efda415ef80 2023-08-25T04:21:23.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.443+0000 7efd9b7fe640 1 -- 172.21.15.55:0/2107460411 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7efd9c00ab90 con 0x7efda415ef80 2023-08-25T04:21:23.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.443+0000 7efd9b7fe640 1 --2- 172.21.15.55:0/2107460411 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7efd840657a0 0x7efd84067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.443+0000 7efd9b7fe640 1 -- 172.21.15.55:0/2107460411 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efd9c082450 con 0x7efda415ef80 2023-08-25T04:21:23.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.447+0000 7efda2d9d640 1 --2- 172.21.15.55:0/2107460411 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7efd840657a0 0x7efd84067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.447+0000 7efda2d9d640 1 --2- 172.21.15.55:0/2107460411 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7efd840657a0 0x7efd84067c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efd940ad000 tx=0x7efd940a6000 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:23.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.447+0000 7efd9b7fe640 1 -- 172.21.15.55:0/2107460411 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7efda40c6130 con 0x7efda415ef80 2023-08-25T04:21:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.607+0000 7efda9019640 1 -- 172.21.15.55:0/2107460411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efda40c6130 con 0x7efda415ef80 2023-08-25T04:21:23.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.607+0000 7efd9b7fe640 1 -- 172.21.15.55:0/2107460411 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+18318 (secure 0 0 0) 0x7efda40c6130 con 0x7efda415ef80 2023-08-25T04:21:23.607 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:23.607 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":121,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:21:22.282280+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:21:20.028451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-25T04:21:21.281198+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:21:23.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.611+0000 7efda9019640 1 -- 172.21.15.55:0/2107460411 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7efd840657a0 msgr2=0x7efd84067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.611+0000 7efda9019640 1 --2- 172.21.15.55:0/2107460411 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7efd840657a0 0x7efd84067c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efd940ad000 tx=0x7efd940a6000 comp rx=0 tx=0).stop 2023-08-25T04:21:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.611+0000 7efda9019640 1 -- 172.21.15.55:0/2107460411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efda415ef80 msgr2=0x7efda406b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.611+0000 7efda9019640 1 --2- 172.21.15.55:0/2107460411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efda415ef80 0x7efda406b5f0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00c700 tx=0x7efd9c00cbc0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.611+0000 7efda9019640 1 -- 172.21.15.55:0/2107460411 shutdown_connections 2023-08-25T04:21:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.611+0000 7efda9019640 1 --2- 172.21.15.55:0/2107460411 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7efd840657a0 0x7efd84067c60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.611+0000 7efda9019640 1 --2- 172.21.15.55:0/2107460411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efda415ef80 0x7efda406b5f0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.611+0000 7efda9019640 1 --2- 172.21.15.55:0/2107460411 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efda415eba0 0x7efda406fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.611+0000 7efda9019640 1 --2- 172.21.15.55:0/2107460411 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efda40cece0 0x7efda4156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.611+0000 7efda9019640 1 -- 172.21.15.55:0/2107460411 >> 172.21.15.55:0/2107460411 conn(0x7efda4069d00 msgr2=0x7efda41573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.611+0000 7efda9019640 1 -- 172.21.15.55:0/2107460411 shutdown_connections 2023-08-25T04:21:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.611+0000 7efda9019640 1 -- 172.21.15.55:0/2107460411 wait complete. 2023-08-25T04:21:23.629 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-25T04:21:23.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f3ce6640 1 Processor -- start 2023-08-25T04:21:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f3ce6640 1 -- start start 2023-08-25T04:21:23.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f3ce6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f37ec06ce30 0x7f37ec0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f3ce6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ec0c9d90 con 0x7f37ec0c9900 2023-08-25T04:21:23.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f3ce6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ec0cbca0 con 0x7f37ec0cb020 2023-08-25T04:21:23.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f3ce6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37ec0c9470 con 0x7f37ec06ce30 2023-08-25T04:21:23.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f1281640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f37ec0c9900 0x7f37ec06c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40370/0 (socket says 172.21.15.55:40370) 2023-08-25T04:21:23.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f1281640 1 -- 172.21.15.55:0/2343409556 learned_addr learned my addr 172.21.15.55:0/2343409556 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:23.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f2283640 1 --2- 172.21.15.55:0/2343409556 >> v2:172.21.15.110:3300/0 conn(0x7f37ec06ce30 0x7f37ec0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f0a80640 1 -- 172.21.15.55:0/2343409556 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996340792 0 0) 0x7f37ec0c9d90 con 0x7f37ec0c9900 2023-08-25T04:21:23.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f0a80640 1 -- 172.21.15.55:0/2343409556 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37d8005740 con 0x7f37ec0c9900 2023-08-25T04:21:23.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f0a80640 1 -- 172.21.15.55:0/2343409556 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3570777152 0 0) 0x7f37d8005740 con 0x7f37ec0c9900 2023-08-25T04:21:23.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f0a80640 1 -- 172.21.15.55:0/2343409556 >> v2:172.21.15.110:3300/0 conn(0x7f37ec06ce30 msgr2=0x7f37ec0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:23.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f0a80640 1 --2- 172.21.15.55:0/2343409556 >> v2:172.21.15.110:3300/0 conn(0x7f37ec06ce30 0x7f37ec0cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f0a80640 1 -- 172.21.15.55:0/2343409556 >> v1:172.21.15.110:6789/0 conn(0x7f37ec0cb020 legacy=0x7f37ec0cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f0a80640 1 -- 172.21.15.55:0/2343409556 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ec0c8b40 con 0x7f37ec0c9900 2023-08-25T04:21:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f0a80640 1 -- 172.21.15.55:0/2343409556 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f37dc001680 con 0x7f37ec0c9900 2023-08-25T04:21:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f0a80640 1 -- 172.21.15.55:0/2343409556 >> v1:172.21.15.55:6789/0 conn(0x7f37ec0c9900 legacy=0x7f37ec06c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f0a80640 1 --2- 172.21.15.55:0/2343409556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37d8005b90 0x7f37d8005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f0a80640 1 --2- 172.21.15.55:0/2343409556 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d80069e0 0x7f37d8006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f0a80640 1 --2- 172.21.15.55:0/2343409556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37d80073a0 0x7f37d800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f0a80640 1 -- 172.21.15.55:0/2343409556 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec0c9470 con 0x7f37d80069e0 2023-08-25T04:21:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f0a80640 1 -- 172.21.15.55:0/2343409556 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d800e340 con 0x7f37d8005b90 2023-08-25T04:21:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f0a80640 1 -- 172.21.15.55:0/2343409556 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d800e500 con 0x7f37d80073a0 2023-08-25T04:21:23.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f2283640 1 --2- 172.21.15.55:0/2343409556 >> v2:172.21.15.110:3300/0 conn(0x7f37ec06ce30 0x7f37ec0cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:23.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f1281640 1 --2- 172.21.15.55:0/2343409556 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d80069e0 0x7f37d8006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f1a82640 1 --2- 172.21.15.55:0/2343409556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37d8005b90 0x7f37d8005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f2283640 1 --2- 172.21.15.55:0/2343409556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37d80073a0 0x7f37d800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f1281640 1 -- 172.21.15.55:0/2343409556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37d80073a0 msgr2=0x7f37d800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f1281640 1 --2- 172.21.15.55:0/2343409556 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37d80073a0 0x7f37d800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f1281640 1 -- 172.21.15.55:0/2343409556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37d8005b90 msgr2=0x7f37d8005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f1281640 1 --2- 172.21.15.55:0/2343409556 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37d8005b90 0x7f37d8005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f2283640 1 -- 172.21.15.55:0/2343409556 reap_dead start 2023-08-25T04:21:23.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.779+0000 7f37f1281640 1 -- 172.21.15.55:0/2343409556 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d8005740 con 0x7f37d80069e0 2023-08-25T04:21:23.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.783+0000 7f37f1281640 1 --2- 172.21.15.55:0/2343409556 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d80069e0 0x7f37d8006e60 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00c240 tx=0x7f37dc01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201dd6660d56cfba server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:23.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.783+0000 7f37f0a80640 1 -- 172.21.15.55:0/2343409556 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc005ae0 con 0x7f37d80069e0 2023-08-25T04:21:23.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.783+0000 7f37f0a80640 1 -- 172.21.15.55:0/2343409556 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37dc005c40 con 0x7f37d80069e0 2023-08-25T04:21:23.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.783+0000 7f37f0a80640 1 -- 172.21.15.55:0/2343409556 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc0072b0 con 0x7f37d80069e0 2023-08-25T04:21:23.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.783+0000 7f37f3ce6640 1 -- 172.21.15.55:0/2343409556 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d80069e0 msgr2=0x7f37d8006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:23.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.783+0000 7f37f3ce6640 1 --2- 172.21.15.55:0/2343409556 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d80069e0 0x7f37d8006e60 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00c240 tx=0x7f37dc01cbc0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.783+0000 7f37f3ce6640 1 -- 172.21.15.55:0/2343409556 shutdown_connections 2023-08-25T04:21:23.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.783+0000 7f37f3ce6640 1 --2- 172.21.15.55:0/2343409556 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d80069e0 0x7f37d8006e60 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.783+0000 7f37f3ce6640 1 -- 172.21.15.55:0/2343409556 >> 172.21.15.55:0/2343409556 conn(0x7f37ec069900 msgr2=0x7f37ec069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:23.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.783+0000 7f37f3ce6640 1 -- 172.21.15.55:0/2343409556 shutdown_connections 2023-08-25T04:21:23.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.783+0000 7f37f3ce6640 1 -- 172.21.15.55:0/2343409556 wait complete. 2023-08-25T04:21:23.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f3ce6640 1 Processor -- start 2023-08-25T04:21:23.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f3ce6640 1 -- start start 2023-08-25T04:21:23.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f3ce6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d80069e0 0x7f37ec0c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f3ce6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37ec0c5490 0x7f37ec0c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f3ce6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ec0c38c0 0x7f37ec0c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f3ce6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec0c65a0 con 0x7f37d80069e0 2023-08-25T04:21:23.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f3ce6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec0c5990 con 0x7f37ec0c38c0 2023-08-25T04:21:23.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f3ce6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec0c5c70 con 0x7f37ec0c5490 2023-08-25T04:21:23.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f1a82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d80069e0 0x7f37ec0c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f1a82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d80069e0 0x7f37ec0c6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55432/0 (socket says 172.21.15.55:55432) 2023-08-25T04:21:23.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f1a82640 1 -- 172.21.15.55:0/707561064 learned_addr learned my addr 172.21.15.55:0/707561064 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:23.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f1281640 1 --2- 172.21.15.55:0/707561064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37ec0c5490 0x7f37ec0c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f2283640 1 --2- 172.21.15.55:0/707561064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ec0c38c0 0x7f37ec0c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f1a82640 1 -- 172.21.15.55:0/707561064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37ec0c5490 msgr2=0x7f37ec0c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:23.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f1a82640 1 --2- 172.21.15.55:0/707561064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37ec0c5490 0x7f37ec0c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f1a82640 1 -- 172.21.15.55:0/707561064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ec0c38c0 msgr2=0x7f37ec0c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:23.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f1a82640 1 --2- 172.21.15.55:0/707561064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ec0c38c0 0x7f37ec0c76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:23.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f1a82640 1 -- 172.21.15.55:0/707561064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ec0c5f50 con 0x7f37d80069e0 2023-08-25T04:21:23.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f2283640 1 --2- 172.21.15.55:0/707561064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ec0c38c0 0x7f37ec0c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:23.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f1a82640 1 --2- 172.21.15.55:0/707561064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d80069e0 0x7f37ec0c6a30 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f37e8007960 tx=0x7f37e800e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:23.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37e27fc640 1 -- 172.21.15.55:0/707561064 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e80052e0 con 0x7f37d80069e0 2023-08-25T04:21:23.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37e27fc640 1 -- 172.21.15.55:0/707561064 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e8005440 con 0x7f37d80069e0 2023-08-25T04:21:23.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f3ce6640 1 -- 172.21.15.55:0/707561064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37ec0c6230 con 0x7f37d80069e0 2023-08-25T04:21:23.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37e27fc640 1 -- 172.21.15.55:0/707561064 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e8003870 con 0x7f37d80069e0 2023-08-25T04:21:23.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.787+0000 7f37f3ce6640 1 -- 172.21.15.55:0/707561064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37ec0c3d30 con 0x7f37d80069e0 2023-08-25T04:21:23.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.791+0000 7f37f3ce6640 1 -- 172.21.15.55:0/707561064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37ec073ec0 con 0x7f37d80069e0 2023-08-25T04:21:23.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.791+0000 7f37e27fc640 1 -- 172.21.15.55:0/707561064 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f37e80039d0 con 0x7f37d80069e0 2023-08-25T04:21:23.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.791+0000 7f37e27fc640 1 --2- 172.21.15.55:0/707561064 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f37d00657a0 0x7f37d0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:23.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.791+0000 7f37e27fc640 1 -- 172.21.15.55:0/707561064 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f37e8082390 con 0x7f37d80069e0 2023-08-25T04:21:23.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.791+0000 7f37f1281640 1 --2- 172.21.15.55:0/707561064 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f37d00657a0 0x7f37d0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:23.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.791+0000 7f37f1281640 1 --2- 172.21.15.55:0/707561064 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f37d00657a0 0x7f37d0067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f37dc0ab000 tx=0x7f37dc0b1040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:23.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.795+0000 7f37e27fc640 1 -- 172.21.15.55:0/707561064 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f37e804fd50 con 0x7f37d80069e0 2023-08-25T04:21:23.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:23.991+0000 7f37f3ce6640 1 -- 172.21.15.55:0/707561064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f37ec0cc230 con 0x7f37d80069e0 2023-08-25T04:21:24.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:24.907+0000 7f37e27fc640 1 -- 172.21.15.55:0/707561064 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v57) v1 ==== 118+0+0 (secure 0 0 0) 0x7f37e8053370 con 0x7f37d80069e0 2023-08-25T04:21:24.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:24.911+0000 7f37f3ce6640 1 -- 172.21.15.55:0/707561064 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f37d00657a0 msgr2=0x7f37d0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:24.911+0000 7f37f3ce6640 1 --2- 172.21.15.55:0/707561064 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f37d00657a0 0x7f37d0067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f37dc0ab000 tx=0x7f37dc0b1040 comp rx=0 tx=0).stop 2023-08-25T04:21:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:24.911+0000 7f37f3ce6640 1 -- 172.21.15.55:0/707561064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d80069e0 msgr2=0x7f37ec0c6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:24.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:24.911+0000 7f37f3ce6640 1 --2- 172.21.15.55:0/707561064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d80069e0 0x7f37ec0c6a30 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f37e8007960 tx=0x7f37e800e8a0 comp rx=0 tx=0).stop 2023-08-25T04:21:24.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:24.911+0000 7f37f3ce6640 1 -- 172.21.15.55:0/707561064 shutdown_connections 2023-08-25T04:21:24.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:24.911+0000 7f37f3ce6640 1 --2- 172.21.15.55:0/707561064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37ec0c38c0 0x7f37ec0c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:24.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:24.911+0000 7f37f3ce6640 1 --2- 172.21.15.55:0/707561064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37ec0c5490 0x7f37ec0c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:24.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:24.911+0000 7f37f3ce6640 1 --2- 172.21.15.55:0/707561064 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f37d00657a0 0x7f37d0067c60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:24.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:24.911+0000 7f37f3ce6640 1 --2- 172.21.15.55:0/707561064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37d80069e0 0x7f37ec0c6a30 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:24.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:24.911+0000 7f37f3ce6640 1 -- 172.21.15.55:0/707561064 >> 172.21.15.55:0/707561064 conn(0x7f37ec069900 msgr2=0x7f37ec0b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:24.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:24.911+0000 7f37f3ce6640 1 -- 172.21.15.55:0/707561064 shutdown_connections 2023-08-25T04:21:24.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:24.911+0000 7f37f3ce6640 1 -- 172.21.15.55:0/707561064 wait complete. 2023-08-25T04:21:24.932 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-25T04:21:24.932 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-25T04:21:25.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.087+0000 7fac92f74640 1 Processor -- start 2023-08-25T04:21:25.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.087+0000 7fac92f74640 1 -- start start 2023-08-25T04:21:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.087+0000 7fac92f74640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fac8c15a7f0 0x7fac8c09bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.087+0000 7fac92f74640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac8c0c9830 0x7fac8c070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.087+0000 7fac92f74640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac8c06c020 0x7fac8c071440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.087+0000 7fac92f74640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8c071980 con 0x7fac8c06c020 2023-08-25T04:21:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.087+0000 7fac92f74640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8c15abd0 con 0x7fac8c15a7f0 2023-08-25T04:21:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.087+0000 7fac92f74640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c0c8ab0 con 0x7fac8c0c9830 2023-08-25T04:21:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.087+0000 7fac91511640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac8c06c020 0x7fac8c071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.087+0000 7fac91511640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac8c06c020 0x7fac8c071440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55442/0 (socket says 172.21.15.55:55442) 2023-08-25T04:21:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.087+0000 7fac91511640 1 -- 172.21.15.55:0/3231894610 learned_addr learned my addr 172.21.15.55:0/3231894610 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.087+0000 7fac8bfff640 1 --2- 172.21.15.55:0/3231894610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac8c0c9830 0x7fac8c070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.087+0000 7fac90d10640 1 --2- 172.21.15.55:0/3231894610 >> v2:172.21.15.110:3300/0 conn(0x7fac8c15a7f0 0x7fac8c09bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.087+0000 7fac91511640 1 -- 172.21.15.55:0/3231894610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac8c0c9830 msgr2=0x7fac8c070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.087+0000 7fac91511640 1 --2- 172.21.15.55:0/3231894610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac8c0c9830 0x7fac8c070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.087+0000 7fac91511640 1 -- 172.21.15.55:0/3231894610 >> v2:172.21.15.110:3300/0 conn(0x7fac8c15a7f0 msgr2=0x7fac8c09bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.087+0000 7fac91511640 1 --2- 172.21.15.55:0/3231894610 >> v2:172.21.15.110:3300/0 conn(0x7fac8c15a7f0 0x7fac8c09bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.087+0000 7fac91511640 1 -- 172.21.15.55:0/3231894610 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c0c8d50 con 0x7fac8c06c020 2023-08-25T04:21:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.091+0000 7fac91511640 1 --2- 172.21.15.55:0/3231894610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac8c06c020 0x7fac8c071440 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fac8c072060 tx=0x7fac8401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e88345ca62c31dc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.091+0000 7fac8b7fe640 1 -- 172.21.15.55:0/3231894610 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac840a5820 con 0x7fac8c06c020 2023-08-25T04:21:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.091+0000 7fac8b7fe640 1 -- 172.21.15.55:0/3231894610 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac840a5980 con 0x7fac8c06c020 2023-08-25T04:21:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.091+0000 7fac8b7fe640 1 -- 172.21.15.55:0/3231894610 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac840a5d10 con 0x7fac8c06c020 2023-08-25T04:21:25.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.091+0000 7fac92f74640 1 -- 172.21.15.55:0/3231894610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac8c06c020 msgr2=0x7fac8c071440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:25.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.091+0000 7fac92f74640 1 --2- 172.21.15.55:0/3231894610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac8c06c020 0x7fac8c071440 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fac8c072060 tx=0x7fac8401c9a0 comp rx=0 tx=0).stop 2023-08-25T04:21:25.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.091+0000 7fac92f74640 1 -- 172.21.15.55:0/3231894610 shutdown_connections 2023-08-25T04:21:25.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.091+0000 7fac92f74640 1 --2- 172.21.15.55:0/3231894610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac8c06c020 0x7fac8c071440 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:25.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.091+0000 7fac92f74640 1 --2- 172.21.15.55:0/3231894610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac8c0c9830 0x7fac8c070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:25.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.091+0000 7fac92f74640 1 --2- 172.21.15.55:0/3231894610 >> v2:172.21.15.110:3300/0 conn(0x7fac8c15a7f0 0x7fac8c09bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.091+0000 7fac92f74640 1 -- 172.21.15.55:0/3231894610 >> 172.21.15.55:0/3231894610 conn(0x7fac8c069900 msgr2=0x7fac8c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.091+0000 7fac92f74640 1 -- 172.21.15.55:0/3231894610 shutdown_connections 2023-08-25T04:21:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.091+0000 7fac92f74640 1 -- 172.21.15.55:0/3231894610 wait complete. 2023-08-25T04:21:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.091+0000 7fac92f74640 1 Processor -- start 2023-08-25T04:21:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.091+0000 7fac92f74640 1 -- start start 2023-08-25T04:21:25.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac92f74640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac8c06c020 0x7fac8c1551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:25.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac92f74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac8c0c9830 0x7fac8c1501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:25.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac92f74640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac8c15a7f0 0x7fac8c1506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac92f74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c0b2f60 con 0x7fac8c0c9830 2023-08-25T04:21:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac92f74640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c15bb30 con 0x7fac8c15a7f0 2023-08-25T04:21:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac92f74640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c1543f0 con 0x7fac8c06c020 2023-08-25T04:21:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac8bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac8c0c9830 0x7fac8c1501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac8bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac8c0c9830 0x7fac8c1501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55458/0 (socket says 172.21.15.55:55458) 2023-08-25T04:21:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac8bfff640 1 -- 172.21.15.55:0/2116283927 learned_addr learned my addr 172.21.15.55:0/2116283927 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac90d10640 1 --2- 172.21.15.55:0/2116283927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac8c06c020 0x7fac8c1551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac91511640 1 --2- 172.21.15.55:0/2116283927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac8c15a7f0 0x7fac8c1506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac8bfff640 1 -- 172.21.15.55:0/2116283927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac8c06c020 msgr2=0x7fac8c1551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac8bfff640 1 --2- 172.21.15.55:0/2116283927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac8c06c020 0x7fac8c1551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac8bfff640 1 -- 172.21.15.55:0/2116283927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac8c15a7f0 msgr2=0x7fac8c1506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac8bfff640 1 --2- 172.21.15.55:0/2116283927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac8c15a7f0 0x7fac8c1506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac8bfff640 1 -- 172.21.15.55:0/2116283927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac84009b30 con 0x7fac8c0c9830 2023-08-25T04:21:25.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac8bfff640 1 --2- 172.21.15.55:0/2116283927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac8c0c9830 0x7fac8c1501a0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fac7800e840 tx=0x7fac7800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:25.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac897fa640 1 -- 172.21.15.55:0/2116283927 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7800c730 con 0x7fac8c0c9830 2023-08-25T04:21:25.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac897fa640 1 -- 172.21.15.55:0/2116283927 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7800c890 con 0x7fac8c0c9830 2023-08-25T04:21:25.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac897fa640 1 -- 172.21.15.55:0/2116283927 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7800cc40 con 0x7fac8c0c9830 2023-08-25T04:21:25.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac92f74640 1 -- 172.21.15.55:0/2116283927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8c1546d0 con 0x7fac8c0c9830 2023-08-25T04:21:25.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac92f74640 1 -- 172.21.15.55:0/2116283927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8c154c90 con 0x7fac8c0c9830 2023-08-25T04:21:25.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.095+0000 7fac92f74640 1 -- 172.21.15.55:0/2116283927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8c06d5b0 con 0x7fac8c0c9830 2023-08-25T04:21:25.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.099+0000 7fac897fa640 1 -- 172.21.15.55:0/2116283927 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fac78013470 con 0x7fac8c0c9830 2023-08-25T04:21:25.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.099+0000 7fac897fa640 1 --2- 172.21.15.55:0/2116283927 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fac700657d0 0x7fac70067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:25.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.099+0000 7fac897fa640 1 -- 172.21.15.55:0/2116283927 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac78082f70 con 0x7fac8c0c9830 2023-08-25T04:21:25.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.099+0000 7fac90d10640 1 --2- 172.21.15.55:0/2116283927 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fac700657d0 0x7fac70067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:25.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.099+0000 7fac90d10640 1 --2- 172.21.15.55:0/2116283927 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fac700657d0 0x7fac70067c90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fac80009aa0 tx=0x7fac80006f90 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:25.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.103+0000 7fac897fa640 1 -- 172.21.15.55:0/2116283927 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fac780509c0 con 0x7fac8c0c9830 2023-08-25T04:21:25.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.291+0000 7fac92f74640 1 -- 172.21.15.55:0/2116283927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fac8c073ec0 con 0x7fac8c0c9830 2023-08-25T04:21:25.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.915+0000 7fac897fa640 1 -- 172.21.15.55:0/2116283927 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7fac78053fe0 con 0x7fac8c0c9830 2023-08-25T04:21:25.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.919+0000 7fac92f74640 1 -- 172.21.15.55:0/2116283927 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fac700657d0 msgr2=0x7fac70067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:25.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.919+0000 7fac92f74640 1 --2- 172.21.15.55:0/2116283927 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fac700657d0 0x7fac70067c90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fac80009aa0 tx=0x7fac80006f90 comp rx=0 tx=0).stop 2023-08-25T04:21:25.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.919+0000 7fac92f74640 1 -- 172.21.15.55:0/2116283927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac8c0c9830 msgr2=0x7fac8c1501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:25.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.919+0000 7fac92f74640 1 --2- 172.21.15.55:0/2116283927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac8c0c9830 0x7fac8c1501a0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fac7800e840 tx=0x7fac7800ed00 comp rx=0 tx=0).stop 2023-08-25T04:21:25.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.919+0000 7fac92f74640 1 -- 172.21.15.55:0/2116283927 shutdown_connections 2023-08-25T04:21:25.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.919+0000 7fac92f74640 1 --2- 172.21.15.55:0/2116283927 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac8c15a7f0 0x7fac8c1506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:25.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.919+0000 7fac92f74640 1 --2- 172.21.15.55:0/2116283927 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fac700657d0 0x7fac70067c90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:25.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.919+0000 7fac92f74640 1 --2- 172.21.15.55:0/2116283927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac8c0c9830 0x7fac8c1501a0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:25.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.919+0000 7fac92f74640 1 --2- 172.21.15.55:0/2116283927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac8c06c020 0x7fac8c1551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:25.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.919+0000 7fac92f74640 1 -- 172.21.15.55:0/2116283927 >> 172.21.15.55:0/2116283927 conn(0x7fac8c069900 msgr2=0x7fac8c0c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:25.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.919+0000 7fac92f74640 1 -- 172.21.15.55:0/2116283927 shutdown_connections 2023-08-25T04:21:25.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:25.919+0000 7fac92f74640 1 -- 172.21.15.55:0/2116283927 wait complete. 2023-08-25T04:21:25.939 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-25T04:21:25.939 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:21:26.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.091+0000 7f28fc8d5640 1 Processor -- start 2023-08-25T04:21:26.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.091+0000 7f28fc8d5640 1 -- start start 2023-08-25T04:21:26.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.091+0000 7f28fc8d5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28f815c9f0 0x7f28f80b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:26.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.091+0000 7f28fc8d5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28f80d0340 0x7f28f806a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:26.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.091+0000 7f28fc8d5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f80b4b20 con 0x7f28f806aee0 2023-08-25T04:21:26.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.091+0000 7f28fc8d5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f80b4e00 con 0x7f28f80d0340 2023-08-25T04:21:26.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.091+0000 7f28fc8d5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80cd530 con 0x7f28f815c9f0 2023-08-25T04:21:26.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.091+0000 7f28f7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f28f806aee0 0x7f28f80cdd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40380/0 (socket says 172.21.15.55:40380) 2023-08-25T04:21:26.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.091+0000 7f28f7fff640 1 -- 172.21.15.55:0/4171135474 learned_addr learned my addr 172.21.15.55:0/4171135474 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:26.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.091+0000 7f28f77fe640 1 --2- 172.21.15.55:0/4171135474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28f815c9f0 0x7f28f80b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:26.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.091+0000 7f28f6ffd640 1 --2- 172.21.15.55:0/4171135474 >> v2:172.21.15.110:3300/0 conn(0x7f28f80d0340 0x7f28f806a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:26.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.091+0000 7f28f67fc640 1 -- 172.21.15.55:0/4171135474 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340166988 0 0) 0x7f28f80b4b20 con 0x7f28f806aee0 2023-08-25T04:21:26.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.091+0000 7f28f67fc640 1 -- 172.21.15.55:0/4171135474 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28e0003530 con 0x7f28f806aee0 2023-08-25T04:21:26.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.091+0000 7f28f77fe640 1 -- 172.21.15.55:0/4171135474 >> v2:172.21.15.110:3300/0 conn(0x7f28f80d0340 msgr2=0x7f28f806a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:26.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.091+0000 7f28f77fe640 1 --2- 172.21.15.55:0/4171135474 >> v2:172.21.15.110:3300/0 conn(0x7f28f80d0340 0x7f28f806a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.091+0000 7f28f77fe640 1 -- 172.21.15.55:0/4171135474 >> v1:172.21.15.55:6789/0 conn(0x7f28f806aee0 legacy=0x7f28f80cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:26.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.091+0000 7f28f77fe640 1 -- 172.21.15.55:0/4171135474 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f80cd810 con 0x7f28f815c9f0 2023-08-25T04:21:26.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.095+0000 7f28f77fe640 1 --2- 172.21.15.55:0/4171135474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28f815c9f0 0x7f28f80b1ac0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f28e80097a0 tx=0x7f28e801ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7b12bb24295c2b6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:26.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.095+0000 7f28f67fc640 1 -- 172.21.15.55:0/4171135474 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e80a8950 con 0x7f28f815c9f0 2023-08-25T04:21:26.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.095+0000 7f28f67fc640 1 -- 172.21.15.55:0/4171135474 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e80a8ab0 con 0x7f28f815c9f0 2023-08-25T04:21:26.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.095+0000 7f28f67fc640 1 -- 172.21.15.55:0/4171135474 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e80a8e40 con 0x7f28f815c9f0 2023-08-25T04:21:26.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.095+0000 7f28fc8d5640 1 -- 172.21.15.55:0/4171135474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28f815c9f0 msgr2=0x7f28f80b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:26.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.095+0000 7f28fc8d5640 1 --2- 172.21.15.55:0/4171135474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28f815c9f0 0x7f28f80b1ac0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f28e80097a0 tx=0x7f28e801ec50 comp rx=0 tx=0).stop 2023-08-25T04:21:26.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.095+0000 7f28fc8d5640 1 -- 172.21.15.55:0/4171135474 shutdown_connections 2023-08-25T04:21:26.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.095+0000 7f28fc8d5640 1 --2- 172.21.15.55:0/4171135474 >> v2:172.21.15.110:3300/0 conn(0x7f28f80d0340 0x7f28f806a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.095+0000 7f28fc8d5640 1 --2- 172.21.15.55:0/4171135474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28f815c9f0 0x7f28f80b1ac0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.095+0000 7f28fc8d5640 1 -- 172.21.15.55:0/4171135474 >> 172.21.15.55:0/4171135474 conn(0x7f28f80d25f0 msgr2=0x7f28f80d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:26.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.095+0000 7f28fc8d5640 1 -- 172.21.15.55:0/4171135474 shutdown_connections 2023-08-25T04:21:26.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.095+0000 7f28fc8d5640 1 -- 172.21.15.55:0/4171135474 wait complete. 2023-08-25T04:21:26.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28fc8d5640 1 Processor -- start 2023-08-25T04:21:26.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28fc8d5640 1 -- start start 2023-08-25T04:21:26.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28fc8d5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28f806aee0 0x7f28f81513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:26.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28fc8d5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28f80d0340 0x7f28f80b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:26.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28fc8d5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28f815c9f0 0x7f28f80b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:26.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28fc8d5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80b5ec0 con 0x7f28f815c9f0 2023-08-25T04:21:26.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28fc8d5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f8151930 con 0x7f28f80d0340 2023-08-25T04:21:26.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28fc8d5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f80b52b0 con 0x7f28f806aee0 2023-08-25T04:21:26.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28f7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28f815c9f0 0x7f28f80b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:26.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28f77fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28f806aee0 0x7f28f81513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:26.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28f77fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28f806aee0 0x7f28f81513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:44036/0 (socket says 172.21.15.55:44036) 2023-08-25T04:21:26.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28f77fe640 1 -- 172.21.15.55:0/991418870 learned_addr learned my addr 172.21.15.55:0/991418870 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:26.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28f6ffd640 1 --2- 172.21.15.55:0/991418870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28f80d0340 0x7f28f80b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28f77fe640 1 -- 172.21.15.55:0/991418870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28f80d0340 msgr2=0x7f28f80b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28f77fe640 1 --2- 172.21.15.55:0/991418870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28f80d0340 0x7f28f80b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28f77fe640 1 -- 172.21.15.55:0/991418870 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28f815c9f0 msgr2=0x7f28f80b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28f77fe640 1 --2- 172.21.15.55:0/991418870 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28f815c9f0 0x7f28f80b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28f77fe640 1 -- 172.21.15.55:0/991418870 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e80093b0 con 0x7f28f806aee0 2023-08-25T04:21:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28f7fff640 1 --2- 172.21.15.55:0/991418870 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28f815c9f0 0x7f28f80b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28f77fe640 1 --2- 172.21.15.55:0/991418870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28f806aee0 0x7f28f81513f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f28e80b3040 tx=0x7f28e801b9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28dffff640 1 -- 172.21.15.55:0/991418870 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e80b0d80 con 0x7f28f806aee0 2023-08-25T04:21:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28dffff640 1 -- 172.21.15.55:0/991418870 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e80b9430 con 0x7f28f806aee0 2023-08-25T04:21:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28dffff640 1 -- 172.21.15.55:0/991418870 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e80b97c0 con 0x7f28f806aee0 2023-08-25T04:21:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28fc8d5640 1 -- 172.21.15.55:0/991418870 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f80b5590 con 0x7f28f806aee0 2023-08-25T04:21:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.099+0000 7f28fc8d5640 1 -- 172.21.15.55:0/991418870 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f80b5b50 con 0x7f28f806aee0 2023-08-25T04:21:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.103+0000 7f28fc8d5640 1 -- 172.21.15.55:0/991418870 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f80b6070 con 0x7f28f806aee0 2023-08-25T04:21:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.103+0000 7f28dffff640 1 -- 172.21.15.55:0/991418870 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f28e80b7040 con 0x7f28f806aee0 2023-08-25T04:21:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.103+0000 7f28dffff640 1 --2- 172.21.15.55:0/991418870 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f28e40657a0 0x7f28e4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.103+0000 7f28dffff640 1 -- 172.21.15.55:0/991418870 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f28e8120880 con 0x7f28f806aee0 2023-08-25T04:21:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.103+0000 7f28f6ffd640 1 --2- 172.21.15.55:0/991418870 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f28e40657a0 0x7f28e4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.103+0000 7f28f6ffd640 1 --2- 172.21.15.55:0/991418870 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f28e40657a0 0x7f28e4067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f28f81f5240 tx=0x7f28ec009190 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.107+0000 7f28dffff640 1 -- 172.21.15.55:0/991418870 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f28e80ee530 con 0x7f28f806aee0 2023-08-25T04:21:26.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.295+0000 7f28fc8d5640 1 -- 172.21.15.55:0/991418870 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28f80b6070 con 0x7f28f806aee0 2023-08-25T04:21:26.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.299+0000 7f28dffff640 1 -- 172.21.15.55:0/991418870 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f28f80b6070 con 0x7f28f806aee0 2023-08-25T04:21:26.296 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:26.296 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2585223071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2585223071},{"type":"v1","addr":"172.21.15.55:6834","nonce":2585223071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52},{"gid":7918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3510911374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3510911374},{"type":"v1","addr":"172.21.15.110:6837","nonce":3510911374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":7921,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1404270940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1404270940},{"type":"v1","addr":"172.21.15.110:6836","nonce":1404270940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:21:22.282732+0000","modified":"2023-08-25T04:21:25.909779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8436":{"gid":8436,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1257898577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1257898577},{"type":"v1","addr":"172.21.15.55:6835","nonce":1257898577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-25T04:21:26.296 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 58 2023-08-25T04:21:26.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.299+0000 7f28fc8d5640 1 -- 172.21.15.55:0/991418870 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f28e40657a0 msgr2=0x7f28e4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:26.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.299+0000 7f28fc8d5640 1 --2- 172.21.15.55:0/991418870 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f28e40657a0 0x7f28e4067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f28f81f5240 tx=0x7f28ec009190 comp rx=0 tx=0).stop 2023-08-25T04:21:26.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.299+0000 7f28fc8d5640 1 -- 172.21.15.55:0/991418870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28f806aee0 msgr2=0x7f28f81513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:26.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.299+0000 7f28fc8d5640 1 --2- 172.21.15.55:0/991418870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28f806aee0 0x7f28f81513f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f28e80b3040 tx=0x7f28e801b9f0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.299+0000 7f28fc8d5640 1 -- 172.21.15.55:0/991418870 shutdown_connections 2023-08-25T04:21:26.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.299+0000 7f28fc8d5640 1 --2- 172.21.15.55:0/991418870 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f28e40657a0 0x7f28e4067c60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.299+0000 7f28fc8d5640 1 --2- 172.21.15.55:0/991418870 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28f815c9f0 0x7f28f80b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.299+0000 7f28fc8d5640 1 --2- 172.21.15.55:0/991418870 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28f80d0340 0x7f28f80b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.299+0000 7f28fc8d5640 1 --2- 172.21.15.55:0/991418870 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28f806aee0 0x7f28f81513f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.299+0000 7f28fc8d5640 1 -- 172.21.15.55:0/991418870 >> 172.21.15.55:0/991418870 conn(0x7f28f80d25f0 msgr2=0x7f28f80d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:26.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.299+0000 7f28fc8d5640 1 -- 172.21.15.55:0/991418870 shutdown_connections 2023-08-25T04:21:26.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.299+0000 7f28fc8d5640 1 -- 172.21.15.55:0/991418870 wait complete. 2023-08-25T04:21:26.316 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:21:26.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.463+0000 7f129ee3a640 1 Processor -- start 2023-08-25T04:21:26.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.463+0000 7f129ee3a640 1 -- start start 2023-08-25T04:21:26.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.463+0000 7f129ee3a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f129815c9f0 0x7f12980b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:26.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.463+0000 7f129ee3a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12980cdd30 0x7f12980ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:26.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.463+0000 7f129ee3a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12980b4b20 con 0x7f12980d0340 2023-08-25T04:21:26.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.463+0000 7f129ee3a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12980b4e00 con 0x7f129815c9f0 2023-08-25T04:21:26.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.463+0000 7f129ee3a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12980cd530 con 0x7f12980cdd30 2023-08-25T04:21:26.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.463+0000 7f129de38640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f129815c9f0 0x7f12980b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:26.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.463+0000 7f129de38640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f129815c9f0 0x7f12980b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55468/0 (socket says 172.21.15.55:55468) 2023-08-25T04:21:26.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.463+0000 7f129de38640 1 -- 172.21.15.55:0/3847943095 learned_addr learned my addr 172.21.15.55:0/3847943095 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:26.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.463+0000 7f129de38640 1 -- 172.21.15.55:0/3847943095 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12980cdd30 msgr2=0x7f12980ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:26.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.463+0000 7f129de38640 1 --2- 172.21.15.55:0/3847943095 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12980cdd30 0x7f12980ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.463+0000 7f129de38640 1 -- 172.21.15.55:0/3847943095 >> v1:172.21.15.110:6789/0 conn(0x7f12980d0340 legacy=0x7f129806a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:26.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.463+0000 7f129de38640 1 -- 172.21.15.55:0/3847943095 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12980cd810 con 0x7f129815c9f0 2023-08-25T04:21:26.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.467+0000 7f129de38640 1 --2- 172.21.15.55:0/3847943095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f129815c9f0 0x7f12980b1ac0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f1294009860 tx=0x7f129401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239c7c845ef431fb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:26.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.467+0000 7f129ce36640 1 -- 172.21.15.55:0/3847943095 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12940a8990 con 0x7f129815c9f0 2023-08-25T04:21:26.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.467+0000 7f129ce36640 1 -- 172.21.15.55:0/3847943095 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12940a8af0 con 0x7f129815c9f0 2023-08-25T04:21:26.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.467+0000 7f129ce36640 1 -- 172.21.15.55:0/3847943095 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12940a8e80 con 0x7f129815c9f0 2023-08-25T04:21:26.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.467+0000 7f129ee3a640 1 -- 172.21.15.55:0/3847943095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f129815c9f0 msgr2=0x7f12980b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:26.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.467+0000 7f129ee3a640 1 --2- 172.21.15.55:0/3847943095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f129815c9f0 0x7f12980b1ac0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f1294009860 tx=0x7f129401ecd0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.467+0000 7f129ee3a640 1 -- 172.21.15.55:0/3847943095 shutdown_connections 2023-08-25T04:21:26.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.467+0000 7f129ee3a640 1 --2- 172.21.15.55:0/3847943095 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12980cdd30 0x7f12980ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.467+0000 7f129ee3a640 1 --2- 172.21.15.55:0/3847943095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f129815c9f0 0x7f12980b1ac0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.467+0000 7f129ee3a640 1 -- 172.21.15.55:0/3847943095 >> 172.21.15.55:0/3847943095 conn(0x7f12980d25f0 msgr2=0x7f12980d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:26.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.467+0000 7f129ee3a640 1 -- 172.21.15.55:0/3847943095 shutdown_connections 2023-08-25T04:21:26.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.467+0000 7f129ee3a640 1 -- 172.21.15.55:0/3847943095 wait complete. 2023-08-25T04:21:26.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.467+0000 7f129ee3a640 1 Processor -- start 2023-08-25T04:21:26.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.467+0000 7f129ee3a640 1 -- start start 2023-08-25T04:21:26.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129ee3a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12980cdd30 0x7f12980c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:26.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129ee3a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12980d0340 0x7f12981f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:26.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129ee3a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f129815c9f0 0x7f12981f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:26.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129ee3a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12980c8ec0 con 0x7f129815c9f0 2023-08-25T04:21:26.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129ee3a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12980b3b70 con 0x7f12980d0340 2023-08-25T04:21:26.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129ee3a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12980b3e50 con 0x7f12980cdd30 2023-08-25T04:21:26.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129e639640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f129815c9f0 0x7f12981f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:26.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129e639640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f129815c9f0 0x7f12981f5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55474/0 (socket says 172.21.15.55:55474) 2023-08-25T04:21:26.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129e639640 1 -- 172.21.15.55:0/4286255375 learned_addr learned my addr 172.21.15.55:0/4286255375 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:26.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129de38640 1 --2- 172.21.15.55:0/4286255375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12980cdd30 0x7f12980c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:26.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129d637640 1 --2- 172.21.15.55:0/4286255375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12980d0340 0x7f12981f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:26.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129e639640 1 -- 172.21.15.55:0/4286255375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12980cdd30 msgr2=0x7f12980c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:26.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129e639640 1 --2- 172.21.15.55:0/4286255375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12980cdd30 0x7f12980c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129e639640 1 -- 172.21.15.55:0/4286255375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12980d0340 msgr2=0x7f12981f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:26.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129e639640 1 --2- 172.21.15.55:0/4286255375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12980d0340 0x7f12981f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129e639640 1 -- 172.21.15.55:0/4286255375 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1294009470 con 0x7f129815c9f0 2023-08-25T04:21:26.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129d637640 1 --2- 172.21.15.55:0/4286255375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12980d0340 0x7f12981f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:26.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129e639640 1 --2- 172.21.15.55:0/4286255375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f129815c9f0 0x7f12981f5ca0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f129000b970 tx=0x7f129000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:26.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f128e7fc640 1 -- 172.21.15.55:0/4286255375 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129000cb40 con 0x7f129815c9f0 2023-08-25T04:21:26.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f128e7fc640 1 -- 172.21.15.55:0/4286255375 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129000ccc0 con 0x7f129815c9f0 2023-08-25T04:21:26.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f128e7fc640 1 -- 172.21.15.55:0/4286255375 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290014680 con 0x7f129815c9f0 2023-08-25T04:21:26.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129ee3a640 1 -- 172.21.15.55:0/4286255375 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12980b4130 con 0x7f129815c9f0 2023-08-25T04:21:26.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129ee3a640 1 -- 172.21.15.55:0/4286255375 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12980c96d0 con 0x7f129815c9f0 2023-08-25T04:21:26.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.471+0000 7f129ee3a640 1 -- 172.21.15.55:0/4286255375 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12980c98f0 con 0x7f129815c9f0 2023-08-25T04:21:26.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.475+0000 7f128e7fc640 1 -- 172.21.15.55:0/4286255375 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f129001d3b0 con 0x7f129815c9f0 2023-08-25T04:21:26.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.475+0000 7f128e7fc640 1 --2- 172.21.15.55:0/4286255375 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f127c0657a0 0x7f127c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:26.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.475+0000 7f128e7fc640 1 -- 172.21.15.55:0/4286255375 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1290082dc0 con 0x7f129815c9f0 2023-08-25T04:21:26.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.475+0000 7f129de38640 1 --2- 172.21.15.55:0/4286255375 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f127c0657a0 0x7f127c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:26.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.475+0000 7f129de38640 1 --2- 172.21.15.55:0/4286255375 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f127c0657a0 0x7f127c067c60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f12940b2000 tx=0x7f1294008040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:26.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.479+0000 7f128e7fc640 1 -- 172.21.15.55:0/4286255375 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f12900508b0 con 0x7f129815c9f0 2023-08-25T04:21:26.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.639+0000 7f129ee3a640 1 -- 172.21.15.55:0/4286255375 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1298066d20 con 0x7f129815c9f0 2023-08-25T04:21:26.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.639+0000 7f128e7fc640 1 -- 172.21.15.55:0/4286255375 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+18305 (secure 0 0 0) 0x7f1290019090 con 0x7f129815c9f0 2023-08-25T04:21:26.637 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:26.637 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":122,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:21:23.894539+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:21:20.028451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-25T04:21:21.281198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:21:26.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.639+0000 7f129ee3a640 1 -- 172.21.15.55:0/4286255375 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f127c0657a0 msgr2=0x7f127c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:26.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.639+0000 7f129ee3a640 1 --2- 172.21.15.55:0/4286255375 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f127c0657a0 0x7f127c067c60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f12940b2000 tx=0x7f1294008040 comp rx=0 tx=0).stop 2023-08-25T04:21:26.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.639+0000 7f129ee3a640 1 -- 172.21.15.55:0/4286255375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f129815c9f0 msgr2=0x7f12981f5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:26.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.639+0000 7f129ee3a640 1 --2- 172.21.15.55:0/4286255375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f129815c9f0 0x7f12981f5ca0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f129000b970 tx=0x7f129000be30 comp rx=0 tx=0).stop 2023-08-25T04:21:26.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.639+0000 7f129ee3a640 1 -- 172.21.15.55:0/4286255375 shutdown_connections 2023-08-25T04:21:26.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.639+0000 7f129ee3a640 1 --2- 172.21.15.55:0/4286255375 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f127c0657a0 0x7f127c067c60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.639+0000 7f129ee3a640 1 --2- 172.21.15.55:0/4286255375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f129815c9f0 0x7f12981f5ca0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.639+0000 7f129ee3a640 1 --2- 172.21.15.55:0/4286255375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12980d0340 0x7f12981f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.639+0000 7f129ee3a640 1 --2- 172.21.15.55:0/4286255375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12980cdd30 0x7f12980c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.639+0000 7f129ee3a640 1 -- 172.21.15.55:0/4286255375 >> 172.21.15.55:0/4286255375 conn(0x7f12980d25f0 msgr2=0x7f129806bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:26.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.639+0000 7f129ee3a640 1 -- 172.21.15.55:0/4286255375 shutdown_connections 2023-08-25T04:21:26.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.639+0000 7f129ee3a640 1 -- 172.21.15.55:0/4286255375 wait complete. 2023-08-25T04:21:26.658 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-25T04:21:26.659 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:21:26.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.803+0000 7f9610dfa640 1 Processor -- start 2023-08-25T04:21:26.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.803+0000 7f9610dfa640 1 -- start start 2023-08-25T04:21:26.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.807+0000 7f9610dfa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f960c0ceeb0 0x7f960c0cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:26.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.807+0000 7f9610dfa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f960c0c89f0 0x7f960c0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:26.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.807+0000 7f9610dfa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960c0cc880 con 0x7f960c0ad950 2023-08-25T04:21:26.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.807+0000 7f9610dfa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960c0b11f0 con 0x7f960c0ceeb0 2023-08-25T04:21:26.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.807+0000 7f9610dfa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c159d50 con 0x7f960c0c89f0 2023-08-25T04:21:26.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.807+0000 7f9603fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f960c0ceeb0 0x7f960c0cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:26.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.807+0000 7f9603fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f960c0ceeb0 0x7f960c0cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55480/0 (socket says 172.21.15.55:55480) 2023-08-25T04:21:26.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.807+0000 7f9603fff640 1 -- 172.21.15.55:0/1580160877 learned_addr learned my addr 172.21.15.55:0/1580160877 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:26.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.807+0000 7f960ad9d640 1 --2- 172.21.15.55:0/1580160877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f960c0c89f0 0x7f960c0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:26.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.807+0000 7f9603fff640 1 -- 172.21.15.55:0/1580160877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f960c0c89f0 msgr2=0x7f960c0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:26.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.807+0000 7f9603fff640 1 --2- 172.21.15.55:0/1580160877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f960c0c89f0 0x7f960c0b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.807+0000 7f9603fff640 1 -- 172.21.15.55:0/1580160877 >> v1:172.21.15.110:6789/0 conn(0x7f960c0ad950 legacy=0x7f960c0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:26.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.807+0000 7f9603fff640 1 -- 172.21.15.55:0/1580160877 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c0ccb60 con 0x7f960c0ceeb0 2023-08-25T04:21:26.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.807+0000 7f960ad9d640 1 --2- 172.21.15.55:0/1580160877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f960c0c89f0 0x7f960c0b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:26.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.811+0000 7f9603fff640 1 --2- 172.21.15.55:0/1580160877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f960c0ceeb0 0x7f960c0cc2a0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009870 tx=0x7f95f401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e67227a1077d9f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:26.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.811+0000 7f9609d9b640 1 -- 172.21.15.55:0/1580160877 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40ad640 con 0x7f960c0ceeb0 2023-08-25T04:21:26.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.811+0000 7f9609d9b640 1 -- 172.21.15.55:0/1580160877 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f40ad7a0 con 0x7f960c0ceeb0 2023-08-25T04:21:26.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.811+0000 7f9609d9b640 1 -- 172.21.15.55:0/1580160877 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40adb30 con 0x7f960c0ceeb0 2023-08-25T04:21:26.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.811+0000 7f9610dfa640 1 -- 172.21.15.55:0/1580160877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f960c0ceeb0 msgr2=0x7f960c0cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:26.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.811+0000 7f9610dfa640 1 --2- 172.21.15.55:0/1580160877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f960c0ceeb0 0x7f960c0cc2a0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009870 tx=0x7f95f401c480 comp rx=0 tx=0).stop 2023-08-25T04:21:26.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.811+0000 7f9610dfa640 1 -- 172.21.15.55:0/1580160877 shutdown_connections 2023-08-25T04:21:26.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.811+0000 7f9610dfa640 1 --2- 172.21.15.55:0/1580160877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f960c0c89f0 0x7f960c0b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.811+0000 7f9610dfa640 1 --2- 172.21.15.55:0/1580160877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f960c0ceeb0 0x7f960c0cc2a0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.811+0000 7f9610dfa640 1 -- 172.21.15.55:0/1580160877 >> 172.21.15.55:0/1580160877 conn(0x7f960c069d00 msgr2=0x7f960c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:26.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.811+0000 7f9610dfa640 1 -- 172.21.15.55:0/1580160877 shutdown_connections 2023-08-25T04:21:26.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.811+0000 7f9610dfa640 1 -- 172.21.15.55:0/1580160877 wait complete. 2023-08-25T04:21:26.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.811+0000 7f9610dfa640 1 Processor -- start 2023-08-25T04:21:26.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.811+0000 7f9610dfa640 1 -- start start 2023-08-25T04:21:26.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.811+0000 7f9610dfa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f960c0ad950 0x7f960c097940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:26.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.811+0000 7f9610dfa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f960c0c89f0 0x7f960c150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:26.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.811+0000 7f9610dfa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f960c0ceeb0 0x7f960c151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:26.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.811+0000 7f9610dfa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c152750 con 0x7f960c0ceeb0 2023-08-25T04:21:26.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f9610dfa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c1524e0 con 0x7f960c0c89f0 2023-08-25T04:21:26.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f9610dfa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c097e80 con 0x7f960c0ad950 2023-08-25T04:21:26.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f960ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f960c0ceeb0 0x7f960c151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:26.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f960ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f960c0ceeb0 0x7f960c151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55494/0 (socket says 172.21.15.55:55494) 2023-08-25T04:21:26.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f960ad9d640 1 -- 172.21.15.55:0/3785373903 learned_addr learned my addr 172.21.15.55:0/3785373903 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:26.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f9603fff640 1 --2- 172.21.15.55:0/3785373903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f960c0c89f0 0x7f960c150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:26.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f960a59c640 1 --2- 172.21.15.55:0/3785373903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f960c0ad950 0x7f960c097940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:26.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f960ad9d640 1 -- 172.21.15.55:0/3785373903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f960c0ad950 msgr2=0x7f960c097940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:26.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f960ad9d640 1 --2- 172.21.15.55:0/3785373903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f960c0ad950 0x7f960c097940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f960ad9d640 1 -- 172.21.15.55:0/3785373903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f960c0c89f0 msgr2=0x7f960c150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:26.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f960ad9d640 1 --2- 172.21.15.55:0/3785373903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f960c0c89f0 0x7f960c150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f960ad9d640 1 -- 172.21.15.55:0/3785373903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f40094d0 con 0x7f960c0ceeb0 2023-08-25T04:21:26.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f960a59c640 1 --2- 172.21.15.55:0/3785373903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f960c0ad950 0x7f960c097940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:26.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f960ad9d640 1 --2- 172.21.15.55:0/3785373903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f960c0ceeb0 0x7f960c151420 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f9604007f20 tx=0x7f960400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:26.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f9602ffd640 1 -- 172.21.15.55:0/3785373903 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960400dee0 con 0x7f960c0ceeb0 2023-08-25T04:21:26.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f9602ffd640 1 -- 172.21.15.55:0/3785373903 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960400f040 con 0x7f960c0ceeb0 2023-08-25T04:21:26.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f9610dfa640 1 -- 172.21.15.55:0/3785373903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c1585a0 con 0x7f960c0ceeb0 2023-08-25T04:21:26.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f9602ffd640 1 -- 172.21.15.55:0/3785373903 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604003de0 con 0x7f960c0ceeb0 2023-08-25T04:21:26.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f9610dfa640 1 -- 172.21.15.55:0/3785373903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c158b60 con 0x7f960c0ceeb0 2023-08-25T04:21:26.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f9610dfa640 1 -- 172.21.15.55:0/3785373903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c158d50 con 0x7f960c0ceeb0 2023-08-25T04:21:26.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.815+0000 7f9602ffd640 1 -- 172.21.15.55:0/3785373903 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f9604004030 con 0x7f960c0ceeb0 2023-08-25T04:21:26.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.819+0000 7f9602ffd640 1 --2- 172.21.15.55:0/3785373903 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f95ec0657a0 0x7f95ec067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:26.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.819+0000 7f9602ffd640 1 -- 172.21.15.55:0/3785373903 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9604083470 con 0x7f960c0ceeb0 2023-08-25T04:21:26.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.819+0000 7f960a59c640 1 --2- 172.21.15.55:0/3785373903 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f95ec0657a0 0x7f95ec067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:26.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.819+0000 7f960a59c640 1 --2- 172.21.15.55:0/3785373903 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f95ec0657a0 0x7f95ec067c60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f95fc000f70 tx=0x7f95fc009040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:26.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.819+0000 7f9602ffd640 1 -- 172.21.15.55:0/3785373903 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9604050d20 con 0x7f960c0ceeb0 2023-08-25T04:21:26.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.979+0000 7f9610dfa640 1 -- 172.21.15.55:0/3785373903 --> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f960c0b3130 con 0x7f95ec0657a0 2023-08-25T04:21:26.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.991+0000 7f9602ffd640 1 -- 172.21.15.55:0/3785373903 <== mgr.6902 v2:172.21.15.110:6832/4272914017 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299510 (secure 0 0 0) 0x7f95fc001ca0 con 0x7f95ec0657a0 2023-08-25T04:21:26.991 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:26.993 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:21:26.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.995+0000 7f9610dfa640 1 -- 172.21.15.55:0/3785373903 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f95ec0657a0 msgr2=0x7f95ec067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:26.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.995+0000 7f9610dfa640 1 --2- 172.21.15.55:0/3785373903 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f95ec0657a0 0x7f95ec067c60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f95fc000f70 tx=0x7f95fc009040 comp rx=0 tx=0).stop 2023-08-25T04:21:26.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.995+0000 7f9610dfa640 1 -- 172.21.15.55:0/3785373903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f960c0ceeb0 msgr2=0x7f960c151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:26.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.995+0000 7f9610dfa640 1 --2- 172.21.15.55:0/3785373903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f960c0ceeb0 0x7f960c151420 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f9604007f20 tx=0x7f960400d560 comp rx=0 tx=0).stop 2023-08-25T04:21:26.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.995+0000 7f9610dfa640 1 -- 172.21.15.55:0/3785373903 shutdown_connections 2023-08-25T04:21:26.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.995+0000 7f9610dfa640 1 --2- 172.21.15.55:0/3785373903 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f95ec0657a0 0x7f95ec067c60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.995+0000 7f9610dfa640 1 --2- 172.21.15.55:0/3785373903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f960c0ceeb0 0x7f960c151420 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.995+0000 7f9610dfa640 1 --2- 172.21.15.55:0/3785373903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f960c0c89f0 0x7f960c150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.995+0000 7f9610dfa640 1 --2- 172.21.15.55:0/3785373903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f960c0ad950 0x7f960c097940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:26.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.995+0000 7f9610dfa640 1 -- 172.21.15.55:0/3785373903 >> 172.21.15.55:0/3785373903 conn(0x7f960c069d00 msgr2=0x7f960c0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:26.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.995+0000 7f9610dfa640 1 -- 172.21.15.55:0/3785373903 shutdown_connections 2023-08-25T04:21:26.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:26.995+0000 7f9610dfa640 1 -- 172.21.15.55:0/3785373903 wait complete. 2023-08-25T04:21:27.011 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-25T04:21:25.543156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1040,"num_read_kb":2137,"num_write":345,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3532,"ondisk_log_size":3532,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":327216,"kb_used_data":12548,"kb_used_omap":13,"kb_used_meta":314546,"kb_avail":754647504,"statfs":{"total":773094113280,"available":772759044096,"internally_reserved":0,"allocated":12849152,"data_stored":6976082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":322095192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.675585"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.876934+0000","last_change":"2023-08-25T04:21:20.876934+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.876934+0000","last_undegraded":"2023-08-25T04:21:20.876934+0000","last_fullsized":"2023-08-25T04:21:20.876934+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.877854+0000","last_change":"2023-08-25T04:21:20.877854+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.877854+0000","last_undegraded":"2023-08-25T04:21:20.877854+0000","last_fullsized":"2023-08-25T04:21:20.877854+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.874561+0000","last_change":"2023-08-25T04:21:20.874561+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.874561+0000","last_undegraded":"2023-08-25T04:21:20.874561+0000","last_fullsized":"2023-08-25T04:21:20.874561+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.872716+0000","last_change":"2023-08-25T04:21:20.872716+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.872716+0000","last_undegraded":"2023-08-25T04:21:20.872716+0000","last_fullsized":"2023-08-25T04:21:20.872716+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.876570+0000","last_change":"2023-08-25T04:21:20.876570+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.876570+0000","last_undegraded":"2023-08-25T04:21:20.876570+0000","last_fullsized":"2023-08-25T04:21:20.876570+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.869664+0000","last_change":"2023-08-25T04:21:20.869664+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.869664+0000","last_undegraded":"2023-08-25T04:21:20.869664+0000","last_fullsized":"2023-08-25T04:21:20.869664+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.872680+0000","last_change":"2023-08-25T04:21:20.872680+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.872680+0000","last_undegraded":"2023-08-25T04:21:20.872680+0000","last_fullsized":"2023-08-25T04:21:20.872680+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.876007+0000","last_change":"2023-08-25T04:21:20.876007+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.876007+0000","last_undegraded":"2023-08-25T04:21:20.876007+0000","last_fullsized":"2023-08-25T04:21:20.876007+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.872779+0000","last_change":"2023-08-25T04:21:20.872779+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.872779+0000","last_undegraded":"2023-08-25T04:21:20.872779+0000","last_fullsized":"2023-08-25T04:21:20.872779+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.875758+0000","last_change":"2023-08-25T04:21:20.875758+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.875758+0000","last_undegraded":"2023-08-25T04:21:20.875758+0000","last_fullsized":"2023-08-25T04:21:20.875758+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.877095+0000","last_change":"2023-08-25T04:21:20.877095+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.877095+0000","last_undegraded":"2023-08-25T04:21:20.877095+0000","last_fullsized":"2023-08-25T04:21:20.877095+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.869846+0000","last_change":"2023-08-25T04:21:20.869846+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.869846+0000","last_undegraded":"2023-08-25T04:21:20.869846+0000","last_fullsized":"2023-08-25T04:21:20.869846+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.872051+0000","last_change":"2023-08-25T04:21:20.872051+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.872051+0000","last_undegraded":"2023-08-25T04:21:20.872051+0000","last_fullsized":"2023-08-25T04:21:20.872051+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.876343+0000","last_change":"2023-08-25T04:21:20.876343+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.876343+0000","last_undegraded":"2023-08-25T04:21:20.876343+0000","last_fullsized":"2023-08-25T04:21:20.876343+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.874985+0000","last_change":"2023-08-25T04:21:20.874985+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.874985+0000","last_undegraded":"2023-08-25T04:21:20.874985+0000","last_fullsized":"2023-08-25T04:21:20.874985+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.872705+0000","last_change":"2023-08-25T04:21:20.872705+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.872705+0000","last_undegraded":"2023-08-25T04:21:20.872705+0000","last_fullsized":"2023-08-25T04:21:20.872705+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.872017+0000","last_change":"2023-08-25T04:21:20.872017+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.872017+0000","last_undegraded":"2023-08-25T04:21:20.872017+0000","last_fullsized":"2023-08-25T04:21:20.872017+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.875015+0000","last_change":"2023-08-25T04:21:20.875015+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.875015+0000","last_undegraded":"2023-08-25T04:21:20.875015+0000","last_fullsized":"2023-08-25T04:21:20.875015+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.870253+0000","last_change":"2023-08-25T04:21:20.870253+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.870253+0000","last_undegraded":"2023-08-25T04:21:20.870253+0000","last_fullsized":"2023-08-25T04:21:20.870253+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.872045+0000","last_change":"2023-08-25T04:21:20.872045+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.872045+0000","last_undegraded":"2023-08-25T04:21:20.872045+0000","last_fullsized":"2023-08-25T04:21:20.872045+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.872766+0000","last_change":"2023-08-25T04:21:20.872766+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.872766+0000","last_undegraded":"2023-08-25T04:21:20.872766+0000","last_fullsized":"2023-08-25T04:21:20.872766+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.875201+0000","last_change":"2023-08-25T04:21:20.875201+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.875201+0000","last_undegraded":"2023-08-25T04:21:20.875201+0000","last_fullsized":"2023-08-25T04:21:20.875201+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.869715+0000","last_change":"2023-08-25T04:21:20.869715+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.869715+0000","last_undegraded":"2023-08-25T04:21:20.869715+0000","last_fullsized":"2023-08-25T04:21:20.869715+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.875170+0000","last_change":"2023-08-25T04:21:20.875170+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.875170+0000","last_undegraded":"2023-08-25T04:21:20.875170+0000","last_fullsized":"2023-08-25T04:21:20.875170+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.875090+0000","last_change":"2023-08-25T04:21:20.875090+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.875090+0000","last_undegraded":"2023-08-25T04:21:20.875090+0000","last_fullsized":"2023-08-25T04:21:20.875090+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"111'3532","reported_seq":4050,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-25T04:21:20.877563+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:21:20.877563+0000","last_peered":"2023-08-25T04:21:20.877563+0000","last_clean":"2023-08-25T04:21:20.877563+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:21:20.877563+0000","last_undegraded":"2023-08-25T04:21:20.877563+0000","last_fullsized":"2023-08-25T04:21:20.877563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:49:03.731845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1040,"num_read_kb":2137,"num_write":345,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":181,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-25T04:21:20.870796+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:21:20.870796+0000","last_peered":"2023-08-25T04:21:20.870796+0000","last_clean":"2023-08-25T04:21:20.870796+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:21:20.870796+0000","last_undegraded":"2023-08-25T04:21:20.870796+0000","last_fullsized":"2023-08-25T04:21:20.870796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:37:51.156102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.876555+0000","last_change":"2023-08-25T04:21:20.876555+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.876555+0000","last_undegraded":"2023-08-25T04:21:20.876555+0000","last_fullsized":"2023-08-25T04:21:20.876555+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-25T04:21:20.877566+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:21:20.877566+0000","last_peered":"2023-08-25T04:21:20.877566+0000","last_clean":"2023-08-25T04:21:20.877566+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:21:20.877566+0000","last_undegraded":"2023-08-25T04:21:20.877566+0000","last_fullsized":"2023-08-25T04:21:20.877566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:39:16.229891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.869686+0000","last_change":"2023-08-25T04:21:20.869686+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.869686+0000","last_undegraded":"2023-08-25T04:21:20.869686+0000","last_fullsized":"2023-08-25T04:21:20.869686+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":189,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-25T04:21:20.879051+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:21:20.879051+0000","last_peered":"2023-08-25T04:21:20.879051+0000","last_clean":"2023-08-25T04:21:20.879051+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:21:20.879051+0000","last_undegraded":"2023-08-25T04:21:20.879051+0000","last_fullsized":"2023-08-25T04:21:20.879051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:29:13.975800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.870319+0000","last_change":"2023-08-25T04:21:20.870319+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.870319+0000","last_undegraded":"2023-08-25T04:21:20.870319+0000","last_fullsized":"2023-08-25T04:21:20.870319+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":181,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-25T04:21:20.871010+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:21:20.871010+0000","last_peered":"2023-08-25T04:21:20.871010+0000","last_clean":"2023-08-25T04:21:20.871010+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:21:20.871010+0000","last_undegraded":"2023-08-25T04:21:20.871010+0000","last_fullsized":"2023-08-25T04:21:20.871010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:24:36.573650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.870333+0000","last_change":"2023-08-25T04:21:20.870333+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.870333+0000","last_undegraded":"2023-08-25T04:21:20.870333+0000","last_fullsized":"2023-08-25T04:21:20.870333+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":197,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-25T04:21:20.870603+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:21:20.870603+0000","last_peered":"2023-08-25T04:21:20.870603+0000","last_clean":"2023-08-25T04:21:20.870603+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:21:20.870603+0000","last_undegraded":"2023-08-25T04:21:20.870603+0000","last_fullsized":"2023-08-25T04:21:20.870603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:24:40.529358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.877061+0000","last_change":"2023-08-25T04:21:20.877061+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.877061+0000","last_undegraded":"2023-08-25T04:21:20.877061+0000","last_fullsized":"2023-08-25T04:21:20.877061+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":183,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-25T04:21:20.877711+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:21:20.877711+0000","last_peered":"2023-08-25T04:21:20.877711+0000","last_clean":"2023-08-25T04:21:20.877711+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:21:20.877711+0000","last_undegraded":"2023-08-25T04:21:20.877711+0000","last_fullsized":"2023-08-25T04:21:20.877711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:04:48.154532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.875109+0000","last_change":"2023-08-25T04:21:20.875109+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.875109+0000","last_undegraded":"2023-08-25T04:21:20.875109+0000","last_fullsized":"2023-08-25T04:21:20.875109+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":197,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-25T04:21:20.870636+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:21:20.870636+0000","last_peered":"2023-08-25T04:21:20.870636+0000","last_clean":"2023-08-25T04:21:20.870636+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:21:20.870636+0000","last_undegraded":"2023-08-25T04:21:20.870636+0000","last_fullsized":"2023-08-25T04:21:20.870636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:44:04.580470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.877264+0000","last_change":"2023-08-25T04:21:20.877264+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.877264+0000","last_undegraded":"2023-08-25T04:21:20.877264+0000","last_fullsized":"2023-08-25T04:21:20.877264+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":211,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-25T04:21:20.871763+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:21:20.871763+0000","last_peered":"2023-08-25T04:21:20.871763+0000","last_clean":"2023-08-25T04:21:20.871763+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:21:20.871763+0000","last_undegraded":"2023-08-25T04:21:20.871763+0000","last_fullsized":"2023-08-25T04:21:20.871763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:25.456765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1040,"num_read_kb":2137,"num_write":345,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3532,"ondisk_log_size":3532,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509662,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59556,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312284,"statfs":{"total":96636764160,"available":96575778816,"internally_reserved":0,"allocated":2056192,"data_stored":1317100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.65300000000000002,"15min":0.69599999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.33700000000000002},"max":{"1min":0.81000000000000005,"5min":0.94099999999999995,"15min":0.996},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.66200000000000003,"15min":0.71399999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86499999999999999,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.78200000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68400000000000005,"15min":0.72699999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88300000000000001,"5min":0.92100000000000004,"15min":1.034},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.67500000000000004,"15min":0.72599999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.374},"max":{"1min":0.81699999999999995,"5min":0.995,"15min":1.036},"last":0.95899999999999996}]},{"osd":2,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.66900000000000004,"15min":0.70799999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.34899999999999998},"max":{"1min":0.89700000000000002,"5min":0.94299999999999995,"15min":1.018},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68899999999999995,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":0.83699999999999997,"5min":1.046,"15min":1.046},"last":0.94299999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.68899999999999995,"15min":0.72999999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.80400000000000005,"5min":0.90900000000000003,"15min":0.98399999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.70799999999999996,"15min":0.74399999999999999},"min":{"1min":0.498,"5min":0.48199999999999998,"15min":0.432},"max":{"1min":0.91300000000000003,"5min":1.04,"15min":1.04},"last":0.89100000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32400000000000001},"max":{"1min":0.74199999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85099999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.878}]},{"osd":5,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.40500000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.79300000000000004,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76400000000000001,"5min":1.032,"15min":1.0349999999999999},"last":0.83599999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.67700000000000005,"15min":0.68600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.76600000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.65400000000000003,"15min":0.65800000000000003},"min":{"1min":0.42799999999999999,"5min":0.42699999999999999,"15min":0.42399999999999999},"max":{"1min":0.93700000000000006,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.92500000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509662,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36768,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335072,"statfs":{"total":96636764160,"available":96599113728,"internally_reserved":0,"allocated":1462272,"data_stored":726732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:20:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.64200000000000002,"15min":0.69499999999999995},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80300000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.65700000000000003,"15min":0.69099999999999995},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86599999999999999,"5min":0.96499999999999997,"15min":1.054},"last":0.59399999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:20:22 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.67200000000000004,"15min":0.72399999999999998},"min":{"1min":0.39600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78300000000000003,"5min":1.0269999999999999,"15min":1.0369999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.69599999999999995,"15min":0.72199999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92900000000000005,"5min":1.109,"15min":1.109},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:20:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68899999999999995,"15min":0.73099999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93000000000000005,"5min":1.0009999999999999,"15min":1.1020000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.74399999999999999,"15min":0.78500000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.996,"5min":1.0569999999999999,"15min":1.117},"last":0.68400000000000005}]},{"osd":3,"last update":"Fri Aug 25 04:20:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72799999999999998,"15min":0.74299999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.46899999999999997},"max":{"1min":0.95399999999999996,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.629},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.71999999999999997,"15min":0.753},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88600000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.61199999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:20:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.751,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.436},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83699999999999997,"5min":0.95799999999999996,"15min":1.0820000000000001},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:20:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.442,"5min":0.39200000000000002,"15min":0.373},"max":{"1min":0.82999999999999996,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89800000000000002,"5min":1.141,"15min":1.141},"last":0.70699999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:20:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.41399999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86599999999999999,"5min":1.0389999999999999,"15min":1.1950000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.72399999999999998,"15min":0.69599999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.44700000000000001},"max":{"1min":0.85799999999999998,"5min":1.373,"15min":1.373},"last":0.47299999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542365,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1462272,"data_stored":726732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65200000000000002,"15min":0.69799999999999995},"min":{"1min":0.498,"5min":0.313,"15min":0.313},"max":{"1min":0.91300000000000003,"5min":0.98099999999999998,"15min":1.018},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66900000000000004,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0409999999999999},"last":0.71399999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.67000000000000004,"15min":0.71899999999999997},"min":{"1min":0.51200000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.99399999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.70299999999999996,"15min":0.73099999999999998},"min":{"1min":0.46400000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.66300000000000003,"15min":0.71499999999999997},"min":{"1min":0.58699999999999997,"5min":0.40799999999999997,"15min":0.39500000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.97499999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70199999999999996,"15min":0.73599999999999999},"min":{"1min":0.58499999999999996,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70199999999999996,"15min":0.72599999999999998},"min":{"1min":0.55800000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.94199999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.70999999999999996,"15min":0.75600000000000001},"min":{"1min":0.626,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.008,"5min":1.028,"15min":1.028},"last":0.72799999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.44500000000000001,"5min":0.38400000000000001,"15min":0.35399999999999998},"max":{"1min":0.72199999999999998,"5min":0.91000000000000003,"15min":0.97099999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.46800000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.874,"5min":0.99399999999999999,"15min":1.018},"last":0.748}]},{"osd":6,"last update":"Fri Aug 25 04:21:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.44600000000000001,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.82399999999999995,"5min":0.96799999999999997,"15min":1.008},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.48199999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79400000000000004,"5min":0.94199999999999995,"15min":0.98299999999999998},"last":0.69799999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:21:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.63400000000000001,"15min":0.61499999999999999},"min":{"1min":0.47499999999999998,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.84699999999999998,"5min":0.93300000000000005,"15min":1.032},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69099999999999995,"15min":0.68999999999999995},"min":{"1min":0.55700000000000005,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.94999999999999996,"5min":1.01,"15min":1.048},"last":0.59099999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542365,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1449984,"data_stored":720562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64600000000000002,"15min":0.69599999999999995},"min":{"1min":0.45600000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.99299999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65700000000000003,"15min":0.69099999999999995},"min":{"1min":0.499,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83699999999999997,"5min":0.90200000000000002,"15min":0.96699999999999997},"last":0.53400000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.68700000000000006,"15min":0.72199999999999998},"min":{"1min":0.46600000000000003,"5min":0.38200000000000001,"15min":0.36199999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0449999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67500000000000004,"15min":0.72399999999999998},"min":{"1min":0.47599999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92100000000000004,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69799999999999995,"15min":0.748},"min":{"1min":0.48099999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91500000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.69699999999999995,"15min":0.73599999999999999},"min":{"1min":0.48399999999999999,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":0.97699999999999998,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.66800000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.71899999999999997,"15min":0.755},"min":{"1min":0.52500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.048},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69599999999999995,"15min":0.74399999999999999},"min":{"1min":0.51300000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0209999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53500000000000003,"15min":0.55000000000000004},"min":{"1min":0.35499999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.94799999999999995},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85999999999999999,"5min":0.91400000000000003,"15min":1.8740000000000001},"last":0.505}]},{"osd":6,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.48699999999999999,"5min":0.48199999999999998,"15min":0.40699999999999997},"max":{"1min":1.079,"5min":1.079,"15min":1.093},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.64000000000000001},"min":{"1min":0.36499999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":1.022,"15min":1.2010000000000001},"last":0.76800000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":0.84499999999999997,"5min":0.84899999999999998,"15min":0.90400000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.505,"5min":0.49199999999999999,"15min":0.437},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.99399999999999999},"last":0.83599999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542365,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36760,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335080,"statfs":{"total":96636764160,"available":96599121920,"internally_reserved":0,"allocated":1449984,"data_stored":720562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.443,"15min":0.45100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.496,"15min":0.51900000000000002},"min":{"1min":0.30099999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63500000000000001,"5min":0.745,"15min":0.91500000000000004},"last":0.625}]},{"osd":1,"last update":"Fri Aug 25 04:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.436,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.65300000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56599999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52200000000000002,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72599999999999998,"15min":0.75},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.02}]},{"osd":5,"last update":"Fri Aug 25 04:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.745,"15min":0.77400000000000002},"min":{"1min":0.53600000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94299999999999995,"5min":1.254,"15min":1.254},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.745,"15min":0.78000000000000003},"min":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Aug 25 04:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78100000000000003,"15min":0.79800000000000004},"min":{"1min":0.55000000000000004,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.753,"15min":0.79100000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.98299999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.81999999999999995},"min":{"1min":0.53000000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.76400000000000001,"15min":0.78800000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.94499999999999995,"5min":1.079,"15min":1.1160000000000001},"last":0.80400000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542366,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54816,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317024,"statfs":{"total":96636764160,"available":96580632576,"internally_reserved":0,"allocated":1462272,"data_stored":726732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.44,"15min":0.45900000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.59299999999999997,"5min":0.85599999999999998,"15min":0.92000000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.45900000000000002,"15min":0.49099999999999999},"min":{"1min":0.29799999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.59899999999999998,"5min":0.81000000000000005,"15min":0.93100000000000005},"last":0.52400000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46700000000000003,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65200000000000002,"5min":0.70799999999999996,"15min":0.85499999999999998},"last":0.5},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56100000000000005,"15min":0.59499999999999997},"min":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.67000000000000004,"5min":0.81699999999999995,"15min":0.89800000000000002},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.499,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":0.71399999999999997,"5min":0.82199999999999995,"15min":0.82299999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53300000000000003,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":0.80600000000000005,"15min":0.89400000000000002},"last":0.55200000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.73799999999999999,"15min":0.78400000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79700000000000004,"5min":1.1990000000000001,"15min":1.2569999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.72799999999999998,"15min":0.77300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96699999999999997,"5min":1.151,"15min":1.5509999999999999},"last":0.84099999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.745,"15min":0.78800000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92800000000000005,"5min":1.1080000000000001,"15min":1.2789999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.753,"15min":0.79500000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94499999999999995,"5min":1.2130000000000001,"15min":1.3089999999999999},"last":0.85999999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.752,"15min":0.81200000000000006},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.84399999999999997,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78300000000000003,"15min":0.83999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.995,"5min":1.25,"15min":1.375},"last":0.82599999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.746,"15min":0.78800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90300000000000002,"5min":1.0860000000000001,"15min":1.339},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.75600000000000001,"15min":0.79500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.92600000000000005,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.90700000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542366,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36756,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335084,"statfs":{"total":96636764160,"available":96599126016,"internally_reserved":0,"allocated":1449984,"data_stored":720562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.43099999999999999,"15min":0.45500000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.501,"5min":0.81000000000000005,"15min":0.96899999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.51900000000000002,"15min":0.52200000000000002},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73699999999999999,"5min":1.212,"15min":1.212},"last":0.29999999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.497,"15min":0.501},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.80500000000000005,"5min":0.876,"15min":0.876},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54400000000000004,"15min":0.56699999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67700000000000005,"5min":0.877,"15min":1.02},"last":0.41099999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57999999999999996,"15min":0.61499999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77800000000000002,"5min":0.92800000000000005,"15min":1.018},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.55000000000000004,"15min":0.57199999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67900000000000005,"5min":1.165,"15min":1.165},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.76400000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88500000000000001,"5min":1.012,"15min":1.204},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.752,"15min":0.79800000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94199999999999995,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.72599999999999998,"15min":0.78000000000000003},"min":{"1min":0.505,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96799999999999997,"5min":1.254,"15min":1.254},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.74099999999999999,"15min":0.79700000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94399999999999995,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.78600000000000003,"15min":0.82499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.92100000000000004,"5min":1.623,"15min":1.623},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.753,"15min":0.79200000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97999999999999998,"5min":1.288,"15min":1.288},"last":0.66500000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.753,"15min":0.80100000000000005},"min":{"1min":0.47299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.98899999999999999,"5min":1.1140000000000001,"15min":1.2949999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.80300000000000005,"15min":0.84199999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.091,"15min":1.3120000000000001},"last":0.59199999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542365,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2056192,"data_stored":1317100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.30599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52100000000000002,"15min":0.55900000000000005},"min":{"1min":0.41499999999999998,"5min":0.38500000000000001,"15min":0.36699999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":3.5089999999999999},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48499999999999999,"15min":0.51500000000000001},"min":{"1min":0.34000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.749,"5min":0.78500000000000003,"15min":0.97499999999999998},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51800000000000002,"15min":0.53700000000000003},"min":{"1min":0.42899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70099999999999996,"5min":0.876,"15min":3.4590000000000001},"last":0.46400000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47699999999999998,"15min":0.48999999999999999},"min":{"1min":0.37,"5min":0.27800000000000002,"15min":0.27700000000000002},"max":{"1min":0.73599999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57199999999999995,"15min":0.58799999999999997},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.32700000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":1.2470000000000001},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77000000000000002,"15min":0.78500000000000003},"min":{"1min":0.60299999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97999999999999998,"5min":1.2,"15min":1.2},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.75800000000000001,"15min":0.79300000000000004},"min":{"1min":0.63,"5min":0.443,"15min":0.443},"max":{"1min":1.1339999999999999,"5min":1.169,"15min":1.1719999999999999},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.747,"15min":0.78500000000000003},"min":{"1min":0.52500000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.032,"5min":1.131,"15min":3.528},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.61599999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.2270000000000001,"5min":1.244,"15min":1.244},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.74399999999999999,"15min":0.78800000000000003},"min":{"1min":0.58799999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":3.4870000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78500000000000003,"15min":0.81999999999999995},"min":{"1min":0.54200000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.093,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.57299999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.80100000000000005,"15min":0.83199999999999996},"min":{"1min":0.63800000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1619999999999999,"5min":1.28,"15min":1.28},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77000000000000002,"15min":0.80000000000000004},"min":{"1min":0.59999999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0609999999999999,"5min":1.0940000000000001,"15min":1.1930000000000001},"last":0.56000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:21:27.019 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:21:27.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.203+0000 7fae04e26640 1 Processor -- start 2023-08-25T04:21:27.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.203+0000 7fae04e26640 1 -- start start 2023-08-25T04:21:27.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.203+0000 7fae04e26640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae000cdde0 0x7fae000ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:27.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.203+0000 7fae04e26640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fae000b2e40 0x7fae000b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:27.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.203+0000 7fae04e26640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae000b29b0 con 0x7fae000d0da0 2023-08-25T04:21:27.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.203+0000 7fae04e26640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae000ce760 con 0x7fae000b2e40 2023-08-25T04:21:27.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.203+0000 7fae04e26640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae000b1dc0 con 0x7fae000cdde0 2023-08-25T04:21:27.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.203+0000 7fadfed9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fae000b2e40 0x7fae000b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:27.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.203+0000 7fadf7fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae000cdde0 0x7fae000ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:27.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.203+0000 7fadfed9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fae000b2e40 0x7fae000b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:50042/0 (socket says 172.21.15.55:50042) 2023-08-25T04:21:27.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.203+0000 7fadfed9d640 1 -- 172.21.15.55:0/1684822936 learned_addr learned my addr 172.21.15.55:0/1684822936 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:27.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.203+0000 7fadfe59c640 1 --1- 172.21.15.55:0/1684822936 >> v1:172.21.15.110:6789/0 conn(0x7fae000d0da0 0x7fae000d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:43858/0 (socket says 172.21.15.55:43858) 2023-08-25T04:21:27.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.207+0000 7fadf7fff640 1 -- 172.21.15.55:0/1684822936 >> v2:172.21.15.110:3300/0 conn(0x7fae000b2e40 msgr2=0x7fae000b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:27.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.207+0000 7fadf7fff640 1 --2- 172.21.15.55:0/1684822936 >> v2:172.21.15.110:3300/0 conn(0x7fae000b2e40 0x7fae000b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.207+0000 7fadf7fff640 1 -- 172.21.15.55:0/1684822936 >> v1:172.21.15.110:6789/0 conn(0x7fae000d0da0 legacy=0x7fae000d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:27.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.207+0000 7fadf7fff640 1 -- 172.21.15.55:0/1684822936 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae000b2080 con 0x7fae000cdde0 2023-08-25T04:21:27.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.207+0000 7fadfdd9b640 1 -- 172.21.15.55:0/1684822936 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222186211 0 0) 0x7fae000b29b0 con 0x7fae000d0da0 2023-08-25T04:21:27.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.207+0000 7fadfed9d640 1 --2- 172.21.15.55:0/1684822936 >> v2:172.21.15.110:3300/0 conn(0x7fae000b2e40 0x7fae000b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:27.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.207+0000 7fadf7fff640 1 --2- 172.21.15.55:0/1684822936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae000cdde0 0x7fae000ce220 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fade80097c0 tx=0x7fade801ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab71c497c67f1757 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:27.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.207+0000 7fadfdd9b640 1 -- 172.21.15.55:0/1684822936 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade80a8970 con 0x7fae000cdde0 2023-08-25T04:21:27.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.207+0000 7fadfdd9b640 1 -- 172.21.15.55:0/1684822936 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade80a8ad0 con 0x7fae000cdde0 2023-08-25T04:21:27.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.207+0000 7fadfdd9b640 1 -- 172.21.15.55:0/1684822936 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade80a8e60 con 0x7fae000cdde0 2023-08-25T04:21:27.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.207+0000 7fae04e26640 1 -- 172.21.15.55:0/1684822936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae000cdde0 msgr2=0x7fae000ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:27.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.207+0000 7fae04e26640 1 --2- 172.21.15.55:0/1684822936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae000cdde0 0x7fae000ce220 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fade80097c0 tx=0x7fade801ec70 comp rx=0 tx=0).stop 2023-08-25T04:21:27.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.207+0000 7fae04e26640 1 -- 172.21.15.55:0/1684822936 shutdown_connections 2023-08-25T04:21:27.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.207+0000 7fae04e26640 1 --2- 172.21.15.55:0/1684822936 >> v2:172.21.15.110:3300/0 conn(0x7fae000b2e40 0x7fae000b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.207+0000 7fae04e26640 1 --2- 172.21.15.55:0/1684822936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae000cdde0 0x7fae000ce220 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fae04e26640 1 -- 172.21.15.55:0/1684822936 >> 172.21.15.55:0/1684822936 conn(0x7fae0009bae0 msgr2=0x7fae000d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:27.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fae04e26640 1 -- 172.21.15.55:0/1684822936 shutdown_connections 2023-08-25T04:21:27.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fae04e26640 1 -- 172.21.15.55:0/1684822936 wait complete. 2023-08-25T04:21:27.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fae04e26640 1 Processor -- start 2023-08-25T04:21:27.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fae04e26640 1 -- start start 2023-08-25T04:21:27.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fae04e26640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae000b2e40 0x7fae00151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:27.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fae04e26640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae000cdde0 0x7fae000cae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:27.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fae04e26640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae000d0da0 0x7fae0015ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:27.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fae04e26640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae00152260 con 0x7fae000cdde0 2023-08-25T04:21:27.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fae04e26640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae000c9d90 con 0x7fae000d0da0 2023-08-25T04:21:27.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fae04e26640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae000ca070 con 0x7fae000b2e40 2023-08-25T04:21:27.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fadf7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae000cdde0 0x7fae000cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:27.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fadf7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae000cdde0 0x7fae000cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55496/0 (socket says 172.21.15.55:55496) 2023-08-25T04:21:27.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fadf7fff640 1 -- 172.21.15.55:0/281418898 learned_addr learned my addr 172.21.15.55:0/281418898 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:27.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fadfe59c640 1 --2- 172.21.15.55:0/281418898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae000b2e40 0x7fae00151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:27.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fadfed9d640 1 --2- 172.21.15.55:0/281418898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae000d0da0 0x7fae0015ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:27.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fadf7fff640 1 -- 172.21.15.55:0/281418898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae000b2e40 msgr2=0x7fae00151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:27.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fadf7fff640 1 --2- 172.21.15.55:0/281418898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae000b2e40 0x7fae00151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fadf7fff640 1 -- 172.21.15.55:0/281418898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae000d0da0 msgr2=0x7fae0015ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:27.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fadf7fff640 1 --2- 172.21.15.55:0/281418898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae000d0da0 0x7fae0015ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fadf7fff640 1 -- 172.21.15.55:0/281418898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf8009b30 con 0x7fae000cdde0 2023-08-25T04:21:27.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.211+0000 7fadfed9d640 1 --2- 172.21.15.55:0/281418898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae000d0da0 0x7fae0015ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:27.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.215+0000 7fadf7fff640 1 --2- 172.21.15.55:0/281418898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae000cdde0 0x7fae000cae30 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fade801c8a0 tx=0x7fade801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:27.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.215+0000 7fadf6ffd640 1 -- 172.21.15.55:0/281418898 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade80b0e10 con 0x7fae000cdde0 2023-08-25T04:21:27.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.215+0000 7fadf6ffd640 1 -- 172.21.15.55:0/281418898 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade80b9410 con 0x7fae000cdde0 2023-08-25T04:21:27.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.215+0000 7fadf6ffd640 1 -- 172.21.15.55:0/281418898 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade80b97c0 con 0x7fae000cdde0 2023-08-25T04:21:27.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.215+0000 7fae04e26640 1 -- 172.21.15.55:0/281418898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade8009420 con 0x7fae000cdde0 2023-08-25T04:21:27.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.215+0000 7fae04e26640 1 -- 172.21.15.55:0/281418898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae000ca630 con 0x7fae000cdde0 2023-08-25T04:21:27.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.215+0000 7fae04e26640 1 -- 172.21.15.55:0/281418898 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0004dbe0 con 0x7fae000cdde0 2023-08-25T04:21:27.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.215+0000 7fadf6ffd640 1 -- 172.21.15.55:0/281418898 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fade80b7040 con 0x7fae000cdde0 2023-08-25T04:21:27.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.215+0000 7fadf6ffd640 1 --2- 172.21.15.55:0/281418898 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fade00657a0 0x7fade0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:27.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.215+0000 7fadf6ffd640 1 -- 172.21.15.55:0/281418898 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fade8120b40 con 0x7fae000cdde0 2023-08-25T04:21:27.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.215+0000 7fadfe59c640 1 --2- 172.21.15.55:0/281418898 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fade00657a0 0x7fade0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:27.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.219+0000 7fadfe59c640 1 --2- 172.21.15.55:0/281418898 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fade00657a0 0x7fade0067c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fadf0000fc0 tx=0x7fadf0007d30 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:27.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.219+0000 7fadf6ffd640 1 -- 172.21.15.55:0/281418898 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fade80ee450 con 0x7fae000cdde0 2023-08-25T04:21:27.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.371+0000 7fae04e26640 1 -- 172.21.15.55:0/281418898 --> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae000b2640 con 0x7fade00657a0 2023-08-25T04:21:27.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.379+0000 7fadf6ffd640 1 -- 172.21.15.55:0/281418898 <== mgr.6902 v2:172.21.15.110:6832/4272914017 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299510 (secure 0 0 0) 0x7fadf00074f0 con 0x7fade00657a0 2023-08-25T04:21:27.380 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:27.381 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:21:27.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.383+0000 7fae04e26640 1 -- 172.21.15.55:0/281418898 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fade00657a0 msgr2=0x7fade0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.383+0000 7fae04e26640 1 --2- 172.21.15.55:0/281418898 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fade00657a0 0x7fade0067c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fadf0000fc0 tx=0x7fadf0007d30 comp rx=0 tx=0).stop 2023-08-25T04:21:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.383+0000 7fae04e26640 1 -- 172.21.15.55:0/281418898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae000cdde0 msgr2=0x7fae000cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.383+0000 7fae04e26640 1 --2- 172.21.15.55:0/281418898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae000cdde0 0x7fae000cae30 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fade801c8a0 tx=0x7fade801ba10 comp rx=0 tx=0).stop 2023-08-25T04:21:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.383+0000 7fae04e26640 1 -- 172.21.15.55:0/281418898 shutdown_connections 2023-08-25T04:21:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.383+0000 7fae04e26640 1 --2- 172.21.15.55:0/281418898 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae000d0da0 0x7fae0015ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.383+0000 7fae04e26640 1 --2- 172.21.15.55:0/281418898 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fade00657a0 0x7fade0067c60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.383+0000 7fae04e26640 1 --2- 172.21.15.55:0/281418898 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae000cdde0 0x7fae000cae30 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.383+0000 7fae04e26640 1 --2- 172.21.15.55:0/281418898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae000b2e40 0x7fae00151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.383+0000 7fae04e26640 1 -- 172.21.15.55:0/281418898 >> 172.21.15.55:0/281418898 conn(0x7fae0009bae0 msgr2=0x7fae0006b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:27.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.383+0000 7fae04e26640 1 -- 172.21.15.55:0/281418898 shutdown_connections 2023-08-25T04:21:27.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.383+0000 7fae04e26640 1 -- 172.21.15.55:0/281418898 wait complete. 2023-08-25T04:21:27.400 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-25T04:21:25.543156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1040,"num_read_kb":2137,"num_write":345,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3532,"ondisk_log_size":3532,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":327216,"kb_used_data":12548,"kb_used_omap":13,"kb_used_meta":314546,"kb_avail":754647504,"statfs":{"total":773094113280,"available":772759044096,"internally_reserved":0,"allocated":12849152,"data_stored":6976082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":322095192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.675585"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.876934+0000","last_change":"2023-08-25T04:21:20.876934+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.876934+0000","last_undegraded":"2023-08-25T04:21:20.876934+0000","last_fullsized":"2023-08-25T04:21:20.876934+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.877854+0000","last_change":"2023-08-25T04:21:20.877854+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.877854+0000","last_undegraded":"2023-08-25T04:21:20.877854+0000","last_fullsized":"2023-08-25T04:21:20.877854+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.874561+0000","last_change":"2023-08-25T04:21:20.874561+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.874561+0000","last_undegraded":"2023-08-25T04:21:20.874561+0000","last_fullsized":"2023-08-25T04:21:20.874561+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.872716+0000","last_change":"2023-08-25T04:21:20.872716+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.872716+0000","last_undegraded":"2023-08-25T04:21:20.872716+0000","last_fullsized":"2023-08-25T04:21:20.872716+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.876570+0000","last_change":"2023-08-25T04:21:20.876570+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.876570+0000","last_undegraded":"2023-08-25T04:21:20.876570+0000","last_fullsized":"2023-08-25T04:21:20.876570+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.869664+0000","last_change":"2023-08-25T04:21:20.869664+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.869664+0000","last_undegraded":"2023-08-25T04:21:20.869664+0000","last_fullsized":"2023-08-25T04:21:20.869664+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.872680+0000","last_change":"2023-08-25T04:21:20.872680+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.872680+0000","last_undegraded":"2023-08-25T04:21:20.872680+0000","last_fullsized":"2023-08-25T04:21:20.872680+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.876007+0000","last_change":"2023-08-25T04:21:20.876007+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.876007+0000","last_undegraded":"2023-08-25T04:21:20.876007+0000","last_fullsized":"2023-08-25T04:21:20.876007+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.872779+0000","last_change":"2023-08-25T04:21:20.872779+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.872779+0000","last_undegraded":"2023-08-25T04:21:20.872779+0000","last_fullsized":"2023-08-25T04:21:20.872779+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.875758+0000","last_change":"2023-08-25T04:21:20.875758+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.875758+0000","last_undegraded":"2023-08-25T04:21:20.875758+0000","last_fullsized":"2023-08-25T04:21:20.875758+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.877095+0000","last_change":"2023-08-25T04:21:20.877095+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.877095+0000","last_undegraded":"2023-08-25T04:21:20.877095+0000","last_fullsized":"2023-08-25T04:21:20.877095+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.869846+0000","last_change":"2023-08-25T04:21:20.869846+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.869846+0000","last_undegraded":"2023-08-25T04:21:20.869846+0000","last_fullsized":"2023-08-25T04:21:20.869846+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.872051+0000","last_change":"2023-08-25T04:21:20.872051+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.872051+0000","last_undegraded":"2023-08-25T04:21:20.872051+0000","last_fullsized":"2023-08-25T04:21:20.872051+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.876343+0000","last_change":"2023-08-25T04:21:20.876343+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.876343+0000","last_undegraded":"2023-08-25T04:21:20.876343+0000","last_fullsized":"2023-08-25T04:21:20.876343+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.874985+0000","last_change":"2023-08-25T04:21:20.874985+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.874985+0000","last_undegraded":"2023-08-25T04:21:20.874985+0000","last_fullsized":"2023-08-25T04:21:20.874985+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.872705+0000","last_change":"2023-08-25T04:21:20.872705+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.872705+0000","last_undegraded":"2023-08-25T04:21:20.872705+0000","last_fullsized":"2023-08-25T04:21:20.872705+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.872017+0000","last_change":"2023-08-25T04:21:20.872017+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.872017+0000","last_undegraded":"2023-08-25T04:21:20.872017+0000","last_fullsized":"2023-08-25T04:21:20.872017+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.875015+0000","last_change":"2023-08-25T04:21:20.875015+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.875015+0000","last_undegraded":"2023-08-25T04:21:20.875015+0000","last_fullsized":"2023-08-25T04:21:20.875015+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.870253+0000","last_change":"2023-08-25T04:21:20.870253+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.870253+0000","last_undegraded":"2023-08-25T04:21:20.870253+0000","last_fullsized":"2023-08-25T04:21:20.870253+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.872045+0000","last_change":"2023-08-25T04:21:20.872045+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.872045+0000","last_undegraded":"2023-08-25T04:21:20.872045+0000","last_fullsized":"2023-08-25T04:21:20.872045+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.872766+0000","last_change":"2023-08-25T04:21:20.872766+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.872766+0000","last_undegraded":"2023-08-25T04:21:20.872766+0000","last_fullsized":"2023-08-25T04:21:20.872766+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.875201+0000","last_change":"2023-08-25T04:21:20.875201+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.875201+0000","last_undegraded":"2023-08-25T04:21:20.875201+0000","last_fullsized":"2023-08-25T04:21:20.875201+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.869715+0000","last_change":"2023-08-25T04:21:20.869715+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.869715+0000","last_undegraded":"2023-08-25T04:21:20.869715+0000","last_fullsized":"2023-08-25T04:21:20.869715+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.875170+0000","last_change":"2023-08-25T04:21:20.875170+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.875170+0000","last_undegraded":"2023-08-25T04:21:20.875170+0000","last_fullsized":"2023-08-25T04:21:20.875170+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.875090+0000","last_change":"2023-08-25T04:21:20.875090+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.875090+0000","last_undegraded":"2023-08-25T04:21:20.875090+0000","last_fullsized":"2023-08-25T04:21:20.875090+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"111'3532","reported_seq":4050,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-25T04:21:20.877563+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:21:20.877563+0000","last_peered":"2023-08-25T04:21:20.877563+0000","last_clean":"2023-08-25T04:21:20.877563+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:21:20.877563+0000","last_undegraded":"2023-08-25T04:21:20.877563+0000","last_fullsized":"2023-08-25T04:21:20.877563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:49:03.731845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1040,"num_read_kb":2137,"num_write":345,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":181,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-25T04:21:20.870796+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:21:20.870796+0000","last_peered":"2023-08-25T04:21:20.870796+0000","last_clean":"2023-08-25T04:21:20.870796+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:21:20.870796+0000","last_undegraded":"2023-08-25T04:21:20.870796+0000","last_fullsized":"2023-08-25T04:21:20.870796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:37:51.156102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.876555+0000","last_change":"2023-08-25T04:21:20.876555+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.876555+0000","last_undegraded":"2023-08-25T04:21:20.876555+0000","last_fullsized":"2023-08-25T04:21:20.876555+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":184,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-25T04:21:20.877566+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:21:20.877566+0000","last_peered":"2023-08-25T04:21:20.877566+0000","last_clean":"2023-08-25T04:21:20.877566+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:21:20.877566+0000","last_undegraded":"2023-08-25T04:21:20.877566+0000","last_fullsized":"2023-08-25T04:21:20.877566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:39:16.229891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.869686+0000","last_change":"2023-08-25T04:21:20.869686+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.869686+0000","last_undegraded":"2023-08-25T04:21:20.869686+0000","last_fullsized":"2023-08-25T04:21:20.869686+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":189,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-25T04:21:20.879051+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:21:20.879051+0000","last_peered":"2023-08-25T04:21:20.879051+0000","last_clean":"2023-08-25T04:21:20.879051+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:21:20.879051+0000","last_undegraded":"2023-08-25T04:21:20.879051+0000","last_fullsized":"2023-08-25T04:21:20.879051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:29:13.975800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.870319+0000","last_change":"2023-08-25T04:21:20.870319+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.870319+0000","last_undegraded":"2023-08-25T04:21:20.870319+0000","last_fullsized":"2023-08-25T04:21:20.870319+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":181,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-25T04:21:20.871010+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:21:20.871010+0000","last_peered":"2023-08-25T04:21:20.871010+0000","last_clean":"2023-08-25T04:21:20.871010+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:21:20.871010+0000","last_undegraded":"2023-08-25T04:21:20.871010+0000","last_fullsized":"2023-08-25T04:21:20.871010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:24:36.573650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.870333+0000","last_change":"2023-08-25T04:21:20.870333+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.870333+0000","last_undegraded":"2023-08-25T04:21:20.870333+0000","last_fullsized":"2023-08-25T04:21:20.870333+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":197,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-25T04:21:20.870603+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:21:20.870603+0000","last_peered":"2023-08-25T04:21:20.870603+0000","last_clean":"2023-08-25T04:21:20.870603+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:21:20.870603+0000","last_undegraded":"2023-08-25T04:21:20.870603+0000","last_fullsized":"2023-08-25T04:21:20.870603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:24:40.529358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.877061+0000","last_change":"2023-08-25T04:21:20.877061+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.877061+0000","last_undegraded":"2023-08-25T04:21:20.877061+0000","last_fullsized":"2023-08-25T04:21:20.877061+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":183,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-25T04:21:20.877711+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:21:20.877711+0000","last_peered":"2023-08-25T04:21:20.877711+0000","last_clean":"2023-08-25T04:21:20.877711+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:21:20.877711+0000","last_undegraded":"2023-08-25T04:21:20.877711+0000","last_fullsized":"2023-08-25T04:21:20.877711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:04:48.154532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.875109+0000","last_change":"2023-08-25T04:21:20.875109+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.875109+0000","last_undegraded":"2023-08-25T04:21:20.875109+0000","last_fullsized":"2023-08-25T04:21:20.875109+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":197,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-25T04:21:20.870636+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:21:20.870636+0000","last_peered":"2023-08-25T04:21:20.870636+0000","last_clean":"2023-08-25T04:21:20.870636+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:21:20.870636+0000","last_undegraded":"2023-08-25T04:21:20.870636+0000","last_fullsized":"2023-08-25T04:21:20.870636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:44:04.580470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:21:21.868567+0000","last_change":"2023-08-25T04:21:21.868567+0000","last_active":"2023-08-25T04:21:21.868567+0000","last_peered":"2023-08-25T04:21:21.868567+0000","last_clean":"2023-08-25T04:21:21.868567+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:21.868567+0000","last_undegraded":"2023-08-25T04:21:21.868567+0000","last_fullsized":"2023-08-25T04:21:21.868567+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":119,"state":"creating+peering","last_fresh":"2023-08-25T04:21:20.877264+0000","last_change":"2023-08-25T04:21:20.877264+0000","last_active":"2023-08-25T04:21:20.865282+0000","last_peered":"2023-08-25T04:21:20.865282+0000","last_clean":"2023-08-25T04:21:20.865282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:21:20.877264+0000","last_undegraded":"2023-08-25T04:21:20.877264+0000","last_fullsized":"2023-08-25T04:21:20.877264+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":211,"reported_epoch":119,"state":"active+clean","last_fresh":"2023-08-25T04:21:20.871763+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:21:20.871763+0000","last_peered":"2023-08-25T04:21:20.871763+0000","last_clean":"2023-08-25T04:21:20.871763+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:21:20.871763+0000","last_undegraded":"2023-08-25T04:21:20.871763+0000","last_fullsized":"2023-08-25T04:21:20.871763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:25.456765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1040,"num_read_kb":2137,"num_write":345,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3532,"ondisk_log_size":3532,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509662,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59556,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312284,"statfs":{"total":96636764160,"available":96575778816,"internally_reserved":0,"allocated":2056192,"data_stored":1317100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.65300000000000002,"15min":0.69599999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.33700000000000002},"max":{"1min":0.81000000000000005,"5min":0.94099999999999995,"15min":0.996},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.66200000000000003,"15min":0.71399999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.86499999999999999,"5min":0.94499999999999995,"15min":1.0249999999999999},"last":0.78200000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.68400000000000005,"15min":0.72699999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88300000000000001,"5min":0.92100000000000004,"15min":1.034},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.67500000000000004,"15min":0.72599999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.374},"max":{"1min":0.81699999999999995,"5min":0.995,"15min":1.036},"last":0.95899999999999996}]},{"osd":2,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.66900000000000004,"15min":0.70799999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.34899999999999998},"max":{"1min":0.89700000000000002,"5min":0.94299999999999995,"15min":1.018},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68899999999999995,"15min":0.73899999999999999},"min":{"1min":0.48599999999999999,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":0.83699999999999997,"5min":1.046,"15min":1.046},"last":0.94299999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.68899999999999995,"15min":0.72999999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.80400000000000005,"5min":0.90900000000000003,"15min":0.98399999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.70799999999999996,"15min":0.74399999999999999},"min":{"1min":0.498,"5min":0.48199999999999998,"15min":0.432},"max":{"1min":0.91300000000000003,"5min":1.04,"15min":1.04},"last":0.89100000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57199999999999995,"15min":0.56999999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.32400000000000001},"max":{"1min":0.74199999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85099999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.878}]},{"osd":5,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.40500000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.79300000000000004,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76400000000000001,"5min":1.032,"15min":1.0349999999999999},"last":0.83599999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.67700000000000005,"15min":0.68600000000000005},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.76600000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.65400000000000003,"15min":0.65800000000000003},"min":{"1min":0.42799999999999999,"5min":0.42699999999999999,"15min":0.42399999999999999},"max":{"1min":0.93700000000000006,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.92500000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509662,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36768,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335072,"statfs":{"total":96636764160,"available":96599113728,"internally_reserved":0,"allocated":1462272,"data_stored":726732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:20:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.64200000000000002,"15min":0.69499999999999995},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.80300000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.65700000000000003,"15min":0.69099999999999995},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86599999999999999,"5min":0.96499999999999997,"15min":1.054},"last":0.59399999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:20:22 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.67200000000000004,"15min":0.72399999999999998},"min":{"1min":0.39600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78300000000000003,"5min":1.0269999999999999,"15min":1.0369999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.69599999999999995,"15min":0.72199999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92900000000000005,"5min":1.109,"15min":1.109},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:20:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68899999999999995,"15min":0.73099999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93000000000000005,"5min":1.0009999999999999,"15min":1.1020000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.74399999999999999,"15min":0.78500000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.996,"5min":1.0569999999999999,"15min":1.117},"last":0.68400000000000005}]},{"osd":3,"last update":"Fri Aug 25 04:20:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72799999999999998,"15min":0.74299999999999999},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.46899999999999997},"max":{"1min":0.95399999999999996,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.629},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.71999999999999997,"15min":0.753},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88600000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.61199999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:20:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.751,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.436},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.83699999999999997,"5min":0.95799999999999996,"15min":1.0820000000000001},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:20:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.66000000000000003,"15min":0.64500000000000002},"min":{"1min":0.442,"5min":0.39200000000000002,"15min":0.373},"max":{"1min":0.82999999999999996,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.73399999999999999,"15min":0.72799999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89800000000000002,"5min":1.141,"15min":1.141},"last":0.70699999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:20:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.65900000000000003,"15min":0.65600000000000003},"min":{"1min":0.41399999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86599999999999999,"5min":1.0389999999999999,"15min":1.1950000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.72399999999999998,"15min":0.69599999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.44700000000000001},"max":{"1min":0.85799999999999998,"5min":1.373,"15min":1.373},"last":0.47299999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542365,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1462272,"data_stored":726732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65200000000000002,"15min":0.69799999999999995},"min":{"1min":0.498,"5min":0.313,"15min":0.313},"max":{"1min":0.91300000000000003,"5min":0.98099999999999998,"15min":1.018},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66900000000000004,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0409999999999999},"last":0.71399999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.67000000000000004,"15min":0.71899999999999997},"min":{"1min":0.51200000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.99399999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.70299999999999996,"15min":0.73099999999999998},"min":{"1min":0.46400000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.66300000000000003,"15min":0.71499999999999997},"min":{"1min":0.58699999999999997,"5min":0.40799999999999997,"15min":0.39500000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.97499999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70199999999999996,"15min":0.73599999999999999},"min":{"1min":0.58499999999999996,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70199999999999996,"15min":0.72599999999999998},"min":{"1min":0.55800000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.94199999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.70999999999999996,"15min":0.75600000000000001},"min":{"1min":0.626,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.008,"5min":1.028,"15min":1.028},"last":0.72799999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.44500000000000001,"5min":0.38400000000000001,"15min":0.35399999999999998},"max":{"1min":0.72199999999999998,"5min":0.91000000000000003,"15min":0.97099999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.46800000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.874,"5min":0.99399999999999999,"15min":1.018},"last":0.748}]},{"osd":6,"last update":"Fri Aug 25 04:21:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.44600000000000001,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.82399999999999995,"5min":0.96799999999999997,"15min":1.008},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.48199999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79400000000000004,"5min":0.94199999999999995,"15min":0.98299999999999998},"last":0.69799999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:21:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.63400000000000001,"15min":0.61499999999999999},"min":{"1min":0.47499999999999998,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.84699999999999998,"5min":0.93300000000000005,"15min":1.032},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69099999999999995,"15min":0.68999999999999995},"min":{"1min":0.55700000000000005,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.94999999999999996,"5min":1.01,"15min":1.048},"last":0.59099999999999997}]}]},{"osd":4,"up_from":14,"seq":60129542365,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1449984,"data_stored":720562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64600000000000002,"15min":0.69599999999999995},"min":{"1min":0.45600000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.99299999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65700000000000003,"15min":0.69099999999999995},"min":{"1min":0.499,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83699999999999997,"5min":0.90200000000000002,"15min":0.96699999999999997},"last":0.53400000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.68700000000000006,"15min":0.72199999999999998},"min":{"1min":0.46600000000000003,"5min":0.38200000000000001,"15min":0.36199999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0449999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67500000000000004,"15min":0.72399999999999998},"min":{"1min":0.47599999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92100000000000004,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69799999999999995,"15min":0.748},"min":{"1min":0.48099999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91500000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.69699999999999995,"15min":0.73599999999999999},"min":{"1min":0.48399999999999999,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":0.97699999999999998,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.66800000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.71899999999999997,"15min":0.755},"min":{"1min":0.52500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.048},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69599999999999995,"15min":0.74399999999999999},"min":{"1min":0.51300000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0209999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53500000000000003,"15min":0.55000000000000004},"min":{"1min":0.35499999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.94799999999999995},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85999999999999999,"5min":0.91400000000000003,"15min":1.8740000000000001},"last":0.505}]},{"osd":6,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.48699999999999999,"5min":0.48199999999999998,"15min":0.40699999999999997},"max":{"1min":1.079,"5min":1.079,"15min":1.093},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.64000000000000001},"min":{"1min":0.36499999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":1.022,"15min":1.2010000000000001},"last":0.76800000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":0.84499999999999997,"5min":0.84899999999999998,"15min":0.90400000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.505,"5min":0.49199999999999999,"15min":0.437},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.99399999999999999},"last":0.83599999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542365,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36760,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335080,"statfs":{"total":96636764160,"available":96599121920,"internally_reserved":0,"allocated":1449984,"data_stored":720562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.443,"15min":0.45100000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.496,"15min":0.51900000000000002},"min":{"1min":0.30099999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63500000000000001,"5min":0.745,"15min":0.91500000000000004},"last":0.625}]},{"osd":1,"last update":"Fri Aug 25 04:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.436,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.65300000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56599999999999995,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52200000000000002,"15min":0.54300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72599999999999998,"15min":0.75},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76900000000000002,"15min":0.79900000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.02}]},{"osd":5,"last update":"Fri Aug 25 04:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.745,"15min":0.77400000000000002},"min":{"1min":0.53600000000000003,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.94299999999999995,"5min":1.254,"15min":1.254},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.745,"15min":0.78000000000000003},"min":{"1min":0.50800000000000001,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Aug 25 04:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78100000000000003,"15min":0.79800000000000004},"min":{"1min":0.55000000000000004,"5min":0.54000000000000004,"15min":0.53100000000000003},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.753,"15min":0.79100000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.98299999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:20:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77600000000000002,"15min":0.81999999999999995},"min":{"1min":0.53000000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.76400000000000001,"15min":0.78800000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.94499999999999995,"5min":1.079,"15min":1.1160000000000001},"last":0.80400000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542366,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54816,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317024,"statfs":{"total":96636764160,"available":96580632576,"internally_reserved":0,"allocated":1462272,"data_stored":726732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.44,"15min":0.45900000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.59299999999999997,"5min":0.85599999999999998,"15min":0.92000000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.45900000000000002,"15min":0.49099999999999999},"min":{"1min":0.29799999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.59899999999999998,"5min":0.81000000000000005,"15min":0.93100000000000005},"last":0.52400000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46700000000000003,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65200000000000002,"5min":0.70799999999999996,"15min":0.85499999999999998},"last":0.5},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56100000000000005,"15min":0.59499999999999997},"min":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.67000000000000004,"5min":0.81699999999999995,"15min":0.89800000000000002},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.499,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":0.71399999999999997,"5min":0.82199999999999995,"15min":0.82299999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53300000000000003,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":0.80600000000000005,"15min":0.89400000000000002},"last":0.55200000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.73799999999999999,"15min":0.78400000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79700000000000004,"5min":1.1990000000000001,"15min":1.2569999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.72799999999999998,"15min":0.77300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96699999999999997,"5min":1.151,"15min":1.5509999999999999},"last":0.84099999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.745,"15min":0.78800000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92800000000000005,"5min":1.1080000000000001,"15min":1.2789999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.753,"15min":0.79500000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94499999999999995,"5min":1.2130000000000001,"15min":1.3089999999999999},"last":0.85999999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.752,"15min":0.81200000000000006},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.84399999999999997,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78300000000000003,"15min":0.83999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.995,"5min":1.25,"15min":1.375},"last":0.82599999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.746,"15min":0.78800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90300000000000002,"5min":1.0860000000000001,"15min":1.339},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.75600000000000001,"15min":0.79500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.92600000000000005,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.90700000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542366,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36756,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335084,"statfs":{"total":96636764160,"available":96599126016,"internally_reserved":0,"allocated":1449984,"data_stored":720562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.43099999999999999,"15min":0.45500000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.501,"5min":0.81000000000000005,"15min":0.96899999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.51900000000000002,"15min":0.52200000000000002},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.73699999999999999,"5min":1.212,"15min":1.212},"last":0.29999999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.497,"15min":0.501},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.80500000000000005,"5min":0.876,"15min":0.876},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54400000000000004,"15min":0.56699999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67700000000000005,"5min":0.877,"15min":1.02},"last":0.41099999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57999999999999996,"15min":0.61499999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77800000000000002,"5min":0.92800000000000005,"15min":1.018},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.55000000000000004,"15min":0.57199999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67900000000000005,"5min":1.165,"15min":1.165},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.76400000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.88500000000000001,"5min":1.012,"15min":1.204},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.752,"15min":0.79800000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.94199999999999995,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Aug 25 04:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.72599999999999998,"15min":0.78000000000000003},"min":{"1min":0.505,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.96799999999999997,"5min":1.254,"15min":1.254},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.74099999999999999,"15min":0.79700000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94399999999999995,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.78600000000000003,"15min":0.82499999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.92100000000000004,"5min":1.623,"15min":1.623},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.753,"15min":0.79200000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97999999999999998,"5min":1.288,"15min":1.288},"last":0.66500000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.753,"15min":0.80100000000000005},"min":{"1min":0.47299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.98899999999999999,"5min":1.1140000000000001,"15min":1.2949999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.80300000000000005,"15min":0.84199999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.091,"15min":1.3120000000000001},"last":0.59199999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542365,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2056192,"data_stored":1317100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.30599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52100000000000002,"15min":0.55900000000000005},"min":{"1min":0.41499999999999998,"5min":0.38500000000000001,"15min":0.36699999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":3.5089999999999999},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48499999999999999,"15min":0.51500000000000001},"min":{"1min":0.34000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.749,"5min":0.78500000000000003,"15min":0.97499999999999998},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51800000000000002,"15min":0.53700000000000003},"min":{"1min":0.42899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70099999999999996,"5min":0.876,"15min":3.4590000000000001},"last":0.46400000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47699999999999998,"15min":0.48999999999999999},"min":{"1min":0.37,"5min":0.27800000000000002,"15min":0.27700000000000002},"max":{"1min":0.73599999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57199999999999995,"15min":0.58799999999999997},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.32700000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":1.2470000000000001},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77000000000000002,"15min":0.78500000000000003},"min":{"1min":0.60299999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97999999999999998,"5min":1.2,"15min":1.2},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.75800000000000001,"15min":0.79300000000000004},"min":{"1min":0.63,"5min":0.443,"15min":0.443},"max":{"1min":1.1339999999999999,"5min":1.169,"15min":1.1719999999999999},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.747,"15min":0.78500000000000003},"min":{"1min":0.52500000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.032,"5min":1.131,"15min":3.528},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.61599999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.2270000000000001,"5min":1.244,"15min":1.244},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.74399999999999999,"15min":0.78800000000000003},"min":{"1min":0.58799999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":3.4870000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78500000000000003,"15min":0.81999999999999995},"min":{"1min":0.54200000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.093,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.57299999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.80100000000000005,"15min":0.83199999999999996},"min":{"1min":0.63800000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1619999999999999,"5min":1.28,"15min":1.28},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77000000000000002,"15min":0.80000000000000004},"min":{"1min":0.59999999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0609999999999999,"5min":1.0940000000000001,"15min":1.1930000000000001},"last":0.56000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:21:27.408 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:21:27.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.591+0000 7f29486ec640 1 Processor -- start 2023-08-25T04:21:27.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.591+0000 7f29486ec640 1 -- start start 2023-08-25T04:21:27.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.595+0000 7f29486ec640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29400ceeb0 0x7f2940165690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:27.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.595+0000 7f29486ec640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29400ac100 con 0x7f294015ef80 2023-08-25T04:21:27.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.595+0000 7f29486ec640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29400ac3a0 con 0x7f294015eba0 2023-08-25T04:21:27.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.595+0000 7f29486ec640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29400b3150 con 0x7f29400ceeb0 2023-08-25T04:21:27.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.595+0000 7f2946c89640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29400ceeb0 0x7f2940165690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:27.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.595+0000 7f2946c89640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29400ceeb0 0x7f2940165690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55504/0 (socket says 172.21.15.55:55504) 2023-08-25T04:21:27.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.595+0000 7f2946c89640 1 -- 172.21.15.55:0/734675493 learned_addr learned my addr 172.21.15.55:0/734675493 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:27.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.595+0000 7f2946c89640 1 -- 172.21.15.55:0/734675493 >> v1:172.21.15.110:6789/0 conn(0x7f294015eba0 legacy=0x7f29400b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:27.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.595+0000 7f2946c89640 1 -- 172.21.15.55:0/734675493 >> v1:172.21.15.55:6789/0 conn(0x7f294015ef80 legacy=0x7f29400ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:27.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.595+0000 7f2946c89640 1 -- 172.21.15.55:0/734675493 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29400b1390 con 0x7f29400ceeb0 2023-08-25T04:21:27.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f2946c89640 1 --2- 172.21.15.55:0/734675493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29400ceeb0 0x7f2940165690 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f2938009e50 tx=0x7f293801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9c8b37aa805367 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:27.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f2945486640 1 -- 172.21.15.55:0/734675493 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29380a58a0 con 0x7f29400ceeb0 2023-08-25T04:21:27.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f2945486640 1 -- 172.21.15.55:0/734675493 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29380a5a00 con 0x7f29400ceeb0 2023-08-25T04:21:27.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f2945486640 1 -- 172.21.15.55:0/734675493 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29380a5d90 con 0x7f29400ceeb0 2023-08-25T04:21:27.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f29486ec640 1 -- 172.21.15.55:0/734675493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29400ceeb0 msgr2=0x7f2940165690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:27.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f29486ec640 1 --2- 172.21.15.55:0/734675493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29400ceeb0 0x7f2940165690 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f2938009e50 tx=0x7f293801c9e0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f29486ec640 1 -- 172.21.15.55:0/734675493 shutdown_connections 2023-08-25T04:21:27.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f29486ec640 1 --2- 172.21.15.55:0/734675493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29400ceeb0 0x7f2940165690 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f29486ec640 1 -- 172.21.15.55:0/734675493 >> 172.21.15.55:0/734675493 conn(0x7f2940069d00 msgr2=0x7f294006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:27.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f29486ec640 1 -- 172.21.15.55:0/734675493 shutdown_connections 2023-08-25T04:21:27.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f29486ec640 1 -- 172.21.15.55:0/734675493 wait complete. 2023-08-25T04:21:27.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f29486ec640 1 Processor -- start 2023-08-25T04:21:27.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f29486ec640 1 -- start start 2023-08-25T04:21:27.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f29486ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29400ceeb0 0x7f29400972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:27.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f29486ec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f294015eba0 0x7f29400c16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:27.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f29486ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f294015ef80 0x7f29400cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:27.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f29486ec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29400c1c00 con 0x7f29400ceeb0 2023-08-25T04:21:27.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f29486ec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29401573e0 con 0x7f294015eba0 2023-08-25T04:21:27.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.599+0000 7f29486ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2940151c30 con 0x7f294015ef80 2023-08-25T04:21:27.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2946488640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29400ceeb0 0x7f29400972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:27.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2946488640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29400ceeb0 0x7f29400972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55506/0 (socket says 172.21.15.55:55506) 2023-08-25T04:21:27.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2946488640 1 -- 172.21.15.55:0/4024511884 learned_addr learned my addr 172.21.15.55:0/4024511884 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:27.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2945c87640 1 --2- 172.21.15.55:0/4024511884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f294015eba0 0x7f29400c16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:27.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2946c89640 1 --2- 172.21.15.55:0/4024511884 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f294015ef80 0x7f29400cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:27.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2946488640 1 -- 172.21.15.55:0/4024511884 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f294015ef80 msgr2=0x7f29400cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2946488640 1 --2- 172.21.15.55:0/4024511884 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f294015ef80 0x7f29400cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2946488640 1 -- 172.21.15.55:0/4024511884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f294015eba0 msgr2=0x7f29400c16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2946488640 1 --2- 172.21.15.55:0/4024511884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f294015eba0 0x7f29400c16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2946488640 1 -- 172.21.15.55:0/4024511884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2938009b30 con 0x7f29400ceeb0 2023-08-25T04:21:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2946c89640 1 --2- 172.21.15.55:0/4024511884 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f294015ef80 0x7f29400cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2945c87640 1 --2- 172.21.15.55:0/4024511884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f294015eba0 0x7f29400c16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2946488640 1 --2- 172.21.15.55:0/4024511884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29400ceeb0 0x7f29400972f0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f293c00c3c0 tx=0x7f293c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:27.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2936ffd640 1 -- 172.21.15.55:0/4024511884 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c0052d0 con 0x7f29400ceeb0 2023-08-25T04:21:27.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2936ffd640 1 -- 172.21.15.55:0/4024511884 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c005430 con 0x7f29400ceeb0 2023-08-25T04:21:27.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2936ffd640 1 -- 172.21.15.55:0/4024511884 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c003840 con 0x7f29400ceeb0 2023-08-25T04:21:27.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f29486ec640 1 -- 172.21.15.55:0/4024511884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2940151f10 con 0x7f29400ceeb0 2023-08-25T04:21:27.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f29486ec640 1 -- 172.21.15.55:0/4024511884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2940156e20 con 0x7f29400ceeb0 2023-08-25T04:21:27.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f29486ec640 1 -- 172.21.15.55:0/4024511884 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294004dbe0 con 0x7f29400ceeb0 2023-08-25T04:21:27.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2936ffd640 1 -- 172.21.15.55:0/4024511884 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f293c0039a0 con 0x7f29400ceeb0 2023-08-25T04:21:27.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2936ffd640 1 --2- 172.21.15.55:0/4024511884 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f29240657a0 0x7f2924067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:27.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.603+0000 7f2936ffd640 1 -- 172.21.15.55:0/4024511884 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f293c0824b0 con 0x7f29400ceeb0 2023-08-25T04:21:27.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.607+0000 7f2945c87640 1 --2- 172.21.15.55:0/4024511884 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f29240657a0 0x7f2924067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:27.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.607+0000 7f2945c87640 1 --2- 172.21.15.55:0/4024511884 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f29240657a0 0x7f2924067c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2940154050 tx=0x7f2930009040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:27.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.611+0000 7f2936ffd640 1 -- 172.21.15.55:0/4024511884 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f293c04fe50 con 0x7f29400ceeb0 2023-08-25T04:21:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.763+0000 7f29486ec640 1 -- 172.21.15.55:0/4024511884 --> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f29400b1f10 con 0x7f29240657a0 2023-08-25T04:21:27.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.771+0000 7f2936ffd640 1 -- 172.21.15.55:0/4024511884 <== mgr.6902 v2:172.21.15.110:6832/4272914017 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311655 (secure 0 0 0) 0x7f29300013f0 con 0x7f29240657a0 2023-08-25T04:21:27.770 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:27.771 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:21:27.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.775+0000 7f29486ec640 1 -- 172.21.15.55:0/4024511884 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f29240657a0 msgr2=0x7f2924067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:27.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.775+0000 7f29486ec640 1 --2- 172.21.15.55:0/4024511884 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f29240657a0 0x7f2924067c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2940154050 tx=0x7f2930009040 comp rx=0 tx=0).stop 2023-08-25T04:21:27.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.775+0000 7f29486ec640 1 -- 172.21.15.55:0/4024511884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29400ceeb0 msgr2=0x7f29400972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:27.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.775+0000 7f29486ec640 1 --2- 172.21.15.55:0/4024511884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29400ceeb0 0x7f29400972f0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f293c00c3c0 tx=0x7f293c00c880 comp rx=0 tx=0).stop 2023-08-25T04:21:27.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.775+0000 7f29486ec640 1 -- 172.21.15.55:0/4024511884 shutdown_connections 2023-08-25T04:21:27.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.775+0000 7f29486ec640 1 --2- 172.21.15.55:0/4024511884 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f294015ef80 0x7f29400cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.775+0000 7f29486ec640 1 --2- 172.21.15.55:0/4024511884 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f294015eba0 0x7f29400c16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.775+0000 7f29486ec640 1 --2- 172.21.15.55:0/4024511884 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f29240657a0 0x7f2924067c60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.775+0000 7f29486ec640 1 --2- 172.21.15.55:0/4024511884 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29400ceeb0 0x7f29400972f0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.775+0000 7f29486ec640 1 -- 172.21.15.55:0/4024511884 >> 172.21.15.55:0/4024511884 conn(0x7f2940069d00 msgr2=0x7f2940070a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:27.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.775+0000 7f29486ec640 1 -- 172.21.15.55:0/4024511884 shutdown_connections 2023-08-25T04:21:27.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.775+0000 7f29486ec640 1 -- 172.21.15.55:0/4024511884 wait complete. 2023-08-25T04:21:27.790 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-25T04:21:27.543733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1040,"num_read_kb":2137,"num_write":389,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3570,"ondisk_log_size":3570,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":327612,"kb_used_data":12936,"kb_used_omap":13,"kb_used_meta":314546,"kb_avail":754647108,"statfs":{"total":773094113280,"available":772758638592,"internally_reserved":0,"allocated":13246464,"data_stored":7162684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":322095192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001708"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.411058+0000","last_change":"2023-08-25T04:21:22.902603+0000","last_active":"2023-08-25T04:21:24.411058+0000","last_peered":"2023-08-25T04:21:24.411058+0000","last_clean":"2023-08-25T04:21:24.411058+0000","last_became_active":"2023-08-25T04:21:22.902327+0000","last_became_peered":"2023-08-25T04:21:22.902327+0000","last_unstale":"2023-08-25T04:21:24.411058+0000","last_undegraded":"2023-08-25T04:21:24.411058+0000","last_fullsized":"2023-08-25T04:21:24.411058+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:17:32.859729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904117+0000","last_change":"2023-08-25T04:21:22.892480+0000","last_active":"2023-08-25T04:21:23.904117+0000","last_peered":"2023-08-25T04:21:23.904117+0000","last_clean":"2023-08-25T04:21:23.904117+0000","last_became_active":"2023-08-25T04:21:22.892212+0000","last_became_peered":"2023-08-25T04:21:22.892212+0000","last_unstale":"2023-08-25T04:21:23.904117+0000","last_undegraded":"2023-08-25T04:21:23.904117+0000","last_fullsized":"2023-08-25T04:21:23.904117+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:29:04.735498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410767+0000","last_change":"2023-08-25T04:21:22.910439+0000","last_active":"2023-08-25T04:21:24.410767+0000","last_peered":"2023-08-25T04:21:24.410767+0000","last_clean":"2023-08-25T04:21:24.410767+0000","last_became_active":"2023-08-25T04:21:22.909347+0000","last_became_peered":"2023-08-25T04:21:22.909347+0000","last_unstale":"2023-08-25T04:21:24.410767+0000","last_undegraded":"2023-08-25T04:21:24.410767+0000","last_fullsized":"2023-08-25T04:21:24.410767+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:56:56.750725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841365+0000","last_change":"2023-08-25T04:21:22.910060+0000","last_active":"2023-08-25T04:21:25.841365+0000","last_peered":"2023-08-25T04:21:25.841365+0000","last_clean":"2023-08-25T04:21:25.841365+0000","last_became_active":"2023-08-25T04:21:22.909773+0000","last_became_peered":"2023-08-25T04:21:22.909773+0000","last_unstale":"2023-08-25T04:21:25.841365+0000","last_undegraded":"2023-08-25T04:21:25.841365+0000","last_fullsized":"2023-08-25T04:21:25.841365+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:13:48.732464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904196+0000","last_change":"2023-08-25T04:21:22.894604+0000","last_active":"2023-08-25T04:21:23.904196+0000","last_peered":"2023-08-25T04:21:23.904196+0000","last_clean":"2023-08-25T04:21:23.904196+0000","last_became_active":"2023-08-25T04:21:22.894314+0000","last_became_peered":"2023-08-25T04:21:22.894314+0000","last_unstale":"2023-08-25T04:21:23.904196+0000","last_undegraded":"2023-08-25T04:21:23.904196+0000","last_fullsized":"2023-08-25T04:21:23.904196+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:03.905041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903357+0000","last_change":"2023-08-25T04:21:22.899480+0000","last_active":"2023-08-25T04:21:23.903357+0000","last_peered":"2023-08-25T04:21:23.903357+0000","last_clean":"2023-08-25T04:21:23.903357+0000","last_became_active":"2023-08-25T04:21:22.899192+0000","last_became_peered":"2023-08-25T04:21:22.899192+0000","last_unstale":"2023-08-25T04:21:23.903357+0000","last_undegraded":"2023-08-25T04:21:23.903357+0000","last_fullsized":"2023-08-25T04:21:23.903357+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:25:06.918252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902974+0000","last_change":"2023-08-25T04:21:22.898793+0000","last_active":"2023-08-25T04:21:23.902974+0000","last_peered":"2023-08-25T04:21:23.902974+0000","last_clean":"2023-08-25T04:21:23.902974+0000","last_became_active":"2023-08-25T04:21:22.898479+0000","last_became_peered":"2023-08-25T04:21:22.898479+0000","last_unstale":"2023-08-25T04:21:23.902974+0000","last_undegraded":"2023-08-25T04:21:23.902974+0000","last_fullsized":"2023-08-25T04:21:23.902974+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:37:01.600324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840200+0000","last_change":"2023-08-25T04:21:22.911502+0000","last_active":"2023-08-25T04:21:25.840200+0000","last_peered":"2023-08-25T04:21:25.840200+0000","last_clean":"2023-08-25T04:21:25.840200+0000","last_became_active":"2023-08-25T04:21:22.911155+0000","last_became_peered":"2023-08-25T04:21:22.911155+0000","last_unstale":"2023-08-25T04:21:25.840200+0000","last_undegraded":"2023-08-25T04:21:25.840200+0000","last_fullsized":"2023-08-25T04:21:25.840200+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:03:15.076436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903831+0000","last_change":"2023-08-25T04:21:22.895163+0000","last_active":"2023-08-25T04:21:23.903831+0000","last_peered":"2023-08-25T04:21:23.903831+0000","last_clean":"2023-08-25T04:21:23.903831+0000","last_became_active":"2023-08-25T04:21:22.893540+0000","last_became_peered":"2023-08-25T04:21:22.893540+0000","last_unstale":"2023-08-25T04:21:23.903831+0000","last_undegraded":"2023-08-25T04:21:23.903831+0000","last_fullsized":"2023-08-25T04:21:23.903831+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:42:32.393868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904666+0000","last_change":"2023-08-25T04:21:22.892180+0000","last_active":"2023-08-25T04:21:23.904666+0000","last_peered":"2023-08-25T04:21:23.904666+0000","last_clean":"2023-08-25T04:21:23.904666+0000","last_became_active":"2023-08-25T04:21:22.891881+0000","last_became_peered":"2023-08-25T04:21:22.891881+0000","last_unstale":"2023-08-25T04:21:23.904666+0000","last_undegraded":"2023-08-25T04:21:23.904666+0000","last_fullsized":"2023-08-25T04:21:23.904666+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:12:11.503876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.163109+0000","last_change":"2023-08-25T04:21:22.906007+0000","last_active":"2023-08-25T04:21:25.163109+0000","last_peered":"2023-08-25T04:21:25.163109+0000","last_clean":"2023-08-25T04:21:25.163109+0000","last_became_active":"2023-08-25T04:21:22.905714+0000","last_became_peered":"2023-08-25T04:21:22.905714+0000","last_unstale":"2023-08-25T04:21:25.163109+0000","last_undegraded":"2023-08-25T04:21:25.163109+0000","last_fullsized":"2023-08-25T04:21:25.163109+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:03:09.709617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902915+0000","last_change":"2023-08-25T04:21:22.900150+0000","last_active":"2023-08-25T04:21:23.902915+0000","last_peered":"2023-08-25T04:21:23.902915+0000","last_clean":"2023-08-25T04:21:23.902915+0000","last_became_active":"2023-08-25T04:21:22.899835+0000","last_became_peered":"2023-08-25T04:21:22.899835+0000","last_unstale":"2023-08-25T04:21:23.902915+0000","last_undegraded":"2023-08-25T04:21:23.902915+0000","last_fullsized":"2023-08-25T04:21:23.902915+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:25:00.393029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841208+0000","last_change":"2023-08-25T04:21:22.904721+0000","last_active":"2023-08-25T04:21:25.841208+0000","last_peered":"2023-08-25T04:21:25.841208+0000","last_clean":"2023-08-25T04:21:25.841208+0000","last_became_active":"2023-08-25T04:21:22.904432+0000","last_became_peered":"2023-08-25T04:21:22.904432+0000","last_unstale":"2023-08-25T04:21:25.841208+0000","last_undegraded":"2023-08-25T04:21:25.841208+0000","last_fullsized":"2023-08-25T04:21:25.841208+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:58:46.330006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076344+0000","last_change":"2023-08-25T04:21:22.899174+0000","last_active":"2023-08-25T04:21:24.076344+0000","last_peered":"2023-08-25T04:21:24.076344+0000","last_clean":"2023-08-25T04:21:24.076344+0000","last_became_active":"2023-08-25T04:21:22.898899+0000","last_became_peered":"2023-08-25T04:21:22.898899+0000","last_unstale":"2023-08-25T04:21:24.076344+0000","last_undegraded":"2023-08-25T04:21:24.076344+0000","last_fullsized":"2023-08-25T04:21:24.076344+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:49:33.691484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076314+0000","last_change":"2023-08-25T04:21:22.901474+0000","last_active":"2023-08-25T04:21:24.076314+0000","last_peered":"2023-08-25T04:21:24.076314+0000","last_clean":"2023-08-25T04:21:24.076314+0000","last_became_active":"2023-08-25T04:21:22.901182+0000","last_became_peered":"2023-08-25T04:21:22.901182+0000","last_unstale":"2023-08-25T04:21:24.076314+0000","last_undegraded":"2023-08-25T04:21:24.076314+0000","last_fullsized":"2023-08-25T04:21:24.076314+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:04:43.968782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076298+0000","last_change":"2023-08-25T04:21:22.901170+0000","last_active":"2023-08-25T04:21:24.076298+0000","last_peered":"2023-08-25T04:21:24.076298+0000","last_clean":"2023-08-25T04:21:24.076298+0000","last_became_active":"2023-08-25T04:21:22.900877+0000","last_became_peered":"2023-08-25T04:21:22.900877+0000","last_unstale":"2023-08-25T04:21:24.076298+0000","last_undegraded":"2023-08-25T04:21:24.076298+0000","last_fullsized":"2023-08-25T04:21:24.076298+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:42:03.512215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.411076+0000","last_change":"2023-08-25T04:21:22.910250+0000","last_active":"2023-08-25T04:21:24.411076+0000","last_peered":"2023-08-25T04:21:24.411076+0000","last_clean":"2023-08-25T04:21:24.411076+0000","last_became_active":"2023-08-25T04:21:22.909079+0000","last_became_peered":"2023-08-25T04:21:22.909079+0000","last_unstale":"2023-08-25T04:21:24.411076+0000","last_undegraded":"2023-08-25T04:21:24.411076+0000","last_fullsized":"2023-08-25T04:21:24.411076+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:51:38.166407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904204+0000","last_change":"2023-08-25T04:21:22.898773+0000","last_active":"2023-08-25T04:21:23.904204+0000","last_peered":"2023-08-25T04:21:23.904204+0000","last_clean":"2023-08-25T04:21:23.904204+0000","last_became_active":"2023-08-25T04:21:22.898466+0000","last_became_peered":"2023-08-25T04:21:22.898466+0000","last_unstale":"2023-08-25T04:21:23.904204+0000","last_undegraded":"2023-08-25T04:21:23.904204+0000","last_fullsized":"2023-08-25T04:21:23.904204+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:59:21.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410834+0000","last_change":"2023-08-25T04:21:22.914850+0000","last_active":"2023-08-25T04:21:24.410834+0000","last_peered":"2023-08-25T04:21:24.410834+0000","last_clean":"2023-08-25T04:21:24.410834+0000","last_became_active":"2023-08-25T04:21:22.910140+0000","last_became_peered":"2023-08-25T04:21:22.910140+0000","last_unstale":"2023-08-25T04:21:24.410834+0000","last_undegraded":"2023-08-25T04:21:24.410834+0000","last_fullsized":"2023-08-25T04:21:24.410834+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:27:14.211228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903999+0000","last_change":"2023-08-25T04:21:22.893589+0000","last_active":"2023-08-25T04:21:23.903999+0000","last_peered":"2023-08-25T04:21:23.903999+0000","last_clean":"2023-08-25T04:21:23.903999+0000","last_became_active":"2023-08-25T04:21:22.893324+0000","last_became_peered":"2023-08-25T04:21:22.893324+0000","last_unstale":"2023-08-25T04:21:23.903999+0000","last_undegraded":"2023-08-25T04:21:23.903999+0000","last_fullsized":"2023-08-25T04:21:23.903999+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:10.680725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840617+0000","last_change":"2023-08-25T04:21:22.904143+0000","last_active":"2023-08-25T04:21:25.840617+0000","last_peered":"2023-08-25T04:21:25.840617+0000","last_clean":"2023-08-25T04:21:25.840617+0000","last_became_active":"2023-08-25T04:21:22.903846+0000","last_became_peered":"2023-08-25T04:21:22.903846+0000","last_unstale":"2023-08-25T04:21:25.840617+0000","last_undegraded":"2023-08-25T04:21:25.840617+0000","last_fullsized":"2023-08-25T04:21:25.840617+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:16:21.898044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904185+0000","last_change":"2023-08-25T04:21:22.904450+0000","last_active":"2023-08-25T04:21:23.904185+0000","last_peered":"2023-08-25T04:21:23.904185+0000","last_clean":"2023-08-25T04:21:23.904185+0000","last_became_active":"2023-08-25T04:21:22.904159+0000","last_became_peered":"2023-08-25T04:21:22.904159+0000","last_unstale":"2023-08-25T04:21:23.904185+0000","last_undegraded":"2023-08-25T04:21:23.904185+0000","last_fullsized":"2023-08-25T04:21:23.904185+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:44:51.607773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410709+0000","last_change":"2023-08-25T04:21:22.909915+0000","last_active":"2023-08-25T04:21:24.410709+0000","last_peered":"2023-08-25T04:21:24.410709+0000","last_clean":"2023-08-25T04:21:24.410709+0000","last_became_active":"2023-08-25T04:21:22.909576+0000","last_became_peered":"2023-08-25T04:21:22.909576+0000","last_unstale":"2023-08-25T04:21:24.410709+0000","last_undegraded":"2023-08-25T04:21:24.410709+0000","last_fullsized":"2023-08-25T04:21:24.410709+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:12:25.327391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903979+0000","last_change":"2023-08-25T04:21:22.904891+0000","last_active":"2023-08-25T04:21:23.903979+0000","last_peered":"2023-08-25T04:21:23.903979+0000","last_clean":"2023-08-25T04:21:23.903979+0000","last_became_active":"2023-08-25T04:21:22.904596+0000","last_became_peered":"2023-08-25T04:21:22.904596+0000","last_unstale":"2023-08-25T04:21:23.903979+0000","last_undegraded":"2023-08-25T04:21:23.903979+0000","last_fullsized":"2023-08-25T04:21:23.903979+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:24:20.422364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903959+0000","last_change":"2023-08-25T04:21:22.902096+0000","last_active":"2023-08-25T04:21:23.903959+0000","last_peered":"2023-08-25T04:21:23.903959+0000","last_clean":"2023-08-25T04:21:23.903959+0000","last_became_active":"2023-08-25T04:21:22.901835+0000","last_became_peered":"2023-08-25T04:21:22.901835+0000","last_unstale":"2023-08-25T04:21:23.903959+0000","last_undegraded":"2023-08-25T04:21:23.903959+0000","last_fullsized":"2023-08-25T04:21:23.903959+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:24:38.098739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903841+0000","last_change":"2023-08-25T04:21:22.889822+0000","last_active":"2023-08-25T04:21:23.903841+0000","last_peered":"2023-08-25T04:21:23.903841+0000","last_clean":"2023-08-25T04:21:23.903841+0000","last_became_active":"2023-08-25T04:21:22.889515+0000","last_became_peered":"2023-08-25T04:21:22.889515+0000","last_unstale":"2023-08-25T04:21:23.903841+0000","last_undegraded":"2023-08-25T04:21:23.903841+0000","last_fullsized":"2023-08-25T04:21:23.903841+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:26:34.858808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.163211+0000","last_change":"2023-08-25T04:21:22.900565+0000","last_active":"2023-08-25T04:21:25.163211+0000","last_peered":"2023-08-25T04:21:25.163211+0000","last_clean":"2023-08-25T04:21:25.163211+0000","last_became_active":"2023-08-25T04:21:22.900258+0000","last_became_peered":"2023-08-25T04:21:22.900258+0000","last_unstale":"2023-08-25T04:21:25.163211+0000","last_undegraded":"2023-08-25T04:21:25.163211+0000","last_fullsized":"2023-08-25T04:21:25.163211+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:25.567019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902975+0000","last_change":"2023-08-25T04:21:22.900271+0000","last_active":"2023-08-25T04:21:23.902975+0000","last_peered":"2023-08-25T04:21:23.902975+0000","last_clean":"2023-08-25T04:21:23.902975+0000","last_became_active":"2023-08-25T04:21:22.899973+0000","last_became_peered":"2023-08-25T04:21:22.899973+0000","last_unstale":"2023-08-25T04:21:23.902975+0000","last_undegraded":"2023-08-25T04:21:23.902975+0000","last_fullsized":"2023-08-25T04:21:23.902975+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:09:02.870355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840653+0000","last_change":"2023-08-25T04:21:22.902127+0000","last_active":"2023-08-25T04:21:25.840653+0000","last_peered":"2023-08-25T04:21:25.840653+0000","last_clean":"2023-08-25T04:21:25.840653+0000","last_became_active":"2023-08-25T04:21:22.901771+0000","last_became_peered":"2023-08-25T04:21:22.901771+0000","last_unstale":"2023-08-25T04:21:25.840653+0000","last_undegraded":"2023-08-25T04:21:25.840653+0000","last_fullsized":"2023-08-25T04:21:25.840653+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:54:19.330475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902947+0000","last_change":"2023-08-25T04:21:22.900843+0000","last_active":"2023-08-25T04:21:23.902947+0000","last_peered":"2023-08-25T04:21:23.902947+0000","last_clean":"2023-08-25T04:21:23.902947+0000","last_became_active":"2023-08-25T04:21:22.900609+0000","last_became_peered":"2023-08-25T04:21:22.900609+0000","last_unstale":"2023-08-25T04:21:23.902947+0000","last_undegraded":"2023-08-25T04:21:23.902947+0000","last_fullsized":"2023-08-25T04:21:23.902947+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:41:05.646746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903444+0000","last_change":"2023-08-25T04:21:22.900517+0000","last_active":"2023-08-25T04:21:23.903444+0000","last_peered":"2023-08-25T04:21:23.903444+0000","last_clean":"2023-08-25T04:21:23.903444+0000","last_became_active":"2023-08-25T04:21:22.900167+0000","last_became_peered":"2023-08-25T04:21:22.900167+0000","last_unstale":"2023-08-25T04:21:23.903444+0000","last_undegraded":"2023-08-25T04:21:23.903444+0000","last_fullsized":"2023-08-25T04:21:23.903444+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:27:53.563502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840288+0000","last_change":"2023-08-25T04:21:22.909298+0000","last_active":"2023-08-25T04:21:25.840288+0000","last_peered":"2023-08-25T04:21:25.840288+0000","last_clean":"2023-08-25T04:21:25.840288+0000","last_became_active":"2023-08-25T04:21:22.908951+0000","last_became_peered":"2023-08-25T04:21:22.908951+0000","last_unstale":"2023-08-25T04:21:25.840288+0000","last_undegraded":"2023-08-25T04:21:25.840288+0000","last_fullsized":"2023-08-25T04:21:25.840288+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:15:52.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410890+0000","last_change":"2023-08-25T04:21:22.910846+0000","last_active":"2023-08-25T04:21:24.410890+0000","last_peered":"2023-08-25T04:21:24.410890+0000","last_clean":"2023-08-25T04:21:24.410890+0000","last_became_active":"2023-08-25T04:21:22.910125+0000","last_became_peered":"2023-08-25T04:21:22.910125+0000","last_unstale":"2023-08-25T04:21:24.410890+0000","last_undegraded":"2023-08-25T04:21:24.410890+0000","last_fullsized":"2023-08-25T04:21:24.410890+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:17.993108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"121'4","reported_seq":17,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841112+0000","last_change":"2023-08-25T04:21:21.899936+0000","last_active":"2023-08-25T04:21:25.841112+0000","last_peered":"2023-08-25T04:21:25.841112+0000","last_clean":"2023-08-25T04:21:25.841112+0000","last_became_active":"2023-08-25T04:21:21.899625+0000","last_became_peered":"2023-08-25T04:21:21.899625+0000","last_unstale":"2023-08-25T04:21:25.841112+0000","last_undegraded":"2023-08-25T04:21:25.841112+0000","last_fullsized":"2023-08-25T04:21:25.841112+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:15:19.683497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840332+0000","last_change":"2023-08-25T04:21:22.916091+0000","last_active":"2023-08-25T04:21:25.840332+0000","last_peered":"2023-08-25T04:21:25.840332+0000","last_clean":"2023-08-25T04:21:25.840332+0000","last_became_active":"2023-08-25T04:21:22.915786+0000","last_became_peered":"2023-08-25T04:21:22.915786+0000","last_unstale":"2023-08-25T04:21:25.840332+0000","last_undegraded":"2023-08-25T04:21:25.840332+0000","last_fullsized":"2023-08-25T04:21:25.840332+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:01:10.869152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"121'1","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840867+0000","last_change":"2023-08-25T04:21:21.893141+0000","last_active":"2023-08-25T04:21:25.840867+0000","last_peered":"2023-08-25T04:21:25.840867+0000","last_clean":"2023-08-25T04:21:25.840867+0000","last_became_active":"2023-08-25T04:21:21.892800+0000","last_became_peered":"2023-08-25T04:21:21.892800+0000","last_unstale":"2023-08-25T04:21:25.840867+0000","last_undegraded":"2023-08-25T04:21:25.840867+0000","last_fullsized":"2023-08-25T04:21:25.840867+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:12:31.209352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903083+0000","last_change":"2023-08-25T04:21:22.898537+0000","last_active":"2023-08-25T04:21:23.903083+0000","last_peered":"2023-08-25T04:21:23.903083+0000","last_clean":"2023-08-25T04:21:23.903083+0000","last_became_active":"2023-08-25T04:21:22.898210+0000","last_became_peered":"2023-08-25T04:21:22.898210+0000","last_unstale":"2023-08-25T04:21:23.903083+0000","last_undegraded":"2023-08-25T04:21:23.903083+0000","last_fullsized":"2023-08-25T04:21:23.903083+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:20:03.163872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"121'2","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903734+0000","last_change":"2023-08-25T04:21:21.896120+0000","last_active":"2023-08-25T04:21:23.903734+0000","last_peered":"2023-08-25T04:21:23.903734+0000","last_clean":"2023-08-25T04:21:23.903734+0000","last_became_active":"2023-08-25T04:21:21.895802+0000","last_became_peered":"2023-08-25T04:21:21.895802+0000","last_unstale":"2023-08-25T04:21:23.903734+0000","last_undegraded":"2023-08-25T04:21:23.903734+0000","last_fullsized":"2023-08-25T04:21:23.903734+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:27:08.122614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162960+0000","last_change":"2023-08-25T04:21:22.908560+0000","last_active":"2023-08-25T04:21:25.162960+0000","last_peered":"2023-08-25T04:21:25.162960+0000","last_clean":"2023-08-25T04:21:25.162960+0000","last_became_active":"2023-08-25T04:21:22.908192+0000","last_became_peered":"2023-08-25T04:21:22.908192+0000","last_unstale":"2023-08-25T04:21:25.162960+0000","last_undegraded":"2023-08-25T04:21:25.162960+0000","last_fullsized":"2023-08-25T04:21:25.162960+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:22.279064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"121'2","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904340+0000","last_change":"2023-08-25T04:21:21.897330+0000","last_active":"2023-08-25T04:21:23.904340+0000","last_peered":"2023-08-25T04:21:23.904340+0000","last_clean":"2023-08-25T04:21:23.904340+0000","last_became_active":"2023-08-25T04:21:21.897056+0000","last_became_peered":"2023-08-25T04:21:21.897056+0000","last_unstale":"2023-08-25T04:21:23.904340+0000","last_undegraded":"2023-08-25T04:21:23.904340+0000","last_fullsized":"2023-08-25T04:21:23.904340+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:15:12.842982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841324+0000","last_change":"2023-08-25T04:21:22.914332+0000","last_active":"2023-08-25T04:21:25.841324+0000","last_peered":"2023-08-25T04:21:25.841324+0000","last_clean":"2023-08-25T04:21:25.841324+0000","last_became_active":"2023-08-25T04:21:22.913928+0000","last_became_peered":"2023-08-25T04:21:22.913928+0000","last_unstale":"2023-08-25T04:21:25.841324+0000","last_undegraded":"2023-08-25T04:21:25.841324+0000","last_fullsized":"2023-08-25T04:21:25.841324+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:58:21.611066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"121'1","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076445+0000","last_change":"2023-08-25T04:21:21.900487+0000","last_active":"2023-08-25T04:21:24.076445+0000","last_peered":"2023-08-25T04:21:24.076445+0000","last_clean":"2023-08-25T04:21:24.076445+0000","last_became_active":"2023-08-25T04:21:21.900194+0000","last_became_peered":"2023-08-25T04:21:21.900194+0000","last_unstale":"2023-08-25T04:21:24.076445+0000","last_undegraded":"2023-08-25T04:21:24.076445+0000","last_fullsized":"2023-08-25T04:21:24.076445+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:57:53.962598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.411030+0000","last_change":"2023-08-25T04:21:22.915270+0000","last_active":"2023-08-25T04:21:24.411030+0000","last_peered":"2023-08-25T04:21:24.411030+0000","last_clean":"2023-08-25T04:21:24.411030+0000","last_became_active":"2023-08-25T04:21:22.913744+0000","last_became_peered":"2023-08-25T04:21:22.913744+0000","last_unstale":"2023-08-25T04:21:24.411030+0000","last_undegraded":"2023-08-25T04:21:24.411030+0000","last_fullsized":"2023-08-25T04:21:24.411030+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:58:46.029608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"121'1","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162819+0000","last_change":"2023-08-25T04:21:21.897494+0000","last_active":"2023-08-25T04:21:25.162819+0000","last_peered":"2023-08-25T04:21:25.162819+0000","last_clean":"2023-08-25T04:21:25.162819+0000","last_became_active":"2023-08-25T04:21:21.897149+0000","last_became_peered":"2023-08-25T04:21:21.897149+0000","last_unstale":"2023-08-25T04:21:25.162819+0000","last_undegraded":"2023-08-25T04:21:25.162819+0000","last_fullsized":"2023-08-25T04:21:25.162819+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:04:11.190127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904271+0000","last_change":"2023-08-25T04:21:22.904977+0000","last_active":"2023-08-25T04:21:23.904271+0000","last_peered":"2023-08-25T04:21:23.904271+0000","last_clean":"2023-08-25T04:21:23.904271+0000","last_became_active":"2023-08-25T04:21:22.904612+0000","last_became_peered":"2023-08-25T04:21:22.904612+0000","last_unstale":"2023-08-25T04:21:23.904271+0000","last_undegraded":"2023-08-25T04:21:23.904271+0000","last_fullsized":"2023-08-25T04:21:23.904271+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:42:42.031026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902917+0000","last_change":"2023-08-25T04:21:21.895812+0000","last_active":"2023-08-25T04:21:23.902917+0000","last_peered":"2023-08-25T04:21:23.902917+0000","last_clean":"2023-08-25T04:21:23.902917+0000","last_became_active":"2023-08-25T04:21:21.895473+0000","last_became_peered":"2023-08-25T04:21:21.895473+0000","last_unstale":"2023-08-25T04:21:23.902917+0000","last_undegraded":"2023-08-25T04:21:23.902917+0000","last_fullsized":"2023-08-25T04:21:23.902917+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:23:23.072929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841106+0000","last_change":"2023-08-25T04:21:22.902808+0000","last_active":"2023-08-25T04:21:25.841106+0000","last_peered":"2023-08-25T04:21:25.841106+0000","last_clean":"2023-08-25T04:21:25.841106+0000","last_became_active":"2023-08-25T04:21:22.902536+0000","last_became_peered":"2023-08-25T04:21:22.902536+0000","last_unstale":"2023-08-25T04:21:25.841106+0000","last_undegraded":"2023-08-25T04:21:25.841106+0000","last_fullsized":"2023-08-25T04:21:25.841106+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:42:06.495784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840581+0000","last_change":"2023-08-25T04:21:21.900803+0000","last_active":"2023-08-25T04:21:25.840581+0000","last_peered":"2023-08-25T04:21:25.840581+0000","last_clean":"2023-08-25T04:21:25.840581+0000","last_became_active":"2023-08-25T04:21:21.900423+0000","last_became_peered":"2023-08-25T04:21:21.900423+0000","last_unstale":"2023-08-25T04:21:25.840581+0000","last_undegraded":"2023-08-25T04:21:25.840581+0000","last_fullsized":"2023-08-25T04:21:25.840581+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:28:18.099804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410801+0000","last_change":"2023-08-25T04:21:22.913903+0000","last_active":"2023-08-25T04:21:24.410801+0000","last_peered":"2023-08-25T04:21:24.410801+0000","last_clean":"2023-08-25T04:21:24.410801+0000","last_became_active":"2023-08-25T04:21:22.910534+0000","last_became_peered":"2023-08-25T04:21:22.910534+0000","last_unstale":"2023-08-25T04:21:24.410801+0000","last_undegraded":"2023-08-25T04:21:24.410801+0000","last_fullsized":"2023-08-25T04:21:24.410801+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:39:37.908542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903950+0000","last_change":"2023-08-25T04:21:21.896785+0000","last_active":"2023-08-25T04:21:23.903950+0000","last_peered":"2023-08-25T04:21:23.903950+0000","last_clean":"2023-08-25T04:21:23.903950+0000","last_became_active":"2023-08-25T04:21:21.896250+0000","last_became_peered":"2023-08-25T04:21:21.896250+0000","last_unstale":"2023-08-25T04:21:23.903950+0000","last_undegraded":"2023-08-25T04:21:23.903950+0000","last_fullsized":"2023-08-25T04:21:23.903950+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:39:26.103990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904017+0000","last_change":"2023-08-25T04:21:22.906785+0000","last_active":"2023-08-25T04:21:23.904017+0000","last_peered":"2023-08-25T04:21:23.904017+0000","last_clean":"2023-08-25T04:21:23.904017+0000","last_became_active":"2023-08-25T04:21:22.905604+0000","last_became_peered":"2023-08-25T04:21:22.905604+0000","last_unstale":"2023-08-25T04:21:23.904017+0000","last_undegraded":"2023-08-25T04:21:23.904017+0000","last_fullsized":"2023-08-25T04:21:23.904017+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:07:02.772070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410927+0000","last_change":"2023-08-25T04:21:21.904376+0000","last_active":"2023-08-25T04:21:24.410927+0000","last_peered":"2023-08-25T04:21:24.410927+0000","last_clean":"2023-08-25T04:21:24.410927+0000","last_became_active":"2023-08-25T04:21:21.904102+0000","last_became_peered":"2023-08-25T04:21:21.904102+0000","last_unstale":"2023-08-25T04:21:24.410927+0000","last_undegraded":"2023-08-25T04:21:24.410927+0000","last_fullsized":"2023-08-25T04:21:24.410927+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:26:24.990460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840462+0000","last_change":"2023-08-25T04:21:22.901342+0000","last_active":"2023-08-25T04:21:25.840462+0000","last_peered":"2023-08-25T04:21:25.840462+0000","last_clean":"2023-08-25T04:21:25.840462+0000","last_became_active":"2023-08-25T04:21:22.900963+0000","last_became_peered":"2023-08-25T04:21:22.900963+0000","last_unstale":"2023-08-25T04:21:25.840462+0000","last_undegraded":"2023-08-25T04:21:25.840462+0000","last_fullsized":"2023-08-25T04:21:25.840462+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:22:10.110622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"121'3","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076512+0000","last_change":"2023-08-25T04:21:21.902909+0000","last_active":"2023-08-25T04:21:24.076512+0000","last_peered":"2023-08-25T04:21:24.076512+0000","last_clean":"2023-08-25T04:21:24.076512+0000","last_became_active":"2023-08-25T04:21:21.902545+0000","last_became_peered":"2023-08-25T04:21:21.902545+0000","last_unstale":"2023-08-25T04:21:24.076512+0000","last_undegraded":"2023-08-25T04:21:24.076512+0000","last_fullsized":"2023-08-25T04:21:24.076512+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:09:15.210507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904324+0000","last_change":"2023-08-25T04:21:22.902324+0000","last_active":"2023-08-25T04:21:23.904324+0000","last_peered":"2023-08-25T04:21:23.904324+0000","last_clean":"2023-08-25T04:21:23.904324+0000","last_became_active":"2023-08-25T04:21:22.902041+0000","last_became_peered":"2023-08-25T04:21:22.902041+0000","last_unstale":"2023-08-25T04:21:23.904324+0000","last_undegraded":"2023-08-25T04:21:23.904324+0000","last_fullsized":"2023-08-25T04:21:23.904324+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:06:37.497907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"121'6","reported_seq":19,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903081+0000","last_change":"2023-08-25T04:21:21.900886+0000","last_active":"2023-08-25T04:21:23.903081+0000","last_peered":"2023-08-25T04:21:23.903081+0000","last_clean":"2023-08-25T04:21:23.903081+0000","last_became_active":"2023-08-25T04:21:21.900551+0000","last_became_peered":"2023-08-25T04:21:21.900551+0000","last_unstale":"2023-08-25T04:21:23.903081+0000","last_undegraded":"2023-08-25T04:21:23.903081+0000","last_fullsized":"2023-08-25T04:21:23.903081+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:23:38.270992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162893+0000","last_change":"2023-08-25T04:21:22.903988+0000","last_active":"2023-08-25T04:21:25.162893+0000","last_peered":"2023-08-25T04:21:25.162893+0000","last_clean":"2023-08-25T04:21:25.162893+0000","last_became_active":"2023-08-25T04:21:22.903724+0000","last_became_peered":"2023-08-25T04:21:22.903724+0000","last_unstale":"2023-08-25T04:21:25.162893+0000","last_undegraded":"2023-08-25T04:21:25.162893+0000","last_fullsized":"2023-08-25T04:21:25.162893+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:03:42.498327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"121'2","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904362+0000","last_change":"2023-08-25T04:21:21.905116+0000","last_active":"2023-08-25T04:21:23.904362+0000","last_peered":"2023-08-25T04:21:23.904362+0000","last_clean":"2023-08-25T04:21:23.904362+0000","last_became_active":"2023-08-25T04:21:21.904844+0000","last_became_peered":"2023-08-25T04:21:21.904844+0000","last_unstale":"2023-08-25T04:21:23.904362+0000","last_undegraded":"2023-08-25T04:21:23.904362+0000","last_fullsized":"2023-08-25T04:21:23.904362+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:58:29.301464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903587+0000","last_change":"2023-08-25T04:21:22.898823+0000","last_active":"2023-08-25T04:21:23.903587+0000","last_peered":"2023-08-25T04:21:23.903587+0000","last_clean":"2023-08-25T04:21:23.903587+0000","last_became_active":"2023-08-25T04:21:22.898537+0000","last_became_peered":"2023-08-25T04:21:22.898537+0000","last_unstale":"2023-08-25T04:21:23.903587+0000","last_undegraded":"2023-08-25T04:21:23.903587+0000","last_fullsized":"2023-08-25T04:21:23.903587+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:33:39.849943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841204+0000","last_change":"2023-08-25T04:21:21.899098+0000","last_active":"2023-08-25T04:21:25.841204+0000","last_peered":"2023-08-25T04:21:25.841204+0000","last_clean":"2023-08-25T04:21:25.841204+0000","last_became_active":"2023-08-25T04:21:21.898766+0000","last_became_peered":"2023-08-25T04:21:21.898766+0000","last_unstale":"2023-08-25T04:21:25.841204+0000","last_undegraded":"2023-08-25T04:21:25.841204+0000","last_fullsized":"2023-08-25T04:21:25.841204+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:44:11.564456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840804+0000","last_change":"2023-08-25T04:21:22.909026+0000","last_active":"2023-08-25T04:21:25.840804+0000","last_peered":"2023-08-25T04:21:25.840804+0000","last_clean":"2023-08-25T04:21:25.840804+0000","last_became_active":"2023-08-25T04:21:22.908495+0000","last_became_peered":"2023-08-25T04:21:22.908495+0000","last_unstale":"2023-08-25T04:21:25.840804+0000","last_undegraded":"2023-08-25T04:21:25.840804+0000","last_fullsized":"2023-08-25T04:21:25.840804+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:14:51.718532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840422+0000","last_change":"2023-08-25T04:21:21.898251+0000","last_active":"2023-08-25T04:21:25.840422+0000","last_peered":"2023-08-25T04:21:25.840422+0000","last_clean":"2023-08-25T04:21:25.840422+0000","last_became_active":"2023-08-25T04:21:21.897984+0000","last_became_peered":"2023-08-25T04:21:21.897984+0000","last_unstale":"2023-08-25T04:21:25.840422+0000","last_undegraded":"2023-08-25T04:21:25.840422+0000","last_fullsized":"2023-08-25T04:21:25.840422+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:41:07.834007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.411139+0000","last_change":"2023-08-25T04:21:22.910451+0000","last_active":"2023-08-25T04:21:24.411139+0000","last_peered":"2023-08-25T04:21:24.411139+0000","last_clean":"2023-08-25T04:21:24.411139+0000","last_became_active":"2023-08-25T04:21:22.909110+0000","last_became_peered":"2023-08-25T04:21:22.909110+0000","last_unstale":"2023-08-25T04:21:24.411139+0000","last_undegraded":"2023-08-25T04:21:24.411139+0000","last_fullsized":"2023-08-25T04:21:24.411139+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:13:10.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"121'8","reported_seq":21,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902573+0000","last_change":"2023-08-25T04:21:21.896664+0000","last_active":"2023-08-25T04:21:23.902573+0000","last_peered":"2023-08-25T04:21:23.902573+0000","last_clean":"2023-08-25T04:21:23.902573+0000","last_became_active":"2023-08-25T04:21:21.896158+0000","last_became_peered":"2023-08-25T04:21:21.896158+0000","last_unstale":"2023-08-25T04:21:23.902573+0000","last_undegraded":"2023-08-25T04:21:23.902573+0000","last_fullsized":"2023-08-25T04:21:23.902573+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:53:23.641692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410675+0000","last_change":"2023-08-25T04:21:22.903079+0000","last_active":"2023-08-25T04:21:24.410675+0000","last_peered":"2023-08-25T04:21:24.410675+0000","last_clean":"2023-08-25T04:21:24.410675+0000","last_became_active":"2023-08-25T04:21:22.902772+0000","last_became_peered":"2023-08-25T04:21:22.902772+0000","last_unstale":"2023-08-25T04:21:24.410675+0000","last_undegraded":"2023-08-25T04:21:24.410675+0000","last_fullsized":"2023-08-25T04:21:24.410675+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:46:54.200389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"121'2","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904616+0000","last_change":"2023-08-25T04:21:21.903246+0000","last_active":"2023-08-25T04:21:23.904616+0000","last_peered":"2023-08-25T04:21:23.904616+0000","last_clean":"2023-08-25T04:21:23.904616+0000","last_became_active":"2023-08-25T04:21:21.902949+0000","last_became_peered":"2023-08-25T04:21:21.902949+0000","last_unstale":"2023-08-25T04:21:23.904616+0000","last_undegraded":"2023-08-25T04:21:23.904616+0000","last_fullsized":"2023-08-25T04:21:23.904616+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:15:50.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902792+0000","last_change":"2023-08-25T04:21:22.894828+0000","last_active":"2023-08-25T04:21:23.902792+0000","last_peered":"2023-08-25T04:21:23.902792+0000","last_clean":"2023-08-25T04:21:23.902792+0000","last_became_active":"2023-08-25T04:21:22.894508+0000","last_became_peered":"2023-08-25T04:21:22.894508+0000","last_unstale":"2023-08-25T04:21:23.902792+0000","last_undegraded":"2023-08-25T04:21:23.902792+0000","last_fullsized":"2023-08-25T04:21:23.902792+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:21:06.670524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.411067+0000","last_change":"2023-08-25T04:21:21.901910+0000","last_active":"2023-08-25T04:21:24.411067+0000","last_peered":"2023-08-25T04:21:24.411067+0000","last_clean":"2023-08-25T04:21:24.411067+0000","last_became_active":"2023-08-25T04:21:21.901498+0000","last_became_peered":"2023-08-25T04:21:21.901498+0000","last_unstale":"2023-08-25T04:21:24.411067+0000","last_undegraded":"2023-08-25T04:21:24.411067+0000","last_fullsized":"2023-08-25T04:21:24.411067+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:00:15.013692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841079+0000","last_change":"2023-08-25T04:21:22.907540+0000","last_active":"2023-08-25T04:21:25.841079+0000","last_peered":"2023-08-25T04:21:25.841079+0000","last_clean":"2023-08-25T04:21:25.841079+0000","last_became_active":"2023-08-25T04:21:22.907269+0000","last_became_peered":"2023-08-25T04:21:22.907269+0000","last_unstale":"2023-08-25T04:21:25.841079+0000","last_undegraded":"2023-08-25T04:21:25.841079+0000","last_fullsized":"2023-08-25T04:21:25.841079+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:05:42.134636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903637+0000","last_change":"2023-08-25T04:21:21.897043+0000","last_active":"2023-08-25T04:21:23.903637+0000","last_peered":"2023-08-25T04:21:23.903637+0000","last_clean":"2023-08-25T04:21:23.903637+0000","last_became_active":"2023-08-25T04:21:21.896732+0000","last_became_peered":"2023-08-25T04:21:21.896732+0000","last_unstale":"2023-08-25T04:21:23.903637+0000","last_undegraded":"2023-08-25T04:21:23.903637+0000","last_fullsized":"2023-08-25T04:21:23.903637+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:23:56.687199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162960+0000","last_change":"2023-08-25T04:21:22.907863+0000","last_active":"2023-08-25T04:21:25.162960+0000","last_peered":"2023-08-25T04:21:25.162960+0000","last_clean":"2023-08-25T04:21:25.162960+0000","last_became_active":"2023-08-25T04:21:22.907427+0000","last_became_peered":"2023-08-25T04:21:22.907427+0000","last_unstale":"2023-08-25T04:21:25.162960+0000","last_undegraded":"2023-08-25T04:21:25.162960+0000","last_fullsized":"2023-08-25T04:21:25.162960+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:40.590057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904657+0000","last_change":"2023-08-25T04:21:21.899448+0000","last_active":"2023-08-25T04:21:23.904657+0000","last_peered":"2023-08-25T04:21:23.904657+0000","last_clean":"2023-08-25T04:21:23.904657+0000","last_became_active":"2023-08-25T04:21:21.899162+0000","last_became_peered":"2023-08-25T04:21:21.899162+0000","last_unstale":"2023-08-25T04:21:23.904657+0000","last_undegraded":"2023-08-25T04:21:23.904657+0000","last_fullsized":"2023-08-25T04:21:23.904657+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:10:45.794596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840819+0000","last_change":"2023-08-25T04:21:22.916377+0000","last_active":"2023-08-25T04:21:25.840819+0000","last_peered":"2023-08-25T04:21:25.840819+0000","last_clean":"2023-08-25T04:21:25.840819+0000","last_became_active":"2023-08-25T04:21:22.915939+0000","last_became_peered":"2023-08-25T04:21:22.915939+0000","last_unstale":"2023-08-25T04:21:25.840819+0000","last_undegraded":"2023-08-25T04:21:25.840819+0000","last_fullsized":"2023-08-25T04:21:25.840819+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:34.902641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903453+0000","last_change":"2023-08-25T04:21:21.893809+0000","last_active":"2023-08-25T04:21:23.903453+0000","last_peered":"2023-08-25T04:21:23.903453+0000","last_clean":"2023-08-25T04:21:23.903453+0000","last_became_active":"2023-08-25T04:21:21.893520+0000","last_became_peered":"2023-08-25T04:21:21.893520+0000","last_unstale":"2023-08-25T04:21:23.903453+0000","last_undegraded":"2023-08-25T04:21:23.903453+0000","last_fullsized":"2023-08-25T04:21:23.903453+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:43:16.462790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840847+0000","last_change":"2023-08-25T04:21:22.900921+0000","last_active":"2023-08-25T04:21:25.840847+0000","last_peered":"2023-08-25T04:21:25.840847+0000","last_clean":"2023-08-25T04:21:25.840847+0000","last_became_active":"2023-08-25T04:21:22.900466+0000","last_became_peered":"2023-08-25T04:21:22.900466+0000","last_unstale":"2023-08-25T04:21:25.840847+0000","last_undegraded":"2023-08-25T04:21:25.840847+0000","last_fullsized":"2023-08-25T04:21:25.840847+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:09:07.904186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840592+0000","last_change":"2023-08-25T04:21:21.897723+0000","last_active":"2023-08-25T04:21:25.840592+0000","last_peered":"2023-08-25T04:21:25.840592+0000","last_clean":"2023-08-25T04:21:25.840592+0000","last_became_active":"2023-08-25T04:21:21.897454+0000","last_became_peered":"2023-08-25T04:21:21.897454+0000","last_unstale":"2023-08-25T04:21:25.840592+0000","last_undegraded":"2023-08-25T04:21:25.840592+0000","last_fullsized":"2023-08-25T04:21:25.840592+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:34:44.246278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076639+0000","last_change":"2023-08-25T04:21:22.903968+0000","last_active":"2023-08-25T04:21:24.076639+0000","last_peered":"2023-08-25T04:21:24.076639+0000","last_clean":"2023-08-25T04:21:24.076639+0000","last_became_active":"2023-08-25T04:21:22.903669+0000","last_became_peered":"2023-08-25T04:21:22.903669+0000","last_unstale":"2023-08-25T04:21:24.076639+0000","last_undegraded":"2023-08-25T04:21:24.076639+0000","last_fullsized":"2023-08-25T04:21:24.076639+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:11.463372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903246+0000","last_change":"2023-08-25T04:21:21.897193+0000","last_active":"2023-08-25T04:21:23.903246+0000","last_peered":"2023-08-25T04:21:23.903246+0000","last_clean":"2023-08-25T04:21:23.903246+0000","last_became_active":"2023-08-25T04:21:21.896858+0000","last_became_peered":"2023-08-25T04:21:21.896858+0000","last_unstale":"2023-08-25T04:21:23.903246+0000","last_undegraded":"2023-08-25T04:21:23.903246+0000","last_fullsized":"2023-08-25T04:21:23.903246+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:23:32.684612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.163362+0000","last_change":"2023-08-25T04:21:22.901384+0000","last_active":"2023-08-25T04:21:25.163362+0000","last_peered":"2023-08-25T04:21:25.163362+0000","last_clean":"2023-08-25T04:21:25.163362+0000","last_became_active":"2023-08-25T04:21:22.901073+0000","last_became_peered":"2023-08-25T04:21:22.901073+0000","last_unstale":"2023-08-25T04:21:25.163362+0000","last_undegraded":"2023-08-25T04:21:25.163362+0000","last_fullsized":"2023-08-25T04:21:25.163362+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:01:08.975856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841028+0000","last_change":"2023-08-25T04:21:21.896102+0000","last_active":"2023-08-25T04:21:25.841028+0000","last_peered":"2023-08-25T04:21:25.841028+0000","last_clean":"2023-08-25T04:21:25.841028+0000","last_became_active":"2023-08-25T04:21:21.895635+0000","last_became_peered":"2023-08-25T04:21:21.895635+0000","last_unstale":"2023-08-25T04:21:25.841028+0000","last_undegraded":"2023-08-25T04:21:25.841028+0000","last_fullsized":"2023-08-25T04:21:25.841028+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:06:47.686562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162827+0000","last_change":"2023-08-25T04:21:22.900419+0000","last_active":"2023-08-25T04:21:25.162827+0000","last_peered":"2023-08-25T04:21:25.162827+0000","last_clean":"2023-08-25T04:21:25.162827+0000","last_became_active":"2023-08-25T04:21:22.900107+0000","last_became_peered":"2023-08-25T04:21:22.900107+0000","last_unstale":"2023-08-25T04:21:25.162827+0000","last_undegraded":"2023-08-25T04:21:25.162827+0000","last_fullsized":"2023-08-25T04:21:25.162827+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:13:10.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"121'2","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840902+0000","last_change":"2023-08-25T04:21:21.900342+0000","last_active":"2023-08-25T04:21:25.840902+0000","last_peered":"2023-08-25T04:21:25.840902+0000","last_clean":"2023-08-25T04:21:25.840902+0000","last_became_active":"2023-08-25T04:21:21.899299+0000","last_became_peered":"2023-08-25T04:21:21.899299+0000","last_unstale":"2023-08-25T04:21:25.840902+0000","last_undegraded":"2023-08-25T04:21:25.840902+0000","last_fullsized":"2023-08-25T04:21:25.840902+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:56:15.651762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"111'3532","reported_seq":4056,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076405+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:21:24.076405+0000","last_peered":"2023-08-25T04:21:24.076405+0000","last_clean":"2023-08-25T04:21:24.076405+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:21:24.076405+0000","last_undegraded":"2023-08-25T04:21:24.076405+0000","last_fullsized":"2023-08-25T04:21:24.076405+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:49:26.318209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1040,"num_read_kb":2137,"num_write":345,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":187,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.163082+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:21:25.163082+0000","last_peered":"2023-08-25T04:21:25.163082+0000","last_clean":"2023-08-25T04:21:25.163082+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:21:25.163082+0000","last_undegraded":"2023-08-25T04:21:25.163082+0000","last_fullsized":"2023-08-25T04:21:25.163082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:35:51.566579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903521+0000","last_change":"2023-08-25T04:21:22.897658+0000","last_active":"2023-08-25T04:21:23.903521+0000","last_peered":"2023-08-25T04:21:23.903521+0000","last_clean":"2023-08-25T04:21:23.903521+0000","last_became_active":"2023-08-25T04:21:22.897340+0000","last_became_peered":"2023-08-25T04:21:22.897340+0000","last_unstale":"2023-08-25T04:21:23.903521+0000","last_undegraded":"2023-08-25T04:21:23.903521+0000","last_fullsized":"2023-08-25T04:21:23.903521+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:02:42.501230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"121'1","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076650+0000","last_change":"2023-08-25T04:21:21.900979+0000","last_active":"2023-08-25T04:21:24.076650+0000","last_peered":"2023-08-25T04:21:24.076650+0000","last_clean":"2023-08-25T04:21:24.076650+0000","last_became_active":"2023-08-25T04:21:21.900548+0000","last_became_peered":"2023-08-25T04:21:21.900548+0000","last_unstale":"2023-08-25T04:21:24.076650+0000","last_undegraded":"2023-08-25T04:21:24.076650+0000","last_fullsized":"2023-08-25T04:21:24.076650+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:10.087987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":190,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076231+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:21:24.076231+0000","last_peered":"2023-08-25T04:21:24.076231+0000","last_clean":"2023-08-25T04:21:24.076231+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:21:24.076231+0000","last_undegraded":"2023-08-25T04:21:24.076231+0000","last_fullsized":"2023-08-25T04:21:24.076231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:50:46.284319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904268+0000","last_change":"2023-08-25T04:21:22.893095+0000","last_active":"2023-08-25T04:21:23.904268+0000","last_peered":"2023-08-25T04:21:23.904268+0000","last_clean":"2023-08-25T04:21:23.904268+0000","last_became_active":"2023-08-25T04:21:22.892796+0000","last_became_peered":"2023-08-25T04:21:22.892796+0000","last_unstale":"2023-08-25T04:21:23.904268+0000","last_undegraded":"2023-08-25T04:21:23.904268+0000","last_fullsized":"2023-08-25T04:21:23.904268+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:17:01.059229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162978+0000","last_change":"2023-08-25T04:21:21.897616+0000","last_active":"2023-08-25T04:21:25.162978+0000","last_peered":"2023-08-25T04:21:25.162978+0000","last_clean":"2023-08-25T04:21:25.162978+0000","last_became_active":"2023-08-25T04:21:21.897331+0000","last_became_peered":"2023-08-25T04:21:21.897331+0000","last_unstale":"2023-08-25T04:21:25.162978+0000","last_undegraded":"2023-08-25T04:21:25.162978+0000","last_fullsized":"2023-08-25T04:21:25.162978+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:21:42.629328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":195,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841171+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:21:25.841171+0000","last_peered":"2023-08-25T04:21:25.841171+0000","last_clean":"2023-08-25T04:21:25.841171+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:21:25.841171+0000","last_undegraded":"2023-08-25T04:21:25.841171+0000","last_fullsized":"2023-08-25T04:21:25.841171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:23.051206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840349+0000","last_change":"2023-08-25T04:21:22.906887+0000","last_active":"2023-08-25T04:21:25.840349+0000","last_peered":"2023-08-25T04:21:25.840349+0000","last_clean":"2023-08-25T04:21:25.840349+0000","last_became_active":"2023-08-25T04:21:22.906378+0000","last_became_peered":"2023-08-25T04:21:22.906378+0000","last_unstale":"2023-08-25T04:21:25.840349+0000","last_undegraded":"2023-08-25T04:21:25.840349+0000","last_fullsized":"2023-08-25T04:21:25.840349+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:37:21.744515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"121'1","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903928+0000","last_change":"2023-08-25T04:21:21.893780+0000","last_active":"2023-08-25T04:21:23.903928+0000","last_peered":"2023-08-25T04:21:23.903928+0000","last_clean":"2023-08-25T04:21:23.903928+0000","last_became_active":"2023-08-25T04:21:21.893498+0000","last_became_peered":"2023-08-25T04:21:21.893498+0000","last_unstale":"2023-08-25T04:21:23.903928+0000","last_undegraded":"2023-08-25T04:21:23.903928+0000","last_fullsized":"2023-08-25T04:21:23.903928+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:45:30.286920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":187,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162798+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:21:25.162798+0000","last_peered":"2023-08-25T04:21:25.162798+0000","last_clean":"2023-08-25T04:21:25.162798+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:21:25.162798+0000","last_undegraded":"2023-08-25T04:21:25.162798+0000","last_fullsized":"2023-08-25T04:21:25.162798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:40:09.787141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840704+0000","last_change":"2023-08-25T04:21:22.908616+0000","last_active":"2023-08-25T04:21:25.840704+0000","last_peered":"2023-08-25T04:21:25.840704+0000","last_clean":"2023-08-25T04:21:25.840704+0000","last_became_active":"2023-08-25T04:21:22.908297+0000","last_became_peered":"2023-08-25T04:21:22.908297+0000","last_unstale":"2023-08-25T04:21:25.840704+0000","last_undegraded":"2023-08-25T04:21:25.840704+0000","last_fullsized":"2023-08-25T04:21:25.840704+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:38:43.950220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903108+0000","last_change":"2023-08-25T04:21:21.890257+0000","last_active":"2023-08-25T04:21:23.903108+0000","last_peered":"2023-08-25T04:21:23.903108+0000","last_clean":"2023-08-25T04:21:23.903108+0000","last_became_active":"2023-08-25T04:21:21.889952+0000","last_became_peered":"2023-08-25T04:21:21.889952+0000","last_unstale":"2023-08-25T04:21:23.903108+0000","last_undegraded":"2023-08-25T04:21:23.903108+0000","last_fullsized":"2023-08-25T04:21:23.903108+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:16:23.636146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":203,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904464+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:21:23.904464+0000","last_peered":"2023-08-25T04:21:23.904464+0000","last_clean":"2023-08-25T04:21:23.904464+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:21:23.904464+0000","last_undegraded":"2023-08-25T04:21:23.904464+0000","last_fullsized":"2023-08-25T04:21:23.904464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:38:00.891104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841103+0000","last_change":"2023-08-25T04:21:22.911195+0000","last_active":"2023-08-25T04:21:25.841103+0000","last_peered":"2023-08-25T04:21:25.841103+0000","last_clean":"2023-08-25T04:21:25.841103+0000","last_became_active":"2023-08-25T04:21:22.910585+0000","last_became_peered":"2023-08-25T04:21:22.910585+0000","last_unstale":"2023-08-25T04:21:25.841103+0000","last_undegraded":"2023-08-25T04:21:25.841103+0000","last_fullsized":"2023-08-25T04:21:25.841103+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:25:56.030464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840387+0000","last_change":"2023-08-25T04:21:21.903096+0000","last_active":"2023-08-25T04:21:25.840387+0000","last_peered":"2023-08-25T04:21:25.840387+0000","last_clean":"2023-08-25T04:21:25.840387+0000","last_became_active":"2023-08-25T04:21:21.902800+0000","last_became_peered":"2023-08-25T04:21:21.902800+0000","last_unstale":"2023-08-25T04:21:25.840387+0000","last_undegraded":"2023-08-25T04:21:25.840387+0000","last_fullsized":"2023-08-25T04:21:25.840387+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:55:56.837970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076659+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:21:24.076659+0000","last_peered":"2023-08-25T04:21:24.076659+0000","last_clean":"2023-08-25T04:21:24.076659+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:21:24.076659+0000","last_undegraded":"2023-08-25T04:21:24.076659+0000","last_fullsized":"2023-08-25T04:21:24.076659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:27:10.575116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410697+0000","last_change":"2023-08-25T04:21:22.912635+0000","last_active":"2023-08-25T04:21:24.410697+0000","last_peered":"2023-08-25T04:21:24.410697+0000","last_clean":"2023-08-25T04:21:24.410697+0000","last_became_active":"2023-08-25T04:21:22.912251+0000","last_became_peered":"2023-08-25T04:21:22.912251+0000","last_unstale":"2023-08-25T04:21:24.410697+0000","last_undegraded":"2023-08-25T04:21:24.410697+0000","last_fullsized":"2023-08-25T04:21:24.410697+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:07:08.209942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"121'2","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840713+0000","last_change":"2023-08-25T04:21:21.903014+0000","last_active":"2023-08-25T04:21:25.840713+0000","last_peered":"2023-08-25T04:21:25.840713+0000","last_clean":"2023-08-25T04:21:25.840713+0000","last_became_active":"2023-08-25T04:21:21.902701+0000","last_became_peered":"2023-08-25T04:21:21.902701+0000","last_unstale":"2023-08-25T04:21:25.840713+0000","last_undegraded":"2023-08-25T04:21:25.840713+0000","last_fullsized":"2023-08-25T04:21:25.840713+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:54:51.762146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":203,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904618+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:21:23.904618+0000","last_peered":"2023-08-25T04:21:23.904618+0000","last_clean":"2023-08-25T04:21:23.904618+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:21:23.904618+0000","last_undegraded":"2023-08-25T04:21:23.904618+0000","last_fullsized":"2023-08-25T04:21:23.904618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:18:52.419533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410922+0000","last_change":"2023-08-25T04:21:22.914660+0000","last_active":"2023-08-25T04:21:24.410922+0000","last_peered":"2023-08-25T04:21:24.410922+0000","last_clean":"2023-08-25T04:21:24.410922+0000","last_became_active":"2023-08-25T04:21:22.909767+0000","last_became_peered":"2023-08-25T04:21:22.909767+0000","last_unstale":"2023-08-25T04:21:24.410922+0000","last_undegraded":"2023-08-25T04:21:24.410922+0000","last_fullsized":"2023-08-25T04:21:24.410922+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:32:16.049571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840266+0000","last_change":"2023-08-25T04:21:21.901171+0000","last_active":"2023-08-25T04:21:25.840266+0000","last_peered":"2023-08-25T04:21:25.840266+0000","last_clean":"2023-08-25T04:21:25.840266+0000","last_became_active":"2023-08-25T04:21:21.900896+0000","last_became_peered":"2023-08-25T04:21:21.900896+0000","last_unstale":"2023-08-25T04:21:25.840266+0000","last_undegraded":"2023-08-25T04:21:25.840266+0000","last_fullsized":"2023-08-25T04:21:25.840266+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:06:42.554534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":217,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904079+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:21:23.904079+0000","last_peered":"2023-08-25T04:21:23.904079+0000","last_clean":"2023-08-25T04:21:23.904079+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:21:23.904079+0000","last_undegraded":"2023-08-25T04:21:23.904079+0000","last_fullsized":"2023-08-25T04:21:23.904079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:03:44.441477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1040,"num_read_kb":2137,"num_write":345,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3532,"ondisk_log_size":3532,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509663,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59600,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312240,"statfs":{"total":96636764160,"available":96575733760,"internally_reserved":0,"allocated":2101248,"data_stored":1337669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.67100000000000004,"15min":0.69599999999999995},"min":{"1min":0.501,"5min":0.35399999999999998,"15min":0.33700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.67700000000000005,"15min":0.71299999999999997},"min":{"1min":0.44500000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1,"5min":1,"15min":1.0249999999999999},"last":0.88600000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.70799999999999996,"15min":0.72799999999999998},"min":{"1min":0.51900000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.70199999999999996,"15min":0.72899999999999998},"min":{"1min":0.47399999999999998,"5min":0.377,"15min":0.374},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.036},"last":0.83599999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68200000000000005,"15min":0.70599999999999996},"min":{"1min":0.49399999999999999,"5min":0.38100000000000001,"15min":0.34899999999999998},"max":{"1min":0.89500000000000002,"5min":0.94299999999999995,"15min":1.018},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.71099999999999997,"15min":0.74099999999999999},"min":{"1min":0.498,"5min":0.46500000000000002,"15min":0.38100000000000001},"max":{"1min":1.0429999999999999,"5min":1.046,"15min":1.046},"last":0.90200000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.70099999999999996,"15min":0.73099999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.75},{"interface":"front","average":{"1min":0.755,"5min":0.71799999999999997,"15min":0.74299999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.85499999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59099999999999997,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.34499999999999997,"15min":0.32400000000000001},"max":{"1min":1.004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":1.004},{"interface":"front","average":{"1min":0.621,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.38900000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.97599999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.97599999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40500000000000003,"15min":0.377},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63800000000000001,"15min":0.63100000000000001},"min":{"1min":0.46600000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.99099999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.442,"5min":0.42799999999999999,"15min":0.42699999999999999},"max":{"1min":1.0169999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.81200000000000006}]}]},{"osd":6,"up_from":15,"seq":64424509663,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36828,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335012,"statfs":{"total":96636764160,"available":96599052288,"internally_reserved":0,"allocated":1519616,"data_stored":749357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.66300000000000003,"15min":0.69599999999999995},"min":{"1min":0.53200000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.88500000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.622},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66400000000000003,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84299999999999997,"5min":0.96499999999999997,"15min":1.054},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69799999999999995,"15min":0.72699999999999998},"min":{"1min":0.48699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96299999999999997,"5min":1.0269999999999999,"15min":1.0369999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69599999999999995,"15min":0.72199999999999998},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90500000000000003,"5min":1.109,"15min":1.109},"last":0.70399999999999996}]},{"osd":2,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70199999999999996,"15min":0.72899999999999998},"min":{"1min":0.54200000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86799999999999999,"5min":1.0009999999999999,"15min":1.1020000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.59299999999999997,"5min":0.499,"15min":0.499},"max":{"1min":0.92900000000000005,"5min":1.0569999999999999,"15min":1.117},"last":0.76900000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.51600000000000001,"5min":0.48499999999999999,"15min":0.46899999999999997},"max":{"1min":0.88700000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.52500000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93999999999999995,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.753}]},{"osd":4,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39400000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.42299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.92200000000000004,"5min":0.95799999999999996,"15min":1.0820000000000001},"last":0.78400000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.48199999999999998,"5min":0.39200000000000002,"15min":0.373},"max":{"1min":0.874,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91700000000000004,"5min":1.141,"15min":1.141},"last":0.81499999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.502,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":1.0389999999999999,"15min":1.046},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71699999999999997,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.44700000000000001},"max":{"1min":0.94199999999999995,"5min":1.373,"15min":1.373},"last":0.71899999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542366,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":747141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65200000000000002,"15min":0.69799999999999995},"min":{"1min":0.498,"5min":0.313,"15min":0.313},"max":{"1min":0.91300000000000003,"5min":0.98099999999999998,"15min":1.018},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66900000000000004,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0409999999999999},"last":0.63200000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.67000000000000004,"15min":0.71899999999999997},"min":{"1min":0.51200000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.99399999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.70299999999999996,"15min":0.73099999999999998},"min":{"1min":0.46400000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.82299999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.66300000000000003,"15min":0.71499999999999997},"min":{"1min":0.58699999999999997,"5min":0.40799999999999997,"15min":0.39500000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.97499999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70199999999999996,"15min":0.73599999999999999},"min":{"1min":0.58499999999999996,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.66600000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70199999999999996,"15min":0.72599999999999998},"min":{"1min":0.55800000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.94199999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.70999999999999996,"15min":0.75600000000000001},"min":{"1min":0.626,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.008,"5min":1.028,"15min":1.028},"last":0.85399999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.44500000000000001,"5min":0.38400000000000001,"15min":0.35399999999999998},"max":{"1min":0.72199999999999998,"5min":0.91000000000000003,"15min":0.97099999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.46800000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.874,"5min":0.99399999999999999,"15min":1.018},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:21:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.44600000000000001,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.82399999999999995,"5min":0.96799999999999997,"15min":1.008},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.48199999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79400000000000004,"5min":0.94199999999999995,"15min":0.98299999999999998},"last":0.73699999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:21:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.63400000000000001,"15min":0.61499999999999999},"min":{"1min":0.47499999999999998,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.84699999999999998,"5min":0.93300000000000005,"15min":1.032},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69099999999999995,"15min":0.68999999999999995},"min":{"1min":0.55700000000000005,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.94999999999999996,"5min":1.01,"15min":1.048},"last":0.877}]}]},{"osd":4,"up_from":14,"seq":60129542366,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36816,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335024,"statfs":{"total":96636764160,"available":96599064576,"internally_reserved":0,"allocated":1507328,"data_stored":747233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64600000000000002,"15min":0.69599999999999995},"min":{"1min":0.45600000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.99299999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65700000000000003,"15min":0.69099999999999995},"min":{"1min":0.499,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83699999999999997,"5min":0.90200000000000002,"15min":0.96699999999999997},"last":0.53400000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.68700000000000006,"15min":0.72199999999999998},"min":{"1min":0.46600000000000003,"5min":0.38200000000000001,"15min":0.36199999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0449999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67500000000000004,"15min":0.72399999999999998},"min":{"1min":0.47599999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92100000000000004,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69799999999999995,"15min":0.748},"min":{"1min":0.48099999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91500000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.69699999999999995,"15min":0.73599999999999999},"min":{"1min":0.48399999999999999,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":0.97699999999999998,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.66800000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.71899999999999997,"15min":0.755},"min":{"1min":0.52500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.048},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69599999999999995,"15min":0.74399999999999999},"min":{"1min":0.51300000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0209999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53500000000000003,"15min":0.55000000000000004},"min":{"1min":0.35499999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.94799999999999995},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85999999999999999,"5min":0.91400000000000003,"15min":1.8740000000000001},"last":0.505}]},{"osd":6,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.48699999999999999,"5min":0.48199999999999998,"15min":0.40699999999999997},"max":{"1min":1.079,"5min":1.079,"15min":1.093},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.64000000000000001},"min":{"1min":0.36499999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":1.022,"15min":1.2010000000000001},"last":0.76800000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":0.84499999999999997,"5min":0.84899999999999998,"15min":0.90400000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.505,"5min":0.49199999999999999,"15min":0.437},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.99399999999999999},"last":0.83599999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542366,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36808,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335032,"statfs":{"total":96636764160,"available":96599072768,"internally_reserved":0,"allocated":1503232,"data_stored":747723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53900000000000003,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.376},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.38500000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63,"5min":0.745,"15min":0.91500000000000004},"last":0.53900000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.502,"15min":0.501},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.74199999999999999,"5min":1.254,"15min":1.254},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.45300000000000001,"5min":0.41499999999999998,"15min":0.33900000000000002},"max":{"1min":0.73999999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.38700000000000001,"15min":0.33000000000000002},"max":{"1min":0.79500000000000004,"5min":1.639,"15min":1.639},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.54300000000000004},"min":{"1min":0.39600000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.748,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.58899999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.56899999999999995,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97999999999999998,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.61899999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.02,"5min":1.601,"15min":1.601},"last":0.78500000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.75900000000000001,"15min":0.77700000000000002},"min":{"1min":0.54600000000000004,"5min":0.52900000000000003,"15min":0.49299999999999999},"max":{"1min":1.0349999999999999,"5min":1.254,"15min":1.254},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.75600000000000001,"15min":0.78000000000000003},"min":{"1min":0.66100000000000003,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":0.95299999999999996,"5min":1.421,"15min":1.421},"last":0.95299999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79500000000000004,"15min":0.80000000000000004},"min":{"1min":0.58999999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0880000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.879},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.76300000000000001,"15min":0.79200000000000004},"min":{"1min":0.63300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0029999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0029999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.79700000000000004,"15min":0.82099999999999995},"min":{"1min":0.621,"5min":0.53000000000000003,"15min":0.52500000000000002},"max":{"1min":1.0780000000000001,"5min":1.472,"15min":1.472},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77300000000000002,"15min":0.78900000000000003},"min":{"1min":0.59799999999999998,"5min":0.498,"15min":0.498},"max":{"1min":1.0209999999999999,"5min":1.079,"15min":1.1160000000000001},"last":0.93400000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542367,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54856,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316984,"statfs":{"total":96636764160,"available":96580591616,"internally_reserved":0,"allocated":1503232,"data_stored":747175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.44,"15min":0.45900000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.59299999999999997,"5min":0.85599999999999998,"15min":0.92000000000000004},"last":0.372},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.45900000000000002,"15min":0.49099999999999999},"min":{"1min":0.29799999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.59899999999999998,"5min":0.81000000000000005,"15min":0.93100000000000005},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46700000000000003,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65200000000000002,"5min":0.70799999999999996,"15min":0.85499999999999998},"last":0.505},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56100000000000005,"15min":0.59499999999999997},"min":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.67000000000000004,"5min":0.81699999999999995,"15min":0.89800000000000002},"last":0.48699999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.499,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":0.71399999999999997,"5min":0.82199999999999995,"15min":0.82299999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53300000000000003,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":0.80600000000000005,"15min":0.89400000000000002},"last":0.55300000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.73799999999999999,"15min":0.78400000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79700000000000004,"5min":1.1990000000000001,"15min":1.2569999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.72799999999999998,"15min":0.77300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96699999999999997,"5min":1.151,"15min":1.5509999999999999},"last":0.628}]},{"osd":5,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.745,"15min":0.78800000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92800000000000005,"5min":1.1080000000000001,"15min":1.2789999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.753,"15min":0.79500000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94499999999999995,"5min":1.2130000000000001,"15min":1.3089999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.752,"15min":0.81200000000000006},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.84399999999999997,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78300000000000003,"15min":0.83999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.995,"5min":1.25,"15min":1.375},"last":0.69699999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.746,"15min":0.78800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90300000000000002,"5min":1.0860000000000001,"15min":1.339},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.75600000000000001,"15min":0.79500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.92600000000000005,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.80800000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542367,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36812,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335028,"statfs":{"total":96636764160,"available":96599068672,"internally_reserved":0,"allocated":1503232,"data_stored":747175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.438,"15min":0.45100000000000001},"min":{"1min":0.26400000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.96899999999999997},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.753,"5min":0.85099999999999998,"15min":1.212},"last":0.47099999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.498,"15min":0.498},"min":{"1min":0.35599999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.76400000000000001,"5min":0.82099999999999995,"15min":0.876},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.496}]},{"osd":3,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.39900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53800000000000003,"15min":0.56799999999999995},"min":{"1min":0.33200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.748,"5min":0.84299999999999997,"15min":1.165},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70899999999999996,"15min":0.75700000000000001},"min":{"1min":0.51900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92300000000000004,"5min":1.012,"15min":1.204},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.76300000000000001,"15min":0.79300000000000004},"min":{"1min":0.52400000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.2529999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72399999999999998,"15min":0.77500000000000002},"min":{"1min":0.54500000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89200000000000002,"5min":1.073,"15min":1.254},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.74399999999999999,"15min":0.79400000000000004},"min":{"1min":0.56999999999999995,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0129999999999999,"5min":1.044,"15min":1.9059999999999999},"last":0.95299999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80000000000000004,"15min":0.82399999999999995},"min":{"1min":0.55800000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.294,"5min":1.294,"15min":1.623},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.755,"15min":0.78900000000000003},"min":{"1min":0.57899999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93000000000000005,"5min":1.0369999999999999,"15min":1.288},"last":0.83399999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.753,"15min":0.79400000000000004},"min":{"1min":0.59199999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95999999999999996,"5min":1.1140000000000001,"15min":1.2949999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81799999999999995,"15min":0.83799999999999997},"min":{"1min":0.59199999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.3120000000000001},"last":0.86599999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542366,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2109440,"data_stored":1339211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.30599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52100000000000002,"15min":0.55900000000000005},"min":{"1min":0.41499999999999998,"5min":0.38500000000000001,"15min":0.36699999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":3.5089999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48499999999999999,"15min":0.51500000000000001},"min":{"1min":0.34000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.749,"5min":0.78500000000000003,"15min":0.97499999999999998},"last":0.63},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51800000000000002,"15min":0.53700000000000003},"min":{"1min":0.42899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70099999999999996,"5min":0.876,"15min":3.4590000000000001},"last":0.55000000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47699999999999998,"15min":0.48999999999999999},"min":{"1min":0.37,"5min":0.27800000000000002,"15min":0.27700000000000002},"max":{"1min":0.73599999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57199999999999995,"15min":0.58799999999999997},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.32700000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":1.2470000000000001},"last":0.70199999999999996}]},{"osd":4,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77000000000000002,"15min":0.78500000000000003},"min":{"1min":0.60299999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97999999999999998,"5min":1.2,"15min":1.2},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.75800000000000001,"15min":0.79300000000000004},"min":{"1min":0.63,"5min":0.443,"15min":0.443},"max":{"1min":1.1339999999999999,"5min":1.169,"15min":1.1719999999999999},"last":0.88}]},{"osd":5,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.747,"15min":0.78500000000000003},"min":{"1min":0.52500000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.032,"5min":1.131,"15min":3.528},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.61599999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.2270000000000001,"5min":1.244,"15min":1.244},"last":0.94299999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.74399999999999999,"15min":0.78800000000000003},"min":{"1min":0.58799999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":3.4870000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78500000000000003,"15min":0.81999999999999995},"min":{"1min":0.54200000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.093,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.98099999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.80100000000000005,"15min":0.83199999999999996},"min":{"1min":0.63800000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1619999999999999,"5min":1.28,"15min":1.28},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77000000000000002,"15min":0.80000000000000004},"min":{"1min":0.59999999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0609999999999999,"5min":1.0940000000000001,"15min":1.1930000000000001},"last":1.0820000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:21:27.798 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-25T04:21:27.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.979+0000 7f7b5b71e640 1 Processor -- start 2023-08-25T04:21:27.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.979+0000 7f7b5b71e640 1 -- start start 2023-08-25T04:21:27.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.979+0000 7f7b5b71e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b540d0d30 0x7f7b540b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:27.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.983+0000 7f7b5b71e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b540cfbc0 con 0x7f7b540cd9d0 2023-08-25T04:21:27.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.983+0000 7f7b5b71e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b540cf320 con 0x7f7b540d1110 2023-08-25T04:21:27.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.983+0000 7f7b5b71e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540cd5b0 con 0x7f7b540d0d30 2023-08-25T04:21:27.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.983+0000 7f7b59cbb640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7b540cd9d0 0x7f7b540cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40394/0 (socket says 172.21.15.55:40394) 2023-08-25T04:21:27.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.983+0000 7f7b59cbb640 1 -- 172.21.15.55:0/1552452885 learned_addr learned my addr 172.21.15.55:0/1552452885 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:27.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.983+0000 7f7b594ba640 1 --2- 172.21.15.55:0/1552452885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b540d0d30 0x7f7b540b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:27.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.983+0000 7f7b4bfff640 1 -- 172.21.15.55:0/1552452885 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176674555 0 0) 0x7f7b540cfbc0 con 0x7f7b540cd9d0 2023-08-25T04:21:27.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.983+0000 7f7b4bfff640 1 -- 172.21.15.55:0/1552452885 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b40003530 con 0x7f7b540cd9d0 2023-08-25T04:21:27.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.983+0000 7f7b594ba640 1 -- 172.21.15.55:0/1552452885 >> v1:172.21.15.110:6789/0 conn(0x7f7b540d1110 legacy=0x7f7b540d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:27.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.983+0000 7f7b4bfff640 1 -- 172.21.15.55:0/1552452885 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593968089 0 0) 0x7f7b540cf320 con 0x7f7b540d1110 2023-08-25T04:21:27.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.983+0000 7f7b594ba640 1 -- 172.21.15.55:0/1552452885 >> v1:172.21.15.55:6789/0 conn(0x7f7b540cd9d0 legacy=0x7f7b540cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:27.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.983+0000 7f7b594ba640 1 -- 172.21.15.55:0/1552452885 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b540cf600 con 0x7f7b540d0d30 2023-08-25T04:21:27.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.983+0000 7f7b594ba640 1 --2- 172.21.15.55:0/1552452885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b540d0d30 0x7f7b540b55c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7b500097d0 tx=0x7f7b5001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=624c3985eb799e29 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:27.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b4bfff640 1 -- 172.21.15.55:0/1552452885 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b500ab600 con 0x7f7b540d0d30 2023-08-25T04:21:27.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b4bfff640 1 -- 172.21.15.55:0/1552452885 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b500ab760 con 0x7f7b540d0d30 2023-08-25T04:21:27.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b4bfff640 1 -- 172.21.15.55:0/1552452885 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b500abaf0 con 0x7f7b540d0d30 2023-08-25T04:21:27.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b5b71e640 1 -- 172.21.15.55:0/1552452885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b540d0d30 msgr2=0x7f7b540b55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:27.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b5b71e640 1 --2- 172.21.15.55:0/1552452885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b540d0d30 0x7f7b540b55c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7b500097d0 tx=0x7f7b5001c3e0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b5b71e640 1 -- 172.21.15.55:0/1552452885 shutdown_connections 2023-08-25T04:21:27.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b5b71e640 1 --2- 172.21.15.55:0/1552452885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b540d0d30 0x7f7b540b55c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b5b71e640 1 -- 172.21.15.55:0/1552452885 >> 172.21.15.55:0/1552452885 conn(0x7f7b5409baf0 msgr2=0x7f7b540d2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:27.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b5b71e640 1 -- 172.21.15.55:0/1552452885 shutdown_connections 2023-08-25T04:21:27.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b5b71e640 1 -- 172.21.15.55:0/1552452885 wait complete. 2023-08-25T04:21:27.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b5b71e640 1 Processor -- start 2023-08-25T04:21:27.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b5b71e640 1 -- start start 2023-08-25T04:21:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b5b71e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b540cd9d0 0x7f7b541538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b5b71e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b540d0d30 0x7f7b5414e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b5b71e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b540d1110 0x7f7b540c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b5b71e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5414ee10 con 0x7f7b540d1110 2023-08-25T04:21:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b5b71e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540c6950 con 0x7f7b540d0d30 2023-08-25T04:21:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b5b71e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b540c6bd0 con 0x7f7b540cd9d0 2023-08-25T04:21:27.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b59cbb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b540d1110 0x7f7b540c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:27.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b59cbb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b540d1110 0x7f7b540c6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55514/0 (socket says 172.21.15.55:55514) 2023-08-25T04:21:27.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.987+0000 7f7b59cbb640 1 -- 172.21.15.55:0/3832312045 learned_addr learned my addr 172.21.15.55:0/3832312045 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:27.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.991+0000 7f7b594ba640 1 --2- 172.21.15.55:0/3832312045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b540cd9d0 0x7f7b541538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:27.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.991+0000 7f7b58cb9640 1 --2- 172.21.15.55:0/3832312045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b540d0d30 0x7f7b5414e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.991+0000 7f7b59cbb640 1 -- 172.21.15.55:0/3832312045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b540cd9d0 msgr2=0x7f7b541538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.991+0000 7f7b59cbb640 1 --2- 172.21.15.55:0/3832312045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b540cd9d0 0x7f7b541538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.991+0000 7f7b59cbb640 1 -- 172.21.15.55:0/3832312045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b540d0d30 msgr2=0x7f7b5414e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.991+0000 7f7b59cbb640 1 --2- 172.21.15.55:0/3832312045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b540d0d30 0x7f7b5414e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:27.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.991+0000 7f7b59cbb640 1 -- 172.21.15.55:0/3832312045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b500093b0 con 0x7f7b540d1110 2023-08-25T04:21:27.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.991+0000 7f7b59cbb640 1 --2- 172.21.15.55:0/3832312045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b540d1110 0x7f7b540c6410 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c00caa0 tx=0x7f7b4c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:27.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.991+0000 7f7b49ffb640 1 -- 172.21.15.55:0/3832312045 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c00ac00 con 0x7f7b540d1110 2023-08-25T04:21:27.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.991+0000 7f7b49ffb640 1 -- 172.21.15.55:0/3832312045 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4c00ad60 con 0x7f7b540d1110 2023-08-25T04:21:27.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.991+0000 7f7b5b71e640 1 -- 172.21.15.55:0/3832312045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b540c6eb0 con 0x7f7b540d1110 2023-08-25T04:21:27.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.991+0000 7f7b49ffb640 1 -- 172.21.15.55:0/3832312045 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c012620 con 0x7f7b540d1110 2023-08-25T04:21:27.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.991+0000 7f7b5b71e640 1 -- 172.21.15.55:0/3832312045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b540c7470 con 0x7f7b540d1110 2023-08-25T04:21:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.991+0000 7f7b5b71e640 1 -- 172.21.15.55:0/3832312045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5404dbe0 con 0x7f7b540d1110 2023-08-25T04:21:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.991+0000 7f7b49ffb640 1 -- 172.21.15.55:0/3832312045 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f7b4c007070 con 0x7f7b540d1110 2023-08-25T04:21:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.991+0000 7f7b49ffb640 1 --2- 172.21.15.55:0/3832312045 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f7b380657a0 0x7f7b38067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.995+0000 7f7b49ffb640 1 -- 172.21.15.55:0/3832312045 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b4c082d90 con 0x7f7b540d1110 2023-08-25T04:21:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.995+0000 7f7b594ba640 1 --2- 172.21.15.55:0/3832312045 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f7b380657a0 0x7f7b38067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.995+0000 7f7b594ba640 1 --2- 172.21.15.55:0/3832312045 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f7b380657a0 0x7f7b38067c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b500af000 tx=0x7f7b500a7000 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:27.995+0000 7f7b49ffb640 1 -- 172.21.15.55:0/3832312045 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7b4c050880 con 0x7f7b540d1110 2023-08-25T04:21:28.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.211+0000 7f7b5b71e640 1 -- 172.21.15.55:0/3832312045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7b5414efb0 con 0x7f7b540d1110 2023-08-25T04:21:28.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.211+0000 7f7b49ffb640 1 -- 172.21.15.55:0/3832312045 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3212 (secure 0 0 0) 0x7f7b4c017ca0 con 0x7f7b540d1110 2023-08-25T04:21:28.208 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:28.209 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1132,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":122,"num_osds":8,"num_up_osds":8,"osd_up_since":1692936167,"num_in_osds":8,"osd_in_since":1692936158,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592778,"bytes_used":335474688,"bytes_avail":772758638592,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":58,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8436}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-08-25T04:21:09.539384+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-25T04:21:28.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.211+0000 7f7b5b71e640 1 -- 172.21.15.55:0/3832312045 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f7b380657a0 msgr2=0x7f7b38067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:28.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.211+0000 7f7b5b71e640 1 --2- 172.21.15.55:0/3832312045 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f7b380657a0 0x7f7b38067c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b500af000 tx=0x7f7b500a7000 comp rx=0 tx=0).stop 2023-08-25T04:21:28.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.211+0000 7f7b5b71e640 1 -- 172.21.15.55:0/3832312045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b540d1110 msgr2=0x7f7b540c6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:28.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.211+0000 7f7b5b71e640 1 --2- 172.21.15.55:0/3832312045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b540d1110 0x7f7b540c6410 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c00caa0 tx=0x7f7b4c00cf60 comp rx=0 tx=0).stop 2023-08-25T04:21:28.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.211+0000 7f7b5b71e640 1 -- 172.21.15.55:0/3832312045 shutdown_connections 2023-08-25T04:21:28.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.211+0000 7f7b5b71e640 1 --2- 172.21.15.55:0/3832312045 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f7b380657a0 0x7f7b38067c60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:28.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.211+0000 7f7b5b71e640 1 --2- 172.21.15.55:0/3832312045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b540d1110 0x7f7b540c6410 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:28.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.211+0000 7f7b5b71e640 1 --2- 172.21.15.55:0/3832312045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b540d0d30 0x7f7b5414e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:28.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.211+0000 7f7b5b71e640 1 --2- 172.21.15.55:0/3832312045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b540cd9d0 0x7f7b541538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:28.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.211+0000 7f7b5b71e640 1 -- 172.21.15.55:0/3832312045 >> 172.21.15.55:0/3832312045 conn(0x7f7b5409baf0 msgr2=0x7f7b540d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:28.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.211+0000 7f7b5b71e640 1 -- 172.21.15.55:0/3832312045 shutdown_connections 2023-08-25T04:21:28.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.211+0000 7f7b5b71e640 1 -- 172.21.15.55:0/3832312045 wait complete. 2023-08-25T04:21:28.229 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-25T04:21:28.230 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:21:28.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.375+0000 7fd844100640 1 Processor -- start 2023-08-25T04:21:28.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.375+0000 7fd844100640 1 -- start start 2023-08-25T04:21:28.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.375+0000 7fd844100640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd83c158e10 0x7fd83c0b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:28.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.375+0000 7fd844100640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd83c159f10 0x7fd83c0cab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:28.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.375+0000 7fd844100640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83c0cdbf0 con 0x7fd83c0cb0d0 2023-08-25T04:21:28.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.375+0000 7fd844100640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83c0ad940 con 0x7fd83c159f10 2023-08-25T04:21:28.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.375+0000 7fd844100640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83c15a3c0 con 0x7fd83c158e10 2023-08-25T04:21:28.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.375+0000 7fd84169b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd83c159f10 0x7fd83c0cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:28.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.375+0000 7fd84169b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd83c159f10 0x7fd83c0cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55516/0 (socket says 172.21.15.55:55516) 2023-08-25T04:21:28.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.375+0000 7fd84169b640 1 -- 172.21.15.55:0/449217148 learned_addr learned my addr 172.21.15.55:0/449217148 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:28.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.375+0000 7fd84269d640 1 --1- 172.21.15.55:0/449217148 >> v1:172.21.15.55:6789/0 conn(0x7fd83c0cb0d0 0x7fd83c0c9a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40410/0 (socket says 172.21.15.55:40410) 2023-08-25T04:21:28.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.375+0000 7fd841e9c640 1 --2- 172.21.15.55:0/449217148 >> v2:172.21.15.110:3300/0 conn(0x7fd83c158e10 0x7fd83c0b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:28.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.375+0000 7fd84169b640 1 -- 172.21.15.55:0/449217148 >> v2:172.21.15.110:3300/0 conn(0x7fd83c158e10 msgr2=0x7fd83c0b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:28.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.375+0000 7fd84169b640 1 --2- 172.21.15.55:0/449217148 >> v2:172.21.15.110:3300/0 conn(0x7fd83c158e10 0x7fd83c0b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:28.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.375+0000 7fd84169b640 1 -- 172.21.15.55:0/449217148 >> v1:172.21.15.55:6789/0 conn(0x7fd83c0cb0d0 legacy=0x7fd83c0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:28.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.375+0000 7fd84169b640 1 -- 172.21.15.55:0/449217148 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c0cb4e0 con 0x7fd83c159f10 2023-08-25T04:21:28.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.375+0000 7fd841e9c640 1 --2- 172.21.15.55:0/449217148 >> v2:172.21.15.110:3300/0 conn(0x7fd83c158e10 0x7fd83c0b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:28.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.379+0000 7fd84169b640 1 --2- 172.21.15.55:0/449217148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd83c159f10 0x7fd83c0cab90 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fd83c06a880 tx=0x7fd82c01d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf10b2dcc68e555 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:28.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.379+0000 7fd840e9a640 1 -- 172.21.15.55:0/449217148 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c0a6830 con 0x7fd83c159f10 2023-08-25T04:21:28.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.379+0000 7fd840e9a640 1 -- 172.21.15.55:0/449217148 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c0a6990 con 0x7fd83c159f10 2023-08-25T04:21:28.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.379+0000 7fd840e9a640 1 -- 172.21.15.55:0/449217148 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c0a6d20 con 0x7fd83c159f10 2023-08-25T04:21:28.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.379+0000 7fd844100640 1 -- 172.21.15.55:0/449217148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd83c159f10 msgr2=0x7fd83c0cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:28.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.379+0000 7fd844100640 1 --2- 172.21.15.55:0/449217148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd83c159f10 0x7fd83c0cab90 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fd83c06a880 tx=0x7fd82c01d8d0 comp rx=0 tx=0).stop 2023-08-25T04:21:28.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.379+0000 7fd844100640 1 -- 172.21.15.55:0/449217148 shutdown_connections 2023-08-25T04:21:28.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.379+0000 7fd844100640 1 --2- 172.21.15.55:0/449217148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd83c159f10 0x7fd83c0cab90 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:28.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.379+0000 7fd844100640 1 --2- 172.21.15.55:0/449217148 >> v2:172.21.15.110:3300/0 conn(0x7fd83c158e10 0x7fd83c0b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:28.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.379+0000 7fd844100640 1 -- 172.21.15.55:0/449217148 >> 172.21.15.55:0/449217148 conn(0x7fd83c069d00 msgr2=0x7fd83c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:28.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.379+0000 7fd844100640 1 -- 172.21.15.55:0/449217148 shutdown_connections 2023-08-25T04:21:28.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.379+0000 7fd844100640 1 -- 172.21.15.55:0/449217148 wait complete. 2023-08-25T04:21:28.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd844100640 1 Processor -- start 2023-08-25T04:21:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd844100640 1 -- start start 2023-08-25T04:21:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd844100640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd83c0cb0d0 0x7fd83c1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd844100640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd83c158e10 0x7fd83c0b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd844100640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c159f10 0x7fd83c0b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd844100640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c161f80 con 0x7fd83c0cb0d0 2023-08-25T04:21:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd844100640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c0b0280 con 0x7fd83c158e10 2023-08-25T04:21:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd844100640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c0b0560 con 0x7fd83c159f10 2023-08-25T04:21:28.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd841e9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd83c0cb0d0 0x7fd83c1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:28.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd841e9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd83c0cb0d0 0x7fd83c1555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55528/0 (socket says 172.21.15.55:55528) 2023-08-25T04:21:28.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd841e9c640 1 -- 172.21.15.55:0/3400020581 learned_addr learned my addr 172.21.15.55:0/3400020581 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:28.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd841e9c640 1 -- 172.21.15.55:0/3400020581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c159f10 msgr2=0x7fd83c0b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:28.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd841e9c640 1 --2- 172.21.15.55:0/3400020581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c159f10 0x7fd83c0b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:28.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd841e9c640 1 -- 172.21.15.55:0/3400020581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd83c158e10 msgr2=0x7fd83c0b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:28.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd841e9c640 1 --2- 172.21.15.55:0/3400020581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd83c158e10 0x7fd83c0b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:28.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd841e9c640 1 -- 172.21.15.55:0/3400020581 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c00a670 con 0x7fd83c0cb0d0 2023-08-25T04:21:28.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd841e9c640 1 --2- 172.21.15.55:0/3400020581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd83c0cb0d0 0x7fd83c1555b0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fd83800e810 tx=0x7fd83800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:28.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd8327fc640 1 -- 172.21.15.55:0/3400020581 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83800c8d0 con 0x7fd83c0cb0d0 2023-08-25T04:21:28.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd8327fc640 1 -- 172.21.15.55:0/3400020581 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83800ca30 con 0x7fd83c0cb0d0 2023-08-25T04:21:28.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd8327fc640 1 -- 172.21.15.55:0/3400020581 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83800cdc0 con 0x7fd83c0cb0d0 2023-08-25T04:21:28.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd844100640 1 -- 172.21.15.55:0/3400020581 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83c159370 con 0x7fd83c0cb0d0 2023-08-25T04:21:28.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd844100640 1 -- 172.21.15.55:0/3400020581 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83c0b0b20 con 0x7fd83c0cb0d0 2023-08-25T04:21:28.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.383+0000 7fd844100640 1 -- 172.21.15.55:0/3400020581 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83c0cd860 con 0x7fd83c0cb0d0 2023-08-25T04:21:28.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.387+0000 7fd8327fc640 1 -- 172.21.15.55:0/3400020581 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fd838013410 con 0x7fd83c0cb0d0 2023-08-25T04:21:28.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.387+0000 7fd8327fc640 1 --2- 172.21.15.55:0/3400020581 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fd8200657a0 0x7fd820067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:28.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.387+0000 7fd8327fc640 1 -- 172.21.15.55:0/3400020581 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd838082fd0 con 0x7fd83c0cb0d0 2023-08-25T04:21:28.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.387+0000 7fd84169b640 1 --2- 172.21.15.55:0/3400020581 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fd8200657a0 0x7fd820067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:28.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.387+0000 7fd84169b640 1 --2- 172.21.15.55:0/3400020581 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fd8200657a0 0x7fd820067c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0b0000 tx=0x7fd82c004740 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:28.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.391+0000 7fd8327fc640 1 -- 172.21.15.55:0/3400020581 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd83c0cd860 con 0x7fd83c0cb0d0 2023-08-25T04:21:28.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.543+0000 7fd844100640 1 -- 172.21.15.55:0/3400020581 --> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd83c0b0d10 con 0x7fd8200657a0 2023-08-25T04:21:28.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.551+0000 7fd8327fc640 1 -- 172.21.15.55:0/3400020581 <== mgr.6902 v2:172.21.15.110:6832/4272914017 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311655 (secure 0 0 0) 0x7fd83c0b0d10 con 0x7fd8200657a0 2023-08-25T04:21:28.551 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:28.553 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:21:28.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.555+0000 7fd844100640 1 -- 172.21.15.55:0/3400020581 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fd8200657a0 msgr2=0x7fd820067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:28.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.555+0000 7fd844100640 1 --2- 172.21.15.55:0/3400020581 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fd8200657a0 0x7fd820067c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0b0000 tx=0x7fd82c004740 comp rx=0 tx=0).stop 2023-08-25T04:21:28.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.555+0000 7fd844100640 1 -- 172.21.15.55:0/3400020581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd83c0cb0d0 msgr2=0x7fd83c1555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:28.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.555+0000 7fd844100640 1 --2- 172.21.15.55:0/3400020581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd83c0cb0d0 0x7fd83c1555b0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fd83800e810 tx=0x7fd83800ecd0 comp rx=0 tx=0).stop 2023-08-25T04:21:28.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.555+0000 7fd844100640 1 -- 172.21.15.55:0/3400020581 shutdown_connections 2023-08-25T04:21:28.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.555+0000 7fd844100640 1 --2- 172.21.15.55:0/3400020581 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c159f10 0x7fd83c0b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:28.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.555+0000 7fd844100640 1 --2- 172.21.15.55:0/3400020581 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd83c158e10 0x7fd83c0b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:28.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.555+0000 7fd844100640 1 --2- 172.21.15.55:0/3400020581 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fd8200657a0 0x7fd820067c60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:28.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.555+0000 7fd844100640 1 --2- 172.21.15.55:0/3400020581 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd83c0cb0d0 0x7fd83c1555b0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:28.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.555+0000 7fd844100640 1 -- 172.21.15.55:0/3400020581 >> 172.21.15.55:0/3400020581 conn(0x7fd83c069d00 msgr2=0x7fd83c0cc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:28.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.555+0000 7fd844100640 1 -- 172.21.15.55:0/3400020581 shutdown_connections 2023-08-25T04:21:28.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:28.555+0000 7fd844100640 1 -- 172.21.15.55:0/3400020581 wait complete. 2023-08-25T04:21:28.572 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-25T04:21:27.543733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1040,"num_read_kb":2137,"num_write":389,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3570,"ondisk_log_size":3570,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":327612,"kb_used_data":12936,"kb_used_omap":13,"kb_used_meta":314546,"kb_avail":754647108,"statfs":{"total":773094113280,"available":772758638592,"internally_reserved":0,"allocated":13246464,"data_stored":7162684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":322095192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001708"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.411058+0000","last_change":"2023-08-25T04:21:22.902603+0000","last_active":"2023-08-25T04:21:24.411058+0000","last_peered":"2023-08-25T04:21:24.411058+0000","last_clean":"2023-08-25T04:21:24.411058+0000","last_became_active":"2023-08-25T04:21:22.902327+0000","last_became_peered":"2023-08-25T04:21:22.902327+0000","last_unstale":"2023-08-25T04:21:24.411058+0000","last_undegraded":"2023-08-25T04:21:24.411058+0000","last_fullsized":"2023-08-25T04:21:24.411058+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:17:32.859729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904117+0000","last_change":"2023-08-25T04:21:22.892480+0000","last_active":"2023-08-25T04:21:23.904117+0000","last_peered":"2023-08-25T04:21:23.904117+0000","last_clean":"2023-08-25T04:21:23.904117+0000","last_became_active":"2023-08-25T04:21:22.892212+0000","last_became_peered":"2023-08-25T04:21:22.892212+0000","last_unstale":"2023-08-25T04:21:23.904117+0000","last_undegraded":"2023-08-25T04:21:23.904117+0000","last_fullsized":"2023-08-25T04:21:23.904117+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:29:04.735498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410767+0000","last_change":"2023-08-25T04:21:22.910439+0000","last_active":"2023-08-25T04:21:24.410767+0000","last_peered":"2023-08-25T04:21:24.410767+0000","last_clean":"2023-08-25T04:21:24.410767+0000","last_became_active":"2023-08-25T04:21:22.909347+0000","last_became_peered":"2023-08-25T04:21:22.909347+0000","last_unstale":"2023-08-25T04:21:24.410767+0000","last_undegraded":"2023-08-25T04:21:24.410767+0000","last_fullsized":"2023-08-25T04:21:24.410767+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:56:56.750725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841365+0000","last_change":"2023-08-25T04:21:22.910060+0000","last_active":"2023-08-25T04:21:25.841365+0000","last_peered":"2023-08-25T04:21:25.841365+0000","last_clean":"2023-08-25T04:21:25.841365+0000","last_became_active":"2023-08-25T04:21:22.909773+0000","last_became_peered":"2023-08-25T04:21:22.909773+0000","last_unstale":"2023-08-25T04:21:25.841365+0000","last_undegraded":"2023-08-25T04:21:25.841365+0000","last_fullsized":"2023-08-25T04:21:25.841365+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:13:48.732464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904196+0000","last_change":"2023-08-25T04:21:22.894604+0000","last_active":"2023-08-25T04:21:23.904196+0000","last_peered":"2023-08-25T04:21:23.904196+0000","last_clean":"2023-08-25T04:21:23.904196+0000","last_became_active":"2023-08-25T04:21:22.894314+0000","last_became_peered":"2023-08-25T04:21:22.894314+0000","last_unstale":"2023-08-25T04:21:23.904196+0000","last_undegraded":"2023-08-25T04:21:23.904196+0000","last_fullsized":"2023-08-25T04:21:23.904196+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:03.905041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903357+0000","last_change":"2023-08-25T04:21:22.899480+0000","last_active":"2023-08-25T04:21:23.903357+0000","last_peered":"2023-08-25T04:21:23.903357+0000","last_clean":"2023-08-25T04:21:23.903357+0000","last_became_active":"2023-08-25T04:21:22.899192+0000","last_became_peered":"2023-08-25T04:21:22.899192+0000","last_unstale":"2023-08-25T04:21:23.903357+0000","last_undegraded":"2023-08-25T04:21:23.903357+0000","last_fullsized":"2023-08-25T04:21:23.903357+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:25:06.918252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902974+0000","last_change":"2023-08-25T04:21:22.898793+0000","last_active":"2023-08-25T04:21:23.902974+0000","last_peered":"2023-08-25T04:21:23.902974+0000","last_clean":"2023-08-25T04:21:23.902974+0000","last_became_active":"2023-08-25T04:21:22.898479+0000","last_became_peered":"2023-08-25T04:21:22.898479+0000","last_unstale":"2023-08-25T04:21:23.902974+0000","last_undegraded":"2023-08-25T04:21:23.902974+0000","last_fullsized":"2023-08-25T04:21:23.902974+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:37:01.600324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840200+0000","last_change":"2023-08-25T04:21:22.911502+0000","last_active":"2023-08-25T04:21:25.840200+0000","last_peered":"2023-08-25T04:21:25.840200+0000","last_clean":"2023-08-25T04:21:25.840200+0000","last_became_active":"2023-08-25T04:21:22.911155+0000","last_became_peered":"2023-08-25T04:21:22.911155+0000","last_unstale":"2023-08-25T04:21:25.840200+0000","last_undegraded":"2023-08-25T04:21:25.840200+0000","last_fullsized":"2023-08-25T04:21:25.840200+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:03:15.076436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903831+0000","last_change":"2023-08-25T04:21:22.895163+0000","last_active":"2023-08-25T04:21:23.903831+0000","last_peered":"2023-08-25T04:21:23.903831+0000","last_clean":"2023-08-25T04:21:23.903831+0000","last_became_active":"2023-08-25T04:21:22.893540+0000","last_became_peered":"2023-08-25T04:21:22.893540+0000","last_unstale":"2023-08-25T04:21:23.903831+0000","last_undegraded":"2023-08-25T04:21:23.903831+0000","last_fullsized":"2023-08-25T04:21:23.903831+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:42:32.393868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904666+0000","last_change":"2023-08-25T04:21:22.892180+0000","last_active":"2023-08-25T04:21:23.904666+0000","last_peered":"2023-08-25T04:21:23.904666+0000","last_clean":"2023-08-25T04:21:23.904666+0000","last_became_active":"2023-08-25T04:21:22.891881+0000","last_became_peered":"2023-08-25T04:21:22.891881+0000","last_unstale":"2023-08-25T04:21:23.904666+0000","last_undegraded":"2023-08-25T04:21:23.904666+0000","last_fullsized":"2023-08-25T04:21:23.904666+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:12:11.503876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.163109+0000","last_change":"2023-08-25T04:21:22.906007+0000","last_active":"2023-08-25T04:21:25.163109+0000","last_peered":"2023-08-25T04:21:25.163109+0000","last_clean":"2023-08-25T04:21:25.163109+0000","last_became_active":"2023-08-25T04:21:22.905714+0000","last_became_peered":"2023-08-25T04:21:22.905714+0000","last_unstale":"2023-08-25T04:21:25.163109+0000","last_undegraded":"2023-08-25T04:21:25.163109+0000","last_fullsized":"2023-08-25T04:21:25.163109+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:03:09.709617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902915+0000","last_change":"2023-08-25T04:21:22.900150+0000","last_active":"2023-08-25T04:21:23.902915+0000","last_peered":"2023-08-25T04:21:23.902915+0000","last_clean":"2023-08-25T04:21:23.902915+0000","last_became_active":"2023-08-25T04:21:22.899835+0000","last_became_peered":"2023-08-25T04:21:22.899835+0000","last_unstale":"2023-08-25T04:21:23.902915+0000","last_undegraded":"2023-08-25T04:21:23.902915+0000","last_fullsized":"2023-08-25T04:21:23.902915+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:25:00.393029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841208+0000","last_change":"2023-08-25T04:21:22.904721+0000","last_active":"2023-08-25T04:21:25.841208+0000","last_peered":"2023-08-25T04:21:25.841208+0000","last_clean":"2023-08-25T04:21:25.841208+0000","last_became_active":"2023-08-25T04:21:22.904432+0000","last_became_peered":"2023-08-25T04:21:22.904432+0000","last_unstale":"2023-08-25T04:21:25.841208+0000","last_undegraded":"2023-08-25T04:21:25.841208+0000","last_fullsized":"2023-08-25T04:21:25.841208+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:58:46.330006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076344+0000","last_change":"2023-08-25T04:21:22.899174+0000","last_active":"2023-08-25T04:21:24.076344+0000","last_peered":"2023-08-25T04:21:24.076344+0000","last_clean":"2023-08-25T04:21:24.076344+0000","last_became_active":"2023-08-25T04:21:22.898899+0000","last_became_peered":"2023-08-25T04:21:22.898899+0000","last_unstale":"2023-08-25T04:21:24.076344+0000","last_undegraded":"2023-08-25T04:21:24.076344+0000","last_fullsized":"2023-08-25T04:21:24.076344+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:49:33.691484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076314+0000","last_change":"2023-08-25T04:21:22.901474+0000","last_active":"2023-08-25T04:21:24.076314+0000","last_peered":"2023-08-25T04:21:24.076314+0000","last_clean":"2023-08-25T04:21:24.076314+0000","last_became_active":"2023-08-25T04:21:22.901182+0000","last_became_peered":"2023-08-25T04:21:22.901182+0000","last_unstale":"2023-08-25T04:21:24.076314+0000","last_undegraded":"2023-08-25T04:21:24.076314+0000","last_fullsized":"2023-08-25T04:21:24.076314+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:04:43.968782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076298+0000","last_change":"2023-08-25T04:21:22.901170+0000","last_active":"2023-08-25T04:21:24.076298+0000","last_peered":"2023-08-25T04:21:24.076298+0000","last_clean":"2023-08-25T04:21:24.076298+0000","last_became_active":"2023-08-25T04:21:22.900877+0000","last_became_peered":"2023-08-25T04:21:22.900877+0000","last_unstale":"2023-08-25T04:21:24.076298+0000","last_undegraded":"2023-08-25T04:21:24.076298+0000","last_fullsized":"2023-08-25T04:21:24.076298+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:42:03.512215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.411076+0000","last_change":"2023-08-25T04:21:22.910250+0000","last_active":"2023-08-25T04:21:24.411076+0000","last_peered":"2023-08-25T04:21:24.411076+0000","last_clean":"2023-08-25T04:21:24.411076+0000","last_became_active":"2023-08-25T04:21:22.909079+0000","last_became_peered":"2023-08-25T04:21:22.909079+0000","last_unstale":"2023-08-25T04:21:24.411076+0000","last_undegraded":"2023-08-25T04:21:24.411076+0000","last_fullsized":"2023-08-25T04:21:24.411076+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:51:38.166407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904204+0000","last_change":"2023-08-25T04:21:22.898773+0000","last_active":"2023-08-25T04:21:23.904204+0000","last_peered":"2023-08-25T04:21:23.904204+0000","last_clean":"2023-08-25T04:21:23.904204+0000","last_became_active":"2023-08-25T04:21:22.898466+0000","last_became_peered":"2023-08-25T04:21:22.898466+0000","last_unstale":"2023-08-25T04:21:23.904204+0000","last_undegraded":"2023-08-25T04:21:23.904204+0000","last_fullsized":"2023-08-25T04:21:23.904204+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:59:21.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410834+0000","last_change":"2023-08-25T04:21:22.914850+0000","last_active":"2023-08-25T04:21:24.410834+0000","last_peered":"2023-08-25T04:21:24.410834+0000","last_clean":"2023-08-25T04:21:24.410834+0000","last_became_active":"2023-08-25T04:21:22.910140+0000","last_became_peered":"2023-08-25T04:21:22.910140+0000","last_unstale":"2023-08-25T04:21:24.410834+0000","last_undegraded":"2023-08-25T04:21:24.410834+0000","last_fullsized":"2023-08-25T04:21:24.410834+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:27:14.211228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903999+0000","last_change":"2023-08-25T04:21:22.893589+0000","last_active":"2023-08-25T04:21:23.903999+0000","last_peered":"2023-08-25T04:21:23.903999+0000","last_clean":"2023-08-25T04:21:23.903999+0000","last_became_active":"2023-08-25T04:21:22.893324+0000","last_became_peered":"2023-08-25T04:21:22.893324+0000","last_unstale":"2023-08-25T04:21:23.903999+0000","last_undegraded":"2023-08-25T04:21:23.903999+0000","last_fullsized":"2023-08-25T04:21:23.903999+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:10.680725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840617+0000","last_change":"2023-08-25T04:21:22.904143+0000","last_active":"2023-08-25T04:21:25.840617+0000","last_peered":"2023-08-25T04:21:25.840617+0000","last_clean":"2023-08-25T04:21:25.840617+0000","last_became_active":"2023-08-25T04:21:22.903846+0000","last_became_peered":"2023-08-25T04:21:22.903846+0000","last_unstale":"2023-08-25T04:21:25.840617+0000","last_undegraded":"2023-08-25T04:21:25.840617+0000","last_fullsized":"2023-08-25T04:21:25.840617+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:16:21.898044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904185+0000","last_change":"2023-08-25T04:21:22.904450+0000","last_active":"2023-08-25T04:21:23.904185+0000","last_peered":"2023-08-25T04:21:23.904185+0000","last_clean":"2023-08-25T04:21:23.904185+0000","last_became_active":"2023-08-25T04:21:22.904159+0000","last_became_peered":"2023-08-25T04:21:22.904159+0000","last_unstale":"2023-08-25T04:21:23.904185+0000","last_undegraded":"2023-08-25T04:21:23.904185+0000","last_fullsized":"2023-08-25T04:21:23.904185+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:44:51.607773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410709+0000","last_change":"2023-08-25T04:21:22.909915+0000","last_active":"2023-08-25T04:21:24.410709+0000","last_peered":"2023-08-25T04:21:24.410709+0000","last_clean":"2023-08-25T04:21:24.410709+0000","last_became_active":"2023-08-25T04:21:22.909576+0000","last_became_peered":"2023-08-25T04:21:22.909576+0000","last_unstale":"2023-08-25T04:21:24.410709+0000","last_undegraded":"2023-08-25T04:21:24.410709+0000","last_fullsized":"2023-08-25T04:21:24.410709+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:12:25.327391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903979+0000","last_change":"2023-08-25T04:21:22.904891+0000","last_active":"2023-08-25T04:21:23.903979+0000","last_peered":"2023-08-25T04:21:23.903979+0000","last_clean":"2023-08-25T04:21:23.903979+0000","last_became_active":"2023-08-25T04:21:22.904596+0000","last_became_peered":"2023-08-25T04:21:22.904596+0000","last_unstale":"2023-08-25T04:21:23.903979+0000","last_undegraded":"2023-08-25T04:21:23.903979+0000","last_fullsized":"2023-08-25T04:21:23.903979+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:24:20.422364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903959+0000","last_change":"2023-08-25T04:21:22.902096+0000","last_active":"2023-08-25T04:21:23.903959+0000","last_peered":"2023-08-25T04:21:23.903959+0000","last_clean":"2023-08-25T04:21:23.903959+0000","last_became_active":"2023-08-25T04:21:22.901835+0000","last_became_peered":"2023-08-25T04:21:22.901835+0000","last_unstale":"2023-08-25T04:21:23.903959+0000","last_undegraded":"2023-08-25T04:21:23.903959+0000","last_fullsized":"2023-08-25T04:21:23.903959+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:24:38.098739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903841+0000","last_change":"2023-08-25T04:21:22.889822+0000","last_active":"2023-08-25T04:21:23.903841+0000","last_peered":"2023-08-25T04:21:23.903841+0000","last_clean":"2023-08-25T04:21:23.903841+0000","last_became_active":"2023-08-25T04:21:22.889515+0000","last_became_peered":"2023-08-25T04:21:22.889515+0000","last_unstale":"2023-08-25T04:21:23.903841+0000","last_undegraded":"2023-08-25T04:21:23.903841+0000","last_fullsized":"2023-08-25T04:21:23.903841+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:26:34.858808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.163211+0000","last_change":"2023-08-25T04:21:22.900565+0000","last_active":"2023-08-25T04:21:25.163211+0000","last_peered":"2023-08-25T04:21:25.163211+0000","last_clean":"2023-08-25T04:21:25.163211+0000","last_became_active":"2023-08-25T04:21:22.900258+0000","last_became_peered":"2023-08-25T04:21:22.900258+0000","last_unstale":"2023-08-25T04:21:25.163211+0000","last_undegraded":"2023-08-25T04:21:25.163211+0000","last_fullsized":"2023-08-25T04:21:25.163211+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:25.567019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902975+0000","last_change":"2023-08-25T04:21:22.900271+0000","last_active":"2023-08-25T04:21:23.902975+0000","last_peered":"2023-08-25T04:21:23.902975+0000","last_clean":"2023-08-25T04:21:23.902975+0000","last_became_active":"2023-08-25T04:21:22.899973+0000","last_became_peered":"2023-08-25T04:21:22.899973+0000","last_unstale":"2023-08-25T04:21:23.902975+0000","last_undegraded":"2023-08-25T04:21:23.902975+0000","last_fullsized":"2023-08-25T04:21:23.902975+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:09:02.870355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840653+0000","last_change":"2023-08-25T04:21:22.902127+0000","last_active":"2023-08-25T04:21:25.840653+0000","last_peered":"2023-08-25T04:21:25.840653+0000","last_clean":"2023-08-25T04:21:25.840653+0000","last_became_active":"2023-08-25T04:21:22.901771+0000","last_became_peered":"2023-08-25T04:21:22.901771+0000","last_unstale":"2023-08-25T04:21:25.840653+0000","last_undegraded":"2023-08-25T04:21:25.840653+0000","last_fullsized":"2023-08-25T04:21:25.840653+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:54:19.330475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902947+0000","last_change":"2023-08-25T04:21:22.900843+0000","last_active":"2023-08-25T04:21:23.902947+0000","last_peered":"2023-08-25T04:21:23.902947+0000","last_clean":"2023-08-25T04:21:23.902947+0000","last_became_active":"2023-08-25T04:21:22.900609+0000","last_became_peered":"2023-08-25T04:21:22.900609+0000","last_unstale":"2023-08-25T04:21:23.902947+0000","last_undegraded":"2023-08-25T04:21:23.902947+0000","last_fullsized":"2023-08-25T04:21:23.902947+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:41:05.646746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903444+0000","last_change":"2023-08-25T04:21:22.900517+0000","last_active":"2023-08-25T04:21:23.903444+0000","last_peered":"2023-08-25T04:21:23.903444+0000","last_clean":"2023-08-25T04:21:23.903444+0000","last_became_active":"2023-08-25T04:21:22.900167+0000","last_became_peered":"2023-08-25T04:21:22.900167+0000","last_unstale":"2023-08-25T04:21:23.903444+0000","last_undegraded":"2023-08-25T04:21:23.903444+0000","last_fullsized":"2023-08-25T04:21:23.903444+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:27:53.563502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840288+0000","last_change":"2023-08-25T04:21:22.909298+0000","last_active":"2023-08-25T04:21:25.840288+0000","last_peered":"2023-08-25T04:21:25.840288+0000","last_clean":"2023-08-25T04:21:25.840288+0000","last_became_active":"2023-08-25T04:21:22.908951+0000","last_became_peered":"2023-08-25T04:21:22.908951+0000","last_unstale":"2023-08-25T04:21:25.840288+0000","last_undegraded":"2023-08-25T04:21:25.840288+0000","last_fullsized":"2023-08-25T04:21:25.840288+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:15:52.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410890+0000","last_change":"2023-08-25T04:21:22.910846+0000","last_active":"2023-08-25T04:21:24.410890+0000","last_peered":"2023-08-25T04:21:24.410890+0000","last_clean":"2023-08-25T04:21:24.410890+0000","last_became_active":"2023-08-25T04:21:22.910125+0000","last_became_peered":"2023-08-25T04:21:22.910125+0000","last_unstale":"2023-08-25T04:21:24.410890+0000","last_undegraded":"2023-08-25T04:21:24.410890+0000","last_fullsized":"2023-08-25T04:21:24.410890+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:17.993108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"121'4","reported_seq":17,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841112+0000","last_change":"2023-08-25T04:21:21.899936+0000","last_active":"2023-08-25T04:21:25.841112+0000","last_peered":"2023-08-25T04:21:25.841112+0000","last_clean":"2023-08-25T04:21:25.841112+0000","last_became_active":"2023-08-25T04:21:21.899625+0000","last_became_peered":"2023-08-25T04:21:21.899625+0000","last_unstale":"2023-08-25T04:21:25.841112+0000","last_undegraded":"2023-08-25T04:21:25.841112+0000","last_fullsized":"2023-08-25T04:21:25.841112+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:15:19.683497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840332+0000","last_change":"2023-08-25T04:21:22.916091+0000","last_active":"2023-08-25T04:21:25.840332+0000","last_peered":"2023-08-25T04:21:25.840332+0000","last_clean":"2023-08-25T04:21:25.840332+0000","last_became_active":"2023-08-25T04:21:22.915786+0000","last_became_peered":"2023-08-25T04:21:22.915786+0000","last_unstale":"2023-08-25T04:21:25.840332+0000","last_undegraded":"2023-08-25T04:21:25.840332+0000","last_fullsized":"2023-08-25T04:21:25.840332+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:01:10.869152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"121'1","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840867+0000","last_change":"2023-08-25T04:21:21.893141+0000","last_active":"2023-08-25T04:21:25.840867+0000","last_peered":"2023-08-25T04:21:25.840867+0000","last_clean":"2023-08-25T04:21:25.840867+0000","last_became_active":"2023-08-25T04:21:21.892800+0000","last_became_peered":"2023-08-25T04:21:21.892800+0000","last_unstale":"2023-08-25T04:21:25.840867+0000","last_undegraded":"2023-08-25T04:21:25.840867+0000","last_fullsized":"2023-08-25T04:21:25.840867+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:12:31.209352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903083+0000","last_change":"2023-08-25T04:21:22.898537+0000","last_active":"2023-08-25T04:21:23.903083+0000","last_peered":"2023-08-25T04:21:23.903083+0000","last_clean":"2023-08-25T04:21:23.903083+0000","last_became_active":"2023-08-25T04:21:22.898210+0000","last_became_peered":"2023-08-25T04:21:22.898210+0000","last_unstale":"2023-08-25T04:21:23.903083+0000","last_undegraded":"2023-08-25T04:21:23.903083+0000","last_fullsized":"2023-08-25T04:21:23.903083+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:20:03.163872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"121'2","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903734+0000","last_change":"2023-08-25T04:21:21.896120+0000","last_active":"2023-08-25T04:21:23.903734+0000","last_peered":"2023-08-25T04:21:23.903734+0000","last_clean":"2023-08-25T04:21:23.903734+0000","last_became_active":"2023-08-25T04:21:21.895802+0000","last_became_peered":"2023-08-25T04:21:21.895802+0000","last_unstale":"2023-08-25T04:21:23.903734+0000","last_undegraded":"2023-08-25T04:21:23.903734+0000","last_fullsized":"2023-08-25T04:21:23.903734+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:27:08.122614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162960+0000","last_change":"2023-08-25T04:21:22.908560+0000","last_active":"2023-08-25T04:21:25.162960+0000","last_peered":"2023-08-25T04:21:25.162960+0000","last_clean":"2023-08-25T04:21:25.162960+0000","last_became_active":"2023-08-25T04:21:22.908192+0000","last_became_peered":"2023-08-25T04:21:22.908192+0000","last_unstale":"2023-08-25T04:21:25.162960+0000","last_undegraded":"2023-08-25T04:21:25.162960+0000","last_fullsized":"2023-08-25T04:21:25.162960+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:22.279064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"121'2","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904340+0000","last_change":"2023-08-25T04:21:21.897330+0000","last_active":"2023-08-25T04:21:23.904340+0000","last_peered":"2023-08-25T04:21:23.904340+0000","last_clean":"2023-08-25T04:21:23.904340+0000","last_became_active":"2023-08-25T04:21:21.897056+0000","last_became_peered":"2023-08-25T04:21:21.897056+0000","last_unstale":"2023-08-25T04:21:23.904340+0000","last_undegraded":"2023-08-25T04:21:23.904340+0000","last_fullsized":"2023-08-25T04:21:23.904340+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:15:12.842982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841324+0000","last_change":"2023-08-25T04:21:22.914332+0000","last_active":"2023-08-25T04:21:25.841324+0000","last_peered":"2023-08-25T04:21:25.841324+0000","last_clean":"2023-08-25T04:21:25.841324+0000","last_became_active":"2023-08-25T04:21:22.913928+0000","last_became_peered":"2023-08-25T04:21:22.913928+0000","last_unstale":"2023-08-25T04:21:25.841324+0000","last_undegraded":"2023-08-25T04:21:25.841324+0000","last_fullsized":"2023-08-25T04:21:25.841324+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:58:21.611066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"121'1","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076445+0000","last_change":"2023-08-25T04:21:21.900487+0000","last_active":"2023-08-25T04:21:24.076445+0000","last_peered":"2023-08-25T04:21:24.076445+0000","last_clean":"2023-08-25T04:21:24.076445+0000","last_became_active":"2023-08-25T04:21:21.900194+0000","last_became_peered":"2023-08-25T04:21:21.900194+0000","last_unstale":"2023-08-25T04:21:24.076445+0000","last_undegraded":"2023-08-25T04:21:24.076445+0000","last_fullsized":"2023-08-25T04:21:24.076445+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:57:53.962598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.411030+0000","last_change":"2023-08-25T04:21:22.915270+0000","last_active":"2023-08-25T04:21:24.411030+0000","last_peered":"2023-08-25T04:21:24.411030+0000","last_clean":"2023-08-25T04:21:24.411030+0000","last_became_active":"2023-08-25T04:21:22.913744+0000","last_became_peered":"2023-08-25T04:21:22.913744+0000","last_unstale":"2023-08-25T04:21:24.411030+0000","last_undegraded":"2023-08-25T04:21:24.411030+0000","last_fullsized":"2023-08-25T04:21:24.411030+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:58:46.029608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"121'1","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162819+0000","last_change":"2023-08-25T04:21:21.897494+0000","last_active":"2023-08-25T04:21:25.162819+0000","last_peered":"2023-08-25T04:21:25.162819+0000","last_clean":"2023-08-25T04:21:25.162819+0000","last_became_active":"2023-08-25T04:21:21.897149+0000","last_became_peered":"2023-08-25T04:21:21.897149+0000","last_unstale":"2023-08-25T04:21:25.162819+0000","last_undegraded":"2023-08-25T04:21:25.162819+0000","last_fullsized":"2023-08-25T04:21:25.162819+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:04:11.190127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904271+0000","last_change":"2023-08-25T04:21:22.904977+0000","last_active":"2023-08-25T04:21:23.904271+0000","last_peered":"2023-08-25T04:21:23.904271+0000","last_clean":"2023-08-25T04:21:23.904271+0000","last_became_active":"2023-08-25T04:21:22.904612+0000","last_became_peered":"2023-08-25T04:21:22.904612+0000","last_unstale":"2023-08-25T04:21:23.904271+0000","last_undegraded":"2023-08-25T04:21:23.904271+0000","last_fullsized":"2023-08-25T04:21:23.904271+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:42:42.031026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902917+0000","last_change":"2023-08-25T04:21:21.895812+0000","last_active":"2023-08-25T04:21:23.902917+0000","last_peered":"2023-08-25T04:21:23.902917+0000","last_clean":"2023-08-25T04:21:23.902917+0000","last_became_active":"2023-08-25T04:21:21.895473+0000","last_became_peered":"2023-08-25T04:21:21.895473+0000","last_unstale":"2023-08-25T04:21:23.902917+0000","last_undegraded":"2023-08-25T04:21:23.902917+0000","last_fullsized":"2023-08-25T04:21:23.902917+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:23:23.072929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841106+0000","last_change":"2023-08-25T04:21:22.902808+0000","last_active":"2023-08-25T04:21:25.841106+0000","last_peered":"2023-08-25T04:21:25.841106+0000","last_clean":"2023-08-25T04:21:25.841106+0000","last_became_active":"2023-08-25T04:21:22.902536+0000","last_became_peered":"2023-08-25T04:21:22.902536+0000","last_unstale":"2023-08-25T04:21:25.841106+0000","last_undegraded":"2023-08-25T04:21:25.841106+0000","last_fullsized":"2023-08-25T04:21:25.841106+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:42:06.495784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840581+0000","last_change":"2023-08-25T04:21:21.900803+0000","last_active":"2023-08-25T04:21:25.840581+0000","last_peered":"2023-08-25T04:21:25.840581+0000","last_clean":"2023-08-25T04:21:25.840581+0000","last_became_active":"2023-08-25T04:21:21.900423+0000","last_became_peered":"2023-08-25T04:21:21.900423+0000","last_unstale":"2023-08-25T04:21:25.840581+0000","last_undegraded":"2023-08-25T04:21:25.840581+0000","last_fullsized":"2023-08-25T04:21:25.840581+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:28:18.099804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410801+0000","last_change":"2023-08-25T04:21:22.913903+0000","last_active":"2023-08-25T04:21:24.410801+0000","last_peered":"2023-08-25T04:21:24.410801+0000","last_clean":"2023-08-25T04:21:24.410801+0000","last_became_active":"2023-08-25T04:21:22.910534+0000","last_became_peered":"2023-08-25T04:21:22.910534+0000","last_unstale":"2023-08-25T04:21:24.410801+0000","last_undegraded":"2023-08-25T04:21:24.410801+0000","last_fullsized":"2023-08-25T04:21:24.410801+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:39:37.908542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903950+0000","last_change":"2023-08-25T04:21:21.896785+0000","last_active":"2023-08-25T04:21:23.903950+0000","last_peered":"2023-08-25T04:21:23.903950+0000","last_clean":"2023-08-25T04:21:23.903950+0000","last_became_active":"2023-08-25T04:21:21.896250+0000","last_became_peered":"2023-08-25T04:21:21.896250+0000","last_unstale":"2023-08-25T04:21:23.903950+0000","last_undegraded":"2023-08-25T04:21:23.903950+0000","last_fullsized":"2023-08-25T04:21:23.903950+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:39:26.103990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904017+0000","last_change":"2023-08-25T04:21:22.906785+0000","last_active":"2023-08-25T04:21:23.904017+0000","last_peered":"2023-08-25T04:21:23.904017+0000","last_clean":"2023-08-25T04:21:23.904017+0000","last_became_active":"2023-08-25T04:21:22.905604+0000","last_became_peered":"2023-08-25T04:21:22.905604+0000","last_unstale":"2023-08-25T04:21:23.904017+0000","last_undegraded":"2023-08-25T04:21:23.904017+0000","last_fullsized":"2023-08-25T04:21:23.904017+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:07:02.772070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410927+0000","last_change":"2023-08-25T04:21:21.904376+0000","last_active":"2023-08-25T04:21:24.410927+0000","last_peered":"2023-08-25T04:21:24.410927+0000","last_clean":"2023-08-25T04:21:24.410927+0000","last_became_active":"2023-08-25T04:21:21.904102+0000","last_became_peered":"2023-08-25T04:21:21.904102+0000","last_unstale":"2023-08-25T04:21:24.410927+0000","last_undegraded":"2023-08-25T04:21:24.410927+0000","last_fullsized":"2023-08-25T04:21:24.410927+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:26:24.990460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840462+0000","last_change":"2023-08-25T04:21:22.901342+0000","last_active":"2023-08-25T04:21:25.840462+0000","last_peered":"2023-08-25T04:21:25.840462+0000","last_clean":"2023-08-25T04:21:25.840462+0000","last_became_active":"2023-08-25T04:21:22.900963+0000","last_became_peered":"2023-08-25T04:21:22.900963+0000","last_unstale":"2023-08-25T04:21:25.840462+0000","last_undegraded":"2023-08-25T04:21:25.840462+0000","last_fullsized":"2023-08-25T04:21:25.840462+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:22:10.110622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"121'3","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076512+0000","last_change":"2023-08-25T04:21:21.902909+0000","last_active":"2023-08-25T04:21:24.076512+0000","last_peered":"2023-08-25T04:21:24.076512+0000","last_clean":"2023-08-25T04:21:24.076512+0000","last_became_active":"2023-08-25T04:21:21.902545+0000","last_became_peered":"2023-08-25T04:21:21.902545+0000","last_unstale":"2023-08-25T04:21:24.076512+0000","last_undegraded":"2023-08-25T04:21:24.076512+0000","last_fullsized":"2023-08-25T04:21:24.076512+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:09:15.210507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904324+0000","last_change":"2023-08-25T04:21:22.902324+0000","last_active":"2023-08-25T04:21:23.904324+0000","last_peered":"2023-08-25T04:21:23.904324+0000","last_clean":"2023-08-25T04:21:23.904324+0000","last_became_active":"2023-08-25T04:21:22.902041+0000","last_became_peered":"2023-08-25T04:21:22.902041+0000","last_unstale":"2023-08-25T04:21:23.904324+0000","last_undegraded":"2023-08-25T04:21:23.904324+0000","last_fullsized":"2023-08-25T04:21:23.904324+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:06:37.497907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"121'6","reported_seq":19,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903081+0000","last_change":"2023-08-25T04:21:21.900886+0000","last_active":"2023-08-25T04:21:23.903081+0000","last_peered":"2023-08-25T04:21:23.903081+0000","last_clean":"2023-08-25T04:21:23.903081+0000","last_became_active":"2023-08-25T04:21:21.900551+0000","last_became_peered":"2023-08-25T04:21:21.900551+0000","last_unstale":"2023-08-25T04:21:23.903081+0000","last_undegraded":"2023-08-25T04:21:23.903081+0000","last_fullsized":"2023-08-25T04:21:23.903081+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:23:38.270992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162893+0000","last_change":"2023-08-25T04:21:22.903988+0000","last_active":"2023-08-25T04:21:25.162893+0000","last_peered":"2023-08-25T04:21:25.162893+0000","last_clean":"2023-08-25T04:21:25.162893+0000","last_became_active":"2023-08-25T04:21:22.903724+0000","last_became_peered":"2023-08-25T04:21:22.903724+0000","last_unstale":"2023-08-25T04:21:25.162893+0000","last_undegraded":"2023-08-25T04:21:25.162893+0000","last_fullsized":"2023-08-25T04:21:25.162893+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:03:42.498327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"121'2","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904362+0000","last_change":"2023-08-25T04:21:21.905116+0000","last_active":"2023-08-25T04:21:23.904362+0000","last_peered":"2023-08-25T04:21:23.904362+0000","last_clean":"2023-08-25T04:21:23.904362+0000","last_became_active":"2023-08-25T04:21:21.904844+0000","last_became_peered":"2023-08-25T04:21:21.904844+0000","last_unstale":"2023-08-25T04:21:23.904362+0000","last_undegraded":"2023-08-25T04:21:23.904362+0000","last_fullsized":"2023-08-25T04:21:23.904362+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:58:29.301464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903587+0000","last_change":"2023-08-25T04:21:22.898823+0000","last_active":"2023-08-25T04:21:23.903587+0000","last_peered":"2023-08-25T04:21:23.903587+0000","last_clean":"2023-08-25T04:21:23.903587+0000","last_became_active":"2023-08-25T04:21:22.898537+0000","last_became_peered":"2023-08-25T04:21:22.898537+0000","last_unstale":"2023-08-25T04:21:23.903587+0000","last_undegraded":"2023-08-25T04:21:23.903587+0000","last_fullsized":"2023-08-25T04:21:23.903587+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:33:39.849943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841204+0000","last_change":"2023-08-25T04:21:21.899098+0000","last_active":"2023-08-25T04:21:25.841204+0000","last_peered":"2023-08-25T04:21:25.841204+0000","last_clean":"2023-08-25T04:21:25.841204+0000","last_became_active":"2023-08-25T04:21:21.898766+0000","last_became_peered":"2023-08-25T04:21:21.898766+0000","last_unstale":"2023-08-25T04:21:25.841204+0000","last_undegraded":"2023-08-25T04:21:25.841204+0000","last_fullsized":"2023-08-25T04:21:25.841204+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:44:11.564456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840804+0000","last_change":"2023-08-25T04:21:22.909026+0000","last_active":"2023-08-25T04:21:25.840804+0000","last_peered":"2023-08-25T04:21:25.840804+0000","last_clean":"2023-08-25T04:21:25.840804+0000","last_became_active":"2023-08-25T04:21:22.908495+0000","last_became_peered":"2023-08-25T04:21:22.908495+0000","last_unstale":"2023-08-25T04:21:25.840804+0000","last_undegraded":"2023-08-25T04:21:25.840804+0000","last_fullsized":"2023-08-25T04:21:25.840804+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:14:51.718532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840422+0000","last_change":"2023-08-25T04:21:21.898251+0000","last_active":"2023-08-25T04:21:25.840422+0000","last_peered":"2023-08-25T04:21:25.840422+0000","last_clean":"2023-08-25T04:21:25.840422+0000","last_became_active":"2023-08-25T04:21:21.897984+0000","last_became_peered":"2023-08-25T04:21:21.897984+0000","last_unstale":"2023-08-25T04:21:25.840422+0000","last_undegraded":"2023-08-25T04:21:25.840422+0000","last_fullsized":"2023-08-25T04:21:25.840422+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:41:07.834007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.411139+0000","last_change":"2023-08-25T04:21:22.910451+0000","last_active":"2023-08-25T04:21:24.411139+0000","last_peered":"2023-08-25T04:21:24.411139+0000","last_clean":"2023-08-25T04:21:24.411139+0000","last_became_active":"2023-08-25T04:21:22.909110+0000","last_became_peered":"2023-08-25T04:21:22.909110+0000","last_unstale":"2023-08-25T04:21:24.411139+0000","last_undegraded":"2023-08-25T04:21:24.411139+0000","last_fullsized":"2023-08-25T04:21:24.411139+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:13:10.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"121'8","reported_seq":21,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902573+0000","last_change":"2023-08-25T04:21:21.896664+0000","last_active":"2023-08-25T04:21:23.902573+0000","last_peered":"2023-08-25T04:21:23.902573+0000","last_clean":"2023-08-25T04:21:23.902573+0000","last_became_active":"2023-08-25T04:21:21.896158+0000","last_became_peered":"2023-08-25T04:21:21.896158+0000","last_unstale":"2023-08-25T04:21:23.902573+0000","last_undegraded":"2023-08-25T04:21:23.902573+0000","last_fullsized":"2023-08-25T04:21:23.902573+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:53:23.641692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410675+0000","last_change":"2023-08-25T04:21:22.903079+0000","last_active":"2023-08-25T04:21:24.410675+0000","last_peered":"2023-08-25T04:21:24.410675+0000","last_clean":"2023-08-25T04:21:24.410675+0000","last_became_active":"2023-08-25T04:21:22.902772+0000","last_became_peered":"2023-08-25T04:21:22.902772+0000","last_unstale":"2023-08-25T04:21:24.410675+0000","last_undegraded":"2023-08-25T04:21:24.410675+0000","last_fullsized":"2023-08-25T04:21:24.410675+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:46:54.200389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"121'2","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904616+0000","last_change":"2023-08-25T04:21:21.903246+0000","last_active":"2023-08-25T04:21:23.904616+0000","last_peered":"2023-08-25T04:21:23.904616+0000","last_clean":"2023-08-25T04:21:23.904616+0000","last_became_active":"2023-08-25T04:21:21.902949+0000","last_became_peered":"2023-08-25T04:21:21.902949+0000","last_unstale":"2023-08-25T04:21:23.904616+0000","last_undegraded":"2023-08-25T04:21:23.904616+0000","last_fullsized":"2023-08-25T04:21:23.904616+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:15:50.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902792+0000","last_change":"2023-08-25T04:21:22.894828+0000","last_active":"2023-08-25T04:21:23.902792+0000","last_peered":"2023-08-25T04:21:23.902792+0000","last_clean":"2023-08-25T04:21:23.902792+0000","last_became_active":"2023-08-25T04:21:22.894508+0000","last_became_peered":"2023-08-25T04:21:22.894508+0000","last_unstale":"2023-08-25T04:21:23.902792+0000","last_undegraded":"2023-08-25T04:21:23.902792+0000","last_fullsized":"2023-08-25T04:21:23.902792+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:21:06.670524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.411067+0000","last_change":"2023-08-25T04:21:21.901910+0000","last_active":"2023-08-25T04:21:24.411067+0000","last_peered":"2023-08-25T04:21:24.411067+0000","last_clean":"2023-08-25T04:21:24.411067+0000","last_became_active":"2023-08-25T04:21:21.901498+0000","last_became_peered":"2023-08-25T04:21:21.901498+0000","last_unstale":"2023-08-25T04:21:24.411067+0000","last_undegraded":"2023-08-25T04:21:24.411067+0000","last_fullsized":"2023-08-25T04:21:24.411067+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:00:15.013692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841079+0000","last_change":"2023-08-25T04:21:22.907540+0000","last_active":"2023-08-25T04:21:25.841079+0000","last_peered":"2023-08-25T04:21:25.841079+0000","last_clean":"2023-08-25T04:21:25.841079+0000","last_became_active":"2023-08-25T04:21:22.907269+0000","last_became_peered":"2023-08-25T04:21:22.907269+0000","last_unstale":"2023-08-25T04:21:25.841079+0000","last_undegraded":"2023-08-25T04:21:25.841079+0000","last_fullsized":"2023-08-25T04:21:25.841079+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:05:42.134636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903637+0000","last_change":"2023-08-25T04:21:21.897043+0000","last_active":"2023-08-25T04:21:23.903637+0000","last_peered":"2023-08-25T04:21:23.903637+0000","last_clean":"2023-08-25T04:21:23.903637+0000","last_became_active":"2023-08-25T04:21:21.896732+0000","last_became_peered":"2023-08-25T04:21:21.896732+0000","last_unstale":"2023-08-25T04:21:23.903637+0000","last_undegraded":"2023-08-25T04:21:23.903637+0000","last_fullsized":"2023-08-25T04:21:23.903637+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:23:56.687199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162960+0000","last_change":"2023-08-25T04:21:22.907863+0000","last_active":"2023-08-25T04:21:25.162960+0000","last_peered":"2023-08-25T04:21:25.162960+0000","last_clean":"2023-08-25T04:21:25.162960+0000","last_became_active":"2023-08-25T04:21:22.907427+0000","last_became_peered":"2023-08-25T04:21:22.907427+0000","last_unstale":"2023-08-25T04:21:25.162960+0000","last_undegraded":"2023-08-25T04:21:25.162960+0000","last_fullsized":"2023-08-25T04:21:25.162960+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:40.590057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904657+0000","last_change":"2023-08-25T04:21:21.899448+0000","last_active":"2023-08-25T04:21:23.904657+0000","last_peered":"2023-08-25T04:21:23.904657+0000","last_clean":"2023-08-25T04:21:23.904657+0000","last_became_active":"2023-08-25T04:21:21.899162+0000","last_became_peered":"2023-08-25T04:21:21.899162+0000","last_unstale":"2023-08-25T04:21:23.904657+0000","last_undegraded":"2023-08-25T04:21:23.904657+0000","last_fullsized":"2023-08-25T04:21:23.904657+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:10:45.794596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840819+0000","last_change":"2023-08-25T04:21:22.916377+0000","last_active":"2023-08-25T04:21:25.840819+0000","last_peered":"2023-08-25T04:21:25.840819+0000","last_clean":"2023-08-25T04:21:25.840819+0000","last_became_active":"2023-08-25T04:21:22.915939+0000","last_became_peered":"2023-08-25T04:21:22.915939+0000","last_unstale":"2023-08-25T04:21:25.840819+0000","last_undegraded":"2023-08-25T04:21:25.840819+0000","last_fullsized":"2023-08-25T04:21:25.840819+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:34.902641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903453+0000","last_change":"2023-08-25T04:21:21.893809+0000","last_active":"2023-08-25T04:21:23.903453+0000","last_peered":"2023-08-25T04:21:23.903453+0000","last_clean":"2023-08-25T04:21:23.903453+0000","last_became_active":"2023-08-25T04:21:21.893520+0000","last_became_peered":"2023-08-25T04:21:21.893520+0000","last_unstale":"2023-08-25T04:21:23.903453+0000","last_undegraded":"2023-08-25T04:21:23.903453+0000","last_fullsized":"2023-08-25T04:21:23.903453+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:43:16.462790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840847+0000","last_change":"2023-08-25T04:21:22.900921+0000","last_active":"2023-08-25T04:21:25.840847+0000","last_peered":"2023-08-25T04:21:25.840847+0000","last_clean":"2023-08-25T04:21:25.840847+0000","last_became_active":"2023-08-25T04:21:22.900466+0000","last_became_peered":"2023-08-25T04:21:22.900466+0000","last_unstale":"2023-08-25T04:21:25.840847+0000","last_undegraded":"2023-08-25T04:21:25.840847+0000","last_fullsized":"2023-08-25T04:21:25.840847+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:09:07.904186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840592+0000","last_change":"2023-08-25T04:21:21.897723+0000","last_active":"2023-08-25T04:21:25.840592+0000","last_peered":"2023-08-25T04:21:25.840592+0000","last_clean":"2023-08-25T04:21:25.840592+0000","last_became_active":"2023-08-25T04:21:21.897454+0000","last_became_peered":"2023-08-25T04:21:21.897454+0000","last_unstale":"2023-08-25T04:21:25.840592+0000","last_undegraded":"2023-08-25T04:21:25.840592+0000","last_fullsized":"2023-08-25T04:21:25.840592+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:34:44.246278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076639+0000","last_change":"2023-08-25T04:21:22.903968+0000","last_active":"2023-08-25T04:21:24.076639+0000","last_peered":"2023-08-25T04:21:24.076639+0000","last_clean":"2023-08-25T04:21:24.076639+0000","last_became_active":"2023-08-25T04:21:22.903669+0000","last_became_peered":"2023-08-25T04:21:22.903669+0000","last_unstale":"2023-08-25T04:21:24.076639+0000","last_undegraded":"2023-08-25T04:21:24.076639+0000","last_fullsized":"2023-08-25T04:21:24.076639+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:11.463372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903246+0000","last_change":"2023-08-25T04:21:21.897193+0000","last_active":"2023-08-25T04:21:23.903246+0000","last_peered":"2023-08-25T04:21:23.903246+0000","last_clean":"2023-08-25T04:21:23.903246+0000","last_became_active":"2023-08-25T04:21:21.896858+0000","last_became_peered":"2023-08-25T04:21:21.896858+0000","last_unstale":"2023-08-25T04:21:23.903246+0000","last_undegraded":"2023-08-25T04:21:23.903246+0000","last_fullsized":"2023-08-25T04:21:23.903246+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:23:32.684612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.163362+0000","last_change":"2023-08-25T04:21:22.901384+0000","last_active":"2023-08-25T04:21:25.163362+0000","last_peered":"2023-08-25T04:21:25.163362+0000","last_clean":"2023-08-25T04:21:25.163362+0000","last_became_active":"2023-08-25T04:21:22.901073+0000","last_became_peered":"2023-08-25T04:21:22.901073+0000","last_unstale":"2023-08-25T04:21:25.163362+0000","last_undegraded":"2023-08-25T04:21:25.163362+0000","last_fullsized":"2023-08-25T04:21:25.163362+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:01:08.975856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841028+0000","last_change":"2023-08-25T04:21:21.896102+0000","last_active":"2023-08-25T04:21:25.841028+0000","last_peered":"2023-08-25T04:21:25.841028+0000","last_clean":"2023-08-25T04:21:25.841028+0000","last_became_active":"2023-08-25T04:21:21.895635+0000","last_became_peered":"2023-08-25T04:21:21.895635+0000","last_unstale":"2023-08-25T04:21:25.841028+0000","last_undegraded":"2023-08-25T04:21:25.841028+0000","last_fullsized":"2023-08-25T04:21:25.841028+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:06:47.686562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162827+0000","last_change":"2023-08-25T04:21:22.900419+0000","last_active":"2023-08-25T04:21:25.162827+0000","last_peered":"2023-08-25T04:21:25.162827+0000","last_clean":"2023-08-25T04:21:25.162827+0000","last_became_active":"2023-08-25T04:21:22.900107+0000","last_became_peered":"2023-08-25T04:21:22.900107+0000","last_unstale":"2023-08-25T04:21:25.162827+0000","last_undegraded":"2023-08-25T04:21:25.162827+0000","last_fullsized":"2023-08-25T04:21:25.162827+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:13:10.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"121'2","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840902+0000","last_change":"2023-08-25T04:21:21.900342+0000","last_active":"2023-08-25T04:21:25.840902+0000","last_peered":"2023-08-25T04:21:25.840902+0000","last_clean":"2023-08-25T04:21:25.840902+0000","last_became_active":"2023-08-25T04:21:21.899299+0000","last_became_peered":"2023-08-25T04:21:21.899299+0000","last_unstale":"2023-08-25T04:21:25.840902+0000","last_undegraded":"2023-08-25T04:21:25.840902+0000","last_fullsized":"2023-08-25T04:21:25.840902+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:56:15.651762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"111'3532","reported_seq":4056,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076405+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:21:24.076405+0000","last_peered":"2023-08-25T04:21:24.076405+0000","last_clean":"2023-08-25T04:21:24.076405+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:21:24.076405+0000","last_undegraded":"2023-08-25T04:21:24.076405+0000","last_fullsized":"2023-08-25T04:21:24.076405+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:49:26.318209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1040,"num_read_kb":2137,"num_write":345,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":187,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.163082+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:21:25.163082+0000","last_peered":"2023-08-25T04:21:25.163082+0000","last_clean":"2023-08-25T04:21:25.163082+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:21:25.163082+0000","last_undegraded":"2023-08-25T04:21:25.163082+0000","last_fullsized":"2023-08-25T04:21:25.163082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:35:51.566579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903521+0000","last_change":"2023-08-25T04:21:22.897658+0000","last_active":"2023-08-25T04:21:23.903521+0000","last_peered":"2023-08-25T04:21:23.903521+0000","last_clean":"2023-08-25T04:21:23.903521+0000","last_became_active":"2023-08-25T04:21:22.897340+0000","last_became_peered":"2023-08-25T04:21:22.897340+0000","last_unstale":"2023-08-25T04:21:23.903521+0000","last_undegraded":"2023-08-25T04:21:23.903521+0000","last_fullsized":"2023-08-25T04:21:23.903521+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:02:42.501230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"121'1","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076650+0000","last_change":"2023-08-25T04:21:21.900979+0000","last_active":"2023-08-25T04:21:24.076650+0000","last_peered":"2023-08-25T04:21:24.076650+0000","last_clean":"2023-08-25T04:21:24.076650+0000","last_became_active":"2023-08-25T04:21:21.900548+0000","last_became_peered":"2023-08-25T04:21:21.900548+0000","last_unstale":"2023-08-25T04:21:24.076650+0000","last_undegraded":"2023-08-25T04:21:24.076650+0000","last_fullsized":"2023-08-25T04:21:24.076650+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:10.087987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":190,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076231+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:21:24.076231+0000","last_peered":"2023-08-25T04:21:24.076231+0000","last_clean":"2023-08-25T04:21:24.076231+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:21:24.076231+0000","last_undegraded":"2023-08-25T04:21:24.076231+0000","last_fullsized":"2023-08-25T04:21:24.076231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:50:46.284319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904268+0000","last_change":"2023-08-25T04:21:22.893095+0000","last_active":"2023-08-25T04:21:23.904268+0000","last_peered":"2023-08-25T04:21:23.904268+0000","last_clean":"2023-08-25T04:21:23.904268+0000","last_became_active":"2023-08-25T04:21:22.892796+0000","last_became_peered":"2023-08-25T04:21:22.892796+0000","last_unstale":"2023-08-25T04:21:23.904268+0000","last_undegraded":"2023-08-25T04:21:23.904268+0000","last_fullsized":"2023-08-25T04:21:23.904268+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:17:01.059229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162978+0000","last_change":"2023-08-25T04:21:21.897616+0000","last_active":"2023-08-25T04:21:25.162978+0000","last_peered":"2023-08-25T04:21:25.162978+0000","last_clean":"2023-08-25T04:21:25.162978+0000","last_became_active":"2023-08-25T04:21:21.897331+0000","last_became_peered":"2023-08-25T04:21:21.897331+0000","last_unstale":"2023-08-25T04:21:25.162978+0000","last_undegraded":"2023-08-25T04:21:25.162978+0000","last_fullsized":"2023-08-25T04:21:25.162978+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:21:42.629328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":195,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841171+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:21:25.841171+0000","last_peered":"2023-08-25T04:21:25.841171+0000","last_clean":"2023-08-25T04:21:25.841171+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:21:25.841171+0000","last_undegraded":"2023-08-25T04:21:25.841171+0000","last_fullsized":"2023-08-25T04:21:25.841171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:23.051206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840349+0000","last_change":"2023-08-25T04:21:22.906887+0000","last_active":"2023-08-25T04:21:25.840349+0000","last_peered":"2023-08-25T04:21:25.840349+0000","last_clean":"2023-08-25T04:21:25.840349+0000","last_became_active":"2023-08-25T04:21:22.906378+0000","last_became_peered":"2023-08-25T04:21:22.906378+0000","last_unstale":"2023-08-25T04:21:25.840349+0000","last_undegraded":"2023-08-25T04:21:25.840349+0000","last_fullsized":"2023-08-25T04:21:25.840349+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:37:21.744515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"121'1","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903928+0000","last_change":"2023-08-25T04:21:21.893780+0000","last_active":"2023-08-25T04:21:23.903928+0000","last_peered":"2023-08-25T04:21:23.903928+0000","last_clean":"2023-08-25T04:21:23.903928+0000","last_became_active":"2023-08-25T04:21:21.893498+0000","last_became_peered":"2023-08-25T04:21:21.893498+0000","last_unstale":"2023-08-25T04:21:23.903928+0000","last_undegraded":"2023-08-25T04:21:23.903928+0000","last_fullsized":"2023-08-25T04:21:23.903928+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:45:30.286920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":187,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162798+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:21:25.162798+0000","last_peered":"2023-08-25T04:21:25.162798+0000","last_clean":"2023-08-25T04:21:25.162798+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:21:25.162798+0000","last_undegraded":"2023-08-25T04:21:25.162798+0000","last_fullsized":"2023-08-25T04:21:25.162798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:40:09.787141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840704+0000","last_change":"2023-08-25T04:21:22.908616+0000","last_active":"2023-08-25T04:21:25.840704+0000","last_peered":"2023-08-25T04:21:25.840704+0000","last_clean":"2023-08-25T04:21:25.840704+0000","last_became_active":"2023-08-25T04:21:22.908297+0000","last_became_peered":"2023-08-25T04:21:22.908297+0000","last_unstale":"2023-08-25T04:21:25.840704+0000","last_undegraded":"2023-08-25T04:21:25.840704+0000","last_fullsized":"2023-08-25T04:21:25.840704+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:38:43.950220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903108+0000","last_change":"2023-08-25T04:21:21.890257+0000","last_active":"2023-08-25T04:21:23.903108+0000","last_peered":"2023-08-25T04:21:23.903108+0000","last_clean":"2023-08-25T04:21:23.903108+0000","last_became_active":"2023-08-25T04:21:21.889952+0000","last_became_peered":"2023-08-25T04:21:21.889952+0000","last_unstale":"2023-08-25T04:21:23.903108+0000","last_undegraded":"2023-08-25T04:21:23.903108+0000","last_fullsized":"2023-08-25T04:21:23.903108+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:16:23.636146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":203,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904464+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:21:23.904464+0000","last_peered":"2023-08-25T04:21:23.904464+0000","last_clean":"2023-08-25T04:21:23.904464+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:21:23.904464+0000","last_undegraded":"2023-08-25T04:21:23.904464+0000","last_fullsized":"2023-08-25T04:21:23.904464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:38:00.891104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841103+0000","last_change":"2023-08-25T04:21:22.911195+0000","last_active":"2023-08-25T04:21:25.841103+0000","last_peered":"2023-08-25T04:21:25.841103+0000","last_clean":"2023-08-25T04:21:25.841103+0000","last_became_active":"2023-08-25T04:21:22.910585+0000","last_became_peered":"2023-08-25T04:21:22.910585+0000","last_unstale":"2023-08-25T04:21:25.841103+0000","last_undegraded":"2023-08-25T04:21:25.841103+0000","last_fullsized":"2023-08-25T04:21:25.841103+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:25:56.030464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840387+0000","last_change":"2023-08-25T04:21:21.903096+0000","last_active":"2023-08-25T04:21:25.840387+0000","last_peered":"2023-08-25T04:21:25.840387+0000","last_clean":"2023-08-25T04:21:25.840387+0000","last_became_active":"2023-08-25T04:21:21.902800+0000","last_became_peered":"2023-08-25T04:21:21.902800+0000","last_unstale":"2023-08-25T04:21:25.840387+0000","last_undegraded":"2023-08-25T04:21:25.840387+0000","last_fullsized":"2023-08-25T04:21:25.840387+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:55:56.837970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076659+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:21:24.076659+0000","last_peered":"2023-08-25T04:21:24.076659+0000","last_clean":"2023-08-25T04:21:24.076659+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:21:24.076659+0000","last_undegraded":"2023-08-25T04:21:24.076659+0000","last_fullsized":"2023-08-25T04:21:24.076659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:27:10.575116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410697+0000","last_change":"2023-08-25T04:21:22.912635+0000","last_active":"2023-08-25T04:21:24.410697+0000","last_peered":"2023-08-25T04:21:24.410697+0000","last_clean":"2023-08-25T04:21:24.410697+0000","last_became_active":"2023-08-25T04:21:22.912251+0000","last_became_peered":"2023-08-25T04:21:22.912251+0000","last_unstale":"2023-08-25T04:21:24.410697+0000","last_undegraded":"2023-08-25T04:21:24.410697+0000","last_fullsized":"2023-08-25T04:21:24.410697+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:07:08.209942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"121'2","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840713+0000","last_change":"2023-08-25T04:21:21.903014+0000","last_active":"2023-08-25T04:21:25.840713+0000","last_peered":"2023-08-25T04:21:25.840713+0000","last_clean":"2023-08-25T04:21:25.840713+0000","last_became_active":"2023-08-25T04:21:21.902701+0000","last_became_peered":"2023-08-25T04:21:21.902701+0000","last_unstale":"2023-08-25T04:21:25.840713+0000","last_undegraded":"2023-08-25T04:21:25.840713+0000","last_fullsized":"2023-08-25T04:21:25.840713+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:54:51.762146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":203,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904618+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:21:23.904618+0000","last_peered":"2023-08-25T04:21:23.904618+0000","last_clean":"2023-08-25T04:21:23.904618+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:21:23.904618+0000","last_undegraded":"2023-08-25T04:21:23.904618+0000","last_fullsized":"2023-08-25T04:21:23.904618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:18:52.419533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410922+0000","last_change":"2023-08-25T04:21:22.914660+0000","last_active":"2023-08-25T04:21:24.410922+0000","last_peered":"2023-08-25T04:21:24.410922+0000","last_clean":"2023-08-25T04:21:24.410922+0000","last_became_active":"2023-08-25T04:21:22.909767+0000","last_became_peered":"2023-08-25T04:21:22.909767+0000","last_unstale":"2023-08-25T04:21:24.410922+0000","last_undegraded":"2023-08-25T04:21:24.410922+0000","last_fullsized":"2023-08-25T04:21:24.410922+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:32:16.049571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840266+0000","last_change":"2023-08-25T04:21:21.901171+0000","last_active":"2023-08-25T04:21:25.840266+0000","last_peered":"2023-08-25T04:21:25.840266+0000","last_clean":"2023-08-25T04:21:25.840266+0000","last_became_active":"2023-08-25T04:21:21.900896+0000","last_became_peered":"2023-08-25T04:21:21.900896+0000","last_unstale":"2023-08-25T04:21:25.840266+0000","last_undegraded":"2023-08-25T04:21:25.840266+0000","last_fullsized":"2023-08-25T04:21:25.840266+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:06:42.554534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":217,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904079+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:21:23.904079+0000","last_peered":"2023-08-25T04:21:23.904079+0000","last_clean":"2023-08-25T04:21:23.904079+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:21:23.904079+0000","last_undegraded":"2023-08-25T04:21:23.904079+0000","last_fullsized":"2023-08-25T04:21:23.904079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:03:44.441477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1040,"num_read_kb":2137,"num_write":345,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3532,"ondisk_log_size":3532,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509663,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59600,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312240,"statfs":{"total":96636764160,"available":96575733760,"internally_reserved":0,"allocated":2101248,"data_stored":1337669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.67100000000000004,"15min":0.69599999999999995},"min":{"1min":0.501,"5min":0.35399999999999998,"15min":0.33700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.67700000000000005,"15min":0.71299999999999997},"min":{"1min":0.44500000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1,"5min":1,"15min":1.0249999999999999},"last":0.88600000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.70799999999999996,"15min":0.72799999999999998},"min":{"1min":0.51900000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.70199999999999996,"15min":0.72899999999999998},"min":{"1min":0.47399999999999998,"5min":0.377,"15min":0.374},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.036},"last":0.83599999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68200000000000005,"15min":0.70599999999999996},"min":{"1min":0.49399999999999999,"5min":0.38100000000000001,"15min":0.34899999999999998},"max":{"1min":0.89500000000000002,"5min":0.94299999999999995,"15min":1.018},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.71099999999999997,"15min":0.74099999999999999},"min":{"1min":0.498,"5min":0.46500000000000002,"15min":0.38100000000000001},"max":{"1min":1.0429999999999999,"5min":1.046,"15min":1.046},"last":0.90200000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.70099999999999996,"15min":0.73099999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.75},{"interface":"front","average":{"1min":0.755,"5min":0.71799999999999997,"15min":0.74299999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.85499999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59099999999999997,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.34499999999999997,"15min":0.32400000000000001},"max":{"1min":1.004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":1.004},{"interface":"front","average":{"1min":0.621,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.38900000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.97599999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.97599999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40500000000000003,"15min":0.377},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63800000000000001,"15min":0.63100000000000001},"min":{"1min":0.46600000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.99099999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.442,"5min":0.42799999999999999,"15min":0.42699999999999999},"max":{"1min":1.0169999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.81200000000000006}]}]},{"osd":6,"up_from":15,"seq":64424509663,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36828,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335012,"statfs":{"total":96636764160,"available":96599052288,"internally_reserved":0,"allocated":1519616,"data_stored":749357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.66300000000000003,"15min":0.69599999999999995},"min":{"1min":0.53200000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.88500000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.622},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66400000000000003,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84299999999999997,"5min":0.96499999999999997,"15min":1.054},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69799999999999995,"15min":0.72699999999999998},"min":{"1min":0.48699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96299999999999997,"5min":1.0269999999999999,"15min":1.0369999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69599999999999995,"15min":0.72199999999999998},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90500000000000003,"5min":1.109,"15min":1.109},"last":0.70399999999999996}]},{"osd":2,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70199999999999996,"15min":0.72899999999999998},"min":{"1min":0.54200000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86799999999999999,"5min":1.0009999999999999,"15min":1.1020000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.59299999999999997,"5min":0.499,"15min":0.499},"max":{"1min":0.92900000000000005,"5min":1.0569999999999999,"15min":1.117},"last":0.76900000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.51600000000000001,"5min":0.48499999999999999,"15min":0.46899999999999997},"max":{"1min":0.88700000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.52500000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93999999999999995,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.753}]},{"osd":4,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39400000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.42299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.92200000000000004,"5min":0.95799999999999996,"15min":1.0820000000000001},"last":0.78400000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.48199999999999998,"5min":0.39200000000000002,"15min":0.373},"max":{"1min":0.874,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91700000000000004,"5min":1.141,"15min":1.141},"last":0.81499999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.502,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":1.0389999999999999,"15min":1.046},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71699999999999997,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.44700000000000001},"max":{"1min":0.94199999999999995,"5min":1.373,"15min":1.373},"last":0.71899999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542366,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":747141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65200000000000002,"15min":0.69799999999999995},"min":{"1min":0.498,"5min":0.313,"15min":0.313},"max":{"1min":0.91300000000000003,"5min":0.98099999999999998,"15min":1.018},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66900000000000004,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0409999999999999},"last":0.63200000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.67000000000000004,"15min":0.71899999999999997},"min":{"1min":0.51200000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.99399999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.70299999999999996,"15min":0.73099999999999998},"min":{"1min":0.46400000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.82299999999999995}]},{"osd":2,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.66300000000000003,"15min":0.71499999999999997},"min":{"1min":0.58699999999999997,"5min":0.40799999999999997,"15min":0.39500000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.97499999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70199999999999996,"15min":0.73599999999999999},"min":{"1min":0.58499999999999996,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.66600000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70199999999999996,"15min":0.72599999999999998},"min":{"1min":0.55800000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.94199999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.70999999999999996,"15min":0.75600000000000001},"min":{"1min":0.626,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.008,"5min":1.028,"15min":1.028},"last":0.85399999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.44500000000000001,"5min":0.38400000000000001,"15min":0.35399999999999998},"max":{"1min":0.72199999999999998,"5min":0.91000000000000003,"15min":0.97099999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.46800000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.874,"5min":0.99399999999999999,"15min":1.018},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:21:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.44600000000000001,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.82399999999999995,"5min":0.96799999999999997,"15min":1.008},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.48199999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79400000000000004,"5min":0.94199999999999995,"15min":0.98299999999999998},"last":0.73699999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:21:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.63400000000000001,"15min":0.61499999999999999},"min":{"1min":0.47499999999999998,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.84699999999999998,"5min":0.93300000000000005,"15min":1.032},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69099999999999995,"15min":0.68999999999999995},"min":{"1min":0.55700000000000005,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.94999999999999996,"5min":1.01,"15min":1.048},"last":0.877}]}]},{"osd":4,"up_from":14,"seq":60129542366,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36816,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335024,"statfs":{"total":96636764160,"available":96599064576,"internally_reserved":0,"allocated":1507328,"data_stored":747233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64600000000000002,"15min":0.69599999999999995},"min":{"1min":0.45600000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.99299999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65700000000000003,"15min":0.69099999999999995},"min":{"1min":0.499,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83699999999999997,"5min":0.90200000000000002,"15min":0.96699999999999997},"last":0.53400000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.68700000000000006,"15min":0.72199999999999998},"min":{"1min":0.46600000000000003,"5min":0.38200000000000001,"15min":0.36199999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0449999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67500000000000004,"15min":0.72399999999999998},"min":{"1min":0.47599999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92100000000000004,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69799999999999995,"15min":0.748},"min":{"1min":0.48099999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91500000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.69699999999999995,"15min":0.73599999999999999},"min":{"1min":0.48399999999999999,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":0.97699999999999998,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.66800000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.71899999999999997,"15min":0.755},"min":{"1min":0.52500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.048},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69599999999999995,"15min":0.74399999999999999},"min":{"1min":0.51300000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0209999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.58199999999999996}]},{"osd":5,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53500000000000003,"15min":0.55000000000000004},"min":{"1min":0.35499999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.94799999999999995},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85999999999999999,"5min":0.91400000000000003,"15min":1.8740000000000001},"last":0.505}]},{"osd":6,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.48699999999999999,"5min":0.48199999999999998,"15min":0.40699999999999997},"max":{"1min":1.079,"5min":1.079,"15min":1.093},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.64000000000000001},"min":{"1min":0.36499999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":1.022,"15min":1.2010000000000001},"last":0.76800000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":0.84499999999999997,"5min":0.84899999999999998,"15min":0.90400000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.505,"5min":0.49199999999999999,"15min":0.437},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.99399999999999999},"last":0.83599999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542366,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36808,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335032,"statfs":{"total":96636764160,"available":96599072768,"internally_reserved":0,"allocated":1503232,"data_stored":747723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53900000000000003,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.376},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.38500000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63,"5min":0.745,"15min":0.91500000000000004},"last":0.53900000000000003}]},{"osd":1,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.502,"15min":0.501},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.74199999999999999,"5min":1.254,"15min":1.254},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.45300000000000001,"5min":0.41499999999999998,"15min":0.33900000000000002},"max":{"1min":0.73999999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.38700000000000001,"15min":0.33000000000000002},"max":{"1min":0.79500000000000004,"5min":1.639,"15min":1.639},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.54300000000000004},"min":{"1min":0.39600000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.748,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.58899999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.56899999999999995,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97999999999999998,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.61899999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.02,"5min":1.601,"15min":1.601},"last":0.78500000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.75900000000000001,"15min":0.77700000000000002},"min":{"1min":0.54600000000000004,"5min":0.52900000000000003,"15min":0.49299999999999999},"max":{"1min":1.0349999999999999,"5min":1.254,"15min":1.254},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.75600000000000001,"15min":0.78000000000000003},"min":{"1min":0.66100000000000003,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":0.95299999999999996,"5min":1.421,"15min":1.421},"last":0.95299999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79500000000000004,"15min":0.80000000000000004},"min":{"1min":0.58999999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0880000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.879},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.76300000000000001,"15min":0.79200000000000004},"min":{"1min":0.63300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0029999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0029999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.79700000000000004,"15min":0.82099999999999995},"min":{"1min":0.621,"5min":0.53000000000000003,"15min":0.52500000000000002},"max":{"1min":1.0780000000000001,"5min":1.472,"15min":1.472},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77300000000000002,"15min":0.78900000000000003},"min":{"1min":0.59799999999999998,"5min":0.498,"15min":0.498},"max":{"1min":1.0209999999999999,"5min":1.079,"15min":1.1160000000000001},"last":0.93400000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542367,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54856,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316984,"statfs":{"total":96636764160,"available":96580591616,"internally_reserved":0,"allocated":1503232,"data_stored":747175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.44,"15min":0.45900000000000002},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.59299999999999997,"5min":0.85599999999999998,"15min":0.92000000000000004},"last":0.372},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.45900000000000002,"15min":0.49099999999999999},"min":{"1min":0.29799999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.59899999999999998,"5min":0.81000000000000005,"15min":0.93100000000000005},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46700000000000003,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65200000000000002,"5min":0.70799999999999996,"15min":0.85499999999999998},"last":0.505},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56100000000000005,"15min":0.59499999999999997},"min":{"1min":0.40899999999999997,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.67000000000000004,"5min":0.81699999999999995,"15min":0.89800000000000002},"last":0.48699999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.499,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":0.71399999999999997,"5min":0.82199999999999995,"15min":0.82299999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53300000000000003,"15min":0.56100000000000005},"min":{"1min":0.373,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68400000000000005,"5min":0.80600000000000005,"15min":0.89400000000000002},"last":0.55300000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.73799999999999999,"15min":0.78400000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.79700000000000004,"5min":1.1990000000000001,"15min":1.2569999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.72799999999999998,"15min":0.77300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96699999999999997,"5min":1.151,"15min":1.5509999999999999},"last":0.628}]},{"osd":5,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.745,"15min":0.78800000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.92800000000000005,"5min":1.1080000000000001,"15min":1.2789999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.753,"15min":0.79500000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94499999999999995,"5min":1.2130000000000001,"15min":1.3089999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.752,"15min":0.81200000000000006},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.84399999999999997,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.78300000000000003,"15min":0.83999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.995,"5min":1.25,"15min":1.375},"last":0.69699999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.746,"15min":0.78800000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90300000000000002,"5min":1.0860000000000001,"15min":1.339},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.75600000000000001,"15min":0.79500000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.92600000000000005,"5min":1.1839999999999999,"15min":1.1859999999999999},"last":0.80800000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542367,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36812,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335028,"statfs":{"total":96636764160,"available":96599068672,"internally_reserved":0,"allocated":1503232,"data_stored":747175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.438,"15min":0.45100000000000001},"min":{"1min":0.26400000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.96899999999999997},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.753,"5min":0.85099999999999998,"15min":1.212},"last":0.47099999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.498,"15min":0.498},"min":{"1min":0.35599999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.76400000000000001,"5min":0.82099999999999995,"15min":0.876},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.496}]},{"osd":3,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.39900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53800000000000003,"15min":0.56799999999999995},"min":{"1min":0.33200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.748,"5min":0.84299999999999997,"15min":1.165},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70899999999999996,"15min":0.75700000000000001},"min":{"1min":0.51900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92300000000000004,"5min":1.012,"15min":1.204},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.76300000000000001,"15min":0.79300000000000004},"min":{"1min":0.52400000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.2529999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72399999999999998,"15min":0.77500000000000002},"min":{"1min":0.54500000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89200000000000002,"5min":1.073,"15min":1.254},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.74399999999999999,"15min":0.79400000000000004},"min":{"1min":0.56999999999999995,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0129999999999999,"5min":1.044,"15min":1.9059999999999999},"last":0.95299999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80000000000000004,"15min":0.82399999999999995},"min":{"1min":0.55800000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.294,"5min":1.294,"15min":1.623},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.755,"15min":0.78900000000000003},"min":{"1min":0.57899999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93000000000000005,"5min":1.0369999999999999,"15min":1.288},"last":0.83399999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.753,"15min":0.79400000000000004},"min":{"1min":0.59199999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95999999999999996,"5min":1.1140000000000001,"15min":1.2949999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81799999999999995,"15min":0.83799999999999997},"min":{"1min":0.59199999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.3120000000000001},"last":0.86599999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542366,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2109440,"data_stored":1339211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.30599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52100000000000002,"15min":0.55900000000000005},"min":{"1min":0.41499999999999998,"5min":0.38500000000000001,"15min":0.36699999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":3.5089999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48499999999999999,"15min":0.51500000000000001},"min":{"1min":0.34000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.749,"5min":0.78500000000000003,"15min":0.97499999999999998},"last":0.63},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51800000000000002,"15min":0.53700000000000003},"min":{"1min":0.42899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70099999999999996,"5min":0.876,"15min":3.4590000000000001},"last":0.55000000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47699999999999998,"15min":0.48999999999999999},"min":{"1min":0.37,"5min":0.27800000000000002,"15min":0.27700000000000002},"max":{"1min":0.73599999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57199999999999995,"15min":0.58799999999999997},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.32700000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":1.2470000000000001},"last":0.70199999999999996}]},{"osd":4,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77000000000000002,"15min":0.78500000000000003},"min":{"1min":0.60299999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97999999999999998,"5min":1.2,"15min":1.2},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.75800000000000001,"15min":0.79300000000000004},"min":{"1min":0.63,"5min":0.443,"15min":0.443},"max":{"1min":1.1339999999999999,"5min":1.169,"15min":1.1719999999999999},"last":0.88}]},{"osd":5,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.747,"15min":0.78500000000000003},"min":{"1min":0.52500000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.032,"5min":1.131,"15min":3.528},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.61599999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.2270000000000001,"5min":1.244,"15min":1.244},"last":0.94299999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.74399999999999999,"15min":0.78800000000000003},"min":{"1min":0.58799999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":3.4870000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78500000000000003,"15min":0.81999999999999995},"min":{"1min":0.54200000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.093,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.98099999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.80100000000000005,"15min":0.83199999999999996},"min":{"1min":0.63800000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1619999999999999,"5min":1.28,"15min":1.28},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77000000000000002,"15min":0.80000000000000004},"min":{"1min":0.59999999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0609999999999999,"5min":1.0940000000000001,"15min":1.1930000000000001},"last":1.0820000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:21:28.855 INFO:tasks.ceph.mds.c.smithi055.stderr:2023-08-25T04:21:28.855+0000 7fbc0cbe2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T04:21:30.687 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:21:30.692 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:21:31.582 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:21:31.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.738+0000 7f250e6e2640 1 Processor -- start 2023-08-25T04:21:31.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.738+0000 7f250e6e2640 1 -- start start 2023-08-25T04:21:31.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.738+0000 7f250e6e2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f250815ca50 0x7f25080d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:31.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.742+0000 7f250e6e2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f25080d0f50 0x7f250806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.742+0000 7f250e6e2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25080afe20 con 0x7f250806c150 2023-08-25T04:21:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.742+0000 7f250e6e2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25080d13d0 con 0x7f25080d0f50 2023-08-25T04:21:31.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.742+0000 7f250e6e2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25080af210 con 0x7f250815ca50 2023-08-25T04:21:31.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.742+0000 7f250cedf640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f25080d0f50 0x7f250806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:31.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.742+0000 7f250d6e0640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f250815ca50 0x7f25080d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:31.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.742+0000 7f250cedf640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f25080d0f50 0x7f250806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:50192/0 (socket says 172.21.15.55:50192) 2023-08-25T04:21:31.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.742+0000 7f250cedf640 1 -- 172.21.15.55:0/3901282114 learned_addr learned my addr 172.21.15.55:0/3901282114 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:31.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.742+0000 7f250cedf640 1 -- 172.21.15.55:0/3901282114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f250815ca50 msgr2=0x7f25080d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:31.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.742+0000 7f250cedf640 1 --2- 172.21.15.55:0/3901282114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f250815ca50 0x7f25080d0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:31.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.742+0000 7f250cedf640 1 -- 172.21.15.55:0/3901282114 >> v1:172.21.15.110:6789/0 conn(0x7f250806c150 legacy=0x7f25080b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:31.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.742+0000 7f250cedf640 1 -- 172.21.15.55:0/3901282114 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25080af4f0 con 0x7f25080d0f50 2023-08-25T04:21:31.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.742+0000 7f250d6e0640 1 --2- 172.21.15.55:0/3901282114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f250815ca50 0x7f25080d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:31.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.746+0000 7f250cedf640 1 --2- 172.21.15.55:0/3901282114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25080d0f50 0x7f250806bc10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009870 tx=0x7f24f801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd47791869a3eda3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:31.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.746+0000 7f24fffff640 1 -- 172.21.15.55:0/3901282114 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f80aa670 con 0x7f25080d0f50 2023-08-25T04:21:31.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.746+0000 7f24fffff640 1 -- 172.21.15.55:0/3901282114 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f80aa7d0 con 0x7f25080d0f50 2023-08-25T04:21:31.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.746+0000 7f24fffff640 1 -- 172.21.15.55:0/3901282114 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f80aab60 con 0x7f25080d0f50 2023-08-25T04:21:31.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.746+0000 7f250e6e2640 1 -- 172.21.15.55:0/3901282114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25080d0f50 msgr2=0x7f250806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:31.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.746+0000 7f250e6e2640 1 --2- 172.21.15.55:0/3901282114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25080d0f50 0x7f250806bc10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009870 tx=0x7f24f801c510 comp rx=0 tx=0).stop 2023-08-25T04:21:31.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.746+0000 7f250e6e2640 1 -- 172.21.15.55:0/3901282114 shutdown_connections 2023-08-25T04:21:31.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.746+0000 7f250e6e2640 1 --2- 172.21.15.55:0/3901282114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25080d0f50 0x7f250806bc10 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:31.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.746+0000 7f250e6e2640 1 --2- 172.21.15.55:0/3901282114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f250815ca50 0x7f25080d0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:31.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.746+0000 7f250e6e2640 1 -- 172.21.15.55:0/3901282114 >> 172.21.15.55:0/3901282114 conn(0x7f2508065f40 msgr2=0x7f250809b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:31.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.746+0000 7f250e6e2640 1 -- 172.21.15.55:0/3901282114 shutdown_connections 2023-08-25T04:21:31.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.746+0000 7f250e6e2640 1 -- 172.21.15.55:0/3901282114 wait complete. 2023-08-25T04:21:31.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.746+0000 7f250e6e2640 1 Processor -- start 2023-08-25T04:21:31.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.746+0000 7f250e6e2640 1 -- start start 2023-08-25T04:21:31.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250e6e2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f250806c150 0x7f2508156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:31.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250e6e2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25080d0f50 0x7f2508157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:31.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250e6e2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f250815ca50 0x7f250815ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250e6e2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25081f9060 con 0x7f250815ca50 2023-08-25T04:21:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250e6e2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25081f8190 con 0x7f25080d0f50 2023-08-25T04:21:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250e6e2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25081f83e0 con 0x7f250806c150 2023-08-25T04:21:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250dee1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f250815ca50 0x7f250815ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250dee1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f250815ca50 0x7f250815ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44480/0 (socket says 172.21.15.55:44480) 2023-08-25T04:21:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250dee1640 1 -- 172.21.15.55:0/3603150654 learned_addr learned my addr 172.21.15.55:0/3603150654 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250d6e0640 1 --2- 172.21.15.55:0/3603150654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f250806c150 0x7f2508156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:31.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250cedf640 1 --2- 172.21.15.55:0/3603150654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25080d0f50 0x7f2508157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:31.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250dee1640 1 -- 172.21.15.55:0/3603150654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f250806c150 msgr2=0x7f2508156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:31.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250dee1640 1 --2- 172.21.15.55:0/3603150654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f250806c150 0x7f2508156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:31.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250dee1640 1 -- 172.21.15.55:0/3603150654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25080d0f50 msgr2=0x7f2508157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:31.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250dee1640 1 --2- 172.21.15.55:0/3603150654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25080d0f50 0x7f2508157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:31.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250dee1640 1 -- 172.21.15.55:0/3603150654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25040093b0 con 0x7f250815ca50 2023-08-25T04:21:31.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250dee1640 1 --2- 172.21.15.55:0/3603150654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f250815ca50 0x7f250815ac10 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f250000c770 tx=0x7f250000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:31.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f24fdffb640 1 -- 172.21.15.55:0/3603150654 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2500003b80 con 0x7f250815ca50 2023-08-25T04:21:31.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f24fdffb640 1 -- 172.21.15.55:0/3603150654 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2500003ce0 con 0x7f250815ca50 2023-08-25T04:21:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f24fdffb640 1 -- 172.21.15.55:0/3603150654 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250000aa90 con 0x7f250815ca50 2023-08-25T04:21:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250e6e2640 1 -- 172.21.15.55:0/3603150654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f80094d0 con 0x7f250815ca50 2023-08-25T04:21:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250e6e2640 1 -- 172.21.15.55:0/3603150654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25081f89a0 con 0x7f250815ca50 2023-08-25T04:21:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f250e6e2640 1 -- 172.21.15.55:0/3603150654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2508073e50 con 0x7f250815ca50 2023-08-25T04:21:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.750+0000 7f24fdffb640 1 -- 172.21.15.55:0/3603150654 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f250000abf0 con 0x7f250815ca50 2023-08-25T04:21:31.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.754+0000 7f24fdffb640 1 --2- 172.21.15.55:0/3603150654 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f24ec0657a0 0x7f24ec067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:31.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.754+0000 7f24fdffb640 1 -- 172.21.15.55:0/3603150654 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2500082c70 con 0x7f250815ca50 2023-08-25T04:21:31.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.754+0000 7f250d6e0640 1 --2- 172.21.15.55:0/3603150654 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f24ec0657a0 0x7f24ec067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:31.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.754+0000 7f250d6e0640 1 --2- 172.21.15.55:0/3603150654 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f24ec0657a0 0x7f24ec067c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2504009c30 tx=0x7f2504006f90 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:31.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.758+0000 7f24fdffb640 1 -- 172.21.15.55:0/3603150654 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f25000506c0 con 0x7f250815ca50 2023-08-25T04:21:31.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.910+0000 7f250e6e2640 1 -- 172.21.15.55:0/3603150654 --> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2508169470 con 0x7f24ec0657a0 2023-08-25T04:21:31.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.922+0000 7f24fdffb640 1 -- 172.21.15.55:0/3603150654 <== mgr.6902 v2:172.21.15.110:6832/4272914017 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311560 (secure 0 0 0) 0x7f2504009880 con 0x7f24ec0657a0 2023-08-25T04:21:31.922 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:31.923 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:21:31.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.922+0000 7f250e6e2640 1 -- 172.21.15.55:0/3603150654 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f24ec0657a0 msgr2=0x7f24ec067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:31.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.922+0000 7f250e6e2640 1 --2- 172.21.15.55:0/3603150654 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f24ec0657a0 0x7f24ec067c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2504009c30 tx=0x7f2504006f90 comp rx=0 tx=0).stop 2023-08-25T04:21:31.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.922+0000 7f250e6e2640 1 -- 172.21.15.55:0/3603150654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f250815ca50 msgr2=0x7f250815ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:31.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.922+0000 7f250e6e2640 1 --2- 172.21.15.55:0/3603150654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f250815ca50 0x7f250815ac10 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f250000c770 tx=0x7f250000cc30 comp rx=0 tx=0).stop 2023-08-25T04:21:31.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.926+0000 7f250e6e2640 1 -- 172.21.15.55:0/3603150654 shutdown_connections 2023-08-25T04:21:31.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.926+0000 7f250e6e2640 1 --2- 172.21.15.55:0/3603150654 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f24ec0657a0 0x7f24ec067c60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:31.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.926+0000 7f250e6e2640 1 --2- 172.21.15.55:0/3603150654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f250815ca50 0x7f250815ac10 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:31.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.926+0000 7f250e6e2640 1 --2- 172.21.15.55:0/3603150654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25080d0f50 0x7f2508157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:31.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.926+0000 7f250e6e2640 1 --2- 172.21.15.55:0/3603150654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f250806c150 0x7f2508156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:31.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.926+0000 7f250e6e2640 1 -- 172.21.15.55:0/3603150654 >> 172.21.15.55:0/3603150654 conn(0x7f2508065f40 msgr2=0x7f25081557b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:31.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.926+0000 7f250e6e2640 1 -- 172.21.15.55:0/3603150654 shutdown_connections 2023-08-25T04:21:31.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:31.926+0000 7f250e6e2640 1 -- 172.21.15.55:0/3603150654 wait complete. 2023-08-25T04:21:31.943 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-08-25T04:21:31.544783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1040,"num_read_kb":2137,"num_write":390,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3571,"ondisk_log_size":3571,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":327612,"kb_used_data":12936,"kb_used_omap":13,"kb_used_meta":314546,"kb_avail":754647108,"statfs":{"total":773094113280,"available":772758638592,"internally_reserved":0,"allocated":13246464,"data_stored":7162684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":322095192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.664599"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.411058+0000","last_change":"2023-08-25T04:21:22.902603+0000","last_active":"2023-08-25T04:21:24.411058+0000","last_peered":"2023-08-25T04:21:24.411058+0000","last_clean":"2023-08-25T04:21:24.411058+0000","last_became_active":"2023-08-25T04:21:22.902327+0000","last_became_peered":"2023-08-25T04:21:22.902327+0000","last_unstale":"2023-08-25T04:21:24.411058+0000","last_undegraded":"2023-08-25T04:21:24.411058+0000","last_fullsized":"2023-08-25T04:21:24.411058+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:17:32.859729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904117+0000","last_change":"2023-08-25T04:21:22.892480+0000","last_active":"2023-08-25T04:21:23.904117+0000","last_peered":"2023-08-25T04:21:23.904117+0000","last_clean":"2023-08-25T04:21:23.904117+0000","last_became_active":"2023-08-25T04:21:22.892212+0000","last_became_peered":"2023-08-25T04:21:22.892212+0000","last_unstale":"2023-08-25T04:21:23.904117+0000","last_undegraded":"2023-08-25T04:21:23.904117+0000","last_fullsized":"2023-08-25T04:21:23.904117+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:29:04.735498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410767+0000","last_change":"2023-08-25T04:21:22.910439+0000","last_active":"2023-08-25T04:21:24.410767+0000","last_peered":"2023-08-25T04:21:24.410767+0000","last_clean":"2023-08-25T04:21:24.410767+0000","last_became_active":"2023-08-25T04:21:22.909347+0000","last_became_peered":"2023-08-25T04:21:22.909347+0000","last_unstale":"2023-08-25T04:21:24.410767+0000","last_undegraded":"2023-08-25T04:21:24.410767+0000","last_fullsized":"2023-08-25T04:21:24.410767+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:56:56.750725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841365+0000","last_change":"2023-08-25T04:21:22.910060+0000","last_active":"2023-08-25T04:21:25.841365+0000","last_peered":"2023-08-25T04:21:25.841365+0000","last_clean":"2023-08-25T04:21:25.841365+0000","last_became_active":"2023-08-25T04:21:22.909773+0000","last_became_peered":"2023-08-25T04:21:22.909773+0000","last_unstale":"2023-08-25T04:21:25.841365+0000","last_undegraded":"2023-08-25T04:21:25.841365+0000","last_fullsized":"2023-08-25T04:21:25.841365+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:13:48.732464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904196+0000","last_change":"2023-08-25T04:21:22.894604+0000","last_active":"2023-08-25T04:21:23.904196+0000","last_peered":"2023-08-25T04:21:23.904196+0000","last_clean":"2023-08-25T04:21:23.904196+0000","last_became_active":"2023-08-25T04:21:22.894314+0000","last_became_peered":"2023-08-25T04:21:22.894314+0000","last_unstale":"2023-08-25T04:21:23.904196+0000","last_undegraded":"2023-08-25T04:21:23.904196+0000","last_fullsized":"2023-08-25T04:21:23.904196+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:03.905041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903357+0000","last_change":"2023-08-25T04:21:22.899480+0000","last_active":"2023-08-25T04:21:23.903357+0000","last_peered":"2023-08-25T04:21:23.903357+0000","last_clean":"2023-08-25T04:21:23.903357+0000","last_became_active":"2023-08-25T04:21:22.899192+0000","last_became_peered":"2023-08-25T04:21:22.899192+0000","last_unstale":"2023-08-25T04:21:23.903357+0000","last_undegraded":"2023-08-25T04:21:23.903357+0000","last_fullsized":"2023-08-25T04:21:23.903357+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:25:06.918252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902974+0000","last_change":"2023-08-25T04:21:22.898793+0000","last_active":"2023-08-25T04:21:23.902974+0000","last_peered":"2023-08-25T04:21:23.902974+0000","last_clean":"2023-08-25T04:21:23.902974+0000","last_became_active":"2023-08-25T04:21:22.898479+0000","last_became_peered":"2023-08-25T04:21:22.898479+0000","last_unstale":"2023-08-25T04:21:23.902974+0000","last_undegraded":"2023-08-25T04:21:23.902974+0000","last_fullsized":"2023-08-25T04:21:23.902974+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:37:01.600324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840200+0000","last_change":"2023-08-25T04:21:22.911502+0000","last_active":"2023-08-25T04:21:25.840200+0000","last_peered":"2023-08-25T04:21:25.840200+0000","last_clean":"2023-08-25T04:21:25.840200+0000","last_became_active":"2023-08-25T04:21:22.911155+0000","last_became_peered":"2023-08-25T04:21:22.911155+0000","last_unstale":"2023-08-25T04:21:25.840200+0000","last_undegraded":"2023-08-25T04:21:25.840200+0000","last_fullsized":"2023-08-25T04:21:25.840200+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:03:15.076436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903831+0000","last_change":"2023-08-25T04:21:22.895163+0000","last_active":"2023-08-25T04:21:23.903831+0000","last_peered":"2023-08-25T04:21:23.903831+0000","last_clean":"2023-08-25T04:21:23.903831+0000","last_became_active":"2023-08-25T04:21:22.893540+0000","last_became_peered":"2023-08-25T04:21:22.893540+0000","last_unstale":"2023-08-25T04:21:23.903831+0000","last_undegraded":"2023-08-25T04:21:23.903831+0000","last_fullsized":"2023-08-25T04:21:23.903831+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:42:32.393868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904666+0000","last_change":"2023-08-25T04:21:22.892180+0000","last_active":"2023-08-25T04:21:23.904666+0000","last_peered":"2023-08-25T04:21:23.904666+0000","last_clean":"2023-08-25T04:21:23.904666+0000","last_became_active":"2023-08-25T04:21:22.891881+0000","last_became_peered":"2023-08-25T04:21:22.891881+0000","last_unstale":"2023-08-25T04:21:23.904666+0000","last_undegraded":"2023-08-25T04:21:23.904666+0000","last_fullsized":"2023-08-25T04:21:23.904666+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:12:11.503876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.163109+0000","last_change":"2023-08-25T04:21:22.906007+0000","last_active":"2023-08-25T04:21:25.163109+0000","last_peered":"2023-08-25T04:21:25.163109+0000","last_clean":"2023-08-25T04:21:25.163109+0000","last_became_active":"2023-08-25T04:21:22.905714+0000","last_became_peered":"2023-08-25T04:21:22.905714+0000","last_unstale":"2023-08-25T04:21:25.163109+0000","last_undegraded":"2023-08-25T04:21:25.163109+0000","last_fullsized":"2023-08-25T04:21:25.163109+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:03:09.709617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902915+0000","last_change":"2023-08-25T04:21:22.900150+0000","last_active":"2023-08-25T04:21:23.902915+0000","last_peered":"2023-08-25T04:21:23.902915+0000","last_clean":"2023-08-25T04:21:23.902915+0000","last_became_active":"2023-08-25T04:21:22.899835+0000","last_became_peered":"2023-08-25T04:21:22.899835+0000","last_unstale":"2023-08-25T04:21:23.902915+0000","last_undegraded":"2023-08-25T04:21:23.902915+0000","last_fullsized":"2023-08-25T04:21:23.902915+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:25:00.393029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841208+0000","last_change":"2023-08-25T04:21:22.904721+0000","last_active":"2023-08-25T04:21:25.841208+0000","last_peered":"2023-08-25T04:21:25.841208+0000","last_clean":"2023-08-25T04:21:25.841208+0000","last_became_active":"2023-08-25T04:21:22.904432+0000","last_became_peered":"2023-08-25T04:21:22.904432+0000","last_unstale":"2023-08-25T04:21:25.841208+0000","last_undegraded":"2023-08-25T04:21:25.841208+0000","last_fullsized":"2023-08-25T04:21:25.841208+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:58:46.330006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076344+0000","last_change":"2023-08-25T04:21:22.899174+0000","last_active":"2023-08-25T04:21:24.076344+0000","last_peered":"2023-08-25T04:21:24.076344+0000","last_clean":"2023-08-25T04:21:24.076344+0000","last_became_active":"2023-08-25T04:21:22.898899+0000","last_became_peered":"2023-08-25T04:21:22.898899+0000","last_unstale":"2023-08-25T04:21:24.076344+0000","last_undegraded":"2023-08-25T04:21:24.076344+0000","last_fullsized":"2023-08-25T04:21:24.076344+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:49:33.691484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076314+0000","last_change":"2023-08-25T04:21:22.901474+0000","last_active":"2023-08-25T04:21:24.076314+0000","last_peered":"2023-08-25T04:21:24.076314+0000","last_clean":"2023-08-25T04:21:24.076314+0000","last_became_active":"2023-08-25T04:21:22.901182+0000","last_became_peered":"2023-08-25T04:21:22.901182+0000","last_unstale":"2023-08-25T04:21:24.076314+0000","last_undegraded":"2023-08-25T04:21:24.076314+0000","last_fullsized":"2023-08-25T04:21:24.076314+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:04:43.968782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076298+0000","last_change":"2023-08-25T04:21:22.901170+0000","last_active":"2023-08-25T04:21:24.076298+0000","last_peered":"2023-08-25T04:21:24.076298+0000","last_clean":"2023-08-25T04:21:24.076298+0000","last_became_active":"2023-08-25T04:21:22.900877+0000","last_became_peered":"2023-08-25T04:21:22.900877+0000","last_unstale":"2023-08-25T04:21:24.076298+0000","last_undegraded":"2023-08-25T04:21:24.076298+0000","last_fullsized":"2023-08-25T04:21:24.076298+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:42:03.512215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.411076+0000","last_change":"2023-08-25T04:21:22.910250+0000","last_active":"2023-08-25T04:21:24.411076+0000","last_peered":"2023-08-25T04:21:24.411076+0000","last_clean":"2023-08-25T04:21:24.411076+0000","last_became_active":"2023-08-25T04:21:22.909079+0000","last_became_peered":"2023-08-25T04:21:22.909079+0000","last_unstale":"2023-08-25T04:21:24.411076+0000","last_undegraded":"2023-08-25T04:21:24.411076+0000","last_fullsized":"2023-08-25T04:21:24.411076+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:51:38.166407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904204+0000","last_change":"2023-08-25T04:21:22.898773+0000","last_active":"2023-08-25T04:21:23.904204+0000","last_peered":"2023-08-25T04:21:23.904204+0000","last_clean":"2023-08-25T04:21:23.904204+0000","last_became_active":"2023-08-25T04:21:22.898466+0000","last_became_peered":"2023-08-25T04:21:22.898466+0000","last_unstale":"2023-08-25T04:21:23.904204+0000","last_undegraded":"2023-08-25T04:21:23.904204+0000","last_fullsized":"2023-08-25T04:21:23.904204+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:59:21.946437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410834+0000","last_change":"2023-08-25T04:21:22.914850+0000","last_active":"2023-08-25T04:21:24.410834+0000","last_peered":"2023-08-25T04:21:24.410834+0000","last_clean":"2023-08-25T04:21:24.410834+0000","last_became_active":"2023-08-25T04:21:22.910140+0000","last_became_peered":"2023-08-25T04:21:22.910140+0000","last_unstale":"2023-08-25T04:21:24.410834+0000","last_undegraded":"2023-08-25T04:21:24.410834+0000","last_fullsized":"2023-08-25T04:21:24.410834+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:27:14.211228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903999+0000","last_change":"2023-08-25T04:21:22.893589+0000","last_active":"2023-08-25T04:21:23.903999+0000","last_peered":"2023-08-25T04:21:23.903999+0000","last_clean":"2023-08-25T04:21:23.903999+0000","last_became_active":"2023-08-25T04:21:22.893324+0000","last_became_peered":"2023-08-25T04:21:22.893324+0000","last_unstale":"2023-08-25T04:21:23.903999+0000","last_undegraded":"2023-08-25T04:21:23.903999+0000","last_fullsized":"2023-08-25T04:21:23.903999+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:29:10.680725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840617+0000","last_change":"2023-08-25T04:21:22.904143+0000","last_active":"2023-08-25T04:21:25.840617+0000","last_peered":"2023-08-25T04:21:25.840617+0000","last_clean":"2023-08-25T04:21:25.840617+0000","last_became_active":"2023-08-25T04:21:22.903846+0000","last_became_peered":"2023-08-25T04:21:22.903846+0000","last_unstale":"2023-08-25T04:21:25.840617+0000","last_undegraded":"2023-08-25T04:21:25.840617+0000","last_fullsized":"2023-08-25T04:21:25.840617+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:16:21.898044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904185+0000","last_change":"2023-08-25T04:21:22.904450+0000","last_active":"2023-08-25T04:21:23.904185+0000","last_peered":"2023-08-25T04:21:23.904185+0000","last_clean":"2023-08-25T04:21:23.904185+0000","last_became_active":"2023-08-25T04:21:22.904159+0000","last_became_peered":"2023-08-25T04:21:22.904159+0000","last_unstale":"2023-08-25T04:21:23.904185+0000","last_undegraded":"2023-08-25T04:21:23.904185+0000","last_fullsized":"2023-08-25T04:21:23.904185+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:44:51.607773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410709+0000","last_change":"2023-08-25T04:21:22.909915+0000","last_active":"2023-08-25T04:21:24.410709+0000","last_peered":"2023-08-25T04:21:24.410709+0000","last_clean":"2023-08-25T04:21:24.410709+0000","last_became_active":"2023-08-25T04:21:22.909576+0000","last_became_peered":"2023-08-25T04:21:22.909576+0000","last_unstale":"2023-08-25T04:21:24.410709+0000","last_undegraded":"2023-08-25T04:21:24.410709+0000","last_fullsized":"2023-08-25T04:21:24.410709+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:12:25.327391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903979+0000","last_change":"2023-08-25T04:21:22.904891+0000","last_active":"2023-08-25T04:21:23.903979+0000","last_peered":"2023-08-25T04:21:23.903979+0000","last_clean":"2023-08-25T04:21:23.903979+0000","last_became_active":"2023-08-25T04:21:22.904596+0000","last_became_peered":"2023-08-25T04:21:22.904596+0000","last_unstale":"2023-08-25T04:21:23.903979+0000","last_undegraded":"2023-08-25T04:21:23.903979+0000","last_fullsized":"2023-08-25T04:21:23.903979+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:24:20.422364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903959+0000","last_change":"2023-08-25T04:21:22.902096+0000","last_active":"2023-08-25T04:21:23.903959+0000","last_peered":"2023-08-25T04:21:23.903959+0000","last_clean":"2023-08-25T04:21:23.903959+0000","last_became_active":"2023-08-25T04:21:22.901835+0000","last_became_peered":"2023-08-25T04:21:22.901835+0000","last_unstale":"2023-08-25T04:21:23.903959+0000","last_undegraded":"2023-08-25T04:21:23.903959+0000","last_fullsized":"2023-08-25T04:21:23.903959+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:24:38.098739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903841+0000","last_change":"2023-08-25T04:21:22.889822+0000","last_active":"2023-08-25T04:21:23.903841+0000","last_peered":"2023-08-25T04:21:23.903841+0000","last_clean":"2023-08-25T04:21:23.903841+0000","last_became_active":"2023-08-25T04:21:22.889515+0000","last_became_peered":"2023-08-25T04:21:22.889515+0000","last_unstale":"2023-08-25T04:21:23.903841+0000","last_undegraded":"2023-08-25T04:21:23.903841+0000","last_fullsized":"2023-08-25T04:21:23.903841+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:26:34.858808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.163211+0000","last_change":"2023-08-25T04:21:22.900565+0000","last_active":"2023-08-25T04:21:25.163211+0000","last_peered":"2023-08-25T04:21:25.163211+0000","last_clean":"2023-08-25T04:21:25.163211+0000","last_became_active":"2023-08-25T04:21:22.900258+0000","last_became_peered":"2023-08-25T04:21:22.900258+0000","last_unstale":"2023-08-25T04:21:25.163211+0000","last_undegraded":"2023-08-25T04:21:25.163211+0000","last_fullsized":"2023-08-25T04:21:25.163211+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:43:25.567019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902975+0000","last_change":"2023-08-25T04:21:22.900271+0000","last_active":"2023-08-25T04:21:23.902975+0000","last_peered":"2023-08-25T04:21:23.902975+0000","last_clean":"2023-08-25T04:21:23.902975+0000","last_became_active":"2023-08-25T04:21:22.899973+0000","last_became_peered":"2023-08-25T04:21:22.899973+0000","last_unstale":"2023-08-25T04:21:23.902975+0000","last_undegraded":"2023-08-25T04:21:23.902975+0000","last_fullsized":"2023-08-25T04:21:23.902975+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:09:02.870355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840653+0000","last_change":"2023-08-25T04:21:22.902127+0000","last_active":"2023-08-25T04:21:25.840653+0000","last_peered":"2023-08-25T04:21:25.840653+0000","last_clean":"2023-08-25T04:21:25.840653+0000","last_became_active":"2023-08-25T04:21:22.901771+0000","last_became_peered":"2023-08-25T04:21:22.901771+0000","last_unstale":"2023-08-25T04:21:25.840653+0000","last_undegraded":"2023-08-25T04:21:25.840653+0000","last_fullsized":"2023-08-25T04:21:25.840653+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:54:19.330475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902947+0000","last_change":"2023-08-25T04:21:22.900843+0000","last_active":"2023-08-25T04:21:23.902947+0000","last_peered":"2023-08-25T04:21:23.902947+0000","last_clean":"2023-08-25T04:21:23.902947+0000","last_became_active":"2023-08-25T04:21:22.900609+0000","last_became_peered":"2023-08-25T04:21:22.900609+0000","last_unstale":"2023-08-25T04:21:23.902947+0000","last_undegraded":"2023-08-25T04:21:23.902947+0000","last_fullsized":"2023-08-25T04:21:23.902947+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:41:05.646746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903444+0000","last_change":"2023-08-25T04:21:22.900517+0000","last_active":"2023-08-25T04:21:23.903444+0000","last_peered":"2023-08-25T04:21:23.903444+0000","last_clean":"2023-08-25T04:21:23.903444+0000","last_became_active":"2023-08-25T04:21:22.900167+0000","last_became_peered":"2023-08-25T04:21:22.900167+0000","last_unstale":"2023-08-25T04:21:23.903444+0000","last_undegraded":"2023-08-25T04:21:23.903444+0000","last_fullsized":"2023-08-25T04:21:23.903444+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:27:53.563502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840288+0000","last_change":"2023-08-25T04:21:22.909298+0000","last_active":"2023-08-25T04:21:25.840288+0000","last_peered":"2023-08-25T04:21:25.840288+0000","last_clean":"2023-08-25T04:21:25.840288+0000","last_became_active":"2023-08-25T04:21:22.908951+0000","last_became_peered":"2023-08-25T04:21:22.908951+0000","last_unstale":"2023-08-25T04:21:25.840288+0000","last_undegraded":"2023-08-25T04:21:25.840288+0000","last_fullsized":"2023-08-25T04:21:25.840288+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:15:52.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410890+0000","last_change":"2023-08-25T04:21:22.910846+0000","last_active":"2023-08-25T04:21:24.410890+0000","last_peered":"2023-08-25T04:21:24.410890+0000","last_clean":"2023-08-25T04:21:24.410890+0000","last_became_active":"2023-08-25T04:21:22.910125+0000","last_became_peered":"2023-08-25T04:21:22.910125+0000","last_unstale":"2023-08-25T04:21:24.410890+0000","last_undegraded":"2023-08-25T04:21:24.410890+0000","last_fullsized":"2023-08-25T04:21:24.410890+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:17.993108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"121'4","reported_seq":17,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841112+0000","last_change":"2023-08-25T04:21:21.899936+0000","last_active":"2023-08-25T04:21:25.841112+0000","last_peered":"2023-08-25T04:21:25.841112+0000","last_clean":"2023-08-25T04:21:25.841112+0000","last_became_active":"2023-08-25T04:21:21.899625+0000","last_became_peered":"2023-08-25T04:21:21.899625+0000","last_unstale":"2023-08-25T04:21:25.841112+0000","last_undegraded":"2023-08-25T04:21:25.841112+0000","last_fullsized":"2023-08-25T04:21:25.841112+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:15:19.683497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840332+0000","last_change":"2023-08-25T04:21:22.916091+0000","last_active":"2023-08-25T04:21:25.840332+0000","last_peered":"2023-08-25T04:21:25.840332+0000","last_clean":"2023-08-25T04:21:25.840332+0000","last_became_active":"2023-08-25T04:21:22.915786+0000","last_became_peered":"2023-08-25T04:21:22.915786+0000","last_unstale":"2023-08-25T04:21:25.840332+0000","last_undegraded":"2023-08-25T04:21:25.840332+0000","last_fullsized":"2023-08-25T04:21:25.840332+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:01:10.869152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"121'1","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840867+0000","last_change":"2023-08-25T04:21:21.893141+0000","last_active":"2023-08-25T04:21:25.840867+0000","last_peered":"2023-08-25T04:21:25.840867+0000","last_clean":"2023-08-25T04:21:25.840867+0000","last_became_active":"2023-08-25T04:21:21.892800+0000","last_became_peered":"2023-08-25T04:21:21.892800+0000","last_unstale":"2023-08-25T04:21:25.840867+0000","last_undegraded":"2023-08-25T04:21:25.840867+0000","last_fullsized":"2023-08-25T04:21:25.840867+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:12:31.209352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903083+0000","last_change":"2023-08-25T04:21:22.898537+0000","last_active":"2023-08-25T04:21:23.903083+0000","last_peered":"2023-08-25T04:21:23.903083+0000","last_clean":"2023-08-25T04:21:23.903083+0000","last_became_active":"2023-08-25T04:21:22.898210+0000","last_became_peered":"2023-08-25T04:21:22.898210+0000","last_unstale":"2023-08-25T04:21:23.903083+0000","last_undegraded":"2023-08-25T04:21:23.903083+0000","last_fullsized":"2023-08-25T04:21:23.903083+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:20:03.163872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"121'2","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903734+0000","last_change":"2023-08-25T04:21:21.896120+0000","last_active":"2023-08-25T04:21:23.903734+0000","last_peered":"2023-08-25T04:21:23.903734+0000","last_clean":"2023-08-25T04:21:23.903734+0000","last_became_active":"2023-08-25T04:21:21.895802+0000","last_became_peered":"2023-08-25T04:21:21.895802+0000","last_unstale":"2023-08-25T04:21:23.903734+0000","last_undegraded":"2023-08-25T04:21:23.903734+0000","last_fullsized":"2023-08-25T04:21:23.903734+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:27:08.122614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162960+0000","last_change":"2023-08-25T04:21:22.908560+0000","last_active":"2023-08-25T04:21:25.162960+0000","last_peered":"2023-08-25T04:21:25.162960+0000","last_clean":"2023-08-25T04:21:25.162960+0000","last_became_active":"2023-08-25T04:21:22.908192+0000","last_became_peered":"2023-08-25T04:21:22.908192+0000","last_unstale":"2023-08-25T04:21:25.162960+0000","last_undegraded":"2023-08-25T04:21:25.162960+0000","last_fullsized":"2023-08-25T04:21:25.162960+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:22.279064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"121'2","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904340+0000","last_change":"2023-08-25T04:21:21.897330+0000","last_active":"2023-08-25T04:21:23.904340+0000","last_peered":"2023-08-25T04:21:23.904340+0000","last_clean":"2023-08-25T04:21:23.904340+0000","last_became_active":"2023-08-25T04:21:21.897056+0000","last_became_peered":"2023-08-25T04:21:21.897056+0000","last_unstale":"2023-08-25T04:21:23.904340+0000","last_undegraded":"2023-08-25T04:21:23.904340+0000","last_fullsized":"2023-08-25T04:21:23.904340+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:15:12.842982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841324+0000","last_change":"2023-08-25T04:21:22.914332+0000","last_active":"2023-08-25T04:21:25.841324+0000","last_peered":"2023-08-25T04:21:25.841324+0000","last_clean":"2023-08-25T04:21:25.841324+0000","last_became_active":"2023-08-25T04:21:22.913928+0000","last_became_peered":"2023-08-25T04:21:22.913928+0000","last_unstale":"2023-08-25T04:21:25.841324+0000","last_undegraded":"2023-08-25T04:21:25.841324+0000","last_fullsized":"2023-08-25T04:21:25.841324+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:58:21.611066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"121'1","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076445+0000","last_change":"2023-08-25T04:21:21.900487+0000","last_active":"2023-08-25T04:21:24.076445+0000","last_peered":"2023-08-25T04:21:24.076445+0000","last_clean":"2023-08-25T04:21:24.076445+0000","last_became_active":"2023-08-25T04:21:21.900194+0000","last_became_peered":"2023-08-25T04:21:21.900194+0000","last_unstale":"2023-08-25T04:21:24.076445+0000","last_undegraded":"2023-08-25T04:21:24.076445+0000","last_fullsized":"2023-08-25T04:21:24.076445+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:57:53.962598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.411030+0000","last_change":"2023-08-25T04:21:22.915270+0000","last_active":"2023-08-25T04:21:24.411030+0000","last_peered":"2023-08-25T04:21:24.411030+0000","last_clean":"2023-08-25T04:21:24.411030+0000","last_became_active":"2023-08-25T04:21:22.913744+0000","last_became_peered":"2023-08-25T04:21:22.913744+0000","last_unstale":"2023-08-25T04:21:24.411030+0000","last_undegraded":"2023-08-25T04:21:24.411030+0000","last_fullsized":"2023-08-25T04:21:24.411030+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:58:46.029608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"121'1","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162819+0000","last_change":"2023-08-25T04:21:21.897494+0000","last_active":"2023-08-25T04:21:25.162819+0000","last_peered":"2023-08-25T04:21:25.162819+0000","last_clean":"2023-08-25T04:21:25.162819+0000","last_became_active":"2023-08-25T04:21:21.897149+0000","last_became_peered":"2023-08-25T04:21:21.897149+0000","last_unstale":"2023-08-25T04:21:25.162819+0000","last_undegraded":"2023-08-25T04:21:25.162819+0000","last_fullsized":"2023-08-25T04:21:25.162819+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:04:11.190127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904271+0000","last_change":"2023-08-25T04:21:22.904977+0000","last_active":"2023-08-25T04:21:23.904271+0000","last_peered":"2023-08-25T04:21:23.904271+0000","last_clean":"2023-08-25T04:21:23.904271+0000","last_became_active":"2023-08-25T04:21:22.904612+0000","last_became_peered":"2023-08-25T04:21:22.904612+0000","last_unstale":"2023-08-25T04:21:23.904271+0000","last_undegraded":"2023-08-25T04:21:23.904271+0000","last_fullsized":"2023-08-25T04:21:23.904271+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:42:42.031026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902917+0000","last_change":"2023-08-25T04:21:21.895812+0000","last_active":"2023-08-25T04:21:23.902917+0000","last_peered":"2023-08-25T04:21:23.902917+0000","last_clean":"2023-08-25T04:21:23.902917+0000","last_became_active":"2023-08-25T04:21:21.895473+0000","last_became_peered":"2023-08-25T04:21:21.895473+0000","last_unstale":"2023-08-25T04:21:23.902917+0000","last_undegraded":"2023-08-25T04:21:23.902917+0000","last_fullsized":"2023-08-25T04:21:23.902917+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:23:23.072929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841106+0000","last_change":"2023-08-25T04:21:22.902808+0000","last_active":"2023-08-25T04:21:25.841106+0000","last_peered":"2023-08-25T04:21:25.841106+0000","last_clean":"2023-08-25T04:21:25.841106+0000","last_became_active":"2023-08-25T04:21:22.902536+0000","last_became_peered":"2023-08-25T04:21:22.902536+0000","last_unstale":"2023-08-25T04:21:25.841106+0000","last_undegraded":"2023-08-25T04:21:25.841106+0000","last_fullsized":"2023-08-25T04:21:25.841106+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:42:06.495784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840581+0000","last_change":"2023-08-25T04:21:21.900803+0000","last_active":"2023-08-25T04:21:25.840581+0000","last_peered":"2023-08-25T04:21:25.840581+0000","last_clean":"2023-08-25T04:21:25.840581+0000","last_became_active":"2023-08-25T04:21:21.900423+0000","last_became_peered":"2023-08-25T04:21:21.900423+0000","last_unstale":"2023-08-25T04:21:25.840581+0000","last_undegraded":"2023-08-25T04:21:25.840581+0000","last_fullsized":"2023-08-25T04:21:25.840581+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:28:18.099804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410801+0000","last_change":"2023-08-25T04:21:22.913903+0000","last_active":"2023-08-25T04:21:24.410801+0000","last_peered":"2023-08-25T04:21:24.410801+0000","last_clean":"2023-08-25T04:21:24.410801+0000","last_became_active":"2023-08-25T04:21:22.910534+0000","last_became_peered":"2023-08-25T04:21:22.910534+0000","last_unstale":"2023-08-25T04:21:24.410801+0000","last_undegraded":"2023-08-25T04:21:24.410801+0000","last_fullsized":"2023-08-25T04:21:24.410801+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:39:37.908542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903950+0000","last_change":"2023-08-25T04:21:21.896785+0000","last_active":"2023-08-25T04:21:23.903950+0000","last_peered":"2023-08-25T04:21:23.903950+0000","last_clean":"2023-08-25T04:21:23.903950+0000","last_became_active":"2023-08-25T04:21:21.896250+0000","last_became_peered":"2023-08-25T04:21:21.896250+0000","last_unstale":"2023-08-25T04:21:23.903950+0000","last_undegraded":"2023-08-25T04:21:23.903950+0000","last_fullsized":"2023-08-25T04:21:23.903950+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:39:26.103990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904017+0000","last_change":"2023-08-25T04:21:22.906785+0000","last_active":"2023-08-25T04:21:23.904017+0000","last_peered":"2023-08-25T04:21:23.904017+0000","last_clean":"2023-08-25T04:21:23.904017+0000","last_became_active":"2023-08-25T04:21:22.905604+0000","last_became_peered":"2023-08-25T04:21:22.905604+0000","last_unstale":"2023-08-25T04:21:23.904017+0000","last_undegraded":"2023-08-25T04:21:23.904017+0000","last_fullsized":"2023-08-25T04:21:23.904017+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:07:02.772070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410927+0000","last_change":"2023-08-25T04:21:21.904376+0000","last_active":"2023-08-25T04:21:24.410927+0000","last_peered":"2023-08-25T04:21:24.410927+0000","last_clean":"2023-08-25T04:21:24.410927+0000","last_became_active":"2023-08-25T04:21:21.904102+0000","last_became_peered":"2023-08-25T04:21:21.904102+0000","last_unstale":"2023-08-25T04:21:24.410927+0000","last_undegraded":"2023-08-25T04:21:24.410927+0000","last_fullsized":"2023-08-25T04:21:24.410927+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:26:24.990460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840462+0000","last_change":"2023-08-25T04:21:22.901342+0000","last_active":"2023-08-25T04:21:25.840462+0000","last_peered":"2023-08-25T04:21:25.840462+0000","last_clean":"2023-08-25T04:21:25.840462+0000","last_became_active":"2023-08-25T04:21:22.900963+0000","last_became_peered":"2023-08-25T04:21:22.900963+0000","last_unstale":"2023-08-25T04:21:25.840462+0000","last_undegraded":"2023-08-25T04:21:25.840462+0000","last_fullsized":"2023-08-25T04:21:25.840462+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:22:10.110622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"121'3","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076512+0000","last_change":"2023-08-25T04:21:21.902909+0000","last_active":"2023-08-25T04:21:24.076512+0000","last_peered":"2023-08-25T04:21:24.076512+0000","last_clean":"2023-08-25T04:21:24.076512+0000","last_became_active":"2023-08-25T04:21:21.902545+0000","last_became_peered":"2023-08-25T04:21:21.902545+0000","last_unstale":"2023-08-25T04:21:24.076512+0000","last_undegraded":"2023-08-25T04:21:24.076512+0000","last_fullsized":"2023-08-25T04:21:24.076512+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:09:15.210507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904324+0000","last_change":"2023-08-25T04:21:22.902324+0000","last_active":"2023-08-25T04:21:23.904324+0000","last_peered":"2023-08-25T04:21:23.904324+0000","last_clean":"2023-08-25T04:21:23.904324+0000","last_became_active":"2023-08-25T04:21:22.902041+0000","last_became_peered":"2023-08-25T04:21:22.902041+0000","last_unstale":"2023-08-25T04:21:23.904324+0000","last_undegraded":"2023-08-25T04:21:23.904324+0000","last_fullsized":"2023-08-25T04:21:23.904324+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:06:37.497907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"121'6","reported_seq":19,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903081+0000","last_change":"2023-08-25T04:21:21.900886+0000","last_active":"2023-08-25T04:21:23.903081+0000","last_peered":"2023-08-25T04:21:23.903081+0000","last_clean":"2023-08-25T04:21:23.903081+0000","last_became_active":"2023-08-25T04:21:21.900551+0000","last_became_peered":"2023-08-25T04:21:21.900551+0000","last_unstale":"2023-08-25T04:21:23.903081+0000","last_undegraded":"2023-08-25T04:21:23.903081+0000","last_fullsized":"2023-08-25T04:21:23.903081+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:23:38.270992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162893+0000","last_change":"2023-08-25T04:21:22.903988+0000","last_active":"2023-08-25T04:21:25.162893+0000","last_peered":"2023-08-25T04:21:25.162893+0000","last_clean":"2023-08-25T04:21:25.162893+0000","last_became_active":"2023-08-25T04:21:22.903724+0000","last_became_peered":"2023-08-25T04:21:22.903724+0000","last_unstale":"2023-08-25T04:21:25.162893+0000","last_undegraded":"2023-08-25T04:21:25.162893+0000","last_fullsized":"2023-08-25T04:21:25.162893+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:03:42.498327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"121'2","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904362+0000","last_change":"2023-08-25T04:21:21.905116+0000","last_active":"2023-08-25T04:21:23.904362+0000","last_peered":"2023-08-25T04:21:23.904362+0000","last_clean":"2023-08-25T04:21:23.904362+0000","last_became_active":"2023-08-25T04:21:21.904844+0000","last_became_peered":"2023-08-25T04:21:21.904844+0000","last_unstale":"2023-08-25T04:21:23.904362+0000","last_undegraded":"2023-08-25T04:21:23.904362+0000","last_fullsized":"2023-08-25T04:21:23.904362+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:58:29.301464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903587+0000","last_change":"2023-08-25T04:21:22.898823+0000","last_active":"2023-08-25T04:21:23.903587+0000","last_peered":"2023-08-25T04:21:23.903587+0000","last_clean":"2023-08-25T04:21:23.903587+0000","last_became_active":"2023-08-25T04:21:22.898537+0000","last_became_peered":"2023-08-25T04:21:22.898537+0000","last_unstale":"2023-08-25T04:21:23.903587+0000","last_undegraded":"2023-08-25T04:21:23.903587+0000","last_fullsized":"2023-08-25T04:21:23.903587+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:33:39.849943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841204+0000","last_change":"2023-08-25T04:21:21.899098+0000","last_active":"2023-08-25T04:21:25.841204+0000","last_peered":"2023-08-25T04:21:25.841204+0000","last_clean":"2023-08-25T04:21:25.841204+0000","last_became_active":"2023-08-25T04:21:21.898766+0000","last_became_peered":"2023-08-25T04:21:21.898766+0000","last_unstale":"2023-08-25T04:21:25.841204+0000","last_undegraded":"2023-08-25T04:21:25.841204+0000","last_fullsized":"2023-08-25T04:21:25.841204+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:44:11.564456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840804+0000","last_change":"2023-08-25T04:21:22.909026+0000","last_active":"2023-08-25T04:21:25.840804+0000","last_peered":"2023-08-25T04:21:25.840804+0000","last_clean":"2023-08-25T04:21:25.840804+0000","last_became_active":"2023-08-25T04:21:22.908495+0000","last_became_peered":"2023-08-25T04:21:22.908495+0000","last_unstale":"2023-08-25T04:21:25.840804+0000","last_undegraded":"2023-08-25T04:21:25.840804+0000","last_fullsized":"2023-08-25T04:21:25.840804+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:14:51.718532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840422+0000","last_change":"2023-08-25T04:21:21.898251+0000","last_active":"2023-08-25T04:21:25.840422+0000","last_peered":"2023-08-25T04:21:25.840422+0000","last_clean":"2023-08-25T04:21:25.840422+0000","last_became_active":"2023-08-25T04:21:21.897984+0000","last_became_peered":"2023-08-25T04:21:21.897984+0000","last_unstale":"2023-08-25T04:21:25.840422+0000","last_undegraded":"2023-08-25T04:21:25.840422+0000","last_fullsized":"2023-08-25T04:21:25.840422+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:41:07.834007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.411139+0000","last_change":"2023-08-25T04:21:22.910451+0000","last_active":"2023-08-25T04:21:24.411139+0000","last_peered":"2023-08-25T04:21:24.411139+0000","last_clean":"2023-08-25T04:21:24.411139+0000","last_became_active":"2023-08-25T04:21:22.909110+0000","last_became_peered":"2023-08-25T04:21:22.909110+0000","last_unstale":"2023-08-25T04:21:24.411139+0000","last_undegraded":"2023-08-25T04:21:24.411139+0000","last_fullsized":"2023-08-25T04:21:24.411139+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:13:10.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"121'8","reported_seq":21,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902573+0000","last_change":"2023-08-25T04:21:21.896664+0000","last_active":"2023-08-25T04:21:23.902573+0000","last_peered":"2023-08-25T04:21:23.902573+0000","last_clean":"2023-08-25T04:21:23.902573+0000","last_became_active":"2023-08-25T04:21:21.896158+0000","last_became_peered":"2023-08-25T04:21:21.896158+0000","last_unstale":"2023-08-25T04:21:23.902573+0000","last_undegraded":"2023-08-25T04:21:23.902573+0000","last_fullsized":"2023-08-25T04:21:23.902573+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:53:23.641692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410675+0000","last_change":"2023-08-25T04:21:22.903079+0000","last_active":"2023-08-25T04:21:24.410675+0000","last_peered":"2023-08-25T04:21:24.410675+0000","last_clean":"2023-08-25T04:21:24.410675+0000","last_became_active":"2023-08-25T04:21:22.902772+0000","last_became_peered":"2023-08-25T04:21:22.902772+0000","last_unstale":"2023-08-25T04:21:24.410675+0000","last_undegraded":"2023-08-25T04:21:24.410675+0000","last_fullsized":"2023-08-25T04:21:24.410675+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:46:54.200389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"121'2","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904616+0000","last_change":"2023-08-25T04:21:21.903246+0000","last_active":"2023-08-25T04:21:23.904616+0000","last_peered":"2023-08-25T04:21:23.904616+0000","last_clean":"2023-08-25T04:21:23.904616+0000","last_became_active":"2023-08-25T04:21:21.902949+0000","last_became_peered":"2023-08-25T04:21:21.902949+0000","last_unstale":"2023-08-25T04:21:23.904616+0000","last_undegraded":"2023-08-25T04:21:23.904616+0000","last_fullsized":"2023-08-25T04:21:23.904616+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:15:50.106769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.902792+0000","last_change":"2023-08-25T04:21:22.894828+0000","last_active":"2023-08-25T04:21:23.902792+0000","last_peered":"2023-08-25T04:21:23.902792+0000","last_clean":"2023-08-25T04:21:23.902792+0000","last_became_active":"2023-08-25T04:21:22.894508+0000","last_became_peered":"2023-08-25T04:21:22.894508+0000","last_unstale":"2023-08-25T04:21:23.902792+0000","last_undegraded":"2023-08-25T04:21:23.902792+0000","last_fullsized":"2023-08-25T04:21:23.902792+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:21:06.670524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"122'1","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.411105+0000","last_change":"2023-08-25T04:21:21.901910+0000","last_active":"2023-08-25T04:21:24.411105+0000","last_peered":"2023-08-25T04:21:24.411105+0000","last_clean":"2023-08-25T04:21:24.411105+0000","last_became_active":"2023-08-25T04:21:21.901498+0000","last_became_peered":"2023-08-25T04:21:21.901498+0000","last_unstale":"2023-08-25T04:21:24.411105+0000","last_undegraded":"2023-08-25T04:21:24.411105+0000","last_fullsized":"2023-08-25T04:21:24.411105+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:00:15.013692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841079+0000","last_change":"2023-08-25T04:21:22.907540+0000","last_active":"2023-08-25T04:21:25.841079+0000","last_peered":"2023-08-25T04:21:25.841079+0000","last_clean":"2023-08-25T04:21:25.841079+0000","last_became_active":"2023-08-25T04:21:22.907269+0000","last_became_peered":"2023-08-25T04:21:22.907269+0000","last_unstale":"2023-08-25T04:21:25.841079+0000","last_undegraded":"2023-08-25T04:21:25.841079+0000","last_fullsized":"2023-08-25T04:21:25.841079+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:05:42.134636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903637+0000","last_change":"2023-08-25T04:21:21.897043+0000","last_active":"2023-08-25T04:21:23.903637+0000","last_peered":"2023-08-25T04:21:23.903637+0000","last_clean":"2023-08-25T04:21:23.903637+0000","last_became_active":"2023-08-25T04:21:21.896732+0000","last_became_peered":"2023-08-25T04:21:21.896732+0000","last_unstale":"2023-08-25T04:21:23.903637+0000","last_undegraded":"2023-08-25T04:21:23.903637+0000","last_fullsized":"2023-08-25T04:21:23.903637+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:23:56.687199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162960+0000","last_change":"2023-08-25T04:21:22.907863+0000","last_active":"2023-08-25T04:21:25.162960+0000","last_peered":"2023-08-25T04:21:25.162960+0000","last_clean":"2023-08-25T04:21:25.162960+0000","last_became_active":"2023-08-25T04:21:22.907427+0000","last_became_peered":"2023-08-25T04:21:22.907427+0000","last_unstale":"2023-08-25T04:21:25.162960+0000","last_undegraded":"2023-08-25T04:21:25.162960+0000","last_fullsized":"2023-08-25T04:21:25.162960+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:40.590057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904657+0000","last_change":"2023-08-25T04:21:21.899448+0000","last_active":"2023-08-25T04:21:23.904657+0000","last_peered":"2023-08-25T04:21:23.904657+0000","last_clean":"2023-08-25T04:21:23.904657+0000","last_became_active":"2023-08-25T04:21:21.899162+0000","last_became_peered":"2023-08-25T04:21:21.899162+0000","last_unstale":"2023-08-25T04:21:23.904657+0000","last_undegraded":"2023-08-25T04:21:23.904657+0000","last_fullsized":"2023-08-25T04:21:23.904657+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:10:45.794596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840819+0000","last_change":"2023-08-25T04:21:22.916377+0000","last_active":"2023-08-25T04:21:25.840819+0000","last_peered":"2023-08-25T04:21:25.840819+0000","last_clean":"2023-08-25T04:21:25.840819+0000","last_became_active":"2023-08-25T04:21:22.915939+0000","last_became_peered":"2023-08-25T04:21:22.915939+0000","last_unstale":"2023-08-25T04:21:25.840819+0000","last_undegraded":"2023-08-25T04:21:25.840819+0000","last_fullsized":"2023-08-25T04:21:25.840819+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:23:34.902641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903453+0000","last_change":"2023-08-25T04:21:21.893809+0000","last_active":"2023-08-25T04:21:23.903453+0000","last_peered":"2023-08-25T04:21:23.903453+0000","last_clean":"2023-08-25T04:21:23.903453+0000","last_became_active":"2023-08-25T04:21:21.893520+0000","last_became_peered":"2023-08-25T04:21:21.893520+0000","last_unstale":"2023-08-25T04:21:23.903453+0000","last_undegraded":"2023-08-25T04:21:23.903453+0000","last_fullsized":"2023-08-25T04:21:23.903453+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:43:16.462790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840847+0000","last_change":"2023-08-25T04:21:22.900921+0000","last_active":"2023-08-25T04:21:25.840847+0000","last_peered":"2023-08-25T04:21:25.840847+0000","last_clean":"2023-08-25T04:21:25.840847+0000","last_became_active":"2023-08-25T04:21:22.900466+0000","last_became_peered":"2023-08-25T04:21:22.900466+0000","last_unstale":"2023-08-25T04:21:25.840847+0000","last_undegraded":"2023-08-25T04:21:25.840847+0000","last_fullsized":"2023-08-25T04:21:25.840847+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:09:07.904186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840592+0000","last_change":"2023-08-25T04:21:21.897723+0000","last_active":"2023-08-25T04:21:25.840592+0000","last_peered":"2023-08-25T04:21:25.840592+0000","last_clean":"2023-08-25T04:21:25.840592+0000","last_became_active":"2023-08-25T04:21:21.897454+0000","last_became_peered":"2023-08-25T04:21:21.897454+0000","last_unstale":"2023-08-25T04:21:25.840592+0000","last_undegraded":"2023-08-25T04:21:25.840592+0000","last_fullsized":"2023-08-25T04:21:25.840592+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:34:44.246278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076639+0000","last_change":"2023-08-25T04:21:22.903968+0000","last_active":"2023-08-25T04:21:24.076639+0000","last_peered":"2023-08-25T04:21:24.076639+0000","last_clean":"2023-08-25T04:21:24.076639+0000","last_became_active":"2023-08-25T04:21:22.903669+0000","last_became_peered":"2023-08-25T04:21:22.903669+0000","last_unstale":"2023-08-25T04:21:24.076639+0000","last_undegraded":"2023-08-25T04:21:24.076639+0000","last_fullsized":"2023-08-25T04:21:24.076639+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:11.463372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903246+0000","last_change":"2023-08-25T04:21:21.897193+0000","last_active":"2023-08-25T04:21:23.903246+0000","last_peered":"2023-08-25T04:21:23.903246+0000","last_clean":"2023-08-25T04:21:23.903246+0000","last_became_active":"2023-08-25T04:21:21.896858+0000","last_became_peered":"2023-08-25T04:21:21.896858+0000","last_unstale":"2023-08-25T04:21:23.903246+0000","last_undegraded":"2023-08-25T04:21:23.903246+0000","last_fullsized":"2023-08-25T04:21:23.903246+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:23:32.684612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.163362+0000","last_change":"2023-08-25T04:21:22.901384+0000","last_active":"2023-08-25T04:21:25.163362+0000","last_peered":"2023-08-25T04:21:25.163362+0000","last_clean":"2023-08-25T04:21:25.163362+0000","last_became_active":"2023-08-25T04:21:22.901073+0000","last_became_peered":"2023-08-25T04:21:22.901073+0000","last_unstale":"2023-08-25T04:21:25.163362+0000","last_undegraded":"2023-08-25T04:21:25.163362+0000","last_fullsized":"2023-08-25T04:21:25.163362+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:01:08.975856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841028+0000","last_change":"2023-08-25T04:21:21.896102+0000","last_active":"2023-08-25T04:21:25.841028+0000","last_peered":"2023-08-25T04:21:25.841028+0000","last_clean":"2023-08-25T04:21:25.841028+0000","last_became_active":"2023-08-25T04:21:21.895635+0000","last_became_peered":"2023-08-25T04:21:21.895635+0000","last_unstale":"2023-08-25T04:21:25.841028+0000","last_undegraded":"2023-08-25T04:21:25.841028+0000","last_fullsized":"2023-08-25T04:21:25.841028+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:06:47.686562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162827+0000","last_change":"2023-08-25T04:21:22.900419+0000","last_active":"2023-08-25T04:21:25.162827+0000","last_peered":"2023-08-25T04:21:25.162827+0000","last_clean":"2023-08-25T04:21:25.162827+0000","last_became_active":"2023-08-25T04:21:22.900107+0000","last_became_peered":"2023-08-25T04:21:22.900107+0000","last_unstale":"2023-08-25T04:21:25.162827+0000","last_undegraded":"2023-08-25T04:21:25.162827+0000","last_fullsized":"2023-08-25T04:21:25.162827+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:13:10.090454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"121'2","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840902+0000","last_change":"2023-08-25T04:21:21.900342+0000","last_active":"2023-08-25T04:21:25.840902+0000","last_peered":"2023-08-25T04:21:25.840902+0000","last_clean":"2023-08-25T04:21:25.840902+0000","last_became_active":"2023-08-25T04:21:21.899299+0000","last_became_peered":"2023-08-25T04:21:21.899299+0000","last_unstale":"2023-08-25T04:21:25.840902+0000","last_undegraded":"2023-08-25T04:21:25.840902+0000","last_fullsized":"2023-08-25T04:21:25.840902+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:56:15.651762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"111'3532","reported_seq":4056,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076405+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:21:24.076405+0000","last_peered":"2023-08-25T04:21:24.076405+0000","last_clean":"2023-08-25T04:21:24.076405+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:21:24.076405+0000","last_undegraded":"2023-08-25T04:21:24.076405+0000","last_fullsized":"2023-08-25T04:21:24.076405+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3532,"log_dups_size":0,"ondisk_log_size":3532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:49:26.318209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1040,"num_read_kb":2137,"num_write":345,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":187,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.163082+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:21:25.163082+0000","last_peered":"2023-08-25T04:21:25.163082+0000","last_clean":"2023-08-25T04:21:25.163082+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:21:25.163082+0000","last_undegraded":"2023-08-25T04:21:25.163082+0000","last_fullsized":"2023-08-25T04:21:25.163082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:35:51.566579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903521+0000","last_change":"2023-08-25T04:21:22.897658+0000","last_active":"2023-08-25T04:21:23.903521+0000","last_peered":"2023-08-25T04:21:23.903521+0000","last_clean":"2023-08-25T04:21:23.903521+0000","last_became_active":"2023-08-25T04:21:22.897340+0000","last_became_peered":"2023-08-25T04:21:22.897340+0000","last_unstale":"2023-08-25T04:21:23.903521+0000","last_undegraded":"2023-08-25T04:21:23.903521+0000","last_fullsized":"2023-08-25T04:21:23.903521+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:02:42.501230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"121'1","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076650+0000","last_change":"2023-08-25T04:21:21.900979+0000","last_active":"2023-08-25T04:21:24.076650+0000","last_peered":"2023-08-25T04:21:24.076650+0000","last_clean":"2023-08-25T04:21:24.076650+0000","last_became_active":"2023-08-25T04:21:21.900548+0000","last_became_peered":"2023-08-25T04:21:21.900548+0000","last_unstale":"2023-08-25T04:21:24.076650+0000","last_undegraded":"2023-08-25T04:21:24.076650+0000","last_fullsized":"2023-08-25T04:21:24.076650+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:10.087987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":190,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076231+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:21:24.076231+0000","last_peered":"2023-08-25T04:21:24.076231+0000","last_clean":"2023-08-25T04:21:24.076231+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:21:24.076231+0000","last_undegraded":"2023-08-25T04:21:24.076231+0000","last_fullsized":"2023-08-25T04:21:24.076231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:50:46.284319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904268+0000","last_change":"2023-08-25T04:21:22.893095+0000","last_active":"2023-08-25T04:21:23.904268+0000","last_peered":"2023-08-25T04:21:23.904268+0000","last_clean":"2023-08-25T04:21:23.904268+0000","last_became_active":"2023-08-25T04:21:22.892796+0000","last_became_peered":"2023-08-25T04:21:22.892796+0000","last_unstale":"2023-08-25T04:21:23.904268+0000","last_undegraded":"2023-08-25T04:21:23.904268+0000","last_fullsized":"2023-08-25T04:21:23.904268+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:17:01.059229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162978+0000","last_change":"2023-08-25T04:21:21.897616+0000","last_active":"2023-08-25T04:21:25.162978+0000","last_peered":"2023-08-25T04:21:25.162978+0000","last_clean":"2023-08-25T04:21:25.162978+0000","last_became_active":"2023-08-25T04:21:21.897331+0000","last_became_peered":"2023-08-25T04:21:21.897331+0000","last_unstale":"2023-08-25T04:21:25.162978+0000","last_undegraded":"2023-08-25T04:21:25.162978+0000","last_fullsized":"2023-08-25T04:21:25.162978+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:21:42.629328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":195,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841171+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:21:25.841171+0000","last_peered":"2023-08-25T04:21:25.841171+0000","last_clean":"2023-08-25T04:21:25.841171+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:21:25.841171+0000","last_undegraded":"2023-08-25T04:21:25.841171+0000","last_fullsized":"2023-08-25T04:21:25.841171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:17:23.051206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840349+0000","last_change":"2023-08-25T04:21:22.906887+0000","last_active":"2023-08-25T04:21:25.840349+0000","last_peered":"2023-08-25T04:21:25.840349+0000","last_clean":"2023-08-25T04:21:25.840349+0000","last_became_active":"2023-08-25T04:21:22.906378+0000","last_became_peered":"2023-08-25T04:21:22.906378+0000","last_unstale":"2023-08-25T04:21:25.840349+0000","last_undegraded":"2023-08-25T04:21:25.840349+0000","last_fullsized":"2023-08-25T04:21:25.840349+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:37:21.744515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"121'1","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903928+0000","last_change":"2023-08-25T04:21:21.893780+0000","last_active":"2023-08-25T04:21:23.903928+0000","last_peered":"2023-08-25T04:21:23.903928+0000","last_clean":"2023-08-25T04:21:23.903928+0000","last_became_active":"2023-08-25T04:21:21.893498+0000","last_became_peered":"2023-08-25T04:21:21.893498+0000","last_unstale":"2023-08-25T04:21:23.903928+0000","last_undegraded":"2023-08-25T04:21:23.903928+0000","last_fullsized":"2023-08-25T04:21:23.903928+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:45:30.286920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":187,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.162798+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:21:25.162798+0000","last_peered":"2023-08-25T04:21:25.162798+0000","last_clean":"2023-08-25T04:21:25.162798+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:21:25.162798+0000","last_undegraded":"2023-08-25T04:21:25.162798+0000","last_fullsized":"2023-08-25T04:21:25.162798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:40:09.787141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840704+0000","last_change":"2023-08-25T04:21:22.908616+0000","last_active":"2023-08-25T04:21:25.840704+0000","last_peered":"2023-08-25T04:21:25.840704+0000","last_clean":"2023-08-25T04:21:25.840704+0000","last_became_active":"2023-08-25T04:21:22.908297+0000","last_became_peered":"2023-08-25T04:21:22.908297+0000","last_unstale":"2023-08-25T04:21:25.840704+0000","last_undegraded":"2023-08-25T04:21:25.840704+0000","last_fullsized":"2023-08-25T04:21:25.840704+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:38:43.950220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.903108+0000","last_change":"2023-08-25T04:21:21.890257+0000","last_active":"2023-08-25T04:21:23.903108+0000","last_peered":"2023-08-25T04:21:23.903108+0000","last_clean":"2023-08-25T04:21:23.903108+0000","last_became_active":"2023-08-25T04:21:21.889952+0000","last_became_peered":"2023-08-25T04:21:21.889952+0000","last_unstale":"2023-08-25T04:21:23.903108+0000","last_undegraded":"2023-08-25T04:21:23.903108+0000","last_fullsized":"2023-08-25T04:21:23.903108+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:16:23.636146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":203,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904464+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:21:23.904464+0000","last_peered":"2023-08-25T04:21:23.904464+0000","last_clean":"2023-08-25T04:21:23.904464+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:21:23.904464+0000","last_undegraded":"2023-08-25T04:21:23.904464+0000","last_fullsized":"2023-08-25T04:21:23.904464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:38:00.891104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.841103+0000","last_change":"2023-08-25T04:21:22.911195+0000","last_active":"2023-08-25T04:21:25.841103+0000","last_peered":"2023-08-25T04:21:25.841103+0000","last_clean":"2023-08-25T04:21:25.841103+0000","last_became_active":"2023-08-25T04:21:22.910585+0000","last_became_peered":"2023-08-25T04:21:22.910585+0000","last_unstale":"2023-08-25T04:21:25.841103+0000","last_undegraded":"2023-08-25T04:21:25.841103+0000","last_fullsized":"2023-08-25T04:21:25.841103+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:25:56.030464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840387+0000","last_change":"2023-08-25T04:21:21.903096+0000","last_active":"2023-08-25T04:21:25.840387+0000","last_peered":"2023-08-25T04:21:25.840387+0000","last_clean":"2023-08-25T04:21:25.840387+0000","last_became_active":"2023-08-25T04:21:21.902800+0000","last_became_peered":"2023-08-25T04:21:21.902800+0000","last_unstale":"2023-08-25T04:21:25.840387+0000","last_undegraded":"2023-08-25T04:21:25.840387+0000","last_fullsized":"2023-08-25T04:21:25.840387+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:55:56.837970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.076659+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:21:24.076659+0000","last_peered":"2023-08-25T04:21:24.076659+0000","last_clean":"2023-08-25T04:21:24.076659+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:21:24.076659+0000","last_undegraded":"2023-08-25T04:21:24.076659+0000","last_fullsized":"2023-08-25T04:21:24.076659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:27:10.575116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410697+0000","last_change":"2023-08-25T04:21:22.912635+0000","last_active":"2023-08-25T04:21:24.410697+0000","last_peered":"2023-08-25T04:21:24.410697+0000","last_clean":"2023-08-25T04:21:24.410697+0000","last_became_active":"2023-08-25T04:21:22.912251+0000","last_became_peered":"2023-08-25T04:21:22.912251+0000","last_unstale":"2023-08-25T04:21:24.410697+0000","last_undegraded":"2023-08-25T04:21:24.410697+0000","last_fullsized":"2023-08-25T04:21:24.410697+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:07:08.209942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"121'2","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840713+0000","last_change":"2023-08-25T04:21:21.903014+0000","last_active":"2023-08-25T04:21:25.840713+0000","last_peered":"2023-08-25T04:21:25.840713+0000","last_clean":"2023-08-25T04:21:25.840713+0000","last_became_active":"2023-08-25T04:21:21.902701+0000","last_became_peered":"2023-08-25T04:21:21.902701+0000","last_unstale":"2023-08-25T04:21:25.840713+0000","last_undegraded":"2023-08-25T04:21:25.840713+0000","last_fullsized":"2023-08-25T04:21:25.840713+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:54:51.762146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":203,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904618+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:21:23.904618+0000","last_peered":"2023-08-25T04:21:23.904618+0000","last_clean":"2023-08-25T04:21:23.904618+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:21:23.904618+0000","last_undegraded":"2023-08-25T04:21:23.904618+0000","last_fullsized":"2023-08-25T04:21:23.904618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:18:52.419533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:24.410922+0000","last_change":"2023-08-25T04:21:22.914660+0000","last_active":"2023-08-25T04:21:24.410922+0000","last_peered":"2023-08-25T04:21:24.410922+0000","last_clean":"2023-08-25T04:21:24.410922+0000","last_became_active":"2023-08-25T04:21:22.909767+0000","last_became_peered":"2023-08-25T04:21:22.909767+0000","last_unstale":"2023-08-25T04:21:24.410922+0000","last_undegraded":"2023-08-25T04:21:24.410922+0000","last_fullsized":"2023-08-25T04:21:24.410922+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:21.868567+0000","last_clean_scrub_stamp":"2023-08-25T04:21:21.868567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:32:16.049571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:25.840266+0000","last_change":"2023-08-25T04:21:21.901171+0000","last_active":"2023-08-25T04:21:25.840266+0000","last_peered":"2023-08-25T04:21:25.840266+0000","last_clean":"2023-08-25T04:21:25.840266+0000","last_became_active":"2023-08-25T04:21:21.900896+0000","last_became_peered":"2023-08-25T04:21:21.900896+0000","last_unstale":"2023-08-25T04:21:25.840266+0000","last_undegraded":"2023-08-25T04:21:25.840266+0000","last_fullsized":"2023-08-25T04:21:25.840266+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:21:20.865282+0000","last_clean_scrub_stamp":"2023-08-25T04:21:20.865282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:06:42.554534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":217,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-08-25T04:21:23.904079+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:21:23.904079+0000","last_peered":"2023-08-25T04:21:23.904079+0000","last_clean":"2023-08-25T04:21:23.904079+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:21:23.904079+0000","last_undegraded":"2023-08-25T04:21:23.904079+0000","last_fullsized":"2023-08-25T04:21:23.904079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:03:44.441477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1040,"num_read_kb":2137,"num_write":345,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3532,"ondisk_log_size":3532,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509664,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59600,"kb_used_data":2052,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312240,"statfs":{"total":96636764160,"available":96575733760,"internally_reserved":0,"allocated":2101248,"data_stored":1337669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.67100000000000004,"15min":0.69599999999999995},"min":{"1min":0.501,"5min":0.35399999999999998,"15min":0.33700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.67700000000000005,"15min":0.71299999999999997},"min":{"1min":0.44500000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1,"5min":1,"15min":1.0249999999999999},"last":0.67900000000000005}]},{"osd":1,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.70799999999999996,"15min":0.72799999999999998},"min":{"1min":0.51900000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.878},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.70199999999999996,"15min":0.72899999999999998},"min":{"1min":0.47399999999999998,"5min":0.377,"15min":0.374},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.036},"last":0.80300000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68200000000000005,"15min":0.70599999999999996},"min":{"1min":0.49399999999999999,"5min":0.38100000000000001,"15min":0.34899999999999998},"max":{"1min":0.89500000000000002,"5min":0.94299999999999995,"15min":1.018},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.71099999999999997,"15min":0.74099999999999999},"min":{"1min":0.498,"5min":0.46500000000000002,"15min":0.38100000000000001},"max":{"1min":1.0429999999999999,"5min":1.046,"15min":1.046},"last":0.82299999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.70099999999999996,"15min":0.73099999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.71799999999999997,"15min":0.74299999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.78300000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59099999999999997,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.34499999999999997,"15min":0.32400000000000001},"max":{"1min":1.004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.38900000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.97599999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.72299999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40500000000000003,"15min":0.377},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63800000000000001,"15min":0.63100000000000001},"min":{"1min":0.46600000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.746}]},{"osd":6,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.99099999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.442,"5min":0.42799999999999999,"15min":0.42699999999999999},"max":{"1min":1.0169999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.84199999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509664,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36828,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335012,"statfs":{"total":96636764160,"available":96599052288,"internally_reserved":0,"allocated":1519616,"data_stored":749357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.66300000000000003,"15min":0.69599999999999995},"min":{"1min":0.53200000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.88500000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66400000000000003,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84299999999999997,"5min":0.96499999999999997,"15min":1.054},"last":0.71999999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69799999999999995,"15min":0.72699999999999998},"min":{"1min":0.48699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96299999999999997,"5min":1.0269999999999999,"15min":1.0369999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69599999999999995,"15min":0.72199999999999998},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90500000000000003,"5min":1.109,"15min":1.109},"last":0.73399999999999999}]},{"osd":2,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70199999999999996,"15min":0.72899999999999998},"min":{"1min":0.54200000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86799999999999999,"5min":1.0009999999999999,"15min":1.1020000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.59299999999999997,"5min":0.499,"15min":0.499},"max":{"1min":0.92900000000000005,"5min":1.0569999999999999,"15min":1.117},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.51600000000000001,"5min":0.48499999999999999,"15min":0.46899999999999997},"max":{"1min":0.88700000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.52500000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93999999999999995,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.80600000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39400000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.498},{"interface":"front","average":{"1min":0.623,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.42299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.92200000000000004,"5min":0.95799999999999996,"15min":1.0820000000000001},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.48199999999999998,"5min":0.39200000000000002,"15min":0.373},"max":{"1min":0.874,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91700000000000004,"5min":1.141,"15min":1.141},"last":0.62}]},{"osd":7,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.502,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":1.0389999999999999,"15min":1.046},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71699999999999997,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.44700000000000001},"max":{"1min":0.94199999999999995,"5min":1.373,"15min":1.373},"last":0.54300000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542367,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":747141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65200000000000002,"15min":0.69799999999999995},"min":{"1min":0.498,"5min":0.313,"15min":0.313},"max":{"1min":0.91300000000000003,"5min":0.98099999999999998,"15min":1.018},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66900000000000004,"15min":0.71399999999999997},"min":{"1min":0.40300000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.0409999999999999},"last":0.83699999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.67000000000000004,"15min":0.71899999999999997},"min":{"1min":0.51200000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.99399999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.70299999999999996,"15min":0.73099999999999998},"min":{"1min":0.46400000000000002,"5min":0.434,"15min":0.434},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.90700000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.66300000000000003,"15min":0.71499999999999997},"min":{"1min":0.58699999999999997,"5min":0.40799999999999997,"15min":0.39500000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.97499999999999998},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.70199999999999996,"15min":0.73599999999999999},"min":{"1min":0.58499999999999996,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.78800000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70199999999999996,"15min":0.72599999999999998},"min":{"1min":0.55800000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.94199999999999995},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.70999999999999996,"15min":0.75600000000000001},"min":{"1min":0.626,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.008,"5min":1.028,"15min":1.028},"last":0.85999999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:21:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.44500000000000001,"5min":0.38400000000000001,"15min":0.35399999999999998},"max":{"1min":0.72199999999999998,"5min":0.91000000000000003,"15min":0.97099999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.46800000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.874,"5min":0.99399999999999999,"15min":1.018},"last":0.80800000000000005}]},{"osd":6,"last update":"Fri Aug 25 04:21:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.44600000000000001,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.82399999999999995,"5min":0.96799999999999997,"15min":1.008},"last":0.755},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.48199999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79400000000000004,"5min":0.94199999999999995,"15min":0.98299999999999998},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Aug 25 04:21:19 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.63400000000000001,"15min":0.61499999999999999},"min":{"1min":0.47499999999999998,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.84699999999999998,"5min":0.93300000000000005,"15min":1.032},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69099999999999995,"15min":0.68999999999999995},"min":{"1min":0.55700000000000005,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.94999999999999996,"5min":1.01,"15min":1.048},"last":0.877}]}]},{"osd":4,"up_from":14,"seq":60129542367,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36816,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335024,"statfs":{"total":96636764160,"available":96599064576,"internally_reserved":0,"allocated":1507328,"data_stored":747233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64600000000000002,"15min":0.69599999999999995},"min":{"1min":0.45600000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.99299999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65700000000000003,"15min":0.69099999999999995},"min":{"1min":0.499,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83699999999999997,"5min":0.90200000000000002,"15min":0.96699999999999997},"last":0.73699999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.68700000000000006,"15min":0.72199999999999998},"min":{"1min":0.46600000000000003,"5min":0.38200000000000001,"15min":0.36199999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0449999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.67500000000000004,"15min":0.72399999999999998},"min":{"1min":0.47599999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92100000000000004,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.82699999999999996}]},{"osd":2,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69799999999999995,"15min":0.748},"min":{"1min":0.48099999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91500000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.69699999999999995,"15min":0.73599999999999999},"min":{"1min":0.48399999999999999,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":0.97699999999999998,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.71899999999999997,"15min":0.755},"min":{"1min":0.52500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.048},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69599999999999995,"15min":0.74399999999999999},"min":{"1min":0.51300000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0209999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.76300000000000001}]},{"osd":5,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53500000000000003,"15min":0.55000000000000004},"min":{"1min":0.35499999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.94799999999999995},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85999999999999999,"5min":0.91400000000000003,"15min":1.8740000000000001},"last":0.47599999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.48699999999999999,"5min":0.48199999999999998,"15min":0.40699999999999997},"max":{"1min":1.079,"5min":1.079,"15min":1.093},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.627,"15min":0.64000000000000001},"min":{"1min":0.36499999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":1.022,"15min":1.2010000000000001},"last":0.53000000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:21:17 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59999999999999998,"15min":0.60899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":0.84499999999999997,"5min":0.84899999999999998,"15min":0.90400000000000003},"last":0.504},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68799999999999994,"15min":0.69699999999999995},"min":{"1min":0.505,"5min":0.49199999999999999,"15min":0.437},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.99399999999999999},"last":0.64100000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542367,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36808,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335032,"statfs":{"total":96636764160,"available":96599072768,"internally_reserved":0,"allocated":1503232,"data_stored":747723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53900000000000003,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.38500000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63,"5min":0.745,"15min":0.91500000000000004},"last":0.54000000000000004}]},{"osd":1,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.502,"15min":0.501},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.74199999999999999,"5min":1.254,"15min":1.254},"last":0.441},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.45300000000000001,"5min":0.41499999999999998,"15min":0.33900000000000002},"max":{"1min":0.73999999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.64700000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.38700000000000001,"15min":0.33000000000000002},"max":{"1min":0.79500000000000004,"5min":1.639,"15min":1.639},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.54300000000000004},"min":{"1min":0.39600000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.748,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.56899999999999995,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97999999999999998,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.61899999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.02,"5min":1.601,"15min":1.601},"last":0.92800000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.75900000000000001,"15min":0.77700000000000002},"min":{"1min":0.54600000000000004,"5min":0.52900000000000003,"15min":0.49299999999999999},"max":{"1min":1.0349999999999999,"5min":1.254,"15min":1.254},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.75600000000000001,"15min":0.78000000000000003},"min":{"1min":0.66100000000000003,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":0.95299999999999996,"5min":1.421,"15min":1.421},"last":0.95799999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79500000000000004,"15min":0.80000000000000004},"min":{"1min":0.58999999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0880000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.76300000000000001,"15min":0.79200000000000004},"min":{"1min":0.63300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0029999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.90300000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.79700000000000004,"15min":0.82099999999999995},"min":{"1min":0.621,"5min":0.53000000000000003,"15min":0.52500000000000002},"max":{"1min":1.0780000000000001,"5min":1.472,"15min":1.472},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77300000000000002,"15min":0.78900000000000003},"min":{"1min":0.59799999999999998,"5min":0.498,"15min":0.498},"max":{"1min":1.0209999999999999,"5min":1.079,"15min":1.1160000000000001},"last":0.88500000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542368,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54856,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316984,"statfs":{"total":96636764160,"available":96580591616,"internally_reserved":0,"allocated":1503232,"data_stored":747175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.432,"15min":0.45700000000000002},"min":{"1min":0.31,"5min":0.255,"15min":0.255},"max":{"1min":0.63500000000000001,"5min":0.77200000000000002,"15min":0.85599999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.47899999999999998,"15min":0.495},"min":{"1min":0.35799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.93100000000000005},"last":0.625}]},{"osd":1,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46899999999999997,"15min":0.48199999999999998},"min":{"1min":0.34799999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69599999999999995,"5min":0.70799999999999996,"15min":0.78800000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56599999999999995,"15min":0.59199999999999997},"min":{"1min":0.41099999999999998,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.81200000000000006,"5min":0.81699999999999995,"15min":0.89800000000000002},"last":0.69199999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.50900000000000001,"15min":0.52900000000000003},"min":{"1min":0.46400000000000002,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":0.748,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.40600000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.89400000000000002},"last":0.54900000000000004}]},{"osd":4,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.73699999999999999,"15min":0.78100000000000003},"min":{"1min":0.51900000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.103,"5min":1.103,"15min":1.2569999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.72999999999999998,"15min":0.77100000000000002},"min":{"1min":0.59799999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.5509999999999999},"last":0.81799999999999995}]},{"osd":5,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.747,"15min":0.78400000000000003},"min":{"1min":0.52500000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.2789999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.75900000000000001,"15min":0.79500000000000004},"min":{"1min":0.627,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.3089999999999999},"last":0.97999999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.754,"15min":0.80700000000000005},"min":{"1min":0.57999999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.077,"5min":1.077,"15min":1.3069999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.78400000000000003,"15min":0.83799999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.375},"last":0.93400000000000005}]},{"osd":7,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74199999999999999,"15min":0.78700000000000003},"min":{"1min":0.54100000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.21,"5min":1.21,"15min":1.339},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.76100000000000001,"15min":0.79200000000000004},"min":{"1min":0.52400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.099,"5min":1.099,"15min":1.1859999999999999},"last":0.83999999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542368,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36812,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335028,"statfs":{"total":96636764160,"available":96599068672,"internally_reserved":0,"allocated":1503232,"data_stored":747175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.438,"15min":0.45100000000000001},"min":{"1min":0.26400000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.96899999999999997},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.753,"5min":0.85099999999999998,"15min":1.212},"last":0.47099999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.498,"15min":0.498},"min":{"1min":0.35599999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.76400000000000001,"5min":0.82099999999999995,"15min":0.876},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.496}]},{"osd":3,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.39900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53800000000000003,"15min":0.56799999999999995},"min":{"1min":0.33200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.748,"5min":0.84299999999999997,"15min":1.165},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70899999999999996,"15min":0.75700000000000001},"min":{"1min":0.51900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92300000000000004,"5min":1.012,"15min":1.204},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.76300000000000001,"15min":0.79300000000000004},"min":{"1min":0.52400000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.2529999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72399999999999998,"15min":0.77500000000000002},"min":{"1min":0.54500000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89200000000000002,"5min":1.073,"15min":1.254},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.74399999999999999,"15min":0.79400000000000004},"min":{"1min":0.56999999999999995,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0129999999999999,"5min":1.044,"15min":1.9059999999999999},"last":0.95299999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80000000000000004,"15min":0.82399999999999995},"min":{"1min":0.55800000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.294,"5min":1.294,"15min":1.623},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.755,"15min":0.78900000000000003},"min":{"1min":0.57899999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93000000000000005,"5min":1.0369999999999999,"15min":1.288},"last":0.83399999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.753,"15min":0.79400000000000004},"min":{"1min":0.59199999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95999999999999996,"5min":1.1140000000000001,"15min":1.2949999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81799999999999995,"15min":0.83799999999999997},"min":{"1min":0.59199999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.3120000000000001},"last":0.86599999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542367,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33244,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338596,"statfs":{"total":96636764160,"available":96602722304,"internally_reserved":0,"allocated":2109440,"data_stored":1339211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47699999999999998,"15min":0.48399999999999999},"min":{"1min":0.30599999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52100000000000002,"15min":0.55900000000000005},"min":{"1min":0.41499999999999998,"5min":0.38500000000000001,"15min":0.36699999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":3.5089999999999999},"last":0.51800000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48499999999999999,"15min":0.51500000000000001},"min":{"1min":0.34000000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.749,"5min":0.78500000000000003,"15min":0.97499999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51800000000000002,"15min":0.53700000000000003},"min":{"1min":0.42899999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70099999999999996,"5min":0.876,"15min":3.4590000000000001},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47699999999999998,"15min":0.48999999999999999},"min":{"1min":0.37,"5min":0.27800000000000002,"15min":0.27700000000000002},"max":{"1min":0.73599999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.5},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57199999999999995,"15min":0.58799999999999997},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.32700000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":1.2470000000000001},"last":0.69599999999999995}]},{"osd":4,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77000000000000002,"15min":0.78500000000000003},"min":{"1min":0.60299999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97999999999999998,"5min":1.2,"15min":1.2},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.75800000000000001,"15min":0.79300000000000004},"min":{"1min":0.63,"5min":0.443,"15min":0.443},"max":{"1min":1.1339999999999999,"5min":1.169,"15min":1.1719999999999999},"last":0.80100000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.747,"15min":0.78500000000000003},"min":{"1min":0.52500000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.032,"5min":1.131,"15min":3.528},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77100000000000002,"15min":0.80100000000000005},"min":{"1min":0.61599999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.2270000000000001,"5min":1.244,"15min":1.244},"last":0.83099999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.74399999999999999,"15min":0.78800000000000003},"min":{"1min":0.58799999999999997,"5min":0.495,"15min":0.495},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":3.4870000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78500000000000003,"15min":0.81999999999999995},"min":{"1min":0.54200000000000004,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.093,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.77400000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:21:18 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.80100000000000005,"15min":0.83199999999999996},"min":{"1min":0.63800000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1619999999999999,"5min":1.28,"15min":1.28},"last":0.876},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77000000000000002,"15min":0.80000000000000004},"min":{"1min":0.59999999999999998,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0609999999999999,"5min":1.0940000000000001,"15min":1.1930000000000001},"last":0.754}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:21:32.000 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-25T04:21:32.001 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-25T04:21:32.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.154+0000 7fbf40a9e640 1 Processor -- start 2023-08-25T04:21:32.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.154+0000 7fbf40a9e640 1 -- start start 2023-08-25T04:21:32.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.154+0000 7fbf40a9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf3c0ad6b0 0x7fbf3c0b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:32.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.154+0000 7fbf40a9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbf3c0cb710 0x7fbf3c06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:32.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.154+0000 7fbf40a9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf3c0cdf20 con 0x7fbf3c0b1750 2023-08-25T04:21:32.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.154+0000 7fbf40a9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf3c09bc40 con 0x7fbf3c0cb710 2023-08-25T04:21:32.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.154+0000 7fbf40a9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3c09bf20 con 0x7fbf3c0ad6b0 2023-08-25T04:21:32.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.154+0000 7fbf39d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbf3c0cb710 0x7fbf3c06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:32.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.154+0000 7fbf39d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbf3c0cb710 0x7fbf3c06c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44488/0 (socket says 172.21.15.55:44488) 2023-08-25T04:21:32.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.154+0000 7fbf39d9b640 1 -- 172.21.15.55:0/3230717204 learned_addr learned my addr 172.21.15.55:0/3230717204 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:32.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.154+0000 7fbf3ad9d640 1 --1- 172.21.15.55:0/3230717204 >> v1:172.21.15.55:6789/0 conn(0x7fbf3c0b1750 0x7fbf3c0c8a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49358/0 (socket says 172.21.15.55:49358) 2023-08-25T04:21:32.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.154+0000 7fbf3a59c640 1 --2- 172.21.15.55:0/3230717204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf3c0ad6b0 0x7fbf3c0b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:32.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.154+0000 7fbf39d9b640 1 -- 172.21.15.55:0/3230717204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf3c0ad6b0 msgr2=0x7fbf3c0b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:32.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.154+0000 7fbf39d9b640 1 --2- 172.21.15.55:0/3230717204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf3c0ad6b0 0x7fbf3c0b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:32.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.154+0000 7fbf39d9b640 1 -- 172.21.15.55:0/3230717204 >> v1:172.21.15.55:6789/0 conn(0x7fbf3c0b1750 legacy=0x7fbf3c0c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:32.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.154+0000 7fbf39d9b640 1 -- 172.21.15.55:0/3230717204 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c06c1c0 con 0x7fbf3c0cb710 2023-08-25T04:21:32.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.154+0000 7fbf3959a640 1 -- 172.21.15.55:0/3230717204 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705300012 0 0) 0x7fbf3c0cdf20 con 0x7fbf3c0b1750 2023-08-25T04:21:32.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.158+0000 7fbf39d9b640 1 --2- 172.21.15.55:0/3230717204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf3c0cb710 0x7fbf3c06c9c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009870 tx=0x7fbf3001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6bf24ba031ad32 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:32.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.158+0000 7fbf3959a640 1 -- 172.21.15.55:0/3230717204 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf300ab600 con 0x7fbf3c0cb710 2023-08-25T04:21:32.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.158+0000 7fbf3959a640 1 -- 172.21.15.55:0/3230717204 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf300a7050 con 0x7fbf3c0cb710 2023-08-25T04:21:32.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.158+0000 7fbf3959a640 1 -- 172.21.15.55:0/3230717204 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf300ab980 con 0x7fbf3c0cb710 2023-08-25T04:21:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.158+0000 7fbf40a9e640 1 -- 172.21.15.55:0/3230717204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf3c0cb710 msgr2=0x7fbf3c06c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.158+0000 7fbf40a9e640 1 --2- 172.21.15.55:0/3230717204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf3c0cb710 0x7fbf3c06c9c0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009870 tx=0x7fbf3001c540 comp rx=0 tx=0).stop 2023-08-25T04:21:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.158+0000 7fbf40a9e640 1 -- 172.21.15.55:0/3230717204 shutdown_connections 2023-08-25T04:21:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.158+0000 7fbf40a9e640 1 --2- 172.21.15.55:0/3230717204 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf3c0cb710 0x7fbf3c06c9c0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.158+0000 7fbf40a9e640 1 --2- 172.21.15.55:0/3230717204 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf3c0ad6b0 0x7fbf3c0b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.158+0000 7fbf40a9e640 1 -- 172.21.15.55:0/3230717204 >> 172.21.15.55:0/3230717204 conn(0x7fbf3c069900 msgr2=0x7fbf3c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:32.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.158+0000 7fbf40a9e640 1 -- 172.21.15.55:0/3230717204 shutdown_connections 2023-08-25T04:21:32.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.158+0000 7fbf40a9e640 1 -- 172.21.15.55:0/3230717204 wait complete. 2023-08-25T04:21:32.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf40a9e640 1 Processor -- start 2023-08-25T04:21:32.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf40a9e640 1 -- start start 2023-08-25T04:21:32.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf40a9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf3c0ad6b0 0x7fbf3c0c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:32.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf40a9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf3c0b1750 0x7fbf3c153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:32.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf40a9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf3c0cb710 0x7fbf3c162780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:32.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf40a9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3c0c3830 con 0x7fbf3c0ad6b0 2023-08-25T04:21:32.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf40a9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3c0c3b10 con 0x7fbf3c0cb710 2023-08-25T04:21:32.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf40a9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3c0c3df0 con 0x7fbf3c0b1750 2023-08-25T04:21:32.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf3a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf3c0ad6b0 0x7fbf3c0c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:32.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf3a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf3c0ad6b0 0x7fbf3c0c48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44496/0 (socket says 172.21.15.55:44496) 2023-08-25T04:21:32.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf3a59c640 1 -- 172.21.15.55:0/1106763809 learned_addr learned my addr 172.21.15.55:0/1106763809 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:32.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf39d9b640 1 --2- 172.21.15.55:0/1106763809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf3c0b1750 0x7fbf3c153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:32.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf3ad9d640 1 --2- 172.21.15.55:0/1106763809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf3c0cb710 0x7fbf3c162780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:32.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf3a59c640 1 -- 172.21.15.55:0/1106763809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf3c0b1750 msgr2=0x7fbf3c153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:32.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf3a59c640 1 --2- 172.21.15.55:0/1106763809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf3c0b1750 0x7fbf3c153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:32.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf3a59c640 1 -- 172.21.15.55:0/1106763809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf3c0cb710 msgr2=0x7fbf3c162780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:32.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf3a59c640 1 --2- 172.21.15.55:0/1106763809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf3c0cb710 0x7fbf3c162780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:32.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf3a59c640 1 -- 172.21.15.55:0/1106763809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf300094d0 con 0x7fbf3c0ad6b0 2023-08-25T04:21:32.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf3ad9d640 1 --2- 172.21.15.55:0/1106763809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf3c0cb710 0x7fbf3c162780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:32.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf3a59c640 1 --2- 172.21.15.55:0/1106763809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf3c0ad6b0 0x7fbf3c0c48d0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00e9b0 tx=0x7fbf2c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:32.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf2affd640 1 -- 172.21.15.55:0/1106763809 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c009670 con 0x7fbf3c0ad6b0 2023-08-25T04:21:32.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf2affd640 1 -- 172.21.15.55:0/1106763809 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c00c9a0 con 0x7fbf3c0ad6b0 2023-08-25T04:21:32.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf2affd640 1 -- 172.21.15.55:0/1106763809 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c00cd10 con 0x7fbf3c0ad6b0 2023-08-25T04:21:32.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf40a9e640 1 -- 172.21.15.55:0/1106763809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf3c0c40d0 con 0x7fbf3c0ad6b0 2023-08-25T04:21:32.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf40a9e640 1 -- 172.21.15.55:0/1106763809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf3c154e10 con 0x7fbf3c0ad6b0 2023-08-25T04:21:32.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.162+0000 7fbf40a9e640 1 -- 172.21.15.55:0/1106763809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf3c0cd130 con 0x7fbf3c0ad6b0 2023-08-25T04:21:32.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.166+0000 7fbf2affd640 1 -- 172.21.15.55:0/1106763809 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fbf2c013470 con 0x7fbf3c0ad6b0 2023-08-25T04:21:32.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.166+0000 7fbf2affd640 1 --2- 172.21.15.55:0/1106763809 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fbf1c0657a0 0x7fbf1c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:32.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.166+0000 7fbf2affd640 1 -- 172.21.15.55:0/1106763809 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf2c083560 con 0x7fbf3c0ad6b0 2023-08-25T04:21:32.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.166+0000 7fbf39d9b640 1 --2- 172.21.15.55:0/1106763809 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fbf1c0657a0 0x7fbf1c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:32.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.166+0000 7fbf39d9b640 1 --2- 172.21.15.55:0/1106763809 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fbf1c0657a0 0x7fbf1c067c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0cbb70 tx=0x7fbf300a6000 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:32.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.170+0000 7fbf2affd640 1 -- 172.21.15.55:0/1106763809 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbf2c050f20 con 0x7fbf3c0ad6b0 2023-08-25T04:21:32.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.382+0000 7fbf40a9e640 1 -- 172.21.15.55:0/1106763809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbf3c073ec0 con 0x7fbf3c0ad6b0 2023-08-25T04:21:32.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.386+0000 7fbf2affd640 1 -- 172.21.15.55:0/1106763809 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7fbf2c054540 con 0x7fbf3c0ad6b0 2023-08-25T04:21:32.385 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2023-08-25T04:21:32.386 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g== 2023-08-25T04:21:32.386 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2023-08-25T04:21:32.386 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2023-08-25T04:21:32.386 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-25T04:21:32.386 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-08-25T04:21:32.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.386+0000 7fbf40a9e640 1 -- 172.21.15.55:0/1106763809 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fbf1c0657a0 msgr2=0x7fbf1c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:32.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.386+0000 7fbf40a9e640 1 --2- 172.21.15.55:0/1106763809 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fbf1c0657a0 0x7fbf1c067c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0cbb70 tx=0x7fbf300a6000 comp rx=0 tx=0).stop 2023-08-25T04:21:32.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.386+0000 7fbf40a9e640 1 -- 172.21.15.55:0/1106763809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf3c0ad6b0 msgr2=0x7fbf3c0c48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:32.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.386+0000 7fbf40a9e640 1 --2- 172.21.15.55:0/1106763809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf3c0ad6b0 0x7fbf3c0c48d0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00e9b0 tx=0x7fbf2c00ee70 comp rx=0 tx=0).stop 2023-08-25T04:21:32.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.390+0000 7fbf40a9e640 1 -- 172.21.15.55:0/1106763809 shutdown_connections 2023-08-25T04:21:32.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.390+0000 7fbf40a9e640 1 --2- 172.21.15.55:0/1106763809 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf3c0cb710 0x7fbf3c162780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:32.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.390+0000 7fbf40a9e640 1 --2- 172.21.15.55:0/1106763809 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf3c0b1750 0x7fbf3c153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:32.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.390+0000 7fbf40a9e640 1 --2- 172.21.15.55:0/1106763809 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fbf1c0657a0 0x7fbf1c067c60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:32.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.390+0000 7fbf40a9e640 1 --2- 172.21.15.55:0/1106763809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf3c0ad6b0 0x7fbf3c0c48d0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:32.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.390+0000 7fbf40a9e640 1 -- 172.21.15.55:0/1106763809 >> 172.21.15.55:0/1106763809 conn(0x7fbf3c069900 msgr2=0x7fbf3c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:32.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.390+0000 7fbf40a9e640 1 -- 172.21.15.55:0/1106763809 shutdown_connections 2023-08-25T04:21:32.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.390+0000 7fbf40a9e640 1 -- 172.21.15.55:0/1106763809 wait complete. 2023-08-25T04:21:32.406 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:21:32.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.550+0000 7f87f1940640 1 Processor -- start 2023-08-25T04:21:32.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.550+0000 7f87f1940640 1 -- start start 2023-08-25T04:21:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.550+0000 7f87f1940640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87ec15eba0 0x7f87ec0b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.550+0000 7f87f1940640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ec0ac3a0 con 0x7f87ec0ceeb0 2023-08-25T04:21:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.550+0000 7f87f1940640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ec0b1390 con 0x7f87ec15ef80 2023-08-25T04:21:32.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.550+0000 7f87f1940640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ec0b1670 con 0x7f87ec15eba0 2023-08-25T04:21:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.554+0000 7f87eaffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87ec15eba0 0x7f87ec0b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.554+0000 7f87eaffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87ec15eba0 0x7f87ec0b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44498/0 (socket says 172.21.15.55:44498) 2023-08-25T04:21:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.554+0000 7f87eaffd640 1 -- 172.21.15.55:0/1677181312 learned_addr learned my addr 172.21.15.55:0/1677181312 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.554+0000 7f87eb7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f87ec0ceeb0 0x7f87ec0ab0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49364/0 (socket says 172.21.15.55:49364) 2023-08-25T04:21:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.554+0000 7f87eaffd640 1 -- 172.21.15.55:0/1677181312 >> v1:172.21.15.110:6789/0 conn(0x7f87ec15ef80 legacy=0x7f87ec0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:32.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.554+0000 7f87eaffd640 1 -- 172.21.15.55:0/1677181312 >> v1:172.21.15.55:6789/0 conn(0x7f87ec0ceeb0 legacy=0x7f87ec0ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:32.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.554+0000 7f87eaffd640 1 -- 172.21.15.55:0/1677181312 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec0b1950 con 0x7f87ec15eba0 2023-08-25T04:21:32.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.554+0000 7f87eaffd640 1 --2- 172.21.15.55:0/1677181312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87ec15eba0 0x7f87ec0b2a40 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f87dc009870 tx=0x7f87dc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de17a4e54c3a8f24 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:32.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.554+0000 7f87ea7fc640 1 -- 172.21.15.55:0/1677181312 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc0aa670 con 0x7f87ec15eba0 2023-08-25T04:21:32.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.554+0000 7f87ea7fc640 1 -- 172.21.15.55:0/1677181312 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc0aa7d0 con 0x7f87ec15eba0 2023-08-25T04:21:32.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.554+0000 7f87ea7fc640 1 -- 172.21.15.55:0/1677181312 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc0aab60 con 0x7f87ec15eba0 2023-08-25T04:21:32.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87f1940640 1 -- 172.21.15.55:0/1677181312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87ec15eba0 msgr2=0x7f87ec0b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:32.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87f1940640 1 --2- 172.21.15.55:0/1677181312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87ec15eba0 0x7f87ec0b2a40 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f87dc009870 tx=0x7f87dc01c510 comp rx=0 tx=0).stop 2023-08-25T04:21:32.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87f1940640 1 -- 172.21.15.55:0/1677181312 shutdown_connections 2023-08-25T04:21:32.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87f1940640 1 --2- 172.21.15.55:0/1677181312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87ec15eba0 0x7f87ec0b2a40 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:32.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87f1940640 1 -- 172.21.15.55:0/1677181312 >> 172.21.15.55:0/1677181312 conn(0x7f87ec069d00 msgr2=0x7f87ec06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:32.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87f1940640 1 -- 172.21.15.55:0/1677181312 shutdown_connections 2023-08-25T04:21:32.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87f1940640 1 -- 172.21.15.55:0/1677181312 wait complete. 2023-08-25T04:21:32.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87f1940640 1 Processor -- start 2023-08-25T04:21:32.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87f1940640 1 -- start start 2023-08-25T04:21:32.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87f1940640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87ec0ceeb0 0x7f87ec153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:32.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87f1940640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87ec15eba0 0x7f87ec0c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:32.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87f1940640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87ec15ef80 0x7f87ec1f9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:32.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87f1940640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec0c2070 con 0x7f87ec0ceeb0 2023-08-25T04:21:32.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87f1940640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec1fb4a0 con 0x7f87ec15ef80 2023-08-25T04:21:32.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87f1940640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec0c1420 con 0x7f87ec15eba0 2023-08-25T04:21:32.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87eaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87ec0ceeb0 0x7f87ec153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:32.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87eaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87ec0ceeb0 0x7f87ec153420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44506/0 (socket says 172.21.15.55:44506) 2023-08-25T04:21:32.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87eaffd640 1 -- 172.21.15.55:0/2934391627 learned_addr learned my addr 172.21.15.55:0/2934391627 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:32.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87eb7fe640 1 --2- 172.21.15.55:0/2934391627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87ec15ef80 0x7f87ec1f9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:32.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87e27fc640 1 --2- 172.21.15.55:0/2934391627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87ec15eba0 0x7f87ec0c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:32.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87eaffd640 1 -- 172.21.15.55:0/2934391627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87ec15eba0 msgr2=0x7f87ec0c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:32.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87eaffd640 1 --2- 172.21.15.55:0/2934391627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87ec15eba0 0x7f87ec0c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:32.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87eaffd640 1 -- 172.21.15.55:0/2934391627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87ec15ef80 msgr2=0x7f87ec1f9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:32.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87eaffd640 1 --2- 172.21.15.55:0/2934391627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87ec15ef80 0x7f87ec1f9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:32.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.558+0000 7f87eaffd640 1 -- 172.21.15.55:0/2934391627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc0094d0 con 0x7f87ec0ceeb0 2023-08-25T04:21:32.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.562+0000 7f87eaffd640 1 --2- 172.21.15.55:0/2934391627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87ec0ceeb0 0x7f87ec153420 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f87dc0ac040 tx=0x7f87dc01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:32.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.562+0000 7f87e8ff9640 1 -- 172.21.15.55:0/2934391627 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc0b38c0 con 0x7f87ec0ceeb0 2023-08-25T04:21:32.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.562+0000 7f87e8ff9640 1 -- 172.21.15.55:0/2934391627 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc0b3a40 con 0x7f87ec0ceeb0 2023-08-25T04:21:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.562+0000 7f87e8ff9640 1 -- 172.21.15.55:0/2934391627 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc0b3df0 con 0x7f87ec0ceeb0 2023-08-25T04:21:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.562+0000 7f87f1940640 1 -- 172.21.15.55:0/2934391627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ec1faab0 con 0x7f87ec0ceeb0 2023-08-25T04:21:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.562+0000 7f87f1940640 1 -- 172.21.15.55:0/2934391627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ec0c10b0 con 0x7f87ec0ceeb0 2023-08-25T04:21:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.562+0000 7f87f1940640 1 -- 172.21.15.55:0/2934391627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ec04dbe0 con 0x7f87ec0ceeb0 2023-08-25T04:21:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.562+0000 7f87e8ff9640 1 -- 172.21.15.55:0/2934391627 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f87dc0b2380 con 0x7f87ec0ceeb0 2023-08-25T04:21:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.562+0000 7f87e8ff9640 1 --2- 172.21.15.55:0/2934391627 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f87cc0657a0 0x7f87cc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.562+0000 7f87e8ff9640 1 -- 172.21.15.55:0/2934391627 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f87dc11da90 con 0x7f87ec0ceeb0 2023-08-25T04:21:32.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.562+0000 7f87e27fc640 1 --2- 172.21.15.55:0/2934391627 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f87cc0657a0 0x7f87cc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:32.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.566+0000 7f87e27fc640 1 --2- 172.21.15.55:0/2934391627 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f87cc0657a0 0x7f87cc067c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f87ec15a900 tx=0x7f87d4009040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:32.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.566+0000 7f87e8ff9640 1 -- 172.21.15.55:0/2934391627 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f87dc0eb340 con 0x7f87ec0ceeb0 2023-08-25T04:21:32.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.754+0000 7f87f1940640 1 -- 172.21.15.55:0/2934391627 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87ec166480 con 0x7f87ec0ceeb0 2023-08-25T04:21:32.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.754+0000 7f87e8ff9640 1 -- 172.21.15.55:0/2934391627 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f87dc0ee960 con 0x7f87ec0ceeb0 2023-08-25T04:21:32.756 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:32.756 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2585223071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2585223071},{"type":"v1","addr":"172.21.15.55:6834","nonce":2585223071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52},{"gid":7918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3510911374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3510911374},{"type":"v1","addr":"172.21.15.110:6837","nonce":3510911374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":7921,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1404270940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1404270940},{"type":"v1","addr":"172.21.15.110:6836","nonce":1404270940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:21:22.282732+0000","modified":"2023-08-25T04:21:25.909779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8436":{"gid":8436,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1257898577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1257898577},{"type":"v1","addr":"172.21.15.55:6835","nonce":1257898577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-25T04:21:32.757 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 58 2023-08-25T04:21:32.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.758+0000 7f87f1940640 1 -- 172.21.15.55:0/2934391627 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f87cc0657a0 msgr2=0x7f87cc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:32.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.758+0000 7f87f1940640 1 --2- 172.21.15.55:0/2934391627 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f87cc0657a0 0x7f87cc067c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f87ec15a900 tx=0x7f87d4009040 comp rx=0 tx=0).stop 2023-08-25T04:21:32.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.758+0000 7f87f1940640 1 -- 172.21.15.55:0/2934391627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87ec0ceeb0 msgr2=0x7f87ec153420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:32.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.758+0000 7f87f1940640 1 --2- 172.21.15.55:0/2934391627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87ec0ceeb0 0x7f87ec153420 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f87dc0ac040 tx=0x7f87dc01ad50 comp rx=0 tx=0).stop 2023-08-25T04:21:32.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.758+0000 7f87f1940640 1 -- 172.21.15.55:0/2934391627 shutdown_connections 2023-08-25T04:21:32.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.758+0000 7f87f1940640 1 --2- 172.21.15.55:0/2934391627 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87ec15ef80 0x7f87ec1f9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:32.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.758+0000 7f87f1940640 1 --2- 172.21.15.55:0/2934391627 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87ec15eba0 0x7f87ec0c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:32.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.758+0000 7f87f1940640 1 --2- 172.21.15.55:0/2934391627 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f87cc0657a0 0x7f87cc067c60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:32.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.758+0000 7f87f1940640 1 --2- 172.21.15.55:0/2934391627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87ec0ceeb0 0x7f87ec153420 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:32.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.758+0000 7f87f1940640 1 -- 172.21.15.55:0/2934391627 >> 172.21.15.55:0/2934391627 conn(0x7f87ec069d00 msgr2=0x7f87ec0ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.758+0000 7f87f1940640 1 -- 172.21.15.55:0/2934391627 shutdown_connections 2023-08-25T04:21:32.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:32.758+0000 7f87f1940640 1 -- 172.21.15.55:0/2934391627 wait complete. 2023-08-25T04:21:33.179 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-25T04:21:22.282732+0000', 'modified': '2023-08-25T04:21:25.909779+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8436}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8436': {'gid': 8436, 'name': 'c', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6835/1257898577', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6833', 'nonce': 1257898577}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 1257898577}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-25T04:21:33.179 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-25T04:21:33.180 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-25T04:21:33.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.330+0000 7feba14bd640 1 Processor -- start 2023-08-25T04:21:33.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.330+0000 7feba14bd640 1 -- start start 2023-08-25T04:21:33.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.330+0000 7feba14bd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feb9c0d0da0 0x7feb9c0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.330+0000 7feba14bd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb9c0cdde0 0x7feb9c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.330+0000 7feba14bd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c0b29b0 con 0x7feb9c0cee60 2023-08-25T04:21:33.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.330+0000 7feba14bd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c0ce760 con 0x7feb9c0cdde0 2023-08-25T04:21:33.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.330+0000 7feba14bd640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c0d16c0 con 0x7feb9c0d0da0 2023-08-25T04:21:33.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.330+0000 7feb93fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb9c0cdde0 0x7feb9c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.330+0000 7feb93fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb9c0cdde0 0x7feb9c0ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44516/0 (socket says 172.21.15.55:44516) 2023-08-25T04:21:33.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.330+0000 7feb93fff640 1 -- 172.21.15.55:0/3072646993 learned_addr learned my addr 172.21.15.55:0/3072646993 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:33.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.330+0000 7feb9affd640 1 --2- 172.21.15.55:0/3072646993 >> v2:172.21.15.110:3300/0 conn(0x7feb9c0d0da0 0x7feb9c0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.330+0000 7feb93fff640 1 -- 172.21.15.55:0/3072646993 >> v2:172.21.15.110:3300/0 conn(0x7feb9c0d0da0 msgr2=0x7feb9c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:33.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.330+0000 7feb93fff640 1 --2- 172.21.15.55:0/3072646993 >> v2:172.21.15.110:3300/0 conn(0x7feb9c0d0da0 0x7feb9c0d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.334+0000 7feb93fff640 1 -- 172.21.15.55:0/3072646993 >> v1:172.21.15.55:6789/0 conn(0x7feb9c0cee60 legacy=0x7feb9c0cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:33.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.334+0000 7feb93fff640 1 -- 172.21.15.55:0/3072646993 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c0b1dc0 con 0x7feb9c0cdde0 2023-08-25T04:21:33.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.334+0000 7feb93fff640 1 --2- 172.21.15.55:0/3072646993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb9c0cdde0 0x7feb9c0ce220 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7feb9c073720 tx=0x7feb8401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d122bc3e3a618aee server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:33.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.334+0000 7feb9a7fc640 1 -- 172.21.15.55:0/3072646993 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb840a89f0 con 0x7feb9c0cdde0 2023-08-25T04:21:33.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.334+0000 7feb9a7fc640 1 -- 172.21.15.55:0/3072646993 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb840a8b50 con 0x7feb9c0cdde0 2023-08-25T04:21:33.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.334+0000 7feb9a7fc640 1 -- 172.21.15.55:0/3072646993 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb840b0440 con 0x7feb9c0cdde0 2023-08-25T04:21:33.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.334+0000 7feba14bd640 1 -- 172.21.15.55:0/3072646993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb9c0cdde0 msgr2=0x7feb9c0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:33.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.334+0000 7feba14bd640 1 --2- 172.21.15.55:0/3072646993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb9c0cdde0 0x7feb9c0ce220 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7feb9c073720 tx=0x7feb8401ecf0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.334+0000 7feba14bd640 1 -- 172.21.15.55:0/3072646993 shutdown_connections 2023-08-25T04:21:33.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.334+0000 7feba14bd640 1 --2- 172.21.15.55:0/3072646993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb9c0cdde0 0x7feb9c0ce220 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.334+0000 7feba14bd640 1 --2- 172.21.15.55:0/3072646993 >> v2:172.21.15.110:3300/0 conn(0x7feb9c0d0da0 0x7feb9c0d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.334+0000 7feba14bd640 1 -- 172.21.15.55:0/3072646993 >> 172.21.15.55:0/3072646993 conn(0x7feb9c09bae0 msgr2=0x7feb9c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:33.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.334+0000 7feba14bd640 1 -- 172.21.15.55:0/3072646993 shutdown_connections 2023-08-25T04:21:33.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.334+0000 7feba14bd640 1 -- 172.21.15.55:0/3072646993 wait complete. 2023-08-25T04:21:33.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feba14bd640 1 Processor -- start 2023-08-25T04:21:33.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feba14bd640 1 -- start start 2023-08-25T04:21:33.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feba14bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb9c0cdde0 0x7feb9c1517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feba14bd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb9c0cee60 0x7feb9c0b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feba14bd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb9c0d0da0 0x7feb9c0b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feba14bd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0cc770 con 0x7feb9c0cdde0 2023-08-25T04:21:33.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feba14bd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c1f1ed0 con 0x7feb9c0cee60 2023-08-25T04:21:33.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feba14bd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0ca440 con 0x7feb9c0d0da0 2023-08-25T04:21:33.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feb9affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb9c0cdde0 0x7feb9c1517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feb9affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb9c0cdde0 0x7feb9c1517f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44524/0 (socket says 172.21.15.55:44524) 2023-08-25T04:21:33.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feb9affd640 1 -- 172.21.15.55:0/1725041778 learned_addr learned my addr 172.21.15.55:0/1725041778 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:33.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feb93fff640 1 --2- 172.21.15.55:0/1725041778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb9c0cee60 0x7feb9c0b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feb9b7fe640 1 --2- 172.21.15.55:0/1725041778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb9c0d0da0 0x7feb9c0b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feb9affd640 1 -- 172.21.15.55:0/1725041778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb9c0d0da0 msgr2=0x7feb9c0b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:33.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feb9affd640 1 --2- 172.21.15.55:0/1725041778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb9c0d0da0 0x7feb9c0b6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feb9affd640 1 -- 172.21.15.55:0/1725041778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb9c0cee60 msgr2=0x7feb9c0b6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:33.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feb9affd640 1 --2- 172.21.15.55:0/1725041778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb9c0cee60 0x7feb9c0b6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feb9affd640 1 -- 172.21.15.55:0/1725041778 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb840094d0 con 0x7feb9c0cdde0 2023-08-25T04:21:33.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feb9affd640 1 --2- 172.21.15.55:0/1725041778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb9c0cdde0 0x7feb9c1517f0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00d800 tx=0x7feb8c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:33.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feb937fe640 1 -- 172.21.15.55:0/1725041778 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c018070 con 0x7feb9c0cdde0 2023-08-25T04:21:33.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feb937fe640 1 -- 172.21.15.55:0/1725041778 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c0059a0 con 0x7feb9c0cdde0 2023-08-25T04:21:33.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feb937fe640 1 -- 172.21.15.55:0/1725041778 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c005b50 con 0x7feb9c0cdde0 2023-08-25T04:21:33.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.338+0000 7feba14bd640 1 -- 172.21.15.55:0/1725041778 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c0ca720 con 0x7feb9c0cdde0 2023-08-25T04:21:33.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.342+0000 7feba14bd640 1 -- 172.21.15.55:0/1725041778 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c0cace0 con 0x7feb9c0cdde0 2023-08-25T04:21:33.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.342+0000 7feb937fe640 1 -- 172.21.15.55:0/1725041778 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7feb8c005cb0 con 0x7feb9c0cdde0 2023-08-25T04:21:33.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.342+0000 7feb937fe640 1 --2- 172.21.15.55:0/1725041778 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7feb7c0657a0 0x7feb7c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feb937fe640 1 -- 172.21.15.55:0/1725041778 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feb8c082d10 con 0x7feb9c0cdde0 2023-08-25T04:21:33.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feba4826000 1 Processor -- start 2023-08-25T04:21:33.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feb93fff640 1 --2- 172.21.15.55:0/1725041778 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7feb7c0657a0 0x7feb7c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feba4826000 1 -- start start 2023-08-25T04:21:33.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feb93fff640 1 --2- 172.21.15.55:0/1725041778 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7feb7c0657a0 0x7feb7c067c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb840b2000 tx=0x7feb84009040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:33.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feba4826000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 0x56105843f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feba4826000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56105843f940 0x5610583f5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feba4826000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5610583f55b0 0x5610583f5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feba4826000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56105824b440 con 0x56105843f020 2023-08-25T04:21:33.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feba4826000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x561058248970 con 0x56105843f940 2023-08-25T04:21:33.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feba4826000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x561058244260 con 0x5610583f55b0 2023-08-25T04:21:33.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feb9affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 0x56105843f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feb9affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 0x56105843f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44528/0 (socket says 172.21.15.55:44528) 2023-08-25T04:21:33.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feb9affd640 1 -- 172.21.15.55:0/3307924544 learned_addr learned my addr 172.21.15.55:0/3307924544 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:33.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feb9b7fe640 1 --2- 172.21.15.55:0/3307924544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5610583f55b0 0x5610583f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feb93fff640 1 --2- 172.21.15.55:0/3307924544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56105843f940 0x5610583f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feb9affd640 1 -- 172.21.15.55:0/3307924544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5610583f55b0 msgr2=0x5610583f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:33.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feb9affd640 1 --2- 172.21.15.55:0/3307924544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5610583f55b0 0x5610583f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feb9affd640 1 -- 172.21.15.55:0/3307924544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56105843f940 msgr2=0x5610583f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:33.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feb9affd640 1 --2- 172.21.15.55:0/3307924544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56105843f940 0x5610583f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feb9affd640 1 -- 172.21.15.55:0/3307924544 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610582dcec0 con 0x56105843f020 2023-08-25T04:21:33.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feb93fff640 1 --2- 172.21.15.55:0/3307924544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56105843f940 0x5610583f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:33.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feb9affd640 1 --2- 172.21.15.55:0/3307924544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 0x56105843f400 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00b4b0 tx=0x7feb8c054080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e770c0219c8820 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:33.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feb90ff9640 1 -- 172.21.15.55:0/3307924544 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c05c120 con 0x56105843f020 2023-08-25T04:21:33.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feb90ff9640 1 -- 172.21.15.55:0/3307924544 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c0810d0 con 0x56105843f020 2023-08-25T04:21:33.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feb90ff9640 1 -- 172.21.15.55:0/3307924544 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c081240 con 0x56105843f020 2023-08-25T04:21:33.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feba4826000 1 -- 172.21.15.55:0/3307924544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 msgr2=0x56105843f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:33.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feba4826000 1 --2- 172.21.15.55:0/3307924544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 0x56105843f400 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00b4b0 tx=0x7feb8c054080 comp rx=0 tx=0).stop 2023-08-25T04:21:33.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feba4826000 1 -- 172.21.15.55:0/3307924544 shutdown_connections 2023-08-25T04:21:33.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feba4826000 1 --2- 172.21.15.55:0/3307924544 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5610583f55b0 0x5610583f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feba4826000 1 --2- 172.21.15.55:0/3307924544 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56105843f940 0x5610583f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feba4826000 1 --2- 172.21.15.55:0/3307924544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 0x56105843f400 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feba4826000 1 -- 172.21.15.55:0/3307924544 >> 172.21.15.55:0/3307924544 conn(0x5610583f1560 msgr2=0x5610583f3950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:33.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feba4826000 1 -- 172.21.15.55:0/3307924544 shutdown_connections 2023-08-25T04:21:33.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.346+0000 7feba4826000 1 -- 172.21.15.55:0/3307924544 wait complete. 2023-08-25T04:21:33.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feba4826000 1 -- start start 2023-08-25T04:21:33.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feba4826000 1 Processor -- start 2023-08-25T04:21:33.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feba4826000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5610583f55b0 0x561058446380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feba4826000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 0x5610584468c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feba4826000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56105843f940 0x56105842cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feba4826000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610581fef60 con 0x56105843f020 2023-08-25T04:21:33.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feba4826000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610581fec00 con 0x56105843f940 2023-08-25T04:21:33.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feba4826000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x561057eff940 con 0x5610583f55b0 2023-08-25T04:21:33.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feba4826000 10 client.0 _ll_register_callbacks cb 0x5610583e0900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:21:33.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feb93fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 0x5610584468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feb93fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 0x5610584468c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44534/0 (socket says 172.21.15.55:44534) 2023-08-25T04:21:33.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feb93fff640 1 -- 172.21.15.55:0/1667076981 learned_addr learned my addr 172.21.15.55:0/1667076981 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:33.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feb9b7fe640 1 --2- 172.21.15.55:0/1667076981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56105843f940 0x56105842cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feb9affd640 1 --2- 172.21.15.55:0/1667076981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5610583f55b0 0x561058446380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feb93fff640 1 -- 172.21.15.55:0/1667076981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5610583f55b0 msgr2=0x561058446380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:33.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feb93fff640 1 --2- 172.21.15.55:0/1667076981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5610583f55b0 0x561058446380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feb93fff640 1 -- 172.21.15.55:0/1667076981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56105843f940 msgr2=0x56105842cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:33.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feb93fff640 1 --2- 172.21.15.55:0/1667076981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56105843f940 0x56105842cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feb93fff640 1 -- 172.21.15.55:0/1667076981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c0cace0 con 0x56105843f020 2023-08-25T04:21:33.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feb93fff640 1 --2- 172.21.15.55:0/1667076981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 0x5610584468c0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7feb8409b510 tx=0x7feb840046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0513e29ea4eecb9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:33.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feb79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T04:21:33.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feb79ffb640 1 -- 172.21.15.55:0/1667076981 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb840c0040 con 0x56105843f020 2023-08-25T04:21:33.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feba4826000 1 -- 172.21.15.55:0/1667076981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610581db9d0 con 0x56105843f020 2023-08-25T04:21:33.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feb79ffb640 1 -- 172.21.15.55:0/1667076981 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feb840bb420 con 0x56105843f020 2023-08-25T04:21:33.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feb79ffb640 1 -- 172.21.15.55:0/1667076981 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb840bb5e0 con 0x56105843f020 2023-08-25T04:21:33.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feba4826000 10 client.8610 fetch_fsmap learned FSMap version 58 2023-08-25T04:21:33.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feba4826000 1 -- 172.21.15.55:0/1667076981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x561057f3e890 con 0x56105843f020 2023-08-25T04:21:33.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feb79ffb640 1 -- 172.21.15.55:0/1667076981 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5610581db9d0 con 0x56105843f020 2023-08-25T04:21:33.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feb79ffb640 1 -- 172.21.15.55:0/1667076981 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7feb840c3030 con 0x56105843f020 2023-08-25T04:21:33.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feba4826000 10 client.8610 fetch_fsmap finished waiting for FSMap version 58 2023-08-25T04:21:33.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feba4826000 10 client.8610 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T04:21:33.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feba4826000 20 client.8610 populate_metadata read hostname 'smithi055' 2023-08-25T04:21:33.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feba4826000 1 --2- 172.21.15.55:0/1667076981 >> [v2:172.21.15.55:6833/1257898577,v1:172.21.15.55:6835/1257898577] conn(0x56105842db40 0x56105842df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feba4826000 4 client.8610 mds_command: new command op to 8436 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-25T04:21:33.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feba4826000 1 -- 172.21.15.55:0/1667076981 --> [v2:172.21.15.55:6833/1257898577,v1:172.21.15.55:6835/1257898577] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610581fb7a0 con 0x56105842db40 2023-08-25T04:21:33.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.350+0000 7feb9affd640 1 --2- 172.21.15.55:0/1667076981 >> [v2:172.21.15.55:6833/1257898577,v1:172.21.15.55:6835/1257898577] conn(0x56105842db40 0x56105842df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.354+0000 7feb9affd640 1 --2- 172.21.15.55:0/1667076981 >> [v2:172.21.15.55:6833/1257898577,v1:172.21.15.55:6835/1257898577] conn(0x56105842db40 0x56105842df20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78f7878a21ead1dd server_cookie=278f424f3e5843b6 in_seq=0 out_seq=0 2023-08-25T04:21:33.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.354+0000 7feb79ffb640 10 client.8610 ms_handle_connect on v2:172.21.15.55:6833/1257898577 2023-08-25T04:21:33.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.354+0000 7feb79ffb640 1 -- 172.21.15.55:0/1667076981 <== mds.0 v2:172.21.15.55:6833/1257898577 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5610581fb7a0 con 0x56105842db40 2023-08-25T04:21:33.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.354+0000 7feb79ffb640 10 client.8610 handle_command_reply: tid=0 2023-08-25T04:21:33.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.354+0000 7feba4826000 1 client.8610 shutdown 2023-08-25T04:21:33.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.354+0000 7feba4826000 1 -- 172.21.15.55:0/1667076981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 msgr2=0x5610584468c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:33.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.354+0000 7feba4826000 1 --2- 172.21.15.55:0/1667076981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 0x5610584468c0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7feb8409b510 tx=0x7feb840046d0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.354+0000 7feba4826000 1 -- 172.21.15.55:0/1667076981 shutdown_connections 2023-08-25T04:21:33.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.354+0000 7feba4826000 1 --2- 172.21.15.55:0/1667076981 >> [v2:172.21.15.55:6833/1257898577,v1:172.21.15.55:6835/1257898577] conn(0x56105842db40 0x56105842df20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.354+0000 7feba4826000 1 --2- 172.21.15.55:0/1667076981 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x56105843f940 0x56105842cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.354+0000 7feba4826000 1 --2- 172.21.15.55:0/1667076981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 0x5610584468c0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.354+0000 7feba4826000 1 --2- 172.21.15.55:0/1667076981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5610583f55b0 0x561058446380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.354+0000 7feb79ffb640 0 client.8610 ms_handle_reset on v2:172.21.15.55:6833/1257898577 2023-08-25T04:21:33.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.354+0000 7feba4826000 1 -- 172.21.15.55:0/1667076981 >> 172.21.15.55:0/1667076981 conn(0x5610583f1560 msgr2=0x5610583f41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:33.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.354+0000 7feba4826000 1 -- 172.21.15.55:0/1667076981 shutdown_connections 2023-08-25T04:21:33.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.354+0000 7feba4826000 1 -- 172.21.15.55:0/1667076981 wait complete. 2023-08-25T04:21:33.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.354+0000 7feba4826000 20 client.8610 trim_cache size 0 max 16384 2023-08-25T04:21:33.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feba4826000 1 Processor -- start 2023-08-25T04:21:33.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feba4826000 1 -- start start 2023-08-25T04:21:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feba4826000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5610583f1560 0x561058499d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feba4826000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5610583f55b0 0x56105849a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feba4826000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 0x56105842c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feba4826000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561058204430 con 0x56105843f020 2023-08-25T04:21:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feba4826000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610581fb640 con 0x5610583f55b0 2023-08-25T04:21:33.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feba4826000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x561058241660 con 0x5610583f1560 2023-08-25T04:21:33.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feb9b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 0x56105842c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feb9b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 0x56105842c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44538/0 (socket says 172.21.15.55:44538) 2023-08-25T04:21:33.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feb9b7fe640 1 -- 172.21.15.55:0/2331334710 learned_addr learned my addr 172.21.15.55:0/2331334710 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:33.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feb9affd640 1 --2- 172.21.15.55:0/2331334710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5610583f1560 0x561058499d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feb93fff640 1 --2- 172.21.15.55:0/2331334710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5610583f55b0 0x56105849a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feb9b7fe640 1 -- 172.21.15.55:0/2331334710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5610583f1560 msgr2=0x561058499d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feb9b7fe640 1 --2- 172.21.15.55:0/2331334710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5610583f1560 0x561058499d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feb9b7fe640 1 -- 172.21.15.55:0/2331334710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5610583f55b0 msgr2=0x56105849a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feb9b7fe640 1 --2- 172.21.15.55:0/2331334710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5610583f55b0 0x56105849a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feb9b7fe640 1 -- 172.21.15.55:0/2331334710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561058207190 con 0x56105843f020 2023-08-25T04:21:33.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feb93fff640 1 --2- 172.21.15.55:0/2331334710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5610583f55b0 0x56105849a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feb9b7fe640 1 --2- 172.21.15.55:0/2331334710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 0x56105842c640 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7feb94001d20 tx=0x7feb940021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3f197e8a4c7b09 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feb917fa640 1 -- 172.21.15.55:0/2331334710 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94014d50 con 0x56105843f020 2023-08-25T04:21:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feb917fa640 1 -- 172.21.15.55:0/2331334710 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb94014eb0 con 0x56105843f020 2023-08-25T04:21:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feb917fa640 1 -- 172.21.15.55:0/2331334710 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94003b80 con 0x56105843f020 2023-08-25T04:21:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feba4826000 1 -- 172.21.15.55:0/2331334710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 msgr2=0x56105842c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feba4826000 1 --2- 172.21.15.55:0/2331334710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 0x56105842c640 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7feb94001d20 tx=0x7feb940021e0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feba4826000 1 -- 172.21.15.55:0/2331334710 shutdown_connections 2023-08-25T04:21:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feba4826000 1 --2- 172.21.15.55:0/2331334710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56105843f020 0x56105842c640 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feba4826000 1 --2- 172.21.15.55:0/2331334710 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5610583f55b0 0x56105849a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feba4826000 1 --2- 172.21.15.55:0/2331334710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5610583f1560 0x561058499d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feba4826000 1 -- 172.21.15.55:0/2331334710 >> 172.21.15.55:0/2331334710 conn(0x56105843e560 msgr2=0x56105842bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feba4826000 1 -- 172.21.15.55:0/2331334710 shutdown_connections 2023-08-25T04:21:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.370+0000 7feba4826000 1 -- 172.21.15.55:0/2331334710 wait complete. 2023-08-25T04:21:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feba4826000 1 -- start start 2023-08-25T04:21:33.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feba4826000 1 Processor -- start 2023-08-25T04:21:33.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feba4826000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5610583f1560 0x561058444850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feba4826000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5610583f55b0 0x56105845a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feba4826000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x56105843f020 0x56105845a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feba4826000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561058215e80 con 0x5610583f55b0 2023-08-25T04:21:33.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feba4826000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x561058455970 con 0x5610583f1560 2023-08-25T04:21:33.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feba4826000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x561058249b10 con 0x56105843f020 2023-08-25T04:21:33.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feba4826000 10 client.0 _ll_register_callbacks cb 0x7feb8c0507d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:21:33.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb93fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5610583f55b0 0x56105845a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb9affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5610583f1560 0x561058444850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb9affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5610583f1560 0x561058444850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:50268/0 (socket says 172.21.15.55:50268) 2023-08-25T04:21:33.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb93fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5610583f55b0 0x56105845a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44542/0 (socket says 172.21.15.55:44542) 2023-08-25T04:21:33.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb9affd640 1 -- 172.21.15.55:0/1394085772 learned_addr learned my addr 172.21.15.55:0/1394085772 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:33.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb9b7fe640 1 --2- 172.21.15.55:0/1394085772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x56105843f020 0x56105845a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb93fff640 1 -- 172.21.15.55:0/1394085772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x56105843f020 msgr2=0x56105845a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:33.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb93fff640 1 --2- 172.21.15.55:0/1394085772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x56105843f020 0x56105845a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb93fff640 1 -- 172.21.15.55:0/1394085772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5610583f1560 msgr2=0x561058444850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:33.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb93fff640 1 --2- 172.21.15.55:0/1394085772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5610583f1560 0x561058444850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb93fff640 1 -- 172.21.15.55:0/1394085772 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9400f040 con 0x5610583f55b0 2023-08-25T04:21:33.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb9affd640 1 --2- 172.21.15.55:0/1394085772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5610583f1560 0x561058444850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:33.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb93fff640 1 --2- 172.21.15.55:0/1394085772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5610583f55b0 0x56105845a370 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7feb8401f590 tx=0x7feb8401d530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a46386fe749e04 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:33.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T04:21:33.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb79ffb640 1 -- 172.21.15.55:0/1394085772 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb840bbc10 con 0x5610583f55b0 2023-08-25T04:21:33.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feba4826000 1 -- 172.21.15.55:0/1394085772 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561058455ab0 con 0x5610583f55b0 2023-08-25T04:21:33.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb79ffb640 1 -- 172.21.15.55:0/1394085772 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feb840bbd70 con 0x5610583f55b0 2023-08-25T04:21:33.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb79ffb640 1 -- 172.21.15.55:0/1394085772 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb840b0ac0 con 0x5610583f55b0 2023-08-25T04:21:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feba4826000 10 client.8616 fetch_fsmap learned FSMap version 58 2023-08-25T04:21:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feba4826000 1 -- 172.21.15.55:0/1394085772 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x5610581ed420 con 0x5610583f55b0 2023-08-25T04:21:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb79ffb640 1 -- 172.21.15.55:0/1394085772 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561058455ab0 con 0x5610583f55b0 2023-08-25T04:21:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb79ffb640 1 -- 172.21.15.55:0/1394085772 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7feb840e3020 con 0x5610583f55b0 2023-08-25T04:21:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feba4826000 10 client.8616 fetch_fsmap finished waiting for FSMap version 58 2023-08-25T04:21:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feba4826000 10 client.8616 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T04:21:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feba4826000 20 client.8616 populate_metadata read hostname 'smithi055' 2023-08-25T04:21:33.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feba4826000 1 --2- 172.21.15.55:0/1394085772 >> [v2:172.21.15.55:6833/1257898577,v1:172.21.15.55:6835/1257898577] conn(0x56105843f940 0x56105849e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feba4826000 4 client.8616 mds_command: new command op to 8436 tid=0[{"prefix": "status"}] 2023-08-25T04:21:33.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feba4826000 1 -- 172.21.15.55:0/1394085772 --> [v2:172.21.15.55:6833/1257898577,v1:172.21.15.55:6835/1257898577] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5610581ff880 con 0x56105843f940 2023-08-25T04:21:33.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.374+0000 7feb9affd640 1 --2- 172.21.15.55:0/1394085772 >> [v2:172.21.15.55:6833/1257898577,v1:172.21.15.55:6835/1257898577] conn(0x56105843f940 0x56105849e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feb79ffb640 10 client.8616 ms_handle_connect on v2:172.21.15.55:6833/1257898577 2023-08-25T04:21:33.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feb9affd640 1 --2- 172.21.15.55:0/1394085772 >> [v2:172.21.15.55:6833/1257898577,v1:172.21.15.55:6835/1257898577] conn(0x56105843f940 0x56105849e440 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e9a982a348e7f4d server_cookie=ce112bc1da5e4ff1 in_seq=0 out_seq=0 2023-08-25T04:21:33.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feb79ffb640 1 -- 172.21.15.55:0/1394085772 <== mds.0 v2:172.21.15.55:6833/1257898577 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5610581ff880 con 0x56105843f940 2023-08-25T04:21:33.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feb79ffb640 10 client.8616 handle_command_reply: tid=0 2023-08-25T04:21:33.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba4826000 1 client.8616 shutdown 2023-08-25T04:21:33.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba4826000 1 -- 172.21.15.55:0/1394085772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5610583f55b0 msgr2=0x56105845a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:33.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba4826000 1 --2- 172.21.15.55:0/1394085772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5610583f55b0 0x56105845a370 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7feb8401f590 tx=0x7feb8401d530 comp rx=0 tx=0).stop 2023-08-25T04:21:33.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba4826000 1 -- 172.21.15.55:0/1394085772 shutdown_connections 2023-08-25T04:21:33.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba4826000 1 --2- 172.21.15.55:0/1394085772 >> [v2:172.21.15.55:6833/1257898577,v1:172.21.15.55:6835/1257898577] conn(0x56105843f940 0x56105849e440 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba4826000 1 --2- 172.21.15.55:0/1394085772 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x56105843f020 0x56105845a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba4826000 1 --2- 172.21.15.55:0/1394085772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5610583f55b0 0x56105845a370 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba4826000 1 --2- 172.21.15.55:0/1394085772 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5610583f1560 0x561058444850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba4826000 1 -- 172.21.15.55:0/1394085772 >> 172.21.15.55:0/1394085772 conn(0x56105843e560 msgr2=0x56105842c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:33.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feb79ffb640 0 client.8616 ms_handle_reset on v2:172.21.15.55:6833/1257898577 2023-08-25T04:21:33.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba4826000 1 -- 172.21.15.55:0/1394085772 shutdown_connections 2023-08-25T04:21:33.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba4826000 1 -- 172.21.15.55:0/1394085772 wait complete. 2023-08-25T04:21:33.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba4826000 20 client.8616 trim_cache size 0 max 16384 2023-08-25T04:21:33.385 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T04:21:33.385 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2d2a9024-b152-4d40-880c-1686d1810590", 2023-08-25T04:21:33.385 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-08-25T04:21:33.385 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 8436, 2023-08-25T04:21:33.385 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-08-25T04:21:33.385 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-08-25T04:21:33.385 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-08-25T04:21:33.386 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.483581281999999, 2023-08-25T04:21:33.386 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 58, 2023-08-25T04:21:33.386 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 122, 2023-08-25T04:21:33.386 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 122, 2023-08-25T04:21:33.386 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 16.375801024000001 2023-08-25T04:21:33.386 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T04:21:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba14bd640 1 -- 172.21.15.55:0/1725041778 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7feb7c0657a0 msgr2=0x7feb7c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba14bd640 1 --2- 172.21.15.55:0/1725041778 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7feb7c0657a0 0x7feb7c067c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7feb840b2000 tx=0x7feb84009040 comp rx=0 tx=0).stop 2023-08-25T04:21:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba14bd640 1 -- 172.21.15.55:0/1725041778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb9c0cdde0 msgr2=0x7feb9c1517f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:33.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba14bd640 1 --2- 172.21.15.55:0/1725041778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb9c0cdde0 0x7feb9c1517f0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00d800 tx=0x7feb8c00dcc0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba14bd640 1 -- 172.21.15.55:0/1725041778 shutdown_connections 2023-08-25T04:21:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba14bd640 1 --2- 172.21.15.55:0/1725041778 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb9c0d0da0 0x7feb9c0b6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba14bd640 1 --2- 172.21.15.55:0/1725041778 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb9c0cee60 0x7feb9c0b6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba14bd640 1 --2- 172.21.15.55:0/1725041778 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7feb7c0657a0 0x7feb7c067c60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba14bd640 1 --2- 172.21.15.55:0/1725041778 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb9c0cdde0 0x7feb9c1517f0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba14bd640 1 -- 172.21.15.55:0/1725041778 >> 172.21.15.55:0/1725041778 conn(0x7feb9c09bae0 msgr2=0x7feb9c06bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba14bd640 1 -- 172.21.15.55:0/1725041778 shutdown_connections 2023-08-25T04:21:33.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.378+0000 7feba14bd640 1 -- 172.21.15.55:0/1725041778 wait complete. 2023-08-25T04:21:33.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:21:33.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.542+0000 7fb08a367640 1 Processor -- start 2023-08-25T04:21:33.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.542+0000 7fb08a367640 1 -- start start 2023-08-25T04:21:33.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.542+0000 7fb08a367640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb0840cb2a0 0x7fb0840b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.542+0000 7fb08a367640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb084159f10 0x7fb0840c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.542+0000 7fb08a367640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0840cdbf0 con 0x7fb084158e10 2023-08-25T04:21:33.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.542+0000 7fb08a367640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0840ad940 con 0x7fb084159f10 2023-08-25T04:21:33.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.542+0000 7fb08a367640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08406d380 con 0x7fb0840cb2a0 2023-08-25T04:21:33.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.542+0000 7fb088904640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb084159f10 0x7fb0840c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.542+0000 7fb0837fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb0840cb2a0 0x7fb0840b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.542+0000 7fb0837fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb0840cb2a0 0x7fb0840b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:50278/0 (socket says 172.21.15.55:50278) 2023-08-25T04:21:33.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.542+0000 7fb0837fe640 1 -- 172.21.15.55:0/1835990093 learned_addr learned my addr 172.21.15.55:0/1835990093 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:33.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.542+0000 7fb083fff640 1 --1- 172.21.15.55:0/1835990093 >> v1:172.21.15.110:6789/0 conn(0x7fb084158e10 0x7fb0840cab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:41724/0 (socket says 172.21.15.55:41724) 2023-08-25T04:21:33.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.542+0000 7fb088904640 1 -- 172.21.15.55:0/1835990093 >> v2:172.21.15.110:3300/0 conn(0x7fb0840cb2a0 msgr2=0x7fb0840b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:33.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.542+0000 7fb088904640 1 --2- 172.21.15.55:0/1835990093 >> v2:172.21.15.110:3300/0 conn(0x7fb0840cb2a0 0x7fb0840b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.542+0000 7fb088904640 1 -- 172.21.15.55:0/1835990093 >> v1:172.21.15.110:6789/0 conn(0x7fb084158e10 legacy=0x7fb0840cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:33.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.542+0000 7fb088904640 1 -- 172.21.15.55:0/1835990093 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08406d660 con 0x7fb084159f10 2023-08-25T04:21:33.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.542+0000 7fb0837fe640 1 --2- 172.21.15.55:0/1835990093 >> v2:172.21.15.110:3300/0 conn(0x7fb0840cb2a0 0x7fb0840b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:33.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.546+0000 7fb088904640 1 --2- 172.21.15.55:0/1835990093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb084159f10 0x7fb0840c9a00 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fb0840c1b70 tx=0x7fb07c01f570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9bf7865ebf86f54 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:33.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.546+0000 7fb082ffd640 1 -- 172.21.15.55:0/1835990093 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c00b2d0 con 0x7fb084159f10 2023-08-25T04:21:33.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.546+0000 7fb082ffd640 1 -- 172.21.15.55:0/1835990093 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c0a7980 con 0x7fb084159f10 2023-08-25T04:21:33.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.546+0000 7fb082ffd640 1 -- 172.21.15.55:0/1835990093 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0a7d10 con 0x7fb084159f10 2023-08-25T04:21:33.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.546+0000 7fb08a367640 1 -- 172.21.15.55:0/1835990093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb084159f10 msgr2=0x7fb0840c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:33.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.546+0000 7fb08a367640 1 --2- 172.21.15.55:0/1835990093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb084159f10 0x7fb0840c9a00 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fb0840c1b70 tx=0x7fb07c01f570 comp rx=0 tx=0).stop 2023-08-25T04:21:33.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.546+0000 7fb08a367640 1 -- 172.21.15.55:0/1835990093 shutdown_connections 2023-08-25T04:21:33.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.546+0000 7fb08a367640 1 --2- 172.21.15.55:0/1835990093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb084159f10 0x7fb0840c9a00 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.546+0000 7fb08a367640 1 --2- 172.21.15.55:0/1835990093 >> v2:172.21.15.110:3300/0 conn(0x7fb0840cb2a0 0x7fb0840b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.546+0000 7fb08a367640 1 -- 172.21.15.55:0/1835990093 >> 172.21.15.55:0/1835990093 conn(0x7fb084069d00 msgr2=0x7fb08406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:33.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.546+0000 7fb08a367640 1 -- 172.21.15.55:0/1835990093 shutdown_connections 2023-08-25T04:21:33.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.546+0000 7fb08a367640 1 -- 172.21.15.55:0/1835990093 wait complete. 2023-08-25T04:21:33.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb08a367640 1 Processor -- start 2023-08-25T04:21:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb08a367640 1 -- start start 2023-08-25T04:21:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb08a367640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0840cb2a0 0x7fb084097810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb08a367640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb084158e10 0x7fb084163a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb08a367640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb084159f10 0x7fb08415bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb08a367640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0841622f0 con 0x7fb084158e10 2023-08-25T04:21:33.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb08a367640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0841625d0 con 0x7fb084159f10 2023-08-25T04:21:33.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb08a367640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0841628b0 con 0x7fb0840cb2a0 2023-08-25T04:21:33.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb0837fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb084158e10 0x7fb084163a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb0837fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb084158e10 0x7fb084163a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44554/0 (socket says 172.21.15.55:44554) 2023-08-25T04:21:33.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb0837fe640 1 -- 172.21.15.55:0/932167225 learned_addr learned my addr 172.21.15.55:0/932167225 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:33.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb088904640 1 --2- 172.21.15.55:0/932167225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb084159f10 0x7fb08415bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb083fff640 1 --2- 172.21.15.55:0/932167225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0840cb2a0 0x7fb084097810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb0837fe640 1 -- 172.21.15.55:0/932167225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0840cb2a0 msgr2=0x7fb084097810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:33.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb0837fe640 1 --2- 172.21.15.55:0/932167225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0840cb2a0 0x7fb084097810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb0837fe640 1 -- 172.21.15.55:0/932167225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb084159f10 msgr2=0x7fb08415bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:33.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb0837fe640 1 --2- 172.21.15.55:0/932167225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb084159f10 0x7fb08415bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb0837fe640 1 -- 172.21.15.55:0/932167225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0780094d0 con 0x7fb084158e10 2023-08-25T04:21:33.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb083fff640 1 --2- 172.21.15.55:0/932167225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0840cb2a0 0x7fb084097810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:33.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb088904640 1 --2- 172.21.15.55:0/932167225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb084159f10 0x7fb08415bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:21:33.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb0837fe640 1 --2- 172.21.15.55:0/932167225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb084158e10 0x7fb084163a30 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fb07800e930 tx=0x7fb07800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:33.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb080ff9640 1 -- 172.21.15.55:0/932167225 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07800ca00 con 0x7fb084158e10 2023-08-25T04:21:33.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb080ff9640 1 -- 172.21.15.55:0/932167225 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07800cb60 con 0x7fb084158e10 2023-08-25T04:21:33.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb08a367640 1 -- 172.21.15.55:0/932167225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c00bc80 con 0x7fb084158e10 2023-08-25T04:21:33.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb080ff9640 1 -- 172.21.15.55:0/932167225 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb078013470 con 0x7fb084158e10 2023-08-25T04:21:33.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb08a367640 1 -- 172.21.15.55:0/932167225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb084159370 con 0x7fb084158e10 2023-08-25T04:21:33.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.550+0000 7fb08a367640 1 -- 172.21.15.55:0/932167225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08404dbe0 con 0x7fb084158e10 2023-08-25T04:21:33.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.554+0000 7fb080ff9640 1 -- 172.21.15.55:0/932167225 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fb0780135d0 con 0x7fb084158e10 2023-08-25T04:21:33.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.554+0000 7fb080ff9640 1 --2- 172.21.15.55:0/932167225 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fb0700657d0 0x7fb070067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:33.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.554+0000 7fb080ff9640 1 -- 172.21.15.55:0/932167225 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb078083200 con 0x7fb084158e10 2023-08-25T04:21:33.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.554+0000 7fb083fff640 1 --2- 172.21.15.55:0/932167225 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fb0700657d0 0x7fb070067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:33.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.554+0000 7fb083fff640 1 --2- 172.21.15.55:0/932167225 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fb0700657d0 0x7fb070067c90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb074007fd0 tx=0x7fb074009040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:33.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.558+0000 7fb080ff9640 1 -- 172.21.15.55:0/932167225 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb078050ba0 con 0x7fb084158e10 2023-08-25T04:21:33.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.754+0000 7fb08a367640 1 -- 172.21.15.55:0/932167225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb0840cd5c0 con 0x7fb084158e10 2023-08-25T04:21:33.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.754+0000 7fb080ff9640 1 -- 172.21.15.55:0/932167225 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb0780541c0 con 0x7fb084158e10 2023-08-25T04:21:33.753 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T04:21:33.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.754+0000 7fb08a367640 1 -- 172.21.15.55:0/932167225 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fb0700657d0 msgr2=0x7fb070067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:33.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.754+0000 7fb08a367640 1 --2- 172.21.15.55:0/932167225 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fb0700657d0 0x7fb070067c90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb074007fd0 tx=0x7fb074009040 comp rx=0 tx=0).stop 2023-08-25T04:21:33.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.754+0000 7fb08a367640 1 -- 172.21.15.55:0/932167225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb084158e10 msgr2=0x7fb084163a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:33.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.754+0000 7fb08a367640 1 --2- 172.21.15.55:0/932167225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb084158e10 0x7fb084163a30 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fb07800e930 tx=0x7fb07800edf0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.754+0000 7fb08a367640 1 -- 172.21.15.55:0/932167225 shutdown_connections 2023-08-25T04:21:33.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.754+0000 7fb08a367640 1 --2- 172.21.15.55:0/932167225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb084159f10 0x7fb08415bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.754+0000 7fb08a367640 1 --2- 172.21.15.55:0/932167225 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fb0700657d0 0x7fb070067c90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.754+0000 7fb08a367640 1 --2- 172.21.15.55:0/932167225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb084158e10 0x7fb084163a30 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.754+0000 7fb08a367640 1 --2- 172.21.15.55:0/932167225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0840cb2a0 0x7fb084097810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:33.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.754+0000 7fb08a367640 1 -- 172.21.15.55:0/932167225 >> 172.21.15.55:0/932167225 conn(0x7fb084069d00 msgr2=0x7fb08406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:33.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.754+0000 7fb08a367640 1 -- 172.21.15.55:0/932167225 shutdown_connections 2023-08-25T04:21:33.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:33.754+0000 7fb08a367640 1 -- 172.21.15.55:0/932167225 wait complete. 2023-08-25T04:21:33.774 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-25T04:21:33.774 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:21:33.775 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-08-25T04:21:33.775 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-25T04:21:33.775 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T04:21:33.775 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-25T04:21:33.776 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-25T04:21:33.776 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:21:33.777 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:21:33.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:33.778 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-08-25T04:21:33.787 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:21:33.787 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:21:33.788 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:21:33.788 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:21:33.788 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-08-25T04:21:33.788 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:21:33.788 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:21:33.788 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:21:33.788 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-08-25T04:21:33.789 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:21:33.789 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:21:33.789 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-08-25T04:21:33.789 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:21:33.789 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:21:33.789 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-08-25T04:21:33.789 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-08-25T04:21:33.790 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41295sec preferred_lft 41295sec 2023-08-25T04:21:33.790 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-08-25T04:21:33.790 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:21:33.790 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:21:33.790 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:21:33.790 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-08-25T04:21:33.790 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-25T04:21:33.791 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:98:6a:38:6a brd ff:ff:ff:ff:ff:ff 2023-08-25T04:21:33.791 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-25T04:21:33.791 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:21:33.791 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:21:33.791 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-08-25T04:21:33.791 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T04:21:33.791 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:21:33.791 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-08-25T04:21:33.792 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:21:33.792 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:21:33.792 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T04:21:33.792 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-08-25T04:21:33.792 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:21:33.792 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:21:33.792 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-25T04:21:33.792 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-08-25T04:21:33.793 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:21:33.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:33.794 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:21:33.855 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-08-25T04:21:33.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:33.857 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-08-25T04:21:33.912 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-08-25T04:21:33.913 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:21:33.913 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-08-25T04:21:33.913 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-25T04:21:33.913 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-08-25T04:21:33.913 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:21:33.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:33.914 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T04:21:33.915 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T04:21:33.915 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-25T04:21:33.915 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-25T04:21:33.916 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-25T04:21:33.916 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T04:21:34.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:34.013 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-08-25T04:21:34.022 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-25T04:21:34.022 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-25T04:21:34.023 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:21:34.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:34.024 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-08-25T04:21:34.088 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:21:34.088 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-25T04:21:34.139 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:21:34.140 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:21:34.141 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:21:34.195 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-25T04:21:34.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:34.196 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:21:34.295 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:21:34.295 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:21:34.310 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:21:34.310 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:21:34.311 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.110:3300,172.21.15.110:3301" 2023-08-25T04:21:34.311 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2d2a9024-b152-4d40-880c-1686d1810590.cephfs=/ 2023-08-25T04:21:34.311 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2023-08-25T04:21:34.314 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T04:21:34.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:34.315 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:21:34.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:34.336 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:21:34.399 INFO:teuthology.orchestra.run.smithi055.stdout:client8086 2023-08-25T04:21:34.399 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:21:34.400 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:21:34.451 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-25T04:21:34.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.638+0000 7fc72d49c640 1 Processor -- start 2023-08-25T04:21:34.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.638+0000 7fc72d49c640 1 -- start start 2023-08-25T04:21:34.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.642+0000 7fc72d49c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7280d0da0 0x7fc7280d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:34.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.642+0000 7fc72d49c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc7280b3e50 0x7fc7280ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:34.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.642+0000 7fc72d49c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7280b29b0 con 0x7fc7280cdde0 2023-08-25T04:21:34.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.642+0000 7fc72d49c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7280ce760 con 0x7fc7280b3e50 2023-08-25T04:21:34.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.642+0000 7fc72d49c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280d16c0 con 0x7fc7280d0da0 2023-08-25T04:21:34.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.642+0000 7fc7277fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc7280b3e50 0x7fc7280ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:34.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.642+0000 7fc7277fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc7280b3e50 0x7fc7280ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44556/0 (socket says 172.21.15.55:44556) 2023-08-25T04:21:34.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.642+0000 7fc7277fe640 1 -- 172.21.15.55:0/2986561449 learned_addr learned my addr 172.21.15.55:0/2986561449 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:34.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.642+0000 7fc71e7fc640 1 --1- 172.21.15.55:0/2986561449 >> v1:172.21.15.55:6789/0 conn(0x7fc7280cdde0 0x7fc7280cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49384/0 (socket says 172.21.15.55:49384) 2023-08-25T04:21:34.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.642+0000 7fc726ffd640 1 --2- 172.21.15.55:0/2986561449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7280d0da0 0x7fc7280d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:34.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.642+0000 7fc7277fe640 1 -- 172.21.15.55:0/2986561449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7280d0da0 msgr2=0x7fc7280d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:34.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.642+0000 7fc7277fe640 1 --2- 172.21.15.55:0/2986561449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7280d0da0 0x7fc7280d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:34.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.642+0000 7fc7277fe640 1 -- 172.21.15.55:0/2986561449 >> v1:172.21.15.55:6789/0 conn(0x7fc7280cdde0 legacy=0x7fc7280cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:34.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.642+0000 7fc7277fe640 1 -- 172.21.15.55:0/2986561449 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7280b1dc0 con 0x7fc7280b3e50 2023-08-25T04:21:34.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.642+0000 7fc726ffd640 1 --2- 172.21.15.55:0/2986561449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7280d0da0 0x7fc7280d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:21:34.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.642+0000 7fc7277fe640 1 --2- 172.21.15.55:0/2986561449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7280b3e50 0x7fc7280ce220 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fc720009e50 tx=0x7fc72001f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7834a10dadd3768 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:34.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc7267fc640 1 -- 172.21.15.55:0/2986561449 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7200af400 con 0x7fc7280b3e50 2023-08-25T04:21:34.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc7267fc640 1 -- 172.21.15.55:0/2986561449 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7200ab050 con 0x7fc7280b3e50 2023-08-25T04:21:34.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc7267fc640 1 -- 172.21.15.55:0/2986561449 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7200af780 con 0x7fc7280b3e50 2023-08-25T04:21:34.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc72d49c640 1 -- 172.21.15.55:0/2986561449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7280b3e50 msgr2=0x7fc7280ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:34.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc72d49c640 1 --2- 172.21.15.55:0/2986561449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7280b3e50 0x7fc7280ce220 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fc720009e50 tx=0x7fc72001f1f0 comp rx=0 tx=0).stop 2023-08-25T04:21:34.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc72d49c640 1 -- 172.21.15.55:0/2986561449 shutdown_connections 2023-08-25T04:21:34.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc72d49c640 1 --2- 172.21.15.55:0/2986561449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7280b3e50 0x7fc7280ce220 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:34.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc72d49c640 1 --2- 172.21.15.55:0/2986561449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7280d0da0 0x7fc7280d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:34.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc72d49c640 1 -- 172.21.15.55:0/2986561449 >> 172.21.15.55:0/2986561449 conn(0x7fc72809bae0 msgr2=0x7fc7280d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:34.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc72d49c640 1 -- 172.21.15.55:0/2986561449 shutdown_connections 2023-08-25T04:21:34.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc72d49c640 1 -- 172.21.15.55:0/2986561449 wait complete. 2023-08-25T04:21:34.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc72d49c640 1 Processor -- start 2023-08-25T04:21:34.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc72d49c640 1 -- start start 2023-08-25T04:21:34.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc72d49c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7280b3e50 0x7fc7280caf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:34.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc72d49c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7280cdde0 0x7fc7281f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:34.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc72d49c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7280d0da0 0x7fc7280c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:34.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc72d49c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280c8810 con 0x7fc7280b3e50 2023-08-25T04:21:34.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc72d49c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280cb490 con 0x7fc7280d0da0 2023-08-25T04:21:34.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc72d49c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7281f3110 con 0x7fc7280cdde0 2023-08-25T04:21:34.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.646+0000 7fc726ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7280b3e50 0x7fc7280caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:34.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.650+0000 7fc726ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7280b3e50 0x7fc7280caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44558/0 (socket says 172.21.15.55:44558) 2023-08-25T04:21:34.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.650+0000 7fc726ffd640 1 -- 172.21.15.55:0/1942375357 learned_addr learned my addr 172.21.15.55:0/1942375357 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:34.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.650+0000 7fc71e7fc640 1 --2- 172.21.15.55:0/1942375357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7280cdde0 0x7fc7281f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:34.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.650+0000 7fc7277fe640 1 --2- 172.21.15.55:0/1942375357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7280d0da0 0x7fc7280c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:34.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.650+0000 7fc726ffd640 1 -- 172.21.15.55:0/1942375357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7280cdde0 msgr2=0x7fc7281f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:34.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.650+0000 7fc726ffd640 1 --2- 172.21.15.55:0/1942375357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7280cdde0 0x7fc7281f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:34.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.650+0000 7fc726ffd640 1 -- 172.21.15.55:0/1942375357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7280d0da0 msgr2=0x7fc7280c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:34.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.650+0000 7fc726ffd640 1 --2- 172.21.15.55:0/1942375357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7280d0da0 0x7fc7280c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:34.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.650+0000 7fc726ffd640 1 -- 172.21.15.55:0/1942375357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc720009b30 con 0x7fc7280b3e50 2023-08-25T04:21:34.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.650+0000 7fc726ffd640 1 --2- 172.21.15.55:0/1942375357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7280b3e50 0x7fc7280caf50 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fc71000d800 tx=0x7fc71000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:34.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.650+0000 7fc71ffff640 1 -- 172.21.15.55:0/1942375357 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7100059a0 con 0x7fc7280b3e50 2023-08-25T04:21:34.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.650+0000 7fc71ffff640 1 -- 172.21.15.55:0/1942375357 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc710005b00 con 0x7fc7280b3e50 2023-08-25T04:21:34.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.650+0000 7fc71ffff640 1 -- 172.21.15.55:0/1942375357 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc710005e90 con 0x7fc7280b3e50 2023-08-25T04:21:34.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.650+0000 7fc72d49c640 1 -- 172.21.15.55:0/1942375357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7280c7b90 con 0x7fc7280b3e50 2023-08-25T04:21:34.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.650+0000 7fc72d49c640 1 -- 172.21.15.55:0/1942375357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7280c8150 con 0x7fc7280b3e50 2023-08-25T04:21:34.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.650+0000 7fc72d49c640 1 -- 172.21.15.55:0/1942375357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72804dbe0 con 0x7fc7280b3e50 2023-08-25T04:21:34.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.650+0000 7fc71ffff640 1 -- 172.21.15.55:0/1942375357 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fc710004030 con 0x7fc7280b3e50 2023-08-25T04:21:34.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.650+0000 7fc71ffff640 1 --2- 172.21.15.55:0/1942375357 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fc7080657a0 0x7fc708067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:34.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.654+0000 7fc71ffff640 1 -- 172.21.15.55:0/1942375357 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc710082f60 con 0x7fc7280b3e50 2023-08-25T04:21:34.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.654+0000 7fc71e7fc640 1 --2- 172.21.15.55:0/1942375357 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fc7080657a0 0x7fc708067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:34.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.654+0000 7fc71e7fc640 1 --2- 172.21.15.55:0/1942375357 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fc7080657a0 0x7fc708067c60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc7280cff00 tx=0x7fc718007c90 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:34.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.654+0000 7fc71ffff640 1 -- 172.21.15.55:0/1942375357 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc710054390 con 0x7fc7280b3e50 2023-08-25T04:21:34.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.838+0000 7fc72d49c640 1 -- 172.21.15.55:0/1942375357 --> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7280b2360 con 0x7fc7080657a0 2023-08-25T04:21:34.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.838+0000 7fc71ffff640 1 -- 172.21.15.55:0/1942375357 <== mgr.6902 v2:172.21.15.110:6832/4272914017 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc718005a60 con 0x7fc7080657a0 2023-08-25T04:21:34.838 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T04:21:34.838 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:21:34.839 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-08-25T04:21:34.839 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:21:34.839 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T04:21:34.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.842+0000 7fc72d49c640 1 -- 172.21.15.55:0/1942375357 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fc7080657a0 msgr2=0x7fc708067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:34.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.842+0000 7fc72d49c640 1 --2- 172.21.15.55:0/1942375357 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fc7080657a0 0x7fc708067c60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc7280cff00 tx=0x7fc718007c90 comp rx=0 tx=0).stop 2023-08-25T04:21:34.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.842+0000 7fc72d49c640 1 -- 172.21.15.55:0/1942375357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7280b3e50 msgr2=0x7fc7280caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:34.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.842+0000 7fc72d49c640 1 --2- 172.21.15.55:0/1942375357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7280b3e50 0x7fc7280caf50 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fc71000d800 tx=0x7fc71000dcc0 comp rx=0 tx=0).stop 2023-08-25T04:21:34.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.842+0000 7fc72d49c640 1 -- 172.21.15.55:0/1942375357 shutdown_connections 2023-08-25T04:21:34.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.842+0000 7fc72d49c640 1 --2- 172.21.15.55:0/1942375357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc7280d0da0 0x7fc7280c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:34.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.842+0000 7fc72d49c640 1 --2- 172.21.15.55:0/1942375357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc7280cdde0 0x7fc7281f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:34.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.842+0000 7fc72d49c640 1 --2- 172.21.15.55:0/1942375357 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7fc7080657a0 0x7fc708067c60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:34.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.842+0000 7fc72d49c640 1 --2- 172.21.15.55:0/1942375357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7280b3e50 0x7fc7280caf50 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:34.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.842+0000 7fc72d49c640 1 -- 172.21.15.55:0/1942375357 >> 172.21.15.55:0/1942375357 conn(0x7fc72809bae0 msgr2=0x7fc7280cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:34.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.842+0000 7fc72d49c640 1 -- 172.21.15.55:0/1942375357 shutdown_connections 2023-08-25T04:21:34.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:34.842+0000 7fc72d49c640 1 -- 172.21.15.55:0/1942375357 wait complete. 2023-08-25T04:21:34.859 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-25T04:21:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.006+0000 7f132f5fa640 1 Processor -- start 2023-08-25T04:21:35.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.006+0000 7f132f5fa640 1 -- start start 2023-08-25T04:21:35.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.006+0000 7f132f5fa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f13281601f0 0x7f132815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:35.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.006+0000 7f132f5fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13280d1290 0x7f132815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:35.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.006+0000 7f132f5fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13280cd5a0 con 0x7f132815e3c0 2023-08-25T04:21:35.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.006+0000 7f132f5fa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13280cd880 con 0x7f13281601f0 2023-08-25T04:21:35.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.006+0000 7f132f5fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13280cdb60 con 0x7f13280d1290 2023-08-25T04:21:35.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.006+0000 7f132cb95640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f132815e3c0 0x7f13280d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49394/0 (socket says 172.21.15.55:49394) 2023-08-25T04:21:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.006+0000 7f132cb95640 1 -- 172.21.15.55:0/2565889919 learned_addr learned my addr 172.21.15.55:0/2565889919 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.006+0000 7f132d396640 1 --2- 172.21.15.55:0/2565889919 >> v2:172.21.15.110:3300/0 conn(0x7f13281601f0 0x7f132815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.006+0000 7f132db97640 1 --2- 172.21.15.55:0/2565889919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13280d1290 0x7f132815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.006+0000 7f131ffff640 1 -- 172.21.15.55:0/2565889919 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396661021 0 0) 0x7f13280cd5a0 con 0x7f132815e3c0 2023-08-25T04:21:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.006+0000 7f131ffff640 1 -- 172.21.15.55:0/2565889919 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1314003530 con 0x7f132815e3c0 2023-08-25T04:21:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.006+0000 7f132d396640 1 -- 172.21.15.55:0/2565889919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13280d1290 msgr2=0x7f132815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.006+0000 7f132d396640 1 --2- 172.21.15.55:0/2565889919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13280d1290 0x7f132815e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.006+0000 7f132d396640 1 -- 172.21.15.55:0/2565889919 >> v1:172.21.15.55:6789/0 conn(0x7f132815e3c0 legacy=0x7f13280d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:35.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.006+0000 7f132d396640 1 -- 172.21.15.55:0/2565889919 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13280cde40 con 0x7f13281601f0 2023-08-25T04:21:35.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.006+0000 7f132db97640 1 --2- 172.21.15.55:0/2565889919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13280d1290 0x7f132815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:35.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.010+0000 7f132d396640 1 --2- 172.21.15.55:0/2565889919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13281601f0 0x7f132815d430 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f13240097a0 tx=0x7f132401ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1eb636499e73f08c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:35.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.010+0000 7f131ffff640 1 -- 172.21.15.55:0/2565889919 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13240a8950 con 0x7f13281601f0 2023-08-25T04:21:35.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.010+0000 7f131ffff640 1 -- 172.21.15.55:0/2565889919 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13240a8ab0 con 0x7f13281601f0 2023-08-25T04:21:35.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.010+0000 7f131ffff640 1 -- 172.21.15.55:0/2565889919 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13240a8e20 con 0x7f13281601f0 2023-08-25T04:21:35.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.010+0000 7f132f5fa640 1 -- 172.21.15.55:0/2565889919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13281601f0 msgr2=0x7f132815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:35.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.010+0000 7f132f5fa640 1 --2- 172.21.15.55:0/2565889919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13281601f0 0x7f132815d430 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f13240097a0 tx=0x7f132401ec50 comp rx=0 tx=0).stop 2023-08-25T04:21:35.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.010+0000 7f132f5fa640 1 -- 172.21.15.55:0/2565889919 shutdown_connections 2023-08-25T04:21:35.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.010+0000 7f132f5fa640 1 --2- 172.21.15.55:0/2565889919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13280d1290 0x7f132815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:35.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.010+0000 7f132f5fa640 1 --2- 172.21.15.55:0/2565889919 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13281601f0 0x7f132815d430 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:35.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.010+0000 7f132f5fa640 1 -- 172.21.15.55:0/2565889919 >> 172.21.15.55:0/2565889919 conn(0x7f13280d27d0 msgr2=0x7f13280d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:35.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.010+0000 7f132f5fa640 1 -- 172.21.15.55:0/2565889919 shutdown_connections 2023-08-25T04:21:35.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.010+0000 7f132f5fa640 1 -- 172.21.15.55:0/2565889919 wait complete. 2023-08-25T04:21:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132f5fa640 1 Processor -- start 2023-08-25T04:21:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132f5fa640 1 -- start start 2023-08-25T04:21:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132f5fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13280d1290 0x7f13281f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132f5fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f132815e3c0 0x7f132814a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132f5fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13281601f0 0x7f132814aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:35.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132f5fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1328148740 con 0x7f13280d1290 2023-08-25T04:21:35.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132f5fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13281f20a0 con 0x7f13281601f0 2023-08-25T04:21:35.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132f5fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13280c82d0 con 0x7f132815e3c0 2023-08-25T04:21:35.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132d396640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13280d1290 0x7f13281f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:35.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132d396640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13280d1290 0x7f13281f1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44570/0 (socket says 172.21.15.55:44570) 2023-08-25T04:21:35.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132d396640 1 -- 172.21.15.55:0/3117656775 learned_addr learned my addr 172.21.15.55:0/3117656775 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:35.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132db97640 1 --2- 172.21.15.55:0/3117656775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13281601f0 0x7f132814aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:35.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132cb95640 1 --2- 172.21.15.55:0/3117656775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f132815e3c0 0x7f132814a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:35.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132d396640 1 -- 172.21.15.55:0/3117656775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f132815e3c0 msgr2=0x7f132814a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:35.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132d396640 1 --2- 172.21.15.55:0/3117656775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f132815e3c0 0x7f132814a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:35.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132d396640 1 -- 172.21.15.55:0/3117656775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13281601f0 msgr2=0x7f132814aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:35.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132d396640 1 --2- 172.21.15.55:0/3117656775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13281601f0 0x7f132814aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:35.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132d396640 1 -- 172.21.15.55:0/3117656775 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1320009a70 con 0x7f13280d1290 2023-08-25T04:21:35.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132d396640 1 --2- 172.21.15.55:0/3117656775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13280d1290 0x7f13281f1b60 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f1324000c10 tx=0x7f132401b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:35.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f131dffb640 1 -- 172.21.15.55:0/3117656775 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13240b1d30 con 0x7f13280d1290 2023-08-25T04:21:35.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f131dffb640 1 -- 172.21.15.55:0/3117656775 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13240b1e90 con 0x7f13280d1290 2023-08-25T04:21:35.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f131dffb640 1 -- 172.21.15.55:0/3117656775 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324005be0 con 0x7f13280d1290 2023-08-25T04:21:35.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132f5fa640 1 -- 172.21.15.55:0/3117656775 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13240093b0 con 0x7f13280d1290 2023-08-25T04:21:35.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.014+0000 7f132f5fa640 1 -- 172.21.15.55:0/3117656775 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13280c8890 con 0x7f13280d1290 2023-08-25T04:21:35.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.018+0000 7f132f5fa640 1 -- 172.21.15.55:0/3117656775 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13280b5260 con 0x7f13280d1290 2023-08-25T04:21:35.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.018+0000 7f131dffb640 1 -- 172.21.15.55:0/3117656775 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 56) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f13240b7040 con 0x7f13280d1290 2023-08-25T04:21:35.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.018+0000 7f131dffb640 1 --2- 172.21.15.55:0/3117656775 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f130c0657a0 0x7f130c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:35.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.018+0000 7f131dffb640 1 -- 172.21.15.55:0/3117656775 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f132411ff60 con 0x7f13280d1290 2023-08-25T04:21:35.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.018+0000 7f132cb95640 1 --2- 172.21.15.55:0/3117656775 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f130c0657a0 0x7f130c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:35.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.018+0000 7f132cb95640 1 --2- 172.21.15.55:0/3117656775 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f130c0657a0 0x7f130c067c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f13280cfe80 tx=0x7f1318009040 comp rx=0 tx=0).ready entity=mgr.6902 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:35.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.022+0000 7f131dffb640 1 -- 172.21.15.55:0/3117656775 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f13240ed870 con 0x7f13280d1290 2023-08-25T04:21:35.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.222+0000 7f132f5fa640 1 -- 172.21.15.55:0/3117656775 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f1328073ec0 con 0x7f13280d1290 2023-08-25T04:21:35.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.722+0000 7f131dffb640 1 -- 172.21.15.55:0/3117656775 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 57) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f13240edc40 con 0x7f13280d1290 2023-08-25T04:21:35.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.726+0000 7f131dffb640 1 -- 172.21.15.55:0/3117656775 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v57) v1 ==== 92+0+0 (secure 0 0 0) 0x7f13240ed870 con 0x7f13280d1290 2023-08-25T04:21:35.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.726+0000 7f132f5fa640 1 -- 172.21.15.55:0/3117656775 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f130c0657a0 msgr2=0x7f130c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:35.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.726+0000 7f132f5fa640 1 --2- 172.21.15.55:0/3117656775 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f130c0657a0 0x7f130c067c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f13280cfe80 tx=0x7f1318009040 comp rx=0 tx=0).stop 2023-08-25T04:21:35.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.726+0000 7f132f5fa640 1 -- 172.21.15.55:0/3117656775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13280d1290 msgr2=0x7f13281f1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:35.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.726+0000 7f132f5fa640 1 --2- 172.21.15.55:0/3117656775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13280d1290 0x7f13281f1b60 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f1324000c10 tx=0x7f132401b9f0 comp rx=0 tx=0).stop 2023-08-25T04:21:35.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.726+0000 7f132f5fa640 1 -- 172.21.15.55:0/3117656775 shutdown_connections 2023-08-25T04:21:35.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.726+0000 7f132f5fa640 1 --2- 172.21.15.55:0/3117656775 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13281601f0 0x7f132814aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:35.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.726+0000 7f132f5fa640 1 --2- 172.21.15.55:0/3117656775 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f132815e3c0 0x7f132814a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:35.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.726+0000 7f132f5fa640 1 --2- 172.21.15.55:0/3117656775 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f130c0657a0 0x7f130c067c60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:35.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.726+0000 7f132f5fa640 1 --2- 172.21.15.55:0/3117656775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13280d1290 0x7f13281f1b60 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:35.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.726+0000 7f132f5fa640 1 -- 172.21.15.55:0/3117656775 >> 172.21.15.55:0/3117656775 conn(0x7f13280d27d0 msgr2=0x7f13280d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:35.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.726+0000 7f132f5fa640 1 -- 172.21.15.55:0/3117656775 shutdown_connections 2023-08-25T04:21:35.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.726+0000 7f132f5fa640 1 -- 172.21.15.55:0/3117656775 wait complete. 2023-08-25T04:21:35.749 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-25T04:21:35.899 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:35.898+0000 7ff662a4e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:21:35.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.902+0000 7f244ac9e640 1 Processor -- start 2023-08-25T04:21:35.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.902+0000 7f244ac9e640 1 -- start start 2023-08-25T04:21:35.903 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:35.902+0000 7efd31b7e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:21:35.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.902+0000 7f244ac9e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f24441601f0 0x7f244415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:35.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.902+0000 7f244ac9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24440d1290 0x7f244415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:35.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.902+0000 7f244ac9e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24440cd5a0 con 0x7f244415e3c0 2023-08-25T04:21:35.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.902+0000 7f244ac9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24440cd880 con 0x7f24440d1290 2023-08-25T04:21:35.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.902+0000 7f244ac9e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24440cdb60 con 0x7f24441601f0 2023-08-25T04:21:35.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.902+0000 7f244923b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24440d1290 0x7f244415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:35.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.906+0000 7f2448a3a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f24441601f0 0x7f244415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:35.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.906+0000 7f244923b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24440d1290 0x7f244415e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44578/0 (socket says 172.21.15.55:44578) 2023-08-25T04:21:35.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.906+0000 7f244923b640 1 -- 172.21.15.55:0/2022159156 learned_addr learned my addr 172.21.15.55:0/2022159156 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:35.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.906+0000 7f244923b640 1 -- 172.21.15.55:0/2022159156 >> v2:172.21.15.110:3300/0 conn(0x7f24441601f0 msgr2=0x7f244415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:35.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.906+0000 7f244923b640 1 --2- 172.21.15.55:0/2022159156 >> v2:172.21.15.110:3300/0 conn(0x7f24441601f0 0x7f244415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:35.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.906+0000 7f244923b640 1 -- 172.21.15.55:0/2022159156 >> v1:172.21.15.110:6789/0 conn(0x7f244415e3c0 legacy=0x7f24440d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:35.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.906+0000 7f244923b640 1 -- 172.21.15.55:0/2022159156 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24440cde40 con 0x7f24440d1290 2023-08-25T04:21:35.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.906+0000 7f2448a3a640 1 --2- 172.21.15.55:0/2022159156 >> v2:172.21.15.110:3300/0 conn(0x7f24441601f0 0x7f244415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:35.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.910+0000 7f244923b640 1 --2- 172.21.15.55:0/2022159156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24440d1290 0x7f244415e8a0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f244408b7f0 tx=0x7f243c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17267dfd63997d2d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:35.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.910+0000 7f24437fe640 1 -- 172.21.15.55:0/2022159156 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c0a5790 con 0x7f24440d1290 2023-08-25T04:21:35.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.910+0000 7f24437fe640 1 -- 172.21.15.55:0/2022159156 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c0a58f0 con 0x7f24440d1290 2023-08-25T04:21:35.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.910+0000 7f24437fe640 1 -- 172.21.15.55:0/2022159156 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c0a5c80 con 0x7f24440d1290 2023-08-25T04:21:35.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.910+0000 7f244ac9e640 1 -- 172.21.15.55:0/2022159156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24440d1290 msgr2=0x7f244415e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:35.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.910+0000 7f244ac9e640 1 --2- 172.21.15.55:0/2022159156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24440d1290 0x7f244415e8a0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f244408b7f0 tx=0x7f243c01c9a0 comp rx=0 tx=0).stop 2023-08-25T04:21:35.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.910+0000 7f244ac9e640 1 -- 172.21.15.55:0/2022159156 shutdown_connections 2023-08-25T04:21:35.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.910+0000 7f244ac9e640 1 --2- 172.21.15.55:0/2022159156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24440d1290 0x7f244415e8a0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:35.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.910+0000 7f244ac9e640 1 --2- 172.21.15.55:0/2022159156 >> v2:172.21.15.110:3300/0 conn(0x7f24441601f0 0x7f244415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:35.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.910+0000 7f244ac9e640 1 -- 172.21.15.55:0/2022159156 >> 172.21.15.55:0/2022159156 conn(0x7f24440d27d0 msgr2=0x7f24440d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:35.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.910+0000 7f244ac9e640 1 -- 172.21.15.55:0/2022159156 shutdown_connections 2023-08-25T04:21:35.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.910+0000 7f244ac9e640 1 -- 172.21.15.55:0/2022159156 wait complete. 2023-08-25T04:21:35.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f244ac9e640 1 Processor -- start 2023-08-25T04:21:35.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f244ac9e640 1 -- start start 2023-08-25T04:21:35.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f244ac9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24440d1290 0x7f2444153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:35.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f244ac9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f244415e3c0 0x7f24441563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:35.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f244ac9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24441601f0 0x7f2444159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:35.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f244ac9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2444154650 con 0x7f24441601f0 2023-08-25T04:21:35.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f244ac9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24440c7ff0 con 0x7f244415e3c0 2023-08-25T04:21:35.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f244ac9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24440c82d0 con 0x7f24440d1290 2023-08-25T04:21:35.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f244923b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24441601f0 0x7f2444159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:35.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f2448a3a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24440d1290 0x7f2444153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:35.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f2448a3a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24440d1290 0x7f2444153930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:54418/0 (socket says 172.21.15.55:54418) 2023-08-25T04:21:35.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f2448a3a640 1 -- 172.21.15.55:0/340022202 learned_addr learned my addr 172.21.15.55:0/340022202 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:35.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f2443fff640 1 --2- 172.21.15.55:0/340022202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f244415e3c0 0x7f24441563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:35.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f2448a3a640 1 -- 172.21.15.55:0/340022202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f244415e3c0 msgr2=0x7f24441563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:35.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f2448a3a640 1 --2- 172.21.15.55:0/340022202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f244415e3c0 0x7f24441563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:35.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f2448a3a640 1 -- 172.21.15.55:0/340022202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24441601f0 msgr2=0x7f2444159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:35.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f2448a3a640 1 --2- 172.21.15.55:0/340022202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24441601f0 0x7f2444159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:35.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f2448a3a640 1 -- 172.21.15.55:0/340022202 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24380093b0 con 0x7f24440d1290 2023-08-25T04:21:35.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f244923b640 1 --2- 172.21.15.55:0/340022202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24441601f0 0x7f2444159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:35.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f2448a3a640 1 --2- 172.21.15.55:0/340022202 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24440d1290 0x7f2444153930 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f243800e960 tx=0x7f243800ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:35.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f24417fa640 1 -- 172.21.15.55:0/340022202 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243800ca00 con 0x7f24440d1290 2023-08-25T04:21:35.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f24417fa640 1 -- 172.21.15.55:0/340022202 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243800cb60 con 0x7f24440d1290 2023-08-25T04:21:35.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f244ac9e640 1 -- 172.21.15.55:0/340022202 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243c009b30 con 0x7f24440d1290 2023-08-25T04:21:35.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f24417fa640 1 -- 172.21.15.55:0/340022202 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24380059a0 con 0x7f24440d1290 2023-08-25T04:21:35.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.914+0000 7f244ac9e640 1 -- 172.21.15.55:0/340022202 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24440ce7c0 con 0x7f24440d1290 2023-08-25T04:21:35.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.918+0000 7f244ac9e640 1 -- 172.21.15.55:0/340022202 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24440b5260 con 0x7f24440d1290 2023-08-25T04:21:35.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.918+0000 7f24417fa640 1 -- 172.21.15.55:0/340022202 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 57) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f2438005b00 con 0x7f24440d1290 2023-08-25T04:21:35.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.918+0000 7f24417fa640 1 --2- 172.21.15.55:0/340022202 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f24280657f0 0x7f2428067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:35.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.918+0000 7f24417fa640 1 -- 172.21.15.55:0/340022202 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2438083370 con 0x7f24440d1290 2023-08-25T04:21:35.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.918+0000 7f2443fff640 1 -- 172.21.15.55:0/340022202 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f24280657f0 msgr2=0x7f2428067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4272914017 2023-08-25T04:21:35.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.918+0000 7f2443fff640 1 --2- 172.21.15.55:0/340022202 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f24280657f0 0x7f2428067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:21:35.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:35.922+0000 7f24417fa640 1 -- 172.21.15.55:0/340022202 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2438050dc0 con 0x7f24440d1290 2023-08-25T04:21:36.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.082+0000 7f244ac9e640 1 -- 172.21.15.55:0/340022202 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f2444073ec0 con 0x7f24440d1290 2023-08-25T04:21:36.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.090+0000 7f24417fa640 1 -- 172.21.15.55:0/340022202 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v41)=0 v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7f24380543e0 con 0x7f24440d1290 2023-08-25T04:21:36.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.090+0000 7f244ac9e640 1 -- 172.21.15.55:0/340022202 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f24280657f0 msgr2=0x7f2428067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:21:36.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.090+0000 7f244ac9e640 1 --2- 172.21.15.55:0/340022202 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f24280657f0 0x7f2428067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.090+0000 7f244ac9e640 1 -- 172.21.15.55:0/340022202 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24440d1290 msgr2=0x7f2444153930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:36.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.090+0000 7f244ac9e640 1 --2- 172.21.15.55:0/340022202 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24440d1290 0x7f2444153930 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f243800e960 tx=0x7f243800ee20 comp rx=0 tx=0).stop 2023-08-25T04:21:36.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.090+0000 7f244ac9e640 1 -- 172.21.15.55:0/340022202 shutdown_connections 2023-08-25T04:21:36.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.090+0000 7f244ac9e640 1 --2- 172.21.15.55:0/340022202 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f24280657f0 0x7f2428067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.090+0000 7f244ac9e640 1 --2- 172.21.15.55:0/340022202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24441601f0 0x7f2444159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.090+0000 7f244ac9e640 1 --2- 172.21.15.55:0/340022202 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f244415e3c0 0x7f24441563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.090+0000 7f244ac9e640 1 --2- 172.21.15.55:0/340022202 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24440d1290 0x7f2444153930 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.090+0000 7f244ac9e640 1 -- 172.21.15.55:0/340022202 >> 172.21.15.55:0/340022202 conn(0x7f24440d27d0 msgr2=0x7f24440d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:36.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.090+0000 7f244ac9e640 1 -- 172.21.15.55:0/340022202 shutdown_connections 2023-08-25T04:21:36.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.090+0000 7f244ac9e640 1 -- 172.21.15.55:0/340022202 wait complete. 2023-08-25T04:21:36.112 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-08-25T04:21:36.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.262+0000 7f468ddfa640 1 Processor -- start 2023-08-25T04:21:36.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.262+0000 7f468ddfa640 1 -- start start 2023-08-25T04:21:36.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.262+0000 7f468ddfa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46881601f0 0x7f468815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:36.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.262+0000 7f468ddfa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f468815e3c0 0x7f46880d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:36.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.262+0000 7f468ddfa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f46880d10c0 0x7f46880b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:36.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.262+0000 7f468ddfa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46880cd5a0 con 0x7f468815e3c0 2023-08-25T04:21:36.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.262+0000 7f468ddfa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46880cd880 con 0x7f46880d10c0 2023-08-25T04:21:36.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.262+0000 7f468ddfa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46880cdb60 con 0x7f46881601f0 2023-08-25T04:21:36.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.262+0000 7f467ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f468815e3c0 0x7f46880d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:36.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.262+0000 7f4687fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f46880d10c0 0x7f46880b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:36.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.262+0000 7f467ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f468815e3c0 0x7f46880d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44596/0 (socket says 172.21.15.55:44596) 2023-08-25T04:21:36.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.262+0000 7f467ffff640 1 -- 172.21.15.55:0/2179735891 learned_addr learned my addr 172.21.15.55:0/2179735891 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:36.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.262+0000 7f46877fe640 1 --2- 172.21.15.55:0/2179735891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46881601f0 0x7f468815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:36.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.262+0000 7f467ffff640 1 -- 172.21.15.55:0/2179735891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46881601f0 msgr2=0x7f468815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:36.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.262+0000 7f467ffff640 1 --2- 172.21.15.55:0/2179735891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46881601f0 0x7f468815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.262+0000 7f467ffff640 1 -- 172.21.15.55:0/2179735891 >> v2:172.21.15.110:3300/0 conn(0x7f46880d10c0 msgr2=0x7f46880b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:36.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.262+0000 7f467ffff640 1 --2- 172.21.15.55:0/2179735891 >> v2:172.21.15.110:3300/0 conn(0x7f46880d10c0 0x7f46880b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.262+0000 7f467ffff640 1 -- 172.21.15.55:0/2179735891 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46880cde40 con 0x7f468815e3c0 2023-08-25T04:21:36.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.266+0000 7f467ffff640 1 --2- 172.21.15.55:0/2179735891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f468815e3c0 0x7f46880d0b80 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f46880d0540 tx=0x7f467001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8adbfb1eb54ddca server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:36.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.270+0000 7f4686ffd640 1 -- 172.21.15.55:0/2179735891 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46700a89b0 con 0x7f468815e3c0 2023-08-25T04:21:36.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.270+0000 7f4686ffd640 1 -- 172.21.15.55:0/2179735891 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46700a8b10 con 0x7f468815e3c0 2023-08-25T04:21:36.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.270+0000 7f4686ffd640 1 -- 172.21.15.55:0/2179735891 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46700a8ea0 con 0x7f468815e3c0 2023-08-25T04:21:36.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.270+0000 7f468ddfa640 1 -- 172.21.15.55:0/2179735891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f468815e3c0 msgr2=0x7f46880d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:36.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.270+0000 7f468ddfa640 1 --2- 172.21.15.55:0/2179735891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f468815e3c0 0x7f46880d0b80 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f46880d0540 tx=0x7f467001ecf0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.270+0000 7f468ddfa640 1 -- 172.21.15.55:0/2179735891 shutdown_connections 2023-08-25T04:21:36.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.270+0000 7f468ddfa640 1 --2- 172.21.15.55:0/2179735891 >> v2:172.21.15.110:3300/0 conn(0x7f46880d10c0 0x7f46880b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.270+0000 7f468ddfa640 1 --2- 172.21.15.55:0/2179735891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f468815e3c0 0x7f46880d0b80 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.270+0000 7f468ddfa640 1 --2- 172.21.15.55:0/2179735891 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46881601f0 0x7f468815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.270+0000 7f468ddfa640 1 -- 172.21.15.55:0/2179735891 >> 172.21.15.55:0/2179735891 conn(0x7f46880d27d0 msgr2=0x7f46880d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:36.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.270+0000 7f468ddfa640 1 -- 172.21.15.55:0/2179735891 shutdown_connections 2023-08-25T04:21:36.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.270+0000 7f468ddfa640 1 -- 172.21.15.55:0/2179735891 wait complete. 2023-08-25T04:21:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.270+0000 7f468ddfa640 1 Processor -- start 2023-08-25T04:21:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.270+0000 7f468ddfa640 1 -- start start 2023-08-25T04:21:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.270+0000 7f468ddfa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46880d10c0 0x7f468809e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.270+0000 7f468ddfa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f468815e3c0 0x7f46881f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f468ddfa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46881601f0 0x7f46881f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f468ddfa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468809f5a0 con 0x7f46880d10c0 2023-08-25T04:21:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f468ddfa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468809f2c0 con 0x7f46881601f0 2023-08-25T04:21:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f468ddfa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46880b5f50 con 0x7f468815e3c0 2023-08-25T04:21:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f46877fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46880d10c0 0x7f468809e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f46877fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46880d10c0 0x7f468809e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44610/0 (socket says 172.21.15.55:44610) 2023-08-25T04:21:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f46877fe640 1 -- 172.21.15.55:0/239924720 learned_addr learned my addr 172.21.15.55:0/239924720 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f467ffff640 1 --2- 172.21.15.55:0/239924720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f468815e3c0 0x7f46881f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f4687fff640 1 --2- 172.21.15.55:0/239924720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46881601f0 0x7f46881f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f467ffff640 1 -- 172.21.15.55:0/239924720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46881601f0 msgr2=0x7f46881f5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f467ffff640 1 --2- 172.21.15.55:0/239924720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46881601f0 0x7f46881f5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f467ffff640 1 -- 172.21.15.55:0/239924720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46880d10c0 msgr2=0x7f468809e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f467ffff640 1 --2- 172.21.15.55:0/239924720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46880d10c0 0x7f468809e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f467ffff640 1 -- 172.21.15.55:0/239924720 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46700094d0 con 0x7f468815e3c0 2023-08-25T04:21:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f46877fe640 1 --2- 172.21.15.55:0/239924720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46880d10c0 0x7f468809e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f467ffff640 1 --2- 172.21.15.55:0/239924720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f468815e3c0 0x7f46881f59b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f46700af000 tx=0x7f467001ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:36.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f4684ff9640 1 -- 172.21.15.55:0/239924720 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46700b0da0 con 0x7f468815e3c0 2023-08-25T04:21:36.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f4684ff9640 1 -- 172.21.15.55:0/239924720 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46700bb460 con 0x7f468815e3c0 2023-08-25T04:21:36.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f4684ff9640 1 -- 172.21.15.55:0/239924720 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46700bb810 con 0x7f468815e3c0 2023-08-25T04:21:36.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f468ddfa640 1 -- 172.21.15.55:0/239924720 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46880ce7c0 con 0x7f468815e3c0 2023-08-25T04:21:36.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f468ddfa640 1 -- 172.21.15.55:0/239924720 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46880b6510 con 0x7f468815e3c0 2023-08-25T04:21:36.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f468ddfa640 1 -- 172.21.15.55:0/239924720 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46880b5260 con 0x7f468815e3c0 2023-08-25T04:21:36.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.274+0000 7f4684ff9640 1 -- 172.21.15.55:0/239924720 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 57) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f46700b83f0 con 0x7f468815e3c0 2023-08-25T04:21:36.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.278+0000 7f4684ff9640 1 --2- 172.21.15.55:0/239924720 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f46680657f0 0x7f4668067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:36.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.278+0000 7f4684ff9640 1 -- 172.21.15.55:0/239924720 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f46701207a0 con 0x7f468815e3c0 2023-08-25T04:21:36.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.278+0000 7f46877fe640 1 -- 172.21.15.55:0/239924720 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f46680657f0 msgr2=0x7f4668067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4272914017 2023-08-25T04:21:36.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.278+0000 7f46877fe640 1 --2- 172.21.15.55:0/239924720 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f46680657f0 0x7f4668067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:21:36.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.282+0000 7f4684ff9640 1 -- 172.21.15.55:0/239924720 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f46700ee160 con 0x7f468815e3c0 2023-08-25T04:21:36.315 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:36.314+0000 7ff662a4e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:21:36.355 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:36.354+0000 7efd31b7e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:21:36.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.442+0000 7f468ddfa640 1 -- 172.21.15.55:0/239924720 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f46880b6700 con 0x7f468815e3c0 2023-08-25T04:21:36.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.450+0000 7f4684ff9640 1 -- 172.21.15.55:0/239924720 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v42)=0 v42) v1 ==== 133+0+0 (secure 0 0 0) 0x7f46700f1780 con 0x7f468815e3c0 2023-08-25T04:21:36.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.450+0000 7f468ddfa640 1 -- 172.21.15.55:0/239924720 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f46680657f0 msgr2=0x7f4668067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:21:36.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.450+0000 7f468ddfa640 1 --2- 172.21.15.55:0/239924720 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f46680657f0 0x7f4668067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.450+0000 7f468ddfa640 1 -- 172.21.15.55:0/239924720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f468815e3c0 msgr2=0x7f46881f59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:36.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.450+0000 7f468ddfa640 1 --2- 172.21.15.55:0/239924720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f468815e3c0 0x7f46881f59b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f46700af000 tx=0x7f467001ba90 comp rx=0 tx=0).stop 2023-08-25T04:21:36.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.450+0000 7f468ddfa640 1 -- 172.21.15.55:0/239924720 shutdown_connections 2023-08-25T04:21:36.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.450+0000 7f468ddfa640 1 --2- 172.21.15.55:0/239924720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46881601f0 0x7f46881f5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.450+0000 7f468ddfa640 1 --2- 172.21.15.55:0/239924720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f468815e3c0 0x7f46881f59b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.450+0000 7f468ddfa640 1 --2- 172.21.15.55:0/239924720 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f46680657f0 0x7f4668067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.450+0000 7f468ddfa640 1 --2- 172.21.15.55:0/239924720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f46880d10c0 0x7f468809e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.450+0000 7f468ddfa640 1 -- 172.21.15.55:0/239924720 >> 172.21.15.55:0/239924720 conn(0x7f46880d27d0 msgr2=0x7f468815d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:36.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.450+0000 7f468ddfa640 1 -- 172.21.15.55:0/239924720 shutdown_connections 2023-08-25T04:21:36.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.450+0000 7f468ddfa640 1 -- 172.21.15.55:0/239924720 wait complete. 2023-08-25T04:21:36.464 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:36.462+0000 7ff662a4e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:21:36.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:36.470 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-25T04:21:36.487 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-08-25T04:21:36.516 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:36.518+0000 7efd31b7e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:21:36.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.666+0000 7f6f0da34640 1 Processor -- start 2023-08-25T04:21:36.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.666+0000 7f6f0da34640 1 -- start start 2023-08-25T04:21:36.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.666+0000 7f6f0da34640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6f0815cb40 0x7f6f080d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:36.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.666+0000 7f6f0da34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f080cf340 0x7f6f080cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:36.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.666+0000 7f6f0da34640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f080d1970 con 0x7f6f080b43e0 2023-08-25T04:21:36.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.666+0000 7f6f0da34640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f080cfcc0 con 0x7f6f0815cb40 2023-08-25T04:21:36.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.666+0000 7f6f0da34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f080d0d80 con 0x7f6f080cf340 2023-08-25T04:21:36.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.670+0000 7f6f06ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6f0815cb40 0x7f6f080d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:36.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.670+0000 7f6f06ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6f0815cb40 0x7f6f080d2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:50354/0 (socket says 172.21.15.55:50354) 2023-08-25T04:21:36.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.670+0000 7f6efffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f080cf340 0x7f6f080cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:36.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.670+0000 7f6f06ffd640 1 -- 172.21.15.55:0/1727041806 learned_addr learned my addr 172.21.15.55:0/1727041806 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:36.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.670+0000 7f6f06ffd640 1 -- 172.21.15.55:0/1727041806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f080cf340 msgr2=0x7f6f080cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:21:36.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.670+0000 7f6f06ffd640 1 --2- 172.21.15.55:0/1727041806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f080cf340 0x7f6f080cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.670+0000 7f6f06ffd640 1 -- 172.21.15.55:0/1727041806 >> v1:172.21.15.110:6789/0 conn(0x7f6f080b43e0 legacy=0x7f6f080b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:36.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.670+0000 7f6f06ffd640 1 -- 172.21.15.55:0/1727041806 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f080d1040 con 0x7f6f0815cb40 2023-08-25T04:21:36.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.670+0000 7f6f06ffd640 1 --2- 172.21.15.55:0/1727041806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f0815cb40 0x7f6f080d2080 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009870 tx=0x7f6ef801ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3326cae4a30a4b51 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:36.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f067fc640 1 -- 172.21.15.55:0/1727041806 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80a8a30 con 0x7f6f0815cb40 2023-08-25T04:21:36.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f067fc640 1 -- 172.21.15.55:0/1727041806 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef80a8b90 con 0x7f6f0815cb40 2023-08-25T04:21:36.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f067fc640 1 -- 172.21.15.55:0/1727041806 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80b0440 con 0x7f6f0815cb40 2023-08-25T04:21:36.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f0da34640 1 -- 172.21.15.55:0/1727041806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f0815cb40 msgr2=0x7f6f080d2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:36.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f0da34640 1 --2- 172.21.15.55:0/1727041806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f0815cb40 0x7f6f080d2080 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009870 tx=0x7f6ef801ed30 comp rx=0 tx=0).stop 2023-08-25T04:21:36.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f0da34640 1 -- 172.21.15.55:0/1727041806 shutdown_connections 2023-08-25T04:21:36.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f0da34640 1 --2- 172.21.15.55:0/1727041806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f080cf340 0x7f6f080cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f0da34640 1 --2- 172.21.15.55:0/1727041806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f0815cb40 0x7f6f080d2080 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f0da34640 1 -- 172.21.15.55:0/1727041806 >> 172.21.15.55:0/1727041806 conn(0x7f6f0806aae0 msgr2=0x7f6f0806aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f0da34640 1 -- 172.21.15.55:0/1727041806 shutdown_connections 2023-08-25T04:21:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f0da34640 1 -- 172.21.15.55:0/1727041806 wait complete. 2023-08-25T04:21:36.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f0da34640 1 Processor -- start 2023-08-25T04:21:36.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f0da34640 1 -- start start 2023-08-25T04:21:36.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f0da34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f080b43e0 0x7f6f081f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:36.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f0da34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f080cf340 0x7f6f080c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:36.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f0da34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0815cb40 0x7f6f0815af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f0da34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0815fd00 con 0x7f6f0815cb40 2023-08-25T04:21:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f0da34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f081f2fd0 con 0x7f6f080cf340 2023-08-25T04:21:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.674+0000 7f6f0da34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f080c68e0 con 0x7f6f080b43e0 2023-08-25T04:21:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6f077fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0815cb40 0x7f6f0815af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6f06ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f080b43e0 0x7f6f081f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6f077fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0815cb40 0x7f6f0815af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44626/0 (socket says 172.21.15.55:44626) 2023-08-25T04:21:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6f077fe640 1 -- 172.21.15.55:0/1098044358 learned_addr learned my addr 172.21.15.55:0/1098044358 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6efffff640 1 --2- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f080cf340 0x7f6f080c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6f077fe640 1 -- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f080b43e0 msgr2=0x7f6f081f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6f077fe640 1 --2- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f080b43e0 0x7f6f081f2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6f077fe640 1 -- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f080cf340 msgr2=0x7f6f080c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:36.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6f077fe640 1 --2- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f080cf340 0x7f6f080c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:36.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6f077fe640 1 -- 172.21.15.55:0/1098044358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef80094d0 con 0x7f6f0815cb40 2023-08-25T04:21:36.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6f06ffd640 1 --2- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f080b43e0 0x7f6f081f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:21:36.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6f077fe640 1 --2- 172.21.15.55:0/1098044358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0815cb40 0x7f6f0815af30 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000c730 tx=0x7f6f0000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:36.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6f04ff9640 1 -- 172.21.15.55:0/1098044358 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f00003b80 con 0x7f6f0815cb40 2023-08-25T04:21:36.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6f0da34640 1 -- 172.21.15.55:0/1098044358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f080c6bc0 con 0x7f6f0815cb40 2023-08-25T04:21:36.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6f04ff9640 1 -- 172.21.15.55:0/1098044358 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f00003ce0 con 0x7f6f0815cb40 2023-08-25T04:21:36.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6f04ff9640 1 -- 172.21.15.55:0/1098044358 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0000aa30 con 0x7f6f0815cb40 2023-08-25T04:21:36.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6f0da34640 1 -- 172.21.15.55:0/1098044358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f080c7180 con 0x7f6f0815cb40 2023-08-25T04:21:36.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6f0da34640 1 -- 172.21.15.55:0/1098044358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f08071f80 con 0x7f6f0815cb40 2023-08-25T04:21:36.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.678+0000 7f6f04ff9640 1 -- 172.21.15.55:0/1098044358 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 57) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f6f0000ab90 con 0x7f6f0815cb40 2023-08-25T04:21:36.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.682+0000 7f6f04ff9640 1 --2- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f6ee8065820 0x7f6ee8067ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:36.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.682+0000 7f6f04ff9640 1 -- 172.21.15.55:0/1098044358 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f00082bc0 con 0x7f6f0815cb40 2023-08-25T04:21:36.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.682+0000 7f6f06ffd640 1 -- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f6ee8065820 msgr2=0x7f6ee8067ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4272914017 2023-08-25T04:21:36.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.682+0000 7f6f06ffd640 1 --2- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f6ee8065820 0x7f6ee8067ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:21:36.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.690+0000 7f6f04ff9640 1 -- 172.21.15.55:0/1098044358 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6f00050630 con 0x7f6f0815cb40 2023-08-25T04:21:36.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.866+0000 7f6f0da34640 1 -- 172.21.15.55:0/1098044358 --> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f080d1600 con 0x7f6ee8065820 2023-08-25T04:21:36.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.886+0000 7f6f06ffd640 1 -- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f6ee8065820 msgr2=0x7f6ee8067ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4272914017 2023-08-25T04:21:36.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:36.886+0000 7f6f06ffd640 1 --2- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f6ee8065820 0x7f6ee8067ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-25T04:21:36.946 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:36.946+0000 7ff662a4e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:21:37.004 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:37.002+0000 7ff662a4e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:21:37.034 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:37.034+0000 7efd31b7e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:21:37.060 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:37.058+0000 7ff662a4e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:21:37.095 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:37.098+0000 7efd31b7e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:21:37.145 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:37.146+0000 7ff662a4e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:21:37.154 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:37.154+0000 7efd31b7e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:21:37.203 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:37.202+0000 7ff662a4e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:21:37.245 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:37.246+0000 7efd31b7e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:21:37.287 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:37.286+0000 7ff662a4e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:21:37.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:37.290+0000 7f6f06ffd640 1 -- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f6ee8065820 msgr2=0x7f6ee8067ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4272914017 2023-08-25T04:21:37.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:37.290+0000 7f6f06ffd640 1 --2- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f6ee8065820 0x7f6ee8067ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-25T04:21:37.304 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:37.306+0000 7efd31b7e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:21:37.343 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:37.342+0000 7ff662a4e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:21:37.393 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:37.394+0000 7efd31b7e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:21:37.452 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:37.454+0000 7efd31b7e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:21:37.486 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:37.486+0000 7ff662a4e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:21:37.544 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:37.542+0000 7ff662a4e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:21:37.602 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:37.602+0000 7efd31b7e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:21:37.664 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:37.666+0000 7efd31b7e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:21:37.782 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:21:37.783 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:21:37.783 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:21:37.791 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:37.790+0000 7ff662a4e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:21:37.915 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:21:37.916 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:21:37.916 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:21:37.924 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:37.926+0000 7efd31b7e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:21:37.926 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:37.926+0000 7ff662a4e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:21:38.051 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:38.050+0000 7ff662a4e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:21:38.065 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:38.066+0000 7efd31b7e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:21:38.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:38.094+0000 7f6f06ffd640 1 -- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f6ee8065820 msgr2=0x7f6ee8067ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4272914017 2023-08-25T04:21:38.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:38.094+0000 7f6f06ffd640 1 --2- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f6ee8065820 0x7f6ee8067ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-25T04:21:38.121 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:38.118+0000 7ff662a4e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:21:38.196 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:38.198+0000 7efd31b7e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:21:38.256 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:38.254+0000 7ff662a4e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:21:38.270 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:38.270+0000 7efd31b7e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:21:38.412 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:38.414+0000 7efd31b7e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:21:38.791 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:38.790+0000 7ff662a4e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:21:38.875 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:38.874+0000 7ff662a4e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:21:38.984 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:38.986+0000 7efd31b7e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:21:39.027 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:39.026+0000 7ff662a4e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:21:39.072 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:39.074+0000 7efd31b7e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:21:39.110 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:39.110+0000 7ff662a4e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:21:39.228 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:39.230+0000 7efd31b7e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:21:39.315 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:39.314+0000 7efd31b7e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:21:39.425 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:39.426+0000 7ff662a4e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:21:39.484 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:39.482+0000 7ff662a4e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:21:39.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:39.498+0000 7f6f04ff9640 1 -- 172.21.15.55:0/1098044358 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 58) v1 ==== 84690+0+0 (secure 0 0 0) 0x7f6f00050a00 con 0x7f6f0815cb40 2023-08-25T04:21:39.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:39.498+0000 7f6f04ff9640 1 -- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f6ee8065820 msgr2=0x7f6ee8067ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:21:39.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:39.498+0000 7f6f04ff9640 1 --2- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:6832/4272914017,v1:172.21.15.110:6833/4272914017] conn(0x7f6ee8065820 0x7f6ee8067ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:39.614 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:39.614+0000 7ff5e5970640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:39.614 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:39.614+0000 7ff5e5970640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:39.615 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:39.614+0000 7ff5e5970640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:39.615 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:39.614+0000 7ff5e5970640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:39.615 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:39.614+0000 7ff5e5970640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:39.615 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:39.614+0000 7ff5e8976640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:39.615 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:39.614+0000 7ff5e8976640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:39.615 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:39.614+0000 7ff5e8976640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:39.615 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:39.614+0000 7ff5e8976640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:39.616 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:21:39.614+0000 7ff5e8976640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:21:39.664 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:39.666+0000 7efd31b7e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:21:39.728 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:21:39.730+0000 7efd31b7e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:21:40.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.502+0000 7f6f04ff9640 1 -- 172.21.15.55:0/1098044358 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 59) v1 ==== 84817+0+0 (secure 0 0 0) 0x7f6f00080f50 con 0x7f6f0815cb40 2023-08-25T04:21:40.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.502+0000 7f6f04ff9640 1 --2- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f6ee80336f0 0x7f6ee806fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:40.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.502+0000 7f6f04ff9640 1 -- 172.21.15.55:0/1098044358 --> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ee800bb90 con 0x7f6ee80336f0 2023-08-25T04:21:40.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.506+0000 7f6f06ffd640 1 --2- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f6ee80336f0 0x7f6ee806fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:40.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.510+0000 7f6f06ffd640 1 --2- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f6ee80336f0 0x7f6ee806fd00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80b2000 tx=0x7f6ef80aa070 comp rx=0 tx=0).ready entity=mgr.7217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:40.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.574+0000 7f6f04ff9640 1 -- 172.21.15.55:0/1098044358 <== mgr.7217 v2:172.21.15.110:6832/3764718770 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6ee800bb90 con 0x7f6ee80336f0 2023-08-25T04:21:40.575 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path snap_test_dir1 2023-08-25T04:21:40.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.578+0000 7f6f0da34640 1 -- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f6ee80336f0 msgr2=0x7f6ee806fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:40.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.578+0000 7f6f0da34640 1 --2- 172.21.15.55:0/1098044358 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f6ee80336f0 0x7f6ee806fd00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80b2000 tx=0x7f6ef80aa070 comp rx=0 tx=0).stop 2023-08-25T04:21:40.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.578+0000 7f6f0da34640 1 -- 172.21.15.55:0/1098044358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0815cb40 msgr2=0x7f6f0815af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:40.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.578+0000 7f6f0da34640 1 --2- 172.21.15.55:0/1098044358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f0815cb40 0x7f6f0815af30 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000c730 tx=0x7f6f0000cbf0 comp rx=0 tx=0).stop 2023-08-25T04:21:40.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.578+0000 7f6f077fe640 1 -- 172.21.15.55:0/1098044358 reap_dead start 2023-08-25T04:21:40.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.578+0000 7f6f0da34640 1 -- 172.21.15.55:0/1098044358 shutdown_connections 2023-08-25T04:21:40.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.578+0000 7f6f0da34640 1 -- 172.21.15.55:0/1098044358 >> 172.21.15.55:0/1098044358 conn(0x7f6f0806aae0 msgr2=0x7f6f080b4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:40.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.578+0000 7f6f0da34640 1 -- 172.21.15.55:0/1098044358 shutdown_connections 2023-08-25T04:21:40.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.578+0000 7f6f0da34640 1 -- 172.21.15.55:0/1098044358 wait complete. 2023-08-25T04:21:40.598 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-25T04:21:40.598 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-25-04_22_00 in ~20s... 2023-08-25T04:21:40.599 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-08-25T04:21:40.599 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-08-25T04:21:40.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.750+0000 7f69d1740640 1 Processor -- start 2023-08-25T04:21:40.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.750+0000 7f69d1740640 1 -- start start 2023-08-25T04:21:40.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.750+0000 7f69d1740640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69cc15cc60 0x7f69cc06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:40.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.750+0000 7f69d1740640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69cc0cc7b0 con 0x7f69cc0af510 2023-08-25T04:21:40.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.750+0000 7f69d1740640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69cc0cbf10 con 0x7f69cc0cebf0 2023-08-25T04:21:40.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.750+0000 7f69d1740640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc0cc1f0 con 0x7f69cc15cc60 2023-08-25T04:21:40.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.750+0000 7f69cb7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f69cc0af510 0x7f69cc06b530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33006/0 (socket says 172.21.15.55:33006) 2023-08-25T04:21:40.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.750+0000 7f69cb7fe640 1 -- 172.21.15.55:0/1224744885 learned_addr learned my addr 172.21.15.55:0/1224744885 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:21:40.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.750+0000 7f69c27fc640 1 --2- 172.21.15.55:0/1224744885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69cc15cc60 0x7f69cc06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:40.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.750+0000 7f69ca7fc640 1 -- 172.21.15.55:0/1224744885 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399614725 0 0) 0x7f69cc0cc7b0 con 0x7f69cc0af510 2023-08-25T04:21:40.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.750+0000 7f69ca7fc640 1 -- 172.21.15.55:0/1224744885 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69b8003530 con 0x7f69cc0af510 2023-08-25T04:21:40.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.750+0000 7f69ca7fc640 1 -- 172.21.15.55:0/1224744885 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774854808 0 0) 0x7f69cc0cbf10 con 0x7f69cc0cebf0 2023-08-25T04:21:40.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.750+0000 7f69ca7fc640 1 -- 172.21.15.55:0/1224744885 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69cc0cc7b0 con 0x7f69cc0cebf0 2023-08-25T04:21:40.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.750+0000 7f69c27fc640 1 -- 172.21.15.55:0/1224744885 >> v1:172.21.15.110:6789/0 conn(0x7f69cc0cebf0 legacy=0x7f69cc0cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:40.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.750+0000 7f69c27fc640 1 -- 172.21.15.55:0/1224744885 >> v1:172.21.15.55:6789/0 conn(0x7f69cc0af510 legacy=0x7f69cc06b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:40.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.750+0000 7f69c27fc640 1 -- 172.21.15.55:0/1224744885 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc0cc4d0 con 0x7f69cc15cc60 2023-08-25T04:21:40.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.754+0000 7f69c27fc640 1 --2- 172.21.15.55:0/1224744885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69cc15cc60 0x7f69cc06aff0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f69b40097f0 tx=0x7f69cc06c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21ab0365be2c91ac server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:40.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.754+0000 7f69ca7fc640 1 -- 172.21.15.55:0/1224744885 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b40ab600 con 0x7f69cc15cc60 2023-08-25T04:21:40.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.754+0000 7f69ca7fc640 1 -- 172.21.15.55:0/1224744885 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b40ab760 con 0x7f69cc15cc60 2023-08-25T04:21:40.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.754+0000 7f69ca7fc640 1 -- 172.21.15.55:0/1224744885 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b40abaf0 con 0x7f69cc15cc60 2023-08-25T04:21:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.754+0000 7f69d1740640 1 -- 172.21.15.55:0/1224744885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69cc15cc60 msgr2=0x7f69cc06aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.754+0000 7f69d1740640 1 --2- 172.21.15.55:0/1224744885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69cc15cc60 0x7f69cc06aff0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f69b40097f0 tx=0x7f69cc06c450 comp rx=0 tx=0).stop 2023-08-25T04:21:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.754+0000 7f69d1740640 1 -- 172.21.15.55:0/1224744885 shutdown_connections 2023-08-25T04:21:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.754+0000 7f69d1740640 1 --2- 172.21.15.55:0/1224744885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69cc15cc60 0x7f69cc06aff0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.754+0000 7f69d1740640 1 -- 172.21.15.55:0/1224744885 >> 172.21.15.55:0/1224744885 conn(0x7f69cc0d0610 msgr2=0x7f69cc0d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.754+0000 7f69d1740640 1 -- 172.21.15.55:0/1224744885 shutdown_connections 2023-08-25T04:21:40.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.754+0000 7f69d1740640 1 -- 172.21.15.55:0/1224744885 wait complete. 2023-08-25T04:21:40.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69d1740640 1 Processor -- start 2023-08-25T04:21:40.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69d1740640 1 -- start start 2023-08-25T04:21:40.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69d1740640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69cc0af510 0x7f69cc152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:40.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69d1740640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69cc0cebf0 0x7f69cc15ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:40.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69d1740640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc15cc60 0x7f69cc0c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:40.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69d1740640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc15a7e0 con 0x7f69cc15cc60 2023-08-25T04:21:40.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69d1740640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc157530 con 0x7f69cc0cebf0 2023-08-25T04:21:40.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69d1740640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc0c4d10 con 0x7f69cc0af510 2023-08-25T04:21:40.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69cb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc15cc60 0x7f69cc0c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:40.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69cb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc15cc60 0x7f69cc0c4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60754/0 (socket says 172.21.15.55:60754) 2023-08-25T04:21:40.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69cb7fe640 1 -- 172.21.15.55:0/221328450 learned_addr learned my addr 172.21.15.55:0/221328450 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:21:40.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69c27fc640 1 --2- 172.21.15.55:0/221328450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69cc0cebf0 0x7f69cc15ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:40.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69caffd640 1 --2- 172.21.15.55:0/221328450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69cc0af510 0x7f69cc152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:40.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69cb7fe640 1 -- 172.21.15.55:0/221328450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69cc0af510 msgr2=0x7f69cc152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:40.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69cb7fe640 1 --2- 172.21.15.55:0/221328450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69cc0af510 0x7f69cc152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:40.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69cb7fe640 1 -- 172.21.15.55:0/221328450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69cc0cebf0 msgr2=0x7f69cc15ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:40.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69cb7fe640 1 --2- 172.21.15.55:0/221328450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69cc0cebf0 0x7f69cc15ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:40.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69cb7fe640 1 -- 172.21.15.55:0/221328450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b4009420 con 0x7f69cc15cc60 2023-08-25T04:21:40.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69cb7fe640 1 --2- 172.21.15.55:0/221328450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc15cc60 0x7f69cc0c4140 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f69c400c390 tx=0x7f69c400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:40.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69c3fff640 1 -- 172.21.15.55:0/221328450 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c4005cf0 con 0x7f69cc15cc60 2023-08-25T04:21:40.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69c3fff640 1 -- 172.21.15.55:0/221328450 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69c4005e50 con 0x7f69cc15cc60 2023-08-25T04:21:40.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69d1740640 1 -- 172.21.15.55:0/221328450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69cc0c4ff0 con 0x7f69cc15cc60 2023-08-25T04:21:40.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69c3fff640 1 -- 172.21.15.55:0/221328450 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69c40072d0 con 0x7f69cc15cc60 2023-08-25T04:21:40.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69d1740640 1 -- 172.21.15.55:0/221328450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69cc157190 con 0x7f69cc15cc60 2023-08-25T04:21:40.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.758+0000 7f69d1740640 1 -- 172.21.15.55:0/221328450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69cc15a9a0 con 0x7f69cc15cc60 2023-08-25T04:21:40.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.762+0000 7f69c3fff640 1 -- 172.21.15.55:0/221328450 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 59) v1 ==== 84817+0+0 (secure 0 0 0) 0x7f69c4007430 con 0x7f69cc15cc60 2023-08-25T04:21:40.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.762+0000 7f69c3fff640 1 --2- 172.21.15.55:0/221328450 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f69ac065520 0x7f69ac0679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:21:40.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.762+0000 7f69c3fff640 1 -- 172.21.15.55:0/221328450 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f69c4082080 con 0x7f69cc15cc60 2023-08-25T04:21:40.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.762+0000 7f69caffd640 1 --2- 172.21.15.55:0/221328450 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f69ac065520 0x7f69ac0679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:21:40.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.762+0000 7f69caffd640 1 --2- 172.21.15.55:0/221328450 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f69ac065520 0x7f69ac0679e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0015c0 tx=0x7f69bc009040 comp rx=0 tx=0).ready entity=mgr.7217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:21:40.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.766+0000 7f69c3fff640 1 -- 172.21.15.55:0/221328450 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f69c40b2d90 con 0x7f69cc15cc60 2023-08-25T04:21:40.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.942+0000 7f69d1740640 1 -- 172.21.15.55:0/221328450 --> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69cc0c4e80 con 0x7f69ac065520 2023-08-25T04:21:40.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.950+0000 7f69c3fff640 1 -- 172.21.15.55:0/221328450 <== mgr.7217 v2:172.21.15.110:6832/3764718770 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7f69cc0c4e80 con 0x7f69ac065520 2023-08-25T04:21:40.950 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:21:40.950 INFO:teuthology.orchestra.run.smithi055.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-08-25T04:21:40.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.954+0000 7f69d1740640 1 -- 172.21.15.55:0/221328450 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f69ac065520 msgr2=0x7f69ac0679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:40.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.954+0000 7f69d1740640 1 --2- 172.21.15.55:0/221328450 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f69ac065520 0x7f69ac0679e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0015c0 tx=0x7f69bc009040 comp rx=0 tx=0).stop 2023-08-25T04:21:40.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.954+0000 7f69d1740640 1 -- 172.21.15.55:0/221328450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc15cc60 msgr2=0x7f69cc0c4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:21:40.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.954+0000 7f69d1740640 1 --2- 172.21.15.55:0/221328450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc15cc60 0x7f69cc0c4140 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f69c400c390 tx=0x7f69c400c790 comp rx=0 tx=0).stop 2023-08-25T04:21:40.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.954+0000 7f69d1740640 1 -- 172.21.15.55:0/221328450 shutdown_connections 2023-08-25T04:21:40.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.954+0000 7f69d1740640 1 --2- 172.21.15.55:0/221328450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69cc15cc60 0x7f69cc0c4140 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:40.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.954+0000 7f69d1740640 1 --2- 172.21.15.55:0/221328450 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69cc0cebf0 0x7f69cc15ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:40.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.954+0000 7f69d1740640 1 --2- 172.21.15.55:0/221328450 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f69ac065520 0x7f69ac0679e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:40.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.954+0000 7f69d1740640 1 --2- 172.21.15.55:0/221328450 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69cc0af510 0x7f69cc152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:21:40.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.954+0000 7f69d1740640 1 -- 172.21.15.55:0/221328450 >> 172.21.15.55:0/221328450 conn(0x7f69cc0d0610 msgr2=0x7f69cc0ae6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:21:40.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.954+0000 7f69d1740640 1 -- 172.21.15.55:0/221328450 shutdown_connections 2023-08-25T04:21:40.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:21:40.954+0000 7f69d1740640 1 -- 172.21.15.55:0/221328450 wait complete. 2023-08-25T04:21:40.971 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-08-25T04:21:40.972 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-08-25T04:21:40.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:40.973 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:40.984 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:40.984 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:40.984 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:21:41.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:41.986 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:41.998 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:41.998 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:41.999 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:21:43.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:43.001 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:43.013 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:43.014 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:43.014 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:21:44.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:44.016 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:44.028 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:44.029 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:44.029 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:21:45.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:45.030 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:45.042 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:45.042 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:45.043 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:21:46.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:46.045 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:46.058 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:46.059 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:46.059 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:21:47.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:47.061 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:47.073 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:47.073 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:47.073 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:21:48.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:48.075 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:48.088 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:48.088 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:48.088 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:21:49.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:49.090 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:49.102 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:49.102 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:49.103 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:21:50.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:50.104 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:50.115 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:50.115 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:50.115 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:21:51.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:51.117 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:51.129 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:51.130 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:51.130 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:21:52.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:52.131 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:52.143 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:52.144 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:52.144 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:21:53.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:53.146 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:53.158 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:53.159 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:53.159 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:21:54.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:54.161 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:54.173 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:54.173 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:54.174 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:21:55.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:55.176 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:55.188 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:55.189 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:55.189 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:21:56.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:56.194 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:56.207 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:56.207 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:56.207 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:21:57.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:57.209 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:57.223 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:57.223 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:57.223 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:21:58.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:58.226 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:58.239 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:58.240 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:58.240 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:21:59.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:21:59.242 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:21:59.255 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:21:59.255 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:21:59.255 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:22:00.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:22:00.258 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:22:00.271 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T04:22:00.272 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T04:22:00.272 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:22:00.588 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:00.586+0000 7ff5d8055640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:00.588 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:00.586+0000 7ff5d8055640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:00.589 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:00.586+0000 7ff5d8055640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:00.589 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:00.586+0000 7ff5d8055640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:00.589 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:00.586+0000 7ff5d8055640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:00.944 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:22:00.949 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:22:01.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:22:01.274 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:22:01.286 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_22_00_UTC 2023-08-25T04:22:01.287 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-04_22_00_UTC'} 2023-08-25T04:22:01.288 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-08-25-04_22_00_UTC'} 2023-08-25T04:22:01.289 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T04:22:01.289 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-08-25-04_22_00_UTC'] 2023-08-25T04:22:01.290 DEBUG:tasks.cephfs.test_snap_schedules:exec=1692937300.5986972, now = 1692937321.29019, timo = 20 2023-08-25T04:22:02.291 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-25T04:22:02.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.450+0000 7f926e89e640 1 Processor -- start 2023-08-25T04:22:02.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.450+0000 7f926e89e640 1 -- start start 2023-08-25T04:22:02.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.454+0000 7f926e89e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f926815cb40 0x7f92680d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:02.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.454+0000 7f926e89e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92680b6a00 0x7f92680cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:02.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.454+0000 7f926e89e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92680d1970 con 0x7f92680cf340 2023-08-25T04:22:02.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.454+0000 7f926e89e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92680cfcf0 con 0x7f926815cb40 2023-08-25T04:22:02.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.454+0000 7f926e89e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92680d0d80 con 0x7f92680b6a00 2023-08-25T04:22:02.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.454+0000 7f9267fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f926815cb40 0x7f92680d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:02.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.454+0000 7f9267fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f926815cb40 0x7f92680d2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33690/0 (socket says 172.21.15.55:33690) 2023-08-25T04:22:02.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.454+0000 7f9267fff640 1 -- 172.21.15.55:0/1014143170 learned_addr learned my addr 172.21.15.55:0/1014143170 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:02.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.454+0000 7f926ce3b640 1 --2- 172.21.15.55:0/1014143170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92680b6a00 0x7f92680cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:02.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.454+0000 7f9267fff640 1 -- 172.21.15.55:0/1014143170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92680b6a00 msgr2=0x7f92680cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:02.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.454+0000 7f9267fff640 1 --2- 172.21.15.55:0/1014143170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92680b6a00 0x7f92680cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:02.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.454+0000 7f9267fff640 1 -- 172.21.15.55:0/1014143170 >> v1:172.21.15.110:6789/0 conn(0x7f92680cf340 legacy=0x7f92680b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:02.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.454+0000 7f9267fff640 1 -- 172.21.15.55:0/1014143170 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92680d1040 con 0x7f926815cb40 2023-08-25T04:22:02.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.458+0000 7f9267fff640 1 --2- 172.21.15.55:0/1014143170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f926815cb40 0x7f92680d2080 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f9258009870 tx=0x7f925801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23ffdc28d59f056e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:02.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.458+0000 7f9266ffd640 1 -- 172.21.15.55:0/1014143170 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92580a8a30 con 0x7f926815cb40 2023-08-25T04:22:02.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.458+0000 7f9266ffd640 1 -- 172.21.15.55:0/1014143170 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92580a8b90 con 0x7f926815cb40 2023-08-25T04:22:02.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.458+0000 7f9266ffd640 1 -- 172.21.15.55:0/1014143170 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92580b0440 con 0x7f926815cb40 2023-08-25T04:22:02.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.458+0000 7f926e89e640 1 -- 172.21.15.55:0/1014143170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f926815cb40 msgr2=0x7f92680d2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:02.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.458+0000 7f926e89e640 1 --2- 172.21.15.55:0/1014143170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f926815cb40 0x7f92680d2080 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f9258009870 tx=0x7f925801ed30 comp rx=0 tx=0).stop 2023-08-25T04:22:02.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.458+0000 7f926e89e640 1 -- 172.21.15.55:0/1014143170 shutdown_connections 2023-08-25T04:22:02.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.458+0000 7f926e89e640 1 --2- 172.21.15.55:0/1014143170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92680b6a00 0x7f92680cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:02.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.458+0000 7f926e89e640 1 --2- 172.21.15.55:0/1014143170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f926815cb40 0x7f92680d2080 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:02.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.458+0000 7f926e89e640 1 -- 172.21.15.55:0/1014143170 >> 172.21.15.55:0/1014143170 conn(0x7f926806aae0 msgr2=0x7f926806aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:02.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.458+0000 7f926e89e640 1 -- 172.21.15.55:0/1014143170 shutdown_connections 2023-08-25T04:22:02.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.458+0000 7f926e89e640 1 -- 172.21.15.55:0/1014143170 wait complete. 2023-08-25T04:22:02.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.458+0000 7f926e89e640 1 Processor -- start 2023-08-25T04:22:02.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.458+0000 7f926e89e640 1 -- start start 2023-08-25T04:22:02.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f926e89e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92680b6a00 0x7f926815d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:02.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f926e89e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92680cf340 0x7f926815f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:02.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f926e89e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f926815cb40 0x7f92681f1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:02.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f926e89e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92680b21c0 con 0x7f92680cf340 2023-08-25T04:22:02.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f926e89e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926815df10 con 0x7f926815cb40 2023-08-25T04:22:02.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f926e89e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926815e1f0 con 0x7f92680b6a00 2023-08-25T04:22:02.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f92677fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92680cf340 0x7f926815f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:02.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f92677fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92680cf340 0x7f926815f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33698/0 (socket says 172.21.15.55:33698) 2023-08-25T04:22:02.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f92677fe640 1 -- 172.21.15.55:0/3023836965 learned_addr learned my addr 172.21.15.55:0/3023836965 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:02.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f9267fff640 1 --2- 172.21.15.55:0/3023836965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92680b6a00 0x7f926815d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:02.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f926ce3b640 1 --2- 172.21.15.55:0/3023836965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f926815cb40 0x7f92681f1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:02.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f92677fe640 1 -- 172.21.15.55:0/3023836965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92680b6a00 msgr2=0x7f926815d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:02.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f92677fe640 1 --2- 172.21.15.55:0/3023836965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92680b6a00 0x7f926815d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:02.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f92677fe640 1 -- 172.21.15.55:0/3023836965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f926815cb40 msgr2=0x7f92681f1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:02.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f92677fe640 1 --2- 172.21.15.55:0/3023836965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f926815cb40 0x7f92681f1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:02.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f92677fe640 1 -- 172.21.15.55:0/3023836965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92580094d0 con 0x7f92680cf340 2023-08-25T04:22:02.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f92677fe640 1 --2- 172.21.15.55:0/3023836965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92680cf340 0x7f926815f130 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f925c00c3c0 tx=0x7f925c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:02.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f9264ff9640 1 -- 172.21.15.55:0/3023836965 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c0052d0 con 0x7f92680cf340 2023-08-25T04:22:02.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f9264ff9640 1 -- 172.21.15.55:0/3023836965 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c005430 con 0x7f92680cf340 2023-08-25T04:22:02.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f926e89e640 1 -- 172.21.15.55:0/3023836965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926815e4d0 con 0x7f92680cf340 2023-08-25T04:22:02.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f9264ff9640 1 -- 172.21.15.55:0/3023836965 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c003840 con 0x7f92680cf340 2023-08-25T04:22:02.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f926e89e640 1 -- 172.21.15.55:0/3023836965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926815f670 con 0x7f92680cf340 2023-08-25T04:22:02.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f926e89e640 1 -- 172.21.15.55:0/3023836965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9268071f80 con 0x7f92680cf340 2023-08-25T04:22:02.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.462+0000 7f9264ff9640 1 -- 172.21.15.55:0/3023836965 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 62) v1 ==== 85195+0+0 (secure 0 0 0) 0x7f925c0039a0 con 0x7f92680cf340 2023-08-25T04:22:02.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.466+0000 7f9264ff9640 1 --2- 172.21.15.55:0/3023836965 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f9254065910 0x7f9254067dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:02.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.466+0000 7f9264ff9640 1 -- 172.21.15.55:0/3023836965 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f925c0827b0 con 0x7f92680cf340 2023-08-25T04:22:02.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.466+0000 7f9267fff640 1 --2- 172.21.15.55:0/3023836965 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f9254065910 0x7f9254067dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:02.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.466+0000 7f9267fff640 1 --2- 172.21.15.55:0/3023836965 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f9254065910 0x7f9254067dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f92580b2000 tx=0x7f9258009040 comp rx=0 tx=0).ready entity=mgr.7217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:02.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.470+0000 7f9264ff9640 1 -- 172.21.15.55:0/3023836965 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f925c04ff20 con 0x7f92680cf340 2023-08-25T04:22:02.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.642+0000 7f926e89e640 1 -- 172.21.15.55:0/3023836965 --> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f92680d1600 con 0x7f9254065910 2023-08-25T04:22:02.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.714+0000 7f9264ff9640 1 -- 172.21.15.55:0/3023836965 <== mgr.7217 v2:172.21.15.110:6832/3764718770 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f92580b04c0 con 0x7f9254065910 2023-08-25T04:22:02.712 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path snap_test_dir1 2023-08-25T04:22:02.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.714+0000 7f926e89e640 1 -- 172.21.15.55:0/3023836965 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f9254065910 msgr2=0x7f9254067dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:02.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.714+0000 7f926e89e640 1 --2- 172.21.15.55:0/3023836965 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f9254065910 0x7f9254067dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f92580b2000 tx=0x7f9258009040 comp rx=0 tx=0).stop 2023-08-25T04:22:02.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.714+0000 7f926e89e640 1 -- 172.21.15.55:0/3023836965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92680cf340 msgr2=0x7f926815f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:02.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.714+0000 7f926e89e640 1 --2- 172.21.15.55:0/3023836965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92680cf340 0x7f926815f130 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f925c00c3c0 tx=0x7f925c00c880 comp rx=0 tx=0).stop 2023-08-25T04:22:02.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.714+0000 7f926e89e640 1 -- 172.21.15.55:0/3023836965 shutdown_connections 2023-08-25T04:22:02.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.714+0000 7f926e89e640 1 --2- 172.21.15.55:0/3023836965 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f926815cb40 0x7f92681f1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:02.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.714+0000 7f926e89e640 1 --2- 172.21.15.55:0/3023836965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92680cf340 0x7f926815f130 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:02.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.714+0000 7f926e89e640 1 --2- 172.21.15.55:0/3023836965 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f9254065910 0x7f9254067dd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:02.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.714+0000 7f926e89e640 1 --2- 172.21.15.55:0/3023836965 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92680b6a00 0x7f926815d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:02.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.714+0000 7f926e89e640 1 -- 172.21.15.55:0/3023836965 >> 172.21.15.55:0/3023836965 conn(0x7f926806aae0 msgr2=0x7f926815bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:02.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.714+0000 7f926e89e640 1 -- 172.21.15.55:0/3023836965 shutdown_connections 2023-08-25T04:22:02.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:02.714+0000 7f926e89e640 1 -- 172.21.15.55:0/3023836965 wait complete. 2023-08-25T04:22:02.733 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-25T04:22:02.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:22:02.734 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T04:22:02.744 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_22_00_UTC 2023-08-25T04:22:02.745 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_22_00_UTC 2023-08-25T04:22:02.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:22:02.746 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_22_00_UTC) 2023-08-25T04:22:02.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:22:02.801 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-25T04:22:02.855 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-25T04:22:03.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.046+0000 7ff131559640 1 Processor -- start 2023-08-25T04:22:03.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.046+0000 7ff131559640 1 -- start start 2023-08-25T04:22:03.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.046+0000 7ff131559640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff12c1601f0 0x7ff12c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:03.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.046+0000 7ff131559640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff12c15e3c0 0x7ff12c0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:03.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.046+0000 7ff131559640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff12c15f8b0 con 0x7ff12c0d10c0 2023-08-25T04:22:03.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.046+0000 7ff131559640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12c0cd5a0 con 0x7ff12c1601f0 2023-08-25T04:22:03.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.046+0000 7ff131559640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12c0cd880 con 0x7ff12c15e3c0 2023-08-25T04:22:03.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.046+0000 7ff12affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff12c1601f0 0x7ff12c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:03.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.046+0000 7ff12b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff12c0d10c0 0x7ff12c0b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41644/0 (socket says 172.21.15.55:41644) 2023-08-25T04:22:03.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.046+0000 7ff12b7fe640 1 -- 172.21.15.55:0/3432473929 learned_addr learned my addr 172.21.15.55:0/3432473929 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:03.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.046+0000 7ff123fff640 1 --2- 172.21.15.55:0/3432473929 >> v2:172.21.15.110:3300/0 conn(0x7ff12c15e3c0 0x7ff12c0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:03.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.046+0000 7ff12affd640 1 -- 172.21.15.55:0/3432473929 >> v2:172.21.15.110:3300/0 conn(0x7ff12c15e3c0 msgr2=0x7ff12c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:03.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.046+0000 7ff12affd640 1 --2- 172.21.15.55:0/3432473929 >> v2:172.21.15.110:3300/0 conn(0x7ff12c15e3c0 0x7ff12c0d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:03.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.046+0000 7ff12affd640 1 -- 172.21.15.55:0/3432473929 >> v1:172.21.15.55:6789/0 conn(0x7ff12c0d10c0 legacy=0x7ff12c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:03.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.046+0000 7ff12affd640 1 -- 172.21.15.55:0/3432473929 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12c0cdb60 con 0x7ff12c1601f0 2023-08-25T04:22:03.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.046+0000 7ff12a7fc640 1 -- 172.21.15.55:0/3432473929 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640704120 0 0) 0x7ff12c15f8b0 con 0x7ff12c0d10c0 2023-08-25T04:22:03.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.050+0000 7ff12affd640 1 --2- 172.21.15.55:0/3432473929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff12c1601f0 0x7ff12c15d430 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0cd350 tx=0x7ff11c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a9db87c2737b05 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:03.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.050+0000 7ff12a7fc640 1 -- 172.21.15.55:0/3432473929 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c0ab610 con 0x7ff12c1601f0 2023-08-25T04:22:03.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.050+0000 7ff12a7fc640 1 -- 172.21.15.55:0/3432473929 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c0ab770 con 0x7ff12c1601f0 2023-08-25T04:22:03.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.050+0000 7ff12a7fc640 1 -- 172.21.15.55:0/3432473929 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c0abb00 con 0x7ff12c1601f0 2023-08-25T04:22:03.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.050+0000 7ff131559640 1 -- 172.21.15.55:0/3432473929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff12c1601f0 msgr2=0x7ff12c15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:03.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.050+0000 7ff131559640 1 --2- 172.21.15.55:0/3432473929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff12c1601f0 0x7ff12c15d430 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0cd350 tx=0x7ff11c01c410 comp rx=0 tx=0).stop 2023-08-25T04:22:03.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.050+0000 7ff131559640 1 -- 172.21.15.55:0/3432473929 shutdown_connections 2023-08-25T04:22:03.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.050+0000 7ff131559640 1 --2- 172.21.15.55:0/3432473929 >> v2:172.21.15.110:3300/0 conn(0x7ff12c15e3c0 0x7ff12c0d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:03.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.050+0000 7ff131559640 1 --2- 172.21.15.55:0/3432473929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff12c1601f0 0x7ff12c15d430 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:03.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.050+0000 7ff131559640 1 -- 172.21.15.55:0/3432473929 >> 172.21.15.55:0/3432473929 conn(0x7ff12c0d27d0 msgr2=0x7ff12c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:03.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.050+0000 7ff131559640 1 -- 172.21.15.55:0/3432473929 shutdown_connections 2023-08-25T04:22:03.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.050+0000 7ff131559640 1 -- 172.21.15.55:0/3432473929 wait complete. 2023-08-25T04:22:03.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff131559640 1 Processor -- start 2023-08-25T04:22:03.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff131559640 1 -- start start 2023-08-25T04:22:03.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff131559640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff12c0d10c0 0x7ff12c15dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:03.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff131559640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff12c15e3c0 0x7ff12c0cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:03.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff131559640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff12c1601f0 0x7ff12c15bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:03.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff131559640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c0cbf10 con 0x7ff12c0d10c0 2023-08-25T04:22:03.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff131559640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c0c8d90 con 0x7ff12c15e3c0 2023-08-25T04:22:03.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff131559640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12c0c9070 con 0x7ff12c1601f0 2023-08-25T04:22:03.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff12affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff12c0d10c0 0x7ff12c15dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:03.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff12affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff12c0d10c0 0x7ff12c15dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33716/0 (socket says 172.21.15.55:33716) 2023-08-25T04:22:03.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff12affd640 1 -- 172.21.15.55:0/55137324 learned_addr learned my addr 172.21.15.55:0/55137324 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:03.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff12affd640 1 -- 172.21.15.55:0/55137324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff12c1601f0 msgr2=0x7ff12c15bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:03.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff12affd640 1 --2- 172.21.15.55:0/55137324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff12c1601f0 0x7ff12c15bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:03.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff12affd640 1 -- 172.21.15.55:0/55137324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff12c15e3c0 msgr2=0x7ff12c0cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:03.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff12affd640 1 --2- 172.21.15.55:0/55137324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff12c15e3c0 0x7ff12c0cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:03.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff12affd640 1 -- 172.21.15.55:0/55137324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c0093b0 con 0x7ff12c0d10c0 2023-08-25T04:22:03.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff12affd640 1 --2- 172.21.15.55:0/55137324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff12c0d10c0 0x7ff12c15dd00 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7ff11c019020 tx=0x7ff11c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:03.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff1237fe640 1 -- 172.21.15.55:0/55137324 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c0bf610 con 0x7ff12c0d10c0 2023-08-25T04:22:03.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff1237fe640 1 -- 172.21.15.55:0/55137324 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c0bf770 con 0x7ff12c0d10c0 2023-08-25T04:22:03.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff1237fe640 1 -- 172.21.15.55:0/55137324 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c0bfb00 con 0x7ff12c0d10c0 2023-08-25T04:22:03.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff131559640 1 -- 172.21.15.55:0/55137324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12c0ce7c0 con 0x7ff12c0d10c0 2023-08-25T04:22:03.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.054+0000 7ff131559640 1 -- 172.21.15.55:0/55137324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12c0cbb10 con 0x7ff12c0d10c0 2023-08-25T04:22:03.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.058+0000 7ff131559640 1 -- 172.21.15.55:0/55137324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12c0b5a20 con 0x7ff12c0d10c0 2023-08-25T04:22:03.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.058+0000 7ff1237fe640 1 -- 172.21.15.55:0/55137324 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 62) v1 ==== 85195+0+0 (secure 0 0 0) 0x7ff11c0b5400 con 0x7ff12c0d10c0 2023-08-25T04:22:03.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.058+0000 7ff1237fe640 1 --2- 172.21.15.55:0/55137324 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7ff10c065910 0x7ff10c067dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:03.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.058+0000 7ff1237fe640 1 -- 172.21.15.55:0/55137324 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6406+0+0 (secure 0 0 0) 0x7ff11c11e150 con 0x7ff12c0d10c0 2023-08-25T04:22:03.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.058+0000 7ff123fff640 1 --2- 172.21.15.55:0/55137324 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7ff10c065910 0x7ff10c067dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:03.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.058+0000 7ff123fff640 1 --2- 172.21.15.55:0/55137324 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7ff10c065910 0x7ff10c067dd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff114006aa0 tx=0x7ff114006a30 comp rx=0 tx=0).ready entity=mgr.7217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:03.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.062+0000 7ff1237fe640 1 -- 172.21.15.55:0/55137324 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff11c0eb8c0 con 0x7ff12c0d10c0 2023-08-25T04:22:03.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.254+0000 7ff131559640 1 -- 172.21.15.55:0/55137324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7ff12c0cc050 con 0x7ff12c0d10c0 2023-08-25T04:22:03.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.809+0000 7ff1237fe640 1 -- 172.21.15.55:0/55137324 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 63) v1 ==== 85178+0+0 (secure 0 0 0) 0x7ff11c0ebc90 con 0x7ff12c0d10c0 2023-08-25T04:22:03.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.809+0000 7ff1237fe640 1 -- 172.21.15.55:0/55137324 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v63) v1 ==== 93+0+0 (secure 0 0 0) 0x7ff11c0ef350 con 0x7ff12c0d10c0 2023-08-25T04:22:03.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.813+0000 7ff131559640 1 -- 172.21.15.55:0/55137324 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7ff10c065910 msgr2=0x7ff10c067dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.813+0000 7ff131559640 1 --2- 172.21.15.55:0/55137324 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7ff10c065910 0x7ff10c067dd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff114006aa0 tx=0x7ff114006a30 comp rx=0 tx=0).stop 2023-08-25T04:22:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.813+0000 7ff131559640 1 -- 172.21.15.55:0/55137324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff12c0d10c0 msgr2=0x7ff12c15dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.813+0000 7ff131559640 1 --2- 172.21.15.55:0/55137324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff12c0d10c0 0x7ff12c15dd00 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7ff11c019020 tx=0x7ff11c01ac50 comp rx=0 tx=0).stop 2023-08-25T04:22:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.813+0000 7ff131559640 1 -- 172.21.15.55:0/55137324 shutdown_connections 2023-08-25T04:22:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.813+0000 7ff131559640 1 --2- 172.21.15.55:0/55137324 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7ff10c065910 0x7ff10c067dd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.813+0000 7ff131559640 1 --2- 172.21.15.55:0/55137324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff12c1601f0 0x7ff12c15bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:03.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.813+0000 7ff131559640 1 --2- 172.21.15.55:0/55137324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff12c15e3c0 0x7ff12c0cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:03.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.813+0000 7ff131559640 1 --2- 172.21.15.55:0/55137324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff12c0d10c0 0x7ff12c15dd00 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:03.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.813+0000 7ff131559640 1 -- 172.21.15.55:0/55137324 >> 172.21.15.55:0/55137324 conn(0x7ff12c0d27d0 msgr2=0x7ff12c15e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:03.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.813+0000 7ff131559640 1 -- 172.21.15.55:0/55137324 shutdown_connections 2023-08-25T04:22:03.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:03.813+0000 7ff131559640 1 -- 172.21.15.55:0/55137324 wait complete. 2023-08-25T04:22:03.837 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T04:22:03.838 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:22:03.899 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:22:03.956 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T04:22:03.957 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:22:03.957 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:22:03.969 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:22:03.970 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:22:03.989 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:03.989+0000 7fc16ec38180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:22:03.998 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:22:04.012 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:04.010+0000 7fd7c3e46180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:22:04.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.189+0000 7f9309f00640 1 Processor -- start 2023-08-25T04:22:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.189+0000 7f9309f00640 1 -- start start 2023-08-25T04:22:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.189+0000 7f9309f00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93040ad950 0x7f93040cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.189+0000 7f9309f00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93040c89f0 0x7f93040ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.189+0000 7f9309f00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93040b2650 con 0x7f930406c000 2023-08-25T04:22:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.189+0000 7f9309f00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93040b11f0 con 0x7f93040ad950 2023-08-25T04:22:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.189+0000 7f9309f00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9304159d50 con 0x7f93040c89f0 2023-08-25T04:22:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.189+0000 7f93037fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93040ad950 0x7f93040cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.189+0000 7f93037fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93040ad950 0x7f93040cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33734/0 (socket says 172.21.15.55:33734) 2023-08-25T04:22:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.189+0000 7f93037fe640 1 -- 172.21.15.55:0/4009313446 learned_addr learned my addr 172.21.15.55:0/4009313446 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.189+0000 7f92fbfff640 1 --2- 172.21.15.55:0/4009313446 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93040c89f0 0x7f93040ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.189+0000 7f93037fe640 1 -- 172.21.15.55:0/4009313446 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93040c89f0 msgr2=0x7f93040ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:04.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.189+0000 7f93037fe640 1 --2- 172.21.15.55:0/4009313446 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93040c89f0 0x7f93040ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.189+0000 7f93037fe640 1 -- 172.21.15.55:0/4009313446 >> v1:172.21.15.110:6789/0 conn(0x7f930406c000 legacy=0x7f930415d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:04.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.189+0000 7f93037fe640 1 -- 172.21.15.55:0/4009313446 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93040cc880 con 0x7f93040ad950 2023-08-25T04:22:04.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.193+0000 7f93037fe640 1 --2- 172.21.15.55:0/4009313446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93040ad950 0x7f93040cc2a0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009870 tx=0x7f92f401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f044659373c39fba server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:04.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.193+0000 7f9302ffd640 1 -- 172.21.15.55:0/4009313446 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f40ad640 con 0x7f93040ad950 2023-08-25T04:22:04.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.193+0000 7f9302ffd640 1 -- 172.21.15.55:0/4009313446 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f40ad7a0 con 0x7f93040ad950 2023-08-25T04:22:04.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.193+0000 7f9302ffd640 1 -- 172.21.15.55:0/4009313446 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f40adb30 con 0x7f93040ad950 2023-08-25T04:22:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.193+0000 7f9309f00640 1 -- 172.21.15.55:0/4009313446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93040ad950 msgr2=0x7f93040cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.193+0000 7f9309f00640 1 --2- 172.21.15.55:0/4009313446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93040ad950 0x7f93040cc2a0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009870 tx=0x7f92f401c480 comp rx=0 tx=0).stop 2023-08-25T04:22:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.193+0000 7f9309f00640 1 -- 172.21.15.55:0/4009313446 shutdown_connections 2023-08-25T04:22:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.193+0000 7f9309f00640 1 --2- 172.21.15.55:0/4009313446 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93040c89f0 0x7f93040ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.193+0000 7f9309f00640 1 --2- 172.21.15.55:0/4009313446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93040ad950 0x7f93040cc2a0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.193+0000 7f9309f00640 1 -- 172.21.15.55:0/4009313446 >> 172.21.15.55:0/4009313446 conn(0x7f9304069d00 msgr2=0x7f930406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.193+0000 7f9309f00640 1 -- 172.21.15.55:0/4009313446 shutdown_connections 2023-08-25T04:22:04.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.193+0000 7f9309f00640 1 -- 172.21.15.55:0/4009313446 wait complete. 2023-08-25T04:22:04.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9309f00640 1 Processor -- start 2023-08-25T04:22:04.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9309f00640 1 -- start start 2023-08-25T04:22:04.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9309f00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f930406c000 0x7f93040c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:04.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9309f00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93040ad950 0x7f9304070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:04.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9309f00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93040c89f0 0x7f9304071430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:04.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9309f00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93040c15b0 con 0x7f93040c89f0 2023-08-25T04:22:04.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9309f00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93040976c0 con 0x7f93040ad950 2023-08-25T04:22:04.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9309f00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9304096c20 con 0x7f930406c000 2023-08-25T04:22:04.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9303fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93040c89f0 0x7f9304071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:04.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9303fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93040c89f0 0x7f9304071430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33750/0 (socket says 172.21.15.55:33750) 2023-08-25T04:22:04.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9303fff640 1 -- 172.21.15.55:0/216608903 learned_addr learned my addr 172.21.15.55:0/216608903 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:04.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f93037fe640 1 --2- 172.21.15.55:0/216608903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f930406c000 0x7f93040c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:04.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f92fbfff640 1 --2- 172.21.15.55:0/216608903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93040ad950 0x7f9304070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:04.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9303fff640 1 -- 172.21.15.55:0/216608903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f930406c000 msgr2=0x7f93040c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:04.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9303fff640 1 --2- 172.21.15.55:0/216608903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f930406c000 0x7f93040c1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9303fff640 1 -- 172.21.15.55:0/216608903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93040ad950 msgr2=0x7f9304070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:04.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9303fff640 1 --2- 172.21.15.55:0/216608903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93040ad950 0x7f9304070ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9303fff640 1 -- 172.21.15.55:0/216608903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f40094d0 con 0x7f93040c89f0 2023-08-25T04:22:04.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9303fff640 1 --2- 172.21.15.55:0/216608903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93040c89f0 0x7f9304071430 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00c730 tx=0x7f92fc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:04.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9300ff9640 1 -- 172.21.15.55:0/216608903 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc003b80 con 0x7f93040c89f0 2023-08-25T04:22:04.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9300ff9640 1 -- 172.21.15.55:0/216608903 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92fc003ce0 con 0x7f93040c89f0 2023-08-25T04:22:04.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9309f00640 1 -- 172.21.15.55:0/216608903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9304096f00 con 0x7f93040c89f0 2023-08-25T04:22:04.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9300ff9640 1 -- 172.21.15.55:0/216608903 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc00aa30 con 0x7f93040c89f0 2023-08-25T04:22:04.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.197+0000 7f9309f00640 1 -- 172.21.15.55:0/216608903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93040971e0 con 0x7f93040c89f0 2023-08-25T04:22:04.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.201+0000 7f9309f00640 1 -- 172.21.15.55:0/216608903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f930404dbe0 con 0x7f93040c89f0 2023-08-25T04:22:04.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.201+0000 7f9300ff9640 1 -- 172.21.15.55:0/216608903 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 63) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f92fc00ab90 con 0x7f93040c89f0 2023-08-25T04:22:04.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.201+0000 7f9300ff9640 1 --2- 172.21.15.55:0/216608903 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f92e40658f0 0x7f92e4067db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:04.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.201+0000 7f9300ff9640 1 -- 172.21.15.55:0/216608903 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f92fc082fe0 con 0x7f93040c89f0 2023-08-25T04:22:04.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.201+0000 7f93037fe640 1 -- 172.21.15.55:0/216608903 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f92e40658f0 msgr2=0x7f92e4067db0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3764718770 2023-08-25T04:22:04.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.201+0000 7f93037fe640 1 --2- 172.21.15.55:0/216608903 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f92e40658f0 0x7f92e4067db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:22:04.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.205+0000 7f9300ff9640 1 -- 172.21.15.55:0/216608903 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f92fc050650 con 0x7f93040c89f0 2023-08-25T04:22:04.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.365+0000 7f9309f00640 1 -- 172.21.15.55:0/216608903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9304097400 con 0x7f93040c89f0 2023-08-25T04:22:04.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.365+0000 7f9300ff9640 1 -- 172.21.15.55:0/216608903 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+18810 (secure 0 0 0) 0x7f92fc053c70 con 0x7f93040c89f0 2023-08-25T04:22:04.365 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:04.366 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":123,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:21:39.491925+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:21:20.028451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-25T04:21:21.281198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/1881766103":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/2743969486":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/25303232":"2023-08-26T04:21:39.491872+0000","172.21.15.110:6833/4272914017":"2023-08-26T04:21:39.491872+0000","172.21.15.110:6832/4272914017":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/3203059750":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/251061267":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/484834832":"2023-08-26T04:21:39.491872+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:22:04.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.365+0000 7f9309f00640 1 -- 172.21.15.55:0/216608903 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f92e40658f0 msgr2=0x7f92e4067db0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:22:04.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.365+0000 7f9309f00640 1 --2- 172.21.15.55:0/216608903 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f92e40658f0 0x7f92e4067db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.365+0000 7f9309f00640 1 -- 172.21.15.55:0/216608903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93040c89f0 msgr2=0x7f9304071430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:04.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.365+0000 7f9309f00640 1 --2- 172.21.15.55:0/216608903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93040c89f0 0x7f9304071430 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00c730 tx=0x7f92fc00cbf0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.369+0000 7f9309f00640 1 -- 172.21.15.55:0/216608903 shutdown_connections 2023-08-25T04:22:04.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.369+0000 7f9309f00640 1 --2- 172.21.15.55:0/216608903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93040c89f0 0x7f9304071430 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.369+0000 7f9309f00640 1 --2- 172.21.15.55:0/216608903 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93040ad950 0x7f9304070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.369+0000 7f9309f00640 1 --2- 172.21.15.55:0/216608903 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f92e40658f0 0x7f92e4067db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.369+0000 7f9309f00640 1 --2- 172.21.15.55:0/216608903 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f930406c000 0x7f93040c1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.369+0000 7f9309f00640 1 -- 172.21.15.55:0/216608903 >> 172.21.15.55:0/216608903 conn(0x7f9304069d00 msgr2=0x7f93040c9590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:04.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.369+0000 7f9309f00640 1 -- 172.21.15.55:0/216608903 shutdown_connections 2023-08-25T04:22:04.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.369+0000 7f9309f00640 1 -- 172.21.15.55:0/216608903 wait complete. 2023-08-25T04:22:04.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:21:20.028451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:21:21.281198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:22:04.391 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:22:04.427 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:04.426+0000 7fd7c3e46180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:22:04.433 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:04.433+0000 7fc16ec38180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:22:04.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.541+0000 7f44a78d8640 1 Processor -- start 2023-08-25T04:22:04.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.541+0000 7f44a78d8640 1 -- start start 2023-08-25T04:22:04.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.545+0000 7f44a78d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44a00ad7b0 0x7f44a006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:04.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.545+0000 7f44a78d8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f44a00c1aa0 0x7f44a00c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:04.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.545+0000 7f44a78d8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a0161440 con 0x7f44a0164b30 2023-08-25T04:22:04.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.545+0000 7f44a78d8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a006cb20 con 0x7f44a00c1aa0 2023-08-25T04:22:04.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.545+0000 7f44a78d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a006ce00 con 0x7f44a00ad7b0 2023-08-25T04:22:04.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.545+0000 7f44a5e75640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f44a00c1aa0 0x7f44a00c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:04.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.545+0000 7f44a5674640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44a00ad7b0 0x7f44a006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:04.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.545+0000 7f44a5e75640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f44a00c1aa0 0x7f44a00c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:41292/0 (socket says 172.21.15.55:41292) 2023-08-25T04:22:04.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.545+0000 7f44a5e75640 1 -- 172.21.15.55:0/4015165352 learned_addr learned my addr 172.21.15.55:0/4015165352 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:04.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.545+0000 7f44a5674640 1 --2- 172.21.15.55:0/4015165352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44a00ad7b0 0x7f44a006c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:58664/0 (socket says 172.21.15.55:58664) 2023-08-25T04:22:04.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.545+0000 7f44a5e75640 1 -- 172.21.15.55:0/4015165352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44a00ad7b0 msgr2=0x7f44a006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:04.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.545+0000 7f44a5e75640 1 --2- 172.21.15.55:0/4015165352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44a00ad7b0 0x7f44a006c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.545+0000 7f44a5e75640 1 -- 172.21.15.55:0/4015165352 >> v1:172.21.15.110:6789/0 conn(0x7f44a0164b30 legacy=0x7f44a00c1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:04.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.545+0000 7f44a5e75640 1 -- 172.21.15.55:0/4015165352 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a006d0e0 con 0x7f44a00c1aa0 2023-08-25T04:22:04.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.549+0000 7f44a5e75640 1 --2- 172.21.15.55:0/4015165352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44a00c1aa0 0x7f44a00c9b90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4498009e50 tx=0x7f449801f1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48d8cea8006d05e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:04.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.549+0000 7f4497fff640 1 -- 172.21.15.55:0/4015165352 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44980af400 con 0x7f44a00c1aa0 2023-08-25T04:22:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.549+0000 7f4497fff640 1 -- 172.21.15.55:0/4015165352 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44980ab050 con 0x7f44a00c1aa0 2023-08-25T04:22:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.549+0000 7f4497fff640 1 -- 172.21.15.55:0/4015165352 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44980af780 con 0x7f44a00c1aa0 2023-08-25T04:22:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.549+0000 7f44a78d8640 1 -- 172.21.15.55:0/4015165352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44a00c1aa0 msgr2=0x7f44a00c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:04.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.549+0000 7f44a78d8640 1 --2- 172.21.15.55:0/4015165352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44a00c1aa0 0x7f44a00c9b90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4498009e50 tx=0x7f449801f1f0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.549+0000 7f44a78d8640 1 -- 172.21.15.55:0/4015165352 shutdown_connections 2023-08-25T04:22:04.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.549+0000 7f44a78d8640 1 --2- 172.21.15.55:0/4015165352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44a00c1aa0 0x7f44a00c9b90 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.549+0000 7f44a78d8640 1 --2- 172.21.15.55:0/4015165352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44a00ad7b0 0x7f44a006c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.549+0000 7f44a78d8640 1 -- 172.21.15.55:0/4015165352 >> 172.21.15.55:0/4015165352 conn(0x7f44a0069900 msgr2=0x7f44a0069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:04.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.549+0000 7f44a78d8640 1 -- 172.21.15.55:0/4015165352 shutdown_connections 2023-08-25T04:22:04.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.549+0000 7f44a78d8640 1 -- 172.21.15.55:0/4015165352 wait complete. 2023-08-25T04:22:04.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.549+0000 7f44a78d8640 1 Processor -- start 2023-08-25T04:22:04.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a78d8640 1 -- start start 2023-08-25T04:22:04.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a78d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44a00ad7b0 0x7f44a00c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:04.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a78d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44a00c1aa0 0x7f44a00c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:04.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a78d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44a0164b30 0x7f44a01faaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:04.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a78d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00c4d20 con 0x7f44a00ad7b0 2023-08-25T04:22:04.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a78d8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00c5b70 con 0x7f44a0164b30 2023-08-25T04:22:04.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a78d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00c5e50 con 0x7f44a00c1aa0 2023-08-25T04:22:04.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a5674640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44a00ad7b0 0x7f44a00c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a4e73640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44a00c1aa0 0x7f44a00c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a5e75640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44a0164b30 0x7f44a01faaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a4e73640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44a00c1aa0 0x7f44a00c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:58678/0 (socket says 172.21.15.55:58678) 2023-08-25T04:22:04.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a4e73640 1 -- 172.21.15.55:0/279632801 learned_addr learned my addr 172.21.15.55:0/279632801 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:04.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a4e73640 1 -- 172.21.15.55:0/279632801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44a0164b30 msgr2=0x7f44a01faaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:04.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a4e73640 1 --2- 172.21.15.55:0/279632801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44a0164b30 0x7f44a01faaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a4e73640 1 -- 172.21.15.55:0/279632801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44a00ad7b0 msgr2=0x7f44a00c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:04.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a4e73640 1 --2- 172.21.15.55:0/279632801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44a00ad7b0 0x7f44a00c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a4e73640 1 -- 172.21.15.55:0/279632801 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4498009b30 con 0x7f44a00c1aa0 2023-08-25T04:22:04.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a4e73640 1 --2- 172.21.15.55:0/279632801 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44a00c1aa0 0x7f44a00c47e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f449000c3c0 tx=0x7f449000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:04.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f4495ffb640 1 -- 172.21.15.55:0/279632801 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44900052d0 con 0x7f44a00c1aa0 2023-08-25T04:22:04.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f4495ffb640 1 -- 172.21.15.55:0/279632801 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4490005430 con 0x7f44a00c1aa0 2023-08-25T04:22:04.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a78d8640 1 -- 172.21.15.55:0/279632801 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a01fa2f0 con 0x7f44a00c1aa0 2023-08-25T04:22:04.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f4495ffb640 1 -- 172.21.15.55:0/279632801 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490003840 con 0x7f44a00c1aa0 2023-08-25T04:22:04.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a78d8640 1 -- 172.21.15.55:0/279632801 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a01fb030 con 0x7f44a00c1aa0 2023-08-25T04:22:04.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.553+0000 7f44a78d8640 1 -- 172.21.15.55:0/279632801 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a0071f80 con 0x7f44a00c1aa0 2023-08-25T04:22:04.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.557+0000 7f4495ffb640 1 -- 172.21.15.55:0/279632801 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 63) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f44900039a0 con 0x7f44a00c1aa0 2023-08-25T04:22:04.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.557+0000 7f4495ffb640 1 --2- 172.21.15.55:0/279632801 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f44840658c0 0x7f4484067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:04.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.557+0000 7f4495ffb640 1 -- 172.21.15.55:0/279632801 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f4490082820 con 0x7f44a00c1aa0 2023-08-25T04:22:04.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.557+0000 7f44a5674640 1 -- 172.21.15.55:0/279632801 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f44840658c0 msgr2=0x7f4484067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3764718770 2023-08-25T04:22:04.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.557+0000 7f44a5674640 1 --2- 172.21.15.55:0/279632801 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f44840658c0 0x7f4484067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:22:04.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.565+0000 7f4495ffb640 1 -- 172.21.15.55:0/279632801 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f449004ff10 con 0x7f44a00c1aa0 2023-08-25T04:22:04.580 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:04.578+0000 7fd7c3e46180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:22:04.595 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:04.593+0000 7fc16ec38180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:22:04.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.725+0000 7f44a78d8640 1 -- 172.21.15.55:0/279632801 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f44a0073ec0 con 0x7f44a00c1aa0 2023-08-25T04:22:04.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.725+0000 7f4495ffb640 1 -- 172.21.15.55:0/279632801 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v123) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4490053530 con 0x7f44a00c1aa0 2023-08-25T04:22:04.728 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:22:04.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.729+0000 7f44a78d8640 1 -- 172.21.15.55:0/279632801 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f44840658c0 msgr2=0x7f4484067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:22:04.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.729+0000 7f44a78d8640 1 --2- 172.21.15.55:0/279632801 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f44840658c0 0x7f4484067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.729+0000 7f44a78d8640 1 -- 172.21.15.55:0/279632801 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44a00c1aa0 msgr2=0x7f44a00c47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:04.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.729+0000 7f44a78d8640 1 --2- 172.21.15.55:0/279632801 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44a00c1aa0 0x7f44a00c47e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f449000c3c0 tx=0x7f449000c880 comp rx=0 tx=0).stop 2023-08-25T04:22:04.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.729+0000 7f44a78d8640 1 -- 172.21.15.55:0/279632801 shutdown_connections 2023-08-25T04:22:04.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.729+0000 7f44a78d8640 1 --2- 172.21.15.55:0/279632801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f44a0164b30 0x7f44a01faaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.729+0000 7f44a78d8640 1 --2- 172.21.15.55:0/279632801 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f44840658c0 0x7f4484067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.729+0000 7f44a78d8640 1 --2- 172.21.15.55:0/279632801 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f44a00c1aa0 0x7f44a00c47e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.729+0000 7f44a78d8640 1 --2- 172.21.15.55:0/279632801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44a00ad7b0 0x7f44a00c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.729+0000 7f44a78d8640 1 -- 172.21.15.55:0/279632801 >> 172.21.15.55:0/279632801 conn(0x7f44a0069900 msgr2=0x7f44a00cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:04.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.729+0000 7f44a78d8640 1 -- 172.21.15.55:0/279632801 shutdown_connections 2023-08-25T04:22:04.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.729+0000 7f44a78d8640 1 -- 172.21.15.55:0/279632801 wait complete. 2023-08-25T04:22:04.749 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:22:04.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.941+0000 7f3bd8f59640 1 Processor -- start 2023-08-25T04:22:04.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.941+0000 7f3bd8f59640 1 -- start start 2023-08-25T04:22:04.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.941+0000 7f3bd8f59640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3bd415e3c0 0x7f3bd415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:04.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.941+0000 7f3bd8f59640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3bd40d1290 0x7f3bd415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:04.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.941+0000 7f3bd8f59640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bd40cd5a0 con 0x7f3bd41601f0 2023-08-25T04:22:04.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.941+0000 7f3bd8f59640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd40cd880 con 0x7f3bd40d1290 2023-08-25T04:22:04.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.941+0000 7f3bd8f59640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bd40cdb60 con 0x7f3bd415e3c0 2023-08-25T04:22:04.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.941+0000 7f3bd2d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3bd40d1290 0x7f3bd415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:04.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.941+0000 7f3bd2d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3bd40d1290 0x7f3bd415e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33768/0 (socket says 172.21.15.55:33768) 2023-08-25T04:22:04.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.941+0000 7f3bd2d9d640 1 -- 172.21.15.55:0/3902593967 learned_addr learned my addr 172.21.15.55:0/3902593967 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:04.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.941+0000 7f3bcbfff640 1 --2- 172.21.15.55:0/3902593967 >> v2:172.21.15.110:3300/0 conn(0x7f3bd415e3c0 0x7f3bd415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:04.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.941+0000 7f3bd2d9d640 1 -- 172.21.15.55:0/3902593967 >> v2:172.21.15.110:3300/0 conn(0x7f3bd415e3c0 msgr2=0x7f3bd415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:04.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.941+0000 7f3bd2d9d640 1 --2- 172.21.15.55:0/3902593967 >> v2:172.21.15.110:3300/0 conn(0x7f3bd415e3c0 0x7f3bd415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.941+0000 7f3bd2d9d640 1 -- 172.21.15.55:0/3902593967 >> v1:172.21.15.110:6789/0 conn(0x7f3bd41601f0 legacy=0x7f3bd40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:04.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.941+0000 7f3bd2d9d640 1 -- 172.21.15.55:0/3902593967 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd40cde40 con 0x7f3bd40d1290 2023-08-25T04:22:04.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.945+0000 7f3bd2d9d640 1 --2- 172.21.15.55:0/3902593967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bd40d1290 0x7f3bd415e8a0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f3bd40cd350 tx=0x7f3bcc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694399788514ba8d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:04.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.945+0000 7f3bd1d9b640 1 -- 172.21.15.55:0/3902593967 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc0a5790 con 0x7f3bd40d1290 2023-08-25T04:22:04.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.945+0000 7f3bd1d9b640 1 -- 172.21.15.55:0/3902593967 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bcc0a58f0 con 0x7f3bd40d1290 2023-08-25T04:22:04.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.945+0000 7f3bd1d9b640 1 -- 172.21.15.55:0/3902593967 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc0a5c80 con 0x7f3bd40d1290 2023-08-25T04:22:04.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.945+0000 7f3bd8f59640 1 -- 172.21.15.55:0/3902593967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bd40d1290 msgr2=0x7f3bd415e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:04.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.945+0000 7f3bd8f59640 1 --2- 172.21.15.55:0/3902593967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bd40d1290 0x7f3bd415e8a0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f3bd40cd350 tx=0x7f3bcc01c9a0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.945+0000 7f3bd8f59640 1 -- 172.21.15.55:0/3902593967 shutdown_connections 2023-08-25T04:22:04.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.945+0000 7f3bd8f59640 1 --2- 172.21.15.55:0/3902593967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bd40d1290 0x7f3bd415e8a0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.945+0000 7f3bd8f59640 1 --2- 172.21.15.55:0/3902593967 >> v2:172.21.15.110:3300/0 conn(0x7f3bd415e3c0 0x7f3bd415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.945+0000 7f3bd8f59640 1 -- 172.21.15.55:0/3902593967 >> 172.21.15.55:0/3902593967 conn(0x7f3bd40d27d0 msgr2=0x7f3bd40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:04.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.945+0000 7f3bd8f59640 1 -- 172.21.15.55:0/3902593967 shutdown_connections 2023-08-25T04:22:04.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.945+0000 7f3bd8f59640 1 -- 172.21.15.55:0/3902593967 wait complete. 2023-08-25T04:22:04.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bd8f59640 1 Processor -- start 2023-08-25T04:22:04.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bd8f59640 1 -- start start 2023-08-25T04:22:04.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bd8f59640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bd40d1290 0x7f3bd4153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bd8f59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bd415e3c0 0x7f3bd415c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bd8f59640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bd41601f0 0x7f3bd415c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bd8f59640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40b6190 con 0x7f3bd415e3c0 2023-08-25T04:22:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bd8f59640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40c8370 con 0x7f3bd41601f0 2023-08-25T04:22:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bd8f59640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd40c8650 con 0x7f3bd40d1290 2023-08-25T04:22:04.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bcbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bd415e3c0 0x7f3bd415c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:04.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bcbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bd415e3c0 0x7f3bd415c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33776/0 (socket says 172.21.15.55:33776) 2023-08-25T04:22:04.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bcbfff640 1 -- 172.21.15.55:0/3606803334 learned_addr learned my addr 172.21.15.55:0/3606803334 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:04.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bd259c640 1 --2- 172.21.15.55:0/3606803334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bd40d1290 0x7f3bd4153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:04.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bd2d9d640 1 --2- 172.21.15.55:0/3606803334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bd41601f0 0x7f3bd415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:04.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bcbfff640 1 -- 172.21.15.55:0/3606803334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bd40d1290 msgr2=0x7f3bd4153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:04.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bcbfff640 1 --2- 172.21.15.55:0/3606803334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bd40d1290 0x7f3bd4153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bcbfff640 1 -- 172.21.15.55:0/3606803334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bd41601f0 msgr2=0x7f3bd415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:04.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bcbfff640 1 --2- 172.21.15.55:0/3606803334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bd41601f0 0x7f3bd415c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:04.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bcbfff640 1 -- 172.21.15.55:0/3606803334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc009b30 con 0x7f3bd415e3c0 2023-08-25T04:22:04.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bcbfff640 1 --2- 172.21.15.55:0/3606803334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bd415e3c0 0x7f3bd415c2d0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc00e930 tx=0x7f3bbc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:04.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bcaffd640 1 -- 172.21.15.55:0/3606803334 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc009690 con 0x7f3bd415e3c0 2023-08-25T04:22:04.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bcaffd640 1 -- 172.21.15.55:0/3606803334 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc00ca00 con 0x7f3bd415e3c0 2023-08-25T04:22:04.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bd8f59640 1 -- 172.21.15.55:0/3606803334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd40ce7c0 con 0x7f3bd415e3c0 2023-08-25T04:22:04.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bcaffd640 1 -- 172.21.15.55:0/3606803334 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00cd70 con 0x7f3bd415e3c0 2023-08-25T04:22:04.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.949+0000 7f3bd8f59640 1 -- 172.21.15.55:0/3606803334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd40b63e0 con 0x7f3bd415e3c0 2023-08-25T04:22:04.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.953+0000 7f3bd8f59640 1 -- 172.21.15.55:0/3606803334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd40b5260 con 0x7f3bd415e3c0 2023-08-25T04:22:04.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.953+0000 7f3bcaffd640 1 -- 172.21.15.55:0/3606803334 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 63) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f3bbc013470 con 0x7f3bd415e3c0 2023-08-25T04:22:04.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.953+0000 7f3bcaffd640 1 --2- 172.21.15.55:0/3606803334 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f3bb40658c0 0x7f3bb4067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:04.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.953+0000 7f3bcaffd640 1 -- 172.21.15.55:0/3606803334 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f3bbc0834e0 con 0x7f3bd415e3c0 2023-08-25T04:22:04.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.953+0000 7f3bd259c640 1 -- 172.21.15.55:0/3606803334 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f3bb40658c0 msgr2=0x7f3bb4067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3764718770 2023-08-25T04:22:04.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.953+0000 7f3bd259c640 1 --2- 172.21.15.55:0/3606803334 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f3bb40658c0 0x7f3bb4067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:22:04.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:04.957+0000 7f3bcaffd640 1 -- 172.21.15.55:0/3606803334 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3bbc050ce0 con 0x7f3bd415e3c0 2023-08-25T04:22:05.064 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:05.062+0000 7fd7c3e46180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:22:05.113 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:05.113+0000 7fc16ec38180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:22:05.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.117+0000 7f3bd8f59640 1 -- 172.21.15.55:0/3606803334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3bd4073ec0 con 0x7f3bd415e3c0 2023-08-25T04:22:05.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.117+0000 7f3bcaffd640 1 -- 172.21.15.55:0/3606803334 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v123) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3bbc054300 con 0x7f3bd415e3c0 2023-08-25T04:22:05.117 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:22:05.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.117+0000 7f3bd8f59640 1 -- 172.21.15.55:0/3606803334 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f3bb40658c0 msgr2=0x7f3bb4067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:22:05.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.117+0000 7f3bd8f59640 1 --2- 172.21.15.55:0/3606803334 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f3bb40658c0 0x7f3bb4067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.117+0000 7f3bd8f59640 1 -- 172.21.15.55:0/3606803334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bd415e3c0 msgr2=0x7f3bd415c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:05.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.117+0000 7f3bd8f59640 1 --2- 172.21.15.55:0/3606803334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bd415e3c0 0x7f3bd415c2d0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc00e930 tx=0x7f3bbc00edf0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.117+0000 7f3bd8f59640 1 -- 172.21.15.55:0/3606803334 shutdown_connections 2023-08-25T04:22:05.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.117+0000 7f3bd8f59640 1 --2- 172.21.15.55:0/3606803334 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bd41601f0 0x7f3bd415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.117+0000 7f3bd8f59640 1 --2- 172.21.15.55:0/3606803334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bd415e3c0 0x7f3bd415c2d0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.117+0000 7f3bd8f59640 1 --2- 172.21.15.55:0/3606803334 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f3bb40658c0 0x7f3bb4067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.117+0000 7f3bd8f59640 1 --2- 172.21.15.55:0/3606803334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bd40d1290 0x7f3bd4153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.117+0000 7f3bd8f59640 1 -- 172.21.15.55:0/3606803334 >> 172.21.15.55:0/3606803334 conn(0x7f3bd40d27d0 msgr2=0x7f3bd40cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:05.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.117+0000 7f3bd8f59640 1 -- 172.21.15.55:0/3606803334 shutdown_connections 2023-08-25T04:22:05.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.117+0000 7f3bd8f59640 1 -- 172.21.15.55:0/3606803334 wait complete. 2023-08-25T04:22:05.122 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:05.122+0000 7fd7c3e46180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:22:05.139 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:22:05.177 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:05.178+0000 7fd7c3e46180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:22:05.178 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:05.177+0000 7fc16ec38180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:22:05.237 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:05.237+0000 7fc16ec38180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:22:05.262 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:05.262+0000 7fd7c3e46180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:22:05.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.289+0000 7f26f298f640 1 Processor -- start 2023-08-25T04:22:05.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.289+0000 7f26f298f640 1 -- start start 2023-08-25T04:22:05.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.289+0000 7f26f298f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f26ec1601f0 0x7f26ec15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:05.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.289+0000 7f26f298f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f26ec15e3c0 0x7f26ec0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:05.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.289+0000 7f26f298f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26ec0d10c0 0x7f26ec0b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:05.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.289+0000 7f26f298f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ec0cd5a0 con 0x7f26ec15e3c0 2023-08-25T04:22:05.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.289+0000 7f26f298f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ec0cd880 con 0x7f26ec1601f0 2023-08-25T04:22:05.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.289+0000 7f26f298f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec0cdb60 con 0x7f26ec0d10c0 2023-08-25T04:22:05.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.289+0000 7f26eb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f26ec15e3c0 0x7f26ec0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:05.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.289+0000 7f26ebfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f26ec1601f0 0x7f26ec15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:05.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.289+0000 7f26eb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f26ec15e3c0 0x7f26ec0d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33778/0 (socket says 172.21.15.55:33778) 2023-08-25T04:22:05.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.289+0000 7f26eb7fe640 1 -- 172.21.15.55:0/428113927 learned_addr learned my addr 172.21.15.55:0/428113927 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:05.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.289+0000 7f26f0f2c640 1 --2- 172.21.15.55:0/428113927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26ec0d10c0 0x7f26ec0b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:05.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.289+0000 7f26eb7fe640 1 -- 172.21.15.55:0/428113927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26ec0d10c0 msgr2=0x7f26ec0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:05.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.289+0000 7f26eb7fe640 1 --2- 172.21.15.55:0/428113927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26ec0d10c0 0x7f26ec0b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.289+0000 7f26eb7fe640 1 -- 172.21.15.55:0/428113927 >> v2:172.21.15.110:3300/0 conn(0x7f26ec1601f0 msgr2=0x7f26ec15d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:05.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.289+0000 7f26eb7fe640 1 --2- 172.21.15.55:0/428113927 >> v2:172.21.15.110:3300/0 conn(0x7f26ec1601f0 0x7f26ec15d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.289+0000 7f26eb7fe640 1 -- 172.21.15.55:0/428113927 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ec0cde40 con 0x7f26ec15e3c0 2023-08-25T04:22:05.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.293+0000 7f26eb7fe640 1 --2- 172.21.15.55:0/428113927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26ec15e3c0 0x7f26ec0d0b80 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f26ec08b7f0 tx=0x7f26e001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d05349f4d8a005 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:05.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.293+0000 7f26eaffd640 1 -- 172.21.15.55:0/428113927 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e00a89b0 con 0x7f26ec15e3c0 2023-08-25T04:22:05.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.293+0000 7f26eaffd640 1 -- 172.21.15.55:0/428113927 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e00a8b10 con 0x7f26ec15e3c0 2023-08-25T04:22:05.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.293+0000 7f26eaffd640 1 -- 172.21.15.55:0/428113927 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e00a8ea0 con 0x7f26ec15e3c0 2023-08-25T04:22:05.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.293+0000 7f26f298f640 1 -- 172.21.15.55:0/428113927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26ec15e3c0 msgr2=0x7f26ec0d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:05.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.293+0000 7f26f298f640 1 --2- 172.21.15.55:0/428113927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26ec15e3c0 0x7f26ec0d0b80 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f26ec08b7f0 tx=0x7f26e001ecf0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.293+0000 7f26f298f640 1 -- 172.21.15.55:0/428113927 shutdown_connections 2023-08-25T04:22:05.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.293+0000 7f26f298f640 1 --2- 172.21.15.55:0/428113927 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26ec0d10c0 0x7f26ec0b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.293+0000 7f26f298f640 1 --2- 172.21.15.55:0/428113927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26ec15e3c0 0x7f26ec0d0b80 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.293+0000 7f26f298f640 1 --2- 172.21.15.55:0/428113927 >> v2:172.21.15.110:3300/0 conn(0x7f26ec1601f0 0x7f26ec15d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.293+0000 7f26f298f640 1 -- 172.21.15.55:0/428113927 >> 172.21.15.55:0/428113927 conn(0x7f26ec0d27d0 msgr2=0x7f26ec0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:05.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.293+0000 7f26f298f640 1 -- 172.21.15.55:0/428113927 shutdown_connections 2023-08-25T04:22:05.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.293+0000 7f26f298f640 1 -- 172.21.15.55:0/428113927 wait complete. 2023-08-25T04:22:05.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26f298f640 1 Processor -- start 2023-08-25T04:22:05.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26f298f640 1 -- start start 2023-08-25T04:22:05.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26f298f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26ec0d10c0 0x7f26ec0cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:05.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26f298f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ec15e3c0 0x7f26ec0af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:05.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26f298f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26ec1601f0 0x7f26ec0afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:05.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26f298f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec14f8a0 con 0x7f26ec1601f0 2023-08-25T04:22:05.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26f298f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec14faf0 con 0x7f26ec15e3c0 2023-08-25T04:22:05.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26f298f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec14fdd0 con 0x7f26ec0d10c0 2023-08-25T04:22:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26f0f2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26ec1601f0 0x7f26ec0afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26f0f2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26ec1601f0 0x7f26ec0afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33788/0 (socket says 172.21.15.55:33788) 2023-08-25T04:22:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26eb7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ec15e3c0 0x7f26ec0af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26f0f2c640 1 -- 172.21.15.55:0/1984590035 learned_addr learned my addr 172.21.15.55:0/1984590035 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26ebfff640 1 --2- 172.21.15.55:0/1984590035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26ec0d10c0 0x7f26ec0cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26eb7fe640 1 -- 172.21.15.55:0/1984590035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26ec0d10c0 msgr2=0x7f26ec0cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:05.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26eb7fe640 1 --2- 172.21.15.55:0/1984590035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26ec0d10c0 0x7f26ec0cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26eb7fe640 1 -- 172.21.15.55:0/1984590035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26ec1601f0 msgr2=0x7f26ec0afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:05.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26eb7fe640 1 --2- 172.21.15.55:0/1984590035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26ec1601f0 0x7f26ec0afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26eb7fe640 1 -- 172.21.15.55:0/1984590035 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e00094d0 con 0x7f26ec15e3c0 2023-08-25T04:22:05.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26ebfff640 1 --2- 172.21.15.55:0/1984590035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26ec0d10c0 0x7f26ec0cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:22:05.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26f0f2c640 1 --2- 172.21.15.55:0/1984590035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26ec1601f0 0x7f26ec0afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:22:05.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26eb7fe640 1 --2- 172.21.15.55:0/1984590035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ec15e3c0 0x7f26ec0af6d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f26e00af000 tx=0x7f26e001ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:05.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26e8ff9640 1 -- 172.21.15.55:0/1984590035 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e00b0da0 con 0x7f26ec15e3c0 2023-08-25T04:22:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26e8ff9640 1 -- 172.21.15.55:0/1984590035 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e00bb460 con 0x7f26ec15e3c0 2023-08-25T04:22:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26e8ff9640 1 -- 172.21.15.55:0/1984590035 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e00bb810 con 0x7f26ec15e3c0 2023-08-25T04:22:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26f298f640 1 -- 172.21.15.55:0/1984590035 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ec0ce7c0 con 0x7f26ec15e3c0 2023-08-25T04:22:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.297+0000 7f26f298f640 1 -- 172.21.15.55:0/1984590035 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ec150390 con 0x7f26ec15e3c0 2023-08-25T04:22:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.301+0000 7f26f298f640 1 -- 172.21.15.55:0/1984590035 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ec0b5260 con 0x7f26ec15e3c0 2023-08-25T04:22:05.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.301+0000 7f26e8ff9640 1 -- 172.21.15.55:0/1984590035 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 63) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f26e00b83f0 con 0x7f26ec15e3c0 2023-08-25T04:22:05.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.301+0000 7f26e8ff9640 1 --2- 172.21.15.55:0/1984590035 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f26d80658f0 0x7f26d8067db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:05.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.301+0000 7f26e8ff9640 1 -- 172.21.15.55:0/1984590035 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f26e0120bc0 con 0x7f26ec15e3c0 2023-08-25T04:22:05.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.301+0000 7f26ebfff640 1 -- 172.21.15.55:0/1984590035 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f26d80658f0 msgr2=0x7f26d8067db0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3764718770 2023-08-25T04:22:05.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.301+0000 7f26ebfff640 1 --2- 172.21.15.55:0/1984590035 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f26d80658f0 0x7f26d8067db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:22:05.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.305+0000 7f26e8ff9640 1 -- 172.21.15.55:0/1984590035 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f26e00ee140 con 0x7f26ec15e3c0 2023-08-25T04:22:05.320 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:05.318+0000 7fd7c3e46180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:22:05.334 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:05.333+0000 7fc16ec38180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:22:05.395 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:05.393+0000 7fc16ec38180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:22:05.405 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:05.402+0000 7fd7c3e46180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:22:05.460 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:05.458+0000 7fd7c3e46180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:22:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.465+0000 7f26f298f640 1 -- 172.21.15.55:0/1984590035 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f26ec150580 con 0x7f26ec15e3c0 2023-08-25T04:22:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.465+0000 7f26e8ff9640 1 -- 172.21.15.55:0/1984590035 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v123) v1 ==== 104+0+11 (secure 0 0 0) 0x7f26e00c00a0 con 0x7f26ec15e3c0 2023-08-25T04:22:05.465 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:22:05.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.465+0000 7f26f298f640 1 -- 172.21.15.55:0/1984590035 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f26d80658f0 msgr2=0x7f26d8067db0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:22:05.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.465+0000 7f26f298f640 1 --2- 172.21.15.55:0/1984590035 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f26d80658f0 0x7f26d8067db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.465+0000 7f26f298f640 1 -- 172.21.15.55:0/1984590035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ec15e3c0 msgr2=0x7f26ec0af6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:05.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.465+0000 7f26f298f640 1 --2- 172.21.15.55:0/1984590035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ec15e3c0 0x7f26ec0af6d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f26e00af000 tx=0x7f26e001ba90 comp rx=0 tx=0).stop 2023-08-25T04:22:05.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.465+0000 7f26f298f640 1 -- 172.21.15.55:0/1984590035 shutdown_connections 2023-08-25T04:22:05.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.465+0000 7f26f298f640 1 --2- 172.21.15.55:0/1984590035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26ec1601f0 0x7f26ec0afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.465+0000 7f26f298f640 1 --2- 172.21.15.55:0/1984590035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26ec15e3c0 0x7f26ec0af6d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.465+0000 7f26f298f640 1 --2- 172.21.15.55:0/1984590035 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f26d80658f0 0x7f26d8067db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.465+0000 7f26f298f640 1 --2- 172.21.15.55:0/1984590035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26ec0d10c0 0x7f26ec0cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.465+0000 7f26f298f640 1 -- 172.21.15.55:0/1984590035 >> 172.21.15.55:0/1984590035 conn(0x7f26ec0d27d0 msgr2=0x7f26ec15cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:05.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.465+0000 7f26f298f640 1 -- 172.21.15.55:0/1984590035 shutdown_connections 2023-08-25T04:22:05.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.465+0000 7f26f298f640 1 -- 172.21.15.55:0/1984590035 wait complete. 2023-08-25T04:22:05.485 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:05.485+0000 7fc16ec38180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:22:05.487 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:22:05.546 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:05.545+0000 7fc16ec38180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:22:05.603 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:05.602+0000 7fd7c3e46180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:22:05.661 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:05.662+0000 7fd7c3e46180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:22:05.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.681+0000 7f4d6d5ac640 1 Processor -- start 2023-08-25T04:22:05.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.681+0000 7f4d6d5ac640 1 -- start start 2023-08-25T04:22:05.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.681+0000 7f4d6d5ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4d681601f0 0x7f4d6815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:05.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.681+0000 7f4d6d5ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d680d1290 0x7f4d6815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:05.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.681+0000 7f4d6d5ac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d680cd5a0 con 0x7f4d6815e3c0 2023-08-25T04:22:05.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.681+0000 7f4d6d5ac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d680cd880 con 0x7f4d681601f0 2023-08-25T04:22:05.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.681+0000 7f4d6d5ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680cdb60 con 0x7f4d680d1290 2023-08-25T04:22:05.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.681+0000 7f4d5ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4d6815e3c0 0x7f4d680d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41650/0 (socket says 172.21.15.55:41650) 2023-08-25T04:22:05.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.681+0000 7f4d5ffff640 1 -- 172.21.15.55:0/1762933058 learned_addr learned my addr 172.21.15.55:0/1762933058 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:05.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.681+0000 7f4d66ffd640 1 --2- 172.21.15.55:0/1762933058 >> v2:172.21.15.55:3300/0 conn(0x7f4d681601f0 0x7f4d6815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:05.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.681+0000 7f4d677fe640 1 --2- 172.21.15.55:0/1762933058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d680d1290 0x7f4d6815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:05.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.681+0000 7f4d667fc640 1 -- 172.21.15.55:0/1762933058 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485080795 0 0) 0x7f4d680cd5a0 con 0x7f4d6815e3c0 2023-08-25T04:22:05.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.681+0000 7f4d667fc640 1 -- 172.21.15.55:0/1762933058 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d54003530 con 0x7f4d6815e3c0 2023-08-25T04:22:05.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.681+0000 7f4d66ffd640 1 -- 172.21.15.55:0/1762933058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d680d1290 msgr2=0x7f4d6815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:05.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.681+0000 7f4d66ffd640 1 --2- 172.21.15.55:0/1762933058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d680d1290 0x7f4d6815e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.681+0000 7f4d66ffd640 1 -- 172.21.15.55:0/1762933058 >> v1:172.21.15.55:6789/0 conn(0x7f4d6815e3c0 legacy=0x7f4d680d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:05.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.681+0000 7f4d66ffd640 1 -- 172.21.15.55:0/1762933058 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d680cde40 con 0x7f4d681601f0 2023-08-25T04:22:05.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.681+0000 7f4d677fe640 1 --2- 172.21.15.55:0/1762933058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d680d1290 0x7f4d6815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:22:05.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.685+0000 7f4d66ffd640 1 --2- 172.21.15.55:0/1762933058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d681601f0 0x7f4d6815d430 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f4d580097a0 tx=0x7f4d5801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfed5c7290eef81 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:05.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.685+0000 7f4d667fc640 1 -- 172.21.15.55:0/1762933058 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d580a8950 con 0x7f4d681601f0 2023-08-25T04:22:05.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.685+0000 7f4d667fc640 1 -- 172.21.15.55:0/1762933058 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d580a8ab0 con 0x7f4d681601f0 2023-08-25T04:22:05.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.685+0000 7f4d667fc640 1 -- 172.21.15.55:0/1762933058 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d580a8e40 con 0x7f4d681601f0 2023-08-25T04:22:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.685+0000 7f4d6d5ac640 1 -- 172.21.15.55:0/1762933058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d681601f0 msgr2=0x7f4d6815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.685+0000 7f4d6d5ac640 1 --2- 172.21.15.55:0/1762933058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d681601f0 0x7f4d6815d430 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f4d580097a0 tx=0x7f4d5801ec50 comp rx=0 tx=0).stop 2023-08-25T04:22:05.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.685+0000 7f4d6d5ac640 1 -- 172.21.15.55:0/1762933058 shutdown_connections 2023-08-25T04:22:05.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.685+0000 7f4d6d5ac640 1 --2- 172.21.15.55:0/1762933058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d680d1290 0x7f4d6815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.685+0000 7f4d6d5ac640 1 --2- 172.21.15.55:0/1762933058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d681601f0 0x7f4d6815d430 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.685+0000 7f4d6d5ac640 1 -- 172.21.15.55:0/1762933058 >> 172.21.15.55:0/1762933058 conn(0x7f4d680d27d0 msgr2=0x7f4d680d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:05.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.685+0000 7f4d6d5ac640 1 -- 172.21.15.55:0/1762933058 shutdown_connections 2023-08-25T04:22:05.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.685+0000 7f4d6d5ac640 1 -- 172.21.15.55:0/1762933058 wait complete. 2023-08-25T04:22:05.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d6d5ac640 1 Processor -- start 2023-08-25T04:22:05.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d6d5ac640 1 -- start start 2023-08-25T04:22:05.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d6d5ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d680d1290 0x7f4d680c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:05.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d6d5ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d6815e3c0 0x7f4d6815a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:05.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d6d5ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d681601f0 0x7f4d6815ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:05.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d6d5ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680cb1b0 con 0x7f4d680d1290 2023-08-25T04:22:05.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d6d5ac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680ca110 con 0x7f4d681601f0 2023-08-25T04:22:05.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d6d5ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680ca3f0 con 0x7f4d6815e3c0 2023-08-25T04:22:05.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d66ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d680d1290 0x7f4d680c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:05.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d66ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d680d1290 0x7f4d680c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33812/0 (socket says 172.21.15.55:33812) 2023-08-25T04:22:05.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d66ffd640 1 -- 172.21.15.55:0/3705644347 learned_addr learned my addr 172.21.15.55:0/3705644347 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:05.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d5ffff640 1 --2- 172.21.15.55:0/3705644347 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d6815e3c0 0x7f4d6815a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:05.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d677fe640 1 --2- 172.21.15.55:0/3705644347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d681601f0 0x7f4d6815ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:05.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d66ffd640 1 -- 172.21.15.55:0/3705644347 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d6815e3c0 msgr2=0x7f4d6815a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:05.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d66ffd640 1 --2- 172.21.15.55:0/3705644347 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d6815e3c0 0x7f4d6815a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d66ffd640 1 -- 172.21.15.55:0/3705644347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d681601f0 msgr2=0x7f4d6815ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:05.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d66ffd640 1 --2- 172.21.15.55:0/3705644347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d681601f0 0x7f4d6815ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d66ffd640 1 -- 172.21.15.55:0/3705644347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d60009a70 con 0x7f4d680d1290 2023-08-25T04:22:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d66ffd640 1 --2- 172.21.15.55:0/3705644347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d680d1290 0x7f4d680c9810 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f4d580b3040 tx=0x7f4d5801b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d5f7fe640 1 -- 172.21.15.55:0/3705644347 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d580bd070 con 0x7f4d680d1290 2023-08-25T04:22:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d5f7fe640 1 -- 172.21.15.55:0/3705644347 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d58006dc0 con 0x7f4d680d1290 2023-08-25T04:22:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d5f7fe640 1 -- 172.21.15.55:0/3705644347 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d580b0d60 con 0x7f4d680d1290 2023-08-25T04:22:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d6d5ac640 1 -- 172.21.15.55:0/3705644347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d580093b0 con 0x7f4d680d1290 2023-08-25T04:22:05.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.689+0000 7f4d6d5ac640 1 -- 172.21.15.55:0/3705644347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d680ca9b0 con 0x7f4d680d1290 2023-08-25T04:22:05.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.693+0000 7f4d6d5ac640 1 -- 172.21.15.55:0/3705644347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d680b5260 con 0x7f4d680d1290 2023-08-25T04:22:05.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.693+0000 7f4d5f7fe640 1 -- 172.21.15.55:0/3705644347 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 63) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f4d580b7040 con 0x7f4d680d1290 2023-08-25T04:22:05.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.693+0000 7f4d5f7fe640 1 --2- 172.21.15.55:0/3705644347 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f4d480658c0 0x7f4d48067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:05.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.693+0000 7f4d5f7fe640 1 -- 172.21.15.55:0/3705644347 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f4d58120230 con 0x7f4d680d1290 2023-08-25T04:22:05.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.693+0000 7f4d5ffff640 1 -- 172.21.15.55:0/3705644347 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f4d480658c0 msgr2=0x7f4d48067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3764718770 2023-08-25T04:22:05.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.693+0000 7f4d5ffff640 1 --2- 172.21.15.55:0/3705644347 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f4d480658c0 0x7f4d48067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:22:05.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.697+0000 7f4d5f7fe640 1 -- 172.21.15.55:0/3705644347 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4d580ed790 con 0x7f4d680d1290 2023-08-25T04:22:05.702 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:05.701+0000 7fc16ec38180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:22:05.765 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:05.765+0000 7fc16ec38180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:22:05.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.857+0000 7f4d6d5ac640 1 -- 172.21.15.55:0/3705644347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d68073ec0 con 0x7f4d680d1290 2023-08-25T04:22:05.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.857+0000 7f4d5f7fe640 1 -- 172.21.15.55:0/3705644347 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v123) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d580f0db0 con 0x7f4d680d1290 2023-08-25T04:22:05.857 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:22:05.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.857+0000 7f4d6d5ac640 1 -- 172.21.15.55:0/3705644347 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f4d480658c0 msgr2=0x7f4d48067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:22:05.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.857+0000 7f4d6d5ac640 1 --2- 172.21.15.55:0/3705644347 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f4d480658c0 0x7f4d48067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.857+0000 7f4d6d5ac640 1 -- 172.21.15.55:0/3705644347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d680d1290 msgr2=0x7f4d680c9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:05.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.857+0000 7f4d6d5ac640 1 --2- 172.21.15.55:0/3705644347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d680d1290 0x7f4d680c9810 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f4d580b3040 tx=0x7f4d5801b9f0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.857+0000 7f4d6d5ac640 1 -- 172.21.15.55:0/3705644347 shutdown_connections 2023-08-25T04:22:05.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.857+0000 7f4d6d5ac640 1 --2- 172.21.15.55:0/3705644347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d681601f0 0x7f4d6815ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.857+0000 7f4d6d5ac640 1 --2- 172.21.15.55:0/3705644347 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f4d480658c0 0x7f4d48067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.857+0000 7f4d6d5ac640 1 --2- 172.21.15.55:0/3705644347 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d6815e3c0 0x7f4d6815a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.857+0000 7f4d6d5ac640 1 --2- 172.21.15.55:0/3705644347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d680d1290 0x7f4d680c9810 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:05.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.857+0000 7f4d6d5ac640 1 -- 172.21.15.55:0/3705644347 >> 172.21.15.55:0/3705644347 conn(0x7f4d680d27d0 msgr2=0x7f4d6815dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:05.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.857+0000 7f4d6d5ac640 1 -- 172.21.15.55:0/3705644347 shutdown_connections 2023-08-25T04:22:05.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:05.857+0000 7f4d6d5ac640 1 -- 172.21.15.55:0/3705644347 wait complete. 2023-08-25T04:22:05.879 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T04:22:05.902 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:22:05.903 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:22:05.903 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:22:05.910 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:05.910+0000 7fd7c3e46180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:22:06.020 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:22:06.020 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:22:06.021 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:22:06.029 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:06.029+0000 7fc16ec38180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:22:06.045 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:06.046+0000 7fd7c3e46180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:22:06.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.117+0000 7f9d351ac640 1 Processor -- start 2023-08-25T04:22:06.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.117+0000 7f9d351ac640 1 -- start start 2023-08-25T04:22:06.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.117+0000 7f9d351ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d300ceeb0 0x7f9d30165690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:06.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.117+0000 7f9d351ac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d300ac100 con 0x7f9d3015eba0 2023-08-25T04:22:06.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.117+0000 7f9d351ac640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d300ac3a0 con 0x7f9d3015ef80 2023-08-25T04:22:06.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.117+0000 7f9d351ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d300b3150 con 0x7f9d300ceeb0 2023-08-25T04:22:06.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.117+0000 7f9d2ed9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9d3015eba0 0x7f9d300b2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41662/0 (socket says 172.21.15.55:41662) 2023-08-25T04:22:06.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.117+0000 7f9d2ed9d640 1 -- 172.21.15.55:0/3159200375 learned_addr learned my addr 172.21.15.55:0/3159200375 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:06.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.117+0000 7f9d2f59e640 1 --2- 172.21.15.55:0/3159200375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d300ceeb0 0x7f9d30165690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:06.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.117+0000 7f9d2e59c640 1 -- 172.21.15.55:0/3159200375 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128778013 0 0) 0x7f9d300ac100 con 0x7f9d3015eba0 2023-08-25T04:22:06.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.117+0000 7f9d2e59c640 1 -- 172.21.15.55:0/3159200375 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d1c003530 con 0x7f9d3015eba0 2023-08-25T04:22:06.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.117+0000 7f9d2e59c640 1 -- 172.21.15.55:0/3159200375 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64003517 0 0) 0x7f9d300ac3a0 con 0x7f9d3015ef80 2023-08-25T04:22:06.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.117+0000 7f9d2e59c640 1 -- 172.21.15.55:0/3159200375 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d300ac100 con 0x7f9d3015ef80 2023-08-25T04:22:06.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.117+0000 7f9d2f59e640 1 -- 172.21.15.55:0/3159200375 >> v1:172.21.15.110:6789/0 conn(0x7f9d3015ef80 legacy=0x7f9d300ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:06.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.117+0000 7f9d2f59e640 1 -- 172.21.15.55:0/3159200375 >> v1:172.21.15.55:6789/0 conn(0x7f9d3015eba0 legacy=0x7f9d300b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:06.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.117+0000 7f9d2f59e640 1 -- 172.21.15.55:0/3159200375 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d300b1390 con 0x7f9d300ceeb0 2023-08-25T04:22:06.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.121+0000 7f9d2f59e640 1 --2- 172.21.15.55:0/3159200375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d300ceeb0 0x7f9d30165690 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009dc0 tx=0x7f9d2801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7001a0cc35c29a1a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:06.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.121+0000 7f9d2e59c640 1 -- 172.21.15.55:0/3159200375 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d280a5a00 con 0x7f9d300ceeb0 2023-08-25T04:22:06.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.121+0000 7f9d2e59c640 1 -- 172.21.15.55:0/3159200375 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d280a5b60 con 0x7f9d300ceeb0 2023-08-25T04:22:06.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.121+0000 7f9d2e59c640 1 -- 172.21.15.55:0/3159200375 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d280ad440 con 0x7f9d300ceeb0 2023-08-25T04:22:06.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.121+0000 7f9d351ac640 1 -- 172.21.15.55:0/3159200375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d300ceeb0 msgr2=0x7f9d30165690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:06.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.121+0000 7f9d351ac640 1 --2- 172.21.15.55:0/3159200375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d300ceeb0 0x7f9d30165690 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009dc0 tx=0x7f9d2801c940 comp rx=0 tx=0).stop 2023-08-25T04:22:06.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.121+0000 7f9d351ac640 1 -- 172.21.15.55:0/3159200375 shutdown_connections 2023-08-25T04:22:06.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.121+0000 7f9d351ac640 1 --2- 172.21.15.55:0/3159200375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d300ceeb0 0x7f9d30165690 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.121+0000 7f9d351ac640 1 -- 172.21.15.55:0/3159200375 >> 172.21.15.55:0/3159200375 conn(0x7f9d30069d00 msgr2=0x7f9d3006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:06.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.121+0000 7f9d351ac640 1 -- 172.21.15.55:0/3159200375 shutdown_connections 2023-08-25T04:22:06.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.121+0000 7f9d351ac640 1 -- 172.21.15.55:0/3159200375 wait complete. 2023-08-25T04:22:06.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d351ac640 1 Processor -- start 2023-08-25T04:22:06.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d351ac640 1 -- start start 2023-08-25T04:22:06.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d351ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d300ceeb0 0x7f9d30154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d351ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d3015eba0 0x7f9d3015a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d351ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d3015ef80 0x7f9d301582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d351ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3015d250 con 0x7f9d3015ef80 2023-08-25T04:22:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d351ac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3015cf70 con 0x7f9d3015eba0 2023-08-25T04:22:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d351ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3006c0a0 con 0x7f9d300ceeb0 2023-08-25T04:22:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d2659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d3015eba0 0x7f9d3015a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d2ed9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d300ceeb0 0x7f9d30154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d2f59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d3015ef80 0x7f9d301582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d2659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d3015eba0 0x7f9d3015a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:41376/0 (socket says 172.21.15.55:41376) 2023-08-25T04:22:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d2659c640 1 -- 172.21.15.55:0/2244983279 learned_addr learned my addr 172.21.15.55:0/2244983279 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d2659c640 1 -- 172.21.15.55:0/2244983279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d300ceeb0 msgr2=0x7f9d30154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d2659c640 1 --2- 172.21.15.55:0/2244983279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d300ceeb0 0x7f9d30154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d2659c640 1 -- 172.21.15.55:0/2244983279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d3015ef80 msgr2=0x7f9d301582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:06.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d2659c640 1 --2- 172.21.15.55:0/2244983279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d3015ef80 0x7f9d301582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d2659c640 1 -- 172.21.15.55:0/2244983279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d28009a70 con 0x7f9d3015eba0 2023-08-25T04:22:06.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d2ed9d640 1 --2- 172.21.15.55:0/2244983279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d300ceeb0 0x7f9d30154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:22:06.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d2659c640 1 --2- 172.21.15.55:0/2244983279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d3015eba0 0x7f9d3015a450 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800c490 tx=0x7f9d1800c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:06.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d27fff640 1 -- 172.21.15.55:0/2244983279 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d180052d0 con 0x7f9d3015eba0 2023-08-25T04:22:06.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d27fff640 1 -- 172.21.15.55:0/2244983279 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d18005430 con 0x7f9d3015eba0 2023-08-25T04:22:06.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d27fff640 1 -- 172.21.15.55:0/2244983279 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18012870 con 0x7f9d3015eba0 2023-08-25T04:22:06.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d351ac640 1 -- 172.21.15.55:0/2244983279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d3006c380 con 0x7f9d3015eba0 2023-08-25T04:22:06.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.125+0000 7f9d351ac640 1 -- 172.21.15.55:0/2244983279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d3006cb80 con 0x7f9d3015eba0 2023-08-25T04:22:06.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.129+0000 7f9d351ac640 1 -- 172.21.15.55:0/2244983279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d3004dbe0 con 0x7f9d3015eba0 2023-08-25T04:22:06.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.129+0000 7f9d27fff640 1 -- 172.21.15.55:0/2244983279 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 63) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f9d180129d0 con 0x7f9d3015eba0 2023-08-25T04:22:06.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.129+0000 7f9d27fff640 1 --2- 172.21.15.55:0/2244983279 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f9d100658c0 0x7f9d10067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:06.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.129+0000 7f9d27fff640 1 -- 172.21.15.55:0/2244983279 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f9d18082e20 con 0x7f9d3015eba0 2023-08-25T04:22:06.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.129+0000 7f9d2ed9d640 1 -- 172.21.15.55:0/2244983279 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f9d100658c0 msgr2=0x7f9d10067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3764718770 2023-08-25T04:22:06.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.129+0000 7f9d2ed9d640 1 --2- 172.21.15.55:0/2244983279 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f9d100658c0 0x7f9d10067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:22:06.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.133+0000 7f9d27fff640 1 -- 172.21.15.55:0/2244983279 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9d180504c0 con 0x7f9d3015eba0 2023-08-25T04:22:06.171 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:06.170+0000 7fd7c3e46180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:22:06.175 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:06.173+0000 7fc16ec38180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:22:06.242 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:06.242+0000 7fd7c3e46180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:22:06.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.305+0000 7f9d351ac640 1 -- 172.21.15.55:0/2244983279 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9d300b2c40 con 0x7f9d3015eba0 2023-08-25T04:22:06.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.305+0000 7f9d27fff640 1 -- 172.21.15.55:0/2244983279 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v123) v1 ==== 80+0+474 (secure 0 0 0) 0x7f9d18053ae0 con 0x7f9d3015eba0 2023-08-25T04:22:06.307 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/1881766103 2023-08-26T04:21:39.491872+0000 2023-08-25T04:22:06.307 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/2743969486 2023-08-26T04:21:39.491872+0000 2023-08-25T04:22:06.307 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/25303232 2023-08-26T04:21:39.491872+0000 2023-08-25T04:22:06.307 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6833/4272914017 2023-08-26T04:21:39.491872+0000 2023-08-25T04:22:06.307 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6832/4272914017 2023-08-26T04:21:39.491872+0000 2023-08-25T04:22:06.308 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3203059750 2023-08-26T04:21:39.491872+0000 2023-08-25T04:22:06.308 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/251061267 2023-08-26T04:21:39.491872+0000 2023-08-25T04:22:06.308 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/484834832 2023-08-26T04:21:39.491872+0000 2023-08-25T04:22:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:listed 8 entries 2023-08-25T04:22:06.310 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:06.309+0000 7fc16ec38180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:22:06.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.309+0000 7f9d351ac640 1 -- 172.21.15.55:0/2244983279 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f9d100658c0 msgr2=0x7f9d10067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:22:06.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.309+0000 7f9d351ac640 1 --2- 172.21.15.55:0/2244983279 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f9d100658c0 0x7f9d10067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.309+0000 7f9d351ac640 1 -- 172.21.15.55:0/2244983279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d3015eba0 msgr2=0x7f9d3015a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:06.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.309+0000 7f9d351ac640 1 --2- 172.21.15.55:0/2244983279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d3015eba0 0x7f9d3015a450 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800c490 tx=0x7f9d1800c950 comp rx=0 tx=0).stop 2023-08-25T04:22:06.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.309+0000 7f9d351ac640 1 -- 172.21.15.55:0/2244983279 shutdown_connections 2023-08-25T04:22:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.309+0000 7f9d351ac640 1 --2- 172.21.15.55:0/2244983279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d3015ef80 0x7f9d301582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.309+0000 7f9d351ac640 1 --2- 172.21.15.55:0/2244983279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d3015eba0 0x7f9d3015a450 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.309+0000 7f9d351ac640 1 --2- 172.21.15.55:0/2244983279 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f9d100658c0 0x7f9d10067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.309+0000 7f9d351ac640 1 --2- 172.21.15.55:0/2244983279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d300ceeb0 0x7f9d30154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.309+0000 7f9d351ac640 1 -- 172.21.15.55:0/2244983279 >> 172.21.15.55:0/2244983279 conn(0x7f9d30069d00 msgr2=0x7f9d300ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.309+0000 7f9d351ac640 1 -- 172.21.15.55:0/2244983279 shutdown_connections 2023-08-25T04:22:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.309+0000 7f9d351ac640 1 -- 172.21.15.55:0/2244983279 wait complete. 2023-08-25T04:22:06.328 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-25T04:22:06.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:22:06.330 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-25T04:22:06.378 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:06.378+0000 7fd7c3e46180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:22:06.386 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:06.385+0000 7fc16ec38180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:22:06.395 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T04:22:06.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:22:06.396 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-25T04:22:06.406 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:22:06.406 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:22:06.415 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:22:06.415 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:22:06.416 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:22:06.455 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T04:22:06.456 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:22:06.456 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:22:06.465 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:22:06.466 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:22:06.530 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:06.529+0000 7fc16ec38180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:22:06.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.641+0000 7f4ba8182640 1 Processor -- start 2023-08-25T04:22:06.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.645+0000 7f4ba8182640 1 -- start start 2023-08-25T04:22:06.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.645+0000 7f4ba8182640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4ba00cdde0 0x7f4ba00ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:06.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.645+0000 7f4ba8182640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4ba00b2e40 0x7f4ba00b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:06.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.645+0000 7f4ba8182640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba00b29b0 con 0x7f4ba00d0da0 2023-08-25T04:22:06.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.645+0000 7f4ba8182640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba00ce760 con 0x7f4ba00cdde0 2023-08-25T04:22:06.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.645+0000 7f4ba8182640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba00b1dc0 con 0x7f4ba00b2e40 2023-08-25T04:22:06.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.645+0000 7f4ba571d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4ba00cdde0 0x7f4ba00ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:06.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.645+0000 7f4ba5f1e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4ba00d0da0 0x7f4ba00d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41672/0 (socket says 172.21.15.55:41672) 2023-08-25T04:22:06.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.645+0000 7f4ba5f1e640 1 -- 172.21.15.55:0/2222160310 learned_addr learned my addr 172.21.15.55:0/2222160310 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:06.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.645+0000 7f4ba671f640 1 --2- 172.21.15.55:0/2222160310 >> v2:172.21.15.110:3300/0 conn(0x7f4ba00b2e40 0x7f4ba00b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:06.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.645+0000 7f4ba4f1c640 1 -- 172.21.15.55:0/2222160310 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074888463 0 0) 0x7f4ba00b29b0 con 0x7f4ba00d0da0 2023-08-25T04:22:06.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.645+0000 7f4ba4f1c640 1 -- 172.21.15.55:0/2222160310 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b8c003530 con 0x7f4ba00d0da0 2023-08-25T04:22:06.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.645+0000 7f4ba571d640 1 -- 172.21.15.55:0/2222160310 >> v2:172.21.15.110:3300/0 conn(0x7f4ba00b2e40 msgr2=0x7f4ba00b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:06.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.645+0000 7f4ba571d640 1 --2- 172.21.15.55:0/2222160310 >> v2:172.21.15.110:3300/0 conn(0x7f4ba00b2e40 0x7f4ba00b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.645+0000 7f4ba571d640 1 -- 172.21.15.55:0/2222160310 >> v1:172.21.15.55:6789/0 conn(0x7f4ba00d0da0 legacy=0x7f4ba00d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:06.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.645+0000 7f4ba571d640 1 -- 172.21.15.55:0/2222160310 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba00b2080 con 0x7f4ba00cdde0 2023-08-25T04:22:06.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.649+0000 7f4ba571d640 1 --2- 172.21.15.55:0/2222160310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ba00cdde0 0x7f4ba00ce220 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00ceae0 tx=0x7f4b9001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f51058763560d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:06.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.649+0000 7f4ba4f1c640 1 -- 172.21.15.55:0/2222160310 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b900a8950 con 0x7f4ba00cdde0 2023-08-25T04:22:06.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.649+0000 7f4ba4f1c640 1 -- 172.21.15.55:0/2222160310 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b900a8ab0 con 0x7f4ba00cdde0 2023-08-25T04:22:06.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.649+0000 7f4ba4f1c640 1 -- 172.21.15.55:0/2222160310 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b900a8e40 con 0x7f4ba00cdde0 2023-08-25T04:22:06.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.649+0000 7f4ba8182640 1 -- 172.21.15.55:0/2222160310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ba00cdde0 msgr2=0x7f4ba00ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:06.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.649+0000 7f4ba8182640 1 --2- 172.21.15.55:0/2222160310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ba00cdde0 0x7f4ba00ce220 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f4ba00ceae0 tx=0x7f4b9001ec50 comp rx=0 tx=0).stop 2023-08-25T04:22:06.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.649+0000 7f4ba8182640 1 -- 172.21.15.55:0/2222160310 shutdown_connections 2023-08-25T04:22:06.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.649+0000 7f4ba8182640 1 --2- 172.21.15.55:0/2222160310 >> v2:172.21.15.110:3300/0 conn(0x7f4ba00b2e40 0x7f4ba00b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.649+0000 7f4ba8182640 1 --2- 172.21.15.55:0/2222160310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ba00cdde0 0x7f4ba00ce220 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.649+0000 7f4ba8182640 1 -- 172.21.15.55:0/2222160310 >> 172.21.15.55:0/2222160310 conn(0x7f4ba009bae0 msgr2=0x7f4ba00d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:06.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.649+0000 7f4ba8182640 1 -- 172.21.15.55:0/2222160310 shutdown_connections 2023-08-25T04:22:06.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.649+0000 7f4ba8182640 1 -- 172.21.15.55:0/2222160310 wait complete. 2023-08-25T04:22:06.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.649+0000 7f4ba8182640 1 Processor -- start 2023-08-25T04:22:06.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba8182640 1 -- start start 2023-08-25T04:22:06.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba8182640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ba00b2e40 0x7f4ba0151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:06.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba8182640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ba00cdde0 0x7f4ba015d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:06.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba8182640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ba00d0da0 0x7f4ba00cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:06.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba8182640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba0152310 con 0x7f4ba00b2e40 2023-08-25T04:22:06.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba8182640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba015dcb0 con 0x7f4ba00cdde0 2023-08-25T04:22:06.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba8182640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00cc3a0 con 0x7f4ba00d0da0 2023-08-25T04:22:06.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba5f1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ba00b2e40 0x7f4ba0151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:06.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba5f1e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ba00b2e40 0x7f4ba0151dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33834/0 (socket says 172.21.15.55:33834) 2023-08-25T04:22:06.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba5f1e640 1 -- 172.21.15.55:0/1588598787 learned_addr learned my addr 172.21.15.55:0/1588598787 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:06.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba571d640 1 --2- 172.21.15.55:0/1588598787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ba00cdde0 0x7f4ba015d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:06.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba671f640 1 --2- 172.21.15.55:0/1588598787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ba00d0da0 0x7f4ba00cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:06.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba571d640 1 -- 172.21.15.55:0/1588598787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ba00d0da0 msgr2=0x7f4ba00cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:06.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba571d640 1 --2- 172.21.15.55:0/1588598787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ba00d0da0 0x7f4ba00cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba571d640 1 -- 172.21.15.55:0/1588598787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ba00b2e40 msgr2=0x7f4ba0151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:06.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba571d640 1 --2- 172.21.15.55:0/1588598787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ba00b2e40 0x7f4ba0151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba571d640 1 -- 172.21.15.55:0/1588598787 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b90009420 con 0x7f4ba00cdde0 2023-08-25T04:22:06.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba5f1e640 1 --2- 172.21.15.55:0/1588598787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ba00b2e40 0x7f4ba0151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:22:06.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba571d640 1 --2- 172.21.15.55:0/1588598787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ba00cdde0 0x7f4ba015d770 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4ba008cea0 tx=0x7f4b9001b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:06.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4b967fc640 1 -- 172.21.15.55:0/1588598787 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b900b0da0 con 0x7f4ba00cdde0 2023-08-25T04:22:06.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4b967fc640 1 -- 172.21.15.55:0/1588598787 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b900b9430 con 0x7f4ba00cdde0 2023-08-25T04:22:06.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4b967fc640 1 -- 172.21.15.55:0/1588598787 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b900b97e0 con 0x7f4ba00cdde0 2023-08-25T04:22:06.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba8182640 1 -- 172.21.15.55:0/1588598787 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba01f5800 con 0x7f4ba00cdde0 2023-08-25T04:22:06.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba8182640 1 -- 172.21.15.55:0/1588598787 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba01f5dc0 con 0x7f4ba00cdde0 2023-08-25T04:22:06.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.653+0000 7f4ba8182640 1 -- 172.21.15.55:0/1588598787 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba004dbe0 con 0x7f4ba00cdde0 2023-08-25T04:22:06.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.657+0000 7f4b967fc640 1 -- 172.21.15.55:0/1588598787 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 63) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f4b900b7040 con 0x7f4ba00cdde0 2023-08-25T04:22:06.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.657+0000 7f4b967fc640 1 --2- 172.21.15.55:0/1588598787 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f4b840658c0 0x7f4b84067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:06.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.657+0000 7f4b967fc640 1 -- 172.21.15.55:0/1588598787 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f4b90120cd0 con 0x7f4ba00cdde0 2023-08-25T04:22:06.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.657+0000 7f4ba5f1e640 1 -- 172.21.15.55:0/1588598787 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f4b840658c0 msgr2=0x7f4b84067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3764718770 2023-08-25T04:22:06.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.657+0000 7f4ba5f1e640 1 --2- 172.21.15.55:0/1588598787 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f4b840658c0 0x7f4b84067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:22:06.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.661+0000 7f4b967fc640 1 -- 172.21.15.55:0/1588598787 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4b900ee370 con 0x7f4ba00cdde0 2023-08-25T04:22:06.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.853+0000 7f4ba8182640 1 -- 172.21.15.55:0/1588598787 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ba00d0b80 con 0x7f4ba00cdde0 2023-08-25T04:22:06.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.853+0000 7f4b967fc640 1 -- 172.21.15.55:0/1588598787 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f4b900f1990 con 0x7f4ba00cdde0 2023-08-25T04:22:06.853 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:06.853 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2585223071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2585223071},{"type":"v1","addr":"172.21.15.55:6834","nonce":2585223071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52},{"gid":7918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3510911374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3510911374},{"type":"v1","addr":"172.21.15.110:6837","nonce":3510911374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":7921,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1404270940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1404270940},{"type":"v1","addr":"172.21.15.110:6836","nonce":1404270940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:21:22.282732+0000","modified":"2023-08-25T04:21:25.909779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8436":{"gid":8436,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1257898577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1257898577},{"type":"v1","addr":"172.21.15.55:6835","nonce":1257898577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-25T04:22:06.854 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 58 2023-08-25T04:22:06.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.853+0000 7f4ba8182640 1 -- 172.21.15.55:0/1588598787 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f4b840658c0 msgr2=0x7f4b84067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:22:06.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.853+0000 7f4ba8182640 1 --2- 172.21.15.55:0/1588598787 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f4b840658c0 0x7f4b84067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.853+0000 7f4ba8182640 1 -- 172.21.15.55:0/1588598787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ba00cdde0 msgr2=0x7f4ba015d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:06.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.853+0000 7f4ba8182640 1 --2- 172.21.15.55:0/1588598787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ba00cdde0 0x7f4ba015d770 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4ba008cea0 tx=0x7f4b9001b9f0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.853+0000 7f4ba8182640 1 -- 172.21.15.55:0/1588598787 shutdown_connections 2023-08-25T04:22:06.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.853+0000 7f4ba8182640 1 --2- 172.21.15.55:0/1588598787 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f4b840658c0 0x7f4b84067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.853+0000 7f4ba8182640 1 --2- 172.21.15.55:0/1588598787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ba00d0da0 0x7f4ba00cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.853+0000 7f4ba8182640 1 --2- 172.21.15.55:0/1588598787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ba00cdde0 0x7f4ba015d770 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.853+0000 7f4ba8182640 1 --2- 172.21.15.55:0/1588598787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4ba00b2e40 0x7f4ba0151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:06.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.853+0000 7f4ba8182640 1 -- 172.21.15.55:0/1588598787 >> 172.21.15.55:0/1588598787 conn(0x7f4ba009bae0 msgr2=0x7f4ba00af3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:06.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.853+0000 7f4ba8182640 1 -- 172.21.15.55:0/1588598787 shutdown_connections 2023-08-25T04:22:06.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:06.853+0000 7f4ba8182640 1 -- 172.21.15.55:0/1588598787 wait complete. 2023-08-25T04:22:06.875 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:22:06.921 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:06.922+0000 7fd7c3e46180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:22:07.005 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:07.006+0000 7fd7c3e46180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:22:07.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.061+0000 7efd6d3ac640 1 Processor -- start 2023-08-25T04:22:07.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.061+0000 7efd6d3ac640 1 -- start start 2023-08-25T04:22:07.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.065+0000 7efd6d3ac640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efd680d0da0 0x7efd680d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.065+0000 7efd6d3ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd680cdde0 0x7efd680ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.065+0000 7efd6d3ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd680cee60 0x7efd680cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.065+0000 7efd6d3ac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd680ce760 con 0x7efd680cdde0 2023-08-25T04:22:07.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.065+0000 7efd6d3ac640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd680b29b0 con 0x7efd680d0da0 2023-08-25T04:22:07.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.065+0000 7efd6d3ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd680d16c0 con 0x7efd680cee60 2023-08-25T04:22:07.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.065+0000 7efd5ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd680cdde0 0x7efd680ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:07.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.065+0000 7efd5ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd680cdde0 0x7efd680ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33844/0 (socket says 172.21.15.55:33844) 2023-08-25T04:22:07.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.065+0000 7efd5ffff640 1 -- 172.21.15.55:0/3184583 learned_addr learned my addr 172.21.15.55:0/3184583 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:07.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.065+0000 7efd677fe640 1 --2- 172.21.15.55:0/3184583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd680cee60 0x7efd680cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:07.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.065+0000 7efd66ffd640 1 --2- 172.21.15.55:0/3184583 >> v2:172.21.15.110:3300/0 conn(0x7efd680d0da0 0x7efd680d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:07.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.065+0000 7efd5ffff640 1 -- 172.21.15.55:0/3184583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd680cee60 msgr2=0x7efd680cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:07.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.065+0000 7efd5ffff640 1 --2- 172.21.15.55:0/3184583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd680cee60 0x7efd680cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.065+0000 7efd5ffff640 1 -- 172.21.15.55:0/3184583 >> v2:172.21.15.110:3300/0 conn(0x7efd680d0da0 msgr2=0x7efd680d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:07.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.065+0000 7efd5ffff640 1 --2- 172.21.15.55:0/3184583 >> v2:172.21.15.110:3300/0 conn(0x7efd680d0da0 0x7efd680d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.065+0000 7efd5ffff640 1 -- 172.21.15.55:0/3184583 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd680b1dc0 con 0x7efd680cdde0 2023-08-25T04:22:07.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.069+0000 7efd5ffff640 1 --2- 172.21.15.55:0/3184583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd680cdde0 0x7efd680ce220 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7efd68073720 tx=0x7efd5001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72827b77df23133 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:07.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.069+0000 7efd667fc640 1 -- 172.21.15.55:0/3184583 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500a89b0 con 0x7efd680cdde0 2023-08-25T04:22:07.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.069+0000 7efd667fc640 1 -- 172.21.15.55:0/3184583 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd500a8b10 con 0x7efd680cdde0 2023-08-25T04:22:07.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.069+0000 7efd667fc640 1 -- 172.21.15.55:0/3184583 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500a8ea0 con 0x7efd680cdde0 2023-08-25T04:22:07.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.069+0000 7efd6d3ac640 1 -- 172.21.15.55:0/3184583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd680cdde0 msgr2=0x7efd680ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:07.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.069+0000 7efd6d3ac640 1 --2- 172.21.15.55:0/3184583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd680cdde0 0x7efd680ce220 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7efd68073720 tx=0x7efd5001ecf0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.069+0000 7efd6d3ac640 1 -- 172.21.15.55:0/3184583 shutdown_connections 2023-08-25T04:22:07.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.069+0000 7efd6d3ac640 1 --2- 172.21.15.55:0/3184583 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd680cee60 0x7efd680cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.069+0000 7efd6d3ac640 1 --2- 172.21.15.55:0/3184583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd680cdde0 0x7efd680ce220 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.069+0000 7efd6d3ac640 1 --2- 172.21.15.55:0/3184583 >> v2:172.21.15.110:3300/0 conn(0x7efd680d0da0 0x7efd680d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.069+0000 7efd6d3ac640 1 -- 172.21.15.55:0/3184583 >> 172.21.15.55:0/3184583 conn(0x7efd6809bae0 msgr2=0x7efd680d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:07.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.069+0000 7efd6d3ac640 1 -- 172.21.15.55:0/3184583 shutdown_connections 2023-08-25T04:22:07.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.069+0000 7efd6d3ac640 1 -- 172.21.15.55:0/3184583 wait complete. 2023-08-25T04:22:07.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.069+0000 7efd6d3ac640 1 Processor -- start 2023-08-25T04:22:07.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.069+0000 7efd6d3ac640 1 -- start start 2023-08-25T04:22:07.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd6d3ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd680cdde0 0x7efd680b7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd6d3ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd680cee60 0x7efd680cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd6d3ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd680d0da0 0x7efd680cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd6d3ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd680cb400 con 0x7efd680cee60 2023-08-25T04:22:07.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd6d3ac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd680ca780 con 0x7efd680d0da0 2023-08-25T04:22:07.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd6d3ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd680caa60 con 0x7efd680cdde0 2023-08-25T04:22:07.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd5ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd680cee60 0x7efd680cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:07.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd66ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd680cdde0 0x7efd680b7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:07.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd5ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd680cee60 0x7efd680cb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33860/0 (socket says 172.21.15.55:33860) 2023-08-25T04:22:07.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd677fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd680d0da0 0x7efd680cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:07.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd66ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd680cdde0 0x7efd680b7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:58744/0 (socket says 172.21.15.55:58744) 2023-08-25T04:22:07.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd5ffff640 1 -- 172.21.15.55:0/135987101 learned_addr learned my addr 172.21.15.55:0/135987101 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:07.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd5ffff640 1 -- 172.21.15.55:0/135987101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd680cdde0 msgr2=0x7efd680b7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:07.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd5ffff640 1 --2- 172.21.15.55:0/135987101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd680cdde0 0x7efd680b7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd5ffff640 1 -- 172.21.15.55:0/135987101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd680d0da0 msgr2=0x7efd680cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:07.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd5ffff640 1 --2- 172.21.15.55:0/135987101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd680d0da0 0x7efd680cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd5ffff640 1 -- 172.21.15.55:0/135987101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd500094d0 con 0x7efd680cee60 2023-08-25T04:22:07.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd5ffff640 1 --2- 172.21.15.55:0/135987101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd680cee60 0x7efd680cb910 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7efd5001d3a0 tx=0x7efd5001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:07.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd5f7fe640 1 -- 172.21.15.55:0/135987101 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500b0d40 con 0x7efd680cee60 2023-08-25T04:22:07.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd5f7fe640 1 -- 172.21.15.55:0/135987101 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd500bb460 con 0x7efd680cee60 2023-08-25T04:22:07.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd5f7fe640 1 -- 172.21.15.55:0/135987101 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500b0ea0 con 0x7efd680cee60 2023-08-25T04:22:07.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd6d3ac640 1 -- 172.21.15.55:0/135987101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd680cad40 con 0x7efd680cee60 2023-08-25T04:22:07.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd6d3ac640 1 -- 172.21.15.55:0/135987101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd680b81d0 con 0x7efd680cee60 2023-08-25T04:22:07.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd6d3ac640 1 -- 172.21.15.55:0/135987101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6804dbe0 con 0x7efd680cee60 2023-08-25T04:22:07.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.073+0000 7efd5f7fe640 1 -- 172.21.15.55:0/135987101 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 63) v1 ==== 85178+0+0 (secure 0 0 0) 0x7efd500b83f0 con 0x7efd680cee60 2023-08-25T04:22:07.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.077+0000 7efd5f7fe640 1 --2- 172.21.15.55:0/135987101 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7efd480658c0 0x7efd48067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.077+0000 7efd5f7fe640 1 -- 172.21.15.55:0/135987101 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6406+0+0 (secure 0 0 0) 0x7efd50120b00 con 0x7efd680cee60 2023-08-25T04:22:07.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.077+0000 7efd66ffd640 1 -- 172.21.15.55:0/135987101 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7efd480658c0 msgr2=0x7efd48067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3764718770 2023-08-25T04:22:07.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.077+0000 7efd66ffd640 1 --2- 172.21.15.55:0/135987101 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7efd480658c0 0x7efd48067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:22:07.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.081+0000 7efd5f7fe640 1 -- 172.21.15.55:0/135987101 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7efd50122e60 con 0x7efd680cee60 2023-08-25T04:22:07.116 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:07.117+0000 7fc16ec38180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:22:07.154 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:07.154+0000 7fd7c3e46180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:22:07.206 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:07.205+0000 7fc16ec38180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:22:07.237 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:07.238+0000 7fd7c3e46180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:22:07.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.237+0000 7efd6d3ac640 1 -- 172.21.15.55:0/135987101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd680d0b80 con 0x7efd680cee60 2023-08-25T04:22:07.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.241+0000 7efd5f7fe640 1 -- 172.21.15.55:0/135987101 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+18810 (secure 0 0 0) 0x7efd500b5070 con 0x7efd680cee60 2023-08-25T04:22:07.241 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:07.241 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":123,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:21:39.491925+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:21:20.028451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-25T04:21:21.281198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/1881766103":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/2743969486":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/25303232":"2023-08-26T04:21:39.491872+0000","172.21.15.110:6833/4272914017":"2023-08-26T04:21:39.491872+0000","172.21.15.110:6832/4272914017":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/3203059750":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/251061267":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/484834832":"2023-08-26T04:21:39.491872+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:22:07.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.241+0000 7efd6d3ac640 1 -- 172.21.15.55:0/135987101 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7efd480658c0 msgr2=0x7efd48067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:22:07.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.241+0000 7efd6d3ac640 1 --2- 172.21.15.55:0/135987101 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7efd480658c0 0x7efd48067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.241+0000 7efd6d3ac640 1 -- 172.21.15.55:0/135987101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd680cee60 msgr2=0x7efd680cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:07.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.241+0000 7efd6d3ac640 1 --2- 172.21.15.55:0/135987101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd680cee60 0x7efd680cb910 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7efd5001d3a0 tx=0x7efd5001ba90 comp rx=0 tx=0).stop 2023-08-25T04:22:07.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.241+0000 7efd6d3ac640 1 -- 172.21.15.55:0/135987101 shutdown_connections 2023-08-25T04:22:07.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.241+0000 7efd6d3ac640 1 --2- 172.21.15.55:0/135987101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd680d0da0 0x7efd680cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.241+0000 7efd6d3ac640 1 --2- 172.21.15.55:0/135987101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd680cee60 0x7efd680cb910 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.241+0000 7efd6d3ac640 1 --2- 172.21.15.55:0/135987101 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7efd480658c0 0x7efd48067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.241+0000 7efd6d3ac640 1 --2- 172.21.15.55:0/135987101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd680cdde0 0x7efd680b7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.241+0000 7efd6d3ac640 1 -- 172.21.15.55:0/135987101 >> 172.21.15.55:0/135987101 conn(0x7efd6809bae0 msgr2=0x7efd6806bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:07.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.241+0000 7efd6d3ac640 1 -- 172.21.15.55:0/135987101 shutdown_connections 2023-08-25T04:22:07.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.241+0000 7efd6d3ac640 1 -- 172.21.15.55:0/135987101 wait complete. 2023-08-25T04:22:07.264 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:21:20.028451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:21:21.281198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:22:07.264 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:22:07.367 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:07.365+0000 7fc16ec38180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:22:07.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.413+0000 7f51d969e640 1 Processor -- start 2023-08-25T04:22:07.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.413+0000 7f51d969e640 1 -- start start 2023-08-25T04:22:07.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.413+0000 7f51d969e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51d41601f0 0x7f51d415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.413+0000 7f51d969e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51d415e3c0 0x7f51d40d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.413+0000 7f51d969e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f51d40d10c0 0x7f51d40b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.413+0000 7f51d969e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d40cd5a0 con 0x7f51d415e3c0 2023-08-25T04:22:07.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.413+0000 7f51d969e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d40cd880 con 0x7f51d40d10c0 2023-08-25T04:22:07.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.413+0000 7f51d969e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d40cdb60 con 0x7f51d41601f0 2023-08-25T04:22:07.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.413+0000 7f51cbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51d415e3c0 0x7f51d40d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:07.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.413+0000 7f51cbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51d415e3c0 0x7f51d40d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33866/0 (socket says 172.21.15.55:33866) 2023-08-25T04:22:07.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.413+0000 7f51cbfff640 1 -- 172.21.15.55:0/333346951 learned_addr learned my addr 172.21.15.55:0/333346951 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:07.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.413+0000 7f51d2ffd640 1 --2- 172.21.15.55:0/333346951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51d41601f0 0x7f51d415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:07.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.413+0000 7f51d37fe640 1 --2- 172.21.15.55:0/333346951 >> v2:172.21.15.110:3300/0 conn(0x7f51d40d10c0 0x7f51d40b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.413+0000 7f51cbfff640 1 -- 172.21.15.55:0/333346951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51d41601f0 msgr2=0x7f51d415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.413+0000 7f51cbfff640 1 --2- 172.21.15.55:0/333346951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51d41601f0 0x7f51d415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.413+0000 7f51cbfff640 1 -- 172.21.15.55:0/333346951 >> v2:172.21.15.110:3300/0 conn(0x7f51d40d10c0 msgr2=0x7f51d40b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.413+0000 7f51cbfff640 1 --2- 172.21.15.55:0/333346951 >> v2:172.21.15.110:3300/0 conn(0x7f51d40d10c0 0x7f51d40b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.413+0000 7f51cbfff640 1 -- 172.21.15.55:0/333346951 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d40cde40 con 0x7f51d415e3c0 2023-08-25T04:22:07.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.417+0000 7f51cbfff640 1 --2- 172.21.15.55:0/333346951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51d415e3c0 0x7f51d40d0b80 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f51d40d0540 tx=0x7f51bc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b48731e75db468c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:07.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.417+0000 7f51d27fc640 1 -- 172.21.15.55:0/333346951 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc0a89b0 con 0x7f51d415e3c0 2023-08-25T04:22:07.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.417+0000 7f51d27fc640 1 -- 172.21.15.55:0/333346951 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc0a8b10 con 0x7f51d415e3c0 2023-08-25T04:22:07.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.417+0000 7f51d27fc640 1 -- 172.21.15.55:0/333346951 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc0a8ea0 con 0x7f51d415e3c0 2023-08-25T04:22:07.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.417+0000 7f51d969e640 1 -- 172.21.15.55:0/333346951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51d415e3c0 msgr2=0x7f51d40d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:07.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.417+0000 7f51d969e640 1 --2- 172.21.15.55:0/333346951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51d415e3c0 0x7f51d40d0b80 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f51d40d0540 tx=0x7f51bc01ecf0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.417+0000 7f51d969e640 1 -- 172.21.15.55:0/333346951 shutdown_connections 2023-08-25T04:22:07.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.417+0000 7f51d969e640 1 --2- 172.21.15.55:0/333346951 >> v2:172.21.15.110:3300/0 conn(0x7f51d40d10c0 0x7f51d40b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.417+0000 7f51d969e640 1 --2- 172.21.15.55:0/333346951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51d415e3c0 0x7f51d40d0b80 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.417+0000 7f51d969e640 1 --2- 172.21.15.55:0/333346951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51d41601f0 0x7f51d415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.417+0000 7f51d969e640 1 -- 172.21.15.55:0/333346951 >> 172.21.15.55:0/333346951 conn(0x7f51d40d27d0 msgr2=0x7f51d40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:07.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.417+0000 7f51d969e640 1 -- 172.21.15.55:0/333346951 shutdown_connections 2023-08-25T04:22:07.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.417+0000 7f51d969e640 1 -- 172.21.15.55:0/333346951 wait complete. 2023-08-25T04:22:07.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d969e640 1 Processor -- start 2023-08-25T04:22:07.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d969e640 1 -- start start 2023-08-25T04:22:07.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d969e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51d40d10c0 0x7f51d40b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d969e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d415e3c0 0x7f51d4158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d969e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51d41601f0 0x7f51d40cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d969e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d40cc200 con 0x7f51d41601f0 2023-08-25T04:22:07.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d969e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d40c6410 con 0x7f51d415e3c0 2023-08-25T04:22:07.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d969e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d40c66f0 con 0x7f51d40d10c0 2023-08-25T04:22:07.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51d41601f0 0x7f51d40cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:07.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51d41601f0 0x7f51d40cb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33868/0 (socket says 172.21.15.55:33868) 2023-08-25T04:22:07.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d37fe640 1 -- 172.21.15.55:0/1577568214 learned_addr learned my addr 172.21.15.55:0/1577568214 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:07.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d2ffd640 1 --2- 172.21.15.55:0/1577568214 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51d40d10c0 0x7f51d40b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:07.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51cbfff640 1 --2- 172.21.15.55:0/1577568214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d415e3c0 0x7f51d4158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:07.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d37fe640 1 -- 172.21.15.55:0/1577568214 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51d40d10c0 msgr2=0x7f51d40b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:07.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d37fe640 1 --2- 172.21.15.55:0/1577568214 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51d40d10c0 0x7f51d40b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d37fe640 1 -- 172.21.15.55:0/1577568214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d415e3c0 msgr2=0x7f51d4158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:07.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d37fe640 1 --2- 172.21.15.55:0/1577568214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d415e3c0 0x7f51d4158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d37fe640 1 -- 172.21.15.55:0/1577568214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc0094d0 con 0x7f51d41601f0 2023-08-25T04:22:07.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d37fe640 1 --2- 172.21.15.55:0/1577568214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51d41601f0 0x7f51d40cb780 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00eed0 tx=0x7f51cc00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:07.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51cb7fe640 1 -- 172.21.15.55:0/1577568214 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc010040 con 0x7f51d41601f0 2023-08-25T04:22:07.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51cb7fe640 1 -- 172.21.15.55:0/1577568214 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51cc014400 con 0x7f51d41601f0 2023-08-25T04:22:07.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51cb7fe640 1 -- 172.21.15.55:0/1577568214 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc009ea0 con 0x7f51d41601f0 2023-08-25T04:22:07.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d969e640 1 -- 172.21.15.55:0/1577568214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d40ce7c0 con 0x7f51d41601f0 2023-08-25T04:22:07.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.421+0000 7f51d969e640 1 -- 172.21.15.55:0/1577568214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d40c6cb0 con 0x7f51d41601f0 2023-08-25T04:22:07.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.425+0000 7f51d969e640 1 -- 172.21.15.55:0/1577568214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d40b5260 con 0x7f51d41601f0 2023-08-25T04:22:07.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.425+0000 7f51cb7fe640 1 -- 172.21.15.55:0/1577568214 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 63) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f51cc0147b0 con 0x7f51d41601f0 2023-08-25T04:22:07.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.425+0000 7f51cb7fe640 1 --2- 172.21.15.55:0/1577568214 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f51b40658c0 0x7f51b4067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.425+0000 7f51cb7fe640 1 -- 172.21.15.55:0/1577568214 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f51cc083b70 con 0x7f51d41601f0 2023-08-25T04:22:07.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.425+0000 7f51d2ffd640 1 -- 172.21.15.55:0/1577568214 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f51b40658c0 msgr2=0x7f51b4067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3764718770 2023-08-25T04:22:07.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.425+0000 7f51d2ffd640 1 --2- 172.21.15.55:0/1577568214 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f51b40658c0 0x7f51b4067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:22:07.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.429+0000 7f51cb7fe640 1 -- 172.21.15.55:0/1577568214 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f51cc051070 con 0x7f51d41601f0 2023-08-25T04:22:07.459 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:07.457+0000 7fc16ec38180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:22:07.553 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:07.554+0000 7fd7c3e46180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:22:07.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.589+0000 7f51d969e640 1 -- 172.21.15.55:0/1577568214 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51d40c6550 con 0x7f51d41601f0 2023-08-25T04:22:07.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.593+0000 7f51cb7fe640 1 -- 172.21.15.55:0/1577568214 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v123) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51cc018020 con 0x7f51d41601f0 2023-08-25T04:22:07.593 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:22:07.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.593+0000 7f51d969e640 1 -- 172.21.15.55:0/1577568214 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f51b40658c0 msgr2=0x7f51b4067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:22:07.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.593+0000 7f51d969e640 1 --2- 172.21.15.55:0/1577568214 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f51b40658c0 0x7f51b4067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.593+0000 7f51d969e640 1 -- 172.21.15.55:0/1577568214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51d41601f0 msgr2=0x7f51d40cb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:07.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.593+0000 7f51d969e640 1 --2- 172.21.15.55:0/1577568214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51d41601f0 0x7f51d40cb780 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f51cc00eed0 tx=0x7f51cc00b480 comp rx=0 tx=0).stop 2023-08-25T04:22:07.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.593+0000 7f51d969e640 1 -- 172.21.15.55:0/1577568214 shutdown_connections 2023-08-25T04:22:07.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.593+0000 7f51d969e640 1 --2- 172.21.15.55:0/1577568214 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51d41601f0 0x7f51d40cb780 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.593+0000 7f51d969e640 1 --2- 172.21.15.55:0/1577568214 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51d415e3c0 0x7f51d4158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.593+0000 7f51d969e640 1 --2- 172.21.15.55:0/1577568214 >> [v2:172.21.15.110:6832/3764718770,v1:172.21.15.110:6833/3764718770] conn(0x7f51b40658c0 0x7f51b4067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.593+0000 7f51d969e640 1 --2- 172.21.15.55:0/1577568214 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51d40d10c0 0x7f51d40b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.593+0000 7f51d969e640 1 -- 172.21.15.55:0/1577568214 >> 172.21.15.55:0/1577568214 conn(0x7f51d40d27d0 msgr2=0x7f51d40cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:07.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.593+0000 7f51d969e640 1 -- 172.21.15.55:0/1577568214 shutdown_connections 2023-08-25T04:22:07.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.593+0000 7f51d969e640 1 -- 172.21.15.55:0/1577568214 wait complete. 2023-08-25T04:22:07.613 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:22:07.614 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:07.614+0000 7fd7c3e46180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:22:07.692 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:07.690+0000 7fd74ba3e640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:07.692 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:07.690+0000 7fd74ba3e640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:07.693 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:07.690+0000 7fd74ba3e640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:07.693 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:07.690+0000 7fd74ba3e640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:07.693 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:07.690+0000 7fd74ba3e640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:07.694 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:07.690+0000 7fd74fa46640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:07.694 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:07.690+0000 7fd74fa46640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:07.694 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:07.690+0000 7fd74fa46640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:07.695 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:07.690+0000 7fd74fa46640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:07.695 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:07.690+0000 7fd74fa46640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:07.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.777+0000 7faedacd8640 1 Processor -- start 2023-08-25T04:22:07.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.777+0000 7faedacd8640 1 -- start start 2023-08-25T04:22:07.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.781+0000 7faedacd8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faed41601f0 0x7faed415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.781+0000 7faedacd8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faed415e3c0 0x7faed40d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.781+0000 7faedacd8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed415f8b0 con 0x7faed40d10c0 2023-08-25T04:22:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.781+0000 7faedacd8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed40cd5a0 con 0x7faed415e3c0 2023-08-25T04:22:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.781+0000 7faedacd8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed40cd880 con 0x7faed41601f0 2023-08-25T04:22:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.781+0000 7faed3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faed415e3c0 0x7faed40d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:07.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.781+0000 7faed3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faed415e3c0 0x7faed40d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33870/0 (socket says 172.21.15.55:33870) 2023-08-25T04:22:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.781+0000 7faed3fff640 1 -- 172.21.15.55:0/3381170331 learned_addr learned my addr 172.21.15.55:0/3381170331 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.781+0000 7faed8a74640 1 --2- 172.21.15.55:0/3381170331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faed41601f0 0x7faed415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:07.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.781+0000 7faed3fff640 1 -- 172.21.15.55:0/3381170331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faed41601f0 msgr2=0x7faed415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:07.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.781+0000 7faed3fff640 1 --2- 172.21.15.55:0/3381170331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faed41601f0 0x7faed415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.781+0000 7faed3fff640 1 -- 172.21.15.55:0/3381170331 >> v1:172.21.15.110:6789/0 conn(0x7faed40d10c0 legacy=0x7faed40b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:07.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.781+0000 7faed3fff640 1 -- 172.21.15.55:0/3381170331 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed40cdb60 con 0x7faed415e3c0 2023-08-25T04:22:07.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.781+0000 7faed3fff640 1 --2- 172.21.15.55:0/3381170331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed415e3c0 0x7faed40d0b80 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7faec0009870 tx=0x7faec001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bebd3179f315fc4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:07.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.781+0000 7faed37fe640 1 -- 172.21.15.55:0/3381170331 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec00a8a30 con 0x7faed415e3c0 2023-08-25T04:22:07.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.785+0000 7faed37fe640 1 -- 172.21.15.55:0/3381170331 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec00a8b90 con 0x7faed415e3c0 2023-08-25T04:22:07.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.785+0000 7faed37fe640 1 -- 172.21.15.55:0/3381170331 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec00b0440 con 0x7faed415e3c0 2023-08-25T04:22:07.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.785+0000 7faedacd8640 1 -- 172.21.15.55:0/3381170331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed415e3c0 msgr2=0x7faed40d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:07.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.785+0000 7faedacd8640 1 --2- 172.21.15.55:0/3381170331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed415e3c0 0x7faed40d0b80 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7faec0009870 tx=0x7faec001ed30 comp rx=0 tx=0).stop 2023-08-25T04:22:07.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.785+0000 7faedacd8640 1 -- 172.21.15.55:0/3381170331 shutdown_connections 2023-08-25T04:22:07.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.785+0000 7faedacd8640 1 --2- 172.21.15.55:0/3381170331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed415e3c0 0x7faed40d0b80 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.785+0000 7faedacd8640 1 --2- 172.21.15.55:0/3381170331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faed41601f0 0x7faed415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.785+0000 7faedacd8640 1 -- 172.21.15.55:0/3381170331 >> 172.21.15.55:0/3381170331 conn(0x7faed40d27d0 msgr2=0x7faed40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:07.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.785+0000 7faedacd8640 1 -- 172.21.15.55:0/3381170331 shutdown_connections 2023-08-25T04:22:07.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.785+0000 7faedacd8640 1 -- 172.21.15.55:0/3381170331 wait complete. 2023-08-25T04:22:07.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.785+0000 7faedacd8640 1 Processor -- start 2023-08-25T04:22:07.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.785+0000 7faedacd8640 1 -- start start 2023-08-25T04:22:07.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.785+0000 7faedacd8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faed40d10c0 0x7faed41f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.785+0000 7faedacd8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faed415e3c0 0x7faed415cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faedacd8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed41601f0 0x7faed40c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:07.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faedacd8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed40c8c60 con 0x7faed41601f0 2023-08-25T04:22:07.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faedacd8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed40c8f40 con 0x7faed40d10c0 2023-08-25T04:22:07.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faedacd8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed41f2600 con 0x7faed415e3c0 2023-08-25T04:22:07.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faed9275640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed41601f0 0x7faed40c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:07.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faed8a74640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faed40d10c0 0x7faed41f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:07.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faed8a74640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faed40d10c0 0x7faed41f2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:41456/0 (socket says 172.21.15.55:41456) 2023-08-25T04:22:07.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faed8a74640 1 -- 172.21.15.55:0/3731229486 learned_addr learned my addr 172.21.15.55:0/3731229486 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:07.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faed3fff640 1 --2- 172.21.15.55:0/3731229486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faed415e3c0 0x7faed415cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:07.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faed8a74640 1 -- 172.21.15.55:0/3731229486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faed415e3c0 msgr2=0x7faed415cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:07.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faed8a74640 1 --2- 172.21.15.55:0/3731229486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faed415e3c0 0x7faed415cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faed8a74640 1 -- 172.21.15.55:0/3731229486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed41601f0 msgr2=0x7faed40c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:07.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faed8a74640 1 --2- 172.21.15.55:0/3731229486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed41601f0 0x7faed40c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faed8a74640 1 -- 172.21.15.55:0/3731229486 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec00094d0 con 0x7faed40d10c0 2023-08-25T04:22:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faed8a74640 1 --2- 172.21.15.55:0/3731229486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faed40d10c0 0x7faed41f2e00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7faec800e870 tx=0x7faec800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faed17fa640 1 -- 172.21.15.55:0/3731229486 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec80095d0 con 0x7faed40d10c0 2023-08-25T04:22:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faed17fa640 1 -- 172.21.15.55:0/3731229486 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec800c940 con 0x7faed40d10c0 2023-08-25T04:22:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faed17fa640 1 -- 172.21.15.55:0/3731229486 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec800ccb0 con 0x7faed40d10c0 2023-08-25T04:22:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faedacd8640 1 -- 172.21.15.55:0/3731229486 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed41f28e0 con 0x7faed40d10c0 2023-08-25T04:22:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faedacd8640 1 -- 172.21.15.55:0/3731229486 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed41f22e0 con 0x7faed40d10c0 2023-08-25T04:22:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faedacd8640 1 -- 172.21.15.55:0/3731229486 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed40b5260 con 0x7faed40d10c0 2023-08-25T04:22:07.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.789+0000 7faed17fa640 1 -- 172.21.15.55:0/3731229486 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 64) v1 ==== 84673+0+0 (secure 0 0 0) 0x7faec8013470 con 0x7faed40d10c0 2023-08-25T04:22:07.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.793+0000 7faed17fa640 1 -- 172.21.15.55:0/3731229486 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6892+0+0 (secure 0 0 0) 0x7faec8083050 con 0x7faed40d10c0 2023-08-25T04:22:07.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.797+0000 7faed17fa640 1 -- 172.21.15.55:0/3731229486 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7faec8050d90 con 0x7faed40d10c0 2023-08-25T04:22:07.825 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:07.825+0000 7fc16ec38180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:22:07.889 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:07.889+0000 7fc16ec38180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:22:07.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.957+0000 7faedacd8640 1 -- 172.21.15.55:0/3731229486 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faed40c9080 con 0x7faed40d10c0 2023-08-25T04:22:07.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.957+0000 7faed17fa640 1 -- 172.21.15.55:0/3731229486 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v124) v1 ==== 92+0+10 (secure 0 0 0) 0x7faed40c9080 con 0x7faed40d10c0 2023-08-25T04:22:07.957 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:22:07.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.957+0000 7faedacd8640 1 -- 172.21.15.55:0/3731229486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faed40d10c0 msgr2=0x7faed41f2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:07.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.957+0000 7faedacd8640 1 --2- 172.21.15.55:0/3731229486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faed40d10c0 0x7faed41f2e00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7faec800e870 tx=0x7faec800ed30 comp rx=0 tx=0).stop 2023-08-25T04:22:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.957+0000 7faedacd8640 1 -- 172.21.15.55:0/3731229486 shutdown_connections 2023-08-25T04:22:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.957+0000 7faedacd8640 1 --2- 172.21.15.55:0/3731229486 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faed41601f0 0x7faed40c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.957+0000 7faedacd8640 1 --2- 172.21.15.55:0/3731229486 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faed415e3c0 0x7faed415cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.957+0000 7faedacd8640 1 --2- 172.21.15.55:0/3731229486 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faed40d10c0 0x7faed41f2e00 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.957+0000 7faedacd8640 1 -- 172.21.15.55:0/3731229486 >> 172.21.15.55:0/3731229486 conn(0x7faed40d27d0 msgr2=0x7faed406b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:07.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.957+0000 7faedacd8640 1 -- 172.21.15.55:0/3731229486 shutdown_connections 2023-08-25T04:22:07.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:07.957+0000 7faedacd8640 1 -- 172.21.15.55:0/3731229486 wait complete. 2023-08-25T04:22:07.977 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T04:22:08.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.125+0000 7fbdfcc6d640 1 Processor -- start 2023-08-25T04:22:08.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.125+0000 7fbdfcc6d640 1 -- start start 2023-08-25T04:22:08.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.125+0000 7fbdfcc6d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbdf815a7f0 0x7fbdf809bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:08.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.125+0000 7fbdfcc6d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf815abd0 con 0x7fbdf806c020 2023-08-25T04:22:08.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.125+0000 7fbdfcc6d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf80c8ab0 con 0x7fbdf80c9830 2023-08-25T04:22:08.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.125+0000 7fbdfcc6d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf80c8d50 con 0x7fbdf815a7f0 2023-08-25T04:22:08.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.125+0000 7fbdf6d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbdf806c020 0x7fbdf80acff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41686/0 (socket says 172.21.15.55:41686) 2023-08-25T04:22:08.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.125+0000 7fbdf6d9d640 1 -- 172.21.15.55:0/3539795252 learned_addr learned my addr 172.21.15.55:0/3539795252 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:08.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.125+0000 7fbdf659c640 1 --2- 172.21.15.55:0/3539795252 >> v2:172.21.15.110:3300/0 conn(0x7fbdf815a7f0 0x7fbdf809bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.125+0000 7fbdf5d9b640 1 -- 172.21.15.55:0/3539795252 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46303349 0 0) 0x7fbdf815abd0 con 0x7fbdf806c020 2023-08-25T04:22:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.125+0000 7fbdf5d9b640 1 -- 172.21.15.55:0/3539795252 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbde4003530 con 0x7fbdf806c020 2023-08-25T04:22:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.125+0000 7fbdf659c640 1 -- 172.21.15.55:0/3539795252 >> v1:172.21.15.110:6789/0 conn(0x7fbdf80c9830 legacy=0x7fbdf8070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:08.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.125+0000 7fbdf659c640 1 -- 172.21.15.55:0/3539795252 >> v1:172.21.15.55:6789/0 conn(0x7fbdf806c020 legacy=0x7fbdf80acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:08.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.125+0000 7fbdf659c640 1 -- 172.21.15.55:0/3539795252 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf80c9030 con 0x7fbdf815a7f0 2023-08-25T04:22:08.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.129+0000 7fbdf659c640 1 --2- 172.21.15.55:0/3539795252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf815a7f0 0x7fbdf809bde0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fbde80097a0 tx=0x7fbde801c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d45d79a53861a7e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:08.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.129+0000 7fbdf5d9b640 1 -- 172.21.15.55:0/3539795252 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde80ab600 con 0x7fbdf815a7f0 2023-08-25T04:22:08.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.129+0000 7fbdf5d9b640 1 -- 172.21.15.55:0/3539795252 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde80a7050 con 0x7fbdf815a7f0 2023-08-25T04:22:08.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.129+0000 7fbdf5d9b640 1 -- 172.21.15.55:0/3539795252 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde80ab980 con 0x7fbdf815a7f0 2023-08-25T04:22:08.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.129+0000 7fbdfcc6d640 1 -- 172.21.15.55:0/3539795252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf815a7f0 msgr2=0x7fbdf809bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:08.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.129+0000 7fbdfcc6d640 1 --2- 172.21.15.55:0/3539795252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf815a7f0 0x7fbdf809bde0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fbde80097a0 tx=0x7fbde801c430 comp rx=0 tx=0).stop 2023-08-25T04:22:08.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.129+0000 7fbdfcc6d640 1 -- 172.21.15.55:0/3539795252 shutdown_connections 2023-08-25T04:22:08.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.129+0000 7fbdfcc6d640 1 --2- 172.21.15.55:0/3539795252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf815a7f0 0x7fbdf809bde0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.129+0000 7fbdfcc6d640 1 -- 172.21.15.55:0/3539795252 >> 172.21.15.55:0/3539795252 conn(0x7fbdf8069900 msgr2=0x7fbdf8069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:08.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.129+0000 7fbdfcc6d640 1 -- 172.21.15.55:0/3539795252 shutdown_connections 2023-08-25T04:22:08.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.129+0000 7fbdfcc6d640 1 -- 172.21.15.55:0/3539795252 wait complete. 2023-08-25T04:22:08.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdfcc6d640 1 Processor -- start 2023-08-25T04:22:08.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdfcc6d640 1 -- start start 2023-08-25T04:22:08.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdfcc6d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf806c020 0x7fbdf8153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:08.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdfcc6d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf80c9830 0x7fbdf80c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:08.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdfcc6d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf815a7f0 0x7fbdf80b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:08.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdfcc6d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8153d60 con 0x7fbdf815a7f0 2023-08-25T04:22:08.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdfcc6d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8154040 con 0x7fbdf80c9830 2023-08-25T04:22:08.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdfcc6d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8154320 con 0x7fbdf806c020 2023-08-25T04:22:08.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdf6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf815a7f0 0x7fbdf80b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:08.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdf6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf815a7f0 0x7fbdf80b22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33890/0 (socket says 172.21.15.55:33890) 2023-08-25T04:22:08.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdf6d9d640 1 -- 172.21.15.55:0/1246078022 learned_addr learned my addr 172.21.15.55:0/1246078022 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:08.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdf659c640 1 --2- 172.21.15.55:0/1246078022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf806c020 0x7fbdf8153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:08.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdeffff640 1 --2- 172.21.15.55:0/1246078022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf80c9830 0x7fbdf80c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:08.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdf6d9d640 1 -- 172.21.15.55:0/1246078022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf806c020 msgr2=0x7fbdf8153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:08.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdf6d9d640 1 --2- 172.21.15.55:0/1246078022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf806c020 0x7fbdf8153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdf6d9d640 1 -- 172.21.15.55:0/1246078022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf80c9830 msgr2=0x7fbdf80c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:08.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdf6d9d640 1 --2- 172.21.15.55:0/1246078022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf80c9830 0x7fbdf80c2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdf6d9d640 1 -- 172.21.15.55:0/1246078022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde80093b0 con 0x7fbdf815a7f0 2023-08-25T04:22:08.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdf659c640 1 --2- 172.21.15.55:0/1246078022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf806c020 0x7fbdf8153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:22:08.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdeffff640 1 --2- 172.21.15.55:0/1246078022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf80c9830 0x7fbdf80c2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:22:08.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdf6d9d640 1 --2- 172.21.15.55:0/1246078022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf815a7f0 0x7fbdf80b22b0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000caa0 tx=0x7fbdf000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:08.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdeeffd640 1 -- 172.21.15.55:0/1246078022 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf000aba0 con 0x7fbdf815a7f0 2023-08-25T04:22:08.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdeeffd640 1 -- 172.21.15.55:0/1246078022 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf000ad00 con 0x7fbdf815a7f0 2023-08-25T04:22:08.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdeeffd640 1 -- 172.21.15.55:0/1246078022 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0012640 con 0x7fbdf815a7f0 2023-08-25T04:22:08.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdfcc6d640 1 -- 172.21.15.55:0/1246078022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf80adc90 con 0x7fbdf815a7f0 2023-08-25T04:22:08.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdfcc6d640 1 -- 172.21.15.55:0/1246078022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf81548e0 con 0x7fbdf815a7f0 2023-08-25T04:22:08.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.133+0000 7fbdfcc6d640 1 -- 172.21.15.55:0/1246078022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf806d5b0 con 0x7fbdf815a7f0 2023-08-25T04:22:08.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.137+0000 7fbdeeffd640 1 -- 172.21.15.55:0/1246078022 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 64) v1 ==== 84673+0+0 (secure 0 0 0) 0x7fbdf0007070 con 0x7fbdf815a7f0 2023-08-25T04:22:08.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.137+0000 7fbdeeffd640 1 -- 172.21.15.55:0/1246078022 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6892+0+0 (secure 0 0 0) 0x7fbdf0082b60 con 0x7fbdf815a7f0 2023-08-25T04:22:08.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.141+0000 7fbdeeffd640 1 -- 172.21.15.55:0/1246078022 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbdf00506f0 con 0x7fbdf815a7f0 2023-08-25T04:22:08.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.297+0000 7fbdfcc6d640 1 -- 172.21.15.55:0/1246078022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbdf8154ad0 con 0x7fbdf815a7f0 2023-08-25T04:22:08.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.297+0000 7fbdeeffd640 1 -- 172.21.15.55:0/1246078022 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v124) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbdf0017020 con 0x7fbdf815a7f0 2023-08-25T04:22:08.298 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T04:22:08.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.301+0000 7fbdfcc6d640 1 -- 172.21.15.55:0/1246078022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf815a7f0 msgr2=0x7fbdf80b22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:08.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.301+0000 7fbdfcc6d640 1 --2- 172.21.15.55:0/1246078022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf815a7f0 0x7fbdf80b22b0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000caa0 tx=0x7fbdf000cf60 comp rx=0 tx=0).stop 2023-08-25T04:22:08.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.301+0000 7fbdfcc6d640 1 -- 172.21.15.55:0/1246078022 shutdown_connections 2023-08-25T04:22:08.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.301+0000 7fbdfcc6d640 1 --2- 172.21.15.55:0/1246078022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf815a7f0 0x7fbdf80b22b0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.301+0000 7fbdfcc6d640 1 --2- 172.21.15.55:0/1246078022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf80c9830 0x7fbdf80c2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.301+0000 7fbdfcc6d640 1 --2- 172.21.15.55:0/1246078022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf806c020 0x7fbdf8153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.301+0000 7fbdfcc6d640 1 -- 172.21.15.55:0/1246078022 >> 172.21.15.55:0/1246078022 conn(0x7fbdf8069900 msgr2=0x7fbdf8152d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:08.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.301+0000 7fbdfcc6d640 1 -- 172.21.15.55:0/1246078022 shutdown_connections 2023-08-25T04:22:08.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.301+0000 7fbdfcc6d640 1 -- 172.21.15.55:0/1246078022 wait complete. 2023-08-25T04:22:08.319 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T04:22:08.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.465+0000 7f68ff120640 1 Processor -- start 2023-08-25T04:22:08.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.465+0000 7f68ff120640 1 -- start start 2023-08-25T04:22:08.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.469+0000 7f68ff120640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f68f815fca0 0x7f68f80cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:08.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.469+0000 7f68ff120640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68f80cfac0 0x7f68f80b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:08.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.469+0000 7f68ff120640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f80cfee0 con 0x7f68f80b8330 2023-08-25T04:22:08.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.469+0000 7f68ff120640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f8160080 con 0x7f68f80cfac0 2023-08-25T04:22:08.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.469+0000 7f68ff120640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f80b70c0 con 0x7f68f815fca0 2023-08-25T04:22:08.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.469+0000 7f68fe91f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68f80cfac0 0x7f68f80b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:08.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.469+0000 7f68fe91f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68f80cfac0 0x7f68f80b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33896/0 (socket says 172.21.15.55:33896) 2023-08-25T04:22:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.469+0000 7f68fe91f640 1 -- 172.21.15.55:0/3231115968 learned_addr learned my addr 172.21.15.55:0/3231115968 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.469+0000 7f68fe11e640 1 --2- 172.21.15.55:0/3231115968 >> v2:172.21.15.110:3300/0 conn(0x7f68f815fca0 0x7f68f80cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.469+0000 7f68fe91f640 1 -- 172.21.15.55:0/3231115968 >> v2:172.21.15.110:3300/0 conn(0x7f68f815fca0 msgr2=0x7f68f80cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:08.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.469+0000 7f68fe91f640 1 --2- 172.21.15.55:0/3231115968 >> v2:172.21.15.110:3300/0 conn(0x7f68f815fca0 0x7f68f80cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.469+0000 7f68fe91f640 1 -- 172.21.15.55:0/3231115968 >> v1:172.21.15.110:6789/0 conn(0x7f68f80b8330 legacy=0x7f68f80d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:08.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.469+0000 7f68fe91f640 1 -- 172.21.15.55:0/3231115968 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f80b73a0 con 0x7f68f80cfac0 2023-08-25T04:22:08.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68fe91f640 1 --2- 172.21.15.55:0/3231115968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f80cfac0 0x7f68f80b65e0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f68f80b4af0 tx=0x7f68f001f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff4769f158feb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:08.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68fd11c640 1 -- 172.21.15.55:0/3231115968 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f00af400 con 0x7f68f80cfac0 2023-08-25T04:22:08.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68fd11c640 1 -- 172.21.15.55:0/3231115968 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f00ab050 con 0x7f68f80cfac0 2023-08-25T04:22:08.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68fd11c640 1 -- 172.21.15.55:0/3231115968 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f00af780 con 0x7f68f80cfac0 2023-08-25T04:22:08.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68ff120640 1 -- 172.21.15.55:0/3231115968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f80cfac0 msgr2=0x7f68f80b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:08.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68ff120640 1 --2- 172.21.15.55:0/3231115968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f80cfac0 0x7f68f80b65e0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f68f80b4af0 tx=0x7f68f001f180 comp rx=0 tx=0).stop 2023-08-25T04:22:08.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68ff120640 1 -- 172.21.15.55:0/3231115968 shutdown_connections 2023-08-25T04:22:08.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68ff120640 1 --2- 172.21.15.55:0/3231115968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f80cfac0 0x7f68f80b65e0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68ff120640 1 --2- 172.21.15.55:0/3231115968 >> v2:172.21.15.110:3300/0 conn(0x7f68f815fca0 0x7f68f80cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68ff120640 1 -- 172.21.15.55:0/3231115968 >> 172.21.15.55:0/3231115968 conn(0x7f68f80658c0 msgr2=0x7f68f8065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:08.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68ff120640 1 -- 172.21.15.55:0/3231115968 shutdown_connections 2023-08-25T04:22:08.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68ff120640 1 -- 172.21.15.55:0/3231115968 wait complete. 2023-08-25T04:22:08.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68ff120640 1 Processor -- start 2023-08-25T04:22:08.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68ff120640 1 -- start start 2023-08-25T04:22:08.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68ff120640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68f80b8330 0x7f68f80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68ff120640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f80cfac0 0x7f68f8155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68ff120640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f815fca0 0x7f68f8152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68ff120640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f81f21a0 con 0x7f68f80cfac0 2023-08-25T04:22:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68ff120640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8157b90 con 0x7f68f815fca0 2023-08-25T04:22:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68ff120640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8157e70 con 0x7f68f80b8330 2023-08-25T04:22:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.473+0000 7f68fd91d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f80cfac0 0x7f68f8155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.477+0000 7f68fd91d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f80cfac0 0x7f68f8155730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33908/0 (socket says 172.21.15.55:33908) 2023-08-25T04:22:08.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.477+0000 7f68fd91d640 1 -- 172.21.15.55:0/3685246953 learned_addr learned my addr 172.21.15.55:0/3685246953 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:08.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.477+0000 7f68fe91f640 1 --2- 172.21.15.55:0/3685246953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f815fca0 0x7f68f8152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:08.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.477+0000 7f68fe11e640 1 --2- 172.21.15.55:0/3685246953 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68f80b8330 0x7f68f80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.477+0000 7f68fd91d640 1 -- 172.21.15.55:0/3685246953 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68f80b8330 msgr2=0x7f68f80b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.477+0000 7f68fd91d640 1 --2- 172.21.15.55:0/3685246953 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68f80b8330 0x7f68f80b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.477+0000 7f68fd91d640 1 -- 172.21.15.55:0/3685246953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f815fca0 msgr2=0x7f68f8152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.477+0000 7f68fd91d640 1 --2- 172.21.15.55:0/3685246953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f815fca0 0x7f68f8152180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.477+0000 7f68fd91d640 1 -- 172.21.15.55:0/3685246953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f0009b30 con 0x7f68f80cfac0 2023-08-25T04:22:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.477+0000 7f68fd91d640 1 --2- 172.21.15.55:0/3685246953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f80cfac0 0x7f68f8155730 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f68e800c410 tx=0x7f68e800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.477+0000 7f68eeffd640 1 -- 172.21.15.55:0/3685246953 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8011790 con 0x7f68f80cfac0 2023-08-25T04:22:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.477+0000 7f68eeffd640 1 -- 172.21.15.55:0/3685246953 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68e80118f0 con 0x7f68f80cfac0 2023-08-25T04:22:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.477+0000 7f68ff120640 1 -- 172.21.15.55:0/3685246953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f8158150 con 0x7f68f80cfac0 2023-08-25T04:22:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.477+0000 7f68eeffd640 1 -- 172.21.15.55:0/3685246953 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8011ca0 con 0x7f68f80cfac0 2023-08-25T04:22:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.477+0000 7f68ff120640 1 -- 172.21.15.55:0/3685246953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f81577b0 con 0x7f68f80cfac0 2023-08-25T04:22:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.477+0000 7f68ff120640 1 -- 172.21.15.55:0/3685246953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f8073e50 con 0x7f68f80cfac0 2023-08-25T04:22:08.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.477+0000 7f68eeffd640 1 -- 172.21.15.55:0/3685246953 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 64) v1 ==== 84673+0+0 (secure 0 0 0) 0x7f68e801c460 con 0x7f68f80cfac0 2023-08-25T04:22:08.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.481+0000 7f68eeffd640 1 -- 172.21.15.55:0/3685246953 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6892+0+0 (secure 0 0 0) 0x7f68e80827a0 con 0x7f68f80cfac0 2023-08-25T04:22:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.485+0000 7f68eeffd640 1 -- 172.21.15.55:0/3685246953 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f68e8050420 con 0x7f68f80cfac0 2023-08-25T04:22:08.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.625+0000 7f68eeffd640 1 -- 172.21.15.55:0/3685246953 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 65) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f68e804fed0 con 0x7f68f80cfac0 2023-08-25T04:22:08.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.629+0000 7f68eeffd640 1 --2- 172.21.15.55:0/3685246953 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f68dc06b5a0 0x7f68dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:08.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.629+0000 7f68fe11e640 1 --2- 172.21.15.55:0/3685246953 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f68dc06b5a0 0x7f68dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:08.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.629+0000 7f68fe11e640 1 --2- 172.21.15.55:0/3685246953 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f68dc06b5a0 0x7f68dc06d990 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f68f8155480 tx=0x7f68f4008040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:08.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.645+0000 7f68ff120640 1 -- 172.21.15.55:0/3685246953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f68f81588e0 con 0x7f68f80cfac0 2023-08-25T04:22:08.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.645+0000 7f68eeffd640 1 -- 172.21.15.55:0/3685246953 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v124) v1 ==== 100+0+11 (secure 0 0 0) 0x7f68e806b3c0 con 0x7f68f80cfac0 2023-08-25T04:22:08.646 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T04:22:08.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.645+0000 7f68ff120640 1 -- 172.21.15.55:0/3685246953 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f68dc06b5a0 msgr2=0x7f68dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:08.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.645+0000 7f68ff120640 1 --2- 172.21.15.55:0/3685246953 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f68dc06b5a0 0x7f68dc06d990 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f68f8155480 tx=0x7f68f4008040 comp rx=0 tx=0).stop 2023-08-25T04:22:08.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.645+0000 7f68ff120640 1 -- 172.21.15.55:0/3685246953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f80cfac0 msgr2=0x7f68f8155730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:08.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.645+0000 7f68ff120640 1 --2- 172.21.15.55:0/3685246953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f80cfac0 0x7f68f8155730 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f68e800c410 tx=0x7f68e800c8d0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.645+0000 7f68ff120640 1 -- 172.21.15.55:0/3685246953 shutdown_connections 2023-08-25T04:22:08.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.645+0000 7f68ff120640 1 --2- 172.21.15.55:0/3685246953 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f815fca0 0x7f68f8152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.645+0000 7f68ff120640 1 --2- 172.21.15.55:0/3685246953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f80cfac0 0x7f68f8155730 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.645+0000 7f68ff120640 1 --2- 172.21.15.55:0/3685246953 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f68dc06b5a0 0x7f68dc06d990 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.645+0000 7f68ff120640 1 --2- 172.21.15.55:0/3685246953 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68f80b8330 0x7f68f80b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.645+0000 7f68ff120640 1 -- 172.21.15.55:0/3685246953 >> 172.21.15.55:0/3685246953 conn(0x7f68f80658c0 msgr2=0x7f68f815bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:08.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.649+0000 7f68ff120640 1 -- 172.21.15.55:0/3685246953 shutdown_connections 2023-08-25T04:22:08.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.649+0000 7f68ff120640 1 -- 172.21.15.55:0/3685246953 wait complete. 2023-08-25T04:22:08.666 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:22:08.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.809+0000 7fb93c0cb640 1 Processor -- start 2023-08-25T04:22:08.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.809+0000 7fb93c0cb640 1 -- start start 2023-08-25T04:22:08.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.809+0000 7fb93c0cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9340cabf0 0x7fb9340ca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:08.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.809+0000 7fb93c0cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93406d2b0 con 0x7fb9340b1220 2023-08-25T04:22:08.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.809+0000 7fb93c0cb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9340c9490 con 0x7fb9340cde20 2023-08-25T04:22:08.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.809+0000 7fb93c0cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9340cb1e0 con 0x7fb9340cabf0 2023-08-25T04:22:08.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.813+0000 7fb93a668640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9340cabf0 0x7fb9340ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:08.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.813+0000 7fb939e67640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fb9340cde20 0x7fb9340ce200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:33740/0 (socket says 172.21.15.55:33740) 2023-08-25T04:22:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.813+0000 7fb939e67640 1 -- 172.21.15.55:0/2340221078 learned_addr learned my addr 172.21.15.55:0/2340221078 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.813+0000 7fb93a668640 1 -- 172.21.15.55:0/2340221078 >> v1:172.21.15.110:6789/0 conn(0x7fb9340cde20 legacy=0x7fb9340ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.813+0000 7fb93a668640 1 -- 172.21.15.55:0/2340221078 >> v1:172.21.15.55:6789/0 conn(0x7fb9340b1220 legacy=0x7fb9340c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.813+0000 7fb93a668640 1 -- 172.21.15.55:0/2340221078 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9340cb480 con 0x7fb9340cabf0 2023-08-25T04:22:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.813+0000 7fb93a668640 1 --2- 172.21.15.55:0/2340221078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9340cabf0 0x7fb9340ca030 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009dc0 tx=0x7fb92c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0312200f29dcdbe server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.813+0000 7fb938e65640 1 -- 172.21.15.55:0/2340221078 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c0a5960 con 0x7fb9340cabf0 2023-08-25T04:22:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.813+0000 7fb938e65640 1 -- 172.21.15.55:0/2340221078 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c0a5ac0 con 0x7fb9340cabf0 2023-08-25T04:22:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.813+0000 7fb938e65640 1 -- 172.21.15.55:0/2340221078 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c0a5e50 con 0x7fb9340cabf0 2023-08-25T04:22:08.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb93c0cb640 1 -- 172.21.15.55:0/2340221078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9340cabf0 msgr2=0x7fb9340ca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:08.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb93c0cb640 1 --2- 172.21.15.55:0/2340221078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9340cabf0 0x7fb9340ca030 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009dc0 tx=0x7fb92c01c8a0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb93c0cb640 1 -- 172.21.15.55:0/2340221078 shutdown_connections 2023-08-25T04:22:08.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb93c0cb640 1 --2- 172.21.15.55:0/2340221078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9340cabf0 0x7fb9340ca030 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb93c0cb640 1 -- 172.21.15.55:0/2340221078 >> 172.21.15.55:0/2340221078 conn(0x7fb9340b0700 msgr2=0x7fb9340b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:08.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb93c0cb640 1 -- 172.21.15.55:0/2340221078 shutdown_connections 2023-08-25T04:22:08.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb93c0cb640 1 -- 172.21.15.55:0/2340221078 wait complete. 2023-08-25T04:22:08.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb93c0cb640 1 Processor -- start 2023-08-25T04:22:08.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb93c0cb640 1 -- start start 2023-08-25T04:22:08.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb93c0cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9340b1220 0x7fb93409d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:08.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb93c0cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9340cabf0 0x7fb93409ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:08.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb93c0cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9340cde20 0x7fb9340aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:08.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb93c0cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93409d350 con 0x7fb9340b1220 2023-08-25T04:22:08.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb93c0cb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9341525d0 con 0x7fb9340cde20 2023-08-25T04:22:08.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb93c0cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9340c7680 con 0x7fb9340cabf0 2023-08-25T04:22:08.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb939e67640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9340b1220 0x7fb93409d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:08.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb939e67640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9340b1220 0x7fb93409d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33926/0 (socket says 172.21.15.55:33926) 2023-08-25T04:22:08.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb939e67640 1 -- 172.21.15.55:0/3864072496 learned_addr learned my addr 172.21.15.55:0/3864072496 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:08.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb93a668640 1 --2- 172.21.15.55:0/3864072496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9340cde20 0x7fb9340aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:08.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb939666640 1 --2- 172.21.15.55:0/3864072496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9340cabf0 0x7fb93409ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:08.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb939e67640 1 -- 172.21.15.55:0/3864072496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9340cabf0 msgr2=0x7fb93409ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:08.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb939e67640 1 --2- 172.21.15.55:0/3864072496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9340cabf0 0x7fb93409ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb939e67640 1 -- 172.21.15.55:0/3864072496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9340cde20 msgr2=0x7fb9340aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:08.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb939e67640 1 --2- 172.21.15.55:0/3864072496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9340cde20 0x7fb9340aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:08.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.817+0000 7fb939e67640 1 -- 172.21.15.55:0/3864072496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92c009a70 con 0x7fb9340b1220 2023-08-25T04:22:08.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.821+0000 7fb939e67640 1 --2- 172.21.15.55:0/3864072496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9340b1220 0x7fb93409d950 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fb93000c500 tx=0x7fb93000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:08.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.821+0000 7fb92a7fc640 1 -- 172.21.15.55:0/3864072496 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb930005cf0 con 0x7fb9340b1220 2023-08-25T04:22:08.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.821+0000 7fb93c0cb640 1 -- 172.21.15.55:0/3864072496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9340c7350 con 0x7fb9340b1220 2023-08-25T04:22:08.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.821+0000 7fb92a7fc640 1 -- 172.21.15.55:0/3864072496 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb930005e50 con 0x7fb9340b1220 2023-08-25T04:22:08.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.821+0000 7fb92a7fc640 1 -- 172.21.15.55:0/3864072496 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9300072f0 con 0x7fb9340b1220 2023-08-25T04:22:08.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.821+0000 7fb93c0cb640 1 -- 172.21.15.55:0/3864072496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93409e5a0 con 0x7fb9340b1220 2023-08-25T04:22:08.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.825+0000 7fb93c0cb640 1 -- 172.21.15.55:0/3864072496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93404dbe0 con 0x7fb9340b1220 2023-08-25T04:22:08.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.825+0000 7fb92a7fc640 1 -- 172.21.15.55:0/3864072496 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 65) v1 ==== 84800+0+0 (secure 0 0 0) 0x7fb930007450 con 0x7fb9340b1220 2023-08-25T04:22:08.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.825+0000 7fb92a7fc640 1 --2- 172.21.15.55:0/3864072496 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb9180654d0 0x7fb918067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:08.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.825+0000 7fb92a7fc640 1 -- 172.21.15.55:0/3864072496 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6892+0+0 (secure 0 0 0) 0x7fb930082370 con 0x7fb9340b1220 2023-08-25T04:22:08.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.825+0000 7fb939666640 1 --2- 172.21.15.55:0/3864072496 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb9180654d0 0x7fb918067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:08.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.825+0000 7fb939666640 1 --2- 172.21.15.55:0/3864072496 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb9180654d0 0x7fb918067990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb9340b3fd0 tx=0x7fb924009040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:08.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:08.829+0000 7fb92a7fc640 1 -- 172.21.15.55:0/3864072496 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb93004fd90 con 0x7fb9340b1220 2023-08-25T04:22:09.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.021+0000 7fb93c0cb640 1 -- 172.21.15.55:0/3864072496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb934065770 con 0x7fb9340b1220 2023-08-25T04:22:09.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.021+0000 7fb92a7fc640 1 -- 172.21.15.55:0/3864072496 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4883 (secure 0 0 0) 0x7fb9300533b0 con 0x7fb9340b1220 2023-08-25T04:22:09.022 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:09.022 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2585223071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2585223071},{"type":"v1","addr":"172.21.15.55:6834","nonce":2585223071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52},{"gid":7918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3510911374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3510911374},{"type":"v1","addr":"172.21.15.110:6837","nonce":3510911374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":7921,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1404270940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1404270940},{"type":"v1","addr":"172.21.15.110:6836","nonce":1404270940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:21:22.282732+0000","modified":"2023-08-25T04:21:25.909779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8436":{"gid":8436,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1257898577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1257898577},{"type":"v1","addr":"172.21.15.55:6835","nonce":1257898577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-25T04:22:09.022 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 58 2023-08-25T04:22:09.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.021+0000 7fb93c0cb640 1 -- 172.21.15.55:0/3864072496 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb9180654d0 msgr2=0x7fb918067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.021+0000 7fb93c0cb640 1 --2- 172.21.15.55:0/3864072496 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb9180654d0 0x7fb918067990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb9340b3fd0 tx=0x7fb924009040 comp rx=0 tx=0).stop 2023-08-25T04:22:09.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.021+0000 7fb93c0cb640 1 -- 172.21.15.55:0/3864072496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9340b1220 msgr2=0x7fb93409d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.021+0000 7fb93c0cb640 1 --2- 172.21.15.55:0/3864072496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9340b1220 0x7fb93409d950 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fb93000c500 tx=0x7fb93000c9c0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.021+0000 7fb93c0cb640 1 -- 172.21.15.55:0/3864072496 shutdown_connections 2023-08-25T04:22:09.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.021+0000 7fb93c0cb640 1 --2- 172.21.15.55:0/3864072496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9340cde20 0x7fb9340aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.021+0000 7fb93c0cb640 1 --2- 172.21.15.55:0/3864072496 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb9180654d0 0x7fb918067990 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.021+0000 7fb93c0cb640 1 --2- 172.21.15.55:0/3864072496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9340cabf0 0x7fb93409ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.021+0000 7fb93c0cb640 1 --2- 172.21.15.55:0/3864072496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9340b1220 0x7fb93409d950 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.021+0000 7fb93c0cb640 1 -- 172.21.15.55:0/3864072496 >> 172.21.15.55:0/3864072496 conn(0x7fb9340b0700 msgr2=0x7fb93406ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:09.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.021+0000 7fb93c0cb640 1 -- 172.21.15.55:0/3864072496 shutdown_connections 2023-08-25T04:22:09.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.021+0000 7fb93c0cb640 1 -- 172.21.15.55:0/3864072496 wait complete. 2023-08-25T04:22:09.042 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:22:09.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.185+0000 7f77cced8640 1 Processor -- start 2023-08-25T04:22:09.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.185+0000 7f77cced8640 1 -- start start 2023-08-25T04:22:09.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.185+0000 7f77cced8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f77c80cfa70 0x7f77c8160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:09.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.185+0000 7f77cced8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c806b2b0 0x7f77c806b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:09.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.185+0000 7f77cced8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c806eaf0 con 0x7f77c815c9c0 2023-08-25T04:22:09.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.189+0000 7f77cced8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c806e530 con 0x7f77c80cfa70 2023-08-25T04:22:09.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.189+0000 7f77cced8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c806e810 con 0x7f77c806b2b0 2023-08-25T04:22:09.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.189+0000 7f77bdd9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f77c80cfa70 0x7f77c8160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:09.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.189+0000 7f77bdd9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f77c80cfa70 0x7f77c8160c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33942/0 (socket says 172.21.15.55:33942) 2023-08-25T04:22:09.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.189+0000 7f77bdd9b640 1 -- 172.21.15.55:0/2974690773 learned_addr learned my addr 172.21.15.55:0/2974690773 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:09.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.189+0000 7f77c6d9d640 1 --2- 172.21.15.55:0/2974690773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c806b2b0 0x7f77c806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:09.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.189+0000 7f77bdd9b640 1 -- 172.21.15.55:0/2974690773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c806b2b0 msgr2=0x7f77c806b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:09.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.189+0000 7f77bdd9b640 1 --2- 172.21.15.55:0/2974690773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c806b2b0 0x7f77c806b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.189+0000 7f77bdd9b640 1 -- 172.21.15.55:0/2974690773 >> v1:172.21.15.110:6789/0 conn(0x7f77c815c9c0 legacy=0x7f77c8160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.189+0000 7f77bdd9b640 1 -- 172.21.15.55:0/2974690773 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c806aab0 con 0x7f77c80cfa70 2023-08-25T04:22:09.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.189+0000 7f77bdd9b640 1 --2- 172.21.15.55:0/2974690773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77c80cfa70 0x7f77c8160c20 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f77b0009e50 tx=0x7f77b001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e3c271ca56f47f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:09.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.189+0000 7f77c5d9b640 1 -- 172.21.15.55:0/2974690773 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b00a5870 con 0x7f77c80cfa70 2023-08-25T04:22:09.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.189+0000 7f77c5d9b640 1 -- 172.21.15.55:0/2974690773 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b00a59d0 con 0x7f77c80cfa70 2023-08-25T04:22:09.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.189+0000 7f77c5d9b640 1 -- 172.21.15.55:0/2974690773 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b00a5d60 con 0x7f77c80cfa70 2023-08-25T04:22:09.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77cced8640 1 -- 172.21.15.55:0/2974690773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77c80cfa70 msgr2=0x7f77c8160c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77cced8640 1 --2- 172.21.15.55:0/2974690773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77c80cfa70 0x7f77c8160c20 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f77b0009e50 tx=0x7f77b001c9e0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77cced8640 1 -- 172.21.15.55:0/2974690773 shutdown_connections 2023-08-25T04:22:09.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77cced8640 1 --2- 172.21.15.55:0/2974690773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c806b2b0 0x7f77c806b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77cced8640 1 --2- 172.21.15.55:0/2974690773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77c80cfa70 0x7f77c8160c20 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77cced8640 1 -- 172.21.15.55:0/2974690773 >> 172.21.15.55:0/2974690773 conn(0x7f77c80d05a0 msgr2=0x7f77c80d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:09.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77cced8640 1 -- 172.21.15.55:0/2974690773 shutdown_connections 2023-08-25T04:22:09.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77cced8640 1 -- 172.21.15.55:0/2974690773 wait complete. 2023-08-25T04:22:09.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77cced8640 1 Processor -- start 2023-08-25T04:22:09.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77cced8640 1 -- start start 2023-08-25T04:22:09.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77cced8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77c806b2b0 0x7f77c814bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:09.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77cced8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c80cfa70 0x7f77c80b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:09.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77cced8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77c815c9c0 0x7f77c80c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:09.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77cced8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c815ab30 con 0x7f77c815c9c0 2023-08-25T04:22:09.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77cced8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c8159f20 con 0x7f77c806b2b0 2023-08-25T04:22:09.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77cced8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c815a200 con 0x7f77c80cfa70 2023-08-25T04:22:09.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77c6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77c815c9c0 0x7f77c80c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:09.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77c6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77c815c9c0 0x7f77c80c40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33958/0 (socket says 172.21.15.55:33958) 2023-08-25T04:22:09.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.193+0000 7f77c6d9d640 1 -- 172.21.15.55:0/3118246770 learned_addr learned my addr 172.21.15.55:0/3118246770 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:09.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.197+0000 7f77bdd9b640 1 --2- 172.21.15.55:0/3118246770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c80cfa70 0x7f77c80b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:09.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.197+0000 7f77c659c640 1 --2- 172.21.15.55:0/3118246770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77c806b2b0 0x7f77c814bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:09.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.197+0000 7f77c6d9d640 1 -- 172.21.15.55:0/3118246770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c80cfa70 msgr2=0x7f77c80b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.197+0000 7f77c6d9d640 1 --2- 172.21.15.55:0/3118246770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c80cfa70 0x7f77c80b3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.197+0000 7f77c6d9d640 1 -- 172.21.15.55:0/3118246770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77c806b2b0 msgr2=0x7f77c814bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.197+0000 7f77c6d9d640 1 --2- 172.21.15.55:0/3118246770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77c806b2b0 0x7f77c814bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.197+0000 7f77c6d9d640 1 -- 172.21.15.55:0/3118246770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b0009b30 con 0x7f77c815c9c0 2023-08-25T04:22:09.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.197+0000 7f77c659c640 1 --2- 172.21.15.55:0/3118246770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77c806b2b0 0x7f77c814bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:09.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.197+0000 7f77c6d9d640 1 --2- 172.21.15.55:0/3118246770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77c815c9c0 0x7f77c80c40d0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f77c000e930 tx=0x7f77c000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:09.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.197+0000 7f77bf7fe640 1 -- 172.21.15.55:0/3118246770 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c00096b0 con 0x7f77c815c9c0 2023-08-25T04:22:09.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.197+0000 7f77bf7fe640 1 -- 172.21.15.55:0/3118246770 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c000c9a0 con 0x7f77c815c9c0 2023-08-25T04:22:09.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.197+0000 7f77bf7fe640 1 -- 172.21.15.55:0/3118246770 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c000cd30 con 0x7f77c815c9c0 2023-08-25T04:22:09.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.197+0000 7f77cced8640 1 -- 172.21.15.55:0/3118246770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c815a4e0 con 0x7f77c815c9c0 2023-08-25T04:22:09.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.197+0000 7f77cced8640 1 -- 172.21.15.55:0/3118246770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c8159bb0 con 0x7f77c815c9c0 2023-08-25T04:22:09.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.197+0000 7f77cced8640 1 -- 172.21.15.55:0/3118246770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c815aca0 con 0x7f77c815c9c0 2023-08-25T04:22:09.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.197+0000 7f77bf7fe640 1 -- 172.21.15.55:0/3118246770 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 65) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f77c0013470 con 0x7f77c815c9c0 2023-08-25T04:22:09.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.197+0000 7f77bf7fe640 1 --2- 172.21.15.55:0/3118246770 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f77a80654d0 0x7f77a8067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:09.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.197+0000 7f77bf7fe640 1 -- 172.21.15.55:0/3118246770 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6892+0+0 (secure 0 0 0) 0x7f77c00830d0 con 0x7f77c815c9c0 2023-08-25T04:22:09.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.201+0000 7f77c659c640 1 --2- 172.21.15.55:0/3118246770 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f77a80654d0 0x7f77a8067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:09.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.201+0000 7f77c659c640 1 --2- 172.21.15.55:0/3118246770 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f77a80654d0 0x7f77a8067990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f77c81f83c0 tx=0x7f77b8009040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:09.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.201+0000 7f77bf7fe640 1 -- 172.21.15.55:0/3118246770 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f77c0050b80 con 0x7f77c815c9c0 2023-08-25T04:22:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.361+0000 7f77cced8640 1 -- 172.21.15.55:0/3118246770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77c804dbe0 con 0x7f77c815c9c0 2023-08-25T04:22:09.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.365+0000 7f77bf7fe640 1 -- 172.21.15.55:0/3118246770 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+19557 (secure 0 0 0) 0x7f77c00541a0 con 0x7f77c815c9c0 2023-08-25T04:22:09.364 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:09.364 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":124,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:22:07.620251+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:21:20.028451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-25T04:21:21.281198+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":124,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3609572863":"2023-08-26T04:22:07.620198+0000","172.21.15.110:6833/3764718770":"2023-08-26T04:22:07.620198+0000","172.21.15.110:6832/3764718770":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/2437933180":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/2896743533":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/1241861202":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/3679172150":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/1315935264":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/1881766103":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/2743969486":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/25303232":"2023-08-26T04:21:39.491872+0000","172.21.15.110:6833/4272914017":"2023-08-26T04:21:39.491872+0000","172.21.15.110:6832/4272914017":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/2603377142":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/3471699845":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/3203059750":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/251061267":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/484834832":"2023-08-26T04:21:39.491872+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:22:09.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.365+0000 7f77cced8640 1 -- 172.21.15.55:0/3118246770 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f77a80654d0 msgr2=0x7f77a8067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.365+0000 7f77cced8640 1 --2- 172.21.15.55:0/3118246770 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f77a80654d0 0x7f77a8067990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f77c81f83c0 tx=0x7f77b8009040 comp rx=0 tx=0).stop 2023-08-25T04:22:09.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.365+0000 7f77cced8640 1 -- 172.21.15.55:0/3118246770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77c815c9c0 msgr2=0x7f77c80c40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.365+0000 7f77cced8640 1 --2- 172.21.15.55:0/3118246770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77c815c9c0 0x7f77c80c40d0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f77c000e930 tx=0x7f77c000edf0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.365+0000 7f77cced8640 1 -- 172.21.15.55:0/3118246770 shutdown_connections 2023-08-25T04:22:09.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.365+0000 7f77cced8640 1 --2- 172.21.15.55:0/3118246770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77c815c9c0 0x7f77c80c40d0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.365+0000 7f77cced8640 1 --2- 172.21.15.55:0/3118246770 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f77a80654d0 0x7f77a8067990 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.365+0000 7f77cced8640 1 --2- 172.21.15.55:0/3118246770 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77c80cfa70 0x7f77c80b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.365+0000 7f77cced8640 1 --2- 172.21.15.55:0/3118246770 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77c806b2b0 0x7f77c814bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.365+0000 7f77cced8640 1 -- 172.21.15.55:0/3118246770 >> 172.21.15.55:0/3118246770 conn(0x7f77c80d05a0 msgr2=0x7f77c80ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:09.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.365+0000 7f77cced8640 1 -- 172.21.15.55:0/3118246770 shutdown_connections 2023-08-25T04:22:09.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.365+0000 7f77cced8640 1 -- 172.21.15.55:0/3118246770 wait complete. 2023-08-25T04:22:09.385 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-25T04:22:09.386 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:22:09.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.529+0000 7f31946bd640 1 Processor -- start 2023-08-25T04:22:09.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.529+0000 7f31946bd640 1 -- start start 2023-08-25T04:22:09.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.529+0000 7f31946bd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f318c0d0da0 0x7f318c0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:09.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.529+0000 7f31946bd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318c0b29b0 con 0x7f318c0cdde0 2023-08-25T04:22:09.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.529+0000 7f31946bd640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318c0cfc80 con 0x7f318c0b3e50 2023-08-25T04:22:09.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.529+0000 7f31946bd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318c0d16c0 con 0x7f318c0d0da0 2023-08-25T04:22:09.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.529+0000 7f3192459640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f318c0d0da0 0x7f318c0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:09.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.529+0000 7f3191c58640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f318c0cdde0 0x7f318c0cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41714/0 (socket says 172.21.15.55:41714) 2023-08-25T04:22:09.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.529+0000 7f3192459640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f318c0d0da0 0x7f318c0d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33974/0 (socket says 172.21.15.55:33974) 2023-08-25T04:22:09.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.529+0000 7f3191c58640 1 -- 172.21.15.55:0/2996865424 learned_addr learned my addr 172.21.15.55:0/2996865424 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:09.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.529+0000 7f3192459640 1 -- 172.21.15.55:0/2996865424 >> v1:172.21.15.110:6789/0 conn(0x7f318c0b3e50 legacy=0x7f318c0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:09.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.529+0000 7f3192459640 1 -- 172.21.15.55:0/2996865424 >> v1:172.21.15.55:6789/0 conn(0x7f318c0cdde0 legacy=0x7f318c0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.529+0000 7f3191457640 1 -- 172.21.15.55:0/2996865424 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625281578 0 0) 0x7f318c0b29b0 con 0x7f318c0cdde0 2023-08-25T04:22:09.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.529+0000 7f3192459640 1 -- 172.21.15.55:0/2996865424 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c0b1dc0 con 0x7f318c0d0da0 2023-08-25T04:22:09.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.533+0000 7f3192459640 1 --2- 172.21.15.55:0/2996865424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f318c0d0da0 0x7f318c0d1180 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f31880097a0 tx=0x7f318801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f942668107a9761a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:09.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.533+0000 7f3191457640 1 -- 172.21.15.55:0/2996865424 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31880a8950 con 0x7f318c0d0da0 2023-08-25T04:22:09.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.533+0000 7f3191457640 1 -- 172.21.15.55:0/2996865424 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31880a8ab0 con 0x7f318c0d0da0 2023-08-25T04:22:09.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.533+0000 7f3191457640 1 -- 172.21.15.55:0/2996865424 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31880a8e40 con 0x7f318c0d0da0 2023-08-25T04:22:09.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.533+0000 7f31946bd640 1 -- 172.21.15.55:0/2996865424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f318c0d0da0 msgr2=0x7f318c0d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.533+0000 7f31946bd640 1 --2- 172.21.15.55:0/2996865424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f318c0d0da0 0x7f318c0d1180 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f31880097a0 tx=0x7f318801ec50 comp rx=0 tx=0).stop 2023-08-25T04:22:09.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.533+0000 7f31946bd640 1 -- 172.21.15.55:0/2996865424 shutdown_connections 2023-08-25T04:22:09.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.533+0000 7f31946bd640 1 --2- 172.21.15.55:0/2996865424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f318c0d0da0 0x7f318c0d1180 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.533+0000 7f31946bd640 1 -- 172.21.15.55:0/2996865424 >> 172.21.15.55:0/2996865424 conn(0x7f318c09bae0 msgr2=0x7f318c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:09.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.533+0000 7f31946bd640 1 -- 172.21.15.55:0/2996865424 shutdown_connections 2023-08-25T04:22:09.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.533+0000 7f31946bd640 1 -- 172.21.15.55:0/2996865424 wait complete. 2023-08-25T04:22:09.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f31946bd640 1 Processor -- start 2023-08-25T04:22:09.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f31946bd640 1 -- start start 2023-08-25T04:22:09.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f31946bd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f318c0b3e50 0x7f318c0c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:09.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f31946bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f318c0cdde0 0x7f318c0d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:09.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f31946bd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f318c0d0da0 0x7f318c0c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:09.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f31946bd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0d34c0 con 0x7f318c0cdde0 2023-08-25T04:22:09.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f31946bd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0c7a20 con 0x7f318c0d0da0 2023-08-25T04:22:09.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f31946bd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0c7d00 con 0x7f318c0b3e50 2023-08-25T04:22:09.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f3191c58640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f318c0cdde0 0x7f318c0d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:09.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f3191c58640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f318c0cdde0 0x7f318c0d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33988/0 (socket says 172.21.15.55:33988) 2023-08-25T04:22:09.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f3191c58640 1 -- 172.21.15.55:0/1499373849 learned_addr learned my addr 172.21.15.55:0/1499373849 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:09.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f3192459640 1 --2- 172.21.15.55:0/1499373849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f318c0b3e50 0x7f318c0c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:09.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f3192c5a640 1 --2- 172.21.15.55:0/1499373849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f318c0d0da0 0x7f318c0c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:09.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f3191c58640 1 -- 172.21.15.55:0/1499373849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f318c0b3e50 msgr2=0x7f318c0c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f3191c58640 1 --2- 172.21.15.55:0/1499373849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f318c0b3e50 0x7f318c0c7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f3191c58640 1 -- 172.21.15.55:0/1499373849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f318c0d0da0 msgr2=0x7f318c0c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f3191c58640 1 --2- 172.21.15.55:0/1499373849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f318c0d0da0 0x7f318c0c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f3191c58640 1 -- 172.21.15.55:0/1499373849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31880093b0 con 0x7f318c0cdde0 2023-08-25T04:22:09.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f3191c58640 1 --2- 172.21.15.55:0/1499373849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f318c0cdde0 0x7f318c0d2f80 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f317c00c4a0 tx=0x7f317c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:09.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f3182ffd640 1 -- 172.21.15.55:0/1499373849 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c0074e0 con 0x7f318c0cdde0 2023-08-25T04:22:09.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f3182ffd640 1 -- 172.21.15.55:0/1499373849 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c007640 con 0x7f318c0cdde0 2023-08-25T04:22:09.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f3182ffd640 1 -- 172.21.15.55:0/1499373849 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c004a30 con 0x7f318c0cdde0 2023-08-25T04:22:09.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f31946bd640 1 -- 172.21.15.55:0/1499373849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318c0c7fe0 con 0x7f318c0cdde0 2023-08-25T04:22:09.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.537+0000 7f31946bd640 1 -- 172.21.15.55:0/1499373849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318c0c85a0 con 0x7f318c0cdde0 2023-08-25T04:22:09.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.541+0000 7f31946bd640 1 -- 172.21.15.55:0/1499373849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318c04dbe0 con 0x7f318c0cdde0 2023-08-25T04:22:09.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.541+0000 7f3182ffd640 1 -- 172.21.15.55:0/1499373849 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 65) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f317c004b90 con 0x7f318c0cdde0 2023-08-25T04:22:09.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.541+0000 7f3182ffd640 1 --2- 172.21.15.55:0/1499373849 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f31700654d0 0x7f3170067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:09.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.541+0000 7f3182ffd640 1 -- 172.21.15.55:0/1499373849 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6892+0+0 (secure 0 0 0) 0x7f317c081f70 con 0x7f318c0cdde0 2023-08-25T04:22:09.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.541+0000 7f3192459640 1 --2- 172.21.15.55:0/1499373849 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f31700654d0 0x7f3170067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:09.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.541+0000 7f3192459640 1 --2- 172.21.15.55:0/1499373849 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f31700654d0 0x7f3170067990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f31880b2000 tx=0x7f3188008040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:09.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.545+0000 7f3182ffd640 1 -- 172.21.15.55:0/1499373849 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f317c0b2d90 con 0x7f318c0cdde0 2023-08-25T04:22:09.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.737+0000 7f31946bd640 1 -- 172.21.15.55:0/1499373849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f318c0d0b80 con 0x7f318c0cdde0 2023-08-25T04:22:09.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.737+0000 7f3182ffd640 1 -- 172.21.15.55:0/1499373849 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f317c018020 con 0x7f318c0cdde0 2023-08-25T04:22:09.739 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:09.739 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2585223071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2585223071},{"type":"v1","addr":"172.21.15.55:6834","nonce":2585223071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52},{"gid":7918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3510911374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3510911374},{"type":"v1","addr":"172.21.15.110:6837","nonce":3510911374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":7921,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1404270940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1404270940},{"type":"v1","addr":"172.21.15.110:6836","nonce":1404270940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:21:22.282732+0000","modified":"2023-08-25T04:21:25.909779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8436":{"gid":8436,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1257898577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1257898577},{"type":"v1","addr":"172.21.15.55:6835","nonce":1257898577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-25T04:22:09.740 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 58 2023-08-25T04:22:09.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.741+0000 7f31946bd640 1 -- 172.21.15.55:0/1499373849 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f31700654d0 msgr2=0x7f3170067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.741+0000 7f31946bd640 1 --2- 172.21.15.55:0/1499373849 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f31700654d0 0x7f3170067990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f31880b2000 tx=0x7f3188008040 comp rx=0 tx=0).stop 2023-08-25T04:22:09.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.741+0000 7f31946bd640 1 -- 172.21.15.55:0/1499373849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f318c0cdde0 msgr2=0x7f318c0d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.741+0000 7f31946bd640 1 --2- 172.21.15.55:0/1499373849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f318c0cdde0 0x7f318c0d2f80 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f317c00c4a0 tx=0x7f317c00c960 comp rx=0 tx=0).stop 2023-08-25T04:22:09.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.741+0000 7f31946bd640 1 -- 172.21.15.55:0/1499373849 shutdown_connections 2023-08-25T04:22:09.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.741+0000 7f31946bd640 1 --2- 172.21.15.55:0/1499373849 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f318c0d0da0 0x7f318c0c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.741+0000 7f31946bd640 1 --2- 172.21.15.55:0/1499373849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f318c0cdde0 0x7f318c0d2f80 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.741+0000 7f31946bd640 1 --2- 172.21.15.55:0/1499373849 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f31700654d0 0x7f3170067990 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.741+0000 7f31946bd640 1 --2- 172.21.15.55:0/1499373849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f318c0b3e50 0x7f318c0c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.741+0000 7f31946bd640 1 -- 172.21.15.55:0/1499373849 >> 172.21.15.55:0/1499373849 conn(0x7f318c09bae0 msgr2=0x7f318c06b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:09.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.741+0000 7f31946bd640 1 -- 172.21.15.55:0/1499373849 shutdown_connections 2023-08-25T04:22:09.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.741+0000 7f31946bd640 1 -- 172.21.15.55:0/1499373849 wait complete. 2023-08-25T04:22:09.759 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:22:09.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.905+0000 7f19bc24f640 1 Processor -- start 2023-08-25T04:22:09.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.905+0000 7f19bc24f640 1 -- start start 2023-08-25T04:22:09.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.905+0000 7f19bc24f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f19b40c89f0 0x7f19b40cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:09.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.905+0000 7f19bc24f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b40cc880 con 0x7f19b40ceeb0 2023-08-25T04:22:09.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.905+0000 7f19bc24f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b40ccb60 con 0x7f19b40ad950 2023-08-25T04:22:09.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.905+0000 7f19bc24f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b40b11f0 con 0x7f19b40c89f0 2023-08-25T04:22:09.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.905+0000 7f19b97ea640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f19b40ceeb0 0x7f19b40b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41720/0 (socket says 172.21.15.55:41720) 2023-08-25T04:22:09.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.905+0000 7f19b97ea640 1 -- 172.21.15.55:0/1309616232 learned_addr learned my addr 172.21.15.55:0/1309616232 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:09.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.905+0000 7f19ba7ec640 1 --2- 172.21.15.55:0/1309616232 >> v2:172.21.15.110:3300/0 conn(0x7f19b40c89f0 0x7f19b40cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:09.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.909+0000 7f19b8fe9640 1 -- 172.21.15.55:0/1309616232 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482563395 0 0) 0x7f19b40cc880 con 0x7f19b40ceeb0 2023-08-25T04:22:09.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.909+0000 7f19b8fe9640 1 -- 172.21.15.55:0/1309616232 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19a0003530 con 0x7f19b40ceeb0 2023-08-25T04:22:09.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.909+0000 7f19b8fe9640 1 -- 172.21.15.55:0/1309616232 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229125509 0 0) 0x7f19b40ccb60 con 0x7f19b40ad950 2023-08-25T04:22:09.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.909+0000 7f19b8fe9640 1 -- 172.21.15.55:0/1309616232 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19b40cc880 con 0x7f19b40ad950 2023-08-25T04:22:09.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.909+0000 7f19ba7ec640 1 -- 172.21.15.55:0/1309616232 >> v1:172.21.15.110:6789/0 conn(0x7f19b40ad950 legacy=0x7f19b40ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.909+0000 7f19ba7ec640 1 -- 172.21.15.55:0/1309616232 >> v1:172.21.15.55:6789/0 conn(0x7f19b40ceeb0 legacy=0x7f19b40b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.909+0000 7f19ba7ec640 1 -- 172.21.15.55:0/1309616232 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b40cce40 con 0x7f19b40c89f0 2023-08-25T04:22:09.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.909+0000 7f19ba7ec640 1 --2- 172.21.15.55:0/1309616232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19b40c89f0 0x7f19b40cc2a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009d90 tx=0x7f19ac01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75ebfd71d8ec25c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:09.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.909+0000 7f19b8fe9640 1 -- 172.21.15.55:0/1309616232 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0a5780 con 0x7f19b40c89f0 2023-08-25T04:22:09.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.909+0000 7f19b8fe9640 1 -- 172.21.15.55:0/1309616232 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac0a58e0 con 0x7f19b40c89f0 2023-08-25T04:22:09.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.909+0000 7f19b8fe9640 1 -- 172.21.15.55:0/1309616232 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0a5c70 con 0x7f19b40c89f0 2023-08-25T04:22:09.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19bc24f640 1 -- 172.21.15.55:0/1309616232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19b40c89f0 msgr2=0x7f19b40cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19bc24f640 1 --2- 172.21.15.55:0/1309616232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19b40c89f0 0x7f19b40cc2a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009d90 tx=0x7f19ac01c8c0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19bc24f640 1 -- 172.21.15.55:0/1309616232 shutdown_connections 2023-08-25T04:22:09.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19bc24f640 1 --2- 172.21.15.55:0/1309616232 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19b40c89f0 0x7f19b40cc2a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19bc24f640 1 -- 172.21.15.55:0/1309616232 >> 172.21.15.55:0/1309616232 conn(0x7f19b4069d00 msgr2=0x7f19b406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:09.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19bc24f640 1 -- 172.21.15.55:0/1309616232 shutdown_connections 2023-08-25T04:22:09.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19bc24f640 1 -- 172.21.15.55:0/1309616232 wait complete. 2023-08-25T04:22:09.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19bc24f640 1 Processor -- start 2023-08-25T04:22:09.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19bc24f640 1 -- start start 2023-08-25T04:22:09.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19bc24f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19b40ad950 0x7f19b40c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:09.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19bc24f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19b40c89f0 0x7f19b40c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:09.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19bc24f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19b40ceeb0 0x7f19b40c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:09.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19bc24f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b4153ed0 con 0x7f19b40ceeb0 2023-08-25T04:22:09.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19bc24f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40c5610 con 0x7f19b40ad950 2023-08-25T04:22:09.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19bc24f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b40c58f0 con 0x7f19b40c89f0 2023-08-25T04:22:09.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19ba7ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19b40ceeb0 0x7f19b40c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:09.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19ba7ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19b40ceeb0 0x7f19b40c6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34004/0 (socket says 172.21.15.55:34004) 2023-08-25T04:22:09.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19ba7ec640 1 -- 172.21.15.55:0/2382281345 learned_addr learned my addr 172.21.15.55:0/2382281345 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:09.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.913+0000 7f19b9feb640 1 --2- 172.21.15.55:0/2382281345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19b40ad950 0x7f19b40c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:09.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.917+0000 7f19ba7ec640 1 -- 172.21.15.55:0/2382281345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19b40c89f0 msgr2=0x7f19b40c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.917+0000 7f19ba7ec640 1 --2- 172.21.15.55:0/2382281345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19b40c89f0 0x7f19b40c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.917+0000 7f19ba7ec640 1 -- 172.21.15.55:0/2382281345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19b40ad950 msgr2=0x7f19b40c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:09.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.917+0000 7f19ba7ec640 1 --2- 172.21.15.55:0/2382281345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19b40ad950 0x7f19b40c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:09.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.917+0000 7f19ba7ec640 1 -- 172.21.15.55:0/2382281345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac009a70 con 0x7f19b40ceeb0 2023-08-25T04:22:09.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.917+0000 7f19b9feb640 1 --2- 172.21.15.55:0/2382281345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19b40ad950 0x7f19b40c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:09.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.917+0000 7f19ba7ec640 1 --2- 172.21.15.55:0/2382281345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19b40ceeb0 0x7f19b40c6e50 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f19ac01a4f0 tx=0x7f19ac019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:09.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.917+0000 7f19aa7fc640 1 -- 172.21.15.55:0/2382281345 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0ad640 con 0x7f19b40ceeb0 2023-08-25T04:22:09.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.917+0000 7f19aa7fc640 1 -- 172.21.15.55:0/2382281345 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac0ad7a0 con 0x7f19b40ceeb0 2023-08-25T04:22:09.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.917+0000 7f19aa7fc640 1 -- 172.21.15.55:0/2382281345 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac0adb10 con 0x7f19b40ceeb0 2023-08-25T04:22:09.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.917+0000 7f19bc24f640 1 -- 172.21.15.55:0/2382281345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b40c5bd0 con 0x7f19b40ceeb0 2023-08-25T04:22:09.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.917+0000 7f19bc24f640 1 -- 172.21.15.55:0/2382281345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b41544f0 con 0x7f19b40ceeb0 2023-08-25T04:22:09.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.917+0000 7f19bc24f640 1 -- 172.21.15.55:0/2382281345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b406b920 con 0x7f19b40ceeb0 2023-08-25T04:22:09.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.917+0000 7f19aa7fc640 1 -- 172.21.15.55:0/2382281345 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 66) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f19ac0b4050 con 0x7f19b40ceeb0 2023-08-25T04:22:09.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.917+0000 7f19aa7fc640 1 --2- 172.21.15.55:0/2382281345 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f1998065710 0x7f1998067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:09.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.917+0000 7f19aa7fc640 1 -- 172.21.15.55:0/2382281345 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6892+0+0 (secure 0 0 0) 0x7f19ac11dff0 con 0x7f19b40ceeb0 2023-08-25T04:22:09.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.917+0000 7f19b9feb640 1 --2- 172.21.15.55:0/2382281345 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f1998065710 0x7f1998067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:09.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.921+0000 7f19b9feb640 1 --2- 172.21.15.55:0/2382281345 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f1998065710 0x7f1998067bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f19b00011f0 tx=0x7f19b0009040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:09.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:09.921+0000 7f19aa7fc640 1 -- 172.21.15.55:0/2382281345 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f19ac14ed90 con 0x7f19b40ceeb0 2023-08-25T04:22:10.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.109+0000 7f19bc24f640 1 -- 172.21.15.55:0/2382281345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19b404dbe0 con 0x7f19b40ceeb0 2023-08-25T04:22:10.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.109+0000 7f19aa7fc640 1 -- 172.21.15.55:0/2382281345 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f19ac0eb7d0 con 0x7f19b40ceeb0 2023-08-25T04:22:10.112 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:10.112 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2585223071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2585223071},{"type":"v1","addr":"172.21.15.55:6834","nonce":2585223071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52},{"gid":7918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3510911374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3510911374},{"type":"v1","addr":"172.21.15.110:6837","nonce":3510911374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":7921,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1404270940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1404270940},{"type":"v1","addr":"172.21.15.110:6836","nonce":1404270940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:21:22.282732+0000","modified":"2023-08-25T04:21:25.909779+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8436":{"gid":8436,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1257898577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1257898577},{"type":"v1","addr":"172.21.15.55:6835","nonce":1257898577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-08-25T04:22:10.112 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 58 2023-08-25T04:22:10.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.113+0000 7f19bc24f640 1 -- 172.21.15.55:0/2382281345 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f1998065710 msgr2=0x7f1998067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:10.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.113+0000 7f19bc24f640 1 --2- 172.21.15.55:0/2382281345 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f1998065710 0x7f1998067bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f19b00011f0 tx=0x7f19b0009040 comp rx=0 tx=0).stop 2023-08-25T04:22:10.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.113+0000 7f19bc24f640 1 -- 172.21.15.55:0/2382281345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19b40ceeb0 msgr2=0x7f19b40c6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:10.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.113+0000 7f19bc24f640 1 --2- 172.21.15.55:0/2382281345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19b40ceeb0 0x7f19b40c6e50 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f19ac01a4f0 tx=0x7f19ac019660 comp rx=0 tx=0).stop 2023-08-25T04:22:10.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.113+0000 7f19bc24f640 1 -- 172.21.15.55:0/2382281345 shutdown_connections 2023-08-25T04:22:10.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.113+0000 7f19bc24f640 1 --2- 172.21.15.55:0/2382281345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19b40ceeb0 0x7f19b40c6e50 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.113+0000 7f19bc24f640 1 --2- 172.21.15.55:0/2382281345 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f1998065710 0x7f1998067bd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.113+0000 7f19bc24f640 1 --2- 172.21.15.55:0/2382281345 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f19b40c89f0 0x7f19b40c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.113+0000 7f19bc24f640 1 --2- 172.21.15.55:0/2382281345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19b40ad950 0x7f19b40c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.113+0000 7f19bc24f640 1 -- 172.21.15.55:0/2382281345 >> 172.21.15.55:0/2382281345 conn(0x7f19b4069d00 msgr2=0x7f19b406a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:10.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.113+0000 7f19bc24f640 1 -- 172.21.15.55:0/2382281345 shutdown_connections 2023-08-25T04:22:10.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.113+0000 7f19bc24f640 1 -- 172.21.15.55:0/2382281345 wait complete. 2023-08-25T04:22:10.133 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:22:10.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.277+0000 7ff6c1144640 1 Processor -- start 2023-08-25T04:22:10.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.277+0000 7ff6c1144640 1 -- start start 2023-08-25T04:22:10.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.277+0000 7ff6c1144640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff6bc0aeb10 0x7ff6bc0ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:10.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.277+0000 7ff6c1144640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6bc0cee20 0x7ff6bc069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:10.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.277+0000 7ff6c1144640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6bc0cf2b0 con 0x7ff6bc069e40 2023-08-25T04:22:10.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.277+0000 7ff6c1144640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6bc0d0380 con 0x7ff6bc0cee20 2023-08-25T04:22:10.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.277+0000 7ff6c1144640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6bc06d590 con 0x7ff6bc0aeb10 2023-08-25T04:22:10.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.277+0000 7ff6ba59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6bc0cee20 0x7ff6bc069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:10.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.277+0000 7ff6ba59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6bc0cee20 0x7ff6bc069900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34006/0 (socket says 172.21.15.55:34006) 2023-08-25T04:22:10.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.277+0000 7ff6ba59c640 1 -- 172.21.15.55:0/823476110 learned_addr learned my addr 172.21.15.55:0/823476110 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:10.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.277+0000 7ff6bad9d640 1 --2- 172.21.15.55:0/823476110 >> v2:172.21.15.110:3300/0 conn(0x7ff6bc0aeb10 0x7ff6bc0ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:10.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.277+0000 7ff6ba59c640 1 -- 172.21.15.55:0/823476110 >> v2:172.21.15.110:3300/0 conn(0x7ff6bc0aeb10 msgr2=0x7ff6bc0ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:10.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.277+0000 7ff6ba59c640 1 --2- 172.21.15.55:0/823476110 >> v2:172.21.15.110:3300/0 conn(0x7ff6bc0aeb10 0x7ff6bc0ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.277+0000 7ff6ba59c640 1 -- 172.21.15.55:0/823476110 >> v1:172.21.15.110:6789/0 conn(0x7ff6bc069e40 legacy=0x7ff6bc160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:10.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.277+0000 7ff6ba59c640 1 -- 172.21.15.55:0/823476110 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc06c4f0 con 0x7ff6bc0cee20 2023-08-25T04:22:10.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.277+0000 7ff6bad9d640 1 --2- 172.21.15.55:0/823476110 >> v2:172.21.15.110:3300/0 conn(0x7ff6bc0aeb10 0x7ff6bc0ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:10.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.281+0000 7ff6ba59c640 1 --2- 172.21.15.55:0/823476110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6bc0cee20 0x7ff6bc069900 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc06d6d0 tx=0x7ff6b001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c07666dc38fff54 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:10.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.281+0000 7ff6b9d9b640 1 -- 172.21.15.55:0/823476110 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00ac410 con 0x7ff6bc0cee20 2023-08-25T04:22:10.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.281+0000 7ff6b9d9b640 1 -- 172.21.15.55:0/823476110 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b00ac570 con 0x7ff6bc0cee20 2023-08-25T04:22:10.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.281+0000 7ff6b9d9b640 1 -- 172.21.15.55:0/823476110 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00ac900 con 0x7ff6bc0cee20 2023-08-25T04:22:10.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.281+0000 7ff6c1144640 1 -- 172.21.15.55:0/823476110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6bc0cee20 msgr2=0x7ff6bc069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:10.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.281+0000 7ff6c1144640 1 --2- 172.21.15.55:0/823476110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6bc0cee20 0x7ff6bc069900 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc06d6d0 tx=0x7ff6b001c4c0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.281+0000 7ff6c1144640 1 -- 172.21.15.55:0/823476110 shutdown_connections 2023-08-25T04:22:10.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.281+0000 7ff6c1144640 1 --2- 172.21.15.55:0/823476110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6bc0cee20 0x7ff6bc069900 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.281+0000 7ff6c1144640 1 --2- 172.21.15.55:0/823476110 >> v2:172.21.15.110:3300/0 conn(0x7ff6bc0aeb10 0x7ff6bc0ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.281+0000 7ff6c1144640 1 -- 172.21.15.55:0/823476110 >> 172.21.15.55:0/823476110 conn(0x7ff6bc0cf530 msgr2=0x7ff6bc0cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:10.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.281+0000 7ff6c1144640 1 -- 172.21.15.55:0/823476110 shutdown_connections 2023-08-25T04:22:10.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.281+0000 7ff6c1144640 1 -- 172.21.15.55:0/823476110 wait complete. 2023-08-25T04:22:10.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6c1144640 1 Processor -- start 2023-08-25T04:22:10.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6c1144640 1 -- start start 2023-08-25T04:22:10.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6c1144640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6bc069e40 0x7ff6bc15c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:10.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6c1144640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6bc0aeb10 0x7ff6bc15edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:10.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6c1144640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6bc0cee20 0x7ff6bc0c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:10.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6c1144640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc15d610 con 0x7ff6bc069e40 2023-08-25T04:22:10.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6c1144640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc15fd00 con 0x7ff6bc0aeb10 2023-08-25T04:22:10.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6c1144640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc15d820 con 0x7ff6bc0cee20 2023-08-25T04:22:10.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6bad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6bc069e40 0x7ff6bc15c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:10.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6bad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6bc069e40 0x7ff6bc15c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34016/0 (socket says 172.21.15.55:34016) 2023-08-25T04:22:10.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6bad9d640 1 -- 172.21.15.55:0/4091497480 learned_addr learned my addr 172.21.15.55:0/4091497480 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:10.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6ba59c640 1 --2- 172.21.15.55:0/4091497480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6bc0aeb10 0x7ff6bc15edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:10.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6bb59e640 1 --2- 172.21.15.55:0/4091497480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6bc0cee20 0x7ff6bc0c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:10.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6bad9d640 1 -- 172.21.15.55:0/4091497480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6bc0cee20 msgr2=0x7ff6bc0c3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:10.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6bad9d640 1 --2- 172.21.15.55:0/4091497480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6bc0cee20 0x7ff6bc0c3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6bad9d640 1 -- 172.21.15.55:0/4091497480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6bc0aeb10 msgr2=0x7ff6bc15edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:10.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6bad9d640 1 --2- 172.21.15.55:0/4091497480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6bc0aeb10 0x7ff6bc15edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6bad9d640 1 -- 172.21.15.55:0/4091497480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b00094d0 con 0x7ff6bc069e40 2023-08-25T04:22:10.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6bad9d640 1 --2- 172.21.15.55:0/4091497480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6bc069e40 0x7ff6bc15c740 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00c7c0 tx=0x7ff6ac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:10.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6a37fe640 1 -- 172.21.15.55:0/4091497480 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac0079d0 con 0x7ff6bc069e40 2023-08-25T04:22:10.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6a37fe640 1 -- 172.21.15.55:0/4091497480 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac007b30 con 0x7ff6bc069e40 2023-08-25T04:22:10.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6a37fe640 1 -- 172.21.15.55:0/4091497480 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac00ce70 con 0x7ff6bc069e40 2023-08-25T04:22:10.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6c1144640 1 -- 172.21.15.55:0/4091497480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6bc15db00 con 0x7ff6bc069e40 2023-08-25T04:22:10.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6c1144640 1 -- 172.21.15.55:0/4091497480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6bc15e0c0 con 0x7ff6bc069e40 2023-08-25T04:22:10.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.285+0000 7ff6c1144640 1 -- 172.21.15.55:0/4091497480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6bc04dbe0 con 0x7ff6bc069e40 2023-08-25T04:22:10.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.289+0000 7ff6a37fe640 1 -- 172.21.15.55:0/4091497480 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 66) v1 ==== 85008+0+0 (secure 0 0 0) 0x7ff6ac0113f0 con 0x7ff6bc069e40 2023-08-25T04:22:10.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.289+0000 7ff6a37fe640 1 --2- 172.21.15.55:0/4091497480 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7ff6a8065710 0x7ff6a8067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:10.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.289+0000 7ff6a37fe640 1 -- 172.21.15.55:0/4091497480 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6892+0+0 (secure 0 0 0) 0x7ff6ac083720 con 0x7ff6bc069e40 2023-08-25T04:22:10.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.289+0000 7ff6ba59c640 1 --2- 172.21.15.55:0/4091497480 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7ff6a8065710 0x7ff6a8067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:10.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.289+0000 7ff6ba59c640 1 --2- 172.21.15.55:0/4091497480 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7ff6a8065710 0x7ff6a8067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00ae000 tx=0x7ff6b0009040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:10.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.293+0000 7ff6a37fe640 1 -- 172.21.15.55:0/4091497480 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff6ac050d50 con 0x7ff6bc069e40 2023-08-25T04:22:10.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.449+0000 7ff6c1144640 1 -- 172.21.15.55:0/4091497480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6bc070e80 con 0x7ff6bc069e40 2023-08-25T04:22:10.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.449+0000 7ff6a37fe640 1 -- 172.21.15.55:0/4091497480 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+19557 (secure 0 0 0) 0x7ff6ac054370 con 0x7ff6bc069e40 2023-08-25T04:22:10.451 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:10.451 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":124,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:22:07.620251+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:21:20.028451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-25T04:21:21.281198+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":124,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3609572863":"2023-08-26T04:22:07.620198+0000","172.21.15.110:6833/3764718770":"2023-08-26T04:22:07.620198+0000","172.21.15.110:6832/3764718770":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/2437933180":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/2896743533":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/1241861202":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/3679172150":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/1315935264":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/1881766103":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/2743969486":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/25303232":"2023-08-26T04:21:39.491872+0000","172.21.15.110:6833/4272914017":"2023-08-26T04:21:39.491872+0000","172.21.15.110:6832/4272914017":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/2603377142":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/3471699845":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/3203059750":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/251061267":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/484834832":"2023-08-26T04:21:39.491872+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:22:10.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.453+0000 7ff6c1144640 1 -- 172.21.15.55:0/4091497480 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7ff6a8065710 msgr2=0x7ff6a8067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:10.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.453+0000 7ff6c1144640 1 --2- 172.21.15.55:0/4091497480 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7ff6a8065710 0x7ff6a8067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00ae000 tx=0x7ff6b0009040 comp rx=0 tx=0).stop 2023-08-25T04:22:10.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.453+0000 7ff6c1144640 1 -- 172.21.15.55:0/4091497480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6bc069e40 msgr2=0x7ff6bc15c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:10.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.453+0000 7ff6c1144640 1 --2- 172.21.15.55:0/4091497480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6bc069e40 0x7ff6bc15c740 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00c7c0 tx=0x7ff6ac00cc80 comp rx=0 tx=0).stop 2023-08-25T04:22:10.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.453+0000 7ff6c1144640 1 -- 172.21.15.55:0/4091497480 shutdown_connections 2023-08-25T04:22:10.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.453+0000 7ff6c1144640 1 --2- 172.21.15.55:0/4091497480 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7ff6a8065710 0x7ff6a8067bd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.453+0000 7ff6c1144640 1 --2- 172.21.15.55:0/4091497480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6bc0cee20 0x7ff6bc0c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.453+0000 7ff6c1144640 1 --2- 172.21.15.55:0/4091497480 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6bc0aeb10 0x7ff6bc15edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.453+0000 7ff6c1144640 1 --2- 172.21.15.55:0/4091497480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6bc069e40 0x7ff6bc15c740 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.453+0000 7ff6c1144640 1 -- 172.21.15.55:0/4091497480 >> 172.21.15.55:0/4091497480 conn(0x7ff6bc0cf530 msgr2=0x7ff6bc0cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:10.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.453+0000 7ff6c1144640 1 -- 172.21.15.55:0/4091497480 shutdown_connections 2023-08-25T04:22:10.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.453+0000 7ff6c1144640 1 -- 172.21.15.55:0/4091497480 wait complete. 2023-08-25T04:22:10.473 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-25T04:22:10.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.617+0000 7f3c03dd2640 1 Processor -- start 2023-08-25T04:22:10.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.617+0000 7f3c03dd2640 1 -- start start 2023-08-25T04:22:10.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.617+0000 7f3c03dd2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bfc0cdde0 0x7f3bfc0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:10.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.617+0000 7f3c03dd2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3bfc0b2e40 0x7f3bfc0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:10.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.617+0000 7f3c03dd2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bfc0b29b0 con 0x7f3bfc0d0da0 2023-08-25T04:22:10.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.617+0000 7f3c03dd2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bfc0ce760 con 0x7f3bfc0b2e40 2023-08-25T04:22:10.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.617+0000 7f3c03dd2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc0b1dc0 con 0x7f3bfc0cdde0 2023-08-25T04:22:10.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.617+0000 7f3c01b6e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3bfc0d0da0 0x7f3bfc0d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40956/0 (socket says 172.21.15.55:40956) 2023-08-25T04:22:10.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.621+0000 7f3c01b6e640 1 -- 172.21.15.55:0/1674542908 learned_addr learned my addr 172.21.15.55:0/1674542908 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:10.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.621+0000 7f3c0136d640 1 --2- 172.21.15.55:0/1674542908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bfc0cdde0 0x7f3bfc0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:10.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.621+0000 7f3c0236f640 1 --2- 172.21.15.55:0/1674542908 >> v2:172.21.15.110:3300/0 conn(0x7f3bfc0b2e40 0x7f3bfc0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:10.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.621+0000 7f3c00b6c640 1 -- 172.21.15.55:0/1674542908 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134984017 0 0) 0x7f3bfc0b29b0 con 0x7f3bfc0d0da0 2023-08-25T04:22:10.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.621+0000 7f3c00b6c640 1 -- 172.21.15.55:0/1674542908 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3be8003530 con 0x7f3bfc0d0da0 2023-08-25T04:22:10.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.621+0000 7f3c0236f640 1 -- 172.21.15.55:0/1674542908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bfc0cdde0 msgr2=0x7f3bfc0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:10.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.621+0000 7f3c0236f640 1 --2- 172.21.15.55:0/1674542908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bfc0cdde0 0x7f3bfc0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.621+0000 7f3c0236f640 1 -- 172.21.15.55:0/1674542908 >> v1:172.21.15.55:6789/0 conn(0x7f3bfc0d0da0 legacy=0x7f3bfc0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:10.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.621+0000 7f3c0236f640 1 -- 172.21.15.55:0/1674542908 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc0b2080 con 0x7f3bfc0b2e40 2023-08-25T04:22:10.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.621+0000 7f3c0236f640 1 --2- 172.21.15.55:0/1674542908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bfc0b2e40 0x7f3bfc0b32d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009d90 tx=0x7f3bf401f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=938b532bf1d7f19b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:10.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.621+0000 7f3c00b6c640 1 -- 172.21.15.55:0/1674542908 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf40af600 con 0x7f3bfc0b2e40 2023-08-25T04:22:10.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.625+0000 7f3c00b6c640 1 -- 172.21.15.55:0/1674542908 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf40ab050 con 0x7f3bfc0b2e40 2023-08-25T04:22:10.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.625+0000 7f3c00b6c640 1 -- 172.21.15.55:0/1674542908 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf40af980 con 0x7f3bfc0b2e40 2023-08-25T04:22:10.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.625+0000 7f3c03dd2640 1 -- 172.21.15.55:0/1674542908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bfc0b2e40 msgr2=0x7f3bfc0b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:10.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.625+0000 7f3c03dd2640 1 --2- 172.21.15.55:0/1674542908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bfc0b2e40 0x7f3bfc0b32d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009d90 tx=0x7f3bf401f130 comp rx=0 tx=0).stop 2023-08-25T04:22:10.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.625+0000 7f3c03dd2640 1 -- 172.21.15.55:0/1674542908 shutdown_connections 2023-08-25T04:22:10.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.625+0000 7f3c03dd2640 1 --2- 172.21.15.55:0/1674542908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bfc0b2e40 0x7f3bfc0b32d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.625+0000 7f3c03dd2640 1 --2- 172.21.15.55:0/1674542908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bfc0cdde0 0x7f3bfc0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.625+0000 7f3c03dd2640 1 -- 172.21.15.55:0/1674542908 >> 172.21.15.55:0/1674542908 conn(0x7f3bfc09bae0 msgr2=0x7f3bfc0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:10.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.625+0000 7f3c03dd2640 1 -- 172.21.15.55:0/1674542908 shutdown_connections 2023-08-25T04:22:10.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.625+0000 7f3c03dd2640 1 -- 172.21.15.55:0/1674542908 wait complete. 2023-08-25T04:22:10.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.625+0000 7f3c03dd2640 1 Processor -- start 2023-08-25T04:22:10.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.625+0000 7f3c03dd2640 1 -- start start 2023-08-25T04:22:10.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.625+0000 7f3c03dd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bfc0b2e40 0x7f3bfc14faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:10.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.625+0000 7f3c03dd2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bfc0cdde0 0x7f3bfc0c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:10.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.625+0000 7f3c03dd2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bfc0d0da0 0x7f3bfc0c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.625+0000 7f3c03dd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc150030 con 0x7f3bfc0b2e40 2023-08-25T04:22:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.625+0000 7f3c03dd2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc159b40 con 0x7f3bfc0cdde0 2023-08-25T04:22:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.625+0000 7f3c03dd2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc0ca6c0 con 0x7f3bfc0d0da0 2023-08-25T04:22:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.629+0000 7f3c01b6e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bfc0b2e40 0x7f3bfc14faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.629+0000 7f3c01b6e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bfc0b2e40 0x7f3bfc14faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39160/0 (socket says 172.21.15.55:39160) 2023-08-25T04:22:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.629+0000 7f3c01b6e640 1 -- 172.21.15.55:0/4236329529 learned_addr learned my addr 172.21.15.55:0/4236329529 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:10.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.629+0000 7f3c0136d640 1 --2- 172.21.15.55:0/4236329529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bfc0cdde0 0x7f3bfc0c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.629+0000 7f3c0236f640 1 --2- 172.21.15.55:0/4236329529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bfc0d0da0 0x7f3bfc0c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.629+0000 7f3c01b6e640 1 -- 172.21.15.55:0/4236329529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bfc0d0da0 msgr2=0x7f3bfc0c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.629+0000 7f3c01b6e640 1 --2- 172.21.15.55:0/4236329529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bfc0d0da0 0x7f3bfc0c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.629+0000 7f3c01b6e640 1 -- 172.21.15.55:0/4236329529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bfc0cdde0 msgr2=0x7f3bfc0c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.629+0000 7f3c01b6e640 1 --2- 172.21.15.55:0/4236329529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bfc0cdde0 0x7f3bfc0c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.629+0000 7f3c01b6e640 1 -- 172.21.15.55:0/4236329529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf4009a70 con 0x7f3bfc0b2e40 2023-08-25T04:22:10.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.629+0000 7f3c01b6e640 1 --2- 172.21.15.55:0/4236329529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bfc0b2e40 0x7f3bfc14faf0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8001270 tx=0x7f3bf800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:10.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.629+0000 7f3bf27fc640 1 -- 172.21.15.55:0/4236329529 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8007270 con 0x7f3bfc0b2e40 2023-08-25T04:22:10.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.629+0000 7f3bf27fc640 1 -- 172.21.15.55:0/4236329529 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf80073d0 con 0x7f3bfc0b2e40 2023-08-25T04:22:10.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.629+0000 7f3c03dd2640 1 -- 172.21.15.55:0/4236329529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bfc0ca3e0 con 0x7f3bfc0b2e40 2023-08-25T04:22:10.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.629+0000 7f3bf27fc640 1 -- 172.21.15.55:0/4236329529 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf800ce50 con 0x7f3bfc0b2e40 2023-08-25T04:22:10.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.629+0000 7f3c03dd2640 1 -- 172.21.15.55:0/4236329529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bfc1597d0 con 0x7f3bfc0b2e40 2023-08-25T04:22:10.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.629+0000 7f3c03dd2640 1 -- 172.21.15.55:0/4236329529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bfc159350 con 0x7f3bfc0b2e40 2023-08-25T04:22:10.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.633+0000 7f3bf27fc640 1 -- 172.21.15.55:0/4236329529 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 66) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f3bf80057b0 con 0x7f3bfc0b2e40 2023-08-25T04:22:10.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.633+0000 7f3bf27fc640 1 --2- 172.21.15.55:0/4236329529 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f3be0065710 0x7f3be0067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:10.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.633+0000 7f3bf27fc640 1 -- 172.21.15.55:0/4236329529 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6892+0+0 (secure 0 0 0) 0x7f3bf8082840 con 0x7f3bfc0b2e40 2023-08-25T04:22:10.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.633+0000 7f3c0136d640 1 --2- 172.21.15.55:0/4236329529 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f3be0065710 0x7f3be0067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:10.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.633+0000 7f3c0136d640 1 --2- 172.21.15.55:0/4236329529 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f3be0065710 0x7f3be0067bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc1f5050 tx=0x7f3bec008040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:10.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.637+0000 7f3bf27fc640 1 -- 172.21.15.55:0/4236329529 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3bfc159350 con 0x7f3bfc0b2e40 2023-08-25T04:22:10.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.825+0000 7f3c03dd2640 1 -- 172.21.15.55:0/4236329529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3bfc159350 con 0x7f3bfc0b2e40 2023-08-25T04:22:10.831 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-08-25T04:22:10.829+0000 7f7f18c38640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-25T04:22:10.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.849+0000 7f3bf27fc640 1 -- 172.21.15.55:0/4236329529 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3bfc159350 con 0x7f3bfc0b2e40 2023-08-25T04:22:10.850 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-25T04:22:10.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.853+0000 7f3c03dd2640 1 -- 172.21.15.55:0/4236329529 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f3be0065710 msgr2=0x7f3be0067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:10.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.853+0000 7f3c03dd2640 1 --2- 172.21.15.55:0/4236329529 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f3be0065710 0x7f3be0067bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc1f5050 tx=0x7f3bec008040 comp rx=0 tx=0).stop 2023-08-25T04:22:10.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.853+0000 7f3c03dd2640 1 -- 172.21.15.55:0/4236329529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bfc0b2e40 msgr2=0x7f3bfc14faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:10.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.853+0000 7f3c03dd2640 1 --2- 172.21.15.55:0/4236329529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bfc0b2e40 0x7f3bfc14faf0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8001270 tx=0x7f3bf800cb10 comp rx=0 tx=0).stop 2023-08-25T04:22:10.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.853+0000 7f3c03dd2640 1 -- 172.21.15.55:0/4236329529 shutdown_connections 2023-08-25T04:22:10.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.853+0000 7f3c03dd2640 1 --2- 172.21.15.55:0/4236329529 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f3be0065710 0x7f3be0067bd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.853+0000 7f3c03dd2640 1 --2- 172.21.15.55:0/4236329529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bfc0d0da0 0x7f3bfc0c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.853+0000 7f3c03dd2640 1 --2- 172.21.15.55:0/4236329529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bfc0cdde0 0x7f3bfc0c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.853+0000 7f3c03dd2640 1 --2- 172.21.15.55:0/4236329529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bfc0b2e40 0x7f3bfc14faf0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:10.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.853+0000 7f3c03dd2640 1 -- 172.21.15.55:0/4236329529 >> 172.21.15.55:0/4236329529 conn(0x7f3bfc09bae0 msgr2=0x7f3bfc151e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:10.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.853+0000 7f3c03dd2640 1 -- 172.21.15.55:0/4236329529 shutdown_connections 2023-08-25T04:22:10.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:10.853+0000 7f3c03dd2640 1 -- 172.21.15.55:0/4236329529 wait complete. 2023-08-25T04:22:10.861 INFO:tasks.ceph.mds.c.smithi055.stderr: -7232> 2023-08-25T04:21:28.855+0000 7fbc0cbe2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T04:22:10.873 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-25T04:22:10.916 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T04:22:11.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.021+0000 7f357b996640 1 Processor -- start 2023-08-25T04:22:11.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.021+0000 7f357b996640 1 -- start start 2023-08-25T04:22:11.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.025+0000 7f357b996640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3574164b30 0x7f357406c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:11.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.025+0000 7f357b996640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3574161440 con 0x7f35740c1aa0 2023-08-25T04:22:11.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.025+0000 7f357b996640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357406cb20 con 0x7f35740ad7b0 2023-08-25T04:22:11.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.025+0000 7f357b996640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357406ce00 con 0x7f3574164b30 2023-08-25T04:22:11.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.025+0000 7f3579f33640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3574164b30 0x7f357406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:11.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.025+0000 7f3579f33640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3574164b30 0x7f357406c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39182/0 (socket says 172.21.15.55:39182) 2023-08-25T04:22:11.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.025+0000 7f3578f31640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f35740c1aa0 0x7f35740c9b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40964/0 (socket says 172.21.15.55:40964) 2023-08-25T04:22:11.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.025+0000 7f3579f33640 1 -- 172.21.15.55:0/3699515488 learned_addr learned my addr 172.21.15.55:0/3699515488 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:11.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.025+0000 7f3579f33640 1 -- 172.21.15.55:0/3699515488 >> v1:172.21.15.110:6789/0 conn(0x7f35740ad7b0 legacy=0x7f35740c1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:11.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.025+0000 7f3579f33640 1 -- 172.21.15.55:0/3699515488 >> v1:172.21.15.55:6789/0 conn(0x7f35740c1aa0 legacy=0x7f35740c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:11.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.025+0000 7f3579f33640 1 -- 172.21.15.55:0/3699515488 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357406d0e0 con 0x7f3574164b30 2023-08-25T04:22:11.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.025+0000 7f356bfff640 1 -- 172.21.15.55:0/3699515488 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064811641 0 0) 0x7f3574161440 con 0x7f35740c1aa0 2023-08-25T04:22:11.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f3579f33640 1 --2- 172.21.15.55:0/3699515488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3574164b30 0x7f357406c540 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f356c009e50 tx=0x7f356c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5ffc4f2fdbff6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:11.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f356bfff640 1 -- 172.21.15.55:0/3699515488 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0af400 con 0x7f3574164b30 2023-08-25T04:22:11.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f356bfff640 1 -- 172.21.15.55:0/3699515488 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c0ab050 con 0x7f3574164b30 2023-08-25T04:22:11.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f356bfff640 1 -- 172.21.15.55:0/3699515488 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0af780 con 0x7f3574164b30 2023-08-25T04:22:11.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f357b996640 1 -- 172.21.15.55:0/3699515488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3574164b30 msgr2=0x7f357406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:11.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f357b996640 1 --2- 172.21.15.55:0/3699515488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3574164b30 0x7f357406c540 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f356c009e50 tx=0x7f356c01f1c0 comp rx=0 tx=0).stop 2023-08-25T04:22:11.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f357b996640 1 -- 172.21.15.55:0/3699515488 shutdown_connections 2023-08-25T04:22:11.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f357b996640 1 --2- 172.21.15.55:0/3699515488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3574164b30 0x7f357406c540 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:11.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f357b996640 1 -- 172.21.15.55:0/3699515488 >> 172.21.15.55:0/3699515488 conn(0x7f3574069900 msgr2=0x7f3574069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:11.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f357b996640 1 -- 172.21.15.55:0/3699515488 shutdown_connections 2023-08-25T04:22:11.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f357b996640 1 -- 172.21.15.55:0/3699515488 wait complete. 2023-08-25T04:22:11.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f357b996640 1 Processor -- start 2023-08-25T04:22:11.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f357b996640 1 -- start start 2023-08-25T04:22:11.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f357b996640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35740ad7b0 0x7f35740c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:11.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f357b996640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35740c1aa0 0x7f35740b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:11.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f357b996640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3574164b30 0x7f35740ac020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:11.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f357b996640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35741f7550 con 0x7f35740c1aa0 2023-08-25T04:22:11.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f357b996640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357415ed70 con 0x7f35740ad7b0 2023-08-25T04:22:11.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.029+0000 7f357b996640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35741f6940 con 0x7f3574164b30 2023-08-25T04:22:11.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.033+0000 7f3578f31640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35740c1aa0 0x7f35740b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:11.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.033+0000 7f3578f31640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35740c1aa0 0x7f35740b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39196/0 (socket says 172.21.15.55:39196) 2023-08-25T04:22:11.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.033+0000 7f3578f31640 1 -- 172.21.15.55:0/2070382635 learned_addr learned my addr 172.21.15.55:0/2070382635 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:11.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.033+0000 7f3579732640 1 --2- 172.21.15.55:0/2070382635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35740ad7b0 0x7f35740c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:11.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.033+0000 7f3579f33640 1 --2- 172.21.15.55:0/2070382635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3574164b30 0x7f35740ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:11.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.033+0000 7f3578f31640 1 -- 172.21.15.55:0/2070382635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3574164b30 msgr2=0x7f35740ac020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:11.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.033+0000 7f3578f31640 1 --2- 172.21.15.55:0/2070382635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3574164b30 0x7f35740ac020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:11.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.033+0000 7f3578f31640 1 -- 172.21.15.55:0/2070382635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35740ad7b0 msgr2=0x7f35740c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:11.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.033+0000 7f3578f31640 1 --2- 172.21.15.55:0/2070382635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35740ad7b0 0x7f35740c43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:11.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.033+0000 7f3578f31640 1 -- 172.21.15.55:0/2070382635 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c009b30 con 0x7f35740c1aa0 2023-08-25T04:22:11.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.033+0000 7f3578f31640 1 --2- 172.21.15.55:0/2070382635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35740c1aa0 0x7f35740b06c0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f35640011f0 tx=0x7f356400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:11.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.033+0000 7f3569ffb640 1 -- 172.21.15.55:0/2070382635 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35640074e0 con 0x7f35740c1aa0 2023-08-25T04:22:11.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.033+0000 7f3569ffb640 1 -- 172.21.15.55:0/2070382635 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3564007640 con 0x7f35740c1aa0 2023-08-25T04:22:11.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.033+0000 7f3569ffb640 1 -- 172.21.15.55:0/2070382635 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564004a10 con 0x7f35740c1aa0 2023-08-25T04:22:11.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.033+0000 7f357b996640 1 -- 172.21.15.55:0/2070382635 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35741f6c20 con 0x7f35740c1aa0 2023-08-25T04:22:11.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.033+0000 7f357b996640 1 -- 172.21.15.55:0/2070382635 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35741f71e0 con 0x7f35740c1aa0 2023-08-25T04:22:11.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.033+0000 7f357b996640 1 -- 172.21.15.55:0/2070382635 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357415cf90 con 0x7f35740c1aa0 2023-08-25T04:22:11.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.033+0000 7f3569ffb640 1 -- 172.21.15.55:0/2070382635 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 66) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f3564004b70 con 0x7f35740c1aa0 2023-08-25T04:22:11.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.037+0000 7f3569ffb640 1 --2- 172.21.15.55:0/2070382635 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f3558065740 0x7f3558067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:11.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.037+0000 7f3569ffb640 1 -- 172.21.15.55:0/2070382635 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6922+0+0 (secure 0 0 0) 0x7f3564082290 con 0x7f35740c1aa0 2023-08-25T04:22:11.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.037+0000 7f3579732640 1 --2- 172.21.15.55:0/2070382635 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f3558065740 0x7f3558067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:11.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.037+0000 7f3579732640 1 --2- 172.21.15.55:0/2070382635 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f3558065740 0x7f3558067c00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3570004fc0 tx=0x7f3570007e90 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:11.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.041+0000 7f3569ffb640 1 -- 172.21.15.55:0/2070382635 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f357415cf90 con 0x7f35740c1aa0 2023-08-25T04:22:11.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.229+0000 7f357b996640 1 -- 172.21.15.55:0/2070382635 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3574073ec0 con 0x7f35740c1aa0 2023-08-25T04:22:11.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.857+0000 7f3569ffb640 1 -- 172.21.15.55:0/2070382635 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f356404fe80 con 0x7f35740c1aa0 2023-08-25T04:22:11.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.861+0000 7f3569ffb640 1 -- 172.21.15.55:0/2070382635 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) v1 ==== 104+0+0 (secure 0 0 0) 0x7f356404fab0 con 0x7f35740c1aa0 2023-08-25T04:22:11.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.861+0000 7f357b996640 1 -- 172.21.15.55:0/2070382635 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f3558065740 msgr2=0x7f3558067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:11.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.861+0000 7f357b996640 1 --2- 172.21.15.55:0/2070382635 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f3558065740 0x7f3558067c00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3570004fc0 tx=0x7f3570007e90 comp rx=0 tx=0).stop 2023-08-25T04:22:11.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.861+0000 7f357b996640 1 -- 172.21.15.55:0/2070382635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35740c1aa0 msgr2=0x7f35740b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:11.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.861+0000 7f357b996640 1 --2- 172.21.15.55:0/2070382635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35740c1aa0 0x7f35740b06c0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f35640011f0 tx=0x7f356400c9b0 comp rx=0 tx=0).stop 2023-08-25T04:22:11.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.861+0000 7f357b996640 1 -- 172.21.15.55:0/2070382635 shutdown_connections 2023-08-25T04:22:11.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.861+0000 7f357b996640 1 --2- 172.21.15.55:0/2070382635 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f3558065740 0x7f3558067c00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:11.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.861+0000 7f357b996640 1 --2- 172.21.15.55:0/2070382635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3574164b30 0x7f35740ac020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:11.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.861+0000 7f357b996640 1 --2- 172.21.15.55:0/2070382635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35740c1aa0 0x7f35740b06c0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:11.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.861+0000 7f357b996640 1 --2- 172.21.15.55:0/2070382635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35740ad7b0 0x7f35740c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:11.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.861+0000 7f357b996640 1 -- 172.21.15.55:0/2070382635 >> 172.21.15.55:0/2070382635 conn(0x7f3574069900 msgr2=0x7f3574164f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:11.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.861+0000 7f357b996640 1 -- 172.21.15.55:0/2070382635 shutdown_connections 2023-08-25T04:22:11.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:11.861+0000 7f357b996640 1 -- 172.21.15.55:0/2070382635 wait complete. 2023-08-25T04:22:11.884 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-25T04:22:12.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.085+0000 7fb551503640 1 Processor -- start 2023-08-25T04:22:12.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.085+0000 7fb551503640 1 -- start start 2023-08-25T04:22:12.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.085+0000 7fb551503640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb54c15cb40 0x7fb54c0d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:12.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.085+0000 7fb551503640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb54c0b59f0 0x7fb54c0b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:12.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.085+0000 7fb551503640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54c0d1970 con 0x7fb54c0cf340 2023-08-25T04:22:12.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.085+0000 7fb551503640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c0d0d80 con 0x7fb54c0b59f0 2023-08-25T04:22:12.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.085+0000 7fb551503640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0d1040 con 0x7fb54c15cb40 2023-08-25T04:22:12.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.085+0000 7fb54b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb54c0b59f0 0x7fb54c0b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:12.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.085+0000 7fb54b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb54c0b59f0 0x7fb54c0b5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39202/0 (socket says 172.21.15.55:39202) 2023-08-25T04:22:12.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.085+0000 7fb54b7fe640 1 -- 172.21.15.55:0/3607826620 learned_addr learned my addr 172.21.15.55:0/3607826620 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:12.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.085+0000 7fb54affd640 1 --2- 172.21.15.55:0/3607826620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb54c15cb40 0x7fb54c0d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:12.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.085+0000 7fb54b7fe640 1 -- 172.21.15.55:0/3607826620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb54c15cb40 msgr2=0x7fb54c0d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:12.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.085+0000 7fb54b7fe640 1 --2- 172.21.15.55:0/3607826620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb54c15cb40 0x7fb54c0d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:12.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.085+0000 7fb54b7fe640 1 -- 172.21.15.55:0/3607826620 >> v1:172.21.15.55:6789/0 conn(0x7fb54c0cf340 legacy=0x7fb54c0cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:12.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.085+0000 7fb54b7fe640 1 -- 172.21.15.55:0/3607826620 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c0d1320 con 0x7fb54c0b59f0 2023-08-25T04:22:12.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.085+0000 7fb54a7fc640 1 -- 172.21.15.55:0/3607826620 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847056051 0 0) 0x7fb54c0d1970 con 0x7fb54c0cf340 2023-08-25T04:22:12.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.089+0000 7fb54b7fe640 1 --2- 172.21.15.55:0/3607826620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb54c0b59f0 0x7fb54c0b5e60 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fb544009e50 tx=0x7fb54401f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4253b0eaffbaaf90 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:12.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.089+0000 7fb54a7fc640 1 -- 172.21.15.55:0/3607826620 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440af400 con 0x7fb54c0b59f0 2023-08-25T04:22:12.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.089+0000 7fb54a7fc640 1 -- 172.21.15.55:0/3607826620 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5440ab050 con 0x7fb54c0b59f0 2023-08-25T04:22:12.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.089+0000 7fb54a7fc640 1 -- 172.21.15.55:0/3607826620 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440af780 con 0x7fb54c0b59f0 2023-08-25T04:22:12.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.089+0000 7fb551503640 1 -- 172.21.15.55:0/3607826620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb54c0b59f0 msgr2=0x7fb54c0b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:12.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.089+0000 7fb551503640 1 --2- 172.21.15.55:0/3607826620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb54c0b59f0 0x7fb54c0b5e60 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fb544009e50 tx=0x7fb54401f1f0 comp rx=0 tx=0).stop 2023-08-25T04:22:12.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.089+0000 7fb551503640 1 -- 172.21.15.55:0/3607826620 shutdown_connections 2023-08-25T04:22:12.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.089+0000 7fb551503640 1 --2- 172.21.15.55:0/3607826620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb54c0b59f0 0x7fb54c0b5e60 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:12.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.089+0000 7fb551503640 1 --2- 172.21.15.55:0/3607826620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb54c15cb40 0x7fb54c0d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:12.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.089+0000 7fb551503640 1 -- 172.21.15.55:0/3607826620 >> 172.21.15.55:0/3607826620 conn(0x7fb54c06aae0 msgr2=0x7fb54c06aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:12.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.089+0000 7fb551503640 1 -- 172.21.15.55:0/3607826620 shutdown_connections 2023-08-25T04:22:12.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.089+0000 7fb551503640 1 -- 172.21.15.55:0/3607826620 wait complete. 2023-08-25T04:22:12.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb551503640 1 Processor -- start 2023-08-25T04:22:12.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb551503640 1 -- start start 2023-08-25T04:22:12.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb551503640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb54c0b59f0 0x7fb54c15df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:12.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb551503640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb54c0cf340 0x7fb54c14dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:12.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb551503640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb54c15cb40 0x7fb54c0c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:12.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb551503640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c15cf20 con 0x7fb54c0b59f0 2023-08-25T04:22:12.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb551503640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c15daa0 con 0x7fb54c15cb40 2023-08-25T04:22:12.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb551503640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c15d170 con 0x7fb54c0cf340 2023-08-25T04:22:12.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb54affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb54c0b59f0 0x7fb54c15df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:12.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb54affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb54c0b59f0 0x7fb54c15df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39212/0 (socket says 172.21.15.55:39212) 2023-08-25T04:22:12.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb54affd640 1 -- 172.21.15.55:0/3305476754 learned_addr learned my addr 172.21.15.55:0/3305476754 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:12.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb54affd640 1 -- 172.21.15.55:0/3305476754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb54c0cf340 msgr2=0x7fb54c14dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:12.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb54affd640 1 --2- 172.21.15.55:0/3305476754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb54c0cf340 0x7fb54c14dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:12.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb54affd640 1 -- 172.21.15.55:0/3305476754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb54c15cb40 msgr2=0x7fb54c0c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:12.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb54affd640 1 --2- 172.21.15.55:0/3305476754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb54c15cb40 0x7fb54c0c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:12.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb54affd640 1 -- 172.21.15.55:0/3305476754 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb544009b30 con 0x7fb54c0b59f0 2023-08-25T04:22:12.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb54affd640 1 --2- 172.21.15.55:0/3305476754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb54c0b59f0 0x7fb54c15df30 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fb53c00d830 tx=0x7fb53c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:12.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb543fff640 1 -- 172.21.15.55:0/3305476754 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c00b6c0 con 0x7fb54c0b59f0 2023-08-25T04:22:12.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb543fff640 1 -- 172.21.15.55:0/3305476754 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53c00b820 con 0x7fb54c0b59f0 2023-08-25T04:22:12.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb543fff640 1 -- 172.21.15.55:0/3305476754 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c00bb90 con 0x7fb54c0b59f0 2023-08-25T04:22:12.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb551503640 1 -- 172.21.15.55:0/3305476754 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c15d450 con 0x7fb54c0b59f0 2023-08-25T04:22:12.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.093+0000 7fb551503640 1 -- 172.21.15.55:0/3305476754 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c14e270 con 0x7fb54c0b59f0 2023-08-25T04:22:12.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.097+0000 7fb551503640 1 -- 172.21.15.55:0/3305476754 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54c071f80 con 0x7fb54c0b59f0 2023-08-25T04:22:12.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.097+0000 7fb543fff640 1 -- 172.21.15.55:0/3305476754 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fb53c01e460 con 0x7fb54c0b59f0 2023-08-25T04:22:12.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.097+0000 7fb543fff640 1 --2- 172.21.15.55:0/3305476754 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb52c0657a0 0x7fb52c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:12.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.097+0000 7fb543fff640 1 -- 172.21.15.55:0/3305476754 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6922+0+0 (secure 0 0 0) 0x7fb53c083ab0 con 0x7fb54c0b59f0 2023-08-25T04:22:12.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.097+0000 7fb5427fc640 1 --2- 172.21.15.55:0/3305476754 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb52c0657a0 0x7fb52c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:12.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.097+0000 7fb5427fc640 1 --2- 172.21.15.55:0/3305476754 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb52c0657a0 0x7fb52c067c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb534007fd0 tx=0x7fb534007940 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:12.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.101+0000 7fb543fff640 1 -- 172.21.15.55:0/3305476754 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb53c0510f0 con 0x7fb54c0b59f0 2023-08-25T04:22:12.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.257+0000 7fb551503640 1 -- 172.21.15.55:0/3305476754 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb54c04dbe0 con 0x7fb54c0b59f0 2023-08-25T04:22:12.861 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-08-25T04:22:12.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.861+0000 7fb543fff640 1 -- 172.21.15.55:0/3305476754 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v127) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb53c054710 con 0x7fb54c0b59f0 2023-08-25T04:22:12.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.865+0000 7fb551503640 1 -- 172.21.15.55:0/3305476754 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb52c0657a0 msgr2=0x7fb52c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:12.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.865+0000 7fb551503640 1 --2- 172.21.15.55:0/3305476754 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb52c0657a0 0x7fb52c067c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb534007fd0 tx=0x7fb534007940 comp rx=0 tx=0).stop 2023-08-25T04:22:12.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.865+0000 7fb551503640 1 -- 172.21.15.55:0/3305476754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb54c0b59f0 msgr2=0x7fb54c15df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:12.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.865+0000 7fb551503640 1 --2- 172.21.15.55:0/3305476754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb54c0b59f0 0x7fb54c15df30 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fb53c00d830 tx=0x7fb53c00dcf0 comp rx=0 tx=0).stop 2023-08-25T04:22:12.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.865+0000 7fb551503640 1 -- 172.21.15.55:0/3305476754 shutdown_connections 2023-08-25T04:22:12.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.865+0000 7fb551503640 1 --2- 172.21.15.55:0/3305476754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb54c15cb40 0x7fb54c0c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:12.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.865+0000 7fb551503640 1 --2- 172.21.15.55:0/3305476754 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb52c0657a0 0x7fb52c067c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:12.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.865+0000 7fb551503640 1 --2- 172.21.15.55:0/3305476754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb54c0cf340 0x7fb54c14dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:12.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.865+0000 7fb551503640 1 --2- 172.21.15.55:0/3305476754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb54c0b59f0 0x7fb54c15df30 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:12.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.865+0000 7fb551503640 1 -- 172.21.15.55:0/3305476754 >> 172.21.15.55:0/3305476754 conn(0x7fb54c06aae0 msgr2=0x7fb54c15be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:12.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.865+0000 7fb551503640 1 -- 172.21.15.55:0/3305476754 shutdown_connections 2023-08-25T04:22:12.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:12.865+0000 7fb551503640 1 -- 172.21.15.55:0/3305476754 wait complete. 2023-08-25T04:22:12.888 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-25T04:22:13.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.041+0000 7f2b9e8cb640 1 Processor -- start 2023-08-25T04:22:13.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.041+0000 7f2b9e8cb640 1 -- start start 2023-08-25T04:22:13.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.045+0000 7f2b9e8cb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2b980ca4a0 0x7f2b9815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:13.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.045+0000 7f2b9e8cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b9806a010 0x7f2b98153110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:13.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.045+0000 7f2b9e8cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9815aa00 con 0x7f2b980ca880 2023-08-25T04:22:13.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.045+0000 7f2b9e8cb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b980cc970 con 0x7f2b980ca4a0 2023-08-25T04:22:13.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.045+0000 7f2b9e8cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b980ccc50 con 0x7f2b9806a010 2023-08-25T04:22:13.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.045+0000 7f2b977fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2b980ca880 0x7f2b98069900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40988/0 (socket says 172.21.15.55:40988) 2023-08-25T04:22:13.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.045+0000 7f2b977fe640 1 -- 172.21.15.55:0/2450868837 learned_addr learned my addr 172.21.15.55:0/2450868837 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:13.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.045+0000 7f2b9ce68640 1 --2- 172.21.15.55:0/2450868837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b9806a010 0x7f2b98153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:13.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.045+0000 7f2b97fff640 1 --2- 172.21.15.55:0/2450868837 >> v2:172.21.15.110:3300/0 conn(0x7f2b980ca4a0 0x7f2b9815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:13.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.045+0000 7f2b97fff640 1 -- 172.21.15.55:0/2450868837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b9806a010 msgr2=0x7f2b98153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:13.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.045+0000 7f2b97fff640 1 --2- 172.21.15.55:0/2450868837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b9806a010 0x7f2b98153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:13.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.045+0000 7f2b97fff640 1 -- 172.21.15.55:0/2450868837 >> v1:172.21.15.55:6789/0 conn(0x7f2b980ca880 legacy=0x7f2b98069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:13.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.045+0000 7f2b96ffd640 1 -- 172.21.15.55:0/2450868837 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291844178 0 0) 0x7f2b9815aa00 con 0x7f2b980ca880 2023-08-25T04:22:13.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.045+0000 7f2b97fff640 1 -- 172.21.15.55:0/2450868837 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b980ccf30 con 0x7f2b980ca4a0 2023-08-25T04:22:13.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.045+0000 7f2b9ce68640 1 --2- 172.21.15.55:0/2450868837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b9806a010 0x7f2b98153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:22:13.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.049+0000 7f2b97fff640 1 --2- 172.21.15.55:0/2450868837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b980ca4a0 0x7f2b9815a4c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009c80 tx=0x7f2b8801c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c02e7fdd58e26280 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:13.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.049+0000 7f2b96ffd640 1 -- 172.21.15.55:0/2450868837 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b880a5960 con 0x7f2b980ca4a0 2023-08-25T04:22:13.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.049+0000 7f2b96ffd640 1 -- 172.21.15.55:0/2450868837 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b880a5ac0 con 0x7f2b980ca4a0 2023-08-25T04:22:13.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.049+0000 7f2b96ffd640 1 -- 172.21.15.55:0/2450868837 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b880a5e50 con 0x7f2b980ca4a0 2023-08-25T04:22:13.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.049+0000 7f2b9e8cb640 1 -- 172.21.15.55:0/2450868837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b980ca4a0 msgr2=0x7f2b9815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:13.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.049+0000 7f2b9e8cb640 1 --2- 172.21.15.55:0/2450868837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b980ca4a0 0x7f2b9815a4c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009c80 tx=0x7f2b8801c880 comp rx=0 tx=0).stop 2023-08-25T04:22:13.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.049+0000 7f2b9e8cb640 1 -- 172.21.15.55:0/2450868837 shutdown_connections 2023-08-25T04:22:13.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.049+0000 7f2b9e8cb640 1 --2- 172.21.15.55:0/2450868837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b9806a010 0x7f2b98153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:13.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.049+0000 7f2b9e8cb640 1 --2- 172.21.15.55:0/2450868837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b980ca4a0 0x7f2b9815a4c0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:13.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.049+0000 7f2b9e8cb640 1 -- 172.21.15.55:0/2450868837 >> 172.21.15.55:0/2450868837 conn(0x7f2b980caf90 msgr2=0x7f2b980cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:13.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.049+0000 7f2b9e8cb640 1 -- 172.21.15.55:0/2450868837 shutdown_connections 2023-08-25T04:22:13.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.049+0000 7f2b9e8cb640 1 -- 172.21.15.55:0/2450868837 wait complete. 2023-08-25T04:22:13.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b9e8cb640 1 Processor -- start 2023-08-25T04:22:13.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b9e8cb640 1 -- start start 2023-08-25T04:22:13.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b9e8cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b9806a010 0x7f2b98151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:13.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b9e8cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b980ca4a0 0x7f2b98151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:13.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b9e8cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b980ca880 0x7f2b980c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:13.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b9e8cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9814ac70 con 0x7f2b9806a010 2023-08-25T04:22:13.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b9e8cb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9814af50 con 0x7f2b980ca880 2023-08-25T04:22:13.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b9e8cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9814b230 con 0x7f2b980ca4a0 2023-08-25T04:22:13.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b97fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b9806a010 0x7f2b98151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:13.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b97fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b9806a010 0x7f2b98151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39226/0 (socket says 172.21.15.55:39226) 2023-08-25T04:22:13.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b97fff640 1 -- 172.21.15.55:0/2088074394 learned_addr learned my addr 172.21.15.55:0/2088074394 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:13.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b9ce68640 1 --2- 172.21.15.55:0/2088074394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b980ca880 0x7f2b980c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:13.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b977fe640 1 --2- 172.21.15.55:0/2088074394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b980ca4a0 0x7f2b98151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:13.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b97fff640 1 -- 172.21.15.55:0/2088074394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b980ca4a0 msgr2=0x7f2b98151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:13.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b97fff640 1 --2- 172.21.15.55:0/2088074394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b980ca4a0 0x7f2b98151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:13.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b97fff640 1 -- 172.21.15.55:0/2088074394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b980ca880 msgr2=0x7f2b980c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:13.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b97fff640 1 --2- 172.21.15.55:0/2088074394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b980ca880 0x7f2b980c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:13.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b97fff640 1 -- 172.21.15.55:0/2088074394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b90009420 con 0x7f2b9806a010 2023-08-25T04:22:13.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b9ce68640 1 --2- 172.21.15.55:0/2088074394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b980ca880 0x7f2b980c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:13.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b97fff640 1 --2- 172.21.15.55:0/2088074394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b9806a010 0x7f2b98151c50 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f2b8801a4b0 tx=0x7f2b88019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:13.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b94ff9640 1 -- 172.21.15.55:0/2088074394 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b880aee00 con 0x7f2b9806a010 2023-08-25T04:22:13.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b94ff9640 1 -- 172.21.15.55:0/2088074394 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b88009450 con 0x7f2b9806a010 2023-08-25T04:22:13.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b94ff9640 1 -- 172.21.15.55:0/2088074394 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b880b7650 con 0x7f2b9806a010 2023-08-25T04:22:13.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b9e8cb640 1 -- 172.21.15.55:0/2088074394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8800d040 con 0x7f2b9806a010 2023-08-25T04:22:13.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.053+0000 7f2b9e8cb640 1 -- 172.21.15.55:0/2088074394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9814b7f0 con 0x7f2b9806a010 2023-08-25T04:22:13.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.057+0000 7f2b9e8cb640 1 -- 172.21.15.55:0/2088074394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b9814b9e0 con 0x7f2b9806a010 2023-08-25T04:22:13.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.057+0000 7f2b94ff9640 1 -- 172.21.15.55:0/2088074394 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f2b880b4050 con 0x7f2b9806a010 2023-08-25T04:22:13.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.057+0000 7f2b94ff9640 1 --2- 172.21.15.55:0/2088074394 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f2b780657d0 0x7f2b78067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:13.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.057+0000 7f2b94ff9640 1 -- 172.21.15.55:0/2088074394 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6484+0+0 (secure 0 0 0) 0x7f2b8811e4e0 con 0x7f2b9806a010 2023-08-25T04:22:13.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.057+0000 7f2b977fe640 1 --2- 172.21.15.55:0/2088074394 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f2b780657d0 0x7f2b78067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:13.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.057+0000 7f2b977fe640 1 --2- 172.21.15.55:0/2088074394 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f2b780657d0 0x7f2b78067c90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2b981f5540 tx=0x7f2b80007c10 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:13.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.061+0000 7f2b94ff9640 1 -- 172.21.15.55:0/2088074394 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2b880ebd60 con 0x7f2b9806a010 2023-08-25T04:22:13.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.221+0000 7f2b9e8cb640 1 -- 172.21.15.55:0/2088074394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2b9804dbe0 con 0x7f2b9806a010 2023-08-25T04:22:13.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.873+0000 7f2b94ff9640 1 -- 172.21.15.55:0/2088074394 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v128) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2b880b20d0 con 0x7f2b9806a010 2023-08-25T04:22:13.874 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-08-25T04:22:13.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.877+0000 7f2b9e8cb640 1 -- 172.21.15.55:0/2088074394 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f2b780657d0 msgr2=0x7f2b78067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:13.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.877+0000 7f2b9e8cb640 1 --2- 172.21.15.55:0/2088074394 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f2b780657d0 0x7f2b78067c90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2b981f5540 tx=0x7f2b80007c10 comp rx=0 tx=0).stop 2023-08-25T04:22:13.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.877+0000 7f2b9e8cb640 1 -- 172.21.15.55:0/2088074394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b9806a010 msgr2=0x7f2b98151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:13.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.877+0000 7f2b9e8cb640 1 --2- 172.21.15.55:0/2088074394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b9806a010 0x7f2b98151c50 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f2b8801a4b0 tx=0x7f2b88019620 comp rx=0 tx=0).stop 2023-08-25T04:22:13.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.877+0000 7f2b9e8cb640 1 -- 172.21.15.55:0/2088074394 shutdown_connections 2023-08-25T04:22:13.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.877+0000 7f2b9e8cb640 1 --2- 172.21.15.55:0/2088074394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2b980ca880 0x7f2b980c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:13.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.877+0000 7f2b9e8cb640 1 --2- 172.21.15.55:0/2088074394 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f2b780657d0 0x7f2b78067c90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:13.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.877+0000 7f2b9e8cb640 1 --2- 172.21.15.55:0/2088074394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2b980ca4a0 0x7f2b98151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:13.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.877+0000 7f2b9e8cb640 1 --2- 172.21.15.55:0/2088074394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b9806a010 0x7f2b98151c50 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:13.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.877+0000 7f2b9e8cb640 1 -- 172.21.15.55:0/2088074394 >> 172.21.15.55:0/2088074394 conn(0x7f2b980caf90 msgr2=0x7f2b98069900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:13.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.877+0000 7f2b9e8cb640 1 -- 172.21.15.55:0/2088074394 shutdown_connections 2023-08-25T04:22:13.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:13.877+0000 7f2b9e8cb640 1 -- 172.21.15.55:0/2088074394 wait complete. 2023-08-25T04:22:13.903 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-08-25T04:22:14.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.049+0000 7fe0ca74a640 1 Processor -- start 2023-08-25T04:22:14.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.049+0000 7fe0ca74a640 1 -- start start 2023-08-25T04:22:14.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.053+0000 7fe0ca74a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe0c415c890 0x7fe0c40cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:14.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.053+0000 7fe0ca74a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0c415d000 0x7fe0c415d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:14.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.053+0000 7fe0ca74a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c40ccdf0 con 0x7fe0c406b8a0 2023-08-25T04:22:14.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.053+0000 7fe0ca74a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c415d980 con 0x7fe0c415c890 2023-08-25T04:22:14.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.053+0000 7fe0ca74a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c40cdce0 con 0x7fe0c415d000 2023-08-25T04:22:14.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.053+0000 7fe0c9748640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe0c415c890 0x7fe0c40cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:14.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.053+0000 7fe0c9748640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe0c415c890 0x7fe0c40cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39242/0 (socket says 172.21.15.55:39242) 2023-08-25T04:22:14.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.053+0000 7fe0c9748640 1 -- 172.21.15.55:0/2222196508 learned_addr learned my addr 172.21.15.55:0/2222196508 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:14.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.053+0000 7fe0c8f47640 1 --2- 172.21.15.55:0/2222196508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0c415d000 0x7fe0c415d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:14.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.053+0000 7fe0c9748640 1 -- 172.21.15.55:0/2222196508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0c415d000 msgr2=0x7fe0c415d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:14.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.053+0000 7fe0c9748640 1 --2- 172.21.15.55:0/2222196508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0c415d000 0x7fe0c415d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.053+0000 7fe0c9748640 1 -- 172.21.15.55:0/2222196508 >> v1:172.21.15.110:6789/0 conn(0x7fe0c406b8a0 legacy=0x7fe0c4070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:14.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.053+0000 7fe0c9748640 1 -- 172.21.15.55:0/2222196508 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c40cbdf0 con 0x7fe0c415c890 2023-08-25T04:22:14.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.057+0000 7fe0c9748640 1 --2- 172.21.15.55:0/2222196508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c415c890 0x7fe0c40cc8b0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009870 tx=0x7fe0c001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a01a5a8043f05a6a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:14.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.057+0000 7fe0bbfff640 1 -- 172.21.15.55:0/2222196508 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c00aa670 con 0x7fe0c415c890 2023-08-25T04:22:14.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.057+0000 7fe0bbfff640 1 -- 172.21.15.55:0/2222196508 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c00aa7d0 con 0x7fe0c415c890 2023-08-25T04:22:14.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.057+0000 7fe0bbfff640 1 -- 172.21.15.55:0/2222196508 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c00aab60 con 0x7fe0c415c890 2023-08-25T04:22:14.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.057+0000 7fe0ca74a640 1 -- 172.21.15.55:0/2222196508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c415c890 msgr2=0x7fe0c40cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:14.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.057+0000 7fe0ca74a640 1 --2- 172.21.15.55:0/2222196508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c415c890 0x7fe0c40cc8b0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009870 tx=0x7fe0c001c510 comp rx=0 tx=0).stop 2023-08-25T04:22:14.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.057+0000 7fe0ca74a640 1 -- 172.21.15.55:0/2222196508 shutdown_connections 2023-08-25T04:22:14.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.057+0000 7fe0ca74a640 1 --2- 172.21.15.55:0/2222196508 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0c415d000 0x7fe0c415d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.057+0000 7fe0ca74a640 1 --2- 172.21.15.55:0/2222196508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c415c890 0x7fe0c40cc8b0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.057+0000 7fe0ca74a640 1 -- 172.21.15.55:0/2222196508 >> 172.21.15.55:0/2222196508 conn(0x7fe0c4069f00 msgr2=0x7fe0c40afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:14.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.057+0000 7fe0ca74a640 1 -- 172.21.15.55:0/2222196508 shutdown_connections 2023-08-25T04:22:14.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.057+0000 7fe0ca74a640 1 -- 172.21.15.55:0/2222196508 wait complete. 2023-08-25T04:22:14.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.057+0000 7fe0ca74a640 1 Processor -- start 2023-08-25T04:22:14.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.057+0000 7fe0ca74a640 1 -- start start 2023-08-25T04:22:14.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0ca74a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c406b8a0 0x7fe0c40c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:14.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0ca74a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0c415c890 0x7fe0c41f92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:14.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0ca74a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0c415d000 0x7fe0c4154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:14.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0ca74a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c40c55b0 con 0x7fe0c406b8a0 2023-08-25T04:22:14.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0ca74a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c41f97e0 con 0x7fe0c415d000 2023-08-25T04:22:14.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0ca74a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c40c7800 con 0x7fe0c415c890 2023-08-25T04:22:14.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0c9748640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c406b8a0 0x7fe0c40c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:14.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0c9748640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c406b8a0 0x7fe0c40c2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39246/0 (socket says 172.21.15.55:39246) 2023-08-25T04:22:14.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0c9748640 1 -- 172.21.15.55:0/2450712132 learned_addr learned my addr 172.21.15.55:0/2450712132 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:14.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0c8f47640 1 --2- 172.21.15.55:0/2450712132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0c415c890 0x7fe0c41f92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:14.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0c9f49640 1 --2- 172.21.15.55:0/2450712132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0c415d000 0x7fe0c4154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:14.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0c9748640 1 -- 172.21.15.55:0/2450712132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0c415c890 msgr2=0x7fe0c41f92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:14.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0c9748640 1 --2- 172.21.15.55:0/2450712132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0c415c890 0x7fe0c41f92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0c9748640 1 -- 172.21.15.55:0/2450712132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0c415d000 msgr2=0x7fe0c4154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:14.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0c9748640 1 --2- 172.21.15.55:0/2450712132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0c415d000 0x7fe0c4154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0c9748640 1 -- 172.21.15.55:0/2450712132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00094d0 con 0x7fe0c406b8a0 2023-08-25T04:22:14.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0c9f49640 1 --2- 172.21.15.55:0/2450712132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0c415d000 0x7fe0c4154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:14.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0c9748640 1 --2- 172.21.15.55:0/2450712132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c406b8a0 0x7fe0c40c2580 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00ac040 tx=0x7fe0c001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:14.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0b9ffb640 1 -- 172.21.15.55:0/2450712132 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c00b3800 con 0x7fe0c406b8a0 2023-08-25T04:22:14.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0b9ffb640 1 -- 172.21.15.55:0/2450712132 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c00b3980 con 0x7fe0c406b8a0 2023-08-25T04:22:14.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0b9ffb640 1 -- 172.21.15.55:0/2450712132 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c00b3d30 con 0x7fe0c406b8a0 2023-08-25T04:22:14.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0ca74a640 1 -- 172.21.15.55:0/2450712132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c40c6f60 con 0x7fe0c406b8a0 2023-08-25T04:22:14.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0ca74a640 1 -- 172.21.15.55:0/2450712132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c40c7520 con 0x7fe0c406b8a0 2023-08-25T04:22:14.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0ca74a640 1 -- 172.21.15.55:0/2450712132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c40c52d0 con 0x7fe0c406b8a0 2023-08-25T04:22:14.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.061+0000 7fe0b9ffb640 1 -- 172.21.15.55:0/2450712132 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fe0c00c6440 con 0x7fe0c406b8a0 2023-08-25T04:22:14.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.065+0000 7fe0b9ffb640 1 --2- 172.21.15.55:0/2450712132 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fe0a80657a0 0x7fe0a8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:14.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.065+0000 7fe0b9ffb640 1 -- 172.21.15.55:0/2450712132 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fe0c011deb0 con 0x7fe0c406b8a0 2023-08-25T04:22:14.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.065+0000 7fe0c8f47640 1 --2- 172.21.15.55:0/2450712132 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fe0a80657a0 0x7fe0a8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:14.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.065+0000 7fe0c8f47640 1 --2- 172.21.15.55:0/2450712132 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fe0a80657a0 0x7fe0a8067c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe0c406b850 tx=0x7fe0b4008040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:14.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.069+0000 7fe0b9ffb640 1 -- 172.21.15.55:0/2450712132 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe0c00eb7e0 con 0x7fe0c406b8a0 2023-08-25T04:22:14.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.225+0000 7fe0ca74a640 1 -- 172.21.15.55:0/2450712132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fe0c4073e50 con 0x7fe0c406b8a0 2023-08-25T04:22:14.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.229+0000 7fe0b9ffb640 1 -- 172.21.15.55:0/2450712132 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v43) v1 ==== 115+0+0 (secure 0 0 0) 0x7fe0c00eee00 con 0x7fe0c406b8a0 2023-08-25T04:22:14.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.233+0000 7fe0ca74a640 1 -- 172.21.15.55:0/2450712132 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fe0a80657a0 msgr2=0x7fe0a8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:14.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.233+0000 7fe0ca74a640 1 --2- 172.21.15.55:0/2450712132 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fe0a80657a0 0x7fe0a8067c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe0c406b850 tx=0x7fe0b4008040 comp rx=0 tx=0).stop 2023-08-25T04:22:14.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.233+0000 7fe0ca74a640 1 -- 172.21.15.55:0/2450712132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c406b8a0 msgr2=0x7fe0c40c2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:14.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.233+0000 7fe0ca74a640 1 --2- 172.21.15.55:0/2450712132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c406b8a0 0x7fe0c40c2580 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00ac040 tx=0x7fe0c001ad50 comp rx=0 tx=0).stop 2023-08-25T04:22:14.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.233+0000 7fe0ca74a640 1 -- 172.21.15.55:0/2450712132 shutdown_connections 2023-08-25T04:22:14.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.233+0000 7fe0ca74a640 1 --2- 172.21.15.55:0/2450712132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0c415d000 0x7fe0c4154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.233+0000 7fe0ca74a640 1 --2- 172.21.15.55:0/2450712132 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fe0a80657a0 0x7fe0a8067c60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.233+0000 7fe0ca74a640 1 --2- 172.21.15.55:0/2450712132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0c415c890 0x7fe0c41f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.233+0000 7fe0ca74a640 1 --2- 172.21.15.55:0/2450712132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0c406b8a0 0x7fe0c40c2580 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.233+0000 7fe0ca74a640 1 -- 172.21.15.55:0/2450712132 >> 172.21.15.55:0/2450712132 conn(0x7fe0c4069f00 msgr2=0x7fe0c40ac810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.233+0000 7fe0ca74a640 1 -- 172.21.15.55:0/2450712132 shutdown_connections 2023-08-25T04:22:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.233+0000 7fe0ca74a640 1 -- 172.21.15.55:0/2450712132 wait complete. 2023-08-25T04:22:14.252 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-25T04:22:14.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.397+0000 7f7e8b59e640 1 Processor -- start 2023-08-25T04:22:14.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.397+0000 7f7e8b59e640 1 -- start start 2023-08-25T04:22:14.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.397+0000 7f7e8b59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e8c15fca0 0x7f7e8c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:14.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.397+0000 7f7e8b59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e8c0b8330 0x7f7e8c0cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:14.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.397+0000 7f7e8b59e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8c0b70c0 con 0x7f7e8c0d0bd0 2023-08-25T04:22:14.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.397+0000 7f7e8b59e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8c160080 con 0x7f7e8c15fca0 2023-08-25T04:22:14.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.397+0000 7f7e8b59e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c0b73a0 con 0x7f7e8c0b8330 2023-08-25T04:22:14.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.397+0000 7f7e8a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e8c15fca0 0x7f7e8c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:14.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.397+0000 7f7e8a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e8c15fca0 0x7f7e8c0cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39258/0 (socket says 172.21.15.55:39258) 2023-08-25T04:22:14.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.397+0000 7f7e8ad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7e8c0d0bd0 0x7f7e8c0d1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40996/0 (socket says 172.21.15.55:40996) 2023-08-25T04:22:14.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.397+0000 7f7e8a59c640 1 -- 172.21.15.55:0/2694046115 learned_addr learned my addr 172.21.15.55:0/2694046115 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:14.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.397+0000 7f7e83fff640 1 --2- 172.21.15.55:0/2694046115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e8c0b8330 0x7f7e8c0cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:14.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.397+0000 7f7e8a59c640 1 -- 172.21.15.55:0/2694046115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e8c0b8330 msgr2=0x7f7e8c0cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:14.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.397+0000 7f7e8a59c640 1 --2- 172.21.15.55:0/2694046115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e8c0b8330 0x7f7e8c0cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.397+0000 7f7e8a59c640 1 -- 172.21.15.55:0/2694046115 >> v1:172.21.15.55:6789/0 conn(0x7f7e8c0d0bd0 legacy=0x7f7e8c0d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:14.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.397+0000 7f7e8a59c640 1 -- 172.21.15.55:0/2694046115 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c0b7680 con 0x7f7e8c15fca0 2023-08-25T04:22:14.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.401+0000 7f7e8a59c640 1 --2- 172.21.15.55:0/2694046115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e8c15fca0 0x7f7e8c0cf580 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009870 tx=0x7f7e7c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89e3645f384e082 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:14.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.401+0000 7f7e89d9b640 1 -- 172.21.15.55:0/2694046115 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0a8a30 con 0x7f7e8c15fca0 2023-08-25T04:22:14.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.401+0000 7f7e89d9b640 1 -- 172.21.15.55:0/2694046115 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c0a8b90 con 0x7f7e8c15fca0 2023-08-25T04:22:14.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.401+0000 7f7e89d9b640 1 -- 172.21.15.55:0/2694046115 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0b0440 con 0x7f7e8c15fca0 2023-08-25T04:22:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.401+0000 7f7e8b59e640 1 -- 172.21.15.55:0/2694046115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e8c15fca0 msgr2=0x7f7e8c0cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.401+0000 7f7e8b59e640 1 --2- 172.21.15.55:0/2694046115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e8c15fca0 0x7f7e8c0cf580 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c009870 tx=0x7f7e7c01ed30 comp rx=0 tx=0).stop 2023-08-25T04:22:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.401+0000 7f7e8b59e640 1 -- 172.21.15.55:0/2694046115 shutdown_connections 2023-08-25T04:22:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.401+0000 7f7e8b59e640 1 --2- 172.21.15.55:0/2694046115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e8c0b8330 0x7f7e8c0cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.401+0000 7f7e8b59e640 1 --2- 172.21.15.55:0/2694046115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e8c15fca0 0x7f7e8c0cf580 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.401+0000 7f7e8b59e640 1 -- 172.21.15.55:0/2694046115 >> 172.21.15.55:0/2694046115 conn(0x7f7e8c0658c0 msgr2=0x7f7e8c065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:14.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.401+0000 7f7e8b59e640 1 -- 172.21.15.55:0/2694046115 shutdown_connections 2023-08-25T04:22:14.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.401+0000 7f7e8b59e640 1 -- 172.21.15.55:0/2694046115 wait complete. 2023-08-25T04:22:14.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8b59e640 1 Processor -- start 2023-08-25T04:22:14.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8b59e640 1 -- start start 2023-08-25T04:22:14.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8b59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e8c0b8330 0x7f7e8c14fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:14.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8b59e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e8c0d0bd0 0x7f7e8c1f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8b59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e8c15fca0 0x7f7e8c154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8b59e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c14f9a0 con 0x7f7e8c0b8330 2023-08-25T04:22:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8b59e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c14ed90 con 0x7f7e8c0d0bd0 2023-08-25T04:22:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8b59e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c14f070 con 0x7f7e8c15fca0 2023-08-25T04:22:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e8c0b8330 0x7f7e8c14fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e8c0b8330 0x7f7e8c14fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39260/0 (socket says 172.21.15.55:39260) 2023-08-25T04:22:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8a59c640 1 -- 172.21.15.55:0/3576824449 learned_addr learned my addr 172.21.15.55:0/3576824449 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:14.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8ad9d640 1 --2- 172.21.15.55:0/3576824449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e8c15fca0 0x7f7e8c154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:14.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e83fff640 1 --2- 172.21.15.55:0/3576824449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e8c0d0bd0 0x7f7e8c1f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:14.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8a59c640 1 -- 172.21.15.55:0/3576824449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e8c15fca0 msgr2=0x7f7e8c154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:14.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8a59c640 1 --2- 172.21.15.55:0/3576824449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e8c15fca0 0x7f7e8c154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8a59c640 1 -- 172.21.15.55:0/3576824449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e8c0d0bd0 msgr2=0x7f7e8c1f1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:14.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8a59c640 1 --2- 172.21.15.55:0/3576824449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e8c0d0bd0 0x7f7e8c1f1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8a59c640 1 -- 172.21.15.55:0/3576824449 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c0094d0 con 0x7f7e8c0b8330 2023-08-25T04:22:14.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e83fff640 1 --2- 172.21.15.55:0/3576824449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e8c0d0bd0 0x7f7e8c1f1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8a59c640 1 --2- 172.21.15.55:0/3576824449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e8c0b8330 0x7f7e8c14fe30 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0b3040 tx=0x7f7e7c01bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e82ffd640 1 -- 172.21.15.55:0/3576824449 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0be070 con 0x7f7e8c0b8330 2023-08-25T04:22:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e82ffd640 1 -- 172.21.15.55:0/3576824449 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c0ba400 con 0x7f7e8c0b8330 2023-08-25T04:22:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e82ffd640 1 -- 172.21.15.55:0/3576824449 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c0ba7d0 con 0x7f7e8c0b8330 2023-08-25T04:22:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8b59e640 1 -- 172.21.15.55:0/3576824449 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8c14f350 con 0x7f7e8c0b8330 2023-08-25T04:22:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.405+0000 7f7e8b59e640 1 -- 172.21.15.55:0/3576824449 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8c14e9d0 con 0x7f7e8c0b8330 2023-08-25T04:22:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.409+0000 7f7e8b59e640 1 -- 172.21.15.55:0/3576824449 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e8c073e50 con 0x7f7e8c0b8330 2023-08-25T04:22:14.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.409+0000 7f7e82ffd640 1 -- 172.21.15.55:0/3576824449 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f7e7c0c3410 con 0x7f7e8c0b8330 2023-08-25T04:22:14.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.409+0000 7f7e82ffd640 1 --2- 172.21.15.55:0/3576824449 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f7e6c0657d0 0x7f7e6c067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:14.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.409+0000 7f7e82ffd640 1 -- 172.21.15.55:0/3576824449 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f7e7c120b40 con 0x7f7e8c0b8330 2023-08-25T04:22:14.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.409+0000 7f7e83fff640 1 --2- 172.21.15.55:0/3576824449 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f7e6c0657d0 0x7f7e6c067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:14.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.409+0000 7f7e83fff640 1 --2- 172.21.15.55:0/3576824449 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f7e6c0657d0 0x7f7e6c067c90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0d3320 tx=0x7f7e74008040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:14.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.413+0000 7f7e82ffd640 1 -- 172.21.15.55:0/3576824449 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7e7c0ee4d0 con 0x7f7e8c0b8330 2023-08-25T04:22:14.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.581+0000 7f7e8b59e640 1 -- 172.21.15.55:0/3576824449 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f7e8c0b8110 con 0x7f7e8c0b8330 2023-08-25T04:22:14.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.589+0000 7f7e82ffd640 1 -- 172.21.15.55:0/3576824449 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v44) v1 ==== 120+0+0 (secure 0 0 0) 0x7f7e7c0f1af0 con 0x7f7e8c0b8330 2023-08-25T04:22:14.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.589+0000 7f7e8b59e640 1 -- 172.21.15.55:0/3576824449 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f7e6c0657d0 msgr2=0x7f7e6c067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:14.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.589+0000 7f7e8b59e640 1 --2- 172.21.15.55:0/3576824449 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f7e6c0657d0 0x7f7e6c067c90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0d3320 tx=0x7f7e74008040 comp rx=0 tx=0).stop 2023-08-25T04:22:14.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.589+0000 7f7e8b59e640 1 -- 172.21.15.55:0/3576824449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e8c0b8330 msgr2=0x7f7e8c14fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:14.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.589+0000 7f7e8b59e640 1 --2- 172.21.15.55:0/3576824449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e8c0b8330 0x7f7e8c14fe30 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0b3040 tx=0x7f7e7c01bad0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.589+0000 7f7e8b59e640 1 -- 172.21.15.55:0/3576824449 shutdown_connections 2023-08-25T04:22:14.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.589+0000 7f7e8b59e640 1 --2- 172.21.15.55:0/3576824449 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f7e6c0657d0 0x7f7e6c067c90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.589+0000 7f7e8b59e640 1 --2- 172.21.15.55:0/3576824449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e8c15fca0 0x7f7e8c154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.589+0000 7f7e8b59e640 1 --2- 172.21.15.55:0/3576824449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e8c0d0bd0 0x7f7e8c1f1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.589+0000 7f7e8b59e640 1 --2- 172.21.15.55:0/3576824449 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e8c0b8330 0x7f7e8c14fe30 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.589+0000 7f7e8b59e640 1 -- 172.21.15.55:0/3576824449 >> 172.21.15.55:0/3576824449 conn(0x7f7e8c0658c0 msgr2=0x7f7e8c0d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:14.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.589+0000 7f7e8b59e640 1 -- 172.21.15.55:0/3576824449 shutdown_connections 2023-08-25T04:22:14.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.589+0000 7f7e8b59e640 1 -- 172.21.15.55:0/3576824449 wait complete. 2023-08-25T04:22:14.609 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-25T04:22:14.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.753+0000 7f48fd367640 1 Processor -- start 2023-08-25T04:22:14.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.753+0000 7f48fd367640 1 -- start start 2023-08-25T04:22:14.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.757+0000 7f48fd367640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48f815a7f0 0x7f48f809bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.757+0000 7f48fd367640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f48f806c020 0x7f48f80acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.757+0000 7f48fd367640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f815abd0 con 0x7f48f80c9830 2023-08-25T04:22:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.757+0000 7f48fd367640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f80c8ab0 con 0x7f48f806c020 2023-08-25T04:22:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.757+0000 7f48fd367640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f80c8d50 con 0x7f48f815a7f0 2023-08-25T04:22:14.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.757+0000 7f48effff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f48f80c9830 0x7f48f8070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41010/0 (socket says 172.21.15.55:41010) 2023-08-25T04:22:14.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.757+0000 7f48effff640 1 -- 172.21.15.55:0/1878999961 learned_addr learned my addr 172.21.15.55:0/1878999961 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:14.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.757+0000 7f48f77fe640 1 --2- 172.21.15.55:0/1878999961 >> v2:172.21.15.55:3300/0 conn(0x7f48f806c020 0x7f48f80acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:14.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.757+0000 7f48f6ffd640 1 --2- 172.21.15.55:0/1878999961 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48f815a7f0 0x7f48f809bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:14.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.757+0000 7f48f67fc640 1 -- 172.21.15.55:0/1878999961 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120204781 0 0) 0x7f48f815abd0 con 0x7f48f80c9830 2023-08-25T04:22:14.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.757+0000 7f48f67fc640 1 -- 172.21.15.55:0/1878999961 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48e4003530 con 0x7f48f80c9830 2023-08-25T04:22:14.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.757+0000 7f48f77fe640 1 -- 172.21.15.55:0/1878999961 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48f815a7f0 msgr2=0x7f48f809bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:14.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.757+0000 7f48f77fe640 1 --2- 172.21.15.55:0/1878999961 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48f815a7f0 0x7f48f809bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.757+0000 7f48f77fe640 1 -- 172.21.15.55:0/1878999961 >> v1:172.21.15.55:6789/0 conn(0x7f48f80c9830 legacy=0x7f48f8070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:14.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.757+0000 7f48f77fe640 1 -- 172.21.15.55:0/1878999961 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f80c9030 con 0x7f48f806c020 2023-08-25T04:22:14.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.761+0000 7f48f77fe640 1 --2- 172.21.15.55:0/1878999961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48f806c020 0x7f48f80acff0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009d90 tx=0x7f48f001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73ea1e524f6580f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:14.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.761+0000 7f48f67fc640 1 -- 172.21.15.55:0/1878999961 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f00a58f0 con 0x7f48f806c020 2023-08-25T04:22:14.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.761+0000 7f48f67fc640 1 -- 172.21.15.55:0/1878999961 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f00a5a50 con 0x7f48f806c020 2023-08-25T04:22:14.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.761+0000 7f48f67fc640 1 -- 172.21.15.55:0/1878999961 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f00a5de0 con 0x7f48f806c020 2023-08-25T04:22:14.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.761+0000 7f48fd367640 1 -- 172.21.15.55:0/1878999961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48f806c020 msgr2=0x7f48f80acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:14.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.761+0000 7f48fd367640 1 --2- 172.21.15.55:0/1878999961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48f806c020 0x7f48f80acff0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009d90 tx=0x7f48f001c920 comp rx=0 tx=0).stop 2023-08-25T04:22:14.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.761+0000 7f48fd367640 1 -- 172.21.15.55:0/1878999961 shutdown_connections 2023-08-25T04:22:14.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.761+0000 7f48fd367640 1 --2- 172.21.15.55:0/1878999961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48f806c020 0x7f48f80acff0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.761+0000 7f48fd367640 1 --2- 172.21.15.55:0/1878999961 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48f815a7f0 0x7f48f809bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.761+0000 7f48fd367640 1 -- 172.21.15.55:0/1878999961 >> 172.21.15.55:0/1878999961 conn(0x7f48f8069900 msgr2=0x7f48f8069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:14.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.761+0000 7f48fd367640 1 -- 172.21.15.55:0/1878999961 shutdown_connections 2023-08-25T04:22:14.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.761+0000 7f48fd367640 1 -- 172.21.15.55:0/1878999961 wait complete. 2023-08-25T04:22:14.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.761+0000 7f48fd367640 1 Processor -- start 2023-08-25T04:22:14.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.761+0000 7f48fd367640 1 -- start start 2023-08-25T04:22:14.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48fd367640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48f806c020 0x7f48f814ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:14.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48fd367640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48f80c9830 0x7f48f80cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:14.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48fd367640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48f815a7f0 0x7f48f8164690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:14.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48fd367640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f80cc310 con 0x7f48f815a7f0 2023-08-25T04:22:14.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48fd367640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f80cc5f0 con 0x7f48f806c020 2023-08-25T04:22:14.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48fd367640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f80cc8d0 con 0x7f48f80c9830 2023-08-25T04:22:14.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48f77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48f815a7f0 0x7f48f8164690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:14.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48f77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48f815a7f0 0x7f48f8164690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39276/0 (socket says 172.21.15.55:39276) 2023-08-25T04:22:14.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48f77fe640 1 -- 172.21.15.55:0/1388611493 learned_addr learned my addr 172.21.15.55:0/1388611493 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:14.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48effff640 1 --2- 172.21.15.55:0/1388611493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48f80c9830 0x7f48f80cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:14.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48f6ffd640 1 --2- 172.21.15.55:0/1388611493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48f806c020 0x7f48f814ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:14.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48f77fe640 1 -- 172.21.15.55:0/1388611493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48f80c9830 msgr2=0x7f48f80cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:14.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48f77fe640 1 --2- 172.21.15.55:0/1388611493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48f80c9830 0x7f48f80cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48f77fe640 1 -- 172.21.15.55:0/1388611493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48f806c020 msgr2=0x7f48f814ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:14.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48f77fe640 1 --2- 172.21.15.55:0/1388611493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48f806c020 0x7f48f814ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48f77fe640 1 -- 172.21.15.55:0/1388611493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f0009a70 con 0x7f48f815a7f0 2023-08-25T04:22:14.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48effff640 1 --2- 172.21.15.55:0/1388611493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48f80c9830 0x7f48f80cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:14.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48f77fe640 1 --2- 172.21.15.55:0/1388611493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48f815a7f0 0x7f48f8164690 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f48f00b0040 tx=0x7f48f00196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48ef7fe640 1 -- 172.21.15.55:0/1388611493 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f00b9860 con 0x7f48f815a7f0 2023-08-25T04:22:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48ef7fe640 1 -- 172.21.15.55:0/1388611493 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f00b99c0 con 0x7f48f815a7f0 2023-08-25T04:22:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48ef7fe640 1 -- 172.21.15.55:0/1388611493 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f00b9d70 con 0x7f48f815a7f0 2023-08-25T04:22:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48fd367640 1 -- 172.21.15.55:0/1388611493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f80ccbb0 con 0x7f48f815a7f0 2023-08-25T04:22:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48fd367640 1 -- 172.21.15.55:0/1388611493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f814f230 con 0x7f48f815a7f0 2023-08-25T04:22:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48fd367640 1 -- 172.21.15.55:0/1388611493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f806d5b0 con 0x7f48f815a7f0 2023-08-25T04:22:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.765+0000 7f48ef7fe640 1 -- 172.21.15.55:0/1388611493 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f48f00ad440 con 0x7f48f815a7f0 2023-08-25T04:22:14.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.769+0000 7f48ef7fe640 1 --2- 172.21.15.55:0/1388611493 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f48d80657a0 0x7f48d8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:14.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.769+0000 7f48ef7fe640 1 -- 172.21.15.55:0/1388611493 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f48f011e3a0 con 0x7f48f815a7f0 2023-08-25T04:22:14.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.769+0000 7f48f6ffd640 1 --2- 172.21.15.55:0/1388611493 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f48d80657a0 0x7f48d8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:14.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.769+0000 7f48f6ffd640 1 --2- 172.21.15.55:0/1388611493 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f48d80657a0 0x7f48d8067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f48e8006fd0 tx=0x7f48e8008040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:14.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.773+0000 7f48ef7fe640 1 -- 172.21.15.55:0/1388611493 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f48f00ebd30 con 0x7f48f815a7f0 2023-08-25T04:22:14.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.933+0000 7f48fd367640 1 -- 172.21.15.55:0/1388611493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f48f8073ec0 con 0x7f48f815a7f0 2023-08-25T04:22:14.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.937+0000 7f48ef7fe640 1 -- 172.21.15.55:0/1388611493 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7f48f00ef350 con 0x7f48f815a7f0 2023-08-25T04:22:14.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.941+0000 7f48fd367640 1 -- 172.21.15.55:0/1388611493 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f48d80657a0 msgr2=0x7f48d8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:14.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.941+0000 7f48fd367640 1 --2- 172.21.15.55:0/1388611493 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f48d80657a0 0x7f48d8067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f48e8006fd0 tx=0x7f48e8008040 comp rx=0 tx=0).stop 2023-08-25T04:22:14.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.941+0000 7f48fd367640 1 -- 172.21.15.55:0/1388611493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48f815a7f0 msgr2=0x7f48f8164690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:14.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.941+0000 7f48fd367640 1 --2- 172.21.15.55:0/1388611493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48f815a7f0 0x7f48f8164690 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f48f00b0040 tx=0x7f48f00196c0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.941+0000 7f48fd367640 1 -- 172.21.15.55:0/1388611493 shutdown_connections 2023-08-25T04:22:14.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.941+0000 7f48fd367640 1 --2- 172.21.15.55:0/1388611493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48f815a7f0 0x7f48f8164690 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.941+0000 7f48fd367640 1 --2- 172.21.15.55:0/1388611493 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f48d80657a0 0x7f48d8067c60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.941+0000 7f48fd367640 1 --2- 172.21.15.55:0/1388611493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48f80c9830 0x7f48f80cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.941+0000 7f48fd367640 1 --2- 172.21.15.55:0/1388611493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48f806c020 0x7f48f814ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:14.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.941+0000 7f48fd367640 1 -- 172.21.15.55:0/1388611493 >> 172.21.15.55:0/1388611493 conn(0x7f48f8069900 msgr2=0x7f48f80b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:14.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.941+0000 7f48fd367640 1 -- 172.21.15.55:0/1388611493 shutdown_connections 2023-08-25T04:22:14.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:14.941+0000 7f48fd367640 1 -- 172.21.15.55:0/1388611493 wait complete. 2023-08-25T04:22:14.959 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-08-25T04:22:15.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.101+0000 7f69f1359640 1 Processor -- start 2023-08-25T04:22:15.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.101+0000 7f69f1359640 1 -- start start 2023-08-25T04:22:15.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69f1359640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f69ec06c2c0 0x7f69ec167840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:15.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69f1359640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69ec161330 con 0x7f69ec15c9c0 2023-08-25T04:22:15.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69f1359640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69ec06eaf0 con 0x7f69ec0cfa70 2023-08-25T04:22:15.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69f1359640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ec06e530 con 0x7f69ec06c2c0 2023-08-25T04:22:15.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69eaffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f69ec15c9c0 0x7f69ec160510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41018/0 (socket says 172.21.15.55:41018) 2023-08-25T04:22:15.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69eaffd640 1 -- 172.21.15.55:0/1709992592 learned_addr learned my addr 172.21.15.55:0/1709992592 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:15.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69eb7fe640 1 --2- 172.21.15.55:0/1709992592 >> v2:172.21.15.110:3300/0 conn(0x7f69ec06c2c0 0x7f69ec167840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:15.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69ea7fc640 1 -- 172.21.15.55:0/1709992592 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754657108 0 0) 0x7f69ec161330 con 0x7f69ec15c9c0 2023-08-25T04:22:15.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69ea7fc640 1 -- 172.21.15.55:0/1709992592 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69d8003530 con 0x7f69ec15c9c0 2023-08-25T04:22:15.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69ea7fc640 1 -- 172.21.15.55:0/1709992592 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1600096269 0 0) 0x7f69d8003530 con 0x7f69ec15c9c0 2023-08-25T04:22:15.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69ea7fc640 1 -- 172.21.15.55:0/1709992592 >> v2:172.21.15.110:3300/0 conn(0x7f69ec06c2c0 msgr2=0x7f69ec167840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:15.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69ea7fc640 1 --2- 172.21.15.55:0/1709992592 >> v2:172.21.15.110:3300/0 conn(0x7f69ec06c2c0 0x7f69ec167840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:15.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69ea7fc640 1 -- 172.21.15.55:0/1709992592 >> v1:172.21.15.110:6789/0 conn(0x7f69ec0cfa70 legacy=0x7f69ec160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:15.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69ea7fc640 1 -- 172.21.15.55:0/1709992592 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec06e810 con 0x7f69ec15c9c0 2023-08-25T04:22:15.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69ea7fc640 1 -- 172.21.15.55:0/1709992592 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f69dc001800 con 0x7f69ec15c9c0 2023-08-25T04:22:15.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69ea7fc640 1 -- 172.21.15.55:0/1709992592 >> v1:172.21.15.55:6789/0 conn(0x7f69ec15c9c0 legacy=0x7f69ec160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:15.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69ea7fc640 1 --2- 172.21.15.55:0/1709992592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69d8003980 0x7f69d8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:15.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69ea7fc640 1 --2- 172.21.15.55:0/1709992592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69d80047d0 0x7f69d8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:15.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69ea7fc640 1 --2- 172.21.15.55:0/1709992592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69d8005190 0x7f69d800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:15.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69ea7fc640 1 -- 172.21.15.55:0/1709992592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec06e530 con 0x7f69d80047d0 2023-08-25T04:22:15.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69ea7fc640 1 -- 172.21.15.55:0/1709992592 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d800c030 con 0x7f69d8003980 2023-08-25T04:22:15.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69ea7fc640 1 -- 172.21.15.55:0/1709992592 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d800c1f0 con 0x7f69d8005190 2023-08-25T04:22:15.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69e27fc640 1 --2- 172.21.15.55:0/1709992592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69d80047d0 0x7f69d8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:15.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69eaffd640 1 --2- 172.21.15.55:0/1709992592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69d8003980 0x7f69d8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:15.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69eb7fe640 1 --2- 172.21.15.55:0/1709992592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69d8005190 0x7f69d800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:15.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69e27fc640 1 -- 172.21.15.55:0/1709992592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69d8005190 msgr2=0x7f69d800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:15.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69e27fc640 1 --2- 172.21.15.55:0/1709992592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69d8005190 0x7f69d800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:15.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69e27fc640 1 -- 172.21.15.55:0/1709992592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69d8003980 msgr2=0x7f69d8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:15.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69e27fc640 1 --2- 172.21.15.55:0/1709992592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69d8003980 0x7f69d8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:15.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69e27fc640 1 -- 172.21.15.55:0/1709992592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d8003530 con 0x7f69d80047d0 2023-08-25T04:22:15.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69eb7fe640 1 --2- 172.21.15.55:0/1709992592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69d8005190 0x7f69d800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:15.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.105+0000 7f69eb7fe640 1 -- 172.21.15.55:0/1709992592 reap_dead start 2023-08-25T04:22:15.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.109+0000 7f69e27fc640 1 --2- 172.21.15.55:0/1709992592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69d80047d0 0x7f69d8004c50 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f69d4001e70 tx=0x7f69d401c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ffdd57d23a0db3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:15.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.109+0000 7f69ea7fc640 1 -- 172.21.15.55:0/1709992592 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d4003b80 con 0x7f69d80047d0 2023-08-25T04:22:15.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.109+0000 7f69ea7fc640 1 -- 172.21.15.55:0/1709992592 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d4003ce0 con 0x7f69d80047d0 2023-08-25T04:22:15.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.109+0000 7f69ea7fc640 1 -- 172.21.15.55:0/1709992592 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d4005310 con 0x7f69d80047d0 2023-08-25T04:22:15.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.109+0000 7f69f1359640 1 -- 172.21.15.55:0/1709992592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69d80047d0 msgr2=0x7f69d8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:15.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.109+0000 7f69f1359640 1 --2- 172.21.15.55:0/1709992592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69d80047d0 0x7f69d8004c50 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f69d4001e70 tx=0x7f69d401c740 comp rx=0 tx=0).stop 2023-08-25T04:22:15.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.109+0000 7f69f1359640 1 -- 172.21.15.55:0/1709992592 shutdown_connections 2023-08-25T04:22:15.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.109+0000 7f69f1359640 1 --2- 172.21.15.55:0/1709992592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69d80047d0 0x7f69d8004c50 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:15.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.109+0000 7f69f1359640 1 -- 172.21.15.55:0/1709992592 >> 172.21.15.55:0/1709992592 conn(0x7f69ec0d05a0 msgr2=0x7f69ec0d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:15.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.109+0000 7f69f1359640 1 -- 172.21.15.55:0/1709992592 shutdown_connections 2023-08-25T04:22:15.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.109+0000 7f69f1359640 1 -- 172.21.15.55:0/1709992592 wait complete. 2023-08-25T04:22:15.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.109+0000 7f69f1359640 1 Processor -- start 2023-08-25T04:22:15.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.109+0000 7f69f1359640 1 -- start start 2023-08-25T04:22:15.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69f1359640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69d80047d0 0x7f69ec0b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:15.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69f1359640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69ec0c40d0 0x7f69ec15ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:15.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69f1359640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69ec156090 0x7f69ec156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:15.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69f1359640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec156fa0 con 0x7f69ec0c40d0 2023-08-25T04:22:15.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69f1359640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec156a50 con 0x7f69d80047d0 2023-08-25T04:22:15.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69f1359640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec0c4550 con 0x7f69ec156090 2023-08-25T04:22:15.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69e27fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69ec0c40d0 0x7f69ec15ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:15.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69eaffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69d80047d0 0x7f69ec0b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:15.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69e27fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69ec0c40d0 0x7f69ec15ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39298/0 (socket says 172.21.15.55:39298) 2023-08-25T04:22:15.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69e27fc640 1 -- 172.21.15.55:0/2811357885 learned_addr learned my addr 172.21.15.55:0/2811357885 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:15.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69eb7fe640 1 --2- 172.21.15.55:0/2811357885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69ec156090 0x7f69ec156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:15.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69e27fc640 1 -- 172.21.15.55:0/2811357885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69ec156090 msgr2=0x7f69ec156510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:15.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69e27fc640 1 --2- 172.21.15.55:0/2811357885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69ec156090 0x7f69ec156510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:15.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69e27fc640 1 -- 172.21.15.55:0/2811357885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69d80047d0 msgr2=0x7f69ec0b5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:15.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69e27fc640 1 --2- 172.21.15.55:0/2811357885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69d80047d0 0x7f69ec0b5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:15.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69e27fc640 1 -- 172.21.15.55:0/2811357885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec1f9b60 con 0x7f69ec0c40d0 2023-08-25T04:22:15.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69e27fc640 1 --2- 172.21.15.55:0/2811357885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69ec0c40d0 0x7f69ec15ab30 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f69d4005040 tx=0x7f69d8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:15.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69e3fff640 1 -- 172.21.15.55:0/2811357885 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d40052d0 con 0x7f69ec0c40d0 2023-08-25T04:22:15.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69e3fff640 1 -- 172.21.15.55:0/2811357885 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d4005430 con 0x7f69ec0c40d0 2023-08-25T04:22:15.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69e3fff640 1 -- 172.21.15.55:0/2811357885 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d40057e0 con 0x7f69ec0c40d0 2023-08-25T04:22:15.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69f1359640 1 -- 172.21.15.55:0/2811357885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ec1f9e40 con 0x7f69ec0c40d0 2023-08-25T04:22:15.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69f1359640 1 -- 172.21.15.55:0/2811357885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ec1fa400 con 0x7f69ec0c40d0 2023-08-25T04:22:15.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.113+0000 7f69f1359640 1 -- 172.21.15.55:0/2811357885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69ec04dbe0 con 0x7f69ec0c40d0 2023-08-25T04:22:15.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.117+0000 7f69e3fff640 1 -- 172.21.15.55:0/2811357885 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f69d40b2050 con 0x7f69ec0c40d0 2023-08-25T04:22:15.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.117+0000 7f69e3fff640 1 --2- 172.21.15.55:0/2811357885 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f69cc0657d0 0x7f69cc067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:15.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.117+0000 7f69e3fff640 1 -- 172.21.15.55:0/2811357885 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f69d411d1b0 con 0x7f69ec0c40d0 2023-08-25T04:22:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.117+0000 7f69eaffd640 1 --2- 172.21.15.55:0/2811357885 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f69cc0657d0 0x7f69cc067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.117+0000 7f69eaffd640 1 --2- 172.21.15.55:0/2811357885 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f69cc0657d0 0x7f69cc067c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f69dc007cb0 tx=0x7f69dc001d80 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.121+0000 7f69e3fff640 1 -- 172.21.15.55:0/2811357885 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f69d40ea9c0 con 0x7f69ec0c40d0 2023-08-25T04:22:15.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.329+0000 7f69f1359640 1 -- 172.21.15.55:0/2811357885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f69ec04dbe0 con 0x7f69ec0c40d0 2023-08-25T04:22:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.873+0000 7f69e3fff640 1 -- 172.21.15.55:0/2811357885 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v741) v1 ==== 148+0+0 (secure 0 0 0) 0x7f69d40b0020 con 0x7f69ec0c40d0 2023-08-25T04:22:15.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.873+0000 7f69f1359640 1 -- 172.21.15.55:0/2811357885 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f69cc0657d0 msgr2=0x7f69cc067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:15.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.873+0000 7f69f1359640 1 --2- 172.21.15.55:0/2811357885 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f69cc0657d0 0x7f69cc067c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f69dc007cb0 tx=0x7f69dc001d80 comp rx=0 tx=0).stop 2023-08-25T04:22:15.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.873+0000 7f69f1359640 1 -- 172.21.15.55:0/2811357885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69ec0c40d0 msgr2=0x7f69ec15ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:15.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.873+0000 7f69f1359640 1 --2- 172.21.15.55:0/2811357885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69ec0c40d0 0x7f69ec15ab30 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f69d4005040 tx=0x7f69d8005800 comp rx=0 tx=0).stop 2023-08-25T04:22:15.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.873+0000 7f69f1359640 1 -- 172.21.15.55:0/2811357885 shutdown_connections 2023-08-25T04:22:15.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.873+0000 7f69f1359640 1 --2- 172.21.15.55:0/2811357885 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f69cc0657d0 0x7f69cc067c90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:15.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.873+0000 7f69f1359640 1 --2- 172.21.15.55:0/2811357885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69ec156090 0x7f69ec156510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:15.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.873+0000 7f69f1359640 1 --2- 172.21.15.55:0/2811357885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69ec0c40d0 0x7f69ec15ab30 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:15.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.873+0000 7f69f1359640 1 --2- 172.21.15.55:0/2811357885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69d80047d0 0x7f69ec0b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:15.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.873+0000 7f69f1359640 1 -- 172.21.15.55:0/2811357885 >> 172.21.15.55:0/2811357885 conn(0x7f69ec0d05a0 msgr2=0x7f69ec0b0770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:15.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.873+0000 7f69f1359640 1 -- 172.21.15.55:0/2811357885 shutdown_connections 2023-08-25T04:22:15.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:15.873+0000 7f69f1359640 1 -- 172.21.15.55:0/2811357885 wait complete. 2023-08-25T04:22:15.898 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-08-25T04:22:15.899 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-25T04:22:15.899 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-08-25T04:22:16.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.045+0000 7f74a6137640 1 Processor -- start 2023-08-25T04:22:16.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.045+0000 7f74a6137640 1 -- start start 2023-08-25T04:22:16.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.049+0000 7f74a6137640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f74a00ceeb0 0x7f74a00cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:16.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.049+0000 7f74a6137640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a00cc880 con 0x7f74a00c89f0 2023-08-25T04:22:16.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.049+0000 7f74a6137640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a00ccb60 con 0x7f74a00ad950 2023-08-25T04:22:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.049+0000 7f74a6137640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a00b11f0 con 0x7f74a00ceeb0 2023-08-25T04:22:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.049+0000 7f749ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f74a00c89f0 0x7f74a00b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41020/0 (socket says 172.21.15.55:41020) 2023-08-25T04:22:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.049+0000 7f749ffff640 1 -- 172.21.15.55:0/4128063177 learned_addr learned my addr 172.21.15.55:0/4128063177 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:16.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.049+0000 7f749effd640 1 --2- 172.21.15.55:0/4128063177 >> v2:172.21.15.110:3300/0 conn(0x7f74a00ceeb0 0x7f74a00cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:16.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.049+0000 7f749e7fc640 1 -- 172.21.15.55:0/4128063177 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2878666983 0 0) 0x7f74a00cc880 con 0x7f74a00c89f0 2023-08-25T04:22:16.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.049+0000 7f749e7fc640 1 -- 172.21.15.55:0/4128063177 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7488003530 con 0x7f74a00c89f0 2023-08-25T04:22:16.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.049+0000 7f749effd640 1 -- 172.21.15.55:0/4128063177 >> v1:172.21.15.110:6789/0 conn(0x7f74a00ad950 legacy=0x7f74a00ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:16.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.049+0000 7f749e7fc640 1 -- 172.21.15.55:0/4128063177 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790658168 0 0) 0x7f74a00ccb60 con 0x7f74a00ad950 2023-08-25T04:22:16.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.049+0000 7f749effd640 1 -- 172.21.15.55:0/4128063177 >> v1:172.21.15.55:6789/0 conn(0x7f74a00c89f0 legacy=0x7f74a00b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:16.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.049+0000 7f749effd640 1 -- 172.21.15.55:0/4128063177 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a00cce40 con 0x7f74a00ceeb0 2023-08-25T04:22:16.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.053+0000 7f749effd640 1 --2- 172.21.15.55:0/4128063177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a00ceeb0 0x7f74a00cc2a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f74940097c0 tx=0x7f749401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=471756927e0d4d5e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:16.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.053+0000 7f749e7fc640 1 -- 172.21.15.55:0/4128063177 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74940ab600 con 0x7f74a00ceeb0 2023-08-25T04:22:16.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.053+0000 7f749e7fc640 1 -- 172.21.15.55:0/4128063177 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74940a7050 con 0x7f74a00ceeb0 2023-08-25T04:22:16.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.053+0000 7f749e7fc640 1 -- 172.21.15.55:0/4128063177 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74940ab980 con 0x7f74a00ceeb0 2023-08-25T04:22:16.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.053+0000 7f74a6137640 1 -- 172.21.15.55:0/4128063177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a00ceeb0 msgr2=0x7f74a00cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:16.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.053+0000 7f74a6137640 1 --2- 172.21.15.55:0/4128063177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a00ceeb0 0x7f74a00cc2a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f74940097c0 tx=0x7f749401c3f0 comp rx=0 tx=0).stop 2023-08-25T04:22:16.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.053+0000 7f74a6137640 1 -- 172.21.15.55:0/4128063177 shutdown_connections 2023-08-25T04:22:16.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.053+0000 7f74a6137640 1 --2- 172.21.15.55:0/4128063177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a00ceeb0 0x7f74a00cc2a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:16.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.053+0000 7f74a6137640 1 -- 172.21.15.55:0/4128063177 >> 172.21.15.55:0/4128063177 conn(0x7f74a0069d00 msgr2=0x7f74a006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:16.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.053+0000 7f74a6137640 1 -- 172.21.15.55:0/4128063177 shutdown_connections 2023-08-25T04:22:16.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.053+0000 7f74a6137640 1 -- 172.21.15.55:0/4128063177 wait complete. 2023-08-25T04:22:16.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.053+0000 7f74a6137640 1 Processor -- start 2023-08-25T04:22:16.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.053+0000 7f74a6137640 1 -- start start 2023-08-25T04:22:16.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f74a6137640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a00ad950 0x7f74a00acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:16.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f74a6137640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74a00c89f0 0x7f74a01628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:16.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f74a6137640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74a00ceeb0 0x7f74a0097780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:16.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f74a6137640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a00ad090 con 0x7f74a00c89f0 2023-08-25T04:22:16.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f74a6137640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a0156ed0 con 0x7f74a00ad950 2023-08-25T04:22:16.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f74a6137640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a015c6d0 con 0x7f74a00ceeb0 2023-08-25T04:22:16.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f749effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74a00c89f0 0x7f74a01628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:16.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f749effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74a00c89f0 0x7f74a01628d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39306/0 (socket says 172.21.15.55:39306) 2023-08-25T04:22:16.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f749effd640 1 -- 172.21.15.55:0/1356611621 learned_addr learned my addr 172.21.15.55:0/1356611621 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:16.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f749ffff640 1 --2- 172.21.15.55:0/1356611621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74a00ceeb0 0x7f74a0097780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:16.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f749f7fe640 1 --2- 172.21.15.55:0/1356611621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a00ad950 0x7f74a00acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:16.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f749effd640 1 -- 172.21.15.55:0/1356611621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74a00ceeb0 msgr2=0x7f74a0097780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:16.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f749effd640 1 --2- 172.21.15.55:0/1356611621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74a00ceeb0 0x7f74a0097780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:16.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f749effd640 1 -- 172.21.15.55:0/1356611621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a00ad950 msgr2=0x7f74a00acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:16.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f749effd640 1 --2- 172.21.15.55:0/1356611621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a00ad950 0x7f74a00acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:16.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f749effd640 1 -- 172.21.15.55:0/1356611621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7494009420 con 0x7f74a00c89f0 2023-08-25T04:22:16.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f749effd640 1 --2- 172.21.15.55:0/1356611621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74a00c89f0 0x7f74a01628d0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f74940ae040 tx=0x7f7494019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:16.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f7487fff640 1 -- 172.21.15.55:0/1356611621 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7494004020 con 0x7f74a00c89f0 2023-08-25T04:22:16.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f7487fff640 1 -- 172.21.15.55:0/1356611621 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7494004180 con 0x7f74a00c89f0 2023-08-25T04:22:16.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f7487fff640 1 -- 172.21.15.55:0/1356611621 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74940044f0 con 0x7f74a00c89f0 2023-08-25T04:22:16.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f74a6137640 1 -- 172.21.15.55:0/1356611621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a015b150 con 0x7f74a00c89f0 2023-08-25T04:22:16.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f74a6137640 1 -- 172.21.15.55:0/1356611621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a015b710 con 0x7f74a00c89f0 2023-08-25T04:22:16.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f74a6137640 1 -- 172.21.15.55:0/1356611621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a015b900 con 0x7f74a00c89f0 2023-08-25T04:22:16.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.057+0000 7f7487fff640 1 -- 172.21.15.55:0/1356611621 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f74940b2040 con 0x7f74a00c89f0 2023-08-25T04:22:16.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.061+0000 7f7487fff640 1 --2- 172.21.15.55:0/1356611621 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f748c0657a0 0x7f748c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:16.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.061+0000 7f7487fff640 1 -- 172.21.15.55:0/1356611621 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f749411cf80 con 0x7f74a00c89f0 2023-08-25T04:22:16.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.061+0000 7f749f7fe640 1 --2- 172.21.15.55:0/1356611621 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f748c0657a0 0x7f748c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:16.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.061+0000 7f749f7fe640 1 --2- 172.21.15.55:0/1356611621 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f748c0657a0 0x7f748c067c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7490000f70 tx=0x7f7490009040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:16.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.065+0000 7f7487fff640 1 -- 172.21.15.55:0/1356611621 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f74940ea800 con 0x7f74a00c89f0 2023-08-25T04:22:16.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.277+0000 7f74a6137640 1 -- 172.21.15.55:0/1356611621 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7f74a004dbe0 con 0x7f74a00c89f0 2023-08-25T04:22:16.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.873+0000 7f7487fff640 1 -- 172.21.15.55:0/1356611621 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v742) v1 ==== 181+0+0 (secure 0 0 0) 0x7f74940ede20 con 0x7f74a00c89f0 2023-08-25T04:22:16.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.877+0000 7f74a6137640 1 -- 172.21.15.55:0/1356611621 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f748c0657a0 msgr2=0x7f748c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:16.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.877+0000 7f74a6137640 1 --2- 172.21.15.55:0/1356611621 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f748c0657a0 0x7f748c067c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7490000f70 tx=0x7f7490009040 comp rx=0 tx=0).stop 2023-08-25T04:22:16.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.877+0000 7f74a6137640 1 -- 172.21.15.55:0/1356611621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74a00c89f0 msgr2=0x7f74a01628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:16.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.877+0000 7f74a6137640 1 --2- 172.21.15.55:0/1356611621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74a00c89f0 0x7f74a01628d0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f74940ae040 tx=0x7f7494019190 comp rx=0 tx=0).stop 2023-08-25T04:22:16.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.877+0000 7f74a6137640 1 -- 172.21.15.55:0/1356611621 shutdown_connections 2023-08-25T04:22:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.877+0000 7f74a6137640 1 --2- 172.21.15.55:0/1356611621 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f748c0657a0 0x7f748c067c60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.877+0000 7f74a6137640 1 --2- 172.21.15.55:0/1356611621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74a00ceeb0 0x7f74a0097780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.877+0000 7f74a6137640 1 --2- 172.21.15.55:0/1356611621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74a00c89f0 0x7f74a01628d0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.877+0000 7f74a6137640 1 --2- 172.21.15.55:0/1356611621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74a00ad950 0x7f74a00acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.877+0000 7f74a6137640 1 -- 172.21.15.55:0/1356611621 >> 172.21.15.55:0/1356611621 conn(0x7f74a0069d00 msgr2=0x7f74a006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.877+0000 7f74a6137640 1 -- 172.21.15.55:0/1356611621 shutdown_connections 2023-08-25T04:22:16.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:16.877+0000 7f74a6137640 1 -- 172.21.15.55:0/1356611621 wait complete. 2023-08-25T04:22:16.902 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:22:17.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.049+0000 7f21cb9db640 1 Processor -- start 2023-08-25T04:22:17.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.049+0000 7f21cb9db640 1 -- start start 2023-08-25T04:22:17.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.049+0000 7f21cb9db640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f21c40ccf20 0x7f21c40cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:17.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.049+0000 7f21cb9db640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c40ce170 con 0x7f21c415a830 2023-08-25T04:22:17.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.049+0000 7f21cb9db640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c40cd8a0 con 0x7f21c406d550 2023-08-25T04:22:17.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.049+0000 7f21cb9db640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c40ce3a0 con 0x7f21c40ccf20 2023-08-25T04:22:17.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.049+0000 7f21c8f76640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f21c40ccf20 0x7f21c40cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:17.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.049+0000 7f21c8f76640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f21c40ccf20 0x7f21c40cd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39308/0 (socket says 172.21.15.55:39308) 2023-08-25T04:22:17.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.049+0000 7f21c9777640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f21c415a830 0x7f21c40cbd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41036/0 (socket says 172.21.15.55:41036) 2023-08-25T04:22:17.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.049+0000 7f21c8f76640 1 -- 172.21.15.55:0/2897416603 learned_addr learned my addr 172.21.15.55:0/2897416603 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:17.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.053+0000 7f21c8f76640 1 -- 172.21.15.55:0/2897416603 >> v1:172.21.15.110:6789/0 conn(0x7f21c406d550 legacy=0x7f21c406da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:17.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.053+0000 7f21c8f76640 1 -- 172.21.15.55:0/2897416603 >> v1:172.21.15.55:6789/0 conn(0x7f21c415a830 legacy=0x7f21c40cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:17.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.053+0000 7f21c8f76640 1 -- 172.21.15.55:0/2897416603 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c40ce660 con 0x7f21c40ccf20 2023-08-25T04:22:17.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.053+0000 7f21c8f76640 1 --2- 172.21.15.55:0/2897416603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21c40ccf20 0x7f21c40cd360 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009870 tx=0x7f21b401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbfb3632638e934 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:17.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.053+0000 7f21bbfff640 1 -- 172.21.15.55:0/2897416603 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b40aa430 con 0x7f21c40ccf20 2023-08-25T04:22:17.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.053+0000 7f21bbfff640 1 -- 172.21.15.55:0/2897416603 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b40aa590 con 0x7f21c40ccf20 2023-08-25T04:22:17.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.053+0000 7f21bbfff640 1 -- 172.21.15.55:0/2897416603 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b40aa920 con 0x7f21c40ccf20 2023-08-25T04:22:17.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.053+0000 7f21cb9db640 1 -- 172.21.15.55:0/2897416603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21c40ccf20 msgr2=0x7f21c40cd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:17.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.053+0000 7f21cb9db640 1 --2- 172.21.15.55:0/2897416603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21c40ccf20 0x7f21c40cd360 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009870 tx=0x7f21b401c4d0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.053+0000 7f21cb9db640 1 -- 172.21.15.55:0/2897416603 shutdown_connections 2023-08-25T04:22:17.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.053+0000 7f21cb9db640 1 --2- 172.21.15.55:0/2897416603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21c40ccf20 0x7f21c40cd360 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.053+0000 7f21cb9db640 1 -- 172.21.15.55:0/2897416603 >> 172.21.15.55:0/2897416603 conn(0x7f21c40d05a0 msgr2=0x7f21c40d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:17.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.053+0000 7f21cb9db640 1 -- 172.21.15.55:0/2897416603 shutdown_connections 2023-08-25T04:22:17.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.053+0000 7f21cb9db640 1 -- 172.21.15.55:0/2897416603 wait complete. 2023-08-25T04:22:17.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21cb9db640 1 Processor -- start 2023-08-25T04:22:17.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21cb9db640 1 -- start start 2023-08-25T04:22:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21cb9db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21c406d550 0x7f21c415d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21cb9db640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c40ccf20 0x7f21c40c2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21cb9db640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c415a830 0x7f21c41f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21cb9db640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c40c1c20 con 0x7f21c406d550 2023-08-25T04:22:17.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21cb9db640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c40c2b70 con 0x7f21c40ccf20 2023-08-25T04:22:17.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21cb9db640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c41f6d20 con 0x7f21c415a830 2023-08-25T04:22:17.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21c9777640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21c406d550 0x7f21c415d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:17.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21c9777640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21c406d550 0x7f21c415d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39316/0 (socket says 172.21.15.55:39316) 2023-08-25T04:22:17.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21c9777640 1 -- 172.21.15.55:0/3765330235 learned_addr learned my addr 172.21.15.55:0/3765330235 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:17.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21c8f76640 1 --2- 172.21.15.55:0/3765330235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c40ccf20 0x7f21c40c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:17.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21c9f78640 1 --2- 172.21.15.55:0/3765330235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c415a830 0x7f21c41f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:17.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21c9777640 1 -- 172.21.15.55:0/3765330235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c415a830 msgr2=0x7f21c41f62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:17.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21c9777640 1 --2- 172.21.15.55:0/3765330235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c415a830 0x7f21c41f62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21c9777640 1 -- 172.21.15.55:0/3765330235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c40ccf20 msgr2=0x7f21c40c2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:17.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21c9777640 1 --2- 172.21.15.55:0/3765330235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c40ccf20 0x7f21c40c2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21c9777640 1 -- 172.21.15.55:0/3765330235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b40094d0 con 0x7f21c406d550 2023-08-25T04:22:17.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21c9777640 1 --2- 172.21.15.55:0/3765330235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21c406d550 0x7f21c415d380 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f21c000c430 tx=0x7f21c000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:17.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21b9ffb640 1 -- 172.21.15.55:0/3765330235 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c00074e0 con 0x7f21c406d550 2023-08-25T04:22:17.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21b9ffb640 1 -- 172.21.15.55:0/3765330235 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c0007640 con 0x7f21c406d550 2023-08-25T04:22:17.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21b9ffb640 1 -- 172.21.15.55:0/3765330235 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c00059d0 con 0x7f21c406d550 2023-08-25T04:22:17.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.057+0000 7f21cb9db640 1 -- 172.21.15.55:0/3765330235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c41f7000 con 0x7f21c406d550 2023-08-25T04:22:17.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.061+0000 7f21cb9db640 1 -- 172.21.15.55:0/3765330235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c40c2110 con 0x7f21c406d550 2023-08-25T04:22:17.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.061+0000 7f21cb9db640 1 -- 172.21.15.55:0/3765330235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c404dbe0 con 0x7f21c406d550 2023-08-25T04:22:17.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.061+0000 7f21b9ffb640 1 -- 172.21.15.55:0/3765330235 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f21c0005b30 con 0x7f21c406d550 2023-08-25T04:22:17.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.061+0000 7f21b9ffb640 1 --2- 172.21.15.55:0/3765330235 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f21a80657a0 0x7f21a8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:17.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.061+0000 7f21b9ffb640 1 -- 172.21.15.55:0/3765330235 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f21c0082610 con 0x7f21c406d550 2023-08-25T04:22:17.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.061+0000 7f21c8f76640 1 --2- 172.21.15.55:0/3765330235 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f21a80657a0 0x7f21a8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:17.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.061+0000 7f21c8f76640 1 --2- 172.21.15.55:0/3765330235 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f21a80657a0 0x7f21a8067c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f21b40ae000 tx=0x7f21b40a7000 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:17.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.065+0000 7f21b9ffb640 1 -- 172.21.15.55:0/3765330235 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f21c004ff10 con 0x7f21c406d550 2023-08-25T04:22:17.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.225+0000 7f21cb9db640 1 -- 172.21.15.55:0/3765330235 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21c4155e40 con 0x7f21c406d550 2023-08-25T04:22:17.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.225+0000 7f21b9ffb640 1 -- 172.21.15.55:0/3765330235 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+15932 (secure 0 0 0) 0x7f21c0053530 con 0x7f21c406d550 2023-08-25T04:22:17.226 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:17.226 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":128,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:22:13.863354+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6835/1257898577":"2023-08-26T04:22:10.836120+0000","172.21.15.55:6833/1257898577":"2023-08-26T04:22:10.836120+0000","172.21.15.110:0/3609572863":"2023-08-26T04:22:07.620198+0000","172.21.15.110:6833/3764718770":"2023-08-26T04:22:07.620198+0000","172.21.15.110:6832/3764718770":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/2437933180":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/2896743533":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/1241861202":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/3679172150":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/1315935264":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/1881766103":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/2743969486":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/25303232":"2023-08-26T04:21:39.491872+0000","172.21.15.110:6833/4272914017":"2023-08-26T04:21:39.491872+0000","172.21.15.110:6832/4272914017":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/2603377142":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/3471699845":"2023-08-26T04:22:07.620198+0000","172.21.15.110:0/3203059750":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/251061267":"2023-08-26T04:21:39.491872+0000","172.21.15.110:0/484834832":"2023-08-26T04:21:39.491872+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:22:17.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.229+0000 7f21cb9db640 1 -- 172.21.15.55:0/3765330235 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f21a80657a0 msgr2=0x7f21a8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:17.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.229+0000 7f21cb9db640 1 --2- 172.21.15.55:0/3765330235 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f21a80657a0 0x7f21a8067c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f21b40ae000 tx=0x7f21b40a7000 comp rx=0 tx=0).stop 2023-08-25T04:22:17.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.229+0000 7f21cb9db640 1 -- 172.21.15.55:0/3765330235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21c406d550 msgr2=0x7f21c415d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:17.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.229+0000 7f21cb9db640 1 --2- 172.21.15.55:0/3765330235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21c406d550 0x7f21c415d380 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f21c000c430 tx=0x7f21c000c8f0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.229+0000 7f21cb9db640 1 -- 172.21.15.55:0/3765330235 shutdown_connections 2023-08-25T04:22:17.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.229+0000 7f21cb9db640 1 --2- 172.21.15.55:0/3765330235 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f21a80657a0 0x7f21a8067c60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.229+0000 7f21cb9db640 1 --2- 172.21.15.55:0/3765330235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c415a830 0x7f21c41f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.229+0000 7f21cb9db640 1 --2- 172.21.15.55:0/3765330235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c40ccf20 0x7f21c40c2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.229+0000 7f21cb9db640 1 --2- 172.21.15.55:0/3765330235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21c406d550 0x7f21c415d380 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.229+0000 7f21cb9db640 1 -- 172.21.15.55:0/3765330235 >> 172.21.15.55:0/3765330235 conn(0x7f21c40d05a0 msgr2=0x7f21c40adad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:17.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.229+0000 7f21cb9db640 1 -- 172.21.15.55:0/3765330235 shutdown_connections 2023-08-25T04:22:17.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.229+0000 7f21cb9db640 1 -- 172.21.15.55:0/3765330235 wait complete. 2023-08-25T04:22:17.247 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:22:17.248 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:22:17.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.393+0000 7f1387b74640 1 Processor -- start 2023-08-25T04:22:17.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.393+0000 7f1387b74640 1 -- start start 2023-08-25T04:22:17.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.393+0000 7f1387b74640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f138006c020 0x7f138009bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:17.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.393+0000 7f1387b74640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138015abd0 con 0x7f13800c9830 2023-08-25T04:22:17.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.393+0000 7f1387b74640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800c8ab0 con 0x7f138015a7f0 2023-08-25T04:22:17.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.393+0000 7f1387b74640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13800c8d50 con 0x7f138006c020 2023-08-25T04:22:17.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.393+0000 7f138510f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f13800c9830 0x7f13800acff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41050/0 (socket says 172.21.15.55:41050) 2023-08-25T04:22:17.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.393+0000 7f138510f640 1 -- 172.21.15.55:0/3151538250 learned_addr learned my addr 172.21.15.55:0/3151538250 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.393+0000 7f1386111640 1 --2- 172.21.15.55:0/3151538250 >> v2:172.21.15.110:3300/0 conn(0x7f138006c020 0x7f138009bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.393+0000 7f138490e640 1 -- 172.21.15.55:0/3151538250 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074507179 0 0) 0x7f138015abd0 con 0x7f13800c9830 2023-08-25T04:22:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.393+0000 7f138490e640 1 -- 172.21.15.55:0/3151538250 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f136c003530 con 0x7f13800c9830 2023-08-25T04:22:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.397+0000 7f138490e640 1 -- 172.21.15.55:0/3151538250 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636094472 0 0) 0x7f13800c8ab0 con 0x7f138015a7f0 2023-08-25T04:22:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.397+0000 7f138490e640 1 -- 172.21.15.55:0/3151538250 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f138015abd0 con 0x7f138015a7f0 2023-08-25T04:22:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.397+0000 7f138490e640 1 -- 172.21.15.55:0/3151538250 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1381853836 0 0) 0x7f136c003530 con 0x7f13800c9830 2023-08-25T04:22:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.397+0000 7f1386111640 1 -- 172.21.15.55:0/3151538250 >> v1:172.21.15.110:6789/0 conn(0x7f138015a7f0 legacy=0x7f1380070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.397+0000 7f1386111640 1 -- 172.21.15.55:0/3151538250 >> v1:172.21.15.55:6789/0 conn(0x7f13800c9830 legacy=0x7f13800acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.397+0000 7f1386111640 1 -- 172.21.15.55:0/3151538250 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13800c9030 con 0x7f138006c020 2023-08-25T04:22:17.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.397+0000 7f1386111640 1 --2- 172.21.15.55:0/3151538250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f138006c020 0x7f138009bde0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f1378009d90 tx=0x7f137801c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31ab018c5d3a0e5c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:17.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.397+0000 7f138490e640 1 -- 172.21.15.55:0/3151538250 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370001680 con 0x7f138006c020 2023-08-25T04:22:17.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.397+0000 7f138490e640 1 -- 172.21.15.55:0/3151538250 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13780a5590 con 0x7f138006c020 2023-08-25T04:22:17.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.397+0000 7f138490e640 1 -- 172.21.15.55:0/3151538250 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13780a5920 con 0x7f138006c020 2023-08-25T04:22:17.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.397+0000 7f1387b74640 1 -- 172.21.15.55:0/3151538250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f138006c020 msgr2=0x7f138009bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:17.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.397+0000 7f1387b74640 1 --2- 172.21.15.55:0/3151538250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f138006c020 0x7f138009bde0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f1378009d90 tx=0x7f137801c840 comp rx=0 tx=0).stop 2023-08-25T04:22:17.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.397+0000 7f1387b74640 1 -- 172.21.15.55:0/3151538250 shutdown_connections 2023-08-25T04:22:17.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.397+0000 7f1387b74640 1 --2- 172.21.15.55:0/3151538250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f138006c020 0x7f138009bde0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.397+0000 7f1387b74640 1 -- 172.21.15.55:0/3151538250 >> 172.21.15.55:0/3151538250 conn(0x7f1380069900 msgr2=0x7f1380069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:17.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1387b74640 1 -- 172.21.15.55:0/3151538250 shutdown_connections 2023-08-25T04:22:17.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1387b74640 1 -- 172.21.15.55:0/3151538250 wait complete. 2023-08-25T04:22:17.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1387b74640 1 Processor -- start 2023-08-25T04:22:17.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1387b74640 1 -- start start 2023-08-25T04:22:17.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1387b74640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f138006c020 0x7f138014a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:17.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1387b74640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13800c9830 0x7f13801520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:17.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1387b74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138015a7f0 0x7f1380157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:17.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1387b74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1380151c60 con 0x7f138015a7f0 2023-08-25T04:22:17.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1387b74640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138014a630 con 0x7f138006c020 2023-08-25T04:22:17.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1387b74640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13801513a0 con 0x7f13800c9830 2023-08-25T04:22:17.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1386111640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138015a7f0 0x7f1380157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:17.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1386111640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138015a7f0 0x7f1380157e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39324/0 (socket says 172.21.15.55:39324) 2023-08-25T04:22:17.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1386111640 1 -- 172.21.15.55:0/3295110110 learned_addr learned my addr 172.21.15.55:0/3295110110 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:17.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f138510f640 1 --2- 172.21.15.55:0/3295110110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13800c9830 0x7f13801520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:17.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1385910640 1 --2- 172.21.15.55:0/3295110110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f138006c020 0x7f138014a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:17.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1386111640 1 -- 172.21.15.55:0/3295110110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13800c9830 msgr2=0x7f13801520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:17.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1386111640 1 --2- 172.21.15.55:0/3295110110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13800c9830 0x7f13801520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1386111640 1 -- 172.21.15.55:0/3295110110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f138006c020 msgr2=0x7f138014a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:17.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1386111640 1 --2- 172.21.15.55:0/3295110110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f138006c020 0x7f138014a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1386111640 1 -- 172.21.15.55:0/3295110110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1378009a70 con 0x7f138015a7f0 2023-08-25T04:22:17.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1385910640 1 --2- 172.21.15.55:0/3295110110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f138006c020 0x7f138014a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:17.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.401+0000 7f1386111640 1 --2- 172.21.15.55:0/3295110110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138015a7f0 0x7f1380157e00 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f137801cd20 tx=0x7f13780195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:17.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.405+0000 7f13767fc640 1 -- 172.21.15.55:0/3295110110 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1378003ba0 con 0x7f138015a7f0 2023-08-25T04:22:17.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.405+0000 7f13767fc640 1 -- 172.21.15.55:0/3295110110 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1378003d00 con 0x7f138015a7f0 2023-08-25T04:22:17.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.405+0000 7f1387b74640 1 -- 172.21.15.55:0/3295110110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13800adc90 con 0x7f138015a7f0 2023-08-25T04:22:17.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.405+0000 7f13767fc640 1 -- 172.21.15.55:0/3295110110 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1378004230 con 0x7f138015a7f0 2023-08-25T04:22:17.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.405+0000 7f1387b74640 1 -- 172.21.15.55:0/3295110110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13801518f0 con 0x7f138015a7f0 2023-08-25T04:22:17.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.405+0000 7f1387b74640 1 -- 172.21.15.55:0/3295110110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138006d5b0 con 0x7f138015a7f0 2023-08-25T04:22:17.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.405+0000 7f13767fc640 1 -- 172.21.15.55:0/3295110110 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f1378004390 con 0x7f138015a7f0 2023-08-25T04:22:17.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.405+0000 7f13767fc640 1 --2- 172.21.15.55:0/3295110110 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f13640657a0 0x7f1364067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:17.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.405+0000 7f13767fc640 1 -- 172.21.15.55:0/3295110110 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f137811d770 con 0x7f138015a7f0 2023-08-25T04:22:17.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.405+0000 7f1385910640 1 --2- 172.21.15.55:0/3295110110 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f13640657a0 0x7f1364067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:17.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.409+0000 7f1385910640 1 --2- 172.21.15.55:0/3295110110 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f13640657a0 0x7f1364067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f137c001240 tx=0x7f137c009040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:17.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.409+0000 7f13767fc640 1 -- 172.21.15.55:0/3295110110 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f13780eb090 con 0x7f138015a7f0 2023-08-25T04:22:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.569+0000 7f1387b74640 1 -- 172.21.15.55:0/3295110110 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13800cb6c0 con 0x7f138015a7f0 2023-08-25T04:22:17.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.569+0000 7f13767fc640 1 -- 172.21.15.55:0/3295110110 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v128) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1378009450 con 0x7f138015a7f0 2023-08-25T04:22:17.568 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:22:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.569+0000 7f1387b74640 1 -- 172.21.15.55:0/3295110110 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f13640657a0 msgr2=0x7f1364067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:17.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.569+0000 7f1387b74640 1 --2- 172.21.15.55:0/3295110110 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f13640657a0 0x7f1364067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f137c001240 tx=0x7f137c009040 comp rx=0 tx=0).stop 2023-08-25T04:22:17.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.569+0000 7f1387b74640 1 -- 172.21.15.55:0/3295110110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138015a7f0 msgr2=0x7f1380157e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:17.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.569+0000 7f1387b74640 1 --2- 172.21.15.55:0/3295110110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138015a7f0 0x7f1380157e00 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f137801cd20 tx=0x7f13780195e0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.569+0000 7f1387b74640 1 -- 172.21.15.55:0/3295110110 shutdown_connections 2023-08-25T04:22:17.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.569+0000 7f1387b74640 1 --2- 172.21.15.55:0/3295110110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138015a7f0 0x7f1380157e00 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.569+0000 7f1387b74640 1 --2- 172.21.15.55:0/3295110110 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f13640657a0 0x7f1364067c60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.569+0000 7f1387b74640 1 --2- 172.21.15.55:0/3295110110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13800c9830 0x7f13801520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.569+0000 7f1387b74640 1 --2- 172.21.15.55:0/3295110110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f138006c020 0x7f138014a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.569+0000 7f1387b74640 1 -- 172.21.15.55:0/3295110110 >> 172.21.15.55:0/3295110110 conn(0x7f1380069900 msgr2=0x7f13800acf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:17.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.569+0000 7f1387b74640 1 -- 172.21.15.55:0/3295110110 shutdown_connections 2023-08-25T04:22:17.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.569+0000 7f1387b74640 1 -- 172.21.15.55:0/3295110110 wait complete. 2023-08-25T04:22:17.589 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:22:17.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.733+0000 7f2cfcb11640 1 Processor -- start 2023-08-25T04:22:17.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.733+0000 7f2cfcb11640 1 -- start start 2023-08-25T04:22:17.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.737+0000 7f2cfcb11640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf80cb020 0x7f2cf80c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:17.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.737+0000 7f2cfcb11640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2cf80cdd50 0x7f2cf80cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:17.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.737+0000 7f2cfcb11640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2cf806c720 0x7f2cf806cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:17.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.737+0000 7f2cfcb11640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf806d0b0 con 0x7f2cf806c720 2023-08-25T04:22:17.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.737+0000 7f2cfcb11640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf80cbca0 con 0x7f2cf80cdd50 2023-08-25T04:22:17.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.737+0000 7f2cfcb11640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf80c9470 con 0x7f2cf80cb020 2023-08-25T04:22:17.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.737+0000 7f2cf6d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2cf806c720 0x7f2cf806cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:17.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.737+0000 7f2cf6d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2cf806c720 0x7f2cf806cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39340/0 (socket says 172.21.15.55:39340) 2023-08-25T04:22:17.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.737+0000 7f2cf6d9d640 1 -- 172.21.15.55:0/2436718283 learned_addr learned my addr 172.21.15.55:0/2436718283 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:17.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.737+0000 7f2ceffff640 1 --2- 172.21.15.55:0/2436718283 >> v2:172.21.15.110:3300/0 conn(0x7f2cf80cdd50 0x7f2cf80cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.737+0000 7f2cf659c640 1 --2- 172.21.15.55:0/2436718283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf80cb020 0x7f2cf80c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.737+0000 7f2cf6d9d640 1 -- 172.21.15.55:0/2436718283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf80cb020 msgr2=0x7f2cf80c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.737+0000 7f2cf6d9d640 1 --2- 172.21.15.55:0/2436718283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf80cb020 0x7f2cf80c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.737+0000 7f2cf6d9d640 1 -- 172.21.15.55:0/2436718283 >> v2:172.21.15.110:3300/0 conn(0x7f2cf80cdd50 msgr2=0x7f2cf80cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.737+0000 7f2cf6d9d640 1 --2- 172.21.15.55:0/2436718283 >> v2:172.21.15.110:3300/0 conn(0x7f2cf80cdd50 0x7f2cf80cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.737+0000 7f2cf6d9d640 1 -- 172.21.15.55:0/2436718283 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf80ce1b0 con 0x7f2cf806c720 2023-08-25T04:22:17.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.737+0000 7f2ceffff640 1 --2- 172.21.15.55:0/2436718283 >> v2:172.21.15.110:3300/0 conn(0x7f2cf80cdd50 0x7f2cf80cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:17.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.737+0000 7f2cf659c640 1 --2- 172.21.15.55:0/2436718283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf80cb020 0x7f2cf80c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:17.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.741+0000 7f2cf6d9d640 1 --2- 172.21.15.55:0/2436718283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cf806c720 0x7f2cf806cb70 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80cbea0 tx=0x7f2cf001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5957c371bc9680f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:17.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.741+0000 7f2cf5d9b640 1 -- 172.21.15.55:0/2436718283 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf00a56b0 con 0x7f2cf806c720 2023-08-25T04:22:17.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.741+0000 7f2cf5d9b640 1 -- 172.21.15.55:0/2436718283 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf00a5810 con 0x7f2cf806c720 2023-08-25T04:22:17.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.741+0000 7f2cf5d9b640 1 -- 172.21.15.55:0/2436718283 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf00a5ba0 con 0x7f2cf806c720 2023-08-25T04:22:17.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.741+0000 7f2cfcb11640 1 -- 172.21.15.55:0/2436718283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cf806c720 msgr2=0x7f2cf806cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:17.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.741+0000 7f2cfcb11640 1 --2- 172.21.15.55:0/2436718283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cf806c720 0x7f2cf806cb70 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80cbea0 tx=0x7f2cf001c940 comp rx=0 tx=0).stop 2023-08-25T04:22:17.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.741+0000 7f2cfcb11640 1 -- 172.21.15.55:0/2436718283 shutdown_connections 2023-08-25T04:22:17.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.741+0000 7f2cfcb11640 1 --2- 172.21.15.55:0/2436718283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cf806c720 0x7f2cf806cb70 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.741+0000 7f2cfcb11640 1 --2- 172.21.15.55:0/2436718283 >> v2:172.21.15.110:3300/0 conn(0x7f2cf80cdd50 0x7f2cf80cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.741+0000 7f2cfcb11640 1 --2- 172.21.15.55:0/2436718283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf80cb020 0x7f2cf80c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.741+0000 7f2cfcb11640 1 -- 172.21.15.55:0/2436718283 >> 172.21.15.55:0/2436718283 conn(0x7f2cf8069900 msgr2=0x7f2cf8069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:17.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.741+0000 7f2cfcb11640 1 -- 172.21.15.55:0/2436718283 shutdown_connections 2023-08-25T04:22:17.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.741+0000 7f2cfcb11640 1 -- 172.21.15.55:0/2436718283 wait complete. 2023-08-25T04:22:17.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.741+0000 7f2cfcb11640 1 Processor -- start 2023-08-25T04:22:17.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.741+0000 7f2cfcb11640 1 -- start start 2023-08-25T04:22:17.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cfcb11640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cf806c720 0x7f2cf80ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:17.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cfcb11640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf80cb020 0x7f2cf8151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:17.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cfcb11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cf80cdd50 0x7f2cf8151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:17.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cfcb11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf80b0820 con 0x7f2cf80cdd50 2023-08-25T04:22:17.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cfcb11640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf80b0b00 con 0x7f2cf806c720 2023-08-25T04:22:17.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cfcb11640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf8098b80 con 0x7f2cf80cb020 2023-08-25T04:22:17.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cf6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cf80cdd50 0x7f2cf8151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:17.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cf6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cf80cdd50 0x7f2cf8151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39354/0 (socket says 172.21.15.55:39354) 2023-08-25T04:22:17.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cf6d9d640 1 -- 172.21.15.55:0/3750083371 learned_addr learned my addr 172.21.15.55:0/3750083371 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:17.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cf659c640 1 --2- 172.21.15.55:0/3750083371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cf806c720 0x7f2cf80ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:17.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2ceffff640 1 --2- 172.21.15.55:0/3750083371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf80cb020 0x7f2cf8151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:17.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cf6d9d640 1 -- 172.21.15.55:0/3750083371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf80cb020 msgr2=0x7f2cf8151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:17.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cf6d9d640 1 --2- 172.21.15.55:0/3750083371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf80cb020 0x7f2cf8151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cf6d9d640 1 -- 172.21.15.55:0/3750083371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cf806c720 msgr2=0x7f2cf80ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:17.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cf6d9d640 1 --2- 172.21.15.55:0/3750083371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cf806c720 0x7f2cf80ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cf6d9d640 1 -- 172.21.15.55:0/3750083371 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf0009b30 con 0x7f2cf80cdd50 2023-08-25T04:22:17.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cf6d9d640 1 --2- 172.21.15.55:0/3750083371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cf80cdd50 0x7f2cf8151850 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f2cf001aff0 tx=0x7f2cf00196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:17.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2ceeffd640 1 -- 172.21.15.55:0/3750083371 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf00b8670 con 0x7f2cf80cdd50 2023-08-25T04:22:17.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2ceeffd640 1 -- 172.21.15.55:0/3750083371 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf00b87d0 con 0x7f2cf80cdd50 2023-08-25T04:22:17.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cfcb11640 1 -- 172.21.15.55:0/3750083371 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf8098e60 con 0x7f2cf80cdd50 2023-08-25T04:22:17.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2ceeffd640 1 -- 172.21.15.55:0/3750083371 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf00b8b60 con 0x7f2cf80cdd50 2023-08-25T04:22:17.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cfcb11640 1 -- 172.21.15.55:0/3750083371 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf80ae590 con 0x7f2cf80cdd50 2023-08-25T04:22:17.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2cfcb11640 1 -- 172.21.15.55:0/3750083371 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf80990a0 con 0x7f2cf80cdd50 2023-08-25T04:22:17.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.745+0000 7f2ceeffd640 1 -- 172.21.15.55:0/3750083371 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f2cf00b8cc0 con 0x7f2cf80cdd50 2023-08-25T04:22:17.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.749+0000 7f2ceeffd640 1 --2- 172.21.15.55:0/3750083371 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f2cd80657a0 0x7f2cd8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:17.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.749+0000 7f2ceeffd640 1 -- 172.21.15.55:0/3750083371 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f2cf011e4c0 con 0x7f2cf80cdd50 2023-08-25T04:22:17.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.749+0000 7f2cf659c640 1 --2- 172.21.15.55:0/3750083371 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f2cd80657a0 0x7f2cd8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:17.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.749+0000 7f2cf659c640 1 --2- 172.21.15.55:0/3750083371 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f2cd80657a0 0x7f2cd8067c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800ab60 tx=0x7f2ce8008040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:17.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.753+0000 7f2ceeffd640 1 -- 172.21.15.55:0/3750083371 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2cf80990a0 con 0x7f2cf80cdd50 2023-08-25T04:22:17.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.909+0000 7f2cfcb11640 1 -- 172.21.15.55:0/3750083371 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2cf80990a0 con 0x7f2cf80cdd50 2023-08-25T04:22:17.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.909+0000 7f2ceeffd640 1 -- 172.21.15.55:0/3750083371 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v128) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2cf80990a0 con 0x7f2cf80cdd50 2023-08-25T04:22:17.910 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:22:17.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.909+0000 7f2cfcb11640 1 -- 172.21.15.55:0/3750083371 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f2cd80657a0 msgr2=0x7f2cd8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:17.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.909+0000 7f2cfcb11640 1 --2- 172.21.15.55:0/3750083371 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f2cd80657a0 0x7f2cd8067c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800ab60 tx=0x7f2ce8008040 comp rx=0 tx=0).stop 2023-08-25T04:22:17.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.909+0000 7f2cfcb11640 1 -- 172.21.15.55:0/3750083371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cf80cdd50 msgr2=0x7f2cf8151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:17.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.909+0000 7f2cfcb11640 1 --2- 172.21.15.55:0/3750083371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cf80cdd50 0x7f2cf8151850 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f2cf001aff0 tx=0x7f2cf00196e0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.909+0000 7f2cfcb11640 1 -- 172.21.15.55:0/3750083371 shutdown_connections 2023-08-25T04:22:17.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.909+0000 7f2cfcb11640 1 --2- 172.21.15.55:0/3750083371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cf80cdd50 0x7f2cf8151850 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.909+0000 7f2cfcb11640 1 --2- 172.21.15.55:0/3750083371 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f2cd80657a0 0x7f2cd8067c60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.909+0000 7f2cfcb11640 1 --2- 172.21.15.55:0/3750083371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf80cb020 0x7f2cf8151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.909+0000 7f2cfcb11640 1 --2- 172.21.15.55:0/3750083371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cf806c720 0x7f2cf80ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:17.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.909+0000 7f2cfcb11640 1 -- 172.21.15.55:0/3750083371 >> 172.21.15.55:0/3750083371 conn(0x7f2cf8069900 msgr2=0x7f2cf806fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:17.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.909+0000 7f2cfcb11640 1 -- 172.21.15.55:0/3750083371 shutdown_connections 2023-08-25T04:22:17.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:17.909+0000 7f2cfcb11640 1 -- 172.21.15.55:0/3750083371 wait complete. 2023-08-25T04:22:17.931 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-25T04:22:18.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.077+0000 7f3fc271e640 1 Processor -- start 2023-08-25T04:22:18.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.077+0000 7f3fc271e640 1 -- start start 2023-08-25T04:22:18.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.077+0000 7f3fc271e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3fbc0ad6b0 0x7f3fbc0b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:18.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.077+0000 7f3fc271e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3fbc0cb710 0x7f3fbc06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:18.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.077+0000 7f3fc271e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fbc0b1750 0x7f3fbc06cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:18.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.077+0000 7f3fc271e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fbc0cdf20 con 0x7f3fbc0ad6b0 2023-08-25T04:22:18.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.077+0000 7f3fc271e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fbc09bc40 con 0x7f3fbc0cb710 2023-08-25T04:22:18.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.077+0000 7f3fc271e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc09bf20 con 0x7f3fbc0b1750 2023-08-25T04:22:18.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.077+0000 7f3fbbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3fbc0ad6b0 0x7f3fbc0b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.077+0000 7f3fbbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3fbc0ad6b0 0x7f3fbc0b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39368/0 (socket says 172.21.15.55:39368) 2023-08-25T04:22:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.077+0000 7f3fbbfff640 1 -- 172.21.15.55:0/2743917675 learned_addr learned my addr 172.21.15.55:0/2743917675 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.077+0000 7f3fc0cbb640 1 --2- 172.21.15.55:0/2743917675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fbc0b1750 0x7f3fbc06cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.077+0000 7f3fb3fff640 1 --2- 172.21.15.55:0/2743917675 >> v2:172.21.15.110:3300/0 conn(0x7f3fbc0cb710 0x7f3fbc06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.077+0000 7f3fbbfff640 1 -- 172.21.15.55:0/2743917675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fbc0b1750 msgr2=0x7f3fbc06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.077+0000 7f3fbbfff640 1 --2- 172.21.15.55:0/2743917675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fbc0b1750 0x7f3fbc06cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.077+0000 7f3fbbfff640 1 -- 172.21.15.55:0/2743917675 >> v2:172.21.15.110:3300/0 conn(0x7f3fbc0cb710 msgr2=0x7f3fbc06c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:18.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.077+0000 7f3fbbfff640 1 --2- 172.21.15.55:0/2743917675 >> v2:172.21.15.110:3300/0 conn(0x7f3fbc0cb710 0x7f3fbc06c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.077+0000 7f3fbbfff640 1 -- 172.21.15.55:0/2743917675 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc06c1c0 con 0x7f3fbc0ad6b0 2023-08-25T04:22:18.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.081+0000 7f3fbbfff640 1 --2- 172.21.15.55:0/2743917675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fbc0ad6b0 0x7f3fbc0b1210 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0cbf10 tx=0x7f3fac01ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32147934f41f012 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:18.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.081+0000 7f3fbb7fe640 1 -- 172.21.15.55:0/2743917675 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac0a7ad0 con 0x7f3fbc0ad6b0 2023-08-25T04:22:18.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.081+0000 7f3fbb7fe640 1 -- 172.21.15.55:0/2743917675 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac0a7c30 con 0x7f3fbc0ad6b0 2023-08-25T04:22:18.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.081+0000 7f3fbb7fe640 1 -- 172.21.15.55:0/2743917675 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac0af440 con 0x7f3fbc0ad6b0 2023-08-25T04:22:18.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.081+0000 7f3fc271e640 1 -- 172.21.15.55:0/2743917675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fbc0ad6b0 msgr2=0x7f3fbc0b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:18.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.081+0000 7f3fc271e640 1 --2- 172.21.15.55:0/2743917675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fbc0ad6b0 0x7f3fbc0b1210 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc0cbf10 tx=0x7f3fac01ebb0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.081+0000 7f3fc271e640 1 -- 172.21.15.55:0/2743917675 shutdown_connections 2023-08-25T04:22:18.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.081+0000 7f3fc271e640 1 --2- 172.21.15.55:0/2743917675 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fbc0b1750 0x7f3fbc06cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.081+0000 7f3fc271e640 1 --2- 172.21.15.55:0/2743917675 >> v2:172.21.15.110:3300/0 conn(0x7f3fbc0cb710 0x7f3fbc06c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.081+0000 7f3fc271e640 1 --2- 172.21.15.55:0/2743917675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fbc0ad6b0 0x7f3fbc0b1210 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.081+0000 7f3fc271e640 1 -- 172.21.15.55:0/2743917675 >> 172.21.15.55:0/2743917675 conn(0x7f3fbc069900 msgr2=0x7f3fbc069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:18.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.081+0000 7f3fc271e640 1 -- 172.21.15.55:0/2743917675 shutdown_connections 2023-08-25T04:22:18.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.081+0000 7f3fc271e640 1 -- 172.21.15.55:0/2743917675 wait complete. 2023-08-25T04:22:18.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fc271e640 1 Processor -- start 2023-08-25T04:22:18.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fc271e640 1 -- start start 2023-08-25T04:22:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fc271e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fbc0ad6b0 0x7f3fbc14a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fc271e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fbc0b1750 0x7f3fbc098a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fc271e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fbc0cb710 0x7f3fbc098f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fc271e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc0af630 con 0x7f3fbc0ad6b0 2023-08-25T04:22:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fc271e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc14ac10 con 0x7f3fbc0cb710 2023-08-25T04:22:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fc271e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc0ae9b0 con 0x7f3fbc0b1750 2023-08-25T04:22:18.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fbbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fbc0ad6b0 0x7f3fbc14a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fbbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fbc0ad6b0 0x7f3fbc14a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39382/0 (socket says 172.21.15.55:39382) 2023-08-25T04:22:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fbbfff640 1 -- 172.21.15.55:0/3448395347 learned_addr learned my addr 172.21.15.55:0/3448395347 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fb3fff640 1 --2- 172.21.15.55:0/3448395347 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fbc0b1750 0x7f3fbc098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fc0cbb640 1 --2- 172.21.15.55:0/3448395347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fbc0cb710 0x7f3fbc098f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fbbfff640 1 -- 172.21.15.55:0/3448395347 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fbc0b1750 msgr2=0x7f3fbc098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fbbfff640 1 --2- 172.21.15.55:0/3448395347 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fbc0b1750 0x7f3fbc098a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fbbfff640 1 -- 172.21.15.55:0/3448395347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fbc0cb710 msgr2=0x7f3fbc098f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:18.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fbbfff640 1 --2- 172.21.15.55:0/3448395347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fbc0cb710 0x7f3fbc098f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fbbfff640 1 -- 172.21.15.55:0/3448395347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac00b720 con 0x7f3fbc0ad6b0 2023-08-25T04:22:18.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fbbfff640 1 --2- 172.21.15.55:0/3448395347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fbc0ad6b0 0x7f3fbc14a6d0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0b2040 tx=0x7f3fac01b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:18.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fb97fa640 1 -- 172.21.15.55:0/3448395347 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac005ba0 con 0x7f3fbc0ad6b0 2023-08-25T04:22:18.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fb97fa640 1 -- 172.21.15.55:0/3448395347 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac005d00 con 0x7f3fbc0ad6b0 2023-08-25T04:22:18.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fb97fa640 1 -- 172.21.15.55:0/3448395347 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac003a70 con 0x7f3fbc0ad6b0 2023-08-25T04:22:18.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fc271e640 1 -- 172.21.15.55:0/3448395347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fbc0aec90 con 0x7f3fbc0ad6b0 2023-08-25T04:22:18.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.085+0000 7f3fc271e640 1 -- 172.21.15.55:0/3448395347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fbc0af250 con 0x7f3fbc0ad6b0 2023-08-25T04:22:18.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.089+0000 7f3fc271e640 1 -- 172.21.15.55:0/3448395347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fbc0af770 con 0x7f3fbc0ad6b0 2023-08-25T04:22:18.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.089+0000 7f3fb97fa640 1 -- 172.21.15.55:0/3448395347 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f3fac003bd0 con 0x7f3fbc0ad6b0 2023-08-25T04:22:18.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.089+0000 7f3fb97fa640 1 --2- 172.21.15.55:0/3448395347 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f3f9c0657a0 0x7f3f9c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:18.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.089+0000 7f3fb97fa640 1 -- 172.21.15.55:0/3448395347 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f3fac11d1a0 con 0x7f3fbc0ad6b0 2023-08-25T04:22:18.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.089+0000 7f3fb3fff640 1 --2- 172.21.15.55:0/3448395347 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f3f9c0657a0 0x7f3f9c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:18.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.089+0000 7f3fb3fff640 1 --2- 172.21.15.55:0/3448395347 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f3f9c0657a0 0x7f3f9c067c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc151860 tx=0x7f3fa4008040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:18.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.093+0000 7f3fb97fa640 1 -- 172.21.15.55:0/3448395347 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3fbc0af770 con 0x7f3fbc0ad6b0 2023-08-25T04:22:18.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.249+0000 7f3fc271e640 1 -- 172.21.15.55:0/3448395347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3fbc0af770 con 0x7f3fbc0ad6b0 2023-08-25T04:22:18.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.257+0000 7f3fb97fa640 1 -- 172.21.15.55:0/3448395347 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3fbc0af770 con 0x7f3fbc0ad6b0 2023-08-25T04:22:18.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.257+0000 7f3fc271e640 1 -- 172.21.15.55:0/3448395347 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f3f9c0657a0 msgr2=0x7f3f9c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:18.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.257+0000 7f3fc271e640 1 --2- 172.21.15.55:0/3448395347 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f3f9c0657a0 0x7f3f9c067c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc151860 tx=0x7f3fa4008040 comp rx=0 tx=0).stop 2023-08-25T04:22:18.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.257+0000 7f3fc271e640 1 -- 172.21.15.55:0/3448395347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fbc0ad6b0 msgr2=0x7f3fbc14a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:18.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.257+0000 7f3fc271e640 1 --2- 172.21.15.55:0/3448395347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fbc0ad6b0 0x7f3fbc14a6d0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f3fac0b2040 tx=0x7f3fac01b950 comp rx=0 tx=0).stop 2023-08-25T04:22:18.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.257+0000 7f3fc271e640 1 -- 172.21.15.55:0/3448395347 shutdown_connections 2023-08-25T04:22:18.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.257+0000 7f3fc271e640 1 --2- 172.21.15.55:0/3448395347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fbc0cb710 0x7f3fbc098f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.257+0000 7f3fc271e640 1 --2- 172.21.15.55:0/3448395347 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f3f9c0657a0 0x7f3f9c067c60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.257+0000 7f3fc271e640 1 --2- 172.21.15.55:0/3448395347 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fbc0b1750 0x7f3fbc098a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.257+0000 7f3fc271e640 1 --2- 172.21.15.55:0/3448395347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fbc0ad6b0 0x7f3fbc14a6d0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.257+0000 7f3fc271e640 1 -- 172.21.15.55:0/3448395347 >> 172.21.15.55:0/3448395347 conn(0x7f3fbc069900 msgr2=0x7f3fbc0cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:18.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.257+0000 7f3fc271e640 1 -- 172.21.15.55:0/3448395347 shutdown_connections 2023-08-25T04:22:18.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.257+0000 7f3fc271e640 1 -- 172.21.15.55:0/3448395347 wait complete. 2023-08-25T04:22:18.277 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T04:22:18.278 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:22:18.340 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T04:22:18.392 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T04:22:18.393 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:22:18.393 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:22:18.404 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T04:22:18.404 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:22:18.405 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:22:18.414 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:22:18.416 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:22:18.416 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:22:18.458 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T04:22:18.458 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T04:22:18.459 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:22:18.469 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T04:22:18.470 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-25T04:22:18.470 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:22:18.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50d2648640 1 Processor -- start 2023-08-25T04:22:18.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50d2648640 1 -- start start 2023-08-25T04:22:18.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50d2648640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50cc0ce220 0x7f50cc0b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:18.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50d2648640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50cc0b29b0 con 0x7f50cc0d0da0 2023-08-25T04:22:18.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50d2648640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50cc0ce6b0 con 0x7f50cc0cdde0 2023-08-25T04:22:18.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50d2648640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc0b1dc0 con 0x7f50cc0ce220 2023-08-25T04:22:18.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50cbfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f50cc0d0da0 0x7f50cc0d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41062/0 (socket says 172.21.15.55:41062) 2023-08-25T04:22:18.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50cbfff640 1 -- 172.21.15.55:0/130505802 learned_addr learned my addr 172.21.15.55:0/130505802 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:18.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50caffd640 1 -- 172.21.15.55:0/130505802 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3027775682 0 0) 0x7f50cc0b29b0 con 0x7f50cc0d0da0 2023-08-25T04:22:18.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50caffd640 1 -- 172.21.15.55:0/130505802 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50b4003530 con 0x7f50cc0d0da0 2023-08-25T04:22:18.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50d0be5640 1 --2- 172.21.15.55:0/130505802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50cc0ce220 0x7f50cc0b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:18.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50caffd640 1 -- 172.21.15.55:0/130505802 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3756209923 0 0) 0x7f50b4003530 con 0x7f50cc0d0da0 2023-08-25T04:22:18.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50caffd640 1 -- 172.21.15.55:0/130505802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50cc0ce220 msgr2=0x7f50cc0b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:18.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50caffd640 1 --2- 172.21.15.55:0/130505802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50cc0ce220 0x7f50cc0b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50caffd640 1 -- 172.21.15.55:0/130505802 >> v1:172.21.15.110:6789/0 conn(0x7f50cc0cdde0 legacy=0x7f50cc0b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:18.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50caffd640 1 -- 172.21.15.55:0/130505802 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc0b2080 con 0x7f50cc0d0da0 2023-08-25T04:22:18.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50caffd640 1 -- 172.21.15.55:0/130505802 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f50bc001800 con 0x7f50cc0d0da0 2023-08-25T04:22:18.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50caffd640 1 -- 172.21.15.55:0/130505802 >> v1:172.21.15.55:6789/0 conn(0x7f50cc0d0da0 legacy=0x7f50cc0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:18.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50caffd640 1 --2- 172.21.15.55:0/130505802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50b40039b0 0x7f50b4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:18.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50caffd640 1 --2- 172.21.15.55:0/130505802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50cc0ce220 0x7f50b40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:18.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50caffd640 1 --2- 172.21.15.55:0/130505802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b4004d10 0x7f50b4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:18.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50caffd640 1 -- 172.21.15.55:0/130505802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc0b1dc0 con 0x7f50b40039b0 2023-08-25T04:22:18.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50caffd640 1 -- 172.21.15.55:0/130505802 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b400bb00 con 0x7f50b4004d10 2023-08-25T04:22:18.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.641+0000 7f50caffd640 1 -- 172.21.15.55:0/130505802 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b400bcc0 con 0x7f50cc0ce220 2023-08-25T04:22:18.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.645+0000 7f50cbfff640 1 --2- 172.21.15.55:0/130505802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50b40039b0 0x7f50b4003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:18.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.645+0000 7f50cb7fe640 1 --2- 172.21.15.55:0/130505802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50cc0ce220 0x7f50b40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:18.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.645+0000 7f50d0be5640 1 --2- 172.21.15.55:0/130505802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b4004d10 0x7f50b4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:18.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.645+0000 7f50cbfff640 1 -- 172.21.15.55:0/130505802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50cc0ce220 msgr2=0x7f50b40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:18.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.645+0000 7f50cbfff640 1 --2- 172.21.15.55:0/130505802 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50cc0ce220 0x7f50b40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.645+0000 7f50cbfff640 1 -- 172.21.15.55:0/130505802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b4004d10 msgr2=0x7f50b4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:18.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.645+0000 7f50cbfff640 1 --2- 172.21.15.55:0/130505802 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b4004d10 0x7f50b4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.645+0000 7f50cbfff640 1 -- 172.21.15.55:0/130505802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b4003530 con 0x7f50b40039b0 2023-08-25T04:22:18.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.645+0000 7f50cbfff640 1 --2- 172.21.15.55:0/130505802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50b40039b0 0x7f50b4003db0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f50bc00c160 tx=0x7f50bc01f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2e559cef3476fe server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:18.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.645+0000 7f50caffd640 1 -- 172.21.15.55:0/130505802 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc007270 con 0x7f50b40039b0 2023-08-25T04:22:18.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.645+0000 7f50caffd640 1 -- 172.21.15.55:0/130505802 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50bc0ab070 con 0x7f50b40039b0 2023-08-25T04:22:18.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.645+0000 7f50caffd640 1 -- 172.21.15.55:0/130505802 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc007610 con 0x7f50b40039b0 2023-08-25T04:22:18.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.649+0000 7f50d2648640 1 -- 172.21.15.55:0/130505802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50b40039b0 msgr2=0x7f50b4003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:18.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.649+0000 7f50d2648640 1 --2- 172.21.15.55:0/130505802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50b40039b0 0x7f50b4003db0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f50bc00c160 tx=0x7f50bc01f350 comp rx=0 tx=0).stop 2023-08-25T04:22:18.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.649+0000 7f50d0be5640 1 -- 172.21.15.55:0/130505802 reap_dead start 2023-08-25T04:22:18.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.649+0000 7f50d2648640 1 -- 172.21.15.55:0/130505802 shutdown_connections 2023-08-25T04:22:18.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.649+0000 7f50d2648640 1 -- 172.21.15.55:0/130505802 >> 172.21.15.55:0/130505802 conn(0x7f50cc09bae0 msgr2=0x7f50cc0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:18.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.649+0000 7f50d2648640 1 -- 172.21.15.55:0/130505802 shutdown_connections 2023-08-25T04:22:18.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.649+0000 7f50d2648640 1 -- 172.21.15.55:0/130505802 wait complete. 2023-08-25T04:22:18.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.649+0000 7f50d2648640 1 Processor -- start 2023-08-25T04:22:18.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.649+0000 7f50d2648640 1 -- start start 2023-08-25T04:22:18.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.649+0000 7f50d2648640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b40039b0 0x7f50cc1f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:18.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.649+0000 7f50d2648640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50cc0cbef0 0x7f50cc0c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:18.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.649+0000 7f50d2648640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50cc0cc370 0x7f50cc0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:18.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.649+0000 7f50d2648640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc0ca610 con 0x7f50cc0cbef0 2023-08-25T04:22:18.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.649+0000 7f50d2648640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc0ca8f0 con 0x7f50b40039b0 2023-08-25T04:22:18.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.649+0000 7f50d2648640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc0cabd0 con 0x7f50cc0cc370 2023-08-25T04:22:18.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.649+0000 7f50cb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50cc0cbef0 0x7f50cc0c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:18.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.649+0000 7f50cb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50cc0cbef0 0x7f50cc0c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39400/0 (socket says 172.21.15.55:39400) 2023-08-25T04:22:18.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.649+0000 7f50cb7fe640 1 -- 172.21.15.55:0/4273614229 learned_addr learned my addr 172.21.15.55:0/4273614229 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:18.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50d0be5640 1 --2- 172.21.15.55:0/4273614229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50cc0cc370 0x7f50cc0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:18.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50cbfff640 1 --2- 172.21.15.55:0/4273614229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b40039b0 0x7f50cc1f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:18.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50cb7fe640 1 -- 172.21.15.55:0/4273614229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50cc0cc370 msgr2=0x7f50cc0c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:18.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50cb7fe640 1 --2- 172.21.15.55:0/4273614229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50cc0cc370 0x7f50cc0c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50cb7fe640 1 -- 172.21.15.55:0/4273614229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b40039b0 msgr2=0x7f50cc1f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:18.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50cb7fe640 1 --2- 172.21.15.55:0/4273614229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b40039b0 0x7f50cc1f19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50cb7fe640 1 -- 172.21.15.55:0/4273614229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc0caeb0 con 0x7f50cc0cbef0 2023-08-25T04:22:18.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50cbfff640 1 --2- 172.21.15.55:0/4273614229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b40039b0 0x7f50cc1f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:18.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50d0be5640 1 --2- 172.21.15.55:0/4273614229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50cc0cc370 0x7f50cc0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:18.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50cb7fe640 1 --2- 172.21.15.55:0/4273614229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50cc0cbef0 0x7f50cc0c82d0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f50c000f870 tx=0x7f50c000fd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:18.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50c8ff9640 1 -- 172.21.15.55:0/4273614229 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c0001330 con 0x7f50cc0cbef0 2023-08-25T04:22:18.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50c8ff9640 1 -- 172.21.15.55:0/4273614229 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c0001cf0 con 0x7f50cc0cbef0 2023-08-25T04:22:18.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50d2648640 1 -- 172.21.15.55:0/4273614229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50cc0cb190 con 0x7f50cc0cbef0 2023-08-25T04:22:18.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50c8ff9640 1 -- 172.21.15.55:0/4273614229 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c000d730 con 0x7f50cc0cbef0 2023-08-25T04:22:18.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50d2648640 1 -- 172.21.15.55:0/4273614229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50cc0ca2a0 con 0x7f50cc0cbef0 2023-08-25T04:22:18.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50d2648640 1 -- 172.21.15.55:0/4273614229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50cc0cb3b0 con 0x7f50cc0cbef0 2023-08-25T04:22:18.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50c8ff9640 1 -- 172.21.15.55:0/4273614229 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f50c000d890 con 0x7f50cc0cbef0 2023-08-25T04:22:18.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50c8ff9640 1 --2- 172.21.15.55:0/4273614229 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f50b80657a0 0x7f50b8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:18.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.653+0000 7f50c8ff9640 1 -- 172.21.15.55:0/4273614229 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f50c0082ff0 con 0x7f50cc0cbef0 2023-08-25T04:22:18.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.657+0000 7f50cbfff640 1 --2- 172.21.15.55:0/4273614229 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f50b80657a0 0x7f50b8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:18.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.657+0000 7f50cbfff640 1 --2- 172.21.15.55:0/4273614229 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f50b80657a0 0x7f50b8067c60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0af000 tx=0x7f50bc0b4040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:18.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.657+0000 7f50c8ff9640 1 -- 172.21.15.55:0/4273614229 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f50c00b3d90 con 0x7f50cc0cbef0 2023-08-25T04:22:18.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.849+0000 7f50d2648640 1 -- 172.21.15.55:0/4273614229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50cc04dbe0 con 0x7f50cc0cbef0 2023-08-25T04:22:18.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.849+0000 7f50c8ff9640 1 -- 172.21.15.55:0/4273614229 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f50c0050930 con 0x7f50cc0cbef0 2023-08-25T04:22:18.850 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:18.850 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":60,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7076,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2585223071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2585223071},{"type":"v1","addr":"172.21.15.55:6834","nonce":2585223071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":52},{"gid":7918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3510911374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3510911374},{"type":"v1","addr":"172.21.15.110:6837","nonce":3510911374}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":7921,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/1404270940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":1404270940},{"type":"v1","addr":"172.21.15.110:6836","nonce":1404270940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53},{"gid":8904,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/372473668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":372473668},{"type":"v1","addr":"172.21.15.55:6835","nonce":372473668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60}],"filesystems":[]} 2023-08-25T04:22:18.851 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 60 2023-08-25T04:22:18.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.849+0000 7f50d2648640 1 -- 172.21.15.55:0/4273614229 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f50b80657a0 msgr2=0x7f50b8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:18.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.849+0000 7f50d2648640 1 --2- 172.21.15.55:0/4273614229 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f50b80657a0 0x7f50b8067c60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0af000 tx=0x7f50bc0b4040 comp rx=0 tx=0).stop 2023-08-25T04:22:18.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.849+0000 7f50d2648640 1 -- 172.21.15.55:0/4273614229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50cc0cbef0 msgr2=0x7f50cc0c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:18.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.849+0000 7f50d2648640 1 --2- 172.21.15.55:0/4273614229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50cc0cbef0 0x7f50cc0c82d0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f50c000f870 tx=0x7f50c000fd30 comp rx=0 tx=0).stop 2023-08-25T04:22:18.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.849+0000 7f50d2648640 1 -- 172.21.15.55:0/4273614229 shutdown_connections 2023-08-25T04:22:18.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.849+0000 7f50d2648640 1 --2- 172.21.15.55:0/4273614229 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f50b80657a0 0x7f50b8067c60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.849+0000 7f50d2648640 1 --2- 172.21.15.55:0/4273614229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50cc0cc370 0x7f50cc0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.849+0000 7f50d2648640 1 --2- 172.21.15.55:0/4273614229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50cc0cbef0 0x7f50cc0c82d0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.849+0000 7f50d2648640 1 --2- 172.21.15.55:0/4273614229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50b40039b0 0x7f50cc1f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:18.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.849+0000 7f50d2648640 1 -- 172.21.15.55:0/4273614229 >> 172.21.15.55:0/4273614229 conn(0x7f50cc09bae0 msgr2=0x7f50cc0cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:18.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.849+0000 7f50d2648640 1 -- 172.21.15.55:0/4273614229 shutdown_connections 2023-08-25T04:22:18.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:18.849+0000 7f50d2648640 1 -- 172.21.15.55:0/4273614229 wait complete. 2023-08-25T04:22:18.871 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-25T04:22:18.871 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-25T04:22:18.871 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-25T04:22:18.872 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:22:18.872 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-25T04:22:18.872 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-25T04:22:18.872 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-25T04:22:18.873 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:22:18.873 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-25T04:22:18.873 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-25T04:22:18.873 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-25T04:22:18.873 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:22:18.874 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-25T04:22:18.874 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-25T04:22:18.874 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-25T04:22:18.874 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T04:22:18.886 INFO:tasks.ceph.mds.a:Stopped 2023-08-25T04:22:18.887 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-25T04:22:18.888 INFO:tasks.ceph.mds.c:Stopped 2023-08-25T04:22:18.888 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-25T04:22:18.890 INFO:tasks.ceph.mds.b:Stopped 2023-08-25T04:22:18.890 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-25T04:22:18.891 INFO:tasks.ceph.mds.d:Stopped 2023-08-25T04:22:18.891 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-25T04:22:18.934 INFO:tasks.ceph.mds.a:Started 2023-08-25T04:22:18.935 DEBUG:teuthology.parallel:result is None 2023-08-25T04:22:18.936 INFO:tasks.ceph.mds.b:Started 2023-08-25T04:22:18.937 DEBUG:teuthology.parallel:result is None 2023-08-25T04:22:18.938 INFO:tasks.ceph.mds.c:Started 2023-08-25T04:22:18.938 DEBUG:teuthology.parallel:result is None 2023-08-25T04:22:18.940 INFO:tasks.ceph.mds.d:Started 2023-08-25T04:22:18.940 DEBUG:teuthology.parallel:result is None 2023-08-25T04:22:18.940 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-25T04:22:19.024 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2023-08-25T04:22:19.025 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-08-25T04:22:19.026 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T04:22:19.027 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2023-08-25T04:22:19.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.093+0000 7fb73e1ba640 1 Processor -- start 2023-08-25T04:22:19.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.093+0000 7fb73e1ba640 1 -- start start 2023-08-25T04:22:19.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.093+0000 7fb73e1ba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb73815eba0 0x7fb7380b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:19.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.093+0000 7fb73e1ba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7380ac3a0 con 0x7fb73815ef80 2023-08-25T04:22:19.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.093+0000 7fb73e1ba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7380b1390 con 0x7fb7380ceeb0 2023-08-25T04:22:19.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.093+0000 7fb73e1ba640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7380b1670 con 0x7fb73815eba0 2023-08-25T04:22:19.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.093+0000 7fb7377fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb73815eba0 0x7fb7380b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:19.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.093+0000 7fb7377fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb73815eba0 0x7fb7380b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39434/0 (socket says 172.21.15.55:39434) 2023-08-25T04:22:19.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.093+0000 7fb7377fe640 1 -- 172.21.15.55:0/2102519662 learned_addr learned my addr 172.21.15.55:0/2102519662 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:19.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.093+0000 7fb7377fe640 1 -- 172.21.15.55:0/2102519662 >> v1:172.21.15.110:6789/0 conn(0x7fb7380ceeb0 legacy=0x7fb7380ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:19.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.093+0000 7fb7377fe640 1 -- 172.21.15.55:0/2102519662 >> v1:172.21.15.55:6789/0 conn(0x7fb73815ef80 legacy=0x7fb7380ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:19.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.093+0000 7fb7377fe640 1 -- 172.21.15.55:0/2102519662 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7380b1950 con 0x7fb73815eba0 2023-08-25T04:22:19.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.097+0000 7fb7377fe640 1 --2- 172.21.15.55:0/2102519662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73815eba0 0x7fb7380b2a40 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fb728009870 tx=0x7fb72801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10476a6240157a53 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:19.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.097+0000 7fb7367fc640 1 -- 172.21.15.55:0/2102519662 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7280aa670 con 0x7fb73815eba0 2023-08-25T04:22:19.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.097+0000 7fb7367fc640 1 -- 172.21.15.55:0/2102519662 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7280aa7d0 con 0x7fb73815eba0 2023-08-25T04:22:19.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.097+0000 7fb7367fc640 1 -- 172.21.15.55:0/2102519662 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7280aab60 con 0x7fb73815eba0 2023-08-25T04:22:19.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.097+0000 7fb73e1ba640 1 -- 172.21.15.55:0/2102519662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73815eba0 msgr2=0x7fb7380b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:19.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.097+0000 7fb73e1ba640 1 --2- 172.21.15.55:0/2102519662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73815eba0 0x7fb7380b2a40 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fb728009870 tx=0x7fb72801c510 comp rx=0 tx=0).stop 2023-08-25T04:22:19.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.097+0000 7fb73e1ba640 1 -- 172.21.15.55:0/2102519662 shutdown_connections 2023-08-25T04:22:19.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.097+0000 7fb73e1ba640 1 --2- 172.21.15.55:0/2102519662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73815eba0 0x7fb7380b2a40 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:19.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.097+0000 7fb73e1ba640 1 -- 172.21.15.55:0/2102519662 >> 172.21.15.55:0/2102519662 conn(0x7fb738069d00 msgr2=0x7fb73806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:19.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.097+0000 7fb73e1ba640 1 -- 172.21.15.55:0/2102519662 shutdown_connections 2023-08-25T04:22:19.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.097+0000 7fb73e1ba640 1 -- 172.21.15.55:0/2102519662 wait complete. 2023-08-25T04:22:19.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.097+0000 7fb73e1ba640 1 Processor -- start 2023-08-25T04:22:19.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.097+0000 7fb73e1ba640 1 -- start start 2023-08-25T04:22:19.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb73e1ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7380ceeb0 0x7fb7381530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:19.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb73e1ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73815eba0 0x7fb7381f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:19.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb73e1ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb73815ef80 0x7fb7381f8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:19.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb73e1ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7380c5950 con 0x7fb73815eba0 2023-08-25T04:22:19.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb73e1ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7381f9460 con 0x7fb73815ef80 2023-08-25T04:22:19.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb73e1ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb738152dc0 con 0x7fb7380ceeb0 2023-08-25T04:22:19.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb736ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73815eba0 0x7fb7381f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:19.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb736ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73815eba0 0x7fb7381f89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39436/0 (socket says 172.21.15.55:39436) 2023-08-25T04:22:19.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb736ffd640 1 -- 172.21.15.55:0/2395929718 learned_addr learned my addr 172.21.15.55:0/2395929718 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:19.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb7377fe640 1 --2- 172.21.15.55:0/2395929718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7380ceeb0 0x7fb7381530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:19.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb737fff640 1 --2- 172.21.15.55:0/2395929718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb73815ef80 0x7fb7381f8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:19.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb736ffd640 1 -- 172.21.15.55:0/2395929718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7380ceeb0 msgr2=0x7fb7381530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:19.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb736ffd640 1 --2- 172.21.15.55:0/2395929718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7380ceeb0 0x7fb7381530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:19.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb736ffd640 1 -- 172.21.15.55:0/2395929718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb73815ef80 msgr2=0x7fb7381f8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:19.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb736ffd640 1 --2- 172.21.15.55:0/2395929718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb73815ef80 0x7fb7381f8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:19.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb736ffd640 1 -- 172.21.15.55:0/2395929718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7280094d0 con 0x7fb73815eba0 2023-08-25T04:22:19.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb737fff640 1 --2- 172.21.15.55:0/2395929718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb73815ef80 0x7fb7381f8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:19.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb736ffd640 1 --2- 172.21.15.55:0/2395929718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73815eba0 0x7fb7381f89e0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00c410 tx=0x7fb72c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:19.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb71ffff640 1 -- 172.21.15.55:0/2395929718 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0052d0 con 0x7fb73815eba0 2023-08-25T04:22:19.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb71ffff640 1 -- 172.21.15.55:0/2395929718 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72c005430 con 0x7fb73815eba0 2023-08-25T04:22:19.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb71ffff640 1 -- 172.21.15.55:0/2395929718 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72c003840 con 0x7fb73815eba0 2023-08-25T04:22:19.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb73e1ba640 1 -- 172.21.15.55:0/2395929718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7381f9720 con 0x7fb73815eba0 2023-08-25T04:22:19.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb73e1ba640 1 -- 172.21.15.55:0/2395929718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb738165080 con 0x7fb73815eba0 2023-08-25T04:22:19.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.101+0000 7fb73e1ba640 1 -- 172.21.15.55:0/2395929718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7381571d0 con 0x7fb73815eba0 2023-08-25T04:22:19.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.105+0000 7fb71ffff640 1 -- 172.21.15.55:0/2395929718 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fb72c0039a0 con 0x7fb73815eba0 2023-08-25T04:22:19.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.105+0000 7fb71ffff640 1 --2- 172.21.15.55:0/2395929718 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb7240657a0 0x7fb724067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:19.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.105+0000 7fb71ffff640 1 -- 172.21.15.55:0/2395929718 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fb72c0824f0 con 0x7fb73815eba0 2023-08-25T04:22:19.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.105+0000 7fb7377fe640 1 --2- 172.21.15.55:0/2395929718 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb7240657a0 0x7fb724067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:19.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.105+0000 7fb7377fe640 1 --2- 172.21.15.55:0/2395929718 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb7240657a0 0x7fb724067c60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb7280ae000 tx=0x7fb7280b5040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:19.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.109+0000 7fb71ffff640 1 -- 172.21.15.55:0/2395929718 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb72c04ff30 con 0x7fb73815eba0 2023-08-25T04:22:19.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.281+0000 7fb73e1ba640 1 -- 172.21.15.55:0/2395929718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb73804dbe0 con 0x7fb73815eba0 2023-08-25T04:22:19.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.901+0000 7fb71ffff640 1 -- 172.21.15.55:0/2395929718 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v130) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb72c053550 con 0x7fb73815eba0 2023-08-25T04:22:19.901 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-08-25T04:22:19.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.901+0000 7fb73e1ba640 1 -- 172.21.15.55:0/2395929718 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb7240657a0 msgr2=0x7fb724067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:19.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.901+0000 7fb73e1ba640 1 --2- 172.21.15.55:0/2395929718 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb7240657a0 0x7fb724067c60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb7280ae000 tx=0x7fb7280b5040 comp rx=0 tx=0).stop 2023-08-25T04:22:19.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.901+0000 7fb73e1ba640 1 -- 172.21.15.55:0/2395929718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73815eba0 msgr2=0x7fb7381f89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:19.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.901+0000 7fb73e1ba640 1 --2- 172.21.15.55:0/2395929718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73815eba0 0x7fb7381f89e0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00c410 tx=0x7fb72c00c8d0 comp rx=0 tx=0).stop 2023-08-25T04:22:19.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.901+0000 7fb73e1ba640 1 -- 172.21.15.55:0/2395929718 shutdown_connections 2023-08-25T04:22:19.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.901+0000 7fb73e1ba640 1 --2- 172.21.15.55:0/2395929718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb73815ef80 0x7fb7381f8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:19.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.901+0000 7fb73e1ba640 1 --2- 172.21.15.55:0/2395929718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb73815eba0 0x7fb7381f89e0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:19.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.901+0000 7fb73e1ba640 1 --2- 172.21.15.55:0/2395929718 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb7240657a0 0x7fb724067c60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:19.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.901+0000 7fb73e1ba640 1 --2- 172.21.15.55:0/2395929718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7380ceeb0 0x7fb7381530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:19.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.901+0000 7fb73e1ba640 1 -- 172.21.15.55:0/2395929718 >> 172.21.15.55:0/2395929718 conn(0x7fb738069d00 msgr2=0x7fb73806c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:19.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.901+0000 7fb73e1ba640 1 -- 172.21.15.55:0/2395929718 shutdown_connections 2023-08-25T04:22:19.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:19.901+0000 7fb73e1ba640 1 -- 172.21.15.55:0/2395929718 wait complete. 2023-08-25T04:22:19.930 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-25T04:22:20.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.081+0000 7f85ad9a3640 1 Processor -- start 2023-08-25T04:22:20.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.081+0000 7f85ad9a3640 1 -- start start 2023-08-25T04:22:20.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.081+0000 7f85ad9a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85a80d0da0 0x7f85a80d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:20.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.081+0000 7f85ad9a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f85a80cdde0 0x7f85a80ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:20.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.081+0000 7f85ad9a3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a80b29b0 con 0x7f85a80cee60 2023-08-25T04:22:20.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.081+0000 7f85ad9a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a80ce760 con 0x7f85a80cdde0 2023-08-25T04:22:20.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.081+0000 7f85ad9a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80d16c0 con 0x7f85a80d0da0 2023-08-25T04:22:20.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.081+0000 7f859e7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f85a80cdde0 0x7f85a80ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:20.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.081+0000 7f859e7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f85a80cdde0 0x7f85a80ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39438/0 (socket says 172.21.15.55:39438) 2023-08-25T04:22:20.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.081+0000 7f859e7fc640 1 -- 172.21.15.55:0/1315692735 learned_addr learned my addr 172.21.15.55:0/1315692735 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:20.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.081+0000 7f85a6ffd640 1 --2- 172.21.15.55:0/1315692735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85a80d0da0 0x7f85a80d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:20.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.081+0000 7f859e7fc640 1 -- 172.21.15.55:0/1315692735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85a80d0da0 msgr2=0x7f85a80d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:20.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.081+0000 7f859e7fc640 1 --2- 172.21.15.55:0/1315692735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85a80d0da0 0x7f85a80d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.081+0000 7f859e7fc640 1 -- 172.21.15.55:0/1315692735 >> v1:172.21.15.55:6789/0 conn(0x7f85a80cee60 legacy=0x7f85a80cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:20.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.081+0000 7f859e7fc640 1 -- 172.21.15.55:0/1315692735 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a80b1dc0 con 0x7f85a80cdde0 2023-08-25T04:22:20.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.081+0000 7f85a6ffd640 1 --2- 172.21.15.55:0/1315692735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85a80d0da0 0x7f85a80d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:20.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.085+0000 7f859e7fc640 1 --2- 172.21.15.55:0/1315692735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85a80cdde0 0x7f85a80ce220 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f8590009e50 tx=0x7f859001f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a152b295734c90bc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:20.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.085+0000 7f85a67fc640 1 -- 172.21.15.55:0/1315692735 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85900af400 con 0x7f85a80cdde0 2023-08-25T04:22:20.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.085+0000 7f85a67fc640 1 -- 172.21.15.55:0/1315692735 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85900ab050 con 0x7f85a80cdde0 2023-08-25T04:22:20.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.085+0000 7f85a67fc640 1 -- 172.21.15.55:0/1315692735 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85900af780 con 0x7f85a80cdde0 2023-08-25T04:22:20.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.085+0000 7f85ad9a3640 1 -- 172.21.15.55:0/1315692735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85a80cdde0 msgr2=0x7f85a80ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:20.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.085+0000 7f85ad9a3640 1 --2- 172.21.15.55:0/1315692735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85a80cdde0 0x7f85a80ce220 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f8590009e50 tx=0x7f859001f1f0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.085+0000 7f85ad9a3640 1 -- 172.21.15.55:0/1315692735 shutdown_connections 2023-08-25T04:22:20.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.085+0000 7f85ad9a3640 1 --2- 172.21.15.55:0/1315692735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85a80cdde0 0x7f85a80ce220 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.085+0000 7f85ad9a3640 1 --2- 172.21.15.55:0/1315692735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85a80d0da0 0x7f85a80d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.085+0000 7f85ad9a3640 1 -- 172.21.15.55:0/1315692735 >> 172.21.15.55:0/1315692735 conn(0x7f85a809bae0 msgr2=0x7f85a80d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:20.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.085+0000 7f85ad9a3640 1 -- 172.21.15.55:0/1315692735 shutdown_connections 2023-08-25T04:22:20.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.085+0000 7f85ad9a3640 1 -- 172.21.15.55:0/1315692735 wait complete. 2023-08-25T04:22:20.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85ad9a3640 1 Processor -- start 2023-08-25T04:22:20.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85ad9a3640 1 -- start start 2023-08-25T04:22:20.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85ad9a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85a80cdde0 0x7f85a8151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:20.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85ad9a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85a80cee60 0x7f85a80cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:20.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85ad9a3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85a80d0da0 0x7f85a815a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:20.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85ad9a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a81f2890 con 0x7f85a80cdde0 2023-08-25T04:22:20.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85ad9a3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a81f1fe0 con 0x7f85a80d0da0 2023-08-25T04:22:20.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85ad9a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80c89d0 con 0x7f85a80cee60 2023-08-25T04:22:20.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85a6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85a80cdde0 0x7f85a8151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:20.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85a6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85a80cdde0 0x7f85a8151910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39440/0 (socket says 172.21.15.55:39440) 2023-08-25T04:22:20.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85a6ffd640 1 -- 172.21.15.55:0/4251675277 learned_addr learned my addr 172.21.15.55:0/4251675277 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:20.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85a6ffd640 1 -- 172.21.15.55:0/4251675277 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85a80cee60 msgr2=0x7f85a80cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:20.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85a6ffd640 1 --2- 172.21.15.55:0/4251675277 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85a80cee60 0x7f85a80cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85a6ffd640 1 -- 172.21.15.55:0/4251675277 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85a80d0da0 msgr2=0x7f85a815a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:20.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85a6ffd640 1 --2- 172.21.15.55:0/4251675277 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85a80d0da0 0x7f85a815a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85a6ffd640 1 -- 172.21.15.55:0/4251675277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8590009b30 con 0x7f85a80cdde0 2023-08-25T04:22:20.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85a6ffd640 1 --2- 172.21.15.55:0/4251675277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85a80cdde0 0x7f85a8151910 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f859800d7d0 tx=0x7f859800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:20.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85a4ff9640 1 -- 172.21.15.55:0/4251675277 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85980059a0 con 0x7f85a80cdde0 2023-08-25T04:22:20.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85a4ff9640 1 -- 172.21.15.55:0/4251675277 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8598005b00 con 0x7f85a80cdde0 2023-08-25T04:22:20.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85a4ff9640 1 -- 172.21.15.55:0/4251675277 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598005e90 con 0x7f85a80cdde0 2023-08-25T04:22:20.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85ad9a3640 1 -- 172.21.15.55:0/4251675277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a80cc4b0 con 0x7f85a80cdde0 2023-08-25T04:22:20.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.089+0000 7f85ad9a3640 1 -- 172.21.15.55:0/4251675277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a81f24b0 con 0x7f85a80cdde0 2023-08-25T04:22:20.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.093+0000 7f85ad9a3640 1 -- 172.21.15.55:0/4251675277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a804dbe0 con 0x7f85a80cdde0 2023-08-25T04:22:20.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.093+0000 7f85a4ff9640 1 -- 172.21.15.55:0/4251675277 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f8598004030 con 0x7f85a80cdde0 2023-08-25T04:22:20.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.093+0000 7f85a4ff9640 1 --2- 172.21.15.55:0/4251675277 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f85880657a0 0x7f8588067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:20.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.093+0000 7f85a4ff9640 1 -- 172.21.15.55:0/4251675277 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8598082c90 con 0x7f85a80cdde0 2023-08-25T04:22:20.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.093+0000 7f859e7fc640 1 --2- 172.21.15.55:0/4251675277 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f85880657a0 0x7f8588067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:20.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.097+0000 7f859e7fc640 1 --2- 172.21.15.55:0/4251675277 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f85880657a0 0x7f8588067c60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f85900b1000 tx=0x7f8590004ac0 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:20.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.097+0000 7f85a4ff9640 1 -- 172.21.15.55:0/4251675277 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8598054410 con 0x7f85a80cdde0 2023-08-25T04:22:20.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.305+0000 7f85ad9a3640 1 -- 172.21.15.55:0/4251675277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f85a80d0b80 con 0x7f85a80cdde0 2023-08-25T04:22:20.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.305+0000 7f85a4ff9640 1 -- 172.21.15.55:0/4251675277 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8598053fa0 con 0x7f85a80cdde0 2023-08-25T04:22:20.307 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:20.307 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T04:22:20.307 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-08-25T04:22:20.308 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.309 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-08-25T04:22:20.309 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkgFrTEBAAoan9rk8Q+qPyMjb2vGUHhA==", 2023-08-25T04:22:20.310 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.310 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:22:20.313 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:22:20.313 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:22:20.314 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:22:20.314 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.316 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:20.316 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.316 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-08-25T04:22:20.317 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk18hNHRAAzXuhzQEONXRzRXTeCH9fKQ==", 2023-08-25T04:22:20.317 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.318 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:22:20.319 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:22:20.319 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:22:20.319 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:22:20.319 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.319 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:20.319 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.320 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-08-25T04:22:20.320 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkLF9CGBAAqxgRU/02SsZfWuZPSYxuZA==", 2023-08-25T04:22:20.320 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.320 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:22:20.320 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:22:20.320 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:22:20.320 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:22:20.321 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.321 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:20.321 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.321 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-08-25T04:22:20.321 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hky6HiJBAAsrXlTDn2cxbk7PnqSgNNkA==", 2023-08-25T04:22:20.321 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.321 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:22:20.322 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:22:20.322 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:22:20.322 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:22:20.322 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.323 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:20.323 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.323 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-08-25T04:22:20.323 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC+J+hkY1tDFBAAVQY5Xl8On9pN3jLWwKWGTA==", 2023-08-25T04:22:20.324 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.324 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:22:20.324 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:22:20.324 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:22:20.324 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.324 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:20.324 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.324 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-08-25T04:22:20.325 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDBJ+hkpdBCHRAADyMAxTsnQfkD9G0p48H4zQ==", 2023-08-25T04:22:20.325 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.325 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:22:20.325 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:22:20.325 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:22:20.325 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.325 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:20.326 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.326 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-08-25T04:22:20.326 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDEJ+hkOR49KRAAudbqAxLItsoczide8ybzAg==", 2023-08-25T04:22:20.326 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.326 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:22:20.326 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:22:20.326 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:22:20.327 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.327 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:20.327 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.327 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-08-25T04:22:20.327 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDHJ+hkxun5MBAAAhGtJYVeL3ogL3TQV67diw==", 2023-08-25T04:22:20.328 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.328 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:22:20.329 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:22:20.329 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:22:20.329 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.329 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:20.329 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.329 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-08-25T04:22:20.329 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDMJ+hkuosTCRAAqCuwHFZFBVR/7nFtHHByNg==", 2023-08-25T04:22:20.330 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.330 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:22:20.330 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:22:20.330 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:22:20.330 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.330 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:20.330 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.330 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-08-25T04:22:20.331 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDPJ+hkJa+SDhAAllo6biVE99BZWvv5K/gXGw==", 2023-08-25T04:22:20.331 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.331 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:22:20.331 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:22:20.331 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:22:20.331 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.331 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:20.331 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.332 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-08-25T04:22:20.332 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDSJ+hkUPywFBAA4jua1Eu1nRl2L6hX/mycfw==", 2023-08-25T04:22:20.332 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.332 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:22:20.332 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:22:20.332 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:22:20.332 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.333 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:20.333 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.333 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-08-25T04:22:20.333 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDVJ+hkhyDMGxAAmcSWLzJqIE5w5H/E4wIurQ==", 2023-08-25T04:22:20.333 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.333 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T04:22:20.333 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T04:22:20.333 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:22:20.334 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.334 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:20.334 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.334 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-08-25T04:22:20.334 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g==", 2023-08-25T04:22:20.334 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.334 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:22:20.335 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-08-25T04:22:20.335 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-25T04:22:20.335 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.335 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:20.335 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.335 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-08-25T04:22:20.335 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk8KsDMxAAKyK4jMKflYNnJXYIbr2OBQ==", 2023-08-25T04:22:20.335 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.336 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:22:20.336 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:22:20.336 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:22:20.336 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:22:20.336 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.336 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:20.336 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.336 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-08-25T04:22:20.337 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjSA4LxAAxzbnHeV85qYZYhSqTOT2rw==", 2023-08-25T04:22:20.337 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.337 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:22:20.337 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:22:20.339 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:22:20.339 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:22:20.339 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.339 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:20.339 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.340 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-08-25T04:22:20.340 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkl9AoORAARYZcPObsM/HT/yrTmneZrw==", 2023-08-25T04:22:20.340 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.340 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T04:22:20.340 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T04:22:20.340 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T04:22:20.340 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T04:22:20.341 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.341 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:20.341 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.341 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-08-25T04:22:20.341 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC2J+hkgTdcLxAAqxSepXXhEultFAFYBBKSag==", 2023-08-25T04:22:20.341 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.341 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:22:20.341 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T04:22:20.342 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T04:22:20.342 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:22:20.342 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.342 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:20.342 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.342 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-08-25T04:22:20.342 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkYGUZDBAAiuDo9hqavWq7zQlGd6x4YQ==", 2023-08-25T04:22:20.343 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.343 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:22:20.343 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T04:22:20.343 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:22:20.343 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.343 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:20.343 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:20.343 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-08-25T04:22:20.344 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjr9KCBAApSqjtFhLnjHduMBu/eaaKw==", 2023-08-25T04:22:20.344 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T04:22:20.344 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T04:22:20.344 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T04:22:20.344 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T04:22:20.344 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.344 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:20.345 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-08-25T04:22:20.345 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T04:22:20.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.305+0000 7f85ad9a3640 1 -- 172.21.15.55:0/4251675277 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f85880657a0 msgr2=0x7f8588067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:20.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.305+0000 7f85ad9a3640 1 --2- 172.21.15.55:0/4251675277 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f85880657a0 0x7f8588067c60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f85900b1000 tx=0x7f8590004ac0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.305+0000 7f85ad9a3640 1 -- 172.21.15.55:0/4251675277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85a80cdde0 msgr2=0x7f85a8151910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:20.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.305+0000 7f85ad9a3640 1 --2- 172.21.15.55:0/4251675277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85a80cdde0 0x7f85a8151910 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f859800d7d0 tx=0x7f859800dc90 comp rx=0 tx=0).stop 2023-08-25T04:22:20.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.305+0000 7f85ad9a3640 1 -- 172.21.15.55:0/4251675277 shutdown_connections 2023-08-25T04:22:20.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.305+0000 7f85ad9a3640 1 --2- 172.21.15.55:0/4251675277 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85a80d0da0 0x7f85a815a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.305+0000 7f85ad9a3640 1 --2- 172.21.15.55:0/4251675277 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f85880657a0 0x7f8588067c60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.305+0000 7f85ad9a3640 1 --2- 172.21.15.55:0/4251675277 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85a80cee60 0x7f85a80cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.305+0000 7f85ad9a3640 1 --2- 172.21.15.55:0/4251675277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85a80cdde0 0x7f85a8151910 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.305+0000 7f85ad9a3640 1 -- 172.21.15.55:0/4251675277 >> 172.21.15.55:0/4251675277 conn(0x7f85a809bae0 msgr2=0x7f85a80b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:20.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.309+0000 7f85ad9a3640 1 -- 172.21.15.55:0/4251675277 shutdown_connections 2023-08-25T04:22:20.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.309+0000 7f85ad9a3640 1 -- 172.21.15.55:0/4251675277 wait complete. 2023-08-25T04:22:20.348 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:22:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.493+0000 7f0726f82640 1 Processor -- start 2023-08-25T04:22:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.493+0000 7f0726f82640 1 -- start start 2023-08-25T04:22:20.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.493+0000 7f0726f82640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f07200cdde0 0x7f07200ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.493+0000 7f0726f82640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f07200b2e40 0x7f07200b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.493+0000 7f0726f82640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07200b29b0 con 0x7f07200d0da0 2023-08-25T04:22:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.493+0000 7f0726f82640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07200ce760 con 0x7f07200cdde0 2023-08-25T04:22:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.493+0000 7f0726f82640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07200b1dc0 con 0x7f07200b2e40 2023-08-25T04:22:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.493+0000 7f0717fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f07200cdde0 0x7f07200ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.493+0000 7f0717fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f07200cdde0 0x7f07200ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39448/0 (socket says 172.21.15.55:39448) 2023-08-25T04:22:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.493+0000 7f0717fff640 1 -- 172.21.15.55:0/259294323 learned_addr learned my addr 172.21.15.55:0/259294323 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.493+0000 7f072551f640 1 --2- 172.21.15.55:0/259294323 >> v2:172.21.15.110:3300/0 conn(0x7f07200b2e40 0x7f07200b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.493+0000 7f0717fff640 1 -- 172.21.15.55:0/259294323 >> v2:172.21.15.110:3300/0 conn(0x7f07200b2e40 msgr2=0x7f07200b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.493+0000 7f0717fff640 1 --2- 172.21.15.55:0/259294323 >> v2:172.21.15.110:3300/0 conn(0x7f07200b2e40 0x7f07200b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.493+0000 7f0717fff640 1 -- 172.21.15.55:0/259294323 >> v1:172.21.15.110:6789/0 conn(0x7f07200d0da0 legacy=0x7f07200d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:20.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.493+0000 7f0717fff640 1 -- 172.21.15.55:0/259294323 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07200b2080 con 0x7f07200cdde0 2023-08-25T04:22:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.497+0000 7f0717fff640 1 --2- 172.21.15.55:0/259294323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07200cdde0 0x7f07200ce220 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f07200ceae0 tx=0x7f071001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bcabe8ea81f137 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.497+0000 7f07177fe640 1 -- 172.21.15.55:0/259294323 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07100a89f0 con 0x7f07200cdde0 2023-08-25T04:22:20.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.497+0000 7f07177fe640 1 -- 172.21.15.55:0/259294323 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07100a8b50 con 0x7f07200cdde0 2023-08-25T04:22:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.497+0000 7f07177fe640 1 -- 172.21.15.55:0/259294323 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07100b0440 con 0x7f07200cdde0 2023-08-25T04:22:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.497+0000 7f0726f82640 1 -- 172.21.15.55:0/259294323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07200cdde0 msgr2=0x7f07200ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:20.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.497+0000 7f0726f82640 1 --2- 172.21.15.55:0/259294323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07200cdde0 0x7f07200ce220 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f07200ceae0 tx=0x7f071001ecf0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.497+0000 7f0726f82640 1 -- 172.21.15.55:0/259294323 shutdown_connections 2023-08-25T04:22:20.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.497+0000 7f0726f82640 1 --2- 172.21.15.55:0/259294323 >> v2:172.21.15.110:3300/0 conn(0x7f07200b2e40 0x7f07200b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.497+0000 7f0726f82640 1 --2- 172.21.15.55:0/259294323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07200cdde0 0x7f07200ce220 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.497+0000 7f0726f82640 1 -- 172.21.15.55:0/259294323 >> 172.21.15.55:0/259294323 conn(0x7f072009bae0 msgr2=0x7f07200d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:20.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.497+0000 7f0726f82640 1 -- 172.21.15.55:0/259294323 shutdown_connections 2023-08-25T04:22:20.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.497+0000 7f0726f82640 1 -- 172.21.15.55:0/259294323 wait complete. 2023-08-25T04:22:20.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f0726f82640 1 Processor -- start 2023-08-25T04:22:20.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f0726f82640 1 -- start start 2023-08-25T04:22:20.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f0726f82640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07200b2e40 0x7f072015e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:20.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f0726f82640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07200cdde0 0x7f072015e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:20.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f0726f82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07200d0da0 0x7f07200c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:20.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f0726f82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072015ecb0 con 0x7f07200d0da0 2023-08-25T04:22:20.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f0726f82640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072015eef0 con 0x7f07200b2e40 2023-08-25T04:22:20.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f0726f82640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072015f1d0 con 0x7f07200cdde0 2023-08-25T04:22:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f072551f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07200d0da0 0x7f07200c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f072551f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07200d0da0 0x7f07200c9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39456/0 (socket says 172.21.15.55:39456) 2023-08-25T04:22:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f072551f640 1 -- 172.21.15.55:0/1922606691 learned_addr learned my addr 172.21.15.55:0/1922606691 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f0717fff640 1 --2- 172.21.15.55:0/1922606691 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07200cdde0 0x7f072015e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:20.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f0724d1e640 1 --2- 172.21.15.55:0/1922606691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07200b2e40 0x7f072015e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:20.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f072551f640 1 -- 172.21.15.55:0/1922606691 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07200cdde0 msgr2=0x7f072015e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:20.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f072551f640 1 --2- 172.21.15.55:0/1922606691 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07200cdde0 0x7f072015e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f072551f640 1 -- 172.21.15.55:0/1922606691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07200b2e40 msgr2=0x7f072015e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:20.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f072551f640 1 --2- 172.21.15.55:0/1922606691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07200b2e40 0x7f072015e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f072551f640 1 -- 172.21.15.55:0/1922606691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07100094d0 con 0x7f07200d0da0 2023-08-25T04:22:20.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f072551f640 1 --2- 172.21.15.55:0/1922606691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07200d0da0 0x7f07200c9890 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f0718007e40 tx=0x7f071800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:20.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f07157fa640 1 -- 172.21.15.55:0/1922606691 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0718014620 con 0x7f07200d0da0 2023-08-25T04:22:20.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f07157fa640 1 -- 172.21.15.55:0/1922606691 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071800ee90 con 0x7f07200d0da0 2023-08-25T04:22:20.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f07157fa640 1 -- 172.21.15.55:0/1922606691 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07180149e0 con 0x7f07200d0da0 2023-08-25T04:22:20.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f0726f82640 1 -- 172.21.15.55:0/1922606691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072015f4b0 con 0x7f07200d0da0 2023-08-25T04:22:20.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f0726f82640 1 -- 172.21.15.55:0/1922606691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072015fa70 con 0x7f07200d0da0 2023-08-25T04:22:20.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.501+0000 7f0726f82640 1 -- 172.21.15.55:0/1922606691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072004dbe0 con 0x7f07200d0da0 2023-08-25T04:22:20.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.505+0000 7f07157fa640 1 -- 172.21.15.55:0/1922606691 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f0718014b40 con 0x7f07200d0da0 2023-08-25T04:22:20.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.505+0000 7f07157fa640 1 --2- 172.21.15.55:0/1922606691 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f070c0657a0 0x7f070c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:20.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.505+0000 7f07157fa640 1 -- 172.21.15.55:0/1922606691 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0718083510 con 0x7f07200d0da0 2023-08-25T04:22:20.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.505+0000 7f0724d1e640 1 --2- 172.21.15.55:0/1922606691 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f070c0657a0 0x7f070c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:20.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.505+0000 7f0724d1e640 1 --2- 172.21.15.55:0/1922606691 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f070c0657a0 0x7f070c067c60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f07201f5310 tx=0x7f071c009040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:20.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.509+0000 7f07157fa640 1 -- 172.21.15.55:0/1922606691 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f07180512a0 con 0x7f07200d0da0 2023-08-25T04:22:20.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.665+0000 7f0726f82640 1 -- 172.21.15.55:0/1922606691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f072015fc60 con 0x7f07200d0da0 2023-08-25T04:22:20.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.665+0000 7f07157fa640 1 -- 172.21.15.55:0/1922606691 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+14661 (secure 0 0 0) 0x7f07180548c0 con 0x7f07200d0da0 2023-08-25T04:22:20.667 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:20.667 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":132,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:22:19.911779+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:22:20.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.669+0000 7f0726f82640 1 -- 172.21.15.55:0/1922606691 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f070c0657a0 msgr2=0x7f070c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:20.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.669+0000 7f0726f82640 1 --2- 172.21.15.55:0/1922606691 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f070c0657a0 0x7f070c067c60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f07201f5310 tx=0x7f071c009040 comp rx=0 tx=0).stop 2023-08-25T04:22:20.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.669+0000 7f0726f82640 1 -- 172.21.15.55:0/1922606691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07200d0da0 msgr2=0x7f07200c9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:20.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.669+0000 7f0726f82640 1 --2- 172.21.15.55:0/1922606691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07200d0da0 0x7f07200c9890 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f0718007e40 tx=0x7f071800e4b0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.669+0000 7f0726f82640 1 -- 172.21.15.55:0/1922606691 shutdown_connections 2023-08-25T04:22:20.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.669+0000 7f0726f82640 1 --2- 172.21.15.55:0/1922606691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07200d0da0 0x7f07200c9890 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.669+0000 7f0726f82640 1 --2- 172.21.15.55:0/1922606691 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f070c0657a0 0x7f070c067c60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.669+0000 7f0726f82640 1 --2- 172.21.15.55:0/1922606691 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07200cdde0 0x7f072015e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.669+0000 7f0726f82640 1 --2- 172.21.15.55:0/1922606691 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07200b2e40 0x7f072015e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.669+0000 7f0726f82640 1 -- 172.21.15.55:0/1922606691 >> 172.21.15.55:0/1922606691 conn(0x7f072009bae0 msgr2=0x7f07200cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:20.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.669+0000 7f0726f82640 1 -- 172.21.15.55:0/1922606691 shutdown_connections 2023-08-25T04:22:20.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.669+0000 7f0726f82640 1 -- 172.21.15.55:0/1922606691 wait complete. 2023-08-25T04:22:20.689 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T04:22:20.690 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T04:22:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.837+0000 7f1c371fa640 1 Processor -- start 2023-08-25T04:22:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.837+0000 7f1c371fa640 1 -- start start 2023-08-25T04:22:20.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.837+0000 7f1c371fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c301601f0 0x7f1c3015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.837+0000 7f1c371fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1c300d1290 0x7f1c3015e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.837+0000 7f1c371fa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c300cd5a0 con 0x7f1c3015e3c0 2023-08-25T04:22:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.837+0000 7f1c371fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c300cd880 con 0x7f1c300d1290 2023-08-25T04:22:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.837+0000 7f1c371fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c300cdb60 con 0x7f1c301601f0 2023-08-25T04:22:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.837+0000 7f1c35797640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1c300d1290 0x7f1c3015e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.837+0000 7f1c35797640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1c300d1290 0x7f1c3015e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54160/0 (socket says 172.21.15.55:54160) 2023-08-25T04:22:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.837+0000 7f1c35797640 1 -- 172.21.15.55:0/1869656877 learned_addr learned my addr 172.21.15.55:0/1869656877 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:20.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.837+0000 7f1c34f96640 1 --2- 172.21.15.55:0/1869656877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c301601f0 0x7f1c3015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:20.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.837+0000 7f1c35797640 1 -- 172.21.15.55:0/1869656877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c301601f0 msgr2=0x7f1c3015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:20.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.837+0000 7f1c35797640 1 --2- 172.21.15.55:0/1869656877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c301601f0 0x7f1c3015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.837+0000 7f1c35797640 1 -- 172.21.15.55:0/1869656877 >> v1:172.21.15.110:6789/0 conn(0x7f1c3015e3c0 legacy=0x7f1c300d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:20.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.837+0000 7f1c35797640 1 -- 172.21.15.55:0/1869656877 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c300cde40 con 0x7f1c300d1290 2023-08-25T04:22:20.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.837+0000 7f1c34f96640 1 --2- 172.21.15.55:0/1869656877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c301601f0 0x7f1c3015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:20.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.841+0000 7f1c35797640 1 --2- 172.21.15.55:0/1869656877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c300d1290 0x7f1c3015e8a0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009e50 tx=0x7f1c2801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fb034a4d40786c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:20.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.841+0000 7f1c2f7fe640 1 -- 172.21.15.55:0/1869656877 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c280af400 con 0x7f1c300d1290 2023-08-25T04:22:20.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.841+0000 7f1c2f7fe640 1 -- 172.21.15.55:0/1869656877 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c280ab050 con 0x7f1c300d1290 2023-08-25T04:22:20.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.841+0000 7f1c2f7fe640 1 -- 172.21.15.55:0/1869656877 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c280af780 con 0x7f1c300d1290 2023-08-25T04:22:20.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.841+0000 7f1c371fa640 1 -- 172.21.15.55:0/1869656877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c300d1290 msgr2=0x7f1c3015e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:20.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.841+0000 7f1c371fa640 1 --2- 172.21.15.55:0/1869656877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c300d1290 0x7f1c3015e8a0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009e50 tx=0x7f1c2801f1f0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.841+0000 7f1c371fa640 1 -- 172.21.15.55:0/1869656877 shutdown_connections 2023-08-25T04:22:20.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.841+0000 7f1c371fa640 1 --2- 172.21.15.55:0/1869656877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c300d1290 0x7f1c3015e8a0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.841+0000 7f1c371fa640 1 --2- 172.21.15.55:0/1869656877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c301601f0 0x7f1c3015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.841+0000 7f1c371fa640 1 -- 172.21.15.55:0/1869656877 >> 172.21.15.55:0/1869656877 conn(0x7f1c300d27d0 msgr2=0x7f1c300d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:20.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.841+0000 7f1c371fa640 1 -- 172.21.15.55:0/1869656877 shutdown_connections 2023-08-25T04:22:20.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.841+0000 7f1c371fa640 1 -- 172.21.15.55:0/1869656877 wait complete. 2023-08-25T04:22:20.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.841+0000 7f1c371fa640 1 Processor -- start 2023-08-25T04:22:20.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c371fa640 1 -- start start 2023-08-25T04:22:20.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c371fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c300d1290 0x7f1c3015acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:20.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c371fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c3015e3c0 0x7f1c30157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:20.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c371fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c301601f0 0x7f1c3015c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:20.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c371fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3015b230 con 0x7f1c300d1290 2023-08-25T04:22:20.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c371fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3015a860 con 0x7f1c3015e3c0 2023-08-25T04:22:20.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c371fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c30159f30 con 0x7f1c301601f0 2023-08-25T04:22:20.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c34f96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c300d1290 0x7f1c3015acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:20.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c34f96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c300d1290 0x7f1c3015acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54166/0 (socket says 172.21.15.55:54166) 2023-08-25T04:22:20.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c34f96640 1 -- 172.21.15.55:0/2923305284 learned_addr learned my addr 172.21.15.55:0/2923305284 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:20.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c2ffff640 1 --2- 172.21.15.55:0/2923305284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c3015e3c0 0x7f1c30157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:20.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c35797640 1 --2- 172.21.15.55:0/2923305284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c301601f0 0x7f1c3015c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:20.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c34f96640 1 -- 172.21.15.55:0/2923305284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c301601f0 msgr2=0x7f1c3015c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:20.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c34f96640 1 --2- 172.21.15.55:0/2923305284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c301601f0 0x7f1c3015c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c34f96640 1 -- 172.21.15.55:0/2923305284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c3015e3c0 msgr2=0x7f1c30157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:20.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c34f96640 1 --2- 172.21.15.55:0/2923305284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c3015e3c0 0x7f1c30157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:20.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c34f96640 1 -- 172.21.15.55:0/2923305284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c28009b30 con 0x7f1c300d1290 2023-08-25T04:22:20.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c35797640 1 --2- 172.21.15.55:0/2923305284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c301601f0 0x7f1c3015c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:20.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c34f96640 1 --2- 172.21.15.55:0/2923305284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c300d1290 0x7f1c3015acf0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400d7d0 tx=0x7f1c2400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:20.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c2d7fa640 1 -- 172.21.15.55:0/2923305284 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240059a0 con 0x7f1c300d1290 2023-08-25T04:22:20.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c2d7fa640 1 -- 172.21.15.55:0/2923305284 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c24005b00 con 0x7f1c300d1290 2023-08-25T04:22:20.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c2d7fa640 1 -- 172.21.15.55:0/2923305284 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24005e90 con 0x7f1c300d1290 2023-08-25T04:22:20.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c371fa640 1 -- 172.21.15.55:0/2923305284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c300ce7c0 con 0x7f1c300d1290 2023-08-25T04:22:20.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c371fa640 1 -- 172.21.15.55:0/2923305284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3015a4f0 con 0x7f1c300d1290 2023-08-25T04:22:20.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.845+0000 7f1c371fa640 1 -- 172.21.15.55:0/2923305284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c300b5260 con 0x7f1c300d1290 2023-08-25T04:22:20.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.849+0000 7f1c2d7fa640 1 -- 172.21.15.55:0/2923305284 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f1c24004030 con 0x7f1c300d1290 2023-08-25T04:22:20.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.849+0000 7f1c2d7fa640 1 --2- 172.21.15.55:0/2923305284 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f1c140657a0 0x7f1c14067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:20.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.849+0000 7f1c2d7fa640 1 -- 172.21.15.55:0/2923305284 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1c24082b70 con 0x7f1c300d1290 2023-08-25T04:22:20.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.849+0000 7f1c2ffff640 1 --2- 172.21.15.55:0/2923305284 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f1c140657a0 0x7f1c14067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:20.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.849+0000 7f1c2ffff640 1 --2- 172.21.15.55:0/2923305284 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f1c140657a0 0x7f1c14067c60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1c301f5590 tx=0x7f1c1c009040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:20.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:20.853+0000 7f1c2d7fa640 1 -- 172.21.15.55:0/2923305284 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1c240542f0 con 0x7f1c300d1290 2023-08-25T04:22:21.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.013+0000 7f1c371fa640 1 -- 172.21.15.55:0/2923305284 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c30073ec0 con 0x7f1c300d1290 2023-08-25T04:22:21.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.013+0000 7f1c2d7fa640 1 -- 172.21.15.55:0/2923305284 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c24053e80 con 0x7f1c300d1290 2023-08-25T04:22:21.014 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T04:22:21.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.013+0000 7f1c371fa640 1 -- 172.21.15.55:0/2923305284 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f1c140657a0 msgr2=0x7f1c14067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:21.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.013+0000 7f1c371fa640 1 --2- 172.21.15.55:0/2923305284 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f1c140657a0 0x7f1c14067c60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1c301f5590 tx=0x7f1c1c009040 comp rx=0 tx=0).stop 2023-08-25T04:22:21.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.013+0000 7f1c371fa640 1 -- 172.21.15.55:0/2923305284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c300d1290 msgr2=0x7f1c3015acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:21.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.013+0000 7f1c371fa640 1 --2- 172.21.15.55:0/2923305284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c300d1290 0x7f1c3015acf0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400d7d0 tx=0x7f1c2400dc90 comp rx=0 tx=0).stop 2023-08-25T04:22:21.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.017+0000 7f1c371fa640 1 -- 172.21.15.55:0/2923305284 shutdown_connections 2023-08-25T04:22:21.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.017+0000 7f1c371fa640 1 --2- 172.21.15.55:0/2923305284 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f1c140657a0 0x7f1c14067c60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.017+0000 7f1c371fa640 1 --2- 172.21.15.55:0/2923305284 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c301601f0 0x7f1c3015c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.017+0000 7f1c371fa640 1 --2- 172.21.15.55:0/2923305284 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c3015e3c0 0x7f1c30157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.017+0000 7f1c371fa640 1 --2- 172.21.15.55:0/2923305284 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c300d1290 0x7f1c3015acf0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.017+0000 7f1c371fa640 1 -- 172.21.15.55:0/2923305284 >> 172.21.15.55:0/2923305284 conn(0x7f1c300d27d0 msgr2=0x7f1c300cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:21.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.017+0000 7f1c371fa640 1 -- 172.21.15.55:0/2923305284 shutdown_connections 2023-08-25T04:22:21.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.017+0000 7f1c371fa640 1 -- 172.21.15.55:0/2923305284 wait complete. 2023-08-25T04:22:21.035 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T04:22:21.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.181+0000 7f860bfba640 1 Processor -- start 2023-08-25T04:22:21.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.181+0000 7f860bfba640 1 -- start start 2023-08-25T04:22:21.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.185+0000 7f860bfba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86040aec80 0x7f86040af060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:21.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.185+0000 7f860bfba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86040ad670 0x7f86040adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:21.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.185+0000 7f860bfba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86040b00f0 con 0x7f86040cfc60 2023-08-25T04:22:21.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.185+0000 7f860bfba640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86040af5a0 con 0x7f86040aec80 2023-08-25T04:22:21.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.185+0000 7f860bfba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86040af850 con 0x7f86040ad670 2023-08-25T04:22:21.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.185+0000 7f8609d56640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86040aec80 0x7f86040af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:21.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.185+0000 7f8609d56640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86040aec80 0x7f86040af060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54176/0 (socket says 172.21.15.55:54176) 2023-08-25T04:22:21.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.185+0000 7f8609d56640 1 -- 172.21.15.55:0/236182976 learned_addr learned my addr 172.21.15.55:0/236182976 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:21.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.185+0000 7f860a557640 1 --2- 172.21.15.55:0/236182976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86040ad670 0x7f86040adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:21.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.185+0000 7f8609d56640 1 -- 172.21.15.55:0/236182976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86040ad670 msgr2=0x7f86040adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:21.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.185+0000 7f8609d56640 1 --2- 172.21.15.55:0/236182976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86040ad670 0x7f86040adaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.185+0000 7f8609d56640 1 -- 172.21.15.55:0/236182976 >> v1:172.21.15.110:6789/0 conn(0x7f86040cfc60 legacy=0x7f86040b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:21.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.185+0000 7f8609d56640 1 -- 172.21.15.55:0/236182976 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86040afb30 con 0x7f86040aec80 2023-08-25T04:22:21.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.189+0000 7f8609d56640 1 --2- 172.21.15.55:0/236182976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86040aec80 0x7f86040af060 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f8600009870 tx=0x7f860001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57eccd05975e74e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:21.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.189+0000 7f8608d54640 1 -- 172.21.15.55:0/236182976 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000aa670 con 0x7f86040aec80 2023-08-25T04:22:21.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.189+0000 7f8608d54640 1 -- 172.21.15.55:0/236182976 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86000aa7d0 con 0x7f86040aec80 2023-08-25T04:22:21.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.189+0000 7f8608d54640 1 -- 172.21.15.55:0/236182976 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000aab60 con 0x7f86040aec80 2023-08-25T04:22:21.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.189+0000 7f860bfba640 1 -- 172.21.15.55:0/236182976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86040aec80 msgr2=0x7f86040af060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:21.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.189+0000 7f860bfba640 1 --2- 172.21.15.55:0/236182976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86040aec80 0x7f86040af060 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f8600009870 tx=0x7f860001c510 comp rx=0 tx=0).stop 2023-08-25T04:22:21.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.189+0000 7f860bfba640 1 -- 172.21.15.55:0/236182976 shutdown_connections 2023-08-25T04:22:21.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.189+0000 7f860bfba640 1 --2- 172.21.15.55:0/236182976 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86040ad670 0x7f86040adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.189+0000 7f860bfba640 1 --2- 172.21.15.55:0/236182976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86040aec80 0x7f86040af060 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.189+0000 7f860bfba640 1 -- 172.21.15.55:0/236182976 >> 172.21.15.55:0/236182976 conn(0x7f8604098a00 msgr2=0x7f86040cf450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:21.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.189+0000 7f860bfba640 1 -- 172.21.15.55:0/236182976 shutdown_connections 2023-08-25T04:22:21.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.189+0000 7f860bfba640 1 -- 172.21.15.55:0/236182976 wait complete. 2023-08-25T04:22:21.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.189+0000 7f860bfba640 1 Processor -- start 2023-08-25T04:22:21.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.189+0000 7f860bfba640 1 -- start start 2023-08-25T04:22:21.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.189+0000 7f860bfba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86040ad670 0x7f86040c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:21.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.189+0000 7f860bfba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86040aec80 0x7f86040c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:21.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f860bfba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86040cfc60 0x7f86040cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:21.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f860bfba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86040cbbd0 con 0x7f86040ad670 2023-08-25T04:22:21.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f860bfba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8604152440 con 0x7f86040aec80 2023-08-25T04:22:21.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f860bfba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8604147a90 con 0x7f86040cfc60 2023-08-25T04:22:21.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f8609d56640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86040ad670 0x7f86040c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:21.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f8609d56640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86040ad670 0x7f86040c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54186/0 (socket says 172.21.15.55:54186) 2023-08-25T04:22:21.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f8609d56640 1 -- 172.21.15.55:0/1835223661 learned_addr learned my addr 172.21.15.55:0/1835223661 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:21.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f860a557640 1 --2- 172.21.15.55:0/1835223661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86040cfc60 0x7f86040cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:21.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f8609555640 1 --2- 172.21.15.55:0/1835223661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86040aec80 0x7f86040c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:21.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f8609d56640 1 -- 172.21.15.55:0/1835223661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86040cfc60 msgr2=0x7f86040cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:21.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f8609d56640 1 --2- 172.21.15.55:0/1835223661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86040cfc60 0x7f86040cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f8609d56640 1 -- 172.21.15.55:0/1835223661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86040aec80 msgr2=0x7f86040c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:21.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f8609d56640 1 --2- 172.21.15.55:0/1835223661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86040aec80 0x7f86040c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f8609d56640 1 -- 172.21.15.55:0/1835223661 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86000094d0 con 0x7f86040ad670 2023-08-25T04:22:21.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f8609d56640 1 --2- 172.21.15.55:0/1835223661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86040ad670 0x7f86040c87b0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f86000ac040 tx=0x7f860001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:21.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f85fa7fc640 1 -- 172.21.15.55:0/1835223661 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000b3800 con 0x7f86040ad670 2023-08-25T04:22:21.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f85fa7fc640 1 -- 172.21.15.55:0/1835223661 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86000b3980 con 0x7f86040ad670 2023-08-25T04:22:21.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f860bfba640 1 -- 172.21.15.55:0/1835223661 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86040c8e90 con 0x7f86040ad670 2023-08-25T04:22:21.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f85fa7fc640 1 -- 172.21.15.55:0/1835223661 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000b3d30 con 0x7f86040ad670 2023-08-25T04:22:21.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f860bfba640 1 -- 172.21.15.55:0/1835223661 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86040c9450 con 0x7f86040ad670 2023-08-25T04:22:21.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f860bfba640 1 -- 172.21.15.55:0/1835223661 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86041525b0 con 0x7f86040ad670 2023-08-25T04:22:21.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f85fa7fc640 1 -- 172.21.15.55:0/1835223661 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f86000c6390 con 0x7f86040ad670 2023-08-25T04:22:21.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.193+0000 7f85fa7fc640 1 --2- 172.21.15.55:0/1835223661 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f85e80657a0 0x7f85e8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:21.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.197+0000 7f85fa7fc640 1 -- 172.21.15.55:0/1835223661 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f860011dad0 con 0x7f86040ad670 2023-08-25T04:22:21.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.197+0000 7f8609555640 1 --2- 172.21.15.55:0/1835223661 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f85e80657a0 0x7f85e8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:21.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.197+0000 7f8609555640 1 --2- 172.21.15.55:0/1835223661 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f85e80657a0 0x7f85e8067c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85f4000f70 tx=0x7f85f4009040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:21.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.197+0000 7f85fa7fc640 1 -- 172.21.15.55:0/1835223661 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f86000eb6b0 con 0x7f86040ad670 2023-08-25T04:22:21.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.365+0000 7f860bfba640 1 -- 172.21.15.55:0/1835223661 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f86040c9640 con 0x7f86040ad670 2023-08-25T04:22:21.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.365+0000 7f85fa7fc640 1 -- 172.21.15.55:0/1835223661 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v132) v1 ==== 92+0+10 (secure 0 0 0) 0x7f86000eecd0 con 0x7f86040ad670 2023-08-25T04:22:21.367 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T04:22:21.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.365+0000 7f860bfba640 1 -- 172.21.15.55:0/1835223661 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f85e80657a0 msgr2=0x7f85e8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:21.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.365+0000 7f860bfba640 1 --2- 172.21.15.55:0/1835223661 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f85e80657a0 0x7f85e8067c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85f4000f70 tx=0x7f85f4009040 comp rx=0 tx=0).stop 2023-08-25T04:22:21.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.365+0000 7f860bfba640 1 -- 172.21.15.55:0/1835223661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86040ad670 msgr2=0x7f86040c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:21.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.365+0000 7f860bfba640 1 --2- 172.21.15.55:0/1835223661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86040ad670 0x7f86040c87b0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f86000ac040 tx=0x7f860001ad50 comp rx=0 tx=0).stop 2023-08-25T04:22:21.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.369+0000 7f860bfba640 1 -- 172.21.15.55:0/1835223661 shutdown_connections 2023-08-25T04:22:21.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.369+0000 7f860bfba640 1 --2- 172.21.15.55:0/1835223661 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f85e80657a0 0x7f85e8067c60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.369+0000 7f860bfba640 1 --2- 172.21.15.55:0/1835223661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86040cfc60 0x7f86040cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.369+0000 7f860bfba640 1 --2- 172.21.15.55:0/1835223661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86040aec80 0x7f86040c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.369+0000 7f860bfba640 1 --2- 172.21.15.55:0/1835223661 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86040ad670 0x7f86040c87b0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.369+0000 7f860bfba640 1 -- 172.21.15.55:0/1835223661 >> 172.21.15.55:0/1835223661 conn(0x7f8604098a00 msgr2=0x7f8604154fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:21.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.369+0000 7f860bfba640 1 -- 172.21.15.55:0/1835223661 shutdown_connections 2023-08-25T04:22:21.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.369+0000 7f860bfba640 1 -- 172.21.15.55:0/1835223661 wait complete. 2023-08-25T04:22:21.387 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-25T04:22:21.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.529+0000 7fac9d434640 1 Processor -- start 2023-08-25T04:22:21.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.529+0000 7fac9d434640 1 -- start start 2023-08-25T04:22:21.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.529+0000 7fac9d434640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fac9815eba0 0x7fac980b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:21.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.529+0000 7fac9d434640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac980ceeb0 0x7fac980ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:21.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.529+0000 7fac9d434640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac980ac3a0 con 0x7fac9815ef80 2023-08-25T04:22:21.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.533+0000 7fac9d434640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac980b1390 con 0x7fac980ceeb0 2023-08-25T04:22:21.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.533+0000 7fac9d434640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac980b1670 con 0x7fac9815eba0 2023-08-25T04:22:21.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.533+0000 7fac8ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fac9815ef80 0x7fac980ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40018/0 (socket says 172.21.15.55:40018) 2023-08-25T04:22:21.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.533+0000 7fac8ffff640 1 -- 172.21.15.55:0/3651175398 learned_addr learned my addr 172.21.15.55:0/3651175398 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:21.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.533+0000 7fac977fe640 1 --2- 172.21.15.55:0/3651175398 >> v2:172.21.15.55:3300/0 conn(0x7fac980ceeb0 0x7fac980ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:21.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.533+0000 7fac96ffd640 1 --2- 172.21.15.55:0/3651175398 >> v2:172.21.15.110:3300/0 conn(0x7fac9815eba0 0x7fac980b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.533+0000 7fac977fe640 1 -- 172.21.15.55:0/3651175398 >> v2:172.21.15.110:3300/0 conn(0x7fac9815eba0 msgr2=0x7fac980b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.533+0000 7fac977fe640 1 --2- 172.21.15.55:0/3651175398 >> v2:172.21.15.110:3300/0 conn(0x7fac9815eba0 0x7fac980b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.533+0000 7fac977fe640 1 -- 172.21.15.55:0/3651175398 >> v1:172.21.15.55:6789/0 conn(0x7fac9815ef80 legacy=0x7fac980ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.533+0000 7fac977fe640 1 -- 172.21.15.55:0/3651175398 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac980b1950 con 0x7fac980ceeb0 2023-08-25T04:22:21.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.533+0000 7fac977fe640 1 --2- 172.21.15.55:0/3651175398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac980ceeb0 0x7fac980ab0f0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fac980b4450 tx=0x7fac9001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8182644c2906325b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:21.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.533+0000 7fac967fc640 1 -- 172.21.15.55:0/3651175398 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac900a59a0 con 0x7fac980ceeb0 2023-08-25T04:22:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.533+0000 7fac967fc640 1 -- 172.21.15.55:0/3651175398 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac900a5b00 con 0x7fac980ceeb0 2023-08-25T04:22:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.533+0000 7fac967fc640 1 -- 172.21.15.55:0/3651175398 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac900a5e90 con 0x7fac980ceeb0 2023-08-25T04:22:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac9d434640 1 -- 172.21.15.55:0/3651175398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac980ceeb0 msgr2=0x7fac980ab0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:21.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac9d434640 1 --2- 172.21.15.55:0/3651175398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac980ceeb0 0x7fac980ab0f0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fac980b4450 tx=0x7fac9001c8e0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac9d434640 1 -- 172.21.15.55:0/3651175398 shutdown_connections 2023-08-25T04:22:21.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac9d434640 1 --2- 172.21.15.55:0/3651175398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac980ceeb0 0x7fac980ab0f0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac9d434640 1 --2- 172.21.15.55:0/3651175398 >> v2:172.21.15.110:3300/0 conn(0x7fac9815eba0 0x7fac980b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac9d434640 1 -- 172.21.15.55:0/3651175398 >> 172.21.15.55:0/3651175398 conn(0x7fac98069d00 msgr2=0x7fac9806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac9d434640 1 -- 172.21.15.55:0/3651175398 shutdown_connections 2023-08-25T04:22:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac9d434640 1 -- 172.21.15.55:0/3651175398 wait complete. 2023-08-25T04:22:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac9d434640 1 Processor -- start 2023-08-25T04:22:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac9d434640 1 -- start start 2023-08-25T04:22:21.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac9d434640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac980ceeb0 0x7fac981561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:21.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac9d434640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac9815eba0 0x7fac98164f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:21.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac9d434640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac9815ef80 0x7fac98158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:21.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac9d434640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac980c8240 con 0x7fac9815eba0 2023-08-25T04:22:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac9d434640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac980c73b0 con 0x7fac980ceeb0 2023-08-25T04:22:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac9d434640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac980c7630 con 0x7fac9815ef80 2023-08-25T04:22:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac8ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac9815eba0 0x7fac98164f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac96ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac980ceeb0 0x7fac981561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac8ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac9815eba0 0x7fac98164f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54192/0 (socket says 172.21.15.55:54192) 2023-08-25T04:22:21.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac8ffff640 1 -- 172.21.15.55:0/4142721041 learned_addr learned my addr 172.21.15.55:0/4142721041 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:21.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.537+0000 7fac977fe640 1 --2- 172.21.15.55:0/4142721041 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac9815ef80 0x7fac98158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:21.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.541+0000 7fac8ffff640 1 -- 172.21.15.55:0/4142721041 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac9815ef80 msgr2=0x7fac98158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:21.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.541+0000 7fac8ffff640 1 --2- 172.21.15.55:0/4142721041 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac9815ef80 0x7fac98158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.541+0000 7fac8ffff640 1 -- 172.21.15.55:0/4142721041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac980ceeb0 msgr2=0x7fac981561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:21.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.541+0000 7fac8ffff640 1 --2- 172.21.15.55:0/4142721041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac980ceeb0 0x7fac981561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.541+0000 7fac8ffff640 1 -- 172.21.15.55:0/4142721041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac90009a70 con 0x7fac9815eba0 2023-08-25T04:22:21.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.541+0000 7fac96ffd640 1 --2- 172.21.15.55:0/4142721041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac980ceeb0 0x7fac981561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:22:21.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.541+0000 7fac8ffff640 1 --2- 172.21.15.55:0/4142721041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac9815eba0 0x7fac98164f00 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fac8000c530 tx=0x7fac8000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:21.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.541+0000 7fac8f7fe640 1 -- 172.21.15.55:0/4142721041 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac80005cf0 con 0x7fac9815eba0 2023-08-25T04:22:21.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.541+0000 7fac8f7fe640 1 -- 172.21.15.55:0/4142721041 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac80005e50 con 0x7fac9815eba0 2023-08-25T04:22:21.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.541+0000 7fac8f7fe640 1 -- 172.21.15.55:0/4142721041 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac80007270 con 0x7fac9815eba0 2023-08-25T04:22:21.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.541+0000 7fac9d434640 1 -- 172.21.15.55:0/4142721041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac980c7910 con 0x7fac9815eba0 2023-08-25T04:22:21.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.541+0000 7fac9d434640 1 -- 172.21.15.55:0/4142721041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac980c7ed0 con 0x7fac9815eba0 2023-08-25T04:22:21.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.541+0000 7fac9d434640 1 -- 172.21.15.55:0/4142721041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9806b5f0 con 0x7fac9815eba0 2023-08-25T04:22:21.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.541+0000 7fac8f7fe640 1 -- 172.21.15.55:0/4142721041 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fac800073d0 con 0x7fac9815eba0 2023-08-25T04:22:21.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.541+0000 7fac8f7fe640 1 --2- 172.21.15.55:0/4142721041 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fac780657a0 0x7fac78067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:21.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.541+0000 7fac8f7fe640 1 -- 172.21.15.55:0/4142721041 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fac800820d0 con 0x7fac9815eba0 2023-08-25T04:22:21.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.541+0000 7fac96ffd640 1 --2- 172.21.15.55:0/4142721041 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fac780657a0 0x7fac78067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:21.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.545+0000 7fac96ffd640 1 --2- 172.21.15.55:0/4142721041 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fac780657a0 0x7fac78067c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac88009f50 tx=0x7fac88009190 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:21.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.545+0000 7fac8f7fe640 1 -- 172.21.15.55:0/4142721041 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fac8004fde0 con 0x7fac9815eba0 2023-08-25T04:22:21.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.705+0000 7fac9d434640 1 -- 172.21.15.55:0/4142721041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fac9804dbe0 con 0x7fac9815eba0 2023-08-25T04:22:21.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.705+0000 7fac8f7fe640 1 -- 172.21.15.55:0/4142721041 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v132) v1 ==== 84+0+126 (secure 0 0 0) 0x7fac80053400 con 0x7fac9815eba0 2023-08-25T04:22:21.706 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:21.706 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T04:22:21.707 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:21.707 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-08-25T04:22:21.707 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-08-25T04:22:21.707 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T04:22:21.708 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:21.708 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-08-25T04:22:21.708 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-08-25T04:22:21.708 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:21.708 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T04:22:21.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.705+0000 7fac9d434640 1 -- 172.21.15.55:0/4142721041 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fac780657a0 msgr2=0x7fac78067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:21.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.705+0000 7fac9d434640 1 --2- 172.21.15.55:0/4142721041 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fac780657a0 0x7fac78067c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac88009f50 tx=0x7fac88009190 comp rx=0 tx=0).stop 2023-08-25T04:22:21.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.705+0000 7fac9d434640 1 -- 172.21.15.55:0/4142721041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac9815eba0 msgr2=0x7fac98164f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:21.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.705+0000 7fac9d434640 1 --2- 172.21.15.55:0/4142721041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac9815eba0 0x7fac98164f00 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fac8000c530 tx=0x7fac8000c9f0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.705+0000 7fac9d434640 1 -- 172.21.15.55:0/4142721041 shutdown_connections 2023-08-25T04:22:21.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.705+0000 7fac9d434640 1 --2- 172.21.15.55:0/4142721041 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fac780657a0 0x7fac78067c60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.705+0000 7fac9d434640 1 --2- 172.21.15.55:0/4142721041 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac9815ef80 0x7fac98158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.705+0000 7fac9d434640 1 --2- 172.21.15.55:0/4142721041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac9815eba0 0x7fac98164f00 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.705+0000 7fac9d434640 1 --2- 172.21.15.55:0/4142721041 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac980ceeb0 0x7fac981561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.705+0000 7fac9d434640 1 -- 172.21.15.55:0/4142721041 >> 172.21.15.55:0/4142721041 conn(0x7fac98069d00 msgr2=0x7fac9806fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:21.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.705+0000 7fac9d434640 1 -- 172.21.15.55:0/4142721041 shutdown_connections 2023-08-25T04:22:21.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.705+0000 7fac9d434640 1 -- 172.21.15.55:0/4142721041 wait complete. 2023-08-25T04:22:21.727 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-25T04:22:21.728 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-25T04:22:21.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.877+0000 7fd74793a640 1 Processor -- start 2023-08-25T04:22:21.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.877+0000 7fd74793a640 1 -- start start 2023-08-25T04:22:21.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.877+0000 7fd74793a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd740155360 0x7fd74015c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:21.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.877+0000 7fd74793a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd740155740 0x7fd74015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:21.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.877+0000 7fd74793a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74015fa50 con 0x7fd74006fb50 2023-08-25T04:22:21.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.877+0000 7fd74793a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd74015f490 con 0x7fd740155740 2023-08-25T04:22:21.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.877+0000 7fd74793a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd74015f770 con 0x7fd740155360 2023-08-25T04:22:21.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.877+0000 7fd744ed5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd740155740 0x7fd74015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:21.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.877+0000 7fd744ed5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd740155740 0x7fd74015eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54204/0 (socket says 172.21.15.55:54204) 2023-08-25T04:22:21.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.877+0000 7fd744ed5640 1 -- 172.21.15.55:0/3187970410 learned_addr learned my addr 172.21.15.55:0/3187970410 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:21.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.877+0000 7fd7456d6640 1 --2- 172.21.15.55:0/3187970410 >> v2:172.21.15.110:3300/0 conn(0x7fd740155360 0x7fd74015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:21.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.877+0000 7fd744ed5640 1 -- 172.21.15.55:0/3187970410 >> v2:172.21.15.110:3300/0 conn(0x7fd740155360 msgr2=0x7fd74015c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:21.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.877+0000 7fd744ed5640 1 --2- 172.21.15.55:0/3187970410 >> v2:172.21.15.110:3300/0 conn(0x7fd740155360 0x7fd74015c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.877+0000 7fd744ed5640 1 -- 172.21.15.55:0/3187970410 >> v1:172.21.15.110:6789/0 conn(0x7fd74006fb50 legacy=0x7fd7400aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:21.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.877+0000 7fd744ed5640 1 -- 172.21.15.55:0/3187970410 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7400ccb40 con 0x7fd740155740 2023-08-25T04:22:21.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.877+0000 7fd7456d6640 1 --2- 172.21.15.55:0/3187970410 >> v2:172.21.15.110:3300/0 conn(0x7fd740155360 0x7fd74015c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:21.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.881+0000 7fd744ed5640 1 --2- 172.21.15.55:0/3187970410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd740155740 0x7fd74015eb90 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fd74006eca0 tx=0x7fd73001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db91c4730fad13f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:21.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.881+0000 7fd737fff640 1 -- 172.21.15.55:0/3187970410 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7300ab600 con 0x7fd740155740 2023-08-25T04:22:21.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.881+0000 7fd737fff640 1 -- 172.21.15.55:0/3187970410 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7300a7050 con 0x7fd740155740 2023-08-25T04:22:21.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.881+0000 7fd737fff640 1 -- 172.21.15.55:0/3187970410 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7300ab980 con 0x7fd740155740 2023-08-25T04:22:21.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.881+0000 7fd74793a640 1 -- 172.21.15.55:0/3187970410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd740155740 msgr2=0x7fd74015eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:21.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.881+0000 7fd74793a640 1 --2- 172.21.15.55:0/3187970410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd740155740 0x7fd74015eb90 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fd74006eca0 tx=0x7fd73001c3a0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.881+0000 7fd74793a640 1 -- 172.21.15.55:0/3187970410 shutdown_connections 2023-08-25T04:22:21.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.881+0000 7fd74793a640 1 --2- 172.21.15.55:0/3187970410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd740155740 0x7fd74015eb90 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.881+0000 7fd74793a640 1 --2- 172.21.15.55:0/3187970410 >> v2:172.21.15.110:3300/0 conn(0x7fd740155360 0x7fd74015c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.881+0000 7fd74793a640 1 -- 172.21.15.55:0/3187970410 >> 172.21.15.55:0/3187970410 conn(0x7fd7400caf90 msgr2=0x7fd7400cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:21.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.881+0000 7fd74793a640 1 -- 172.21.15.55:0/3187970410 shutdown_connections 2023-08-25T04:22:21.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.881+0000 7fd74793a640 1 -- 172.21.15.55:0/3187970410 wait complete. 2023-08-25T04:22:21.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd74793a640 1 Processor -- start 2023-08-25T04:22:21.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd74793a640 1 -- start start 2023-08-25T04:22:21.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd74793a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd74006fb50 0x7fd74014e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:21.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd74793a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd740155360 0x7fd7400ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:21.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd74793a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd740155740 0x7fd740150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:21.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd74793a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7400c9680 con 0x7fd740155360 2023-08-25T04:22:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd74793a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7400c55e0 con 0x7fd74006fb50 2023-08-25T04:22:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd74793a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7400c5ba0 con 0x7fd740155740 2023-08-25T04:22:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd744ed5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd740155360 0x7fd7400ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd744ed5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd740155360 0x7fd7400ad6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54216/0 (socket says 172.21.15.55:54216) 2023-08-25T04:22:21.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd744ed5640 1 -- 172.21.15.55:0/746247889 learned_addr learned my addr 172.21.15.55:0/746247889 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:21.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd7456d6640 1 --2- 172.21.15.55:0/746247889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd74006fb50 0x7fd74014e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:21.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd745ed7640 1 --2- 172.21.15.55:0/746247889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd740155740 0x7fd740150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:21.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd744ed5640 1 -- 172.21.15.55:0/746247889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd740155740 msgr2=0x7fd740150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:21.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd744ed5640 1 --2- 172.21.15.55:0/746247889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd740155740 0x7fd740150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd744ed5640 1 -- 172.21.15.55:0/746247889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd74006fb50 msgr2=0x7fd74014e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:21.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd744ed5640 1 --2- 172.21.15.55:0/746247889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd74006fb50 0x7fd74014e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:21.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd744ed5640 1 -- 172.21.15.55:0/746247889 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7300094d0 con 0x7fd740155360 2023-08-25T04:22:21.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd744ed5640 1 --2- 172.21.15.55:0/746247889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd740155360 0x7fd7400ad6e0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fd7300ae040 tx=0x7fd730019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:21.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd735ffb640 1 -- 172.21.15.55:0/746247889 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7300ba070 con 0x7fd740155360 2023-08-25T04:22:21.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd735ffb640 1 -- 172.21.15.55:0/746247889 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7300ace10 con 0x7fd740155360 2023-08-25T04:22:21.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd735ffb640 1 -- 172.21.15.55:0/746247889 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7300b6440 con 0x7fd740155360 2023-08-25T04:22:21.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd74793a640 1 -- 172.21.15.55:0/746247889 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74014ed20 con 0x7fd740155360 2023-08-25T04:22:21.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd74793a640 1 -- 172.21.15.55:0/746247889 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7400c98d0 con 0x7fd740155360 2023-08-25T04:22:21.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.885+0000 7fd74793a640 1 -- 172.21.15.55:0/746247889 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7400b0660 con 0x7fd740155360 2023-08-25T04:22:21.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.889+0000 7fd735ffb640 1 -- 172.21.15.55:0/746247889 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fd7300b2040 con 0x7fd740155360 2023-08-25T04:22:21.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.889+0000 7fd735ffb640 1 --2- 172.21.15.55:0/746247889 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fd7240657d0 0x7fd724067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:21.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.889+0000 7fd735ffb640 1 -- 172.21.15.55:0/746247889 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd73011c900 con 0x7fd740155360 2023-08-25T04:22:21.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.889+0000 7fd7456d6640 1 --2- 172.21.15.55:0/746247889 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fd7240657d0 0x7fd724067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:21.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.889+0000 7fd7456d6640 1 --2- 172.21.15.55:0/746247889 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fd7240657d0 0x7fd724067c90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00ab60 tx=0x7fd73c008040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:21.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:21.893+0000 7fd735ffb640 1 -- 172.21.15.55:0/746247889 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd7300ea590 con 0x7fd740155360 2023-08-25T04:22:22.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:22.049+0000 7fd74793a640 1 -- 172.21.15.55:0/746247889 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd74004dbe0 con 0x7fd740155360 2023-08-25T04:22:22.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:22.921+0000 7fd735ffb640 1 -- 172.21.15.55:0/746247889 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v133) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd7300edbb0 con 0x7fd740155360 2023-08-25T04:22:22.921 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-08-25T04:22:22.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:22.925+0000 7fd74793a640 1 -- 172.21.15.55:0/746247889 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fd7240657d0 msgr2=0x7fd724067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:22.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:22.925+0000 7fd74793a640 1 --2- 172.21.15.55:0/746247889 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fd7240657d0 0x7fd724067c90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00ab60 tx=0x7fd73c008040 comp rx=0 tx=0).stop 2023-08-25T04:22:22.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:22.925+0000 7fd74793a640 1 -- 172.21.15.55:0/746247889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd740155360 msgr2=0x7fd7400ad6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:22.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:22.925+0000 7fd74793a640 1 --2- 172.21.15.55:0/746247889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd740155360 0x7fd7400ad6e0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fd7300ae040 tx=0x7fd730019140 comp rx=0 tx=0).stop 2023-08-25T04:22:22.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:22.925+0000 7fd74793a640 1 -- 172.21.15.55:0/746247889 shutdown_connections 2023-08-25T04:22:22.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:22.925+0000 7fd74793a640 1 --2- 172.21.15.55:0/746247889 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fd7240657d0 0x7fd724067c90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:22.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:22.925+0000 7fd74793a640 1 --2- 172.21.15.55:0/746247889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd740155740 0x7fd740150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:22.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:22.925+0000 7fd74793a640 1 --2- 172.21.15.55:0/746247889 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd740155360 0x7fd7400ad6e0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:22.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:22.925+0000 7fd74793a640 1 --2- 172.21.15.55:0/746247889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd74006fb50 0x7fd74014e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:22.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:22.925+0000 7fd74793a640 1 -- 172.21.15.55:0/746247889 >> 172.21.15.55:0/746247889 conn(0x7fd7400caf90 msgr2=0x7fd74006a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:22.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:22.925+0000 7fd74793a640 1 -- 172.21.15.55:0/746247889 shutdown_connections 2023-08-25T04:22:22.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:22.925+0000 7fd74793a640 1 -- 172.21.15.55:0/746247889 wait complete. 2023-08-25T04:22:22.951 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-25T04:22:23.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.105+0000 7ff946456640 1 Processor -- start 2023-08-25T04:22:23.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.105+0000 7ff946456640 1 -- start start 2023-08-25T04:22:23.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.109+0000 7ff946456640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff94015cc40 0x7ff94006ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:23.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.109+0000 7ff946456640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9400b1820 0x7ff9400ce940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:23.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.109+0000 7ff946456640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94006bf20 con 0x7ff9400b12f0 2023-08-25T04:22:23.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.109+0000 7ff946456640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9400d10f0 con 0x7ff9400b1820 2023-08-25T04:22:23.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.109+0000 7ff946456640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9400b0940 con 0x7ff94015cc40 2023-08-25T04:22:23.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.109+0000 7ff9449f3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9400b1820 0x7ff9400ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:23.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.109+0000 7ff9449f3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9400b1820 0x7ff9400ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54230/0 (socket says 172.21.15.55:54230) 2023-08-25T04:22:23.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.109+0000 7ff9449f3640 1 -- 172.21.15.55:0/336701712 learned_addr learned my addr 172.21.15.55:0/336701712 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:23.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.109+0000 7ff93ffff640 1 --2- 172.21.15.55:0/336701712 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff94015cc40 0x7ff94006ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:23.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.109+0000 7ff9449f3640 1 -- 172.21.15.55:0/336701712 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff94015cc40 msgr2=0x7ff94006ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:23.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.109+0000 7ff9449f3640 1 --2- 172.21.15.55:0/336701712 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff94015cc40 0x7ff94006ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:23.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.109+0000 7ff9449f3640 1 -- 172.21.15.55:0/336701712 >> v1:172.21.15.55:6789/0 conn(0x7ff9400b12f0 legacy=0x7ff94006b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:23.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.109+0000 7ff9449f3640 1 -- 172.21.15.55:0/336701712 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9400b0c20 con 0x7ff9400b1820 2023-08-25T04:22:23.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.109+0000 7ff9449f3640 1 --2- 172.21.15.55:0/336701712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9400b1820 0x7ff9400ce940 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7ff938009e50 tx=0x7ff93801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe32dae380d4b5e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:23.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.109+0000 7ff93effd640 1 -- 172.21.15.55:0/336701712 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9380a57d0 con 0x7ff9400b1820 2023-08-25T04:22:23.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff93effd640 1 -- 172.21.15.55:0/336701712 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9380a5930 con 0x7ff9400b1820 2023-08-25T04:22:23.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff93effd640 1 -- 172.21.15.55:0/336701712 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9380a5cc0 con 0x7ff9400b1820 2023-08-25T04:22:23.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff946456640 1 -- 172.21.15.55:0/336701712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9400b1820 msgr2=0x7ff9400ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:23.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff946456640 1 --2- 172.21.15.55:0/336701712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9400b1820 0x7ff9400ce940 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7ff938009e50 tx=0x7ff93801ca10 comp rx=0 tx=0).stop 2023-08-25T04:22:23.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff946456640 1 -- 172.21.15.55:0/336701712 shutdown_connections 2023-08-25T04:22:23.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff946456640 1 --2- 172.21.15.55:0/336701712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9400b1820 0x7ff9400ce940 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:23.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff946456640 1 --2- 172.21.15.55:0/336701712 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff94015cc40 0x7ff94006ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:23.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff946456640 1 -- 172.21.15.55:0/336701712 >> 172.21.15.55:0/336701712 conn(0x7ff9400d05d0 msgr2=0x7ff9400d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:23.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff946456640 1 -- 172.21.15.55:0/336701712 shutdown_connections 2023-08-25T04:22:23.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff946456640 1 -- 172.21.15.55:0/336701712 wait complete. 2023-08-25T04:22:23.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff946456640 1 Processor -- start 2023-08-25T04:22:23.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff946456640 1 -- start start 2023-08-25T04:22:23.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff946456640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9400b12f0 0x7ff940146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:23.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff946456640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9400b1820 0x7ff94014bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:23.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff946456640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff94015cc40 0x7ff94014e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:23.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff946456640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94014c540 con 0x7ff9400b1820 2023-08-25T04:22:23.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff946456640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94014c820 con 0x7ff94015cc40 2023-08-25T04:22:23.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff946456640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94014cb00 con 0x7ff9400b12f0 2023-08-25T04:22:23.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff93f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9400b1820 0x7ff94014bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:23.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff93ffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9400b12f0 0x7ff940146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:23.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff93f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9400b1820 0x7ff94014bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54234/0 (socket says 172.21.15.55:54234) 2023-08-25T04:22:23.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.113+0000 7ff93f7fe640 1 -- 172.21.15.55:0/1942991 learned_addr learned my addr 172.21.15.55:0/1942991 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:23.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.117+0000 7ff9449f3640 1 --2- 172.21.15.55:0/1942991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff94015cc40 0x7ff94014e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:23.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.117+0000 7ff93f7fe640 1 -- 172.21.15.55:0/1942991 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9400b12f0 msgr2=0x7ff940146340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:23.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.117+0000 7ff93f7fe640 1 --2- 172.21.15.55:0/1942991 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9400b12f0 0x7ff940146340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:23.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.117+0000 7ff93f7fe640 1 -- 172.21.15.55:0/1942991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff94015cc40 msgr2=0x7ff94014e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:23.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.117+0000 7ff93f7fe640 1 --2- 172.21.15.55:0/1942991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff94015cc40 0x7ff94014e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:23.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.117+0000 7ff93f7fe640 1 -- 172.21.15.55:0/1942991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff938009b30 con 0x7ff9400b1820 2023-08-25T04:22:23.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.117+0000 7ff93f7fe640 1 --2- 172.21.15.55:0/1942991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9400b1820 0x7ff94014bb40 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c4d0 tx=0x7ff93400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:23.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.117+0000 7ff93cff9640 1 -- 172.21.15.55:0/1942991 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9340052d0 con 0x7ff9400b1820 2023-08-25T04:22:23.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.117+0000 7ff93cff9640 1 -- 172.21.15.55:0/1942991 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff934005430 con 0x7ff9400b1820 2023-08-25T04:22:23.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.117+0000 7ff93cff9640 1 -- 172.21.15.55:0/1942991 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934012830 con 0x7ff9400b1820 2023-08-25T04:22:23.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.117+0000 7ff946456640 1 -- 172.21.15.55:0/1942991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94014cde0 con 0x7ff9400b1820 2023-08-25T04:22:23.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.117+0000 7ff946456640 1 -- 172.21.15.55:0/1942991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff940146880 con 0x7ff9400b1820 2023-08-25T04:22:23.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.117+0000 7ff946456640 1 -- 172.21.15.55:0/1942991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff940073e50 con 0x7ff9400b1820 2023-08-25T04:22:23.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.121+0000 7ff93cff9640 1 -- 172.21.15.55:0/1942991 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7ff934012990 con 0x7ff9400b1820 2023-08-25T04:22:23.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.121+0000 7ff93cff9640 1 --2- 172.21.15.55:0/1942991 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7ff92c0657a0 0x7ff92c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:23.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.121+0000 7ff93cff9640 1 -- 172.21.15.55:0/1942991 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5580+0+0 (secure 0 0 0) 0x7ff934083240 con 0x7ff9400b1820 2023-08-25T04:22:23.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.121+0000 7ff93ffff640 1 --2- 172.21.15.55:0/1942991 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7ff92c0657a0 0x7ff92c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:23.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.121+0000 7ff93ffff640 1 --2- 172.21.15.55:0/1942991 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7ff92c0657a0 0x7ff92c067c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff9300079c0 tx=0x7ff930008040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:23.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.125+0000 7ff93cff9640 1 -- 172.21.15.55:0/1942991 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff934050ea0 con 0x7ff9400b1820 2023-08-25T04:22:23.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.277+0000 7ff946456640 1 -- 172.21.15.55:0/1942991 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff9400d0c00 con 0x7ff9400b1820 2023-08-25T04:22:23.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.925+0000 7ff93cff9640 1 -- 172.21.15.55:0/1942991 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v134) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff9340544c0 con 0x7ff9400b1820 2023-08-25T04:22:23.929 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-08-25T04:22:23.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.937+0000 7ff946456640 1 -- 172.21.15.55:0/1942991 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7ff92c0657a0 msgr2=0x7ff92c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:23.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.937+0000 7ff946456640 1 --2- 172.21.15.55:0/1942991 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7ff92c0657a0 0x7ff92c067c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff9300079c0 tx=0x7ff930008040 comp rx=0 tx=0).stop 2023-08-25T04:22:23.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.937+0000 7ff946456640 1 -- 172.21.15.55:0/1942991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9400b1820 msgr2=0x7ff94014bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:23.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.937+0000 7ff946456640 1 --2- 172.21.15.55:0/1942991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9400b1820 0x7ff94014bb40 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c4d0 tx=0x7ff93400c990 comp rx=0 tx=0).stop 2023-08-25T04:22:23.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.937+0000 7ff946456640 1 -- 172.21.15.55:0/1942991 shutdown_connections 2023-08-25T04:22:23.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.937+0000 7ff946456640 1 --2- 172.21.15.55:0/1942991 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff94015cc40 0x7ff94014e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:23.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.937+0000 7ff946456640 1 --2- 172.21.15.55:0/1942991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9400b1820 0x7ff94014bb40 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:23.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.937+0000 7ff946456640 1 --2- 172.21.15.55:0/1942991 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7ff92c0657a0 0x7ff92c067c60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:23.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.937+0000 7ff946456640 1 --2- 172.21.15.55:0/1942991 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9400b12f0 0x7ff940146340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:23.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.937+0000 7ff946456640 1 -- 172.21.15.55:0/1942991 >> 172.21.15.55:0/1942991 conn(0x7ff9400d05d0 msgr2=0x7ff9400adf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:23.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.941+0000 7ff946456640 1 -- 172.21.15.55:0/1942991 shutdown_connections 2023-08-25T04:22:23.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:23.941+0000 7ff946456640 1 -- 172.21.15.55:0/1942991 wait complete. 2023-08-25T04:22:23.973 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-25T04:22:24.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.121+0000 7feb0dcf7640 1 Processor -- start 2023-08-25T04:22:24.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.121+0000 7feb0dcf7640 1 -- start start 2023-08-25T04:22:24.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.125+0000 7feb0dcf7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb080b8330 0x7feb08167290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:24.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.125+0000 7feb0dcf7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb080b70c0 con 0x7feb080cfc90 2023-08-25T04:22:24.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.125+0000 7feb0dcf7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb080b73a0 con 0x7feb0815fca0 2023-08-25T04:22:24.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.125+0000 7feb0dcf7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb08160080 con 0x7feb080b8330 2023-08-25T04:22:24.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.125+0000 7feafffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feb080cfc90 0x7feb080b55d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40042/0 (socket says 172.21.15.55:40042) 2023-08-25T04:22:24.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.125+0000 7feafffff640 1 -- 172.21.15.55:0/701396137 learned_addr learned my addr 172.21.15.55:0/701396137 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:24.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.125+0000 7feb0d4f6640 1 --2- 172.21.15.55:0/701396137 >> v2:172.21.15.55:3300/0 conn(0x7feb080b8330 0x7feb08167290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:24.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.125+0000 7feb0d4f6640 1 -- 172.21.15.55:0/701396137 >> v1:172.21.15.110:6789/0 conn(0x7feb0815fca0 legacy=0x7feb080cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:24.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.125+0000 7feb0d4f6640 1 -- 172.21.15.55:0/701396137 >> v1:172.21.15.55:6789/0 conn(0x7feb080cfc90 legacy=0x7feb080b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:24.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.125+0000 7feb0d4f6640 1 -- 172.21.15.55:0/701396137 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb080b7680 con 0x7feb080b8330 2023-08-25T04:22:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.129+0000 7feb0d4f6640 1 --2- 172.21.15.55:0/701396137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb080b8330 0x7feb08167290 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7feb00009d90 tx=0x7feb0001f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ee6bc82213df94 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.129+0000 7feaff7fe640 1 -- 172.21.15.55:0/701396137 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb000af600 con 0x7feb080b8330 2023-08-25T04:22:24.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.129+0000 7feaff7fe640 1 -- 172.21.15.55:0/701396137 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb000ab050 con 0x7feb080b8330 2023-08-25T04:22:24.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.129+0000 7feaff7fe640 1 -- 172.21.15.55:0/701396137 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb000af980 con 0x7feb080b8330 2023-08-25T04:22:24.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.129+0000 7feb0dcf7640 1 -- 172.21.15.55:0/701396137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb080b8330 msgr2=0x7feb08167290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:24.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.129+0000 7feb0dcf7640 1 --2- 172.21.15.55:0/701396137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb080b8330 0x7feb08167290 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7feb00009d90 tx=0x7feb0001f130 comp rx=0 tx=0).stop 2023-08-25T04:22:24.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.129+0000 7feb0dcf7640 1 -- 172.21.15.55:0/701396137 shutdown_connections 2023-08-25T04:22:24.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.129+0000 7feb0dcf7640 1 --2- 172.21.15.55:0/701396137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb080b8330 0x7feb08167290 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:24.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.129+0000 7feb0dcf7640 1 -- 172.21.15.55:0/701396137 >> 172.21.15.55:0/701396137 conn(0x7feb080658c0 msgr2=0x7feb08065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:24.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.129+0000 7feb0dcf7640 1 -- 172.21.15.55:0/701396137 shutdown_connections 2023-08-25T04:22:24.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.129+0000 7feb0dcf7640 1 -- 172.21.15.55:0/701396137 wait complete. 2023-08-25T04:22:24.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.129+0000 7feb0dcf7640 1 Processor -- start 2023-08-25T04:22:24.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.129+0000 7feb0dcf7640 1 -- start start 2023-08-25T04:22:24.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0dcf7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb080b8330 0x7feb081577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:24.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0dcf7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb080cfc90 0x7feb0814bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:24.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0dcf7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb0815fca0 0x7feb080d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:24.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0dcf7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb080c71e0 con 0x7feb080b8330 2023-08-25T04:22:24.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0dcf7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb080c8040 con 0x7feb080cfc90 2023-08-25T04:22:24.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0dcf7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb080c84d0 con 0x7feb0815fca0 2023-08-25T04:22:24.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0ccf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb080b8330 0x7feb081577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:24.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0ccf5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb080b8330 0x7feb081577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54256/0 (socket says 172.21.15.55:54256) 2023-08-25T04:22:24.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0ccf5640 1 -- 172.21.15.55:0/1230564021 learned_addr learned my addr 172.21.15.55:0/1230564021 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:24.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feafffff640 1 --2- 172.21.15.55:0/1230564021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb080cfc90 0x7feb0814bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:24.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0d4f6640 1 --2- 172.21.15.55:0/1230564021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb0815fca0 0x7feb080d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:24.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0ccf5640 1 -- 172.21.15.55:0/1230564021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb0815fca0 msgr2=0x7feb080d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:24.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0ccf5640 1 --2- 172.21.15.55:0/1230564021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb0815fca0 0x7feb080d1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:24.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0ccf5640 1 -- 172.21.15.55:0/1230564021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb080cfc90 msgr2=0x7feb0814bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:24.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0ccf5640 1 --2- 172.21.15.55:0/1230564021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb080cfc90 0x7feb0814bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:24.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0ccf5640 1 -- 172.21.15.55:0/1230564021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb00009a70 con 0x7feb080b8330 2023-08-25T04:22:24.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0ccf5640 1 --2- 172.21.15.55:0/1230564021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb080b8330 0x7feb081577b0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7feb0400c3f0 tx=0x7feb0400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:24.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feafd7fa640 1 -- 172.21.15.55:0/1230564021 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb040052d0 con 0x7feb080b8330 2023-08-25T04:22:24.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feafd7fa640 1 -- 172.21.15.55:0/1230564021 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb04005430 con 0x7feb080b8330 2023-08-25T04:22:24.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feafd7fa640 1 -- 172.21.15.55:0/1230564021 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb04003840 con 0x7feb080b8330 2023-08-25T04:22:24.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0dcf7640 1 -- 172.21.15.55:0/1230564021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb08157cf0 con 0x7feb080b8330 2023-08-25T04:22:24.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0dcf7640 1 -- 172.21.15.55:0/1230564021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb080c7710 con 0x7feb080b8330 2023-08-25T04:22:24.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feb0dcf7640 1 -- 172.21.15.55:0/1230564021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb08073e50 con 0x7feb080b8330 2023-08-25T04:22:24.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.133+0000 7feafd7fa640 1 -- 172.21.15.55:0/1230564021 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7feb040039a0 con 0x7feb080b8330 2023-08-25T04:22:24.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.137+0000 7feafd7fa640 1 --2- 172.21.15.55:0/1230564021 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7feaf40657a0 0x7feaf4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:24.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.137+0000 7feafd7fa640 1 -- 172.21.15.55:0/1230564021 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5962+0+0 (secure 0 0 0) 0x7feb04082810 con 0x7feb080b8330 2023-08-25T04:22:24.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.137+0000 7feafffff640 1 --2- 172.21.15.55:0/1230564021 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7feaf40657a0 0x7feaf4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:24.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.137+0000 7feafffff640 1 --2- 172.21.15.55:0/1230564021 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7feaf40657a0 0x7feaf4067c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7feb08159f20 tx=0x7feaf8009040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:24.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.137+0000 7feafd7fa640 1 -- 172.21.15.55:0/1230564021 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7feb04050340 con 0x7feb080b8330 2023-08-25T04:22:24.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.329+0000 7feb0dcf7640 1 -- 172.21.15.55:0/1230564021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7feb080b8110 con 0x7feb080b8330 2023-08-25T04:22:24.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.985+0000 7feafd7fa640 1 -- 172.21.15.55:0/1230564021 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v63) v1 ==== 174+0+0 (secure 0 0 0) 0x7feb04053960 con 0x7feb080b8330 2023-08-25T04:22:24.986 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 17 and data pool 18 2023-08-25T04:22:24.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.997+0000 7feb0dcf7640 1 -- 172.21.15.55:0/1230564021 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7feaf40657a0 msgr2=0x7feaf4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:25.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.997+0000 7feb0dcf7640 1 --2- 172.21.15.55:0/1230564021 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7feaf40657a0 0x7feaf4067c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7feb08159f20 tx=0x7feaf8009040 comp rx=0 tx=0).stop 2023-08-25T04:22:25.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.997+0000 7feb0dcf7640 1 -- 172.21.15.55:0/1230564021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb080b8330 msgr2=0x7feb081577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:25.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.997+0000 7feb0dcf7640 1 --2- 172.21.15.55:0/1230564021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb080b8330 0x7feb081577b0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7feb0400c3f0 tx=0x7feb0400c8b0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.997+0000 7feb0dcf7640 1 -- 172.21.15.55:0/1230564021 shutdown_connections 2023-08-25T04:22:25.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.997+0000 7feb0dcf7640 1 --2- 172.21.15.55:0/1230564021 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7feaf40657a0 0x7feaf4067c60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.997+0000 7feb0dcf7640 1 --2- 172.21.15.55:0/1230564021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb0815fca0 0x7feb080d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.997+0000 7feb0dcf7640 1 --2- 172.21.15.55:0/1230564021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb080cfc90 0x7feb0814bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.997+0000 7feb0dcf7640 1 --2- 172.21.15.55:0/1230564021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb080b8330 0x7feb081577b0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:24.997+0000 7feb0dcf7640 1 -- 172.21.15.55:0/1230564021 >> 172.21.15.55:0/1230564021 conn(0x7feb080658c0 msgr2=0x7feb0815e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:25.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.001+0000 7feb0dcf7640 1 -- 172.21.15.55:0/1230564021 shutdown_connections 2023-08-25T04:22:25.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.001+0000 7feb0dcf7640 1 -- 172.21.15.55:0/1230564021 wait complete. 2023-08-25T04:22:25.028 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:22:25.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.173+0000 7f92fb25c640 1 Processor -- start 2023-08-25T04:22:25.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.173+0000 7f92fb25c640 1 -- start start 2023-08-25T04:22:25.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.173+0000 7f92fb25c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f92f40d0da0 0x7f92f40d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:25.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.173+0000 7f92fb25c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92f40cdde0 0x7f92f40ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:25.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.173+0000 7f92fb25c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92f40cee60 0x7f92f40cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:25.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.173+0000 7f92fb25c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f40ce760 con 0x7f92f40cdde0 2023-08-25T04:22:25.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.173+0000 7f92fb25c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f40b29b0 con 0x7f92f40d0da0 2023-08-25T04:22:25.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.173+0000 7f92fb25c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f40d16c0 con 0x7f92f40cee60 2023-08-25T04:22:25.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.173+0000 7f92f3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92f40cdde0 0x7f92f40ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:25.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.173+0000 7f92f3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92f40cdde0 0x7f92f40ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54264/0 (socket says 172.21.15.55:54264) 2023-08-25T04:22:25.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.173+0000 7f92f3fff640 1 -- 172.21.15.55:0/614985451 learned_addr learned my addr 172.21.15.55:0/614985451 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:25.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.173+0000 7f92f8ff8640 1 --2- 172.21.15.55:0/614985451 >> v2:172.21.15.110:3300/0 conn(0x7f92f40d0da0 0x7f92f40d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:25.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.173+0000 7f92f97f9640 1 --2- 172.21.15.55:0/614985451 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92f40cee60 0x7f92f40cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:25.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.173+0000 7f92f3fff640 1 -- 172.21.15.55:0/614985451 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92f40cee60 msgr2=0x7f92f40cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:25.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.173+0000 7f92f3fff640 1 --2- 172.21.15.55:0/614985451 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92f40cee60 0x7f92f40cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.173+0000 7f92f3fff640 1 -- 172.21.15.55:0/614985451 >> v2:172.21.15.110:3300/0 conn(0x7f92f40d0da0 msgr2=0x7f92f40d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:25.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.173+0000 7f92f3fff640 1 --2- 172.21.15.55:0/614985451 >> v2:172.21.15.110:3300/0 conn(0x7f92f40d0da0 0x7f92f40d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.173+0000 7f92f3fff640 1 -- 172.21.15.55:0/614985451 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f40b1dc0 con 0x7f92f40cdde0 2023-08-25T04:22:25.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.177+0000 7f92f3fff640 1 --2- 172.21.15.55:0/614985451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92f40cdde0 0x7f92f40ce220 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f92f4073720 tx=0x7f92e001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a362a01db27415cf server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:25.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.177+0000 7f92f37fe640 1 -- 172.21.15.55:0/614985451 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e00a89b0 con 0x7f92f40cdde0 2023-08-25T04:22:25.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.177+0000 7f92f37fe640 1 -- 172.21.15.55:0/614985451 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e00a8b10 con 0x7f92f40cdde0 2023-08-25T04:22:25.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.177+0000 7f92f37fe640 1 -- 172.21.15.55:0/614985451 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e00a8ea0 con 0x7f92f40cdde0 2023-08-25T04:22:25.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.177+0000 7f92fb25c640 1 -- 172.21.15.55:0/614985451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92f40cdde0 msgr2=0x7f92f40ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:25.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.177+0000 7f92fb25c640 1 --2- 172.21.15.55:0/614985451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92f40cdde0 0x7f92f40ce220 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f92f4073720 tx=0x7f92e001ecf0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.177+0000 7f92fb25c640 1 -- 172.21.15.55:0/614985451 shutdown_connections 2023-08-25T04:22:25.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.177+0000 7f92fb25c640 1 --2- 172.21.15.55:0/614985451 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92f40cee60 0x7f92f40cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.177+0000 7f92fb25c640 1 --2- 172.21.15.55:0/614985451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92f40cdde0 0x7f92f40ce220 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.177+0000 7f92fb25c640 1 --2- 172.21.15.55:0/614985451 >> v2:172.21.15.110:3300/0 conn(0x7f92f40d0da0 0x7f92f40d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.177+0000 7f92fb25c640 1 -- 172.21.15.55:0/614985451 >> 172.21.15.55:0/614985451 conn(0x7f92f409bae0 msgr2=0x7f92f40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:25.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.177+0000 7f92fb25c640 1 -- 172.21.15.55:0/614985451 shutdown_connections 2023-08-25T04:22:25.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.177+0000 7f92fb25c640 1 -- 172.21.15.55:0/614985451 wait complete. 2023-08-25T04:22:25.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92fb25c640 1 Processor -- start 2023-08-25T04:22:25.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92fb25c640 1 -- start start 2023-08-25T04:22:25.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92fb25c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92f40cdde0 0x7f92f40b75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:25.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92fb25c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92f40cee60 0x7f92f40c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:25.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92fb25c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92f40d0da0 0x7f92f41f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92fb25c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f40c9890 con 0x7f92f40d0da0 2023-08-25T04:22:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92fb25c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f40c9160 con 0x7f92f40cee60 2023-08-25T04:22:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92fb25c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f40c7cf0 con 0x7f92f40cdde0 2023-08-25T04:22:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92f97f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92f40d0da0 0x7f92f41f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92f97f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92f40d0da0 0x7f92f41f2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54274/0 (socket says 172.21.15.55:54274) 2023-08-25T04:22:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92f97f9640 1 -- 172.21.15.55:0/675342569 learned_addr learned my addr 172.21.15.55:0/675342569 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92f3fff640 1 --2- 172.21.15.55:0/675342569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92f40cee60 0x7f92f40c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92f8ff8640 1 --2- 172.21.15.55:0/675342569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92f40cdde0 0x7f92f40b75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:25.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92f97f9640 1 -- 172.21.15.55:0/675342569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92f40cdde0 msgr2=0x7f92f40b75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:25.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92f97f9640 1 --2- 172.21.15.55:0/675342569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92f40cdde0 0x7f92f40b75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92f97f9640 1 -- 172.21.15.55:0/675342569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92f40cee60 msgr2=0x7f92f40c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:25.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92f97f9640 1 --2- 172.21.15.55:0/675342569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92f40cee60 0x7f92f40c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92f97f9640 1 -- 172.21.15.55:0/675342569 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e00094d0 con 0x7f92f40d0da0 2023-08-25T04:22:25.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92f97f9640 1 --2- 172.21.15.55:0/675342569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92f40d0da0 0x7f92f41f2340 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f92ec007d50 tx=0x7f92ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:25.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92f17fa640 1 -- 172.21.15.55:0/675342569 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec014420 con 0x7f92f40d0da0 2023-08-25T04:22:25.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92f17fa640 1 -- 172.21.15.55:0/675342569 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec0145a0 con 0x7f92f40d0da0 2023-08-25T04:22:25.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92fb25c640 1 -- 172.21.15.55:0/675342569 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f40b7c00 con 0x7f92f40d0da0 2023-08-25T04:22:25.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92f17fa640 1 -- 172.21.15.55:0/675342569 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec014950 con 0x7f92f40d0da0 2023-08-25T04:22:25.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.181+0000 7f92fb25c640 1 -- 172.21.15.55:0/675342569 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f40b81c0 con 0x7f92f40d0da0 2023-08-25T04:22:25.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.185+0000 7f92fb25c640 1 -- 172.21.15.55:0/675342569 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f404dbe0 con 0x7f92f40d0da0 2023-08-25T04:22:25.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.185+0000 7f92f17fa640 1 -- 172.21.15.55:0/675342569 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f92ec014ab0 con 0x7f92f40d0da0 2023-08-25T04:22:25.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.185+0000 7f92f17fa640 1 --2- 172.21.15.55:0/675342569 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f92d80657a0 0x7f92d8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:25.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.185+0000 7f92f17fa640 1 -- 172.21.15.55:0/675342569 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f92ec0837a0 con 0x7f92f40d0da0 2023-08-25T04:22:25.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.185+0000 7f92f8ff8640 1 --2- 172.21.15.55:0/675342569 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f92d80657a0 0x7f92d8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:25.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.185+0000 7f92f8ff8640 1 --2- 172.21.15.55:0/675342569 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f92d80657a0 0x7f92d8067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92e8006fd0 tx=0x7f92e8008040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:25.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.189+0000 7f92f17fa640 1 -- 172.21.15.55:0/675342569 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f92ec051160 con 0x7f92f40d0da0 2023-08-25T04:22:25.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.349+0000 7f92fb25c640 1 -- 172.21.15.55:0/675342569 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92f40d0b80 con 0x7f92f40d0da0 2023-08-25T04:22:25.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.349+0000 7f92f17fa640 1 -- 172.21.15.55:0/675342569 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+18386 (secure 0 0 0) 0x7f92ec054780 con 0x7f92f40d0da0 2023-08-25T04:22:25.350 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:25.350 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":135,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:22:24.335850+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:22:22.099798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-25T04:22:23.329827+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:22:25.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.349+0000 7f92fb25c640 1 -- 172.21.15.55:0/675342569 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f92d80657a0 msgr2=0x7f92d8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:25.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.349+0000 7f92fb25c640 1 --2- 172.21.15.55:0/675342569 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f92d80657a0 0x7f92d8067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92e8006fd0 tx=0x7f92e8008040 comp rx=0 tx=0).stop 2023-08-25T04:22:25.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.349+0000 7f92fb25c640 1 -- 172.21.15.55:0/675342569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92f40d0da0 msgr2=0x7f92f41f2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:25.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.349+0000 7f92fb25c640 1 --2- 172.21.15.55:0/675342569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92f40d0da0 0x7f92f41f2340 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f92ec007d50 tx=0x7f92ec00e4b0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.349+0000 7f92fb25c640 1 -- 172.21.15.55:0/675342569 shutdown_connections 2023-08-25T04:22:25.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.349+0000 7f92fb25c640 1 --2- 172.21.15.55:0/675342569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92f40d0da0 0x7f92f41f2340 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.349+0000 7f92fb25c640 1 --2- 172.21.15.55:0/675342569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92f40cee60 0x7f92f40c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.349+0000 7f92fb25c640 1 --2- 172.21.15.55:0/675342569 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f92d80657a0 0x7f92d8067c60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.349+0000 7f92fb25c640 1 --2- 172.21.15.55:0/675342569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92f40cdde0 0x7f92f40b75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.349+0000 7f92fb25c640 1 -- 172.21.15.55:0/675342569 >> 172.21.15.55:0/675342569 conn(0x7f92f409bae0 msgr2=0x7f92f40b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:25.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.349+0000 7f92fb25c640 1 -- 172.21.15.55:0/675342569 shutdown_connections 2023-08-25T04:22:25.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.353+0000 7f92fb25c640 1 -- 172.21.15.55:0/675342569 wait complete. 2023-08-25T04:22:25.371 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:22:25.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.513+0000 7f7e772ec640 1 Processor -- start 2023-08-25T04:22:25.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.513+0000 7f7e772ec640 1 -- start start 2023-08-25T04:22:25.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.513+0000 7f7e772ec640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7e7015a830 0x7f7e700cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.513+0000 7f7e772ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e700cd630 0x7f7e7006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.513+0000 7f7e772ec640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e700ce170 con 0x7f7e700cc2b0 2023-08-25T04:22:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.513+0000 7f7e772ec640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e700cc6f0 con 0x7f7e7015a830 2023-08-25T04:22:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.513+0000 7f7e772ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e700ce3a0 con 0x7f7e700cd630 2023-08-25T04:22:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.513+0000 7f7e74887640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7e700cc2b0 0x7f7e700ccf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40050/0 (socket says 172.21.15.55:40050) 2023-08-25T04:22:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.513+0000 7f7e74887640 1 -- 172.21.15.55:0/3437910442 learned_addr learned my addr 172.21.15.55:0/3437910442 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.513+0000 7f7e75088640 1 --2- 172.21.15.55:0/3437910442 >> v2:172.21.15.110:3300/0 conn(0x7f7e7015a830 0x7f7e700cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:25.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.517+0000 7f7e75889640 1 --2- 172.21.15.55:0/3437910442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e700cd630 0x7f7e7006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:25.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.517+0000 7f7e67fff640 1 -- 172.21.15.55:0/3437910442 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219072710 0 0) 0x7f7e700ce170 con 0x7f7e700cc2b0 2023-08-25T04:22:25.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.517+0000 7f7e67fff640 1 -- 172.21.15.55:0/3437910442 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e5c003530 con 0x7f7e700cc2b0 2023-08-25T04:22:25.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.517+0000 7f7e75088640 1 -- 172.21.15.55:0/3437910442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e700cd630 msgr2=0x7f7e7006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:25.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.517+0000 7f7e75088640 1 --2- 172.21.15.55:0/3437910442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e700cd630 0x7f7e7006d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.517+0000 7f7e75088640 1 -- 172.21.15.55:0/3437910442 >> v1:172.21.15.55:6789/0 conn(0x7f7e700cc2b0 legacy=0x7f7e700ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:25.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.517+0000 7f7e67fff640 1 -- 172.21.15.55:0/3437910442 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3664869261 0 0) 0x7f7e5c003530 con 0x7f7e700cc2b0 2023-08-25T04:22:25.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.517+0000 7f7e75088640 1 -- 172.21.15.55:0/3437910442 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e700ce660 con 0x7f7e7015a830 2023-08-25T04:22:25.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.517+0000 7f7e75889640 1 --2- 172.21.15.55:0/3437910442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e700cd630 0x7f7e7006d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:22:25.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.517+0000 7f7e75088640 1 --2- 172.21.15.55:0/3437910442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e7015a830 0x7f7e700cbd70 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0097a0 tx=0x7f7e6c01c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=949acf7cacef1376 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:25.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.517+0000 7f7e67fff640 1 -- 172.21.15.55:0/3437910442 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60001680 con 0x7f7e7015a830 2023-08-25T04:22:25.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.517+0000 7f7e67fff640 1 -- 172.21.15.55:0/3437910442 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c0a7050 con 0x7f7e7015a830 2023-08-25T04:22:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.517+0000 7f7e67fff640 1 -- 172.21.15.55:0/3437910442 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0ab600 con 0x7f7e7015a830 2023-08-25T04:22:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e772ec640 1 -- 172.21.15.55:0/3437910442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e7015a830 msgr2=0x7f7e700cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e772ec640 1 --2- 172.21.15.55:0/3437910442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e7015a830 0x7f7e700cbd70 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0097a0 tx=0x7f7e6c01c350 comp rx=0 tx=0).stop 2023-08-25T04:22:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e772ec640 1 -- 172.21.15.55:0/3437910442 shutdown_connections 2023-08-25T04:22:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e772ec640 1 --2- 172.21.15.55:0/3437910442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e700cd630 0x7f7e7006d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e772ec640 1 --2- 172.21.15.55:0/3437910442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e7015a830 0x7f7e700cbd70 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e772ec640 1 -- 172.21.15.55:0/3437910442 >> 172.21.15.55:0/3437910442 conn(0x7f7e700d05a0 msgr2=0x7f7e700d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e772ec640 1 -- 172.21.15.55:0/3437910442 shutdown_connections 2023-08-25T04:22:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e772ec640 1 -- 172.21.15.55:0/3437910442 wait complete. 2023-08-25T04:22:25.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e772ec640 1 Processor -- start 2023-08-25T04:22:25.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e772ec640 1 -- start start 2023-08-25T04:22:25.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e772ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e700cc2b0 0x7f7e70158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:25.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e772ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e700cd630 0x7f7e70149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:25.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e772ec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e7015a830 0x7f7e700ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e772ec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e701f5b10 con 0x7f7e700cc2b0 2023-08-25T04:22:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e772ec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7006c860 con 0x7f7e7015a830 2023-08-25T04:22:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e772ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e701f54c0 con 0x7f7e700cd630 2023-08-25T04:22:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e75088640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e700cc2b0 0x7f7e70158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e75088640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e700cc2b0 0x7f7e70158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54276/0 (socket says 172.21.15.55:54276) 2023-08-25T04:22:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e75088640 1 -- 172.21.15.55:0/3272165240 learned_addr learned my addr 172.21.15.55:0/3272165240 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e74887640 1 --2- 172.21.15.55:0/3272165240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e700cd630 0x7f7e70149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.521+0000 7f7e75889640 1 --2- 172.21.15.55:0/3272165240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e7015a830 0x7f7e700ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.525+0000 7f7e75088640 1 -- 172.21.15.55:0/3272165240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e700cd630 msgr2=0x7f7e70149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.525+0000 7f7e75088640 1 --2- 172.21.15.55:0/3272165240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e700cd630 0x7f7e70149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.525+0000 7f7e75088640 1 -- 172.21.15.55:0/3272165240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e7015a830 msgr2=0x7f7e700ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.525+0000 7f7e75088640 1 --2- 172.21.15.55:0/3272165240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e7015a830 0x7f7e700ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.525+0000 7f7e75088640 1 -- 172.21.15.55:0/3272165240 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e68009a70 con 0x7f7e700cc2b0 2023-08-25T04:22:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.525+0000 7f7e75088640 1 --2- 172.21.15.55:0/3272165240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e700cc2b0 0x7f7e70158160 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c000c10 tx=0x7f7e6c0190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.525+0000 7f7e65ffb640 1 -- 172.21.15.55:0/3272165240 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c003a30 con 0x7f7e700cc2b0 2023-08-25T04:22:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.525+0000 7f7e65ffb640 1 -- 172.21.15.55:0/3272165240 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c003b90 con 0x7f7e700cc2b0 2023-08-25T04:22:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.525+0000 7f7e772ec640 1 -- 172.21.15.55:0/3272165240 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6c0093b0 con 0x7f7e700cc2b0 2023-08-25T04:22:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.525+0000 7f7e65ffb640 1 -- 172.21.15.55:0/3272165240 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0b5410 con 0x7f7e700cc2b0 2023-08-25T04:22:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.525+0000 7f7e772ec640 1 -- 172.21.15.55:0/3272165240 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e701f51b0 con 0x7f7e700cc2b0 2023-08-25T04:22:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.525+0000 7f7e772ec640 1 -- 172.21.15.55:0/3272165240 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7004dbe0 con 0x7f7e700cc2b0 2023-08-25T04:22:25.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.525+0000 7f7e65ffb640 1 -- 172.21.15.55:0/3272165240 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f7e6c0b2050 con 0x7f7e700cc2b0 2023-08-25T04:22:25.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.525+0000 7f7e65ffb640 1 --2- 172.21.15.55:0/3272165240 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f7e540657a0 0x7f7e54067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:25.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.529+0000 7f7e65ffb640 1 -- 172.21.15.55:0/3272165240 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e6c11d2b0 con 0x7f7e700cc2b0 2023-08-25T04:22:25.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.529+0000 7f7e74887640 1 --2- 172.21.15.55:0/3272165240 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f7e540657a0 0x7f7e54067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:25.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.529+0000 7f7e74887640 1 --2- 172.21.15.55:0/3272165240 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f7e540657a0 0x7f7e54067c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7e600013b0 tx=0x7f7e60001340 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:25.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.529+0000 7f7e65ffb640 1 -- 172.21.15.55:0/3272165240 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7e6c0ead10 con 0x7f7e700cc2b0 2023-08-25T04:22:25.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.689+0000 7f7e772ec640 1 -- 172.21.15.55:0/3272165240 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e700ae3a0 con 0x7f7e700cc2b0 2023-08-25T04:22:25.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.689+0000 7f7e65ffb640 1 -- 172.21.15.55:0/3272165240 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+18386 (secure 0 0 0) 0x7f7e6c0ee330 con 0x7f7e700cc2b0 2023-08-25T04:22:25.690 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:25.690 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":135,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:22:24.335850+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:22:22.099798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-25T04:22:23.329827+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:22:25.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.689+0000 7f7e772ec640 1 -- 172.21.15.55:0/3272165240 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f7e540657a0 msgr2=0x7f7e54067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:25.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.689+0000 7f7e772ec640 1 --2- 172.21.15.55:0/3272165240 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f7e540657a0 0x7f7e54067c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7e600013b0 tx=0x7f7e60001340 comp rx=0 tx=0).stop 2023-08-25T04:22:25.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.689+0000 7f7e772ec640 1 -- 172.21.15.55:0/3272165240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e700cc2b0 msgr2=0x7f7e70158160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:25.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.689+0000 7f7e772ec640 1 --2- 172.21.15.55:0/3272165240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e700cc2b0 0x7f7e70158160 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c000c10 tx=0x7f7e6c0190f0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.689+0000 7f7e772ec640 1 -- 172.21.15.55:0/3272165240 shutdown_connections 2023-08-25T04:22:25.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.689+0000 7f7e772ec640 1 --2- 172.21.15.55:0/3272165240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e7015a830 0x7f7e700ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.689+0000 7f7e772ec640 1 --2- 172.21.15.55:0/3272165240 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f7e540657a0 0x7f7e54067c60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.689+0000 7f7e772ec640 1 --2- 172.21.15.55:0/3272165240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e700cd630 0x7f7e70149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.689+0000 7f7e772ec640 1 --2- 172.21.15.55:0/3272165240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e700cc2b0 0x7f7e70158160 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.689+0000 7f7e772ec640 1 -- 172.21.15.55:0/3272165240 >> 172.21.15.55:0/3272165240 conn(0x7f7e700d05a0 msgr2=0x7f7e7006e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:25.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.693+0000 7f7e772ec640 1 -- 172.21.15.55:0/3272165240 shutdown_connections 2023-08-25T04:22:25.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.693+0000 7f7e772ec640 1 -- 172.21.15.55:0/3272165240 wait complete. 2023-08-25T04:22:25.713 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-25T04:22:25.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.861+0000 7ff9bc710640 1 Processor -- start 2023-08-25T04:22:25.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.861+0000 7ff9bc710640 1 -- start start 2023-08-25T04:22:25.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.861+0000 7ff9bc710640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9b415d430 0x7ff9b41679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:25.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.861+0000 7ff9bc710640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b415f8b0 con 0x7ff9b415e3c0 2023-08-25T04:22:25.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.861+0000 7ff9bc710640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b40cd5a0 con 0x7ff9b41601f0 2023-08-25T04:22:25.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.861+0000 7ff9bc710640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b40cd880 con 0x7ff9b415d430 2023-08-25T04:22:25.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.861+0000 7ff9bacad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9b415d430 0x7ff9b41679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:25.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.861+0000 7ff9bacad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9b415d430 0x7ff9b41679e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54280/0 (socket says 172.21.15.55:54280) 2023-08-25T04:22:25.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.861+0000 7ff9bacad640 1 -- 172.21.15.55:0/4110635998 learned_addr learned my addr 172.21.15.55:0/4110635998 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:25.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.861+0000 7ff9bacad640 1 -- 172.21.15.55:0/4110635998 >> v1:172.21.15.110:6789/0 conn(0x7ff9b41601f0 legacy=0x7ff9b40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:25.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.861+0000 7ff9bacad640 1 -- 172.21.15.55:0/4110635998 >> v1:172.21.15.55:6789/0 conn(0x7ff9b415e3c0 legacy=0x7ff9b40d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:25.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.861+0000 7ff9bacad640 1 -- 172.21.15.55:0/4110635998 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b40cdb60 con 0x7ff9b415d430 2023-08-25T04:22:25.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.865+0000 7ff9bacad640 1 --2- 172.21.15.55:0/4110635998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b415d430 0x7ff9b41679e0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009e80 tx=0x7ff9ac01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8af604300f6d696 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:25.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.865+0000 7ff9b94aa640 1 -- 172.21.15.55:0/4110635998 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac0af400 con 0x7ff9b415d430 2023-08-25T04:22:25.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.865+0000 7ff9b94aa640 1 -- 172.21.15.55:0/4110635998 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac0ab050 con 0x7ff9b415d430 2023-08-25T04:22:25.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.865+0000 7ff9b94aa640 1 -- 172.21.15.55:0/4110635998 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac0af780 con 0x7ff9b415d430 2023-08-25T04:22:25.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.865+0000 7ff9bc710640 1 -- 172.21.15.55:0/4110635998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b415d430 msgr2=0x7ff9b41679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:25.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.865+0000 7ff9bc710640 1 --2- 172.21.15.55:0/4110635998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b415d430 0x7ff9b41679e0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009e80 tx=0x7ff9ac01f1e0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.865+0000 7ff9bc710640 1 -- 172.21.15.55:0/4110635998 shutdown_connections 2023-08-25T04:22:25.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.865+0000 7ff9bc710640 1 --2- 172.21.15.55:0/4110635998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b415d430 0x7ff9b41679e0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.865+0000 7ff9bc710640 1 -- 172.21.15.55:0/4110635998 >> 172.21.15.55:0/4110635998 conn(0x7ff9b40d27d0 msgr2=0x7ff9b40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:25.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.865+0000 7ff9bc710640 1 -- 172.21.15.55:0/4110635998 shutdown_connections 2023-08-25T04:22:25.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.865+0000 7ff9bc710640 1 -- 172.21.15.55:0/4110635998 wait complete. 2023-08-25T04:22:25.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bc710640 1 Processor -- start 2023-08-25T04:22:25.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bc710640 1 -- start start 2023-08-25T04:22:25.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bc710640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9b415d430 0x7ff9b40ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:25.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bc710640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9b415e3c0 0x7ff9b4157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:25.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bc710640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b41601f0 0x7ff9b40b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:25.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bc710640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b40b7bf0 con 0x7ff9b41601f0 2023-08-25T04:22:25.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bc710640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b40b6340 con 0x7ff9b415d430 2023-08-25T04:22:25.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bc710640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b40cba50 con 0x7ff9b415e3c0 2023-08-25T04:22:25.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bacad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b41601f0 0x7ff9b40b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:25.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bacad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b41601f0 0x7ff9b40b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54290/0 (socket says 172.21.15.55:54290) 2023-08-25T04:22:25.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bacad640 1 -- 172.21.15.55:0/1679820370 learned_addr learned my addr 172.21.15.55:0/1679820370 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:25.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9ba4ac640 1 --2- 172.21.15.55:0/1679820370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9b415d430 0x7ff9b40ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:25.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9b9cab640 1 --2- 172.21.15.55:0/1679820370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9b415e3c0 0x7ff9b4157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:25.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bacad640 1 -- 172.21.15.55:0/1679820370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9b415e3c0 msgr2=0x7ff9b4157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:25.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bacad640 1 --2- 172.21.15.55:0/1679820370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9b415e3c0 0x7ff9b4157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bacad640 1 -- 172.21.15.55:0/1679820370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9b415d430 msgr2=0x7ff9b40ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:25.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bacad640 1 --2- 172.21.15.55:0/1679820370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9b415d430 0x7ff9b40ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:25.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bacad640 1 -- 172.21.15.55:0/1679820370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac009b30 con 0x7ff9b41601f0 2023-08-25T04:22:25.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9ba4ac640 1 --2- 172.21.15.55:0/1679820370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9b415d430 0x7ff9b40ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:25.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bacad640 1 --2- 172.21.15.55:0/1679820370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b41601f0 0x7ff9b40b5e00 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac01bdf0 tx=0x7ff9ac01bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:25.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9aaffd640 1 -- 172.21.15.55:0/1679820370 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac0afde0 con 0x7ff9b41601f0 2023-08-25T04:22:25.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9aaffd640 1 -- 172.21.15.55:0/1679820370 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ac009510 con 0x7ff9b41601f0 2023-08-25T04:22:25.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9aaffd640 1 -- 172.21.15.55:0/1679820370 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac0ba660 con 0x7ff9b41601f0 2023-08-25T04:22:25.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bc710640 1 -- 172.21.15.55:0/1679820370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b40cae40 con 0x7ff9b41601f0 2023-08-25T04:22:25.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.869+0000 7ff9bc710640 1 -- 172.21.15.55:0/1679820370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b40cb400 con 0x7ff9b41601f0 2023-08-25T04:22:25.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.873+0000 7ff9bc710640 1 -- 172.21.15.55:0/1679820370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b40b5260 con 0x7ff9b41601f0 2023-08-25T04:22:25.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.873+0000 7ff9aaffd640 1 -- 172.21.15.55:0/1679820370 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7ff9ac0b6040 con 0x7ff9b41601f0 2023-08-25T04:22:25.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.873+0000 7ff9aaffd640 1 --2- 172.21.15.55:0/1679820370 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7ff9980657a0 0x7ff998067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:25.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.873+0000 7ff9aaffd640 1 -- 172.21.15.55:0/1679820370 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff9ac121410 con 0x7ff9b41601f0 2023-08-25T04:22:25.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.873+0000 7ff9ba4ac640 1 --2- 172.21.15.55:0/1679820370 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7ff9980657a0 0x7ff998067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:25.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.877+0000 7ff9ba4ac640 1 --2- 172.21.15.55:0/1679820370 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7ff9980657a0 0x7ff998067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0007fd0 tx=0x7ff9b0009040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:25.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:25.877+0000 7ff9aaffd640 1 -- 172.21.15.55:0/1679820370 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff9ac0eecd0 con 0x7ff9b41601f0 2023-08-25T04:22:25.900 INFO:tasks.ceph.mds.c.smithi055.stderr:2023-08-25T04:22:25.901+0000 7f1a84d90640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T04:22:26.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:26.073+0000 7ff9bc710640 1 -- 172.21.15.55:0/1679820370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff9b40cbbc0 con 0x7ff9b41601f0 2023-08-25T04:22:26.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:26.985+0000 7ff9aaffd640 1 -- 172.21.15.55:0/1679820370 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v65) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff9ac0f22f0 con 0x7ff9b41601f0 2023-08-25T04:22:26.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:26.985+0000 7ff9bc710640 1 -- 172.21.15.55:0/1679820370 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7ff9980657a0 msgr2=0x7ff998067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:26.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:26.985+0000 7ff9bc710640 1 --2- 172.21.15.55:0/1679820370 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7ff9980657a0 0x7ff998067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0007fd0 tx=0x7ff9b0009040 comp rx=0 tx=0).stop 2023-08-25T04:22:26.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:26.989+0000 7ff9bc710640 1 -- 172.21.15.55:0/1679820370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b41601f0 msgr2=0x7ff9b40b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:26.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:26.989+0000 7ff9bc710640 1 --2- 172.21.15.55:0/1679820370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b41601f0 0x7ff9b40b5e00 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac01bdf0 tx=0x7ff9ac01bf80 comp rx=0 tx=0).stop 2023-08-25T04:22:26.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:26.989+0000 7ff9bc710640 1 -- 172.21.15.55:0/1679820370 shutdown_connections 2023-08-25T04:22:26.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:26.989+0000 7ff9bc710640 1 --2- 172.21.15.55:0/1679820370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9b41601f0 0x7ff9b40b5e00 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:26.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:26.989+0000 7ff9bc710640 1 --2- 172.21.15.55:0/1679820370 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7ff9980657a0 0x7ff998067c60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:26.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:26.989+0000 7ff9bc710640 1 --2- 172.21.15.55:0/1679820370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9b415e3c0 0x7ff9b4157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:26.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:26.989+0000 7ff9bc710640 1 --2- 172.21.15.55:0/1679820370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9b415d430 0x7ff9b40ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:26.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:26.989+0000 7ff9bc710640 1 -- 172.21.15.55:0/1679820370 >> 172.21.15.55:0/1679820370 conn(0x7ff9b40d27d0 msgr2=0x7ff9b406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:26.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:26.989+0000 7ff9bc710640 1 -- 172.21.15.55:0/1679820370 shutdown_connections 2023-08-25T04:22:26.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:26.989+0000 7ff9bc710640 1 -- 172.21.15.55:0/1679820370 wait complete. 2023-08-25T04:22:27.012 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-25T04:22:27.013 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-25T04:22:27.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.165+0000 7fdff7888640 1 Processor -- start 2023-08-25T04:22:27.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.165+0000 7fdff7888640 1 -- start start 2023-08-25T04:22:27.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.165+0000 7fdff7888640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdff015a7f0 0x7fdff009bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:27.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.165+0000 7fdff7888640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdff00c9830 0x7fdff0070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:27.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.165+0000 7fdff7888640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff015abd0 con 0x7fdff006c020 2023-08-25T04:22:27.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.165+0000 7fdff7888640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff00c8ab0 con 0x7fdff00c9830 2023-08-25T04:22:27.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.165+0000 7fdff7888640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00c8d50 con 0x7fdff015a7f0 2023-08-25T04:22:27.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.165+0000 7fdff4e23640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdff00c9830 0x7fdff0070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:27.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.165+0000 7fdff4e23640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdff00c9830 0x7fdff0070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54296/0 (socket says 172.21.15.55:54296) 2023-08-25T04:22:27.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.165+0000 7fdff4e23640 1 -- 172.21.15.55:0/3563614256 learned_addr learned my addr 172.21.15.55:0/3563614256 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:27.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.165+0000 7fdff5624640 1 --2- 172.21.15.55:0/3563614256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdff015a7f0 0x7fdff009bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:27.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.165+0000 7fdff4e23640 1 -- 172.21.15.55:0/3563614256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdff015a7f0 msgr2=0x7fdff009bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:27.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.165+0000 7fdff4e23640 1 --2- 172.21.15.55:0/3563614256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdff015a7f0 0x7fdff009bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:27.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.165+0000 7fdff4e23640 1 -- 172.21.15.55:0/3563614256 >> v1:172.21.15.55:6789/0 conn(0x7fdff006c020 legacy=0x7fdff00acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:27.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.165+0000 7fdff4e23640 1 -- 172.21.15.55:0/3563614256 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff00c9030 con 0x7fdff00c9830 2023-08-25T04:22:27.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.169+0000 7fdff4e23640 1 --2- 172.21.15.55:0/3563614256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdff00c9830 0x7fdff0070f00 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009870 tx=0x7fdfe001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854b543413df890 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:27.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.169+0000 7fdfe7fff640 1 -- 172.21.15.55:0/3563614256 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe00a95f0 con 0x7fdff00c9830 2023-08-25T04:22:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.169+0000 7fdfe7fff640 1 -- 172.21.15.55:0/3563614256 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe00a9750 con 0x7fdff00c9830 2023-08-25T04:22:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.169+0000 7fdfe7fff640 1 -- 172.21.15.55:0/3563614256 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe00a9ae0 con 0x7fdff00c9830 2023-08-25T04:22:27.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.169+0000 7fdff7888640 1 -- 172.21.15.55:0/3563614256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdff00c9830 msgr2=0x7fdff0070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:27.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.169+0000 7fdff7888640 1 --2- 172.21.15.55:0/3563614256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdff00c9830 0x7fdff0070f00 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0009870 tx=0x7fdfe001c510 comp rx=0 tx=0).stop 2023-08-25T04:22:27.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.169+0000 7fdff7888640 1 -- 172.21.15.55:0/3563614256 shutdown_connections 2023-08-25T04:22:27.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.169+0000 7fdff7888640 1 --2- 172.21.15.55:0/3563614256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdff00c9830 0x7fdff0070f00 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:27.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.169+0000 7fdff7888640 1 --2- 172.21.15.55:0/3563614256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdff015a7f0 0x7fdff009bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:27.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.169+0000 7fdff7888640 1 -- 172.21.15.55:0/3563614256 >> 172.21.15.55:0/3563614256 conn(0x7fdff0069900 msgr2=0x7fdff0069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:27.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.169+0000 7fdff7888640 1 -- 172.21.15.55:0/3563614256 shutdown_connections 2023-08-25T04:22:27.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.169+0000 7fdff7888640 1 -- 172.21.15.55:0/3563614256 wait complete. 2023-08-25T04:22:27.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff7888640 1 Processor -- start 2023-08-25T04:22:27.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff7888640 1 -- start start 2023-08-25T04:22:27.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff7888640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdff006c020 0x7fdff0154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:27.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff7888640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdff00c9830 0x7fdff0157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:27.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff7888640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdff015a7f0 0x7fdff015e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:27.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff7888640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00acff0 con 0x7fdff015a7f0 2023-08-25T04:22:27.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff7888640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff0154eb0 con 0x7fdff00c9830 2023-08-25T04:22:27.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff7888640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00cc4f0 con 0x7fdff006c020 2023-08-25T04:22:27.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff5e25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdff015a7f0 0x7fdff015e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:27.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff5e25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdff015a7f0 0x7fdff015e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54308/0 (socket says 172.21.15.55:54308) 2023-08-25T04:22:27.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff5e25640 1 -- 172.21.15.55:0/3901715066 learned_addr learned my addr 172.21.15.55:0/3901715066 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff5624640 1 --2- 172.21.15.55:0/3901715066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdff006c020 0x7fdff0154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff4e23640 1 --2- 172.21.15.55:0/3901715066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdff00c9830 0x7fdff0157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:27.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff5e25640 1 -- 172.21.15.55:0/3901715066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdff006c020 msgr2=0x7fdff0154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff5e25640 1 --2- 172.21.15.55:0/3901715066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdff006c020 0x7fdff0154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff5e25640 1 -- 172.21.15.55:0/3901715066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdff00c9830 msgr2=0x7fdff0157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff5e25640 1 --2- 172.21.15.55:0/3901715066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdff00c9830 0x7fdff0157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff5e25640 1 -- 172.21.15.55:0/3901715066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe00094d0 con 0x7fdff015a7f0 2023-08-25T04:22:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff5624640 1 --2- 172.21.15.55:0/3901715066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdff006c020 0x7fdff0154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff4e23640 1 --2- 172.21.15.55:0/3901715066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdff00c9830 0x7fdff0157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff5e25640 1 --2- 172.21.15.55:0/3901715066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdff015a7f0 0x7fdff015e230 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800c730 tx=0x7fdfe800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:27.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdfe5ffb640 1 -- 172.21.15.55:0/3901715066 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8003b80 con 0x7fdff015a7f0 2023-08-25T04:22:27.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdfe5ffb640 1 -- 172.21.15.55:0/3901715066 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe8003ce0 con 0x7fdff015a7f0 2023-08-25T04:22:27.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdfe5ffb640 1 -- 172.21.15.55:0/3901715066 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8005310 con 0x7fdff015a7f0 2023-08-25T04:22:27.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff7888640 1 -- 172.21.15.55:0/3901715066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff00adc90 con 0x7fdff015a7f0 2023-08-25T04:22:27.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.173+0000 7fdff7888640 1 -- 172.21.15.55:0/3901715066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff00ccab0 con 0x7fdff015a7f0 2023-08-25T04:22:27.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.177+0000 7fdff7888640 1 -- 172.21.15.55:0/3901715066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff006d5b0 con 0x7fdff015a7f0 2023-08-25T04:22:27.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.177+0000 7fdfe5ffb640 1 -- 172.21.15.55:0/3901715066 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fdfe8005680 con 0x7fdff015a7f0 2023-08-25T04:22:27.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.177+0000 7fdfe5ffb640 1 --2- 172.21.15.55:0/3901715066 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fdfd40657a0 0x7fdfd4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:27.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.177+0000 7fdfe5ffb640 1 -- 172.21.15.55:0/3901715066 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdfe8082fb0 con 0x7fdff015a7f0 2023-08-25T04:22:27.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.177+0000 7fdff5624640 1 --2- 172.21.15.55:0/3901715066 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fdfd40657a0 0x7fdfd4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:27.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.177+0000 7fdff5624640 1 --2- 172.21.15.55:0/3901715066 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fdfd40657a0 0x7fdfd4067c60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdfec006fd0 tx=0x7fdfec008040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:27.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.181+0000 7fdfe5ffb640 1 -- 172.21.15.55:0/3901715066 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fdfe80508c0 con 0x7fdff015a7f0 2023-08-25T04:22:27.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.369+0000 7fdff7888640 1 -- 172.21.15.55:0/3901715066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdff0073ec0 con 0x7fdff015a7f0 2023-08-25T04:22:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.993+0000 7fdfe5ffb640 1 -- 172.21.15.55:0/3901715066 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v66) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdfe8053ee0 con 0x7fdff015a7f0 2023-08-25T04:22:27.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.997+0000 7fdff7888640 1 -- 172.21.15.55:0/3901715066 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fdfd40657a0 msgr2=0x7fdfd4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.997+0000 7fdff7888640 1 --2- 172.21.15.55:0/3901715066 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fdfd40657a0 0x7fdfd4067c60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdfec006fd0 tx=0x7fdfec008040 comp rx=0 tx=0).stop 2023-08-25T04:22:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.997+0000 7fdff7888640 1 -- 172.21.15.55:0/3901715066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdff015a7f0 msgr2=0x7fdff015e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.997+0000 7fdff7888640 1 --2- 172.21.15.55:0/3901715066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdff015a7f0 0x7fdff015e230 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800c730 tx=0x7fdfe800cbf0 comp rx=0 tx=0).stop 2023-08-25T04:22:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.997+0000 7fdff7888640 1 -- 172.21.15.55:0/3901715066 shutdown_connections 2023-08-25T04:22:27.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.997+0000 7fdff7888640 1 --2- 172.21.15.55:0/3901715066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdff015a7f0 0x7fdff015e230 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:27.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.997+0000 7fdff7888640 1 --2- 172.21.15.55:0/3901715066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdff00c9830 0x7fdff0157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:27.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.997+0000 7fdff7888640 1 --2- 172.21.15.55:0/3901715066 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fdfd40657a0 0x7fdfd4067c60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:27.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.997+0000 7fdff7888640 1 --2- 172.21.15.55:0/3901715066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdff006c020 0x7fdff0154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.997+0000 7fdff7888640 1 -- 172.21.15.55:0/3901715066 >> 172.21.15.55:0/3901715066 conn(0x7fdff0069900 msgr2=0x7fdff0069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:28.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.997+0000 7fdff7888640 1 -- 172.21.15.55:0/3901715066 shutdown_connections 2023-08-25T04:22:28.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:27.997+0000 7fdff7888640 1 -- 172.21.15.55:0/3901715066 wait complete. 2023-08-25T04:22:28.019 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-25T04:22:28.020 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:22:28.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fce503640 1 Processor -- start 2023-08-25T04:22:28.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fce503640 1 -- start start 2023-08-25T04:22:28.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fce503640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fc80ce220 0x7f6fc80b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fce503640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc80b29b0 con 0x7f6fc80d0da0 2023-08-25T04:22:28.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fce503640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fc80ce6b0 con 0x7f6fc80cdde0 2023-08-25T04:22:28.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fce503640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc80b1dc0 con 0x7f6fc80ce220 2023-08-25T04:22:28.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fc7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6fc80d0da0 0x7f6fc80d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40094/0 (socket says 172.21.15.55:40094) 2023-08-25T04:22:28.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fc7fff640 1 -- 172.21.15.55:0/1147518570 learned_addr learned my addr 172.21.15.55:0/1147518570 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:28.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fccaa0640 1 --2- 172.21.15.55:0/1147518570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fc80ce220 0x7f6fc80b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fc77fe640 1 -- 172.21.15.55:0/1147518570 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1200143188 0 0) 0x7f6fc80b29b0 con 0x7f6fc80d0da0 2023-08-25T04:22:28.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fc77fe640 1 -- 172.21.15.55:0/1147518570 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb4003530 con 0x7f6fc80d0da0 2023-08-25T04:22:28.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fc77fe640 1 -- 172.21.15.55:0/1147518570 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723684644 0 0) 0x7f6fc80ce6b0 con 0x7f6fc80cdde0 2023-08-25T04:22:28.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fc77fe640 1 -- 172.21.15.55:0/1147518570 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fc80b29b0 con 0x7f6fc80cdde0 2023-08-25T04:22:28.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fc77fe640 1 -- 172.21.15.55:0/1147518570 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 8241937 0 0) 0x7f6fb4003530 con 0x7f6fc80d0da0 2023-08-25T04:22:28.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fc77fe640 1 -- 172.21.15.55:0/1147518570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fc80ce220 msgr2=0x7f6fc80b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:28.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fc77fe640 1 --2- 172.21.15.55:0/1147518570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fc80ce220 0x7f6fc80b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fc77fe640 1 -- 172.21.15.55:0/1147518570 >> v1:172.21.15.110:6789/0 conn(0x7f6fc80cdde0 legacy=0x7f6fc80b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:28.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fc77fe640 1 -- 172.21.15.55:0/1147518570 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc80b2080 con 0x7f6fc80d0da0 2023-08-25T04:22:28.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.169+0000 7f6fc77fe640 1 -- 172.21.15.55:0/1147518570 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f6fb8001800 con 0x7f6fc80d0da0 2023-08-25T04:22:28.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fc77fe640 1 -- 172.21.15.55:0/1147518570 >> v1:172.21.15.55:6789/0 conn(0x7f6fc80d0da0 legacy=0x7f6fc80d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:28.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fc77fe640 1 --2- 172.21.15.55:0/1147518570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb4003b40 0x7f6fb4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fc77fe640 1 --2- 172.21.15.55:0/1147518570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fc80ce220 0x7f6fb40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fc77fe640 1 --2- 172.21.15.55:0/1147518570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fb4004d10 0x7f6fb4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fc77fe640 1 -- 172.21.15.55:0/1147518570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc80b1dc0 con 0x7f6fb4004d10 2023-08-25T04:22:28.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fc77fe640 1 -- 172.21.15.55:0/1147518570 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb400ba40 con 0x7f6fb4003b40 2023-08-25T04:22:28.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fc77fe640 1 -- 172.21.15.55:0/1147518570 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb400bbb0 con 0x7f6fc80ce220 2023-08-25T04:22:28.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fccaa0640 1 --2- 172.21.15.55:0/1147518570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fb4004d10 0x7f6fb4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fc7fff640 1 --2- 172.21.15.55:0/1147518570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb4003b40 0x7f6fb4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fbffff640 1 --2- 172.21.15.55:0/1147518570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fc80ce220 0x7f6fb40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fccaa0640 1 -- 172.21.15.55:0/1147518570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fc80ce220 msgr2=0x7f6fb40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:28.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fccaa0640 1 --2- 172.21.15.55:0/1147518570 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fc80ce220 0x7f6fb40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fccaa0640 1 -- 172.21.15.55:0/1147518570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb4003b40 msgr2=0x7f6fb4003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:28.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fccaa0640 1 --2- 172.21.15.55:0/1147518570 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fb4003b40 0x7f6fb4003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fccaa0640 1 -- 172.21.15.55:0/1147518570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb4003530 con 0x7f6fb4004d10 2023-08-25T04:22:28.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fccaa0640 1 --2- 172.21.15.55:0/1147518570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fb4004d10 0x7f6fb4005190 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0009fc0 tx=0x7f6fc001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71be4b6341d4fdd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:28.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fc77fe640 1 -- 172.21.15.55:0/1147518570 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc00a5c70 con 0x7f6fb4004d10 2023-08-25T04:22:28.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fc77fe640 1 -- 172.21.15.55:0/1147518570 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc000f040 con 0x7f6fb4004d10 2023-08-25T04:22:28.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.173+0000 7f6fc77fe640 1 -- 172.21.15.55:0/1147518570 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc00ad440 con 0x7f6fb4004d10 2023-08-25T04:22:28.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fce503640 1 -- 172.21.15.55:0/1147518570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fb4004d10 msgr2=0x7f6fb4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:28.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fce503640 1 --2- 172.21.15.55:0/1147518570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fb4004d10 0x7f6fb4005190 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0009fc0 tx=0x7f6fc001cc60 comp rx=0 tx=0).stop 2023-08-25T04:22:28.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fccaa0640 1 -- 172.21.15.55:0/1147518570 reap_dead start 2023-08-25T04:22:28.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fce503640 1 -- 172.21.15.55:0/1147518570 shutdown_connections 2023-08-25T04:22:28.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fce503640 1 -- 172.21.15.55:0/1147518570 >> 172.21.15.55:0/1147518570 conn(0x7f6fc809bae0 msgr2=0x7f6fc80d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:28.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fce503640 1 -- 172.21.15.55:0/1147518570 shutdown_connections 2023-08-25T04:22:28.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fce503640 1 -- 172.21.15.55:0/1147518570 wait complete. 2023-08-25T04:22:28.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fce503640 1 Processor -- start 2023-08-25T04:22:28.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fce503640 1 -- start start 2023-08-25T04:22:28.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fce503640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fb4004d10 0x7f6fc81e6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fce503640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fc81e6010 0x7f6fc80b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fce503640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fc80ca010 0x7f6fc80cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fce503640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc81e5bf0 con 0x7f6fb4004d10 2023-08-25T04:22:28.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fce503640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc806bd90 con 0x7f6fc80ca010 2023-08-25T04:22:28.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fce503640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc80b8230 con 0x7f6fc81e6010 2023-08-25T04:22:28.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fc7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fb4004d10 0x7f6fc81e6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fc7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fb4004d10 0x7f6fc81e6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54338/0 (socket says 172.21.15.55:54338) 2023-08-25T04:22:28.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fc7fff640 1 -- 172.21.15.55:0/592709484 learned_addr learned my addr 172.21.15.55:0/592709484 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:28.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fbffff640 1 --2- 172.21.15.55:0/592709484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fc81e6010 0x7f6fc80b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fccaa0640 1 --2- 172.21.15.55:0/592709484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fc80ca010 0x7f6fc80cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fc7fff640 1 -- 172.21.15.55:0/592709484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fc81e6010 msgr2=0x7f6fc80b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:28.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fc7fff640 1 --2- 172.21.15.55:0/592709484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fc81e6010 0x7f6fc80b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fc7fff640 1 -- 172.21.15.55:0/592709484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fc80ca010 msgr2=0x7f6fc80cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:28.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fc7fff640 1 --2- 172.21.15.55:0/592709484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fc80ca010 0x7f6fc80cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.177+0000 7f6fc7fff640 1 -- 172.21.15.55:0/592709484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc81e52e0 con 0x7f6fb4004d10 2023-08-25T04:22:28.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.181+0000 7f6fc7fff640 1 --2- 172.21.15.55:0/592709484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fb4004d10 0x7f6fc81e6eb0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800f960 tx=0x7f6fb800fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:28.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.181+0000 7f6fc57fa640 1 -- 172.21.15.55:0/592709484 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb80072e0 con 0x7f6fb4004d10 2023-08-25T04:22:28.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.181+0000 7f6fc57fa640 1 -- 172.21.15.55:0/592709484 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb8007480 con 0x7f6fb4004d10 2023-08-25T04:22:28.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.181+0000 7f6fc57fa640 1 -- 172.21.15.55:0/592709484 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb80059f0 con 0x7f6fb4004d10 2023-08-25T04:22:28.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.181+0000 7f6fce503640 1 -- 172.21.15.55:0/592709484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc80ca560 con 0x7f6fb4004d10 2023-08-25T04:22:28.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.181+0000 7f6fce503640 1 -- 172.21.15.55:0/592709484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc81e5810 con 0x7f6fb4004d10 2023-08-25T04:22:28.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.181+0000 7f6fce503640 1 -- 172.21.15.55:0/592709484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc81e5d30 con 0x7f6fb4004d10 2023-08-25T04:22:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.181+0000 7f6fc57fa640 1 -- 172.21.15.55:0/592709484 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f6fb8005b50 con 0x7f6fb4004d10 2023-08-25T04:22:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.181+0000 7f6fc57fa640 1 --2- 172.21.15.55:0/592709484 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f6fa80657a0 0x7f6fa8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.181+0000 7f6fc57fa640 1 -- 172.21.15.55:0/592709484 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6fb80830a0 con 0x7f6fb4004d10 2023-08-25T04:22:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.181+0000 7f6fbffff640 1 --2- 172.21.15.55:0/592709484 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f6fa80657a0 0x7f6fa8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.185+0000 7f6fbffff640 1 --2- 172.21.15.55:0/592709484 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f6fa80657a0 0x7f6fa8067c60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80cfa60 tx=0x7f6fb0009040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:28.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.185+0000 7f6fc57fa640 1 -- 172.21.15.55:0/592709484 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6fc81e5d30 con 0x7f6fb4004d10 2023-08-25T04:22:28.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.377+0000 7f6fce503640 1 -- 172.21.15.55:0/592709484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fc81e5d30 con 0x7f6fb4004d10 2023-08-25T04:22:28.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.377+0000 7f6fc57fa640 1 -- 172.21.15.55:0/592709484 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f6fb8054580 con 0x7f6fb4004d10 2023-08-25T04:22:28.377 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:28.378 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7493,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/2640392190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2640392190},{"type":"v1","addr":"172.21.15.110:6837","nonce":2640392190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62},{"gid":8428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/2668985619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2668985619},{"type":"v1","addr":"172.21.15.110:6836","nonce":2668985619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61},{"gid":9018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/210118982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":210118982},{"type":"v1","addr":"172.21.15.55:6834","nonce":210118982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:22:24.336177+0000","modified":"2023-08-25T04:22:27.988148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9024":{"gid":9024,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/2424299953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2424299953},{"type":"v1","addr":"172.21.15.55:6835","nonce":2424299953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-25T04:22:28.379 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 66 2023-08-25T04:22:28.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.377+0000 7f6fce503640 1 -- 172.21.15.55:0/592709484 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f6fa80657a0 msgr2=0x7f6fa8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:28.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.377+0000 7f6fce503640 1 --2- 172.21.15.55:0/592709484 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f6fa80657a0 0x7f6fa8067c60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80cfa60 tx=0x7f6fb0009040 comp rx=0 tx=0).stop 2023-08-25T04:22:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.377+0000 7f6fce503640 1 -- 172.21.15.55:0/592709484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fb4004d10 msgr2=0x7f6fc81e6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.377+0000 7f6fce503640 1 --2- 172.21.15.55:0/592709484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fb4004d10 0x7f6fc81e6eb0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800f960 tx=0x7f6fb800fe20 comp rx=0 tx=0).stop 2023-08-25T04:22:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.377+0000 7f6fce503640 1 -- 172.21.15.55:0/592709484 shutdown_connections 2023-08-25T04:22:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.377+0000 7f6fce503640 1 --2- 172.21.15.55:0/592709484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6fc80ca010 0x7f6fc80cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.377+0000 7f6fce503640 1 --2- 172.21.15.55:0/592709484 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f6fa80657a0 0x7f6fa8067c60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.377+0000 7f6fce503640 1 --2- 172.21.15.55:0/592709484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6fc81e6010 0x7f6fc80b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.377+0000 7f6fce503640 1 --2- 172.21.15.55:0/592709484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fb4004d10 0x7f6fc81e6eb0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.377+0000 7f6fce503640 1 -- 172.21.15.55:0/592709484 >> 172.21.15.55:0/592709484 conn(0x7f6fc809bae0 msgr2=0x7f6fc80b3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.377+0000 7f6fce503640 1 -- 172.21.15.55:0/592709484 shutdown_connections 2023-08-25T04:22:28.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.377+0000 7f6fce503640 1 -- 172.21.15.55:0/592709484 wait complete. 2023-08-25T04:22:28.399 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T04:22:28.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.541+0000 7fc1931e1640 1 Processor -- start 2023-08-25T04:22:28.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.541+0000 7fc1931e1640 1 -- start start 2023-08-25T04:22:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.541+0000 7fc1931e1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc18c15a830 0x7fc18c0cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.541+0000 7fc1931e1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc18c0cc2b0 0x7fc18c0ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.541+0000 7fc1931e1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc18c0cd460 0x7fc18c15e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.541+0000 7fc1931e1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18c0cc6f0 con 0x7fc18c0cd460 2023-08-25T04:22:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.541+0000 7fc1931e1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18c0cd8e0 con 0x7fc18c15a830 2023-08-25T04:22:28.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.541+0000 7fc1931e1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c0ce170 con 0x7fc18c0cc2b0 2023-08-25T04:22:28.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.541+0000 7fc19177e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc18c0cd460 0x7fc18c15e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.541+0000 7fc19177e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc18c0cd460 0x7fc18c15e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54354/0 (socket says 172.21.15.55:54354) 2023-08-25T04:22:28.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.541+0000 7fc19177e640 1 -- 172.21.15.55:0/2642636719 learned_addr learned my addr 172.21.15.55:0/2642636719 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:28.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.541+0000 7fc190f7d640 1 --2- 172.21.15.55:0/2642636719 >> v2:172.21.15.110:3300/0 conn(0x7fc18c15a830 0x7fc18c0cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.541+0000 7fc183fff640 1 --2- 172.21.15.55:0/2642636719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc18c0cc2b0 0x7fc18c0ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.545+0000 7fc19177e640 1 -- 172.21.15.55:0/2642636719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc18c0cc2b0 msgr2=0x7fc18c0ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:28.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.545+0000 7fc19177e640 1 --2- 172.21.15.55:0/2642636719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc18c0cc2b0 0x7fc18c0ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.545+0000 7fc19177e640 1 -- 172.21.15.55:0/2642636719 >> v2:172.21.15.110:3300/0 conn(0x7fc18c15a830 msgr2=0x7fc18c0cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:28.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.545+0000 7fc19177e640 1 --2- 172.21.15.55:0/2642636719 >> v2:172.21.15.110:3300/0 conn(0x7fc18c15a830 0x7fc18c0cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.545+0000 7fc19177e640 1 -- 172.21.15.55:0/2642636719 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c0ce3a0 con 0x7fc18c0cd460 2023-08-25T04:22:28.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.545+0000 7fc19177e640 1 --2- 172.21.15.55:0/2642636719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18c0cd460 0x7fc18c15e380 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fc18c073830 tx=0x7fc18401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2164c4843a0788 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:28.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.545+0000 7fc1837fe640 1 -- 172.21.15.55:0/2642636719 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1840a5560 con 0x7fc18c0cd460 2023-08-25T04:22:28.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.545+0000 7fc1837fe640 1 -- 172.21.15.55:0/2642636719 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1840a56c0 con 0x7fc18c0cd460 2023-08-25T04:22:28.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.545+0000 7fc1837fe640 1 -- 172.21.15.55:0/2642636719 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1840a5a50 con 0x7fc18c0cd460 2023-08-25T04:22:28.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.545+0000 7fc1931e1640 1 -- 172.21.15.55:0/2642636719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18c0cd460 msgr2=0x7fc18c15e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:28.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.545+0000 7fc1931e1640 1 --2- 172.21.15.55:0/2642636719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18c0cd460 0x7fc18c15e380 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fc18c073830 tx=0x7fc18401c6e0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.545+0000 7fc1931e1640 1 -- 172.21.15.55:0/2642636719 shutdown_connections 2023-08-25T04:22:28.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.545+0000 7fc1931e1640 1 --2- 172.21.15.55:0/2642636719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18c0cd460 0x7fc18c15e380 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.545+0000 7fc1931e1640 1 --2- 172.21.15.55:0/2642636719 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc18c0cc2b0 0x7fc18c0ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.545+0000 7fc1931e1640 1 --2- 172.21.15.55:0/2642636719 >> v2:172.21.15.110:3300/0 conn(0x7fc18c15a830 0x7fc18c0cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.545+0000 7fc1931e1640 1 -- 172.21.15.55:0/2642636719 >> 172.21.15.55:0/2642636719 conn(0x7fc18c0d05a0 msgr2=0x7fc18c0d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:28.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc1931e1640 1 -- 172.21.15.55:0/2642636719 shutdown_connections 2023-08-25T04:22:28.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc1931e1640 1 -- 172.21.15.55:0/2642636719 wait complete. 2023-08-25T04:22:28.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc1931e1640 1 Processor -- start 2023-08-25T04:22:28.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc1931e1640 1 -- start start 2023-08-25T04:22:28.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc1931e1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc18c0cc2b0 0x7fc18c06b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc1931e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18c0cd460 0x7fc18c0b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc1931e1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc18c15a830 0x7fc18c0b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc1931e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c153370 con 0x7fc18c0cd460 2023-08-25T04:22:28.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc1931e1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c06dbe0 con 0x7fc18c15a830 2023-08-25T04:22:28.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc1931e1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c06f150 con 0x7fc18c0cc2b0 2023-08-25T04:22:28.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc183fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18c0cd460 0x7fc18c0b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc183fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18c0cd460 0x7fc18c0b30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54366/0 (socket says 172.21.15.55:54366) 2023-08-25T04:22:28.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc183fff640 1 -- 172.21.15.55:0/510251821 learned_addr learned my addr 172.21.15.55:0/510251821 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:28.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc190f7d640 1 --2- 172.21.15.55:0/510251821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc18c0cc2b0 0x7fc18c06b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc183fff640 1 -- 172.21.15.55:0/510251821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc18c0cc2b0 msgr2=0x7fc18c06b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:28.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc183fff640 1 --2- 172.21.15.55:0/510251821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc18c0cc2b0 0x7fc18c06b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc19177e640 1 --2- 172.21.15.55:0/510251821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc18c15a830 0x7fc18c0b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc183fff640 1 -- 172.21.15.55:0/510251821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc18c15a830 msgr2=0x7fc18c0b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:28.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc183fff640 1 --2- 172.21.15.55:0/510251821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc18c15a830 0x7fc18c0b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc183fff640 1 -- 172.21.15.55:0/510251821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc184009b30 con 0x7fc18c0cd460 2023-08-25T04:22:28.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc190f7d640 1 --2- 172.21.15.55:0/510251821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc18c0cc2b0 0x7fc18c06b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:28.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc19177e640 1 --2- 172.21.15.55:0/510251821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc18c15a830 0x7fc18c0b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:28.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.549+0000 7fc183fff640 1 --2- 172.21.15.55:0/510251821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18c0cd460 0x7fc18c0b30f0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00e840 tx=0x7fc17c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:28.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.553+0000 7fc1817fa640 1 -- 172.21.15.55:0/510251821 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c004020 con 0x7fc18c0cd460 2023-08-25T04:22:28.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.553+0000 7fc1817fa640 1 -- 172.21.15.55:0/510251821 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c004180 con 0x7fc18c0cd460 2023-08-25T04:22:28.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.553+0000 7fc1817fa640 1 -- 172.21.15.55:0/510251821 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c00c730 con 0x7fc18c0cd460 2023-08-25T04:22:28.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.553+0000 7fc1931e1640 1 -- 172.21.15.55:0/510251821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc18c153090 con 0x7fc18c0cd460 2023-08-25T04:22:28.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.553+0000 7fc1931e1640 1 -- 172.21.15.55:0/510251821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc18c15c000 con 0x7fc18c0cd460 2023-08-25T04:22:28.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.553+0000 7fc1931e1640 1 -- 172.21.15.55:0/510251821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc18c06ecd0 con 0x7fc18c0cd460 2023-08-25T04:22:28.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.553+0000 7fc1817fa640 1 -- 172.21.15.55:0/510251821 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fc17c00c890 con 0x7fc18c0cd460 2023-08-25T04:22:28.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.553+0000 7fc1817fa640 1 --2- 172.21.15.55:0/510251821 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fc1780657d0 0x7fc178067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.553+0000 7fc1817fa640 1 -- 172.21.15.55:0/510251821 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc17c082c40 con 0x7fc18c0cd460 2023-08-25T04:22:28.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.553+0000 7fc190f7d640 1 --2- 172.21.15.55:0/510251821 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fc1780657d0 0x7fc178067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.557+0000 7fc190f7d640 1 --2- 172.21.15.55:0/510251821 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fc1780657d0 0x7fc178067c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc188009ac0 tx=0x7fc188008040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:28.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.557+0000 7fc1817fa640 1 -- 172.21.15.55:0/510251821 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc18c06ecd0 con 0x7fc18c0cd460 2023-08-25T04:22:28.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.717+0000 7fc1931e1640 1 -- 172.21.15.55:0/510251821 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc18c06ecd0 con 0x7fc18c0cd460 2023-08-25T04:22:28.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.721+0000 7fc1817fa640 1 -- 172.21.15.55:0/510251821 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+18373 (secure 0 0 0) 0x7fc18c06ecd0 con 0x7fc18c0cd460 2023-08-25T04:22:28.720 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:28.720 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":136,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T04:22:25.959085+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:22:22.099798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-25T04:22:23.329827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T04:22:28.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.721+0000 7fc1931e1640 1 -- 172.21.15.55:0/510251821 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fc1780657d0 msgr2=0x7fc178067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:28.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.721+0000 7fc1931e1640 1 --2- 172.21.15.55:0/510251821 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fc1780657d0 0x7fc178067c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc188009ac0 tx=0x7fc188008040 comp rx=0 tx=0).stop 2023-08-25T04:22:28.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.721+0000 7fc1931e1640 1 -- 172.21.15.55:0/510251821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18c0cd460 msgr2=0x7fc18c0b30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:28.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.721+0000 7fc1931e1640 1 --2- 172.21.15.55:0/510251821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18c0cd460 0x7fc18c0b30f0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00e840 tx=0x7fc17c00ed00 comp rx=0 tx=0).stop 2023-08-25T04:22:28.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.721+0000 7fc1931e1640 1 -- 172.21.15.55:0/510251821 shutdown_connections 2023-08-25T04:22:28.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.721+0000 7fc1931e1640 1 --2- 172.21.15.55:0/510251821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc18c15a830 0x7fc18c0b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.721+0000 7fc1931e1640 1 --2- 172.21.15.55:0/510251821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18c0cd460 0x7fc18c0b30f0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.721+0000 7fc1931e1640 1 --2- 172.21.15.55:0/510251821 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fc1780657d0 0x7fc178067c90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.721+0000 7fc1931e1640 1 --2- 172.21.15.55:0/510251821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc18c0cc2b0 0x7fc18c06b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.721+0000 7fc1931e1640 1 -- 172.21.15.55:0/510251821 >> 172.21.15.55:0/510251821 conn(0x7fc18c0d05a0 msgr2=0x7fc18c159950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:28.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.721+0000 7fc1931e1640 1 -- 172.21.15.55:0/510251821 shutdown_connections 2023-08-25T04:22:28.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.721+0000 7fc1931e1640 1 -- 172.21.15.55:0/510251821 wait complete. 2023-08-25T04:22:28.742 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-25T04:22:28.742 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:22:28.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.885+0000 7fb5fa288640 1 Processor -- start 2023-08-25T04:22:28.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.885+0000 7fb5fa288640 1 -- start start 2023-08-25T04:22:28.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.885+0000 7fb5fa288640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5f40cdde0 0x7fb5f40ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.885+0000 7fb5fa288640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb5f40b2e40 0x7fb5f40b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.885+0000 7fb5fa288640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f40b29b0 con 0x7fb5f40d0da0 2023-08-25T04:22:28.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.885+0000 7fb5fa288640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f40ce760 con 0x7fb5f40b2e40 2023-08-25T04:22:28.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.885+0000 7fb5fa288640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f40b1dc0 con 0x7fb5f40cdde0 2023-08-25T04:22:28.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.885+0000 7fb5f8825640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb5f40b2e40 0x7fb5f40b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.885+0000 7fb5f8825640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb5f40b2e40 0x7fb5f40b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54380/0 (socket says 172.21.15.55:54380) 2023-08-25T04:22:28.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.885+0000 7fb5f8825640 1 -- 172.21.15.55:0/2574722725 learned_addr learned my addr 172.21.15.55:0/2574722725 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:28.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.885+0000 7fb5f37fe640 1 --2- 172.21.15.55:0/2574722725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5f40cdde0 0x7fb5f40ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.885+0000 7fb5f8825640 1 -- 172.21.15.55:0/2574722725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5f40cdde0 msgr2=0x7fb5f40ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.885+0000 7fb5f8825640 1 --2- 172.21.15.55:0/2574722725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5f40cdde0 0x7fb5f40ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.885+0000 7fb5f8825640 1 -- 172.21.15.55:0/2574722725 >> v1:172.21.15.110:6789/0 conn(0x7fb5f40d0da0 legacy=0x7fb5f40d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.885+0000 7fb5f8825640 1 -- 172.21.15.55:0/2574722725 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f40b2080 con 0x7fb5f40b2e40 2023-08-25T04:22:28.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.889+0000 7fb5f8825640 1 --2- 172.21.15.55:0/2574722725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f40b2e40 0x7fb5f40b32d0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec009e50 tx=0x7fb5ec01f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7ff7e878dc7140 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:28.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.889+0000 7fb5f2ffd640 1 -- 172.21.15.55:0/2574722725 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec0af400 con 0x7fb5f40b2e40 2023-08-25T04:22:28.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.889+0000 7fb5f2ffd640 1 -- 172.21.15.55:0/2574722725 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ec0ab050 con 0x7fb5f40b2e40 2023-08-25T04:22:28.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.889+0000 7fb5f2ffd640 1 -- 172.21.15.55:0/2574722725 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec0af780 con 0x7fb5f40b2e40 2023-08-25T04:22:28.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.889+0000 7fb5fa288640 1 -- 172.21.15.55:0/2574722725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f40b2e40 msgr2=0x7fb5f40b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:28.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.889+0000 7fb5fa288640 1 --2- 172.21.15.55:0/2574722725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f40b2e40 0x7fb5f40b32d0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec009e50 tx=0x7fb5ec01f1f0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.889+0000 7fb5fa288640 1 -- 172.21.15.55:0/2574722725 shutdown_connections 2023-08-25T04:22:28.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.889+0000 7fb5fa288640 1 --2- 172.21.15.55:0/2574722725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f40b2e40 0x7fb5f40b32d0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.889+0000 7fb5fa288640 1 --2- 172.21.15.55:0/2574722725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5f40cdde0 0x7fb5f40ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.889+0000 7fb5fa288640 1 -- 172.21.15.55:0/2574722725 >> 172.21.15.55:0/2574722725 conn(0x7fb5f409bae0 msgr2=0x7fb5f40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:28.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.889+0000 7fb5fa288640 1 -- 172.21.15.55:0/2574722725 shutdown_connections 2023-08-25T04:22:28.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.889+0000 7fb5fa288640 1 -- 172.21.15.55:0/2574722725 wait complete. 2023-08-25T04:22:28.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5fa288640 1 Processor -- start 2023-08-25T04:22:28.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5fa288640 1 -- start start 2023-08-25T04:22:28.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5fa288640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5f40b2e40 0x7fb5f414f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5fa288640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5f40cdde0 0x7fb5f41f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5fa288640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f40d0da0 0x7fb5f40c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5fa288640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f41f67a0 con 0x7fb5f40d0da0 2023-08-25T04:22:28.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5fa288640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f40c8580 con 0x7fb5f40b2e40 2023-08-25T04:22:28.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5fa288640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f40b7c80 con 0x7fb5f40cdde0 2023-08-25T04:22:28.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5f8825640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f40d0da0 0x7fb5f40c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5f8825640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f40d0da0 0x7fb5f40c5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54388/0 (socket says 172.21.15.55:54388) 2023-08-25T04:22:28.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5f8825640 1 -- 172.21.15.55:0/256055367 learned_addr learned my addr 172.21.15.55:0/256055367 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:28.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5f8825640 1 -- 172.21.15.55:0/256055367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5f40cdde0 msgr2=0x7fb5f41f6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5f37fe640 1 --2- 172.21.15.55:0/256055367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5f40cdde0 0x7fb5f41f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5f3fff640 1 --2- 172.21.15.55:0/256055367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5f40b2e40 0x7fb5f414f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5f8825640 1 --2- 172.21.15.55:0/256055367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5f40cdde0 0x7fb5f41f6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5f8825640 1 -- 172.21.15.55:0/256055367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5f40b2e40 msgr2=0x7fb5f414f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5f8825640 1 --2- 172.21.15.55:0/256055367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5f40b2e40 0x7fb5f414f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5f8825640 1 -- 172.21.15.55:0/256055367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec009b30 con 0x7fb5f40d0da0 2023-08-25T04:22:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5f37fe640 1 --2- 172.21.15.55:0/256055367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5f40cdde0 0x7fb5f41f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5f3fff640 1 --2- 172.21.15.55:0/256055367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5f40b2e40 0x7fb5f414f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5f8825640 1 --2- 172.21.15.55:0/256055367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f40d0da0 0x7fb5f40c5a30 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec01ce20 tx=0x7fb5ec01bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5f0ff9640 1 -- 172.21.15.55:0/256055367 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec0afde0 con 0x7fb5f40d0da0 2023-08-25T04:22:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5f0ff9640 1 -- 172.21.15.55:0/256055367 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ec009510 con 0x7fb5f40d0da0 2023-08-25T04:22:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5f0ff9640 1 -- 172.21.15.55:0/256055367 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec0b8640 con 0x7fb5f40d0da0 2023-08-25T04:22:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5fa288640 1 -- 172.21.15.55:0/256055367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f40b7f60 con 0x7fb5f40d0da0 2023-08-25T04:22:28.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.893+0000 7fb5fa288640 1 -- 172.21.15.55:0/256055367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f414be70 con 0x7fb5f40d0da0 2023-08-25T04:22:28.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.897+0000 7fb5fa288640 1 -- 172.21.15.55:0/256055367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f40b8710 con 0x7fb5f40d0da0 2023-08-25T04:22:28.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.897+0000 7fb5f0ff9640 1 -- 172.21.15.55:0/256055367 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fb5ec0b6040 con 0x7fb5f40d0da0 2023-08-25T04:22:28.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.897+0000 7fb5f0ff9640 1 --2- 172.21.15.55:0/256055367 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb5e00657a0 0x7fb5e0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:28.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.897+0000 7fb5f0ff9640 1 -- 172.21.15.55:0/256055367 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb5ec120ff0 con 0x7fb5f40d0da0 2023-08-25T04:22:28.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.897+0000 7fb5f3fff640 1 --2- 172.21.15.55:0/256055367 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb5e00657a0 0x7fb5e0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:28.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.897+0000 7fb5f3fff640 1 --2- 172.21.15.55:0/256055367 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb5e00657a0 0x7fb5e0067c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40cc630 tx=0x7fb5e4009040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:28.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:28.901+0000 7fb5f0ff9640 1 -- 172.21.15.55:0/256055367 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb5ec0ee8f0 con 0x7fb5f40d0da0 2023-08-25T04:22:29.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.053+0000 7fb5fa288640 1 -- 172.21.15.55:0/256055367 --> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5f40b2640 con 0x7fb5e00657a0 2023-08-25T04:22:29.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.069+0000 7fb5f0ff9640 1 -- 172.21.15.55:0/256055367 <== mgr.7301 v2:172.21.15.110:6832/3700713436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299464 (secure 0 0 0) 0x7fb5e4001d30 con 0x7fb5e00657a0 2023-08-25T04:22:29.069 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:29.070 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:22:29.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.069+0000 7fb5fa288640 1 -- 172.21.15.55:0/256055367 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb5e00657a0 msgr2=0x7fb5e0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:29.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.069+0000 7fb5fa288640 1 --2- 172.21.15.55:0/256055367 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb5e00657a0 0x7fb5e0067c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40cc630 tx=0x7fb5e4009040 comp rx=0 tx=0).stop 2023-08-25T04:22:29.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.069+0000 7fb5fa288640 1 -- 172.21.15.55:0/256055367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f40d0da0 msgr2=0x7fb5f40c5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:29.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.069+0000 7fb5fa288640 1 --2- 172.21.15.55:0/256055367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f40d0da0 0x7fb5f40c5a30 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec01ce20 tx=0x7fb5ec01bf90 comp rx=0 tx=0).stop 2023-08-25T04:22:29.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.069+0000 7fb5fa288640 1 -- 172.21.15.55:0/256055367 shutdown_connections 2023-08-25T04:22:29.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.069+0000 7fb5fa288640 1 --2- 172.21.15.55:0/256055367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f40d0da0 0x7fb5f40c5a30 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.069+0000 7fb5fa288640 1 --2- 172.21.15.55:0/256055367 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fb5e00657a0 0x7fb5e0067c60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.069+0000 7fb5fa288640 1 --2- 172.21.15.55:0/256055367 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5f40cdde0 0x7fb5f41f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.069+0000 7fb5fa288640 1 --2- 172.21.15.55:0/256055367 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5f40b2e40 0x7fb5f414f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.069+0000 7fb5fa288640 1 -- 172.21.15.55:0/256055367 >> 172.21.15.55:0/256055367 conn(0x7fb5f409bae0 msgr2=0x7fb5f406b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:29.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.069+0000 7fb5fa288640 1 -- 172.21.15.55:0/256055367 shutdown_connections 2023-08-25T04:22:29.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.069+0000 7fb5fa288640 1 -- 172.21.15.55:0/256055367 wait complete. 2023-08-25T04:22:29.089 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-25T04:22:27.649102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1232,"num_read_kb":2549,"num_write":385,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3554,"ondisk_log_size":3554,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":346684,"kb_used_data":13968,"kb_used_omap":13,"kb_used_meta":332594,"kb_avail":754628036,"statfs":{"total":773094113280,"available":772739108864,"internally_reserved":0,"allocated":14303232,"data_stored":7724588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":340576344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.730869"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.927153+0000","last_change":"2023-08-25T04:22:22.927153+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.927153+0000","last_undegraded":"2023-08-25T04:22:22.927153+0000","last_fullsized":"2023-08-25T04:22:22.927153+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.927298+0000","last_change":"2023-08-25T04:22:22.927298+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.927298+0000","last_undegraded":"2023-08-25T04:22:22.927298+0000","last_fullsized":"2023-08-25T04:22:22.927298+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.923466+0000","last_change":"2023-08-25T04:22:22.923466+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.923466+0000","last_undegraded":"2023-08-25T04:22:22.923466+0000","last_fullsized":"2023-08-25T04:22:22.923466+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.926636+0000","last_change":"2023-08-25T04:22:22.926636+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.926636+0000","last_undegraded":"2023-08-25T04:22:22.926636+0000","last_fullsized":"2023-08-25T04:22:22.926636+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.920944+0000","last_change":"2023-08-25T04:22:22.920944+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.920944+0000","last_undegraded":"2023-08-25T04:22:22.920944+0000","last_fullsized":"2023-08-25T04:22:22.920944+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.921681+0000","last_change":"2023-08-25T04:22:22.921681+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.921681+0000","last_undegraded":"2023-08-25T04:22:22.921681+0000","last_fullsized":"2023-08-25T04:22:22.921681+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.922490+0000","last_change":"2023-08-25T04:22:22.922490+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.922490+0000","last_undegraded":"2023-08-25T04:22:22.922490+0000","last_fullsized":"2023-08-25T04:22:22.922490+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.921643+0000","last_change":"2023-08-25T04:22:22.921643+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.921643+0000","last_undegraded":"2023-08-25T04:22:22.921643+0000","last_fullsized":"2023-08-25T04:22:22.921643+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.926676+0000","last_change":"2023-08-25T04:22:22.926676+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.926676+0000","last_undegraded":"2023-08-25T04:22:22.926676+0000","last_fullsized":"2023-08-25T04:22:22.926676+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.926497+0000","last_change":"2023-08-25T04:22:22.926497+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.926497+0000","last_undegraded":"2023-08-25T04:22:22.926497+0000","last_fullsized":"2023-08-25T04:22:22.926497+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.923054+0000","last_change":"2023-08-25T04:22:22.923054+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.923054+0000","last_undegraded":"2023-08-25T04:22:22.923054+0000","last_fullsized":"2023-08-25T04:22:22.923054+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.922961+0000","last_change":"2023-08-25T04:22:22.922961+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.922961+0000","last_undegraded":"2023-08-25T04:22:22.922961+0000","last_fullsized":"2023-08-25T04:22:22.922961+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.921717+0000","last_change":"2023-08-25T04:22:22.921717+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.921717+0000","last_undegraded":"2023-08-25T04:22:22.921717+0000","last_fullsized":"2023-08-25T04:22:22.921717+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.922979+0000","last_change":"2023-08-25T04:22:22.922979+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.922979+0000","last_undegraded":"2023-08-25T04:22:22.922979+0000","last_fullsized":"2023-08-25T04:22:22.922979+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.926724+0000","last_change":"2023-08-25T04:22:22.926724+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.926724+0000","last_undegraded":"2023-08-25T04:22:22.926724+0000","last_fullsized":"2023-08-25T04:22:22.926724+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.923809+0000","last_change":"2023-08-25T04:22:22.923809+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.923809+0000","last_undegraded":"2023-08-25T04:22:22.923809+0000","last_fullsized":"2023-08-25T04:22:22.923809+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.921722+0000","last_change":"2023-08-25T04:22:22.921722+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.921722+0000","last_undegraded":"2023-08-25T04:22:22.921722+0000","last_fullsized":"2023-08-25T04:22:22.921722+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.926644+0000","last_change":"2023-08-25T04:22:22.926644+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.926644+0000","last_undegraded":"2023-08-25T04:22:22.926644+0000","last_fullsized":"2023-08-25T04:22:22.926644+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.926539+0000","last_change":"2023-08-25T04:22:22.926539+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.926539+0000","last_undegraded":"2023-08-25T04:22:22.926539+0000","last_fullsized":"2023-08-25T04:22:22.926539+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.921670+0000","last_change":"2023-08-25T04:22:22.921670+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.921670+0000","last_undegraded":"2023-08-25T04:22:22.921670+0000","last_fullsized":"2023-08-25T04:22:22.921670+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.920293+0000","last_change":"2023-08-25T04:22:22.920293+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.920293+0000","last_undegraded":"2023-08-25T04:22:22.920293+0000","last_fullsized":"2023-08-25T04:22:22.920293+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.920243+0000","last_change":"2023-08-25T04:22:22.920243+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.920243+0000","last_undegraded":"2023-08-25T04:22:22.920243+0000","last_fullsized":"2023-08-25T04:22:22.920243+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.921657+0000","last_change":"2023-08-25T04:22:22.921657+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.921657+0000","last_undegraded":"2023-08-25T04:22:22.921657+0000","last_fullsized":"2023-08-25T04:22:22.921657+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.922755+0000","last_change":"2023-08-25T04:22:22.922755+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.922755+0000","last_undegraded":"2023-08-25T04:22:22.922755+0000","last_fullsized":"2023-08-25T04:22:22.922755+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.926787+0000","last_change":"2023-08-25T04:22:22.926787+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.926787+0000","last_undegraded":"2023-08-25T04:22:22.926787+0000","last_fullsized":"2023-08-25T04:22:22.926787+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"124'3554","reported_seq":4148,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-25T04:22:22.924431+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:22:22.924431+0000","last_peered":"2023-08-25T04:22:22.924431+0000","last_clean":"2023-08-25T04:22:22.924431+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:22:22.924431+0000","last_undegraded":"2023-08-25T04:22:22.924431+0000","last_fullsized":"2023-08-25T04:22:22.924431+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3554,"log_dups_size":0,"ondisk_log_size":3554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:14:40.684461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1232,"num_read_kb":2549,"num_write":385,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":204,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-25T04:22:22.924351+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:22:22.924351+0000","last_peered":"2023-08-25T04:22:22.924351+0000","last_clean":"2023-08-25T04:22:22.924351+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:22:22.924351+0000","last_undegraded":"2023-08-25T04:22:22.924351+0000","last_fullsized":"2023-08-25T04:22:22.924351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:39:15.799087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.927804+0000","last_change":"2023-08-25T04:22:22.927804+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.927804+0000","last_undegraded":"2023-08-25T04:22:22.927804+0000","last_fullsized":"2023-08-25T04:22:22.927804+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":204,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-25T04:22:22.924288+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:22:22.924288+0000","last_peered":"2023-08-25T04:22:22.924288+0000","last_clean":"2023-08-25T04:22:22.924288+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:22:22.924288+0000","last_undegraded":"2023-08-25T04:22:22.924288+0000","last_fullsized":"2023-08-25T04:22:22.924288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:38:04.299692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.928496+0000","last_change":"2023-08-25T04:22:22.928496+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.928496+0000","last_undegraded":"2023-08-25T04:22:22.928496+0000","last_fullsized":"2023-08-25T04:22:22.928496+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-25T04:22:22.924195+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:22:22.924195+0000","last_peered":"2023-08-25T04:22:22.924195+0000","last_clean":"2023-08-25T04:22:22.924195+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:22:22.924195+0000","last_undegraded":"2023-08-25T04:22:22.924195+0000","last_fullsized":"2023-08-25T04:22:22.924195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:09:51.873746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.927374+0000","last_change":"2023-08-25T04:22:22.927374+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.927374+0000","last_undegraded":"2023-08-25T04:22:22.927374+0000","last_fullsized":"2023-08-25T04:22:22.927374+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":204,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-25T04:22:22.924492+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:22:22.924492+0000","last_peered":"2023-08-25T04:22:22.924492+0000","last_clean":"2023-08-25T04:22:22.924492+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:22:22.924492+0000","last_undegraded":"2023-08-25T04:22:22.924492+0000","last_fullsized":"2023-08-25T04:22:22.924492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:33:39.641488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.926611+0000","last_change":"2023-08-25T04:22:22.926611+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.926611+0000","last_undegraded":"2023-08-25T04:22:22.926611+0000","last_fullsized":"2023-08-25T04:22:22.926611+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-25T04:22:22.920836+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:22:22.920836+0000","last_peered":"2023-08-25T04:22:22.920836+0000","last_clean":"2023-08-25T04:22:22.920836+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:22:22.920836+0000","last_undegraded":"2023-08-25T04:22:22.920836+0000","last_fullsized":"2023-08-25T04:22:22.920836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:50:32.808558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.922576+0000","last_change":"2023-08-25T04:22:22.922576+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.922576+0000","last_undegraded":"2023-08-25T04:22:22.922576+0000","last_fullsized":"2023-08-25T04:22:22.922576+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":204,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-25T04:22:22.925019+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:22:22.925019+0000","last_peered":"2023-08-25T04:22:22.925019+0000","last_clean":"2023-08-25T04:22:22.925019+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:22:22.925019+0000","last_undegraded":"2023-08-25T04:22:22.925019+0000","last_fullsized":"2023-08-25T04:22:22.925019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:40:13.313632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.922584+0000","last_change":"2023-08-25T04:22:22.922584+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.922584+0000","last_undegraded":"2023-08-25T04:22:22.922584+0000","last_fullsized":"2023-08-25T04:22:22.922584+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":225,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-25T04:22:22.920820+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:22:22.920820+0000","last_peered":"2023-08-25T04:22:22.920820+0000","last_clean":"2023-08-25T04:22:22.920820+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:22:22.920820+0000","last_undegraded":"2023-08-25T04:22:22.920820+0000","last_fullsized":"2023-08-25T04:22:22.920820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:33:00.526082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.927578+0000","last_change":"2023-08-25T04:22:22.927578+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.927578+0000","last_undegraded":"2023-08-25T04:22:22.927578+0000","last_fullsized":"2023-08-25T04:22:22.927578+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-25T04:22:22.927715+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:22:22.927715+0000","last_peered":"2023-08-25T04:22:22.927715+0000","last_clean":"2023-08-25T04:22:22.927715+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:22:22.927715+0000","last_undegraded":"2023-08-25T04:22:22.927715+0000","last_fullsized":"2023-08-25T04:22:22.927715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:11:14.411761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1232,"num_read_kb":2549,"num_write":385,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3554,"ondisk_log_size":3554,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509673,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59732,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312108,"statfs":{"total":96636764160,"available":96575598592,"internally_reserved":0,"allocated":2236416,"data_stored":1409892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.67100000000000004,"15min":0.69599999999999995},"min":{"1min":0.501,"5min":0.35399999999999998,"15min":0.33700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.67700000000000005,"15min":0.71299999999999997},"min":{"1min":0.44500000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1,"5min":1,"15min":1.0249999999999999},"last":0.751}]},{"osd":1,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.70799999999999996,"15min":0.72799999999999998},"min":{"1min":0.51900000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.70199999999999996,"15min":0.72899999999999998},"min":{"1min":0.47399999999999998,"5min":0.377,"15min":0.374},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.036},"last":0.70299999999999996}]},{"osd":2,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68200000000000005,"15min":0.70599999999999996},"min":{"1min":0.49399999999999999,"5min":0.38100000000000001,"15min":0.34899999999999998},"max":{"1min":0.89500000000000002,"5min":0.94299999999999995,"15min":1.018},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.71099999999999997,"15min":0.74099999999999999},"min":{"1min":0.498,"5min":0.46500000000000002,"15min":0.38100000000000001},"max":{"1min":1.0429999999999999,"5min":1.046,"15min":1.046},"last":0.83899999999999997}]},{"osd":3,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.70099999999999996,"15min":0.73099999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.71799999999999997,"15min":0.74299999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.78200000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59099999999999997,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.34499999999999997,"15min":0.32400000000000001},"max":{"1min":1.004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.38900000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.97599999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40500000000000003,"15min":0.377},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63800000000000001,"15min":0.63100000000000001},"min":{"1min":0.46600000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.61199999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.99099999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.442,"5min":0.42799999999999999,"15min":0.42699999999999999},"max":{"1min":1.0169999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.58599999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509673,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36944,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334896,"statfs":{"total":96636764160,"available":96598933504,"internally_reserved":0,"allocated":1642496,"data_stored":819524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.66300000000000003,"15min":0.69599999999999995},"min":{"1min":0.53200000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.88500000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66400000000000003,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84299999999999997,"5min":0.96499999999999997,"15min":1.054},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69799999999999995,"15min":0.72699999999999998},"min":{"1min":0.48699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96299999999999997,"5min":1.0269999999999999,"15min":1.0369999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69599999999999995,"15min":0.72199999999999998},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90500000000000003,"5min":1.109,"15min":1.109},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70199999999999996,"15min":0.72899999999999998},"min":{"1min":0.54200000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86799999999999999,"5min":1.0009999999999999,"15min":1.1020000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.59299999999999997,"5min":0.499,"15min":0.499},"max":{"1min":0.92900000000000005,"5min":1.0569999999999999,"15min":1.117},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.51600000000000001,"5min":0.48499999999999999,"15min":0.46899999999999997},"max":{"1min":0.88700000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.52500000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93999999999999995,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.55300000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39400000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.42299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.92200000000000004,"5min":0.95799999999999996,"15min":1.0820000000000001},"last":0.77900000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.48199999999999998,"5min":0.39200000000000002,"15min":0.373},"max":{"1min":0.874,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91700000000000004,"5min":1.141,"15min":1.141},"last":0.80000000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.502,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":1.0389999999999999,"15min":1.046},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71699999999999997,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.44700000000000001},"max":{"1min":0.94199999999999995,"5min":1.373,"15min":1.373},"last":0.82099999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542376,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50832,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321008,"statfs":{"total":96636764160,"available":96584712192,"internally_reserved":0,"allocated":1642496,"data_stored":819524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65400000000000003,"15min":0.69399999999999995},"min":{"1min":0.42399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":1.002,"5min":1.002,"15min":1.018},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66700000000000004,"15min":0.70999999999999996},"min":{"1min":0.50600000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":1.0409999999999999},"last":0.754}]},{"osd":1,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66600000000000004,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93000000000000005,"5min":0.96399999999999997,"15min":0.99399999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.72799999999999998},"min":{"1min":0.48999999999999999,"5min":0.434,"15min":0.434},"max":{"1min":0.96199999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.65400000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65800000000000003,"15min":0.70999999999999996},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.39500000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.97499999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68300000000000005,"15min":0.72699999999999998},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89200000000000002,"5min":1.048,"15min":1.048},"last":0.69699999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68700000000000006,"15min":0.71999999999999997},"min":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70899999999999996,"15min":0.749},"min":{"1min":0.48999999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85999999999999999,"5min":1.028,"15min":1.028},"last":0.80700000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54800000000000004,"15min":0.56999999999999995},"min":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.35399999999999998},"max":{"1min":0.69699999999999995,"5min":0.91000000000000003,"15min":0.97099999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59099999999999997,"15min":0.60999999999999999},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.80800000000000005,"5min":0.91900000000000004,"15min":1.018},"last":0.72899999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.62,"15min":0.62},"min":{"1min":0.437,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.77400000000000002,"5min":0.96799999999999997,"15min":1.008},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64200000000000002,"15min":0.64500000000000002},"min":{"1min":0.46100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.872,"5min":0.94199999999999995,"15min":0.98299999999999998},"last":0.79300000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63300000000000001,"15min":0.61099999999999999},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.877,"5min":0.93300000000000005,"15min":1.032},"last":0.877},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.47799999999999998,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.877,"5min":1.01,"15min":1.048},"last":0.82399999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542376,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36944,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334896,"statfs":{"total":96636764160,"available":96598933504,"internally_reserved":0,"allocated":1642496,"data_stored":819524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.65700000000000003,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.68799999999999994},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.68300000000000005}]},{"osd":1,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.69299999999999995,"15min":0.72299999999999998},"min":{"1min":0.438,"5min":0.38200000000000001,"15min":0.36199999999999999},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.68300000000000005,"15min":0.72399999999999998},"min":{"1min":0.49199999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.75}]},{"osd":2,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.71399999999999997,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.69499999999999995,"15min":0.73699999999999999},"min":{"1min":0.49299999999999999,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.504}]},{"osd":3,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.72699999999999998,"15min":0.75800000000000001},"min":{"1min":0.46999999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":3.0019999999999998,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.69699999999999995,"15min":0.74199999999999999},"min":{"1min":0.54300000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.331,"5min":2.331,"15min":2.331},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.36799999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.60699999999999998,"15min":0.59999999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.746,"15min":0.73999999999999999},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.40699999999999997},"max":{"1min":3.0710000000000002,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.42299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.71199999999999997}]},{"osd":7,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.625},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.71899999999999997,"15min":0.70499999999999996},"min":{"1min":0.50700000000000001,"5min":0.49199999999999999,"15min":0.437},"max":{"1min":3.2170000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":0.80600000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542376,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36944,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334896,"statfs":{"total":96636764160,"available":96598933504,"internally_reserved":0,"allocated":1642496,"data_stored":819524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53900000000000003,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.38500000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63,"5min":0.745,"15min":0.91500000000000004},"last":0.46300000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.502,"15min":0.501},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.74199999999999999,"5min":1.254,"15min":1.254},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.45300000000000001,"5min":0.41499999999999998,"15min":0.33900000000000002},"max":{"1min":0.73999999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.96999999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.38700000000000001,"15min":0.33000000000000002},"max":{"1min":0.79500000000000004,"5min":1.639,"15min":1.639},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.54300000000000004},"min":{"1min":0.39600000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.748,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.56899999999999995,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97999999999999998,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.61899999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.02,"5min":1.601,"15min":1.601},"last":1.016}]},{"osd":5,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.75900000000000001,"15min":0.77700000000000002},"min":{"1min":0.54600000000000004,"5min":0.52900000000000003,"15min":0.49299999999999999},"max":{"1min":1.0349999999999999,"5min":1.254,"15min":1.254},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.75600000000000001,"15min":0.78000000000000003},"min":{"1min":0.66100000000000003,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":0.95299999999999996,"5min":1.421,"15min":1.421},"last":0.94099999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79500000000000004,"15min":0.80000000000000004},"min":{"1min":0.58999999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0880000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.76300000000000001,"15min":0.79200000000000004},"min":{"1min":0.63300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0029999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.76600000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.79700000000000004,"15min":0.82099999999999995},"min":{"1min":0.621,"5min":0.53000000000000003,"15min":0.52500000000000002},"max":{"1min":1.0780000000000001,"5min":1.472,"15min":1.472},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77300000000000002,"15min":0.78900000000000003},"min":{"1min":0.59799999999999998,"5min":0.498,"15min":0.498},"max":{"1min":1.0209999999999999,"5min":1.079,"15min":1.1160000000000001},"last":0.82699999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542377,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54992,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316848,"statfs":{"total":96636764160,"available":96580452352,"internally_reserved":0,"allocated":1642496,"data_stored":819524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.432,"15min":0.45700000000000002},"min":{"1min":0.31,"5min":0.255,"15min":0.255},"max":{"1min":0.63500000000000001,"5min":0.77200000000000002,"15min":0.85599999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.47899999999999998,"15min":0.495},"min":{"1min":0.35799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.93100000000000005},"last":0.38600000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46899999999999997,"15min":0.48199999999999998},"min":{"1min":0.34799999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69599999999999995,"5min":0.70799999999999996,"15min":0.78800000000000003},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56599999999999995,"15min":0.59199999999999997},"min":{"1min":0.41099999999999998,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.81200000000000006,"5min":0.81699999999999995,"15min":0.89800000000000002},"last":0.433}]},{"osd":3,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.50900000000000001,"15min":0.52900000000000003},"min":{"1min":0.46400000000000002,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":0.748,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.40600000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.89400000000000002},"last":0.45500000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.73699999999999999,"15min":0.78100000000000003},"min":{"1min":0.51900000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.103,"5min":1.103,"15min":1.2569999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.72999999999999998,"15min":0.77100000000000002},"min":{"1min":0.59799999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.5509999999999999},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.747,"15min":0.78400000000000003},"min":{"1min":0.52500000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.2789999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.75900000000000001,"15min":0.79500000000000004},"min":{"1min":0.627,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.3089999999999999},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.754,"15min":0.80700000000000005},"min":{"1min":0.57999999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.077,"5min":1.077,"15min":1.3069999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.78400000000000003,"15min":0.83799999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.375},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74199999999999999,"15min":0.78700000000000003},"min":{"1min":0.54100000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.21,"5min":1.21,"15min":1.339},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.76100000000000001,"15min":0.79200000000000004},"min":{"1min":0.52400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.099,"5min":1.099,"15min":1.1859999999999999},"last":0.61599999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542377,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36944,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334896,"statfs":{"total":96636764160,"available":96598933504,"internally_reserved":0,"allocated":1630208,"data_stored":813354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.438,"15min":0.45100000000000001},"min":{"1min":0.26400000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.96899999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.753,"5min":0.85099999999999998,"15min":1.212},"last":0.54500000000000004}]},{"osd":2,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.498,"15min":0.498},"min":{"1min":0.35599999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.76400000000000001,"5min":0.82099999999999995,"15min":0.876},"last":0.499},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.39900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53800000000000003,"15min":0.56799999999999995},"min":{"1min":0.33200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.748,"5min":0.84299999999999997,"15min":1.165},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70899999999999996,"15min":0.75700000000000001},"min":{"1min":0.51900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92300000000000004,"5min":1.012,"15min":1.204},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.76300000000000001,"15min":0.79300000000000004},"min":{"1min":0.52400000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.2529999999999999},"last":0.84299999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72399999999999998,"15min":0.77500000000000002},"min":{"1min":0.54500000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89200000000000002,"5min":1.073,"15min":1.254},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.74399999999999999,"15min":0.79400000000000004},"min":{"1min":0.56999999999999995,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0129999999999999,"5min":1.044,"15min":1.9059999999999999},"last":0.96399999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80000000000000004,"15min":0.82399999999999995},"min":{"1min":0.55800000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.294,"5min":1.294,"15min":1.623},"last":0.875},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.755,"15min":0.78900000000000003},"min":{"1min":0.57899999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93000000000000005,"5min":1.0369999999999999,"15min":1.288},"last":1.0129999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.753,"15min":0.79400000000000004},"min":{"1min":0.59199999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95999999999999996,"5min":1.1140000000000001,"15min":1.2949999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81799999999999995,"15min":0.83799999999999997},"min":{"1min":0.59199999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.3120000000000001},"last":1.002}]}]},{"osd":0,"up_from":14,"seq":60129542376,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33352,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338488,"statfs":{"total":96636764160,"available":96602611712,"internally_reserved":0,"allocated":2224128,"data_stored":1403722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46999999999999997,"15min":0.48199999999999998},"min":{"1min":0.28199999999999997,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.66300000000000003,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.55500000000000005},"min":{"1min":0.39200000000000002,"5min":0.38500000000000001,"15min":0.36699999999999999},"max":{"1min":0.79700000000000004,"5min":1.0129999999999999,"15min":3.5089999999999999},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.51500000000000001},"min":{"1min":0.36199999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.53300000000000003},"min":{"1min":0.34399999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.748,"5min":0.876,"15min":3.4590000000000001},"last":0.53500000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47599999999999998,"15min":0.48699999999999999},"min":{"1min":0.35499999999999998,"5min":0.28699999999999998,"15min":0.27700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.40500000000000003,"5min":0.36699999999999999,"15min":0.32700000000000001},"max":{"1min":0.875,"5min":0.93500000000000005,"15min":1.2470000000000001},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.746,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91400000000000003,"5min":1.2,"15min":1.2},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.754,"5min":0.73999999999999999,"15min":0.79000000000000004},"min":{"1min":0.56799999999999995,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.169,"15min":1.169},"last":0.64200000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72899999999999998,"15min":0.78100000000000003},"min":{"1min":0.59499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84399999999999997,"5min":1.131,"15min":3.528},"last":0.629},{"interface":"front","average":{"1min":0.745,"5min":0.746,"15min":0.79600000000000004},"min":{"1min":0.55700000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98799999999999999,"5min":1.244,"15min":1.244},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73499999999999999,"15min":0.78700000000000003},"min":{"1min":0.54500000000000004,"5min":0.495,"15min":0.495},"max":{"1min":0.95999999999999996,"5min":1.1180000000000001,"15min":3.4870000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77400000000000002,"15min":0.81499999999999995},"min":{"1min":0.57299999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98099999999999998,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.64800000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78400000000000003,"15min":0.82499999999999996},"min":{"1min":0.51700000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0580000000000001,"5min":1.28,"15min":1.28},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.753,"15min":0.79500000000000004},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0820000000000001,"5min":1.0940000000000001,"15min":1.1930000000000001},"last":0.61499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:22:29.098 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:22:29.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.273+0000 7f8aea544640 1 Processor -- start 2023-08-25T04:22:29.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.273+0000 7f8aea544640 1 -- start start 2023-08-25T04:22:29.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.273+0000 7f8aea544640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ae40d0da0 0x7f8ae40d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:29.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.273+0000 7f8aea544640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8ae40cdde0 0x7f8ae40ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:29.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.273+0000 7f8aea544640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8ae40cee60 0x7f8ae40cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:29.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.273+0000 7f8aea544640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae40ce760 con 0x7f8ae40cee60 2023-08-25T04:22:29.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.273+0000 7f8aea544640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae40b29b0 con 0x7f8ae40cdde0 2023-08-25T04:22:29.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.273+0000 7f8aea544640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40d16c0 con 0x7f8ae40d0da0 2023-08-25T04:22:29.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.273+0000 7f8ae8ae1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8ae40cee60 0x7f8ae40cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:29.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.273+0000 7f8ae8ae1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8ae40cee60 0x7f8ae40cf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54390/0 (socket says 172.21.15.55:54390) 2023-08-25T04:22:29.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.273+0000 7f8ae8ae1640 1 -- 172.21.15.55:0/2882956777 learned_addr learned my addr 172.21.15.55:0/2882956777 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:29.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.273+0000 7f8ae3fff640 1 --2- 172.21.15.55:0/2882956777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ae40d0da0 0x7f8ae40d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:29.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.273+0000 7f8ae37fe640 1 --2- 172.21.15.55:0/2882956777 >> v2:172.21.15.110:3300/0 conn(0x7f8ae40cdde0 0x7f8ae40ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:29.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.273+0000 7f8ae8ae1640 1 -- 172.21.15.55:0/2882956777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ae40d0da0 msgr2=0x7f8ae40d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:29.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.273+0000 7f8ae8ae1640 1 --2- 172.21.15.55:0/2882956777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ae40d0da0 0x7f8ae40d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.273+0000 7f8ae8ae1640 1 -- 172.21.15.55:0/2882956777 >> v2:172.21.15.110:3300/0 conn(0x7f8ae40cdde0 msgr2=0x7f8ae40ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:29.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.273+0000 7f8ae8ae1640 1 --2- 172.21.15.55:0/2882956777 >> v2:172.21.15.110:3300/0 conn(0x7f8ae40cdde0 0x7f8ae40ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.273+0000 7f8ae8ae1640 1 -- 172.21.15.55:0/2882956777 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae40b1dc0 con 0x7f8ae40cee60 2023-08-25T04:22:29.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.277+0000 7f8ae8ae1640 1 --2- 172.21.15.55:0/2882956777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ae40cee60 0x7f8ae40cf2f0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f8ae409c210 tx=0x7f8adc01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb37ee783d356590 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:29.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.277+0000 7f8ae2ffd640 1 -- 172.21.15.55:0/2882956777 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0af400 con 0x7f8ae40cee60 2023-08-25T04:22:29.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.277+0000 7f8ae2ffd640 1 -- 172.21.15.55:0/2882956777 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc0ab050 con 0x7f8ae40cee60 2023-08-25T04:22:29.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.277+0000 7f8ae2ffd640 1 -- 172.21.15.55:0/2882956777 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0af780 con 0x7f8ae40cee60 2023-08-25T04:22:29.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.277+0000 7f8aea544640 1 -- 172.21.15.55:0/2882956777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ae40cee60 msgr2=0x7f8ae40cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:29.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.277+0000 7f8aea544640 1 --2- 172.21.15.55:0/2882956777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ae40cee60 0x7f8ae40cf2f0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f8ae409c210 tx=0x7f8adc01f1c0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.277+0000 7f8aea544640 1 -- 172.21.15.55:0/2882956777 shutdown_connections 2023-08-25T04:22:29.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.277+0000 7f8aea544640 1 --2- 172.21.15.55:0/2882956777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ae40cee60 0x7f8ae40cf2f0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.277+0000 7f8aea544640 1 --2- 172.21.15.55:0/2882956777 >> v2:172.21.15.110:3300/0 conn(0x7f8ae40cdde0 0x7f8ae40ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.277+0000 7f8aea544640 1 --2- 172.21.15.55:0/2882956777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ae40d0da0 0x7f8ae40d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.277+0000 7f8aea544640 1 -- 172.21.15.55:0/2882956777 >> 172.21.15.55:0/2882956777 conn(0x7f8ae409bae0 msgr2=0x7f8ae40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:29.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.277+0000 7f8aea544640 1 -- 172.21.15.55:0/2882956777 shutdown_connections 2023-08-25T04:22:29.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.277+0000 7f8aea544640 1 -- 172.21.15.55:0/2882956777 wait complete. 2023-08-25T04:22:29.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8aea544640 1 Processor -- start 2023-08-25T04:22:29.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8aea544640 1 -- start start 2023-08-25T04:22:29.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8aea544640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ae40cdde0 0x7f8ae41f1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:29.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8aea544640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ae40cee60 0x7f8ae40b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:29.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8aea544640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ae40d0da0 0x7f8ae406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:29.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8aea544640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40c62f0 con 0x7f8ae40d0da0 2023-08-25T04:22:29.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8aea544640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40c6e70 con 0x7f8ae40cee60 2023-08-25T04:22:29.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8aea544640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40c6540 con 0x7f8ae40cdde0 2023-08-25T04:22:29.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8ae8ae1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ae40d0da0 0x7f8ae406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:29.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8ae8ae1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ae40d0da0 0x7f8ae406bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54394/0 (socket says 172.21.15.55:54394) 2023-08-25T04:22:29.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8ae8ae1640 1 -- 172.21.15.55:0/1677109679 learned_addr learned my addr 172.21.15.55:0/1677109679 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:29.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8ae3fff640 1 --2- 172.21.15.55:0/1677109679 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ae40cdde0 0x7f8ae41f1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:29.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8ae37fe640 1 --2- 172.21.15.55:0/1677109679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ae40cee60 0x7f8ae40b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:29.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8ae8ae1640 1 -- 172.21.15.55:0/1677109679 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ae40cdde0 msgr2=0x7f8ae41f1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:29.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8ae8ae1640 1 --2- 172.21.15.55:0/1677109679 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ae40cdde0 0x7f8ae41f1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8ae8ae1640 1 -- 172.21.15.55:0/1677109679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ae40cee60 msgr2=0x7f8ae40b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:29.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8ae8ae1640 1 --2- 172.21.15.55:0/1677109679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ae40cee60 0x7f8ae40b71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8ae8ae1640 1 -- 172.21.15.55:0/1677109679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc009b30 con 0x7f8ae40d0da0 2023-08-25T04:22:29.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8ae8ae1640 1 --2- 172.21.15.55:0/1677109679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ae40d0da0 0x7f8ae406bae0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0b2040 tx=0x7f8adc01bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:29.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8ae0ff9640 1 -- 172.21.15.55:0/1677109679 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0afc80 con 0x7f8ae40d0da0 2023-08-25T04:22:29.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8ae0ff9640 1 -- 172.21.15.55:0/1677109679 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc0afe00 con 0x7f8ae40d0da0 2023-08-25T04:22:29.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8ae0ff9640 1 -- 172.21.15.55:0/1677109679 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0b8640 con 0x7f8ae40d0da0 2023-08-25T04:22:29.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8aea544640 1 -- 172.21.15.55:0/1677109679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae40c6820 con 0x7f8ae40d0da0 2023-08-25T04:22:29.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.281+0000 7f8aea544640 1 -- 172.21.15.55:0/1677109679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae41f1fd0 con 0x7f8ae40d0da0 2023-08-25T04:22:29.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.285+0000 7f8aea544640 1 -- 172.21.15.55:0/1677109679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae40c6fe0 con 0x7f8ae40d0da0 2023-08-25T04:22:29.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.285+0000 7f8ae0ff9640 1 -- 172.21.15.55:0/1677109679 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f8adc0b6040 con 0x7f8ae40d0da0 2023-08-25T04:22:29.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.285+0000 7f8ae0ff9640 1 --2- 172.21.15.55:0/1677109679 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f8ad00657a0 0x7f8ad0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:29.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.285+0000 7f8ae0ff9640 1 -- 172.21.15.55:0/1677109679 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8adc120cb0 con 0x7f8ae40d0da0 2023-08-25T04:22:29.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.285+0000 7f8ae3fff640 1 --2- 172.21.15.55:0/1677109679 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f8ad00657a0 0x7f8ad0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:29.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.285+0000 7f8ae3fff640 1 --2- 172.21.15.55:0/1677109679 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f8ad00657a0 0x7f8ad0067c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009b40 tx=0x7f8ad4006f90 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:29.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.289+0000 7f8ae0ff9640 1 -- 172.21.15.55:0/1677109679 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8adc0ee6b0 con 0x7f8ae40d0da0 2023-08-25T04:22:29.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.441+0000 7f8aea544640 1 -- 172.21.15.55:0/1677109679 --> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ae40b2360 con 0x7f8ad00657a0 2023-08-25T04:22:29.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.453+0000 7f8ae0ff9640 1 -- 172.21.15.55:0/1677109679 <== mgr.7301 v2:172.21.15.110:6832/3700713436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299464 (secure 0 0 0) 0x7f8ad4011a60 con 0x7f8ad00657a0 2023-08-25T04:22:29.457 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:29.458 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:22:29.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.453+0000 7f8aea544640 1 -- 172.21.15.55:0/1677109679 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f8ad00657a0 msgr2=0x7f8ad0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:29.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.453+0000 7f8aea544640 1 --2- 172.21.15.55:0/1677109679 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f8ad00657a0 0x7f8ad0067c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4009b40 tx=0x7f8ad4006f90 comp rx=0 tx=0).stop 2023-08-25T04:22:29.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.453+0000 7f8aea544640 1 -- 172.21.15.55:0/1677109679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ae40d0da0 msgr2=0x7f8ae406bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:29.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.453+0000 7f8aea544640 1 --2- 172.21.15.55:0/1677109679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ae40d0da0 0x7f8ae406bae0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0b2040 tx=0x7f8adc01bf60 comp rx=0 tx=0).stop 2023-08-25T04:22:29.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.453+0000 7f8aea544640 1 -- 172.21.15.55:0/1677109679 shutdown_connections 2023-08-25T04:22:29.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.453+0000 7f8aea544640 1 --2- 172.21.15.55:0/1677109679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ae40d0da0 0x7f8ae406bae0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.453+0000 7f8aea544640 1 --2- 172.21.15.55:0/1677109679 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8ae40cee60 0x7f8ae40b71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.453+0000 7f8aea544640 1 --2- 172.21.15.55:0/1677109679 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f8ad00657a0 0x7f8ad0067c60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.453+0000 7f8aea544640 1 --2- 172.21.15.55:0/1677109679 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8ae40cdde0 0x7f8ae41f1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.453+0000 7f8aea544640 1 -- 172.21.15.55:0/1677109679 >> 172.21.15.55:0/1677109679 conn(0x7f8ae409bae0 msgr2=0x7f8ae40b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:29.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.453+0000 7f8aea544640 1 -- 172.21.15.55:0/1677109679 shutdown_connections 2023-08-25T04:22:29.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.457+0000 7f8aea544640 1 -- 172.21.15.55:0/1677109679 wait complete. 2023-08-25T04:22:29.475 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-25T04:22:27.649102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1232,"num_read_kb":2549,"num_write":385,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3554,"ondisk_log_size":3554,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":346684,"kb_used_data":13968,"kb_used_omap":13,"kb_used_meta":332594,"kb_avail":754628036,"statfs":{"total":773094113280,"available":772739108864,"internally_reserved":0,"allocated":14303232,"data_stored":7724588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":340576344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.730869"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.927153+0000","last_change":"2023-08-25T04:22:22.927153+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.927153+0000","last_undegraded":"2023-08-25T04:22:22.927153+0000","last_fullsized":"2023-08-25T04:22:22.927153+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.927298+0000","last_change":"2023-08-25T04:22:22.927298+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.927298+0000","last_undegraded":"2023-08-25T04:22:22.927298+0000","last_fullsized":"2023-08-25T04:22:22.927298+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.923466+0000","last_change":"2023-08-25T04:22:22.923466+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.923466+0000","last_undegraded":"2023-08-25T04:22:22.923466+0000","last_fullsized":"2023-08-25T04:22:22.923466+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.926636+0000","last_change":"2023-08-25T04:22:22.926636+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.926636+0000","last_undegraded":"2023-08-25T04:22:22.926636+0000","last_fullsized":"2023-08-25T04:22:22.926636+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.920944+0000","last_change":"2023-08-25T04:22:22.920944+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.920944+0000","last_undegraded":"2023-08-25T04:22:22.920944+0000","last_fullsized":"2023-08-25T04:22:22.920944+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.921681+0000","last_change":"2023-08-25T04:22:22.921681+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.921681+0000","last_undegraded":"2023-08-25T04:22:22.921681+0000","last_fullsized":"2023-08-25T04:22:22.921681+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.922490+0000","last_change":"2023-08-25T04:22:22.922490+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.922490+0000","last_undegraded":"2023-08-25T04:22:22.922490+0000","last_fullsized":"2023-08-25T04:22:22.922490+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.921643+0000","last_change":"2023-08-25T04:22:22.921643+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.921643+0000","last_undegraded":"2023-08-25T04:22:22.921643+0000","last_fullsized":"2023-08-25T04:22:22.921643+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.926676+0000","last_change":"2023-08-25T04:22:22.926676+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.926676+0000","last_undegraded":"2023-08-25T04:22:22.926676+0000","last_fullsized":"2023-08-25T04:22:22.926676+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.926497+0000","last_change":"2023-08-25T04:22:22.926497+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.926497+0000","last_undegraded":"2023-08-25T04:22:22.926497+0000","last_fullsized":"2023-08-25T04:22:22.926497+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.923054+0000","last_change":"2023-08-25T04:22:22.923054+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.923054+0000","last_undegraded":"2023-08-25T04:22:22.923054+0000","last_fullsized":"2023-08-25T04:22:22.923054+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.922961+0000","last_change":"2023-08-25T04:22:22.922961+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.922961+0000","last_undegraded":"2023-08-25T04:22:22.922961+0000","last_fullsized":"2023-08-25T04:22:22.922961+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.921717+0000","last_change":"2023-08-25T04:22:22.921717+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.921717+0000","last_undegraded":"2023-08-25T04:22:22.921717+0000","last_fullsized":"2023-08-25T04:22:22.921717+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.922979+0000","last_change":"2023-08-25T04:22:22.922979+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.922979+0000","last_undegraded":"2023-08-25T04:22:22.922979+0000","last_fullsized":"2023-08-25T04:22:22.922979+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.926724+0000","last_change":"2023-08-25T04:22:22.926724+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.926724+0000","last_undegraded":"2023-08-25T04:22:22.926724+0000","last_fullsized":"2023-08-25T04:22:22.926724+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.923809+0000","last_change":"2023-08-25T04:22:22.923809+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.923809+0000","last_undegraded":"2023-08-25T04:22:22.923809+0000","last_fullsized":"2023-08-25T04:22:22.923809+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.921722+0000","last_change":"2023-08-25T04:22:22.921722+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.921722+0000","last_undegraded":"2023-08-25T04:22:22.921722+0000","last_fullsized":"2023-08-25T04:22:22.921722+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.926644+0000","last_change":"2023-08-25T04:22:22.926644+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.926644+0000","last_undegraded":"2023-08-25T04:22:22.926644+0000","last_fullsized":"2023-08-25T04:22:22.926644+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.926539+0000","last_change":"2023-08-25T04:22:22.926539+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.926539+0000","last_undegraded":"2023-08-25T04:22:22.926539+0000","last_fullsized":"2023-08-25T04:22:22.926539+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.921670+0000","last_change":"2023-08-25T04:22:22.921670+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.921670+0000","last_undegraded":"2023-08-25T04:22:22.921670+0000","last_fullsized":"2023-08-25T04:22:22.921670+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.920293+0000","last_change":"2023-08-25T04:22:22.920293+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.920293+0000","last_undegraded":"2023-08-25T04:22:22.920293+0000","last_fullsized":"2023-08-25T04:22:22.920293+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.920243+0000","last_change":"2023-08-25T04:22:22.920243+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.920243+0000","last_undegraded":"2023-08-25T04:22:22.920243+0000","last_fullsized":"2023-08-25T04:22:22.920243+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.921657+0000","last_change":"2023-08-25T04:22:22.921657+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.921657+0000","last_undegraded":"2023-08-25T04:22:22.921657+0000","last_fullsized":"2023-08-25T04:22:22.921657+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.922755+0000","last_change":"2023-08-25T04:22:22.922755+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.922755+0000","last_undegraded":"2023-08-25T04:22:22.922755+0000","last_fullsized":"2023-08-25T04:22:22.922755+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.926787+0000","last_change":"2023-08-25T04:22:22.926787+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.926787+0000","last_undegraded":"2023-08-25T04:22:22.926787+0000","last_fullsized":"2023-08-25T04:22:22.926787+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"124'3554","reported_seq":4148,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-25T04:22:22.924431+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:22:22.924431+0000","last_peered":"2023-08-25T04:22:22.924431+0000","last_clean":"2023-08-25T04:22:22.924431+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:22:22.924431+0000","last_undegraded":"2023-08-25T04:22:22.924431+0000","last_fullsized":"2023-08-25T04:22:22.924431+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3554,"log_dups_size":0,"ondisk_log_size":3554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:14:40.684461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1232,"num_read_kb":2549,"num_write":385,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":204,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-25T04:22:22.924351+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:22:22.924351+0000","last_peered":"2023-08-25T04:22:22.924351+0000","last_clean":"2023-08-25T04:22:22.924351+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:22:22.924351+0000","last_undegraded":"2023-08-25T04:22:22.924351+0000","last_fullsized":"2023-08-25T04:22:22.924351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:39:15.799087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.927804+0000","last_change":"2023-08-25T04:22:22.927804+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.927804+0000","last_undegraded":"2023-08-25T04:22:22.927804+0000","last_fullsized":"2023-08-25T04:22:22.927804+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":204,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-25T04:22:22.924288+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:22:22.924288+0000","last_peered":"2023-08-25T04:22:22.924288+0000","last_clean":"2023-08-25T04:22:22.924288+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:22:22.924288+0000","last_undegraded":"2023-08-25T04:22:22.924288+0000","last_fullsized":"2023-08-25T04:22:22.924288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:38:04.299692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.928496+0000","last_change":"2023-08-25T04:22:22.928496+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.928496+0000","last_undegraded":"2023-08-25T04:22:22.928496+0000","last_fullsized":"2023-08-25T04:22:22.928496+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":210,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-25T04:22:22.924195+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:22:22.924195+0000","last_peered":"2023-08-25T04:22:22.924195+0000","last_clean":"2023-08-25T04:22:22.924195+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:22:22.924195+0000","last_undegraded":"2023-08-25T04:22:22.924195+0000","last_fullsized":"2023-08-25T04:22:22.924195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:09:51.873746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.927374+0000","last_change":"2023-08-25T04:22:22.927374+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.927374+0000","last_undegraded":"2023-08-25T04:22:22.927374+0000","last_fullsized":"2023-08-25T04:22:22.927374+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":204,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-25T04:22:22.924492+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:22:22.924492+0000","last_peered":"2023-08-25T04:22:22.924492+0000","last_clean":"2023-08-25T04:22:22.924492+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:22:22.924492+0000","last_undegraded":"2023-08-25T04:22:22.924492+0000","last_fullsized":"2023-08-25T04:22:22.924492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:33:39.641488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.926611+0000","last_change":"2023-08-25T04:22:22.926611+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.926611+0000","last_undegraded":"2023-08-25T04:22:22.926611+0000","last_fullsized":"2023-08-25T04:22:22.926611+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":226,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-25T04:22:22.920836+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:22:22.920836+0000","last_peered":"2023-08-25T04:22:22.920836+0000","last_clean":"2023-08-25T04:22:22.920836+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:22:22.920836+0000","last_undegraded":"2023-08-25T04:22:22.920836+0000","last_fullsized":"2023-08-25T04:22:22.920836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:50:32.808558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.922576+0000","last_change":"2023-08-25T04:22:22.922576+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.922576+0000","last_undegraded":"2023-08-25T04:22:22.922576+0000","last_fullsized":"2023-08-25T04:22:22.922576+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":204,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-25T04:22:22.925019+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:22:22.925019+0000","last_peered":"2023-08-25T04:22:22.925019+0000","last_clean":"2023-08-25T04:22:22.925019+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:22:22.925019+0000","last_undegraded":"2023-08-25T04:22:22.925019+0000","last_fullsized":"2023-08-25T04:22:22.925019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:40:13.313632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.922584+0000","last_change":"2023-08-25T04:22:22.922584+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.922584+0000","last_undegraded":"2023-08-25T04:22:22.922584+0000","last_fullsized":"2023-08-25T04:22:22.922584+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":225,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-25T04:22:22.920820+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:22:22.920820+0000","last_peered":"2023-08-25T04:22:22.920820+0000","last_clean":"2023-08-25T04:22:22.920820+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:22:22.920820+0000","last_undegraded":"2023-08-25T04:22:22.920820+0000","last_fullsized":"2023-08-25T04:22:22.920820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:33:00.526082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T04:22:23.917753+0000","last_change":"2023-08-25T04:22:23.917753+0000","last_active":"2023-08-25T04:22:23.917753+0000","last_peered":"2023-08-25T04:22:23.917753+0000","last_clean":"2023-08-25T04:22:23.917753+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:23.917753+0000","last_undegraded":"2023-08-25T04:22:23.917753+0000","last_fullsized":"2023-08-25T04:22:23.917753+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":1,"reported_epoch":133,"state":"creating+peering","last_fresh":"2023-08-25T04:22:22.927578+0000","last_change":"2023-08-25T04:22:22.927578+0000","last_active":"2023-08-25T04:22:22.911502+0000","last_peered":"2023-08-25T04:22:22.911502+0000","last_clean":"2023-08-25T04:22:22.911502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T04:22:22.927578+0000","last_undegraded":"2023-08-25T04:22:22.927578+0000","last_fullsized":"2023-08-25T04:22:22.927578+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":239,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-08-25T04:22:22.927715+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:22:22.927715+0000","last_peered":"2023-08-25T04:22:22.927715+0000","last_clean":"2023-08-25T04:22:22.927715+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:22:22.927715+0000","last_undegraded":"2023-08-25T04:22:22.927715+0000","last_fullsized":"2023-08-25T04:22:22.927715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:11:14.411761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1232,"num_read_kb":2549,"num_write":385,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3554,"ondisk_log_size":3554,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509673,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59732,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312108,"statfs":{"total":96636764160,"available":96575598592,"internally_reserved":0,"allocated":2236416,"data_stored":1409892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.67100000000000004,"15min":0.69599999999999995},"min":{"1min":0.501,"5min":0.35399999999999998,"15min":0.33700000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.67700000000000005,"15min":0.71299999999999997},"min":{"1min":0.44500000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1,"5min":1,"15min":1.0249999999999999},"last":0.751}]},{"osd":1,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.70799999999999996,"15min":0.72799999999999998},"min":{"1min":0.51900000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.70199999999999996,"15min":0.72899999999999998},"min":{"1min":0.47399999999999998,"5min":0.377,"15min":0.374},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.036},"last":0.70299999999999996}]},{"osd":2,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.68200000000000005,"15min":0.70599999999999996},"min":{"1min":0.49399999999999999,"5min":0.38100000000000001,"15min":0.34899999999999998},"max":{"1min":0.89500000000000002,"5min":0.94299999999999995,"15min":1.018},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.71099999999999997,"15min":0.74099999999999999},"min":{"1min":0.498,"5min":0.46500000000000002,"15min":0.38100000000000001},"max":{"1min":1.0429999999999999,"5min":1.046,"15min":1.046},"last":0.83899999999999997}]},{"osd":3,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.70099999999999996,"15min":0.73099999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.71799999999999997,"15min":0.74299999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.78200000000000003}]},{"osd":4,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59099999999999997,"15min":0.57299999999999995},"min":{"1min":0.40300000000000002,"5min":0.34499999999999997,"15min":0.32400000000000001},"max":{"1min":1.004,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.38900000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.97599999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40500000000000003,"15min":0.377},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63800000000000001,"15min":0.63100000000000001},"min":{"1min":0.46600000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.61199999999999999}]},{"osd":6,"last update":"Fri Aug 25 04:21:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.69499999999999995,"15min":0.69099999999999995},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.99099999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.66800000000000004,"15min":0.65900000000000003},"min":{"1min":0.442,"5min":0.42799999999999999,"15min":0.42699999999999999},"max":{"1min":1.0169999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.58599999999999997}]}]},{"osd":6,"up_from":15,"seq":64424509673,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36944,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334896,"statfs":{"total":96636764160,"available":96598933504,"internally_reserved":0,"allocated":1642496,"data_stored":819524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.66300000000000003,"15min":0.69599999999999995},"min":{"1min":0.53200000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.88500000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66400000000000003,"15min":0.68799999999999994},"min":{"1min":0.42499999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84299999999999997,"5min":0.96499999999999997,"15min":1.054},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.69799999999999995,"15min":0.72699999999999998},"min":{"1min":0.48699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96299999999999997,"5min":1.0269999999999999,"15min":1.0369999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.69599999999999995,"15min":0.72199999999999998},"min":{"1min":0.438,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.90500000000000003,"5min":1.109,"15min":1.109},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70199999999999996,"15min":0.72899999999999998},"min":{"1min":0.54200000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86799999999999999,"5min":1.0009999999999999,"15min":1.1020000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.59299999999999997,"5min":0.499,"15min":0.499},"max":{"1min":0.92900000000000005,"5min":1.0569999999999999,"15min":1.117},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73799999999999999,"15min":0.74399999999999999},"min":{"1min":0.51600000000000001,"5min":0.48499999999999999,"15min":0.46899999999999997},"max":{"1min":0.88700000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.72599999999999998,"15min":0.752},"min":{"1min":0.52500000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93999999999999995,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.55300000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58599999999999997,"15min":0.59099999999999997},"min":{"1min":0.39400000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82299999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.42299999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.92200000000000004,"5min":0.95799999999999996,"15min":1.0820000000000001},"last":0.77900000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.48199999999999998,"5min":0.39200000000000002,"15min":0.373},"max":{"1min":0.874,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.44800000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.91700000000000004,"5min":1.141,"15min":1.141},"last":0.80000000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.502,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.85199999999999998,"5min":1.0389999999999999,"15min":1.046},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.71699999999999997,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.44700000000000001},"max":{"1min":0.94199999999999995,"5min":1.373,"15min":1.373},"last":0.82099999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542376,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50832,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321008,"statfs":{"total":96636764160,"available":96584712192,"internally_reserved":0,"allocated":1642496,"data_stored":819524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65400000000000003,"15min":0.69399999999999995},"min":{"1min":0.42399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":1.002,"5min":1.002,"15min":1.018},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66700000000000004,"15min":0.70999999999999996},"min":{"1min":0.50600000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":1.0409999999999999},"last":0.754}]},{"osd":1,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66600000000000004,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93000000000000005,"5min":0.96399999999999997,"15min":0.99399999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.72799999999999998},"min":{"1min":0.48999999999999999,"5min":0.434,"15min":0.434},"max":{"1min":0.96199999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.65400000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65800000000000003,"15min":0.70999999999999996},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.39500000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.97499999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68300000000000005,"15min":0.72699999999999998},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89200000000000002,"5min":1.048,"15min":1.048},"last":0.69699999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68700000000000006,"15min":0.71999999999999997},"min":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70899999999999996,"15min":0.749},"min":{"1min":0.48999999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85999999999999999,"5min":1.028,"15min":1.028},"last":0.80700000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54800000000000004,"15min":0.56999999999999995},"min":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.35399999999999998},"max":{"1min":0.69699999999999995,"5min":0.91000000000000003,"15min":0.97099999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59099999999999997,"15min":0.60999999999999999},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.80800000000000005,"5min":0.91900000000000004,"15min":1.018},"last":0.72899999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.62,"15min":0.62},"min":{"1min":0.437,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.77400000000000002,"5min":0.96799999999999997,"15min":1.008},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64200000000000002,"15min":0.64500000000000002},"min":{"1min":0.46100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.872,"5min":0.94199999999999995,"15min":0.98299999999999998},"last":0.79300000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63300000000000001,"15min":0.61099999999999999},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.877,"5min":0.93300000000000005,"15min":1.032},"last":0.877},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.47799999999999998,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.877,"5min":1.01,"15min":1.048},"last":0.82399999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542376,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36944,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334896,"statfs":{"total":96636764160,"available":96598933504,"internally_reserved":0,"allocated":1642496,"data_stored":819524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.65700000000000003,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.68799999999999994},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.68300000000000005}]},{"osd":1,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.69299999999999995,"15min":0.72299999999999998},"min":{"1min":0.438,"5min":0.38200000000000001,"15min":0.36199999999999999},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.68300000000000005,"15min":0.72399999999999998},"min":{"1min":0.49199999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.75}]},{"osd":2,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.71399999999999997,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.69499999999999995,"15min":0.73699999999999999},"min":{"1min":0.49299999999999999,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.504}]},{"osd":3,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.72699999999999998,"15min":0.75800000000000001},"min":{"1min":0.46999999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":3.0019999999999998,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.69699999999999995,"15min":0.74199999999999999},"min":{"1min":0.54300000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.331,"5min":2.331,"15min":2.331},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.36799999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.60699999999999998,"15min":0.59999999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.746,"15min":0.73999999999999999},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.40699999999999997},"max":{"1min":3.0710000000000002,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.42299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.71199999999999997}]},{"osd":7,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.625},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.71899999999999997,"15min":0.70499999999999996},"min":{"1min":0.50700000000000001,"5min":0.49199999999999999,"15min":0.437},"max":{"1min":3.2170000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":0.80600000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542376,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36944,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334896,"statfs":{"total":96636764160,"available":96598933504,"internally_reserved":0,"allocated":1642496,"data_stored":819524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.30199999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.53900000000000003,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.505,"15min":0.51900000000000002},"min":{"1min":0.38500000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63,"5min":0.745,"15min":0.91500000000000004},"last":0.46300000000000002}]},{"osd":1,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.502,"15min":0.501},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.74199999999999999,"5min":1.254,"15min":1.254},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.45300000000000001,"5min":0.41499999999999998,"15min":0.33900000000000002},"max":{"1min":0.73999999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.96999999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.38700000000000001,"15min":0.33000000000000002},"max":{"1min":0.79500000000000004,"5min":1.639,"15min":1.639},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53500000000000003,"15min":0.54300000000000004},"min":{"1min":0.39600000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.748,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.56899999999999995,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97999999999999998,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.61899999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.02,"5min":1.601,"15min":1.601},"last":1.016}]},{"osd":5,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.75900000000000001,"15min":0.77700000000000002},"min":{"1min":0.54600000000000004,"5min":0.52900000000000003,"15min":0.49299999999999999},"max":{"1min":1.0349999999999999,"5min":1.254,"15min":1.254},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.75600000000000001,"15min":0.78000000000000003},"min":{"1min":0.66100000000000003,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":0.95299999999999996,"5min":1.421,"15min":1.421},"last":0.94099999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79500000000000004,"15min":0.80000000000000004},"min":{"1min":0.58999999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0880000000000001,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.76300000000000001,"15min":0.79200000000000004},"min":{"1min":0.63300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0029999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.76600000000000001}]},{"osd":7,"last update":"Fri Aug 25 04:21:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.79700000000000004,"15min":0.82099999999999995},"min":{"1min":0.621,"5min":0.53000000000000003,"15min":0.52500000000000002},"max":{"1min":1.0780000000000001,"5min":1.472,"15min":1.472},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77300000000000002,"15min":0.78900000000000003},"min":{"1min":0.59799999999999998,"5min":0.498,"15min":0.498},"max":{"1min":1.0209999999999999,"5min":1.079,"15min":1.1160000000000001},"last":0.82699999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542377,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54992,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316848,"statfs":{"total":96636764160,"available":96580452352,"internally_reserved":0,"allocated":1642496,"data_stored":819524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.432,"15min":0.45700000000000002},"min":{"1min":0.31,"5min":0.255,"15min":0.255},"max":{"1min":0.63500000000000001,"5min":0.77200000000000002,"15min":0.85599999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.47899999999999998,"15min":0.495},"min":{"1min":0.35799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.93100000000000005},"last":0.38600000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46899999999999997,"15min":0.48199999999999998},"min":{"1min":0.34799999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69599999999999995,"5min":0.70799999999999996,"15min":0.78800000000000003},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56599999999999995,"15min":0.59199999999999997},"min":{"1min":0.41099999999999998,"5min":0.39200000000000002,"15min":0.36699999999999999},"max":{"1min":0.81200000000000006,"5min":0.81699999999999995,"15min":0.89800000000000002},"last":0.433}]},{"osd":3,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.50900000000000001,"15min":0.52900000000000003},"min":{"1min":0.46400000000000002,"5min":0.35599999999999998,"15min":0.34499999999999997},"max":{"1min":0.748,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54800000000000004,"15min":0.56100000000000005},"min":{"1min":0.40600000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.89400000000000002},"last":0.45500000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.73699999999999999,"15min":0.78100000000000003},"min":{"1min":0.51900000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.103,"5min":1.103,"15min":1.2569999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.72999999999999998,"15min":0.77100000000000002},"min":{"1min":0.59799999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.5509999999999999},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.747,"15min":0.78400000000000003},"min":{"1min":0.52500000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.2789999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.75900000000000001,"15min":0.79500000000000004},"min":{"1min":0.627,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.3089999999999999},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.754,"15min":0.80700000000000005},"min":{"1min":0.57999999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.077,"5min":1.077,"15min":1.3069999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.78400000000000003,"15min":0.83799999999999997},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.375},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:21:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74199999999999999,"15min":0.78700000000000003},"min":{"1min":0.54100000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.21,"5min":1.21,"15min":1.339},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.76100000000000001,"15min":0.79200000000000004},"min":{"1min":0.52400000000000002,"5min":0.44,"15min":0.44},"max":{"1min":1.099,"5min":1.099,"15min":1.1859999999999999},"last":0.61599999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542377,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36944,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334896,"statfs":{"total":96636764160,"available":96598933504,"internally_reserved":0,"allocated":1630208,"data_stored":813354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.438,"15min":0.45100000000000001},"min":{"1min":0.26400000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.96899999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.29999999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.753,"5min":0.85099999999999998,"15min":1.212},"last":0.54500000000000004}]},{"osd":2,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.498,"15min":0.498},"min":{"1min":0.35599999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.76400000000000001,"5min":0.82099999999999995,"15min":0.876},"last":0.499},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.35299999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59899999999999998,"15min":0.61299999999999999},"min":{"1min":0.39900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53800000000000003,"15min":0.56799999999999995},"min":{"1min":0.33200000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.748,"5min":0.84299999999999997,"15min":1.165},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70899999999999996,"15min":0.75700000000000001},"min":{"1min":0.51900000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92300000000000004,"5min":1.012,"15min":1.204},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.76300000000000001,"15min":0.79300000000000004},"min":{"1min":0.52400000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.2529999999999999},"last":0.84299999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72399999999999998,"15min":0.77500000000000002},"min":{"1min":0.54500000000000004,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89200000000000002,"5min":1.073,"15min":1.254},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.74399999999999999,"15min":0.79400000000000004},"min":{"1min":0.56999999999999995,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0129999999999999,"5min":1.044,"15min":1.9059999999999999},"last":0.96399999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80000000000000004,"15min":0.82399999999999995},"min":{"1min":0.55800000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.294,"5min":1.294,"15min":1.623},"last":0.875},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.755,"15min":0.78900000000000003},"min":{"1min":0.57899999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93000000000000005,"5min":1.0369999999999999,"15min":1.288},"last":1.0129999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.753,"15min":0.79400000000000004},"min":{"1min":0.59199999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95999999999999996,"5min":1.1140000000000001,"15min":1.2949999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81799999999999995,"15min":0.83799999999999997},"min":{"1min":0.59199999999999997,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.3120000000000001},"last":1.002}]}]},{"osd":0,"up_from":14,"seq":60129542376,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33352,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338488,"statfs":{"total":96636764160,"available":96602611712,"internally_reserved":0,"allocated":2224128,"data_stored":1403722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46999999999999997,"15min":0.48199999999999998},"min":{"1min":0.28199999999999997,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.66300000000000003,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.55500000000000005},"min":{"1min":0.39200000000000002,"5min":0.38500000000000001,"15min":0.36699999999999999},"max":{"1min":0.79700000000000004,"5min":1.0129999999999999,"15min":3.5089999999999999},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.51500000000000001},"min":{"1min":0.36199999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.53300000000000003},"min":{"1min":0.34399999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.748,"5min":0.876,"15min":3.4590000000000001},"last":0.53500000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47599999999999998,"15min":0.48699999999999999},"min":{"1min":0.35499999999999998,"5min":0.28699999999999998,"15min":0.27700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.40500000000000003,"5min":0.36699999999999999,"15min":0.32700000000000001},"max":{"1min":0.875,"5min":0.93500000000000005,"15min":1.2470000000000001},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.746,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91400000000000003,"5min":1.2,"15min":1.2},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.754,"5min":0.73999999999999999,"15min":0.79000000000000004},"min":{"1min":0.56799999999999995,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.169,"15min":1.169},"last":0.64200000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72899999999999998,"15min":0.78100000000000003},"min":{"1min":0.59499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84399999999999997,"5min":1.131,"15min":3.528},"last":0.629},{"interface":"front","average":{"1min":0.745,"5min":0.746,"15min":0.79600000000000004},"min":{"1min":0.55700000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98799999999999999,"5min":1.244,"15min":1.244},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73499999999999999,"15min":0.78700000000000003},"min":{"1min":0.54500000000000004,"5min":0.495,"15min":0.495},"max":{"1min":0.95999999999999996,"5min":1.1180000000000001,"15min":3.4870000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77400000000000002,"15min":0.81499999999999995},"min":{"1min":0.57299999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98099999999999998,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.64800000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78400000000000003,"15min":0.82499999999999996},"min":{"1min":0.51700000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0580000000000001,"5min":1.28,"15min":1.28},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.753,"15min":0.79500000000000004},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0820000000000001,"5min":1.0940000000000001,"15min":1.1930000000000001},"last":0.61499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:22:29.482 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:22:29.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.661+0000 7f3377700640 1 Processor -- start 2023-08-25T04:22:29.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.661+0000 7f3377700640 1 -- start start 2023-08-25T04:22:29.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f3377700640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f33700aeb10 0x7f33700ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:29.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f3377700640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33700cee20 0x7f3370069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:29.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f3377700640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3370069e40 0x7f3370160520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:29.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f3377700640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33700d0380 con 0x7f3370069e40 2023-08-25T04:22:29.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f3377700640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337006d590 con 0x7f33700aeb10 2023-08-25T04:22:29.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f3377700640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33700cf280 con 0x7f33700cee20 2023-08-25T04:22:29.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f3375c9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3370069e40 0x7f3370160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:29.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f3375c9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3370069e40 0x7f3370160520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54406/0 (socket says 172.21.15.55:54406) 2023-08-25T04:22:29.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f3375c9d640 1 -- 172.21.15.55:0/1811281398 learned_addr learned my addr 172.21.15.55:0/1811281398 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:29.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f337549c640 1 --2- 172.21.15.55:0/1811281398 >> v2:172.21.15.110:3300/0 conn(0x7f33700aeb10 0x7f33700ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:29.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f3375c9d640 1 -- 172.21.15.55:0/1811281398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33700cee20 msgr2=0x7f3370069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:29.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f3374c9b640 1 --2- 172.21.15.55:0/1811281398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33700cee20 0x7f3370069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:29.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f3375c9d640 1 --2- 172.21.15.55:0/1811281398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33700cee20 0x7f3370069900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f3375c9d640 1 -- 172.21.15.55:0/1811281398 >> v2:172.21.15.110:3300/0 conn(0x7f33700aeb10 msgr2=0x7f33700ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:29.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f3375c9d640 1 --2- 172.21.15.55:0/1811281398 >> v2:172.21.15.110:3300/0 conn(0x7f33700aeb10 0x7f33700ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f3375c9d640 1 -- 172.21.15.55:0/1811281398 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337006c4f0 con 0x7f3370069e40 2023-08-25T04:22:29.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f337549c640 1 --2- 172.21.15.55:0/1811281398 >> v2:172.21.15.110:3300/0 conn(0x7f33700aeb10 0x7f33700ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:29.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f3374c9b640 1 --2- 172.21.15.55:0/1811281398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33700cee20 0x7f3370069900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:29.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.665+0000 7f3375c9d640 1 --2- 172.21.15.55:0/1811281398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3370069e40 0x7f3370160520 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f337006b930 tx=0x7f336801c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68d5e5d5c2a8c18 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:29.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3367fff640 1 -- 172.21.15.55:0/1811281398 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33680a6490 con 0x7f3370069e40 2023-08-25T04:22:29.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3367fff640 1 -- 172.21.15.55:0/1811281398 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33680a65f0 con 0x7f3370069e40 2023-08-25T04:22:29.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3367fff640 1 -- 172.21.15.55:0/1811281398 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33680a6980 con 0x7f3370069e40 2023-08-25T04:22:29.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3377700640 1 -- 172.21.15.55:0/1811281398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3370069e40 msgr2=0x7f3370160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:29.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3377700640 1 --2- 172.21.15.55:0/1811281398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3370069e40 0x7f3370160520 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f337006b930 tx=0x7f336801c710 comp rx=0 tx=0).stop 2023-08-25T04:22:29.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3377700640 1 -- 172.21.15.55:0/1811281398 shutdown_connections 2023-08-25T04:22:29.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3377700640 1 --2- 172.21.15.55:0/1811281398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3370069e40 0x7f3370160520 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3377700640 1 --2- 172.21.15.55:0/1811281398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33700cee20 0x7f3370069900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3377700640 1 --2- 172.21.15.55:0/1811281398 >> v2:172.21.15.110:3300/0 conn(0x7f33700aeb10 0x7f33700ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3377700640 1 -- 172.21.15.55:0/1811281398 >> 172.21.15.55:0/1811281398 conn(0x7f33700cf530 msgr2=0x7f33700cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:29.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3377700640 1 -- 172.21.15.55:0/1811281398 shutdown_connections 2023-08-25T04:22:29.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3377700640 1 -- 172.21.15.55:0/1811281398 wait complete. 2023-08-25T04:22:29.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3377700640 1 Processor -- start 2023-08-25T04:22:29.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3377700640 1 -- start start 2023-08-25T04:22:29.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3377700640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3370069e40 0x7f3370157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:29.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3377700640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33700aeb10 0x7f3370156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:29.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3377700640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33700cee20 0x7f33700c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:29.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3377700640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33701570e0 con 0x7f3370069e40 2023-08-25T04:22:29.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3377700640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33701573c0 con 0x7f33700aeb10 2023-08-25T04:22:29.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f3377700640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33701576a0 con 0x7f33700cee20 2023-08-25T04:22:29.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.669+0000 7f337549c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3370069e40 0x7f3370157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:29.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.673+0000 7f337549c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3370069e40 0x7f3370157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54410/0 (socket says 172.21.15.55:54410) 2023-08-25T04:22:29.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.673+0000 7f337549c640 1 -- 172.21.15.55:0/278679920 learned_addr learned my addr 172.21.15.55:0/278679920 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:29.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.673+0000 7f3374c9b640 1 --2- 172.21.15.55:0/278679920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33700aeb10 0x7f3370156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:29.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.673+0000 7f3375c9d640 1 --2- 172.21.15.55:0/278679920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33700cee20 0x7f33700c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:29.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.673+0000 7f337549c640 1 -- 172.21.15.55:0/278679920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33700cee20 msgr2=0x7f33700c4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:29.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.673+0000 7f337549c640 1 --2- 172.21.15.55:0/278679920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33700cee20 0x7f33700c4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.673+0000 7f337549c640 1 -- 172.21.15.55:0/278679920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33700aeb10 msgr2=0x7f3370156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:29.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.673+0000 7f337549c640 1 --2- 172.21.15.55:0/278679920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33700aeb10 0x7f3370156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.673+0000 7f337549c640 1 -- 172.21.15.55:0/278679920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3368009b30 con 0x7f3370069e40 2023-08-25T04:22:29.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.673+0000 7f3375c9d640 1 --2- 172.21.15.55:0/278679920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33700cee20 0x7f33700c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:29.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.673+0000 7f337549c640 1 --2- 172.21.15.55:0/278679920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3370069e40 0x7f3370157ea0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f336c00c7f0 tx=0x7f336c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:29.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.673+0000 7f3365ffb640 1 -- 172.21.15.55:0/278679920 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c007820 con 0x7f3370069e40 2023-08-25T04:22:29.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.673+0000 7f3365ffb640 1 -- 172.21.15.55:0/278679920 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c007980 con 0x7f3370069e40 2023-08-25T04:22:29.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.673+0000 7f3365ffb640 1 -- 172.21.15.55:0/278679920 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c007d30 con 0x7f3370069e40 2023-08-25T04:22:29.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.673+0000 7f3377700640 1 -- 172.21.15.55:0/278679920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3370157980 con 0x7f3370069e40 2023-08-25T04:22:29.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.673+0000 7f3377700640 1 -- 172.21.15.55:0/278679920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3370156c40 con 0x7f3370069e40 2023-08-25T04:22:29.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.673+0000 7f3377700640 1 -- 172.21.15.55:0/278679920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337004dbe0 con 0x7f3370069e40 2023-08-25T04:22:29.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.673+0000 7f3365ffb640 1 -- 172.21.15.55:0/278679920 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f336c0113f0 con 0x7f3370069e40 2023-08-25T04:22:29.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.677+0000 7f3365ffb640 1 --2- 172.21.15.55:0/278679920 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f33540657a0 0x7f3354067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:29.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.677+0000 7f3365ffb640 1 -- 172.21.15.55:0/278679920 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f336c083290 con 0x7f3370069e40 2023-08-25T04:22:29.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.677+0000 7f3374c9b640 1 --2- 172.21.15.55:0/278679920 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f33540657a0 0x7f3354067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:29.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.677+0000 7f3374c9b640 1 --2- 172.21.15.55:0/278679920 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f33540657a0 0x7f3354067c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3370159250 tx=0x7f3360008040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:29.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.681+0000 7f3365ffb640 1 -- 172.21.15.55:0/278679920 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f336c050bc0 con 0x7f3370069e40 2023-08-25T04:22:29.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.833+0000 7f3377700640 1 -- 172.21.15.55:0/278679920 --> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f337006d070 con 0x7f33540657a0 2023-08-25T04:22:29.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.845+0000 7f3365ffb640 1 -- 172.21.15.55:0/278679920 <== mgr.7301 v2:172.21.15.110:6832/3700713436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311748 (secure 0 0 0) 0x7f336000a670 con 0x7f33540657a0 2023-08-25T04:22:29.846 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:29.847 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:22:29.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.845+0000 7f3377700640 1 -- 172.21.15.55:0/278679920 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f33540657a0 msgr2=0x7f3354067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:29.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.845+0000 7f3377700640 1 --2- 172.21.15.55:0/278679920 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f33540657a0 0x7f3354067c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3370159250 tx=0x7f3360008040 comp rx=0 tx=0).stop 2023-08-25T04:22:29.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.845+0000 7f3377700640 1 -- 172.21.15.55:0/278679920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3370069e40 msgr2=0x7f3370157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:29.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.845+0000 7f3377700640 1 --2- 172.21.15.55:0/278679920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3370069e40 0x7f3370157ea0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f336c00c7f0 tx=0x7f336c00ccb0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.845+0000 7f3377700640 1 -- 172.21.15.55:0/278679920 shutdown_connections 2023-08-25T04:22:29.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.845+0000 7f3377700640 1 --2- 172.21.15.55:0/278679920 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f33540657a0 0x7f3354067c60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.845+0000 7f3377700640 1 --2- 172.21.15.55:0/278679920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33700cee20 0x7f33700c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.845+0000 7f3377700640 1 --2- 172.21.15.55:0/278679920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33700aeb10 0x7f3370156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.845+0000 7f3377700640 1 --2- 172.21.15.55:0/278679920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3370069e40 0x7f3370157ea0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:29.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.845+0000 7f3377700640 1 -- 172.21.15.55:0/278679920 >> 172.21.15.55:0/278679920 conn(0x7f33700cf530 msgr2=0x7f33700cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:29.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.845+0000 7f3377700640 1 -- 172.21.15.55:0/278679920 shutdown_connections 2023-08-25T04:22:29.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:29.845+0000 7f3377700640 1 -- 172.21.15.55:0/278679920 wait complete. 2023-08-25T04:22:29.866 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-25T04:22:29.649564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1232,"num_read_kb":2549,"num_write":429,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3592,"ondisk_log_size":3592,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":200,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":347064,"kb_used_data":14344,"kb_used_omap":13,"kb_used_meta":332594,"kb_avail":754627656,"statfs":{"total":773094113280,"available":772738719744,"internally_reserved":0,"allocated":14688256,"data_stored":7905020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":340576344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001582"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964341+0000","last_change":"2023-08-25T04:22:24.980160+0000","last_active":"2023-08-25T04:22:25.964341+0000","last_peered":"2023-08-25T04:22:25.964341+0000","last_clean":"2023-08-25T04:22:25.964341+0000","last_became_active":"2023-08-25T04:22:24.979819+0000","last_became_peered":"2023-08-25T04:22:24.979819+0000","last_unstale":"2023-08-25T04:22:25.964341+0000","last_undegraded":"2023-08-25T04:22:25.964341+0000","last_fullsized":"2023-08-25T04:22:25.964341+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:54:24.855039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205880+0000","last_change":"2023-08-25T04:22:24.984110+0000","last_active":"2023-08-25T04:22:26.205880+0000","last_peered":"2023-08-25T04:22:26.205880+0000","last_clean":"2023-08-25T04:22:26.205880+0000","last_became_active":"2023-08-25T04:22:24.983833+0000","last_became_peered":"2023-08-25T04:22:24.983833+0000","last_unstale":"2023-08-25T04:22:26.205880+0000","last_undegraded":"2023-08-25T04:22:26.205880+0000","last_fullsized":"2023-08-25T04:22:26.205880+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:19.130375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206678+0000","last_change":"2023-08-25T04:22:24.980242+0000","last_active":"2023-08-25T04:22:26.206678+0000","last_peered":"2023-08-25T04:22:26.206678+0000","last_clean":"2023-08-25T04:22:26.206678+0000","last_became_active":"2023-08-25T04:22:24.979947+0000","last_became_peered":"2023-08-25T04:22:24.979947+0000","last_unstale":"2023-08-25T04:22:26.206678+0000","last_undegraded":"2023-08-25T04:22:26.206678+0000","last_fullsized":"2023-08-25T04:22:26.206678+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:35:58.759682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204756+0000","last_change":"2023-08-25T04:22:24.967850+0000","last_active":"2023-08-25T04:22:26.204756+0000","last_peered":"2023-08-25T04:22:26.204756+0000","last_clean":"2023-08-25T04:22:26.204756+0000","last_became_active":"2023-08-25T04:22:24.967464+0000","last_became_peered":"2023-08-25T04:22:24.967464+0000","last_unstale":"2023-08-25T04:22:26.204756+0000","last_undegraded":"2023-08-25T04:22:26.204756+0000","last_fullsized":"2023-08-25T04:22:26.204756+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:15:05.316894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964504+0000","last_change":"2023-08-25T04:22:24.974055+0000","last_active":"2023-08-25T04:22:25.964504+0000","last_peered":"2023-08-25T04:22:25.964504+0000","last_clean":"2023-08-25T04:22:25.964504+0000","last_became_active":"2023-08-25T04:22:24.973743+0000","last_became_peered":"2023-08-25T04:22:24.973743+0000","last_unstale":"2023-08-25T04:22:25.964504+0000","last_undegraded":"2023-08-25T04:22:25.964504+0000","last_fullsized":"2023-08-25T04:22:25.964504+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:11:27.537860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205716+0000","last_change":"2023-08-25T04:22:25.003305+0000","last_active":"2023-08-25T04:22:26.205716+0000","last_peered":"2023-08-25T04:22:26.205716+0000","last_clean":"2023-08-25T04:22:26.205716+0000","last_became_active":"2023-08-25T04:22:25.003004+0000","last_became_peered":"2023-08-25T04:22:25.003004+0000","last_unstale":"2023-08-25T04:22:26.205716+0000","last_undegraded":"2023-08-25T04:22:26.205716+0000","last_fullsized":"2023-08-25T04:22:26.205716+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:51:25.392772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205489+0000","last_change":"2023-08-25T04:22:24.989495+0000","last_active":"2023-08-25T04:22:26.205489+0000","last_peered":"2023-08-25T04:22:26.205489+0000","last_clean":"2023-08-25T04:22:26.205489+0000","last_became_active":"2023-08-25T04:22:24.989203+0000","last_became_peered":"2023-08-25T04:22:24.989203+0000","last_unstale":"2023-08-25T04:22:26.205489+0000","last_undegraded":"2023-08-25T04:22:26.205489+0000","last_fullsized":"2023-08-25T04:22:26.205489+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:40.390488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205615+0000","last_change":"2023-08-25T04:22:24.979108+0000","last_active":"2023-08-25T04:22:26.205615+0000","last_peered":"2023-08-25T04:22:26.205615+0000","last_clean":"2023-08-25T04:22:26.205615+0000","last_became_active":"2023-08-25T04:22:24.978466+0000","last_became_peered":"2023-08-25T04:22:24.978466+0000","last_unstale":"2023-08-25T04:22:26.205615+0000","last_undegraded":"2023-08-25T04:22:26.205615+0000","last_fullsized":"2023-08-25T04:22:26.205615+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:31.333780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204900+0000","last_change":"2023-08-25T04:22:24.971968+0000","last_active":"2023-08-25T04:22:26.204900+0000","last_peered":"2023-08-25T04:22:26.204900+0000","last_clean":"2023-08-25T04:22:26.204900+0000","last_became_active":"2023-08-25T04:22:24.971520+0000","last_became_peered":"2023-08-25T04:22:24.971520+0000","last_unstale":"2023-08-25T04:22:26.204900+0000","last_undegraded":"2023-08-25T04:22:26.204900+0000","last_fullsized":"2023-08-25T04:22:26.204900+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:40.767462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964324+0000","last_change":"2023-08-25T04:22:24.992802+0000","last_active":"2023-08-25T04:22:25.964324+0000","last_peered":"2023-08-25T04:22:25.964324+0000","last_clean":"2023-08-25T04:22:25.964324+0000","last_became_active":"2023-08-25T04:22:24.992482+0000","last_became_peered":"2023-08-25T04:22:24.992482+0000","last_unstale":"2023-08-25T04:22:25.964324+0000","last_undegraded":"2023-08-25T04:22:25.964324+0000","last_fullsized":"2023-08-25T04:22:25.964324+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:47:02.262159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964006+0000","last_change":"2023-08-25T04:22:24.984162+0000","last_active":"2023-08-25T04:22:25.964006+0000","last_peered":"2023-08-25T04:22:25.964006+0000","last_clean":"2023-08-25T04:22:25.964006+0000","last_became_active":"2023-08-25T04:22:24.983860+0000","last_became_peered":"2023-08-25T04:22:24.983860+0000","last_unstale":"2023-08-25T04:22:25.964006+0000","last_undegraded":"2023-08-25T04:22:25.964006+0000","last_fullsized":"2023-08-25T04:22:25.964006+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:52:46.328332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206070+0000","last_change":"2023-08-25T04:22:24.994560+0000","last_active":"2023-08-25T04:22:26.206070+0000","last_peered":"2023-08-25T04:22:26.206070+0000","last_clean":"2023-08-25T04:22:26.206070+0000","last_became_active":"2023-08-25T04:22:24.991957+0000","last_became_peered":"2023-08-25T04:22:24.991957+0000","last_unstale":"2023-08-25T04:22:26.206070+0000","last_undegraded":"2023-08-25T04:22:26.206070+0000","last_fullsized":"2023-08-25T04:22:26.206070+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:39:01.013890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964164+0000","last_change":"2023-08-25T04:22:24.989968+0000","last_active":"2023-08-25T04:22:25.964164+0000","last_peered":"2023-08-25T04:22:25.964164+0000","last_clean":"2023-08-25T04:22:25.964164+0000","last_became_active":"2023-08-25T04:22:24.989686+0000","last_became_peered":"2023-08-25T04:22:24.989686+0000","last_unstale":"2023-08-25T04:22:25.964164+0000","last_undegraded":"2023-08-25T04:22:25.964164+0000","last_fullsized":"2023-08-25T04:22:25.964164+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:19:35.918305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206776+0000","last_change":"2023-08-25T04:22:24.987770+0000","last_active":"2023-08-25T04:22:26.206776+0000","last_peered":"2023-08-25T04:22:26.206776+0000","last_clean":"2023-08-25T04:22:26.206776+0000","last_became_active":"2023-08-25T04:22:24.980118+0000","last_became_peered":"2023-08-25T04:22:24.980118+0000","last_unstale":"2023-08-25T04:22:26.206776+0000","last_undegraded":"2023-08-25T04:22:26.206776+0000","last_fullsized":"2023-08-25T04:22:26.206776+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:47:48.315800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.963965+0000","last_change":"2023-08-25T04:22:24.986598+0000","last_active":"2023-08-25T04:22:25.963965+0000","last_peered":"2023-08-25T04:22:25.963965+0000","last_clean":"2023-08-25T04:22:25.963965+0000","last_became_active":"2023-08-25T04:22:24.986222+0000","last_became_peered":"2023-08-25T04:22:24.986222+0000","last_unstale":"2023-08-25T04:22:25.963965+0000","last_undegraded":"2023-08-25T04:22:25.963965+0000","last_fullsized":"2023-08-25T04:22:25.963965+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:20:05.410997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206217+0000","last_change":"2023-08-25T04:22:24.997307+0000","last_active":"2023-08-25T04:22:26.206217+0000","last_peered":"2023-08-25T04:22:26.206217+0000","last_clean":"2023-08-25T04:22:26.206217+0000","last_became_active":"2023-08-25T04:22:24.997034+0000","last_became_peered":"2023-08-25T04:22:24.997034+0000","last_unstale":"2023-08-25T04:22:26.206217+0000","last_undegraded":"2023-08-25T04:22:26.206217+0000","last_fullsized":"2023-08-25T04:22:26.206217+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:30.167507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964468+0000","last_change":"2023-08-25T04:22:24.994912+0000","last_active":"2023-08-25T04:22:25.964468+0000","last_peered":"2023-08-25T04:22:25.964468+0000","last_clean":"2023-08-25T04:22:25.964468+0000","last_became_active":"2023-08-25T04:22:24.994634+0000","last_became_peered":"2023-08-25T04:22:24.994634+0000","last_unstale":"2023-08-25T04:22:25.964468+0000","last_undegraded":"2023-08-25T04:22:25.964468+0000","last_fullsized":"2023-08-25T04:22:25.964468+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:35:18.722412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206017+0000","last_change":"2023-08-25T04:22:24.985919+0000","last_active":"2023-08-25T04:22:26.206017+0000","last_peered":"2023-08-25T04:22:26.206017+0000","last_clean":"2023-08-25T04:22:26.206017+0000","last_became_active":"2023-08-25T04:22:24.985596+0000","last_became_peered":"2023-08-25T04:22:24.985596+0000","last_unstale":"2023-08-25T04:22:26.206017+0000","last_undegraded":"2023-08-25T04:22:26.206017+0000","last_fullsized":"2023-08-25T04:22:26.206017+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:54.188602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964341+0000","last_change":"2023-08-25T04:22:24.976285+0000","last_active":"2023-08-25T04:22:25.964341+0000","last_peered":"2023-08-25T04:22:25.964341+0000","last_clean":"2023-08-25T04:22:25.964341+0000","last_became_active":"2023-08-25T04:22:24.975957+0000","last_became_peered":"2023-08-25T04:22:24.975957+0000","last_unstale":"2023-08-25T04:22:25.964341+0000","last_undegraded":"2023-08-25T04:22:25.964341+0000","last_fullsized":"2023-08-25T04:22:25.964341+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:32.308329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205321+0000","last_change":"2023-08-25T04:22:24.997826+0000","last_active":"2023-08-25T04:22:26.205321+0000","last_peered":"2023-08-25T04:22:26.205321+0000","last_clean":"2023-08-25T04:22:26.205321+0000","last_became_active":"2023-08-25T04:22:24.997523+0000","last_became_peered":"2023-08-25T04:22:24.997523+0000","last_unstale":"2023-08-25T04:22:26.205321+0000","last_undegraded":"2023-08-25T04:22:26.205321+0000","last_fullsized":"2023-08-25T04:22:26.205321+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:49.402784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204493+0000","last_change":"2023-08-25T04:22:24.986733+0000","last_active":"2023-08-25T04:22:26.204493+0000","last_peered":"2023-08-25T04:22:26.204493+0000","last_clean":"2023-08-25T04:22:26.204493+0000","last_became_active":"2023-08-25T04:22:24.986451+0000","last_became_peered":"2023-08-25T04:22:24.986451+0000","last_unstale":"2023-08-25T04:22:26.204493+0000","last_undegraded":"2023-08-25T04:22:26.204493+0000","last_fullsized":"2023-08-25T04:22:26.204493+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:34.985760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964257+0000","last_change":"2023-08-25T04:22:24.974093+0000","last_active":"2023-08-25T04:22:25.964257+0000","last_peered":"2023-08-25T04:22:25.964257+0000","last_clean":"2023-08-25T04:22:25.964257+0000","last_became_active":"2023-08-25T04:22:24.973777+0000","last_became_peered":"2023-08-25T04:22:24.973777+0000","last_unstale":"2023-08-25T04:22:25.964257+0000","last_undegraded":"2023-08-25T04:22:25.964257+0000","last_fullsized":"2023-08-25T04:22:25.964257+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:03.889864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204118+0000","last_change":"2023-08-25T04:22:24.971791+0000","last_active":"2023-08-25T04:22:26.204118+0000","last_peered":"2023-08-25T04:22:26.204118+0000","last_clean":"2023-08-25T04:22:26.204118+0000","last_became_active":"2023-08-25T04:22:24.971512+0000","last_became_peered":"2023-08-25T04:22:24.971512+0000","last_unstale":"2023-08-25T04:22:26.204118+0000","last_undegraded":"2023-08-25T04:22:26.204118+0000","last_fullsized":"2023-08-25T04:22:26.204118+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:55.716380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204451+0000","last_change":"2023-08-25T04:22:24.984931+0000","last_active":"2023-08-25T04:22:26.204451+0000","last_peered":"2023-08-25T04:22:26.204451+0000","last_clean":"2023-08-25T04:22:26.204451+0000","last_became_active":"2023-08-25T04:22:24.983776+0000","last_became_peered":"2023-08-25T04:22:24.983776+0000","last_unstale":"2023-08-25T04:22:26.204451+0000","last_undegraded":"2023-08-25T04:22:26.204451+0000","last_fullsized":"2023-08-25T04:22:26.204451+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:45.770499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205203+0000","last_change":"2023-08-25T04:22:24.988545+0000","last_active":"2023-08-25T04:22:26.205203+0000","last_peered":"2023-08-25T04:22:26.205203+0000","last_clean":"2023-08-25T04:22:26.205203+0000","last_became_active":"2023-08-25T04:22:24.987759+0000","last_became_peered":"2023-08-25T04:22:24.987759+0000","last_unstale":"2023-08-25T04:22:26.205203+0000","last_undegraded":"2023-08-25T04:22:26.205203+0000","last_fullsized":"2023-08-25T04:22:26.205203+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:46:11.761122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205641+0000","last_change":"2023-08-25T04:22:24.987279+0000","last_active":"2023-08-25T04:22:26.205641+0000","last_peered":"2023-08-25T04:22:26.205641+0000","last_clean":"2023-08-25T04:22:26.205641+0000","last_became_active":"2023-08-25T04:22:24.986999+0000","last_became_peered":"2023-08-25T04:22:24.986999+0000","last_unstale":"2023-08-25T04:22:26.205641+0000","last_undegraded":"2023-08-25T04:22:26.205641+0000","last_fullsized":"2023-08-25T04:22:26.205641+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:38:02.874638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964476+0000","last_change":"2023-08-25T04:22:24.972732+0000","last_active":"2023-08-25T04:22:25.964476+0000","last_peered":"2023-08-25T04:22:25.964476+0000","last_clean":"2023-08-25T04:22:25.964476+0000","last_became_active":"2023-08-25T04:22:24.972382+0000","last_became_peered":"2023-08-25T04:22:24.972382+0000","last_unstale":"2023-08-25T04:22:25.964476+0000","last_undegraded":"2023-08-25T04:22:25.964476+0000","last_fullsized":"2023-08-25T04:22:25.964476+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:09:19.698330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206133+0000","last_change":"2023-08-25T04:22:24.996718+0000","last_active":"2023-08-25T04:22:26.206133+0000","last_peered":"2023-08-25T04:22:26.206133+0000","last_clean":"2023-08-25T04:22:26.206133+0000","last_became_active":"2023-08-25T04:22:24.996420+0000","last_became_peered":"2023-08-25T04:22:24.996420+0000","last_unstale":"2023-08-25T04:22:26.206133+0000","last_undegraded":"2023-08-25T04:22:26.206133+0000","last_fullsized":"2023-08-25T04:22:26.206133+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:56.492659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205299+0000","last_change":"2023-08-25T04:22:24.999223+0000","last_active":"2023-08-25T04:22:26.205299+0000","last_peered":"2023-08-25T04:22:26.205299+0000","last_clean":"2023-08-25T04:22:26.205299+0000","last_became_active":"2023-08-25T04:22:24.998811+0000","last_became_peered":"2023-08-25T04:22:24.998811+0000","last_unstale":"2023-08-25T04:22:26.205299+0000","last_undegraded":"2023-08-25T04:22:26.205299+0000","last_fullsized":"2023-08-25T04:22:26.205299+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:20:11.946216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206840+0000","last_change":"2023-08-25T04:22:24.977279+0000","last_active":"2023-08-25T04:22:26.206840+0000","last_peered":"2023-08-25T04:22:26.206840+0000","last_clean":"2023-08-25T04:22:26.206840+0000","last_became_active":"2023-08-25T04:22:24.976837+0000","last_became_peered":"2023-08-25T04:22:24.976837+0000","last_unstale":"2023-08-25T04:22:26.206840+0000","last_undegraded":"2023-08-25T04:22:26.206840+0000","last_fullsized":"2023-08-25T04:22:26.206840+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:32.849194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204228+0000","last_change":"2023-08-25T04:22:24.991026+0000","last_active":"2023-08-25T04:22:26.204228+0000","last_peered":"2023-08-25T04:22:26.204228+0000","last_clean":"2023-08-25T04:22:26.204228+0000","last_became_active":"2023-08-25T04:22:24.989826+0000","last_became_peered":"2023-08-25T04:22:24.989826+0000","last_unstale":"2023-08-25T04:22:26.204228+0000","last_undegraded":"2023-08-25T04:22:26.204228+0000","last_fullsized":"2023-08-25T04:22:26.204228+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:48:24.022318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204007+0000","last_change":"2023-08-25T04:22:24.983898+0000","last_active":"2023-08-25T04:22:26.204007+0000","last_peered":"2023-08-25T04:22:26.204007+0000","last_clean":"2023-08-25T04:22:26.204007+0000","last_became_active":"2023-08-25T04:22:24.983418+0000","last_became_peered":"2023-08-25T04:22:24.983418+0000","last_unstale":"2023-08-25T04:22:26.204007+0000","last_undegraded":"2023-08-25T04:22:26.204007+0000","last_fullsized":"2023-08-25T04:22:26.204007+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:50:57.280394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964302+0000","last_change":"2023-08-25T04:22:24.994393+0000","last_active":"2023-08-25T04:22:25.964302+0000","last_peered":"2023-08-25T04:22:25.964302+0000","last_clean":"2023-08-25T04:22:25.964302+0000","last_became_active":"2023-08-25T04:22:24.994120+0000","last_became_peered":"2023-08-25T04:22:24.994120+0000","last_unstale":"2023-08-25T04:22:25.964302+0000","last_undegraded":"2023-08-25T04:22:25.964302+0000","last_fullsized":"2023-08-25T04:22:25.964302+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:19:47.445600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"135'4","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964948+0000","last_change":"2023-08-25T04:22:23.939086+0000","last_active":"2023-08-25T04:22:25.964948+0000","last_peered":"2023-08-25T04:22:25.964948+0000","last_clean":"2023-08-25T04:22:25.964948+0000","last_became_active":"2023-08-25T04:22:23.938752+0000","last_became_peered":"2023-08-25T04:22:23.938752+0000","last_unstale":"2023-08-25T04:22:25.964948+0000","last_undegraded":"2023-08-25T04:22:25.964948+0000","last_fullsized":"2023-08-25T04:22:25.964948+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:02.883614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205864+0000","last_change":"2023-08-25T04:22:25.003212+0000","last_active":"2023-08-25T04:22:26.205864+0000","last_peered":"2023-08-25T04:22:26.205864+0000","last_clean":"2023-08-25T04:22:26.205864+0000","last_became_active":"2023-08-25T04:22:25.002912+0000","last_became_peered":"2023-08-25T04:22:25.002912+0000","last_unstale":"2023-08-25T04:22:26.205864+0000","last_undegraded":"2023-08-25T04:22:26.205864+0000","last_fullsized":"2023-08-25T04:22:26.205864+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:14:30.577755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"135'1","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964441+0000","last_change":"2023-08-25T04:22:23.945578+0000","last_active":"2023-08-25T04:22:25.964441+0000","last_peered":"2023-08-25T04:22:25.964441+0000","last_clean":"2023-08-25T04:22:25.964441+0000","last_became_active":"2023-08-25T04:22:23.943682+0000","last_became_peered":"2023-08-25T04:22:23.943682+0000","last_unstale":"2023-08-25T04:22:25.964441+0000","last_undegraded":"2023-08-25T04:22:25.964441+0000","last_fullsized":"2023-08-25T04:22:25.964441+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:08:27.693453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204753+0000","last_change":"2023-08-25T04:22:24.995628+0000","last_active":"2023-08-25T04:22:26.204753+0000","last_peered":"2023-08-25T04:22:26.204753+0000","last_clean":"2023-08-25T04:22:26.204753+0000","last_became_active":"2023-08-25T04:22:24.995241+0000","last_became_peered":"2023-08-25T04:22:24.995241+0000","last_unstale":"2023-08-25T04:22:26.204753+0000","last_undegraded":"2023-08-25T04:22:26.204753+0000","last_fullsized":"2023-08-25T04:22:26.204753+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:10:47.097275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"135'2","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204909+0000","last_change":"2023-08-25T04:22:23.943083+0000","last_active":"2023-08-25T04:22:26.204909+0000","last_peered":"2023-08-25T04:22:26.204909+0000","last_clean":"2023-08-25T04:22:26.204909+0000","last_became_active":"2023-08-25T04:22:23.942760+0000","last_became_peered":"2023-08-25T04:22:23.942760+0000","last_unstale":"2023-08-25T04:22:26.204909+0000","last_undegraded":"2023-08-25T04:22:26.204909+0000","last_fullsized":"2023-08-25T04:22:26.204909+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:57:55.603209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204374+0000","last_change":"2023-08-25T04:22:24.992702+0000","last_active":"2023-08-25T04:22:26.204374+0000","last_peered":"2023-08-25T04:22:26.204374+0000","last_clean":"2023-08-25T04:22:26.204374+0000","last_became_active":"2023-08-25T04:22:24.992406+0000","last_became_peered":"2023-08-25T04:22:24.992406+0000","last_unstale":"2023-08-25T04:22:26.204374+0000","last_undegraded":"2023-08-25T04:22:26.204374+0000","last_fullsized":"2023-08-25T04:22:26.204374+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:11.448723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"135'2","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964321+0000","last_change":"2023-08-25T04:22:23.936987+0000","last_active":"2023-08-25T04:22:25.964321+0000","last_peered":"2023-08-25T04:22:25.964321+0000","last_clean":"2023-08-25T04:22:25.964321+0000","last_became_active":"2023-08-25T04:22:23.936122+0000","last_became_peered":"2023-08-25T04:22:23.936122+0000","last_unstale":"2023-08-25T04:22:25.964321+0000","last_undegraded":"2023-08-25T04:22:25.964321+0000","last_fullsized":"2023-08-25T04:22:25.964321+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:18:53.632727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.963950+0000","last_change":"2023-08-25T04:22:24.985581+0000","last_active":"2023-08-25T04:22:25.963950+0000","last_peered":"2023-08-25T04:22:25.963950+0000","last_clean":"2023-08-25T04:22:25.963950+0000","last_became_active":"2023-08-25T04:22:24.985265+0000","last_became_peered":"2023-08-25T04:22:24.985265+0000","last_unstale":"2023-08-25T04:22:25.963950+0000","last_undegraded":"2023-08-25T04:22:25.963950+0000","last_fullsized":"2023-08-25T04:22:25.963950+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:51:21.272105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"135'1","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964548+0000","last_change":"2023-08-25T04:22:23.935374+0000","last_active":"2023-08-25T04:22:25.964548+0000","last_peered":"2023-08-25T04:22:25.964548+0000","last_clean":"2023-08-25T04:22:25.964548+0000","last_became_active":"2023-08-25T04:22:23.935042+0000","last_became_peered":"2023-08-25T04:22:23.935042+0000","last_unstale":"2023-08-25T04:22:25.964548+0000","last_undegraded":"2023-08-25T04:22:25.964548+0000","last_fullsized":"2023-08-25T04:22:25.964548+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:46:59.332786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.963948+0000","last_change":"2023-08-25T04:22:24.967494+0000","last_active":"2023-08-25T04:22:25.963948+0000","last_peered":"2023-08-25T04:22:25.963948+0000","last_clean":"2023-08-25T04:22:25.963948+0000","last_became_active":"2023-08-25T04:22:24.967152+0000","last_became_peered":"2023-08-25T04:22:24.967152+0000","last_unstale":"2023-08-25T04:22:25.963948+0000","last_undegraded":"2023-08-25T04:22:25.963948+0000","last_fullsized":"2023-08-25T04:22:25.963948+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:22:15.124047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"135'1","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205756+0000","last_change":"2023-08-25T04:22:23.954752+0000","last_active":"2023-08-25T04:22:26.205756+0000","last_peered":"2023-08-25T04:22:26.205756+0000","last_clean":"2023-08-25T04:22:26.205756+0000","last_became_active":"2023-08-25T04:22:23.954364+0000","last_became_peered":"2023-08-25T04:22:23.954364+0000","last_unstale":"2023-08-25T04:22:26.205756+0000","last_undegraded":"2023-08-25T04:22:26.205756+0000","last_fullsized":"2023-08-25T04:22:26.205756+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:38:10.408336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206897+0000","last_change":"2023-08-25T04:22:24.987561+0000","last_active":"2023-08-25T04:22:26.206897+0000","last_peered":"2023-08-25T04:22:26.206897+0000","last_clean":"2023-08-25T04:22:26.206897+0000","last_became_active":"2023-08-25T04:22:24.986656+0000","last_became_peered":"2023-08-25T04:22:24.986656+0000","last_unstale":"2023-08-25T04:22:26.206897+0000","last_undegraded":"2023-08-25T04:22:26.206897+0000","last_fullsized":"2023-08-25T04:22:26.206897+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:55.425168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204332+0000","last_change":"2023-08-25T04:22:23.939447+0000","last_active":"2023-08-25T04:22:26.204332+0000","last_peered":"2023-08-25T04:22:26.204332+0000","last_clean":"2023-08-25T04:22:26.204332+0000","last_became_active":"2023-08-25T04:22:23.939163+0000","last_became_peered":"2023-08-25T04:22:23.939163+0000","last_unstale":"2023-08-25T04:22:26.204332+0000","last_undegraded":"2023-08-25T04:22:26.204332+0000","last_fullsized":"2023-08-25T04:22:26.204332+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:39.384237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964131+0000","last_change":"2023-08-25T04:22:24.986173+0000","last_active":"2023-08-25T04:22:25.964131+0000","last_peered":"2023-08-25T04:22:25.964131+0000","last_clean":"2023-08-25T04:22:25.964131+0000","last_became_active":"2023-08-25T04:22:24.985930+0000","last_became_peered":"2023-08-25T04:22:24.985930+0000","last_unstale":"2023-08-25T04:22:25.964131+0000","last_undegraded":"2023-08-25T04:22:25.964131+0000","last_fullsized":"2023-08-25T04:22:25.964131+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:30:42.063939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206544+0000","last_change":"2023-08-25T04:22:23.949373+0000","last_active":"2023-08-25T04:22:26.206544+0000","last_peered":"2023-08-25T04:22:26.206544+0000","last_clean":"2023-08-25T04:22:26.206544+0000","last_became_active":"2023-08-25T04:22:23.949016+0000","last_became_peered":"2023-08-25T04:22:23.949016+0000","last_unstale":"2023-08-25T04:22:26.206544+0000","last_undegraded":"2023-08-25T04:22:26.206544+0000","last_fullsized":"2023-08-25T04:22:26.206544+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:37.798379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204294+0000","last_change":"2023-08-25T04:22:24.995550+0000","last_active":"2023-08-25T04:22:26.204294+0000","last_peered":"2023-08-25T04:22:26.204294+0000","last_clean":"2023-08-25T04:22:26.204294+0000","last_became_active":"2023-08-25T04:22:24.995194+0000","last_became_peered":"2023-08-25T04:22:24.995194+0000","last_unstale":"2023-08-25T04:22:26.204294+0000","last_undegraded":"2023-08-25T04:22:26.204294+0000","last_fullsized":"2023-08-25T04:22:26.204294+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:15:07.728544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"135'1","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964281+0000","last_change":"2023-08-25T04:22:23.950360+0000","last_active":"2023-08-25T04:22:25.964281+0000","last_peered":"2023-08-25T04:22:25.964281+0000","last_clean":"2023-08-25T04:22:25.964281+0000","last_became_active":"2023-08-25T04:22:23.949970+0000","last_became_peered":"2023-08-25T04:22:23.949970+0000","last_unstale":"2023-08-25T04:22:25.964281+0000","last_undegraded":"2023-08-25T04:22:25.964281+0000","last_fullsized":"2023-08-25T04:22:25.964281+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:35:31.393426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964710+0000","last_change":"2023-08-25T04:22:24.973304+0000","last_active":"2023-08-25T04:22:25.964710+0000","last_peered":"2023-08-25T04:22:25.964710+0000","last_clean":"2023-08-25T04:22:25.964710+0000","last_became_active":"2023-08-25T04:22:24.972966+0000","last_became_peered":"2023-08-25T04:22:24.972966+0000","last_unstale":"2023-08-25T04:22:25.964710+0000","last_undegraded":"2023-08-25T04:22:25.964710+0000","last_fullsized":"2023-08-25T04:22:25.964710+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:19:47.310378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"135'2","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205861+0000","last_change":"2023-08-25T04:22:23.952200+0000","last_active":"2023-08-25T04:22:26.205861+0000","last_peered":"2023-08-25T04:22:26.205861+0000","last_clean":"2023-08-25T04:22:26.205861+0000","last_became_active":"2023-08-25T04:22:23.951889+0000","last_became_peered":"2023-08-25T04:22:23.951889+0000","last_unstale":"2023-08-25T04:22:26.205861+0000","last_undegraded":"2023-08-25T04:22:26.205861+0000","last_fullsized":"2023-08-25T04:22:26.205861+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:04:29.621868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206484+0000","last_change":"2023-08-25T04:22:24.990122+0000","last_active":"2023-08-25T04:22:26.206484+0000","last_peered":"2023-08-25T04:22:26.206484+0000","last_clean":"2023-08-25T04:22:26.206484+0000","last_became_active":"2023-08-25T04:22:24.989765+0000","last_became_peered":"2023-08-25T04:22:24.989765+0000","last_unstale":"2023-08-25T04:22:26.206484+0000","last_undegraded":"2023-08-25T04:22:26.206484+0000","last_fullsized":"2023-08-25T04:22:26.206484+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:43:42.693750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"135'1","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204988+0000","last_change":"2023-08-25T04:22:23.941276+0000","last_active":"2023-08-25T04:22:26.204988+0000","last_peered":"2023-08-25T04:22:26.204988+0000","last_clean":"2023-08-25T04:22:26.204988+0000","last_became_active":"2023-08-25T04:22:23.941003+0000","last_became_peered":"2023-08-25T04:22:23.941003+0000","last_unstale":"2023-08-25T04:22:26.204988+0000","last_undegraded":"2023-08-25T04:22:26.204988+0000","last_fullsized":"2023-08-25T04:22:26.204988+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:43:25.869524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205335+0000","last_change":"2023-08-25T04:22:24.988711+0000","last_active":"2023-08-25T04:22:26.205335+0000","last_peered":"2023-08-25T04:22:26.205335+0000","last_clean":"2023-08-25T04:22:26.205335+0000","last_became_active":"2023-08-25T04:22:24.988233+0000","last_became_peered":"2023-08-25T04:22:24.988233+0000","last_unstale":"2023-08-25T04:22:26.205335+0000","last_undegraded":"2023-08-25T04:22:26.205335+0000","last_fullsized":"2023-08-25T04:22:26.205335+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:13:11.822457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204767+0000","last_change":"2023-08-25T04:22:23.951309+0000","last_active":"2023-08-25T04:22:26.204767+0000","last_peered":"2023-08-25T04:22:26.204767+0000","last_clean":"2023-08-25T04:22:26.204767+0000","last_became_active":"2023-08-25T04:22:23.951005+0000","last_became_peered":"2023-08-25T04:22:23.951005+0000","last_unstale":"2023-08-25T04:22:26.204767+0000","last_undegraded":"2023-08-25T04:22:26.204767+0000","last_fullsized":"2023-08-25T04:22:26.204767+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:18:58.996099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206343+0000","last_change":"2023-08-25T04:22:24.993127+0000","last_active":"2023-08-25T04:22:26.206343+0000","last_peered":"2023-08-25T04:22:26.206343+0000","last_clean":"2023-08-25T04:22:26.206343+0000","last_became_active":"2023-08-25T04:22:24.992643+0000","last_became_peered":"2023-08-25T04:22:24.992643+0000","last_unstale":"2023-08-25T04:22:26.206343+0000","last_undegraded":"2023-08-25T04:22:26.206343+0000","last_fullsized":"2023-08-25T04:22:26.206343+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:46:04.552286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"135'2","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205646+0000","last_change":"2023-08-25T04:22:23.951668+0000","last_active":"2023-08-25T04:22:26.205646+0000","last_peered":"2023-08-25T04:22:26.205646+0000","last_clean":"2023-08-25T04:22:26.205646+0000","last_became_active":"2023-08-25T04:22:23.951292+0000","last_became_peered":"2023-08-25T04:22:23.951292+0000","last_unstale":"2023-08-25T04:22:26.205646+0000","last_undegraded":"2023-08-25T04:22:26.205646+0000","last_fullsized":"2023-08-25T04:22:26.205646+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:51:27.882156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206310+0000","last_change":"2023-08-25T04:22:24.988137+0000","last_active":"2023-08-25T04:22:26.206310+0000","last_peered":"2023-08-25T04:22:26.206310+0000","last_clean":"2023-08-25T04:22:26.206310+0000","last_became_active":"2023-08-25T04:22:24.987859+0000","last_became_peered":"2023-08-25T04:22:24.987859+0000","last_unstale":"2023-08-25T04:22:26.206310+0000","last_undegraded":"2023-08-25T04:22:26.206310+0000","last_fullsized":"2023-08-25T04:22:26.206310+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:20:01.423528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204381+0000","last_change":"2023-08-25T04:22:23.940568+0000","last_active":"2023-08-25T04:22:26.204381+0000","last_peered":"2023-08-25T04:22:26.204381+0000","last_clean":"2023-08-25T04:22:26.204381+0000","last_became_active":"2023-08-25T04:22:23.940255+0000","last_became_peered":"2023-08-25T04:22:23.940255+0000","last_unstale":"2023-08-25T04:22:26.204381+0000","last_undegraded":"2023-08-25T04:22:26.204381+0000","last_fullsized":"2023-08-25T04:22:26.204381+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:57:23.695875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.207016+0000","last_change":"2023-08-25T04:22:24.980057+0000","last_active":"2023-08-25T04:22:26.207016+0000","last_peered":"2023-08-25T04:22:26.207016+0000","last_clean":"2023-08-25T04:22:26.207016+0000","last_became_active":"2023-08-25T04:22:24.979725+0000","last_became_peered":"2023-08-25T04:22:24.979725+0000","last_unstale":"2023-08-25T04:22:26.207016+0000","last_undegraded":"2023-08-25T04:22:26.207016+0000","last_fullsized":"2023-08-25T04:22:26.207016+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:54:50.327192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206540+0000","last_change":"2023-08-25T04:22:23.952275+0000","last_active":"2023-08-25T04:22:26.206540+0000","last_peered":"2023-08-25T04:22:26.206540+0000","last_clean":"2023-08-25T04:22:26.206540+0000","last_became_active":"2023-08-25T04:22:23.951935+0000","last_became_peered":"2023-08-25T04:22:23.951935+0000","last_unstale":"2023-08-25T04:22:26.206540+0000","last_undegraded":"2023-08-25T04:22:26.206540+0000","last_fullsized":"2023-08-25T04:22:26.206540+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:23:13.707641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204529+0000","last_change":"2023-08-25T04:22:24.997117+0000","last_active":"2023-08-25T04:22:26.204529+0000","last_peered":"2023-08-25T04:22:26.204529+0000","last_clean":"2023-08-25T04:22:26.204529+0000","last_became_active":"2023-08-25T04:22:24.996854+0000","last_became_peered":"2023-08-25T04:22:24.996854+0000","last_unstale":"2023-08-25T04:22:26.204529+0000","last_undegraded":"2023-08-25T04:22:26.204529+0000","last_fullsized":"2023-08-25T04:22:26.204529+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:51:28.888407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.203755+0000","last_change":"2023-08-25T04:22:23.942906+0000","last_active":"2023-08-25T04:22:26.203755+0000","last_peered":"2023-08-25T04:22:26.203755+0000","last_clean":"2023-08-25T04:22:26.203755+0000","last_became_active":"2023-08-25T04:22:23.942635+0000","last_became_peered":"2023-08-25T04:22:23.942635+0000","last_unstale":"2023-08-25T04:22:26.203755+0000","last_undegraded":"2023-08-25T04:22:26.203755+0000","last_fullsized":"2023-08-25T04:22:26.203755+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:48:16.866068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206199+0000","last_change":"2023-08-25T04:22:25.000112+0000","last_active":"2023-08-25T04:22:26.206199+0000","last_peered":"2023-08-25T04:22:26.206199+0000","last_clean":"2023-08-25T04:22:26.206199+0000","last_became_active":"2023-08-25T04:22:24.999839+0000","last_became_peered":"2023-08-25T04:22:24.999839+0000","last_unstale":"2023-08-25T04:22:26.206199+0000","last_undegraded":"2023-08-25T04:22:26.206199+0000","last_fullsized":"2023-08-25T04:22:26.206199+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:46:11.761122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"135'2","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206039+0000","last_change":"2023-08-25T04:22:23.949512+0000","last_active":"2023-08-25T04:22:26.206039+0000","last_peered":"2023-08-25T04:22:26.206039+0000","last_clean":"2023-08-25T04:22:26.206039+0000","last_became_active":"2023-08-25T04:22:23.949089+0000","last_became_peered":"2023-08-25T04:22:23.949089+0000","last_unstale":"2023-08-25T04:22:26.206039+0000","last_undegraded":"2023-08-25T04:22:26.206039+0000","last_fullsized":"2023-08-25T04:22:26.206039+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:10:46.091024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964232+0000","last_change":"2023-08-25T04:22:24.985747+0000","last_active":"2023-08-25T04:22:25.964232+0000","last_peered":"2023-08-25T04:22:25.964232+0000","last_clean":"2023-08-25T04:22:25.964232+0000","last_became_active":"2023-08-25T04:22:24.985464+0000","last_became_peered":"2023-08-25T04:22:24.985464+0000","last_unstale":"2023-08-25T04:22:25.964232+0000","last_undegraded":"2023-08-25T04:22:25.964232+0000","last_fullsized":"2023-08-25T04:22:25.964232+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:16:56.375321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964182+0000","last_change":"2023-08-25T04:22:23.950792+0000","last_active":"2023-08-25T04:22:25.964182+0000","last_peered":"2023-08-25T04:22:25.964182+0000","last_clean":"2023-08-25T04:22:25.964182+0000","last_became_active":"2023-08-25T04:22:23.950452+0000","last_became_peered":"2023-08-25T04:22:23.950452+0000","last_unstale":"2023-08-25T04:22:25.964182+0000","last_undegraded":"2023-08-25T04:22:25.964182+0000","last_fullsized":"2023-08-25T04:22:25.964182+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:40:57.683800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204971+0000","last_change":"2023-08-25T04:22:24.967748+0000","last_active":"2023-08-25T04:22:26.204971+0000","last_peered":"2023-08-25T04:22:26.204971+0000","last_clean":"2023-08-25T04:22:26.204971+0000","last_became_active":"2023-08-25T04:22:24.967392+0000","last_became_peered":"2023-08-25T04:22:24.967392+0000","last_unstale":"2023-08-25T04:22:26.204971+0000","last_undegraded":"2023-08-25T04:22:26.204971+0000","last_fullsized":"2023-08-25T04:22:26.204971+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:02:48.603704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964565+0000","last_change":"2023-08-25T04:22:23.950199+0000","last_active":"2023-08-25T04:22:25.964565+0000","last_peered":"2023-08-25T04:22:25.964565+0000","last_clean":"2023-08-25T04:22:25.964565+0000","last_became_active":"2023-08-25T04:22:23.949899+0000","last_became_peered":"2023-08-25T04:22:23.949899+0000","last_unstale":"2023-08-25T04:22:25.964565+0000","last_undegraded":"2023-08-25T04:22:25.964565+0000","last_fullsized":"2023-08-25T04:22:25.964565+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:20:04.404746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205521+0000","last_change":"2023-08-25T04:22:24.990681+0000","last_active":"2023-08-25T04:22:26.205521+0000","last_peered":"2023-08-25T04:22:26.205521+0000","last_clean":"2023-08-25T04:22:26.205521+0000","last_became_active":"2023-08-25T04:22:24.990410+0000","last_became_peered":"2023-08-25T04:22:24.990410+0000","last_unstale":"2023-08-25T04:22:26.205521+0000","last_undegraded":"2023-08-25T04:22:26.205521+0000","last_fullsized":"2023-08-25T04:22:26.205521+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:09:06.003095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206284+0000","last_change":"2023-08-25T04:22:23.951624+0000","last_active":"2023-08-25T04:22:26.206284+0000","last_peered":"2023-08-25T04:22:26.206284+0000","last_clean":"2023-08-25T04:22:26.206284+0000","last_became_active":"2023-08-25T04:22:23.951310+0000","last_became_peered":"2023-08-25T04:22:23.951310+0000","last_unstale":"2023-08-25T04:22:26.206284+0000","last_undegraded":"2023-08-25T04:22:26.206284+0000","last_fullsized":"2023-08-25T04:22:26.206284+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:13:10.816206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206463+0000","last_change":"2023-08-25T04:22:24.992947+0000","last_active":"2023-08-25T04:22:26.206463+0000","last_peered":"2023-08-25T04:22:26.206463+0000","last_clean":"2023-08-25T04:22:26.206463+0000","last_became_active":"2023-08-25T04:22:24.992319+0000","last_became_peered":"2023-08-25T04:22:24.992319+0000","last_unstale":"2023-08-25T04:22:26.206463+0000","last_undegraded":"2023-08-25T04:22:26.206463+0000","last_fullsized":"2023-08-25T04:22:26.206463+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:07:57.946440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964608+0000","last_change":"2023-08-25T04:22:23.943144+0000","last_active":"2023-08-25T04:22:25.964608+0000","last_peered":"2023-08-25T04:22:25.964608+0000","last_clean":"2023-08-25T04:22:25.964608+0000","last_became_active":"2023-08-25T04:22:23.942803+0000","last_became_peered":"2023-08-25T04:22:23.942803+0000","last_unstale":"2023-08-25T04:22:25.964608+0000","last_undegraded":"2023-08-25T04:22:25.964608+0000","last_fullsized":"2023-08-25T04:22:25.964608+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:07:37.842415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206440+0000","last_change":"2023-08-25T04:22:24.978375+0000","last_active":"2023-08-25T04:22:26.206440+0000","last_peered":"2023-08-25T04:22:26.206440+0000","last_clean":"2023-08-25T04:22:26.206440+0000","last_became_active":"2023-08-25T04:22:24.978090+0000","last_became_peered":"2023-08-25T04:22:24.978090+0000","last_unstale":"2023-08-25T04:22:26.206440+0000","last_undegraded":"2023-08-25T04:22:26.206440+0000","last_fullsized":"2023-08-25T04:22:26.206440+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:47:18.483790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964359+0000","last_change":"2023-08-25T04:22:23.940126+0000","last_active":"2023-08-25T04:22:25.964359+0000","last_peered":"2023-08-25T04:22:25.964359+0000","last_clean":"2023-08-25T04:22:25.964359+0000","last_became_active":"2023-08-25T04:22:23.939787+0000","last_became_peered":"2023-08-25T04:22:23.939787+0000","last_unstale":"2023-08-25T04:22:25.964359+0000","last_undegraded":"2023-08-25T04:22:25.964359+0000","last_fullsized":"2023-08-25T04:22:25.964359+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:27:15.410928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204264+0000","last_change":"2023-08-25T04:22:24.991400+0000","last_active":"2023-08-25T04:22:26.204264+0000","last_peered":"2023-08-25T04:22:26.204264+0000","last_clean":"2023-08-25T04:22:26.204264+0000","last_became_active":"2023-08-25T04:22:24.991119+0000","last_became_peered":"2023-08-25T04:22:24.991119+0000","last_unstale":"2023-08-25T04:22:26.204264+0000","last_undegraded":"2023-08-25T04:22:26.204264+0000","last_fullsized":"2023-08-25T04:22:26.204264+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:19:09.572991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205583+0000","last_change":"2023-08-25T04:22:23.951861+0000","last_active":"2023-08-25T04:22:26.205583+0000","last_peered":"2023-08-25T04:22:26.205583+0000","last_clean":"2023-08-25T04:22:26.205583+0000","last_became_active":"2023-08-25T04:22:23.951562+0000","last_became_peered":"2023-08-25T04:22:23.951562+0000","last_unstale":"2023-08-25T04:22:26.205583+0000","last_undegraded":"2023-08-25T04:22:26.205583+0000","last_fullsized":"2023-08-25T04:22:26.205583+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:44.764248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964267+0000","last_change":"2023-08-25T04:22:24.981863+0000","last_active":"2023-08-25T04:22:25.964267+0000","last_peered":"2023-08-25T04:22:25.964267+0000","last_clean":"2023-08-25T04:22:25.964267+0000","last_became_active":"2023-08-25T04:22:24.981575+0000","last_became_peered":"2023-08-25T04:22:24.981575+0000","last_unstale":"2023-08-25T04:22:25.964267+0000","last_undegraded":"2023-08-25T04:22:25.964267+0000","last_fullsized":"2023-08-25T04:22:25.964267+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:54.230362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.203758+0000","last_change":"2023-08-25T04:22:23.935832+0000","last_active":"2023-08-25T04:22:26.203758+0000","last_peered":"2023-08-25T04:22:26.203758+0000","last_clean":"2023-08-25T04:22:26.203758+0000","last_became_active":"2023-08-25T04:22:23.935459+0000","last_became_peered":"2023-08-25T04:22:23.935459+0000","last_unstale":"2023-08-25T04:22:26.203758+0000","last_undegraded":"2023-08-25T04:22:26.203758+0000","last_fullsized":"2023-08-25T04:22:26.203758+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:29:11.514300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204593+0000","last_change":"2023-08-25T04:22:24.986230+0000","last_active":"2023-08-25T04:22:26.204593+0000","last_peered":"2023-08-25T04:22:26.204593+0000","last_clean":"2023-08-25T04:22:26.204593+0000","last_became_active":"2023-08-25T04:22:24.985966+0000","last_became_peered":"2023-08-25T04:22:24.985966+0000","last_unstale":"2023-08-25T04:22:26.204593+0000","last_undegraded":"2023-08-25T04:22:26.204593+0000","last_fullsized":"2023-08-25T04:22:26.204593+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:07.817849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"135'8","reported_seq":21,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205699+0000","last_change":"2023-08-25T04:22:23.942738+0000","last_active":"2023-08-25T04:22:26.205699+0000","last_peered":"2023-08-25T04:22:26.205699+0000","last_clean":"2023-08-25T04:22:26.205699+0000","last_became_active":"2023-08-25T04:22:23.942467+0000","last_became_peered":"2023-08-25T04:22:23.942467+0000","last_unstale":"2023-08-25T04:22:26.205699+0000","last_undegraded":"2023-08-25T04:22:26.205699+0000","last_fullsized":"2023-08-25T04:22:26.205699+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:40:39.538469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"124'3554","reported_seq":4154,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204170+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:22:26.204170+0000","last_peered":"2023-08-25T04:22:26.204170+0000","last_clean":"2023-08-25T04:22:26.204170+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:22:26.204170+0000","last_undegraded":"2023-08-25T04:22:26.204170+0000","last_fullsized":"2023-08-25T04:22:26.204170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3554,"log_dups_size":0,"ondisk_log_size":3554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:42:27.482968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1232,"num_read_kb":2549,"num_write":385,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":210,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204582+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:22:26.204582+0000","last_peered":"2023-08-25T04:22:26.204582+0000","last_clean":"2023-08-25T04:22:26.204582+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:22:26.204582+0000","last_undegraded":"2023-08-25T04:22:26.204582+0000","last_fullsized":"2023-08-25T04:22:26.204582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:18:42.136058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964886+0000","last_change":"2023-08-25T04:22:24.974953+0000","last_active":"2023-08-25T04:22:25.964886+0000","last_peered":"2023-08-25T04:22:25.964886+0000","last_clean":"2023-08-25T04:22:25.964886+0000","last_became_active":"2023-08-25T04:22:24.974639+0000","last_became_peered":"2023-08-25T04:22:24.974639+0000","last_unstale":"2023-08-25T04:22:25.964886+0000","last_undegraded":"2023-08-25T04:22:25.964886+0000","last_fullsized":"2023-08-25T04:22:25.964886+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:52:46.328332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"135'2","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206333+0000","last_change":"2023-08-25T04:22:23.942162+0000","last_active":"2023-08-25T04:22:26.206333+0000","last_peered":"2023-08-25T04:22:26.206333+0000","last_clean":"2023-08-25T04:22:26.206333+0000","last_became_active":"2023-08-25T04:22:23.941827+0000","last_became_peered":"2023-08-25T04:22:23.941827+0000","last_unstale":"2023-08-25T04:22:26.206333+0000","last_undegraded":"2023-08-25T04:22:26.206333+0000","last_fullsized":"2023-08-25T04:22:26.206333+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:13:01.394885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":210,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.203927+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:22:26.203927+0000","last_peered":"2023-08-25T04:22:26.203927+0000","last_clean":"2023-08-25T04:22:26.203927+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:22:26.203927+0000","last_undegraded":"2023-08-25T04:22:26.203927+0000","last_fullsized":"2023-08-25T04:22:26.203927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:33:38.409193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964043+0000","last_change":"2023-08-25T04:22:24.981226+0000","last_active":"2023-08-25T04:22:25.964043+0000","last_peered":"2023-08-25T04:22:25.964043+0000","last_clean":"2023-08-25T04:22:25.964043+0000","last_became_active":"2023-08-25T04:22:24.980923+0000","last_became_peered":"2023-08-25T04:22:24.980923+0000","last_unstale":"2023-08-25T04:22:25.964043+0000","last_undegraded":"2023-08-25T04:22:25.964043+0000","last_fullsized":"2023-08-25T04:22:25.964043+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:40:40.053181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.207052+0000","last_change":"2023-08-25T04:22:23.945299+0000","last_active":"2023-08-25T04:22:26.207052+0000","last_peered":"2023-08-25T04:22:26.207052+0000","last_clean":"2023-08-25T04:22:26.207052+0000","last_became_active":"2023-08-25T04:22:23.945011+0000","last_became_peered":"2023-08-25T04:22:23.945011+0000","last_unstale":"2023-08-25T04:22:26.207052+0000","last_undegraded":"2023-08-25T04:22:26.207052+0000","last_fullsized":"2023-08-25T04:22:26.207052+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:40:48.532063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":216,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205171+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:22:26.205171+0000","last_peered":"2023-08-25T04:22:26.205171+0000","last_clean":"2023-08-25T04:22:26.205171+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:22:26.205171+0000","last_undegraded":"2023-08-25T04:22:26.205171+0000","last_fullsized":"2023-08-25T04:22:26.205171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:07:15.240628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205697+0000","last_change":"2023-08-25T04:22:24.989300+0000","last_active":"2023-08-25T04:22:26.205697+0000","last_peered":"2023-08-25T04:22:26.205697+0000","last_clean":"2023-08-25T04:22:26.205697+0000","last_became_active":"2023-08-25T04:22:24.988974+0000","last_became_peered":"2023-08-25T04:22:24.988974+0000","last_unstale":"2023-08-25T04:22:26.205697+0000","last_undegraded":"2023-08-25T04:22:26.205697+0000","last_fullsized":"2023-08-25T04:22:26.205697+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:04.496248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206547+0000","last_change":"2023-08-25T04:22:23.945109+0000","last_active":"2023-08-25T04:22:26.206547+0000","last_peered":"2023-08-25T04:22:26.206547+0000","last_clean":"2023-08-25T04:22:26.206547+0000","last_became_active":"2023-08-25T04:22:23.944798+0000","last_became_peered":"2023-08-25T04:22:23.944798+0000","last_unstale":"2023-08-25T04:22:26.206547+0000","last_undegraded":"2023-08-25T04:22:26.206547+0000","last_fullsized":"2023-08-25T04:22:26.206547+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:41:12.209828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":210,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204495+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:22:26.204495+0000","last_peered":"2023-08-25T04:22:26.204495+0000","last_clean":"2023-08-25T04:22:26.204495+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:22:26.204495+0000","last_undegraded":"2023-08-25T04:22:26.204495+0000","last_fullsized":"2023-08-25T04:22:26.204495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:31:56.114244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964582+0000","last_change":"2023-08-25T04:22:24.973626+0000","last_active":"2023-08-25T04:22:25.964582+0000","last_peered":"2023-08-25T04:22:25.964582+0000","last_clean":"2023-08-25T04:22:25.964582+0000","last_became_active":"2023-08-25T04:22:24.973339+0000","last_became_peered":"2023-08-25T04:22:24.973339+0000","last_unstale":"2023-08-25T04:22:25.964582+0000","last_undegraded":"2023-08-25T04:22:25.964582+0000","last_fullsized":"2023-08-25T04:22:25.964582+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:22:15.124047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.965016+0000","last_change":"2023-08-25T04:22:23.949056+0000","last_active":"2023-08-25T04:22:25.965016+0000","last_peered":"2023-08-25T04:22:25.965016+0000","last_clean":"2023-08-25T04:22:25.965016+0000","last_became_active":"2023-08-25T04:22:23.948734+0000","last_became_peered":"2023-08-25T04:22:23.948734+0000","last_unstale":"2023-08-25T04:22:25.965016+0000","last_undegraded":"2023-08-25T04:22:25.965016+0000","last_fullsized":"2023-08-25T04:22:25.965016+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:54:23.848789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964392+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:22:25.964392+0000","last_peered":"2023-08-25T04:22:25.964392+0000","last_clean":"2023-08-25T04:22:25.964392+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:22:25.964392+0000","last_undegraded":"2023-08-25T04:22:25.964392+0000","last_fullsized":"2023-08-25T04:22:25.964392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:48:05.691167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204743+0000","last_change":"2023-08-25T04:22:24.996859+0000","last_active":"2023-08-25T04:22:26.204743+0000","last_peered":"2023-08-25T04:22:26.204743+0000","last_clean":"2023-08-25T04:22:26.204743+0000","last_became_active":"2023-08-25T04:22:24.996540+0000","last_became_peered":"2023-08-25T04:22:24.996540+0000","last_unstale":"2023-08-25T04:22:26.204743+0000","last_undegraded":"2023-08-25T04:22:26.204743+0000","last_fullsized":"2023-08-25T04:22:26.204743+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:14:30.577755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205007+0000","last_change":"2023-08-25T04:22:23.942354+0000","last_active":"2023-08-25T04:22:26.205007+0000","last_peered":"2023-08-25T04:22:26.205007+0000","last_clean":"2023-08-25T04:22:26.205007+0000","last_became_active":"2023-08-25T04:22:23.942057+0000","last_became_peered":"2023-08-25T04:22:23.942057+0000","last_unstale":"2023-08-25T04:22:26.205007+0000","last_undegraded":"2023-08-25T04:22:26.205007+0000","last_fullsized":"2023-08-25T04:22:26.205007+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:55.486409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":210,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205061+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:22:26.205061+0000","last_peered":"2023-08-25T04:22:26.205061+0000","last_clean":"2023-08-25T04:22:26.205061+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:22:26.205061+0000","last_undegraded":"2023-08-25T04:22:26.205061+0000","last_fullsized":"2023-08-25T04:22:26.205061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:34:54.300689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206139+0000","last_change":"2023-08-25T04:22:24.980259+0000","last_active":"2023-08-25T04:22:26.206139+0000","last_peered":"2023-08-25T04:22:26.206139+0000","last_clean":"2023-08-25T04:22:26.206139+0000","last_became_active":"2023-08-25T04:22:24.978717+0000","last_became_peered":"2023-08-25T04:22:24.978717+0000","last_unstale":"2023-08-25T04:22:26.206139+0000","last_undegraded":"2023-08-25T04:22:26.206139+0000","last_fullsized":"2023-08-25T04:22:26.206139+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:54:36.992915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"135'3","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204712+0000","last_change":"2023-08-25T04:22:23.941295+0000","last_active":"2023-08-25T04:22:26.204712+0000","last_peered":"2023-08-25T04:22:26.204712+0000","last_clean":"2023-08-25T04:22:26.204712+0000","last_became_active":"2023-08-25T04:22:23.940689+0000","last_became_peered":"2023-08-25T04:22:23.940689+0000","last_unstale":"2023-08-25T04:22:26.204712+0000","last_undegraded":"2023-08-25T04:22:26.204712+0000","last_fullsized":"2023-08-25T04:22:26.204712+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:39:00.007640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964469+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:22:25.964469+0000","last_peered":"2023-08-25T04:22:25.964469+0000","last_clean":"2023-08-25T04:22:25.964469+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:22:25.964469+0000","last_undegraded":"2023-08-25T04:22:25.964469+0000","last_fullsized":"2023-08-25T04:22:25.964469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:35:38.352388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205216+0000","last_change":"2023-08-25T04:22:24.988742+0000","last_active":"2023-08-25T04:22:26.205216+0000","last_peered":"2023-08-25T04:22:26.205216+0000","last_clean":"2023-08-25T04:22:26.205216+0000","last_became_active":"2023-08-25T04:22:24.988427+0000","last_became_peered":"2023-08-25T04:22:24.988427+0000","last_unstale":"2023-08-25T04:22:26.205216+0000","last_undegraded":"2023-08-25T04:22:26.205216+0000","last_fullsized":"2023-08-25T04:22:26.205216+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:30.167507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"135'6","reported_seq":19,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205903+0000","last_change":"2023-08-25T04:22:23.946500+0000","last_active":"2023-08-25T04:22:26.205903+0000","last_peered":"2023-08-25T04:22:26.205903+0000","last_clean":"2023-08-25T04:22:26.205903+0000","last_became_active":"2023-08-25T04:22:23.946216+0000","last_became_peered":"2023-08-25T04:22:23.946216+0000","last_unstale":"2023-08-25T04:22:26.205903+0000","last_undegraded":"2023-08-25T04:22:26.205903+0000","last_fullsized":"2023-08-25T04:22:26.205903+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:14:16.851197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":246,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.965121+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:22:25.965121+0000","last_peered":"2023-08-25T04:22:25.965121+0000","last_clean":"2023-08-25T04:22:25.965121+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:22:25.965121+0000","last_undegraded":"2023-08-25T04:22:25.965121+0000","last_fullsized":"2023-08-25T04:22:25.965121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:07:47.138650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1232,"num_read_kb":2549,"num_write":385,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3554,"ondisk_log_size":3554,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509674,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59788,"kb_used_data":2236,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312052,"statfs":{"total":96636764160,"available":96575541248,"internally_reserved":0,"allocated":2289664,"data_stored":1431077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65700000000000003,"15min":0.69699999999999995},"min":{"1min":0.51200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91700000000000004,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66600000000000004,"15min":0.70999999999999996},"min":{"1min":0.41499999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81899999999999995,"5min":1,"15min":1.0249999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70099999999999996,"15min":0.72499999999999998},"min":{"1min":0.58099999999999996,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.878,"5min":1.054,"15min":1.054},"last":0.63},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68999999999999995,"15min":0.72499999999999998},"min":{"1min":0.52100000000000002,"5min":0.377,"15min":0.374},"max":{"1min":0.90100000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.751}]},{"osd":2,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65700000000000003,"15min":0.69699999999999995},"min":{"1min":0.44800000000000001,"5min":0.38100000000000001,"15min":0.34899999999999998},"max":{"1min":0.753,"5min":0.94299999999999995,"15min":1.018},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.70899999999999996,"15min":0.74099999999999999},"min":{"1min":0.61499999999999999,"5min":0.46500000000000002,"15min":0.38100000000000001},"max":{"1min":0.96199999999999997,"5min":1.046,"15min":1.046},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69299999999999995,"15min":0.72799999999999998},"min":{"1min":0.56000000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85299999999999998,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71099999999999997,"15min":0.74099999999999999},"min":{"1min":0.54800000000000004,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":0.84899999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.34499999999999997,"15min":0.32400000000000001},"max":{"1min":0.75,"5min":1.004,"15min":1.0109999999999999},"last":0.499},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.44500000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81899999999999995,"5min":0.97599999999999998,"15min":0.97799999999999998},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.624,"15min":0.61099999999999999},"min":{"1min":0.45000000000000001,"5min":0.40500000000000003,"15min":0.377},"max":{"1min":0.90600000000000003,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64200000000000002,"15min":0.629},"min":{"1min":0.42399999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.873,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69999999999999996,"15min":0.69099999999999995},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.872,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.49399999999999999,"5min":0.42799999999999999,"15min":0.42699999999999999},"max":{"1min":0.90100000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.69899999999999995}]}]},{"osd":6,"up_from":15,"seq":64424509674,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36984,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334856,"statfs":{"total":96636764160,"available":96598892544,"internally_reserved":0,"allocated":1683456,"data_stored":840515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65600000000000003,"15min":0.68999999999999995},"min":{"1min":0.439,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.89300000000000002,"5min":0.97599999999999998,"15min":1.0089999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64600000000000002,"15min":0.68100000000000005},"min":{"1min":0.46800000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.95999999999999996,"15min":1.054},"last":0.63900000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69999999999999996,"15min":0.72099999999999997},"min":{"1min":0.498,"5min":0.39600000000000002,"15min":0.38200000000000001},"max":{"1min":0.85199999999999998,"5min":0.98799999999999999,"15min":1.0369999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.71999999999999997},"min":{"1min":0.50700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81899999999999995,"5min":1.109,"15min":1.109},"last":0.69999999999999996}]},{"osd":2,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.55900000000000005,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86299999999999999,"5min":1.0009999999999999,"15min":1.1020000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.745,"15min":0.77700000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94799999999999995,"5min":1.0169999999999999,"15min":1.0569999999999999},"last":0.75600000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.49199999999999999,"5min":0.48499999999999999,"15min":0.46899999999999997},"max":{"1min":0.93600000000000005,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71799999999999997,"15min":0.746},"min":{"1min":0.53000000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93500000000000005,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.621}]},{"osd":4,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.46300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.96199999999999997,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.60699999999999998,"15min":0.59399999999999997},"min":{"1min":0.38700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.93500000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47999999999999998,"5min":0.39200000000000002,"15min":0.373},"max":{"1min":0.85899999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.141,"15min":1.141},"last":0.77600000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40400000000000003},"max":{"1min":0.90200000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.69899999999999995},"min":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.44700000000000001},"max":{"1min":0.90600000000000003,"5min":1.373,"15min":1.373},"last":0.60199999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542377,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50876,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320964,"statfs":{"total":96636764160,"available":96584667136,"internally_reserved":0,"allocated":1687552,"data_stored":840093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65400000000000003,"15min":0.69399999999999995},"min":{"1min":0.42399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":1.002,"5min":1.002,"15min":1.018},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66700000000000004,"15min":0.70999999999999996},"min":{"1min":0.50600000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":1.0409999999999999},"last":0.83899999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66600000000000004,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93000000000000005,"5min":0.96399999999999997,"15min":0.99399999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.72799999999999998},"min":{"1min":0.48999999999999999,"5min":0.434,"15min":0.434},"max":{"1min":0.96199999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.78900000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65800000000000003,"15min":0.70999999999999996},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.39500000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.97499999999999998},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68300000000000005,"15min":0.72699999999999998},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89200000000000002,"5min":1.048,"15min":1.048},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68700000000000006,"15min":0.71999999999999997},"min":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70899999999999996,"15min":0.749},"min":{"1min":0.48999999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85999999999999999,"5min":1.028,"15min":1.028},"last":0.746}]},{"osd":4,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54800000000000004,"15min":0.56999999999999995},"min":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.35399999999999998},"max":{"1min":0.69699999999999995,"5min":0.91000000000000003,"15min":0.97099999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59099999999999997,"15min":0.60999999999999999},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.80800000000000005,"5min":0.91900000000000004,"15min":1.018},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Aug 25 04:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.62,"15min":0.62},"min":{"1min":0.437,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.77400000000000002,"5min":0.96799999999999997,"15min":1.008},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64200000000000002,"15min":0.64500000000000002},"min":{"1min":0.46100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.872,"5min":0.94199999999999995,"15min":0.98299999999999998},"last":0.57999999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63300000000000001,"15min":0.61099999999999999},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.877,"5min":0.93300000000000005,"15min":1.032},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.47799999999999998,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.877,"5min":1.01,"15min":1.048},"last":0.60599999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542377,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36996,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334844,"statfs":{"total":96636764160,"available":96598880256,"internally_reserved":0,"allocated":1691648,"data_stored":841545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.65700000000000003,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.68799999999999994},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.879}]},{"osd":1,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.69299999999999995,"15min":0.72299999999999998},"min":{"1min":0.438,"5min":0.38200000000000001,"15min":0.36199999999999999},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.68300000000000005,"15min":0.72399999999999998},"min":{"1min":0.49199999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.84599999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.71399999999999997,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.69499999999999995,"15min":0.73699999999999999},"min":{"1min":0.49299999999999999,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.97199999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.72699999999999998,"15min":0.75800000000000001},"min":{"1min":0.46999999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":3.0019999999999998,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.69699999999999995,"15min":0.74199999999999999},"min":{"1min":0.54300000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.331,"5min":2.331,"15min":2.331},"last":0.79600000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.36799999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.60699999999999998,"15min":0.59999999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.746,"15min":0.73999999999999999},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.40699999999999997},"max":{"1min":3.0710000000000002,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.42299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.71899999999999997,"15min":0.70499999999999996},"min":{"1min":0.50700000000000001,"5min":0.49199999999999999,"15min":0.437},"max":{"1min":3.2170000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":0.63700000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542377,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37004,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334836,"statfs":{"total":96636764160,"available":96598872064,"internally_reserved":0,"allocated":1695744,"data_stored":841579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.434,"15min":0.44900000000000001},"min":{"1min":0.30099999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64100000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.49099999999999999,"15min":0.51100000000000001},"min":{"1min":0.33300000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.55300000000000005,"5min":0.70799999999999996,"15min":0.91500000000000004},"last":0.46999999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.499,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.81100000000000005,"5min":1.254,"15min":1.254},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.433,"5min":0.41499999999999998,"15min":0.33900000000000002},"max":{"1min":0.96999999999999997,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.42299999999999999,"5min":0.38700000000000001,"15min":0.33000000000000002},"max":{"1min":0.70299999999999996,"5min":1.639,"15min":1.639},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70399999999999996,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.48699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92200000000000004,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76400000000000001,"15min":0.79500000000000004},"min":{"1min":0.55400000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.016,"5min":1.601,"15min":1.601},"last":0.81799999999999995}]},{"osd":5,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73399999999999999,"15min":0.77000000000000002},"min":{"1min":0.55000000000000004,"5min":0.52900000000000003,"15min":0.49299999999999999},"max":{"1min":0.94899999999999995,"5min":1.0549999999999999,"15min":1.254},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74399999999999999,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":0.98299999999999998,"5min":1.421,"15min":1.421},"last":1.2010000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78000000000000003,"15min":0.79900000000000004},"min":{"1min":0.59799999999999998,"5min":0.55000000000000004,"15min":0.54000000000000004},"max":{"1min":1.008,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.748,"15min":0.78400000000000003},"min":{"1min":0.53700000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.99299999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.94999999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77600000000000002,"15min":0.81299999999999994},"min":{"1min":0.56499999999999995,"5min":0.53000000000000003,"15min":0.52500000000000002},"max":{"1min":0.96699999999999997,"5min":1.472,"15min":1.472},"last":1.038},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.752,"15min":0.78600000000000003},"min":{"1min":0.56699999999999995,"5min":0.498,"15min":0.498},"max":{"1min":0.88800000000000001,"5min":1.0209999999999999,"15min":1.1160000000000001},"last":1.0760000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542378,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55028,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316812,"statfs":{"total":96636764160,"available":96580415488,"internally_reserved":0,"allocated":1679360,"data_stored":839933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.433,"15min":0.45700000000000002},"min":{"1min":0.32900000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.61099999999999999,"5min":0.65100000000000002,"15min":0.85599999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.47699999999999998,"15min":0.496},"min":{"1min":0.35599999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72599999999999998,"5min":0.83099999999999996,"15min":0.93100000000000005},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.78800000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57599999999999996,"15min":0.59099999999999997},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.39200000000000002},"max":{"1min":0.81000000000000005,"5min":0.81699999999999995,"15min":0.89800000000000002},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35499999999999998},"max":{"1min":0.67600000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.434},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.42199999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68300000000000005,"5min":0.88900000000000001,"15min":0.89400000000000002},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.74199999999999999,"15min":0.78300000000000003},"min":{"1min":0.58799999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.751},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72399999999999998,"15min":0.77000000000000002},"min":{"1min":0.53200000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.038,"5min":1.0629999999999999,"15min":1.5509999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74099999999999999,"15min":0.78400000000000003},"min":{"1min":0.56399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.258,"5min":1.258,"15min":1.2789999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.76800000000000002,"15min":0.79900000000000004},"min":{"1min":0.57899999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.754,"15min":0.80500000000000005},"min":{"1min":0.55300000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.3069999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.78200000000000003,"15min":0.83799999999999997},"min":{"1min":0.58599999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0800000000000001,"5min":1.1930000000000001,"15min":1.375},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.745,"15min":0.78800000000000003},"min":{"1min":0.58999999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.339},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.75800000000000001,"15min":0.79300000000000004},"min":{"1min":0.60599999999999998,"5min":0.44,"15min":0.44},"max":{"1min":1.133,"5min":1.133,"15min":1.1859999999999999},"last":0.68999999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542378,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36984,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334856,"statfs":{"total":96636764160,"available":96598892544,"internally_reserved":0,"allocated":1683456,"data_stored":839955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.43099999999999999,"15min":0.45200000000000001},"min":{"1min":0.29799999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67500000000000004,"5min":0.93999999999999995,"15min":0.96899999999999997},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.38100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.751,"5min":0.85099999999999998,"15min":1.212},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.497},"min":{"1min":0.35799999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.58399999999999996,"5min":0.80500000000000005,"15min":0.876},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.56799999999999995},"min":{"1min":0.40699999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":1.095,"15min":1.095},"last":0.58499999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58999999999999997,"15min":0.61399999999999999},"min":{"1min":0.435,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89200000000000002,"5min":1.03,"15min":1.03},"last":0.443},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.53500000000000003,"15min":0.56899999999999995},"min":{"1min":0.438,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":1.165},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.69999999999999996,"15min":0.755},"min":{"1min":0.52900000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.204},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.76100000000000001,"15min":0.79200000000000004},"min":{"1min":0.64700000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.246,"5min":1.246,"15min":1.2529999999999999},"last":0.94699999999999995}]},{"osd":5,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.72199999999999998,"15min":0.77300000000000002},"min":{"1min":0.50800000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.254},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73599999999999999,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0249999999999999,"5min":1.044,"15min":1.9059999999999999},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.81999999999999995},"min":{"1min":0.622,"5min":0.497,"15min":0.497},"max":{"1min":1.125,"5min":1.294,"15min":1.623},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.755,"15min":0.78800000000000003},"min":{"1min":0.57199999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.92000000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.751,"15min":0.79200000000000004},"min":{"1min":0.52600000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.091,"5min":1.091,"15min":1.2949999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.81699999999999995,"15min":0.83999999999999997},"min":{"1min":0.59899999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.006}]}]},{"osd":0,"up_from":14,"seq":60129542377,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33404,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338436,"statfs":{"total":96636764160,"available":96602558464,"internally_reserved":0,"allocated":2277376,"data_stored":1430323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46999999999999997,"15min":0.48199999999999998},"min":{"1min":0.28199999999999997,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.66300000000000003,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.55500000000000005},"min":{"1min":0.39200000000000002,"5min":0.38500000000000001,"15min":0.36699999999999999},"max":{"1min":0.79700000000000004,"5min":1.0129999999999999,"15min":3.5089999999999999},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.51500000000000001},"min":{"1min":0.36199999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.37},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.53300000000000003},"min":{"1min":0.34399999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.748,"5min":0.876,"15min":3.4590000000000001},"last":0.44500000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47599999999999998,"15min":0.48699999999999999},"min":{"1min":0.35499999999999998,"5min":0.28699999999999998,"15min":0.27700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.40500000000000003,"5min":0.36699999999999999,"15min":0.32700000000000001},"max":{"1min":0.875,"5min":0.93500000000000005,"15min":1.2470000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.746,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91400000000000003,"5min":1.2,"15min":1.2},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.73999999999999999,"15min":0.79000000000000004},"min":{"1min":0.56799999999999995,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.169,"15min":1.169},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72899999999999998,"15min":0.78100000000000003},"min":{"1min":0.59499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84399999999999997,"5min":1.131,"15min":3.528},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.746,"15min":0.79600000000000004},"min":{"1min":0.55700000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98799999999999999,"5min":1.244,"15min":1.244},"last":0.71599999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73499999999999999,"15min":0.78700000000000003},"min":{"1min":0.54500000000000004,"5min":0.495,"15min":0.495},"max":{"1min":0.95999999999999996,"5min":1.1180000000000001,"15min":3.4870000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77400000000000002,"15min":0.81499999999999995},"min":{"1min":0.57299999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98099999999999998,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.82999999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78400000000000003,"15min":0.82499999999999996},"min":{"1min":0.51700000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0580000000000001,"5min":1.28,"15min":1.28},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.753,"15min":0.79500000000000004},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0820000000000001,"5min":1.0940000000000001,"15min":1.1930000000000001},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:22:29.876 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-25T04:22:30.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.049+0000 7f02d4219640 1 Processor -- start 2023-08-25T04:22:30.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.049+0000 7f02d4219640 1 -- start start 2023-08-25T04:22:30.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.053+0000 7f02d4219640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02cc0cdfa0 0x7f02cc06d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:30.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.053+0000 7f02d4219640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02cc0ce380 0x7f02cc15c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:30.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.053+0000 7f02d4219640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02cc06d820 con 0x7f02cc0ce800 2023-08-25T04:22:30.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.053+0000 7f02d4219640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02cc06db00 con 0x7f02cc0ce380 2023-08-25T04:22:30.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.053+0000 7f02d4219640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc06dde0 con 0x7f02cc0cdfa0 2023-08-25T04:22:30.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.053+0000 7f02d17b4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02cc0ce380 0x7f02cc15c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:30.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.053+0000 7f02d17b4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02cc0ce380 0x7f02cc15c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54426/0 (socket says 172.21.15.55:54426) 2023-08-25T04:22:30.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.053+0000 7f02d17b4640 1 -- 172.21.15.55:0/332425493 learned_addr learned my addr 172.21.15.55:0/332425493 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:30.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.053+0000 7f02d1fb5640 1 --2- 172.21.15.55:0/332425493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02cc0cdfa0 0x7f02cc06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:30.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.053+0000 7f02d17b4640 1 -- 172.21.15.55:0/332425493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02cc0cdfa0 msgr2=0x7f02cc06d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:30.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.053+0000 7f02d17b4640 1 --2- 172.21.15.55:0/332425493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02cc0cdfa0 0x7f02cc06d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.053+0000 7f02d17b4640 1 -- 172.21.15.55:0/332425493 >> v1:172.21.15.55:6789/0 conn(0x7f02cc0ce800 legacy=0x7f02cc152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:30.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.053+0000 7f02d17b4640 1 -- 172.21.15.55:0/332425493 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc06e0c0 con 0x7f02cc0ce380 2023-08-25T04:22:30.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.057+0000 7f02d17b4640 1 --2- 172.21.15.55:0/332425493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0ce380 0x7f02cc15c7b0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009870 tx=0x7f02bc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c5f1563dba7660 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:30.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.057+0000 7f02d0fb3640 1 -- 172.21.15.55:0/332425493 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc0ac600 con 0x7f02cc0ce380 2023-08-25T04:22:30.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.057+0000 7f02d0fb3640 1 -- 172.21.15.55:0/332425493 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02bc0a8050 con 0x7f02cc0ce380 2023-08-25T04:22:30.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.057+0000 7f02d0fb3640 1 -- 172.21.15.55:0/332425493 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc0ac980 con 0x7f02cc0ce380 2023-08-25T04:22:30.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.057+0000 7f02d4219640 1 -- 172.21.15.55:0/332425493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0ce380 msgr2=0x7f02cc15c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:30.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.057+0000 7f02d4219640 1 --2- 172.21.15.55:0/332425493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0ce380 0x7f02cc15c7b0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009870 tx=0x7f02bc01c510 comp rx=0 tx=0).stop 2023-08-25T04:22:30.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.057+0000 7f02d4219640 1 -- 172.21.15.55:0/332425493 shutdown_connections 2023-08-25T04:22:30.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.057+0000 7f02d4219640 1 --2- 172.21.15.55:0/332425493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0ce380 0x7f02cc15c7b0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.057+0000 7f02d4219640 1 --2- 172.21.15.55:0/332425493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02cc0cdfa0 0x7f02cc06d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.057+0000 7f02d4219640 1 -- 172.21.15.55:0/332425493 >> 172.21.15.55:0/332425493 conn(0x7f02cc0cb6f0 msgr2=0x7f02cc0cbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:30.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.057+0000 7f02d4219640 1 -- 172.21.15.55:0/332425493 shutdown_connections 2023-08-25T04:22:30.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.057+0000 7f02d4219640 1 -- 172.21.15.55:0/332425493 wait complete. 2023-08-25T04:22:30.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.057+0000 7f02d4219640 1 Processor -- start 2023-08-25T04:22:30.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.057+0000 7f02d4219640 1 -- start start 2023-08-25T04:22:30.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d4219640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02cc0cdfa0 0x7f02cc0c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:30.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d4219640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02cc0ce380 0x7f02cc1562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:30.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d4219640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0ce800 0x7f02cc0c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:30.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d4219640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc0c4890 con 0x7f02cc0ce800 2023-08-25T04:22:30.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d4219640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc0c3c80 con 0x7f02cc0cdfa0 2023-08-25T04:22:30.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d4219640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc0c3f60 con 0x7f02cc0ce380 2023-08-25T04:22:30.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d27b6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0ce800 0x7f02cc0c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:30.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d27b6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0ce800 0x7f02cc0c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54442/0 (socket says 172.21.15.55:54442) 2023-08-25T04:22:30.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d27b6640 1 -- 172.21.15.55:0/976826990 learned_addr learned my addr 172.21.15.55:0/976826990 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:30.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d17b4640 1 --2- 172.21.15.55:0/976826990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02cc0ce380 0x7f02cc1562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:30.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d1fb5640 1 --2- 172.21.15.55:0/976826990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02cc0cdfa0 0x7f02cc0c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:30.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d27b6640 1 -- 172.21.15.55:0/976826990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02cc0ce380 msgr2=0x7f02cc1562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:30.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d27b6640 1 --2- 172.21.15.55:0/976826990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02cc0ce380 0x7f02cc1562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d27b6640 1 -- 172.21.15.55:0/976826990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02cc0cdfa0 msgr2=0x7f02cc0c4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:30.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d27b6640 1 --2- 172.21.15.55:0/976826990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02cc0cdfa0 0x7f02cc0c4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d27b6640 1 -- 172.21.15.55:0/976826990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc0094d0 con 0x7f02cc0ce800 2023-08-25T04:22:30.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d27b6640 1 --2- 172.21.15.55:0/976826990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0ce800 0x7f02cc0c7390 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f02c400c730 tx=0x7f02c400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:30.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02c27fc640 1 -- 172.21.15.55:0/976826990 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4003b80 con 0x7f02cc0ce800 2023-08-25T04:22:30.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02c27fc640 1 -- 172.21.15.55:0/976826990 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c4003ce0 con 0x7f02cc0ce800 2023-08-25T04:22:30.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d4219640 1 -- 172.21.15.55:0/976826990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02cc0c4240 con 0x7f02cc0ce800 2023-08-25T04:22:30.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02c27fc640 1 -- 172.21.15.55:0/976826990 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c400aa30 con 0x7f02cc0ce800 2023-08-25T04:22:30.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d4219640 1 -- 172.21.15.55:0/976826990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02cc0c5260 con 0x7f02cc0ce800 2023-08-25T04:22:30.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02d4219640 1 -- 172.21.15.55:0/976826990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02cc0c4a00 con 0x7f02cc0ce800 2023-08-25T04:22:30.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.061+0000 7f02c27fc640 1 -- 172.21.15.55:0/976826990 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f02c400ab90 con 0x7f02cc0ce800 2023-08-25T04:22:30.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.065+0000 7f02c27fc640 1 --2- 172.21.15.55:0/976826990 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f02b00657a0 0x7f02b0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:30.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.065+0000 7f02c27fc640 1 -- 172.21.15.55:0/976826990 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f02c4082c00 con 0x7f02cc0ce800 2023-08-25T04:22:30.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.065+0000 7f02d1fb5640 1 --2- 172.21.15.55:0/976826990 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f02b00657a0 0x7f02b0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:30.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.065+0000 7f02d1fb5640 1 --2- 172.21.15.55:0/976826990 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f02b00657a0 0x7f02b0067c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f02cc152f40 tx=0x7f02c8008040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:30.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.069+0000 7f02c27fc640 1 -- 172.21.15.55:0/976826990 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f02c4089080 con 0x7f02cc0ce800 2023-08-25T04:22:30.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.281+0000 7f02d4219640 1 -- 172.21.15.55:0/976826990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f02cc04dbe0 con 0x7f02cc0ce800 2023-08-25T04:22:30.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.281+0000 7f02c27fc640 1 -- 172.21.15.55:0/976826990 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3212 (secure 0 0 0) 0x7f02c4050660 con 0x7f02cc0ce800 2023-08-25T04:22:30.283 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:30.284 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1194,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":136,"num_osds":8,"num_up_osds":8,"osd_up_since":1692936167,"num_in_osds":8,"osd_in_since":1692936158,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592778,"bytes_used":355393536,"bytes_avail":772738719744,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":66,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":9024}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2023-08-25T04:22:11.645174+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-25T04:22:30.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.285+0000 7f02d4219640 1 -- 172.21.15.55:0/976826990 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f02b00657a0 msgr2=0x7f02b0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.285+0000 7f02d4219640 1 --2- 172.21.15.55:0/976826990 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f02b00657a0 0x7f02b0067c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f02cc152f40 tx=0x7f02c8008040 comp rx=0 tx=0).stop 2023-08-25T04:22:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.285+0000 7f02d4219640 1 -- 172.21.15.55:0/976826990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0ce800 msgr2=0x7f02cc0c7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.285+0000 7f02d4219640 1 --2- 172.21.15.55:0/976826990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0ce800 0x7f02cc0c7390 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f02c400c730 tx=0x7f02c400cbf0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.285+0000 7f02d4219640 1 -- 172.21.15.55:0/976826990 shutdown_connections 2023-08-25T04:22:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.285+0000 7f02d4219640 1 --2- 172.21.15.55:0/976826990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02cc0ce800 0x7f02cc0c7390 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.285+0000 7f02d4219640 1 --2- 172.21.15.55:0/976826990 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f02b00657a0 0x7f02b0067c60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.285+0000 7f02d4219640 1 --2- 172.21.15.55:0/976826990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02cc0ce380 0x7f02cc1562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.285+0000 7f02d4219640 1 --2- 172.21.15.55:0/976826990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02cc0cdfa0 0x7f02cc0c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.285+0000 7f02d4219640 1 -- 172.21.15.55:0/976826990 >> 172.21.15.55:0/976826990 conn(0x7f02cc0cb6f0 msgr2=0x7f02cc158610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.285+0000 7f02d4219640 1 -- 172.21.15.55:0/976826990 shutdown_connections 2023-08-25T04:22:30.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.285+0000 7f02d4219640 1 -- 172.21.15.55:0/976826990 wait complete. 2023-08-25T04:22:30.304 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-25T04:22:30.305 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:22:30.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d45eac640 1 Processor -- start 2023-08-25T04:22:30.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d45eac640 1 -- start start 2023-08-25T04:22:30.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d45eac640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2d400cdde0 0x7f2d400ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:30.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d45eac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d400b29b0 con 0x7f2d400d0da0 2023-08-25T04:22:30.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d45eac640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d400b1dc0 con 0x7f2d400b2e40 2023-08-25T04:22:30.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d45eac640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d400ce760 con 0x7f2d400cdde0 2023-08-25T04:22:30.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2d400d0da0 0x7f2d400d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40106/0 (socket says 172.21.15.55:40106) 2023-08-25T04:22:30.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3f7fe640 1 -- 172.21.15.55:0/794132031 learned_addr learned my addr 172.21.15.55:0/794132031 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:30.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3effd640 1 -- 172.21.15.55:0/794132031 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755074728 0 0) 0x7f2d400b29b0 con 0x7f2d400d0da0 2023-08-25T04:22:30.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3effd640 1 -- 172.21.15.55:0/794132031 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d2c003530 con 0x7f2d400d0da0 2023-08-25T04:22:30.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d37fff640 1 --2- 172.21.15.55:0/794132031 >> v2:172.21.15.110:3300/0 conn(0x7f2d400cdde0 0x7f2d400ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:30.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3effd640 1 -- 172.21.15.55:0/794132031 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2604705464 0 0) 0x7f2d2c003530 con 0x7f2d400d0da0 2023-08-25T04:22:30.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3effd640 1 -- 172.21.15.55:0/794132031 >> v2:172.21.15.110:3300/0 conn(0x7f2d400cdde0 msgr2=0x7f2d400ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:30.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3effd640 1 --2- 172.21.15.55:0/794132031 >> v2:172.21.15.110:3300/0 conn(0x7f2d400cdde0 0x7f2d400ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3effd640 1 -- 172.21.15.55:0/794132031 >> v1:172.21.15.110:6789/0 conn(0x7f2d400b2e40 legacy=0x7f2d400b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:30.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3effd640 1 -- 172.21.15.55:0/794132031 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d400b2080 con 0x7f2d400d0da0 2023-08-25T04:22:30.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3effd640 1 -- 172.21.15.55:0/794132031 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f2d30001800 con 0x7f2d400d0da0 2023-08-25T04:22:30.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d37fff640 1 --2- 172.21.15.55:0/794132031 >> v2:172.21.15.110:3300/0 conn(0x7f2d400cdde0 0x7f2d400ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:30.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3effd640 1 -- 172.21.15.55:0/794132031 >> v1:172.21.15.55:6789/0 conn(0x7f2d400d0da0 legacy=0x7f2d400d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:30.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3effd640 1 --2- 172.21.15.55:0/794132031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d2c003980 0x7f2d2c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:30.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3effd640 1 --2- 172.21.15.55:0/794132031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c0047d0 0x7f2d2c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:30.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3effd640 1 --2- 172.21.15.55:0/794132031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d2c005190 0x7f2d2c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:30.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3effd640 1 -- 172.21.15.55:0/794132031 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d400ce760 con 0x7f2d2c0047d0 2023-08-25T04:22:30.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3effd640 1 -- 172.21.15.55:0/794132031 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c00c0c0 con 0x7f2d2c005190 2023-08-25T04:22:30.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3effd640 1 -- 172.21.15.55:0/794132031 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c00c280 con 0x7f2d2c003980 2023-08-25T04:22:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d37fff640 1 --2- 172.21.15.55:0/794132031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c0047d0 0x7f2d2c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3f7fe640 1 --2- 172.21.15.55:0/794132031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d2c003980 0x7f2d2c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d3ffff640 1 --2- 172.21.15.55:0/794132031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d2c005190 0x7f2d2c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:30.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d37fff640 1 -- 172.21.15.55:0/794132031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d2c003980 msgr2=0x7f2d2c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:30.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d37fff640 1 --2- 172.21.15.55:0/794132031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d2c003980 0x7f2d2c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d37fff640 1 -- 172.21.15.55:0/794132031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d2c005190 msgr2=0x7f2d2c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:30.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d37fff640 1 --2- 172.21.15.55:0/794132031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d2c005190 0x7f2d2c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.449+0000 7f2d37fff640 1 -- 172.21.15.55:0/794132031 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c003530 con 0x7f2d2c0047d0 2023-08-25T04:22:30.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.453+0000 7f2d3ffff640 1 -- 172.21.15.55:0/794132031 reap_dead start 2023-08-25T04:22:30.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.453+0000 7f2d37fff640 1 --2- 172.21.15.55:0/794132031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c0047d0 0x7f2d2c004c50 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f2d280098d0 tx=0x7f2d2801c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1e6046c20e421f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:30.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.453+0000 7f2d3effd640 1 -- 172.21.15.55:0/794132031 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280a8620 con 0x7f2d2c0047d0 2023-08-25T04:22:30.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.453+0000 7f2d3effd640 1 -- 172.21.15.55:0/794132031 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d280a8780 con 0x7f2d2c0047d0 2023-08-25T04:22:30.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.453+0000 7f2d3effd640 1 -- 172.21.15.55:0/794132031 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d280a8af0 con 0x7f2d2c0047d0 2023-08-25T04:22:30.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.453+0000 7f2d45eac640 1 -- 172.21.15.55:0/794132031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c0047d0 msgr2=0x7f2d2c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:30.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.453+0000 7f2d45eac640 1 --2- 172.21.15.55:0/794132031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c0047d0 0x7f2d2c004c50 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f2d280098d0 tx=0x7f2d2801c5b0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.453+0000 7f2d45eac640 1 -- 172.21.15.55:0/794132031 shutdown_connections 2023-08-25T04:22:30.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.453+0000 7f2d45eac640 1 --2- 172.21.15.55:0/794132031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c0047d0 0x7f2d2c004c50 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.453+0000 7f2d45eac640 1 -- 172.21.15.55:0/794132031 >> 172.21.15.55:0/794132031 conn(0x7f2d4009bae0 msgr2=0x7f2d400d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:30.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.453+0000 7f2d45eac640 1 -- 172.21.15.55:0/794132031 shutdown_connections 2023-08-25T04:22:30.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.453+0000 7f2d45eac640 1 -- 172.21.15.55:0/794132031 wait complete. 2023-08-25T04:22:30.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d45eac640 1 Processor -- start 2023-08-25T04:22:30.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d45eac640 1 -- start start 2023-08-25T04:22:30.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d45eac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c0047d0 0x7f2d40156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:30.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d45eac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d400c8120 0x7f2d400c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:30.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d45eac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d400afd90 0x7f2d400c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:30.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d45eac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d40156550 con 0x7f2d2c0047d0 2023-08-25T04:22:30.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d45eac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d400b02c0 con 0x7f2d400c8120 2023-08-25T04:22:30.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d45eac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d400b05a0 con 0x7f2d400afd90 2023-08-25T04:22:30.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d3f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c0047d0 0x7f2d40156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:30.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d37fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d400c8120 0x7f2d400c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:30.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d3f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c0047d0 0x7f2d40156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54448/0 (socket says 172.21.15.55:54448) 2023-08-25T04:22:30.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d3f7fe640 1 -- 172.21.15.55:0/2992616812 learned_addr learned my addr 172.21.15.55:0/2992616812 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:30.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d3ffff640 1 --2- 172.21.15.55:0/2992616812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d400afd90 0x7f2d400c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:30.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d37fff640 1 -- 172.21.15.55:0/2992616812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d400afd90 msgr2=0x7f2d400c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:30.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d37fff640 1 --2- 172.21.15.55:0/2992616812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d400afd90 0x7f2d400c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d37fff640 1 -- 172.21.15.55:0/2992616812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c0047d0 msgr2=0x7f2d40156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:30.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d37fff640 1 --2- 172.21.15.55:0/2992616812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c0047d0 0x7f2d40156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d37fff640 1 -- 172.21.15.55:0/2992616812 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d400b0880 con 0x7f2d400c8120 2023-08-25T04:22:30.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d3f7fe640 1 --2- 172.21.15.55:0/2992616812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c0047d0 0x7f2d40156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:22:30.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.457+0000 7f2d37fff640 1 --2- 172.21.15.55:0/2992616812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d400c8120 0x7f2d400c8550 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00c090 tx=0x7f2d2c005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:30.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.461+0000 7f2d3cff9640 1 -- 172.21.15.55:0/2992616812 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28004220 con 0x7f2d400c8120 2023-08-25T04:22:30.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.461+0000 7f2d3cff9640 1 -- 172.21.15.55:0/2992616812 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d28004380 con 0x7f2d400c8120 2023-08-25T04:22:30.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.461+0000 7f2d45eac640 1 -- 172.21.15.55:0/2992616812 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d400b0b60 con 0x7f2d400c8120 2023-08-25T04:22:30.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.461+0000 7f2d3cff9640 1 -- 172.21.15.55:0/2992616812 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28003860 con 0x7f2d400c8120 2023-08-25T04:22:30.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.461+0000 7f2d45eac640 1 -- 172.21.15.55:0/2992616812 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d400b4720 con 0x7f2d400c8120 2023-08-25T04:22:30.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.461+0000 7f2d45eac640 1 -- 172.21.15.55:0/2992616812 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d400b02c0 con 0x7f2d400c8120 2023-08-25T04:22:30.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.461+0000 7f2d3cff9640 1 -- 172.21.15.55:0/2992616812 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f2d280059a0 con 0x7f2d400c8120 2023-08-25T04:22:30.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.461+0000 7f2d3cff9640 1 --2- 172.21.15.55:0/2992616812 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f2d200657d0 0x7f2d20067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:30.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.461+0000 7f2d3cff9640 1 -- 172.21.15.55:0/2992616812 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d2811d4f0 con 0x7f2d400c8120 2023-08-25T04:22:30.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.461+0000 7f2d3f7fe640 1 --2- 172.21.15.55:0/2992616812 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f2d200657d0 0x7f2d20067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:30.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.465+0000 7f2d3f7fe640 1 --2- 172.21.15.55:0/2992616812 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f2d200657d0 0x7f2d20067c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d30000c10 tx=0x7f2d30009040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:30.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.465+0000 7f2d3cff9640 1 -- 172.21.15.55:0/2992616812 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2d280eae90 con 0x7f2d400c8120 2023-08-25T04:22:30.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.621+0000 7f2d45eac640 1 -- 172.21.15.55:0/2992616812 --> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d400b2640 con 0x7f2d200657d0 2023-08-25T04:22:30.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.629+0000 7f2d3cff9640 1 -- 172.21.15.55:0/2992616812 <== mgr.7301 v2:172.21.15.110:6832/3700713436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311748 (secure 0 0 0) 0x7f2d30011ce0 con 0x7f2d200657d0 2023-08-25T04:22:30.631 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:30.632 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:22:30.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.633+0000 7f2d45eac640 1 -- 172.21.15.55:0/2992616812 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f2d200657d0 msgr2=0x7f2d20067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:30.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.633+0000 7f2d45eac640 1 --2- 172.21.15.55:0/2992616812 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f2d200657d0 0x7f2d20067c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d30000c10 tx=0x7f2d30009040 comp rx=0 tx=0).stop 2023-08-25T04:22:30.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.633+0000 7f2d45eac640 1 -- 172.21.15.55:0/2992616812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d400c8120 msgr2=0x7f2d400c8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:30.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.633+0000 7f2d45eac640 1 --2- 172.21.15.55:0/2992616812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d400c8120 0x7f2d400c8550 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00c090 tx=0x7f2d2c005800 comp rx=0 tx=0).stop 2023-08-25T04:22:30.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.633+0000 7f2d45eac640 1 -- 172.21.15.55:0/2992616812 shutdown_connections 2023-08-25T04:22:30.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.633+0000 7f2d45eac640 1 --2- 172.21.15.55:0/2992616812 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f2d200657d0 0x7f2d20067c90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.633+0000 7f2d45eac640 1 --2- 172.21.15.55:0/2992616812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d400afd90 0x7f2d400c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.633+0000 7f2d45eac640 1 --2- 172.21.15.55:0/2992616812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d400c8120 0x7f2d400c8550 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.633+0000 7f2d45eac640 1 --2- 172.21.15.55:0/2992616812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d2c0047d0 0x7f2d40156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:30.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.633+0000 7f2d45eac640 1 -- 172.21.15.55:0/2992616812 >> 172.21.15.55:0/2992616812 conn(0x7f2d4009bae0 msgr2=0x7f2d4015c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:30.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.633+0000 7f2d45eac640 1 -- 172.21.15.55:0/2992616812 shutdown_connections 2023-08-25T04:22:30.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:30.633+0000 7f2d45eac640 1 -- 172.21.15.55:0/2992616812 wait complete. 2023-08-25T04:22:30.651 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-25T04:22:29.649564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1232,"num_read_kb":2549,"num_write":429,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3592,"ondisk_log_size":3592,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":200,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":347064,"kb_used_data":14344,"kb_used_omap":13,"kb_used_meta":332594,"kb_avail":754627656,"statfs":{"total":773094113280,"available":772738719744,"internally_reserved":0,"allocated":14688256,"data_stored":7905020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":340576344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001582"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964341+0000","last_change":"2023-08-25T04:22:24.980160+0000","last_active":"2023-08-25T04:22:25.964341+0000","last_peered":"2023-08-25T04:22:25.964341+0000","last_clean":"2023-08-25T04:22:25.964341+0000","last_became_active":"2023-08-25T04:22:24.979819+0000","last_became_peered":"2023-08-25T04:22:24.979819+0000","last_unstale":"2023-08-25T04:22:25.964341+0000","last_undegraded":"2023-08-25T04:22:25.964341+0000","last_fullsized":"2023-08-25T04:22:25.964341+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:54:24.855039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205880+0000","last_change":"2023-08-25T04:22:24.984110+0000","last_active":"2023-08-25T04:22:26.205880+0000","last_peered":"2023-08-25T04:22:26.205880+0000","last_clean":"2023-08-25T04:22:26.205880+0000","last_became_active":"2023-08-25T04:22:24.983833+0000","last_became_peered":"2023-08-25T04:22:24.983833+0000","last_unstale":"2023-08-25T04:22:26.205880+0000","last_undegraded":"2023-08-25T04:22:26.205880+0000","last_fullsized":"2023-08-25T04:22:26.205880+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:19.130375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206678+0000","last_change":"2023-08-25T04:22:24.980242+0000","last_active":"2023-08-25T04:22:26.206678+0000","last_peered":"2023-08-25T04:22:26.206678+0000","last_clean":"2023-08-25T04:22:26.206678+0000","last_became_active":"2023-08-25T04:22:24.979947+0000","last_became_peered":"2023-08-25T04:22:24.979947+0000","last_unstale":"2023-08-25T04:22:26.206678+0000","last_undegraded":"2023-08-25T04:22:26.206678+0000","last_fullsized":"2023-08-25T04:22:26.206678+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:35:58.759682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204756+0000","last_change":"2023-08-25T04:22:24.967850+0000","last_active":"2023-08-25T04:22:26.204756+0000","last_peered":"2023-08-25T04:22:26.204756+0000","last_clean":"2023-08-25T04:22:26.204756+0000","last_became_active":"2023-08-25T04:22:24.967464+0000","last_became_peered":"2023-08-25T04:22:24.967464+0000","last_unstale":"2023-08-25T04:22:26.204756+0000","last_undegraded":"2023-08-25T04:22:26.204756+0000","last_fullsized":"2023-08-25T04:22:26.204756+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:15:05.316894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964504+0000","last_change":"2023-08-25T04:22:24.974055+0000","last_active":"2023-08-25T04:22:25.964504+0000","last_peered":"2023-08-25T04:22:25.964504+0000","last_clean":"2023-08-25T04:22:25.964504+0000","last_became_active":"2023-08-25T04:22:24.973743+0000","last_became_peered":"2023-08-25T04:22:24.973743+0000","last_unstale":"2023-08-25T04:22:25.964504+0000","last_undegraded":"2023-08-25T04:22:25.964504+0000","last_fullsized":"2023-08-25T04:22:25.964504+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:11:27.537860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205716+0000","last_change":"2023-08-25T04:22:25.003305+0000","last_active":"2023-08-25T04:22:26.205716+0000","last_peered":"2023-08-25T04:22:26.205716+0000","last_clean":"2023-08-25T04:22:26.205716+0000","last_became_active":"2023-08-25T04:22:25.003004+0000","last_became_peered":"2023-08-25T04:22:25.003004+0000","last_unstale":"2023-08-25T04:22:26.205716+0000","last_undegraded":"2023-08-25T04:22:26.205716+0000","last_fullsized":"2023-08-25T04:22:26.205716+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:51:25.392772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205489+0000","last_change":"2023-08-25T04:22:24.989495+0000","last_active":"2023-08-25T04:22:26.205489+0000","last_peered":"2023-08-25T04:22:26.205489+0000","last_clean":"2023-08-25T04:22:26.205489+0000","last_became_active":"2023-08-25T04:22:24.989203+0000","last_became_peered":"2023-08-25T04:22:24.989203+0000","last_unstale":"2023-08-25T04:22:26.205489+0000","last_undegraded":"2023-08-25T04:22:26.205489+0000","last_fullsized":"2023-08-25T04:22:26.205489+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:40.390488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205615+0000","last_change":"2023-08-25T04:22:24.979108+0000","last_active":"2023-08-25T04:22:26.205615+0000","last_peered":"2023-08-25T04:22:26.205615+0000","last_clean":"2023-08-25T04:22:26.205615+0000","last_became_active":"2023-08-25T04:22:24.978466+0000","last_became_peered":"2023-08-25T04:22:24.978466+0000","last_unstale":"2023-08-25T04:22:26.205615+0000","last_undegraded":"2023-08-25T04:22:26.205615+0000","last_fullsized":"2023-08-25T04:22:26.205615+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:31.333780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204900+0000","last_change":"2023-08-25T04:22:24.971968+0000","last_active":"2023-08-25T04:22:26.204900+0000","last_peered":"2023-08-25T04:22:26.204900+0000","last_clean":"2023-08-25T04:22:26.204900+0000","last_became_active":"2023-08-25T04:22:24.971520+0000","last_became_peered":"2023-08-25T04:22:24.971520+0000","last_unstale":"2023-08-25T04:22:26.204900+0000","last_undegraded":"2023-08-25T04:22:26.204900+0000","last_fullsized":"2023-08-25T04:22:26.204900+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:40.767462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964324+0000","last_change":"2023-08-25T04:22:24.992802+0000","last_active":"2023-08-25T04:22:25.964324+0000","last_peered":"2023-08-25T04:22:25.964324+0000","last_clean":"2023-08-25T04:22:25.964324+0000","last_became_active":"2023-08-25T04:22:24.992482+0000","last_became_peered":"2023-08-25T04:22:24.992482+0000","last_unstale":"2023-08-25T04:22:25.964324+0000","last_undegraded":"2023-08-25T04:22:25.964324+0000","last_fullsized":"2023-08-25T04:22:25.964324+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:47:02.262159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964006+0000","last_change":"2023-08-25T04:22:24.984162+0000","last_active":"2023-08-25T04:22:25.964006+0000","last_peered":"2023-08-25T04:22:25.964006+0000","last_clean":"2023-08-25T04:22:25.964006+0000","last_became_active":"2023-08-25T04:22:24.983860+0000","last_became_peered":"2023-08-25T04:22:24.983860+0000","last_unstale":"2023-08-25T04:22:25.964006+0000","last_undegraded":"2023-08-25T04:22:25.964006+0000","last_fullsized":"2023-08-25T04:22:25.964006+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:52:46.328332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206070+0000","last_change":"2023-08-25T04:22:24.994560+0000","last_active":"2023-08-25T04:22:26.206070+0000","last_peered":"2023-08-25T04:22:26.206070+0000","last_clean":"2023-08-25T04:22:26.206070+0000","last_became_active":"2023-08-25T04:22:24.991957+0000","last_became_peered":"2023-08-25T04:22:24.991957+0000","last_unstale":"2023-08-25T04:22:26.206070+0000","last_undegraded":"2023-08-25T04:22:26.206070+0000","last_fullsized":"2023-08-25T04:22:26.206070+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:39:01.013890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964164+0000","last_change":"2023-08-25T04:22:24.989968+0000","last_active":"2023-08-25T04:22:25.964164+0000","last_peered":"2023-08-25T04:22:25.964164+0000","last_clean":"2023-08-25T04:22:25.964164+0000","last_became_active":"2023-08-25T04:22:24.989686+0000","last_became_peered":"2023-08-25T04:22:24.989686+0000","last_unstale":"2023-08-25T04:22:25.964164+0000","last_undegraded":"2023-08-25T04:22:25.964164+0000","last_fullsized":"2023-08-25T04:22:25.964164+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:19:35.918305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206776+0000","last_change":"2023-08-25T04:22:24.987770+0000","last_active":"2023-08-25T04:22:26.206776+0000","last_peered":"2023-08-25T04:22:26.206776+0000","last_clean":"2023-08-25T04:22:26.206776+0000","last_became_active":"2023-08-25T04:22:24.980118+0000","last_became_peered":"2023-08-25T04:22:24.980118+0000","last_unstale":"2023-08-25T04:22:26.206776+0000","last_undegraded":"2023-08-25T04:22:26.206776+0000","last_fullsized":"2023-08-25T04:22:26.206776+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:47:48.315800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.963965+0000","last_change":"2023-08-25T04:22:24.986598+0000","last_active":"2023-08-25T04:22:25.963965+0000","last_peered":"2023-08-25T04:22:25.963965+0000","last_clean":"2023-08-25T04:22:25.963965+0000","last_became_active":"2023-08-25T04:22:24.986222+0000","last_became_peered":"2023-08-25T04:22:24.986222+0000","last_unstale":"2023-08-25T04:22:25.963965+0000","last_undegraded":"2023-08-25T04:22:25.963965+0000","last_fullsized":"2023-08-25T04:22:25.963965+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:20:05.410997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206217+0000","last_change":"2023-08-25T04:22:24.997307+0000","last_active":"2023-08-25T04:22:26.206217+0000","last_peered":"2023-08-25T04:22:26.206217+0000","last_clean":"2023-08-25T04:22:26.206217+0000","last_became_active":"2023-08-25T04:22:24.997034+0000","last_became_peered":"2023-08-25T04:22:24.997034+0000","last_unstale":"2023-08-25T04:22:26.206217+0000","last_undegraded":"2023-08-25T04:22:26.206217+0000","last_fullsized":"2023-08-25T04:22:26.206217+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:30.167507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964468+0000","last_change":"2023-08-25T04:22:24.994912+0000","last_active":"2023-08-25T04:22:25.964468+0000","last_peered":"2023-08-25T04:22:25.964468+0000","last_clean":"2023-08-25T04:22:25.964468+0000","last_became_active":"2023-08-25T04:22:24.994634+0000","last_became_peered":"2023-08-25T04:22:24.994634+0000","last_unstale":"2023-08-25T04:22:25.964468+0000","last_undegraded":"2023-08-25T04:22:25.964468+0000","last_fullsized":"2023-08-25T04:22:25.964468+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:35:18.722412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206017+0000","last_change":"2023-08-25T04:22:24.985919+0000","last_active":"2023-08-25T04:22:26.206017+0000","last_peered":"2023-08-25T04:22:26.206017+0000","last_clean":"2023-08-25T04:22:26.206017+0000","last_became_active":"2023-08-25T04:22:24.985596+0000","last_became_peered":"2023-08-25T04:22:24.985596+0000","last_unstale":"2023-08-25T04:22:26.206017+0000","last_undegraded":"2023-08-25T04:22:26.206017+0000","last_fullsized":"2023-08-25T04:22:26.206017+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:54.188602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964341+0000","last_change":"2023-08-25T04:22:24.976285+0000","last_active":"2023-08-25T04:22:25.964341+0000","last_peered":"2023-08-25T04:22:25.964341+0000","last_clean":"2023-08-25T04:22:25.964341+0000","last_became_active":"2023-08-25T04:22:24.975957+0000","last_became_peered":"2023-08-25T04:22:24.975957+0000","last_unstale":"2023-08-25T04:22:25.964341+0000","last_undegraded":"2023-08-25T04:22:25.964341+0000","last_fullsized":"2023-08-25T04:22:25.964341+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:32.308329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205321+0000","last_change":"2023-08-25T04:22:24.997826+0000","last_active":"2023-08-25T04:22:26.205321+0000","last_peered":"2023-08-25T04:22:26.205321+0000","last_clean":"2023-08-25T04:22:26.205321+0000","last_became_active":"2023-08-25T04:22:24.997523+0000","last_became_peered":"2023-08-25T04:22:24.997523+0000","last_unstale":"2023-08-25T04:22:26.205321+0000","last_undegraded":"2023-08-25T04:22:26.205321+0000","last_fullsized":"2023-08-25T04:22:26.205321+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:49.402784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204493+0000","last_change":"2023-08-25T04:22:24.986733+0000","last_active":"2023-08-25T04:22:26.204493+0000","last_peered":"2023-08-25T04:22:26.204493+0000","last_clean":"2023-08-25T04:22:26.204493+0000","last_became_active":"2023-08-25T04:22:24.986451+0000","last_became_peered":"2023-08-25T04:22:24.986451+0000","last_unstale":"2023-08-25T04:22:26.204493+0000","last_undegraded":"2023-08-25T04:22:26.204493+0000","last_fullsized":"2023-08-25T04:22:26.204493+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:34.985760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964257+0000","last_change":"2023-08-25T04:22:24.974093+0000","last_active":"2023-08-25T04:22:25.964257+0000","last_peered":"2023-08-25T04:22:25.964257+0000","last_clean":"2023-08-25T04:22:25.964257+0000","last_became_active":"2023-08-25T04:22:24.973777+0000","last_became_peered":"2023-08-25T04:22:24.973777+0000","last_unstale":"2023-08-25T04:22:25.964257+0000","last_undegraded":"2023-08-25T04:22:25.964257+0000","last_fullsized":"2023-08-25T04:22:25.964257+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:03.889864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204118+0000","last_change":"2023-08-25T04:22:24.971791+0000","last_active":"2023-08-25T04:22:26.204118+0000","last_peered":"2023-08-25T04:22:26.204118+0000","last_clean":"2023-08-25T04:22:26.204118+0000","last_became_active":"2023-08-25T04:22:24.971512+0000","last_became_peered":"2023-08-25T04:22:24.971512+0000","last_unstale":"2023-08-25T04:22:26.204118+0000","last_undegraded":"2023-08-25T04:22:26.204118+0000","last_fullsized":"2023-08-25T04:22:26.204118+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:55.716380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204451+0000","last_change":"2023-08-25T04:22:24.984931+0000","last_active":"2023-08-25T04:22:26.204451+0000","last_peered":"2023-08-25T04:22:26.204451+0000","last_clean":"2023-08-25T04:22:26.204451+0000","last_became_active":"2023-08-25T04:22:24.983776+0000","last_became_peered":"2023-08-25T04:22:24.983776+0000","last_unstale":"2023-08-25T04:22:26.204451+0000","last_undegraded":"2023-08-25T04:22:26.204451+0000","last_fullsized":"2023-08-25T04:22:26.204451+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:45.770499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205203+0000","last_change":"2023-08-25T04:22:24.988545+0000","last_active":"2023-08-25T04:22:26.205203+0000","last_peered":"2023-08-25T04:22:26.205203+0000","last_clean":"2023-08-25T04:22:26.205203+0000","last_became_active":"2023-08-25T04:22:24.987759+0000","last_became_peered":"2023-08-25T04:22:24.987759+0000","last_unstale":"2023-08-25T04:22:26.205203+0000","last_undegraded":"2023-08-25T04:22:26.205203+0000","last_fullsized":"2023-08-25T04:22:26.205203+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:46:11.761122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205641+0000","last_change":"2023-08-25T04:22:24.987279+0000","last_active":"2023-08-25T04:22:26.205641+0000","last_peered":"2023-08-25T04:22:26.205641+0000","last_clean":"2023-08-25T04:22:26.205641+0000","last_became_active":"2023-08-25T04:22:24.986999+0000","last_became_peered":"2023-08-25T04:22:24.986999+0000","last_unstale":"2023-08-25T04:22:26.205641+0000","last_undegraded":"2023-08-25T04:22:26.205641+0000","last_fullsized":"2023-08-25T04:22:26.205641+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:38:02.874638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964476+0000","last_change":"2023-08-25T04:22:24.972732+0000","last_active":"2023-08-25T04:22:25.964476+0000","last_peered":"2023-08-25T04:22:25.964476+0000","last_clean":"2023-08-25T04:22:25.964476+0000","last_became_active":"2023-08-25T04:22:24.972382+0000","last_became_peered":"2023-08-25T04:22:24.972382+0000","last_unstale":"2023-08-25T04:22:25.964476+0000","last_undegraded":"2023-08-25T04:22:25.964476+0000","last_fullsized":"2023-08-25T04:22:25.964476+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:09:19.698330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206133+0000","last_change":"2023-08-25T04:22:24.996718+0000","last_active":"2023-08-25T04:22:26.206133+0000","last_peered":"2023-08-25T04:22:26.206133+0000","last_clean":"2023-08-25T04:22:26.206133+0000","last_became_active":"2023-08-25T04:22:24.996420+0000","last_became_peered":"2023-08-25T04:22:24.996420+0000","last_unstale":"2023-08-25T04:22:26.206133+0000","last_undegraded":"2023-08-25T04:22:26.206133+0000","last_fullsized":"2023-08-25T04:22:26.206133+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:56.492659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205299+0000","last_change":"2023-08-25T04:22:24.999223+0000","last_active":"2023-08-25T04:22:26.205299+0000","last_peered":"2023-08-25T04:22:26.205299+0000","last_clean":"2023-08-25T04:22:26.205299+0000","last_became_active":"2023-08-25T04:22:24.998811+0000","last_became_peered":"2023-08-25T04:22:24.998811+0000","last_unstale":"2023-08-25T04:22:26.205299+0000","last_undegraded":"2023-08-25T04:22:26.205299+0000","last_fullsized":"2023-08-25T04:22:26.205299+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:20:11.946216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206840+0000","last_change":"2023-08-25T04:22:24.977279+0000","last_active":"2023-08-25T04:22:26.206840+0000","last_peered":"2023-08-25T04:22:26.206840+0000","last_clean":"2023-08-25T04:22:26.206840+0000","last_became_active":"2023-08-25T04:22:24.976837+0000","last_became_peered":"2023-08-25T04:22:24.976837+0000","last_unstale":"2023-08-25T04:22:26.206840+0000","last_undegraded":"2023-08-25T04:22:26.206840+0000","last_fullsized":"2023-08-25T04:22:26.206840+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:32.849194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204228+0000","last_change":"2023-08-25T04:22:24.991026+0000","last_active":"2023-08-25T04:22:26.204228+0000","last_peered":"2023-08-25T04:22:26.204228+0000","last_clean":"2023-08-25T04:22:26.204228+0000","last_became_active":"2023-08-25T04:22:24.989826+0000","last_became_peered":"2023-08-25T04:22:24.989826+0000","last_unstale":"2023-08-25T04:22:26.204228+0000","last_undegraded":"2023-08-25T04:22:26.204228+0000","last_fullsized":"2023-08-25T04:22:26.204228+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:48:24.022318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204007+0000","last_change":"2023-08-25T04:22:24.983898+0000","last_active":"2023-08-25T04:22:26.204007+0000","last_peered":"2023-08-25T04:22:26.204007+0000","last_clean":"2023-08-25T04:22:26.204007+0000","last_became_active":"2023-08-25T04:22:24.983418+0000","last_became_peered":"2023-08-25T04:22:24.983418+0000","last_unstale":"2023-08-25T04:22:26.204007+0000","last_undegraded":"2023-08-25T04:22:26.204007+0000","last_fullsized":"2023-08-25T04:22:26.204007+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:50:57.280394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964302+0000","last_change":"2023-08-25T04:22:24.994393+0000","last_active":"2023-08-25T04:22:25.964302+0000","last_peered":"2023-08-25T04:22:25.964302+0000","last_clean":"2023-08-25T04:22:25.964302+0000","last_became_active":"2023-08-25T04:22:24.994120+0000","last_became_peered":"2023-08-25T04:22:24.994120+0000","last_unstale":"2023-08-25T04:22:25.964302+0000","last_undegraded":"2023-08-25T04:22:25.964302+0000","last_fullsized":"2023-08-25T04:22:25.964302+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:19:47.445600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"135'4","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964948+0000","last_change":"2023-08-25T04:22:23.939086+0000","last_active":"2023-08-25T04:22:25.964948+0000","last_peered":"2023-08-25T04:22:25.964948+0000","last_clean":"2023-08-25T04:22:25.964948+0000","last_became_active":"2023-08-25T04:22:23.938752+0000","last_became_peered":"2023-08-25T04:22:23.938752+0000","last_unstale":"2023-08-25T04:22:25.964948+0000","last_undegraded":"2023-08-25T04:22:25.964948+0000","last_fullsized":"2023-08-25T04:22:25.964948+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:02.883614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205864+0000","last_change":"2023-08-25T04:22:25.003212+0000","last_active":"2023-08-25T04:22:26.205864+0000","last_peered":"2023-08-25T04:22:26.205864+0000","last_clean":"2023-08-25T04:22:26.205864+0000","last_became_active":"2023-08-25T04:22:25.002912+0000","last_became_peered":"2023-08-25T04:22:25.002912+0000","last_unstale":"2023-08-25T04:22:26.205864+0000","last_undegraded":"2023-08-25T04:22:26.205864+0000","last_fullsized":"2023-08-25T04:22:26.205864+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:14:30.577755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"135'1","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964441+0000","last_change":"2023-08-25T04:22:23.945578+0000","last_active":"2023-08-25T04:22:25.964441+0000","last_peered":"2023-08-25T04:22:25.964441+0000","last_clean":"2023-08-25T04:22:25.964441+0000","last_became_active":"2023-08-25T04:22:23.943682+0000","last_became_peered":"2023-08-25T04:22:23.943682+0000","last_unstale":"2023-08-25T04:22:25.964441+0000","last_undegraded":"2023-08-25T04:22:25.964441+0000","last_fullsized":"2023-08-25T04:22:25.964441+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:08:27.693453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204753+0000","last_change":"2023-08-25T04:22:24.995628+0000","last_active":"2023-08-25T04:22:26.204753+0000","last_peered":"2023-08-25T04:22:26.204753+0000","last_clean":"2023-08-25T04:22:26.204753+0000","last_became_active":"2023-08-25T04:22:24.995241+0000","last_became_peered":"2023-08-25T04:22:24.995241+0000","last_unstale":"2023-08-25T04:22:26.204753+0000","last_undegraded":"2023-08-25T04:22:26.204753+0000","last_fullsized":"2023-08-25T04:22:26.204753+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:10:47.097275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"135'2","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204909+0000","last_change":"2023-08-25T04:22:23.943083+0000","last_active":"2023-08-25T04:22:26.204909+0000","last_peered":"2023-08-25T04:22:26.204909+0000","last_clean":"2023-08-25T04:22:26.204909+0000","last_became_active":"2023-08-25T04:22:23.942760+0000","last_became_peered":"2023-08-25T04:22:23.942760+0000","last_unstale":"2023-08-25T04:22:26.204909+0000","last_undegraded":"2023-08-25T04:22:26.204909+0000","last_fullsized":"2023-08-25T04:22:26.204909+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:57:55.603209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204374+0000","last_change":"2023-08-25T04:22:24.992702+0000","last_active":"2023-08-25T04:22:26.204374+0000","last_peered":"2023-08-25T04:22:26.204374+0000","last_clean":"2023-08-25T04:22:26.204374+0000","last_became_active":"2023-08-25T04:22:24.992406+0000","last_became_peered":"2023-08-25T04:22:24.992406+0000","last_unstale":"2023-08-25T04:22:26.204374+0000","last_undegraded":"2023-08-25T04:22:26.204374+0000","last_fullsized":"2023-08-25T04:22:26.204374+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:11.448723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"135'2","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964321+0000","last_change":"2023-08-25T04:22:23.936987+0000","last_active":"2023-08-25T04:22:25.964321+0000","last_peered":"2023-08-25T04:22:25.964321+0000","last_clean":"2023-08-25T04:22:25.964321+0000","last_became_active":"2023-08-25T04:22:23.936122+0000","last_became_peered":"2023-08-25T04:22:23.936122+0000","last_unstale":"2023-08-25T04:22:25.964321+0000","last_undegraded":"2023-08-25T04:22:25.964321+0000","last_fullsized":"2023-08-25T04:22:25.964321+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:18:53.632727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.963950+0000","last_change":"2023-08-25T04:22:24.985581+0000","last_active":"2023-08-25T04:22:25.963950+0000","last_peered":"2023-08-25T04:22:25.963950+0000","last_clean":"2023-08-25T04:22:25.963950+0000","last_became_active":"2023-08-25T04:22:24.985265+0000","last_became_peered":"2023-08-25T04:22:24.985265+0000","last_unstale":"2023-08-25T04:22:25.963950+0000","last_undegraded":"2023-08-25T04:22:25.963950+0000","last_fullsized":"2023-08-25T04:22:25.963950+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:51:21.272105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"135'1","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964548+0000","last_change":"2023-08-25T04:22:23.935374+0000","last_active":"2023-08-25T04:22:25.964548+0000","last_peered":"2023-08-25T04:22:25.964548+0000","last_clean":"2023-08-25T04:22:25.964548+0000","last_became_active":"2023-08-25T04:22:23.935042+0000","last_became_peered":"2023-08-25T04:22:23.935042+0000","last_unstale":"2023-08-25T04:22:25.964548+0000","last_undegraded":"2023-08-25T04:22:25.964548+0000","last_fullsized":"2023-08-25T04:22:25.964548+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:46:59.332786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.963948+0000","last_change":"2023-08-25T04:22:24.967494+0000","last_active":"2023-08-25T04:22:25.963948+0000","last_peered":"2023-08-25T04:22:25.963948+0000","last_clean":"2023-08-25T04:22:25.963948+0000","last_became_active":"2023-08-25T04:22:24.967152+0000","last_became_peered":"2023-08-25T04:22:24.967152+0000","last_unstale":"2023-08-25T04:22:25.963948+0000","last_undegraded":"2023-08-25T04:22:25.963948+0000","last_fullsized":"2023-08-25T04:22:25.963948+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:22:15.124047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"135'1","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205756+0000","last_change":"2023-08-25T04:22:23.954752+0000","last_active":"2023-08-25T04:22:26.205756+0000","last_peered":"2023-08-25T04:22:26.205756+0000","last_clean":"2023-08-25T04:22:26.205756+0000","last_became_active":"2023-08-25T04:22:23.954364+0000","last_became_peered":"2023-08-25T04:22:23.954364+0000","last_unstale":"2023-08-25T04:22:26.205756+0000","last_undegraded":"2023-08-25T04:22:26.205756+0000","last_fullsized":"2023-08-25T04:22:26.205756+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:38:10.408336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206897+0000","last_change":"2023-08-25T04:22:24.987561+0000","last_active":"2023-08-25T04:22:26.206897+0000","last_peered":"2023-08-25T04:22:26.206897+0000","last_clean":"2023-08-25T04:22:26.206897+0000","last_became_active":"2023-08-25T04:22:24.986656+0000","last_became_peered":"2023-08-25T04:22:24.986656+0000","last_unstale":"2023-08-25T04:22:26.206897+0000","last_undegraded":"2023-08-25T04:22:26.206897+0000","last_fullsized":"2023-08-25T04:22:26.206897+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:55.425168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204332+0000","last_change":"2023-08-25T04:22:23.939447+0000","last_active":"2023-08-25T04:22:26.204332+0000","last_peered":"2023-08-25T04:22:26.204332+0000","last_clean":"2023-08-25T04:22:26.204332+0000","last_became_active":"2023-08-25T04:22:23.939163+0000","last_became_peered":"2023-08-25T04:22:23.939163+0000","last_unstale":"2023-08-25T04:22:26.204332+0000","last_undegraded":"2023-08-25T04:22:26.204332+0000","last_fullsized":"2023-08-25T04:22:26.204332+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:39.384237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964131+0000","last_change":"2023-08-25T04:22:24.986173+0000","last_active":"2023-08-25T04:22:25.964131+0000","last_peered":"2023-08-25T04:22:25.964131+0000","last_clean":"2023-08-25T04:22:25.964131+0000","last_became_active":"2023-08-25T04:22:24.985930+0000","last_became_peered":"2023-08-25T04:22:24.985930+0000","last_unstale":"2023-08-25T04:22:25.964131+0000","last_undegraded":"2023-08-25T04:22:25.964131+0000","last_fullsized":"2023-08-25T04:22:25.964131+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:30:42.063939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206544+0000","last_change":"2023-08-25T04:22:23.949373+0000","last_active":"2023-08-25T04:22:26.206544+0000","last_peered":"2023-08-25T04:22:26.206544+0000","last_clean":"2023-08-25T04:22:26.206544+0000","last_became_active":"2023-08-25T04:22:23.949016+0000","last_became_peered":"2023-08-25T04:22:23.949016+0000","last_unstale":"2023-08-25T04:22:26.206544+0000","last_undegraded":"2023-08-25T04:22:26.206544+0000","last_fullsized":"2023-08-25T04:22:26.206544+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:37.798379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204294+0000","last_change":"2023-08-25T04:22:24.995550+0000","last_active":"2023-08-25T04:22:26.204294+0000","last_peered":"2023-08-25T04:22:26.204294+0000","last_clean":"2023-08-25T04:22:26.204294+0000","last_became_active":"2023-08-25T04:22:24.995194+0000","last_became_peered":"2023-08-25T04:22:24.995194+0000","last_unstale":"2023-08-25T04:22:26.204294+0000","last_undegraded":"2023-08-25T04:22:26.204294+0000","last_fullsized":"2023-08-25T04:22:26.204294+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:15:07.728544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"135'1","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964281+0000","last_change":"2023-08-25T04:22:23.950360+0000","last_active":"2023-08-25T04:22:25.964281+0000","last_peered":"2023-08-25T04:22:25.964281+0000","last_clean":"2023-08-25T04:22:25.964281+0000","last_became_active":"2023-08-25T04:22:23.949970+0000","last_became_peered":"2023-08-25T04:22:23.949970+0000","last_unstale":"2023-08-25T04:22:25.964281+0000","last_undegraded":"2023-08-25T04:22:25.964281+0000","last_fullsized":"2023-08-25T04:22:25.964281+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:35:31.393426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964710+0000","last_change":"2023-08-25T04:22:24.973304+0000","last_active":"2023-08-25T04:22:25.964710+0000","last_peered":"2023-08-25T04:22:25.964710+0000","last_clean":"2023-08-25T04:22:25.964710+0000","last_became_active":"2023-08-25T04:22:24.972966+0000","last_became_peered":"2023-08-25T04:22:24.972966+0000","last_unstale":"2023-08-25T04:22:25.964710+0000","last_undegraded":"2023-08-25T04:22:25.964710+0000","last_fullsized":"2023-08-25T04:22:25.964710+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:19:47.310378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"135'2","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205861+0000","last_change":"2023-08-25T04:22:23.952200+0000","last_active":"2023-08-25T04:22:26.205861+0000","last_peered":"2023-08-25T04:22:26.205861+0000","last_clean":"2023-08-25T04:22:26.205861+0000","last_became_active":"2023-08-25T04:22:23.951889+0000","last_became_peered":"2023-08-25T04:22:23.951889+0000","last_unstale":"2023-08-25T04:22:26.205861+0000","last_undegraded":"2023-08-25T04:22:26.205861+0000","last_fullsized":"2023-08-25T04:22:26.205861+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:04:29.621868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206484+0000","last_change":"2023-08-25T04:22:24.990122+0000","last_active":"2023-08-25T04:22:26.206484+0000","last_peered":"2023-08-25T04:22:26.206484+0000","last_clean":"2023-08-25T04:22:26.206484+0000","last_became_active":"2023-08-25T04:22:24.989765+0000","last_became_peered":"2023-08-25T04:22:24.989765+0000","last_unstale":"2023-08-25T04:22:26.206484+0000","last_undegraded":"2023-08-25T04:22:26.206484+0000","last_fullsized":"2023-08-25T04:22:26.206484+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:43:42.693750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"135'1","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204988+0000","last_change":"2023-08-25T04:22:23.941276+0000","last_active":"2023-08-25T04:22:26.204988+0000","last_peered":"2023-08-25T04:22:26.204988+0000","last_clean":"2023-08-25T04:22:26.204988+0000","last_became_active":"2023-08-25T04:22:23.941003+0000","last_became_peered":"2023-08-25T04:22:23.941003+0000","last_unstale":"2023-08-25T04:22:26.204988+0000","last_undegraded":"2023-08-25T04:22:26.204988+0000","last_fullsized":"2023-08-25T04:22:26.204988+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:43:25.869524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205335+0000","last_change":"2023-08-25T04:22:24.988711+0000","last_active":"2023-08-25T04:22:26.205335+0000","last_peered":"2023-08-25T04:22:26.205335+0000","last_clean":"2023-08-25T04:22:26.205335+0000","last_became_active":"2023-08-25T04:22:24.988233+0000","last_became_peered":"2023-08-25T04:22:24.988233+0000","last_unstale":"2023-08-25T04:22:26.205335+0000","last_undegraded":"2023-08-25T04:22:26.205335+0000","last_fullsized":"2023-08-25T04:22:26.205335+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:13:11.822457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204767+0000","last_change":"2023-08-25T04:22:23.951309+0000","last_active":"2023-08-25T04:22:26.204767+0000","last_peered":"2023-08-25T04:22:26.204767+0000","last_clean":"2023-08-25T04:22:26.204767+0000","last_became_active":"2023-08-25T04:22:23.951005+0000","last_became_peered":"2023-08-25T04:22:23.951005+0000","last_unstale":"2023-08-25T04:22:26.204767+0000","last_undegraded":"2023-08-25T04:22:26.204767+0000","last_fullsized":"2023-08-25T04:22:26.204767+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:18:58.996099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206343+0000","last_change":"2023-08-25T04:22:24.993127+0000","last_active":"2023-08-25T04:22:26.206343+0000","last_peered":"2023-08-25T04:22:26.206343+0000","last_clean":"2023-08-25T04:22:26.206343+0000","last_became_active":"2023-08-25T04:22:24.992643+0000","last_became_peered":"2023-08-25T04:22:24.992643+0000","last_unstale":"2023-08-25T04:22:26.206343+0000","last_undegraded":"2023-08-25T04:22:26.206343+0000","last_fullsized":"2023-08-25T04:22:26.206343+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:46:04.552286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"135'2","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205646+0000","last_change":"2023-08-25T04:22:23.951668+0000","last_active":"2023-08-25T04:22:26.205646+0000","last_peered":"2023-08-25T04:22:26.205646+0000","last_clean":"2023-08-25T04:22:26.205646+0000","last_became_active":"2023-08-25T04:22:23.951292+0000","last_became_peered":"2023-08-25T04:22:23.951292+0000","last_unstale":"2023-08-25T04:22:26.205646+0000","last_undegraded":"2023-08-25T04:22:26.205646+0000","last_fullsized":"2023-08-25T04:22:26.205646+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:51:27.882156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206310+0000","last_change":"2023-08-25T04:22:24.988137+0000","last_active":"2023-08-25T04:22:26.206310+0000","last_peered":"2023-08-25T04:22:26.206310+0000","last_clean":"2023-08-25T04:22:26.206310+0000","last_became_active":"2023-08-25T04:22:24.987859+0000","last_became_peered":"2023-08-25T04:22:24.987859+0000","last_unstale":"2023-08-25T04:22:26.206310+0000","last_undegraded":"2023-08-25T04:22:26.206310+0000","last_fullsized":"2023-08-25T04:22:26.206310+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:20:01.423528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204381+0000","last_change":"2023-08-25T04:22:23.940568+0000","last_active":"2023-08-25T04:22:26.204381+0000","last_peered":"2023-08-25T04:22:26.204381+0000","last_clean":"2023-08-25T04:22:26.204381+0000","last_became_active":"2023-08-25T04:22:23.940255+0000","last_became_peered":"2023-08-25T04:22:23.940255+0000","last_unstale":"2023-08-25T04:22:26.204381+0000","last_undegraded":"2023-08-25T04:22:26.204381+0000","last_fullsized":"2023-08-25T04:22:26.204381+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:57:23.695875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.207016+0000","last_change":"2023-08-25T04:22:24.980057+0000","last_active":"2023-08-25T04:22:26.207016+0000","last_peered":"2023-08-25T04:22:26.207016+0000","last_clean":"2023-08-25T04:22:26.207016+0000","last_became_active":"2023-08-25T04:22:24.979725+0000","last_became_peered":"2023-08-25T04:22:24.979725+0000","last_unstale":"2023-08-25T04:22:26.207016+0000","last_undegraded":"2023-08-25T04:22:26.207016+0000","last_fullsized":"2023-08-25T04:22:26.207016+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:54:50.327192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206540+0000","last_change":"2023-08-25T04:22:23.952275+0000","last_active":"2023-08-25T04:22:26.206540+0000","last_peered":"2023-08-25T04:22:26.206540+0000","last_clean":"2023-08-25T04:22:26.206540+0000","last_became_active":"2023-08-25T04:22:23.951935+0000","last_became_peered":"2023-08-25T04:22:23.951935+0000","last_unstale":"2023-08-25T04:22:26.206540+0000","last_undegraded":"2023-08-25T04:22:26.206540+0000","last_fullsized":"2023-08-25T04:22:26.206540+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:23:13.707641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204529+0000","last_change":"2023-08-25T04:22:24.997117+0000","last_active":"2023-08-25T04:22:26.204529+0000","last_peered":"2023-08-25T04:22:26.204529+0000","last_clean":"2023-08-25T04:22:26.204529+0000","last_became_active":"2023-08-25T04:22:24.996854+0000","last_became_peered":"2023-08-25T04:22:24.996854+0000","last_unstale":"2023-08-25T04:22:26.204529+0000","last_undegraded":"2023-08-25T04:22:26.204529+0000","last_fullsized":"2023-08-25T04:22:26.204529+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:51:28.888407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.203755+0000","last_change":"2023-08-25T04:22:23.942906+0000","last_active":"2023-08-25T04:22:26.203755+0000","last_peered":"2023-08-25T04:22:26.203755+0000","last_clean":"2023-08-25T04:22:26.203755+0000","last_became_active":"2023-08-25T04:22:23.942635+0000","last_became_peered":"2023-08-25T04:22:23.942635+0000","last_unstale":"2023-08-25T04:22:26.203755+0000","last_undegraded":"2023-08-25T04:22:26.203755+0000","last_fullsized":"2023-08-25T04:22:26.203755+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:48:16.866068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206199+0000","last_change":"2023-08-25T04:22:25.000112+0000","last_active":"2023-08-25T04:22:26.206199+0000","last_peered":"2023-08-25T04:22:26.206199+0000","last_clean":"2023-08-25T04:22:26.206199+0000","last_became_active":"2023-08-25T04:22:24.999839+0000","last_became_peered":"2023-08-25T04:22:24.999839+0000","last_unstale":"2023-08-25T04:22:26.206199+0000","last_undegraded":"2023-08-25T04:22:26.206199+0000","last_fullsized":"2023-08-25T04:22:26.206199+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:46:11.761122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"135'2","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206039+0000","last_change":"2023-08-25T04:22:23.949512+0000","last_active":"2023-08-25T04:22:26.206039+0000","last_peered":"2023-08-25T04:22:26.206039+0000","last_clean":"2023-08-25T04:22:26.206039+0000","last_became_active":"2023-08-25T04:22:23.949089+0000","last_became_peered":"2023-08-25T04:22:23.949089+0000","last_unstale":"2023-08-25T04:22:26.206039+0000","last_undegraded":"2023-08-25T04:22:26.206039+0000","last_fullsized":"2023-08-25T04:22:26.206039+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:10:46.091024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964232+0000","last_change":"2023-08-25T04:22:24.985747+0000","last_active":"2023-08-25T04:22:25.964232+0000","last_peered":"2023-08-25T04:22:25.964232+0000","last_clean":"2023-08-25T04:22:25.964232+0000","last_became_active":"2023-08-25T04:22:24.985464+0000","last_became_peered":"2023-08-25T04:22:24.985464+0000","last_unstale":"2023-08-25T04:22:25.964232+0000","last_undegraded":"2023-08-25T04:22:25.964232+0000","last_fullsized":"2023-08-25T04:22:25.964232+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:16:56.375321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964182+0000","last_change":"2023-08-25T04:22:23.950792+0000","last_active":"2023-08-25T04:22:25.964182+0000","last_peered":"2023-08-25T04:22:25.964182+0000","last_clean":"2023-08-25T04:22:25.964182+0000","last_became_active":"2023-08-25T04:22:23.950452+0000","last_became_peered":"2023-08-25T04:22:23.950452+0000","last_unstale":"2023-08-25T04:22:25.964182+0000","last_undegraded":"2023-08-25T04:22:25.964182+0000","last_fullsized":"2023-08-25T04:22:25.964182+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:40:57.683800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204971+0000","last_change":"2023-08-25T04:22:24.967748+0000","last_active":"2023-08-25T04:22:26.204971+0000","last_peered":"2023-08-25T04:22:26.204971+0000","last_clean":"2023-08-25T04:22:26.204971+0000","last_became_active":"2023-08-25T04:22:24.967392+0000","last_became_peered":"2023-08-25T04:22:24.967392+0000","last_unstale":"2023-08-25T04:22:26.204971+0000","last_undegraded":"2023-08-25T04:22:26.204971+0000","last_fullsized":"2023-08-25T04:22:26.204971+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:02:48.603704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964565+0000","last_change":"2023-08-25T04:22:23.950199+0000","last_active":"2023-08-25T04:22:25.964565+0000","last_peered":"2023-08-25T04:22:25.964565+0000","last_clean":"2023-08-25T04:22:25.964565+0000","last_became_active":"2023-08-25T04:22:23.949899+0000","last_became_peered":"2023-08-25T04:22:23.949899+0000","last_unstale":"2023-08-25T04:22:25.964565+0000","last_undegraded":"2023-08-25T04:22:25.964565+0000","last_fullsized":"2023-08-25T04:22:25.964565+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:20:04.404746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205521+0000","last_change":"2023-08-25T04:22:24.990681+0000","last_active":"2023-08-25T04:22:26.205521+0000","last_peered":"2023-08-25T04:22:26.205521+0000","last_clean":"2023-08-25T04:22:26.205521+0000","last_became_active":"2023-08-25T04:22:24.990410+0000","last_became_peered":"2023-08-25T04:22:24.990410+0000","last_unstale":"2023-08-25T04:22:26.205521+0000","last_undegraded":"2023-08-25T04:22:26.205521+0000","last_fullsized":"2023-08-25T04:22:26.205521+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:09:06.003095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206284+0000","last_change":"2023-08-25T04:22:23.951624+0000","last_active":"2023-08-25T04:22:26.206284+0000","last_peered":"2023-08-25T04:22:26.206284+0000","last_clean":"2023-08-25T04:22:26.206284+0000","last_became_active":"2023-08-25T04:22:23.951310+0000","last_became_peered":"2023-08-25T04:22:23.951310+0000","last_unstale":"2023-08-25T04:22:26.206284+0000","last_undegraded":"2023-08-25T04:22:26.206284+0000","last_fullsized":"2023-08-25T04:22:26.206284+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:13:10.816206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206463+0000","last_change":"2023-08-25T04:22:24.992947+0000","last_active":"2023-08-25T04:22:26.206463+0000","last_peered":"2023-08-25T04:22:26.206463+0000","last_clean":"2023-08-25T04:22:26.206463+0000","last_became_active":"2023-08-25T04:22:24.992319+0000","last_became_peered":"2023-08-25T04:22:24.992319+0000","last_unstale":"2023-08-25T04:22:26.206463+0000","last_undegraded":"2023-08-25T04:22:26.206463+0000","last_fullsized":"2023-08-25T04:22:26.206463+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:07:57.946440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964608+0000","last_change":"2023-08-25T04:22:23.943144+0000","last_active":"2023-08-25T04:22:25.964608+0000","last_peered":"2023-08-25T04:22:25.964608+0000","last_clean":"2023-08-25T04:22:25.964608+0000","last_became_active":"2023-08-25T04:22:23.942803+0000","last_became_peered":"2023-08-25T04:22:23.942803+0000","last_unstale":"2023-08-25T04:22:25.964608+0000","last_undegraded":"2023-08-25T04:22:25.964608+0000","last_fullsized":"2023-08-25T04:22:25.964608+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:07:37.842415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206440+0000","last_change":"2023-08-25T04:22:24.978375+0000","last_active":"2023-08-25T04:22:26.206440+0000","last_peered":"2023-08-25T04:22:26.206440+0000","last_clean":"2023-08-25T04:22:26.206440+0000","last_became_active":"2023-08-25T04:22:24.978090+0000","last_became_peered":"2023-08-25T04:22:24.978090+0000","last_unstale":"2023-08-25T04:22:26.206440+0000","last_undegraded":"2023-08-25T04:22:26.206440+0000","last_fullsized":"2023-08-25T04:22:26.206440+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:47:18.483790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964359+0000","last_change":"2023-08-25T04:22:23.940126+0000","last_active":"2023-08-25T04:22:25.964359+0000","last_peered":"2023-08-25T04:22:25.964359+0000","last_clean":"2023-08-25T04:22:25.964359+0000","last_became_active":"2023-08-25T04:22:23.939787+0000","last_became_peered":"2023-08-25T04:22:23.939787+0000","last_unstale":"2023-08-25T04:22:25.964359+0000","last_undegraded":"2023-08-25T04:22:25.964359+0000","last_fullsized":"2023-08-25T04:22:25.964359+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:27:15.410928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204264+0000","last_change":"2023-08-25T04:22:24.991400+0000","last_active":"2023-08-25T04:22:26.204264+0000","last_peered":"2023-08-25T04:22:26.204264+0000","last_clean":"2023-08-25T04:22:26.204264+0000","last_became_active":"2023-08-25T04:22:24.991119+0000","last_became_peered":"2023-08-25T04:22:24.991119+0000","last_unstale":"2023-08-25T04:22:26.204264+0000","last_undegraded":"2023-08-25T04:22:26.204264+0000","last_fullsized":"2023-08-25T04:22:26.204264+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:19:09.572991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205583+0000","last_change":"2023-08-25T04:22:23.951861+0000","last_active":"2023-08-25T04:22:26.205583+0000","last_peered":"2023-08-25T04:22:26.205583+0000","last_clean":"2023-08-25T04:22:26.205583+0000","last_became_active":"2023-08-25T04:22:23.951562+0000","last_became_peered":"2023-08-25T04:22:23.951562+0000","last_unstale":"2023-08-25T04:22:26.205583+0000","last_undegraded":"2023-08-25T04:22:26.205583+0000","last_fullsized":"2023-08-25T04:22:26.205583+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:44.764248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964267+0000","last_change":"2023-08-25T04:22:24.981863+0000","last_active":"2023-08-25T04:22:25.964267+0000","last_peered":"2023-08-25T04:22:25.964267+0000","last_clean":"2023-08-25T04:22:25.964267+0000","last_became_active":"2023-08-25T04:22:24.981575+0000","last_became_peered":"2023-08-25T04:22:24.981575+0000","last_unstale":"2023-08-25T04:22:25.964267+0000","last_undegraded":"2023-08-25T04:22:25.964267+0000","last_fullsized":"2023-08-25T04:22:25.964267+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:54.230362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.203758+0000","last_change":"2023-08-25T04:22:23.935832+0000","last_active":"2023-08-25T04:22:26.203758+0000","last_peered":"2023-08-25T04:22:26.203758+0000","last_clean":"2023-08-25T04:22:26.203758+0000","last_became_active":"2023-08-25T04:22:23.935459+0000","last_became_peered":"2023-08-25T04:22:23.935459+0000","last_unstale":"2023-08-25T04:22:26.203758+0000","last_undegraded":"2023-08-25T04:22:26.203758+0000","last_fullsized":"2023-08-25T04:22:26.203758+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:29:11.514300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204593+0000","last_change":"2023-08-25T04:22:24.986230+0000","last_active":"2023-08-25T04:22:26.204593+0000","last_peered":"2023-08-25T04:22:26.204593+0000","last_clean":"2023-08-25T04:22:26.204593+0000","last_became_active":"2023-08-25T04:22:24.985966+0000","last_became_peered":"2023-08-25T04:22:24.985966+0000","last_unstale":"2023-08-25T04:22:26.204593+0000","last_undegraded":"2023-08-25T04:22:26.204593+0000","last_fullsized":"2023-08-25T04:22:26.204593+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:07.817849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"135'8","reported_seq":21,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205699+0000","last_change":"2023-08-25T04:22:23.942738+0000","last_active":"2023-08-25T04:22:26.205699+0000","last_peered":"2023-08-25T04:22:26.205699+0000","last_clean":"2023-08-25T04:22:26.205699+0000","last_became_active":"2023-08-25T04:22:23.942467+0000","last_became_peered":"2023-08-25T04:22:23.942467+0000","last_unstale":"2023-08-25T04:22:26.205699+0000","last_undegraded":"2023-08-25T04:22:26.205699+0000","last_fullsized":"2023-08-25T04:22:26.205699+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:40:39.538469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"124'3554","reported_seq":4154,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204170+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:22:26.204170+0000","last_peered":"2023-08-25T04:22:26.204170+0000","last_clean":"2023-08-25T04:22:26.204170+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:22:26.204170+0000","last_undegraded":"2023-08-25T04:22:26.204170+0000","last_fullsized":"2023-08-25T04:22:26.204170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3554,"log_dups_size":0,"ondisk_log_size":3554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:42:27.482968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1232,"num_read_kb":2549,"num_write":385,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":210,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204582+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:22:26.204582+0000","last_peered":"2023-08-25T04:22:26.204582+0000","last_clean":"2023-08-25T04:22:26.204582+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:22:26.204582+0000","last_undegraded":"2023-08-25T04:22:26.204582+0000","last_fullsized":"2023-08-25T04:22:26.204582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:18:42.136058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964886+0000","last_change":"2023-08-25T04:22:24.974953+0000","last_active":"2023-08-25T04:22:25.964886+0000","last_peered":"2023-08-25T04:22:25.964886+0000","last_clean":"2023-08-25T04:22:25.964886+0000","last_became_active":"2023-08-25T04:22:24.974639+0000","last_became_peered":"2023-08-25T04:22:24.974639+0000","last_unstale":"2023-08-25T04:22:25.964886+0000","last_undegraded":"2023-08-25T04:22:25.964886+0000","last_fullsized":"2023-08-25T04:22:25.964886+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:52:46.328332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"135'2","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206333+0000","last_change":"2023-08-25T04:22:23.942162+0000","last_active":"2023-08-25T04:22:26.206333+0000","last_peered":"2023-08-25T04:22:26.206333+0000","last_clean":"2023-08-25T04:22:26.206333+0000","last_became_active":"2023-08-25T04:22:23.941827+0000","last_became_peered":"2023-08-25T04:22:23.941827+0000","last_unstale":"2023-08-25T04:22:26.206333+0000","last_undegraded":"2023-08-25T04:22:26.206333+0000","last_fullsized":"2023-08-25T04:22:26.206333+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:13:01.394885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":210,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.203927+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:22:26.203927+0000","last_peered":"2023-08-25T04:22:26.203927+0000","last_clean":"2023-08-25T04:22:26.203927+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:22:26.203927+0000","last_undegraded":"2023-08-25T04:22:26.203927+0000","last_fullsized":"2023-08-25T04:22:26.203927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:33:38.409193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964043+0000","last_change":"2023-08-25T04:22:24.981226+0000","last_active":"2023-08-25T04:22:25.964043+0000","last_peered":"2023-08-25T04:22:25.964043+0000","last_clean":"2023-08-25T04:22:25.964043+0000","last_became_active":"2023-08-25T04:22:24.980923+0000","last_became_peered":"2023-08-25T04:22:24.980923+0000","last_unstale":"2023-08-25T04:22:25.964043+0000","last_undegraded":"2023-08-25T04:22:25.964043+0000","last_fullsized":"2023-08-25T04:22:25.964043+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:40:40.053181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.207052+0000","last_change":"2023-08-25T04:22:23.945299+0000","last_active":"2023-08-25T04:22:26.207052+0000","last_peered":"2023-08-25T04:22:26.207052+0000","last_clean":"2023-08-25T04:22:26.207052+0000","last_became_active":"2023-08-25T04:22:23.945011+0000","last_became_peered":"2023-08-25T04:22:23.945011+0000","last_unstale":"2023-08-25T04:22:26.207052+0000","last_undegraded":"2023-08-25T04:22:26.207052+0000","last_fullsized":"2023-08-25T04:22:26.207052+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:40:48.532063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":216,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205171+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:22:26.205171+0000","last_peered":"2023-08-25T04:22:26.205171+0000","last_clean":"2023-08-25T04:22:26.205171+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:22:26.205171+0000","last_undegraded":"2023-08-25T04:22:26.205171+0000","last_fullsized":"2023-08-25T04:22:26.205171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:07:15.240628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205697+0000","last_change":"2023-08-25T04:22:24.989300+0000","last_active":"2023-08-25T04:22:26.205697+0000","last_peered":"2023-08-25T04:22:26.205697+0000","last_clean":"2023-08-25T04:22:26.205697+0000","last_became_active":"2023-08-25T04:22:24.988974+0000","last_became_peered":"2023-08-25T04:22:24.988974+0000","last_unstale":"2023-08-25T04:22:26.205697+0000","last_undegraded":"2023-08-25T04:22:26.205697+0000","last_fullsized":"2023-08-25T04:22:26.205697+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:04.496248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206547+0000","last_change":"2023-08-25T04:22:23.945109+0000","last_active":"2023-08-25T04:22:26.206547+0000","last_peered":"2023-08-25T04:22:26.206547+0000","last_clean":"2023-08-25T04:22:26.206547+0000","last_became_active":"2023-08-25T04:22:23.944798+0000","last_became_peered":"2023-08-25T04:22:23.944798+0000","last_unstale":"2023-08-25T04:22:26.206547+0000","last_undegraded":"2023-08-25T04:22:26.206547+0000","last_fullsized":"2023-08-25T04:22:26.206547+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:41:12.209828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":210,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204495+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:22:26.204495+0000","last_peered":"2023-08-25T04:22:26.204495+0000","last_clean":"2023-08-25T04:22:26.204495+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:22:26.204495+0000","last_undegraded":"2023-08-25T04:22:26.204495+0000","last_fullsized":"2023-08-25T04:22:26.204495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:31:56.114244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964582+0000","last_change":"2023-08-25T04:22:24.973626+0000","last_active":"2023-08-25T04:22:25.964582+0000","last_peered":"2023-08-25T04:22:25.964582+0000","last_clean":"2023-08-25T04:22:25.964582+0000","last_became_active":"2023-08-25T04:22:24.973339+0000","last_became_peered":"2023-08-25T04:22:24.973339+0000","last_unstale":"2023-08-25T04:22:25.964582+0000","last_undegraded":"2023-08-25T04:22:25.964582+0000","last_fullsized":"2023-08-25T04:22:25.964582+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:22:15.124047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.965016+0000","last_change":"2023-08-25T04:22:23.949056+0000","last_active":"2023-08-25T04:22:25.965016+0000","last_peered":"2023-08-25T04:22:25.965016+0000","last_clean":"2023-08-25T04:22:25.965016+0000","last_became_active":"2023-08-25T04:22:23.948734+0000","last_became_peered":"2023-08-25T04:22:23.948734+0000","last_unstale":"2023-08-25T04:22:25.965016+0000","last_undegraded":"2023-08-25T04:22:25.965016+0000","last_fullsized":"2023-08-25T04:22:25.965016+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:54:23.848789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964392+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:22:25.964392+0000","last_peered":"2023-08-25T04:22:25.964392+0000","last_clean":"2023-08-25T04:22:25.964392+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:22:25.964392+0000","last_undegraded":"2023-08-25T04:22:25.964392+0000","last_fullsized":"2023-08-25T04:22:25.964392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:48:05.691167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204743+0000","last_change":"2023-08-25T04:22:24.996859+0000","last_active":"2023-08-25T04:22:26.204743+0000","last_peered":"2023-08-25T04:22:26.204743+0000","last_clean":"2023-08-25T04:22:26.204743+0000","last_became_active":"2023-08-25T04:22:24.996540+0000","last_became_peered":"2023-08-25T04:22:24.996540+0000","last_unstale":"2023-08-25T04:22:26.204743+0000","last_undegraded":"2023-08-25T04:22:26.204743+0000","last_fullsized":"2023-08-25T04:22:26.204743+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:14:30.577755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205007+0000","last_change":"2023-08-25T04:22:23.942354+0000","last_active":"2023-08-25T04:22:26.205007+0000","last_peered":"2023-08-25T04:22:26.205007+0000","last_clean":"2023-08-25T04:22:26.205007+0000","last_became_active":"2023-08-25T04:22:23.942057+0000","last_became_peered":"2023-08-25T04:22:23.942057+0000","last_unstale":"2023-08-25T04:22:26.205007+0000","last_undegraded":"2023-08-25T04:22:26.205007+0000","last_fullsized":"2023-08-25T04:22:26.205007+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:55.486409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":210,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205061+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:22:26.205061+0000","last_peered":"2023-08-25T04:22:26.205061+0000","last_clean":"2023-08-25T04:22:26.205061+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:22:26.205061+0000","last_undegraded":"2023-08-25T04:22:26.205061+0000","last_fullsized":"2023-08-25T04:22:26.205061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:34:54.300689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206139+0000","last_change":"2023-08-25T04:22:24.980259+0000","last_active":"2023-08-25T04:22:26.206139+0000","last_peered":"2023-08-25T04:22:26.206139+0000","last_clean":"2023-08-25T04:22:26.206139+0000","last_became_active":"2023-08-25T04:22:24.978717+0000","last_became_peered":"2023-08-25T04:22:24.978717+0000","last_unstale":"2023-08-25T04:22:26.206139+0000","last_undegraded":"2023-08-25T04:22:26.206139+0000","last_fullsized":"2023-08-25T04:22:26.206139+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:54:36.992915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"135'3","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204712+0000","last_change":"2023-08-25T04:22:23.941295+0000","last_active":"2023-08-25T04:22:26.204712+0000","last_peered":"2023-08-25T04:22:26.204712+0000","last_clean":"2023-08-25T04:22:26.204712+0000","last_became_active":"2023-08-25T04:22:23.940689+0000","last_became_peered":"2023-08-25T04:22:23.940689+0000","last_unstale":"2023-08-25T04:22:26.204712+0000","last_undegraded":"2023-08-25T04:22:26.204712+0000","last_fullsized":"2023-08-25T04:22:26.204712+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:39:00.007640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964469+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:22:25.964469+0000","last_peered":"2023-08-25T04:22:25.964469+0000","last_clean":"2023-08-25T04:22:25.964469+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:22:25.964469+0000","last_undegraded":"2023-08-25T04:22:25.964469+0000","last_fullsized":"2023-08-25T04:22:25.964469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:35:38.352388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205216+0000","last_change":"2023-08-25T04:22:24.988742+0000","last_active":"2023-08-25T04:22:26.205216+0000","last_peered":"2023-08-25T04:22:26.205216+0000","last_clean":"2023-08-25T04:22:26.205216+0000","last_became_active":"2023-08-25T04:22:24.988427+0000","last_became_peered":"2023-08-25T04:22:24.988427+0000","last_unstale":"2023-08-25T04:22:26.205216+0000","last_undegraded":"2023-08-25T04:22:26.205216+0000","last_fullsized":"2023-08-25T04:22:26.205216+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:30.167507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"135'6","reported_seq":19,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205903+0000","last_change":"2023-08-25T04:22:23.946500+0000","last_active":"2023-08-25T04:22:26.205903+0000","last_peered":"2023-08-25T04:22:26.205903+0000","last_clean":"2023-08-25T04:22:26.205903+0000","last_became_active":"2023-08-25T04:22:23.946216+0000","last_became_peered":"2023-08-25T04:22:23.946216+0000","last_unstale":"2023-08-25T04:22:26.205903+0000","last_undegraded":"2023-08-25T04:22:26.205903+0000","last_fullsized":"2023-08-25T04:22:26.205903+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:14:16.851197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":246,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.965121+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:22:25.965121+0000","last_peered":"2023-08-25T04:22:25.965121+0000","last_clean":"2023-08-25T04:22:25.965121+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:22:25.965121+0000","last_undegraded":"2023-08-25T04:22:25.965121+0000","last_fullsized":"2023-08-25T04:22:25.965121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:07:47.138650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1232,"num_read_kb":2549,"num_write":385,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3554,"ondisk_log_size":3554,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509674,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59788,"kb_used_data":2236,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312052,"statfs":{"total":96636764160,"available":96575541248,"internally_reserved":0,"allocated":2289664,"data_stored":1431077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65700000000000003,"15min":0.69699999999999995},"min":{"1min":0.51200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91700000000000004,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66600000000000004,"15min":0.70999999999999996},"min":{"1min":0.41499999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81899999999999995,"5min":1,"15min":1.0249999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70099999999999996,"15min":0.72499999999999998},"min":{"1min":0.58099999999999996,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.878,"5min":1.054,"15min":1.054},"last":0.63},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68999999999999995,"15min":0.72499999999999998},"min":{"1min":0.52100000000000002,"5min":0.377,"15min":0.374},"max":{"1min":0.90100000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.751}]},{"osd":2,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65700000000000003,"15min":0.69699999999999995},"min":{"1min":0.44800000000000001,"5min":0.38100000000000001,"15min":0.34899999999999998},"max":{"1min":0.753,"5min":0.94299999999999995,"15min":1.018},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.70899999999999996,"15min":0.74099999999999999},"min":{"1min":0.61499999999999999,"5min":0.46500000000000002,"15min":0.38100000000000001},"max":{"1min":0.96199999999999997,"5min":1.046,"15min":1.046},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69299999999999995,"15min":0.72799999999999998},"min":{"1min":0.56000000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85299999999999998,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71099999999999997,"15min":0.74099999999999999},"min":{"1min":0.54800000000000004,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":0.84899999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.77000000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.34499999999999997,"15min":0.32400000000000001},"max":{"1min":0.75,"5min":1.004,"15min":1.0109999999999999},"last":0.499},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.44500000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81899999999999995,"5min":0.97599999999999998,"15min":0.97799999999999998},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.624,"15min":0.61099999999999999},"min":{"1min":0.45000000000000001,"5min":0.40500000000000003,"15min":0.377},"max":{"1min":0.90600000000000003,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64200000000000002,"15min":0.629},"min":{"1min":0.42399999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.873,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69999999999999996,"15min":0.69099999999999995},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.872,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.49399999999999999,"5min":0.42799999999999999,"15min":0.42699999999999999},"max":{"1min":0.90100000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.69899999999999995}]}]},{"osd":6,"up_from":15,"seq":64424509674,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36984,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334856,"statfs":{"total":96636764160,"available":96598892544,"internally_reserved":0,"allocated":1683456,"data_stored":840515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65600000000000003,"15min":0.68999999999999995},"min":{"1min":0.439,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.89300000000000002,"5min":0.97599999999999998,"15min":1.0089999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64600000000000002,"15min":0.68100000000000005},"min":{"1min":0.46800000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.95999999999999996,"15min":1.054},"last":0.63900000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69999999999999996,"15min":0.72099999999999997},"min":{"1min":0.498,"5min":0.39600000000000002,"15min":0.38200000000000001},"max":{"1min":0.85199999999999998,"5min":0.98799999999999999,"15min":1.0369999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.71999999999999997},"min":{"1min":0.50700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81899999999999995,"5min":1.109,"15min":1.109},"last":0.69999999999999996}]},{"osd":2,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.55900000000000005,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86299999999999999,"5min":1.0009999999999999,"15min":1.1020000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.745,"15min":0.77700000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94799999999999995,"5min":1.0169999999999999,"15min":1.0569999999999999},"last":0.75600000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.49199999999999999,"5min":0.48499999999999999,"15min":0.46899999999999997},"max":{"1min":0.93600000000000005,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71799999999999997,"15min":0.746},"min":{"1min":0.53000000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93500000000000005,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.621}]},{"osd":4,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.46300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.96199999999999997,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.60699999999999998,"15min":0.59399999999999997},"min":{"1min":0.38700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.93500000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47999999999999998,"5min":0.39200000000000002,"15min":0.373},"max":{"1min":0.85899999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.141,"15min":1.141},"last":0.77600000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40400000000000003},"max":{"1min":0.90200000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.69899999999999995},"min":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.44700000000000001},"max":{"1min":0.90600000000000003,"5min":1.373,"15min":1.373},"last":0.60199999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542377,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50876,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320964,"statfs":{"total":96636764160,"available":96584667136,"internally_reserved":0,"allocated":1687552,"data_stored":840093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65400000000000003,"15min":0.69399999999999995},"min":{"1min":0.42399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":1.002,"5min":1.002,"15min":1.018},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66700000000000004,"15min":0.70999999999999996},"min":{"1min":0.50600000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":1.0409999999999999},"last":0.83899999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66600000000000004,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93000000000000005,"5min":0.96399999999999997,"15min":0.99399999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.72799999999999998},"min":{"1min":0.48999999999999999,"5min":0.434,"15min":0.434},"max":{"1min":0.96199999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.78900000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65800000000000003,"15min":0.70999999999999996},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.39500000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.97499999999999998},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68300000000000005,"15min":0.72699999999999998},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89200000000000002,"5min":1.048,"15min":1.048},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68700000000000006,"15min":0.71999999999999997},"min":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70899999999999996,"15min":0.749},"min":{"1min":0.48999999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85999999999999999,"5min":1.028,"15min":1.028},"last":0.746}]},{"osd":4,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54800000000000004,"15min":0.56999999999999995},"min":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.35399999999999998},"max":{"1min":0.69699999999999995,"5min":0.91000000000000003,"15min":0.97099999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59099999999999997,"15min":0.60999999999999999},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.80800000000000005,"5min":0.91900000000000004,"15min":1.018},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Aug 25 04:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.62,"15min":0.62},"min":{"1min":0.437,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.77400000000000002,"5min":0.96799999999999997,"15min":1.008},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64200000000000002,"15min":0.64500000000000002},"min":{"1min":0.46100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.872,"5min":0.94199999999999995,"15min":0.98299999999999998},"last":0.57999999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63300000000000001,"15min":0.61099999999999999},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.877,"5min":0.93300000000000005,"15min":1.032},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.47799999999999998,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.877,"5min":1.01,"15min":1.048},"last":0.60599999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542377,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36996,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334844,"statfs":{"total":96636764160,"available":96598880256,"internally_reserved":0,"allocated":1691648,"data_stored":841545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.65700000000000003,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.68799999999999994},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.879}]},{"osd":1,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.69299999999999995,"15min":0.72299999999999998},"min":{"1min":0.438,"5min":0.38200000000000001,"15min":0.36199999999999999},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.68300000000000005,"15min":0.72399999999999998},"min":{"1min":0.49199999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.84599999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.71399999999999997,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.69499999999999995,"15min":0.73699999999999999},"min":{"1min":0.49299999999999999,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.97199999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.72699999999999998,"15min":0.75800000000000001},"min":{"1min":0.46999999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":3.0019999999999998,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.69699999999999995,"15min":0.74199999999999999},"min":{"1min":0.54300000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.331,"5min":2.331,"15min":2.331},"last":0.79600000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.36799999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.60699999999999998,"15min":0.59999999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.746,"15min":0.73999999999999999},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.40699999999999997},"max":{"1min":3.0710000000000002,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.42299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.71899999999999997,"15min":0.70499999999999996},"min":{"1min":0.50700000000000001,"5min":0.49199999999999999,"15min":0.437},"max":{"1min":3.2170000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":0.63700000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542377,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37004,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334836,"statfs":{"total":96636764160,"available":96598872064,"internally_reserved":0,"allocated":1695744,"data_stored":841579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.434,"15min":0.44900000000000001},"min":{"1min":0.30099999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64100000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.49099999999999999,"15min":0.51100000000000001},"min":{"1min":0.33300000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.55300000000000005,"5min":0.70799999999999996,"15min":0.91500000000000004},"last":0.46999999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.499,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.81100000000000005,"5min":1.254,"15min":1.254},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.433,"5min":0.41499999999999998,"15min":0.33900000000000002},"max":{"1min":0.96999999999999997,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.42299999999999999,"5min":0.38700000000000001,"15min":0.33000000000000002},"max":{"1min":0.70299999999999996,"5min":1.639,"15min":1.639},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70399999999999996,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.48699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92200000000000004,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.1220000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76400000000000001,"15min":0.79500000000000004},"min":{"1min":0.55400000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.016,"5min":1.601,"15min":1.601},"last":0.81799999999999995}]},{"osd":5,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73399999999999999,"15min":0.77000000000000002},"min":{"1min":0.55000000000000004,"5min":0.52900000000000003,"15min":0.49299999999999999},"max":{"1min":0.94899999999999995,"5min":1.0549999999999999,"15min":1.254},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74399999999999999,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":0.98299999999999998,"5min":1.421,"15min":1.421},"last":1.2010000000000001}]},{"osd":6,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78000000000000003,"15min":0.79900000000000004},"min":{"1min":0.59799999999999998,"5min":0.55000000000000004,"15min":0.54000000000000004},"max":{"1min":1.008,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.748,"15min":0.78400000000000003},"min":{"1min":0.53700000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.99299999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.94999999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77600000000000002,"15min":0.81299999999999994},"min":{"1min":0.56499999999999995,"5min":0.53000000000000003,"15min":0.52500000000000002},"max":{"1min":0.96699999999999997,"5min":1.472,"15min":1.472},"last":1.038},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.752,"15min":0.78600000000000003},"min":{"1min":0.56699999999999995,"5min":0.498,"15min":0.498},"max":{"1min":0.88800000000000001,"5min":1.0209999999999999,"15min":1.1160000000000001},"last":1.0760000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542378,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55028,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316812,"statfs":{"total":96636764160,"available":96580415488,"internally_reserved":0,"allocated":1679360,"data_stored":839933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.433,"15min":0.45700000000000002},"min":{"1min":0.32900000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.61099999999999999,"5min":0.65100000000000002,"15min":0.85599999999999998},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.47699999999999998,"15min":0.496},"min":{"1min":0.35599999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72599999999999998,"5min":0.83099999999999996,"15min":0.93100000000000005},"last":0.40699999999999997}]},{"osd":1,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.78800000000000003},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57599999999999996,"15min":0.59099999999999997},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.39200000000000002},"max":{"1min":0.81000000000000005,"5min":0.81699999999999995,"15min":0.89800000000000002},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35499999999999998},"max":{"1min":0.67600000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.434},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.42199999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68300000000000005,"5min":0.88900000000000001,"15min":0.89400000000000002},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.74199999999999999,"15min":0.78300000000000003},"min":{"1min":0.58799999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.751},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72399999999999998,"15min":0.77000000000000002},"min":{"1min":0.53200000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.038,"5min":1.0629999999999999,"15min":1.5509999999999999},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74099999999999999,"15min":0.78400000000000003},"min":{"1min":0.56399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.258,"5min":1.258,"15min":1.2789999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.76800000000000002,"15min":0.79900000000000004},"min":{"1min":0.57899999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.754,"15min":0.80500000000000005},"min":{"1min":0.55300000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.3069999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.78200000000000003,"15min":0.83799999999999997},"min":{"1min":0.58599999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0800000000000001,"5min":1.1930000000000001,"15min":1.375},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.745,"15min":0.78800000000000003},"min":{"1min":0.58999999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.339},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.75800000000000001,"15min":0.79300000000000004},"min":{"1min":0.60599999999999998,"5min":0.44,"15min":0.44},"max":{"1min":1.133,"5min":1.133,"15min":1.1859999999999999},"last":0.68999999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542378,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36984,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334856,"statfs":{"total":96636764160,"available":96598892544,"internally_reserved":0,"allocated":1683456,"data_stored":839955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.43099999999999999,"15min":0.45200000000000001},"min":{"1min":0.29799999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67500000000000004,"5min":0.93999999999999995,"15min":0.96899999999999997},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.38100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.751,"5min":0.85099999999999998,"15min":1.212},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.497},"min":{"1min":0.35799999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.58399999999999996,"5min":0.80500000000000005,"15min":0.876},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.56799999999999995},"min":{"1min":0.40699999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":1.095,"15min":1.095},"last":0.58499999999999996}]},{"osd":3,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58999999999999997,"15min":0.61399999999999999},"min":{"1min":0.435,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89200000000000002,"5min":1.03,"15min":1.03},"last":0.443},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.53500000000000003,"15min":0.56899999999999995},"min":{"1min":0.438,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":1.165},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.69999999999999996,"15min":0.755},"min":{"1min":0.52900000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.204},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.76100000000000001,"15min":0.79200000000000004},"min":{"1min":0.64700000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.246,"5min":1.246,"15min":1.2529999999999999},"last":0.94699999999999995}]},{"osd":5,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.72199999999999998,"15min":0.77300000000000002},"min":{"1min":0.50800000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.254},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73599999999999999,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0249999999999999,"5min":1.044,"15min":1.9059999999999999},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.81999999999999995},"min":{"1min":0.622,"5min":0.497,"15min":0.497},"max":{"1min":1.125,"5min":1.294,"15min":1.623},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.755,"15min":0.78800000000000003},"min":{"1min":0.57199999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.92000000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.751,"15min":0.79200000000000004},"min":{"1min":0.52600000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.091,"5min":1.091,"15min":1.2949999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.81699999999999995,"15min":0.83999999999999997},"min":{"1min":0.59899999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.006}]}]},{"osd":0,"up_from":14,"seq":60129542377,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33404,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338436,"statfs":{"total":96636764160,"available":96602558464,"internally_reserved":0,"allocated":2277376,"data_stored":1430323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46999999999999997,"15min":0.48199999999999998},"min":{"1min":0.28199999999999997,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.66300000000000003,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.55500000000000005},"min":{"1min":0.39200000000000002,"5min":0.38500000000000001,"15min":0.36699999999999999},"max":{"1min":0.79700000000000004,"5min":1.0129999999999999,"15min":3.5089999999999999},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.51500000000000001},"min":{"1min":0.36199999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.37},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.53300000000000003},"min":{"1min":0.34399999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.748,"5min":0.876,"15min":3.4590000000000001},"last":0.44500000000000001}]},{"osd":3,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47599999999999998,"15min":0.48699999999999999},"min":{"1min":0.35499999999999998,"5min":0.28699999999999998,"15min":0.27700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.40500000000000003,"5min":0.36699999999999999,"15min":0.32700000000000001},"max":{"1min":0.875,"5min":0.93500000000000005,"15min":1.2470000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.746,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91400000000000003,"5min":1.2,"15min":1.2},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.73999999999999999,"15min":0.79000000000000004},"min":{"1min":0.56799999999999995,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.169,"15min":1.169},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72899999999999998,"15min":0.78100000000000003},"min":{"1min":0.59499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84399999999999997,"5min":1.131,"15min":3.528},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.746,"15min":0.79600000000000004},"min":{"1min":0.55700000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98799999999999999,"5min":1.244,"15min":1.244},"last":0.71599999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73499999999999999,"15min":0.78700000000000003},"min":{"1min":0.54500000000000004,"5min":0.495,"15min":0.495},"max":{"1min":0.95999999999999996,"5min":1.1180000000000001,"15min":3.4870000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77400000000000002,"15min":0.81499999999999995},"min":{"1min":0.57299999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98099999999999998,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.82999999999999996}]},{"osd":7,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78400000000000003,"15min":0.82499999999999996},"min":{"1min":0.51700000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0580000000000001,"5min":1.28,"15min":1.28},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.753,"15min":0.79500000000000004},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0820000000000001,"5min":1.0940000000000001,"15min":1.1930000000000001},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:22:31.006 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:22:31.009 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:22:33.660 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T04:22:33.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.813+0000 7fd095c88640 1 Processor -- start 2023-08-25T04:22:33.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.813+0000 7fd095c88640 1 -- start start 2023-08-25T04:22:33.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.817+0000 7fd095c88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0900d0da0 0x7fd0900d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:33.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.817+0000 7fd095c88640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd0900cdde0 0x7fd0900ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:33.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.817+0000 7fd095c88640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0900b29b0 con 0x7fd0900cee60 2023-08-25T04:22:33.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.817+0000 7fd095c88640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0900ce760 con 0x7fd0900cdde0 2023-08-25T04:22:33.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.817+0000 7fd095c88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900d16c0 con 0x7fd0900d0da0 2023-08-25T04:22:33.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.817+0000 7fd08ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd0900cee60 0x7fd0900cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53646/0 (socket says 172.21.15.55:53646) 2023-08-25T04:22:33.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.817+0000 7fd08ffff640 1 -- 172.21.15.55:0/3796569199 learned_addr learned my addr 172.21.15.55:0/3796569199 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:33.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.817+0000 7fd08f7fe640 1 --2- 172.21.15.55:0/3796569199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0900d0da0 0x7fd0900d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:33.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.817+0000 7fd087fff640 1 --2- 172.21.15.55:0/3796569199 >> v2:172.21.15.110:3300/0 conn(0x7fd0900cdde0 0x7fd0900ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:33.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.817+0000 7fd08effd640 1 -- 172.21.15.55:0/3796569199 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364239865 0 0) 0x7fd0900b29b0 con 0x7fd0900cee60 2023-08-25T04:22:33.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.817+0000 7fd08effd640 1 -- 172.21.15.55:0/3796569199 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd07c003530 con 0x7fd0900cee60 2023-08-25T04:22:33.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.817+0000 7fd08f7fe640 1 -- 172.21.15.55:0/3796569199 >> v2:172.21.15.110:3300/0 conn(0x7fd0900cdde0 msgr2=0x7fd0900ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:33.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.817+0000 7fd08f7fe640 1 --2- 172.21.15.55:0/3796569199 >> v2:172.21.15.110:3300/0 conn(0x7fd0900cdde0 0x7fd0900ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:33.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.817+0000 7fd08f7fe640 1 -- 172.21.15.55:0/3796569199 >> v1:172.21.15.55:6789/0 conn(0x7fd0900cee60 legacy=0x7fd0900cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:33.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.817+0000 7fd08f7fe640 1 -- 172.21.15.55:0/3796569199 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0900b1dc0 con 0x7fd0900d0da0 2023-08-25T04:22:33.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.817+0000 7fd087fff640 1 --2- 172.21.15.55:0/3796569199 >> v2:172.21.15.110:3300/0 conn(0x7fd0900cdde0 0x7fd0900ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T04:22:33.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.821+0000 7fd08f7fe640 1 --2- 172.21.15.55:0/3796569199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0900d0da0 0x7fd0900d1180 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd0800097a0 tx=0x7fd08001ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b23b41afd7c0d0e3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:33.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.821+0000 7fd08effd640 1 -- 172.21.15.55:0/3796569199 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0800a8950 con 0x7fd0900d0da0 2023-08-25T04:22:33.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.821+0000 7fd08effd640 1 -- 172.21.15.55:0/3796569199 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0800a8ab0 con 0x7fd0900d0da0 2023-08-25T04:22:33.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.821+0000 7fd08effd640 1 -- 172.21.15.55:0/3796569199 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0800a8e40 con 0x7fd0900d0da0 2023-08-25T04:22:33.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.821+0000 7fd095c88640 1 -- 172.21.15.55:0/3796569199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0900d0da0 msgr2=0x7fd0900d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:33.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.821+0000 7fd095c88640 1 --2- 172.21.15.55:0/3796569199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0900d0da0 0x7fd0900d1180 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd0800097a0 tx=0x7fd08001ec50 comp rx=0 tx=0).stop 2023-08-25T04:22:33.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.821+0000 7fd095c88640 1 -- 172.21.15.55:0/3796569199 shutdown_connections 2023-08-25T04:22:33.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.821+0000 7fd095c88640 1 --2- 172.21.15.55:0/3796569199 >> v2:172.21.15.110:3300/0 conn(0x7fd0900cdde0 0x7fd0900ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:33.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.821+0000 7fd095c88640 1 --2- 172.21.15.55:0/3796569199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0900d0da0 0x7fd0900d1180 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:33.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.821+0000 7fd095c88640 1 -- 172.21.15.55:0/3796569199 >> 172.21.15.55:0/3796569199 conn(0x7fd09009bae0 msgr2=0x7fd0900d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:33.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.821+0000 7fd095c88640 1 -- 172.21.15.55:0/3796569199 shutdown_connections 2023-08-25T04:22:33.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.821+0000 7fd095c88640 1 -- 172.21.15.55:0/3796569199 wait complete. 2023-08-25T04:22:33.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.821+0000 7fd095c88640 1 Processor -- start 2023-08-25T04:22:33.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.821+0000 7fd095c88640 1 -- start start 2023-08-25T04:22:33.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd095c88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0900cdde0 0x7fd090151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:33.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd095c88640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0900cee60 0x7fd0900c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:33.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd095c88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0900d0da0 0x7fd0900c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:33.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd095c88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900cb160 con 0x7fd0900cdde0 2023-08-25T04:22:33.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd095c88640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900c7ac0 con 0x7fd0900cee60 2023-08-25T04:22:33.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd095c88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd090152280 con 0x7fd0900d0da0 2023-08-25T04:22:33.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd08f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0900cdde0 0x7fd090151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:33.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd08f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0900cdde0 0x7fd090151d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38378/0 (socket says 172.21.15.55:38378) 2023-08-25T04:22:33.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd08f7fe640 1 -- 172.21.15.55:0/1004356114 learned_addr learned my addr 172.21.15.55:0/1004356114 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:33.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd087fff640 1 --2- 172.21.15.55:0/1004356114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0900cee60 0x7fd0900c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd08ffff640 1 --2- 172.21.15.55:0/1004356114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0900d0da0 0x7fd0900c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd08f7fe640 1 -- 172.21.15.55:0/1004356114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0900d0da0 msgr2=0x7fd0900c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd08f7fe640 1 --2- 172.21.15.55:0/1004356114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0900d0da0 0x7fd0900c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd08f7fe640 1 -- 172.21.15.55:0/1004356114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0900cee60 msgr2=0x7fd0900c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd08f7fe640 1 --2- 172.21.15.55:0/1004356114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0900cee60 0x7fd0900c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:33.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd08f7fe640 1 -- 172.21.15.55:0/1004356114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd078009420 con 0x7fd0900cdde0 2023-08-25T04:22:33.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd08f7fe640 1 --2- 172.21.15.55:0/1004356114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0900cdde0 0x7fd090151d40 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fd08001c880 tx=0x7fd08001b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:33.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd08cff9640 1 -- 172.21.15.55:0/1004356114 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0800b0d80 con 0x7fd0900cdde0 2023-08-25T04:22:33.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd08cff9640 1 -- 172.21.15.55:0/1004356114 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0800b9410 con 0x7fd0900cdde0 2023-08-25T04:22:33.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd08cff9640 1 -- 172.21.15.55:0/1004356114 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0800b97c0 con 0x7fd0900cdde0 2023-08-25T04:22:33.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd095c88640 1 -- 172.21.15.55:0/1004356114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0800093b0 con 0x7fd0900cdde0 2023-08-25T04:22:33.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd095c88640 1 -- 172.21.15.55:0/1004356114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0900ca7c0 con 0x7fd0900cdde0 2023-08-25T04:22:33.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd095c88640 1 -- 172.21.15.55:0/1004356114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09004dbe0 con 0x7fd0900cdde0 2023-08-25T04:22:33.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.825+0000 7fd08cff9640 1 -- 172.21.15.55:0/1004356114 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fd0800b7040 con 0x7fd0900cdde0 2023-08-25T04:22:33.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.829+0000 7fd08cff9640 1 --2- 172.21.15.55:0/1004356114 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fd0700657a0 0x7fd070067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:33.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.829+0000 7fd08cff9640 1 -- 172.21.15.55:0/1004356114 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd080120990 con 0x7fd0900cdde0 2023-08-25T04:22:33.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.829+0000 7fd087fff640 1 --2- 172.21.15.55:0/1004356114 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fd0700657a0 0x7fd070067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:33.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.829+0000 7fd087fff640 1 --2- 172.21.15.55:0/1004356114 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fd0700657a0 0x7fd070067c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd09015c360 tx=0x7fd078009190 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:33.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.833+0000 7fd08cff9640 1 -- 172.21.15.55:0/1004356114 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd0800ee340 con 0x7fd0900cdde0 2023-08-25T04:22:33.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.989+0000 7fd095c88640 1 -- 172.21.15.55:0/1004356114 --> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd0900b2360 con 0x7fd0700657a0 2023-08-25T04:22:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:33.997+0000 7fd08cff9640 1 -- 172.21.15.55:0/1004356114 <== mgr.7301 v2:172.21.15.110:6832/3700713436 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311626 (secure 0 0 0) 0x7fd078009960 con 0x7fd0700657a0 2023-08-25T04:22:34.004 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T04:22:34.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.001+0000 7fd095c88640 1 -- 172.21.15.55:0/1004356114 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fd0700657a0 msgr2=0x7fd070067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:34.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.001+0000 7fd095c88640 1 --2- 172.21.15.55:0/1004356114 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fd0700657a0 0x7fd070067c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd09015c360 tx=0x7fd078009190 comp rx=0 tx=0).stop 2023-08-25T04:22:34.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.001+0000 7fd095c88640 1 -- 172.21.15.55:0/1004356114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0900cdde0 msgr2=0x7fd090151d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:34.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.001+0000 7fd095c88640 1 --2- 172.21.15.55:0/1004356114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0900cdde0 0x7fd090151d40 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fd08001c880 tx=0x7fd08001b9f0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.001+0000 7fd095c88640 1 -- 172.21.15.55:0/1004356114 shutdown_connections 2023-08-25T04:22:34.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.001+0000 7fd095c88640 1 --2- 172.21.15.55:0/1004356114 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fd0700657a0 0x7fd070067c60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.001+0000 7fd095c88640 1 --2- 172.21.15.55:0/1004356114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd0900d0da0 0x7fd0900c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.001+0000 7fd095c88640 1 --2- 172.21.15.55:0/1004356114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd0900cee60 0x7fd0900c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.001+0000 7fd095c88640 1 --2- 172.21.15.55:0/1004356114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0900cdde0 0x7fd090151d40 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.001+0000 7fd095c88640 1 -- 172.21.15.55:0/1004356114 >> 172.21.15.55:0/1004356114 conn(0x7fd09009bae0 msgr2=0x7fd0900cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.001+0000 7fd095c88640 1 -- 172.21.15.55:0/1004356114 shutdown_connections 2023-08-25T04:22:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.001+0000 7fd095c88640 1 -- 172.21.15.55:0/1004356114 wait complete. 2023-08-25T04:22:34.020 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-08-25T04:22:33.650640+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1232,"num_read_kb":2549,"num_write":430,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3593,"ondisk_log_size":3593,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":347064,"kb_used_data":14344,"kb_used_omap":13,"kb_used_meta":332594,"kb_avail":754627656,"statfs":{"total":773094113280,"available":772738719744,"internally_reserved":0,"allocated":14688256,"data_stored":7905020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":340576344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.690693"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964341+0000","last_change":"2023-08-25T04:22:24.980160+0000","last_active":"2023-08-25T04:22:25.964341+0000","last_peered":"2023-08-25T04:22:25.964341+0000","last_clean":"2023-08-25T04:22:25.964341+0000","last_became_active":"2023-08-25T04:22:24.979819+0000","last_became_peered":"2023-08-25T04:22:24.979819+0000","last_unstale":"2023-08-25T04:22:25.964341+0000","last_undegraded":"2023-08-25T04:22:25.964341+0000","last_fullsized":"2023-08-25T04:22:25.964341+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:54:24.855039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205880+0000","last_change":"2023-08-25T04:22:24.984110+0000","last_active":"2023-08-25T04:22:26.205880+0000","last_peered":"2023-08-25T04:22:26.205880+0000","last_clean":"2023-08-25T04:22:26.205880+0000","last_became_active":"2023-08-25T04:22:24.983833+0000","last_became_peered":"2023-08-25T04:22:24.983833+0000","last_unstale":"2023-08-25T04:22:26.205880+0000","last_undegraded":"2023-08-25T04:22:26.205880+0000","last_fullsized":"2023-08-25T04:22:26.205880+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:19.130375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206678+0000","last_change":"2023-08-25T04:22:24.980242+0000","last_active":"2023-08-25T04:22:26.206678+0000","last_peered":"2023-08-25T04:22:26.206678+0000","last_clean":"2023-08-25T04:22:26.206678+0000","last_became_active":"2023-08-25T04:22:24.979947+0000","last_became_peered":"2023-08-25T04:22:24.979947+0000","last_unstale":"2023-08-25T04:22:26.206678+0000","last_undegraded":"2023-08-25T04:22:26.206678+0000","last_fullsized":"2023-08-25T04:22:26.206678+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:35:58.759682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204756+0000","last_change":"2023-08-25T04:22:24.967850+0000","last_active":"2023-08-25T04:22:26.204756+0000","last_peered":"2023-08-25T04:22:26.204756+0000","last_clean":"2023-08-25T04:22:26.204756+0000","last_became_active":"2023-08-25T04:22:24.967464+0000","last_became_peered":"2023-08-25T04:22:24.967464+0000","last_unstale":"2023-08-25T04:22:26.204756+0000","last_undegraded":"2023-08-25T04:22:26.204756+0000","last_fullsized":"2023-08-25T04:22:26.204756+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:15:05.316894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964504+0000","last_change":"2023-08-25T04:22:24.974055+0000","last_active":"2023-08-25T04:22:25.964504+0000","last_peered":"2023-08-25T04:22:25.964504+0000","last_clean":"2023-08-25T04:22:25.964504+0000","last_became_active":"2023-08-25T04:22:24.973743+0000","last_became_peered":"2023-08-25T04:22:24.973743+0000","last_unstale":"2023-08-25T04:22:25.964504+0000","last_undegraded":"2023-08-25T04:22:25.964504+0000","last_fullsized":"2023-08-25T04:22:25.964504+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:11:27.537860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205716+0000","last_change":"2023-08-25T04:22:25.003305+0000","last_active":"2023-08-25T04:22:26.205716+0000","last_peered":"2023-08-25T04:22:26.205716+0000","last_clean":"2023-08-25T04:22:26.205716+0000","last_became_active":"2023-08-25T04:22:25.003004+0000","last_became_peered":"2023-08-25T04:22:25.003004+0000","last_unstale":"2023-08-25T04:22:26.205716+0000","last_undegraded":"2023-08-25T04:22:26.205716+0000","last_fullsized":"2023-08-25T04:22:26.205716+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:51:25.392772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205489+0000","last_change":"2023-08-25T04:22:24.989495+0000","last_active":"2023-08-25T04:22:26.205489+0000","last_peered":"2023-08-25T04:22:26.205489+0000","last_clean":"2023-08-25T04:22:26.205489+0000","last_became_active":"2023-08-25T04:22:24.989203+0000","last_became_peered":"2023-08-25T04:22:24.989203+0000","last_unstale":"2023-08-25T04:22:26.205489+0000","last_undegraded":"2023-08-25T04:22:26.205489+0000","last_fullsized":"2023-08-25T04:22:26.205489+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:40.390488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205615+0000","last_change":"2023-08-25T04:22:24.979108+0000","last_active":"2023-08-25T04:22:26.205615+0000","last_peered":"2023-08-25T04:22:26.205615+0000","last_clean":"2023-08-25T04:22:26.205615+0000","last_became_active":"2023-08-25T04:22:24.978466+0000","last_became_peered":"2023-08-25T04:22:24.978466+0000","last_unstale":"2023-08-25T04:22:26.205615+0000","last_undegraded":"2023-08-25T04:22:26.205615+0000","last_fullsized":"2023-08-25T04:22:26.205615+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:18:31.333780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204900+0000","last_change":"2023-08-25T04:22:24.971968+0000","last_active":"2023-08-25T04:22:26.204900+0000","last_peered":"2023-08-25T04:22:26.204900+0000","last_clean":"2023-08-25T04:22:26.204900+0000","last_became_active":"2023-08-25T04:22:24.971520+0000","last_became_peered":"2023-08-25T04:22:24.971520+0000","last_unstale":"2023-08-25T04:22:26.204900+0000","last_undegraded":"2023-08-25T04:22:26.204900+0000","last_fullsized":"2023-08-25T04:22:26.204900+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:31:40.767462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964324+0000","last_change":"2023-08-25T04:22:24.992802+0000","last_active":"2023-08-25T04:22:25.964324+0000","last_peered":"2023-08-25T04:22:25.964324+0000","last_clean":"2023-08-25T04:22:25.964324+0000","last_became_active":"2023-08-25T04:22:24.992482+0000","last_became_peered":"2023-08-25T04:22:24.992482+0000","last_unstale":"2023-08-25T04:22:25.964324+0000","last_undegraded":"2023-08-25T04:22:25.964324+0000","last_fullsized":"2023-08-25T04:22:25.964324+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:47:02.262159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964006+0000","last_change":"2023-08-25T04:22:24.984162+0000","last_active":"2023-08-25T04:22:25.964006+0000","last_peered":"2023-08-25T04:22:25.964006+0000","last_clean":"2023-08-25T04:22:25.964006+0000","last_became_active":"2023-08-25T04:22:24.983860+0000","last_became_peered":"2023-08-25T04:22:24.983860+0000","last_unstale":"2023-08-25T04:22:25.964006+0000","last_undegraded":"2023-08-25T04:22:25.964006+0000","last_fullsized":"2023-08-25T04:22:25.964006+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:52:46.328332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206070+0000","last_change":"2023-08-25T04:22:24.994560+0000","last_active":"2023-08-25T04:22:26.206070+0000","last_peered":"2023-08-25T04:22:26.206070+0000","last_clean":"2023-08-25T04:22:26.206070+0000","last_became_active":"2023-08-25T04:22:24.991957+0000","last_became_peered":"2023-08-25T04:22:24.991957+0000","last_unstale":"2023-08-25T04:22:26.206070+0000","last_undegraded":"2023-08-25T04:22:26.206070+0000","last_fullsized":"2023-08-25T04:22:26.206070+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:39:01.013890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964164+0000","last_change":"2023-08-25T04:22:24.989968+0000","last_active":"2023-08-25T04:22:25.964164+0000","last_peered":"2023-08-25T04:22:25.964164+0000","last_clean":"2023-08-25T04:22:25.964164+0000","last_became_active":"2023-08-25T04:22:24.989686+0000","last_became_peered":"2023-08-25T04:22:24.989686+0000","last_unstale":"2023-08-25T04:22:25.964164+0000","last_undegraded":"2023-08-25T04:22:25.964164+0000","last_fullsized":"2023-08-25T04:22:25.964164+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:19:35.918305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206776+0000","last_change":"2023-08-25T04:22:24.987770+0000","last_active":"2023-08-25T04:22:26.206776+0000","last_peered":"2023-08-25T04:22:26.206776+0000","last_clean":"2023-08-25T04:22:26.206776+0000","last_became_active":"2023-08-25T04:22:24.980118+0000","last_became_peered":"2023-08-25T04:22:24.980118+0000","last_unstale":"2023-08-25T04:22:26.206776+0000","last_undegraded":"2023-08-25T04:22:26.206776+0000","last_fullsized":"2023-08-25T04:22:26.206776+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:47:48.315800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.963965+0000","last_change":"2023-08-25T04:22:24.986598+0000","last_active":"2023-08-25T04:22:25.963965+0000","last_peered":"2023-08-25T04:22:25.963965+0000","last_clean":"2023-08-25T04:22:25.963965+0000","last_became_active":"2023-08-25T04:22:24.986222+0000","last_became_peered":"2023-08-25T04:22:24.986222+0000","last_unstale":"2023-08-25T04:22:25.963965+0000","last_undegraded":"2023-08-25T04:22:25.963965+0000","last_fullsized":"2023-08-25T04:22:25.963965+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:20:05.410997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206217+0000","last_change":"2023-08-25T04:22:24.997307+0000","last_active":"2023-08-25T04:22:26.206217+0000","last_peered":"2023-08-25T04:22:26.206217+0000","last_clean":"2023-08-25T04:22:26.206217+0000","last_became_active":"2023-08-25T04:22:24.997034+0000","last_became_peered":"2023-08-25T04:22:24.997034+0000","last_unstale":"2023-08-25T04:22:26.206217+0000","last_undegraded":"2023-08-25T04:22:26.206217+0000","last_fullsized":"2023-08-25T04:22:26.206217+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:30.167507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964468+0000","last_change":"2023-08-25T04:22:24.994912+0000","last_active":"2023-08-25T04:22:25.964468+0000","last_peered":"2023-08-25T04:22:25.964468+0000","last_clean":"2023-08-25T04:22:25.964468+0000","last_became_active":"2023-08-25T04:22:24.994634+0000","last_became_peered":"2023-08-25T04:22:24.994634+0000","last_unstale":"2023-08-25T04:22:25.964468+0000","last_undegraded":"2023-08-25T04:22:25.964468+0000","last_fullsized":"2023-08-25T04:22:25.964468+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:35:18.722412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206017+0000","last_change":"2023-08-25T04:22:24.985919+0000","last_active":"2023-08-25T04:22:26.206017+0000","last_peered":"2023-08-25T04:22:26.206017+0000","last_clean":"2023-08-25T04:22:26.206017+0000","last_became_active":"2023-08-25T04:22:24.985596+0000","last_became_peered":"2023-08-25T04:22:24.985596+0000","last_unstale":"2023-08-25T04:22:26.206017+0000","last_undegraded":"2023-08-25T04:22:26.206017+0000","last_fullsized":"2023-08-25T04:22:26.206017+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:54.188602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964341+0000","last_change":"2023-08-25T04:22:24.976285+0000","last_active":"2023-08-25T04:22:25.964341+0000","last_peered":"2023-08-25T04:22:25.964341+0000","last_clean":"2023-08-25T04:22:25.964341+0000","last_became_active":"2023-08-25T04:22:24.975957+0000","last_became_peered":"2023-08-25T04:22:24.975957+0000","last_unstale":"2023-08-25T04:22:25.964341+0000","last_undegraded":"2023-08-25T04:22:25.964341+0000","last_fullsized":"2023-08-25T04:22:25.964341+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:31:32.308329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205321+0000","last_change":"2023-08-25T04:22:24.997826+0000","last_active":"2023-08-25T04:22:26.205321+0000","last_peered":"2023-08-25T04:22:26.205321+0000","last_clean":"2023-08-25T04:22:26.205321+0000","last_became_active":"2023-08-25T04:22:24.997523+0000","last_became_peered":"2023-08-25T04:22:24.997523+0000","last_unstale":"2023-08-25T04:22:26.205321+0000","last_undegraded":"2023-08-25T04:22:26.205321+0000","last_fullsized":"2023-08-25T04:22:26.205321+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:49.402784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204493+0000","last_change":"2023-08-25T04:22:24.986733+0000","last_active":"2023-08-25T04:22:26.204493+0000","last_peered":"2023-08-25T04:22:26.204493+0000","last_clean":"2023-08-25T04:22:26.204493+0000","last_became_active":"2023-08-25T04:22:24.986451+0000","last_became_peered":"2023-08-25T04:22:24.986451+0000","last_unstale":"2023-08-25T04:22:26.204493+0000","last_undegraded":"2023-08-25T04:22:26.204493+0000","last_fullsized":"2023-08-25T04:22:26.204493+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:34:34.985760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964257+0000","last_change":"2023-08-25T04:22:24.974093+0000","last_active":"2023-08-25T04:22:25.964257+0000","last_peered":"2023-08-25T04:22:25.964257+0000","last_clean":"2023-08-25T04:22:25.964257+0000","last_became_active":"2023-08-25T04:22:24.973777+0000","last_became_peered":"2023-08-25T04:22:24.973777+0000","last_unstale":"2023-08-25T04:22:25.964257+0000","last_undegraded":"2023-08-25T04:22:25.964257+0000","last_fullsized":"2023-08-25T04:22:25.964257+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:03.889864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204118+0000","last_change":"2023-08-25T04:22:24.971791+0000","last_active":"2023-08-25T04:22:26.204118+0000","last_peered":"2023-08-25T04:22:26.204118+0000","last_clean":"2023-08-25T04:22:26.204118+0000","last_became_active":"2023-08-25T04:22:24.971512+0000","last_became_peered":"2023-08-25T04:22:24.971512+0000","last_unstale":"2023-08-25T04:22:26.204118+0000","last_undegraded":"2023-08-25T04:22:26.204118+0000","last_fullsized":"2023-08-25T04:22:26.204118+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:55.716380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204451+0000","last_change":"2023-08-25T04:22:24.984931+0000","last_active":"2023-08-25T04:22:26.204451+0000","last_peered":"2023-08-25T04:22:26.204451+0000","last_clean":"2023-08-25T04:22:26.204451+0000","last_became_active":"2023-08-25T04:22:24.983776+0000","last_became_peered":"2023-08-25T04:22:24.983776+0000","last_unstale":"2023-08-25T04:22:26.204451+0000","last_undegraded":"2023-08-25T04:22:26.204451+0000","last_fullsized":"2023-08-25T04:22:26.204451+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:45.770499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205203+0000","last_change":"2023-08-25T04:22:24.988545+0000","last_active":"2023-08-25T04:22:26.205203+0000","last_peered":"2023-08-25T04:22:26.205203+0000","last_clean":"2023-08-25T04:22:26.205203+0000","last_became_active":"2023-08-25T04:22:24.987759+0000","last_became_peered":"2023-08-25T04:22:24.987759+0000","last_unstale":"2023-08-25T04:22:26.205203+0000","last_undegraded":"2023-08-25T04:22:26.205203+0000","last_fullsized":"2023-08-25T04:22:26.205203+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:46:11.761122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205641+0000","last_change":"2023-08-25T04:22:24.987279+0000","last_active":"2023-08-25T04:22:26.205641+0000","last_peered":"2023-08-25T04:22:26.205641+0000","last_clean":"2023-08-25T04:22:26.205641+0000","last_became_active":"2023-08-25T04:22:24.986999+0000","last_became_peered":"2023-08-25T04:22:24.986999+0000","last_unstale":"2023-08-25T04:22:26.205641+0000","last_undegraded":"2023-08-25T04:22:26.205641+0000","last_fullsized":"2023-08-25T04:22:26.205641+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:38:02.874638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964476+0000","last_change":"2023-08-25T04:22:24.972732+0000","last_active":"2023-08-25T04:22:25.964476+0000","last_peered":"2023-08-25T04:22:25.964476+0000","last_clean":"2023-08-25T04:22:25.964476+0000","last_became_active":"2023-08-25T04:22:24.972382+0000","last_became_peered":"2023-08-25T04:22:24.972382+0000","last_unstale":"2023-08-25T04:22:25.964476+0000","last_undegraded":"2023-08-25T04:22:25.964476+0000","last_fullsized":"2023-08-25T04:22:25.964476+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:09:19.698330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206133+0000","last_change":"2023-08-25T04:22:24.996718+0000","last_active":"2023-08-25T04:22:26.206133+0000","last_peered":"2023-08-25T04:22:26.206133+0000","last_clean":"2023-08-25T04:22:26.206133+0000","last_became_active":"2023-08-25T04:22:24.996420+0000","last_became_peered":"2023-08-25T04:22:24.996420+0000","last_unstale":"2023-08-25T04:22:26.206133+0000","last_undegraded":"2023-08-25T04:22:26.206133+0000","last_fullsized":"2023-08-25T04:22:26.206133+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:56.492659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205299+0000","last_change":"2023-08-25T04:22:24.999223+0000","last_active":"2023-08-25T04:22:26.205299+0000","last_peered":"2023-08-25T04:22:26.205299+0000","last_clean":"2023-08-25T04:22:26.205299+0000","last_became_active":"2023-08-25T04:22:24.998811+0000","last_became_peered":"2023-08-25T04:22:24.998811+0000","last_unstale":"2023-08-25T04:22:26.205299+0000","last_undegraded":"2023-08-25T04:22:26.205299+0000","last_fullsized":"2023-08-25T04:22:26.205299+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:20:11.946216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206840+0000","last_change":"2023-08-25T04:22:24.977279+0000","last_active":"2023-08-25T04:22:26.206840+0000","last_peered":"2023-08-25T04:22:26.206840+0000","last_clean":"2023-08-25T04:22:26.206840+0000","last_became_active":"2023-08-25T04:22:24.976837+0000","last_became_peered":"2023-08-25T04:22:24.976837+0000","last_unstale":"2023-08-25T04:22:26.206840+0000","last_undegraded":"2023-08-25T04:22:26.206840+0000","last_fullsized":"2023-08-25T04:22:26.206840+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:32.849194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204228+0000","last_change":"2023-08-25T04:22:24.991026+0000","last_active":"2023-08-25T04:22:26.204228+0000","last_peered":"2023-08-25T04:22:26.204228+0000","last_clean":"2023-08-25T04:22:26.204228+0000","last_became_active":"2023-08-25T04:22:24.989826+0000","last_became_peered":"2023-08-25T04:22:24.989826+0000","last_unstale":"2023-08-25T04:22:26.204228+0000","last_undegraded":"2023-08-25T04:22:26.204228+0000","last_fullsized":"2023-08-25T04:22:26.204228+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:48:24.022318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204007+0000","last_change":"2023-08-25T04:22:24.983898+0000","last_active":"2023-08-25T04:22:26.204007+0000","last_peered":"2023-08-25T04:22:26.204007+0000","last_clean":"2023-08-25T04:22:26.204007+0000","last_became_active":"2023-08-25T04:22:24.983418+0000","last_became_peered":"2023-08-25T04:22:24.983418+0000","last_unstale":"2023-08-25T04:22:26.204007+0000","last_undegraded":"2023-08-25T04:22:26.204007+0000","last_fullsized":"2023-08-25T04:22:26.204007+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:50:57.280394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964302+0000","last_change":"2023-08-25T04:22:24.994393+0000","last_active":"2023-08-25T04:22:25.964302+0000","last_peered":"2023-08-25T04:22:25.964302+0000","last_clean":"2023-08-25T04:22:25.964302+0000","last_became_active":"2023-08-25T04:22:24.994120+0000","last_became_peered":"2023-08-25T04:22:24.994120+0000","last_unstale":"2023-08-25T04:22:25.964302+0000","last_undegraded":"2023-08-25T04:22:25.964302+0000","last_fullsized":"2023-08-25T04:22:25.964302+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:19:47.445600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"135'4","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964948+0000","last_change":"2023-08-25T04:22:23.939086+0000","last_active":"2023-08-25T04:22:25.964948+0000","last_peered":"2023-08-25T04:22:25.964948+0000","last_clean":"2023-08-25T04:22:25.964948+0000","last_became_active":"2023-08-25T04:22:23.938752+0000","last_became_peered":"2023-08-25T04:22:23.938752+0000","last_unstale":"2023-08-25T04:22:25.964948+0000","last_undegraded":"2023-08-25T04:22:25.964948+0000","last_fullsized":"2023-08-25T04:22:25.964948+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:29:02.883614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205864+0000","last_change":"2023-08-25T04:22:25.003212+0000","last_active":"2023-08-25T04:22:26.205864+0000","last_peered":"2023-08-25T04:22:26.205864+0000","last_clean":"2023-08-25T04:22:26.205864+0000","last_became_active":"2023-08-25T04:22:25.002912+0000","last_became_peered":"2023-08-25T04:22:25.002912+0000","last_unstale":"2023-08-25T04:22:26.205864+0000","last_undegraded":"2023-08-25T04:22:26.205864+0000","last_fullsized":"2023-08-25T04:22:26.205864+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:14:30.577755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"135'1","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964441+0000","last_change":"2023-08-25T04:22:23.945578+0000","last_active":"2023-08-25T04:22:25.964441+0000","last_peered":"2023-08-25T04:22:25.964441+0000","last_clean":"2023-08-25T04:22:25.964441+0000","last_became_active":"2023-08-25T04:22:23.943682+0000","last_became_peered":"2023-08-25T04:22:23.943682+0000","last_unstale":"2023-08-25T04:22:25.964441+0000","last_undegraded":"2023-08-25T04:22:25.964441+0000","last_fullsized":"2023-08-25T04:22:25.964441+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:08:27.693453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204753+0000","last_change":"2023-08-25T04:22:24.995628+0000","last_active":"2023-08-25T04:22:26.204753+0000","last_peered":"2023-08-25T04:22:26.204753+0000","last_clean":"2023-08-25T04:22:26.204753+0000","last_became_active":"2023-08-25T04:22:24.995241+0000","last_became_peered":"2023-08-25T04:22:24.995241+0000","last_unstale":"2023-08-25T04:22:26.204753+0000","last_undegraded":"2023-08-25T04:22:26.204753+0000","last_fullsized":"2023-08-25T04:22:26.204753+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:10:47.097275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"135'2","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204909+0000","last_change":"2023-08-25T04:22:23.943083+0000","last_active":"2023-08-25T04:22:26.204909+0000","last_peered":"2023-08-25T04:22:26.204909+0000","last_clean":"2023-08-25T04:22:26.204909+0000","last_became_active":"2023-08-25T04:22:23.942760+0000","last_became_peered":"2023-08-25T04:22:23.942760+0000","last_unstale":"2023-08-25T04:22:26.204909+0000","last_undegraded":"2023-08-25T04:22:26.204909+0000","last_fullsized":"2023-08-25T04:22:26.204909+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:57:55.603209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204374+0000","last_change":"2023-08-25T04:22:24.992702+0000","last_active":"2023-08-25T04:22:26.204374+0000","last_peered":"2023-08-25T04:22:26.204374+0000","last_clean":"2023-08-25T04:22:26.204374+0000","last_became_active":"2023-08-25T04:22:24.992406+0000","last_became_peered":"2023-08-25T04:22:24.992406+0000","last_unstale":"2023-08-25T04:22:26.204374+0000","last_undegraded":"2023-08-25T04:22:26.204374+0000","last_fullsized":"2023-08-25T04:22:26.204374+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:11.448723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"135'2","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964321+0000","last_change":"2023-08-25T04:22:23.936987+0000","last_active":"2023-08-25T04:22:25.964321+0000","last_peered":"2023-08-25T04:22:25.964321+0000","last_clean":"2023-08-25T04:22:25.964321+0000","last_became_active":"2023-08-25T04:22:23.936122+0000","last_became_peered":"2023-08-25T04:22:23.936122+0000","last_unstale":"2023-08-25T04:22:25.964321+0000","last_undegraded":"2023-08-25T04:22:25.964321+0000","last_fullsized":"2023-08-25T04:22:25.964321+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:18:53.632727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.963950+0000","last_change":"2023-08-25T04:22:24.985581+0000","last_active":"2023-08-25T04:22:25.963950+0000","last_peered":"2023-08-25T04:22:25.963950+0000","last_clean":"2023-08-25T04:22:25.963950+0000","last_became_active":"2023-08-25T04:22:24.985265+0000","last_became_peered":"2023-08-25T04:22:24.985265+0000","last_unstale":"2023-08-25T04:22:25.963950+0000","last_undegraded":"2023-08-25T04:22:25.963950+0000","last_fullsized":"2023-08-25T04:22:25.963950+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:51:21.272105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"135'1","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964548+0000","last_change":"2023-08-25T04:22:23.935374+0000","last_active":"2023-08-25T04:22:25.964548+0000","last_peered":"2023-08-25T04:22:25.964548+0000","last_clean":"2023-08-25T04:22:25.964548+0000","last_became_active":"2023-08-25T04:22:23.935042+0000","last_became_peered":"2023-08-25T04:22:23.935042+0000","last_unstale":"2023-08-25T04:22:25.964548+0000","last_undegraded":"2023-08-25T04:22:25.964548+0000","last_fullsized":"2023-08-25T04:22:25.964548+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:46:59.332786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.963948+0000","last_change":"2023-08-25T04:22:24.967494+0000","last_active":"2023-08-25T04:22:25.963948+0000","last_peered":"2023-08-25T04:22:25.963948+0000","last_clean":"2023-08-25T04:22:25.963948+0000","last_became_active":"2023-08-25T04:22:24.967152+0000","last_became_peered":"2023-08-25T04:22:24.967152+0000","last_unstale":"2023-08-25T04:22:25.963948+0000","last_undegraded":"2023-08-25T04:22:25.963948+0000","last_fullsized":"2023-08-25T04:22:25.963948+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:22:15.124047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"135'1","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205756+0000","last_change":"2023-08-25T04:22:23.954752+0000","last_active":"2023-08-25T04:22:26.205756+0000","last_peered":"2023-08-25T04:22:26.205756+0000","last_clean":"2023-08-25T04:22:26.205756+0000","last_became_active":"2023-08-25T04:22:23.954364+0000","last_became_peered":"2023-08-25T04:22:23.954364+0000","last_unstale":"2023-08-25T04:22:26.205756+0000","last_undegraded":"2023-08-25T04:22:26.205756+0000","last_fullsized":"2023-08-25T04:22:26.205756+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:38:10.408336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206897+0000","last_change":"2023-08-25T04:22:24.987561+0000","last_active":"2023-08-25T04:22:26.206897+0000","last_peered":"2023-08-25T04:22:26.206897+0000","last_clean":"2023-08-25T04:22:26.206897+0000","last_became_active":"2023-08-25T04:22:24.986656+0000","last_became_peered":"2023-08-25T04:22:24.986656+0000","last_unstale":"2023-08-25T04:22:26.206897+0000","last_undegraded":"2023-08-25T04:22:26.206897+0000","last_fullsized":"2023-08-25T04:22:26.206897+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:47:55.425168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204332+0000","last_change":"2023-08-25T04:22:23.939447+0000","last_active":"2023-08-25T04:22:26.204332+0000","last_peered":"2023-08-25T04:22:26.204332+0000","last_clean":"2023-08-25T04:22:26.204332+0000","last_became_active":"2023-08-25T04:22:23.939163+0000","last_became_peered":"2023-08-25T04:22:23.939163+0000","last_unstale":"2023-08-25T04:22:26.204332+0000","last_undegraded":"2023-08-25T04:22:26.204332+0000","last_fullsized":"2023-08-25T04:22:26.204332+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:39.384237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964131+0000","last_change":"2023-08-25T04:22:24.986173+0000","last_active":"2023-08-25T04:22:25.964131+0000","last_peered":"2023-08-25T04:22:25.964131+0000","last_clean":"2023-08-25T04:22:25.964131+0000","last_became_active":"2023-08-25T04:22:24.985930+0000","last_became_peered":"2023-08-25T04:22:24.985930+0000","last_unstale":"2023-08-25T04:22:25.964131+0000","last_undegraded":"2023-08-25T04:22:25.964131+0000","last_fullsized":"2023-08-25T04:22:25.964131+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:30:42.063939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206544+0000","last_change":"2023-08-25T04:22:23.949373+0000","last_active":"2023-08-25T04:22:26.206544+0000","last_peered":"2023-08-25T04:22:26.206544+0000","last_clean":"2023-08-25T04:22:26.206544+0000","last_became_active":"2023-08-25T04:22:23.949016+0000","last_became_peered":"2023-08-25T04:22:23.949016+0000","last_unstale":"2023-08-25T04:22:26.206544+0000","last_undegraded":"2023-08-25T04:22:26.206544+0000","last_fullsized":"2023-08-25T04:22:26.206544+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:37.798379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204294+0000","last_change":"2023-08-25T04:22:24.995550+0000","last_active":"2023-08-25T04:22:26.204294+0000","last_peered":"2023-08-25T04:22:26.204294+0000","last_clean":"2023-08-25T04:22:26.204294+0000","last_became_active":"2023-08-25T04:22:24.995194+0000","last_became_peered":"2023-08-25T04:22:24.995194+0000","last_unstale":"2023-08-25T04:22:26.204294+0000","last_undegraded":"2023-08-25T04:22:26.204294+0000","last_fullsized":"2023-08-25T04:22:26.204294+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:15:07.728544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"135'1","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964281+0000","last_change":"2023-08-25T04:22:23.950360+0000","last_active":"2023-08-25T04:22:25.964281+0000","last_peered":"2023-08-25T04:22:25.964281+0000","last_clean":"2023-08-25T04:22:25.964281+0000","last_became_active":"2023-08-25T04:22:23.949970+0000","last_became_peered":"2023-08-25T04:22:23.949970+0000","last_unstale":"2023-08-25T04:22:25.964281+0000","last_undegraded":"2023-08-25T04:22:25.964281+0000","last_fullsized":"2023-08-25T04:22:25.964281+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:35:31.393426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964710+0000","last_change":"2023-08-25T04:22:24.973304+0000","last_active":"2023-08-25T04:22:25.964710+0000","last_peered":"2023-08-25T04:22:25.964710+0000","last_clean":"2023-08-25T04:22:25.964710+0000","last_became_active":"2023-08-25T04:22:24.972966+0000","last_became_peered":"2023-08-25T04:22:24.972966+0000","last_unstale":"2023-08-25T04:22:25.964710+0000","last_undegraded":"2023-08-25T04:22:25.964710+0000","last_fullsized":"2023-08-25T04:22:25.964710+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:19:47.310378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"135'2","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205861+0000","last_change":"2023-08-25T04:22:23.952200+0000","last_active":"2023-08-25T04:22:26.205861+0000","last_peered":"2023-08-25T04:22:26.205861+0000","last_clean":"2023-08-25T04:22:26.205861+0000","last_became_active":"2023-08-25T04:22:23.951889+0000","last_became_peered":"2023-08-25T04:22:23.951889+0000","last_unstale":"2023-08-25T04:22:26.205861+0000","last_undegraded":"2023-08-25T04:22:26.205861+0000","last_fullsized":"2023-08-25T04:22:26.205861+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:04:29.621868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206484+0000","last_change":"2023-08-25T04:22:24.990122+0000","last_active":"2023-08-25T04:22:26.206484+0000","last_peered":"2023-08-25T04:22:26.206484+0000","last_clean":"2023-08-25T04:22:26.206484+0000","last_became_active":"2023-08-25T04:22:24.989765+0000","last_became_peered":"2023-08-25T04:22:24.989765+0000","last_unstale":"2023-08-25T04:22:26.206484+0000","last_undegraded":"2023-08-25T04:22:26.206484+0000","last_fullsized":"2023-08-25T04:22:26.206484+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:43:42.693750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"135'1","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204988+0000","last_change":"2023-08-25T04:22:23.941276+0000","last_active":"2023-08-25T04:22:26.204988+0000","last_peered":"2023-08-25T04:22:26.204988+0000","last_clean":"2023-08-25T04:22:26.204988+0000","last_became_active":"2023-08-25T04:22:23.941003+0000","last_became_peered":"2023-08-25T04:22:23.941003+0000","last_unstale":"2023-08-25T04:22:26.204988+0000","last_undegraded":"2023-08-25T04:22:26.204988+0000","last_fullsized":"2023-08-25T04:22:26.204988+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:43:25.869524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205335+0000","last_change":"2023-08-25T04:22:24.988711+0000","last_active":"2023-08-25T04:22:26.205335+0000","last_peered":"2023-08-25T04:22:26.205335+0000","last_clean":"2023-08-25T04:22:26.205335+0000","last_became_active":"2023-08-25T04:22:24.988233+0000","last_became_peered":"2023-08-25T04:22:24.988233+0000","last_unstale":"2023-08-25T04:22:26.205335+0000","last_undegraded":"2023-08-25T04:22:26.205335+0000","last_fullsized":"2023-08-25T04:22:26.205335+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:13:11.822457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204767+0000","last_change":"2023-08-25T04:22:23.951309+0000","last_active":"2023-08-25T04:22:26.204767+0000","last_peered":"2023-08-25T04:22:26.204767+0000","last_clean":"2023-08-25T04:22:26.204767+0000","last_became_active":"2023-08-25T04:22:23.951005+0000","last_became_peered":"2023-08-25T04:22:23.951005+0000","last_unstale":"2023-08-25T04:22:26.204767+0000","last_undegraded":"2023-08-25T04:22:26.204767+0000","last_fullsized":"2023-08-25T04:22:26.204767+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:18:58.996099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206343+0000","last_change":"2023-08-25T04:22:24.993127+0000","last_active":"2023-08-25T04:22:26.206343+0000","last_peered":"2023-08-25T04:22:26.206343+0000","last_clean":"2023-08-25T04:22:26.206343+0000","last_became_active":"2023-08-25T04:22:24.992643+0000","last_became_peered":"2023-08-25T04:22:24.992643+0000","last_unstale":"2023-08-25T04:22:26.206343+0000","last_undegraded":"2023-08-25T04:22:26.206343+0000","last_fullsized":"2023-08-25T04:22:26.206343+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:46:04.552286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"135'2","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205646+0000","last_change":"2023-08-25T04:22:23.951668+0000","last_active":"2023-08-25T04:22:26.205646+0000","last_peered":"2023-08-25T04:22:26.205646+0000","last_clean":"2023-08-25T04:22:26.205646+0000","last_became_active":"2023-08-25T04:22:23.951292+0000","last_became_peered":"2023-08-25T04:22:23.951292+0000","last_unstale":"2023-08-25T04:22:26.205646+0000","last_undegraded":"2023-08-25T04:22:26.205646+0000","last_fullsized":"2023-08-25T04:22:26.205646+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:51:27.882156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206310+0000","last_change":"2023-08-25T04:22:24.988137+0000","last_active":"2023-08-25T04:22:26.206310+0000","last_peered":"2023-08-25T04:22:26.206310+0000","last_clean":"2023-08-25T04:22:26.206310+0000","last_became_active":"2023-08-25T04:22:24.987859+0000","last_became_peered":"2023-08-25T04:22:24.987859+0000","last_unstale":"2023-08-25T04:22:26.206310+0000","last_undegraded":"2023-08-25T04:22:26.206310+0000","last_fullsized":"2023-08-25T04:22:26.206310+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:20:01.423528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204381+0000","last_change":"2023-08-25T04:22:23.940568+0000","last_active":"2023-08-25T04:22:26.204381+0000","last_peered":"2023-08-25T04:22:26.204381+0000","last_clean":"2023-08-25T04:22:26.204381+0000","last_became_active":"2023-08-25T04:22:23.940255+0000","last_became_peered":"2023-08-25T04:22:23.940255+0000","last_unstale":"2023-08-25T04:22:26.204381+0000","last_undegraded":"2023-08-25T04:22:26.204381+0000","last_fullsized":"2023-08-25T04:22:26.204381+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:57:23.695875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.207016+0000","last_change":"2023-08-25T04:22:24.980057+0000","last_active":"2023-08-25T04:22:26.207016+0000","last_peered":"2023-08-25T04:22:26.207016+0000","last_clean":"2023-08-25T04:22:26.207016+0000","last_became_active":"2023-08-25T04:22:24.979725+0000","last_became_peered":"2023-08-25T04:22:24.979725+0000","last_unstale":"2023-08-25T04:22:26.207016+0000","last_undegraded":"2023-08-25T04:22:26.207016+0000","last_fullsized":"2023-08-25T04:22:26.207016+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:54:50.327192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206540+0000","last_change":"2023-08-25T04:22:23.952275+0000","last_active":"2023-08-25T04:22:26.206540+0000","last_peered":"2023-08-25T04:22:26.206540+0000","last_clean":"2023-08-25T04:22:26.206540+0000","last_became_active":"2023-08-25T04:22:23.951935+0000","last_became_peered":"2023-08-25T04:22:23.951935+0000","last_unstale":"2023-08-25T04:22:26.206540+0000","last_undegraded":"2023-08-25T04:22:26.206540+0000","last_fullsized":"2023-08-25T04:22:26.206540+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:23:13.707641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204529+0000","last_change":"2023-08-25T04:22:24.997117+0000","last_active":"2023-08-25T04:22:26.204529+0000","last_peered":"2023-08-25T04:22:26.204529+0000","last_clean":"2023-08-25T04:22:26.204529+0000","last_became_active":"2023-08-25T04:22:24.996854+0000","last_became_peered":"2023-08-25T04:22:24.996854+0000","last_unstale":"2023-08-25T04:22:26.204529+0000","last_undegraded":"2023-08-25T04:22:26.204529+0000","last_fullsized":"2023-08-25T04:22:26.204529+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:51:28.888407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.203755+0000","last_change":"2023-08-25T04:22:23.942906+0000","last_active":"2023-08-25T04:22:26.203755+0000","last_peered":"2023-08-25T04:22:26.203755+0000","last_clean":"2023-08-25T04:22:26.203755+0000","last_became_active":"2023-08-25T04:22:23.942635+0000","last_became_peered":"2023-08-25T04:22:23.942635+0000","last_unstale":"2023-08-25T04:22:26.203755+0000","last_undegraded":"2023-08-25T04:22:26.203755+0000","last_fullsized":"2023-08-25T04:22:26.203755+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:48:16.866068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206199+0000","last_change":"2023-08-25T04:22:25.000112+0000","last_active":"2023-08-25T04:22:26.206199+0000","last_peered":"2023-08-25T04:22:26.206199+0000","last_clean":"2023-08-25T04:22:26.206199+0000","last_became_active":"2023-08-25T04:22:24.999839+0000","last_became_peered":"2023-08-25T04:22:24.999839+0000","last_unstale":"2023-08-25T04:22:26.206199+0000","last_undegraded":"2023-08-25T04:22:26.206199+0000","last_fullsized":"2023-08-25T04:22:26.206199+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:46:11.761122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"135'2","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206039+0000","last_change":"2023-08-25T04:22:23.949512+0000","last_active":"2023-08-25T04:22:26.206039+0000","last_peered":"2023-08-25T04:22:26.206039+0000","last_clean":"2023-08-25T04:22:26.206039+0000","last_became_active":"2023-08-25T04:22:23.949089+0000","last_became_peered":"2023-08-25T04:22:23.949089+0000","last_unstale":"2023-08-25T04:22:26.206039+0000","last_undegraded":"2023-08-25T04:22:26.206039+0000","last_fullsized":"2023-08-25T04:22:26.206039+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:10:46.091024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964232+0000","last_change":"2023-08-25T04:22:24.985747+0000","last_active":"2023-08-25T04:22:25.964232+0000","last_peered":"2023-08-25T04:22:25.964232+0000","last_clean":"2023-08-25T04:22:25.964232+0000","last_became_active":"2023-08-25T04:22:24.985464+0000","last_became_peered":"2023-08-25T04:22:24.985464+0000","last_unstale":"2023-08-25T04:22:25.964232+0000","last_undegraded":"2023-08-25T04:22:25.964232+0000","last_fullsized":"2023-08-25T04:22:25.964232+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:16:56.375321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"136'1","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964226+0000","last_change":"2023-08-25T04:22:23.950792+0000","last_active":"2023-08-25T04:22:25.964226+0000","last_peered":"2023-08-25T04:22:25.964226+0000","last_clean":"2023-08-25T04:22:25.964226+0000","last_became_active":"2023-08-25T04:22:23.950452+0000","last_became_peered":"2023-08-25T04:22:23.950452+0000","last_unstale":"2023-08-25T04:22:25.964226+0000","last_undegraded":"2023-08-25T04:22:25.964226+0000","last_fullsized":"2023-08-25T04:22:25.964226+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:40:57.683800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204971+0000","last_change":"2023-08-25T04:22:24.967748+0000","last_active":"2023-08-25T04:22:26.204971+0000","last_peered":"2023-08-25T04:22:26.204971+0000","last_clean":"2023-08-25T04:22:26.204971+0000","last_became_active":"2023-08-25T04:22:24.967392+0000","last_became_peered":"2023-08-25T04:22:24.967392+0000","last_unstale":"2023-08-25T04:22:26.204971+0000","last_undegraded":"2023-08-25T04:22:26.204971+0000","last_fullsized":"2023-08-25T04:22:26.204971+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:02:48.603704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964565+0000","last_change":"2023-08-25T04:22:23.950199+0000","last_active":"2023-08-25T04:22:25.964565+0000","last_peered":"2023-08-25T04:22:25.964565+0000","last_clean":"2023-08-25T04:22:25.964565+0000","last_became_active":"2023-08-25T04:22:23.949899+0000","last_became_peered":"2023-08-25T04:22:23.949899+0000","last_unstale":"2023-08-25T04:22:25.964565+0000","last_undegraded":"2023-08-25T04:22:25.964565+0000","last_fullsized":"2023-08-25T04:22:25.964565+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:20:04.404746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205521+0000","last_change":"2023-08-25T04:22:24.990681+0000","last_active":"2023-08-25T04:22:26.205521+0000","last_peered":"2023-08-25T04:22:26.205521+0000","last_clean":"2023-08-25T04:22:26.205521+0000","last_became_active":"2023-08-25T04:22:24.990410+0000","last_became_peered":"2023-08-25T04:22:24.990410+0000","last_unstale":"2023-08-25T04:22:26.205521+0000","last_undegraded":"2023-08-25T04:22:26.205521+0000","last_fullsized":"2023-08-25T04:22:26.205521+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:09:06.003095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206284+0000","last_change":"2023-08-25T04:22:23.951624+0000","last_active":"2023-08-25T04:22:26.206284+0000","last_peered":"2023-08-25T04:22:26.206284+0000","last_clean":"2023-08-25T04:22:26.206284+0000","last_became_active":"2023-08-25T04:22:23.951310+0000","last_became_peered":"2023-08-25T04:22:23.951310+0000","last_unstale":"2023-08-25T04:22:26.206284+0000","last_undegraded":"2023-08-25T04:22:26.206284+0000","last_fullsized":"2023-08-25T04:22:26.206284+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:13:10.816206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206463+0000","last_change":"2023-08-25T04:22:24.992947+0000","last_active":"2023-08-25T04:22:26.206463+0000","last_peered":"2023-08-25T04:22:26.206463+0000","last_clean":"2023-08-25T04:22:26.206463+0000","last_became_active":"2023-08-25T04:22:24.992319+0000","last_became_peered":"2023-08-25T04:22:24.992319+0000","last_unstale":"2023-08-25T04:22:26.206463+0000","last_undegraded":"2023-08-25T04:22:26.206463+0000","last_fullsized":"2023-08-25T04:22:26.206463+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:07:57.946440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964608+0000","last_change":"2023-08-25T04:22:23.943144+0000","last_active":"2023-08-25T04:22:25.964608+0000","last_peered":"2023-08-25T04:22:25.964608+0000","last_clean":"2023-08-25T04:22:25.964608+0000","last_became_active":"2023-08-25T04:22:23.942803+0000","last_became_peered":"2023-08-25T04:22:23.942803+0000","last_unstale":"2023-08-25T04:22:25.964608+0000","last_undegraded":"2023-08-25T04:22:25.964608+0000","last_fullsized":"2023-08-25T04:22:25.964608+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:07:37.842415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206440+0000","last_change":"2023-08-25T04:22:24.978375+0000","last_active":"2023-08-25T04:22:26.206440+0000","last_peered":"2023-08-25T04:22:26.206440+0000","last_clean":"2023-08-25T04:22:26.206440+0000","last_became_active":"2023-08-25T04:22:24.978090+0000","last_became_peered":"2023-08-25T04:22:24.978090+0000","last_unstale":"2023-08-25T04:22:26.206440+0000","last_undegraded":"2023-08-25T04:22:26.206440+0000","last_fullsized":"2023-08-25T04:22:26.206440+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:47:18.483790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964359+0000","last_change":"2023-08-25T04:22:23.940126+0000","last_active":"2023-08-25T04:22:25.964359+0000","last_peered":"2023-08-25T04:22:25.964359+0000","last_clean":"2023-08-25T04:22:25.964359+0000","last_became_active":"2023-08-25T04:22:23.939787+0000","last_became_peered":"2023-08-25T04:22:23.939787+0000","last_unstale":"2023-08-25T04:22:25.964359+0000","last_undegraded":"2023-08-25T04:22:25.964359+0000","last_fullsized":"2023-08-25T04:22:25.964359+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:27:15.410928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204264+0000","last_change":"2023-08-25T04:22:24.991400+0000","last_active":"2023-08-25T04:22:26.204264+0000","last_peered":"2023-08-25T04:22:26.204264+0000","last_clean":"2023-08-25T04:22:26.204264+0000","last_became_active":"2023-08-25T04:22:24.991119+0000","last_became_peered":"2023-08-25T04:22:24.991119+0000","last_unstale":"2023-08-25T04:22:26.204264+0000","last_undegraded":"2023-08-25T04:22:26.204264+0000","last_fullsized":"2023-08-25T04:22:26.204264+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:19:09.572991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205583+0000","last_change":"2023-08-25T04:22:23.951861+0000","last_active":"2023-08-25T04:22:26.205583+0000","last_peered":"2023-08-25T04:22:26.205583+0000","last_clean":"2023-08-25T04:22:26.205583+0000","last_became_active":"2023-08-25T04:22:23.951562+0000","last_became_peered":"2023-08-25T04:22:23.951562+0000","last_unstale":"2023-08-25T04:22:26.205583+0000","last_undegraded":"2023-08-25T04:22:26.205583+0000","last_fullsized":"2023-08-25T04:22:26.205583+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:44.764248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964267+0000","last_change":"2023-08-25T04:22:24.981863+0000","last_active":"2023-08-25T04:22:25.964267+0000","last_peered":"2023-08-25T04:22:25.964267+0000","last_clean":"2023-08-25T04:22:25.964267+0000","last_became_active":"2023-08-25T04:22:24.981575+0000","last_became_peered":"2023-08-25T04:22:24.981575+0000","last_unstale":"2023-08-25T04:22:25.964267+0000","last_undegraded":"2023-08-25T04:22:25.964267+0000","last_fullsized":"2023-08-25T04:22:25.964267+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:54.230362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.203758+0000","last_change":"2023-08-25T04:22:23.935832+0000","last_active":"2023-08-25T04:22:26.203758+0000","last_peered":"2023-08-25T04:22:26.203758+0000","last_clean":"2023-08-25T04:22:26.203758+0000","last_became_active":"2023-08-25T04:22:23.935459+0000","last_became_peered":"2023-08-25T04:22:23.935459+0000","last_unstale":"2023-08-25T04:22:26.203758+0000","last_undegraded":"2023-08-25T04:22:26.203758+0000","last_fullsized":"2023-08-25T04:22:26.203758+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:29:11.514300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204593+0000","last_change":"2023-08-25T04:22:24.986230+0000","last_active":"2023-08-25T04:22:26.204593+0000","last_peered":"2023-08-25T04:22:26.204593+0000","last_clean":"2023-08-25T04:22:26.204593+0000","last_became_active":"2023-08-25T04:22:24.985966+0000","last_became_peered":"2023-08-25T04:22:24.985966+0000","last_unstale":"2023-08-25T04:22:26.204593+0000","last_undegraded":"2023-08-25T04:22:26.204593+0000","last_fullsized":"2023-08-25T04:22:26.204593+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:51:07.817849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"135'8","reported_seq":21,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205699+0000","last_change":"2023-08-25T04:22:23.942738+0000","last_active":"2023-08-25T04:22:26.205699+0000","last_peered":"2023-08-25T04:22:26.205699+0000","last_clean":"2023-08-25T04:22:26.205699+0000","last_became_active":"2023-08-25T04:22:23.942467+0000","last_became_peered":"2023-08-25T04:22:23.942467+0000","last_unstale":"2023-08-25T04:22:26.205699+0000","last_undegraded":"2023-08-25T04:22:26.205699+0000","last_fullsized":"2023-08-25T04:22:26.205699+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:40:39.538469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"124'3554","reported_seq":4154,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204170+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T04:22:26.204170+0000","last_peered":"2023-08-25T04:22:26.204170+0000","last_clean":"2023-08-25T04:22:26.204170+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T04:22:26.204170+0000","last_undegraded":"2023-08-25T04:22:26.204170+0000","last_fullsized":"2023-08-25T04:22:26.204170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3554,"log_dups_size":0,"ondisk_log_size":3554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:42:27.482968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1232,"num_read_kb":2549,"num_write":385,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":210,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204582+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T04:22:26.204582+0000","last_peered":"2023-08-25T04:22:26.204582+0000","last_clean":"2023-08-25T04:22:26.204582+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T04:22:26.204582+0000","last_undegraded":"2023-08-25T04:22:26.204582+0000","last_fullsized":"2023-08-25T04:22:26.204582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:18:42.136058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964886+0000","last_change":"2023-08-25T04:22:24.974953+0000","last_active":"2023-08-25T04:22:25.964886+0000","last_peered":"2023-08-25T04:22:25.964886+0000","last_clean":"2023-08-25T04:22:25.964886+0000","last_became_active":"2023-08-25T04:22:24.974639+0000","last_became_peered":"2023-08-25T04:22:24.974639+0000","last_unstale":"2023-08-25T04:22:25.964886+0000","last_undegraded":"2023-08-25T04:22:25.964886+0000","last_fullsized":"2023-08-25T04:22:25.964886+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:52:46.328332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"135'2","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206333+0000","last_change":"2023-08-25T04:22:23.942162+0000","last_active":"2023-08-25T04:22:26.206333+0000","last_peered":"2023-08-25T04:22:26.206333+0000","last_clean":"2023-08-25T04:22:26.206333+0000","last_became_active":"2023-08-25T04:22:23.941827+0000","last_became_peered":"2023-08-25T04:22:23.941827+0000","last_unstale":"2023-08-25T04:22:26.206333+0000","last_undegraded":"2023-08-25T04:22:26.206333+0000","last_fullsized":"2023-08-25T04:22:26.206333+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:13:01.394885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":210,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.203927+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T04:22:26.203927+0000","last_peered":"2023-08-25T04:22:26.203927+0000","last_clean":"2023-08-25T04:22:26.203927+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T04:22:26.203927+0000","last_undegraded":"2023-08-25T04:22:26.203927+0000","last_fullsized":"2023-08-25T04:22:26.203927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:33:38.409193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964043+0000","last_change":"2023-08-25T04:22:24.981226+0000","last_active":"2023-08-25T04:22:25.964043+0000","last_peered":"2023-08-25T04:22:25.964043+0000","last_clean":"2023-08-25T04:22:25.964043+0000","last_became_active":"2023-08-25T04:22:24.980923+0000","last_became_peered":"2023-08-25T04:22:24.980923+0000","last_unstale":"2023-08-25T04:22:25.964043+0000","last_undegraded":"2023-08-25T04:22:25.964043+0000","last_fullsized":"2023-08-25T04:22:25.964043+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:40:40.053181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.207052+0000","last_change":"2023-08-25T04:22:23.945299+0000","last_active":"2023-08-25T04:22:26.207052+0000","last_peered":"2023-08-25T04:22:26.207052+0000","last_clean":"2023-08-25T04:22:26.207052+0000","last_became_active":"2023-08-25T04:22:23.945011+0000","last_became_peered":"2023-08-25T04:22:23.945011+0000","last_unstale":"2023-08-25T04:22:26.207052+0000","last_undegraded":"2023-08-25T04:22:26.207052+0000","last_fullsized":"2023-08-25T04:22:26.207052+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:40:48.532063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":216,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205171+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T04:22:26.205171+0000","last_peered":"2023-08-25T04:22:26.205171+0000","last_clean":"2023-08-25T04:22:26.205171+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T04:22:26.205171+0000","last_undegraded":"2023-08-25T04:22:26.205171+0000","last_fullsized":"2023-08-25T04:22:26.205171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:07:15.240628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205697+0000","last_change":"2023-08-25T04:22:24.989300+0000","last_active":"2023-08-25T04:22:26.205697+0000","last_peered":"2023-08-25T04:22:26.205697+0000","last_clean":"2023-08-25T04:22:26.205697+0000","last_became_active":"2023-08-25T04:22:24.988974+0000","last_became_peered":"2023-08-25T04:22:24.988974+0000","last_unstale":"2023-08-25T04:22:26.205697+0000","last_undegraded":"2023-08-25T04:22:26.205697+0000","last_fullsized":"2023-08-25T04:22:26.205697+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:22:04.496248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206547+0000","last_change":"2023-08-25T04:22:23.945109+0000","last_active":"2023-08-25T04:22:26.206547+0000","last_peered":"2023-08-25T04:22:26.206547+0000","last_clean":"2023-08-25T04:22:26.206547+0000","last_became_active":"2023-08-25T04:22:23.944798+0000","last_became_peered":"2023-08-25T04:22:23.944798+0000","last_unstale":"2023-08-25T04:22:26.206547+0000","last_undegraded":"2023-08-25T04:22:26.206547+0000","last_fullsized":"2023-08-25T04:22:26.206547+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:41:12.209828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":210,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204495+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T04:22:26.204495+0000","last_peered":"2023-08-25T04:22:26.204495+0000","last_clean":"2023-08-25T04:22:26.204495+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T04:22:26.204495+0000","last_undegraded":"2023-08-25T04:22:26.204495+0000","last_fullsized":"2023-08-25T04:22:26.204495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:31:56.114244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964582+0000","last_change":"2023-08-25T04:22:24.973626+0000","last_active":"2023-08-25T04:22:25.964582+0000","last_peered":"2023-08-25T04:22:25.964582+0000","last_clean":"2023-08-25T04:22:25.964582+0000","last_became_active":"2023-08-25T04:22:24.973339+0000","last_became_peered":"2023-08-25T04:22:24.973339+0000","last_unstale":"2023-08-25T04:22:25.964582+0000","last_undegraded":"2023-08-25T04:22:25.964582+0000","last_fullsized":"2023-08-25T04:22:25.964582+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:22:15.124047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.965016+0000","last_change":"2023-08-25T04:22:23.949056+0000","last_active":"2023-08-25T04:22:25.965016+0000","last_peered":"2023-08-25T04:22:25.965016+0000","last_clean":"2023-08-25T04:22:25.965016+0000","last_became_active":"2023-08-25T04:22:23.948734+0000","last_became_peered":"2023-08-25T04:22:23.948734+0000","last_unstale":"2023-08-25T04:22:25.965016+0000","last_undegraded":"2023-08-25T04:22:25.965016+0000","last_fullsized":"2023-08-25T04:22:25.965016+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:54:23.848789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":232,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964392+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T04:22:25.964392+0000","last_peered":"2023-08-25T04:22:25.964392+0000","last_clean":"2023-08-25T04:22:25.964392+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T04:22:25.964392+0000","last_undegraded":"2023-08-25T04:22:25.964392+0000","last_fullsized":"2023-08-25T04:22:25.964392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:48:05.691167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204743+0000","last_change":"2023-08-25T04:22:24.996859+0000","last_active":"2023-08-25T04:22:26.204743+0000","last_peered":"2023-08-25T04:22:26.204743+0000","last_clean":"2023-08-25T04:22:26.204743+0000","last_became_active":"2023-08-25T04:22:24.996540+0000","last_became_peered":"2023-08-25T04:22:24.996540+0000","last_unstale":"2023-08-25T04:22:26.204743+0000","last_undegraded":"2023-08-25T04:22:26.204743+0000","last_fullsized":"2023-08-25T04:22:26.204743+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:14:30.577755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205007+0000","last_change":"2023-08-25T04:22:23.942354+0000","last_active":"2023-08-25T04:22:26.205007+0000","last_peered":"2023-08-25T04:22:26.205007+0000","last_clean":"2023-08-25T04:22:26.205007+0000","last_became_active":"2023-08-25T04:22:23.942057+0000","last_became_peered":"2023-08-25T04:22:23.942057+0000","last_unstale":"2023-08-25T04:22:26.205007+0000","last_undegraded":"2023-08-25T04:22:26.205007+0000","last_fullsized":"2023-08-25T04:22:26.205007+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:55.486409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":210,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205061+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T04:22:26.205061+0000","last_peered":"2023-08-25T04:22:26.205061+0000","last_clean":"2023-08-25T04:22:26.205061+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T04:22:26.205061+0000","last_undegraded":"2023-08-25T04:22:26.205061+0000","last_fullsized":"2023-08-25T04:22:26.205061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:34:54.300689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.206139+0000","last_change":"2023-08-25T04:22:24.980259+0000","last_active":"2023-08-25T04:22:26.206139+0000","last_peered":"2023-08-25T04:22:26.206139+0000","last_clean":"2023-08-25T04:22:26.206139+0000","last_became_active":"2023-08-25T04:22:24.978717+0000","last_became_peered":"2023-08-25T04:22:24.978717+0000","last_unstale":"2023-08-25T04:22:26.206139+0000","last_undegraded":"2023-08-25T04:22:26.206139+0000","last_fullsized":"2023-08-25T04:22:26.206139+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:54:36.992915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"135'3","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.204712+0000","last_change":"2023-08-25T04:22:23.941295+0000","last_active":"2023-08-25T04:22:26.204712+0000","last_peered":"2023-08-25T04:22:26.204712+0000","last_clean":"2023-08-25T04:22:26.204712+0000","last_became_active":"2023-08-25T04:22:23.940689+0000","last_became_peered":"2023-08-25T04:22:23.940689+0000","last_unstale":"2023-08-25T04:22:26.204712+0000","last_undegraded":"2023-08-25T04:22:26.204712+0000","last_fullsized":"2023-08-25T04:22:26.204712+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:39:00.007640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":232,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.964469+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T04:22:25.964469+0000","last_peered":"2023-08-25T04:22:25.964469+0000","last_clean":"2023-08-25T04:22:25.964469+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T04:22:25.964469+0000","last_undegraded":"2023-08-25T04:22:25.964469+0000","last_fullsized":"2023-08-25T04:22:25.964469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:35:38.352388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205216+0000","last_change":"2023-08-25T04:22:24.988742+0000","last_active":"2023-08-25T04:22:26.205216+0000","last_peered":"2023-08-25T04:22:26.205216+0000","last_clean":"2023-08-25T04:22:26.205216+0000","last_became_active":"2023-08-25T04:22:24.988427+0000","last_became_peered":"2023-08-25T04:22:24.988427+0000","last_unstale":"2023-08-25T04:22:26.205216+0000","last_undegraded":"2023-08-25T04:22:26.205216+0000","last_fullsized":"2023-08-25T04:22:26.205216+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:23.917753+0000","last_clean_scrub_stamp":"2023-08-25T04:22:23.917753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:30.167507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"135'6","reported_seq":19,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:26.205903+0000","last_change":"2023-08-25T04:22:23.946500+0000","last_active":"2023-08-25T04:22:26.205903+0000","last_peered":"2023-08-25T04:22:26.205903+0000","last_clean":"2023-08-25T04:22:26.205903+0000","last_became_active":"2023-08-25T04:22:23.946216+0000","last_became_peered":"2023-08-25T04:22:23.946216+0000","last_unstale":"2023-08-25T04:22:26.205903+0000","last_undegraded":"2023-08-25T04:22:26.205903+0000","last_fullsized":"2023-08-25T04:22:26.205903+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":133,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:22:22.911502+0000","last_clean_scrub_stamp":"2023-08-25T04:22:22.911502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:14:16.851197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":246,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-25T04:22:25.965121+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T04:22:25.965121+0000","last_peered":"2023-08-25T04:22:25.965121+0000","last_clean":"2023-08-25T04:22:25.965121+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T04:22:25.965121+0000","last_undegraded":"2023-08-25T04:22:25.965121+0000","last_fullsized":"2023-08-25T04:22:25.965121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:07:47.138650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1232,"num_read_kb":2549,"num_write":385,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3554,"ondisk_log_size":3554,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509675,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59788,"kb_used_data":2236,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312052,"statfs":{"total":96636764160,"available":96575541248,"internally_reserved":0,"allocated":2289664,"data_stored":1431077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.65700000000000003,"15min":0.69699999999999995},"min":{"1min":0.51200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.91700000000000004,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66600000000000004,"15min":0.70999999999999996},"min":{"1min":0.41499999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81899999999999995,"5min":1,"15min":1.0249999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70099999999999996,"15min":0.72499999999999998},"min":{"1min":0.58099999999999996,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.878,"5min":1.054,"15min":1.054},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68999999999999995,"15min":0.72499999999999998},"min":{"1min":0.52100000000000002,"5min":0.377,"15min":0.374},"max":{"1min":0.90100000000000002,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.747}]},{"osd":2,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65700000000000003,"15min":0.69699999999999995},"min":{"1min":0.44800000000000001,"5min":0.38100000000000001,"15min":0.34899999999999998},"max":{"1min":0.753,"5min":0.94299999999999995,"15min":1.018},"last":0.874},{"interface":"front","average":{"1min":0.752,"5min":0.70899999999999996,"15min":0.74099999999999999},"min":{"1min":0.61499999999999999,"5min":0.46500000000000002,"15min":0.38100000000000001},"max":{"1min":0.96199999999999997,"5min":1.046,"15min":1.046},"last":0.72299999999999998}]},{"osd":3,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69299999999999995,"15min":0.72799999999999998},"min":{"1min":0.56000000000000005,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85299999999999998,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.71099999999999997,"15min":0.74099999999999999},"min":{"1min":0.54800000000000004,"5min":0.46600000000000003,"15min":0.432},"max":{"1min":0.84899999999999998,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.80700000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.58699999999999997,"15min":0.57099999999999995},"min":{"1min":0.373,"5min":0.34499999999999997,"15min":0.32400000000000001},"max":{"1min":0.75,"5min":1.004,"15min":1.0109999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.60899999999999999,"15min":0.59499999999999997},"min":{"1min":0.44500000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.81899999999999995,"5min":0.97599999999999998,"15min":0.97799999999999998},"last":0.48199999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.624,"15min":0.61099999999999999},"min":{"1min":0.45000000000000001,"5min":0.40500000000000003,"15min":0.377},"max":{"1min":0.90600000000000003,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64200000000000002,"15min":0.629},"min":{"1min":0.42399999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.873,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.64800000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:22:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.69999999999999996,"15min":0.69099999999999995},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.872,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.49399999999999999,"5min":0.42799999999999999,"15min":0.42699999999999999},"max":{"1min":0.90100000000000002,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.57299999999999995}]}]},{"osd":6,"up_from":15,"seq":64424509675,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36984,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334856,"statfs":{"total":96636764160,"available":96598892544,"internally_reserved":0,"allocated":1683456,"data_stored":840515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65600000000000003,"15min":0.68999999999999995},"min":{"1min":0.439,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.89300000000000002,"5min":0.97599999999999998,"15min":1.0089999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64600000000000002,"15min":0.68100000000000005},"min":{"1min":0.46800000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72099999999999997,"5min":0.95999999999999996,"15min":1.054},"last":0.82899999999999996}]},{"osd":1,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69999999999999996,"15min":0.72099999999999997},"min":{"1min":0.498,"5min":0.39600000000000002,"15min":0.38200000000000001},"max":{"1min":0.85199999999999998,"5min":0.98799999999999999,"15min":1.0369999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68400000000000005,"15min":0.71999999999999997},"min":{"1min":0.50700000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81899999999999995,"5min":1.109,"15min":1.109},"last":0.72199999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69999999999999996,"15min":0.72399999999999998},"min":{"1min":0.55900000000000005,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86299999999999999,"5min":1.0009999999999999,"15min":1.1020000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.745,"15min":0.77700000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94799999999999995,"5min":1.0169999999999999,"15min":1.0569999999999999},"last":0.877}]},{"osd":3,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73399999999999999,"15min":0.73999999999999999},"min":{"1min":0.49199999999999999,"5min":0.48499999999999999,"15min":0.46899999999999997},"max":{"1min":0.93600000000000005,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71799999999999997,"15min":0.746},"min":{"1min":0.53000000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93500000000000005,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.81100000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.59799999999999998,"15min":0.59299999999999997},"min":{"1min":0.46300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.96199999999999997,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.60699999999999998,"15min":0.59399999999999997},"min":{"1min":0.38700000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.93500000000000005,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.56899999999999995}]},{"osd":5,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47999999999999998,"5min":0.39200000000000002,"15min":0.373},"max":{"1min":0.85899999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.141,"15min":1.141},"last":0.85099999999999998}]},{"osd":7,"last update":"Fri Aug 25 04:22:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65700000000000003,"15min":0.65500000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40400000000000003},"max":{"1min":0.90200000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.62},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70899999999999996,"15min":0.69899999999999995},"min":{"1min":0.48099999999999998,"5min":0.45200000000000001,"15min":0.44700000000000001},"max":{"1min":0.90600000000000003,"5min":1.373,"15min":1.373},"last":0.79000000000000004}]}]},{"osd":5,"up_from":14,"seq":60129542378,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50876,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320964,"statfs":{"total":96636764160,"available":96584667136,"internally_reserved":0,"allocated":1687552,"data_stored":840093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65400000000000003,"15min":0.69399999999999995},"min":{"1min":0.42399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":1.002,"5min":1.002,"15min":1.018},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66700000000000004,"15min":0.70999999999999996},"min":{"1min":0.50600000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":1.0409999999999999},"last":0.73699999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66600000000000004,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.93000000000000005,"5min":0.96399999999999997,"15min":0.99399999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.72799999999999998},"min":{"1min":0.48999999999999999,"5min":0.434,"15min":0.434},"max":{"1min":0.96199999999999997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.81299999999999994}]},{"osd":2,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.65800000000000003,"15min":0.70999999999999996},"min":{"1min":0.42099999999999999,"5min":0.40799999999999997,"15min":0.39500000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.97499999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68300000000000005,"15min":0.72699999999999998},"min":{"1min":0.46700000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89200000000000002,"5min":1.048,"15min":1.048},"last":0.79300000000000004}]},{"osd":3,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68700000000000006,"15min":0.71999999999999997},"min":{"1min":0.46800000000000003,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70899999999999996,"15min":0.749},"min":{"1min":0.48999999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85999999999999999,"5min":1.028,"15min":1.028},"last":0.68200000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54800000000000004,"15min":0.56999999999999995},"min":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.35399999999999998},"max":{"1min":0.69699999999999995,"5min":0.91000000000000003,"15min":0.97099999999999997},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.59099999999999997,"15min":0.60999999999999999},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.80800000000000005,"5min":0.91900000000000004,"15min":1.018},"last":0.59299999999999997}]},{"osd":6,"last update":"Fri Aug 25 04:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.62,"15min":0.62},"min":{"1min":0.437,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.77400000000000002,"5min":0.96799999999999997,"15min":1.008},"last":0.624},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64200000000000002,"15min":0.64500000000000002},"min":{"1min":0.46100000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.872,"5min":0.94199999999999995,"15min":0.98299999999999998},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Aug 25 04:22:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.63300000000000001,"15min":0.61099999999999999},"min":{"1min":0.41499999999999998,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":0.877,"5min":0.93300000000000005,"15min":1.032},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.47799999999999998,"5min":0.47099999999999997,"15min":0.45100000000000001},"max":{"1min":0.877,"5min":1.01,"15min":1.048},"last":0.69799999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542378,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36996,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334844,"statfs":{"total":96636764160,"available":96598880256,"internally_reserved":0,"allocated":1691648,"data_stored":841545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.65700000000000003,"15min":0.69799999999999995},"min":{"1min":0.434,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.68799999999999994},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.75700000000000001}]},{"osd":1,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.69299999999999995,"15min":0.72299999999999998},"min":{"1min":0.438,"5min":0.38200000000000001,"15min":0.36199999999999999},"max":{"1min":2.9239999999999999,"5min":2.9239999999999999,"15min":2.9239999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.68300000000000005,"15min":0.72399999999999998},"min":{"1min":0.49199999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.2989999999999999,"5min":2.2989999999999999,"15min":2.2989999999999999},"last":0.91200000000000003}]},{"osd":2,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.71399999999999997,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.69499999999999995,"15min":0.73699999999999999},"min":{"1min":0.49299999999999999,"5min":0.40400000000000003,"15min":0.34000000000000002},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.86199999999999999}]},{"osd":3,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.72699999999999998,"15min":0.75800000000000001},"min":{"1min":0.46999999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":3.0019999999999998,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.69699999999999995,"15min":0.74199999999999999},"min":{"1min":0.54300000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.331,"5min":2.331,"15min":2.331},"last":0.71899999999999997}]},{"osd":5,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.36799999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.60699999999999998,"15min":0.59999999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.746,"15min":0.73999999999999999},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.40699999999999997},"max":{"1min":3.0710000000000002,"5min":3.0710000000000002,"15min":3.0710000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.64800000000000002,"15min":0.64600000000000002},"min":{"1min":0.42299999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.624}]},{"osd":7,"last update":"Fri Aug 25 04:22:18 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.41399999999999998,"5min":0.39700000000000002,"15min":0.36699999999999999},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.71899999999999997,"15min":0.70499999999999996},"min":{"1min":0.50700000000000001,"5min":0.49199999999999999,"15min":0.437},"max":{"1min":3.2170000000000001,"5min":3.2170000000000001,"15min":3.2170000000000001},"last":0.56299999999999994}]}]},{"osd":3,"up_from":14,"seq":60129542378,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37004,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334836,"statfs":{"total":96636764160,"available":96598872064,"internally_reserved":0,"allocated":1695744,"data_stored":841579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.434,"15min":0.44900000000000001},"min":{"1min":0.30099999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64100000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.49099999999999999,"15min":0.51100000000000001},"min":{"1min":0.33300000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.55300000000000005,"5min":0.70799999999999996,"15min":0.91500000000000004},"last":0.43099999999999999}]},{"osd":1,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.499,"15min":0.497},"min":{"1min":0.34799999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.81100000000000005,"5min":1.254,"15min":1.254},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.433,"5min":0.41499999999999998,"15min":0.33900000000000002},"max":{"1min":0.96999999999999997,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.42299999999999999,"5min":0.38700000000000001,"15min":0.33000000000000002},"max":{"1min":0.70299999999999996,"5min":1.639,"15min":1.639},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70399999999999996,"5min":0.75900000000000001,"15min":0.89600000000000002},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.48699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.92200000000000004,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76400000000000001,"15min":0.79500000000000004},"min":{"1min":0.55400000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.016,"5min":1.601,"15min":1.601},"last":0.46400000000000002}]},{"osd":5,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73399999999999999,"15min":0.77000000000000002},"min":{"1min":0.55000000000000004,"5min":0.52900000000000003,"15min":0.49299999999999999},"max":{"1min":0.94899999999999995,"5min":1.0549999999999999,"15min":1.254},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74399999999999999,"15min":0.77400000000000002},"min":{"1min":0.54600000000000004,"5min":0.50600000000000001,"15min":0.48099999999999998},"max":{"1min":0.98299999999999998,"5min":1.421,"15min":1.421},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78000000000000003,"15min":0.79900000000000004},"min":{"1min":0.59799999999999998,"5min":0.55000000000000004,"15min":0.54000000000000004},"max":{"1min":1.008,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.748,"15min":0.78400000000000003},"min":{"1min":0.53700000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.99299999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.878}]},{"osd":7,"last update":"Fri Aug 25 04:22:25 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77600000000000002,"15min":0.81299999999999994},"min":{"1min":0.56499999999999995,"5min":0.53000000000000003,"15min":0.52500000000000002},"max":{"1min":0.96699999999999997,"5min":1.472,"15min":1.472},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.752,"15min":0.78600000000000003},"min":{"1min":0.56699999999999995,"5min":0.498,"15min":0.498},"max":{"1min":0.88800000000000001,"5min":1.0209999999999999,"15min":1.1160000000000001},"last":0.72099999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542379,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55028,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316812,"statfs":{"total":96636764160,"available":96580415488,"internally_reserved":0,"allocated":1679360,"data_stored":839933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.433,"15min":0.45700000000000002},"min":{"1min":0.32900000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.61099999999999999,"5min":0.65100000000000002,"15min":0.85599999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.47699999999999998,"15min":0.496},"min":{"1min":0.35599999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72599999999999998,"5min":0.83099999999999996,"15min":0.93100000000000005},"last":0.372}]},{"osd":1,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.29999999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.78800000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57599999999999996,"15min":0.59099999999999997},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.39200000000000002},"max":{"1min":0.81000000000000005,"5min":0.81699999999999995,"15min":0.89800000000000002},"last":0.497}]},{"osd":3,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35499999999999998},"max":{"1min":0.67600000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54300000000000004,"15min":0.56200000000000006},"min":{"1min":0.42199999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68300000000000005,"5min":0.88900000000000001,"15min":0.89400000000000002},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.74199999999999999,"15min":0.78300000000000003},"min":{"1min":0.58799999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.624},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72399999999999998,"15min":0.77000000000000002},"min":{"1min":0.53200000000000003,"5min":0.442,"15min":0.442},"max":{"1min":1.038,"5min":1.0629999999999999,"15min":1.5509999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74099999999999999,"15min":0.78400000000000003},"min":{"1min":0.56399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.258,"5min":1.258,"15min":1.2789999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.76800000000000002,"15min":0.79900000000000004},"min":{"1min":0.57899999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.76700000000000002}]},{"osd":6,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.754,"15min":0.80500000000000005},"min":{"1min":0.55300000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.3069999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.78200000000000003,"15min":0.83799999999999997},"min":{"1min":0.58599999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0800000000000001,"5min":1.1930000000000001,"15min":1.375},"last":0.79000000000000004}]},{"osd":7,"last update":"Fri Aug 25 04:22:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.745,"15min":0.78800000000000003},"min":{"1min":0.58999999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.339},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.75800000000000001,"15min":0.79300000000000004},"min":{"1min":0.60599999999999998,"5min":0.44,"15min":0.44},"max":{"1min":1.133,"5min":1.133,"15min":1.1859999999999999},"last":0.71499999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542379,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36984,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334856,"statfs":{"total":96636764160,"available":96598892544,"internally_reserved":0,"allocated":1683456,"data_stored":839955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.43099999999999999,"15min":0.45200000000000001},"min":{"1min":0.29799999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67500000000000004,"5min":0.93999999999999995,"15min":0.96899999999999997},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.38100000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.751,"5min":0.85099999999999998,"15min":1.212},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48399999999999999,"15min":0.497},"min":{"1min":0.35799999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.58399999999999996,"5min":0.80500000000000005,"15min":0.876},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55400000000000005,"15min":0.56799999999999995},"min":{"1min":0.40699999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":1.095,"15min":1.095},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58999999999999997,"15min":0.61399999999999999},"min":{"1min":0.435,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89200000000000002,"5min":1.03,"15min":1.03},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.53500000000000003,"15min":0.56899999999999995},"min":{"1min":0.438,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":1.165},"last":0.47999999999999998}]},{"osd":4,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.69999999999999996,"15min":0.755},"min":{"1min":0.52900000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.204},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.76100000000000001,"15min":0.79200000000000004},"min":{"1min":0.64700000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.246,"5min":1.246,"15min":1.2529999999999999},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.72199999999999998,"15min":0.77300000000000002},"min":{"1min":0.50800000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.254},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.73599999999999999,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0249999999999999,"5min":1.044,"15min":1.9059999999999999},"last":0.749}]},{"osd":6,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.81999999999999995},"min":{"1min":0.622,"5min":0.497,"15min":0.497},"max":{"1min":1.125,"5min":1.294,"15min":1.623},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.755,"15min":0.78800000000000003},"min":{"1min":0.57199999999999995,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Aug 25 04:22:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.751,"15min":0.79200000000000004},"min":{"1min":0.52600000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.091,"5min":1.091,"15min":1.2949999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.81699999999999995,"15min":0.83999999999999997},"min":{"1min":0.59899999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.83699999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542378,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33404,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338436,"statfs":{"total":96636764160,"available":96602558464,"internally_reserved":0,"allocated":2277376,"data_stored":1430323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46999999999999997,"15min":0.48199999999999998},"min":{"1min":0.28199999999999997,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.66300000000000003,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.55500000000000005},"min":{"1min":0.39200000000000002,"5min":0.38500000000000001,"15min":0.36699999999999999},"max":{"1min":0.79700000000000004,"5min":1.0129999999999999,"15min":3.5089999999999999},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48499999999999999,"15min":0.51500000000000001},"min":{"1min":0.36199999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.53300000000000003},"min":{"1min":0.34399999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.748,"5min":0.876,"15min":3.4590000000000001},"last":0.65400000000000003}]},{"osd":3,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47599999999999998,"15min":0.48699999999999999},"min":{"1min":0.35499999999999998,"5min":0.28699999999999998,"15min":0.27700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.503},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.56899999999999995,"15min":0.58599999999999997},"min":{"1min":0.40500000000000003,"5min":0.36699999999999999,"15min":0.32700000000000001},"max":{"1min":0.875,"5min":0.93500000000000005,"15min":1.2470000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.746,"15min":0.77900000000000003},"min":{"1min":0.56299999999999994,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91400000000000003,"5min":1.2,"15min":1.2},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.73999999999999999,"15min":0.79000000000000004},"min":{"1min":0.56799999999999995,"5min":0.443,"15min":0.443},"max":{"1min":0.94499999999999995,"5min":1.169,"15min":1.169},"last":0.93500000000000005}]},{"osd":5,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72899999999999998,"15min":0.78100000000000003},"min":{"1min":0.59499999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.84399999999999997,"5min":1.131,"15min":3.528},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.746,"15min":0.79600000000000004},"min":{"1min":0.55700000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98799999999999999,"5min":1.244,"15min":1.244},"last":0.95399999999999996}]},{"osd":6,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73499999999999999,"15min":0.78700000000000003},"min":{"1min":0.54500000000000004,"5min":0.495,"15min":0.495},"max":{"1min":0.95999999999999996,"5min":1.1180000000000001,"15min":3.4870000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.77400000000000002,"15min":0.81499999999999995},"min":{"1min":0.57299999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.98099999999999998,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.0169999999999999}]},{"osd":7,"last update":"Fri Aug 25 04:22:20 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.78400000000000003,"15min":0.82499999999999996},"min":{"1min":0.51700000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0580000000000001,"5min":1.28,"15min":1.28},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.753,"15min":0.79500000000000004},"min":{"1min":0.56000000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0820000000000001,"5min":1.0940000000000001,"15min":1.1930000000000001},"last":1}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T04:22:34.028 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-25T04:22:34.028 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-25T04:22:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.213+0000 7f092cbe1640 1 Processor -- start 2023-08-25T04:22:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.213+0000 7f092cbe1640 1 -- start start 2023-08-25T04:22:34.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.213+0000 7f092cbe1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f092815a7f0 0x7f092809bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:34.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.213+0000 7f092cbe1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f092806c020 0x7f09280acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:34.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.213+0000 7f092cbe1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092815abd0 con 0x7f09280c9830 2023-08-25T04:22:34.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.213+0000 7f092cbe1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09280c8ab0 con 0x7f092815a7f0 2023-08-25T04:22:34.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.213+0000 7f092cbe1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09280c8d50 con 0x7f092806c020 2023-08-25T04:22:34.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.213+0000 7f092659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f092815a7f0 0x7f092809bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:34.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.213+0000 7f092659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f092815a7f0 0x7f092809bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38394/0 (socket says 172.21.15.55:38394) 2023-08-25T04:22:34.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.213+0000 7f092659c640 1 -- 172.21.15.55:0/555249868 learned_addr learned my addr 172.21.15.55:0/555249868 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:34.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.213+0000 7f092659c640 1 -- 172.21.15.55:0/555249868 >> v2:172.21.15.110:3300/0 conn(0x7f092806c020 msgr2=0x7f09280acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:34.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.213+0000 7f092659c640 1 --2- 172.21.15.55:0/555249868 >> v2:172.21.15.110:3300/0 conn(0x7f092806c020 0x7f09280acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.213+0000 7f092659c640 1 -- 172.21.15.55:0/555249868 >> v1:172.21.15.110:6789/0 conn(0x7f09280c9830 legacy=0x7f0928070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:34.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.213+0000 7f092659c640 1 -- 172.21.15.55:0/555249868 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09280c9030 con 0x7f092815a7f0 2023-08-25T04:22:34.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.217+0000 7f092659c640 1 --2- 172.21.15.55:0/555249868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f092815a7f0 0x7f092809bde0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f09280cbf20 tx=0x7f091801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfb298690dc318f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:34.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.217+0000 7f0925d9b640 1 -- 172.21.15.55:0/555249868 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09180ac620 con 0x7f092815a7f0 2023-08-25T04:22:34.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.217+0000 7f0925d9b640 1 -- 172.21.15.55:0/555249868 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09180ac780 con 0x7f092815a7f0 2023-08-25T04:22:34.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.217+0000 7f0925d9b640 1 -- 172.21.15.55:0/555249868 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09180acb10 con 0x7f092815a7f0 2023-08-25T04:22:34.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.217+0000 7f092cbe1640 1 -- 172.21.15.55:0/555249868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f092815a7f0 msgr2=0x7f092809bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:34.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.217+0000 7f092cbe1640 1 --2- 172.21.15.55:0/555249868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f092815a7f0 0x7f092809bde0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f09280cbf20 tx=0x7f091801c4b0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.217+0000 7f092cbe1640 1 -- 172.21.15.55:0/555249868 shutdown_connections 2023-08-25T04:22:34.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.217+0000 7f092cbe1640 1 --2- 172.21.15.55:0/555249868 >> v2:172.21.15.110:3300/0 conn(0x7f092806c020 0x7f09280acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.217+0000 7f092cbe1640 1 --2- 172.21.15.55:0/555249868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f092815a7f0 0x7f092809bde0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.217+0000 7f092cbe1640 1 -- 172.21.15.55:0/555249868 >> 172.21.15.55:0/555249868 conn(0x7f0928069900 msgr2=0x7f0928069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:34.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.217+0000 7f092cbe1640 1 -- 172.21.15.55:0/555249868 shutdown_connections 2023-08-25T04:22:34.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.217+0000 7f092cbe1640 1 -- 172.21.15.55:0/555249868 wait complete. 2023-08-25T04:22:34.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092cbe1640 1 Processor -- start 2023-08-25T04:22:34.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092cbe1640 1 -- start start 2023-08-25T04:22:34.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092cbe1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f092806c020 0x7f0928158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:34.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092cbe1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09280c9830 0x7f09280c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:34.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092cbe1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f092815a7f0 0x7f09280b2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:34.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092cbe1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09280b26b0 con 0x7f092806c020 2023-08-25T04:22:34.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092cbe1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09280c65f0 con 0x7f09280c9830 2023-08-25T04:22:34.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092cbe1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09280b3080 con 0x7f092815a7f0 2023-08-25T04:22:34.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f092806c020 0x7f0928158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:34.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f092806c020 0x7f0928158a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38410/0 (socket says 172.21.15.55:38410) 2023-08-25T04:22:34.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092659c640 1 -- 172.21.15.55:0/1694558521 learned_addr learned my addr 172.21.15.55:0/1694558521 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:34.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f091dd9b640 1 --2- 172.21.15.55:0/1694558521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09280c9830 0x7f09280c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f0926d9d640 1 --2- 172.21.15.55:0/1694558521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f092815a7f0 0x7f09280b2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092659c640 1 -- 172.21.15.55:0/1694558521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f092815a7f0 msgr2=0x7f09280b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092659c640 1 --2- 172.21.15.55:0/1694558521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f092815a7f0 0x7f09280b2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092659c640 1 -- 172.21.15.55:0/1694558521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09280c9830 msgr2=0x7f09280c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092659c640 1 --2- 172.21.15.55:0/1694558521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09280c9830 0x7f09280c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092659c640 1 -- 172.21.15.55:0/1694558521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0918009470 con 0x7f092806c020 2023-08-25T04:22:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f0926d9d640 1 --2- 172.21.15.55:0/1694558521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f092815a7f0 0x7f09280b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:34.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092659c640 1 --2- 172.21.15.55:0/1694558521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f092806c020 0x7f0928158a00 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f09180af040 tx=0x7f091801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:34.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f091f7fe640 1 -- 172.21.15.55:0/1694558521 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09180b7620 con 0x7f092806c020 2023-08-25T04:22:34.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f091f7fe640 1 -- 172.21.15.55:0/1694558521 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09180b77a0 con 0x7f092806c020 2023-08-25T04:22:34.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f091f7fe640 1 -- 172.21.15.55:0/1694558521 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09180b7b50 con 0x7f092806c020 2023-08-25T04:22:34.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092cbe1640 1 -- 172.21.15.55:0/1694558521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09280c6b50 con 0x7f092806c020 2023-08-25T04:22:34.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.221+0000 7f092cbe1640 1 -- 172.21.15.55:0/1694558521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09280b2060 con 0x7f092806c020 2023-08-25T04:22:34.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.225+0000 7f092cbe1640 1 -- 172.21.15.55:0/1694558521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092806d5b0 con 0x7f092806c020 2023-08-25T04:22:34.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.225+0000 7f091f7fe640 1 -- 172.21.15.55:0/1694558521 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f09180b3040 con 0x7f092806c020 2023-08-25T04:22:34.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.225+0000 7f091f7fe640 1 --2- 172.21.15.55:0/1694558521 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f09080657a0 0x7f0908067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:34.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.225+0000 7f091f7fe640 1 -- 172.21.15.55:0/1694558521 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f091811d390 con 0x7f092806c020 2023-08-25T04:22:34.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.225+0000 7f091dd9b640 1 --2- 172.21.15.55:0/1694558521 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f09080657a0 0x7f0908067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:34.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.225+0000 7f091dd9b640 1 --2- 172.21.15.55:0/1694558521 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f09080657a0 0x7f0908067c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0928165e60 tx=0x7f0910009040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:34.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.229+0000 7f091f7fe640 1 -- 172.21.15.55:0/1694558521 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f09180eab90 con 0x7f092806c020 2023-08-25T04:22:34.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.437+0000 7f092cbe1640 1 -- 172.21.15.55:0/1694558521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f092806d5b0 con 0x7f092806c020 2023-08-25T04:22:34.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.445+0000 7f091f7fe640 1 -- 172.21.15.55:0/1694558521 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+147 (secure 0 0 0) 0x7f09180ac5e0 con 0x7f092806c020 2023-08-25T04:22:34.445 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2023-08-25T04:22:34.445 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g== 2023-08-25T04:22:34.446 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2023-08-25T04:22:34.446 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2023-08-25T04:22:34.446 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-25T04:22:34.447 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-08-25T04:22:34.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.445+0000 7f092cbe1640 1 -- 172.21.15.55:0/1694558521 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f09080657a0 msgr2=0x7f0908067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:34.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.445+0000 7f092cbe1640 1 --2- 172.21.15.55:0/1694558521 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f09080657a0 0x7f0908067c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0928165e60 tx=0x7f0910009040 comp rx=0 tx=0).stop 2023-08-25T04:22:34.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.445+0000 7f092cbe1640 1 -- 172.21.15.55:0/1694558521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f092806c020 msgr2=0x7f0928158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:34.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.445+0000 7f092cbe1640 1 --2- 172.21.15.55:0/1694558521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f092806c020 0x7f0928158a00 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f09180af040 tx=0x7f091801acf0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.445+0000 7f092cbe1640 1 -- 172.21.15.55:0/1694558521 shutdown_connections 2023-08-25T04:22:34.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.445+0000 7f092cbe1640 1 --2- 172.21.15.55:0/1694558521 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f09080657a0 0x7f0908067c60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.445+0000 7f092cbe1640 1 --2- 172.21.15.55:0/1694558521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f092815a7f0 0x7f09280b2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.445+0000 7f092cbe1640 1 --2- 172.21.15.55:0/1694558521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09280c9830 0x7f09280c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.445+0000 7f092cbe1640 1 --2- 172.21.15.55:0/1694558521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f092806c020 0x7f0928158a00 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.445+0000 7f092cbe1640 1 -- 172.21.15.55:0/1694558521 >> 172.21.15.55:0/1694558521 conn(0x7f0928069900 msgr2=0x7f09280aafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:34.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.445+0000 7f092cbe1640 1 -- 172.21.15.55:0/1694558521 shutdown_connections 2023-08-25T04:22:34.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.445+0000 7f092cbe1640 1 -- 172.21.15.55:0/1694558521 wait complete. 2023-08-25T04:22:34.466 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T04:22:34.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.609+0000 7f5914856640 1 Processor -- start 2023-08-25T04:22:34.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.609+0000 7f5914856640 1 -- start start 2023-08-25T04:22:34.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.609+0000 7f5914856640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59100cdde0 0x7f59100ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:34.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.609+0000 7f5914856640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59100b2e40 0x7f59100b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:34.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.609+0000 7f5914856640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59100b29b0 con 0x7f59100d0da0 2023-08-25T04:22:34.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.609+0000 7f5914856640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59100ce760 con 0x7f59100cdde0 2023-08-25T04:22:34.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.609+0000 7f5914856640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59100b1dc0 con 0x7f59100b2e40 2023-08-25T04:22:34.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.609+0000 7f5905d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59100cdde0 0x7f59100ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:34.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.609+0000 7f5905d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59100cdde0 0x7f59100ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38420/0 (socket says 172.21.15.55:38420) 2023-08-25T04:22:34.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.609+0000 7f5905d9b640 1 -- 172.21.15.55:0/1371547517 learned_addr learned my addr 172.21.15.55:0/1371547517 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:34.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.609+0000 7f590ed9d640 1 --2- 172.21.15.55:0/1371547517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59100b2e40 0x7f59100b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:34.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.609+0000 7f5905d9b640 1 -- 172.21.15.55:0/1371547517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59100b2e40 msgr2=0x7f59100b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:34.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.609+0000 7f5905d9b640 1 --2- 172.21.15.55:0/1371547517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59100b2e40 0x7f59100b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.609+0000 7f5905d9b640 1 -- 172.21.15.55:0/1371547517 >> v1:172.21.15.55:6789/0 conn(0x7f59100d0da0 legacy=0x7f59100d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:34.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.609+0000 7f5905d9b640 1 -- 172.21.15.55:0/1371547517 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59100b2080 con 0x7f59100cdde0 2023-08-25T04:22:34.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.609+0000 7f590ed9d640 1 --2- 172.21.15.55:0/1371547517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59100b2e40 0x7f59100b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.613+0000 7f5905d9b640 1 --2- 172.21.15.55:0/1371547517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59100cdde0 0x7f59100ce220 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f58f8009e50 tx=0x7f58f801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e29d69b60eb651b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.613+0000 7f590dd9b640 1 -- 172.21.15.55:0/1371547517 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f80af400 con 0x7f59100cdde0 2023-08-25T04:22:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.613+0000 7f590dd9b640 1 -- 172.21.15.55:0/1371547517 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f80ab050 con 0x7f59100cdde0 2023-08-25T04:22:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.613+0000 7f590dd9b640 1 -- 172.21.15.55:0/1371547517 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f80af780 con 0x7f59100cdde0 2023-08-25T04:22:34.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.613+0000 7f5914856640 1 -- 172.21.15.55:0/1371547517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59100cdde0 msgr2=0x7f59100ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:34.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.613+0000 7f5914856640 1 --2- 172.21.15.55:0/1371547517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59100cdde0 0x7f59100ce220 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f58f8009e50 tx=0x7f58f801f1f0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.613+0000 7f5914856640 1 -- 172.21.15.55:0/1371547517 shutdown_connections 2023-08-25T04:22:34.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.613+0000 7f5914856640 1 --2- 172.21.15.55:0/1371547517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59100b2e40 0x7f59100b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.613+0000 7f5914856640 1 --2- 172.21.15.55:0/1371547517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59100cdde0 0x7f59100ce220 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.613+0000 7f5914856640 1 -- 172.21.15.55:0/1371547517 >> 172.21.15.55:0/1371547517 conn(0x7f591009bae0 msgr2=0x7f59100d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:34.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.613+0000 7f5914856640 1 -- 172.21.15.55:0/1371547517 shutdown_connections 2023-08-25T04:22:34.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.613+0000 7f5914856640 1 -- 172.21.15.55:0/1371547517 wait complete. 2023-08-25T04:22:34.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f5914856640 1 Processor -- start 2023-08-25T04:22:34.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f5914856640 1 -- start start 2023-08-25T04:22:34.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f5914856640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59100b2e40 0x7f59100b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:34.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f5914856640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59100cdde0 0x7f59100c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:34.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f5914856640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59100d0da0 0x7f59100b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:34.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f5914856640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59101f21d0 con 0x7f59100b2e40 2023-08-25T04:22:34.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f5914856640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59100cac90 con 0x7f59100d0da0 2023-08-25T04:22:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f5914856640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59100c9dd0 con 0x7f59100cdde0 2023-08-25T04:22:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f590e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59100b2e40 0x7f59100b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f590e59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59100b2e40 0x7f59100b7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38430/0 (socket says 172.21.15.55:38430) 2023-08-25T04:22:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f590e59c640 1 -- 172.21.15.55:0/2575574983 learned_addr learned my addr 172.21.15.55:0/2575574983 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f5905d9b640 1 --2- 172.21.15.55:0/2575574983 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59100cdde0 0x7f59100c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f590ed9d640 1 --2- 172.21.15.55:0/2575574983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59100d0da0 0x7f59100b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f590e59c640 1 -- 172.21.15.55:0/2575574983 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59100cdde0 msgr2=0x7f59100c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f590e59c640 1 --2- 172.21.15.55:0/2575574983 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59100cdde0 0x7f59100c9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f590e59c640 1 -- 172.21.15.55:0/2575574983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59100d0da0 msgr2=0x7f59100b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:34.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f590e59c640 1 --2- 172.21.15.55:0/2575574983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59100d0da0 0x7f59100b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f590e59c640 1 -- 172.21.15.55:0/2575574983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f8009b30 con 0x7f59100b2e40 2023-08-25T04:22:34.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f590ed9d640 1 --2- 172.21.15.55:0/2575574983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59100d0da0 0x7f59100b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:34.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f590e59c640 1 --2- 172.21.15.55:0/2575574983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59100b2e40 0x7f59100b7ef0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f590000c480 tx=0x7f590000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:34.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f59077fe640 1 -- 172.21.15.55:0/2575574983 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5900005480 con 0x7f59100b2e40 2023-08-25T04:22:34.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f59077fe640 1 -- 172.21.15.55:0/2575574983 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5900003600 con 0x7f59100b2e40 2023-08-25T04:22:34.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f59077fe640 1 -- 172.21.15.55:0/2575574983 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59000039b0 con 0x7f59100b2e40 2023-08-25T04:22:34.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f5914856640 1 -- 172.21.15.55:0/2575574983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59100ca080 con 0x7f59100b2e40 2023-08-25T04:22:34.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.617+0000 7f5914856640 1 -- 172.21.15.55:0/2575574983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59100ca640 con 0x7f59100b2e40 2023-08-25T04:22:34.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.621+0000 7f5914856640 1 -- 172.21.15.55:0/2575574983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59100b2620 con 0x7f59100b2e40 2023-08-25T04:22:34.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.621+0000 7f59077fe640 1 -- 172.21.15.55:0/2575574983 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f5900003b10 con 0x7f59100b2e40 2023-08-25T04:22:34.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.621+0000 7f59077fe640 1 --2- 172.21.15.55:0/2575574983 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f58f00657a0 0x7f58f0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:34.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.621+0000 7f59077fe640 1 -- 172.21.15.55:0/2575574983 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5900082560 con 0x7f59100b2e40 2023-08-25T04:22:34.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.621+0000 7f5905d9b640 1 --2- 172.21.15.55:0/2575574983 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f58f00657a0 0x7f58f0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:34.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.621+0000 7f5905d9b640 1 --2- 172.21.15.55:0/2575574983 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f58f00657a0 0x7f58f0067c60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f58f80b1000 tx=0x7f58f80aa000 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.625+0000 7f59077fe640 1 -- 172.21.15.55:0/2575574983 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f59100b2620 con 0x7f59100b2e40 2023-08-25T04:22:34.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.817+0000 7f5914856640 1 -- 172.21.15.55:0/2575574983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59100b2620 con 0x7f59100b2e40 2023-08-25T04:22:34.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.817+0000 7f59077fe640 1 -- 172.21.15.55:0/2575574983 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f59100b2620 con 0x7f59100b2e40 2023-08-25T04:22:34.818 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:34.818 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7493,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/2640392190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2640392190},{"type":"v1","addr":"172.21.15.110:6837","nonce":2640392190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62},{"gid":8428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/2668985619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2668985619},{"type":"v1","addr":"172.21.15.110:6836","nonce":2668985619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61},{"gid":9018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/210118982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":210118982},{"type":"v1","addr":"172.21.15.55:6834","nonce":210118982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:22:24.336177+0000","modified":"2023-08-25T04:22:27.988148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9024":{"gid":9024,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/2424299953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2424299953},{"type":"v1","addr":"172.21.15.55:6835","nonce":2424299953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-25T04:22:34.819 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 66 2023-08-25T04:22:34.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.817+0000 7f5914856640 1 -- 172.21.15.55:0/2575574983 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f58f00657a0 msgr2=0x7f58f0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:34.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.817+0000 7f5914856640 1 --2- 172.21.15.55:0/2575574983 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f58f00657a0 0x7f58f0067c60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f58f80b1000 tx=0x7f58f80aa000 comp rx=0 tx=0).stop 2023-08-25T04:22:34.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.817+0000 7f5914856640 1 -- 172.21.15.55:0/2575574983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59100b2e40 msgr2=0x7f59100b7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:34.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.817+0000 7f5914856640 1 --2- 172.21.15.55:0/2575574983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59100b2e40 0x7f59100b7ef0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f590000c480 tx=0x7f590000c940 comp rx=0 tx=0).stop 2023-08-25T04:22:34.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.817+0000 7f5914856640 1 -- 172.21.15.55:0/2575574983 shutdown_connections 2023-08-25T04:22:34.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.821+0000 7f5914856640 1 --2- 172.21.15.55:0/2575574983 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59100d0da0 0x7f59100b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.821+0000 7f5914856640 1 --2- 172.21.15.55:0/2575574983 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f58f00657a0 0x7f58f0067c60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.821+0000 7f5914856640 1 --2- 172.21.15.55:0/2575574983 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59100cdde0 0x7f59100c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.821+0000 7f5914856640 1 --2- 172.21.15.55:0/2575574983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59100b2e40 0x7f59100b7ef0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:34.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.821+0000 7f5914856640 1 -- 172.21.15.55:0/2575574983 >> 172.21.15.55:0/2575574983 conn(0x7f591009bae0 msgr2=0x7f591006b300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:34.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.821+0000 7f5914856640 1 -- 172.21.15.55:0/2575574983 shutdown_connections 2023-08-25T04:22:34.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:34.821+0000 7f5914856640 1 -- 172.21.15.55:0/2575574983 wait complete. 2023-08-25T04:22:35.243 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-25T04:22:24.336177+0000', 'modified': '2023-08-25T04:22:27.988148+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9024}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9024': {'gid': 9024, 'name': 'c', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6835/2424299953', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6833', 'nonce': 2424299953}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 2424299953}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-25T04:22:35.244 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-25T04:22:35.244 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-25T04:22:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.393+0000 7f92c953a640 1 Processor -- start 2023-08-25T04:22:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.393+0000 7f92c953a640 1 -- start start 2023-08-25T04:22:35.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.393+0000 7f92c953a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92c40cda70 0x7f92c415d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.393+0000 7f92c953a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f92c415d5f0 0x7f92c406bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.393+0000 7f92c953a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c40c9fe0 con 0x7f92c406c120 2023-08-25T04:22:35.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.393+0000 7f92c953a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c40cde50 con 0x7f92c40cda70 2023-08-25T04:22:35.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.393+0000 7f92c953a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c415db70 con 0x7f92c415d5f0 2023-08-25T04:22:35.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.393+0000 7f92c2ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92c40cda70 0x7f92c415d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.393+0000 7f92c2ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f92c40cda70 0x7f92c415d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38436/0 (socket says 172.21.15.55:38436) 2023-08-25T04:22:35.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.393+0000 7f92c2ffd640 1 -- 172.21.15.55:0/882604120 learned_addr learned my addr 172.21.15.55:0/882604120 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:35.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.393+0000 7f92bbfff640 1 --2- 172.21.15.55:0/882604120 >> v2:172.21.15.110:3300/0 conn(0x7f92c415d5f0 0x7f92c406bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.393+0000 7f92c2ffd640 1 -- 172.21.15.55:0/882604120 >> v2:172.21.15.110:3300/0 conn(0x7f92c415d5f0 msgr2=0x7f92c406bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.393+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/882604120 >> v2:172.21.15.110:3300/0 conn(0x7f92c415d5f0 0x7f92c406bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.393+0000 7f92c2ffd640 1 -- 172.21.15.55:0/882604120 >> v1:172.21.15.110:6789/0 conn(0x7f92c406c120 legacy=0x7f92c40ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.393+0000 7f92c2ffd640 1 -- 172.21.15.55:0/882604120 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c415de50 con 0x7f92c40cda70 2023-08-25T04:22:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.393+0000 7f92bbfff640 1 --2- 172.21.15.55:0/882604120 >> v2:172.21.15.110:3300/0 conn(0x7f92c415d5f0 0x7f92c406bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.397+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/882604120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40cda70 0x7f92c415d0b0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f92c40b0b30 tx=0x7f92b401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5022f3198c81aaab server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.397+0000 7f92c27fc640 1 -- 172.21.15.55:0/882604120 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b40ab650 con 0x7f92c40cda70 2023-08-25T04:22:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.397+0000 7f92c27fc640 1 -- 172.21.15.55:0/882604120 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b40ab7b0 con 0x7f92c40cda70 2023-08-25T04:22:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.397+0000 7f92c27fc640 1 -- 172.21.15.55:0/882604120 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b40abb40 con 0x7f92c40cda70 2023-08-25T04:22:35.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.397+0000 7f92c953a640 1 -- 172.21.15.55:0/882604120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40cda70 msgr2=0x7f92c415d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:35.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.397+0000 7f92c953a640 1 --2- 172.21.15.55:0/882604120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40cda70 0x7f92c415d0b0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f92c40b0b30 tx=0x7f92b401c490 comp rx=0 tx=0).stop 2023-08-25T04:22:35.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.397+0000 7f92c953a640 1 -- 172.21.15.55:0/882604120 shutdown_connections 2023-08-25T04:22:35.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.397+0000 7f92c953a640 1 --2- 172.21.15.55:0/882604120 >> v2:172.21.15.110:3300/0 conn(0x7f92c415d5f0 0x7f92c406bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.397+0000 7f92c953a640 1 --2- 172.21.15.55:0/882604120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40cda70 0x7f92c415d0b0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.397+0000 7f92c953a640 1 -- 172.21.15.55:0/882604120 >> 172.21.15.55:0/882604120 conn(0x7f92c4069f00 msgr2=0x7f92c40affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:35.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.397+0000 7f92c953a640 1 -- 172.21.15.55:0/882604120 shutdown_connections 2023-08-25T04:22:35.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.397+0000 7f92c953a640 1 -- 172.21.15.55:0/882604120 wait complete. 2023-08-25T04:22:35.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92c953a640 1 Processor -- start 2023-08-25T04:22:35.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92c953a640 1 -- start start 2023-08-25T04:22:35.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92c953a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92c406c120 0x7f92c41f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92c953a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40cda70 0x7f92c40c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92c953a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92c415d5f0 0x7f92c40c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92c953a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40b3890 con 0x7f92c40cda70 2023-08-25T04:22:35.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92c953a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40b10d0 con 0x7f92c406c120 2023-08-25T04:22:35.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92c953a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40b1970 con 0x7f92c415d5f0 2023-08-25T04:22:35.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92bbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40cda70 0x7f92c40c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92bbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40cda70 0x7f92c40c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38440/0 (socket says 172.21.15.55:38440) 2023-08-25T04:22:35.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92bbfff640 1 -- 172.21.15.55:0/1900070467 learned_addr learned my addr 172.21.15.55:0/1900070467 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:35.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/1900070467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92c406c120 0x7f92c41f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92c37fe640 1 --2- 172.21.15.55:0/1900070467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92c415d5f0 0x7f92c40c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92bbfff640 1 -- 172.21.15.55:0/1900070467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92c415d5f0 msgr2=0x7f92c40c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:35.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92bbfff640 1 --2- 172.21.15.55:0/1900070467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92c415d5f0 0x7f92c40c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92bbfff640 1 -- 172.21.15.55:0/1900070467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92c406c120 msgr2=0x7f92c41f7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:35.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92bbfff640 1 --2- 172.21.15.55:0/1900070467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92c406c120 0x7f92c41f7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92bbfff640 1 -- 172.21.15.55:0/1900070467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b40094d0 con 0x7f92c40cda70 2023-08-25T04:22:35.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/1900070467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92c406c120 0x7f92c41f7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:35.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92bbfff640 1 --2- 172.21.15.55:0/1900070467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40cda70 0x7f92c40c41b0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00c7f0 tx=0x7f92ac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:35.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92bb7fe640 1 -- 172.21.15.55:0/1900070467 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac007820 con 0x7f92c40cda70 2023-08-25T04:22:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92bb7fe640 1 -- 172.21.15.55:0/1900070467 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac007980 con 0x7f92c40cda70 2023-08-25T04:22:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92c953a640 1 -- 172.21.15.55:0/1900070467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c40b35b0 con 0x7f92c40cda70 2023-08-25T04:22:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92bb7fe640 1 -- 172.21.15.55:0/1900070467 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac007d30 con 0x7f92c40cda70 2023-08-25T04:22:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.401+0000 7f92c953a640 1 -- 172.21.15.55:0/1900070467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c40b1600 con 0x7f92c40cda70 2023-08-25T04:22:35.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.405+0000 7f92bb7fe640 1 -- 172.21.15.55:0/1900070467 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f92ac0113f0 con 0x7f92c40cda70 2023-08-25T04:22:35.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.405+0000 7f92bb7fe640 1 --2- 172.21.15.55:0/1900070467 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f92a40657a0 0x7f92a4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.405+0000 7f92bb7fe640 1 -- 172.21.15.55:0/1900070467 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f92ac083460 con 0x7f92c40cda70 2023-08-25T04:22:35.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.405+0000 7f92cc899000 1 Processor -- start 2023-08-25T04:22:35.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.405+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/1900070467 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f92a40657a0 0x7f92a4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.405+0000 7f92cc899000 1 -- start start 2023-08-25T04:22:35.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/1900070467 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f92a40657a0 0x7f92a4067c60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f92b40af000 tx=0x7f92b40a7000 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:35.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92cc899000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a085020 0x55571a085400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92cc899000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085940 0x55571a03b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92cc899000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a03b5b0 0x55571a03b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92cc899000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555719e91440 con 0x55571a085940 2023-08-25T04:22:35.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92cc899000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555719e8e970 con 0x55571a03b5b0 2023-08-25T04:22:35.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92cc899000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x555719e8a260 con 0x55571a085020 2023-08-25T04:22:35.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92bbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085940 0x55571a03b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92bbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085940 0x55571a03b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38448/0 (socket says 172.21.15.55:38448) 2023-08-25T04:22:35.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92bbfff640 1 -- 172.21.15.55:0/1940874435 learned_addr learned my addr 172.21.15.55:0/1940874435 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:35.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/1940874435 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a085020 0x55571a085400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92c37fe640 1 --2- 172.21.15.55:0/1940874435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a03b5b0 0x55571a03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92bbfff640 1 -- 172.21.15.55:0/1940874435 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a085020 msgr2=0x55571a085400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:35.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92bbfff640 1 --2- 172.21.15.55:0/1940874435 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a085020 0x55571a085400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92bbfff640 1 -- 172.21.15.55:0/1940874435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a03b5b0 msgr2=0x55571a03b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:35.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92bbfff640 1 --2- 172.21.15.55:0/1940874435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a03b5b0 0x55571a03b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92bbfff640 1 -- 172.21.15.55:0/1940874435 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555719f22ec0 con 0x55571a085940 2023-08-25T04:22:35.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92c37fe640 1 --2- 172.21.15.55:0/1940874435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a03b5b0 0x55571a03b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:35.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/1940874435 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a085020 0x55571a085400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:35.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92bbfff640 1 --2- 172.21.15.55:0/1940874435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085940 0x55571a03b070 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f92ac006ee0 tx=0x7f92ac0550f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8bfa853fab2a4a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:35.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92b8ff9640 1 -- 172.21.15.55:0/1940874435 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac081780 con 0x55571a085940 2023-08-25T04:22:35.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92b8ff9640 1 -- 172.21.15.55:0/1940874435 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac0818e0 con 0x55571a085940 2023-08-25T04:22:35.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92b8ff9640 1 -- 172.21.15.55:0/1940874435 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac083070 con 0x55571a085940 2023-08-25T04:22:35.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92cc899000 1 -- 172.21.15.55:0/1940874435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085940 msgr2=0x55571a03b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:35.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92cc899000 1 --2- 172.21.15.55:0/1940874435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085940 0x55571a03b070 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f92ac006ee0 tx=0x7f92ac0550f0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92cc899000 1 -- 172.21.15.55:0/1940874435 shutdown_connections 2023-08-25T04:22:35.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92cc899000 1 --2- 172.21.15.55:0/1940874435 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a03b5b0 0x55571a03b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92cc899000 1 --2- 172.21.15.55:0/1940874435 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085940 0x55571a03b070 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92cc899000 1 --2- 172.21.15.55:0/1940874435 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a085020 0x55571a085400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92cc899000 1 -- 172.21.15.55:0/1940874435 >> 172.21.15.55:0/1940874435 conn(0x55571a037560 msgr2=0x55571a039950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:35.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92cc899000 1 -- 172.21.15.55:0/1940874435 shutdown_connections 2023-08-25T04:22:35.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92cc899000 1 -- 172.21.15.55:0/1940874435 wait complete. 2023-08-25T04:22:35.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92cc899000 1 -- start start 2023-08-25T04:22:35.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.409+0000 7f92cc899000 1 Processor -- start 2023-08-25T04:22:35.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a03b5b0 0x55571a08c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085020 0x55571a08c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a085940 0x55571a072dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555719e44f60 con 0x55571a085020 2023-08-25T04:22:35.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555719e44c00 con 0x55571a085940 2023-08-25T04:22:35.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x555719b45940 con 0x55571a03b5b0 2023-08-25T04:22:35.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 10 client.0 _ll_register_callbacks cb 0x55571a026900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:22:35.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92bbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085020 0x55571a08c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92bbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085020 0x55571a08c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38458/0 (socket says 172.21.15.55:38458) 2023-08-25T04:22:35.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92bbfff640 1 -- 172.21.15.55:0/2619508212 learned_addr learned my addr 172.21.15.55:0/2619508212 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:35.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/2619508212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a03b5b0 0x55571a08c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92c37fe640 1 --2- 172.21.15.55:0/2619508212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a085940 0x55571a072dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92bbfff640 1 -- 172.21.15.55:0/2619508212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a03b5b0 msgr2=0x55571a08c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:35.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92bbfff640 1 --2- 172.21.15.55:0/2619508212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a03b5b0 0x55571a08c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92bbfff640 1 -- 172.21.15.55:0/2619508212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a085940 msgr2=0x55571a072dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:35.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92bbfff640 1 --2- 172.21.15.55:0/2619508212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a085940 0x55571a072dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92bbfff640 1 -- 172.21.15.55:0/2619508212 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c40b1600 con 0x55571a085020 2023-08-25T04:22:35.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92bbfff640 1 --2- 172.21.15.55:0/2619508212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085020 0x55571a08c8c0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f92ac050e20 tx=0x7f92ac006e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878dee214fe40f20 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:35.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T04:22:35.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92a1ffb640 1 -- 172.21.15.55:0/2619508212 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac0812c0 con 0x55571a085020 2023-08-25T04:22:35.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92a1ffb640 1 -- 172.21.15.55:0/2619508212 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f92ac083070 con 0x55571a085020 2023-08-25T04:22:35.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 -- 172.21.15.55:0/2619508212 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555719e219d0 con 0x55571a085020 2023-08-25T04:22:35.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92a1ffb640 1 -- 172.21.15.55:0/2619508212 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92ac083250 con 0x55571a085020 2023-08-25T04:22:35.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 10 client.9195 fetch_fsmap learned FSMap version 66 2023-08-25T04:22:35.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 -- 172.21.15.55:0/2619508212 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x555719b84890 con 0x55571a085020 2023-08-25T04:22:35.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92a1ffb640 1 -- 172.21.15.55:0/2619508212 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac076080 con 0x55571a085020 2023-08-25T04:22:35.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92a1ffb640 1 -- 172.21.15.55:0/2619508212 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 66) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f92ac0720d0 con 0x55571a085020 2023-08-25T04:22:35.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 10 client.9195 fetch_fsmap finished waiting for FSMap version 66 2023-08-25T04:22:35.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 10 client.9195 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T04:22:35.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 20 client.9195 populate_metadata read hostname 'smithi055' 2023-08-25T04:22:35.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 --2- 172.21.15.55:0/2619508212 >> [v2:172.21.15.55:6833/2424299953,v1:172.21.15.55:6835/2424299953] conn(0x55571a073b70 0x55571a073f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 4 client.9195 mds_command: new command op to 9024 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-25T04:22:35.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 -- 172.21.15.55:0/2619508212 --> [v2:172.21.15.55:6833/2424299953,v1:172.21.15.55:6835/2424299953] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555719e417a0 con 0x55571a073b70 2023-08-25T04:22:35.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/2619508212 >> [v2:172.21.15.55:6833/2424299953,v1:172.21.15.55:6835/2424299953] conn(0x55571a073b70 0x55571a073f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92a1ffb640 10 client.9195 ms_handle_connect on v2:172.21.15.55:6833/2424299953 2023-08-25T04:22:35.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/2619508212 >> [v2:172.21.15.55:6833/2424299953,v1:172.21.15.55:6835/2424299953] conn(0x55571a073b70 0x55571a073f50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e2c40cf1df6b426 server_cookie=8fa7ecc6f4b6a56c in_seq=0 out_seq=0 2023-08-25T04:22:35.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92a1ffb640 1 -- 172.21.15.55:0/2619508212 <== mds.0 v2:172.21.15.55:6833/2424299953 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555719e417a0 con 0x55571a073b70 2023-08-25T04:22:35.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92a1ffb640 10 client.9195 handle_command_reply: tid=0 2023-08-25T04:22:35.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 client.9195 shutdown 2023-08-25T04:22:35.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 -- 172.21.15.55:0/2619508212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085020 msgr2=0x55571a08c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:35.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 --2- 172.21.15.55:0/2619508212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085020 0x55571a08c8c0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f92ac050e20 tx=0x7f92ac006e50 comp rx=0 tx=0).stop 2023-08-25T04:22:35.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 -- 172.21.15.55:0/2619508212 shutdown_connections 2023-08-25T04:22:35.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 --2- 172.21.15.55:0/2619508212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a085940 0x55571a072dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 --2- 172.21.15.55:0/2619508212 >> [v2:172.21.15.55:6833/2424299953,v1:172.21.15.55:6835/2424299953] conn(0x55571a073b70 0x55571a073f50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 --2- 172.21.15.55:0/2619508212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085020 0x55571a08c8c0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 --2- 172.21.15.55:0/2619508212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a03b5b0 0x55571a08c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 -- 172.21.15.55:0/2619508212 >> 172.21.15.55:0/2619508212 conn(0x55571a037560 msgr2=0x55571a03a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:35.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92a1ffb640 0 client.9195 ms_handle_reset on v2:172.21.15.55:6833/2424299953 2023-08-25T04:22:35.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.413+0000 7f92cc899000 1 -- 172.21.15.55:0/2619508212 shutdown_connections 2023-08-25T04:22:35.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.417+0000 7f92cc899000 1 -- 172.21.15.55:0/2619508212 wait complete. 2023-08-25T04:22:35.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.417+0000 7f92cc899000 20 client.9195 trim_cache size 0 max 16384 2023-08-25T04:22:35.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.429+0000 7f92cc899000 1 Processor -- start 2023-08-25T04:22:35.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.429+0000 7f92cc899000 1 -- start start 2023-08-25T04:22:35.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a03b5b0 0x55571a039950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085020 0x55571a039e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a085940 0x55571a087d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555719e41640 con 0x55571a085020 2023-08-25T04:22:35.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555719e44f60 con 0x55571a085940 2023-08-25T04:22:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55571a03dbd0 con 0x55571a03b5b0 2023-08-25T04:22:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92bbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085020 0x55571a039e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92bbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085020 0x55571a039e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38472/0 (socket says 172.21.15.55:38472) 2023-08-25T04:22:35.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92bbfff640 1 -- 172.21.15.55:0/2119917417 learned_addr learned my addr 172.21.15.55:0/2119917417 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:35.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92bbfff640 1 -- 172.21.15.55:0/2119917417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a03b5b0 msgr2=0x55571a039950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:35.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92bbfff640 1 --2- 172.21.15.55:0/2119917417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a03b5b0 0x55571a039950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92bbfff640 1 -- 172.21.15.55:0/2119917417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a085940 msgr2=0x55571a087d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:35.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92bbfff640 1 --2- 172.21.15.55:0/2119917417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a085940 0x55571a087d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92bbfff640 1 -- 172.21.15.55:0/2119917417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555719e4d190 con 0x55571a085020 2023-08-25T04:22:35.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92bbfff640 1 --2- 172.21.15.55:0/2119917417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085020 0x55571a039e90 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f92ac054620 tx=0x7f92ac06b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4366fef7306afc6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:35.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92b97fa640 1 -- 172.21.15.55:0/2119917417 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac0812c0 con 0x55571a085020 2023-08-25T04:22:35.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92b97fa640 1 -- 172.21.15.55:0/2119917417 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555719e219d0 con 0x55571a085020 2023-08-25T04:22:35.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92b97fa640 1 -- 172.21.15.55:0/2119917417 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac050710 con 0x55571a085020 2023-08-25T04:22:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 -- 172.21.15.55:0/2119917417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085020 msgr2=0x55571a039e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 --2- 172.21.15.55:0/2119917417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085020 0x55571a039e90 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f92ac054620 tx=0x7f92ac06b000 comp rx=0 tx=0).stop 2023-08-25T04:22:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 -- 172.21.15.55:0/2119917417 shutdown_connections 2023-08-25T04:22:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 --2- 172.21.15.55:0/2119917417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a085940 0x55571a087d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 --2- 172.21.15.55:0/2119917417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a085020 0x55571a039e90 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 --2- 172.21.15.55:0/2119917417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a03b5b0 0x55571a039950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 -- 172.21.15.55:0/2119917417 >> 172.21.15.55:0/2119917417 conn(0x55571a037560 msgr2=0x55571a083fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:35.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 -- 172.21.15.55:0/2119917417 shutdown_connections 2023-08-25T04:22:35.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 -- 172.21.15.55:0/2119917417 wait complete. 2023-08-25T04:22:35.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 -- start start 2023-08-25T04:22:35.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 Processor -- start 2023-08-25T04:22:35.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a03b5b0 0x55571a0e31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a085020 0x55571a0e3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a085940 0x55571a08a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555719e51e80 con 0x55571a03b5b0 2023-08-25T04:22:35.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555719e577a0 con 0x55571a085020 2023-08-25T04:22:35.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x555719e940e0 con 0x55571a085940 2023-08-25T04:22:35.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.433+0000 7f92cc899000 10 client.0 _ll_register_callbacks cb 0x7f92ac050c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T04:22:35.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a03b5b0 0x55571a0e31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c2ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a03b5b0 0x55571a0e31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38478/0 (socket says 172.21.15.55:38478) 2023-08-25T04:22:35.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c2ffd640 1 -- 172.21.15.55:0/2932422592 learned_addr learned my addr 172.21.15.55:0/2932422592 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:35.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92bbfff640 1 --2- 172.21.15.55:0/2932422592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a085020 0x55571a0e3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c37fe640 1 --2- 172.21.15.55:0/2932422592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a085940 0x55571a08a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c2ffd640 1 -- 172.21.15.55:0/2932422592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a085940 msgr2=0x55571a08a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:35.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/2932422592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a085940 0x55571a08a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c2ffd640 1 -- 172.21.15.55:0/2932422592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a085020 msgr2=0x55571a0e3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:35.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/2932422592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a085020 0x55571a0e3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c2ffd640 1 -- 172.21.15.55:0/2932422592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555719b84890 con 0x55571a03b5b0 2023-08-25T04:22:35.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c2ffd640 1 --2- 172.21.15.55:0/2932422592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a03b5b0 0x55571a0e31c0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f92b40ad040 tx=0x7f92b401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da51e7f30561d5ac server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:35.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T04:22:35.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92a1ffb640 1 -- 172.21.15.55:0/2932422592 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b40c4040 con 0x55571a03b5b0 2023-08-25T04:22:35.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92a1ffb640 1 -- 172.21.15.55:0/2932422592 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f92b40abd60 con 0x55571a03b5b0 2023-08-25T04:22:35.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 1 -- 172.21.15.55:0/2932422592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55571a09bab0 con 0x55571a03b5b0 2023-08-25T04:22:35.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92a1ffb640 1 -- 172.21.15.55:0/2932422592 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92b40cb350 con 0x55571a03b5b0 2023-08-25T04:22:35.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 10 client.9201 fetch_fsmap learned FSMap version 66 2023-08-25T04:22:35.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 1 -- 172.21.15.55:0/2932422592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x555719e33420 con 0x55571a03b5b0 2023-08-25T04:22:35.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92a1ffb640 1 -- 172.21.15.55:0/2932422592 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55571a09bab0 con 0x55571a03b5b0 2023-08-25T04:22:35.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92a1ffb640 1 -- 172.21.15.55:0/2932422592 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 66) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f92b40bf8d0 con 0x55571a03b5b0 2023-08-25T04:22:35.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 10 client.9201 fetch_fsmap finished waiting for FSMap version 66 2023-08-25T04:22:35.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 10 client.9201 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T04:22:35.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 20 client.9201 populate_metadata read hostname 'smithi055' 2023-08-25T04:22:35.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 1 --2- 172.21.15.55:0/2932422592 >> [v2:172.21.15.55:6833/2424299953,v1:172.21.15.55:6835/2424299953] conn(0x55571a0ea020 0x55571a0ec410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 4 client.9201 mds_command: new command op to 9024 tid=0[{"prefix": "status"}] 2023-08-25T04:22:35.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 1 -- 172.21.15.55:0/2932422592 --> [v2:172.21.15.55:6833/2424299953,v1:172.21.15.55:6835/2424299953] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555719e45880 con 0x55571a0ea020 2023-08-25T04:22:35.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92bbfff640 1 --2- 172.21.15.55:0/2932422592 >> [v2:172.21.15.55:6833/2424299953,v1:172.21.15.55:6835/2424299953] conn(0x55571a0ea020 0x55571a0ec410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92bbfff640 1 --2- 172.21.15.55:0/2932422592 >> [v2:172.21.15.55:6833/2424299953,v1:172.21.15.55:6835/2424299953] conn(0x55571a0ea020 0x55571a0ec410 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4986c88339bff65 server_cookie=40beb9d35039f900 in_seq=0 out_seq=0 2023-08-25T04:22:35.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92a1ffb640 10 client.9201 ms_handle_connect on v2:172.21.15.55:6833/2424299953 2023-08-25T04:22:35.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92a1ffb640 1 -- 172.21.15.55:0/2932422592 <== mds.0 v2:172.21.15.55:6833/2424299953 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x555719e45880 con 0x55571a0ea020 2023-08-25T04:22:35.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92a1ffb640 10 client.9201 handle_command_reply: tid=0 2023-08-25T04:22:35.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 1 client.9201 shutdown 2023-08-25T04:22:35.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 1 -- 172.21.15.55:0/2932422592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a03b5b0 msgr2=0x55571a0e31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:35.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 1 --2- 172.21.15.55:0/2932422592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a03b5b0 0x55571a0e31c0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f92b40ad040 tx=0x7f92b401acd0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 1 -- 172.21.15.55:0/2932422592 shutdown_connections 2023-08-25T04:22:35.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 1 --2- 172.21.15.55:0/2932422592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55571a085940 0x55571a08a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 1 --2- 172.21.15.55:0/2932422592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55571a085020 0x55571a0e3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 1 --2- 172.21.15.55:0/2932422592 >> [v2:172.21.15.55:6833/2424299953,v1:172.21.15.55:6835/2424299953] conn(0x55571a0ea020 0x55571a0ec410 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 1 --2- 172.21.15.55:0/2932422592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55571a03b5b0 0x55571a0e31c0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92a1ffb640 0 client.9201 ms_handle_reset on v2:172.21.15.55:6833/2424299953 2023-08-25T04:22:35.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 1 -- 172.21.15.55:0/2932422592 >> 172.21.15.55:0/2932422592 conn(0x55571a037560 msgr2=0x55571a071f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:35.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 1 -- 172.21.15.55:0/2932422592 shutdown_connections 2023-08-25T04:22:35.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 1 -- 172.21.15.55:0/2932422592 wait complete. 2023-08-25T04:22:35.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92cc899000 20 client.9201 trim_cache size 0 max 16384 2023-08-25T04:22:35.446 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T04:22:35.447 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2d2a9024-b152-4d40-880c-1686d1810590", 2023-08-25T04:22:35.447 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-08-25T04:22:35.447 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 9024, 2023-08-25T04:22:35.447 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-08-25T04:22:35.447 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-08-25T04:22:35.447 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-08-25T04:22:35.447 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.459288119, 2023-08-25T04:22:35.447 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 66, 2023-08-25T04:22:35.448 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 136, 2023-08-25T04:22:35.448 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 136, 2023-08-25T04:22:35.448 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 16.408068610000001 2023-08-25T04:22:35.448 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T04:22:35.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c953a640 1 -- 172.21.15.55:0/1900070467 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f92a40657a0 msgr2=0x7f92a4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:35.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c953a640 1 --2- 172.21.15.55:0/1900070467 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f92a40657a0 0x7f92a4067c60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f92b40af000 tx=0x7f92b40a7000 comp rx=0 tx=0).stop 2023-08-25T04:22:35.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c953a640 1 -- 172.21.15.55:0/1900070467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40cda70 msgr2=0x7f92c40c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:35.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c953a640 1 --2- 172.21.15.55:0/1900070467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40cda70 0x7f92c40c41b0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00c7f0 tx=0x7f92ac00ccb0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c953a640 1 -- 172.21.15.55:0/1900070467 shutdown_connections 2023-08-25T04:22:35.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c953a640 1 --2- 172.21.15.55:0/1900070467 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f92a40657a0 0x7f92a4067c60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c953a640 1 --2- 172.21.15.55:0/1900070467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f92c415d5f0 0x7f92c40c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c953a640 1 --2- 172.21.15.55:0/1900070467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f92c40cda70 0x7f92c40c41b0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c953a640 1 --2- 172.21.15.55:0/1900070467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f92c406c120 0x7f92c41f7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.437+0000 7f92c953a640 1 -- 172.21.15.55:0/1900070467 >> 172.21.15.55:0/1900070467 conn(0x7f92c4069f00 msgr2=0x7f92c40c7690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:35.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.441+0000 7f92c953a640 1 -- 172.21.15.55:0/1900070467 shutdown_connections 2023-08-25T04:22:35.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.441+0000 7f92c953a640 1 -- 172.21.15.55:0/1900070467 wait complete. 2023-08-25T04:22:35.458 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T04:22:35.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.601+0000 7fadf0c5c640 1 Processor -- start 2023-08-25T04:22:35.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.601+0000 7fadf0c5c640 1 -- start start 2023-08-25T04:22:35.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.601+0000 7fadf0c5c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fadec0d0da0 0x7fadec0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.601+0000 7fadf0c5c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadec0cdde0 0x7fadec0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.601+0000 7fadf0c5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadec0b29b0 con 0x7fadec0cee60 2023-08-25T04:22:35.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.601+0000 7fadf0c5c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadec0ce760 con 0x7fadec0d0da0 2023-08-25T04:22:35.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.601+0000 7fadf0c5c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0d16c0 con 0x7fadec0cdde0 2023-08-25T04:22:35.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.601+0000 7fadea59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fadec0d0da0 0x7fadec0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.601+0000 7fadea59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fadec0d0da0 0x7fadec0d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38484/0 (socket says 172.21.15.55:38484) 2023-08-25T04:22:35.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.601+0000 7fadea59c640 1 -- 172.21.15.55:0/3559272873 learned_addr learned my addr 172.21.15.55:0/3559272873 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:35.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.601+0000 7fade3fff640 1 --2- 172.21.15.55:0/3559272873 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadec0cdde0 0x7fadec0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.601+0000 7fadea59c640 1 -- 172.21.15.55:0/3559272873 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadec0cdde0 msgr2=0x7fadec0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:35.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.601+0000 7fadea59c640 1 --2- 172.21.15.55:0/3559272873 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadec0cdde0 0x7fadec0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.601+0000 7fadea59c640 1 -- 172.21.15.55:0/3559272873 >> v1:172.21.15.55:6789/0 conn(0x7fadec0cee60 legacy=0x7fadec0cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.601+0000 7fadea59c640 1 -- 172.21.15.55:0/3559272873 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec0b1dc0 con 0x7fadec0d0da0 2023-08-25T04:22:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.605+0000 7fadea59c640 1 --2- 172.21.15.55:0/3559272873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadec0d0da0 0x7fadec0d1180 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7faddc006fd0 tx=0x7faddc01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ac28fa4abe15cb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.605+0000 7fade9d9b640 1 -- 172.21.15.55:0/3559272873 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc0a8a10 con 0x7fadec0d0da0 2023-08-25T04:22:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.605+0000 7fade9d9b640 1 -- 172.21.15.55:0/3559272873 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faddc0a8b70 con 0x7fadec0d0da0 2023-08-25T04:22:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.605+0000 7fade9d9b640 1 -- 172.21.15.55:0/3559272873 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc0b0440 con 0x7fadec0d0da0 2023-08-25T04:22:35.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.605+0000 7fadf0c5c640 1 -- 172.21.15.55:0/3559272873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadec0d0da0 msgr2=0x7fadec0d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:35.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.605+0000 7fadf0c5c640 1 --2- 172.21.15.55:0/3559272873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadec0d0da0 0x7fadec0d1180 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7faddc006fd0 tx=0x7faddc01ed10 comp rx=0 tx=0).stop 2023-08-25T04:22:35.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.605+0000 7fadf0c5c640 1 -- 172.21.15.55:0/3559272873 shutdown_connections 2023-08-25T04:22:35.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.605+0000 7fadf0c5c640 1 --2- 172.21.15.55:0/3559272873 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadec0cdde0 0x7fadec0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.605+0000 7fadf0c5c640 1 --2- 172.21.15.55:0/3559272873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadec0d0da0 0x7fadec0d1180 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.605+0000 7fadf0c5c640 1 -- 172.21.15.55:0/3559272873 >> 172.21.15.55:0/3559272873 conn(0x7fadec09bae0 msgr2=0x7fadec0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:35.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.605+0000 7fadf0c5c640 1 -- 172.21.15.55:0/3559272873 shutdown_connections 2023-08-25T04:22:35.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.605+0000 7fadf0c5c640 1 -- 172.21.15.55:0/3559272873 wait complete. 2023-08-25T04:22:35.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fadf0c5c640 1 Processor -- start 2023-08-25T04:22:35.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fadf0c5c640 1 -- start start 2023-08-25T04:22:35.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fadf0c5c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadec0cdde0 0x7fadec15b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fadf0c5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadec0cee60 0x7fadec1f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fadf0c5c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadec0d0da0 0x7fadec0b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fadf0c5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0c91e0 con 0x7fadec0cee60 2023-08-25T04:22:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fadf0c5c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadec149490 con 0x7fadec0cdde0 2023-08-25T04:22:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fadf0c5c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadec0c8940 con 0x7fadec0d0da0 2023-08-25T04:22:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fade3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadec0cee60 0x7fadec1f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fade3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadec0cee60 0x7fadec1f1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38492/0 (socket says 172.21.15.55:38492) 2023-08-25T04:22:35.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fade3fff640 1 -- 172.21.15.55:0/4066306305 learned_addr learned my addr 172.21.15.55:0/4066306305 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:35.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fade3fff640 1 -- 172.21.15.55:0/4066306305 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadec0d0da0 msgr2=0x7fadec0b7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:35.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fade3fff640 1 --2- 172.21.15.55:0/4066306305 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadec0d0da0 0x7fadec0b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fade3fff640 1 -- 172.21.15.55:0/4066306305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadec0cdde0 msgr2=0x7fadec15b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:35.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fade3fff640 1 --2- 172.21.15.55:0/4066306305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadec0cdde0 0x7fadec15b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fade3fff640 1 -- 172.21.15.55:0/4066306305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc009480 con 0x7fadec0cee60 2023-08-25T04:22:35.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fade3fff640 1 --2- 172.21.15.55:0/4066306305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadec0cee60 0x7fadec1f1c30 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fadd400e930 tx=0x7fadd400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:35.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fade2ffd640 1 -- 172.21.15.55:0/4066306305 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd4009690 con 0x7fadec0cee60 2023-08-25T04:22:35.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fade2ffd640 1 -- 172.21.15.55:0/4066306305 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd400ca00 con 0x7fadec0cee60 2023-08-25T04:22:35.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fade2ffd640 1 -- 172.21.15.55:0/4066306305 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd400cd70 con 0x7fadec0cee60 2023-08-25T04:22:35.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fadf0c5c640 1 -- 172.21.15.55:0/4066306305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadec0c8c20 con 0x7fadec0cee60 2023-08-25T04:22:35.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.609+0000 7fadf0c5c640 1 -- 172.21.15.55:0/4066306305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadec0b76c0 con 0x7fadec0cee60 2023-08-25T04:22:35.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.613+0000 7fadf0c5c640 1 -- 172.21.15.55:0/4066306305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadec04dbe0 con 0x7fadec0cee60 2023-08-25T04:22:35.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.613+0000 7fade2ffd640 1 -- 172.21.15.55:0/4066306305 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fadd4013470 con 0x7fadec0cee60 2023-08-25T04:22:35.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.613+0000 7fade2ffd640 1 --2- 172.21.15.55:0/4066306305 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fadcc0657a0 0x7fadcc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:35.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.613+0000 7fade2ffd640 1 -- 172.21.15.55:0/4066306305 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fadd40831e0 con 0x7fadec0cee60 2023-08-25T04:22:35.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.613+0000 7fadea59c640 1 --2- 172.21.15.55:0/4066306305 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fadcc0657a0 0x7fadcc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:35.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.613+0000 7fadea59c640 1 --2- 172.21.15.55:0/4066306305 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fadcc0657a0 0x7fadcc067c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faddc0b2000 tx=0x7faddc004740 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:35.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.617+0000 7fade2ffd640 1 -- 172.21.15.55:0/4066306305 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fadd4050c40 con 0x7fadec0cee60 2023-08-25T04:22:35.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.805+0000 7fadf0c5c640 1 -- 172.21.15.55:0/4066306305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fadec0d0b80 con 0x7fadec0cee60 2023-08-25T04:22:35.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.805+0000 7fade2ffd640 1 -- 172.21.15.55:0/4066306305 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) v1 ==== 53+0+73 (secure 0 0 0) 0x7fadd4054260 con 0x7fadec0cee60 2023-08-25T04:22:35.807 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T04:22:35.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.809+0000 7fadf0c5c640 1 -- 172.21.15.55:0/4066306305 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fadcc0657a0 msgr2=0x7fadcc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:35.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.809+0000 7fadf0c5c640 1 --2- 172.21.15.55:0/4066306305 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fadcc0657a0 0x7fadcc067c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faddc0b2000 tx=0x7faddc004740 comp rx=0 tx=0).stop 2023-08-25T04:22:35.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.809+0000 7fadf0c5c640 1 -- 172.21.15.55:0/4066306305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadec0cee60 msgr2=0x7fadec1f1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:35.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.809+0000 7fadf0c5c640 1 --2- 172.21.15.55:0/4066306305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadec0cee60 0x7fadec1f1c30 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fadd400e930 tx=0x7fadd400edf0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.809+0000 7fadf0c5c640 1 -- 172.21.15.55:0/4066306305 shutdown_connections 2023-08-25T04:22:35.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.809+0000 7fadf0c5c640 1 --2- 172.21.15.55:0/4066306305 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fadcc0657a0 0x7fadcc067c60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.809+0000 7fadf0c5c640 1 --2- 172.21.15.55:0/4066306305 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadec0d0da0 0x7fadec0b7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.809+0000 7fadf0c5c640 1 --2- 172.21.15.55:0/4066306305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadec0cee60 0x7fadec1f1c30 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.809+0000 7fadf0c5c640 1 --2- 172.21.15.55:0/4066306305 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadec0cdde0 0x7fadec15b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:35.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.809+0000 7fadf0c5c640 1 -- 172.21.15.55:0/4066306305 >> 172.21.15.55:0/4066306305 conn(0x7fadec09bae0 msgr2=0x7fadec0b2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:35.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.809+0000 7fadf0c5c640 1 -- 172.21.15.55:0/4066306305 shutdown_connections 2023-08-25T04:22:35.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:35.809+0000 7fadf0c5c640 1 -- 172.21.15.55:0/4066306305 wait complete. 2023-08-25T04:22:35.830 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-25T04:22:35.830 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T04:22:35.830 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-08-25T04:22:35.831 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-25T04:22:35.831 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T04:22:35.831 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-25T04:22:35.832 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-25T04:22:35.832 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T04:22:35.832 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:22:35.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:22:35.833 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-08-25T04:22:35.844 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T04:22:35.845 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T04:22:35.845 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T04:22:35.845 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:22:35.846 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-08-25T04:22:35.846 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:22:35.846 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:22:35.847 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:22:35.847 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-08-25T04:22:35.847 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:22:35.847 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:22:35.847 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-08-25T04:22:35.847 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T04:22:35.847 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:22:35.848 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-08-25T04:22:35.848 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-08-25T04:22:35.848 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41232sec preferred_lft 41232sec 2023-08-25T04:22:35.848 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-08-25T04:22:35.848 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:22:35.848 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T04:22:35.848 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-08-25T04:22:35.849 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-08-25T04:22:35.849 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-25T04:22:35.849 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:98:6a:38:6a brd ff:ff:ff:ff:ff:ff 2023-08-25T04:22:35.849 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-25T04:22:35.849 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:22:35.850 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T04:22:35.850 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-08-25T04:22:35.850 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T04:22:35.850 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:22:35.850 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-08-25T04:22:35.850 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:22:35.850 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:22:35.850 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T04:22:35.851 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-08-25T04:22:35.851 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:22:35.851 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T04:22:35.851 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-25T04:22:35.851 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-08-25T04:22:35.851 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T04:22:35.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:22:35.852 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T04:22:35.910 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-08-25T04:22:35.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:22:35.913 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-08-25T04:22:35.970 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-08-25T04:22:35.971 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T04:22:35.971 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-08-25T04:22:35.971 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-25T04:22:35.971 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-08-25T04:22:35.971 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T04:22:35.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:22:35.972 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T04:22:35.973 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T04:22:35.974 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-25T04:22:35.975 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-25T04:22:35.976 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-25T04:22:35.977 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T04:22:36.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:22:36.069 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-08-25T04:22:36.078 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-25T04:22:36.078 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-25T04:22:36.079 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:22:36.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:22:36.080 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-08-25T04:22:36.145 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:22:36.146 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-25T04:22:36.200 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-25T04:22:36.201 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T04:22:36.201 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:22:36.256 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-25T04:22:36.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:22:36.259 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:22:36.352 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:22:36.352 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:22:36.365 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T04:22:36.365 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T04:22:36.365 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.110:3300,172.21.15.110:3301" 2023-08-25T04:22:36.365 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2d2a9024-b152-4d40-880c-1686d1810590.cephfs=/ 2023-08-25T04:22:36.366 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2023-08-25T04:22:36.368 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T04:22:36.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:22:36.370 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-25T04:22:36.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:22:36.393 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T04:22:36.457 INFO:teuthology.orchestra.run.smithi055.stdout:client8554 2023-08-25T04:22:36.458 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T04:22:36.458 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T04:22:36.512 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-25T04:22:36.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.701+0000 7fa446b11640 1 Processor -- start 2023-08-25T04:22:36.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.701+0000 7fa446b11640 1 -- start start 2023-08-25T04:22:36.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.705+0000 7fa446b11640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa4400ceff0 0x7fa440069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:36.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.705+0000 7fa446b11640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44006c4f0 con 0x7fa440069e40 2023-08-25T04:22:36.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.705+0000 7fa446b11640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44006c7d0 con 0x7fa4400aeb10 2023-08-25T04:22:36.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.705+0000 7fa446b11640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4400d0380 con 0x7fa4400ceff0 2023-08-25T04:22:36.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.705+0000 7fa43ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa4400ceff0 0x7fa440069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:36.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.705+0000 7fa43ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa4400ceff0 0x7fa440069900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38504/0 (socket says 172.21.15.55:38504) 2023-08-25T04:22:36.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.705+0000 7fa43ffff640 1 -- 172.21.15.55:0/672473270 learned_addr learned my addr 172.21.15.55:0/672473270 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:36.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.705+0000 7fa43ffff640 1 -- 172.21.15.55:0/672473270 >> v1:172.21.15.110:6789/0 conn(0x7fa4400aeb10 legacy=0x7fa4400ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:36.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.705+0000 7fa43ffff640 1 -- 172.21.15.55:0/672473270 >> v1:172.21.15.55:6789/0 conn(0x7fa440069e40 legacy=0x7fa4400cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:36.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.705+0000 7fa43ffff640 1 -- 172.21.15.55:0/672473270 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44006cab0 con 0x7fa4400ceff0 2023-08-25T04:22:36.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.705+0000 7fa43ffff640 1 --2- 172.21.15.55:0/672473270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4400ceff0 0x7fa440069900 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009870 tx=0x7fa42c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9013649892177ce9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:36.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.705+0000 7fa43f7fe640 1 -- 172.21.15.55:0/672473270 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c0ab600 con 0x7fa4400ceff0 2023-08-25T04:22:36.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.705+0000 7fa43f7fe640 1 -- 172.21.15.55:0/672473270 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c0a7050 con 0x7fa4400ceff0 2023-08-25T04:22:36.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa43f7fe640 1 -- 172.21.15.55:0/672473270 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c0ab980 con 0x7fa4400ceff0 2023-08-25T04:22:36.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa446b11640 1 -- 172.21.15.55:0/672473270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4400ceff0 msgr2=0x7fa440069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:36.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa446b11640 1 --2- 172.21.15.55:0/672473270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4400ceff0 0x7fa440069900 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fa42c009870 tx=0x7fa42c01c500 comp rx=0 tx=0).stop 2023-08-25T04:22:36.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa446b11640 1 -- 172.21.15.55:0/672473270 shutdown_connections 2023-08-25T04:22:36.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa446b11640 1 --2- 172.21.15.55:0/672473270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4400ceff0 0x7fa440069900 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:36.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa446b11640 1 -- 172.21.15.55:0/672473270 >> 172.21.15.55:0/672473270 conn(0x7fa4400cf530 msgr2=0x7fa4400cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:36.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa446b11640 1 -- 172.21.15.55:0/672473270 shutdown_connections 2023-08-25T04:22:36.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa446b11640 1 -- 172.21.15.55:0/672473270 wait complete. 2023-08-25T04:22:36.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa446b11640 1 Processor -- start 2023-08-25T04:22:36.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa446b11640 1 -- start start 2023-08-25T04:22:36.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa446b11640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa440069e40 0x7fa4400c3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:36.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa446b11640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4400aeb10 0x7fa440154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:36.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa446b11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4400ceff0 0x7fa4400c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:36.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa446b11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4400b5140 con 0x7fa4400ceff0 2023-08-25T04:22:36.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa446b11640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4400c3f60 con 0x7fa4400aeb10 2023-08-25T04:22:36.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa446b11640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44015fe20 con 0x7fa440069e40 2023-08-25T04:22:36.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa4450ae640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4400ceff0 0x7fa4400c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:36.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa4450ae640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4400ceff0 0x7fa4400c5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38518/0 (socket says 172.21.15.55:38518) 2023-08-25T04:22:36.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.709+0000 7fa4450ae640 1 -- 172.21.15.55:0/2721770312 learned_addr learned my addr 172.21.15.55:0/2721770312 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:36.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa43ffff640 1 --2- 172.21.15.55:0/2721770312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4400aeb10 0x7fa440154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:36.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa4448ad640 1 --2- 172.21.15.55:0/2721770312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa440069e40 0x7fa4400c3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:36.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa4450ae640 1 -- 172.21.15.55:0/2721770312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa440069e40 msgr2=0x7fa4400c3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:36.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa4450ae640 1 --2- 172.21.15.55:0/2721770312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa440069e40 0x7fa4400c3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:36.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa4450ae640 1 -- 172.21.15.55:0/2721770312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4400aeb10 msgr2=0x7fa440154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:36.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa4450ae640 1 --2- 172.21.15.55:0/2721770312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4400aeb10 0x7fa440154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:36.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa4450ae640 1 -- 172.21.15.55:0/2721770312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c0094d0 con 0x7fa4400ceff0 2023-08-25T04:22:36.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa43ffff640 1 --2- 172.21.15.55:0/2721770312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4400aeb10 0x7fa440154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:36.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa4448ad640 1 --2- 172.21.15.55:0/2721770312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa440069e40 0x7fa4400c3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T04:22:36.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa4450ae640 1 --2- 172.21.15.55:0/2721770312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4400ceff0 0x7fa4400c5480 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fa43800c770 tx=0x7fa43800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:36.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa43d7fa640 1 -- 172.21.15.55:0/2721770312 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa438003b80 con 0x7fa4400ceff0 2023-08-25T04:22:36.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa43d7fa640 1 -- 172.21.15.55:0/2721770312 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa438003ce0 con 0x7fa4400ceff0 2023-08-25T04:22:36.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa43d7fa640 1 -- 172.21.15.55:0/2721770312 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43800aa30 con 0x7fa4400ceff0 2023-08-25T04:22:36.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa446b11640 1 -- 172.21.15.55:0/2721770312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44015ae20 con 0x7fa4400ceff0 2023-08-25T04:22:36.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa446b11640 1 -- 172.21.15.55:0/2721770312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44015a800 con 0x7fa4400ceff0 2023-08-25T04:22:36.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa446b11640 1 -- 172.21.15.55:0/2721770312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44004dbe0 con 0x7fa4400ceff0 2023-08-25T04:22:36.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa43d7fa640 1 -- 172.21.15.55:0/2721770312 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fa43800ab90 con 0x7fa4400ceff0 2023-08-25T04:22:36.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa43d7fa640 1 --2- 172.21.15.55:0/2721770312 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fa4240657d0 0x7fa424067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:36.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa43d7fa640 1 -- 172.21.15.55:0/2721770312 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa438082e10 con 0x7fa4400ceff0 2023-08-25T04:22:36.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.713+0000 7fa4448ad640 1 --2- 172.21.15.55:0/2721770312 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fa4240657d0 0x7fa424067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:36.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.717+0000 7fa4448ad640 1 --2- 172.21.15.55:0/2721770312 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fa4240657d0 0x7fa424067c90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa44015b0b0 tx=0x7fa434009040 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:36.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.717+0000 7fa43d7fa640 1 -- 172.21.15.55:0/2721770312 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa438086030 con 0x7fa4400ceff0 2023-08-25T04:22:36.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.897+0000 7fa446b11640 1 -- 172.21.15.55:0/2721770312 --> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa440070e80 con 0x7fa4240657d0 2023-08-25T04:22:36.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.897+0000 7fa43d7fa640 1 -- 172.21.15.55:0/2721770312 <== mgr.7301 v2:172.21.15.110:6832/3700713436 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fa440070e80 con 0x7fa4240657d0 2023-08-25T04:22:36.899 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T04:22:36.899 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T04:22:36.899 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-08-25T04:22:36.900 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T04:22:36.900 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T04:22:36.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.901+0000 7fa446b11640 1 -- 172.21.15.55:0/2721770312 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fa4240657d0 msgr2=0x7fa424067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:36.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.901+0000 7fa446b11640 1 --2- 172.21.15.55:0/2721770312 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fa4240657d0 0x7fa424067c90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa44015b0b0 tx=0x7fa434009040 comp rx=0 tx=0).stop 2023-08-25T04:22:36.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.901+0000 7fa446b11640 1 -- 172.21.15.55:0/2721770312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4400ceff0 msgr2=0x7fa4400c5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:36.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.901+0000 7fa446b11640 1 --2- 172.21.15.55:0/2721770312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4400ceff0 0x7fa4400c5480 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fa43800c770 tx=0x7fa43800cc30 comp rx=0 tx=0).stop 2023-08-25T04:22:36.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.901+0000 7fa446b11640 1 -- 172.21.15.55:0/2721770312 shutdown_connections 2023-08-25T04:22:36.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.901+0000 7fa446b11640 1 --2- 172.21.15.55:0/2721770312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4400ceff0 0x7fa4400c5480 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:36.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.901+0000 7fa446b11640 1 --2- 172.21.15.55:0/2721770312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4400aeb10 0x7fa440154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:36.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.901+0000 7fa446b11640 1 --2- 172.21.15.55:0/2721770312 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7fa4240657d0 0x7fa424067c90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:36.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.901+0000 7fa446b11640 1 --2- 172.21.15.55:0/2721770312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa440069e40 0x7fa4400c3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:36.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.901+0000 7fa446b11640 1 -- 172.21.15.55:0/2721770312 >> 172.21.15.55:0/2721770312 conn(0x7fa4400cf530 msgr2=0x7fa4400cb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:36.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.901+0000 7fa446b11640 1 -- 172.21.15.55:0/2721770312 shutdown_connections 2023-08-25T04:22:36.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:36.901+0000 7fa446b11640 1 -- 172.21.15.55:0/2721770312 wait complete. 2023-08-25T04:22:36.920 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-25T04:22:37.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.065+0000 7f5fe8f11640 1 Processor -- start 2023-08-25T04:22:37.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.065+0000 7f5fe8f11640 1 -- start start 2023-08-25T04:22:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.069+0000 7f5fe8f11640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5fe40c9830 0x7f5fe409bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.069+0000 7f5fe8f11640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe415abd0 con 0x7f5fe415a7f0 2023-08-25T04:22:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.069+0000 7f5fe8f11640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe40c8ab0 con 0x7f5fe406c020 2023-08-25T04:22:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.069+0000 7f5fe8f11640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe40c8d50 con 0x7f5fe40c9830 2023-08-25T04:22:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.069+0000 7f5fe259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5fe415a7f0 0x7f5fe4070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53696/0 (socket says 172.21.15.55:53696) 2023-08-25T04:22:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.069+0000 7f5fe259c640 1 -- 172.21.15.55:0/900796548 learned_addr learned my addr 172.21.15.55:0/900796548 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T04:22:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.069+0000 7f5fd9d9b640 1 --2- 172.21.15.55:0/900796548 >> v2:172.21.15.110:3300/0 conn(0x7f5fe40c9830 0x7f5fe409bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.069+0000 7f5fe1d9b640 1 -- 172.21.15.55:0/900796548 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646362435 0 0) 0x7f5fe415abd0 con 0x7f5fe415a7f0 2023-08-25T04:22:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.069+0000 7f5fe1d9b640 1 -- 172.21.15.55:0/900796548 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fd0003530 con 0x7f5fe415a7f0 2023-08-25T04:22:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.069+0000 7f5fd9d9b640 1 -- 172.21.15.55:0/900796548 >> v1:172.21.15.110:6789/0 conn(0x7f5fe406c020 legacy=0x7f5fe40acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.069+0000 7f5fe1d9b640 1 -- 172.21.15.55:0/900796548 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083993196 0 0) 0x7f5fe40c8ab0 con 0x7f5fe406c020 2023-08-25T04:22:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.069+0000 7f5fd9d9b640 1 -- 172.21.15.55:0/900796548 >> v1:172.21.15.55:6789/0 conn(0x7f5fe415a7f0 legacy=0x7f5fe4070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.069+0000 7f5fd9d9b640 1 -- 172.21.15.55:0/900796548 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe40c9030 con 0x7f5fe40c9830 2023-08-25T04:22:37.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.073+0000 7f5fd9d9b640 1 --2- 172.21.15.55:0/900796548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40c9830 0x7f5fe409bde0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009d90 tx=0x7f5fcc01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea455684b354923d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:37.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.073+0000 7f5fe1d9b640 1 -- 172.21.15.55:0/900796548 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc0a58f0 con 0x7f5fe40c9830 2023-08-25T04:22:37.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.073+0000 7f5fe1d9b640 1 -- 172.21.15.55:0/900796548 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc0a5a50 con 0x7f5fe40c9830 2023-08-25T04:22:37.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.073+0000 7f5fe1d9b640 1 -- 172.21.15.55:0/900796548 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc0a5de0 con 0x7f5fe40c9830 2023-08-25T04:22:37.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.073+0000 7f5fe8f11640 1 -- 172.21.15.55:0/900796548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40c9830 msgr2=0x7f5fe409bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:37.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.073+0000 7f5fe8f11640 1 --2- 172.21.15.55:0/900796548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40c9830 0x7f5fe409bde0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009d90 tx=0x7f5fcc01c920 comp rx=0 tx=0).stop 2023-08-25T04:22:37.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.073+0000 7f5fe8f11640 1 -- 172.21.15.55:0/900796548 shutdown_connections 2023-08-25T04:22:37.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.073+0000 7f5fe8f11640 1 --2- 172.21.15.55:0/900796548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40c9830 0x7f5fe409bde0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:37.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.073+0000 7f5fe8f11640 1 -- 172.21.15.55:0/900796548 >> 172.21.15.55:0/900796548 conn(0x7f5fe4069900 msgr2=0x7f5fe4069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:37.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.073+0000 7f5fe8f11640 1 -- 172.21.15.55:0/900796548 shutdown_connections 2023-08-25T04:22:37.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.073+0000 7f5fe8f11640 1 -- 172.21.15.55:0/900796548 wait complete. 2023-08-25T04:22:37.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.073+0000 7f5fe8f11640 1 Processor -- start 2023-08-25T04:22:37.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.073+0000 7f5fe8f11640 1 -- start start 2023-08-25T04:22:37.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe8f11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fe406c020 0x7f5fe40b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:37.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe8f11640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40c9830 0x7f5fe40b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:37.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe8f11640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5fe415a7f0 0x7f5fe414cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:37.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe8f11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe40c4500 con 0x7f5fe406c020 2023-08-25T04:22:37.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe8f11640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe4158950 con 0x7f5fe40c9830 2023-08-25T04:22:37.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe8f11640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe4157c20 con 0x7f5fe415a7f0 2023-08-25T04:22:37.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fe406c020 0x7f5fe40b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:37.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fe406c020 0x7f5fe40b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38532/0 (socket says 172.21.15.55:38532) 2023-08-25T04:22:37.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe259c640 1 -- 172.21.15.55:0/799944251 learned_addr learned my addr 172.21.15.55:0/799944251 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:37.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fd9d9b640 1 --2- 172.21.15.55:0/799944251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40c9830 0x7f5fe40b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:37.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe2d9d640 1 --2- 172.21.15.55:0/799944251 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5fe415a7f0 0x7f5fe414cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:37.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe259c640 1 -- 172.21.15.55:0/799944251 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5fe415a7f0 msgr2=0x7f5fe414cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:37.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe259c640 1 --2- 172.21.15.55:0/799944251 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5fe415a7f0 0x7f5fe414cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:37.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe259c640 1 -- 172.21.15.55:0/799944251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40c9830 msgr2=0x7f5fe40b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:37.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe259c640 1 --2- 172.21.15.55:0/799944251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40c9830 0x7f5fe40b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:37.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe259c640 1 -- 172.21.15.55:0/799944251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc009a70 con 0x7f5fe406c020 2023-08-25T04:22:37.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe259c640 1 --2- 172.21.15.55:0/799944251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fe406c020 0x7f5fe40b2000 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f5fd400c430 tx=0x7f5fd400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:37.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fdb7fe640 1 -- 172.21.15.55:0/799944251 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd40074e0 con 0x7f5fe406c020 2023-08-25T04:22:37.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fdb7fe640 1 -- 172.21.15.55:0/799944251 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd4007660 con 0x7f5fe406c020 2023-08-25T04:22:37.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe8f11640 1 -- 172.21.15.55:0/799944251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe40adc90 con 0x7f5fe406c020 2023-08-25T04:22:37.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fdb7fe640 1 -- 172.21.15.55:0/799944251 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd40059f0 con 0x7f5fe406c020 2023-08-25T04:22:37.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe8f11640 1 -- 172.21.15.55:0/799944251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe40c4710 con 0x7f5fe406c020 2023-08-25T04:22:37.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fe8f11640 1 -- 172.21.15.55:0/799944251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe406d5b0 con 0x7f5fe406c020 2023-08-25T04:22:37.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.077+0000 7f5fdb7fe640 1 -- 172.21.15.55:0/799944251 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 67) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f5fd4005b50 con 0x7f5fe406c020 2023-08-25T04:22:37.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.081+0000 7f5fdb7fe640 1 --2- 172.21.15.55:0/799944251 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f5fc40657a0 0x7f5fc4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:37.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.081+0000 7f5fdb7fe640 1 -- 172.21.15.55:0/799944251 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5fd4082530 con 0x7f5fe406c020 2023-08-25T04:22:37.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.081+0000 7f5fd9d9b640 1 --2- 172.21.15.55:0/799944251 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f5fc40657a0 0x7f5fc4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:37.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.081+0000 7f5fd9d9b640 1 --2- 172.21.15.55:0/799944251 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f5fc40657a0 0x7f5fc4067c60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0af000 tx=0x7f5fcc0a7070 comp rx=0 tx=0).ready entity=mgr.7301 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:37.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.085+0000 7f5fdb7fe640 1 -- 172.21.15.55:0/799944251 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5fd404fef0 con 0x7f5fe406c020 2023-08-25T04:22:37.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.285+0000 7f5fe8f11640 1 -- 172.21.15.55:0/799944251 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f5fe4073ec0 con 0x7f5fe406c020 2023-08-25T04:22:37.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.733+0000 7f5fdb7fe640 1 -- 172.21.15.55:0/799944251 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 68) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f5fd40502c0 con 0x7f5fe406c020 2023-08-25T04:22:37.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.737+0000 7f5fdb7fe640 1 -- 172.21.15.55:0/799944251 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v68) v1 ==== 92+0+0 (secure 0 0 0) 0x7f5fd404fef0 con 0x7f5fe406c020 2023-08-25T04:22:37.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.737+0000 7f5fe8f11640 1 -- 172.21.15.55:0/799944251 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f5fc40657a0 msgr2=0x7f5fc4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:37.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.737+0000 7f5fe8f11640 1 --2- 172.21.15.55:0/799944251 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f5fc40657a0 0x7f5fc4067c60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0af000 tx=0x7f5fcc0a7070 comp rx=0 tx=0).stop 2023-08-25T04:22:37.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.737+0000 7f5fe8f11640 1 -- 172.21.15.55:0/799944251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fe406c020 msgr2=0x7f5fe40b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:37.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.737+0000 7f5fe8f11640 1 --2- 172.21.15.55:0/799944251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fe406c020 0x7f5fe40b2000 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f5fd400c430 tx=0x7f5fd400c8f0 comp rx=0 tx=0).stop 2023-08-25T04:22:37.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.737+0000 7f5fe8f11640 1 -- 172.21.15.55:0/799944251 shutdown_connections 2023-08-25T04:22:37.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.737+0000 7f5fe8f11640 1 --2- 172.21.15.55:0/799944251 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f5fc40657a0 0x7f5fc4067c60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:37.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.737+0000 7f5fe8f11640 1 --2- 172.21.15.55:0/799944251 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5fe415a7f0 0x7f5fe414cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:37.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.737+0000 7f5fe8f11640 1 --2- 172.21.15.55:0/799944251 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5fe40c9830 0x7f5fe40b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:37.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.737+0000 7f5fe8f11640 1 --2- 172.21.15.55:0/799944251 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fe406c020 0x7f5fe40b2000 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:37.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.737+0000 7f5fe8f11640 1 -- 172.21.15.55:0/799944251 >> 172.21.15.55:0/799944251 conn(0x7f5fe4069900 msgr2=0x7f5fe40af130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:37.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.737+0000 7f5fe8f11640 1 -- 172.21.15.55:0/799944251 shutdown_connections 2023-08-25T04:22:37.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.737+0000 7f5fe8f11640 1 -- 172.21.15.55:0/799944251 wait complete. 2023-08-25T04:22:37.761 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-25T04:22:37.912 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:37.913+0000 7f303a5d4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:22:37.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f7171104640 1 Processor -- start 2023-08-25T04:22:37.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f7171104640 1 -- start start 2023-08-25T04:22:37.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f7171104640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f716c15fca0 0x7f716c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:37.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f7171104640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f716c0b8330 0x7f716c0cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:37.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f7171104640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f716c0d0bd0 0x7f716c0d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:37.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f7171104640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716c160080 con 0x7f716c0d0bd0 2023-08-25T04:22:37.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f7171104640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716c0b70c0 con 0x7f716c0b8330 2023-08-25T04:22:37.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f7171104640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0b73a0 con 0x7f716c15fca0 2023-08-25T04:22:37.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f7170903640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f716c0d0bd0 0x7f716c0d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:37.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f7170903640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f716c0d0bd0 0x7f716c0d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38566/0 (socket says 172.21.15.55:38566) 2023-08-25T04:22:37.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f7170903640 1 -- 172.21.15.55:0/2106622788 learned_addr learned my addr 172.21.15.55:0/2106622788 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:37.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f716b7fe640 1 --2- 172.21.15.55:0/2106622788 >> v2:172.21.15.110:3300/0 conn(0x7f716c0b8330 0x7f716c0cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:37.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f716bfff640 1 --2- 172.21.15.55:0/2106622788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f716c15fca0 0x7f716c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:37.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f7170903640 1 -- 172.21.15.55:0/2106622788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f716c15fca0 msgr2=0x7f716c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:37.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f7170903640 1 --2- 172.21.15.55:0/2106622788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f716c15fca0 0x7f716c0cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:37.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f7170903640 1 -- 172.21.15.55:0/2106622788 >> v2:172.21.15.110:3300/0 conn(0x7f716c0b8330 msgr2=0x7f716c0cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:37.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f7170903640 1 --2- 172.21.15.55:0/2106622788 >> v2:172.21.15.110:3300/0 conn(0x7f716c0b8330 0x7f716c0cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:37.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f7170903640 1 -- 172.21.15.55:0/2106622788 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c0b7680 con 0x7f716c0d0bd0 2023-08-25T04:22:37.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f716bfff640 1 --2- 172.21.15.55:0/2106622788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f716c15fca0 0x7f716c0cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:37.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.913+0000 7f716b7fe640 1 --2- 172.21.15.55:0/2106622788 >> v2:172.21.15.110:3300/0 conn(0x7f716c0b8330 0x7f716c0cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:37.921 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:37.917+0000 7f9611169180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T04:22:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.917+0000 7f7170903640 1 --2- 172.21.15.55:0/2106622788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f716c0d0bd0 0x7f716c0d1040 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f716c0b51e0 tx=0x7f716401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6bb4cceea758d96 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.917+0000 7f716affd640 1 -- 172.21.15.55:0/2106622788 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640af400 con 0x7f716c0d0bd0 2023-08-25T04:22:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.917+0000 7f716affd640 1 -- 172.21.15.55:0/2106622788 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71640ab050 con 0x7f716c0d0bd0 2023-08-25T04:22:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.917+0000 7f716affd640 1 -- 172.21.15.55:0/2106622788 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640af780 con 0x7f716c0d0bd0 2023-08-25T04:22:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.917+0000 7f7171104640 1 -- 172.21.15.55:0/2106622788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f716c0d0bd0 msgr2=0x7f716c0d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.917+0000 7f7171104640 1 --2- 172.21.15.55:0/2106622788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f716c0d0bd0 0x7f716c0d1040 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f716c0b51e0 tx=0x7f716401f1c0 comp rx=0 tx=0).stop 2023-08-25T04:22:37.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.917+0000 7f7171104640 1 -- 172.21.15.55:0/2106622788 shutdown_connections 2023-08-25T04:22:37.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.917+0000 7f7171104640 1 --2- 172.21.15.55:0/2106622788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f716c0d0bd0 0x7f716c0d1040 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:37.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.917+0000 7f7171104640 1 --2- 172.21.15.55:0/2106622788 >> v2:172.21.15.110:3300/0 conn(0x7f716c0b8330 0x7f716c0cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:37.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.917+0000 7f7171104640 1 --2- 172.21.15.55:0/2106622788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f716c15fca0 0x7f716c0cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:37.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.917+0000 7f7171104640 1 -- 172.21.15.55:0/2106622788 >> 172.21.15.55:0/2106622788 conn(0x7f716c0658c0 msgr2=0x7f716c065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:37.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.917+0000 7f7171104640 1 -- 172.21.15.55:0/2106622788 shutdown_connections 2023-08-25T04:22:37.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.917+0000 7f7171104640 1 -- 172.21.15.55:0/2106622788 wait complete. 2023-08-25T04:22:37.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.921+0000 7f7171104640 1 Processor -- start 2023-08-25T04:22:37.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.921+0000 7f7171104640 1 -- start start 2023-08-25T04:22:37.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7171104640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f716c0b8330 0x7f716c152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:37.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7171104640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f716c0d0bd0 0x7f716c0c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:37.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7171104640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f716c15fca0 0x7f716c143750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:37.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7171104640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c1534b0 con 0x7f716c15fca0 2023-08-25T04:22:37.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7171104640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c157630 con 0x7f716c0d0bd0 2023-08-25T04:22:37.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7171104640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c156a60 con 0x7f716c0b8330 2023-08-25T04:22:37.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7170903640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f716c15fca0 0x7f716c143750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:37.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7170903640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f716c15fca0 0x7f716c143750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38574/0 (socket says 172.21.15.55:38574) 2023-08-25T04:22:37.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7170903640 1 -- 172.21.15.55:0/2059283348 learned_addr learned my addr 172.21.15.55:0/2059283348 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:37.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f716bfff640 1 --2- 172.21.15.55:0/2059283348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f716c0b8330 0x7f716c152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:37.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f716b7fe640 1 --2- 172.21.15.55:0/2059283348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f716c0d0bd0 0x7f716c0c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:37.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7170903640 1 -- 172.21.15.55:0/2059283348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f716c0b8330 msgr2=0x7f716c152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:37.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7170903640 1 --2- 172.21.15.55:0/2059283348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f716c0b8330 0x7f716c152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:37.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7170903640 1 -- 172.21.15.55:0/2059283348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f716c0d0bd0 msgr2=0x7f716c0c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:37.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7170903640 1 --2- 172.21.15.55:0/2059283348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f716c0d0bd0 0x7f716c0c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:37.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7170903640 1 -- 172.21.15.55:0/2059283348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7164009b30 con 0x7f716c15fca0 2023-08-25T04:22:37.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7170903640 1 --2- 172.21.15.55:0/2059283348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f716c15fca0 0x7f716c143750 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f71640b2040 tx=0x7f716401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:37.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7168ff9640 1 -- 172.21.15.55:0/2059283348 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640afde0 con 0x7f716c15fca0 2023-08-25T04:22:37.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7168ff9640 1 -- 172.21.15.55:0/2059283348 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7164009510 con 0x7f716c15fca0 2023-08-25T04:22:37.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7171104640 1 -- 172.21.15.55:0/2059283348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716c156d00 con 0x7f716c15fca0 2023-08-25T04:22:37.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7168ff9640 1 -- 172.21.15.55:0/2059283348 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640ba660 con 0x7f716c15fca0 2023-08-25T04:22:37.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7171104640 1 -- 172.21.15.55:0/2059283348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716c1572c0 con 0x7f716c15fca0 2023-08-25T04:22:37.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7171104640 1 -- 172.21.15.55:0/2059283348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716c0b7940 con 0x7f716c15fca0 2023-08-25T04:22:37.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.925+0000 7f7168ff9640 1 -- 172.21.15.55:0/2059283348 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 68) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f71640b6040 con 0x7f716c15fca0 2023-08-25T04:22:37.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.929+0000 7f7168ff9640 1 --2- 172.21.15.55:0/2059283348 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f71580657f0 0x7f7158067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:37.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.929+0000 7f7168ff9640 1 -- 172.21.15.55:0/2059283348 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7164121370 con 0x7f716c15fca0 2023-08-25T04:22:37.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.929+0000 7f716bfff640 1 -- 172.21.15.55:0/2059283348 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f71580657f0 msgr2=0x7f7158067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3700713436 2023-08-25T04:22:37.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.929+0000 7f716bfff640 1 --2- 172.21.15.55:0/2059283348 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f71580657f0 0x7f7158067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:22:37.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:37.933+0000 7f7168ff9640 1 -- 172.21.15.55:0/2059283348 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f716c0b7940 con 0x7f716c15fca0 2023-08-25T04:22:38.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.097+0000 7f7171104640 1 -- 172.21.15.55:0/2059283348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f716c0b7940 con 0x7f716c15fca0 2023-08-25T04:22:38.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.105+0000 7f7168ff9640 1 -- 172.21.15.55:0/2059283348 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v47)=0 v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7f716c0b7940 con 0x7f716c15fca0 2023-08-25T04:22:38.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.105+0000 7f7171104640 1 -- 172.21.15.55:0/2059283348 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f71580657f0 msgr2=0x7f7158067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:22:38.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.105+0000 7f7171104640 1 --2- 172.21.15.55:0/2059283348 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f71580657f0 0x7f7158067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.105+0000 7f7171104640 1 -- 172.21.15.55:0/2059283348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f716c15fca0 msgr2=0x7f716c143750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:38.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.105+0000 7f7171104640 1 --2- 172.21.15.55:0/2059283348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f716c15fca0 0x7f716c143750 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f71640b2040 tx=0x7f716401bf60 comp rx=0 tx=0).stop 2023-08-25T04:22:38.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.105+0000 7f7171104640 1 -- 172.21.15.55:0/2059283348 shutdown_connections 2023-08-25T04:22:38.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.105+0000 7f7171104640 1 --2- 172.21.15.55:0/2059283348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f716c15fca0 0x7f716c143750 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.105+0000 7f7171104640 1 --2- 172.21.15.55:0/2059283348 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f716c0d0bd0 0x7f716c0c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.105+0000 7f7171104640 1 --2- 172.21.15.55:0/2059283348 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f71580657f0 0x7f7158067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.105+0000 7f7171104640 1 --2- 172.21.15.55:0/2059283348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f716c0b8330 0x7f716c152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.105+0000 7f7171104640 1 -- 172.21.15.55:0/2059283348 >> 172.21.15.55:0/2059283348 conn(0x7f716c0658c0 msgr2=0x7f716c065ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:38.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.105+0000 7f7171104640 1 -- 172.21.15.55:0/2059283348 shutdown_connections 2023-08-25T04:22:38.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.105+0000 7f7171104640 1 -- 172.21.15.55:0/2059283348 wait complete. 2023-08-25T04:22:38.126 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-08-25T04:22:38.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.273+0000 7f68f8503640 1 Processor -- start 2023-08-25T04:22:38.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.273+0000 7f68f8503640 1 -- start start 2023-08-25T04:22:38.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.273+0000 7f68f8503640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68f01601f0 0x7f68f015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:38.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.273+0000 7f68f8503640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f68f015e3c0 0x7f68f00d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:38.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.273+0000 7f68f8503640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f015f8b0 con 0x7f68f00d10c0 2023-08-25T04:22:38.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.273+0000 7f68f8503640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f00cd5a0 con 0x7f68f01601f0 2023-08-25T04:22:38.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.273+0000 7f68f8503640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f00cd880 con 0x7f68f015e3c0 2023-08-25T04:22:38.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.273+0000 7f68f629f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68f01601f0 0x7f68f015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:38.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.273+0000 7f68f629f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f68f01601f0 0x7f68f015d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38584/0 (socket says 172.21.15.55:38584) 2023-08-25T04:22:38.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.273+0000 7f68f629f640 1 -- 172.21.15.55:0/3707596184 learned_addr learned my addr 172.21.15.55:0/3707596184 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:38.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.273+0000 7f68f5a9e640 1 --2- 172.21.15.55:0/3707596184 >> v2:172.21.15.110:3300/0 conn(0x7f68f015e3c0 0x7f68f00d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:38.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.273+0000 7f68f629f640 1 -- 172.21.15.55:0/3707596184 >> v2:172.21.15.110:3300/0 conn(0x7f68f015e3c0 msgr2=0x7f68f00d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:38.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.273+0000 7f68f629f640 1 --2- 172.21.15.55:0/3707596184 >> v2:172.21.15.110:3300/0 conn(0x7f68f015e3c0 0x7f68f00d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.273+0000 7f68f629f640 1 -- 172.21.15.55:0/3707596184 >> v1:172.21.15.110:6789/0 conn(0x7f68f00d10c0 legacy=0x7f68f00b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:38.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.273+0000 7f68f629f640 1 -- 172.21.15.55:0/3707596184 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f00cdb60 con 0x7f68f01601f0 2023-08-25T04:22:38.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.281+0000 7f68f629f640 1 --2- 172.21.15.55:0/3707596184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f01601f0 0x7f68f015d430 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f68f00cd350 tx=0x7f68ec01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3533f119f564b963 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:38.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.281+0000 7f68f529d640 1 -- 172.21.15.55:0/3707596184 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec0ac640 con 0x7f68f01601f0 2023-08-25T04:22:38.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.281+0000 7f68f529d640 1 -- 172.21.15.55:0/3707596184 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec0ac7a0 con 0x7f68f01601f0 2023-08-25T04:22:38.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.281+0000 7f68f529d640 1 -- 172.21.15.55:0/3707596184 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec0acb30 con 0x7f68f01601f0 2023-08-25T04:22:38.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.281+0000 7f68f8503640 1 -- 172.21.15.55:0/3707596184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f01601f0 msgr2=0x7f68f015d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.281+0000 7f68f8503640 1 --2- 172.21.15.55:0/3707596184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f01601f0 0x7f68f015d430 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f68f00cd350 tx=0x7f68ec01c4d0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.281+0000 7f68f8503640 1 -- 172.21.15.55:0/3707596184 shutdown_connections 2023-08-25T04:22:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.281+0000 7f68f8503640 1 --2- 172.21.15.55:0/3707596184 >> v2:172.21.15.110:3300/0 conn(0x7f68f015e3c0 0x7f68f00d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.281+0000 7f68f8503640 1 --2- 172.21.15.55:0/3707596184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f01601f0 0x7f68f015d430 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.281+0000 7f68f8503640 1 -- 172.21.15.55:0/3707596184 >> 172.21.15.55:0/3707596184 conn(0x7f68f00d27d0 msgr2=0x7f68f00d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.281+0000 7f68f8503640 1 -- 172.21.15.55:0/3707596184 shutdown_connections 2023-08-25T04:22:38.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.281+0000 7f68f8503640 1 -- 172.21.15.55:0/3707596184 wait complete. 2023-08-25T04:22:38.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.281+0000 7f68f8503640 1 Processor -- start 2023-08-25T04:22:38.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.281+0000 7f68f8503640 1 -- start start 2023-08-25T04:22:38.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f8503640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f00d10c0 0x7f68f015c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:38.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f8503640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68f015e3c0 0x7f68f00cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:38.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f8503640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f01601f0 0x7f68f00c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:38.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f8503640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f015d5a0 con 0x7f68f00d10c0 2023-08-25T04:22:38.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f8503640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f00c9af0 con 0x7f68f01601f0 2023-08-25T04:22:38.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f8503640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f0156ba0 con 0x7f68f015e3c0 2023-08-25T04:22:38.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f629f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f00d10c0 0x7f68f015c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:38.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f629f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f00d10c0 0x7f68f015c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38590/0 (socket says 172.21.15.55:38590) 2023-08-25T04:22:38.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f629f640 1 -- 172.21.15.55:0/4013082479 learned_addr learned my addr 172.21.15.55:0/4013082479 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:38.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f6aa0640 1 --2- 172.21.15.55:0/4013082479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f01601f0 0x7f68f00c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:38.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f5a9e640 1 --2- 172.21.15.55:0/4013082479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68f015e3c0 0x7f68f00cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:38.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f629f640 1 -- 172.21.15.55:0/4013082479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68f015e3c0 msgr2=0x7f68f00cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:38.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f629f640 1 --2- 172.21.15.55:0/4013082479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68f015e3c0 0x7f68f00cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f629f640 1 -- 172.21.15.55:0/4013082479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f01601f0 msgr2=0x7f68f00c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:38.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f629f640 1 --2- 172.21.15.55:0/4013082479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f01601f0 0x7f68f00c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f629f640 1 -- 172.21.15.55:0/4013082479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec009470 con 0x7f68f00d10c0 2023-08-25T04:22:38.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f629f640 1 --2- 172.21.15.55:0/4013082479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f00d10c0 0x7f68f015c620 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0190e0 tx=0x7f68ec01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68e6ffd640 1 -- 172.21.15.55:0/4013082479 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec0bd070 con 0x7f68f00d10c0 2023-08-25T04:22:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68e6ffd640 1 -- 172.21.15.55:0/4013082479 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec0b7420 con 0x7f68f00d10c0 2023-08-25T04:22:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f8503640 1 -- 172.21.15.55:0/4013082479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f00ce7c0 con 0x7f68f00d10c0 2023-08-25T04:22:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68e6ffd640 1 -- 172.21.15.55:0/4013082479 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec0b7790 con 0x7f68f00d10c0 2023-08-25T04:22:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f8503640 1 -- 172.21.15.55:0/4013082479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f015cfe0 con 0x7f68f00d10c0 2023-08-25T04:22:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.285+0000 7f68f8503640 1 -- 172.21.15.55:0/4013082479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f00b5260 con 0x7f68f00d10c0 2023-08-25T04:22:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.289+0000 7f68e6ffd640 1 -- 172.21.15.55:0/4013082479 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 68) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f68ec0b3040 con 0x7f68f00d10c0 2023-08-25T04:22:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.289+0000 7f68e6ffd640 1 --2- 172.21.15.55:0/4013082479 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f68d40657f0 0x7f68d4067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:38.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.289+0000 7f68e6ffd640 1 -- 172.21.15.55:0/4013082479 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68ec11ccb0 con 0x7f68f00d10c0 2023-08-25T04:22:38.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.289+0000 7f68f5a9e640 1 -- 172.21.15.55:0/4013082479 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f68d40657f0 msgr2=0x7f68d4067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3700713436 2023-08-25T04:22:38.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.289+0000 7f68f5a9e640 1 --2- 172.21.15.55:0/4013082479 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f68d40657f0 0x7f68d4067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:22:38.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.293+0000 7f68e6ffd640 1 -- 172.21.15.55:0/4013082479 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f68ec0ea700 con 0x7f68f00d10c0 2023-08-25T04:22:38.327 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:38.325+0000 7f303a5d4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:22:38.375 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:38.373+0000 7f9611169180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T04:22:38.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.453+0000 7f68f8503640 1 -- 172.21.15.55:0/4013082479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f68f0073ec0 con 0x7f68f00d10c0 2023-08-25T04:22:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.457+0000 7f68e6ffd640 1 -- 172.21.15.55:0/4013082479 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v48)=0 v48) v1 ==== 133+0+0 (secure 0 0 0) 0x7f68ec0edd20 con 0x7f68f00d10c0 2023-08-25T04:22:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.461+0000 7f68f8503640 1 -- 172.21.15.55:0/4013082479 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f68d40657f0 msgr2=0x7f68d4067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:22:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.461+0000 7f68f8503640 1 --2- 172.21.15.55:0/4013082479 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f68d40657f0 0x7f68d4067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.461+0000 7f68f8503640 1 -- 172.21.15.55:0/4013082479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f00d10c0 msgr2=0x7f68f015c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.461+0000 7f68f8503640 1 --2- 172.21.15.55:0/4013082479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f00d10c0 0x7f68f015c620 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0190e0 tx=0x7f68ec01ad10 comp rx=0 tx=0).stop 2023-08-25T04:22:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.461+0000 7f68f8503640 1 -- 172.21.15.55:0/4013082479 shutdown_connections 2023-08-25T04:22:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.461+0000 7f68f8503640 1 --2- 172.21.15.55:0/4013082479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68f01601f0 0x7f68f00c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.461+0000 7f68f8503640 1 --2- 172.21.15.55:0/4013082479 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f68d40657f0 0x7f68d4067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.461+0000 7f68f8503640 1 --2- 172.21.15.55:0/4013082479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68f015e3c0 0x7f68f00cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.461+0000 7f68f8503640 1 --2- 172.21.15.55:0/4013082479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f68f00d10c0 0x7f68f015c620 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.461+0000 7f68f8503640 1 -- 172.21.15.55:0/4013082479 >> 172.21.15.55:0/4013082479 conn(0x7f68f00d27d0 msgr2=0x7f68f0157f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:38.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.461+0000 7f68f8503640 1 -- 172.21.15.55:0/4013082479 shutdown_connections 2023-08-25T04:22:38.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.461+0000 7f68f8503640 1 -- 172.21.15.55:0/4013082479 wait complete. 2023-08-25T04:22:38.477 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:38.477+0000 7f303a5d4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:22:38.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T04:22:38.481 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-25T04:22:38.496 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1 1M 2023-08-25T04:22:38.536 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:38.537+0000 7f9611169180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T04:22:38.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.685+0000 7f37ab4f9640 1 Processor -- start 2023-08-25T04:22:38.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.685+0000 7f37ab4f9640 1 -- start start 2023-08-25T04:22:38.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.685+0000 7f37ab4f9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f37a40cf7b0 0x7f37a40b6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:38.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.685+0000 7f37ab4f9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a40d1970 con 0x7f37a40cf340 2023-08-25T04:22:38.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.685+0000 7f37ab4f9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a40d2790 con 0x7f37a415cb40 2023-08-25T04:22:38.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.685+0000 7f37ab4f9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a40d0d80 con 0x7f37a40cf7b0 2023-08-25T04:22:38.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.685+0000 7f37a9a96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f37a40cf7b0 0x7f37a40b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:38.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.685+0000 7f37a9a96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f37a40cf7b0 0x7f37a40b6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38592/0 (socket says 172.21.15.55:38592) 2023-08-25T04:22:38.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.685+0000 7f37a9a96640 1 -- 172.21.15.55:0/2491960861 learned_addr learned my addr 172.21.15.55:0/2491960861 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:38.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.685+0000 7f37a9a96640 1 -- 172.21.15.55:0/2491960861 >> v1:172.21.15.110:6789/0 conn(0x7f37a415cb40 legacy=0x7f37a40d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:38.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.685+0000 7f37a9a96640 1 -- 172.21.15.55:0/2491960861 >> v1:172.21.15.55:6789/0 conn(0x7f37a40cf340 legacy=0x7f37a40b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:38.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.685+0000 7f37a9a96640 1 -- 172.21.15.55:0/2491960861 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a40d1040 con 0x7f37a40cf7b0 2023-08-25T04:22:38.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.689+0000 7f37a9a96640 1 --2- 172.21.15.55:0/2491960861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a40cf7b0 0x7f37a40b6100 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f379c009e50 tx=0x7f379c01f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc679e657c058ee1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:38.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.689+0000 7f379bfff640 1 -- 172.21.15.55:0/2491960861 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c0af400 con 0x7f37a40cf7b0 2023-08-25T04:22:38.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.689+0000 7f379bfff640 1 -- 172.21.15.55:0/2491960861 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379c0ab050 con 0x7f37a40cf7b0 2023-08-25T04:22:38.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.689+0000 7f379bfff640 1 -- 172.21.15.55:0/2491960861 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c0af780 con 0x7f37a40cf7b0 2023-08-25T04:22:38.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.689+0000 7f37ab4f9640 1 -- 172.21.15.55:0/2491960861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a40cf7b0 msgr2=0x7f37a40b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:38.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.689+0000 7f37ab4f9640 1 --2- 172.21.15.55:0/2491960861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a40cf7b0 0x7f37a40b6100 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f379c009e50 tx=0x7f379c01f1f0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.689+0000 7f37ab4f9640 1 -- 172.21.15.55:0/2491960861 shutdown_connections 2023-08-25T04:22:38.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.689+0000 7f37ab4f9640 1 --2- 172.21.15.55:0/2491960861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a40cf7b0 0x7f37a40b6100 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.689+0000 7f37ab4f9640 1 -- 172.21.15.55:0/2491960861 >> 172.21.15.55:0/2491960861 conn(0x7f37a406aae0 msgr2=0x7f37a406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:38.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.689+0000 7f37ab4f9640 1 -- 172.21.15.55:0/2491960861 shutdown_connections 2023-08-25T04:22:38.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.689+0000 7f37ab4f9640 1 -- 172.21.15.55:0/2491960861 wait complete. 2023-08-25T04:22:38.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37ab4f9640 1 Processor -- start 2023-08-25T04:22:38.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37ab4f9640 1 -- start start 2023-08-25T04:22:38.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37ab4f9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37a40cf340 0x7f37a4151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:38.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37ab4f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a40cf7b0 0x7f37a40b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:38.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37ab4f9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37a415cb40 0x7f37a40b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:38.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37ab4f9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a415fd70 con 0x7f37a40cf7b0 2023-08-25T04:22:38.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37ab4f9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a415ecd0 con 0x7f37a415cb40 2023-08-25T04:22:38.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37ab4f9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a415efb0 con 0x7f37a40cf340 2023-08-25T04:22:38.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37a8a94640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a40cf7b0 0x7f37a40b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:38.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37a8a94640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a40cf7b0 0x7f37a40b6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38594/0 (socket says 172.21.15.55:38594) 2023-08-25T04:22:38.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37a8a94640 1 -- 172.21.15.55:0/2161445402 learned_addr learned my addr 172.21.15.55:0/2161445402 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:38.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37a9a96640 1 --2- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37a415cb40 0x7f37a40b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:38.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37a9295640 1 --2- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37a40cf340 0x7f37a4151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:38.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37a8a94640 1 -- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37a40cf340 msgr2=0x7f37a4151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:38.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37a8a94640 1 --2- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37a40cf340 0x7f37a4151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37a8a94640 1 -- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37a415cb40 msgr2=0x7f37a40b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:38.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37a8a94640 1 --2- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37a415cb40 0x7f37a40b6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:38.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37a8a94640 1 -- 172.21.15.55:0/2161445402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379c009b30 con 0x7f37a40cf7b0 2023-08-25T04:22:38.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37a8a94640 1 --2- 172.21.15.55:0/2161445402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a40cf7b0 0x7f37a40b6a40 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f379400c3c0 tx=0x7f379400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:38.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f3799ffb640 1 -- 172.21.15.55:0/2161445402 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37940052d0 con 0x7f37a40cf7b0 2023-08-25T04:22:38.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f3799ffb640 1 -- 172.21.15.55:0/2161445402 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3794005430 con 0x7f37a40cf7b0 2023-08-25T04:22:38.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f3799ffb640 1 -- 172.21.15.55:0/2161445402 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3794003840 con 0x7f37a40cf7b0 2023-08-25T04:22:38.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37ab4f9640 1 -- 172.21.15.55:0/2161445402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a415f290 con 0x7f37a40cf7b0 2023-08-25T04:22:38.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.693+0000 7f37ab4f9640 1 -- 172.21.15.55:0/2161445402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a415f850 con 0x7f37a40cf7b0 2023-08-25T04:22:38.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.697+0000 7f37ab4f9640 1 -- 172.21.15.55:0/2161445402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a4071f80 con 0x7f37a40cf7b0 2023-08-25T04:22:38.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.697+0000 7f3799ffb640 1 -- 172.21.15.55:0/2161445402 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 68) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f37940039a0 con 0x7f37a40cf7b0 2023-08-25T04:22:38.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.697+0000 7f3799ffb640 1 --2- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f37880657f0 0x7f3788067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:38.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.697+0000 7f3799ffb640 1 -- 172.21.15.55:0/2161445402 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3794082450 con 0x7f37a40cf7b0 2023-08-25T04:22:38.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.697+0000 7f37a9295640 1 -- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f37880657f0 msgr2=0x7f3788067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3700713436 2023-08-25T04:22:38.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.697+0000 7f37a9295640 1 --2- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f37880657f0 0x7f3788067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T04:22:38.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.701+0000 7f3799ffb640 1 -- 172.21.15.55:0/2161445402 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f379404fea0 con 0x7f37a40cf7b0 2023-08-25T04:22:38.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.881+0000 7f37ab4f9640 1 -- 172.21.15.55:0/2161445402 --> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f37a40d1600 con 0x7f37880657f0 2023-08-25T04:22:38.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.901+0000 7f37a9295640 1 -- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f37880657f0 msgr2=0x7f3788067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3700713436 2023-08-25T04:22:38.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:38.901+0000 7f37a9295640 1 --2- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f37880657f0 0x7f3788067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-25T04:22:38.959 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:38.957+0000 7f303a5d4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:22:39.017 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:39.017+0000 7f303a5d4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:22:39.052 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:39.053+0000 7f9611169180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T04:22:39.074 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:39.073+0000 7f303a5d4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:22:39.114 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:39.113+0000 7f9611169180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T04:22:39.159 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:39.157+0000 7f303a5d4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:22:39.172 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:39.173+0000 7f9611169180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T04:22:39.217 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:39.217+0000 7f303a5d4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:22:39.262 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:39.261+0000 7f9611169180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T04:22:39.301 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:39.301+0000 7f303a5d4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:22:39.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:39.305+0000 7f37a9295640 1 -- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f37880657f0 msgr2=0x7f3788067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3700713436 2023-08-25T04:22:39.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:39.305+0000 7f37a9295640 1 --2- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f37880657f0 0x7f3788067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-25T04:22:39.322 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:39.321+0000 7f9611169180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T04:22:39.357 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:39.357+0000 7f303a5d4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:22:39.410 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:39.409+0000 7f9611169180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T04:22:39.469 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:39.469+0000 7f9611169180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T04:22:39.499 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:39.497+0000 7f303a5d4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:22:39.557 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:39.557+0000 7f303a5d4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:22:39.620 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:39.617+0000 7f9611169180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T04:22:39.680 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:39.681+0000 7f9611169180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T04:22:39.797 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:22:39.797 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:22:39.797 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:22:39.805 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:39.805+0000 7f303a5d4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:22:39.931 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T04:22:39.931 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T04:22:39.931 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T04:22:39.940 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:39.941+0000 7f9611169180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T04:22:39.942 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:39.941+0000 7f303a5d4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:22:40.069 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:40.069+0000 7f303a5d4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:22:40.083 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:40.080+0000 7f9611169180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:22:40.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:40.108+0000 7f37a9295640 1 -- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f37880657f0 msgr2=0x7f3788067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3700713436 2023-08-25T04:22:40.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:40.108+0000 7f37a9295640 1 --2- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f37880657f0 0x7f3788067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-25T04:22:40.139 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:40.137+0000 7f303a5d4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:22:40.214 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:40.212+0000 7f9611169180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T04:22:40.274 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:40.273+0000 7f303a5d4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:22:40.288 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:40.284+0000 7f9611169180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T04:22:40.430 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:40.428+0000 7f9611169180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T04:22:40.814 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:40.813+0000 7f303a5d4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:22:40.899 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:40.897+0000 7f303a5d4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:22:41.004 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:41.004+0000 7f9611169180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T04:22:41.051 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:41.049+0000 7f303a5d4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:22:41.092 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:41.092+0000 7f9611169180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T04:22:41.134 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:41.133+0000 7f303a5d4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:22:41.249 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:41.248+0000 7f9611169180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T04:22:41.337 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:41.336+0000 7f9611169180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T04:22:41.449 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:41.449+0000 7f303a5d4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:22:41.509 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:41.509+0000 7f303a5d4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:22:41.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:41.520+0000 7f3799ffb640 1 -- 172.21.15.55:0/2161445402 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 69) v1 ==== 84690+0+0 (secure 0 0 0) 0x7f3794050270 con 0x7f37a40cf7b0 2023-08-25T04:22:41.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:41.520+0000 7f3799ffb640 1 -- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f37880657f0 msgr2=0x7f3788067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T04:22:41.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:41.520+0000 7f3799ffb640 1 --2- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:6832/3700713436,v1:172.21.15.110:6833/3700713436] conn(0x7f37880657f0 0x7f3788067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:41.634 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:41.633+0000 7f2fc0400640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:41.635 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:41.633+0000 7f2fc0400640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:41.635 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:41.633+0000 7f2fc0400640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:41.635 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:41.633+0000 7f2fc0400640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:41.635 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:41.633+0000 7f2fc0400640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:41.636 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:41.633+0000 7f2fbd3fa640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:41.636 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:41.633+0000 7f2fbd3fa640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:41.636 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:41.633+0000 7f2fbd3fa640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:41.636 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:41.633+0000 7f2fbd3fa640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:41.637 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:22:41.633+0000 7f2fbd3fa640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:22:41.688 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:41.688+0000 7f9611169180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T04:22:41.754 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T04:22:41.752+0000 7f9611169180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T04:22:42.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.524+0000 7f3799ffb640 1 -- 172.21.15.55:0/2161445402 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 70) v1 ==== 84817+0+0 (secure 0 0 0) 0x7f379400fca0 con 0x7f37a40cf7b0 2023-08-25T04:22:42.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.524+0000 7f3799ffb640 1 --2- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f3788033910 0x7f378806fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:42.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.524+0000 7f3799ffb640 1 -- 172.21.15.55:0/2161445402 --> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3788033cf0 con 0x7f3788033910 2023-08-25T04:22:42.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.528+0000 7f37a9295640 1 --2- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f3788033910 0x7f378806fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:42.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.528+0000 7f37a9295640 1 --2- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f3788033910 0x7f378806fcd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f37a0007fd0 tx=0x7f37a0007e40 comp rx=0 tx=0).ready entity=mgr.7616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:42.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.600+0000 7f3799ffb640 1 -- 172.21.15.55:0/2161445402 <== mgr.7616 v2:172.21.15.110:6832/3538591338 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f3788033cf0 con 0x7f3788033910 2023-08-25T04:22:42.601 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1 2023-08-25T04:22:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.600+0000 7f37ab4f9640 1 -- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f3788033910 msgr2=0x7f378806fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.600+0000 7f37ab4f9640 1 --2- 172.21.15.55:0/2161445402 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f3788033910 0x7f378806fcd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f37a0007fd0 tx=0x7f37a0007e40 comp rx=0 tx=0).stop 2023-08-25T04:22:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.600+0000 7f37ab4f9640 1 -- 172.21.15.55:0/2161445402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a40cf7b0 msgr2=0x7f37a40b6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:42.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.600+0000 7f37ab4f9640 1 --2- 172.21.15.55:0/2161445402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a40cf7b0 0x7f37a40b6a40 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f379400c3c0 tx=0x7f379400c880 comp rx=0 tx=0).stop 2023-08-25T04:22:42.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.600+0000 7f37a9a96640 1 -- 172.21.15.55:0/2161445402 reap_dead start 2023-08-25T04:22:42.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.600+0000 7f37ab4f9640 1 -- 172.21.15.55:0/2161445402 shutdown_connections 2023-08-25T04:22:42.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.600+0000 7f37ab4f9640 1 -- 172.21.15.55:0/2161445402 >> 172.21.15.55:0/2161445402 conn(0x7f37a406aae0 msgr2=0x7f37a40ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:42.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.600+0000 7f37ab4f9640 1 -- 172.21.15.55:0/2161445402 shutdown_connections 2023-08-25T04:22:42.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.600+0000 7f37ab4f9640 1 -- 172.21.15.55:0/2161445402 wait complete. 2023-08-25T04:22:42.624 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1 2023-08-25T04:22:42.625 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs /snap_test_dir1 55n 2023-08-25T04:22:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.776+0000 7f72f5d37640 1 Processor -- start 2023-08-25T04:22:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.776+0000 7f72f5d37640 1 -- start start 2023-08-25T04:22:42.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.776+0000 7f72f5d37640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f72f01601f0 0x7f72f015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:42.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.776+0000 7f72f5d37640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f00cd5a0 con 0x7f72f015e3c0 2023-08-25T04:22:42.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.776+0000 7f72f5d37640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f00cd880 con 0x7f72f00d1290 2023-08-25T04:22:42.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.776+0000 7f72f5d37640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f00cdb60 con 0x7f72f01601f0 2023-08-25T04:22:42.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.776+0000 7f72ef7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f72f01601f0 0x7f72f015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:42.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.776+0000 7f72ef7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f72f01601f0 0x7f72f015d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58490/0 (socket says 172.21.15.55:58490) 2023-08-25T04:22:42.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.776+0000 7f72eeffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f72f015e3c0 0x7f72f00d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57952/0 (socket says 172.21.15.55:57952) 2023-08-25T04:22:42.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.776+0000 7f72ef7fe640 1 -- 172.21.15.55:0/11798929 learned_addr learned my addr 172.21.15.55:0/11798929 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:42.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.776+0000 7f72ef7fe640 1 -- 172.21.15.55:0/11798929 >> v1:172.21.15.110:6789/0 conn(0x7f72f00d1290 legacy=0x7f72f015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:42.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.776+0000 7f72ef7fe640 1 -- 172.21.15.55:0/11798929 >> v1:172.21.15.55:6789/0 conn(0x7f72f015e3c0 legacy=0x7f72f00d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:42.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.776+0000 7f72ef7fe640 1 -- 172.21.15.55:0/11798929 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f00cde40 con 0x7f72f01601f0 2023-08-25T04:22:42.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.780+0000 7f72ef7fe640 1 --2- 172.21.15.55:0/11798929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72f01601f0 0x7f72f015d430 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f72e0006fd0 tx=0x7f72e001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69e96de910ed40a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:42.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.780+0000 7f72ee7fc640 1 -- 172.21.15.55:0/11798929 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e00ab610 con 0x7f72f01601f0 2023-08-25T04:22:42.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.780+0000 7f72ee7fc640 1 -- 172.21.15.55:0/11798929 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e00ab770 con 0x7f72f01601f0 2023-08-25T04:22:42.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.780+0000 7f72ee7fc640 1 -- 172.21.15.55:0/11798929 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e00abb00 con 0x7f72f01601f0 2023-08-25T04:22:42.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.780+0000 7f72f5d37640 1 -- 172.21.15.55:0/11798929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72f01601f0 msgr2=0x7f72f015d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:42.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.780+0000 7f72f5d37640 1 --2- 172.21.15.55:0/11798929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72f01601f0 0x7f72f015d430 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f72e0006fd0 tx=0x7f72e001c4f0 comp rx=0 tx=0).stop 2023-08-25T04:22:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.780+0000 7f72f5d37640 1 -- 172.21.15.55:0/11798929 shutdown_connections 2023-08-25T04:22:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.780+0000 7f72f5d37640 1 --2- 172.21.15.55:0/11798929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72f01601f0 0x7f72f015d430 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.780+0000 7f72f5d37640 1 -- 172.21.15.55:0/11798929 >> 172.21.15.55:0/11798929 conn(0x7f72f00d27d0 msgr2=0x7f72f00d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.780+0000 7f72f5d37640 1 -- 172.21.15.55:0/11798929 shutdown_connections 2023-08-25T04:22:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.780+0000 7f72f5d37640 1 -- 172.21.15.55:0/11798929 wait complete. 2023-08-25T04:22:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72f5d37640 1 Processor -- start 2023-08-25T04:22:42.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72f5d37640 1 -- start start 2023-08-25T04:22:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72f5d37640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72f00d1290 0x7f72f0154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72f5d37640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72f015e3c0 0x7f72f01575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72f5d37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72f01601f0 0x7f72f0157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72f5d37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f0153ef0 con 0x7f72f01601f0 2023-08-25T04:22:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72f5d37640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f00c8940 con 0x7f72f00d1290 2023-08-25T04:22:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72f5d37640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f00c8c20 con 0x7f72f015e3c0 2023-08-25T04:22:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72effff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72f01601f0 0x7f72f0157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72effff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72f01601f0 0x7f72f0157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58492/0 (socket says 172.21.15.55:58492) 2023-08-25T04:22:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72effff640 1 -- 172.21.15.55:0/3705981550 learned_addr learned my addr 172.21.15.55:0/3705981550 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72ef7fe640 1 --2- 172.21.15.55:0/3705981550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72f00d1290 0x7f72f0154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72eeffd640 1 --2- 172.21.15.55:0/3705981550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72f015e3c0 0x7f72f01575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72effff640 1 -- 172.21.15.55:0/3705981550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72f015e3c0 msgr2=0x7f72f01575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72effff640 1 --2- 172.21.15.55:0/3705981550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72f015e3c0 0x7f72f01575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72effff640 1 -- 172.21.15.55:0/3705981550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72f00d1290 msgr2=0x7f72f0154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72effff640 1 --2- 172.21.15.55:0/3705981550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72f00d1290 0x7f72f0154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72effff640 1 -- 172.21.15.55:0/3705981550 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e0009480 con 0x7f72f01601f0 2023-08-25T04:22:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72effff640 1 --2- 172.21.15.55:0/3705981550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72f01601f0 0x7f72f0157af0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f72e800c770 tx=0x7f72e800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:42.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72d7fff640 1 -- 172.21.15.55:0/3705981550 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8003b80 con 0x7f72f01601f0 2023-08-25T04:22:42.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72d7fff640 1 -- 172.21.15.55:0/3705981550 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e8003ce0 con 0x7f72f01601f0 2023-08-25T04:22:42.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72d7fff640 1 -- 172.21.15.55:0/3705981550 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e800aa90 con 0x7f72f01601f0 2023-08-25T04:22:42.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72f5d37640 1 -- 172.21.15.55:0/3705981550 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f00c8f00 con 0x7f72f01601f0 2023-08-25T04:22:42.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.784+0000 7f72f5d37640 1 -- 172.21.15.55:0/3705981550 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f0154b90 con 0x7f72f01601f0 2023-08-25T04:22:42.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.788+0000 7f72f5d37640 1 -- 172.21.15.55:0/3705981550 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f00b5260 con 0x7f72f01601f0 2023-08-25T04:22:42.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.788+0000 7f72d7fff640 1 -- 172.21.15.55:0/3705981550 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 70) v1 ==== 84817+0+0 (secure 0 0 0) 0x7f72e800abf0 con 0x7f72f01601f0 2023-08-25T04:22:42.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.788+0000 7f72d7fff640 1 --2- 172.21.15.55:0/3705981550 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f72dc065520 0x7f72dc0679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:42.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.788+0000 7f72d7fff640 1 -- 172.21.15.55:0/3705981550 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f72e80829d0 con 0x7f72f01601f0 2023-08-25T04:22:42.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.788+0000 7f72ef7fe640 1 --2- 172.21.15.55:0/3705981550 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f72dc065520 0x7f72dc0679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:42.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.788+0000 7f72ef7fe640 1 --2- 172.21.15.55:0/3705981550 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f72dc065520 0x7f72dc0679e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f72e00af000 tx=0x7f72e00a7000 comp rx=0 tx=0).ready entity=mgr.7616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:42.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.792+0000 7f72d7fff640 1 -- 172.21.15.55:0/3705981550 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f72e8050650 con 0x7f72f01601f0 2023-08-25T04:22:42.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:42.968+0000 7f72f5d37640 1 -- 172.21.15.55:0/3705981550 --> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/snap_test_dir1", "retention_spec_or_period": "55n", "target": ["mon-mgr", ""]}) v1 -- 0x7f72f0154db0 con 0x7f72dc065520 2023-08-25T04:22:43.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.020+0000 7f72d7fff640 1 -- 172.21.15.55:0/3705981550 <== mgr.7616 v2:172.21.15.110:6832/3538591338 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+40 (secure 0 0 0) 0x7f72f0154db0 con 0x7f72dc065520 2023-08-25T04:22:43.024 INFO:teuthology.orchestra.run.smithi055.stdout:Retention added to path /snap_test_dir1 2023-08-25T04:22:43.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.024+0000 7f72f5d37640 1 -- 172.21.15.55:0/3705981550 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f72dc065520 msgr2=0x7f72dc0679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:43.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.024+0000 7f72f5d37640 1 --2- 172.21.15.55:0/3705981550 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f72dc065520 0x7f72dc0679e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f72e00af000 tx=0x7f72e00a7000 comp rx=0 tx=0).stop 2023-08-25T04:22:43.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.024+0000 7f72f5d37640 1 -- 172.21.15.55:0/3705981550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72f01601f0 msgr2=0x7f72f0157af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.024+0000 7f72f5d37640 1 --2- 172.21.15.55:0/3705981550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72f01601f0 0x7f72f0157af0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f72e800c770 tx=0x7f72e800cc30 comp rx=0 tx=0).stop 2023-08-25T04:22:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.024+0000 7f72f5d37640 1 -- 172.21.15.55:0/3705981550 shutdown_connections 2023-08-25T04:22:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.024+0000 7f72f5d37640 1 --2- 172.21.15.55:0/3705981550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72f01601f0 0x7f72f0157af0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.024+0000 7f72f5d37640 1 --2- 172.21.15.55:0/3705981550 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f72dc065520 0x7f72dc0679e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.024+0000 7f72f5d37640 1 --2- 172.21.15.55:0/3705981550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72f015e3c0 0x7f72f01575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:43.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.024+0000 7f72f5d37640 1 --2- 172.21.15.55:0/3705981550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72f00d1290 0x7f72f0154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.024+0000 7f72f5d37640 1 -- 172.21.15.55:0/3705981550 >> 172.21.15.55:0/3705981550 conn(0x7f72f00d27d0 msgr2=0x7f72f00cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.024+0000 7f72f5d37640 1 -- 172.21.15.55:0/3705981550 shutdown_connections 2023-08-25T04:22:43.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.024+0000 7f72f5d37640 1 -- 172.21.15.55:0/3705981550 wait complete. 2023-08-25T04:22:43.045 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path /snap_test_dir1 2023-08-25T04:22:43.046 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-08-25T04:22:43.046 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json /snap_test_dir1 2023-08-25T04:22:43.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.192+0000 7f8771e08640 1 Processor -- start 2023-08-25T04:22:43.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.192+0000 7f8771e08640 1 -- start start 2023-08-25T04:22:43.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.196+0000 7f8771e08640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f876c155740 0x7f876c15c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:43.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.196+0000 7f8771e08640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f876c06fb50 0x7f876c0aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:43.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.196+0000 7f8771e08640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876c15fa50 con 0x7f876c155360 2023-08-25T04:22:43.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.196+0000 7f8771e08640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f876c15f2a0 con 0x7f876c155740 2023-08-25T04:22:43.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.196+0000 7f8771e08640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f876c15f490 con 0x7f876c06fb50 2023-08-25T04:22:43.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.196+0000 7f8763fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f876c155740 0x7f876c15c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:43.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.196+0000 7f8763fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f876c155740 0x7f876c15c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58506/0 (socket says 172.21.15.55:58506) 2023-08-25T04:22:43.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.196+0000 7f8763fff640 1 -- 172.21.15.55:0/770447192 learned_addr learned my addr 172.21.15.55:0/770447192 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:43.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.196+0000 7f876bfff640 1 --2- 172.21.15.55:0/770447192 >> v2:172.21.15.110:3300/0 conn(0x7f876c06fb50 0x7f876c0aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:43.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.196+0000 7f8763fff640 1 -- 172.21.15.55:0/770447192 >> v2:172.21.15.110:3300/0 conn(0x7f876c06fb50 msgr2=0x7f876c0aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T04:22:43.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.196+0000 7f8763fff640 1 --2- 172.21.15.55:0/770447192 >> v2:172.21.15.110:3300/0 conn(0x7f876c06fb50 0x7f876c0aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:43.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.196+0000 7f8763fff640 1 -- 172.21.15.55:0/770447192 >> v1:172.21.15.110:6789/0 conn(0x7f876c155360 legacy=0x7f876c15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:43.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.196+0000 7f8763fff640 1 -- 172.21.15.55:0/770447192 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c15f770 con 0x7f876c155740 2023-08-25T04:22:43.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.200+0000 7f8763fff640 1 --2- 172.21.15.55:0/770447192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f876c155740 0x7f876c15c180 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f876c1590d0 tx=0x7f875401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124a464a4b70c573 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:43.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.200+0000 7f876affd640 1 -- 172.21.15.55:0/770447192 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540ab600 con 0x7f876c155740 2023-08-25T04:22:43.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.200+0000 7f876affd640 1 -- 172.21.15.55:0/770447192 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87540a7050 con 0x7f876c155740 2023-08-25T04:22:43.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.200+0000 7f876affd640 1 -- 172.21.15.55:0/770447192 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540ab980 con 0x7f876c155740 2023-08-25T04:22:43.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.200+0000 7f8771e08640 1 -- 172.21.15.55:0/770447192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f876c155740 msgr2=0x7f876c15c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:43.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.200+0000 7f8771e08640 1 --2- 172.21.15.55:0/770447192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f876c155740 0x7f876c15c180 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f876c1590d0 tx=0x7f875401c3e0 comp rx=0 tx=0).stop 2023-08-25T04:22:43.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.200+0000 7f8771e08640 1 -- 172.21.15.55:0/770447192 shutdown_connections 2023-08-25T04:22:43.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.200+0000 7f8771e08640 1 --2- 172.21.15.55:0/770447192 >> v2:172.21.15.110:3300/0 conn(0x7f876c06fb50 0x7f876c0aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:43.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.200+0000 7f8771e08640 1 --2- 172.21.15.55:0/770447192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f876c155740 0x7f876c15c180 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:43.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.200+0000 7f8771e08640 1 -- 172.21.15.55:0/770447192 >> 172.21.15.55:0/770447192 conn(0x7f876c0caf90 msgr2=0x7f876c0cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:43.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.200+0000 7f8771e08640 1 -- 172.21.15.55:0/770447192 shutdown_connections 2023-08-25T04:22:43.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.200+0000 7f8771e08640 1 -- 172.21.15.55:0/770447192 wait complete. 2023-08-25T04:22:43.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.200+0000 7f8771e08640 1 Processor -- start 2023-08-25T04:22:43.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.200+0000 7f8771e08640 1 -- start start 2023-08-25T04:22:43.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f8771e08640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f876c06fb50 0x7f876c152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:43.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f8771e08640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f876c155360 0x7f876c156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:43.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f8771e08640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f876c155740 0x7f876c1f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:43.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f8771e08640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c157ad0 con 0x7f876c06fb50 2023-08-25T04:22:43.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f8771e08640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c156bb0 con 0x7f876c155360 2023-08-25T04:22:43.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f8771e08640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c156e50 con 0x7f876c155740 2023-08-25T04:22:43.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f876b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f876c06fb50 0x7f876c152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:43.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f876b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f876c06fb50 0x7f876c152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58512/0 (socket says 172.21.15.55:58512) 2023-08-25T04:22:43.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f876b7fe640 1 -- 172.21.15.55:0/1840822337 learned_addr learned my addr 172.21.15.55:0/1840822337 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T04:22:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f8763fff640 1 --2- 172.21.15.55:0/1840822337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f876c155360 0x7f876c156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f876bfff640 1 --2- 172.21.15.55:0/1840822337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f876c155740 0x7f876c1f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f876b7fe640 1 -- 172.21.15.55:0/1840822337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f876c155740 msgr2=0x7f876c1f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:43.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f876b7fe640 1 --2- 172.21.15.55:0/1840822337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f876c155740 0x7f876c1f60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:43.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f876b7fe640 1 -- 172.21.15.55:0/1840822337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f876c155360 msgr2=0x7f876c156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:43.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f876b7fe640 1 --2- 172.21.15.55:0/1840822337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f876c155360 0x7f876c156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:43.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f876b7fe640 1 -- 172.21.15.55:0/1840822337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87540094d0 con 0x7f876c06fb50 2023-08-25T04:22:43.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f876bfff640 1 --2- 172.21.15.55:0/1840822337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f876c155740 0x7f876c1f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T04:22:43.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f876b7fe640 1 --2- 172.21.15.55:0/1840822337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f876c06fb50 0x7f876c152ae0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f875c00c500 tx=0x7f875c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:43.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f8768ff9640 1 -- 172.21.15.55:0/1840822337 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c005220 con 0x7f876c06fb50 2023-08-25T04:22:43.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f8768ff9640 1 -- 172.21.15.55:0/1840822337 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c005380 con 0x7f876c06fb50 2023-08-25T04:22:43.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f8768ff9640 1 -- 172.21.15.55:0/1840822337 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c007270 con 0x7f876c06fb50 2023-08-25T04:22:43.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f8771e08640 1 -- 172.21.15.55:0/1840822337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876c157130 con 0x7f876c06fb50 2023-08-25T04:22:43.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f8771e08640 1 -- 172.21.15.55:0/1840822337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876c1576f0 con 0x7f876c06fb50 2023-08-25T04:22:43.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f8771e08640 1 -- 172.21.15.55:0/1840822337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876c04dbe0 con 0x7f876c06fb50 2023-08-25T04:22:43.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.204+0000 7f8768ff9640 1 -- 172.21.15.55:0/1840822337 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 70) v1 ==== 84817+0+0 (secure 0 0 0) 0x7f875c0073d0 con 0x7f876c06fb50 2023-08-25T04:22:43.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.208+0000 7f8768ff9640 1 --2- 172.21.15.55:0/1840822337 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f874c065550 0x7f874c067a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T04:22:43.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.208+0000 7f8768ff9640 1 -- 172.21.15.55:0/1840822337 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f875c082590 con 0x7f876c06fb50 2023-08-25T04:22:43.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.208+0000 7f8763fff640 1 --2- 172.21.15.55:0/1840822337 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f874c065550 0x7f874c067a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T04:22:43.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.208+0000 7f8763fff640 1 --2- 172.21.15.55:0/1840822337 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f874c065550 0x7f874c067a10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f87540ad000 tx=0x7f87540a6000 comp rx=0 tx=0).ready entity=mgr.7616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T04:22:43.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.212+0000 7f8768ff9640 1 -- 172.21.15.55:0/1840822337 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f875c0500e0 con 0x7f876c06fb50 2023-08-25T04:22:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.388+0000 7f8771e08640 1 -- 172.21.15.55:0/1840822337 --> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f876c0b08e0 con 0x7f874c065550 2023-08-25T04:22:43.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.396+0000 7f8768ff9640 1 -- 172.21.15.55:0/1840822337 <== mgr.7616 v2:172.21.15.110:6832/3538591338 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+74 (secure 0 0 0) 0x7f87540ab740 con 0x7f874c065550 2023-08-25T04:22:43.397 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T04:22:43.397 INFO:teuthology.orchestra.run.smithi055.stdout:{"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-08-25T04:22:43.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.396+0000 7f8771e08640 1 -- 172.21.15.55:0/1840822337 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f874c065550 msgr2=0x7f874c067a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:43.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.396+0000 7f8771e08640 1 --2- 172.21.15.55:0/1840822337 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f874c065550 0x7f874c067a10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f87540ad000 tx=0x7f87540a6000 comp rx=0 tx=0).stop 2023-08-25T04:22:43.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.396+0000 7f8771e08640 1 -- 172.21.15.55:0/1840822337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f876c06fb50 msgr2=0x7f876c152ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T04:22:43.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.396+0000 7f8771e08640 1 --2- 172.21.15.55:0/1840822337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f876c06fb50 0x7f876c152ae0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f875c00c500 tx=0x7f875c00c9c0 comp rx=0 tx=0).stop 2023-08-25T04:22:43.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.396+0000 7f8771e08640 1 -- 172.21.15.55:0/1840822337 shutdown_connections 2023-08-25T04:22:43.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.396+0000 7f8771e08640 1 --2- 172.21.15.55:0/1840822337 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f874c065550 0x7f874c067a10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:43.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.396+0000 7f8771e08640 1 --2- 172.21.15.55:0/1840822337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f876c155740 0x7f876c1f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:43.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.396+0000 7f8771e08640 1 --2- 172.21.15.55:0/1840822337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f876c155360 0x7f876c156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:43.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.396+0000 7f8771e08640 1 --2- 172.21.15.55:0/1840822337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f876c06fb50 0x7f876c152ae0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T04:22:43.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.396+0000 7f8771e08640 1 -- 172.21.15.55:0/1840822337 >> 172.21.15.55:0/1840822337 conn(0x7f876c0caf90 msgr2=0x7f876c0c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T04:22:43.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.396+0000 7f8771e08640 1 -- 172.21.15.55:0/1840822337 shutdown_connections 2023-08-25T04:22:43.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T04:22:43.396+0000 7f8771e08640 1 -- 172.21.15.55:0/1840822337 wait complete. 2023-08-25T04:22:43.418 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-08-25T04:22:43.418 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': '/snap_test_dir1', 'schedule': ['1M'], 'retention': [{'n': 55}]} 2023-08-25T04:23:00.036 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:23:00.037+0000 7f2faf3de640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:23:00.037 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:23:00.037+0000 7f2faf3de640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:23:00.037 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:23:00.037+0000 7f2faf3de640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:23:00.037 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:23:00.037+0000 7f2faf3de640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:23:00.037 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T04:23:00.037+0000 7f2faf3de640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T04:23:01.066 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:23:01.070 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:23:31.196 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:23:31.200 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:24:01.279 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:24:01.283 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:24:31.537 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:24:31.545 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:25:01.596 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:25:01.600 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:25:31.675 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:25:31.680 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:26:01.757 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:26:01.763 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:26:31.831 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:26:31.837 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:27:01.895 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:27:01.902 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:27:32.003 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:27:32.007 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:28:02.067 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:28:02.072 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:28:32.133 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:28:32.139 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:29:02.188 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:29:02.193 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:29:32.344 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:29:32.349 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:30:02.402 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:30:02.406 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:30:32.467 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:30:32.475 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:31:02.560 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:31:02.623 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:31:32.750 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:31:32.755 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:32:02.860 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:32:02.864 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:32:32.929 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:32:32.933 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:33:03.174 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:33:03.179 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:33:33.230 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:33:33.235 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:34:03.347 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:34:03.352 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:34:33.452 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:34:33.457 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:35:03.775 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:35:03.780 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:35:33.832 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:35:33.837 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:36:03.914 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:36:03.918 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:36:33.970 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:36:33.975 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:37:04.201 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:37:04.206 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:37:34.249 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:37:34.254 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:38:04.321 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:38:04.326 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:38:34.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:38:34.401 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:39:04.620 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:39:04.625 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:39:34.694 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:39:34.699 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:40:04.757 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:40:04.762 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:40:34.839 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:40:34.844 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:41:05.026 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:41:05.030 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:41:35.093 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:41:35.097 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:42:05.149 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:42:05.155 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:42:35.214 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:42:35.219 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:43:05.360 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:43:05.364 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:43:35.611 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:43:35.616 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:44:05.671 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:44:05.676 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:44:35.727 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:44:35.731 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:45:05.914 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:45:05.919 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:45:35.973 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:45:35.976 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:46:06.052 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:46:06.058 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:46:36.127 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:46:36.132 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:47:06.325 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:47:06.329 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:47:36.381 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:47:36.386 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:48:06.439 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:48:06.448 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:48:36.502 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:48:36.507 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:49:06.627 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:49:06.632 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:49:36.691 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:49:36.695 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:50:06.764 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:50:06.768 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:50:36.825 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:50:36.829 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:51:06.932 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:51:06.936 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:51:37.296 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:51:37.300 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:52:07.369 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:52:07.374 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:52:37.425 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:52:37.430 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:53:07.502 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:53:07.507 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:53:37.565 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:53:37.570 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:54:07.839 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:54:07.843 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:54:38.203 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:54:38.208 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:55:08.272 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:55:08.279 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:55:38.336 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:55:38.340 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:56:08.516 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:56:08.521 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:56:38.573 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:56:38.578 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:57:08.637 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:57:08.642 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:57:38.702 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:57:38.706 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:58:08.758 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:58:08.764 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:58:38.824 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:58:38.889 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:59:09.029 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:59:09.034 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:59:39.085 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T04:59:39.089 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:00:09.150 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:00:09.157 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:00:39.339 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:00:39.344 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:01:09.411 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:01:09.416 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:01:39.470 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:01:39.475 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:02:09.602 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:02:09.607 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:02:39.917 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:02:39.922 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:03:09.973 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:03:09.977 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:03:40.039 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:03:40.043 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:04:10.104 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:04:10.108 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:04:40.184 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:04:40.188 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:05:10.491 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:05:10.495 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:05:40.580 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:05:40.585 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:06:10.662 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:06:10.666 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:06:40.727 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:06:40.732 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:07:11.043 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:07:11.047 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:07:41.099 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:07:41.105 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:08:11.164 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:08:11.169 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:08:41.230 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:08:41.235 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:09:11.301 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:09:11.305 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:09:41.365 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:09:41.370 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:10:11.430 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:10:11.435 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:10:41.494 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:10:41.498 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:11:11.574 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:11:11.578 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:11:41.841 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:11:41.845 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:12:11.898 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:12:11.903 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:12:41.971 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:12:41.978 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:13:12.094 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:13:12.100 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:13:42.292 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:13:42.297 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:14:12.657 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:14:12.663 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:14:42.721 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:14:42.726 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:15:12.778 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:15:12.783 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:15:42.834 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:15:42.839 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:16:12.917 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:16:12.922 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:16:42.974 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:16:42.978 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:17:13.039 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:17:13.049 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:17:43.178 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:17:43.183 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:18:13.235 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:18:13.240 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:18:15.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:15.420 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:18:15.436 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_24_00_UTC 2023-08-25T05:18:15.436 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_25_00_UTC 2023-08-25T05:18:15.436 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_26_00_UTC 2023-08-25T05:18:15.436 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_27_00_UTC 2023-08-25T05:18:15.437 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_28_00_UTC 2023-08-25T05:18:15.437 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_29_00_UTC 2023-08-25T05:18:15.437 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_30_00_UTC 2023-08-25T05:18:15.437 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_31_00_UTC 2023-08-25T05:18:15.437 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_32_00_UTC 2023-08-25T05:18:15.437 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_33_00_UTC 2023-08-25T05:18:15.437 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_34_00_UTC 2023-08-25T05:18:15.437 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_35_00_UTC 2023-08-25T05:18:15.438 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_36_00_UTC 2023-08-25T05:18:15.438 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_37_00_UTC 2023-08-25T05:18:15.438 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_38_00_UTC 2023-08-25T05:18:15.438 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_39_00_UTC 2023-08-25T05:18:15.438 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_40_00_UTC 2023-08-25T05:18:15.438 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_41_00_UTC 2023-08-25T05:18:15.438 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_42_00_UTC 2023-08-25T05:18:15.438 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_43_00_UTC 2023-08-25T05:18:15.439 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_44_00_UTC 2023-08-25T05:18:15.439 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_45_00_UTC 2023-08-25T05:18:15.439 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_46_00_UTC 2023-08-25T05:18:15.439 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_47_00_UTC 2023-08-25T05:18:15.439 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_48_00_UTC 2023-08-25T05:18:15.439 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_49_00_UTC 2023-08-25T05:18:15.439 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_50_00_UTC 2023-08-25T05:18:15.440 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_51_00_UTC 2023-08-25T05:18:15.440 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_52_00_UTC 2023-08-25T05:18:15.440 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_53_00_UTC 2023-08-25T05:18:15.440 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_54_00_UTC 2023-08-25T05:18:15.440 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_55_00_UTC 2023-08-25T05:18:15.440 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_56_00_UTC 2023-08-25T05:18:15.440 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_57_00_UTC 2023-08-25T05:18:15.441 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_58_00_UTC 2023-08-25T05:18:15.441 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_59_00_UTC 2023-08-25T05:18:15.441 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_00_00_UTC 2023-08-25T05:18:15.441 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_01_00_UTC 2023-08-25T05:18:15.441 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_02_00_UTC 2023-08-25T05:18:15.441 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_03_00_UTC 2023-08-25T05:18:15.441 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_04_00_UTC 2023-08-25T05:18:15.441 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_05_00_UTC 2023-08-25T05:18:15.442 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_06_00_UTC 2023-08-25T05:18:15.442 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_07_00_UTC 2023-08-25T05:18:15.442 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_08_00_UTC 2023-08-25T05:18:15.442 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_09_00_UTC 2023-08-25T05:18:15.442 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_10_00_UTC 2023-08-25T05:18:15.443 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_11_00_UTC 2023-08-25T05:18:15.443 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_12_00_UTC 2023-08-25T05:18:15.443 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_13_00_UTC 2023-08-25T05:18:15.443 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_14_00_UTC 2023-08-25T05:18:15.444 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_15_00_UTC 2023-08-25T05:18:15.444 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_16_00_UTC 2023-08-25T05:18:15.444 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_17_00_UTC 2023-08-25T05:18:15.444 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_18_00_UTC 2023-08-25T05:18:15.445 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-25-04_24_00_UTC', 'scheduled-2023-08-25-04_25_00_UTC', 'scheduled-2023-08-25-04_26_00_UTC', 'scheduled-2023-08-25-04_27_00_UTC', 'scheduled-2023-08-25-04_28_00_UTC', 'scheduled-2023-08-25-04_29_00_UTC', 'scheduled-2023-08-25-04_30_00_UTC', 'scheduled-2023-08-25-04_31_00_UTC', 'scheduled-2023-08-25-04_32_00_UTC', 'scheduled-2023-08-25-04_33_00_UTC', 'scheduled-2023-08-25-04_34_00_UTC', 'scheduled-2023-08-25-04_35_00_UTC', 'scheduled-2023-08-25-04_36_00_UTC', 'scheduled-2023-08-25-04_37_00_UTC', 'scheduled-2023-08-25-04_38_00_UTC', 'scheduled-2023-08-25-04_39_00_UTC', 'scheduled-2023-08-25-04_40_00_UTC', 'scheduled-2023-08-25-04_41_00_UTC', 'scheduled-2023-08-25-04_42_00_UTC', 'scheduled-2023-08-25-04_43_00_UTC', 'scheduled-2023-08-25-04_44_00_UTC', 'scheduled-2023-08-25-04_45_00_UTC', 'scheduled-2023-08-25-04_46_00_UTC', 'scheduled-2023-08-25-04_47_00_UTC', 'scheduled-2023-08-25-04_48_00_UTC', 'scheduled-2023-08-25-04_49_00_UTC', 'scheduled-2023-08-25-04_50_00_UTC', 'scheduled-2023-08-25-04_51_00_UTC', 'scheduled-2023-08-25-04_52_00_UTC', 'scheduled-2023-08-25-04_53_00_UTC', 'scheduled-2023-08-25-04_54_00_UTC', 'scheduled-2023-08-25-04_55_00_UTC', 'scheduled-2023-08-25-04_56_00_UTC', 'scheduled-2023-08-25-04_57_00_UTC', 'scheduled-2023-08-25-04_58_00_UTC', 'scheduled-2023-08-25-04_59_00_UTC', 'scheduled-2023-08-25-05_00_00_UTC', 'scheduled-2023-08-25-05_01_00_UTC', 'scheduled-2023-08-25-05_02_00_UTC', 'scheduled-2023-08-25-05_03_00_UTC', 'scheduled-2023-08-25-05_04_00_UTC', 'scheduled-2023-08-25-05_05_00_UTC', 'scheduled-2023-08-25-05_06_00_UTC', 'scheduled-2023-08-25-05_07_00_UTC', 'scheduled-2023-08-25-05_08_00_UTC', 'scheduled-2023-08-25-05_09_00_UTC', 'scheduled-2023-08-25-05_10_00_UTC', 'scheduled-2023-08-25-05_11_00_UTC', 'scheduled-2023-08-25-05_12_00_UTC', 'scheduled-2023-08-25-05_13_00_UTC', 'scheduled-2023-08-25-05_14_00_UTC', 'scheduled-2023-08-25-05_15_00_UTC', 'scheduled-2023-08-25-05_16_00_UTC', 'scheduled-2023-08-25-05_17_00_UTC', 'scheduled-2023-08-25-05_18_00_UTC'] 2023-08-25T05:18:15.446 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1 2023-08-25T05:18:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.642+0000 7f7143f67640 1 Processor -- start 2023-08-25T05:18:15.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.642+0000 7f7143f67640 1 -- start start 2023-08-25T05:18:15.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.642+0000 7f7143f67640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f713c159d00 0x7f713c0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:15.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.642+0000 7f7143f67640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f713c0cc930 0x7f713c0ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:15.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.642+0000 7f7143f67640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c0c9270 con 0x7f713c06fb50 2023-08-25T05:18:15.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.642+0000 7f7143f67640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c0cc510 con 0x7f713c0cc930 2023-08-25T05:18:15.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.642+0000 7f7143f67640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c0ce220 con 0x7f713c159d00 2023-08-25T05:18:15.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.642+0000 7f7142504640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f713c0cc930 0x7f713c0ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:15.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.642+0000 7f7141502640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f713c06fb50 0x7f713c0c8b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54576/0 (socket says 172.21.15.55:54576) 2023-08-25T05:18:15.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.642+0000 7f7141502640 1 -- 172.21.15.55:0/41216378 learned_addr learned my addr 172.21.15.55:0/41216378 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:15.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.642+0000 7f7141d03640 1 --2- 172.21.15.55:0/41216378 >> v2:172.21.15.110:3300/0 conn(0x7f713c159d00 0x7f713c0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:15.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.642+0000 7f7142504640 1 -- 172.21.15.55:0/41216378 >> v2:172.21.15.110:3300/0 conn(0x7f713c159d00 msgr2=0x7f713c0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:15.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.642+0000 7f7142504640 1 --2- 172.21.15.55:0/41216378 >> v2:172.21.15.110:3300/0 conn(0x7f713c159d00 0x7f713c0cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:15.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.642+0000 7f7142504640 1 -- 172.21.15.55:0/41216378 >> v1:172.21.15.55:6789/0 conn(0x7f713c06fb50 legacy=0x7f713c0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:15.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.642+0000 7f7142504640 1 -- 172.21.15.55:0/41216378 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c0ca6c0 con 0x7f713c0cc930 2023-08-25T05:18:15.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.642+0000 7f7140d01640 1 -- 172.21.15.55:0/41216378 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3452944837 0 0) 0x7f713c0c9270 con 0x7f713c06fb50 2023-08-25T05:18:15.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.646+0000 7f7142504640 1 --2- 172.21.15.55:0/41216378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f713c0cc930 0x7f713c0ccd40 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f713c0b0de0 tx=0x7f713401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457e52133a84c05f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:15.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.646+0000 7f7140d01640 1 -- 172.21.15.55:0/41216378 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71340a5910 con 0x7f713c0cc930 2023-08-25T05:18:15.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.646+0000 7f7140d01640 1 -- 172.21.15.55:0/41216378 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71340a5a70 con 0x7f713c0cc930 2023-08-25T05:18:15.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.646+0000 7f7140d01640 1 -- 172.21.15.55:0/41216378 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71340a5e00 con 0x7f713c0cc930 2023-08-25T05:18:15.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.646+0000 7f7143f67640 1 -- 172.21.15.55:0/41216378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f713c0cc930 msgr2=0x7f713c0ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:15.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.646+0000 7f7143f67640 1 --2- 172.21.15.55:0/41216378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f713c0cc930 0x7f713c0ccd40 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f713c0b0de0 tx=0x7f713401c850 comp rx=0 tx=0).stop 2023-08-25T05:18:15.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.646+0000 7f7143f67640 1 -- 172.21.15.55:0/41216378 shutdown_connections 2023-08-25T05:18:15.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.646+0000 7f7143f67640 1 --2- 172.21.15.55:0/41216378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f713c0cc930 0x7f713c0ccd40 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:15.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.646+0000 7f7143f67640 1 --2- 172.21.15.55:0/41216378 >> v2:172.21.15.110:3300/0 conn(0x7f713c159d00 0x7f713c0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:15.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.646+0000 7f7143f67640 1 -- 172.21.15.55:0/41216378 >> 172.21.15.55:0/41216378 conn(0x7f713c0caf90 msgr2=0x7f713c0cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:15.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.646+0000 7f7143f67640 1 -- 172.21.15.55:0/41216378 shutdown_connections 2023-08-25T05:18:15.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.646+0000 7f7143f67640 1 -- 172.21.15.55:0/41216378 wait complete. 2023-08-25T05:18:15.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7143f67640 1 Processor -- start 2023-08-25T05:18:15.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7143f67640 1 -- start start 2023-08-25T05:18:15.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7143f67640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f713c06fb50 0x7f713c1f4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:15.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7143f67640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f713c0cc930 0x7f713c152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:15.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7143f67640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f713c159d00 0x7f713c152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:15.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7143f67640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c1551a0 con 0x7f713c159d00 2023-08-25T05:18:15.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7143f67640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c1542b0 con 0x7f713c06fb50 2023-08-25T05:18:15.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7143f67640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c154590 con 0x7f713c0cc930 2023-08-25T05:18:15.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7142504640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f713c159d00 0x7f713c152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:15.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7142504640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f713c159d00 0x7f713c152b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51750/0 (socket says 172.21.15.55:51750) 2023-08-25T05:18:15.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7142504640 1 -- 172.21.15.55:0/3866277312 learned_addr learned my addr 172.21.15.55:0/3866277312 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:15.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7141d03640 1 --2- 172.21.15.55:0/3866277312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f713c06fb50 0x7f713c1f4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:15.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7141502640 1 --2- 172.21.15.55:0/3866277312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f713c0cc930 0x7f713c152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:15.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7142504640 1 -- 172.21.15.55:0/3866277312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f713c0cc930 msgr2=0x7f713c152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:15.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7142504640 1 --2- 172.21.15.55:0/3866277312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f713c0cc930 0x7f713c152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7142504640 1 -- 172.21.15.55:0/3866277312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f713c06fb50 msgr2=0x7f713c1f4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7142504640 1 --2- 172.21.15.55:0/3866277312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f713c06fb50 0x7f713c1f4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7142504640 1 -- 172.21.15.55:0/3866277312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7134009a70 con 0x7f713c159d00 2023-08-25T05:18:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7141502640 1 --2- 172.21.15.55:0/3866277312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f713c0cc930 0x7f713c152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7142504640 1 --2- 172.21.15.55:0/3866277312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f713c159d00 0x7f713c152b80 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f71340b0040 tx=0x7f71340195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f71327fc640 1 -- 172.21.15.55:0/3866277312 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71340b9860 con 0x7f713c159d00 2023-08-25T05:18:15.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f71327fc640 1 -- 172.21.15.55:0/3866277312 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71340b99c0 con 0x7f713c159d00 2023-08-25T05:18:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f71327fc640 1 -- 172.21.15.55:0/3866277312 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71340b9d70 con 0x7f713c159d00 2023-08-25T05:18:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7143f67640 1 -- 172.21.15.55:0/3866277312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c154870 con 0x7f713c159d00 2023-08-25T05:18:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7143f67640 1 -- 172.21.15.55:0/3866277312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c154e30 con 0x7f713c159d00 2023-08-25T05:18:15.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.650+0000 7f7143f67640 1 -- 172.21.15.55:0/3866277312 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c04dbe0 con 0x7f713c159d00 2023-08-25T05:18:15.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.654+0000 7f71327fc640 1 -- 172.21.15.55:0/3866277312 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 74) v1 ==== 85093+0+0 (secure 0 0 0) 0x7f71340ad440 con 0x7f713c159d00 2023-08-25T05:18:15.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.654+0000 7f71327fc640 1 --2- 172.21.15.55:0/3866277312 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f7120065820 0x7f7120067ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:15.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.654+0000 7f71327fc640 1 -- 172.21.15.55:0/3866277312 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6494+0+0 (secure 0 0 0) 0x7f713411dfc0 con 0x7f713c159d00 2023-08-25T05:18:15.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.654+0000 7f7141d03640 1 --2- 172.21.15.55:0/3866277312 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f7120065820 0x7f7120067ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:15.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.654+0000 7f7141d03640 1 --2- 172.21.15.55:0/3866277312 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f7120065820 0x7f7120067ce0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f71380079c0 tx=0x7f7138008040 comp rx=0 tx=0).ready entity=mgr.7616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:15.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.658+0000 7f71327fc640 1 -- 172.21.15.55:0/3866277312 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f71340eb840 con 0x7f713c159d00 2023-08-25T05:18:15.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.830+0000 7f7143f67640 1 -- 172.21.15.55:0/3866277312 --> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f713c0cd770 con 0x7f7120065820 2023-08-25T05:18:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.838+0000 7f71327fc640 1 -- 172.21.15.55:0/3866277312 <== mgr.7616 v2:172.21.15.110:6832/3538591338 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f71380108d0 con 0x7f7120065820 2023-08-25T05:18:15.842 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:15.843 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:22:42", "first": "2023-08-25T04:23:00", "last": "2023-08-25T05:18:00", "last_pruned": "2023-08-25T05:18:01", "created_count": 56, "pruned_count": 1, "active": true}] 2023-08-25T05:18:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.842+0000 7f7143f67640 1 -- 172.21.15.55:0/3866277312 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f7120065820 msgr2=0x7f7120067ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.842+0000 7f7143f67640 1 --2- 172.21.15.55:0/3866277312 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f7120065820 0x7f7120067ce0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f71380079c0 tx=0x7f7138008040 comp rx=0 tx=0).stop 2023-08-25T05:18:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.842+0000 7f7143f67640 1 -- 172.21.15.55:0/3866277312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f713c159d00 msgr2=0x7f713c152b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.842+0000 7f7143f67640 1 --2- 172.21.15.55:0/3866277312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f713c159d00 0x7f713c152b80 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f71340b0040 tx=0x7f71340195f0 comp rx=0 tx=0).stop 2023-08-25T05:18:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.842+0000 7f7143f67640 1 -- 172.21.15.55:0/3866277312 shutdown_connections 2023-08-25T05:18:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.842+0000 7f7143f67640 1 --2- 172.21.15.55:0/3866277312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f713c159d00 0x7f713c152b80 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.842+0000 7f7143f67640 1 --2- 172.21.15.55:0/3866277312 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f7120065820 0x7f7120067ce0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:15.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.842+0000 7f7143f67640 1 --2- 172.21.15.55:0/3866277312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f713c0cc930 0x7f713c152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:15.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.842+0000 7f7143f67640 1 --2- 172.21.15.55:0/3866277312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f713c06fb50 0x7f713c1f4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:15.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.842+0000 7f7143f67640 1 -- 172.21.15.55:0/3866277312 >> 172.21.15.55:0/3866277312 conn(0x7f713c0caf90 msgr2=0x7f713c1536c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:15.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.842+0000 7f7143f67640 1 -- 172.21.15.55:0/3866277312 shutdown_connections 2023-08-25T05:18:15.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:15.842+0000 7f7143f67640 1 -- 172.21.15.55:0/3866277312 wait complete. 2023-08-25T05:18:15.863 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T04:22:42", "first": "2023-08-25T04:23:00", "last": "2023-08-25T05:18:00", "last_pruned": "2023-08-25T05:18:01", "created_count": 56, "pruned_count": 1, "active": true}] 2023-08-25T05:18:15.863 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1', 'rel_path': '/snap_test_dir1', 'schedule': '1M', 'retention': {'n': 55}, 'start': '2023-08-25T00:00:00', 'created': '2023-08-25T04:22:42', 'first': '2023-08-25T04:23:00', 'last': '2023-08-25T05:18:00', 'last_pruned': '2023-08-25T05:18:01', 'created_count': 56, 'pruned_count': 1, 'active': True} 2023-08-25T05:18:15.864 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 55 2023-08-25T05:18:15.864 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 56 2023-08-25T05:18:15.865 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1 2023-08-25T05:18:16.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.010+0000 7fb7f8537640 1 Processor -- start 2023-08-25T05:18:16.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.010+0000 7fb7f8537640 1 -- start start 2023-08-25T05:18:16.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.010+0000 7fb7f8537640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb7f015c8e0 0x7fb7f00cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:16.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.010+0000 7fb7f8537640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7f006ea10 0x7fb7f00cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:16.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.010+0000 7fb7f8537640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f00c4f40 con 0x7fb7f00cd8a0 2023-08-25T05:18:16.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.010+0000 7fb7f8537640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f00c4d50 con 0x7fb7f015c8e0 2023-08-25T05:18:16.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.010+0000 7fb7f8537640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f006ee70 con 0x7fb7f006ea10 2023-08-25T05:18:16.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.010+0000 7fb7f6ad4640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb7f00cd8a0 0x7fb7f01604b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54578/0 (socket says 172.21.15.55:54578) 2023-08-25T05:18:16.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.010+0000 7fb7f6ad4640 1 -- 172.21.15.55:0/1465504160 learned_addr learned my addr 172.21.15.55:0/1465504160 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:16.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.010+0000 7fb7f62d3640 1 --2- 172.21.15.55:0/1465504160 >> v2:172.21.15.110:3300/0 conn(0x7fb7f015c8e0 0x7fb7f00cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:16.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.010+0000 7fb7f5ad2640 1 --2- 172.21.15.55:0/1465504160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7f006ea10 0x7fb7f00cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:16.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.010+0000 7fb7f52d1640 1 -- 172.21.15.55:0/1465504160 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688635600 0 0) 0x7fb7f00c4f40 con 0x7fb7f00cd8a0 2023-08-25T05:18:16.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.010+0000 7fb7f52d1640 1 -- 172.21.15.55:0/1465504160 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7dc003530 con 0x7fb7f00cd8a0 2023-08-25T05:18:16.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.010+0000 7fb7f52d1640 1 -- 172.21.15.55:0/1465504160 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2159740704 0 0) 0x7fb7dc003530 con 0x7fb7f00cd8a0 2023-08-25T05:18:16.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.010+0000 7fb7f62d3640 1 -- 172.21.15.55:0/1465504160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7f006ea10 msgr2=0x7fb7f00cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:16.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.010+0000 7fb7f62d3640 1 --2- 172.21.15.55:0/1465504160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7f006ea10 0x7fb7f00cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:16.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.010+0000 7fb7f62d3640 1 -- 172.21.15.55:0/1465504160 >> v1:172.21.15.55:6789/0 conn(0x7fb7f00cd8a0 legacy=0x7fb7f01604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:16.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.010+0000 7fb7f62d3640 1 -- 172.21.15.55:0/1465504160 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f00c5220 con 0x7fb7f015c8e0 2023-08-25T05:18:16.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.014+0000 7fb7f62d3640 1 --2- 172.21.15.55:0/1465504160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7f015c8e0 0x7fb7f00cc8e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0097f0 tx=0x7fb7ec01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4841049a28691a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:16.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.014+0000 7fb7f52d1640 1 -- 172.21.15.55:0/1465504160 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0a4ea0 con 0x7fb7f015c8e0 2023-08-25T05:18:16.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.014+0000 7fb7f52d1640 1 -- 172.21.15.55:0/1465504160 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec0a7050 con 0x7fb7f015c8e0 2023-08-25T05:18:16.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.014+0000 7fb7f52d1640 1 -- 172.21.15.55:0/1465504160 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8001a00 con 0x7fb7f015c8e0 2023-08-25T05:18:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.014+0000 7fb7f8537640 1 -- 172.21.15.55:0/1465504160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7f015c8e0 msgr2=0x7fb7f00cc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:16.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.014+0000 7fb7f8537640 1 --2- 172.21.15.55:0/1465504160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7f015c8e0 0x7fb7f00cc8e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0097f0 tx=0x7fb7ec01c3a0 comp rx=0 tx=0).stop 2023-08-25T05:18:16.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.014+0000 7fb7f8537640 1 -- 172.21.15.55:0/1465504160 shutdown_connections 2023-08-25T05:18:16.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.014+0000 7fb7f8537640 1 --2- 172.21.15.55:0/1465504160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7f006ea10 0x7fb7f00cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:16.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.014+0000 7fb7f8537640 1 --2- 172.21.15.55:0/1465504160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7f015c8e0 0x7fb7f00cc8e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:16.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.014+0000 7fb7f8537640 1 -- 172.21.15.55:0/1465504160 >> 172.21.15.55:0/1465504160 conn(0x7fb7f00cb790 msgr2=0x7fb7f00cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:16.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.014+0000 7fb7f8537640 1 -- 172.21.15.55:0/1465504160 shutdown_connections 2023-08-25T05:18:16.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.014+0000 7fb7f8537640 1 -- 172.21.15.55:0/1465504160 wait complete. 2023-08-25T05:18:16.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f8537640 1 Processor -- start 2023-08-25T05:18:16.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f8537640 1 -- start start 2023-08-25T05:18:16.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f8537640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7f006ea10 0x7fb7f0154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:16.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f8537640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f00cd8a0 0x7fb7f0158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:16.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f8537640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7f015c8e0 0x7fb7f0153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:16.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f8537640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f01590f0 con 0x7fb7f00cd8a0 2023-08-25T05:18:16.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f8537640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f01593d0 con 0x7fb7f006ea10 2023-08-25T05:18:16.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f8537640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f01596b0 con 0x7fb7f015c8e0 2023-08-25T05:18:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f5ad2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f00cd8a0 0x7fb7f0158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f5ad2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f00cd8a0 0x7fb7f0158670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51754/0 (socket says 172.21.15.55:51754) 2023-08-25T05:18:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f5ad2640 1 -- 172.21.15.55:0/1165306670 learned_addr learned my addr 172.21.15.55:0/1165306670 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f6ad4640 1 --2- 172.21.15.55:0/1165306670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7f015c8e0 0x7fb7f0153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f62d3640 1 --2- 172.21.15.55:0/1165306670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7f006ea10 0x7fb7f0154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:16.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f5ad2640 1 -- 172.21.15.55:0/1165306670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7f015c8e0 msgr2=0x7fb7f0153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:16.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f5ad2640 1 --2- 172.21.15.55:0/1165306670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7f015c8e0 0x7fb7f0153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:16.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f5ad2640 1 -- 172.21.15.55:0/1165306670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7f006ea10 msgr2=0x7fb7f0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:16.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f5ad2640 1 --2- 172.21.15.55:0/1165306670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7f006ea10 0x7fb7f0154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:16.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f5ad2640 1 -- 172.21.15.55:0/1165306670 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec009420 con 0x7fb7f00cd8a0 2023-08-25T05:18:16.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f6ad4640 1 --2- 172.21.15.55:0/1165306670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7f015c8e0 0x7fb7f0153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:16.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f5ad2640 1 --2- 172.21.15.55:0/1165306670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f00cd8a0 0x7fb7f0158670 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000e870 tx=0x7fb7e000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:16.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7e6ffd640 1 -- 172.21.15.55:0/1165306670 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0009510 con 0x7fb7f00cd8a0 2023-08-25T05:18:16.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7e6ffd640 1 -- 172.21.15.55:0/1165306670 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e000eec0 con 0x7fb7f00cd8a0 2023-08-25T05:18:16.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7f8537640 1 -- 172.21.15.55:0/1165306670 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f0159990 con 0x7fb7f00cd8a0 2023-08-25T05:18:16.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.018+0000 7fb7e6ffd640 1 -- 172.21.15.55:0/1165306670 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e000cb40 con 0x7fb7f00cd8a0 2023-08-25T05:18:16.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.022+0000 7fb7f8537640 1 -- 172.21.15.55:0/1165306670 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f015b0a0 con 0x7fb7f00cd8a0 2023-08-25T05:18:16.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.022+0000 7fb7f8537640 1 -- 172.21.15.55:0/1165306670 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f015d400 con 0x7fb7f00cd8a0 2023-08-25T05:18:16.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.022+0000 7fb7e6ffd640 1 -- 172.21.15.55:0/1165306670 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 74) v1 ==== 85093+0+0 (secure 0 0 0) 0x7fb7e000cca0 con 0x7fb7f00cd8a0 2023-08-25T05:18:16.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.022+0000 7fb7e6ffd640 1 --2- 172.21.15.55:0/1165306670 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fb7d40657f0 0x7fb7d4067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:16.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.022+0000 7fb7e6ffd640 1 -- 172.21.15.55:0/1165306670 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6494+0+0 (secure 0 0 0) 0x7fb7e0083320 con 0x7fb7f00cd8a0 2023-08-25T05:18:16.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.022+0000 7fb7f62d3640 1 --2- 172.21.15.55:0/1165306670 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fb7d40657f0 0x7fb7d4067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:16.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.022+0000 7fb7f62d3640 1 --2- 172.21.15.55:0/1165306670 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fb7d40657f0 0x7fb7d4067cb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0ad000 tx=0x7fb7ec008040 comp rx=0 tx=0).ready entity=mgr.7616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:16.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.026+0000 7fb7e6ffd640 1 -- 172.21.15.55:0/1165306670 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb7f015d400 con 0x7fb7f00cd8a0 2023-08-25T05:18:16.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.202+0000 7fb7f8537640 1 -- 172.21.15.55:0/1165306670 --> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7f015ccc0 con 0x7fb7d40657f0 2023-08-25T05:18:16.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.278+0000 7fb7e6ffd640 1 -- 172.21.15.55:0/1165306670 <== mgr.7616 v2:172.21.15.110:6832/3538591338 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+42 (secure 0 0 0) 0x7fb7ec006e20 con 0x7fb7d40657f0 2023-08-25T05:18:16.282 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1 2023-08-25T05:18:16.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.282+0000 7fb7f8537640 1 -- 172.21.15.55:0/1165306670 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fb7d40657f0 msgr2=0x7fb7d4067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:16.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.282+0000 7fb7f8537640 1 --2- 172.21.15.55:0/1165306670 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fb7d40657f0 0x7fb7d4067cb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec0ad000 tx=0x7fb7ec008040 comp rx=0 tx=0).stop 2023-08-25T05:18:16.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.282+0000 7fb7f8537640 1 -- 172.21.15.55:0/1165306670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f00cd8a0 msgr2=0x7fb7f0158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:16.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.282+0000 7fb7f8537640 1 --2- 172.21.15.55:0/1165306670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f00cd8a0 0x7fb7f0158670 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000e870 tx=0x7fb7e000ec70 comp rx=0 tx=0).stop 2023-08-25T05:18:16.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.282+0000 7fb7f8537640 1 -- 172.21.15.55:0/1165306670 shutdown_connections 2023-08-25T05:18:16.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.282+0000 7fb7f8537640 1 --2- 172.21.15.55:0/1165306670 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fb7d40657f0 0x7fb7d4067cb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:16.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.282+0000 7fb7f8537640 1 --2- 172.21.15.55:0/1165306670 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7f015c8e0 0x7fb7f0153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:16.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.282+0000 7fb7f8537640 1 --2- 172.21.15.55:0/1165306670 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f00cd8a0 0x7fb7f0158670 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:16.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.282+0000 7fb7f8537640 1 --2- 172.21.15.55:0/1165306670 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7f006ea10 0x7fb7f0154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:16.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.282+0000 7fb7f8537640 1 -- 172.21.15.55:0/1165306670 >> 172.21.15.55:0/1165306670 conn(0x7fb7f00cb790 msgr2=0x7fb7f00ae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:16.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.282+0000 7fb7f8537640 1 -- 172.21.15.55:0/1165306670 shutdown_connections 2023-08-25T05:18:16.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:16.282+0000 7fb7f8537640 1 -- 172.21.15.55:0/1165306670 wait complete. 2023-08-25T05:18:16.303 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1 2023-08-25T05:18:16.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:16.303 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:18:16.315 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_24_00_UTC 2023-08-25T05:18:16.315 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_25_00_UTC 2023-08-25T05:18:16.316 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_26_00_UTC 2023-08-25T05:18:16.316 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_27_00_UTC 2023-08-25T05:18:16.316 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_28_00_UTC 2023-08-25T05:18:16.316 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_29_00_UTC 2023-08-25T05:18:16.316 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_30_00_UTC 2023-08-25T05:18:16.316 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_31_00_UTC 2023-08-25T05:18:16.317 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_32_00_UTC 2023-08-25T05:18:16.317 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_33_00_UTC 2023-08-25T05:18:16.317 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_34_00_UTC 2023-08-25T05:18:16.317 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_35_00_UTC 2023-08-25T05:18:16.317 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_36_00_UTC 2023-08-25T05:18:16.317 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_37_00_UTC 2023-08-25T05:18:16.317 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_38_00_UTC 2023-08-25T05:18:16.318 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_39_00_UTC 2023-08-25T05:18:16.318 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_40_00_UTC 2023-08-25T05:18:16.318 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_41_00_UTC 2023-08-25T05:18:16.318 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_42_00_UTC 2023-08-25T05:18:16.319 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_43_00_UTC 2023-08-25T05:18:16.319 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_44_00_UTC 2023-08-25T05:18:16.319 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_45_00_UTC 2023-08-25T05:18:16.319 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_46_00_UTC 2023-08-25T05:18:16.319 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_47_00_UTC 2023-08-25T05:18:16.319 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_48_00_UTC 2023-08-25T05:18:16.319 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_49_00_UTC 2023-08-25T05:18:16.319 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_50_00_UTC 2023-08-25T05:18:16.320 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_51_00_UTC 2023-08-25T05:18:16.320 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_52_00_UTC 2023-08-25T05:18:16.320 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_53_00_UTC 2023-08-25T05:18:16.320 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_54_00_UTC 2023-08-25T05:18:16.320 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_55_00_UTC 2023-08-25T05:18:16.320 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_56_00_UTC 2023-08-25T05:18:16.320 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_57_00_UTC 2023-08-25T05:18:16.321 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_58_00_UTC 2023-08-25T05:18:16.321 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-04_59_00_UTC 2023-08-25T05:18:16.321 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_00_00_UTC 2023-08-25T05:18:16.321 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_01_00_UTC 2023-08-25T05:18:16.321 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_02_00_UTC 2023-08-25T05:18:16.321 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_03_00_UTC 2023-08-25T05:18:16.321 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_04_00_UTC 2023-08-25T05:18:16.321 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_05_00_UTC 2023-08-25T05:18:16.322 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_06_00_UTC 2023-08-25T05:18:16.322 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_07_00_UTC 2023-08-25T05:18:16.322 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_08_00_UTC 2023-08-25T05:18:16.322 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_09_00_UTC 2023-08-25T05:18:16.322 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_10_00_UTC 2023-08-25T05:18:16.323 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_11_00_UTC 2023-08-25T05:18:16.323 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_12_00_UTC 2023-08-25T05:18:16.323 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_13_00_UTC 2023-08-25T05:18:16.323 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_14_00_UTC 2023-08-25T05:18:16.323 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_15_00_UTC 2023-08-25T05:18:16.323 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_16_00_UTC 2023-08-25T05:18:16.323 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_17_00_UTC 2023-08-25T05:18:16.324 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_18_00_UTC 2023-08-25T05:18:16.324 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_24_00_UTC 2023-08-25T05:18:16.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:16.325 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_24_00_UTC) 2023-08-25T05:18:16.381 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_25_00_UTC 2023-08-25T05:18:16.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:16.382 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_25_00_UTC) 2023-08-25T05:18:16.437 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_26_00_UTC 2023-08-25T05:18:16.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:16.438 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_26_00_UTC) 2023-08-25T05:18:16.498 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_27_00_UTC 2023-08-25T05:18:16.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:16.499 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_27_00_UTC) 2023-08-25T05:18:16.556 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_28_00_UTC 2023-08-25T05:18:16.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:16.556 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_28_00_UTC) 2023-08-25T05:18:16.613 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_29_00_UTC 2023-08-25T05:18:16.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:16.614 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_29_00_UTC) 2023-08-25T05:18:16.669 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_30_00_UTC 2023-08-25T05:18:16.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:16.670 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_30_00_UTC) 2023-08-25T05:18:16.725 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_31_00_UTC 2023-08-25T05:18:16.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:16.726 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_31_00_UTC) 2023-08-25T05:18:16.781 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_32_00_UTC 2023-08-25T05:18:16.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:16.782 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_32_00_UTC) 2023-08-25T05:18:16.843 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_33_00_UTC 2023-08-25T05:18:16.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:16.844 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_33_00_UTC) 2023-08-25T05:18:16.902 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_34_00_UTC 2023-08-25T05:18:16.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:16.903 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_34_00_UTC) 2023-08-25T05:18:16.961 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_35_00_UTC 2023-08-25T05:18:16.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:16.962 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_35_00_UTC) 2023-08-25T05:18:17.017 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_36_00_UTC 2023-08-25T05:18:17.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:17.018 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_36_00_UTC) 2023-08-25T05:18:17.074 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_37_00_UTC 2023-08-25T05:18:17.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:17.075 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_37_00_UTC) 2023-08-25T05:18:17.134 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_38_00_UTC 2023-08-25T05:18:17.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:17.135 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_38_00_UTC) 2023-08-25T05:18:17.190 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_39_00_UTC 2023-08-25T05:18:17.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:17.191 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_39_00_UTC) 2023-08-25T05:18:17.250 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_40_00_UTC 2023-08-25T05:18:17.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:17.250 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_40_00_UTC) 2023-08-25T05:18:17.305 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_41_00_UTC 2023-08-25T05:18:17.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:17.306 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_41_00_UTC) 2023-08-25T05:18:17.366 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_42_00_UTC 2023-08-25T05:18:17.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:17.367 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_42_00_UTC) 2023-08-25T05:18:17.429 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_43_00_UTC 2023-08-25T05:18:17.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:17.430 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_43_00_UTC) 2023-08-25T05:18:17.489 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_44_00_UTC 2023-08-25T05:18:17.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:17.490 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_44_00_UTC) 2023-08-25T05:18:17.541 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_45_00_UTC 2023-08-25T05:18:17.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:17.542 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_45_00_UTC) 2023-08-25T05:18:17.597 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_46_00_UTC 2023-08-25T05:18:17.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:17.598 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_46_00_UTC) 2023-08-25T05:18:17.653 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_47_00_UTC 2023-08-25T05:18:17.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:17.654 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_47_00_UTC) 2023-08-25T05:18:17.709 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_48_00_UTC 2023-08-25T05:18:17.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:17.710 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_48_00_UTC) 2023-08-25T05:18:17.770 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_49_00_UTC 2023-08-25T05:18:17.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:17.771 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_49_00_UTC) 2023-08-25T05:18:17.830 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_50_00_UTC 2023-08-25T05:18:17.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:17.831 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_50_00_UTC) 2023-08-25T05:18:17.895 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_51_00_UTC 2023-08-25T05:18:17.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:17.896 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_51_00_UTC) 2023-08-25T05:18:17.953 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_52_00_UTC 2023-08-25T05:18:17.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:17.954 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_52_00_UTC) 2023-08-25T05:18:18.008 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_53_00_UTC 2023-08-25T05:18:18.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:18.009 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_53_00_UTC) 2023-08-25T05:18:18.090 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_54_00_UTC 2023-08-25T05:18:18.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:18.091 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_54_00_UTC) 2023-08-25T05:18:18.150 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_55_00_UTC 2023-08-25T05:18:18.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:18.151 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_55_00_UTC) 2023-08-25T05:18:18.206 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_56_00_UTC 2023-08-25T05:18:18.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:18.209 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_56_00_UTC) 2023-08-25T05:18:18.265 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_57_00_UTC 2023-08-25T05:18:18.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:18.266 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_57_00_UTC) 2023-08-25T05:18:18.321 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_58_00_UTC 2023-08-25T05:18:18.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:18.322 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_58_00_UTC) 2023-08-25T05:18:18.376 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-04_59_00_UTC 2023-08-25T05:18:18.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:18.377 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-04_59_00_UTC) 2023-08-25T05:18:18.432 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_00_00_UTC 2023-08-25T05:18:18.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:18.433 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_00_00_UTC) 2023-08-25T05:18:18.489 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_01_00_UTC 2023-08-25T05:18:18.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:18.489 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_01_00_UTC) 2023-08-25T05:18:18.546 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_02_00_UTC 2023-08-25T05:18:18.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:18.547 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_02_00_UTC) 2023-08-25T05:18:18.605 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_03_00_UTC 2023-08-25T05:18:18.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:18.606 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_03_00_UTC) 2023-08-25T05:18:18.661 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_04_00_UTC 2023-08-25T05:18:18.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:18.662 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_04_00_UTC) 2023-08-25T05:18:18.720 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_05_00_UTC 2023-08-25T05:18:18.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:18.721 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_05_00_UTC) 2023-08-25T05:18:18.777 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_06_00_UTC 2023-08-25T05:18:18.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:18.778 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_06_00_UTC) 2023-08-25T05:18:18.835 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_07_00_UTC 2023-08-25T05:18:18.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:18.837 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_07_00_UTC) 2023-08-25T05:18:18.901 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_08_00_UTC 2023-08-25T05:18:18.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:18.902 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_08_00_UTC) 2023-08-25T05:18:18.957 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_09_00_UTC 2023-08-25T05:18:18.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:18.958 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_09_00_UTC) 2023-08-25T05:18:19.013 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_10_00_UTC 2023-08-25T05:18:19.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:19.014 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_10_00_UTC) 2023-08-25T05:18:19.070 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_11_00_UTC 2023-08-25T05:18:19.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:19.071 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_11_00_UTC) 2023-08-25T05:18:19.140 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_12_00_UTC 2023-08-25T05:18:19.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:19.141 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_12_00_UTC) 2023-08-25T05:18:19.207 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_13_00_UTC 2023-08-25T05:18:19.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:19.208 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_13_00_UTC) 2023-08-25T05:18:19.265 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_14_00_UTC 2023-08-25T05:18:19.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:19.266 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_14_00_UTC) 2023-08-25T05:18:19.320 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_15_00_UTC 2023-08-25T05:18:19.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:19.321 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_15_00_UTC) 2023-08-25T05:18:19.381 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_16_00_UTC 2023-08-25T05:18:19.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:19.382 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_16_00_UTC) 2023-08-25T05:18:19.437 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_17_00_UTC 2023-08-25T05:18:19.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:19.438 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_17_00_UTC) 2023-08-25T05:18:19.492 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_18_00_UTC 2023-08-25T05:18:19.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:19.493 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_18_00_UTC) 2023-08-25T05:18:19.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:19.550 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-25T05:18:19.603 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-25T05:18:19.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1624396640 1 Processor -- start 2023-08-25T05:18:19.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1624396640 1 -- start start 2023-08-25T05:18:19.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1624396640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f161c06c3b0 0x7f161c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:19.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1624396640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f161c06c790 0x7f161c06de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:19.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1624396640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f161c0d1060 0x7f161c06e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:19.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1624396640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161c0cab90 con 0x7f161c06c3b0 2023-08-25T05:18:19.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1624396640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f161c06dbb0 con 0x7f161c0d1060 2023-08-25T05:18:19.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1624396640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c0cae50 con 0x7f161c06c790 2023-08-25T05:18:19.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1622132640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f161c06c3b0 0x7f161c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:19.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1622132640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f161c06c3b0 0x7f161c0cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51766/0 (socket says 172.21.15.55:51766) 2023-08-25T05:18:19.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1622132640 1 -- 172.21.15.55:0/590801501 learned_addr learned my addr 172.21.15.55:0/590801501 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:19.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1621931640 1 --2- 172.21.15.55:0/590801501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f161c06c790 0x7f161c06de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1622933640 1 --2- 172.21.15.55:0/590801501 >> v2:172.21.15.110:3300/0 conn(0x7f161c0d1060 0x7f161c06e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1622132640 1 -- 172.21.15.55:0/590801501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f161c06c790 msgr2=0x7f161c06de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1622132640 1 --2- 172.21.15.55:0/590801501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f161c06c790 0x7f161c06de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1622132640 1 -- 172.21.15.55:0/590801501 >> v2:172.21.15.110:3300/0 conn(0x7f161c0d1060 msgr2=0x7f161c06e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1622132640 1 --2- 172.21.15.55:0/590801501 >> v2:172.21.15.110:3300/0 conn(0x7f161c0d1060 0x7f161c06e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1622132640 1 -- 172.21.15.55:0/590801501 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c0cb130 con 0x7f161c06c3b0 2023-08-25T05:18:19.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.790+0000 7f1622933640 1 --2- 172.21.15.55:0/590801501 >> v2:172.21.15.110:3300/0 conn(0x7f161c0d1060 0x7f161c06e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:18:19.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.794+0000 7f1622132640 1 --2- 172.21.15.55:0/590801501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f161c06c3b0 0x7f161c0cd7d0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f161c0715a0 tx=0x7f161801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4575b9df5226254e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.794+0000 7f1621130640 1 -- 172.21.15.55:0/590801501 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180ab670 con 0x7f161c06c3b0 2023-08-25T05:18:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.794+0000 7f1621130640 1 -- 172.21.15.55:0/590801501 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16180ab7d0 con 0x7f161c06c3b0 2023-08-25T05:18:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.794+0000 7f1621130640 1 -- 172.21.15.55:0/590801501 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180abb60 con 0x7f161c06c3b0 2023-08-25T05:18:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.794+0000 7f1624396640 1 -- 172.21.15.55:0/590801501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f161c06c3b0 msgr2=0x7f161c0cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.794+0000 7f1624396640 1 --2- 172.21.15.55:0/590801501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f161c06c3b0 0x7f161c0cd7d0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f161c0715a0 tx=0x7f161801c490 comp rx=0 tx=0).stop 2023-08-25T05:18:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.794+0000 7f1624396640 1 -- 172.21.15.55:0/590801501 shutdown_connections 2023-08-25T05:18:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.794+0000 7f1624396640 1 --2- 172.21.15.55:0/590801501 >> v2:172.21.15.110:3300/0 conn(0x7f161c0d1060 0x7f161c06e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.794+0000 7f1624396640 1 --2- 172.21.15.55:0/590801501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f161c06c790 0x7f161c06de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.794+0000 7f1624396640 1 --2- 172.21.15.55:0/590801501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f161c06c3b0 0x7f161c0cd7d0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.794+0000 7f1624396640 1 -- 172.21.15.55:0/590801501 >> 172.21.15.55:0/590801501 conn(0x7f161c0d0540 msgr2=0x7f161c0d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.794+0000 7f1624396640 1 -- 172.21.15.55:0/590801501 shutdown_connections 2023-08-25T05:18:19.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.794+0000 7f1624396640 1 -- 172.21.15.55:0/590801501 wait complete. 2023-08-25T05:18:19.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.794+0000 7f1624396640 1 Processor -- start 2023-08-25T05:18:19.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1624396640 1 -- start start 2023-08-25T05:18:19.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1624396640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f161c06c3b0 0x7f161c14da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1624396640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f161c06c790 0x7f161c0cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1624396640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f161c0d1060 0x7f161c15f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1624396640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c14df80 con 0x7f161c06c790 2023-08-25T05:18:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1624396640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161c138f20 con 0x7f161c0d1060 2023-08-25T05:18:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1624396640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161c138310 con 0x7f161c06c3b0 2023-08-25T05:18:19.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1621931640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f161c06c790 0x7f161c0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1621931640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f161c06c790 0x7f161c0cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51780/0 (socket says 172.21.15.55:51780) 2023-08-25T05:18:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1621931640 1 -- 172.21.15.55:0/3636860322 learned_addr learned my addr 172.21.15.55:0/3636860322 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1622933640 1 --2- 172.21.15.55:0/3636860322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f161c0d1060 0x7f161c15f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1622132640 1 --2- 172.21.15.55:0/3636860322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f161c06c3b0 0x7f161c14da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1621931640 1 -- 172.21.15.55:0/3636860322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f161c06c3b0 msgr2=0x7f161c14da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1621931640 1 --2- 172.21.15.55:0/3636860322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f161c06c3b0 0x7f161c14da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:19.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1621931640 1 -- 172.21.15.55:0/3636860322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f161c0d1060 msgr2=0x7f161c15f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1621931640 1 --2- 172.21.15.55:0/3636860322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f161c0d1060 0x7f161c15f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1621931640 1 -- 172.21.15.55:0/3636860322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1618009480 con 0x7f161c06c790 2023-08-25T05:18:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1622933640 1 --2- 172.21.15.55:0/3636860322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f161c0d1060 0x7f161c15f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1621931640 1 --2- 172.21.15.55:0/3636860322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f161c06c790 0x7f161c0cb830 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f160c00d7d0 tx=0x7f160c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1612ffd640 1 -- 172.21.15.55:0/3636860322 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c0096a0 con 0x7f161c06c790 2023-08-25T05:18:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1612ffd640 1 -- 172.21.15.55:0/3636860322 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160c009800 con 0x7f161c06c790 2023-08-25T05:18:19.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1624396640 1 -- 172.21.15.55:0/3636860322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161c1385f0 con 0x7f161c06c790 2023-08-25T05:18:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1612ffd640 1 -- 172.21.15.55:0/3636860322 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c009bb0 con 0x7f161c06c790 2023-08-25T05:18:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1624396640 1 -- 172.21.15.55:0/3636860322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f161c138bb0 con 0x7f161c06c790 2023-08-25T05:18:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.798+0000 7f1624396640 1 -- 172.21.15.55:0/3636860322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f161c1390b0 con 0x7f161c06c790 2023-08-25T05:18:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.802+0000 7f1612ffd640 1 -- 172.21.15.55:0/3636860322 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 74) v1 ==== 85093+0+0 (secure 0 0 0) 0x7f160c009d10 con 0x7f161c06c790 2023-08-25T05:18:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.802+0000 7f1612ffd640 1 --2- 172.21.15.55:0/3636860322 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f16000657f0 0x7f1600067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.802+0000 7f1612ffd640 1 -- 172.21.15.55:0/3636860322 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6494+0+0 (secure 0 0 0) 0x7f160c0836a0 con 0x7f161c06c790 2023-08-25T05:18:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.802+0000 7f1622132640 1 --2- 172.21.15.55:0/3636860322 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f16000657f0 0x7f1600067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.802+0000 7f1622132640 1 --2- 172.21.15.55:0/3636860322 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f16000657f0 0x7f1600067cb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f16180af000 tx=0x7f16180a7000 comp rx=0 tx=0).ready entity=mgr.7616 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:19.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:19.806+0000 7f1612ffd640 1 -- 172.21.15.55:0/3636860322 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f160c054920 con 0x7f161c06c790 2023-08-25T05:18:20.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:20.042+0000 7f1624396640 1 -- 172.21.15.55:0/3636860322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f161c073ec0 con 0x7f161c06c790 2023-08-25T05:18:20.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:20.862+0000 7f1612ffd640 1 -- 172.21.15.55:0/3636860322 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 75) v1 ==== 85076+0+0 (secure 0 0 0) 0x7f160c051260 con 0x7f161c06c790 2023-08-25T05:18:20.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:20.866+0000 7f1612ffd640 1 -- 172.21.15.55:0/3636860322 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v75) v1 ==== 93+0+0 (secure 0 0 0) 0x7f160c054920 con 0x7f161c06c790 2023-08-25T05:18:20.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:20.870+0000 7f1624396640 1 -- 172.21.15.55:0/3636860322 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f16000657f0 msgr2=0x7f1600067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:20.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:20.870+0000 7f1624396640 1 --2- 172.21.15.55:0/3636860322 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f16000657f0 0x7f1600067cb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f16180af000 tx=0x7f16180a7000 comp rx=0 tx=0).stop 2023-08-25T05:18:20.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:20.870+0000 7f1624396640 1 -- 172.21.15.55:0/3636860322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f161c06c790 msgr2=0x7f161c0cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:20.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:20.870+0000 7f1624396640 1 --2- 172.21.15.55:0/3636860322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f161c06c790 0x7f161c0cb830 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f160c00d7d0 tx=0x7f160c00dc90 comp rx=0 tx=0).stop 2023-08-25T05:18:20.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:20.870+0000 7f1624396640 1 -- 172.21.15.55:0/3636860322 shutdown_connections 2023-08-25T05:18:20.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:20.870+0000 7f1624396640 1 --2- 172.21.15.55:0/3636860322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f161c0d1060 0x7f161c15f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:20.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:20.870+0000 7f1624396640 1 --2- 172.21.15.55:0/3636860322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f161c06c790 0x7f161c0cb830 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:20.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:20.870+0000 7f1624396640 1 --2- 172.21.15.55:0/3636860322 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f16000657f0 0x7f1600067cb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:20.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:20.870+0000 7f1624396640 1 --2- 172.21.15.55:0/3636860322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f161c06c3b0 0x7f161c14da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:20.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:20.870+0000 7f1624396640 1 -- 172.21.15.55:0/3636860322 >> 172.21.15.55:0/3636860322 conn(0x7f161c0d0540 msgr2=0x7f161c157820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:20.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:20.870+0000 7f1624396640 1 -- 172.21.15.55:0/3636860322 shutdown_connections 2023-08-25T05:18:20.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:20.870+0000 7f1624396640 1 -- 172.21.15.55:0/3636860322 wait complete. 2023-08-25T05:18:20.903 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T05:18:20.904 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T05:18:20.966 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T05:18:21.019 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T05:18:21.020 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:18:21.020 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:18:21.031 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:18:21.032 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:18:21.062 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:21.058+0000 7f57e32fb180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:18:21.072 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:18:21.074 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:21.075+0000 7f8eeec2c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:18:21.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.262+0000 7f0afbae5640 1 Processor -- start 2023-08-25T05:18:21.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.266+0000 7f0afbae5640 1 -- start start 2023-08-25T05:18:21.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.266+0000 7f0afbae5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40d0da0 0x7f0af40d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:21.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.266+0000 7f0afbae5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0af40cdde0 0x7f0af40ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:21.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.266+0000 7f0afbae5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0af40cee60 0x7f0af40cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:21.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.266+0000 7f0afbae5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af40ce760 con 0x7f0af40cdde0 2023-08-25T05:18:21.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.266+0000 7f0afbae5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af40b29b0 con 0x7f0af40cee60 2023-08-25T05:18:21.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.266+0000 7f0afbae5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af40d16c0 con 0x7f0af40d0da0 2023-08-25T05:18:21.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.266+0000 7f0af9080640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0af40cdde0 0x7f0af40ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:21.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.266+0000 7f0af9080640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0af40cdde0 0x7f0af40ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44860/0 (socket says 172.21.15.55:44860) 2023-08-25T05:18:21.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.266+0000 7f0af9080640 1 -- 172.21.15.55:0/2889403864 learned_addr learned my addr 172.21.15.55:0/2889403864 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:21.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.266+0000 7f0afa082640 1 --2- 172.21.15.55:0/2889403864 >> v2:172.21.15.110:3300/0 conn(0x7f0af40cee60 0x7f0af40cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:21.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.266+0000 7f0af9881640 1 --2- 172.21.15.55:0/2889403864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40d0da0 0x7f0af40d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:21.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.266+0000 7f0af9080640 1 -- 172.21.15.55:0/2889403864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40d0da0 msgr2=0x7f0af40d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:21.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.266+0000 7f0af9080640 1 --2- 172.21.15.55:0/2889403864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40d0da0 0x7f0af40d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.266+0000 7f0af9080640 1 -- 172.21.15.55:0/2889403864 >> v2:172.21.15.110:3300/0 conn(0x7f0af40cee60 msgr2=0x7f0af40cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:21.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.266+0000 7f0af9080640 1 --2- 172.21.15.55:0/2889403864 >> v2:172.21.15.110:3300/0 conn(0x7f0af40cee60 0x7f0af40cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.266+0000 7f0af9080640 1 -- 172.21.15.55:0/2889403864 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af40b1dc0 con 0x7f0af40cdde0 2023-08-25T05:18:21.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.270+0000 7f0af9080640 1 --2- 172.21.15.55:0/2889403864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40cdde0 0x7f0af40ce220 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f0af40b1bd0 tx=0x7f0ae401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce75c36bf143ffb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:21.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.270+0000 7f0af887f640 1 -- 172.21.15.55:0/2889403864 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40a89b0 con 0x7f0af40cdde0 2023-08-25T05:18:21.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.270+0000 7f0af887f640 1 -- 172.21.15.55:0/2889403864 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae40a8b10 con 0x7f0af40cdde0 2023-08-25T05:18:21.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.270+0000 7f0af887f640 1 -- 172.21.15.55:0/2889403864 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40a8ea0 con 0x7f0af40cdde0 2023-08-25T05:18:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.270+0000 7f0afbae5640 1 -- 172.21.15.55:0/2889403864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40cdde0 msgr2=0x7f0af40ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.270+0000 7f0afbae5640 1 --2- 172.21.15.55:0/2889403864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40cdde0 0x7f0af40ce220 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f0af40b1bd0 tx=0x7f0ae401ecf0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.270+0000 7f0afbae5640 1 -- 172.21.15.55:0/2889403864 shutdown_connections 2023-08-25T05:18:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.270+0000 7f0afbae5640 1 --2- 172.21.15.55:0/2889403864 >> v2:172.21.15.110:3300/0 conn(0x7f0af40cee60 0x7f0af40cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.270+0000 7f0afbae5640 1 --2- 172.21.15.55:0/2889403864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40cdde0 0x7f0af40ce220 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.270+0000 7f0afbae5640 1 --2- 172.21.15.55:0/2889403864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40d0da0 0x7f0af40d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.270+0000 7f0afbae5640 1 -- 172.21.15.55:0/2889403864 >> 172.21.15.55:0/2889403864 conn(0x7f0af409bae0 msgr2=0x7f0af40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.270+0000 7f0afbae5640 1 -- 172.21.15.55:0/2889403864 shutdown_connections 2023-08-25T05:18:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.270+0000 7f0afbae5640 1 -- 172.21.15.55:0/2889403864 wait complete. 2023-08-25T05:18:21.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.270+0000 7f0afbae5640 1 Processor -- start 2023-08-25T05:18:21.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.270+0000 7f0afbae5640 1 -- start start 2023-08-25T05:18:21.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0afbae5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40cdde0 0x7f0af4151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:21.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0afbae5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0af40cee60 0x7f0af40b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:21.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0afbae5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40d0da0 0x7f0af415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:21.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0afbae5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af40b57c0 con 0x7f0af40cdde0 2023-08-25T05:18:21.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0afbae5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af40b5aa0 con 0x7f0af40cee60 2023-08-25T05:18:21.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0afbae5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af40b5d80 con 0x7f0af40d0da0 2023-08-25T05:18:21.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0af9881640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40cdde0 0x7f0af4151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:21.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0af9881640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40cdde0 0x7f0af4151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44868/0 (socket says 172.21.15.55:44868) 2023-08-25T05:18:21.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0af9881640 1 -- 172.21.15.55:0/2786650864 learned_addr learned my addr 172.21.15.55:0/2786650864 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:21.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0af9080640 1 --2- 172.21.15.55:0/2786650864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0af40cee60 0x7f0af40b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:21.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0afa082640 1 --2- 172.21.15.55:0/2786650864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40d0da0 0x7f0af415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:21.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0af9881640 1 -- 172.21.15.55:0/2786650864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40d0da0 msgr2=0x7f0af415aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:21.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0af9881640 1 --2- 172.21.15.55:0/2786650864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40d0da0 0x7f0af415aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0af9881640 1 -- 172.21.15.55:0/2786650864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0af40cee60 msgr2=0x7f0af40b6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:21.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0af9881640 1 --2- 172.21.15.55:0/2786650864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0af40cee60 0x7f0af40b6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0af9881640 1 -- 172.21.15.55:0/2786650864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae40094d0 con 0x7f0af40cdde0 2023-08-25T05:18:21.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0af9881640 1 --2- 172.21.15.55:0/2786650864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40cdde0 0x7f0af4151bb0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f0af000d800 tx=0x7f0af000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:21.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0aea7fc640 1 -- 172.21.15.55:0/2786650864 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0018070 con 0x7f0af40cdde0 2023-08-25T05:18:21.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0aea7fc640 1 -- 172.21.15.55:0/2786650864 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af00059a0 con 0x7f0af40cdde0 2023-08-25T05:18:21.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0aea7fc640 1 -- 172.21.15.55:0/2786650864 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af0005b50 con 0x7f0af40cdde0 2023-08-25T05:18:21.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0afbae5640 1 -- 172.21.15.55:0/2786650864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af40b6060 con 0x7f0af40cdde0 2023-08-25T05:18:21.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0afbae5640 1 -- 172.21.15.55:0/2786650864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af40b53e0 con 0x7f0af40cdde0 2023-08-25T05:18:21.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.274+0000 7f0afbae5640 1 -- 172.21.15.55:0/2786650864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af404dbe0 con 0x7f0af40cdde0 2023-08-25T05:18:21.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.278+0000 7f0aea7fc640 1 -- 172.21.15.55:0/2786650864 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 75) v1 ==== 85076+0+0 (secure 0 0 0) 0x7f0af0005cb0 con 0x7f0af40cdde0 2023-08-25T05:18:21.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.278+0000 7f0aea7fc640 1 --2- 172.21.15.55:0/2786650864 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f0ad80657a0 0x7f0ad8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:21.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.278+0000 7f0aea7fc640 1 -- 172.21.15.55:0/2786650864 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6494+0+0 (secure 0 0 0) 0x7f0af00830f0 con 0x7f0af40cdde0 2023-08-25T05:18:21.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.278+0000 7f0af9080640 1 -- 172.21.15.55:0/2786650864 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f0ad80657a0 msgr2=0x7f0ad8067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3538591338 2023-08-25T05:18:21.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.278+0000 7f0af9080640 1 --2- 172.21.15.55:0/2786650864 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f0ad80657a0 0x7f0ad8067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:18:21.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.286+0000 7f0aea7fc640 1 -- 172.21.15.55:0/2786650864 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0af0054300 con 0x7f0af40cdde0 2023-08-25T05:18:21.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.446+0000 7f0afbae5640 1 -- 172.21.15.55:0/2786650864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0af40d0b80 con 0x7f0af40cdde0 2023-08-25T05:18:21.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.450+0000 7f0aea7fc640 1 -- 172.21.15.55:0/2786650864 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+19044 (secure 0 0 0) 0x7f0af0053e90 con 0x7f0af40cdde0 2023-08-25T05:18:21.453 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:21.453 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":143,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:18:20.851741+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:22:22.099798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-25T04:22:23.329827+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":112,"snap_epoch":143,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6833/3700713436":"2023-08-26T04:22:41.515664+0000","172.21.15.110:6832/3700713436":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/789108415":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/3185722269":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/452038739":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/327450935":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/3135214366":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/2514341378":"2023-08-26T04:22:41.515664+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":3,"length":54},{"begin":59,"length":54}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":49,"length":8},{"begin":105,"length":8}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:18:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.450+0000 7f0afbae5640 1 -- 172.21.15.55:0/2786650864 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f0ad80657a0 msgr2=0x7f0ad8067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:18:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.450+0000 7f0afbae5640 1 --2- 172.21.15.55:0/2786650864 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f0ad80657a0 0x7f0ad8067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.450+0000 7f0afbae5640 1 -- 172.21.15.55:0/2786650864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40cdde0 msgr2=0x7f0af4151bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.450+0000 7f0afbae5640 1 --2- 172.21.15.55:0/2786650864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40cdde0 0x7f0af4151bb0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f0af000d800 tx=0x7f0af000dcc0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.450+0000 7f0afbae5640 1 -- 172.21.15.55:0/2786650864 shutdown_connections 2023-08-25T05:18:21.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.450+0000 7f0afbae5640 1 --2- 172.21.15.55:0/2786650864 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f0ad80657a0 0x7f0ad8067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.450+0000 7f0afbae5640 1 --2- 172.21.15.55:0/2786650864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0af40d0da0 0x7f0af415aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.450+0000 7f0afbae5640 1 --2- 172.21.15.55:0/2786650864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0af40cee60 0x7f0af40b6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.450+0000 7f0afbae5640 1 --2- 172.21.15.55:0/2786650864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0af40cdde0 0x7f0af4151bb0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.450+0000 7f0afbae5640 1 -- 172.21.15.55:0/2786650864 >> 172.21.15.55:0/2786650864 conn(0x7f0af409bae0 msgr2=0x7f0af406c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:21.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.450+0000 7f0afbae5640 1 -- 172.21.15.55:0/2786650864 shutdown_connections 2023-08-25T05:18:21.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.450+0000 7f0afbae5640 1 -- 172.21.15.55:0/2786650864 wait complete. 2023-08-25T05:18:21.475 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:22:22.099798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:22:23.329827+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 112, 'snap_epoch': 143, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T05:18:21.477 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T05:18:21.490 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:21.491+0000 7f8eeec2c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:18:21.516 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:21.514+0000 7f57e32fb180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:18:21.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.646+0000 7ff3f6374640 1 Processor -- start 2023-08-25T05:18:21.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.646+0000 7ff3f6374640 1 -- start start 2023-08-25T05:18:21.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.650+0000 7ff3f6374640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff3f01596d0 0x7ff3f015d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:21.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.650+0000 7ff3f6374640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f015a1c0 con 0x7ff3f00cac10 2023-08-25T05:18:21.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.650+0000 7ff3f6374640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f015a410 con 0x7ff3f00cdc10 2023-08-25T05:18:21.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.650+0000 7ff3f6374640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f015a6f0 con 0x7ff3f01596d0 2023-08-25T05:18:21.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.650+0000 7ff3effff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff3f01596d0 0x7ff3f015d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:21.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.650+0000 7ff3effff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff3f01596d0 0x7ff3f015d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:57604/0 (socket says 172.21.15.55:57604) 2023-08-25T05:18:21.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.650+0000 7ff3effff640 1 -- 172.21.15.55:0/1655977841 learned_addr learned my addr 172.21.15.55:0/1655977841 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:21.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.650+0000 7ff3effff640 1 -- 172.21.15.55:0/1655977841 >> v1:172.21.15.110:6789/0 conn(0x7ff3f00cdc10 legacy=0x7ff3f0159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:21.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.650+0000 7ff3effff640 1 -- 172.21.15.55:0/1655977841 >> v1:172.21.15.55:6789/0 conn(0x7ff3f00cac10 legacy=0x7ff3f0070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:21.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.650+0000 7ff3effff640 1 -- 172.21.15.55:0/1655977841 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f015a9d0 con 0x7ff3f01596d0 2023-08-25T05:18:21.654 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:21.655+0000 7f8eeec2c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:18:21.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.654+0000 7ff3effff640 1 --2- 172.21.15.55:0/1655977841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3f01596d0 0x7ff3f015d9c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0009870 tx=0x7ff3e001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c81b91c473930e0d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:21.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.654+0000 7ff3ef7fe640 1 -- 172.21.15.55:0/1655977841 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e00ac630 con 0x7ff3f01596d0 2023-08-25T05:18:21.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.654+0000 7ff3ef7fe640 1 -- 172.21.15.55:0/1655977841 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e00ac790 con 0x7ff3f01596d0 2023-08-25T05:18:21.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.654+0000 7ff3ef7fe640 1 -- 172.21.15.55:0/1655977841 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e00ac630 con 0x7ff3f01596d0 2023-08-25T05:18:21.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.658+0000 7ff3f6374640 1 -- 172.21.15.55:0/1655977841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3f01596d0 msgr2=0x7ff3f015d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:21.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.658+0000 7ff3f6374640 1 --2- 172.21.15.55:0/1655977841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3f01596d0 0x7ff3f015d9c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0009870 tx=0x7ff3e001c4d0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.658+0000 7ff3f6374640 1 -- 172.21.15.55:0/1655977841 shutdown_connections 2023-08-25T05:18:21.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.658+0000 7ff3f6374640 1 --2- 172.21.15.55:0/1655977841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3f01596d0 0x7ff3f015d9c0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.658+0000 7ff3f6374640 1 -- 172.21.15.55:0/1655977841 >> 172.21.15.55:0/1655977841 conn(0x7ff3f006b990 msgr2=0x7ff3f006bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:21.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.658+0000 7ff3f6374640 1 -- 172.21.15.55:0/1655977841 shutdown_connections 2023-08-25T05:18:21.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.658+0000 7ff3f6374640 1 -- 172.21.15.55:0/1655977841 wait complete. 2023-08-25T05:18:21.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.658+0000 7ff3f6374640 1 Processor -- start 2023-08-25T05:18:21.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3f6374640 1 -- start start 2023-08-25T05:18:21.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3f6374640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3f00cac10 0x7ff3f0150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:21.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3f6374640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3f00cdc10 0x7ff3f01476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:21.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3f6374640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3f01596d0 0x7ff3f0151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:21.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3f6374640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f014b860 con 0x7ff3f01596d0 2023-08-25T05:18:21.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3f6374640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f0150bc0 con 0x7ff3f00cdc10 2023-08-25T05:18:21.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3f6374640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f0150ea0 con 0x7ff3f00cac10 2023-08-25T05:18:21.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3e77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3f00cdc10 0x7ff3f01476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:21.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3e77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3f00cdc10 0x7ff3f01476d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:57620/0 (socket says 172.21.15.55:57620) 2023-08-25T05:18:21.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3e77fe640 1 -- 172.21.15.55:0/3929518287 learned_addr learned my addr 172.21.15.55:0/3929518287 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:21.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3effff640 1 --2- 172.21.15.55:0/3929518287 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3f00cac10 0x7ff3f0150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:21.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3f4911640 1 --2- 172.21.15.55:0/3929518287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3f01596d0 0x7ff3f0151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:21.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3effff640 1 -- 172.21.15.55:0/3929518287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3f00cdc10 msgr2=0x7ff3f01476d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:21.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3effff640 1 --2- 172.21.15.55:0/3929518287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3f00cdc10 0x7ff3f01476d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3effff640 1 -- 172.21.15.55:0/3929518287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3f01596d0 msgr2=0x7ff3f0151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:21.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3effff640 1 --2- 172.21.15.55:0/3929518287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3f01596d0 0x7ff3f0151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3effff640 1 -- 172.21.15.55:0/3929518287 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e00094d0 con 0x7ff3f00cac10 2023-08-25T05:18:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3f4911640 1 --2- 172.21.15.55:0/3929518287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3f01596d0 0x7ff3f0151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3e77fe640 1 --2- 172.21.15.55:0/3929518287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3f00cdc10 0x7ff3f01476d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:18:21.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.662+0000 7ff3effff640 1 --2- 172.21.15.55:0/3929518287 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3f00cac10 0x7ff3f0150060 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00ac000 tx=0x7ff3e0019270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.666+0000 7ff3ed7fa640 1 -- 172.21.15.55:0/3929518287 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e00bd070 con 0x7ff3f00cac10 2023-08-25T05:18:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.666+0000 7ff3ed7fa640 1 -- 172.21.15.55:0/3929518287 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e00ab7e0 con 0x7ff3f00cac10 2023-08-25T05:18:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.666+0000 7ff3f6374640 1 -- 172.21.15.55:0/3929518287 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f0151180 con 0x7ff3f00cac10 2023-08-25T05:18:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.666+0000 7ff3ed7fa640 1 -- 172.21.15.55:0/3929518287 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e00ac630 con 0x7ff3f00cac10 2023-08-25T05:18:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.666+0000 7ff3f6374640 1 -- 172.21.15.55:0/3929518287 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f0151740 con 0x7ff3f00cac10 2023-08-25T05:18:21.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.666+0000 7ff3f6374640 1 -- 172.21.15.55:0/3929518287 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f015dec0 con 0x7ff3f00cac10 2023-08-25T05:18:21.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.666+0000 7ff3ed7fa640 1 -- 172.21.15.55:0/3929518287 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 75) v1 ==== 85076+0+0 (secure 0 0 0) 0x7ff3e00b3040 con 0x7ff3f00cac10 2023-08-25T05:18:21.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.666+0000 7ff3ed7fa640 1 --2- 172.21.15.55:0/3929518287 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7ff3d00657a0 0x7ff3d0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:21.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.666+0000 7ff3ed7fa640 1 -- 172.21.15.55:0/3929518287 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6494+0+0 (secure 0 0 0) 0x7ff3e011cda0 con 0x7ff3f00cac10 2023-08-25T05:18:21.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.666+0000 7ff3e77fe640 1 -- 172.21.15.55:0/3929518287 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7ff3d00657a0 msgr2=0x7ff3d0067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3538591338 2023-08-25T05:18:21.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.666+0000 7ff3e77fe640 1 --2- 172.21.15.55:0/3929518287 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7ff3d00657a0 0x7ff3d0067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:18:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.670+0000 7ff3ed7fa640 1 -- 172.21.15.55:0/3929518287 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff3e00ea590 con 0x7ff3f00cac10 2023-08-25T05:18:21.721 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:21.718+0000 7f57e32fb180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:18:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.838+0000 7ff3f6374640 1 -- 172.21.15.55:0/3929518287 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3f0151930 con 0x7ff3f00cac10 2023-08-25T05:18:21.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.838+0000 7ff3ed7fa640 1 -- 172.21.15.55:0/3929518287 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v143) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff3e00a80a0 con 0x7ff3f00cac10 2023-08-25T05:18:21.841 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T05:18:21.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.842+0000 7ff3f6374640 1 -- 172.21.15.55:0/3929518287 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7ff3d00657a0 msgr2=0x7ff3d0067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:18:21.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.842+0000 7ff3f6374640 1 --2- 172.21.15.55:0/3929518287 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7ff3d00657a0 0x7ff3d0067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.842+0000 7ff3f6374640 1 -- 172.21.15.55:0/3929518287 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3f00cac10 msgr2=0x7ff3f0150060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:21.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.842+0000 7ff3f6374640 1 --2- 172.21.15.55:0/3929518287 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3f00cac10 0x7ff3f0150060 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff3e00ac000 tx=0x7ff3e0019270 comp rx=0 tx=0).stop 2023-08-25T05:18:21.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.842+0000 7ff3f6374640 1 -- 172.21.15.55:0/3929518287 shutdown_connections 2023-08-25T05:18:21.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.842+0000 7ff3f6374640 1 --2- 172.21.15.55:0/3929518287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3f01596d0 0x7ff3f0151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.842+0000 7ff3f6374640 1 --2- 172.21.15.55:0/3929518287 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3f00cdc10 0x7ff3f01476d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.842+0000 7ff3f6374640 1 --2- 172.21.15.55:0/3929518287 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7ff3d00657a0 0x7ff3d0067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.842+0000 7ff3f6374640 1 --2- 172.21.15.55:0/3929518287 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3f00cac10 0x7ff3f0150060 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:21.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.842+0000 7ff3f6374640 1 -- 172.21.15.55:0/3929518287 >> 172.21.15.55:0/3929518287 conn(0x7ff3f006b990 msgr2=0x7ff3f0070170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:21.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.842+0000 7ff3f6374640 1 -- 172.21.15.55:0/3929518287 shutdown_connections 2023-08-25T05:18:21.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:21.842+0000 7ff3f6374640 1 -- 172.21.15.55:0/3929518287 wait complete. 2023-08-25T05:18:21.864 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T05:18:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.050+0000 7f22464bc640 1 Processor -- start 2023-08-25T05:18:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.050+0000 7f22464bc640 1 -- start start 2023-08-25T05:18:22.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.054+0000 7f22464bc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f224015fca0 0x7f22400cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:22.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.054+0000 7f22464bc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f22400b8330 0x7f22400cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:22.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.054+0000 7f22464bc640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22400b70c0 con 0x7f22400d0bd0 2023-08-25T05:18:22.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.054+0000 7f22464bc640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2240160080 con 0x7f224015fca0 2023-08-25T05:18:22.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.054+0000 7f22464bc640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22400b73a0 con 0x7f22400b8330 2023-08-25T05:18:22.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.054+0000 7f22454ba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f224015fca0 0x7f22400cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:22.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.054+0000 7f22454ba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f224015fca0 0x7f22400cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44890/0 (socket says 172.21.15.55:44890) 2023-08-25T05:18:22.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.054+0000 7f22454ba640 1 -- 172.21.15.55:0/2786169862 learned_addr learned my addr 172.21.15.55:0/2786169862 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:22.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.054+0000 7f2244cb9640 1 --2- 172.21.15.55:0/2786169862 >> v2:172.21.15.110:3300/0 conn(0x7f22400b8330 0x7f22400cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:22.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.054+0000 7f22454ba640 1 -- 172.21.15.55:0/2786169862 >> v2:172.21.15.110:3300/0 conn(0x7f22400b8330 msgr2=0x7f22400cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:22.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.054+0000 7f22454ba640 1 --2- 172.21.15.55:0/2786169862 >> v2:172.21.15.110:3300/0 conn(0x7f22400b8330 0x7f22400cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.054+0000 7f22454ba640 1 -- 172.21.15.55:0/2786169862 >> v1:172.21.15.110:6789/0 conn(0x7f22400d0bd0 legacy=0x7f22400d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.054+0000 7f22454ba640 1 -- 172.21.15.55:0/2786169862 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22400b7680 con 0x7f224015fca0 2023-08-25T05:18:22.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f22454ba640 1 --2- 172.21.15.55:0/2786169862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224015fca0 0x7f22400cf580 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f22400b4170 tx=0x7f223c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e613d192a602719 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:22.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f2237fff640 1 -- 172.21.15.55:0/2786169862 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c0a89f0 con 0x7f224015fca0 2023-08-25T05:18:22.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f2237fff640 1 -- 172.21.15.55:0/2786169862 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c0a8b50 con 0x7f224015fca0 2023-08-25T05:18:22.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f2237fff640 1 -- 172.21.15.55:0/2786169862 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c0b0440 con 0x7f224015fca0 2023-08-25T05:18:22.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f22464bc640 1 -- 172.21.15.55:0/2786169862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224015fca0 msgr2=0x7f22400cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:22.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f22464bc640 1 --2- 172.21.15.55:0/2786169862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224015fca0 0x7f22400cf580 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f22400b4170 tx=0x7f223c01ecf0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f22464bc640 1 -- 172.21.15.55:0/2786169862 shutdown_connections 2023-08-25T05:18:22.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f22464bc640 1 --2- 172.21.15.55:0/2786169862 >> v2:172.21.15.110:3300/0 conn(0x7f22400b8330 0x7f22400cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f22464bc640 1 --2- 172.21.15.55:0/2786169862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f224015fca0 0x7f22400cf580 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f22464bc640 1 -- 172.21.15.55:0/2786169862 >> 172.21.15.55:0/2786169862 conn(0x7f22400658c0 msgr2=0x7f2240065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:22.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f22464bc640 1 -- 172.21.15.55:0/2786169862 shutdown_connections 2023-08-25T05:18:22.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f22464bc640 1 -- 172.21.15.55:0/2786169862 wait complete. 2023-08-25T05:18:22.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f22464bc640 1 Processor -- start 2023-08-25T05:18:22.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f22464bc640 1 -- start start 2023-08-25T05:18:22.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f22464bc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22400b8330 0x7f22400c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:22.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f22464bc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22400d0bd0 0x7f22400c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:22.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f22464bc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f224015fca0 0x7f22400c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:22.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f22464bc640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2240157b60 con 0x7f22400b8330 2023-08-25T05:18:22.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.058+0000 7f22464bc640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22400ca2d0 con 0x7f224015fca0 2023-08-25T05:18:22.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f22464bc640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22400ca5b0 con 0x7f22400d0bd0 2023-08-25T05:18:22.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f22454ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22400b8330 0x7f22400c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:22.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f22454ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22400b8330 0x7f22400c50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44898/0 (socket says 172.21.15.55:44898) 2023-08-25T05:18:22.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f22454ba640 1 -- 172.21.15.55:0/3769672656 learned_addr learned my addr 172.21.15.55:0/3769672656 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:22.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f2245cbb640 1 --2- 172.21.15.55:0/3769672656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f224015fca0 0x7f22400c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:22.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f2244cb9640 1 --2- 172.21.15.55:0/3769672656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22400d0bd0 0x7f22400c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:22.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f22454ba640 1 -- 172.21.15.55:0/3769672656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22400d0bd0 msgr2=0x7f22400c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:22.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f22454ba640 1 --2- 172.21.15.55:0/3769672656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22400d0bd0 0x7f22400c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f22454ba640 1 -- 172.21.15.55:0/3769672656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f224015fca0 msgr2=0x7f22400c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:22.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f22454ba640 1 --2- 172.21.15.55:0/3769672656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f224015fca0 0x7f22400c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f22454ba640 1 -- 172.21.15.55:0/3769672656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c0094d0 con 0x7f22400b8330 2023-08-25T05:18:22.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f22454ba640 1 --2- 172.21.15.55:0/3769672656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22400b8330 0x7f22400c50c0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f223c01b900 tx=0x7f223c01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:22.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f2235ffb640 1 -- 172.21.15.55:0/3769672656 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c0ba600 con 0x7f22400b8330 2023-08-25T05:18:22.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f2235ffb640 1 -- 172.21.15.55:0/3769672656 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c0ba760 con 0x7f22400b8330 2023-08-25T05:18:22.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f2235ffb640 1 -- 172.21.15.55:0/3769672656 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c0bab10 con 0x7f22400b8330 2023-08-25T05:18:22.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f22464bc640 1 -- 172.21.15.55:0/3769672656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22401f2d80 con 0x7f22400b8330 2023-08-25T05:18:22.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f22464bc640 1 -- 172.21.15.55:0/3769672656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22400ca890 con 0x7f22400b8330 2023-08-25T05:18:22.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f22464bc640 1 -- 172.21.15.55:0/3769672656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2240073e50 con 0x7f22400b8330 2023-08-25T05:18:22.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.062+0000 7f2235ffb640 1 -- 172.21.15.55:0/3769672656 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 75) v1 ==== 85076+0+0 (secure 0 0 0) 0x7f223c0bac70 con 0x7f22400b8330 2023-08-25T05:18:22.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.066+0000 7f2235ffb640 1 --2- 172.21.15.55:0/3769672656 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f22240657a0 0x7f2224067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:22.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.066+0000 7f2235ffb640 1 -- 172.21.15.55:0/3769672656 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6494+0+0 (secure 0 0 0) 0x7f223c1215a0 con 0x7f22400b8330 2023-08-25T05:18:22.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.066+0000 7f2244cb9640 1 -- 172.21.15.55:0/3769672656 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f22240657a0 msgr2=0x7f2224067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3538591338 2023-08-25T05:18:22.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.066+0000 7f2244cb9640 1 --2- 172.21.15.55:0/3769672656 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f22240657a0 0x7f2224067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:18:22.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.070+0000 7f2235ffb640 1 -- 172.21.15.55:0/3769672656 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f223c0eedb0 con 0x7f22400b8330 2023-08-25T05:18:22.154 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:22.155+0000 7f8eeec2c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:18:22.213 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:22.211+0000 7f8eeec2c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:18:22.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.238+0000 7f22464bc640 1 -- 172.21.15.55:0/3769672656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f22400b8110 con 0x7f22400b8330 2023-08-25T05:18:22.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.238+0000 7f2235ffb640 1 -- 172.21.15.55:0/3769672656 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v143) v1 ==== 92+0+10 (secure 0 0 0) 0x7f223c0f23d0 con 0x7f22400b8330 2023-08-25T05:18:22.242 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T05:18:22.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.242+0000 7f22464bc640 1 -- 172.21.15.55:0/3769672656 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f22240657a0 msgr2=0x7f2224067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:18:22.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.242+0000 7f22464bc640 1 --2- 172.21.15.55:0/3769672656 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f22240657a0 0x7f2224067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.242+0000 7f22464bc640 1 -- 172.21.15.55:0/3769672656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22400b8330 msgr2=0x7f22400c50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:22.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.242+0000 7f22464bc640 1 --2- 172.21.15.55:0/3769672656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22400b8330 0x7f22400c50c0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f223c01b900 tx=0x7f223c01ba90 comp rx=0 tx=0).stop 2023-08-25T05:18:22.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.242+0000 7f22464bc640 1 -- 172.21.15.55:0/3769672656 shutdown_connections 2023-08-25T05:18:22.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.242+0000 7f22464bc640 1 --2- 172.21.15.55:0/3769672656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f224015fca0 0x7f22400c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.242+0000 7f22464bc640 1 --2- 172.21.15.55:0/3769672656 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f22240657a0 0x7f2224067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.242+0000 7f22464bc640 1 --2- 172.21.15.55:0/3769672656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22400d0bd0 0x7f22400c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.242+0000 7f22464bc640 1 --2- 172.21.15.55:0/3769672656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f22400b8330 0x7f22400c50c0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.242+0000 7f22464bc640 1 -- 172.21.15.55:0/3769672656 >> 172.21.15.55:0/3769672656 conn(0x7f22400658c0 msgr2=0x7f224015e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.242+0000 7f22464bc640 1 -- 172.21.15.55:0/3769672656 shutdown_connections 2023-08-25T05:18:22.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.242+0000 7f22464bc640 1 -- 172.21.15.55:0/3769672656 wait complete. 2023-08-25T05:18:22.250 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:22.246+0000 7f57e32fb180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:18:22.264 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T05:18:22.268 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:22.267+0000 7f8eeec2c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:18:22.315 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:22.314+0000 7f57e32fb180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:18:22.355 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:22.355+0000 7f8eeec2c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:18:22.375 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:22.374+0000 7f57e32fb180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:18:22.412 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:22.411+0000 7f8eeec2c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:18:22.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.414+0000 7fd53a110640 1 Processor -- start 2023-08-25T05:18:22.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.414+0000 7fd53a110640 1 -- start start 2023-08-25T05:18:22.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.414+0000 7fd53a110640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd53415e3c0 0x7fd53415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:22.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.414+0000 7fd53a110640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5340cd5a0 con 0x7fd5340d1290 2023-08-25T05:18:22.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.414+0000 7fd53a110640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5340cd880 con 0x7fd5341601f0 2023-08-25T05:18:22.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.414+0000 7fd53a110640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5340cdb60 con 0x7fd53415e3c0 2023-08-25T05:18:22.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.414+0000 7fd52bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd53415e3c0 0x7fd53415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:22.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.414+0000 7fd533fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd5340d1290 0x7fd53415e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54892/0 (socket says 172.21.15.55:54892) 2023-08-25T05:18:22.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.414+0000 7fd533fff640 1 -- 172.21.15.55:0/13564237 learned_addr learned my addr 172.21.15.55:0/13564237 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:22.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.414+0000 7fd52bfff640 1 -- 172.21.15.55:0/13564237 >> v1:172.21.15.110:6789/0 conn(0x7fd5341601f0 legacy=0x7fd5340d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:22.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.414+0000 7fd52bfff640 1 -- 172.21.15.55:0/13564237 >> v1:172.21.15.55:6789/0 conn(0x7fd5340d1290 legacy=0x7fd53415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:22.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.414+0000 7fd52bfff640 1 -- 172.21.15.55:0/13564237 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340cde40 con 0x7fd53415e3c0 2023-08-25T05:18:22.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.414+0000 7fd532ffd640 1 -- 172.21.15.55:0/13564237 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87044268 0 0) 0x7fd5340cd880 con 0x7fd5341601f0 2023-08-25T05:18:22.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.418+0000 7fd52bfff640 1 --2- 172.21.15.55:0/13564237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd53415e3c0 0x7fd53415d430 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0097c0 tx=0x7fd51c01c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c42dffd83f52f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:22.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.418+0000 7fd532ffd640 1 -- 172.21.15.55:0/13564237 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0ab600 con 0x7fd53415e3c0 2023-08-25T05:18:22.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.418+0000 7fd532ffd640 1 -- 172.21.15.55:0/13564237 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c0a7050 con 0x7fd53415e3c0 2023-08-25T05:18:22.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.418+0000 7fd532ffd640 1 -- 172.21.15.55:0/13564237 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0ab980 con 0x7fd53415e3c0 2023-08-25T05:18:22.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.418+0000 7fd53a110640 1 -- 172.21.15.55:0/13564237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd53415e3c0 msgr2=0x7fd53415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:22.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.418+0000 7fd53a110640 1 --2- 172.21.15.55:0/13564237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd53415e3c0 0x7fd53415d430 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0097c0 tx=0x7fd51c01c2e0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.418+0000 7fd53a110640 1 -- 172.21.15.55:0/13564237 shutdown_connections 2023-08-25T05:18:22.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.418+0000 7fd53a110640 1 --2- 172.21.15.55:0/13564237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd53415e3c0 0x7fd53415d430 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.418+0000 7fd53a110640 1 -- 172.21.15.55:0/13564237 >> 172.21.15.55:0/13564237 conn(0x7fd5340d27d0 msgr2=0x7fd5340d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:22.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.418+0000 7fd53a110640 1 -- 172.21.15.55:0/13564237 shutdown_connections 2023-08-25T05:18:22.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd53a110640 1 -- 172.21.15.55:0/13564237 wait complete. 2023-08-25T05:18:22.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd53a110640 1 Processor -- start 2023-08-25T05:18:22.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd53a110640 1 -- start start 2023-08-25T05:18:22.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd53a110640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5340d1290 0x7fd5341548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:22.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd53a110640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd53415e3c0 0x7fd534154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:22.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd53a110640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5341601f0 0x7fd53409c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:22.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd53a110640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd534155350 con 0x7fd5341601f0 2023-08-25T05:18:22.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd53a110640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53409fc30 con 0x7fd53415e3c0 2023-08-25T05:18:22.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd53a110640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340c8530 con 0x7fd5340d1290 2023-08-25T05:18:22.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd533fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5341601f0 0x7fd53409c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:22.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd533fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5341601f0 0x7fd53409c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44928/0 (socket says 172.21.15.55:44928) 2023-08-25T05:18:22.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd533fff640 1 -- 172.21.15.55:0/193789531 learned_addr learned my addr 172.21.15.55:0/193789531 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:22.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd52bfff640 1 --2- 172.21.15.55:0/193789531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd53415e3c0 0x7fd534154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:22.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd5337fe640 1 --2- 172.21.15.55:0/193789531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5340d1290 0x7fd5341548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:22.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd533fff640 1 -- 172.21.15.55:0/193789531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5340d1290 msgr2=0x7fd5341548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:22.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd533fff640 1 --2- 172.21.15.55:0/193789531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5340d1290 0x7fd5341548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd533fff640 1 -- 172.21.15.55:0/193789531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd53415e3c0 msgr2=0x7fd534154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:22.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd533fff640 1 --2- 172.21.15.55:0/193789531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd53415e3c0 0x7fd534154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd533fff640 1 -- 172.21.15.55:0/193789531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c009420 con 0x7fd5341601f0 2023-08-25T05:18:22.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd533fff640 1 --2- 172.21.15.55:0/193789531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5341601f0 0x7fd53409c660 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00caf0 tx=0x7fd52c002120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:22.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd530ff9640 1 -- 172.21.15.55:0/193789531 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c00a760 con 0x7fd5341601f0 2023-08-25T05:18:22.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.422+0000 7fd530ff9640 1 -- 172.21.15.55:0/193789531 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c00a8c0 con 0x7fd5341601f0 2023-08-25T05:18:22.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.426+0000 7fd530ff9640 1 -- 172.21.15.55:0/193789531 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c00ac50 con 0x7fd5341601f0 2023-08-25T05:18:22.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.426+0000 7fd53a110640 1 -- 172.21.15.55:0/193789531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53409fe40 con 0x7fd5341601f0 2023-08-25T05:18:22.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.426+0000 7fd53a110640 1 -- 172.21.15.55:0/193789531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5340c87d0 con 0x7fd5341601f0 2023-08-25T05:18:22.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.426+0000 7fd53a110640 1 -- 172.21.15.55:0/193789531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5340b5260 con 0x7fd5341601f0 2023-08-25T05:18:22.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.426+0000 7fd530ff9640 1 -- 172.21.15.55:0/193789531 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 75) v1 ==== 85076+0+0 (secure 0 0 0) 0x7fd52c0070d0 con 0x7fd5341601f0 2023-08-25T05:18:22.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.426+0000 7fd530ff9640 1 --2- 172.21.15.55:0/193789531 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fd5140657a0 0x7fd514067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:22.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.430+0000 7fd530ff9640 1 -- 172.21.15.55:0/193789531 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6494+0+0 (secure 0 0 0) 0x7fd52c0828a0 con 0x7fd5341601f0 2023-08-25T05:18:22.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.430+0000 7fd5337fe640 1 -- 172.21.15.55:0/193789531 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fd5140657a0 msgr2=0x7fd514067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3538591338 2023-08-25T05:18:22.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.430+0000 7fd5337fe640 1 --2- 172.21.15.55:0/193789531 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fd5140657a0 0x7fd514067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:18:22.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.434+0000 7fd530ff9640 1 -- 172.21.15.55:0/193789531 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd52c050140 con 0x7fd5341601f0 2023-08-25T05:18:22.470 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:22.466+0000 7f57e32fb180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:18:22.496 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:22.495+0000 7f8eeec2c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:18:22.530 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:22.526+0000 7f57e32fb180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:18:22.553 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:22.551+0000 7f8eeec2c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:18:22.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.590+0000 7fd53a110640 1 -- 172.21.15.55:0/193789531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd5340d20e0 con 0x7fd5341601f0 2023-08-25T05:18:22.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.590+0000 7fd530ff9640 1 -- 172.21.15.55:0/193789531 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v143) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd52c018020 con 0x7fd5341601f0 2023-08-25T05:18:22.593 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T05:18:22.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.590+0000 7fd53a110640 1 -- 172.21.15.55:0/193789531 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fd5140657a0 msgr2=0x7fd514067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:18:22.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.590+0000 7fd53a110640 1 --2- 172.21.15.55:0/193789531 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fd5140657a0 0x7fd514067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.590+0000 7fd53a110640 1 -- 172.21.15.55:0/193789531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5341601f0 msgr2=0x7fd53409c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:22.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.590+0000 7fd53a110640 1 --2- 172.21.15.55:0/193789531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5341601f0 0x7fd53409c660 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00caf0 tx=0x7fd52c002120 comp rx=0 tx=0).stop 2023-08-25T05:18:22.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.590+0000 7fd53a110640 1 -- 172.21.15.55:0/193789531 shutdown_connections 2023-08-25T05:18:22.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.590+0000 7fd53a110640 1 --2- 172.21.15.55:0/193789531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5341601f0 0x7fd53409c660 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.590+0000 7fd53a110640 1 --2- 172.21.15.55:0/193789531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd53415e3c0 0x7fd534154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.590+0000 7fd53a110640 1 --2- 172.21.15.55:0/193789531 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fd5140657a0 0x7fd514067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.590+0000 7fd53a110640 1 --2- 172.21.15.55:0/193789531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5340d1290 0x7fd5341548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.590+0000 7fd53a110640 1 -- 172.21.15.55:0/193789531 >> 172.21.15.55:0/193789531 conn(0x7fd5340d27d0 msgr2=0x7fd5340b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:22.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.594+0000 7fd53a110640 1 -- 172.21.15.55:0/193789531 shutdown_connections 2023-08-25T05:18:22.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.594+0000 7fd53a110640 1 -- 172.21.15.55:0/193789531 wait complete. 2023-08-25T05:18:22.615 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T05:18:22.620 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:22.618+0000 7f57e32fb180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:18:22.681 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:22.678+0000 7f57e32fb180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:18:22.696 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:22.695+0000 7f8eeec2c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:18:22.754 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:22.755+0000 7f8eeec2c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:18:22.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.762+0000 7fb75052c640 1 Processor -- start 2023-08-25T05:18:22.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.762+0000 7fb75052c640 1 -- start start 2023-08-25T05:18:22.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.766+0000 7fb75052c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb74815cb40 0x7fb7480ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:22.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.766+0000 7fb75052c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb7480d32f0 0x7fb7480d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:22.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.766+0000 7fb75052c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7480cd3e0 con 0x7fb7480d0db0 2023-08-25T05:18:22.767 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.766+0000 7fb75052c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7480d0c40 con 0x7fb7480d32f0 2023-08-25T05:18:22.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.766+0000 7fb75052c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480cd680 con 0x7fb74815cb40 2023-08-25T05:18:22.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.766+0000 7fb74dac7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb7480d32f0 0x7fb7480d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:22.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.766+0000 7fb74e2c8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb74815cb40 0x7fb7480ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:22.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.766+0000 7fb74dac7640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb7480d32f0 0x7fb7480d05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:57652/0 (socket says 172.21.15.55:57652) 2023-08-25T05:18:22.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.766+0000 7fb74dac7640 1 -- 172.21.15.55:0/1720679833 learned_addr learned my addr 172.21.15.55:0/1720679833 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:22.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.766+0000 7fb74e2c8640 1 -- 172.21.15.55:0/1720679833 >> v2:172.21.15.110:3300/0 conn(0x7fb7480d32f0 msgr2=0x7fb7480d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:22.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.766+0000 7fb74e2c8640 1 --2- 172.21.15.55:0/1720679833 >> v2:172.21.15.110:3300/0 conn(0x7fb7480d32f0 0x7fb7480d05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.766+0000 7fb74e2c8640 1 -- 172.21.15.55:0/1720679833 >> v1:172.21.15.110:6789/0 conn(0x7fb7480d0db0 legacy=0x7fb7480d11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:22.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.766+0000 7fb74e2c8640 1 -- 172.21.15.55:0/1720679833 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7480cd960 con 0x7fb74815cb40 2023-08-25T05:18:22.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.766+0000 7fb74dac7640 1 --2- 172.21.15.55:0/1720679833 >> v2:172.21.15.110:3300/0 conn(0x7fb7480d32f0 0x7fb7480d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:18:22.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.770+0000 7fb74e2c8640 1 --2- 172.21.15.55:0/1720679833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb74815cb40 0x7fb7480ce440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb7440097a0 tx=0x7fb74401c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79760cf304c1dc13 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:22.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.770+0000 7fb74d2c6640 1 -- 172.21.15.55:0/1720679833 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440ac600 con 0x7fb74815cb40 2023-08-25T05:18:22.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.770+0000 7fb74d2c6640 1 -- 172.21.15.55:0/1720679833 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7440a8050 con 0x7fb74815cb40 2023-08-25T05:18:22.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.770+0000 7fb74d2c6640 1 -- 172.21.15.55:0/1720679833 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440ac980 con 0x7fb74815cb40 2023-08-25T05:18:22.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.770+0000 7fb75052c640 1 -- 172.21.15.55:0/1720679833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb74815cb40 msgr2=0x7fb7480ce440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:22.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.770+0000 7fb75052c640 1 --2- 172.21.15.55:0/1720679833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb74815cb40 0x7fb7480ce440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb7440097a0 tx=0x7fb74401c3a0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.770+0000 7fb75052c640 1 -- 172.21.15.55:0/1720679833 shutdown_connections 2023-08-25T05:18:22.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.770+0000 7fb75052c640 1 --2- 172.21.15.55:0/1720679833 >> v2:172.21.15.110:3300/0 conn(0x7fb7480d32f0 0x7fb7480d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.770+0000 7fb75052c640 1 --2- 172.21.15.55:0/1720679833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb74815cb40 0x7fb7480ce440 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.770+0000 7fb75052c640 1 -- 172.21.15.55:0/1720679833 >> 172.21.15.55:0/1720679833 conn(0x7fb7480d27d0 msgr2=0x7fb7480d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:22.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.770+0000 7fb75052c640 1 -- 172.21.15.55:0/1720679833 shutdown_connections 2023-08-25T05:18:22.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.770+0000 7fb75052c640 1 -- 172.21.15.55:0/1720679833 wait complete. 2023-08-25T05:18:22.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb75052c640 1 Processor -- start 2023-08-25T05:18:22.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb75052c640 1 -- start start 2023-08-25T05:18:22.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb75052c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7480d0db0 0x7fb748152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:22.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb75052c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7480d32f0 0x7fb74814c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:22.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb75052c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb74815cb40 0x7fb748150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:22.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb75052c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74814cd80 con 0x7fb7480d32f0 2023-08-25T05:18:22.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb75052c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb748151460 con 0x7fb74815cb40 2023-08-25T05:18:22.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb75052c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb748151740 con 0x7fb7480d0db0 2023-08-25T05:18:22.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb74dac7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7480d32f0 0x7fb74814c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:22.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb74e2c8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7480d0db0 0x7fb748152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:22.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb74dac7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7480d32f0 0x7fb74814c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44934/0 (socket says 172.21.15.55:44934) 2023-08-25T05:18:22.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb74dac7640 1 -- 172.21.15.55:0/112544776 learned_addr learned my addr 172.21.15.55:0/112544776 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:22.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb74e2c8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7480d0db0 0x7fb748152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:41170/0 (socket says 172.21.15.55:41170) 2023-08-25T05:18:22.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb74eac9640 1 --2- 172.21.15.55:0/112544776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb74815cb40 0x7fb748150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:22.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb74e2c8640 1 -- 172.21.15.55:0/112544776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb74815cb40 msgr2=0x7fb748150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:22.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb74e2c8640 1 --2- 172.21.15.55:0/112544776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb74815cb40 0x7fb748150c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb74e2c8640 1 -- 172.21.15.55:0/112544776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7480d32f0 msgr2=0x7fb74814c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:22.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb74e2c8640 1 --2- 172.21.15.55:0/112544776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7480d32f0 0x7fb74814c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb74e2c8640 1 -- 172.21.15.55:0/112544776 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7380094d0 con 0x7fb7480d0db0 2023-08-25T05:18:22.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb74dac7640 1 --2- 172.21.15.55:0/112544776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7480d32f0 0x7fb74814c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:18:22.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb74e2c8640 1 --2- 172.21.15.55:0/112544776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7480d0db0 0x7fb748152500 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb7440ac000 tx=0x7fb74401abe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:22.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb73effd640 1 -- 172.21.15.55:0/112544776 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440bb070 con 0x7fb7480d0db0 2023-08-25T05:18:22.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb73effd640 1 -- 172.21.15.55:0/112544776 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7440ace20 con 0x7fb7480d0db0 2023-08-25T05:18:22.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb73effd640 1 -- 172.21.15.55:0/112544776 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb744005c00 con 0x7fb7480d0db0 2023-08-25T05:18:22.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb75052c640 1 -- 172.21.15.55:0/112544776 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7440093b0 con 0x7fb7480d0db0 2023-08-25T05:18:22.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.774+0000 7fb75052c640 1 -- 172.21.15.55:0/112544776 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb748151d00 con 0x7fb7480d0db0 2023-08-25T05:18:22.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.778+0000 7fb75052c640 1 -- 172.21.15.55:0/112544776 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb748073ec0 con 0x7fb7480d0db0 2023-08-25T05:18:22.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.778+0000 7fb73effd640 1 -- 172.21.15.55:0/112544776 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 75) v1 ==== 85076+0+0 (secure 0 0 0) 0x7fb7440b3070 con 0x7fb7480d0db0 2023-08-25T05:18:22.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.778+0000 7fb73effd640 1 --2- 172.21.15.55:0/112544776 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fb72c0657a0 0x7fb72c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:22.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.778+0000 7fb73effd640 1 -- 172.21.15.55:0/112544776 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6494+0+0 (secure 0 0 0) 0x7fb74411cda0 con 0x7fb7480d0db0 2023-08-25T05:18:22.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.778+0000 7fb74dac7640 1 -- 172.21.15.55:0/112544776 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fb72c0657a0 msgr2=0x7fb72c067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3538591338 2023-08-25T05:18:22.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.778+0000 7fb74dac7640 1 --2- 172.21.15.55:0/112544776 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fb72c0657a0 0x7fb72c067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:18:22.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.782+0000 7fb73effd640 1 -- 172.21.15.55:0/112544776 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb7440ea530 con 0x7fb7480d0db0 2023-08-25T05:18:22.838 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:22.834+0000 7f57e32fb180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:18:22.900 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:22.898+0000 7f57e32fb180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:18:22.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.942+0000 7fb75052c640 1 -- 172.21.15.55:0/112544776 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb748151880 con 0x7fb7480d0db0 2023-08-25T05:18:22.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.942+0000 7fb73effd640 1 -- 172.21.15.55:0/112544776 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v143) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb748151880 con 0x7fb7480d0db0 2023-08-25T05:18:22.946 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T05:18:22.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.946+0000 7fb75052c640 1 -- 172.21.15.55:0/112544776 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fb72c0657a0 msgr2=0x7fb72c067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:18:22.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.946+0000 7fb75052c640 1 --2- 172.21.15.55:0/112544776 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fb72c0657a0 0x7fb72c067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.946+0000 7fb75052c640 1 -- 172.21.15.55:0/112544776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7480d0db0 msgr2=0x7fb748152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:22.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.946+0000 7fb75052c640 1 --2- 172.21.15.55:0/112544776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7480d0db0 0x7fb748152500 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb7440ac000 tx=0x7fb74401abe0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.946+0000 7fb75052c640 1 -- 172.21.15.55:0/112544776 shutdown_connections 2023-08-25T05:18:22.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.946+0000 7fb75052c640 1 --2- 172.21.15.55:0/112544776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb74815cb40 0x7fb748150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.946+0000 7fb75052c640 1 --2- 172.21.15.55:0/112544776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7480d32f0 0x7fb74814c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.946+0000 7fb75052c640 1 --2- 172.21.15.55:0/112544776 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fb72c0657a0 0x7fb72c067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.946+0000 7fb75052c640 1 --2- 172.21.15.55:0/112544776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7480d0db0 0x7fb748152500 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:22.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.946+0000 7fb75052c640 1 -- 172.21.15.55:0/112544776 >> 172.21.15.55:0/112544776 conn(0x7fb7480d27d0 msgr2=0x7fb74806b210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:22.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.946+0000 7fb75052c640 1 -- 172.21.15.55:0/112544776 shutdown_connections 2023-08-25T05:18:22.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:22.946+0000 7fb75052c640 1 -- 172.21.15.55:0/112544776 wait complete. 2023-08-25T05:18:22.968 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T05:18:22.997 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:18:22.997 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:18:22.998 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:18:23.005 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:23.007+0000 7f8eeec2c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:18:23.140 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:23.139+0000 7f8eeec2c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:18:23.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.146+0000 7fe177ce5640 1 Processor -- start 2023-08-25T05:18:23.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.146+0000 7fe177ce5640 1 -- start start 2023-08-25T05:18:23.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.146+0000 7fe177ce5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe1700d0da0 0x7fe1700d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.146+0000 7fe177ce5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe1700cdde0 0x7fe1700ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.146+0000 7fe177ce5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1700cee60 0x7fe1700cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.146+0000 7fe175a81640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe1700d0da0 0x7fe1700d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.146+0000 7fe177ce5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1700ce760 con 0x7fe1700d0da0 2023-08-25T05:18:23.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.146+0000 7fe177ce5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1700b29b0 con 0x7fe1700cdde0 2023-08-25T05:18:23.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.146+0000 7fe177ce5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1700d16c0 con 0x7fe1700cee60 2023-08-25T05:18:23.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.146+0000 7fe175a81640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe1700d0da0 0x7fe1700d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44948/0 (socket says 172.21.15.55:44948) 2023-08-25T05:18:23.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.146+0000 7fe175a81640 1 -- 172.21.15.55:0/2997483452 learned_addr learned my addr 172.21.15.55:0/2997483452 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:23.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.146+0000 7fe175a81640 1 -- 172.21.15.55:0/2997483452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1700cee60 msgr2=0x7fe1700cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:23.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.146+0000 7fe175a81640 1 --2- 172.21.15.55:0/2997483452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1700cee60 0x7fe1700cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.146+0000 7fe175a81640 1 -- 172.21.15.55:0/2997483452 >> v2:172.21.15.110:3300/0 conn(0x7fe1700cdde0 msgr2=0x7fe1700ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:23.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.146+0000 7fe175a81640 1 --2- 172.21.15.55:0/2997483452 >> v2:172.21.15.110:3300/0 conn(0x7fe1700cdde0 0x7fe1700ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.146+0000 7fe175a81640 1 -- 172.21.15.55:0/2997483452 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1700b1dc0 con 0x7fe1700d0da0 2023-08-25T05:18:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.150+0000 7fe175a81640 1 --2- 172.21.15.55:0/2997483452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1700d0da0 0x7fe1700d1180 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fe1700d38c0 tx=0x7fe16c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb21b42b9729e43 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.150+0000 7fe174a7f640 1 -- 172.21.15.55:0/2997483452 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0a89b0 con 0x7fe1700d0da0 2023-08-25T05:18:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.150+0000 7fe174a7f640 1 -- 172.21.15.55:0/2997483452 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c0a8b10 con 0x7fe1700d0da0 2023-08-25T05:18:23.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.150+0000 7fe174a7f640 1 -- 172.21.15.55:0/2997483452 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0a8ea0 con 0x7fe1700d0da0 2023-08-25T05:18:23.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.150+0000 7fe177ce5640 1 -- 172.21.15.55:0/2997483452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1700d0da0 msgr2=0x7fe1700d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.150+0000 7fe177ce5640 1 --2- 172.21.15.55:0/2997483452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1700d0da0 0x7fe1700d1180 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fe1700d38c0 tx=0x7fe16c01ecf0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.150+0000 7fe177ce5640 1 -- 172.21.15.55:0/2997483452 shutdown_connections 2023-08-25T05:18:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.150+0000 7fe177ce5640 1 --2- 172.21.15.55:0/2997483452 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1700cee60 0x7fe1700cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.150+0000 7fe177ce5640 1 --2- 172.21.15.55:0/2997483452 >> v2:172.21.15.110:3300/0 conn(0x7fe1700cdde0 0x7fe1700ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.150+0000 7fe177ce5640 1 --2- 172.21.15.55:0/2997483452 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1700d0da0 0x7fe1700d1180 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.150+0000 7fe177ce5640 1 -- 172.21.15.55:0/2997483452 >> 172.21.15.55:0/2997483452 conn(0x7fe17009bae0 msgr2=0x7fe1700d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.150+0000 7fe177ce5640 1 -- 172.21.15.55:0/2997483452 shutdown_connections 2023-08-25T05:18:23.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.150+0000 7fe177ce5640 1 -- 172.21.15.55:0/2997483452 wait complete. 2023-08-25T05:18:23.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe177ce5640 1 Processor -- start 2023-08-25T05:18:23.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe177ce5640 1 -- start start 2023-08-25T05:18:23.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe177ce5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1700cdde0 0x7fe1700c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:23.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe177ce5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1700cee60 0x7fe17014be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:23.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe177ce5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1700d0da0 0x7fe1700cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:23.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe177ce5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17014c3c0 con 0x7fe1700cee60 2023-08-25T05:18:23.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe177ce5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1700ca8e0 con 0x7fe1700cdde0 2023-08-25T05:18:23.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe177ce5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1700b7e10 con 0x7fe1700d0da0 2023-08-25T05:18:23.157 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:18:23.157 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:18:23.157 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:18:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe175280640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1700cee60 0x7fe17014be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:23.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe175280640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1700cee60 0x7fe17014be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44964/0 (socket says 172.21.15.55:44964) 2023-08-25T05:18:23.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe175280640 1 -- 172.21.15.55:0/108003256 learned_addr learned my addr 172.21.15.55:0/108003256 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:23.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe175a81640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1700cdde0 0x7fe1700c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:23.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe176282640 1 --2- 172.21.15.55:0/108003256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1700d0da0 0x7fe1700cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:23.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe175280640 1 -- 172.21.15.55:0/108003256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1700d0da0 msgr2=0x7fe1700cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:23.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe175280640 1 --2- 172.21.15.55:0/108003256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1700d0da0 0x7fe1700cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe175280640 1 -- 172.21.15.55:0/108003256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1700cdde0 msgr2=0x7fe1700c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:23.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe175280640 1 --2- 172.21.15.55:0/108003256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1700cdde0 0x7fe1700c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe175280640 1 -- 172.21.15.55:0/108003256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c009480 con 0x7fe1700cee60 2023-08-25T05:18:23.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe175280640 1 --2- 172.21.15.55:0/108003256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1700cee60 0x7fe17014be80 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fe16000b410 tx=0x7fe16000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:23.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe1667fc640 1 -- 172.21.15.55:0/108003256 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe160011830 con 0x7fe1700cee60 2023-08-25T05:18:23.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe1667fc640 1 -- 172.21.15.55:0/108003256 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe160011990 con 0x7fe1700cee60 2023-08-25T05:18:23.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe1667fc640 1 -- 172.21.15.55:0/108003256 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe160011d40 con 0x7fe1700cee60 2023-08-25T05:18:23.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe177ce5640 1 -- 172.21.15.55:0/108003256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1700b80f0 con 0x7fe1700cee60 2023-08-25T05:18:23.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.154+0000 7fe177ce5640 1 -- 172.21.15.55:0/108003256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1700cae60 con 0x7fe1700cee60 2023-08-25T05:18:23.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.158+0000 7fe177ce5640 1 -- 172.21.15.55:0/108003256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17004dbe0 con 0x7fe1700cee60 2023-08-25T05:18:23.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.158+0000 7fe1667fc640 1 -- 172.21.15.55:0/108003256 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 75) v1 ==== 85076+0+0 (secure 0 0 0) 0x7fe16001a400 con 0x7fe1700cee60 2023-08-25T05:18:23.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.158+0000 7fe1667fc640 1 --2- 172.21.15.55:0/108003256 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fe1540657a0 0x7fe154067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:23.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.158+0000 7fe1667fc640 1 -- 172.21.15.55:0/108003256 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6494+0+0 (secure 0 0 0) 0x7fe160083220 con 0x7fe1700cee60 2023-08-25T05:18:23.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.158+0000 7fe175a81640 1 -- 172.21.15.55:0/108003256 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fe1540657a0 msgr2=0x7fe154067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3538591338 2023-08-25T05:18:23.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.158+0000 7fe175a81640 1 --2- 172.21.15.55:0/108003256 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fe1540657a0 0x7fe154067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:18:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.162+0000 7fe1667fc640 1 -- 172.21.15.55:0/108003256 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe160050a30 con 0x7fe1700cee60 2023-08-25T05:18:23.167 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:23.166+0000 7f57e32fb180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:18:23.267 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:23.267+0000 7f8eeec2c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:18:23.311 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:23.310+0000 7f57e32fb180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:18:23.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.334+0000 7fe177ce5640 1 -- 172.21.15.55:0/108003256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe1700d0b80 con 0x7fe1700cee60 2023-08-25T05:18:23.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.334+0000 7fe1667fc640 1 -- 172.21.15.55:0/108003256 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v143) v1 ==== 80+0+475 (secure 0 0 0) 0x7fe160054050 con 0x7fe1700cee60 2023-08-25T05:18:23.338 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6833/3700713436 2023-08-26T04:22:41.515664+0000 2023-08-25T05:18:23.339 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6832/3700713436 2023-08-26T04:22:41.515664+0000 2023-08-25T05:18:23.339 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/789108415 2023-08-26T04:22:41.515664+0000 2023-08-25T05:18:23.339 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3185722269 2023-08-26T04:22:41.515664+0000 2023-08-25T05:18:23.340 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/452038739 2023-08-26T04:22:41.515664+0000 2023-08-25T05:18:23.340 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/327450935 2023-08-26T04:22:41.515664+0000 2023-08-25T05:18:23.340 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3135214366 2023-08-26T04:22:41.515664+0000 2023-08-25T05:18:23.340 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/2514341378 2023-08-26T04:22:41.515664+0000 2023-08-25T05:18:23.346 INFO:teuthology.orchestra.run.smithi055.stderr:listed 8 entries 2023-08-25T05:18:23.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.338+0000 7fe177ce5640 1 -- 172.21.15.55:0/108003256 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fe1540657a0 msgr2=0x7fe154067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:18:23.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.338+0000 7fe177ce5640 1 --2- 172.21.15.55:0/108003256 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fe1540657a0 0x7fe154067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.338+0000 7fe177ce5640 1 -- 172.21.15.55:0/108003256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1700cee60 msgr2=0x7fe17014be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:23.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.338+0000 7fe177ce5640 1 --2- 172.21.15.55:0/108003256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1700cee60 0x7fe17014be80 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fe16000b410 tx=0x7fe16000b8d0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.338+0000 7fe177ce5640 1 -- 172.21.15.55:0/108003256 shutdown_connections 2023-08-25T05:18:23.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.338+0000 7fe177ce5640 1 --2- 172.21.15.55:0/108003256 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fe1540657a0 0x7fe154067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.338+0000 7fe177ce5640 1 --2- 172.21.15.55:0/108003256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe1700d0da0 0x7fe1700cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.338+0000 7fe177ce5640 1 --2- 172.21.15.55:0/108003256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1700cee60 0x7fe17014be80 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.338+0000 7fe177ce5640 1 --2- 172.21.15.55:0/108003256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1700cdde0 0x7fe1700c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.338+0000 7fe177ce5640 1 -- 172.21.15.55:0/108003256 >> 172.21.15.55:0/108003256 conn(0x7fe17009bae0 msgr2=0x7fe1700b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:23.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.338+0000 7fe177ce5640 1 -- 172.21.15.55:0/108003256 shutdown_connections 2023-08-25T05:18:23.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.338+0000 7fe177ce5640 1 -- 172.21.15.55:0/108003256 wait complete. 2023-08-25T05:18:23.349 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:23.335+0000 7f8eeec2c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:18:23.359 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-25T05:18:23.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:23.360 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-25T05:18:23.411 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T05:18:23.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:23.413 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-25T05:18:23.424 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:18:23.424 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:18:23.435 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:18:23.436 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:18:23.436 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:18:23.448 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:23.446+0000 7f57e32fb180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:18:23.457 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T05:18:23.457 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:18:23.458 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:18:23.474 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:23.475+0000 7f8eeec2c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:18:23.483 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:18:23.483 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:18:23.522 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:23.518+0000 7f57e32fb180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:18:23.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.642+0000 7f3c913fa640 1 Processor -- start 2023-08-25T05:18:23.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.642+0000 7f3c913fa640 1 -- start start 2023-08-25T05:18:23.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.642+0000 7f3c913fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c8c15cc80 0x7f3c8c0ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:23.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.642+0000 7f3c913fa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3c8c0b1a90 0x7f3c8c06a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:23.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.642+0000 7f3c913fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8c0d18a0 con 0x7f3c8c15c8a0 2023-08-25T05:18:23.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.642+0000 7f3c913fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8c0cd6c0 con 0x7f3c8c15cc80 2023-08-25T05:18:23.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.642+0000 7f3c913fa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8c0cd9a0 con 0x7f3c8c0b1a90 2023-08-25T05:18:23.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.642+0000 7f3c8a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c8c15cc80 0x7f3c8c0ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:23.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.642+0000 7f3c8affd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3c8c15c8a0 0x7f3c8c0d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54908/0 (socket says 172.21.15.55:54908) 2023-08-25T05:18:23.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.642+0000 7f3c8affd640 1 -- 172.21.15.55:0/1210823072 learned_addr learned my addr 172.21.15.55:0/1210823072 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:23.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.642+0000 7f3c8b7fe640 1 --2- 172.21.15.55:0/1210823072 >> v2:172.21.15.110:3300/0 conn(0x7f3c8c0b1a90 0x7f3c8c06a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:23.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.642+0000 7f3c8a7fc640 1 -- 172.21.15.55:0/1210823072 >> v2:172.21.15.110:3300/0 conn(0x7f3c8c0b1a90 msgr2=0x7f3c8c06a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:23.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.642+0000 7f3c8a7fc640 1 --2- 172.21.15.55:0/1210823072 >> v2:172.21.15.110:3300/0 conn(0x7f3c8c0b1a90 0x7f3c8c06a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.642+0000 7f3c8a7fc640 1 -- 172.21.15.55:0/1210823072 >> v1:172.21.15.55:6789/0 conn(0x7f3c8c15c8a0 legacy=0x7f3c8c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:23.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.642+0000 7f3c8a7fc640 1 -- 172.21.15.55:0/1210823072 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c0cdc80 con 0x7f3c8c15cc80 2023-08-25T05:18:23.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.646+0000 7f3c8a7fc640 1 --2- 172.21.15.55:0/1210823072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c15cc80 0x7f3c8c0ce480 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c08bfc0 tx=0x7f3c8001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9795dc7b8127553b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:23.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.646+0000 7f3c89ffb640 1 -- 172.21.15.55:0/1210823072 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c800ab600 con 0x7f3c8c15cc80 2023-08-25T05:18:23.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.646+0000 7f3c89ffb640 1 -- 172.21.15.55:0/1210823072 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c800a7050 con 0x7f3c8c15cc80 2023-08-25T05:18:23.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.646+0000 7f3c89ffb640 1 -- 172.21.15.55:0/1210823072 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c800ab980 con 0x7f3c8c15cc80 2023-08-25T05:18:23.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.646+0000 7f3c913fa640 1 -- 172.21.15.55:0/1210823072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c15cc80 msgr2=0x7f3c8c0ce480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:23.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.646+0000 7f3c913fa640 1 --2- 172.21.15.55:0/1210823072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c15cc80 0x7f3c8c0ce480 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c08bfc0 tx=0x7f3c8001c3a0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.646+0000 7f3c913fa640 1 -- 172.21.15.55:0/1210823072 shutdown_connections 2023-08-25T05:18:23.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.646+0000 7f3c913fa640 1 --2- 172.21.15.55:0/1210823072 >> v2:172.21.15.110:3300/0 conn(0x7f3c8c0b1a90 0x7f3c8c06a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.646+0000 7f3c913fa640 1 --2- 172.21.15.55:0/1210823072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c15cc80 0x7f3c8c0ce480 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.646+0000 7f3c913fa640 1 -- 172.21.15.55:0/1210823072 >> 172.21.15.55:0/1210823072 conn(0x7f3c8c09b950 msgr2=0x7f3c8c0d2610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:23.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.646+0000 7f3c913fa640 1 -- 172.21.15.55:0/1210823072 shutdown_connections 2023-08-25T05:18:23.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.646+0000 7f3c913fa640 1 -- 172.21.15.55:0/1210823072 wait complete. 2023-08-25T05:18:23.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c913fa640 1 Processor -- start 2023-08-25T05:18:23.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c913fa640 1 -- start start 2023-08-25T05:18:23.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c913fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c8c0b1a90 0x7f3c8c15f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:23.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c913fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c8c15c8a0 0x7f3c8c151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:23.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c913fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c15cc80 0x7f3c8c0b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c913fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c15ff30 con 0x7f3c8c15cc80 2023-08-25T05:18:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c913fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c152f30 con 0x7f3c8c0b1a90 2023-08-25T05:18:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c913fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8c152690 con 0x7f3c8c15c8a0 2023-08-25T05:18:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c8a7fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c8c15c8a0 0x7f3c8c151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c8affd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c8c0b1a90 0x7f3c8c15f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:23.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c8b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c15cc80 0x7f3c8c0b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:23.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c8a7fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c8c15c8a0 0x7f3c8c151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:41196/0 (socket says 172.21.15.55:41196) 2023-08-25T05:18:23.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c8a7fc640 1 -- 172.21.15.55:0/4045186376 learned_addr learned my addr 172.21.15.55:0/4045186376 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:23.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c8a7fc640 1 -- 172.21.15.55:0/4045186376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c8c0b1a90 msgr2=0x7f3c8c15f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:23.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c8a7fc640 1 --2- 172.21.15.55:0/4045186376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c8c0b1a90 0x7f3c8c15f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c8a7fc640 1 -- 172.21.15.55:0/4045186376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c15cc80 msgr2=0x7f3c8c0b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c8a7fc640 1 --2- 172.21.15.55:0/4045186376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c15cc80 0x7f3c8c0b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c8a7fc640 1 -- 172.21.15.55:0/4045186376 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c80009420 con 0x7f3c8c15c8a0 2023-08-25T05:18:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c8a7fc640 1 --2- 172.21.15.55:0/4045186376 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c8c15c8a0 0x7f3c8c151bd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3c800ae040 tx=0x7f3c80019140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c737fe640 1 -- 172.21.15.55:0/4045186376 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c800b4430 con 0x7f3c8c15c8a0 2023-08-25T05:18:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c737fe640 1 -- 172.21.15.55:0/4045186376 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c800b45b0 con 0x7f3c8c15c8a0 2023-08-25T05:18:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c913fa640 1 -- 172.21.15.55:0/4045186376 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8c152970 con 0x7f3c8c15c8a0 2023-08-25T05:18:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c737fe640 1 -- 172.21.15.55:0/4045186376 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c800b4960 con 0x7f3c8c15c8a0 2023-08-25T05:18:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c913fa640 1 -- 172.21.15.55:0/4045186376 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8c0af270 con 0x7f3c8c15c8a0 2023-08-25T05:18:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.650+0000 7f3c913fa640 1 -- 172.21.15.55:0/4045186376 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8c066d20 con 0x7f3c8c15c8a0 2023-08-25T05:18:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.654+0000 7f3c737fe640 1 -- 172.21.15.55:0/4045186376 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 75) v1 ==== 85076+0+0 (secure 0 0 0) 0x7f3c800b2040 con 0x7f3c8c15c8a0 2023-08-25T05:18:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.654+0000 7f3c737fe640 1 --2- 172.21.15.55:0/4045186376 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f3c780657a0 0x7f3c78067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.654+0000 7f3c737fe640 1 -- 172.21.15.55:0/4045186376 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6494+0+0 (secure 0 0 0) 0x7f3c8011cf60 con 0x7f3c8c15c8a0 2023-08-25T05:18:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.654+0000 7f3c8affd640 1 -- 172.21.15.55:0/4045186376 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f3c780657a0 msgr2=0x7f3c78067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3538591338 2023-08-25T05:18:23.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.654+0000 7f3c8affd640 1 --2- 172.21.15.55:0/4045186376 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f3c780657a0 0x7f3c78067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:18:23.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.658+0000 7f3c737fe640 1 -- 172.21.15.55:0/4045186376 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3c800ea6f0 con 0x7f3c8c15c8a0 2023-08-25T05:18:23.669 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:23.666+0000 7f57e32fb180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:18:23.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.850+0000 7f3c913fa640 1 -- 172.21.15.55:0/4045186376 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c8c0b8590 con 0x7f3c8c15c8a0 2023-08-25T05:18:23.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.854+0000 7f3c737fe640 1 -- 172.21.15.55:0/4045186376 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f3c800edd10 con 0x7f3c8c15c8a0 2023-08-25T05:18:23.855 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:23.855 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7493,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/2640392190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2640392190},{"type":"v1","addr":"172.21.15.110:6837","nonce":2640392190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62},{"gid":8428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/2668985619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2668985619},{"type":"v1","addr":"172.21.15.110:6836","nonce":2668985619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61},{"gid":9018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/210118982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":210118982},{"type":"v1","addr":"172.21.15.55:6834","nonce":210118982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:22:24.336177+0000","modified":"2023-08-25T04:22:27.988148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9024":{"gid":9024,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/2424299953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2424299953},{"type":"v1","addr":"172.21.15.55:6835","nonce":2424299953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-25T05:18:23.855 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 66 2023-08-25T05:18:23.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.854+0000 7f3c913fa640 1 -- 172.21.15.55:0/4045186376 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f3c780657a0 msgr2=0x7f3c78067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:18:23.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.854+0000 7f3c913fa640 1 --2- 172.21.15.55:0/4045186376 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f3c780657a0 0x7f3c78067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.854+0000 7f3c913fa640 1 -- 172.21.15.55:0/4045186376 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c8c15c8a0 msgr2=0x7f3c8c151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:23.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.854+0000 7f3c913fa640 1 --2- 172.21.15.55:0/4045186376 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c8c15c8a0 0x7f3c8c151bd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3c800ae040 tx=0x7f3c80019140 comp rx=0 tx=0).stop 2023-08-25T05:18:23.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.854+0000 7f3c913fa640 1 -- 172.21.15.55:0/4045186376 shutdown_connections 2023-08-25T05:18:23.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.854+0000 7f3c913fa640 1 --2- 172.21.15.55:0/4045186376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c8c15cc80 0x7f3c8c0b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.854+0000 7f3c913fa640 1 --2- 172.21.15.55:0/4045186376 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f3c780657a0 0x7f3c78067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.854+0000 7f3c913fa640 1 --2- 172.21.15.55:0/4045186376 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c8c15c8a0 0x7f3c8c151bd0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.854+0000 7f3c913fa640 1 --2- 172.21.15.55:0/4045186376 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c8c0b1a90 0x7f3c8c15f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:23.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.854+0000 7f3c913fa640 1 -- 172.21.15.55:0/4045186376 >> 172.21.15.55:0/4045186376 conn(0x7f3c8c09b950 msgr2=0x7f3c8c06bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:23.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.854+0000 7f3c913fa640 1 -- 172.21.15.55:0/4045186376 shutdown_connections 2023-08-25T05:18:23.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:23.854+0000 7f3c913fa640 1 -- 172.21.15.55:0/4045186376 wait complete. 2023-08-25T05:18:23.878 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:18:24.020 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:24.019+0000 7f8eeec2c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:18:24.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.062+0000 7f90b4cec640 1 Processor -- start 2023-08-25T05:18:24.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.062+0000 7f90b4cec640 1 -- start start 2023-08-25T05:18:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.062+0000 7f90b4cec640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90b00d0da0 0x7f90b00d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.062+0000 7f90b4cec640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b00b29b0 con 0x7f90b00cdde0 2023-08-25T05:18:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.062+0000 7f90b4cec640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b00cfc80 con 0x7f90b00b3e50 2023-08-25T05:18:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.062+0000 7f90b4cec640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b00d16c0 con 0x7f90b00d0da0 2023-08-25T05:18:24.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.062+0000 7f90ae59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90b00d0da0 0x7f90b00d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:24.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.066+0000 7f90ae59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90b00d0da0 0x7f90b00d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44992/0 (socket says 172.21.15.55:44992) 2023-08-25T05:18:24.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.066+0000 7f90ae59c640 1 -- 172.21.15.55:0/601469426 learned_addr learned my addr 172.21.15.55:0/601469426 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:24.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.066+0000 7f90ae59c640 1 -- 172.21.15.55:0/601469426 >> v1:172.21.15.110:6789/0 conn(0x7f90b00b3e50 legacy=0x7f90b00cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:24.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.066+0000 7f90ae59c640 1 -- 172.21.15.55:0/601469426 >> v1:172.21.15.55:6789/0 conn(0x7f90b00cdde0 legacy=0x7f90b00cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:24.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.066+0000 7f90ae59c640 1 -- 172.21.15.55:0/601469426 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b00b1dc0 con 0x7f90b00d0da0 2023-08-25T05:18:24.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.070+0000 7f90ae59c640 1 --2- 172.21.15.55:0/601469426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90b00d0da0 0x7f90b00d1180 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f90a0006fd0 tx=0x7f90a001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436b7c657dbb3198 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:24.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.070+0000 7f90ad59a640 1 -- 172.21.15.55:0/601469426 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a00a8a10 con 0x7f90b00d0da0 2023-08-25T05:18:24.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.070+0000 7f90ad59a640 1 -- 172.21.15.55:0/601469426 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a00a8b70 con 0x7f90b00d0da0 2023-08-25T05:18:24.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.070+0000 7f90ad59a640 1 -- 172.21.15.55:0/601469426 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a00b0440 con 0x7f90b00d0da0 2023-08-25T05:18:24.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.070+0000 7f90b4cec640 1 -- 172.21.15.55:0/601469426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90b00d0da0 msgr2=0x7f90b00d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:24.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.070+0000 7f90b4cec640 1 --2- 172.21.15.55:0/601469426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90b00d0da0 0x7f90b00d1180 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f90a0006fd0 tx=0x7f90a001ed10 comp rx=0 tx=0).stop 2023-08-25T05:18:24.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.070+0000 7f90b4cec640 1 -- 172.21.15.55:0/601469426 shutdown_connections 2023-08-25T05:18:24.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.070+0000 7f90b4cec640 1 --2- 172.21.15.55:0/601469426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90b00d0da0 0x7f90b00d1180 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.070+0000 7f90b4cec640 1 -- 172.21.15.55:0/601469426 >> 172.21.15.55:0/601469426 conn(0x7f90b009bae0 msgr2=0x7f90b00d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:24.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.070+0000 7f90b4cec640 1 -- 172.21.15.55:0/601469426 shutdown_connections 2023-08-25T05:18:24.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.070+0000 7f90b4cec640 1 -- 172.21.15.55:0/601469426 wait complete. 2023-08-25T05:18:24.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.070+0000 7f90b4cec640 1 Processor -- start 2023-08-25T05:18:24.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90b4cec640 1 -- start start 2023-08-25T05:18:24.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90b4cec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90b00b3e50 0x7f90b0151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:24.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90b4cec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90b00cdde0 0x7f90b01f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:24.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90b4cec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90b00d0da0 0x7f90b01f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:24.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90b4cec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b00cb190 con 0x7f90b00b3e50 2023-08-25T05:18:24.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90b4cec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b00ca580 con 0x7f90b00d0da0 2023-08-25T05:18:24.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90b4cec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b00ca860 con 0x7f90b00cdde0 2023-08-25T05:18:24.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90ae59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90b00b3e50 0x7f90b0151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:24.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90ae59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90b00b3e50 0x7f90b0151d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45002/0 (socket says 172.21.15.55:45002) 2023-08-25T05:18:24.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90ae59c640 1 -- 172.21.15.55:0/3436666416 learned_addr learned my addr 172.21.15.55:0/3436666416 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:24.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90add9b640 1 --2- 172.21.15.55:0/3436666416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90b00cdde0 0x7f90b01f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:24.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90aed9d640 1 --2- 172.21.15.55:0/3436666416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90b00d0da0 0x7f90b01f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90ae59c640 1 -- 172.21.15.55:0/3436666416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90b00cdde0 msgr2=0x7f90b01f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90ae59c640 1 --2- 172.21.15.55:0/3436666416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90b00cdde0 0x7f90b01f5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90ae59c640 1 -- 172.21.15.55:0/3436666416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90b00d0da0 msgr2=0x7f90b01f5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90ae59c640 1 --2- 172.21.15.55:0/3436666416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90b00d0da0 0x7f90b01f5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90ae59c640 1 -- 172.21.15.55:0/3436666416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a0009480 con 0x7f90b00b3e50 2023-08-25T05:18:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90ae59c640 1 --2- 172.21.15.55:0/3436666416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90b00b3e50 0x7f90b0151d20 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f90a001c940 tx=0x7f90a001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f909effd640 1 -- 172.21.15.55:0/3436666416 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0005ba0 con 0x7f90b00b3e50 2023-08-25T05:18:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f909effd640 1 -- 172.21.15.55:0/3436666416 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a0005d00 con 0x7f90b00b3e50 2023-08-25T05:18:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90b4cec640 1 -- 172.21.15.55:0/3436666416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b00cab40 con 0x7f90b00b3e50 2023-08-25T05:18:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f909effd640 1 -- 172.21.15.55:0/3436666416 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0003860 con 0x7f90b00b3e50 2023-08-25T05:18:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.074+0000 7f90b4cec640 1 -- 172.21.15.55:0/3436666416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b0152260 con 0x7f90b00b3e50 2023-08-25T05:18:24.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.078+0000 7f90b4cec640 1 -- 172.21.15.55:0/3436666416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b004dbe0 con 0x7f90b00b3e50 2023-08-25T05:18:24.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.078+0000 7f909effd640 1 -- 172.21.15.55:0/3436666416 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 75) v1 ==== 85076+0+0 (secure 0 0 0) 0x7f90a00039c0 con 0x7f90b00b3e50 2023-08-25T05:18:24.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.078+0000 7f909effd640 1 --2- 172.21.15.55:0/3436666416 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f90900657a0 0x7f9090067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:24.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.078+0000 7f909effd640 1 -- 172.21.15.55:0/3436666416 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6494+0+0 (secure 0 0 0) 0x7f90a0120200 con 0x7f90b00b3e50 2023-08-25T05:18:24.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.078+0000 7f90add9b640 1 -- 172.21.15.55:0/3436666416 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f90900657a0 msgr2=0x7f9090067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3538591338 2023-08-25T05:18:24.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.078+0000 7f90add9b640 1 --2- 172.21.15.55:0/3436666416 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f90900657a0 0x7f9090067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:18:24.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.082+0000 7f909effd640 1 -- 172.21.15.55:0/3436666416 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f90a00edaa0 con 0x7f90b00b3e50 2023-08-25T05:18:24.106 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:24.107+0000 7f8eeec2c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:18:24.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.246+0000 7f90b4cec640 1 -- 172.21.15.55:0/3436666416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90b00b2330 con 0x7f90b00b3e50 2023-08-25T05:18:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.246+0000 7f909effd640 1 -- 172.21.15.55:0/3436666416 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+19044 (secure 0 0 0) 0x7f90a00f10c0 con 0x7f90b00b3e50 2023-08-25T05:18:24.249 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:24.249 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":143,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:18:20.851741+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:22:22.099798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-25T04:22:23.329827+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":112,"snap_epoch":143,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6833/3700713436":"2023-08-26T04:22:41.515664+0000","172.21.15.110:6832/3700713436":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/789108415":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/3185722269":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/452038739":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/327450935":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/3135214366":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/2514341378":"2023-08-26T04:22:41.515664+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":3,"length":54},{"begin":59,"length":54}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":49,"length":8},{"begin":105,"length":8}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:18:24.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.246+0000 7f90b4cec640 1 -- 172.21.15.55:0/3436666416 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f90900657a0 msgr2=0x7f9090067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:18:24.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.250+0000 7f90b4cec640 1 --2- 172.21.15.55:0/3436666416 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f90900657a0 0x7f9090067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.250+0000 7f90b4cec640 1 -- 172.21.15.55:0/3436666416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90b00b3e50 msgr2=0x7f90b0151d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:24.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.250+0000 7f90b4cec640 1 --2- 172.21.15.55:0/3436666416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90b00b3e50 0x7f90b0151d20 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f90a001c940 tx=0x7f90a001bab0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.250+0000 7f90b4cec640 1 -- 172.21.15.55:0/3436666416 shutdown_connections 2023-08-25T05:18:24.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.250+0000 7f90b4cec640 1 --2- 172.21.15.55:0/3436666416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f90b00d0da0 0x7f90b01f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.250+0000 7f90b4cec640 1 --2- 172.21.15.55:0/3436666416 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7f90900657a0 0x7f9090067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.250+0000 7f90b4cec640 1 --2- 172.21.15.55:0/3436666416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90b00cdde0 0x7f90b01f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.250+0000 7f90b4cec640 1 --2- 172.21.15.55:0/3436666416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90b00b3e50 0x7f90b0151d20 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.250+0000 7f90b4cec640 1 -- 172.21.15.55:0/3436666416 >> 172.21.15.55:0/3436666416 conn(0x7f90b009bae0 msgr2=0x7f90b00cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:24.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.250+0000 7f90b4cec640 1 -- 172.21.15.55:0/3436666416 shutdown_connections 2023-08-25T05:18:24.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.250+0000 7f90b4cec640 1 -- 172.21.15.55:0/3436666416 wait complete. 2023-08-25T05:18:24.254 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:24.250+0000 7f57e32fb180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:18:24.255 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:24.255+0000 7f8eeec2c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:18:24.271 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T04:22:22.099798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T04:22:23.329827+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 112, 'snap_epoch': 143, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T05:18:24.272 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T05:18:24.338 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:24.339+0000 7f8eeec2c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:18:24.342 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:24.342+0000 7f57e32fb180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:18:24.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4db737640 1 Processor -- start 2023-08-25T05:18:24.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4db737640 1 -- start start 2023-08-25T05:18:24.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4db737640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d415e3c0 0x7fe4d415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:24.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4db737640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe4d40d1290 0x7fe4d415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4db737640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d40cd5a0 con 0x7fe4d41601f0 2023-08-25T05:18:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4db737640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d40cd880 con 0x7fe4d40d1290 2023-08-25T05:18:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4db737640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d40cdb60 con 0x7fe4d415e3c0 2023-08-25T05:18:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4d94d3640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe4d41601f0 0x7fe4d40d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54920/0 (socket says 172.21.15.55:54920) 2023-08-25T05:18:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4d94d3640 1 -- 172.21.15.55:0/3889739249 learned_addr learned my addr 172.21.15.55:0/3889739249 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4d8cd2640 1 --2- 172.21.15.55:0/3889739249 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d415e3c0 0x7fe4d415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4d9cd4640 1 --2- 172.21.15.55:0/3889739249 >> v2:172.21.15.110:3300/0 conn(0x7fe4d40d1290 0x7fe4d415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4cbfff640 1 -- 172.21.15.55:0/3889739249 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656426903 0 0) 0x7fe4d40cd5a0 con 0x7fe4d41601f0 2023-08-25T05:18:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4cbfff640 1 -- 172.21.15.55:0/3889739249 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4c0003530 con 0x7fe4d41601f0 2023-08-25T05:18:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4d8cd2640 1 -- 172.21.15.55:0/3889739249 >> v2:172.21.15.110:3300/0 conn(0x7fe4d40d1290 msgr2=0x7fe4d415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4d8cd2640 1 --2- 172.21.15.55:0/3889739249 >> v2:172.21.15.110:3300/0 conn(0x7fe4d40d1290 0x7fe4d415e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4d8cd2640 1 -- 172.21.15.55:0/3889739249 >> v1:172.21.15.55:6789/0 conn(0x7fe4d41601f0 legacy=0x7fe4d40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4cbfff640 1 -- 172.21.15.55:0/3889739249 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2295989075 0 0) 0x7fe4c0003530 con 0x7fe4d41601f0 2023-08-25T05:18:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4d8cd2640 1 -- 172.21.15.55:0/3889739249 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d40cde40 con 0x7fe4d415e3c0 2023-08-25T05:18:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.418+0000 7fe4d9cd4640 1 --2- 172.21.15.55:0/3889739249 >> v2:172.21.15.110:3300/0 conn(0x7fe4d40d1290 0x7fe4d415e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:18:24.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.422+0000 7fe4d8cd2640 1 --2- 172.21.15.55:0/3889739249 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d415e3c0 0x7fe4d415d430 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe4c40097c0 tx=0x7fe4c401eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee698f2a6ec9e879 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:24.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.422+0000 7fe4cbfff640 1 -- 172.21.15.55:0/3889739249 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0001800 con 0x7fe4d415e3c0 2023-08-25T05:18:24.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.422+0000 7fe4cbfff640 1 -- 172.21.15.55:0/3889739249 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c40a85d0 con 0x7fe4d415e3c0 2023-08-25T05:18:24.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.422+0000 7fe4cbfff640 1 -- 172.21.15.55:0/3889739249 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c40a8960 con 0x7fe4d415e3c0 2023-08-25T05:18:24.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.422+0000 7fe4db737640 1 -- 172.21.15.55:0/3889739249 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d415e3c0 msgr2=0x7fe4d415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:24.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.422+0000 7fe4db737640 1 --2- 172.21.15.55:0/3889739249 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d415e3c0 0x7fe4d415d430 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe4c40097c0 tx=0x7fe4c401eb90 comp rx=0 tx=0).stop 2023-08-25T05:18:24.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.422+0000 7fe4db737640 1 -- 172.21.15.55:0/3889739249 shutdown_connections 2023-08-25T05:18:24.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.422+0000 7fe4db737640 1 --2- 172.21.15.55:0/3889739249 >> v2:172.21.15.110:3300/0 conn(0x7fe4d40d1290 0x7fe4d415e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.422+0000 7fe4db737640 1 --2- 172.21.15.55:0/3889739249 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d415e3c0 0x7fe4d415d430 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.422+0000 7fe4db737640 1 -- 172.21.15.55:0/3889739249 >> 172.21.15.55:0/3889739249 conn(0x7fe4d40d27d0 msgr2=0x7fe4d40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:24.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.422+0000 7fe4db737640 1 -- 172.21.15.55:0/3889739249 shutdown_connections 2023-08-25T05:18:24.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.422+0000 7fe4db737640 1 -- 172.21.15.55:0/3889739249 wait complete. 2023-08-25T05:18:24.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4db737640 1 Processor -- start 2023-08-25T05:18:24.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4db737640 1 -- start start 2023-08-25T05:18:24.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4db737640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4d40d1290 0x7fe4d415c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:24.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4db737640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4d415e3c0 0x7fe4d40cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:24.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4db737640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d41601f0 0x7fe4d40cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:24.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4db737640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d41f5ad0 con 0x7fe4d40d1290 2023-08-25T05:18:24.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4db737640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d41f5db0 con 0x7fe4d415e3c0 2023-08-25T05:18:24.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4db737640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d41f6090 con 0x7fe4d41601f0 2023-08-25T05:18:24.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4d94d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4d40d1290 0x7fe4d415c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:24.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4d94d3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4d40d1290 0x7fe4d415c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45008/0 (socket says 172.21.15.55:45008) 2023-08-25T05:18:24.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4d94d3640 1 -- 172.21.15.55:0/2065191318 learned_addr learned my addr 172.21.15.55:0/2065191318 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:24.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4d8cd2640 1 --2- 172.21.15.55:0/2065191318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4d415e3c0 0x7fe4d40cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:24.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4d9cd4640 1 --2- 172.21.15.55:0/2065191318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d41601f0 0x7fe4d40cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:24.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4d94d3640 1 -- 172.21.15.55:0/2065191318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d41601f0 msgr2=0x7fe4d40cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4d94d3640 1 --2- 172.21.15.55:0/2065191318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d41601f0 0x7fe4d40cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4d94d3640 1 -- 172.21.15.55:0/2065191318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4d415e3c0 msgr2=0x7fe4d40cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4d94d3640 1 --2- 172.21.15.55:0/2065191318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4d415e3c0 0x7fe4d40cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4d94d3640 1 -- 172.21.15.55:0/2065191318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc009a70 con 0x7fe4d40d1290 2023-08-25T05:18:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4d94d3640 1 --2- 172.21.15.55:0/2065191318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4d40d1290 0x7fe4d415c650 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000c780 tx=0x7fe4d000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:24.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4c9ffb640 1 -- 172.21.15.55:0/2065191318 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0007270 con 0x7fe4d40d1290 2023-08-25T05:18:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4c9ffb640 1 -- 172.21.15.55:0/2065191318 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d00073f0 con 0x7fe4d40d1290 2023-08-25T05:18:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4db737640 1 -- 172.21.15.55:0/2065191318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c4009420 con 0x7fe4d40d1290 2023-08-25T05:18:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4c9ffb640 1 -- 172.21.15.55:0/2065191318 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d00057b0 con 0x7fe4d40d1290 2023-08-25T05:18:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.426+0000 7fe4db737640 1 -- 172.21.15.55:0/2065191318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d40ce7c0 con 0x7fe4d40d1290 2023-08-25T05:18:24.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.430+0000 7fe4db737640 1 -- 172.21.15.55:0/2065191318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d40b5260 con 0x7fe4d40d1290 2023-08-25T05:18:24.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.430+0000 7fe4c9ffb640 1 -- 172.21.15.55:0/2065191318 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 75) v1 ==== 85076+0+0 (secure 0 0 0) 0x7fe4d0005910 con 0x7fe4d40d1290 2023-08-25T05:18:24.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.430+0000 7fe4c9ffb640 1 --2- 172.21.15.55:0/2065191318 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fe4b80657a0 0x7fe4b8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:24.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.430+0000 7fe4c9ffb640 1 -- 172.21.15.55:0/2065191318 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6494+0+0 (secure 0 0 0) 0x7fe4d0082d10 con 0x7fe4d40d1290 2023-08-25T05:18:24.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.430+0000 7fe4d8cd2640 1 -- 172.21.15.55:0/2065191318 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fe4b80657a0 msgr2=0x7fe4b8067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3538591338 2023-08-25T05:18:24.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.430+0000 7fe4d8cd2640 1 --2- 172.21.15.55:0/2065191318 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fe4b80657a0 0x7fe4b8067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:18:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.434+0000 7fe4c9ffb640 1 -- 172.21.15.55:0/2065191318 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe4d0088020 con 0x7fe4d40d1290 2023-08-25T05:18:24.504 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:24.498+0000 7f57e32fb180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:18:24.590 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:24.586+0000 7f57e32fb180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:18:24.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.594+0000 7fe4db737640 1 -- 172.21.15.55:0/2065191318 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4d4073ec0 con 0x7fe4d40d1290 2023-08-25T05:18:24.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.594+0000 7fe4c9ffb640 1 -- 172.21.15.55:0/2065191318 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v143) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4d0050500 con 0x7fe4d40d1290 2023-08-25T05:18:24.599 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T05:18:24.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.598+0000 7fe4db737640 1 -- 172.21.15.55:0/2065191318 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fe4b80657a0 msgr2=0x7fe4b8067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:18:24.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.598+0000 7fe4db737640 1 --2- 172.21.15.55:0/2065191318 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fe4b80657a0 0x7fe4b8067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.598+0000 7fe4db737640 1 -- 172.21.15.55:0/2065191318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4d40d1290 msgr2=0x7fe4d415c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:24.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.598+0000 7fe4db737640 1 --2- 172.21.15.55:0/2065191318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4d40d1290 0x7fe4d415c650 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000c780 tx=0x7fe4d000cb80 comp rx=0 tx=0).stop 2023-08-25T05:18:24.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.598+0000 7fe4db737640 1 -- 172.21.15.55:0/2065191318 shutdown_connections 2023-08-25T05:18:24.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.598+0000 7fe4db737640 1 --2- 172.21.15.55:0/2065191318 >> [v2:172.21.15.110:6832/3538591338,v1:172.21.15.110:6833/3538591338] conn(0x7fe4b80657a0 0x7fe4b8067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.598+0000 7fe4db737640 1 --2- 172.21.15.55:0/2065191318 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d41601f0 0x7fe4d40cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.598+0000 7fe4db737640 1 --2- 172.21.15.55:0/2065191318 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4d415e3c0 0x7fe4d40cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.598+0000 7fe4db737640 1 --2- 172.21.15.55:0/2065191318 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe4d40d1290 0x7fe4d415c650 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.598+0000 7fe4db737640 1 -- 172.21.15.55:0/2065191318 >> 172.21.15.55:0/2065191318 conn(0x7fe4d40d27d0 msgr2=0x7fe4d406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:24.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.598+0000 7fe4db737640 1 -- 172.21.15.55:0/2065191318 shutdown_connections 2023-08-25T05:18:24.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.598+0000 7fe4db737640 1 -- 172.21.15.55:0/2065191318 wait complete. 2023-08-25T05:18:24.620 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T05:18:24.655 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:24.655+0000 7f8eeec2c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:18:24.717 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:24.715+0000 7f8eeec2c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:18:24.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.778+0000 7f97a4dd2640 1 Processor -- start 2023-08-25T05:18:24.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.778+0000 7f97a4dd2640 1 -- start start 2023-08-25T05:18:24.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.778+0000 7f97a4dd2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97a00cd190 0x7f97a00d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:24.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.778+0000 7f97a4dd2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a00d0690 con 0x7f97a015c8a0 2023-08-25T05:18:24.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.778+0000 7f97a4dd2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a00cd6c0 con 0x7f97a00d10a0 2023-08-25T05:18:24.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.778+0000 7f97a4dd2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00d1530 con 0x7f97a00cd190 2023-08-25T05:18:24.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.778+0000 7f979f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f97a015c8a0 0x7f97a00b4aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54932/0 (socket says 172.21.15.55:54932) 2023-08-25T05:18:24.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.778+0000 7f979f7fe640 1 -- 172.21.15.55:0/3763106951 learned_addr learned my addr 172.21.15.55:0/3763106951 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:24.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.778+0000 7f979effd640 1 --2- 172.21.15.55:0/3763106951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97a00cd190 0x7f97a00d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:24.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.782+0000 7f979effd640 1 -- 172.21.15.55:0/3763106951 >> v1:172.21.15.110:6789/0 conn(0x7f97a00d10a0 legacy=0x7f97a00b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:24.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.782+0000 7f979effd640 1 -- 172.21.15.55:0/3763106951 >> v1:172.21.15.55:6789/0 conn(0x7f97a015c8a0 legacy=0x7f97a00b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:24.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.782+0000 7f979e7fc640 1 -- 172.21.15.55:0/3763106951 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260024971 0 0) 0x7f97a00d0690 con 0x7f97a015c8a0 2023-08-25T05:18:24.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.782+0000 7f979effd640 1 -- 172.21.15.55:0/3763106951 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a00cd9a0 con 0x7f97a00cd190 2023-08-25T05:18:24.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.782+0000 7f979effd640 1 --2- 172.21.15.55:0/3763106951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97a00cd190 0x7f97a00d0b60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f97940097f0 tx=0x7f979401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9af3fdcaa568a82b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:24.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.786+0000 7f979e7fc640 1 -- 172.21.15.55:0/3763106951 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97940aa5f0 con 0x7f97a00cd190 2023-08-25T05:18:24.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.786+0000 7f979e7fc640 1 -- 172.21.15.55:0/3763106951 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97940aa750 con 0x7f97a00cd190 2023-08-25T05:18:24.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.786+0000 7f979e7fc640 1 -- 172.21.15.55:0/3763106951 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97940aaae0 con 0x7f97a00cd190 2023-08-25T05:18:24.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.786+0000 7f97a4dd2640 1 -- 172.21.15.55:0/3763106951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97a00cd190 msgr2=0x7f97a00d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:24.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.786+0000 7f97a4dd2640 1 --2- 172.21.15.55:0/3763106951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97a00cd190 0x7f97a00d0b60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f97940097f0 tx=0x7f979401c490 comp rx=0 tx=0).stop 2023-08-25T05:18:24.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.786+0000 7f97a4dd2640 1 -- 172.21.15.55:0/3763106951 shutdown_connections 2023-08-25T05:18:24.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.786+0000 7f97a4dd2640 1 --2- 172.21.15.55:0/3763106951 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97a00cd190 0x7f97a00d0b60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.786+0000 7f97a4dd2640 1 -- 172.21.15.55:0/3763106951 >> 172.21.15.55:0/3763106951 conn(0x7f97a00d2610 msgr2=0x7f97a00d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:24.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.786+0000 7f97a4dd2640 1 -- 172.21.15.55:0/3763106951 shutdown_connections 2023-08-25T05:18:24.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.786+0000 7f97a4dd2640 1 -- 172.21.15.55:0/3763106951 wait complete. 2023-08-25T05:18:24.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f97a4dd2640 1 Processor -- start 2023-08-25T05:18:24.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f97a4dd2640 1 -- start start 2023-08-25T05:18:24.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f97a4dd2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97a00cd190 0x7f97a014ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:24.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f97a4dd2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97a00d10a0 0x7f97a00b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:24.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f97a4dd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a015c8a0 0x7f97a014a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:24.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f97a4dd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a014d430 con 0x7f97a015c8a0 2023-08-25T05:18:24.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f97a4dd2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a014c390 con 0x7f97a00cd190 2023-08-25T05:18:24.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f97a4dd2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a014c670 con 0x7f97a00d10a0 2023-08-25T05:18:24.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f979ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a015c8a0 0x7f97a014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:24.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f979ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a015c8a0 0x7f97a014a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45022/0 (socket says 172.21.15.55:45022) 2023-08-25T05:18:24.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f979ffff640 1 -- 172.21.15.55:0/305593006 learned_addr learned my addr 172.21.15.55:0/305593006 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:24.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f979effd640 1 --2- 172.21.15.55:0/305593006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97a00d10a0 0x7f97a00b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:24.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f979f7fe640 1 --2- 172.21.15.55:0/305593006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97a00cd190 0x7f97a014ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:24.795 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:24.791+0000 7f8e77363640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:24.795 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:24.791+0000 7f8e77363640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:24.795 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:24.791+0000 7f8e77363640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:24.795 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:24.791+0000 7f8e77363640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:24.795 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:24.791+0000 7f8e77363640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:24.795 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:24.795+0000 7f8e7ab6a640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:24.795 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:24.795+0000 7f8e7ab6a640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:24.796 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:24.795+0000 7f8e7ab6a640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:24.796 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:24.795+0000 7f8e7ab6a640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:24.796 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:24.795+0000 7f8e7ab6a640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:24.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f979ffff640 1 -- 172.21.15.55:0/305593006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97a00d10a0 msgr2=0x7f97a00b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:24.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f979ffff640 1 --2- 172.21.15.55:0/305593006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97a00d10a0 0x7f97a00b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f979ffff640 1 -- 172.21.15.55:0/305593006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97a00cd190 msgr2=0x7f97a014ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:24.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f979ffff640 1 --2- 172.21.15.55:0/305593006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97a00cd190 0x7f97a014ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f979ffff640 1 -- 172.21.15.55:0/305593006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9794009420 con 0x7f97a015c8a0 2023-08-25T05:18:24.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f979ffff640 1 --2- 172.21.15.55:0/305593006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a015c8a0 0x7f97a014a470 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f979800c770 tx=0x7f979800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:24.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f9787fff640 1 -- 172.21.15.55:0/305593006 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798003b80 con 0x7f97a015c8a0 2023-08-25T05:18:24.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f9787fff640 1 -- 172.21.15.55:0/305593006 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9798003ce0 con 0x7f97a015c8a0 2023-08-25T05:18:24.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f9787fff640 1 -- 172.21.15.55:0/305593006 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979800aa90 con 0x7f97a015c8a0 2023-08-25T05:18:24.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f97a4dd2640 1 -- 172.21.15.55:0/305593006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a014c950 con 0x7f97a015c8a0 2023-08-25T05:18:24.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.790+0000 7f97a4dd2640 1 -- 172.21.15.55:0/305593006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a014cf10 con 0x7f97a015c8a0 2023-08-25T05:18:24.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.794+0000 7f97a4dd2640 1 -- 172.21.15.55:0/305593006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a00d0940 con 0x7f97a015c8a0 2023-08-25T05:18:24.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.794+0000 7f9787fff640 1 -- 172.21.15.55:0/305593006 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 76) v1 ==== 84673+0+0 (secure 0 0 0) 0x7f979800abf0 con 0x7f97a015c8a0 2023-08-25T05:18:24.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.794+0000 7f9787fff640 1 -- 172.21.15.55:0/305593006 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6838+0+0 (secure 0 0 0) 0x7f97980828c0 con 0x7f97a015c8a0 2023-08-25T05:18:24.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.802+0000 7f9787fff640 1 -- 172.21.15.55:0/305593006 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9798050570 con 0x7f97a015c8a0 2023-08-25T05:18:24.947 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:24.946+0000 7f57e32fb180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:18:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.966+0000 7f97a4dd2640 1 -- 172.21.15.55:0/305593006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f97a00b8590 con 0x7f97a015c8a0 2023-08-25T05:18:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.966+0000 7f9787fff640 1 -- 172.21.15.55:0/305593006 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v144) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9798053b90 con 0x7f97a015c8a0 2023-08-25T05:18:24.969 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T05:18:24.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.966+0000 7f97a4dd2640 1 -- 172.21.15.55:0/305593006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a015c8a0 msgr2=0x7f97a014a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:24.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.966+0000 7f97a4dd2640 1 --2- 172.21.15.55:0/305593006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a015c8a0 0x7f97a014a470 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f979800c770 tx=0x7f979800cc30 comp rx=0 tx=0).stop 2023-08-25T05:18:24.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.966+0000 7f97a4dd2640 1 -- 172.21.15.55:0/305593006 shutdown_connections 2023-08-25T05:18:24.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.966+0000 7f97a4dd2640 1 --2- 172.21.15.55:0/305593006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97a015c8a0 0x7f97a014a470 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.966+0000 7f97a4dd2640 1 --2- 172.21.15.55:0/305593006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97a00d10a0 0x7f97a00b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.966+0000 7f97a4dd2640 1 --2- 172.21.15.55:0/305593006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97a00cd190 0x7f97a014ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:24.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.966+0000 7f97a4dd2640 1 -- 172.21.15.55:0/305593006 >> 172.21.15.55:0/305593006 conn(0x7f97a00d2610 msgr2=0x7f97a00b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.970+0000 7f97a4dd2640 1 -- 172.21.15.55:0/305593006 shutdown_connections 2023-08-25T05:18:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:24.970+0000 7f97a4dd2640 1 -- 172.21.15.55:0/305593006 wait complete. 2023-08-25T05:18:24.991 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T05:18:25.016 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:25.014+0000 7f57e32fb180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:18:25.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.138+0000 7fd515744640 1 Processor -- start 2023-08-25T05:18:25.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.138+0000 7fd515744640 1 -- start start 2023-08-25T05:18:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.142+0000 7fd515744640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5101601f0 0x7fd51015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.142+0000 7fd515744640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd51015e3c0 0x7fd5100d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.142+0000 7fd515744640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51015f8b0 con 0x7fd5100d10c0 2023-08-25T05:18:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.142+0000 7fd515744640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5100cd5a0 con 0x7fd51015e3c0 2023-08-25T05:18:25.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.142+0000 7fd515744640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5100cd880 con 0x7fd5101601f0 2023-08-25T05:18:25.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.142+0000 7fd50effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5101601f0 0x7fd51015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:25.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.142+0000 7fd5067fc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd51015e3c0 0x7fd5100d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:25.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.142+0000 7fd50effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5101601f0 0x7fd51015d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:41232/0 (socket says 172.21.15.55:41232) 2023-08-25T05:18:25.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.142+0000 7fd50effd640 1 -- 172.21.15.55:0/3390896820 learned_addr learned my addr 172.21.15.55:0/3390896820 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:25.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.142+0000 7fd50effd640 1 -- 172.21.15.55:0/3390896820 >> v2:172.21.15.110:3300/0 conn(0x7fd51015e3c0 msgr2=0x7fd5100d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:25.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.142+0000 7fd50effd640 1 --2- 172.21.15.55:0/3390896820 >> v2:172.21.15.110:3300/0 conn(0x7fd51015e3c0 0x7fd5100d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.142+0000 7fd50effd640 1 -- 172.21.15.55:0/3390896820 >> v1:172.21.15.110:6789/0 conn(0x7fd5100d10c0 legacy=0x7fd5100b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:25.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.142+0000 7fd50effd640 1 -- 172.21.15.55:0/3390896820 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5100cdb60 con 0x7fd5101601f0 2023-08-25T05:18:25.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.146+0000 7fd50effd640 1 --2- 172.21.15.55:0/3390896820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5101601f0 0x7fd51015d430 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8006fd0 tx=0x7fd4f801ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3e50e30967ba0d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:25.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.146+0000 7fd50e7fc640 1 -- 172.21.15.55:0/3390896820 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80a8a10 con 0x7fd5101601f0 2023-08-25T05:18:25.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.146+0000 7fd50e7fc640 1 -- 172.21.15.55:0/3390896820 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f80a8b70 con 0x7fd5101601f0 2023-08-25T05:18:25.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.146+0000 7fd50e7fc640 1 -- 172.21.15.55:0/3390896820 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80b0440 con 0x7fd5101601f0 2023-08-25T05:18:25.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.146+0000 7fd515744640 1 -- 172.21.15.55:0/3390896820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5101601f0 msgr2=0x7fd51015d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:25.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.146+0000 7fd515744640 1 --2- 172.21.15.55:0/3390896820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5101601f0 0x7fd51015d430 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8006fd0 tx=0x7fd4f801ed10 comp rx=0 tx=0).stop 2023-08-25T05:18:25.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.146+0000 7fd515744640 1 -- 172.21.15.55:0/3390896820 shutdown_connections 2023-08-25T05:18:25.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.146+0000 7fd515744640 1 --2- 172.21.15.55:0/3390896820 >> v2:172.21.15.110:3300/0 conn(0x7fd51015e3c0 0x7fd5100d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.146+0000 7fd515744640 1 --2- 172.21.15.55:0/3390896820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5101601f0 0x7fd51015d430 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.146+0000 7fd515744640 1 -- 172.21.15.55:0/3390896820 >> 172.21.15.55:0/3390896820 conn(0x7fd5100d27d0 msgr2=0x7fd5100d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:25.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.146+0000 7fd515744640 1 -- 172.21.15.55:0/3390896820 shutdown_connections 2023-08-25T05:18:25.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.146+0000 7fd515744640 1 -- 172.21.15.55:0/3390896820 wait complete. 2023-08-25T05:18:25.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.146+0000 7fd515744640 1 Processor -- start 2023-08-25T05:18:25.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.146+0000 7fd515744640 1 -- start start 2023-08-25T05:18:25.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd515744640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5100d10c0 0x7fd5100c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:25.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd515744640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd51015e3c0 0x7fd5100b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:25.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd515744640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5101601f0 0x7fd5100b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:25.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd515744640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5100b7e00 con 0x7fd51015e3c0 2023-08-25T05:18:25.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd515744640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5100b65c0 con 0x7fd5100d10c0 2023-08-25T05:18:25.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd515744640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5100b68a0 con 0x7fd5101601f0 2023-08-25T05:18:25.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd5067fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd51015e3c0 0x7fd5100b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:25.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd5067fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd51015e3c0 0x7fd5100b7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45036/0 (socket says 172.21.15.55:45036) 2023-08-25T05:18:25.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd5067fc640 1 -- 172.21.15.55:0/298392269 learned_addr learned my addr 172.21.15.55:0/298392269 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:25.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd50f7fe640 1 --2- 172.21.15.55:0/298392269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5101601f0 0x7fd5100b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:25.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd50effd640 1 --2- 172.21.15.55:0/298392269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5100d10c0 0x7fd5100c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:25.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd5067fc640 1 -- 172.21.15.55:0/298392269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5101601f0 msgr2=0x7fd5100b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:25.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd5067fc640 1 --2- 172.21.15.55:0/298392269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5101601f0 0x7fd5100b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd5067fc640 1 -- 172.21.15.55:0/298392269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5100d10c0 msgr2=0x7fd5100c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:25.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd5067fc640 1 --2- 172.21.15.55:0/298392269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5100d10c0 0x7fd5100c7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd5067fc640 1 -- 172.21.15.55:0/298392269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f8009480 con 0x7fd51015e3c0 2023-08-25T05:18:25.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd5067fc640 1 --2- 172.21.15.55:0/298392269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd51015e3c0 0x7fd5100b7380 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fd50000e930 tx=0x7fd50000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:25.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd507fff640 1 -- 172.21.15.55:0/298392269 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd500009690 con 0x7fd51015e3c0 2023-08-25T05:18:25.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd507fff640 1 -- 172.21.15.55:0/298392269 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50000ca00 con 0x7fd51015e3c0 2023-08-25T05:18:25.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd507fff640 1 -- 172.21.15.55:0/298392269 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50000cd70 con 0x7fd51015e3c0 2023-08-25T05:18:25.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd515744640 1 -- 172.21.15.55:0/298392269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5100b6b80 con 0x7fd51015e3c0 2023-08-25T05:18:25.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd515744640 1 -- 172.21.15.55:0/298392269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd510157d20 con 0x7fd51015e3c0 2023-08-25T05:18:25.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd515744640 1 -- 172.21.15.55:0/298392269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5100b5260 con 0x7fd51015e3c0 2023-08-25T05:18:25.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.150+0000 7fd507fff640 1 -- 172.21.15.55:0/298392269 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 76) v1 ==== 84673+0+0 (secure 0 0 0) 0x7fd500013470 con 0x7fd51015e3c0 2023-08-25T05:18:25.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.154+0000 7fd507fff640 1 -- 172.21.15.55:0/298392269 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6838+0+0 (secure 0 0 0) 0x7fd500082e90 con 0x7fd51015e3c0 2023-08-25T05:18:25.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.158+0000 7fd507fff640 1 -- 172.21.15.55:0/298392269 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd500050b10 con 0x7fd51015e3c0 2023-08-25T05:18:25.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.310+0000 7fd515744640 1 -- 172.21.15.55:0/298392269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd510073ec0 con 0x7fd51015e3c0 2023-08-25T05:18:25.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.310+0000 7fd507fff640 1 -- 172.21.15.55:0/298392269 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v144) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd500054130 con 0x7fd51015e3c0 2023-08-25T05:18:25.313 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T05:18:25.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.310+0000 7fd515744640 1 -- 172.21.15.55:0/298392269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd51015e3c0 msgr2=0x7fd5100b7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:25.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.310+0000 7fd515744640 1 --2- 172.21.15.55:0/298392269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd51015e3c0 0x7fd5100b7380 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fd50000e930 tx=0x7fd50000edf0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.310+0000 7fd515744640 1 -- 172.21.15.55:0/298392269 shutdown_connections 2023-08-25T05:18:25.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.310+0000 7fd515744640 1 --2- 172.21.15.55:0/298392269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5101601f0 0x7fd5100b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.310+0000 7fd515744640 1 --2- 172.21.15.55:0/298392269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd51015e3c0 0x7fd5100b7380 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.310+0000 7fd515744640 1 --2- 172.21.15.55:0/298392269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5100d10c0 0x7fd5100c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.310+0000 7fd515744640 1 -- 172.21.15.55:0/298392269 >> 172.21.15.55:0/298392269 conn(0x7fd5100d27d0 msgr2=0x7fd5100d2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:25.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.310+0000 7fd515744640 1 -- 172.21.15.55:0/298392269 shutdown_connections 2023-08-25T05:18:25.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.314+0000 7fd515744640 1 -- 172.21.15.55:0/298392269 wait complete. 2023-08-25T05:18:25.333 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T05:18:25.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.518+0000 7ff24286d640 1 Processor -- start 2023-08-25T05:18:25.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.518+0000 7ff24286d640 1 -- start start 2023-08-25T05:18:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.518+0000 7ff24286d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff23c0ad660 0x7ff23c0cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.518+0000 7ff24286d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff23c0cc6a0 0x7ff23c06c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.518+0000 7ff24286d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23c0cdf40 con 0x7ff23c0ada40 2023-08-25T05:18:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.518+0000 7ff24286d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23c06c7b0 con 0x7ff23c0cc6a0 2023-08-25T05:18:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.518+0000 7ff24286d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23c06b7b0 con 0x7ff23c0ad660 2023-08-25T05:18:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.518+0000 7ff240e0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff23c0cc6a0 0x7ff23c06c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.518+0000 7ff240e0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff23c0cc6a0 0x7ff23c06c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45048/0 (socket says 172.21.15.55:45048) 2023-08-25T05:18:25.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.518+0000 7ff240e0a640 1 -- 172.21.15.55:0/3065524000 learned_addr learned my addr 172.21.15.55:0/3065524000 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:25.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.518+0000 7ff23bfff640 1 --2- 172.21.15.55:0/3065524000 >> v2:172.21.15.110:3300/0 conn(0x7ff23c0ad660 0x7ff23c0cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:25.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.518+0000 7ff240e0a640 1 -- 172.21.15.55:0/3065524000 >> v2:172.21.15.110:3300/0 conn(0x7ff23c0ad660 msgr2=0x7ff23c0cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:25.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.518+0000 7ff240e0a640 1 --2- 172.21.15.55:0/3065524000 >> v2:172.21.15.110:3300/0 conn(0x7ff23c0ad660 0x7ff23c0cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.518+0000 7ff240e0a640 1 -- 172.21.15.55:0/3065524000 >> v1:172.21.15.55:6789/0 conn(0x7ff23c0ada40 legacy=0x7ff23c0cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:25.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.518+0000 7ff240e0a640 1 -- 172.21.15.55:0/3065524000 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c06ba90 con 0x7ff23c0cc6a0 2023-08-25T05:18:25.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.518+0000 7ff23affd640 1 -- 172.21.15.55:0/3065524000 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114683922 0 0) 0x7ff23c0cdf40 con 0x7ff23c0ada40 2023-08-25T05:18:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.522+0000 7ff240e0a640 1 --2- 172.21.15.55:0/3065524000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23c0cc6a0 0x7ff23c06c270 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7ff23c06dd00 tx=0x7ff23401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ce89785c111d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.522+0000 7ff23affd640 1 -- 172.21.15.55:0/3065524000 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2340a5760 con 0x7ff23c0cc6a0 2023-08-25T05:18:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.522+0000 7ff23affd640 1 -- 172.21.15.55:0/3065524000 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2340a58c0 con 0x7ff23c0cc6a0 2023-08-25T05:18:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.522+0000 7ff23affd640 1 -- 172.21.15.55:0/3065524000 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2340a5c50 con 0x7ff23c0cc6a0 2023-08-25T05:18:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.522+0000 7ff24286d640 1 -- 172.21.15.55:0/3065524000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23c0cc6a0 msgr2=0x7ff23c06c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.522+0000 7ff24286d640 1 --2- 172.21.15.55:0/3065524000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23c0cc6a0 0x7ff23c06c270 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7ff23c06dd00 tx=0x7ff23401c9d0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.522+0000 7ff24286d640 1 -- 172.21.15.55:0/3065524000 shutdown_connections 2023-08-25T05:18:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.522+0000 7ff24286d640 1 --2- 172.21.15.55:0/3065524000 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23c0cc6a0 0x7ff23c06c270 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.522+0000 7ff24286d640 1 --2- 172.21.15.55:0/3065524000 >> v2:172.21.15.110:3300/0 conn(0x7ff23c0ad660 0x7ff23c0cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.522+0000 7ff24286d640 1 -- 172.21.15.55:0/3065524000 >> 172.21.15.55:0/3065524000 conn(0x7ff23c069900 msgr2=0x7ff23c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.522+0000 7ff24286d640 1 -- 172.21.15.55:0/3065524000 shutdown_connections 2023-08-25T05:18:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.522+0000 7ff24286d640 1 -- 172.21.15.55:0/3065524000 wait complete. 2023-08-25T05:18:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.522+0000 7ff24286d640 1 Processor -- start 2023-08-25T05:18:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff24286d640 1 -- start start 2023-08-25T05:18:25.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff24286d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff23c0ad660 0x7ff23c1533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:25.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff24286d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff23c0ada40 0x7ff23c1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:25.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff24286d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23c0cc6a0 0x7ff23c0700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:25.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff24286d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c1538e0 con 0x7ff23c0cc6a0 2023-08-25T05:18:25.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff24286d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0717a0 con 0x7ff23c0ada40 2023-08-25T05:18:25.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff24286d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c155710 con 0x7ff23c0ad660 2023-08-25T05:18:25.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff240e0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23c0cc6a0 0x7ff23c0700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:25.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff240e0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23c0cc6a0 0x7ff23c0700f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45062/0 (socket says 172.21.15.55:45062) 2023-08-25T05:18:25.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff240e0a640 1 -- 172.21.15.55:0/2540419700 learned_addr learned my addr 172.21.15.55:0/2540419700 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:25.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff240e0a640 1 -- 172.21.15.55:0/2540419700 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff23c0ad660 msgr2=0x7ff23c1533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:25.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff240e0a640 1 --2- 172.21.15.55:0/2540419700 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff23c0ad660 0x7ff23c1533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff240e0a640 1 -- 172.21.15.55:0/2540419700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff23c0ada40 msgr2=0x7ff23c1551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:25.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff23b7fe640 1 --2- 172.21.15.55:0/2540419700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff23c0ada40 0x7ff23c1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff240e0a640 1 --2- 172.21.15.55:0/2540419700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff23c0ada40 0x7ff23c1551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff240e0a640 1 -- 172.21.15.55:0/2540419700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff234009b30 con 0x7ff23c0cc6a0 2023-08-25T05:18:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff23b7fe640 1 --2- 172.21.15.55:0/2540419700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff23c0ada40 0x7ff23c1551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:18:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff240e0a640 1 --2- 172.21.15.55:0/2540419700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23c0cc6a0 0x7ff23c0700f0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7ff2340af040 tx=0x7ff234019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff238ff9640 1 -- 172.21.15.55:0/2540419700 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2340b8670 con 0x7ff23c0cc6a0 2023-08-25T05:18:25.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff238ff9640 1 -- 172.21.15.55:0/2540419700 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2340b87f0 con 0x7ff23c0cc6a0 2023-08-25T05:18:25.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff24286d640 1 -- 172.21.15.55:0/2540419700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23c070e70 con 0x7ff23c0cc6a0 2023-08-25T05:18:25.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff238ff9640 1 -- 172.21.15.55:0/2540419700 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2340b8ba0 con 0x7ff23c0cc6a0 2023-08-25T05:18:25.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff24286d640 1 -- 172.21.15.55:0/2540419700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23c071430 con 0x7ff23c0cc6a0 2023-08-25T05:18:25.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.526+0000 7ff24286d640 1 -- 172.21.15.55:0/2540419700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23c073ec0 con 0x7ff23c0cc6a0 2023-08-25T05:18:25.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.530+0000 7ff238ff9640 1 -- 172.21.15.55:0/2540419700 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 76) v1 ==== 84673+0+0 (secure 0 0 0) 0x7ff2340b8d00 con 0x7ff23c0cc6a0 2023-08-25T05:18:25.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.530+0000 7ff238ff9640 1 -- 172.21.15.55:0/2540419700 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6838+0+0 (secure 0 0 0) 0x7ff23411e150 con 0x7ff23c0cc6a0 2023-08-25T05:18:25.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.534+0000 7ff238ff9640 1 -- 172.21.15.55:0/2540419700 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff2340ebd10 con 0x7ff23c0cc6a0 2023-08-25T05:18:25.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.690+0000 7ff24286d640 1 -- 172.21.15.55:0/2540419700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff23c06c8f0 con 0x7ff23c0cc6a0 2023-08-25T05:18:25.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.690+0000 7ff238ff9640 1 -- 172.21.15.55:0/2540419700 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v144) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff2340ef330 con 0x7ff23c0cc6a0 2023-08-25T05:18:25.692 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T05:18:25.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.690+0000 7ff24286d640 1 -- 172.21.15.55:0/2540419700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23c0cc6a0 msgr2=0x7ff23c0700f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:25.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.690+0000 7ff24286d640 1 --2- 172.21.15.55:0/2540419700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23c0cc6a0 0x7ff23c0700f0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7ff2340af040 tx=0x7ff234019770 comp rx=0 tx=0).stop 2023-08-25T05:18:25.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.690+0000 7ff24286d640 1 -- 172.21.15.55:0/2540419700 shutdown_connections 2023-08-25T05:18:25.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.690+0000 7ff24286d640 1 --2- 172.21.15.55:0/2540419700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23c0cc6a0 0x7ff23c0700f0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.690+0000 7ff24286d640 1 --2- 172.21.15.55:0/2540419700 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff23c0ada40 0x7ff23c1551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.690+0000 7ff24286d640 1 --2- 172.21.15.55:0/2540419700 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff23c0ad660 0x7ff23c1533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.690+0000 7ff24286d640 1 -- 172.21.15.55:0/2540419700 >> 172.21.15.55:0/2540419700 conn(0x7ff23c069900 msgr2=0x7ff23c0cba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:25.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.690+0000 7ff24286d640 1 -- 172.21.15.55:0/2540419700 shutdown_connections 2023-08-25T05:18:25.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.690+0000 7ff24286d640 1 -- 172.21.15.55:0/2540419700 wait complete. 2023-08-25T05:18:25.713 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:18:25.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.858+0000 7f7b343a3640 1 Processor -- start 2023-08-25T05:18:25.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.858+0000 7f7b343a3640 1 -- start start 2023-08-25T05:18:25.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.858+0000 7f7b343a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b2c15fef0 0x7f7b2c0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:25.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.858+0000 7f7b343a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7b2c0b2a40 0x7f7b2c0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:25.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.858+0000 7f7b343a3640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2c160570 con 0x7f7b2c0b2ea0 2023-08-25T05:18:25.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.858+0000 7f7b343a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2c1602d0 con 0x7f7b2c0b2a40 2023-08-25T05:18:25.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.858+0000 7f7b343a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c160810 con 0x7f7b2c15fef0 2023-08-25T05:18:25.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.858+0000 7f7b3193e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7b2c0b2a40 0x7f7b2c0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:25.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.858+0000 7f7b32940640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7b2c0b2ea0 0x7f7b2c0b14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54954/0 (socket says 172.21.15.55:54954) 2023-08-25T05:18:25.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.858+0000 7f7b32940640 1 -- 172.21.15.55:0/155006788 learned_addr learned my addr 172.21.15.55:0/155006788 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:25.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.858+0000 7f7b3213f640 1 --2- 172.21.15.55:0/155006788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b2c15fef0 0x7f7b2c0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:25.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.858+0000 7f7b3193e640 1 -- 172.21.15.55:0/155006788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b2c15fef0 msgr2=0x7f7b2c0cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:25.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.858+0000 7f7b3193e640 1 --2- 172.21.15.55:0/155006788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b2c15fef0 0x7f7b2c0cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.858+0000 7f7b3193e640 1 -- 172.21.15.55:0/155006788 >> v1:172.21.15.55:6789/0 conn(0x7f7b2c0b2ea0 legacy=0x7f7b2c0b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:25.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.858+0000 7f7b3193e640 1 -- 172.21.15.55:0/155006788 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2c160af0 con 0x7f7b2c0b2a40 2023-08-25T05:18:25.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.858+0000 7f7b3213f640 1 --2- 172.21.15.55:0/155006788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b2c15fef0 0x7f7b2c0cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:25.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.862+0000 7f7b3193e640 1 --2- 172.21.15.55:0/155006788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b2c0b2a40 0x7f7b2c0ce7a0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0097c0 tx=0x7f7b1c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1b7533f6e9dc8a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:25.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.862+0000 7f7b3113d640 1 -- 172.21.15.55:0/155006788 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c0ab600 con 0x7f7b2c0b2a40 2023-08-25T05:18:25.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.862+0000 7f7b3113d640 1 -- 172.21.15.55:0/155006788 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c0a7050 con 0x7f7b2c0b2a40 2023-08-25T05:18:25.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.862+0000 7f7b3113d640 1 -- 172.21.15.55:0/155006788 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c0ab980 con 0x7f7b2c0b2a40 2023-08-25T05:18:25.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.862+0000 7f7b343a3640 1 -- 172.21.15.55:0/155006788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b2c0b2a40 msgr2=0x7f7b2c0ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:25.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.862+0000 7f7b343a3640 1 --2- 172.21.15.55:0/155006788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b2c0b2a40 0x7f7b2c0ce7a0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0097c0 tx=0x7f7b1c01c3c0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.862+0000 7f7b343a3640 1 -- 172.21.15.55:0/155006788 shutdown_connections 2023-08-25T05:18:25.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.862+0000 7f7b343a3640 1 --2- 172.21.15.55:0/155006788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b2c0b2a40 0x7f7b2c0ce7a0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.862+0000 7f7b343a3640 1 --2- 172.21.15.55:0/155006788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b2c15fef0 0x7f7b2c0cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.862+0000 7f7b343a3640 1 -- 172.21.15.55:0/155006788 >> 172.21.15.55:0/155006788 conn(0x7f7b2c069d00 msgr2=0x7f7b2c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:25.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.862+0000 7f7b343a3640 1 -- 172.21.15.55:0/155006788 shutdown_connections 2023-08-25T05:18:25.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.862+0000 7f7b343a3640 1 -- 172.21.15.55:0/155006788 wait complete. 2023-08-25T05:18:25.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b343a3640 1 Processor -- start 2023-08-25T05:18:25.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b343a3640 1 -- start start 2023-08-25T05:18:25.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b343a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b2c0b2a40 0x7f7b2c15f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:25.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b343a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b2c0b2ea0 0x7f7b2c0979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:25.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b343a3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b2c15fef0 0x7f7b2c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:25.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b343a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c097f10 con 0x7f7b2c0b2a40 2023-08-25T05:18:25.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b343a3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c15cef0 con 0x7f7b2c15fef0 2023-08-25T05:18:25.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b343a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2c15e710 con 0x7f7b2c0b2ea0 2023-08-25T05:18:25.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b3213f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b2c0b2a40 0x7f7b2c15f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:25.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b3213f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b2c0b2a40 0x7f7b2c15f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45070/0 (socket says 172.21.15.55:45070) 2023-08-25T05:18:25.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b3213f640 1 -- 172.21.15.55:0/1026382440 learned_addr learned my addr 172.21.15.55:0/1026382440 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:25.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b3213f640 1 -- 172.21.15.55:0/1026382440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b2c0b2ea0 msgr2=0x7f7b2c0979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:25.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b3213f640 1 --2- 172.21.15.55:0/1026382440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b2c0b2ea0 0x7f7b2c0979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b3213f640 1 -- 172.21.15.55:0/1026382440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b2c15fef0 msgr2=0x7f7b2c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:25.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b3213f640 1 --2- 172.21.15.55:0/1026382440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b2c15fef0 0x7f7b2c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:25.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b3213f640 1 -- 172.21.15.55:0/1026382440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c009420 con 0x7f7b2c0b2a40 2023-08-25T05:18:25.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b3213f640 1 --2- 172.21.15.55:0/1026382440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b2c0b2a40 0x7f7b2c15f140 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f7b2800e840 tx=0x7f7b2800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:25.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b22ffd640 1 -- 172.21.15.55:0/1026382440 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2800c8d0 con 0x7f7b2c0b2a40 2023-08-25T05:18:25.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b22ffd640 1 -- 172.21.15.55:0/1026382440 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2800ca30 con 0x7f7b2c0b2a40 2023-08-25T05:18:25.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b22ffd640 1 -- 172.21.15.55:0/1026382440 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2800cde0 con 0x7f7b2c0b2a40 2023-08-25T05:18:25.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b343a3640 1 -- 172.21.15.55:0/1026382440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2c15e960 con 0x7f7b2c0b2a40 2023-08-25T05:18:25.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.866+0000 7f7b343a3640 1 -- 172.21.15.55:0/1026382440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2c155b50 con 0x7f7b2c0b2a40 2023-08-25T05:18:25.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.870+0000 7f7b343a3640 1 -- 172.21.15.55:0/1026382440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2c04dbe0 con 0x7f7b2c0b2a40 2023-08-25T05:18:25.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.870+0000 7f7b22ffd640 1 -- 172.21.15.55:0/1026382440 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 77) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f7b28013410 con 0x7f7b2c0b2a40 2023-08-25T05:18:25.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.870+0000 7f7b22ffd640 1 --2- 172.21.15.55:0/1026382440 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f7b100654d0 0x7f7b10067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:25.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.870+0000 7f7b22ffd640 1 -- 172.21.15.55:0/1026382440 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6838+0+0 (secure 0 0 0) 0x7f7b28082bb0 con 0x7f7b2c0b2a40 2023-08-25T05:18:25.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.870+0000 7f7b3193e640 1 --2- 172.21.15.55:0/1026382440 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f7b100654d0 0x7f7b10067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:25.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.870+0000 7f7b3193e640 1 --2- 172.21.15.55:0/1026382440 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f7b100654d0 0x7f7b10067990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0ad000 tx=0x7f7b1c004740 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:25.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:25.874+0000 7f7b22ffd640 1 -- 172.21.15.55:0/1026382440 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7b280505d0 con 0x7f7b2c0b2a40 2023-08-25T05:18:26.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.066+0000 7f7b343a3640 1 -- 172.21.15.55:0/1026382440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b2c0ccc40 con 0x7f7b2c0b2a40 2023-08-25T05:18:26.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.066+0000 7f7b22ffd640 1 -- 172.21.15.55:0/1026382440 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f7b28053bf0 con 0x7f7b2c0b2a40 2023-08-25T05:18:26.068 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:26.068 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7493,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/2640392190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2640392190},{"type":"v1","addr":"172.21.15.110:6837","nonce":2640392190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62},{"gid":8428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/2668985619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2668985619},{"type":"v1","addr":"172.21.15.110:6836","nonce":2668985619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61},{"gid":9018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/210118982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":210118982},{"type":"v1","addr":"172.21.15.55:6834","nonce":210118982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:22:24.336177+0000","modified":"2023-08-25T04:22:27.988148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9024":{"gid":9024,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/2424299953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2424299953},{"type":"v1","addr":"172.21.15.55:6835","nonce":2424299953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-25T05:18:26.069 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 66 2023-08-25T05:18:26.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.066+0000 7f7b343a3640 1 -- 172.21.15.55:0/1026382440 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f7b100654d0 msgr2=0x7f7b10067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:26.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.066+0000 7f7b343a3640 1 --2- 172.21.15.55:0/1026382440 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f7b100654d0 0x7f7b10067990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0ad000 tx=0x7f7b1c004740 comp rx=0 tx=0).stop 2023-08-25T05:18:26.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.066+0000 7f7b343a3640 1 -- 172.21.15.55:0/1026382440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b2c0b2a40 msgr2=0x7f7b2c15f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:26.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.066+0000 7f7b343a3640 1 --2- 172.21.15.55:0/1026382440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b2c0b2a40 0x7f7b2c15f140 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f7b2800e840 tx=0x7f7b2800ed00 comp rx=0 tx=0).stop 2023-08-25T05:18:26.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.066+0000 7f7b343a3640 1 -- 172.21.15.55:0/1026382440 shutdown_connections 2023-08-25T05:18:26.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.066+0000 7f7b343a3640 1 --2- 172.21.15.55:0/1026382440 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f7b100654d0 0x7f7b10067990 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.066+0000 7f7b343a3640 1 --2- 172.21.15.55:0/1026382440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7b2c15fef0 0x7f7b2c0aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.066+0000 7f7b343a3640 1 --2- 172.21.15.55:0/1026382440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7b2c0b2ea0 0x7f7b2c0979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.066+0000 7f7b343a3640 1 --2- 172.21.15.55:0/1026382440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b2c0b2a40 0x7f7b2c15f140 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.066+0000 7f7b343a3640 1 -- 172.21.15.55:0/1026382440 >> 172.21.15.55:0/1026382440 conn(0x7f7b2c069d00 msgr2=0x7f7b2c0ac480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:26.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.066+0000 7f7b343a3640 1 -- 172.21.15.55:0/1026382440 shutdown_connections 2023-08-25T05:18:26.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.066+0000 7f7b343a3640 1 -- 172.21.15.55:0/1026382440 wait complete. 2023-08-25T05:18:26.089 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:18:26.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.230+0000 7f89b0c56640 1 Processor -- start 2023-08-25T05:18:26.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.230+0000 7f89b0c56640 1 -- start start 2023-08-25T05:18:26.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.230+0000 7f89b0c56640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89ac0ad950 0x7f89ac0cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.230+0000 7f89b0c56640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f89ac0c89f0 0x7f89ac0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89b0c56640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ac0b2650 con 0x7f89ac06c000 2023-08-25T05:18:26.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89b0c56640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac0b11f0 con 0x7f89ac0c89f0 2023-08-25T05:18:26.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89b0c56640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac159d50 con 0x7f89ac0ad950 2023-08-25T05:18:26.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89aad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f89ac06c000 0x7f89ac15d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54966/0 (socket says 172.21.15.55:54966) 2023-08-25T05:18:26.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89aad9d640 1 -- 172.21.15.55:0/1236358047 learned_addr learned my addr 172.21.15.55:0/1236358047 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:26.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89aa59c640 1 --2- 172.21.15.55:0/1236358047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89ac0ad950 0x7f89ac0cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a9d9b640 1 -- 172.21.15.55:0/1236358047 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980586506 0 0) 0x7f89ac0b2650 con 0x7f89ac06c000 2023-08-25T05:18:26.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a1d9b640 1 --2- 172.21.15.55:0/1236358047 >> v2:172.21.15.110:3300/0 conn(0x7f89ac0c89f0 0x7f89ac0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a9d9b640 1 -- 172.21.15.55:0/1236358047 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8998003530 con 0x7f89ac06c000 2023-08-25T05:18:26.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a9d9b640 1 -- 172.21.15.55:0/1236358047 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4247987419 0 0) 0x7f8998003530 con 0x7f89ac06c000 2023-08-25T05:18:26.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a9d9b640 1 -- 172.21.15.55:0/1236358047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89ac0ad950 msgr2=0x7f89ac0cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:26.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a9d9b640 1 --2- 172.21.15.55:0/1236358047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89ac0ad950 0x7f89ac0cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a9d9b640 1 -- 172.21.15.55:0/1236358047 >> v2:172.21.15.110:3300/0 conn(0x7f89ac0c89f0 msgr2=0x7f89ac0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:26.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a9d9b640 1 --2- 172.21.15.55:0/1236358047 >> v2:172.21.15.110:3300/0 conn(0x7f89ac0c89f0 0x7f89ac0ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a9d9b640 1 -- 172.21.15.55:0/1236358047 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac0cc880 con 0x7f89ac06c000 2023-08-25T05:18:26.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a9d9b640 1 -- 172.21.15.55:0/1236358047 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f89a4001a00 con 0x7f89ac06c000 2023-08-25T05:18:26.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a9d9b640 1 -- 172.21.15.55:0/1236358047 >> v1:172.21.15.55:6789/0 conn(0x7f89ac06c000 legacy=0x7f89ac15d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:26.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a9d9b640 1 --2- 172.21.15.55:0/1236358047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89ac0ad950 0x7f8998003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a9d9b640 1 --2- 172.21.15.55:0/1236358047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8998003f00 0x7f89980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a9d9b640 1 --2- 172.21.15.55:0/1236358047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8998004d10 0x7f8998005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a9d9b640 1 -- 172.21.15.55:0/1236358047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0b11f0 con 0x7f8998003f00 2023-08-25T05:18:26.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a9d9b640 1 -- 172.21.15.55:0/1236358047 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac159d50 con 0x7f8998004d10 2023-08-25T05:18:26.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a9d9b640 1 -- 172.21.15.55:0/1236358047 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899800dbf0 con 0x7f89ac0ad950 2023-08-25T05:18:26.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a1d9b640 1 --2- 172.21.15.55:0/1236358047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8998003f00 0x7f89980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89aad9d640 1 --2- 172.21.15.55:0/1236358047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8998004d10 0x7f8998005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89aa59c640 1 --2- 172.21.15.55:0/1236358047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89ac0ad950 0x7f8998003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a1d9b640 1 -- 172.21.15.55:0/1236358047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89ac0ad950 msgr2=0x7f8998003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:26.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a1d9b640 1 --2- 172.21.15.55:0/1236358047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89ac0ad950 0x7f8998003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a1d9b640 1 -- 172.21.15.55:0/1236358047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8998004d10 msgr2=0x7f8998005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:26.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a1d9b640 1 --2- 172.21.15.55:0/1236358047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8998004d10 0x7f8998005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89a1d9b640 1 -- 172.21.15.55:0/1236358047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8998003530 con 0x7f8998003f00 2023-08-25T05:18:26.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.234+0000 7f89aad9d640 1 --2- 172.21.15.55:0/1236358047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8998004d10 0x7f8998005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:26.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.238+0000 7f89a1d9b640 1 --2- 172.21.15.55:0/1236358047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8998003f00 0x7f89980047d0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f899c009ae0 tx=0x7f899c01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d335968bf98a919b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:26.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.238+0000 7f89a9d9b640 1 -- 172.21.15.55:0/1236358047 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c0a6510 con 0x7f8998003f00 2023-08-25T05:18:26.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.238+0000 7f89a9d9b640 1 -- 172.21.15.55:0/1236358047 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899c0a6670 con 0x7f8998003f00 2023-08-25T05:18:26.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.238+0000 7f89a9d9b640 1 -- 172.21.15.55:0/1236358047 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c0a6a20 con 0x7f8998003f00 2023-08-25T05:18:26.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.238+0000 7f89b0c56640 1 -- 172.21.15.55:0/1236358047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8998003f00 msgr2=0x7f89980047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:26.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.238+0000 7f89b0c56640 1 --2- 172.21.15.55:0/1236358047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8998003f00 0x7f89980047d0 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f899c009ae0 tx=0x7f899c01ca20 comp rx=0 tx=0).stop 2023-08-25T05:18:26.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.238+0000 7f89aad9d640 1 -- 172.21.15.55:0/1236358047 reap_dead start 2023-08-25T05:18:26.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.238+0000 7f89b0c56640 1 -- 172.21.15.55:0/1236358047 shutdown_connections 2023-08-25T05:18:26.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.238+0000 7f89b0c56640 1 -- 172.21.15.55:0/1236358047 >> 172.21.15.55:0/1236358047 conn(0x7f89ac069d00 msgr2=0x7f89ac06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:26.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.238+0000 7f89b0c56640 1 -- 172.21.15.55:0/1236358047 shutdown_connections 2023-08-25T05:18:26.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.238+0000 7f89b0c56640 1 -- 172.21.15.55:0/1236358047 wait complete. 2023-08-25T05:18:26.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.238+0000 7f89b0c56640 1 Processor -- start 2023-08-25T05:18:26.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.238+0000 7f89b0c56640 1 -- start start 2023-08-25T05:18:26.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89b0c56640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8998003f00 0x7f89ac0c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89b0c56640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89ac153860 0x7f89ac152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89b0c56640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89ac153e20 0x7f89ac1542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89b0c56640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac1f5860 con 0x7f8998003f00 2023-08-25T05:18:26.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89b0c56640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac1f4cb0 con 0x7f89ac153860 2023-08-25T05:18:26.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89b0c56640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac152c80 con 0x7f89ac153e20 2023-08-25T05:18:26.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89aa59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8998003f00 0x7f89ac0c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89aa59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8998003f00 0x7f89ac0c7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45088/0 (socket says 172.21.15.55:45088) 2023-08-25T05:18:26.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89aa59c640 1 -- 172.21.15.55:0/1447039816 learned_addr learned my addr 172.21.15.55:0/1447039816 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:26.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89a1d9b640 1 --2- 172.21.15.55:0/1447039816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89ac153860 0x7f89ac152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89aad9d640 1 --2- 172.21.15.55:0/1447039816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89ac153e20 0x7f89ac1542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89aa59c640 1 -- 172.21.15.55:0/1447039816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89ac153e20 msgr2=0x7f89ac1542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:26.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89aa59c640 1 --2- 172.21.15.55:0/1447039816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89ac153e20 0x7f89ac1542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89aa59c640 1 -- 172.21.15.55:0/1447039816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89ac153860 msgr2=0x7f89ac152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:26.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89aa59c640 1 --2- 172.21.15.55:0/1447039816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89ac153860 0x7f89ac152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89aa59c640 1 -- 172.21.15.55:0/1447039816 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac0c8280 con 0x7f8998003f00 2023-08-25T05:18:26.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89aa59c640 1 --2- 172.21.15.55:0/1447039816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8998003f00 0x7f89ac0c7910 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f89940119d0 tx=0x7f8994011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:26.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89a37fe640 1 -- 172.21.15.55:0/1447039816 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899400faf0 con 0x7f8998003f00 2023-08-25T05:18:26.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89a37fe640 1 -- 172.21.15.55:0/1447039816 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899400fc50 con 0x7f8998003f00 2023-08-25T05:18:26.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89a37fe640 1 -- 172.21.15.55:0/1447039816 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994014440 con 0x7f8998003f00 2023-08-25T05:18:26.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89b0c56640 1 -- 172.21.15.55:0/1447039816 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ac1f4ec0 con 0x7f8998003f00 2023-08-25T05:18:26.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89b0c56640 1 -- 172.21.15.55:0/1447039816 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ac1f5480 con 0x7f8998003f00 2023-08-25T05:18:26.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89b0c56640 1 -- 172.21.15.55:0/1447039816 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ac1f5640 con 0x7f8998003f00 2023-08-25T05:18:26.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.242+0000 7f89a37fe640 1 -- 172.21.15.55:0/1447039816 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 77) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f89940145a0 con 0x7f8998003f00 2023-08-25T05:18:26.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.246+0000 7f89a37fe640 1 --2- 172.21.15.55:0/1447039816 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f898c0654c0 0x7f898c067980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.246+0000 7f89a37fe640 1 -- 172.21.15.55:0/1447039816 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6838+0+0 (secure 0 0 0) 0x7f89940834c0 con 0x7f8998003f00 2023-08-25T05:18:26.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.246+0000 7f89a1d9b640 1 --2- 172.21.15.55:0/1447039816 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f898c0654c0 0x7f898c067980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.246+0000 7f89a1d9b640 1 --2- 172.21.15.55:0/1447039816 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f898c0654c0 0x7f898c067980 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f899c0af000 tx=0x7f899c0046d0 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:26.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.250+0000 7f89a37fe640 1 -- 172.21.15.55:0/1447039816 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8994050fa0 con 0x7f8998003f00 2023-08-25T05:18:26.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.406+0000 7f89b0c56640 1 -- 172.21.15.55:0/1447039816 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89ac04dbe0 con 0x7f8998003f00 2023-08-25T05:18:26.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.406+0000 7f89a37fe640 1 -- 172.21.15.55:0/1447039816 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+19553 (secure 0 0 0) 0x7f89940545c0 con 0x7f8998003f00 2023-08-25T05:18:26.410 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:26.411 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":144,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:18:24.719643+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:22:22.099798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-25T04:22:23.329827+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":144,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3450681761":"2023-08-26T05:18:24.719592+0000","172.21.15.110:0/3855906458":"2023-08-26T05:18:24.719592+0000","172.21.15.110:0/1252829579":"2023-08-26T05:18:24.719592+0000","172.21.15.110:0/2636731011":"2023-08-26T05:18:24.719592+0000","172.21.15.110:6833/3538591338":"2023-08-26T05:18:24.719592+0000","172.21.15.110:6833/3700713436":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/359151790":"2023-08-26T05:18:24.719592+0000","172.21.15.110:6832/3700713436":"2023-08-26T04:22:41.515664+0000","172.21.15.110:6832/3538591338":"2023-08-26T05:18:24.719592+0000","172.21.15.110:0/789108415":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/3818846433":"2023-08-26T05:18:24.719592+0000","172.21.15.110:0/3185722269":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/452038739":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/327450935":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/3135214366":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/2514341378":"2023-08-26T04:22:41.515664+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[{"pool":18,"snaps":[{"begin":57,"length":1},{"begin":113,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:18:26.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.410+0000 7f89b0c56640 1 -- 172.21.15.55:0/1447039816 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f898c0654c0 msgr2=0x7f898c067980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:26.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.410+0000 7f89b0c56640 1 --2- 172.21.15.55:0/1447039816 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f898c0654c0 0x7f898c067980 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f899c0af000 tx=0x7f899c0046d0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.410+0000 7f89b0c56640 1 -- 172.21.15.55:0/1447039816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8998003f00 msgr2=0x7f89ac0c7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:26.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.410+0000 7f89b0c56640 1 --2- 172.21.15.55:0/1447039816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8998003f00 0x7f89ac0c7910 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f89940119d0 tx=0x7f8994011e90 comp rx=0 tx=0).stop 2023-08-25T05:18:26.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.410+0000 7f89b0c56640 1 -- 172.21.15.55:0/1447039816 shutdown_connections 2023-08-25T05:18:26.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.410+0000 7f89b0c56640 1 --2- 172.21.15.55:0/1447039816 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f898c0654c0 0x7f898c067980 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.410+0000 7f89b0c56640 1 --2- 172.21.15.55:0/1447039816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89ac153e20 0x7f89ac1542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.410+0000 7f89b0c56640 1 --2- 172.21.15.55:0/1447039816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89ac153860 0x7f89ac152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.410+0000 7f89b0c56640 1 --2- 172.21.15.55:0/1447039816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8998003f00 0x7f89ac0c7910 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.410+0000 7f89b0c56640 1 -- 172.21.15.55:0/1447039816 >> 172.21.15.55:0/1447039816 conn(0x7f89ac069d00 msgr2=0x7f89ac0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:26.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.410+0000 7f89b0c56640 1 -- 172.21.15.55:0/1447039816 shutdown_connections 2023-08-25T05:18:26.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.410+0000 7f89b0c56640 1 -- 172.21.15.55:0/1447039816 wait complete. 2023-08-25T05:18:26.432 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-25T05:18:26.434 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:18:26.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.574+0000 7f057410a640 1 Processor -- start 2023-08-25T05:18:26.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.574+0000 7f057410a640 1 -- start start 2023-08-25T05:18:26.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.578+0000 7f057410a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056c15a830 0x7f056c0cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.578+0000 7f057410a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f056c0cd630 0x7f056c06d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.578+0000 7f057410a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056c0ce170 con 0x7f056c0cc2b0 2023-08-25T05:18:26.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.578+0000 7f057410a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c0cc6f0 con 0x7f056c0cd630 2023-08-25T05:18:26.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.578+0000 7f057410a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c0ce3a0 con 0x7f056c15a830 2023-08-25T05:18:26.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.578+0000 7f05726a7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f056c0cd630 0x7f056c06d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.578+0000 7f05726a7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f056c0cd630 0x7f056c06d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45094/0 (socket says 172.21.15.55:45094) 2023-08-25T05:18:26.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.578+0000 7f05726a7640 1 -- 172.21.15.55:0/1474752127 learned_addr learned my addr 172.21.15.55:0/1474752127 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:26.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.578+0000 7f0571ea6640 1 --2- 172.21.15.55:0/1474752127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056c15a830 0x7f056c0cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.578+0000 7f05726a7640 1 -- 172.21.15.55:0/1474752127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056c15a830 msgr2=0x7f056c0cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:26.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.578+0000 7f05726a7640 1 --2- 172.21.15.55:0/1474752127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056c15a830 0x7f056c0cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.578+0000 7f05726a7640 1 -- 172.21.15.55:0/1474752127 >> v1:172.21.15.110:6789/0 conn(0x7f056c0cc2b0 legacy=0x7f056c0ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:26.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.578+0000 7f05726a7640 1 -- 172.21.15.55:0/1474752127 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c0ce660 con 0x7f056c0cd630 2023-08-25T05:18:26.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.578+0000 7f05726a7640 1 --2- 172.21.15.55:0/1474752127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f056c0cd630 0x7f056c06d550 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f0564009e50 tx=0x7f056401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e65c045daf5035 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:26.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.578+0000 7f0570ea4640 1 -- 172.21.15.55:0/1474752127 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640a58a0 con 0x7f056c0cd630 2023-08-25T05:18:26.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f0570ea4640 1 -- 172.21.15.55:0/1474752127 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05640a5a00 con 0x7f056c0cd630 2023-08-25T05:18:26.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f0570ea4640 1 -- 172.21.15.55:0/1474752127 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640a5d90 con 0x7f056c0cd630 2023-08-25T05:18:26.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f057410a640 1 -- 172.21.15.55:0/1474752127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f056c0cd630 msgr2=0x7f056c06d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:26.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f057410a640 1 --2- 172.21.15.55:0/1474752127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f056c0cd630 0x7f056c06d550 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f0564009e50 tx=0x7f056401c9e0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f057410a640 1 -- 172.21.15.55:0/1474752127 shutdown_connections 2023-08-25T05:18:26.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f057410a640 1 --2- 172.21.15.55:0/1474752127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f056c0cd630 0x7f056c06d550 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f057410a640 1 --2- 172.21.15.55:0/1474752127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056c15a830 0x7f056c0cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f057410a640 1 -- 172.21.15.55:0/1474752127 >> 172.21.15.55:0/1474752127 conn(0x7f056c0d05a0 msgr2=0x7f056c0d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:26.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f057410a640 1 -- 172.21.15.55:0/1474752127 shutdown_connections 2023-08-25T05:18:26.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f057410a640 1 -- 172.21.15.55:0/1474752127 wait complete. 2023-08-25T05:18:26.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f057410a640 1 Processor -- start 2023-08-25T05:18:26.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f057410a640 1 -- start start 2023-08-25T05:18:26.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f057410a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056c0cc2b0 0x7f056c151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f057410a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f056c0cd630 0x7f056c0b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f057410a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f056c15a830 0x7f056c06af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f057410a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c0b5ae0 con 0x7f056c0cd630 2023-08-25T05:18:26.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f057410a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c0b4b50 con 0x7f056c15a830 2023-08-25T05:18:26.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f057410a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c06b460 con 0x7f056c0cc2b0 2023-08-25T05:18:26.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f05716a5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f056c0cd630 0x7f056c0b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f05716a5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f056c0cd630 0x7f056c0b55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45104/0 (socket says 172.21.15.55:45104) 2023-08-25T05:18:26.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f05716a5640 1 -- 172.21.15.55:0/1076256643 learned_addr learned my addr 172.21.15.55:0/1076256643 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:26.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f0571ea6640 1 --2- 172.21.15.55:0/1076256643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056c0cc2b0 0x7f056c151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.582+0000 7f05726a7640 1 --2- 172.21.15.55:0/1076256643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f056c15a830 0x7f056c06af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.586+0000 7f05716a5640 1 -- 172.21.15.55:0/1076256643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056c0cc2b0 msgr2=0x7f056c151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:26.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.586+0000 7f05716a5640 1 --2- 172.21.15.55:0/1076256643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056c0cc2b0 0x7f056c151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.586+0000 7f05716a5640 1 -- 172.21.15.55:0/1076256643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f056c15a830 msgr2=0x7f056c06af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:26.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.586+0000 7f05716a5640 1 --2- 172.21.15.55:0/1076256643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f056c15a830 0x7f056c06af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.586+0000 7f05716a5640 1 -- 172.21.15.55:0/1076256643 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0564009b30 con 0x7f056c0cd630 2023-08-25T05:18:26.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.586+0000 7f05716a5640 1 --2- 172.21.15.55:0/1076256643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f056c0cd630 0x7f056c0b55a0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f055c00c500 tx=0x7f055c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:26.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.586+0000 7f05627fc640 1 -- 172.21.15.55:0/1076256643 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c005220 con 0x7f056c0cd630 2023-08-25T05:18:26.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.586+0000 7f05627fc640 1 -- 172.21.15.55:0/1076256643 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c005380 con 0x7f056c0cd630 2023-08-25T05:18:26.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.586+0000 7f05627fc640 1 -- 172.21.15.55:0/1076256643 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c007270 con 0x7f056c0cd630 2023-08-25T05:18:26.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.586+0000 7f057410a640 1 -- 172.21.15.55:0/1076256643 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c163800 con 0x7f056c0cd630 2023-08-25T05:18:26.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.586+0000 7f057410a640 1 -- 172.21.15.55:0/1076256643 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c0b4da0 con 0x7f056c0cd630 2023-08-25T05:18:26.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.586+0000 7f057410a640 1 -- 172.21.15.55:0/1076256643 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056c163d20 con 0x7f056c0cd630 2023-08-25T05:18:26.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.586+0000 7f05627fc640 1 -- 172.21.15.55:0/1076256643 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 77) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f055c0073d0 con 0x7f056c0cd630 2023-08-25T05:18:26.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.586+0000 7f05627fc640 1 --2- 172.21.15.55:0/1076256643 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f0550065500 0x7f05500679c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.586+0000 7f05627fc640 1 -- 172.21.15.55:0/1076256643 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6838+0+0 (secure 0 0 0) 0x7f055c082620 con 0x7f056c0cd630 2023-08-25T05:18:26.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.590+0000 7f0571ea6640 1 --2- 172.21.15.55:0/1076256643 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f0550065500 0x7f05500679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.590+0000 7f0571ea6640 1 --2- 172.21.15.55:0/1076256643 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f0550065500 0x7f05500679c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0568009aa0 tx=0x7f0568006f90 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:26.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.594+0000 7f05627fc640 1 -- 172.21.15.55:0/1076256643 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f055c050070 con 0x7f056c0cd630 2023-08-25T05:18:26.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.782+0000 7f057410a640 1 -- 172.21.15.55:0/1076256643 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f056c04dbe0 con 0x7f056c0cd630 2023-08-25T05:18:26.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.782+0000 7f05627fc640 1 -- 172.21.15.55:0/1076256643 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f055c053690 con 0x7f056c0cd630 2023-08-25T05:18:26.784 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:26.785 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7493,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/2640392190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2640392190},{"type":"v1","addr":"172.21.15.110:6837","nonce":2640392190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62},{"gid":8428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/2668985619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2668985619},{"type":"v1","addr":"172.21.15.110:6836","nonce":2668985619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61},{"gid":9018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/210118982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":210118982},{"type":"v1","addr":"172.21.15.55:6834","nonce":210118982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:22:24.336177+0000","modified":"2023-08-25T04:22:27.988148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9024":{"gid":9024,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/2424299953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2424299953},{"type":"v1","addr":"172.21.15.55:6835","nonce":2424299953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-25T05:18:26.785 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 66 2023-08-25T05:18:26.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.782+0000 7f057410a640 1 -- 172.21.15.55:0/1076256643 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f0550065500 msgr2=0x7f05500679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:26.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.782+0000 7f057410a640 1 --2- 172.21.15.55:0/1076256643 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f0550065500 0x7f05500679c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0568009aa0 tx=0x7f0568006f90 comp rx=0 tx=0).stop 2023-08-25T05:18:26.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.782+0000 7f057410a640 1 -- 172.21.15.55:0/1076256643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f056c0cd630 msgr2=0x7f056c0b55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:26.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.782+0000 7f057410a640 1 --2- 172.21.15.55:0/1076256643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f056c0cd630 0x7f056c0b55a0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f055c00c500 tx=0x7f055c00c9c0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.782+0000 7f057410a640 1 -- 172.21.15.55:0/1076256643 shutdown_connections 2023-08-25T05:18:26.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.782+0000 7f057410a640 1 --2- 172.21.15.55:0/1076256643 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f0550065500 0x7f05500679c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.782+0000 7f057410a640 1 --2- 172.21.15.55:0/1076256643 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f056c15a830 0x7f056c06af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.782+0000 7f057410a640 1 --2- 172.21.15.55:0/1076256643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f056c0cd630 0x7f056c0b55a0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.782+0000 7f057410a640 1 --2- 172.21.15.55:0/1076256643 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f056c0cc2b0 0x7f056c151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.782+0000 7f057410a640 1 -- 172.21.15.55:0/1076256643 >> 172.21.15.55:0/1076256643 conn(0x7f056c0d05a0 msgr2=0x7f056c0ad200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:26.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.782+0000 7f057410a640 1 -- 172.21.15.55:0/1076256643 shutdown_connections 2023-08-25T05:18:26.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.782+0000 7f057410a640 1 -- 172.21.15.55:0/1076256643 wait complete. 2023-08-25T05:18:26.806 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:18:26.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.954+0000 7f961f69c640 1 Processor -- start 2023-08-25T05:18:26.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.954+0000 7f961f69c640 1 -- start start 2023-08-25T05:18:26.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.958+0000 7f961f69c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f961815eba0 0x7f96180b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.958+0000 7f961f69c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96180ceeb0 0x7f96180ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.958+0000 7f961f69c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96180ac3a0 con 0x7f961815ef80 2023-08-25T05:18:26.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.958+0000 7f961f69c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96180b1390 con 0x7f96180ceeb0 2023-08-25T05:18:26.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.958+0000 7f961f69c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96180b1670 con 0x7f961815eba0 2023-08-25T05:18:26.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.958+0000 7f961dc39640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96180ceeb0 0x7f96180ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.958+0000 7f961dc39640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f96180ceeb0 0x7f96180ab0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45118/0 (socket says 172.21.15.55:45118) 2023-08-25T05:18:26.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.958+0000 7f961dc39640 1 -- 172.21.15.55:0/3903259757 learned_addr learned my addr 172.21.15.55:0/3903259757 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:26.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.958+0000 7f961cc37640 1 --1- 172.21.15.55:0/3903259757 >> v1:172.21.15.55:6789/0 conn(0x7f961815ef80 0x7f96180ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54972/0 (socket says 172.21.15.55:54972) 2023-08-25T05:18:26.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.958+0000 7f961d438640 1 --2- 172.21.15.55:0/3903259757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f961815eba0 0x7f96180b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.958+0000 7f961dc39640 1 -- 172.21.15.55:0/3903259757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f961815eba0 msgr2=0x7f96180b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:26.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.958+0000 7f961dc39640 1 --2- 172.21.15.55:0/3903259757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f961815eba0 0x7f96180b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.958+0000 7f961dc39640 1 -- 172.21.15.55:0/3903259757 >> v1:172.21.15.55:6789/0 conn(0x7f961815ef80 legacy=0x7f96180ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:26.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.958+0000 7f961dc39640 1 -- 172.21.15.55:0/3903259757 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96180b1950 con 0x7f96180ceeb0 2023-08-25T05:18:26.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.958+0000 7f960ffff640 1 -- 172.21.15.55:0/3903259757 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266094269 0 0) 0x7f96180ac3a0 con 0x7f961815ef80 2023-08-25T05:18:26.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f961dc39640 1 --2- 172.21.15.55:0/3903259757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96180ceeb0 0x7f96180ab0f0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f9610009e50 tx=0x7f961001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6abcd6d0fc84c125 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:26.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f960ffff640 1 -- 172.21.15.55:0/3903259757 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96100a58a0 con 0x7f96180ceeb0 2023-08-25T05:18:26.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f960ffff640 1 -- 172.21.15.55:0/3903259757 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96100a5a00 con 0x7f96180ceeb0 2023-08-25T05:18:26.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f960ffff640 1 -- 172.21.15.55:0/3903259757 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96100a5d90 con 0x7f96180ceeb0 2023-08-25T05:18:26.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f961f69c640 1 -- 172.21.15.55:0/3903259757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96180ceeb0 msgr2=0x7f96180ab0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:26.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f961f69c640 1 --2- 172.21.15.55:0/3903259757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96180ceeb0 0x7f96180ab0f0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f9610009e50 tx=0x7f961001c9e0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f961f69c640 1 -- 172.21.15.55:0/3903259757 shutdown_connections 2023-08-25T05:18:26.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f961f69c640 1 --2- 172.21.15.55:0/3903259757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96180ceeb0 0x7f96180ab0f0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f961f69c640 1 --2- 172.21.15.55:0/3903259757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f961815eba0 0x7f96180b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f961f69c640 1 -- 172.21.15.55:0/3903259757 >> 172.21.15.55:0/3903259757 conn(0x7f9618069d00 msgr2=0x7f961806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:26.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f961f69c640 1 -- 172.21.15.55:0/3903259757 shutdown_connections 2023-08-25T05:18:26.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f961f69c640 1 -- 172.21.15.55:0/3903259757 wait complete. 2023-08-25T05:18:26.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f961f69c640 1 Processor -- start 2023-08-25T05:18:26.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f961f69c640 1 -- start start 2023-08-25T05:18:26.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f961f69c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96180ceeb0 0x7f96180c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f961f69c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f961815eba0 0x7f9618158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f961f69c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f961815ef80 0x7f96180c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f961f69c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96180c8270 con 0x7f961815eba0 2023-08-25T05:18:26.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f961f69c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96180c71f0 con 0x7f961815ef80 2023-08-25T05:18:26.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.962+0000 7f961f69c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96180c74d0 con 0x7f96180ceeb0 2023-08-25T05:18:26.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.966+0000 7f961cc37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f961815eba0 0x7f9618158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.966+0000 7f961cc37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f961815eba0 0x7f9618158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45134/0 (socket says 172.21.15.55:45134) 2023-08-25T05:18:26.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.966+0000 7f961cc37640 1 -- 172.21.15.55:0/3742717999 learned_addr learned my addr 172.21.15.55:0/3742717999 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:26.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.966+0000 7f961d438640 1 --2- 172.21.15.55:0/3742717999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96180ceeb0 0x7f96180c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.966+0000 7f961dc39640 1 --2- 172.21.15.55:0/3742717999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f961815ef80 0x7f96180c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.966+0000 7f961cc37640 1 -- 172.21.15.55:0/3742717999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96180ceeb0 msgr2=0x7f96180c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:26.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.966+0000 7f961cc37640 1 --2- 172.21.15.55:0/3742717999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96180ceeb0 0x7f96180c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.966+0000 7f961cc37640 1 -- 172.21.15.55:0/3742717999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f961815ef80 msgr2=0x7f96180c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:26.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.966+0000 7f961cc37640 1 --2- 172.21.15.55:0/3742717999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f961815ef80 0x7f96180c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:26.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.966+0000 7f961cc37640 1 -- 172.21.15.55:0/3742717999 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9610009b30 con 0x7f961815eba0 2023-08-25T05:18:26.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.966+0000 7f961cc37640 1 --2- 172.21.15.55:0/3742717999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f961815eba0 0x7f9618158d40 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f96080011f0 tx=0x7f960800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:26.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.966+0000 7f960dffb640 1 -- 172.21.15.55:0/3742717999 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96080074e0 con 0x7f961815eba0 2023-08-25T05:18:26.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.966+0000 7f960dffb640 1 -- 172.21.15.55:0/3742717999 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9608007640 con 0x7f961815eba0 2023-08-25T05:18:26.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.966+0000 7f960dffb640 1 -- 172.21.15.55:0/3742717999 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608004a10 con 0x7f961815eba0 2023-08-25T05:18:26.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.966+0000 7f961f69c640 1 -- 172.21.15.55:0/3742717999 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96180c77b0 con 0x7f961815eba0 2023-08-25T05:18:26.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.966+0000 7f961f69c640 1 -- 172.21.15.55:0/3742717999 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96180c7d70 con 0x7f961815eba0 2023-08-25T05:18:26.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.966+0000 7f961f69c640 1 -- 172.21.15.55:0/3742717999 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961804dbe0 con 0x7f961815eba0 2023-08-25T05:18:26.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.966+0000 7f960dffb640 1 -- 172.21.15.55:0/3742717999 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f9608004b70 con 0x7f961815eba0 2023-08-25T05:18:26.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.970+0000 7f960dffb640 1 --2- 172.21.15.55:0/3742717999 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f95fc065710 0x7f95fc067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:26.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.970+0000 7f960dffb640 1 -- 172.21.15.55:0/3742717999 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6794+0+0 (secure 0 0 0) 0x7f9608082420 con 0x7f961815eba0 2023-08-25T05:18:26.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.970+0000 7f961d438640 1 --2- 172.21.15.55:0/3742717999 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f95fc065710 0x7f95fc067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:26.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.970+0000 7f961d438640 1 --2- 172.21.15.55:0/3742717999 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f95fc065710 0x7f95fc067bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9614009b60 tx=0x7f9614009190 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:26.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:26.974+0000 7f960dffb640 1 -- 172.21.15.55:0/3742717999 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f960804fbc0 con 0x7f961815eba0 2023-08-25T05:18:27.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.162+0000 7f961f69c640 1 -- 172.21.15.55:0/3742717999 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96180ccc40 con 0x7f961815eba0 2023-08-25T05:18:27.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.162+0000 7f960dffb640 1 -- 172.21.15.55:0/3742717999 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4880 (secure 0 0 0) 0x7f96080531e0 con 0x7f961815eba0 2023-08-25T05:18:27.165 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:27.165 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":66,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7493,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/2640392190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2640392190},{"type":"v1","addr":"172.21.15.110:6837","nonce":2640392190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62},{"gid":8428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/2668985619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2668985619},{"type":"v1","addr":"172.21.15.110:6836","nonce":2668985619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61},{"gid":9018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/210118982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":210118982},{"type":"v1","addr":"172.21.15.55:6834","nonce":210118982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T04:22:24.336177+0000","modified":"2023-08-25T04:22:27.988148+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9024},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9024":{"gid":9024,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/2424299953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2424299953},{"type":"v1","addr":"172.21.15.55:6835","nonce":2424299953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-08-25T05:18:27.166 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 66 2023-08-25T05:18:27.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.166+0000 7f961f69c640 1 -- 172.21.15.55:0/3742717999 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f95fc065710 msgr2=0x7f95fc067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:27.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.166+0000 7f961f69c640 1 --2- 172.21.15.55:0/3742717999 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f95fc065710 0x7f95fc067bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9614009b60 tx=0x7f9614009190 comp rx=0 tx=0).stop 2023-08-25T05:18:27.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.166+0000 7f961f69c640 1 -- 172.21.15.55:0/3742717999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f961815eba0 msgr2=0x7f9618158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:27.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.166+0000 7f961f69c640 1 --2- 172.21.15.55:0/3742717999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f961815eba0 0x7f9618158d40 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f96080011f0 tx=0x7f960800c9b0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.166+0000 7f961f69c640 1 -- 172.21.15.55:0/3742717999 shutdown_connections 2023-08-25T05:18:27.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.166+0000 7f961f69c640 1 --2- 172.21.15.55:0/3742717999 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f95fc065710 0x7f95fc067bd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.166+0000 7f961f69c640 1 --2- 172.21.15.55:0/3742717999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f961815ef80 0x7f96180c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.166+0000 7f961f69c640 1 --2- 172.21.15.55:0/3742717999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f961815eba0 0x7f9618158d40 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.166+0000 7f961f69c640 1 --2- 172.21.15.55:0/3742717999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96180ceeb0 0x7f96180c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.166+0000 7f961f69c640 1 -- 172.21.15.55:0/3742717999 >> 172.21.15.55:0/3742717999 conn(0x7f9618069d00 msgr2=0x7f96180af410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:27.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.166+0000 7f961f69c640 1 -- 172.21.15.55:0/3742717999 shutdown_connections 2023-08-25T05:18:27.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.166+0000 7f961f69c640 1 -- 172.21.15.55:0/3742717999 wait complete. 2023-08-25T05:18:27.186 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:18:27.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.330+0000 7f5f356d8640 1 Processor -- start 2023-08-25T05:18:27.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.330+0000 7f5f356d8640 1 -- start start 2023-08-25T05:18:27.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.330+0000 7f5f356d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f300d0da0 0x7f5f300d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:27.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.330+0000 7f5f356d8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f300cdde0 0x7f5f300ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:27.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.330+0000 7f5f356d8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f300b29b0 con 0x7f5f300cee60 2023-08-25T05:18:27.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.330+0000 7f5f356d8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f300ce760 con 0x7f5f300cdde0 2023-08-25T05:18:27.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.330+0000 7f5f356d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f300d16c0 con 0x7f5f300d0da0 2023-08-25T05:18:27.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.330+0000 7f5f2effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f300d0da0 0x7f5f300d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:27.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.330+0000 7f5f267fc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f300cdde0 0x7f5f300ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:27.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.330+0000 7f5f2f7fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5f300cee60 0x7f5f300cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:43396/0 (socket says 172.21.15.55:43396) 2023-08-25T05:18:27.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.330+0000 7f5f2effd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f300d0da0 0x7f5f300d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:41326/0 (socket says 172.21.15.55:41326) 2023-08-25T05:18:27.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.330+0000 7f5f2f7fe640 1 -- 172.21.15.55:0/1435615914 learned_addr learned my addr 172.21.15.55:0/1435615914 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:27.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.334+0000 7f5f2effd640 1 -- 172.21.15.55:0/1435615914 >> v2:172.21.15.110:3300/0 conn(0x7f5f300cdde0 msgr2=0x7f5f300ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:27.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.334+0000 7f5f2effd640 1 --2- 172.21.15.55:0/1435615914 >> v2:172.21.15.110:3300/0 conn(0x7f5f300cdde0 0x7f5f300ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.334+0000 7f5f2effd640 1 -- 172.21.15.55:0/1435615914 >> v1:172.21.15.110:6789/0 conn(0x7f5f300cee60 legacy=0x7f5f300cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:27.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.334+0000 7f5f2effd640 1 -- 172.21.15.55:0/1435615914 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f300b1dc0 con 0x7f5f300d0da0 2023-08-25T05:18:27.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.334+0000 7f5f2effd640 1 --2- 172.21.15.55:0/1435615914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f300d0da0 0x7f5f300d1180 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5f200097a0 tx=0x7f5f2001ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bb0b7eeef35dcbc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:27.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.334+0000 7f5f2e7fc640 1 -- 172.21.15.55:0/1435615914 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f200a8950 con 0x7f5f300d0da0 2023-08-25T05:18:27.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.334+0000 7f5f2e7fc640 1 -- 172.21.15.55:0/1435615914 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f200a8ab0 con 0x7f5f300d0da0 2023-08-25T05:18:27.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.334+0000 7f5f2e7fc640 1 -- 172.21.15.55:0/1435615914 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f200a8e40 con 0x7f5f300d0da0 2023-08-25T05:18:27.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f356d8640 1 -- 172.21.15.55:0/1435615914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f300d0da0 msgr2=0x7f5f300d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:27.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f356d8640 1 --2- 172.21.15.55:0/1435615914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f300d0da0 0x7f5f300d1180 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5f200097a0 tx=0x7f5f2001ec50 comp rx=0 tx=0).stop 2023-08-25T05:18:27.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f356d8640 1 -- 172.21.15.55:0/1435615914 shutdown_connections 2023-08-25T05:18:27.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f356d8640 1 --2- 172.21.15.55:0/1435615914 >> v2:172.21.15.110:3300/0 conn(0x7f5f300cdde0 0x7f5f300ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f356d8640 1 --2- 172.21.15.55:0/1435615914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f300d0da0 0x7f5f300d1180 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f356d8640 1 -- 172.21.15.55:0/1435615914 >> 172.21.15.55:0/1435615914 conn(0x7f5f3009bae0 msgr2=0x7f5f300d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:27.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f356d8640 1 -- 172.21.15.55:0/1435615914 shutdown_connections 2023-08-25T05:18:27.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f356d8640 1 -- 172.21.15.55:0/1435615914 wait complete. 2023-08-25T05:18:27.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f356d8640 1 Processor -- start 2023-08-25T05:18:27.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f356d8640 1 -- start start 2023-08-25T05:18:27.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f356d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f300cdde0 0x7f5f3015ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:27.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f356d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f300cee60 0x7f5f3015e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:27.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f356d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f300d0da0 0x7f5f300b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:27.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f356d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3015e2a0 con 0x7f5f300d0da0 2023-08-25T05:18:27.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f356d8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3015d3c0 con 0x7f5f300cdde0 2023-08-25T05:18:27.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f356d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3015d690 con 0x7f5f300cee60 2023-08-25T05:18:27.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f300d0da0 0x7f5f300b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:27.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f2f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f300d0da0 0x7f5f300b05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45142/0 (socket says 172.21.15.55:45142) 2023-08-25T05:18:27.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f2f7fe640 1 -- 172.21.15.55:0/3629749644 learned_addr learned my addr 172.21.15.55:0/3629749644 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:27.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f2effd640 1 --2- 172.21.15.55:0/3629749644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f300cdde0 0x7f5f3015ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:27.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f267fc640 1 --2- 172.21.15.55:0/3629749644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f300cee60 0x7f5f3015e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:27.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f2f7fe640 1 -- 172.21.15.55:0/3629749644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f300cee60 msgr2=0x7f5f3015e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:27.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f2f7fe640 1 --2- 172.21.15.55:0/3629749644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f300cee60 0x7f5f3015e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f2f7fe640 1 -- 172.21.15.55:0/3629749644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f300cdde0 msgr2=0x7f5f3015ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:27.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f2f7fe640 1 --2- 172.21.15.55:0/3629749644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f300cdde0 0x7f5f3015ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.338+0000 7f5f2f7fe640 1 -- 172.21.15.55:0/3629749644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f200093b0 con 0x7f5f300d0da0 2023-08-25T05:18:27.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.342+0000 7f5f2f7fe640 1 --2- 172.21.15.55:0/3629749644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f300d0da0 0x7f5f300b05a0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800c400 tx=0x7f5f2800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:27.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.342+0000 7f5f27fff640 1 -- 172.21.15.55:0/3629749644 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28005cf0 con 0x7f5f300d0da0 2023-08-25T05:18:27.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.342+0000 7f5f27fff640 1 -- 172.21.15.55:0/3629749644 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f28005e50 con 0x7f5f300d0da0 2023-08-25T05:18:27.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.342+0000 7f5f356d8640 1 -- 172.21.15.55:0/3629749644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3015d970 con 0x7f5f300d0da0 2023-08-25T05:18:27.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.342+0000 7f5f27fff640 1 -- 172.21.15.55:0/3629749644 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f280072d0 con 0x7f5f300d0da0 2023-08-25T05:18:27.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.342+0000 7f5f356d8640 1 -- 172.21.15.55:0/3629749644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3015df30 con 0x7f5f300d0da0 2023-08-25T05:18:27.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.342+0000 7f5f356d8640 1 -- 172.21.15.55:0/3629749644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3015e410 con 0x7f5f300d0da0 2023-08-25T05:18:27.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.342+0000 7f5f27fff640 1 -- 172.21.15.55:0/3629749644 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f5f28007430 con 0x7f5f300d0da0 2023-08-25T05:18:27.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.342+0000 7f5f27fff640 1 --2- 172.21.15.55:0/3629749644 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f5f10065740 0x7f5f10067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:27.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.342+0000 7f5f27fff640 1 -- 172.21.15.55:0/3629749644 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6794+0+0 (secure 0 0 0) 0x7f5f280824d0 con 0x7f5f300d0da0 2023-08-25T05:18:27.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.346+0000 7f5f2effd640 1 --2- 172.21.15.55:0/3629749644 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f5f10065740 0x7f5f10067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:27.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.346+0000 7f5f2effd640 1 --2- 172.21.15.55:0/3629749644 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f5f10065740 0x7f5f10067c00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5f200b2000 tx=0x7f5f20008040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:27.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.346+0000 7f5f27fff640 1 -- 172.21.15.55:0/3629749644 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5f2804fe00 con 0x7f5f300d0da0 2023-08-25T05:18:27.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.506+0000 7f5f356d8640 1 -- 172.21.15.55:0/3629749644 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f3004dbe0 con 0x7f5f300d0da0 2023-08-25T05:18:27.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.506+0000 7f5f27fff640 1 -- 172.21.15.55:0/3629749644 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+19483 (secure 0 0 0) 0x7f5f28053420 con 0x7f5f300d0da0 2023-08-25T05:18:27.513 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:27.514 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":145,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:18:26.828446+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-25T04:22:22.099798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-25T04:22:23.329827+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":144,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3450681761":"2023-08-26T05:18:24.719592+0000","172.21.15.110:0/3855906458":"2023-08-26T05:18:24.719592+0000","172.21.15.110:0/1252829579":"2023-08-26T05:18:24.719592+0000","172.21.15.110:0/2636731011":"2023-08-26T05:18:24.719592+0000","172.21.15.110:6833/3538591338":"2023-08-26T05:18:24.719592+0000","172.21.15.110:6833/3700713436":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/359151790":"2023-08-26T05:18:24.719592+0000","172.21.15.110:6832/3700713436":"2023-08-26T04:22:41.515664+0000","172.21.15.110:6832/3538591338":"2023-08-26T05:18:24.719592+0000","172.21.15.110:0/789108415":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/3818846433":"2023-08-26T05:18:24.719592+0000","172.21.15.110:0/3185722269":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/452038739":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/327450935":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/3135214366":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/2514341378":"2023-08-26T04:22:41.515664+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":18,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:18:27.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.510+0000 7f5f356d8640 1 -- 172.21.15.55:0/3629749644 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f5f10065740 msgr2=0x7f5f10067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:27.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.510+0000 7f5f356d8640 1 --2- 172.21.15.55:0/3629749644 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f5f10065740 0x7f5f10067c00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5f200b2000 tx=0x7f5f20008040 comp rx=0 tx=0).stop 2023-08-25T05:18:27.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.510+0000 7f5f356d8640 1 -- 172.21.15.55:0/3629749644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f300d0da0 msgr2=0x7f5f300b05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:27.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.510+0000 7f5f356d8640 1 --2- 172.21.15.55:0/3629749644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f300d0da0 0x7f5f300b05a0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800c400 tx=0x7f5f2800c8c0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.510+0000 7f5f356d8640 1 -- 172.21.15.55:0/3629749644 shutdown_connections 2023-08-25T05:18:27.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.510+0000 7f5f356d8640 1 --2- 172.21.15.55:0/3629749644 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f5f10065740 0x7f5f10067c00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.510+0000 7f5f356d8640 1 --2- 172.21.15.55:0/3629749644 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f300d0da0 0x7f5f300b05a0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.510+0000 7f5f356d8640 1 --2- 172.21.15.55:0/3629749644 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f300cee60 0x7f5f3015e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.510+0000 7f5f356d8640 1 --2- 172.21.15.55:0/3629749644 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f300cdde0 0x7f5f3015ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.510+0000 7f5f356d8640 1 -- 172.21.15.55:0/3629749644 >> 172.21.15.55:0/3629749644 conn(0x7f5f3009bae0 msgr2=0x7f5f300b36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:27.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.510+0000 7f5f356d8640 1 -- 172.21.15.55:0/3629749644 shutdown_connections 2023-08-25T05:18:27.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.510+0000 7f5f356d8640 1 -- 172.21.15.55:0/3629749644 wait complete. 2023-08-25T05:18:27.532 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-25T05:18:27.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.674+0000 7f0b9bf96640 1 Processor -- start 2023-08-25T05:18:27.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.674+0000 7f0b9bf96640 1 -- start start 2023-08-25T05:18:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.674+0000 7f0b9bf96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b940cdb10 0x7f0b940cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.674+0000 7f0b9bf96640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b940ae450 0x7f0b940cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.674+0000 7f0b9bf96640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9406c7c0 con 0x7f0b940ca260 2023-08-25T05:18:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.674+0000 7f0b9bf96640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b940ce430 con 0x7f0b940cdb10 2023-08-25T05:18:27.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.674+0000 7f0b9bf96640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b940ae9a0 con 0x7f0b940ae450 2023-08-25T05:18:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.678+0000 7f0b99d32640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b940cdb10 0x7f0b940cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.678+0000 7f0b99d32640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0b940cdb10 0x7f0b940cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45158/0 (socket says 172.21.15.55:45158) 2023-08-25T05:18:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.678+0000 7f0b99d32640 1 -- 172.21.15.55:0/2496267337 learned_addr learned my addr 172.21.15.55:0/2496267337 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.678+0000 7f0b99531640 1 --2- 172.21.15.55:0/2496267337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b940ae450 0x7f0b940cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.678+0000 7f0b99d32640 1 -- 172.21.15.55:0/2496267337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b940ae450 msgr2=0x7f0b940cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.678+0000 7f0b99d32640 1 --2- 172.21.15.55:0/2496267337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b940ae450 0x7f0b940cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.678+0000 7f0b99d32640 1 -- 172.21.15.55:0/2496267337 >> v1:172.21.15.110:6789/0 conn(0x7f0b940ca260 legacy=0x7f0b940ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:27.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.678+0000 7f0b99d32640 1 -- 172.21.15.55:0/2496267337 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b940cb5e0 con 0x7f0b940cdb10 2023-08-25T05:18:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.678+0000 7f0b99d32640 1 --2- 172.21.15.55:0/2496267337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b940cdb10 0x7f0b940cd310 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009870 tx=0x7f0b9001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ec9a760b6f5d2c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.678+0000 7f0b98d30640 1 -- 172.21.15.55:0/2496267337 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b900ab620 con 0x7f0b940cdb10 2023-08-25T05:18:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.678+0000 7f0b98d30640 1 -- 172.21.15.55:0/2496267337 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b900ab780 con 0x7f0b940cdb10 2023-08-25T05:18:27.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.678+0000 7f0b98d30640 1 -- 172.21.15.55:0/2496267337 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b900abb10 con 0x7f0b940cdb10 2023-08-25T05:18:27.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b9bf96640 1 -- 172.21.15.55:0/2496267337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b940cdb10 msgr2=0x7f0b940cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:27.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b9bf96640 1 --2- 172.21.15.55:0/2496267337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b940cdb10 0x7f0b940cd310 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f0b90009870 tx=0x7f0b9001c510 comp rx=0 tx=0).stop 2023-08-25T05:18:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b9bf96640 1 -- 172.21.15.55:0/2496267337 shutdown_connections 2023-08-25T05:18:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b9bf96640 1 --2- 172.21.15.55:0/2496267337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b940ae450 0x7f0b940cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b9bf96640 1 --2- 172.21.15.55:0/2496267337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b940cdb10 0x7f0b940cd310 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b9bf96640 1 -- 172.21.15.55:0/2496267337 >> 172.21.15.55:0/2496267337 conn(0x7f0b940cf530 msgr2=0x7f0b940cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b9bf96640 1 -- 172.21.15.55:0/2496267337 shutdown_connections 2023-08-25T05:18:27.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b9bf96640 1 -- 172.21.15.55:0/2496267337 wait complete. 2023-08-25T05:18:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b9bf96640 1 Processor -- start 2023-08-25T05:18:27.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b9bf96640 1 -- start start 2023-08-25T05:18:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b9bf96640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b940ae450 0x7f0b94152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:27.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b9bf96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b940ca260 0x7f0b940c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:27.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b9bf96640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b940cdb10 0x7f0b940ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:27.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b9bf96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b940af2b0 con 0x7f0b940ca260 2023-08-25T05:18:27.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b9bf96640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b94153470 con 0x7f0b940cdb10 2023-08-25T05:18:27.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b9bf96640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b94153750 con 0x7f0b940ae450 2023-08-25T05:18:27.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b99531640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b940ca260 0x7f0b940c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:27.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b99531640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b940ca260 0x7f0b940c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45170/0 (socket says 172.21.15.55:45170) 2023-08-25T05:18:27.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b99531640 1 -- 172.21.15.55:0/2559814730 learned_addr learned my addr 172.21.15.55:0/2559814730 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:27.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b99d32640 1 --2- 172.21.15.55:0/2559814730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b940ae450 0x7f0b94152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:27.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b9a533640 1 --2- 172.21.15.55:0/2559814730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b940cdb10 0x7f0b940ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:27.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b99531640 1 -- 172.21.15.55:0/2559814730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b940ae450 msgr2=0x7f0b94152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:27.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b99531640 1 --2- 172.21.15.55:0/2559814730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b940ae450 0x7f0b94152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b99531640 1 -- 172.21.15.55:0/2559814730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b940cdb10 msgr2=0x7f0b940ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:27.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b99531640 1 --2- 172.21.15.55:0/2559814730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b940cdb10 0x7f0b940ad250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.682+0000 7f0b99531640 1 -- 172.21.15.55:0/2559814730 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b900094d0 con 0x7f0b940ca260 2023-08-25T05:18:27.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.686+0000 7f0b99531640 1 --2- 172.21.15.55:0/2559814730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b940ca260 0x7f0b940c8600 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400d5d0 tx=0x7f0b8400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:27.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.686+0000 7f0b8a7fc640 1 -- 172.21.15.55:0/2559814730 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b84004240 con 0x7f0b940ca260 2023-08-25T05:18:27.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.686+0000 7f0b8a7fc640 1 -- 172.21.15.55:0/2559814730 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b840043a0 con 0x7f0b940ca260 2023-08-25T05:18:27.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.686+0000 7f0b9bf96640 1 -- 172.21.15.55:0/2559814730 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b940cb3b0 con 0x7f0b940ca260 2023-08-25T05:18:27.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.686+0000 7f0b8a7fc640 1 -- 172.21.15.55:0/2559814730 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b84003840 con 0x7f0b940ca260 2023-08-25T05:18:27.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.686+0000 7f0b9bf96640 1 -- 172.21.15.55:0/2559814730 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b940aef40 con 0x7f0b940ca260 2023-08-25T05:18:27.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.686+0000 7f0b9bf96640 1 -- 172.21.15.55:0/2559814730 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b940cf1d0 con 0x7f0b940ca260 2023-08-25T05:18:27.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.686+0000 7f0b8a7fc640 1 -- 172.21.15.55:0/2559814730 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f0b840039a0 con 0x7f0b940ca260 2023-08-25T05:18:27.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.686+0000 7f0b8a7fc640 1 --2- 172.21.15.55:0/2559814730 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f0b78065710 0x7f0b78067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:27.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.686+0000 7f0b8a7fc640 1 -- 172.21.15.55:0/2559814730 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6794+0+0 (secure 0 0 0) 0x7f0b84083300 con 0x7f0b940ca260 2023-08-25T05:18:27.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.686+0000 7f0b99d32640 1 --2- 172.21.15.55:0/2559814730 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f0b78065710 0x7f0b78067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:27.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.690+0000 7f0b99d32640 1 --2- 172.21.15.55:0/2559814730 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f0b78065710 0x7f0b78067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0b900af000 tx=0x7f0b900b6040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:27.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.690+0000 7f0b8a7fc640 1 -- 172.21.15.55:0/2559814730 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0b840509f0 con 0x7f0b940ca260 2023-08-25T05:18:27.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.886+0000 7f0b9bf96640 1 -- 172.21.15.55:0/2559814730 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0b9404dbe0 con 0x7f0b940ca260 2023-08-25T05:18:27.887 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-08-25T05:18:27.886+0000 7f7f18c38640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-25T05:18:27.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.894+0000 7f0b8a7fc640 1 -- 172.21.15.55:0/2559814730 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0b84054010 con 0x7f0b940ca260 2023-08-25T05:18:27.895 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-25T05:18:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.894+0000 7f0b9bf96640 1 -- 172.21.15.55:0/2559814730 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f0b78065710 msgr2=0x7f0b78067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.894+0000 7f0b9bf96640 1 --2- 172.21.15.55:0/2559814730 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f0b78065710 0x7f0b78067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0b900af000 tx=0x7f0b900b6040 comp rx=0 tx=0).stop 2023-08-25T05:18:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.894+0000 7f0b9bf96640 1 -- 172.21.15.55:0/2559814730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b940ca260 msgr2=0x7f0b940c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.894+0000 7f0b9bf96640 1 --2- 172.21.15.55:0/2559814730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b940ca260 0x7f0b940c8600 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f0b8400d5d0 tx=0x7f0b8400da90 comp rx=0 tx=0).stop 2023-08-25T05:18:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.894+0000 7f0b9bf96640 1 -- 172.21.15.55:0/2559814730 shutdown_connections 2023-08-25T05:18:27.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.894+0000 7f0b9bf96640 1 --2- 172.21.15.55:0/2559814730 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f0b78065710 0x7f0b78067bd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.894+0000 7f0b9bf96640 1 --2- 172.21.15.55:0/2559814730 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0b940cdb10 0x7f0b940ad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.894+0000 7f0b9bf96640 1 --2- 172.21.15.55:0/2559814730 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b940ca260 0x7f0b940c8600 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.894+0000 7f0b9bf96640 1 --2- 172.21.15.55:0/2559814730 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0b940ae450 0x7f0b94152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:27.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.894+0000 7f0b9bf96640 1 -- 172.21.15.55:0/2559814730 >> 172.21.15.55:0/2559814730 conn(0x7f0b940cf530 msgr2=0x7f0b9415a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:27.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.894+0000 7f0b9bf96640 1 -- 172.21.15.55:0/2559814730 shutdown_connections 2023-08-25T05:18:27.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:27.894+0000 7f0b9bf96640 1 -- 172.21.15.55:0/2559814730 wait complete. 2023-08-25T05:18:27.917 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-25T05:18:27.959 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T05:18:28.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.066+0000 7f7a0e05c640 1 Processor -- start 2023-08-25T05:18:28.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.066+0000 7f7a0e05c640 1 -- start start 2023-08-25T05:18:28.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.066+0000 7f7a0e05c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7a080c9830 0x7f7a0809bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:28.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.066+0000 7f7a0e05c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a0806c020 0x7f7a080acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:28.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.066+0000 7f7a0e05c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0815abd0 con 0x7f7a0815a7f0 2023-08-25T05:18:28.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.066+0000 7f7a0e05c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a080c8ab0 con 0x7f7a080c9830 2023-08-25T05:18:28.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.066+0000 7f7a0e05c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080c8d50 con 0x7f7a0806c020 2023-08-25T05:18:28.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.066+0000 7f79fffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7a080c9830 0x7f7a0809bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:28.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.066+0000 7f79fffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7a080c9830 0x7f7a0809bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45182/0 (socket says 172.21.15.55:45182) 2023-08-25T05:18:28.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.066+0000 7f79fffff640 1 -- 172.21.15.55:0/2749431134 learned_addr learned my addr 172.21.15.55:0/2749431134 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:28.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.066+0000 7f7a07fff640 1 --2- 172.21.15.55:0/2749431134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a0806c020 0x7f7a080acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:28.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.066+0000 7f79fffff640 1 -- 172.21.15.55:0/2749431134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a0806c020 msgr2=0x7f7a080acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:28.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.066+0000 7f79fffff640 1 --2- 172.21.15.55:0/2749431134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a0806c020 0x7f7a080acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:28.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.066+0000 7f79fffff640 1 -- 172.21.15.55:0/2749431134 >> v1:172.21.15.110:6789/0 conn(0x7f7a0815a7f0 legacy=0x7f7a08070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:28.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.066+0000 7f79fffff640 1 -- 172.21.15.55:0/2749431134 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a080c9030 con 0x7f7a080c9830 2023-08-25T05:18:28.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.070+0000 7f79fffff640 1 --2- 172.21.15.55:0/2749431134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a080c9830 0x7f7a0809bde0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009870 tx=0x7f79f001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe157825eee8541 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:28.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.070+0000 7f7a06ffd640 1 -- 172.21.15.55:0/2749431134 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f00ab620 con 0x7f7a080c9830 2023-08-25T05:18:28.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.070+0000 7f7a06ffd640 1 -- 172.21.15.55:0/2749431134 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f00ab780 con 0x7f7a080c9830 2023-08-25T05:18:28.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.070+0000 7f7a06ffd640 1 -- 172.21.15.55:0/2749431134 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f00abb10 con 0x7f7a080c9830 2023-08-25T05:18:28.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.070+0000 7f7a0e05c640 1 -- 172.21.15.55:0/2749431134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a080c9830 msgr2=0x7f7a0809bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:28.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.070+0000 7f7a0e05c640 1 --2- 172.21.15.55:0/2749431134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a080c9830 0x7f7a0809bde0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009870 tx=0x7f79f001c510 comp rx=0 tx=0).stop 2023-08-25T05:18:28.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.070+0000 7f7a0e05c640 1 -- 172.21.15.55:0/2749431134 shutdown_connections 2023-08-25T05:18:28.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.070+0000 7f7a0e05c640 1 --2- 172.21.15.55:0/2749431134 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a0806c020 0x7f7a080acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:28.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.070+0000 7f7a0e05c640 1 --2- 172.21.15.55:0/2749431134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a080c9830 0x7f7a0809bde0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:28.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.070+0000 7f7a0e05c640 1 -- 172.21.15.55:0/2749431134 >> 172.21.15.55:0/2749431134 conn(0x7f7a08069900 msgr2=0x7f7a08069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:28.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.070+0000 7f7a0e05c640 1 -- 172.21.15.55:0/2749431134 shutdown_connections 2023-08-25T05:18:28.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.070+0000 7f7a0e05c640 1 -- 172.21.15.55:0/2749431134 wait complete. 2023-08-25T05:18:28.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a0e05c640 1 Processor -- start 2023-08-25T05:18:28.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a0e05c640 1 -- start start 2023-08-25T05:18:28.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a0e05c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a0806c020 0x7f7a08165e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:28.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a0e05c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a080c9830 0x7f7a08158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:28.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a0e05c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a0815a7f0 0x7f7a0814d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:28.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a0e05c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0814d530 con 0x7f7a0806c020 2023-08-25T05:18:28.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a0e05c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a081663d0 con 0x7f7a0815a7f0 2023-08-25T05:18:28.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a0e05c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0815a120 con 0x7f7a080c9830 2023-08-25T05:18:28.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a077fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a0806c020 0x7f7a08165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:28.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a077fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a0806c020 0x7f7a08165e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45196/0 (socket says 172.21.15.55:45196) 2023-08-25T05:18:28.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a077fe640 1 -- 172.21.15.55:0/3371309506 learned_addr learned my addr 172.21.15.55:0/3371309506 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:28.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f79fffff640 1 --2- 172.21.15.55:0/3371309506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a080c9830 0x7f7a08158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:28.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a07fff640 1 --2- 172.21.15.55:0/3371309506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a0815a7f0 0x7f7a0814d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:28.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a077fe640 1 -- 172.21.15.55:0/3371309506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a080c9830 msgr2=0x7f7a08158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:28.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a077fe640 1 --2- 172.21.15.55:0/3371309506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a080c9830 0x7f7a08158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:28.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a077fe640 1 -- 172.21.15.55:0/3371309506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a0815a7f0 msgr2=0x7f7a0814d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:28.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a077fe640 1 --2- 172.21.15.55:0/3371309506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a0815a7f0 0x7f7a0814d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:28.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a077fe640 1 -- 172.21.15.55:0/3371309506 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f00094d0 con 0x7f7a0806c020 2023-08-25T05:18:28.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a07fff640 1 --2- 172.21.15.55:0/3371309506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a0815a7f0 0x7f7a0814d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:28.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a077fe640 1 --2- 172.21.15.55:0/3371309506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a0806c020 0x7f7a08165e90 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f79f800c400 tx=0x7f79f800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:28.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a04ff9640 1 -- 172.21.15.55:0/3371309506 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f80052d0 con 0x7f7a0806c020 2023-08-25T05:18:28.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a04ff9640 1 -- 172.21.15.55:0/3371309506 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f8005430 con 0x7f7a0806c020 2023-08-25T05:18:28.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a04ff9640 1 -- 172.21.15.55:0/3371309506 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8003890 con 0x7f7a0806c020 2023-08-25T05:18:28.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a0e05c640 1 -- 172.21.15.55:0/3371309506 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a08159b60 con 0x7f7a0806c020 2023-08-25T05:18:28.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.074+0000 7f7a0e05c640 1 -- 172.21.15.55:0/3371309506 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a081585f0 con 0x7f7a0806c020 2023-08-25T05:18:28.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.078+0000 7f7a0e05c640 1 -- 172.21.15.55:0/3371309506 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0806d5b0 con 0x7f7a0806c020 2023-08-25T05:18:28.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.078+0000 7f7a04ff9640 1 -- 172.21.15.55:0/3371309506 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 78) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f79f80039f0 con 0x7f7a0806c020 2023-08-25T05:18:28.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.078+0000 7f7a04ff9640 1 --2- 172.21.15.55:0/3371309506 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f79e8065710 0x7f79e8067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:28.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.078+0000 7f7a04ff9640 1 -- 172.21.15.55:0/3371309506 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f79f80826f0 con 0x7f7a0806c020 2023-08-25T05:18:28.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.078+0000 7f79fffff640 1 --2- 172.21.15.55:0/3371309506 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f79e8065710 0x7f79e8067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:28.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.078+0000 7f79fffff640 1 --2- 172.21.15.55:0/3371309506 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f79e8065710 0x7f79e8067bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f79f00af000 tx=0x7f79f00b6040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:28.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.082+0000 7f7a04ff9640 1 -- 172.21.15.55:0/3371309506 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f79f804fef0 con 0x7f7a0806c020 2023-08-25T05:18:28.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.270+0000 7f7a0e05c640 1 -- 172.21.15.55:0/3371309506 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7a08073ec0 con 0x7f7a0806c020 2023-08-25T05:18:28.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.910+0000 7f7a04ff9640 1 -- 172.21.15.55:0/3371309506 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f79f80502c0 con 0x7f7a0806c020 2023-08-25T05:18:28.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.910+0000 7f7a04ff9640 1 -- 172.21.15.55:0/3371309506 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7f79f8071750 con 0x7f7a0806c020 2023-08-25T05:18:28.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.914+0000 7f7a0e05c640 1 -- 172.21.15.55:0/3371309506 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f79e8065710 msgr2=0x7f79e8067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:28.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.914+0000 7f7a0e05c640 1 --2- 172.21.15.55:0/3371309506 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f79e8065710 0x7f79e8067bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f79f00af000 tx=0x7f79f00b6040 comp rx=0 tx=0).stop 2023-08-25T05:18:28.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.914+0000 7f7a0e05c640 1 -- 172.21.15.55:0/3371309506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a0806c020 msgr2=0x7f7a08165e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:28.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.914+0000 7f7a0e05c640 1 --2- 172.21.15.55:0/3371309506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a0806c020 0x7f7a08165e90 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f79f800c400 tx=0x7f79f800c8c0 comp rx=0 tx=0).stop 2023-08-25T05:18:28.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.914+0000 7f7a0e05c640 1 -- 172.21.15.55:0/3371309506 shutdown_connections 2023-08-25T05:18:28.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.914+0000 7f7a0e05c640 1 --2- 172.21.15.55:0/3371309506 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f79e8065710 0x7f79e8067bd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:28.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.914+0000 7f7a0e05c640 1 --2- 172.21.15.55:0/3371309506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a0815a7f0 0x7f7a0814d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:28.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.914+0000 7f7a0e05c640 1 --2- 172.21.15.55:0/3371309506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a080c9830 0x7f7a08158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:28.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.914+0000 7f7a0e05c640 1 --2- 172.21.15.55:0/3371309506 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a0806c020 0x7f7a08165e90 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:28.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.914+0000 7f7a0e05c640 1 -- 172.21.15.55:0/3371309506 >> 172.21.15.55:0/3371309506 conn(0x7f7a08069900 msgr2=0x7f7a08072af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:28.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.914+0000 7f7a0e05c640 1 -- 172.21.15.55:0/3371309506 shutdown_connections 2023-08-25T05:18:28.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:28.914+0000 7f7a0e05c640 1 -- 172.21.15.55:0/3371309506 wait complete. 2023-08-25T05:18:28.937 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-25T05:18:29.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.122+0000 7f2c176cb640 1 Processor -- start 2023-08-25T05:18:29.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.126+0000 7f2c176cb640 1 -- start start 2023-08-25T05:18:29.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.126+0000 7f2c176cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c100ad7e0 0x7f2c100b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:29.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.126+0000 7f2c176cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2c100b0440 0x7f2c101645b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:29.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.126+0000 7f2c176cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c100ca4d0 con 0x7f2c100b2a80 2023-08-25T05:18:29.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.126+0000 7f2c176cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c100adbc0 con 0x7f2c100b0440 2023-08-25T05:18:29.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.126+0000 7f2c176cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c100c9900 con 0x7f2c100ad7e0 2023-08-25T05:18:29.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.126+0000 7f2c15c68640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2c100b0440 0x7f2c101645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:29.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.126+0000 7f2c14c66640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2c100b2a80 0x7f2c100afd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54984/0 (socket says 172.21.15.55:54984) 2023-08-25T05:18:29.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.126+0000 7f2c14c66640 1 -- 172.21.15.55:0/705292191 learned_addr learned my addr 172.21.15.55:0/705292191 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:29.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.126+0000 7f2c15467640 1 --2- 172.21.15.55:0/705292191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c100ad7e0 0x7f2c100b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:29.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.126+0000 7f2c15c68640 1 -- 172.21.15.55:0/705292191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c100ad7e0 msgr2=0x7f2c100b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:29.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.126+0000 7f2c15c68640 1 --2- 172.21.15.55:0/705292191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c100ad7e0 0x7f2c100b2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:29.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.126+0000 7f2c15c68640 1 -- 172.21.15.55:0/705292191 >> v1:172.21.15.55:6789/0 conn(0x7f2c100b2a80 legacy=0x7f2c100afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:29.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.126+0000 7f2c07fff640 1 -- 172.21.15.55:0/705292191 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003346708 0 0) 0x7f2c100ca4d0 con 0x7f2c100b2a80 2023-08-25T05:18:29.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.126+0000 7f2c15c68640 1 -- 172.21.15.55:0/705292191 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c100c9ba0 con 0x7f2c100b0440 2023-08-25T05:18:29.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.130+0000 7f2c15c68640 1 --2- 172.21.15.55:0/705292191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c100b0440 0x7f2c101645b0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009d90 tx=0x7f2c0801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986a78810a73402c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:29.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.130+0000 7f2c07fff640 1 -- 172.21.15.55:0/705292191 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c080a59e0 con 0x7f2c100b0440 2023-08-25T05:18:29.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.130+0000 7f2c07fff640 1 -- 172.21.15.55:0/705292191 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c080a5b40 con 0x7f2c100b0440 2023-08-25T05:18:29.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.130+0000 7f2c07fff640 1 -- 172.21.15.55:0/705292191 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c080ad440 con 0x7f2c100b0440 2023-08-25T05:18:29.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.130+0000 7f2c176cb640 1 -- 172.21.15.55:0/705292191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c100b0440 msgr2=0x7f2c101645b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:29.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.130+0000 7f2c176cb640 1 --2- 172.21.15.55:0/705292191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c100b0440 0x7f2c101645b0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009d90 tx=0x7f2c0801c920 comp rx=0 tx=0).stop 2023-08-25T05:18:29.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.130+0000 7f2c176cb640 1 -- 172.21.15.55:0/705292191 shutdown_connections 2023-08-25T05:18:29.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.130+0000 7f2c176cb640 1 --2- 172.21.15.55:0/705292191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c100b0440 0x7f2c101645b0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:29.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.130+0000 7f2c176cb640 1 --2- 172.21.15.55:0/705292191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c100ad7e0 0x7f2c100b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:29.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.130+0000 7f2c176cb640 1 -- 172.21.15.55:0/705292191 >> 172.21.15.55:0/705292191 conn(0x7f2c100cad30 msgr2=0x7f2c100cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:29.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.130+0000 7f2c176cb640 1 -- 172.21.15.55:0/705292191 shutdown_connections 2023-08-25T05:18:29.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.130+0000 7f2c176cb640 1 -- 172.21.15.55:0/705292191 wait complete. 2023-08-25T05:18:29.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.130+0000 7f2c176cb640 1 Processor -- start 2023-08-25T05:18:29.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.130+0000 7f2c176cb640 1 -- start start 2023-08-25T05:18:29.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c176cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c100ad7e0 0x7f2c100c1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:29.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c176cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c100b0440 0x7f2c101520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:29.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c176cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c100b2a80 0x7f2c100cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:29.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c176cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c100cd610 con 0x7f2c100b2a80 2023-08-25T05:18:29.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c176cb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c10154090 con 0x7f2c100ad7e0 2023-08-25T05:18:29.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c176cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c10154370 con 0x7f2c100b0440 2023-08-25T05:18:29.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c15c68640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c100b2a80 0x7f2c100cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:29.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c15c68640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c100b2a80 0x7f2c100cc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45218/0 (socket says 172.21.15.55:45218) 2023-08-25T05:18:29.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c15c68640 1 -- 172.21.15.55:0/3149479324 learned_addr learned my addr 172.21.15.55:0/3149479324 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c15467640 1 --2- 172.21.15.55:0/3149479324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c100ad7e0 0x7f2c100c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c14c66640 1 --2- 172.21.15.55:0/3149479324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c100b0440 0x7f2c101520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c15c68640 1 -- 172.21.15.55:0/3149479324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c100b0440 msgr2=0x7f2c101520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:29.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c15c68640 1 --2- 172.21.15.55:0/3149479324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c100b0440 0x7f2c101520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c15c68640 1 -- 172.21.15.55:0/3149479324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c100ad7e0 msgr2=0x7f2c100c1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c15c68640 1 --2- 172.21.15.55:0/3149479324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c100ad7e0 0x7f2c100c1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c15c68640 1 -- 172.21.15.55:0/3149479324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c08009a70 con 0x7f2c100b2a80 2023-08-25T05:18:29.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c15c68640 1 --2- 172.21.15.55:0/3149479324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c100b2a80 0x7f2c100cc7b0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f2c0801afd0 tx=0x7f2c080196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c05ffb640 1 -- 172.21.15.55:0/3149479324 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c080ade40 con 0x7f2c100b2a80 2023-08-25T05:18:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c05ffb640 1 -- 172.21.15.55:0/3149479324 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c080b9450 con 0x7f2c100b2a80 2023-08-25T05:18:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c05ffb640 1 -- 172.21.15.55:0/3149479324 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c080b97e0 con 0x7f2c100b2a80 2023-08-25T05:18:29.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c176cb640 1 -- 172.21.15.55:0/3149479324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c10154650 con 0x7f2c100b2a80 2023-08-25T05:18:29.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c176cb640 1 -- 172.21.15.55:0/3149479324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c10152620 con 0x7f2c100b2a80 2023-08-25T05:18:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c176cb640 1 -- 172.21.15.55:0/3149479324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c1004e430 con 0x7f2c100b2a80 2023-08-25T05:18:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.134+0000 7f2c05ffb640 1 -- 172.21.15.55:0/3149479324 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f2c080b9940 con 0x7f2c100b2a80 2023-08-25T05:18:29.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.138+0000 7f2c05ffb640 1 --2- 172.21.15.55:0/3149479324 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f2bf40657a0 0x7f2bf4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:29.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.138+0000 7f2c05ffb640 1 -- 172.21.15.55:0/3149479324 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f2c0811eb00 con 0x7f2c100b2a80 2023-08-25T05:18:29.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.138+0000 7f2c15467640 1 --2- 172.21.15.55:0/3149479324 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f2bf40657a0 0x7f2bf4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:29.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.138+0000 7f2c15467640 1 --2- 172.21.15.55:0/3149479324 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f2bf40657a0 0x7f2bf4067c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00aae0 tx=0x7f2c0c008040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:29.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.142+0000 7f2c05ffb640 1 -- 172.21.15.55:0/3149479324 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2c08120e60 con 0x7f2c100b2a80 2023-08-25T05:18:29.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.294+0000 7f2c176cb640 1 -- 172.21.15.55:0/3149479324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2c10154b00 con 0x7f2c100b2a80 2023-08-25T05:18:29.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.918+0000 7f2c05ffb640 1 -- 172.21.15.55:0/3149479324 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v147) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2c080ec420 con 0x7f2c100b2a80 2023-08-25T05:18:29.922 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-08-25T05:18:29.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.922+0000 7f2c176cb640 1 -- 172.21.15.55:0/3149479324 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f2bf40657a0 msgr2=0x7f2bf4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:29.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.922+0000 7f2c176cb640 1 --2- 172.21.15.55:0/3149479324 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f2bf40657a0 0x7f2bf4067c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00aae0 tx=0x7f2c0c008040 comp rx=0 tx=0).stop 2023-08-25T05:18:29.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.922+0000 7f2c176cb640 1 -- 172.21.15.55:0/3149479324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c100b2a80 msgr2=0x7f2c100cc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:29.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.922+0000 7f2c176cb640 1 --2- 172.21.15.55:0/3149479324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c100b2a80 0x7f2c100cc7b0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f2c0801afd0 tx=0x7f2c080196c0 comp rx=0 tx=0).stop 2023-08-25T05:18:29.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.922+0000 7f2c176cb640 1 -- 172.21.15.55:0/3149479324 shutdown_connections 2023-08-25T05:18:29.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.922+0000 7f2c176cb640 1 --2- 172.21.15.55:0/3149479324 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f2bf40657a0 0x7f2bf4067c60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:29.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.922+0000 7f2c176cb640 1 --2- 172.21.15.55:0/3149479324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c100b2a80 0x7f2c100cc7b0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:29.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.922+0000 7f2c176cb640 1 --2- 172.21.15.55:0/3149479324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c100b0440 0x7f2c101520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:29.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.922+0000 7f2c176cb640 1 --2- 172.21.15.55:0/3149479324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c100ad7e0 0x7f2c100c1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:29.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.922+0000 7f2c176cb640 1 -- 172.21.15.55:0/3149479324 >> 172.21.15.55:0/3149479324 conn(0x7f2c100cad30 msgr2=0x7f2c1006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:29.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.922+0000 7f2c176cb640 1 -- 172.21.15.55:0/3149479324 shutdown_connections 2023-08-25T05:18:29.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:29.922+0000 7f2c176cb640 1 -- 172.21.15.55:0/3149479324 wait complete. 2023-08-25T05:18:29.946 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-25T05:18:30.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.094+0000 7f89d5dfa640 1 Processor -- start 2023-08-25T05:18:30.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.094+0000 7f89d5dfa640 1 -- start start 2023-08-25T05:18:30.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.094+0000 7f89d5dfa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89d015cb40 0x7f89d00d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:30.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.094+0000 7f89d5dfa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89d00cf340 0x7f89d00cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:30.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.094+0000 7f89d5dfa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d00d1970 con 0x7f89d00b43e0 2023-08-25T05:18:30.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.094+0000 7f89d5dfa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d00cfcc0 con 0x7f89d015cb40 2023-08-25T05:18:30.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.094+0000 7f89d5dfa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00d0d80 con 0x7f89d00cf340 2023-08-25T05:18:30.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.094+0000 7f89cf7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89d015cb40 0x7f89d00d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:30.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.094+0000 7f89cf7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89d015cb40 0x7f89d00d2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45220/0 (socket says 172.21.15.55:45220) 2023-08-25T05:18:30.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.094+0000 7f89cf7fe640 1 -- 172.21.15.55:0/1417042933 learned_addr learned my addr 172.21.15.55:0/1417042933 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:30.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.094+0000 7f89c7fff640 1 --2- 172.21.15.55:0/1417042933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89d00cf340 0x7f89d00cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:30.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.094+0000 7f89cf7fe640 1 -- 172.21.15.55:0/1417042933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89d00cf340 msgr2=0x7f89d00cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:30.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.094+0000 7f89cf7fe640 1 --2- 172.21.15.55:0/1417042933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89d00cf340 0x7f89d00cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:30.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.094+0000 7f89cf7fe640 1 -- 172.21.15.55:0/1417042933 >> v1:172.21.15.110:6789/0 conn(0x7f89d00b43e0 legacy=0x7f89d00b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:30.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.094+0000 7f89cf7fe640 1 -- 172.21.15.55:0/1417042933 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d00d1040 con 0x7f89d015cb40 2023-08-25T05:18:30.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.098+0000 7f89cf7fe640 1 --2- 172.21.15.55:0/1417042933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d015cb40 0x7f89d00d2080 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f89c0009870 tx=0x7f89c001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93dde513ca5fd700 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:30.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.098+0000 7f89ceffd640 1 -- 172.21.15.55:0/1417042933 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c00a89b0 con 0x7f89d015cb40 2023-08-25T05:18:30.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.098+0000 7f89ceffd640 1 -- 172.21.15.55:0/1417042933 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c00a8b10 con 0x7f89d015cb40 2023-08-25T05:18:30.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.098+0000 7f89ceffd640 1 -- 172.21.15.55:0/1417042933 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c00a8ea0 con 0x7f89d015cb40 2023-08-25T05:18:30.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.098+0000 7f89d5dfa640 1 -- 172.21.15.55:0/1417042933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d015cb40 msgr2=0x7f89d00d2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:30.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.098+0000 7f89d5dfa640 1 --2- 172.21.15.55:0/1417042933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d015cb40 0x7f89d00d2080 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f89c0009870 tx=0x7f89c001ecf0 comp rx=0 tx=0).stop 2023-08-25T05:18:30.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.098+0000 7f89d5dfa640 1 -- 172.21.15.55:0/1417042933 shutdown_connections 2023-08-25T05:18:30.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.098+0000 7f89d5dfa640 1 --2- 172.21.15.55:0/1417042933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89d00cf340 0x7f89d00cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:30.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.098+0000 7f89d5dfa640 1 --2- 172.21.15.55:0/1417042933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d015cb40 0x7f89d00d2080 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:30.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.098+0000 7f89d5dfa640 1 -- 172.21.15.55:0/1417042933 >> 172.21.15.55:0/1417042933 conn(0x7f89d006aae0 msgr2=0x7f89d006aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:30.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.098+0000 7f89d5dfa640 1 -- 172.21.15.55:0/1417042933 shutdown_connections 2023-08-25T05:18:30.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.098+0000 7f89d5dfa640 1 -- 172.21.15.55:0/1417042933 wait complete. 2023-08-25T05:18:30.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89d5dfa640 1 Processor -- start 2023-08-25T05:18:30.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89d5dfa640 1 -- start start 2023-08-25T05:18:30.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89d5dfa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d00b43e0 0x7f89d00c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:30.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89d5dfa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89d00cf340 0x7f89d00c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:30.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89d5dfa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89d015cb40 0x7f89d015eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:30.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89d5dfa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00a9460 con 0x7f89d00b43e0 2023-08-25T05:18:30.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89d5dfa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d00c69d0 con 0x7f89d00cf340 2023-08-25T05:18:30.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89d5dfa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d01f5510 con 0x7f89d015cb40 2023-08-25T05:18:30.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89cf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d00b43e0 0x7f89d00c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:30.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89cf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d00b43e0 0x7f89d00c6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45232/0 (socket says 172.21.15.55:45232) 2023-08-25T05:18:30.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89cf7fe640 1 -- 172.21.15.55:0/2476503876 learned_addr learned my addr 172.21.15.55:0/2476503876 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:30.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89cffff640 1 --2- 172.21.15.55:0/2476503876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89d015cb40 0x7f89d015eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:30.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89c7fff640 1 --2- 172.21.15.55:0/2476503876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89d00cf340 0x7f89d00c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:30.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89cf7fe640 1 -- 172.21.15.55:0/2476503876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89d015cb40 msgr2=0x7f89d015eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:30.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89cf7fe640 1 --2- 172.21.15.55:0/2476503876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89d015cb40 0x7f89d015eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:30.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89cf7fe640 1 -- 172.21.15.55:0/2476503876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89d00cf340 msgr2=0x7f89d00c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:30.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89cf7fe640 1 --2- 172.21.15.55:0/2476503876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89d00cf340 0x7f89d00c7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:30.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89cf7fe640 1 -- 172.21.15.55:0/2476503876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c00094d0 con 0x7f89d00b43e0 2023-08-25T05:18:30.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89cf7fe640 1 --2- 172.21.15.55:0/2476503876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d00b43e0 0x7f89d00c6490 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f89c001f590 tx=0x7f89c001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:30.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89ccff9640 1 -- 172.21.15.55:0/2476503876 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c00ba600 con 0x7f89d00b43e0 2023-08-25T05:18:30.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89ccff9640 1 -- 172.21.15.55:0/2476503876 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c00ba780 con 0x7f89d00b43e0 2023-08-25T05:18:30.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89d5dfa640 1 -- 172.21.15.55:0/2476503876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d01f57f0 con 0x7f89d00b43e0 2023-08-25T05:18:30.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89ccff9640 1 -- 172.21.15.55:0/2476503876 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c00bab30 con 0x7f89d00b43e0 2023-08-25T05:18:30.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.102+0000 7f89d5dfa640 1 -- 172.21.15.55:0/2476503876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d01f5db0 con 0x7f89d00b43e0 2023-08-25T05:18:30.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.106+0000 7f89d5dfa640 1 -- 172.21.15.55:0/2476503876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d0071f80 con 0x7f89d00b43e0 2023-08-25T05:18:30.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.106+0000 7f89ccff9640 1 -- 172.21.15.55:0/2476503876 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f89c00bac90 con 0x7f89d00b43e0 2023-08-25T05:18:30.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.106+0000 7f89ccff9640 1 --2- 172.21.15.55:0/2476503876 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f89b00657a0 0x7f89b0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:30.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.106+0000 7f89ccff9640 1 -- 172.21.15.55:0/2476503876 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6398+0+0 (secure 0 0 0) 0x7f89c0121790 con 0x7f89d00b43e0 2023-08-25T05:18:30.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.106+0000 7f89c7fff640 1 --2- 172.21.15.55:0/2476503876 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f89b00657a0 0x7f89b0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:30.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.106+0000 7f89c7fff640 1 --2- 172.21.15.55:0/2476503876 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f89b00657a0 0x7f89b0067c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f89d01f32e0 tx=0x7f89b8008040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:30.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.110+0000 7f89ccff9640 1 -- 172.21.15.55:0/2476503876 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f89c00eeec0 con 0x7f89d00b43e0 2023-08-25T05:18:30.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.266+0000 7f89d5dfa640 1 -- 172.21.15.55:0/2476503876 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f89d0071f80 con 0x7f89d00b43e0 2023-08-25T05:18:30.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.938+0000 7f89ccff9640 1 -- 172.21.15.55:0/2476503876 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v148) v1 ==== 169+0+0 (secure 0 0 0) 0x7f89c00f24e0 con 0x7f89d00b43e0 2023-08-25T05:18:30.941 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-08-25T05:18:30.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.942+0000 7f89d5dfa640 1 -- 172.21.15.55:0/2476503876 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f89b00657a0 msgr2=0x7f89b0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:30.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.942+0000 7f89d5dfa640 1 --2- 172.21.15.55:0/2476503876 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f89b00657a0 0x7f89b0067c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f89d01f32e0 tx=0x7f89b8008040 comp rx=0 tx=0).stop 2023-08-25T05:18:30.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.942+0000 7f89d5dfa640 1 -- 172.21.15.55:0/2476503876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d00b43e0 msgr2=0x7f89d00c6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:30.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.942+0000 7f89d5dfa640 1 --2- 172.21.15.55:0/2476503876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d00b43e0 0x7f89d00c6490 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f89c001f590 tx=0x7f89c001ba90 comp rx=0 tx=0).stop 2023-08-25T05:18:30.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.942+0000 7f89d5dfa640 1 -- 172.21.15.55:0/2476503876 shutdown_connections 2023-08-25T05:18:30.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.942+0000 7f89d5dfa640 1 --2- 172.21.15.55:0/2476503876 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f89b00657a0 0x7f89b0067c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:30.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.942+0000 7f89d5dfa640 1 --2- 172.21.15.55:0/2476503876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89d015cb40 0x7f89d015eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:30.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.942+0000 7f89d5dfa640 1 --2- 172.21.15.55:0/2476503876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89d00cf340 0x7f89d00c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:30.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.942+0000 7f89d5dfa640 1 --2- 172.21.15.55:0/2476503876 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89d00b43e0 0x7f89d00c6490 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:30.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.942+0000 7f89d5dfa640 1 -- 172.21.15.55:0/2476503876 >> 172.21.15.55:0/2476503876 conn(0x7f89d006aae0 msgr2=0x7f89d00b6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:30.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.942+0000 7f89d5dfa640 1 -- 172.21.15.55:0/2476503876 shutdown_connections 2023-08-25T05:18:30.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:30.942+0000 7f89d5dfa640 1 -- 172.21.15.55:0/2476503876 wait complete. 2023-08-25T05:18:30.966 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-08-25T05:18:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.110+0000 7fcd4f019640 1 Processor -- start 2023-08-25T05:18:31.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.110+0000 7fcd4f019640 1 -- start start 2023-08-25T05:18:31.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.110+0000 7fcd4f019640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcd4815a840 0x7fcd480cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:31.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.110+0000 7fcd4f019640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd480ce5a0 con 0x7fcd480cd620 2023-08-25T05:18:31.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.110+0000 7fcd4f019640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd480ce880 con 0x7fcd480ce110 2023-08-25T05:18:31.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.110+0000 7fcd4f019640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd480cf640 con 0x7fcd4815a840 2023-08-25T05:18:31.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.114+0000 7fcd4cdb5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcd4815a840 0x7fcd480cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:31.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.114+0000 7fcd4d5b6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcd480cd620 0x7fcd481646e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55530/0 (socket says 172.21.15.55:55530) 2023-08-25T05:18:31.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.114+0000 7fcd4d5b6640 1 -- 172.21.15.55:0/3028901200 learned_addr learned my addr 172.21.15.55:0/3028901200 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:31.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.114+0000 7fcd4cdb5640 1 -- 172.21.15.55:0/3028901200 >> v1:172.21.15.110:6789/0 conn(0x7fcd480ce110 legacy=0x7fcd480ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:31.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.114+0000 7fcd4cdb5640 1 -- 172.21.15.55:0/3028901200 >> v1:172.21.15.55:6789/0 conn(0x7fcd480cd620 legacy=0x7fcd481646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:31.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.114+0000 7fcd3f7fe640 1 -- 172.21.15.55:0/3028901200 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4174770694 0 0) 0x7fcd480ce5a0 con 0x7fcd480cd620 2023-08-25T05:18:31.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.114+0000 7fcd4cdb5640 1 -- 172.21.15.55:0/3028901200 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd480ceb60 con 0x7fcd4815a840 2023-08-25T05:18:31.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.114+0000 7fcd4cdb5640 1 --2- 172.21.15.55:0/3028901200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4815a840 0x7fcd480cc140 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fcd440097a0 tx=0x7fcd4401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1676292975387b30 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:31.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.114+0000 7fcd3f7fe640 1 -- 172.21.15.55:0/3028901200 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44004230 con 0x7fcd4815a840 2023-08-25T05:18:31.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.114+0000 7fcd3f7fe640 1 -- 172.21.15.55:0/3028901200 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd440a7050 con 0x7fcd4815a840 2023-08-25T05:18:31.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.114+0000 7fcd3f7fe640 1 -- 172.21.15.55:0/3028901200 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44003620 con 0x7fcd4815a840 2023-08-25T05:18:31.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4f019640 1 -- 172.21.15.55:0/3028901200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4815a840 msgr2=0x7fcd480cc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:31.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4f019640 1 --2- 172.21.15.55:0/3028901200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4815a840 0x7fcd480cc140 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fcd440097a0 tx=0x7fcd4401c460 comp rx=0 tx=0).stop 2023-08-25T05:18:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4f019640 1 -- 172.21.15.55:0/3028901200 shutdown_connections 2023-08-25T05:18:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4f019640 1 --2- 172.21.15.55:0/3028901200 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4815a840 0x7fcd480cc140 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4f019640 1 -- 172.21.15.55:0/3028901200 >> 172.21.15.55:0/3028901200 conn(0x7fcd480d0540 msgr2=0x7fcd480d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:31.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4f019640 1 -- 172.21.15.55:0/3028901200 shutdown_connections 2023-08-25T05:18:31.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4f019640 1 -- 172.21.15.55:0/3028901200 wait complete. 2023-08-25T05:18:31.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4f019640 1 Processor -- start 2023-08-25T05:18:31.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4f019640 1 -- start start 2023-08-25T05:18:31.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4f019640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd480cd620 0x7fcd481579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4f019640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd4815a840 0x7fcd48159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:31.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4f019640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4815ada0 0x7fcd481546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:31.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4f019640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480c8a90 con 0x7fcd4815ada0 2023-08-25T05:18:31.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4f019640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480c8d70 con 0x7fcd4815a840 2023-08-25T05:18:31.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4f019640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480c9050 con 0x7fcd480cd620 2023-08-25T05:18:31.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4d5b6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4815ada0 0x7fcd481546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:31.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4d5b6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4815ada0 0x7fcd481546c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35910/0 (socket says 172.21.15.55:35910) 2023-08-25T05:18:31.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4d5b6640 1 -- 172.21.15.55:0/257918242 learned_addr learned my addr 172.21.15.55:0/257918242 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:31.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4cdb5640 1 --2- 172.21.15.55:0/257918242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd480cd620 0x7fcd481579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:31.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd3ffff640 1 --2- 172.21.15.55:0/257918242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd4815a840 0x7fcd48159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:31.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4d5b6640 1 -- 172.21.15.55:0/257918242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd480cd620 msgr2=0x7fcd481579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:31.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4d5b6640 1 --2- 172.21.15.55:0/257918242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd480cd620 0x7fcd481579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4d5b6640 1 -- 172.21.15.55:0/257918242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd4815a840 msgr2=0x7fcd48159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:31.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4d5b6640 1 --2- 172.21.15.55:0/257918242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd4815a840 0x7fcd48159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4d5b6640 1 -- 172.21.15.55:0/257918242 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd440093b0 con 0x7fcd4815ada0 2023-08-25T05:18:31.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd3ffff640 1 --2- 172.21.15.55:0/257918242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd4815a840 0x7fcd48159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:31.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4cdb5640 1 --2- 172.21.15.55:0/257918242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd480cd620 0x7fcd481579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:31.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.118+0000 7fcd4d5b6640 1 --2- 172.21.15.55:0/257918242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4815ada0 0x7fcd481546c0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000c780 tx=0x7fcd4000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:31.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.122+0000 7fcd3d7fa640 1 -- 172.21.15.55:0/257918242 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4000ce90 con 0x7fcd4815ada0 2023-08-25T05:18:31.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.122+0000 7fcd3d7fa640 1 -- 172.21.15.55:0/257918242 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4000a640 con 0x7fcd4815ada0 2023-08-25T05:18:31.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.122+0000 7fcd4f019640 1 -- 172.21.15.55:0/257918242 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd480c9330 con 0x7fcd4815ada0 2023-08-25T05:18:31.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.122+0000 7fcd3d7fa640 1 -- 172.21.15.55:0/257918242 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4000a9d0 con 0x7fcd4815ada0 2023-08-25T05:18:31.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.122+0000 7fcd4f019640 1 -- 172.21.15.55:0/257918242 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd48156c90 con 0x7fcd4815ada0 2023-08-25T05:18:31.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.122+0000 7fcd4f019640 1 -- 172.21.15.55:0/257918242 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd480b63c0 con 0x7fcd4815ada0 2023-08-25T05:18:31.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.122+0000 7fcd3d7fa640 1 -- 172.21.15.55:0/257918242 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fcd4000ab30 con 0x7fcd4815ada0 2023-08-25T05:18:31.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.122+0000 7fcd3d7fa640 1 --2- 172.21.15.55:0/257918242 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fcd340657d0 0x7fcd34067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:31.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.122+0000 7fcd3d7fa640 1 -- 172.21.15.55:0/257918242 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fcd400823a0 con 0x7fcd4815ada0 2023-08-25T05:18:31.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.122+0000 7fcd4cdb5640 1 --2- 172.21.15.55:0/257918242 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fcd340657d0 0x7fcd34067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:31.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.126+0000 7fcd4cdb5640 1 --2- 172.21.15.55:0/257918242 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fcd340657d0 0x7fcd34067c90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcd440ad000 tx=0x7fcd44008040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:31.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.126+0000 7fcd3d7fa640 1 -- 172.21.15.55:0/257918242 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fcd4004fd20 con 0x7fcd4815ada0 2023-08-25T05:18:31.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.286+0000 7fcd4f019640 1 -- 172.21.15.55:0/257918242 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fcd48073ec0 con 0x7fcd4815ada0 2023-08-25T05:18:31.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.290+0000 7fcd3d7fa640 1 -- 172.21.15.55:0/257918242 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v49) v1 ==== 115+0+0 (secure 0 0 0) 0x7fcd40053340 con 0x7fcd4815ada0 2023-08-25T05:18:31.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.294+0000 7fcd4f019640 1 -- 172.21.15.55:0/257918242 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fcd340657d0 msgr2=0x7fcd34067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:31.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.294+0000 7fcd4f019640 1 --2- 172.21.15.55:0/257918242 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fcd340657d0 0x7fcd34067c90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcd440ad000 tx=0x7fcd44008040 comp rx=0 tx=0).stop 2023-08-25T05:18:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.294+0000 7fcd4f019640 1 -- 172.21.15.55:0/257918242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4815ada0 msgr2=0x7fcd481546c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.294+0000 7fcd4f019640 1 --2- 172.21.15.55:0/257918242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4815ada0 0x7fcd481546c0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000c780 tx=0x7fcd4000cc40 comp rx=0 tx=0).stop 2023-08-25T05:18:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.294+0000 7fcd4f019640 1 -- 172.21.15.55:0/257918242 shutdown_connections 2023-08-25T05:18:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.294+0000 7fcd4f019640 1 --2- 172.21.15.55:0/257918242 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fcd340657d0 0x7fcd34067c90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.294+0000 7fcd4f019640 1 --2- 172.21.15.55:0/257918242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4815ada0 0x7fcd481546c0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.294+0000 7fcd4f019640 1 --2- 172.21.15.55:0/257918242 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd4815a840 0x7fcd48159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.294+0000 7fcd4f019640 1 --2- 172.21.15.55:0/257918242 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd480cd620 0x7fcd481579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.294+0000 7fcd4f019640 1 -- 172.21.15.55:0/257918242 >> 172.21.15.55:0/257918242 conn(0x7fcd480d0540 msgr2=0x7fcd48159ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:31.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.294+0000 7fcd4f019640 1 -- 172.21.15.55:0/257918242 shutdown_connections 2023-08-25T05:18:31.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.294+0000 7fcd4f019640 1 -- 172.21.15.55:0/257918242 wait complete. 2023-08-25T05:18:31.315 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-25T05:18:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.462+0000 7fbfcfe19640 1 Processor -- start 2023-08-25T05:18:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.462+0000 7fbfcfe19640 1 -- start start 2023-08-25T05:18:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.462+0000 7fbfcfe19640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfc815e3c0 0x7fbfc815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:31.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.462+0000 7fbfcfe19640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbfc80d1290 0x7fbfc815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:31.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.462+0000 7fbfcfe19640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc80cd5a0 con 0x7fbfc81601f0 2023-08-25T05:18:31.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.462+0000 7fbfcfe19640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc80cd880 con 0x7fbfc815e3c0 2023-08-25T05:18:31.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.462+0000 7fbfcfe19640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc80cdb60 con 0x7fbfc80d1290 2023-08-25T05:18:31.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.462+0000 7fbfcdbb5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbfc81601f0 0x7fbfc80d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55532/0 (socket says 172.21.15.55:55532) 2023-08-25T05:18:31.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.462+0000 7fbfcdbb5640 1 -- 172.21.15.55:0/2157186016 learned_addr learned my addr 172.21.15.55:0/2157186016 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:31.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.462+0000 7fbfcd3b4640 1 --2- 172.21.15.55:0/2157186016 >> v2:172.21.15.55:3300/0 conn(0x7fbfc815e3c0 0x7fbfc815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:31.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.462+0000 7fbfce3b6640 1 --2- 172.21.15.55:0/2157186016 >> v2:172.21.15.110:3300/0 conn(0x7fbfc80d1290 0x7fbfc815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:31.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.462+0000 7fbfccbb3640 1 -- 172.21.15.55:0/2157186016 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593248303 0 0) 0x7fbfc80cd5a0 con 0x7fbfc81601f0 2023-08-25T05:18:31.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.462+0000 7fbfccbb3640 1 -- 172.21.15.55:0/2157186016 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfb4003530 con 0x7fbfc81601f0 2023-08-25T05:18:31.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.462+0000 7fbfcd3b4640 1 -- 172.21.15.55:0/2157186016 >> v2:172.21.15.110:3300/0 conn(0x7fbfc80d1290 msgr2=0x7fbfc815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:31.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.462+0000 7fbfcd3b4640 1 --2- 172.21.15.55:0/2157186016 >> v2:172.21.15.110:3300/0 conn(0x7fbfc80d1290 0x7fbfc815e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.462+0000 7fbfcd3b4640 1 -- 172.21.15.55:0/2157186016 >> v1:172.21.15.55:6789/0 conn(0x7fbfc81601f0 legacy=0x7fbfc80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:31.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.462+0000 7fbfcd3b4640 1 -- 172.21.15.55:0/2157186016 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc80cde40 con 0x7fbfc815e3c0 2023-08-25T05:18:31.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.466+0000 7fbfcd3b4640 1 --2- 172.21.15.55:0/2157186016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfc815e3c0 0x7fbfc815d430 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80d2060 tx=0x7fbfb801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8cadbec19311724 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:31.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.466+0000 7fbfccbb3640 1 -- 172.21.15.55:0/2157186016 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8004230 con 0x7fbfc815e3c0 2023-08-25T05:18:31.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.466+0000 7fbfccbb3640 1 -- 172.21.15.55:0/2157186016 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb80a7050 con 0x7fbfc815e3c0 2023-08-25T05:18:31.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.466+0000 7fbfccbb3640 1 -- 172.21.15.55:0/2157186016 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8003620 con 0x7fbfc815e3c0 2023-08-25T05:18:31.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.466+0000 7fbfcfe19640 1 -- 172.21.15.55:0/2157186016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfc815e3c0 msgr2=0x7fbfc815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:31.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.466+0000 7fbfcfe19640 1 --2- 172.21.15.55:0/2157186016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfc815e3c0 0x7fbfc815d430 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80d2060 tx=0x7fbfb801c430 comp rx=0 tx=0).stop 2023-08-25T05:18:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.466+0000 7fbfcfe19640 1 -- 172.21.15.55:0/2157186016 shutdown_connections 2023-08-25T05:18:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.466+0000 7fbfcfe19640 1 --2- 172.21.15.55:0/2157186016 >> v2:172.21.15.110:3300/0 conn(0x7fbfc80d1290 0x7fbfc815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.466+0000 7fbfcfe19640 1 --2- 172.21.15.55:0/2157186016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfc815e3c0 0x7fbfc815d430 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.466+0000 7fbfcfe19640 1 -- 172.21.15.55:0/2157186016 >> 172.21.15.55:0/2157186016 conn(0x7fbfc80d27d0 msgr2=0x7fbfc80d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.470+0000 7fbfcfe19640 1 -- 172.21.15.55:0/2157186016 shutdown_connections 2023-08-25T05:18:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.470+0000 7fbfcfe19640 1 -- 172.21.15.55:0/2157186016 wait complete. 2023-08-25T05:18:31.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.474+0000 7fbfcfe19640 1 Processor -- start 2023-08-25T05:18:31.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.474+0000 7fbfcfe19640 1 -- start start 2023-08-25T05:18:31.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.474+0000 7fbfcfe19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfc80d1290 0x7fbfc80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:31.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.474+0000 7fbfcfe19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfc815e3c0 0x7fbfc80cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:31.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.474+0000 7fbfcfe19640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfc81601f0 0x7fbfc80c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:31.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfcfe19640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc81525e0 con 0x7fbfc80d1290 2023-08-25T05:18:31.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfcfe19640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc8151960 con 0x7fbfc81601f0 2023-08-25T05:18:31.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfcfe19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc8151c40 con 0x7fbfc815e3c0 2023-08-25T05:18:31.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfcd3b4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfc815e3c0 0x7fbfc80cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:31.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfcd3b4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfc815e3c0 0x7fbfc80cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:56912/0 (socket says 172.21.15.55:56912) 2023-08-25T05:18:31.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfcd3b4640 1 -- 172.21.15.55:0/210983575 learned_addr learned my addr 172.21.15.55:0/210983575 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:31.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfcdbb5640 1 --2- 172.21.15.55:0/210983575 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfc80d1290 0x7fbfc80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:31.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfce3b6640 1 --2- 172.21.15.55:0/210983575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfc81601f0 0x7fbfc80c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:31.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfcdbb5640 1 -- 172.21.15.55:0/210983575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfc815e3c0 msgr2=0x7fbfc80cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:31.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfcdbb5640 1 --2- 172.21.15.55:0/210983575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfc815e3c0 0x7fbfc80cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfcdbb5640 1 -- 172.21.15.55:0/210983575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfc81601f0 msgr2=0x7fbfc80c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:31.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfcdbb5640 1 --2- 172.21.15.55:0/210983575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfc81601f0 0x7fbfc80c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfcdbb5640 1 -- 172.21.15.55:0/210983575 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb8009420 con 0x7fbfc80d1290 2023-08-25T05:18:31.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfcd3b4640 1 --2- 172.21.15.55:0/210983575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfc815e3c0 0x7fbfc80cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:18:31.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfcdbb5640 1 --2- 172.21.15.55:0/210983575 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfc80d1290 0x7fbfc80cf1e0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4001ec0 tx=0x7fbfc400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:31.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfbe7fc640 1 -- 172.21.15.55:0/210983575 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc40074e0 con 0x7fbfc80d1290 2023-08-25T05:18:31.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfbe7fc640 1 -- 172.21.15.55:0/210983575 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc4007640 con 0x7fbfc80d1290 2023-08-25T05:18:31.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfbe7fc640 1 -- 172.21.15.55:0/210983575 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc40059b0 con 0x7fbfc80d1290 2023-08-25T05:18:31.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfcfe19640 1 -- 172.21.15.55:0/210983575 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc8151f20 con 0x7fbfc80d1290 2023-08-25T05:18:31.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.478+0000 7fbfcfe19640 1 -- 172.21.15.55:0/210983575 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc80ca1c0 con 0x7fbfc80d1290 2023-08-25T05:18:31.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.482+0000 7fbfbe7fc640 1 -- 172.21.15.55:0/210983575 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fbfc4005b10 con 0x7fbfc80d1290 2023-08-25T05:18:31.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.482+0000 7fbfcfe19640 1 -- 172.21.15.55:0/210983575 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc80b5260 con 0x7fbfc80d1290 2023-08-25T05:18:31.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.486+0000 7fbfbe7fc640 1 --2- 172.21.15.55:0/210983575 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fbfac0657a0 0x7fbfac067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.486+0000 7fbfbe7fc640 1 -- 172.21.15.55:0/210983575 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fbfc4082440 con 0x7fbfc80d1290 2023-08-25T05:18:31.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.486+0000 7fbfcd3b4640 1 --2- 172.21.15.55:0/210983575 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fbfac0657a0 0x7fbfac067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:31.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.486+0000 7fbfcd3b4640 1 --2- 172.21.15.55:0/210983575 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fbfac0657a0 0x7fbfac067c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbfb801a060 tx=0x7fbfb80a6000 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:31.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.490+0000 7fbfbe7fc640 1 -- 172.21.15.55:0/210983575 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbfc404ff00 con 0x7fbfc80d1290 2023-08-25T05:18:31.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.646+0000 7fbfcfe19640 1 -- 172.21.15.55:0/210983575 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fbfc8073ec0 con 0x7fbfc80d1290 2023-08-25T05:18:31.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.650+0000 7fbfbe7fc640 1 -- 172.21.15.55:0/210983575 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v50) v1 ==== 120+0+0 (secure 0 0 0) 0x7fbfc4053520 con 0x7fbfc80d1290 2023-08-25T05:18:31.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.654+0000 7fbfcfe19640 1 -- 172.21.15.55:0/210983575 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fbfac0657a0 msgr2=0x7fbfac067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:31.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.654+0000 7fbfcfe19640 1 --2- 172.21.15.55:0/210983575 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fbfac0657a0 0x7fbfac067c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbfb801a060 tx=0x7fbfb80a6000 comp rx=0 tx=0).stop 2023-08-25T05:18:31.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.654+0000 7fbfcfe19640 1 -- 172.21.15.55:0/210983575 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfc80d1290 msgr2=0x7fbfc80cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:31.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.654+0000 7fbfcfe19640 1 --2- 172.21.15.55:0/210983575 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfc80d1290 0x7fbfc80cf1e0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4001ec0 tx=0x7fbfc400c820 comp rx=0 tx=0).stop 2023-08-25T05:18:31.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.654+0000 7fbfcfe19640 1 -- 172.21.15.55:0/210983575 shutdown_connections 2023-08-25T05:18:31.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.654+0000 7fbfcfe19640 1 --2- 172.21.15.55:0/210983575 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fbfac0657a0 0x7fbfac067c60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.654+0000 7fbfcfe19640 1 --2- 172.21.15.55:0/210983575 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfc81601f0 0x7fbfc80c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.654+0000 7fbfcfe19640 1 --2- 172.21.15.55:0/210983575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfc815e3c0 0x7fbfc80cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.654+0000 7fbfcfe19640 1 --2- 172.21.15.55:0/210983575 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfc80d1290 0x7fbfc80cf1e0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.654+0000 7fbfcfe19640 1 -- 172.21.15.55:0/210983575 >> 172.21.15.55:0/210983575 conn(0x7fbfc80d27d0 msgr2=0x7fbfc80d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:31.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.654+0000 7fbfcfe19640 1 -- 172.21.15.55:0/210983575 shutdown_connections 2023-08-25T05:18:31.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.654+0000 7fbfcfe19640 1 -- 172.21.15.55:0/210983575 wait complete. 2023-08-25T05:18:31.676 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-25T05:18:31.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.818+0000 7f38afb44640 1 Processor -- start 2023-08-25T05:18:31.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.818+0000 7f38afb44640 1 -- start start 2023-08-25T05:18:31.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.822+0000 7f38afb44640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f38a80ad660 0x7f38a80cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:31.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.822+0000 7f38afb44640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38a80ada40 0x7f38a806c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:31.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.822+0000 7f38afb44640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a80cdf40 con 0x7f38a809bde0 2023-08-25T05:18:31.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.822+0000 7f38afb44640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a806c7b0 con 0x7f38a80ada40 2023-08-25T05:18:31.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.822+0000 7f38afb44640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a806b7b0 con 0x7f38a80ad660 2023-08-25T05:18:31.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.822+0000 7f38ad0df640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38a80ada40 0x7f38a806c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:31.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.822+0000 7f38ad0df640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38a80ada40 0x7f38a806c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35936/0 (socket says 172.21.15.55:35936) 2023-08-25T05:18:31.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.822+0000 7f38ad0df640 1 -- 172.21.15.55:0/510008679 learned_addr learned my addr 172.21.15.55:0/510008679 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:31.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.822+0000 7f38ad8e0640 1 --2- 172.21.15.55:0/510008679 >> v2:172.21.15.110:3300/0 conn(0x7f38a80ad660 0x7f38a80cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:31.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.822+0000 7f38ad0df640 1 -- 172.21.15.55:0/510008679 >> v2:172.21.15.110:3300/0 conn(0x7f38a80ad660 msgr2=0x7f38a80cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:31.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.822+0000 7f38ad0df640 1 --2- 172.21.15.55:0/510008679 >> v2:172.21.15.110:3300/0 conn(0x7f38a80ad660 0x7f38a80cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.822+0000 7f38ad0df640 1 -- 172.21.15.55:0/510008679 >> v1:172.21.15.110:6789/0 conn(0x7f38a809bde0 legacy=0x7f38a80cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:31.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.822+0000 7f38ad0df640 1 -- 172.21.15.55:0/510008679 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a806ba90 con 0x7f38a80ada40 2023-08-25T05:18:31.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.826+0000 7f38ad0df640 1 --2- 172.21.15.55:0/510008679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38a80ada40 0x7f38a806c270 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f38a806dd00 tx=0x7f389801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894d740e52c90e6d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:31.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.826+0000 7f38ac8de640 1 -- 172.21.15.55:0/510008679 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980ad640 con 0x7f38a80ada40 2023-08-25T05:18:31.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.826+0000 7f38ac8de640 1 -- 172.21.15.55:0/510008679 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38980ad7a0 con 0x7f38a80ada40 2023-08-25T05:18:31.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.826+0000 7f38ac8de640 1 -- 172.21.15.55:0/510008679 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980adb30 con 0x7f38a80ada40 2023-08-25T05:18:31.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.826+0000 7f38afb44640 1 -- 172.21.15.55:0/510008679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38a80ada40 msgr2=0x7f38a806c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:31.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.826+0000 7f38afb44640 1 --2- 172.21.15.55:0/510008679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38a80ada40 0x7f38a806c270 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f38a806dd00 tx=0x7f389801c4c0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.826+0000 7f38afb44640 1 -- 172.21.15.55:0/510008679 shutdown_connections 2023-08-25T05:18:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.826+0000 7f38afb44640 1 --2- 172.21.15.55:0/510008679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38a80ada40 0x7f38a806c270 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.826+0000 7f38afb44640 1 --2- 172.21.15.55:0/510008679 >> v2:172.21.15.110:3300/0 conn(0x7f38a80ad660 0x7f38a80cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.826+0000 7f38afb44640 1 -- 172.21.15.55:0/510008679 >> 172.21.15.55:0/510008679 conn(0x7f38a8069900 msgr2=0x7f38a8069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.826+0000 7f38afb44640 1 -- 172.21.15.55:0/510008679 shutdown_connections 2023-08-25T05:18:31.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.826+0000 7f38afb44640 1 -- 172.21.15.55:0/510008679 wait complete. 2023-08-25T05:18:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.826+0000 7f38afb44640 1 Processor -- start 2023-08-25T05:18:31.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.826+0000 7f38afb44640 1 -- start start 2023-08-25T05:18:31.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.830+0000 7f38afb44640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38a809bde0 0x7f38a8152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:31.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.830+0000 7f38afb44640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38a80ad660 0x7f38a81581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:31.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.830+0000 7f38afb44640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38a80ada40 0x7f38a81586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:31.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.830+0000 7f38afb44640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a8153370 con 0x7f38a80ada40 2023-08-25T05:18:31.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.830+0000 7f38afb44640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a80b25d0 con 0x7f38a80ad660 2023-08-25T05:18:31.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.830+0000 7f38afb44640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a80b1d30 con 0x7f38a809bde0 2023-08-25T05:18:31.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.830+0000 7f38ae0e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38a80ada40 0x7f38a81586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:31.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.830+0000 7f38ad0df640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38a80ad660 0x7f38a81581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:31.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.830+0000 7f38ae0e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38a80ada40 0x7f38a81586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35952/0 (socket says 172.21.15.55:35952) 2023-08-25T05:18:31.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.830+0000 7f38ae0e1640 1 -- 172.21.15.55:0/3617278039 learned_addr learned my addr 172.21.15.55:0/3617278039 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:31.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.830+0000 7f38ad8e0640 1 --2- 172.21.15.55:0/3617278039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38a809bde0 0x7f38a8152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:31.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.830+0000 7f38ae0e1640 1 -- 172.21.15.55:0/3617278039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38a809bde0 msgr2=0x7f38a8152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:31.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.830+0000 7f38ae0e1640 1 --2- 172.21.15.55:0/3617278039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38a809bde0 0x7f38a8152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.830+0000 7f38ae0e1640 1 -- 172.21.15.55:0/3617278039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38a80ad660 msgr2=0x7f38a81581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:31.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.830+0000 7f38ae0e1640 1 --2- 172.21.15.55:0/3617278039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38a80ad660 0x7f38a81581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:31.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.830+0000 7f38ae0e1640 1 -- 172.21.15.55:0/3617278039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38980094d0 con 0x7f38a80ada40 2023-08-25T05:18:31.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.830+0000 7f38ae0e1640 1 --2- 172.21.15.55:0/3617278039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38a80ada40 0x7f38a81586e0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f38a000c780 tx=0x7f38a000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:31.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.834+0000 7f389e7fc640 1 -- 172.21.15.55:0/3617278039 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0004b70 con 0x7f38a80ada40 2023-08-25T05:18:31.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.834+0000 7f389e7fc640 1 -- 172.21.15.55:0/3617278039 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a000ce90 con 0x7f38a80ada40 2023-08-25T05:18:31.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.834+0000 7f389e7fc640 1 -- 172.21.15.55:0/3617278039 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a000a850 con 0x7f38a80ada40 2023-08-25T05:18:31.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.834+0000 7f38afb44640 1 -- 172.21.15.55:0/3617278039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a80b2010 con 0x7f38a80ada40 2023-08-25T05:18:31.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.834+0000 7f38afb44640 1 -- 172.21.15.55:0/3617278039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a815a1c0 con 0x7f38a80ada40 2023-08-25T05:18:31.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.834+0000 7f38afb44640 1 -- 172.21.15.55:0/3617278039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a8073ec0 con 0x7f38a80ada40 2023-08-25T05:18:31.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.834+0000 7f389e7fc640 1 -- 172.21.15.55:0/3617278039 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f38a000a9b0 con 0x7f38a80ada40 2023-08-25T05:18:31.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.838+0000 7f389e7fc640 1 --2- 172.21.15.55:0/3617278039 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f388c0657a0 0x7f388c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:31.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.838+0000 7f389e7fc640 1 -- 172.21.15.55:0/3617278039 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f38a0082f70 con 0x7f38a80ada40 2023-08-25T05:18:31.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.838+0000 7f38ad8e0640 1 --2- 172.21.15.55:0/3617278039 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f388c0657a0 0x7f388c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:31.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.838+0000 7f38ad8e0640 1 --2- 172.21.15.55:0/3617278039 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f388c0657a0 0x7f388c067c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f38a4006fd0 tx=0x7f38a4008040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:31.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.842+0000 7f389e7fc640 1 -- 172.21.15.55:0/3617278039 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f38a00b3d90 con 0x7f38a80ada40 2023-08-25T05:18:32.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:31.998+0000 7f38afb44640 1 -- 172.21.15.55:0/3617278039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f38a80cb1e0 con 0x7f38a80ada40 2023-08-25T05:18:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.006+0000 7f389e7fc640 1 -- 172.21.15.55:0/3617278039 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7f38a0054540 con 0x7f38a80ada40 2023-08-25T05:18:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.006+0000 7f38afb44640 1 -- 172.21.15.55:0/3617278039 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f388c0657a0 msgr2=0x7f388c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.006+0000 7f38afb44640 1 --2- 172.21.15.55:0/3617278039 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f388c0657a0 0x7f388c067c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f38a4006fd0 tx=0x7f38a4008040 comp rx=0 tx=0).stop 2023-08-25T05:18:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.006+0000 7f38afb44640 1 -- 172.21.15.55:0/3617278039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38a80ada40 msgr2=0x7f38a81586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:32.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.006+0000 7f38afb44640 1 --2- 172.21.15.55:0/3617278039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38a80ada40 0x7f38a81586e0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f38a000c780 tx=0x7f38a000cc40 comp rx=0 tx=0).stop 2023-08-25T05:18:32.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.006+0000 7f38afb44640 1 -- 172.21.15.55:0/3617278039 shutdown_connections 2023-08-25T05:18:32.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.006+0000 7f38afb44640 1 --2- 172.21.15.55:0/3617278039 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f388c0657a0 0x7f388c067c60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:32.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.006+0000 7f38afb44640 1 --2- 172.21.15.55:0/3617278039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38a80ada40 0x7f38a81586e0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:32.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.006+0000 7f38afb44640 1 --2- 172.21.15.55:0/3617278039 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38a80ad660 0x7f38a81581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:32.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.006+0000 7f38afb44640 1 --2- 172.21.15.55:0/3617278039 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38a809bde0 0x7f38a8152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:32.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.006+0000 7f38afb44640 1 -- 172.21.15.55:0/3617278039 >> 172.21.15.55:0/3617278039 conn(0x7f38a8069900 msgr2=0x7f38a80ab500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:32.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.006+0000 7f38afb44640 1 -- 172.21.15.55:0/3617278039 shutdown_connections 2023-08-25T05:18:32.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.006+0000 7f38afb44640 1 -- 172.21.15.55:0/3617278039 wait complete. 2023-08-25T05:18:32.028 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-08-25T05:18:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.170+0000 7f471a6cb640 1 Processor -- start 2023-08-25T05:18:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.170+0000 7f471a6cb640 1 -- start start 2023-08-25T05:18:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.170+0000 7f471a6cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47140ad950 0x7f47140cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.170+0000 7f471a6cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47140cc880 con 0x7f47140ceeb0 2023-08-25T05:18:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.170+0000 7f471a6cb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47140ccb60 con 0x7f47140c89f0 2023-08-25T05:18:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.170+0000 7f471a6cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47140b11f0 con 0x7f47140ad950 2023-08-25T05:18:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.174+0000 7f4718c68640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f47140ceeb0 0x7f47140b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55538/0 (socket says 172.21.15.55:55538) 2023-08-25T05:18:32.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.174+0000 7f4718c68640 1 -- 172.21.15.55:0/1568298100 learned_addr learned my addr 172.21.15.55:0/1568298100 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:32.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.174+0000 7f4713fff640 1 --2- 172.21.15.55:0/1568298100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47140ad950 0x7f47140cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:32.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.174+0000 7f4712ffd640 1 -- 172.21.15.55:0/1568298100 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550387083 0 0) 0x7f47140cc880 con 0x7f47140ceeb0 2023-08-25T05:18:32.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.174+0000 7f4712ffd640 1 -- 172.21.15.55:0/1568298100 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46fc003530 con 0x7f47140ceeb0 2023-08-25T05:18:32.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.174+0000 7f4712ffd640 1 -- 172.21.15.55:0/1568298100 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138892895 0 0) 0x7f47140ccb60 con 0x7f47140c89f0 2023-08-25T05:18:32.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.174+0000 7f4712ffd640 1 -- 172.21.15.55:0/1568298100 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47140cc880 con 0x7f47140c89f0 2023-08-25T05:18:32.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.174+0000 7f4713fff640 1 -- 172.21.15.55:0/1568298100 >> v1:172.21.15.110:6789/0 conn(0x7f47140c89f0 legacy=0x7f47140ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:32.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.174+0000 7f4713fff640 1 -- 172.21.15.55:0/1568298100 >> v1:172.21.15.55:6789/0 conn(0x7f47140ceeb0 legacy=0x7f47140b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:32.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.174+0000 7f4713fff640 1 -- 172.21.15.55:0/1568298100 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47140cce40 con 0x7f47140ad950 2023-08-25T05:18:32.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.174+0000 7f4713fff640 1 --2- 172.21.15.55:0/1568298100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47140ad950 0x7f47140cc2a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f47040097f0 tx=0x7f470401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebce46d1b7e17112 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:32.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f4712ffd640 1 -- 172.21.15.55:0/1568298100 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47040ab600 con 0x7f47140ad950 2023-08-25T05:18:32.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f4712ffd640 1 -- 172.21.15.55:0/1568298100 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47040a7050 con 0x7f47140ad950 2023-08-25T05:18:32.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f4712ffd640 1 -- 172.21.15.55:0/1568298100 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47040ab980 con 0x7f47140ad950 2023-08-25T05:18:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f471a6cb640 1 -- 172.21.15.55:0/1568298100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47140ad950 msgr2=0x7f47140cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f471a6cb640 1 --2- 172.21.15.55:0/1568298100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47140ad950 0x7f47140cc2a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f47040097f0 tx=0x7f470401c430 comp rx=0 tx=0).stop 2023-08-25T05:18:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f471a6cb640 1 -- 172.21.15.55:0/1568298100 shutdown_connections 2023-08-25T05:18:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f471a6cb640 1 --2- 172.21.15.55:0/1568298100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47140ad950 0x7f47140cc2a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f471a6cb640 1 -- 172.21.15.55:0/1568298100 >> 172.21.15.55:0/1568298100 conn(0x7f4714069d00 msgr2=0x7f471406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f471a6cb640 1 -- 172.21.15.55:0/1568298100 shutdown_connections 2023-08-25T05:18:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f471a6cb640 1 -- 172.21.15.55:0/1568298100 wait complete. 2023-08-25T05:18:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f471a6cb640 1 Processor -- start 2023-08-25T05:18:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f471a6cb640 1 -- start start 2023-08-25T05:18:32.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f471a6cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47140ad950 0x7f47140acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:32.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f471a6cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47140c89f0 0x7f47140c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:32.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f471a6cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47140ceeb0 0x7f4714150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:32.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f471a6cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47140ad0f0 con 0x7f47140c89f0 2023-08-25T05:18:32.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f471a6cb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47140c9bf0 con 0x7f47140ceeb0 2023-08-25T05:18:32.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f471a6cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47140abb10 con 0x7f47140ad950 2023-08-25T05:18:32.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f47137fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47140c89f0 0x7f47140c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:32.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f47137fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47140c89f0 0x7f47140c96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35962/0 (socket says 172.21.15.55:35962) 2023-08-25T05:18:32.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.178+0000 7f47137fe640 1 -- 172.21.15.55:0/1320115122 learned_addr learned my addr 172.21.15.55:0/1320115122 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:32.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.182+0000 7f4713fff640 1 --2- 172.21.15.55:0/1320115122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47140ad950 0x7f47140acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:32.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.182+0000 7f4718c68640 1 --2- 172.21.15.55:0/1320115122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47140ceeb0 0x7f4714150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:32.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.182+0000 7f47137fe640 1 -- 172.21.15.55:0/1320115122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47140ad950 msgr2=0x7f47140acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:32.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.182+0000 7f47137fe640 1 --2- 172.21.15.55:0/1320115122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47140ad950 0x7f47140acbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:32.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.182+0000 7f47137fe640 1 -- 172.21.15.55:0/1320115122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47140ceeb0 msgr2=0x7f4714150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:32.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.182+0000 7f47137fe640 1 --2- 172.21.15.55:0/1320115122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47140ceeb0 0x7f4714150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:32.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.182+0000 7f47137fe640 1 -- 172.21.15.55:0/1320115122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4704009420 con 0x7f47140c89f0 2023-08-25T05:18:32.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.182+0000 7f4713fff640 1 --2- 172.21.15.55:0/1320115122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47140ad950 0x7f47140acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:32.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.182+0000 7f47137fe640 1 --2- 172.21.15.55:0/1320115122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47140c89f0 0x7f47140c96b0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f470800c410 tx=0x7f470800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:32.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.182+0000 7f4710ff9640 1 -- 172.21.15.55:0/1320115122 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47080052d0 con 0x7f47140c89f0 2023-08-25T05:18:32.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.182+0000 7f4710ff9640 1 -- 172.21.15.55:0/1320115122 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4708005450 con 0x7f47140c89f0 2023-08-25T05:18:32.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.182+0000 7f4710ff9640 1 -- 172.21.15.55:0/1320115122 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4708003840 con 0x7f47140c89f0 2023-08-25T05:18:32.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.182+0000 7f471a6cb640 1 -- 172.21.15.55:0/1320115122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47140abdf0 con 0x7f47140c89f0 2023-08-25T05:18:32.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.182+0000 7f471a6cb640 1 -- 172.21.15.55:0/1320115122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47140ac3b0 con 0x7f47140c89f0 2023-08-25T05:18:32.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.182+0000 7f471a6cb640 1 -- 172.21.15.55:0/1320115122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471404dbe0 con 0x7f47140c89f0 2023-08-25T05:18:32.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.182+0000 7f4710ff9640 1 -- 172.21.15.55:0/1320115122 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f47080039a0 con 0x7f47140c89f0 2023-08-25T05:18:32.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.186+0000 7f4710ff9640 1 --2- 172.21.15.55:0/1320115122 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f47000657a0 0x7f4700067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:32.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.186+0000 7f4710ff9640 1 -- 172.21.15.55:0/1320115122 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f4708082570 con 0x7f47140c89f0 2023-08-25T05:18:32.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.186+0000 7f4713fff640 1 --2- 172.21.15.55:0/1320115122 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f47000657a0 0x7f4700067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:32.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.186+0000 7f4713fff640 1 --2- 172.21.15.55:0/1320115122 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f47000657a0 0x7f4700067c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f47040ad000 tx=0x7f4704008040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:32.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.190+0000 7f4710ff9640 1 -- 172.21.15.55:0/1320115122 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f470804ffa0 con 0x7f47140c89f0 2023-08-25T05:18:32.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.402+0000 7f471a6cb640 1 -- 172.21.15.55:0/1320115122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7f47140b2e40 con 0x7f47140c89f0 2023-08-25T05:18:32.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.933+0000 7f4710ff9640 1 -- 172.21.15.55:0/1320115122 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v2451) v1 ==== 178+0+0 (secure 0 0 0) 0x7f47080535c0 con 0x7f47140c89f0 2023-08-25T05:18:32.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.937+0000 7f471a6cb640 1 -- 172.21.15.55:0/1320115122 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f47000657a0 msgr2=0x7f4700067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:32.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.937+0000 7f471a6cb640 1 --2- 172.21.15.55:0/1320115122 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f47000657a0 0x7f4700067c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f47040ad000 tx=0x7f4704008040 comp rx=0 tx=0).stop 2023-08-25T05:18:32.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.937+0000 7f471a6cb640 1 -- 172.21.15.55:0/1320115122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47140c89f0 msgr2=0x7f47140c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.937+0000 7f471a6cb640 1 --2- 172.21.15.55:0/1320115122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47140c89f0 0x7f47140c96b0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f470800c410 tx=0x7f470800c8d0 comp rx=0 tx=0).stop 2023-08-25T05:18:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.937+0000 7f471a6cb640 1 -- 172.21.15.55:0/1320115122 shutdown_connections 2023-08-25T05:18:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.937+0000 7f471a6cb640 1 --2- 172.21.15.55:0/1320115122 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f47000657a0 0x7f4700067c60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.937+0000 7f471a6cb640 1 --2- 172.21.15.55:0/1320115122 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47140ceeb0 0x7f4714150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:32.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.937+0000 7f471a6cb640 1 --2- 172.21.15.55:0/1320115122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47140c89f0 0x7f47140c96b0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.937+0000 7f471a6cb640 1 --2- 172.21.15.55:0/1320115122 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47140ad950 0x7f47140acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.937+0000 7f471a6cb640 1 -- 172.21.15.55:0/1320115122 >> 172.21.15.55:0/1320115122 conn(0x7f4714069d00 msgr2=0x7f47140cb680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.937+0000 7f471a6cb640 1 -- 172.21.15.55:0/1320115122 shutdown_connections 2023-08-25T05:18:32.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:32.937+0000 7f471a6cb640 1 -- 172.21.15.55:0/1320115122 wait complete. 2023-08-25T05:18:32.960 INFO:tasks.cephfs_test_runner:test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) ... ok 2023-08-25T05:18:32.961 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-08-25T05:18:32.961 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-25T05:18:32.962 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-08-25T05:18:33.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.105+0000 7f05ce996640 1 Processor -- start 2023-08-25T05:18:33.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.105+0000 7f05ce996640 1 -- start start 2023-08-25T05:18:33.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.105+0000 7f05ce996640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05c80d0da0 0x7f05c80d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:33.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.105+0000 7f05ce996640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c80b29b0 con 0x7f05c80cdde0 2023-08-25T05:18:33.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.105+0000 7f05ce996640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c80cfc80 con 0x7f05c80b3e50 2023-08-25T05:18:33.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.105+0000 7f05ce996640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c80d16c0 con 0x7f05c80d0da0 2023-08-25T05:18:33.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.109+0000 7f05c77fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f05c80cdde0 0x7f05c80cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55544/0 (socket says 172.21.15.55:55544) 2023-08-25T05:18:33.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.109+0000 7f05c77fe640 1 -- 172.21.15.55:0/4204745410 learned_addr learned my addr 172.21.15.55:0/4204745410 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:33.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.109+0000 7f05c7fff640 1 --2- 172.21.15.55:0/4204745410 >> v2:172.21.15.55:3300/0 conn(0x7f05c80d0da0 0x7f05c80d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:33.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.109+0000 7f05c7fff640 1 -- 172.21.15.55:0/4204745410 >> v1:172.21.15.110:6789/0 conn(0x7f05c80b3e50 legacy=0x7f05c80cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:33.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.109+0000 7f05c7fff640 1 -- 172.21.15.55:0/4204745410 >> v1:172.21.15.55:6789/0 conn(0x7f05c80cdde0 legacy=0x7f05c80cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:33.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.109+0000 7f05c7fff640 1 -- 172.21.15.55:0/4204745410 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c80b1dc0 con 0x7f05c80d0da0 2023-08-25T05:18:33.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.109+0000 7f05c6ffd640 1 -- 172.21.15.55:0/4204745410 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3383649095 0 0) 0x7f05c80b29b0 con 0x7f05c80cdde0 2023-08-25T05:18:33.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.109+0000 7f05c7fff640 1 --2- 172.21.15.55:0/4204745410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c80d0da0 0x7f05c80d1180 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f05b80097a0 tx=0x7f05b801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab69ccffb07ebd5f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:33.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.109+0000 7f05c6ffd640 1 -- 172.21.15.55:0/4204745410 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b80a8950 con 0x7f05c80d0da0 2023-08-25T05:18:33.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.109+0000 7f05c6ffd640 1 -- 172.21.15.55:0/4204745410 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b80a8ab0 con 0x7f05c80d0da0 2023-08-25T05:18:33.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.109+0000 7f05c6ffd640 1 -- 172.21.15.55:0/4204745410 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b80a8e40 con 0x7f05c80d0da0 2023-08-25T05:18:33.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05ce996640 1 -- 172.21.15.55:0/4204745410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c80d0da0 msgr2=0x7f05c80d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:33.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05ce996640 1 --2- 172.21.15.55:0/4204745410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c80d0da0 0x7f05c80d1180 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f05b80097a0 tx=0x7f05b801ec50 comp rx=0 tx=0).stop 2023-08-25T05:18:33.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05ce996640 1 -- 172.21.15.55:0/4204745410 shutdown_connections 2023-08-25T05:18:33.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05ce996640 1 --2- 172.21.15.55:0/4204745410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c80d0da0 0x7f05c80d1180 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:33.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05ce996640 1 -- 172.21.15.55:0/4204745410 >> 172.21.15.55:0/4204745410 conn(0x7f05c809bae0 msgr2=0x7f05c80d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:33.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05ce996640 1 -- 172.21.15.55:0/4204745410 shutdown_connections 2023-08-25T05:18:33.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05ce996640 1 -- 172.21.15.55:0/4204745410 wait complete. 2023-08-25T05:18:33.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05ce996640 1 Processor -- start 2023-08-25T05:18:33.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05ce996640 1 -- start start 2023-08-25T05:18:33.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05ce996640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c80b3e50 0x7f05c80b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:33.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05ce996640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c80cdde0 0x7f05c80b6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:33.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05ce996640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c80d0da0 0x7f05c8151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:33.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05ce996640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c80b77e0 con 0x7f05c80d0da0 2023-08-25T05:18:33.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05ce996640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c80b6970 con 0x7f05c80b3e50 2023-08-25T05:18:33.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05ce996640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c80b6bd0 con 0x7f05c80cdde0 2023-08-25T05:18:33.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05ccf33640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c80d0da0 0x7f05c8151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:33.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05ccf33640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c80d0da0 0x7f05c8151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35976/0 (socket says 172.21.15.55:35976) 2023-08-25T05:18:33.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05ccf33640 1 -- 172.21.15.55:0/2633447417 learned_addr learned my addr 172.21.15.55:0/2633447417 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:33.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05c7fff640 1 --2- 172.21.15.55:0/2633447417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c80b3e50 0x7f05c80b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:33.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.113+0000 7f05c77fe640 1 --2- 172.21.15.55:0/2633447417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c80cdde0 0x7f05c80b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:33.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.117+0000 7f05ccf33640 1 -- 172.21.15.55:0/2633447417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c80cdde0 msgr2=0x7f05c80b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:33.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.117+0000 7f05ccf33640 1 --2- 172.21.15.55:0/2633447417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c80cdde0 0x7f05c80b6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:33.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.117+0000 7f05ccf33640 1 -- 172.21.15.55:0/2633447417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c80b3e50 msgr2=0x7f05c80b7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:33.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.117+0000 7f05ccf33640 1 --2- 172.21.15.55:0/2633447417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c80b3e50 0x7f05c80b7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:33.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.117+0000 7f05ccf33640 1 -- 172.21.15.55:0/2633447417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b80093b0 con 0x7f05c80d0da0 2023-08-25T05:18:33.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.117+0000 7f05c77fe640 1 --2- 172.21.15.55:0/2633447417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c80cdde0 0x7f05c80b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:33.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.117+0000 7f05ccf33640 1 --2- 172.21.15.55:0/2633447417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c80d0da0 0x7f05c8151a90 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f05c000c730 tx=0x7f05c000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:33.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.117+0000 7f05c4ff9640 1 -- 172.21.15.55:0/2633447417 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0003b80 con 0x7f05c80d0da0 2023-08-25T05:18:33.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.117+0000 7f05c4ff9640 1 -- 172.21.15.55:0/2633447417 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c0003ce0 con 0x7f05c80d0da0 2023-08-25T05:18:33.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.117+0000 7f05c4ff9640 1 -- 172.21.15.55:0/2633447417 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0005310 con 0x7f05c80d0da0 2023-08-25T05:18:33.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.117+0000 7f05ce996640 1 -- 172.21.15.55:0/2633447417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c80b6eb0 con 0x7f05c80d0da0 2023-08-25T05:18:33.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.117+0000 7f05ce996640 1 -- 172.21.15.55:0/2633447417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c80b7470 con 0x7f05c80d0da0 2023-08-25T05:18:33.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.117+0000 7f05ce996640 1 -- 172.21.15.55:0/2633447417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c80b7950 con 0x7f05c80d0da0 2023-08-25T05:18:33.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.117+0000 7f05c4ff9640 1 -- 172.21.15.55:0/2633447417 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f05c0005680 con 0x7f05c80d0da0 2023-08-25T05:18:33.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.117+0000 7f05c4ff9640 1 --2- 172.21.15.55:0/2633447417 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f05b40657a0 0x7f05b4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:33.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.117+0000 7f05c4ff9640 1 -- 172.21.15.55:0/2633447417 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f05c0082f10 con 0x7f05c80d0da0 2023-08-25T05:18:33.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.121+0000 7f05c7fff640 1 --2- 172.21.15.55:0/2633447417 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f05b40657a0 0x7f05b4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:33.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.121+0000 7f05c7fff640 1 --2- 172.21.15.55:0/2633447417 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f05b40657a0 0x7f05b4067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f05b80b2000 tx=0x7f05b80aa070 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:33.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.125+0000 7f05c4ff9640 1 -- 172.21.15.55:0/2633447417 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f05c0050800 con 0x7f05c80d0da0 2023-08-25T05:18:33.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.333+0000 7f05ce996640 1 -- 172.21.15.55:0/2633447417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f05c804dbe0 con 0x7f05c80d0da0 2023-08-25T05:18:33.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.937+0000 7f05c4ff9640 1 -- 172.21.15.55:0/2633447417 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2452) v1 ==== 177+0+0 (secure 0 0 0) 0x7f05c0053e20 con 0x7f05c80d0da0 2023-08-25T05:18:33.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.937+0000 7f05ce996640 1 -- 172.21.15.55:0/2633447417 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f05b40657a0 msgr2=0x7f05b4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:33.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.937+0000 7f05ce996640 1 --2- 172.21.15.55:0/2633447417 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f05b40657a0 0x7f05b4067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f05b80b2000 tx=0x7f05b80aa070 comp rx=0 tx=0).stop 2023-08-25T05:18:33.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.937+0000 7f05ce996640 1 -- 172.21.15.55:0/2633447417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c80d0da0 msgr2=0x7f05c8151a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:33.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.937+0000 7f05ce996640 1 --2- 172.21.15.55:0/2633447417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c80d0da0 0x7f05c8151a90 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f05c000c730 tx=0x7f05c000cbf0 comp rx=0 tx=0).stop 2023-08-25T05:18:33.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.937+0000 7f05ce996640 1 -- 172.21.15.55:0/2633447417 shutdown_connections 2023-08-25T05:18:33.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.937+0000 7f05ce996640 1 --2- 172.21.15.55:0/2633447417 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f05b40657a0 0x7f05b4067c60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:33.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.937+0000 7f05ce996640 1 --2- 172.21.15.55:0/2633447417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c80d0da0 0x7f05c8151a90 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:33.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.937+0000 7f05ce996640 1 --2- 172.21.15.55:0/2633447417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c80cdde0 0x7f05c80b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:33.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.937+0000 7f05ce996640 1 --2- 172.21.15.55:0/2633447417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c80b3e50 0x7f05c80b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:33.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.937+0000 7f05ce996640 1 -- 172.21.15.55:0/2633447417 >> 172.21.15.55:0/2633447417 conn(0x7f05c809bae0 msgr2=0x7f05c80cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:33.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.941+0000 7f05ce996640 1 -- 172.21.15.55:0/2633447417 shutdown_connections 2023-08-25T05:18:33.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:33.941+0000 7f05ce996640 1 -- 172.21.15.55:0/2633447417 wait complete. 2023-08-25T05:18:33.965 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:18:34.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.109+0000 7f1c23819640 1 Processor -- start 2023-08-25T05:18:34.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.109+0000 7f1c23819640 1 -- start start 2023-08-25T05:18:34.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.109+0000 7f1c23819640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1c1c164410 0x7f1c1c0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.109+0000 7f1c23819640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1c1c0cddf0 0x7f1c1c0c1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.109+0000 7f1c23819640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c1c0c18b0 0x7f1c1c0cac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.109+0000 7f1c23819640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c0c1d60 con 0x7f1c1c0cddf0 2023-08-25T05:18:34.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.109+0000 7f1c23819640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c0cc510 con 0x7f1c1c164410 2023-08-25T05:18:34.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.109+0000 7f1c23819640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c1647f0 con 0x7f1c1c0c18b0 2023-08-25T05:18:34.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.109+0000 7f1c20db4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1c1c0cddf0 0x7f1c1c0c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:34.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.109+0000 7f1c20db4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1c1c0cddf0 0x7f1c1c0c1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35988/0 (socket says 172.21.15.55:35988) 2023-08-25T05:18:34.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.109+0000 7f1c20db4640 1 -- 172.21.15.55:0/3229751021 learned_addr learned my addr 172.21.15.55:0/3229751021 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:34.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.109+0000 7f1c21db6640 1 --2- 172.21.15.55:0/3229751021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c1c0c18b0 0x7f1c1c0cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:34.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.109+0000 7f1c215b5640 1 --2- 172.21.15.55:0/3229751021 >> v2:172.21.15.110:3300/0 conn(0x7f1c1c164410 0x7f1c1c0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:34.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.113+0000 7f1c20db4640 1 -- 172.21.15.55:0/3229751021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c1c0c18b0 msgr2=0x7f1c1c0cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:34.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.113+0000 7f1c20db4640 1 --2- 172.21.15.55:0/3229751021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c1c0c18b0 0x7f1c1c0cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.113+0000 7f1c20db4640 1 -- 172.21.15.55:0/3229751021 >> v2:172.21.15.110:3300/0 conn(0x7f1c1c164410 msgr2=0x7f1c1c0b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:34.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.113+0000 7f1c20db4640 1 --2- 172.21.15.55:0/3229751021 >> v2:172.21.15.110:3300/0 conn(0x7f1c1c164410 0x7f1c1c0b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.113+0000 7f1c20db4640 1 -- 172.21.15.55:0/3229751021 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c0cc9b0 con 0x7f1c1c0cddf0 2023-08-25T05:18:34.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.113+0000 7f1c215b5640 1 --2- 172.21.15.55:0/3229751021 >> v2:172.21.15.110:3300/0 conn(0x7f1c1c164410 0x7f1c1c0b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:34.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.113+0000 7f1c21db6640 1 --2- 172.21.15.55:0/3229751021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c1c0c18b0 0x7f1c1c0cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:34.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.113+0000 7f1c20db4640 1 --2- 172.21.15.55:0/3229751021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c1c0cddf0 0x7f1c1c0c1370 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0cec10 tx=0x7f1c0c01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4564fc1b3c33fe95 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:34.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.113+0000 7f1c13fff640 1 -- 172.21.15.55:0/3229751021 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c0ab600 con 0x7f1c1c0cddf0 2023-08-25T05:18:34.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.113+0000 7f1c13fff640 1 -- 172.21.15.55:0/3229751021 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0c0a7050 con 0x7f1c1c0cddf0 2023-08-25T05:18:34.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.113+0000 7f1c13fff640 1 -- 172.21.15.55:0/3229751021 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c0ab980 con 0x7f1c1c0cddf0 2023-08-25T05:18:34.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.113+0000 7f1c23819640 1 -- 172.21.15.55:0/3229751021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c1c0cddf0 msgr2=0x7f1c1c0c1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:34.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.113+0000 7f1c23819640 1 --2- 172.21.15.55:0/3229751021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c1c0cddf0 0x7f1c1c0c1370 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0cec10 tx=0x7f1c0c01c240 comp rx=0 tx=0).stop 2023-08-25T05:18:34.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c23819640 1 -- 172.21.15.55:0/3229751021 shutdown_connections 2023-08-25T05:18:34.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c23819640 1 --2- 172.21.15.55:0/3229751021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c1c0c18b0 0x7f1c1c0cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c23819640 1 --2- 172.21.15.55:0/3229751021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c1c0cddf0 0x7f1c1c0c1370 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c23819640 1 --2- 172.21.15.55:0/3229751021 >> v2:172.21.15.110:3300/0 conn(0x7f1c1c164410 0x7f1c1c0b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c23819640 1 -- 172.21.15.55:0/3229751021 >> 172.21.15.55:0/3229751021 conn(0x7f1c1c069d00 msgr2=0x7f1c1c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:34.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c23819640 1 -- 172.21.15.55:0/3229751021 shutdown_connections 2023-08-25T05:18:34.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c23819640 1 -- 172.21.15.55:0/3229751021 wait complete. 2023-08-25T05:18:34.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c23819640 1 Processor -- start 2023-08-25T05:18:34.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c23819640 1 -- start start 2023-08-25T05:18:34.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c23819640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c1c0c18b0 0x7f1c1c15b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c23819640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c1c0cddf0 0x7f1c1c0c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c23819640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c1c164410 0x7f1c1c162520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c23819640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0c7600 con 0x7f1c1c164410 2023-08-25T05:18:34.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c23819640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c15b8c0 con 0x7f1c1c0cddf0 2023-08-25T05:18:34.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c23819640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0c7850 con 0x7f1c1c0c18b0 2023-08-25T05:18:34.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c21db6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c1c164410 0x7f1c1c162520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:34.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c21db6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c1c164410 0x7f1c1c162520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35992/0 (socket says 172.21.15.55:35992) 2023-08-25T05:18:34.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c21db6640 1 -- 172.21.15.55:0/3141826864 learned_addr learned my addr 172.21.15.55:0/3141826864 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:34.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c21db6640 1 -- 172.21.15.55:0/3141826864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c1c0c18b0 msgr2=0x7f1c1c15b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:34.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c21db6640 1 --2- 172.21.15.55:0/3141826864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c1c0c18b0 0x7f1c1c15b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c21db6640 1 -- 172.21.15.55:0/3141826864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c1c0cddf0 msgr2=0x7f1c1c0c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:34.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c20db4640 1 --2- 172.21.15.55:0/3141826864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c1c0cddf0 0x7f1c1c0c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:34.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c21db6640 1 --2- 172.21.15.55:0/3141826864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c1c0cddf0 0x7f1c1c0c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c21db6640 1 -- 172.21.15.55:0/3141826864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c0094d0 con 0x7f1c1c164410 2023-08-25T05:18:34.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c20db4640 1 --2- 172.21.15.55:0/3141826864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c1c0cddf0 0x7f1c1c0c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:18:34.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c21db6640 1 --2- 172.21.15.55:0/3141826864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c1c164410 0x7f1c1c162520 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f1c14007e10 tx=0x7f1c1400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:34.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.117+0000 7f1c11ffb640 1 -- 172.21.15.55:0/3141826864 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14003ba0 con 0x7f1c1c164410 2023-08-25T05:18:34.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.121+0000 7f1c11ffb640 1 -- 172.21.15.55:0/3141826864 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1400f040 con 0x7f1c1c164410 2023-08-25T05:18:34.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.121+0000 7f1c11ffb640 1 -- 172.21.15.55:0/3141826864 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1400de80 con 0x7f1c1c164410 2023-08-25T05:18:34.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.121+0000 7f1c23819640 1 -- 172.21.15.55:0/3141826864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1c0c7b30 con 0x7f1c1c164410 2023-08-25T05:18:34.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.121+0000 7f1c23819640 1 -- 172.21.15.55:0/3141826864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c0c80f0 con 0x7f1c1c164410 2023-08-25T05:18:34.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.121+0000 7f1c23819640 1 -- 172.21.15.55:0/3141826864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1c0c82e0 con 0x7f1c1c164410 2023-08-25T05:18:34.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.121+0000 7f1c11ffb640 1 -- 172.21.15.55:0/3141826864 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f1c14004030 con 0x7f1c1c164410 2023-08-25T05:18:34.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.121+0000 7f1c11ffb640 1 --2- 172.21.15.55:0/3141826864 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f1c000657a0 0x7f1c00067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.121+0000 7f1c11ffb640 1 -- 172.21.15.55:0/3141826864 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f1c140833c0 con 0x7f1c1c164410 2023-08-25T05:18:34.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.121+0000 7f1c215b5640 1 --2- 172.21.15.55:0/3141826864 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f1c000657a0 0x7f1c00067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:34.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.125+0000 7f1c215b5640 1 --2- 172.21.15.55:0/3141826864 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f1c000657a0 0x7f1c00067c60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1c18006f10 tx=0x7f1c18008040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:34.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.125+0000 7f1c11ffb640 1 -- 172.21.15.55:0/3141826864 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1c14050cc0 con 0x7f1c1c164410 2023-08-25T05:18:34.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.285+0000 7f1c23819640 1 -- 172.21.15.55:0/3141826864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c1c0cd500 con 0x7f1c1c164410 2023-08-25T05:18:34.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.285+0000 7f1c11ffb640 1 -- 172.21.15.55:0/3141826864 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+15806 (secure 0 0 0) 0x7f1c140542e0 con 0x7f1c1c164410 2023-08-25T05:18:34.289 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:34.290 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":148,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:18:30.919298+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6835/2424299953":"2023-08-26T05:18:27.888828+0000","172.21.15.110:0/3450681761":"2023-08-26T05:18:24.719592+0000","172.21.15.110:0/3855906458":"2023-08-26T05:18:24.719592+0000","172.21.15.110:0/1252829579":"2023-08-26T05:18:24.719592+0000","172.21.15.110:0/2636731011":"2023-08-26T05:18:24.719592+0000","172.21.15.110:6833/3538591338":"2023-08-26T05:18:24.719592+0000","172.21.15.55:6833/2424299953":"2023-08-26T05:18:27.888828+0000","172.21.15.110:6833/3700713436":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/359151790":"2023-08-26T05:18:24.719592+0000","172.21.15.110:6832/3700713436":"2023-08-26T04:22:41.515664+0000","172.21.15.110:6832/3538591338":"2023-08-26T05:18:24.719592+0000","172.21.15.110:0/789108415":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/3818846433":"2023-08-26T05:18:24.719592+0000","172.21.15.110:0/3185722269":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/452038739":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/327450935":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/3135214366":"2023-08-26T04:22:41.515664+0000","172.21.15.110:0/2514341378":"2023-08-26T04:22:41.515664+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:18:34.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.289+0000 7f1c23819640 1 -- 172.21.15.55:0/3141826864 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f1c000657a0 msgr2=0x7f1c00067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:34.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.289+0000 7f1c23819640 1 --2- 172.21.15.55:0/3141826864 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f1c000657a0 0x7f1c00067c60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1c18006f10 tx=0x7f1c18008040 comp rx=0 tx=0).stop 2023-08-25T05:18:34.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.289+0000 7f1c23819640 1 -- 172.21.15.55:0/3141826864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c1c164410 msgr2=0x7f1c1c162520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:34.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.289+0000 7f1c23819640 1 --2- 172.21.15.55:0/3141826864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c1c164410 0x7f1c1c162520 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f1c14007e10 tx=0x7f1c1400d4a0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.289+0000 7f1c23819640 1 -- 172.21.15.55:0/3141826864 shutdown_connections 2023-08-25T05:18:34.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.289+0000 7f1c23819640 1 --2- 172.21.15.55:0/3141826864 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f1c000657a0 0x7f1c00067c60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.289+0000 7f1c23819640 1 --2- 172.21.15.55:0/3141826864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c1c164410 0x7f1c1c162520 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.289+0000 7f1c23819640 1 --2- 172.21.15.55:0/3141826864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c1c0cddf0 0x7f1c1c0c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.289+0000 7f1c23819640 1 --2- 172.21.15.55:0/3141826864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c1c0c18b0 0x7f1c1c15b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.289+0000 7f1c23819640 1 -- 172.21.15.55:0/3141826864 >> 172.21.15.55:0/3141826864 conn(0x7f1c1c069d00 msgr2=0x7f1c1c160c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:34.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.289+0000 7f1c23819640 1 -- 172.21.15.55:0/3141826864 shutdown_connections 2023-08-25T05:18:34.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.289+0000 7f1c23819640 1 -- 172.21.15.55:0/3141826864 wait complete. 2023-08-25T05:18:34.311 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T05:18:34.312 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T05:18:34.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa040dac640 1 Processor -- start 2023-08-25T05:18:34.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa040dac640 1 -- start start 2023-08-25T05:18:34.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa040dac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa03c06c3b0 0x7fa03c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa040dac640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa03c06c790 0x7fa03c06de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa040dac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c0d1060 0x7fa03c06e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa040dac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03c0cab90 con 0x7fa03c06c3b0 2023-08-25T05:18:34.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa040dac640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03c06dbb0 con 0x7fa03c06c790 2023-08-25T05:18:34.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa040dac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0cae50 con 0x7fa03c0d1060 2023-08-25T05:18:34.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa03a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa03c06c3b0 0x7fa03c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:34.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa03a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa03c06c3b0 0x7fa03c0cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36000/0 (socket says 172.21.15.55:36000) 2023-08-25T05:18:34.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa03a59c640 1 -- 172.21.15.55:0/1289396677 learned_addr learned my addr 172.21.15.55:0/1289396677 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:34.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa03ad9d640 1 --2- 172.21.15.55:0/1289396677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c0d1060 0x7fa03c06e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:34.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa033fff640 1 --2- 172.21.15.55:0/1289396677 >> v2:172.21.15.110:3300/0 conn(0x7fa03c06c790 0x7fa03c06de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:34.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa03a59c640 1 -- 172.21.15.55:0/1289396677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c0d1060 msgr2=0x7fa03c06e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:34.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa03a59c640 1 --2- 172.21.15.55:0/1289396677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c0d1060 0x7fa03c06e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa03a59c640 1 -- 172.21.15.55:0/1289396677 >> v2:172.21.15.110:3300/0 conn(0x7fa03c06c790 msgr2=0x7fa03c06de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:34.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa03a59c640 1 --2- 172.21.15.55:0/1289396677 >> v2:172.21.15.110:3300/0 conn(0x7fa03c06c790 0x7fa03c06de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa03a59c640 1 -- 172.21.15.55:0/1289396677 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c0cb130 con 0x7fa03c06c3b0 2023-08-25T05:18:34.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa033fff640 1 --2- 172.21.15.55:0/1289396677 >> v2:172.21.15.110:3300/0 conn(0x7fa03c06c790 0x7fa03c06de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:18:34.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.457+0000 7fa03ad9d640 1 --2- 172.21.15.55:0/1289396677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c0d1060 0x7fa03c06e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:18:34.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.461+0000 7fa03a59c640 1 --2- 172.21.15.55:0/1289396677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c06c3b0 0x7fa03c0cd7d0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fa03c071900 tx=0x7fa02c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea6670c62d89393 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:34.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.461+0000 7fa039d9b640 1 -- 172.21.15.55:0/1289396677 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c0ac640 con 0x7fa03c06c3b0 2023-08-25T05:18:34.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.461+0000 7fa039d9b640 1 -- 172.21.15.55:0/1289396677 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c0ac7a0 con 0x7fa03c06c3b0 2023-08-25T05:18:34.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.461+0000 7fa039d9b640 1 -- 172.21.15.55:0/1289396677 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c0acb30 con 0x7fa03c06c3b0 2023-08-25T05:18:34.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.461+0000 7fa040dac640 1 -- 172.21.15.55:0/1289396677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c06c3b0 msgr2=0x7fa03c0cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:34.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.461+0000 7fa040dac640 1 --2- 172.21.15.55:0/1289396677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c06c3b0 0x7fa03c0cd7d0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fa03c071900 tx=0x7fa02c01c400 comp rx=0 tx=0).stop 2023-08-25T05:18:34.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.461+0000 7fa040dac640 1 -- 172.21.15.55:0/1289396677 shutdown_connections 2023-08-25T05:18:34.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.461+0000 7fa040dac640 1 --2- 172.21.15.55:0/1289396677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c0d1060 0x7fa03c06e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.461+0000 7fa040dac640 1 --2- 172.21.15.55:0/1289396677 >> v2:172.21.15.110:3300/0 conn(0x7fa03c06c790 0x7fa03c06de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.461+0000 7fa040dac640 1 --2- 172.21.15.55:0/1289396677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c06c3b0 0x7fa03c0cd7d0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.461+0000 7fa040dac640 1 -- 172.21.15.55:0/1289396677 >> 172.21.15.55:0/1289396677 conn(0x7fa03c0d0540 msgr2=0x7fa03c0d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:34.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.461+0000 7fa040dac640 1 -- 172.21.15.55:0/1289396677 shutdown_connections 2023-08-25T05:18:34.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.461+0000 7fa040dac640 1 -- 172.21.15.55:0/1289396677 wait complete. 2023-08-25T05:18:34.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa040dac640 1 Processor -- start 2023-08-25T05:18:34.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa040dac640 1 -- start start 2023-08-25T05:18:34.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa040dac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa03c06c3b0 0x7fa03c151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa040dac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c06c790 0x7fa03c0aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa040dac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c0d1060 0x7fa03c1527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa040dac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0af050 con 0x7fa03c0d1060 2023-08-25T05:18:34.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa040dac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0ad110 con 0x7fa03c06c3b0 2023-08-25T05:18:34.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa040dac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c14ac60 con 0x7fa03c06c790 2023-08-25T05:18:34.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa03ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c0d1060 0x7fa03c1527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:34.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa03ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c0d1060 0x7fa03c1527b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36002/0 (socket says 172.21.15.55:36002) 2023-08-25T05:18:34.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa03ad9d640 1 -- 172.21.15.55:0/2871438286 learned_addr learned my addr 172.21.15.55:0/2871438286 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:34.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa03a59c640 1 --2- 172.21.15.55:0/2871438286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa03c06c3b0 0x7fa03c151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:34.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa033fff640 1 --2- 172.21.15.55:0/2871438286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c06c790 0x7fa03c0aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:34.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa03ad9d640 1 -- 172.21.15.55:0/2871438286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c06c790 msgr2=0x7fa03c0aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:34.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa03ad9d640 1 --2- 172.21.15.55:0/2871438286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c06c790 0x7fa03c0aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa03ad9d640 1 -- 172.21.15.55:0/2871438286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa03c06c3b0 msgr2=0x7fa03c151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:34.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa03ad9d640 1 --2- 172.21.15.55:0/2871438286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa03c06c3b0 0x7fa03c151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa03ad9d640 1 -- 172.21.15.55:0/2871438286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c009480 con 0x7fa03c0d1060 2023-08-25T05:18:34.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa033fff640 1 --2- 172.21.15.55:0/2871438286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c06c790 0x7fa03c0aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:34.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa03ad9d640 1 --2- 172.21.15.55:0/2871438286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c0d1060 0x7fa03c1527b0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fa03400cd50 tx=0x7fa03400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:34.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa032ffd640 1 -- 172.21.15.55:0/2871438286 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03400f680 con 0x7fa03c0d1060 2023-08-25T05:18:34.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa032ffd640 1 -- 172.21.15.55:0/2871438286 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03400f800 con 0x7fa03c0d1060 2023-08-25T05:18:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa040dac640 1 -- 172.21.15.55:0/2871438286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03c14af00 con 0x7fa03c0d1060 2023-08-25T05:18:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa032ffd640 1 -- 172.21.15.55:0/2871438286 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03400fbb0 con 0x7fa03c0d1060 2023-08-25T05:18:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.465+0000 7fa040dac640 1 -- 172.21.15.55:0/2871438286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03c0cf720 con 0x7fa03c0d1060 2023-08-25T05:18:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.469+0000 7fa040dac640 1 -- 172.21.15.55:0/2871438286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03c0ad5a0 con 0x7fa03c0d1060 2023-08-25T05:18:34.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.469+0000 7fa032ffd640 1 -- 172.21.15.55:0/2871438286 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fa03400b040 con 0x7fa03c0d1060 2023-08-25T05:18:34.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.469+0000 7fa032ffd640 1 --2- 172.21.15.55:0/2871438286 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fa01c0657a0 0x7fa01c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.469+0000 7fa032ffd640 1 -- 172.21.15.55:0/2871438286 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fa034083930 con 0x7fa03c0d1060 2023-08-25T05:18:34.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.469+0000 7fa03a59c640 1 --2- 172.21.15.55:0/2871438286 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fa01c0657a0 0x7fa01c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:34.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.469+0000 7fa03a59c640 1 --2- 172.21.15.55:0/2871438286 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fa01c0657a0 0x7fa01c067c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0ae000 tx=0x7fa02c0a7000 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:34.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.473+0000 7fa032ffd640 1 -- 172.21.15.55:0/2871438286 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa03c0ad5a0 con 0x7fa03c0d1060 2023-08-25T05:18:34.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.633+0000 7fa040dac640 1 -- 172.21.15.55:0/2871438286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa03c0ad5a0 con 0x7fa03c0d1060 2023-08-25T05:18:34.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.633+0000 7fa032ffd640 1 -- 172.21.15.55:0/2871438286 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v148) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa03c0ad5a0 con 0x7fa03c0d1060 2023-08-25T05:18:34.637 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T05:18:34.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.637+0000 7fa040dac640 1 -- 172.21.15.55:0/2871438286 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fa01c0657a0 msgr2=0x7fa01c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:34.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.637+0000 7fa040dac640 1 --2- 172.21.15.55:0/2871438286 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fa01c0657a0 0x7fa01c067c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0ae000 tx=0x7fa02c0a7000 comp rx=0 tx=0).stop 2023-08-25T05:18:34.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.637+0000 7fa040dac640 1 -- 172.21.15.55:0/2871438286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c0d1060 msgr2=0x7fa03c1527b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:34.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.637+0000 7fa040dac640 1 --2- 172.21.15.55:0/2871438286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c0d1060 0x7fa03c1527b0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fa03400cd50 tx=0x7fa03400a650 comp rx=0 tx=0).stop 2023-08-25T05:18:34.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.637+0000 7fa040dac640 1 -- 172.21.15.55:0/2871438286 shutdown_connections 2023-08-25T05:18:34.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.637+0000 7fa040dac640 1 --2- 172.21.15.55:0/2871438286 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fa01c0657a0 0x7fa01c067c60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.637+0000 7fa040dac640 1 --2- 172.21.15.55:0/2871438286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c0d1060 0x7fa03c1527b0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.637+0000 7fa040dac640 1 --2- 172.21.15.55:0/2871438286 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c06c790 0x7fa03c0aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.637+0000 7fa040dac640 1 --2- 172.21.15.55:0/2871438286 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa03c06c3b0 0x7fa03c151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.637+0000 7fa040dac640 1 -- 172.21.15.55:0/2871438286 >> 172.21.15.55:0/2871438286 conn(0x7fa03c0d0540 msgr2=0x7fa03c0d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:34.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.637+0000 7fa040dac640 1 -- 172.21.15.55:0/2871438286 shutdown_connections 2023-08-25T05:18:34.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.637+0000 7fa040dac640 1 -- 172.21.15.55:0/2871438286 wait complete. 2023-08-25T05:18:34.659 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T05:18:34.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.801+0000 7f51c9505640 1 Processor -- start 2023-08-25T05:18:34.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.801+0000 7f51c9505640 1 -- start start 2023-08-25T05:18:34.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.805+0000 7f51c9505640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f51c415fca0 0x7f51c40cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.805+0000 7f51c9505640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c40cfee0 con 0x7f51c40cfac0 2023-08-25T05:18:34.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.805+0000 7f51c9505640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c40b70c0 con 0x7f51c40b8330 2023-08-25T05:18:34.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.805+0000 7f51c9505640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c4160080 con 0x7f51c415fca0 2023-08-25T05:18:34.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.805+0000 7f51c8d04640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f51c40cfac0 0x7f51c40b65e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55554/0 (socket says 172.21.15.55:55554) 2023-08-25T05:18:34.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.805+0000 7f51c8d04640 1 -- 172.21.15.55:0/1970709607 learned_addr learned my addr 172.21.15.55:0/1970709607 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:34.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.805+0000 7f51c3fff640 1 --2- 172.21.15.55:0/1970709607 >> v2:172.21.15.110:3300/0 conn(0x7f51c415fca0 0x7f51c40cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:34.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.805+0000 7f51c2ffd640 1 -- 172.21.15.55:0/1970709607 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632051150 0 0) 0x7f51c40cfee0 con 0x7f51c40cfac0 2023-08-25T05:18:34.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.805+0000 7f51c2ffd640 1 -- 172.21.15.55:0/1970709607 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51ac003530 con 0x7f51c40cfac0 2023-08-25T05:18:34.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.805+0000 7f51c2ffd640 1 -- 172.21.15.55:0/1970709607 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910229228 0 0) 0x7f51c40b70c0 con 0x7f51c40b8330 2023-08-25T05:18:34.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.805+0000 7f51c2ffd640 1 -- 172.21.15.55:0/1970709607 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51c40cfee0 con 0x7f51c40b8330 2023-08-25T05:18:34.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.805+0000 7f51c3fff640 1 -- 172.21.15.55:0/1970709607 >> v1:172.21.15.110:6789/0 conn(0x7f51c40b8330 legacy=0x7f51c40d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:34.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.805+0000 7f51c3fff640 1 -- 172.21.15.55:0/1970709607 >> v1:172.21.15.55:6789/0 conn(0x7f51c40cfac0 legacy=0x7f51c40b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:34.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.805+0000 7f51c3fff640 1 -- 172.21.15.55:0/1970709607 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c40b73a0 con 0x7f51c415fca0 2023-08-25T05:18:34.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.809+0000 7f51c3fff640 1 --2- 172.21.15.55:0/1970709607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51c415fca0 0x7f51c40cf580 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f51b40097c0 tx=0x7f51b401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddfba3f5efa7bb4c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:34.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.809+0000 7f51c2ffd640 1 -- 172.21.15.55:0/1970709607 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b40a8970 con 0x7f51c415fca0 2023-08-25T05:18:34.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.809+0000 7f51c2ffd640 1 -- 172.21.15.55:0/1970709607 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b40a8ad0 con 0x7f51c415fca0 2023-08-25T05:18:34.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.809+0000 7f51c2ffd640 1 -- 172.21.15.55:0/1970709607 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b40a8e60 con 0x7f51c415fca0 2023-08-25T05:18:34.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.809+0000 7f51c9505640 1 -- 172.21.15.55:0/1970709607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51c415fca0 msgr2=0x7f51c40cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:34.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.809+0000 7f51c9505640 1 --2- 172.21.15.55:0/1970709607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51c415fca0 0x7f51c40cf580 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f51b40097c0 tx=0x7f51b401ec70 comp rx=0 tx=0).stop 2023-08-25T05:18:34.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.809+0000 7f51c9505640 1 -- 172.21.15.55:0/1970709607 shutdown_connections 2023-08-25T05:18:34.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.809+0000 7f51c9505640 1 --2- 172.21.15.55:0/1970709607 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51c415fca0 0x7f51c40cf580 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.809+0000 7f51c9505640 1 -- 172.21.15.55:0/1970709607 >> 172.21.15.55:0/1970709607 conn(0x7f51c40658c0 msgr2=0x7f51c4065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:34.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.809+0000 7f51c9505640 1 -- 172.21.15.55:0/1970709607 shutdown_connections 2023-08-25T05:18:34.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.809+0000 7f51c9505640 1 -- 172.21.15.55:0/1970709607 wait complete. 2023-08-25T05:18:34.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.809+0000 7f51c9505640 1 Processor -- start 2023-08-25T05:18:34.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.809+0000 7f51c9505640 1 -- start start 2023-08-25T05:18:34.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c9505640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51c40b8330 0x7f51c414ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c9505640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51c40cfac0 0x7f51c4151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c9505640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51c415fca0 0x7f51c40c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c9505640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c414e350 con 0x7f51c40cfac0 2023-08-25T05:18:34.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c9505640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c414d1f0 con 0x7f51c415fca0 2023-08-25T05:18:34.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c9505640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c4151de0 con 0x7f51c40b8330 2023-08-25T05:18:34.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51c40cfac0 0x7f51c4151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:34.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c3fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51c40b8330 0x7f51c414ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:34.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51c40cfac0 0x7f51c4151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36016/0 (socket says 172.21.15.55:36016) 2023-08-25T05:18:34.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c37fe640 1 -- 172.21.15.55:0/608309839 learned_addr learned my addr 172.21.15.55:0/608309839 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:34.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c8d04640 1 --2- 172.21.15.55:0/608309839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51c415fca0 0x7f51c40c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:34.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c37fe640 1 -- 172.21.15.55:0/608309839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51c40b8330 msgr2=0x7f51c414ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:34.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c37fe640 1 --2- 172.21.15.55:0/608309839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51c40b8330 0x7f51c414ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c37fe640 1 -- 172.21.15.55:0/608309839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51c415fca0 msgr2=0x7f51c40c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:34.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c37fe640 1 --2- 172.21.15.55:0/608309839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51c415fca0 0x7f51c40c7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c37fe640 1 -- 172.21.15.55:0/608309839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b4009420 con 0x7f51c40cfac0 2023-08-25T05:18:34.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c37fe640 1 --2- 172.21.15.55:0/608309839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51c40cfac0 0x7f51c4151190 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f51b800c500 tx=0x7f51b800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:34.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c0ff9640 1 -- 172.21.15.55:0/608309839 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b80052d0 con 0x7f51c40cfac0 2023-08-25T05:18:34.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c0ff9640 1 -- 172.21.15.55:0/608309839 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b8005430 con 0x7f51c40cfac0 2023-08-25T05:18:34.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c9505640 1 -- 172.21.15.55:0/608309839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c4151b00 con 0x7f51c40cfac0 2023-08-25T05:18:34.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c0ff9640 1 -- 172.21.15.55:0/608309839 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8012870 con 0x7f51c40cfac0 2023-08-25T05:18:34.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c9505640 1 -- 172.21.15.55:0/608309839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c414df70 con 0x7f51c40cfac0 2023-08-25T05:18:34.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.813+0000 7f51c9505640 1 -- 172.21.15.55:0/608309839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c414daf0 con 0x7f51c40cfac0 2023-08-25T05:18:34.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.817+0000 7f51c0ff9640 1 -- 172.21.15.55:0/608309839 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f51b80129d0 con 0x7f51c40cfac0 2023-08-25T05:18:34.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.817+0000 7f51c0ff9640 1 --2- 172.21.15.55:0/608309839 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f51b00657a0 0x7f51b0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:34.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.817+0000 7f51c0ff9640 1 -- 172.21.15.55:0/608309839 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f51b80829e0 con 0x7f51c40cfac0 2023-08-25T05:18:34.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.817+0000 7f51c3fff640 1 --2- 172.21.15.55:0/608309839 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f51b00657a0 0x7f51b0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:34.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.817+0000 7f51c3fff640 1 --2- 172.21.15.55:0/608309839 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f51b00657a0 0x7f51b0067c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f51b40b2000 tx=0x7f51b4008040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:34.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.821+0000 7f51c0ff9640 1 -- 172.21.15.55:0/608309839 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f51c414daf0 con 0x7f51c40cfac0 2023-08-25T05:18:34.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.977+0000 7f51c9505640 1 -- 172.21.15.55:0/608309839 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f51c414daf0 con 0x7f51c40cfac0 2023-08-25T05:18:34.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.977+0000 7f51c0ff9640 1 -- 172.21.15.55:0/608309839 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v148) v1 ==== 92+0+10 (secure 0 0 0) 0x7f51c414daf0 con 0x7f51c40cfac0 2023-08-25T05:18:34.982 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T05:18:34.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.981+0000 7f51c9505640 1 -- 172.21.15.55:0/608309839 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f51b00657a0 msgr2=0x7f51b0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:34.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.981+0000 7f51c9505640 1 --2- 172.21.15.55:0/608309839 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f51b00657a0 0x7f51b0067c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f51b40b2000 tx=0x7f51b4008040 comp rx=0 tx=0).stop 2023-08-25T05:18:34.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.981+0000 7f51c9505640 1 -- 172.21.15.55:0/608309839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51c40cfac0 msgr2=0x7f51c4151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:34.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.981+0000 7f51c9505640 1 --2- 172.21.15.55:0/608309839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51c40cfac0 0x7f51c4151190 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f51b800c500 tx=0x7f51b800c9c0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.981+0000 7f51c9505640 1 -- 172.21.15.55:0/608309839 shutdown_connections 2023-08-25T05:18:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.981+0000 7f51c9505640 1 --2- 172.21.15.55:0/608309839 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f51b00657a0 0x7f51b0067c60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.981+0000 7f51c9505640 1 --2- 172.21.15.55:0/608309839 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51c415fca0 0x7f51c40c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.981+0000 7f51c9505640 1 --2- 172.21.15.55:0/608309839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51c40cfac0 0x7f51c4151190 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.981+0000 7f51c9505640 1 --2- 172.21.15.55:0/608309839 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51c40b8330 0x7f51c414ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:34.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.981+0000 7f51c9505640 1 -- 172.21.15.55:0/608309839 >> 172.21.15.55:0/608309839 conn(0x7f51c40658c0 msgr2=0x7f51c40b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:34.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.981+0000 7f51c9505640 1 -- 172.21.15.55:0/608309839 shutdown_connections 2023-08-25T05:18:34.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:34.981+0000 7f51c9505640 1 -- 172.21.15.55:0/608309839 wait complete. 2023-08-25T05:18:35.004 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-25T05:18:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.145+0000 7fe15d140640 1 Processor -- start 2023-08-25T05:18:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.149+0000 7fe15d140640 1 -- start start 2023-08-25T05:18:35.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.149+0000 7fe15d140640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe15806c3b0 0x7fe1580cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.149+0000 7fe15d140640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe15806c790 0x7fe15806de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.149+0000 7fe15d140640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe1580d1060 0x7fe15806e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.149+0000 7fe15d140640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1580cab90 con 0x7fe1580d1060 2023-08-25T05:18:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.149+0000 7fe15d140640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15806dbb0 con 0x7fe15806c790 2023-08-25T05:18:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.149+0000 7fe15d140640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580cae50 con 0x7fe15806c3b0 2023-08-25T05:18:35.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.149+0000 7fe15759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe1580d1060 0x7fe15806e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:35.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.149+0000 7fe15759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe1580d1060 0x7fe15806e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36022/0 (socket says 172.21.15.55:36022) 2023-08-25T05:18:35.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.149+0000 7fe15759e640 1 -- 172.21.15.55:0/171780531 learned_addr learned my addr 172.21.15.55:0/171780531 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:35.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.149+0000 7fe14e59c640 1 --2- 172.21.15.55:0/171780531 >> v2:172.21.15.110:3300/0 conn(0x7fe15806c790 0x7fe15806de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:35.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.149+0000 7fe156d9d640 1 --2- 172.21.15.55:0/171780531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe15806c3b0 0x7fe1580cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.149+0000 7fe15759e640 1 -- 172.21.15.55:0/171780531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe15806c3b0 msgr2=0x7fe1580cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.149+0000 7fe15759e640 1 --2- 172.21.15.55:0/171780531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe15806c3b0 0x7fe1580cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.149+0000 7fe15759e640 1 -- 172.21.15.55:0/171780531 >> v2:172.21.15.110:3300/0 conn(0x7fe15806c790 msgr2=0x7fe15806de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.149+0000 7fe15759e640 1 --2- 172.21.15.55:0/171780531 >> v2:172.21.15.110:3300/0 conn(0x7fe15806c790 0x7fe15806de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.149+0000 7fe15759e640 1 -- 172.21.15.55:0/171780531 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1580cb130 con 0x7fe1580d1060 2023-08-25T05:18:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.149+0000 7fe156d9d640 1 --2- 172.21.15.55:0/171780531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe15806c3b0 0x7fe1580cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.153+0000 7fe15759e640 1 --2- 172.21.15.55:0/171780531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1580d1060 0x7fe15806e3d0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fe1580714d0 tx=0x7fe15001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eda2936ee296cf9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.153+0000 7fe15659c640 1 -- 172.21.15.55:0/171780531 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1500a5800 con 0x7fe1580d1060 2023-08-25T05:18:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.153+0000 7fe15659c640 1 -- 172.21.15.55:0/171780531 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1500a5960 con 0x7fe1580d1060 2023-08-25T05:18:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.153+0000 7fe15659c640 1 -- 172.21.15.55:0/171780531 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1500a5cf0 con 0x7fe1580d1060 2023-08-25T05:18:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.153+0000 7fe15d140640 1 -- 172.21.15.55:0/171780531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1580d1060 msgr2=0x7fe15806e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.153+0000 7fe15d140640 1 --2- 172.21.15.55:0/171780531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1580d1060 0x7fe15806e3d0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fe1580714d0 tx=0x7fe15001c960 comp rx=0 tx=0).stop 2023-08-25T05:18:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.153+0000 7fe15d140640 1 -- 172.21.15.55:0/171780531 shutdown_connections 2023-08-25T05:18:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.153+0000 7fe15d140640 1 --2- 172.21.15.55:0/171780531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1580d1060 0x7fe15806e3d0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.153+0000 7fe15d140640 1 --2- 172.21.15.55:0/171780531 >> v2:172.21.15.110:3300/0 conn(0x7fe15806c790 0x7fe15806de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.153+0000 7fe15d140640 1 --2- 172.21.15.55:0/171780531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe15806c3b0 0x7fe1580cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.153+0000 7fe15d140640 1 -- 172.21.15.55:0/171780531 >> 172.21.15.55:0/171780531 conn(0x7fe1580d0540 msgr2=0x7fe1580d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.153+0000 7fe15d140640 1 -- 172.21.15.55:0/171780531 shutdown_connections 2023-08-25T05:18:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.153+0000 7fe15d140640 1 -- 172.21.15.55:0/171780531 wait complete. 2023-08-25T05:18:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.153+0000 7fe15d140640 1 Processor -- start 2023-08-25T05:18:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.153+0000 7fe15d140640 1 -- start start 2023-08-25T05:18:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe15d140640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe15806c3b0 0x7fe158155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe15d140640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe15806c790 0x7fe158155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe15d140640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1580d1060 0x7fe1580c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe15d140640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580b31c0 con 0x7fe15806c3b0 2023-08-25T05:18:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe15d140640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1581561a0 con 0x7fe1580d1060 2023-08-25T05:18:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe15d140640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe158156430 con 0x7fe15806c790 2023-08-25T05:18:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe156d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe15806c3b0 0x7fe158155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe156d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe15806c3b0 0x7fe158155720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36032/0 (socket says 172.21.15.55:36032) 2023-08-25T05:18:35.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe156d9d640 1 -- 172.21.15.55:0/1540784250 learned_addr learned my addr 172.21.15.55:0/1540784250 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:35.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe15759e640 1 --2- 172.21.15.55:0/1540784250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1580d1060 0x7fe1580c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:35.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe14e59c640 1 --2- 172.21.15.55:0/1540784250 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe15806c790 0x7fe158155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:35.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe156d9d640 1 -- 172.21.15.55:0/1540784250 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe15806c790 msgr2=0x7fe158155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:35.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe156d9d640 1 --2- 172.21.15.55:0/1540784250 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe15806c790 0x7fe158155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe156d9d640 1 -- 172.21.15.55:0/1540784250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1580d1060 msgr2=0x7fe1580c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:35.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe156d9d640 1 --2- 172.21.15.55:0/1540784250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1580d1060 0x7fe1580c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe156d9d640 1 -- 172.21.15.55:0/1540784250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe150009b30 con 0x7fe15806c3b0 2023-08-25T05:18:35.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe156d9d640 1 --2- 172.21.15.55:0/1540784250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe15806c3b0 0x7fe158155720 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fe14800e7e0 tx=0x7fe14800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe14ffff640 1 -- 172.21.15.55:0/1540784250 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1480059a0 con 0x7fe15806c3b0 2023-08-25T05:18:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe14ffff640 1 -- 172.21.15.55:0/1540784250 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe148005b00 con 0x7fe15806c3b0 2023-08-25T05:18:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe14ffff640 1 -- 172.21.15.55:0/1540784250 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148005e90 con 0x7fe15806c3b0 2023-08-25T05:18:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe15d140640 1 -- 172.21.15.55:0/1540784250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe158156710 con 0x7fe15806c3b0 2023-08-25T05:18:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe15d140640 1 -- 172.21.15.55:0/1540784250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe158156cd0 con 0x7fe15806c3b0 2023-08-25T05:18:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.157+0000 7fe15d140640 1 -- 172.21.15.55:0/1540784250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe158073ec0 con 0x7fe15806c3b0 2023-08-25T05:18:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.161+0000 7fe14ffff640 1 -- 172.21.15.55:0/1540784250 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fe148004030 con 0x7fe15806c3b0 2023-08-25T05:18:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.161+0000 7fe14ffff640 1 --2- 172.21.15.55:0/1540784250 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe1380657a0 0x7fe138067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.161+0000 7fe14ffff640 1 -- 172.21.15.55:0/1540784250 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fe148082e60 con 0x7fe15806c3b0 2023-08-25T05:18:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.161+0000 7fe14e59c640 1 --2- 172.21.15.55:0/1540784250 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe1380657a0 0x7fe138067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.161+0000 7fe14e59c640 1 --2- 172.21.15.55:0/1540784250 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe1380657a0 0x7fe138067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe1580aea10 tx=0x7fe140009190 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.165+0000 7fe14ffff640 1 -- 172.21.15.55:0/1540784250 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe148054210 con 0x7fe15806c3b0 2023-08-25T05:18:35.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.321+0000 7fe15d140640 1 -- 172.21.15.55:0/1540784250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe1580cdce0 con 0x7fe15806c3b0 2023-08-25T05:18:35.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.325+0000 7fe14ffff640 1 -- 172.21.15.55:0/1540784250 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v52)=0 v52) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe148053da0 con 0x7fe15806c3b0 2023-08-25T05:18:35.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.329+0000 7fe15d140640 1 -- 172.21.15.55:0/1540784250 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe1380657a0 msgr2=0x7fe138067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:35.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.329+0000 7fe15d140640 1 --2- 172.21.15.55:0/1540784250 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe1380657a0 0x7fe138067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe1580aea10 tx=0x7fe140009190 comp rx=0 tx=0).stop 2023-08-25T05:18:35.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.329+0000 7fe15d140640 1 -- 172.21.15.55:0/1540784250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe15806c3b0 msgr2=0x7fe158155720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:35.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.329+0000 7fe15d140640 1 --2- 172.21.15.55:0/1540784250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe15806c3b0 0x7fe158155720 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fe14800e7e0 tx=0x7fe14800eca0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.329+0000 7fe15d140640 1 -- 172.21.15.55:0/1540784250 shutdown_connections 2023-08-25T05:18:35.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.329+0000 7fe15d140640 1 --2- 172.21.15.55:0/1540784250 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe1380657a0 0x7fe138067c60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.329+0000 7fe15d140640 1 --2- 172.21.15.55:0/1540784250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe1580d1060 0x7fe1580c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.329+0000 7fe15d140640 1 --2- 172.21.15.55:0/1540784250 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe15806c790 0x7fe158155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.329+0000 7fe15d140640 1 --2- 172.21.15.55:0/1540784250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe15806c3b0 0x7fe158155720 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.329+0000 7fe15d140640 1 -- 172.21.15.55:0/1540784250 >> 172.21.15.55:0/1540784250 conn(0x7fe1580d0540 msgr2=0x7fe1580cbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:35.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.329+0000 7fe15d140640 1 -- 172.21.15.55:0/1540784250 shutdown_connections 2023-08-25T05:18:35.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.329+0000 7fe15d140640 1 -- 172.21.15.55:0/1540784250 wait complete. 2023-08-25T05:18:35.351 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T05:18:35.352 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T05:18:35.402 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T05:18:35.468 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T05:18:35.469 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:18:35.469 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:18:35.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T05:18:35.479 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:18:35.479 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:18:35.488 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:18:35.489 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:18:35.489 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:18:35.534 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T05:18:35.535 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:18:35.535 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:18:35.544 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:18:35.545 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-25T05:18:35.545 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:18:35.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.717+0000 7fede825c640 1 Processor -- start 2023-08-25T05:18:35.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.717+0000 7fede825c640 1 -- start start 2023-08-25T05:18:35.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.717+0000 7fede825c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fede00cdb10 0x7fede00cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:35.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.717+0000 7fede825c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fede00ae450 0x7fede00cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:35.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.717+0000 7fede825c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fede006c7c0 con 0x7fede00ca260 2023-08-25T05:18:35.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.717+0000 7fede825c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede00ce430 con 0x7fede00ae450 2023-08-25T05:18:35.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.717+0000 7fede825c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fede00ae9a0 con 0x7fede00cdb10 2023-08-25T05:18:35.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.717+0000 7fede57f7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fede00ae450 0x7fede00cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:35.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.717+0000 7fede57f7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fede00ae450 0x7fede00cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36034/0 (socket says 172.21.15.55:36034) 2023-08-25T05:18:35.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.717+0000 7fede57f7640 1 -- 172.21.15.55:0/908977859 learned_addr learned my addr 172.21.15.55:0/908977859 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:35.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.721+0000 7fede5ff8640 1 --2- 172.21.15.55:0/908977859 >> v2:172.21.15.110:3300/0 conn(0x7fede00cdb10 0x7fede00cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:35.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.721+0000 7fede57f7640 1 -- 172.21.15.55:0/908977859 >> v2:172.21.15.110:3300/0 conn(0x7fede00cdb10 msgr2=0x7fede00cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:35.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.721+0000 7fede57f7640 1 --2- 172.21.15.55:0/908977859 >> v2:172.21.15.110:3300/0 conn(0x7fede00cdb10 0x7fede00cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.721+0000 7fede57f7640 1 -- 172.21.15.55:0/908977859 >> v1:172.21.15.110:6789/0 conn(0x7fede00ca260 legacy=0x7fede00ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:35.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.721+0000 7fede57f7640 1 -- 172.21.15.55:0/908977859 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede00cb5e0 con 0x7fede00ae450 2023-08-25T05:18:35.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.721+0000 7fede5ff8640 1 --2- 172.21.15.55:0/908977859 >> v2:172.21.15.110:3300/0 conn(0x7fede00cdb10 0x7fede00cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:18:35.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.721+0000 7fede57f7640 1 --2- 172.21.15.55:0/908977859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fede00ae450 0x7fede00cdef0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fede006b820 tx=0x7fedd001eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2000386f5d2e464 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:35.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.721+0000 7fede4ff6640 1 -- 172.21.15.55:0/908977859 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd00a7b30 con 0x7fede00ae450 2023-08-25T05:18:35.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.721+0000 7fede4ff6640 1 -- 172.21.15.55:0/908977859 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd00a7c90 con 0x7fede00ae450 2023-08-25T05:18:35.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.721+0000 7fede4ff6640 1 -- 172.21.15.55:0/908977859 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd00af440 con 0x7fede00ae450 2023-08-25T05:18:35.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.721+0000 7fede825c640 1 -- 172.21.15.55:0/908977859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fede00ae450 msgr2=0x7fede00cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:35.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.721+0000 7fede825c640 1 --2- 172.21.15.55:0/908977859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fede00ae450 0x7fede00cdef0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fede006b820 tx=0x7fedd001eb60 comp rx=0 tx=0).stop 2023-08-25T05:18:35.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede825c640 1 -- 172.21.15.55:0/908977859 shutdown_connections 2023-08-25T05:18:35.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede825c640 1 --2- 172.21.15.55:0/908977859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fede00ae450 0x7fede00cdef0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede825c640 1 --2- 172.21.15.55:0/908977859 >> v2:172.21.15.110:3300/0 conn(0x7fede00cdb10 0x7fede00cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede825c640 1 -- 172.21.15.55:0/908977859 >> 172.21.15.55:0/908977859 conn(0x7fede00cf530 msgr2=0x7fede00cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:35.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede825c640 1 -- 172.21.15.55:0/908977859 shutdown_connections 2023-08-25T05:18:35.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede825c640 1 -- 172.21.15.55:0/908977859 wait complete. 2023-08-25T05:18:35.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede825c640 1 Processor -- start 2023-08-25T05:18:35.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede825c640 1 -- start start 2023-08-25T05:18:35.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede825c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fede00ae450 0x7fede01504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:35.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede825c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fede00ca260 0x7fede00c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:35.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede825c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fede00cdb10 0x7fede01547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:35.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede825c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede00c8b00 con 0x7fede00cdb10 2023-08-25T05:18:35.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede825c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede00c8670 con 0x7fede00ae450 2023-08-25T05:18:35.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede825c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fede00c7a60 con 0x7fede00ca260 2023-08-25T05:18:35.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede67f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fede00cdb10 0x7fede01547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:35.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede67f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fede00cdb10 0x7fede01547a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36038/0 (socket says 172.21.15.55:36038) 2023-08-25T05:18:35.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede5ff8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fede00ae450 0x7fede01504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:35.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede67f9640 1 -- 172.21.15.55:0/750581950 learned_addr learned my addr 172.21.15.55:0/750581950 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:35.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede57f7640 1 --2- 172.21.15.55:0/750581950 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fede00ca260 0x7fede00c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:35.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede67f9640 1 -- 172.21.15.55:0/750581950 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fede00ca260 msgr2=0x7fede00c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:35.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede67f9640 1 --2- 172.21.15.55:0/750581950 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fede00ca260 0x7fede00c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede67f9640 1 -- 172.21.15.55:0/750581950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fede00ae450 msgr2=0x7fede01504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:35.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede67f9640 1 --2- 172.21.15.55:0/750581950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fede00ae450 0x7fede01504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.725+0000 7fede67f9640 1 -- 172.21.15.55:0/750581950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd000b770 con 0x7fede00cdb10 2023-08-25T05:18:35.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.729+0000 7fede67f9640 1 --2- 172.21.15.55:0/750581950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fede00cdb10 0x7fede01547a0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fedd800b970 tx=0x7fedd800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:35.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.729+0000 7fedd67fc640 1 -- 172.21.15.55:0/750581950 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd800cae0 con 0x7fede00cdb10 2023-08-25T05:18:35.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.729+0000 7fedd67fc640 1 -- 172.21.15.55:0/750581950 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd800cc40 con 0x7fede00cdb10 2023-08-25T05:18:35.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.729+0000 7fedd67fc640 1 -- 172.21.15.55:0/750581950 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd8014680 con 0x7fede00cdb10 2023-08-25T05:18:35.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.729+0000 7fede825c640 1 -- 172.21.15.55:0/750581950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede00c7d40 con 0x7fede00cdb10 2023-08-25T05:18:35.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.729+0000 7fede825c640 1 -- 172.21.15.55:0/750581950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede00c8300 con 0x7fede00cdb10 2023-08-25T05:18:35.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.729+0000 7fede825c640 1 -- 172.21.15.55:0/750581950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede00cf1d0 con 0x7fede00cdb10 2023-08-25T05:18:35.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.729+0000 7fedd67fc640 1 -- 172.21.15.55:0/750581950 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fedd801d3b0 con 0x7fede00cdb10 2023-08-25T05:18:35.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.729+0000 7fedd67fc640 1 --2- 172.21.15.55:0/750581950 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fedc40657d0 0x7fedc4067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:35.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.729+0000 7fedd67fc640 1 -- 172.21.15.55:0/750581950 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fedd8082c30 con 0x7fede00cdb10 2023-08-25T05:18:35.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.733+0000 7fede5ff8640 1 --2- 172.21.15.55:0/750581950 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fedc40657d0 0x7fedc4067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:35.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.733+0000 7fede5ff8640 1 --2- 172.21.15.55:0/750581950 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fedc40657d0 0x7fedc4067c90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fede01535d0 tx=0x7feddc008040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:35.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.733+0000 7fedd67fc640 1 -- 172.21.15.55:0/750581950 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fedd80506e0 con 0x7fede00cdb10 2023-08-25T05:18:35.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.921+0000 7fede825c640 1 -- 172.21.15.55:0/750581950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fede004dbe0 con 0x7fede00cdb10 2023-08-25T05:18:35.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.925+0000 7fedd67fc640 1 -- 172.21.15.55:0/750581950 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+3702 (secure 0 0 0) 0x7fedd8053d00 con 0x7fede00cdb10 2023-08-25T05:18:35.927 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:35.927 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":68,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7493,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/2640392190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":2640392190},{"type":"v1","addr":"172.21.15.110:6837","nonce":2640392190}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62},{"gid":8428,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/2668985619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2668985619},{"type":"v1","addr":"172.21.15.110:6836","nonce":2668985619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":61},{"gid":9018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/210118982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":210118982},{"type":"v1","addr":"172.21.15.55:6834","nonce":210118982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":62},{"gid":9507,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3456483781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3456483781},{"type":"v1","addr":"172.21.15.55:6835","nonce":3456483781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":68}],"filesystems":[]} 2023-08-25T05:18:35.928 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 68 2023-08-25T05:18:35.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.925+0000 7fede825c640 1 -- 172.21.15.55:0/750581950 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fedc40657d0 msgr2=0x7fedc4067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:35.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.925+0000 7fede825c640 1 --2- 172.21.15.55:0/750581950 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fedc40657d0 0x7fedc4067c90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fede01535d0 tx=0x7feddc008040 comp rx=0 tx=0).stop 2023-08-25T05:18:35.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.925+0000 7fede825c640 1 -- 172.21.15.55:0/750581950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fede00cdb10 msgr2=0x7fede01547a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:35.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.925+0000 7fede825c640 1 --2- 172.21.15.55:0/750581950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fede00cdb10 0x7fede01547a0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fedd800b970 tx=0x7fedd800be30 comp rx=0 tx=0).stop 2023-08-25T05:18:35.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.925+0000 7fede825c640 1 -- 172.21.15.55:0/750581950 shutdown_connections 2023-08-25T05:18:35.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.925+0000 7fede825c640 1 --2- 172.21.15.55:0/750581950 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fedc40657d0 0x7fedc4067c90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.925+0000 7fede825c640 1 --2- 172.21.15.55:0/750581950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fede00cdb10 0x7fede01547a0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.925+0000 7fede825c640 1 --2- 172.21.15.55:0/750581950 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fede00ca260 0x7fede00c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.925+0000 7fede825c640 1 --2- 172.21.15.55:0/750581950 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fede00ae450 0x7fede01504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.925+0000 7fede825c640 1 -- 172.21.15.55:0/750581950 >> 172.21.15.55:0/750581950 conn(0x7fede00cf530 msgr2=0x7fede00ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.925+0000 7fede825c640 1 -- 172.21.15.55:0/750581950 shutdown_connections 2023-08-25T05:18:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:35.925+0000 7fede825c640 1 -- 172.21.15.55:0/750581950 wait complete. 2023-08-25T05:18:35.948 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-25T05:18:35.948 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-25T05:18:35.949 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-25T05:18:35.949 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:18:35.949 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-25T05:18:35.949 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-25T05:18:35.950 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-25T05:18:35.950 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:18:35.950 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-25T05:18:35.950 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-25T05:18:35.950 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-25T05:18:35.951 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:18:35.951 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-25T05:18:35.951 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-25T05:18:35.951 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-25T05:18:35.951 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:18:35.961 INFO:tasks.ceph.mds.c:Stopped 2023-08-25T05:18:35.961 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-25T05:18:35.962 INFO:tasks.ceph.mds.a:Stopped 2023-08-25T05:18:35.962 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-25T05:18:35.965 INFO:tasks.ceph.mds.b:Stopped 2023-08-25T05:18:35.965 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-25T05:18:35.966 INFO:tasks.ceph.mds.d:Stopped 2023-08-25T05:18:35.966 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-25T05:18:36.005 INFO:tasks.ceph.mds.c:Started 2023-08-25T05:18:36.006 DEBUG:teuthology.parallel:result is None 2023-08-25T05:18:36.007 INFO:tasks.ceph.mds.a:Started 2023-08-25T05:18:36.007 DEBUG:teuthology.parallel:result is None 2023-08-25T05:18:36.011 INFO:tasks.ceph.mds.b:Started 2023-08-25T05:18:36.012 DEBUG:teuthology.parallel:result is None 2023-08-25T05:18:36.014 INFO:tasks.ceph.mds.d:Started 2023-08-25T05:18:36.014 DEBUG:teuthology.parallel:result is None 2023-08-25T05:18:36.015 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-25T05:18:36.096 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-08-25T05:18:36.097 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T05:18:36.103 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2023-08-25T05:18:36.103 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2023-08-25T05:18:36.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.161+0000 7f8f3aa34640 1 Processor -- start 2023-08-25T05:18:36.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.161+0000 7f8f3aa34640 1 -- start start 2023-08-25T05:18:36.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.165+0000 7f8f3aa34640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8f340ad950 0x7f8f340cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:36.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.165+0000 7f8f3aa34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f340ceeb0 0x7f8f340b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:36.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.165+0000 7f8f3aa34640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f340cc880 con 0x7f8f340c89f0 2023-08-25T05:18:36.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.165+0000 7f8f3aa34640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f340b11f0 con 0x7f8f340ad950 2023-08-25T05:18:36.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.165+0000 7f8f3aa34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f34159d50 con 0x7f8f340ceeb0 2023-08-25T05:18:36.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.165+0000 7f8f33fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f8f340ad950 0x7f8f340cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:36.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.165+0000 7f8f38fd1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f340ceeb0 0x7f8f340b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:36.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.165+0000 7f8f337fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f8f340c89f0 0x7f8f340ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:35118/0 (socket says 172.21.15.55:35118) 2023-08-25T05:18:36.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.165+0000 7f8f337fe640 1 -- 172.21.15.55:0/292300070 learned_addr learned my addr 172.21.15.55:0/292300070 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:36.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.165+0000 7f8f33fff640 1 -- 172.21.15.55:0/292300070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f340ceeb0 msgr2=0x7f8f340b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:36.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.165+0000 7f8f33fff640 1 --2- 172.21.15.55:0/292300070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f340ceeb0 0x7f8f340b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:36.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.165+0000 7f8f33fff640 1 -- 172.21.15.55:0/292300070 >> v1:172.21.15.110:6789/0 conn(0x7f8f340c89f0 legacy=0x7f8f340ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:36.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.165+0000 7f8f32ffd640 1 -- 172.21.15.55:0/292300070 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077600574 0 0) 0x7f8f340cc880 con 0x7f8f340c89f0 2023-08-25T05:18:36.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.165+0000 7f8f33fff640 1 -- 172.21.15.55:0/292300070 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f340ccb60 con 0x7f8f340ad950 2023-08-25T05:18:36.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.165+0000 7f8f38fd1640 1 --2- 172.21.15.55:0/292300070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f340ceeb0 0x7f8f340b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:18:36.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.169+0000 7f8f33fff640 1 --2- 172.21.15.55:0/292300070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f340ad950 0x7f8f340cc2a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8f240097c0 tx=0x7f8f2401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64865ba9cfbfeada server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:36.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.169+0000 7f8f32ffd640 1 -- 172.21.15.55:0/292300070 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f240ab600 con 0x7f8f340ad950 2023-08-25T05:18:36.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.169+0000 7f8f32ffd640 1 -- 172.21.15.55:0/292300070 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f240a7050 con 0x7f8f340ad950 2023-08-25T05:18:36.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.169+0000 7f8f32ffd640 1 -- 172.21.15.55:0/292300070 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f240ab980 con 0x7f8f340ad950 2023-08-25T05:18:36.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.169+0000 7f8f3aa34640 1 -- 172.21.15.55:0/292300070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f340ad950 msgr2=0x7f8f340cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:36.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.169+0000 7f8f3aa34640 1 --2- 172.21.15.55:0/292300070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f340ad950 0x7f8f340cc2a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8f240097c0 tx=0x7f8f2401c3c0 comp rx=0 tx=0).stop 2023-08-25T05:18:36.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.169+0000 7f8f3aa34640 1 -- 172.21.15.55:0/292300070 shutdown_connections 2023-08-25T05:18:36.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.169+0000 7f8f3aa34640 1 --2- 172.21.15.55:0/292300070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f340ceeb0 0x7f8f340b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:36.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.169+0000 7f8f3aa34640 1 --2- 172.21.15.55:0/292300070 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f340ad950 0x7f8f340cc2a0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:36.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.169+0000 7f8f3aa34640 1 -- 172.21.15.55:0/292300070 >> 172.21.15.55:0/292300070 conn(0x7f8f34069d00 msgr2=0x7f8f3406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:36.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.169+0000 7f8f3aa34640 1 -- 172.21.15.55:0/292300070 shutdown_connections 2023-08-25T05:18:36.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.169+0000 7f8f3aa34640 1 -- 172.21.15.55:0/292300070 wait complete. 2023-08-25T05:18:36.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.169+0000 7f8f3aa34640 1 Processor -- start 2023-08-25T05:18:36.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.169+0000 7f8f3aa34640 1 -- start start 2023-08-25T05:18:36.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f3aa34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f340ad950 0x7f8f34152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:36.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f3aa34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f340c89f0 0x7f8f3415a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:36.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f3aa34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f340ceeb0 0x7f8f340ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:36.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f3aa34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f340ae530 con 0x7f8f340c89f0 2023-08-25T05:18:36.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f3aa34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f340c8170 con 0x7f8f340ad950 2023-08-25T05:18:36.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f3aa34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f340c8450 con 0x7f8f340ceeb0 2023-08-25T05:18:36.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f337fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f340c89f0 0x7f8f3415a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:36.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f337fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f340c89f0 0x7f8f3415a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36074/0 (socket says 172.21.15.55:36074) 2023-08-25T05:18:36.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f337fe640 1 -- 172.21.15.55:0/3800042901 learned_addr learned my addr 172.21.15.55:0/3800042901 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:36.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f33fff640 1 --2- 172.21.15.55:0/3800042901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f340ad950 0x7f8f34152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:36.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f38fd1640 1 --2- 172.21.15.55:0/3800042901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f340ceeb0 0x7f8f340ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:36.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f337fe640 1 -- 172.21.15.55:0/3800042901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f340ceeb0 msgr2=0x7f8f340ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:36.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f337fe640 1 --2- 172.21.15.55:0/3800042901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f340ceeb0 0x7f8f340ae9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:36.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f337fe640 1 -- 172.21.15.55:0/3800042901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f340ad950 msgr2=0x7f8f34152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:36.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f337fe640 1 --2- 172.21.15.55:0/3800042901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f340ad950 0x7f8f34152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:36.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f337fe640 1 -- 172.21.15.55:0/3800042901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c009a70 con 0x7f8f340c89f0 2023-08-25T05:18:36.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f337fe640 1 --2- 172.21.15.55:0/3800042901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f340c89f0 0x7f8f3415a0f0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f8f280011f0 tx=0x7f8f2800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:36.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f30ff9640 1 -- 172.21.15.55:0/3800042901 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f280074e0 con 0x7f8f340c89f0 2023-08-25T05:18:36.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f30ff9640 1 -- 172.21.15.55:0/3800042901 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f28007640 con 0x7f8f340c89f0 2023-08-25T05:18:36.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f30ff9640 1 -- 172.21.15.55:0/3800042901 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f28004a10 con 0x7f8f340c89f0 2023-08-25T05:18:36.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f3aa34640 1 -- 172.21.15.55:0/3800042901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f24009420 con 0x7f8f340c89f0 2023-08-25T05:18:36.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f3aa34640 1 -- 172.21.15.55:0/3800042901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f34156d30 con 0x7f8f340c89f0 2023-08-25T05:18:36.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f3aa34640 1 -- 172.21.15.55:0/3800042901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3404dbe0 con 0x7f8f340c89f0 2023-08-25T05:18:36.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.173+0000 7f8f30ff9640 1 -- 172.21.15.55:0/3800042901 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f8f28004b70 con 0x7f8f340c89f0 2023-08-25T05:18:36.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.177+0000 7f8f30ff9640 1 --2- 172.21.15.55:0/3800042901 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f8f200657a0 0x7f8f20067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:36.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.177+0000 7f8f30ff9640 1 -- 172.21.15.55:0/3800042901 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f8f280822a0 con 0x7f8f340c89f0 2023-08-25T05:18:36.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.177+0000 7f8f33fff640 1 --2- 172.21.15.55:0/3800042901 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f8f200657a0 0x7f8f20067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:36.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.177+0000 7f8f33fff640 1 --2- 172.21.15.55:0/3800042901 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f8f200657a0 0x7f8f20067c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8f240ad000 tx=0x7f8f240a6000 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:36.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.177+0000 7f8f30ff9640 1 -- 172.21.15.55:0/3800042901 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8f2804fc20 con 0x7f8f340c89f0 2023-08-25T05:18:36.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:36.345+0000 7f8f3aa34640 1 -- 172.21.15.55:0/3800042901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8f3415d0f0 con 0x7f8f340c89f0 2023-08-25T05:18:37.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:37.877+0000 7f8f30ff9640 1 -- 172.21.15.55:0/3800042901 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v153) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8f28053240 con 0x7f8f340c89f0 2023-08-25T05:18:37.881 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-08-25T05:18:37.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:37.881+0000 7f8f3aa34640 1 -- 172.21.15.55:0/3800042901 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f8f200657a0 msgr2=0x7f8f20067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:37.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:37.881+0000 7f8f3aa34640 1 --2- 172.21.15.55:0/3800042901 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f8f200657a0 0x7f8f20067c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8f240ad000 tx=0x7f8f240a6000 comp rx=0 tx=0).stop 2023-08-25T05:18:37.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:37.881+0000 7f8f3aa34640 1 -- 172.21.15.55:0/3800042901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f340c89f0 msgr2=0x7f8f3415a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:37.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:37.881+0000 7f8f3aa34640 1 --2- 172.21.15.55:0/3800042901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f340c89f0 0x7f8f3415a0f0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f8f280011f0 tx=0x7f8f2800c9b0 comp rx=0 tx=0).stop 2023-08-25T05:18:37.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:37.881+0000 7f8f3aa34640 1 -- 172.21.15.55:0/3800042901 shutdown_connections 2023-08-25T05:18:37.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:37.881+0000 7f8f3aa34640 1 --2- 172.21.15.55:0/3800042901 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f8f200657a0 0x7f8f20067c60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:37.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:37.881+0000 7f8f3aa34640 1 --2- 172.21.15.55:0/3800042901 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8f340ceeb0 0x7f8f340ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:37.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:37.881+0000 7f8f3aa34640 1 --2- 172.21.15.55:0/3800042901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f340c89f0 0x7f8f3415a0f0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:37.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:37.881+0000 7f8f3aa34640 1 --2- 172.21.15.55:0/3800042901 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8f340ad950 0x7f8f34152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:37.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:37.881+0000 7f8f3aa34640 1 -- 172.21.15.55:0/3800042901 >> 172.21.15.55:0/3800042901 conn(0x7f8f34069d00 msgr2=0x7f8f341533d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:37.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:37.881+0000 7f8f3aa34640 1 -- 172.21.15.55:0/3800042901 shutdown_connections 2023-08-25T05:18:37.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:37.881+0000 7f8f3aa34640 1 -- 172.21.15.55:0/3800042901 wait complete. 2023-08-25T05:18:37.907 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-25T05:18:38.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.053+0000 7f29c66cb640 1 Processor -- start 2023-08-25T05:18:38.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.053+0000 7f29c66cb640 1 -- start start 2023-08-25T05:18:38.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.053+0000 7f29c66cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c00cddc0 0x7f29c00b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:38.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.053+0000 7f29c66cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29c00ce1a0 0x7f29c00ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:38.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.053+0000 7f29c66cb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c0069ba0 con 0x7f29c00caa50 2023-08-25T05:18:38.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.053+0000 7f29c66cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c00ceab0 con 0x7f29c00ce1a0 2023-08-25T05:18:38.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.053+0000 7f29c66cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c0069900 con 0x7f29c00cddc0 2023-08-25T05:18:38.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.053+0000 7f29bf7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29c00ce1a0 0x7f29c00ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:38.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.053+0000 7f29bf7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29c00ce1a0 0x7f29c00ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36090/0 (socket says 172.21.15.55:36090) 2023-08-25T05:18:38.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.053+0000 7f29bf7fe640 1 -- 172.21.15.55:0/3458531535 learned_addr learned my addr 172.21.15.55:0/3458531535 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:38.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.053+0000 7f29bffff640 1 --2- 172.21.15.55:0/3458531535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c00cddc0 0x7f29c00b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:38.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.053+0000 7f29bf7fe640 1 -- 172.21.15.55:0/3458531535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c00cddc0 msgr2=0x7f29c00b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:38.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.053+0000 7f29bf7fe640 1 --2- 172.21.15.55:0/3458531535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c00cddc0 0x7f29c00b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.053+0000 7f29bf7fe640 1 -- 172.21.15.55:0/3458531535 >> v1:172.21.15.55:6789/0 conn(0x7f29c00caa50 legacy=0x7f29c00caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.053+0000 7f29bf7fe640 1 -- 172.21.15.55:0/3458531535 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c00cd390 con 0x7f29c00ce1a0 2023-08-25T05:18:38.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.053+0000 7f29beffd640 1 -- 172.21.15.55:0/3458531535 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632767322 0 0) 0x7f29c0069ba0 con 0x7f29c00caa50 2023-08-25T05:18:38.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.057+0000 7f29bf7fe640 1 --2- 172.21.15.55:0/3458531535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29c00ce1a0 0x7f29c00ca510 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009870 tx=0x7f29b401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d204c11f2459feb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:38.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.057+0000 7f29beffd640 1 -- 172.21.15.55:0/3458531535 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b40ac640 con 0x7f29c00ce1a0 2023-08-25T05:18:38.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.057+0000 7f29beffd640 1 -- 172.21.15.55:0/3458531535 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b40ac7a0 con 0x7f29c00ce1a0 2023-08-25T05:18:38.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.057+0000 7f29beffd640 1 -- 172.21.15.55:0/3458531535 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b40acb30 con 0x7f29c00ce1a0 2023-08-25T05:18:38.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.057+0000 7f29c66cb640 1 -- 172.21.15.55:0/3458531535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29c00ce1a0 msgr2=0x7f29c00ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.057+0000 7f29c66cb640 1 --2- 172.21.15.55:0/3458531535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29c00ce1a0 0x7f29c00ca510 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009870 tx=0x7f29b401c480 comp rx=0 tx=0).stop 2023-08-25T05:18:38.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.057+0000 7f29c66cb640 1 -- 172.21.15.55:0/3458531535 shutdown_connections 2023-08-25T05:18:38.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.057+0000 7f29c66cb640 1 --2- 172.21.15.55:0/3458531535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29c00ce1a0 0x7f29c00ca510 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.057+0000 7f29c66cb640 1 --2- 172.21.15.55:0/3458531535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c00cddc0 0x7f29c00b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.057+0000 7f29c66cb640 1 -- 172.21.15.55:0/3458531535 >> 172.21.15.55:0/3458531535 conn(0x7f29c00b0700 msgr2=0x7f29c00b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.057+0000 7f29c66cb640 1 -- 172.21.15.55:0/3458531535 shutdown_connections 2023-08-25T05:18:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.057+0000 7f29c66cb640 1 -- 172.21.15.55:0/3458531535 wait complete. 2023-08-25T05:18:38.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29c66cb640 1 Processor -- start 2023-08-25T05:18:38.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29c66cb640 1 -- start start 2023-08-25T05:18:38.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29c66cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c00caa50 0x7f29c01f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:38.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29c66cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29c00cddc0 0x7f29c015cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:38.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29c66cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29c00ce1a0 0x7f29c015d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:38.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29c66cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c0158a00 con 0x7f29c00cddc0 2023-08-25T05:18:38.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29c66cb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c0157030 con 0x7f29c00ce1a0 2023-08-25T05:18:38.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29c66cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c00c5eb0 con 0x7f29c00caa50 2023-08-25T05:18:38.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29bf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29c00cddc0 0x7f29c015cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:38.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29bf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29c00cddc0 0x7f29c015cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36092/0 (socket says 172.21.15.55:36092) 2023-08-25T05:18:38.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29bf7fe640 1 -- 172.21.15.55:0/2677661555 learned_addr learned my addr 172.21.15.55:0/2677661555 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:38.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29bffff640 1 --2- 172.21.15.55:0/2677661555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c00caa50 0x7f29c01f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:38.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29c4c68640 1 --2- 172.21.15.55:0/2677661555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29c00ce1a0 0x7f29c015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:38.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29bf7fe640 1 -- 172.21.15.55:0/2677661555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c00caa50 msgr2=0x7f29c01f4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29bf7fe640 1 --2- 172.21.15.55:0/2677661555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c00caa50 0x7f29c01f4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29bf7fe640 1 -- 172.21.15.55:0/2677661555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29c00ce1a0 msgr2=0x7f29c015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29bf7fe640 1 --2- 172.21.15.55:0/2677661555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29c00ce1a0 0x7f29c015d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29bf7fe640 1 -- 172.21.15.55:0/2677661555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40094d0 con 0x7f29c00cddc0 2023-08-25T05:18:38.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29c4c68640 1 --2- 172.21.15.55:0/2677661555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29c00ce1a0 0x7f29c015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:38.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29bf7fe640 1 --2- 172.21.15.55:0/2677661555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29c00cddc0 0x7f29c015cf20 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f29b401a0b0 tx=0x7f29b401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:38.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29bcff9640 1 -- 172.21.15.55:0/2677661555 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4004220 con 0x7f29c00cddc0 2023-08-25T05:18:38.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29bcff9640 1 -- 172.21.15.55:0/2677661555 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b4004380 con 0x7f29c00cddc0 2023-08-25T05:18:38.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29bcff9640 1 -- 172.21.15.55:0/2677661555 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4003820 con 0x7f29c00cddc0 2023-08-25T05:18:38.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.061+0000 7f29c66cb640 1 -- 172.21.15.55:0/2677661555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c00c6190 con 0x7f29c00cddc0 2023-08-25T05:18:38.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.065+0000 7f29c66cb640 1 -- 172.21.15.55:0/2677661555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c00c6750 con 0x7f29c00cddc0 2023-08-25T05:18:38.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.065+0000 7f29c66cb640 1 -- 172.21.15.55:0/2677661555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c0158b40 con 0x7f29c00cddc0 2023-08-25T05:18:38.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.065+0000 7f29bcff9640 1 -- 172.21.15.55:0/2677661555 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f29b40b3050 con 0x7f29c00cddc0 2023-08-25T05:18:38.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.065+0000 7f29bcff9640 1 --2- 172.21.15.55:0/2677661555 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f29ac065820 0x7f29ac067ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:38.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.065+0000 7f29bcff9640 1 -- 172.21.15.55:0/2677661555 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f29b411d130 con 0x7f29c00cddc0 2023-08-25T05:18:38.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.065+0000 7f29bffff640 1 --2- 172.21.15.55:0/2677661555 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f29ac065820 0x7f29ac067ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:38.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.069+0000 7f29bffff640 1 --2- 172.21.15.55:0/2677661555 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f29ac065820 0x7f29ac067ce0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f29b00079c0 tx=0x7f29b0008040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:38.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.069+0000 7f29bcff9640 1 -- 172.21.15.55:0/2677661555 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f29c0158b40 con 0x7f29c00cddc0 2023-08-25T05:18:38.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.277+0000 7f29c66cb640 1 -- 172.21.15.55:0/2677661555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f29c0158b40 con 0x7f29c00cddc0 2023-08-25T05:18:38.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.277+0000 7f29bcff9640 1 -- 172.21.15.55:0/2677661555 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v39) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f29c0158b40 con 0x7f29c00cddc0 2023-08-25T05:18:38.280 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:38.281 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T05:18:38.281 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-08-25T05:18:38.281 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.281 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-08-25T05:18:38.281 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkgFrTEBAAoan9rk8Q+qPyMjb2vGUHhA==", 2023-08-25T05:18:38.281 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.281 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:18:38.281 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:18:38.282 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:18:38.282 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:18:38.282 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.282 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:38.282 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.282 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-08-25T05:18:38.282 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk18hNHRAAzXuhzQEONXRzRXTeCH9fKQ==", 2023-08-25T05:18:38.283 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.283 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:18:38.283 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:18:38.283 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:18:38.283 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:18:38.283 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.283 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:38.283 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.284 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-08-25T05:18:38.284 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkLF9CGBAAqxgRU/02SsZfWuZPSYxuZA==", 2023-08-25T05:18:38.284 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.284 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:18:38.284 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:18:38.284 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:18:38.284 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:18:38.284 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.285 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:38.285 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.285 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-08-25T05:18:38.285 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hky6HiJBAAsrXlTDn2cxbk7PnqSgNNkA==", 2023-08-25T05:18:38.285 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.285 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:18:38.285 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:18:38.286 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:18:38.286 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:18:38.286 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.286 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:38.286 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.286 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-08-25T05:18:38.286 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC+J+hkY1tDFBAAVQY5Xl8On9pN3jLWwKWGTA==", 2023-08-25T05:18:38.286 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.287 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:18:38.287 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:18:38.287 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:18:38.287 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.287 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:38.287 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.287 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-08-25T05:18:38.287 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDBJ+hkpdBCHRAADyMAxTsnQfkD9G0p48H4zQ==", 2023-08-25T05:18:38.288 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.288 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:18:38.288 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:18:38.288 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:18:38.288 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.288 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:38.288 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.289 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-08-25T05:18:38.289 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDEJ+hkOR49KRAAudbqAxLItsoczide8ybzAg==", 2023-08-25T05:18:38.289 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.289 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:18:38.289 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:18:38.289 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:18:38.289 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.289 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:38.290 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.290 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-08-25T05:18:38.290 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDHJ+hkxun5MBAAAhGtJYVeL3ogL3TQV67diw==", 2023-08-25T05:18:38.290 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.290 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:18:38.290 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:18:38.290 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:18:38.290 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.291 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:38.291 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.291 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-08-25T05:18:38.291 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDMJ+hkuosTCRAAqCuwHFZFBVR/7nFtHHByNg==", 2023-08-25T05:18:38.291 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.291 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:18:38.291 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:18:38.291 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:18:38.292 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.292 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:38.292 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.292 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-08-25T05:18:38.292 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDPJ+hkJa+SDhAAllo6biVE99BZWvv5K/gXGw==", 2023-08-25T05:18:38.292 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.292 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:18:38.293 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:18:38.293 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:18:38.293 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.293 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:38.293 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.293 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-08-25T05:18:38.293 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDSJ+hkUPywFBAA4jua1Eu1nRl2L6hX/mycfw==", 2023-08-25T05:18:38.293 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.294 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:18:38.294 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:18:38.294 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:18:38.294 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.294 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:38.294 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.294 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-08-25T05:18:38.294 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDVJ+hkhyDMGxAAmcSWLzJqIE5w5H/E4wIurQ==", 2023-08-25T05:18:38.295 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.295 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:18:38.295 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:18:38.295 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:18:38.295 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.295 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:38.295 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.295 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-08-25T05:18:38.296 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g==", 2023-08-25T05:18:38.296 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.296 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:18:38.296 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-08-25T05:18:38.296 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-25T05:18:38.296 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.296 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:38.297 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.297 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-08-25T05:18:38.297 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk8KsDMxAAKyK4jMKflYNnJXYIbr2OBQ==", 2023-08-25T05:18:38.297 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.297 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:18:38.297 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T05:18:38.297 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T05:18:38.297 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T05:18:38.298 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.298 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:38.298 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.298 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-08-25T05:18:38.298 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjSA4LxAAxzbnHeV85qYZYhSqTOT2rw==", 2023-08-25T05:18:38.298 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.298 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:18:38.298 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T05:18:38.299 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T05:18:38.299 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T05:18:38.299 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.299 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:38.299 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.299 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-08-25T05:18:38.299 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkl9AoORAARYZcPObsM/HT/yrTmneZrw==", 2023-08-25T05:18:38.299 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.300 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:18:38.300 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T05:18:38.300 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T05:18:38.300 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T05:18:38.300 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.300 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:38.300 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.301 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-08-25T05:18:38.301 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC2J+hkgTdcLxAAqxSepXXhEultFAFYBBKSag==", 2023-08-25T05:18:38.301 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.301 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T05:18:38.301 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:18:38.301 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:18:38.301 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:18:38.301 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.302 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:38.302 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.302 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-08-25T05:18:38.302 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkYGUZDBAAiuDo9hqavWq7zQlGd6x4YQ==", 2023-08-25T05:18:38.302 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.302 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T05:18:38.302 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T05:18:38.302 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:18:38.303 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.303 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:38.303 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:38.303 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-08-25T05:18:38.303 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjr9KCBAApSqjtFhLnjHduMBu/eaaKw==", 2023-08-25T05:18:38.303 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:18:38.304 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T05:18:38.304 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T05:18:38.304 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:18:38.304 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.304 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:38.304 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-08-25T05:18:38.304 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T05:18:38.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.277+0000 7f29c66cb640 1 -- 172.21.15.55:0/2677661555 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f29ac065820 msgr2=0x7f29ac067ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.277+0000 7f29c66cb640 1 --2- 172.21.15.55:0/2677661555 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f29ac065820 0x7f29ac067ce0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f29b00079c0 tx=0x7f29b0008040 comp rx=0 tx=0).stop 2023-08-25T05:18:38.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.277+0000 7f29c66cb640 1 -- 172.21.15.55:0/2677661555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29c00cddc0 msgr2=0x7f29c015cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.277+0000 7f29c66cb640 1 --2- 172.21.15.55:0/2677661555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29c00cddc0 0x7f29c015cf20 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f29b401a0b0 tx=0x7f29b401acc0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.277+0000 7f29c66cb640 1 -- 172.21.15.55:0/2677661555 shutdown_connections 2023-08-25T05:18:38.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.277+0000 7f29c66cb640 1 --2- 172.21.15.55:0/2677661555 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f29ac065820 0x7f29ac067ce0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.277+0000 7f29c66cb640 1 --2- 172.21.15.55:0/2677661555 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29c00ce1a0 0x7f29c015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.277+0000 7f29c66cb640 1 --2- 172.21.15.55:0/2677661555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29c00cddc0 0x7f29c015cf20 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.277+0000 7f29c66cb640 1 --2- 172.21.15.55:0/2677661555 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29c00caa50 0x7f29c01f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.277+0000 7f29c66cb640 1 -- 172.21.15.55:0/2677661555 >> 172.21.15.55:0/2677661555 conn(0x7f29c00b0700 msgr2=0x7f29c0164950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:38.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.277+0000 7f29c66cb640 1 -- 172.21.15.55:0/2677661555 shutdown_connections 2023-08-25T05:18:38.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.277+0000 7f29c66cb640 1 -- 172.21.15.55:0/2677661555 wait complete. 2023-08-25T05:18:38.308 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:18:38.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.449+0000 7faa5b488640 1 Processor -- start 2023-08-25T05:18:38.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.449+0000 7faa5b488640 1 -- start start 2023-08-25T05:18:38.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.449+0000 7faa5b488640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faa5415c9c0 0x7faa54160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:38.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.449+0000 7faa5b488640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa5406b2b0 0x7faa5406b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:38.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.449+0000 7faa5b488640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5406eaf0 con 0x7faa540cfa70 2023-08-25T05:18:38.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.449+0000 7faa5b488640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5406e530 con 0x7faa5406b2b0 2023-08-25T05:18:38.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.449+0000 7faa5b488640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5406e810 con 0x7faa5415c9c0 2023-08-25T05:18:38.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.449+0000 7faa58a23640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faa540cfa70 0x7faa54160a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55578/0 (socket says 172.21.15.55:55578) 2023-08-25T05:18:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.449+0000 7faa58a23640 1 -- 172.21.15.55:0/2759009128 learned_addr learned my addr 172.21.15.55:0/2759009128 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.449+0000 7faa59a25640 1 --2- 172.21.15.55:0/2759009128 >> v2:172.21.15.55:3300/0 conn(0x7faa5406b2b0 0x7faa5406b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:38.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.449+0000 7faa59224640 1 --2- 172.21.15.55:0/2759009128 >> v2:172.21.15.110:3300/0 conn(0x7faa5415c9c0 0x7faa54160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:38.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.449+0000 7faa59a25640 1 -- 172.21.15.55:0/2759009128 >> v2:172.21.15.110:3300/0 conn(0x7faa5415c9c0 msgr2=0x7faa54160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:38.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.449+0000 7faa59a25640 1 --2- 172.21.15.55:0/2759009128 >> v2:172.21.15.110:3300/0 conn(0x7faa5415c9c0 0x7faa54160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.449+0000 7faa59a25640 1 -- 172.21.15.55:0/2759009128 >> v1:172.21.15.55:6789/0 conn(0x7faa540cfa70 legacy=0x7faa54160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.449+0000 7faa59a25640 1 -- 172.21.15.55:0/2759009128 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5406aab0 con 0x7faa5406b2b0 2023-08-25T05:18:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.449+0000 7faa4bfff640 1 -- 172.21.15.55:0/2759009128 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507994270 0 0) 0x7faa5406eaf0 con 0x7faa540cfa70 2023-08-25T05:18:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.449+0000 7faa59224640 1 --2- 172.21.15.55:0/2759009128 >> v2:172.21.15.110:3300/0 conn(0x7faa5415c9c0 0x7faa54160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:18:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.453+0000 7faa59a25640 1 --2- 172.21.15.55:0/2759009128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa5406b2b0 0x7faa5406b740 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7faa54070600 tx=0x7faa4c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b269e249c28b50 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:38.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.453+0000 7faa4bfff640 1 -- 172.21.15.55:0/2759009128 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c0a5960 con 0x7faa5406b2b0 2023-08-25T05:18:38.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.453+0000 7faa4bfff640 1 -- 172.21.15.55:0/2759009128 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c0a5ac0 con 0x7faa5406b2b0 2023-08-25T05:18:38.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.453+0000 7faa4bfff640 1 -- 172.21.15.55:0/2759009128 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c0a5e50 con 0x7faa5406b2b0 2023-08-25T05:18:38.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.453+0000 7faa5b488640 1 -- 172.21.15.55:0/2759009128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa5406b2b0 msgr2=0x7faa5406b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.453+0000 7faa5b488640 1 --2- 172.21.15.55:0/2759009128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa5406b2b0 0x7faa5406b740 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7faa54070600 tx=0x7faa4c01c8e0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.453+0000 7faa5b488640 1 -- 172.21.15.55:0/2759009128 shutdown_connections 2023-08-25T05:18:38.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.453+0000 7faa5b488640 1 --2- 172.21.15.55:0/2759009128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa5406b2b0 0x7faa5406b740 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.453+0000 7faa5b488640 1 --2- 172.21.15.55:0/2759009128 >> v2:172.21.15.110:3300/0 conn(0x7faa5415c9c0 0x7faa54160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.453+0000 7faa5b488640 1 -- 172.21.15.55:0/2759009128 >> 172.21.15.55:0/2759009128 conn(0x7faa540d05a0 msgr2=0x7faa540d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:38.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.453+0000 7faa5b488640 1 -- 172.21.15.55:0/2759009128 shutdown_connections 2023-08-25T05:18:38.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.453+0000 7faa5b488640 1 -- 172.21.15.55:0/2759009128 wait complete. 2023-08-25T05:18:38.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa5b488640 1 Processor -- start 2023-08-25T05:18:38.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa5b488640 1 -- start start 2023-08-25T05:18:38.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa5b488640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa5406b2b0 0x7faa540c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:38.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa5b488640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa540cfa70 0x7faa5414b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:38.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa5b488640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa5415c9c0 0x7faa5414be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:38.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa5b488640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa541f8320 con 0x7faa5406b2b0 2023-08-25T05:18:38.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa5b488640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5415a370 con 0x7faa540cfa70 2023-08-25T05:18:38.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa5b488640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa54159ab0 con 0x7faa5415c9c0 2023-08-25T05:18:38.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa59224640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa5406b2b0 0x7faa540c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:38.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa59224640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa5406b2b0 0x7faa540c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36108/0 (socket says 172.21.15.55:36108) 2023-08-25T05:18:38.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa59224640 1 -- 172.21.15.55:0/3145923519 learned_addr learned my addr 172.21.15.55:0/3145923519 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:38.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa58a23640 1 --2- 172.21.15.55:0/3145923519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa540cfa70 0x7faa5414b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:38.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa59a25640 1 --2- 172.21.15.55:0/3145923519 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa5415c9c0 0x7faa5414be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:38.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa59224640 1 -- 172.21.15.55:0/3145923519 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa5415c9c0 msgr2=0x7faa5414be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa59224640 1 --2- 172.21.15.55:0/3145923519 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa5415c9c0 0x7faa5414be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa59224640 1 -- 172.21.15.55:0/3145923519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa540cfa70 msgr2=0x7faa5414b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa59224640 1 --2- 172.21.15.55:0/3145923519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa540cfa70 0x7faa5414b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa59224640 1 -- 172.21.15.55:0/3145923519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c009a70 con 0x7faa5406b2b0 2023-08-25T05:18:38.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa59a25640 1 --2- 172.21.15.55:0/3145923519 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa5415c9c0 0x7faa5414be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:38.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa58a23640 1 --2- 172.21.15.55:0/3145923519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa540cfa70 0x7faa5414b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:38.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa59224640 1 --2- 172.21.15.55:0/3145923519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa5406b2b0 0x7faa540c67a0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7faa5000c850 tx=0x7faa5000cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:38.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa49ffb640 1 -- 172.21.15.55:0/3145923519 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa500059a0 con 0x7faa5406b2b0 2023-08-25T05:18:38.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa49ffb640 1 -- 172.21.15.55:0/3145923519 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa50005b00 con 0x7faa5406b2b0 2023-08-25T05:18:38.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa49ffb640 1 -- 172.21.15.55:0/3145923519 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50005e90 con 0x7faa5406b2b0 2023-08-25T05:18:38.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa5b488640 1 -- 172.21.15.55:0/3145923519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa54159d20 con 0x7faa5406b2b0 2023-08-25T05:18:38.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.457+0000 7faa5b488640 1 -- 172.21.15.55:0/3145923519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa540c7030 con 0x7faa5406b2b0 2023-08-25T05:18:38.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.461+0000 7faa5b488640 1 -- 172.21.15.55:0/3145923519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa541610e0 con 0x7faa5406b2b0 2023-08-25T05:18:38.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.461+0000 7faa49ffb640 1 -- 172.21.15.55:0/3145923519 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7faa50007830 con 0x7faa5406b2b0 2023-08-25T05:18:38.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.461+0000 7faa49ffb640 1 --2- 172.21.15.55:0/3145923519 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7faa380657a0 0x7faa38067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:38.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.461+0000 7faa49ffb640 1 -- 172.21.15.55:0/3145923519 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5210+0+0 (secure 0 0 0) 0x7faa50082c30 con 0x7faa5406b2b0 2023-08-25T05:18:38.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.461+0000 7faa58a23640 1 --2- 172.21.15.55:0/3145923519 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7faa380657a0 0x7faa38067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:38.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.465+0000 7faa58a23640 1 --2- 172.21.15.55:0/3145923519 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7faa380657a0 0x7faa38067c60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faa44007fd0 tx=0x7faa44007c20 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:38.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.465+0000 7faa49ffb640 1 -- 172.21.15.55:0/3145923519 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7faa50050810 con 0x7faa5406b2b0 2023-08-25T05:18:38.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.625+0000 7faa5b488640 1 -- 172.21.15.55:0/3145923519 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa5404dbe0 con 0x7faa5406b2b0 2023-08-25T05:18:38.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.625+0000 7faa49ffb640 1 -- 172.21.15.55:0/3145923519 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+14661 (secure 0 0 0) 0x7faa50053e30 con 0x7faa5406b2b0 2023-08-25T05:18:38.628 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:38.629 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":153,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:18:37.875373+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":134,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:18:38.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.625+0000 7faa5b488640 1 -- 172.21.15.55:0/3145923519 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7faa380657a0 msgr2=0x7faa38067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.625+0000 7faa5b488640 1 --2- 172.21.15.55:0/3145923519 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7faa380657a0 0x7faa38067c60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7faa44007fd0 tx=0x7faa44007c20 comp rx=0 tx=0).stop 2023-08-25T05:18:38.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.625+0000 7faa5b488640 1 -- 172.21.15.55:0/3145923519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa5406b2b0 msgr2=0x7faa540c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.625+0000 7faa5b488640 1 --2- 172.21.15.55:0/3145923519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa5406b2b0 0x7faa540c67a0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7faa5000c850 tx=0x7faa5000cd10 comp rx=0 tx=0).stop 2023-08-25T05:18:38.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.625+0000 7faa5b488640 1 -- 172.21.15.55:0/3145923519 shutdown_connections 2023-08-25T05:18:38.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.625+0000 7faa5b488640 1 --2- 172.21.15.55:0/3145923519 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7faa380657a0 0x7faa38067c60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.625+0000 7faa5b488640 1 --2- 172.21.15.55:0/3145923519 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa5415c9c0 0x7faa5414be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.625+0000 7faa5b488640 1 --2- 172.21.15.55:0/3145923519 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa540cfa70 0x7faa5414b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.625+0000 7faa5b488640 1 --2- 172.21.15.55:0/3145923519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa5406b2b0 0x7faa540c67a0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.625+0000 7faa5b488640 1 -- 172.21.15.55:0/3145923519 >> 172.21.15.55:0/3145923519 conn(0x7faa540d05a0 msgr2=0x7faa540ad470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:38.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.625+0000 7faa5b488640 1 -- 172.21.15.55:0/3145923519 shutdown_connections 2023-08-25T05:18:38.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.625+0000 7faa5b488640 1 -- 172.21.15.55:0/3145923519 wait complete. 2023-08-25T05:18:38.650 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T05:18:38.651 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T05:18:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.793+0000 7f078c744640 1 Processor -- start 2023-08-25T05:18:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.793+0000 7f078c744640 1 -- start start 2023-08-25T05:18:38.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.797+0000 7f078c744640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f078415a7f0 0x7f078409bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:38.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.797+0000 7f078c744640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078415abd0 con 0x7f078406c020 2023-08-25T05:18:38.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.797+0000 7f078c744640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07840c8ab0 con 0x7f07840c9830 2023-08-25T05:18:38.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.797+0000 7f078c744640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07840c8d50 con 0x7f078415a7f0 2023-08-25T05:18:38.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.797+0000 7f078ace1640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f078406c020 0x7f07840acff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55590/0 (socket says 172.21.15.55:55590) 2023-08-25T05:18:38.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.797+0000 7f078ace1640 1 -- 172.21.15.55:0/1632255745 learned_addr learned my addr 172.21.15.55:0/1632255745 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:38.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.797+0000 7f078a4e0640 1 --2- 172.21.15.55:0/1632255745 >> v2:172.21.15.110:3300/0 conn(0x7f078415a7f0 0x7f078409bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:38.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.797+0000 7f07894de640 1 -- 172.21.15.55:0/1632255745 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 190587277 0 0) 0x7f078415abd0 con 0x7f078406c020 2023-08-25T05:18:38.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.797+0000 7f07894de640 1 -- 172.21.15.55:0/1632255745 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0770003530 con 0x7f078406c020 2023-08-25T05:18:38.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.797+0000 7f07894de640 1 -- 172.21.15.55:0/1632255745 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4061185421 0 0) 0x7f0770003530 con 0x7f078406c020 2023-08-25T05:18:38.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.797+0000 7f078a4e0640 1 -- 172.21.15.55:0/1632255745 >> v1:172.21.15.110:6789/0 conn(0x7f07840c9830 legacy=0x7f0784070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.797+0000 7f078a4e0640 1 -- 172.21.15.55:0/1632255745 >> v1:172.21.15.55:6789/0 conn(0x7f078406c020 legacy=0x7f07840acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.797+0000 7f078a4e0640 1 -- 172.21.15.55:0/1632255745 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07840c9030 con 0x7f078415a7f0 2023-08-25T05:18:38.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f078a4e0640 1 --2- 172.21.15.55:0/1632255745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078415a7f0 0x7f078409bde0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f07800097a0 tx=0x7f078001c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a425e200d59c4b35 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:38.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f07894de640 1 -- 172.21.15.55:0/1632255745 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c001a00 con 0x7f078415a7f0 2023-08-25T05:18:38.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f07894de640 1 -- 172.21.15.55:0/1632255745 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07800a7050 con 0x7f078415a7f0 2023-08-25T05:18:38.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f07894de640 1 -- 172.21.15.55:0/1632255745 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07800ab620 con 0x7f078415a7f0 2023-08-25T05:18:38.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f078c744640 1 -- 172.21.15.55:0/1632255745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078415a7f0 msgr2=0x7f078409bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f078c744640 1 --2- 172.21.15.55:0/1632255745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078415a7f0 0x7f078409bde0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f07800097a0 tx=0x7f078001c350 comp rx=0 tx=0).stop 2023-08-25T05:18:38.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f078c744640 1 -- 172.21.15.55:0/1632255745 shutdown_connections 2023-08-25T05:18:38.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f078c744640 1 --2- 172.21.15.55:0/1632255745 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078415a7f0 0x7f078409bde0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f078c744640 1 -- 172.21.15.55:0/1632255745 >> 172.21.15.55:0/1632255745 conn(0x7f0784069900 msgr2=0x7f0784069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:38.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f078c744640 1 -- 172.21.15.55:0/1632255745 shutdown_connections 2023-08-25T05:18:38.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f078c744640 1 -- 172.21.15.55:0/1632255745 wait complete. 2023-08-25T05:18:38.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f078c744640 1 Processor -- start 2023-08-25T05:18:38.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f078c744640 1 -- start start 2023-08-25T05:18:38.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f078c744640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f078406c020 0x7f0784152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:38.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f078c744640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07840c9830 0x7f07841f8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:38.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f078c744640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078415a7f0 0x7f07840b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:38.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f078c744640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078415ea40 con 0x7f078406c020 2023-08-25T05:18:38.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f078c744640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0784158070 con 0x7f078415a7f0 2023-08-25T05:18:38.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f078c744640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07841f98a0 con 0x7f07840c9830 2023-08-25T05:18:38.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.801+0000 7f078a4e0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f078406c020 0x7f0784152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:38.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.805+0000 7f078a4e0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f078406c020 0x7f0784152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36110/0 (socket says 172.21.15.55:36110) 2023-08-25T05:18:38.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.805+0000 7f078a4e0640 1 -- 172.21.15.55:0/3900220603 learned_addr learned my addr 172.21.15.55:0/3900220603 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:38.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.805+0000 7f078ace1640 1 --2- 172.21.15.55:0/3900220603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078415a7f0 0x7f07840b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:38.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.805+0000 7f0789cdf640 1 --2- 172.21.15.55:0/3900220603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07840c9830 0x7f07841f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:38.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.805+0000 7f078a4e0640 1 -- 172.21.15.55:0/3900220603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07840c9830 msgr2=0x7f07841f8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.805+0000 7f078a4e0640 1 --2- 172.21.15.55:0/3900220603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07840c9830 0x7f07841f8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.805+0000 7f078a4e0640 1 -- 172.21.15.55:0/3900220603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078415a7f0 msgr2=0x7f07840b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.805+0000 7f078a4e0640 1 --2- 172.21.15.55:0/3900220603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078415a7f0 0x7f07840b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.805+0000 7f078a4e0640 1 -- 172.21.15.55:0/3900220603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07800093b0 con 0x7f078406c020 2023-08-25T05:18:38.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.805+0000 7f0789cdf640 1 --2- 172.21.15.55:0/3900220603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07840c9830 0x7f07841f8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:18:38.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.805+0000 7f078a4e0640 1 --2- 172.21.15.55:0/3900220603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f078406c020 0x7f0784152650 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f07800ae040 tx=0x7f078001ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:38.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.805+0000 7f077affd640 1 -- 172.21.15.55:0/3900220603 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07800059a0 con 0x7f078406c020 2023-08-25T05:18:38.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.805+0000 7f077affd640 1 -- 172.21.15.55:0/3900220603 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0780005b00 con 0x7f078406c020 2023-08-25T05:18:38.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.805+0000 7f077affd640 1 -- 172.21.15.55:0/3900220603 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0780005e70 con 0x7f078406c020 2023-08-25T05:18:38.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.805+0000 7f078c744640 1 -- 172.21.15.55:0/3900220603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07840adc90 con 0x7f078406c020 2023-08-25T05:18:38.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.805+0000 7f078c744640 1 -- 172.21.15.55:0/3900220603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0784158280 con 0x7f078406c020 2023-08-25T05:18:38.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.805+0000 7f078c744640 1 -- 172.21.15.55:0/3900220603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078406d5b0 con 0x7f078406c020 2023-08-25T05:18:38.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.805+0000 7f077affd640 1 -- 172.21.15.55:0/3900220603 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f0780006020 con 0x7f078406c020 2023-08-25T05:18:38.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.809+0000 7f077affd640 1 --2- 172.21.15.55:0/3900220603 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f07680657a0 0x7f0768067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:38.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.809+0000 7f077affd640 1 -- 172.21.15.55:0/3900220603 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f078011c720 con 0x7f078406c020 2023-08-25T05:18:38.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.809+0000 7f0789cdf640 1 --2- 172.21.15.55:0/3900220603 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f07680657a0 0x7f0768067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:38.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.809+0000 7f0789cdf640 1 --2- 172.21.15.55:0/3900220603 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f07680657a0 0x7f0768067c60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0784166100 tx=0x7f0774009040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:38.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.813+0000 7f077affd640 1 -- 172.21.15.55:0/3900220603 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f07800ea280 con 0x7f078406c020 2023-08-25T05:18:38.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.973+0000 7f078c744640 1 -- 172.21.15.55:0/3900220603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0784073ec0 con 0x7f078406c020 2023-08-25T05:18:38.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.973+0000 7f077affd640 1 -- 172.21.15.55:0/3900220603 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v153) v1 ==== 93+0+10 (secure 0 0 0) 0x7f07800ed8a0 con 0x7f078406c020 2023-08-25T05:18:38.975 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T05:18:38.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.973+0000 7f078c744640 1 -- 172.21.15.55:0/3900220603 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f07680657a0 msgr2=0x7f0768067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.973+0000 7f078c744640 1 --2- 172.21.15.55:0/3900220603 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f07680657a0 0x7f0768067c60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0784166100 tx=0x7f0774009040 comp rx=0 tx=0).stop 2023-08-25T05:18:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.973+0000 7f078c744640 1 -- 172.21.15.55:0/3900220603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f078406c020 msgr2=0x7f0784152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.973+0000 7f078c744640 1 --2- 172.21.15.55:0/3900220603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f078406c020 0x7f0784152650 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f07800ae040 tx=0x7f078001ab90 comp rx=0 tx=0).stop 2023-08-25T05:18:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.973+0000 7f078c744640 1 -- 172.21.15.55:0/3900220603 shutdown_connections 2023-08-25T05:18:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.973+0000 7f078c744640 1 --2- 172.21.15.55:0/3900220603 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f07680657a0 0x7f0768067c60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.973+0000 7f078c744640 1 --2- 172.21.15.55:0/3900220603 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f078415a7f0 0x7f07840b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.973+0000 7f078c744640 1 --2- 172.21.15.55:0/3900220603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07840c9830 0x7f07841f8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.973+0000 7f078c744640 1 --2- 172.21.15.55:0/3900220603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f078406c020 0x7f0784152650 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:38.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.973+0000 7f078c744640 1 -- 172.21.15.55:0/3900220603 >> 172.21.15.55:0/3900220603 conn(0x7f0784069900 msgr2=0x7f07840ade20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:38.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.973+0000 7f078c744640 1 -- 172.21.15.55:0/3900220603 shutdown_connections 2023-08-25T05:18:38.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:38.973+0000 7f078c744640 1 -- 172.21.15.55:0/3900220603 wait complete. 2023-08-25T05:18:38.997 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T05:18:39.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.141+0000 7f2e8209c640 1 Processor -- start 2023-08-25T05:18:39.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.141+0000 7f2e8209c640 1 -- start start 2023-08-25T05:18:39.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.141+0000 7f2e8209c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2e7c1601f0 0x7f2e7c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:39.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.141+0000 7f2e8209c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e7c15e3c0 0x7f2e7c0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:39.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.141+0000 7f2e8209c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7c15f8b0 con 0x7f2e7c0d10c0 2023-08-25T05:18:39.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.141+0000 7f2e8209c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7c0cd5a0 con 0x7f2e7c1601f0 2023-08-25T05:18:39.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.141+0000 7f2e8209c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c0cd880 con 0x7f2e7c15e3c0 2023-08-25T05:18:39.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.141+0000 7f2e7b7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2e7c1601f0 0x7f2e7c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:39.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.141+0000 7f2e73fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e7c15e3c0 0x7f2e7c0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:39.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.141+0000 7f2e73fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e7c15e3c0 0x7f2e7c0d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:57120/0 (socket says 172.21.15.55:57120) 2023-08-25T05:18:39.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.141+0000 7f2e7b7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2e7c1601f0 0x7f2e7c15d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:59816/0 (socket says 172.21.15.55:59816) 2023-08-25T05:18:39.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.141+0000 7f2e73fff640 1 -- 172.21.15.55:0/699423611 learned_addr learned my addr 172.21.15.55:0/699423611 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:39.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.145+0000 7f2e7b7fe640 1 -- 172.21.15.55:0/699423611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e7c15e3c0 msgr2=0x7f2e7c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:39.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.145+0000 7f2e7b7fe640 1 --2- 172.21.15.55:0/699423611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e7c15e3c0 0x7f2e7c0d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.145+0000 7f2e7b7fe640 1 -- 172.21.15.55:0/699423611 >> v1:172.21.15.110:6789/0 conn(0x7f2e7c0d10c0 legacy=0x7f2e7c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:39.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.145+0000 7f2e7b7fe640 1 -- 172.21.15.55:0/699423611 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c0cdb60 con 0x7f2e7c1601f0 2023-08-25T05:18:39.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.145+0000 7f2e73fff640 1 --2- 172.21.15.55:0/699423611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e7c15e3c0 0x7f2e7c0d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:18:39.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.145+0000 7f2e7b7fe640 1 --2- 172.21.15.55:0/699423611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c1601f0 0x7f2e7c15d430 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0097a0 tx=0x7f2e6c01ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9ad9d72c3c4cc1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.145+0000 7f2e7affd640 1 -- 172.21.15.55:0/699423611 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c0a8950 con 0x7f2e7c1601f0 2023-08-25T05:18:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.145+0000 7f2e7affd640 1 -- 172.21.15.55:0/699423611 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6c0a8ab0 con 0x7f2e7c1601f0 2023-08-25T05:18:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.145+0000 7f2e7affd640 1 -- 172.21.15.55:0/699423611 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c0a8e40 con 0x7f2e7c1601f0 2023-08-25T05:18:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.145+0000 7f2e8209c640 1 -- 172.21.15.55:0/699423611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c1601f0 msgr2=0x7f2e7c15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:39.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.145+0000 7f2e8209c640 1 --2- 172.21.15.55:0/699423611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c1601f0 0x7f2e7c15d430 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0097a0 tx=0x7f2e6c01ec50 comp rx=0 tx=0).stop 2023-08-25T05:18:39.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e8209c640 1 -- 172.21.15.55:0/699423611 shutdown_connections 2023-08-25T05:18:39.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e8209c640 1 --2- 172.21.15.55:0/699423611 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e7c15e3c0 0x7f2e7c0d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e8209c640 1 --2- 172.21.15.55:0/699423611 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c1601f0 0x7f2e7c15d430 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e8209c640 1 -- 172.21.15.55:0/699423611 >> 172.21.15.55:0/699423611 conn(0x7f2e7c0d27d0 msgr2=0x7f2e7c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:39.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e8209c640 1 -- 172.21.15.55:0/699423611 shutdown_connections 2023-08-25T05:18:39.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e8209c640 1 -- 172.21.15.55:0/699423611 wait complete. 2023-08-25T05:18:39.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e8209c640 1 Processor -- start 2023-08-25T05:18:39.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e8209c640 1 -- start start 2023-08-25T05:18:39.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e8209c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e7c0d10c0 0x7f2e7c14fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:39.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e8209c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e7c15e3c0 0x7f2e7c0c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:39.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e8209c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c1601f0 0x7f2e7c0c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:39.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e8209c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c1f39e0 con 0x7f2e7c15e3c0 2023-08-25T05:18:39.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e8209c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c1f2e10 con 0x7f2e7c1601f0 2023-08-25T05:18:39.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e8209c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c1f30b0 con 0x7f2e7c0d10c0 2023-08-25T05:18:39.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e73fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e7c15e3c0 0x7f2e7c0c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:39.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e7b7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e7c0d10c0 0x7f2e7c14fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:39.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e7b7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e7c0d10c0 0x7f2e7c14fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:57134/0 (socket says 172.21.15.55:57134) 2023-08-25T05:18:39.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e7b7fe640 1 -- 172.21.15.55:0/396990838 learned_addr learned my addr 172.21.15.55:0/396990838 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:39.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e7bfff640 1 --2- 172.21.15.55:0/396990838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c1601f0 0x7f2e7c0c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:39.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e73fff640 1 -- 172.21.15.55:0/396990838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e7c0d10c0 msgr2=0x7f2e7c14fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:39.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e73fff640 1 --2- 172.21.15.55:0/396990838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e7c0d10c0 0x7f2e7c14fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e73fff640 1 -- 172.21.15.55:0/396990838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c1601f0 msgr2=0x7f2e7c0c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:39.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e73fff640 1 --2- 172.21.15.55:0/396990838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c1601f0 0x7f2e7c0c6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e73fff640 1 -- 172.21.15.55:0/396990838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e640094d0 con 0x7f2e7c15e3c0 2023-08-25T05:18:39.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.149+0000 7f2e73fff640 1 --2- 172.21.15.55:0/396990838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e7c15e3c0 0x7f2e7c0c8ee0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400e910 tx=0x7f2e6400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:39.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.153+0000 7f2e78ff9640 1 -- 172.21.15.55:0/396990838 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6400ca00 con 0x7f2e7c15e3c0 2023-08-25T05:18:39.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.153+0000 7f2e78ff9640 1 -- 172.21.15.55:0/396990838 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6400cb60 con 0x7f2e7c15e3c0 2023-08-25T05:18:39.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.153+0000 7f2e78ff9640 1 -- 172.21.15.55:0/396990838 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64004030 con 0x7f2e7c15e3c0 2023-08-25T05:18:39.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.153+0000 7f2e8209c640 1 -- 172.21.15.55:0/396990838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6c0093b0 con 0x7f2e7c15e3c0 2023-08-25T05:18:39.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.153+0000 7f2e8209c640 1 -- 172.21.15.55:0/396990838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7c1f3670 con 0x7f2e7c15e3c0 2023-08-25T05:18:39.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.153+0000 7f2e8209c640 1 -- 172.21.15.55:0/396990838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7c0b63e0 con 0x7f2e7c15e3c0 2023-08-25T05:18:39.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.153+0000 7f2e78ff9640 1 -- 172.21.15.55:0/396990838 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f2e64004190 con 0x7f2e7c15e3c0 2023-08-25T05:18:39.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.153+0000 7f2e78ff9640 1 --2- 172.21.15.55:0/396990838 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f2e5c0657a0 0x7f2e5c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:39.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.153+0000 7f2e78ff9640 1 -- 172.21.15.55:0/396990838 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2e64082f80 con 0x7f2e7c15e3c0 2023-08-25T05:18:39.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.153+0000 7f2e7b7fe640 1 --2- 172.21.15.55:0/396990838 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f2e5c0657a0 0x7f2e5c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:39.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.157+0000 7f2e7b7fe640 1 --2- 172.21.15.55:0/396990838 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f2e5c0657a0 0x7f2e5c067c60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c01ec90 tx=0x7f2e6c0aa070 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:39.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.157+0000 7f2e78ff9640 1 -- 172.21.15.55:0/396990838 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2e64050d20 con 0x7f2e7c15e3c0 2023-08-25T05:18:39.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.313+0000 7f2e8209c640 1 -- 172.21.15.55:0/396990838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2e7c073ec0 con 0x7f2e7c15e3c0 2023-08-25T05:18:39.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.313+0000 7f2e78ff9640 1 -- 172.21.15.55:0/396990838 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v153) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2e64054340 con 0x7f2e7c15e3c0 2023-08-25T05:18:39.317 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T05:18:39.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.317+0000 7f2e8209c640 1 -- 172.21.15.55:0/396990838 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f2e5c0657a0 msgr2=0x7f2e5c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:39.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.317+0000 7f2e8209c640 1 --2- 172.21.15.55:0/396990838 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f2e5c0657a0 0x7f2e5c067c60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c01ec90 tx=0x7f2e6c0aa070 comp rx=0 tx=0).stop 2023-08-25T05:18:39.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.317+0000 7f2e8209c640 1 -- 172.21.15.55:0/396990838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e7c15e3c0 msgr2=0x7f2e7c0c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:39.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.317+0000 7f2e8209c640 1 --2- 172.21.15.55:0/396990838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e7c15e3c0 0x7f2e7c0c8ee0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400e910 tx=0x7f2e6400edd0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.317+0000 7f2e8209c640 1 -- 172.21.15.55:0/396990838 shutdown_connections 2023-08-25T05:18:39.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.317+0000 7f2e8209c640 1 --2- 172.21.15.55:0/396990838 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f2e5c0657a0 0x7f2e5c067c60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.317+0000 7f2e8209c640 1 --2- 172.21.15.55:0/396990838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e7c1601f0 0x7f2e7c0c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.317+0000 7f2e8209c640 1 --2- 172.21.15.55:0/396990838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e7c15e3c0 0x7f2e7c0c8ee0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.317+0000 7f2e8209c640 1 --2- 172.21.15.55:0/396990838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e7c0d10c0 0x7f2e7c14fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.317+0000 7f2e8209c640 1 -- 172.21.15.55:0/396990838 >> 172.21.15.55:0/396990838 conn(0x7f2e7c0d27d0 msgr2=0x7f2e7c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:39.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.317+0000 7f2e8209c640 1 -- 172.21.15.55:0/396990838 shutdown_connections 2023-08-25T05:18:39.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.317+0000 7f2e8209c640 1 -- 172.21.15.55:0/396990838 wait complete. 2023-08-25T05:18:39.339 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-25T05:18:39.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.477+0000 7fdea77d2640 1 Processor -- start 2023-08-25T05:18:39.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.477+0000 7fdea77d2640 1 -- start start 2023-08-25T05:18:39.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.481+0000 7fdea77d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdea00cd360 0x7fdea006dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:39.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.481+0000 7fdea77d2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea00ce170 con 0x7fdea00ccf20 2023-08-25T05:18:39.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.481+0000 7fdea77d2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea00ce3a0 con 0x7fdea015a830 2023-08-25T05:18:39.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.481+0000 7fdea77d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea00ce660 con 0x7fdea00cd360 2023-08-25T05:18:39.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.481+0000 7fdea5d6f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdea00cd360 0x7fdea006dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:39.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.481+0000 7fdea5d6f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdea00cd360 0x7fdea006dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36134/0 (socket says 172.21.15.55:36134) 2023-08-25T05:18:39.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.481+0000 7fdea5d6f640 1 -- 172.21.15.55:0/2336884785 learned_addr learned my addr 172.21.15.55:0/2336884785 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:39.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.481+0000 7fdea4d6d640 1 --1- 172.21.15.55:0/2336884785 >> v1:172.21.15.55:6789/0 conn(0x7fdea00ccf20 0x7fdea006d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55602/0 (socket says 172.21.15.55:55602) 2023-08-25T05:18:39.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.481+0000 7fdea5d6f640 1 -- 172.21.15.55:0/2336884785 >> v1:172.21.15.110:6789/0 conn(0x7fdea015a830 legacy=0x7fdea00cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:39.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.481+0000 7fdea5d6f640 1 -- 172.21.15.55:0/2336884785 >> v1:172.21.15.55:6789/0 conn(0x7fdea00ccf20 legacy=0x7fdea006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:39.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.481+0000 7fde97fff640 1 -- 172.21.15.55:0/2336884785 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521881548 0 0) 0x7fdea00ce170 con 0x7fdea00ccf20 2023-08-25T05:18:39.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.481+0000 7fdea5d6f640 1 -- 172.21.15.55:0/2336884785 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea00ce940 con 0x7fdea00cd360 2023-08-25T05:18:39.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.485+0000 7fdea5d6f640 1 --2- 172.21.15.55:0/2336884785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea00cd360 0x7fdea006dc60 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fde98009e50 tx=0x7fde9801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26fe3c175e3dcf0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:39.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.485+0000 7fde97fff640 1 -- 172.21.15.55:0/2336884785 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde980a58a0 con 0x7fdea00cd360 2023-08-25T05:18:39.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.485+0000 7fde97fff640 1 -- 172.21.15.55:0/2336884785 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde980a5a00 con 0x7fdea00cd360 2023-08-25T05:18:39.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.485+0000 7fde97fff640 1 -- 172.21.15.55:0/2336884785 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde980a5d90 con 0x7fdea00cd360 2023-08-25T05:18:39.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.485+0000 7fdea77d2640 1 -- 172.21.15.55:0/2336884785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea00cd360 msgr2=0x7fdea006dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:39.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.485+0000 7fdea77d2640 1 --2- 172.21.15.55:0/2336884785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea00cd360 0x7fdea006dc60 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fde98009e50 tx=0x7fde9801c9e0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.485+0000 7fdea77d2640 1 -- 172.21.15.55:0/2336884785 shutdown_connections 2023-08-25T05:18:39.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.485+0000 7fdea77d2640 1 --2- 172.21.15.55:0/2336884785 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea00cd360 0x7fdea006dc60 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.485+0000 7fdea77d2640 1 -- 172.21.15.55:0/2336884785 >> 172.21.15.55:0/2336884785 conn(0x7fdea00d05a0 msgr2=0x7fdea00d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:39.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.485+0000 7fdea77d2640 1 -- 172.21.15.55:0/2336884785 shutdown_connections 2023-08-25T05:18:39.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.485+0000 7fdea77d2640 1 -- 172.21.15.55:0/2336884785 wait complete. 2023-08-25T05:18:39.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.485+0000 7fdea77d2640 1 Processor -- start 2023-08-25T05:18:39.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.485+0000 7fdea77d2640 1 -- start start 2023-08-25T05:18:39.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea77d2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdea00ccf20 0x7fdea014a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:39.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea77d2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdea00cd360 0x7fdea014f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:39.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea77d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea015a830 0x7fdea014ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:39.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea77d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea0153900 con 0x7fdea015a830 2023-08-25T05:18:39.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea77d2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea014ad70 con 0x7fdea00cd360 2023-08-25T05:18:39.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea77d2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea0150cc0 con 0x7fdea00ccf20 2023-08-25T05:18:39.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea5d6f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea015a830 0x7fdea014ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:39.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea5d6f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea015a830 0x7fdea014ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36138/0 (socket says 172.21.15.55:36138) 2023-08-25T05:18:39.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea5d6f640 1 -- 172.21.15.55:0/2939827844 learned_addr learned my addr 172.21.15.55:0/2939827844 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:39.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea556e640 1 --2- 172.21.15.55:0/2939827844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdea00ccf20 0x7fdea014a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:39.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea4d6d640 1 --2- 172.21.15.55:0/2939827844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdea00cd360 0x7fdea014f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:39.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea5d6f640 1 -- 172.21.15.55:0/2939827844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdea00ccf20 msgr2=0x7fdea014a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:39.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea5d6f640 1 --2- 172.21.15.55:0/2939827844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdea00ccf20 0x7fdea014a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea5d6f640 1 -- 172.21.15.55:0/2939827844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdea00cd360 msgr2=0x7fdea014f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:39.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea5d6f640 1 --2- 172.21.15.55:0/2939827844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdea00cd360 0x7fdea014f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea5d6f640 1 -- 172.21.15.55:0/2939827844 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde98009b30 con 0x7fdea015a830 2023-08-25T05:18:39.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea4d6d640 1 --2- 172.21.15.55:0/2939827844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdea00cd360 0x7fdea014f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:39.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea5d6f640 1 --2- 172.21.15.55:0/2939827844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea015a830 0x7fdea014ff40 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fde980af040 tx=0x7fde98019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:39.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fde95ffb640 1 -- 172.21.15.55:0/2939827844 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde980b8880 con 0x7fdea015a830 2023-08-25T05:18:39.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fde95ffb640 1 -- 172.21.15.55:0/2939827844 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde980b8a00 con 0x7fdea015a830 2023-08-25T05:18:39.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fde95ffb640 1 -- 172.21.15.55:0/2939827844 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde980b8db0 con 0x7fdea015a830 2023-08-25T05:18:39.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea77d2640 1 -- 172.21.15.55:0/2939827844 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea0150fa0 con 0x7fdea015a830 2023-08-25T05:18:39.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea77d2640 1 -- 172.21.15.55:0/2939827844 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea014fc50 con 0x7fdea015a830 2023-08-25T05:18:39.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.489+0000 7fdea77d2640 1 -- 172.21.15.55:0/2939827844 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea0153a70 con 0x7fdea015a830 2023-08-25T05:18:39.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.493+0000 7fde95ffb640 1 -- 172.21.15.55:0/2939827844 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fde980b6440 con 0x7fdea015a830 2023-08-25T05:18:39.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.493+0000 7fde95ffb640 1 --2- 172.21.15.55:0/2939827844 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fde840657a0 0x7fde84067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:39.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.493+0000 7fde95ffb640 1 -- 172.21.15.55:0/2939827844 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fde9811d820 con 0x7fdea015a830 2023-08-25T05:18:39.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.493+0000 7fdea556e640 1 --2- 172.21.15.55:0/2939827844 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fde840657a0 0x7fde84067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:39.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.493+0000 7fdea556e640 1 --2- 172.21.15.55:0/2939827844 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fde840657a0 0x7fde84067c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fde9c000fc0 tx=0x7fde9c009040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:39.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.497+0000 7fde95ffb640 1 -- 172.21.15.55:0/2939827844 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fde980eb530 con 0x7fdea015a830 2023-08-25T05:18:39.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.653+0000 7fdea77d2640 1 -- 172.21.15.55:0/2939827844 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdea0151190 con 0x7fdea015a830 2023-08-25T05:18:39.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.653+0000 7fde95ffb640 1 -- 172.21.15.55:0/2939827844 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v153) v1 ==== 84+0+126 (secure 0 0 0) 0x7fde980eeb50 con 0x7fdea015a830 2023-08-25T05:18:39.658 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:39.659 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T05:18:39.659 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:39.659 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-08-25T05:18:39.659 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-08-25T05:18:39.659 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:18:39.659 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:39.660 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-08-25T05:18:39.660 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-08-25T05:18:39.660 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:39.660 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T05:18:39.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.657+0000 7fdea77d2640 1 -- 172.21.15.55:0/2939827844 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fde840657a0 msgr2=0x7fde84067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:39.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.657+0000 7fdea77d2640 1 --2- 172.21.15.55:0/2939827844 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fde840657a0 0x7fde84067c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fde9c000fc0 tx=0x7fde9c009040 comp rx=0 tx=0).stop 2023-08-25T05:18:39.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.657+0000 7fdea77d2640 1 -- 172.21.15.55:0/2939827844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea015a830 msgr2=0x7fdea014ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:39.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.657+0000 7fdea77d2640 1 --2- 172.21.15.55:0/2939827844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea015a830 0x7fdea014ff40 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fde980af040 tx=0x7fde98019780 comp rx=0 tx=0).stop 2023-08-25T05:18:39.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.657+0000 7fdea77d2640 1 -- 172.21.15.55:0/2939827844 shutdown_connections 2023-08-25T05:18:39.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.657+0000 7fdea77d2640 1 --2- 172.21.15.55:0/2939827844 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fde840657a0 0x7fde84067c60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.657+0000 7fdea77d2640 1 --2- 172.21.15.55:0/2939827844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdea015a830 0x7fdea014ff40 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.657+0000 7fdea77d2640 1 --2- 172.21.15.55:0/2939827844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdea00cd360 0x7fdea014f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.657+0000 7fdea77d2640 1 --2- 172.21.15.55:0/2939827844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdea00ccf20 0x7fdea014a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.657+0000 7fdea77d2640 1 -- 172.21.15.55:0/2939827844 >> 172.21.15.55:0/2939827844 conn(0x7fdea00d05a0 msgr2=0x7fdea014eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:39.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.657+0000 7fdea77d2640 1 -- 172.21.15.55:0/2939827844 shutdown_connections 2023-08-25T05:18:39.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.657+0000 7fdea77d2640 1 -- 172.21.15.55:0/2939827844 wait complete. 2023-08-25T05:18:39.680 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-25T05:18:39.681 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-25T05:18:39.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.825+0000 7f0f111ba640 1 Processor -- start 2023-08-25T05:18:39.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.825+0000 7f0f111ba640 1 -- start start 2023-08-25T05:18:39.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.825+0000 7f0f111ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0c0afa20 0x7f0f0c0b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:39.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.825+0000 7f0f111ba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0f0c0cf9b0 0x7f0f0c0ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:39.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.825+0000 7f0f111ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0f0c0cd160 0x7f0f0c0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:39.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.825+0000 7f0f111ba640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0c0cfe10 con 0x7f0f0c0cf9b0 2023-08-25T05:18:39.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.825+0000 7f0f111ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0c0cdb00 con 0x7f0f0c0cd160 2023-08-25T05:18:39.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.825+0000 7f0f111ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c0cae70 con 0x7f0f0c0afa20 2023-08-25T05:18:39.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.825+0000 7f0f03fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0f0c0cf9b0 0x7f0f0c0ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:39.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.825+0000 7f0f03fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0f0c0cf9b0 0x7f0f0c0ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36152/0 (socket says 172.21.15.55:36152) 2023-08-25T05:18:39.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.825+0000 7f0f03fff640 1 -- 172.21.15.55:0/1028089081 learned_addr learned my addr 172.21.15.55:0/1028089081 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:39.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.825+0000 7f0f03fff640 1 -- 172.21.15.55:0/1028089081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0c0afa20 msgr2=0x7f0f0c0b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:39.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.825+0000 7f0f03fff640 1 --2- 172.21.15.55:0/1028089081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0c0afa20 0x7f0f0c0b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.825+0000 7f0f03fff640 1 -- 172.21.15.55:0/1028089081 >> v2:172.21.15.110:3300/0 conn(0x7f0f0c0cd160 msgr2=0x7f0f0c0cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:39.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.825+0000 7f0f0b59e640 1 --2- 172.21.15.55:0/1028089081 >> v2:172.21.15.110:3300/0 conn(0x7f0f0c0cd160 0x7f0f0c0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:39.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.829+0000 7f0f03fff640 1 --2- 172.21.15.55:0/1028089081 >> v2:172.21.15.110:3300/0 conn(0x7f0f0c0cd160 0x7f0f0c0cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.829+0000 7f0f03fff640 1 -- 172.21.15.55:0/1028089081 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c0cb0e0 con 0x7f0f0c0cf9b0 2023-08-25T05:18:39.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.829+0000 7f0f0b59e640 1 --2- 172.21.15.55:0/1028089081 >> v2:172.21.15.110:3300/0 conn(0x7f0f0c0cd160 0x7f0f0c0cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:18:39.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.829+0000 7f0f03fff640 1 --2- 172.21.15.55:0/1028089081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0cf9b0 0x7f0f0c0ce9c0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c160730 tx=0x7f0ef401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e33356d4f2e8a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:39.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.829+0000 7f0f0a59c640 1 -- 172.21.15.55:0/1028089081 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef40ab600 con 0x7f0f0c0cf9b0 2023-08-25T05:18:39.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.829+0000 7f0f0a59c640 1 -- 172.21.15.55:0/1028089081 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef40ab760 con 0x7f0f0c0cf9b0 2023-08-25T05:18:39.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.829+0000 7f0f0a59c640 1 -- 172.21.15.55:0/1028089081 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef40abaf0 con 0x7f0f0c0cf9b0 2023-08-25T05:18:39.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.829+0000 7f0f111ba640 1 -- 172.21.15.55:0/1028089081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0cf9b0 msgr2=0x7f0f0c0ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:39.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.829+0000 7f0f111ba640 1 --2- 172.21.15.55:0/1028089081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0cf9b0 0x7f0f0c0ce9c0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c160730 tx=0x7f0ef401c440 comp rx=0 tx=0).stop 2023-08-25T05:18:39.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.829+0000 7f0f111ba640 1 -- 172.21.15.55:0/1028089081 shutdown_connections 2023-08-25T05:18:39.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.829+0000 7f0f111ba640 1 --2- 172.21.15.55:0/1028089081 >> v2:172.21.15.110:3300/0 conn(0x7f0f0c0cd160 0x7f0f0c0cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.829+0000 7f0f111ba640 1 --2- 172.21.15.55:0/1028089081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0cf9b0 0x7f0f0c0ce9c0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.829+0000 7f0f111ba640 1 --2- 172.21.15.55:0/1028089081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0c0afa20 0x7f0f0c0b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.829+0000 7f0f111ba640 1 -- 172.21.15.55:0/1028089081 >> 172.21.15.55:0/1028089081 conn(0x7f0f0c0d0780 msgr2=0x7f0f0c0d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:39.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.829+0000 7f0f111ba640 1 -- 172.21.15.55:0/1028089081 shutdown_connections 2023-08-25T05:18:39.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.829+0000 7f0f111ba640 1 -- 172.21.15.55:0/1028089081 wait complete. 2023-08-25T05:18:39.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f111ba640 1 Processor -- start 2023-08-25T05:18:39.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f111ba640 1 -- start start 2023-08-25T05:18:39.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f111ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0c0afa20 0x7f0f0c15bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:39.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f111ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0cd160 0x7f0f0c1f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:39.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f111ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f0c0cf9b0 0x7f0f0c0b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:39.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f111ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c152060 con 0x7f0f0c0cd160 2023-08-25T05:18:39.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f111ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c1f5df0 con 0x7f0f0c0cf9b0 2023-08-25T05:18:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f111ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c1f55a0 con 0x7f0f0c0afa20 2023-08-25T05:18:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f03fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0cd160 0x7f0f0c1f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f03fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0cd160 0x7f0f0c1f4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36160/0 (socket says 172.21.15.55:36160) 2023-08-25T05:18:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f03fff640 1 -- 172.21.15.55:0/3938806466 learned_addr learned my addr 172.21.15.55:0/3938806466 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f0ad9d640 1 --2- 172.21.15.55:0/3938806466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0c0afa20 0x7f0f0c15bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f0b59e640 1 --2- 172.21.15.55:0/3938806466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f0c0cf9b0 0x7f0f0c0b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f03fff640 1 -- 172.21.15.55:0/3938806466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0c0afa20 msgr2=0x7f0f0c15bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:39.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f03fff640 1 --2- 172.21.15.55:0/3938806466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0c0afa20 0x7f0f0c15bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f03fff640 1 -- 172.21.15.55:0/3938806466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f0c0cf9b0 msgr2=0x7f0f0c0b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:39.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f03fff640 1 --2- 172.21.15.55:0/3938806466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f0c0cf9b0 0x7f0f0c0b5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:39.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f03fff640 1 -- 172.21.15.55:0/3938806466 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef40094d0 con 0x7f0f0c0cd160 2023-08-25T05:18:39.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.833+0000 7f0f03fff640 1 --2- 172.21.15.55:0/3938806466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0cd160 0x7f0f0c1f4c30 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f0ef40ad040 tx=0x7f0ef401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:39.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.837+0000 7f0f037fe640 1 -- 172.21.15.55:0/3938806466 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef40b4800 con 0x7f0f0c0cd160 2023-08-25T05:18:39.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.837+0000 7f0f037fe640 1 -- 172.21.15.55:0/3938806466 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef40b4980 con 0x7f0f0c0cd160 2023-08-25T05:18:39.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.837+0000 7f0f037fe640 1 -- 172.21.15.55:0/3938806466 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef40b4d30 con 0x7f0f0c0cd160 2023-08-25T05:18:39.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.837+0000 7f0f111ba640 1 -- 172.21.15.55:0/3938806466 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0c1f5880 con 0x7f0f0c0cd160 2023-08-25T05:18:39.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.837+0000 7f0f111ba640 1 -- 172.21.15.55:0/3938806466 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0c151cf0 con 0x7f0f0c0cd160 2023-08-25T05:18:39.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.837+0000 7f0f111ba640 1 -- 172.21.15.55:0/3938806466 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0c04dbe0 con 0x7f0f0c0cd160 2023-08-25T05:18:39.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.837+0000 7f0f037fe640 1 -- 172.21.15.55:0/3938806466 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f0ef40b3380 con 0x7f0f0c0cd160 2023-08-25T05:18:39.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.837+0000 7f0f037fe640 1 --2- 172.21.15.55:0/3938806466 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f0eec0657a0 0x7f0eec067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:39.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.837+0000 7f0f037fe640 1 -- 172.21.15.55:0/3938806466 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0ef411d4b0 con 0x7f0f0c0cd160 2023-08-25T05:18:39.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.837+0000 7f0f0ad9d640 1 --2- 172.21.15.55:0/3938806466 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f0eec0657a0 0x7f0eec067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:39.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.841+0000 7f0f0ad9d640 1 --2- 172.21.15.55:0/3938806466 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f0eec0657a0 0x7f0eec067c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0098f0 tx=0x7f0efc006f90 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:39.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:39.841+0000 7f0f037fe640 1 -- 172.21.15.55:0/3938806466 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0ef40eb0b0 con 0x7f0f0c0cd160 2023-08-25T05:18:40.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:40.001+0000 7f0f111ba640 1 -- 172.21.15.55:0/3938806466 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0f0c0cde80 con 0x7f0f0c0cd160 2023-08-25T05:18:40.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:40.977+0000 7f0f037fe640 1 -- 172.21.15.55:0/3938806466 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v154) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0ef40ee6d0 con 0x7f0f0c0cd160 2023-08-25T05:18:40.980 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-08-25T05:18:40.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:40.981+0000 7f0f111ba640 1 -- 172.21.15.55:0/3938806466 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f0eec0657a0 msgr2=0x7f0eec067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:40.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:40.981+0000 7f0f111ba640 1 --2- 172.21.15.55:0/3938806466 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f0eec0657a0 0x7f0eec067c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0098f0 tx=0x7f0efc006f90 comp rx=0 tx=0).stop 2023-08-25T05:18:40.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:40.981+0000 7f0f111ba640 1 -- 172.21.15.55:0/3938806466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0cd160 msgr2=0x7f0f0c1f4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:40.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:40.985+0000 7f0f111ba640 1 --2- 172.21.15.55:0/3938806466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0cd160 0x7f0f0c1f4c30 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f0ef40ad040 tx=0x7f0ef401ac80 comp rx=0 tx=0).stop 2023-08-25T05:18:40.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:40.985+0000 7f0f111ba640 1 -- 172.21.15.55:0/3938806466 shutdown_connections 2023-08-25T05:18:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:40.985+0000 7f0f111ba640 1 --2- 172.21.15.55:0/3938806466 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f0eec0657a0 0x7f0eec067c60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:40.985+0000 7f0f111ba640 1 --2- 172.21.15.55:0/3938806466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0f0c0cf9b0 0x7f0f0c0b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:40.985+0000 7f0f111ba640 1 --2- 172.21.15.55:0/3938806466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0cd160 0x7f0f0c1f4c30 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:40.985+0000 7f0f111ba640 1 --2- 172.21.15.55:0/3938806466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0f0c0afa20 0x7f0f0c15bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:40.985+0000 7f0f111ba640 1 -- 172.21.15.55:0/3938806466 >> 172.21.15.55:0/3938806466 conn(0x7f0f0c0d0780 msgr2=0x7f0f0c154580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:40.985+0000 7f0f111ba640 1 -- 172.21.15.55:0/3938806466 shutdown_connections 2023-08-25T05:18:40.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:40.985+0000 7f0f111ba640 1 -- 172.21.15.55:0/3938806466 wait complete. 2023-08-25T05:18:41.010 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-25T05:18:41.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.213+0000 7f304b29e640 1 Processor -- start 2023-08-25T05:18:41.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f304b29e640 1 -- start start 2023-08-25T05:18:41.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f304b29e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f304406c3b0 0x7f30440cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:41.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f304b29e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f304406e5a0 0x7f30440ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:41.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f304b29e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30440cab90 con 0x7f304406c790 2023-08-25T05:18:41.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f304b29e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304406dbb0 con 0x7f304406e5a0 2023-08-25T05:18:41.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f304b29e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30440cae50 con 0x7f304406c3b0 2023-08-25T05:18:41.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f3048839640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f304406c790 0x7f304406de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34292/0 (socket says 172.21.15.55:34292) 2023-08-25T05:18:41.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f3048839640 1 -- 172.21.15.55:0/2775555806 learned_addr learned my addr 172.21.15.55:0/2775555806 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:41.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f304903a640 1 --2- 172.21.15.55:0/2775555806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f304406c3b0 0x7f30440cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:41.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f304983b640 1 --2- 172.21.15.55:0/2775555806 >> v2:172.21.15.110:3300/0 conn(0x7f304406e5a0 0x7f30440ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:41.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f303bfff640 1 -- 172.21.15.55:0/2775555806 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285820046 0 0) 0x7f30440cab90 con 0x7f304406c790 2023-08-25T05:18:41.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f303bfff640 1 -- 172.21.15.55:0/2775555806 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3030003530 con 0x7f304406c790 2023-08-25T05:18:41.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f303bfff640 1 -- 172.21.15.55:0/2775555806 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2993661343 0 0) 0x7f3030003530 con 0x7f304406c790 2023-08-25T05:18:41.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f303bfff640 1 -- 172.21.15.55:0/2775555806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f304406c3b0 msgr2=0x7f30440cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:41.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f303bfff640 1 --2- 172.21.15.55:0/2775555806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f304406c3b0 0x7f30440cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:41.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f303bfff640 1 -- 172.21.15.55:0/2775555806 >> v2:172.21.15.110:3300/0 conn(0x7f304406e5a0 msgr2=0x7f30440ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:41.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f303bfff640 1 --2- 172.21.15.55:0/2775555806 >> v2:172.21.15.110:3300/0 conn(0x7f304406e5a0 0x7f30440ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:41.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f303bfff640 1 -- 172.21.15.55:0/2775555806 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30440cb130 con 0x7f304406c790 2023-08-25T05:18:41.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f303bfff640 1 -- 172.21.15.55:0/2775555806 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f3034001680 con 0x7f304406c790 2023-08-25T05:18:41.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f303bfff640 1 -- 172.21.15.55:0/2775555806 >> v1:172.21.15.55:6789/0 conn(0x7f304406c790 legacy=0x7f304406de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:41.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f303bfff640 1 --2- 172.21.15.55:0/2775555806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3030003980 0x7f3030003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:41.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f303bfff640 1 --2- 172.21.15.55:0/2775555806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f304406c3b0 0x7f30300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:41.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f303bfff640 1 --2- 172.21.15.55:0/2775555806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3030004d10 0x7f3030005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:41.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f303bfff640 1 -- 172.21.15.55:0/2775555806 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304406dbb0 con 0x7f3030004d10 2023-08-25T05:18:41.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f303bfff640 1 -- 172.21.15.55:0/2775555806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30440cae50 con 0x7f3030003980 2023-08-25T05:18:41.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f303bfff640 1 -- 172.21.15.55:0/2775555806 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303000b990 con 0x7f304406c3b0 2023-08-25T05:18:41.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f3048839640 1 --2- 172.21.15.55:0/2775555806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f304406c3b0 0x7f30300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:41.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f304903a640 1 --2- 172.21.15.55:0/2775555806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3030003980 0x7f3030003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:41.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f304983b640 1 --2- 172.21.15.55:0/2775555806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3030004d10 0x7f3030005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:41.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f3048839640 1 -- 172.21.15.55:0/2775555806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3030003980 msgr2=0x7f3030003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:41.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f3048839640 1 --2- 172.21.15.55:0/2775555806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3030003980 0x7f3030003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:41.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f3048839640 1 -- 172.21.15.55:0/2775555806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3030004d10 msgr2=0x7f3030005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:41.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f3048839640 1 --2- 172.21.15.55:0/2775555806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3030004d10 0x7f3030005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:41.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.217+0000 7f3048839640 1 -- 172.21.15.55:0/2775555806 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3030003530 con 0x7f304406c3b0 2023-08-25T05:18:41.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.221+0000 7f3048839640 1 --2- 172.21.15.55:0/2775555806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f304406c3b0 0x7f30300047d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f303400c210 tx=0x7f303401cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98777e60b83892fa server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:41.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.221+0000 7f303bfff640 1 -- 172.21.15.55:0/2775555806 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30340a5940 con 0x7f304406c3b0 2023-08-25T05:18:41.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.221+0000 7f303bfff640 1 -- 172.21.15.55:0/2775555806 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30340a5aa0 con 0x7f304406c3b0 2023-08-25T05:18:41.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.221+0000 7f303bfff640 1 -- 172.21.15.55:0/2775555806 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30340a5e70 con 0x7f304406c3b0 2023-08-25T05:18:41.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.221+0000 7f304b29e640 1 -- 172.21.15.55:0/2775555806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f304406c3b0 msgr2=0x7f30300047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:41.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.221+0000 7f304b29e640 1 --2- 172.21.15.55:0/2775555806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f304406c3b0 0x7f30300047d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f303400c210 tx=0x7f303401cc40 comp rx=0 tx=0).stop 2023-08-25T05:18:41.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.221+0000 7f304983b640 1 -- 172.21.15.55:0/2775555806 reap_dead start 2023-08-25T05:18:41.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.221+0000 7f304b29e640 1 -- 172.21.15.55:0/2775555806 shutdown_connections 2023-08-25T05:18:41.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.221+0000 7f304b29e640 1 -- 172.21.15.55:0/2775555806 >> 172.21.15.55:0/2775555806 conn(0x7f30440d0540 msgr2=0x7f30440d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:41.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.221+0000 7f304b29e640 1 -- 172.21.15.55:0/2775555806 shutdown_connections 2023-08-25T05:18:41.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.221+0000 7f304b29e640 1 -- 172.21.15.55:0/2775555806 wait complete. 2023-08-25T05:18:41.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304b29e640 1 Processor -- start 2023-08-25T05:18:41.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304b29e640 1 -- start start 2023-08-25T05:18:41.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304b29e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f304406c3b0 0x7f304415dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:41.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304b29e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30440c8470 0x7f30440c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:41.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304b29e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30440c6c20 0x7f30440cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:41.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304b29e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30441f5c60 con 0x7f30440c6c20 2023-08-25T05:18:41.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304b29e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30441f5090 con 0x7f30440c8470 2023-08-25T05:18:41.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304b29e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304415e130 con 0x7f304406c3b0 2023-08-25T05:18:41.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304983b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30440c6c20 0x7f30440cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:41.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304983b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30440c6c20 0x7f30440cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45742/0 (socket says 172.21.15.55:45742) 2023-08-25T05:18:41.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304983b640 1 -- 172.21.15.55:0/2545814136 learned_addr learned my addr 172.21.15.55:0/2545814136 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:41.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f3048839640 1 --2- 172.21.15.55:0/2545814136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30440c8470 0x7f30440c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:41.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304903a640 1 --2- 172.21.15.55:0/2545814136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f304406c3b0 0x7f304415dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:41.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304983b640 1 -- 172.21.15.55:0/2545814136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f304406c3b0 msgr2=0x7f304415dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:41.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304983b640 1 --2- 172.21.15.55:0/2545814136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f304406c3b0 0x7f304415dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:41.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304983b640 1 -- 172.21.15.55:0/2545814136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30440c8470 msgr2=0x7f30440c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:41.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304983b640 1 --2- 172.21.15.55:0/2545814136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30440c8470 0x7f30440c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:41.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304983b640 1 -- 172.21.15.55:0/2545814136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30441f5330 con 0x7f30440c6c20 2023-08-25T05:18:41.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f3048839640 1 --2- 172.21.15.55:0/2545814136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30440c8470 0x7f30440c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:18:41.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304983b640 1 --2- 172.21.15.55:0/2545814136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30440c6c20 0x7f30440cb830 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f30440715c0 tx=0x7f303c00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:41.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f3039ffb640 1 -- 172.21.15.55:0/2545814136 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c00e040 con 0x7f30440c6c20 2023-08-25T05:18:41.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f3039ffb640 1 -- 172.21.15.55:0/2545814136 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c00f040 con 0x7f30440c6c20 2023-08-25T05:18:41.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f3039ffb640 1 -- 172.21.15.55:0/2545814136 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c015430 con 0x7f30440c6c20 2023-08-25T05:18:41.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304b29e640 1 -- 172.21.15.55:0/2545814136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30441f5610 con 0x7f30440c6c20 2023-08-25T05:18:41.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.225+0000 7f304b29e640 1 -- 172.21.15.55:0/2545814136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304415e520 con 0x7f30440c6c20 2023-08-25T05:18:41.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.229+0000 7f304b29e640 1 -- 172.21.15.55:0/2545814136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30441f5dd0 con 0x7f30440c6c20 2023-08-25T05:18:41.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.229+0000 7f3039ffb640 1 -- 172.21.15.55:0/2545814136 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f303c015590 con 0x7f30440c6c20 2023-08-25T05:18:41.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.229+0000 7f3039ffb640 1 --2- 172.21.15.55:0/2545814136 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f30280657a0 0x7f3028067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:41.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.229+0000 7f3039ffb640 1 -- 172.21.15.55:0/2545814136 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f303c083500 con 0x7f30440c6c20 2023-08-25T05:18:41.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.229+0000 7f304903a640 1 --2- 172.21.15.55:0/2545814136 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f30280657a0 0x7f3028067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:41.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.229+0000 7f304903a640 1 --2- 172.21.15.55:0/2545814136 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f30280657a0 0x7f3028067c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3040009a60 tx=0x7f3040006f90 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:41.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.233+0000 7f3039ffb640 1 -- 172.21.15.55:0/2545814136 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f303c050f70 con 0x7f30440c6c20 2023-08-25T05:18:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.389+0000 7f304b29e640 1 -- 172.21.15.55:0/2545814136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3044073ec0 con 0x7f30440c6c20 2023-08-25T05:18:41.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.981+0000 7f3039ffb640 1 -- 172.21.15.55:0/2545814136 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v155) v1 ==== 170+0+0 (secure 0 0 0) 0x7f303c054590 con 0x7f30440c6c20 2023-08-25T05:18:41.983 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-08-25T05:18:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.997+0000 7f304b29e640 1 -- 172.21.15.55:0/2545814136 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f30280657a0 msgr2=0x7f3028067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:41.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.997+0000 7f304b29e640 1 --2- 172.21.15.55:0/2545814136 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f30280657a0 0x7f3028067c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3040009a60 tx=0x7f3040006f90 comp rx=0 tx=0).stop 2023-08-25T05:18:42.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.997+0000 7f304b29e640 1 -- 172.21.15.55:0/2545814136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30440c6c20 msgr2=0x7f30440cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:42.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.997+0000 7f304b29e640 1 --2- 172.21.15.55:0/2545814136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30440c6c20 0x7f30440cb830 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f30440715c0 tx=0x7f303c00f1b0 comp rx=0 tx=0).stop 2023-08-25T05:18:42.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.997+0000 7f304b29e640 1 -- 172.21.15.55:0/2545814136 shutdown_connections 2023-08-25T05:18:42.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.997+0000 7f304b29e640 1 --2- 172.21.15.55:0/2545814136 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f30280657a0 0x7f3028067c60 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3040009a60 tx=0x7f3040006f90 comp rx=0 tx=0).stop 2023-08-25T05:18:42.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.997+0000 7f304b29e640 1 --2- 172.21.15.55:0/2545814136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30440c6c20 0x7f30440cb830 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:42.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.997+0000 7f304b29e640 1 --2- 172.21.15.55:0/2545814136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f30440c8470 0x7f30440c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:42.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.997+0000 7f304b29e640 1 --2- 172.21.15.55:0/2545814136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f304406c3b0 0x7f304415dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:42.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:41.997+0000 7f304b29e640 1 -- 172.21.15.55:0/2545814136 >> 172.21.15.55:0/2545814136 conn(0x7f30440d0540 msgr2=0x7f30440b1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:42.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.001+0000 7f304b29e640 1 -- 172.21.15.55:0/2545814136 shutdown_connections 2023-08-25T05:18:42.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.001+0000 7f304b29e640 1 -- 172.21.15.55:0/2545814136 wait complete. 2023-08-25T05:18:42.027 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-25T05:18:42.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.169+0000 7fe0fdc26640 1 Processor -- start 2023-08-25T05:18:42.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.169+0000 7fe0fdc26640 1 -- start start 2023-08-25T05:18:42.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.173+0000 7fe0fdc26640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe0f80cc8b0 0x7fe0f806b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:42.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.173+0000 7fe0fdc26640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe0f806bde0 0x7fe0f8070810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:42.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.173+0000 7fe0fdc26640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f806c220 con 0x7fe0f815c890 2023-08-25T05:18:42.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.173+0000 7fe0fdc26640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f80cdce0 con 0x7fe0f80cc8b0 2023-08-25T05:18:42.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.173+0000 7fe0fdc26640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f80cbdf0 con 0x7fe0f806bde0 2023-08-25T05:18:42.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.173+0000 7fe0effff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe0f80cc8b0 0x7fe0f806b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:42.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.173+0000 7fe0effff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe0f80cc8b0 0x7fe0f806b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45752/0 (socket says 172.21.15.55:45752) 2023-08-25T05:18:42.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.173+0000 7fe0effff640 1 -- 172.21.15.55:0/2426344579 learned_addr learned my addr 172.21.15.55:0/2426344579 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:42.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.173+0000 7fe0fd425640 1 --2- 172.21.15.55:0/2426344579 >> v2:172.21.15.110:3300/0 conn(0x7fe0f806bde0 0x7fe0f8070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:42.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.173+0000 7fe0effff640 1 -- 172.21.15.55:0/2426344579 >> v2:172.21.15.110:3300/0 conn(0x7fe0f806bde0 msgr2=0x7fe0f8070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:42.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.173+0000 7fe0effff640 1 --2- 172.21.15.55:0/2426344579 >> v2:172.21.15.110:3300/0 conn(0x7fe0f806bde0 0x7fe0f8070810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:42.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.173+0000 7fe0effff640 1 -- 172.21.15.55:0/2426344579 >> v1:172.21.15.110:6789/0 conn(0x7fe0f815c890 legacy=0x7fe0f815d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:42.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.173+0000 7fe0effff640 1 -- 172.21.15.55:0/2426344579 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f815db70 con 0x7fe0f80cc8b0 2023-08-25T05:18:42.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.177+0000 7fe0effff640 1 --2- 172.21.15.55:0/2426344579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0f80cc8b0 0x7fe0f806b8a0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009870 tx=0x7fe0e801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffbbc785039fd0b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:42.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.177+0000 7fe0ef7fe640 1 -- 172.21.15.55:0/2426344579 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e80aa5f0 con 0x7fe0f80cc8b0 2023-08-25T05:18:42.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.177+0000 7fe0ef7fe640 1 -- 172.21.15.55:0/2426344579 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e80aa750 con 0x7fe0f80cc8b0 2023-08-25T05:18:42.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.177+0000 7fe0ef7fe640 1 -- 172.21.15.55:0/2426344579 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e80aaae0 con 0x7fe0f80cc8b0 2023-08-25T05:18:42.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.177+0000 7fe0fdc26640 1 -- 172.21.15.55:0/2426344579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0f80cc8b0 msgr2=0x7fe0f806b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:42.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.177+0000 7fe0fdc26640 1 --2- 172.21.15.55:0/2426344579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0f80cc8b0 0x7fe0f806b8a0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009870 tx=0x7fe0e801c490 comp rx=0 tx=0).stop 2023-08-25T05:18:42.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.177+0000 7fe0fdc26640 1 -- 172.21.15.55:0/2426344579 shutdown_connections 2023-08-25T05:18:42.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.177+0000 7fe0fdc26640 1 --2- 172.21.15.55:0/2426344579 >> v2:172.21.15.110:3300/0 conn(0x7fe0f806bde0 0x7fe0f8070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:42.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.177+0000 7fe0fdc26640 1 --2- 172.21.15.55:0/2426344579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0f80cc8b0 0x7fe0f806b8a0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:42.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.177+0000 7fe0fdc26640 1 -- 172.21.15.55:0/2426344579 >> 172.21.15.55:0/2426344579 conn(0x7fe0f8069f00 msgr2=0x7fe0f80afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:42.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.177+0000 7fe0fdc26640 1 -- 172.21.15.55:0/2426344579 shutdown_connections 2023-08-25T05:18:42.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.177+0000 7fe0fdc26640 1 -- 172.21.15.55:0/2426344579 wait complete. 2023-08-25T05:18:42.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.177+0000 7fe0fdc26640 1 Processor -- start 2023-08-25T05:18:42.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.177+0000 7fe0fdc26640 1 -- start start 2023-08-25T05:18:42.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.177+0000 7fe0fdc26640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0f806bde0 0x7fe0f814e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:42.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.177+0000 7fe0fdc26640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0f80cc8b0 0x7fe0f8152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:42.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0fdc26640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0f815c890 0x7fe0f8152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:42.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0fdc26640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f814ecf0 con 0x7fe0f80cc8b0 2023-08-25T05:18:42.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0fdc26640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f81540b0 con 0x7fe0f806bde0 2023-08-25T05:18:42.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0fdc26640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f81534a0 con 0x7fe0f815c890 2023-08-25T05:18:42.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0effff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0f80cc8b0 0x7fe0f8152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:42.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0effff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0f80cc8b0 0x7fe0f8152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45756/0 (socket says 172.21.15.55:45756) 2023-08-25T05:18:42.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0effff640 1 -- 172.21.15.55:0/176587574 learned_addr learned my addr 172.21.15.55:0/176587574 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:42.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0fcc24640 1 --2- 172.21.15.55:0/176587574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0f806bde0 0x7fe0f814e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:42.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0fd425640 1 --2- 172.21.15.55:0/176587574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0f815c890 0x7fe0f8152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:42.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0effff640 1 -- 172.21.15.55:0/176587574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0f815c890 msgr2=0x7fe0f8152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:42.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0effff640 1 --2- 172.21.15.55:0/176587574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0f815c890 0x7fe0f8152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:42.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0effff640 1 -- 172.21.15.55:0/176587574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0f806bde0 msgr2=0x7fe0f814e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:42.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0effff640 1 --2- 172.21.15.55:0/176587574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0f806bde0 0x7fe0f814e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:42.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0effff640 1 -- 172.21.15.55:0/176587574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e80094d0 con 0x7fe0f80cc8b0 2023-08-25T05:18:42.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0effff640 1 --2- 172.21.15.55:0/176587574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0f80cc8b0 0x7fe0f8152970 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fe0e801ab40 tx=0x7fe0e801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:42.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0ed7fa640 1 -- 172.21.15.55:0/176587574 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e80aa5f0 con 0x7fe0f80cc8b0 2023-08-25T05:18:42.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0ed7fa640 1 -- 172.21.15.55:0/176587574 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e80b3800 con 0x7fe0f80cc8b0 2023-08-25T05:18:42.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0fdc26640 1 -- 172.21.15.55:0/176587574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f8153780 con 0x7fe0f80cc8b0 2023-08-25T05:18:42.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0ed7fa640 1 -- 172.21.15.55:0/176587574 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e80b3bb0 con 0x7fe0f80cc8b0 2023-08-25T05:18:42.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0fdc26640 1 -- 172.21.15.55:0/176587574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f8153d40 con 0x7fe0f80cc8b0 2023-08-25T05:18:42.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.181+0000 7fe0fdc26640 1 -- 172.21.15.55:0/176587574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f80aba40 con 0x7fe0f80cc8b0 2023-08-25T05:18:42.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.185+0000 7fe0ed7fa640 1 -- 172.21.15.55:0/176587574 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fe0e80b3d10 con 0x7fe0f80cc8b0 2023-08-25T05:18:42.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.185+0000 7fe0ed7fa640 1 --2- 172.21.15.55:0/176587574 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe0e40657a0 0x7fe0e4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:42.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.185+0000 7fe0ed7fa640 1 -- 172.21.15.55:0/176587574 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fe0e80a7070 con 0x7fe0f80cc8b0 2023-08-25T05:18:42.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.185+0000 7fe0fcc24640 1 --2- 172.21.15.55:0/176587574 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe0e40657a0 0x7fe0e4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:42.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.185+0000 7fe0fcc24640 1 --2- 172.21.15.55:0/176587574 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe0e40657a0 0x7fe0e4067c60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80cee80 tx=0x7fe0f4009060 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:42.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.189+0000 7fe0ed7fa640 1 -- 172.21.15.55:0/176587574 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe0e80eb2e0 con 0x7fe0f80cc8b0 2023-08-25T05:18:42.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:42.373+0000 7fe0fdc26640 1 -- 172.21.15.55:0/176587574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe0f80aba40 con 0x7fe0f80cc8b0 2023-08-25T05:18:43.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.017+0000 7fe0ed7fa640 1 -- 172.21.15.55:0/176587574 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v70) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe0f80aba40 con 0x7fe0f80cc8b0 2023-08-25T05:18:43.025 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 19 and data pool 20 2023-08-25T05:18:43.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.025+0000 7fe0fdc26640 1 -- 172.21.15.55:0/176587574 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe0e40657a0 msgr2=0x7fe0e4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:43.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.025+0000 7fe0fdc26640 1 --2- 172.21.15.55:0/176587574 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe0e40657a0 0x7fe0e4067c60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80cee80 tx=0x7fe0f4009060 comp rx=0 tx=0).stop 2023-08-25T05:18:43.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.025+0000 7fe0fdc26640 1 -- 172.21.15.55:0/176587574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0f80cc8b0 msgr2=0x7fe0f8152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:43.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.025+0000 7fe0fdc26640 1 --2- 172.21.15.55:0/176587574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0f80cc8b0 0x7fe0f8152970 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fe0e801ab40 tx=0x7fe0e801acd0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.029+0000 7fe0fdc26640 1 -- 172.21.15.55:0/176587574 shutdown_connections 2023-08-25T05:18:43.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.029+0000 7fe0fdc26640 1 --2- 172.21.15.55:0/176587574 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe0e40657a0 0x7fe0e4067c60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.029+0000 7fe0fdc26640 1 --2- 172.21.15.55:0/176587574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0f815c890 0x7fe0f8152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.029+0000 7fe0fdc26640 1 --2- 172.21.15.55:0/176587574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0f80cc8b0 0x7fe0f8152970 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.029+0000 7fe0fdc26640 1 --2- 172.21.15.55:0/176587574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0f806bde0 0x7fe0f814e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.033+0000 7fe0fdc26640 1 -- 172.21.15.55:0/176587574 >> 172.21.15.55:0/176587574 conn(0x7fe0f8069f00 msgr2=0x7fe0f80afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:43.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.033+0000 7fe0fdc26640 1 -- 172.21.15.55:0/176587574 shutdown_connections 2023-08-25T05:18:43.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.033+0000 7fe0fdc26640 1 -- 172.21.15.55:0/176587574 wait complete. 2023-08-25T05:18:43.061 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:18:43.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.205+0000 7fb0b969e640 1 Processor -- start 2023-08-25T05:18:43.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.205+0000 7fb0b969e640 1 -- start start 2023-08-25T05:18:43.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.205+0000 7fb0b969e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b40d0340 0x7fb0b40d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:43.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.205+0000 7fb0b969e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b40d07d0 con 0x7fb0b415c9f0 2023-08-25T05:18:43.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.205+0000 7fb0b969e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b40b4b20 con 0x7fb0b40b1ac0 2023-08-25T05:18:43.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.205+0000 7fb0b969e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b40b1f00 con 0x7fb0b40d0340 2023-08-25T05:18:43.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.205+0000 7fb0b3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb0b415c9f0 0x7fb0b406a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34308/0 (socket says 172.21.15.55:34308) 2023-08-25T05:18:43.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.205+0000 7fb0b3fff640 1 -- 172.21.15.55:0/663706495 learned_addr learned my addr 172.21.15.55:0/663706495 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:43.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.205+0000 7fb0b8e9d640 1 --2- 172.21.15.55:0/663706495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b40d0340 0x7fb0b40d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:43.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.205+0000 7fb0b2ffd640 1 -- 172.21.15.55:0/663706495 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763238029 0 0) 0x7fb0b40d07d0 con 0x7fb0b415c9f0 2023-08-25T05:18:43.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.205+0000 7fb0b2ffd640 1 -- 172.21.15.55:0/663706495 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb09c003530 con 0x7fb0b415c9f0 2023-08-25T05:18:43.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.205+0000 7fb0b2ffd640 1 -- 172.21.15.55:0/663706495 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150565231 0 0) 0x7fb0b40b4b20 con 0x7fb0b40b1ac0 2023-08-25T05:18:43.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.205+0000 7fb0b2ffd640 1 -- 172.21.15.55:0/663706495 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0b40d07d0 con 0x7fb0b40b1ac0 2023-08-25T05:18:43.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.205+0000 7fb0b2ffd640 1 -- 172.21.15.55:0/663706495 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 327622559 0 0) 0x7fb09c003530 con 0x7fb0b415c9f0 2023-08-25T05:18:43.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.205+0000 7fb0b8e9d640 1 -- 172.21.15.55:0/663706495 >> v1:172.21.15.110:6789/0 conn(0x7fb0b40b1ac0 legacy=0x7fb0b40cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:43.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.205+0000 7fb0b8e9d640 1 -- 172.21.15.55:0/663706495 >> v1:172.21.15.55:6789/0 conn(0x7fb0b415c9f0 legacy=0x7fb0b406a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:43.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.205+0000 7fb0b8e9d640 1 -- 172.21.15.55:0/663706495 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b40b4e00 con 0x7fb0b40d0340 2023-08-25T05:18:43.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.209+0000 7fb0b8e9d640 1 --2- 172.21.15.55:0/663706495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b40d0340 0x7fb0b40d0a20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac009dc0 tx=0x7fb0ac01f080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db86be32684a43c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:43.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.209+0000 7fb0b2ffd640 1 -- 172.21.15.55:0/663706495 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4001800 con 0x7fb0b40d0340 2023-08-25T05:18:43.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.209+0000 7fb0b2ffd640 1 -- 172.21.15.55:0/663706495 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ac0a8c10 con 0x7fb0b40d0340 2023-08-25T05:18:43.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.209+0000 7fb0b2ffd640 1 -- 172.21.15.55:0/663706495 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac0b0440 con 0x7fb0b40d0340 2023-08-25T05:18:43.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.209+0000 7fb0b969e640 1 -- 172.21.15.55:0/663706495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b40d0340 msgr2=0x7fb0b40d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:43.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.209+0000 7fb0b969e640 1 --2- 172.21.15.55:0/663706495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b40d0340 0x7fb0b40d0a20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac009dc0 tx=0x7fb0ac01f080 comp rx=0 tx=0).stop 2023-08-25T05:18:43.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.209+0000 7fb0b969e640 1 -- 172.21.15.55:0/663706495 shutdown_connections 2023-08-25T05:18:43.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.209+0000 7fb0b969e640 1 --2- 172.21.15.55:0/663706495 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b40d0340 0x7fb0b40d0a20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.209+0000 7fb0b969e640 1 -- 172.21.15.55:0/663706495 >> 172.21.15.55:0/663706495 conn(0x7fb0b40d25f0 msgr2=0x7fb0b40d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:43.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.209+0000 7fb0b969e640 1 -- 172.21.15.55:0/663706495 shutdown_connections 2023-08-25T05:18:43.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.209+0000 7fb0b969e640 1 -- 172.21.15.55:0/663706495 wait complete. 2023-08-25T05:18:43.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b969e640 1 Processor -- start 2023-08-25T05:18:43.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b969e640 1 -- start start 2023-08-25T05:18:43.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b969e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0b40b1ac0 0x7fb0b40b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:43.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b969e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b40d0340 0x7fb0b40b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:43.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b969e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0b415c9f0 0x7fb0b4158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:43.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b969e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b40c9e10 con 0x7fb0b40b1ac0 2023-08-25T05:18:43.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b969e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b415a610 con 0x7fb0b415c9f0 2023-08-25T05:18:43.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b969e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b4157710 con 0x7fb0b40d0340 2023-08-25T05:18:43.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0b40b1ac0 0x7fb0b40b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:43.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0b40b1ac0 0x7fb0b40b7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45766/0 (socket says 172.21.15.55:45766) 2023-08-25T05:18:43.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b3fff640 1 -- 172.21.15.55:0/1044107774 learned_addr learned my addr 172.21.15.55:0/1044107774 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:43.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b37fe640 1 --2- 172.21.15.55:0/1044107774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b40d0340 0x7fb0b40b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:43.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b8e9d640 1 --2- 172.21.15.55:0/1044107774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0b415c9f0 0x7fb0b4158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:43.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b3fff640 1 -- 172.21.15.55:0/1044107774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b40d0340 msgr2=0x7fb0b40b79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:43.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b3fff640 1 --2- 172.21.15.55:0/1044107774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b40d0340 0x7fb0b40b79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b3fff640 1 -- 172.21.15.55:0/1044107774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0b415c9f0 msgr2=0x7fb0b4158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:43.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b3fff640 1 --2- 172.21.15.55:0/1044107774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0b415c9f0 0x7fb0b4158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b3fff640 1 -- 172.21.15.55:0/1044107774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac009a70 con 0x7fb0b40b1ac0 2023-08-25T05:18:43.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b8e9d640 1 --2- 172.21.15.55:0/1044107774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0b415c9f0 0x7fb0b4158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:18:43.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b3fff640 1 --2- 172.21.15.55:0/1044107774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0b40b1ac0 0x7fb0b40b7460 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400c750 tx=0x7fb0a400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:43.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b0ff9640 1 -- 172.21.15.55:0/1044107774 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4007270 con 0x7fb0b40b1ac0 2023-08-25T05:18:43.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b0ff9640 1 -- 172.21.15.55:0/1044107774 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a40073f0 con 0x7fb0b40b1ac0 2023-08-25T05:18:43.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b0ff9640 1 -- 172.21.15.55:0/1044107774 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a40057b0 con 0x7fb0b40b1ac0 2023-08-25T05:18:43.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b969e640 1 -- 172.21.15.55:0/1044107774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b414a280 con 0x7fb0b40b1ac0 2023-08-25T05:18:43.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.213+0000 7fb0b969e640 1 -- 172.21.15.55:0/1044107774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b4159f50 con 0x7fb0b40b1ac0 2023-08-25T05:18:43.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.217+0000 7fb0b969e640 1 -- 172.21.15.55:0/1044107774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b4159d80 con 0x7fb0b40b1ac0 2023-08-25T05:18:43.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.217+0000 7fb0b0ff9640 1 -- 172.21.15.55:0/1044107774 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fb0a4005910 con 0x7fb0b40b1ac0 2023-08-25T05:18:43.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.217+0000 7fb0b0ff9640 1 --2- 172.21.15.55:0/1044107774 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fb0a00657d0 0x7fb0a0067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:43.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.217+0000 7fb0b0ff9640 1 -- 172.21.15.55:0/1044107774 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb0a4082750 con 0x7fb0b40b1ac0 2023-08-25T05:18:43.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.217+0000 7fb0b37fe640 1 --2- 172.21.15.55:0/1044107774 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fb0a00657d0 0x7fb0a0067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:43.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.217+0000 7fb0b37fe640 1 --2- 172.21.15.55:0/1044107774 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fb0a00657d0 0x7fb0a0067c90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb0b406bd30 tx=0x7fb0a8009040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:43.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.221+0000 7fb0b0ff9640 1 -- 172.21.15.55:0/1044107774 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb0a4050060 con 0x7fb0b40b1ac0 2023-08-25T05:18:43.299 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:18:43.304 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:18:43.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.381+0000 7fb0b969e640 1 -- 172.21.15.55:0/1044107774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0b40cd500 con 0x7fb0b40b1ac0 2023-08-25T05:18:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.381+0000 7fb0b0ff9640 1 -- 172.21.15.55:0/1044107774 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fb0a4053680 con 0x7fb0b40b1ac0 2023-08-25T05:18:43.385 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:43.385 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":156,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:18:42.380727+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:18:40.053897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-25T05:18:41.441905+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:18:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.381+0000 7fb0b969e640 1 -- 172.21.15.55:0/1044107774 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fb0a00657d0 msgr2=0x7fb0a0067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.381+0000 7fb0b969e640 1 --2- 172.21.15.55:0/1044107774 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fb0a00657d0 0x7fb0a0067c90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb0b406bd30 tx=0x7fb0a8009040 comp rx=0 tx=0).stop 2023-08-25T05:18:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.381+0000 7fb0b969e640 1 -- 172.21.15.55:0/1044107774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0b40b1ac0 msgr2=0x7fb0b40b7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:43.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.381+0000 7fb0b969e640 1 --2- 172.21.15.55:0/1044107774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0b40b1ac0 0x7fb0b40b7460 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400c750 tx=0x7fb0a400cc10 comp rx=0 tx=0).stop 2023-08-25T05:18:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.381+0000 7fb0b969e640 1 -- 172.21.15.55:0/1044107774 shutdown_connections 2023-08-25T05:18:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.381+0000 7fb0b969e640 1 --2- 172.21.15.55:0/1044107774 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fb0a00657d0 0x7fb0a0067c90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.381+0000 7fb0b969e640 1 --2- 172.21.15.55:0/1044107774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb0b415c9f0 0x7fb0b4158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.381+0000 7fb0b969e640 1 --2- 172.21.15.55:0/1044107774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb0b40d0340 0x7fb0b40b79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.381+0000 7fb0b969e640 1 --2- 172.21.15.55:0/1044107774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0b40b1ac0 0x7fb0b40b7460 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.381+0000 7fb0b969e640 1 -- 172.21.15.55:0/1044107774 >> 172.21.15.55:0/1044107774 conn(0x7fb0b40d25f0 msgr2=0x7fb0b406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.385+0000 7fb0b969e640 1 -- 172.21.15.55:0/1044107774 shutdown_connections 2023-08-25T05:18:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.385+0000 7fb0b969e640 1 -- 172.21.15.55:0/1044107774 wait complete. 2023-08-25T05:18:43.407 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:18:43.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.593+0000 7f4e1a434640 1 Processor -- start 2023-08-25T05:18:43.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.593+0000 7f4e1a434640 1 -- start start 2023-08-25T05:18:43.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.593+0000 7f4e1a434640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e140cde20 0x7f4e140ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:43.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.593+0000 7f4e1a434640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4e140cabf0 0x7f4e1406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:43.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.593+0000 7f4e1a434640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1406d2b0 con 0x7f4e140b1220 2023-08-25T05:18:43.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.593+0000 7f4e1a434640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e140c9490 con 0x7f4e140cabf0 2023-08-25T05:18:43.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.593+0000 7f4e1a434640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140cb1e0 con 0x7f4e140cde20 2023-08-25T05:18:43.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.597+0000 7f4e189d1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4e140cabf0 0x7f4e1406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:43.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.597+0000 7f4e189d1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4e140cabf0 0x7f4e1406c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45776/0 (socket says 172.21.15.55:45776) 2023-08-25T05:18:43.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.597+0000 7f4e137fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4e140b1220 0x7f4e1406be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34310/0 (socket says 172.21.15.55:34310) 2023-08-25T05:18:43.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.597+0000 7f4e189d1640 1 -- 172.21.15.55:0/901091059 learned_addr learned my addr 172.21.15.55:0/901091059 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:43.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.597+0000 7f4e13fff640 1 --2- 172.21.15.55:0/901091059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e140cde20 0x7f4e140ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:43.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.597+0000 7f4e189d1640 1 -- 172.21.15.55:0/901091059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e140cde20 msgr2=0x7f4e140ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:43.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.597+0000 7f4e189d1640 1 --2- 172.21.15.55:0/901091059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e140cde20 0x7f4e140ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.597+0000 7f4e189d1640 1 -- 172.21.15.55:0/901091059 >> v1:172.21.15.55:6789/0 conn(0x7f4e140b1220 legacy=0x7f4e1406be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:43.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.597+0000 7f4e189d1640 1 -- 172.21.15.55:0/901091059 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e140cb480 con 0x7f4e140cabf0 2023-08-25T05:18:43.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.597+0000 7f4e12ffd640 1 -- 172.21.15.55:0/901091059 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3710727331 0 0) 0x7f4e1406d2b0 con 0x7f4e140b1220 2023-08-25T05:18:43.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.597+0000 7f4e189d1640 1 --2- 172.21.15.55:0/901091059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e140cabf0 0x7f4e1406c5a0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c009e50 tx=0x7f4e0c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45f268154382c24 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:43.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.597+0000 7f4e12ffd640 1 -- 172.21.15.55:0/901091059 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0a5900 con 0x7f4e140cabf0 2023-08-25T05:18:43.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.597+0000 7f4e12ffd640 1 -- 172.21.15.55:0/901091059 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c0a5a60 con 0x7f4e140cabf0 2023-08-25T05:18:43.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.597+0000 7f4e12ffd640 1 -- 172.21.15.55:0/901091059 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0a5df0 con 0x7f4e140cabf0 2023-08-25T05:18:43.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e1a434640 1 -- 172.21.15.55:0/901091059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e140cabf0 msgr2=0x7f4e1406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:43.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e1a434640 1 --2- 172.21.15.55:0/901091059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e140cabf0 0x7f4e1406c5a0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c009e50 tx=0x7f4e0c01ca10 comp rx=0 tx=0).stop 2023-08-25T05:18:43.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e1a434640 1 -- 172.21.15.55:0/901091059 shutdown_connections 2023-08-25T05:18:43.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e1a434640 1 --2- 172.21.15.55:0/901091059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e140cabf0 0x7f4e1406c5a0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e1a434640 1 --2- 172.21.15.55:0/901091059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e140cde20 0x7f4e140ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e1a434640 1 -- 172.21.15.55:0/901091059 >> 172.21.15.55:0/901091059 conn(0x7f4e140b0700 msgr2=0x7f4e140b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:43.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e1a434640 1 -- 172.21.15.55:0/901091059 shutdown_connections 2023-08-25T05:18:43.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e1a434640 1 -- 172.21.15.55:0/901091059 wait complete. 2023-08-25T05:18:43.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e1a434640 1 Processor -- start 2023-08-25T05:18:43.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e1a434640 1 -- start start 2023-08-25T05:18:43.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e1a434640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e140b1220 0x7f4e14152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:43.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e1a434640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e140cabf0 0x7f4e140aa500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:43.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e1a434640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e140cde20 0x7f4e140aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:43.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e1a434640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140ac430 con 0x7f4e140cde20 2023-08-25T05:18:43.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e1a434640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140ab7b0 con 0x7f4e140cabf0 2023-08-25T05:18:43.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e1a434640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e140aba90 con 0x7f4e140b1220 2023-08-25T05:18:43.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e189d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e140cde20 0x7f4e140aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:43.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e189d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e140cde20 0x7f4e140aaa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45788/0 (socket says 172.21.15.55:45788) 2023-08-25T05:18:43.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e189d1640 1 -- 172.21.15.55:0/3117175718 learned_addr learned my addr 172.21.15.55:0/3117175718 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:43.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.601+0000 7f4e13fff640 1 --2- 172.21.15.55:0/3117175718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e140b1220 0x7f4e14152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:43.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.605+0000 7f4e137fe640 1 --2- 172.21.15.55:0/3117175718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e140cabf0 0x7f4e140aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:43.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.605+0000 7f4e189d1640 1 -- 172.21.15.55:0/3117175718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e140b1220 msgr2=0x7f4e14152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:43.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.605+0000 7f4e189d1640 1 --2- 172.21.15.55:0/3117175718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e140b1220 0x7f4e14152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.605+0000 7f4e189d1640 1 -- 172.21.15.55:0/3117175718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e140cabf0 msgr2=0x7f4e140aa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:43.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.605+0000 7f4e189d1640 1 --2- 172.21.15.55:0/3117175718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e140cabf0 0x7f4e140aa500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.605+0000 7f4e189d1640 1 -- 172.21.15.55:0/3117175718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c009b30 con 0x7f4e140cde20 2023-08-25T05:18:43.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.605+0000 7f4e189d1640 1 --2- 172.21.15.55:0/3117175718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e140cde20 0x7f4e140aaa40 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0af040 tx=0x7f4e0c0197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:43.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.605+0000 7f4e10ff9640 1 -- 172.21.15.55:0/3117175718 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0bd070 con 0x7f4e140cde20 2023-08-25T05:18:43.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.605+0000 7f4e10ff9640 1 -- 172.21.15.55:0/3117175718 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c0b8680 con 0x7f4e140cde20 2023-08-25T05:18:43.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.605+0000 7f4e10ff9640 1 -- 172.21.15.55:0/3117175718 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0b8a30 con 0x7f4e140cde20 2023-08-25T05:18:43.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.605+0000 7f4e1a434640 1 -- 172.21.15.55:0/3117175718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e140abd70 con 0x7f4e140cde20 2023-08-25T05:18:43.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.605+0000 7f4e1a434640 1 -- 172.21.15.55:0/3117175718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e14153210 con 0x7f4e140cde20 2023-08-25T05:18:43.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.605+0000 7f4e1a434640 1 -- 172.21.15.55:0/3117175718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e140ac570 con 0x7f4e140cde20 2023-08-25T05:18:43.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.605+0000 7f4e10ff9640 1 -- 172.21.15.55:0/3117175718 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f4e0c0b8b90 con 0x7f4e140cde20 2023-08-25T05:18:43.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.605+0000 7f4e10ff9640 1 --2- 172.21.15.55:0/3117175718 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f4e000657a0 0x7f4e00067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:43.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.609+0000 7f4e10ff9640 1 -- 172.21.15.55:0/3117175718 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4e0c11de90 con 0x7f4e140cde20 2023-08-25T05:18:43.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.609+0000 7f4e13fff640 1 --2- 172.21.15.55:0/3117175718 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f4e000657a0 0x7f4e00067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:43.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.609+0000 7f4e13fff640 1 --2- 172.21.15.55:0/3117175718 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f4e000657a0 0x7f4e00067c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e04007a60 tx=0x7f4e04008040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:43.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.613+0000 7f4e10ff9640 1 -- 172.21.15.55:0/3117175718 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4e140ac570 con 0x7f4e140cde20 2023-08-25T05:18:43.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.773+0000 7f4e1a434640 1 -- 172.21.15.55:0/3117175718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e140abbd0 con 0x7f4e140cde20 2023-08-25T05:18:43.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.773+0000 7f4e10ff9640 1 -- 172.21.15.55:0/3117175718 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f4e140abbd0 con 0x7f4e140cde20 2023-08-25T05:18:43.777 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:43.778 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":156,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:18:42.380727+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:18:40.053897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-25T05:18:41.441905+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:18:43.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.777+0000 7f4e1a434640 1 -- 172.21.15.55:0/3117175718 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f4e000657a0 msgr2=0x7f4e00067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:43.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.777+0000 7f4e1a434640 1 --2- 172.21.15.55:0/3117175718 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f4e000657a0 0x7f4e00067c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e04007a60 tx=0x7f4e04008040 comp rx=0 tx=0).stop 2023-08-25T05:18:43.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.777+0000 7f4e1a434640 1 -- 172.21.15.55:0/3117175718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e140cde20 msgr2=0x7f4e140aaa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:43.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.777+0000 7f4e1a434640 1 --2- 172.21.15.55:0/3117175718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e140cde20 0x7f4e140aaa40 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0af040 tx=0x7f4e0c0197b0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.777+0000 7f4e1a434640 1 -- 172.21.15.55:0/3117175718 shutdown_connections 2023-08-25T05:18:43.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.777+0000 7f4e1a434640 1 --2- 172.21.15.55:0/3117175718 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f4e000657a0 0x7f4e00067c60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.777+0000 7f4e1a434640 1 --2- 172.21.15.55:0/3117175718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e140cde20 0x7f4e140aaa40 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.777+0000 7f4e1a434640 1 --2- 172.21.15.55:0/3117175718 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e140cabf0 0x7f4e140aa500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.777+0000 7f4e1a434640 1 --2- 172.21.15.55:0/3117175718 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e140b1220 0x7f4e14152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.777+0000 7f4e1a434640 1 -- 172.21.15.55:0/3117175718 >> 172.21.15.55:0/3117175718 conn(0x7f4e140b0700 msgr2=0x7f4e140af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:43.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.777+0000 7f4e1a434640 1 -- 172.21.15.55:0/3117175718 shutdown_connections 2023-08-25T05:18:43.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.777+0000 7f4e1a434640 1 -- 172.21.15.55:0/3117175718 wait complete. 2023-08-25T05:18:43.800 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-25T05:18:43.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.945+0000 7f7a097ac640 1 Processor -- start 2023-08-25T05:18:43.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.945+0000 7f7a097ac640 1 -- start start 2023-08-25T05:18:43.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.945+0000 7f7a097ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7a040c9900 0x7f7a040cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:43.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.945+0000 7f7a097ac640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7a0406c720 0x7f7a0406cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:43.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.945+0000 7f7a097ac640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a040c9d90 con 0x7f7a040cb020 2023-08-25T05:18:43.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.945+0000 7f7a097ac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a040cbca0 con 0x7f7a040c9900 2023-08-25T05:18:43.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.945+0000 7f7a097ac640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a040c9470 con 0x7f7a0406c720 2023-08-25T05:18:43.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.945+0000 7f79fa7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7a040c9900 0x7f7a040cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:43.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.945+0000 7f79fa7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7a040c9900 0x7f7a040cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45796/0 (socket says 172.21.15.55:45796) 2023-08-25T05:18:43.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.945+0000 7f79fa7fc640 1 -- 172.21.15.55:0/1241254479 learned_addr learned my addr 172.21.15.55:0/1241254479 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:43.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.945+0000 7f79fa7fc640 1 -- 172.21.15.55:0/1241254479 >> v2:172.21.15.110:3300/0 conn(0x7f7a0406c720 msgr2=0x7f7a0406cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:43.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.945+0000 7f79fa7fc640 1 --2- 172.21.15.55:0/1241254479 >> v2:172.21.15.110:3300/0 conn(0x7f7a0406c720 0x7f7a0406cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.945+0000 7f79fa7fc640 1 -- 172.21.15.55:0/1241254479 >> v1:172.21.15.110:6789/0 conn(0x7f7a040cb020 legacy=0x7f7a040cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:43.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.945+0000 7f79fa7fc640 1 -- 172.21.15.55:0/1241254479 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0406d040 con 0x7f7a040c9900 2023-08-25T05:18:43.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.949+0000 7f79fa7fc640 1 --2- 172.21.15.55:0/1241254479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a040c9900 0x7f7a040cdd50 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f7a040cc1d0 tx=0x7f79f401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a35476f56ff94e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:43.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.949+0000 7f7a027fc640 1 -- 172.21.15.55:0/1241254479 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f40ab600 con 0x7f7a040c9900 2023-08-25T05:18:43.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.949+0000 7f7a027fc640 1 -- 172.21.15.55:0/1241254479 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f40a7050 con 0x7f7a040c9900 2023-08-25T05:18:43.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.949+0000 7f7a027fc640 1 -- 172.21.15.55:0/1241254479 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f40ab980 con 0x7f7a040c9900 2023-08-25T05:18:43.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.949+0000 7f7a097ac640 1 -- 172.21.15.55:0/1241254479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a040c9900 msgr2=0x7f7a040cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:43.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.949+0000 7f7a097ac640 1 --2- 172.21.15.55:0/1241254479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a040c9900 0x7f7a040cdd50 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f7a040cc1d0 tx=0x7f79f401c430 comp rx=0 tx=0).stop 2023-08-25T05:18:43.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.949+0000 7f7a097ac640 1 -- 172.21.15.55:0/1241254479 shutdown_connections 2023-08-25T05:18:43.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.949+0000 7f7a097ac640 1 --2- 172.21.15.55:0/1241254479 >> v2:172.21.15.110:3300/0 conn(0x7f7a0406c720 0x7f7a0406cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.949+0000 7f7a097ac640 1 --2- 172.21.15.55:0/1241254479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a040c9900 0x7f7a040cdd50 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.949+0000 7f7a097ac640 1 -- 172.21.15.55:0/1241254479 >> 172.21.15.55:0/1241254479 conn(0x7f7a04069900 msgr2=0x7f7a04069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.949+0000 7f7a097ac640 1 -- 172.21.15.55:0/1241254479 shutdown_connections 2023-08-25T05:18:43.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.949+0000 7f7a097ac640 1 -- 172.21.15.55:0/1241254479 wait complete. 2023-08-25T05:18:43.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.949+0000 7f7a097ac640 1 Processor -- start 2023-08-25T05:18:43.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.949+0000 7f7a097ac640 1 -- start start 2023-08-25T05:18:43.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f7a097ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a0406c720 0x7f7a040aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:43.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f7a097ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a040c9900 0x7f7a040ab510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:43.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f7a097ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a040cb020 0x7f7a041440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:43.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f7a097ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a04158ef0 con 0x7f7a040c9900 2023-08-25T05:18:43.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f7a097ac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a04158550 con 0x7f7a040cb020 2023-08-25T05:18:43.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f7a097ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a04158830 con 0x7f7a0406c720 2023-08-25T05:18:43.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f79fa7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a040c9900 0x7f7a040ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:43.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f79fa7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a040c9900 0x7f7a040ab510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45798/0 (socket says 172.21.15.55:45798) 2023-08-25T05:18:43.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f79fa7fc640 1 -- 172.21.15.55:0/2618135964 learned_addr learned my addr 172.21.15.55:0/2618135964 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:43.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f7a02ffd640 1 --2- 172.21.15.55:0/2618135964 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a0406c720 0x7f7a040aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:43.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f7a037fe640 1 --2- 172.21.15.55:0/2618135964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a040cb020 0x7f7a041440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:43.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f79fa7fc640 1 -- 172.21.15.55:0/2618135964 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a0406c720 msgr2=0x7f7a040aafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:43.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f79fa7fc640 1 --2- 172.21.15.55:0/2618135964 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a0406c720 0x7f7a040aafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f79fa7fc640 1 -- 172.21.15.55:0/2618135964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a040cb020 msgr2=0x7f7a041440e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:43.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f79fa7fc640 1 --2- 172.21.15.55:0/2618135964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a040cb020 0x7f7a041440e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:43.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f79fa7fc640 1 -- 172.21.15.55:0/2618135964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f40094d0 con 0x7f7a040c9900 2023-08-25T05:18:43.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f79fa7fc640 1 --2- 172.21.15.55:0/2618135964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a040c9900 0x7f7a040ab510 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f79f40ae040 tx=0x7f79f401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:43.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f79fbfff640 1 -- 172.21.15.55:0/2618135964 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f40b6620 con 0x7f7a040c9900 2023-08-25T05:18:43.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f79fbfff640 1 -- 172.21.15.55:0/2618135964 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f40b67a0 con 0x7f7a040c9900 2023-08-25T05:18:43.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f79fbfff640 1 -- 172.21.15.55:0/2618135964 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f40b6b50 con 0x7f7a040c9900 2023-08-25T05:18:43.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f7a097ac640 1 -- 172.21.15.55:0/2618135964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a04158b10 con 0x7f7a040c9900 2023-08-25T05:18:43.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f7a097ac640 1 -- 172.21.15.55:0/2618135964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a04144620 con 0x7f7a040c9900 2023-08-25T05:18:43.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.953+0000 7f7a097ac640 1 -- 172.21.15.55:0/2618135964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a04073ec0 con 0x7f7a040c9900 2023-08-25T05:18:43.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.957+0000 7f79fbfff640 1 -- 172.21.15.55:0/2618135964 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f79f40b2040 con 0x7f7a040c9900 2023-08-25T05:18:43.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.957+0000 7f79fbfff640 1 --2- 172.21.15.55:0/2618135964 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f79e40657a0 0x7f79e4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:43.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.957+0000 7f79fbfff640 1 -- 172.21.15.55:0/2618135964 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f79f411d5d0 con 0x7f7a040c9900 2023-08-25T05:18:43.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.957+0000 7f7a02ffd640 1 --2- 172.21.15.55:0/2618135964 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f79e40657a0 0x7f79e4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:43.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.957+0000 7f7a02ffd640 1 --2- 172.21.15.55:0/2618135964 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f79e40657a0 0x7f79e4067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f79ec006fd0 tx=0x7f79ec008040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:43.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:43.961+0000 7f79fbfff640 1 -- 172.21.15.55:0/2618135964 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f79f40eae60 con 0x7f7a040c9900 2023-08-25T05:18:44.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:44.153+0000 7f7a097ac640 1 -- 172.21.15.55:0/2618135964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7a040c19f0 con 0x7f7a040c9900 2023-08-25T05:18:45.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.025+0000 7f79fbfff640 1 -- 172.21.15.55:0/2618135964 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v73) v1 ==== 118+0+0 (secure 0 0 0) 0x7f79f40ee480 con 0x7f7a040c9900 2023-08-25T05:18:45.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.025+0000 7f7a097ac640 1 -- 172.21.15.55:0/2618135964 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f79e40657a0 msgr2=0x7f79e4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:45.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.025+0000 7f7a097ac640 1 --2- 172.21.15.55:0/2618135964 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f79e40657a0 0x7f79e4067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f79ec006fd0 tx=0x7f79ec008040 comp rx=0 tx=0).stop 2023-08-25T05:18:45.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.025+0000 7f7a097ac640 1 -- 172.21.15.55:0/2618135964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a040c9900 msgr2=0x7f7a040ab510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:45.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.025+0000 7f7a097ac640 1 --2- 172.21.15.55:0/2618135964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a040c9900 0x7f7a040ab510 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f79f40ae040 tx=0x7f79f401ac70 comp rx=0 tx=0).stop 2023-08-25T05:18:45.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.025+0000 7f7a097ac640 1 -- 172.21.15.55:0/2618135964 shutdown_connections 2023-08-25T05:18:45.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.025+0000 7f7a097ac640 1 --2- 172.21.15.55:0/2618135964 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f79e40657a0 0x7f79e4067c60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:45.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.025+0000 7f7a097ac640 1 --2- 172.21.15.55:0/2618135964 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a040cb020 0x7f7a041440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:45.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.025+0000 7f7a097ac640 1 --2- 172.21.15.55:0/2618135964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a040c9900 0x7f7a040ab510 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:45.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.025+0000 7f7a097ac640 1 --2- 172.21.15.55:0/2618135964 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a0406c720 0x7f7a040aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:45.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.025+0000 7f7a097ac640 1 -- 172.21.15.55:0/2618135964 >> 172.21.15.55:0/2618135964 conn(0x7f7a04069900 msgr2=0x7f7a040ac7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:45.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.029+0000 7f7a097ac640 1 -- 172.21.15.55:0/2618135964 shutdown_connections 2023-08-25T05:18:45.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.029+0000 7f7a097ac640 1 -- 172.21.15.55:0/2618135964 wait complete. 2023-08-25T05:18:45.054 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-25T05:18:45.055 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-25T05:18:45.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.201+0000 7f502e974640 1 Processor -- start 2023-08-25T05:18:45.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.205+0000 7f502e974640 1 -- start start 2023-08-25T05:18:45.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.205+0000 7f502e974640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f502815a7f0 0x7f502809bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:45.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.205+0000 7f502e974640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f502806c020 0x7f50280acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:45.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.205+0000 7f502e974640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502815abd0 con 0x7f50280c9830 2023-08-25T05:18:45.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.205+0000 7f502e974640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50280c8ab0 con 0x7f502806c020 2023-08-25T05:18:45.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.205+0000 7f502e974640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50280c8d50 con 0x7f502815a7f0 2023-08-25T05:18:45.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.205+0000 7f50277fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f50280c9830 0x7f5028070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34314/0 (socket says 172.21.15.55:34314) 2023-08-25T05:18:45.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.205+0000 7f50277fe640 1 -- 172.21.15.55:0/3421192129 learned_addr learned my addr 172.21.15.55:0/3421192129 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:45.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.205+0000 7f5027fff640 1 --2- 172.21.15.55:0/3421192129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f502815a7f0 0x7f502809bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:45.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.205+0000 7f502cf11640 1 --2- 172.21.15.55:0/3421192129 >> v2:172.21.15.110:3300/0 conn(0x7f502806c020 0x7f50280acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:45.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.205+0000 7f5026ffd640 1 -- 172.21.15.55:0/3421192129 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1445491108 0 0) 0x7f502815abd0 con 0x7f50280c9830 2023-08-25T05:18:45.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.205+0000 7f5026ffd640 1 -- 172.21.15.55:0/3421192129 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5010003530 con 0x7f50280c9830 2023-08-25T05:18:45.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.205+0000 7f5027fff640 1 -- 172.21.15.55:0/3421192129 >> v2:172.21.15.110:3300/0 conn(0x7f502806c020 msgr2=0x7f50280acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:45.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.205+0000 7f5027fff640 1 --2- 172.21.15.55:0/3421192129 >> v2:172.21.15.110:3300/0 conn(0x7f502806c020 0x7f50280acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:45.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.205+0000 7f5027fff640 1 -- 172.21.15.55:0/3421192129 >> v1:172.21.15.55:6789/0 conn(0x7f50280c9830 legacy=0x7f5028070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:45.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.205+0000 7f5027fff640 1 -- 172.21.15.55:0/3421192129 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50280c9030 con 0x7f502815a7f0 2023-08-25T05:18:45.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.209+0000 7f5027fff640 1 --2- 172.21.15.55:0/3421192129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f502815a7f0 0x7f502809bde0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f50180097a0 tx=0x7f501801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dadf4d5a0924db03 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:45.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.209+0000 7f5026ffd640 1 -- 172.21.15.55:0/3421192129 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180ab600 con 0x7f502815a7f0 2023-08-25T05:18:45.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.209+0000 7f5026ffd640 1 -- 172.21.15.55:0/3421192129 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50180a7050 con 0x7f502815a7f0 2023-08-25T05:18:45.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.209+0000 7f5026ffd640 1 -- 172.21.15.55:0/3421192129 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180ab980 con 0x7f502815a7f0 2023-08-25T05:18:45.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.209+0000 7f502e974640 1 -- 172.21.15.55:0/3421192129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f502815a7f0 msgr2=0x7f502809bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:45.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.209+0000 7f502e974640 1 --2- 172.21.15.55:0/3421192129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f502815a7f0 0x7f502809bde0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f50180097a0 tx=0x7f501801c430 comp rx=0 tx=0).stop 2023-08-25T05:18:45.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.209+0000 7f502e974640 1 -- 172.21.15.55:0/3421192129 shutdown_connections 2023-08-25T05:18:45.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.209+0000 7f502e974640 1 --2- 172.21.15.55:0/3421192129 >> v2:172.21.15.110:3300/0 conn(0x7f502806c020 0x7f50280acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:45.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.209+0000 7f502e974640 1 --2- 172.21.15.55:0/3421192129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f502815a7f0 0x7f502809bde0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:45.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.209+0000 7f502e974640 1 -- 172.21.15.55:0/3421192129 >> 172.21.15.55:0/3421192129 conn(0x7f5028069900 msgr2=0x7f5028069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:45.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.209+0000 7f502e974640 1 -- 172.21.15.55:0/3421192129 shutdown_connections 2023-08-25T05:18:45.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.209+0000 7f502e974640 1 -- 172.21.15.55:0/3421192129 wait complete. 2023-08-25T05:18:45.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.209+0000 7f502e974640 1 Processor -- start 2023-08-25T05:18:45.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502e974640 1 -- start start 2023-08-25T05:18:45.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502e974640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f502806c020 0x7f50280ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:45.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502e974640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50280c9830 0x7f50280b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502e974640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502815a7f0 0x7f5028150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502e974640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50281641e0 con 0x7f502815a7f0 2023-08-25T05:18:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502e974640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50280b2910 con 0x7f50280c9830 2023-08-25T05:18:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502e974640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50280cd490 con 0x7f502806c020 2023-08-25T05:18:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502cf11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502815a7f0 0x7f5028150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502cf11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502815a7f0 0x7f5028150ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45804/0 (socket says 172.21.15.55:45804) 2023-08-25T05:18:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502cf11640 1 -- 172.21.15.55:0/838645520 learned_addr learned my addr 172.21.15.55:0/838645520 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f50277fe640 1 --2- 172.21.15.55:0/838645520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50280c9830 0x7f50280b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f5027fff640 1 --2- 172.21.15.55:0/838645520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f502806c020 0x7f50280ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502cf11640 1 -- 172.21.15.55:0/838645520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f502806c020 msgr2=0x7f50280ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502cf11640 1 --2- 172.21.15.55:0/838645520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f502806c020 0x7f50280ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502cf11640 1 -- 172.21.15.55:0/838645520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50280c9830 msgr2=0x7f50280b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502cf11640 1 --2- 172.21.15.55:0/838645520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50280c9830 0x7f50280b23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502cf11640 1 -- 172.21.15.55:0/838645520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50180093b0 con 0x7f502815a7f0 2023-08-25T05:18:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f50277fe640 1 --2- 172.21.15.55:0/838645520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50280c9830 0x7f50280b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:45.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f5027fff640 1 --2- 172.21.15.55:0/838645520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f502806c020 0x7f50280ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:45.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502cf11640 1 --2- 172.21.15.55:0/838645520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502815a7f0 0x7f5028150ea0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f502000ef90 tx=0x7f502000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:45.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f5024ff9640 1 -- 172.21.15.55:0/838645520 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5020009ca0 con 0x7f502815a7f0 2023-08-25T05:18:45.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f5024ff9640 1 -- 172.21.15.55:0/838645520 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502000f040 con 0x7f502815a7f0 2023-08-25T05:18:45.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502e974640 1 -- 172.21.15.55:0/838645520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50280cd770 con 0x7f502815a7f0 2023-08-25T05:18:45.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f5024ff9640 1 -- 172.21.15.55:0/838645520 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50200146c0 con 0x7f502815a7f0 2023-08-25T05:18:45.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502e974640 1 -- 172.21.15.55:0/838645520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50280cdd30 con 0x7f502815a7f0 2023-08-25T05:18:45.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.213+0000 7f502e974640 1 -- 172.21.15.55:0/838645520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502806d5b0 con 0x7f502815a7f0 2023-08-25T05:18:45.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.217+0000 7f5024ff9640 1 -- 172.21.15.55:0/838645520 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f5020014820 con 0x7f502815a7f0 2023-08-25T05:18:45.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.217+0000 7f5024ff9640 1 --2- 172.21.15.55:0/838645520 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f50140657a0 0x7f5014067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:45.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.217+0000 7f5024ff9640 1 -- 172.21.15.55:0/838645520 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5020083f90 con 0x7f502815a7f0 2023-08-25T05:18:45.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.217+0000 7f5027fff640 1 --2- 172.21.15.55:0/838645520 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f50140657a0 0x7f5014067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:45.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.217+0000 7f5027fff640 1 --2- 172.21.15.55:0/838645520 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f50140657a0 0x7f5014067c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f50280ce2e0 tx=0x7f5018008040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:45.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.221+0000 7f5024ff9640 1 -- 172.21.15.55:0/838645520 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5020051820 con 0x7f502815a7f0 2023-08-25T05:18:45.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:45.409+0000 7f502e974640 1 -- 172.21.15.55:0/838645520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5028163f40 con 0x7f502815a7f0 2023-08-25T05:18:46.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.037+0000 7f5024ff9640 1 -- 172.21.15.55:0/838645520 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v74) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5028163f40 con 0x7f502815a7f0 2023-08-25T05:18:46.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.037+0000 7f502e974640 1 -- 172.21.15.55:0/838645520 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f50140657a0 msgr2=0x7f5014067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:46.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.037+0000 7f502e974640 1 --2- 172.21.15.55:0/838645520 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f50140657a0 0x7f5014067c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f50280ce2e0 tx=0x7f5018008040 comp rx=0 tx=0).stop 2023-08-25T05:18:46.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.037+0000 7f502e974640 1 -- 172.21.15.55:0/838645520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502815a7f0 msgr2=0x7f5028150ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:46.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.037+0000 7f502e974640 1 --2- 172.21.15.55:0/838645520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502815a7f0 0x7f5028150ea0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f502000ef90 tx=0x7f502000c490 comp rx=0 tx=0).stop 2023-08-25T05:18:46.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.037+0000 7f502e974640 1 -- 172.21.15.55:0/838645520 shutdown_connections 2023-08-25T05:18:46.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.037+0000 7f502e974640 1 --2- 172.21.15.55:0/838645520 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f50140657a0 0x7f5014067c60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.037+0000 7f502e974640 1 --2- 172.21.15.55:0/838645520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f502815a7f0 0x7f5028150ea0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.037+0000 7f502e974640 1 --2- 172.21.15.55:0/838645520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50280c9830 0x7f50280b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.037+0000 7f502e974640 1 --2- 172.21.15.55:0/838645520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f502806c020 0x7f50280ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.037+0000 7f502e974640 1 -- 172.21.15.55:0/838645520 >> 172.21.15.55:0/838645520 conn(0x7f5028069900 msgr2=0x7f50280aafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:46.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.037+0000 7f502e974640 1 -- 172.21.15.55:0/838645520 shutdown_connections 2023-08-25T05:18:46.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.037+0000 7f502e974640 1 -- 172.21.15.55:0/838645520 wait complete. 2023-08-25T05:18:46.067 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-25T05:18:46.068 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:18:46.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.213+0000 7f8122d67640 1 Processor -- start 2023-08-25T05:18:46.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.213+0000 7f8122d67640 1 -- start start 2023-08-25T05:18:46.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.213+0000 7f8122d67640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f811c0d0da0 0x7f811c0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:46.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.213+0000 7f8122d67640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f811c0b3e50 0x7f811c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:46.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.213+0000 7f8122d67640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811c0b29b0 con 0x7f811c0cdde0 2023-08-25T05:18:46.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.213+0000 7f8122d67640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811c0ce760 con 0x7f811c0d0da0 2023-08-25T05:18:46.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.213+0000 7f8122d67640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811c0d16c0 con 0x7f811c0b3e50 2023-08-25T05:18:46.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.213+0000 7f8120b03640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f811c0d0da0 0x7f811c0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:46.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.213+0000 7f8120b03640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f811c0d0da0 0x7f811c0d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45808/0 (socket says 172.21.15.55:45808) 2023-08-25T05:18:46.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.213+0000 7f811bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f811c0cdde0 0x7f811c0cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34324/0 (socket says 172.21.15.55:34324) 2023-08-25T05:18:46.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.213+0000 7f8120b03640 1 -- 172.21.15.55:0/3760878227 learned_addr learned my addr 172.21.15.55:0/3760878227 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:46.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.213+0000 7f8121304640 1 --2- 172.21.15.55:0/3760878227 >> v2:172.21.15.110:3300/0 conn(0x7f811c0b3e50 0x7f811c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:46.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.213+0000 7f8120b03640 1 -- 172.21.15.55:0/3760878227 >> v2:172.21.15.110:3300/0 conn(0x7f811c0b3e50 msgr2=0x7f811c0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:46.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.213+0000 7f8120b03640 1 --2- 172.21.15.55:0/3760878227 >> v2:172.21.15.110:3300/0 conn(0x7f811c0b3e50 0x7f811c0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.213+0000 7f8120b03640 1 -- 172.21.15.55:0/3760878227 >> v1:172.21.15.55:6789/0 conn(0x7f811c0cdde0 legacy=0x7f811c0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:46.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.213+0000 7f8120b03640 1 -- 172.21.15.55:0/3760878227 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c0b1dc0 con 0x7f811c0d0da0 2023-08-25T05:18:46.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.213+0000 7f811b7fe640 1 -- 172.21.15.55:0/3760878227 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160917222 0 0) 0x7f811c0b29b0 con 0x7f811c0cdde0 2023-08-25T05:18:46.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.213+0000 7f8121304640 1 --2- 172.21.15.55:0/3760878227 >> v2:172.21.15.110:3300/0 conn(0x7f811c0b3e50 0x7f811c0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:18:46.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.217+0000 7f8120b03640 1 --2- 172.21.15.55:0/3760878227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f811c0d0da0 0x7f811c0d1180 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f811c09c1c0 tx=0x7f811001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10739e7beb85965f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:46.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.217+0000 7f811b7fe640 1 -- 172.21.15.55:0/3760878227 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81100a89f0 con 0x7f811c0d0da0 2023-08-25T05:18:46.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.217+0000 7f811b7fe640 1 -- 172.21.15.55:0/3760878227 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81100a8b50 con 0x7f811c0d0da0 2023-08-25T05:18:46.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.217+0000 7f811b7fe640 1 -- 172.21.15.55:0/3760878227 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81100b0440 con 0x7f811c0d0da0 2023-08-25T05:18:46.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.217+0000 7f8122d67640 1 -- 172.21.15.55:0/3760878227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f811c0d0da0 msgr2=0x7f811c0d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:46.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.217+0000 7f8122d67640 1 --2- 172.21.15.55:0/3760878227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f811c0d0da0 0x7f811c0d1180 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f811c09c1c0 tx=0x7f811001ecf0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.217+0000 7f8122d67640 1 -- 172.21.15.55:0/3760878227 shutdown_connections 2023-08-25T05:18:46.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.217+0000 7f8122d67640 1 --2- 172.21.15.55:0/3760878227 >> v2:172.21.15.110:3300/0 conn(0x7f811c0b3e50 0x7f811c0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.217+0000 7f8122d67640 1 --2- 172.21.15.55:0/3760878227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f811c0d0da0 0x7f811c0d1180 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.217+0000 7f8122d67640 1 -- 172.21.15.55:0/3760878227 >> 172.21.15.55:0/3760878227 conn(0x7f811c09bae0 msgr2=0x7f811c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:46.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.217+0000 7f8122d67640 1 -- 172.21.15.55:0/3760878227 shutdown_connections 2023-08-25T05:18:46.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.217+0000 7f8122d67640 1 -- 172.21.15.55:0/3760878227 wait complete. 2023-08-25T05:18:46.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.217+0000 7f8122d67640 1 Processor -- start 2023-08-25T05:18:46.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.217+0000 7f8122d67640 1 -- start start 2023-08-25T05:18:46.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f8122d67640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f811c0b3e50 0x7f811c0c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:46.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f8122d67640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f811c0cdde0 0x7f811c0c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:46.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f8122d67640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f811c0d0da0 0x7f811c151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:46.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f8122d67640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c0c8580 con 0x7f811c0cdde0 2023-08-25T05:18:46.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f8122d67640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c0ca4a0 con 0x7f811c0d0da0 2023-08-25T05:18:46.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f8122d67640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811c0c7240 con 0x7f811c0b3e50 2023-08-25T05:18:46.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f811bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f811c0cdde0 0x7f811c0c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:46.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f811bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f811c0cdde0 0x7f811c0c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45814/0 (socket says 172.21.15.55:45814) 2023-08-25T05:18:46.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f811bfff640 1 -- 172.21.15.55:0/3249135006 learned_addr learned my addr 172.21.15.55:0/3249135006 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:46.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f8120b03640 1 --2- 172.21.15.55:0/3249135006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f811c0b3e50 0x7f811c0c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:46.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f8121304640 1 --2- 172.21.15.55:0/3249135006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f811c0d0da0 0x7f811c151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:46.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f811bfff640 1 -- 172.21.15.55:0/3249135006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f811c0b3e50 msgr2=0x7f811c0c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:46.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f811bfff640 1 --2- 172.21.15.55:0/3249135006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f811c0b3e50 0x7f811c0c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f811bfff640 1 -- 172.21.15.55:0/3249135006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f811c0d0da0 msgr2=0x7f811c151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f811bfff640 1 --2- 172.21.15.55:0/3249135006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f811c0d0da0 0x7f811c151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f811bfff640 1 -- 172.21.15.55:0/3249135006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8110009480 con 0x7f811c0cdde0 2023-08-25T05:18:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f8120b03640 1 --2- 172.21.15.55:0/3249135006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f811c0b3e50 0x7f811c0c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:18:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f8121304640 1 --2- 172.21.15.55:0/3249135006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f811c0d0da0 0x7f811c151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:18:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f811bfff640 1 --2- 172.21.15.55:0/3249135006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f811c0cdde0 0x7f811c0c6d00 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f81080011f0 tx=0x7f810800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f81197fa640 1 -- 172.21.15.55:0/3249135006 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81080074e0 con 0x7f811c0cdde0 2023-08-25T05:18:46.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f81197fa640 1 -- 172.21.15.55:0/3249135006 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8108007640 con 0x7f811c0cdde0 2023-08-25T05:18:46.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f8122d67640 1 -- 172.21.15.55:0/3249135006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811c0ca930 con 0x7f811c0cdde0 2023-08-25T05:18:46.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f81197fa640 1 -- 172.21.15.55:0/3249135006 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8108004a10 con 0x7f811c0cdde0 2023-08-25T05:18:46.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f8122d67640 1 -- 172.21.15.55:0/3249135006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811c0c9b70 con 0x7f811c0cdde0 2023-08-25T05:18:46.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.221+0000 7f8122d67640 1 -- 172.21.15.55:0/3249135006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811c0ca630 con 0x7f811c0cdde0 2023-08-25T05:18:46.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.225+0000 7f81197fa640 1 -- 172.21.15.55:0/3249135006 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f8108004b70 con 0x7f811c0cdde0 2023-08-25T05:18:46.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.225+0000 7f81197fa640 1 --2- 172.21.15.55:0/3249135006 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f81000657a0 0x7f8100067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:46.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.225+0000 7f81197fa640 1 -- 172.21.15.55:0/3249135006 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8108082270 con 0x7f811c0cdde0 2023-08-25T05:18:46.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.225+0000 7f8120b03640 1 --2- 172.21.15.55:0/3249135006 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f81000657a0 0x7f8100067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:46.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.225+0000 7f8120b03640 1 --2- 172.21.15.55:0/3249135006 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f81000657a0 0x7f8100067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f81100b2000 tx=0x7f81100aa070 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:46.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.229+0000 7f81197fa640 1 -- 172.21.15.55:0/3249135006 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f810804fc20 con 0x7f811c0cdde0 2023-08-25T05:18:46.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.417+0000 7f8122d67640 1 -- 172.21.15.55:0/3249135006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f811c04dbe0 con 0x7f811c0cdde0 2023-08-25T05:18:46.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.417+0000 7f81197fa640 1 -- 172.21.15.55:0/3249135006 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4877 (secure 0 0 0) 0x7f8108053240 con 0x7f811c0cdde0 2023-08-25T05:18:46.423 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:46.423 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8911,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/381737607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":381737607},{"type":"v1","addr":"172.21.15.55:6834","nonce":381737607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":8917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/775518941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":775518941},{"type":"v1","addr":"172.21.15.110:6836","nonce":775518941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":8920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1426163963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1426163963},{"type":"v1","addr":"172.21.15.110:6837","nonce":1426163963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:18:42.381096+0000","modified":"2023-08-25T05:18:46.026870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9618},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9618":{"gid":9618,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3591663387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3591663387},{"type":"v1","addr":"172.21.15.55:6835","nonce":3591663387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-25T05:18:46.423 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 74 2023-08-25T05:18:46.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.421+0000 7f8122d67640 1 -- 172.21.15.55:0/3249135006 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f81000657a0 msgr2=0x7f8100067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:46.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.421+0000 7f8122d67640 1 --2- 172.21.15.55:0/3249135006 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f81000657a0 0x7f8100067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f81100b2000 tx=0x7f81100aa070 comp rx=0 tx=0).stop 2023-08-25T05:18:46.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.421+0000 7f8122d67640 1 -- 172.21.15.55:0/3249135006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f811c0cdde0 msgr2=0x7f811c0c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:46.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.421+0000 7f8122d67640 1 --2- 172.21.15.55:0/3249135006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f811c0cdde0 0x7f811c0c6d00 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f81080011f0 tx=0x7f810800c9b0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.421+0000 7f8122d67640 1 -- 172.21.15.55:0/3249135006 shutdown_connections 2023-08-25T05:18:46.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.421+0000 7f8122d67640 1 --2- 172.21.15.55:0/3249135006 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f81000657a0 0x7f8100067c60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.421+0000 7f8122d67640 1 --2- 172.21.15.55:0/3249135006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f811c0d0da0 0x7f811c151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.421+0000 7f8122d67640 1 --2- 172.21.15.55:0/3249135006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f811c0cdde0 0x7f811c0c6d00 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.421+0000 7f8122d67640 1 --2- 172.21.15.55:0/3249135006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f811c0b3e50 0x7f811c0c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.421+0000 7f8122d67640 1 -- 172.21.15.55:0/3249135006 >> 172.21.15.55:0/3249135006 conn(0x7f811c09bae0 msgr2=0x7f811c0cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:46.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.421+0000 7f8122d67640 1 -- 172.21.15.55:0/3249135006 shutdown_connections 2023-08-25T05:18:46.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.421+0000 7f8122d67640 1 -- 172.21.15.55:0/3249135006 wait complete. 2023-08-25T05:18:46.444 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:18:46.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.585+0000 7f1cec92c640 1 Processor -- start 2023-08-25T05:18:46.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.585+0000 7f1cec92c640 1 -- start start 2023-08-25T05:18:46.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.585+0000 7f1cec92c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1ce80ad950 0x7f1ce80cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:46.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.585+0000 7f1cec92c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce80c89f0 0x7f1ce80ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:46.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.585+0000 7f1cec92c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce80b2650 con 0x7f1ce806c000 2023-08-25T05:18:46.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.585+0000 7f1cec92c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce80b11f0 con 0x7f1ce80ad950 2023-08-25T05:18:46.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.585+0000 7f1cec92c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce8159d50 con 0x7f1ce80c89f0 2023-08-25T05:18:46.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.585+0000 7f1ce659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1ce80ad950 0x7f1ce80cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:46.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.585+0000 7f1ce659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1ce80ad950 0x7f1ce80cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45824/0 (socket says 172.21.15.55:45824) 2023-08-25T05:18:46.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.585+0000 7f1ce659c640 1 -- 172.21.15.55:0/4259993488 learned_addr learned my addr 172.21.15.55:0/4259993488 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:46.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.589+0000 7f1cdffff640 1 --2- 172.21.15.55:0/4259993488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce80c89f0 0x7f1ce80ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:46.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.589+0000 7f1ce659c640 1 -- 172.21.15.55:0/4259993488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce80c89f0 msgr2=0x7f1ce80ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:46.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.589+0000 7f1ce659c640 1 --2- 172.21.15.55:0/4259993488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce80c89f0 0x7f1ce80ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.589+0000 7f1ce659c640 1 -- 172.21.15.55:0/4259993488 >> v1:172.21.15.110:6789/0 conn(0x7f1ce806c000 legacy=0x7f1ce815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.589+0000 7f1ce659c640 1 -- 172.21.15.55:0/4259993488 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce80cc880 con 0x7f1ce80ad950 2023-08-25T05:18:46.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.589+0000 7f1ce659c640 1 --2- 172.21.15.55:0/4259993488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce80ad950 0x7f1ce80cc2a0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009870 tx=0x7f1cd801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0c33e15816246e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.589+0000 7f1ce5d9b640 1 -- 172.21.15.55:0/4259993488 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd80ac640 con 0x7f1ce80ad950 2023-08-25T05:18:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.589+0000 7f1ce5d9b640 1 -- 172.21.15.55:0/4259993488 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd80ac7a0 con 0x7f1ce80ad950 2023-08-25T05:18:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.589+0000 7f1ce5d9b640 1 -- 172.21.15.55:0/4259993488 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd80acb30 con 0x7f1ce80ad950 2023-08-25T05:18:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1cec92c640 1 -- 172.21.15.55:0/4259993488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce80ad950 msgr2=0x7f1ce80cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1cec92c640 1 --2- 172.21.15.55:0/4259993488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce80ad950 0x7f1ce80cc2a0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009870 tx=0x7f1cd801c440 comp rx=0 tx=0).stop 2023-08-25T05:18:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1cec92c640 1 -- 172.21.15.55:0/4259993488 shutdown_connections 2023-08-25T05:18:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1cec92c640 1 --2- 172.21.15.55:0/4259993488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce80c89f0 0x7f1ce80ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1cec92c640 1 --2- 172.21.15.55:0/4259993488 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce80ad950 0x7f1ce80cc2a0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1cec92c640 1 -- 172.21.15.55:0/4259993488 >> 172.21.15.55:0/4259993488 conn(0x7f1ce8069d00 msgr2=0x7f1ce806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1cec92c640 1 -- 172.21.15.55:0/4259993488 shutdown_connections 2023-08-25T05:18:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1cec92c640 1 -- 172.21.15.55:0/4259993488 wait complete. 2023-08-25T05:18:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1cec92c640 1 Processor -- start 2023-08-25T05:18:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1cec92c640 1 -- start start 2023-08-25T05:18:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1cec92c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce806c000 0x7f1ce8152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1cec92c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce80ad950 0x7f1ce81583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1cec92c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce80c89f0 0x7f1ce81588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1cec92c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce8153160 con 0x7f1ce80c89f0 2023-08-25T05:18:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1cec92c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce81567b0 con 0x7f1ce80ad950 2023-08-25T05:18:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1cec92c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce8156a90 con 0x7f1ce806c000 2023-08-25T05:18:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1ce6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce80c89f0 0x7f1ce81588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1ce6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce80c89f0 0x7f1ce81588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45828/0 (socket says 172.21.15.55:45828) 2023-08-25T05:18:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1ce6d9d640 1 -- 172.21.15.55:0/4207560974 learned_addr learned my addr 172.21.15.55:0/4207560974 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1cdffff640 1 --2- 172.21.15.55:0/4207560974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce80ad950 0x7f1ce81583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1ce659c640 1 --2- 172.21.15.55:0/4207560974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce806c000 0x7f1ce8152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1ce6d9d640 1 -- 172.21.15.55:0/4207560974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce806c000 msgr2=0x7f1ce8152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1ce6d9d640 1 --2- 172.21.15.55:0/4207560974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce806c000 0x7f1ce8152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1ce6d9d640 1 -- 172.21.15.55:0/4207560974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce80ad950 msgr2=0x7f1ce81583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1ce6d9d640 1 --2- 172.21.15.55:0/4207560974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce80ad950 0x7f1ce81583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.593+0000 7f1ce6d9d640 1 -- 172.21.15.55:0/4207560974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd80094d0 con 0x7f1ce80c89f0 2023-08-25T05:18:46.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.597+0000 7f1ce6d9d640 1 --2- 172.21.15.55:0/4207560974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce80c89f0 0x7f1ce81588f0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000c780 tx=0x7f1ce000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.597+0000 7f1cdeffd640 1 -- 172.21.15.55:0/4207560974 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0004b70 con 0x7f1ce80c89f0 2023-08-25T05:18:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.597+0000 7f1cdeffd640 1 -- 172.21.15.55:0/4207560974 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce000ce90 con 0x7f1ce80c89f0 2023-08-25T05:18:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.597+0000 7f1cec92c640 1 -- 172.21.15.55:0/4207560974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce8159f30 con 0x7f1ce80c89f0 2023-08-25T05:18:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.597+0000 7f1cdeffd640 1 -- 172.21.15.55:0/4207560974 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce000a850 con 0x7f1ce80c89f0 2023-08-25T05:18:46.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.597+0000 7f1cec92c640 1 -- 172.21.15.55:0/4207560974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce81564a0 con 0x7f1ce80c89f0 2023-08-25T05:18:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.597+0000 7f1cec92c640 1 -- 172.21.15.55:0/4207560974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce815a450 con 0x7f1ce80c89f0 2023-08-25T05:18:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.597+0000 7f1cdeffd640 1 -- 172.21.15.55:0/4207560974 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f1ce000a9b0 con 0x7f1ce80c89f0 2023-08-25T05:18:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.597+0000 7f1cdeffd640 1 --2- 172.21.15.55:0/4207560974 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f1cc80657a0 0x7f1cc8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.597+0000 7f1cdeffd640 1 -- 172.21.15.55:0/4207560974 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1ce0082f60 con 0x7f1ce80c89f0 2023-08-25T05:18:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.597+0000 7f1ce659c640 1 --2- 172.21.15.55:0/4207560974 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f1cc80657a0 0x7f1cc8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.601+0000 7f1ce659c640 1 --2- 172.21.15.55:0/4207560974 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f1cc80657a0 0x7f1cc8067c60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80ae000 tx=0x7f1cd80a6070 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:46.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.601+0000 7f1cdeffd640 1 -- 172.21.15.55:0/4207560974 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1ce815a450 con 0x7f1ce80c89f0 2023-08-25T05:18:46.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.761+0000 7f1cec92c640 1 -- 172.21.15.55:0/4207560974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ce815a450 con 0x7f1ce80c89f0 2023-08-25T05:18:46.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.761+0000 7f1cdeffd640 1 -- 172.21.15.55:0/4207560974 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+18321 (secure 0 0 0) 0x7f1ce815a450 con 0x7f1ce80c89f0 2023-08-25T05:18:46.767 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:46.767 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":157,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:18:44.010411+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:18:40.053897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-25T05:18:41.441905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:18:46.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.765+0000 7f1cec92c640 1 -- 172.21.15.55:0/4207560974 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f1cc80657a0 msgr2=0x7f1cc8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:46.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.765+0000 7f1cec92c640 1 --2- 172.21.15.55:0/4207560974 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f1cc80657a0 0x7f1cc8067c60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80ae000 tx=0x7f1cd80a6070 comp rx=0 tx=0).stop 2023-08-25T05:18:46.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.765+0000 7f1cec92c640 1 -- 172.21.15.55:0/4207560974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce80c89f0 msgr2=0x7f1ce81588f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:46.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.765+0000 7f1cec92c640 1 --2- 172.21.15.55:0/4207560974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce80c89f0 0x7f1ce81588f0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000c780 tx=0x7f1ce000cc40 comp rx=0 tx=0).stop 2023-08-25T05:18:46.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.765+0000 7f1cec92c640 1 -- 172.21.15.55:0/4207560974 shutdown_connections 2023-08-25T05:18:46.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.765+0000 7f1cec92c640 1 --2- 172.21.15.55:0/4207560974 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f1cc80657a0 0x7f1cc8067c60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.765+0000 7f1cec92c640 1 --2- 172.21.15.55:0/4207560974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ce80c89f0 0x7f1ce81588f0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.765+0000 7f1cec92c640 1 --2- 172.21.15.55:0/4207560974 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce80ad950 0x7f1ce81583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.765+0000 7f1cec92c640 1 --2- 172.21.15.55:0/4207560974 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce806c000 0x7f1ce8152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.765+0000 7f1cec92c640 1 -- 172.21.15.55:0/4207560974 >> 172.21.15.55:0/4207560974 conn(0x7f1ce8069d00 msgr2=0x7f1ce8157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:46.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.765+0000 7f1cec92c640 1 -- 172.21.15.55:0/4207560974 shutdown_connections 2023-08-25T05:18:46.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.765+0000 7f1cec92c640 1 -- 172.21.15.55:0/4207560974 wait complete. 2023-08-25T05:18:46.788 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-25T05:18:46.789 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:18:46.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.929+0000 7f375ae88640 1 Processor -- start 2023-08-25T05:18:46.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.929+0000 7f375ae88640 1 -- start start 2023-08-25T05:18:46.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.929+0000 7f375ae88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37540ceeb0 0x7f37540cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:46.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.929+0000 7f375ae88640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37540cc880 con 0x7f37540c89f0 2023-08-25T05:18:46.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.929+0000 7f375ae88640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37540ccb60 con 0x7f37540ad950 2023-08-25T05:18:46.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.929+0000 7f375ae88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37540b11f0 con 0x7f37540ceeb0 2023-08-25T05:18:46.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.929+0000 7f3759425640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f37540c89f0 0x7f37540b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34336/0 (socket says 172.21.15.55:34336) 2023-08-25T05:18:46.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.929+0000 7f3759425640 1 -- 172.21.15.55:0/3434557710 learned_addr learned my addr 172.21.15.55:0/3434557710 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:46.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.929+0000 7f374bfff640 1 --2- 172.21.15.55:0/3434557710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37540ceeb0 0x7f37540cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:46.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.929+0000 7f374b7fe640 1 -- 172.21.15.55:0/3434557710 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298435918 0 0) 0x7f37540cc880 con 0x7f37540c89f0 2023-08-25T05:18:46.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.929+0000 7f374b7fe640 1 -- 172.21.15.55:0/3434557710 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f373c005740 con 0x7f37540c89f0 2023-08-25T05:18:46.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.933+0000 7f374b7fe640 1 -- 172.21.15.55:0/3434557710 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4075436481 0 0) 0x7f37540ccb60 con 0x7f37540ad950 2023-08-25T05:18:46.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.933+0000 7f374bfff640 1 -- 172.21.15.55:0/3434557710 >> v1:172.21.15.110:6789/0 conn(0x7f37540ad950 legacy=0x7f37540ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:46.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.933+0000 7f374bfff640 1 -- 172.21.15.55:0/3434557710 >> v1:172.21.15.55:6789/0 conn(0x7f37540c89f0 legacy=0x7f37540b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:46.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.933+0000 7f374bfff640 1 -- 172.21.15.55:0/3434557710 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37540cce40 con 0x7f37540ceeb0 2023-08-25T05:18:46.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.933+0000 7f374bfff640 1 --2- 172.21.15.55:0/3434557710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37540ceeb0 0x7f37540cc2a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f37440097f0 tx=0x7f374401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3234b068f9817026 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:46.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.933+0000 7f374b7fe640 1 -- 172.21.15.55:0/3434557710 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37440ab600 con 0x7f37540ceeb0 2023-08-25T05:18:46.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.933+0000 7f374b7fe640 1 -- 172.21.15.55:0/3434557710 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37440a7050 con 0x7f37540ceeb0 2023-08-25T05:18:46.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.933+0000 7f374b7fe640 1 -- 172.21.15.55:0/3434557710 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37440ab980 con 0x7f37540ceeb0 2023-08-25T05:18:46.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.933+0000 7f375ae88640 1 -- 172.21.15.55:0/3434557710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37540ceeb0 msgr2=0x7f37540cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:46.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.933+0000 7f375ae88640 1 --2- 172.21.15.55:0/3434557710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37540ceeb0 0x7f37540cc2a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f37440097f0 tx=0x7f374401c430 comp rx=0 tx=0).stop 2023-08-25T05:18:46.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.933+0000 7f375ae88640 1 -- 172.21.15.55:0/3434557710 shutdown_connections 2023-08-25T05:18:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.933+0000 7f375ae88640 1 --2- 172.21.15.55:0/3434557710 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37540ceeb0 0x7f37540cc2a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f375ae88640 1 -- 172.21.15.55:0/3434557710 >> 172.21.15.55:0/3434557710 conn(0x7f3754069d00 msgr2=0x7f375406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f375ae88640 1 -- 172.21.15.55:0/3434557710 shutdown_connections 2023-08-25T05:18:46.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f375ae88640 1 -- 172.21.15.55:0/3434557710 wait complete. 2023-08-25T05:18:46.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f375ae88640 1 Processor -- start 2023-08-25T05:18:46.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f375ae88640 1 -- start start 2023-08-25T05:18:46.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f375ae88640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37540ad950 0x7f3754070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:46.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f375ae88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37540c89f0 0x7f3754071050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:46.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f375ae88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37540ceeb0 0x7f3754097210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f375ae88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3754157da0 con 0x7f37540ceeb0 2023-08-25T05:18:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f375ae88640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3754157420 con 0x7f37540ad950 2023-08-25T05:18:46.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f375ae88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3754157140 con 0x7f37540c89f0 2023-08-25T05:18:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f3759425640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37540ceeb0 0x7f3754097210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f3759425640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37540ceeb0 0x7f3754097210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45844/0 (socket says 172.21.15.55:45844) 2023-08-25T05:18:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f3759425640 1 -- 172.21.15.55:0/3330263642 learned_addr learned my addr 172.21.15.55:0/3330263642 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:46.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f374bfff640 1 --2- 172.21.15.55:0/3330263642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37540c89f0 0x7f3754071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f3758c24640 1 --2- 172.21.15.55:0/3330263642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37540ad950 0x7f3754070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f3759425640 1 -- 172.21.15.55:0/3330263642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37540c89f0 msgr2=0x7f3754071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f3759425640 1 --2- 172.21.15.55:0/3330263642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37540c89f0 0x7f3754071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f3759425640 1 -- 172.21.15.55:0/3330263642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37540ad950 msgr2=0x7f3754070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f3759425640 1 --2- 172.21.15.55:0/3330263642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37540ad950 0x7f3754070b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:46.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f3759425640 1 -- 172.21.15.55:0/3330263642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3744009420 con 0x7f37540ceeb0 2023-08-25T05:18:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f3759425640 1 --2- 172.21.15.55:0/3330263642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37540ceeb0 0x7f3754097210 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f374c00cbb0 tx=0x7f374c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.937+0000 7f37497fa640 1 -- 172.21.15.55:0/3330263642 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c00ad40 con 0x7f37540ceeb0 2023-08-25T05:18:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.941+0000 7f37497fa640 1 -- 172.21.15.55:0/3330263642 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c012400 con 0x7f37540ceeb0 2023-08-25T05:18:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.941+0000 7f37497fa640 1 -- 172.21.15.55:0/3330263642 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c00aea0 con 0x7f37540ceeb0 2023-08-25T05:18:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.941+0000 7f375ae88640 1 -- 172.21.15.55:0/3330263642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3754157750 con 0x7f37540ceeb0 2023-08-25T05:18:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.941+0000 7f375ae88640 1 -- 172.21.15.55:0/3330263642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37540ceac0 con 0x7f37540ceeb0 2023-08-25T05:18:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.941+0000 7f375ae88640 1 -- 172.21.15.55:0/3330263642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3754157f10 con 0x7f37540ceeb0 2023-08-25T05:18:46.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.941+0000 7f37497fa640 1 -- 172.21.15.55:0/3330263642 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f374c007070 con 0x7f37540ceeb0 2023-08-25T05:18:46.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.941+0000 7f37497fa640 1 --2- 172.21.15.55:0/3330263642 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f37400657a0 0x7f3740067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:46.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.941+0000 7f37497fa640 1 -- 172.21.15.55:0/3330263642 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f374c082ed0 con 0x7f37540ceeb0 2023-08-25T05:18:46.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.941+0000 7f3758c24640 1 --2- 172.21.15.55:0/3330263642 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f37400657a0 0x7f3740067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:46.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.941+0000 7f3758c24640 1 --2- 172.21.15.55:0/3330263642 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f37400657a0 0x7f3740067c60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3750000f70 tx=0x7f3750009040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:46.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:46.945+0000 7f37497fa640 1 -- 172.21.15.55:0/3330263642 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f374c050920 con 0x7f37540ceeb0 2023-08-25T05:18:46.958 INFO:tasks.ceph.mds.c.smithi055.stderr:2023-08-25T05:18:46.957+0000 7f9209be6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T05:18:47.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.101+0000 7f375ae88640 1 -- 172.21.15.55:0/3330263642 --> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3754157c00 con 0x7f37400657a0 2023-08-25T05:18:47.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.113+0000 7f37497fa640 1 -- 172.21.15.55:0/3330263642 <== mgr.7709 v2:172.21.15.110:6832/4256905777 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311876 (secure 0 0 0) 0x7f375000f820 con 0x7f37400657a0 2023-08-25T05:18:47.123 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:47.124 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:18:47.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.113+0000 7f375ae88640 1 -- 172.21.15.55:0/3330263642 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f37400657a0 msgr2=0x7f3740067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:47.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.113+0000 7f375ae88640 1 --2- 172.21.15.55:0/3330263642 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f37400657a0 0x7f3740067c60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3750000f70 tx=0x7f3750009040 comp rx=0 tx=0).stop 2023-08-25T05:18:47.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.113+0000 7f375ae88640 1 -- 172.21.15.55:0/3330263642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37540ceeb0 msgr2=0x7f3754097210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:47.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.113+0000 7f375ae88640 1 --2- 172.21.15.55:0/3330263642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37540ceeb0 0x7f3754097210 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f374c00cbb0 tx=0x7f374c00a430 comp rx=0 tx=0).stop 2023-08-25T05:18:47.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.113+0000 7f375ae88640 1 -- 172.21.15.55:0/3330263642 shutdown_connections 2023-08-25T05:18:47.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.117+0000 7f375ae88640 1 --2- 172.21.15.55:0/3330263642 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f37400657a0 0x7f3740067c60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.117+0000 7f375ae88640 1 --2- 172.21.15.55:0/3330263642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37540ceeb0 0x7f3754097210 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.117+0000 7f375ae88640 1 --2- 172.21.15.55:0/3330263642 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37540c89f0 0x7f3754071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.117+0000 7f375ae88640 1 --2- 172.21.15.55:0/3330263642 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37540ad950 0x7f3754070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.117+0000 7f375ae88640 1 -- 172.21.15.55:0/3330263642 >> 172.21.15.55:0/3330263642 conn(0x7f3754069d00 msgr2=0x7f375415d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:47.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.117+0000 7f375ae88640 1 -- 172.21.15.55:0/3330263642 shutdown_connections 2023-08-25T05:18:47.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.117+0000 7f375ae88640 1 -- 172.21.15.55:0/3330263642 wait complete. 2023-08-25T05:18:47.138 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-08-25T05:18:46.749930+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1424,"num_read_kb":2961,"num_write":469,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3614,"ondisk_log_size":3614,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":206,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":375520,"kb_used_data":16424,"kb_used_omap":13,"kb_used_meta":358962,"kb_avail":754599200,"statfs":{"total":773094113280,"available":772709580800,"internally_reserved":0,"allocated":16818176,"data_stored":9043124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":367577176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.770953"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264078+0000","last_change":"2023-08-25T05:18:43.021284+0000","last_active":"2023-08-25T05:18:44.264078+0000","last_peered":"2023-08-25T05:18:44.264078+0000","last_clean":"2023-08-25T05:18:44.264078+0000","last_became_active":"2023-08-25T05:18:43.020830+0000","last_became_peered":"2023-08-25T05:18:43.020830+0000","last_unstale":"2023-08-25T05:18:44.264078+0000","last_undegraded":"2023-08-25T05:18:44.264078+0000","last_fullsized":"2023-08-25T05:18:44.264078+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:07:49.562671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265168+0000","last_change":"2023-08-25T05:18:43.013629+0000","last_active":"2023-08-25T05:18:44.265168+0000","last_peered":"2023-08-25T05:18:44.265168+0000","last_clean":"2023-08-25T05:18:44.265168+0000","last_became_active":"2023-08-25T05:18:43.013334+0000","last_became_peered":"2023-08-25T05:18:43.013334+0000","last_unstale":"2023-08-25T05:18:44.265168+0000","last_undegraded":"2023-08-25T05:18:44.265168+0000","last_fullsized":"2023-08-25T05:18:44.265168+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:06.710698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266017+0000","last_change":"2023-08-25T05:18:43.016711+0000","last_active":"2023-08-25T05:18:44.266017+0000","last_peered":"2023-08-25T05:18:44.266017+0000","last_clean":"2023-08-25T05:18:44.266017+0000","last_became_active":"2023-08-25T05:18:43.016411+0000","last_became_peered":"2023-08-25T05:18:43.016411+0000","last_unstale":"2023-08-25T05:18:44.266017+0000","last_undegraded":"2023-08-25T05:18:44.266017+0000","last_fullsized":"2023-08-25T05:18:44.266017+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:46:52.296912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265070+0000","last_change":"2023-08-25T05:18:43.020172+0000","last_active":"2023-08-25T05:18:44.265070+0000","last_peered":"2023-08-25T05:18:44.265070+0000","last_clean":"2023-08-25T05:18:44.265070+0000","last_became_active":"2023-08-25T05:18:43.019592+0000","last_became_peered":"2023-08-25T05:18:43.019592+0000","last_unstale":"2023-08-25T05:18:44.265070+0000","last_undegraded":"2023-08-25T05:18:44.265070+0000","last_fullsized":"2023-08-25T05:18:44.265070+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:43:08.063330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.028898+0000","last_change":"2023-08-25T05:18:43.022655+0000","last_active":"2023-08-25T05:18:44.028898+0000","last_peered":"2023-08-25T05:18:44.028898+0000","last_clean":"2023-08-25T05:18:44.028898+0000","last_became_active":"2023-08-25T05:18:43.022319+0000","last_became_peered":"2023-08-25T05:18:43.022319+0000","last_unstale":"2023-08-25T05:18:44.028898+0000","last_undegraded":"2023-08-25T05:18:44.028898+0000","last_fullsized":"2023-08-25T05:18:44.028898+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:57:35.517926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264362+0000","last_change":"2023-08-25T05:18:43.012604+0000","last_active":"2023-08-25T05:18:44.264362+0000","last_peered":"2023-08-25T05:18:44.264362+0000","last_clean":"2023-08-25T05:18:44.264362+0000","last_became_active":"2023-08-25T05:18:43.012289+0000","last_became_peered":"2023-08-25T05:18:43.012289+0000","last_unstale":"2023-08-25T05:18:44.264362+0000","last_undegraded":"2023-08-25T05:18:44.264362+0000","last_fullsized":"2023-08-25T05:18:44.264362+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:59:45.018075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.022974+0000","last_change":"2023-08-25T05:18:43.024661+0000","last_active":"2023-08-25T05:18:44.022974+0000","last_peered":"2023-08-25T05:18:44.022974+0000","last_clean":"2023-08-25T05:18:44.022974+0000","last_became_active":"2023-08-25T05:18:43.024381+0000","last_became_peered":"2023-08-25T05:18:43.024381+0000","last_unstale":"2023-08-25T05:18:44.022974+0000","last_undegraded":"2023-08-25T05:18:44.022974+0000","last_fullsized":"2023-08-25T05:18:44.022974+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:33:04.351022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.022797+0000","last_change":"2023-08-25T05:18:43.019590+0000","last_active":"2023-08-25T05:18:44.022797+0000","last_peered":"2023-08-25T05:18:44.022797+0000","last_clean":"2023-08-25T05:18:44.022797+0000","last_became_active":"2023-08-25T05:18:43.019304+0000","last_became_peered":"2023-08-25T05:18:43.019304+0000","last_unstale":"2023-08-25T05:18:44.022797+0000","last_undegraded":"2023-08-25T05:18:44.022797+0000","last_fullsized":"2023-08-25T05:18:44.022797+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:17:00.637276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264985+0000","last_change":"2023-08-25T05:18:43.015369+0000","last_active":"2023-08-25T05:18:44.264985+0000","last_peered":"2023-08-25T05:18:44.264985+0000","last_clean":"2023-08-25T05:18:44.264985+0000","last_became_active":"2023-08-25T05:18:43.015069+0000","last_became_peered":"2023-08-25T05:18:43.015069+0000","last_unstale":"2023-08-25T05:18:44.264985+0000","last_undegraded":"2023-08-25T05:18:44.264985+0000","last_fullsized":"2023-08-25T05:18:44.264985+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:23.489370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264174+0000","last_change":"2023-08-25T05:18:43.022490+0000","last_active":"2023-08-25T05:18:44.264174+0000","last_peered":"2023-08-25T05:18:44.264174+0000","last_clean":"2023-08-25T05:18:44.264174+0000","last_became_active":"2023-08-25T05:18:43.022198+0000","last_became_peered":"2023-08-25T05:18:43.022198+0000","last_unstale":"2023-08-25T05:18:44.264174+0000","last_undegraded":"2023-08-25T05:18:44.264174+0000","last_fullsized":"2023-08-25T05:18:44.264174+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:30:51.261368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265060+0000","last_change":"2023-08-25T05:18:43.017932+0000","last_active":"2023-08-25T05:18:44.265060+0000","last_peered":"2023-08-25T05:18:44.265060+0000","last_clean":"2023-08-25T05:18:44.265060+0000","last_became_active":"2023-08-25T05:18:43.017653+0000","last_became_peered":"2023-08-25T05:18:43.017653+0000","last_unstale":"2023-08-25T05:18:44.265060+0000","last_undegraded":"2023-08-25T05:18:44.265060+0000","last_fullsized":"2023-08-25T05:18:44.265060+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:30:51.261368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264187+0000","last_change":"2023-08-25T05:18:43.015559+0000","last_active":"2023-08-25T05:18:44.264187+0000","last_peered":"2023-08-25T05:18:44.264187+0000","last_clean":"2023-08-25T05:18:44.264187+0000","last_became_active":"2023-08-25T05:18:43.015244+0000","last_became_peered":"2023-08-25T05:18:43.015244+0000","last_unstale":"2023-08-25T05:18:44.264187+0000","last_undegraded":"2023-08-25T05:18:44.264187+0000","last_fullsized":"2023-08-25T05:18:44.264187+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:18:17.009667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265057+0000","last_change":"2023-08-25T05:18:43.019589+0000","last_active":"2023-08-25T05:18:44.265057+0000","last_peered":"2023-08-25T05:18:44.265057+0000","last_clean":"2023-08-25T05:18:44.265057+0000","last_became_active":"2023-08-25T05:18:43.018628+0000","last_became_peered":"2023-08-25T05:18:43.018628+0000","last_unstale":"2023-08-25T05:18:44.265057+0000","last_undegraded":"2023-08-25T05:18:44.265057+0000","last_fullsized":"2023-08-25T05:18:44.265057+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:53.031570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.263832+0000","last_change":"2023-08-25T05:18:43.021596+0000","last_active":"2023-08-25T05:18:44.263832+0000","last_peered":"2023-08-25T05:18:44.263832+0000","last_clean":"2023-08-25T05:18:44.263832+0000","last_became_active":"2023-08-25T05:18:43.021248+0000","last_became_peered":"2023-08-25T05:18:43.021248+0000","last_unstale":"2023-08-25T05:18:44.263832+0000","last_undegraded":"2023-08-25T05:18:44.263832+0000","last_fullsized":"2023-08-25T05:18:44.263832+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:20:32.896054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.263615+0000","last_change":"2023-08-25T05:18:43.021494+0000","last_active":"2023-08-25T05:18:44.263615+0000","last_peered":"2023-08-25T05:18:44.263615+0000","last_clean":"2023-08-25T05:18:44.263615+0000","last_became_active":"2023-08-25T05:18:43.020911+0000","last_became_peered":"2023-08-25T05:18:43.020911+0000","last_unstale":"2023-08-25T05:18:44.263615+0000","last_undegraded":"2023-08-25T05:18:44.263615+0000","last_fullsized":"2023-08-25T05:18:44.263615+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:43:54.302758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264310+0000","last_change":"2023-08-25T05:18:43.019081+0000","last_active":"2023-08-25T05:18:44.264310+0000","last_peered":"2023-08-25T05:18:44.264310+0000","last_clean":"2023-08-25T05:18:44.264310+0000","last_became_active":"2023-08-25T05:18:43.016700+0000","last_became_peered":"2023-08-25T05:18:43.016700+0000","last_unstale":"2023-08-25T05:18:44.264310+0000","last_undegraded":"2023-08-25T05:18:44.264310+0000","last_fullsized":"2023-08-25T05:18:44.264310+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:09:33.219395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265019+0000","last_change":"2023-08-25T05:18:43.018756+0000","last_active":"2023-08-25T05:18:44.265019+0000","last_peered":"2023-08-25T05:18:44.265019+0000","last_clean":"2023-08-25T05:18:44.265019+0000","last_became_active":"2023-08-25T05:18:43.018435+0000","last_became_peered":"2023-08-25T05:18:43.018435+0000","last_unstale":"2023-08-25T05:18:44.265019+0000","last_undegraded":"2023-08-25T05:18:44.265019+0000","last_fullsized":"2023-08-25T05:18:44.265019+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:19.500588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.029180+0000","last_change":"2023-08-25T05:18:43.023678+0000","last_active":"2023-08-25T05:18:44.029180+0000","last_peered":"2023-08-25T05:18:44.029180+0000","last_clean":"2023-08-25T05:18:44.029180+0000","last_became_active":"2023-08-25T05:18:43.021965+0000","last_became_peered":"2023-08-25T05:18:43.021965+0000","last_unstale":"2023-08-25T05:18:44.029180+0000","last_undegraded":"2023-08-25T05:18:44.029180+0000","last_fullsized":"2023-08-25T05:18:44.029180+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:46:36.177659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024082+0000","last_change":"2023-08-25T05:18:43.026887+0000","last_active":"2023-08-25T05:18:44.024082+0000","last_peered":"2023-08-25T05:18:44.024082+0000","last_clean":"2023-08-25T05:18:44.024082+0000","last_became_active":"2023-08-25T05:18:43.026608+0000","last_became_peered":"2023-08-25T05:18:43.026608+0000","last_unstale":"2023-08-25T05:18:44.024082+0000","last_undegraded":"2023-08-25T05:18:44.024082+0000","last_fullsized":"2023-08-25T05:18:44.024082+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:14:13.909304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.029004+0000","last_change":"2023-08-25T05:18:43.021647+0000","last_active":"2023-08-25T05:18:44.029004+0000","last_peered":"2023-08-25T05:18:44.029004+0000","last_clean":"2023-08-25T05:18:44.029004+0000","last_became_active":"2023-08-25T05:18:43.021347+0000","last_became_peered":"2023-08-25T05:18:43.021347+0000","last_unstale":"2023-08-25T05:18:44.029004+0000","last_undegraded":"2023-08-25T05:18:44.029004+0000","last_fullsized":"2023-08-25T05:18:44.029004+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:16:27.975505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265000+0000","last_change":"2023-08-25T05:18:43.018967+0000","last_active":"2023-08-25T05:18:44.265000+0000","last_peered":"2023-08-25T05:18:44.265000+0000","last_clean":"2023-08-25T05:18:44.265000+0000","last_became_active":"2023-08-25T05:18:43.018672+0000","last_became_peered":"2023-08-25T05:18:43.018672+0000","last_unstale":"2023-08-25T05:18:44.265000+0000","last_undegraded":"2023-08-25T05:18:44.265000+0000","last_fullsized":"2023-08-25T05:18:44.265000+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:00:10.435407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.263710+0000","last_change":"2023-08-25T05:18:43.013956+0000","last_active":"2023-08-25T05:18:44.263710+0000","last_peered":"2023-08-25T05:18:44.263710+0000","last_clean":"2023-08-25T05:18:44.263710+0000","last_became_active":"2023-08-25T05:18:43.013557+0000","last_became_peered":"2023-08-25T05:18:43.013557+0000","last_unstale":"2023-08-25T05:18:44.263710+0000","last_undegraded":"2023-08-25T05:18:44.263710+0000","last_fullsized":"2023-08-25T05:18:44.263710+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:07:38.755466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265153+0000","last_change":"2023-08-25T05:18:43.018588+0000","last_active":"2023-08-25T05:18:44.265153+0000","last_peered":"2023-08-25T05:18:44.265153+0000","last_clean":"2023-08-25T05:18:44.265153+0000","last_became_active":"2023-08-25T05:18:43.018281+0000","last_became_peered":"2023-08-25T05:18:43.018281+0000","last_unstale":"2023-08-25T05:18:44.265153+0000","last_undegraded":"2023-08-25T05:18:44.265153+0000","last_fullsized":"2023-08-25T05:18:44.265153+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:23:36.539232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264470+0000","last_change":"2023-08-25T05:18:43.014804+0000","last_active":"2023-08-25T05:18:44.264470+0000","last_peered":"2023-08-25T05:18:44.264470+0000","last_clean":"2023-08-25T05:18:44.264470+0000","last_became_active":"2023-08-25T05:18:43.014476+0000","last_became_peered":"2023-08-25T05:18:43.014476+0000","last_unstale":"2023-08-25T05:18:44.264470+0000","last_undegraded":"2023-08-25T05:18:44.264470+0000","last_fullsized":"2023-08-25T05:18:44.264470+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:27.816099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266390+0000","last_change":"2023-08-25T05:18:43.016896+0000","last_active":"2023-08-25T05:18:44.266390+0000","last_peered":"2023-08-25T05:18:44.266390+0000","last_clean":"2023-08-25T05:18:44.266390+0000","last_became_active":"2023-08-25T05:18:43.016508+0000","last_became_peered":"2023-08-25T05:18:43.016508+0000","last_unstale":"2023-08-25T05:18:44.266390+0000","last_undegraded":"2023-08-25T05:18:44.266390+0000","last_fullsized":"2023-08-25T05:18:44.266390+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:37:35.398558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266307+0000","last_change":"2023-08-25T05:18:43.022648+0000","last_active":"2023-08-25T05:18:44.266307+0000","last_peered":"2023-08-25T05:18:44.266307+0000","last_clean":"2023-08-25T05:18:44.266307+0000","last_became_active":"2023-08-25T05:18:43.022187+0000","last_became_peered":"2023-08-25T05:18:43.022187+0000","last_unstale":"2023-08-25T05:18:44.266307+0000","last_undegraded":"2023-08-25T05:18:44.266307+0000","last_fullsized":"2023-08-25T05:18:44.266307+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:19:33.722951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024243+0000","last_change":"2023-08-25T05:18:43.034166+0000","last_active":"2023-08-25T05:18:44.024243+0000","last_peered":"2023-08-25T05:18:44.024243+0000","last_clean":"2023-08-25T05:18:44.024243+0000","last_became_active":"2023-08-25T05:18:43.033854+0000","last_became_peered":"2023-08-25T05:18:43.033854+0000","last_unstale":"2023-08-25T05:18:44.024243+0000","last_undegraded":"2023-08-25T05:18:44.024243+0000","last_fullsized":"2023-08-25T05:18:44.024243+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:40:10.500869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264476+0000","last_change":"2023-08-25T05:18:43.022340+0000","last_active":"2023-08-25T05:18:44.264476+0000","last_peered":"2023-08-25T05:18:44.264476+0000","last_clean":"2023-08-25T05:18:44.264476+0000","last_became_active":"2023-08-25T05:18:43.022055+0000","last_became_peered":"2023-08-25T05:18:43.022055+0000","last_unstale":"2023-08-25T05:18:44.264476+0000","last_undegraded":"2023-08-25T05:18:44.264476+0000","last_fullsized":"2023-08-25T05:18:44.264476+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:06.710698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266256+0000","last_change":"2023-08-25T05:18:43.023425+0000","last_active":"2023-08-25T05:18:44.266256+0000","last_peered":"2023-08-25T05:18:44.266256+0000","last_clean":"2023-08-25T05:18:44.266256+0000","last_became_active":"2023-08-25T05:18:43.022664+0000","last_became_peered":"2023-08-25T05:18:43.022664+0000","last_unstale":"2023-08-25T05:18:44.266256+0000","last_undegraded":"2023-08-25T05:18:44.266256+0000","last_fullsized":"2023-08-25T05:18:44.266256+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:16:55.474578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265988+0000","last_change":"2023-08-25T05:18:43.013793+0000","last_active":"2023-08-25T05:18:44.265988+0000","last_peered":"2023-08-25T05:18:44.265988+0000","last_clean":"2023-08-25T05:18:44.265988+0000","last_became_active":"2023-08-25T05:18:43.013465+0000","last_became_peered":"2023-08-25T05:18:43.013465+0000","last_unstale":"2023-08-25T05:18:44.265988+0000","last_undegraded":"2023-08-25T05:18:44.265988+0000","last_fullsized":"2023-08-25T05:18:44.265988+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:04.778381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.022797+0000","last_change":"2023-08-25T05:18:43.017883+0000","last_active":"2023-08-25T05:18:44.022797+0000","last_peered":"2023-08-25T05:18:44.022797+0000","last_clean":"2023-08-25T05:18:44.022797+0000","last_became_active":"2023-08-25T05:18:43.017617+0000","last_became_peered":"2023-08-25T05:18:43.017617+0000","last_unstale":"2023-08-25T05:18:44.022797+0000","last_undegraded":"2023-08-25T05:18:44.022797+0000","last_fullsized":"2023-08-25T05:18:44.022797+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:02:11.931674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264382+0000","last_change":"2023-08-25T05:18:43.018110+0000","last_active":"2023-08-25T05:18:44.264382+0000","last_peered":"2023-08-25T05:18:44.264382+0000","last_clean":"2023-08-25T05:18:44.264382+0000","last_became_active":"2023-08-25T05:18:43.017785+0000","last_became_peered":"2023-08-25T05:18:43.017785+0000","last_unstale":"2023-08-25T05:18:44.264382+0000","last_undegraded":"2023-08-25T05:18:44.264382+0000","last_fullsized":"2023-08-25T05:18:44.264382+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:43:08.063330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.022929+0000","last_change":"2023-08-25T05:18:43.016575+0000","last_active":"2023-08-25T05:18:44.022929+0000","last_peered":"2023-08-25T05:18:44.022929+0000","last_clean":"2023-08-25T05:18:44.022929+0000","last_became_active":"2023-08-25T05:18:43.014556+0000","last_became_peered":"2023-08-25T05:18:43.014556+0000","last_unstale":"2023-08-25T05:18:44.022929+0000","last_undegraded":"2023-08-25T05:18:44.022929+0000","last_fullsized":"2023-08-25T05:18:44.022929+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:57:53.494446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"156'4","reported_seq":17,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266415+0000","last_change":"2023-08-25T05:18:42.003929+0000","last_active":"2023-08-25T05:18:44.266415+0000","last_peered":"2023-08-25T05:18:44.266415+0000","last_clean":"2023-08-25T05:18:44.266415+0000","last_became_active":"2023-08-25T05:18:42.003615+0000","last_became_peered":"2023-08-25T05:18:42.003615+0000","last_unstale":"2023-08-25T05:18:44.266415+0000","last_undegraded":"2023-08-25T05:18:44.266415+0000","last_fullsized":"2023-08-25T05:18:44.266415+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:33:11.340984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.263688+0000","last_change":"2023-08-25T05:18:43.014166+0000","last_active":"2023-08-25T05:18:44.263688+0000","last_peered":"2023-08-25T05:18:44.263688+0000","last_clean":"2023-08-25T05:18:44.263688+0000","last_became_active":"2023-08-25T05:18:43.013551+0000","last_became_peered":"2023-08-25T05:18:43.013551+0000","last_unstale":"2023-08-25T05:18:44.263688+0000","last_undegraded":"2023-08-25T05:18:44.263688+0000","last_fullsized":"2023-08-25T05:18:44.263688+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:56:48.071241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.029353+0000","last_change":"2023-08-25T05:18:42.004500+0000","last_active":"2023-08-25T05:18:44.029353+0000","last_peered":"2023-08-25T05:18:44.029353+0000","last_clean":"2023-08-25T05:18:44.029353+0000","last_became_active":"2023-08-25T05:18:42.004225+0000","last_became_peered":"2023-08-25T05:18:42.004225+0000","last_unstale":"2023-08-25T05:18:44.029353+0000","last_undegraded":"2023-08-25T05:18:44.029353+0000","last_fullsized":"2023-08-25T05:18:44.029353+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:58.109732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265319+0000","last_change":"2023-08-25T05:18:43.028870+0000","last_active":"2023-08-25T05:18:44.265319+0000","last_peered":"2023-08-25T05:18:44.265319+0000","last_clean":"2023-08-25T05:18:44.265319+0000","last_became_active":"2023-08-25T05:18:43.028519+0000","last_became_peered":"2023-08-25T05:18:43.028519+0000","last_unstale":"2023-08-25T05:18:44.265319+0000","last_undegraded":"2023-08-25T05:18:44.265319+0000","last_fullsized":"2023-08-25T05:18:44.265319+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:23:59.977624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024375+0000","last_change":"2023-08-25T05:18:42.008868+0000","last_active":"2023-08-25T05:18:44.024375+0000","last_peered":"2023-08-25T05:18:44.024375+0000","last_clean":"2023-08-25T05:18:44.024375+0000","last_became_active":"2023-08-25T05:18:42.008503+0000","last_became_peered":"2023-08-25T05:18:42.008503+0000","last_unstale":"2023-08-25T05:18:44.024375+0000","last_undegraded":"2023-08-25T05:18:44.024375+0000","last_fullsized":"2023-08-25T05:18:44.024375+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:58:48.970670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264914+0000","last_change":"2023-08-25T05:18:43.028485+0000","last_active":"2023-08-25T05:18:44.264914+0000","last_peered":"2023-08-25T05:18:44.264914+0000","last_clean":"2023-08-25T05:18:44.264914+0000","last_became_active":"2023-08-25T05:18:43.028202+0000","last_became_peered":"2023-08-25T05:18:43.028202+0000","last_unstale":"2023-08-25T05:18:44.264914+0000","last_undegraded":"2023-08-25T05:18:44.264914+0000","last_fullsized":"2023-08-25T05:18:44.264914+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:30.215736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024164+0000","last_change":"2023-08-25T05:18:42.004258+0000","last_active":"2023-08-25T05:18:44.024164+0000","last_peered":"2023-08-25T05:18:44.024164+0000","last_clean":"2023-08-25T05:18:44.024164+0000","last_became_active":"2023-08-25T05:18:42.003976+0000","last_became_peered":"2023-08-25T05:18:42.003976+0000","last_unstale":"2023-08-25T05:18:44.024164+0000","last_undegraded":"2023-08-25T05:18:44.024164+0000","last_fullsized":"2023-08-25T05:18:44.024164+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:56:49.062002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023420+0000","last_change":"2023-08-25T05:18:43.018719+0000","last_active":"2023-08-25T05:18:44.023420+0000","last_peered":"2023-08-25T05:18:44.023420+0000","last_clean":"2023-08-25T05:18:44.023420+0000","last_became_active":"2023-08-25T05:18:43.018416+0000","last_became_peered":"2023-08-25T05:18:43.018416+0000","last_unstale":"2023-08-25T05:18:44.023420+0000","last_undegraded":"2023-08-25T05:18:44.023420+0000","last_fullsized":"2023-08-25T05:18:44.023420+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:39:40.809179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023105+0000","last_change":"2023-08-25T05:18:42.000199+0000","last_active":"2023-08-25T05:18:44.023105+0000","last_peered":"2023-08-25T05:18:44.023105+0000","last_clean":"2023-08-25T05:18:44.023105+0000","last_became_active":"2023-08-25T05:18:41.999901+0000","last_became_peered":"2023-08-25T05:18:41.999901+0000","last_unstale":"2023-08-25T05:18:44.023105+0000","last_undegraded":"2023-08-25T05:18:44.023105+0000","last_fullsized":"2023-08-25T05:18:44.023105+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:36:16.996309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023335+0000","last_change":"2023-08-25T05:18:43.019416+0000","last_active":"2023-08-25T05:18:44.023335+0000","last_peered":"2023-08-25T05:18:44.023335+0000","last_clean":"2023-08-25T05:18:44.023335+0000","last_became_active":"2023-08-25T05:18:43.019140+0000","last_became_peered":"2023-08-25T05:18:43.019140+0000","last_unstale":"2023-08-25T05:18:44.023335+0000","last_undegraded":"2023-08-25T05:18:44.023335+0000","last_fullsized":"2023-08-25T05:18:44.023335+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:39:14.210220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.028857+0000","last_change":"2023-08-25T05:18:41.997440+0000","last_active":"2023-08-25T05:18:44.028857+0000","last_peered":"2023-08-25T05:18:44.028857+0000","last_clean":"2023-08-25T05:18:44.028857+0000","last_became_active":"2023-08-25T05:18:41.997159+0000","last_became_peered":"2023-08-25T05:18:41.997159+0000","last_unstale":"2023-08-25T05:18:44.028857+0000","last_undegraded":"2023-08-25T05:18:44.028857+0000","last_fullsized":"2023-08-25T05:18:44.028857+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:06:20.702134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.029282+0000","last_change":"2023-08-25T05:18:43.028078+0000","last_active":"2023-08-25T05:18:44.029282+0000","last_peered":"2023-08-25T05:18:44.029282+0000","last_clean":"2023-08-25T05:18:44.029282+0000","last_became_active":"2023-08-25T05:18:43.027806+0000","last_became_peered":"2023-08-25T05:18:43.027806+0000","last_unstale":"2023-08-25T05:18:44.029282+0000","last_undegraded":"2023-08-25T05:18:44.029282+0000","last_fullsized":"2023-08-25T05:18:44.029282+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:14.357059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264577+0000","last_change":"2023-08-25T05:18:41.997124+0000","last_active":"2023-08-25T05:18:44.264577+0000","last_peered":"2023-08-25T05:18:44.264577+0000","last_clean":"2023-08-25T05:18:44.264577+0000","last_became_active":"2023-08-25T05:18:41.996819+0000","last_became_peered":"2023-08-25T05:18:41.996819+0000","last_unstale":"2023-08-25T05:18:44.264577+0000","last_undegraded":"2023-08-25T05:18:44.264577+0000","last_fullsized":"2023-08-25T05:18:44.264577+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:44:10.470149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024062+0000","last_change":"2023-08-25T05:18:43.030926+0000","last_active":"2023-08-25T05:18:44.024062+0000","last_peered":"2023-08-25T05:18:44.024062+0000","last_clean":"2023-08-25T05:18:44.024062+0000","last_became_active":"2023-08-25T05:18:43.030669+0000","last_became_peered":"2023-08-25T05:18:43.030669+0000","last_unstale":"2023-08-25T05:18:44.024062+0000","last_undegraded":"2023-08-25T05:18:44.024062+0000","last_fullsized":"2023-08-25T05:18:44.024062+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:44:07.458954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265884+0000","last_change":"2023-08-25T05:18:41.999760+0000","last_active":"2023-08-25T05:18:44.265884+0000","last_peered":"2023-08-25T05:18:44.265884+0000","last_clean":"2023-08-25T05:18:44.265884+0000","last_became_active":"2023-08-25T05:18:41.999487+0000","last_became_peered":"2023-08-25T05:18:41.999487+0000","last_unstale":"2023-08-25T05:18:44.265884+0000","last_undegraded":"2023-08-25T05:18:44.265884+0000","last_fullsized":"2023-08-25T05:18:44.265884+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:00:01.681325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265777+0000","last_change":"2023-08-25T05:18:43.017295+0000","last_active":"2023-08-25T05:18:44.265777+0000","last_peered":"2023-08-25T05:18:44.265777+0000","last_clean":"2023-08-25T05:18:44.265777+0000","last_became_active":"2023-08-25T05:18:43.016969+0000","last_became_peered":"2023-08-25T05:18:43.016969+0000","last_unstale":"2023-08-25T05:18:44.265777+0000","last_undegraded":"2023-08-25T05:18:44.265777+0000","last_fullsized":"2023-08-25T05:18:44.265777+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:48.052436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265465+0000","last_change":"2023-08-25T05:18:42.003823+0000","last_active":"2023-08-25T05:18:44.265465+0000","last_peered":"2023-08-25T05:18:44.265465+0000","last_clean":"2023-08-25T05:18:44.265465+0000","last_became_active":"2023-08-25T05:18:42.003512+0000","last_became_peered":"2023-08-25T05:18:42.003512+0000","last_unstale":"2023-08-25T05:18:44.265465+0000","last_undegraded":"2023-08-25T05:18:44.265465+0000","last_fullsized":"2023-08-25T05:18:44.265465+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:26:03.670562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023107+0000","last_change":"2023-08-25T05:18:43.025160+0000","last_active":"2023-08-25T05:18:44.023107+0000","last_peered":"2023-08-25T05:18:44.023107+0000","last_clean":"2023-08-25T05:18:44.023107+0000","last_became_active":"2023-08-25T05:18:43.024883+0000","last_became_peered":"2023-08-25T05:18:43.024883+0000","last_unstale":"2023-08-25T05:18:44.023107+0000","last_undegraded":"2023-08-25T05:18:44.023107+0000","last_fullsized":"2023-08-25T05:18:44.023107+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:12:22.988678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266306+0000","last_change":"2023-08-25T05:18:42.002477+0000","last_active":"2023-08-25T05:18:44.266306+0000","last_peered":"2023-08-25T05:18:44.266306+0000","last_clean":"2023-08-25T05:18:44.266306+0000","last_became_active":"2023-08-25T05:18:42.002189+0000","last_became_peered":"2023-08-25T05:18:42.002189+0000","last_unstale":"2023-08-25T05:18:44.266306+0000","last_undegraded":"2023-08-25T05:18:44.266306+0000","last_fullsized":"2023-08-25T05:18:44.266306+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:54:33.888415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023834+0000","last_change":"2023-08-25T05:18:43.035745+0000","last_active":"2023-08-25T05:18:44.023834+0000","last_peered":"2023-08-25T05:18:44.023834+0000","last_clean":"2023-08-25T05:18:44.023834+0000","last_became_active":"2023-08-25T05:18:43.033701+0000","last_became_peered":"2023-08-25T05:18:43.033701+0000","last_unstale":"2023-08-25T05:18:44.023834+0000","last_undegraded":"2023-08-25T05:18:44.023834+0000","last_fullsized":"2023-08-25T05:18:44.023834+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:56:19.448594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264890+0000","last_change":"2023-08-25T05:18:41.997558+0000","last_active":"2023-08-25T05:18:44.264890+0000","last_peered":"2023-08-25T05:18:44.264890+0000","last_clean":"2023-08-25T05:18:44.264890+0000","last_became_active":"2023-08-25T05:18:41.997225+0000","last_became_peered":"2023-08-25T05:18:41.997225+0000","last_unstale":"2023-08-25T05:18:44.264890+0000","last_undegraded":"2023-08-25T05:18:44.264890+0000","last_fullsized":"2023-08-25T05:18:44.264890+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:52:16.648509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264436+0000","last_change":"2023-08-25T05:18:43.027665+0000","last_active":"2023-08-25T05:18:44.264436+0000","last_peered":"2023-08-25T05:18:44.264436+0000","last_clean":"2023-08-25T05:18:44.264436+0000","last_became_active":"2023-08-25T05:18:43.023946+0000","last_became_peered":"2023-08-25T05:18:43.023946+0000","last_unstale":"2023-08-25T05:18:44.264436+0000","last_undegraded":"2023-08-25T05:18:44.264436+0000","last_fullsized":"2023-08-25T05:18:44.264436+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:23:36.539232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.029134+0000","last_change":"2023-08-25T05:18:42.000131+0000","last_active":"2023-08-25T05:18:44.029134+0000","last_peered":"2023-08-25T05:18:44.029134+0000","last_clean":"2023-08-25T05:18:44.029134+0000","last_became_active":"2023-08-25T05:18:41.999838+0000","last_became_peered":"2023-08-25T05:18:41.999838+0000","last_unstale":"2023-08-25T05:18:44.029134+0000","last_undegraded":"2023-08-25T05:18:44.029134+0000","last_fullsized":"2023-08-25T05:18:44.029134+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:13.182230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.029040+0000","last_change":"2023-08-25T05:18:43.026481+0000","last_active":"2023-08-25T05:18:44.029040+0000","last_peered":"2023-08-25T05:18:44.029040+0000","last_clean":"2023-08-25T05:18:44.029040+0000","last_became_active":"2023-08-25T05:18:43.024448+0000","last_became_peered":"2023-08-25T05:18:43.024448+0000","last_unstale":"2023-08-25T05:18:44.029040+0000","last_undegraded":"2023-08-25T05:18:44.029040+0000","last_fullsized":"2023-08-25T05:18:44.029040+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:36:10.249255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023232+0000","last_change":"2023-08-25T05:18:41.997520+0000","last_active":"2023-08-25T05:18:44.023232+0000","last_peered":"2023-08-25T05:18:44.023232+0000","last_clean":"2023-08-25T05:18:44.023232+0000","last_became_active":"2023-08-25T05:18:41.997027+0000","last_became_peered":"2023-08-25T05:18:41.997027+0000","last_unstale":"2023-08-25T05:18:44.023232+0000","last_undegraded":"2023-08-25T05:18:44.023232+0000","last_fullsized":"2023-08-25T05:18:44.023232+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:28:38.120100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264073+0000","last_change":"2023-08-25T05:18:43.025907+0000","last_active":"2023-08-25T05:18:44.264073+0000","last_peered":"2023-08-25T05:18:44.264073+0000","last_clean":"2023-08-25T05:18:44.264073+0000","last_became_active":"2023-08-25T05:18:43.025608+0000","last_became_peered":"2023-08-25T05:18:43.025608+0000","last_unstale":"2023-08-25T05:18:44.264073+0000","last_undegraded":"2023-08-25T05:18:44.264073+0000","last_fullsized":"2023-08-25T05:18:44.264073+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:39.176775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.263839+0000","last_change":"2023-08-25T05:18:41.996610+0000","last_active":"2023-08-25T05:18:44.263839+0000","last_peered":"2023-08-25T05:18:44.263839+0000","last_clean":"2023-08-25T05:18:44.263839+0000","last_became_active":"2023-08-25T05:18:41.996226+0000","last_became_peered":"2023-08-25T05:18:41.996226+0000","last_unstale":"2023-08-25T05:18:44.263839+0000","last_undegraded":"2023-08-25T05:18:44.263839+0000","last_fullsized":"2023-08-25T05:18:44.263839+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:15:42.883652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.029317+0000","last_change":"2023-08-25T05:18:43.022548+0000","last_active":"2023-08-25T05:18:44.029317+0000","last_peered":"2023-08-25T05:18:44.029317+0000","last_clean":"2023-08-25T05:18:44.029317+0000","last_became_active":"2023-08-25T05:18:43.022262+0000","last_became_peered":"2023-08-25T05:18:43.022262+0000","last_unstale":"2023-08-25T05:18:44.029317+0000","last_undegraded":"2023-08-25T05:18:44.029317+0000","last_fullsized":"2023-08-25T05:18:44.029317+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:13:22.966274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023266+0000","last_change":"2023-08-25T05:18:42.009616+0000","last_active":"2023-08-25T05:18:44.023266+0000","last_peered":"2023-08-25T05:18:44.023266+0000","last_clean":"2023-08-25T05:18:44.023266+0000","last_became_active":"2023-08-25T05:18:42.009122+0000","last_became_peered":"2023-08-25T05:18:42.009122+0000","last_unstale":"2023-08-25T05:18:44.023266+0000","last_undegraded":"2023-08-25T05:18:44.023266+0000","last_fullsized":"2023-08-25T05:18:44.023266+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:15:01.126641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265385+0000","last_change":"2023-08-25T05:18:43.017831+0000","last_active":"2023-08-25T05:18:44.265385+0000","last_peered":"2023-08-25T05:18:44.265385+0000","last_clean":"2023-08-25T05:18:44.265385+0000","last_became_active":"2023-08-25T05:18:43.017515+0000","last_became_peered":"2023-08-25T05:18:43.017515+0000","last_unstale":"2023-08-25T05:18:44.265385+0000","last_undegraded":"2023-08-25T05:18:44.265385+0000","last_fullsized":"2023-08-25T05:18:44.265385+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:58:35.505256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264799+0000","last_change":"2023-08-25T05:18:42.001493+0000","last_active":"2023-08-25T05:18:44.264799+0000","last_peered":"2023-08-25T05:18:44.264799+0000","last_clean":"2023-08-25T05:18:44.264799+0000","last_became_active":"2023-08-25T05:18:42.001207+0000","last_became_peered":"2023-08-25T05:18:42.001207+0000","last_unstale":"2023-08-25T05:18:44.264799+0000","last_undegraded":"2023-08-25T05:18:44.264799+0000","last_fullsized":"2023-08-25T05:18:44.264799+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:38:40.941750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.028896+0000","last_change":"2023-08-25T05:18:43.028728+0000","last_active":"2023-08-25T05:18:44.028896+0000","last_peered":"2023-08-25T05:18:44.028896+0000","last_clean":"2023-08-25T05:18:44.028896+0000","last_became_active":"2023-08-25T05:18:43.028386+0000","last_became_peered":"2023-08-25T05:18:43.028386+0000","last_unstale":"2023-08-25T05:18:44.028896+0000","last_undegraded":"2023-08-25T05:18:44.028896+0000","last_fullsized":"2023-08-25T05:18:44.028896+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:04.171396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264283+0000","last_change":"2023-08-25T05:18:42.002206+0000","last_active":"2023-08-25T05:18:44.264283+0000","last_peered":"2023-08-25T05:18:44.264283+0000","last_clean":"2023-08-25T05:18:44.264283+0000","last_became_active":"2023-08-25T05:18:42.001920+0000","last_became_peered":"2023-08-25T05:18:42.001920+0000","last_unstale":"2023-08-25T05:18:44.264283+0000","last_undegraded":"2023-08-25T05:18:44.264283+0000","last_fullsized":"2023-08-25T05:18:44.264283+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:09:05.451822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265769+0000","last_change":"2023-08-25T05:18:43.021948+0000","last_active":"2023-08-25T05:18:44.265769+0000","last_peered":"2023-08-25T05:18:44.265769+0000","last_clean":"2023-08-25T05:18:44.265769+0000","last_became_active":"2023-08-25T05:18:43.021683+0000","last_became_peered":"2023-08-25T05:18:43.021683+0000","last_unstale":"2023-08-25T05:18:44.265769+0000","last_undegraded":"2023-08-25T05:18:44.265769+0000","last_fullsized":"2023-08-25T05:18:44.265769+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:06:41.412964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023632+0000","last_change":"2023-08-25T05:18:42.005532+0000","last_active":"2023-08-25T05:18:44.023632+0000","last_peered":"2023-08-25T05:18:44.023632+0000","last_clean":"2023-08-25T05:18:44.023632+0000","last_became_active":"2023-08-25T05:18:42.005252+0000","last_became_peered":"2023-08-25T05:18:42.005252+0000","last_unstale":"2023-08-25T05:18:44.023632+0000","last_undegraded":"2023-08-25T05:18:44.023632+0000","last_fullsized":"2023-08-25T05:18:44.023632+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:42:39.151805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023077+0000","last_change":"2023-08-25T05:18:43.027308+0000","last_active":"2023-08-25T05:18:44.023077+0000","last_peered":"2023-08-25T05:18:44.023077+0000","last_clean":"2023-08-25T05:18:44.023077+0000","last_became_active":"2023-08-25T05:18:43.027025+0000","last_became_peered":"2023-08-25T05:18:43.027025+0000","last_unstale":"2023-08-25T05:18:44.023077+0000","last_undegraded":"2023-08-25T05:18:44.023077+0000","last_fullsized":"2023-08-25T05:18:44.023077+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:42:34.144469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023448+0000","last_change":"2023-08-25T05:18:41.997664+0000","last_active":"2023-08-25T05:18:44.023448+0000","last_peered":"2023-08-25T05:18:44.023448+0000","last_clean":"2023-08-25T05:18:44.023448+0000","last_became_active":"2023-08-25T05:18:41.997306+0000","last_became_peered":"2023-08-25T05:18:41.997306+0000","last_unstale":"2023-08-25T05:18:44.023448+0000","last_undegraded":"2023-08-25T05:18:44.023448+0000","last_fullsized":"2023-08-25T05:18:44.023448+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:56:48.440336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264575+0000","last_change":"2023-08-25T05:18:43.026696+0000","last_active":"2023-08-25T05:18:44.264575+0000","last_peered":"2023-08-25T05:18:44.264575+0000","last_clean":"2023-08-25T05:18:44.264575+0000","last_became_active":"2023-08-25T05:18:43.023547+0000","last_became_peered":"2023-08-25T05:18:43.023547+0000","last_unstale":"2023-08-25T05:18:44.264575+0000","last_undegraded":"2023-08-25T05:18:44.264575+0000","last_fullsized":"2023-08-25T05:18:44.264575+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:24:26.928297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265129+0000","last_change":"2023-08-25T05:18:41.999051+0000","last_active":"2023-08-25T05:18:44.265129+0000","last_peered":"2023-08-25T05:18:44.265129+0000","last_clean":"2023-08-25T05:18:44.265129+0000","last_became_active":"2023-08-25T05:18:41.998743+0000","last_became_peered":"2023-08-25T05:18:41.998743+0000","last_unstale":"2023-08-25T05:18:44.265129+0000","last_undegraded":"2023-08-25T05:18:44.265129+0000","last_fullsized":"2023-08-25T05:18:44.265129+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:19.243492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265096+0000","last_change":"2023-08-25T05:18:43.016275+0000","last_active":"2023-08-25T05:18:44.265096+0000","last_peered":"2023-08-25T05:18:44.265096+0000","last_clean":"2023-08-25T05:18:44.265096+0000","last_became_active":"2023-08-25T05:18:43.013832+0000","last_became_peered":"2023-08-25T05:18:43.013832+0000","last_unstale":"2023-08-25T05:18:44.265096+0000","last_undegraded":"2023-08-25T05:18:44.265096+0000","last_fullsized":"2023-08-25T05:18:44.265096+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:30:14.175368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265348+0000","last_change":"2023-08-25T05:18:42.006062+0000","last_active":"2023-08-25T05:18:44.265348+0000","last_peered":"2023-08-25T05:18:44.265348+0000","last_clean":"2023-08-25T05:18:44.265348+0000","last_became_active":"2023-08-25T05:18:42.005637+0000","last_became_peered":"2023-08-25T05:18:42.005637+0000","last_unstale":"2023-08-25T05:18:44.265348+0000","last_undegraded":"2023-08-25T05:18:44.265348+0000","last_fullsized":"2023-08-25T05:18:44.265348+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:11:37.665172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264748+0000","last_change":"2023-08-25T05:18:43.016016+0000","last_active":"2023-08-25T05:18:44.264748+0000","last_peered":"2023-08-25T05:18:44.264748+0000","last_clean":"2023-08-25T05:18:44.264748+0000","last_became_active":"2023-08-25T05:18:43.015720+0000","last_became_peered":"2023-08-25T05:18:43.015720+0000","last_unstale":"2023-08-25T05:18:44.264748+0000","last_undegraded":"2023-08-25T05:18:44.264748+0000","last_fullsized":"2023-08-25T05:18:44.264748+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:53:39.126353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023821+0000","last_change":"2023-08-25T05:18:42.007961+0000","last_active":"2023-08-25T05:18:44.023821+0000","last_peered":"2023-08-25T05:18:44.023821+0000","last_clean":"2023-08-25T05:18:44.023821+0000","last_became_active":"2023-08-25T05:18:42.007709+0000","last_became_peered":"2023-08-25T05:18:42.007709+0000","last_unstale":"2023-08-25T05:18:44.023821+0000","last_undegraded":"2023-08-25T05:18:44.023821+0000","last_fullsized":"2023-08-25T05:18:44.023821+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:51:08.045361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264599+0000","last_change":"2023-08-25T05:18:43.023107+0000","last_active":"2023-08-25T05:18:44.264599+0000","last_peered":"2023-08-25T05:18:44.264599+0000","last_clean":"2023-08-25T05:18:44.264599+0000","last_became_active":"2023-08-25T05:18:43.022816+0000","last_became_peered":"2023-08-25T05:18:43.022816+0000","last_unstale":"2023-08-25T05:18:44.264599+0000","last_undegraded":"2023-08-25T05:18:44.264599+0000","last_fullsized":"2023-08-25T05:18:44.264599+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:22:47.802011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264958+0000","last_change":"2023-08-25T05:18:41.997712+0000","last_active":"2023-08-25T05:18:44.264958+0000","last_peered":"2023-08-25T05:18:44.264958+0000","last_clean":"2023-08-25T05:18:44.264958+0000","last_became_active":"2023-08-25T05:18:41.997370+0000","last_became_peered":"2023-08-25T05:18:41.997370+0000","last_unstale":"2023-08-25T05:18:44.264958+0000","last_undegraded":"2023-08-25T05:18:44.264958+0000","last_fullsized":"2023-08-25T05:18:44.264958+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:07.320076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024009+0000","last_change":"2023-08-25T05:18:43.026045+0000","last_active":"2023-08-25T05:18:44.024009+0000","last_peered":"2023-08-25T05:18:44.024009+0000","last_clean":"2023-08-25T05:18:44.024009+0000","last_became_active":"2023-08-25T05:18:43.025780+0000","last_became_peered":"2023-08-25T05:18:43.025780+0000","last_unstale":"2023-08-25T05:18:44.024009+0000","last_undegraded":"2023-08-25T05:18:44.024009+0000","last_fullsized":"2023-08-25T05:18:44.024009+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:28:42.264155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.029023+0000","last_change":"2023-08-25T05:18:41.996744+0000","last_active":"2023-08-25T05:18:44.029023+0000","last_peered":"2023-08-25T05:18:44.029023+0000","last_clean":"2023-08-25T05:18:44.029023+0000","last_became_active":"2023-08-25T05:18:41.996415+0000","last_became_peered":"2023-08-25T05:18:41.996415+0000","last_unstale":"2023-08-25T05:18:44.029023+0000","last_undegraded":"2023-08-25T05:18:44.029023+0000","last_fullsized":"2023-08-25T05:18:44.029023+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:10:54.857022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266175+0000","last_change":"2023-08-25T05:18:43.016638+0000","last_active":"2023-08-25T05:18:44.266175+0000","last_peered":"2023-08-25T05:18:44.266175+0000","last_clean":"2023-08-25T05:18:44.266175+0000","last_became_active":"2023-08-25T05:18:43.016337+0000","last_became_peered":"2023-08-25T05:18:43.016337+0000","last_unstale":"2023-08-25T05:18:44.266175+0000","last_undegraded":"2023-08-25T05:18:44.266175+0000","last_fullsized":"2023-08-25T05:18:44.266175+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:22:07.929386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023629+0000","last_change":"2023-08-25T05:18:42.008485+0000","last_active":"2023-08-25T05:18:44.023629+0000","last_peered":"2023-08-25T05:18:44.023629+0000","last_clean":"2023-08-25T05:18:44.023629+0000","last_became_active":"2023-08-25T05:18:42.008215+0000","last_became_peered":"2023-08-25T05:18:42.008215+0000","last_unstale":"2023-08-25T05:18:44.023629+0000","last_undegraded":"2023-08-25T05:18:44.023629+0000","last_fullsized":"2023-08-25T05:18:44.023629+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:36:29.351358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"144'3576","reported_seq":4296,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.022989+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:18:44.022989+0000","last_peered":"2023-08-25T05:18:44.022989+0000","last_clean":"2023-08-25T05:18:44.022989+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:18:44.022989+0000","last_undegraded":"2023-08-25T05:18:44.022989+0000","last_fullsized":"2023-08-25T05:18:44.022989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3576,"log_dups_size":0,"ondisk_log_size":3576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:59:59.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1424,"num_read_kb":2961,"num_write":425,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":277,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265190+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:18:44.265190+0000","last_peered":"2023-08-25T05:18:44.265190+0000","last_clean":"2023-08-25T05:18:44.265190+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:18:44.265190+0000","last_undegraded":"2023-08-25T05:18:44.265190+0000","last_fullsized":"2023-08-25T05:18:44.265190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:28:58.855339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024311+0000","last_change":"2023-08-25T05:18:43.027617+0000","last_active":"2023-08-25T05:18:44.024311+0000","last_peered":"2023-08-25T05:18:44.024311+0000","last_clean":"2023-08-25T05:18:44.024311+0000","last_became_active":"2023-08-25T05:18:43.026629+0000","last_became_peered":"2023-08-25T05:18:43.026629+0000","last_unstale":"2023-08-25T05:18:44.024311+0000","last_undegraded":"2023-08-25T05:18:44.024311+0000","last_fullsized":"2023-08-25T05:18:44.024311+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:06.811328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265841+0000","last_change":"2023-08-25T05:18:42.004689+0000","last_active":"2023-08-25T05:18:44.265841+0000","last_peered":"2023-08-25T05:18:44.265841+0000","last_clean":"2023-08-25T05:18:44.265841+0000","last_became_active":"2023-08-25T05:18:42.004418+0000","last_became_peered":"2023-08-25T05:18:42.004418+0000","last_unstale":"2023-08-25T05:18:44.265841+0000","last_undegraded":"2023-08-25T05:18:44.265841+0000","last_fullsized":"2023-08-25T05:18:44.265841+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:30:19.459460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":274,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.022856+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:18:44.022856+0000","last_peered":"2023-08-25T05:18:44.022856+0000","last_clean":"2023-08-25T05:18:44.022856+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:18:44.022856+0000","last_undegraded":"2023-08-25T05:18:44.022856+0000","last_fullsized":"2023-08-25T05:18:44.022856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:20:11.374565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.029289+0000","last_change":"2023-08-25T05:18:43.025521+0000","last_active":"2023-08-25T05:18:44.029289+0000","last_peered":"2023-08-25T05:18:44.029289+0000","last_clean":"2023-08-25T05:18:44.029289+0000","last_became_active":"2023-08-25T05:18:43.024342+0000","last_became_peered":"2023-08-25T05:18:43.024342+0000","last_unstale":"2023-08-25T05:18:44.029289+0000","last_undegraded":"2023-08-25T05:18:44.029289+0000","last_fullsized":"2023-08-25T05:18:44.029289+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:47:56.770443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"156'8","reported_seq":21,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264659+0000","last_change":"2023-08-25T05:18:42.000254+0000","last_active":"2023-08-25T05:18:44.264659+0000","last_peered":"2023-08-25T05:18:44.264659+0000","last_clean":"2023-08-25T05:18:44.264659+0000","last_became_active":"2023-08-25T05:18:41.999919+0000","last_became_peered":"2023-08-25T05:18:41.999919+0000","last_unstale":"2023-08-25T05:18:44.264659+0000","last_undegraded":"2023-08-25T05:18:44.264659+0000","last_fullsized":"2023-08-25T05:18:44.264659+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:44:49.983274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":281,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.263712+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:18:44.263712+0000","last_peered":"2023-08-25T05:18:44.263712+0000","last_clean":"2023-08-25T05:18:44.263712+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:18:44.263712+0000","last_undegraded":"2023-08-25T05:18:44.263712+0000","last_fullsized":"2023-08-25T05:18:44.263712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:37:06.890891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264623+0000","last_change":"2023-08-25T05:18:43.026892+0000","last_active":"2023-08-25T05:18:44.264623+0000","last_peered":"2023-08-25T05:18:44.264623+0000","last_clean":"2023-08-25T05:18:44.264623+0000","last_became_active":"2023-08-25T05:18:43.026591+0000","last_became_peered":"2023-08-25T05:18:43.026591+0000","last_unstale":"2023-08-25T05:18:44.264623+0000","last_undegraded":"2023-08-25T05:18:44.264623+0000","last_fullsized":"2023-08-25T05:18:44.264623+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:44:46.192772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.263891+0000","last_change":"2023-08-25T05:18:42.002328+0000","last_active":"2023-08-25T05:18:44.263891+0000","last_peered":"2023-08-25T05:18:44.263891+0000","last_clean":"2023-08-25T05:18:44.263891+0000","last_became_active":"2023-08-25T05:18:42.001515+0000","last_became_peered":"2023-08-25T05:18:42.001515+0000","last_unstale":"2023-08-25T05:18:44.263891+0000","last_undegraded":"2023-08-25T05:18:44.263891+0000","last_fullsized":"2023-08-25T05:18:44.263891+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:01:03.539459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":277,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265193+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:18:44.265193+0000","last_peered":"2023-08-25T05:18:44.265193+0000","last_clean":"2023-08-25T05:18:44.265193+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:18:44.265193+0000","last_undegraded":"2023-08-25T05:18:44.265193+0000","last_fullsized":"2023-08-25T05:18:44.265193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:39.590865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266254+0000","last_change":"2023-08-25T05:18:43.012845+0000","last_active":"2023-08-25T05:18:44.266254+0000","last_peered":"2023-08-25T05:18:44.266254+0000","last_clean":"2023-08-25T05:18:44.266254+0000","last_became_active":"2023-08-25T05:18:43.012531+0000","last_became_peered":"2023-08-25T05:18:43.012531+0000","last_unstale":"2023-08-25T05:18:44.266254+0000","last_undegraded":"2023-08-25T05:18:44.266254+0000","last_fullsized":"2023-08-25T05:18:44.266254+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:11:28.839645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"156'3","reported_seq":16,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024389+0000","last_change":"2023-08-25T05:18:42.009359+0000","last_active":"2023-08-25T05:18:44.024389+0000","last_peered":"2023-08-25T05:18:44.024389+0000","last_clean":"2023-08-25T05:18:44.024389+0000","last_became_active":"2023-08-25T05:18:42.009035+0000","last_became_peered":"2023-08-25T05:18:42.009035+0000","last_unstale":"2023-08-25T05:18:44.024389+0000","last_undegraded":"2023-08-25T05:18:44.024389+0000","last_fullsized":"2023-08-25T05:18:44.024389+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:51:22.629220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":295,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265140+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:18:44.265140+0000","last_peered":"2023-08-25T05:18:44.265140+0000","last_clean":"2023-08-25T05:18:44.265140+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:18:44.265140+0000","last_undegraded":"2023-08-25T05:18:44.265140+0000","last_fullsized":"2023-08-25T05:18:44.265140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:14:49.169294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266281+0000","last_change":"2023-08-25T05:18:43.023594+0000","last_active":"2023-08-25T05:18:44.266281+0000","last_peered":"2023-08-25T05:18:44.266281+0000","last_clean":"2023-08-25T05:18:44.266281+0000","last_became_active":"2023-08-25T05:18:43.023065+0000","last_became_peered":"2023-08-25T05:18:43.023065+0000","last_unstale":"2023-08-25T05:18:44.266281+0000","last_undegraded":"2023-08-25T05:18:44.266281+0000","last_fullsized":"2023-08-25T05:18:44.266281+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:07:13.370237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"156'6","reported_seq":19,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024237+0000","last_change":"2023-08-25T05:18:42.007912+0000","last_active":"2023-08-25T05:18:44.024237+0000","last_peered":"2023-08-25T05:18:44.024237+0000","last_clean":"2023-08-25T05:18:44.024237+0000","last_became_active":"2023-08-25T05:18:42.007622+0000","last_became_peered":"2023-08-25T05:18:42.007622+0000","last_unstale":"2023-08-25T05:18:44.024237+0000","last_undegraded":"2023-08-25T05:18:44.024237+0000","last_fullsized":"2023-08-25T05:18:44.024237+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:00:57.416789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":273,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024452+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:18:44.024452+0000","last_peered":"2023-08-25T05:18:44.024452+0000","last_clean":"2023-08-25T05:18:44.024452+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:18:44.024452+0000","last_undegraded":"2023-08-25T05:18:44.024452+0000","last_fullsized":"2023-08-25T05:18:44.024452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:51:38.180709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.263607+0000","last_change":"2023-08-25T05:18:43.022011+0000","last_active":"2023-08-25T05:18:44.263607+0000","last_peered":"2023-08-25T05:18:44.263607+0000","last_clean":"2023-08-25T05:18:44.263607+0000","last_became_active":"2023-08-25T05:18:43.021487+0000","last_became_peered":"2023-08-25T05:18:43.021487+0000","last_unstale":"2023-08-25T05:18:44.263607+0000","last_undegraded":"2023-08-25T05:18:44.263607+0000","last_fullsized":"2023-08-25T05:18:44.263607+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:53:29.305847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265368+0000","last_change":"2023-08-25T05:18:42.001170+0000","last_active":"2023-08-25T05:18:44.265368+0000","last_peered":"2023-08-25T05:18:44.265368+0000","last_clean":"2023-08-25T05:18:44.265368+0000","last_became_active":"2023-08-25T05:18:42.000871+0000","last_became_peered":"2023-08-25T05:18:42.000871+0000","last_unstale":"2023-08-25T05:18:44.265368+0000","last_undegraded":"2023-08-25T05:18:44.265368+0000","last_fullsized":"2023-08-25T05:18:44.265368+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:26:45.672460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":294,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264732+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:18:44.264732+0000","last_peered":"2023-08-25T05:18:44.264732+0000","last_clean":"2023-08-25T05:18:44.264732+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:18:44.264732+0000","last_undegraded":"2023-08-25T05:18:44.264732+0000","last_fullsized":"2023-08-25T05:18:44.264732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:13:01.797253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264723+0000","last_change":"2023-08-25T05:18:43.019768+0000","last_active":"2023-08-25T05:18:44.264723+0000","last_peered":"2023-08-25T05:18:44.264723+0000","last_clean":"2023-08-25T05:18:44.264723+0000","last_became_active":"2023-08-25T05:18:43.019444+0000","last_became_peered":"2023-08-25T05:18:43.019444+0000","last_unstale":"2023-08-25T05:18:44.264723+0000","last_undegraded":"2023-08-25T05:18:44.264723+0000","last_fullsized":"2023-08-25T05:18:44.264723+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:11.568022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264065+0000","last_change":"2023-08-25T05:18:42.003667+0000","last_active":"2023-08-25T05:18:44.264065+0000","last_peered":"2023-08-25T05:18:44.264065+0000","last_clean":"2023-08-25T05:18:44.264065+0000","last_became_active":"2023-08-25T05:18:42.003374+0000","last_became_peered":"2023-08-25T05:18:42.003374+0000","last_unstale":"2023-08-25T05:18:44.264065+0000","last_undegraded":"2023-08-25T05:18:44.264065+0000","last_fullsized":"2023-08-25T05:18:44.264065+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:53.417493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":314,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266460+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:18:44.266460+0000","last_peered":"2023-08-25T05:18:44.266460+0000","last_clean":"2023-08-25T05:18:44.266460+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:18:44.266460+0000","last_undegraded":"2023-08-25T05:18:44.266460+0000","last_fullsized":"2023-08-25T05:18:44.266460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:02:12.993652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1424,"num_read_kb":2961,"num_write":425,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3576,"ondisk_log_size":3576,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510348,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51732,"kb_used_data":2496,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320108,"statfs":{"total":96636764160,"available":96583790592,"internally_reserved":0,"allocated":2555904,"data_stored":1574266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.51000000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89000000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.47799999999999998,"15min":0.38500000000000001},"max":{"1min":0.98299999999999998,"5min":1.0069999999999999,"15min":1.0089999999999999},"last":0.752}]},{"osd":1,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96999999999999997,"5min":0.99399999999999999,"15min":1.0629999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.45100000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0329999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.83499999999999996}]},{"osd":2,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.745,"15min":0.748},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46200000000000002},"max":{"1min":0.95699999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.54400000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0109999999999999,"5min":1.405,"15min":1.405},"last":0.68700000000000006}]},{"osd":3,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.496},"max":{"1min":0.92600000000000005,"5min":1.0409999999999999,"15min":1.0469999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.752,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.85699999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84599999999999997,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82999999999999996,"5min":0.96499999999999997,"15min":0.97499999999999998},"last":0.57199999999999995}]},{"osd":5,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63700000000000001,"15min":0.627},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82899999999999996,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66700000000000004,"15min":0.67200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.90300000000000002,"5min":0.97899999999999998,"15min":1.0309999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72599999999999998,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94099999999999995,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.45100000000000001},"max":{"1min":0.874,"5min":0.996,"15min":1.0649999999999999},"last":0.63200000000000001}]}]},{"osd":6,"up_from":15,"seq":64424510348,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28932,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342908,"statfs":{"total":96636764160,"available":96607137792,"internally_reserved":0,"allocated":1953792,"data_stored":982868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.746},"min":{"1min":0.625,"5min":0.433,"15min":0.433},"max":{"1min":0.95199999999999996,"5min":0.96799999999999997,"15min":1.2070000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.54800000000000004,"5min":0.42699999999999999,"15min":0.41299999999999998},"max":{"1min":0.999,"5min":0.999,"15min":1.002},"last":0.68400000000000005}]},{"osd":1,"last update":"Fri Aug 25 05:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.75,"15min":0.745},"min":{"1min":0.56999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94999999999999996,"5min":0.95799999999999996,"15min":1.0149999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75,"15min":0.755},"min":{"1min":0.53600000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.3009999999999999},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Aug 25 05:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.78600000000000003},"min":{"1min":0.65300000000000002,"5min":0.54000000000000004,"15min":0.53900000000000003},"max":{"1min":0.93100000000000005,"5min":0.95699999999999996,"15min":1.1240000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.96999999999999997,"5min":1.0249999999999999,"15min":1.0549999999999999},"last":0.88}]},{"osd":3,"last update":"Fri Aug 25 05:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.63500000000000001,"5min":0.51200000000000001,"15min":0.499},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.6020000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79200000000000004,"15min":0.77800000000000002},"min":{"1min":0.56799999999999995,"5min":0.56599999999999995,"15min":0.502},"max":{"1min":0.998,"5min":1.004,"15min":1.1519999999999999},"last":0.73799999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.39300000000000002,"15min":0.375},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.2589999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.63100000000000001,"15min":0.61899999999999999},"min":{"1min":0.433,"5min":0.42999999999999999,"15min":0.373},"max":{"1min":0.86499999999999999,"5min":0.92600000000000005,"15min":1.571},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Aug 25 05:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64700000000000002,"15min":0.65400000000000003},"min":{"1min":0.499,"5min":0.41399999999999998,"15min":0.40799999999999997},"max":{"1min":0.96699999999999997,"5min":0.96799999999999997,"15min":1.0269999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.503,"5min":0.46999999999999997,"15min":0.44800000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.3380000000000001},"last":0.80000000000000004}]},{"osd":7,"last update":"Fri Aug 25 05:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67700000000000005,"15min":0.66500000000000004},"min":{"1min":0.49199999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92900000000000005,"5min":1.0109999999999999,"15min":1.0740000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69999999999999996,"15min":0.68899999999999995},"min":{"1min":0.501,"5min":0.46700000000000003,"15min":0.46100000000000002},"max":{"1min":0.98899999999999999,"5min":1.038,"15min":1.667},"last":0.77900000000000003}]}]},{"osd":5,"up_from":14,"seq":60129543051,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55292,"kb_used_data":1904,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316548,"statfs":{"total":96636764160,"available":96580145152,"internally_reserved":0,"allocated":1949696,"data_stored":982218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.75900000000000001,"15min":0.74299999999999999},"min":{"1min":0.56399999999999995,"5min":0.52400000000000002,"15min":0.35399999999999998},"max":{"1min":1.0649999999999999,"5min":1.175,"15min":1.175},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.51800000000000002,"15min":0.41599999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.0620000000000001},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Aug 25 05:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.75600000000000001},"min":{"1min":0.53900000000000003,"5min":0.53000000000000003,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":1.02,"15min":1.042},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77500000000000002,"15min":0.76900000000000002},"min":{"1min":0.60299999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.004,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.754,"15min":0.754},"min":{"1min":0.58899999999999997,"5min":0.496,"15min":0.45900000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.79300000000000004,"15min":0.77600000000000002},"min":{"1min":0.59699999999999998,"5min":0.51700000000000002,"15min":0.5},"max":{"1min":1.01,"5min":1.0349999999999999,"15min":1.038},"last":0.746}]},{"osd":3,"last update":"Fri Aug 25 05:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77300000000000002,"15min":0.76800000000000002},"min":{"1min":0.56000000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.93899999999999995,"5min":1.131,"15min":1.131},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.54500000000000004},"max":{"1min":1.032,"5min":1.032,"15min":1.073},"last":0.62}]},{"osd":4,"last update":"Fri Aug 25 05:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39600000000000002},"max":{"1min":0.75,"5min":0.91500000000000004,"15min":0.998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.78300000000000003,"5min":0.84799999999999998,"15min":0.98099999999999998},"last":0.68600000000000005}]},{"osd":6,"last update":"Fri Aug 25 05:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65700000000000003,"15min":0.65400000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.39700000000000002},"max":{"1min":0.91400000000000003,"5min":0.95799999999999996,"15min":1.0409999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.498,"5min":0.47299999999999998,"15min":0.41799999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":1.026},"last":0.79900000000000004}]},{"osd":7,"last update":"Fri Aug 25 05:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.45700000000000002,"5min":0.42799999999999999,"15min":0.32100000000000001},"max":{"1min":0.878,"5min":0.95299999999999996,"15min":1.034},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.70899999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.45100000000000001},"max":{"1min":0.92900000000000005,"5min":0.98599999999999999,"15min":1.0740000000000001},"last":0.78200000000000003}]}]},{"osd":4,"up_from":14,"seq":60129543051,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41400,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330440,"statfs":{"total":96636764160,"available":96594370560,"internally_reserved":0,"allocated":1945600,"data_stored":982196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76700000000000002,"15min":0.74199999999999999},"min":{"1min":0.54900000000000004,"5min":0.48599999999999999,"15min":0.42899999999999999},"max":{"1min":0.94299999999999995,"5min":1.0509999999999999,"15min":1.0720000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.753,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.442},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96999999999999997},"last":0.73899999999999999}]},{"osd":1,"last update":"Fri Aug 25 05:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79000000000000004,"15min":0.76500000000000001},"min":{"1min":0.56599999999999995,"5min":0.48199999999999998,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78300000000000003,"15min":0.76300000000000001},"min":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.51400000000000001},"max":{"1min":0.96599999999999997,"5min":1.008,"15min":1.0660000000000001},"last":0.85999999999999999}]},{"osd":2,"last update":"Fri Aug 25 05:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78100000000000003,"15min":0.77100000000000002},"min":{"1min":0.57999999999999996,"5min":0.55800000000000005,"15min":0.46500000000000002},"max":{"1min":0.96099999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.876},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.76900000000000002},"min":{"1min":0.60599999999999998,"5min":0.52800000000000002,"15min":0.47199999999999998},"max":{"1min":0.95299999999999996,"5min":1.093,"15min":1.093},"last":0.82599999999999996}]},{"osd":3,"last update":"Fri Aug 25 05:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80000000000000004,"15min":0.78100000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.51700000000000002},"max":{"1min":0.98799999999999999,"5min":1.0429999999999999,"15min":1.044},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80400000000000005,"15min":0.78900000000000003},"min":{"1min":0.63900000000000001,"5min":0.59299999999999997,"15min":0.5},"max":{"1min":0.90800000000000003,"5min":1.048,"15min":1.1180000000000001},"last":0.76500000000000001}]},{"osd":5,"last update":"Fri Aug 25 05:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57599999999999996,"15min":0.55500000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.35699999999999998},"max":{"1min":0.74199999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.59799999999999998},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.38800000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":1.0449999999999999},"last":0.51000000000000001}]},{"osd":6,"last update":"Fri Aug 25 05:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.746,"15min":0.73699999999999999},"min":{"1min":0.57099999999999995,"5min":0.505,"15min":0.48399999999999999},"max":{"1min":0.96099999999999997,"5min":0.97299999999999998,"15min":1.01},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.67100000000000004,"15min":0.66300000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.38700000000000001},"max":{"1min":0.97699999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Fri Aug 25 05:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64000000000000001,"15min":0.626},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.40200000000000002},"max":{"1min":0.89600000000000002,"5min":0.90300000000000002,"15min":0.94399999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.71999999999999997,"15min":0.70299999999999996},"min":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.46100000000000002},"max":{"1min":0.97799999999999998,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.70899999999999996}]}]},{"osd":3,"up_from":14,"seq":60129543051,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59468,"kb_used_data":1916,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312372,"statfs":{"total":96636764160,"available":96575868928,"internally_reserved":0,"allocated":1961984,"data_stored":983878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46500000000000002,"15min":0.46800000000000003},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.315},"max":{"1min":0.624,"5min":0.72299999999999998,"15min":0.88300000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70099999999999996,"5min":0.79300000000000004,"15min":0.80700000000000005},"last":0.54200000000000004}]},{"osd":1,"last update":"Fri Aug 25 05:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.92700000000000005},"last":0.627},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64000000000000001,"15min":0.63300000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.85899999999999999,"5min":0.88100000000000001,"15min":0.96199999999999997},"last":0.67100000000000004}]},{"osd":2,"last update":"Fri Aug 25 05:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.48899999999999999,"5min":0.42999999999999999,"15min":0.42899999999999999},"max":{"1min":0.80100000000000005,"5min":0.85099999999999998,"15min":0.89400000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.40899999999999997,"5min":0.38700000000000001,"15min":0.379},"max":{"1min":0.76600000000000001,"5min":0.85599999999999998,"15min":0.91500000000000004},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Aug 25 05:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81599999999999995,"15min":0.80600000000000005},"min":{"1min":0.56299999999999994,"5min":0.52400000000000002,"15min":0.499},"max":{"1min":1.0920000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.65000000000000002,"5min":0.625,"15min":0.55600000000000005},"max":{"1min":1.0649999999999999,"5min":1.2509999999999999,"15min":1.3220000000000001},"last":0.92500000000000004}]},{"osd":5,"last update":"Fri Aug 25 05:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82699999999999996,"15min":0.82299999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.55300000000000005},"max":{"1min":1.111,"5min":1.1830000000000001,"15min":1.2749999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58299999999999996},"max":{"1min":1.1359999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.1619999999999999}]},{"osd":6,"last update":"Fri Aug 25 05:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.87,"15min":0.86599999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0580000000000001,"5min":1.357,"15min":1.357},"last":1.038},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.84799999999999998,"15min":0.84099999999999997},"min":{"1min":0.628,"5min":0.58299999999999996,"15min":0.54900000000000004},"max":{"1min":1.0189999999999999,"5min":1.274,"15min":1.274},"last":1.085}]},{"osd":7,"last update":"Fri Aug 25 05:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.89100000000000001,"15min":0.879},"min":{"1min":0.64100000000000001,"5min":0.63800000000000001,"15min":0.60599999999999998},"max":{"1min":1.103,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.115},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83999999999999997,"15min":0.83199999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.093,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.1339999999999999}]}]},{"osd":2,"up_from":14,"seq":60129543052,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59460,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312380,"statfs":{"total":96636764160,"available":96575877120,"internally_reserved":0,"allocated":1953792,"data_stored":982812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.66000000000000003,"5min":0.72599999999999998,"15min":0.76800000000000002},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.41699999999999998}]},{"osd":1,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33200000000000002},"max":{"1min":0.69599999999999995,"5min":0.76300000000000001,"15min":0.77600000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.628},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.503}]},{"osd":3,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.78100000000000003,"15min":0.83599999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82899999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.436}]},{"osd":4,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85099999999999998,"15min":0.83599999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1870000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.48299999999999998},"max":{"1min":1.089,"5min":1.163,"15min":1.163},"last":0.83599999999999997}]},{"osd":5,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.82599999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.54300000000000004},"max":{"1min":1.113,"5min":1.393,"15min":1.393},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.53900000000000003},"max":{"1min":1.2310000000000001,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.91600000000000004}]},{"osd":6,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.88200000000000001,"15min":0.85999999999999999},"min":{"1min":0.63800000000000001,"5min":0.63700000000000001,"15min":0.58699999999999997},"max":{"1min":1.169,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.875},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.88900000000000001,"15min":0.89400000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1910000000000001,"5min":1.2529999999999999,"15min":1.369},"last":0.81899999999999995}]},{"osd":7,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84899999999999998,"15min":0.82999999999999996},"min":{"1min":0.68799999999999994,"5min":0.621,"15min":0.54300000000000004},"max":{"1min":1.131,"5min":1.292,"15min":1.292},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.85399999999999998,"15min":0.83799999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.125,"5min":1.1870000000000001,"15min":1.254},"last":0.80100000000000005}]}]},{"osd":1,"up_from":14,"seq":60129543052,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37244,"kb_used_data":1904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334596,"statfs":{"total":96636764160,"available":96598626304,"internally_reserved":0,"allocated":1949696,"data_stored":982266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.48299999999999998},"min":{"1min":0.32300000000000001,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.752,"15min":0.91700000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.88700000000000001},"last":0.374}]},{"osd":2,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73699999999999999,"5min":0.749,"15min":0.78900000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.34799999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82299999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.437,"5min":0.435,"15min":0.40600000000000003},"max":{"1min":0.86799999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.499},"max":{"1min":0.97899999999999998,"5min":1.0680000000000001,"15min":1.212},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.83099999999999996,"15min":0.82499999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.0229999999999999,"5min":1.0429999999999999,"15min":1.163},"last":0.84199999999999997}]},{"osd":5,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.52900000000000003},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.81999999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.083,"5min":1.115,"15min":1.171},"last":0.748}]},{"osd":6,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86499999999999999,"15min":0.84599999999999997},"min":{"1min":0.64400000000000002,"5min":0.627,"15min":0.51500000000000001},"max":{"1min":1.107,"5min":1.1579999999999999,"15min":1.3700000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83299999999999996,"15min":0.83399999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.1830000000000001},"last":0.82099999999999995}]},{"osd":7,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.044,"5min":1.1659999999999999,"15min":1.3320000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.58899999999999997},"max":{"1min":1.115,"5min":1.115,"15min":1.268},"last":0.89000000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543051,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41992,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329848,"statfs":{"total":96636764160,"available":96593764352,"internally_reserved":0,"allocated":2547712,"data_stored":1572620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77200000000000002,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.379},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.49099999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.35099999999999998},"max":{"1min":0.73299999999999998,"5min":0.88400000000000001,"15min":0.90700000000000003},"last":0.432},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54900000000000004,"15min":0.55100000000000005},"min":{"1min":0.42199999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.70299999999999996,"5min":0.83099999999999996,"15min":0.86099999999999999},"last":0.44600000000000001}]},{"osd":3,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.379,"5min":0.36399999999999999,"15min":0.34599999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.0409999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.46400000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77300000000000002,"5min":0.878,"15min":0.878},"last":0.33000000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.82699999999999996,"15min":0.82299999999999995},"min":{"1min":0.63400000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1719999999999999,"5min":1.2649999999999999,"15min":1.3740000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.82299999999999995,"15min":0.82099999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.96099999999999997,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.80300000000000005,"15min":0.80600000000000005},"min":{"1min":0.64600000000000002,"5min":0.56399999999999995,"15min":0.46100000000000002},"max":{"1min":0.96399999999999997,"5min":1.0820000000000001,"15min":1.2210000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.82699999999999996,"15min":0.84099999999999997},"min":{"1min":0.68300000000000005,"5min":0.55700000000000005,"15min":0.54400000000000004},"max":{"1min":1.077,"5min":1.1379999999999999,"15min":1.3260000000000001},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.60999999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0009999999999999,"5min":1.196,"15min":1.196},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.84899999999999998,"15min":0.85899999999999999},"min":{"1min":0.59299999999999997,"5min":0.58999999999999997,"15min":0.58699999999999997},"max":{"1min":1.2030000000000001,"5min":1.216,"15min":1.2849999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.874,"15min":0.871},"min":{"1min":0.63200000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0860000000000001,"5min":1.22,"15min":1.2410000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.84499999999999997,"15min":0.84199999999999997},"min":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.58899999999999997},"max":{"1min":1.048,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:18:47.150 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:18:47.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.321+0000 7f01b5be1640 1 Processor -- start 2023-08-25T05:18:47.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.321+0000 7f01b5be1640 1 -- start start 2023-08-25T05:18:47.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.321+0000 7f01b5be1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01b00c89f0 0x7f01b00cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:47.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.321+0000 7f01b5be1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b00cc880 con 0x7f01b00ad950 2023-08-25T05:18:47.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.321+0000 7f01b5be1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b00ccb60 con 0x7f01b00ceeb0 2023-08-25T05:18:47.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.321+0000 7f01b5be1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b00b11f0 con 0x7f01b00c89f0 2023-08-25T05:18:47.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.321+0000 7f01af7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f01b00ad950 0x7f01b00ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34340/0 (socket says 172.21.15.55:34340) 2023-08-25T05:18:47.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.321+0000 7f01af7fe640 1 -- 172.21.15.55:0/3117986301 learned_addr learned my addr 172.21.15.55:0/3117986301 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:47.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.325+0000 7f01affff640 1 --2- 172.21.15.55:0/3117986301 >> v2:172.21.15.55:3300/0 conn(0x7f01b00c89f0 0x7f01b00cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:47.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.325+0000 7f01affff640 1 -- 172.21.15.55:0/3117986301 >> v1:172.21.15.110:6789/0 conn(0x7f01b00ceeb0 legacy=0x7f01b00b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:47.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.325+0000 7f01affff640 1 -- 172.21.15.55:0/3117986301 >> v1:172.21.15.55:6789/0 conn(0x7f01b00ad950 legacy=0x7f01b00ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:47.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.325+0000 7f01affff640 1 -- 172.21.15.55:0/3117986301 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b00cce40 con 0x7f01b00c89f0 2023-08-25T05:18:47.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.325+0000 7f01aeffd640 1 -- 172.21.15.55:0/3117986301 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940351756 0 0) 0x7f01b00cc880 con 0x7f01b00ad950 2023-08-25T05:18:47.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.325+0000 7f01affff640 1 --2- 172.21.15.55:0/3117986301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01b00c89f0 0x7f01b00cc2a0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f01a8009d90 tx=0x7f01a801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929c4458d827aea8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:47.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.325+0000 7f01aeffd640 1 -- 172.21.15.55:0/3117986301 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a80a5780 con 0x7f01b00c89f0 2023-08-25T05:18:47.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.325+0000 7f01aeffd640 1 -- 172.21.15.55:0/3117986301 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a80a58e0 con 0x7f01b00c89f0 2023-08-25T05:18:47.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.325+0000 7f01aeffd640 1 -- 172.21.15.55:0/3117986301 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a80a5c70 con 0x7f01b00c89f0 2023-08-25T05:18:47.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01b5be1640 1 -- 172.21.15.55:0/3117986301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01b00c89f0 msgr2=0x7f01b00cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:47.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01b5be1640 1 --2- 172.21.15.55:0/3117986301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01b00c89f0 0x7f01b00cc2a0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f01a8009d90 tx=0x7f01a801c8c0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01b5be1640 1 -- 172.21.15.55:0/3117986301 shutdown_connections 2023-08-25T05:18:47.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01b5be1640 1 --2- 172.21.15.55:0/3117986301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01b00c89f0 0x7f01b00cc2a0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01b5be1640 1 -- 172.21.15.55:0/3117986301 >> 172.21.15.55:0/3117986301 conn(0x7f01b0069d00 msgr2=0x7f01b006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:47.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01b5be1640 1 -- 172.21.15.55:0/3117986301 shutdown_connections 2023-08-25T05:18:47.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01b5be1640 1 -- 172.21.15.55:0/3117986301 wait complete. 2023-08-25T05:18:47.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01b5be1640 1 Processor -- start 2023-08-25T05:18:47.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01b5be1640 1 -- start start 2023-08-25T05:18:47.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01b5be1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01b00ad950 0x7f01b009b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:47.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01b5be1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01b00c89f0 0x7f01b0158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:47.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01b5be1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01b00ceeb0 0x7f01b009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:47.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01b5be1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b009be00 con 0x7f01b00c89f0 2023-08-25T05:18:47.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01b5be1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b0158f00 con 0x7f01b00ad950 2023-08-25T05:18:47.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01b5be1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b01591e0 con 0x7f01b00ceeb0 2023-08-25T05:18:47.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01a7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01b00c89f0 0x7f01b0158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:47.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01a7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01b00c89f0 0x7f01b0158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45864/0 (socket says 172.21.15.55:45864) 2023-08-25T05:18:47.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01a7fff640 1 -- 172.21.15.55:0/1072756100 learned_addr learned my addr 172.21.15.55:0/1072756100 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:47.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01af7fe640 1 --2- 172.21.15.55:0/1072756100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01b00ad950 0x7f01b009b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:47.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01affff640 1 --2- 172.21.15.55:0/1072756100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01b00ceeb0 0x7f01b009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:47.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01a7fff640 1 -- 172.21.15.55:0/1072756100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01b00ceeb0 msgr2=0x7f01b009ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:47.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01a7fff640 1 --2- 172.21.15.55:0/1072756100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01b00ceeb0 0x7f01b009ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01a7fff640 1 -- 172.21.15.55:0/1072756100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01b00ad950 msgr2=0x7f01b009b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:47.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01a7fff640 1 --2- 172.21.15.55:0/1072756100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01b00ad950 0x7f01b009b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01a7fff640 1 -- 172.21.15.55:0/1072756100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a8009a70 con 0x7f01b00c89f0 2023-08-25T05:18:47.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01affff640 1 --2- 172.21.15.55:0/1072756100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01b00ceeb0 0x7f01b009ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:47.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.329+0000 7f01a7fff640 1 --2- 172.21.15.55:0/1072756100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01b00c89f0 0x7f01b0158800 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f019800c3c0 tx=0x7f019800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:47.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.333+0000 7f01acff9640 1 -- 172.21.15.55:0/1072756100 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01980052d0 con 0x7f01b00c89f0 2023-08-25T05:18:47.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.333+0000 7f01acff9640 1 -- 172.21.15.55:0/1072756100 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0198005430 con 0x7f01b00c89f0 2023-08-25T05:18:47.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.333+0000 7f01acff9640 1 -- 172.21.15.55:0/1072756100 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0198003840 con 0x7f01b00c89f0 2023-08-25T05:18:47.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.333+0000 7f01b5be1640 1 -- 172.21.15.55:0/1072756100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b0153e20 con 0x7f01b00c89f0 2023-08-25T05:18:47.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.333+0000 7f01b5be1640 1 -- 172.21.15.55:0/1072756100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b01594c0 con 0x7f01b00c89f0 2023-08-25T05:18:47.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.333+0000 7f01b5be1640 1 -- 172.21.15.55:0/1072756100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b0154340 con 0x7f01b00c89f0 2023-08-25T05:18:47.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.333+0000 7f01acff9640 1 -- 172.21.15.55:0/1072756100 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f01980039a0 con 0x7f01b00c89f0 2023-08-25T05:18:47.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.333+0000 7f01acff9640 1 --2- 172.21.15.55:0/1072756100 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f01900657d0 0x7f0190067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:47.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.333+0000 7f01acff9640 1 -- 172.21.15.55:0/1072756100 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0198082440 con 0x7f01b00c89f0 2023-08-25T05:18:47.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.333+0000 7f01af7fe640 1 --2- 172.21.15.55:0/1072756100 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f01900657d0 0x7f0190067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:47.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.337+0000 7f01af7fe640 1 --2- 172.21.15.55:0/1072756100 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f01900657d0 0x7f0190067c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f01a0007a90 tx=0x7f01a00079e0 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:47.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.337+0000 7f01acff9640 1 -- 172.21.15.55:0/1072756100 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f01b0154340 con 0x7f01b00c89f0 2023-08-25T05:18:47.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.489+0000 7f01b5be1640 1 -- 172.21.15.55:0/1072756100 --> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01b0154340 con 0x7f01900657d0 2023-08-25T05:18:47.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.501+0000 7f01acff9640 1 -- 172.21.15.55:0/1072756100 <== mgr.7709 v2:172.21.15.110:6832/4256905777 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311876 (secure 0 0 0) 0x7f01b0154340 con 0x7f01900657d0 2023-08-25T05:18:47.505 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:47.506 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:18:47.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.501+0000 7f01b5be1640 1 -- 172.21.15.55:0/1072756100 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f01900657d0 msgr2=0x7f0190067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:47.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.501+0000 7f01b5be1640 1 --2- 172.21.15.55:0/1072756100 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f01900657d0 0x7f0190067c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f01a0007a90 tx=0x7f01a00079e0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.501+0000 7f01b5be1640 1 -- 172.21.15.55:0/1072756100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01b00c89f0 msgr2=0x7f01b0158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:47.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.501+0000 7f01b5be1640 1 --2- 172.21.15.55:0/1072756100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01b00c89f0 0x7f01b0158800 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f019800c3c0 tx=0x7f019800c880 comp rx=0 tx=0).stop 2023-08-25T05:18:47.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.501+0000 7f01b5be1640 1 -- 172.21.15.55:0/1072756100 shutdown_connections 2023-08-25T05:18:47.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.501+0000 7f01b5be1640 1 --2- 172.21.15.55:0/1072756100 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f01900657d0 0x7f0190067c90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.501+0000 7f01b5be1640 1 --2- 172.21.15.55:0/1072756100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01b00ceeb0 0x7f01b009ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.501+0000 7f01b5be1640 1 --2- 172.21.15.55:0/1072756100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01b00c89f0 0x7f01b0158800 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.501+0000 7f01b5be1640 1 --2- 172.21.15.55:0/1072756100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01b00ad950 0x7f01b009b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.501+0000 7f01b5be1640 1 -- 172.21.15.55:0/1072756100 >> 172.21.15.55:0/1072756100 conn(0x7f01b0069d00 msgr2=0x7f01b00b1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:47.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.501+0000 7f01b5be1640 1 -- 172.21.15.55:0/1072756100 shutdown_connections 2023-08-25T05:18:47.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.501+0000 7f01b5be1640 1 -- 172.21.15.55:0/1072756100 wait complete. 2023-08-25T05:18:47.524 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-08-25T05:18:46.749930+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1424,"num_read_kb":2961,"num_write":469,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3614,"ondisk_log_size":3614,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":206,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":375520,"kb_used_data":16424,"kb_used_omap":13,"kb_used_meta":358962,"kb_avail":754599200,"statfs":{"total":773094113280,"available":772709580800,"internally_reserved":0,"allocated":16818176,"data_stored":9043124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":367577176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.770953"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264078+0000","last_change":"2023-08-25T05:18:43.021284+0000","last_active":"2023-08-25T05:18:44.264078+0000","last_peered":"2023-08-25T05:18:44.264078+0000","last_clean":"2023-08-25T05:18:44.264078+0000","last_became_active":"2023-08-25T05:18:43.020830+0000","last_became_peered":"2023-08-25T05:18:43.020830+0000","last_unstale":"2023-08-25T05:18:44.264078+0000","last_undegraded":"2023-08-25T05:18:44.264078+0000","last_fullsized":"2023-08-25T05:18:44.264078+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:07:49.562671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265168+0000","last_change":"2023-08-25T05:18:43.013629+0000","last_active":"2023-08-25T05:18:44.265168+0000","last_peered":"2023-08-25T05:18:44.265168+0000","last_clean":"2023-08-25T05:18:44.265168+0000","last_became_active":"2023-08-25T05:18:43.013334+0000","last_became_peered":"2023-08-25T05:18:43.013334+0000","last_unstale":"2023-08-25T05:18:44.265168+0000","last_undegraded":"2023-08-25T05:18:44.265168+0000","last_fullsized":"2023-08-25T05:18:44.265168+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:06.710698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266017+0000","last_change":"2023-08-25T05:18:43.016711+0000","last_active":"2023-08-25T05:18:44.266017+0000","last_peered":"2023-08-25T05:18:44.266017+0000","last_clean":"2023-08-25T05:18:44.266017+0000","last_became_active":"2023-08-25T05:18:43.016411+0000","last_became_peered":"2023-08-25T05:18:43.016411+0000","last_unstale":"2023-08-25T05:18:44.266017+0000","last_undegraded":"2023-08-25T05:18:44.266017+0000","last_fullsized":"2023-08-25T05:18:44.266017+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:46:52.296912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265070+0000","last_change":"2023-08-25T05:18:43.020172+0000","last_active":"2023-08-25T05:18:44.265070+0000","last_peered":"2023-08-25T05:18:44.265070+0000","last_clean":"2023-08-25T05:18:44.265070+0000","last_became_active":"2023-08-25T05:18:43.019592+0000","last_became_peered":"2023-08-25T05:18:43.019592+0000","last_unstale":"2023-08-25T05:18:44.265070+0000","last_undegraded":"2023-08-25T05:18:44.265070+0000","last_fullsized":"2023-08-25T05:18:44.265070+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:43:08.063330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.028898+0000","last_change":"2023-08-25T05:18:43.022655+0000","last_active":"2023-08-25T05:18:44.028898+0000","last_peered":"2023-08-25T05:18:44.028898+0000","last_clean":"2023-08-25T05:18:44.028898+0000","last_became_active":"2023-08-25T05:18:43.022319+0000","last_became_peered":"2023-08-25T05:18:43.022319+0000","last_unstale":"2023-08-25T05:18:44.028898+0000","last_undegraded":"2023-08-25T05:18:44.028898+0000","last_fullsized":"2023-08-25T05:18:44.028898+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:57:35.517926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264362+0000","last_change":"2023-08-25T05:18:43.012604+0000","last_active":"2023-08-25T05:18:44.264362+0000","last_peered":"2023-08-25T05:18:44.264362+0000","last_clean":"2023-08-25T05:18:44.264362+0000","last_became_active":"2023-08-25T05:18:43.012289+0000","last_became_peered":"2023-08-25T05:18:43.012289+0000","last_unstale":"2023-08-25T05:18:44.264362+0000","last_undegraded":"2023-08-25T05:18:44.264362+0000","last_fullsized":"2023-08-25T05:18:44.264362+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:59:45.018075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.022974+0000","last_change":"2023-08-25T05:18:43.024661+0000","last_active":"2023-08-25T05:18:44.022974+0000","last_peered":"2023-08-25T05:18:44.022974+0000","last_clean":"2023-08-25T05:18:44.022974+0000","last_became_active":"2023-08-25T05:18:43.024381+0000","last_became_peered":"2023-08-25T05:18:43.024381+0000","last_unstale":"2023-08-25T05:18:44.022974+0000","last_undegraded":"2023-08-25T05:18:44.022974+0000","last_fullsized":"2023-08-25T05:18:44.022974+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:33:04.351022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.022797+0000","last_change":"2023-08-25T05:18:43.019590+0000","last_active":"2023-08-25T05:18:44.022797+0000","last_peered":"2023-08-25T05:18:44.022797+0000","last_clean":"2023-08-25T05:18:44.022797+0000","last_became_active":"2023-08-25T05:18:43.019304+0000","last_became_peered":"2023-08-25T05:18:43.019304+0000","last_unstale":"2023-08-25T05:18:44.022797+0000","last_undegraded":"2023-08-25T05:18:44.022797+0000","last_fullsized":"2023-08-25T05:18:44.022797+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:17:00.637276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264985+0000","last_change":"2023-08-25T05:18:43.015369+0000","last_active":"2023-08-25T05:18:44.264985+0000","last_peered":"2023-08-25T05:18:44.264985+0000","last_clean":"2023-08-25T05:18:44.264985+0000","last_became_active":"2023-08-25T05:18:43.015069+0000","last_became_peered":"2023-08-25T05:18:43.015069+0000","last_unstale":"2023-08-25T05:18:44.264985+0000","last_undegraded":"2023-08-25T05:18:44.264985+0000","last_fullsized":"2023-08-25T05:18:44.264985+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:23.489370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264174+0000","last_change":"2023-08-25T05:18:43.022490+0000","last_active":"2023-08-25T05:18:44.264174+0000","last_peered":"2023-08-25T05:18:44.264174+0000","last_clean":"2023-08-25T05:18:44.264174+0000","last_became_active":"2023-08-25T05:18:43.022198+0000","last_became_peered":"2023-08-25T05:18:43.022198+0000","last_unstale":"2023-08-25T05:18:44.264174+0000","last_undegraded":"2023-08-25T05:18:44.264174+0000","last_fullsized":"2023-08-25T05:18:44.264174+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:30:51.261368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265060+0000","last_change":"2023-08-25T05:18:43.017932+0000","last_active":"2023-08-25T05:18:44.265060+0000","last_peered":"2023-08-25T05:18:44.265060+0000","last_clean":"2023-08-25T05:18:44.265060+0000","last_became_active":"2023-08-25T05:18:43.017653+0000","last_became_peered":"2023-08-25T05:18:43.017653+0000","last_unstale":"2023-08-25T05:18:44.265060+0000","last_undegraded":"2023-08-25T05:18:44.265060+0000","last_fullsized":"2023-08-25T05:18:44.265060+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:30:51.261368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264187+0000","last_change":"2023-08-25T05:18:43.015559+0000","last_active":"2023-08-25T05:18:44.264187+0000","last_peered":"2023-08-25T05:18:44.264187+0000","last_clean":"2023-08-25T05:18:44.264187+0000","last_became_active":"2023-08-25T05:18:43.015244+0000","last_became_peered":"2023-08-25T05:18:43.015244+0000","last_unstale":"2023-08-25T05:18:44.264187+0000","last_undegraded":"2023-08-25T05:18:44.264187+0000","last_fullsized":"2023-08-25T05:18:44.264187+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:18:17.009667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265057+0000","last_change":"2023-08-25T05:18:43.019589+0000","last_active":"2023-08-25T05:18:44.265057+0000","last_peered":"2023-08-25T05:18:44.265057+0000","last_clean":"2023-08-25T05:18:44.265057+0000","last_became_active":"2023-08-25T05:18:43.018628+0000","last_became_peered":"2023-08-25T05:18:43.018628+0000","last_unstale":"2023-08-25T05:18:44.265057+0000","last_undegraded":"2023-08-25T05:18:44.265057+0000","last_fullsized":"2023-08-25T05:18:44.265057+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:53.031570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.263832+0000","last_change":"2023-08-25T05:18:43.021596+0000","last_active":"2023-08-25T05:18:44.263832+0000","last_peered":"2023-08-25T05:18:44.263832+0000","last_clean":"2023-08-25T05:18:44.263832+0000","last_became_active":"2023-08-25T05:18:43.021248+0000","last_became_peered":"2023-08-25T05:18:43.021248+0000","last_unstale":"2023-08-25T05:18:44.263832+0000","last_undegraded":"2023-08-25T05:18:44.263832+0000","last_fullsized":"2023-08-25T05:18:44.263832+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:20:32.896054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.263615+0000","last_change":"2023-08-25T05:18:43.021494+0000","last_active":"2023-08-25T05:18:44.263615+0000","last_peered":"2023-08-25T05:18:44.263615+0000","last_clean":"2023-08-25T05:18:44.263615+0000","last_became_active":"2023-08-25T05:18:43.020911+0000","last_became_peered":"2023-08-25T05:18:43.020911+0000","last_unstale":"2023-08-25T05:18:44.263615+0000","last_undegraded":"2023-08-25T05:18:44.263615+0000","last_fullsized":"2023-08-25T05:18:44.263615+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:43:54.302758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264310+0000","last_change":"2023-08-25T05:18:43.019081+0000","last_active":"2023-08-25T05:18:44.264310+0000","last_peered":"2023-08-25T05:18:44.264310+0000","last_clean":"2023-08-25T05:18:44.264310+0000","last_became_active":"2023-08-25T05:18:43.016700+0000","last_became_peered":"2023-08-25T05:18:43.016700+0000","last_unstale":"2023-08-25T05:18:44.264310+0000","last_undegraded":"2023-08-25T05:18:44.264310+0000","last_fullsized":"2023-08-25T05:18:44.264310+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:09:33.219395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265019+0000","last_change":"2023-08-25T05:18:43.018756+0000","last_active":"2023-08-25T05:18:44.265019+0000","last_peered":"2023-08-25T05:18:44.265019+0000","last_clean":"2023-08-25T05:18:44.265019+0000","last_became_active":"2023-08-25T05:18:43.018435+0000","last_became_peered":"2023-08-25T05:18:43.018435+0000","last_unstale":"2023-08-25T05:18:44.265019+0000","last_undegraded":"2023-08-25T05:18:44.265019+0000","last_fullsized":"2023-08-25T05:18:44.265019+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:19.500588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.029180+0000","last_change":"2023-08-25T05:18:43.023678+0000","last_active":"2023-08-25T05:18:44.029180+0000","last_peered":"2023-08-25T05:18:44.029180+0000","last_clean":"2023-08-25T05:18:44.029180+0000","last_became_active":"2023-08-25T05:18:43.021965+0000","last_became_peered":"2023-08-25T05:18:43.021965+0000","last_unstale":"2023-08-25T05:18:44.029180+0000","last_undegraded":"2023-08-25T05:18:44.029180+0000","last_fullsized":"2023-08-25T05:18:44.029180+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:46:36.177659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024082+0000","last_change":"2023-08-25T05:18:43.026887+0000","last_active":"2023-08-25T05:18:44.024082+0000","last_peered":"2023-08-25T05:18:44.024082+0000","last_clean":"2023-08-25T05:18:44.024082+0000","last_became_active":"2023-08-25T05:18:43.026608+0000","last_became_peered":"2023-08-25T05:18:43.026608+0000","last_unstale":"2023-08-25T05:18:44.024082+0000","last_undegraded":"2023-08-25T05:18:44.024082+0000","last_fullsized":"2023-08-25T05:18:44.024082+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:14:13.909304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.029004+0000","last_change":"2023-08-25T05:18:43.021647+0000","last_active":"2023-08-25T05:18:44.029004+0000","last_peered":"2023-08-25T05:18:44.029004+0000","last_clean":"2023-08-25T05:18:44.029004+0000","last_became_active":"2023-08-25T05:18:43.021347+0000","last_became_peered":"2023-08-25T05:18:43.021347+0000","last_unstale":"2023-08-25T05:18:44.029004+0000","last_undegraded":"2023-08-25T05:18:44.029004+0000","last_fullsized":"2023-08-25T05:18:44.029004+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:16:27.975505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265000+0000","last_change":"2023-08-25T05:18:43.018967+0000","last_active":"2023-08-25T05:18:44.265000+0000","last_peered":"2023-08-25T05:18:44.265000+0000","last_clean":"2023-08-25T05:18:44.265000+0000","last_became_active":"2023-08-25T05:18:43.018672+0000","last_became_peered":"2023-08-25T05:18:43.018672+0000","last_unstale":"2023-08-25T05:18:44.265000+0000","last_undegraded":"2023-08-25T05:18:44.265000+0000","last_fullsized":"2023-08-25T05:18:44.265000+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:00:10.435407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.263710+0000","last_change":"2023-08-25T05:18:43.013956+0000","last_active":"2023-08-25T05:18:44.263710+0000","last_peered":"2023-08-25T05:18:44.263710+0000","last_clean":"2023-08-25T05:18:44.263710+0000","last_became_active":"2023-08-25T05:18:43.013557+0000","last_became_peered":"2023-08-25T05:18:43.013557+0000","last_unstale":"2023-08-25T05:18:44.263710+0000","last_undegraded":"2023-08-25T05:18:44.263710+0000","last_fullsized":"2023-08-25T05:18:44.263710+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:07:38.755466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265153+0000","last_change":"2023-08-25T05:18:43.018588+0000","last_active":"2023-08-25T05:18:44.265153+0000","last_peered":"2023-08-25T05:18:44.265153+0000","last_clean":"2023-08-25T05:18:44.265153+0000","last_became_active":"2023-08-25T05:18:43.018281+0000","last_became_peered":"2023-08-25T05:18:43.018281+0000","last_unstale":"2023-08-25T05:18:44.265153+0000","last_undegraded":"2023-08-25T05:18:44.265153+0000","last_fullsized":"2023-08-25T05:18:44.265153+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:23:36.539232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264470+0000","last_change":"2023-08-25T05:18:43.014804+0000","last_active":"2023-08-25T05:18:44.264470+0000","last_peered":"2023-08-25T05:18:44.264470+0000","last_clean":"2023-08-25T05:18:44.264470+0000","last_became_active":"2023-08-25T05:18:43.014476+0000","last_became_peered":"2023-08-25T05:18:43.014476+0000","last_unstale":"2023-08-25T05:18:44.264470+0000","last_undegraded":"2023-08-25T05:18:44.264470+0000","last_fullsized":"2023-08-25T05:18:44.264470+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:36:27.816099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266390+0000","last_change":"2023-08-25T05:18:43.016896+0000","last_active":"2023-08-25T05:18:44.266390+0000","last_peered":"2023-08-25T05:18:44.266390+0000","last_clean":"2023-08-25T05:18:44.266390+0000","last_became_active":"2023-08-25T05:18:43.016508+0000","last_became_peered":"2023-08-25T05:18:43.016508+0000","last_unstale":"2023-08-25T05:18:44.266390+0000","last_undegraded":"2023-08-25T05:18:44.266390+0000","last_fullsized":"2023-08-25T05:18:44.266390+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:37:35.398558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266307+0000","last_change":"2023-08-25T05:18:43.022648+0000","last_active":"2023-08-25T05:18:44.266307+0000","last_peered":"2023-08-25T05:18:44.266307+0000","last_clean":"2023-08-25T05:18:44.266307+0000","last_became_active":"2023-08-25T05:18:43.022187+0000","last_became_peered":"2023-08-25T05:18:43.022187+0000","last_unstale":"2023-08-25T05:18:44.266307+0000","last_undegraded":"2023-08-25T05:18:44.266307+0000","last_fullsized":"2023-08-25T05:18:44.266307+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:19:33.722951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024243+0000","last_change":"2023-08-25T05:18:43.034166+0000","last_active":"2023-08-25T05:18:44.024243+0000","last_peered":"2023-08-25T05:18:44.024243+0000","last_clean":"2023-08-25T05:18:44.024243+0000","last_became_active":"2023-08-25T05:18:43.033854+0000","last_became_peered":"2023-08-25T05:18:43.033854+0000","last_unstale":"2023-08-25T05:18:44.024243+0000","last_undegraded":"2023-08-25T05:18:44.024243+0000","last_fullsized":"2023-08-25T05:18:44.024243+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:40:10.500869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264476+0000","last_change":"2023-08-25T05:18:43.022340+0000","last_active":"2023-08-25T05:18:44.264476+0000","last_peered":"2023-08-25T05:18:44.264476+0000","last_clean":"2023-08-25T05:18:44.264476+0000","last_became_active":"2023-08-25T05:18:43.022055+0000","last_became_peered":"2023-08-25T05:18:43.022055+0000","last_unstale":"2023-08-25T05:18:44.264476+0000","last_undegraded":"2023-08-25T05:18:44.264476+0000","last_fullsized":"2023-08-25T05:18:44.264476+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:06.710698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266256+0000","last_change":"2023-08-25T05:18:43.023425+0000","last_active":"2023-08-25T05:18:44.266256+0000","last_peered":"2023-08-25T05:18:44.266256+0000","last_clean":"2023-08-25T05:18:44.266256+0000","last_became_active":"2023-08-25T05:18:43.022664+0000","last_became_peered":"2023-08-25T05:18:43.022664+0000","last_unstale":"2023-08-25T05:18:44.266256+0000","last_undegraded":"2023-08-25T05:18:44.266256+0000","last_fullsized":"2023-08-25T05:18:44.266256+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:16:55.474578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265988+0000","last_change":"2023-08-25T05:18:43.013793+0000","last_active":"2023-08-25T05:18:44.265988+0000","last_peered":"2023-08-25T05:18:44.265988+0000","last_clean":"2023-08-25T05:18:44.265988+0000","last_became_active":"2023-08-25T05:18:43.013465+0000","last_became_peered":"2023-08-25T05:18:43.013465+0000","last_unstale":"2023-08-25T05:18:44.265988+0000","last_undegraded":"2023-08-25T05:18:44.265988+0000","last_fullsized":"2023-08-25T05:18:44.265988+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:22:04.778381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.022797+0000","last_change":"2023-08-25T05:18:43.017883+0000","last_active":"2023-08-25T05:18:44.022797+0000","last_peered":"2023-08-25T05:18:44.022797+0000","last_clean":"2023-08-25T05:18:44.022797+0000","last_became_active":"2023-08-25T05:18:43.017617+0000","last_became_peered":"2023-08-25T05:18:43.017617+0000","last_unstale":"2023-08-25T05:18:44.022797+0000","last_undegraded":"2023-08-25T05:18:44.022797+0000","last_fullsized":"2023-08-25T05:18:44.022797+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:02:11.931674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264382+0000","last_change":"2023-08-25T05:18:43.018110+0000","last_active":"2023-08-25T05:18:44.264382+0000","last_peered":"2023-08-25T05:18:44.264382+0000","last_clean":"2023-08-25T05:18:44.264382+0000","last_became_active":"2023-08-25T05:18:43.017785+0000","last_became_peered":"2023-08-25T05:18:43.017785+0000","last_unstale":"2023-08-25T05:18:44.264382+0000","last_undegraded":"2023-08-25T05:18:44.264382+0000","last_fullsized":"2023-08-25T05:18:44.264382+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:43:08.063330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.022929+0000","last_change":"2023-08-25T05:18:43.016575+0000","last_active":"2023-08-25T05:18:44.022929+0000","last_peered":"2023-08-25T05:18:44.022929+0000","last_clean":"2023-08-25T05:18:44.022929+0000","last_became_active":"2023-08-25T05:18:43.014556+0000","last_became_peered":"2023-08-25T05:18:43.014556+0000","last_unstale":"2023-08-25T05:18:44.022929+0000","last_undegraded":"2023-08-25T05:18:44.022929+0000","last_fullsized":"2023-08-25T05:18:44.022929+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:57:53.494446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"156'4","reported_seq":17,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266415+0000","last_change":"2023-08-25T05:18:42.003929+0000","last_active":"2023-08-25T05:18:44.266415+0000","last_peered":"2023-08-25T05:18:44.266415+0000","last_clean":"2023-08-25T05:18:44.266415+0000","last_became_active":"2023-08-25T05:18:42.003615+0000","last_became_peered":"2023-08-25T05:18:42.003615+0000","last_unstale":"2023-08-25T05:18:44.266415+0000","last_undegraded":"2023-08-25T05:18:44.266415+0000","last_fullsized":"2023-08-25T05:18:44.266415+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:33:11.340984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.263688+0000","last_change":"2023-08-25T05:18:43.014166+0000","last_active":"2023-08-25T05:18:44.263688+0000","last_peered":"2023-08-25T05:18:44.263688+0000","last_clean":"2023-08-25T05:18:44.263688+0000","last_became_active":"2023-08-25T05:18:43.013551+0000","last_became_peered":"2023-08-25T05:18:43.013551+0000","last_unstale":"2023-08-25T05:18:44.263688+0000","last_undegraded":"2023-08-25T05:18:44.263688+0000","last_fullsized":"2023-08-25T05:18:44.263688+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:56:48.071241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.029353+0000","last_change":"2023-08-25T05:18:42.004500+0000","last_active":"2023-08-25T05:18:44.029353+0000","last_peered":"2023-08-25T05:18:44.029353+0000","last_clean":"2023-08-25T05:18:44.029353+0000","last_became_active":"2023-08-25T05:18:42.004225+0000","last_became_peered":"2023-08-25T05:18:42.004225+0000","last_unstale":"2023-08-25T05:18:44.029353+0000","last_undegraded":"2023-08-25T05:18:44.029353+0000","last_fullsized":"2023-08-25T05:18:44.029353+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:58.109732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265319+0000","last_change":"2023-08-25T05:18:43.028870+0000","last_active":"2023-08-25T05:18:44.265319+0000","last_peered":"2023-08-25T05:18:44.265319+0000","last_clean":"2023-08-25T05:18:44.265319+0000","last_became_active":"2023-08-25T05:18:43.028519+0000","last_became_peered":"2023-08-25T05:18:43.028519+0000","last_unstale":"2023-08-25T05:18:44.265319+0000","last_undegraded":"2023-08-25T05:18:44.265319+0000","last_fullsized":"2023-08-25T05:18:44.265319+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:23:59.977624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024375+0000","last_change":"2023-08-25T05:18:42.008868+0000","last_active":"2023-08-25T05:18:44.024375+0000","last_peered":"2023-08-25T05:18:44.024375+0000","last_clean":"2023-08-25T05:18:44.024375+0000","last_became_active":"2023-08-25T05:18:42.008503+0000","last_became_peered":"2023-08-25T05:18:42.008503+0000","last_unstale":"2023-08-25T05:18:44.024375+0000","last_undegraded":"2023-08-25T05:18:44.024375+0000","last_fullsized":"2023-08-25T05:18:44.024375+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:58:48.970670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264914+0000","last_change":"2023-08-25T05:18:43.028485+0000","last_active":"2023-08-25T05:18:44.264914+0000","last_peered":"2023-08-25T05:18:44.264914+0000","last_clean":"2023-08-25T05:18:44.264914+0000","last_became_active":"2023-08-25T05:18:43.028202+0000","last_became_peered":"2023-08-25T05:18:43.028202+0000","last_unstale":"2023-08-25T05:18:44.264914+0000","last_undegraded":"2023-08-25T05:18:44.264914+0000","last_fullsized":"2023-08-25T05:18:44.264914+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:01:30.215736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024164+0000","last_change":"2023-08-25T05:18:42.004258+0000","last_active":"2023-08-25T05:18:44.024164+0000","last_peered":"2023-08-25T05:18:44.024164+0000","last_clean":"2023-08-25T05:18:44.024164+0000","last_became_active":"2023-08-25T05:18:42.003976+0000","last_became_peered":"2023-08-25T05:18:42.003976+0000","last_unstale":"2023-08-25T05:18:44.024164+0000","last_undegraded":"2023-08-25T05:18:44.024164+0000","last_fullsized":"2023-08-25T05:18:44.024164+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:56:49.062002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023420+0000","last_change":"2023-08-25T05:18:43.018719+0000","last_active":"2023-08-25T05:18:44.023420+0000","last_peered":"2023-08-25T05:18:44.023420+0000","last_clean":"2023-08-25T05:18:44.023420+0000","last_became_active":"2023-08-25T05:18:43.018416+0000","last_became_peered":"2023-08-25T05:18:43.018416+0000","last_unstale":"2023-08-25T05:18:44.023420+0000","last_undegraded":"2023-08-25T05:18:44.023420+0000","last_fullsized":"2023-08-25T05:18:44.023420+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:39:40.809179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023105+0000","last_change":"2023-08-25T05:18:42.000199+0000","last_active":"2023-08-25T05:18:44.023105+0000","last_peered":"2023-08-25T05:18:44.023105+0000","last_clean":"2023-08-25T05:18:44.023105+0000","last_became_active":"2023-08-25T05:18:41.999901+0000","last_became_peered":"2023-08-25T05:18:41.999901+0000","last_unstale":"2023-08-25T05:18:44.023105+0000","last_undegraded":"2023-08-25T05:18:44.023105+0000","last_fullsized":"2023-08-25T05:18:44.023105+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:36:16.996309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023335+0000","last_change":"2023-08-25T05:18:43.019416+0000","last_active":"2023-08-25T05:18:44.023335+0000","last_peered":"2023-08-25T05:18:44.023335+0000","last_clean":"2023-08-25T05:18:44.023335+0000","last_became_active":"2023-08-25T05:18:43.019140+0000","last_became_peered":"2023-08-25T05:18:43.019140+0000","last_unstale":"2023-08-25T05:18:44.023335+0000","last_undegraded":"2023-08-25T05:18:44.023335+0000","last_fullsized":"2023-08-25T05:18:44.023335+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:39:14.210220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.028857+0000","last_change":"2023-08-25T05:18:41.997440+0000","last_active":"2023-08-25T05:18:44.028857+0000","last_peered":"2023-08-25T05:18:44.028857+0000","last_clean":"2023-08-25T05:18:44.028857+0000","last_became_active":"2023-08-25T05:18:41.997159+0000","last_became_peered":"2023-08-25T05:18:41.997159+0000","last_unstale":"2023-08-25T05:18:44.028857+0000","last_undegraded":"2023-08-25T05:18:44.028857+0000","last_fullsized":"2023-08-25T05:18:44.028857+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:06:20.702134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.029282+0000","last_change":"2023-08-25T05:18:43.028078+0000","last_active":"2023-08-25T05:18:44.029282+0000","last_peered":"2023-08-25T05:18:44.029282+0000","last_clean":"2023-08-25T05:18:44.029282+0000","last_became_active":"2023-08-25T05:18:43.027806+0000","last_became_peered":"2023-08-25T05:18:43.027806+0000","last_unstale":"2023-08-25T05:18:44.029282+0000","last_undegraded":"2023-08-25T05:18:44.029282+0000","last_fullsized":"2023-08-25T05:18:44.029282+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:05:14.357059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264577+0000","last_change":"2023-08-25T05:18:41.997124+0000","last_active":"2023-08-25T05:18:44.264577+0000","last_peered":"2023-08-25T05:18:44.264577+0000","last_clean":"2023-08-25T05:18:44.264577+0000","last_became_active":"2023-08-25T05:18:41.996819+0000","last_became_peered":"2023-08-25T05:18:41.996819+0000","last_unstale":"2023-08-25T05:18:44.264577+0000","last_undegraded":"2023-08-25T05:18:44.264577+0000","last_fullsized":"2023-08-25T05:18:44.264577+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:44:10.470149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024062+0000","last_change":"2023-08-25T05:18:43.030926+0000","last_active":"2023-08-25T05:18:44.024062+0000","last_peered":"2023-08-25T05:18:44.024062+0000","last_clean":"2023-08-25T05:18:44.024062+0000","last_became_active":"2023-08-25T05:18:43.030669+0000","last_became_peered":"2023-08-25T05:18:43.030669+0000","last_unstale":"2023-08-25T05:18:44.024062+0000","last_undegraded":"2023-08-25T05:18:44.024062+0000","last_fullsized":"2023-08-25T05:18:44.024062+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:44:07.458954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265884+0000","last_change":"2023-08-25T05:18:41.999760+0000","last_active":"2023-08-25T05:18:44.265884+0000","last_peered":"2023-08-25T05:18:44.265884+0000","last_clean":"2023-08-25T05:18:44.265884+0000","last_became_active":"2023-08-25T05:18:41.999487+0000","last_became_peered":"2023-08-25T05:18:41.999487+0000","last_unstale":"2023-08-25T05:18:44.265884+0000","last_undegraded":"2023-08-25T05:18:44.265884+0000","last_fullsized":"2023-08-25T05:18:44.265884+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:00:01.681325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265777+0000","last_change":"2023-08-25T05:18:43.017295+0000","last_active":"2023-08-25T05:18:44.265777+0000","last_peered":"2023-08-25T05:18:44.265777+0000","last_clean":"2023-08-25T05:18:44.265777+0000","last_became_active":"2023-08-25T05:18:43.016969+0000","last_became_peered":"2023-08-25T05:18:43.016969+0000","last_unstale":"2023-08-25T05:18:44.265777+0000","last_undegraded":"2023-08-25T05:18:44.265777+0000","last_fullsized":"2023-08-25T05:18:44.265777+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:52:48.052436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265465+0000","last_change":"2023-08-25T05:18:42.003823+0000","last_active":"2023-08-25T05:18:44.265465+0000","last_peered":"2023-08-25T05:18:44.265465+0000","last_clean":"2023-08-25T05:18:44.265465+0000","last_became_active":"2023-08-25T05:18:42.003512+0000","last_became_peered":"2023-08-25T05:18:42.003512+0000","last_unstale":"2023-08-25T05:18:44.265465+0000","last_undegraded":"2023-08-25T05:18:44.265465+0000","last_fullsized":"2023-08-25T05:18:44.265465+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:26:03.670562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023107+0000","last_change":"2023-08-25T05:18:43.025160+0000","last_active":"2023-08-25T05:18:44.023107+0000","last_peered":"2023-08-25T05:18:44.023107+0000","last_clean":"2023-08-25T05:18:44.023107+0000","last_became_active":"2023-08-25T05:18:43.024883+0000","last_became_peered":"2023-08-25T05:18:43.024883+0000","last_unstale":"2023-08-25T05:18:44.023107+0000","last_undegraded":"2023-08-25T05:18:44.023107+0000","last_fullsized":"2023-08-25T05:18:44.023107+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:12:22.988678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266306+0000","last_change":"2023-08-25T05:18:42.002477+0000","last_active":"2023-08-25T05:18:44.266306+0000","last_peered":"2023-08-25T05:18:44.266306+0000","last_clean":"2023-08-25T05:18:44.266306+0000","last_became_active":"2023-08-25T05:18:42.002189+0000","last_became_peered":"2023-08-25T05:18:42.002189+0000","last_unstale":"2023-08-25T05:18:44.266306+0000","last_undegraded":"2023-08-25T05:18:44.266306+0000","last_fullsized":"2023-08-25T05:18:44.266306+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:54:33.888415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023834+0000","last_change":"2023-08-25T05:18:43.035745+0000","last_active":"2023-08-25T05:18:44.023834+0000","last_peered":"2023-08-25T05:18:44.023834+0000","last_clean":"2023-08-25T05:18:44.023834+0000","last_became_active":"2023-08-25T05:18:43.033701+0000","last_became_peered":"2023-08-25T05:18:43.033701+0000","last_unstale":"2023-08-25T05:18:44.023834+0000","last_undegraded":"2023-08-25T05:18:44.023834+0000","last_fullsized":"2023-08-25T05:18:44.023834+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:56:19.448594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264890+0000","last_change":"2023-08-25T05:18:41.997558+0000","last_active":"2023-08-25T05:18:44.264890+0000","last_peered":"2023-08-25T05:18:44.264890+0000","last_clean":"2023-08-25T05:18:44.264890+0000","last_became_active":"2023-08-25T05:18:41.997225+0000","last_became_peered":"2023-08-25T05:18:41.997225+0000","last_unstale":"2023-08-25T05:18:44.264890+0000","last_undegraded":"2023-08-25T05:18:44.264890+0000","last_fullsized":"2023-08-25T05:18:44.264890+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:52:16.648509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264436+0000","last_change":"2023-08-25T05:18:43.027665+0000","last_active":"2023-08-25T05:18:44.264436+0000","last_peered":"2023-08-25T05:18:44.264436+0000","last_clean":"2023-08-25T05:18:44.264436+0000","last_became_active":"2023-08-25T05:18:43.023946+0000","last_became_peered":"2023-08-25T05:18:43.023946+0000","last_unstale":"2023-08-25T05:18:44.264436+0000","last_undegraded":"2023-08-25T05:18:44.264436+0000","last_fullsized":"2023-08-25T05:18:44.264436+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:23:36.539232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.029134+0000","last_change":"2023-08-25T05:18:42.000131+0000","last_active":"2023-08-25T05:18:44.029134+0000","last_peered":"2023-08-25T05:18:44.029134+0000","last_clean":"2023-08-25T05:18:44.029134+0000","last_became_active":"2023-08-25T05:18:41.999838+0000","last_became_peered":"2023-08-25T05:18:41.999838+0000","last_unstale":"2023-08-25T05:18:44.029134+0000","last_undegraded":"2023-08-25T05:18:44.029134+0000","last_fullsized":"2023-08-25T05:18:44.029134+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:24:13.182230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.029040+0000","last_change":"2023-08-25T05:18:43.026481+0000","last_active":"2023-08-25T05:18:44.029040+0000","last_peered":"2023-08-25T05:18:44.029040+0000","last_clean":"2023-08-25T05:18:44.029040+0000","last_became_active":"2023-08-25T05:18:43.024448+0000","last_became_peered":"2023-08-25T05:18:43.024448+0000","last_unstale":"2023-08-25T05:18:44.029040+0000","last_undegraded":"2023-08-25T05:18:44.029040+0000","last_fullsized":"2023-08-25T05:18:44.029040+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:36:10.249255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023232+0000","last_change":"2023-08-25T05:18:41.997520+0000","last_active":"2023-08-25T05:18:44.023232+0000","last_peered":"2023-08-25T05:18:44.023232+0000","last_clean":"2023-08-25T05:18:44.023232+0000","last_became_active":"2023-08-25T05:18:41.997027+0000","last_became_peered":"2023-08-25T05:18:41.997027+0000","last_unstale":"2023-08-25T05:18:44.023232+0000","last_undegraded":"2023-08-25T05:18:44.023232+0000","last_fullsized":"2023-08-25T05:18:44.023232+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:28:38.120100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264073+0000","last_change":"2023-08-25T05:18:43.025907+0000","last_active":"2023-08-25T05:18:44.264073+0000","last_peered":"2023-08-25T05:18:44.264073+0000","last_clean":"2023-08-25T05:18:44.264073+0000","last_became_active":"2023-08-25T05:18:43.025608+0000","last_became_peered":"2023-08-25T05:18:43.025608+0000","last_unstale":"2023-08-25T05:18:44.264073+0000","last_undegraded":"2023-08-25T05:18:44.264073+0000","last_fullsized":"2023-08-25T05:18:44.264073+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:44:39.176775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.263839+0000","last_change":"2023-08-25T05:18:41.996610+0000","last_active":"2023-08-25T05:18:44.263839+0000","last_peered":"2023-08-25T05:18:44.263839+0000","last_clean":"2023-08-25T05:18:44.263839+0000","last_became_active":"2023-08-25T05:18:41.996226+0000","last_became_peered":"2023-08-25T05:18:41.996226+0000","last_unstale":"2023-08-25T05:18:44.263839+0000","last_undegraded":"2023-08-25T05:18:44.263839+0000","last_fullsized":"2023-08-25T05:18:44.263839+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:15:42.883652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.029317+0000","last_change":"2023-08-25T05:18:43.022548+0000","last_active":"2023-08-25T05:18:44.029317+0000","last_peered":"2023-08-25T05:18:44.029317+0000","last_clean":"2023-08-25T05:18:44.029317+0000","last_became_active":"2023-08-25T05:18:43.022262+0000","last_became_peered":"2023-08-25T05:18:43.022262+0000","last_unstale":"2023-08-25T05:18:44.029317+0000","last_undegraded":"2023-08-25T05:18:44.029317+0000","last_fullsized":"2023-08-25T05:18:44.029317+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:13:22.966274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023266+0000","last_change":"2023-08-25T05:18:42.009616+0000","last_active":"2023-08-25T05:18:44.023266+0000","last_peered":"2023-08-25T05:18:44.023266+0000","last_clean":"2023-08-25T05:18:44.023266+0000","last_became_active":"2023-08-25T05:18:42.009122+0000","last_became_peered":"2023-08-25T05:18:42.009122+0000","last_unstale":"2023-08-25T05:18:44.023266+0000","last_undegraded":"2023-08-25T05:18:44.023266+0000","last_fullsized":"2023-08-25T05:18:44.023266+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:15:01.126641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265385+0000","last_change":"2023-08-25T05:18:43.017831+0000","last_active":"2023-08-25T05:18:44.265385+0000","last_peered":"2023-08-25T05:18:44.265385+0000","last_clean":"2023-08-25T05:18:44.265385+0000","last_became_active":"2023-08-25T05:18:43.017515+0000","last_became_peered":"2023-08-25T05:18:43.017515+0000","last_unstale":"2023-08-25T05:18:44.265385+0000","last_undegraded":"2023-08-25T05:18:44.265385+0000","last_fullsized":"2023-08-25T05:18:44.265385+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:58:35.505256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264799+0000","last_change":"2023-08-25T05:18:42.001493+0000","last_active":"2023-08-25T05:18:44.264799+0000","last_peered":"2023-08-25T05:18:44.264799+0000","last_clean":"2023-08-25T05:18:44.264799+0000","last_became_active":"2023-08-25T05:18:42.001207+0000","last_became_peered":"2023-08-25T05:18:42.001207+0000","last_unstale":"2023-08-25T05:18:44.264799+0000","last_undegraded":"2023-08-25T05:18:44.264799+0000","last_fullsized":"2023-08-25T05:18:44.264799+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:38:40.941750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.028896+0000","last_change":"2023-08-25T05:18:43.028728+0000","last_active":"2023-08-25T05:18:44.028896+0000","last_peered":"2023-08-25T05:18:44.028896+0000","last_clean":"2023-08-25T05:18:44.028896+0000","last_became_active":"2023-08-25T05:18:43.028386+0000","last_became_peered":"2023-08-25T05:18:43.028386+0000","last_unstale":"2023-08-25T05:18:44.028896+0000","last_undegraded":"2023-08-25T05:18:44.028896+0000","last_fullsized":"2023-08-25T05:18:44.028896+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:20:04.171396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264283+0000","last_change":"2023-08-25T05:18:42.002206+0000","last_active":"2023-08-25T05:18:44.264283+0000","last_peered":"2023-08-25T05:18:44.264283+0000","last_clean":"2023-08-25T05:18:44.264283+0000","last_became_active":"2023-08-25T05:18:42.001920+0000","last_became_peered":"2023-08-25T05:18:42.001920+0000","last_unstale":"2023-08-25T05:18:44.264283+0000","last_undegraded":"2023-08-25T05:18:44.264283+0000","last_fullsized":"2023-08-25T05:18:44.264283+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:09:05.451822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265769+0000","last_change":"2023-08-25T05:18:43.021948+0000","last_active":"2023-08-25T05:18:44.265769+0000","last_peered":"2023-08-25T05:18:44.265769+0000","last_clean":"2023-08-25T05:18:44.265769+0000","last_became_active":"2023-08-25T05:18:43.021683+0000","last_became_peered":"2023-08-25T05:18:43.021683+0000","last_unstale":"2023-08-25T05:18:44.265769+0000","last_undegraded":"2023-08-25T05:18:44.265769+0000","last_fullsized":"2023-08-25T05:18:44.265769+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:06:41.412964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023632+0000","last_change":"2023-08-25T05:18:42.005532+0000","last_active":"2023-08-25T05:18:44.023632+0000","last_peered":"2023-08-25T05:18:44.023632+0000","last_clean":"2023-08-25T05:18:44.023632+0000","last_became_active":"2023-08-25T05:18:42.005252+0000","last_became_peered":"2023-08-25T05:18:42.005252+0000","last_unstale":"2023-08-25T05:18:44.023632+0000","last_undegraded":"2023-08-25T05:18:44.023632+0000","last_fullsized":"2023-08-25T05:18:44.023632+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:42:39.151805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023077+0000","last_change":"2023-08-25T05:18:43.027308+0000","last_active":"2023-08-25T05:18:44.023077+0000","last_peered":"2023-08-25T05:18:44.023077+0000","last_clean":"2023-08-25T05:18:44.023077+0000","last_became_active":"2023-08-25T05:18:43.027025+0000","last_became_peered":"2023-08-25T05:18:43.027025+0000","last_unstale":"2023-08-25T05:18:44.023077+0000","last_undegraded":"2023-08-25T05:18:44.023077+0000","last_fullsized":"2023-08-25T05:18:44.023077+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:42:34.144469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023448+0000","last_change":"2023-08-25T05:18:41.997664+0000","last_active":"2023-08-25T05:18:44.023448+0000","last_peered":"2023-08-25T05:18:44.023448+0000","last_clean":"2023-08-25T05:18:44.023448+0000","last_became_active":"2023-08-25T05:18:41.997306+0000","last_became_peered":"2023-08-25T05:18:41.997306+0000","last_unstale":"2023-08-25T05:18:44.023448+0000","last_undegraded":"2023-08-25T05:18:44.023448+0000","last_fullsized":"2023-08-25T05:18:44.023448+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:56:48.440336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264575+0000","last_change":"2023-08-25T05:18:43.026696+0000","last_active":"2023-08-25T05:18:44.264575+0000","last_peered":"2023-08-25T05:18:44.264575+0000","last_clean":"2023-08-25T05:18:44.264575+0000","last_became_active":"2023-08-25T05:18:43.023547+0000","last_became_peered":"2023-08-25T05:18:43.023547+0000","last_unstale":"2023-08-25T05:18:44.264575+0000","last_undegraded":"2023-08-25T05:18:44.264575+0000","last_fullsized":"2023-08-25T05:18:44.264575+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:24:26.928297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265129+0000","last_change":"2023-08-25T05:18:41.999051+0000","last_active":"2023-08-25T05:18:44.265129+0000","last_peered":"2023-08-25T05:18:44.265129+0000","last_clean":"2023-08-25T05:18:44.265129+0000","last_became_active":"2023-08-25T05:18:41.998743+0000","last_became_peered":"2023-08-25T05:18:41.998743+0000","last_unstale":"2023-08-25T05:18:44.265129+0000","last_undegraded":"2023-08-25T05:18:44.265129+0000","last_fullsized":"2023-08-25T05:18:44.265129+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:19.243492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265096+0000","last_change":"2023-08-25T05:18:43.016275+0000","last_active":"2023-08-25T05:18:44.265096+0000","last_peered":"2023-08-25T05:18:44.265096+0000","last_clean":"2023-08-25T05:18:44.265096+0000","last_became_active":"2023-08-25T05:18:43.013832+0000","last_became_peered":"2023-08-25T05:18:43.013832+0000","last_unstale":"2023-08-25T05:18:44.265096+0000","last_undegraded":"2023-08-25T05:18:44.265096+0000","last_fullsized":"2023-08-25T05:18:44.265096+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:30:14.175368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265348+0000","last_change":"2023-08-25T05:18:42.006062+0000","last_active":"2023-08-25T05:18:44.265348+0000","last_peered":"2023-08-25T05:18:44.265348+0000","last_clean":"2023-08-25T05:18:44.265348+0000","last_became_active":"2023-08-25T05:18:42.005637+0000","last_became_peered":"2023-08-25T05:18:42.005637+0000","last_unstale":"2023-08-25T05:18:44.265348+0000","last_undegraded":"2023-08-25T05:18:44.265348+0000","last_fullsized":"2023-08-25T05:18:44.265348+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:11:37.665172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264748+0000","last_change":"2023-08-25T05:18:43.016016+0000","last_active":"2023-08-25T05:18:44.264748+0000","last_peered":"2023-08-25T05:18:44.264748+0000","last_clean":"2023-08-25T05:18:44.264748+0000","last_became_active":"2023-08-25T05:18:43.015720+0000","last_became_peered":"2023-08-25T05:18:43.015720+0000","last_unstale":"2023-08-25T05:18:44.264748+0000","last_undegraded":"2023-08-25T05:18:44.264748+0000","last_fullsized":"2023-08-25T05:18:44.264748+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:53:39.126353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023821+0000","last_change":"2023-08-25T05:18:42.007961+0000","last_active":"2023-08-25T05:18:44.023821+0000","last_peered":"2023-08-25T05:18:44.023821+0000","last_clean":"2023-08-25T05:18:44.023821+0000","last_became_active":"2023-08-25T05:18:42.007709+0000","last_became_peered":"2023-08-25T05:18:42.007709+0000","last_unstale":"2023-08-25T05:18:44.023821+0000","last_undegraded":"2023-08-25T05:18:44.023821+0000","last_fullsized":"2023-08-25T05:18:44.023821+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:51:08.045361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264599+0000","last_change":"2023-08-25T05:18:43.023107+0000","last_active":"2023-08-25T05:18:44.264599+0000","last_peered":"2023-08-25T05:18:44.264599+0000","last_clean":"2023-08-25T05:18:44.264599+0000","last_became_active":"2023-08-25T05:18:43.022816+0000","last_became_peered":"2023-08-25T05:18:43.022816+0000","last_unstale":"2023-08-25T05:18:44.264599+0000","last_undegraded":"2023-08-25T05:18:44.264599+0000","last_fullsized":"2023-08-25T05:18:44.264599+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:22:47.802011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264958+0000","last_change":"2023-08-25T05:18:41.997712+0000","last_active":"2023-08-25T05:18:44.264958+0000","last_peered":"2023-08-25T05:18:44.264958+0000","last_clean":"2023-08-25T05:18:44.264958+0000","last_became_active":"2023-08-25T05:18:41.997370+0000","last_became_peered":"2023-08-25T05:18:41.997370+0000","last_unstale":"2023-08-25T05:18:44.264958+0000","last_undegraded":"2023-08-25T05:18:44.264958+0000","last_fullsized":"2023-08-25T05:18:44.264958+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:07.320076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024009+0000","last_change":"2023-08-25T05:18:43.026045+0000","last_active":"2023-08-25T05:18:44.024009+0000","last_peered":"2023-08-25T05:18:44.024009+0000","last_clean":"2023-08-25T05:18:44.024009+0000","last_became_active":"2023-08-25T05:18:43.025780+0000","last_became_peered":"2023-08-25T05:18:43.025780+0000","last_unstale":"2023-08-25T05:18:44.024009+0000","last_undegraded":"2023-08-25T05:18:44.024009+0000","last_fullsized":"2023-08-25T05:18:44.024009+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:28:42.264155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.029023+0000","last_change":"2023-08-25T05:18:41.996744+0000","last_active":"2023-08-25T05:18:44.029023+0000","last_peered":"2023-08-25T05:18:44.029023+0000","last_clean":"2023-08-25T05:18:44.029023+0000","last_became_active":"2023-08-25T05:18:41.996415+0000","last_became_peered":"2023-08-25T05:18:41.996415+0000","last_unstale":"2023-08-25T05:18:44.029023+0000","last_undegraded":"2023-08-25T05:18:44.029023+0000","last_fullsized":"2023-08-25T05:18:44.029023+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:10:54.857022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266175+0000","last_change":"2023-08-25T05:18:43.016638+0000","last_active":"2023-08-25T05:18:44.266175+0000","last_peered":"2023-08-25T05:18:44.266175+0000","last_clean":"2023-08-25T05:18:44.266175+0000","last_became_active":"2023-08-25T05:18:43.016337+0000","last_became_peered":"2023-08-25T05:18:43.016337+0000","last_unstale":"2023-08-25T05:18:44.266175+0000","last_undegraded":"2023-08-25T05:18:44.266175+0000","last_fullsized":"2023-08-25T05:18:44.266175+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:22:07.929386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.023629+0000","last_change":"2023-08-25T05:18:42.008485+0000","last_active":"2023-08-25T05:18:44.023629+0000","last_peered":"2023-08-25T05:18:44.023629+0000","last_clean":"2023-08-25T05:18:44.023629+0000","last_became_active":"2023-08-25T05:18:42.008215+0000","last_became_peered":"2023-08-25T05:18:42.008215+0000","last_unstale":"2023-08-25T05:18:44.023629+0000","last_undegraded":"2023-08-25T05:18:44.023629+0000","last_fullsized":"2023-08-25T05:18:44.023629+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:36:29.351358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"144'3576","reported_seq":4296,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.022989+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:18:44.022989+0000","last_peered":"2023-08-25T05:18:44.022989+0000","last_clean":"2023-08-25T05:18:44.022989+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:18:44.022989+0000","last_undegraded":"2023-08-25T05:18:44.022989+0000","last_fullsized":"2023-08-25T05:18:44.022989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3576,"log_dups_size":0,"ondisk_log_size":3576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:59:59.185548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1424,"num_read_kb":2961,"num_write":425,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":277,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265190+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:18:44.265190+0000","last_peered":"2023-08-25T05:18:44.265190+0000","last_clean":"2023-08-25T05:18:44.265190+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:18:44.265190+0000","last_undegraded":"2023-08-25T05:18:44.265190+0000","last_fullsized":"2023-08-25T05:18:44.265190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:28:58.855339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024311+0000","last_change":"2023-08-25T05:18:43.027617+0000","last_active":"2023-08-25T05:18:44.024311+0000","last_peered":"2023-08-25T05:18:44.024311+0000","last_clean":"2023-08-25T05:18:44.024311+0000","last_became_active":"2023-08-25T05:18:43.026629+0000","last_became_peered":"2023-08-25T05:18:43.026629+0000","last_unstale":"2023-08-25T05:18:44.024311+0000","last_undegraded":"2023-08-25T05:18:44.024311+0000","last_fullsized":"2023-08-25T05:18:44.024311+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:06.811328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265841+0000","last_change":"2023-08-25T05:18:42.004689+0000","last_active":"2023-08-25T05:18:44.265841+0000","last_peered":"2023-08-25T05:18:44.265841+0000","last_clean":"2023-08-25T05:18:44.265841+0000","last_became_active":"2023-08-25T05:18:42.004418+0000","last_became_peered":"2023-08-25T05:18:42.004418+0000","last_unstale":"2023-08-25T05:18:44.265841+0000","last_undegraded":"2023-08-25T05:18:44.265841+0000","last_fullsized":"2023-08-25T05:18:44.265841+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:30:19.459460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":274,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.022856+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:18:44.022856+0000","last_peered":"2023-08-25T05:18:44.022856+0000","last_clean":"2023-08-25T05:18:44.022856+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:18:44.022856+0000","last_undegraded":"2023-08-25T05:18:44.022856+0000","last_fullsized":"2023-08-25T05:18:44.022856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:20:11.374565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.029289+0000","last_change":"2023-08-25T05:18:43.025521+0000","last_active":"2023-08-25T05:18:44.029289+0000","last_peered":"2023-08-25T05:18:44.029289+0000","last_clean":"2023-08-25T05:18:44.029289+0000","last_became_active":"2023-08-25T05:18:43.024342+0000","last_became_peered":"2023-08-25T05:18:43.024342+0000","last_unstale":"2023-08-25T05:18:44.029289+0000","last_undegraded":"2023-08-25T05:18:44.029289+0000","last_fullsized":"2023-08-25T05:18:44.029289+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:47:56.770443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"156'8","reported_seq":21,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264659+0000","last_change":"2023-08-25T05:18:42.000254+0000","last_active":"2023-08-25T05:18:44.264659+0000","last_peered":"2023-08-25T05:18:44.264659+0000","last_clean":"2023-08-25T05:18:44.264659+0000","last_became_active":"2023-08-25T05:18:41.999919+0000","last_became_peered":"2023-08-25T05:18:41.999919+0000","last_unstale":"2023-08-25T05:18:44.264659+0000","last_undegraded":"2023-08-25T05:18:44.264659+0000","last_fullsized":"2023-08-25T05:18:44.264659+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:44:49.983274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":281,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.263712+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:18:44.263712+0000","last_peered":"2023-08-25T05:18:44.263712+0000","last_clean":"2023-08-25T05:18:44.263712+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:18:44.263712+0000","last_undegraded":"2023-08-25T05:18:44.263712+0000","last_fullsized":"2023-08-25T05:18:44.263712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:37:06.890891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264623+0000","last_change":"2023-08-25T05:18:43.026892+0000","last_active":"2023-08-25T05:18:44.264623+0000","last_peered":"2023-08-25T05:18:44.264623+0000","last_clean":"2023-08-25T05:18:44.264623+0000","last_became_active":"2023-08-25T05:18:43.026591+0000","last_became_peered":"2023-08-25T05:18:43.026591+0000","last_unstale":"2023-08-25T05:18:44.264623+0000","last_undegraded":"2023-08-25T05:18:44.264623+0000","last_fullsized":"2023-08-25T05:18:44.264623+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:44:46.192772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.263891+0000","last_change":"2023-08-25T05:18:42.002328+0000","last_active":"2023-08-25T05:18:44.263891+0000","last_peered":"2023-08-25T05:18:44.263891+0000","last_clean":"2023-08-25T05:18:44.263891+0000","last_became_active":"2023-08-25T05:18:42.001515+0000","last_became_peered":"2023-08-25T05:18:42.001515+0000","last_unstale":"2023-08-25T05:18:44.263891+0000","last_undegraded":"2023-08-25T05:18:44.263891+0000","last_fullsized":"2023-08-25T05:18:44.263891+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:01:03.539459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":277,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265193+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:18:44.265193+0000","last_peered":"2023-08-25T05:18:44.265193+0000","last_clean":"2023-08-25T05:18:44.265193+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:18:44.265193+0000","last_undegraded":"2023-08-25T05:18:44.265193+0000","last_fullsized":"2023-08-25T05:18:44.265193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:08:39.590865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266254+0000","last_change":"2023-08-25T05:18:43.012845+0000","last_active":"2023-08-25T05:18:44.266254+0000","last_peered":"2023-08-25T05:18:44.266254+0000","last_clean":"2023-08-25T05:18:44.266254+0000","last_became_active":"2023-08-25T05:18:43.012531+0000","last_became_peered":"2023-08-25T05:18:43.012531+0000","last_unstale":"2023-08-25T05:18:44.266254+0000","last_undegraded":"2023-08-25T05:18:44.266254+0000","last_fullsized":"2023-08-25T05:18:44.266254+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:11:28.839645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"156'3","reported_seq":16,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024389+0000","last_change":"2023-08-25T05:18:42.009359+0000","last_active":"2023-08-25T05:18:44.024389+0000","last_peered":"2023-08-25T05:18:44.024389+0000","last_clean":"2023-08-25T05:18:44.024389+0000","last_became_active":"2023-08-25T05:18:42.009035+0000","last_became_peered":"2023-08-25T05:18:42.009035+0000","last_unstale":"2023-08-25T05:18:44.024389+0000","last_undegraded":"2023-08-25T05:18:44.024389+0000","last_fullsized":"2023-08-25T05:18:44.024389+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:51:22.629220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":295,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265140+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:18:44.265140+0000","last_peered":"2023-08-25T05:18:44.265140+0000","last_clean":"2023-08-25T05:18:44.265140+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:18:44.265140+0000","last_undegraded":"2023-08-25T05:18:44.265140+0000","last_fullsized":"2023-08-25T05:18:44.265140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:14:49.169294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266281+0000","last_change":"2023-08-25T05:18:43.023594+0000","last_active":"2023-08-25T05:18:44.266281+0000","last_peered":"2023-08-25T05:18:44.266281+0000","last_clean":"2023-08-25T05:18:44.266281+0000","last_became_active":"2023-08-25T05:18:43.023065+0000","last_became_peered":"2023-08-25T05:18:43.023065+0000","last_unstale":"2023-08-25T05:18:44.266281+0000","last_undegraded":"2023-08-25T05:18:44.266281+0000","last_fullsized":"2023-08-25T05:18:44.266281+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:07:13.370237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"156'6","reported_seq":19,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024237+0000","last_change":"2023-08-25T05:18:42.007912+0000","last_active":"2023-08-25T05:18:44.024237+0000","last_peered":"2023-08-25T05:18:44.024237+0000","last_clean":"2023-08-25T05:18:44.024237+0000","last_became_active":"2023-08-25T05:18:42.007622+0000","last_became_peered":"2023-08-25T05:18:42.007622+0000","last_unstale":"2023-08-25T05:18:44.024237+0000","last_undegraded":"2023-08-25T05:18:44.024237+0000","last_fullsized":"2023-08-25T05:18:44.024237+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:00:57.416789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":273,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.024452+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:18:44.024452+0000","last_peered":"2023-08-25T05:18:44.024452+0000","last_clean":"2023-08-25T05:18:44.024452+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:18:44.024452+0000","last_undegraded":"2023-08-25T05:18:44.024452+0000","last_fullsized":"2023-08-25T05:18:44.024452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:51:38.180709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.263607+0000","last_change":"2023-08-25T05:18:43.022011+0000","last_active":"2023-08-25T05:18:44.263607+0000","last_peered":"2023-08-25T05:18:44.263607+0000","last_clean":"2023-08-25T05:18:44.263607+0000","last_became_active":"2023-08-25T05:18:43.021487+0000","last_became_peered":"2023-08-25T05:18:43.021487+0000","last_unstale":"2023-08-25T05:18:44.263607+0000","last_undegraded":"2023-08-25T05:18:44.263607+0000","last_fullsized":"2023-08-25T05:18:44.263607+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:53:29.305847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.265368+0000","last_change":"2023-08-25T05:18:42.001170+0000","last_active":"2023-08-25T05:18:44.265368+0000","last_peered":"2023-08-25T05:18:44.265368+0000","last_clean":"2023-08-25T05:18:44.265368+0000","last_became_active":"2023-08-25T05:18:42.000871+0000","last_became_peered":"2023-08-25T05:18:42.000871+0000","last_unstale":"2023-08-25T05:18:44.265368+0000","last_undegraded":"2023-08-25T05:18:44.265368+0000","last_fullsized":"2023-08-25T05:18:44.265368+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:26:45.672460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":294,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264732+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:18:44.264732+0000","last_peered":"2023-08-25T05:18:44.264732+0000","last_clean":"2023-08-25T05:18:44.264732+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:18:44.264732+0000","last_undegraded":"2023-08-25T05:18:44.264732+0000","last_fullsized":"2023-08-25T05:18:44.264732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:13:01.797253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264723+0000","last_change":"2023-08-25T05:18:43.019768+0000","last_active":"2023-08-25T05:18:44.264723+0000","last_peered":"2023-08-25T05:18:44.264723+0000","last_clean":"2023-08-25T05:18:44.264723+0000","last_became_active":"2023-08-25T05:18:43.019444+0000","last_became_peered":"2023-08-25T05:18:43.019444+0000","last_unstale":"2023-08-25T05:18:44.264723+0000","last_undegraded":"2023-08-25T05:18:44.264723+0000","last_fullsized":"2023-08-25T05:18:44.264723+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:41.976656+0000","last_clean_scrub_stamp":"2023-08-25T05:18:41.976656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:11.568022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.264065+0000","last_change":"2023-08-25T05:18:42.003667+0000","last_active":"2023-08-25T05:18:44.264065+0000","last_peered":"2023-08-25T05:18:44.264065+0000","last_clean":"2023-08-25T05:18:44.264065+0000","last_became_active":"2023-08-25T05:18:42.003374+0000","last_became_peered":"2023-08-25T05:18:42.003374+0000","last_unstale":"2023-08-25T05:18:44.264065+0000","last_undegraded":"2023-08-25T05:18:44.264065+0000","last_fullsized":"2023-08-25T05:18:44.264065+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:18:40.965531+0000","last_clean_scrub_stamp":"2023-08-25T05:18:40.965531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:53.417493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":314,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-08-25T05:18:44.266460+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:18:44.266460+0000","last_peered":"2023-08-25T05:18:44.266460+0000","last_clean":"2023-08-25T05:18:44.266460+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:18:44.266460+0000","last_undegraded":"2023-08-25T05:18:44.266460+0000","last_fullsized":"2023-08-25T05:18:44.266460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:02:12.993652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1424,"num_read_kb":2961,"num_write":425,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3576,"ondisk_log_size":3576,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510348,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51732,"kb_used_data":2496,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320108,"statfs":{"total":96636764160,"available":96583790592,"internally_reserved":0,"allocated":2555904,"data_stored":1574266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.51000000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89000000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.47799999999999998,"15min":0.38500000000000001},"max":{"1min":0.98299999999999998,"5min":1.0069999999999999,"15min":1.0089999999999999},"last":0.752}]},{"osd":1,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96999999999999997,"5min":0.99399999999999999,"15min":1.0629999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.45100000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0329999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.83499999999999996}]},{"osd":2,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.745,"15min":0.748},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46200000000000002},"max":{"1min":0.95699999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.54400000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0109999999999999,"5min":1.405,"15min":1.405},"last":0.68700000000000006}]},{"osd":3,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.496},"max":{"1min":0.92600000000000005,"5min":1.0409999999999999,"15min":1.0469999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.752,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.85699999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84599999999999997,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82999999999999996,"5min":0.96499999999999997,"15min":0.97499999999999998},"last":0.57199999999999995}]},{"osd":5,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63700000000000001,"15min":0.627},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82899999999999996,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66700000000000004,"15min":0.67200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.90300000000000002,"5min":0.97899999999999998,"15min":1.0309999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72599999999999998,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94099999999999995,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.45100000000000001},"max":{"1min":0.874,"5min":0.996,"15min":1.0649999999999999},"last":0.63200000000000001}]}]},{"osd":6,"up_from":15,"seq":64424510348,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28932,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342908,"statfs":{"total":96636764160,"available":96607137792,"internally_reserved":0,"allocated":1953792,"data_stored":982868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.745,"15min":0.746},"min":{"1min":0.625,"5min":0.433,"15min":0.433},"max":{"1min":0.95199999999999996,"5min":0.96799999999999997,"15min":1.2070000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.54800000000000004,"5min":0.42699999999999999,"15min":0.41299999999999998},"max":{"1min":0.999,"5min":0.999,"15min":1.002},"last":0.68400000000000005}]},{"osd":1,"last update":"Fri Aug 25 05:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.75,"15min":0.745},"min":{"1min":0.56999999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.94999999999999996,"5min":0.95799999999999996,"15min":1.0149999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75,"15min":0.755},"min":{"1min":0.53600000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.3009999999999999},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Aug 25 05:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.78600000000000003},"min":{"1min":0.65300000000000002,"5min":0.54000000000000004,"15min":0.53900000000000003},"max":{"1min":0.93100000000000005,"5min":0.95699999999999996,"15min":1.1240000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.81499999999999995,"15min":0.81799999999999995},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.96999999999999997,"5min":1.0249999999999999,"15min":1.0549999999999999},"last":0.88}]},{"osd":3,"last update":"Fri Aug 25 05:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.77900000000000003,"15min":0.77100000000000002},"min":{"1min":0.63500000000000001,"5min":0.51200000000000001,"15min":0.499},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.6020000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79200000000000004,"15min":0.77800000000000002},"min":{"1min":0.56799999999999995,"5min":0.56599999999999995,"15min":0.502},"max":{"1min":0.998,"5min":1.004,"15min":1.1519999999999999},"last":0.73799999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.40500000000000003,"5min":0.39300000000000002,"15min":0.375},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":1.2589999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.63100000000000001,"15min":0.61899999999999999},"min":{"1min":0.433,"5min":0.42999999999999999,"15min":0.373},"max":{"1min":0.86499999999999999,"5min":0.92600000000000005,"15min":1.571},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Aug 25 05:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64700000000000002,"15min":0.65400000000000003},"min":{"1min":0.499,"5min":0.41399999999999998,"15min":0.40799999999999997},"max":{"1min":0.96699999999999997,"5min":0.96799999999999997,"15min":1.0269999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.503,"5min":0.46999999999999997,"15min":0.44800000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.3380000000000001},"last":0.80000000000000004}]},{"osd":7,"last update":"Fri Aug 25 05:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67700000000000005,"15min":0.66500000000000004},"min":{"1min":0.49199999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92900000000000005,"5min":1.0109999999999999,"15min":1.0740000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69999999999999996,"15min":0.68899999999999995},"min":{"1min":0.501,"5min":0.46700000000000003,"15min":0.46100000000000002},"max":{"1min":0.98899999999999999,"5min":1.038,"15min":1.667},"last":0.77900000000000003}]}]},{"osd":5,"up_from":14,"seq":60129543051,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55292,"kb_used_data":1904,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316548,"statfs":{"total":96636764160,"available":96580145152,"internally_reserved":0,"allocated":1949696,"data_stored":982218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.75900000000000001,"15min":0.74299999999999999},"min":{"1min":0.56399999999999995,"5min":0.52400000000000002,"15min":0.35399999999999998},"max":{"1min":1.0649999999999999,"5min":1.175,"15min":1.175},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.51800000000000002,"15min":0.41599999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.0620000000000001},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Aug 25 05:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.75600000000000001},"min":{"1min":0.53900000000000003,"5min":0.53000000000000003,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":1.02,"15min":1.042},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77500000000000002,"15min":0.76900000000000002},"min":{"1min":0.60299999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.004,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.754,"15min":0.754},"min":{"1min":0.58899999999999997,"5min":0.496,"15min":0.45900000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.79300000000000004,"15min":0.77600000000000002},"min":{"1min":0.59699999999999998,"5min":0.51700000000000002,"15min":0.5},"max":{"1min":1.01,"5min":1.0349999999999999,"15min":1.038},"last":0.746}]},{"osd":3,"last update":"Fri Aug 25 05:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.77300000000000002,"15min":0.76800000000000002},"min":{"1min":0.56000000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.93899999999999995,"5min":1.131,"15min":1.131},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.54500000000000004},"max":{"1min":1.032,"5min":1.032,"15min":1.073},"last":0.62}]},{"osd":4,"last update":"Fri Aug 25 05:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.39600000000000002},"max":{"1min":0.75,"5min":0.91500000000000004,"15min":0.998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60699999999999998,"15min":0.61599999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.78300000000000003,"5min":0.84799999999999998,"15min":0.98099999999999998},"last":0.68600000000000005}]},{"osd":6,"last update":"Fri Aug 25 05:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65700000000000003,"15min":0.65400000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.39700000000000002},"max":{"1min":0.91400000000000003,"5min":0.95799999999999996,"15min":1.0409999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.498,"5min":0.47299999999999998,"15min":0.41799999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":1.026},"last":0.79900000000000004}]},{"osd":7,"last update":"Fri Aug 25 05:18:11 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.45700000000000002,"5min":0.42799999999999999,"15min":0.32100000000000001},"max":{"1min":0.878,"5min":0.95299999999999996,"15min":1.034},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71099999999999997,"15min":0.70899999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.45100000000000001},"max":{"1min":0.92900000000000005,"5min":0.98599999999999999,"15min":1.0740000000000001},"last":0.78200000000000003}]}]},{"osd":4,"up_from":14,"seq":60129543051,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41400,"kb_used_data":1900,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330440,"statfs":{"total":96636764160,"available":96594370560,"internally_reserved":0,"allocated":1945600,"data_stored":982196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76700000000000002,"15min":0.74199999999999999},"min":{"1min":0.54900000000000004,"5min":0.48599999999999999,"15min":0.42899999999999999},"max":{"1min":0.94299999999999995,"5min":1.0509999999999999,"15min":1.0720000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.753,"15min":0.72999999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.442},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96999999999999997},"last":0.73899999999999999}]},{"osd":1,"last update":"Fri Aug 25 05:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79000000000000004,"15min":0.76500000000000001},"min":{"1min":0.56599999999999995,"5min":0.48199999999999998,"15min":0.45900000000000002},"max":{"1min":0.98799999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78300000000000003,"15min":0.76300000000000001},"min":{"1min":0.61899999999999999,"5min":0.54900000000000004,"15min":0.51400000000000001},"max":{"1min":0.96599999999999997,"5min":1.008,"15min":1.0660000000000001},"last":0.85999999999999999}]},{"osd":2,"last update":"Fri Aug 25 05:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78100000000000003,"15min":0.77100000000000002},"min":{"1min":0.57999999999999996,"5min":0.55800000000000005,"15min":0.46500000000000002},"max":{"1min":0.96099999999999997,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.876},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78700000000000003,"15min":0.76900000000000002},"min":{"1min":0.60599999999999998,"5min":0.52800000000000002,"15min":0.47199999999999998},"max":{"1min":0.95299999999999996,"5min":1.093,"15min":1.093},"last":0.82599999999999996}]},{"osd":3,"last update":"Fri Aug 25 05:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80000000000000004,"15min":0.78100000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.51700000000000002},"max":{"1min":0.98799999999999999,"5min":1.0429999999999999,"15min":1.044},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80400000000000005,"15min":0.78900000000000003},"min":{"1min":0.63900000000000001,"5min":0.59299999999999997,"15min":0.5},"max":{"1min":0.90800000000000003,"5min":1.048,"15min":1.1180000000000001},"last":0.76500000000000001}]},{"osd":5,"last update":"Fri Aug 25 05:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57599999999999996,"15min":0.55500000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.35699999999999998},"max":{"1min":0.74199999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60799999999999998,"15min":0.59799999999999998},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.38800000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":1.0449999999999999},"last":0.51000000000000001}]},{"osd":6,"last update":"Fri Aug 25 05:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.746,"15min":0.73699999999999999},"min":{"1min":0.57099999999999995,"5min":0.505,"15min":0.48399999999999999},"max":{"1min":0.96099999999999997,"5min":0.97299999999999998,"15min":1.01},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.67100000000000004,"15min":0.66300000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.38700000000000001},"max":{"1min":0.97699999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Fri Aug 25 05:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64000000000000001,"15min":0.626},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.40200000000000002},"max":{"1min":0.89600000000000002,"5min":0.90300000000000002,"15min":0.94399999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.71999999999999997,"15min":0.70299999999999996},"min":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.46100000000000002},"max":{"1min":0.97799999999999998,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.70899999999999996}]}]},{"osd":3,"up_from":14,"seq":60129543051,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59468,"kb_used_data":1916,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312372,"statfs":{"total":96636764160,"available":96575868928,"internally_reserved":0,"allocated":1961984,"data_stored":983878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46500000000000002,"15min":0.46800000000000003},"min":{"1min":0.33800000000000002,"5min":0.32800000000000001,"15min":0.315},"max":{"1min":0.624,"5min":0.72299999999999998,"15min":0.88300000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53700000000000003,"15min":0.54100000000000004},"min":{"1min":0.35799999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70099999999999996,"5min":0.79300000000000004,"15min":0.80700000000000005},"last":0.54200000000000004}]},{"osd":1,"last update":"Fri Aug 25 05:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.92700000000000005},"last":0.627},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64000000000000001,"15min":0.63300000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.85899999999999999,"5min":0.88100000000000001,"15min":0.96199999999999997},"last":0.67100000000000004}]},{"osd":2,"last update":"Fri Aug 25 05:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.48899999999999999,"5min":0.42999999999999999,"15min":0.42899999999999999},"max":{"1min":0.80100000000000005,"5min":0.85099999999999998,"15min":0.89400000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.40899999999999997,"5min":0.38700000000000001,"15min":0.379},"max":{"1min":0.76600000000000001,"5min":0.85599999999999998,"15min":0.91500000000000004},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Aug 25 05:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.81599999999999995,"15min":0.80600000000000005},"min":{"1min":0.56299999999999994,"5min":0.52400000000000002,"15min":0.499},"max":{"1min":1.0920000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.84199999999999997,"15min":0.84399999999999997},"min":{"1min":0.65000000000000002,"5min":0.625,"15min":0.55600000000000005},"max":{"1min":1.0649999999999999,"5min":1.2509999999999999,"15min":1.3220000000000001},"last":0.92500000000000004}]},{"osd":5,"last update":"Fri Aug 25 05:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82699999999999996,"15min":0.82299999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.55300000000000005},"max":{"1min":1.111,"5min":1.1830000000000001,"15min":1.2749999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58299999999999996},"max":{"1min":1.1359999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.1619999999999999}]},{"osd":6,"last update":"Fri Aug 25 05:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.87,"15min":0.86599999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0580000000000001,"5min":1.357,"15min":1.357},"last":1.038},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.84799999999999998,"15min":0.84099999999999997},"min":{"1min":0.628,"5min":0.58299999999999996,"15min":0.54900000000000004},"max":{"1min":1.0189999999999999,"5min":1.274,"15min":1.274},"last":1.085}]},{"osd":7,"last update":"Fri Aug 25 05:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.89100000000000001,"15min":0.879},"min":{"1min":0.64100000000000001,"5min":0.63800000000000001,"15min":0.60599999999999998},"max":{"1min":1.103,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.115},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83999999999999997,"15min":0.83199999999999996},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.093,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.1339999999999999}]}]},{"osd":2,"up_from":14,"seq":60129543052,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59460,"kb_used_data":1908,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312380,"statfs":{"total":96636764160,"available":96575877120,"internally_reserved":0,"allocated":1953792,"data_stored":982812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.66000000000000003,"5min":0.72599999999999998,"15min":0.76800000000000002},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.41699999999999998}]},{"osd":1,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33200000000000002},"max":{"1min":0.69599999999999995,"5min":0.76300000000000001,"15min":0.77600000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.628},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.503}]},{"osd":3,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.78100000000000003,"15min":0.83599999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82899999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.436}]},{"osd":4,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85099999999999998,"15min":0.83599999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1870000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.48299999999999998},"max":{"1min":1.089,"5min":1.163,"15min":1.163},"last":0.83599999999999997}]},{"osd":5,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.82599999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.54300000000000004},"max":{"1min":1.113,"5min":1.393,"15min":1.393},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.53900000000000003},"max":{"1min":1.2310000000000001,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.91600000000000004}]},{"osd":6,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.88200000000000001,"15min":0.85999999999999999},"min":{"1min":0.63800000000000001,"5min":0.63700000000000001,"15min":0.58699999999999997},"max":{"1min":1.169,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.875},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.88900000000000001,"15min":0.89400000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1910000000000001,"5min":1.2529999999999999,"15min":1.369},"last":0.81899999999999995}]},{"osd":7,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84899999999999998,"15min":0.82999999999999996},"min":{"1min":0.68799999999999994,"5min":0.621,"15min":0.54300000000000004},"max":{"1min":1.131,"5min":1.292,"15min":1.292},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.85399999999999998,"15min":0.83799999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.125,"5min":1.1870000000000001,"15min":1.254},"last":0.80100000000000005}]}]},{"osd":1,"up_from":14,"seq":60129543052,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37244,"kb_used_data":1904,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334596,"statfs":{"total":96636764160,"available":96598626304,"internally_reserved":0,"allocated":1949696,"data_stored":982266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.48299999999999998},"min":{"1min":0.32300000000000001,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.752,"15min":0.91700000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.88700000000000001},"last":0.374}]},{"osd":2,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73699999999999999,"5min":0.749,"15min":0.78900000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.34799999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82299999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.437,"5min":0.435,"15min":0.40600000000000003},"max":{"1min":0.86799999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.499},"max":{"1min":0.97899999999999998,"5min":1.0680000000000001,"15min":1.212},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.83099999999999996,"15min":0.82499999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.0229999999999999,"5min":1.0429999999999999,"15min":1.163},"last":0.84199999999999997}]},{"osd":5,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.52900000000000003},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.81999999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.083,"5min":1.115,"15min":1.171},"last":0.748}]},{"osd":6,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86499999999999999,"15min":0.84599999999999997},"min":{"1min":0.64400000000000002,"5min":0.627,"15min":0.51500000000000001},"max":{"1min":1.107,"5min":1.1579999999999999,"15min":1.3700000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83299999999999996,"15min":0.83399999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.1830000000000001},"last":0.82099999999999995}]},{"osd":7,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.044,"5min":1.1659999999999999,"15min":1.3320000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.58899999999999997},"max":{"1min":1.115,"5min":1.115,"15min":1.268},"last":0.89000000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543051,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41992,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329848,"statfs":{"total":96636764160,"available":96593764352,"internally_reserved":0,"allocated":2547712,"data_stored":1572620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77200000000000002,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.379},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.49099999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.40500000000000003}]},{"osd":2,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.35099999999999998},"max":{"1min":0.73299999999999998,"5min":0.88400000000000001,"15min":0.90700000000000003},"last":0.432},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54900000000000004,"15min":0.55100000000000005},"min":{"1min":0.42199999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.70299999999999996,"5min":0.83099999999999996,"15min":0.86099999999999999},"last":0.44600000000000001}]},{"osd":3,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.379,"5min":0.36399999999999999,"15min":0.34599999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.0409999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.46400000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77300000000000002,"5min":0.878,"15min":0.878},"last":0.33000000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.82699999999999996,"15min":0.82299999999999995},"min":{"1min":0.63400000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1719999999999999,"5min":1.2649999999999999,"15min":1.3740000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.82299999999999995,"15min":0.82099999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.96099999999999997,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.80300000000000005,"15min":0.80600000000000005},"min":{"1min":0.64600000000000002,"5min":0.56399999999999995,"15min":0.46100000000000002},"max":{"1min":0.96399999999999997,"5min":1.0820000000000001,"15min":1.2210000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.82699999999999996,"15min":0.84099999999999997},"min":{"1min":0.68300000000000005,"5min":0.55700000000000005,"15min":0.54400000000000004},"max":{"1min":1.077,"5min":1.1379999999999999,"15min":1.3260000000000001},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.60999999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0009999999999999,"5min":1.196,"15min":1.196},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.84899999999999998,"15min":0.85899999999999999},"min":{"1min":0.59299999999999997,"5min":0.58999999999999997,"15min":0.58699999999999997},"max":{"1min":1.2030000000000001,"5min":1.216,"15min":1.2849999999999999},"last":0.57599999999999996}]},{"osd":7,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.874,"15min":0.871},"min":{"1min":0.63200000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0860000000000001,"5min":1.22,"15min":1.2410000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.84499999999999997,"15min":0.84199999999999997},"min":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.58899999999999997},"max":{"1min":1.048,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:18:47.531 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-25T05:18:47.532 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-25T05:18:47.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.717+0000 7feb3b888640 1 Processor -- start 2023-08-25T05:18:47.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.717+0000 7feb3b888640 1 -- start start 2023-08-25T05:18:47.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.717+0000 7feb3b888640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb340c9900 0x7feb340cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:47.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.717+0000 7feb3b888640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb340c9d90 con 0x7feb340cb020 2023-08-25T05:18:47.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.717+0000 7feb3b888640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb340cbca0 con 0x7feb3406c720 2023-08-25T05:18:47.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.717+0000 7feb3b888640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb340c9470 con 0x7feb340c9900 2023-08-25T05:18:47.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.717+0000 7feb39624640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feb340cb020 0x7feb340cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34356/0 (socket says 172.21.15.55:34356) 2023-08-25T05:18:47.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.717+0000 7feb39624640 1 -- 172.21.15.55:0/519911585 learned_addr learned my addr 172.21.15.55:0/519911585 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:47.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb38e23640 1 --2- 172.21.15.55:0/519911585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb340c9900 0x7feb340cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:47.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb2bfff640 1 -- 172.21.15.55:0/519911585 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811156727 0 0) 0x7feb340c9d90 con 0x7feb340cb020 2023-08-25T05:18:47.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb2bfff640 1 -- 172.21.15.55:0/519911585 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb20005740 con 0x7feb340cb020 2023-08-25T05:18:47.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb2bfff640 1 -- 172.21.15.55:0/519911585 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3448928030 0 0) 0x7feb20005740 con 0x7feb340cb020 2023-08-25T05:18:47.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb2bfff640 1 -- 172.21.15.55:0/519911585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb340c9900 msgr2=0x7feb340cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:47.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb2bfff640 1 --2- 172.21.15.55:0/519911585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb340c9900 0x7feb340cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb2bfff640 1 -- 172.21.15.55:0/519911585 >> v1:172.21.15.110:6789/0 conn(0x7feb3406c720 legacy=0x7feb340cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:47.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb2bfff640 1 -- 172.21.15.55:0/519911585 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb340c8b40 con 0x7feb340cb020 2023-08-25T05:18:47.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb2bfff640 1 -- 172.21.15.55:0/519911585 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7feb30001800 con 0x7feb340cb020 2023-08-25T05:18:47.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb2bfff640 1 -- 172.21.15.55:0/519911585 >> v1:172.21.15.55:6789/0 conn(0x7feb340cb020 legacy=0x7feb340cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:47.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb2bfff640 1 --2- 172.21.15.55:0/519911585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb20005bc0 0x7feb20005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:47.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb2bfff640 1 --2- 172.21.15.55:0/519911585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb340c9900 0x7feb200069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:47.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb2bfff640 1 --2- 172.21.15.55:0/519911585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb20006f20 0x7feb200073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:47.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb2bfff640 1 -- 172.21.15.55:0/519911585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb340c9470 con 0x7feb20006f20 2023-08-25T05:18:47.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb2bfff640 1 -- 172.21.15.55:0/519911585 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2000dc80 con 0x7feb20005bc0 2023-08-25T05:18:47.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb2bfff640 1 -- 172.21.15.55:0/519911585 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2000de40 con 0x7feb340c9900 2023-08-25T05:18:47.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb39e25640 1 --2- 172.21.15.55:0/519911585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb20006f20 0x7feb200073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:47.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb39624640 1 --2- 172.21.15.55:0/519911585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb20005bc0 0x7feb20005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:47.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb38e23640 1 --2- 172.21.15.55:0/519911585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb340c9900 0x7feb200069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb39e25640 1 -- 172.21.15.55:0/519911585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb340c9900 msgr2=0x7feb200069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb39e25640 1 --2- 172.21.15.55:0/519911585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb340c9900 0x7feb200069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb39e25640 1 -- 172.21.15.55:0/519911585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb20005bc0 msgr2=0x7feb20005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb39e25640 1 --2- 172.21.15.55:0/519911585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb20005bc0 0x7feb20005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.721+0000 7feb39e25640 1 -- 172.21.15.55:0/519911585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb20005740 con 0x7feb20006f20 2023-08-25T05:18:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb39e25640 1 --2- 172.21.15.55:0/519911585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb20006f20 0x7feb200073a0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7feb2c002010 tx=0x7feb2c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb8bf7a57657536 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:47.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb2bfff640 1 -- 172.21.15.55:0/519911585 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c0aa640 con 0x7feb20006f20 2023-08-25T05:18:47.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb2bfff640 1 -- 172.21.15.55:0/519911585 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2c0aa7c0 con 0x7feb20006f20 2023-08-25T05:18:47.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb2bfff640 1 -- 172.21.15.55:0/519911585 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2c0aab70 con 0x7feb20006f20 2023-08-25T05:18:47.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb3b888640 1 -- 172.21.15.55:0/519911585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb20006f20 msgr2=0x7feb200073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:47.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb3b888640 1 --2- 172.21.15.55:0/519911585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb20006f20 0x7feb200073a0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7feb2c002010 tx=0x7feb2c01c8c0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb39e25640 1 -- 172.21.15.55:0/519911585 reap_dead start 2023-08-25T05:18:47.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb3b888640 1 -- 172.21.15.55:0/519911585 shutdown_connections 2023-08-25T05:18:47.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb3b888640 1 -- 172.21.15.55:0/519911585 >> 172.21.15.55:0/519911585 conn(0x7feb34069900 msgr2=0x7feb34069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:47.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb3b888640 1 -- 172.21.15.55:0/519911585 shutdown_connections 2023-08-25T05:18:47.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb3b888640 1 -- 172.21.15.55:0/519911585 wait complete. 2023-08-25T05:18:47.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb3b888640 1 Processor -- start 2023-08-25T05:18:47.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb3b888640 1 -- start start 2023-08-25T05:18:47.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb3b888640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb341534b0 0x7feb34158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:47.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb3b888640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb34153890 0x7feb34157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:47.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb3b888640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb34157fc0 0x7feb341f1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:47.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb3b888640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3409aff0 con 0x7feb341534b0 2023-08-25T05:18:47.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb3b888640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3409a000 con 0x7feb34157fc0 2023-08-25T05:18:47.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.725+0000 7feb3b888640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb34158440 con 0x7feb34153890 2023-08-25T05:18:47.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.729+0000 7feb39624640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb341534b0 0x7feb34158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:47.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.729+0000 7feb39624640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb341534b0 0x7feb34158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45880/0 (socket says 172.21.15.55:45880) 2023-08-25T05:18:47.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.729+0000 7feb39624640 1 -- 172.21.15.55:0/2498003384 learned_addr learned my addr 172.21.15.55:0/2498003384 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:47.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.729+0000 7feb38e23640 1 --2- 172.21.15.55:0/2498003384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb34153890 0x7feb34157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:47.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.729+0000 7feb39e25640 1 --2- 172.21.15.55:0/2498003384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb34157fc0 0x7feb341f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:47.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.729+0000 7feb39624640 1 -- 172.21.15.55:0/2498003384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb34153890 msgr2=0x7feb34157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:47.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.729+0000 7feb39624640 1 --2- 172.21.15.55:0/2498003384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb34153890 0x7feb34157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.729+0000 7feb39624640 1 -- 172.21.15.55:0/2498003384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb34157fc0 msgr2=0x7feb341f1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:47.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.729+0000 7feb39624640 1 --2- 172.21.15.55:0/2498003384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb34157fc0 0x7feb341f1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.729+0000 7feb39624640 1 -- 172.21.15.55:0/2498003384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb34099410 con 0x7feb341534b0 2023-08-25T05:18:47.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.729+0000 7feb39624640 1 --2- 172.21.15.55:0/2498003384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb341534b0 0x7feb34158980 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7feb3000f8b0 tx=0x7feb3000fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:47.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.729+0000 7feb29ffb640 1 -- 172.21.15.55:0/2498003384 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30001110 con 0x7feb341534b0 2023-08-25T05:18:47.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.729+0000 7feb29ffb640 1 -- 172.21.15.55:0/2498003384 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb300072e0 con 0x7feb341534b0 2023-08-25T05:18:47.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.729+0000 7feb3b888640 1 -- 172.21.15.55:0/2498003384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb34099660 con 0x7feb341534b0 2023-08-25T05:18:47.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.729+0000 7feb29ffb640 1 -- 172.21.15.55:0/2498003384 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb300057b0 con 0x7feb341534b0 2023-08-25T05:18:47.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.729+0000 7feb3b888640 1 -- 172.21.15.55:0/2498003384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb34099c20 con 0x7feb341534b0 2023-08-25T05:18:47.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.729+0000 7feb3b888640 1 -- 172.21.15.55:0/2498003384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb34099de0 con 0x7feb341534b0 2023-08-25T05:18:47.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.729+0000 7feb29ffb640 1 -- 172.21.15.55:0/2498003384 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7feb30005910 con 0x7feb341534b0 2023-08-25T05:18:47.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.733+0000 7feb29ffb640 1 --2- 172.21.15.55:0/2498003384 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7feb180657a0 0x7feb18067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:47.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.733+0000 7feb29ffb640 1 -- 172.21.15.55:0/2498003384 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feb30083090 con 0x7feb341534b0 2023-08-25T05:18:47.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.733+0000 7feb38e23640 1 --2- 172.21.15.55:0/2498003384 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7feb180657a0 0x7feb18067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:47.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.733+0000 7feb38e23640 1 --2- 172.21.15.55:0/2498003384 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7feb180657a0 0x7feb18067c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feb341544b0 tx=0x7feb24008040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:47.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.737+0000 7feb29ffb640 1 -- 172.21.15.55:0/2498003384 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7feb30050a40 con 0x7feb341534b0 2023-08-25T05:18:47.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.949+0000 7feb3b888640 1 -- 172.21.15.55:0/2498003384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7feb34073ec0 con 0x7feb341534b0 2023-08-25T05:18:47.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.953+0000 7feb29ffb640 1 -- 172.21.15.55:0/2498003384 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v41) v1 ==== 190+0+147 (secure 0 0 0) 0x7feb30054060 con 0x7feb341534b0 2023-08-25T05:18:47.958 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2023-08-25T05:18:47.962 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g== 2023-08-25T05:18:47.963 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2023-08-25T05:18:47.963 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2023-08-25T05:18:47.963 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-25T05:18:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-08-25T05:18:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.957+0000 7feb3b888640 1 -- 172.21.15.55:0/2498003384 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7feb180657a0 msgr2=0x7feb18067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.957+0000 7feb3b888640 1 --2- 172.21.15.55:0/2498003384 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7feb180657a0 0x7feb18067c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feb341544b0 tx=0x7feb24008040 comp rx=0 tx=0).stop 2023-08-25T05:18:47.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.957+0000 7feb3b888640 1 -- 172.21.15.55:0/2498003384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb341534b0 msgr2=0x7feb34158980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:47.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.957+0000 7feb3b888640 1 --2- 172.21.15.55:0/2498003384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb341534b0 0x7feb34158980 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7feb3000f8b0 tx=0x7feb3000fd70 comp rx=0 tx=0).stop 2023-08-25T05:18:47.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.957+0000 7feb3b888640 1 -- 172.21.15.55:0/2498003384 shutdown_connections 2023-08-25T05:18:47.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.957+0000 7feb3b888640 1 --2- 172.21.15.55:0/2498003384 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7feb180657a0 0x7feb18067c60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.957+0000 7feb3b888640 1 --2- 172.21.15.55:0/2498003384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb34157fc0 0x7feb341f1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.957+0000 7feb3b888640 1 --2- 172.21.15.55:0/2498003384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb34153890 0x7feb34157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.957+0000 7feb3b888640 1 --2- 172.21.15.55:0/2498003384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb341534b0 0x7feb34158980 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:47.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.957+0000 7feb3b888640 1 -- 172.21.15.55:0/2498003384 >> 172.21.15.55:0/2498003384 conn(0x7feb34069900 msgr2=0x7feb340c1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:47.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.957+0000 7feb3b888640 1 -- 172.21.15.55:0/2498003384 shutdown_connections 2023-08-25T05:18:47.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:47.957+0000 7feb3b888640 1 -- 172.21.15.55:0/2498003384 wait complete. 2023-08-25T05:18:47.979 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:18:48.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.121+0000 7f9f81a04640 1 Processor -- start 2023-08-25T05:18:48.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.121+0000 7f9f81a04640 1 -- start start 2023-08-25T05:18:48.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.121+0000 7f9f81a04640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9f7c15c690 0x7f9f7c0d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.121+0000 7f9f81a04640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9f7c0d01a0 0x7f9f7c0cf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.121+0000 7f9f81a04640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f7c0cf970 0x7f9f7c0d2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.121+0000 7f9f81a04640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7c0cfdc0 con 0x7f9f7c15c690 2023-08-25T05:18:48.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.121+0000 7f9f81a04640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f7c0d0710 con 0x7f9f7c0d01a0 2023-08-25T05:18:48.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.121+0000 7f9f81a04640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c0d09f0 con 0x7f9f7c0cf970 2023-08-25T05:18:48.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.121+0000 7f9f7affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9f7c15c690 0x7f9f7c0d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.121+0000 7f9f7affd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9f7c15c690 0x7f9f7c0d1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45896/0 (socket says 172.21.15.55:45896) 2023-08-25T05:18:48.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.121+0000 7f9f7affd640 1 -- 172.21.15.55:0/3456642133 learned_addr learned my addr 172.21.15.55:0/3456642133 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:48.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.121+0000 7f9f7b7fe640 1 --2- 172.21.15.55:0/3456642133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f7c0cf970 0x7f9f7c0d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.121+0000 7f9f727fc640 1 --2- 172.21.15.55:0/3456642133 >> v2:172.21.15.110:3300/0 conn(0x7f9f7c0d01a0 0x7f9f7c0cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.121+0000 7f9f7affd640 1 -- 172.21.15.55:0/3456642133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f7c0cf970 msgr2=0x7f9f7c0d2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:48.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.121+0000 7f9f7affd640 1 --2- 172.21.15.55:0/3456642133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f7c0cf970 0x7f9f7c0d2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.121+0000 7f9f7affd640 1 -- 172.21.15.55:0/3456642133 >> v2:172.21.15.110:3300/0 conn(0x7f9f7c0d01a0 msgr2=0x7f9f7c0cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:48.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.121+0000 7f9f7affd640 1 --2- 172.21.15.55:0/3456642133 >> v2:172.21.15.110:3300/0 conn(0x7f9f7c0d01a0 0x7f9f7c0cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.121+0000 7f9f7affd640 1 -- 172.21.15.55:0/3456642133 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c0d0cd0 con 0x7f9f7c15c690 2023-08-25T05:18:48.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.125+0000 7f9f7affd640 1 --2- 172.21.15.55:0/3456642133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f7c15c690 0x7f9f7c0d1ca0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0b7f40 tx=0x7f9f6c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d9f179ef95057b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:48.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.125+0000 7f9f7a7fc640 1 -- 172.21.15.55:0/3456642133 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c0a89b0 con 0x7f9f7c15c690 2023-08-25T05:18:48.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.125+0000 7f9f7a7fc640 1 -- 172.21.15.55:0/3456642133 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6c0a8b10 con 0x7f9f7c15c690 2023-08-25T05:18:48.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.125+0000 7f9f7a7fc640 1 -- 172.21.15.55:0/3456642133 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c0a8ea0 con 0x7f9f7c15c690 2023-08-25T05:18:48.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.125+0000 7f9f81a04640 1 -- 172.21.15.55:0/3456642133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f7c15c690 msgr2=0x7f9f7c0d1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:48.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.125+0000 7f9f81a04640 1 --2- 172.21.15.55:0/3456642133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f7c15c690 0x7f9f7c0d1ca0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0b7f40 tx=0x7f9f6c01ecf0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.125+0000 7f9f81a04640 1 -- 172.21.15.55:0/3456642133 shutdown_connections 2023-08-25T05:18:48.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.125+0000 7f9f81a04640 1 --2- 172.21.15.55:0/3456642133 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f7c0cf970 0x7f9f7c0d2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.125+0000 7f9f81a04640 1 --2- 172.21.15.55:0/3456642133 >> v2:172.21.15.110:3300/0 conn(0x7f9f7c0d01a0 0x7f9f7c0cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.125+0000 7f9f81a04640 1 --2- 172.21.15.55:0/3456642133 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f7c15c690 0x7f9f7c0d1ca0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.125+0000 7f9f81a04640 1 -- 172.21.15.55:0/3456642133 >> 172.21.15.55:0/3456642133 conn(0x7f9f7c0656c0 msgr2=0x7f9f7c065ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:48.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.125+0000 7f9f81a04640 1 -- 172.21.15.55:0/3456642133 shutdown_connections 2023-08-25T05:18:48.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.125+0000 7f9f81a04640 1 -- 172.21.15.55:0/3456642133 wait complete. 2023-08-25T05:18:48.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f81a04640 1 Processor -- start 2023-08-25T05:18:48.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f81a04640 1 -- start start 2023-08-25T05:18:48.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f81a04640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f7c0cf970 0x7f9f7c0b81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f81a04640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f7c0d01a0 0x7f9f7c154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f81a04640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f7c15c690 0x7f9f7c153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f81a04640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c1547d0 con 0x7f9f7c15c690 2023-08-25T05:18:48.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f81a04640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c153b50 con 0x7f9f7c0d01a0 2023-08-25T05:18:48.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f81a04640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c153e30 con 0x7f9f7c0cf970 2023-08-25T05:18:48.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f7b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f7c15c690 0x7f9f7c153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f7b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f7c15c690 0x7f9f7c153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45910/0 (socket says 172.21.15.55:45910) 2023-08-25T05:18:48.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f7b7fe640 1 -- 172.21.15.55:0/3379171444 learned_addr learned my addr 172.21.15.55:0/3379171444 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:48.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f727fc640 1 --2- 172.21.15.55:0/3379171444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f7c0d01a0 0x7f9f7c154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f7affd640 1 --2- 172.21.15.55:0/3379171444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f7c0cf970 0x7f9f7c0b81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f7b7fe640 1 -- 172.21.15.55:0/3379171444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f7c0cf970 msgr2=0x7f9f7c0b81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:48.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f7b7fe640 1 --2- 172.21.15.55:0/3379171444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f7c0cf970 0x7f9f7c0b81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f7b7fe640 1 -- 172.21.15.55:0/3379171444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f7c0d01a0 msgr2=0x7f9f7c154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:48.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f7b7fe640 1 --2- 172.21.15.55:0/3379171444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f7c0d01a0 0x7f9f7c154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f7b7fe640 1 -- 172.21.15.55:0/3379171444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c0094d0 con 0x7f9f7c15c690 2023-08-25T05:18:48.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f7affd640 1 --2- 172.21.15.55:0/3379171444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f7c0cf970 0x7f9f7c0b81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:48.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f7b7fe640 1 --2- 172.21.15.55:0/3379171444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f7c15c690 0x7f9f7c153300 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400efc0 tx=0x7f9f7400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:48.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f78ff9640 1 -- 172.21.15.55:0/3379171444 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74014480 con 0x7f9f7c15c690 2023-08-25T05:18:48.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f78ff9640 1 -- 172.21.15.55:0/3379171444 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7400f040 con 0x7f9f7c15c690 2023-08-25T05:18:48.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f78ff9640 1 -- 172.21.15.55:0/3379171444 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74014820 con 0x7f9f7c15c690 2023-08-25T05:18:48.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.129+0000 7f9f81a04640 1 -- 172.21.15.55:0/3379171444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7c154110 con 0x7f9f7c15c690 2023-08-25T05:18:48.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.133+0000 7f9f81a04640 1 -- 172.21.15.55:0/3379171444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7c153840 con 0x7f9f7c15c690 2023-08-25T05:18:48.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.133+0000 7f9f81a04640 1 -- 172.21.15.55:0/3379171444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f7c154910 con 0x7f9f7c15c690 2023-08-25T05:18:48.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.133+0000 7f9f78ff9640 1 -- 172.21.15.55:0/3379171444 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f9f74014980 con 0x7f9f7c15c690 2023-08-25T05:18:48.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.133+0000 7f9f78ff9640 1 --2- 172.21.15.55:0/3379171444 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f9f5c0657a0 0x7f9f5c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.133+0000 7f9f78ff9640 1 -- 172.21.15.55:0/3379171444 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9f74083f60 con 0x7f9f7c15c690 2023-08-25T05:18:48.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.133+0000 7f9f7affd640 1 --2- 172.21.15.55:0/3379171444 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f9f5c0657a0 0x7f9f5c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.137+0000 7f9f7affd640 1 --2- 172.21.15.55:0/3379171444 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f9f5c0657a0 0x7f9f5c067c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c0b2000 tx=0x7f9f6c008040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:48.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.137+0000 7f9f78ff9640 1 -- 172.21.15.55:0/3379171444 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9f7c154910 con 0x7f9f7c15c690 2023-08-25T05:18:48.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.329+0000 7f9f81a04640 1 -- 172.21.15.55:0/3379171444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f7c154910 con 0x7f9f7c15c690 2023-08-25T05:18:48.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.329+0000 7f9f78ff9640 1 -- 172.21.15.55:0/3379171444 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4877 (secure 0 0 0) 0x7f9f7c154910 con 0x7f9f7c15c690 2023-08-25T05:18:48.333 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:48.333 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8911,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/381737607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":381737607},{"type":"v1","addr":"172.21.15.55:6834","nonce":381737607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":8917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/775518941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":775518941},{"type":"v1","addr":"172.21.15.110:6836","nonce":775518941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":8920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1426163963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1426163963},{"type":"v1","addr":"172.21.15.110:6837","nonce":1426163963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:18:42.381096+0000","modified":"2023-08-25T05:18:46.026870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9618},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9618":{"gid":9618,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3591663387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3591663387},{"type":"v1","addr":"172.21.15.55:6835","nonce":3591663387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-25T05:18:48.334 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 74 2023-08-25T05:18:48.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.329+0000 7f9f81a04640 1 -- 172.21.15.55:0/3379171444 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f9f5c0657a0 msgr2=0x7f9f5c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:48.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.333+0000 7f9f81a04640 1 --2- 172.21.15.55:0/3379171444 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f9f5c0657a0 0x7f9f5c067c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c0b2000 tx=0x7f9f6c008040 comp rx=0 tx=0).stop 2023-08-25T05:18:48.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.333+0000 7f9f81a04640 1 -- 172.21.15.55:0/3379171444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f7c15c690 msgr2=0x7f9f7c153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:48.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.333+0000 7f9f81a04640 1 --2- 172.21.15.55:0/3379171444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f7c15c690 0x7f9f7c153300 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f9f7400efc0 tx=0x7f9f7400c490 comp rx=0 tx=0).stop 2023-08-25T05:18:48.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.333+0000 7f9f81a04640 1 -- 172.21.15.55:0/3379171444 shutdown_connections 2023-08-25T05:18:48.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.333+0000 7f9f81a04640 1 --2- 172.21.15.55:0/3379171444 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f9f5c0657a0 0x7f9f5c067c60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.333+0000 7f9f81a04640 1 --2- 172.21.15.55:0/3379171444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f7c15c690 0x7f9f7c153300 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.333+0000 7f9f81a04640 1 --2- 172.21.15.55:0/3379171444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f7c0d01a0 0x7f9f7c154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.333+0000 7f9f81a04640 1 --2- 172.21.15.55:0/3379171444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f7c0cf970 0x7f9f7c0b81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.333+0000 7f9f81a04640 1 -- 172.21.15.55:0/3379171444 >> 172.21.15.55:0/3379171444 conn(0x7f9f7c0656c0 msgr2=0x7f9f7c0b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:48.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.333+0000 7f9f81a04640 1 -- 172.21.15.55:0/3379171444 shutdown_connections 2023-08-25T05:18:48.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.333+0000 7f9f81a04640 1 -- 172.21.15.55:0/3379171444 wait complete. 2023-08-25T05:18:48.763 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-25T05:18:42.381096+0000', 'modified': '2023-08-25T05:18:46.026870+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9618}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9618': {'gid': 9618, 'name': 'c', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6835/3591663387', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6833', 'nonce': 3591663387}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 3591663387}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-25T05:18:48.764 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-25T05:18:48.764 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-25T05:18:48.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.909+0000 7f9ef9a9e640 1 Processor -- start 2023-08-25T05:18:48.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.909+0000 7f9ef9a9e640 1 -- start start 2023-08-25T05:18:48.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.909+0000 7f9ef9a9e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9ef40ceeb0 0x7f9ef40cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.909+0000 7f9ef9a9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ef40c89f0 0x7f9ef40b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.909+0000 7f9ef9a9e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef40cc880 con 0x7f9ef40ad950 2023-08-25T05:18:48.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.909+0000 7f9ef9a9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef40b11f0 con 0x7f9ef40c89f0 2023-08-25T05:18:48.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.909+0000 7f9ef9a9e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef4159d50 con 0x7f9ef40ceeb0 2023-08-25T05:18:48.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.909+0000 7f9ef3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ef40c89f0 0x7f9ef40b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.909+0000 7f9ef3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ef40c89f0 0x7f9ef40b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45912/0 (socket says 172.21.15.55:45912) 2023-08-25T05:18:48.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.909+0000 7f9ef3fff640 1 -- 172.21.15.55:0/3497022796 learned_addr learned my addr 172.21.15.55:0/3497022796 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:48.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.909+0000 7f9eebfff640 1 --2- 172.21.15.55:0/3497022796 >> v2:172.21.15.110:3300/0 conn(0x7f9ef40ceeb0 0x7f9ef40cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.909+0000 7f9ef3fff640 1 -- 172.21.15.55:0/3497022796 >> v2:172.21.15.110:3300/0 conn(0x7f9ef40ceeb0 msgr2=0x7f9ef40cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:48.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.909+0000 7f9ef3fff640 1 --2- 172.21.15.55:0/3497022796 >> v2:172.21.15.110:3300/0 conn(0x7f9ef40ceeb0 0x7f9ef40cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.909+0000 7f9ef3fff640 1 -- 172.21.15.55:0/3497022796 >> v1:172.21.15.110:6789/0 conn(0x7f9ef40ad950 legacy=0x7f9ef40ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:48.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.909+0000 7f9ef3fff640 1 -- 172.21.15.55:0/3497022796 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef40ccb60 con 0x7f9ef40c89f0 2023-08-25T05:18:48.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.913+0000 7f9ef3fff640 1 --2- 172.21.15.55:0/3497022796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef40c89f0 0x7f9ef40b1640 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f9ef406df00 tx=0x7f9eec01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be47060858a0e853 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:48.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.913+0000 7f9ef2ffd640 1 -- 172.21.15.55:0/3497022796 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec0a56e0 con 0x7f9ef40c89f0 2023-08-25T05:18:48.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.913+0000 7f9ef2ffd640 1 -- 172.21.15.55:0/3497022796 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eec0a5840 con 0x7f9ef40c89f0 2023-08-25T05:18:48.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.913+0000 7f9ef2ffd640 1 -- 172.21.15.55:0/3497022796 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec0a5bd0 con 0x7f9ef40c89f0 2023-08-25T05:18:48.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.913+0000 7f9ef9a9e640 1 -- 172.21.15.55:0/3497022796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef40c89f0 msgr2=0x7f9ef40b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:48.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.913+0000 7f9ef9a9e640 1 --2- 172.21.15.55:0/3497022796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef40c89f0 0x7f9ef40b1640 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f9ef406df00 tx=0x7f9eec01c910 comp rx=0 tx=0).stop 2023-08-25T05:18:48.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.913+0000 7f9ef9a9e640 1 -- 172.21.15.55:0/3497022796 shutdown_connections 2023-08-25T05:18:48.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.913+0000 7f9ef9a9e640 1 --2- 172.21.15.55:0/3497022796 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef40c89f0 0x7f9ef40b1640 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.913+0000 7f9ef9a9e640 1 --2- 172.21.15.55:0/3497022796 >> v2:172.21.15.110:3300/0 conn(0x7f9ef40ceeb0 0x7f9ef40cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.913+0000 7f9ef9a9e640 1 -- 172.21.15.55:0/3497022796 >> 172.21.15.55:0/3497022796 conn(0x7f9ef4069d00 msgr2=0x7f9ef406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:48.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.913+0000 7f9ef9a9e640 1 -- 172.21.15.55:0/3497022796 shutdown_connections 2023-08-25T05:18:48.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.913+0000 7f9ef9a9e640 1 -- 172.21.15.55:0/3497022796 wait complete. 2023-08-25T05:18:48.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef9a9e640 1 Processor -- start 2023-08-25T05:18:48.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef9a9e640 1 -- start start 2023-08-25T05:18:48.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef9a9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef40ad950 0x7f9ef40971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef9a9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ef40c89f0 0x7f9ef40c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef9a9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ef40ceeb0 0x7f9ef4154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef9a9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef40c8340 con 0x7f9ef40ad950 2023-08-25T05:18:48.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef9a9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef40c6250 con 0x7f9ef40ceeb0 2023-08-25T05:18:48.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef9a9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef40c6530 con 0x7f9ef40c89f0 2023-08-25T05:18:48.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef40ad950 0x7f9ef40971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef40ad950 0x7f9ef40971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45928/0 (socket says 172.21.15.55:45928) 2023-08-25T05:18:48.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef37fe640 1 -- 172.21.15.55:0/3141616430 learned_addr learned my addr 172.21.15.55:0/3141616430 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:48.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9eebfff640 1 --2- 172.21.15.55:0/3141616430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ef40c89f0 0x7f9ef40c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef3fff640 1 --2- 172.21.15.55:0/3141616430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ef40ceeb0 0x7f9ef4154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef37fe640 1 -- 172.21.15.55:0/3141616430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ef40c89f0 msgr2=0x7f9ef40c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:48.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef37fe640 1 --2- 172.21.15.55:0/3141616430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ef40c89f0 0x7f9ef40c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef37fe640 1 -- 172.21.15.55:0/3141616430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ef40ceeb0 msgr2=0x7f9ef4154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:48.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef37fe640 1 --2- 172.21.15.55:0/3141616430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ef40ceeb0 0x7f9ef4154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef37fe640 1 -- 172.21.15.55:0/3141616430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec009b30 con 0x7f9ef40ad950 2023-08-25T05:18:48.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef37fe640 1 --2- 172.21.15.55:0/3141616430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef40ad950 0x7f9ef40971f0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400c3c0 tx=0x7f9ee400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:48.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef0ff9640 1 -- 172.21.15.55:0/3141616430 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee40052d0 con 0x7f9ef40ad950 2023-08-25T05:18:48.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef0ff9640 1 -- 172.21.15.55:0/3141616430 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee4005430 con 0x7f9ef40ad950 2023-08-25T05:18:48.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef0ff9640 1 -- 172.21.15.55:0/3141616430 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4003840 con 0x7f9ef40ad950 2023-08-25T05:18:48.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef9a9e640 1 -- 172.21.15.55:0/3141616430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef4151f50 con 0x7f9ef40ad950 2023-08-25T05:18:48.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.917+0000 7f9ef9a9e640 1 -- 172.21.15.55:0/3141616430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef4159ed0 con 0x7f9ef40ad950 2023-08-25T05:18:48.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.921+0000 7f9ef0ff9640 1 -- 172.21.15.55:0/3141616430 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f9ee40039a0 con 0x7f9ef40ad950 2023-08-25T05:18:48.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.921+0000 7f9ef0ff9640 1 --2- 172.21.15.55:0/3141616430 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f9ed40657a0 0x7f9ed4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.921+0000 7f9ef0ff9640 1 -- 172.21.15.55:0/3141616430 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ee4082490 con 0x7f9ef40ad950 2023-08-25T05:18:48.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.921+0000 7f9eebfff640 1 --2- 172.21.15.55:0/3141616430 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f9ed40657a0 0x7f9ed4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.921+0000 7f9efce14000 1 Processor -- start 2023-08-25T05:18:48.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.921+0000 7f9efce14000 1 -- start start 2023-08-25T05:18:48.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.921+0000 7f9eebfff640 1 --2- 172.21.15.55:0/3141616430 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f9ed40657a0 0x7f9ed4067c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40af6c0 tx=0x7f9edc009190 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:48.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.921+0000 7f9efce14000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac55270 0x55f17ac55650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.921+0000 7f9efce14000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac55b90 0x55f17ac0b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.921+0000 7f9efce14000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac0b9c0 0x55f17ac0bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.921+0000 7f9efce14000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f17aa5d440 con 0x55f17ac55b90 2023-08-25T05:18:48.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.921+0000 7f9efce14000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f17aa5a970 con 0x55f17ac0b9c0 2023-08-25T05:18:48.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.921+0000 7f9efce14000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f17aa56260 con 0x55f17ac55270 2023-08-25T05:18:48.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9eebfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac55b90 0x55f17ac0b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9eebfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac55b90 0x55f17ac0b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45938/0 (socket says 172.21.15.55:45938) 2023-08-25T05:18:48.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9eebfff640 1 -- 172.21.15.55:0/3532789505 learned_addr learned my addr 172.21.15.55:0/3532789505 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:48.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9ef3fff640 1 --2- 172.21.15.55:0/3532789505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac0b9c0 0x55f17ac0bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9ef37fe640 1 --2- 172.21.15.55:0/3532789505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac55270 0x55f17ac55650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9eebfff640 1 -- 172.21.15.55:0/3532789505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac55270 msgr2=0x55f17ac55650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:48.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9eebfff640 1 --2- 172.21.15.55:0/3532789505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac55270 0x55f17ac55650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9eebfff640 1 -- 172.21.15.55:0/3532789505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac0b9c0 msgr2=0x55f17ac0bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:48.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9eebfff640 1 --2- 172.21.15.55:0/3532789505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac0b9c0 0x55f17ac0bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9eebfff640 1 -- 172.21.15.55:0/3532789505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f17aaeeec0 con 0x55f17ac55b90 2023-08-25T05:18:48.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9eebfff640 1 --2- 172.21.15.55:0/3532789505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac55b90 0x55f17ac0b480 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f9edc006aa0 tx=0x7f9edc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a3be91add9df54 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:48.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9ee97fa640 1 -- 172.21.15.55:0/3532789505 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc01c040 con 0x55f17ac55b90 2023-08-25T05:18:48.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9ee97fa640 1 -- 172.21.15.55:0/3532789505 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc0038f0 con 0x55f17ac55b90 2023-08-25T05:18:48.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9ee97fa640 1 -- 172.21.15.55:0/3532789505 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc003c60 con 0x55f17ac55b90 2023-08-25T05:18:48.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9efce14000 1 -- 172.21.15.55:0/3532789505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac55b90 msgr2=0x55f17ac0b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:48.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9efce14000 1 --2- 172.21.15.55:0/3532789505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac55b90 0x55f17ac0b480 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f9edc006aa0 tx=0x7f9edc014000 comp rx=0 tx=0).stop 2023-08-25T05:18:48.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9efce14000 1 -- 172.21.15.55:0/3532789505 shutdown_connections 2023-08-25T05:18:48.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9efce14000 1 --2- 172.21.15.55:0/3532789505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac0b9c0 0x55f17ac0bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9efce14000 1 --2- 172.21.15.55:0/3532789505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac55b90 0x55f17ac0b480 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9efce14000 1 --2- 172.21.15.55:0/3532789505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac55270 0x55f17ac55650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9efce14000 1 -- 172.21.15.55:0/3532789505 >> 172.21.15.55:0/3532789505 conn(0x55f17ac03560 msgr2=0x55f17ac05950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:48.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9efce14000 1 -- 172.21.15.55:0/3532789505 shutdown_connections 2023-08-25T05:18:48.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9efce14000 1 -- 172.21.15.55:0/3532789505 wait complete. 2023-08-25T05:18:48.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9efce14000 1 -- start start 2023-08-25T05:18:48.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9efce14000 1 Processor -- start 2023-08-25T05:18:48.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9efce14000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac0b9c0 0x55f17ac43650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9efce14000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac55270 0x55f17ac43b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9efce14000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac55b90 0x55f17ac440d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9efce14000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f17aa10f60 con 0x55f17ac0b9c0 2023-08-25T05:18:48.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9efce14000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f17aa10c00 con 0x55f17ac55270 2023-08-25T05:18:48.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.925+0000 7f9efce14000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f17a711940 con 0x55f17ac55b90 2023-08-25T05:18:48.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 10 client.0 _ll_register_callbacks cb 0x55f17abf2900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T05:18:48.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ef37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac0b9c0 0x55f17ac43650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ef37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac0b9c0 0x55f17ac43650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45952/0 (socket says 172.21.15.55:45952) 2023-08-25T05:18:48.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ef37fe640 1 -- 172.21.15.55:0/1849194747 learned_addr learned my addr 172.21.15.55:0/1849194747 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:48.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9eebfff640 1 --2- 172.21.15.55:0/1849194747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac55270 0x55f17ac43b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ef3fff640 1 --2- 172.21.15.55:0/1849194747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac55b90 0x55f17ac440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ef37fe640 1 -- 172.21.15.55:0/1849194747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac55b90 msgr2=0x55f17ac440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:48.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ef37fe640 1 --2- 172.21.15.55:0/1849194747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac55b90 0x55f17ac440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ef37fe640 1 -- 172.21.15.55:0/1849194747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac55270 msgr2=0x55f17ac43b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:48.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ef37fe640 1 --2- 172.21.15.55:0/1849194747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac55270 0x55f17ac43b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ef37fe640 1 -- 172.21.15.55:0/1849194747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc011b90 con 0x55f17ac0b9c0 2023-08-25T05:18:48.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9eebfff640 1 --2- 172.21.15.55:0/1849194747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac55270 0x55f17ac43b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:48.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ef37fe640 1 --2- 172.21.15.55:0/1849194747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac0b9c0 0x55f17ac43650 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4053810 tx=0x7f9ee405b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950655be51b7a8f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:48.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ed27fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T05:18:48.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ed27fc640 1 -- 172.21.15.55:0/1849194747 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee40822d0 con 0x55f17ac0b9c0 2023-08-25T05:18:48.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 1 -- 172.21.15.55:0/1849194747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f17a9ed9d0 con 0x55f17ac0b9c0 2023-08-25T05:18:48.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ed27fc640 1 -- 172.21.15.55:0/1849194747 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(157..157 src has 1..157) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ee404f900 con 0x55f17ac0b9c0 2023-08-25T05:18:48.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ed27fc640 1 -- 172.21.15.55:0/1849194747 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ee404fac0 con 0x55f17ac0b9c0 2023-08-25T05:18:48.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 10 client.9762 fetch_fsmap learned FSMap version 74 2023-08-25T05:18:48.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 1 -- 172.21.15.55:0/1849194747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x55f17a750890 con 0x55f17ac0b9c0 2023-08-25T05:18:48.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ed27fc640 1 -- 172.21.15.55:0/1849194747 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f17a9ed9d0 con 0x55f17ac0b9c0 2023-08-25T05:18:48.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ed27fc640 1 -- 172.21.15.55:0/1849194747 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 74) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9ee4080170 con 0x55f17ac0b9c0 2023-08-25T05:18:48.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 10 client.9762 fetch_fsmap finished waiting for FSMap version 74 2023-08-25T05:18:48.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 10 client.9762 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T05:18:48.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 20 client.9762 populate_metadata read hostname 'smithi055' 2023-08-25T05:18:48.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 1 --2- 172.21.15.55:0/1849194747 >> [v2:172.21.15.55:6833/3591663387,v1:172.21.15.55:6835/3591663387] conn(0x55f17ac44ae0 0x55f17ac67320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 4 client.9762 mds_command: new command op to 9618 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-25T05:18:48.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 1 -- 172.21.15.55:0/1849194747 --> [v2:172.21.15.55:6833/3591663387,v1:172.21.15.55:6835/3591663387] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f17aa0d7a0 con 0x55f17ac44ae0 2023-08-25T05:18:48.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9eebfff640 1 --2- 172.21.15.55:0/1849194747 >> [v2:172.21.15.55:6833/3591663387,v1:172.21.15.55:6835/3591663387] conn(0x55f17ac44ae0 0x55f17ac67320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ed27fc640 10 client.9762 ms_handle_connect on v2:172.21.15.55:6833/3591663387 2023-08-25T05:18:48.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9eebfff640 1 --2- 172.21.15.55:0/1849194747 >> [v2:172.21.15.55:6833/3591663387,v1:172.21.15.55:6835/3591663387] conn(0x55f17ac44ae0 0x55f17ac67320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=594a2ff2c5fc976e server_cookie=4f005c99857ea881 in_seq=0 out_seq=0 2023-08-25T05:18:48.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ed27fc640 1 -- 172.21.15.55:0/1849194747 <== mds.0 v2:172.21.15.55:6833/3591663387 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f17aa0d7a0 con 0x55f17ac44ae0 2023-08-25T05:18:48.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ed27fc640 10 client.9762 handle_command_reply: tid=0 2023-08-25T05:18:48.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 1 client.9762 shutdown 2023-08-25T05:18:48.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 1 -- 172.21.15.55:0/1849194747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac0b9c0 msgr2=0x55f17ac43650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:48.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 1 --2- 172.21.15.55:0/1849194747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac0b9c0 0x55f17ac43650 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4053810 tx=0x7f9ee405b830 comp rx=0 tx=0).stop 2023-08-25T05:18:48.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 1 -- 172.21.15.55:0/1849194747 shutdown_connections 2023-08-25T05:18:48.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 1 --2- 172.21.15.55:0/1849194747 >> [v2:172.21.15.55:6833/3591663387,v1:172.21.15.55:6835/3591663387] conn(0x55f17ac44ae0 0x55f17ac67320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 1 --2- 172.21.15.55:0/1849194747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac55b90 0x55f17ac440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 1 --2- 172.21.15.55:0/1849194747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac55270 0x55f17ac43b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 1 --2- 172.21.15.55:0/1849194747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac0b9c0 0x55f17ac43650 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9ed27fc640 0 client.9762 ms_handle_reset on v2:172.21.15.55:6833/3591663387 2023-08-25T05:18:48.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 1 -- 172.21.15.55:0/1849194747 >> 172.21.15.55:0/1849194747 conn(0x55f17ac03560 msgr2=0x55f17ac0c840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:48.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 1 -- 172.21.15.55:0/1849194747 shutdown_connections 2023-08-25T05:18:48.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 1 -- 172.21.15.55:0/1849194747 wait complete. 2023-08-25T05:18:48.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.929+0000 7f9efce14000 20 client.9762 trim_cache size 0 max 16384 2023-08-25T05:18:48.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.945+0000 7f9efce14000 1 Processor -- start 2023-08-25T05:18:48.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.945+0000 7f9efce14000 1 -- start start 2023-08-25T05:18:48.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac03560 0x55f17ac41e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac0b9c0 0x55f17ac423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac55270 0x55f17ac0bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f17aa1de80 con 0x55f17ac03560 2023-08-25T05:18:48.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f17aa58dc0 con 0x55f17ac0b9c0 2023-08-25T05:18:48.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f17aa5ea10 con 0x55f17ac55270 2023-08-25T05:18:48.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9ef37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac03560 0x55f17ac41e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9ef37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac03560 0x55f17ac41e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45968/0 (socket says 172.21.15.55:45968) 2023-08-25T05:18:48.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9ef37fe640 1 -- 172.21.15.55:0/160344058 learned_addr learned my addr 172.21.15.55:0/160344058 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:48.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9ef37fe640 1 -- 172.21.15.55:0/160344058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac55270 msgr2=0x55f17ac0bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:48.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9ef37fe640 1 --2- 172.21.15.55:0/160344058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac55270 0x55f17ac0bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9ef37fe640 1 -- 172.21.15.55:0/160344058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac0b9c0 msgr2=0x55f17ac423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:48.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9ef37fe640 1 --2- 172.21.15.55:0/160344058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac0b9c0 0x55f17ac423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9ef37fe640 1 -- 172.21.15.55:0/160344058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef4153760 con 0x55f17ac03560 2023-08-25T05:18:48.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9ef37fe640 1 --2- 172.21.15.55:0/160344058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac03560 0x55f17ac41e70 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4053a30 tx=0x7f9ee4059050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d01d311d189989c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:48.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9ee9ffb640 1 -- 172.21.15.55:0/160344058 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee404fcc0 con 0x55f17ac03560 2023-08-25T05:18:48.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9ee9ffb640 1 -- 172.21.15.55:0/160344058 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee400e040 con 0x55f17ac03560 2023-08-25T05:18:48.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9ee9ffb640 1 -- 172.21.15.55:0/160344058 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4080540 con 0x55f17ac03560 2023-08-25T05:18:48.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 -- 172.21.15.55:0/160344058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac03560 msgr2=0x55f17ac41e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:48.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 --2- 172.21.15.55:0/160344058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac03560 0x55f17ac41e70 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4053a30 tx=0x7f9ee4059050 comp rx=0 tx=0).stop 2023-08-25T05:18:48.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 -- 172.21.15.55:0/160344058 shutdown_connections 2023-08-25T05:18:48.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 --2- 172.21.15.55:0/160344058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac55270 0x55f17ac0bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 --2- 172.21.15.55:0/160344058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac0b9c0 0x55f17ac423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 --2- 172.21.15.55:0/160344058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac03560 0x55f17ac41e70 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 -- 172.21.15.55:0/160344058 >> 172.21.15.55:0/160344058 conn(0x55f17ac62570 msgr2=0x55f17ac41760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:48.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 -- 172.21.15.55:0/160344058 shutdown_connections 2023-08-25T05:18:48.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 -- 172.21.15.55:0/160344058 wait complete. 2023-08-25T05:18:48.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 -- start start 2023-08-25T05:18:48.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 Processor -- start 2023-08-25T05:18:48.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac03560 0x55f17ac69210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac0b9c0 0x55f17ac706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac55270 0x55f17ac70c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f17aa27e80 con 0x55f17ac03560 2023-08-25T05:18:48.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f17a9f3d10 con 0x55f17ac55270 2023-08-25T05:18:48.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f17aa600e0 con 0x55f17ac0b9c0 2023-08-25T05:18:48.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.949+0000 7f9efce14000 10 client.0 _ll_register_callbacks cb 0x7f9edc009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T05:18:48.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac03560 0x55f17ac69210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac03560 0x55f17ac69210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45978/0 (socket says 172.21.15.55:45978) 2023-08-25T05:18:48.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef37fe640 1 -- 172.21.15.55:0/3976159990 learned_addr learned my addr 172.21.15.55:0/3976159990 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:48.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9eebfff640 1 --2- 172.21.15.55:0/3976159990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac0b9c0 0x55f17ac706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef3fff640 1 --2- 172.21.15.55:0/3976159990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac55270 0x55f17ac70c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef37fe640 1 -- 172.21.15.55:0/3976159990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac0b9c0 msgr2=0x55f17ac706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:48.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef37fe640 1 --2- 172.21.15.55:0/3976159990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac0b9c0 0x55f17ac706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef37fe640 1 -- 172.21.15.55:0/3976159990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac55270 msgr2=0x55f17ac70c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:48.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef37fe640 1 --2- 172.21.15.55:0/3976159990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac55270 0x55f17ac70c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef37fe640 1 -- 172.21.15.55:0/3976159990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f17a750890 con 0x55f17ac03560 2023-08-25T05:18:48.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef37fe640 1 --2- 172.21.15.55:0/3976159990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac03560 0x55f17ac69210 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4051e60 tx=0x7f9ee404fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f39b42c0e1f8ca server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:48.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ed27fc640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T05:18:48.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ed27fc640 1 -- 172.21.15.55:0/3976159990 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee400e040 con 0x55f17ac03560 2023-08-25T05:18:48.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ed27fc640 1 -- 172.21.15.55:0/3976159990 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(157..157 src has 1..157) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ee4057820 con 0x55f17ac03560 2023-08-25T05:18:48.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 1 -- 172.21.15.55:0/3976159990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f17aa4f240 con 0x55f17ac03560 2023-08-25T05:18:48.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ed27fc640 1 -- 172.21.15.55:0/3976159990 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ee40804f0 con 0x55f17ac03560 2023-08-25T05:18:48.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 10 client.9768 fetch_fsmap learned FSMap version 74 2023-08-25T05:18:48.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 1 -- 172.21.15.55:0/3976159990 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x55f17aa19190 con 0x55f17ac03560 2023-08-25T05:18:48.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ed27fc640 1 -- 172.21.15.55:0/3976159990 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f17aa4f240 con 0x55f17ac03560 2023-08-25T05:18:48.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ed27fc640 1 -- 172.21.15.55:0/3976159990 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 74) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9ee4080170 con 0x55f17ac03560 2023-08-25T05:18:48.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 10 client.9768 fetch_fsmap finished waiting for FSMap version 74 2023-08-25T05:18:48.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 10 client.9768 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T05:18:48.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 20 client.9768 populate_metadata read hostname 'smithi055' 2023-08-25T05:18:48.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 1 --2- 172.21.15.55:0/3976159990 >> [v2:172.21.15.55:6833/3591663387,v1:172.21.15.55:6835/3591663387] conn(0x55f17ac55b90 0x55f17acb4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:48.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 4 client.9768 mds_command: new command op to 9618 tid=0[{"prefix": "status"}] 2023-08-25T05:18:48.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 1 -- 172.21.15.55:0/3976159990 --> [v2:172.21.15.55:6833/3591663387,v1:172.21.15.55:6835/3591663387] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f17aa4ef60 con 0x55f17ac55b90 2023-08-25T05:18:48.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9eebfff640 1 --2- 172.21.15.55:0/3976159990 >> [v2:172.21.15.55:6833/3591663387,v1:172.21.15.55:6835/3591663387] conn(0x55f17ac55b90 0x55f17acb4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:48.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9eebfff640 1 --2- 172.21.15.55:0/3976159990 >> [v2:172.21.15.55:6833/3591663387,v1:172.21.15.55:6835/3591663387] conn(0x55f17ac55b90 0x55f17acb4010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e171bfaa600ff14 server_cookie=b4611c71d5a3552b in_seq=0 out_seq=0 2023-08-25T05:18:48.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ed27fc640 10 client.9768 ms_handle_connect on v2:172.21.15.55:6833/3591663387 2023-08-25T05:18:48.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ed27fc640 1 -- 172.21.15.55:0/3976159990 <== mds.0 v2:172.21.15.55:6833/3591663387 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55f17aa4ef60 con 0x55f17ac55b90 2023-08-25T05:18:48.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ed27fc640 10 client.9768 handle_command_reply: tid=0 2023-08-25T05:18:48.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 1 client.9768 shutdown 2023-08-25T05:18:48.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 1 -- 172.21.15.55:0/3976159990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac03560 msgr2=0x55f17ac69210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:48.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 1 --2- 172.21.15.55:0/3976159990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac03560 0x55f17ac69210 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4051e60 tx=0x7f9ee404fed0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 1 -- 172.21.15.55:0/3976159990 shutdown_connections 2023-08-25T05:18:48.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 1 --2- 172.21.15.55:0/3976159990 >> [v2:172.21.15.55:6833/3591663387,v1:172.21.15.55:6835/3591663387] conn(0x55f17ac55b90 0x55f17acb4010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 1 --2- 172.21.15.55:0/3976159990 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55f17ac55270 0x55f17ac70c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 1 --2- 172.21.15.55:0/3976159990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55f17ac0b9c0 0x55f17ac706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ed27fc640 0 client.9768 ms_handle_reset on v2:172.21.15.55:6833/3591663387 2023-08-25T05:18:48.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 1 --2- 172.21.15.55:0/3976159990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f17ac03560 0x55f17ac69210 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 1 -- 172.21.15.55:0/3976159990 >> 172.21.15.55:0/3976159990 conn(0x55f17ac62570 msgr2=0x55f17ac0c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:48.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 1 -- 172.21.15.55:0/3976159990 shutdown_connections 2023-08-25T05:18:48.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 1 -- 172.21.15.55:0/3976159990 wait complete. 2023-08-25T05:18:48.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9efce14000 20 client.9768 trim_cache size 0 max 16384 2023-08-25T05:18:48.968 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T05:18:48.968 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2d2a9024-b152-4d40-880c-1686d1810590", 2023-08-25T05:18:48.968 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-08-25T05:18:48.968 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 9618, 2023-08-25T05:18:48.968 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-08-25T05:18:48.968 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-08-25T05:18:48.969 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-08-25T05:18:48.969 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 5.9469282300000001, 2023-08-25T05:18:48.969 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 74, 2023-08-25T05:18:48.969 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 157, 2023-08-25T05:18:48.969 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 157, 2023-08-25T05:18:48.969 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 12.855923968999999 2023-08-25T05:18:48.969 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T05:18:48.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef9a9e640 1 -- 172.21.15.55:0/3141616430 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f9ed40657a0 msgr2=0x7f9ed4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:48.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef9a9e640 1 --2- 172.21.15.55:0/3141616430 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f9ed40657a0 0x7f9ed4067c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40af6c0 tx=0x7f9edc009190 comp rx=0 tx=0).stop 2023-08-25T05:18:48.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef9a9e640 1 -- 172.21.15.55:0/3141616430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef40ad950 msgr2=0x7f9ef40971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:48.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef9a9e640 1 --2- 172.21.15.55:0/3141616430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef40ad950 0x7f9ef40971f0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400c3c0 tx=0x7f9ee400c880 comp rx=0 tx=0).stop 2023-08-25T05:18:48.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef9a9e640 1 -- 172.21.15.55:0/3141616430 shutdown_connections 2023-08-25T05:18:48.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef9a9e640 1 --2- 172.21.15.55:0/3141616430 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f9ed40657a0 0x7f9ed4067c60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef9a9e640 1 --2- 172.21.15.55:0/3141616430 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ef40ceeb0 0x7f9ef4154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef9a9e640 1 --2- 172.21.15.55:0/3141616430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ef40c89f0 0x7f9ef40c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef9a9e640 1 --2- 172.21.15.55:0/3141616430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef40ad950 0x7f9ef40971f0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:48.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef9a9e640 1 -- 172.21.15.55:0/3141616430 >> 172.21.15.55:0/3141616430 conn(0x7f9ef4069d00 msgr2=0x7f9ef40cb600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:48.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef9a9e640 1 -- 172.21.15.55:0/3141616430 shutdown_connections 2023-08-25T05:18:48.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:48.953+0000 7f9ef9a9e640 1 -- 172.21.15.55:0/3141616430 wait complete. 2023-08-25T05:18:48.977 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T05:18:49.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.117+0000 7fc5f8a08640 1 Processor -- start 2023-08-25T05:18:49.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.117+0000 7fc5f8a08640 1 -- start start 2023-08-25T05:18:49.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.121+0000 7fc5f8a08640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc5f40cfa70 0x7fc5f4160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:49.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.121+0000 7fc5f8a08640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f406eaf0 con 0x7fc5f406b2b0 2023-08-25T05:18:49.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.121+0000 7fc5f8a08640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f406e530 con 0x7fc5f415c9c0 2023-08-25T05:18:49.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.121+0000 7fc5f8a08640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f406e810 con 0x7fc5f40cfa70 2023-08-25T05:18:49.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.121+0000 7fc5e9d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc5f40cfa70 0x7fc5f4160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:49.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.121+0000 7fc5e9d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc5f40cfa70 0x7fc5f4160c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45988/0 (socket says 172.21.15.55:45988) 2023-08-25T05:18:49.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.121+0000 7fc5f2d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc5f406b2b0 0x7fc5f406b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34362/0 (socket says 172.21.15.55:34362) 2023-08-25T05:18:49.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.121+0000 7fc5e9d9b640 1 -- 172.21.15.55:0/1870422801 learned_addr learned my addr 172.21.15.55:0/1870422801 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:49.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.121+0000 7fc5e9d9b640 1 -- 172.21.15.55:0/1870422801 >> v1:172.21.15.110:6789/0 conn(0x7fc5f415c9c0 legacy=0x7fc5f4160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:49.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.121+0000 7fc5e9d9b640 1 -- 172.21.15.55:0/1870422801 >> v1:172.21.15.55:6789/0 conn(0x7fc5f406b2b0 legacy=0x7fc5f406b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:49.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.121+0000 7fc5e9d9b640 1 -- 172.21.15.55:0/1870422801 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f406aab0 con 0x7fc5f40cfa70 2023-08-25T05:18:49.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.121+0000 7fc5f1d9b640 1 -- 172.21.15.55:0/1870422801 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431950203 0 0) 0x7fc5f406eaf0 con 0x7fc5f406b2b0 2023-08-25T05:18:49.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.125+0000 7fc5e9d9b640 1 --2- 172.21.15.55:0/1870422801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f40cfa70 0x7fc5f4160c20 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009870 tx=0x7fc5dc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b314aff55bb963 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:49.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.125+0000 7fc5f1d9b640 1 -- 172.21.15.55:0/1870422801 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc0aa430 con 0x7fc5f40cfa70 2023-08-25T05:18:49.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.125+0000 7fc5f1d9b640 1 -- 172.21.15.55:0/1870422801 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc0aa590 con 0x7fc5f40cfa70 2023-08-25T05:18:49.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.125+0000 7fc5f1d9b640 1 -- 172.21.15.55:0/1870422801 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc0aa920 con 0x7fc5f40cfa70 2023-08-25T05:18:49.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.125+0000 7fc5f8a08640 1 -- 172.21.15.55:0/1870422801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f40cfa70 msgr2=0x7fc5f4160c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:49.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.125+0000 7fc5f8a08640 1 --2- 172.21.15.55:0/1870422801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f40cfa70 0x7fc5f4160c20 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009870 tx=0x7fc5dc01c510 comp rx=0 tx=0).stop 2023-08-25T05:18:49.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.125+0000 7fc5f8a08640 1 -- 172.21.15.55:0/1870422801 shutdown_connections 2023-08-25T05:18:49.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.125+0000 7fc5f8a08640 1 --2- 172.21.15.55:0/1870422801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f40cfa70 0x7fc5f4160c20 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:49.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.125+0000 7fc5f8a08640 1 -- 172.21.15.55:0/1870422801 >> 172.21.15.55:0/1870422801 conn(0x7fc5f40d05a0 msgr2=0x7fc5f40d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:49.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.125+0000 7fc5f8a08640 1 -- 172.21.15.55:0/1870422801 shutdown_connections 2023-08-25T05:18:49.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.125+0000 7fc5f8a08640 1 -- 172.21.15.55:0/1870422801 wait complete. 2023-08-25T05:18:49.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.125+0000 7fc5f8a08640 1 Processor -- start 2023-08-25T05:18:49.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.125+0000 7fc5f8a08640 1 -- start start 2023-08-25T05:18:49.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5f8a08640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5f406b2b0 0x7fc5f41596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:49.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5f8a08640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f40cfa70 0x7fc5f4152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:49.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5f8a08640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5f415c9c0 0x7fc5f41470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:49.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5f8a08640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f4152990 con 0x7fc5f40cfa70 2023-08-25T05:18:49.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5f8a08640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f4147600 con 0x7fc5f406b2b0 2023-08-25T05:18:49.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5f8a08640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f415a920 con 0x7fc5f415c9c0 2023-08-25T05:18:49.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5e9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f40cfa70 0x7fc5f4152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:49.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5e9d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f40cfa70 0x7fc5f4152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45998/0 (socket says 172.21.15.55:45998) 2023-08-25T05:18:49.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5e9d9b640 1 -- 172.21.15.55:0/3510036897 learned_addr learned my addr 172.21.15.55:0/3510036897 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:49.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5f259c640 1 --2- 172.21.15.55:0/3510036897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5f406b2b0 0x7fc5f41596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:49.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5f2d9d640 1 --2- 172.21.15.55:0/3510036897 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5f415c9c0 0x7fc5f41470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:49.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5e9d9b640 1 -- 172.21.15.55:0/3510036897 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5f415c9c0 msgr2=0x7fc5f41470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:49.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5e9d9b640 1 --2- 172.21.15.55:0/3510036897 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5f415c9c0 0x7fc5f41470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:49.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5e9d9b640 1 -- 172.21.15.55:0/3510036897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5f406b2b0 msgr2=0x7fc5f41596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:49.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5e9d9b640 1 --2- 172.21.15.55:0/3510036897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5f406b2b0 0x7fc5f41596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:49.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5e9d9b640 1 -- 172.21.15.55:0/3510036897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc0094d0 con 0x7fc5f40cfa70 2023-08-25T05:18:49.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5e9d9b640 1 --2- 172.21.15.55:0/3510036897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f40cfa70 0x7fc5f4152450 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc019120 tx=0x7fc5dc01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:49.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5eb7fe640 1 -- 172.21.15.55:0/3510036897 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc0b38c0 con 0x7fc5f40cfa70 2023-08-25T05:18:49.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5eb7fe640 1 -- 172.21.15.55:0/3510036897 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc0b3a40 con 0x7fc5f40cfa70 2023-08-25T05:18:49.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5eb7fe640 1 -- 172.21.15.55:0/3510036897 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc0b3df0 con 0x7fc5f40cfa70 2023-08-25T05:18:49.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5f8a08640 1 -- 172.21.15.55:0/3510036897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f41536b0 con 0x7fc5f40cfa70 2023-08-25T05:18:49.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5f8a08640 1 -- 172.21.15.55:0/3510036897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f4159ff0 con 0x7fc5f40cfa70 2023-08-25T05:18:49.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5f8a08640 1 -- 172.21.15.55:0/3510036897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f40b64f0 con 0x7fc5f40cfa70 2023-08-25T05:18:49.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.129+0000 7fc5eb7fe640 1 -- 172.21.15.55:0/3510036897 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fc5dc0b2380 con 0x7fc5f40cfa70 2023-08-25T05:18:49.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.133+0000 7fc5eb7fe640 1 --2- 172.21.15.55:0/3510036897 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fc5d40657a0 0x7fc5d4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:49.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.133+0000 7fc5eb7fe640 1 -- 172.21.15.55:0/3510036897 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc5dc11d510 con 0x7fc5f40cfa70 2023-08-25T05:18:49.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.133+0000 7fc5f259c640 1 --2- 172.21.15.55:0/3510036897 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fc5d40657a0 0x7fc5d4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:49.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.133+0000 7fc5f259c640 1 --2- 172.21.15.55:0/3510036897 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fc5d40657a0 0x7fc5d4067c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4001340 tx=0x7fc5e4009040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:49.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.137+0000 7fc5eb7fe640 1 -- 172.21.15.55:0/3510036897 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc5dc0eaf80 con 0x7fc5f40cfa70 2023-08-25T05:18:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.325+0000 7fc5f8a08640 1 -- 172.21.15.55:0/3510036897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc5f404dbe0 con 0x7fc5f40cfa70 2023-08-25T05:18:49.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.329+0000 7fc5eb7fe640 1 -- 172.21.15.55:0/3510036897 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc5dc0ee5a0 con 0x7fc5f40cfa70 2023-08-25T05:18:49.331 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T05:18:49.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.329+0000 7fc5f8a08640 1 -- 172.21.15.55:0/3510036897 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fc5d40657a0 msgr2=0x7fc5d4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:49.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.329+0000 7fc5f8a08640 1 --2- 172.21.15.55:0/3510036897 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fc5d40657a0 0x7fc5d4067c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4001340 tx=0x7fc5e4009040 comp rx=0 tx=0).stop 2023-08-25T05:18:49.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.329+0000 7fc5f8a08640 1 -- 172.21.15.55:0/3510036897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f40cfa70 msgr2=0x7fc5f4152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:49.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.329+0000 7fc5f8a08640 1 --2- 172.21.15.55:0/3510036897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f40cfa70 0x7fc5f4152450 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc019120 tx=0x7fc5dc01ad50 comp rx=0 tx=0).stop 2023-08-25T05:18:49.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.329+0000 7fc5f8a08640 1 -- 172.21.15.55:0/3510036897 shutdown_connections 2023-08-25T05:18:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.329+0000 7fc5f8a08640 1 --2- 172.21.15.55:0/3510036897 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fc5d40657a0 0x7fc5d4067c60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.329+0000 7fc5f8a08640 1 --2- 172.21.15.55:0/3510036897 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5f415c9c0 0x7fc5f41470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.329+0000 7fc5f8a08640 1 --2- 172.21.15.55:0/3510036897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5f40cfa70 0x7fc5f4152450 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.329+0000 7fc5f8a08640 1 --2- 172.21.15.55:0/3510036897 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5f406b2b0 0x7fc5f41596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.329+0000 7fc5f8a08640 1 -- 172.21.15.55:0/3510036897 >> 172.21.15.55:0/3510036897 conn(0x7fc5f40d05a0 msgr2=0x7fc5f415ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.329+0000 7fc5f8a08640 1 -- 172.21.15.55:0/3510036897 shutdown_connections 2023-08-25T05:18:49.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:49.329+0000 7fc5f8a08640 1 -- 172.21.15.55:0/3510036897 wait complete. 2023-08-25T05:18:49.352 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-25T05:18:49.352 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T05:18:49.353 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-08-25T05:18:49.353 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-25T05:18:49.353 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T05:18:49.354 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-25T05:18:49.354 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-25T05:18:49.354 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T05:18:49.354 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T05:18:49.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:49.355 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-08-25T05:18:49.366 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T05:18:49.366 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T05:18:49.367 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T05:18:49.367 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:18:49.367 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-08-25T05:18:49.367 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:18:49.368 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T05:18:49.368 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-08-25T05:18:49.368 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-08-25T05:18:49.368 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T05:18:49.368 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-08-25T05:18:49.369 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-08-25T05:18:49.369 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T05:18:49.369 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-08-25T05:18:49.370 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-08-25T05:18:49.370 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-08-25T05:18:49.370 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 37859sec preferred_lft 37859sec 2023-08-25T05:18:49.370 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-08-25T05:18:49.370 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:18:49.371 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T05:18:49.371 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-08-25T05:18:49.371 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-08-25T05:18:49.371 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-25T05:18:49.372 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:98:6a:38:6a brd ff:ff:ff:ff:ff:ff 2023-08-25T05:18:49.372 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-25T05:18:49.372 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:18:49.373 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T05:18:49.373 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-08-25T05:18:49.373 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T05:18:49.373 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:18:49.374 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-08-25T05:18:49.374 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:18:49.374 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T05:18:49.375 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T05:18:49.375 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-08-25T05:18:49.375 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:18:49.375 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T05:18:49.376 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-25T05:18:49.376 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-08-25T05:18:49.376 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:18:49.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:49.377 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T05:18:49.432 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-08-25T05:18:49.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:49.434 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-08-25T05:18:49.484 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-08-25T05:18:49.484 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T05:18:49.484 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-08-25T05:18:49.485 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-25T05:18:49.485 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-08-25T05:18:49.485 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T05:18:49.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:49.486 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T05:18:49.486 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T05:18:49.487 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-25T05:18:49.487 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-25T05:18:49.487 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-25T05:18:49.487 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T05:18:49.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:49.581 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-08-25T05:18:49.590 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-25T05:18:49.591 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-25T05:18:49.591 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T05:18:49.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:49.592 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-08-25T05:18:49.656 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T05:18:49.657 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-25T05:18:49.707 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-25T05:18:49.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T05:18:49.708 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-25T05:18:49.762 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-25T05:18:49.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:49.764 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T05:18:49.857 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T05:18:49.858 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T05:18:49.871 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T05:18:49.871 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T05:18:49.871 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.110:3300,172.21.15.110:3301" 2023-08-25T05:18:49.872 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2d2a9024-b152-4d40-880c-1686d1810590.cephfs=/ 2023-08-25T05:18:49.872 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2023-08-25T05:18:49.875 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T05:18:49.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:49.875 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-25T05:18:49.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:49.898 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T05:18:49.959 INFO:teuthology.orchestra.run.smithi055.stdout:client8000 2023-08-25T05:18:49.959 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:18:49.960 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:18:50.015 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-25T05:18:50.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.197+0000 7f14fbe34640 1 Processor -- start 2023-08-25T05:18:50.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.197+0000 7f14fbe34640 1 -- start start 2023-08-25T05:18:50.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.201+0000 7f14fbe34640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f14f4164410 0x7f14f40b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:50.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.201+0000 7f14fbe34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14f40c1a80 0x7f14f406bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:50.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.201+0000 7f14fbe34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f40cc510 con 0x7f14f40cddf0 2023-08-25T05:18:50.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.201+0000 7f14fbe34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f41647f0 con 0x7f14f40c1a80 2023-08-25T05:18:50.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.201+0000 7f14fbe34640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f40cc9b0 con 0x7f14f4164410 2023-08-25T05:18:50.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.201+0000 7f14fa3d1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14f40c1a80 0x7f14f406bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:50.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.201+0000 7f14f93cf640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f14f40cddf0 0x7f14f40c1370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34370/0 (socket says 172.21.15.55:34370) 2023-08-25T05:18:50.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.201+0000 7f14fa3d1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14f40c1a80 0x7f14f406bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46006/0 (socket says 172.21.15.55:46006) 2023-08-25T05:18:50.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.201+0000 7f14f93cf640 1 -- 172.21.15.55:0/491405992 learned_addr learned my addr 172.21.15.55:0/491405992 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:50.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.201+0000 7f14f9bd0640 1 --2- 172.21.15.55:0/491405992 >> v2:172.21.15.110:3300/0 conn(0x7f14f4164410 0x7f14f40b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:50.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.201+0000 7f14fa3d1640 1 -- 172.21.15.55:0/491405992 >> v2:172.21.15.110:3300/0 conn(0x7f14f4164410 msgr2=0x7f14f40b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:50.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.201+0000 7f14fa3d1640 1 --2- 172.21.15.55:0/491405992 >> v2:172.21.15.110:3300/0 conn(0x7f14f4164410 0x7f14f40b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:50.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.201+0000 7f14fa3d1640 1 -- 172.21.15.55:0/491405992 >> v1:172.21.15.55:6789/0 conn(0x7f14f40cddf0 legacy=0x7f14f40c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:50.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.201+0000 7f14fa3d1640 1 -- 172.21.15.55:0/491405992 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f40ccc90 con 0x7f14f40c1a80 2023-08-25T05:18:50.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.201+0000 7f14f8bce640 1 -- 172.21.15.55:0/491405992 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14833524 0 0) 0x7f14f40cc510 con 0x7f14f40cddf0 2023-08-25T05:18:50.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.205+0000 7f14fa3d1640 1 --2- 172.21.15.55:0/491405992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14f40c1a80 0x7f14f406bb40 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f14f40cec10 tx=0x7f14ec01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6576be9917dd138c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:50.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.205+0000 7f14f8bce640 1 -- 172.21.15.55:0/491405992 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec0a57b0 con 0x7f14f40c1a80 2023-08-25T05:18:50.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.205+0000 7f14f8bce640 1 -- 172.21.15.55:0/491405992 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ec0a5910 con 0x7f14f40c1a80 2023-08-25T05:18:50.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.205+0000 7f14f8bce640 1 -- 172.21.15.55:0/491405992 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec0a5ca0 con 0x7f14f40c1a80 2023-08-25T05:18:50.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.205+0000 7f14fbe34640 1 -- 172.21.15.55:0/491405992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14f40c1a80 msgr2=0x7f14f406bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:50.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.205+0000 7f14fbe34640 1 --2- 172.21.15.55:0/491405992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14f40c1a80 0x7f14f406bb40 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f14f40cec10 tx=0x7f14ec01c910 comp rx=0 tx=0).stop 2023-08-25T05:18:50.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.205+0000 7f14fbe34640 1 -- 172.21.15.55:0/491405992 shutdown_connections 2023-08-25T05:18:50.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.205+0000 7f14fbe34640 1 --2- 172.21.15.55:0/491405992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14f40c1a80 0x7f14f406bb40 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:50.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.205+0000 7f14fbe34640 1 --2- 172.21.15.55:0/491405992 >> v2:172.21.15.110:3300/0 conn(0x7f14f4164410 0x7f14f40b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:50.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.205+0000 7f14fbe34640 1 -- 172.21.15.55:0/491405992 >> 172.21.15.55:0/491405992 conn(0x7f14f4069d00 msgr2=0x7f14f406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:50.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.205+0000 7f14fbe34640 1 -- 172.21.15.55:0/491405992 shutdown_connections 2023-08-25T05:18:50.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.205+0000 7f14fbe34640 1 -- 172.21.15.55:0/491405992 wait complete. 2023-08-25T05:18:50.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.205+0000 7f14fbe34640 1 Processor -- start 2023-08-25T05:18:50.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.205+0000 7f14fbe34640 1 -- start start 2023-08-25T05:18:50.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14fbe34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f40c1a80 0x7f14f4159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:50.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14fbe34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14f40cddf0 0x7f14f40c1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:50.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14fbe34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14f4164410 0x7f14f40c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:50.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14fbe34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f4161200 con 0x7f14f4164410 2023-08-25T05:18:50.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14fbe34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f41614e0 con 0x7f14f40c1a80 2023-08-25T05:18:50.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14fbe34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f41617c0 con 0x7f14f40cddf0 2023-08-25T05:18:50.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14fa3d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14f4164410 0x7f14f40c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:50.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14fa3d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14f4164410 0x7f14f40c4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46014/0 (socket says 172.21.15.55:46014) 2023-08-25T05:18:50.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14fa3d1640 1 -- 172.21.15.55:0/2342605594 learned_addr learned my addr 172.21.15.55:0/2342605594 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:50.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14f9bd0640 1 --2- 172.21.15.55:0/2342605594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f40c1a80 0x7f14f4159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:50.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14f93cf640 1 --2- 172.21.15.55:0/2342605594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14f40cddf0 0x7f14f40c1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:50.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14fa3d1640 1 -- 172.21.15.55:0/2342605594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14f40cddf0 msgr2=0x7f14f40c1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:50.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14fa3d1640 1 --2- 172.21.15.55:0/2342605594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14f40cddf0 0x7f14f40c1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:50.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14fa3d1640 1 -- 172.21.15.55:0/2342605594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f40c1a80 msgr2=0x7f14f4159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:50.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14fa3d1640 1 --2- 172.21.15.55:0/2342605594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f40c1a80 0x7f14f4159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:50.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14fa3d1640 1 -- 172.21.15.55:0/2342605594 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec009a70 con 0x7f14f4164410 2023-08-25T05:18:50.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14fa3d1640 1 --2- 172.21.15.55:0/2342605594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14f4164410 0x7f14f40c4820 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f14ec019520 tx=0x7f14ec0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:50.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14ea7fc640 1 -- 172.21.15.55:0/2342605594 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec0bd070 con 0x7f14f4164410 2023-08-25T05:18:50.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14ea7fc640 1 -- 172.21.15.55:0/2342605594 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ec0ad440 con 0x7f14f4164410 2023-08-25T05:18:50.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14ea7fc640 1 -- 172.21.15.55:0/2342605594 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec0ad7f0 con 0x7f14f4164410 2023-08-25T05:18:50.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14fbe34640 1 -- 172.21.15.55:0/2342605594 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f4161aa0 con 0x7f14f4164410 2023-08-25T05:18:50.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14fbe34640 1 -- 172.21.15.55:0/2342605594 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f4162060 con 0x7f14f4164410 2023-08-25T05:18:50.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14fbe34640 1 -- 172.21.15.55:0/2342605594 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f4162250 con 0x7f14f4164410 2023-08-25T05:18:50.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.209+0000 7f14ea7fc640 1 -- 172.21.15.55:0/2342605594 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f14ec0b4070 con 0x7f14f4164410 2023-08-25T05:18:50.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.213+0000 7f14ea7fc640 1 --2- 172.21.15.55:0/2342605594 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f14d80657d0 0x7f14d8067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:50.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.213+0000 7f14ea7fc640 1 -- 172.21.15.55:0/2342605594 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f14ec11d4e0 con 0x7f14f4164410 2023-08-25T05:18:50.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.213+0000 7f14f9bd0640 1 --2- 172.21.15.55:0/2342605594 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f14d80657d0 0x7f14d8067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:50.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.213+0000 7f14f9bd0640 1 --2- 172.21.15.55:0/2342605594 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f14d80657d0 0x7f14d8067c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f14f00079c0 tx=0x7f14f0008040 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:50.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.217+0000 7f14ea7fc640 1 -- 172.21.15.55:0/2342605594 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f14ec0eaea0 con 0x7f14f4164410 2023-08-25T05:18:50.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.393+0000 7f14fbe34640 1 -- 172.21.15.55:0/2342605594 --> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f14f40cd530 con 0x7f14d80657d0 2023-08-25T05:18:50.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.393+0000 7f14ea7fc640 1 -- 172.21.15.55:0/2342605594 <== mgr.7709 v2:172.21.15.110:6832/4256905777 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f14f00108d0 con 0x7f14d80657d0 2023-08-25T05:18:50.398 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T05:18:50.399 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:18:50.399 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-08-25T05:18:50.399 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:18:50.399 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T05:18:50.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.397+0000 7f14fbe34640 1 -- 172.21.15.55:0/2342605594 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f14d80657d0 msgr2=0x7f14d8067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:50.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.397+0000 7f14fbe34640 1 --2- 172.21.15.55:0/2342605594 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f14d80657d0 0x7f14d8067c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f14f00079c0 tx=0x7f14f0008040 comp rx=0 tx=0).stop 2023-08-25T05:18:50.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.397+0000 7f14fbe34640 1 -- 172.21.15.55:0/2342605594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14f4164410 msgr2=0x7f14f40c4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:50.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.397+0000 7f14fbe34640 1 --2- 172.21.15.55:0/2342605594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14f4164410 0x7f14f40c4820 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f14ec019520 tx=0x7f14ec0196b0 comp rx=0 tx=0).stop 2023-08-25T05:18:50.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.397+0000 7f14fbe34640 1 -- 172.21.15.55:0/2342605594 shutdown_connections 2023-08-25T05:18:50.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.397+0000 7f14fbe34640 1 --2- 172.21.15.55:0/2342605594 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f14d80657d0 0x7f14d8067c90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.397+0000 7f14fbe34640 1 --2- 172.21.15.55:0/2342605594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14f4164410 0x7f14f40c4820 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.397+0000 7f14fbe34640 1 --2- 172.21.15.55:0/2342605594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14f40cddf0 0x7f14f40c1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.397+0000 7f14fbe34640 1 --2- 172.21.15.55:0/2342605594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14f40c1a80 0x7f14f4159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.397+0000 7f14fbe34640 1 -- 172.21.15.55:0/2342605594 >> 172.21.15.55:0/2342605594 conn(0x7f14f4069d00 msgr2=0x7f14f4070480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.397+0000 7f14fbe34640 1 -- 172.21.15.55:0/2342605594 shutdown_connections 2023-08-25T05:18:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.397+0000 7f14fbe34640 1 -- 172.21.15.55:0/2342605594 wait complete. 2023-08-25T05:18:50.419 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-25T05:18:50.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.561+0000 7fe7d8959640 1 Processor -- start 2023-08-25T05:18:50.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.561+0000 7fe7d8959640 1 -- start start 2023-08-25T05:18:50.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.565+0000 7fe7d8959640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe7d406c3b0 0x7fe7d40cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:50.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.565+0000 7fe7d8959640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe7d406e5a0 0x7fe7d40ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:50.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.565+0000 7fe7d8959640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d40cab90 con 0x7fe7d406c790 2023-08-25T05:18:50.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.565+0000 7fe7d8959640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d406dbb0 con 0x7fe7d406c3b0 2023-08-25T05:18:50.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.565+0000 7fe7d8959640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d40cae50 con 0x7fe7d406e5a0 2023-08-25T05:18:50.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.565+0000 7fe7d259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe7d406c3b0 0x7fe7d40cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:50.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.565+0000 7fe7d259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe7d406c3b0 0x7fe7d40cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46156/0 (socket says 172.21.15.55:46156) 2023-08-25T05:18:50.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.565+0000 7fe7d259c640 1 -- 172.21.15.55:0/913677201 learned_addr learned my addr 172.21.15.55:0/913677201 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:50.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.565+0000 7fe7d2d9d640 1 --2- 172.21.15.55:0/913677201 >> v2:172.21.15.110:3300/0 conn(0x7fe7d406e5a0 0x7fe7d40ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:50.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.565+0000 7fe7d259c640 1 -- 172.21.15.55:0/913677201 >> v2:172.21.15.110:3300/0 conn(0x7fe7d406e5a0 msgr2=0x7fe7d40ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:50.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.565+0000 7fe7d259c640 1 --2- 172.21.15.55:0/913677201 >> v2:172.21.15.110:3300/0 conn(0x7fe7d406e5a0 0x7fe7d40ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:50.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.565+0000 7fe7d259c640 1 -- 172.21.15.55:0/913677201 >> v1:172.21.15.110:6789/0 conn(0x7fe7d406c790 legacy=0x7fe7d406de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:50.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.565+0000 7fe7d259c640 1 -- 172.21.15.55:0/913677201 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d40cb130 con 0x7fe7d406c3b0 2023-08-25T05:18:50.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.569+0000 7fe7d259c640 1 --2- 172.21.15.55:0/913677201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7d406c3b0 0x7fe7d40cd7d0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4070600 tx=0x7fe7c401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ad092017b2be7c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:50.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.569+0000 7fe7d1d9b640 1 -- 172.21.15.55:0/913677201 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c40a5860 con 0x7fe7d406c3b0 2023-08-25T05:18:50.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.569+0000 7fe7d1d9b640 1 -- 172.21.15.55:0/913677201 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c40a59c0 con 0x7fe7d406c3b0 2023-08-25T05:18:50.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.569+0000 7fe7d1d9b640 1 -- 172.21.15.55:0/913677201 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c40a5d50 con 0x7fe7d406c3b0 2023-08-25T05:18:50.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.569+0000 7fe7d8959640 1 -- 172.21.15.55:0/913677201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7d406c3b0 msgr2=0x7fe7d40cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:50.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.569+0000 7fe7d8959640 1 --2- 172.21.15.55:0/913677201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7d406c3b0 0x7fe7d40cd7d0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4070600 tx=0x7fe7c401c9c0 comp rx=0 tx=0).stop 2023-08-25T05:18:50.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.569+0000 7fe7d8959640 1 -- 172.21.15.55:0/913677201 shutdown_connections 2023-08-25T05:18:50.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.569+0000 7fe7d8959640 1 --2- 172.21.15.55:0/913677201 >> v2:172.21.15.110:3300/0 conn(0x7fe7d406e5a0 0x7fe7d40ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:50.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.569+0000 7fe7d8959640 1 --2- 172.21.15.55:0/913677201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7d406c3b0 0x7fe7d40cd7d0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:50.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.569+0000 7fe7d8959640 1 -- 172.21.15.55:0/913677201 >> 172.21.15.55:0/913677201 conn(0x7fe7d40d0540 msgr2=0x7fe7d40d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:50.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.569+0000 7fe7d8959640 1 -- 172.21.15.55:0/913677201 shutdown_connections 2023-08-25T05:18:50.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.569+0000 7fe7d8959640 1 -- 172.21.15.55:0/913677201 wait complete. 2023-08-25T05:18:50.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.569+0000 7fe7d8959640 1 Processor -- start 2023-08-25T05:18:50.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.569+0000 7fe7d8959640 1 -- start start 2023-08-25T05:18:50.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d8959640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7d406c3b0 0x7fe7d4152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:50.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d8959640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7d406c790 0x7fe7d41528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:50.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d8959640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7d406e5a0 0x7fe7d40b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:50.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d8959640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d4152e00 con 0x7fe7d406c3b0 2023-08-25T05:18:50.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d8959640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d415a0e0 con 0x7fe7d406e5a0 2023-08-25T05:18:50.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d8959640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d40b3fb0 con 0x7fe7d406c790 2023-08-25T05:18:50.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7d406c3b0 0x7fe7d4152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:50.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7d406c3b0 0x7fe7d4152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46162/0 (socket says 172.21.15.55:46162) 2023-08-25T05:18:50.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d259c640 1 -- 172.21.15.55:0/618062793 learned_addr learned my addr 172.21.15.55:0/618062793 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:50.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7c9d9b640 1 --2- 172.21.15.55:0/618062793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7d406c790 0x7fe7d41528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:50.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d2d9d640 1 --2- 172.21.15.55:0/618062793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7d406e5a0 0x7fe7d40b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:50.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d259c640 1 -- 172.21.15.55:0/618062793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7d406c790 msgr2=0x7fe7d41528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:50.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d259c640 1 --2- 172.21.15.55:0/618062793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7d406c790 0x7fe7d41528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:50.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d259c640 1 -- 172.21.15.55:0/618062793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7d406e5a0 msgr2=0x7fe7d40b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:50.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d259c640 1 --2- 172.21.15.55:0/618062793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7d406e5a0 0x7fe7d40b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:50.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d259c640 1 -- 172.21.15.55:0/618062793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c4009b30 con 0x7fe7d406c3b0 2023-08-25T05:18:50.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d2d9d640 1 --2- 172.21.15.55:0/618062793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7d406e5a0 0x7fe7d40b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:50.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d259c640 1 --2- 172.21.15.55:0/618062793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7d406c3b0 0x7fe7d4152f90 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fe7c401a5f0 tx=0x7fe7c4019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:50.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7cb7fe640 1 -- 172.21.15.55:0/618062793 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c40b8880 con 0x7fe7d406c3b0 2023-08-25T05:18:50.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7cb7fe640 1 -- 172.21.15.55:0/618062793 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c40b8a00 con 0x7fe7d406c3b0 2023-08-25T05:18:50.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d8959640 1 -- 172.21.15.55:0/618062793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d40cd240 con 0x7fe7d406c3b0 2023-08-25T05:18:50.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7cb7fe640 1 -- 172.21.15.55:0/618062793 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c40b8db0 con 0x7fe7d406c3b0 2023-08-25T05:18:50.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d8959640 1 -- 172.21.15.55:0/618062793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d40cd800 con 0x7fe7d406c3b0 2023-08-25T05:18:50.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7d8959640 1 -- 172.21.15.55:0/618062793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d415a250 con 0x7fe7d406c3b0 2023-08-25T05:18:50.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.573+0000 7fe7cb7fe640 1 -- 172.21.15.55:0/618062793 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 79) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fe7c4006d50 con 0x7fe7d406c3b0 2023-08-25T05:18:50.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.577+0000 7fe7cb7fe640 1 --2- 172.21.15.55:0/618062793 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe7b40657a0 0x7fe7b4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:50.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.577+0000 7fe7cb7fe640 1 -- 172.21.15.55:0/618062793 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe7c411e260 con 0x7fe7d406c3b0 2023-08-25T05:18:50.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.577+0000 7fe7c9d9b640 1 --2- 172.21.15.55:0/618062793 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe7b40657a0 0x7fe7b4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:50.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.577+0000 7fe7c9d9b640 1 --2- 172.21.15.55:0/618062793 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe7b40657a0 0x7fe7b4067c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40b6160 tx=0x7fe7bc007e40 comp rx=0 tx=0).ready entity=mgr.7709 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:50.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.581+0000 7fe7cb7fe640 1 -- 172.21.15.55:0/618062793 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe7c40ebca0 con 0x7fe7d406c3b0 2023-08-25T05:18:50.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:50.773+0000 7fe7d8959640 1 -- 172.21.15.55:0/618062793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fe7d4073ec0 con 0x7fe7d406c3b0 2023-08-25T05:18:51.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.069+0000 7fe7cb7fe640 1 -- 172.21.15.55:0/618062793 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 80) v1 ==== 85081+0+0 (secure 0 0 0) 0x7fe7c40ec070 con 0x7fe7d406c3b0 2023-08-25T05:18:51.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.073+0000 7fe7cb7fe640 1 -- 172.21.15.55:0/618062793 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v80) v1 ==== 92+0+0 (secure 0 0 0) 0x7fe7c40ef4a0 con 0x7fe7d406c3b0 2023-08-25T05:18:51.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.073+0000 7fe7d8959640 1 -- 172.21.15.55:0/618062793 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe7b40657a0 msgr2=0x7fe7b4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:51.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.073+0000 7fe7d8959640 1 --2- 172.21.15.55:0/618062793 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe7b40657a0 0x7fe7b4067c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe7d40b6160 tx=0x7fe7bc007e40 comp rx=0 tx=0).stop 2023-08-25T05:18:51.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.073+0000 7fe7d8959640 1 -- 172.21.15.55:0/618062793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7d406c3b0 msgr2=0x7fe7d4152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:51.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.073+0000 7fe7d8959640 1 --2- 172.21.15.55:0/618062793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7d406c3b0 0x7fe7d4152f90 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fe7c401a5f0 tx=0x7fe7c4019760 comp rx=0 tx=0).stop 2023-08-25T05:18:51.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.073+0000 7fe7d8959640 1 -- 172.21.15.55:0/618062793 shutdown_connections 2023-08-25T05:18:51.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.073+0000 7fe7d8959640 1 --2- 172.21.15.55:0/618062793 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe7b40657a0 0x7fe7b4067c60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.073+0000 7fe7d8959640 1 --2- 172.21.15.55:0/618062793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe7d406e5a0 0x7fe7d40b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.073+0000 7fe7d8959640 1 --2- 172.21.15.55:0/618062793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe7d406c790 0x7fe7d41528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.073+0000 7fe7d8959640 1 --2- 172.21.15.55:0/618062793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7d406c3b0 0x7fe7d4152f90 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.073+0000 7fe7d8959640 1 -- 172.21.15.55:0/618062793 >> 172.21.15.55:0/618062793 conn(0x7fe7d40d0540 msgr2=0x7fe7d415bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:51.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.073+0000 7fe7d8959640 1 -- 172.21.15.55:0/618062793 shutdown_connections 2023-08-25T05:18:51.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.073+0000 7fe7d8959640 1 -- 172.21.15.55:0/618062793 wait complete. 2023-08-25T05:18:51.099 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-25T05:18:51.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.245+0000 7f760fde1640 1 Processor -- start 2023-08-25T05:18:51.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.245+0000 7f760fde1640 1 -- start start 2023-08-25T05:18:51.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.249+0000 7f760fde1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f760815e3c0 0x7f760815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:51.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.249+0000 7f760fde1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76080cd5a0 con 0x7f76081601f0 2023-08-25T05:18:51.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.249+0000 7f760fde1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76080cd880 con 0x7f76080d1290 2023-08-25T05:18:51.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.249+0000 7f760fde1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76080cdb60 con 0x7f760815e3c0 2023-08-25T05:18:51.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.249+0000 7f760db7d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f76081601f0 0x7f76080d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45046/0 (socket says 172.21.15.55:45046) 2023-08-25T05:18:51.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.249+0000 7f760db7d640 1 -- 172.21.15.55:0/2926809384 learned_addr learned my addr 172.21.15.55:0/2926809384 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:51.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.249+0000 7f760d37c640 1 --2- 172.21.15.55:0/2926809384 >> v2:172.21.15.110:3300/0 conn(0x7f760815e3c0 0x7f760815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:51.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.249+0000 7f760cb7b640 1 -- 172.21.15.55:0/2926809384 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988573043 0 0) 0x7f76080cd5a0 con 0x7f76081601f0 2023-08-25T05:18:51.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.249+0000 7f760cb7b640 1 -- 172.21.15.55:0/2926809384 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75f4003530 con 0x7f76081601f0 2023-08-25T05:18:51.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.249+0000 7f760d37c640 1 -- 172.21.15.55:0/2926809384 >> v1:172.21.15.110:6789/0 conn(0x7f76080d1290 legacy=0x7f760815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:51.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.249+0000 7f760cb7b640 1 -- 172.21.15.55:0/2926809384 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201617214 0 0) 0x7f76080cd880 con 0x7f76080d1290 2023-08-25T05:18:51.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.249+0000 7f760d37c640 1 -- 172.21.15.55:0/2926809384 >> v1:172.21.15.55:6789/0 conn(0x7f76081601f0 legacy=0x7f76080d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:51.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.249+0000 7f760d37c640 1 -- 172.21.15.55:0/2926809384 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76080cde40 con 0x7f760815e3c0 2023-08-25T05:18:51.257 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:51.249+0000 7f73b70e2180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:18:51.261 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:51.255+0000 7f4ae8e01180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:18:51.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.253+0000 7f760d37c640 1 --2- 172.21.15.55:0/2926809384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f760815e3c0 0x7f760815d430 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f75f80097c0 tx=0x7f75f801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6299743b86d7b915 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.253+0000 7f760cb7b640 1 -- 172.21.15.55:0/2926809384 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f80ab600 con 0x7f760815e3c0 2023-08-25T05:18:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.253+0000 7f760cb7b640 1 -- 172.21.15.55:0/2926809384 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f80a7050 con 0x7f760815e3c0 2023-08-25T05:18:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.253+0000 7f760cb7b640 1 -- 172.21.15.55:0/2926809384 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f80ab980 con 0x7f760815e3c0 2023-08-25T05:18:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.253+0000 7f760fde1640 1 -- 172.21.15.55:0/2926809384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f760815e3c0 msgr2=0x7f760815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:51.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.253+0000 7f760fde1640 1 --2- 172.21.15.55:0/2926809384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f760815e3c0 0x7f760815d430 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f75f80097c0 tx=0x7f75f801c450 comp rx=0 tx=0).stop 2023-08-25T05:18:51.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.253+0000 7f760fde1640 1 -- 172.21.15.55:0/2926809384 shutdown_connections 2023-08-25T05:18:51.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.253+0000 7f760fde1640 1 --2- 172.21.15.55:0/2926809384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f760815e3c0 0x7f760815d430 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.253+0000 7f760fde1640 1 -- 172.21.15.55:0/2926809384 >> 172.21.15.55:0/2926809384 conn(0x7f76080d27d0 msgr2=0x7f76080d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:51.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.253+0000 7f760fde1640 1 -- 172.21.15.55:0/2926809384 shutdown_connections 2023-08-25T05:18:51.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.253+0000 7f760fde1640 1 -- 172.21.15.55:0/2926809384 wait complete. 2023-08-25T05:18:51.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.253+0000 7f760fde1640 1 Processor -- start 2023-08-25T05:18:51.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.253+0000 7f760fde1640 1 -- start start 2023-08-25T05:18:51.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760fde1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76080d1290 0x7f760814fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:51.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760fde1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f760815e3c0 0x7f760814b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:51.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760fde1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76081601f0 0x7f760814ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:51.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760fde1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76081580b0 con 0x7f760815e3c0 2023-08-25T05:18:51.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760fde1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7608152620 con 0x7f76080d1290 2023-08-25T05:18:51.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760fde1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7608157530 con 0x7f76081601f0 2023-08-25T05:18:51.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760d37c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f760815e3c0 0x7f760814b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:51.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760d37c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f760815e3c0 0x7f760814b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46190/0 (socket says 172.21.15.55:46190) 2023-08-25T05:18:51.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760d37c640 1 -- 172.21.15.55:0/1097539324 learned_addr learned my addr 172.21.15.55:0/1097539324 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:51.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760db7d640 1 --2- 172.21.15.55:0/1097539324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76080d1290 0x7f760814fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:51.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760e37e640 1 --2- 172.21.15.55:0/1097539324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76081601f0 0x7f760814ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760d37c640 1 -- 172.21.15.55:0/1097539324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76081601f0 msgr2=0x7f760814ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760d37c640 1 --2- 172.21.15.55:0/1097539324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76081601f0 0x7f760814ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760d37c640 1 -- 172.21.15.55:0/1097539324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76080d1290 msgr2=0x7f760814fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760d37c640 1 --2- 172.21.15.55:0/1097539324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76080d1290 0x7f760814fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760d37c640 1 -- 172.21.15.55:0/1097539324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f8009420 con 0x7f760815e3c0 2023-08-25T05:18:51.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760d37c640 1 --2- 172.21.15.55:0/1097539324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f760815e3c0 0x7f760814b540 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f75f80ae040 tx=0x7f75f80191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:51.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f75fe7fc640 1 -- 172.21.15.55:0/1097539324 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8004020 con 0x7f760815e3c0 2023-08-25T05:18:51.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f75fe7fc640 1 -- 172.21.15.55:0/1097539324 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f8004180 con 0x7f760815e3c0 2023-08-25T05:18:51.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f75fe7fc640 1 -- 172.21.15.55:0/1097539324 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f80044f0 con 0x7f760815e3c0 2023-08-25T05:18:51.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760fde1640 1 -- 172.21.15.55:0/1097539324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7608157780 con 0x7f760815e3c0 2023-08-25T05:18:51.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760fde1640 1 -- 172.21.15.55:0/1097539324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7608157d40 con 0x7f760815e3c0 2023-08-25T05:18:51.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f760fde1640 1 -- 172.21.15.55:0/1097539324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76080b5260 con 0x7f760815e3c0 2023-08-25T05:18:51.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.257+0000 7f75fe7fc640 1 -- 172.21.15.55:0/1097539324 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 80) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f75f80b2040 con 0x7f760815e3c0 2023-08-25T05:18:51.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.261+0000 7f75fe7fc640 1 --2- 172.21.15.55:0/1097539324 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f75ec0657f0 0x7f75ec067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:51.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.261+0000 7f75fe7fc640 1 -- 172.21.15.55:0/1097539324 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75f811cf80 con 0x7f760815e3c0 2023-08-25T05:18:51.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.261+0000 7f760db7d640 1 -- 172.21.15.55:0/1097539324 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f75ec0657f0 msgr2=0x7f75ec067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4256905777 2023-08-25T05:18:51.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.261+0000 7f760db7d640 1 --2- 172.21.15.55:0/1097539324 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f75ec0657f0 0x7f75ec067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:18:51.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.269+0000 7f75fe7fc640 1 -- 172.21.15.55:0/1097539324 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f75f80ea8c0 con 0x7f760815e3c0 2023-08-25T05:18:51.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.425+0000 7f760fde1640 1 -- 172.21.15.55:0/1097539324 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f7608158260 con 0x7f760815e3c0 2023-08-25T05:18:51.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.433+0000 7f75fe7fc640 1 -- 172.21.15.55:0/1097539324 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v53)=0 v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7608158260 con 0x7f760815e3c0 2023-08-25T05:18:51.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.433+0000 7f760fde1640 1 -- 172.21.15.55:0/1097539324 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f75ec0657f0 msgr2=0x7f75ec067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:18:51.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.433+0000 7f760fde1640 1 --2- 172.21.15.55:0/1097539324 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f75ec0657f0 0x7f75ec067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.433+0000 7f760fde1640 1 -- 172.21.15.55:0/1097539324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f760815e3c0 msgr2=0x7f760814b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:51.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.433+0000 7f760fde1640 1 --2- 172.21.15.55:0/1097539324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f760815e3c0 0x7f760814b540 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f75f80ae040 tx=0x7f75f80191f0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.433+0000 7f760fde1640 1 -- 172.21.15.55:0/1097539324 shutdown_connections 2023-08-25T05:18:51.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.433+0000 7f760fde1640 1 --2- 172.21.15.55:0/1097539324 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f75ec0657f0 0x7f75ec067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.433+0000 7f760fde1640 1 --2- 172.21.15.55:0/1097539324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76081601f0 0x7f760814ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.433+0000 7f760fde1640 1 --2- 172.21.15.55:0/1097539324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f760815e3c0 0x7f760814b540 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.433+0000 7f760fde1640 1 --2- 172.21.15.55:0/1097539324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76080d1290 0x7f760814fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.433+0000 7f760fde1640 1 -- 172.21.15.55:0/1097539324 >> 172.21.15.55:0/1097539324 conn(0x7f76080d27d0 msgr2=0x7f760815e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:51.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.433+0000 7f760fde1640 1 -- 172.21.15.55:0/1097539324 shutdown_connections 2023-08-25T05:18:51.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.433+0000 7f760fde1640 1 -- 172.21.15.55:0/1097539324 wait complete. 2023-08-25T05:18:51.458 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-08-25T05:18:51.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.601+0000 7fe62d996640 1 Processor -- start 2023-08-25T05:18:51.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.601+0000 7fe62d996640 1 -- start start 2023-08-25T05:18:51.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.605+0000 7fe62d996640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe62815e3c0 0x7fe62815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:51.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.605+0000 7fe62d996640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe6280d1290 0x7fe62815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:51.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.605+0000 7fe62d996640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6280cd5a0 con 0x7fe6281601f0 2023-08-25T05:18:51.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.605+0000 7fe62d996640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6280cd880 con 0x7fe6280d1290 2023-08-25T05:18:51.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.605+0000 7fe62d996640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280cdb60 con 0x7fe62815e3c0 2023-08-25T05:18:51.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.605+0000 7fe61ffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe62815e3c0 0x7fe62815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:51.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.605+0000 7fe6277fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe6280d1290 0x7fe62815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:51.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.605+0000 7fe61ffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe62815e3c0 0x7fe62815d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:54060/0 (socket says 172.21.15.55:54060) 2023-08-25T05:18:51.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.605+0000 7fe61ffff640 1 -- 172.21.15.55:0/945427373 learned_addr learned my addr 172.21.15.55:0/945427373 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:51.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.605+0000 7fe61ffff640 1 -- 172.21.15.55:0/945427373 >> v2:172.21.15.110:3300/0 conn(0x7fe6280d1290 msgr2=0x7fe62815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:51.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.605+0000 7fe61ffff640 1 --2- 172.21.15.55:0/945427373 >> v2:172.21.15.110:3300/0 conn(0x7fe6280d1290 0x7fe62815e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.605+0000 7fe61ffff640 1 -- 172.21.15.55:0/945427373 >> v1:172.21.15.110:6789/0 conn(0x7fe6281601f0 legacy=0x7fe6280d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:51.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.605+0000 7fe61ffff640 1 -- 172.21.15.55:0/945427373 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6280cde40 con 0x7fe62815e3c0 2023-08-25T05:18:51.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.609+0000 7fe61ffff640 1 --2- 172.21.15.55:0/945427373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe62815e3c0 0x7fe62815d430 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe610009870 tx=0x7fe61001ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df5c62ed575796c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:51.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.609+0000 7fe6267fc640 1 -- 172.21.15.55:0/945427373 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6100a8a30 con 0x7fe62815e3c0 2023-08-25T05:18:51.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.609+0000 7fe6267fc640 1 -- 172.21.15.55:0/945427373 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6100a8b90 con 0x7fe62815e3c0 2023-08-25T05:18:51.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.609+0000 7fe6267fc640 1 -- 172.21.15.55:0/945427373 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6100b0440 con 0x7fe62815e3c0 2023-08-25T05:18:51.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.609+0000 7fe62d996640 1 -- 172.21.15.55:0/945427373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe62815e3c0 msgr2=0x7fe62815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:51.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.609+0000 7fe62d996640 1 --2- 172.21.15.55:0/945427373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe62815e3c0 0x7fe62815d430 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe610009870 tx=0x7fe61001ed30 comp rx=0 tx=0).stop 2023-08-25T05:18:51.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.609+0000 7fe62d996640 1 -- 172.21.15.55:0/945427373 shutdown_connections 2023-08-25T05:18:51.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.609+0000 7fe62d996640 1 --2- 172.21.15.55:0/945427373 >> v2:172.21.15.110:3300/0 conn(0x7fe6280d1290 0x7fe62815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.609+0000 7fe62d996640 1 --2- 172.21.15.55:0/945427373 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe62815e3c0 0x7fe62815d430 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.609+0000 7fe62d996640 1 -- 172.21.15.55:0/945427373 >> 172.21.15.55:0/945427373 conn(0x7fe6280d27d0 msgr2=0x7fe6280d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:51.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.609+0000 7fe62d996640 1 -- 172.21.15.55:0/945427373 shutdown_connections 2023-08-25T05:18:51.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.609+0000 7fe62d996640 1 -- 172.21.15.55:0/945427373 wait complete. 2023-08-25T05:18:51.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.609+0000 7fe62d996640 1 Processor -- start 2023-08-25T05:18:51.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.609+0000 7fe62d996640 1 -- start start 2023-08-25T05:18:51.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe62d996640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6280d1290 0x7fe6280c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:51.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe62d996640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe62815e3c0 0x7fe6281f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:51.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe62d996640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6281601f0 0x7fe6281f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:51.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe62d996640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280c6ac0 con 0x7fe62815e3c0 2023-08-25T05:18:51.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe62d996640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280c6da0 con 0x7fe6280d1290 2023-08-25T05:18:51.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe62d996640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280c7080 con 0x7fe6281601f0 2023-08-25T05:18:51.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe61ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe62815e3c0 0x7fe6281f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:51.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe61ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe62815e3c0 0x7fe6281f2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46206/0 (socket says 172.21.15.55:46206) 2023-08-25T05:18:51.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe61ffff640 1 -- 172.21.15.55:0/545540154 learned_addr learned my addr 172.21.15.55:0/545540154 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:51.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe6277fe640 1 --2- 172.21.15.55:0/545540154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6281601f0 0x7fe6281f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:51.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe626ffd640 1 --2- 172.21.15.55:0/545540154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6280d1290 0x7fe6280c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:51.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe61ffff640 1 -- 172.21.15.55:0/545540154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6281601f0 msgr2=0x7fe6281f2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:51.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe61ffff640 1 --2- 172.21.15.55:0/545540154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6281601f0 0x7fe6281f2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe61ffff640 1 -- 172.21.15.55:0/545540154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6280d1290 msgr2=0x7fe6280c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:51.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe61ffff640 1 --2- 172.21.15.55:0/545540154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6280d1290 0x7fe6280c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe61ffff640 1 -- 172.21.15.55:0/545540154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6100094d0 con 0x7fe62815e3c0 2023-08-25T05:18:51.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe61ffff640 1 --2- 172.21.15.55:0/545540154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe62815e3c0 0x7fe6281f2050 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fe6100b3040 tx=0x7fe61001bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:51.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe624ff9640 1 -- 172.21.15.55:0/545540154 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6100b0dd0 con 0x7fe62815e3c0 2023-08-25T05:18:51.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe624ff9640 1 -- 172.21.15.55:0/545540154 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6100bb460 con 0x7fe62815e3c0 2023-08-25T05:18:51.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe624ff9640 1 -- 172.21.15.55:0/545540154 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6100bb810 con 0x7fe62815e3c0 2023-08-25T05:18:51.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe62d996640 1 -- 172.21.15.55:0/545540154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6280ce7c0 con 0x7fe62815e3c0 2023-08-25T05:18:51.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe62d996640 1 -- 172.21.15.55:0/545540154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6280c7640 con 0x7fe62815e3c0 2023-08-25T05:18:51.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe62d996640 1 -- 172.21.15.55:0/545540154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6280b5260 con 0x7fe62815e3c0 2023-08-25T05:18:51.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.613+0000 7fe624ff9640 1 -- 172.21.15.55:0/545540154 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 80) v1 ==== 85081+0+0 (secure 0 0 0) 0x7fe6100b83f0 con 0x7fe62815e3c0 2023-08-25T05:18:51.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.617+0000 7fe624ff9640 1 --2- 172.21.15.55:0/545540154 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe6080657f0 0x7fe608067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:51.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.617+0000 7fe624ff9640 1 -- 172.21.15.55:0/545540154 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe6101207f0 con 0x7fe62815e3c0 2023-08-25T05:18:51.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.617+0000 7fe626ffd640 1 -- 172.21.15.55:0/545540154 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe6080657f0 msgr2=0x7fe608067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4256905777 2023-08-25T05:18:51.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.617+0000 7fe626ffd640 1 --2- 172.21.15.55:0/545540154 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe6080657f0 0x7fe608067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:18:51.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.621+0000 7fe624ff9640 1 -- 172.21.15.55:0/545540154 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe6100ee240 con 0x7fe62815e3c0 2023-08-25T05:18:51.672 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:51.671+0000 7f4ae8e01180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:18:51.703 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:51.701+0000 7f73b70e2180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:18:51.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.781+0000 7fe62d996640 1 -- 172.21.15.55:0/545540154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fe628073ec0 con 0x7fe62815e3c0 2023-08-25T05:18:51.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.789+0000 7fe624ff9640 1 -- 172.21.15.55:0/545540154 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v54)=0 v54) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe6100f1860 con 0x7fe62815e3c0 2023-08-25T05:18:51.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.789+0000 7fe62d996640 1 -- 172.21.15.55:0/545540154 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe6080657f0 msgr2=0x7fe608067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:18:51.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.789+0000 7fe62d996640 1 --2- 172.21.15.55:0/545540154 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe6080657f0 0x7fe608067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.789+0000 7fe62d996640 1 -- 172.21.15.55:0/545540154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe62815e3c0 msgr2=0x7fe6281f2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.789+0000 7fe62d996640 1 --2- 172.21.15.55:0/545540154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe62815e3c0 0x7fe6281f2050 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fe6100b3040 tx=0x7fe61001bad0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.789+0000 7fe62d996640 1 -- 172.21.15.55:0/545540154 shutdown_connections 2023-08-25T05:18:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.789+0000 7fe62d996640 1 --2- 172.21.15.55:0/545540154 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7fe6080657f0 0x7fe608067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.789+0000 7fe62d996640 1 --2- 172.21.15.55:0/545540154 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe6281601f0 0x7fe6281f2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.789+0000 7fe62d996640 1 --2- 172.21.15.55:0/545540154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe62815e3c0 0x7fe6281f2050 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.789+0000 7fe62d996640 1 --2- 172.21.15.55:0/545540154 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe6280d1290 0x7fe6280c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.789+0000 7fe62d996640 1 -- 172.21.15.55:0/545540154 >> 172.21.15.55:0/545540154 conn(0x7fe6280d27d0 msgr2=0x7fe6280cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:51.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.789+0000 7fe62d996640 1 -- 172.21.15.55:0/545540154 shutdown_connections 2023-08-25T05:18:51.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:51.789+0000 7fe62d996640 1 -- 172.21.15.55:0/545540154 wait complete. 2023-08-25T05:18:51.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:51.815 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-25T05:18:51.822 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:51.823+0000 7f4ae8e01180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:18:51.831 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-08-25T05:18:51.866 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:51.861+0000 7f73b70e2180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:18:52.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.013+0000 7f8405434640 1 Processor -- start 2023-08-25T05:18:52.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.013+0000 7f8405434640 1 -- start start 2023-08-25T05:18:52.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.013+0000 7f8405434640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f840015cb40 0x7f84000d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:52.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.013+0000 7f8405434640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84000d1970 con 0x7f84000b59f0 2023-08-25T05:18:52.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.013+0000 7f8405434640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84000d0d80 con 0x7f84000cf340 2023-08-25T05:18:52.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.013+0000 7f8405434640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84000d1040 con 0x7f840015cb40 2023-08-25T05:18:52.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.013+0000 7f83ff7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f84000b59f0 0x7f84000b5e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45052/0 (socket says 172.21.15.55:45052) 2023-08-25T05:18:52.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.013+0000 7f83ff7fe640 1 -- 172.21.15.55:0/757475044 learned_addr learned my addr 172.21.15.55:0/757475044 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:52.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.013+0000 7f83feffd640 1 --2- 172.21.15.55:0/757475044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f840015cb40 0x7f84000d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:52.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.013+0000 7f83fe7fc640 1 -- 172.21.15.55:0/757475044 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057688697 0 0) 0x7f84000d1970 con 0x7f84000b59f0 2023-08-25T05:18:52.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.013+0000 7f83fe7fc640 1 -- 172.21.15.55:0/757475044 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83ec003530 con 0x7f84000b59f0 2023-08-25T05:18:52.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.013+0000 7f83feffd640 1 -- 172.21.15.55:0/757475044 >> v1:172.21.15.110:6789/0 conn(0x7f84000cf340 legacy=0x7f84000cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:52.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.013+0000 7f83fe7fc640 1 -- 172.21.15.55:0/757475044 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125397340 0 0) 0x7f84000d0d80 con 0x7f84000cf340 2023-08-25T05:18:52.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.013+0000 7f83feffd640 1 -- 172.21.15.55:0/757475044 >> v1:172.21.15.55:6789/0 conn(0x7f84000b59f0 legacy=0x7f84000b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:52.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.013+0000 7f83feffd640 1 -- 172.21.15.55:0/757475044 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84000d1320 con 0x7f840015cb40 2023-08-25T05:18:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.017+0000 7f83feffd640 1 --2- 172.21.15.55:0/757475044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f840015cb40 0x7f84000d2080 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f83f00097f0 tx=0x7f83f001ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2562d9eb6416e893 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.017+0000 7f83fe7fc640 1 -- 172.21.15.55:0/757475044 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f00a89b0 con 0x7f840015cb40 2023-08-25T05:18:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.017+0000 7f83fe7fc640 1 -- 172.21.15.55:0/757475044 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f00a8b10 con 0x7f840015cb40 2023-08-25T05:18:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.017+0000 7f83fe7fc640 1 -- 172.21.15.55:0/757475044 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f00a8ea0 con 0x7f840015cb40 2023-08-25T05:18:52.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.017+0000 7f8405434640 1 -- 172.21.15.55:0/757475044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f840015cb40 msgr2=0x7f84000d2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:52.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.017+0000 7f8405434640 1 --2- 172.21.15.55:0/757475044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f840015cb40 0x7f84000d2080 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f83f00097f0 tx=0x7f83f001ecb0 comp rx=0 tx=0).stop 2023-08-25T05:18:52.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.017+0000 7f8405434640 1 -- 172.21.15.55:0/757475044 shutdown_connections 2023-08-25T05:18:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.017+0000 7f8405434640 1 --2- 172.21.15.55:0/757475044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f840015cb40 0x7f84000d2080 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.017+0000 7f8405434640 1 -- 172.21.15.55:0/757475044 >> 172.21.15.55:0/757475044 conn(0x7f840006aae0 msgr2=0x7f840006aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.017+0000 7f8405434640 1 -- 172.21.15.55:0/757475044 shutdown_connections 2023-08-25T05:18:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.017+0000 7f8405434640 1 -- 172.21.15.55:0/757475044 wait complete. 2023-08-25T05:18:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f8405434640 1 Processor -- start 2023-08-25T05:18:52.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f8405434640 1 -- start start 2023-08-25T05:18:52.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f8405434640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84000b59f0 0x7f840015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:52.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f8405434640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84000cf340 0x7f84000c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:52.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f8405434640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f840015cb40 0x7f84000b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:52.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f8405434640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84000b1610 con 0x7f84000b59f0 2023-08-25T05:18:52.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f8405434640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840015bf70 con 0x7f84000cf340 2023-08-25T05:18:52.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f8405434640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84000c75d0 con 0x7f840015cb40 2023-08-25T05:18:52.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f83feffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84000b59f0 0x7f840015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:52.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f83feffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84000b59f0 0x7f840015ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46216/0 (socket says 172.21.15.55:46216) 2023-08-25T05:18:52.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f83feffd640 1 -- 172.21.15.55:0/2502046788 learned_addr learned my addr 172.21.15.55:0/2502046788 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:52.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f83f7fff640 1 --2- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84000cf340 0x7f84000c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:52.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f83ff7fe640 1 --2- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f840015cb40 0x7f84000b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:52.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f83feffd640 1 -- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f840015cb40 msgr2=0x7f84000b7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:52.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f83feffd640 1 --2- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f840015cb40 0x7f84000b7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:52.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f83feffd640 1 -- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84000cf340 msgr2=0x7f84000c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:52.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f83feffd640 1 --2- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84000cf340 0x7f84000c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:52.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f83feffd640 1 -- 172.21.15.55:0/2502046788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f0009420 con 0x7f84000b59f0 2023-08-25T05:18:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f83feffd640 1 --2- 172.21.15.55:0/2502046788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84000b59f0 0x7f840015ba30 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f83f00097f0 tx=0x7f83f001ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f83f77fe640 1 -- 172.21.15.55:0/2502046788 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f00bf070 con 0x7f84000b59f0 2023-08-25T05:18:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f83f77fe640 1 -- 172.21.15.55:0/2502046788 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f00b0bf0 con 0x7f84000b59f0 2023-08-25T05:18:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f83f77fe640 1 -- 172.21.15.55:0/2502046788 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f00b9410 con 0x7f84000b59f0 2023-08-25T05:18:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f8405434640 1 -- 172.21.15.55:0/2502046788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84000c86c0 con 0x7f84000b59f0 2023-08-25T05:18:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.021+0000 7f8405434640 1 -- 172.21.15.55:0/2502046788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84000c6d30 con 0x7f84000b59f0 2023-08-25T05:18:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.025+0000 7f8405434640 1 -- 172.21.15.55:0/2502046788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8400071f80 con 0x7f84000b59f0 2023-08-25T05:18:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.025+0000 7f83f77fe640 1 -- 172.21.15.55:0/2502046788 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 80) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f83f00b7040 con 0x7f84000b59f0 2023-08-25T05:18:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.025+0000 7f83f77fe640 1 --2- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f83e00657f0 0x7f83e0067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.025+0000 7f83f77fe640 1 -- 172.21.15.55:0/2502046788 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f83f01201a0 con 0x7f84000b59f0 2023-08-25T05:18:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.025+0000 7f83f7fff640 1 -- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f83e00657f0 msgr2=0x7f83e0067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4256905777 2023-08-25T05:18:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.025+0000 7f83f7fff640 1 --2- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f83e00657f0 0x7f83e0067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:18:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.029+0000 7f83f77fe640 1 -- 172.21.15.55:0/2502046788 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f83f00edb60 con 0x7f84000b59f0 2023-08-25T05:18:52.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.209+0000 7f8405434640 1 -- 172.21.15.55:0/2502046788 --> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f84000d1600 con 0x7f83e00657f0 2023-08-25T05:18:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.229+0000 7f83f7fff640 1 -- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f83e00657f0 msgr2=0x7f83e0067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4256905777 2023-08-25T05:18:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.229+0000 7f83f7fff640 1 --2- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f83e00657f0 0x7f83e0067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-25T05:18:52.305 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:52.303+0000 7f4ae8e01180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:18:52.363 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:52.363+0000 7f4ae8e01180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:18:52.380 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:52.377+0000 7f73b70e2180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:18:52.418 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:52.419+0000 7f4ae8e01180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:18:52.442 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:52.437+0000 7f73b70e2180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:18:52.500 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:52.497+0000 7f73b70e2180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:18:52.504 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:52.503+0000 7f4ae8e01180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:18:52.561 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:52.559+0000 7f4ae8e01180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:18:52.593 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:52.589+0000 7f73b70e2180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:18:52.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.633+0000 7f83f7fff640 1 -- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f83e00657f0 msgr2=0x7f83e0067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4256905777 2023-08-25T05:18:52.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:52.633+0000 7f83f7fff640 1 --2- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f83e00657f0 0x7f83e0067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-25T05:18:52.645 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:52.643+0000 7f4ae8e01180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:18:52.652 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:52.649+0000 7f73b70e2180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:18:52.700 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:52.699+0000 7f4ae8e01180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:18:52.740 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:52.737+0000 7f73b70e2180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:18:52.799 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:52.797+0000 7f73b70e2180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:18:52.843 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:52.843+0000 7f4ae8e01180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:18:52.901 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:52.899+0000 7f4ae8e01180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:18:52.950 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:52.945+0000 7f73b70e2180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:18:53.012 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:53.009+0000 7f73b70e2180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:18:53.139 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:18:53.140 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:18:53.140 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:18:53.148 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:53.147+0000 7f4ae8e01180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:18:53.261 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:18:53.261 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:18:53.262 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:18:53.270 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:53.265+0000 7f73b70e2180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:18:53.283 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:53.283+0000 7f4ae8e01180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:18:53.406 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:53.407+0000 7f4ae8e01180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:18:53.412 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:53.409+0000 7f73b70e2180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:18:53.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:53.437+0000 7f83f7fff640 1 -- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f83e00657f0 msgr2=0x7f83e0067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4256905777 2023-08-25T05:18:53.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:53.437+0000 7f83f7fff640 1 --2- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f83e00657f0 0x7f83e0067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-25T05:18:53.476 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:53.475+0000 7f4ae8e01180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:18:53.543 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:53.541+0000 7f73b70e2180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:18:53.611 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:53.611+0000 7f4ae8e01180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:18:53.617 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:53.613+0000 7f73b70e2180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:18:53.759 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:53.757+0000 7f73b70e2180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:18:54.149 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:54.151+0000 7f4ae8e01180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:18:54.233 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:54.231+0000 7f4ae8e01180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:18:54.327 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:54.325+0000 7f73b70e2180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:18:54.380 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:54.379+0000 7f4ae8e01180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:18:54.415 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:54.413+0000 7f73b70e2180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:18:54.463 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:54.463+0000 7f4ae8e01180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:18:54.572 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:54.569+0000 7f73b70e2180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:18:54.660 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:54.657+0000 7f73b70e2180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:18:54.781 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:54.779+0000 7f4ae8e01180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:18:54.841 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:54.839+0000 7f4ae8e01180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:18:54.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:54.849+0000 7f83f77fe640 1 -- 172.21.15.55:0/2502046788 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 81) v1 ==== 84690+0+0 (secure 0 0 0) 0x7f83f00edf30 con 0x7f84000b59f0 2023-08-25T05:18:54.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:54.849+0000 7f83f77fe640 1 -- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f83e00657f0 msgr2=0x7f83e0067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:18:54.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:54.849+0000 7f83f77fe640 1 --2- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:6832/4256905777,v1:172.21.15.110:6833/4256905777] conn(0x7f83e00657f0 0x7f83e0067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:54.973 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:54.971+0000 7f4a6ec26640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:54.973 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:54.971+0000 7f4a6ec26640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:54.973 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:54.971+0000 7f4a6ec26640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:54.974 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:54.971+0000 7f4a6ec26640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:54.974 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:54.971+0000 7f4a6ec26640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:54.974 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:54.971+0000 7f4a6bc20640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:54.974 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:54.971+0000 7f4a6bc20640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:54.974 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:54.971+0000 7f4a6bc20640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:54.974 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:54.971+0000 7f4a6bc20640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:54.974 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:54.971+0000 7f4a6bc20640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:18:55.010 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:55.005+0000 7f73b70e2180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:18:55.074 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:55.069+0000 7f73b70e2180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:18:55.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:55.857+0000 7f83f77fe640 1 -- 172.21.15.55:0/2502046788 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 82) v1 ==== 84817+0+0 (secure 0 0 0) 0x7f83f00ef640 con 0x7f84000b59f0 2023-08-25T05:18:55.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:55.857+0000 7f83f77fe640 1 --2- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f83e0033910 0x7f83e006fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:55.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:55.857+0000 7f83f77fe640 1 -- 172.21.15.55:0/2502046788 --> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f83e0033cf0 con 0x7f83e0033910 2023-08-25T05:18:55.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:55.857+0000 7f83f7fff640 1 --2- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f83e0033910 0x7f83e006fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:55.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:55.865+0000 7f83f7fff640 1 --2- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f83e0033910 0x7f83e006fcd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f84000c7e30 tx=0x7f83e8007d40 comp rx=0 tx=0).ready entity=mgr.9064 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:55.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:55.929+0000 7f83f77fe640 1 -- 172.21.15.55:0/2502046788 <== mgr.9064 v2:172.21.15.110:6832/3704357441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f83e0033cf0 con 0x7f83e0033910 2023-08-25T05:18:55.933 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path snap_test_dir1 2023-08-25T05:18:55.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:55.933+0000 7f8405434640 1 -- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f83e0033910 msgr2=0x7f83e006fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:55.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:55.933+0000 7f8405434640 1 --2- 172.21.15.55:0/2502046788 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f83e0033910 0x7f83e006fcd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f84000c7e30 tx=0x7f83e8007d40 comp rx=0 tx=0).stop 2023-08-25T05:18:55.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:55.933+0000 7f8405434640 1 -- 172.21.15.55:0/2502046788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84000b59f0 msgr2=0x7f840015ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:55.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:55.933+0000 7f8405434640 1 --2- 172.21.15.55:0/2502046788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84000b59f0 0x7f840015ba30 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f83f00097f0 tx=0x7f83f001ba50 comp rx=0 tx=0).stop 2023-08-25T05:18:55.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:55.933+0000 7f83ff7fe640 1 -- 172.21.15.55:0/2502046788 reap_dead start 2023-08-25T05:18:55.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:55.933+0000 7f8405434640 1 -- 172.21.15.55:0/2502046788 shutdown_connections 2023-08-25T05:18:55.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:55.933+0000 7f8405434640 1 -- 172.21.15.55:0/2502046788 >> 172.21.15.55:0/2502046788 conn(0x7f840006aae0 msgr2=0x7f84000c9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:55.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:55.933+0000 7f8405434640 1 -- 172.21.15.55:0/2502046788 shutdown_connections 2023-08-25T05:18:55.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:55.933+0000 7f8405434640 1 -- 172.21.15.55:0/2502046788 wait complete. 2023-08-25T05:18:55.957 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-25T05:18:55.957 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-25T05:18:56.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.105+0000 7f21a6d74640 1 Processor -- start 2023-08-25T05:18:56.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.105+0000 7f21a6d74640 1 -- start start 2023-08-25T05:18:56.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.105+0000 7f21a6d74640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21a00cf340 0x7f21a00cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.105+0000 7f21a6d74640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f21a00b59f0 0x7f21a00b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.105+0000 7f21a6d74640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a00d1970 con 0x7f21a015cb40 2023-08-25T05:18:56.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.105+0000 7f21a6d74640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a00d2790 con 0x7f21a00b59f0 2023-08-25T05:18:56.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.105+0000 7f21a6d74640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a00cfcc0 con 0x7f21a00cf340 2023-08-25T05:18:56.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.105+0000 7f21a4b10640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f21a015cb40 0x7f21a00d2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:47842/0 (socket says 172.21.15.55:47842) 2023-08-25T05:18:56.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.105+0000 7f21a4b10640 1 -- 172.21.15.55:0/4067591882 learned_addr learned my addr 172.21.15.55:0/4067591882 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:56.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.105+0000 7f219ffff640 1 --2- 172.21.15.55:0/4067591882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21a00cf340 0x7f21a00cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:56.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.105+0000 7f21a5311640 1 --2- 172.21.15.55:0/4067591882 >> v2:172.21.15.110:3300/0 conn(0x7f21a00b59f0 0x7f21a00b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:56.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.105+0000 7f219f7fe640 1 -- 172.21.15.55:0/4067591882 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115518210 0 0) 0x7f21a00d1970 con 0x7f21a015cb40 2023-08-25T05:18:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.105+0000 7f219f7fe640 1 -- 172.21.15.55:0/4067591882 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2190003530 con 0x7f21a015cb40 2023-08-25T05:18:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.105+0000 7f219ffff640 1 -- 172.21.15.55:0/4067591882 >> v2:172.21.15.110:3300/0 conn(0x7f21a00b59f0 msgr2=0x7f21a00b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.105+0000 7f219ffff640 1 --2- 172.21.15.55:0/4067591882 >> v2:172.21.15.110:3300/0 conn(0x7f21a00b59f0 0x7f21a00b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.105+0000 7f219ffff640 1 -- 172.21.15.55:0/4067591882 >> v1:172.21.15.110:6789/0 conn(0x7f21a015cb40 legacy=0x7f21a00d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.105+0000 7f219ffff640 1 -- 172.21.15.55:0/4067591882 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a00d0d80 con 0x7f21a00cf340 2023-08-25T05:18:56.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.105+0000 7f21a5311640 1 --2- 172.21.15.55:0/4067591882 >> v2:172.21.15.110:3300/0 conn(0x7f21a00b59f0 0x7f21a00b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:18:56.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.109+0000 7f219ffff640 1 --2- 172.21.15.55:0/4067591882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21a00cf340 0x7f21a00cf780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f218c0097c0 tx=0x7f218c01ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1903341d5e988456 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:56.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.109+0000 7f219f7fe640 1 -- 172.21.15.55:0/4067591882 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c0a8970 con 0x7f21a00cf340 2023-08-25T05:18:56.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.109+0000 7f219f7fe640 1 -- 172.21.15.55:0/4067591882 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c0a8ad0 con 0x7f21a00cf340 2023-08-25T05:18:56.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.109+0000 7f219f7fe640 1 -- 172.21.15.55:0/4067591882 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c0a8e40 con 0x7f21a00cf340 2023-08-25T05:18:56.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.109+0000 7f21a6d74640 1 -- 172.21.15.55:0/4067591882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21a00cf340 msgr2=0x7f21a00cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:56.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.109+0000 7f21a6d74640 1 --2- 172.21.15.55:0/4067591882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21a00cf340 0x7f21a00cf780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f218c0097c0 tx=0x7f218c01ec70 comp rx=0 tx=0).stop 2023-08-25T05:18:56.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.109+0000 7f21a6d74640 1 -- 172.21.15.55:0/4067591882 shutdown_connections 2023-08-25T05:18:56.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.109+0000 7f21a6d74640 1 --2- 172.21.15.55:0/4067591882 >> v2:172.21.15.110:3300/0 conn(0x7f21a00b59f0 0x7f21a00b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.109+0000 7f21a6d74640 1 --2- 172.21.15.55:0/4067591882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21a00cf340 0x7f21a00cf780 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.109+0000 7f21a6d74640 1 -- 172.21.15.55:0/4067591882 >> 172.21.15.55:0/4067591882 conn(0x7f21a006aae0 msgr2=0x7f21a006aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:56.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.109+0000 7f21a6d74640 1 -- 172.21.15.55:0/4067591882 shutdown_connections 2023-08-25T05:18:56.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.109+0000 7f21a6d74640 1 -- 172.21.15.55:0/4067591882 wait complete. 2023-08-25T05:18:56.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a6d74640 1 Processor -- start 2023-08-25T05:18:56.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a6d74640 1 -- start start 2023-08-25T05:18:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a6d74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21a00b59f0 0x7f21a01f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a6d74640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21a00cf340 0x7f21a0159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a6d74640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21a015cb40 0x7f21a015a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a6d74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a01f6700 con 0x7f21a00b59f0 2023-08-25T05:18:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a6d74640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a01e70c0 con 0x7f21a015cb40 2023-08-25T05:18:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a6d74640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a00c8580 con 0x7f21a00cf340 2023-08-25T05:18:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a4b10640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21a00b59f0 0x7f21a01f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a4b10640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21a00b59f0 0x7f21a01f61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46222/0 (socket says 172.21.15.55:46222) 2023-08-25T05:18:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a4b10640 1 -- 172.21.15.55:0/3221438858 learned_addr learned my addr 172.21.15.55:0/3221438858 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:56.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f219ffff640 1 --2- 172.21.15.55:0/3221438858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21a00cf340 0x7f21a0159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:56.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a5311640 1 --2- 172.21.15.55:0/3221438858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21a015cb40 0x7f21a015a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:56.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a4b10640 1 -- 172.21.15.55:0/3221438858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21a00cf340 msgr2=0x7f21a0159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:56.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a4b10640 1 --2- 172.21.15.55:0/3221438858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21a00cf340 0x7f21a0159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a4b10640 1 -- 172.21.15.55:0/3221438858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21a015cb40 msgr2=0x7f21a015a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:56.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a4b10640 1 --2- 172.21.15.55:0/3221438858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21a015cb40 0x7f21a015a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a4b10640 1 -- 172.21.15.55:0/3221438858 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2198009a70 con 0x7f21a00b59f0 2023-08-25T05:18:56.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f219ffff640 1 --2- 172.21.15.55:0/3221438858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21a00cf340 0x7f21a0159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:18:56.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a5311640 1 --2- 172.21.15.55:0/3221438858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21a015cb40 0x7f21a015a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:18:56.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.113+0000 7f21a4b10640 1 --2- 172.21.15.55:0/3221438858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21a00b59f0 0x7f21a01f61c0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f219400c420 tx=0x7f219400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:56.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.117+0000 7f219d7fa640 1 -- 172.21.15.55:0/3221438858 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2194005cf0 con 0x7f21a00b59f0 2023-08-25T05:18:56.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.117+0000 7f219d7fa640 1 -- 172.21.15.55:0/3221438858 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2194005e50 con 0x7f21a00b59f0 2023-08-25T05:18:56.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.117+0000 7f219d7fa640 1 -- 172.21.15.55:0/3221438858 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21940072d0 con 0x7f21a00b59f0 2023-08-25T05:18:56.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.117+0000 7f21a6d74640 1 -- 172.21.15.55:0/3221438858 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f218c009420 con 0x7f21a00b59f0 2023-08-25T05:18:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.117+0000 7f21a6d74640 1 -- 172.21.15.55:0/3221438858 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a00c8b40 con 0x7f21a00b59f0 2023-08-25T05:18:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.117+0000 7f21a6d74640 1 -- 172.21.15.55:0/3221438858 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a0071f80 con 0x7f21a00b59f0 2023-08-25T05:18:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.117+0000 7f219d7fa640 1 -- 172.21.15.55:0/3221438858 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 82) v1 ==== 84817+0+0 (secure 0 0 0) 0x7f2194007430 con 0x7f21a00b59f0 2023-08-25T05:18:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.117+0000 7f219d7fa640 1 --2- 172.21.15.55:0/3221438858 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f2184065520 0x7f21840679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.117+0000 7f219d7fa640 1 -- 172.21.15.55:0/3221438858 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f21940821b0 con 0x7f21a00b59f0 2023-08-25T05:18:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.117+0000 7f219ffff640 1 --2- 172.21.15.55:0/3221438858 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f2184065520 0x7f21840679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.117+0000 7f219ffff640 1 --2- 172.21.15.55:0/3221438858 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f2184065520 0x7f21840679e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f218c0b2000 tx=0x7f218c008040 comp rx=0 tx=0).ready entity=mgr.9064 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:56.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.121+0000 7f219d7fa640 1 -- 172.21.15.55:0/3221438858 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f219404fe30 con 0x7f21a00b59f0 2023-08-25T05:18:56.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.297+0000 7f21a6d74640 1 -- 172.21.15.55:0/3221438858 --> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f21a00d1040 con 0x7f2184065520 2023-08-25T05:18:56.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.361+0000 7f219d7fa640 1 -- 172.21.15.55:0/3221438858 <== mgr.9064 v2:172.21.15.110:6832/3704357441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f218c0c10c0 con 0x7f2184065520 2023-08-25T05:18:56.364 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path snap_test_dir1 2023-08-25T05:18:56.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.361+0000 7f21a6d74640 1 -- 172.21.15.55:0/3221438858 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f2184065520 msgr2=0x7f21840679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:56.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.361+0000 7f21a6d74640 1 --2- 172.21.15.55:0/3221438858 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f2184065520 0x7f21840679e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f218c0b2000 tx=0x7f218c008040 comp rx=0 tx=0).stop 2023-08-25T05:18:56.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.361+0000 7f21a6d74640 1 -- 172.21.15.55:0/3221438858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21a00b59f0 msgr2=0x7f21a01f61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:56.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.361+0000 7f21a6d74640 1 --2- 172.21.15.55:0/3221438858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21a00b59f0 0x7f21a01f61c0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f219400c420 tx=0x7f219400c820 comp rx=0 tx=0).stop 2023-08-25T05:18:56.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.361+0000 7f21a6d74640 1 -- 172.21.15.55:0/3221438858 shutdown_connections 2023-08-25T05:18:56.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.361+0000 7f21a6d74640 1 --2- 172.21.15.55:0/3221438858 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f2184065520 0x7f21840679e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.361+0000 7f21a6d74640 1 --2- 172.21.15.55:0/3221438858 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21a015cb40 0x7f21a015a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.361+0000 7f21a6d74640 1 --2- 172.21.15.55:0/3221438858 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21a00cf340 0x7f21a0159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.361+0000 7f21a6d74640 1 --2- 172.21.15.55:0/3221438858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21a00b59f0 0x7f21a01f61c0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.361+0000 7f21a6d74640 1 -- 172.21.15.55:0/3221438858 >> 172.21.15.55:0/3221438858 conn(0x7f21a006aae0 msgr2=0x7f21a015bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:56.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.361+0000 7f21a6d74640 1 -- 172.21.15.55:0/3221438858 shutdown_connections 2023-08-25T05:18:56.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.361+0000 7f21a6d74640 1 -- 172.21.15.55:0/3221438858 wait complete. 2023-08-25T05:18:56.385 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-25T05:18:56.385 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-08-25T05:18:56.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.529+0000 7fa190a9c640 1 Processor -- start 2023-08-25T05:18:56.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.529+0000 7fa190a9c640 1 -- start start 2023-08-25T05:18:56.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.529+0000 7fa190a9c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa18c155360 0x7fa18c15c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.529+0000 7fa190a9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa18c155740 0x7fa18c15eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.529+0000 7fa190a9c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa18c06fb50 0x7fa18c0aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.529+0000 7fa190a9c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18c15fa50 con 0x7fa18c06fb50 2023-08-25T05:18:56.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.529+0000 7fa190a9c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18c15f490 con 0x7fa18c155360 2023-08-25T05:18:56.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.529+0000 7fa190a9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c15f770 con 0x7fa18c155740 2023-08-25T05:18:56.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.529+0000 7fa18ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa18c06fb50 0x7fa18c0aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:56.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.529+0000 7fa18ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa18c06fb50 0x7fa18c0aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46230/0 (socket says 172.21.15.55:46230) 2023-08-25T05:18:56.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.529+0000 7fa18ad9d640 1 -- 172.21.15.55:0/2066444589 learned_addr learned my addr 172.21.15.55:0/2066444589 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:56.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.529+0000 7fa183fff640 1 --2- 172.21.15.55:0/2066444589 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa18c155740 0x7fa18c15eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:56.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.529+0000 7fa18a59c640 1 --2- 172.21.15.55:0/2066444589 >> v2:172.21.15.110:3300/0 conn(0x7fa18c155360 0x7fa18c15c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:56.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.529+0000 7fa18ad9d640 1 -- 172.21.15.55:0/2066444589 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa18c155740 msgr2=0x7fa18c15eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:56.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.529+0000 7fa18ad9d640 1 --2- 172.21.15.55:0/2066444589 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa18c155740 0x7fa18c15eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.533+0000 7fa18ad9d640 1 -- 172.21.15.55:0/2066444589 >> v2:172.21.15.110:3300/0 conn(0x7fa18c155360 msgr2=0x7fa18c15c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:56.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.533+0000 7fa18ad9d640 1 --2- 172.21.15.55:0/2066444589 >> v2:172.21.15.110:3300/0 conn(0x7fa18c155360 0x7fa18c15c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.533+0000 7fa18ad9d640 1 -- 172.21.15.55:0/2066444589 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c0ccb40 con 0x7fa18c06fb50 2023-08-25T05:18:56.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.533+0000 7fa18ad9d640 1 --2- 172.21.15.55:0/2066444589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa18c06fb50 0x7fa18c0aff90 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fa18c06eca0 tx=0x7fa18401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475a338a4873d3ad server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:56.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.533+0000 7fa189d9b640 1 -- 172.21.15.55:0/2066444589 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1840a5530 con 0x7fa18c06fb50 2023-08-25T05:18:56.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.533+0000 7fa189d9b640 1 -- 172.21.15.55:0/2066444589 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1840a5690 con 0x7fa18c06fb50 2023-08-25T05:18:56.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.533+0000 7fa189d9b640 1 -- 172.21.15.55:0/2066444589 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1840a5a20 con 0x7fa18c06fb50 2023-08-25T05:18:56.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.533+0000 7fa190a9c640 1 -- 172.21.15.55:0/2066444589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa18c06fb50 msgr2=0x7fa18c0aff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:56.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.533+0000 7fa190a9c640 1 --2- 172.21.15.55:0/2066444589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa18c06fb50 0x7fa18c0aff90 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fa18c06eca0 tx=0x7fa18401c8b0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.533+0000 7fa190a9c640 1 -- 172.21.15.55:0/2066444589 shutdown_connections 2023-08-25T05:18:56.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.533+0000 7fa190a9c640 1 --2- 172.21.15.55:0/2066444589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa18c06fb50 0x7fa18c0aff90 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.533+0000 7fa190a9c640 1 --2- 172.21.15.55:0/2066444589 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa18c155740 0x7fa18c15eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.533+0000 7fa190a9c640 1 --2- 172.21.15.55:0/2066444589 >> v2:172.21.15.110:3300/0 conn(0x7fa18c155360 0x7fa18c15c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.533+0000 7fa190a9c640 1 -- 172.21.15.55:0/2066444589 >> 172.21.15.55:0/2066444589 conn(0x7fa18c0caf90 msgr2=0x7fa18c0cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:56.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.533+0000 7fa190a9c640 1 -- 172.21.15.55:0/2066444589 shutdown_connections 2023-08-25T05:18:56.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.533+0000 7fa190a9c640 1 -- 172.21.15.55:0/2066444589 wait complete. 2023-08-25T05:18:56.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa190a9c640 1 Processor -- start 2023-08-25T05:18:56.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa190a9c640 1 -- start start 2023-08-25T05:18:56.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa190a9c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa18c06fb50 0x7fa18c1657a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa190a9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa18c155360 0x7fa18c1f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa190a9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa18c155740 0x7fa18c0c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa190a9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c161780 con 0x7fa18c155360 2023-08-25T05:18:56.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa190a9c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c1f5940 con 0x7fa18c06fb50 2023-08-25T05:18:56.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa190a9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c1606e0 con 0x7fa18c155740 2023-08-25T05:18:56.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa183fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa18c155360 0x7fa18c1f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:56.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa183fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa18c155360 0x7fa18c1f5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46236/0 (socket says 172.21.15.55:46236) 2023-08-25T05:18:56.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa183fff640 1 -- 172.21.15.55:0/1913522832 learned_addr learned my addr 172.21.15.55:0/1913522832 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:56.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa18a59c640 1 --2- 172.21.15.55:0/1913522832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa18c06fb50 0x7fa18c1657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:56.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa18ad9d640 1 --2- 172.21.15.55:0/1913522832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa18c155740 0x7fa18c0c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:56.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa183fff640 1 -- 172.21.15.55:0/1913522832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa18c155740 msgr2=0x7fa18c0c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:56.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa183fff640 1 --2- 172.21.15.55:0/1913522832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa18c155740 0x7fa18c0c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa183fff640 1 -- 172.21.15.55:0/1913522832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa18c06fb50 msgr2=0x7fa18c1657a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:56.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa183fff640 1 --2- 172.21.15.55:0/1913522832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa18c06fb50 0x7fa18c1657a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa183fff640 1 -- 172.21.15.55:0/1913522832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa184009b30 con 0x7fa18c155360 2023-08-25T05:18:56.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa18ad9d640 1 --2- 172.21.15.55:0/1913522832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa18c155740 0x7fa18c0c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:56.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.537+0000 7fa183fff640 1 --2- 172.21.15.55:0/1913522832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa18c155360 0x7fa18c1f5400 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fa17400e930 tx=0x7fa17400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:56.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.541+0000 7fa182ffd640 1 -- 172.21.15.55:0/1913522832 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174009690 con 0x7fa18c155360 2023-08-25T05:18:56.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.541+0000 7fa182ffd640 1 -- 172.21.15.55:0/1913522832 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17400ca00 con 0x7fa18c155360 2023-08-25T05:18:56.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.541+0000 7fa182ffd640 1 -- 172.21.15.55:0/1913522832 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17400cdb0 con 0x7fa18c155360 2023-08-25T05:18:56.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.541+0000 7fa190a9c640 1 -- 172.21.15.55:0/1913522832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18c1609c0 con 0x7fa18c155360 2023-08-25T05:18:56.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.541+0000 7fa190a9c640 1 -- 172.21.15.55:0/1913522832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18c160f80 con 0x7fa18c155360 2023-08-25T05:18:56.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.541+0000 7fa190a9c640 1 -- 172.21.15.55:0/1913522832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa18c04dbe0 con 0x7fa18c155360 2023-08-25T05:18:56.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.541+0000 7fa182ffd640 1 -- 172.21.15.55:0/1913522832 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 82) v1 ==== 84817+0+0 (secure 0 0 0) 0x7fa174013470 con 0x7fa18c155360 2023-08-25T05:18:56.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.541+0000 7fa182ffd640 1 --2- 172.21.15.55:0/1913522832 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fa16c065520 0x7fa16c0679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.541+0000 7fa182ffd640 1 -- 172.21.15.55:0/1913522832 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fa174082f00 con 0x7fa18c155360 2023-08-25T05:18:56.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.541+0000 7fa18a59c640 1 --2- 172.21.15.55:0/1913522832 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fa16c065520 0x7fa16c0679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:56.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.545+0000 7fa18a59c640 1 --2- 172.21.15.55:0/1913522832 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fa16c065520 0x7fa16c0679e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa17c009ae0 tx=0x7fa17c009190 comp rx=0 tx=0).ready entity=mgr.9064 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:56.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.545+0000 7fa182ffd640 1 -- 172.21.15.55:0/1913522832 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa174050c40 con 0x7fa18c155360 2023-08-25T05:18:56.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.721+0000 7fa190a9c640 1 -- 172.21.15.55:0/1913522832 --> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa18c0b08e0 con 0x7fa16c065520 2023-08-25T05:18:56.731 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:56.731+0000 7f4a75c34640 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-08-25T05:18:56.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.729+0000 7fa182ffd640 1 -- 172.21.15.55:0/1913522832 <== mgr.9064 v2:172.21.15.110:6832/3704357441 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fa17c011a00 con 0x7fa16c065520 2023-08-25T05:18:56.733 INFO:teuthology.orchestra.run.smithi055.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-08-25T05:18:56.740 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-08-25T05:18:56.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:18:56.741 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-25T05:18:56.753 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-25T05:18:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.945+0000 7f38cae19640 1 Processor -- start 2023-08-25T05:18:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.945+0000 7f38cae19640 1 -- start start 2023-08-25T05:18:56.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.945+0000 7f38cae19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38c40c9830 0x7f38c409bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.945+0000 7f38cae19640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38c406c020 0x7f38c40acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.945+0000 7f38cae19640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c415abd0 con 0x7f38c415a7f0 2023-08-25T05:18:56.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.945+0000 7f38cae19640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c40c8ab0 con 0x7f38c406c020 2023-08-25T05:18:56.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.945+0000 7f38cae19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c40c8d50 con 0x7f38c40c9830 2023-08-25T05:18:56.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.949+0000 7f38c93b6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f38c406c020 0x7f38c40acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:56.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.949+0000 7f38c8bb5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f38c415a7f0 0x7f38c4070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45054/0 (socket says 172.21.15.55:45054) 2023-08-25T05:18:56.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.949+0000 7f38c8bb5640 1 -- 172.21.15.55:0/1447507596 learned_addr learned my addr 172.21.15.55:0/1447507596 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:56.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.949+0000 7f38c3fff640 1 --2- 172.21.15.55:0/1447507596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38c40c9830 0x7f38c409bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:56.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.949+0000 7f38c93b6640 1 -- 172.21.15.55:0/1447507596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38c40c9830 msgr2=0x7f38c409bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:56.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.949+0000 7f38c93b6640 1 --2- 172.21.15.55:0/1447507596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38c40c9830 0x7f38c409bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.949+0000 7f38c37fe640 1 -- 172.21.15.55:0/1447507596 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474990978 0 0) 0x7f38c415abd0 con 0x7f38c415a7f0 2023-08-25T05:18:56.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.949+0000 7f38c93b6640 1 -- 172.21.15.55:0/1447507596 >> v1:172.21.15.55:6789/0 conn(0x7f38c415a7f0 legacy=0x7f38c4070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:56.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.949+0000 7f38c93b6640 1 -- 172.21.15.55:0/1447507596 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c40c9030 con 0x7f38c406c020 2023-08-25T05:18:56.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.949+0000 7f38c3fff640 1 --2- 172.21.15.55:0/1447507596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38c40c9830 0x7f38c409bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:56.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.949+0000 7f38c93b6640 1 --2- 172.21.15.55:0/1447507596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c406c020 0x7f38c40acff0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009d90 tx=0x7f38bc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb4e1a7b9c4a1ed server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:56.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.949+0000 7f38c37fe640 1 -- 172.21.15.55:0/1447507596 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc0a58f0 con 0x7f38c406c020 2023-08-25T05:18:56.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.949+0000 7f38c37fe640 1 -- 172.21.15.55:0/1447507596 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc0a5a50 con 0x7f38c406c020 2023-08-25T05:18:56.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.949+0000 7f38c37fe640 1 -- 172.21.15.55:0/1447507596 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc0a5de0 con 0x7f38c406c020 2023-08-25T05:18:56.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38cae19640 1 -- 172.21.15.55:0/1447507596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c406c020 msgr2=0x7f38c40acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:56.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38cae19640 1 --2- 172.21.15.55:0/1447507596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c406c020 0x7f38c40acff0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009d90 tx=0x7f38bc01c920 comp rx=0 tx=0).stop 2023-08-25T05:18:56.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38cae19640 1 -- 172.21.15.55:0/1447507596 shutdown_connections 2023-08-25T05:18:56.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38cae19640 1 --2- 172.21.15.55:0/1447507596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38c40c9830 0x7f38c409bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38cae19640 1 --2- 172.21.15.55:0/1447507596 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c406c020 0x7f38c40acff0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38cae19640 1 -- 172.21.15.55:0/1447507596 >> 172.21.15.55:0/1447507596 conn(0x7f38c4069900 msgr2=0x7f38c4069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:56.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38cae19640 1 -- 172.21.15.55:0/1447507596 shutdown_connections 2023-08-25T05:18:56.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38cae19640 1 -- 172.21.15.55:0/1447507596 wait complete. 2023-08-25T05:18:56.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38cae19640 1 Processor -- start 2023-08-25T05:18:56.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38cae19640 1 -- start start 2023-08-25T05:18:56.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38cae19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c406c020 0x7f38c4152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38cae19640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38c40c9830 0x7f38c40b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38cae19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38c415a7f0 0x7f38c4152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38cae19640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c4152590 con 0x7f38c406c020 2023-08-25T05:18:56.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38cae19640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c4158f20 con 0x7f38c40c9830 2023-08-25T05:18:56.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38cae19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c4158c40 con 0x7f38c415a7f0 2023-08-25T05:18:56.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38c8bb5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c406c020 0x7f38c4152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:56.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38c8bb5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c406c020 0x7f38c4152760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46260/0 (socket says 172.21.15.55:46260) 2023-08-25T05:18:56.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38c8bb5640 1 -- 172.21.15.55:0/2552331624 learned_addr learned my addr 172.21.15.55:0/2552331624 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:56.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38c8bb5640 1 -- 172.21.15.55:0/2552331624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38c415a7f0 msgr2=0x7f38c4152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:56.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38c8bb5640 1 --2- 172.21.15.55:0/2552331624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38c415a7f0 0x7f38c4152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38c8bb5640 1 -- 172.21.15.55:0/2552331624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38c40c9830 msgr2=0x7f38c40b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:56.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38c8bb5640 1 --2- 172.21.15.55:0/2552331624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38c40c9830 0x7f38c40b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:56.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38c8bb5640 1 -- 172.21.15.55:0/2552331624 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc009a70 con 0x7f38c406c020 2023-08-25T05:18:56.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.953+0000 7f38c8bb5640 1 --2- 172.21.15.55:0/2552331624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c406c020 0x7f38c4152760 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f38b800c430 tx=0x7f38b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:56.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.957+0000 7f38c17fa640 1 -- 172.21.15.55:0/2552331624 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b80074e0 con 0x7f38c406c020 2023-08-25T05:18:56.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.957+0000 7f38c17fa640 1 -- 172.21.15.55:0/2552331624 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b8007640 con 0x7f38c406c020 2023-08-25T05:18:56.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.957+0000 7f38c17fa640 1 -- 172.21.15.55:0/2552331624 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b80059d0 con 0x7f38c406c020 2023-08-25T05:18:56.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.957+0000 7f38cae19640 1 -- 172.21.15.55:0/2552331624 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c4153830 con 0x7f38c406c020 2023-08-25T05:18:56.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.957+0000 7f38cae19640 1 -- 172.21.15.55:0/2552331624 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c4153df0 con 0x7f38c406c020 2023-08-25T05:18:56.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.957+0000 7f38cae19640 1 -- 172.21.15.55:0/2552331624 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c406d5b0 con 0x7f38c406c020 2023-08-25T05:18:56.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.957+0000 7f38c17fa640 1 -- 172.21.15.55:0/2552331624 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 83) v1 ==== 85082+0+0 (secure 0 0 0) 0x7f38b8005b30 con 0x7f38c406c020 2023-08-25T05:18:56.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.957+0000 7f38c17fa640 1 --2- 172.21.15.55:0/2552331624 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f38a8065820 0x7f38a8067ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:56.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.957+0000 7f38c17fa640 1 -- 172.21.15.55:0/2552331624 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f38b8082810 con 0x7f38c406c020 2023-08-25T05:18:56.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.957+0000 7f38c3fff640 1 --2- 172.21.15.55:0/2552331624 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f38a8065820 0x7f38a8067ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:56.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.961+0000 7f38c3fff640 1 --2- 172.21.15.55:0/2552331624 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f38a8065820 0x7f38a8067ce0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f38b0006f10 tx=0x7f38b0008040 comp rx=0 tx=0).ready entity=mgr.9064 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:56.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:56.961+0000 7f38c17fa640 1 -- 172.21.15.55:0/2552331624 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f38b8050080 con 0x7f38c406c020 2023-08-25T05:18:57.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:57.153+0000 7f38cae19640 1 -- 172.21.15.55:0/2552331624 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f38c4073ec0 con 0x7f38c406c020 2023-08-25T05:18:57.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:57.917+0000 7f38c17fa640 1 -- 172.21.15.55:0/2552331624 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 84) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f38b8050450 con 0x7f38c406c020 2023-08-25T05:18:57.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:57.917+0000 7f38c17fa640 1 -- 172.21.15.55:0/2552331624 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v84) v1 ==== 93+0+0 (secure 0 0 0) 0x7f38b8051e80 con 0x7f38c406c020 2023-08-25T05:18:57.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:57.921+0000 7f38cae19640 1 -- 172.21.15.55:0/2552331624 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f38a8065820 msgr2=0x7f38a8067ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:57.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:57.921+0000 7f38cae19640 1 --2- 172.21.15.55:0/2552331624 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f38a8065820 0x7f38a8067ce0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f38b0006f10 tx=0x7f38b0008040 comp rx=0 tx=0).stop 2023-08-25T05:18:57.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:57.921+0000 7f38cae19640 1 -- 172.21.15.55:0/2552331624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c406c020 msgr2=0x7f38c4152760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:57.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:57.921+0000 7f38cae19640 1 --2- 172.21.15.55:0/2552331624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c406c020 0x7f38c4152760 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f38b800c430 tx=0x7f38b800c8f0 comp rx=0 tx=0).stop 2023-08-25T05:18:57.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:57.921+0000 7f38cae19640 1 -- 172.21.15.55:0/2552331624 shutdown_connections 2023-08-25T05:18:57.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:57.921+0000 7f38cae19640 1 --2- 172.21.15.55:0/2552331624 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f38a8065820 0x7f38a8067ce0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:57.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:57.921+0000 7f38cae19640 1 --2- 172.21.15.55:0/2552331624 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f38c415a7f0 0x7f38c4152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:57.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:57.921+0000 7f38cae19640 1 --2- 172.21.15.55:0/2552331624 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f38c40c9830 0x7f38c40b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:57.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:57.921+0000 7f38cae19640 1 --2- 172.21.15.55:0/2552331624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38c406c020 0x7f38c4152760 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:57.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:57.921+0000 7f38cae19640 1 -- 172.21.15.55:0/2552331624 >> 172.21.15.55:0/2552331624 conn(0x7f38c4069900 msgr2=0x7f38c4069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:57.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:57.921+0000 7f38cae19640 1 -- 172.21.15.55:0/2552331624 shutdown_connections 2023-08-25T05:18:57.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:57.921+0000 7f38cae19640 1 -- 172.21.15.55:0/2552331624 wait complete. 2023-08-25T05:18:57.948 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T05:18:57.948 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T05:18:58.006 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T05:18:58.072 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T05:18:58.073 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:18:58.073 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:18:58.082 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:18:58.082 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:18:58.101 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:58.099+0000 7f2bf6348180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:18:58.102 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:58.097+0000 7f1e0a570180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:18:58.110 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:18:58.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.297+0000 7fba695a3640 1 Processor -- start 2023-08-25T05:18:58.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.297+0000 7fba695a3640 1 -- start start 2023-08-25T05:18:58.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.297+0000 7fba695a3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fba640d0da0 0x7fba640d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:58.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.297+0000 7fba695a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba640cdde0 0x7fba640ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:58.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.297+0000 7fba695a3640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba640b29b0 con 0x7fba640cee60 2023-08-25T05:18:58.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.297+0000 7fba695a3640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba640ce760 con 0x7fba640d0da0 2023-08-25T05:18:58.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.297+0000 7fba695a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba640d16c0 con 0x7fba640cdde0 2023-08-25T05:18:58.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.297+0000 7fba62ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fba640d0da0 0x7fba640d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:58.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.297+0000 7fba5a7fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba640cdde0 0x7fba640ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:58.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.297+0000 7fba637fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fba640cee60 0x7fba640cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:47854/0 (socket says 172.21.15.55:47854) 2023-08-25T05:18:58.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.297+0000 7fba5a7fc640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba640cdde0 0x7fba640ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:54178/0 (socket says 172.21.15.55:54178) 2023-08-25T05:18:58.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.297+0000 7fba62ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fba640d0da0 0x7fba640d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:54370/0 (socket says 172.21.15.55:54370) 2023-08-25T05:18:58.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.297+0000 7fba637fe640 1 -- 172.21.15.55:0/1180167186 learned_addr learned my addr 172.21.15.55:0/1180167186 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:58.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.297+0000 7fba5a7fc640 1 -- 172.21.15.55:0/1180167186 >> v2:172.21.15.110:3300/0 conn(0x7fba640d0da0 msgr2=0x7fba640d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:58.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.297+0000 7fba5a7fc640 1 --2- 172.21.15.55:0/1180167186 >> v2:172.21.15.110:3300/0 conn(0x7fba640d0da0 0x7fba640d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:58.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.297+0000 7fba5a7fc640 1 -- 172.21.15.55:0/1180167186 >> v1:172.21.15.110:6789/0 conn(0x7fba640cee60 legacy=0x7fba640cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:58.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.297+0000 7fba5a7fc640 1 -- 172.21.15.55:0/1180167186 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba640b1dc0 con 0x7fba640cdde0 2023-08-25T05:18:58.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.297+0000 7fba62ffd640 1 --2- 172.21.15.55:0/1180167186 >> v2:172.21.15.110:3300/0 conn(0x7fba640d0da0 0x7fba640d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:18:58.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.301+0000 7fba5a7fc640 1 --2- 172.21.15.55:0/1180167186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba640cdde0 0x7fba640ce220 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fba4c009d90 tx=0x7fba4c01f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76b016c96a9174bc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:58.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.301+0000 7fba627fc640 1 -- 172.21.15.55:0/1180167186 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0af600 con 0x7fba640cdde0 2023-08-25T05:18:58.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.301+0000 7fba627fc640 1 -- 172.21.15.55:0/1180167186 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c0ab050 con 0x7fba640cdde0 2023-08-25T05:18:58.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.301+0000 7fba627fc640 1 -- 172.21.15.55:0/1180167186 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0af980 con 0x7fba640cdde0 2023-08-25T05:18:58.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.301+0000 7fba695a3640 1 -- 172.21.15.55:0/1180167186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba640cdde0 msgr2=0x7fba640ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:58.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.301+0000 7fba695a3640 1 --2- 172.21.15.55:0/1180167186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba640cdde0 0x7fba640ce220 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fba4c009d90 tx=0x7fba4c01f130 comp rx=0 tx=0).stop 2023-08-25T05:18:58.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.301+0000 7fba695a3640 1 -- 172.21.15.55:0/1180167186 shutdown_connections 2023-08-25T05:18:58.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.301+0000 7fba695a3640 1 --2- 172.21.15.55:0/1180167186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba640cdde0 0x7fba640ce220 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:58.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.301+0000 7fba695a3640 1 --2- 172.21.15.55:0/1180167186 >> v2:172.21.15.110:3300/0 conn(0x7fba640d0da0 0x7fba640d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:58.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.301+0000 7fba695a3640 1 -- 172.21.15.55:0/1180167186 >> 172.21.15.55:0/1180167186 conn(0x7fba6409bae0 msgr2=0x7fba640d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:58.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.301+0000 7fba695a3640 1 -- 172.21.15.55:0/1180167186 shutdown_connections 2023-08-25T05:18:58.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.301+0000 7fba695a3640 1 -- 172.21.15.55:0/1180167186 wait complete. 2023-08-25T05:18:58.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba695a3640 1 Processor -- start 2023-08-25T05:18:58.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba695a3640 1 -- start start 2023-08-25T05:18:58.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba695a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba640cdde0 0x7fba641fa340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:58.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba695a3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba640cee60 0x7fba641f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:58.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba695a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba640d0da0 0x7fba641f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:58.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba695a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba641fa880 con 0x7fba640d0da0 2023-08-25T05:18:58.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba695a3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba641f72b0 con 0x7fba640cee60 2023-08-25T05:18:58.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba695a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba641f6730 con 0x7fba640cdde0 2023-08-25T05:18:58.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba637fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba640d0da0 0x7fba641f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:58.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba62ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba640cdde0 0x7fba641fa340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:58.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba637fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba640d0da0 0x7fba641f60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46284/0 (socket says 172.21.15.55:46284) 2023-08-25T05:18:58.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba5a7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba640cee60 0x7fba641f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:58.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba62ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba640cdde0 0x7fba641fa340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:54180/0 (socket says 172.21.15.55:54180) 2023-08-25T05:18:58.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba637fe640 1 -- 172.21.15.55:0/1515860361 learned_addr learned my addr 172.21.15.55:0/1515860361 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:58.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba62ffd640 1 -- 172.21.15.55:0/1515860361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba640cee60 msgr2=0x7fba641f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:58.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba62ffd640 1 --2- 172.21.15.55:0/1515860361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba640cee60 0x7fba641f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:58.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba62ffd640 1 -- 172.21.15.55:0/1515860361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba640d0da0 msgr2=0x7fba641f60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:58.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba62ffd640 1 --2- 172.21.15.55:0/1515860361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba640d0da0 0x7fba641f60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:58.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba62ffd640 1 -- 172.21.15.55:0/1515860361 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba540093b0 con 0x7fba640cdde0 2023-08-25T05:18:58.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba62ffd640 1 --2- 172.21.15.55:0/1515860361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba640cdde0 0x7fba641fa340 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fba5400e870 tx=0x7fba5400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:58.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba5bfff640 1 -- 172.21.15.55:0/1515860361 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba540059a0 con 0x7fba640cdde0 2023-08-25T05:18:58.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba5bfff640 1 -- 172.21.15.55:0/1515860361 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba54005b00 con 0x7fba640cdde0 2023-08-25T05:18:58.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba695a3640 1 -- 172.21.15.55:0/1515860361 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4c009a70 con 0x7fba640cdde0 2023-08-25T05:18:58.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.305+0000 7fba5bfff640 1 -- 172.21.15.55:0/1515860361 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5400c940 con 0x7fba640cdde0 2023-08-25T05:18:58.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.309+0000 7fba695a3640 1 -- 172.21.15.55:0/1515860361 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba641f6cf0 con 0x7fba640cdde0 2023-08-25T05:18:58.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.309+0000 7fba695a3640 1 -- 172.21.15.55:0/1515860361 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6404dbe0 con 0x7fba640cdde0 2023-08-25T05:18:58.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.309+0000 7fba5bfff640 1 -- 172.21.15.55:0/1515860361 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 84) v1 ==== 85065+0+0 (secure 0 0 0) 0x7fba5400caa0 con 0x7fba640cdde0 2023-08-25T05:18:58.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.309+0000 7fba5bfff640 1 --2- 172.21.15.55:0/1515860361 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fba440657a0 0x7fba44067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:58.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.309+0000 7fba5bfff640 1 -- 172.21.15.55:0/1515860361 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fba540833b0 con 0x7fba640cdde0 2023-08-25T05:18:58.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.309+0000 7fba5a7fc640 1 -- 172.21.15.55:0/1515860361 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fba440657a0 msgr2=0x7fba44067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3704357441 2023-08-25T05:18:58.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.309+0000 7fba5a7fc640 1 --2- 172.21.15.55:0/1515860361 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fba440657a0 0x7fba44067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:18:58.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.313+0000 7fba5bfff640 1 -- 172.21.15.55:0/1515860361 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fba54050ca0 con 0x7fba640cdde0 2023-08-25T05:18:58.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.473+0000 7fba695a3640 1 -- 172.21.15.55:0/1515860361 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba6415eb20 con 0x7fba640cdde0 2023-08-25T05:18:58.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.473+0000 7fba5bfff640 1 -- 172.21.15.55:0/1515860361 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+18829 (secure 0 0 0) 0x7fba540542c0 con 0x7fba640cdde0 2023-08-25T05:18:58.478 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:18:58.478 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":158,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:18:54.845594+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:18:40.053897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-25T05:18:41.441905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3176170740":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/3759935208":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/2816190802":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/978380102":"2023-08-26T05:18:54.845562+0000","172.21.15.110:6833/4256905777":"2023-08-26T05:18:54.845562+0000","172.21.15.110:6832/4256905777":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/1948062482":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/2661104133":"2023-08-26T05:18:54.845562+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:18:58.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.477+0000 7fba695a3640 1 -- 172.21.15.55:0/1515860361 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fba440657a0 msgr2=0x7fba44067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:18:58.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.477+0000 7fba695a3640 1 --2- 172.21.15.55:0/1515860361 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fba440657a0 0x7fba44067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:58.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.477+0000 7fba695a3640 1 -- 172.21.15.55:0/1515860361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba640cdde0 msgr2=0x7fba641fa340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:58.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.477+0000 7fba695a3640 1 --2- 172.21.15.55:0/1515860361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba640cdde0 0x7fba641fa340 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fba5400e870 tx=0x7fba5400ed30 comp rx=0 tx=0).stop 2023-08-25T05:18:58.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.477+0000 7fba695a3640 1 -- 172.21.15.55:0/1515860361 shutdown_connections 2023-08-25T05:18:58.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.477+0000 7fba695a3640 1 --2- 172.21.15.55:0/1515860361 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fba440657a0 0x7fba44067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:58.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.477+0000 7fba695a3640 1 --2- 172.21.15.55:0/1515860361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba640d0da0 0x7fba641f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:58.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.477+0000 7fba695a3640 1 --2- 172.21.15.55:0/1515860361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba640cee60 0x7fba641f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:58.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.477+0000 7fba695a3640 1 --2- 172.21.15.55:0/1515860361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba640cdde0 0x7fba641fa340 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:58.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.477+0000 7fba695a3640 1 -- 172.21.15.55:0/1515860361 >> 172.21.15.55:0/1515860361 conn(0x7fba6409bae0 msgr2=0x7fba640cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:58.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.477+0000 7fba695a3640 1 -- 172.21.15.55:0/1515860361 shutdown_connections 2023-08-25T05:18:58.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.477+0000 7fba695a3640 1 -- 172.21.15.55:0/1515860361 wait complete. 2023-08-25T05:18:58.506 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T05:18:40.053897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '156', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T05:18:41.441905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T05:18:58.507 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T05:18:58.518 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:58.519+0000 7f2bf6348180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:18:58.557 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:58.553+0000 7f1e0a570180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:18:58.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.653+0000 7fc1da66d640 1 Processor -- start 2023-08-25T05:18:58.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.653+0000 7fc1da66d640 1 -- start start 2023-08-25T05:18:58.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.657+0000 7fc1da66d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc1d41601f0 0x7fc1d415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:58.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.657+0000 7fc1da66d640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d40cd5a0 con 0x7fc1d40d1290 2023-08-25T05:18:58.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.657+0000 7fc1da66d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d40cd880 con 0x7fc1d415e3c0 2023-08-25T05:18:58.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.657+0000 7fc1da66d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1d40cdb60 con 0x7fc1d41601f0 2023-08-25T05:18:58.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.657+0000 7fc1d8c0a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc1d40d1290 0x7fc1d415e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45080/0 (socket says 172.21.15.55:45080) 2023-08-25T05:18:58.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.657+0000 7fc1d8c0a640 1 -- 172.21.15.55:0/1408485471 learned_addr learned my addr 172.21.15.55:0/1408485471 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:58.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.657+0000 7fc1d3fff640 1 --2- 172.21.15.55:0/1408485471 >> v2:172.21.15.110:3300/0 conn(0x7fc1d41601f0 0x7fc1d415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:58.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.657+0000 7fc1d2ffd640 1 -- 172.21.15.55:0/1408485471 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458435655 0 0) 0x7fc1d40cd5a0 con 0x7fc1d40d1290 2023-08-25T05:18:58.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.657+0000 7fc1d2ffd640 1 -- 172.21.15.55:0/1408485471 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1bc003530 con 0x7fc1d40d1290 2023-08-25T05:18:58.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.657+0000 7fc1d2ffd640 1 -- 172.21.15.55:0/1408485471 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634823881 0 0) 0x7fc1d40cd880 con 0x7fc1d415e3c0 2023-08-25T05:18:58.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.657+0000 7fc1d2ffd640 1 -- 172.21.15.55:0/1408485471 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1d40cd5a0 con 0x7fc1d415e3c0 2023-08-25T05:18:58.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.657+0000 7fc1d3fff640 1 -- 172.21.15.55:0/1408485471 >> v1:172.21.15.110:6789/0 conn(0x7fc1d415e3c0 legacy=0x7fc1d40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:58.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.657+0000 7fc1d3fff640 1 -- 172.21.15.55:0/1408485471 >> v1:172.21.15.55:6789/0 conn(0x7fc1d40d1290 legacy=0x7fc1d415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:58.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.657+0000 7fc1d3fff640 1 -- 172.21.15.55:0/1408485471 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d40cde40 con 0x7fc1d41601f0 2023-08-25T05:18:58.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1d3fff640 1 --2- 172.21.15.55:0/1408485471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d41601f0 0x7fc1d415d430 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40097a0 tx=0x7fc1c401c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0e8939926c4b7e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:58.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1d2ffd640 1 -- 172.21.15.55:0/1408485471 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4004230 con 0x7fc1d41601f0 2023-08-25T05:18:58.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1d2ffd640 1 -- 172.21.15.55:0/1408485471 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c40a7050 con 0x7fc1d41601f0 2023-08-25T05:18:58.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1d2ffd640 1 -- 172.21.15.55:0/1408485471 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4003620 con 0x7fc1d41601f0 2023-08-25T05:18:58.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1da66d640 1 -- 172.21.15.55:0/1408485471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d41601f0 msgr2=0x7fc1d415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:58.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1da66d640 1 --2- 172.21.15.55:0/1408485471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d41601f0 0x7fc1d415d430 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40097a0 tx=0x7fc1c401c430 comp rx=0 tx=0).stop 2023-08-25T05:18:58.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1da66d640 1 -- 172.21.15.55:0/1408485471 shutdown_connections 2023-08-25T05:18:58.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1da66d640 1 --2- 172.21.15.55:0/1408485471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d41601f0 0x7fc1d415d430 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1da66d640 1 -- 172.21.15.55:0/1408485471 >> 172.21.15.55:0/1408485471 conn(0x7fc1d40d27d0 msgr2=0x7fc1d40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1da66d640 1 -- 172.21.15.55:0/1408485471 shutdown_connections 2023-08-25T05:18:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1da66d640 1 -- 172.21.15.55:0/1408485471 wait complete. 2023-08-25T05:18:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1da66d640 1 Processor -- start 2023-08-25T05:18:58.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1da66d640 1 -- start start 2023-08-25T05:18:58.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1da66d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1d40d1290 0x7fc1d40cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:58.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1da66d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d415e3c0 0x7fc1d40b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:58.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1da66d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1d41601f0 0x7fc1d406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:58.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1da66d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d40cc080 con 0x7fc1d41601f0 2023-08-25T05:18:58.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1da66d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d40b62b0 con 0x7fc1d415e3c0 2023-08-25T05:18:58.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.661+0000 7fc1da66d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d40b6590 con 0x7fc1d40d1290 2023-08-25T05:18:58.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.665+0000 7fc1d8c0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1d41601f0 0x7fc1d406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:58.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.665+0000 7fc1d37fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d415e3c0 0x7fc1d40b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.665+0000 7fc1d3fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1d40d1290 0x7fc1d40cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.665+0000 7fc1d8c0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1d41601f0 0x7fc1d406bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46290/0 (socket says 172.21.15.55:46290) 2023-08-25T05:18:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.665+0000 7fc1d8c0a640 1 -- 172.21.15.55:0/3362798140 learned_addr learned my addr 172.21.15.55:0/3362798140 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.665+0000 7fc1d8c0a640 1 -- 172.21.15.55:0/3362798140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1d40d1290 msgr2=0x7fc1d40cbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.665+0000 7fc1d8c0a640 1 --2- 172.21.15.55:0/3362798140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1d40d1290 0x7fc1d40cbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.665+0000 7fc1d8c0a640 1 -- 172.21.15.55:0/3362798140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d415e3c0 msgr2=0x7fc1d40b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:58.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.665+0000 7fc1d8c0a640 1 --2- 172.21.15.55:0/3362798140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d415e3c0 0x7fc1d40b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.665+0000 7fc1d8c0a640 1 -- 172.21.15.55:0/3362798140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c40093b0 con 0x7fc1d41601f0 2023-08-25T05:18:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.665+0000 7fc1d37fe640 1 --2- 172.21.15.55:0/3362798140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d415e3c0 0x7fc1d40b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:18:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.665+0000 7fc1d8c0a640 1 --2- 172.21.15.55:0/3362798140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1d41601f0 0x7fc1d406bbb0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00cb40 tx=0x7fc1cc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.665+0000 7fc1d0ff9640 1 -- 172.21.15.55:0/3362798140 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc00aca0 con 0x7fc1d41601f0 2023-08-25T05:18:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.665+0000 7fc1d0ff9640 1 -- 172.21.15.55:0/3362798140 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc00ae00 con 0x7fc1d41601f0 2023-08-25T05:18:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.665+0000 7fc1d0ff9640 1 -- 172.21.15.55:0/3362798140 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc012600 con 0x7fc1d41601f0 2023-08-25T05:18:58.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.665+0000 7fc1da66d640 1 -- 172.21.15.55:0/3362798140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d40cb340 con 0x7fc1d41601f0 2023-08-25T05:18:58.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.665+0000 7fc1da66d640 1 -- 172.21.15.55:0/3362798140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d40b5ef0 con 0x7fc1d41601f0 2023-08-25T05:18:58.671 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:58.667+0000 7f2bf6348180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:18:58.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.665+0000 7fc1da66d640 1 -- 172.21.15.55:0/3362798140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d40b5260 con 0x7fc1d41601f0 2023-08-25T05:18:58.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.669+0000 7fc1d0ff9640 1 -- 172.21.15.55:0/3362798140 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 84) v1 ==== 85065+0+0 (secure 0 0 0) 0x7fc1cc007070 con 0x7fc1d41601f0 2023-08-25T05:18:58.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.669+0000 7fc1d0ff9640 1 --2- 172.21.15.55:0/3362798140 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fc1c00657a0 0x7fc1c0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:58.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.669+0000 7fc1d0ff9640 1 -- 172.21.15.55:0/3362798140 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fc1cc0830d0 con 0x7fc1d41601f0 2023-08-25T05:18:58.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.669+0000 7fc1d3fff640 1 -- 172.21.15.55:0/3362798140 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fc1c00657a0 msgr2=0x7fc1c0067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3704357441 2023-08-25T05:18:58.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.669+0000 7fc1d3fff640 1 --2- 172.21.15.55:0/3362798140 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fc1c00657a0 0x7fc1c0067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:18:58.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.673+0000 7fc1d0ff9640 1 -- 172.21.15.55:0/3362798140 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc1cc0508b0 con 0x7fc1d41601f0 2023-08-25T05:18:58.720 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:58.717+0000 7f1e0a570180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:18:58.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.829+0000 7fc1da66d640 1 -- 172.21.15.55:0/3362798140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1d40cb1a0 con 0x7fc1d41601f0 2023-08-25T05:18:58.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.829+0000 7fc1d0ff9640 1 -- 172.21.15.55:0/3362798140 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v158) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1d40cb1a0 con 0x7fc1d41601f0 2023-08-25T05:18:58.835 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T05:18:58.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.833+0000 7fc1da66d640 1 -- 172.21.15.55:0/3362798140 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fc1c00657a0 msgr2=0x7fc1c0067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:18:58.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.833+0000 7fc1da66d640 1 --2- 172.21.15.55:0/3362798140 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fc1c00657a0 0x7fc1c0067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:58.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.833+0000 7fc1da66d640 1 -- 172.21.15.55:0/3362798140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1d41601f0 msgr2=0x7fc1d406bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:58.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.833+0000 7fc1da66d640 1 --2- 172.21.15.55:0/3362798140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1d41601f0 0x7fc1d406bbb0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00cb40 tx=0x7fc1cc00a060 comp rx=0 tx=0).stop 2023-08-25T05:18:58.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.833+0000 7fc1da66d640 1 -- 172.21.15.55:0/3362798140 shutdown_connections 2023-08-25T05:18:58.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.833+0000 7fc1da66d640 1 --2- 172.21.15.55:0/3362798140 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fc1c00657a0 0x7fc1c0067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:58.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.833+0000 7fc1da66d640 1 --2- 172.21.15.55:0/3362798140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1d41601f0 0x7fc1d406bbb0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:58.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.833+0000 7fc1da66d640 1 --2- 172.21.15.55:0/3362798140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1d415e3c0 0x7fc1d40b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:58.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.833+0000 7fc1da66d640 1 --2- 172.21.15.55:0/3362798140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1d40d1290 0x7fc1d40cbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:58.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.833+0000 7fc1da66d640 1 -- 172.21.15.55:0/3362798140 >> 172.21.15.55:0/3362798140 conn(0x7fc1d40d27d0 msgr2=0x7fc1d40d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:58.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.833+0000 7fc1da66d640 1 -- 172.21.15.55:0/3362798140 shutdown_connections 2023-08-25T05:18:58.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:58.833+0000 7fc1da66d640 1 -- 172.21.15.55:0/3362798140 wait complete. 2023-08-25T05:18:58.857 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T05:18:59.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.045+0000 7f35ed9ba640 1 Processor -- start 2023-08-25T05:18:59.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.045+0000 7f35ed9ba640 1 -- start start 2023-08-25T05:18:59.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.045+0000 7f35ed9ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f35e815a7f0 0x7f35e809bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.045+0000 7f35ed9ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e806c020 0x7f35e80acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.045+0000 7f35ed9ba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e815abd0 con 0x7f35e80c9830 2023-08-25T05:18:59.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.045+0000 7f35ed9ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e80c8ab0 con 0x7f35e815a7f0 2023-08-25T05:18:59.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.045+0000 7f35ed9ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e80c8d50 con 0x7f35e806c020 2023-08-25T05:18:59.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.045+0000 7f35dffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f35e80c9830 0x7f35e8070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45082/0 (socket says 172.21.15.55:45082) 2023-08-25T05:18:59.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.045+0000 7f35dffff640 1 -- 172.21.15.55:0/3145043096 learned_addr learned my addr 172.21.15.55:0/3145043096 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:59.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.045+0000 7f35e6ffd640 1 --2- 172.21.15.55:0/3145043096 >> v2:172.21.15.110:3300/0 conn(0x7f35e815a7f0 0x7f35e809bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:59.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.045+0000 7f35e77fe640 1 --2- 172.21.15.55:0/3145043096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e806c020 0x7f35e80acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:59.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.045+0000 7f35e67fc640 1 -- 172.21.15.55:0/3145043096 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077383234 0 0) 0x7f35e815abd0 con 0x7f35e80c9830 2023-08-25T05:18:59.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.045+0000 7f35e67fc640 1 -- 172.21.15.55:0/3145043096 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35d4003530 con 0x7f35e80c9830 2023-08-25T05:18:59.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.045+0000 7f35e6ffd640 1 -- 172.21.15.55:0/3145043096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e806c020 msgr2=0x7f35e80acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:59.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.049+0000 7f35e6ffd640 1 --2- 172.21.15.55:0/3145043096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e806c020 0x7f35e80acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.049+0000 7f35e6ffd640 1 -- 172.21.15.55:0/3145043096 >> v1:172.21.15.55:6789/0 conn(0x7f35e80c9830 legacy=0x7f35e8070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:59.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.049+0000 7f35e6ffd640 1 -- 172.21.15.55:0/3145043096 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e80c9030 con 0x7f35e815a7f0 2023-08-25T05:18:59.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.049+0000 7f35e77fe640 1 --2- 172.21.15.55:0/3145043096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e806c020 0x7f35e80acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:18:59.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.049+0000 7f35e6ffd640 1 --2- 172.21.15.55:0/3145043096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e815a7f0 0x7f35e809bde0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f35d80097a0 tx=0x7f35d801c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8745f2fee5931103 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:59.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.049+0000 7f35e67fc640 1 -- 172.21.15.55:0/3145043096 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d80ab600 con 0x7f35e815a7f0 2023-08-25T05:18:59.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.049+0000 7f35e67fc640 1 -- 172.21.15.55:0/3145043096 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d80a7050 con 0x7f35e815a7f0 2023-08-25T05:18:59.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.049+0000 7f35e67fc640 1 -- 172.21.15.55:0/3145043096 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d80ab980 con 0x7f35e815a7f0 2023-08-25T05:18:59.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.049+0000 7f35ed9ba640 1 -- 172.21.15.55:0/3145043096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e815a7f0 msgr2=0x7f35e809bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:59.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.049+0000 7f35ed9ba640 1 --2- 172.21.15.55:0/3145043096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e815a7f0 0x7f35e809bde0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f35d80097a0 tx=0x7f35d801c430 comp rx=0 tx=0).stop 2023-08-25T05:18:59.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35ed9ba640 1 -- 172.21.15.55:0/3145043096 shutdown_connections 2023-08-25T05:18:59.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35ed9ba640 1 --2- 172.21.15.55:0/3145043096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e806c020 0x7f35e80acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35ed9ba640 1 --2- 172.21.15.55:0/3145043096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e815a7f0 0x7f35e809bde0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35ed9ba640 1 -- 172.21.15.55:0/3145043096 >> 172.21.15.55:0/3145043096 conn(0x7f35e8069900 msgr2=0x7f35e8069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:59.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35ed9ba640 1 -- 172.21.15.55:0/3145043096 shutdown_connections 2023-08-25T05:18:59.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35ed9ba640 1 -- 172.21.15.55:0/3145043096 wait complete. 2023-08-25T05:18:59.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35ed9ba640 1 Processor -- start 2023-08-25T05:18:59.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35ed9ba640 1 -- start start 2023-08-25T05:18:59.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35ed9ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e806c020 0x7f35e814ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35ed9ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e80c9830 0x7f35e8153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35ed9ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e815a7f0 0x7f35e814f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35ed9ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e80c76c0 con 0x7f35e80c9830 2023-08-25T05:18:59.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35ed9ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e80c79a0 con 0x7f35e815a7f0 2023-08-25T05:18:59.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35ed9ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e80c7c80 con 0x7f35e806c020 2023-08-25T05:18:59.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e80c9830 0x7f35e8153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:59.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35e77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e815a7f0 0x7f35e814f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:59.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e80c9830 0x7f35e8153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46302/0 (socket says 172.21.15.55:46302) 2023-08-25T05:18:59.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35e6ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e806c020 0x7f35e814ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:59.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35dffff640 1 -- 172.21.15.55:0/3439264416 learned_addr learned my addr 172.21.15.55:0/3439264416 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:59.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35e77fe640 1 -- 172.21.15.55:0/3439264416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e806c020 msgr2=0x7f35e814ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:59.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35e77fe640 1 --2- 172.21.15.55:0/3439264416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e806c020 0x7f35e814ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35e77fe640 1 -- 172.21.15.55:0/3439264416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e80c9830 msgr2=0x7f35e8153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:59.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35e77fe640 1 --2- 172.21.15.55:0/3439264416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e80c9830 0x7f35e8153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35e77fe640 1 -- 172.21.15.55:0/3439264416 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e0009a70 con 0x7f35e815a7f0 2023-08-25T05:18:59.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35e6ffd640 1 --2- 172.21.15.55:0/3439264416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e806c020 0x7f35e814ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:18:59.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.053+0000 7f35dffff640 1 --2- 172.21.15.55:0/3439264416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e80c9830 0x7f35e8153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:18:59.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.057+0000 7f35e77fe640 1 --2- 172.21.15.55:0/3439264416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e815a7f0 0x7f35e814f650 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f35e80afe60 tx=0x7f35e000ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:59.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.057+0000 7f35e4ff9640 1 -- 172.21.15.55:0/3439264416 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e000cc90 con 0x7f35e815a7f0 2023-08-25T05:18:59.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.057+0000 7f35e4ff9640 1 -- 172.21.15.55:0/3439264416 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e000f040 con 0x7f35e815a7f0 2023-08-25T05:18:59.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.057+0000 7f35ed9ba640 1 -- 172.21.15.55:0/3439264416 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d80093b0 con 0x7f35e815a7f0 2023-08-25T05:18:59.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.057+0000 7f35e4ff9640 1 -- 172.21.15.55:0/3439264416 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e0003be0 con 0x7f35e815a7f0 2023-08-25T05:18:59.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.057+0000 7f35ed9ba640 1 -- 172.21.15.55:0/3439264416 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e814f3c0 con 0x7f35e815a7f0 2023-08-25T05:18:59.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.057+0000 7f35ed9ba640 1 -- 172.21.15.55:0/3439264416 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e806d5b0 con 0x7f35e815a7f0 2023-08-25T05:18:59.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.057+0000 7f35e4ff9640 1 -- 172.21.15.55:0/3439264416 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 84) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f35e0014480 con 0x7f35e815a7f0 2023-08-25T05:18:59.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.057+0000 7f35e4ff9640 1 --2- 172.21.15.55:0/3439264416 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f35c80657a0 0x7f35c8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.057+0000 7f35e4ff9640 1 -- 172.21.15.55:0/3439264416 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f35e0083bc0 con 0x7f35e815a7f0 2023-08-25T05:18:59.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.057+0000 7f35e6ffd640 1 -- 172.21.15.55:0/3439264416 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f35c80657a0 msgr2=0x7f35c8067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3704357441 2023-08-25T05:18:59.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.057+0000 7f35e6ffd640 1 --2- 172.21.15.55:0/3439264416 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f35c80657a0 0x7f35c8067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:18:59.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.061+0000 7f35e4ff9640 1 -- 172.21.15.55:0/3439264416 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f35e0054e30 con 0x7f35e815a7f0 2023-08-25T05:18:59.153 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:59.151+0000 7f2bf6348180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:18:59.210 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:59.211+0000 7f2bf6348180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:18:59.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.221+0000 7f35ed9ba640 1 -- 172.21.15.55:0/3439264416 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f35e80c7ae0 con 0x7f35e815a7f0 2023-08-25T05:18:59.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.221+0000 7f35e4ff9640 1 -- 172.21.15.55:0/3439264416 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v158) v1 ==== 92+0+10 (secure 0 0 0) 0x7f35e80c7ae0 con 0x7f35e815a7f0 2023-08-25T05:18:59.227 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T05:18:59.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.225+0000 7f35ed9ba640 1 -- 172.21.15.55:0/3439264416 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f35c80657a0 msgr2=0x7f35c8067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:18:59.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.225+0000 7f35ed9ba640 1 --2- 172.21.15.55:0/3439264416 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f35c80657a0 0x7f35c8067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.225+0000 7f35ed9ba640 1 -- 172.21.15.55:0/3439264416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e815a7f0 msgr2=0x7f35e814f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:59.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.225+0000 7f35ed9ba640 1 --2- 172.21.15.55:0/3439264416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e815a7f0 0x7f35e814f650 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f35e80afe60 tx=0x7f35e000ef90 comp rx=0 tx=0).stop 2023-08-25T05:18:59.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.225+0000 7f35ed9ba640 1 -- 172.21.15.55:0/3439264416 shutdown_connections 2023-08-25T05:18:59.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.225+0000 7f35ed9ba640 1 --2- 172.21.15.55:0/3439264416 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f35c80657a0 0x7f35c8067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.225+0000 7f35ed9ba640 1 --2- 172.21.15.55:0/3439264416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e815a7f0 0x7f35e814f650 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.225+0000 7f35ed9ba640 1 --2- 172.21.15.55:0/3439264416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35e80c9830 0x7f35e8153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.225+0000 7f35ed9ba640 1 --2- 172.21.15.55:0/3439264416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e806c020 0x7f35e814ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.225+0000 7f35ed9ba640 1 -- 172.21.15.55:0/3439264416 >> 172.21.15.55:0/3439264416 conn(0x7f35e8069900 msgr2=0x7f35e80ab5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:59.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.225+0000 7f35ed9ba640 1 -- 172.21.15.55:0/3439264416 shutdown_connections 2023-08-25T05:18:59.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.225+0000 7f35ed9ba640 1 -- 172.21.15.55:0/3439264416 wait complete. 2023-08-25T05:18:59.241 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:59.237+0000 7f1e0a570180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:18:59.249 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T05:18:59.266 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:59.267+0000 7f2bf6348180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:18:59.305 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:59.301+0000 7f1e0a570180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:18:59.350 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:59.351+0000 7f2bf6348180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:18:59.365 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:59.361+0000 7f1e0a570180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:18:59.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.393+0000 7f6755ee5640 1 Processor -- start 2023-08-25T05:18:59.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.393+0000 7f6755ee5640 1 -- start start 2023-08-25T05:18:59.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.397+0000 7f6755ee5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f67501601f0 0x7f675015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.397+0000 7f6755ee5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f675015e3c0 0x7f67500d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.397+0000 7f6755ee5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675015f8b0 con 0x7f67500d10c0 2023-08-25T05:18:59.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.397+0000 7f6755ee5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67500cd5a0 con 0x7f67501601f0 2023-08-25T05:18:59.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.397+0000 7f6755ee5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67500cd880 con 0x7f675015e3c0 2023-08-25T05:18:59.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.397+0000 7f6747fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f675015e3c0 0x7f67500d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:59.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.397+0000 7f674f7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f67501601f0 0x7f675015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:59.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.397+0000 7f674ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f67500d10c0 0x7f67500b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45096/0 (socket says 172.21.15.55:45096) 2023-08-25T05:18:59.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.397+0000 7f674ffff640 1 -- 172.21.15.55:0/3999313180 learned_addr learned my addr 172.21.15.55:0/3999313180 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:18:59.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.397+0000 7f6747fff640 1 -- 172.21.15.55:0/3999313180 >> v2:172.21.15.110:3300/0 conn(0x7f67501601f0 msgr2=0x7f675015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:59.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.397+0000 7f6747fff640 1 --2- 172.21.15.55:0/3999313180 >> v2:172.21.15.110:3300/0 conn(0x7f67501601f0 0x7f675015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.397+0000 7f6747fff640 1 -- 172.21.15.55:0/3999313180 >> v1:172.21.15.55:6789/0 conn(0x7f67500d10c0 legacy=0x7f67500b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:59.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.397+0000 7f6747fff640 1 -- 172.21.15.55:0/3999313180 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67500cdb60 con 0x7f675015e3c0 2023-08-25T05:18:59.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.397+0000 7f674effd640 1 -- 172.21.15.55:0/3999313180 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554505104 0 0) 0x7f675015f8b0 con 0x7f67500d10c0 2023-08-25T05:18:59.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.397+0000 7f674f7fe640 1 --2- 172.21.15.55:0/3999313180 >> v2:172.21.15.110:3300/0 conn(0x7f67501601f0 0x7f675015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:18:59.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.401+0000 7f6747fff640 1 --2- 172.21.15.55:0/3999313180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f675015e3c0 0x7f67500d0b80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f67380097c0 tx=0x7f673801ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e80422572ec83246 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:59.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.401+0000 7f674effd640 1 -- 172.21.15.55:0/3999313180 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67380a8970 con 0x7f675015e3c0 2023-08-25T05:18:59.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.401+0000 7f674effd640 1 -- 172.21.15.55:0/3999313180 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67380a8ad0 con 0x7f675015e3c0 2023-08-25T05:18:59.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.401+0000 7f674effd640 1 -- 172.21.15.55:0/3999313180 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67380a8e60 con 0x7f675015e3c0 2023-08-25T05:18:59.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.401+0000 7f6755ee5640 1 -- 172.21.15.55:0/3999313180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f675015e3c0 msgr2=0x7f67500d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:59.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.401+0000 7f6755ee5640 1 --2- 172.21.15.55:0/3999313180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f675015e3c0 0x7f67500d0b80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f67380097c0 tx=0x7f673801ec70 comp rx=0 tx=0).stop 2023-08-25T05:18:59.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.401+0000 7f6755ee5640 1 -- 172.21.15.55:0/3999313180 shutdown_connections 2023-08-25T05:18:59.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.401+0000 7f6755ee5640 1 --2- 172.21.15.55:0/3999313180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f675015e3c0 0x7f67500d0b80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.401+0000 7f6755ee5640 1 --2- 172.21.15.55:0/3999313180 >> v2:172.21.15.110:3300/0 conn(0x7f67501601f0 0x7f675015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.401+0000 7f6755ee5640 1 -- 172.21.15.55:0/3999313180 >> 172.21.15.55:0/3999313180 conn(0x7f67500d27d0 msgr2=0x7f67500d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:59.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.401+0000 7f6755ee5640 1 -- 172.21.15.55:0/3999313180 shutdown_connections 2023-08-25T05:18:59.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.401+0000 7f6755ee5640 1 -- 172.21.15.55:0/3999313180 wait complete. 2023-08-25T05:18:59.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.401+0000 7f6755ee5640 1 Processor -- start 2023-08-25T05:18:59.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.401+0000 7f6755ee5640 1 -- start start 2023-08-25T05:18:59.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f6755ee5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67500d10c0 0x7f675009f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f6755ee5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f675015e3c0 0x7f67500cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f6755ee5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67501601f0 0x7f675015b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f6755ee5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67500cc7a0 con 0x7f67500d10c0 2023-08-25T05:18:59.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f6755ee5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675015b5d0 con 0x7f675015e3c0 2023-08-25T05:18:59.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f6755ee5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f675009f6d0 con 0x7f67501601f0 2023-08-25T05:18:59.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f674f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67500d10c0 0x7f675009f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:59.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f6747fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f675015e3c0 0x7f67500cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:59.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f674f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67500d10c0 0x7f675009f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46312/0 (socket says 172.21.15.55:46312) 2023-08-25T05:18:59.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f674f7fe640 1 -- 172.21.15.55:0/3142131279 learned_addr learned my addr 172.21.15.55:0/3142131279 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:59.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f674ffff640 1 --2- 172.21.15.55:0/3142131279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67501601f0 0x7f675015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:59.409 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:59.407+0000 7f2bf6348180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:18:59.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f674f7fe640 1 -- 172.21.15.55:0/3142131279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67501601f0 msgr2=0x7f675015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:59.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f674f7fe640 1 --2- 172.21.15.55:0/3142131279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67501601f0 0x7f675015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f674f7fe640 1 -- 172.21.15.55:0/3142131279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f675015e3c0 msgr2=0x7f67500cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:59.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f674f7fe640 1 --2- 172.21.15.55:0/3142131279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f675015e3c0 0x7f67500cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f674f7fe640 1 -- 172.21.15.55:0/3142131279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67400093b0 con 0x7f67500d10c0 2023-08-25T05:18:59.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f674ffff640 1 --2- 172.21.15.55:0/3142131279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67501601f0 0x7f675015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:18:59.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f674f7fe640 1 --2- 172.21.15.55:0/3142131279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67500d10c0 0x7f675009f040 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f674000e960 tx=0x7f674000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:59.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f674cff9640 1 -- 172.21.15.55:0/3142131279 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674000ca00 con 0x7f67500d10c0 2023-08-25T05:18:59.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f674cff9640 1 -- 172.21.15.55:0/3142131279 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674000cb60 con 0x7f67500d10c0 2023-08-25T05:18:59.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f6755ee5640 1 -- 172.21.15.55:0/3142131279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6738009420 con 0x7f67500d10c0 2023-08-25T05:18:59.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f674cff9640 1 -- 172.21.15.55:0/3142131279 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67400059a0 con 0x7f67500d10c0 2023-08-25T05:18:59.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f6755ee5640 1 -- 172.21.15.55:0/3142131279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675009fc90 con 0x7f67500d10c0 2023-08-25T05:18:59.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f6755ee5640 1 -- 172.21.15.55:0/3142131279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67500b5260 con 0x7f67500d10c0 2023-08-25T05:18:59.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.405+0000 7f674cff9640 1 -- 172.21.15.55:0/3142131279 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 84) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f6740005b00 con 0x7f67500d10c0 2023-08-25T05:18:59.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.409+0000 7f674cff9640 1 --2- 172.21.15.55:0/3142131279 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f67300657a0 0x7f6730067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.409+0000 7f674cff9640 1 -- 172.21.15.55:0/3142131279 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f6740083470 con 0x7f67500d10c0 2023-08-25T05:18:59.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.409+0000 7f6747fff640 1 -- 172.21.15.55:0/3142131279 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f67300657a0 msgr2=0x7f6730067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3704357441 2023-08-25T05:18:59.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.409+0000 7f6747fff640 1 --2- 172.21.15.55:0/3142131279 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f67300657a0 0x7f6730067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:18:59.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.413+0000 7f674cff9640 1 -- 172.21.15.55:0/3142131279 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6740050d60 con 0x7f67500d10c0 2023-08-25T05:18:59.460 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:59.457+0000 7f1e0a570180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:18:59.492 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:59.491+0000 7f2bf6348180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:18:59.520 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:59.517+0000 7f1e0a570180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:18:59.547 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:59.547+0000 7f2bf6348180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:18:59.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.569+0000 7f6755ee5640 1 -- 172.21.15.55:0/3142131279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6750073ec0 con 0x7f67500d10c0 2023-08-25T05:18:59.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.569+0000 7f674cff9640 1 -- 172.21.15.55:0/3142131279 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v158) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6740054380 con 0x7f67500d10c0 2023-08-25T05:18:59.571 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T05:18:59.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.569+0000 7f6755ee5640 1 -- 172.21.15.55:0/3142131279 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f67300657a0 msgr2=0x7f6730067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:18:59.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.569+0000 7f6755ee5640 1 --2- 172.21.15.55:0/3142131279 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f67300657a0 0x7f6730067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.569+0000 7f6755ee5640 1 -- 172.21.15.55:0/3142131279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67500d10c0 msgr2=0x7f675009f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:59.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.569+0000 7f6755ee5640 1 --2- 172.21.15.55:0/3142131279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67500d10c0 0x7f675009f040 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f674000e960 tx=0x7f674000ee20 comp rx=0 tx=0).stop 2023-08-25T05:18:59.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.569+0000 7f6755ee5640 1 -- 172.21.15.55:0/3142131279 shutdown_connections 2023-08-25T05:18:59.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.569+0000 7f6755ee5640 1 --2- 172.21.15.55:0/3142131279 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f67300657a0 0x7f6730067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.569+0000 7f6755ee5640 1 --2- 172.21.15.55:0/3142131279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67501601f0 0x7f675015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.569+0000 7f6755ee5640 1 --2- 172.21.15.55:0/3142131279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f675015e3c0 0x7f67500cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.569+0000 7f6755ee5640 1 --2- 172.21.15.55:0/3142131279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67500d10c0 0x7f675009f040 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.569+0000 7f6755ee5640 1 -- 172.21.15.55:0/3142131279 >> 172.21.15.55:0/3142131279 conn(0x7f67500d27d0 msgr2=0x7f67500cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:59.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.569+0000 7f6755ee5640 1 -- 172.21.15.55:0/3142131279 shutdown_connections 2023-08-25T05:18:59.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.569+0000 7f6755ee5640 1 -- 172.21.15.55:0/3142131279 wait complete. 2023-08-25T05:18:59.593 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T05:18:59.611 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:59.609+0000 7f1e0a570180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:18:59.672 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:59.669+0000 7f1e0a570180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:18:59.689 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:59.691+0000 7f2bf6348180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:18:59.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.737+0000 7f997d634640 1 Processor -- start 2023-08-25T05:18:59.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.737+0000 7f997d634640 1 -- start start 2023-08-25T05:18:59.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.741+0000 7f997d634640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99781601f0 0x7f997815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.741+0000 7f997d634640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f997815e3c0 0x7f99780d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.741+0000 7f997d634640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f99780d10c0 0x7f99780b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.741+0000 7f997d634640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99780cd5a0 con 0x7f997815e3c0 2023-08-25T05:18:59.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.741+0000 7f997d634640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99780cd880 con 0x7f99780d10c0 2023-08-25T05:18:59.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.741+0000 7f997d634640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99780cdb60 con 0x7f99781601f0 2023-08-25T05:18:59.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.741+0000 7f996ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f997815e3c0 0x7f99780d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:59.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.741+0000 7f996ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f997815e3c0 0x7f99780d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46324/0 (socket says 172.21.15.55:46324) 2023-08-25T05:18:59.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.741+0000 7f996ffff640 1 -- 172.21.15.55:0/1642370081 learned_addr learned my addr 172.21.15.55:0/1642370081 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:59.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.741+0000 7f99777fe640 1 --2- 172.21.15.55:0/1642370081 >> v2:172.21.15.110:3300/0 conn(0x7f99780d10c0 0x7f99780b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:59.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.741+0000 7f9976ffd640 1 --2- 172.21.15.55:0/1642370081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99781601f0 0x7f997815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:59.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.741+0000 7f996ffff640 1 -- 172.21.15.55:0/1642370081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99781601f0 msgr2=0x7f997815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:59.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.741+0000 7f996ffff640 1 --2- 172.21.15.55:0/1642370081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99781601f0 0x7f997815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.741+0000 7f996ffff640 1 -- 172.21.15.55:0/1642370081 >> v2:172.21.15.110:3300/0 conn(0x7f99780d10c0 msgr2=0x7f99780b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:18:59.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.741+0000 7f996ffff640 1 --2- 172.21.15.55:0/1642370081 >> v2:172.21.15.110:3300/0 conn(0x7f99780d10c0 0x7f99780b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.741+0000 7f996ffff640 1 -- 172.21.15.55:0/1642370081 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99780cde40 con 0x7f997815e3c0 2023-08-25T05:18:59.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.745+0000 7f996ffff640 1 --2- 172.21.15.55:0/1642370081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997815e3c0 0x7f99780d0b80 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f99780d0540 tx=0x7f996001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff59c936c21f1c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:59.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.745+0000 7f99767fc640 1 -- 172.21.15.55:0/1642370081 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99600a89b0 con 0x7f997815e3c0 2023-08-25T05:18:59.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.745+0000 7f99767fc640 1 -- 172.21.15.55:0/1642370081 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99600a8b10 con 0x7f997815e3c0 2023-08-25T05:18:59.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.745+0000 7f99767fc640 1 -- 172.21.15.55:0/1642370081 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99600a8ea0 con 0x7f997815e3c0 2023-08-25T05:18:59.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.745+0000 7f997d634640 1 -- 172.21.15.55:0/1642370081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997815e3c0 msgr2=0x7f99780d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:59.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.745+0000 7f997d634640 1 --2- 172.21.15.55:0/1642370081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997815e3c0 0x7f99780d0b80 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f99780d0540 tx=0x7f996001ecf0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.745+0000 7f997d634640 1 -- 172.21.15.55:0/1642370081 shutdown_connections 2023-08-25T05:18:59.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.745+0000 7f997d634640 1 --2- 172.21.15.55:0/1642370081 >> v2:172.21.15.110:3300/0 conn(0x7f99780d10c0 0x7f99780b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.745+0000 7f997d634640 1 --2- 172.21.15.55:0/1642370081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997815e3c0 0x7f99780d0b80 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.745+0000 7f997d634640 1 --2- 172.21.15.55:0/1642370081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99781601f0 0x7f997815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.745+0000 7f997d634640 1 -- 172.21.15.55:0/1642370081 >> 172.21.15.55:0/1642370081 conn(0x7f99780d27d0 msgr2=0x7f99780d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:59.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.745+0000 7f997d634640 1 -- 172.21.15.55:0/1642370081 shutdown_connections 2023-08-25T05:18:59.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.745+0000 7f997d634640 1 -- 172.21.15.55:0/1642370081 wait complete. 2023-08-25T05:18:59.749 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:59.747+0000 7f2bf6348180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:18:59.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.745+0000 7f997d634640 1 Processor -- start 2023-08-25T05:18:59.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.745+0000 7f997d634640 1 -- start start 2023-08-25T05:18:59.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f997d634640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99780d10c0 0x7f99780b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f997d634640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997815e3c0 0x7f9978158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f997d634640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99781601f0 0x7f99780cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f997d634640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99780cc200 con 0x7f997815e3c0 2023-08-25T05:18:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f997d634640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99780c6410 con 0x7f99780d10c0 2023-08-25T05:18:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f997d634640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99780c66f0 con 0x7f99781601f0 2023-08-25T05:18:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f996ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997815e3c0 0x7f9978158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f9976ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99780d10c0 0x7f99780b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f996ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997815e3c0 0x7f9978158e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46340/0 (socket says 172.21.15.55:46340) 2023-08-25T05:18:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f996ffff640 1 -- 172.21.15.55:0/3043070068 learned_addr learned my addr 172.21.15.55:0/3043070068 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:18:59.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f99777fe640 1 --2- 172.21.15.55:0/3043070068 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99781601f0 0x7f99780cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:18:59.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f996ffff640 1 -- 172.21.15.55:0/3043070068 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99781601f0 msgr2=0x7f99780cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:59.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f996ffff640 1 --2- 172.21.15.55:0/3043070068 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99781601f0 0x7f99780cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f996ffff640 1 -- 172.21.15.55:0/3043070068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99780d10c0 msgr2=0x7f99780b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:59.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f996ffff640 1 --2- 172.21.15.55:0/3043070068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99780d10c0 0x7f99780b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f996ffff640 1 -- 172.21.15.55:0/3043070068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99600094d0 con 0x7f997815e3c0 2023-08-25T05:18:59.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f996ffff640 1 --2- 172.21.15.55:0/3043070068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997815e3c0 0x7f9978158e60 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f996001d3a0 tx=0x7f996001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:18:59.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f996f7fe640 1 -- 172.21.15.55:0/3043070068 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99600b0d40 con 0x7f997815e3c0 2023-08-25T05:18:59.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f996f7fe640 1 -- 172.21.15.55:0/3043070068 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99600bb460 con 0x7f997815e3c0 2023-08-25T05:18:59.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f996f7fe640 1 -- 172.21.15.55:0/3043070068 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99600b0ea0 con 0x7f997815e3c0 2023-08-25T05:18:59.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f997d634640 1 -- 172.21.15.55:0/3043070068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99780ce7c0 con 0x7f997815e3c0 2023-08-25T05:18:59.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f997d634640 1 -- 172.21.15.55:0/3043070068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99780c6cb0 con 0x7f997815e3c0 2023-08-25T05:18:59.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.749+0000 7f997d634640 1 -- 172.21.15.55:0/3043070068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99780b5260 con 0x7f997815e3c0 2023-08-25T05:18:59.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.753+0000 7f996f7fe640 1 -- 172.21.15.55:0/3043070068 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 84) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f99600b83f0 con 0x7f997815e3c0 2023-08-25T05:18:59.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.753+0000 7f996f7fe640 1 --2- 172.21.15.55:0/3043070068 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f99580657a0 0x7f9958067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:18:59.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.753+0000 7f996f7fe640 1 -- 172.21.15.55:0/3043070068 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f9960120980 con 0x7f997815e3c0 2023-08-25T05:18:59.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.753+0000 7f9976ffd640 1 -- 172.21.15.55:0/3043070068 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f99580657a0 msgr2=0x7f9958067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3704357441 2023-08-25T05:18:59.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.753+0000 7f9976ffd640 1 --2- 172.21.15.55:0/3043070068 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f99580657a0 0x7f9958067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:18:59.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.757+0000 7f996f7fe640 1 -- 172.21.15.55:0/3043070068 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f99600ee1e0 con 0x7f997815e3c0 2023-08-25T05:18:59.827 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:59.825+0000 7f1e0a570180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:18:59.892 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:18:59.885+0000 7f1e0a570180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:18:59.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.913+0000 7f997d634640 1 -- 172.21.15.55:0/3043070068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9978073ec0 con 0x7f997815e3c0 2023-08-25T05:18:59.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.913+0000 7f996f7fe640 1 -- 172.21.15.55:0/3043070068 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v158) v1 ==== 100+0+11 (secure 0 0 0) 0x7f99600f1800 con 0x7f997815e3c0 2023-08-25T05:18:59.917 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T05:18:59.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.913+0000 7f997d634640 1 -- 172.21.15.55:0/3043070068 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f99580657a0 msgr2=0x7f9958067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:18:59.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.913+0000 7f997d634640 1 --2- 172.21.15.55:0/3043070068 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f99580657a0 0x7f9958067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.913+0000 7f997d634640 1 -- 172.21.15.55:0/3043070068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997815e3c0 msgr2=0x7f9978158e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:18:59.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.913+0000 7f997d634640 1 --2- 172.21.15.55:0/3043070068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997815e3c0 0x7f9978158e60 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f996001d3a0 tx=0x7f996001ba90 comp rx=0 tx=0).stop 2023-08-25T05:18:59.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.913+0000 7f997d634640 1 -- 172.21.15.55:0/3043070068 shutdown_connections 2023-08-25T05:18:59.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.913+0000 7f997d634640 1 --2- 172.21.15.55:0/3043070068 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f99580657a0 0x7f9958067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.913+0000 7f997d634640 1 --2- 172.21.15.55:0/3043070068 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99781601f0 0x7f99780cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.913+0000 7f997d634640 1 --2- 172.21.15.55:0/3043070068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997815e3c0 0x7f9978158e60 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.913+0000 7f997d634640 1 --2- 172.21.15.55:0/3043070068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99780d10c0 0x7f99780b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:18:59.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.913+0000 7f997d634640 1 -- 172.21.15.55:0/3043070068 >> 172.21.15.55:0/3043070068 conn(0x7f99780d27d0 msgr2=0x7f99780cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:18:59.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.913+0000 7f997d634640 1 -- 172.21.15.55:0/3043070068 shutdown_connections 2023-08-25T05:18:59.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:18:59.913+0000 7f997d634640 1 -- 172.21.15.55:0/3043070068 wait complete. 2023-08-25T05:18:59.940 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T05:18:59.987 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:18:59.988 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:18:59.988 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:18:59.996 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:18:59.995+0000 7f2bf6348180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:19:00.130 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:00.131+0000 7f2bf6348180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:19:00.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.161+0000 7f7e3bfe1640 1 Processor -- start 2023-08-25T05:19:00.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.161+0000 7f7e3bfe1640 1 -- start start 2023-08-25T05:19:00.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.161+0000 7f7e3bfe1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e340d0da0 0x7f7e340d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:00.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.161+0000 7f7e3bfe1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e340b29b0 con 0x7f7e340b3e50 2023-08-25T05:19:00.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.161+0000 7f7e3bfe1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e340cfc80 con 0x7f7e340cdde0 2023-08-25T05:19:00.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.161+0000 7f7e3bfe1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e340d16c0 con 0x7f7e340d0da0 2023-08-25T05:19:00.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.161+0000 7f7e3a57e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7e340b3e50 0x7f7e340cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45102/0 (socket says 172.21.15.55:45102) 2023-08-25T05:19:00.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.161+0000 7f7e3a57e640 1 -- 172.21.15.55:0/3236787654 learned_addr learned my addr 172.21.15.55:0/3236787654 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:00.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.161+0000 7f7e39d7d640 1 --2- 172.21.15.55:0/3236787654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e340d0da0 0x7f7e340d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:00.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.161+0000 7f7e38d7b640 1 -- 172.21.15.55:0/3236787654 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967359306 0 0) 0x7f7e340b29b0 con 0x7f7e340b3e50 2023-08-25T05:19:00.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.161+0000 7f7e38d7b640 1 -- 172.21.15.55:0/3236787654 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e20003530 con 0x7f7e340b3e50 2023-08-25T05:19:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.161+0000 7f7e38d7b640 1 -- 172.21.15.55:0/3236787654 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012982046 0 0) 0x7f7e340cfc80 con 0x7f7e340cdde0 2023-08-25T05:19:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.161+0000 7f7e38d7b640 1 -- 172.21.15.55:0/3236787654 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e340b29b0 con 0x7f7e340cdde0 2023-08-25T05:19:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.161+0000 7f7e39d7d640 1 -- 172.21.15.55:0/3236787654 >> v1:172.21.15.110:6789/0 conn(0x7f7e340cdde0 legacy=0x7f7e340cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.161+0000 7f7e39d7d640 1 -- 172.21.15.55:0/3236787654 >> v1:172.21.15.55:6789/0 conn(0x7f7e340b3e50 legacy=0x7f7e340cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:00.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.161+0000 7f7e39d7d640 1 -- 172.21.15.55:0/3236787654 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e340b1dc0 con 0x7f7e340d0da0 2023-08-25T05:19:00.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.165+0000 7f7e39d7d640 1 --2- 172.21.15.55:0/3236787654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e340d0da0 0x7f7e340d1180 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7e300097d0 tx=0x7f7e3001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d39033eff258305 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:00.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.165+0000 7f7e38d7b640 1 -- 172.21.15.55:0/3236787654 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e300a8990 con 0x7f7e340d0da0 2023-08-25T05:19:00.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.165+0000 7f7e38d7b640 1 -- 172.21.15.55:0/3236787654 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e300a8af0 con 0x7f7e340d0da0 2023-08-25T05:19:00.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.165+0000 7f7e38d7b640 1 -- 172.21.15.55:0/3236787654 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e300a8e80 con 0x7f7e340d0da0 2023-08-25T05:19:00.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.165+0000 7f7e3bfe1640 1 -- 172.21.15.55:0/3236787654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e340d0da0 msgr2=0x7f7e340d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:00.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.165+0000 7f7e3bfe1640 1 --2- 172.21.15.55:0/3236787654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e340d0da0 0x7f7e340d1180 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7e300097d0 tx=0x7f7e3001ec90 comp rx=0 tx=0).stop 2023-08-25T05:19:00.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.165+0000 7f7e3bfe1640 1 -- 172.21.15.55:0/3236787654 shutdown_connections 2023-08-25T05:19:00.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.165+0000 7f7e3bfe1640 1 --2- 172.21.15.55:0/3236787654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e340d0da0 0x7f7e340d1180 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.165+0000 7f7e3bfe1640 1 -- 172.21.15.55:0/3236787654 >> 172.21.15.55:0/3236787654 conn(0x7f7e3409bae0 msgr2=0x7f7e340d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:00.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.165+0000 7f7e3bfe1640 1 -- 172.21.15.55:0/3236787654 shutdown_connections 2023-08-25T05:19:00.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.165+0000 7f7e3bfe1640 1 -- 172.21.15.55:0/3236787654 wait complete. 2023-08-25T05:19:00.171 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:19:00.171 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:19:00.171 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:19:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e3bfe1640 1 Processor -- start 2023-08-25T05:19:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e3bfe1640 1 -- start start 2023-08-25T05:19:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e3bfe1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e340b3e50 0x7f7e341f1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e3bfe1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e340cdde0 0x7f7e340c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e3bfe1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e340d0da0 0x7f7e340c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e3bfe1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e340cb290 con 0x7f7e340b3e50 2023-08-25T05:19:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e3bfe1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e340c7650 con 0x7f7e340cdde0 2023-08-25T05:19:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e3bfe1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e340ca680 con 0x7f7e340d0da0 2023-08-25T05:19:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e39d7d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e340b3e50 0x7f7e341f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e39d7d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e340b3e50 0x7f7e341f1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46350/0 (socket says 172.21.15.55:46350) 2023-08-25T05:19:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e39d7d640 1 -- 172.21.15.55:0/236892924 learned_addr learned my addr 172.21.15.55:0/236892924 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e3957c640 1 --2- 172.21.15.55:0/236892924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e340cdde0 0x7f7e340c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e3a57e640 1 --2- 172.21.15.55:0/236892924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e340d0da0 0x7f7e340c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e39d7d640 1 -- 172.21.15.55:0/236892924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e340d0da0 msgr2=0x7f7e340c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e39d7d640 1 --2- 172.21.15.55:0/236892924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e340d0da0 0x7f7e340c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e39d7d640 1 -- 172.21.15.55:0/236892924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e340cdde0 msgr2=0x7f7e340c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e39d7d640 1 --2- 172.21.15.55:0/236892924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e340cdde0 0x7f7e340c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e39d7d640 1 -- 172.21.15.55:0/236892924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e300093b0 con 0x7f7e340b3e50 2023-08-25T05:19:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e3a57e640 1 --2- 172.21.15.55:0/236892924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e340d0da0 0x7f7e340c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e39d7d640 1 --2- 172.21.15.55:0/236892924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e340b3e50 0x7f7e341f1800 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f7e3001b8a0 tx=0x7f7e3001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e2a7fc640 1 -- 172.21.15.55:0/236892924 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e300b0d80 con 0x7f7e340b3e50 2023-08-25T05:19:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e2a7fc640 1 -- 172.21.15.55:0/236892924 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e300b9430 con 0x7f7e340b3e50 2023-08-25T05:19:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e2a7fc640 1 -- 172.21.15.55:0/236892924 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e300b97e0 con 0x7f7e340b3e50 2023-08-25T05:19:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e3bfe1640 1 -- 172.21.15.55:0/236892924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e340ca960 con 0x7f7e340b3e50 2023-08-25T05:19:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.169+0000 7f7e3bfe1640 1 -- 172.21.15.55:0/236892924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e340caf20 con 0x7f7e340b3e50 2023-08-25T05:19:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.173+0000 7f7e3bfe1640 1 -- 172.21.15.55:0/236892924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3404dbe0 con 0x7f7e340b3e50 2023-08-25T05:19:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.173+0000 7f7e2a7fc640 1 -- 172.21.15.55:0/236892924 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 84) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f7e300b7040 con 0x7f7e340b3e50 2023-08-25T05:19:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.173+0000 7f7e2a7fc640 1 --2- 172.21.15.55:0/236892924 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f7e180657d0 0x7f7e18067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.173+0000 7f7e2a7fc640 1 -- 172.21.15.55:0/236892924 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f7e30120b40 con 0x7f7e340b3e50 2023-08-25T05:19:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.173+0000 7f7e3957c640 1 -- 172.21.15.55:0/236892924 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f7e180657d0 msgr2=0x7f7e18067c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3704357441 2023-08-25T05:19:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.173+0000 7f7e3957c640 1 --2- 172.21.15.55:0/236892924 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f7e180657d0 0x7f7e18067c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:19:00.182 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:00.177+0000 7f1e0a570180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:19:00.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.181+0000 7f7e2a7fc640 1 -- 172.21.15.55:0/236892924 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7e300ee2f0 con 0x7f7e340b3e50 2023-08-25T05:19:00.256 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:00.255+0000 7f2bf6348180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:19:00.325 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:00.327+0000 7f2bf6348180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:19:00.327 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:00.325+0000 7f1e0a570180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:19:00.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.353+0000 7f7e3bfe1640 1 -- 172.21.15.55:0/236892924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7e340d0b80 con 0x7f7e340b3e50 2023-08-25T05:19:00.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.353+0000 7f7e2a7fc640 1 -- 172.21.15.55:0/236892924 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v158) v1 ==== 80+0+477 (secure 0 0 0) 0x7f7e300b5080 con 0x7f7e340b3e50 2023-08-25T05:19:00.356 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3176170740 2023-08-26T05:18:54.845562+0000 2023-08-25T05:19:00.356 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3759935208 2023-08-26T05:18:54.845562+0000 2023-08-25T05:19:00.356 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/2816190802 2023-08-26T05:18:54.845562+0000 2023-08-25T05:19:00.356 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/978380102 2023-08-26T05:18:54.845562+0000 2023-08-25T05:19:00.356 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6833/4256905777 2023-08-26T05:18:54.845562+0000 2023-08-25T05:19:00.357 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6832/4256905777 2023-08-26T05:18:54.845562+0000 2023-08-25T05:19:00.357 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/1948062482 2023-08-26T05:18:54.845562+0000 2023-08-25T05:19:00.357 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/2661104133 2023-08-26T05:18:54.845562+0000 2023-08-25T05:19:00.358 INFO:teuthology.orchestra.run.smithi055.stderr:listed 8 entries 2023-08-25T05:19:00.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.353+0000 7f7e3bfe1640 1 -- 172.21.15.55:0/236892924 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f7e180657d0 msgr2=0x7f7e18067c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:19:00.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.353+0000 7f7e3bfe1640 1 --2- 172.21.15.55:0/236892924 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f7e180657d0 0x7f7e18067c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.353+0000 7f7e3bfe1640 1 -- 172.21.15.55:0/236892924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e340b3e50 msgr2=0x7f7e341f1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:00.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.353+0000 7f7e3bfe1640 1 --2- 172.21.15.55:0/236892924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e340b3e50 0x7f7e341f1800 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f7e3001b8a0 tx=0x7f7e3001ba30 comp rx=0 tx=0).stop 2023-08-25T05:19:00.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.353+0000 7f7e3bfe1640 1 -- 172.21.15.55:0/236892924 shutdown_connections 2023-08-25T05:19:00.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.353+0000 7f7e3bfe1640 1 --2- 172.21.15.55:0/236892924 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f7e180657d0 0x7f7e18067c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.353+0000 7f7e3bfe1640 1 --2- 172.21.15.55:0/236892924 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7e340d0da0 0x7f7e340c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.353+0000 7f7e3bfe1640 1 --2- 172.21.15.55:0/236892924 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7e340cdde0 0x7f7e340c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.353+0000 7f7e3bfe1640 1 --2- 172.21.15.55:0/236892924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e340b3e50 0x7f7e341f1800 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.353+0000 7f7e3bfe1640 1 -- 172.21.15.55:0/236892924 >> 172.21.15.55:0/236892924 conn(0x7f7e3409bae0 msgr2=0x7f7e340cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:00.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.353+0000 7f7e3bfe1640 1 -- 172.21.15.55:0/236892924 shutdown_connections 2023-08-25T05:19:00.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.353+0000 7f7e3bfe1640 1 -- 172.21.15.55:0/236892924 wait complete. 2023-08-25T05:19:00.377 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-25T05:19:00.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:19:00.378 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-25T05:19:00.447 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T05:19:00.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:19:00.447 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-25T05:19:00.457 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:19:00.458 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:19:00.462 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:00.459+0000 7f2bf6348180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:19:00.462 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:00.461+0000 7f1e0a570180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:19:00.467 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:19:00.467 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:19:00.468 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:19:00.477 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T05:19:00.477 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:19:00.478 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:19:00.518 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:19:00.518 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:19:00.538 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:00.533+0000 7f1e0a570180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:19:00.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.661+0000 7f62cad44640 1 Processor -- start 2023-08-25T05:19:00.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.661+0000 7f62cad44640 1 -- start start 2023-08-25T05:19:00.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.661+0000 7f62cad44640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62c40d0da0 0x7f62c40d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:00.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.661+0000 7f62cad44640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62c40b3e50 0x7f62c40ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:00.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.661+0000 7f62cad44640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c40b29b0 con 0x7f62c40cdde0 2023-08-25T05:19:00.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.661+0000 7f62cad44640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c40ce760 con 0x7f62c40d0da0 2023-08-25T05:19:00.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.661+0000 7f62cad44640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40d16c0 con 0x7f62c40b3e50 2023-08-25T05:19:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.661+0000 7f62c8ae0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62c40d0da0 0x7f62c40d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.661+0000 7f62c3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f62c40cdde0 0x7f62c40cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45812/0 (socket says 172.21.15.55:45812) 2023-08-25T05:19:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.661+0000 7f62c3fff640 1 -- 172.21.15.55:0/3885676831 learned_addr learned my addr 172.21.15.55:0/3885676831 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.665+0000 7f62c92e1640 1 --2- 172.21.15.55:0/3885676831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62c40b3e50 0x7f62c40ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.665+0000 7f62c8ae0640 1 -- 172.21.15.55:0/3885676831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62c40b3e50 msgr2=0x7f62c40ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.665+0000 7f62c8ae0640 1 --2- 172.21.15.55:0/3885676831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62c40b3e50 0x7f62c40ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.665+0000 7f62c8ae0640 1 -- 172.21.15.55:0/3885676831 >> v1:172.21.15.55:6789/0 conn(0x7f62c40cdde0 legacy=0x7f62c40cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.665+0000 7f62c8ae0640 1 -- 172.21.15.55:0/3885676831 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40b1dc0 con 0x7f62c40d0da0 2023-08-25T05:19:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.665+0000 7f62c92e1640 1 --2- 172.21.15.55:0/3885676831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62c40b3e50 0x7f62c40ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.665+0000 7f62c8ae0640 1 --2- 172.21.15.55:0/3885676831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c40d0da0 0x7f62c40d1180 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f62b80097a0 tx=0x7f62b801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb95df8fcaf6c65 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:00.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.665+0000 7f62c37fe640 1 -- 172.21.15.55:0/3885676831 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b80a8950 con 0x7f62c40d0da0 2023-08-25T05:19:00.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.665+0000 7f62c37fe640 1 -- 172.21.15.55:0/3885676831 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b80a8ab0 con 0x7f62c40d0da0 2023-08-25T05:19:00.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.665+0000 7f62c37fe640 1 -- 172.21.15.55:0/3885676831 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b80a8e40 con 0x7f62c40d0da0 2023-08-25T05:19:00.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62cad44640 1 -- 172.21.15.55:0/3885676831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c40d0da0 msgr2=0x7f62c40d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:00.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62cad44640 1 --2- 172.21.15.55:0/3885676831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c40d0da0 0x7f62c40d1180 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f62b80097a0 tx=0x7f62b801ec50 comp rx=0 tx=0).stop 2023-08-25T05:19:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62cad44640 1 -- 172.21.15.55:0/3885676831 shutdown_connections 2023-08-25T05:19:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62cad44640 1 --2- 172.21.15.55:0/3885676831 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62c40b3e50 0x7f62c40ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62cad44640 1 --2- 172.21.15.55:0/3885676831 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c40d0da0 0x7f62c40d1180 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62cad44640 1 -- 172.21.15.55:0/3885676831 >> 172.21.15.55:0/3885676831 conn(0x7f62c409bae0 msgr2=0x7f62c40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62cad44640 1 -- 172.21.15.55:0/3885676831 shutdown_connections 2023-08-25T05:19:00.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62cad44640 1 -- 172.21.15.55:0/3885676831 wait complete. 2023-08-25T05:19:00.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62cad44640 1 Processor -- start 2023-08-25T05:19:00.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62cad44640 1 -- start start 2023-08-25T05:19:00.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62cad44640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c40b3e50 0x7f62c415d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:00.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62cad44640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62c40cdde0 0x7f62c40c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:00.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62cad44640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62c40d0da0 0x7f62c40ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:00.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62cad44640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40c9930 con 0x7f62c40b3e50 2023-08-25T05:19:00.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62cad44640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40c9c10 con 0x7f62c40cdde0 2023-08-25T05:19:00.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62cad44640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40c9ef0 con 0x7f62c40d0da0 2023-08-25T05:19:00.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62c8ae0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c40b3e50 0x7f62c415d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:00.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62c8ae0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c40b3e50 0x7f62c415d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36852/0 (socket says 172.21.15.55:36852) 2023-08-25T05:19:00.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62c8ae0640 1 -- 172.21.15.55:0/1168861227 learned_addr learned my addr 172.21.15.55:0/1168861227 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:00.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62c92e1640 1 --2- 172.21.15.55:0/1168861227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62c40d0da0 0x7f62c40ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:00.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.669+0000 7f62c3fff640 1 --2- 172.21.15.55:0/1168861227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62c40cdde0 0x7f62c40c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:00.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.673+0000 7f62c8ae0640 1 -- 172.21.15.55:0/1168861227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62c40d0da0 msgr2=0x7f62c40ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:00.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.673+0000 7f62c8ae0640 1 --2- 172.21.15.55:0/1168861227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62c40d0da0 0x7f62c40ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.673+0000 7f62c8ae0640 1 -- 172.21.15.55:0/1168861227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62c40cdde0 msgr2=0x7f62c40c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:00.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.673+0000 7f62c8ae0640 1 --2- 172.21.15.55:0/1168861227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62c40cdde0 0x7f62c40c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.673+0000 7f62c8ae0640 1 -- 172.21.15.55:0/1168861227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b80093b0 con 0x7f62c40b3e50 2023-08-25T05:19:00.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.673+0000 7f62c8ae0640 1 --2- 172.21.15.55:0/1168861227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c40b3e50 0x7f62c415d890 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f62b80b3040 tx=0x7f62b801b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:00.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.673+0000 7f62c17fa640 1 -- 172.21.15.55:0/1168861227 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b80be070 con 0x7f62c40b3e50 2023-08-25T05:19:00.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.673+0000 7f62c17fa640 1 -- 172.21.15.55:0/1168861227 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b80b9430 con 0x7f62c40b3e50 2023-08-25T05:19:00.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.673+0000 7f62cad44640 1 -- 172.21.15.55:0/1168861227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c40ca1d0 con 0x7f62c40b3e50 2023-08-25T05:19:00.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.673+0000 7f62c17fa640 1 -- 172.21.15.55:0/1168861227 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b80b97e0 con 0x7f62c40b3e50 2023-08-25T05:19:00.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.673+0000 7f62cad44640 1 -- 172.21.15.55:0/1168861227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c415ddd0 con 0x7f62c40b3e50 2023-08-25T05:19:00.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.673+0000 7f62cad44640 1 -- 172.21.15.55:0/1168861227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c404dbe0 con 0x7f62c40b3e50 2023-08-25T05:19:00.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.673+0000 7f62c17fa640 1 -- 172.21.15.55:0/1168861227 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 84) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f62b80b7040 con 0x7f62c40b3e50 2023-08-25T05:19:00.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.673+0000 7f62c17fa640 1 --2- 172.21.15.55:0/1168861227 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f62a80657a0 0x7f62a8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:00.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.673+0000 7f62c17fa640 1 -- 172.21.15.55:0/1168861227 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f62b8120510 con 0x7f62c40b3e50 2023-08-25T05:19:00.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.673+0000 7f62c3fff640 1 -- 172.21.15.55:0/1168861227 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f62a80657a0 msgr2=0x7f62a8067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3704357441 2023-08-25T05:19:00.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.673+0000 7f62c3fff640 1 --2- 172.21.15.55:0/1168861227 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f62a80657a0 0x7f62a8067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:19:00.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.677+0000 7f62c17fa640 1 -- 172.21.15.55:0/1168861227 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f62b80ede00 con 0x7f62c40b3e50 2023-08-25T05:19:00.687 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:00.685+0000 7f1e0a570180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:19:00.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.873+0000 7f62cad44640 1 -- 172.21.15.55:0/1168861227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62c40b2330 con 0x7f62c40b3e50 2023-08-25T05:19:00.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.873+0000 7f62c17fa640 1 -- 172.21.15.55:0/1168861227 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4877 (secure 0 0 0) 0x7f62b80f1420 con 0x7f62c40b3e50 2023-08-25T05:19:00.879 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:00.879 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8911,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/381737607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":381737607},{"type":"v1","addr":"172.21.15.55:6834","nonce":381737607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":8917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/775518941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":775518941},{"type":"v1","addr":"172.21.15.110:6836","nonce":775518941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":8920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1426163963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1426163963},{"type":"v1","addr":"172.21.15.110:6837","nonce":1426163963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:18:42.381096+0000","modified":"2023-08-25T05:18:46.026870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9618},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9618":{"gid":9618,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3591663387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3591663387},{"type":"v1","addr":"172.21.15.55:6835","nonce":3591663387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-25T05:19:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 74 2023-08-25T05:19:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.877+0000 7f62c3fff640 1 -- 172.21.15.55:0/1168861227 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f62a80657a0 msgr2=0x7f62a8067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3704357441 2023-08-25T05:19:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.877+0000 7f62c3fff640 1 --2- 172.21.15.55:0/1168861227 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f62a80657a0 0x7f62a8067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-25T05:19:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.877+0000 7f62cad44640 1 -- 172.21.15.55:0/1168861227 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f62a80657a0 msgr2=0x7f62a8067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:19:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.877+0000 7f62cad44640 1 --2- 172.21.15.55:0/1168861227 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f62a80657a0 0x7f62a8067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.877+0000 7f62cad44640 1 -- 172.21.15.55:0/1168861227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c40b3e50 msgr2=0x7f62c415d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:00.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.877+0000 7f62cad44640 1 --2- 172.21.15.55:0/1168861227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c40b3e50 0x7f62c415d890 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f62b80b3040 tx=0x7f62b801b9f0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.877+0000 7f62cad44640 1 -- 172.21.15.55:0/1168861227 shutdown_connections 2023-08-25T05:19:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.877+0000 7f62cad44640 1 --2- 172.21.15.55:0/1168861227 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f62a80657a0 0x7f62a8067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.877+0000 7f62cad44640 1 --2- 172.21.15.55:0/1168861227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62c40d0da0 0x7f62c40ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.877+0000 7f62cad44640 1 --2- 172.21.15.55:0/1168861227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f62c40cdde0 0x7f62c40c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.877+0000 7f62cad44640 1 --2- 172.21.15.55:0/1168861227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62c40b3e50 0x7f62c415d890 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.877+0000 7f62cad44640 1 -- 172.21.15.55:0/1168861227 >> 172.21.15.55:0/1168861227 conn(0x7f62c409bae0 msgr2=0x7f62c40cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:00.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.877+0000 7f62cad44640 1 -- 172.21.15.55:0/1168861227 shutdown_connections 2023-08-25T05:19:00.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:00.877+0000 7f62cad44640 1 -- 172.21.15.55:0/1168861227 wait complete. 2023-08-25T05:19:00.900 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:19:01.004 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:01.003+0000 7f2bf6348180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:19:01.090 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:01.091+0000 7f2bf6348180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:19:01.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.085+0000 7fae6f311640 1 Processor -- start 2023-08-25T05:19:01.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.089+0000 7fae6f311640 1 -- start start 2023-08-25T05:19:01.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.089+0000 7fae6f311640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae680d0da0 0x7fae680d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:01.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.089+0000 7fae6f311640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fae680cdde0 0x7fae680ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:01.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.089+0000 7fae6f311640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae680cee60 0x7fae680cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:01.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.089+0000 7fae6f311640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae680ce760 con 0x7fae680d0da0 2023-08-25T05:19:01.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.089+0000 7fae6f311640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae680b29b0 con 0x7fae680cdde0 2023-08-25T05:19:01.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.089+0000 7fae6f311640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae680d16c0 con 0x7fae680cee60 2023-08-25T05:19:01.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.089+0000 7fae6d0ad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae680d0da0 0x7fae680d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:01.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.089+0000 7fae6d0ad640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae680d0da0 0x7fae680d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36862/0 (socket says 172.21.15.55:36862) 2023-08-25T05:19:01.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.089+0000 7fae6d0ad640 1 -- 172.21.15.55:0/485723163 learned_addr learned my addr 172.21.15.55:0/485723163 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:01.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.089+0000 7fae6c8ac640 1 --2- 172.21.15.55:0/485723163 >> v2:172.21.15.110:3300/0 conn(0x7fae680cdde0 0x7fae680ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:01.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.089+0000 7fae6d8ae640 1 --2- 172.21.15.55:0/485723163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae680cee60 0x7fae680cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:01.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.089+0000 7fae6d0ad640 1 -- 172.21.15.55:0/485723163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae680cee60 msgr2=0x7fae680cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:01.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.089+0000 7fae6d0ad640 1 --2- 172.21.15.55:0/485723163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae680cee60 0x7fae680cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.089+0000 7fae6d0ad640 1 -- 172.21.15.55:0/485723163 >> v2:172.21.15.110:3300/0 conn(0x7fae680cdde0 msgr2=0x7fae680ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:01.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.089+0000 7fae6d0ad640 1 --2- 172.21.15.55:0/485723163 >> v2:172.21.15.110:3300/0 conn(0x7fae680cdde0 0x7fae680ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.089+0000 7fae6d0ad640 1 -- 172.21.15.55:0/485723163 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae680b1dc0 con 0x7fae680d0da0 2023-08-25T05:19:01.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.093+0000 7fae6d0ad640 1 --2- 172.21.15.55:0/485723163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae680d0da0 0x7fae680d1180 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fae680d38c0 tx=0x7fae6401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a6526cca41f051 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:01.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.093+0000 7fae5ffff640 1 -- 172.21.15.55:0/485723163 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae640a89b0 con 0x7fae680d0da0 2023-08-25T05:19:01.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.093+0000 7fae5ffff640 1 -- 172.21.15.55:0/485723163 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae640a8b10 con 0x7fae680d0da0 2023-08-25T05:19:01.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.093+0000 7fae5ffff640 1 -- 172.21.15.55:0/485723163 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae640a8ea0 con 0x7fae680d0da0 2023-08-25T05:19:01.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.093+0000 7fae6f311640 1 -- 172.21.15.55:0/485723163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae680d0da0 msgr2=0x7fae680d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:01.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.093+0000 7fae6f311640 1 --2- 172.21.15.55:0/485723163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae680d0da0 0x7fae680d1180 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fae680d38c0 tx=0x7fae6401ecf0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.093+0000 7fae6f311640 1 -- 172.21.15.55:0/485723163 shutdown_connections 2023-08-25T05:19:01.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.093+0000 7fae6f311640 1 --2- 172.21.15.55:0/485723163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae680cee60 0x7fae680cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.093+0000 7fae6f311640 1 --2- 172.21.15.55:0/485723163 >> v2:172.21.15.110:3300/0 conn(0x7fae680cdde0 0x7fae680ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.093+0000 7fae6f311640 1 --2- 172.21.15.55:0/485723163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae680d0da0 0x7fae680d1180 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.093+0000 7fae6f311640 1 -- 172.21.15.55:0/485723163 >> 172.21.15.55:0/485723163 conn(0x7fae6809bae0 msgr2=0x7fae680d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:01.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.093+0000 7fae6f311640 1 -- 172.21.15.55:0/485723163 shutdown_connections 2023-08-25T05:19:01.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.093+0000 7fae6f311640 1 -- 172.21.15.55:0/485723163 wait complete. 2023-08-25T05:19:01.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6f311640 1 Processor -- start 2023-08-25T05:19:01.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6f311640 1 -- start start 2023-08-25T05:19:01.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6f311640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae680cdde0 0x7fae680cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:01.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6f311640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae680cee60 0x7fae680c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:01.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6f311640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae680d0da0 0x7fae680c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:01.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6f311640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae680b57c0 con 0x7fae680cdde0 2023-08-25T05:19:01.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6f311640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae680b5aa0 con 0x7fae680d0da0 2023-08-25T05:19:01.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6f311640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae680b5d80 con 0x7fae680cee60 2023-08-25T05:19:01.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6d0ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae680cdde0 0x7fae680cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:01.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6d0ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae680cdde0 0x7fae680cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36868/0 (socket says 172.21.15.55:36868) 2023-08-25T05:19:01.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6d8ae640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae680d0da0 0x7fae680c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:01.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6d0ad640 1 -- 172.21.15.55:0/3360801181 learned_addr learned my addr 172.21.15.55:0/3360801181 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:01.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6c8ac640 1 --2- 172.21.15.55:0/3360801181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae680cee60 0x7fae680c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:01.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6d0ad640 1 -- 172.21.15.55:0/3360801181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae680cee60 msgr2=0x7fae680c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:01.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6d0ad640 1 --2- 172.21.15.55:0/3360801181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae680cee60 0x7fae680c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6d0ad640 1 -- 172.21.15.55:0/3360801181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae680d0da0 msgr2=0x7fae680c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:01.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6d0ad640 1 --2- 172.21.15.55:0/3360801181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae680d0da0 0x7fae680c7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6d0ad640 1 -- 172.21.15.55:0/3360801181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae64009480 con 0x7fae680cdde0 2023-08-25T05:19:01.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6d8ae640 1 --2- 172.21.15.55:0/3360801181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae680d0da0 0x7fae680c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:19:01.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6d0ad640 1 --2- 172.21.15.55:0/3360801181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae680cdde0 0x7fae680cb410 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fae6401f590 tx=0x7fae6401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:01.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae5dffb640 1 -- 172.21.15.55:0/3360801181 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64003820 con 0x7fae680cdde0 2023-08-25T05:19:01.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae5dffb640 1 -- 172.21.15.55:0/3360801181 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae64003980 con 0x7fae680cdde0 2023-08-25T05:19:01.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae5dffb640 1 -- 172.21.15.55:0/3360801181 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64003d10 con 0x7fae680cdde0 2023-08-25T05:19:01.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6f311640 1 -- 172.21.15.55:0/3360801181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae680b6060 con 0x7fae680cdde0 2023-08-25T05:19:01.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.097+0000 7fae6f311640 1 -- 172.21.15.55:0/3360801181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae680cb950 con 0x7fae680cdde0 2023-08-25T05:19:01.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.101+0000 7fae6f311640 1 -- 172.21.15.55:0/3360801181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6804dbe0 con 0x7fae680cdde0 2023-08-25T05:19:01.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.101+0000 7fae5dffb640 1 -- 172.21.15.55:0/3360801181 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 84) v1 ==== 85065+0+0 (secure 0 0 0) 0x7fae640b7070 con 0x7fae680cdde0 2023-08-25T05:19:01.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.101+0000 7fae5dffb640 1 --2- 172.21.15.55:0/3360801181 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fae4c0657a0 0x7fae4c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:01.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.101+0000 7fae5dffb640 1 -- 172.21.15.55:0/3360801181 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fae6411fee0 con 0x7fae680cdde0 2023-08-25T05:19:01.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.101+0000 7fae6c8ac640 1 -- 172.21.15.55:0/3360801181 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fae4c0657a0 msgr2=0x7fae4c067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3704357441 2023-08-25T05:19:01.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.101+0000 7fae6c8ac640 1 --2- 172.21.15.55:0/3360801181 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fae4c0657a0 0x7fae4c067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:19:01.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.105+0000 7fae5dffb640 1 -- 172.21.15.55:0/3360801181 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fae640ed760 con 0x7fae680cdde0 2023-08-25T05:19:01.242 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:01.239+0000 7f2bf6348180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:19:01.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.265+0000 7fae6f311640 1 -- 172.21.15.55:0/3360801181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae680b19b0 con 0x7fae680cdde0 2023-08-25T05:19:01.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.265+0000 7fae5dffb640 1 -- 172.21.15.55:0/3360801181 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+18829 (secure 0 0 0) 0x7fae640f0d80 con 0x7fae680cdde0 2023-08-25T05:19:01.271 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:01.271 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":158,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:18:54.845594+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:18:40.053897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-25T05:18:41.441905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3176170740":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/3759935208":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/2816190802":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/978380102":"2023-08-26T05:18:54.845562+0000","172.21.15.110:6833/4256905777":"2023-08-26T05:18:54.845562+0000","172.21.15.110:6832/4256905777":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/1948062482":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/2661104133":"2023-08-26T05:18:54.845562+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:19:01.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.269+0000 7fae6f311640 1 -- 172.21.15.55:0/3360801181 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fae4c0657a0 msgr2=0x7fae4c067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:19:01.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.269+0000 7fae6f311640 1 --2- 172.21.15.55:0/3360801181 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fae4c0657a0 0x7fae4c067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.269+0000 7fae6f311640 1 -- 172.21.15.55:0/3360801181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae680cdde0 msgr2=0x7fae680cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:01.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.269+0000 7fae6f311640 1 --2- 172.21.15.55:0/3360801181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae680cdde0 0x7fae680cb410 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fae6401f590 tx=0x7fae6401ba90 comp rx=0 tx=0).stop 2023-08-25T05:19:01.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.269+0000 7fae6f311640 1 -- 172.21.15.55:0/3360801181 shutdown_connections 2023-08-25T05:19:01.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.269+0000 7fae6f311640 1 --2- 172.21.15.55:0/3360801181 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7fae4c0657a0 0x7fae4c067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.269+0000 7fae6f311640 1 --2- 172.21.15.55:0/3360801181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae680d0da0 0x7fae680c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.269+0000 7fae6f311640 1 --2- 172.21.15.55:0/3360801181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae680cee60 0x7fae680c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.269+0000 7fae6f311640 1 --2- 172.21.15.55:0/3360801181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae680cdde0 0x7fae680cb410 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.269+0000 7fae6f311640 1 -- 172.21.15.55:0/3360801181 >> 172.21.15.55:0/3360801181 conn(0x7fae6809bae0 msgr2=0x7fae680b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:01.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.269+0000 7fae6f311640 1 -- 172.21.15.55:0/3360801181 shutdown_connections 2023-08-25T05:19:01.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.269+0000 7fae6f311640 1 -- 172.21.15.55:0/3360801181 wait complete. 2023-08-25T05:19:01.275 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:01.273+0000 7f1e0a570180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:19:01.293 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T05:18:40.053897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '156', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T05:18:41.441905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T05:19:01.293 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T05:19:01.322 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:01.323+0000 7f2bf6348180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:19:01.367 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:01.365+0000 7f1e0a570180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:19:01.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.441+0000 7f57f90bd640 1 Processor -- start 2023-08-25T05:19:01.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.441+0000 7f57f90bd640 1 -- start start 2023-08-25T05:19:01.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.441+0000 7f57f90bd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f57f41601f0 0x7f57f415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:01.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.441+0000 7f57f90bd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f40cd5a0 con 0x7f57f415e3c0 2023-08-25T05:19:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.441+0000 7f57f90bd640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f40cd880 con 0x7f57f40d1290 2023-08-25T05:19:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.441+0000 7f57f90bd640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f40cdb60 con 0x7f57f41601f0 2023-08-25T05:19:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.441+0000 7f57f259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f57f415e3c0 0x7f57f40d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45822/0 (socket says 172.21.15.55:45822) 2023-08-25T05:19:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.441+0000 7f57f259c640 1 -- 172.21.15.55:0/3856935055 learned_addr learned my addr 172.21.15.55:0/3856935055 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.441+0000 7f57f2d9d640 1 --2- 172.21.15.55:0/3856935055 >> v2:172.21.15.110:3300/0 conn(0x7f57f41601f0 0x7f57f415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:01.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.441+0000 7f57f1d9b640 1 -- 172.21.15.55:0/3856935055 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222780857 0 0) 0x7f57f40cd5a0 con 0x7f57f415e3c0 2023-08-25T05:19:01.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.441+0000 7f57f1d9b640 1 -- 172.21.15.55:0/3856935055 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57dc003530 con 0x7f57f415e3c0 2023-08-25T05:19:01.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.441+0000 7f57f1d9b640 1 -- 172.21.15.55:0/3856935055 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1658480937 0 0) 0x7f57f40cd880 con 0x7f57f40d1290 2023-08-25T05:19:01.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.441+0000 7f57f1d9b640 1 -- 172.21.15.55:0/3856935055 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f40cd5a0 con 0x7f57f40d1290 2023-08-25T05:19:01.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.441+0000 7f57f2d9d640 1 -- 172.21.15.55:0/3856935055 >> v1:172.21.15.110:6789/0 conn(0x7f57f40d1290 legacy=0x7f57f415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:01.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.441+0000 7f57f2d9d640 1 -- 172.21.15.55:0/3856935055 >> v1:172.21.15.55:6789/0 conn(0x7f57f415e3c0 legacy=0x7f57f40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:01.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.441+0000 7f57f2d9d640 1 -- 172.21.15.55:0/3856935055 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f40cde40 con 0x7f57f41601f0 2023-08-25T05:19:01.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.445+0000 7f57f2d9d640 1 --2- 172.21.15.55:0/3856935055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f41601f0 0x7f57f415d430 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f57e40097a0 tx=0x7f57e401c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bb6a48878ffd439 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:01.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.445+0000 7f57f1d9b640 1 -- 172.21.15.55:0/3856935055 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e4004230 con 0x7f57f41601f0 2023-08-25T05:19:01.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.445+0000 7f57f1d9b640 1 -- 172.21.15.55:0/3856935055 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e40a7050 con 0x7f57f41601f0 2023-08-25T05:19:01.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.445+0000 7f57f1d9b640 1 -- 172.21.15.55:0/3856935055 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e4003620 con 0x7f57f41601f0 2023-08-25T05:19:01.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.445+0000 7f57f90bd640 1 -- 172.21.15.55:0/3856935055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f41601f0 msgr2=0x7f57f415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:01.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.445+0000 7f57f90bd640 1 --2- 172.21.15.55:0/3856935055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f41601f0 0x7f57f415d430 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f57e40097a0 tx=0x7f57e401c430 comp rx=0 tx=0).stop 2023-08-25T05:19:01.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.445+0000 7f57f90bd640 1 -- 172.21.15.55:0/3856935055 shutdown_connections 2023-08-25T05:19:01.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.445+0000 7f57f90bd640 1 --2- 172.21.15.55:0/3856935055 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f41601f0 0x7f57f415d430 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.445+0000 7f57f90bd640 1 -- 172.21.15.55:0/3856935055 >> 172.21.15.55:0/3856935055 conn(0x7f57f40d27d0 msgr2=0x7f57f40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:01.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.445+0000 7f57f90bd640 1 -- 172.21.15.55:0/3856935055 shutdown_connections 2023-08-25T05:19:01.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.445+0000 7f57f90bd640 1 -- 172.21.15.55:0/3856935055 wait complete. 2023-08-25T05:19:01.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f90bd640 1 Processor -- start 2023-08-25T05:19:01.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f90bd640 1 -- start start 2023-08-25T05:19:01.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f90bd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f40d1290 0x7f57f4152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:01.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f90bd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57f415e3c0 0x7f57f4154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:01.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f90bd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57f41601f0 0x7f57f414e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:01.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f90bd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f4151a10 con 0x7f57f41601f0 2023-08-25T05:19:01.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f90bd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f4151170 con 0x7f57f40d1290 2023-08-25T05:19:01.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f90bd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f4151450 con 0x7f57f415e3c0 2023-08-25T05:19:01.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57f41601f0 0x7f57f414e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:01.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f2d9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f40d1290 0x7f57f4152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:01.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f259c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57f415e3c0 0x7f57f4154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:01.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f2d9d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f40d1290 0x7f57f4152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:33682/0 (socket says 172.21.15.55:33682) 2023-08-25T05:19:01.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57f41601f0 0x7f57f414e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36876/0 (socket says 172.21.15.55:36876) 2023-08-25T05:19:01.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f2d9d640 1 -- 172.21.15.55:0/3730814979 learned_addr learned my addr 172.21.15.55:0/3730814979 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:01.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f359e640 1 -- 172.21.15.55:0/3730814979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57f415e3c0 msgr2=0x7f57f4154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:01.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f359e640 1 --2- 172.21.15.55:0/3730814979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57f415e3c0 0x7f57f4154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f359e640 1 -- 172.21.15.55:0/3730814979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f40d1290 msgr2=0x7f57f4152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:01.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f359e640 1 --2- 172.21.15.55:0/3730814979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f40d1290 0x7f57f4152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f359e640 1 -- 172.21.15.55:0/3730814979 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e40093b0 con 0x7f57f41601f0 2023-08-25T05:19:01.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f2d9d640 1 --2- 172.21.15.55:0/3730814979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f40d1290 0x7f57f4152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:19:01.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f359e640 1 --2- 172.21.15.55:0/3730814979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57f41601f0 0x7f57f414e8e0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f57ec002240 tx=0x7f57ec00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:01.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57db7fe640 1 -- 172.21.15.55:0/3730814979 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec006d60 con 0x7f57f41601f0 2023-08-25T05:19:01.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57db7fe640 1 -- 172.21.15.55:0/3730814979 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ec005020 con 0x7f57f41601f0 2023-08-25T05:19:01.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57db7fe640 1 -- 172.21.15.55:0/3730814979 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec005430 con 0x7f57f41601f0 2023-08-25T05:19:01.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f90bd640 1 -- 172.21.15.55:0/3730814979 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f4151730 con 0x7f57f41601f0 2023-08-25T05:19:01.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.449+0000 7f57f90bd640 1 -- 172.21.15.55:0/3730814979 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f414d940 con 0x7f57f41601f0 2023-08-25T05:19:01.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.453+0000 7f57f90bd640 1 -- 172.21.15.55:0/3730814979 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f40b5260 con 0x7f57f41601f0 2023-08-25T05:19:01.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.453+0000 7f57db7fe640 1 -- 172.21.15.55:0/3730814979 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 84) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f57ec00a640 con 0x7f57f41601f0 2023-08-25T05:19:01.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.453+0000 7f57db7fe640 1 --2- 172.21.15.55:0/3730814979 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f57e00657a0 0x7f57e0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:01.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.453+0000 7f57db7fe640 1 -- 172.21.15.55:0/3730814979 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f57ec082d20 con 0x7f57f41601f0 2023-08-25T05:19:01.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.453+0000 7f57f2d9d640 1 -- 172.21.15.55:0/3730814979 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f57e00657a0 msgr2=0x7f57e0067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3704357441 2023-08-25T05:19:01.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.453+0000 7f57f2d9d640 1 --2- 172.21.15.55:0/3730814979 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f57e00657a0 0x7f57e0067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:19:01.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.457+0000 7f57db7fe640 1 -- 172.21.15.55:0/3730814979 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f57ec050610 con 0x7f57f41601f0 2023-08-25T05:19:01.544 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:01.541+0000 7f1e0a570180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:19:01.632 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:01.629+0000 7f1e0a570180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:19:01.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.633+0000 7f57f90bd640 1 -- 172.21.15.55:0/3730814979 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57f4073ec0 con 0x7f57f41601f0 2023-08-25T05:19:01.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.633+0000 7f57db7fe640 1 -- 172.21.15.55:0/3730814979 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v158) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57ec0160a0 con 0x7f57f41601f0 2023-08-25T05:19:01.636 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T05:19:01.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.633+0000 7f57f90bd640 1 -- 172.21.15.55:0/3730814979 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f57e00657a0 msgr2=0x7f57e0067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:19:01.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.633+0000 7f57f90bd640 1 --2- 172.21.15.55:0/3730814979 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f57e00657a0 0x7f57e0067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.633+0000 7f57f90bd640 1 -- 172.21.15.55:0/3730814979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57f41601f0 msgr2=0x7f57f414e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:01.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.633+0000 7f57f90bd640 1 --2- 172.21.15.55:0/3730814979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57f41601f0 0x7f57f414e8e0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f57ec002240 tx=0x7f57ec00cb90 comp rx=0 tx=0).stop 2023-08-25T05:19:01.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.633+0000 7f57f90bd640 1 -- 172.21.15.55:0/3730814979 shutdown_connections 2023-08-25T05:19:01.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.633+0000 7f57f90bd640 1 --2- 172.21.15.55:0/3730814979 >> [v2:172.21.15.110:6832/3704357441,v1:172.21.15.110:6833/3704357441] conn(0x7f57e00657a0 0x7f57e0067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.633+0000 7f57f90bd640 1 --2- 172.21.15.55:0/3730814979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57f41601f0 0x7f57f414e8e0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.633+0000 7f57f90bd640 1 --2- 172.21.15.55:0/3730814979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57f415e3c0 0x7f57f4154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.633+0000 7f57f90bd640 1 --2- 172.21.15.55:0/3730814979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57f40d1290 0x7f57f4152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.633+0000 7f57f90bd640 1 -- 172.21.15.55:0/3730814979 >> 172.21.15.55:0/3730814979 conn(0x7f57f40d27d0 msgr2=0x7f57f40d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:01.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.633+0000 7f57f90bd640 1 -- 172.21.15.55:0/3730814979 shutdown_connections 2023-08-25T05:19:01.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.633+0000 7f57f90bd640 1 -- 172.21.15.55:0/3730814979 wait complete. 2023-08-25T05:19:01.640 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:01.639+0000 7f2bf6348180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:19:01.658 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T05:19:01.700 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:01.699+0000 7f2bf6348180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:19:01.775 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:01.775+0000 7f2b82a83640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:01.776 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:01.775+0000 7f2b82a83640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:01.776 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:01.775+0000 7f2b82a83640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:01.776 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:01.775+0000 7f2b82a83640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:01.776 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:01.775+0000 7f2b82a83640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:01.777 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:01.775+0000 7f2b7fa7d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:01.777 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:01.775+0000 7f2b7fa7d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:01.777 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:01.775+0000 7f2b7fa7d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:01.777 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:01.775+0000 7f2b7fa7d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:01.777 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:01.775+0000 7f2b7fa7d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:01.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.809+0000 7f67e438f640 1 Processor -- start 2023-08-25T05:19:01.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.809+0000 7f67e438f640 1 -- start start 2023-08-25T05:19:01.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.809+0000 7f67e438f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67dc15a7f0 0x7f67dc09bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:01.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.809+0000 7f67e438f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f67dc0c9830 0x7f67dc070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:01.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.809+0000 7f67e438f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67dc15abd0 con 0x7f67dc06c020 2023-08-25T05:19:01.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.809+0000 7f67e438f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67dc0c8ab0 con 0x7f67dc0c9830 2023-08-25T05:19:01.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.809+0000 7f67e438f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0c8d50 con 0x7f67dc15a7f0 2023-08-25T05:19:01.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.809+0000 7f67e292c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f67dc06c020 0x7f67dc0acff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45838/0 (socket says 172.21.15.55:45838) 2023-08-25T05:19:01.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.809+0000 7f67e292c640 1 -- 172.21.15.55:0/4010264738 learned_addr learned my addr 172.21.15.55:0/4010264738 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.813+0000 7f67e212b640 1 --2- 172.21.15.55:0/4010264738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67dc15a7f0 0x7f67dc09bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.813+0000 7f67e192a640 1 --2- 172.21.15.55:0/4010264738 >> v2:172.21.15.110:3300/0 conn(0x7f67dc0c9830 0x7f67dc070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.813+0000 7f67e1129640 1 -- 172.21.15.55:0/4010264738 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028860185 0 0) 0x7f67dc15abd0 con 0x7f67dc06c020 2023-08-25T05:19:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.813+0000 7f67e1129640 1 -- 172.21.15.55:0/4010264738 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67c8003530 con 0x7f67dc06c020 2023-08-25T05:19:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.813+0000 7f67e212b640 1 -- 172.21.15.55:0/4010264738 >> v2:172.21.15.110:3300/0 conn(0x7f67dc0c9830 msgr2=0x7f67dc070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.813+0000 7f67e212b640 1 --2- 172.21.15.55:0/4010264738 >> v2:172.21.15.110:3300/0 conn(0x7f67dc0c9830 0x7f67dc070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.813+0000 7f67e212b640 1 -- 172.21.15.55:0/4010264738 >> v1:172.21.15.55:6789/0 conn(0x7f67dc06c020 legacy=0x7f67dc0acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:01.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.813+0000 7f67e212b640 1 -- 172.21.15.55:0/4010264738 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc0c9030 con 0x7f67dc15a7f0 2023-08-25T05:19:01.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.813+0000 7f67e212b640 1 --2- 172.21.15.55:0/4010264738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67dc15a7f0 0x7f67dc09bde0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f67d80097a0 tx=0x7f67d801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b760dbbb9283eb3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:01.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.813+0000 7f67e1129640 1 -- 172.21.15.55:0/4010264738 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d80ab650 con 0x7f67dc15a7f0 2023-08-25T05:19:01.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.813+0000 7f67e1129640 1 -- 172.21.15.55:0/4010264738 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d80ab7b0 con 0x7f67dc15a7f0 2023-08-25T05:19:01.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.813+0000 7f67e1129640 1 -- 172.21.15.55:0/4010264738 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d80abb20 con 0x7f67dc15a7f0 2023-08-25T05:19:01.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e438f640 1 -- 172.21.15.55:0/4010264738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67dc15a7f0 msgr2=0x7f67dc09bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:01.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e438f640 1 --2- 172.21.15.55:0/4010264738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67dc15a7f0 0x7f67dc09bde0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f67d80097a0 tx=0x7f67d801c430 comp rx=0 tx=0).stop 2023-08-25T05:19:01.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e438f640 1 -- 172.21.15.55:0/4010264738 shutdown_connections 2023-08-25T05:19:01.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e438f640 1 --2- 172.21.15.55:0/4010264738 >> v2:172.21.15.110:3300/0 conn(0x7f67dc0c9830 0x7f67dc070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e438f640 1 --2- 172.21.15.55:0/4010264738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67dc15a7f0 0x7f67dc09bde0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e438f640 1 -- 172.21.15.55:0/4010264738 >> 172.21.15.55:0/4010264738 conn(0x7f67dc069900 msgr2=0x7f67dc069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:01.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e438f640 1 -- 172.21.15.55:0/4010264738 shutdown_connections 2023-08-25T05:19:01.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e438f640 1 -- 172.21.15.55:0/4010264738 wait complete. 2023-08-25T05:19:01.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e438f640 1 Processor -- start 2023-08-25T05:19:01.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e438f640 1 -- start start 2023-08-25T05:19:01.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e438f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67dc06c020 0x7f67dc0b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:01.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e438f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67dc0c9830 0x7f67dc157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:01.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e438f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc15a7f0 0x7f67dc098a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:01.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e438f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0b1840 con 0x7f67dc0c9830 2023-08-25T05:19:01.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e438f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0b1b20 con 0x7f67dc15a7f0 2023-08-25T05:19:01.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e438f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc0b1e00 con 0x7f67dc06c020 2023-08-25T05:19:01.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e192a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67dc0c9830 0x7f67dc157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:01.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e192a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67dc0c9830 0x7f67dc157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36890/0 (socket says 172.21.15.55:36890) 2023-08-25T05:19:01.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e192a640 1 -- 172.21.15.55:0/283923048 learned_addr learned my addr 172.21.15.55:0/283923048 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:01.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e212b640 1 --2- 172.21.15.55:0/283923048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67dc06c020 0x7f67dc0b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:01.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.817+0000 7f67e292c640 1 --2- 172.21.15.55:0/283923048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc15a7f0 0x7f67dc098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:01.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.821+0000 7f67e212b640 1 -- 172.21.15.55:0/283923048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc15a7f0 msgr2=0x7f67dc098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:01.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.821+0000 7f67e212b640 1 --2- 172.21.15.55:0/283923048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc15a7f0 0x7f67dc098a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.821+0000 7f67e212b640 1 -- 172.21.15.55:0/283923048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67dc0c9830 msgr2=0x7f67dc157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:01.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.821+0000 7f67e212b640 1 --2- 172.21.15.55:0/283923048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67dc0c9830 0x7f67dc157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.821+0000 7f67e212b640 1 -- 172.21.15.55:0/283923048 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d80093b0 con 0x7f67dc06c020 2023-08-25T05:19:01.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.821+0000 7f67e192a640 1 --2- 172.21.15.55:0/283923048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67dc0c9830 0x7f67dc157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:19:01.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.821+0000 7f67e212b640 1 --2- 172.21.15.55:0/283923048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67dc06c020 0x7f67dc0b0ff0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f67d80ac000 tx=0x7f67d801ac70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:01.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.821+0000 7f67d2ffd640 1 -- 172.21.15.55:0/283923048 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d8005ba0 con 0x7f67dc06c020 2023-08-25T05:19:01.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.821+0000 7f67d2ffd640 1 -- 172.21.15.55:0/283923048 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d8005d00 con 0x7f67dc06c020 2023-08-25T05:19:01.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.821+0000 7f67d2ffd640 1 -- 172.21.15.55:0/283923048 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d8006240 con 0x7f67dc06c020 2023-08-25T05:19:01.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.821+0000 7f67e438f640 1 -- 172.21.15.55:0/283923048 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67dc0adc90 con 0x7f67dc06c020 2023-08-25T05:19:01.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.821+0000 7f67e438f640 1 -- 172.21.15.55:0/283923048 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67dc0b23c0 con 0x7f67dc06c020 2023-08-25T05:19:01.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.821+0000 7f67e438f640 1 -- 172.21.15.55:0/283923048 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67dc06d5b0 con 0x7f67dc06c020 2023-08-25T05:19:01.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.821+0000 7f67d2ffd640 1 -- 172.21.15.55:0/283923048 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 85) v1 ==== 84673+0+0 (secure 0 0 0) 0x7f67d80063a0 con 0x7f67dc06c020 2023-08-25T05:19:01.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.825+0000 7f67d2ffd640 1 -- 172.21.15.55:0/283923048 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f67d811d230 con 0x7f67dc06c020 2023-08-25T05:19:01.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.825+0000 7f67d2ffd640 1 -- 172.21.15.55:0/283923048 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f67d80eaff0 con 0x7f67dc06c020 2023-08-25T05:19:01.988 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:01.985+0000 7f1e0a570180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:19:01.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.989+0000 7f67e438f640 1 -- 172.21.15.55:0/283923048 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f67dc0b25b0 con 0x7f67dc06c020 2023-08-25T05:19:01.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.989+0000 7f67d2ffd640 1 -- 172.21.15.55:0/283923048 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v159) v1 ==== 92+0+10 (secure 0 0 0) 0x7f67d80ee610 con 0x7f67dc06c020 2023-08-25T05:19:01.995 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T05:19:01.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.993+0000 7f67e438f640 1 -- 172.21.15.55:0/283923048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67dc06c020 msgr2=0x7f67dc0b0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:01.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.993+0000 7f67e438f640 1 --2- 172.21.15.55:0/283923048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67dc06c020 0x7f67dc0b0ff0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f67d80ac000 tx=0x7f67d801ac70 comp rx=0 tx=0).stop 2023-08-25T05:19:01.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.993+0000 7f67e438f640 1 -- 172.21.15.55:0/283923048 shutdown_connections 2023-08-25T05:19:01.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.993+0000 7f67e438f640 1 --2- 172.21.15.55:0/283923048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67dc15a7f0 0x7f67dc098a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.993+0000 7f67e438f640 1 --2- 172.21.15.55:0/283923048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67dc0c9830 0x7f67dc157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.993+0000 7f67e438f640 1 --2- 172.21.15.55:0/283923048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67dc06c020 0x7f67dc0b0ff0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:01.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.993+0000 7f67e438f640 1 -- 172.21.15.55:0/283923048 >> 172.21.15.55:0/283923048 conn(0x7f67dc069900 msgr2=0x7f67dc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:01.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.993+0000 7f67e438f640 1 -- 172.21.15.55:0/283923048 shutdown_connections 2023-08-25T05:19:01.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:01.993+0000 7f67e438f640 1 -- 172.21.15.55:0/283923048 wait complete. 2023-08-25T05:19:02.015 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T05:19:02.054 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:02.049+0000 7f1e0a570180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:19:02.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.161+0000 7fa162888640 1 Processor -- start 2023-08-25T05:19:02.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.161+0000 7fa162888640 1 -- start start 2023-08-25T05:19:02.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.161+0000 7fa162888640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa15c06c3b0 0x7fa15c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.161+0000 7fa162888640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa15c06c790 0x7fa15c06de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.161+0000 7fa162888640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15c0cab90 con 0x7fa15c0d1060 2023-08-25T05:19:02.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.161+0000 7fa162888640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15c06dbb0 con 0x7fa15c06c3b0 2023-08-25T05:19:02.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.161+0000 7fa162888640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c0cae50 con 0x7fa15c06c790 2023-08-25T05:19:02.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.161+0000 7fa15bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa15c06c3b0 0x7fa15c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.161+0000 7fa160e25640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa15c0d1060 0x7fa15c15c1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45852/0 (socket says 172.21.15.55:45852) 2023-08-25T05:19:02.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.161+0000 7fa160e25640 1 -- 172.21.15.55:0/3505799623 learned_addr learned my addr 172.21.15.55:0/3505799623 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:02.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.161+0000 7fa15b7fe640 1 --2- 172.21.15.55:0/3505799623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa15c06c790 0x7fa15c06de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.161+0000 7fa15bfff640 1 -- 172.21.15.55:0/3505799623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa15c06c790 msgr2=0x7fa15c06de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:02.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.161+0000 7fa15bfff640 1 --2- 172.21.15.55:0/3505799623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa15c06c790 0x7fa15c06de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.161+0000 7fa15bfff640 1 -- 172.21.15.55:0/3505799623 >> v1:172.21.15.55:6789/0 conn(0x7fa15c0d1060 legacy=0x7fa15c15c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:02.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.161+0000 7fa15bfff640 1 -- 172.21.15.55:0/3505799623 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c0cb130 con 0x7fa15c06c3b0 2023-08-25T05:19:02.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.161+0000 7fa15affd640 1 -- 172.21.15.55:0/3505799623 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341257403 0 0) 0x7fa15c0cab90 con 0x7fa15c0d1060 2023-08-25T05:19:02.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.165+0000 7fa15bfff640 1 --2- 172.21.15.55:0/3505799623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa15c06c3b0 0x7fa15c0cd7d0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fa14c0097a0 tx=0x7fa14c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4da853ab976c08 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:02.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.165+0000 7fa15affd640 1 -- 172.21.15.55:0/3505799623 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c0ab600 con 0x7fa15c06c3b0 2023-08-25T05:19:02.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.165+0000 7fa15affd640 1 -- 172.21.15.55:0/3505799623 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c0a7050 con 0x7fa15c06c3b0 2023-08-25T05:19:02.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.165+0000 7fa15affd640 1 -- 172.21.15.55:0/3505799623 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c0ab980 con 0x7fa15c06c3b0 2023-08-25T05:19:02.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.165+0000 7fa162888640 1 -- 172.21.15.55:0/3505799623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa15c06c3b0 msgr2=0x7fa15c0cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:02.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.165+0000 7fa162888640 1 --2- 172.21.15.55:0/3505799623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa15c06c3b0 0x7fa15c0cd7d0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fa14c0097a0 tx=0x7fa14c01c430 comp rx=0 tx=0).stop 2023-08-25T05:19:02.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.165+0000 7fa162888640 1 -- 172.21.15.55:0/3505799623 shutdown_connections 2023-08-25T05:19:02.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.165+0000 7fa162888640 1 --2- 172.21.15.55:0/3505799623 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa15c06c790 0x7fa15c06de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.165+0000 7fa162888640 1 --2- 172.21.15.55:0/3505799623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa15c06c3b0 0x7fa15c0cd7d0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.165+0000 7fa162888640 1 -- 172.21.15.55:0/3505799623 >> 172.21.15.55:0/3505799623 conn(0x7fa15c0d0540 msgr2=0x7fa15c0d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:02.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.165+0000 7fa162888640 1 -- 172.21.15.55:0/3505799623 shutdown_connections 2023-08-25T05:19:02.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.165+0000 7fa162888640 1 -- 172.21.15.55:0/3505799623 wait complete. 2023-08-25T05:19:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.165+0000 7fa162888640 1 Processor -- start 2023-08-25T05:19:02.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa162888640 1 -- start start 2023-08-25T05:19:02.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa162888640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa15c06c3b0 0x7fa15c154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa162888640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c06c790 0x7fa15c14ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa162888640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa15c0d1060 0x7fa15c154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa162888640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c151bb0 con 0x7fa15c0d1060 2023-08-25T05:19:02.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa162888640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c1504e0 con 0x7fa15c06c790 2023-08-25T05:19:02.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa162888640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c0c70b0 con 0x7fa15c06c3b0 2023-08-25T05:19:02.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa160e25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa15c0d1060 0x7fa15c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa160e25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa15c0d1060 0x7fa15c154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36916/0 (socket says 172.21.15.55:36916) 2023-08-25T05:19:02.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa160e25640 1 -- 172.21.15.55:0/2955973619 learned_addr learned my addr 172.21.15.55:0/2955973619 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:02.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa15b7fe640 1 --2- 172.21.15.55:0/2955973619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c06c790 0x7fa15c14ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa15bfff640 1 --2- 172.21.15.55:0/2955973619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa15c06c3b0 0x7fa15c154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa160e25640 1 -- 172.21.15.55:0/2955973619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa15c06c3b0 msgr2=0x7fa15c154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:02.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa160e25640 1 --2- 172.21.15.55:0/2955973619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa15c06c3b0 0x7fa15c154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa160e25640 1 -- 172.21.15.55:0/2955973619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c06c790 msgr2=0x7fa15c14ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:02.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa160e25640 1 --2- 172.21.15.55:0/2955973619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c06c790 0x7fa15c14ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa160e25640 1 -- 172.21.15.55:0/2955973619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c0093b0 con 0x7fa15c0d1060 2023-08-25T05:19:02.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa15b7fe640 1 --2- 172.21.15.55:0/2955973619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c06c790 0x7fa15c14ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:19:02.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa15bfff640 1 --2- 172.21.15.55:0/2955973619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa15c06c3b0 0x7fa15c154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:19:02.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa160e25640 1 --2- 172.21.15.55:0/2955973619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa15c0d1060 0x7fa15c154810 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fa15400c780 tx=0x7fa15400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:02.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa158ff9640 1 -- 172.21.15.55:0/2955973619 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15400ce90 con 0x7fa15c0d1060 2023-08-25T05:19:02.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa158ff9640 1 -- 172.21.15.55:0/2955973619 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15400a640 con 0x7fa15c0d1060 2023-08-25T05:19:02.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa158ff9640 1 -- 172.21.15.55:0/2955973619 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15400a9d0 con 0x7fa15c0d1060 2023-08-25T05:19:02.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa162888640 1 -- 172.21.15.55:0/2955973619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15c151210 con 0x7fa15c0d1060 2023-08-25T05:19:02.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa162888640 1 -- 172.21.15.55:0/2955973619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15c1517d0 con 0x7fa15c0d1060 2023-08-25T05:19:02.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.169+0000 7fa162888640 1 -- 172.21.15.55:0/2955973619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa15c151cf0 con 0x7fa15c0d1060 2023-08-25T05:19:02.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.173+0000 7fa158ff9640 1 -- 172.21.15.55:0/2955973619 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 85) v1 ==== 84673+0+0 (secure 0 0 0) 0x7fa15400ab30 con 0x7fa15c0d1060 2023-08-25T05:19:02.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.173+0000 7fa158ff9640 1 -- 172.21.15.55:0/2955973619 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fa154081ff0 con 0x7fa15c0d1060 2023-08-25T05:19:02.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.177+0000 7fa158ff9640 1 -- 172.21.15.55:0/2955973619 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa15c151cf0 con 0x7fa15c0d1060 2023-08-25T05:19:02.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.329+0000 7fa162888640 1 -- 172.21.15.55:0/2955973619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa15c151cf0 con 0x7fa15c0d1060 2023-08-25T05:19:02.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.333+0000 7fa158ff9640 1 -- 172.21.15.55:0/2955973619 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v159) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa154018020 con 0x7fa15c0d1060 2023-08-25T05:19:02.335 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T05:19:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.333+0000 7fa162888640 1 -- 172.21.15.55:0/2955973619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa15c0d1060 msgr2=0x7fa15c154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:02.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.333+0000 7fa162888640 1 --2- 172.21.15.55:0/2955973619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa15c0d1060 0x7fa15c154810 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fa15400c780 tx=0x7fa15400cc40 comp rx=0 tx=0).stop 2023-08-25T05:19:02.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.333+0000 7fa162888640 1 -- 172.21.15.55:0/2955973619 shutdown_connections 2023-08-25T05:19:02.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.333+0000 7fa162888640 1 --2- 172.21.15.55:0/2955973619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa15c0d1060 0x7fa15c154810 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.333+0000 7fa162888640 1 --2- 172.21.15.55:0/2955973619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa15c06c790 0x7fa15c14ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.333+0000 7fa162888640 1 --2- 172.21.15.55:0/2955973619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa15c06c3b0 0x7fa15c154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.333+0000 7fa162888640 1 -- 172.21.15.55:0/2955973619 >> 172.21.15.55:0/2955973619 conn(0x7fa15c0d0540 msgr2=0x7fa15c0ad1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:02.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.333+0000 7fa162888640 1 -- 172.21.15.55:0/2955973619 shutdown_connections 2023-08-25T05:19:02.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.333+0000 7fa162888640 1 -- 172.21.15.55:0/2955973619 wait complete. 2023-08-25T05:19:02.356 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T05:19:02.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.541+0000 7f75cc008640 1 Processor -- start 2023-08-25T05:19:02.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.541+0000 7f75cc008640 1 -- start start 2023-08-25T05:19:02.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.541+0000 7f75cc008640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75c40ce110 0x7f75c40cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.541+0000 7f75cc008640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75c40cd620 0x7f75c41646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.541+0000 7f75cc008640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c40ce5a0 con 0x7f75c415a840 2023-08-25T05:19:02.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.541+0000 7f75cc008640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c40cf640 con 0x7f75c40cd620 2023-08-25T05:19:02.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.541+0000 7f75cc008640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c40ce880 con 0x7f75c40ce110 2023-08-25T05:19:02.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.541+0000 7f75ca5a5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75c40cd620 0x7f75c41646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.541+0000 7f75ca5a5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75c40cd620 0x7f75c41646e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36924/0 (socket says 172.21.15.55:36924) 2023-08-25T05:19:02.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.541+0000 7f75ca5a5640 1 -- 172.21.15.55:0/15591682 learned_addr learned my addr 172.21.15.55:0/15591682 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:02.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.541+0000 7f75c95a3640 1 --2- 172.21.15.55:0/15591682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75c40ce110 0x7f75c40cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.541+0000 7f75ca5a5640 1 -- 172.21.15.55:0/15591682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75c40ce110 msgr2=0x7f75c40cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:02.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.541+0000 7f75ca5a5640 1 --2- 172.21.15.55:0/15591682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75c40ce110 0x7f75c40cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.541+0000 7f75ca5a5640 1 -- 172.21.15.55:0/15591682 >> v1:172.21.15.110:6789/0 conn(0x7f75c415a840 legacy=0x7f75c40ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:02.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.541+0000 7f75ca5a5640 1 -- 172.21.15.55:0/15591682 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c40ceb60 con 0x7f75c40cd620 2023-08-25T05:19:02.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.541+0000 7f75c95a3640 1 --2- 172.21.15.55:0/15591682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75c40ce110 0x7f75c40cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:02.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.545+0000 7f75ca5a5640 1 --2- 172.21.15.55:0/15591682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c40cd620 0x7f75c41646e0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009e50 tx=0x7f75bc01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b87e7e4810025e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:02.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.545+0000 7f75c8da2640 1 -- 172.21.15.55:0/15591682 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0a57d0 con 0x7f75c40cd620 2023-08-25T05:19:02.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.545+0000 7f75c8da2640 1 -- 172.21.15.55:0/15591682 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc0a5930 con 0x7f75c40cd620 2023-08-25T05:19:02.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.545+0000 7f75c8da2640 1 -- 172.21.15.55:0/15591682 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0a5cc0 con 0x7f75c40cd620 2023-08-25T05:19:02.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.545+0000 7f75cc008640 1 -- 172.21.15.55:0/15591682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c40cd620 msgr2=0x7f75c41646e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:02.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.545+0000 7f75cc008640 1 --2- 172.21.15.55:0/15591682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c40cd620 0x7f75c41646e0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009e50 tx=0x7f75bc01ca10 comp rx=0 tx=0).stop 2023-08-25T05:19:02.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.545+0000 7f75cc008640 1 -- 172.21.15.55:0/15591682 shutdown_connections 2023-08-25T05:19:02.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.545+0000 7f75cc008640 1 --2- 172.21.15.55:0/15591682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c40cd620 0x7f75c41646e0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.545+0000 7f75cc008640 1 --2- 172.21.15.55:0/15591682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75c40ce110 0x7f75c40cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.545+0000 7f75cc008640 1 -- 172.21.15.55:0/15591682 >> 172.21.15.55:0/15591682 conn(0x7f75c40d0540 msgr2=0x7f75c40d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:02.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.545+0000 7f75cc008640 1 -- 172.21.15.55:0/15591682 shutdown_connections 2023-08-25T05:19:02.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.545+0000 7f75cc008640 1 -- 172.21.15.55:0/15591682 wait complete. 2023-08-25T05:19:02.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75cc008640 1 Processor -- start 2023-08-25T05:19:02.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75cc008640 1 -- start start 2023-08-25T05:19:02.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75cc008640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75c40cd620 0x7f75c41637a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75cc008640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75c415a840 0x7f75c41f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75cc008640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c41f8d70 0x7f75c41f7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75cc008640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c41f66b0 con 0x7f75c41f8d70 2023-08-25T05:19:02.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75cc008640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c41f6990 con 0x7f75c40cd620 2023-08-25T05:19:02.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75cc008640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c41f6c70 con 0x7f75c415a840 2023-08-25T05:19:02.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75ca5a5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c41f8d70 0x7f75c41f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75ca5a5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c41f8d70 0x7f75c41f7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36928/0 (socket says 172.21.15.55:36928) 2023-08-25T05:19:02.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75ca5a5640 1 -- 172.21.15.55:0/2888621668 learned_addr learned my addr 172.21.15.55:0/2888621668 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:02.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75c95a3640 1 --2- 172.21.15.55:0/2888621668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75c415a840 0x7f75c41f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75c9da4640 1 --2- 172.21.15.55:0/2888621668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75c40cd620 0x7f75c41637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75ca5a5640 1 -- 172.21.15.55:0/2888621668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75c415a840 msgr2=0x7f75c41f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:02.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75ca5a5640 1 --2- 172.21.15.55:0/2888621668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75c415a840 0x7f75c41f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75ca5a5640 1 -- 172.21.15.55:0/2888621668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75c40cd620 msgr2=0x7f75c41637a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:02.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75ca5a5640 1 --2- 172.21.15.55:0/2888621668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75c40cd620 0x7f75c41637a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75ca5a5640 1 -- 172.21.15.55:0/2888621668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc009b30 con 0x7f75c41f8d70 2023-08-25T05:19:02.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75ca5a5640 1 --2- 172.21.15.55:0/2888621668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c41f8d70 0x7f75c41f7750 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f75bc01a640 tx=0x7f75bc0197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:02.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75ba7fc640 1 -- 172.21.15.55:0/2888621668 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0b8670 con 0x7f75c41f8d70 2023-08-25T05:19:02.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75ba7fc640 1 -- 172.21.15.55:0/2888621668 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc0b87d0 con 0x7f75c41f8d70 2023-08-25T05:19:02.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75ba7fc640 1 -- 172.21.15.55:0/2888621668 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0b8b80 con 0x7f75c41f8d70 2023-08-25T05:19:02.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75cc008640 1 -- 172.21.15.55:0/2888621668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c41f6f50 con 0x7f75c41f8d70 2023-08-25T05:19:02.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.549+0000 7f75cc008640 1 -- 172.21.15.55:0/2888621668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c4163ce0 con 0x7f75c41f8d70 2023-08-25T05:19:02.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.553+0000 7f75cc008640 1 -- 172.21.15.55:0/2888621668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c4073ec0 con 0x7f75c41f8d70 2023-08-25T05:19:02.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.553+0000 7f75ba7fc640 1 -- 172.21.15.55:0/2888621668 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 85) v1 ==== 84673+0+0 (secure 0 0 0) 0x7f75bc0b8ce0 con 0x7f75c41f8d70 2023-08-25T05:19:02.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.553+0000 7f75ba7fc640 1 -- 172.21.15.55:0/2888621668 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f75bc11e270 con 0x7f75c41f8d70 2023-08-25T05:19:02.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.557+0000 7f75ba7fc640 1 -- 172.21.15.55:0/2888621668 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f75bc0ebfc0 con 0x7f75c41f8d70 2023-08-25T05:19:02.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.713+0000 7f75ba7fc640 1 -- 172.21.15.55:0/2888621668 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 86) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f75bc0eba70 con 0x7f75c41f8d70 2023-08-25T05:19:02.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.713+0000 7f75ba7fc640 1 --2- 172.21.15.55:0/2888621668 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f75a806b440 0x7f75a806d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.713+0000 7f75c9da4640 1 --2- 172.21.15.55:0/2888621668 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f75a806b440 0x7f75a806d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.717+0000 7f75cc008640 1 -- 172.21.15.55:0/2888621668 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f75c4069cc0 con 0x7f75c41f8d70 2023-08-25T05:19:02.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.717+0000 7f75ba7fc640 1 -- 172.21.15.55:0/2888621668 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v159) v1 ==== 100+0+11 (secure 0 0 0) 0x7f75bc0b9f80 con 0x7f75c41f8d70 2023-08-25T05:19:02.721 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T05:19:02.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.721+0000 7f75cc008640 1 -- 172.21.15.55:0/2888621668 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f75a806b440 msgr2=0x7f75a806d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:02.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.721+0000 7f75cc008640 1 --2- 172.21.15.55:0/2888621668 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f75a806b440 0x7f75a806d830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7f75c0000fc0 tx=0x7f75c0009040 comp rx=0 tx=0).stop 2023-08-25T05:19:02.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.721+0000 7f75cc008640 1 -- 172.21.15.55:0/2888621668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c41f8d70 msgr2=0x7f75c41f7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:02.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.721+0000 7f75cc008640 1 --2- 172.21.15.55:0/2888621668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c41f8d70 0x7f75c41f7750 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f75bc01a640 tx=0x7f75bc0197b0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.721+0000 7f75cc008640 1 -- 172.21.15.55:0/2888621668 shutdown_connections 2023-08-25T05:19:02.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.721+0000 7f75cc008640 1 --2- 172.21.15.55:0/2888621668 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75c41f8d70 0x7f75c41f7750 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.721+0000 7f75cc008640 1 --2- 172.21.15.55:0/2888621668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75c415a840 0x7f75c41f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.721+0000 7f75cc008640 1 --2- 172.21.15.55:0/2888621668 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f75a806b440 0x7f75a806d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.721+0000 7f75cc008640 1 --2- 172.21.15.55:0/2888621668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75c40cd620 0x7f75c41637a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.721+0000 7f75cc008640 1 -- 172.21.15.55:0/2888621668 >> 172.21.15.55:0/2888621668 conn(0x7f75c40d0540 msgr2=0x7f75c4164290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:02.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.721+0000 7f75cc008640 1 -- 172.21.15.55:0/2888621668 shutdown_connections 2023-08-25T05:19:02.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.721+0000 7f75cc008640 1 -- 172.21.15.55:0/2888621668 wait complete. 2023-08-25T05:19:02.743 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:19:02.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efca21ba640 1 Processor -- start 2023-08-25T05:19:02.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efca21ba640 1 -- start start 2023-08-25T05:19:02.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efca21ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc9c0d0da0 0x7efc9c0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efca21ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efc9c0cdde0 0x7efc9c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efca21ba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9c0b29b0 con 0x7efc9c0cee60 2023-08-25T05:19:02.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efca21ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9c0ce760 con 0x7efc9c0cdde0 2023-08-25T05:19:02.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efca21ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0d16c0 con 0x7efc9c0d0da0 2023-08-25T05:19:02.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efc9bfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efc9c0cee60 0x7efc9c0cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45864/0 (socket says 172.21.15.55:45864) 2023-08-25T05:19:02.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efc9bfff640 1 -- 172.21.15.55:0/2058807699 learned_addr learned my addr 172.21.15.55:0/2058807699 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:02.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efc9b7fe640 1 --2- 172.21.15.55:0/2058807699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc9c0d0da0 0x7efc9c0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efc93fff640 1 --2- 172.21.15.55:0/2058807699 >> v2:172.21.15.110:3300/0 conn(0x7efc9c0cdde0 0x7efc9c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efc9affd640 1 -- 172.21.15.55:0/2058807699 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747107934 0 0) 0x7efc9c0b29b0 con 0x7efc9c0cee60 2023-08-25T05:19:02.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efc9affd640 1 -- 172.21.15.55:0/2058807699 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc88003530 con 0x7efc9c0cee60 2023-08-25T05:19:02.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efc9affd640 1 -- 172.21.15.55:0/2058807699 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2773923095 0 0) 0x7efc88003530 con 0x7efc9c0cee60 2023-08-25T05:19:02.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efc9affd640 1 -- 172.21.15.55:0/2058807699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc9c0d0da0 msgr2=0x7efc9c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:02.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efc9affd640 1 --2- 172.21.15.55:0/2058807699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc9c0d0da0 0x7efc9c0d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efc9affd640 1 -- 172.21.15.55:0/2058807699 >> v2:172.21.15.110:3300/0 conn(0x7efc9c0cdde0 msgr2=0x7efc9c0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:02.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efc9affd640 1 --2- 172.21.15.55:0/2058807699 >> v2:172.21.15.110:3300/0 conn(0x7efc9c0cdde0 0x7efc9c0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efc9affd640 1 -- 172.21.15.55:0/2058807699 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c0b1dc0 con 0x7efc9c0cee60 2023-08-25T05:19:02.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.885+0000 7efc9affd640 1 -- 172.21.15.55:0/2058807699 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7efc94001a00 con 0x7efc9c0cee60 2023-08-25T05:19:02.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc9affd640 1 -- 172.21.15.55:0/2058807699 >> v1:172.21.15.55:6789/0 conn(0x7efc9c0cee60 legacy=0x7efc9c0cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:02.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc9affd640 1 --2- 172.21.15.55:0/2058807699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc9c0d0da0 0x7efc88003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc9affd640 1 --2- 172.21.15.55:0/2058807699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc88003f00 0x7efc880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc9affd640 1 --2- 172.21.15.55:0/2058807699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc88004d10 0x7efc88005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc9affd640 1 -- 172.21.15.55:0/2058807699 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0ce760 con 0x7efc88003f00 2023-08-25T05:19:02.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc9affd640 1 -- 172.21.15.55:0/2058807699 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0d16c0 con 0x7efc88004d10 2023-08-25T05:19:02.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc9affd640 1 -- 172.21.15.55:0/2058807699 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8800b9c0 con 0x7efc9c0d0da0 2023-08-25T05:19:02.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc93fff640 1 --2- 172.21.15.55:0/2058807699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc88003f00 0x7efc880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc9b7fe640 1 --2- 172.21.15.55:0/2058807699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc9c0d0da0 0x7efc88003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc9bfff640 1 --2- 172.21.15.55:0/2058807699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc88004d10 0x7efc88005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc93fff640 1 -- 172.21.15.55:0/2058807699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc9c0d0da0 msgr2=0x7efc88003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:02.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc93fff640 1 --2- 172.21.15.55:0/2058807699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc9c0d0da0 0x7efc88003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc93fff640 1 -- 172.21.15.55:0/2058807699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc88004d10 msgr2=0x7efc88005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:02.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc93fff640 1 --2- 172.21.15.55:0/2058807699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc88004d10 0x7efc88005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc93fff640 1 -- 172.21.15.55:0/2058807699 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc88003530 con 0x7efc88003f00 2023-08-25T05:19:02.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc93fff640 1 --2- 172.21.15.55:0/2058807699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc88003f00 0x7efc880047d0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7efc84009ae0 tx=0x7efc8401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b121b80ff4f22782 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:02.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc9affd640 1 -- 172.21.15.55:0/2058807699 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc840a5680 con 0x7efc88003f00 2023-08-25T05:19:02.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc9affd640 1 -- 172.21.15.55:0/2058807699 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc840a57e0 con 0x7efc88003f00 2023-08-25T05:19:02.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.889+0000 7efc9affd640 1 -- 172.21.15.55:0/2058807699 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc840a5b90 con 0x7efc88003f00 2023-08-25T05:19:02.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efca21ba640 1 -- 172.21.15.55:0/2058807699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc88003f00 msgr2=0x7efc880047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:02.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efca21ba640 1 --2- 172.21.15.55:0/2058807699 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc88003f00 0x7efc880047d0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7efc84009ae0 tx=0x7efc8401ca90 comp rx=0 tx=0).stop 2023-08-25T05:19:02.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efc9bfff640 1 -- 172.21.15.55:0/2058807699 reap_dead start 2023-08-25T05:19:02.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efca21ba640 1 -- 172.21.15.55:0/2058807699 shutdown_connections 2023-08-25T05:19:02.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efca21ba640 1 -- 172.21.15.55:0/2058807699 >> 172.21.15.55:0/2058807699 conn(0x7efc9c09bae0 msgr2=0x7efc9c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:02.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efca21ba640 1 -- 172.21.15.55:0/2058807699 shutdown_connections 2023-08-25T05:19:02.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efca21ba640 1 -- 172.21.15.55:0/2058807699 wait complete. 2023-08-25T05:19:02.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efca21ba640 1 Processor -- start 2023-08-25T05:19:02.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efca21ba640 1 -- start start 2023-08-25T05:19:02.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efca21ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc88003f00 0x7efc9c0cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efca21ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc9c0c8080 0x7efc9c0c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efca21ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc9c0c6980 0x7efc9c1f54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efca21ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0c7b80 con 0x7efc88003f00 2023-08-25T05:19:02.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efca21ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0c8590 con 0x7efc9c0c8080 2023-08-25T05:19:02.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efca21ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0c8870 con 0x7efc9c0c6980 2023-08-25T05:19:02.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efc9b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc88003f00 0x7efc9c0cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efc9b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc88003f00 0x7efc9c0cc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36948/0 (socket says 172.21.15.55:36948) 2023-08-25T05:19:02.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efc9b7fe640 1 -- 172.21.15.55:0/2348488877 learned_addr learned my addr 172.21.15.55:0/2348488877 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:02.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efc93fff640 1 --2- 172.21.15.55:0/2348488877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc9c0c8080 0x7efc9c0c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.893+0000 7efc9bfff640 1 --2- 172.21.15.55:0/2348488877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc9c0c6980 0x7efc9c1f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.897+0000 7efc9b7fe640 1 -- 172.21.15.55:0/2348488877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc9c0c6980 msgr2=0x7efc9c1f54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:02.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.897+0000 7efc9b7fe640 1 --2- 172.21.15.55:0/2348488877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc9c0c6980 0x7efc9c1f54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.897+0000 7efc9b7fe640 1 -- 172.21.15.55:0/2348488877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc9c0c8080 msgr2=0x7efc9c0c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:02.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.897+0000 7efc9b7fe640 1 --2- 172.21.15.55:0/2348488877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc9c0c8080 0x7efc9c0c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:02.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.897+0000 7efc9b7fe640 1 -- 172.21.15.55:0/2348488877 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c0c8b50 con 0x7efc88003f00 2023-08-25T05:19:02.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.897+0000 7efc9b7fe640 1 --2- 172.21.15.55:0/2348488877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc88003f00 0x7efc9c0cc030 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0119d0 tx=0x7efc8c011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:02.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.897+0000 7efc98ff9640 1 -- 172.21.15.55:0/2348488877 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c005bb0 con 0x7efc88003f00 2023-08-25T05:19:02.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.897+0000 7efc98ff9640 1 -- 172.21.15.55:0/2348488877 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c005d10 con 0x7efc88003f00 2023-08-25T05:19:02.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.897+0000 7efc98ff9640 1 -- 172.21.15.55:0/2348488877 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00faa0 con 0x7efc88003f00 2023-08-25T05:19:02.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.897+0000 7efca21ba640 1 -- 172.21.15.55:0/2348488877 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9c0c8e30 con 0x7efc88003f00 2023-08-25T05:19:02.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.897+0000 7efca21ba640 1 -- 172.21.15.55:0/2348488877 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9c1f5a10 con 0x7efc88003f00 2023-08-25T05:19:02.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.897+0000 7efca21ba640 1 -- 172.21.15.55:0/2348488877 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9c04dbe0 con 0x7efc88003f00 2023-08-25T05:19:02.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.897+0000 7efc98ff9640 1 -- 172.21.15.55:0/2348488877 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 86) v1 ==== 84800+0+0 (secure 0 0 0) 0x7efc8c00fc00 con 0x7efc88003f00 2023-08-25T05:19:02.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.897+0000 7efc98ff9640 1 --2- 172.21.15.55:0/2348488877 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7efc7c0654d0 0x7efc7c067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:02.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.897+0000 7efc98ff9640 1 -- 172.21.15.55:0/2348488877 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6750+0+0 (secure 0 0 0) 0x7efc8c0833d0 con 0x7efc88003f00 2023-08-25T05:19:02.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.901+0000 7efc93fff640 1 --2- 172.21.15.55:0/2348488877 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7efc7c0654d0 0x7efc7c067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:02.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.901+0000 7efc93fff640 1 --2- 172.21.15.55:0/2348488877 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7efc7c0654d0 0x7efc7c067990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efc840af000 tx=0x7efc840046d0 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:02.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:02.905+0000 7efc98ff9640 1 -- 172.21.15.55:0/2348488877 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7efc8c050f10 con 0x7efc88003f00 2023-08-25T05:19:03.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.089+0000 7efca21ba640 1 -- 172.21.15.55:0/2348488877 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc9c0b2610 con 0x7efc88003f00 2023-08-25T05:19:03.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.089+0000 7efc98ff9640 1 -- 172.21.15.55:0/2348488877 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4877 (secure 0 0 0) 0x7efc8c054530 con 0x7efc88003f00 2023-08-25T05:19:03.095 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:03.095 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8911,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/381737607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":381737607},{"type":"v1","addr":"172.21.15.55:6834","nonce":381737607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":8917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/775518941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":775518941},{"type":"v1","addr":"172.21.15.110:6836","nonce":775518941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":8920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1426163963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1426163963},{"type":"v1","addr":"172.21.15.110:6837","nonce":1426163963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:18:42.381096+0000","modified":"2023-08-25T05:18:46.026870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9618},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9618":{"gid":9618,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3591663387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3591663387},{"type":"v1","addr":"172.21.15.55:6835","nonce":3591663387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-25T05:19:03.095 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 74 2023-08-25T05:19:03.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.093+0000 7efca21ba640 1 -- 172.21.15.55:0/2348488877 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7efc7c0654d0 msgr2=0x7efc7c067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:03.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.093+0000 7efca21ba640 1 --2- 172.21.15.55:0/2348488877 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7efc7c0654d0 0x7efc7c067990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efc840af000 tx=0x7efc840046d0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.093+0000 7efca21ba640 1 -- 172.21.15.55:0/2348488877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc88003f00 msgr2=0x7efc9c0cc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:03.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.093+0000 7efca21ba640 1 --2- 172.21.15.55:0/2348488877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc88003f00 0x7efc9c0cc030 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0119d0 tx=0x7efc8c011dd0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.093+0000 7efca21ba640 1 -- 172.21.15.55:0/2348488877 shutdown_connections 2023-08-25T05:19:03.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.093+0000 7efca21ba640 1 --2- 172.21.15.55:0/2348488877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc9c0c6980 0x7efc9c1f54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.093+0000 7efca21ba640 1 --2- 172.21.15.55:0/2348488877 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7efc7c0654d0 0x7efc7c067990 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.093+0000 7efca21ba640 1 --2- 172.21.15.55:0/2348488877 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc9c0c8080 0x7efc9c0c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.093+0000 7efca21ba640 1 --2- 172.21.15.55:0/2348488877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc88003f00 0x7efc9c0cc030 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.093+0000 7efca21ba640 1 -- 172.21.15.55:0/2348488877 >> 172.21.15.55:0/2348488877 conn(0x7efc9c09bae0 msgr2=0x7efc9c06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:03.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.093+0000 7efca21ba640 1 -- 172.21.15.55:0/2348488877 shutdown_connections 2023-08-25T05:19:03.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.093+0000 7efca21ba640 1 -- 172.21.15.55:0/2348488877 wait complete. 2023-08-25T05:19:03.116 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:19:03.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.257+0000 7f0013d96640 1 Processor -- start 2023-08-25T05:19:03.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.257+0000 7f0013d96640 1 -- start start 2023-08-25T05:19:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.257+0000 7f0013d96640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f000c0d0da0 0x7f000c0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:03.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.257+0000 7f0013d96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f000c0cdde0 0x7f000c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:03.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.257+0000 7f0013d96640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c0b29b0 con 0x7f000c0cee60 2023-08-25T05:19:03.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.257+0000 7f0013d96640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000c0ce760 con 0x7f000c0cdde0 2023-08-25T05:19:03.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.257+0000 7f0013d96640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000c0d16c0 con 0x7f000c0d0da0 2023-08-25T05:19:03.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.257+0000 7f0011331640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f000c0cdde0 0x7f000c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:03.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.257+0000 7f0011331640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f000c0cdde0 0x7f000c0ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36958/0 (socket says 172.21.15.55:36958) 2023-08-25T05:19:03.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.257+0000 7f0012333640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f000c0cee60 0x7f000c0cf2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45866/0 (socket says 172.21.15.55:45866) 2023-08-25T05:19:03.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.257+0000 7f0011331640 1 -- 172.21.15.55:0/4086403414 learned_addr learned my addr 172.21.15.55:0/4086403414 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:03.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.257+0000 7f0011b32640 1 --2- 172.21.15.55:0/4086403414 >> v2:172.21.15.110:3300/0 conn(0x7f000c0d0da0 0x7f000c0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:03.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.257+0000 7f0011331640 1 -- 172.21.15.55:0/4086403414 >> v2:172.21.15.110:3300/0 conn(0x7f000c0d0da0 msgr2=0x7f000c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:03.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.257+0000 7f0011331640 1 --2- 172.21.15.55:0/4086403414 >> v2:172.21.15.110:3300/0 conn(0x7f000c0d0da0 0x7f000c0d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.257+0000 7f0011331640 1 -- 172.21.15.55:0/4086403414 >> v1:172.21.15.55:6789/0 conn(0x7f000c0cee60 legacy=0x7f000c0cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:03.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.257+0000 7f0011331640 1 -- 172.21.15.55:0/4086403414 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c0b1dc0 con 0x7f000c0cdde0 2023-08-25T05:19:03.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.257+0000 7f0010b30640 1 -- 172.21.15.55:0/4086403414 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070735621 0 0) 0x7f000c0b29b0 con 0x7f000c0cee60 2023-08-25T05:19:03.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.261+0000 7f0011331640 1 --2- 172.21.15.55:0/4086403414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f000c0cdde0 0x7f000c0ce220 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f000c073720 tx=0x7efffc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d0284226c8f7d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:03.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.261+0000 7f0010b30640 1 -- 172.21.15.55:0/4086403414 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc0a89f0 con 0x7f000c0cdde0 2023-08-25T05:19:03.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.261+0000 7f0010b30640 1 -- 172.21.15.55:0/4086403414 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc0a8b50 con 0x7f000c0cdde0 2023-08-25T05:19:03.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.261+0000 7f0010b30640 1 -- 172.21.15.55:0/4086403414 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc0b0440 con 0x7f000c0cdde0 2023-08-25T05:19:03.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.261+0000 7f0013d96640 1 -- 172.21.15.55:0/4086403414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f000c0cdde0 msgr2=0x7f000c0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:03.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.261+0000 7f0013d96640 1 --2- 172.21.15.55:0/4086403414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f000c0cdde0 0x7f000c0ce220 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f000c073720 tx=0x7efffc01ecf0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.261+0000 7f0013d96640 1 -- 172.21.15.55:0/4086403414 shutdown_connections 2023-08-25T05:19:03.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.261+0000 7f0013d96640 1 --2- 172.21.15.55:0/4086403414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f000c0cdde0 0x7f000c0ce220 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.261+0000 7f0013d96640 1 --2- 172.21.15.55:0/4086403414 >> v2:172.21.15.110:3300/0 conn(0x7f000c0d0da0 0x7f000c0d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.261+0000 7f0013d96640 1 -- 172.21.15.55:0/4086403414 >> 172.21.15.55:0/4086403414 conn(0x7f000c09bae0 msgr2=0x7f000c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:03.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.261+0000 7f0013d96640 1 -- 172.21.15.55:0/4086403414 shutdown_connections 2023-08-25T05:19:03.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.261+0000 7f0013d96640 1 -- 172.21.15.55:0/4086403414 wait complete. 2023-08-25T05:19:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0013d96640 1 Processor -- start 2023-08-25T05:19:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0013d96640 1 -- start start 2023-08-25T05:19:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0013d96640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f000c0cdde0 0x7f000c15f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0013d96640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f000c0cee60 0x7f000c14c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0013d96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f000c0d0da0 0x7f000c15ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0013d96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c14a6b0 con 0x7f000c0d0da0 2023-08-25T05:19:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0013d96640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c0b6430 con 0x7f000c0cdde0 2023-08-25T05:19:03.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0013d96640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000c14d440 con 0x7f000c0cee60 2023-08-25T05:19:03.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0012333640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f000c0d0da0 0x7f000c15ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:03.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0012333640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f000c0d0da0 0x7f000c15ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36962/0 (socket says 172.21.15.55:36962) 2023-08-25T05:19:03.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0012333640 1 -- 172.21.15.55:0/1451439632 learned_addr learned my addr 172.21.15.55:0/1451439632 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:03.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0011b32640 1 --2- 172.21.15.55:0/1451439632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f000c0cdde0 0x7f000c15f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:03.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0011331640 1 --2- 172.21.15.55:0/1451439632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f000c0cee60 0x7f000c14c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:03.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0012333640 1 -- 172.21.15.55:0/1451439632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f000c0cee60 msgr2=0x7f000c14c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:03.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0012333640 1 --2- 172.21.15.55:0/1451439632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f000c0cee60 0x7f000c14c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0012333640 1 -- 172.21.15.55:0/1451439632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f000c0cdde0 msgr2=0x7f000c15f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:03.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0012333640 1 --2- 172.21.15.55:0/1451439632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f000c0cdde0 0x7f000c15f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0012333640 1 -- 172.21.15.55:0/1451439632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc0094d0 con 0x7f000c0d0da0 2023-08-25T05:19:03.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0012333640 1 --2- 172.21.15.55:0/1451439632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f000c0d0da0 0x7f000c15ce80 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f000400c7a0 tx=0x7f000400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:03.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f00027fc640 1 -- 172.21.15.55:0/1451439632 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000400a640 con 0x7f000c0d0da0 2023-08-25T05:19:03.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f00027fc640 1 -- 172.21.15.55:0/1451439632 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000400a7a0 con 0x7f000c0d0da0 2023-08-25T05:19:03.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f00027fc640 1 -- 172.21.15.55:0/1451439632 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000400abd0 con 0x7f000c0d0da0 2023-08-25T05:19:03.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0013d96640 1 -- 172.21.15.55:0/1451439632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000c14d720 con 0x7f000c0d0da0 2023-08-25T05:19:03.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.265+0000 7f0013d96640 1 -- 172.21.15.55:0/1451439632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000c0b6920 con 0x7f000c0d0da0 2023-08-25T05:19:03.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.269+0000 7f0013d96640 1 -- 172.21.15.55:0/1451439632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000c04dbe0 con 0x7f000c0d0da0 2023-08-25T05:19:03.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.269+0000 7f00027fc640 1 -- 172.21.15.55:0/1451439632 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 86) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f000400ad30 con 0x7f000c0d0da0 2023-08-25T05:19:03.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.269+0000 7f00027fc640 1 --2- 172.21.15.55:0/1451439632 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7efff00654d0 0x7efff0067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:03.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.269+0000 7f00027fc640 1 -- 172.21.15.55:0/1451439632 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f00040821a0 con 0x7f000c0d0da0 2023-08-25T05:19:03.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.269+0000 7f0011b32640 1 --2- 172.21.15.55:0/1451439632 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7efff00654d0 0x7efff0067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:03.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.269+0000 7f0011b32640 1 --2- 172.21.15.55:0/1451439632 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7efff00654d0 0x7efff0067990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0008009b40 tx=0x7f0008006f90 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:03.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.273+0000 7f00027fc640 1 -- 172.21.15.55:0/1451439632 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f000404fda0 con 0x7f000c0d0da0 2023-08-25T05:19:03.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.429+0000 7f0013d96640 1 -- 172.21.15.55:0/1451439632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f000c0d0b80 con 0x7f000c0d0da0 2023-08-25T05:19:03.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.429+0000 7f00027fc640 1 -- 172.21.15.55:0/1451439632 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+19338 (secure 0 0 0) 0x7f0004018090 con 0x7f000c0d0da0 2023-08-25T05:19:03.434 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:03.434 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":159,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:19:01.703993+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:18:40.053897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-25T05:18:41.441905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3737721083":"2023-08-26T05:19:01.703962+0000","172.21.15.110:0/3805989963":"2023-08-26T05:19:01.703962+0000","172.21.15.110:0/702058312":"2023-08-26T05:19:01.703962+0000","172.21.15.110:0/1806042334":"2023-08-26T05:19:01.703962+0000","172.21.15.110:6833/3704357441":"2023-08-26T05:19:01.703962+0000","172.21.15.110:6832/3704357441":"2023-08-26T05:19:01.703962+0000","172.21.15.110:0/3176170740":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/3759935208":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/2816190802":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/978380102":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/1555733326":"2023-08-26T05:19:01.703962+0000","172.21.15.110:0/3822005312":"2023-08-26T05:19:01.703962+0000","172.21.15.110:6833/4256905777":"2023-08-26T05:18:54.845562+0000","172.21.15.110:6832/4256905777":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/1948062482":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/2661104133":"2023-08-26T05:18:54.845562+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:19:03.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.433+0000 7f0013d96640 1 -- 172.21.15.55:0/1451439632 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7efff00654d0 msgr2=0x7efff0067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:03.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.433+0000 7f0013d96640 1 --2- 172.21.15.55:0/1451439632 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7efff00654d0 0x7efff0067990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0008009b40 tx=0x7f0008006f90 comp rx=0 tx=0).stop 2023-08-25T05:19:03.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.433+0000 7f0013d96640 1 -- 172.21.15.55:0/1451439632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f000c0d0da0 msgr2=0x7f000c15ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:03.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.433+0000 7f0013d96640 1 --2- 172.21.15.55:0/1451439632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f000c0d0da0 0x7f000c15ce80 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f000400c7a0 tx=0x7f000400cc60 comp rx=0 tx=0).stop 2023-08-25T05:19:03.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.433+0000 7f0013d96640 1 -- 172.21.15.55:0/1451439632 shutdown_connections 2023-08-25T05:19:03.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.433+0000 7f0013d96640 1 --2- 172.21.15.55:0/1451439632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f000c0d0da0 0x7f000c15ce80 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.433+0000 7f0013d96640 1 --2- 172.21.15.55:0/1451439632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f000c0cee60 0x7f000c14c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.433+0000 7f0013d96640 1 --2- 172.21.15.55:0/1451439632 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7efff00654d0 0x7efff0067990 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.433+0000 7f0013d96640 1 --2- 172.21.15.55:0/1451439632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f000c0cdde0 0x7f000c15f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.433+0000 7f0013d96640 1 -- 172.21.15.55:0/1451439632 >> 172.21.15.55:0/1451439632 conn(0x7f000c09bae0 msgr2=0x7f000c0cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:03.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.433+0000 7f0013d96640 1 -- 172.21.15.55:0/1451439632 shutdown_connections 2023-08-25T05:19:03.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.433+0000 7f0013d96640 1 -- 172.21.15.55:0/1451439632 wait complete. 2023-08-25T05:19:03.455 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-25T05:19:03.456 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:19:03.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.597+0000 7ff455937640 1 Processor -- start 2023-08-25T05:19:03.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.597+0000 7ff455937640 1 -- start start 2023-08-25T05:19:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.597+0000 7ff455937640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff45015c9c0 0x7ff450160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.597+0000 7ff455937640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45006eaf0 con 0x7ff45006b2b0 2023-08-25T05:19:03.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.597+0000 7ff455937640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45006e530 con 0x7ff4500cfa70 2023-08-25T05:19:03.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.597+0000 7ff455937640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45006e810 con 0x7ff45015c9c0 2023-08-25T05:19:03.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.597+0000 7ff44effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff45015c9c0 0x7ff450160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:03.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.597+0000 7ff44f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff45006b2b0 0x7ff45006b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45868/0 (socket says 172.21.15.55:45868) 2023-08-25T05:19:03.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.601+0000 7ff44f7fe640 1 -- 172.21.15.55:0/948350003 learned_addr learned my addr 172.21.15.55:0/948350003 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.601+0000 7ff44effd640 1 -- 172.21.15.55:0/948350003 >> v1:172.21.15.110:6789/0 conn(0x7ff4500cfa70 legacy=0x7ff450160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.601+0000 7ff44effd640 1 -- 172.21.15.55:0/948350003 >> v1:172.21.15.55:6789/0 conn(0x7ff45006b2b0 legacy=0x7ff45006b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.601+0000 7ff44effd640 1 -- 172.21.15.55:0/948350003 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45006aab0 con 0x7ff45015c9c0 2023-08-25T05:19:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.601+0000 7ff44effd640 1 --2- 172.21.15.55:0/948350003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff45015c9c0 0x7ff450160510 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7ff4400097a0 tx=0x7ff44001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=259c58ece0b363bd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.601+0000 7ff44e7fc640 1 -- 172.21.15.55:0/948350003 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4400ab5f0 con 0x7ff45015c9c0 2023-08-25T05:19:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.601+0000 7ff44e7fc640 1 -- 172.21.15.55:0/948350003 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4400ab750 con 0x7ff45015c9c0 2023-08-25T05:19:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.601+0000 7ff44e7fc640 1 -- 172.21.15.55:0/948350003 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4400abae0 con 0x7ff45015c9c0 2023-08-25T05:19:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.601+0000 7ff455937640 1 -- 172.21.15.55:0/948350003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff45015c9c0 msgr2=0x7ff450160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.601+0000 7ff455937640 1 --2- 172.21.15.55:0/948350003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff45015c9c0 0x7ff450160510 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7ff4400097a0 tx=0x7ff44001c430 comp rx=0 tx=0).stop 2023-08-25T05:19:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff455937640 1 -- 172.21.15.55:0/948350003 shutdown_connections 2023-08-25T05:19:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff455937640 1 --2- 172.21.15.55:0/948350003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff45015c9c0 0x7ff450160510 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff455937640 1 -- 172.21.15.55:0/948350003 >> 172.21.15.55:0/948350003 conn(0x7ff4500d05a0 msgr2=0x7ff4500d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff455937640 1 -- 172.21.15.55:0/948350003 shutdown_connections 2023-08-25T05:19:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff455937640 1 -- 172.21.15.55:0/948350003 wait complete. 2023-08-25T05:19:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff455937640 1 Processor -- start 2023-08-25T05:19:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff455937640 1 -- start start 2023-08-25T05:19:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff455937640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff45006b2b0 0x7ff450158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff455937640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4500cfa70 0x7ff4501524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff455937640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff45015c9c0 0x7ff4501f8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff455937640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff450153420 con 0x7ff45015c9c0 2023-08-25T05:19:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff455937640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff450152e60 con 0x7ff45006b2b0 2023-08-25T05:19:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff455937640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff450153140 con 0x7ff4500cfa70 2023-08-25T05:19:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff44f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff45015c9c0 0x7ff4501f8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:03.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff44effd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff45006b2b0 0x7ff450158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:03.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff44f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff45015c9c0 0x7ff4501f8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36986/0 (socket says 172.21.15.55:36986) 2023-08-25T05:19:03.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff44f7fe640 1 -- 172.21.15.55:0/2178455748 learned_addr learned my addr 172.21.15.55:0/2178455748 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:03.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff44effd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff45006b2b0 0x7ff450158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:33768/0 (socket says 172.21.15.55:33768) 2023-08-25T05:19:03.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff4467fc640 1 --2- 172.21.15.55:0/2178455748 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4500cfa70 0x7ff4501524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff44f7fe640 1 -- 172.21.15.55:0/2178455748 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4500cfa70 msgr2=0x7ff4501524c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff44f7fe640 1 --2- 172.21.15.55:0/2178455748 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4500cfa70 0x7ff4501524c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff44f7fe640 1 -- 172.21.15.55:0/2178455748 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff45006b2b0 msgr2=0x7ff450158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff44f7fe640 1 --2- 172.21.15.55:0/2178455748 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff45006b2b0 0x7ff450158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.605+0000 7ff44f7fe640 1 -- 172.21.15.55:0/2178455748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4400093b0 con 0x7ff45015c9c0 2023-08-25T05:19:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.609+0000 7ff44f7fe640 1 --2- 172.21.15.55:0/2178455748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff45015c9c0 0x7ff4501f8310 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7ff44800cbc0 tx=0x7ff44800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.609+0000 7ff44cff9640 1 -- 172.21.15.55:0/2178455748 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44800ad40 con 0x7ff45015c9c0 2023-08-25T05:19:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.609+0000 7ff44cff9640 1 -- 172.21.15.55:0/2178455748 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff448012400 con 0x7ff45015c9c0 2023-08-25T05:19:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.609+0000 7ff455937640 1 -- 172.21.15.55:0/2178455748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff450138100 con 0x7ff45015c9c0 2023-08-25T05:19:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.609+0000 7ff44cff9640 1 -- 172.21.15.55:0/2178455748 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44800aea0 con 0x7ff45015c9c0 2023-08-25T05:19:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.609+0000 7ff455937640 1 -- 172.21.15.55:0/2178455748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff450152a00 con 0x7ff45015c9c0 2023-08-25T05:19:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.609+0000 7ff455937640 1 -- 172.21.15.55:0/2178455748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45004dbe0 con 0x7ff45015c9c0 2023-08-25T05:19:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.609+0000 7ff44cff9640 1 -- 172.21.15.55:0/2178455748 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 86) v1 ==== 84800+0+0 (secure 0 0 0) 0x7ff448007070 con 0x7ff45015c9c0 2023-08-25T05:19:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.609+0000 7ff44cff9640 1 --2- 172.21.15.55:0/2178455748 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7ff4300654d0 0x7ff430067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.609+0000 7ff44cff9640 1 -- 172.21.15.55:0/2178455748 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6750+0+0 (secure 0 0 0) 0x7ff448082c90 con 0x7ff45015c9c0 2023-08-25T05:19:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.609+0000 7ff44effd640 1 --2- 172.21.15.55:0/2178455748 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7ff4300654d0 0x7ff430067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.613+0000 7ff44effd640 1 --2- 172.21.15.55:0/2178455748 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7ff4300654d0 0x7ff430067990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff4400af000 tx=0x7ff4400a7000 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.613+0000 7ff44cff9640 1 -- 172.21.15.55:0/2178455748 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff448050740 con 0x7ff45015c9c0 2023-08-25T05:19:03.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.809+0000 7ff455937640 1 -- 172.21.15.55:0/2178455748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4500cdc20 con 0x7ff45015c9c0 2023-08-25T05:19:03.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.809+0000 7ff44cff9640 1 -- 172.21.15.55:0/2178455748 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4877 (secure 0 0 0) 0x7ff448017090 con 0x7ff45015c9c0 2023-08-25T05:19:03.815 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:03.815 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8911,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/381737607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":381737607},{"type":"v1","addr":"172.21.15.55:6834","nonce":381737607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":8917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/775518941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":775518941},{"type":"v1","addr":"172.21.15.110:6836","nonce":775518941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":8920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1426163963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1426163963},{"type":"v1","addr":"172.21.15.110:6837","nonce":1426163963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:18:42.381096+0000","modified":"2023-08-25T05:18:46.026870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9618},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9618":{"gid":9618,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3591663387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3591663387},{"type":"v1","addr":"172.21.15.55:6835","nonce":3591663387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-25T05:19:03.815 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 74 2023-08-25T05:19:03.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.813+0000 7ff455937640 1 -- 172.21.15.55:0/2178455748 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7ff4300654d0 msgr2=0x7ff430067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:03.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.813+0000 7ff455937640 1 --2- 172.21.15.55:0/2178455748 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7ff4300654d0 0x7ff430067990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff4400af000 tx=0x7ff4400a7000 comp rx=0 tx=0).stop 2023-08-25T05:19:03.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.813+0000 7ff455937640 1 -- 172.21.15.55:0/2178455748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff45015c9c0 msgr2=0x7ff4501f8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.813+0000 7ff455937640 1 --2- 172.21.15.55:0/2178455748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff45015c9c0 0x7ff4501f8310 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7ff44800cbc0 tx=0x7ff44800a430 comp rx=0 tx=0).stop 2023-08-25T05:19:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.813+0000 7ff455937640 1 -- 172.21.15.55:0/2178455748 shutdown_connections 2023-08-25T05:19:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.813+0000 7ff455937640 1 --2- 172.21.15.55:0/2178455748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff45015c9c0 0x7ff4501f8310 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.813+0000 7ff455937640 1 --2- 172.21.15.55:0/2178455748 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4500cfa70 0x7ff4501524c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.813+0000 7ff455937640 1 --2- 172.21.15.55:0/2178455748 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7ff4300654d0 0x7ff430067990 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.813+0000 7ff455937640 1 --2- 172.21.15.55:0/2178455748 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff45006b2b0 0x7ff450158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.813+0000 7ff455937640 1 -- 172.21.15.55:0/2178455748 >> 172.21.15.55:0/2178455748 conn(0x7ff4500d05a0 msgr2=0x7ff4501574b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:03.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.813+0000 7ff455937640 1 -- 172.21.15.55:0/2178455748 shutdown_connections 2023-08-25T05:19:03.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.813+0000 7ff455937640 1 -- 172.21.15.55:0/2178455748 wait complete. 2023-08-25T05:19:03.835 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:19:03.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.981+0000 7f0505c34640 1 Processor -- start 2023-08-25T05:19:03.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.985+0000 7f0505c34640 1 -- start start 2023-08-25T05:19:03.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.985+0000 7f0505c34640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f05000d0da0 0x7f05000d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:03.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.985+0000 7f0505c34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05000cdde0 0x7f05000ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:03.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.985+0000 7f0505c34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05000cee60 0x7f05000cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:03.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.985+0000 7f0505c34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05000ce760 con 0x7f05000cee60 2023-08-25T05:19:03.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.985+0000 7f0505c34640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05000b29b0 con 0x7f05000d0da0 2023-08-25T05:19:03.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.985+0000 7f0505c34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05000d16c0 con 0x7f05000cdde0 2023-08-25T05:19:03.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.985+0000 7f04fffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05000cee60 0x7f05000cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:03.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.985+0000 7f04fffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05000cee60 0x7f05000cf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36992/0 (socket says 172.21.15.55:36992) 2023-08-25T05:19:03.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.985+0000 7f04fffff640 1 -- 172.21.15.55:0/1234975370 learned_addr learned my addr 172.21.15.55:0/1234975370 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:03.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.985+0000 7f04f7fff640 1 --2- 172.21.15.55:0/1234975370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05000cdde0 0x7f05000ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:03.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.985+0000 7f04ff7fe640 1 --2- 172.21.15.55:0/1234975370 >> v2:172.21.15.110:3300/0 conn(0x7f05000d0da0 0x7f05000d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:03.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.985+0000 7f04fffff640 1 -- 172.21.15.55:0/1234975370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05000cdde0 msgr2=0x7f05000ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:03.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.985+0000 7f04fffff640 1 --2- 172.21.15.55:0/1234975370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05000cdde0 0x7f05000ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.985+0000 7f04fffff640 1 -- 172.21.15.55:0/1234975370 >> v2:172.21.15.110:3300/0 conn(0x7f05000d0da0 msgr2=0x7f05000d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:03.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.985+0000 7f04fffff640 1 --2- 172.21.15.55:0/1234975370 >> v2:172.21.15.110:3300/0 conn(0x7f05000d0da0 0x7f05000d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.985+0000 7f04fffff640 1 -- 172.21.15.55:0/1234975370 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05000b1dc0 con 0x7f05000cee60 2023-08-25T05:19:03.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.989+0000 7f04fffff640 1 --2- 172.21.15.55:0/1234975370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000cee60 0x7f05000cf2f0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f0500073720 tx=0x7f04f801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d4033cd4f23750 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:03.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.989+0000 7f04feffd640 1 -- 172.21.15.55:0/1234975370 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80af400 con 0x7f05000cee60 2023-08-25T05:19:03.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.989+0000 7f04feffd640 1 -- 172.21.15.55:0/1234975370 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f80ab050 con 0x7f05000cee60 2023-08-25T05:19:03.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.989+0000 7f04feffd640 1 -- 172.21.15.55:0/1234975370 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80af780 con 0x7f05000cee60 2023-08-25T05:19:03.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.989+0000 7f0505c34640 1 -- 172.21.15.55:0/1234975370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000cee60 msgr2=0x7f05000cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:03.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.989+0000 7f0505c34640 1 --2- 172.21.15.55:0/1234975370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000cee60 0x7f05000cf2f0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f0500073720 tx=0x7f04f801f1c0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.989+0000 7f0505c34640 1 -- 172.21.15.55:0/1234975370 shutdown_connections 2023-08-25T05:19:03.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.989+0000 7f0505c34640 1 --2- 172.21.15.55:0/1234975370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000cee60 0x7f05000cf2f0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.989+0000 7f0505c34640 1 --2- 172.21.15.55:0/1234975370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05000cdde0 0x7f05000ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.989+0000 7f0505c34640 1 --2- 172.21.15.55:0/1234975370 >> v2:172.21.15.110:3300/0 conn(0x7f05000d0da0 0x7f05000d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:03.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.989+0000 7f0505c34640 1 -- 172.21.15.55:0/1234975370 >> 172.21.15.55:0/1234975370 conn(0x7f050009bae0 msgr2=0x7f05000d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:03.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.989+0000 7f0505c34640 1 -- 172.21.15.55:0/1234975370 shutdown_connections 2023-08-25T05:19:03.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.989+0000 7f0505c34640 1 -- 172.21.15.55:0/1234975370 wait complete. 2023-08-25T05:19:03.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.989+0000 7f0505c34640 1 Processor -- start 2023-08-25T05:19:03.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.989+0000 7f0505c34640 1 -- start start 2023-08-25T05:19:03.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f0505c34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05000cdde0 0x7f05000c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:03.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f0505c34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05000cee60 0x7f0500151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:04.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f0505c34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000d0da0 0x7f05000b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:04.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f0505c34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05000ca8e0 con 0x7f05000d0da0 2023-08-25T05:19:04.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f0505c34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05000b7720 con 0x7f05000cee60 2023-08-25T05:19:04.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f0505c34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05000c6f60 con 0x7f05000cdde0 2023-08-25T05:19:04.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f04fffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000d0da0 0x7f05000b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:04.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f04fffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000d0da0 0x7f05000b5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37008/0 (socket says 172.21.15.55:37008) 2023-08-25T05:19:04.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f04fffff640 1 -- 172.21.15.55:0/3379610473 learned_addr learned my addr 172.21.15.55:0/3379610473 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:04.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f04f7fff640 1 --2- 172.21.15.55:0/3379610473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05000cee60 0x7f0500151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:04.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f04ff7fe640 1 --2- 172.21.15.55:0/3379610473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05000cdde0 0x7f05000c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:04.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f04fffff640 1 -- 172.21.15.55:0/3379610473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05000cdde0 msgr2=0x7f05000c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:04.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f04fffff640 1 --2- 172.21.15.55:0/3379610473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05000cdde0 0x7f05000c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f04fffff640 1 -- 172.21.15.55:0/3379610473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05000cee60 msgr2=0x7f0500151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:04.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f04fffff640 1 --2- 172.21.15.55:0/3379610473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05000cee60 0x7f0500151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f04fffff640 1 -- 172.21.15.55:0/3379610473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f8009b30 con 0x7f05000d0da0 2023-08-25T05:19:04.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f04fffff640 1 --2- 172.21.15.55:0/3379610473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000d0da0 0x7f05000b5df0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f04f801d870 tx=0x7f04f801bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:04.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f04fcff9640 1 -- 172.21.15.55:0/3379610473 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80afc80 con 0x7f05000d0da0 2023-08-25T05:19:04.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f04fcff9640 1 -- 172.21.15.55:0/3379610473 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f80afde0 con 0x7f05000d0da0 2023-08-25T05:19:04.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f0505c34640 1 -- 172.21.15.55:0/3379610473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05000b6e80 con 0x7f05000d0da0 2023-08-25T05:19:04.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f04fcff9640 1 -- 172.21.15.55:0/3379610473 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80b8640 con 0x7f05000d0da0 2023-08-25T05:19:04.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f0505c34640 1 -- 172.21.15.55:0/3379610473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05000b7440 con 0x7f05000d0da0 2023-08-25T05:19:04.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.993+0000 7f0505c34640 1 -- 172.21.15.55:0/3379610473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05000cad00 con 0x7f05000d0da0 2023-08-25T05:19:04.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.997+0000 7f04fcff9640 1 -- 172.21.15.55:0/3379610473 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 87) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f04f80b6040 con 0x7f05000d0da0 2023-08-25T05:19:04.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.997+0000 7f04fcff9640 1 --2- 172.21.15.55:0/3379610473 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f04e0065710 0x7f04e0067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:04.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.997+0000 7f04fcff9640 1 -- 172.21.15.55:0/3379610473 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f04f8120f70 con 0x7f05000d0da0 2023-08-25T05:19:04.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.997+0000 7f04ff7fe640 1 --2- 172.21.15.55:0/3379610473 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f04e0065710 0x7f04e0067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:04.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:03.997+0000 7f04ff7fe640 1 --2- 172.21.15.55:0/3379610473 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f04e0065710 0x7f04e0067bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009b40 tx=0x7f04f0006f90 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:04.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.001+0000 7f04fcff9640 1 -- 172.21.15.55:0/3379610473 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f05000cad00 con 0x7f05000d0da0 2023-08-25T05:19:04.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.189+0000 7f0505c34640 1 -- 172.21.15.55:0/3379610473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05000cad00 con 0x7f05000d0da0 2023-08-25T05:19:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.193+0000 7f04fcff9640 1 -- 172.21.15.55:0/3379610473 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4877 (secure 0 0 0) 0x7f05000cad00 con 0x7f05000d0da0 2023-08-25T05:19:04.196 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:04.196 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8911,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/381737607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":381737607},{"type":"v1","addr":"172.21.15.55:6834","nonce":381737607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":8917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/775518941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":775518941},{"type":"v1","addr":"172.21.15.110:6836","nonce":775518941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":8920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1426163963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1426163963},{"type":"v1","addr":"172.21.15.110:6837","nonce":1426163963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:18:42.381096+0000","modified":"2023-08-25T05:18:46.026870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9618},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9618":{"gid":9618,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3591663387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3591663387},{"type":"v1","addr":"172.21.15.55:6835","nonce":3591663387}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-08-25T05:19:04.199 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 74 2023-08-25T05:19:04.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.193+0000 7f0505c34640 1 -- 172.21.15.55:0/3379610473 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f04e0065710 msgr2=0x7f04e0067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:04.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.193+0000 7f0505c34640 1 --2- 172.21.15.55:0/3379610473 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f04e0065710 0x7f04e0067bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009b40 tx=0x7f04f0006f90 comp rx=0 tx=0).stop 2023-08-25T05:19:04.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.193+0000 7f0505c34640 1 -- 172.21.15.55:0/3379610473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000d0da0 msgr2=0x7f05000b5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:04.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.193+0000 7f0505c34640 1 --2- 172.21.15.55:0/3379610473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000d0da0 0x7f05000b5df0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f04f801d870 tx=0x7f04f801bf60 comp rx=0 tx=0).stop 2023-08-25T05:19:04.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.193+0000 7f0505c34640 1 -- 172.21.15.55:0/3379610473 shutdown_connections 2023-08-25T05:19:04.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.193+0000 7f0505c34640 1 --2- 172.21.15.55:0/3379610473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05000d0da0 0x7f05000b5df0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.193+0000 7f0505c34640 1 --2- 172.21.15.55:0/3379610473 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f04e0065710 0x7f04e0067bd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.193+0000 7f0505c34640 1 --2- 172.21.15.55:0/3379610473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05000cee60 0x7f0500151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.193+0000 7f0505c34640 1 --2- 172.21.15.55:0/3379610473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05000cdde0 0x7f05000c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.193+0000 7f0505c34640 1 -- 172.21.15.55:0/3379610473 >> 172.21.15.55:0/3379610473 conn(0x7f050009bae0 msgr2=0x7f05000b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:04.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.193+0000 7f0505c34640 1 -- 172.21.15.55:0/3379610473 shutdown_connections 2023-08-25T05:19:04.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.193+0000 7f0505c34640 1 -- 172.21.15.55:0/3379610473 wait complete. 2023-08-25T05:19:04.217 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:19:04.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.357+0000 7fac2cb03640 1 Processor -- start 2023-08-25T05:19:04.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.357+0000 7fac2cb03640 1 -- start start 2023-08-25T05:19:04.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.357+0000 7fac2cb03640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac2815c9c0 0x7fac28160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:04.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.357+0000 7fac2cb03640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fac280cfa70 0x7fac28160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:04.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.357+0000 7fac2cb03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac28160f90 0x7fac280ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:04.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.357+0000 7fac2cb03640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2806eaf0 con 0x7fac2815c9c0 2023-08-25T05:19:04.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.357+0000 7fac2cb03640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2806e530 con 0x7fac280cfa70 2023-08-25T05:19:04.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.357+0000 7fac2cb03640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2806e810 con 0x7fac28160f90 2023-08-25T05:19:04.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.357+0000 7fac2659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac2815c9c0 0x7fac28160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:04.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.357+0000 7fac2659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac2815c9c0 0x7fac28160510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37024/0 (socket says 172.21.15.55:37024) 2023-08-25T05:19:04.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.357+0000 7fac2659c640 1 -- 172.21.15.55:0/2351186558 learned_addr learned my addr 172.21.15.55:0/2351186558 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:04.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.357+0000 7fac26d9d640 1 --2- 172.21.15.55:0/2351186558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac28160f90 0x7fac280ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:04.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.357+0000 7fac1ffff640 1 --2- 172.21.15.55:0/2351186558 >> v2:172.21.15.110:3300/0 conn(0x7fac280cfa70 0x7fac28160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:04.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.361+0000 7fac2659c640 1 -- 172.21.15.55:0/2351186558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac28160f90 msgr2=0x7fac280ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:04.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.361+0000 7fac2659c640 1 --2- 172.21.15.55:0/2351186558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac28160f90 0x7fac280ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.361+0000 7fac2659c640 1 -- 172.21.15.55:0/2351186558 >> v2:172.21.15.110:3300/0 conn(0x7fac280cfa70 msgr2=0x7fac28160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:04.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.361+0000 7fac2659c640 1 --2- 172.21.15.55:0/2351186558 >> v2:172.21.15.110:3300/0 conn(0x7fac280cfa70 0x7fac28160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.361+0000 7fac2659c640 1 -- 172.21.15.55:0/2351186558 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2806aab0 con 0x7fac2815c9c0 2023-08-25T05:19:04.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.361+0000 7fac26d9d640 1 --2- 172.21.15.55:0/2351186558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac28160f90 0x7fac280ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:04.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.361+0000 7fac2659c640 1 --2- 172.21.15.55:0/2351186558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2815c9c0 0x7fac28160510 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fac280d16a0 tx=0x7fac1801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110ea6616d604fd5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:04.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.361+0000 7fac25d9b640 1 -- 172.21.15.55:0/2351186558 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180ac600 con 0x7fac2815c9c0 2023-08-25T05:19:04.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.361+0000 7fac25d9b640 1 -- 172.21.15.55:0/2351186558 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac180a8050 con 0x7fac2815c9c0 2023-08-25T05:19:04.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.361+0000 7fac25d9b640 1 -- 172.21.15.55:0/2351186558 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180ac980 con 0x7fac2815c9c0 2023-08-25T05:19:04.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac2cb03640 1 -- 172.21.15.55:0/2351186558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2815c9c0 msgr2=0x7fac28160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:04.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac2cb03640 1 --2- 172.21.15.55:0/2351186558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2815c9c0 0x7fac28160510 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fac280d16a0 tx=0x7fac1801c4d0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac2cb03640 1 -- 172.21.15.55:0/2351186558 shutdown_connections 2023-08-25T05:19:04.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac2cb03640 1 --2- 172.21.15.55:0/2351186558 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac28160f90 0x7fac280ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac2cb03640 1 --2- 172.21.15.55:0/2351186558 >> v2:172.21.15.110:3300/0 conn(0x7fac280cfa70 0x7fac28160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac2cb03640 1 --2- 172.21.15.55:0/2351186558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2815c9c0 0x7fac28160510 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac2cb03640 1 -- 172.21.15.55:0/2351186558 >> 172.21.15.55:0/2351186558 conn(0x7fac280d05a0 msgr2=0x7fac280d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:04.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac2cb03640 1 -- 172.21.15.55:0/2351186558 shutdown_connections 2023-08-25T05:19:04.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac2cb03640 1 -- 172.21.15.55:0/2351186558 wait complete. 2023-08-25T05:19:04.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac2cb03640 1 Processor -- start 2023-08-25T05:19:04.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac2cb03640 1 -- start start 2023-08-25T05:19:04.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac2cb03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac280cfa70 0x7fac28157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:04.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac2cb03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2815c9c0 0x7fac28151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:04.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac2cb03640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac28160f90 0x7fac2815a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:04.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac2cb03640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac28158500 con 0x7fac2815c9c0 2023-08-25T05:19:04.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac2cb03640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2814fcb0 con 0x7fac28160f90 2023-08-25T05:19:04.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac2cb03640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2814ff90 con 0x7fac280cfa70 2023-08-25T05:19:04.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac1ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2815c9c0 0x7fac28151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:04.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac1ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2815c9c0 0x7fac28151ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37028/0 (socket says 172.21.15.55:37028) 2023-08-25T05:19:04.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac1ffff640 1 -- 172.21.15.55:0/3042804628 learned_addr learned my addr 172.21.15.55:0/3042804628 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:04.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac1ffff640 1 -- 172.21.15.55:0/3042804628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac280cfa70 msgr2=0x7fac28157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:04.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac1ffff640 1 --2- 172.21.15.55:0/3042804628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac280cfa70 0x7fac28157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac1ffff640 1 -- 172.21.15.55:0/3042804628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac28160f90 msgr2=0x7fac2815a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:04.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac1ffff640 1 --2- 172.21.15.55:0/3042804628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac28160f90 0x7fac2815a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.365+0000 7fac1ffff640 1 -- 172.21.15.55:0/3042804628 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac18009480 con 0x7fac2815c9c0 2023-08-25T05:19:04.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.369+0000 7fac1ffff640 1 --2- 172.21.15.55:0/3042804628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2815c9c0 0x7fac28151ee0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fac1000e930 tx=0x7fac1000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:04.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.369+0000 7fac1effd640 1 -- 172.21.15.55:0/3042804628 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10009690 con 0x7fac2815c9c0 2023-08-25T05:19:04.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.369+0000 7fac1effd640 1 -- 172.21.15.55:0/3042804628 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1000ca00 con 0x7fac2815c9c0 2023-08-25T05:19:04.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.369+0000 7fac1effd640 1 -- 172.21.15.55:0/3042804628 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1000cd70 con 0x7fac2815c9c0 2023-08-25T05:19:04.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.369+0000 7fac2cb03640 1 -- 172.21.15.55:0/3042804628 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac28150270 con 0x7fac2815c9c0 2023-08-25T05:19:04.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.369+0000 7fac2cb03640 1 -- 172.21.15.55:0/3042804628 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2814bdd0 con 0x7fac2815c9c0 2023-08-25T05:19:04.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.369+0000 7fac2cb03640 1 -- 172.21.15.55:0/3042804628 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2804dbe0 con 0x7fac2815c9c0 2023-08-25T05:19:04.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.369+0000 7fac1effd640 1 -- 172.21.15.55:0/3042804628 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 87) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fac10013470 con 0x7fac2815c9c0 2023-08-25T05:19:04.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.369+0000 7fac1effd640 1 --2- 172.21.15.55:0/3042804628 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fac08065710 0x7fac08067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:04.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.369+0000 7fac1effd640 1 -- 172.21.15.55:0/3042804628 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fac100833f0 con 0x7fac2815c9c0 2023-08-25T05:19:04.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.373+0000 7fac2659c640 1 --2- 172.21.15.55:0/3042804628 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fac08065710 0x7fac08067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:04.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.373+0000 7fac2659c640 1 --2- 172.21.15.55:0/3042804628 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fac08065710 0x7fac08067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fac180ae000 tx=0x7fac18004740 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:04.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.373+0000 7fac1effd640 1 -- 172.21.15.55:0/3042804628 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fac10050bd0 con 0x7fac2815c9c0 2023-08-25T05:19:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.533+0000 7fac2cb03640 1 -- 172.21.15.55:0/3042804628 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac280d0360 con 0x7fac2815c9c0 2023-08-25T05:19:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.533+0000 7fac1effd640 1 -- 172.21.15.55:0/3042804628 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+19338 (secure 0 0 0) 0x7fac100541f0 con 0x7fac2815c9c0 2023-08-25T05:19:04.538 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:04.538 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":159,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:19:01.703993+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:18:40.053897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-25T05:18:41.441905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/3737721083":"2023-08-26T05:19:01.703962+0000","172.21.15.110:0/3805989963":"2023-08-26T05:19:01.703962+0000","172.21.15.110:0/702058312":"2023-08-26T05:19:01.703962+0000","172.21.15.110:0/1806042334":"2023-08-26T05:19:01.703962+0000","172.21.15.110:6833/3704357441":"2023-08-26T05:19:01.703962+0000","172.21.15.110:6832/3704357441":"2023-08-26T05:19:01.703962+0000","172.21.15.110:0/3176170740":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/3759935208":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/2816190802":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/978380102":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/1555733326":"2023-08-26T05:19:01.703962+0000","172.21.15.110:0/3822005312":"2023-08-26T05:19:01.703962+0000","172.21.15.110:6833/4256905777":"2023-08-26T05:18:54.845562+0000","172.21.15.110:6832/4256905777":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/1948062482":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/2661104133":"2023-08-26T05:18:54.845562+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:19:04.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.537+0000 7fac2cb03640 1 -- 172.21.15.55:0/3042804628 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fac08065710 msgr2=0x7fac08067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:04.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.537+0000 7fac2cb03640 1 --2- 172.21.15.55:0/3042804628 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fac08065710 0x7fac08067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fac180ae000 tx=0x7fac18004740 comp rx=0 tx=0).stop 2023-08-25T05:19:04.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.537+0000 7fac2cb03640 1 -- 172.21.15.55:0/3042804628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2815c9c0 msgr2=0x7fac28151ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:04.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.537+0000 7fac2cb03640 1 --2- 172.21.15.55:0/3042804628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2815c9c0 0x7fac28151ee0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fac1000e930 tx=0x7fac1000edf0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.537+0000 7fac2cb03640 1 -- 172.21.15.55:0/3042804628 shutdown_connections 2023-08-25T05:19:04.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.537+0000 7fac2cb03640 1 --2- 172.21.15.55:0/3042804628 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fac08065710 0x7fac08067bd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.537+0000 7fac2cb03640 1 --2- 172.21.15.55:0/3042804628 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac28160f90 0x7fac2815a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.537+0000 7fac2cb03640 1 --2- 172.21.15.55:0/3042804628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2815c9c0 0x7fac28151ee0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.537+0000 7fac2cb03640 1 --2- 172.21.15.55:0/3042804628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac280cfa70 0x7fac28157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.537+0000 7fac2cb03640 1 -- 172.21.15.55:0/3042804628 >> 172.21.15.55:0/3042804628 conn(0x7fac280d05a0 msgr2=0x7fac28158770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:04.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.537+0000 7fac2cb03640 1 -- 172.21.15.55:0/3042804628 shutdown_connections 2023-08-25T05:19:04.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.537+0000 7fac2cb03640 1 -- 172.21.15.55:0/3042804628 wait complete. 2023-08-25T05:19:04.559 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-25T05:19:04.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.701+0000 7fdc2f29c640 1 Processor -- start 2023-08-25T05:19:04.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.701+0000 7fdc2f29c640 1 -- start start 2023-08-25T05:19:04.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.701+0000 7fdc2f29c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc280d0da0 0x7fdc280d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:04.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.701+0000 7fdc2f29c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc280cdde0 0x7fdc280ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:04.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.701+0000 7fdc2f29c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc280b29b0 con 0x7fdc280cee60 2023-08-25T05:19:04.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.701+0000 7fdc2f29c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc280ce760 con 0x7fdc280d0da0 2023-08-25T05:19:04.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.701+0000 7fdc2f29c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc280d16c0 con 0x7fdc280cdde0 2023-08-25T05:19:04.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.701+0000 7fdc2d038640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc280d0da0 0x7fdc280d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:04.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.701+0000 7fdc2d839640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdc280cee60 0x7fdc280cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45878/0 (socket says 172.21.15.55:45878) 2023-08-25T05:19:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.701+0000 7fdc2d839640 1 -- 172.21.15.55:0/453761497 learned_addr learned my addr 172.21.15.55:0/453761497 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.701+0000 7fdc2d038640 1 -- 172.21.15.55:0/453761497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc280cdde0 msgr2=0x7fdc280ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.701+0000 7fdc2d038640 1 --2- 172.21.15.55:0/453761497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc280cdde0 0x7fdc280ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.701+0000 7fdc2d038640 1 -- 172.21.15.55:0/453761497 >> v1:172.21.15.55:6789/0 conn(0x7fdc280cee60 legacy=0x7fdc280cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:04.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.701+0000 7fdc2d038640 1 -- 172.21.15.55:0/453761497 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc280b1dc0 con 0x7fdc280d0da0 2023-08-25T05:19:04.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.705+0000 7fdc2d038640 1 --2- 172.21.15.55:0/453761497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc280d0da0 0x7fdc280d1180 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fdc240097a0 tx=0x7fdc2401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2dfc774b7ef256 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:04.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.705+0000 7fdc1ffff640 1 -- 172.21.15.55:0/453761497 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc240a8950 con 0x7fdc280d0da0 2023-08-25T05:19:04.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.705+0000 7fdc1ffff640 1 -- 172.21.15.55:0/453761497 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc240a8ab0 con 0x7fdc280d0da0 2023-08-25T05:19:04.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.705+0000 7fdc1ffff640 1 -- 172.21.15.55:0/453761497 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc240a8e40 con 0x7fdc280d0da0 2023-08-25T05:19:04.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.705+0000 7fdc2f29c640 1 -- 172.21.15.55:0/453761497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc280d0da0 msgr2=0x7fdc280d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:04.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.705+0000 7fdc2f29c640 1 --2- 172.21.15.55:0/453761497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc280d0da0 0x7fdc280d1180 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fdc240097a0 tx=0x7fdc2401ec50 comp rx=0 tx=0).stop 2023-08-25T05:19:04.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.705+0000 7fdc2f29c640 1 -- 172.21.15.55:0/453761497 shutdown_connections 2023-08-25T05:19:04.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.705+0000 7fdc2f29c640 1 --2- 172.21.15.55:0/453761497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc280cdde0 0x7fdc280ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.705+0000 7fdc2f29c640 1 --2- 172.21.15.55:0/453761497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc280d0da0 0x7fdc280d1180 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.705+0000 7fdc2f29c640 1 -- 172.21.15.55:0/453761497 >> 172.21.15.55:0/453761497 conn(0x7fdc2809bae0 msgr2=0x7fdc280d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:04.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.705+0000 7fdc2f29c640 1 -- 172.21.15.55:0/453761497 shutdown_connections 2023-08-25T05:19:04.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.705+0000 7fdc2f29c640 1 -- 172.21.15.55:0/453761497 wait complete. 2023-08-25T05:19:04.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2f29c640 1 Processor -- start 2023-08-25T05:19:04.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2f29c640 1 -- start start 2023-08-25T05:19:04.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2f29c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc280cdde0 0x7fdc280b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:04.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2f29c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc280cee60 0x7fdc280b6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:04.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2f29c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc280d0da0 0x7fdc280b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:04.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2f29c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc281f6300 con 0x7fdc280cee60 2023-08-25T05:19:04.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2f29c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc281f5430 con 0x7fdc280cdde0 2023-08-25T05:19:04.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2f29c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc281f5680 con 0x7fdc280d0da0 2023-08-25T05:19:04.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2c837640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc280cee60 0x7fdc280b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:04.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2c837640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc280cee60 0x7fdc280b6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37042/0 (socket says 172.21.15.55:37042) 2023-08-25T05:19:04.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2c837640 1 -- 172.21.15.55:0/1152906934 learned_addr learned my addr 172.21.15.55:0/1152906934 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:04.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2d839640 1 --2- 172.21.15.55:0/1152906934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc280d0da0 0x7fdc280b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:04.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2d038640 1 --2- 172.21.15.55:0/1152906934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc280cdde0 0x7fdc280b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:04.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2c837640 1 -- 172.21.15.55:0/1152906934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc280d0da0 msgr2=0x7fdc280b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:04.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2c837640 1 --2- 172.21.15.55:0/1152906934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc280d0da0 0x7fdc280b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2c837640 1 -- 172.21.15.55:0/1152906934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc280cdde0 msgr2=0x7fdc280b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:04.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2c837640 1 --2- 172.21.15.55:0/1152906934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc280cdde0 0x7fdc280b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2c837640 1 -- 172.21.15.55:0/1152906934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc240093b0 con 0x7fdc280cee60 2023-08-25T05:19:04.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2c837640 1 --2- 172.21.15.55:0/1152906934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc280cee60 0x7fdc280b6890 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800b550 tx=0x7fdc1800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:04.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc1dffb640 1 -- 172.21.15.55:0/1152906934 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18010870 con 0x7fdc280cee60 2023-08-25T05:19:04.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc1dffb640 1 -- 172.21.15.55:0/1152906934 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc180109f0 con 0x7fdc280cee60 2023-08-25T05:19:04.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2f29c640 1 -- 172.21.15.55:0/1152906934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc281f5960 con 0x7fdc280cee60 2023-08-25T05:19:04.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc1dffb640 1 -- 172.21.15.55:0/1152906934 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18010da0 con 0x7fdc280cee60 2023-08-25T05:19:04.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2f29c640 1 -- 172.21.15.55:0/1152906934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc281f5f20 con 0x7fdc280cee60 2023-08-25T05:19:04.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.709+0000 7fdc2f29c640 1 -- 172.21.15.55:0/1152906934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2804dbe0 con 0x7fdc280cee60 2023-08-25T05:19:04.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.713+0000 7fdc1dffb640 1 -- 172.21.15.55:0/1152906934 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 87) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fdc1800f3c0 con 0x7fdc280cee60 2023-08-25T05:19:04.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.713+0000 7fdc1dffb640 1 --2- 172.21.15.55:0/1152906934 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fdc0c065710 0x7fdc0c067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:04.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.713+0000 7fdc1dffb640 1 -- 172.21.15.55:0/1152906934 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fdc18083180 con 0x7fdc280cee60 2023-08-25T05:19:04.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.713+0000 7fdc2d038640 1 --2- 172.21.15.55:0/1152906934 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fdc0c065710 0x7fdc0c067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:04.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.713+0000 7fdc2d038640 1 --2- 172.21.15.55:0/1152906934 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fdc0c065710 0x7fdc0c067bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdc240b2000 tx=0x7fdc24008040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:04.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.717+0000 7fdc1dffb640 1 -- 172.21.15.55:0/1152906934 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fdc180508a0 con 0x7fdc280cee60 2023-08-25T05:19:04.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.905+0000 7fdc2f29c640 1 -- 172.21.15.55:0/1152906934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdc280b2330 con 0x7fdc280cee60 2023-08-25T05:19:04.910 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-08-25T05:19:04.905+0000 7f7f18c38640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-25T05:19:04.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.913+0000 7fdc1dffb640 1 -- 172.21.15.55:0/1152906934 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdc18053ec0 con 0x7fdc280cee60 2023-08-25T05:19:04.918 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-25T05:19:04.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.917+0000 7fdc2f29c640 1 -- 172.21.15.55:0/1152906934 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fdc0c065710 msgr2=0x7fdc0c067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:04.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.917+0000 7fdc2f29c640 1 --2- 172.21.15.55:0/1152906934 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fdc0c065710 0x7fdc0c067bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdc240b2000 tx=0x7fdc24008040 comp rx=0 tx=0).stop 2023-08-25T05:19:04.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.917+0000 7fdc2f29c640 1 -- 172.21.15.55:0/1152906934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc280cee60 msgr2=0x7fdc280b6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:04.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.917+0000 7fdc2f29c640 1 --2- 172.21.15.55:0/1152906934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc280cee60 0x7fdc280b6890 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800b550 tx=0x7fdc1800ba10 comp rx=0 tx=0).stop 2023-08-25T05:19:04.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.917+0000 7fdc2f29c640 1 -- 172.21.15.55:0/1152906934 shutdown_connections 2023-08-25T05:19:04.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.917+0000 7fdc2f29c640 1 --2- 172.21.15.55:0/1152906934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc280d0da0 0x7fdc280b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.917+0000 7fdc2f29c640 1 --2- 172.21.15.55:0/1152906934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc280cee60 0x7fdc280b6890 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.917+0000 7fdc2f29c640 1 --2- 172.21.15.55:0/1152906934 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fdc0c065710 0x7fdc0c067bd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.917+0000 7fdc2f29c640 1 --2- 172.21.15.55:0/1152906934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc280cdde0 0x7fdc280b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:04.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.917+0000 7fdc2f29c640 1 -- 172.21.15.55:0/1152906934 >> 172.21.15.55:0/1152906934 conn(0x7fdc2809bae0 msgr2=0x7fdc280b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:04.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.917+0000 7fdc2f29c640 1 -- 172.21.15.55:0/1152906934 shutdown_connections 2023-08-25T05:19:04.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:04.917+0000 7fdc2f29c640 1 -- 172.21.15.55:0/1152906934 wait complete. 2023-08-25T05:19:04.927 INFO:tasks.ceph.mds.c.smithi055.stderr: -3600> 2023-08-25T05:18:46.957+0000 7f9209be6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T05:19:04.948 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-25T05:19:04.987 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T05:19:05.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.093+0000 7f2bf103a640 1 Processor -- start 2023-08-25T05:19:05.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.093+0000 7f2bf103a640 1 -- start start 2023-08-25T05:19:05.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.093+0000 7f2bf103a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bec15fca0 0x7f2bec0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:05.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.093+0000 7f2bf103a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bec0b70c0 con 0x7f2bec0b8330 2023-08-25T05:19:05.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.093+0000 7f2bf103a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bec0b73a0 con 0x7f2bec0cfac0 2023-08-25T05:19:05.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.093+0000 7f2bf103a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec160080 con 0x7f2bec15fca0 2023-08-25T05:19:05.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.093+0000 7f2beb7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2bec0b8330 0x7f2bec0d0bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45886/0 (socket says 172.21.15.55:45886) 2023-08-25T05:19:05.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.093+0000 7f2beb7fe640 1 -- 172.21.15.55:0/591447962 learned_addr learned my addr 172.21.15.55:0/591447962 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:05.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.097+0000 7f2bebfff640 1 --2- 172.21.15.55:0/591447962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bec15fca0 0x7f2bec0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:05.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.097+0000 7f2beaffd640 1 -- 172.21.15.55:0/591447962 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 675551695 0 0) 0x7f2bec0b70c0 con 0x7f2bec0b8330 2023-08-25T05:19:05.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.097+0000 7f2beaffd640 1 -- 172.21.15.55:0/591447962 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bd4003530 con 0x7f2bec0b8330 2023-08-25T05:19:05.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.097+0000 7f2beaffd640 1 -- 172.21.15.55:0/591447962 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536217866 0 0) 0x7f2bec0b73a0 con 0x7f2bec0cfac0 2023-08-25T05:19:05.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.097+0000 7f2beaffd640 1 -- 172.21.15.55:0/591447962 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bec0b70c0 con 0x7f2bec0cfac0 2023-08-25T05:19:05.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.097+0000 7f2bebfff640 1 -- 172.21.15.55:0/591447962 >> v1:172.21.15.110:6789/0 conn(0x7f2bec0cfac0 legacy=0x7f2bec0b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:05.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.097+0000 7f2bebfff640 1 -- 172.21.15.55:0/591447962 >> v1:172.21.15.55:6789/0 conn(0x7f2bec0b8330 legacy=0x7f2bec0d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:05.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.097+0000 7f2beaffd640 1 -- 172.21.15.55:0/591447962 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2120934627 0 0) 0x7f2bd4003530 con 0x7f2bec0b8330 2023-08-25T05:19:05.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.097+0000 7f2bebfff640 1 -- 172.21.15.55:0/591447962 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec0b7680 con 0x7f2bec15fca0 2023-08-25T05:19:05.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.097+0000 7f2bebfff640 1 --2- 172.21.15.55:0/591447962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bec15fca0 0x7f2bec0cf580 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0097f0 tx=0x7f2bdc01ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e7f14e3d86e1d6f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:05.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2beaffd640 1 -- 172.21.15.55:0/591447962 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be0001680 con 0x7f2bec15fca0 2023-08-25T05:19:05.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2beaffd640 1 -- 172.21.15.55:0/591447962 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bdc0a8650 con 0x7f2bec15fca0 2023-08-25T05:19:05.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2beaffd640 1 -- 172.21.15.55:0/591447962 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc0a89e0 con 0x7f2bec15fca0 2023-08-25T05:19:05.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2bf103a640 1 -- 172.21.15.55:0/591447962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bec15fca0 msgr2=0x7f2bec0cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:05.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2bf103a640 1 --2- 172.21.15.55:0/591447962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bec15fca0 0x7f2bec0cf580 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0097f0 tx=0x7f2bdc01ebd0 comp rx=0 tx=0).stop 2023-08-25T05:19:05.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2bf103a640 1 -- 172.21.15.55:0/591447962 shutdown_connections 2023-08-25T05:19:05.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2bf103a640 1 --2- 172.21.15.55:0/591447962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bec15fca0 0x7f2bec0cf580 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:05.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2bf103a640 1 -- 172.21.15.55:0/591447962 >> 172.21.15.55:0/591447962 conn(0x7f2bec0658c0 msgr2=0x7f2bec065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:05.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2bf103a640 1 -- 172.21.15.55:0/591447962 shutdown_connections 2023-08-25T05:19:05.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2bf103a640 1 -- 172.21.15.55:0/591447962 wait complete. 2023-08-25T05:19:05.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2bf103a640 1 Processor -- start 2023-08-25T05:19:05.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2bf103a640 1 -- start start 2023-08-25T05:19:05.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2bf103a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bec0b8330 0x7f2bec14e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:05.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2bf103a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bec0cfac0 0x7f2bec14dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:05.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2bf103a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bec15fca0 0x7f2bec14fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:05.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2bf103a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec151bc0 con 0x7f2bec0b8330 2023-08-25T05:19:05.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2bf103a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec14eb80 con 0x7f2bec0cfac0 2023-08-25T05:19:05.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2bf103a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bec14ee20 con 0x7f2bec15fca0 2023-08-25T05:19:05.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2bebfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bec0b8330 0x7f2bec14e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:05.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2bebfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bec0b8330 0x7f2bec14e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37066/0 (socket says 172.21.15.55:37066) 2023-08-25T05:19:05.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.101+0000 7f2bebfff640 1 -- 172.21.15.55:0/810449863 learned_addr learned my addr 172.21.15.55:0/810449863 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:05.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.105+0000 7f2beb7fe640 1 --2- 172.21.15.55:0/810449863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bec0cfac0 0x7f2bec14dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:05.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.105+0000 7f2bf0839640 1 --2- 172.21.15.55:0/810449863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bec15fca0 0x7f2bec14fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:05.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.105+0000 7f2bebfff640 1 -- 172.21.15.55:0/810449863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bec15fca0 msgr2=0x7f2bec14fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:05.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.105+0000 7f2bebfff640 1 --2- 172.21.15.55:0/810449863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bec15fca0 0x7f2bec14fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:05.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.105+0000 7f2bebfff640 1 -- 172.21.15.55:0/810449863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bec0cfac0 msgr2=0x7f2bec14dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:05.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.105+0000 7f2bebfff640 1 --2- 172.21.15.55:0/810449863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bec0cfac0 0x7f2bec14dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:05.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.105+0000 7f2bebfff640 1 -- 172.21.15.55:0/810449863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc009420 con 0x7f2bec0b8330 2023-08-25T05:19:05.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.105+0000 7f2beb7fe640 1 --2- 172.21.15.55:0/810449863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bec0cfac0 0x7f2bec14dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:19:05.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.105+0000 7f2bf0839640 1 --2- 172.21.15.55:0/810449863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bec15fca0 0x7f2bec14fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:19:05.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.105+0000 7f2bebfff640 1 --2- 172.21.15.55:0/810449863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bec0b8330 0x7f2bec14e640 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0097f0 tx=0x7f2bdc01b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:05.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.105+0000 7f2be8ff9640 1 -- 172.21.15.55:0/810449863 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc0b0850 con 0x7f2bec0b8330 2023-08-25T05:19:05.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.105+0000 7f2be8ff9640 1 -- 172.21.15.55:0/810449863 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bdc0b09b0 con 0x7f2bec0b8330 2023-08-25T05:19:05.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.105+0000 7f2bf103a640 1 -- 172.21.15.55:0/810449863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bec14f100 con 0x7f2bec0b8330 2023-08-25T05:19:05.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.105+0000 7f2be8ff9640 1 -- 172.21.15.55:0/810449863 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc0b0d20 con 0x7f2bec0b8330 2023-08-25T05:19:05.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.105+0000 7f2bf103a640 1 -- 172.21.15.55:0/810449863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bec14f6c0 con 0x7f2bec0b8330 2023-08-25T05:19:05.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.105+0000 7f2bf103a640 1 -- 172.21.15.55:0/810449863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bec151d30 con 0x7f2bec0b8330 2023-08-25T05:19:05.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.105+0000 7f2be8ff9640 1 -- 172.21.15.55:0/810449863 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 87) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f2bdc0b7040 con 0x7f2bec0b8330 2023-08-25T05:19:05.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.109+0000 7f2be8ff9640 1 --2- 172.21.15.55:0/810449863 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f2bd8065710 0x7f2bd8067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:05.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.109+0000 7f2be8ff9640 1 -- 172.21.15.55:0/810449863 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f2bdc120c70 con 0x7f2bec0b8330 2023-08-25T05:19:05.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.109+0000 7f2beb7fe640 1 --2- 172.21.15.55:0/810449863 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f2bd8065710 0x7f2bd8067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:05.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.109+0000 7f2beb7fe640 1 --2- 172.21.15.55:0/810449863 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f2bd8065710 0x7f2bd8067bd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2be0000fc0 tx=0x7f2be0009040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:05.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.113+0000 7f2be8ff9640 1 -- 172.21.15.55:0/810449863 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2bdc0ee560 con 0x7f2bec0b8330 2023-08-25T05:19:05.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.301+0000 7f2bf103a640 1 -- 172.21.15.55:0/810449863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2bec073e50 con 0x7f2bec0b8330 2023-08-25T05:19:05.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.945+0000 7f2be8ff9640 1 -- 172.21.15.55:0/810449863 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2bdc11ee60 con 0x7f2bec0b8330 2023-08-25T05:19:05.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.945+0000 7f2bf103a640 1 -- 172.21.15.55:0/810449863 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f2bd8065710 msgr2=0x7f2bd8067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:05.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.945+0000 7f2bf103a640 1 --2- 172.21.15.55:0/810449863 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f2bd8065710 0x7f2bd8067bd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2be0000fc0 tx=0x7f2be0009040 comp rx=0 tx=0).stop 2023-08-25T05:19:05.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.945+0000 7f2bf103a640 1 -- 172.21.15.55:0/810449863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bec0b8330 msgr2=0x7f2bec14e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:05.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.945+0000 7f2bf103a640 1 --2- 172.21.15.55:0/810449863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bec0b8330 0x7f2bec14e640 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0097f0 tx=0x7f2bdc01b970 comp rx=0 tx=0).stop 2023-08-25T05:19:05.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.949+0000 7f2bf103a640 1 -- 172.21.15.55:0/810449863 shutdown_connections 2023-08-25T05:19:05.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.949+0000 7f2bf103a640 1 --2- 172.21.15.55:0/810449863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2bec15fca0 0x7f2bec14fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:05.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.949+0000 7f2bf103a640 1 --2- 172.21.15.55:0/810449863 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f2bd8065710 0x7f2bd8067bd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:05.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.949+0000 7f2bf103a640 1 --2- 172.21.15.55:0/810449863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2bec0cfac0 0x7f2bec14dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:05.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.949+0000 7f2bf103a640 1 --2- 172.21.15.55:0/810449863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bec0b8330 0x7f2bec14e640 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:05.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.949+0000 7f2bf103a640 1 -- 172.21.15.55:0/810449863 >> 172.21.15.55:0/810449863 conn(0x7f2bec0658c0 msgr2=0x7f2bec0b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:05.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.949+0000 7f2bf103a640 1 -- 172.21.15.55:0/810449863 shutdown_connections 2023-08-25T05:19:05.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:05.949+0000 7f2bf103a640 1 -- 172.21.15.55:0/810449863 wait complete. 2023-08-25T05:19:05.977 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-25T05:19:06.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.165+0000 7f4e513ba640 1 Processor -- start 2023-08-25T05:19:06.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.165+0000 7f4e513ba640 1 -- start start 2023-08-25T05:19:06.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.169+0000 7f4e513ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e4c06e690 0x7f4e4c069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:06.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.169+0000 7f4e513ba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4e4c071500 0x7f4e4c0c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.169+0000 7f4e513ba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4c071070 con 0x7f4e4c161070 2023-08-25T05:19:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.169+0000 7f4e513ba640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4c06b370 con 0x7f4e4c071500 2023-08-25T05:19:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.169+0000 7f4e513ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c160420 con 0x7f4e4c06e690 2023-08-25T05:19:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.169+0000 7f4e4b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4e4c071500 0x7f4e4c0c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.169+0000 7f4e4b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4e4c071500 0x7f4e4c0c9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37080/0 (socket says 172.21.15.55:37080) 2023-08-25T05:19:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.169+0000 7f4e43fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4e4c161070 0x7f4e4c06ea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45898/0 (socket says 172.21.15.55:45898) 2023-08-25T05:19:06.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.169+0000 7f4e4b7fe640 1 -- 172.21.15.55:0/3506667308 learned_addr learned my addr 172.21.15.55:0/3506667308 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:06.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.169+0000 7f4e4affd640 1 --2- 172.21.15.55:0/3506667308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e4c06e690 0x7f4e4c069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:06.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.169+0000 7f4e4b7fe640 1 -- 172.21.15.55:0/3506667308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e4c06e690 msgr2=0x7f4e4c069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:06.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.169+0000 7f4e4b7fe640 1 --2- 172.21.15.55:0/3506667308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e4c06e690 0x7f4e4c069900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:06.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.169+0000 7f4e4a7fc640 1 -- 172.21.15.55:0/3506667308 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823050449 0 0) 0x7f4e4c071070 con 0x7f4e4c161070 2023-08-25T05:19:06.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.169+0000 7f4e4b7fe640 1 -- 172.21.15.55:0/3506667308 >> v1:172.21.15.55:6789/0 conn(0x7f4e4c161070 legacy=0x7f4e4c06ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:06.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.169+0000 7f4e4b7fe640 1 -- 172.21.15.55:0/3506667308 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c069f90 con 0x7f4e4c071500 2023-08-25T05:19:06.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.173+0000 7f4e4b7fe640 1 --2- 172.21.15.55:0/3506667308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c071500 0x7f4e4c0c9be0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009e50 tx=0x7f4e4401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb63fd4595adff server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:06.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.173+0000 7f4e4a7fc640 1 -- 172.21.15.55:0/3506667308 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e440a58a0 con 0x7f4e4c071500 2023-08-25T05:19:06.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.173+0000 7f4e4a7fc640 1 -- 172.21.15.55:0/3506667308 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e440a5a00 con 0x7f4e4c071500 2023-08-25T05:19:06.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.173+0000 7f4e4a7fc640 1 -- 172.21.15.55:0/3506667308 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e440a5d90 con 0x7f4e4c071500 2023-08-25T05:19:06.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.173+0000 7f4e513ba640 1 -- 172.21.15.55:0/3506667308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c071500 msgr2=0x7f4e4c0c9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:06.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.173+0000 7f4e513ba640 1 --2- 172.21.15.55:0/3506667308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c071500 0x7f4e4c0c9be0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009e50 tx=0x7f4e4401c9e0 comp rx=0 tx=0).stop 2023-08-25T05:19:06.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.173+0000 7f4e513ba640 1 -- 172.21.15.55:0/3506667308 shutdown_connections 2023-08-25T05:19:06.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.173+0000 7f4e513ba640 1 --2- 172.21.15.55:0/3506667308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c071500 0x7f4e4c0c9be0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:06.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.173+0000 7f4e513ba640 1 --2- 172.21.15.55:0/3506667308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e4c06e690 0x7f4e4c069900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:06.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.173+0000 7f4e513ba640 1 -- 172.21.15.55:0/3506667308 >> 172.21.15.55:0/3506667308 conn(0x7f4e4c0cc010 msgr2=0x7f4e4c0cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:06.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.173+0000 7f4e513ba640 1 -- 172.21.15.55:0/3506667308 shutdown_connections 2023-08-25T05:19:06.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.173+0000 7f4e513ba640 1 -- 172.21.15.55:0/3506667308 wait complete. 2023-08-25T05:19:06.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.173+0000 7f4e513ba640 1 Processor -- start 2023-08-25T05:19:06.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.173+0000 7f4e513ba640 1 -- start start 2023-08-25T05:19:06.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.173+0000 7f4e513ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e4c06e690 0x7f4e4c1515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:06.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e513ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c071500 0x7f4e4c0b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:06.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e513ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c161070 0x7f4e4c15e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:06.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e513ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c1f9b80 con 0x7f4e4c161070 2023-08-25T05:19:06.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e513ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c151b30 con 0x7f4e4c071500 2023-08-25T05:19:06.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e513ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c15d0c0 con 0x7f4e4c06e690 2023-08-25T05:19:06.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e4b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c161070 0x7f4e4c15e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:06.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e4b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c161070 0x7f4e4c15e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37082/0 (socket says 172.21.15.55:37082) 2023-08-25T05:19:06.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e4b7fe640 1 -- 172.21.15.55:0/1724198654 learned_addr learned my addr 172.21.15.55:0/1724198654 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:06.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e4affd640 1 --2- 172.21.15.55:0/1724198654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e4c06e690 0x7f4e4c1515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:06.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e43fff640 1 --2- 172.21.15.55:0/1724198654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c071500 0x7f4e4c0b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:06.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e4b7fe640 1 -- 172.21.15.55:0/1724198654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e4c06e690 msgr2=0x7f4e4c1515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:06.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e4b7fe640 1 --2- 172.21.15.55:0/1724198654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e4c06e690 0x7f4e4c1515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:06.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e4b7fe640 1 -- 172.21.15.55:0/1724198654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c071500 msgr2=0x7f4e4c0b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:06.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e4b7fe640 1 --2- 172.21.15.55:0/1724198654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c071500 0x7f4e4c0b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:06.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e4b7fe640 1 -- 172.21.15.55:0/1724198654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e44009b30 con 0x7f4e4c161070 2023-08-25T05:19:06.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e4affd640 1 --2- 172.21.15.55:0/1724198654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e4c06e690 0x7f4e4c1515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:06.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e4b7fe640 1 --2- 172.21.15.55:0/1724198654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c161070 0x7f4e4c15e3a0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f4e440af040 tx=0x7f4e44019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:06.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e437fe640 1 -- 172.21.15.55:0/1724198654 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e440b8670 con 0x7f4e4c161070 2023-08-25T05:19:06.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e437fe640 1 -- 172.21.15.55:0/1724198654 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e440b8810 con 0x7f4e4c161070 2023-08-25T05:19:06.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e437fe640 1 -- 172.21.15.55:0/1724198654 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e440b8bc0 con 0x7f4e4c161070 2023-08-25T05:19:06.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e513ba640 1 -- 172.21.15.55:0/1724198654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4c0b38b0 con 0x7f4e4c161070 2023-08-25T05:19:06.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e513ba640 1 -- 172.21.15.55:0/1724198654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4c0b3e30 con 0x7f4e4c161070 2023-08-25T05:19:06.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e513ba640 1 -- 172.21.15.55:0/1724198654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4c161450 con 0x7f4e4c161070 2023-08-25T05:19:06.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.177+0000 7f4e437fe640 1 -- 172.21.15.55:0/1724198654 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f4e440b8d20 con 0x7f4e4c161070 2023-08-25T05:19:06.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.181+0000 7f4e437fe640 1 --2- 172.21.15.55:0/1724198654 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f4e2c0657a0 0x7f4e2c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:06.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.181+0000 7f4e437fe640 1 -- 172.21.15.55:0/1724198654 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f4e4411e980 con 0x7f4e4c161070 2023-08-25T05:19:06.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.181+0000 7f4e4affd640 1 --2- 172.21.15.55:0/1724198654 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f4e2c0657a0 0x7f4e2c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:06.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.181+0000 7f4e4affd640 1 --2- 172.21.15.55:0/1724198654 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f4e2c0657a0 0x7f4e2c067c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c15ef40 tx=0x7f4e3c008040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:06.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.181+0000 7f4e437fe640 1 -- 172.21.15.55:0/1724198654 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4e440ec150 con 0x7f4e4c161070 2023-08-25T05:19:06.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.341+0000 7f4e513ba640 1 -- 172.21.15.55:0/1724198654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4e4c04dbe0 con 0x7f4e4c161070 2023-08-25T05:19:06.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.957+0000 7f4e437fe640 1 -- 172.21.15.55:0/1724198654 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v161) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4e4411ce60 con 0x7f4e4c161070 2023-08-25T05:19:06.963 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-08-25T05:19:06.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.961+0000 7f4e513ba640 1 -- 172.21.15.55:0/1724198654 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f4e2c0657a0 msgr2=0x7f4e2c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:06.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.961+0000 7f4e513ba640 1 --2- 172.21.15.55:0/1724198654 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f4e2c0657a0 0x7f4e2c067c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c15ef40 tx=0x7f4e3c008040 comp rx=0 tx=0).stop 2023-08-25T05:19:06.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.961+0000 7f4e513ba640 1 -- 172.21.15.55:0/1724198654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c161070 msgr2=0x7f4e4c15e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:06.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.961+0000 7f4e513ba640 1 --2- 172.21.15.55:0/1724198654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c161070 0x7f4e4c15e3a0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f4e440af040 tx=0x7f4e44019780 comp rx=0 tx=0).stop 2023-08-25T05:19:06.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.961+0000 7f4e513ba640 1 -- 172.21.15.55:0/1724198654 shutdown_connections 2023-08-25T05:19:06.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.961+0000 7f4e513ba640 1 --2- 172.21.15.55:0/1724198654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e4c161070 0x7f4e4c15e3a0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:06.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.961+0000 7f4e513ba640 1 --2- 172.21.15.55:0/1724198654 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f4e2c0657a0 0x7f4e2c067c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:06.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.961+0000 7f4e513ba640 1 --2- 172.21.15.55:0/1724198654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e4c071500 0x7f4e4c0b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:06.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.961+0000 7f4e513ba640 1 --2- 172.21.15.55:0/1724198654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e4c06e690 0x7f4e4c1515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:06.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.961+0000 7f4e513ba640 1 -- 172.21.15.55:0/1724198654 >> 172.21.15.55:0/1724198654 conn(0x7f4e4c0cc010 msgr2=0x7f4e4c0cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:06.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.961+0000 7f4e513ba640 1 -- 172.21.15.55:0/1724198654 shutdown_connections 2023-08-25T05:19:06.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:06.961+0000 7f4e513ba640 1 -- 172.21.15.55:0/1724198654 wait complete. 2023-08-25T05:19:06.990 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-25T05:19:07.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.137+0000 7f33655e9640 1 Processor -- start 2023-08-25T05:19:07.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.137+0000 7f33655e9640 1 -- start start 2023-08-25T05:19:07.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.141+0000 7f33655e9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3360155740 0x7f336015c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:07.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.141+0000 7f33655e9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f336006fb50 0x7f33600aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:07.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.141+0000 7f33655e9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336015fa50 con 0x7f3360155360 2023-08-25T05:19:07.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.141+0000 7f33655e9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336015f2a0 con 0x7f3360155740 2023-08-25T05:19:07.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.141+0000 7f33655e9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336015f490 con 0x7f336006fb50 2023-08-25T05:19:07.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.141+0000 7f3357fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3360155740 0x7f336015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:07.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.141+0000 7f3357fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3360155740 0x7f336015c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37094/0 (socket says 172.21.15.55:37094) 2023-08-25T05:19:07.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.141+0000 7f3357fff640 1 -- 172.21.15.55:0/245715936 learned_addr learned my addr 172.21.15.55:0/245715936 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:07.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.141+0000 7f3357fff640 1 -- 172.21.15.55:0/245715936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f336006fb50 msgr2=0x7f33600aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:07.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.141+0000 7f3357fff640 1 --2- 172.21.15.55:0/245715936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f336006fb50 0x7f33600aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:07.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.141+0000 7f3357fff640 1 -- 172.21.15.55:0/245715936 >> v1:172.21.15.110:6789/0 conn(0x7f3360155360 legacy=0x7f336015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:07.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.141+0000 7f3357fff640 1 -- 172.21.15.55:0/245715936 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336015f770 con 0x7f3360155740 2023-08-25T05:19:07.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.145+0000 7f3357fff640 1 --2- 172.21.15.55:0/245715936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3360155740 0x7f336015c180 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f3348009870 tx=0x7f334801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85106125587457ba server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:07.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.145+0000 7f335e7fc640 1 -- 172.21.15.55:0/245715936 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33480ab600 con 0x7f3360155740 2023-08-25T05:19:07.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.145+0000 7f335e7fc640 1 -- 172.21.15.55:0/245715936 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33480a7050 con 0x7f3360155740 2023-08-25T05:19:07.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.145+0000 7f335e7fc640 1 -- 172.21.15.55:0/245715936 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33480ab980 con 0x7f3360155740 2023-08-25T05:19:07.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.145+0000 7f33655e9640 1 -- 172.21.15.55:0/245715936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3360155740 msgr2=0x7f336015c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.145+0000 7f33655e9640 1 --2- 172.21.15.55:0/245715936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3360155740 0x7f336015c180 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f3348009870 tx=0x7f334801c3e0 comp rx=0 tx=0).stop 2023-08-25T05:19:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.145+0000 7f33655e9640 1 -- 172.21.15.55:0/245715936 shutdown_connections 2023-08-25T05:19:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.145+0000 7f33655e9640 1 --2- 172.21.15.55:0/245715936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f336006fb50 0x7f33600aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.145+0000 7f33655e9640 1 --2- 172.21.15.55:0/245715936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3360155740 0x7f336015c180 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.145+0000 7f33655e9640 1 -- 172.21.15.55:0/245715936 >> 172.21.15.55:0/245715936 conn(0x7f33600caf90 msgr2=0x7f33600cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.145+0000 7f33655e9640 1 -- 172.21.15.55:0/245715936 shutdown_connections 2023-08-25T05:19:07.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.145+0000 7f33655e9640 1 -- 172.21.15.55:0/245715936 wait complete. 2023-08-25T05:19:07.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.145+0000 7f33655e9640 1 Processor -- start 2023-08-25T05:19:07.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.145+0000 7f33655e9640 1 -- start start 2023-08-25T05:19:07.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f33655e9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f336006fb50 0x7f3360159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:07.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f33655e9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3360155360 0x7f336015c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:07.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f33655e9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3360155740 0x7f336015b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:07.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f33655e9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3360159a60 con 0x7f3360155360 2023-08-25T05:19:07.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f33655e9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336015a450 con 0x7f336006fb50 2023-08-25T05:19:07.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f33655e9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336015a730 con 0x7f3360155740 2023-08-25T05:19:07.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f3357fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3360155360 0x7f336015c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:07.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f3357fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3360155360 0x7f336015c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37102/0 (socket says 172.21.15.55:37102) 2023-08-25T05:19:07.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f3357fff640 1 -- 172.21.15.55:0/460124044 learned_addr learned my addr 172.21.15.55:0/460124044 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:07.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f335effd640 1 --2- 172.21.15.55:0/460124044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f336006fb50 0x7f3360159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:07.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f335f7fe640 1 --2- 172.21.15.55:0/460124044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3360155740 0x7f336015b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:07.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f3357fff640 1 -- 172.21.15.55:0/460124044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3360155740 msgr2=0x7f336015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:07.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f3357fff640 1 --2- 172.21.15.55:0/460124044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3360155740 0x7f336015b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:07.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f3357fff640 1 -- 172.21.15.55:0/460124044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f336006fb50 msgr2=0x7f3360159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:07.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f3357fff640 1 --2- 172.21.15.55:0/460124044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f336006fb50 0x7f3360159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:07.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f3357fff640 1 -- 172.21.15.55:0/460124044 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33480094d0 con 0x7f3360155360 2023-08-25T05:19:07.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f335effd640 1 --2- 172.21.15.55:0/460124044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f336006fb50 0x7f3360159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:07.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f3357fff640 1 --2- 172.21.15.55:0/460124044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3360155360 0x7f336015c1a0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f33480ae040 tx=0x7f3348019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:07.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f33577fe640 1 -- 172.21.15.55:0/460124044 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33480b7650 con 0x7f3360155360 2023-08-25T05:19:07.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f33577fe640 1 -- 172.21.15.55:0/460124044 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33480b77b0 con 0x7f3360155360 2023-08-25T05:19:07.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f33655e9640 1 -- 172.21.15.55:0/460124044 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336015aa10 con 0x7f3360155360 2023-08-25T05:19:07.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f33577fe640 1 -- 172.21.15.55:0/460124044 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33480b7b60 con 0x7f3360155360 2023-08-25T05:19:07.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f33655e9640 1 -- 172.21.15.55:0/460124044 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336015afd0 con 0x7f3360155360 2023-08-25T05:19:07.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f33655e9640 1 -- 172.21.15.55:0/460124044 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336015b1c0 con 0x7f3360155360 2023-08-25T05:19:07.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.149+0000 7f33577fe640 1 -- 172.21.15.55:0/460124044 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f33480b7cc0 con 0x7f3360155360 2023-08-25T05:19:07.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.153+0000 7f33577fe640 1 --2- 172.21.15.55:0/460124044 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f33400657a0 0x7f3340067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:07.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.153+0000 7f33577fe640 1 -- 172.21.15.55:0/460124044 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6398+0+0 (secure 0 0 0) 0x7f334811da50 con 0x7f3360155360 2023-08-25T05:19:07.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.153+0000 7f335effd640 1 --2- 172.21.15.55:0/460124044 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f33400657a0 0x7f3340067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:07.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.153+0000 7f335effd640 1 --2- 172.21.15.55:0/460124044 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f33400657a0 0x7f3340067c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3350001760 tx=0x7f3350009040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:07.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.157+0000 7f33577fe640 1 -- 172.21.15.55:0/460124044 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f33480eb230 con 0x7f3360155360 2023-08-25T05:19:07.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.321+0000 7f33655e9640 1 -- 172.21.15.55:0/460124044 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f336004dbe0 con 0x7f3360155360 2023-08-25T05:19:07.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.973+0000 7f33577fe640 1 -- 172.21.15.55:0/460124044 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v162) v1 ==== 169+0+0 (secure 0 0 0) 0x7f33480ee850 con 0x7f3360155360 2023-08-25T05:19:07.978 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-08-25T05:19:07.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.977+0000 7f33655e9640 1 -- 172.21.15.55:0/460124044 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f33400657a0 msgr2=0x7f3340067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:07.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.977+0000 7f33655e9640 1 --2- 172.21.15.55:0/460124044 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f33400657a0 0x7f3340067c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3350001760 tx=0x7f3350009040 comp rx=0 tx=0).stop 2023-08-25T05:19:07.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.977+0000 7f33655e9640 1 -- 172.21.15.55:0/460124044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3360155360 msgr2=0x7f336015c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:07.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.977+0000 7f33655e9640 1 --2- 172.21.15.55:0/460124044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3360155360 0x7f336015c1a0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f33480ae040 tx=0x7f3348019180 comp rx=0 tx=0).stop 2023-08-25T05:19:07.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.977+0000 7f33655e9640 1 -- 172.21.15.55:0/460124044 shutdown_connections 2023-08-25T05:19:07.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.977+0000 7f33655e9640 1 --2- 172.21.15.55:0/460124044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3360155740 0x7f336015b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:07.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.977+0000 7f33655e9640 1 --2- 172.21.15.55:0/460124044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3360155360 0x7f336015c1a0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:07.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.977+0000 7f33655e9640 1 --2- 172.21.15.55:0/460124044 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f33400657a0 0x7f3340067c60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:07.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.977+0000 7f33655e9640 1 --2- 172.21.15.55:0/460124044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f336006fb50 0x7f3360159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:07.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.977+0000 7f33655e9640 1 -- 172.21.15.55:0/460124044 >> 172.21.15.55:0/460124044 conn(0x7f33600caf90 msgr2=0x7f33600b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:07.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.977+0000 7f33655e9640 1 -- 172.21.15.55:0/460124044 shutdown_connections 2023-08-25T05:19:07.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:07.977+0000 7f33655e9640 1 -- 172.21.15.55:0/460124044 wait complete. 2023-08-25T05:19:08.007 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-08-25T05:19:08.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.157+0000 7f05e67fa640 1 Processor -- start 2023-08-25T05:19:08.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.157+0000 7f05e67fa640 1 -- start start 2023-08-25T05:19:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.157+0000 7f05e67fa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f05e00c9900 0x7f05e00cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.157+0000 7f05e67fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05e006c720 0x7f05e006cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.157+0000 7f05e67fa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e00c9d90 con 0x7f05e00cb020 2023-08-25T05:19:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.157+0000 7f05e67fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e00cbca0 con 0x7f05e006c720 2023-08-25T05:19:08.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.157+0000 7f05e67fa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e00c9470 con 0x7f05e00c9900 2023-08-25T05:19:08.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.157+0000 7f05e4d97640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05e006c720 0x7f05e006cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:08.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.157+0000 7f05e4d97640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05e006c720 0x7f05e006cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37116/0 (socket says 172.21.15.55:37116) 2023-08-25T05:19:08.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.157+0000 7f05e4d97640 1 -- 172.21.15.55:0/708482973 learned_addr learned my addr 172.21.15.55:0/708482973 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:08.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.157+0000 7f05df7fe640 1 --2- 172.21.15.55:0/708482973 >> v2:172.21.15.110:3300/0 conn(0x7f05e00c9900 0x7f05e00cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:08.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.157+0000 7f05e4d97640 1 -- 172.21.15.55:0/708482973 >> v2:172.21.15.110:3300/0 conn(0x7f05e00c9900 msgr2=0x7f05e00cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:08.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.157+0000 7f05e4d97640 1 --2- 172.21.15.55:0/708482973 >> v2:172.21.15.110:3300/0 conn(0x7f05e00c9900 0x7f05e00cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.157+0000 7f05e4d97640 1 -- 172.21.15.55:0/708482973 >> v1:172.21.15.110:6789/0 conn(0x7f05e00cb020 legacy=0x7f05e00cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:08.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.157+0000 7f05e4d97640 1 -- 172.21.15.55:0/708482973 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e006d040 con 0x7f05e006c720 2023-08-25T05:19:08.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.161+0000 7f05e4d97640 1 --2- 172.21.15.55:0/708482973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05e006c720 0x7f05e006cb00 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f05e0071fe0 tx=0x7f05d801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14cda09f3ca26399 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:08.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.161+0000 7f05deffd640 1 -- 172.21.15.55:0/708482973 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d80a5600 con 0x7f05e006c720 2023-08-25T05:19:08.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.161+0000 7f05deffd640 1 -- 172.21.15.55:0/708482973 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d80a5760 con 0x7f05e006c720 2023-08-25T05:19:08.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.161+0000 7f05deffd640 1 -- 172.21.15.55:0/708482973 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d80a5af0 con 0x7f05e006c720 2023-08-25T05:19:08.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.161+0000 7f05e67fa640 1 -- 172.21.15.55:0/708482973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05e006c720 msgr2=0x7f05e006cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:08.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.161+0000 7f05e67fa640 1 --2- 172.21.15.55:0/708482973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05e006c720 0x7f05e006cb00 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f05e0071fe0 tx=0x7f05d801c940 comp rx=0 tx=0).stop 2023-08-25T05:19:08.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.161+0000 7f05e67fa640 1 -- 172.21.15.55:0/708482973 shutdown_connections 2023-08-25T05:19:08.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.161+0000 7f05e67fa640 1 --2- 172.21.15.55:0/708482973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05e006c720 0x7f05e006cb00 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.161+0000 7f05e67fa640 1 --2- 172.21.15.55:0/708482973 >> v2:172.21.15.110:3300/0 conn(0x7f05e00c9900 0x7f05e00cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.161+0000 7f05e67fa640 1 -- 172.21.15.55:0/708482973 >> 172.21.15.55:0/708482973 conn(0x7f05e0069900 msgr2=0x7f05e0069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:08.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.161+0000 7f05e67fa640 1 -- 172.21.15.55:0/708482973 shutdown_connections 2023-08-25T05:19:08.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.161+0000 7f05e67fa640 1 -- 172.21.15.55:0/708482973 wait complete. 2023-08-25T05:19:08.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e67fa640 1 Processor -- start 2023-08-25T05:19:08.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e67fa640 1 -- start start 2023-08-25T05:19:08.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e67fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05e006c720 0x7f05e0155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e67fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05e00c9900 0x7f05e015ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e67fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05e00cb020 0x7f05e0157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e67fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e00ae190 con 0x7f05e00cb020 2023-08-25T05:19:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e67fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e00ae470 con 0x7f05e00c9900 2023-08-25T05:19:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e67fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e00ae750 con 0x7f05e006c720 2023-08-25T05:19:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e4d97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05e00cb020 0x7f05e0157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:08.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e4d97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05e00cb020 0x7f05e0157970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37122/0 (socket says 172.21.15.55:37122) 2023-08-25T05:19:08.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e4d97640 1 -- 172.21.15.55:0/703847882 learned_addr learned my addr 172.21.15.55:0/703847882 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:08.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05dffff640 1 --2- 172.21.15.55:0/703847882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05e006c720 0x7f05e0155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:08.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05df7fe640 1 --2- 172.21.15.55:0/703847882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05e00c9900 0x7f05e015ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:08.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e4d97640 1 -- 172.21.15.55:0/703847882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05e006c720 msgr2=0x7f05e0155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:08.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e4d97640 1 --2- 172.21.15.55:0/703847882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05e006c720 0x7f05e0155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e4d97640 1 -- 172.21.15.55:0/703847882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05e00c9900 msgr2=0x7f05e015ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:08.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e4d97640 1 --2- 172.21.15.55:0/703847882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05e00c9900 0x7f05e015ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e4d97640 1 -- 172.21.15.55:0/703847882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d8009b30 con 0x7f05e00cb020 2023-08-25T05:19:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e4d97640 1 --2- 172.21.15.55:0/703847882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05e00cb020 0x7f05e0157970 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f05d80af040 tx=0x7f05d80196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05dcff9640 1 -- 172.21.15.55:0/703847882 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d80b8670 con 0x7f05e00cb020 2023-08-25T05:19:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05dcff9640 1 -- 172.21.15.55:0/703847882 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d80b87d0 con 0x7f05e00cb020 2023-08-25T05:19:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05dcff9640 1 -- 172.21.15.55:0/703847882 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d80b8b60 con 0x7f05e00cb020 2023-08-25T05:19:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e67fa640 1 -- 172.21.15.55:0/703847882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e00aea30 con 0x7f05e00cb020 2023-08-25T05:19:08.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e67fa640 1 -- 172.21.15.55:0/703847882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e01564f0 con 0x7f05e00cb020 2023-08-25T05:19:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.165+0000 7f05e67fa640 1 -- 172.21.15.55:0/703847882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e0073ec0 con 0x7f05e00cb020 2023-08-25T05:19:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.169+0000 7f05dcff9640 1 -- 172.21.15.55:0/703847882 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f05d80b8cc0 con 0x7f05e00cb020 2023-08-25T05:19:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.169+0000 7f05dcff9640 1 --2- 172.21.15.55:0/703847882 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f05cc0657a0 0x7f05cc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.169+0000 7f05dcff9640 1 -- 172.21.15.55:0/703847882 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f05d811e200 con 0x7f05e00cb020 2023-08-25T05:19:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.169+0000 7f05dffff640 1 --2- 172.21.15.55:0/703847882 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f05cc0657a0 0x7f05cc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:08.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.169+0000 7f05dffff640 1 --2- 172.21.15.55:0/703847882 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f05cc0657a0 0x7f05cc067c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f05d0000fc0 tx=0x7f05d0009040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:08.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.173+0000 7f05dcff9640 1 -- 172.21.15.55:0/703847882 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f05d80ebd80 con 0x7f05e00cb020 2023-08-25T05:19:08.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.333+0000 7f05e67fa640 1 -- 172.21.15.55:0/703847882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f05e00c1940 con 0x7f05e00cb020 2023-08-25T05:19:08.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.341+0000 7f05dcff9640 1 -- 172.21.15.55:0/703847882 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v55) v1 ==== 115+0+0 (secure 0 0 0) 0x7f05d8009510 con 0x7f05e00cb020 2023-08-25T05:19:08.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.341+0000 7f05e67fa640 1 -- 172.21.15.55:0/703847882 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f05cc0657a0 msgr2=0x7f05cc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:08.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.341+0000 7f05e67fa640 1 --2- 172.21.15.55:0/703847882 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f05cc0657a0 0x7f05cc067c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f05d0000fc0 tx=0x7f05d0009040 comp rx=0 tx=0).stop 2023-08-25T05:19:08.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.341+0000 7f05e67fa640 1 -- 172.21.15.55:0/703847882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05e00cb020 msgr2=0x7f05e0157970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:08.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.341+0000 7f05e67fa640 1 --2- 172.21.15.55:0/703847882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05e00cb020 0x7f05e0157970 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f05d80af040 tx=0x7f05d80196e0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.341+0000 7f05e67fa640 1 -- 172.21.15.55:0/703847882 shutdown_connections 2023-08-25T05:19:08.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.341+0000 7f05e67fa640 1 --2- 172.21.15.55:0/703847882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05e00cb020 0x7f05e0157970 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.341+0000 7f05e67fa640 1 --2- 172.21.15.55:0/703847882 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f05cc0657a0 0x7f05cc067c60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.341+0000 7f05e67fa640 1 --2- 172.21.15.55:0/703847882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05e00c9900 0x7f05e015ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.341+0000 7f05e67fa640 1 --2- 172.21.15.55:0/703847882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05e006c720 0x7f05e0155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.341+0000 7f05e67fa640 1 -- 172.21.15.55:0/703847882 >> 172.21.15.55:0/703847882 conn(0x7f05e0069900 msgr2=0x7f05e00b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:08.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.341+0000 7f05e67fa640 1 -- 172.21.15.55:0/703847882 shutdown_connections 2023-08-25T05:19:08.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.341+0000 7f05e67fa640 1 -- 172.21.15.55:0/703847882 wait complete. 2023-08-25T05:19:08.365 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-25T05:19:08.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.505+0000 7fa437c34640 1 Processor -- start 2023-08-25T05:19:08.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.505+0000 7fa437c34640 1 -- start start 2023-08-25T05:19:08.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.509+0000 7fa437c34640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa4300cb710 0x7fa4300cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:08.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.509+0000 7fa437c34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4300cdf20 con 0x7fa4300ad6b0 2023-08-25T05:19:08.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.509+0000 7fa437c34640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43009bc40 con 0x7fa43006c9c0 2023-08-25T05:19:08.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.509+0000 7fa437c34640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43009bf20 con 0x7fa4300cb710 2023-08-25T05:19:08.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.509+0000 7fa4359d0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa4300ad6b0 0x7fa4300b1210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45906/0 (socket says 172.21.15.55:45906) 2023-08-25T05:19:08.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.509+0000 7fa4359d0640 1 -- 172.21.15.55:0/2693842975 learned_addr learned my addr 172.21.15.55:0/2693842975 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:08.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.509+0000 7fa4351cf640 1 --2- 172.21.15.55:0/2693842975 >> v2:172.21.15.110:3300/0 conn(0x7fa4300cb710 0x7fa4300cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:08.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.509+0000 7fa4349ce640 1 -- 172.21.15.55:0/2693842975 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743285875 0 0) 0x7fa4300cdf20 con 0x7fa4300ad6b0 2023-08-25T05:19:08.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.509+0000 7fa4349ce640 1 -- 172.21.15.55:0/2693842975 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa41c003530 con 0x7fa4300ad6b0 2023-08-25T05:19:08.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.509+0000 7fa4349ce640 1 -- 172.21.15.55:0/2693842975 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062420598 0 0) 0x7fa43009bc40 con 0x7fa43006c9c0 2023-08-25T05:19:08.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.509+0000 7fa4349ce640 1 -- 172.21.15.55:0/2693842975 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4300cdf20 con 0x7fa43006c9c0 2023-08-25T05:19:08.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.509+0000 7fa4351cf640 1 -- 172.21.15.55:0/2693842975 >> v1:172.21.15.110:6789/0 conn(0x7fa43006c9c0 legacy=0x7fa4300c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:08.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.509+0000 7fa4349ce640 1 -- 172.21.15.55:0/2693842975 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2627690077 0 0) 0x7fa41c003530 con 0x7fa4300ad6b0 2023-08-25T05:19:08.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.509+0000 7fa4351cf640 1 -- 172.21.15.55:0/2693842975 >> v1:172.21.15.55:6789/0 conn(0x7fa4300ad6b0 legacy=0x7fa4300b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:08.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.509+0000 7fa4351cf640 1 -- 172.21.15.55:0/2693842975 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43006c1c0 con 0x7fa4300cb710 2023-08-25T05:19:08.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.513+0000 7fa4351cf640 1 --2- 172.21.15.55:0/2693842975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4300cb710 0x7fa4300cd1b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa42000a960 tx=0x7fa42001d770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3be62235140804b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:08.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.513+0000 7fa4349ce640 1 -- 172.21.15.55:0/2693842975 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c001800 con 0x7fa4300cb710 2023-08-25T05:19:08.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.513+0000 7fa4349ce640 1 -- 172.21.15.55:0/2693842975 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4200a9440 con 0x7fa4300cb710 2023-08-25T05:19:08.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.513+0000 7fa4349ce640 1 -- 172.21.15.55:0/2693842975 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4200a97d0 con 0x7fa4300cb710 2023-08-25T05:19:08.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.513+0000 7fa437c34640 1 -- 172.21.15.55:0/2693842975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4300cb710 msgr2=0x7fa4300cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:08.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.513+0000 7fa437c34640 1 --2- 172.21.15.55:0/2693842975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4300cb710 0x7fa4300cd1b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa42000a960 tx=0x7fa42001d770 comp rx=0 tx=0).stop 2023-08-25T05:19:08.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.513+0000 7fa437c34640 1 -- 172.21.15.55:0/2693842975 shutdown_connections 2023-08-25T05:19:08.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.513+0000 7fa437c34640 1 --2- 172.21.15.55:0/2693842975 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4300cb710 0x7fa4300cd1b0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.513+0000 7fa437c34640 1 -- 172.21.15.55:0/2693842975 >> 172.21.15.55:0/2693842975 conn(0x7fa430069900 msgr2=0x7fa430069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:08.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.513+0000 7fa437c34640 1 -- 172.21.15.55:0/2693842975 shutdown_connections 2023-08-25T05:19:08.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.513+0000 7fa437c34640 1 -- 172.21.15.55:0/2693842975 wait complete. 2023-08-25T05:19:08.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.513+0000 7fa437c34640 1 Processor -- start 2023-08-25T05:19:08.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.513+0000 7fa437c34640 1 -- start start 2023-08-25T05:19:08.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa437c34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa43006c9c0 0x7fa4300c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:08.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa437c34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4300ad6b0 0x7fa430098a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:08.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa437c34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4300cb710 0x7fa4300c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:08.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa437c34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300c3080 con 0x7fa43006c9c0 2023-08-25T05:19:08.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa437c34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300c4d40 con 0x7fa4300ad6b0 2023-08-25T05:19:08.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa437c34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300c2470 con 0x7fa4300cb710 2023-08-25T05:19:08.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa4359d0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa43006c9c0 0x7fa4300c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:08.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa4359d0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa43006c9c0 0x7fa4300c1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37130/0 (socket says 172.21.15.55:37130) 2023-08-25T05:19:08.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa4359d0640 1 -- 172.21.15.55:0/1146906403 learned_addr learned my addr 172.21.15.55:0/1146906403 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:08.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa4351cf640 1 --2- 172.21.15.55:0/1146906403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4300ad6b0 0x7fa430098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:08.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa4361d1640 1 --2- 172.21.15.55:0/1146906403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4300cb710 0x7fa4300c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:08.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa4359d0640 1 -- 172.21.15.55:0/1146906403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4300cb710 msgr2=0x7fa4300c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:08.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa4359d0640 1 --2- 172.21.15.55:0/1146906403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4300cb710 0x7fa4300c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa4359d0640 1 -- 172.21.15.55:0/1146906403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4300ad6b0 msgr2=0x7fa430098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:08.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa4359d0640 1 --2- 172.21.15.55:0/1146906403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4300ad6b0 0x7fa430098a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa4359d0640 1 -- 172.21.15.55:0/1146906403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42000a5c0 con 0x7fa43006c9c0 2023-08-25T05:19:08.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa4351cf640 1 --2- 172.21.15.55:0/1146906403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4300ad6b0 0x7fa430098a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:08.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa4359d0640 1 --2- 172.21.15.55:0/1146906403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa43006c9c0 0x7fa4300c1e20 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00c750 tx=0x7fa42c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:08.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa4267fc640 1 -- 172.21.15.55:0/1146906403 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c007270 con 0x7fa43006c9c0 2023-08-25T05:19:08.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa4267fc640 1 -- 172.21.15.55:0/1146906403 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c0073f0 con 0x7fa43006c9c0 2023-08-25T05:19:08.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa4267fc640 1 -- 172.21.15.55:0/1146906403 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c0057b0 con 0x7fa43006c9c0 2023-08-25T05:19:08.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa437c34640 1 -- 172.21.15.55:0/1146906403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4300c2750 con 0x7fa43006c9c0 2023-08-25T05:19:08.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa437c34640 1 -- 172.21.15.55:0/1146906403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4300c2d10 con 0x7fa43006c9c0 2023-08-25T05:19:08.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa437c34640 1 -- 172.21.15.55:0/1146906403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa430071f80 con 0x7fa43006c9c0 2023-08-25T05:19:08.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.517+0000 7fa4267fc640 1 -- 172.21.15.55:0/1146906403 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fa42c005910 con 0x7fa43006c9c0 2023-08-25T05:19:08.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.521+0000 7fa4267fc640 1 --2- 172.21.15.55:0/1146906403 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa4140657a0 0x7fa414067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:08.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.521+0000 7fa4267fc640 1 -- 172.21.15.55:0/1146906403 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fa42c082750 con 0x7fa43006c9c0 2023-08-25T05:19:08.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.521+0000 7fa4351cf640 1 --2- 172.21.15.55:0/1146906403 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa4140657a0 0x7fa414067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:08.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.521+0000 7fa4351cf640 1 --2- 172.21.15.55:0/1146906403 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa4140657a0 0x7fa414067c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa4200b0000 tx=0x7fa4200b3040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:08.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.525+0000 7fa4267fc640 1 -- 172.21.15.55:0/1146906403 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa42c050150 con 0x7fa43006c9c0 2023-08-25T05:19:08.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.677+0000 7fa437c34640 1 -- 172.21.15.55:0/1146906403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fa430073ec0 con 0x7fa43006c9c0 2023-08-25T05:19:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.681+0000 7fa4267fc640 1 -- 172.21.15.55:0/1146906403 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v56) v1 ==== 120+0+0 (secure 0 0 0) 0x7fa42c053770 con 0x7fa43006c9c0 2023-08-25T05:19:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.685+0000 7fa437c34640 1 -- 172.21.15.55:0/1146906403 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa4140657a0 msgr2=0x7fa414067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.685+0000 7fa437c34640 1 --2- 172.21.15.55:0/1146906403 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa4140657a0 0x7fa414067c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa4200b0000 tx=0x7fa4200b3040 comp rx=0 tx=0).stop 2023-08-25T05:19:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.685+0000 7fa437c34640 1 -- 172.21.15.55:0/1146906403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa43006c9c0 msgr2=0x7fa4300c1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.685+0000 7fa437c34640 1 --2- 172.21.15.55:0/1146906403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa43006c9c0 0x7fa4300c1e20 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00c750 tx=0x7fa42c00cc10 comp rx=0 tx=0).stop 2023-08-25T05:19:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.685+0000 7fa437c34640 1 -- 172.21.15.55:0/1146906403 shutdown_connections 2023-08-25T05:19:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.685+0000 7fa437c34640 1 --2- 172.21.15.55:0/1146906403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4300cb710 0x7fa4300c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.685+0000 7fa437c34640 1 --2- 172.21.15.55:0/1146906403 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa4140657a0 0x7fa414067c60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.685+0000 7fa437c34640 1 --2- 172.21.15.55:0/1146906403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4300ad6b0 0x7fa430098a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.685+0000 7fa437c34640 1 --2- 172.21.15.55:0/1146906403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa43006c9c0 0x7fa4300c1e20 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.685+0000 7fa437c34640 1 -- 172.21.15.55:0/1146906403 >> 172.21.15.55:0/1146906403 conn(0x7fa430069900 msgr2=0x7fa430158b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.685+0000 7fa437c34640 1 -- 172.21.15.55:0/1146906403 shutdown_connections 2023-08-25T05:19:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.685+0000 7fa437c34640 1 -- 172.21.15.55:0/1146906403 wait complete. 2023-08-25T05:19:08.708 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-25T05:19:08.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.861+0000 7fa8d1382640 1 Processor -- start 2023-08-25T05:19:08.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.861+0000 7fa8d1382640 1 -- start start 2023-08-25T05:19:08.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.861+0000 7fa8d1382640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa8cc1601f0 0x7fa8cc15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:08.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.861+0000 7fa8d1382640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8cc0d1290 0x7fa8cc15e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:08.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.861+0000 7fa8d1382640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8cc0cd5a0 con 0x7fa8cc15e3c0 2023-08-25T05:19:08.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.861+0000 7fa8d1382640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8cc0cd880 con 0x7fa8cc0d1290 2023-08-25T05:19:08.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.861+0000 7fa8d1382640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8cc0cdb60 con 0x7fa8cc1601f0 2023-08-25T05:19:08.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.861+0000 7fa8cb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8cc0d1290 0x7fa8cc15e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:08.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.861+0000 7fa8cb7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8cc0d1290 0x7fa8cc15e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37142/0 (socket says 172.21.15.55:37142) 2023-08-25T05:19:08.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.861+0000 7fa8cb7fe640 1 -- 172.21.15.55:0/2554200570 learned_addr learned my addr 172.21.15.55:0/2554200570 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:08.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.861+0000 7fa8cb7fe640 1 -- 172.21.15.55:0/2554200570 >> v2:172.21.15.110:3300/0 conn(0x7fa8cc1601f0 msgr2=0x7fa8cc15d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:08.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.861+0000 7fa8cb7fe640 1 --2- 172.21.15.55:0/2554200570 >> v2:172.21.15.110:3300/0 conn(0x7fa8cc1601f0 0x7fa8cc15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.861+0000 7fa8cb7fe640 1 -- 172.21.15.55:0/2554200570 >> v1:172.21.15.110:6789/0 conn(0x7fa8cc15e3c0 legacy=0x7fa8cc0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:08.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.861+0000 7fa8cb7fe640 1 -- 172.21.15.55:0/2554200570 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc0cde40 con 0x7fa8cc0d1290 2023-08-25T05:19:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.865+0000 7fa8cb7fe640 1 --2- 172.21.15.55:0/2554200570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8cc0d1290 0x7fa8cc15e8a0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc08b7f0 tx=0x7fa8c401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6bbbdff64bc6e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.865+0000 7fa8ca7fc640 1 -- 172.21.15.55:0/2554200570 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c40a5750 con 0x7fa8cc0d1290 2023-08-25T05:19:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.865+0000 7fa8ca7fc640 1 -- 172.21.15.55:0/2554200570 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c40a58b0 con 0x7fa8cc0d1290 2023-08-25T05:19:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.865+0000 7fa8ca7fc640 1 -- 172.21.15.55:0/2554200570 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c40a5c40 con 0x7fa8cc0d1290 2023-08-25T05:19:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.865+0000 7fa8d1382640 1 -- 172.21.15.55:0/2554200570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8cc0d1290 msgr2=0x7fa8cc15e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.865+0000 7fa8d1382640 1 --2- 172.21.15.55:0/2554200570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8cc0d1290 0x7fa8cc15e8a0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc08b7f0 tx=0x7fa8c401c960 comp rx=0 tx=0).stop 2023-08-25T05:19:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.865+0000 7fa8d1382640 1 -- 172.21.15.55:0/2554200570 shutdown_connections 2023-08-25T05:19:08.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.865+0000 7fa8d1382640 1 --2- 172.21.15.55:0/2554200570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8cc0d1290 0x7fa8cc15e8a0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.865+0000 7fa8d1382640 1 --2- 172.21.15.55:0/2554200570 >> v2:172.21.15.110:3300/0 conn(0x7fa8cc1601f0 0x7fa8cc15d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.865+0000 7fa8d1382640 1 -- 172.21.15.55:0/2554200570 >> 172.21.15.55:0/2554200570 conn(0x7fa8cc0d27d0 msgr2=0x7fa8cc0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:08.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.865+0000 7fa8d1382640 1 -- 172.21.15.55:0/2554200570 shutdown_connections 2023-08-25T05:19:08.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.865+0000 7fa8d1382640 1 -- 172.21.15.55:0/2554200570 wait complete. 2023-08-25T05:19:08.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.865+0000 7fa8d1382640 1 Processor -- start 2023-08-25T05:19:08.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.865+0000 7fa8d1382640 1 -- start start 2023-08-25T05:19:08.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8d1382640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8cc0d1290 0x7fa8cc159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:08.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8d1382640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8cc15e3c0 0x7fa8cc0b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:08.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8d1382640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8cc1601f0 0x7fa8cc15b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:08.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8d1382640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc15b250 con 0x7fa8cc15e3c0 2023-08-25T05:19:08.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8d1382640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc15a640 con 0x7fa8cc0d1290 2023-08-25T05:19:08.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8d1382640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc15a920 con 0x7fa8cc1601f0 2023-08-25T05:19:08.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8cc15e3c0 0x7fa8cc0b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:08.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8cc15e3c0 0x7fa8cc0b6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37144/0 (socket says 172.21.15.55:37144) 2023-08-25T05:19:08.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8c3fff640 1 -- 172.21.15.55:0/240422794 learned_addr learned my addr 172.21.15.55:0/240422794 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:08.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8caffd640 1 --2- 172.21.15.55:0/240422794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8cc0d1290 0x7fa8cc159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:08.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8cb7fe640 1 --2- 172.21.15.55:0/240422794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8cc1601f0 0x7fa8cc15b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:08.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8c3fff640 1 -- 172.21.15.55:0/240422794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8cc1601f0 msgr2=0x7fa8cc15b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:08.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8c3fff640 1 --2- 172.21.15.55:0/240422794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8cc1601f0 0x7fa8cc15b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8c3fff640 1 -- 172.21.15.55:0/240422794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8cc0d1290 msgr2=0x7fa8cc159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:08.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8c3fff640 1 --2- 172.21.15.55:0/240422794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8cc0d1290 0x7fa8cc159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:08.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8c3fff640 1 -- 172.21.15.55:0/240422794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c4009b30 con 0x7fa8cc15e3c0 2023-08-25T05:19:08.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8caffd640 1 --2- 172.21.15.55:0/240422794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8cc0d1290 0x7fa8cc159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:08.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8c3fff640 1 --2- 172.21.15.55:0/240422794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8cc15e3c0 0x7fa8cc0b6d80 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400c490 tx=0x7fa8b4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:08.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8c37fe640 1 -- 172.21.15.55:0/240422794 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4003600 con 0x7fa8cc15e3c0 2023-08-25T05:19:08.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8c37fe640 1 -- 172.21.15.55:0/240422794 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b4003780 con 0x7fa8cc15e3c0 2023-08-25T05:19:08.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8c37fe640 1 -- 172.21.15.55:0/240422794 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4003b70 con 0x7fa8cc15e3c0 2023-08-25T05:19:08.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8d1382640 1 -- 172.21.15.55:0/240422794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc0ce7c0 con 0x7fa8cc15e3c0 2023-08-25T05:19:08.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8d1382640 1 -- 172.21.15.55:0/240422794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc15aee0 con 0x7fa8cc15e3c0 2023-08-25T05:19:08.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.869+0000 7fa8d1382640 1 -- 172.21.15.55:0/240422794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8cc0b5a20 con 0x7fa8cc15e3c0 2023-08-25T05:19:08.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.873+0000 7fa8c37fe640 1 -- 172.21.15.55:0/240422794 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fa8b4003cd0 con 0x7fa8cc15e3c0 2023-08-25T05:19:08.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.873+0000 7fa8c37fe640 1 --2- 172.21.15.55:0/240422794 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa8ac0657a0 0x7fa8ac067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:08.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.873+0000 7fa8c37fe640 1 -- 172.21.15.55:0/240422794 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fa8b40820a0 con 0x7fa8cc15e3c0 2023-08-25T05:19:08.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.873+0000 7fa8caffd640 1 --2- 172.21.15.55:0/240422794 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa8ac0657a0 0x7fa8ac067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:08.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.873+0000 7fa8caffd640 1 --2- 172.21.15.55:0/240422794 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa8ac0657a0 0x7fa8ac067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009890 tx=0x7fa8bc008040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:08.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:08.877+0000 7fa8c37fe640 1 -- 172.21.15.55:0/240422794 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa8b404fad0 con 0x7fa8cc15e3c0 2023-08-25T05:19:09.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.033+0000 7fa8d1382640 1 -- 172.21.15.55:0/240422794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa8cc073ec0 con 0x7fa8cc15e3c0 2023-08-25T05:19:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.037+0000 7fa8c37fe640 1 -- 172.21.15.55:0/240422794 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa8b40530f0 con 0x7fa8cc15e3c0 2023-08-25T05:19:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.041+0000 7fa8d1382640 1 -- 172.21.15.55:0/240422794 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa8ac0657a0 msgr2=0x7fa8ac067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.041+0000 7fa8d1382640 1 --2- 172.21.15.55:0/240422794 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa8ac0657a0 0x7fa8ac067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009890 tx=0x7fa8bc008040 comp rx=0 tx=0).stop 2023-08-25T05:19:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.041+0000 7fa8d1382640 1 -- 172.21.15.55:0/240422794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8cc15e3c0 msgr2=0x7fa8cc0b6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.041+0000 7fa8d1382640 1 --2- 172.21.15.55:0/240422794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8cc15e3c0 0x7fa8cc0b6d80 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400c490 tx=0x7fa8b4001e80 comp rx=0 tx=0).stop 2023-08-25T05:19:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.041+0000 7fa8d1382640 1 -- 172.21.15.55:0/240422794 shutdown_connections 2023-08-25T05:19:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.041+0000 7fa8d1382640 1 --2- 172.21.15.55:0/240422794 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8cc1601f0 0x7fa8cc15b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.041+0000 7fa8d1382640 1 --2- 172.21.15.55:0/240422794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8cc15e3c0 0x7fa8cc0b6d80 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.041+0000 7fa8d1382640 1 --2- 172.21.15.55:0/240422794 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa8ac0657a0 0x7fa8ac067c60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.041+0000 7fa8d1382640 1 --2- 172.21.15.55:0/240422794 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8cc0d1290 0x7fa8cc159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.041+0000 7fa8d1382640 1 -- 172.21.15.55:0/240422794 >> 172.21.15.55:0/240422794 conn(0x7fa8cc0d27d0 msgr2=0x7fa8cc0d0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.041+0000 7fa8d1382640 1 -- 172.21.15.55:0/240422794 shutdown_connections 2023-08-25T05:19:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.041+0000 7fa8d1382640 1 -- 172.21.15.55:0/240422794 wait complete. 2023-08-25T05:19:09.062 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-08-25T05:19:09.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.201+0000 7fc44c088640 1 Processor -- start 2023-08-25T05:19:09.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.201+0000 7fc44c088640 1 -- start start 2023-08-25T05:19:09.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.205+0000 7fc44c088640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc444158e10 0x7fc4440b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:09.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.205+0000 7fc44c088640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc444159f10 0x7fc4440cab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:09.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.205+0000 7fc44c088640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc4440cb0d0 0x7fc4440c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:09.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.205+0000 7fc44c088640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4440ad940 con 0x7fc444159f10 2023-08-25T05:19:09.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.205+0000 7fc44c088640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4440cb540 con 0x7fc4440cb0d0 2023-08-25T05:19:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.205+0000 7fc44c088640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440cdbf0 con 0x7fc444158e10 2023-08-25T05:19:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.205+0000 7fc449623640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc444159f10 0x7fc4440cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.205+0000 7fc449623640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc444159f10 0x7fc4440cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37160/0 (socket says 172.21.15.55:37160) 2023-08-25T05:19:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.205+0000 7fc449623640 1 -- 172.21.15.55:0/3048530108 learned_addr learned my addr 172.21.15.55:0/3048530108 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:09.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.205+0000 7fc44a625640 1 --2- 172.21.15.55:0/3048530108 >> v2:172.21.15.110:3300/0 conn(0x7fc4440cb0d0 0x7fc4440c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:09.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.205+0000 7fc449e24640 1 --2- 172.21.15.55:0/3048530108 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc444158e10 0x7fc4440b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:09.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.205+0000 7fc449623640 1 -- 172.21.15.55:0/3048530108 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc444158e10 msgr2=0x7fc4440b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:09.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.205+0000 7fc449623640 1 --2- 172.21.15.55:0/3048530108 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc444158e10 0x7fc4440b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:09.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.205+0000 7fc449623640 1 -- 172.21.15.55:0/3048530108 >> v2:172.21.15.110:3300/0 conn(0x7fc4440cb0d0 msgr2=0x7fc4440c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:09.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.205+0000 7fc449623640 1 --2- 172.21.15.55:0/3048530108 >> v2:172.21.15.110:3300/0 conn(0x7fc4440cb0d0 0x7fc4440c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:09.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.205+0000 7fc449623640 1 -- 172.21.15.55:0/3048530108 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44415a390 con 0x7fc444159f10 2023-08-25T05:19:09.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.205+0000 7fc449e24640 1 --2- 172.21.15.55:0/3048530108 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc444158e10 0x7fc4440b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:19:09.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.205+0000 7fc44a625640 1 --2- 172.21.15.55:0/3048530108 >> v2:172.21.15.110:3300/0 conn(0x7fc4440cb0d0 0x7fc4440c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:19:09.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.209+0000 7fc449623640 1 --2- 172.21.15.55:0/3048530108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc444159f10 0x7fc4440cab90 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fc4440b33d0 tx=0x7fc43401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f5b8dbf4a26c09 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:09.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.209+0000 7fc448e22640 1 -- 172.21.15.55:0/3048530108 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4340ab640 con 0x7fc444159f10 2023-08-25T05:19:09.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.209+0000 7fc448e22640 1 -- 172.21.15.55:0/3048530108 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4340a7070 con 0x7fc444159f10 2023-08-25T05:19:09.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.209+0000 7fc448e22640 1 -- 172.21.15.55:0/3048530108 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4340ab9c0 con 0x7fc444159f10 2023-08-25T05:19:09.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.209+0000 7fc44c088640 1 -- 172.21.15.55:0/3048530108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc444159f10 msgr2=0x7fc4440cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:09.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.209+0000 7fc44c088640 1 --2- 172.21.15.55:0/3048530108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc444159f10 0x7fc4440cab90 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fc4440b33d0 tx=0x7fc43401c500 comp rx=0 tx=0).stop 2023-08-25T05:19:09.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.209+0000 7fc44c088640 1 -- 172.21.15.55:0/3048530108 shutdown_connections 2023-08-25T05:19:09.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.209+0000 7fc44c088640 1 --2- 172.21.15.55:0/3048530108 >> v2:172.21.15.110:3300/0 conn(0x7fc4440cb0d0 0x7fc4440c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:09.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.209+0000 7fc44c088640 1 --2- 172.21.15.55:0/3048530108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc444159f10 0x7fc4440cab90 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:09.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.209+0000 7fc44c088640 1 --2- 172.21.15.55:0/3048530108 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc444158e10 0x7fc4440b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:09.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.209+0000 7fc44c088640 1 -- 172.21.15.55:0/3048530108 >> 172.21.15.55:0/3048530108 conn(0x7fc444069d00 msgr2=0x7fc44406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:09.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.209+0000 7fc44c088640 1 -- 172.21.15.55:0/3048530108 shutdown_connections 2023-08-25T05:19:09.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.209+0000 7fc44c088640 1 -- 172.21.15.55:0/3048530108 wait complete. 2023-08-25T05:19:09.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.209+0000 7fc44c088640 1 Processor -- start 2023-08-25T05:19:09.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.209+0000 7fc44c088640 1 -- start start 2023-08-25T05:19:09.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc44c088640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4440cb0d0 0x7fc4440abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:09.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc44c088640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc444158e10 0x7fc4440acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:09.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc44c088640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc444159f10 0x7fc4440978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:09.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc44c088640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440ab090 con 0x7fc4440cb0d0 2023-08-25T05:19:09.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc44c088640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440ad100 con 0x7fc444159f10 2023-08-25T05:19:09.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc44c088640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4440ac610 con 0x7fc444158e10 2023-08-25T05:19:09.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc449e24640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4440cb0d0 0x7fc4440abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:09.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc449e24640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4440cb0d0 0x7fc4440abb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37162/0 (socket says 172.21.15.55:37162) 2023-08-25T05:19:09.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc449e24640 1 -- 172.21.15.55:0/3176792973 learned_addr learned my addr 172.21.15.55:0/3176792973 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:09.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc449623640 1 --2- 172.21.15.55:0/3176792973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc444158e10 0x7fc4440acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:09.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc44a625640 1 --2- 172.21.15.55:0/3176792973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc444159f10 0x7fc4440978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:09.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc449e24640 1 -- 172.21.15.55:0/3176792973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc444158e10 msgr2=0x7fc4440acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:09.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc449e24640 1 --2- 172.21.15.55:0/3176792973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc444158e10 0x7fc4440acbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:09.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc449e24640 1 -- 172.21.15.55:0/3176792973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc444159f10 msgr2=0x7fc4440978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:09.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc449e24640 1 --2- 172.21.15.55:0/3176792973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc444159f10 0x7fc4440978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:09.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc449e24640 1 -- 172.21.15.55:0/3176792973 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4340094d0 con 0x7fc4440cb0d0 2023-08-25T05:19:09.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc449e24640 1 --2- 172.21.15.55:0/3176792973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4440cb0d0 0x7fc4440abb00 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fc44000c7c0 tx=0x7fc44000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:09.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc43a7fc640 1 -- 172.21.15.55:0/3176792973 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440007a30 con 0x7fc4440cb0d0 2023-08-25T05:19:09.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc43a7fc640 1 -- 172.21.15.55:0/3176792973 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc440007b90 con 0x7fc4440cb0d0 2023-08-25T05:19:09.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc43a7fc640 1 -- 172.21.15.55:0/3176792973 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44000ce70 con 0x7fc4440cb0d0 2023-08-25T05:19:09.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc44c088640 1 -- 172.21.15.55:0/3176792973 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc444159370 con 0x7fc4440cb0d0 2023-08-25T05:19:09.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc44c088640 1 -- 172.21.15.55:0/3176792973 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4440ab5e0 con 0x7fc4440cb0d0 2023-08-25T05:19:09.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc44c088640 1 -- 172.21.15.55:0/3176792973 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44404dbe0 con 0x7fc4440cb0d0 2023-08-25T05:19:09.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.213+0000 7fc43a7fc640 1 -- 172.21.15.55:0/3176792973 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fc4400113f0 con 0x7fc4440cb0d0 2023-08-25T05:19:09.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.217+0000 7fc43a7fc640 1 --2- 172.21.15.55:0/3176792973 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fc4280657a0 0x7fc428067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:09.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.217+0000 7fc43a7fc640 1 -- 172.21.15.55:0/3176792973 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fc440083580 con 0x7fc4440cb0d0 2023-08-25T05:19:09.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.217+0000 7fc449623640 1 --2- 172.21.15.55:0/3176792973 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fc4280657a0 0x7fc428067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:09.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.217+0000 7fc449623640 1 --2- 172.21.15.55:0/3176792973 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fc4280657a0 0x7fc428067c60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc4340af000 tx=0x7fc4340a7000 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:09.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.221+0000 7fc43a7fc640 1 -- 172.21.15.55:0/3176792973 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc440050df0 con 0x7fc4440cb0d0 2023-08-25T05:19:09.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.429+0000 7fc44c088640 1 -- 172.21.15.55:0/3176792973 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7fc4440cd5c0 con 0x7fc4440cb0d0 2023-08-25T05:19:09.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.977+0000 7fc43a7fc640 1 -- 172.21.15.55:0/3176792973 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2486) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc440054410 con 0x7fc4440cb0d0 2023-08-25T05:19:09.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.981+0000 7fc44c088640 1 -- 172.21.15.55:0/3176792973 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fc4280657a0 msgr2=0x7fc428067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:09.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.981+0000 7fc44c088640 1 --2- 172.21.15.55:0/3176792973 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fc4280657a0 0x7fc428067c60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc4340af000 tx=0x7fc4340a7000 comp rx=0 tx=0).stop 2023-08-25T05:19:09.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.981+0000 7fc44c088640 1 -- 172.21.15.55:0/3176792973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4440cb0d0 msgr2=0x7fc4440abb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:09.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.981+0000 7fc44c088640 1 --2- 172.21.15.55:0/3176792973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4440cb0d0 0x7fc4440abb00 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fc44000c7c0 tx=0x7fc44000cc80 comp rx=0 tx=0).stop 2023-08-25T05:19:09.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.981+0000 7fc44c088640 1 -- 172.21.15.55:0/3176792973 shutdown_connections 2023-08-25T05:19:09.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.981+0000 7fc44c088640 1 --2- 172.21.15.55:0/3176792973 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fc4280657a0 0x7fc428067c60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:09.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.981+0000 7fc44c088640 1 --2- 172.21.15.55:0/3176792973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc444159f10 0x7fc4440978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:09.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.981+0000 7fc44c088640 1 --2- 172.21.15.55:0/3176792973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc444158e10 0x7fc4440acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:09.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.981+0000 7fc44c088640 1 --2- 172.21.15.55:0/3176792973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4440cb0d0 0x7fc4440abb00 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:09.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.981+0000 7fc44c088640 1 -- 172.21.15.55:0/3176792973 >> 172.21.15.55:0/3176792973 conn(0x7fc444069d00 msgr2=0x7fc4440c89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:09.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.981+0000 7fc44c088640 1 -- 172.21.15.55:0/3176792973 shutdown_connections 2023-08-25T05:19:09.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:09.981+0000 7fc44c088640 1 -- 172.21.15.55:0/3176792973 wait complete. 2023-08-25T05:19:10.004 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-08-25T05:19:10.004 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-08-25T05:19:10.004 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-25T05:19:10.005 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-08-25T05:19:10.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.145+0000 7f34e2fac640 1 Processor -- start 2023-08-25T05:19:10.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.145+0000 7f34e2fac640 1 -- start start 2023-08-25T05:19:10.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.149+0000 7f34e2fac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34dc15fef0 0x7f34dc0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:10.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.149+0000 7f34e2fac640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f34dc0b2a40 0x7f34dc0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:10.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.149+0000 7f34e2fac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34dc160570 con 0x7f34dc0b2ea0 2023-08-25T05:19:10.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.149+0000 7f34e2fac640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34dc1602d0 con 0x7f34dc0b2a40 2023-08-25T05:19:10.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.149+0000 7f34e2fac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc160810 con 0x7f34dc15fef0 2023-08-25T05:19:10.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.149+0000 7f34e1549640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f34dc0b2ea0 0x7f34dc0b14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45912/0 (socket says 172.21.15.55:45912) 2023-08-25T05:19:10.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.149+0000 7f34e1549640 1 -- 172.21.15.55:0/1107389575 learned_addr learned my addr 172.21.15.55:0/1107389575 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:10.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.149+0000 7f34e0d48640 1 --2- 172.21.15.55:0/1107389575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34dc15fef0 0x7f34dc0cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:10.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.149+0000 7f34d3fff640 1 --2- 172.21.15.55:0/1107389575 >> v2:172.21.15.110:3300/0 conn(0x7f34dc0b2a40 0x7f34dc0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:10.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.149+0000 7f34d37fe640 1 -- 172.21.15.55:0/1107389575 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734206984 0 0) 0x7f34dc160570 con 0x7f34dc0b2ea0 2023-08-25T05:19:10.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.149+0000 7f34d37fe640 1 -- 172.21.15.55:0/1107389575 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34c4003530 con 0x7f34dc0b2ea0 2023-08-25T05:19:10.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.149+0000 7f34e0d48640 1 -- 172.21.15.55:0/1107389575 >> v2:172.21.15.110:3300/0 conn(0x7f34dc0b2a40 msgr2=0x7f34dc0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:10.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.149+0000 7f34e0d48640 1 --2- 172.21.15.55:0/1107389575 >> v2:172.21.15.110:3300/0 conn(0x7f34dc0b2a40 0x7f34dc0ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:10.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.149+0000 7f34e0d48640 1 -- 172.21.15.55:0/1107389575 >> v1:172.21.15.55:6789/0 conn(0x7f34dc0b2ea0 legacy=0x7f34dc0b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:10.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.149+0000 7f34e0d48640 1 -- 172.21.15.55:0/1107389575 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34dc160af0 con 0x7f34dc15fef0 2023-08-25T05:19:10.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.153+0000 7f34e0d48640 1 --2- 172.21.15.55:0/1107389575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34dc15fef0 0x7f34dc0cce60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f34d80097c0 tx=0x7f34d801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58f3fadb8fe637ca server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:10.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.153+0000 7f34d37fe640 1 -- 172.21.15.55:0/1107389575 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d80ab600 con 0x7f34dc15fef0 2023-08-25T05:19:10.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.153+0000 7f34d37fe640 1 -- 172.21.15.55:0/1107389575 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d80a7050 con 0x7f34dc15fef0 2023-08-25T05:19:10.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.153+0000 7f34d37fe640 1 -- 172.21.15.55:0/1107389575 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d80ab980 con 0x7f34dc15fef0 2023-08-25T05:19:10.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.153+0000 7f34e2fac640 1 -- 172.21.15.55:0/1107389575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34dc15fef0 msgr2=0x7f34dc0cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:10.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.153+0000 7f34e2fac640 1 --2- 172.21.15.55:0/1107389575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34dc15fef0 0x7f34dc0cce60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f34d80097c0 tx=0x7f34d801c3c0 comp rx=0 tx=0).stop 2023-08-25T05:19:10.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.153+0000 7f34e2fac640 1 -- 172.21.15.55:0/1107389575 shutdown_connections 2023-08-25T05:19:10.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.153+0000 7f34e2fac640 1 --2- 172.21.15.55:0/1107389575 >> v2:172.21.15.110:3300/0 conn(0x7f34dc0b2a40 0x7f34dc0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:10.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.153+0000 7f34e2fac640 1 --2- 172.21.15.55:0/1107389575 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34dc15fef0 0x7f34dc0cce60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:10.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.153+0000 7f34e2fac640 1 -- 172.21.15.55:0/1107389575 >> 172.21.15.55:0/1107389575 conn(0x7f34dc069d00 msgr2=0x7f34dc06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:10.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.153+0000 7f34e2fac640 1 -- 172.21.15.55:0/1107389575 shutdown_connections 2023-08-25T05:19:10.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.153+0000 7f34e2fac640 1 -- 172.21.15.55:0/1107389575 wait complete. 2023-08-25T05:19:10.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.153+0000 7f34e2fac640 1 Processor -- start 2023-08-25T05:19:10.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.153+0000 7f34e2fac640 1 -- start start 2023-08-25T05:19:10.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34e2fac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34dc0b2a40 0x7f34dc06fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:10.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34e2fac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34dc0b2ea0 0x7f34dc070360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:10.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34e2fac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34dc15fef0 0x7f34dc0708a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:10.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34e2fac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc152ba0 con 0x7f34dc0b2ea0 2023-08-25T05:19:10.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34e2fac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc06f990 con 0x7f34dc0b2a40 2023-08-25T05:19:10.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34e2fac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34dc152df0 con 0x7f34dc15fef0 2023-08-25T05:19:10.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34d3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34dc0b2ea0 0x7f34dc070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:10.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34d3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34dc0b2ea0 0x7f34dc070360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37174/0 (socket says 172.21.15.55:37174) 2023-08-25T05:19:10.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34d3fff640 1 -- 172.21.15.55:0/74778396 learned_addr learned my addr 172.21.15.55:0/74778396 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:10.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34e1549640 1 --2- 172.21.15.55:0/74778396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34dc15fef0 0x7f34dc0708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:10.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34e0d48640 1 --2- 172.21.15.55:0/74778396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34dc0b2a40 0x7f34dc06fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:10.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34d3fff640 1 -- 172.21.15.55:0/74778396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34dc15fef0 msgr2=0x7f34dc0708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:10.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34d3fff640 1 --2- 172.21.15.55:0/74778396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34dc15fef0 0x7f34dc0708a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:10.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34d3fff640 1 -- 172.21.15.55:0/74778396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34dc0b2a40 msgr2=0x7f34dc06fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:10.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34d3fff640 1 --2- 172.21.15.55:0/74778396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34dc0b2a40 0x7f34dc06fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:10.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34d3fff640 1 -- 172.21.15.55:0/74778396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d8009420 con 0x7f34dc0b2ea0 2023-08-25T05:19:10.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34d3fff640 1 --2- 172.21.15.55:0/74778396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34dc0b2ea0 0x7f34dc070360 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00e870 tx=0x7f34cc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:10.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34d17fa640 1 -- 172.21.15.55:0/74778396 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc009510 con 0x7f34dc0b2ea0 2023-08-25T05:19:10.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34d17fa640 1 -- 172.21.15.55:0/74778396 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc00eec0 con 0x7f34dc0b2ea0 2023-08-25T05:19:10.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34e2fac640 1 -- 172.21.15.55:0/74778396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34dc1530d0 con 0x7f34dc0b2ea0 2023-08-25T05:19:10.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34d17fa640 1 -- 172.21.15.55:0/74778396 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc00cae0 con 0x7f34dc0b2ea0 2023-08-25T05:19:10.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34e2fac640 1 -- 172.21.15.55:0/74778396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34dc153690 con 0x7f34dc0b2ea0 2023-08-25T05:19:10.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.157+0000 7f34e2fac640 1 -- 172.21.15.55:0/74778396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34dc04dbe0 con 0x7f34dc0b2ea0 2023-08-25T05:19:10.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.161+0000 7f34d17fa640 1 -- 172.21.15.55:0/74778396 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f34cc00cc40 con 0x7f34dc0b2ea0 2023-08-25T05:19:10.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.161+0000 7f34d17fa640 1 --2- 172.21.15.55:0/74778396 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f34c80657a0 0x7f34c8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:10.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.161+0000 7f34d17fa640 1 -- 172.21.15.55:0/74778396 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f34cc082f80 con 0x7f34dc0b2ea0 2023-08-25T05:19:10.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.161+0000 7f34e0d48640 1 --2- 172.21.15.55:0/74778396 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f34c80657a0 0x7f34c8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:10.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.161+0000 7f34e0d48640 1 --2- 172.21.15.55:0/74778396 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f34c80657a0 0x7f34c8067c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f34d80ad000 tx=0x7f34d80a6000 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:10.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.165+0000 7f34d17fa640 1 -- 172.21.15.55:0/74778396 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f34cc050a30 con 0x7f34dc0b2ea0 2023-08-25T05:19:10.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.373+0000 7f34e2fac640 1 -- 172.21.15.55:0/74778396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f34dc06bf10 con 0x7f34dc0b2ea0 2023-08-25T05:19:10.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.985+0000 7f34d17fa640 1 -- 172.21.15.55:0/74778396 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2487) v1 ==== 168+0+0 (secure 0 0 0) 0x7f34cc054050 con 0x7f34dc0b2ea0 2023-08-25T05:19:10.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.989+0000 7f34e2fac640 1 -- 172.21.15.55:0/74778396 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f34c80657a0 msgr2=0x7f34c8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:10.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.989+0000 7f34e2fac640 1 --2- 172.21.15.55:0/74778396 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f34c80657a0 0x7f34c8067c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f34d80ad000 tx=0x7f34d80a6000 comp rx=0 tx=0).stop 2023-08-25T05:19:10.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.989+0000 7f34e2fac640 1 -- 172.21.15.55:0/74778396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34dc0b2ea0 msgr2=0x7f34dc070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:10.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.989+0000 7f34e2fac640 1 --2- 172.21.15.55:0/74778396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34dc0b2ea0 0x7f34dc070360 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f34cc00e870 tx=0x7f34cc00ec70 comp rx=0 tx=0).stop 2023-08-25T05:19:10.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.989+0000 7f34e2fac640 1 -- 172.21.15.55:0/74778396 shutdown_connections 2023-08-25T05:19:10.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.989+0000 7f34e2fac640 1 --2- 172.21.15.55:0/74778396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34dc15fef0 0x7f34dc0708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:10.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.989+0000 7f34e2fac640 1 --2- 172.21.15.55:0/74778396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34dc0b2ea0 0x7f34dc070360 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:10.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.989+0000 7f34e2fac640 1 --2- 172.21.15.55:0/74778396 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f34c80657a0 0x7f34c8067c60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:10.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.989+0000 7f34e2fac640 1 --2- 172.21.15.55:0/74778396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34dc0b2a40 0x7f34dc06fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:10.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.989+0000 7f34e2fac640 1 -- 172.21.15.55:0/74778396 >> 172.21.15.55:0/74778396 conn(0x7f34dc069d00 msgr2=0x7f34dc0ca210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:10.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.989+0000 7f34e2fac640 1 -- 172.21.15.55:0/74778396 shutdown_connections 2023-08-25T05:19:10.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:10.989+0000 7f34e2fac640 1 -- 172.21.15.55:0/74778396 wait complete. 2023-08-25T05:19:11.014 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:19:11.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc6cce5640 1 Processor -- start 2023-08-25T05:19:11.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc6cce5640 1 -- start start 2023-08-25T05:19:11.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc6cce5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc680d0da0 0x7fcc680d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc6cce5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc680cdde0 0x7fcc680ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc6cce5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcc680cee60 0x7fcc680cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc6cce5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc680ce760 con 0x7fcc680cdde0 2023-08-25T05:19:11.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc6cce5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc680b29b0 con 0x7fcc680cee60 2023-08-25T05:19:11.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc6cce5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc680d16c0 con 0x7fcc680d0da0 2023-08-25T05:19:11.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc65d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc680cdde0 0x7fcc680ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc65d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc680cdde0 0x7fcc680ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53630/0 (socket says 172.21.15.55:53630) 2023-08-25T05:19:11.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc65d9b640 1 -- 172.21.15.55:0/2449773851 learned_addr learned my addr 172.21.15.55:0/2449773851 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:11.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc66d9d640 1 --2- 172.21.15.55:0/2449773851 >> v2:172.21.15.110:3300/0 conn(0x7fcc680cee60 0x7fcc680cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc6659c640 1 --2- 172.21.15.55:0/2449773851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc680d0da0 0x7fcc680d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc65d9b640 1 -- 172.21.15.55:0/2449773851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc680d0da0 msgr2=0x7fcc680d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:11.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc65d9b640 1 --2- 172.21.15.55:0/2449773851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc680d0da0 0x7fcc680d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc65d9b640 1 -- 172.21.15.55:0/2449773851 >> v2:172.21.15.110:3300/0 conn(0x7fcc680cee60 msgr2=0x7fcc680cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:11.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc65d9b640 1 --2- 172.21.15.55:0/2449773851 >> v2:172.21.15.110:3300/0 conn(0x7fcc680cee60 0x7fcc680cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc65d9b640 1 -- 172.21.15.55:0/2449773851 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc680b1dc0 con 0x7fcc680cdde0 2023-08-25T05:19:11.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.161+0000 7fcc6659c640 1 --2- 172.21.15.55:0/2449773851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc680d0da0 0x7fcc680d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:11.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.165+0000 7fcc65d9b640 1 --2- 172.21.15.55:0/2449773851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc680cdde0 0x7fcc680ce220 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fcc680b1bd0 tx=0x7fcc5c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd49203ea2a65e90 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:11.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.165+0000 7fcc6559a640 1 -- 172.21.15.55:0/2449773851 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c0a89b0 con 0x7fcc680cdde0 2023-08-25T05:19:11.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.165+0000 7fcc6559a640 1 -- 172.21.15.55:0/2449773851 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5c0a8b10 con 0x7fcc680cdde0 2023-08-25T05:19:11.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.165+0000 7fcc6559a640 1 -- 172.21.15.55:0/2449773851 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c0a8ea0 con 0x7fcc680cdde0 2023-08-25T05:19:11.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.165+0000 7fcc6cce5640 1 -- 172.21.15.55:0/2449773851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc680cdde0 msgr2=0x7fcc680ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:11.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.165+0000 7fcc6cce5640 1 --2- 172.21.15.55:0/2449773851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc680cdde0 0x7fcc680ce220 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fcc680b1bd0 tx=0x7fcc5c01ecf0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.165+0000 7fcc6cce5640 1 -- 172.21.15.55:0/2449773851 shutdown_connections 2023-08-25T05:19:11.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.165+0000 7fcc6cce5640 1 --2- 172.21.15.55:0/2449773851 >> v2:172.21.15.110:3300/0 conn(0x7fcc680cee60 0x7fcc680cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.165+0000 7fcc6cce5640 1 --2- 172.21.15.55:0/2449773851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc680cdde0 0x7fcc680ce220 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.165+0000 7fcc6cce5640 1 --2- 172.21.15.55:0/2449773851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc680d0da0 0x7fcc680d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.165+0000 7fcc6cce5640 1 -- 172.21.15.55:0/2449773851 >> 172.21.15.55:0/2449773851 conn(0x7fcc6809bae0 msgr2=0x7fcc680d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:11.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.165+0000 7fcc6cce5640 1 -- 172.21.15.55:0/2449773851 shutdown_connections 2023-08-25T05:19:11.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.165+0000 7fcc6cce5640 1 -- 172.21.15.55:0/2449773851 wait complete. 2023-08-25T05:19:11.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6cce5640 1 Processor -- start 2023-08-25T05:19:11.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6cce5640 1 -- start start 2023-08-25T05:19:11.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6cce5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc680cdde0 0x7fcc68151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6cce5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc680cee60 0x7fcc680b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6cce5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc680d0da0 0x7fcc6815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6cce5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc680b57c0 con 0x7fcc680cdde0 2023-08-25T05:19:11.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6cce5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc680b5aa0 con 0x7fcc680cee60 2023-08-25T05:19:11.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6cce5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc680b5d80 con 0x7fcc680d0da0 2023-08-25T05:19:11.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc680cdde0 0x7fcc68151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc680cdde0 0x7fcc68151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53632/0 (socket says 172.21.15.55:53632) 2023-08-25T05:19:11.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6659c640 1 -- 172.21.15.55:0/979661406 learned_addr learned my addr 172.21.15.55:0/979661406 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:11.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc65d9b640 1 --2- 172.21.15.55:0/979661406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc680cee60 0x7fcc680b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc66d9d640 1 --2- 172.21.15.55:0/979661406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc680d0da0 0x7fcc6815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6659c640 1 -- 172.21.15.55:0/979661406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc680d0da0 msgr2=0x7fcc6815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:11.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6659c640 1 --2- 172.21.15.55:0/979661406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc680d0da0 0x7fcc6815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6659c640 1 -- 172.21.15.55:0/979661406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc680cee60 msgr2=0x7fcc680b6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:11.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6659c640 1 --2- 172.21.15.55:0/979661406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc680cee60 0x7fcc680b6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6659c640 1 -- 172.21.15.55:0/979661406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c0094d0 con 0x7fcc680cdde0 2023-08-25T05:19:11.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6659c640 1 --2- 172.21.15.55:0/979661406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc680cdde0 0x7fcc68151bb0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800e7e0 tx=0x7fcc5800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:11.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc56ffd640 1 -- 172.21.15.55:0/979661406 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc580059a0 con 0x7fcc680cdde0 2023-08-25T05:19:11.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc56ffd640 1 -- 172.21.15.55:0/979661406 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc58005b00 con 0x7fcc680cdde0 2023-08-25T05:19:11.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc56ffd640 1 -- 172.21.15.55:0/979661406 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58005e90 con 0x7fcc680cdde0 2023-08-25T05:19:11.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6cce5640 1 -- 172.21.15.55:0/979661406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc680b6060 con 0x7fcc680cdde0 2023-08-25T05:19:11.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6cce5640 1 -- 172.21.15.55:0/979661406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc680b53e0 con 0x7fcc680cdde0 2023-08-25T05:19:11.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.169+0000 7fcc6cce5640 1 -- 172.21.15.55:0/979661406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc6804dbe0 con 0x7fcc680cdde0 2023-08-25T05:19:11.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.173+0000 7fcc56ffd640 1 -- 172.21.15.55:0/979661406 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fcc58004030 con 0x7fcc680cdde0 2023-08-25T05:19:11.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.173+0000 7fcc56ffd640 1 --2- 172.21.15.55:0/979661406 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fcc480657a0 0x7fcc48067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.173+0000 7fcc56ffd640 1 -- 172.21.15.55:0/979661406 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fcc58082dd0 con 0x7fcc680cdde0 2023-08-25T05:19:11.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.173+0000 7fcc65d9b640 1 --2- 172.21.15.55:0/979661406 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fcc480657a0 0x7fcc48067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.173+0000 7fcc65d9b640 1 --2- 172.21.15.55:0/979661406 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fcc480657a0 0x7fcc48067c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0b2000 tx=0x7fcc5c008040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:11.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.177+0000 7fcc56ffd640 1 -- 172.21.15.55:0/979661406 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fcc580540f0 con 0x7fcc680cdde0 2023-08-25T05:19:11.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.333+0000 7fcc6cce5640 1 -- 172.21.15.55:0/979661406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc680d0b80 con 0x7fcc680cdde0 2023-08-25T05:19:11.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.333+0000 7fcc56ffd640 1 -- 172.21.15.55:0/979661406 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+15808 (secure 0 0 0) 0x7fcc58053c80 con 0x7fcc680cdde0 2023-08-25T05:19:11.339 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:11.339 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":162,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:19:07.961569+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6835/3591663387":"2023-08-26T05:19:04.911814+0000","172.21.15.55:6833/3591663387":"2023-08-26T05:19:04.911814+0000","172.21.15.110:0/3737721083":"2023-08-26T05:19:01.703962+0000","172.21.15.110:0/3805989963":"2023-08-26T05:19:01.703962+0000","172.21.15.110:0/702058312":"2023-08-26T05:19:01.703962+0000","172.21.15.110:0/1806042334":"2023-08-26T05:19:01.703962+0000","172.21.15.110:6833/3704357441":"2023-08-26T05:19:01.703962+0000","172.21.15.110:6832/3704357441":"2023-08-26T05:19:01.703962+0000","172.21.15.110:0/3176170740":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/3759935208":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/2816190802":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/978380102":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/1555733326":"2023-08-26T05:19:01.703962+0000","172.21.15.110:0/3822005312":"2023-08-26T05:19:01.703962+0000","172.21.15.110:6833/4256905777":"2023-08-26T05:18:54.845562+0000","172.21.15.110:6832/4256905777":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/1948062482":"2023-08-26T05:18:54.845562+0000","172.21.15.110:0/2661104133":"2023-08-26T05:18:54.845562+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:19:11.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.333+0000 7fcc6cce5640 1 -- 172.21.15.55:0/979661406 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fcc480657a0 msgr2=0x7fcc48067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:11.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.333+0000 7fcc6cce5640 1 --2- 172.21.15.55:0/979661406 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fcc480657a0 0x7fcc48067c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0b2000 tx=0x7fcc5c008040 comp rx=0 tx=0).stop 2023-08-25T05:19:11.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.333+0000 7fcc6cce5640 1 -- 172.21.15.55:0/979661406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc680cdde0 msgr2=0x7fcc68151bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:11.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.333+0000 7fcc6cce5640 1 --2- 172.21.15.55:0/979661406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc680cdde0 0x7fcc68151bb0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fcc5800e7e0 tx=0x7fcc5800eca0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.333+0000 7fcc6cce5640 1 -- 172.21.15.55:0/979661406 shutdown_connections 2023-08-25T05:19:11.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.333+0000 7fcc6cce5640 1 --2- 172.21.15.55:0/979661406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc680d0da0 0x7fcc6815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.333+0000 7fcc6cce5640 1 --2- 172.21.15.55:0/979661406 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fcc480657a0 0x7fcc48067c60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.333+0000 7fcc6cce5640 1 --2- 172.21.15.55:0/979661406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc680cee60 0x7fcc680b6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.333+0000 7fcc6cce5640 1 --2- 172.21.15.55:0/979661406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc680cdde0 0x7fcc68151bb0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.333+0000 7fcc6cce5640 1 -- 172.21.15.55:0/979661406 >> 172.21.15.55:0/979661406 conn(0x7fcc6809bae0 msgr2=0x7fcc6806c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:11.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.333+0000 7fcc6cce5640 1 -- 172.21.15.55:0/979661406 shutdown_connections 2023-08-25T05:19:11.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.333+0000 7fcc6cce5640 1 -- 172.21.15.55:0/979661406 wait complete. 2023-08-25T05:19:11.358 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T05:19:11.359 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T05:19:11.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.501+0000 7f2123be1640 1 Processor -- start 2023-08-25T05:19:11.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.501+0000 7f2123be1640 1 -- start start 2023-08-25T05:19:11.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.501+0000 7f2123be1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f211c15aa10 0x7f211c0cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.501+0000 7f2123be1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f211c06a010 0x7f211c0cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.501+0000 7f2123be1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c0cb720 con 0x7f211c0cfff0 2023-08-25T05:19:11.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.501+0000 7f2123be1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211c15b150 con 0x7f211c15aa10 2023-08-25T05:19:11.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.501+0000 7f2123be1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c15b430 con 0x7f211c06a010 2023-08-25T05:19:11.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.501+0000 7f212117c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f211c0cfff0 0x7f211c069900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58504/0 (socket says 172.21.15.55:58504) 2023-08-25T05:19:11.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.501+0000 7f212117c640 1 -- 172.21.15.55:0/1813040698 learned_addr learned my addr 172.21.15.55:0/1813040698 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:11.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.501+0000 7f212197d640 1 --2- 172.21.15.55:0/1813040698 >> v2:172.21.15.110:3300/0 conn(0x7f211c15aa10 0x7f211c0cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.501+0000 7f212217e640 1 --2- 172.21.15.55:0/1813040698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f211c06a010 0x7f211c0cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.501+0000 7f212097b640 1 -- 172.21.15.55:0/1813040698 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510388095 0 0) 0x7f211c0cb720 con 0x7f211c0cfff0 2023-08-25T05:19:11.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.501+0000 7f212097b640 1 -- 172.21.15.55:0/1813040698 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2108003530 con 0x7f211c0cfff0 2023-08-25T05:19:11.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.501+0000 7f212197d640 1 -- 172.21.15.55:0/1813040698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f211c06a010 msgr2=0x7f211c0cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:11.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.501+0000 7f212197d640 1 --2- 172.21.15.55:0/1813040698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f211c06a010 0x7f211c0cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.501+0000 7f212197d640 1 -- 172.21.15.55:0/1813040698 >> v1:172.21.15.55:6789/0 conn(0x7f211c0cfff0 legacy=0x7f211c069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:11.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.501+0000 7f212197d640 1 -- 172.21.15.55:0/1813040698 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c15b710 con 0x7f211c15aa10 2023-08-25T05:19:11.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.505+0000 7f212197d640 1 --2- 172.21.15.55:0/1813040698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f211c15aa10 0x7f211c0cee60 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f21180097c0 tx=0x7f211801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41cd4f8115094862 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:11.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.505+0000 7f212097b640 1 -- 172.21.15.55:0/1813040698 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21180ab600 con 0x7f211c15aa10 2023-08-25T05:19:11.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.505+0000 7f212097b640 1 -- 172.21.15.55:0/1813040698 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21180a7050 con 0x7f211c15aa10 2023-08-25T05:19:11.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.505+0000 7f212097b640 1 -- 172.21.15.55:0/1813040698 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21180ab960 con 0x7f211c15aa10 2023-08-25T05:19:11.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.505+0000 7f2123be1640 1 -- 172.21.15.55:0/1813040698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f211c15aa10 msgr2=0x7f211c0cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:11.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.505+0000 7f2123be1640 1 --2- 172.21.15.55:0/1813040698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f211c15aa10 0x7f211c0cee60 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f21180097c0 tx=0x7f211801c3f0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.505+0000 7f2123be1640 1 -- 172.21.15.55:0/1813040698 shutdown_connections 2023-08-25T05:19:11.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.505+0000 7f2123be1640 1 --2- 172.21.15.55:0/1813040698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f211c06a010 0x7f211c0cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.505+0000 7f2123be1640 1 --2- 172.21.15.55:0/1813040698 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f211c15aa10 0x7f211c0cee60 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.505+0000 7f2123be1640 1 -- 172.21.15.55:0/1813040698 >> 172.21.15.55:0/1813040698 conn(0x7f211c0cf4d0 msgr2=0x7f211c0cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:11.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.505+0000 7f2123be1640 1 -- 172.21.15.55:0/1813040698 shutdown_connections 2023-08-25T05:19:11.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.505+0000 7f2123be1640 1 -- 172.21.15.55:0/1813040698 wait complete. 2023-08-25T05:19:11.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f2123be1640 1 Processor -- start 2023-08-25T05:19:11.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f2123be1640 1 -- start start 2023-08-25T05:19:11.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f2123be1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f211c06a010 0x7f211c147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f2123be1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f211c0cfff0 0x7f211c0b2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f2123be1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f211c0c2be0 0x7f211c0ad090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f2123be1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0c3130 con 0x7f211c06a010 2023-08-25T05:19:11.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f2123be1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0c3410 con 0x7f211c0cfff0 2023-08-25T05:19:11.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f2123be1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0c36f0 con 0x7f211c0c2be0 2023-08-25T05:19:11.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f212197d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f211c06a010 0x7f211c147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f212197d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f211c06a010 0x7f211c147720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53636/0 (socket says 172.21.15.55:53636) 2023-08-25T05:19:11.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f212197d640 1 -- 172.21.15.55:0/448705362 learned_addr learned my addr 172.21.15.55:0/448705362 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:11.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f212217e640 1 --2- 172.21.15.55:0/448705362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f211c0c2be0 0x7f211c0ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f212117c640 1 --2- 172.21.15.55:0/448705362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f211c0cfff0 0x7f211c0b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f212197d640 1 -- 172.21.15.55:0/448705362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f211c0c2be0 msgr2=0x7f211c0ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f212197d640 1 --2- 172.21.15.55:0/448705362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f211c0c2be0 0x7f211c0ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f212197d640 1 -- 172.21.15.55:0/448705362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f211c0cfff0 msgr2=0x7f211c0b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f212197d640 1 --2- 172.21.15.55:0/448705362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f211c0cfff0 0x7f211c0b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f212197d640 1 -- 172.21.15.55:0/448705362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2118009420 con 0x7f211c06a010 2023-08-25T05:19:11.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f212117c640 1 --2- 172.21.15.55:0/448705362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f211c0cfff0 0x7f211c0b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:11.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f212197d640 1 --2- 172.21.15.55:0/448705362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f211c06a010 0x7f211c147720 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f211801aaa0 tx=0x7f2118019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:11.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f21127fc640 1 -- 172.21.15.55:0/448705362 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21180bb070 con 0x7f211c06a010 2023-08-25T05:19:11.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f21127fc640 1 -- 172.21.15.55:0/448705362 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21180abd10 con 0x7f211c06a010 2023-08-25T05:19:11.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f2123be1640 1 -- 172.21.15.55:0/448705362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211c0c7860 con 0x7f211c06a010 2023-08-25T05:19:11.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f21127fc640 1 -- 172.21.15.55:0/448705362 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21180b4600 con 0x7f211c06a010 2023-08-25T05:19:11.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.509+0000 7f2123be1640 1 -- 172.21.15.55:0/448705362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211c153ed0 con 0x7f211c06a010 2023-08-25T05:19:11.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.513+0000 7f2123be1640 1 -- 172.21.15.55:0/448705362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211c0c7a70 con 0x7f211c06a010 2023-08-25T05:19:11.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.513+0000 7f21127fc640 1 -- 172.21.15.55:0/448705362 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f21180b2040 con 0x7f211c06a010 2023-08-25T05:19:11.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.513+0000 7f21127fc640 1 --2- 172.21.15.55:0/448705362 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f21000657a0 0x7f2100067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.513+0000 7f21127fc640 1 -- 172.21.15.55:0/448705362 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f211811c870 con 0x7f211c06a010 2023-08-25T05:19:11.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.513+0000 7f212117c640 1 --2- 172.21.15.55:0/448705362 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f21000657a0 0x7f2100067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.513+0000 7f212117c640 1 --2- 172.21.15.55:0/448705362 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f21000657a0 0x7f2100067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f211c0b5420 tx=0x7f210c009040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:11.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.517+0000 7f21127fc640 1 -- 172.21.15.55:0/448705362 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f21180ea3a0 con 0x7f211c06a010 2023-08-25T05:19:11.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.677+0000 7f2123be1640 1 -- 172.21.15.55:0/448705362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f211c073ec0 con 0x7f211c06a010 2023-08-25T05:19:11.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.677+0000 7f21127fc640 1 -- 172.21.15.55:0/448705362 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v162) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21180b00a0 con 0x7f211c06a010 2023-08-25T05:19:11.680 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T05:19:11.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.677+0000 7f2123be1640 1 -- 172.21.15.55:0/448705362 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f21000657a0 msgr2=0x7f2100067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:11.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.677+0000 7f2123be1640 1 --2- 172.21.15.55:0/448705362 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f21000657a0 0x7f2100067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f211c0b5420 tx=0x7f210c009040 comp rx=0 tx=0).stop 2023-08-25T05:19:11.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.677+0000 7f2123be1640 1 -- 172.21.15.55:0/448705362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f211c06a010 msgr2=0x7f211c147720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:11.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.677+0000 7f2123be1640 1 --2- 172.21.15.55:0/448705362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f211c06a010 0x7f211c147720 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f211801aaa0 tx=0x7f2118019190 comp rx=0 tx=0).stop 2023-08-25T05:19:11.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.677+0000 7f2123be1640 1 -- 172.21.15.55:0/448705362 shutdown_connections 2023-08-25T05:19:11.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.677+0000 7f2123be1640 1 --2- 172.21.15.55:0/448705362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f211c0c2be0 0x7f211c0ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.677+0000 7f2123be1640 1 --2- 172.21.15.55:0/448705362 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f21000657a0 0x7f2100067c60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.677+0000 7f2123be1640 1 --2- 172.21.15.55:0/448705362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f211c0cfff0 0x7f211c0b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.677+0000 7f2123be1640 1 --2- 172.21.15.55:0/448705362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f211c06a010 0x7f211c147720 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.677+0000 7f2123be1640 1 -- 172.21.15.55:0/448705362 >> 172.21.15.55:0/448705362 conn(0x7f211c0cf4d0 msgr2=0x7f211c0cf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:11.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.677+0000 7f2123be1640 1 -- 172.21.15.55:0/448705362 shutdown_connections 2023-08-25T05:19:11.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.677+0000 7f2123be1640 1 -- 172.21.15.55:0/448705362 wait complete. 2023-08-25T05:19:11.701 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T05:19:11.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.845+0000 7fbf09ad5640 1 Processor -- start 2023-08-25T05:19:11.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.845+0000 7fbf09ad5640 1 -- start start 2023-08-25T05:19:11.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.845+0000 7fbf09ad5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbf0415fca0 0x7fbf040cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.845+0000 7fbf09ad5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf040b8330 0x7fbf040cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.845+0000 7fbf09ad5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf040b70c0 con 0x7fbf040d0bd0 2023-08-25T05:19:11.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.845+0000 7fbf09ad5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf04160080 con 0x7fbf0415fca0 2023-08-25T05:19:11.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.845+0000 7fbf09ad5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf040b73a0 con 0x7fbf040b8330 2023-08-25T05:19:11.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.845+0000 7fbf092d4640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbf040d0bd0 0x7fbf040d1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58510/0 (socket says 172.21.15.55:58510) 2023-08-25T05:19:11.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.845+0000 7fbf092d4640 1 -- 172.21.15.55:0/813055478 learned_addr learned my addr 172.21.15.55:0/813055478 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:11.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.845+0000 7fbefbfff640 1 --2- 172.21.15.55:0/813055478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf040b8330 0x7fbf040cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.845+0000 7fbf08ad3640 1 --2- 172.21.15.55:0/813055478 >> v2:172.21.15.110:3300/0 conn(0x7fbf0415fca0 0x7fbf040cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.845+0000 7fbefb7fe640 1 -- 172.21.15.55:0/813055478 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370417865 0 0) 0x7fbf040b70c0 con 0x7fbf040d0bd0 2023-08-25T05:19:11.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.845+0000 7fbefb7fe640 1 -- 172.21.15.55:0/813055478 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeec003530 con 0x7fbf040d0bd0 2023-08-25T05:19:11.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefb7fe640 1 -- 172.21.15.55:0/813055478 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 811708315 0 0) 0x7fbeec003530 con 0x7fbf040d0bd0 2023-08-25T05:19:11.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefb7fe640 1 -- 172.21.15.55:0/813055478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf040b8330 msgr2=0x7fbf040cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:11.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefb7fe640 1 --2- 172.21.15.55:0/813055478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf040b8330 0x7fbf040cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefb7fe640 1 -- 172.21.15.55:0/813055478 >> v2:172.21.15.110:3300/0 conn(0x7fbf0415fca0 msgr2=0x7fbf040cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:11.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefb7fe640 1 --2- 172.21.15.55:0/813055478 >> v2:172.21.15.110:3300/0 conn(0x7fbf0415fca0 0x7fbf040cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefb7fe640 1 -- 172.21.15.55:0/813055478 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf040b7680 con 0x7fbf040d0bd0 2023-08-25T05:19:11.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefb7fe640 1 -- 172.21.15.55:0/813055478 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fbefc001a00 con 0x7fbf040d0bd0 2023-08-25T05:19:11.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefb7fe640 1 -- 172.21.15.55:0/813055478 >> v1:172.21.15.55:6789/0 conn(0x7fbf040d0bd0 legacy=0x7fbf040d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:11.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefb7fe640 1 --2- 172.21.15.55:0/813055478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeec003980 0x7fbeec003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefb7fe640 1 --2- 172.21.15.55:0/813055478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbeec0047d0 0x7fbeec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefb7fe640 1 --2- 172.21.15.55:0/813055478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf040b8330 0x7fbeec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefb7fe640 1 -- 172.21.15.55:0/813055478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf04160080 con 0x7fbeec003980 2023-08-25T05:19:11.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefb7fe640 1 -- 172.21.15.55:0/813055478 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf040b73a0 con 0x7fbeec0047d0 2023-08-25T05:19:11.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefb7fe640 1 -- 172.21.15.55:0/813055478 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec00b9c0 con 0x7fbf040b8330 2023-08-25T05:19:11.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbf08ad3640 1 --2- 172.21.15.55:0/813055478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeec003980 0x7fbeec003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefbfff640 1 --2- 172.21.15.55:0/813055478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbeec0047d0 0x7fbeec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbf092d4640 1 --2- 172.21.15.55:0/813055478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf040b8330 0x7fbeec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbf08ad3640 1 -- 172.21.15.55:0/813055478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf040b8330 msgr2=0x7fbeec005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:11.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbf08ad3640 1 --2- 172.21.15.55:0/813055478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf040b8330 0x7fbeec005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbf08ad3640 1 -- 172.21.15.55:0/813055478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbeec0047d0 msgr2=0x7fbeec004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:11.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbf08ad3640 1 --2- 172.21.15.55:0/813055478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbeec0047d0 0x7fbeec004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbf08ad3640 1 -- 172.21.15.55:0/813055478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec003530 con 0x7fbeec003980 2023-08-25T05:19:11.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefbfff640 1 --2- 172.21.15.55:0/813055478 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbeec0047d0 0x7fbeec004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:11.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbf08ad3640 1 --2- 172.21.15.55:0/813055478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeec003980 0x7fbeec003da0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009ae0 tx=0x7fbf0001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d877f6fdf628ce9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:11.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefb7fe640 1 -- 172.21.15.55:0/813055478 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf000a64a0 con 0x7fbeec003980 2023-08-25T05:19:11.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefb7fe640 1 -- 172.21.15.55:0/813055478 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf000a6600 con 0x7fbeec003980 2023-08-25T05:19:11.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.849+0000 7fbefb7fe640 1 -- 172.21.15.55:0/813055478 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf000a69b0 con 0x7fbeec003980 2023-08-25T05:19:11.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf09ad5640 1 -- 172.21.15.55:0/813055478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeec003980 msgr2=0x7fbeec003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:11.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf09ad5640 1 --2- 172.21.15.55:0/813055478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbeec003980 0x7fbeec003da0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009ae0 tx=0x7fbf0001ca90 comp rx=0 tx=0).stop 2023-08-25T05:19:11.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf092d4640 1 -- 172.21.15.55:0/813055478 reap_dead start 2023-08-25T05:19:11.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf09ad5640 1 -- 172.21.15.55:0/813055478 shutdown_connections 2023-08-25T05:19:11.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf09ad5640 1 -- 172.21.15.55:0/813055478 >> 172.21.15.55:0/813055478 conn(0x7fbf040658c0 msgr2=0x7fbf04065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:11.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf09ad5640 1 -- 172.21.15.55:0/813055478 shutdown_connections 2023-08-25T05:19:11.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf09ad5640 1 -- 172.21.15.55:0/813055478 wait complete. 2023-08-25T05:19:11.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf09ad5640 1 Processor -- start 2023-08-25T05:19:11.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf09ad5640 1 -- start start 2023-08-25T05:19:11.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf09ad5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbeec003980 0x7fbf04148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf09ad5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf04148b00 0x7fbf041f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf09ad5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf04159550 0x7fbf040c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf09ad5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf041f21a0 con 0x7fbf04159550 2023-08-25T05:19:11.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf09ad5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf04154b60 con 0x7fbeec003980 2023-08-25T05:19:11.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf09ad5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf04154e40 con 0x7fbf04148b00 2023-08-25T05:19:11.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf092d4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf04159550 0x7fbf040c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf092d4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf04159550 0x7fbf040c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53654/0 (socket says 172.21.15.55:53654) 2023-08-25T05:19:11.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf092d4640 1 -- 172.21.15.55:0/1799918233 learned_addr learned my addr 172.21.15.55:0/1799918233 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:11.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbf08ad3640 1 --2- 172.21.15.55:0/1799918233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbeec003980 0x7fbf04148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.853+0000 7fbefbfff640 1 --2- 172.21.15.55:0/1799918233 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf04148b00 0x7fbf041f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.857+0000 7fbf092d4640 1 -- 172.21.15.55:0/1799918233 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf04148b00 msgr2=0x7fbf041f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:11.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.857+0000 7fbf092d4640 1 --2- 172.21.15.55:0/1799918233 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf04148b00 0x7fbf041f25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.857+0000 7fbf092d4640 1 -- 172.21.15.55:0/1799918233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbeec003980 msgr2=0x7fbf04148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:11.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.857+0000 7fbf092d4640 1 --2- 172.21.15.55:0/1799918233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbeec003980 0x7fbf04148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:11.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.857+0000 7fbf092d4640 1 -- 172.21.15.55:0/1799918233 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf041f1dc0 con 0x7fbf04159550 2023-08-25T05:19:11.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.857+0000 7fbf092d4640 1 --2- 172.21.15.55:0/1799918233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf04159550 0x7fbf040c8120 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fbefc002240 tx=0x7fbefc011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:11.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.857+0000 7fbef97fa640 1 -- 172.21.15.55:0/1799918233 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc00f8a0 con 0x7fbf04159550 2023-08-25T05:19:11.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.857+0000 7fbef97fa640 1 -- 172.21.15.55:0/1799918233 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc00fa20 con 0x7fbf04159550 2023-08-25T05:19:11.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.857+0000 7fbf09ad5640 1 -- 172.21.15.55:0/1799918233 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf041488a0 con 0x7fbf04159550 2023-08-25T05:19:11.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.857+0000 7fbef97fa640 1 -- 172.21.15.55:0/1799918233 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc00fdd0 con 0x7fbf04159550 2023-08-25T05:19:11.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.857+0000 7fbf09ad5640 1 -- 172.21.15.55:0/1799918233 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf041f2b00 con 0x7fbf04159550 2023-08-25T05:19:11.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.857+0000 7fbf09ad5640 1 -- 172.21.15.55:0/1799918233 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf041f22e0 con 0x7fbf04159550 2023-08-25T05:19:11.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.857+0000 7fbef97fa640 1 -- 172.21.15.55:0/1799918233 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fbefc01f460 con 0x7fbf04159550 2023-08-25T05:19:11.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.857+0000 7fbef97fa640 1 --2- 172.21.15.55:0/1799918233 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fbef00657a0 0x7fbef0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:11.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.861+0000 7fbf08ad3640 1 --2- 172.21.15.55:0/1799918233 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fbef00657a0 0x7fbef0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:11.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.861+0000 7fbf08ad3640 1 --2- 172.21.15.55:0/1799918233 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fbef00657a0 0x7fbef0067c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbf000ad000 tx=0x7fbf000b3040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:11.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.861+0000 7fbef97fa640 1 -- 172.21.15.55:0/1799918233 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fbefc05b210 con 0x7fbf04159550 2023-08-25T05:19:11.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:11.869+0000 7fbef97fa640 1 -- 172.21.15.55:0/1799918233 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbf041f22e0 con 0x7fbf04159550 2023-08-25T05:19:12.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.025+0000 7fbf09ad5640 1 -- 172.21.15.55:0/1799918233 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbf041f22e0 con 0x7fbf04159550 2023-08-25T05:19:12.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.025+0000 7fbef97fa640 1 -- 172.21.15.55:0/1799918233 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v162) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbf041f22e0 con 0x7fbf04159550 2023-08-25T05:19:12.030 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T05:19:12.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.029+0000 7fbf09ad5640 1 -- 172.21.15.55:0/1799918233 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fbef00657a0 msgr2=0x7fbef0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:12.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.029+0000 7fbf09ad5640 1 --2- 172.21.15.55:0/1799918233 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fbef00657a0 0x7fbef0067c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbf000ad000 tx=0x7fbf000b3040 comp rx=0 tx=0).stop 2023-08-25T05:19:12.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.029+0000 7fbf09ad5640 1 -- 172.21.15.55:0/1799918233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf04159550 msgr2=0x7fbf040c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:12.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.029+0000 7fbf09ad5640 1 --2- 172.21.15.55:0/1799918233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf04159550 0x7fbf040c8120 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fbefc002240 tx=0x7fbefc011c20 comp rx=0 tx=0).stop 2023-08-25T05:19:12.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.029+0000 7fbf09ad5640 1 -- 172.21.15.55:0/1799918233 shutdown_connections 2023-08-25T05:19:12.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.029+0000 7fbf09ad5640 1 --2- 172.21.15.55:0/1799918233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf04159550 0x7fbf040c8120 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.029+0000 7fbf09ad5640 1 --2- 172.21.15.55:0/1799918233 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf04148b00 0x7fbf041f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.029+0000 7fbf09ad5640 1 --2- 172.21.15.55:0/1799918233 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fbef00657a0 0x7fbef0067c60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.029+0000 7fbf09ad5640 1 --2- 172.21.15.55:0/1799918233 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbeec003980 0x7fbf04148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.029+0000 7fbf09ad5640 1 -- 172.21.15.55:0/1799918233 >> 172.21.15.55:0/1799918233 conn(0x7fbf040658c0 msgr2=0x7fbf040d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:12.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.029+0000 7fbf09ad5640 1 -- 172.21.15.55:0/1799918233 shutdown_connections 2023-08-25T05:19:12.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.029+0000 7fbf09ad5640 1 -- 172.21.15.55:0/1799918233 wait complete. 2023-08-25T05:19:12.051 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-25T05:19:12.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f37a1834640 1 Processor -- start 2023-08-25T05:19:12.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f37a1834640 1 -- start start 2023-08-25T05:19:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f37a1834640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f379c0cb020 0x7f379c0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:12.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f37a1834640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f379c06c720 0x7f379c06cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:12.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f37a1834640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379c0cbca0 con 0x7f379c0cdd50 2023-08-25T05:19:12.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f37a1834640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379c0c9470 con 0x7f379c0cb020 2023-08-25T05:19:12.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f37a1834640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379c0ce1e0 con 0x7f379c06c720 2023-08-25T05:19:12.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f379a7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f379c0cdd50 0x7f379c0cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58516/0 (socket says 172.21.15.55:58516) 2023-08-25T05:19:12.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f379a7fc640 1 -- 172.21.15.55:0/4222762075 learned_addr learned my addr 172.21.15.55:0/4222762075 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:12.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f379b7fe640 1 --2- 172.21.15.55:0/4222762075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f379c06c720 0x7f379c06cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:12.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f379affd640 1 --2- 172.21.15.55:0/4222762075 >> v2:172.21.15.110:3300/0 conn(0x7f379c0cb020 0x7f379c0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:12.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f3799ffb640 1 -- 172.21.15.55:0/4222762075 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831454592 0 0) 0x7f379c0cbca0 con 0x7f379c0cdd50 2023-08-25T05:19:12.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f3799ffb640 1 -- 172.21.15.55:0/4222762075 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3784003530 con 0x7f379c0cdd50 2023-08-25T05:19:12.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f3799ffb640 1 -- 172.21.15.55:0/4222762075 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1721841880 0 0) 0x7f3784003530 con 0x7f379c0cdd50 2023-08-25T05:19:12.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f3799ffb640 1 -- 172.21.15.55:0/4222762075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f379c06c720 msgr2=0x7f379c06cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f3799ffb640 1 --2- 172.21.15.55:0/4222762075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f379c06c720 0x7f379c06cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f3799ffb640 1 -- 172.21.15.55:0/4222762075 >> v2:172.21.15.110:3300/0 conn(0x7f379c0cb020 msgr2=0x7f379c0c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f3799ffb640 1 --2- 172.21.15.55:0/4222762075 >> v2:172.21.15.110:3300/0 conn(0x7f379c0cb020 0x7f379c0c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f3799ffb640 1 -- 172.21.15.55:0/4222762075 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379c06d070 con 0x7f379c0cdd50 2023-08-25T05:19:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f3799ffb640 1 -- 172.21.15.55:0/4222762075 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f3790001680 con 0x7f379c0cdd50 2023-08-25T05:19:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f379b7fe640 1 --2- 172.21.15.55:0/4222762075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f379c06c720 0x7f379c06cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:19:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f3799ffb640 1 -- 172.21.15.55:0/4222762075 >> v1:172.21.15.55:6789/0 conn(0x7f379c0cdd50 legacy=0x7f379c0cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:12.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f3799ffb640 1 --2- 172.21.15.55:0/4222762075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f379c06c720 0x7f3784003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:12.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f3799ffb640 1 --2- 172.21.15.55:0/4222762075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3784003ec0 0x7f37840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:12.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f3799ffb640 1 --2- 172.21.15.55:0/4222762075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3784004d10 0x7f3784005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:12.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f3799ffb640 1 -- 172.21.15.55:0/4222762075 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c0c9470 con 0x7f3784004d10 2023-08-25T05:19:12.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f3799ffb640 1 -- 172.21.15.55:0/4222762075 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c0ce1e0 con 0x7f3784003ec0 2023-08-25T05:19:12.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f3799ffb640 1 -- 172.21.15.55:0/4222762075 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378400b990 con 0x7f379c06c720 2023-08-25T05:19:12.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f379affd640 1 --2- 172.21.15.55:0/4222762075 >> v2:172.21.15.110:3300/0 conn(0x7f379c0cb020 0x7f379c0c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:19:12.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f379a7fc640 1 --2- 172.21.15.55:0/4222762075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3784003ec0 0x7f37840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:12.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f379b7fe640 1 --2- 172.21.15.55:0/4222762075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3784004d10 0x7f3784005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:12.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f379affd640 1 --2- 172.21.15.55:0/4222762075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f379c06c720 0x7f3784003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:12.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f379b7fe640 1 -- 172.21.15.55:0/4222762075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f379c06c720 msgr2=0x7f3784003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f379b7fe640 1 --2- 172.21.15.55:0/4222762075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f379c06c720 0x7f3784003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f379b7fe640 1 -- 172.21.15.55:0/4222762075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3784003ec0 msgr2=0x7f37840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f379b7fe640 1 --2- 172.21.15.55:0/4222762075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3784003ec0 0x7f37840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f379b7fe640 1 -- 172.21.15.55:0/4222762075 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3794009a70 con 0x7f3784004d10 2023-08-25T05:19:12.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f379affd640 1 --2- 172.21.15.55:0/4222762075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f379c06c720 0x7f3784003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:12.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.197+0000 7f379a7fc640 1 --2- 172.21.15.55:0/4222762075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3784003ec0 0x7f37840047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:19:12.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.201+0000 7f379b7fe640 1 --2- 172.21.15.55:0/4222762075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3784004d10 0x7f3784005190 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f3794009fb0 tx=0x7f37940211f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c11112c38c0bbe server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:12.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.201+0000 7f3799ffb640 1 -- 172.21.15.55:0/4222762075 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37940b0600 con 0x7f3784004d10 2023-08-25T05:19:12.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.201+0000 7f3799ffb640 1 -- 172.21.15.55:0/4222762075 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37940ac050 con 0x7f3784004d10 2023-08-25T05:19:12.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.201+0000 7f3799ffb640 1 -- 172.21.15.55:0/4222762075 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37940b09a0 con 0x7f3784004d10 2023-08-25T05:19:12.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.201+0000 7f37a1834640 1 -- 172.21.15.55:0/4222762075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3784004d10 msgr2=0x7f3784005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:12.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.201+0000 7f37a1834640 1 --2- 172.21.15.55:0/4222762075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3784004d10 0x7f3784005190 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f3794009fb0 tx=0x7f37940211f0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.201+0000 7f379b7fe640 1 -- 172.21.15.55:0/4222762075 reap_dead start 2023-08-25T05:19:12.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.201+0000 7f37a1834640 1 -- 172.21.15.55:0/4222762075 shutdown_connections 2023-08-25T05:19:12.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.201+0000 7f37a1834640 1 -- 172.21.15.55:0/4222762075 >> 172.21.15.55:0/4222762075 conn(0x7f379c069900 msgr2=0x7f379c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:12.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.201+0000 7f37a1834640 1 -- 172.21.15.55:0/4222762075 shutdown_connections 2023-08-25T05:19:12.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.201+0000 7f37a1834640 1 -- 172.21.15.55:0/4222762075 wait complete. 2023-08-25T05:19:12.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f37a1834640 1 Processor -- start 2023-08-25T05:19:12.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f37a1834640 1 -- start start 2023-08-25T05:19:12.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f37a1834640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3784004d10 0x7f379c09b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:12.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f37a1834640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f379c0c3f70 0x7f379c0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:12.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f37a1834640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f379c159ad0 0x7f379c159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:12.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f37a1834640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c1edb30 con 0x7f379c159ad0 2023-08-25T05:19:12.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f37a1834640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c09ba90 con 0x7f379c0c3f70 2023-08-25T05:19:12.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f37a1834640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379c0c6470 con 0x7f3784004d10 2023-08-25T05:19:12.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f379b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f379c159ad0 0x7f379c159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:12.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f379b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f379c159ad0 0x7f379c159f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53668/0 (socket says 172.21.15.55:53668) 2023-08-25T05:19:12.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f379b7fe640 1 -- 172.21.15.55:0/4126783952 learned_addr learned my addr 172.21.15.55:0/4126783952 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:12.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f379a7fc640 1 --2- 172.21.15.55:0/4126783952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f379c0c3f70 0x7f379c0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:12.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f379affd640 1 --2- 172.21.15.55:0/4126783952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3784004d10 0x7f379c09b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:12.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f379b7fe640 1 -- 172.21.15.55:0/4126783952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3784004d10 msgr2=0x7f379c09b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:12.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f379b7fe640 1 --2- 172.21.15.55:0/4126783952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3784004d10 0x7f379c09b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f379b7fe640 1 -- 172.21.15.55:0/4126783952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f379c0c3f70 msgr2=0x7f379c0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:12.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f379b7fe640 1 --2- 172.21.15.55:0/4126783952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f379c0c3f70 0x7f379c0c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f379b7fe640 1 -- 172.21.15.55:0/4126783952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379c15a490 con 0x7f379c159ad0 2023-08-25T05:19:12.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f379b7fe640 1 --2- 172.21.15.55:0/4126783952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f379c159ad0 0x7f379c159f50 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f37940b3040 tx=0x7f3794009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f3783fff640 1 -- 172.21.15.55:0/4126783952 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37940b1d10 con 0x7f379c159ad0 2023-08-25T05:19:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f3783fff640 1 -- 172.21.15.55:0/4126783952 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379400f040 con 0x7f379c159ad0 2023-08-25T05:19:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f37a1834640 1 -- 172.21.15.55:0/4126783952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379c0ac7a0 con 0x7f379c159ad0 2023-08-25T05:19:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f3783fff640 1 -- 172.21.15.55:0/4126783952 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3794003be0 con 0x7f379c159ad0 2023-08-25T05:19:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.205+0000 7f37a1834640 1 -- 172.21.15.55:0/4126783952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379c0aca40 con 0x7f379c159ad0 2023-08-25T05:19:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.209+0000 7f37a1834640 1 -- 172.21.15.55:0/4126783952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379c0661b0 con 0x7f379c159ad0 2023-08-25T05:19:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.209+0000 7f3783fff640 1 -- 172.21.15.55:0/4126783952 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f37940b7050 con 0x7f379c159ad0 2023-08-25T05:19:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.209+0000 7f3783fff640 1 --2- 172.21.15.55:0/4126783952 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f37880657a0 0x7f3788067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:12.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.209+0000 7f3783fff640 1 -- 172.21.15.55:0/4126783952 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f3794121460 con 0x7f379c159ad0 2023-08-25T05:19:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.209+0000 7f379affd640 1 --2- 172.21.15.55:0/4126783952 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f37880657a0 0x7f3788067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.209+0000 7f379affd640 1 --2- 172.21.15.55:0/4126783952 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f37880657a0 0x7f3788067c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f378c009380 tx=0x7f378c008040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.213+0000 7f3783fff640 1 -- 172.21.15.55:0/4126783952 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f37940eecf0 con 0x7f379c159ad0 2023-08-25T05:19:12.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.369+0000 7f37a1834640 1 -- 172.21.15.55:0/4126783952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f379c071670 con 0x7f379c159ad0 2023-08-25T05:19:12.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.373+0000 7f3783fff640 1 -- 172.21.15.55:0/4126783952 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v58)=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7f379c071670 con 0x7f379c159ad0 2023-08-25T05:19:12.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.377+0000 7f37a1834640 1 -- 172.21.15.55:0/4126783952 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f37880657a0 msgr2=0x7f3788067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:12.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.377+0000 7f37a1834640 1 --2- 172.21.15.55:0/4126783952 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f37880657a0 0x7f3788067c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f378c009380 tx=0x7f378c008040 comp rx=0 tx=0).stop 2023-08-25T05:19:12.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.377+0000 7f37a1834640 1 -- 172.21.15.55:0/4126783952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f379c159ad0 msgr2=0x7f379c159f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:12.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.377+0000 7f37a1834640 1 --2- 172.21.15.55:0/4126783952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f379c159ad0 0x7f379c159f50 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f37940b3040 tx=0x7f3794009750 comp rx=0 tx=0).stop 2023-08-25T05:19:12.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.377+0000 7f37a1834640 1 -- 172.21.15.55:0/4126783952 shutdown_connections 2023-08-25T05:19:12.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.377+0000 7f37a1834640 1 --2- 172.21.15.55:0/4126783952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f379c159ad0 0x7f379c159f50 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.377+0000 7f37a1834640 1 --2- 172.21.15.55:0/4126783952 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f37880657a0 0x7f3788067c60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.377+0000 7f37a1834640 1 --2- 172.21.15.55:0/4126783952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f379c0c3f70 0x7f379c0c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.377+0000 7f37a1834640 1 --2- 172.21.15.55:0/4126783952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3784004d10 0x7f379c09b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.377+0000 7f37a1834640 1 -- 172.21.15.55:0/4126783952 >> 172.21.15.55:0/4126783952 conn(0x7f379c069900 msgr2=0x7f379c06b610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:12.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.377+0000 7f37a1834640 1 -- 172.21.15.55:0/4126783952 shutdown_connections 2023-08-25T05:19:12.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.377+0000 7f37a1834640 1 -- 172.21.15.55:0/4126783952 wait complete. 2023-08-25T05:19:12.400 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T05:19:12.400 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T05:19:12.481 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T05:19:12.528 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T05:19:12.528 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:19:12.529 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:19:12.538 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T05:19:12.538 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:19:12.539 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:19:12.586 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:19:12.587 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:19:12.587 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:19:12.596 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T05:19:12.597 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:19:12.597 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:19:12.641 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:19:12.641 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-25T05:19:12.641 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:19:12.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.781+0000 7f486f09c640 1 Processor -- start 2023-08-25T05:19:12.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.781+0000 7f486f09c640 1 -- start start 2023-08-25T05:19:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.785+0000 7f486f09c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48680d0da0 0x7f48680d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.785+0000 7f486f09c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48680b29b0 con 0x7f48680b3e50 2023-08-25T05:19:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.785+0000 7f486f09c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48680cfc80 con 0x7f48680cdde0 2023-08-25T05:19:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.785+0000 7f486f09c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48680d16c0 con 0x7f48680d0da0 2023-08-25T05:19:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.785+0000 7f486d639640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f48680b3e50 0x7f48680cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58518/0 (socket says 172.21.15.55:58518) 2023-08-25T05:19:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.785+0000 7f486d639640 1 -- 172.21.15.55:0/2215574865 learned_addr learned my addr 172.21.15.55:0/2215574865 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.785+0000 7f486ce38640 1 --2- 172.21.15.55:0/2215574865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48680d0da0 0x7f48680d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:12.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.785+0000 7f48677fe640 1 -- 172.21.15.55:0/2215574865 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091527636 0 0) 0x7f48680b29b0 con 0x7f48680b3e50 2023-08-25T05:19:12.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.785+0000 7f48677fe640 1 -- 172.21.15.55:0/2215574865 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4858003530 con 0x7f48680b3e50 2023-08-25T05:19:12.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.785+0000 7f48677fe640 1 -- 172.21.15.55:0/2215574865 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045982991 0 0) 0x7f48680cfc80 con 0x7f48680cdde0 2023-08-25T05:19:12.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.785+0000 7f48677fe640 1 -- 172.21.15.55:0/2215574865 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48680b29b0 con 0x7f48680cdde0 2023-08-25T05:19:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.785+0000 7f486ce38640 1 -- 172.21.15.55:0/2215574865 >> v1:172.21.15.110:6789/0 conn(0x7f48680cdde0 legacy=0x7f48680cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.785+0000 7f486ce38640 1 -- 172.21.15.55:0/2215574865 >> v1:172.21.15.55:6789/0 conn(0x7f48680b3e50 legacy=0x7f48680cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.785+0000 7f486ce38640 1 -- 172.21.15.55:0/2215574865 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48680b1dc0 con 0x7f48680d0da0 2023-08-25T05:19:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f486ce38640 1 --2- 172.21.15.55:0/2215574865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48680d0da0 0x7f48680d1180 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f485c0097d0 tx=0x7f485c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bbb9ffa471b3513 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f48677fe640 1 -- 172.21.15.55:0/2215574865 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c0a8990 con 0x7f48680d0da0 2023-08-25T05:19:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f48677fe640 1 -- 172.21.15.55:0/2215574865 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485c0a8af0 con 0x7f48680d0da0 2023-08-25T05:19:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f48677fe640 1 -- 172.21.15.55:0/2215574865 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c0a8e80 con 0x7f48680d0da0 2023-08-25T05:19:12.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f486f09c640 1 -- 172.21.15.55:0/2215574865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48680d0da0 msgr2=0x7f48680d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:12.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f486f09c640 1 --2- 172.21.15.55:0/2215574865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48680d0da0 0x7f48680d1180 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f485c0097d0 tx=0x7f485c01ec90 comp rx=0 tx=0).stop 2023-08-25T05:19:12.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f486f09c640 1 -- 172.21.15.55:0/2215574865 shutdown_connections 2023-08-25T05:19:12.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f486f09c640 1 --2- 172.21.15.55:0/2215574865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48680d0da0 0x7f48680d1180 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f486f09c640 1 -- 172.21.15.55:0/2215574865 >> 172.21.15.55:0/2215574865 conn(0x7f486809bae0 msgr2=0x7f48680d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:12.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f486f09c640 1 -- 172.21.15.55:0/2215574865 shutdown_connections 2023-08-25T05:19:12.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f486f09c640 1 -- 172.21.15.55:0/2215574865 wait complete. 2023-08-25T05:19:12.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f486f09c640 1 Processor -- start 2023-08-25T05:19:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f486f09c640 1 -- start start 2023-08-25T05:19:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f486f09c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48680b3e50 0x7f48681f1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f486f09c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48680cdde0 0x7f48680c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f486f09c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48680d0da0 0x7f48680c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f486f09c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48680cb290 con 0x7f48680d0da0 2023-08-25T05:19:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f486f09c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48680c7650 con 0x7f48680cdde0 2023-08-25T05:19:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.789+0000 7f486f09c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48680ca680 con 0x7f48680b3e50 2023-08-25T05:19:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f486d639640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48680d0da0 0x7f48680c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f486d639640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48680d0da0 0x7f48680c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53672/0 (socket says 172.21.15.55:53672) 2023-08-25T05:19:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f486d639640 1 -- 172.21.15.55:0/2966667944 learned_addr learned my addr 172.21.15.55:0/2966667944 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f486ce38640 1 --2- 172.21.15.55:0/2966667944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48680b3e50 0x7f48681f1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f4867fff640 1 --2- 172.21.15.55:0/2966667944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48680cdde0 0x7f48680c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:12.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f486d639640 1 -- 172.21.15.55:0/2966667944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48680b3e50 msgr2=0x7f48681f1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:12.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f486d639640 1 --2- 172.21.15.55:0/2966667944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48680b3e50 0x7f48681f1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f486d639640 1 -- 172.21.15.55:0/2966667944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48680cdde0 msgr2=0x7f48680c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f486d639640 1 --2- 172.21.15.55:0/2966667944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48680cdde0 0x7f48680c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f486d639640 1 -- 172.21.15.55:0/2966667944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c0093b0 con 0x7f48680d0da0 2023-08-25T05:19:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f486ce38640 1 --2- 172.21.15.55:0/2966667944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48680b3e50 0x7f48681f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:19:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f486d639640 1 --2- 172.21.15.55:0/2966667944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48680d0da0 0x7f48680c6830 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f486000cac0 tx=0x7f486000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f48657fa640 1 -- 172.21.15.55:0/2966667944 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486000ac30 con 0x7f48680d0da0 2023-08-25T05:19:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f48657fa640 1 -- 172.21.15.55:0/2966667944 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486000ad90 con 0x7f48680d0da0 2023-08-25T05:19:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f486f09c640 1 -- 172.21.15.55:0/2966667944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48680ca960 con 0x7f48680d0da0 2023-08-25T05:19:12.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f48657fa640 1 -- 172.21.15.55:0/2966667944 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860012620 con 0x7f48680d0da0 2023-08-25T05:19:12.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f486f09c640 1 -- 172.21.15.55:0/2966667944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48680caf20 con 0x7f48680d0da0 2023-08-25T05:19:12.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f486f09c640 1 -- 172.21.15.55:0/2966667944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48680cb440 con 0x7f48680d0da0 2023-08-25T05:19:12.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.793+0000 7f48657fa640 1 -- 172.21.15.55:0/2966667944 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f4860007070 con 0x7f48680d0da0 2023-08-25T05:19:12.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.797+0000 7f48657fa640 1 --2- 172.21.15.55:0/2966667944 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f484c0657d0 0x7f484c067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:12.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.797+0000 7f48657fa640 1 -- 172.21.15.55:0/2966667944 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f4860082e90 con 0x7f48680d0da0 2023-08-25T05:19:12.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.797+0000 7f486ce38640 1 --2- 172.21.15.55:0/2966667944 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f484c0657d0 0x7f484c067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:12.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.797+0000 7f486ce38640 1 --2- 172.21.15.55:0/2966667944 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f484c0657d0 0x7f484c067c90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f485c0b2000 tx=0x7f485c008040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:12.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.797+0000 7f48657fa640 1 -- 172.21.15.55:0/2966667944 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f48600508c0 con 0x7f48680d0da0 2023-08-25T05:19:12.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.993+0000 7f486f09c640 1 -- 172.21.15.55:0/2966667944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f486804dbe0 con 0x7f48680d0da0 2023-08-25T05:19:12.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.993+0000 7f48657fa640 1 -- 172.21.15.55:0/2966667944 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+3700 (secure 0 0 0) 0x7f4860084e90 con 0x7f48680d0da0 2023-08-25T05:19:12.996 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:12.996 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":76,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8911,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/381737607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":381737607},{"type":"v1","addr":"172.21.15.55:6834","nonce":381737607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":8917,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/775518941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":775518941},{"type":"v1","addr":"172.21.15.110:6836","nonce":775518941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":8920,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1426163963","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1426163963},{"type":"v1","addr":"172.21.15.110:6837","nonce":1426163963}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":69},{"gid":10047,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/4204128337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":4204128337},{"type":"v1","addr":"172.21.15.55:6835","nonce":4204128337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":76}],"filesystems":[]} 2023-08-25T05:19:12.996 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 76 2023-08-25T05:19:12.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.993+0000 7f486f09c640 1 -- 172.21.15.55:0/2966667944 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f484c0657d0 msgr2=0x7f484c067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:12.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.993+0000 7f486f09c640 1 --2- 172.21.15.55:0/2966667944 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f484c0657d0 0x7f484c067c90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f485c0b2000 tx=0x7f485c008040 comp rx=0 tx=0).stop 2023-08-25T05:19:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.993+0000 7f486f09c640 1 -- 172.21.15.55:0/2966667944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48680d0da0 msgr2=0x7f48680c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.993+0000 7f486f09c640 1 --2- 172.21.15.55:0/2966667944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48680d0da0 0x7f48680c6830 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f486000cac0 tx=0x7f486000cf80 comp rx=0 tx=0).stop 2023-08-25T05:19:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.993+0000 7f486f09c640 1 -- 172.21.15.55:0/2966667944 shutdown_connections 2023-08-25T05:19:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.993+0000 7f486f09c640 1 --2- 172.21.15.55:0/2966667944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48680d0da0 0x7f48680c6830 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.993+0000 7f486f09c640 1 --2- 172.21.15.55:0/2966667944 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f484c0657d0 0x7f484c067c90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.993+0000 7f486f09c640 1 --2- 172.21.15.55:0/2966667944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48680cdde0 0x7f48680c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.993+0000 7f486f09c640 1 --2- 172.21.15.55:0/2966667944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48680b3e50 0x7f48681f1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:12.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.993+0000 7f486f09c640 1 -- 172.21.15.55:0/2966667944 >> 172.21.15.55:0/2966667944 conn(0x7f486809bae0 msgr2=0x7f48680cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:12.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.993+0000 7f486f09c640 1 -- 172.21.15.55:0/2966667944 shutdown_connections 2023-08-25T05:19:12.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:12.993+0000 7f486f09c640 1 -- 172.21.15.55:0/2966667944 wait complete. 2023-08-25T05:19:13.018 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-25T05:19:13.019 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-25T05:19:13.019 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-25T05:19:13.019 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:19:13.020 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-25T05:19:13.020 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-25T05:19:13.021 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-25T05:19:13.021 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:19:13.022 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-25T05:19:13.022 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-25T05:19:13.022 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-25T05:19:13.022 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:19:13.023 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-25T05:19:13.023 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-25T05:19:13.023 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-25T05:19:13.023 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:19:13.032 INFO:tasks.ceph.mds.a:Stopped 2023-08-25T05:19:13.033 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-25T05:19:13.034 INFO:tasks.ceph.mds.c:Stopped 2023-08-25T05:19:13.034 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-25T05:19:13.038 INFO:tasks.ceph.mds.b:Stopped 2023-08-25T05:19:13.039 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-25T05:19:13.039 INFO:tasks.ceph.mds.d:Stopped 2023-08-25T05:19:13.040 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-25T05:19:13.085 INFO:tasks.ceph.mds.a:Started 2023-08-25T05:19:13.085 DEBUG:teuthology.parallel:result is None 2023-08-25T05:19:13.087 INFO:tasks.ceph.mds.c:Started 2023-08-25T05:19:13.088 DEBUG:teuthology.parallel:result is None 2023-08-25T05:19:13.088 INFO:tasks.ceph.mds.b:Started 2023-08-25T05:19:13.089 DEBUG:teuthology.parallel:result is None 2023-08-25T05:19:13.090 INFO:tasks.ceph.mds.d:Started 2023-08-25T05:19:13.090 DEBUG:teuthology.parallel:result is None 2023-08-25T05:19:13.091 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-25T05:19:13.172 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-08-25T05:19:13.173 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2023-08-25T05:19:13.173 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2023-08-25T05:19:13.176 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T05:19:13.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.237+0000 7f519092c640 1 Processor -- start 2023-08-25T05:19:13.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.237+0000 7f519092c640 1 -- start start 2023-08-25T05:19:13.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.237+0000 7f519092c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518c0d0da0 0x7f518c0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:13.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.237+0000 7f519092c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518c0b29b0 con 0x7f518c0b3e50 2023-08-25T05:19:13.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.237+0000 7f519092c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518c0cfc80 con 0x7f518c0cdde0 2023-08-25T05:19:13.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.237+0000 7f519092c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518c0d16c0 con 0x7f518c0d0da0 2023-08-25T05:19:13.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.237+0000 7f518ad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f518c0b3e50 0x7f518c0cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58528/0 (socket says 172.21.15.55:58528) 2023-08-25T05:19:13.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.237+0000 7f518ad9d640 1 -- 172.21.15.55:0/3001763164 learned_addr learned my addr 172.21.15.55:0/3001763164 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:13.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.237+0000 7f518a59c640 1 --2- 172.21.15.55:0/3001763164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518c0d0da0 0x7f518c0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:13.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.237+0000 7f5189d9b640 1 -- 172.21.15.55:0/3001763164 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615771381 0 0) 0x7f518c0b29b0 con 0x7f518c0b3e50 2023-08-25T05:19:13.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.237+0000 7f5189d9b640 1 -- 172.21.15.55:0/3001763164 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5178003530 con 0x7f518c0b3e50 2023-08-25T05:19:13.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.237+0000 7f5189d9b640 1 -- 172.21.15.55:0/3001763164 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219835191 0 0) 0x7f518c0cfc80 con 0x7f518c0cdde0 2023-08-25T05:19:13.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.237+0000 7f518a59c640 1 -- 172.21.15.55:0/3001763164 >> v1:172.21.15.110:6789/0 conn(0x7f518c0cdde0 legacy=0x7f518c0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:13.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.237+0000 7f518a59c640 1 -- 172.21.15.55:0/3001763164 >> v1:172.21.15.55:6789/0 conn(0x7f518c0b3e50 legacy=0x7f518c0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:13.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.237+0000 7f518a59c640 1 -- 172.21.15.55:0/3001763164 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c0b1dc0 con 0x7f518c0d0da0 2023-08-25T05:19:13.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.241+0000 7f518a59c640 1 --2- 172.21.15.55:0/3001763164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518c0d0da0 0x7f518c0d1180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f517c009e10 tx=0x7f517c01f1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaa75d47f92091a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:13.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.241+0000 7f5189d9b640 1 -- 172.21.15.55:0/3001763164 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c0af600 con 0x7f518c0d0da0 2023-08-25T05:19:13.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.241+0000 7f5189d9b640 1 -- 172.21.15.55:0/3001763164 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c0ab050 con 0x7f518c0d0da0 2023-08-25T05:19:13.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.241+0000 7f5189d9b640 1 -- 172.21.15.55:0/3001763164 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c0af980 con 0x7f518c0d0da0 2023-08-25T05:19:13.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.241+0000 7f519092c640 1 -- 172.21.15.55:0/3001763164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518c0d0da0 msgr2=0x7f518c0d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:13.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.241+0000 7f519092c640 1 --2- 172.21.15.55:0/3001763164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518c0d0da0 0x7f518c0d1180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f517c009e10 tx=0x7f517c01f1b0 comp rx=0 tx=0).stop 2023-08-25T05:19:13.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.241+0000 7f519092c640 1 -- 172.21.15.55:0/3001763164 shutdown_connections 2023-08-25T05:19:13.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.241+0000 7f519092c640 1 --2- 172.21.15.55:0/3001763164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518c0d0da0 0x7f518c0d1180 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:13.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.241+0000 7f519092c640 1 -- 172.21.15.55:0/3001763164 >> 172.21.15.55:0/3001763164 conn(0x7f518c09bae0 msgr2=0x7f518c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:13.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.241+0000 7f519092c640 1 -- 172.21.15.55:0/3001763164 shutdown_connections 2023-08-25T05:19:13.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.241+0000 7f519092c640 1 -- 172.21.15.55:0/3001763164 wait complete. 2023-08-25T05:19:13.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.245+0000 7f519092c640 1 Processor -- start 2023-08-25T05:19:13.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.245+0000 7f519092c640 1 -- start start 2023-08-25T05:19:13.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.245+0000 7f519092c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f518c0b3e50 0x7f518c0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:13.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.245+0000 7f519092c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f518c0cdde0 0x7f518c0b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:13.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.245+0000 7f519092c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518c0d0da0 0x7f518c1f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:13.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.245+0000 7f519092c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c0c9930 con 0x7f518c0b3e50 2023-08-25T05:19:13.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.245+0000 7f519092c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c0c9c10 con 0x7f518c0cdde0 2023-08-25T05:19:13.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.245+0000 7f519092c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518c0c9ef0 con 0x7f518c0d0da0 2023-08-25T05:19:13.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.245+0000 7f518a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f518c0b3e50 0x7f518c0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:13.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.245+0000 7f518a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f518c0b3e50 0x7f518c0c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53708/0 (socket says 172.21.15.55:53708) 2023-08-25T05:19:13.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.245+0000 7f518a59c640 1 -- 172.21.15.55:0/1283587948 learned_addr learned my addr 172.21.15.55:0/1283587948 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:13.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.245+0000 7f518ad9d640 1 --2- 172.21.15.55:0/1283587948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518c0d0da0 0x7f518c1f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:13.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.245+0000 7f5181d9b640 1 --2- 172.21.15.55:0/1283587948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f518c0cdde0 0x7f518c0b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:13.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.245+0000 7f518a59c640 1 -- 172.21.15.55:0/1283587948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518c0d0da0 msgr2=0x7f518c1f5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:13.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.245+0000 7f518a59c640 1 --2- 172.21.15.55:0/1283587948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518c0d0da0 0x7f518c1f5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:13.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.245+0000 7f518a59c640 1 -- 172.21.15.55:0/1283587948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f518c0cdde0 msgr2=0x7f518c0b7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:13.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.245+0000 7f518a59c640 1 --2- 172.21.15.55:0/1283587948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f518c0cdde0 0x7f518c0b7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:13.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.245+0000 7f518a59c640 1 -- 172.21.15.55:0/1283587948 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c009a70 con 0x7f518c0b3e50 2023-08-25T05:19:13.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.249+0000 7f518a59c640 1 --2- 172.21.15.55:0/1283587948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f518c0b3e50 0x7f518c0c8bd0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f517c0b2040 tx=0x7f517c01bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:13.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.249+0000 7f51837fe640 1 -- 172.21.15.55:0/1283587948 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c009450 con 0x7f518c0b3e50 2023-08-25T05:19:13.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.249+0000 7f51837fe640 1 -- 172.21.15.55:0/1283587948 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c0039a0 con 0x7f518c0b3e50 2023-08-25T05:19:13.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.249+0000 7f51837fe640 1 -- 172.21.15.55:0/1283587948 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c003d30 con 0x7f518c0b3e50 2023-08-25T05:19:13.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.249+0000 7f519092c640 1 -- 172.21.15.55:0/1283587948 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518c0ca1d0 con 0x7f518c0b3e50 2023-08-25T05:19:13.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.249+0000 7f519092c640 1 -- 172.21.15.55:0/1283587948 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518c1f6780 con 0x7f518c0b3e50 2023-08-25T05:19:13.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.249+0000 7f519092c640 1 -- 172.21.15.55:0/1283587948 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518c04dbe0 con 0x7f518c0b3e50 2023-08-25T05:19:13.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.249+0000 7f51837fe640 1 -- 172.21.15.55:0/1283587948 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f517c0b6050 con 0x7f518c0b3e50 2023-08-25T05:19:13.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.249+0000 7f51837fe640 1 --2- 172.21.15.55:0/1283587948 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f516c0657a0 0x7f516c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:13.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.249+0000 7f51837fe640 1 -- 172.21.15.55:0/1283587948 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f517c120750 con 0x7f518c0b3e50 2023-08-25T05:19:13.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.249+0000 7f5181d9b640 1 --2- 172.21.15.55:0/1283587948 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f516c0657a0 0x7f516c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:13.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.253+0000 7f5181d9b640 1 --2- 172.21.15.55:0/1283587948 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f516c0657a0 0x7f516c067c60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5174000f70 tx=0x7f5174009040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:13.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.253+0000 7f51837fe640 1 -- 172.21.15.55:0/1283587948 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f517c0ee100 con 0x7f518c0b3e50 2023-08-25T05:19:13.365 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:19:13.369 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:19:13.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:13.421+0000 7f519092c640 1 -- 172.21.15.55:0/1283587948 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f518c0c9a70 con 0x7f518c0b3e50 2023-08-25T05:19:14.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.029+0000 7f51837fe640 1 -- 172.21.15.55:0/1283587948 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v164) v1 ==== 97+0+0 (secure 0 0 0) 0x7f518c0c9a70 con 0x7f518c0b3e50 2023-08-25T05:19:14.032 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-08-25T05:19:14.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.029+0000 7f519092c640 1 -- 172.21.15.55:0/1283587948 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f516c0657a0 msgr2=0x7f516c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:14.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.029+0000 7f519092c640 1 --2- 172.21.15.55:0/1283587948 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f516c0657a0 0x7f516c067c60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5174000f70 tx=0x7f5174009040 comp rx=0 tx=0).stop 2023-08-25T05:19:14.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.029+0000 7f519092c640 1 -- 172.21.15.55:0/1283587948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f518c0b3e50 msgr2=0x7f518c0c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:14.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.029+0000 7f519092c640 1 --2- 172.21.15.55:0/1283587948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f518c0b3e50 0x7f518c0c8bd0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f517c0b2040 tx=0x7f517c01bf50 comp rx=0 tx=0).stop 2023-08-25T05:19:14.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.029+0000 7f519092c640 1 -- 172.21.15.55:0/1283587948 shutdown_connections 2023-08-25T05:19:14.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.029+0000 7f519092c640 1 --2- 172.21.15.55:0/1283587948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f518c0d0da0 0x7f518c1f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.029+0000 7f519092c640 1 --2- 172.21.15.55:0/1283587948 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f516c0657a0 0x7f516c067c60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.029+0000 7f519092c640 1 --2- 172.21.15.55:0/1283587948 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f518c0cdde0 0x7f518c0b7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.029+0000 7f519092c640 1 --2- 172.21.15.55:0/1283587948 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f518c0b3e50 0x7f518c0c8bd0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.029+0000 7f519092c640 1 -- 172.21.15.55:0/1283587948 >> 172.21.15.55:0/1283587948 conn(0x7f518c09bae0 msgr2=0x7f518c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:14.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.029+0000 7f519092c640 1 -- 172.21.15.55:0/1283587948 shutdown_connections 2023-08-25T05:19:14.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.029+0000 7f519092c640 1 -- 172.21.15.55:0/1283587948 wait complete. 2023-08-25T05:19:14.059 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-25T05:19:14.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.249+0000 7f43cd782640 1 Processor -- start 2023-08-25T05:19:14.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.249+0000 7f43cd782640 1 -- start start 2023-08-25T05:19:14.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.249+0000 7f43cd782640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43c815c9c0 0x7f43c8160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:14.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.249+0000 7f43cd782640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c806eaf0 con 0x7f43c806b2b0 2023-08-25T05:19:14.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.253+0000 7f43cd782640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c806e530 con 0x7f43c80cfa70 2023-08-25T05:19:14.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.253+0000 7f43cd782640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c806e810 con 0x7f43c815c9c0 2023-08-25T05:19:14.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.253+0000 7f43c77fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f43c806b2b0 0x7f43c806b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58536/0 (socket says 172.21.15.55:58536) 2023-08-25T05:19:14.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.253+0000 7f43c77fe640 1 -- 172.21.15.55:0/3603456082 learned_addr learned my addr 172.21.15.55:0/3603456082 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:14.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.253+0000 7f43c6ffd640 1 --2- 172.21.15.55:0/3603456082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43c815c9c0 0x7f43c8160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:14.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.253+0000 7f43c67fc640 1 -- 172.21.15.55:0/3603456082 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709435050 0 0) 0x7f43c806eaf0 con 0x7f43c806b2b0 2023-08-25T05:19:14.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.253+0000 7f43c67fc640 1 -- 172.21.15.55:0/3603456082 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b4003530 con 0x7f43c806b2b0 2023-08-25T05:19:14.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.253+0000 7f43c67fc640 1 -- 172.21.15.55:0/3603456082 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2493382734 0 0) 0x7f43c806e530 con 0x7f43c80cfa70 2023-08-25T05:19:14.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.253+0000 7f43c67fc640 1 -- 172.21.15.55:0/3603456082 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43c806eaf0 con 0x7f43c80cfa70 2023-08-25T05:19:14.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.253+0000 7f43c6ffd640 1 -- 172.21.15.55:0/3603456082 >> v1:172.21.15.110:6789/0 conn(0x7f43c80cfa70 legacy=0x7f43c8160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:14.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.253+0000 7f43c6ffd640 1 -- 172.21.15.55:0/3603456082 >> v1:172.21.15.55:6789/0 conn(0x7f43c806b2b0 legacy=0x7f43c806b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:14.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.253+0000 7f43c6ffd640 1 -- 172.21.15.55:0/3603456082 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c806aab0 con 0x7f43c815c9c0 2023-08-25T05:19:14.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.253+0000 7f43c6ffd640 1 --2- 172.21.15.55:0/3603456082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43c815c9c0 0x7f43c8160510 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f43b00097d0 tx=0x7f43b001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d40e87aabba32270 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:14.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43c67fc640 1 -- 172.21.15.55:0/3603456082 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b00a7070 con 0x7f43c815c9c0 2023-08-25T05:19:14.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43c67fc640 1 -- 172.21.15.55:0/3603456082 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b00ab430 con 0x7f43c815c9c0 2023-08-25T05:19:14.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43c67fc640 1 -- 172.21.15.55:0/3603456082 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b00ab7c0 con 0x7f43c815c9c0 2023-08-25T05:19:14.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43cd782640 1 -- 172.21.15.55:0/3603456082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43c815c9c0 msgr2=0x7f43c8160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:14.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43cd782640 1 --2- 172.21.15.55:0/3603456082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43c815c9c0 0x7f43c8160510 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f43b00097d0 tx=0x7f43b001c470 comp rx=0 tx=0).stop 2023-08-25T05:19:14.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43cd782640 1 -- 172.21.15.55:0/3603456082 shutdown_connections 2023-08-25T05:19:14.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43cd782640 1 --2- 172.21.15.55:0/3603456082 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43c815c9c0 0x7f43c8160510 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43cd782640 1 -- 172.21.15.55:0/3603456082 >> 172.21.15.55:0/3603456082 conn(0x7f43c80d05a0 msgr2=0x7f43c80d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:14.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43cd782640 1 -- 172.21.15.55:0/3603456082 shutdown_connections 2023-08-25T05:19:14.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43cd782640 1 -- 172.21.15.55:0/3603456082 wait complete. 2023-08-25T05:19:14.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43cd782640 1 Processor -- start 2023-08-25T05:19:14.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43cd782640 1 -- start start 2023-08-25T05:19:14.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43cd782640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43c806b2b0 0x7f43c815af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:14.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43cd782640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c80cfa70 0x7f43c80ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:14.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43cd782640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43c815c9c0 0x7f43c814b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:14.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43cd782640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c815ab60 con 0x7f43c815c9c0 2023-08-25T05:19:14.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43cd782640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c814bdf0 con 0x7f43c80cfa70 2023-08-25T05:19:14.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43cd782640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c814c0d0 con 0x7f43c806b2b0 2023-08-25T05:19:14.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43c77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43c815c9c0 0x7f43c814b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:14.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43be7fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c80cfa70 0x7f43c80ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:14.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43c6ffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43c806b2b0 0x7f43c815af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:14.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43c77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43c815c9c0 0x7f43c814b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53710/0 (socket says 172.21.15.55:53710) 2023-08-25T05:19:14.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.257+0000 7f43c77fe640 1 -- 172.21.15.55:0/3887846272 learned_addr learned my addr 172.21.15.55:0/3887846272 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:14.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.261+0000 7f43be7fc640 1 -- 172.21.15.55:0/3887846272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43c806b2b0 msgr2=0x7f43c815af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:14.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.261+0000 7f43be7fc640 1 --2- 172.21.15.55:0/3887846272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43c806b2b0 0x7f43c815af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.261+0000 7f43be7fc640 1 -- 172.21.15.55:0/3887846272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43c815c9c0 msgr2=0x7f43c814b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:14.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.261+0000 7f43be7fc640 1 --2- 172.21.15.55:0/3887846272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43c815c9c0 0x7f43c814b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.261+0000 7f43be7fc640 1 -- 172.21.15.55:0/3887846272 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b00093b0 con 0x7f43c80cfa70 2023-08-25T05:19:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.261+0000 7f43c77fe640 1 --2- 172.21.15.55:0/3887846272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43c815c9c0 0x7f43c814b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:19:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.261+0000 7f43be7fc640 1 --2- 172.21.15.55:0/3887846272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c80cfa70 0x7f43c80ada90 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f43b800c310 tx=0x7f43b8001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.261+0000 7f43bffff640 1 -- 172.21.15.55:0/3887846272 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b80052d0 con 0x7f43c80cfa70 2023-08-25T05:19:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.261+0000 7f43bffff640 1 -- 172.21.15.55:0/3887846272 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b8005450 con 0x7f43c80cfa70 2023-08-25T05:19:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.261+0000 7f43bffff640 1 -- 172.21.15.55:0/3887846272 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8003840 con 0x7f43c80cfa70 2023-08-25T05:19:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.261+0000 7f43cd782640 1 -- 172.21.15.55:0/3887846272 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c815a780 con 0x7f43c80cfa70 2023-08-25T05:19:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.261+0000 7f43cd782640 1 -- 172.21.15.55:0/3887846272 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c814de00 con 0x7f43c80cfa70 2023-08-25T05:19:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.261+0000 7f43cd782640 1 -- 172.21.15.55:0/3887846272 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c815add0 con 0x7f43c80cfa70 2023-08-25T05:19:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.261+0000 7f43bffff640 1 -- 172.21.15.55:0/3887846272 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f43b80039a0 con 0x7f43c80cfa70 2023-08-25T05:19:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.261+0000 7f43bffff640 1 --2- 172.21.15.55:0/3887846272 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f43a80657d0 0x7f43a8067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.261+0000 7f43bffff640 1 -- 172.21.15.55:0/3887846272 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f43b80821a0 con 0x7f43c80cfa70 2023-08-25T05:19:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.265+0000 7f43c6ffd640 1 --2- 172.21.15.55:0/3887846272 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f43a80657d0 0x7f43a8067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.265+0000 7f43c6ffd640 1 --2- 172.21.15.55:0/3887846272 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f43a80657d0 0x7f43a8067c90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f43b00af000 tx=0x7f43b00b6040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:14.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.265+0000 7f43bffff640 1 -- 172.21.15.55:0/3887846272 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f43b804ffc0 con 0x7f43c80cfa70 2023-08-25T05:19:14.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.473+0000 7f43cd782640 1 -- 172.21.15.55:0/3887846272 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f43c815a5e0 con 0x7f43c80cfa70 2023-08-25T05:19:14.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.473+0000 7f43bffff640 1 -- 172.21.15.55:0/3887846272 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v41) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f43c815a5e0 con 0x7f43c80cfa70 2023-08-25T05:19:14.478 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:14.478 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T05:19:14.478 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-08-25T05:19:14.478 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.478 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-08-25T05:19:14.479 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkgFrTEBAAoan9rk8Q+qPyMjb2vGUHhA==", 2023-08-25T05:19:14.479 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.479 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:19:14.479 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:19:14.479 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:19:14.480 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:19:14.480 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.480 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:14.481 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.481 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-08-25T05:19:14.481 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk18hNHRAAzXuhzQEONXRzRXTeCH9fKQ==", 2023-08-25T05:19:14.481 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.482 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:19:14.482 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:19:14.482 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:19:14.482 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:19:14.482 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.482 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:14.482 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.483 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-08-25T05:19:14.483 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkLF9CGBAAqxgRU/02SsZfWuZPSYxuZA==", 2023-08-25T05:19:14.483 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.483 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:19:14.483 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:19:14.483 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:19:14.483 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:19:14.483 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.484 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:14.484 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.484 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-08-25T05:19:14.484 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hky6HiJBAAsrXlTDn2cxbk7PnqSgNNkA==", 2023-08-25T05:19:14.484 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.484 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:19:14.484 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:19:14.485 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:19:14.485 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:19:14.485 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.485 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:14.485 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.485 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-08-25T05:19:14.485 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC+J+hkY1tDFBAAVQY5Xl8On9pN3jLWwKWGTA==", 2023-08-25T05:19:14.486 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.486 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:19:14.486 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:19:14.486 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:19:14.486 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.486 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:14.486 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.486 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-08-25T05:19:14.487 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDBJ+hkpdBCHRAADyMAxTsnQfkD9G0p48H4zQ==", 2023-08-25T05:19:14.487 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.487 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:19:14.487 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:19:14.487 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:19:14.487 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.487 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:14.487 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.488 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-08-25T05:19:14.488 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDEJ+hkOR49KRAAudbqAxLItsoczide8ybzAg==", 2023-08-25T05:19:14.488 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.488 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:19:14.488 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:19:14.488 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:19:14.488 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.489 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:14.489 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.489 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-08-25T05:19:14.489 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDHJ+hkxun5MBAAAhGtJYVeL3ogL3TQV67diw==", 2023-08-25T05:19:14.489 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.489 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:19:14.489 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:19:14.489 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:19:14.490 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.490 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:14.490 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.490 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-08-25T05:19:14.490 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDMJ+hkuosTCRAAqCuwHFZFBVR/7nFtHHByNg==", 2023-08-25T05:19:14.491 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.491 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:19:14.491 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:19:14.491 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:19:14.491 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.492 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:14.492 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.492 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-08-25T05:19:14.492 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDPJ+hkJa+SDhAAllo6biVE99BZWvv5K/gXGw==", 2023-08-25T05:19:14.492 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.493 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:19:14.493 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:19:14.493 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:19:14.493 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.493 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:14.493 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.493 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-08-25T05:19:14.493 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDSJ+hkUPywFBAA4jua1Eu1nRl2L6hX/mycfw==", 2023-08-25T05:19:14.494 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.494 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:19:14.494 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:19:14.494 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:19:14.494 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.494 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:14.494 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.494 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-08-25T05:19:14.495 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDVJ+hkhyDMGxAAmcSWLzJqIE5w5H/E4wIurQ==", 2023-08-25T05:19:14.495 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.495 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:19:14.495 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:19:14.495 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:19:14.495 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.495 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:14.495 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.496 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-08-25T05:19:14.496 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g==", 2023-08-25T05:19:14.496 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.496 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:19:14.496 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-08-25T05:19:14.496 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-25T05:19:14.496 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.497 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:14.497 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.497 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-08-25T05:19:14.497 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk8KsDMxAAKyK4jMKflYNnJXYIbr2OBQ==", 2023-08-25T05:19:14.497 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.497 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:19:14.497 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T05:19:14.497 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T05:19:14.498 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T05:19:14.498 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.498 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:14.498 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.498 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-08-25T05:19:14.498 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjSA4LxAAxzbnHeV85qYZYhSqTOT2rw==", 2023-08-25T05:19:14.498 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.498 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:19:14.499 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T05:19:14.499 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T05:19:14.499 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T05:19:14.499 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.499 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:14.499 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.499 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-08-25T05:19:14.499 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkl9AoORAARYZcPObsM/HT/yrTmneZrw==", 2023-08-25T05:19:14.500 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.500 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:19:14.500 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T05:19:14.500 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T05:19:14.500 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T05:19:14.500 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.500 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:14.501 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.501 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-08-25T05:19:14.501 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC2J+hkgTdcLxAAqxSepXXhEultFAFYBBKSag==", 2023-08-25T05:19:14.501 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.501 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T05:19:14.501 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:19:14.501 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:19:14.501 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:19:14.502 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.502 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:14.502 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.502 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-08-25T05:19:14.502 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkYGUZDBAAiuDo9hqavWq7zQlGd6x4YQ==", 2023-08-25T05:19:14.502 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.502 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T05:19:14.502 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T05:19:14.503 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:19:14.503 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.503 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:14.503 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:14.503 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-08-25T05:19:14.503 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjr9KCBAApSqjtFhLnjHduMBu/eaaKw==", 2023-08-25T05:19:14.503 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:19:14.503 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T05:19:14.504 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T05:19:14.504 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:19:14.504 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.504 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:14.504 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-08-25T05:19:14.504 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T05:19:14.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.477+0000 7f43cd782640 1 -- 172.21.15.55:0/3887846272 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f43a80657d0 msgr2=0x7f43a8067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:14.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.477+0000 7f43cd782640 1 --2- 172.21.15.55:0/3887846272 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f43a80657d0 0x7f43a8067c90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f43b00af000 tx=0x7f43b00b6040 comp rx=0 tx=0).stop 2023-08-25T05:19:14.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.477+0000 7f43cd782640 1 -- 172.21.15.55:0/3887846272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c80cfa70 msgr2=0x7f43c80ada90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:14.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.477+0000 7f43cd782640 1 --2- 172.21.15.55:0/3887846272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c80cfa70 0x7f43c80ada90 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f43b800c310 tx=0x7f43b8001e80 comp rx=0 tx=0).stop 2023-08-25T05:19:14.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.477+0000 7f43cd782640 1 -- 172.21.15.55:0/3887846272 shutdown_connections 2023-08-25T05:19:14.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.477+0000 7f43cd782640 1 --2- 172.21.15.55:0/3887846272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43c815c9c0 0x7f43c814b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.477+0000 7f43cd782640 1 --2- 172.21.15.55:0/3887846272 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f43a80657d0 0x7f43a8067c90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.477+0000 7f43cd782640 1 --2- 172.21.15.55:0/3887846272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43c80cfa70 0x7f43c80ada90 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.477+0000 7f43cd782640 1 --2- 172.21.15.55:0/3887846272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43c806b2b0 0x7f43c815af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.477+0000 7f43cd782640 1 -- 172.21.15.55:0/3887846272 >> 172.21.15.55:0/3887846272 conn(0x7f43c80d05a0 msgr2=0x7f43c80b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:14.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.477+0000 7f43cd782640 1 -- 172.21.15.55:0/3887846272 shutdown_connections 2023-08-25T05:19:14.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.477+0000 7f43cd782640 1 -- 172.21.15.55:0/3887846272 wait complete. 2023-08-25T05:19:14.508 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:19:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.649+0000 7fa174d40640 1 Processor -- start 2023-08-25T05:19:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.649+0000 7fa174d40640 1 -- start start 2023-08-25T05:19:14.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.649+0000 7fa174d40640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa1700d0da0 0x7fa1700d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.649+0000 7fa174d40640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700b3e50 0x7fa1700ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.649+0000 7fa174d40640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1700b29b0 con 0x7fa1700cdde0 2023-08-25T05:19:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.649+0000 7fa174d40640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1700ce760 con 0x7fa1700d0da0 2023-08-25T05:19:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.649+0000 7fa174d40640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1700d16c0 con 0x7fa1700b3e50 2023-08-25T05:19:14.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.649+0000 7fa16e59c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa1700d0da0 0x7fa1700d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:14.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.649+0000 7fa16e59c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa1700d0da0 0x7fa1700d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:36568/0 (socket says 172.21.15.55:36568) 2023-08-25T05:19:14.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.649+0000 7fa16e59c640 1 -- 172.21.15.55:0/2538422824 learned_addr learned my addr 172.21.15.55:0/2538422824 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:14.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.649+0000 7fa16ed9d640 1 --2- 172.21.15.55:0/2538422824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700b3e50 0x7fa1700ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:14.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.649+0000 7fa16e59c640 1 -- 172.21.15.55:0/2538422824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700b3e50 msgr2=0x7fa1700ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:14.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.649+0000 7fa16e59c640 1 --2- 172.21.15.55:0/2538422824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700b3e50 0x7fa1700ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.649+0000 7fa16e59c640 1 -- 172.21.15.55:0/2538422824 >> v1:172.21.15.110:6789/0 conn(0x7fa1700cdde0 legacy=0x7fa1700cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.649+0000 7fa16e59c640 1 -- 172.21.15.55:0/2538422824 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1700b1dc0 con 0x7fa1700d0da0 2023-08-25T05:19:14.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.653+0000 7fa16e59c640 1 --2- 172.21.15.55:0/2538422824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700d0da0 0x7fa1700d1180 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa160006fd0 tx=0x7fa16001ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5e4e089d3129fb9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.653+0000 7fa16dd9b640 1 -- 172.21.15.55:0/2538422824 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1600a8a10 con 0x7fa1700d0da0 2023-08-25T05:19:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.653+0000 7fa16dd9b640 1 -- 172.21.15.55:0/2538422824 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1600a8b70 con 0x7fa1700d0da0 2023-08-25T05:19:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.653+0000 7fa16dd9b640 1 -- 172.21.15.55:0/2538422824 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1600b0440 con 0x7fa1700d0da0 2023-08-25T05:19:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.653+0000 7fa174d40640 1 -- 172.21.15.55:0/2538422824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700d0da0 msgr2=0x7fa1700d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.653+0000 7fa174d40640 1 --2- 172.21.15.55:0/2538422824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700d0da0 0x7fa1700d1180 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa160006fd0 tx=0x7fa16001ed10 comp rx=0 tx=0).stop 2023-08-25T05:19:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.653+0000 7fa174d40640 1 -- 172.21.15.55:0/2538422824 shutdown_connections 2023-08-25T05:19:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.653+0000 7fa174d40640 1 --2- 172.21.15.55:0/2538422824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700b3e50 0x7fa1700ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.653+0000 7fa174d40640 1 --2- 172.21.15.55:0/2538422824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700d0da0 0x7fa1700d1180 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.653+0000 7fa174d40640 1 -- 172.21.15.55:0/2538422824 >> 172.21.15.55:0/2538422824 conn(0x7fa17009bae0 msgr2=0x7fa1700d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.653+0000 7fa174d40640 1 -- 172.21.15.55:0/2538422824 shutdown_connections 2023-08-25T05:19:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.653+0000 7fa174d40640 1 -- 172.21.15.55:0/2538422824 wait complete. 2023-08-25T05:19:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa174d40640 1 Processor -- start 2023-08-25T05:19:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa174d40640 1 -- start start 2023-08-25T05:19:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa174d40640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700b3e50 0x7fa17015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa174d40640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700cdde0 0x7fa1700c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa174d40640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700d0da0 0x7fa1700cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa174d40640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1700cc760 con 0x7fa1700d0da0 2023-08-25T05:19:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa174d40640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17015f570 con 0x7fa1700b3e50 2023-08-25T05:19:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa174d40640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1700c6a70 con 0x7fa1700cdde0 2023-08-25T05:19:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa16ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700d0da0 0x7fa1700cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa16ed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700d0da0 0x7fa1700cc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53726/0 (socket says 172.21.15.55:53726) 2023-08-25T05:19:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa16ed9d640 1 -- 172.21.15.55:0/466587248 learned_addr learned my addr 172.21.15.55:0/466587248 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa16e59c640 1 --2- 172.21.15.55:0/466587248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700b3e50 0x7fa17015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa167fff640 1 --2- 172.21.15.55:0/466587248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700cdde0 0x7fa1700c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa16ed9d640 1 -- 172.21.15.55:0/466587248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700cdde0 msgr2=0x7fa1700c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa16ed9d640 1 --2- 172.21.15.55:0/466587248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700cdde0 0x7fa1700c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa16ed9d640 1 -- 172.21.15.55:0/466587248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700b3e50 msgr2=0x7fa17015ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa16ed9d640 1 --2- 172.21.15.55:0/466587248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700b3e50 0x7fa17015ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa16ed9d640 1 -- 172.21.15.55:0/466587248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa160009480 con 0x7fa1700d0da0 2023-08-25T05:19:14.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa16e59c640 1 --2- 172.21.15.55:0/466587248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700b3e50 0x7fa17015ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:19:14.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa16ed9d640 1 --2- 172.21.15.55:0/466587248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700d0da0 0x7fa1700cc220 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fa16800efc0 tx=0x7fa16800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:14.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.657+0000 7fa166ffd640 1 -- 172.21.15.55:0/466587248 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa168009b20 con 0x7fa1700d0da0 2023-08-25T05:19:14.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.661+0000 7fa166ffd640 1 -- 172.21.15.55:0/466587248 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16800f040 con 0x7fa1700d0da0 2023-08-25T05:19:14.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.661+0000 7fa166ffd640 1 -- 172.21.15.55:0/466587248 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1680146c0 con 0x7fa1700d0da0 2023-08-25T05:19:14.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.661+0000 7fa174d40640 1 -- 172.21.15.55:0/466587248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17015f290 con 0x7fa1700d0da0 2023-08-25T05:19:14.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.661+0000 7fa174d40640 1 -- 172.21.15.55:0/466587248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1700c6700 con 0x7fa1700d0da0 2023-08-25T05:19:14.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.661+0000 7fa174d40640 1 -- 172.21.15.55:0/466587248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17004dbe0 con 0x7fa1700d0da0 2023-08-25T05:19:14.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.661+0000 7fa166ffd640 1 -- 172.21.15.55:0/466587248 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fa168014820 con 0x7fa1700d0da0 2023-08-25T05:19:14.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.661+0000 7fa166ffd640 1 --2- 172.21.15.55:0/466587248 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa1500657a0 0x7fa150067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:14.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.661+0000 7fa166ffd640 1 -- 172.21.15.55:0/466587248 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa168083910 con 0x7fa1700d0da0 2023-08-25T05:19:14.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.661+0000 7fa16e59c640 1 --2- 172.21.15.55:0/466587248 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa1500657a0 0x7fa150067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:14.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.661+0000 7fa16e59c640 1 --2- 172.21.15.55:0/466587248 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa1500657a0 0x7fa150067c60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa1600b2000 tx=0x7fa1600aa070 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:14.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.665+0000 7fa166ffd640 1 -- 172.21.15.55:0/466587248 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa1680515a0 con 0x7fa1700d0da0 2023-08-25T05:19:14.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.821+0000 7fa174d40640 1 -- 172.21.15.55:0/466587248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa17006c700 con 0x7fa1700d0da0 2023-08-25T05:19:14.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.821+0000 7fa166ffd640 1 -- 172.21.15.55:0/466587248 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+14661 (secure 0 0 0) 0x7fa168018020 con 0x7fa1700d0da0 2023-08-25T05:19:14.826 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:14.826 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":166,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:19:14.038665+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:19:14.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.825+0000 7fa174d40640 1 -- 172.21.15.55:0/466587248 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa1500657a0 msgr2=0x7fa150067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:14.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.825+0000 7fa174d40640 1 --2- 172.21.15.55:0/466587248 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa1500657a0 0x7fa150067c60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa1600b2000 tx=0x7fa1600aa070 comp rx=0 tx=0).stop 2023-08-25T05:19:14.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.825+0000 7fa174d40640 1 -- 172.21.15.55:0/466587248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700d0da0 msgr2=0x7fa1700cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:14.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.825+0000 7fa174d40640 1 --2- 172.21.15.55:0/466587248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700d0da0 0x7fa1700cc220 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fa16800efc0 tx=0x7fa16800c490 comp rx=0 tx=0).stop 2023-08-25T05:19:14.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.825+0000 7fa174d40640 1 -- 172.21.15.55:0/466587248 shutdown_connections 2023-08-25T05:19:14.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.825+0000 7fa174d40640 1 --2- 172.21.15.55:0/466587248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700d0da0 0x7fa1700cc220 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.825+0000 7fa174d40640 1 --2- 172.21.15.55:0/466587248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700cdde0 0x7fa1700c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.825+0000 7fa174d40640 1 --2- 172.21.15.55:0/466587248 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa1500657a0 0x7fa150067c60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.825+0000 7fa174d40640 1 --2- 172.21.15.55:0/466587248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700b3e50 0x7fa17015ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:14.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.825+0000 7fa174d40640 1 -- 172.21.15.55:0/466587248 >> 172.21.15.55:0/466587248 conn(0x7fa17009bae0 msgr2=0x7fa17015c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:14.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.825+0000 7fa174d40640 1 -- 172.21.15.55:0/466587248 shutdown_connections 2023-08-25T05:19:14.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.825+0000 7fa174d40640 1 -- 172.21.15.55:0/466587248 wait complete. 2023-08-25T05:19:14.847 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T05:19:14.848 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T05:19:14.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.989+0000 7fab4d4ca640 1 Processor -- start 2023-08-25T05:19:14.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.989+0000 7fab4d4ca640 1 -- start start 2023-08-25T05:19:14.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.993+0000 7fab4d4ca640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab480cfc90 0x7fab480b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.993+0000 7fab4d4ca640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fab480b8330 0x7fab480b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.993+0000 7fab4d4ca640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab480b70c0 con 0x7fab4815fca0 2023-08-25T05:19:14.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.993+0000 7fab4d4ca640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab48160080 con 0x7fab480b8330 2023-08-25T05:19:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.993+0000 7fab4d4ca640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab480b73a0 con 0x7fab480cfc90 2023-08-25T05:19:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.993+0000 7fab4ccc9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fab480b8330 0x7fab480b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.993+0000 7fab477fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab480cfc90 0x7fab480b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:14.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.993+0000 7fab4ccc9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fab480b8330 0x7fab480b5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:36574/0 (socket says 172.21.15.55:36574) 2023-08-25T05:19:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.993+0000 7fab4ccc9640 1 -- 172.21.15.55:0/2364491594 learned_addr learned my addr 172.21.15.55:0/2364491594 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.993+0000 7fab4ccc9640 1 -- 172.21.15.55:0/2364491594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab480cfc90 msgr2=0x7fab480b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:14.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.993+0000 7fab4ccc9640 1 --2- 172.21.15.55:0/2364491594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab480cfc90 0x7fab480b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.993+0000 7fab4ccc9640 1 -- 172.21.15.55:0/2364491594 >> v1:172.21.15.110:6789/0 conn(0x7fab4815fca0 legacy=0x7fab480cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:15.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.993+0000 7fab4ccc9640 1 -- 172.21.15.55:0/2364491594 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab480b7680 con 0x7fab480b8330 2023-08-25T05:19:15.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.997+0000 7fab4ccc9640 1 --2- 172.21.15.55:0/2364491594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab480b8330 0x7fab480b5b10 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fab40009e50 tx=0x7fab4001f1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=404b3771131e2236 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:15.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.997+0000 7fab46ffd640 1 -- 172.21.15.55:0/2364491594 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab400af400 con 0x7fab480b8330 2023-08-25T05:19:15.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.997+0000 7fab46ffd640 1 -- 172.21.15.55:0/2364491594 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab400ab050 con 0x7fab480b8330 2023-08-25T05:19:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.997+0000 7fab46ffd640 1 -- 172.21.15.55:0/2364491594 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab400af780 con 0x7fab480b8330 2023-08-25T05:19:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.997+0000 7fab4d4ca640 1 -- 172.21.15.55:0/2364491594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab480b8330 msgr2=0x7fab480b5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.997+0000 7fab4d4ca640 1 --2- 172.21.15.55:0/2364491594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab480b8330 0x7fab480b5b10 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fab40009e50 tx=0x7fab4001f1f0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.997+0000 7fab4d4ca640 1 -- 172.21.15.55:0/2364491594 shutdown_connections 2023-08-25T05:19:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.997+0000 7fab4d4ca640 1 --2- 172.21.15.55:0/2364491594 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab480b8330 0x7fab480b5b10 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.997+0000 7fab4d4ca640 1 --2- 172.21.15.55:0/2364491594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab480cfc90 0x7fab480b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.997+0000 7fab4d4ca640 1 -- 172.21.15.55:0/2364491594 >> 172.21.15.55:0/2364491594 conn(0x7fab480658c0 msgr2=0x7fab48065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.997+0000 7fab4d4ca640 1 -- 172.21.15.55:0/2364491594 shutdown_connections 2023-08-25T05:19:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.997+0000 7fab4d4ca640 1 -- 172.21.15.55:0/2364491594 wait complete. 2023-08-25T05:19:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.997+0000 7fab4d4ca640 1 Processor -- start 2023-08-25T05:19:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:14.997+0000 7fab4d4ca640 1 -- start start 2023-08-25T05:19:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab4d4ca640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab480b8330 0x7fab481f1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab4d4ca640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab480cfc90 0x7fab480c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:15.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab4d4ca640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab4815fca0 0x7fab48159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:15.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab4d4ca640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab48158d40 con 0x7fab480b8330 2023-08-25T05:19:15.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab4d4ca640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab481f1c90 con 0x7fab480cfc90 2023-08-25T05:19:15.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab4d4ca640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab481581c0 con 0x7fab4815fca0 2023-08-25T05:19:15.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab47fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab480b8330 0x7fab481f1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:15.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab47fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab480b8330 0x7fab481f1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53736/0 (socket says 172.21.15.55:53736) 2023-08-25T05:19:15.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab47fff640 1 -- 172.21.15.55:0/2530134658 learned_addr learned my addr 172.21.15.55:0/2530134658 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:15.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab477fe640 1 --2- 172.21.15.55:0/2530134658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab480cfc90 0x7fab480c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:15.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab4ccc9640 1 --2- 172.21.15.55:0/2530134658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab4815fca0 0x7fab48159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:15.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab47fff640 1 -- 172.21.15.55:0/2530134658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab4815fca0 msgr2=0x7fab48159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:15.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab47fff640 1 --2- 172.21.15.55:0/2530134658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab4815fca0 0x7fab48159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab47fff640 1 -- 172.21.15.55:0/2530134658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab480cfc90 msgr2=0x7fab480c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:15.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab47fff640 1 --2- 172.21.15.55:0/2530134658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab480cfc90 0x7fab480c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab47fff640 1 -- 172.21.15.55:0/2530134658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40009b30 con 0x7fab480b8330 2023-08-25T05:19:15.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab477fe640 1 --2- 172.21.15.55:0/2530134658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab480cfc90 0x7fab480c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:19:15.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab47fff640 1 --2- 172.21.15.55:0/2530134658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab480b8330 0x7fab481f1750 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fab3800c3f0 tx=0x7fab3800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:15.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab44ff9640 1 -- 172.21.15.55:0/2530134658 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab380052d0 con 0x7fab480b8330 2023-08-25T05:19:15.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab44ff9640 1 -- 172.21.15.55:0/2530134658 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab38005430 con 0x7fab480b8330 2023-08-25T05:19:15.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab44ff9640 1 -- 172.21.15.55:0/2530134658 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38003840 con 0x7fab480b8330 2023-08-25T05:19:15.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab4d4ca640 1 -- 172.21.15.55:0/2530134658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab481584a0 con 0x7fab480b8330 2023-08-25T05:19:15.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab4d4ca640 1 -- 172.21.15.55:0/2530134658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab48158a60 con 0x7fab480b8330 2023-08-25T05:19:15.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab4d4ca640 1 -- 172.21.15.55:0/2530134658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab48073e50 con 0x7fab480b8330 2023-08-25T05:19:15.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.001+0000 7fab44ff9640 1 -- 172.21.15.55:0/2530134658 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fab380039a0 con 0x7fab480b8330 2023-08-25T05:19:15.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.005+0000 7fab44ff9640 1 --2- 172.21.15.55:0/2530134658 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fab340657a0 0x7fab34067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:15.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.005+0000 7fab44ff9640 1 -- 172.21.15.55:0/2530134658 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fab380820e0 con 0x7fab480b8330 2023-08-25T05:19:15.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.005+0000 7fab477fe640 1 --2- 172.21.15.55:0/2530134658 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fab340657a0 0x7fab34067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:15.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.005+0000 7fab477fe640 1 --2- 172.21.15.55:0/2530134658 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fab340657a0 0x7fab34067c60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab481590f0 tx=0x7fab3c009190 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:15.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.009+0000 7fab44ff9640 1 -- 172.21.15.55:0/2530134658 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fab3804fe80 con 0x7fab480b8330 2023-08-25T05:19:15.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.169+0000 7fab4d4ca640 1 -- 172.21.15.55:0/2530134658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab480b8110 con 0x7fab480b8330 2023-08-25T05:19:15.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.169+0000 7fab44ff9640 1 -- 172.21.15.55:0/2530134658 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v166) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab380534a0 con 0x7fab480b8330 2023-08-25T05:19:15.172 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T05:19:15.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.169+0000 7fab4d4ca640 1 -- 172.21.15.55:0/2530134658 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fab340657a0 msgr2=0x7fab34067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:15.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.169+0000 7fab4d4ca640 1 --2- 172.21.15.55:0/2530134658 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fab340657a0 0x7fab34067c60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab481590f0 tx=0x7fab3c009190 comp rx=0 tx=0).stop 2023-08-25T05:19:15.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.169+0000 7fab4d4ca640 1 -- 172.21.15.55:0/2530134658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab480b8330 msgr2=0x7fab481f1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:15.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.169+0000 7fab4d4ca640 1 --2- 172.21.15.55:0/2530134658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab480b8330 0x7fab481f1750 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fab3800c3f0 tx=0x7fab3800c8b0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.169+0000 7fab4d4ca640 1 -- 172.21.15.55:0/2530134658 shutdown_connections 2023-08-25T05:19:15.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.169+0000 7fab4d4ca640 1 --2- 172.21.15.55:0/2530134658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab4815fca0 0x7fab48159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.169+0000 7fab4d4ca640 1 --2- 172.21.15.55:0/2530134658 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fab340657a0 0x7fab34067c60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.169+0000 7fab4d4ca640 1 --2- 172.21.15.55:0/2530134658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab480cfc90 0x7fab480c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.169+0000 7fab4d4ca640 1 --2- 172.21.15.55:0/2530134658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab480b8330 0x7fab481f1750 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.169+0000 7fab4d4ca640 1 -- 172.21.15.55:0/2530134658 >> 172.21.15.55:0/2530134658 conn(0x7fab480658c0 msgr2=0x7fab480b5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:15.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.169+0000 7fab4d4ca640 1 -- 172.21.15.55:0/2530134658 shutdown_connections 2023-08-25T05:19:15.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.169+0000 7fab4d4ca640 1 -- 172.21.15.55:0/2530134658 wait complete. 2023-08-25T05:19:15.194 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T05:19:15.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb59733640 1 Processor -- start 2023-08-25T05:19:15.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb59733640 1 -- start start 2023-08-25T05:19:15.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb59733640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5415e3c0 0x7fcb5415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:15.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb59733640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb540cd5a0 con 0x7fcb541601f0 2023-08-25T05:19:15.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb59733640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb540cd880 con 0x7fcb540d1290 2023-08-25T05:19:15.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb59733640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540cdb60 con 0x7fcb5415e3c0 2023-08-25T05:19:15.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb52ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcb541601f0 0x7fcb540d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58546/0 (socket says 172.21.15.55:58546) 2023-08-25T05:19:15.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb52ffd640 1 -- 172.21.15.55:0/288714542 learned_addr learned my addr 172.21.15.55:0/288714542 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:15.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb4a7fc640 1 --2- 172.21.15.55:0/288714542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5415e3c0 0x7fcb5415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:15.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb527fc640 1 -- 172.21.15.55:0/288714542 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365251974 0 0) 0x7fcb540cd5a0 con 0x7fcb541601f0 2023-08-25T05:19:15.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb527fc640 1 -- 172.21.15.55:0/288714542 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb40003530 con 0x7fcb541601f0 2023-08-25T05:19:15.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb527fc640 1 -- 172.21.15.55:0/288714542 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3405365414 0 0) 0x7fcb40003530 con 0x7fcb541601f0 2023-08-25T05:19:15.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb527fc640 1 -- 172.21.15.55:0/288714542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5415e3c0 msgr2=0x7fcb5415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:15.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb527fc640 1 --2- 172.21.15.55:0/288714542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5415e3c0 0x7fcb5415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb527fc640 1 -- 172.21.15.55:0/288714542 >> v1:172.21.15.110:6789/0 conn(0x7fcb540d1290 legacy=0x7fcb5415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:15.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb527fc640 1 -- 172.21.15.55:0/288714542 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb540cde40 con 0x7fcb541601f0 2023-08-25T05:19:15.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb527fc640 1 -- 172.21.15.55:0/288714542 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fcb44001800 con 0x7fcb541601f0 2023-08-25T05:19:15.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb527fc640 1 -- 172.21.15.55:0/288714542 >> v1:172.21.15.55:6789/0 conn(0x7fcb541601f0 legacy=0x7fcb540d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:15.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb527fc640 1 --2- 172.21.15.55:0/288714542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5415e3c0 0x7fcb400039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:15.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb527fc640 1 --2- 172.21.15.55:0/288714542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb40003f30 0x7fcb400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:15.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.337+0000 7fcb527fc640 1 --2- 172.21.15.55:0/288714542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb40004d10 0x7fcb40005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:15.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.341+0000 7fcb527fc640 1 -- 172.21.15.55:0/288714542 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540cdb60 con 0x7fcb40004d10 2023-08-25T05:19:15.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.341+0000 7fcb527fc640 1 -- 172.21.15.55:0/288714542 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4000bb00 con 0x7fcb40003f30 2023-08-25T05:19:15.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.341+0000 7fcb527fc640 1 -- 172.21.15.55:0/288714542 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4000bcc0 con 0x7fcb5415e3c0 2023-08-25T05:19:15.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.341+0000 7fcb537fe640 1 --2- 172.21.15.55:0/288714542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb40004d10 0x7fcb40005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:15.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.341+0000 7fcb52ffd640 1 --2- 172.21.15.55:0/288714542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5415e3c0 0x7fcb400039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:15.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.341+0000 7fcb4a7fc640 1 --2- 172.21.15.55:0/288714542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb40003f30 0x7fcb400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:15.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.341+0000 7fcb537fe640 1 -- 172.21.15.55:0/288714542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5415e3c0 msgr2=0x7fcb400039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:15.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.341+0000 7fcb537fe640 1 --2- 172.21.15.55:0/288714542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5415e3c0 0x7fcb400039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.341+0000 7fcb537fe640 1 -- 172.21.15.55:0/288714542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb40003f30 msgr2=0x7fcb400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:15.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.341+0000 7fcb537fe640 1 --2- 172.21.15.55:0/288714542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb40003f30 0x7fcb400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.341+0000 7fcb537fe640 1 -- 172.21.15.55:0/288714542 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb40003530 con 0x7fcb40004d10 2023-08-25T05:19:15.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.341+0000 7fcb537fe640 1 --2- 172.21.15.55:0/288714542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb40004d10 0x7fcb40005190 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c001780 tx=0x7fcb4c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52bedd9196c36e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:15.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.341+0000 7fcb527fc640 1 -- 172.21.15.55:0/288714542 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c0052d0 con 0x7fcb40004d10 2023-08-25T05:19:15.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.341+0000 7fcb527fc640 1 -- 172.21.15.55:0/288714542 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c0a7050 con 0x7fcb40004d10 2023-08-25T05:19:15.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.341+0000 7fcb527fc640 1 -- 172.21.15.55:0/288714542 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c003600 con 0x7fcb40004d10 2023-08-25T05:19:15.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb59733640 1 -- 172.21.15.55:0/288714542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb40004d10 msgr2=0x7fcb40005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:15.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb59733640 1 --2- 172.21.15.55:0/288714542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb40004d10 0x7fcb40005190 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c001780 tx=0x7fcb4c01c400 comp rx=0 tx=0).stop 2023-08-25T05:19:15.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb537fe640 1 -- 172.21.15.55:0/288714542 reap_dead start 2023-08-25T05:19:15.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb59733640 1 -- 172.21.15.55:0/288714542 shutdown_connections 2023-08-25T05:19:15.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb59733640 1 -- 172.21.15.55:0/288714542 >> 172.21.15.55:0/288714542 conn(0x7fcb540d27d0 msgr2=0x7fcb540d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:15.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb59733640 1 -- 172.21.15.55:0/288714542 shutdown_connections 2023-08-25T05:19:15.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb59733640 1 -- 172.21.15.55:0/288714542 wait complete. 2023-08-25T05:19:15.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb59733640 1 Processor -- start 2023-08-25T05:19:15.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb59733640 1 -- start start 2023-08-25T05:19:15.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb59733640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb40004d10 0x7fcb540b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:15.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb59733640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb540cbcf0 0x7fcb540cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:15.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb59733640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb541f1660 0x7fcb541f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:15.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb59733640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb541f2020 con 0x7fcb540cbcf0 2023-08-25T05:19:15.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb59733640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540b02e0 con 0x7fcb40004d10 2023-08-25T05:19:15.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb59733640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb540b05c0 con 0x7fcb541f1660 2023-08-25T05:19:15.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb4a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb540cbcf0 0x7fcb540cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:15.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb4a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb540cbcf0 0x7fcb540cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53758/0 (socket says 172.21.15.55:53758) 2023-08-25T05:19:15.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb4a7fc640 1 -- 172.21.15.55:0/1615497936 learned_addr learned my addr 172.21.15.55:0/1615497936 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:15.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb52ffd640 1 --2- 172.21.15.55:0/1615497936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb40004d10 0x7fcb540b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:15.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb537fe640 1 --2- 172.21.15.55:0/1615497936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb541f1660 0x7fcb541f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:15.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb4a7fc640 1 -- 172.21.15.55:0/1615497936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb541f1660 msgr2=0x7fcb541f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:15.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb4a7fc640 1 --2- 172.21.15.55:0/1615497936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb541f1660 0x7fcb541f1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb4a7fc640 1 -- 172.21.15.55:0/1615497936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb40004d10 msgr2=0x7fcb540b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:15.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb4a7fc640 1 --2- 172.21.15.55:0/1615497936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb40004d10 0x7fcb540b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.345+0000 7fcb4a7fc640 1 -- 172.21.15.55:0/1615497936 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb540ce7c0 con 0x7fcb540cbcf0 2023-08-25T05:19:15.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.349+0000 7fcb4a7fc640 1 --2- 172.21.15.55:0/1615497936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb540cbcf0 0x7fcb540cc170 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c011e30 tx=0x7fcb3c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:15.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.349+0000 7fcb4bfff640 1 -- 172.21.15.55:0/1615497936 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c00e040 con 0x7fcb540cbcf0 2023-08-25T05:19:15.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.349+0000 7fcb4bfff640 1 -- 172.21.15.55:0/1615497936 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c00f040 con 0x7fcb540cbcf0 2023-08-25T05:19:15.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.349+0000 7fcb4bfff640 1 -- 172.21.15.55:0/1615497936 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c009c00 con 0x7fcb540cbcf0 2023-08-25T05:19:15.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.349+0000 7fcb59733640 1 -- 172.21.15.55:0/1615497936 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb540b08a0 con 0x7fcb540cbcf0 2023-08-25T05:19:15.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.349+0000 7fcb59733640 1 -- 172.21.15.55:0/1615497936 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb540cc770 con 0x7fcb540cbcf0 2023-08-25T05:19:15.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.349+0000 7fcb59733640 1 -- 172.21.15.55:0/1615497936 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb540b5260 con 0x7fcb540cbcf0 2023-08-25T05:19:15.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.349+0000 7fcb4bfff640 1 -- 172.21.15.55:0/1615497936 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fcb3c015850 con 0x7fcb540cbcf0 2023-08-25T05:19:15.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.349+0000 7fcb4bfff640 1 --2- 172.21.15.55:0/1615497936 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fcb340657a0 0x7fcb34067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:15.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.349+0000 7fcb4bfff640 1 -- 172.21.15.55:0/1615497936 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcb3c083b10 con 0x7fcb540cbcf0 2023-08-25T05:19:15.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.349+0000 7fcb52ffd640 1 --2- 172.21.15.55:0/1615497936 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fcb340657a0 0x7fcb34067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:15.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.353+0000 7fcb52ffd640 1 --2- 172.21.15.55:0/1615497936 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fcb340657a0 0x7fcb34067c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcb44000f00 tx=0x7fcb44009040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:15.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.353+0000 7fcb4bfff640 1 -- 172.21.15.55:0/1615497936 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fcb3c051660 con 0x7fcb540cbcf0 2023-08-25T05:19:15.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.509+0000 7fcb59733640 1 -- 172.21.15.55:0/1615497936 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcb54073ec0 con 0x7fcb540cbcf0 2023-08-25T05:19:15.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.509+0000 7fcb4bfff640 1 -- 172.21.15.55:0/1615497936 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v166) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcb3c054c80 con 0x7fcb540cbcf0 2023-08-25T05:19:15.515 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T05:19:15.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.513+0000 7fcb59733640 1 -- 172.21.15.55:0/1615497936 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fcb340657a0 msgr2=0x7fcb34067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:15.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.513+0000 7fcb59733640 1 --2- 172.21.15.55:0/1615497936 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fcb340657a0 0x7fcb34067c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcb44000f00 tx=0x7fcb44009040 comp rx=0 tx=0).stop 2023-08-25T05:19:15.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.513+0000 7fcb59733640 1 -- 172.21.15.55:0/1615497936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb540cbcf0 msgr2=0x7fcb540cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.513+0000 7fcb59733640 1 --2- 172.21.15.55:0/1615497936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb540cbcf0 0x7fcb540cc170 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c011e30 tx=0x7fcb3c00f580 comp rx=0 tx=0).stop 2023-08-25T05:19:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.513+0000 7fcb59733640 1 -- 172.21.15.55:0/1615497936 shutdown_connections 2023-08-25T05:19:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.513+0000 7fcb59733640 1 --2- 172.21.15.55:0/1615497936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb541f1660 0x7fcb541f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.513+0000 7fcb59733640 1 --2- 172.21.15.55:0/1615497936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb540cbcf0 0x7fcb540cc170 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.513+0000 7fcb59733640 1 --2- 172.21.15.55:0/1615497936 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fcb340657a0 0x7fcb34067c60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.513+0000 7fcb59733640 1 --2- 172.21.15.55:0/1615497936 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb40004d10 0x7fcb540b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.513+0000 7fcb59733640 1 -- 172.21.15.55:0/1615497936 >> 172.21.15.55:0/1615497936 conn(0x7fcb540d27d0 msgr2=0x7fcb540d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:15.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.513+0000 7fcb59733640 1 -- 172.21.15.55:0/1615497936 shutdown_connections 2023-08-25T05:19:15.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.513+0000 7fcb59733640 1 -- 172.21.15.55:0/1615497936 wait complete. 2023-08-25T05:19:15.536 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-25T05:19:15.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.677+0000 7f52842ec640 1 Processor -- start 2023-08-25T05:19:15.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.677+0000 7f52842ec640 1 -- start start 2023-08-25T05:19:15.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.677+0000 7f52842ec640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f527c0b1220 0x7f527c0c9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:15.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.677+0000 7f52842ec640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f527c0cabf0 0x7f527c0c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.677+0000 7f52842ec640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f527c06d2b0 con 0x7f527c0cde20 2023-08-25T05:19:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.677+0000 7f52842ec640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527c0c9490 con 0x7f527c0b1220 2023-08-25T05:19:15.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.677+0000 7f52842ec640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527c0cb1e0 con 0x7f527c0cabf0 2023-08-25T05:19:15.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.677+0000 7f5281887640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f527c0b1220 0x7f527c0c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:15.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.677+0000 7f5281887640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f527c0b1220 0x7f527c0c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53766/0 (socket says 172.21.15.55:53766) 2023-08-25T05:19:15.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.677+0000 7f5281887640 1 -- 172.21.15.55:0/3799251521 learned_addr learned my addr 172.21.15.55:0/3799251521 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:15.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.677+0000 7f5282889640 1 --2- 172.21.15.55:0/3799251521 >> v2:172.21.15.110:3300/0 conn(0x7f527c0cabf0 0x7f527c0c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:15.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.677+0000 7f5281887640 1 -- 172.21.15.55:0/3799251521 >> v2:172.21.15.110:3300/0 conn(0x7f527c0cabf0 msgr2=0x7f527c0c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:15.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.677+0000 7f5281887640 1 --2- 172.21.15.55:0/3799251521 >> v2:172.21.15.110:3300/0 conn(0x7f527c0cabf0 0x7f527c0c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.677+0000 7f5281887640 1 -- 172.21.15.55:0/3799251521 >> v1:172.21.15.110:6789/0 conn(0x7f527c0cde20 legacy=0x7f527c0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:15.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.677+0000 7f5281887640 1 -- 172.21.15.55:0/3799251521 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c0cb480 con 0x7f527c0b1220 2023-08-25T05:19:15.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.677+0000 7f5282889640 1 --2- 172.21.15.55:0/3799251521 >> v2:172.21.15.110:3300/0 conn(0x7f527c0cabf0 0x7f527c0c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:19:15.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.681+0000 7f5281887640 1 --2- 172.21.15.55:0/3799251521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527c0b1220 0x7f527c0c9920 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f526c009870 tx=0x7f526c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c9b2f118e26702 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:15.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.681+0000 7f5281086640 1 -- 172.21.15.55:0/3799251521 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0ab610 con 0x7f527c0b1220 2023-08-25T05:19:15.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.681+0000 7f5281086640 1 -- 172.21.15.55:0/3799251521 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c0ab770 con 0x7f527c0b1220 2023-08-25T05:19:15.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.681+0000 7f5281086640 1 -- 172.21.15.55:0/3799251521 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0abb00 con 0x7f527c0b1220 2023-08-25T05:19:15.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.681+0000 7f52842ec640 1 -- 172.21.15.55:0/3799251521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527c0b1220 msgr2=0x7f527c0c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:15.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.681+0000 7f52842ec640 1 --2- 172.21.15.55:0/3799251521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527c0b1220 0x7f527c0c9920 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f526c009870 tx=0x7f526c01c410 comp rx=0 tx=0).stop 2023-08-25T05:19:15.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.681+0000 7f52842ec640 1 -- 172.21.15.55:0/3799251521 shutdown_connections 2023-08-25T05:19:15.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.681+0000 7f52842ec640 1 --2- 172.21.15.55:0/3799251521 >> v2:172.21.15.110:3300/0 conn(0x7f527c0cabf0 0x7f527c0c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.681+0000 7f52842ec640 1 --2- 172.21.15.55:0/3799251521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527c0b1220 0x7f527c0c9920 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.681+0000 7f52842ec640 1 -- 172.21.15.55:0/3799251521 >> 172.21.15.55:0/3799251521 conn(0x7f527c0b0700 msgr2=0x7f527c0b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:15.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.681+0000 7f52842ec640 1 -- 172.21.15.55:0/3799251521 shutdown_connections 2023-08-25T05:19:15.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.681+0000 7f52842ec640 1 -- 172.21.15.55:0/3799251521 wait complete. 2023-08-25T05:19:15.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f52842ec640 1 Processor -- start 2023-08-25T05:19:15.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f52842ec640 1 -- start start 2023-08-25T05:19:15.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f52842ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f527c0b1220 0x7f527c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:15.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f52842ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527c0cabf0 0x7f527c153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:15.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f52842ec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f527c0cde20 0x7f527c09ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:15.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f52842ec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c158d20 con 0x7f527c0cabf0 2023-08-25T05:19:15.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f52842ec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c158f90 con 0x7f527c0cde20 2023-08-25T05:19:15.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f52842ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527c159270 con 0x7f527c0b1220 2023-08-25T05:19:15.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f5281887640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527c0cabf0 0x7f527c153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:15.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f5281887640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527c0cabf0 0x7f527c153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53780/0 (socket says 172.21.15.55:53780) 2023-08-25T05:19:15.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f5281887640 1 -- 172.21.15.55:0/2772605862 learned_addr learned my addr 172.21.15.55:0/2772605862 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:15.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f5282088640 1 --2- 172.21.15.55:0/2772605862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f527c0b1220 0x7f527c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:15.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f5282889640 1 --2- 172.21.15.55:0/2772605862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f527c0cde20 0x7f527c09ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:15.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f5281887640 1 -- 172.21.15.55:0/2772605862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f527c0b1220 msgr2=0x7f527c159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:15.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f5281887640 1 --2- 172.21.15.55:0/2772605862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f527c0b1220 0x7f527c159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f5281887640 1 -- 172.21.15.55:0/2772605862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f527c0cde20 msgr2=0x7f527c09ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:15.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f5281887640 1 --2- 172.21.15.55:0/2772605862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f527c0cde20 0x7f527c09ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f5281887640 1 -- 172.21.15.55:0/2772605862 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c0094d0 con 0x7f527c0cabf0 2023-08-25T05:19:15.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f5282889640 1 --2- 172.21.15.55:0/2772605862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f527c0cde20 0x7f527c09ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:15.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f5281887640 1 --2- 172.21.15.55:0/2772605862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527c0cabf0 0x7f527c153650 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f526c0ad040 tx=0x7f526c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:15.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f5272ffd640 1 -- 172.21.15.55:0/2772605862 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0b48c0 con 0x7f527c0cabf0 2023-08-25T05:19:15.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f5272ffd640 1 -- 172.21.15.55:0/2772605862 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c0b4a40 con 0x7f527c0cabf0 2023-08-25T05:19:15.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f52842ec640 1 -- 172.21.15.55:0/2772605862 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527c159550 con 0x7f527c0cabf0 2023-08-25T05:19:15.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f5272ffd640 1 -- 172.21.15.55:0/2772605862 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0b4df0 con 0x7f527c0cabf0 2023-08-25T05:19:15.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f52842ec640 1 -- 172.21.15.55:0/2772605862 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527c159fb0 con 0x7f527c0cabf0 2023-08-25T05:19:15.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.685+0000 7f52842ec640 1 -- 172.21.15.55:0/2772605862 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527c159790 con 0x7f527c0cabf0 2023-08-25T05:19:15.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.689+0000 7f5272ffd640 1 -- 172.21.15.55:0/2772605862 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f526c0be3f0 con 0x7f527c0cabf0 2023-08-25T05:19:15.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.689+0000 7f5272ffd640 1 --2- 172.21.15.55:0/2772605862 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f52600657d0 0x7f5260067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:15.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.689+0000 7f5272ffd640 1 -- 172.21.15.55:0/2772605862 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f526c11db70 con 0x7f527c0cabf0 2023-08-25T05:19:15.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.689+0000 7f5282088640 1 --2- 172.21.15.55:0/2772605862 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f52600657d0 0x7f5260067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:15.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.689+0000 7f5282088640 1 --2- 172.21.15.55:0/2772605862 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f52600657d0 0x7f5260067c90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5278007fd0 tx=0x7f5278009040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:15.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.693+0000 7f5272ffd640 1 -- 172.21.15.55:0/2772605862 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f527c159790 con 0x7f527c0cabf0 2023-08-25T05:19:15.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.853+0000 7f52842ec640 1 -- 172.21.15.55:0/2772605862 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f527c159790 con 0x7f527c0cabf0 2023-08-25T05:19:15.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.853+0000 7f5272ffd640 1 -- 172.21.15.55:0/2772605862 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v166) v1 ==== 84+0+126 (secure 0 0 0) 0x7f527c159790 con 0x7f527c0cabf0 2023-08-25T05:19:15.856 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:15.856 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T05:19:15.856 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:15.856 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-08-25T05:19:15.856 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-08-25T05:19:15.856 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:19:15.857 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:15.857 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-08-25T05:19:15.857 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-08-25T05:19:15.857 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:15.857 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T05:19:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.853+0000 7f52842ec640 1 -- 172.21.15.55:0/2772605862 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f52600657d0 msgr2=0x7f5260067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.853+0000 7f52842ec640 1 --2- 172.21.15.55:0/2772605862 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f52600657d0 0x7f5260067c90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5278007fd0 tx=0x7f5278009040 comp rx=0 tx=0).stop 2023-08-25T05:19:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.853+0000 7f52842ec640 1 -- 172.21.15.55:0/2772605862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527c0cabf0 msgr2=0x7f527c153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.853+0000 7f52842ec640 1 --2- 172.21.15.55:0/2772605862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527c0cabf0 0x7f527c153650 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f526c0ad040 tx=0x7f526c01ac50 comp rx=0 tx=0).stop 2023-08-25T05:19:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.853+0000 7f52842ec640 1 -- 172.21.15.55:0/2772605862 shutdown_connections 2023-08-25T05:19:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.853+0000 7f52842ec640 1 --2- 172.21.15.55:0/2772605862 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f52600657d0 0x7f5260067c90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.853+0000 7f52842ec640 1 --2- 172.21.15.55:0/2772605862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f527c0cde20 0x7f527c09ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.853+0000 7f52842ec640 1 --2- 172.21.15.55:0/2772605862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f527c0cabf0 0x7f527c153650 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.853+0000 7f52842ec640 1 --2- 172.21.15.55:0/2772605862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f527c0b1220 0x7f527c159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.853+0000 7f52842ec640 1 -- 172.21.15.55:0/2772605862 >> 172.21.15.55:0/2772605862 conn(0x7f527c0b0700 msgr2=0x7f527c06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.853+0000 7f52842ec640 1 -- 172.21.15.55:0/2772605862 shutdown_connections 2023-08-25T05:19:15.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:15.853+0000 7f52842ec640 1 -- 172.21.15.55:0/2772605862 wait complete. 2023-08-25T05:19:15.877 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-25T05:19:15.877 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-25T05:19:16.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.021+0000 7fb85ae19640 1 Processor -- start 2023-08-25T05:19:16.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.021+0000 7fb85ae19640 1 -- start start 2023-08-25T05:19:16.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.021+0000 7fb85ae19640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb854155360 0x7fb85415c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:16.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.021+0000 7fb85ae19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb854155740 0x7fb85415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:16.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.021+0000 7fb85ae19640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85415fa50 con 0x7fb85406fb50 2023-08-25T05:19:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.021+0000 7fb85ae19640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85415f490 con 0x7fb854155360 2023-08-25T05:19:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.021+0000 7fb85ae19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85415f770 con 0x7fb854155740 2023-08-25T05:19:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.021+0000 7fb858bb5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb854155360 0x7fb85415c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.021+0000 7fb858bb5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb854155360 0x7fb85415c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53788/0 (socket says 172.21.15.55:53788) 2023-08-25T05:19:16.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.021+0000 7fb858bb5640 1 -- 172.21.15.55:0/2088814823 learned_addr learned my addr 172.21.15.55:0/2088814823 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:16.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.025+0000 7fb858bb5640 1 -- 172.21.15.55:0/2088814823 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb854155740 msgr2=0x7fb85415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:16.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.025+0000 7fb84bfff640 1 --2- 172.21.15.55:0/2088814823 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb854155740 0x7fb85415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:16.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.025+0000 7fb858bb5640 1 --2- 172.21.15.55:0/2088814823 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb854155740 0x7fb85415eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:16.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.025+0000 7fb858bb5640 1 -- 172.21.15.55:0/2088814823 >> v1:172.21.15.110:6789/0 conn(0x7fb85406fb50 legacy=0x7fb8540aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:16.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.025+0000 7fb858bb5640 1 -- 172.21.15.55:0/2088814823 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8540ccb40 con 0x7fb854155360 2023-08-25T05:19:16.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.025+0000 7fb84bfff640 1 --2- 172.21.15.55:0/2088814823 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb854155740 0x7fb85415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:19:16.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.025+0000 7fb858bb5640 1 --2- 172.21.15.55:0/2088814823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854155360 0x7fb85415c180 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fb850009870 tx=0x7fb85001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8794290a020df74 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:16.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.025+0000 7fb84b7fe640 1 -- 172.21.15.55:0/2088814823 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8500ab600 con 0x7fb854155360 2023-08-25T05:19:16.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.025+0000 7fb84b7fe640 1 -- 172.21.15.55:0/2088814823 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8500a7050 con 0x7fb854155360 2023-08-25T05:19:16.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.025+0000 7fb84b7fe640 1 -- 172.21.15.55:0/2088814823 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8500ab980 con 0x7fb854155360 2023-08-25T05:19:16.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.025+0000 7fb85ae19640 1 -- 172.21.15.55:0/2088814823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854155360 msgr2=0x7fb85415c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:16.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.025+0000 7fb85ae19640 1 --2- 172.21.15.55:0/2088814823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854155360 0x7fb85415c180 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fb850009870 tx=0x7fb85001c3e0 comp rx=0 tx=0).stop 2023-08-25T05:19:16.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb85ae19640 1 -- 172.21.15.55:0/2088814823 shutdown_connections 2023-08-25T05:19:16.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb85ae19640 1 --2- 172.21.15.55:0/2088814823 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb854155740 0x7fb85415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:16.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb85ae19640 1 --2- 172.21.15.55:0/2088814823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb854155360 0x7fb85415c180 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:16.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb85ae19640 1 -- 172.21.15.55:0/2088814823 >> 172.21.15.55:0/2088814823 conn(0x7fb8540caf90 msgr2=0x7fb8540cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:16.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb85ae19640 1 -- 172.21.15.55:0/2088814823 shutdown_connections 2023-08-25T05:19:16.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb85ae19640 1 -- 172.21.15.55:0/2088814823 wait complete. 2023-08-25T05:19:16.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb85ae19640 1 Processor -- start 2023-08-25T05:19:16.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb85ae19640 1 -- start start 2023-08-25T05:19:16.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb85ae19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85406fb50 0x7fb85414e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:16.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb85ae19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb854155360 0x7fb85415d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:16.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb85ae19640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb854155740 0x7fb85415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:16.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb85ae19640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85414ec90 con 0x7fb85406fb50 2023-08-25T05:19:16.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb85ae19640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb854157230 con 0x7fb854155740 2023-08-25T05:19:16.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb85ae19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb854157510 con 0x7fb854155360 2023-08-25T05:19:16.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb858bb5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85406fb50 0x7fb85414e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:16.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb858bb5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85406fb50 0x7fb85414e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53796/0 (socket says 172.21.15.55:53796) 2023-08-25T05:19:16.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb858bb5640 1 -- 172.21.15.55:0/58020206 learned_addr learned my addr 172.21.15.55:0/58020206 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:16.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb8593b6640 1 --2- 172.21.15.55:0/58020206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb854155740 0x7fb85415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:16.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb84bfff640 1 --2- 172.21.15.55:0/58020206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb854155360 0x7fb85415d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:16.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb858bb5640 1 -- 172.21.15.55:0/58020206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb854155360 msgr2=0x7fb85415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:16.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb858bb5640 1 --2- 172.21.15.55:0/58020206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb854155360 0x7fb85415d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:16.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb858bb5640 1 -- 172.21.15.55:0/58020206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb854155740 msgr2=0x7fb85415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:16.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb858bb5640 1 --2- 172.21.15.55:0/58020206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb854155740 0x7fb85415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:16.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb858bb5640 1 -- 172.21.15.55:0/58020206 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8500094d0 con 0x7fb85406fb50 2023-08-25T05:19:16.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.029+0000 7fb858bb5640 1 --2- 172.21.15.55:0/58020206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85406fb50 0x7fb85414e750 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fb8500ae040 tx=0x7fb85001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:16.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.033+0000 7fb8497fa640 1 -- 172.21.15.55:0/58020206 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8500b6620 con 0x7fb85406fb50 2023-08-25T05:19:16.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.033+0000 7fb8497fa640 1 -- 172.21.15.55:0/58020206 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8500b67a0 con 0x7fb85406fb50 2023-08-25T05:19:16.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.033+0000 7fb8497fa640 1 -- 172.21.15.55:0/58020206 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8500b6b50 con 0x7fb85406fb50 2023-08-25T05:19:16.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.033+0000 7fb85ae19640 1 -- 172.21.15.55:0/58020206 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8541577f0 con 0x7fb85406fb50 2023-08-25T05:19:16.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.033+0000 7fb85ae19640 1 -- 172.21.15.55:0/58020206 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb854156f30 con 0x7fb85406fb50 2023-08-25T05:19:16.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.033+0000 7fb85ae19640 1 -- 172.21.15.55:0/58020206 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85404dbe0 con 0x7fb85406fb50 2023-08-25T05:19:16.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.033+0000 7fb8497fa640 1 -- 172.21.15.55:0/58020206 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fb8500b2040 con 0x7fb85406fb50 2023-08-25T05:19:16.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.033+0000 7fb8497fa640 1 --2- 172.21.15.55:0/58020206 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fb8400657d0 0x7fb840067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:16.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.033+0000 7fb8497fa640 1 -- 172.21.15.55:0/58020206 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb85011d2d0 con 0x7fb85406fb50 2023-08-25T05:19:16.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.033+0000 7fb84bfff640 1 --2- 172.21.15.55:0/58020206 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fb8400657d0 0x7fb840067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:16.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.037+0000 7fb84bfff640 1 --2- 172.21.15.55:0/58020206 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fb8400657d0 0x7fb840067c90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb8540c93d0 tx=0x7fb844008040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:16.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.037+0000 7fb8497fa640 1 -- 172.21.15.55:0/58020206 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb8500eaed0 con 0x7fb85406fb50 2023-08-25T05:19:16.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:16.197+0000 7fb85ae19640 1 -- 172.21.15.55:0/58020206 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb8540cc5c0 con 0x7fb85406fb50 2023-08-25T05:19:17.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.065+0000 7fb8497fa640 1 -- 172.21.15.55:0/58020206 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v167) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb8500ee4f0 con 0x7fb85406fb50 2023-08-25T05:19:17.067 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-08-25T05:19:17.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.069+0000 7fb85ae19640 1 -- 172.21.15.55:0/58020206 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fb8400657d0 msgr2=0x7fb840067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:17.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.069+0000 7fb85ae19640 1 --2- 172.21.15.55:0/58020206 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fb8400657d0 0x7fb840067c90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb8540c93d0 tx=0x7fb844008040 comp rx=0 tx=0).stop 2023-08-25T05:19:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.069+0000 7fb85ae19640 1 -- 172.21.15.55:0/58020206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85406fb50 msgr2=0x7fb85414e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.069+0000 7fb85ae19640 1 --2- 172.21.15.55:0/58020206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85406fb50 0x7fb85414e750 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fb8500ae040 tx=0x7fb85001ac20 comp rx=0 tx=0).stop 2023-08-25T05:19:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.069+0000 7fb85ae19640 1 -- 172.21.15.55:0/58020206 shutdown_connections 2023-08-25T05:19:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.069+0000 7fb85ae19640 1 --2- 172.21.15.55:0/58020206 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fb8400657d0 0x7fb840067c90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:17.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.069+0000 7fb85ae19640 1 --2- 172.21.15.55:0/58020206 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb854155740 0x7fb85415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:17.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.069+0000 7fb85ae19640 1 --2- 172.21.15.55:0/58020206 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb854155360 0x7fb85415d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:17.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.069+0000 7fb85ae19640 1 --2- 172.21.15.55:0/58020206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb85406fb50 0x7fb85414e750 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:17.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.069+0000 7fb85ae19640 1 -- 172.21.15.55:0/58020206 >> 172.21.15.55:0/58020206 conn(0x7fb8540caf90 msgr2=0x7fb8540cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:17.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.069+0000 7fb85ae19640 1 -- 172.21.15.55:0/58020206 shutdown_connections 2023-08-25T05:19:17.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.069+0000 7fb85ae19640 1 -- 172.21.15.55:0/58020206 wait complete. 2023-08-25T05:19:17.096 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-25T05:19:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.249+0000 7fdb9125c640 1 Processor -- start 2023-08-25T05:19:17.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.249+0000 7fdb9125c640 1 -- start start 2023-08-25T05:19:17.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.249+0000 7fdb9125c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb8c06c3b0 0x7fdb8c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:17.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.249+0000 7fdb9125c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdb8c06c790 0x7fdb8c06de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:17.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.249+0000 7fdb9125c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb8c0cab90 con 0x7fdb8c0d1060 2023-08-25T05:19:17.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.249+0000 7fdb9125c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb8c06dbb0 con 0x7fdb8c06c790 2023-08-25T05:19:17.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.249+0000 7fdb9125c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c0cae50 con 0x7fdb8c06c3b0 2023-08-25T05:19:17.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.249+0000 7fdb8a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdb8c06c790 0x7fdb8c06de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:17.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.249+0000 7fdb8a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdb8c06c790 0x7fdb8c06de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53812/0 (socket says 172.21.15.55:53812) 2023-08-25T05:19:17.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.249+0000 7fdb8a59c640 1 -- 172.21.15.55:0/2689415975 learned_addr learned my addr 172.21.15.55:0/2689415975 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:17.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.249+0000 7fdb8ad9d640 1 --2- 172.21.15.55:0/2689415975 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb8c06c3b0 0x7fdb8c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:17.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.249+0000 7fdb8a59c640 1 -- 172.21.15.55:0/2689415975 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb8c06c3b0 msgr2=0x7fdb8c0cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:17.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.249+0000 7fdb8a59c640 1 --2- 172.21.15.55:0/2689415975 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb8c06c3b0 0x7fdb8c0cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:17.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.249+0000 7fdb8a59c640 1 -- 172.21.15.55:0/2689415975 >> v1:172.21.15.110:6789/0 conn(0x7fdb8c0d1060 legacy=0x7fdb8c15c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:17.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.249+0000 7fdb8a59c640 1 -- 172.21.15.55:0/2689415975 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8c0cb130 con 0x7fdb8c06c790 2023-08-25T05:19:17.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.253+0000 7fdb8a59c640 1 --2- 172.21.15.55:0/2689415975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb8c06c790 0x7fdb8c06de90 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009870 tx=0x7fdb8001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65a8c0cfbd739b00 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:17.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.253+0000 7fdb89d9b640 1 -- 172.21.15.55:0/2689415975 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb800ab620 con 0x7fdb8c06c790 2023-08-25T05:19:17.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.253+0000 7fdb89d9b640 1 -- 172.21.15.55:0/2689415975 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb800ab780 con 0x7fdb8c06c790 2023-08-25T05:19:17.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.253+0000 7fdb89d9b640 1 -- 172.21.15.55:0/2689415975 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb800abb10 con 0x7fdb8c06c790 2023-08-25T05:19:17.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.253+0000 7fdb9125c640 1 -- 172.21.15.55:0/2689415975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb8c06c790 msgr2=0x7fdb8c06de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:17.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.253+0000 7fdb9125c640 1 --2- 172.21.15.55:0/2689415975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb8c06c790 0x7fdb8c06de90 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009870 tx=0x7fdb8001c510 comp rx=0 tx=0).stop 2023-08-25T05:19:17.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.253+0000 7fdb9125c640 1 -- 172.21.15.55:0/2689415975 shutdown_connections 2023-08-25T05:19:17.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.253+0000 7fdb9125c640 1 --2- 172.21.15.55:0/2689415975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb8c06c790 0x7fdb8c06de90 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:17.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.253+0000 7fdb9125c640 1 --2- 172.21.15.55:0/2689415975 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb8c06c3b0 0x7fdb8c0cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:17.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.253+0000 7fdb9125c640 1 -- 172.21.15.55:0/2689415975 >> 172.21.15.55:0/2689415975 conn(0x7fdb8c0d0540 msgr2=0x7fdb8c0d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:17.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.253+0000 7fdb9125c640 1 -- 172.21.15.55:0/2689415975 shutdown_connections 2023-08-25T05:19:17.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.253+0000 7fdb9125c640 1 -- 172.21.15.55:0/2689415975 wait complete. 2023-08-25T05:19:17.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb9125c640 1 Processor -- start 2023-08-25T05:19:17.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb9125c640 1 -- start start 2023-08-25T05:19:17.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb9125c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb8c06c3b0 0x7fdb8c0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:17.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb9125c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb8c06c790 0x7fdb8c153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:17.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb9125c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb8c0d1060 0x7fdb8c14ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:17.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb9125c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c151d90 con 0x7fdb8c0d1060 2023-08-25T05:19:17.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb9125c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c1537f0 con 0x7fdb8c06c3b0 2023-08-25T05:19:17.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb9125c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c0ca470 con 0x7fdb8c06c790 2023-08-25T05:19:17.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb8b59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb8c0d1060 0x7fdb8c14ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:17.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb8b59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb8c0d1060 0x7fdb8c14ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53820/0 (socket says 172.21.15.55:53820) 2023-08-25T05:19:17.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb8b59e640 1 -- 172.21.15.55:0/2087922327 learned_addr learned my addr 172.21.15.55:0/2087922327 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:17.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb8a59c640 1 --2- 172.21.15.55:0/2087922327 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb8c06c790 0x7fdb8c153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:17.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb8ad9d640 1 --2- 172.21.15.55:0/2087922327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb8c06c3b0 0x7fdb8c0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:17.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb8b59e640 1 -- 172.21.15.55:0/2087922327 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb8c06c790 msgr2=0x7fdb8c153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:17.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb8b59e640 1 --2- 172.21.15.55:0/2087922327 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb8c06c790 0x7fdb8c153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:17.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb8b59e640 1 -- 172.21.15.55:0/2087922327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb8c06c3b0 msgr2=0x7fdb8c0c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:17.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb8b59e640 1 --2- 172.21.15.55:0/2087922327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb8c06c3b0 0x7fdb8c0c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:17.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb8b59e640 1 -- 172.21.15.55:0/2087922327 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb800094d0 con 0x7fdb8c0d1060 2023-08-25T05:19:17.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb8b59e640 1 --2- 172.21.15.55:0/2087922327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb8c0d1060 0x7fdb8c14ecd0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400c730 tx=0x7fdb8400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:17.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb737fe640 1 -- 172.21.15.55:0/2087922327 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb84003b80 con 0x7fdb8c0d1060 2023-08-25T05:19:17.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb737fe640 1 -- 172.21.15.55:0/2087922327 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb84003ce0 con 0x7fdb8c0d1060 2023-08-25T05:19:17.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb9125c640 1 -- 172.21.15.55:0/2087922327 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb8c152be0 con 0x7fdb8c0d1060 2023-08-25T05:19:17.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb737fe640 1 -- 172.21.15.55:0/2087922327 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8400aa30 con 0x7fdb8c0d1060 2023-08-25T05:19:17.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb9125c640 1 -- 172.21.15.55:0/2087922327 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8c1531a0 con 0x7fdb8c0d1060 2023-08-25T05:19:17.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.257+0000 7fdb9125c640 1 -- 172.21.15.55:0/2087922327 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb8c153960 con 0x7fdb8c0d1060 2023-08-25T05:19:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.261+0000 7fdb737fe640 1 -- 172.21.15.55:0/2087922327 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fdb8400ab90 con 0x7fdb8c0d1060 2023-08-25T05:19:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.261+0000 7fdb737fe640 1 --2- 172.21.15.55:0/2087922327 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fdb780657a0 0x7fdb78067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.261+0000 7fdb737fe640 1 -- 172.21.15.55:0/2087922327 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fdb84083500 con 0x7fdb8c0d1060 2023-08-25T05:19:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.261+0000 7fdb8ad9d640 1 --2- 172.21.15.55:0/2087922327 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fdb780657a0 0x7fdb78067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.261+0000 7fdb8ad9d640 1 --2- 172.21.15.55:0/2087922327 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fdb780657a0 0x7fdb78067c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009b40 tx=0x7fdb7c006f90 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.265+0000 7fdb737fe640 1 -- 172.21.15.55:0/2087922327 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fdb84051120 con 0x7fdb8c0d1060 2023-08-25T05:19:17.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:17.421+0000 7fdb9125c640 1 -- 172.21.15.55:0/2087922327 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdb8c073ec0 con 0x7fdb8c0d1060 2023-08-25T05:19:18.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.077+0000 7fdb737fe640 1 -- 172.21.15.55:0/2087922327 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v168) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdb84054740 con 0x7fdb8c0d1060 2023-08-25T05:19:18.079 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-08-25T05:19:18.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.085+0000 7fdb9125c640 1 -- 172.21.15.55:0/2087922327 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fdb780657a0 msgr2=0x7fdb78067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:18.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.085+0000 7fdb9125c640 1 --2- 172.21.15.55:0/2087922327 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fdb780657a0 0x7fdb78067c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009b40 tx=0x7fdb7c006f90 comp rx=0 tx=0).stop 2023-08-25T05:19:18.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.085+0000 7fdb9125c640 1 -- 172.21.15.55:0/2087922327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb8c0d1060 msgr2=0x7fdb8c14ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:18.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.085+0000 7fdb9125c640 1 --2- 172.21.15.55:0/2087922327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb8c0d1060 0x7fdb8c14ecd0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400c730 tx=0x7fdb8400cbf0 comp rx=0 tx=0).stop 2023-08-25T05:19:18.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.085+0000 7fdb9125c640 1 -- 172.21.15.55:0/2087922327 shutdown_connections 2023-08-25T05:19:18.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.085+0000 7fdb9125c640 1 --2- 172.21.15.55:0/2087922327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb8c0d1060 0x7fdb8c14ecd0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:18.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.085+0000 7fdb9125c640 1 --2- 172.21.15.55:0/2087922327 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdb8c06c790 0x7fdb8c153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:18.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.085+0000 7fdb9125c640 1 --2- 172.21.15.55:0/2087922327 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fdb780657a0 0x7fdb78067c60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:18.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.085+0000 7fdb9125c640 1 --2- 172.21.15.55:0/2087922327 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdb8c06c3b0 0x7fdb8c0c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:18.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.085+0000 7fdb9125c640 1 -- 172.21.15.55:0/2087922327 >> 172.21.15.55:0/2087922327 conn(0x7fdb8c0d0540 msgr2=0x7fdb8c0d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:18.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.089+0000 7fdb9125c640 1 -- 172.21.15.55:0/2087922327 shutdown_connections 2023-08-25T05:19:18.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.089+0000 7fdb9125c640 1 -- 172.21.15.55:0/2087922327 wait complete. 2023-08-25T05:19:18.120 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-25T05:19:18.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.265+0000 7f57d9f03640 1 Processor -- start 2023-08-25T05:19:18.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.265+0000 7f57d9f03640 1 -- start start 2023-08-25T05:19:18.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.265+0000 7f57d9f03640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57d406c020 0x7f57d409bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:18.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.265+0000 7f57d9f03640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d415abd0 con 0x7f57d415a7f0 2023-08-25T05:19:18.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.265+0000 7f57d9f03640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d40c8ab0 con 0x7f57d40c9830 2023-08-25T05:19:18.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.265+0000 7f57d9f03640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d40c8d50 con 0x7f57d406c020 2023-08-25T05:19:18.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.265+0000 7f57d37fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f57d415a7f0 0x7f57d4070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58548/0 (socket says 172.21.15.55:58548) 2023-08-25T05:19:18.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.265+0000 7f57d37fe640 1 -- 172.21.15.55:0/3948680030 learned_addr learned my addr 172.21.15.55:0/3948680030 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:18.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.265+0000 7f57d3fff640 1 --2- 172.21.15.55:0/3948680030 >> v2:172.21.15.55:3300/0 conn(0x7f57d406c020 0x7f57d409bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:18.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.265+0000 7f57d2ffd640 1 -- 172.21.15.55:0/3948680030 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767044406 0 0) 0x7f57d415abd0 con 0x7f57d415a7f0 2023-08-25T05:19:18.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.265+0000 7f57d2ffd640 1 -- 172.21.15.55:0/3948680030 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57c0003530 con 0x7f57d415a7f0 2023-08-25T05:19:18.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.265+0000 7f57d3fff640 1 -- 172.21.15.55:0/3948680030 >> v1:172.21.15.110:6789/0 conn(0x7f57d40c9830 legacy=0x7f57d40acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:18.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.265+0000 7f57d3fff640 1 -- 172.21.15.55:0/3948680030 >> v1:172.21.15.55:6789/0 conn(0x7f57d415a7f0 legacy=0x7f57d4070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:18.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.265+0000 7f57d3fff640 1 -- 172.21.15.55:0/3948680030 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d40c9030 con 0x7f57d406c020 2023-08-25T05:19:18.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.269+0000 7f57d3fff640 1 --2- 172.21.15.55:0/3948680030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57d406c020 0x7f57d409bde0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009d90 tx=0x7f57cc01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0db648823e00e09 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:18.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.269+0000 7f57d2ffd640 1 -- 172.21.15.55:0/3948680030 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc0a58b0 con 0x7f57d406c020 2023-08-25T05:19:18.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.269+0000 7f57d2ffd640 1 -- 172.21.15.55:0/3948680030 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc0a5a10 con 0x7f57d406c020 2023-08-25T05:19:18.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.269+0000 7f57d2ffd640 1 -- 172.21.15.55:0/3948680030 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc0a5d80 con 0x7f57d406c020 2023-08-25T05:19:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.269+0000 7f57d9f03640 1 -- 172.21.15.55:0/3948680030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57d406c020 msgr2=0x7f57d409bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.269+0000 7f57d9f03640 1 --2- 172.21.15.55:0/3948680030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57d406c020 0x7f57d409bde0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009d90 tx=0x7f57cc01c8e0 comp rx=0 tx=0).stop 2023-08-25T05:19:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.269+0000 7f57d9f03640 1 -- 172.21.15.55:0/3948680030 shutdown_connections 2023-08-25T05:19:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.269+0000 7f57d9f03640 1 --2- 172.21.15.55:0/3948680030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57d406c020 0x7f57d409bde0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.269+0000 7f57d9f03640 1 -- 172.21.15.55:0/3948680030 >> 172.21.15.55:0/3948680030 conn(0x7f57d4069900 msgr2=0x7f57d4069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.269+0000 7f57d9f03640 1 -- 172.21.15.55:0/3948680030 shutdown_connections 2023-08-25T05:19:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.269+0000 7f57d9f03640 1 -- 172.21.15.55:0/3948680030 wait complete. 2023-08-25T05:19:18.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57d9f03640 1 Processor -- start 2023-08-25T05:19:18.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57d9f03640 1 -- start start 2023-08-25T05:19:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57d9f03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57d406c020 0x7f57d4152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57d9f03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57d40c9830 0x7f57d40cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57d9f03640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57d415a7f0 0x7f57d41537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57d9f03640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d40b0fb0 con 0x7f57d40c9830 2023-08-25T05:19:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57d9f03640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d40b1b30 con 0x7f57d415a7f0 2023-08-25T05:19:18.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57d9f03640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d41637c0 con 0x7f57d406c020 2023-08-25T05:19:18.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57cbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57d40c9830 0x7f57d40cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:18.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57cbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57d40c9830 0x7f57d40cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53834/0 (socket says 172.21.15.55:53834) 2023-08-25T05:19:18.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57cbfff640 1 -- 172.21.15.55:0/2150887259 learned_addr learned my addr 172.21.15.55:0/2150887259 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:18.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57d37fe640 1 --2- 172.21.15.55:0/2150887259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57d406c020 0x7f57d4152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:18.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57d3fff640 1 --2- 172.21.15.55:0/2150887259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57d415a7f0 0x7f57d41537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57cbfff640 1 -- 172.21.15.55:0/2150887259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57d406c020 msgr2=0x7f57d4152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57cbfff640 1 --2- 172.21.15.55:0/2150887259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57d406c020 0x7f57d4152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57cbfff640 1 -- 172.21.15.55:0/2150887259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57d415a7f0 msgr2=0x7f57d41537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57cbfff640 1 --2- 172.21.15.55:0/2150887259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57d415a7f0 0x7f57d41537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57cbfff640 1 -- 172.21.15.55:0/2150887259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc009a70 con 0x7f57d40c9830 2023-08-25T05:19:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57cbfff640 1 --2- 172.21.15.55:0/2150887259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57d40c9830 0x7f57d40cd870 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00b410 tx=0x7f57bc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57d0ff9640 1 -- 172.21.15.55:0/2150887259 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc004020 con 0x7f57d40c9830 2023-08-25T05:19:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57d0ff9640 1 -- 172.21.15.55:0/2150887259 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc004180 con 0x7f57d40c9830 2023-08-25T05:19:18.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57d0ff9640 1 -- 172.21.15.55:0/2150887259 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc011630 con 0x7f57d40c9830 2023-08-25T05:19:18.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57d9f03640 1 -- 172.21.15.55:0/2150887259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d40adc90 con 0x7f57d40c9830 2023-08-25T05:19:18.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.273+0000 7f57d9f03640 1 -- 172.21.15.55:0/2150887259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d40b14e0 con 0x7f57d40c9830 2023-08-25T05:19:18.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.277+0000 7f57d9f03640 1 -- 172.21.15.55:0/2150887259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d406d5b0 con 0x7f57d40c9830 2023-08-25T05:19:18.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.277+0000 7f57d0ff9640 1 -- 172.21.15.55:0/2150887259 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f57bc011790 con 0x7f57d40c9830 2023-08-25T05:19:18.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.277+0000 7f57d0ff9640 1 --2- 172.21.15.55:0/2150887259 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f57b40657d0 0x7f57b4067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:18.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.277+0000 7f57d0ff9640 1 -- 172.21.15.55:0/2150887259 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f57bc083300 con 0x7f57d40c9830 2023-08-25T05:19:18.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.277+0000 7f57d37fe640 1 --2- 172.21.15.55:0/2150887259 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f57b40657d0 0x7f57b4067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:18.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.277+0000 7f57d37fe640 1 --2- 172.21.15.55:0/2150887259 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f57b40657d0 0x7f57b4067c90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f57c4001370 tx=0x7f57c4009040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:18.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.281+0000 7f57d0ff9640 1 -- 172.21.15.55:0/2150887259 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f57bc050e30 con 0x7f57d40c9830 2023-08-25T05:19:18.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:18.473+0000 7f57d9f03640 1 -- 172.21.15.55:0/2150887259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f57d40b1ca0 con 0x7f57d40c9830 2023-08-25T05:19:19.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.093+0000 7f57d0ff9640 1 -- 172.21.15.55:0/2150887259 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v79) v1 ==== 174+0+0 (secure 0 0 0) 0x7f57bc054450 con 0x7f57d40c9830 2023-08-25T05:19:19.107 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 21 and data pool 22 2023-08-25T05:19:19.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.113+0000 7f57d9f03640 1 -- 172.21.15.55:0/2150887259 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f57b40657d0 msgr2=0x7f57b4067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.113+0000 7f57d9f03640 1 --2- 172.21.15.55:0/2150887259 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f57b40657d0 0x7f57b4067c90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f57c4001370 tx=0x7f57c4009040 comp rx=0 tx=0).stop 2023-08-25T05:19:19.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.113+0000 7f57d9f03640 1 -- 172.21.15.55:0/2150887259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57d40c9830 msgr2=0x7f57d40cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.113+0000 7f57d9f03640 1 --2- 172.21.15.55:0/2150887259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57d40c9830 0x7f57d40cd870 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00b410 tx=0x7f57bc00b8d0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.113+0000 7f57d9f03640 1 -- 172.21.15.55:0/2150887259 shutdown_connections 2023-08-25T05:19:19.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.113+0000 7f57d9f03640 1 --2- 172.21.15.55:0/2150887259 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f57b40657d0 0x7f57b4067c90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.113+0000 7f57d9f03640 1 --2- 172.21.15.55:0/2150887259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57d415a7f0 0x7f57d41537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.113+0000 7f57d9f03640 1 --2- 172.21.15.55:0/2150887259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57d40c9830 0x7f57d40cd870 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.113+0000 7f57d9f03640 1 --2- 172.21.15.55:0/2150887259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57d406c020 0x7f57d4152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.113+0000 7f57d9f03640 1 -- 172.21.15.55:0/2150887259 >> 172.21.15.55:0/2150887259 conn(0x7f57d4069900 msgr2=0x7f57d4070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:19.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.117+0000 7f57d9f03640 1 -- 172.21.15.55:0/2150887259 shutdown_connections 2023-08-25T05:19:19.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.117+0000 7f57d9f03640 1 -- 172.21.15.55:0/2150887259 wait complete. 2023-08-25T05:19:19.144 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:19:19.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.289+0000 7ff381767640 1 Processor -- start 2023-08-25T05:19:19.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.289+0000 7ff381767640 1 -- start start 2023-08-25T05:19:19.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.289+0000 7ff381767640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff37c0b4510 0x7ff37c0b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:19.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.289+0000 7ff381767640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37c0b1b90 con 0x7ff37c0b4080 2023-08-25T05:19:19.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.289+0000 7ff381767640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37c0b1f20 con 0x7ff37c160120 2023-08-25T05:19:19.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.289+0000 7ff381767640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff37c0b49a0 con 0x7ff37c0b4510 2023-08-25T05:19:19.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.289+0000 7ff3727fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff37c0b4080 0x7ff37c0b23b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58560/0 (socket says 172.21.15.55:58560) 2023-08-25T05:19:19.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.289+0000 7ff3727fc640 1 -- 172.21.15.55:0/2920954345 learned_addr learned my addr 172.21.15.55:0/2920954345 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.289+0000 7ff37b7fe640 1 --2- 172.21.15.55:0/2920954345 >> v2:172.21.15.110:3300/0 conn(0x7ff37c0b4510 0x7ff37c0b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.289+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2920954345 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839426658 0 0) 0x7ff364001120 con 0x7ff37c0b4080 2023-08-25T05:19:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.289+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2920954345 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff368003530 con 0x7ff37c0b4080 2023-08-25T05:19:19.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.289+0000 7ff37b7fe640 1 -- 172.21.15.55:0/2920954345 >> v1:172.21.15.110:6789/0 conn(0x7ff37c160120 legacy=0x7ff37c0b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.289+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2920954345 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389708528 0 0) 0x7ff37c0b1f20 con 0x7ff37c160120 2023-08-25T05:19:19.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.289+0000 7ff37b7fe640 1 -- 172.21.15.55:0/2920954345 >> v1:172.21.15.55:6789/0 conn(0x7ff37c0b4080 legacy=0x7ff37c0b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.289+0000 7ff37b7fe640 1 -- 172.21.15.55:0/2920954345 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c0cddf0 con 0x7ff37c0b4510 2023-08-25T05:19:19.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.293+0000 7ff37b7fe640 1 --2- 172.21.15.55:0/2920954345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0b4510 0x7ff37c0b2ac0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ff374009dc0 tx=0x7ff37401c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73d88ed64db2cc94 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:19.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.293+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2920954345 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3740a59c0 con 0x7ff37c0b4510 2023-08-25T05:19:19.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.293+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2920954345 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3740a5b20 con 0x7ff37c0b4510 2023-08-25T05:19:19.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.293+0000 7ff37a7fc640 1 -- 172.21.15.55:0/2920954345 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3740ad440 con 0x7ff37c0b4510 2023-08-25T05:19:19.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.293+0000 7ff381767640 1 -- 172.21.15.55:0/2920954345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0b4510 msgr2=0x7ff37c0b2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.293+0000 7ff381767640 1 --2- 172.21.15.55:0/2920954345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0b4510 0x7ff37c0b2ac0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ff374009dc0 tx=0x7ff37401c900 comp rx=0 tx=0).stop 2023-08-25T05:19:19.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.293+0000 7ff381767640 1 -- 172.21.15.55:0/2920954345 shutdown_connections 2023-08-25T05:19:19.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.293+0000 7ff381767640 1 --2- 172.21.15.55:0/2920954345 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0b4510 0x7ff37c0b2ac0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.293+0000 7ff381767640 1 -- 172.21.15.55:0/2920954345 >> 172.21.15.55:0/2920954345 conn(0x7ff37c09b950 msgr2=0x7ff37c0d2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:19.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.293+0000 7ff381767640 1 -- 172.21.15.55:0/2920954345 shutdown_connections 2023-08-25T05:19:19.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.293+0000 7ff381767640 1 -- 172.21.15.55:0/2920954345 wait complete. 2023-08-25T05:19:19.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff381767640 1 Processor -- start 2023-08-25T05:19:19.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff381767640 1 -- start start 2023-08-25T05:19:19.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff381767640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff37c0b4080 0x7ff37c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:19.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff381767640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0b4510 0x7ff37c14c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:19.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff381767640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c160120 0x7ff37c155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:19.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff381767640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c0cae50 con 0x7ff37c0b4080 2023-08-25T05:19:19.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff381767640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c157c00 con 0x7ff37c0b4510 2023-08-25T05:19:19.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff381767640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c0c9a00 con 0x7ff37c160120 2023-08-25T05:19:19.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff37affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff37c0b4080 0x7ff37c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:19.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff37affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff37c0b4080 0x7ff37c1568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53850/0 (socket says 172.21.15.55:53850) 2023-08-25T05:19:19.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff37affd640 1 -- 172.21.15.55:0/3610929307 learned_addr learned my addr 172.21.15.55:0/3610929307 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:19.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff37affd640 1 -- 172.21.15.55:0/3610929307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c160120 msgr2=0x7ff37c155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff37affd640 1 --2- 172.21.15.55:0/3610929307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c160120 0x7ff37c155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff37affd640 1 -- 172.21.15.55:0/3610929307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0b4510 msgr2=0x7ff37c14c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff37affd640 1 --2- 172.21.15.55:0/3610929307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0b4510 0x7ff37c14c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff37affd640 1 -- 172.21.15.55:0/3610929307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff374009a70 con 0x7ff37c0b4080 2023-08-25T05:19:19.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff37affd640 1 --2- 172.21.15.55:0/3610929307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff37c0b4080 0x7ff37c1568c0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00c440 tx=0x7ff36c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:19.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff373fff640 1 -- 172.21.15.55:0/3610929307 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c005480 con 0x7ff37c0b4080 2023-08-25T05:19:19.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff373fff640 1 -- 172.21.15.55:0/3610929307 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c003650 con 0x7ff37c0b4080 2023-08-25T05:19:19.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff381767640 1 -- 172.21.15.55:0/3610929307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37c156e00 con 0x7ff37c0b4080 2023-08-25T05:19:19.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff373fff640 1 -- 172.21.15.55:0/3610929307 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c003a00 con 0x7ff37c0b4080 2023-08-25T05:19:19.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff381767640 1 -- 172.21.15.55:0/3610929307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37c157640 con 0x7ff37c0b4080 2023-08-25T05:19:19.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.297+0000 7ff381767640 1 -- 172.21.15.55:0/3610929307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff37c073e50 con 0x7ff37c0b4080 2023-08-25T05:19:19.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.301+0000 7ff373fff640 1 -- 172.21.15.55:0/3610929307 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7ff36c003b60 con 0x7ff37c0b4080 2023-08-25T05:19:19.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.301+0000 7ff373fff640 1 --2- 172.21.15.55:0/3610929307 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7ff35c0657a0 0x7ff35c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:19.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.301+0000 7ff373fff640 1 -- 172.21.15.55:0/3610929307 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff36c0825d0 con 0x7ff37c0b4080 2023-08-25T05:19:19.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.301+0000 7ff3727fc640 1 --2- 172.21.15.55:0/3610929307 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7ff35c0657a0 0x7ff35c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:19.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.301+0000 7ff3727fc640 1 --2- 172.21.15.55:0/3610929307 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7ff35c0657a0 0x7ff35c067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff364000f70 tx=0x7ff364001120 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:19.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.305+0000 7ff373fff640 1 -- 172.21.15.55:0/3610929307 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff36c04fe60 con 0x7ff37c0b4080 2023-08-25T05:19:19.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.461+0000 7ff381767640 1 -- 172.21.15.55:0/3610929307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff37c06bb00 con 0x7ff37c0b4080 2023-08-25T05:19:19.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.461+0000 7ff373fff640 1 -- 172.21.15.55:0/3610929307 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) v1 ==== 74+0+18326 (secure 0 0 0) 0x7ff36c053480 con 0x7ff37c0b4080 2023-08-25T05:19:19.466 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:19.466 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":169,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:19:18.477391+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:19:16.250564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-25T05:19:17.474382+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:19:19.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.465+0000 7ff381767640 1 -- 172.21.15.55:0/3610929307 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7ff35c0657a0 msgr2=0x7ff35c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.465+0000 7ff381767640 1 --2- 172.21.15.55:0/3610929307 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7ff35c0657a0 0x7ff35c067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff364000f70 tx=0x7ff364001120 comp rx=0 tx=0).stop 2023-08-25T05:19:19.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.465+0000 7ff381767640 1 -- 172.21.15.55:0/3610929307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff37c0b4080 msgr2=0x7ff37c1568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.465+0000 7ff381767640 1 --2- 172.21.15.55:0/3610929307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff37c0b4080 0x7ff37c1568c0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00c440 tx=0x7ff36c00c900 comp rx=0 tx=0).stop 2023-08-25T05:19:19.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.465+0000 7ff381767640 1 -- 172.21.15.55:0/3610929307 shutdown_connections 2023-08-25T05:19:19.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.465+0000 7ff381767640 1 --2- 172.21.15.55:0/3610929307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff37c160120 0x7ff37c155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.465+0000 7ff381767640 1 --2- 172.21.15.55:0/3610929307 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7ff35c0657a0 0x7ff35c067c60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.465+0000 7ff381767640 1 --2- 172.21.15.55:0/3610929307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff37c0b4510 0x7ff37c14c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.465+0000 7ff381767640 1 --2- 172.21.15.55:0/3610929307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff37c0b4080 0x7ff37c1568c0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.465+0000 7ff381767640 1 -- 172.21.15.55:0/3610929307 >> 172.21.15.55:0/3610929307 conn(0x7ff37c09b950 msgr2=0x7ff37c0cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:19.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.465+0000 7ff381767640 1 -- 172.21.15.55:0/3610929307 shutdown_connections 2023-08-25T05:19:19.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.465+0000 7ff381767640 1 -- 172.21.15.55:0/3610929307 wait complete. 2023-08-25T05:19:19.487 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:19:19.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.629+0000 7f5a4759e640 1 Processor -- start 2023-08-25T05:19:19.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.629+0000 7f5a4759e640 1 -- start start 2023-08-25T05:19:19.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.629+0000 7f5a4759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a4815c9f0 0x7f5a480b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:19.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.629+0000 7f5a4759e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a480d0340 0x7f5a4806a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:19.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.629+0000 7f5a4759e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5a4806aee0 0x7f5a480cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:19.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.629+0000 7f5a4759e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a480b4b20 con 0x7f5a480d0340 2023-08-25T05:19:19.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.629+0000 7f5a4759e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a480b4e00 con 0x7f5a4806aee0 2023-08-25T05:19:19.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.629+0000 7f5a4759e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480cd530 con 0x7f5a4815c9f0 2023-08-25T05:19:19.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.629+0000 7f5a3dd9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a480d0340 0x7f5a4806a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:19.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.629+0000 7f5a3dd9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a480d0340 0x7f5a4806a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53858/0 (socket says 172.21.15.55:53858) 2023-08-25T05:19:19.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.629+0000 7f5a3dd9b640 1 -- 172.21.15.55:0/1387669722 learned_addr learned my addr 172.21.15.55:0/1387669722 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:19.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.629+0000 7f5a4659c640 1 --2- 172.21.15.55:0/1387669722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a4815c9f0 0x7f5a480b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:19.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.629+0000 7f5a46d9d640 1 --2- 172.21.15.55:0/1387669722 >> v2:172.21.15.110:3300/0 conn(0x7f5a4806aee0 0x7f5a480cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:19.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.629+0000 7f5a3dd9b640 1 -- 172.21.15.55:0/1387669722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a4815c9f0 msgr2=0x7f5a480b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:19.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.629+0000 7f5a3dd9b640 1 --2- 172.21.15.55:0/1387669722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a4815c9f0 0x7f5a480b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.629+0000 7f5a3dd9b640 1 -- 172.21.15.55:0/1387669722 >> v2:172.21.15.110:3300/0 conn(0x7f5a4806aee0 msgr2=0x7f5a480cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:19.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.629+0000 7f5a3dd9b640 1 --2- 172.21.15.55:0/1387669722 >> v2:172.21.15.110:3300/0 conn(0x7f5a4806aee0 0x7f5a480cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.629+0000 7f5a3dd9b640 1 -- 172.21.15.55:0/1387669722 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a480cd810 con 0x7f5a480d0340 2023-08-25T05:19:19.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.633+0000 7f5a3dd9b640 1 --2- 172.21.15.55:0/1387669722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a480d0340 0x7f5a4806a9a0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f5a480cf040 tx=0x7f5a3001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e20356650cf2e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:19.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.633+0000 7f5a45d9b640 1 -- 172.21.15.55:0/1387669722 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300af400 con 0x7f5a480d0340 2023-08-25T05:19:19.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.633+0000 7f5a45d9b640 1 -- 172.21.15.55:0/1387669722 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a300ab050 con 0x7f5a480d0340 2023-08-25T05:19:19.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.633+0000 7f5a45d9b640 1 -- 172.21.15.55:0/1387669722 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300af780 con 0x7f5a480d0340 2023-08-25T05:19:19.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.633+0000 7f5a4759e640 1 -- 172.21.15.55:0/1387669722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a480d0340 msgr2=0x7f5a4806a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.633+0000 7f5a4759e640 1 --2- 172.21.15.55:0/1387669722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a480d0340 0x7f5a4806a9a0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f5a480cf040 tx=0x7f5a3001f1c0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.633+0000 7f5a4759e640 1 -- 172.21.15.55:0/1387669722 shutdown_connections 2023-08-25T05:19:19.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.633+0000 7f5a4759e640 1 --2- 172.21.15.55:0/1387669722 >> v2:172.21.15.110:3300/0 conn(0x7f5a4806aee0 0x7f5a480cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.633+0000 7f5a4759e640 1 --2- 172.21.15.55:0/1387669722 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a480d0340 0x7f5a4806a9a0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.633+0000 7f5a4759e640 1 --2- 172.21.15.55:0/1387669722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a4815c9f0 0x7f5a480b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.633+0000 7f5a4759e640 1 -- 172.21.15.55:0/1387669722 >> 172.21.15.55:0/1387669722 conn(0x7f5a480d25f0 msgr2=0x7f5a480d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:19.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.633+0000 7f5a4759e640 1 -- 172.21.15.55:0/1387669722 shutdown_connections 2023-08-25T05:19:19.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.633+0000 7f5a4759e640 1 -- 172.21.15.55:0/1387669722 wait complete. 2023-08-25T05:19:19.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.633+0000 7f5a4759e640 1 Processor -- start 2023-08-25T05:19:19.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4759e640 1 -- start start 2023-08-25T05:19:19.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4759e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4806aee0 0x7f5a4814e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:19.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4759e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a480d0340 0x7f5a480af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:19.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4759e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a4815c9f0 0x7f5a480af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:19.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4759e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4815df40 con 0x7f5a4806aee0 2023-08-25T05:19:19.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4759e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4815d070 con 0x7f5a4815c9f0 2023-08-25T05:19:19.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4759e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4815d2c0 con 0x7f5a480d0340 2023-08-25T05:19:19.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4806aee0 0x7f5a4814e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:19.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4806aee0 0x7f5a4814e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53864/0 (socket says 172.21.15.55:53864) 2023-08-25T05:19:19.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4659c640 1 -- 172.21.15.55:0/124602060 learned_addr learned my addr 172.21.15.55:0/124602060 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:19.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a3dd9b640 1 --2- 172.21.15.55:0/124602060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a480d0340 0x7f5a480af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:19.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a46d9d640 1 --2- 172.21.15.55:0/124602060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a4815c9f0 0x7f5a480af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:19.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4659c640 1 -- 172.21.15.55:0/124602060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a480d0340 msgr2=0x7f5a480af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4659c640 1 --2- 172.21.15.55:0/124602060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a480d0340 0x7f5a480af190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4659c640 1 -- 172.21.15.55:0/124602060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a4815c9f0 msgr2=0x7f5a480af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4659c640 1 --2- 172.21.15.55:0/124602060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a4815c9f0 0x7f5a480af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4659c640 1 -- 172.21.15.55:0/124602060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a30009b30 con 0x7f5a4806aee0 2023-08-25T05:19:19.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4659c640 1 --2- 172.21.15.55:0/124602060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4806aee0 0x7f5a4814e910 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800e870 tx=0x7f5a3800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:19.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a3f7fe640 1 -- 172.21.15.55:0/124602060 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a380095d0 con 0x7f5a4806aee0 2023-08-25T05:19:19.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a3f7fe640 1 -- 172.21.15.55:0/124602060 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3800c940 con 0x7f5a4806aee0 2023-08-25T05:19:19.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4759e640 1 -- 172.21.15.55:0/124602060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4815d5a0 con 0x7f5a4806aee0 2023-08-25T05:19:19.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a3f7fe640 1 -- 172.21.15.55:0/124602060 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800ccb0 con 0x7f5a4806aee0 2023-08-25T05:19:19.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4759e640 1 -- 172.21.15.55:0/124602060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4815db60 con 0x7f5a4806aee0 2023-08-25T05:19:19.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.637+0000 7f5a4759e640 1 -- 172.21.15.55:0/124602060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a480c6b10 con 0x7f5a4806aee0 2023-08-25T05:19:19.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.641+0000 7f5a3f7fe640 1 -- 172.21.15.55:0/124602060 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f5a38013470 con 0x7f5a4806aee0 2023-08-25T05:19:19.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.641+0000 7f5a3f7fe640 1 --2- 172.21.15.55:0/124602060 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f5a280657a0 0x7f5a28067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:19.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.641+0000 7f5a3f7fe640 1 -- 172.21.15.55:0/124602060 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5a380834a0 con 0x7f5a4806aee0 2023-08-25T05:19:19.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.641+0000 7f5a3dd9b640 1 --2- 172.21.15.55:0/124602060 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f5a280657a0 0x7f5a28067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:19.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.641+0000 7f5a3dd9b640 1 --2- 172.21.15.55:0/124602060 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f5a280657a0 0x7f5a28067c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5a300b1000 tx=0x7f5a300aa000 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:19.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.645+0000 7f5a3f7fe640 1 -- 172.21.15.55:0/124602060 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5a38050f20 con 0x7f5a4806aee0 2023-08-25T05:19:19.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.801+0000 7f5a4759e640 1 -- 172.21.15.55:0/124602060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a48066d20 con 0x7f5a4806aee0 2023-08-25T05:19:19.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.801+0000 7f5a3f7fe640 1 -- 172.21.15.55:0/124602060 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) v1 ==== 74+0+18326 (secure 0 0 0) 0x7f5a38054540 con 0x7f5a4806aee0 2023-08-25T05:19:19.806 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:19.806 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":169,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:19:18.477391+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:19:16.250564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-25T05:19:17.474382+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:19:19.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.805+0000 7f5a4759e640 1 -- 172.21.15.55:0/124602060 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f5a280657a0 msgr2=0x7f5a28067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.805+0000 7f5a4759e640 1 --2- 172.21.15.55:0/124602060 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f5a280657a0 0x7f5a28067c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5a300b1000 tx=0x7f5a300aa000 comp rx=0 tx=0).stop 2023-08-25T05:19:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.805+0000 7f5a4759e640 1 -- 172.21.15.55:0/124602060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4806aee0 msgr2=0x7f5a4814e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.805+0000 7f5a4759e640 1 --2- 172.21.15.55:0/124602060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4806aee0 0x7f5a4814e910 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800e870 tx=0x7f5a3800ed30 comp rx=0 tx=0).stop 2023-08-25T05:19:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.805+0000 7f5a4759e640 1 -- 172.21.15.55:0/124602060 shutdown_connections 2023-08-25T05:19:19.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.805+0000 7f5a4759e640 1 --2- 172.21.15.55:0/124602060 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f5a280657a0 0x7f5a28067c60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.805+0000 7f5a4759e640 1 --2- 172.21.15.55:0/124602060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a4815c9f0 0x7f5a480af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.805+0000 7f5a4759e640 1 --2- 172.21.15.55:0/124602060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a480d0340 0x7f5a480af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.805+0000 7f5a4759e640 1 --2- 172.21.15.55:0/124602060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a4806aee0 0x7f5a4814e910 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.805+0000 7f5a4759e640 1 -- 172.21.15.55:0/124602060 >> 172.21.15.55:0/124602060 conn(0x7f5a480d25f0 msgr2=0x7f5a4815bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:19.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.805+0000 7f5a4759e640 1 -- 172.21.15.55:0/124602060 shutdown_connections 2023-08-25T05:19:19.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.805+0000 7f5a4759e640 1 -- 172.21.15.55:0/124602060 wait complete. 2023-08-25T05:19:19.827 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-25T05:19:19.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.973+0000 7f9fff1e9640 1 Processor -- start 2023-08-25T05:19:19.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.973+0000 7f9fff1e9640 1 -- start start 2023-08-25T05:19:19.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.973+0000 7f9fff1e9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9ff806c3b0 0x7f9ff80cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:19.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.973+0000 7f9fff1e9640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff80cab90 con 0x7f9ff806c790 2023-08-25T05:19:19.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.973+0000 7f9fff1e9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff806dbb0 con 0x7f9ff806e5a0 2023-08-25T05:19:19.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.973+0000 7f9fff1e9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff80cae50 con 0x7f9ff806c3b0 2023-08-25T05:19:19.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.973+0000 7f9ff7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9ff806c790 0x7f9ff806de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58576/0 (socket says 172.21.15.55:58576) 2023-08-25T05:19:19.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.973+0000 7f9ff7fff640 1 -- 172.21.15.55:0/2881993006 learned_addr learned my addr 172.21.15.55:0/2881993006 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:19.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.973+0000 7f9ffcf85640 1 --2- 172.21.15.55:0/2881993006 >> v2:172.21.15.110:3300/0 conn(0x7f9ff806c3b0 0x7f9ff80cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:19.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.973+0000 7f9ff77fe640 1 -- 172.21.15.55:0/2881993006 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011163844 0 0) 0x7f9ff80cab90 con 0x7f9ff806c790 2023-08-25T05:19:19.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.973+0000 7f9ff77fe640 1 -- 172.21.15.55:0/2881993006 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fe8003530 con 0x7f9ff806c790 2023-08-25T05:19:19.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.973+0000 7f9ffcf85640 1 -- 172.21.15.55:0/2881993006 >> v1:172.21.15.110:6789/0 conn(0x7f9ff806e5a0 legacy=0x7f9ff80ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.973+0000 7f9ffcf85640 1 -- 172.21.15.55:0/2881993006 >> v1:172.21.15.55:6789/0 conn(0x7f9ff806c790 legacy=0x7f9ff806de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.973+0000 7f9ffcf85640 1 -- 172.21.15.55:0/2881993006 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff80cb130 con 0x7f9ff806c3b0 2023-08-25T05:19:19.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.977+0000 7f9ffcf85640 1 --2- 172.21.15.55:0/2881993006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ff806c3b0 0x7f9ff80cd7d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0097a0 tx=0x7f9fec01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6153bc5dfbc0f23 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:19.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.977+0000 7f9ff77fe640 1 -- 172.21.15.55:0/2881993006 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0ab610 con 0x7f9ff806c3b0 2023-08-25T05:19:19.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.977+0000 7f9ff77fe640 1 -- 172.21.15.55:0/2881993006 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fec0ab770 con 0x7f9ff806c3b0 2023-08-25T05:19:19.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.977+0000 7f9ff77fe640 1 -- 172.21.15.55:0/2881993006 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec0abb00 con 0x7f9ff806c3b0 2023-08-25T05:19:19.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.977+0000 7f9fff1e9640 1 -- 172.21.15.55:0/2881993006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ff806c3b0 msgr2=0x7f9ff80cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.977+0000 7f9fff1e9640 1 --2- 172.21.15.55:0/2881993006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ff806c3b0 0x7f9ff80cd7d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0097a0 tx=0x7f9fec01c430 comp rx=0 tx=0).stop 2023-08-25T05:19:19.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.977+0000 7f9fff1e9640 1 -- 172.21.15.55:0/2881993006 shutdown_connections 2023-08-25T05:19:19.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.977+0000 7f9fff1e9640 1 --2- 172.21.15.55:0/2881993006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ff806c3b0 0x7f9ff80cd7d0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.977+0000 7f9fff1e9640 1 -- 172.21.15.55:0/2881993006 >> 172.21.15.55:0/2881993006 conn(0x7f9ff80d0540 msgr2=0x7f9ff80d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:19.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.977+0000 7f9fff1e9640 1 -- 172.21.15.55:0/2881993006 shutdown_connections 2023-08-25T05:19:19.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.977+0000 7f9fff1e9640 1 -- 172.21.15.55:0/2881993006 wait complete. 2023-08-25T05:19:19.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9fff1e9640 1 Processor -- start 2023-08-25T05:19:19.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9fff1e9640 1 -- start start 2023-08-25T05:19:19.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9fff1e9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ff806c3b0 0x7f9ff809dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:19.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9fff1e9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ff806c790 0x7f9ff815d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:19.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9fff1e9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ff806e5a0 0x7f9ff80b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:19.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9fff1e9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff815d5c0 con 0x7f9ff806c790 2023-08-25T05:19:19.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9fff1e9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff815ddb0 con 0x7f9ff806c3b0 2023-08-25T05:19:19.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9fff1e9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff80c91c0 con 0x7f9ff806e5a0 2023-08-25T05:19:19.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9ff7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ff806c790 0x7f9ff815d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:19.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9ff7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ff806c790 0x7f9ff815d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53878/0 (socket says 172.21.15.55:53878) 2023-08-25T05:19:19.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9ff7fff640 1 -- 172.21.15.55:0/3951458047 learned_addr learned my addr 172.21.15.55:0/3951458047 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:19.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9ffcf85640 1 --2- 172.21.15.55:0/3951458047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ff806c3b0 0x7f9ff809dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:19.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9ffd786640 1 --2- 172.21.15.55:0/3951458047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ff806e5a0 0x7f9ff80b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:19.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9ff7fff640 1 -- 172.21.15.55:0/3951458047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ff806e5a0 msgr2=0x7f9ff80b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9ff7fff640 1 --2- 172.21.15.55:0/3951458047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ff806e5a0 0x7f9ff80b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9ff7fff640 1 -- 172.21.15.55:0/3951458047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ff806c3b0 msgr2=0x7f9ff809dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:19.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9ff7fff640 1 --2- 172.21.15.55:0/3951458047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ff806c3b0 0x7f9ff809dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:19.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9ff7fff640 1 -- 172.21.15.55:0/3951458047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec0093b0 con 0x7f9ff806c790 2023-08-25T05:19:19.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9ff7fff640 1 --2- 172.21.15.55:0/3951458047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ff806c790 0x7f9ff815d080 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400c500 tx=0x7f9fe400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:19.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9ff57fa640 1 -- 172.21.15.55:0/3951458047 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4005cf0 con 0x7f9ff806c790 2023-08-25T05:19:19.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9ff57fa640 1 -- 172.21.15.55:0/3951458047 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe4005e50 con 0x7f9ff806c790 2023-08-25T05:19:19.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9fff1e9640 1 -- 172.21.15.55:0/3951458047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff8160080 con 0x7f9ff806c790 2023-08-25T05:19:19.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9ff57fa640 1 -- 172.21.15.55:0/3951458047 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40072f0 con 0x7f9ff806c790 2023-08-25T05:19:19.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.981+0000 7f9fff1e9640 1 -- 172.21.15.55:0/3951458047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff815d7f0 con 0x7f9ff806c790 2023-08-25T05:19:19.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.985+0000 7f9fff1e9640 1 -- 172.21.15.55:0/3951458047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff8073ec0 con 0x7f9ff806c790 2023-08-25T05:19:19.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.985+0000 7f9ff57fa640 1 -- 172.21.15.55:0/3951458047 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f9fe4007450 con 0x7f9ff806c790 2023-08-25T05:19:19.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.985+0000 7f9ff57fa640 1 --2- 172.21.15.55:0/3951458047 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f9fdc0657a0 0x7f9fdc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:19.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.985+0000 7f9ff57fa640 1 -- 172.21.15.55:0/3951458047 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9fe40824b0 con 0x7f9ff806c790 2023-08-25T05:19:19.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.985+0000 7f9ffcf85640 1 --2- 172.21.15.55:0/3951458047 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f9fdc0657a0 0x7f9fdc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:19.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.985+0000 7f9ffcf85640 1 --2- 172.21.15.55:0/3951458047 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f9fdc0657a0 0x7f9fdc067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0af000 tx=0x7f9fec0a7000 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:19.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:19.989+0000 7f9ff57fa640 1 -- 172.21.15.55:0/3951458047 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9fe404ff00 con 0x7f9ff806c790 2023-08-25T05:19:20.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:20.181+0000 7f9fff1e9640 1 -- 172.21.15.55:0/3951458047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9ff80cfbf0 con 0x7f9ff806c790 2023-08-25T05:19:21.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.101+0000 7f9ff57fa640 1 -- 172.21.15.55:0/3951458047 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v82) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9fe4053520 con 0x7f9ff806c790 2023-08-25T05:19:21.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.105+0000 7f9fff1e9640 1 -- 172.21.15.55:0/3951458047 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f9fdc0657a0 msgr2=0x7f9fdc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:21.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.105+0000 7f9fff1e9640 1 --2- 172.21.15.55:0/3951458047 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f9fdc0657a0 0x7f9fdc067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9fec0af000 tx=0x7f9fec0a7000 comp rx=0 tx=0).stop 2023-08-25T05:19:21.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.105+0000 7f9fff1e9640 1 -- 172.21.15.55:0/3951458047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ff806c790 msgr2=0x7f9ff815d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:21.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.105+0000 7f9fff1e9640 1 --2- 172.21.15.55:0/3951458047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ff806c790 0x7f9ff815d080 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400c500 tx=0x7f9fe400c9c0 comp rx=0 tx=0).stop 2023-08-25T05:19:21.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.105+0000 7f9fff1e9640 1 -- 172.21.15.55:0/3951458047 shutdown_connections 2023-08-25T05:19:21.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.105+0000 7f9fff1e9640 1 --2- 172.21.15.55:0/3951458047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ff806e5a0 0x7f9ff80b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:21.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.105+0000 7f9fff1e9640 1 --2- 172.21.15.55:0/3951458047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ff806c790 0x7f9ff815d080 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:21.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.105+0000 7f9fff1e9640 1 --2- 172.21.15.55:0/3951458047 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f9fdc0657a0 0x7f9fdc067c60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:21.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.105+0000 7f9fff1e9640 1 --2- 172.21.15.55:0/3951458047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ff806c3b0 0x7f9ff809dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:21.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.105+0000 7f9fff1e9640 1 -- 172.21.15.55:0/3951458047 >> 172.21.15.55:0/3951458047 conn(0x7f9ff80d0540 msgr2=0x7f9ff80d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:21.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.105+0000 7f9fff1e9640 1 -- 172.21.15.55:0/3951458047 shutdown_connections 2023-08-25T05:19:21.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.105+0000 7f9fff1e9640 1 -- 172.21.15.55:0/3951458047 wait complete. 2023-08-25T05:19:21.132 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-25T05:19:21.132 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-25T05:19:21.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.277+0000 7f29f1615640 1 Processor -- start 2023-08-25T05:19:21.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.281+0000 7f29f1615640 1 -- start start 2023-08-25T05:19:21.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.281+0000 7f29f1615640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29ec0c9900 0x7f29ec0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:21.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.281+0000 7f29f1615640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f29ec06c720 0x7f29ec06cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:21.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.281+0000 7f29f1615640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ec0c9d90 con 0x7f29ec0cb020 2023-08-25T05:19:21.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.281+0000 7f29f1615640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec0cbca0 con 0x7f29ec0c9900 2023-08-25T05:19:21.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.281+0000 7f29f1615640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec0c9470 con 0x7f29ec06c720 2023-08-25T05:19:21.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.281+0000 7f29e3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29ec0c9900 0x7f29ec0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:21.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.281+0000 7f29e3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29ec0c9900 0x7f29ec0cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51042/0 (socket says 172.21.15.55:51042) 2023-08-25T05:19:21.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.281+0000 7f29e3fff640 1 -- 172.21.15.55:0/4132261928 learned_addr learned my addr 172.21.15.55:0/4132261928 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:21.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.281+0000 7f29eb7fe640 1 --2- 172.21.15.55:0/4132261928 >> v2:172.21.15.110:3300/0 conn(0x7f29ec06c720 0x7f29ec06cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:21.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.281+0000 7f29e3fff640 1 -- 172.21.15.55:0/4132261928 >> v2:172.21.15.110:3300/0 conn(0x7f29ec06c720 msgr2=0x7f29ec06cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:21.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.281+0000 7f29e3fff640 1 --2- 172.21.15.55:0/4132261928 >> v2:172.21.15.110:3300/0 conn(0x7f29ec06c720 0x7f29ec06cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:21.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.281+0000 7f29e3fff640 1 -- 172.21.15.55:0/4132261928 >> v1:172.21.15.110:6789/0 conn(0x7f29ec0cb020 legacy=0x7f29ec0cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:21.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.281+0000 7f29e3fff640 1 -- 172.21.15.55:0/4132261928 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec06d040 con 0x7f29ec0c9900 2023-08-25T05:19:21.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.285+0000 7f29e3fff640 1 --2- 172.21.15.55:0/4132261928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29ec0c9900 0x7f29ec0cdd50 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0cc1d0 tx=0x7f29d401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a9f882894ff66a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:21.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.285+0000 7f29ea7fc640 1 -- 172.21.15.55:0/4132261928 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d40ab600 con 0x7f29ec0c9900 2023-08-25T05:19:21.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.285+0000 7f29ea7fc640 1 -- 172.21.15.55:0/4132261928 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d40a7050 con 0x7f29ec0c9900 2023-08-25T05:19:21.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.285+0000 7f29ea7fc640 1 -- 172.21.15.55:0/4132261928 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d40ab980 con 0x7f29ec0c9900 2023-08-25T05:19:21.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.285+0000 7f29f1615640 1 -- 172.21.15.55:0/4132261928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29ec0c9900 msgr2=0x7f29ec0cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:21.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.285+0000 7f29f1615640 1 --2- 172.21.15.55:0/4132261928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29ec0c9900 0x7f29ec0cdd50 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0cc1d0 tx=0x7f29d401c430 comp rx=0 tx=0).stop 2023-08-25T05:19:21.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.285+0000 7f29f1615640 1 -- 172.21.15.55:0/4132261928 shutdown_connections 2023-08-25T05:19:21.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.285+0000 7f29f1615640 1 --2- 172.21.15.55:0/4132261928 >> v2:172.21.15.110:3300/0 conn(0x7f29ec06c720 0x7f29ec06cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:21.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.285+0000 7f29f1615640 1 --2- 172.21.15.55:0/4132261928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29ec0c9900 0x7f29ec0cdd50 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:21.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.285+0000 7f29f1615640 1 -- 172.21.15.55:0/4132261928 >> 172.21.15.55:0/4132261928 conn(0x7f29ec069900 msgr2=0x7f29ec069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:21.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.285+0000 7f29f1615640 1 -- 172.21.15.55:0/4132261928 shutdown_connections 2023-08-25T05:19:21.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.285+0000 7f29f1615640 1 -- 172.21.15.55:0/4132261928 wait complete. 2023-08-25T05:19:21.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.285+0000 7f29f1615640 1 Processor -- start 2023-08-25T05:19:21.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.285+0000 7f29f1615640 1 -- start start 2023-08-25T05:19:21.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29f1615640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29ec06c720 0x7f29ec0c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:21.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29f1615640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29ec0c9900 0x7f29ec14d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:21.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29f1615640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29ec0cb020 0x7f29ec098a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:21.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29f1615640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0c4ee0 con 0x7f29ec0cb020 2023-08-25T05:19:21.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29f1615640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0b19f0 con 0x7f29ec06c720 2023-08-25T05:19:21.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29f1615640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0b1cd0 con 0x7f29ec0c9900 2023-08-25T05:19:21.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29eb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29ec0cb020 0x7f29ec098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:21.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29eb7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29ec0cb020 0x7f29ec098a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51048/0 (socket says 172.21.15.55:51048) 2023-08-25T05:19:21.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29eb7fe640 1 -- 172.21.15.55:0/2601616195 learned_addr learned my addr 172.21.15.55:0/2601616195 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:21.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29eaffd640 1 --2- 172.21.15.55:0/2601616195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29ec06c720 0x7f29ec0c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:21.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29e3fff640 1 --2- 172.21.15.55:0/2601616195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29ec0c9900 0x7f29ec14d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:21.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29eb7fe640 1 -- 172.21.15.55:0/2601616195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29ec0c9900 msgr2=0x7f29ec14d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:21.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29eb7fe640 1 --2- 172.21.15.55:0/2601616195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29ec0c9900 0x7f29ec14d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:21.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29eb7fe640 1 -- 172.21.15.55:0/2601616195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29ec06c720 msgr2=0x7f29ec0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:21.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29eb7fe640 1 --2- 172.21.15.55:0/2601616195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29ec06c720 0x7f29ec0c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:21.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29eb7fe640 1 -- 172.21.15.55:0/2601616195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d40094d0 con 0x7f29ec0cb020 2023-08-25T05:19:21.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29eb7fe640 1 --2- 172.21.15.55:0/2601616195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29ec0cb020 0x7f29ec098a00 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f29e4007e40 tx=0x7f29e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:21.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29e37fe640 1 -- 172.21.15.55:0/2601616195 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4014620 con 0x7f29ec0cb020 2023-08-25T05:19:21.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29e37fe640 1 -- 172.21.15.55:0/2601616195 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e400ee90 con 0x7f29ec0cb020 2023-08-25T05:19:21.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29e37fe640 1 -- 172.21.15.55:0/2601616195 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e40149e0 con 0x7f29ec0cb020 2023-08-25T05:19:21.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29f1615640 1 -- 172.21.15.55:0/2601616195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ec0b1fb0 con 0x7f29ec0cb020 2023-08-25T05:19:21.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29f1615640 1 -- 172.21.15.55:0/2601616195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ec0b2570 con 0x7f29ec0cb020 2023-08-25T05:19:21.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.289+0000 7f29f1615640 1 -- 172.21.15.55:0/2601616195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ec073ec0 con 0x7f29ec0cb020 2023-08-25T05:19:21.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.293+0000 7f29e37fe640 1 -- 172.21.15.55:0/2601616195 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f29e4014b40 con 0x7f29ec0cb020 2023-08-25T05:19:21.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.293+0000 7f29e37fe640 1 --2- 172.21.15.55:0/2601616195 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f29cc0657a0 0x7f29cc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:21.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.293+0000 7f29e37fe640 1 -- 172.21.15.55:0/2601616195 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f29e4083840 con 0x7f29ec0cb020 2023-08-25T05:19:21.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.293+0000 7f29eaffd640 1 --2- 172.21.15.55:0/2601616195 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f29cc0657a0 0x7f29cc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:21.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.293+0000 7f29eaffd640 1 --2- 172.21.15.55:0/2601616195 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f29cc0657a0 0x7f29cc067c60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f29dc006fd0 tx=0x7f29dc009060 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:21.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.297+0000 7f29e37fe640 1 -- 172.21.15.55:0/2601616195 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f29e40512a0 con 0x7f29ec0cb020 2023-08-25T05:19:21.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:21.485+0000 7f29f1615640 1 -- 172.21.15.55:0/2601616195 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f29ec0ad500 con 0x7f29ec0cb020 2023-08-25T05:19:22.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.121+0000 7f29e37fe640 1 -- 172.21.15.55:0/2601616195 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v83) v1 ==== 122+0+0 (secure 0 0 0) 0x7f29e40548c0 con 0x7f29ec0cb020 2023-08-25T05:19:22.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.125+0000 7f29f1615640 1 -- 172.21.15.55:0/2601616195 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f29cc0657a0 msgr2=0x7f29cc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.125+0000 7f29f1615640 1 --2- 172.21.15.55:0/2601616195 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f29cc0657a0 0x7f29cc067c60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f29dc006fd0 tx=0x7f29dc009060 comp rx=0 tx=0).stop 2023-08-25T05:19:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.125+0000 7f29f1615640 1 -- 172.21.15.55:0/2601616195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29ec0cb020 msgr2=0x7f29ec098a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.125+0000 7f29f1615640 1 --2- 172.21.15.55:0/2601616195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29ec0cb020 0x7f29ec098a00 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f29e4007e40 tx=0x7f29e400e4b0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.125+0000 7f29f1615640 1 -- 172.21.15.55:0/2601616195 shutdown_connections 2023-08-25T05:19:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.125+0000 7f29f1615640 1 --2- 172.21.15.55:0/2601616195 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29ec0cb020 0x7f29ec098a00 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.125+0000 7f29f1615640 1 --2- 172.21.15.55:0/2601616195 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29ec0c9900 0x7f29ec14d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.125+0000 7f29f1615640 1 --2- 172.21.15.55:0/2601616195 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f29cc0657a0 0x7f29cc067c60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.125+0000 7f29f1615640 1 --2- 172.21.15.55:0/2601616195 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29ec06c720 0x7f29ec0c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.125+0000 7f29f1615640 1 -- 172.21.15.55:0/2601616195 >> 172.21.15.55:0/2601616195 conn(0x7f29ec069900 msgr2=0x7f29ec0aafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.125+0000 7f29f1615640 1 -- 172.21.15.55:0/2601616195 shutdown_connections 2023-08-25T05:19:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.125+0000 7f29f1615640 1 -- 172.21.15.55:0/2601616195 wait complete. 2023-08-25T05:19:22.149 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-25T05:19:22.150 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:19:22.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.293+0000 7fe7537e8640 1 Processor -- start 2023-08-25T05:19:22.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.293+0000 7fe7537e8640 1 -- start start 2023-08-25T05:19:22.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.293+0000 7fe7537e8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe74c0cfa70 0x7fe74c160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:22.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.293+0000 7fe7537e8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74c06eaf0 con 0x7fe74c06b2b0 2023-08-25T05:19:22.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.293+0000 7fe7537e8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74c06e530 con 0x7fe74c15c9c0 2023-08-25T05:19:22.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.293+0000 7fe7537e8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74c06e810 con 0x7fe74c0cfa70 2023-08-25T05:19:22.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.293+0000 7fe750d83640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe74c0cfa70 0x7fe74c160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:22.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.293+0000 7fe751d85640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe74c06b2b0 0x7fe74c06b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38212/0 (socket says 172.21.15.55:38212) 2023-08-25T05:19:22.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.293+0000 7fe751d85640 1 -- 172.21.15.55:0/697253744 learned_addr learned my addr 172.21.15.55:0/697253744 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:22.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.293+0000 7fe750d83640 1 -- 172.21.15.55:0/697253744 >> v1:172.21.15.110:6789/0 conn(0x7fe74c15c9c0 legacy=0x7fe74c160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:22.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.293+0000 7fe750d83640 1 -- 172.21.15.55:0/697253744 >> v1:172.21.15.55:6789/0 conn(0x7fe74c06b2b0 legacy=0x7fe74c06b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:22.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.293+0000 7fe750d83640 1 -- 172.21.15.55:0/697253744 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c06aab0 con 0x7fe74c0cfa70 2023-08-25T05:19:22.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.297+0000 7fe750d83640 1 --2- 172.21.15.55:0/697253744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe74c0cfa70 0x7fe74c160c20 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0097c0 tx=0x7fe73c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f39c35575a88f14 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:22.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.297+0000 7fe743fff640 1 -- 172.21.15.55:0/697253744 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c0ac630 con 0x7fe74c0cfa70 2023-08-25T05:19:22.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.297+0000 7fe743fff640 1 -- 172.21.15.55:0/697253744 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c0ac790 con 0x7fe74c0cfa70 2023-08-25T05:19:22.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.297+0000 7fe743fff640 1 -- 172.21.15.55:0/697253744 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c0acb20 con 0x7fe74c0cfa70 2023-08-25T05:19:22.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.297+0000 7fe7537e8640 1 -- 172.21.15.55:0/697253744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe74c0cfa70 msgr2=0x7fe74c160c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:22.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.297+0000 7fe7537e8640 1 --2- 172.21.15.55:0/697253744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe74c0cfa70 0x7fe74c160c20 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0097c0 tx=0x7fe73c01c410 comp rx=0 tx=0).stop 2023-08-25T05:19:22.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.297+0000 7fe7537e8640 1 -- 172.21.15.55:0/697253744 shutdown_connections 2023-08-25T05:19:22.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.297+0000 7fe7537e8640 1 --2- 172.21.15.55:0/697253744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe74c0cfa70 0x7fe74c160c20 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.297+0000 7fe7537e8640 1 -- 172.21.15.55:0/697253744 >> 172.21.15.55:0/697253744 conn(0x7fe74c0d05a0 msgr2=0x7fe74c0d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:22.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.297+0000 7fe7537e8640 1 -- 172.21.15.55:0/697253744 shutdown_connections 2023-08-25T05:19:22.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.297+0000 7fe7537e8640 1 -- 172.21.15.55:0/697253744 wait complete. 2023-08-25T05:19:22.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe7537e8640 1 Processor -- start 2023-08-25T05:19:22.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe7537e8640 1 -- start start 2023-08-25T05:19:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe7537e8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe74c06b2b0 0x7fe74c0c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:22.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe7537e8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe74c0cfa70 0x7fe74c158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:22.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe7537e8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe74c15c9c0 0x7fe74c157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:22.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe7537e8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c15a930 con 0x7fe74c06b2b0 2023-08-25T05:19:22.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe7537e8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c15ac10 con 0x7fe74c15c9c0 2023-08-25T05:19:22.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe7537e8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c15aef0 con 0x7fe74c0cfa70 2023-08-25T05:19:22.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe751584640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe74c06b2b0 0x7fe74c0c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:22.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe751584640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe74c06b2b0 0x7fe74c0c2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51076/0 (socket says 172.21.15.55:51076) 2023-08-25T05:19:22.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe751584640 1 -- 172.21.15.55:0/1089698793 learned_addr learned my addr 172.21.15.55:0/1089698793 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:22.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe750d83640 1 --2- 172.21.15.55:0/1089698793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe74c0cfa70 0x7fe74c158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:22.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe751d85640 1 --2- 172.21.15.55:0/1089698793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe74c15c9c0 0x7fe74c157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:22.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe751584640 1 -- 172.21.15.55:0/1089698793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe74c0cfa70 msgr2=0x7fe74c158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:22.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe751584640 1 --2- 172.21.15.55:0/1089698793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe74c0cfa70 0x7fe74c158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe751584640 1 -- 172.21.15.55:0/1089698793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe74c15c9c0 msgr2=0x7fe74c157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:22.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe751584640 1 --2- 172.21.15.55:0/1089698793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe74c15c9c0 0x7fe74c157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe751584640 1 -- 172.21.15.55:0/1089698793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c009420 con 0x7fe74c06b2b0 2023-08-25T05:19:22.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe751d85640 1 --2- 172.21.15.55:0/1089698793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe74c15c9c0 0x7fe74c157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:19:22.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe751584640 1 --2- 172.21.15.55:0/1089698793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe74c06b2b0 0x7fe74c0c2f10 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fe74800b3f0 tx=0x7fe74800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe741ffb640 1 -- 172.21.15.55:0/1089698793 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748011830 con 0x7fe74c06b2b0 2023-08-25T05:19:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe741ffb640 1 -- 172.21.15.55:0/1089698793 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7480119b0 con 0x7fe74c06b2b0 2023-08-25T05:19:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe7537e8640 1 -- 172.21.15.55:0/1089698793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74c15b1d0 con 0x7fe74c06b2b0 2023-08-25T05:19:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe741ffb640 1 -- 172.21.15.55:0/1089698793 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748011d60 con 0x7fe74c06b2b0 2023-08-25T05:19:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe7537e8640 1 -- 172.21.15.55:0/1089698793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74c15b9d0 con 0x7fe74c06b2b0 2023-08-25T05:19:22.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.301+0000 7fe7537e8640 1 -- 172.21.15.55:0/1089698793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74c1610e0 con 0x7fe74c06b2b0 2023-08-25T05:19:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.305+0000 7fe741ffb640 1 -- 172.21.15.55:0/1089698793 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fe74801a410 con 0x7fe74c06b2b0 2023-08-25T05:19:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.305+0000 7fe741ffb640 1 --2- 172.21.15.55:0/1089698793 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fe7300657a0 0x7fe730067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.305+0000 7fe741ffb640 1 -- 172.21.15.55:0/1089698793 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe748082ed0 con 0x7fe74c06b2b0 2023-08-25T05:19:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.305+0000 7fe750d83640 1 --2- 172.21.15.55:0/1089698793 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fe7300657a0 0x7fe730067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:22.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.305+0000 7fe750d83640 1 --2- 172.21.15.55:0/1089698793 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fe7300657a0 0x7fe730067c60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0ae000 tx=0x7fe73c008040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:22.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.309+0000 7fe741ffb640 1 -- 172.21.15.55:0/1089698793 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe7480507e0 con 0x7fe74c06b2b0 2023-08-25T05:19:22.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.505+0000 7fe7537e8640 1 -- 172.21.15.55:0/1089698793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe74c04dbe0 con 0x7fe74c06b2b0 2023-08-25T05:19:22.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.505+0000 7fe741ffb640 1 -- 172.21.15.55:0/1089698793 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4883 (secure 0 0 0) 0x7fe748015090 con 0x7fe74c06b2b0 2023-08-25T05:19:22.511 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:22.511 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/934106390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":934106390},{"type":"v1","addr":"172.21.15.110:6836","nonce":934106390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":78},{"gid":8303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/759320040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":759320040},{"type":"v1","addr":"172.21.15.110:6837","nonce":759320040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":78},{"gid":10140,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2128942930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2128942930},{"type":"v1","addr":"172.21.15.55:6833","nonce":2128942930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:19:18.477714+0000","modified":"2023-08-25T05:19:22.105735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":10149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10149":{"gid":10149,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1451359895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1451359895},{"type":"v1","addr":"172.21.15.55:6835","nonce":1451359895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-25T05:19:22.511 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 83 2023-08-25T05:19:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.509+0000 7fe7537e8640 1 -- 172.21.15.55:0/1089698793 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fe7300657a0 msgr2=0x7fe730067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.509+0000 7fe7537e8640 1 --2- 172.21.15.55:0/1089698793 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fe7300657a0 0x7fe730067c60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0ae000 tx=0x7fe73c008040 comp rx=0 tx=0).stop 2023-08-25T05:19:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.509+0000 7fe7537e8640 1 -- 172.21.15.55:0/1089698793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe74c06b2b0 msgr2=0x7fe74c0c2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.509+0000 7fe7537e8640 1 --2- 172.21.15.55:0/1089698793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe74c06b2b0 0x7fe74c0c2f10 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fe74800b3f0 tx=0x7fe74800b8b0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.509+0000 7fe7537e8640 1 -- 172.21.15.55:0/1089698793 shutdown_connections 2023-08-25T05:19:22.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.509+0000 7fe7537e8640 1 --2- 172.21.15.55:0/1089698793 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fe7300657a0 0x7fe730067c60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.509+0000 7fe7537e8640 1 --2- 172.21.15.55:0/1089698793 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe74c15c9c0 0x7fe74c157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.509+0000 7fe7537e8640 1 --2- 172.21.15.55:0/1089698793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe74c0cfa70 0x7fe74c158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.509+0000 7fe7537e8640 1 --2- 172.21.15.55:0/1089698793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe74c06b2b0 0x7fe74c0c2f10 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.509+0000 7fe7537e8640 1 -- 172.21.15.55:0/1089698793 >> 172.21.15.55:0/1089698793 conn(0x7fe74c0d05a0 msgr2=0x7fe74c0aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.509+0000 7fe7537e8640 1 -- 172.21.15.55:0/1089698793 shutdown_connections 2023-08-25T05:19:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.509+0000 7fe7537e8640 1 -- 172.21.15.55:0/1089698793 wait complete. 2023-08-25T05:19:22.532 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:19:22.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f126e112640 1 Processor -- start 2023-08-25T05:19:22.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f126e112640 1 -- start start 2023-08-25T05:19:22.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f126e112640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f12680b1ac0 0x7f12680d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:22.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f126e112640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12680b4b20 con 0x7f126815c9f0 2023-08-25T05:19:22.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f126e112640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12680b4e00 con 0x7f12680cdd30 2023-08-25T05:19:22.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f126e112640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12680b1f00 con 0x7f12680b1ac0 2023-08-25T05:19:22.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f126d110640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f126815c9f0 0x7f126806a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38226/0 (socket says 172.21.15.55:38226) 2023-08-25T05:19:22.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f126d110640 1 -- 172.21.15.55:0/1478271777 learned_addr learned my addr 172.21.15.55:0/1478271777 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:22.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f126c90f640 1 --2- 172.21.15.55:0/1478271777 >> v2:172.21.15.110:3300/0 conn(0x7f12680b1ac0 0x7f12680d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:22.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f125ffff640 1 -- 172.21.15.55:0/1478271777 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226568258 0 0) 0x7f12680b4b20 con 0x7f126815c9f0 2023-08-25T05:19:22.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f125ffff640 1 -- 172.21.15.55:0/1478271777 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1254003530 con 0x7f126815c9f0 2023-08-25T05:19:22.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f125ffff640 1 -- 172.21.15.55:0/1478271777 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2385987184 0 0) 0x7f1254003530 con 0x7f126815c9f0 2023-08-25T05:19:22.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f125ffff640 1 -- 172.21.15.55:0/1478271777 >> v2:172.21.15.110:3300/0 conn(0x7f12680b1ac0 msgr2=0x7f12680d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:22.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f125ffff640 1 --2- 172.21.15.55:0/1478271777 >> v2:172.21.15.110:3300/0 conn(0x7f12680b1ac0 0x7f12680d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f125ffff640 1 -- 172.21.15.55:0/1478271777 >> v1:172.21.15.110:6789/0 conn(0x7f12680cdd30 legacy=0x7f12680d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:22.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f125ffff640 1 -- 172.21.15.55:0/1478271777 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12680cd530 con 0x7f126815c9f0 2023-08-25T05:19:22.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f125ffff640 1 -- 172.21.15.55:0/1478271777 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f1264001800 con 0x7f126815c9f0 2023-08-25T05:19:22.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f125ffff640 1 -- 172.21.15.55:0/1478271777 >> v1:172.21.15.55:6789/0 conn(0x7f126815c9f0 legacy=0x7f126806a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:22.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f125ffff640 1 --2- 172.21.15.55:0/1478271777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1254003980 0x7f1254003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:22.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f125ffff640 1 --2- 172.21.15.55:0/1478271777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12540047d0 0x7f1254004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:22.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f125ffff640 1 --2- 172.21.15.55:0/1478271777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1254005190 0x7f125400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:22.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f125ffff640 1 -- 172.21.15.55:0/1478271777 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125400c010 con 0x7f1254005190 2023-08-25T05:19:22.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f125ffff640 1 -- 172.21.15.55:0/1478271777 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125400c180 con 0x7f1254003980 2023-08-25T05:19:22.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f125ffff640 1 -- 172.21.15.55:0/1478271777 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125400c340 con 0x7f12540047d0 2023-08-25T05:19:22.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f126d911640 1 --2- 172.21.15.55:0/1478271777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1254005190 0x7f125400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:22.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f126c90f640 1 --2- 172.21.15.55:0/1478271777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12540047d0 0x7f1254004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:22.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f126d110640 1 --2- 172.21.15.55:0/1478271777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1254003980 0x7f1254003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:22.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f126d911640 1 -- 172.21.15.55:0/1478271777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12540047d0 msgr2=0x7f1254004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:22.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f126d911640 1 --2- 172.21.15.55:0/1478271777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12540047d0 0x7f1254004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f126d911640 1 -- 172.21.15.55:0/1478271777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1254003980 msgr2=0x7f1254003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:22.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f126d911640 1 --2- 172.21.15.55:0/1478271777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1254003980 0x7f1254003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.673+0000 7f126d911640 1 -- 172.21.15.55:0/1478271777 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1254003530 con 0x7f1254005190 2023-08-25T05:19:22.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.677+0000 7f126d911640 1 -- 172.21.15.55:0/1478271777 reap_dead start 2023-08-25T05:19:22.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.677+0000 7f126d911640 1 --2- 172.21.15.55:0/1478271777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1254005190 0x7f125400b990 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f1260001e70 tx=0x7f126001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611c98f6b48c069c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:22.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.677+0000 7f125ffff640 1 -- 172.21.15.55:0/1478271777 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260003b80 con 0x7f1254005190 2023-08-25T05:19:22.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.677+0000 7f125ffff640 1 -- 172.21.15.55:0/1478271777 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1260003d20 con 0x7f1254005190 2023-08-25T05:19:22.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.677+0000 7f125ffff640 1 -- 172.21.15.55:0/1478271777 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260005260 con 0x7f1254005190 2023-08-25T05:19:22.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.677+0000 7f126e112640 1 -- 172.21.15.55:0/1478271777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1254005190 msgr2=0x7f125400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:22.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.677+0000 7f126e112640 1 --2- 172.21.15.55:0/1478271777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1254005190 0x7f125400b990 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f1260001e70 tx=0x7f126001c760 comp rx=0 tx=0).stop 2023-08-25T05:19:22.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.677+0000 7f126e112640 1 -- 172.21.15.55:0/1478271777 shutdown_connections 2023-08-25T05:19:22.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.677+0000 7f126e112640 1 --2- 172.21.15.55:0/1478271777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1254005190 0x7f125400b990 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.677+0000 7f126e112640 1 -- 172.21.15.55:0/1478271777 >> 172.21.15.55:0/1478271777 conn(0x7f12680d25f0 msgr2=0x7f12680d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:22.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.677+0000 7f126e112640 1 -- 172.21.15.55:0/1478271777 shutdown_connections 2023-08-25T05:19:22.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.677+0000 7f126e112640 1 -- 172.21.15.55:0/1478271777 wait complete. 2023-08-25T05:19:22.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126e112640 1 Processor -- start 2023-08-25T05:19:22.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126e112640 1 -- start start 2023-08-25T05:19:22.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126e112640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1254005190 0x7f12680cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:22.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126e112640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12680b5b00 0x7f12680af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:22.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126e112640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1268159bb0 0x7f126815a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:22.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126e112640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126815aff0 con 0x7f1268159bb0 2023-08-25T05:19:22.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126e112640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126815a570 con 0x7f12680b5b00 2023-08-25T05:19:22.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126e112640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12680ca150 con 0x7f1254005190 2023-08-25T05:19:22.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126d911640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1268159bb0 0x7f126815a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:22.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126d110640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1254005190 0x7f12680cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:22.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126d911640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1268159bb0 0x7f126815a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51100/0 (socket says 172.21.15.55:51100) 2023-08-25T05:19:22.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126d911640 1 -- 172.21.15.55:0/182736572 learned_addr learned my addr 172.21.15.55:0/182736572 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:22.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126c90f640 1 --2- 172.21.15.55:0/182736572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12680b5b00 0x7f12680af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:22.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126d911640 1 -- 172.21.15.55:0/182736572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1254005190 msgr2=0x7f12680cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:22.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126d911640 1 --2- 172.21.15.55:0/182736572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1254005190 0x7f12680cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126d911640 1 -- 172.21.15.55:0/182736572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12680b5b00 msgr2=0x7f12680af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:22.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126d911640 1 --2- 172.21.15.55:0/182736572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12680b5b00 0x7f12680af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126d911640 1 -- 172.21.15.55:0/182736572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12680ca430 con 0x7f1268159bb0 2023-08-25T05:19:22.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126d911640 1 --2- 172.21.15.55:0/182736572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1268159bb0 0x7f126815a030 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f126001cc40 tx=0x7f1254005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:22.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f125dffb640 1 -- 172.21.15.55:0/182736572 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12600ac070 con 0x7f1268159bb0 2023-08-25T05:19:22.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f125dffb640 1 -- 172.21.15.55:0/182736572 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1260003e90 con 0x7f1268159bb0 2023-08-25T05:19:22.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f125dffb640 1 -- 172.21.15.55:0/182736572 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260006d60 con 0x7f1268159bb0 2023-08-25T05:19:22.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126e112640 1 -- 172.21.15.55:0/182736572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12680ca710 con 0x7f1268159bb0 2023-08-25T05:19:22.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.681+0000 7f126e112640 1 -- 172.21.15.55:0/182736572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126815d040 con 0x7f1268159bb0 2023-08-25T05:19:22.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.685+0000 7f126e112640 1 -- 172.21.15.55:0/182736572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1268066d20 con 0x7f1268159bb0 2023-08-25T05:19:22.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.685+0000 7f125dffb640 1 -- 172.21.15.55:0/182736572 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f1260007030 con 0x7f1268159bb0 2023-08-25T05:19:22.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.685+0000 7f125dffb640 1 --2- 172.21.15.55:0/182736572 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f124c0657d0 0x7f124c067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:22.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.685+0000 7f125dffb640 1 -- 172.21.15.55:0/182736572 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f126011c1b0 con 0x7f1268159bb0 2023-08-25T05:19:22.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.685+0000 7f126d110640 1 --2- 172.21.15.55:0/182736572 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f124c0657d0 0x7f124c067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:22.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.685+0000 7f126d110640 1 --2- 172.21.15.55:0/182736572 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f124c0657d0 0x7f124c067c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1264000f00 tx=0x7f1264009040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:22.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.689+0000 7f125dffb640 1 -- 172.21.15.55:0/182736572 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f12600e9a80 con 0x7f1268159bb0 2023-08-25T05:19:22.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.849+0000 7f126e112640 1 -- 172.21.15.55:0/182736572 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12680cabc0 con 0x7f1268159bb0 2023-08-25T05:19:22.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.849+0000 7f125dffb640 1 -- 172.21.15.55:0/182736572 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+18313 (secure 0 0 0) 0x7f12600b8020 con 0x7f1268159bb0 2023-08-25T05:19:22.852 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:22.853 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":170,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:19:20.090877+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:19:16.250564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-25T05:19:17.474382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:19:22.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.849+0000 7f126e112640 1 -- 172.21.15.55:0/182736572 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f124c0657d0 msgr2=0x7f124c067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:22.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.849+0000 7f126e112640 1 --2- 172.21.15.55:0/182736572 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f124c0657d0 0x7f124c067c90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1264000f00 tx=0x7f1264009040 comp rx=0 tx=0).stop 2023-08-25T05:19:22.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.849+0000 7f126e112640 1 -- 172.21.15.55:0/182736572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1268159bb0 msgr2=0x7f126815a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:22.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.849+0000 7f126e112640 1 --2- 172.21.15.55:0/182736572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1268159bb0 0x7f126815a030 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f126001cc40 tx=0x7f1254005800 comp rx=0 tx=0).stop 2023-08-25T05:19:22.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.849+0000 7f126e112640 1 -- 172.21.15.55:0/182736572 shutdown_connections 2023-08-25T05:19:22.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.849+0000 7f126e112640 1 --2- 172.21.15.55:0/182736572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1268159bb0 0x7f126815a030 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.849+0000 7f126e112640 1 --2- 172.21.15.55:0/182736572 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f124c0657d0 0x7f124c067c90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.849+0000 7f126e112640 1 --2- 172.21.15.55:0/182736572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12680b5b00 0x7f12680af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.849+0000 7f126e112640 1 --2- 172.21.15.55:0/182736572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1254005190 0x7f12680cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:22.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.849+0000 7f126e112640 1 -- 172.21.15.55:0/182736572 >> 172.21.15.55:0/182736572 conn(0x7f12680d25f0 msgr2=0x7f126806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:22.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.853+0000 7f126e112640 1 -- 172.21.15.55:0/182736572 shutdown_connections 2023-08-25T05:19:22.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:22.853+0000 7f126e112640 1 -- 172.21.15.55:0/182736572 wait complete. 2023-08-25T05:19:22.874 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-25T05:19:22.874 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:19:23.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.013+0000 7f2501e56640 1 Processor -- start 2023-08-25T05:19:23.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.013+0000 7f2501e56640 1 -- start start 2023-08-25T05:19:23.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.017+0000 7f2501e56640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24fc0cfa70 0x7f24fc160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.017+0000 7f2501e56640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24fc06eaf0 con 0x7f24fc06b2b0 2023-08-25T05:19:23.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.017+0000 7f2501e56640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24fc06e530 con 0x7f24fc15c9c0 2023-08-25T05:19:23.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.017+0000 7f2501e56640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24fc06e810 con 0x7f24fc0cfa70 2023-08-25T05:19:23.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.017+0000 7f24f3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f24fc0cfa70 0x7f24fc160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.017+0000 7f24fbfff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f24fc06b2b0 0x7f24fc06b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38240/0 (socket says 172.21.15.55:38240) 2023-08-25T05:19:23.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.017+0000 7f24fbfff640 1 -- 172.21.15.55:0/1242113806 learned_addr learned my addr 172.21.15.55:0/1242113806 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:23.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.017+0000 7f24f3fff640 1 -- 172.21.15.55:0/1242113806 >> v1:172.21.15.110:6789/0 conn(0x7f24fc15c9c0 legacy=0x7f24fc160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:23.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.017+0000 7f24f3fff640 1 -- 172.21.15.55:0/1242113806 >> v1:172.21.15.55:6789/0 conn(0x7f24fc06b2b0 legacy=0x7f24fc06b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.017+0000 7f24f3fff640 1 -- 172.21.15.55:0/1242113806 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc06aab0 con 0x7f24fc0cfa70 2023-08-25T05:19:23.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.021+0000 7f24f3fff640 1 --2- 172.21.15.55:0/1242113806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc0cfa70 0x7f24fc160c20 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f24e40097c0 tx=0x7f24e401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a610619c62b6e3a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:23.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.021+0000 7f24faffd640 1 -- 172.21.15.55:0/1242113806 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e40ac630 con 0x7f24fc0cfa70 2023-08-25T05:19:23.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.021+0000 7f24faffd640 1 -- 172.21.15.55:0/1242113806 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e40ac790 con 0x7f24fc0cfa70 2023-08-25T05:19:23.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.021+0000 7f24faffd640 1 -- 172.21.15.55:0/1242113806 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e40acb20 con 0x7f24fc0cfa70 2023-08-25T05:19:23.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.021+0000 7f2501e56640 1 -- 172.21.15.55:0/1242113806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc0cfa70 msgr2=0x7f24fc160c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.021+0000 7f2501e56640 1 --2- 172.21.15.55:0/1242113806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc0cfa70 0x7f24fc160c20 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f24e40097c0 tx=0x7f24e401c410 comp rx=0 tx=0).stop 2023-08-25T05:19:23.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.021+0000 7f2501e56640 1 -- 172.21.15.55:0/1242113806 shutdown_connections 2023-08-25T05:19:23.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.021+0000 7f2501e56640 1 --2- 172.21.15.55:0/1242113806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc0cfa70 0x7f24fc160c20 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.021+0000 7f2501e56640 1 -- 172.21.15.55:0/1242113806 >> 172.21.15.55:0/1242113806 conn(0x7f24fc0d05a0 msgr2=0x7f24fc0d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:23.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.021+0000 7f2501e56640 1 -- 172.21.15.55:0/1242113806 shutdown_connections 2023-08-25T05:19:23.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.021+0000 7f2501e56640 1 -- 172.21.15.55:0/1242113806 wait complete. 2023-08-25T05:19:23.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.021+0000 7f2501e56640 1 Processor -- start 2023-08-25T05:19:23.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.021+0000 7f2501e56640 1 -- start start 2023-08-25T05:19:23.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f2501e56640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24fc06b2b0 0x7f24fc0c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f2501e56640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc0cfa70 0x7f24fc158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f2501e56640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24fc15c9c0 0x7f24fc157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f2501e56640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc15a930 con 0x7f24fc0cfa70 2023-08-25T05:19:23.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f2501e56640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc15ac10 con 0x7f24fc15c9c0 2023-08-25T05:19:23.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f2501e56640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc15aef0 con 0x7f24fc06b2b0 2023-08-25T05:19:23.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f24f3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc0cfa70 0x7f24fc158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f24f3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc0cfa70 0x7f24fc158b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51124/0 (socket says 172.21.15.55:51124) 2023-08-25T05:19:23.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f24f3fff640 1 -- 172.21.15.55:0/2258931747 learned_addr learned my addr 172.21.15.55:0/2258931747 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:23.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f24fbfff640 1 --2- 172.21.15.55:0/2258931747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24fc15c9c0 0x7f24fc157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f24fb7fe640 1 --2- 172.21.15.55:0/2258931747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24fc06b2b0 0x7f24fc0c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f24f3fff640 1 -- 172.21.15.55:0/2258931747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24fc06b2b0 msgr2=0x7f24fc0c2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f24f3fff640 1 --2- 172.21.15.55:0/2258931747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24fc06b2b0 0x7f24fc0c2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f24f3fff640 1 -- 172.21.15.55:0/2258931747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24fc15c9c0 msgr2=0x7f24fc157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f24f3fff640 1 --2- 172.21.15.55:0/2258931747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24fc15c9c0 0x7f24fc157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f24f3fff640 1 -- 172.21.15.55:0/2258931747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e4009420 con 0x7f24fc0cfa70 2023-08-25T05:19:23.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f24fbfff640 1 --2- 172.21.15.55:0/2258931747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24fc15c9c0 0x7f24fc157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:19:23.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f24fb7fe640 1 --2- 172.21.15.55:0/2258931747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24fc06b2b0 0x7f24fc0c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:19:23.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f24f3fff640 1 --2- 172.21.15.55:0/2258931747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc0cfa70 0x7f24fc158b20 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f24e40af040 tx=0x7f24e40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:23.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f24f8ff9640 1 -- 172.21.15.55:0/2258931747 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e40b5610 con 0x7f24fc0cfa70 2023-08-25T05:19:23.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f24f8ff9640 1 -- 172.21.15.55:0/2258931747 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e40b5770 con 0x7f24fc0cfa70 2023-08-25T05:19:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f2501e56640 1 -- 172.21.15.55:0/2258931747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24fc15b1d0 con 0x7f24fc0cfa70 2023-08-25T05:19:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f24f8ff9640 1 -- 172.21.15.55:0/2258931747 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e40b5b20 con 0x7f24fc0cfa70 2023-08-25T05:19:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f2501e56640 1 -- 172.21.15.55:0/2258931747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24fc15b9d0 con 0x7f24fc0cfa70 2023-08-25T05:19:23.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f2501e56640 1 -- 172.21.15.55:0/2258931747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24fc1610e0 con 0x7f24fc0cfa70 2023-08-25T05:19:23.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.025+0000 7f24f8ff9640 1 -- 172.21.15.55:0/2258931747 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f24e40b3040 con 0x7f24fc0cfa70 2023-08-25T05:19:23.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.029+0000 7f24f8ff9640 1 --2- 172.21.15.55:0/2258931747 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f24dc0657a0 0x7f24dc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.029+0000 7f24f8ff9640 1 -- 172.21.15.55:0/2258931747 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f24e411d190 con 0x7f24fc0cfa70 2023-08-25T05:19:23.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.029+0000 7f24fb7fe640 1 --2- 172.21.15.55:0/2258931747 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f24dc0657a0 0x7f24dc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.029+0000 7f24fb7fe640 1 --2- 172.21.15.55:0/2258931747 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f24dc0657a0 0x7f24dc067c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00a830 tx=0x7f24ec008040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:23.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.033+0000 7f24f8ff9640 1 -- 172.21.15.55:0/2258931747 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f24e40eaa40 con 0x7f24fc0cfa70 2023-08-25T05:19:23.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.185+0000 7f2501e56640 1 -- 172.21.15.55:0/2258931747 --> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24fc15ad80 con 0x7f24dc0657a0 2023-08-25T05:19:23.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.197+0000 7f24f8ff9640 1 -- 172.21.15.55:0/2258931747 <== mgr.9163 v2:172.21.15.110:6832/221263034 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299474 (secure 0 0 0) 0x7f24fc15ad80 con 0x7f24dc0657a0 2023-08-25T05:19:23.203 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:23.204 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:19:23.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.201+0000 7f2501e56640 1 -- 172.21.15.55:0/2258931747 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f24dc0657a0 msgr2=0x7f24dc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.201+0000 7f2501e56640 1 --2- 172.21.15.55:0/2258931747 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f24dc0657a0 0x7f24dc067c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00a830 tx=0x7f24ec008040 comp rx=0 tx=0).stop 2023-08-25T05:19:23.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.201+0000 7f2501e56640 1 -- 172.21.15.55:0/2258931747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc0cfa70 msgr2=0x7f24fc158b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.201+0000 7f2501e56640 1 --2- 172.21.15.55:0/2258931747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc0cfa70 0x7f24fc158b20 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f24e40af040 tx=0x7f24e40191b0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.201+0000 7f2501e56640 1 -- 172.21.15.55:0/2258931747 shutdown_connections 2023-08-25T05:19:23.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.201+0000 7f2501e56640 1 --2- 172.21.15.55:0/2258931747 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f24dc0657a0 0x7f24dc067c60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.201+0000 7f2501e56640 1 --2- 172.21.15.55:0/2258931747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24fc15c9c0 0x7f24fc157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.201+0000 7f2501e56640 1 --2- 172.21.15.55:0/2258931747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24fc0cfa70 0x7f24fc158b20 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.201+0000 7f2501e56640 1 --2- 172.21.15.55:0/2258931747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24fc06b2b0 0x7f24fc0c2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.201+0000 7f2501e56640 1 -- 172.21.15.55:0/2258931747 >> 172.21.15.55:0/2258931747 conn(0x7f24fc0d05a0 msgr2=0x7f24fc0aef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:23.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.201+0000 7f2501e56640 1 -- 172.21.15.55:0/2258931747 shutdown_connections 2023-08-25T05:19:23.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.201+0000 7f2501e56640 1 -- 172.21.15.55:0/2258931747 wait complete. 2023-08-25T05:19:23.223 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-25T05:19:21.732945+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1616,"num_read_kb":3373,"num_write":465,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3598,"ondisk_log_size":3598,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":394480,"kb_used_data":17348,"kb_used_omap":13,"kb_used_meta":377010,"kb_avail":754580240,"statfs":{"total":773094113280,"available":772690165760,"internally_reserved":0,"allocated":17764352,"data_stored":9533634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":386058328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.665539"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.522751+0000","last_change":"2023-08-25T05:19:17.522751+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.522751+0000","last_undegraded":"2023-08-25T05:19:17.522751+0000","last_fullsized":"2023-08-25T05:19:17.522751+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.073435+0000","last_change":"2023-08-25T05:19:17.073435+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.073435+0000","last_undegraded":"2023-08-25T05:19:17.073435+0000","last_fullsized":"2023-08-25T05:19:17.073435+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.072876+0000","last_change":"2023-08-25T05:19:17.072876+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.072876+0000","last_undegraded":"2023-08-25T05:19:17.072876+0000","last_fullsized":"2023-08-25T05:19:17.072876+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.073317+0000","last_change":"2023-08-25T05:19:17.073317+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.073317+0000","last_undegraded":"2023-08-25T05:19:17.073317+0000","last_fullsized":"2023-08-25T05:19:17.073317+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.070341+0000","last_change":"2023-08-25T05:19:17.070341+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.070341+0000","last_undegraded":"2023-08-25T05:19:17.070341+0000","last_fullsized":"2023-08-25T05:19:17.070341+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.522840+0000","last_change":"2023-08-25T05:19:17.522840+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.522840+0000","last_undegraded":"2023-08-25T05:19:17.522840+0000","last_fullsized":"2023-08-25T05:19:17.522840+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.076088+0000","last_change":"2023-08-25T05:19:17.076088+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.076088+0000","last_undegraded":"2023-08-25T05:19:17.076088+0000","last_fullsized":"2023-08-25T05:19:17.076088+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.522816+0000","last_change":"2023-08-25T05:19:17.522816+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.522816+0000","last_undegraded":"2023-08-25T05:19:17.522816+0000","last_fullsized":"2023-08-25T05:19:17.522816+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.069492+0000","last_change":"2023-08-25T05:19:17.069492+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.069492+0000","last_undegraded":"2023-08-25T05:19:17.069492+0000","last_fullsized":"2023-08-25T05:19:17.069492+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.072851+0000","last_change":"2023-08-25T05:19:17.072851+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.072851+0000","last_undegraded":"2023-08-25T05:19:17.072851+0000","last_fullsized":"2023-08-25T05:19:17.072851+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.073375+0000","last_change":"2023-08-25T05:19:17.073375+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.073375+0000","last_undegraded":"2023-08-25T05:19:17.073375+0000","last_fullsized":"2023-08-25T05:19:17.073375+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.069787+0000","last_change":"2023-08-25T05:19:17.069787+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.069787+0000","last_undegraded":"2023-08-25T05:19:17.069787+0000","last_fullsized":"2023-08-25T05:19:17.069787+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.072264+0000","last_change":"2023-08-25T05:19:17.072264+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.072264+0000","last_undegraded":"2023-08-25T05:19:17.072264+0000","last_fullsized":"2023-08-25T05:19:17.072264+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.069780+0000","last_change":"2023-08-25T05:19:17.069780+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.069780+0000","last_undegraded":"2023-08-25T05:19:17.069780+0000","last_fullsized":"2023-08-25T05:19:17.069780+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.072251+0000","last_change":"2023-08-25T05:19:17.072251+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.072251+0000","last_undegraded":"2023-08-25T05:19:17.072251+0000","last_fullsized":"2023-08-25T05:19:17.072251+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.069829+0000","last_change":"2023-08-25T05:19:17.069829+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.069829+0000","last_undegraded":"2023-08-25T05:19:17.069829+0000","last_fullsized":"2023-08-25T05:19:17.069829+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.069787+0000","last_change":"2023-08-25T05:19:17.069787+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.069787+0000","last_undegraded":"2023-08-25T05:19:17.069787+0000","last_fullsized":"2023-08-25T05:19:17.069787+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.076083+0000","last_change":"2023-08-25T05:19:17.076083+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.076083+0000","last_undegraded":"2023-08-25T05:19:17.076083+0000","last_fullsized":"2023-08-25T05:19:17.076083+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.072874+0000","last_change":"2023-08-25T05:19:17.072874+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.072874+0000","last_undegraded":"2023-08-25T05:19:17.072874+0000","last_fullsized":"2023-08-25T05:19:17.072874+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.522820+0000","last_change":"2023-08-25T05:19:17.522820+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.522820+0000","last_undegraded":"2023-08-25T05:19:17.522820+0000","last_fullsized":"2023-08-25T05:19:17.522820+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.075802+0000","last_change":"2023-08-25T05:19:17.075802+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.075802+0000","last_undegraded":"2023-08-25T05:19:17.075802+0000","last_fullsized":"2023-08-25T05:19:17.075802+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.069502+0000","last_change":"2023-08-25T05:19:17.069502+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.069502+0000","last_undegraded":"2023-08-25T05:19:17.069502+0000","last_fullsized":"2023-08-25T05:19:17.069502+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.075491+0000","last_change":"2023-08-25T05:19:17.075491+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.075491+0000","last_undegraded":"2023-08-25T05:19:17.075491+0000","last_fullsized":"2023-08-25T05:19:17.075491+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.072758+0000","last_change":"2023-08-25T05:19:17.072758+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.072758+0000","last_undegraded":"2023-08-25T05:19:17.072758+0000","last_fullsized":"2023-08-25T05:19:17.072758+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.072340+0000","last_change":"2023-08-25T05:19:17.072340+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.072340+0000","last_undegraded":"2023-08-25T05:19:17.072340+0000","last_fullsized":"2023-08-25T05:19:17.072340+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"159'3598","reported_seq":4389,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-25T05:19:17.074082+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:19:17.074082+0000","last_peered":"2023-08-25T05:19:17.074082+0000","last_clean":"2023-08-25T05:19:17.074082+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:19:17.074082+0000","last_undegraded":"2023-08-25T05:19:17.074082+0000","last_fullsized":"2023-08-25T05:19:17.074082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3598,"log_dups_size":0,"ondisk_log_size":3598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:27:36.787996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1616,"num_read_kb":3373,"num_write":465,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":291,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-25T05:19:17.076878+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:19:17.076878+0000","last_peered":"2023-08-25T05:19:17.076878+0000","last_clean":"2023-08-25T05:19:17.076878+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:19:17.076878+0000","last_undegraded":"2023-08-25T05:19:17.076878+0000","last_fullsized":"2023-08-25T05:19:17.076878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:38:50.546523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.072904+0000","last_change":"2023-08-25T05:19:17.072904+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.072904+0000","last_undegraded":"2023-08-25T05:19:17.072904+0000","last_fullsized":"2023-08-25T05:19:17.072904+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":288,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-25T05:19:17.073982+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:19:17.073982+0000","last_peered":"2023-08-25T05:19:17.073982+0000","last_clean":"2023-08-25T05:19:17.073982+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:19:17.073982+0000","last_undegraded":"2023-08-25T05:19:17.073982+0000","last_fullsized":"2023-08-25T05:19:17.073982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:55:24.713926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.075546+0000","last_change":"2023-08-25T05:19:17.075546+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.075546+0000","last_undegraded":"2023-08-25T05:19:17.075546+0000","last_fullsized":"2023-08-25T05:19:17.075546+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":295,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-25T05:19:17.068014+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:19:17.068014+0000","last_peered":"2023-08-25T05:19:17.068014+0000","last_clean":"2023-08-25T05:19:17.068014+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:19:17.068014+0000","last_undegraded":"2023-08-25T05:19:17.068014+0000","last_fullsized":"2023-08-25T05:19:17.068014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:14:50.902135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.069648+0000","last_change":"2023-08-25T05:19:17.069648+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.069648+0000","last_undegraded":"2023-08-25T05:19:17.069648+0000","last_fullsized":"2023-08-25T05:19:17.069648+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":291,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-25T05:19:17.076582+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:19:17.076582+0000","last_peered":"2023-08-25T05:19:17.076582+0000","last_clean":"2023-08-25T05:19:17.076582+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:19:17.076582+0000","last_undegraded":"2023-08-25T05:19:17.076582+0000","last_fullsized":"2023-08-25T05:19:17.076582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:39:31.789106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.522827+0000","last_change":"2023-08-25T05:19:17.522827+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.522827+0000","last_undegraded":"2023-08-25T05:19:17.522827+0000","last_fullsized":"2023-08-25T05:19:17.522827+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":315,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-25T05:19:17.073615+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:19:17.073615+0000","last_peered":"2023-08-25T05:19:17.073615+0000","last_clean":"2023-08-25T05:19:17.073615+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:19:17.073615+0000","last_undegraded":"2023-08-25T05:19:17.073615+0000","last_fullsized":"2023-08-25T05:19:17.073615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:25:43.203774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.070012+0000","last_change":"2023-08-25T05:19:17.070012+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.070012+0000","last_undegraded":"2023-08-25T05:19:17.070012+0000","last_fullsized":"2023-08-25T05:19:17.070012+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":287,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-25T05:19:17.074090+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:19:17.074090+0000","last_peered":"2023-08-25T05:19:17.074090+0000","last_clean":"2023-08-25T05:19:17.074090+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:19:17.074090+0000","last_undegraded":"2023-08-25T05:19:17.074090+0000","last_fullsized":"2023-08-25T05:19:17.074090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:11:21.923953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.069774+0000","last_change":"2023-08-25T05:19:17.069774+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.069774+0000","last_undegraded":"2023-08-25T05:19:17.069774+0000","last_fullsized":"2023-08-25T05:19:17.069774+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":314,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-25T05:19:17.072621+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:19:17.072621+0000","last_peered":"2023-08-25T05:19:17.072621+0000","last_clean":"2023-08-25T05:19:17.072621+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:19:17.072621+0000","last_undegraded":"2023-08-25T05:19:17.072621+0000","last_fullsized":"2023-08-25T05:19:17.072621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:47:43.921255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.075567+0000","last_change":"2023-08-25T05:19:17.075567+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.075567+0000","last_undegraded":"2023-08-25T05:19:17.075567+0000","last_fullsized":"2023-08-25T05:19:17.075567+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":334,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-25T05:19:17.071743+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:19:17.071743+0000","last_peered":"2023-08-25T05:19:17.071743+0000","last_clean":"2023-08-25T05:19:17.071743+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:19:17.071743+0000","last_undegraded":"2023-08-25T05:19:17.071743+0000","last_fullsized":"2023-08-25T05:19:17.071743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:32:09.847504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1616,"num_read_kb":3373,"num_write":465,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3598,"ondisk_log_size":3598,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510354,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51824,"kb_used_data":2596,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320016,"statfs":{"total":96636764160,"available":96583696384,"internally_reserved":0,"allocated":2658304,"data_stored":1630624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.51000000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89000000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.47799999999999998,"15min":0.38500000000000001},"max":{"1min":0.98299999999999998,"5min":1.0069999999999999,"15min":1.0089999999999999},"last":0.68200000000000005}]},{"osd":1,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96999999999999997,"5min":0.99399999999999999,"15min":1.0629999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.45100000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0329999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.75700000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.745,"15min":0.748},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46200000000000002},"max":{"1min":0.95699999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.54400000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0109999999999999,"5min":1.405,"15min":1.405},"last":0.66700000000000004}]},{"osd":3,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.496},"max":{"1min":0.92600000000000005,"5min":1.0409999999999999,"15min":1.0469999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.752,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.70299999999999996}]},{"osd":4,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84599999999999997,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82999999999999996,"5min":0.96499999999999997,"15min":0.97499999999999998},"last":0.44500000000000001}]},{"osd":5,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63700000000000001,"15min":0.627},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82899999999999996,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66700000000000004,"15min":0.67200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.90300000000000002,"5min":0.97899999999999998,"15min":1.0309999999999999},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72599999999999998,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94099999999999995,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.45100000000000001},"max":{"1min":0.874,"5min":0.996,"15min":1.0649999999999999},"last":0.47999999999999998}]}]},{"osd":6,"up_from":15,"seq":64424510354,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29048,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342792,"statfs":{"total":96636764160,"available":96607019008,"internally_reserved":0,"allocated":2076672,"data_stored":1046426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.71699999999999997,"15min":0.73899999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91100000000000003,"5min":0.96799999999999997,"15min":1.2070000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.432,"5min":0.42699999999999999,"15min":0.41299999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.61699999999999999}]},{"osd":1,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.73299999999999998,"15min":0.73599999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.74099999999999999,"15min":0.75},"min":{"1min":0.441,"5min":0.441,"15min":0.42999999999999999},"max":{"1min":0.94599999999999995,"5min":1.0169999999999999,"15min":1.3009999999999999},"last":0.66000000000000003}]},{"osd":2,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.77900000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94899999999999995,"5min":0.95699999999999996,"15min":1.1240000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.92700000000000005,"5min":1.0249999999999999,"15min":1.0549999999999999},"last":0.60199999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.499},"max":{"1min":0.82699999999999996,"5min":1.0229999999999999,"15min":1.6020000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.77200000000000002,"15min":0.77400000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.84799999999999998,"5min":1.004,"15min":1.1519999999999999},"last":0.77800000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.375},"max":{"1min":0.81699999999999995,"5min":0.95099999999999996,"15min":1.2589999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.628,"15min":0.62},"min":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.373},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.571},"last":0.49199999999999999}]},{"osd":5,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65400000000000003,"15min":0.65800000000000003},"min":{"1min":0.42099999999999999,"5min":0.41399999999999998,"15min":0.40799999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.0269999999999999},"last":0.753},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.75,"15min":0.746},"min":{"1min":0.503,"5min":0.46999999999999997,"15min":0.44800000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.3380000000000001},"last":0.83399999999999996}]},{"osd":7,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68799999999999994,"15min":0.66800000000000004},"min":{"1min":0.46500000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.0740000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.69299999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90300000000000002,"5min":1.038,"15min":1.667},"last":0.63400000000000001}]}]},{"osd":5,"up_from":14,"seq":60129543057,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55416,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316424,"statfs":{"total":96636764160,"available":96580018176,"internally_reserved":0,"allocated":2076672,"data_stored":1046426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":1.175,"15min":1.175},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.73899999999999999,"15min":0.749},"min":{"1min":0.441,"5min":0.441,"15min":0.41599999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.0620000000000001},"last":0.92200000000000004}]},{"osd":1,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72599999999999998,"15min":0.748},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96099999999999997,"5min":1.02,"15min":1.042},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.76100000000000001,"15min":0.76400000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.70099999999999996}]},{"osd":2,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94299999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90600000000000003,"5min":1.0349999999999999,"15min":1.038},"last":0.90100000000000002}]},{"osd":3,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.86599999999999999,"5min":1.131,"15min":1.131},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.88600000000000001,"5min":1.032,"15min":1.073},"last":0.95799999999999996}]},{"osd":4,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.874}]},{"osd":6,"last update":"Fri Aug 25 05:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.67300000000000004,"15min":0.66300000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.39700000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.046},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68400000000000005,"15min":0.67100000000000004},"min":{"1min":0.496,"5min":0.47299999999999998,"15min":0.41799999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.97799999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.66300000000000003,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.42799999999999999,"15min":0.32100000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73099999999999998,"15min":0.71499999999999997},"min":{"1min":0.56799999999999995,"5min":0.48199999999999998,"15min":0.45100000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":1.149}]}]},{"osd":4,"up_from":14,"seq":60129543057,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41528,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330312,"statfs":{"total":96636764160,"available":96594239488,"internally_reserved":0,"allocated":2064384,"data_stored":1040256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.746,"15min":0.73599999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91200000000000003,"5min":1.0509999999999999,"15min":1.0720000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.79700000000000004,"5min":0.96399999999999997,"15min":0.96999999999999997},"last":0.90100000000000002}]},{"osd":1,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.75900000000000001,"15min":0.76000000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93000000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.752,"15min":0.755},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89800000000000002,"5min":1.008,"15min":1.0660000000000001},"last":0.78100000000000003}]},{"osd":2,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.97099999999999997,"5min":1.002,"15min":1.0669999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47199999999999998},"max":{"1min":0.84399999999999997,"5min":1.093,"15min":1.093},"last":0.93899999999999995}]},{"osd":3,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.78200000000000003,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.51700000000000002},"max":{"1min":1.0129999999999999,"5min":1.0369999999999999,"15min":1.044},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89500000000000002,"5min":1.048,"15min":1.1180000000000001},"last":0.88500000000000001}]},{"osd":5,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56999999999999995,"15min":0.55500000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.751,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.0449999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.746,"15min":0.73899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.81899999999999995}]},{"osd":7,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.628,"15min":0.624},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94399999999999995},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":0.70499999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.46100000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.72099999999999997}]}]},{"osd":3,"up_from":14,"seq":60129543057,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59564,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312276,"statfs":{"total":96636764160,"available":96575770624,"internally_reserved":0,"allocated":2064384,"data_stored":1040256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45400000000000001,"15min":0.46800000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.38100000000000001}]},{"osd":1,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72999999999999998,"5min":0.871,"15min":0.92700000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.628,"15min":0.63100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.88100000000000001,"15min":0.96199999999999997},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59199999999999997,"15min":0.60599999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73999999999999999,"5min":0.85099999999999998,"15min":0.89400000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":0.85599999999999998,"15min":0.89400000000000002},"last":0.44900000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.81200000000000006,"15min":0.80300000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0900000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81200000000000006,"15min":0.83399999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.97599999999999998,"5min":1.2050000000000001,"15min":1.3220000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.81100000000000005,"15min":0.81799999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.054,"5min":1.1830000000000001,"15min":1.2749999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.82099999999999995,"15min":0.82899999999999996},"min":{"1min":0.58899999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"max":{"1min":1.1619999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.85899999999999999,"15min":0.86199999999999999},"min":{"1min":0.58599999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.113,"5min":1.357,"15min":1.357},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83499999999999996,"15min":0.83899999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.085,"5min":1.274,"15min":1.274},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.872,"15min":0.875},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.115,"5min":1.29,"15min":1.2929999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1339999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.70199999999999996}]}]},{"osd":2,"up_from":14,"seq":60129543058,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59576,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312264,"statfs":{"total":96636764160,"available":96575758336,"internally_reserved":0,"allocated":2076672,"data_stored":1046426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.66000000000000003,"5min":0.72599999999999998,"15min":0.76800000000000002},"last":0.31},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.40200000000000002}]},{"osd":1,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33200000000000002},"max":{"1min":0.69599999999999995,"5min":0.76300000000000001,"15min":0.77600000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.628},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.441}]},{"osd":3,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.78100000000000003,"15min":0.83599999999999997},"last":0.378},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82899999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85099999999999998,"15min":0.83599999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1870000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.48299999999999998},"max":{"1min":1.089,"5min":1.163,"15min":1.163},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.82599999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.54300000000000004},"max":{"1min":1.113,"5min":1.393,"15min":1.393},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.53900000000000003},"max":{"1min":1.2310000000000001,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.50700000000000001}]},{"osd":6,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.88200000000000001,"15min":0.85999999999999999},"min":{"1min":0.63800000000000001,"5min":0.63700000000000001,"15min":0.58699999999999997},"max":{"1min":1.169,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.88900000000000001,"15min":0.89400000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1910000000000001,"5min":1.2529999999999999,"15min":1.369},"last":0.55200000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84899999999999998,"15min":0.82999999999999996},"min":{"1min":0.68799999999999994,"5min":0.621,"15min":0.54300000000000004},"max":{"1min":1.131,"5min":1.292,"15min":1.292},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.85399999999999998,"15min":0.83799999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.125,"5min":1.1870000000000001,"15min":1.254},"last":0.51900000000000002}]}]},{"osd":1,"up_from":14,"seq":60129543058,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37368,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334472,"statfs":{"total":96636764160,"available":96598499328,"internally_reserved":0,"allocated":2076672,"data_stored":1046426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.48299999999999998},"min":{"1min":0.32300000000000001,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.752,"15min":0.91700000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.88700000000000001},"last":0.45000000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73699999999999999,"5min":0.749,"15min":0.78900000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82299999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.437,"5min":0.435,"15min":0.40600000000000003},"max":{"1min":0.86799999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.499},"max":{"1min":0.97899999999999998,"5min":1.0680000000000001,"15min":1.212},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.83099999999999996,"15min":0.82499999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.0229999999999999,"5min":1.0429999999999999,"15min":1.163},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.52900000000000003},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.81999999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.083,"5min":1.115,"15min":1.171},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86499999999999999,"15min":0.84599999999999997},"min":{"1min":0.64400000000000002,"5min":0.627,"15min":0.51500000000000001},"max":{"1min":1.107,"5min":1.1579999999999999,"15min":1.3700000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83299999999999996,"15min":0.83399999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.1830000000000001},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.044,"5min":1.1659999999999999,"15min":1.3320000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.58899999999999997},"max":{"1min":1.115,"5min":1.115,"15min":1.268},"last":0.81799999999999995}]}]},{"osd":0,"up_from":14,"seq":60129543057,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60156,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311684,"statfs":{"total":96636764160,"available":96575164416,"internally_reserved":0,"allocated":2670592,"data_stored":1636794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77200000000000002,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.49099999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.503}]},{"osd":2,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.35099999999999998},"max":{"1min":0.73299999999999998,"5min":0.88400000000000001,"15min":0.90700000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54900000000000004,"15min":0.55100000000000005},"min":{"1min":0.42199999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.70299999999999996,"5min":0.83099999999999996,"15min":0.86099999999999999},"last":0.41599999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.379,"5min":0.36399999999999999,"15min":0.34599999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.0409999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.46400000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77300000000000002,"5min":0.878,"15min":0.878},"last":0.57499999999999996}]},{"osd":4,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.82699999999999996,"15min":0.82299999999999995},"min":{"1min":0.63400000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1719999999999999,"5min":1.2649999999999999,"15min":1.3740000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.82299999999999995,"15min":0.82099999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.96099999999999997,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.76100000000000001}]},{"osd":5,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.80300000000000005,"15min":0.80600000000000005},"min":{"1min":0.64600000000000002,"5min":0.56399999999999995,"15min":0.46100000000000002},"max":{"1min":0.96399999999999997,"5min":1.0820000000000001,"15min":1.2210000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.82699999999999996,"15min":0.84099999999999997},"min":{"1min":0.68300000000000005,"5min":0.55700000000000005,"15min":0.54400000000000004},"max":{"1min":1.077,"5min":1.1379999999999999,"15min":1.3260000000000001},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.60999999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0009999999999999,"5min":1.196,"15min":1.196},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.84899999999999998,"15min":0.85899999999999999},"min":{"1min":0.59299999999999997,"5min":0.58999999999999997,"15min":0.58699999999999997},"max":{"1min":1.2030000000000001,"5min":1.216,"15min":1.2849999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.874,"15min":0.871},"min":{"1min":0.63200000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0860000000000001,"5min":1.22,"15min":1.2410000000000001},"last":0.747},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.84499999999999997,"15min":0.84199999999999997},"min":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.58899999999999997},"max":{"1min":1.048,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.73699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:19:23.230 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:19:23.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f25a1540640 1 Processor -- start 2023-08-25T05:19:23.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f25a1540640 1 -- start start 2023-08-25T05:19:23.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f25a1540640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f259c15c690 0x7f259c0d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f25a1540640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f259c0cfb40 0x7f259c0b5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f25a1540640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259c0d0710 con 0x7f259c0d01a0 2023-08-25T05:19:23.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f25a1540640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f259c0d09f0 con 0x7f259c15c690 2023-08-25T05:19:23.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f25a1540640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c0d0cd0 con 0x7f259c0cfb40 2023-08-25T05:19:23.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f259a7fc640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f259c0d01a0 0x7f259c0cf430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38256/0 (socket says 172.21.15.55:38256) 2023-08-25T05:19:23.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f259a7fc640 1 -- 172.21.15.55:0/3025587102 learned_addr learned my addr 172.21.15.55:0/3025587102 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:23.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f259affd640 1 --2- 172.21.15.55:0/3025587102 >> v2:172.21.15.110:3300/0 conn(0x7f259c15c690 0x7f259c0d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f259b7fe640 1 --2- 172.21.15.55:0/3025587102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f259c0cfb40 0x7f259c0b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f2599ffb640 1 -- 172.21.15.55:0/3025587102 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340159788 0 0) 0x7f259c0d0710 con 0x7f259c0d01a0 2023-08-25T05:19:23.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f2599ffb640 1 -- 172.21.15.55:0/3025587102 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2584003530 con 0x7f259c0d01a0 2023-08-25T05:19:23.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f2599ffb640 1 -- 172.21.15.55:0/3025587102 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 450753046 0 0) 0x7f2584003530 con 0x7f259c0d01a0 2023-08-25T05:19:23.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f2599ffb640 1 -- 172.21.15.55:0/3025587102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f259c0cfb40 msgr2=0x7f259c0b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:23.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f2599ffb640 1 --2- 172.21.15.55:0/3025587102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f259c0cfb40 0x7f259c0b5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f2599ffb640 1 -- 172.21.15.55:0/3025587102 >> v2:172.21.15.110:3300/0 conn(0x7f259c15c690 msgr2=0x7f259c0d1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:23.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f2599ffb640 1 --2- 172.21.15.55:0/3025587102 >> v2:172.21.15.110:3300/0 conn(0x7f259c15c690 0x7f259c0d1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f2599ffb640 1 -- 172.21.15.55:0/3025587102 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c0d0fb0 con 0x7f259c0d01a0 2023-08-25T05:19:23.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f2599ffb640 1 -- 172.21.15.55:0/3025587102 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f2590001680 con 0x7f259c0d01a0 2023-08-25T05:19:23.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f2599ffb640 1 -- 172.21.15.55:0/3025587102 >> v1:172.21.15.55:6789/0 conn(0x7f259c0d01a0 legacy=0x7f259c0cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f2599ffb640 1 --2- 172.21.15.55:0/3025587102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2584003980 0x7f2584003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f2599ffb640 1 --2- 172.21.15.55:0/3025587102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840047d0 0x7f2584004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f2599ffb640 1 --2- 172.21.15.55:0/3025587102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f259c0cfb40 0x7f2584005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f2599ffb640 1 -- 172.21.15.55:0/3025587102 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c0d09f0 con 0x7f25840047d0 2023-08-25T05:19:23.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f2599ffb640 1 -- 172.21.15.55:0/3025587102 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c0d0cd0 con 0x7f2584003980 2023-08-25T05:19:23.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f2599ffb640 1 -- 172.21.15.55:0/3025587102 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258400b9c0 con 0x7f259c0cfb40 2023-08-25T05:19:23.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f259a7fc640 1 --2- 172.21.15.55:0/3025587102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840047d0 0x7f2584004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f259b7fe640 1 --2- 172.21.15.55:0/3025587102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f259c0cfb40 0x7f2584005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f259affd640 1 --2- 172.21.15.55:0/3025587102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2584003980 0x7f2584003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f259a7fc640 1 -- 172.21.15.55:0/3025587102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f259c0cfb40 msgr2=0x7f2584005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:23.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f259a7fc640 1 --2- 172.21.15.55:0/3025587102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f259c0cfb40 0x7f2584005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f259a7fc640 1 -- 172.21.15.55:0/3025587102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2584003980 msgr2=0x7f2584003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:23.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f259a7fc640 1 --2- 172.21.15.55:0/3025587102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2584003980 0x7f2584003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f259a7fc640 1 -- 172.21.15.55:0/3025587102 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2584003530 con 0x7f25840047d0 2023-08-25T05:19:23.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.413+0000 7f259affd640 1 --2- 172.21.15.55:0/3025587102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2584003980 0x7f2584003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:23.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.417+0000 7f259a7fc640 1 --2- 172.21.15.55:0/3025587102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840047d0 0x7f2584004c50 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f259000c240 tx=0x7f259001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c674cf21266c2c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:23.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.417+0000 7f2599ffb640 1 -- 172.21.15.55:0/3025587102 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25900058e0 con 0x7f25840047d0 2023-08-25T05:19:23.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.417+0000 7f2599ffb640 1 -- 172.21.15.55:0/3025587102 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2590005a40 con 0x7f25840047d0 2023-08-25T05:19:23.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.417+0000 7f2599ffb640 1 -- 172.21.15.55:0/3025587102 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590005dd0 con 0x7f25840047d0 2023-08-25T05:19:23.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.417+0000 7f25a1540640 1 -- 172.21.15.55:0/3025587102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840047d0 msgr2=0x7f2584004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.417+0000 7f25a1540640 1 --2- 172.21.15.55:0/3025587102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840047d0 0x7f2584004c50 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f259000c240 tx=0x7f259001cc60 comp rx=0 tx=0).stop 2023-08-25T05:19:23.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.417+0000 7f259b7fe640 1 -- 172.21.15.55:0/3025587102 reap_dead start 2023-08-25T05:19:23.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.417+0000 7f25a1540640 1 -- 172.21.15.55:0/3025587102 shutdown_connections 2023-08-25T05:19:23.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.417+0000 7f25a1540640 1 -- 172.21.15.55:0/3025587102 >> 172.21.15.55:0/3025587102 conn(0x7f259c0656c0 msgr2=0x7f259c065ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:23.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.417+0000 7f25a1540640 1 -- 172.21.15.55:0/3025587102 shutdown_connections 2023-08-25T05:19:23.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.417+0000 7f25a1540640 1 -- 172.21.15.55:0/3025587102 wait complete. 2023-08-25T05:19:23.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f25a1540640 1 Processor -- start 2023-08-25T05:19:23.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f25a1540640 1 -- start start 2023-08-25T05:19:23.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f25a1540640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840047d0 0x7f259c1f6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f25a1540640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f259c0b21e0 0x7f259c15a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f25a1540640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f259c0b2640 0x7f259c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f25a1540640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c156e00 con 0x7f25840047d0 2023-08-25T05:19:23.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f25a1540640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c1f6590 con 0x7f259c0b21e0 2023-08-25T05:19:23.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f25a1540640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259c14b420 con 0x7f259c0b2640 2023-08-25T05:19:23.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f259affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840047d0 0x7f259c1f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f259affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840047d0 0x7f259c1f6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51152/0 (socket says 172.21.15.55:51152) 2023-08-25T05:19:23.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f259affd640 1 -- 172.21.15.55:0/1603331928 learned_addr learned my addr 172.21.15.55:0/1603331928 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:23.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f259b7fe640 1 --2- 172.21.15.55:0/1603331928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f259c0b2640 0x7f259c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f259a7fc640 1 --2- 172.21.15.55:0/1603331928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f259c0b21e0 0x7f259c15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f259affd640 1 -- 172.21.15.55:0/1603331928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f259c0b2640 msgr2=0x7f259c15ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f259affd640 1 --2- 172.21.15.55:0/1603331928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f259c0b2640 0x7f259c15ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f259affd640 1 -- 172.21.15.55:0/1603331928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f259c0b21e0 msgr2=0x7f259c15a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f259affd640 1 --2- 172.21.15.55:0/1603331928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f259c0b21e0 0x7f259c15a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f259affd640 1 -- 172.21.15.55:0/1603331928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c0d2360 con 0x7f25840047d0 2023-08-25T05:19:23.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f259a7fc640 1 --2- 172.21.15.55:0/1603331928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f259c0b21e0 0x7f259c15a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:23.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f259affd640 1 --2- 172.21.15.55:0/1603331928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840047d0 0x7f259c1f6050 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f258c0115f0 tx=0x7f258c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:23.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f25837fe640 1 -- 172.21.15.55:0/1603331928 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c004220 con 0x7f25840047d0 2023-08-25T05:19:23.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f25837fe640 1 -- 172.21.15.55:0/1603331928 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258c004380 con 0x7f25840047d0 2023-08-25T05:19:23.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f25837fe640 1 -- 172.21.15.55:0/1603331928 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c00f910 con 0x7f25840047d0 2023-08-25T05:19:23.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f25a1540640 1 -- 172.21.15.55:0/1603331928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259c155d60 con 0x7f25840047d0 2023-08-25T05:19:23.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.421+0000 7f25a1540640 1 -- 172.21.15.55:0/1603331928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259c156320 con 0x7f25840047d0 2023-08-25T05:19:23.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.425+0000 7f25a1540640 1 -- 172.21.15.55:0/1603331928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259c073e50 con 0x7f25840047d0 2023-08-25T05:19:23.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.425+0000 7f25837fe640 1 -- 172.21.15.55:0/1603331928 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f258c00fa70 con 0x7f25840047d0 2023-08-25T05:19:23.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.425+0000 7f25837fe640 1 --2- 172.21.15.55:0/1603331928 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f25880657d0 0x7f2588067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.425+0000 7f25837fe640 1 -- 172.21.15.55:0/1603331928 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f258c083470 con 0x7f25840047d0 2023-08-25T05:19:23.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.425+0000 7f259a7fc640 1 --2- 172.21.15.55:0/1603331928 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f25880657d0 0x7f2588067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.425+0000 7f259a7fc640 1 --2- 172.21.15.55:0/1603331928 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f25880657d0 0x7f2588067c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f25900aa000 tx=0x7f2590001a80 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:23.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.429+0000 7f25837fe640 1 -- 172.21.15.55:0/1603331928 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f258c050ed0 con 0x7f25840047d0 2023-08-25T05:19:23.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.581+0000 7f25a1540640 1 -- 172.21.15.55:0/1603331928 --> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f259c0d21e0 con 0x7f25880657d0 2023-08-25T05:19:23.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.593+0000 7f25837fe640 1 -- 172.21.15.55:0/1603331928 <== mgr.9163 v2:172.21.15.110:6832/221263034 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299474 (secure 0 0 0) 0x7f2590001540 con 0x7f25880657d0 2023-08-25T05:19:23.596 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:23.598 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:19:23.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.593+0000 7f25a1540640 1 -- 172.21.15.55:0/1603331928 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f25880657d0 msgr2=0x7f2588067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.593+0000 7f25a1540640 1 --2- 172.21.15.55:0/1603331928 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f25880657d0 0x7f2588067c90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f25900aa000 tx=0x7f2590001a80 comp rx=0 tx=0).stop 2023-08-25T05:19:23.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.593+0000 7f25a1540640 1 -- 172.21.15.55:0/1603331928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840047d0 msgr2=0x7f259c1f6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.593+0000 7f25a1540640 1 --2- 172.21.15.55:0/1603331928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840047d0 0x7f259c1f6050 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f258c0115f0 tx=0x7f258c011ab0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.593+0000 7f25a1540640 1 -- 172.21.15.55:0/1603331928 shutdown_connections 2023-08-25T05:19:23.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.593+0000 7f25a1540640 1 --2- 172.21.15.55:0/1603331928 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f259c0b2640 0x7f259c15ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.593+0000 7f25a1540640 1 --2- 172.21.15.55:0/1603331928 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f25880657d0 0x7f2588067c90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.593+0000 7f25a1540640 1 --2- 172.21.15.55:0/1603331928 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f259c0b21e0 0x7f259c15a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.593+0000 7f25a1540640 1 --2- 172.21.15.55:0/1603331928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840047d0 0x7f259c1f6050 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.593+0000 7f25a1540640 1 -- 172.21.15.55:0/1603331928 >> 172.21.15.55:0/1603331928 conn(0x7f259c0656c0 msgr2=0x7f259c159140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:23.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.593+0000 7f25a1540640 1 -- 172.21.15.55:0/1603331928 shutdown_connections 2023-08-25T05:19:23.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.593+0000 7f25a1540640 1 -- 172.21.15.55:0/1603331928 wait complete. 2023-08-25T05:19:23.617 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-25T05:19:21.732945+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1616,"num_read_kb":3373,"num_write":465,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3598,"ondisk_log_size":3598,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":394480,"kb_used_data":17348,"kb_used_omap":13,"kb_used_meta":377010,"kb_avail":754580240,"statfs":{"total":773094113280,"available":772690165760,"internally_reserved":0,"allocated":17764352,"data_stored":9533634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":386058328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.665539"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.522751+0000","last_change":"2023-08-25T05:19:17.522751+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.522751+0000","last_undegraded":"2023-08-25T05:19:17.522751+0000","last_fullsized":"2023-08-25T05:19:17.522751+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.073435+0000","last_change":"2023-08-25T05:19:17.073435+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.073435+0000","last_undegraded":"2023-08-25T05:19:17.073435+0000","last_fullsized":"2023-08-25T05:19:17.073435+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.072876+0000","last_change":"2023-08-25T05:19:17.072876+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.072876+0000","last_undegraded":"2023-08-25T05:19:17.072876+0000","last_fullsized":"2023-08-25T05:19:17.072876+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.073317+0000","last_change":"2023-08-25T05:19:17.073317+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.073317+0000","last_undegraded":"2023-08-25T05:19:17.073317+0000","last_fullsized":"2023-08-25T05:19:17.073317+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.070341+0000","last_change":"2023-08-25T05:19:17.070341+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.070341+0000","last_undegraded":"2023-08-25T05:19:17.070341+0000","last_fullsized":"2023-08-25T05:19:17.070341+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.522840+0000","last_change":"2023-08-25T05:19:17.522840+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.522840+0000","last_undegraded":"2023-08-25T05:19:17.522840+0000","last_fullsized":"2023-08-25T05:19:17.522840+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.076088+0000","last_change":"2023-08-25T05:19:17.076088+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.076088+0000","last_undegraded":"2023-08-25T05:19:17.076088+0000","last_fullsized":"2023-08-25T05:19:17.076088+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.522816+0000","last_change":"2023-08-25T05:19:17.522816+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.522816+0000","last_undegraded":"2023-08-25T05:19:17.522816+0000","last_fullsized":"2023-08-25T05:19:17.522816+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.069492+0000","last_change":"2023-08-25T05:19:17.069492+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.069492+0000","last_undegraded":"2023-08-25T05:19:17.069492+0000","last_fullsized":"2023-08-25T05:19:17.069492+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.072851+0000","last_change":"2023-08-25T05:19:17.072851+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.072851+0000","last_undegraded":"2023-08-25T05:19:17.072851+0000","last_fullsized":"2023-08-25T05:19:17.072851+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.073375+0000","last_change":"2023-08-25T05:19:17.073375+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.073375+0000","last_undegraded":"2023-08-25T05:19:17.073375+0000","last_fullsized":"2023-08-25T05:19:17.073375+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.069787+0000","last_change":"2023-08-25T05:19:17.069787+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.069787+0000","last_undegraded":"2023-08-25T05:19:17.069787+0000","last_fullsized":"2023-08-25T05:19:17.069787+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.072264+0000","last_change":"2023-08-25T05:19:17.072264+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.072264+0000","last_undegraded":"2023-08-25T05:19:17.072264+0000","last_fullsized":"2023-08-25T05:19:17.072264+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.069780+0000","last_change":"2023-08-25T05:19:17.069780+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.069780+0000","last_undegraded":"2023-08-25T05:19:17.069780+0000","last_fullsized":"2023-08-25T05:19:17.069780+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.072251+0000","last_change":"2023-08-25T05:19:17.072251+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.072251+0000","last_undegraded":"2023-08-25T05:19:17.072251+0000","last_fullsized":"2023-08-25T05:19:17.072251+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.069829+0000","last_change":"2023-08-25T05:19:17.069829+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.069829+0000","last_undegraded":"2023-08-25T05:19:17.069829+0000","last_fullsized":"2023-08-25T05:19:17.069829+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.069787+0000","last_change":"2023-08-25T05:19:17.069787+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.069787+0000","last_undegraded":"2023-08-25T05:19:17.069787+0000","last_fullsized":"2023-08-25T05:19:17.069787+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.076083+0000","last_change":"2023-08-25T05:19:17.076083+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.076083+0000","last_undegraded":"2023-08-25T05:19:17.076083+0000","last_fullsized":"2023-08-25T05:19:17.076083+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.072874+0000","last_change":"2023-08-25T05:19:17.072874+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.072874+0000","last_undegraded":"2023-08-25T05:19:17.072874+0000","last_fullsized":"2023-08-25T05:19:17.072874+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.522820+0000","last_change":"2023-08-25T05:19:17.522820+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.522820+0000","last_undegraded":"2023-08-25T05:19:17.522820+0000","last_fullsized":"2023-08-25T05:19:17.522820+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.075802+0000","last_change":"2023-08-25T05:19:17.075802+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.075802+0000","last_undegraded":"2023-08-25T05:19:17.075802+0000","last_fullsized":"2023-08-25T05:19:17.075802+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.069502+0000","last_change":"2023-08-25T05:19:17.069502+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.069502+0000","last_undegraded":"2023-08-25T05:19:17.069502+0000","last_fullsized":"2023-08-25T05:19:17.069502+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.075491+0000","last_change":"2023-08-25T05:19:17.075491+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.075491+0000","last_undegraded":"2023-08-25T05:19:17.075491+0000","last_fullsized":"2023-08-25T05:19:17.075491+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.072758+0000","last_change":"2023-08-25T05:19:17.072758+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.072758+0000","last_undegraded":"2023-08-25T05:19:17.072758+0000","last_fullsized":"2023-08-25T05:19:17.072758+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.072340+0000","last_change":"2023-08-25T05:19:17.072340+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.072340+0000","last_undegraded":"2023-08-25T05:19:17.072340+0000","last_fullsized":"2023-08-25T05:19:17.072340+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"159'3598","reported_seq":4389,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-25T05:19:17.074082+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:19:17.074082+0000","last_peered":"2023-08-25T05:19:17.074082+0000","last_clean":"2023-08-25T05:19:17.074082+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:19:17.074082+0000","last_undegraded":"2023-08-25T05:19:17.074082+0000","last_fullsized":"2023-08-25T05:19:17.074082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3598,"log_dups_size":0,"ondisk_log_size":3598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:27:36.787996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1616,"num_read_kb":3373,"num_write":465,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":291,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-25T05:19:17.076878+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:19:17.076878+0000","last_peered":"2023-08-25T05:19:17.076878+0000","last_clean":"2023-08-25T05:19:17.076878+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:19:17.076878+0000","last_undegraded":"2023-08-25T05:19:17.076878+0000","last_fullsized":"2023-08-25T05:19:17.076878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:38:50.546523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.072904+0000","last_change":"2023-08-25T05:19:17.072904+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.072904+0000","last_undegraded":"2023-08-25T05:19:17.072904+0000","last_fullsized":"2023-08-25T05:19:17.072904+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":288,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-25T05:19:17.073982+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:19:17.073982+0000","last_peered":"2023-08-25T05:19:17.073982+0000","last_clean":"2023-08-25T05:19:17.073982+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:19:17.073982+0000","last_undegraded":"2023-08-25T05:19:17.073982+0000","last_fullsized":"2023-08-25T05:19:17.073982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:55:24.713926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.075546+0000","last_change":"2023-08-25T05:19:17.075546+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.075546+0000","last_undegraded":"2023-08-25T05:19:17.075546+0000","last_fullsized":"2023-08-25T05:19:17.075546+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":295,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-25T05:19:17.068014+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:19:17.068014+0000","last_peered":"2023-08-25T05:19:17.068014+0000","last_clean":"2023-08-25T05:19:17.068014+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:19:17.068014+0000","last_undegraded":"2023-08-25T05:19:17.068014+0000","last_fullsized":"2023-08-25T05:19:17.068014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:14:50.902135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.069648+0000","last_change":"2023-08-25T05:19:17.069648+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.069648+0000","last_undegraded":"2023-08-25T05:19:17.069648+0000","last_fullsized":"2023-08-25T05:19:17.069648+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":291,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-25T05:19:17.076582+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:19:17.076582+0000","last_peered":"2023-08-25T05:19:17.076582+0000","last_clean":"2023-08-25T05:19:17.076582+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:19:17.076582+0000","last_undegraded":"2023-08-25T05:19:17.076582+0000","last_fullsized":"2023-08-25T05:19:17.076582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:39:31.789106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.522827+0000","last_change":"2023-08-25T05:19:17.522827+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.522827+0000","last_undegraded":"2023-08-25T05:19:17.522827+0000","last_fullsized":"2023-08-25T05:19:17.522827+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":315,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-25T05:19:17.073615+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:19:17.073615+0000","last_peered":"2023-08-25T05:19:17.073615+0000","last_clean":"2023-08-25T05:19:17.073615+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:19:17.073615+0000","last_undegraded":"2023-08-25T05:19:17.073615+0000","last_fullsized":"2023-08-25T05:19:17.073615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:25:43.203774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.070012+0000","last_change":"2023-08-25T05:19:17.070012+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.070012+0000","last_undegraded":"2023-08-25T05:19:17.070012+0000","last_fullsized":"2023-08-25T05:19:17.070012+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":287,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-25T05:19:17.074090+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:19:17.074090+0000","last_peered":"2023-08-25T05:19:17.074090+0000","last_clean":"2023-08-25T05:19:17.074090+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:19:17.074090+0000","last_undegraded":"2023-08-25T05:19:17.074090+0000","last_fullsized":"2023-08-25T05:19:17.074090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:11:21.923953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.069774+0000","last_change":"2023-08-25T05:19:17.069774+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.069774+0000","last_undegraded":"2023-08-25T05:19:17.069774+0000","last_fullsized":"2023-08-25T05:19:17.069774+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":314,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-25T05:19:17.072621+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:19:17.072621+0000","last_peered":"2023-08-25T05:19:17.072621+0000","last_clean":"2023-08-25T05:19:17.072621+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:19:17.072621+0000","last_undegraded":"2023-08-25T05:19:17.072621+0000","last_fullsized":"2023-08-25T05:19:17.072621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:47:43.921255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:19:18.065974+0000","last_change":"2023-08-25T05:19:18.065974+0000","last_active":"2023-08-25T05:19:18.065974+0000","last_peered":"2023-08-25T05:19:18.065974+0000","last_clean":"2023-08-25T05:19:18.065974+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:18.065974+0000","last_undegraded":"2023-08-25T05:19:18.065974+0000","last_fullsized":"2023-08-25T05:19:18.065974+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":167,"state":"creating+peering","last_fresh":"2023-08-25T05:19:17.075567+0000","last_change":"2023-08-25T05:19:17.075567+0000","last_active":"2023-08-25T05:19:17.055494+0000","last_peered":"2023-08-25T05:19:17.055494+0000","last_clean":"2023-08-25T05:19:17.055494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:19:17.075567+0000","last_undegraded":"2023-08-25T05:19:17.075567+0000","last_fullsized":"2023-08-25T05:19:17.075567+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":334,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-08-25T05:19:17.071743+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:19:17.071743+0000","last_peered":"2023-08-25T05:19:17.071743+0000","last_clean":"2023-08-25T05:19:17.071743+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:19:17.071743+0000","last_undegraded":"2023-08-25T05:19:17.071743+0000","last_fullsized":"2023-08-25T05:19:17.071743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:32:09.847504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1616,"num_read_kb":3373,"num_write":465,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3598,"ondisk_log_size":3598,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510354,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51824,"kb_used_data":2596,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320016,"statfs":{"total":96636764160,"available":96583696384,"internally_reserved":0,"allocated":2658304,"data_stored":1630624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.51000000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89000000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.47799999999999998,"15min":0.38500000000000001},"max":{"1min":0.98299999999999998,"5min":1.0069999999999999,"15min":1.0089999999999999},"last":0.68200000000000005}]},{"osd":1,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96999999999999997,"5min":0.99399999999999999,"15min":1.0629999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.45100000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0329999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.75700000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.745,"15min":0.748},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46200000000000002},"max":{"1min":0.95699999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.54400000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0109999999999999,"5min":1.405,"15min":1.405},"last":0.66700000000000004}]},{"osd":3,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.496},"max":{"1min":0.92600000000000005,"5min":1.0409999999999999,"15min":1.0469999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.752,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.70299999999999996}]},{"osd":4,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84599999999999997,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82999999999999996,"5min":0.96499999999999997,"15min":0.97499999999999998},"last":0.44500000000000001}]},{"osd":5,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63700000000000001,"15min":0.627},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82899999999999996,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66700000000000004,"15min":0.67200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.90300000000000002,"5min":0.97899999999999998,"15min":1.0309999999999999},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72599999999999998,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94099999999999995,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.45100000000000001},"max":{"1min":0.874,"5min":0.996,"15min":1.0649999999999999},"last":0.47999999999999998}]}]},{"osd":6,"up_from":15,"seq":64424510354,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29048,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342792,"statfs":{"total":96636764160,"available":96607019008,"internally_reserved":0,"allocated":2076672,"data_stored":1046426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.71699999999999997,"15min":0.73899999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91100000000000003,"5min":0.96799999999999997,"15min":1.2070000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.432,"5min":0.42699999999999999,"15min":0.41299999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.61699999999999999}]},{"osd":1,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.73299999999999998,"15min":0.73599999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.74099999999999999,"15min":0.75},"min":{"1min":0.441,"5min":0.441,"15min":0.42999999999999999},"max":{"1min":0.94599999999999995,"5min":1.0169999999999999,"15min":1.3009999999999999},"last":0.66000000000000003}]},{"osd":2,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.77900000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94899999999999995,"5min":0.95699999999999996,"15min":1.1240000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.92700000000000005,"5min":1.0249999999999999,"15min":1.0549999999999999},"last":0.60199999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.499},"max":{"1min":0.82699999999999996,"5min":1.0229999999999999,"15min":1.6020000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.77200000000000002,"15min":0.77400000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.84799999999999998,"5min":1.004,"15min":1.1519999999999999},"last":0.77800000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.375},"max":{"1min":0.81699999999999995,"5min":0.95099999999999996,"15min":1.2589999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.628,"15min":0.62},"min":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.373},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.571},"last":0.49199999999999999}]},{"osd":5,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65400000000000003,"15min":0.65800000000000003},"min":{"1min":0.42099999999999999,"5min":0.41399999999999998,"15min":0.40799999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.0269999999999999},"last":0.753},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.75,"15min":0.746},"min":{"1min":0.503,"5min":0.46999999999999997,"15min":0.44800000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.3380000000000001},"last":0.83399999999999996}]},{"osd":7,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68799999999999994,"15min":0.66800000000000004},"min":{"1min":0.46500000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.0740000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.69299999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90300000000000002,"5min":1.038,"15min":1.667},"last":0.63400000000000001}]}]},{"osd":5,"up_from":14,"seq":60129543057,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55416,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316424,"statfs":{"total":96636764160,"available":96580018176,"internally_reserved":0,"allocated":2076672,"data_stored":1046426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":1.175,"15min":1.175},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.73899999999999999,"15min":0.749},"min":{"1min":0.441,"5min":0.441,"15min":0.41599999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.0620000000000001},"last":0.92200000000000004}]},{"osd":1,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72599999999999998,"15min":0.748},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96099999999999997,"5min":1.02,"15min":1.042},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.76100000000000001,"15min":0.76400000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.70099999999999996}]},{"osd":2,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94299999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90600000000000003,"5min":1.0349999999999999,"15min":1.038},"last":0.90100000000000002}]},{"osd":3,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.86599999999999999,"5min":1.131,"15min":1.131},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.88600000000000001,"5min":1.032,"15min":1.073},"last":0.95799999999999996}]},{"osd":4,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.874}]},{"osd":6,"last update":"Fri Aug 25 05:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.67300000000000004,"15min":0.66300000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.39700000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":1.046},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68400000000000005,"15min":0.67100000000000004},"min":{"1min":0.496,"5min":0.47299999999999998,"15min":0.41799999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.97799999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.66300000000000003,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.42799999999999999,"15min":0.32100000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73099999999999998,"15min":0.71499999999999997},"min":{"1min":0.56799999999999995,"5min":0.48199999999999998,"15min":0.45100000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":1.149}]}]},{"osd":4,"up_from":14,"seq":60129543057,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41528,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330312,"statfs":{"total":96636764160,"available":96594239488,"internally_reserved":0,"allocated":2064384,"data_stored":1040256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.746,"15min":0.73599999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91200000000000003,"5min":1.0509999999999999,"15min":1.0720000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.79700000000000004,"5min":0.96399999999999997,"15min":0.96999999999999997},"last":0.90100000000000002}]},{"osd":1,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.75900000000000001,"15min":0.76000000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93000000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.752,"15min":0.755},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89800000000000002,"5min":1.008,"15min":1.0660000000000001},"last":0.78100000000000003}]},{"osd":2,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.97099999999999997,"5min":1.002,"15min":1.0669999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47199999999999998},"max":{"1min":0.84399999999999997,"5min":1.093,"15min":1.093},"last":0.93899999999999995}]},{"osd":3,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.78200000000000003,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.51700000000000002},"max":{"1min":1.0129999999999999,"5min":1.0369999999999999,"15min":1.044},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89500000000000002,"5min":1.048,"15min":1.1180000000000001},"last":0.88500000000000001}]},{"osd":5,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56999999999999995,"15min":0.55500000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.751,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.0449999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.746,"15min":0.73899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.81899999999999995}]},{"osd":7,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.628,"15min":0.624},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94399999999999995},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":0.70499999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.46100000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.72099999999999997}]}]},{"osd":3,"up_from":14,"seq":60129543057,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59564,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312276,"statfs":{"total":96636764160,"available":96575770624,"internally_reserved":0,"allocated":2064384,"data_stored":1040256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45400000000000001,"15min":0.46800000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.38100000000000001}]},{"osd":1,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72999999999999998,"5min":0.871,"15min":0.92700000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.628,"15min":0.63100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.88100000000000001,"15min":0.96199999999999997},"last":0.52400000000000002}]},{"osd":2,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59199999999999997,"15min":0.60599999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73999999999999999,"5min":0.85099999999999998,"15min":0.89400000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":0.85599999999999998,"15min":0.89400000000000002},"last":0.44900000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.81200000000000006,"15min":0.80300000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0900000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81200000000000006,"15min":0.83399999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.97599999999999998,"5min":1.2050000000000001,"15min":1.3220000000000001},"last":0.60999999999999999}]},{"osd":5,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.81100000000000005,"15min":0.81799999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.054,"5min":1.1830000000000001,"15min":1.2749999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.82099999999999995,"15min":0.82899999999999996},"min":{"1min":0.58899999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"max":{"1min":1.1619999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.85899999999999999,"15min":0.86199999999999999},"min":{"1min":0.58599999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.113,"5min":1.357,"15min":1.357},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83499999999999996,"15min":0.83899999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.085,"5min":1.274,"15min":1.274},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.872,"15min":0.875},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.115,"5min":1.29,"15min":1.2929999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1339999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.70199999999999996}]}]},{"osd":2,"up_from":14,"seq":60129543058,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59576,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312264,"statfs":{"total":96636764160,"available":96575758336,"internally_reserved":0,"allocated":2076672,"data_stored":1046426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.66000000000000003,"5min":0.72599999999999998,"15min":0.76800000000000002},"last":0.31},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.40200000000000002}]},{"osd":1,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33200000000000002},"max":{"1min":0.69599999999999995,"5min":0.76300000000000001,"15min":0.77600000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.628},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.441}]},{"osd":3,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.78100000000000003,"15min":0.83599999999999997},"last":0.378},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82899999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85099999999999998,"15min":0.83599999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1870000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.48299999999999998},"max":{"1min":1.089,"5min":1.163,"15min":1.163},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.82599999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.54300000000000004},"max":{"1min":1.113,"5min":1.393,"15min":1.393},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.53900000000000003},"max":{"1min":1.2310000000000001,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.50700000000000001}]},{"osd":6,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.88200000000000001,"15min":0.85999999999999999},"min":{"1min":0.63800000000000001,"5min":0.63700000000000001,"15min":0.58699999999999997},"max":{"1min":1.169,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.88900000000000001,"15min":0.89400000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1910000000000001,"5min":1.2529999999999999,"15min":1.369},"last":0.55200000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84899999999999998,"15min":0.82999999999999996},"min":{"1min":0.68799999999999994,"5min":0.621,"15min":0.54300000000000004},"max":{"1min":1.131,"5min":1.292,"15min":1.292},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.85399999999999998,"15min":0.83799999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.125,"5min":1.1870000000000001,"15min":1.254},"last":0.51900000000000002}]}]},{"osd":1,"up_from":14,"seq":60129543058,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37368,"kb_used_data":2028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334472,"statfs":{"total":96636764160,"available":96598499328,"internally_reserved":0,"allocated":2076672,"data_stored":1046426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.48299999999999998},"min":{"1min":0.32300000000000001,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.752,"15min":0.91700000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.88700000000000001},"last":0.45000000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73699999999999999,"5min":0.749,"15min":0.78900000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42299999999999999}]},{"osd":3,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82299999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.437,"5min":0.435,"15min":0.40600000000000003},"max":{"1min":0.86799999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.499},"max":{"1min":0.97899999999999998,"5min":1.0680000000000001,"15min":1.212},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.83099999999999996,"15min":0.82499999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.0229999999999999,"5min":1.0429999999999999,"15min":1.163},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.52900000000000003},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.81999999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.083,"5min":1.115,"15min":1.171},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86499999999999999,"15min":0.84599999999999997},"min":{"1min":0.64400000000000002,"5min":0.627,"15min":0.51500000000000001},"max":{"1min":1.107,"5min":1.1579999999999999,"15min":1.3700000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83299999999999996,"15min":0.83399999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.1830000000000001},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.044,"5min":1.1659999999999999,"15min":1.3320000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.58899999999999997},"max":{"1min":1.115,"5min":1.115,"15min":1.268},"last":0.81799999999999995}]}]},{"osd":0,"up_from":14,"seq":60129543057,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60156,"kb_used_data":2608,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311684,"statfs":{"total":96636764160,"available":96575164416,"internally_reserved":0,"allocated":2670592,"data_stored":1636794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.77200000000000002,"5min":0.80900000000000005,"15min":0.82599999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.49099999999999999,"5min":0.438,"15min":0.438},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.503}]},{"osd":2,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.35099999999999998},"max":{"1min":0.73299999999999998,"5min":0.88400000000000001,"15min":0.90700000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54900000000000004,"15min":0.55100000000000005},"min":{"1min":0.42199999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.70299999999999996,"5min":0.83099999999999996,"15min":0.86099999999999999},"last":0.41599999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.51300000000000001},"min":{"1min":0.379,"5min":0.36399999999999999,"15min":0.34599999999999997},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":1.0409999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.46400000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.77300000000000002,"5min":0.878,"15min":0.878},"last":0.57499999999999996}]},{"osd":4,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.82699999999999996,"15min":0.82299999999999995},"min":{"1min":0.63400000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1719999999999999,"5min":1.2649999999999999,"15min":1.3740000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.82299999999999995,"15min":0.82099999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.96099999999999997,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.76100000000000001}]},{"osd":5,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.80300000000000005,"15min":0.80600000000000005},"min":{"1min":0.64600000000000002,"5min":0.56399999999999995,"15min":0.46100000000000002},"max":{"1min":0.96399999999999997,"5min":1.0820000000000001,"15min":1.2210000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.82699999999999996,"15min":0.84099999999999997},"min":{"1min":0.68300000000000005,"5min":0.55700000000000005,"15min":0.54400000000000004},"max":{"1min":1.077,"5min":1.1379999999999999,"15min":1.3260000000000001},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.60999999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0009999999999999,"5min":1.196,"15min":1.196},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.84899999999999998,"15min":0.85899999999999999},"min":{"1min":0.59299999999999997,"5min":0.58999999999999997,"15min":0.58699999999999997},"max":{"1min":1.2030000000000001,"5min":1.216,"15min":1.2849999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Aug 25 05:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.874,"15min":0.871},"min":{"1min":0.63200000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0860000000000001,"5min":1.22,"15min":1.2410000000000001},"last":0.747},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.84499999999999997,"15min":0.84199999999999997},"min":{"1min":0.64500000000000002,"5min":0.60899999999999999,"15min":0.58899999999999997},"max":{"1min":1.048,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.73699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:19:23.625 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:19:23.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.801+0000 7f1b2e49c640 1 Processor -- start 2023-08-25T05:19:23.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.801+0000 7f1b2e49c640 1 -- start start 2023-08-25T05:19:23.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.801+0000 7f1b2e49c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1b280ceeb0 0x7f1b280cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.801+0000 7f1b2e49c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b280cc880 con 0x7f1b280ad950 2023-08-25T05:19:23.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.801+0000 7f1b2e49c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b280ccb60 con 0x7f1b280c89f0 2023-08-25T05:19:23.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.801+0000 7f1b2e49c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b280b11f0 con 0x7f1b280ceeb0 2023-08-25T05:19:23.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.801+0000 7f1b27fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1b280ad950 0x7f1b280ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38262/0 (socket says 172.21.15.55:38262) 2023-08-25T05:19:23.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.801+0000 7f1b27fff640 1 -- 172.21.15.55:0/4143424349 learned_addr learned my addr 172.21.15.55:0/4143424349 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:23.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.801+0000 7f1b277fe640 1 --2- 172.21.15.55:0/4143424349 >> v2:172.21.15.55:3300/0 conn(0x7f1b280ceeb0 0x7f1b280cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.805+0000 7f1b26ffd640 1 -- 172.21.15.55:0/4143424349 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1717126382 0 0) 0x7f1b280cc880 con 0x7f1b280ad950 2023-08-25T05:19:23.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.805+0000 7f1b26ffd640 1 -- 172.21.15.55:0/4143424349 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b10003530 con 0x7f1b280ad950 2023-08-25T05:19:23.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.805+0000 7f1b26ffd640 1 -- 172.21.15.55:0/4143424349 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277707909 0 0) 0x7f1b280ccb60 con 0x7f1b280c89f0 2023-08-25T05:19:23.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.805+0000 7f1b277fe640 1 -- 172.21.15.55:0/4143424349 >> v1:172.21.15.110:6789/0 conn(0x7f1b280c89f0 legacy=0x7f1b280b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.805+0000 7f1b277fe640 1 -- 172.21.15.55:0/4143424349 >> v1:172.21.15.55:6789/0 conn(0x7f1b280ad950 legacy=0x7f1b280ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.805+0000 7f1b277fe640 1 -- 172.21.15.55:0/4143424349 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b280cce40 con 0x7f1b280ceeb0 2023-08-25T05:19:23.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.805+0000 7f1b277fe640 1 --2- 172.21.15.55:0/4143424349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280ceeb0 0x7f1b280cc2a0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0097c0 tx=0x7f1b1c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91c724bf0b9af38 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:23.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.805+0000 7f1b26ffd640 1 -- 172.21.15.55:0/4143424349 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0ab600 con 0x7f1b280ceeb0 2023-08-25T05:19:23.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.805+0000 7f1b26ffd640 1 -- 172.21.15.55:0/4143424349 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c0a7050 con 0x7f1b280ceeb0 2023-08-25T05:19:23.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.805+0000 7f1b26ffd640 1 -- 172.21.15.55:0/4143424349 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0ab980 con 0x7f1b280ceeb0 2023-08-25T05:19:23.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.805+0000 7f1b2e49c640 1 -- 172.21.15.55:0/4143424349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280ceeb0 msgr2=0x7f1b280cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.805+0000 7f1b2e49c640 1 --2- 172.21.15.55:0/4143424349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280ceeb0 0x7f1b280cc2a0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0097c0 tx=0x7f1b1c01c3f0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b2e49c640 1 -- 172.21.15.55:0/4143424349 shutdown_connections 2023-08-25T05:19:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b2e49c640 1 --2- 172.21.15.55:0/4143424349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280ceeb0 0x7f1b280cc2a0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b2e49c640 1 -- 172.21.15.55:0/4143424349 >> 172.21.15.55:0/4143424349 conn(0x7f1b28069d00 msgr2=0x7f1b2806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b2e49c640 1 -- 172.21.15.55:0/4143424349 shutdown_connections 2023-08-25T05:19:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b2e49c640 1 -- 172.21.15.55:0/4143424349 wait complete. 2023-08-25T05:19:23.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b2e49c640 1 Processor -- start 2023-08-25T05:19:23.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b2e49c640 1 -- start start 2023-08-25T05:19:23.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b2e49c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b280ad950 0x7f1b280acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b2e49c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280c89f0 0x7f1b2815d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b2e49c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b280ceeb0 0x7f1b280ac350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b2e49c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b28070a90 con 0x7f1b280c89f0 2023-08-25T05:19:23.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b2e49c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b28154cf0 con 0x7f1b280ad950 2023-08-25T05:19:23.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b2e49c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b28070440 con 0x7f1b280ceeb0 2023-08-25T05:19:23.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b277fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280c89f0 0x7f1b2815d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b277fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280c89f0 0x7f1b2815d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51174/0 (socket says 172.21.15.55:51174) 2023-08-25T05:19:23.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b277fe640 1 -- 172.21.15.55:0/2468805047 learned_addr learned my addr 172.21.15.55:0/2468805047 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:23.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b27fff640 1 --2- 172.21.15.55:0/2468805047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b280ad950 0x7f1b280acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b2ca39640 1 --2- 172.21.15.55:0/2468805047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b280ceeb0 0x7f1b280ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b277fe640 1 -- 172.21.15.55:0/2468805047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b280ceeb0 msgr2=0x7f1b280ac350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b277fe640 1 --2- 172.21.15.55:0/2468805047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b280ceeb0 0x7f1b280ac350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b277fe640 1 -- 172.21.15.55:0/2468805047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b280ad950 msgr2=0x7f1b280acc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b277fe640 1 --2- 172.21.15.55:0/2468805047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b280ad950 0x7f1b280acc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b277fe640 1 -- 172.21.15.55:0/2468805047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c009420 con 0x7f1b280c89f0 2023-08-25T05:19:23.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.809+0000 7f1b277fe640 1 --2- 172.21.15.55:0/2468805047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280c89f0 0x7f1b2815d8b0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c019000 tx=0x7f1b1c019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:23.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.813+0000 7f1b24ff9640 1 -- 172.21.15.55:0/2468805047 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0ba070 con 0x7f1b280c89f0 2023-08-25T05:19:23.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.813+0000 7f1b24ff9640 1 -- 172.21.15.55:0/2468805047 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c006e20 con 0x7f1b280c89f0 2023-08-25T05:19:23.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.813+0000 7f1b2e49c640 1 -- 172.21.15.55:0/2468805047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b28070720 con 0x7f1b280c89f0 2023-08-25T05:19:23.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.813+0000 7f1b24ff9640 1 -- 172.21.15.55:0/2468805047 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0b4400 con 0x7f1b280c89f0 2023-08-25T05:19:23.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.813+0000 7f1b2e49c640 1 -- 172.21.15.55:0/2468805047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b28070f20 con 0x7f1b280c89f0 2023-08-25T05:19:23.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.813+0000 7f1b2e49c640 1 -- 172.21.15.55:0/2468805047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2804dbe0 con 0x7f1b280c89f0 2023-08-25T05:19:23.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.813+0000 7f1b24ff9640 1 -- 172.21.15.55:0/2468805047 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f1b1c0b2040 con 0x7f1b280c89f0 2023-08-25T05:19:23.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.813+0000 7f1b24ff9640 1 --2- 172.21.15.55:0/2468805047 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f1b140657a0 0x7f1b14067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:23.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.813+0000 7f1b24ff9640 1 -- 172.21.15.55:0/2468805047 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1b1c11c740 con 0x7f1b280c89f0 2023-08-25T05:19:23.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.813+0000 7f1b27fff640 1 --2- 172.21.15.55:0/2468805047 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f1b140657a0 0x7f1b14067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:23.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.817+0000 7f1b27fff640 1 --2- 172.21.15.55:0/2468805047 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f1b140657a0 0x7f1b14067c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b18005890 tx=0x7f1b18009040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:23.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.817+0000 7f1b24ff9640 1 -- 172.21.15.55:0/2468805047 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1b1c0e9ff0 con 0x7f1b280c89f0 2023-08-25T05:19:23.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.969+0000 7f1b2e49c640 1 -- 172.21.15.55:0/2468805047 --> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b280cddf0 con 0x7f1b140657a0 2023-08-25T05:19:23.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.981+0000 7f1b24ff9640 1 -- 172.21.15.55:0/2468805047 <== mgr.9163 v2:172.21.15.110:6832/221263034 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311610 (secure 0 0 0) 0x7f1b280cddf0 con 0x7f1b140657a0 2023-08-25T05:19:23.984 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:23.985 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:19:23.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.981+0000 7f1b2e49c640 1 -- 172.21.15.55:0/2468805047 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f1b140657a0 msgr2=0x7f1b14067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.981+0000 7f1b2e49c640 1 --2- 172.21.15.55:0/2468805047 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f1b140657a0 0x7f1b14067c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b18005890 tx=0x7f1b18009040 comp rx=0 tx=0).stop 2023-08-25T05:19:23.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.981+0000 7f1b2e49c640 1 -- 172.21.15.55:0/2468805047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280c89f0 msgr2=0x7f1b2815d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:23.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.981+0000 7f1b2e49c640 1 --2- 172.21.15.55:0/2468805047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280c89f0 0x7f1b2815d8b0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c019000 tx=0x7f1b1c019190 comp rx=0 tx=0).stop 2023-08-25T05:19:23.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.981+0000 7f1b2e49c640 1 -- 172.21.15.55:0/2468805047 shutdown_connections 2023-08-25T05:19:23.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.981+0000 7f1b2e49c640 1 --2- 172.21.15.55:0/2468805047 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1b280ceeb0 0x7f1b280ac350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.981+0000 7f1b2e49c640 1 --2- 172.21.15.55:0/2468805047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b280c89f0 0x7f1b2815d8b0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.981+0000 7f1b2e49c640 1 --2- 172.21.15.55:0/2468805047 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f1b140657a0 0x7f1b14067c60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.981+0000 7f1b2e49c640 1 --2- 172.21.15.55:0/2468805047 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1b280ad950 0x7f1b280acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:23.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.981+0000 7f1b2e49c640 1 -- 172.21.15.55:0/2468805047 >> 172.21.15.55:0/2468805047 conn(0x7f1b28069d00 msgr2=0x7f1b280ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:23.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.981+0000 7f1b2e49c640 1 -- 172.21.15.55:0/2468805047 shutdown_connections 2023-08-25T05:19:23.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:23.981+0000 7f1b2e49c640 1 -- 172.21.15.55:0/2468805047 wait complete. 2023-08-25T05:19:24.004 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-25T05:19:23.733350+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1616,"num_read_kb":3373,"num_write":509,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3636,"ondisk_log_size":3636,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":192,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":394884,"kb_used_data":17736,"kb_used_omap":13,"kb_used_meta":377010,"kb_avail":754579836,"statfs":{"total":773094113280,"available":772689752064,"internally_reserved":0,"allocated":18161664,"data_stored":9720236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":386058328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001215"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387222+0000","last_change":"2023-08-25T05:19:19.105458+0000","last_active":"2023-08-25T05:19:20.387222+0000","last_peered":"2023-08-25T05:19:20.387222+0000","last_clean":"2023-08-25T05:19:20.387222+0000","last_became_active":"2023-08-25T05:19:19.104947+0000","last_became_peered":"2023-08-25T05:19:19.104947+0000","last_unstale":"2023-08-25T05:19:20.387222+0000","last_undegraded":"2023-08-25T05:19:20.387222+0000","last_fullsized":"2023-08-25T05:19:20.387222+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:04:23.125561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670934+0000","last_change":"2023-08-25T05:19:19.097697+0000","last_active":"2023-08-25T05:19:20.670934+0000","last_peered":"2023-08-25T05:19:20.670934+0000","last_clean":"2023-08-25T05:19:20.670934+0000","last_became_active":"2023-08-25T05:19:19.097401+0000","last_became_peered":"2023-08-25T05:19:19.097401+0000","last_unstale":"2023-08-25T05:19:20.670934+0000","last_undegraded":"2023-08-25T05:19:20.670934+0000","last_fullsized":"2023-08-25T05:19:20.670934+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:22:06.016604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670720+0000","last_change":"2023-08-25T05:19:19.109971+0000","last_active":"2023-08-25T05:19:20.670720+0000","last_peered":"2023-08-25T05:19:20.670720+0000","last_clean":"2023-08-25T05:19:20.670720+0000","last_became_active":"2023-08-25T05:19:19.109681+0000","last_became_peered":"2023-08-25T05:19:19.109681+0000","last_unstale":"2023-08-25T05:19:20.670720+0000","last_undegraded":"2023-08-25T05:19:20.670720+0000","last_fullsized":"2023-08-25T05:19:20.670720+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:59:08.669080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101723+0000","last_change":"2023-08-25T05:19:19.087934+0000","last_active":"2023-08-25T05:19:20.101723+0000","last_peered":"2023-08-25T05:19:20.101723+0000","last_clean":"2023-08-25T05:19:20.101723+0000","last_became_active":"2023-08-25T05:19:19.087573+0000","last_became_peered":"2023-08-25T05:19:19.087573+0000","last_unstale":"2023-08-25T05:19:20.101723+0000","last_undegraded":"2023-08-25T05:19:20.101723+0000","last_fullsized":"2023-08-25T05:19:20.101723+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:08:47.094804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100398+0000","last_change":"2023-08-25T05:19:19.110091+0000","last_active":"2023-08-25T05:19:20.100398+0000","last_peered":"2023-08-25T05:19:20.100398+0000","last_clean":"2023-08-25T05:19:20.100398+0000","last_became_active":"2023-08-25T05:19:19.108036+0000","last_became_peered":"2023-08-25T05:19:19.108036+0000","last_unstale":"2023-08-25T05:19:20.100398+0000","last_undegraded":"2023-08-25T05:19:20.100398+0000","last_fullsized":"2023-08-25T05:19:20.100398+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:56.343935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100257+0000","last_change":"2023-08-25T05:19:19.111006+0000","last_active":"2023-08-25T05:19:20.100257+0000","last_peered":"2023-08-25T05:19:20.100257+0000","last_clean":"2023-08-25T05:19:20.100257+0000","last_became_active":"2023-08-25T05:19:19.110679+0000","last_became_peered":"2023-08-25T05:19:19.110679+0000","last_unstale":"2023-08-25T05:19:20.100257+0000","last_undegraded":"2023-08-25T05:19:20.100257+0000","last_fullsized":"2023-08-25T05:19:20.100257+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:30:50.264686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386815+0000","last_change":"2023-08-25T05:19:19.111964+0000","last_active":"2023-08-25T05:19:20.386815+0000","last_peered":"2023-08-25T05:19:20.386815+0000","last_clean":"2023-08-25T05:19:20.386815+0000","last_became_active":"2023-08-25T05:19:19.110964+0000","last_became_peered":"2023-08-25T05:19:19.110964+0000","last_unstale":"2023-08-25T05:19:20.386815+0000","last_undegraded":"2023-08-25T05:19:20.386815+0000","last_fullsized":"2023-08-25T05:19:20.386815+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:36:09.034953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102061+0000","last_change":"2023-08-25T05:19:19.096673+0000","last_active":"2023-08-25T05:19:20.102061+0000","last_peered":"2023-08-25T05:19:20.102061+0000","last_clean":"2023-08-25T05:19:20.102061+0000","last_became_active":"2023-08-25T05:19:19.094244+0000","last_became_peered":"2023-08-25T05:19:19.094244+0000","last_unstale":"2023-08-25T05:19:20.102061+0000","last_undegraded":"2023-08-25T05:19:20.102061+0000","last_fullsized":"2023-08-25T05:19:20.102061+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:17:01.615689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100562+0000","last_change":"2023-08-25T05:19:19.118566+0000","last_active":"2023-08-25T05:19:20.100562+0000","last_peered":"2023-08-25T05:19:20.100562+0000","last_clean":"2023-08-25T05:19:20.100562+0000","last_became_active":"2023-08-25T05:19:19.112749+0000","last_became_peered":"2023-08-25T05:19:19.112749+0000","last_unstale":"2023-08-25T05:19:20.100562+0000","last_undegraded":"2023-08-25T05:19:20.100562+0000","last_fullsized":"2023-08-25T05:19:20.100562+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:29:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100587+0000","last_change":"2023-08-25T05:19:19.110305+0000","last_active":"2023-08-25T05:19:20.100587+0000","last_peered":"2023-08-25T05:19:20.100587+0000","last_clean":"2023-08-25T05:19:20.100587+0000","last_became_active":"2023-08-25T05:19:19.108828+0000","last_became_peered":"2023-08-25T05:19:19.108828+0000","last_unstale":"2023-08-25T05:19:20.100587+0000","last_undegraded":"2023-08-25T05:19:20.100587+0000","last_fullsized":"2023-08-25T05:19:20.100587+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:59:56.021201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669617+0000","last_change":"2023-08-25T05:19:19.101083+0000","last_active":"2023-08-25T05:19:20.669617+0000","last_peered":"2023-08-25T05:19:20.669617+0000","last_clean":"2023-08-25T05:19:20.669617+0000","last_became_active":"2023-08-25T05:19:19.100783+0000","last_became_peered":"2023-08-25T05:19:19.100783+0000","last_unstale":"2023-08-25T05:19:20.669617+0000","last_undegraded":"2023-08-25T05:19:20.669617+0000","last_fullsized":"2023-08-25T05:19:20.669617+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:06:27.041983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102187+0000","last_change":"2023-08-25T05:19:19.105347+0000","last_active":"2023-08-25T05:19:20.102187+0000","last_peered":"2023-08-25T05:19:20.102187+0000","last_clean":"2023-08-25T05:19:20.102187+0000","last_became_active":"2023-08-25T05:19:19.105087+0000","last_became_peered":"2023-08-25T05:19:19.105087+0000","last_unstale":"2023-08-25T05:19:20.102187+0000","last_undegraded":"2023-08-25T05:19:20.102187+0000","last_fullsized":"2023-08-25T05:19:20.102187+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:53:45.015387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.099965+0000","last_change":"2023-08-25T05:19:19.110786+0000","last_active":"2023-08-25T05:19:20.099965+0000","last_peered":"2023-08-25T05:19:20.099965+0000","last_clean":"2023-08-25T05:19:20.099965+0000","last_became_active":"2023-08-25T05:19:19.108699+0000","last_became_peered":"2023-08-25T05:19:19.108699+0000","last_unstale":"2023-08-25T05:19:20.099965+0000","last_undegraded":"2023-08-25T05:19:20.099965+0000","last_fullsized":"2023-08-25T05:19:20.099965+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:59.578688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.103004+0000","last_change":"2023-08-25T05:19:19.104814+0000","last_active":"2023-08-25T05:19:20.103004+0000","last_peered":"2023-08-25T05:19:20.103004+0000","last_clean":"2023-08-25T05:19:20.103004+0000","last_became_active":"2023-08-25T05:19:19.104517+0000","last_became_peered":"2023-08-25T05:19:19.104517+0000","last_unstale":"2023-08-25T05:19:20.103004+0000","last_undegraded":"2023-08-25T05:19:20.103004+0000","last_fullsized":"2023-08-25T05:19:20.103004+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:48:12.851567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670538+0000","last_change":"2023-08-25T05:19:19.101295+0000","last_active":"2023-08-25T05:19:20.670538+0000","last_peered":"2023-08-25T05:19:20.670538+0000","last_clean":"2023-08-25T05:19:20.670538+0000","last_became_active":"2023-08-25T05:19:19.100728+0000","last_became_peered":"2023-08-25T05:19:19.100728+0000","last_unstale":"2023-08-25T05:19:20.670538+0000","last_undegraded":"2023-08-25T05:19:20.670538+0000","last_fullsized":"2023-08-25T05:19:20.670538+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:06:43.803011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.099751+0000","last_change":"2023-08-25T05:19:19.105817+0000","last_active":"2023-08-25T05:19:20.099751+0000","last_peered":"2023-08-25T05:19:20.099751+0000","last_clean":"2023-08-25T05:19:20.099751+0000","last_became_active":"2023-08-25T05:19:19.105440+0000","last_became_peered":"2023-08-25T05:19:19.105440+0000","last_unstale":"2023-08-25T05:19:20.099751+0000","last_undegraded":"2023-08-25T05:19:20.099751+0000","last_fullsized":"2023-08-25T05:19:20.099751+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:54:15.215671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102346+0000","last_change":"2023-08-25T05:19:19.107687+0000","last_active":"2023-08-25T05:19:20.102346+0000","last_peered":"2023-08-25T05:19:20.102346+0000","last_clean":"2023-08-25T05:19:20.102346+0000","last_became_active":"2023-08-25T05:19:19.107352+0000","last_became_peered":"2023-08-25T05:19:19.107352+0000","last_unstale":"2023-08-25T05:19:20.102346+0000","last_undegraded":"2023-08-25T05:19:20.102346+0000","last_fullsized":"2023-08-25T05:19:20.102346+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:16.742610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669842+0000","last_change":"2023-08-25T05:19:19.106678+0000","last_active":"2023-08-25T05:19:20.669842+0000","last_peered":"2023-08-25T05:19:20.669842+0000","last_clean":"2023-08-25T05:19:20.669842+0000","last_became_active":"2023-08-25T05:19:19.106200+0000","last_became_peered":"2023-08-25T05:19:19.106200+0000","last_unstale":"2023-08-25T05:19:20.669842+0000","last_undegraded":"2023-08-25T05:19:20.669842+0000","last_fullsized":"2023-08-25T05:19:20.669842+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:16:30.547249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.671022+0000","last_change":"2023-08-25T05:19:19.109289+0000","last_active":"2023-08-25T05:19:20.671022+0000","last_peered":"2023-08-25T05:19:20.671022+0000","last_clean":"2023-08-25T05:19:20.671022+0000","last_became_active":"2023-08-25T05:19:19.108896+0000","last_became_peered":"2023-08-25T05:19:19.108896+0000","last_unstale":"2023-08-25T05:19:20.671022+0000","last_undegraded":"2023-08-25T05:19:20.671022+0000","last_fullsized":"2023-08-25T05:19:20.671022+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:53:01.852132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669753+0000","last_change":"2023-08-25T05:19:19.101815+0000","last_active":"2023-08-25T05:19:20.669753+0000","last_peered":"2023-08-25T05:19:20.669753+0000","last_clean":"2023-08-25T05:19:20.669753+0000","last_became_active":"2023-08-25T05:19:19.101418+0000","last_became_peered":"2023-08-25T05:19:19.101418+0000","last_unstale":"2023-08-25T05:19:20.669753+0000","last_undegraded":"2023-08-25T05:19:20.669753+0000","last_fullsized":"2023-08-25T05:19:20.669753+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:02:40.529229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100089+0000","last_change":"2023-08-25T05:19:19.114228+0000","last_active":"2023-08-25T05:19:20.100089+0000","last_peered":"2023-08-25T05:19:20.100089+0000","last_clean":"2023-08-25T05:19:20.100089+0000","last_became_active":"2023-08-25T05:19:19.112823+0000","last_became_peered":"2023-08-25T05:19:19.112823+0000","last_unstale":"2023-08-25T05:19:20.100089+0000","last_undegraded":"2023-08-25T05:19:20.100089+0000","last_fullsized":"2023-08-25T05:19:20.100089+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:55.589906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386836+0000","last_change":"2023-08-25T05:19:19.111385+0000","last_active":"2023-08-25T05:19:20.386836+0000","last_peered":"2023-08-25T05:19:20.386836+0000","last_clean":"2023-08-25T05:19:20.386836+0000","last_became_active":"2023-08-25T05:19:19.111045+0000","last_became_peered":"2023-08-25T05:19:19.111045+0000","last_unstale":"2023-08-25T05:19:20.386836+0000","last_undegraded":"2023-08-25T05:19:20.386836+0000","last_fullsized":"2023-08-25T05:19:20.386836+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:17:09.619856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101958+0000","last_change":"2023-08-25T05:19:19.107378+0000","last_active":"2023-08-25T05:19:20.101958+0000","last_peered":"2023-08-25T05:19:20.101958+0000","last_clean":"2023-08-25T05:19:20.101958+0000","last_became_active":"2023-08-25T05:19:19.106704+0000","last_became_peered":"2023-08-25T05:19:19.106704+0000","last_unstale":"2023-08-25T05:19:20.101958+0000","last_undegraded":"2023-08-25T05:19:20.101958+0000","last_fullsized":"2023-08-25T05:19:20.101958+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:02:41.116429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669789+0000","last_change":"2023-08-25T05:19:19.109734+0000","last_active":"2023-08-25T05:19:20.669789+0000","last_peered":"2023-08-25T05:19:20.669789+0000","last_clean":"2023-08-25T05:19:20.669789+0000","last_became_active":"2023-08-25T05:19:19.109437+0000","last_became_peered":"2023-08-25T05:19:19.109437+0000","last_unstale":"2023-08-25T05:19:20.669789+0000","last_undegraded":"2023-08-25T05:19:20.669789+0000","last_fullsized":"2023-08-25T05:19:20.669789+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:45:41.480896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387260+0000","last_change":"2023-08-25T05:19:19.108235+0000","last_active":"2023-08-25T05:19:20.387260+0000","last_peered":"2023-08-25T05:19:20.387260+0000","last_clean":"2023-08-25T05:19:20.387260+0000","last_became_active":"2023-08-25T05:19:19.107876+0000","last_became_peered":"2023-08-25T05:19:19.107876+0000","last_unstale":"2023-08-25T05:19:20.387260+0000","last_undegraded":"2023-08-25T05:19:20.387260+0000","last_fullsized":"2023-08-25T05:19:20.387260+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:20:41.091758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387186+0000","last_change":"2023-08-25T05:19:19.113934+0000","last_active":"2023-08-25T05:19:20.387186+0000","last_peered":"2023-08-25T05:19:20.387186+0000","last_clean":"2023-08-25T05:19:20.387186+0000","last_became_active":"2023-08-25T05:19:19.113434+0000","last_became_peered":"2023-08-25T05:19:19.113434+0000","last_unstale":"2023-08-25T05:19:20.387186+0000","last_undegraded":"2023-08-25T05:19:20.387186+0000","last_fullsized":"2023-08-25T05:19:20.387186+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:45:10.087683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100452+0000","last_change":"2023-08-25T05:19:19.113088+0000","last_active":"2023-08-25T05:19:20.100452+0000","last_peered":"2023-08-25T05:19:20.100452+0000","last_clean":"2023-08-25T05:19:20.100452+0000","last_became_active":"2023-08-25T05:19:19.112714+0000","last_became_peered":"2023-08-25T05:19:19.112714+0000","last_unstale":"2023-08-25T05:19:20.100452+0000","last_undegraded":"2023-08-25T05:19:20.100452+0000","last_fullsized":"2023-08-25T05:19:20.100452+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:09.499178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670051+0000","last_change":"2023-08-25T05:19:19.106903+0000","last_active":"2023-08-25T05:19:20.670051+0000","last_peered":"2023-08-25T05:19:20.670051+0000","last_clean":"2023-08-25T05:19:20.670051+0000","last_became_active":"2023-08-25T05:19:19.106619+0000","last_became_peered":"2023-08-25T05:19:19.106619+0000","last_unstale":"2023-08-25T05:19:20.670051+0000","last_undegraded":"2023-08-25T05:19:20.670051+0000","last_fullsized":"2023-08-25T05:19:20.670051+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:17:02.980043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102736+0000","last_change":"2023-08-25T05:19:19.115725+0000","last_active":"2023-08-25T05:19:20.102736+0000","last_peered":"2023-08-25T05:19:20.102736+0000","last_clean":"2023-08-25T05:19:20.102736+0000","last_became_active":"2023-08-25T05:19:19.115107+0000","last_became_peered":"2023-08-25T05:19:19.115107+0000","last_unstale":"2023-08-25T05:19:20.102736+0000","last_undegraded":"2023-08-25T05:19:20.102736+0000","last_fullsized":"2023-08-25T05:19:20.102736+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:47:19.466677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669974+0000","last_change":"2023-08-25T05:19:19.091428+0000","last_active":"2023-08-25T05:19:20.669974+0000","last_peered":"2023-08-25T05:19:20.669974+0000","last_clean":"2023-08-25T05:19:20.669974+0000","last_became_active":"2023-08-25T05:19:19.090567+0000","last_became_peered":"2023-08-25T05:19:19.090567+0000","last_unstale":"2023-08-25T05:19:20.669974+0000","last_undegraded":"2023-08-25T05:19:20.669974+0000","last_fullsized":"2023-08-25T05:19:20.669974+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:29:12.750973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.099772+0000","last_change":"2023-08-25T05:19:19.101493+0000","last_active":"2023-08-25T05:19:20.099772+0000","last_peered":"2023-08-25T05:19:20.099772+0000","last_clean":"2023-08-25T05:19:20.099772+0000","last_became_active":"2023-08-25T05:19:19.101085+0000","last_became_peered":"2023-08-25T05:19:19.101085+0000","last_unstale":"2023-08-25T05:19:20.099772+0000","last_undegraded":"2023-08-25T05:19:20.099772+0000","last_fullsized":"2023-08-25T05:19:20.099772+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:39:18.042193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102195+0000","last_change":"2023-08-25T05:19:19.094244+0000","last_active":"2023-08-25T05:19:20.102195+0000","last_peered":"2023-08-25T05:19:20.102195+0000","last_clean":"2023-08-25T05:19:20.102195+0000","last_became_active":"2023-08-25T05:19:19.093926+0000","last_became_peered":"2023-08-25T05:19:19.093926+0000","last_unstale":"2023-08-25T05:19:20.102195+0000","last_undegraded":"2023-08-25T05:19:20.102195+0000","last_fullsized":"2023-08-25T05:19:20.102195+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:09:55.883591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670822+0000","last_change":"2023-08-25T05:19:19.109818+0000","last_active":"2023-08-25T05:19:20.670822+0000","last_peered":"2023-08-25T05:19:20.670822+0000","last_clean":"2023-08-25T05:19:20.670822+0000","last_became_active":"2023-08-25T05:19:19.109520+0000","last_became_peered":"2023-08-25T05:19:19.109520+0000","last_unstale":"2023-08-25T05:19:20.670822+0000","last_undegraded":"2023-08-25T05:19:20.670822+0000","last_fullsized":"2023-08-25T05:19:20.670822+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:12.342980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"169'4","reported_seq":17,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100652+0000","last_change":"2023-08-25T05:19:18.096852+0000","last_active":"2023-08-25T05:19:20.100652+0000","last_peered":"2023-08-25T05:19:20.100652+0000","last_clean":"2023-08-25T05:19:20.100652+0000","last_became_active":"2023-08-25T05:19:18.096586+0000","last_became_peered":"2023-08-25T05:19:18.096586+0000","last_unstale":"2023-08-25T05:19:20.100652+0000","last_undegraded":"2023-08-25T05:19:20.100652+0000","last_fullsized":"2023-08-25T05:19:20.100652+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:10:33.739986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670769+0000","last_change":"2023-08-25T05:19:19.099800+0000","last_active":"2023-08-25T05:19:20.670769+0000","last_peered":"2023-08-25T05:19:20.670769+0000","last_clean":"2023-08-25T05:19:20.670769+0000","last_became_active":"2023-08-25T05:19:19.099476+0000","last_became_peered":"2023-08-25T05:19:19.099476+0000","last_unstale":"2023-08-25T05:19:20.670769+0000","last_undegraded":"2023-08-25T05:19:20.670769+0000","last_fullsized":"2023-08-25T05:19:20.670769+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:09:33.219847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"169'1","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670612+0000","last_change":"2023-08-25T05:19:18.103369+0000","last_active":"2023-08-25T05:19:20.670612+0000","last_peered":"2023-08-25T05:19:20.670612+0000","last_clean":"2023-08-25T05:19:20.670612+0000","last_became_active":"2023-08-25T05:19:18.103067+0000","last_became_peered":"2023-08-25T05:19:18.103067+0000","last_unstale":"2023-08-25T05:19:20.670612+0000","last_undegraded":"2023-08-25T05:19:20.670612+0000","last_fullsized":"2023-08-25T05:19:20.670612+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:24:17.716029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102787+0000","last_change":"2023-08-25T05:19:19.088435+0000","last_active":"2023-08-25T05:19:20.102787+0000","last_peered":"2023-08-25T05:19:20.102787+0000","last_clean":"2023-08-25T05:19:20.102787+0000","last_became_active":"2023-08-25T05:19:19.088107+0000","last_became_peered":"2023-08-25T05:19:19.088107+0000","last_unstale":"2023-08-25T05:19:20.102787+0000","last_undegraded":"2023-08-25T05:19:20.102787+0000","last_fullsized":"2023-08-25T05:19:20.102787+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:20:52.631756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"169'2","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670847+0000","last_change":"2023-08-25T05:19:18.103473+0000","last_active":"2023-08-25T05:19:20.670847+0000","last_peered":"2023-08-25T05:19:20.670847+0000","last_clean":"2023-08-25T05:19:20.670847+0000","last_became_active":"2023-08-25T05:19:18.103177+0000","last_became_peered":"2023-08-25T05:19:18.103177+0000","last_unstale":"2023-08-25T05:19:20.670847+0000","last_undegraded":"2023-08-25T05:19:20.670847+0000","last_fullsized":"2023-08-25T05:19:20.670847+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:23:45.700005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670811+0000","last_change":"2023-08-25T05:19:19.110072+0000","last_active":"2023-08-25T05:19:20.670811+0000","last_peered":"2023-08-25T05:19:20.670811+0000","last_clean":"2023-08-25T05:19:20.670811+0000","last_became_active":"2023-08-25T05:19:19.109776+0000","last_became_peered":"2023-08-25T05:19:19.109776+0000","last_unstale":"2023-08-25T05:19:20.670811+0000","last_undegraded":"2023-08-25T05:19:20.670811+0000","last_fullsized":"2023-08-25T05:19:20.670811+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:31:17.527448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"169'2","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670688+0000","last_change":"2023-08-25T05:19:18.091924+0000","last_active":"2023-08-25T05:19:20.670688+0000","last_peered":"2023-08-25T05:19:20.670688+0000","last_clean":"2023-08-25T05:19:20.670688+0000","last_became_active":"2023-08-25T05:19:18.091634+0000","last_became_peered":"2023-08-25T05:19:18.091634+0000","last_unstale":"2023-08-25T05:19:20.670688+0000","last_undegraded":"2023-08-25T05:19:20.670688+0000","last_fullsized":"2023-08-25T05:19:20.670688+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:12.984060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669406+0000","last_change":"2023-08-25T05:19:19.116242+0000","last_active":"2023-08-25T05:19:20.669406+0000","last_peered":"2023-08-25T05:19:20.669406+0000","last_clean":"2023-08-25T05:19:20.669406+0000","last_became_active":"2023-08-25T05:19:19.114880+0000","last_became_peered":"2023-08-25T05:19:19.114880+0000","last_unstale":"2023-08-25T05:19:20.669406+0000","last_undegraded":"2023-08-25T05:19:20.669406+0000","last_fullsized":"2023-08-25T05:19:20.669406+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:28.182090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"169'1","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102829+0000","last_change":"2023-08-25T05:19:18.091169+0000","last_active":"2023-08-25T05:19:20.102829+0000","last_peered":"2023-08-25T05:19:20.102829+0000","last_clean":"2023-08-25T05:19:20.102829+0000","last_became_active":"2023-08-25T05:19:18.090883+0000","last_became_peered":"2023-08-25T05:19:18.090883+0000","last_unstale":"2023-08-25T05:19:20.102829+0000","last_undegraded":"2023-08-25T05:19:20.102829+0000","last_fullsized":"2023-08-25T05:19:20.102829+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:42:56.038398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101698+0000","last_change":"2023-08-25T05:19:19.103477+0000","last_active":"2023-08-25T05:19:20.101698+0000","last_peered":"2023-08-25T05:19:20.101698+0000","last_clean":"2023-08-25T05:19:20.101698+0000","last_became_active":"2023-08-25T05:19:19.103091+0000","last_became_peered":"2023-08-25T05:19:19.103091+0000","last_unstale":"2023-08-25T05:19:20.101698+0000","last_undegraded":"2023-08-25T05:19:20.101698+0000","last_fullsized":"2023-08-25T05:19:20.101698+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:01:06.559858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"169'1","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100129+0000","last_change":"2023-08-25T05:19:18.095404+0000","last_active":"2023-08-25T05:19:20.100129+0000","last_peered":"2023-08-25T05:19:20.100129+0000","last_clean":"2023-08-25T05:19:20.100129+0000","last_became_active":"2023-08-25T05:19:18.095131+0000","last_became_peered":"2023-08-25T05:19:18.095131+0000","last_unstale":"2023-08-25T05:19:20.100129+0000","last_undegraded":"2023-08-25T05:19:20.100129+0000","last_fullsized":"2023-08-25T05:19:20.100129+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:25:28.110408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670533+0000","last_change":"2023-08-25T05:19:19.104380+0000","last_active":"2023-08-25T05:19:20.670533+0000","last_peered":"2023-08-25T05:19:20.670533+0000","last_clean":"2023-08-25T05:19:20.670533+0000","last_became_active":"2023-08-25T05:19:19.104058+0000","last_became_peered":"2023-08-25T05:19:19.104058+0000","last_unstale":"2023-08-25T05:19:20.670533+0000","last_undegraded":"2023-08-25T05:19:20.670533+0000","last_fullsized":"2023-08-25T05:19:20.670533+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:07:07.905137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386872+0000","last_change":"2023-08-25T05:19:18.100455+0000","last_active":"2023-08-25T05:19:20.386872+0000","last_peered":"2023-08-25T05:19:20.386872+0000","last_clean":"2023-08-25T05:19:20.386872+0000","last_became_active":"2023-08-25T05:19:18.100020+0000","last_became_peered":"2023-08-25T05:19:18.100020+0000","last_unstale":"2023-08-25T05:19:20.386872+0000","last_undegraded":"2023-08-25T05:19:20.386872+0000","last_fullsized":"2023-08-25T05:19:20.386872+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:30:30.194970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386825+0000","last_change":"2023-08-25T05:19:19.104588+0000","last_active":"2023-08-25T05:19:20.386825+0000","last_peered":"2023-08-25T05:19:20.386825+0000","last_clean":"2023-08-25T05:19:20.386825+0000","last_became_active":"2023-08-25T05:19:19.104190+0000","last_became_peered":"2023-08-25T05:19:19.104190+0000","last_unstale":"2023-08-25T05:19:20.386825+0000","last_undegraded":"2023-08-25T05:19:20.386825+0000","last_fullsized":"2023-08-25T05:19:20.386825+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:34.804176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.099794+0000","last_change":"2023-08-25T05:19:18.099984+0000","last_active":"2023-08-25T05:19:20.099794+0000","last_peered":"2023-08-25T05:19:20.099794+0000","last_clean":"2023-08-25T05:19:20.099794+0000","last_became_active":"2023-08-25T05:19:18.099639+0000","last_became_peered":"2023-08-25T05:19:18.099639+0000","last_unstale":"2023-08-25T05:19:20.099794+0000","last_undegraded":"2023-08-25T05:19:20.099794+0000","last_fullsized":"2023-08-25T05:19:20.099794+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:43.410039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670547+0000","last_change":"2023-08-25T05:19:19.114870+0000","last_active":"2023-08-25T05:19:20.670547+0000","last_peered":"2023-08-25T05:19:20.670547+0000","last_clean":"2023-08-25T05:19:20.670547+0000","last_became_active":"2023-08-25T05:19:19.114345+0000","last_became_peered":"2023-08-25T05:19:19.114345+0000","last_unstale":"2023-08-25T05:19:20.670547+0000","last_undegraded":"2023-08-25T05:19:20.670547+0000","last_fullsized":"2023-08-25T05:19:20.670547+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:26:19.530079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"169'1","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670084+0000","last_change":"2023-08-25T05:19:18.096880+0000","last_active":"2023-08-25T05:19:20.670084+0000","last_peered":"2023-08-25T05:19:20.670084+0000","last_clean":"2023-08-25T05:19:20.670084+0000","last_became_active":"2023-08-25T05:19:18.096570+0000","last_became_peered":"2023-08-25T05:19:18.096570+0000","last_unstale":"2023-08-25T05:19:20.670084+0000","last_undegraded":"2023-08-25T05:19:20.670084+0000","last_fullsized":"2023-08-25T05:19:20.670084+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:38:43.808966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670858+0000","last_change":"2023-08-25T05:19:19.100758+0000","last_active":"2023-08-25T05:19:20.670858+0000","last_peered":"2023-08-25T05:19:20.670858+0000","last_clean":"2023-08-25T05:19:20.670858+0000","last_became_active":"2023-08-25T05:19:19.100420+0000","last_became_peered":"2023-08-25T05:19:19.100420+0000","last_unstale":"2023-08-25T05:19:20.670858+0000","last_undegraded":"2023-08-25T05:19:20.670858+0000","last_fullsized":"2023-08-25T05:19:20.670858+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:09:39.333299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"169'2","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670653+0000","last_change":"2023-08-25T05:19:18.100557+0000","last_active":"2023-08-25T05:19:20.670653+0000","last_peered":"2023-08-25T05:19:20.670653+0000","last_clean":"2023-08-25T05:19:20.670653+0000","last_became_active":"2023-08-25T05:19:18.100282+0000","last_became_peered":"2023-08-25T05:19:18.100282+0000","last_unstale":"2023-08-25T05:19:20.670653+0000","last_undegraded":"2023-08-25T05:19:20.670653+0000","last_fullsized":"2023-08-25T05:19:20.670653+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:20:03.474378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387190+0000","last_change":"2023-08-25T05:19:19.106251+0000","last_active":"2023-08-25T05:19:20.387190+0000","last_peered":"2023-08-25T05:19:20.387190+0000","last_clean":"2023-08-25T05:19:20.387190+0000","last_became_active":"2023-08-25T05:19:19.105964+0000","last_became_peered":"2023-08-25T05:19:19.105964+0000","last_unstale":"2023-08-25T05:19:20.387190+0000","last_undegraded":"2023-08-25T05:19:20.387190+0000","last_fullsized":"2023-08-25T05:19:20.387190+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:14:57.389520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"169'1","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670844+0000","last_change":"2023-08-25T05:19:18.093116+0000","last_active":"2023-08-25T05:19:20.670844+0000","last_peered":"2023-08-25T05:19:20.670844+0000","last_clean":"2023-08-25T05:19:20.670844+0000","last_became_active":"2023-08-25T05:19:18.092653+0000","last_became_peered":"2023-08-25T05:19:18.092653+0000","last_unstale":"2023-08-25T05:19:20.670844+0000","last_undegraded":"2023-08-25T05:19:20.670844+0000","last_fullsized":"2023-08-25T05:19:20.670844+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:05.472719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387368+0000","last_change":"2023-08-25T05:19:19.105286+0000","last_active":"2023-08-25T05:19:20.387368+0000","last_peered":"2023-08-25T05:19:20.387368+0000","last_clean":"2023-08-25T05:19:20.387368+0000","last_became_active":"2023-08-25T05:19:19.104634+0000","last_became_peered":"2023-08-25T05:19:19.104634+0000","last_unstale":"2023-08-25T05:19:20.387368+0000","last_undegraded":"2023-08-25T05:19:20.387368+0000","last_fullsized":"2023-08-25T05:19:20.387368+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:47:08.696601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102178+0000","last_change":"2023-08-25T05:19:18.094164+0000","last_active":"2023-08-25T05:19:20.102178+0000","last_peered":"2023-08-25T05:19:20.102178+0000","last_clean":"2023-08-25T05:19:20.102178+0000","last_became_active":"2023-08-25T05:19:18.093896+0000","last_became_peered":"2023-08-25T05:19:18.093896+0000","last_unstale":"2023-08-25T05:19:20.102178+0000","last_undegraded":"2023-08-25T05:19:20.102178+0000","last_fullsized":"2023-08-25T05:19:20.102178+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:05:08.912305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670476+0000","last_change":"2023-08-25T05:19:19.100598+0000","last_active":"2023-08-25T05:19:20.670476+0000","last_peered":"2023-08-25T05:19:20.670476+0000","last_clean":"2023-08-25T05:19:20.670476+0000","last_became_active":"2023-08-25T05:19:19.100286+0000","last_became_peered":"2023-08-25T05:19:19.100286+0000","last_unstale":"2023-08-25T05:19:20.670476+0000","last_undegraded":"2023-08-25T05:19:20.670476+0000","last_fullsized":"2023-08-25T05:19:20.670476+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:25.142761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"169'2","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669623+0000","last_change":"2023-08-25T05:19:18.095970+0000","last_active":"2023-08-25T05:19:20.669623+0000","last_peered":"2023-08-25T05:19:20.669623+0000","last_clean":"2023-08-25T05:19:20.669623+0000","last_became_active":"2023-08-25T05:19:18.095674+0000","last_became_peered":"2023-08-25T05:19:18.095674+0000","last_unstale":"2023-08-25T05:19:20.669623+0000","last_undegraded":"2023-08-25T05:19:20.669623+0000","last_fullsized":"2023-08-25T05:19:20.669623+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:24:15.408544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670727+0000","last_change":"2023-08-25T05:19:19.108226+0000","last_active":"2023-08-25T05:19:20.670727+0000","last_peered":"2023-08-25T05:19:20.670727+0000","last_clean":"2023-08-25T05:19:20.670727+0000","last_became_active":"2023-08-25T05:19:19.107952+0000","last_became_peered":"2023-08-25T05:19:19.107952+0000","last_unstale":"2023-08-25T05:19:20.670727+0000","last_undegraded":"2023-08-25T05:19:20.670727+0000","last_fullsized":"2023-08-25T05:19:20.670727+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:02:58.784477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102713+0000","last_change":"2023-08-25T05:19:18.085032+0000","last_active":"2023-08-25T05:19:20.102713+0000","last_peered":"2023-08-25T05:19:20.102713+0000","last_clean":"2023-08-25T05:19:20.102713+0000","last_became_active":"2023-08-25T05:19:18.084389+0000","last_became_peered":"2023-08-25T05:19:18.084389+0000","last_unstale":"2023-08-25T05:19:20.102713+0000","last_undegraded":"2023-08-25T05:19:20.102713+0000","last_fullsized":"2023-08-25T05:19:20.102713+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:10:06.746194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670403+0000","last_change":"2023-08-25T05:19:19.097860+0000","last_active":"2023-08-25T05:19:20.670403+0000","last_peered":"2023-08-25T05:19:20.670403+0000","last_clean":"2023-08-25T05:19:20.670403+0000","last_became_active":"2023-08-25T05:19:19.097569+0000","last_became_peered":"2023-08-25T05:19:19.097569+0000","last_unstale":"2023-08-25T05:19:20.670403+0000","last_undegraded":"2023-08-25T05:19:20.670403+0000","last_fullsized":"2023-08-25T05:19:20.670403+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:59:29.544988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669318+0000","last_change":"2023-08-25T05:19:18.095969+0000","last_active":"2023-08-25T05:19:20.669318+0000","last_peered":"2023-08-25T05:19:20.669318+0000","last_clean":"2023-08-25T05:19:20.669318+0000","last_became_active":"2023-08-25T05:19:18.095659+0000","last_became_peered":"2023-08-25T05:19:18.095659+0000","last_unstale":"2023-08-25T05:19:20.669318+0000","last_undegraded":"2023-08-25T05:19:20.669318+0000","last_fullsized":"2023-08-25T05:19:20.669318+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:10:13.656262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.671026+0000","last_change":"2023-08-25T05:19:19.097622+0000","last_active":"2023-08-25T05:19:20.671026+0000","last_peered":"2023-08-25T05:19:20.671026+0000","last_clean":"2023-08-25T05:19:20.671026+0000","last_became_active":"2023-08-25T05:19:19.097309+0000","last_became_peered":"2023-08-25T05:19:19.097309+0000","last_unstale":"2023-08-25T05:19:20.671026+0000","last_undegraded":"2023-08-25T05:19:20.671026+0000","last_fullsized":"2023-08-25T05:19:20.671026+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:32:40.698453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102541+0000","last_change":"2023-08-25T05:19:18.097856+0000","last_active":"2023-08-25T05:19:20.102541+0000","last_peered":"2023-08-25T05:19:20.102541+0000","last_clean":"2023-08-25T05:19:20.102541+0000","last_became_active":"2023-08-25T05:19:18.097185+0000","last_became_peered":"2023-08-25T05:19:18.097185+0000","last_unstale":"2023-08-25T05:19:20.102541+0000","last_undegraded":"2023-08-25T05:19:20.102541+0000","last_fullsized":"2023-08-25T05:19:20.102541+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:46:31.312925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100822+0000","last_change":"2023-08-25T05:19:19.108821+0000","last_active":"2023-08-25T05:19:20.100822+0000","last_peered":"2023-08-25T05:19:20.100822+0000","last_clean":"2023-08-25T05:19:20.100822+0000","last_became_active":"2023-08-25T05:19:19.108491+0000","last_became_peered":"2023-08-25T05:19:19.108491+0000","last_unstale":"2023-08-25T05:19:20.100822+0000","last_undegraded":"2023-08-25T05:19:20.100822+0000","last_fullsized":"2023-08-25T05:19:20.100822+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:32:30.407510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"169'2","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102445+0000","last_change":"2023-08-25T05:19:18.095293+0000","last_active":"2023-08-25T05:19:20.102445+0000","last_peered":"2023-08-25T05:19:20.102445+0000","last_clean":"2023-08-25T05:19:20.102445+0000","last_became_active":"2023-08-25T05:19:18.094917+0000","last_became_peered":"2023-08-25T05:19:18.094917+0000","last_unstale":"2023-08-25T05:19:20.102445+0000","last_undegraded":"2023-08-25T05:19:20.102445+0000","last_fullsized":"2023-08-25T05:19:20.102445+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:59.213187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101995+0000","last_change":"2023-08-25T05:19:19.104831+0000","last_active":"2023-08-25T05:19:20.101995+0000","last_peered":"2023-08-25T05:19:20.101995+0000","last_clean":"2023-08-25T05:19:20.101995+0000","last_became_active":"2023-08-25T05:19:19.104547+0000","last_became_peered":"2023-08-25T05:19:19.104547+0000","last_unstale":"2023-08-25T05:19:20.101995+0000","last_undegraded":"2023-08-25T05:19:20.101995+0000","last_fullsized":"2023-08-25T05:19:20.101995+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:10:49.389866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387262+0000","last_change":"2023-08-25T05:19:18.101512+0000","last_active":"2023-08-25T05:19:20.387262+0000","last_peered":"2023-08-25T05:19:20.387262+0000","last_clean":"2023-08-25T05:19:20.387262+0000","last_became_active":"2023-08-25T05:19:18.100932+0000","last_became_peered":"2023-08-25T05:19:18.100932+0000","last_unstale":"2023-08-25T05:19:20.387262+0000","last_undegraded":"2023-08-25T05:19:20.387262+0000","last_fullsized":"2023-08-25T05:19:20.387262+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:36:54.617809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387333+0000","last_change":"2023-08-25T05:19:19.106309+0000","last_active":"2023-08-25T05:19:20.387333+0000","last_peered":"2023-08-25T05:19:20.387333+0000","last_clean":"2023-08-25T05:19:20.387333+0000","last_became_active":"2023-08-25T05:19:19.105633+0000","last_became_peered":"2023-08-25T05:19:19.105633+0000","last_unstale":"2023-08-25T05:19:20.387333+0000","last_undegraded":"2023-08-25T05:19:20.387333+0000","last_fullsized":"2023-08-25T05:19:20.387333+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:42:35.210980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670971+0000","last_change":"2023-08-25T05:19:18.092916+0000","last_active":"2023-08-25T05:19:20.670971+0000","last_peered":"2023-08-25T05:19:20.670971+0000","last_clean":"2023-08-25T05:19:20.670971+0000","last_became_active":"2023-08-25T05:19:18.092251+0000","last_became_peered":"2023-08-25T05:19:18.092251+0000","last_unstale":"2023-08-25T05:19:20.670971+0000","last_undegraded":"2023-08-25T05:19:20.670971+0000","last_fullsized":"2023-08-25T05:19:20.670971+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:06:49.660235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100648+0000","last_change":"2023-08-25T05:19:19.101644+0000","last_active":"2023-08-25T05:19:20.100648+0000","last_peered":"2023-08-25T05:19:20.100648+0000","last_clean":"2023-08-25T05:19:20.100648+0000","last_became_active":"2023-08-25T05:19:19.101339+0000","last_became_peered":"2023-08-25T05:19:19.101339+0000","last_unstale":"2023-08-25T05:19:20.100648+0000","last_undegraded":"2023-08-25T05:19:20.100648+0000","last_fullsized":"2023-08-25T05:19:20.100648+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:30:26.456155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100558+0000","last_change":"2023-08-25T05:19:18.093466+0000","last_active":"2023-08-25T05:19:20.100558+0000","last_peered":"2023-08-25T05:19:20.100558+0000","last_clean":"2023-08-25T05:19:20.100558+0000","last_became_active":"2023-08-25T05:19:18.093177+0000","last_became_peered":"2023-08-25T05:19:18.093177+0000","last_unstale":"2023-08-25T05:19:20.100558+0000","last_undegraded":"2023-08-25T05:19:20.100558+0000","last_fullsized":"2023-08-25T05:19:20.100558+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:42:18.077337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102354+0000","last_change":"2023-08-25T05:19:19.104021+0000","last_active":"2023-08-25T05:19:20.102354+0000","last_peered":"2023-08-25T05:19:20.102354+0000","last_clean":"2023-08-25T05:19:20.102354+0000","last_became_active":"2023-08-25T05:19:19.103708+0000","last_became_peered":"2023-08-25T05:19:19.103708+0000","last_unstale":"2023-08-25T05:19:20.102354+0000","last_undegraded":"2023-08-25T05:19:20.102354+0000","last_fullsized":"2023-08-25T05:19:20.102354+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:40:08.903268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386949+0000","last_change":"2023-08-25T05:19:18.100268+0000","last_active":"2023-08-25T05:19:20.386949+0000","last_peered":"2023-08-25T05:19:20.386949+0000","last_clean":"2023-08-25T05:19:20.386949+0000","last_became_active":"2023-08-25T05:19:18.099889+0000","last_became_peered":"2023-08-25T05:19:18.099889+0000","last_unstale":"2023-08-25T05:19:20.386949+0000","last_undegraded":"2023-08-25T05:19:20.386949+0000","last_fullsized":"2023-08-25T05:19:20.386949+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:29:35.762327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101763+0000","last_change":"2023-08-25T05:19:19.104177+0000","last_active":"2023-08-25T05:19:20.101763+0000","last_peered":"2023-08-25T05:19:20.101763+0000","last_clean":"2023-08-25T05:19:20.101763+0000","last_became_active":"2023-08-25T05:19:19.103862+0000","last_became_peered":"2023-08-25T05:19:19.103862+0000","last_unstale":"2023-08-25T05:19:20.101763+0000","last_undegraded":"2023-08-25T05:19:20.101763+0000","last_fullsized":"2023-08-25T05:19:20.101763+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:16:56.937872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670073+0000","last_change":"2023-08-25T05:19:18.103122+0000","last_active":"2023-08-25T05:19:20.670073+0000","last_peered":"2023-08-25T05:19:20.670073+0000","last_clean":"2023-08-25T05:19:20.670073+0000","last_became_active":"2023-08-25T05:19:18.102803+0000","last_became_peered":"2023-08-25T05:19:18.102803+0000","last_unstale":"2023-08-25T05:19:20.670073+0000","last_undegraded":"2023-08-25T05:19:20.670073+0000","last_fullsized":"2023-08-25T05:19:20.670073+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:50.153960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670536+0000","last_change":"2023-08-25T05:19:19.099519+0000","last_active":"2023-08-25T05:19:20.670536+0000","last_peered":"2023-08-25T05:19:20.670536+0000","last_clean":"2023-08-25T05:19:20.670536+0000","last_became_active":"2023-08-25T05:19:19.099205+0000","last_became_peered":"2023-08-25T05:19:19.099205+0000","last_unstale":"2023-08-25T05:19:20.670536+0000","last_undegraded":"2023-08-25T05:19:20.670536+0000","last_fullsized":"2023-08-25T05:19:20.670536+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:55:24.322604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386935+0000","last_change":"2023-08-25T05:19:18.100661+0000","last_active":"2023-08-25T05:19:20.386935+0000","last_peered":"2023-08-25T05:19:20.386935+0000","last_clean":"2023-08-25T05:19:20.386935+0000","last_became_active":"2023-08-25T05:19:18.100392+0000","last_became_peered":"2023-08-25T05:19:18.100392+0000","last_unstale":"2023-08-25T05:19:20.386935+0000","last_undegraded":"2023-08-25T05:19:20.386935+0000","last_fullsized":"2023-08-25T05:19:20.386935+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:11:31.150609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102574+0000","last_change":"2023-08-25T05:19:19.116107+0000","last_active":"2023-08-25T05:19:20.102574+0000","last_peered":"2023-08-25T05:19:20.102574+0000","last_clean":"2023-08-25T05:19:20.102574+0000","last_became_active":"2023-08-25T05:19:19.115467+0000","last_became_peered":"2023-08-25T05:19:19.115467+0000","last_unstale":"2023-08-25T05:19:20.102574+0000","last_undegraded":"2023-08-25T05:19:20.102574+0000","last_fullsized":"2023-08-25T05:19:20.102574+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:02:00.326701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670600+0000","last_change":"2023-08-25T05:19:18.098107+0000","last_active":"2023-08-25T05:19:20.670600+0000","last_peered":"2023-08-25T05:19:20.670600+0000","last_clean":"2023-08-25T05:19:20.670600+0000","last_became_active":"2023-08-25T05:19:18.096554+0000","last_became_peered":"2023-08-25T05:19:18.096554+0000","last_unstale":"2023-08-25T05:19:20.670600+0000","last_undegraded":"2023-08-25T05:19:20.670600+0000","last_fullsized":"2023-08-25T05:19:20.670600+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:32:51.417009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.103100+0000","last_change":"2023-08-25T05:19:19.100511+0000","last_active":"2023-08-25T05:19:20.103100+0000","last_peered":"2023-08-25T05:19:20.103100+0000","last_clean":"2023-08-25T05:19:20.103100+0000","last_became_active":"2023-08-25T05:19:19.100224+0000","last_became_peered":"2023-08-25T05:19:19.100224+0000","last_unstale":"2023-08-25T05:19:20.103100+0000","last_undegraded":"2023-08-25T05:19:20.103100+0000","last_fullsized":"2023-08-25T05:19:20.103100+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:08:47.094804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"169'6","reported_seq":19,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669575+0000","last_change":"2023-08-25T05:19:18.097720+0000","last_active":"2023-08-25T05:19:20.669575+0000","last_peered":"2023-08-25T05:19:20.669575+0000","last_clean":"2023-08-25T05:19:20.669575+0000","last_became_active":"2023-08-25T05:19:18.097437+0000","last_became_peered":"2023-08-25T05:19:18.097437+0000","last_unstale":"2023-08-25T05:19:20.669575+0000","last_undegraded":"2023-08-25T05:19:20.669575+0000","last_fullsized":"2023-08-25T05:19:20.669575+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:27:10.667868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"159'3598","reported_seq":4395,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670815+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:19:20.670815+0000","last_peered":"2023-08-25T05:19:20.670815+0000","last_clean":"2023-08-25T05:19:20.670815+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:19:20.670815+0000","last_undegraded":"2023-08-25T05:19:20.670815+0000","last_fullsized":"2023-08-25T05:19:20.670815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3598,"log_dups_size":0,"ondisk_log_size":3598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:39:34.018928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1616,"num_read_kb":3373,"num_write":465,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":297,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387034+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:19:20.387034+0000","last_peered":"2023-08-25T05:19:20.387034+0000","last_clean":"2023-08-25T05:19:20.387034+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:19:20.387034+0000","last_undegraded":"2023-08-25T05:19:20.387034+0000","last_fullsized":"2023-08-25T05:19:20.387034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:57:41.321145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.103027+0000","last_change":"2023-08-25T05:19:19.099971+0000","last_active":"2023-08-25T05:19:20.103027+0000","last_peered":"2023-08-25T05:19:20.103027+0000","last_clean":"2023-08-25T05:19:20.103027+0000","last_became_active":"2023-08-25T05:19:19.099675+0000","last_became_peered":"2023-08-25T05:19:19.099675+0000","last_unstale":"2023-08-25T05:19:20.103027+0000","last_undegraded":"2023-08-25T05:19:20.103027+0000","last_fullsized":"2023-08-25T05:19:20.103027+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:01:06.559858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670874+0000","last_change":"2023-08-25T05:19:18.101899+0000","last_active":"2023-08-25T05:19:20.670874+0000","last_peered":"2023-08-25T05:19:20.670874+0000","last_clean":"2023-08-25T05:19:20.670874+0000","last_became_active":"2023-08-25T05:19:18.101630+0000","last_became_peered":"2023-08-25T05:19:18.101630+0000","last_unstale":"2023-08-25T05:19:20.670874+0000","last_undegraded":"2023-08-25T05:19:20.670874+0000","last_fullsized":"2023-08-25T05:19:20.670874+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:00.294806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":294,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670641+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:19:20.670641+0000","last_peered":"2023-08-25T05:19:20.670641+0000","last_clean":"2023-08-25T05:19:20.670641+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:19:20.670641+0000","last_undegraded":"2023-08-25T05:19:20.670641+0000","last_fullsized":"2023-08-25T05:19:20.670641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:21:16.671755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669776+0000","last_change":"2023-08-25T05:19:19.100942+0000","last_active":"2023-08-25T05:19:20.669776+0000","last_peered":"2023-08-25T05:19:20.669776+0000","last_clean":"2023-08-25T05:19:20.669776+0000","last_became_active":"2023-08-25T05:19:19.100643+0000","last_became_peered":"2023-08-25T05:19:19.100643+0000","last_unstale":"2023-08-25T05:19:20.669776+0000","last_undegraded":"2023-08-25T05:19:20.669776+0000","last_fullsized":"2023-08-25T05:19:20.669776+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:03:30.222315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387360+0000","last_change":"2023-08-25T05:19:18.101699+0000","last_active":"2023-08-25T05:19:20.387360+0000","last_peered":"2023-08-25T05:19:20.387360+0000","last_clean":"2023-08-25T05:19:20.387360+0000","last_became_active":"2023-08-25T05:19:18.101250+0000","last_became_peered":"2023-08-25T05:19:18.101250+0000","last_unstale":"2023-08-25T05:19:20.387360+0000","last_undegraded":"2023-08-25T05:19:20.387360+0000","last_fullsized":"2023-08-25T05:19:20.387360+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:15:02.972695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":301,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669659+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:19:20.669659+0000","last_peered":"2023-08-25T05:19:20.669659+0000","last_clean":"2023-08-25T05:19:20.669659+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:19:20.669659+0000","last_undegraded":"2023-08-25T05:19:20.669659+0000","last_fullsized":"2023-08-25T05:19:20.669659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:28:55.023977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669978+0000","last_change":"2023-08-25T05:19:19.106477+0000","last_active":"2023-08-25T05:19:20.669978+0000","last_peered":"2023-08-25T05:19:20.669978+0000","last_clean":"2023-08-25T05:19:20.669978+0000","last_became_active":"2023-08-25T05:19:19.105841+0000","last_became_peered":"2023-08-25T05:19:19.105841+0000","last_unstale":"2023-08-25T05:19:20.669978+0000","last_undegraded":"2023-08-25T05:19:20.669978+0000","last_fullsized":"2023-08-25T05:19:20.669978+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:26:48.556516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"169'3","reported_seq":16,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669891+0000","last_change":"2023-08-25T05:19:18.096878+0000","last_active":"2023-08-25T05:19:20.669891+0000","last_peered":"2023-08-25T05:19:20.669891+0000","last_clean":"2023-08-25T05:19:20.669891+0000","last_became_active":"2023-08-25T05:19:18.096598+0000","last_became_peered":"2023-08-25T05:19:18.096598+0000","last_unstale":"2023-08-25T05:19:20.669891+0000","last_undegraded":"2023-08-25T05:19:20.669891+0000","last_fullsized":"2023-08-25T05:19:20.669891+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:14:03.569363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":297,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386771+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:19:20.386771+0000","last_peered":"2023-08-25T05:19:20.386771+0000","last_clean":"2023-08-25T05:19:20.386771+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:19:20.386771+0000","last_undegraded":"2023-08-25T05:19:20.386771+0000","last_fullsized":"2023-08-25T05:19:20.386771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:28:51.230788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102292+0000","last_change":"2023-08-25T05:19:19.101369+0000","last_active":"2023-08-25T05:19:20.102292+0000","last_peered":"2023-08-25T05:19:20.102292+0000","last_clean":"2023-08-25T05:19:20.102292+0000","last_became_active":"2023-08-25T05:19:19.101088+0000","last_became_peered":"2023-08-25T05:19:19.101088+0000","last_unstale":"2023-08-25T05:19:20.102292+0000","last_undegraded":"2023-08-25T05:19:20.102292+0000","last_fullsized":"2023-08-25T05:19:20.102292+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:25:10.949007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"169'2","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100387+0000","last_change":"2023-08-25T05:19:18.093716+0000","last_active":"2023-08-25T05:19:20.100387+0000","last_peered":"2023-08-25T05:19:20.100387+0000","last_clean":"2023-08-25T05:19:20.100387+0000","last_became_active":"2023-08-25T05:19:18.093405+0000","last_became_peered":"2023-08-25T05:19:18.093405+0000","last_unstale":"2023-08-25T05:19:20.100387+0000","last_undegraded":"2023-08-25T05:19:20.100387+0000","last_fullsized":"2023-08-25T05:19:20.100387+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:31:11.585564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":321,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670917+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:19:20.670917+0000","last_peered":"2023-08-25T05:19:20.670917+0000","last_clean":"2023-08-25T05:19:20.670917+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:19:20.670917+0000","last_undegraded":"2023-08-25T05:19:20.670917+0000","last_fullsized":"2023-08-25T05:19:20.670917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:59:33.954297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670543+0000","last_change":"2023-08-25T05:19:19.101066+0000","last_active":"2023-08-25T05:19:20.670543+0000","last_peered":"2023-08-25T05:19:20.670543+0000","last_clean":"2023-08-25T05:19:20.670543+0000","last_became_active":"2023-08-25T05:19:19.100413+0000","last_became_peered":"2023-08-25T05:19:19.100413+0000","last_unstale":"2023-08-25T05:19:20.670543+0000","last_undegraded":"2023-08-25T05:19:20.670543+0000","last_fullsized":"2023-08-25T05:19:20.670543+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:51:57.187189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101945+0000","last_change":"2023-08-25T05:19:18.095988+0000","last_active":"2023-08-25T05:19:20.101945+0000","last_peered":"2023-08-25T05:19:20.101945+0000","last_clean":"2023-08-25T05:19:20.101945+0000","last_became_active":"2023-08-25T05:19:18.095703+0000","last_became_peered":"2023-08-25T05:19:18.095703+0000","last_unstale":"2023-08-25T05:19:20.101945+0000","last_undegraded":"2023-08-25T05:19:20.101945+0000","last_fullsized":"2023-08-25T05:19:20.101945+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:00:07.720641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":293,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670981+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:19:20.670981+0000","last_peered":"2023-08-25T05:19:20.670981+0000","last_clean":"2023-08-25T05:19:20.670981+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:19:20.670981+0000","last_undegraded":"2023-08-25T05:19:20.670981+0000","last_fullsized":"2023-08-25T05:19:20.670981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:08:17.333118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.099924+0000","last_change":"2023-08-25T05:19:19.102358+0000","last_active":"2023-08-25T05:19:20.099924+0000","last_peered":"2023-08-25T05:19:20.099924+0000","last_clean":"2023-08-25T05:19:20.099924+0000","last_became_active":"2023-08-25T05:19:19.102056+0000","last_became_peered":"2023-08-25T05:19:19.102056+0000","last_unstale":"2023-08-25T05:19:20.099924+0000","last_undegraded":"2023-08-25T05:19:20.099924+0000","last_fullsized":"2023-08-25T05:19:20.099924+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:52:53.748952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101790+0000","last_change":"2023-08-25T05:19:18.094251+0000","last_active":"2023-08-25T05:19:20.101790+0000","last_peered":"2023-08-25T05:19:20.101790+0000","last_clean":"2023-08-25T05:19:20.101790+0000","last_became_active":"2023-08-25T05:19:18.093738+0000","last_became_peered":"2023-08-25T05:19:18.093738+0000","last_unstale":"2023-08-25T05:19:20.101790+0000","last_undegraded":"2023-08-25T05:19:20.101790+0000","last_fullsized":"2023-08-25T05:19:20.101790+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:17.035462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":320,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670955+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:19:20.670955+0000","last_peered":"2023-08-25T05:19:20.670955+0000","last_clean":"2023-08-25T05:19:20.670955+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:19:20.670955+0000","last_undegraded":"2023-08-25T05:19:20.670955+0000","last_fullsized":"2023-08-25T05:19:20.670955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:48:10.515420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670901+0000","last_change":"2023-08-25T05:19:19.110969+0000","last_active":"2023-08-25T05:19:20.670901+0000","last_peered":"2023-08-25T05:19:20.670901+0000","last_clean":"2023-08-25T05:19:20.670901+0000","last_became_active":"2023-08-25T05:19:19.110658+0000","last_became_peered":"2023-08-25T05:19:19.110658+0000","last_unstale":"2023-08-25T05:19:20.670901+0000","last_undegraded":"2023-08-25T05:19:20.670901+0000","last_fullsized":"2023-08-25T05:19:20.670901+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:18:12.887154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"169'8","reported_seq":21,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386584+0000","last_change":"2023-08-25T05:19:18.103067+0000","last_active":"2023-08-25T05:19:20.386584+0000","last_peered":"2023-08-25T05:19:20.386584+0000","last_clean":"2023-08-25T05:19:20.386584+0000","last_became_active":"2023-08-25T05:19:18.102725+0000","last_became_peered":"2023-08-25T05:19:18.102725+0000","last_unstale":"2023-08-25T05:19:20.386584+0000","last_undegraded":"2023-08-25T05:19:20.386584+0000","last_fullsized":"2023-08-25T05:19:20.386584+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:24.864465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":340,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102822+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:19:20.102822+0000","last_peered":"2023-08-25T05:19:20.102822+0000","last_clean":"2023-08-25T05:19:20.102822+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:19:20.102822+0000","last_undegraded":"2023-08-25T05:19:20.102822+0000","last_fullsized":"2023-08-25T05:19:20.102822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:15:58.285824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1616,"num_read_kb":3373,"num_write":465,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3598,"ondisk_log_size":3598,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510355,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51876,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319964,"statfs":{"total":96636764160,"available":96583643136,"internally_reserved":0,"allocated":2711552,"data_stored":1657225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.51000000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89000000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.47799999999999998,"15min":0.38500000000000001},"max":{"1min":0.98299999999999998,"5min":1.0069999999999999,"15min":1.0089999999999999},"last":0.55700000000000005}]},{"osd":1,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96999999999999997,"5min":0.99399999999999999,"15min":1.0629999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.45100000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0329999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.745,"15min":0.748},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46200000000000002},"max":{"1min":0.95699999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.54400000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0109999999999999,"5min":1.405,"15min":1.405},"last":0.626}]},{"osd":3,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.496},"max":{"1min":0.92600000000000005,"5min":1.0409999999999999,"15min":1.0469999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.752,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84599999999999997,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82999999999999996,"5min":0.96499999999999997,"15min":0.97499999999999998},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63700000000000001,"15min":0.627},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82899999999999996,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66700000000000004,"15min":0.67200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.90300000000000002,"5min":0.97899999999999998,"15min":1.0309999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72599999999999998,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94099999999999995,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.45100000000000001},"max":{"1min":0.874,"5min":0.996,"15min":1.0649999999999999},"last":0.84099999999999997}]}]},{"osd":6,"up_from":15,"seq":64424510355,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29092,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342748,"statfs":{"total":96636764160,"available":96606973952,"internally_reserved":0,"allocated":2117632,"data_stored":1066905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.71699999999999997,"15min":0.73899999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91100000000000003,"5min":0.96799999999999997,"15min":1.2070000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.432,"5min":0.42699999999999999,"15min":0.41299999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.58299999999999996}]},{"osd":1,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.73299999999999998,"15min":0.73599999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.74099999999999999,"15min":0.75},"min":{"1min":0.441,"5min":0.441,"15min":0.42999999999999999},"max":{"1min":0.94599999999999995,"5min":1.0169999999999999,"15min":1.3009999999999999},"last":0.622}]},{"osd":2,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.77900000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94899999999999995,"5min":0.95699999999999996,"15min":1.1240000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.92700000000000005,"5min":1.0249999999999999,"15min":1.0549999999999999},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.499},"max":{"1min":0.82699999999999996,"5min":1.0229999999999999,"15min":1.6020000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.77200000000000002,"15min":0.77400000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.84799999999999998,"5min":1.004,"15min":1.1519999999999999},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.375},"max":{"1min":0.81699999999999995,"5min":0.95099999999999996,"15min":1.2589999999999999},"last":0.438},{"interface":"front","average":{"1min":0.625,"5min":0.628,"15min":0.62},"min":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.373},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.571},"last":0.41399999999999998}]},{"osd":5,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65400000000000003,"15min":0.65800000000000003},"min":{"1min":0.42099999999999999,"5min":0.41399999999999998,"15min":0.40799999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.0269999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.75,"15min":0.746},"min":{"1min":0.503,"5min":0.46999999999999997,"15min":0.44800000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.3380000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68799999999999994,"15min":0.66800000000000004},"min":{"1min":0.46500000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.0740000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.69299999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90300000000000002,"5min":1.038,"15min":1.667},"last":0.75800000000000001}]}]},{"osd":5,"up_from":14,"seq":60129543058,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55452,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316388,"statfs":{"total":96636764160,"available":96579981312,"internally_reserved":0,"allocated":2113536,"data_stored":1066835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":1.175,"15min":1.175},"last":0.878},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.73899999999999999,"15min":0.749},"min":{"1min":0.441,"5min":0.441,"15min":0.41599999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.0620000000000001},"last":0.85399999999999998}]},{"osd":1,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72599999999999998,"15min":0.748},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96099999999999997,"5min":1.02,"15min":1.042},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.76100000000000001,"15min":0.76400000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.94699999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94299999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90600000000000003,"5min":1.0349999999999999,"15min":1.038},"last":0.96099999999999997}]},{"osd":3,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.86599999999999999,"5min":1.131,"15min":1.131},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.88600000000000001,"5min":1.032,"15min":1.073},"last":0.98399999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Fri Aug 25 05:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.67300000000000004,"15min":0.66300000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.39700000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68400000000000005,"15min":0.67100000000000004},"min":{"1min":0.496,"5min":0.47299999999999998,"15min":0.41799999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.91400000000000003}]},{"osd":7,"last update":"Fri Aug 25 05:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.66300000000000003,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.42799999999999999,"15min":0.32100000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73099999999999998,"15min":0.71499999999999997},"min":{"1min":0.56799999999999995,"5min":0.48199999999999998,"15min":0.45100000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.79900000000000004}]}]},{"osd":4,"up_from":14,"seq":60129543058,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41576,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330264,"statfs":{"total":96636764160,"available":96594190336,"internally_reserved":0,"allocated":2125824,"data_stored":1068447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.746,"15min":0.73599999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91200000000000003,"5min":1.0509999999999999,"15min":1.0720000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.79700000000000004,"5min":0.96399999999999997,"15min":0.96999999999999997},"last":0.498}]},{"osd":1,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.75900000000000001,"15min":0.76000000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93000000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.752,"15min":0.755},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89800000000000002,"5min":1.008,"15min":1.0660000000000001},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.97099999999999997,"5min":1.002,"15min":1.0669999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47199999999999998},"max":{"1min":0.84399999999999997,"5min":1.093,"15min":1.093},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.78200000000000003,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.51700000000000002},"max":{"1min":1.0129999999999999,"5min":1.0369999999999999,"15min":1.044},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89500000000000002,"5min":1.048,"15min":1.1180000000000001},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56999999999999995,"15min":0.55500000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.751,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.0449999999999999},"last":0.40400000000000003}]},{"osd":6,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.746,"15min":0.73899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.622},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.628,"15min":0.624},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94399999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":0.70499999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.46100000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.65900000000000003}]}]},{"osd":3,"up_from":14,"seq":60129543058,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59628,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312212,"statfs":{"total":96636764160,"available":96575705088,"internally_reserved":0,"allocated":2121728,"data_stored":1067451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45400000000000001,"15min":0.46800000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.71899999999999997}]},{"osd":1,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72999999999999998,"5min":0.871,"15min":0.92700000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.628,"15min":0.63100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.88100000000000001,"15min":0.96199999999999997},"last":0.81799999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59199999999999997,"15min":0.60599999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73999999999999999,"5min":0.85099999999999998,"15min":0.89400000000000002},"last":0.752},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":0.85599999999999998,"15min":0.89400000000000002},"last":0.60199999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.81200000000000006,"15min":0.80300000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0900000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81200000000000006,"15min":0.83399999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.97599999999999998,"5min":1.2050000000000001,"15min":1.3220000000000001},"last":0.873}]},{"osd":5,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.81100000000000005,"15min":0.81799999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.054,"5min":1.1830000000000001,"15min":1.2749999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.82099999999999995,"15min":0.82899999999999996},"min":{"1min":0.58899999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"max":{"1min":1.1619999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.78500000000000003}]},{"osd":6,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.85899999999999999,"15min":0.86199999999999999},"min":{"1min":0.58599999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.113,"5min":1.357,"15min":1.357},"last":1.026},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83499999999999996,"15min":0.83899999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.085,"5min":1.274,"15min":1.274},"last":0.83199999999999996}]},{"osd":7,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.872,"15min":0.875},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.115,"5min":1.29,"15min":1.2929999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1339999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.98299999999999998}]}]},{"osd":2,"up_from":14,"seq":60129543059,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59624,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312216,"statfs":{"total":96636764160,"available":96575709184,"internally_reserved":0,"allocated":2121728,"data_stored":1066947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.66000000000000003,"5min":0.72599999999999998,"15min":0.76800000000000002},"last":0.31},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.40200000000000002}]},{"osd":1,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33200000000000002},"max":{"1min":0.69599999999999995,"5min":0.76300000000000001,"15min":0.77600000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.628},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.441}]},{"osd":3,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.78100000000000003,"15min":0.83599999999999997},"last":0.378},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82899999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85099999999999998,"15min":0.83599999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1870000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.48299999999999998},"max":{"1min":1.089,"5min":1.163,"15min":1.163},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.82599999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.54300000000000004},"max":{"1min":1.113,"5min":1.393,"15min":1.393},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.53900000000000003},"max":{"1min":1.2310000000000001,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.50700000000000001}]},{"osd":6,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.88200000000000001,"15min":0.85999999999999999},"min":{"1min":0.63800000000000001,"5min":0.63700000000000001,"15min":0.58699999999999997},"max":{"1min":1.169,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.88900000000000001,"15min":0.89400000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1910000000000001,"5min":1.2529999999999999,"15min":1.369},"last":0.55200000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84899999999999998,"15min":0.82999999999999996},"min":{"1min":0.68799999999999994,"5min":0.621,"15min":0.54300000000000004},"max":{"1min":1.131,"5min":1.292,"15min":1.292},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.85399999999999998,"15min":0.83799999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.125,"5min":1.1870000000000001,"15min":1.254},"last":0.51900000000000002}]}]},{"osd":1,"up_from":14,"seq":60129543059,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37416,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334424,"statfs":{"total":96636764160,"available":96598450176,"internally_reserved":0,"allocated":2117632,"data_stored":1066905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.48299999999999998},"min":{"1min":0.32300000000000001,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.752,"15min":0.91700000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.88700000000000001},"last":0.28999999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73699999999999999,"5min":0.749,"15min":0.78900000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42899999999999999}]},{"osd":3,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82299999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.437,"5min":0.435,"15min":0.40600000000000003},"max":{"1min":0.86799999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.499},"max":{"1min":0.97899999999999998,"5min":1.0680000000000001,"15min":1.212},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.83099999999999996,"15min":0.82499999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.0229999999999999,"5min":1.0429999999999999,"15min":1.163},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.52900000000000003},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.81999999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.083,"5min":1.115,"15min":1.171},"last":0.68700000000000006}]},{"osd":6,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86499999999999999,"15min":0.84599999999999997},"min":{"1min":0.64400000000000002,"5min":0.627,"15min":0.51500000000000001},"max":{"1min":1.107,"5min":1.1579999999999999,"15min":1.3700000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83299999999999996,"15min":0.83399999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.1830000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.044,"5min":1.1659999999999999,"15min":1.3320000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.58899999999999997},"max":{"1min":1.115,"5min":1.115,"15min":1.268},"last":0.70399999999999996}]}]},{"osd":0,"up_from":14,"seq":60129543058,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60220,"kb_used_data":2668,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311620,"statfs":{"total":96636764160,"available":96575098880,"internally_reserved":0,"allocated":2732032,"data_stored":1659521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.49199999999999999,"15min":0.50600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77500000000000002,"5min":0.79600000000000004,"15min":0.82599999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.64500000000000002,"5min":0.876,"15min":0.876},"last":0.47099999999999997}]},{"osd":2,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71499999999999997,"5min":0.82899999999999996,"15min":0.90700000000000003},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.57699999999999996,"5min":0.83099999999999996,"15min":0.86099999999999999},"last":0.54500000000000004}]},{"osd":3,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.499,"15min":0.50900000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.60199999999999998,"5min":0.93799999999999994,"15min":1.0409999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.59399999999999997,"15min":0.61099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79900000000000004,"5min":0.878,"15min":0.878},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92900000000000005,"5min":1.2649999999999999,"15min":1.3740000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.125,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.85599999999999998}]},{"osd":5,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.78500000000000003,"15min":0.79900000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.46100000000000002},"max":{"1min":1.012,"5min":1.0820000000000001,"15min":1.2210000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.80900000000000005,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.3260000000000001},"last":0.88}]},{"osd":6,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.89600000000000002,"5min":1.196,"15min":1.196},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0589999999999999,"5min":1.216,"15min":1.2849999999999999},"last":0.75}]},{"osd":7,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.85099999999999998,"15min":0.86299999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.149,"5min":1.22,"15min":1.2410000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.81899999999999995,"15min":0.83599999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.95999999999999996,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.75900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:19:24.012 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-25T05:19:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.185+0000 7f5f25959640 1 Processor -- start 2023-08-25T05:19:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.185+0000 7f5f25959640 1 -- start start 2023-08-25T05:19:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.185+0000 7f5f25959640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5f2015dcb0 0x7f5f2006bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.185+0000 7f5f25959640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2015e140 con 0x7f5f20069c20 2023-08-25T05:19:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.185+0000 7f5f25959640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2015d260 con 0x7f5f2006c060 2023-08-25T05:19:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.185+0000 7f5f25959640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f20159b70 con 0x7f5f2015dcb0 2023-08-25T05:19:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.185+0000 7f5f1effd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5f20069c20 0x7f5f2006a000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38274/0 (socket says 172.21.15.55:38274) 2023-08-25T05:19:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.185+0000 7f5f1effd640 1 -- 172.21.15.55:0/3516635669 learned_addr learned my addr 172.21.15.55:0/3516635669 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.189+0000 7f5f167fc640 1 --2- 172.21.15.55:0/3516635669 >> v2:172.21.15.55:3300/0 conn(0x7f5f2015dcb0 0x7f5f2006bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.189+0000 7f5f1e7fc640 1 -- 172.21.15.55:0/3516635669 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4495331 0 0) 0x7f5f2015e140 con 0x7f5f20069c20 2023-08-25T05:19:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.189+0000 7f5f1e7fc640 1 -- 172.21.15.55:0/3516635669 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f0c003530 con 0x7f5f20069c20 2023-08-25T05:19:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.189+0000 7f5f167fc640 1 -- 172.21.15.55:0/3516635669 >> v1:172.21.15.110:6789/0 conn(0x7f5f2006c060 legacy=0x7f5f200c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.189+0000 7f5f167fc640 1 -- 172.21.15.55:0/3516635669 >> v1:172.21.15.55:6789/0 conn(0x7f5f20069c20 legacy=0x7f5f2006a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.189+0000 7f5f167fc640 1 -- 172.21.15.55:0/3516635669 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2006c570 con 0x7f5f2015dcb0 2023-08-25T05:19:24.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.189+0000 7f5f167fc640 1 --2- 172.21.15.55:0/3516635669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f2015dcb0 0x7f5f2006bb20 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f5f080097c0 tx=0x7f5f0801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8386bc97f91d7d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.189+0000 7f5f1e7fc640 1 -- 172.21.15.55:0/3516635669 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f080ac620 con 0x7f5f2015dcb0 2023-08-25T05:19:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.189+0000 7f5f1e7fc640 1 -- 172.21.15.55:0/3516635669 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f080ac780 con 0x7f5f2015dcb0 2023-08-25T05:19:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.189+0000 7f5f1e7fc640 1 -- 172.21.15.55:0/3516635669 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f080acb10 con 0x7f5f2015dcb0 2023-08-25T05:19:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f25959640 1 -- 172.21.15.55:0/3516635669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f2015dcb0 msgr2=0x7f5f2006bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f25959640 1 --2- 172.21.15.55:0/3516635669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f2015dcb0 0x7f5f2006bb20 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f5f080097c0 tx=0x7f5f0801c3c0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f25959640 1 -- 172.21.15.55:0/3516635669 shutdown_connections 2023-08-25T05:19:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f25959640 1 --2- 172.21.15.55:0/3516635669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f2015dcb0 0x7f5f2006bb20 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f25959640 1 -- 172.21.15.55:0/3516635669 >> 172.21.15.55:0/3516635669 conn(0x7f5f200ce7f0 msgr2=0x7f5f200cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f25959640 1 -- 172.21.15.55:0/3516635669 shutdown_connections 2023-08-25T05:19:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f25959640 1 -- 172.21.15.55:0/3516635669 wait complete. 2023-08-25T05:19:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f25959640 1 Processor -- start 2023-08-25T05:19:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f25959640 1 -- start start 2023-08-25T05:19:24.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f25959640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f20069c20 0x7f5f200c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:24.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f25959640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f2006c060 0x7f5f200cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:24.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f25959640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f2015dcb0 0x7f5f200cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:24.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f25959640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f200c9f40 con 0x7f5f2015dcb0 2023-08-25T05:19:24.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f25959640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f200ca220 con 0x7f5f2006c060 2023-08-25T05:19:24.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f25959640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f200ca500 con 0x7f5f20069c20 2023-08-25T05:19:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f1f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f2015dcb0 0x7f5f200cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f1f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f2015dcb0 0x7f5f200cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51188/0 (socket says 172.21.15.55:51188) 2023-08-25T05:19:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f1f7fe640 1 -- 172.21.15.55:0/3639705479 learned_addr learned my addr 172.21.15.55:0/3639705479 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f1effd640 1 --2- 172.21.15.55:0/3639705479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f20069c20 0x7f5f200c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f167fc640 1 --2- 172.21.15.55:0/3639705479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f2006c060 0x7f5f200cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:24.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f1f7fe640 1 -- 172.21.15.55:0/3639705479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f20069c20 msgr2=0x7f5f200c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:24.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f1f7fe640 1 --2- 172.21.15.55:0/3639705479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f20069c20 0x7f5f200c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f1f7fe640 1 -- 172.21.15.55:0/3639705479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f2006c060 msgr2=0x7f5f200cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:24.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f1f7fe640 1 --2- 172.21.15.55:0/3639705479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f2006c060 0x7f5f200cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.193+0000 7f5f1f7fe640 1 -- 172.21.15.55:0/3639705479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f08009420 con 0x7f5f2015dcb0 2023-08-25T05:19:24.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.197+0000 7f5f1f7fe640 1 --2- 172.21.15.55:0/3639705479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f2015dcb0 0x7f5f200cb520 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800c770 tx=0x7f5f1800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:24.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.197+0000 7f5f1cff9640 1 -- 172.21.15.55:0/3639705479 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f18003b80 con 0x7f5f2015dcb0 2023-08-25T05:19:24.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.197+0000 7f5f1cff9640 1 -- 172.21.15.55:0/3639705479 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f18003ce0 con 0x7f5f2015dcb0 2023-08-25T05:19:24.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.197+0000 7f5f1cff9640 1 -- 172.21.15.55:0/3639705479 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1800aa90 con 0x7f5f2015dcb0 2023-08-25T05:19:24.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.197+0000 7f5f25959640 1 -- 172.21.15.55:0/3639705479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f200ca7e0 con 0x7f5f2015dcb0 2023-08-25T05:19:24.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.197+0000 7f5f25959640 1 -- 172.21.15.55:0/3639705479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f200abef0 con 0x7f5f2015dcb0 2023-08-25T05:19:24.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.197+0000 7f5f25959640 1 -- 172.21.15.55:0/3639705479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2004dbe0 con 0x7f5f2015dcb0 2023-08-25T05:19:24.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.197+0000 7f5f1cff9640 1 -- 172.21.15.55:0/3639705479 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f5f1800abf0 con 0x7f5f2015dcb0 2023-08-25T05:19:24.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.197+0000 7f5f1cff9640 1 --2- 172.21.15.55:0/3639705479 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f5f000657a0 0x7f5f00067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:24.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.197+0000 7f5f1cff9640 1 -- 172.21.15.55:0/3639705479 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f18082dc0 con 0x7f5f2015dcb0 2023-08-25T05:19:24.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.197+0000 7f5f1effd640 1 --2- 172.21.15.55:0/3639705479 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f5f000657a0 0x7f5f00067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:24.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.201+0000 7f5f1effd640 1 --2- 172.21.15.55:0/3639705479 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f5f000657a0 0x7f5f00067c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5f100011f0 tx=0x7f5f10007d40 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:24.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.201+0000 7f5f1cff9640 1 -- 172.21.15.55:0/3639705479 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5f180506f0 con 0x7f5f2015dcb0 2023-08-25T05:19:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.417+0000 7f5f25959640 1 -- 172.21.15.55:0/3639705479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f5f200cac90 con 0x7f5f2015dcb0 2023-08-25T05:19:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.417+0000 7f5f1cff9640 1 -- 172.21.15.55:0/3639705479 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3215 (secure 0 0 0) 0x7f5f18053d10 con 0x7f5f2015dcb0 2023-08-25T05:19:24.421 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:24.421 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":4608,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":170,"num_osds":8,"num_up_osds":8,"osd_up_since":1692936167,"num_in_osds":8,"osd_in_since":1692936158,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592778,"bytes_used":404361216,"bytes_avail":772689752064,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":83,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":10149}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2023-08-25T05:19:05.729520+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-25T05:19:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.417+0000 7f5f25959640 1 -- 172.21.15.55:0/3639705479 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f5f000657a0 msgr2=0x7f5f00067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.417+0000 7f5f25959640 1 --2- 172.21.15.55:0/3639705479 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f5f000657a0 0x7f5f00067c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5f100011f0 tx=0x7f5f10007d40 comp rx=0 tx=0).stop 2023-08-25T05:19:24.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.417+0000 7f5f25959640 1 -- 172.21.15.55:0/3639705479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f2015dcb0 msgr2=0x7f5f200cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.417+0000 7f5f25959640 1 --2- 172.21.15.55:0/3639705479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f2015dcb0 0x7f5f200cb520 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f5f1800c770 tx=0x7f5f1800cc30 comp rx=0 tx=0).stop 2023-08-25T05:19:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.417+0000 7f5f25959640 1 -- 172.21.15.55:0/3639705479 shutdown_connections 2023-08-25T05:19:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.417+0000 7f5f25959640 1 --2- 172.21.15.55:0/3639705479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f2015dcb0 0x7f5f200cb520 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.417+0000 7f5f25959640 1 --2- 172.21.15.55:0/3639705479 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f5f000657a0 0x7f5f00067c60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.417+0000 7f5f25959640 1 --2- 172.21.15.55:0/3639705479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f2006c060 0x7f5f200cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.417+0000 7f5f25959640 1 --2- 172.21.15.55:0/3639705479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f20069c20 0x7f5f200c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.417+0000 7f5f25959640 1 -- 172.21.15.55:0/3639705479 >> 172.21.15.55:0/3639705479 conn(0x7f5f200ce7f0 msgr2=0x7f5f200cd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.417+0000 7f5f25959640 1 -- 172.21.15.55:0/3639705479 shutdown_connections 2023-08-25T05:19:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.417+0000 7f5f25959640 1 -- 172.21.15.55:0/3639705479 wait complete. 2023-08-25T05:19:24.441 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-25T05:19:24.442 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:19:24.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.581+0000 7f57b5311640 1 Processor -- start 2023-08-25T05:19:24.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.581+0000 7f57b5311640 1 -- start start 2023-08-25T05:19:24.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.585+0000 7f57b5311640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f57b00cdde0 0x7f57b00ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:24.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.585+0000 7f57b5311640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57b00b2e40 0x7f57b00b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:24.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.585+0000 7f57b5311640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b00b29b0 con 0x7f57b00d0da0 2023-08-25T05:19:24.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.585+0000 7f57b5311640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b00ce760 con 0x7f57b00b2e40 2023-08-25T05:19:24.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.585+0000 7f57b5311640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b00b1dc0 con 0x7f57b00cdde0 2023-08-25T05:19:24.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.585+0000 7f57af7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57b00b2e40 0x7f57b00b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:24.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.585+0000 7f57aeffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f57b00d0da0 0x7f57b00d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38286/0 (socket says 172.21.15.55:38286) 2023-08-25T05:19:24.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.585+0000 7f57aeffd640 1 -- 172.21.15.55:0/2427020993 learned_addr learned my addr 172.21.15.55:0/2427020993 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:24.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.585+0000 7f57a7fff640 1 --2- 172.21.15.55:0/2427020993 >> v2:172.21.15.110:3300/0 conn(0x7f57b00cdde0 0x7f57b00ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:24.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.585+0000 7f57ae7fc640 1 -- 172.21.15.55:0/2427020993 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 249557978 0 0) 0x7f57b00b29b0 con 0x7f57b00d0da0 2023-08-25T05:19:24.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.585+0000 7f57ae7fc640 1 -- 172.21.15.55:0/2427020993 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f579c003530 con 0x7f57b00d0da0 2023-08-25T05:19:24.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.585+0000 7f57af7fe640 1 -- 172.21.15.55:0/2427020993 >> v2:172.21.15.110:3300/0 conn(0x7f57b00cdde0 msgr2=0x7f57b00ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:24.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.585+0000 7f57af7fe640 1 --2- 172.21.15.55:0/2427020993 >> v2:172.21.15.110:3300/0 conn(0x7f57b00cdde0 0x7f57b00ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.585+0000 7f57af7fe640 1 -- 172.21.15.55:0/2427020993 >> v1:172.21.15.55:6789/0 conn(0x7f57b00d0da0 legacy=0x7f57b00d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:24.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.585+0000 7f57af7fe640 1 -- 172.21.15.55:0/2427020993 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b00b2080 con 0x7f57b00b2e40 2023-08-25T05:19:24.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.589+0000 7f57af7fe640 1 --2- 172.21.15.55:0/2427020993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b00b2e40 0x7f57b00b32b0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f57b00d38c0 tx=0x7f57a801f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b0067fd038d8fd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:24.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.589+0000 7f57ae7fc640 1 -- 172.21.15.55:0/2427020993 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80b0440 con 0x7f57b00b2e40 2023-08-25T05:19:24.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.589+0000 7f57ae7fc640 1 -- 172.21.15.55:0/2427020993 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a80b05a0 con 0x7f57b00b2e40 2023-08-25T05:19:24.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.589+0000 7f57ae7fc640 1 -- 172.21.15.55:0/2427020993 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80b0910 con 0x7f57b00b2e40 2023-08-25T05:19:24.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.589+0000 7f57b5311640 1 -- 172.21.15.55:0/2427020993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b00b2e40 msgr2=0x7f57b00b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:24.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.589+0000 7f57b5311640 1 --2- 172.21.15.55:0/2427020993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b00b2e40 0x7f57b00b32b0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f57b00d38c0 tx=0x7f57a801f0f0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.589+0000 7f57b5311640 1 -- 172.21.15.55:0/2427020993 shutdown_connections 2023-08-25T05:19:24.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.589+0000 7f57b5311640 1 --2- 172.21.15.55:0/2427020993 >> v2:172.21.15.110:3300/0 conn(0x7f57b00cdde0 0x7f57b00ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.589+0000 7f57b5311640 1 --2- 172.21.15.55:0/2427020993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b00b2e40 0x7f57b00b32b0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.589+0000 7f57b5311640 1 -- 172.21.15.55:0/2427020993 >> 172.21.15.55:0/2427020993 conn(0x7f57b009bae0 msgr2=0x7f57b00d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:24.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.589+0000 7f57b5311640 1 -- 172.21.15.55:0/2427020993 shutdown_connections 2023-08-25T05:19:24.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.589+0000 7f57b5311640 1 -- 172.21.15.55:0/2427020993 wait complete. 2023-08-25T05:19:24.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.589+0000 7f57b5311640 1 Processor -- start 2023-08-25T05:19:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.589+0000 7f57b5311640 1 -- start start 2023-08-25T05:19:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57b5311640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b00b2e40 0x7f57b006b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57b5311640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57b00cdde0 0x7f57b0151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57b5311640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57b00d0da0 0x7f57b0151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57b5311640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b01f21b0 con 0x7f57b00b2e40 2023-08-25T05:19:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57b5311640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b01f2490 con 0x7f57b00d0da0 2023-08-25T05:19:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57b5311640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b01f2770 con 0x7f57b00cdde0 2023-08-25T05:19:24.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57aeffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b00b2e40 0x7f57b006b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:24.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57aeffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b00b2e40 0x7f57b006b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51200/0 (socket says 172.21.15.55:51200) 2023-08-25T05:19:24.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57aeffd640 1 -- 172.21.15.55:0/264266153 learned_addr learned my addr 172.21.15.55:0/264266153 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:24.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57af7fe640 1 --2- 172.21.15.55:0/264266153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57b00d0da0 0x7f57b0151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:24.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57a7fff640 1 --2- 172.21.15.55:0/264266153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57b00cdde0 0x7f57b0151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:24.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57aeffd640 1 -- 172.21.15.55:0/264266153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57b00cdde0 msgr2=0x7f57b0151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:24.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57aeffd640 1 --2- 172.21.15.55:0/264266153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57b00cdde0 0x7f57b0151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57aeffd640 1 -- 172.21.15.55:0/264266153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57b00d0da0 msgr2=0x7f57b0151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:24.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57aeffd640 1 --2- 172.21.15.55:0/264266153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57b00d0da0 0x7f57b0151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57aeffd640 1 -- 172.21.15.55:0/264266153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a8009a70 con 0x7f57b00b2e40 2023-08-25T05:19:24.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57af7fe640 1 --2- 172.21.15.55:0/264266153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57b00d0da0 0x7f57b0151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:24.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57a7fff640 1 --2- 172.21.15.55:0/264266153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57b00cdde0 0x7f57b0151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:24.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57aeffd640 1 --2- 172.21.15.55:0/264266153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b00b2e40 0x7f57b006b4f0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f57a000c400 tx=0x7f57a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:24.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57a77fe640 1 -- 172.21.15.55:0/264266153 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a00074e0 con 0x7f57b00b2e40 2023-08-25T05:19:24.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57a77fe640 1 -- 172.21.15.55:0/264266153 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a0007660 con 0x7f57b00b2e40 2023-08-25T05:19:24.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57a77fe640 1 -- 172.21.15.55:0/264266153 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a00059f0 con 0x7f57b00b2e40 2023-08-25T05:19:24.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57b5311640 1 -- 172.21.15.55:0/264266153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b01f2a50 con 0x7f57b00b2e40 2023-08-25T05:19:24.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57b5311640 1 -- 172.21.15.55:0/264266153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b01f1dd0 con 0x7f57b00b2e40 2023-08-25T05:19:24.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57b5311640 1 -- 172.21.15.55:0/264266153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b00c9870 con 0x7f57b00b2e40 2023-08-25T05:19:24.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.593+0000 7f57a77fe640 1 -- 172.21.15.55:0/264266153 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f57a0005b50 con 0x7f57b00b2e40 2023-08-25T05:19:24.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.597+0000 7f57a77fe640 1 --2- 172.21.15.55:0/264266153 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f57900657a0 0x7f5790067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:24.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.597+0000 7f57a77fe640 1 -- 172.21.15.55:0/264266153 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f57a0082510 con 0x7f57b00b2e40 2023-08-25T05:19:24.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.597+0000 7f57a7fff640 1 --2- 172.21.15.55:0/264266153 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f57900657a0 0x7f5790067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:24.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.597+0000 7f57a7fff640 1 --2- 172.21.15.55:0/264266153 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f57900657a0 0x7f5790067c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f57b00b84a0 tx=0x7f5798008040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:24.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.601+0000 7f57a77fe640 1 -- 172.21.15.55:0/264266153 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f57a004ff50 con 0x7f57b00b2e40 2023-08-25T05:19:24.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.753+0000 7f57b5311640 1 -- 172.21.15.55:0/264266153 --> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f57b00b2640 con 0x7f57900657a0 2023-08-25T05:19:24.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.761+0000 7f57a77fe640 1 -- 172.21.15.55:0/264266153 <== mgr.9163 v2:172.21.15.110:6832/221263034 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311610 (secure 0 0 0) 0x7f5798011a10 con 0x7f57900657a0 2023-08-25T05:19:24.767 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:24.768 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:19:24.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.765+0000 7f57b5311640 1 -- 172.21.15.55:0/264266153 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f57900657a0 msgr2=0x7f5790067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.765+0000 7f57b5311640 1 --2- 172.21.15.55:0/264266153 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f57900657a0 0x7f5790067c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f57b00b84a0 tx=0x7f5798008040 comp rx=0 tx=0).stop 2023-08-25T05:19:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.765+0000 7f57b5311640 1 -- 172.21.15.55:0/264266153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b00b2e40 msgr2=0x7f57b006b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.765+0000 7f57b5311640 1 --2- 172.21.15.55:0/264266153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b00b2e40 0x7f57b006b4f0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f57a000c400 tx=0x7f57a000c8c0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.765+0000 7f57b5311640 1 -- 172.21.15.55:0/264266153 shutdown_connections 2023-08-25T05:19:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.765+0000 7f57b5311640 1 --2- 172.21.15.55:0/264266153 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f57900657a0 0x7f5790067c60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.765+0000 7f57b5311640 1 --2- 172.21.15.55:0/264266153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f57b00d0da0 0x7f57b0151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.765+0000 7f57b5311640 1 --2- 172.21.15.55:0/264266153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f57b00cdde0 0x7f57b0151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.765+0000 7f57b5311640 1 --2- 172.21.15.55:0/264266153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b00b2e40 0x7f57b006b4f0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.765+0000 7f57b5311640 1 -- 172.21.15.55:0/264266153 >> 172.21.15.55:0/264266153 conn(0x7f57b009bae0 msgr2=0x7f57b00b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.765+0000 7f57b5311640 1 -- 172.21.15.55:0/264266153 shutdown_connections 2023-08-25T05:19:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:24.765+0000 7f57b5311640 1 -- 172.21.15.55:0/264266153 wait complete. 2023-08-25T05:19:24.787 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-25T05:19:23.733350+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1616,"num_read_kb":3373,"num_write":509,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3636,"ondisk_log_size":3636,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":192,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":394884,"kb_used_data":17736,"kb_used_omap":13,"kb_used_meta":377010,"kb_avail":754579836,"statfs":{"total":773094113280,"available":772689752064,"internally_reserved":0,"allocated":18161664,"data_stored":9720236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":386058328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001215"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387222+0000","last_change":"2023-08-25T05:19:19.105458+0000","last_active":"2023-08-25T05:19:20.387222+0000","last_peered":"2023-08-25T05:19:20.387222+0000","last_clean":"2023-08-25T05:19:20.387222+0000","last_became_active":"2023-08-25T05:19:19.104947+0000","last_became_peered":"2023-08-25T05:19:19.104947+0000","last_unstale":"2023-08-25T05:19:20.387222+0000","last_undegraded":"2023-08-25T05:19:20.387222+0000","last_fullsized":"2023-08-25T05:19:20.387222+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:04:23.125561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670934+0000","last_change":"2023-08-25T05:19:19.097697+0000","last_active":"2023-08-25T05:19:20.670934+0000","last_peered":"2023-08-25T05:19:20.670934+0000","last_clean":"2023-08-25T05:19:20.670934+0000","last_became_active":"2023-08-25T05:19:19.097401+0000","last_became_peered":"2023-08-25T05:19:19.097401+0000","last_unstale":"2023-08-25T05:19:20.670934+0000","last_undegraded":"2023-08-25T05:19:20.670934+0000","last_fullsized":"2023-08-25T05:19:20.670934+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:22:06.016604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670720+0000","last_change":"2023-08-25T05:19:19.109971+0000","last_active":"2023-08-25T05:19:20.670720+0000","last_peered":"2023-08-25T05:19:20.670720+0000","last_clean":"2023-08-25T05:19:20.670720+0000","last_became_active":"2023-08-25T05:19:19.109681+0000","last_became_peered":"2023-08-25T05:19:19.109681+0000","last_unstale":"2023-08-25T05:19:20.670720+0000","last_undegraded":"2023-08-25T05:19:20.670720+0000","last_fullsized":"2023-08-25T05:19:20.670720+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:59:08.669080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101723+0000","last_change":"2023-08-25T05:19:19.087934+0000","last_active":"2023-08-25T05:19:20.101723+0000","last_peered":"2023-08-25T05:19:20.101723+0000","last_clean":"2023-08-25T05:19:20.101723+0000","last_became_active":"2023-08-25T05:19:19.087573+0000","last_became_peered":"2023-08-25T05:19:19.087573+0000","last_unstale":"2023-08-25T05:19:20.101723+0000","last_undegraded":"2023-08-25T05:19:20.101723+0000","last_fullsized":"2023-08-25T05:19:20.101723+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:08:47.094804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100398+0000","last_change":"2023-08-25T05:19:19.110091+0000","last_active":"2023-08-25T05:19:20.100398+0000","last_peered":"2023-08-25T05:19:20.100398+0000","last_clean":"2023-08-25T05:19:20.100398+0000","last_became_active":"2023-08-25T05:19:19.108036+0000","last_became_peered":"2023-08-25T05:19:19.108036+0000","last_unstale":"2023-08-25T05:19:20.100398+0000","last_undegraded":"2023-08-25T05:19:20.100398+0000","last_fullsized":"2023-08-25T05:19:20.100398+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:56.343935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100257+0000","last_change":"2023-08-25T05:19:19.111006+0000","last_active":"2023-08-25T05:19:20.100257+0000","last_peered":"2023-08-25T05:19:20.100257+0000","last_clean":"2023-08-25T05:19:20.100257+0000","last_became_active":"2023-08-25T05:19:19.110679+0000","last_became_peered":"2023-08-25T05:19:19.110679+0000","last_unstale":"2023-08-25T05:19:20.100257+0000","last_undegraded":"2023-08-25T05:19:20.100257+0000","last_fullsized":"2023-08-25T05:19:20.100257+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:30:50.264686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386815+0000","last_change":"2023-08-25T05:19:19.111964+0000","last_active":"2023-08-25T05:19:20.386815+0000","last_peered":"2023-08-25T05:19:20.386815+0000","last_clean":"2023-08-25T05:19:20.386815+0000","last_became_active":"2023-08-25T05:19:19.110964+0000","last_became_peered":"2023-08-25T05:19:19.110964+0000","last_unstale":"2023-08-25T05:19:20.386815+0000","last_undegraded":"2023-08-25T05:19:20.386815+0000","last_fullsized":"2023-08-25T05:19:20.386815+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:36:09.034953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102061+0000","last_change":"2023-08-25T05:19:19.096673+0000","last_active":"2023-08-25T05:19:20.102061+0000","last_peered":"2023-08-25T05:19:20.102061+0000","last_clean":"2023-08-25T05:19:20.102061+0000","last_became_active":"2023-08-25T05:19:19.094244+0000","last_became_peered":"2023-08-25T05:19:19.094244+0000","last_unstale":"2023-08-25T05:19:20.102061+0000","last_undegraded":"2023-08-25T05:19:20.102061+0000","last_fullsized":"2023-08-25T05:19:20.102061+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:17:01.615689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100562+0000","last_change":"2023-08-25T05:19:19.118566+0000","last_active":"2023-08-25T05:19:20.100562+0000","last_peered":"2023-08-25T05:19:20.100562+0000","last_clean":"2023-08-25T05:19:20.100562+0000","last_became_active":"2023-08-25T05:19:19.112749+0000","last_became_peered":"2023-08-25T05:19:19.112749+0000","last_unstale":"2023-08-25T05:19:20.100562+0000","last_undegraded":"2023-08-25T05:19:20.100562+0000","last_fullsized":"2023-08-25T05:19:20.100562+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:29:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100587+0000","last_change":"2023-08-25T05:19:19.110305+0000","last_active":"2023-08-25T05:19:20.100587+0000","last_peered":"2023-08-25T05:19:20.100587+0000","last_clean":"2023-08-25T05:19:20.100587+0000","last_became_active":"2023-08-25T05:19:19.108828+0000","last_became_peered":"2023-08-25T05:19:19.108828+0000","last_unstale":"2023-08-25T05:19:20.100587+0000","last_undegraded":"2023-08-25T05:19:20.100587+0000","last_fullsized":"2023-08-25T05:19:20.100587+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:59:56.021201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669617+0000","last_change":"2023-08-25T05:19:19.101083+0000","last_active":"2023-08-25T05:19:20.669617+0000","last_peered":"2023-08-25T05:19:20.669617+0000","last_clean":"2023-08-25T05:19:20.669617+0000","last_became_active":"2023-08-25T05:19:19.100783+0000","last_became_peered":"2023-08-25T05:19:19.100783+0000","last_unstale":"2023-08-25T05:19:20.669617+0000","last_undegraded":"2023-08-25T05:19:20.669617+0000","last_fullsized":"2023-08-25T05:19:20.669617+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:06:27.041983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102187+0000","last_change":"2023-08-25T05:19:19.105347+0000","last_active":"2023-08-25T05:19:20.102187+0000","last_peered":"2023-08-25T05:19:20.102187+0000","last_clean":"2023-08-25T05:19:20.102187+0000","last_became_active":"2023-08-25T05:19:19.105087+0000","last_became_peered":"2023-08-25T05:19:19.105087+0000","last_unstale":"2023-08-25T05:19:20.102187+0000","last_undegraded":"2023-08-25T05:19:20.102187+0000","last_fullsized":"2023-08-25T05:19:20.102187+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:53:45.015387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.099965+0000","last_change":"2023-08-25T05:19:19.110786+0000","last_active":"2023-08-25T05:19:20.099965+0000","last_peered":"2023-08-25T05:19:20.099965+0000","last_clean":"2023-08-25T05:19:20.099965+0000","last_became_active":"2023-08-25T05:19:19.108699+0000","last_became_peered":"2023-08-25T05:19:19.108699+0000","last_unstale":"2023-08-25T05:19:20.099965+0000","last_undegraded":"2023-08-25T05:19:20.099965+0000","last_fullsized":"2023-08-25T05:19:20.099965+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:59.578688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.103004+0000","last_change":"2023-08-25T05:19:19.104814+0000","last_active":"2023-08-25T05:19:20.103004+0000","last_peered":"2023-08-25T05:19:20.103004+0000","last_clean":"2023-08-25T05:19:20.103004+0000","last_became_active":"2023-08-25T05:19:19.104517+0000","last_became_peered":"2023-08-25T05:19:19.104517+0000","last_unstale":"2023-08-25T05:19:20.103004+0000","last_undegraded":"2023-08-25T05:19:20.103004+0000","last_fullsized":"2023-08-25T05:19:20.103004+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:48:12.851567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670538+0000","last_change":"2023-08-25T05:19:19.101295+0000","last_active":"2023-08-25T05:19:20.670538+0000","last_peered":"2023-08-25T05:19:20.670538+0000","last_clean":"2023-08-25T05:19:20.670538+0000","last_became_active":"2023-08-25T05:19:19.100728+0000","last_became_peered":"2023-08-25T05:19:19.100728+0000","last_unstale":"2023-08-25T05:19:20.670538+0000","last_undegraded":"2023-08-25T05:19:20.670538+0000","last_fullsized":"2023-08-25T05:19:20.670538+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:06:43.803011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.099751+0000","last_change":"2023-08-25T05:19:19.105817+0000","last_active":"2023-08-25T05:19:20.099751+0000","last_peered":"2023-08-25T05:19:20.099751+0000","last_clean":"2023-08-25T05:19:20.099751+0000","last_became_active":"2023-08-25T05:19:19.105440+0000","last_became_peered":"2023-08-25T05:19:19.105440+0000","last_unstale":"2023-08-25T05:19:20.099751+0000","last_undegraded":"2023-08-25T05:19:20.099751+0000","last_fullsized":"2023-08-25T05:19:20.099751+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:54:15.215671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102346+0000","last_change":"2023-08-25T05:19:19.107687+0000","last_active":"2023-08-25T05:19:20.102346+0000","last_peered":"2023-08-25T05:19:20.102346+0000","last_clean":"2023-08-25T05:19:20.102346+0000","last_became_active":"2023-08-25T05:19:19.107352+0000","last_became_peered":"2023-08-25T05:19:19.107352+0000","last_unstale":"2023-08-25T05:19:20.102346+0000","last_undegraded":"2023-08-25T05:19:20.102346+0000","last_fullsized":"2023-08-25T05:19:20.102346+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:16.742610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669842+0000","last_change":"2023-08-25T05:19:19.106678+0000","last_active":"2023-08-25T05:19:20.669842+0000","last_peered":"2023-08-25T05:19:20.669842+0000","last_clean":"2023-08-25T05:19:20.669842+0000","last_became_active":"2023-08-25T05:19:19.106200+0000","last_became_peered":"2023-08-25T05:19:19.106200+0000","last_unstale":"2023-08-25T05:19:20.669842+0000","last_undegraded":"2023-08-25T05:19:20.669842+0000","last_fullsized":"2023-08-25T05:19:20.669842+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:16:30.547249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.671022+0000","last_change":"2023-08-25T05:19:19.109289+0000","last_active":"2023-08-25T05:19:20.671022+0000","last_peered":"2023-08-25T05:19:20.671022+0000","last_clean":"2023-08-25T05:19:20.671022+0000","last_became_active":"2023-08-25T05:19:19.108896+0000","last_became_peered":"2023-08-25T05:19:19.108896+0000","last_unstale":"2023-08-25T05:19:20.671022+0000","last_undegraded":"2023-08-25T05:19:20.671022+0000","last_fullsized":"2023-08-25T05:19:20.671022+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:53:01.852132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669753+0000","last_change":"2023-08-25T05:19:19.101815+0000","last_active":"2023-08-25T05:19:20.669753+0000","last_peered":"2023-08-25T05:19:20.669753+0000","last_clean":"2023-08-25T05:19:20.669753+0000","last_became_active":"2023-08-25T05:19:19.101418+0000","last_became_peered":"2023-08-25T05:19:19.101418+0000","last_unstale":"2023-08-25T05:19:20.669753+0000","last_undegraded":"2023-08-25T05:19:20.669753+0000","last_fullsized":"2023-08-25T05:19:20.669753+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:02:40.529229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100089+0000","last_change":"2023-08-25T05:19:19.114228+0000","last_active":"2023-08-25T05:19:20.100089+0000","last_peered":"2023-08-25T05:19:20.100089+0000","last_clean":"2023-08-25T05:19:20.100089+0000","last_became_active":"2023-08-25T05:19:19.112823+0000","last_became_peered":"2023-08-25T05:19:19.112823+0000","last_unstale":"2023-08-25T05:19:20.100089+0000","last_undegraded":"2023-08-25T05:19:20.100089+0000","last_fullsized":"2023-08-25T05:19:20.100089+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:55.589906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386836+0000","last_change":"2023-08-25T05:19:19.111385+0000","last_active":"2023-08-25T05:19:20.386836+0000","last_peered":"2023-08-25T05:19:20.386836+0000","last_clean":"2023-08-25T05:19:20.386836+0000","last_became_active":"2023-08-25T05:19:19.111045+0000","last_became_peered":"2023-08-25T05:19:19.111045+0000","last_unstale":"2023-08-25T05:19:20.386836+0000","last_undegraded":"2023-08-25T05:19:20.386836+0000","last_fullsized":"2023-08-25T05:19:20.386836+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:17:09.619856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101958+0000","last_change":"2023-08-25T05:19:19.107378+0000","last_active":"2023-08-25T05:19:20.101958+0000","last_peered":"2023-08-25T05:19:20.101958+0000","last_clean":"2023-08-25T05:19:20.101958+0000","last_became_active":"2023-08-25T05:19:19.106704+0000","last_became_peered":"2023-08-25T05:19:19.106704+0000","last_unstale":"2023-08-25T05:19:20.101958+0000","last_undegraded":"2023-08-25T05:19:20.101958+0000","last_fullsized":"2023-08-25T05:19:20.101958+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:02:41.116429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669789+0000","last_change":"2023-08-25T05:19:19.109734+0000","last_active":"2023-08-25T05:19:20.669789+0000","last_peered":"2023-08-25T05:19:20.669789+0000","last_clean":"2023-08-25T05:19:20.669789+0000","last_became_active":"2023-08-25T05:19:19.109437+0000","last_became_peered":"2023-08-25T05:19:19.109437+0000","last_unstale":"2023-08-25T05:19:20.669789+0000","last_undegraded":"2023-08-25T05:19:20.669789+0000","last_fullsized":"2023-08-25T05:19:20.669789+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:45:41.480896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387260+0000","last_change":"2023-08-25T05:19:19.108235+0000","last_active":"2023-08-25T05:19:20.387260+0000","last_peered":"2023-08-25T05:19:20.387260+0000","last_clean":"2023-08-25T05:19:20.387260+0000","last_became_active":"2023-08-25T05:19:19.107876+0000","last_became_peered":"2023-08-25T05:19:19.107876+0000","last_unstale":"2023-08-25T05:19:20.387260+0000","last_undegraded":"2023-08-25T05:19:20.387260+0000","last_fullsized":"2023-08-25T05:19:20.387260+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:20:41.091758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387186+0000","last_change":"2023-08-25T05:19:19.113934+0000","last_active":"2023-08-25T05:19:20.387186+0000","last_peered":"2023-08-25T05:19:20.387186+0000","last_clean":"2023-08-25T05:19:20.387186+0000","last_became_active":"2023-08-25T05:19:19.113434+0000","last_became_peered":"2023-08-25T05:19:19.113434+0000","last_unstale":"2023-08-25T05:19:20.387186+0000","last_undegraded":"2023-08-25T05:19:20.387186+0000","last_fullsized":"2023-08-25T05:19:20.387186+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:45:10.087683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100452+0000","last_change":"2023-08-25T05:19:19.113088+0000","last_active":"2023-08-25T05:19:20.100452+0000","last_peered":"2023-08-25T05:19:20.100452+0000","last_clean":"2023-08-25T05:19:20.100452+0000","last_became_active":"2023-08-25T05:19:19.112714+0000","last_became_peered":"2023-08-25T05:19:19.112714+0000","last_unstale":"2023-08-25T05:19:20.100452+0000","last_undegraded":"2023-08-25T05:19:20.100452+0000","last_fullsized":"2023-08-25T05:19:20.100452+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:09.499178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670051+0000","last_change":"2023-08-25T05:19:19.106903+0000","last_active":"2023-08-25T05:19:20.670051+0000","last_peered":"2023-08-25T05:19:20.670051+0000","last_clean":"2023-08-25T05:19:20.670051+0000","last_became_active":"2023-08-25T05:19:19.106619+0000","last_became_peered":"2023-08-25T05:19:19.106619+0000","last_unstale":"2023-08-25T05:19:20.670051+0000","last_undegraded":"2023-08-25T05:19:20.670051+0000","last_fullsized":"2023-08-25T05:19:20.670051+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:17:02.980043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102736+0000","last_change":"2023-08-25T05:19:19.115725+0000","last_active":"2023-08-25T05:19:20.102736+0000","last_peered":"2023-08-25T05:19:20.102736+0000","last_clean":"2023-08-25T05:19:20.102736+0000","last_became_active":"2023-08-25T05:19:19.115107+0000","last_became_peered":"2023-08-25T05:19:19.115107+0000","last_unstale":"2023-08-25T05:19:20.102736+0000","last_undegraded":"2023-08-25T05:19:20.102736+0000","last_fullsized":"2023-08-25T05:19:20.102736+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:47:19.466677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669974+0000","last_change":"2023-08-25T05:19:19.091428+0000","last_active":"2023-08-25T05:19:20.669974+0000","last_peered":"2023-08-25T05:19:20.669974+0000","last_clean":"2023-08-25T05:19:20.669974+0000","last_became_active":"2023-08-25T05:19:19.090567+0000","last_became_peered":"2023-08-25T05:19:19.090567+0000","last_unstale":"2023-08-25T05:19:20.669974+0000","last_undegraded":"2023-08-25T05:19:20.669974+0000","last_fullsized":"2023-08-25T05:19:20.669974+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:29:12.750973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.099772+0000","last_change":"2023-08-25T05:19:19.101493+0000","last_active":"2023-08-25T05:19:20.099772+0000","last_peered":"2023-08-25T05:19:20.099772+0000","last_clean":"2023-08-25T05:19:20.099772+0000","last_became_active":"2023-08-25T05:19:19.101085+0000","last_became_peered":"2023-08-25T05:19:19.101085+0000","last_unstale":"2023-08-25T05:19:20.099772+0000","last_undegraded":"2023-08-25T05:19:20.099772+0000","last_fullsized":"2023-08-25T05:19:20.099772+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:39:18.042193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102195+0000","last_change":"2023-08-25T05:19:19.094244+0000","last_active":"2023-08-25T05:19:20.102195+0000","last_peered":"2023-08-25T05:19:20.102195+0000","last_clean":"2023-08-25T05:19:20.102195+0000","last_became_active":"2023-08-25T05:19:19.093926+0000","last_became_peered":"2023-08-25T05:19:19.093926+0000","last_unstale":"2023-08-25T05:19:20.102195+0000","last_undegraded":"2023-08-25T05:19:20.102195+0000","last_fullsized":"2023-08-25T05:19:20.102195+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:09:55.883591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670822+0000","last_change":"2023-08-25T05:19:19.109818+0000","last_active":"2023-08-25T05:19:20.670822+0000","last_peered":"2023-08-25T05:19:20.670822+0000","last_clean":"2023-08-25T05:19:20.670822+0000","last_became_active":"2023-08-25T05:19:19.109520+0000","last_became_peered":"2023-08-25T05:19:19.109520+0000","last_unstale":"2023-08-25T05:19:20.670822+0000","last_undegraded":"2023-08-25T05:19:20.670822+0000","last_fullsized":"2023-08-25T05:19:20.670822+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:12.342980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"169'4","reported_seq":17,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100652+0000","last_change":"2023-08-25T05:19:18.096852+0000","last_active":"2023-08-25T05:19:20.100652+0000","last_peered":"2023-08-25T05:19:20.100652+0000","last_clean":"2023-08-25T05:19:20.100652+0000","last_became_active":"2023-08-25T05:19:18.096586+0000","last_became_peered":"2023-08-25T05:19:18.096586+0000","last_unstale":"2023-08-25T05:19:20.100652+0000","last_undegraded":"2023-08-25T05:19:20.100652+0000","last_fullsized":"2023-08-25T05:19:20.100652+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:10:33.739986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670769+0000","last_change":"2023-08-25T05:19:19.099800+0000","last_active":"2023-08-25T05:19:20.670769+0000","last_peered":"2023-08-25T05:19:20.670769+0000","last_clean":"2023-08-25T05:19:20.670769+0000","last_became_active":"2023-08-25T05:19:19.099476+0000","last_became_peered":"2023-08-25T05:19:19.099476+0000","last_unstale":"2023-08-25T05:19:20.670769+0000","last_undegraded":"2023-08-25T05:19:20.670769+0000","last_fullsized":"2023-08-25T05:19:20.670769+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:09:33.219847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"169'1","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670612+0000","last_change":"2023-08-25T05:19:18.103369+0000","last_active":"2023-08-25T05:19:20.670612+0000","last_peered":"2023-08-25T05:19:20.670612+0000","last_clean":"2023-08-25T05:19:20.670612+0000","last_became_active":"2023-08-25T05:19:18.103067+0000","last_became_peered":"2023-08-25T05:19:18.103067+0000","last_unstale":"2023-08-25T05:19:20.670612+0000","last_undegraded":"2023-08-25T05:19:20.670612+0000","last_fullsized":"2023-08-25T05:19:20.670612+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:24:17.716029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102787+0000","last_change":"2023-08-25T05:19:19.088435+0000","last_active":"2023-08-25T05:19:20.102787+0000","last_peered":"2023-08-25T05:19:20.102787+0000","last_clean":"2023-08-25T05:19:20.102787+0000","last_became_active":"2023-08-25T05:19:19.088107+0000","last_became_peered":"2023-08-25T05:19:19.088107+0000","last_unstale":"2023-08-25T05:19:20.102787+0000","last_undegraded":"2023-08-25T05:19:20.102787+0000","last_fullsized":"2023-08-25T05:19:20.102787+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:20:52.631756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"169'2","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670847+0000","last_change":"2023-08-25T05:19:18.103473+0000","last_active":"2023-08-25T05:19:20.670847+0000","last_peered":"2023-08-25T05:19:20.670847+0000","last_clean":"2023-08-25T05:19:20.670847+0000","last_became_active":"2023-08-25T05:19:18.103177+0000","last_became_peered":"2023-08-25T05:19:18.103177+0000","last_unstale":"2023-08-25T05:19:20.670847+0000","last_undegraded":"2023-08-25T05:19:20.670847+0000","last_fullsized":"2023-08-25T05:19:20.670847+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:23:45.700005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670811+0000","last_change":"2023-08-25T05:19:19.110072+0000","last_active":"2023-08-25T05:19:20.670811+0000","last_peered":"2023-08-25T05:19:20.670811+0000","last_clean":"2023-08-25T05:19:20.670811+0000","last_became_active":"2023-08-25T05:19:19.109776+0000","last_became_peered":"2023-08-25T05:19:19.109776+0000","last_unstale":"2023-08-25T05:19:20.670811+0000","last_undegraded":"2023-08-25T05:19:20.670811+0000","last_fullsized":"2023-08-25T05:19:20.670811+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:31:17.527448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"169'2","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670688+0000","last_change":"2023-08-25T05:19:18.091924+0000","last_active":"2023-08-25T05:19:20.670688+0000","last_peered":"2023-08-25T05:19:20.670688+0000","last_clean":"2023-08-25T05:19:20.670688+0000","last_became_active":"2023-08-25T05:19:18.091634+0000","last_became_peered":"2023-08-25T05:19:18.091634+0000","last_unstale":"2023-08-25T05:19:20.670688+0000","last_undegraded":"2023-08-25T05:19:20.670688+0000","last_fullsized":"2023-08-25T05:19:20.670688+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:12.984060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669406+0000","last_change":"2023-08-25T05:19:19.116242+0000","last_active":"2023-08-25T05:19:20.669406+0000","last_peered":"2023-08-25T05:19:20.669406+0000","last_clean":"2023-08-25T05:19:20.669406+0000","last_became_active":"2023-08-25T05:19:19.114880+0000","last_became_peered":"2023-08-25T05:19:19.114880+0000","last_unstale":"2023-08-25T05:19:20.669406+0000","last_undegraded":"2023-08-25T05:19:20.669406+0000","last_fullsized":"2023-08-25T05:19:20.669406+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:28.182090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"169'1","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102829+0000","last_change":"2023-08-25T05:19:18.091169+0000","last_active":"2023-08-25T05:19:20.102829+0000","last_peered":"2023-08-25T05:19:20.102829+0000","last_clean":"2023-08-25T05:19:20.102829+0000","last_became_active":"2023-08-25T05:19:18.090883+0000","last_became_peered":"2023-08-25T05:19:18.090883+0000","last_unstale":"2023-08-25T05:19:20.102829+0000","last_undegraded":"2023-08-25T05:19:20.102829+0000","last_fullsized":"2023-08-25T05:19:20.102829+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:42:56.038398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101698+0000","last_change":"2023-08-25T05:19:19.103477+0000","last_active":"2023-08-25T05:19:20.101698+0000","last_peered":"2023-08-25T05:19:20.101698+0000","last_clean":"2023-08-25T05:19:20.101698+0000","last_became_active":"2023-08-25T05:19:19.103091+0000","last_became_peered":"2023-08-25T05:19:19.103091+0000","last_unstale":"2023-08-25T05:19:20.101698+0000","last_undegraded":"2023-08-25T05:19:20.101698+0000","last_fullsized":"2023-08-25T05:19:20.101698+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:01:06.559858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"169'1","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100129+0000","last_change":"2023-08-25T05:19:18.095404+0000","last_active":"2023-08-25T05:19:20.100129+0000","last_peered":"2023-08-25T05:19:20.100129+0000","last_clean":"2023-08-25T05:19:20.100129+0000","last_became_active":"2023-08-25T05:19:18.095131+0000","last_became_peered":"2023-08-25T05:19:18.095131+0000","last_unstale":"2023-08-25T05:19:20.100129+0000","last_undegraded":"2023-08-25T05:19:20.100129+0000","last_fullsized":"2023-08-25T05:19:20.100129+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:25:28.110408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670533+0000","last_change":"2023-08-25T05:19:19.104380+0000","last_active":"2023-08-25T05:19:20.670533+0000","last_peered":"2023-08-25T05:19:20.670533+0000","last_clean":"2023-08-25T05:19:20.670533+0000","last_became_active":"2023-08-25T05:19:19.104058+0000","last_became_peered":"2023-08-25T05:19:19.104058+0000","last_unstale":"2023-08-25T05:19:20.670533+0000","last_undegraded":"2023-08-25T05:19:20.670533+0000","last_fullsized":"2023-08-25T05:19:20.670533+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:07:07.905137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386872+0000","last_change":"2023-08-25T05:19:18.100455+0000","last_active":"2023-08-25T05:19:20.386872+0000","last_peered":"2023-08-25T05:19:20.386872+0000","last_clean":"2023-08-25T05:19:20.386872+0000","last_became_active":"2023-08-25T05:19:18.100020+0000","last_became_peered":"2023-08-25T05:19:18.100020+0000","last_unstale":"2023-08-25T05:19:20.386872+0000","last_undegraded":"2023-08-25T05:19:20.386872+0000","last_fullsized":"2023-08-25T05:19:20.386872+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:30:30.194970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386825+0000","last_change":"2023-08-25T05:19:19.104588+0000","last_active":"2023-08-25T05:19:20.386825+0000","last_peered":"2023-08-25T05:19:20.386825+0000","last_clean":"2023-08-25T05:19:20.386825+0000","last_became_active":"2023-08-25T05:19:19.104190+0000","last_became_peered":"2023-08-25T05:19:19.104190+0000","last_unstale":"2023-08-25T05:19:20.386825+0000","last_undegraded":"2023-08-25T05:19:20.386825+0000","last_fullsized":"2023-08-25T05:19:20.386825+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:34.804176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.099794+0000","last_change":"2023-08-25T05:19:18.099984+0000","last_active":"2023-08-25T05:19:20.099794+0000","last_peered":"2023-08-25T05:19:20.099794+0000","last_clean":"2023-08-25T05:19:20.099794+0000","last_became_active":"2023-08-25T05:19:18.099639+0000","last_became_peered":"2023-08-25T05:19:18.099639+0000","last_unstale":"2023-08-25T05:19:20.099794+0000","last_undegraded":"2023-08-25T05:19:20.099794+0000","last_fullsized":"2023-08-25T05:19:20.099794+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:43.410039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670547+0000","last_change":"2023-08-25T05:19:19.114870+0000","last_active":"2023-08-25T05:19:20.670547+0000","last_peered":"2023-08-25T05:19:20.670547+0000","last_clean":"2023-08-25T05:19:20.670547+0000","last_became_active":"2023-08-25T05:19:19.114345+0000","last_became_peered":"2023-08-25T05:19:19.114345+0000","last_unstale":"2023-08-25T05:19:20.670547+0000","last_undegraded":"2023-08-25T05:19:20.670547+0000","last_fullsized":"2023-08-25T05:19:20.670547+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:26:19.530079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"169'1","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670084+0000","last_change":"2023-08-25T05:19:18.096880+0000","last_active":"2023-08-25T05:19:20.670084+0000","last_peered":"2023-08-25T05:19:20.670084+0000","last_clean":"2023-08-25T05:19:20.670084+0000","last_became_active":"2023-08-25T05:19:18.096570+0000","last_became_peered":"2023-08-25T05:19:18.096570+0000","last_unstale":"2023-08-25T05:19:20.670084+0000","last_undegraded":"2023-08-25T05:19:20.670084+0000","last_fullsized":"2023-08-25T05:19:20.670084+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:38:43.808966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670858+0000","last_change":"2023-08-25T05:19:19.100758+0000","last_active":"2023-08-25T05:19:20.670858+0000","last_peered":"2023-08-25T05:19:20.670858+0000","last_clean":"2023-08-25T05:19:20.670858+0000","last_became_active":"2023-08-25T05:19:19.100420+0000","last_became_peered":"2023-08-25T05:19:19.100420+0000","last_unstale":"2023-08-25T05:19:20.670858+0000","last_undegraded":"2023-08-25T05:19:20.670858+0000","last_fullsized":"2023-08-25T05:19:20.670858+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:09:39.333299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"169'2","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670653+0000","last_change":"2023-08-25T05:19:18.100557+0000","last_active":"2023-08-25T05:19:20.670653+0000","last_peered":"2023-08-25T05:19:20.670653+0000","last_clean":"2023-08-25T05:19:20.670653+0000","last_became_active":"2023-08-25T05:19:18.100282+0000","last_became_peered":"2023-08-25T05:19:18.100282+0000","last_unstale":"2023-08-25T05:19:20.670653+0000","last_undegraded":"2023-08-25T05:19:20.670653+0000","last_fullsized":"2023-08-25T05:19:20.670653+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:20:03.474378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387190+0000","last_change":"2023-08-25T05:19:19.106251+0000","last_active":"2023-08-25T05:19:20.387190+0000","last_peered":"2023-08-25T05:19:20.387190+0000","last_clean":"2023-08-25T05:19:20.387190+0000","last_became_active":"2023-08-25T05:19:19.105964+0000","last_became_peered":"2023-08-25T05:19:19.105964+0000","last_unstale":"2023-08-25T05:19:20.387190+0000","last_undegraded":"2023-08-25T05:19:20.387190+0000","last_fullsized":"2023-08-25T05:19:20.387190+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:14:57.389520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"169'1","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670844+0000","last_change":"2023-08-25T05:19:18.093116+0000","last_active":"2023-08-25T05:19:20.670844+0000","last_peered":"2023-08-25T05:19:20.670844+0000","last_clean":"2023-08-25T05:19:20.670844+0000","last_became_active":"2023-08-25T05:19:18.092653+0000","last_became_peered":"2023-08-25T05:19:18.092653+0000","last_unstale":"2023-08-25T05:19:20.670844+0000","last_undegraded":"2023-08-25T05:19:20.670844+0000","last_fullsized":"2023-08-25T05:19:20.670844+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:05.472719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387368+0000","last_change":"2023-08-25T05:19:19.105286+0000","last_active":"2023-08-25T05:19:20.387368+0000","last_peered":"2023-08-25T05:19:20.387368+0000","last_clean":"2023-08-25T05:19:20.387368+0000","last_became_active":"2023-08-25T05:19:19.104634+0000","last_became_peered":"2023-08-25T05:19:19.104634+0000","last_unstale":"2023-08-25T05:19:20.387368+0000","last_undegraded":"2023-08-25T05:19:20.387368+0000","last_fullsized":"2023-08-25T05:19:20.387368+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:47:08.696601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102178+0000","last_change":"2023-08-25T05:19:18.094164+0000","last_active":"2023-08-25T05:19:20.102178+0000","last_peered":"2023-08-25T05:19:20.102178+0000","last_clean":"2023-08-25T05:19:20.102178+0000","last_became_active":"2023-08-25T05:19:18.093896+0000","last_became_peered":"2023-08-25T05:19:18.093896+0000","last_unstale":"2023-08-25T05:19:20.102178+0000","last_undegraded":"2023-08-25T05:19:20.102178+0000","last_fullsized":"2023-08-25T05:19:20.102178+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:05:08.912305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670476+0000","last_change":"2023-08-25T05:19:19.100598+0000","last_active":"2023-08-25T05:19:20.670476+0000","last_peered":"2023-08-25T05:19:20.670476+0000","last_clean":"2023-08-25T05:19:20.670476+0000","last_became_active":"2023-08-25T05:19:19.100286+0000","last_became_peered":"2023-08-25T05:19:19.100286+0000","last_unstale":"2023-08-25T05:19:20.670476+0000","last_undegraded":"2023-08-25T05:19:20.670476+0000","last_fullsized":"2023-08-25T05:19:20.670476+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:25.142761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"169'2","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669623+0000","last_change":"2023-08-25T05:19:18.095970+0000","last_active":"2023-08-25T05:19:20.669623+0000","last_peered":"2023-08-25T05:19:20.669623+0000","last_clean":"2023-08-25T05:19:20.669623+0000","last_became_active":"2023-08-25T05:19:18.095674+0000","last_became_peered":"2023-08-25T05:19:18.095674+0000","last_unstale":"2023-08-25T05:19:20.669623+0000","last_undegraded":"2023-08-25T05:19:20.669623+0000","last_fullsized":"2023-08-25T05:19:20.669623+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:24:15.408544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670727+0000","last_change":"2023-08-25T05:19:19.108226+0000","last_active":"2023-08-25T05:19:20.670727+0000","last_peered":"2023-08-25T05:19:20.670727+0000","last_clean":"2023-08-25T05:19:20.670727+0000","last_became_active":"2023-08-25T05:19:19.107952+0000","last_became_peered":"2023-08-25T05:19:19.107952+0000","last_unstale":"2023-08-25T05:19:20.670727+0000","last_undegraded":"2023-08-25T05:19:20.670727+0000","last_fullsized":"2023-08-25T05:19:20.670727+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:02:58.784477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102713+0000","last_change":"2023-08-25T05:19:18.085032+0000","last_active":"2023-08-25T05:19:20.102713+0000","last_peered":"2023-08-25T05:19:20.102713+0000","last_clean":"2023-08-25T05:19:20.102713+0000","last_became_active":"2023-08-25T05:19:18.084389+0000","last_became_peered":"2023-08-25T05:19:18.084389+0000","last_unstale":"2023-08-25T05:19:20.102713+0000","last_undegraded":"2023-08-25T05:19:20.102713+0000","last_fullsized":"2023-08-25T05:19:20.102713+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:10:06.746194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670403+0000","last_change":"2023-08-25T05:19:19.097860+0000","last_active":"2023-08-25T05:19:20.670403+0000","last_peered":"2023-08-25T05:19:20.670403+0000","last_clean":"2023-08-25T05:19:20.670403+0000","last_became_active":"2023-08-25T05:19:19.097569+0000","last_became_peered":"2023-08-25T05:19:19.097569+0000","last_unstale":"2023-08-25T05:19:20.670403+0000","last_undegraded":"2023-08-25T05:19:20.670403+0000","last_fullsized":"2023-08-25T05:19:20.670403+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:59:29.544988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669318+0000","last_change":"2023-08-25T05:19:18.095969+0000","last_active":"2023-08-25T05:19:20.669318+0000","last_peered":"2023-08-25T05:19:20.669318+0000","last_clean":"2023-08-25T05:19:20.669318+0000","last_became_active":"2023-08-25T05:19:18.095659+0000","last_became_peered":"2023-08-25T05:19:18.095659+0000","last_unstale":"2023-08-25T05:19:20.669318+0000","last_undegraded":"2023-08-25T05:19:20.669318+0000","last_fullsized":"2023-08-25T05:19:20.669318+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:10:13.656262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.671026+0000","last_change":"2023-08-25T05:19:19.097622+0000","last_active":"2023-08-25T05:19:20.671026+0000","last_peered":"2023-08-25T05:19:20.671026+0000","last_clean":"2023-08-25T05:19:20.671026+0000","last_became_active":"2023-08-25T05:19:19.097309+0000","last_became_peered":"2023-08-25T05:19:19.097309+0000","last_unstale":"2023-08-25T05:19:20.671026+0000","last_undegraded":"2023-08-25T05:19:20.671026+0000","last_fullsized":"2023-08-25T05:19:20.671026+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:32:40.698453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102541+0000","last_change":"2023-08-25T05:19:18.097856+0000","last_active":"2023-08-25T05:19:20.102541+0000","last_peered":"2023-08-25T05:19:20.102541+0000","last_clean":"2023-08-25T05:19:20.102541+0000","last_became_active":"2023-08-25T05:19:18.097185+0000","last_became_peered":"2023-08-25T05:19:18.097185+0000","last_unstale":"2023-08-25T05:19:20.102541+0000","last_undegraded":"2023-08-25T05:19:20.102541+0000","last_fullsized":"2023-08-25T05:19:20.102541+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:46:31.312925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100822+0000","last_change":"2023-08-25T05:19:19.108821+0000","last_active":"2023-08-25T05:19:20.100822+0000","last_peered":"2023-08-25T05:19:20.100822+0000","last_clean":"2023-08-25T05:19:20.100822+0000","last_became_active":"2023-08-25T05:19:19.108491+0000","last_became_peered":"2023-08-25T05:19:19.108491+0000","last_unstale":"2023-08-25T05:19:20.100822+0000","last_undegraded":"2023-08-25T05:19:20.100822+0000","last_fullsized":"2023-08-25T05:19:20.100822+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:32:30.407510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"169'2","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102445+0000","last_change":"2023-08-25T05:19:18.095293+0000","last_active":"2023-08-25T05:19:20.102445+0000","last_peered":"2023-08-25T05:19:20.102445+0000","last_clean":"2023-08-25T05:19:20.102445+0000","last_became_active":"2023-08-25T05:19:18.094917+0000","last_became_peered":"2023-08-25T05:19:18.094917+0000","last_unstale":"2023-08-25T05:19:20.102445+0000","last_undegraded":"2023-08-25T05:19:20.102445+0000","last_fullsized":"2023-08-25T05:19:20.102445+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:59.213187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101995+0000","last_change":"2023-08-25T05:19:19.104831+0000","last_active":"2023-08-25T05:19:20.101995+0000","last_peered":"2023-08-25T05:19:20.101995+0000","last_clean":"2023-08-25T05:19:20.101995+0000","last_became_active":"2023-08-25T05:19:19.104547+0000","last_became_peered":"2023-08-25T05:19:19.104547+0000","last_unstale":"2023-08-25T05:19:20.101995+0000","last_undegraded":"2023-08-25T05:19:20.101995+0000","last_fullsized":"2023-08-25T05:19:20.101995+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:10:49.389866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387262+0000","last_change":"2023-08-25T05:19:18.101512+0000","last_active":"2023-08-25T05:19:20.387262+0000","last_peered":"2023-08-25T05:19:20.387262+0000","last_clean":"2023-08-25T05:19:20.387262+0000","last_became_active":"2023-08-25T05:19:18.100932+0000","last_became_peered":"2023-08-25T05:19:18.100932+0000","last_unstale":"2023-08-25T05:19:20.387262+0000","last_undegraded":"2023-08-25T05:19:20.387262+0000","last_fullsized":"2023-08-25T05:19:20.387262+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:36:54.617809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387333+0000","last_change":"2023-08-25T05:19:19.106309+0000","last_active":"2023-08-25T05:19:20.387333+0000","last_peered":"2023-08-25T05:19:20.387333+0000","last_clean":"2023-08-25T05:19:20.387333+0000","last_became_active":"2023-08-25T05:19:19.105633+0000","last_became_peered":"2023-08-25T05:19:19.105633+0000","last_unstale":"2023-08-25T05:19:20.387333+0000","last_undegraded":"2023-08-25T05:19:20.387333+0000","last_fullsized":"2023-08-25T05:19:20.387333+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:42:35.210980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670971+0000","last_change":"2023-08-25T05:19:18.092916+0000","last_active":"2023-08-25T05:19:20.670971+0000","last_peered":"2023-08-25T05:19:20.670971+0000","last_clean":"2023-08-25T05:19:20.670971+0000","last_became_active":"2023-08-25T05:19:18.092251+0000","last_became_peered":"2023-08-25T05:19:18.092251+0000","last_unstale":"2023-08-25T05:19:20.670971+0000","last_undegraded":"2023-08-25T05:19:20.670971+0000","last_fullsized":"2023-08-25T05:19:20.670971+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:06:49.660235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100648+0000","last_change":"2023-08-25T05:19:19.101644+0000","last_active":"2023-08-25T05:19:20.100648+0000","last_peered":"2023-08-25T05:19:20.100648+0000","last_clean":"2023-08-25T05:19:20.100648+0000","last_became_active":"2023-08-25T05:19:19.101339+0000","last_became_peered":"2023-08-25T05:19:19.101339+0000","last_unstale":"2023-08-25T05:19:20.100648+0000","last_undegraded":"2023-08-25T05:19:20.100648+0000","last_fullsized":"2023-08-25T05:19:20.100648+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:30:26.456155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100558+0000","last_change":"2023-08-25T05:19:18.093466+0000","last_active":"2023-08-25T05:19:20.100558+0000","last_peered":"2023-08-25T05:19:20.100558+0000","last_clean":"2023-08-25T05:19:20.100558+0000","last_became_active":"2023-08-25T05:19:18.093177+0000","last_became_peered":"2023-08-25T05:19:18.093177+0000","last_unstale":"2023-08-25T05:19:20.100558+0000","last_undegraded":"2023-08-25T05:19:20.100558+0000","last_fullsized":"2023-08-25T05:19:20.100558+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:42:18.077337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102354+0000","last_change":"2023-08-25T05:19:19.104021+0000","last_active":"2023-08-25T05:19:20.102354+0000","last_peered":"2023-08-25T05:19:20.102354+0000","last_clean":"2023-08-25T05:19:20.102354+0000","last_became_active":"2023-08-25T05:19:19.103708+0000","last_became_peered":"2023-08-25T05:19:19.103708+0000","last_unstale":"2023-08-25T05:19:20.102354+0000","last_undegraded":"2023-08-25T05:19:20.102354+0000","last_fullsized":"2023-08-25T05:19:20.102354+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:40:08.903268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386949+0000","last_change":"2023-08-25T05:19:18.100268+0000","last_active":"2023-08-25T05:19:20.386949+0000","last_peered":"2023-08-25T05:19:20.386949+0000","last_clean":"2023-08-25T05:19:20.386949+0000","last_became_active":"2023-08-25T05:19:18.099889+0000","last_became_peered":"2023-08-25T05:19:18.099889+0000","last_unstale":"2023-08-25T05:19:20.386949+0000","last_undegraded":"2023-08-25T05:19:20.386949+0000","last_fullsized":"2023-08-25T05:19:20.386949+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:29:35.762327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101763+0000","last_change":"2023-08-25T05:19:19.104177+0000","last_active":"2023-08-25T05:19:20.101763+0000","last_peered":"2023-08-25T05:19:20.101763+0000","last_clean":"2023-08-25T05:19:20.101763+0000","last_became_active":"2023-08-25T05:19:19.103862+0000","last_became_peered":"2023-08-25T05:19:19.103862+0000","last_unstale":"2023-08-25T05:19:20.101763+0000","last_undegraded":"2023-08-25T05:19:20.101763+0000","last_fullsized":"2023-08-25T05:19:20.101763+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:16:56.937872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670073+0000","last_change":"2023-08-25T05:19:18.103122+0000","last_active":"2023-08-25T05:19:20.670073+0000","last_peered":"2023-08-25T05:19:20.670073+0000","last_clean":"2023-08-25T05:19:20.670073+0000","last_became_active":"2023-08-25T05:19:18.102803+0000","last_became_peered":"2023-08-25T05:19:18.102803+0000","last_unstale":"2023-08-25T05:19:20.670073+0000","last_undegraded":"2023-08-25T05:19:20.670073+0000","last_fullsized":"2023-08-25T05:19:20.670073+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:50.153960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670536+0000","last_change":"2023-08-25T05:19:19.099519+0000","last_active":"2023-08-25T05:19:20.670536+0000","last_peered":"2023-08-25T05:19:20.670536+0000","last_clean":"2023-08-25T05:19:20.670536+0000","last_became_active":"2023-08-25T05:19:19.099205+0000","last_became_peered":"2023-08-25T05:19:19.099205+0000","last_unstale":"2023-08-25T05:19:20.670536+0000","last_undegraded":"2023-08-25T05:19:20.670536+0000","last_fullsized":"2023-08-25T05:19:20.670536+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:55:24.322604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386935+0000","last_change":"2023-08-25T05:19:18.100661+0000","last_active":"2023-08-25T05:19:20.386935+0000","last_peered":"2023-08-25T05:19:20.386935+0000","last_clean":"2023-08-25T05:19:20.386935+0000","last_became_active":"2023-08-25T05:19:18.100392+0000","last_became_peered":"2023-08-25T05:19:18.100392+0000","last_unstale":"2023-08-25T05:19:20.386935+0000","last_undegraded":"2023-08-25T05:19:20.386935+0000","last_fullsized":"2023-08-25T05:19:20.386935+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:11:31.150609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102574+0000","last_change":"2023-08-25T05:19:19.116107+0000","last_active":"2023-08-25T05:19:20.102574+0000","last_peered":"2023-08-25T05:19:20.102574+0000","last_clean":"2023-08-25T05:19:20.102574+0000","last_became_active":"2023-08-25T05:19:19.115467+0000","last_became_peered":"2023-08-25T05:19:19.115467+0000","last_unstale":"2023-08-25T05:19:20.102574+0000","last_undegraded":"2023-08-25T05:19:20.102574+0000","last_fullsized":"2023-08-25T05:19:20.102574+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:02:00.326701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670600+0000","last_change":"2023-08-25T05:19:18.098107+0000","last_active":"2023-08-25T05:19:20.670600+0000","last_peered":"2023-08-25T05:19:20.670600+0000","last_clean":"2023-08-25T05:19:20.670600+0000","last_became_active":"2023-08-25T05:19:18.096554+0000","last_became_peered":"2023-08-25T05:19:18.096554+0000","last_unstale":"2023-08-25T05:19:20.670600+0000","last_undegraded":"2023-08-25T05:19:20.670600+0000","last_fullsized":"2023-08-25T05:19:20.670600+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:32:51.417009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.103100+0000","last_change":"2023-08-25T05:19:19.100511+0000","last_active":"2023-08-25T05:19:20.103100+0000","last_peered":"2023-08-25T05:19:20.103100+0000","last_clean":"2023-08-25T05:19:20.103100+0000","last_became_active":"2023-08-25T05:19:19.100224+0000","last_became_peered":"2023-08-25T05:19:19.100224+0000","last_unstale":"2023-08-25T05:19:20.103100+0000","last_undegraded":"2023-08-25T05:19:20.103100+0000","last_fullsized":"2023-08-25T05:19:20.103100+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:08:47.094804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"169'6","reported_seq":19,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669575+0000","last_change":"2023-08-25T05:19:18.097720+0000","last_active":"2023-08-25T05:19:20.669575+0000","last_peered":"2023-08-25T05:19:20.669575+0000","last_clean":"2023-08-25T05:19:20.669575+0000","last_became_active":"2023-08-25T05:19:18.097437+0000","last_became_peered":"2023-08-25T05:19:18.097437+0000","last_unstale":"2023-08-25T05:19:20.669575+0000","last_undegraded":"2023-08-25T05:19:20.669575+0000","last_fullsized":"2023-08-25T05:19:20.669575+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:27:10.667868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"159'3598","reported_seq":4395,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670815+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:19:20.670815+0000","last_peered":"2023-08-25T05:19:20.670815+0000","last_clean":"2023-08-25T05:19:20.670815+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:19:20.670815+0000","last_undegraded":"2023-08-25T05:19:20.670815+0000","last_fullsized":"2023-08-25T05:19:20.670815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3598,"log_dups_size":0,"ondisk_log_size":3598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:39:34.018928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1616,"num_read_kb":3373,"num_write":465,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":297,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387034+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:19:20.387034+0000","last_peered":"2023-08-25T05:19:20.387034+0000","last_clean":"2023-08-25T05:19:20.387034+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:19:20.387034+0000","last_undegraded":"2023-08-25T05:19:20.387034+0000","last_fullsized":"2023-08-25T05:19:20.387034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:57:41.321145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.103027+0000","last_change":"2023-08-25T05:19:19.099971+0000","last_active":"2023-08-25T05:19:20.103027+0000","last_peered":"2023-08-25T05:19:20.103027+0000","last_clean":"2023-08-25T05:19:20.103027+0000","last_became_active":"2023-08-25T05:19:19.099675+0000","last_became_peered":"2023-08-25T05:19:19.099675+0000","last_unstale":"2023-08-25T05:19:20.103027+0000","last_undegraded":"2023-08-25T05:19:20.103027+0000","last_fullsized":"2023-08-25T05:19:20.103027+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:01:06.559858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670874+0000","last_change":"2023-08-25T05:19:18.101899+0000","last_active":"2023-08-25T05:19:20.670874+0000","last_peered":"2023-08-25T05:19:20.670874+0000","last_clean":"2023-08-25T05:19:20.670874+0000","last_became_active":"2023-08-25T05:19:18.101630+0000","last_became_peered":"2023-08-25T05:19:18.101630+0000","last_unstale":"2023-08-25T05:19:20.670874+0000","last_undegraded":"2023-08-25T05:19:20.670874+0000","last_fullsized":"2023-08-25T05:19:20.670874+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:00.294806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":294,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670641+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:19:20.670641+0000","last_peered":"2023-08-25T05:19:20.670641+0000","last_clean":"2023-08-25T05:19:20.670641+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:19:20.670641+0000","last_undegraded":"2023-08-25T05:19:20.670641+0000","last_fullsized":"2023-08-25T05:19:20.670641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:21:16.671755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669776+0000","last_change":"2023-08-25T05:19:19.100942+0000","last_active":"2023-08-25T05:19:20.669776+0000","last_peered":"2023-08-25T05:19:20.669776+0000","last_clean":"2023-08-25T05:19:20.669776+0000","last_became_active":"2023-08-25T05:19:19.100643+0000","last_became_peered":"2023-08-25T05:19:19.100643+0000","last_unstale":"2023-08-25T05:19:20.669776+0000","last_undegraded":"2023-08-25T05:19:20.669776+0000","last_fullsized":"2023-08-25T05:19:20.669776+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:03:30.222315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387360+0000","last_change":"2023-08-25T05:19:18.101699+0000","last_active":"2023-08-25T05:19:20.387360+0000","last_peered":"2023-08-25T05:19:20.387360+0000","last_clean":"2023-08-25T05:19:20.387360+0000","last_became_active":"2023-08-25T05:19:18.101250+0000","last_became_peered":"2023-08-25T05:19:18.101250+0000","last_unstale":"2023-08-25T05:19:20.387360+0000","last_undegraded":"2023-08-25T05:19:20.387360+0000","last_fullsized":"2023-08-25T05:19:20.387360+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:15:02.972695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":301,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669659+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:19:20.669659+0000","last_peered":"2023-08-25T05:19:20.669659+0000","last_clean":"2023-08-25T05:19:20.669659+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:19:20.669659+0000","last_undegraded":"2023-08-25T05:19:20.669659+0000","last_fullsized":"2023-08-25T05:19:20.669659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:28:55.023977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669978+0000","last_change":"2023-08-25T05:19:19.106477+0000","last_active":"2023-08-25T05:19:20.669978+0000","last_peered":"2023-08-25T05:19:20.669978+0000","last_clean":"2023-08-25T05:19:20.669978+0000","last_became_active":"2023-08-25T05:19:19.105841+0000","last_became_peered":"2023-08-25T05:19:19.105841+0000","last_unstale":"2023-08-25T05:19:20.669978+0000","last_undegraded":"2023-08-25T05:19:20.669978+0000","last_fullsized":"2023-08-25T05:19:20.669978+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:26:48.556516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"169'3","reported_seq":16,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669891+0000","last_change":"2023-08-25T05:19:18.096878+0000","last_active":"2023-08-25T05:19:20.669891+0000","last_peered":"2023-08-25T05:19:20.669891+0000","last_clean":"2023-08-25T05:19:20.669891+0000","last_became_active":"2023-08-25T05:19:18.096598+0000","last_became_peered":"2023-08-25T05:19:18.096598+0000","last_unstale":"2023-08-25T05:19:20.669891+0000","last_undegraded":"2023-08-25T05:19:20.669891+0000","last_fullsized":"2023-08-25T05:19:20.669891+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:14:03.569363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":297,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386771+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:19:20.386771+0000","last_peered":"2023-08-25T05:19:20.386771+0000","last_clean":"2023-08-25T05:19:20.386771+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:19:20.386771+0000","last_undegraded":"2023-08-25T05:19:20.386771+0000","last_fullsized":"2023-08-25T05:19:20.386771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:28:51.230788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102292+0000","last_change":"2023-08-25T05:19:19.101369+0000","last_active":"2023-08-25T05:19:20.102292+0000","last_peered":"2023-08-25T05:19:20.102292+0000","last_clean":"2023-08-25T05:19:20.102292+0000","last_became_active":"2023-08-25T05:19:19.101088+0000","last_became_peered":"2023-08-25T05:19:19.101088+0000","last_unstale":"2023-08-25T05:19:20.102292+0000","last_undegraded":"2023-08-25T05:19:20.102292+0000","last_fullsized":"2023-08-25T05:19:20.102292+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:25:10.949007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"169'2","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100387+0000","last_change":"2023-08-25T05:19:18.093716+0000","last_active":"2023-08-25T05:19:20.100387+0000","last_peered":"2023-08-25T05:19:20.100387+0000","last_clean":"2023-08-25T05:19:20.100387+0000","last_became_active":"2023-08-25T05:19:18.093405+0000","last_became_peered":"2023-08-25T05:19:18.093405+0000","last_unstale":"2023-08-25T05:19:20.100387+0000","last_undegraded":"2023-08-25T05:19:20.100387+0000","last_fullsized":"2023-08-25T05:19:20.100387+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:31:11.585564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":321,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670917+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:19:20.670917+0000","last_peered":"2023-08-25T05:19:20.670917+0000","last_clean":"2023-08-25T05:19:20.670917+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:19:20.670917+0000","last_undegraded":"2023-08-25T05:19:20.670917+0000","last_fullsized":"2023-08-25T05:19:20.670917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:59:33.954297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670543+0000","last_change":"2023-08-25T05:19:19.101066+0000","last_active":"2023-08-25T05:19:20.670543+0000","last_peered":"2023-08-25T05:19:20.670543+0000","last_clean":"2023-08-25T05:19:20.670543+0000","last_became_active":"2023-08-25T05:19:19.100413+0000","last_became_peered":"2023-08-25T05:19:19.100413+0000","last_unstale":"2023-08-25T05:19:20.670543+0000","last_undegraded":"2023-08-25T05:19:20.670543+0000","last_fullsized":"2023-08-25T05:19:20.670543+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:51:57.187189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101945+0000","last_change":"2023-08-25T05:19:18.095988+0000","last_active":"2023-08-25T05:19:20.101945+0000","last_peered":"2023-08-25T05:19:20.101945+0000","last_clean":"2023-08-25T05:19:20.101945+0000","last_became_active":"2023-08-25T05:19:18.095703+0000","last_became_peered":"2023-08-25T05:19:18.095703+0000","last_unstale":"2023-08-25T05:19:20.101945+0000","last_undegraded":"2023-08-25T05:19:20.101945+0000","last_fullsized":"2023-08-25T05:19:20.101945+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:00:07.720641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":293,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670981+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:19:20.670981+0000","last_peered":"2023-08-25T05:19:20.670981+0000","last_clean":"2023-08-25T05:19:20.670981+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:19:20.670981+0000","last_undegraded":"2023-08-25T05:19:20.670981+0000","last_fullsized":"2023-08-25T05:19:20.670981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:08:17.333118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.099924+0000","last_change":"2023-08-25T05:19:19.102358+0000","last_active":"2023-08-25T05:19:20.099924+0000","last_peered":"2023-08-25T05:19:20.099924+0000","last_clean":"2023-08-25T05:19:20.099924+0000","last_became_active":"2023-08-25T05:19:19.102056+0000","last_became_peered":"2023-08-25T05:19:19.102056+0000","last_unstale":"2023-08-25T05:19:20.099924+0000","last_undegraded":"2023-08-25T05:19:20.099924+0000","last_fullsized":"2023-08-25T05:19:20.099924+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:52:53.748952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101790+0000","last_change":"2023-08-25T05:19:18.094251+0000","last_active":"2023-08-25T05:19:20.101790+0000","last_peered":"2023-08-25T05:19:20.101790+0000","last_clean":"2023-08-25T05:19:20.101790+0000","last_became_active":"2023-08-25T05:19:18.093738+0000","last_became_peered":"2023-08-25T05:19:18.093738+0000","last_unstale":"2023-08-25T05:19:20.101790+0000","last_undegraded":"2023-08-25T05:19:20.101790+0000","last_fullsized":"2023-08-25T05:19:20.101790+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:17.035462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":320,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670955+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:19:20.670955+0000","last_peered":"2023-08-25T05:19:20.670955+0000","last_clean":"2023-08-25T05:19:20.670955+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:19:20.670955+0000","last_undegraded":"2023-08-25T05:19:20.670955+0000","last_fullsized":"2023-08-25T05:19:20.670955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:48:10.515420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670901+0000","last_change":"2023-08-25T05:19:19.110969+0000","last_active":"2023-08-25T05:19:20.670901+0000","last_peered":"2023-08-25T05:19:20.670901+0000","last_clean":"2023-08-25T05:19:20.670901+0000","last_became_active":"2023-08-25T05:19:19.110658+0000","last_became_peered":"2023-08-25T05:19:19.110658+0000","last_unstale":"2023-08-25T05:19:20.670901+0000","last_undegraded":"2023-08-25T05:19:20.670901+0000","last_fullsized":"2023-08-25T05:19:20.670901+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:18:12.887154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"169'8","reported_seq":21,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386584+0000","last_change":"2023-08-25T05:19:18.103067+0000","last_active":"2023-08-25T05:19:20.386584+0000","last_peered":"2023-08-25T05:19:20.386584+0000","last_clean":"2023-08-25T05:19:20.386584+0000","last_became_active":"2023-08-25T05:19:18.102725+0000","last_became_peered":"2023-08-25T05:19:18.102725+0000","last_unstale":"2023-08-25T05:19:20.386584+0000","last_undegraded":"2023-08-25T05:19:20.386584+0000","last_fullsized":"2023-08-25T05:19:20.386584+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:24.864465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":340,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102822+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:19:20.102822+0000","last_peered":"2023-08-25T05:19:20.102822+0000","last_clean":"2023-08-25T05:19:20.102822+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:19:20.102822+0000","last_undegraded":"2023-08-25T05:19:20.102822+0000","last_fullsized":"2023-08-25T05:19:20.102822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:15:58.285824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1616,"num_read_kb":3373,"num_write":465,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3598,"ondisk_log_size":3598,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510355,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51876,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319964,"statfs":{"total":96636764160,"available":96583643136,"internally_reserved":0,"allocated":2711552,"data_stored":1657225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.51000000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89000000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.47799999999999998,"15min":0.38500000000000001},"max":{"1min":0.98299999999999998,"5min":1.0069999999999999,"15min":1.0089999999999999},"last":0.55700000000000005}]},{"osd":1,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96999999999999997,"5min":0.99399999999999999,"15min":1.0629999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.45100000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0329999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.745,"15min":0.748},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46200000000000002},"max":{"1min":0.95699999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.54400000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0109999999999999,"5min":1.405,"15min":1.405},"last":0.626}]},{"osd":3,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.496},"max":{"1min":0.92600000000000005,"5min":1.0409999999999999,"15min":1.0469999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.752,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84599999999999997,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82999999999999996,"5min":0.96499999999999997,"15min":0.97499999999999998},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63700000000000001,"15min":0.627},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82899999999999996,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66700000000000004,"15min":0.67200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.90300000000000002,"5min":0.97899999999999998,"15min":1.0309999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72599999999999998,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94099999999999995,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.45100000000000001},"max":{"1min":0.874,"5min":0.996,"15min":1.0649999999999999},"last":0.84099999999999997}]}]},{"osd":6,"up_from":15,"seq":64424510355,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29092,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342748,"statfs":{"total":96636764160,"available":96606973952,"internally_reserved":0,"allocated":2117632,"data_stored":1066905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.71699999999999997,"15min":0.73899999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91100000000000003,"5min":0.96799999999999997,"15min":1.2070000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.432,"5min":0.42699999999999999,"15min":0.41299999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.58299999999999996}]},{"osd":1,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.73299999999999998,"15min":0.73599999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.74099999999999999,"15min":0.75},"min":{"1min":0.441,"5min":0.441,"15min":0.42999999999999999},"max":{"1min":0.94599999999999995,"5min":1.0169999999999999,"15min":1.3009999999999999},"last":0.622}]},{"osd":2,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.77900000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94899999999999995,"5min":0.95699999999999996,"15min":1.1240000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.92700000000000005,"5min":1.0249999999999999,"15min":1.0549999999999999},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.499},"max":{"1min":0.82699999999999996,"5min":1.0229999999999999,"15min":1.6020000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.77200000000000002,"15min":0.77400000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.84799999999999998,"5min":1.004,"15min":1.1519999999999999},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.375},"max":{"1min":0.81699999999999995,"5min":0.95099999999999996,"15min":1.2589999999999999},"last":0.438},{"interface":"front","average":{"1min":0.625,"5min":0.628,"15min":0.62},"min":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.373},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.571},"last":0.41399999999999998}]},{"osd":5,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65400000000000003,"15min":0.65800000000000003},"min":{"1min":0.42099999999999999,"5min":0.41399999999999998,"15min":0.40799999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.0269999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.75,"15min":0.746},"min":{"1min":0.503,"5min":0.46999999999999997,"15min":0.44800000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.3380000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68799999999999994,"15min":0.66800000000000004},"min":{"1min":0.46500000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.0740000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.69299999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90300000000000002,"5min":1.038,"15min":1.667},"last":0.75800000000000001}]}]},{"osd":5,"up_from":14,"seq":60129543058,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55452,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316388,"statfs":{"total":96636764160,"available":96579981312,"internally_reserved":0,"allocated":2113536,"data_stored":1066835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":1.175,"15min":1.175},"last":0.878},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.73899999999999999,"15min":0.749},"min":{"1min":0.441,"5min":0.441,"15min":0.41599999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.0620000000000001},"last":0.85399999999999998}]},{"osd":1,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72599999999999998,"15min":0.748},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96099999999999997,"5min":1.02,"15min":1.042},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.76100000000000001,"15min":0.76400000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.94699999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94299999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90600000000000003,"5min":1.0349999999999999,"15min":1.038},"last":0.96099999999999997}]},{"osd":3,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.86599999999999999,"5min":1.131,"15min":1.131},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.88600000000000001,"5min":1.032,"15min":1.073},"last":0.98399999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Fri Aug 25 05:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.67300000000000004,"15min":0.66300000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.39700000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68400000000000005,"15min":0.67100000000000004},"min":{"1min":0.496,"5min":0.47299999999999998,"15min":0.41799999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.91400000000000003}]},{"osd":7,"last update":"Fri Aug 25 05:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.66300000000000003,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.42799999999999999,"15min":0.32100000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73099999999999998,"15min":0.71499999999999997},"min":{"1min":0.56799999999999995,"5min":0.48199999999999998,"15min":0.45100000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.79900000000000004}]}]},{"osd":4,"up_from":14,"seq":60129543058,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41576,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330264,"statfs":{"total":96636764160,"available":96594190336,"internally_reserved":0,"allocated":2125824,"data_stored":1068447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.746,"15min":0.73599999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91200000000000003,"5min":1.0509999999999999,"15min":1.0720000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.79700000000000004,"5min":0.96399999999999997,"15min":0.96999999999999997},"last":0.498}]},{"osd":1,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.75900000000000001,"15min":0.76000000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93000000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.752,"15min":0.755},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89800000000000002,"5min":1.008,"15min":1.0660000000000001},"last":0.63800000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.97099999999999997,"5min":1.002,"15min":1.0669999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47199999999999998},"max":{"1min":0.84399999999999997,"5min":1.093,"15min":1.093},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.78200000000000003,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.51700000000000002},"max":{"1min":1.0129999999999999,"5min":1.0369999999999999,"15min":1.044},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89500000000000002,"5min":1.048,"15min":1.1180000000000001},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56999999999999995,"15min":0.55500000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.751,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.0449999999999999},"last":0.40400000000000003}]},{"osd":6,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.746,"15min":0.73899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.622},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.628,"15min":0.624},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94399999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":0.70499999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.46100000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.65900000000000003}]}]},{"osd":3,"up_from":14,"seq":60129543058,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59628,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312212,"statfs":{"total":96636764160,"available":96575705088,"internally_reserved":0,"allocated":2121728,"data_stored":1067451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45400000000000001,"15min":0.46800000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.71899999999999997}]},{"osd":1,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72999999999999998,"5min":0.871,"15min":0.92700000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.628,"15min":0.63100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.88100000000000001,"15min":0.96199999999999997},"last":0.81799999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59199999999999997,"15min":0.60599999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73999999999999999,"5min":0.85099999999999998,"15min":0.89400000000000002},"last":0.752},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":0.85599999999999998,"15min":0.89400000000000002},"last":0.60199999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.81200000000000006,"15min":0.80300000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0900000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81200000000000006,"15min":0.83399999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.97599999999999998,"5min":1.2050000000000001,"15min":1.3220000000000001},"last":0.873}]},{"osd":5,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.81100000000000005,"15min":0.81799999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.054,"5min":1.1830000000000001,"15min":1.2749999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.82099999999999995,"15min":0.82899999999999996},"min":{"1min":0.58899999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"max":{"1min":1.1619999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.78500000000000003}]},{"osd":6,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.85899999999999999,"15min":0.86199999999999999},"min":{"1min":0.58599999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.113,"5min":1.357,"15min":1.357},"last":1.026},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83499999999999996,"15min":0.83899999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.085,"5min":1.274,"15min":1.274},"last":0.83199999999999996}]},{"osd":7,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.872,"15min":0.875},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.115,"5min":1.29,"15min":1.2929999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1339999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.98299999999999998}]}]},{"osd":2,"up_from":14,"seq":60129543059,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59624,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312216,"statfs":{"total":96636764160,"available":96575709184,"internally_reserved":0,"allocated":2121728,"data_stored":1066947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.66000000000000003,"5min":0.72599999999999998,"15min":0.76800000000000002},"last":0.31},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.40200000000000002}]},{"osd":1,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33200000000000002},"max":{"1min":0.69599999999999995,"5min":0.76300000000000001,"15min":0.77600000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.628},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.441}]},{"osd":3,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.78100000000000003,"15min":0.83599999999999997},"last":0.378},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82899999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85099999999999998,"15min":0.83599999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1870000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.48299999999999998},"max":{"1min":1.089,"5min":1.163,"15min":1.163},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.82599999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.54300000000000004},"max":{"1min":1.113,"5min":1.393,"15min":1.393},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.53900000000000003},"max":{"1min":1.2310000000000001,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.50700000000000001}]},{"osd":6,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.88200000000000001,"15min":0.85999999999999999},"min":{"1min":0.63800000000000001,"5min":0.63700000000000001,"15min":0.58699999999999997},"max":{"1min":1.169,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.88900000000000001,"15min":0.89400000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1910000000000001,"5min":1.2529999999999999,"15min":1.369},"last":0.55200000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84899999999999998,"15min":0.82999999999999996},"min":{"1min":0.68799999999999994,"5min":0.621,"15min":0.54300000000000004},"max":{"1min":1.131,"5min":1.292,"15min":1.292},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.85399999999999998,"15min":0.83799999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.125,"5min":1.1870000000000001,"15min":1.254},"last":0.51900000000000002}]}]},{"osd":1,"up_from":14,"seq":60129543059,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37416,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334424,"statfs":{"total":96636764160,"available":96598450176,"internally_reserved":0,"allocated":2117632,"data_stored":1066905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.48299999999999998},"min":{"1min":0.32300000000000001,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.752,"15min":0.91700000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.88700000000000001},"last":0.28999999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73699999999999999,"5min":0.749,"15min":0.78900000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.42899999999999999}]},{"osd":3,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82299999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.437,"5min":0.435,"15min":0.40600000000000003},"max":{"1min":0.86799999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.499},"max":{"1min":0.97899999999999998,"5min":1.0680000000000001,"15min":1.212},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.83099999999999996,"15min":0.82499999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.0229999999999999,"5min":1.0429999999999999,"15min":1.163},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.52900000000000003},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.81999999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.083,"5min":1.115,"15min":1.171},"last":0.68700000000000006}]},{"osd":6,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86499999999999999,"15min":0.84599999999999997},"min":{"1min":0.64400000000000002,"5min":0.627,"15min":0.51500000000000001},"max":{"1min":1.107,"5min":1.1579999999999999,"15min":1.3700000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83299999999999996,"15min":0.83399999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.1830000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.044,"5min":1.1659999999999999,"15min":1.3320000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.58899999999999997},"max":{"1min":1.115,"5min":1.115,"15min":1.268},"last":0.70399999999999996}]}]},{"osd":0,"up_from":14,"seq":60129543058,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60220,"kb_used_data":2668,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311620,"statfs":{"total":96636764160,"available":96575098880,"internally_reserved":0,"allocated":2732032,"data_stored":1659521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.49199999999999999,"15min":0.50600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77500000000000002,"5min":0.79600000000000004,"15min":0.82599999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.64500000000000002,"5min":0.876,"15min":0.876},"last":0.47099999999999997}]},{"osd":2,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71499999999999997,"5min":0.82899999999999996,"15min":0.90700000000000003},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.57699999999999996,"5min":0.83099999999999996,"15min":0.86099999999999999},"last":0.54500000000000004}]},{"osd":3,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.499,"15min":0.50900000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.60199999999999998,"5min":0.93799999999999994,"15min":1.0409999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.59399999999999997,"15min":0.61099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79900000000000004,"5min":0.878,"15min":0.878},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92900000000000005,"5min":1.2649999999999999,"15min":1.3740000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.125,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.85599999999999998}]},{"osd":5,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.78500000000000003,"15min":0.79900000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.46100000000000002},"max":{"1min":1.012,"5min":1.0820000000000001,"15min":1.2210000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.80900000000000005,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.3260000000000001},"last":0.88}]},{"osd":6,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.89600000000000002,"5min":1.196,"15min":1.196},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0589999999999999,"5min":1.216,"15min":1.2849999999999999},"last":0.75}]},{"osd":7,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.85099999999999998,"15min":0.86299999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.149,"5min":1.22,"15min":1.2410000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.81899999999999995,"15min":0.83599999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.95999999999999996,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.75900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:19:25.046 INFO:tasks.ceph.mds.c.smithi055.stderr:2023-08-25T05:19:25.041+0000 7faeca672640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T05:19:27.794 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:19:27.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.948+0000 7f2d427e1640 1 Processor -- start 2023-08-25T05:19:27.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.948+0000 7f2d427e1640 1 -- start start 2023-08-25T05:19:27.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.948+0000 7f2d427e1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0cc700 0x7f2d3c1678b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:27.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.948+0000 7f2d427e1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3c06c4f0 con 0x7f2d3c0ceff0 2023-08-25T05:19:27.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.948+0000 7f2d427e1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3c06c7d0 con 0x7f2d3c0aeb10 2023-08-25T05:19:27.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.948+0000 7f2d427e1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0d0380 con 0x7f2d3c0cc700 2023-08-25T05:19:27.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.948+0000 7f2d3b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2d3c0ceff0 0x7f2d3c069900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38294/0 (socket says 172.21.15.55:38294) 2023-08-25T05:19:27.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.948+0000 7f2d3b7fe640 1 -- 172.21.15.55:0/965324515 learned_addr learned my addr 172.21.15.55:0/965324515 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:27.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.948+0000 7f2d40d7e640 1 --2- 172.21.15.55:0/965324515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0cc700 0x7f2d3c1678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:27.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.948+0000 7f2d3affd640 1 -- 172.21.15.55:0/965324515 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014919315 0 0) 0x7f2d3c06c4f0 con 0x7f2d3c0ceff0 2023-08-25T05:19:27.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.948+0000 7f2d3affd640 1 -- 172.21.15.55:0/965324515 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d24003530 con 0x7f2d3c0ceff0 2023-08-25T05:19:27.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.948+0000 7f2d3affd640 1 -- 172.21.15.55:0/965324515 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457493547 0 0) 0x7f2d3c06c7d0 con 0x7f2d3c0aeb10 2023-08-25T05:19:27.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.948+0000 7f2d3affd640 1 -- 172.21.15.55:0/965324515 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d3c06c4f0 con 0x7f2d3c0aeb10 2023-08-25T05:19:27.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.948+0000 7f2d40d7e640 1 -- 172.21.15.55:0/965324515 >> v1:172.21.15.110:6789/0 conn(0x7f2d3c0aeb10 legacy=0x7f2d3c0ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:27.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.948+0000 7f2d40d7e640 1 -- 172.21.15.55:0/965324515 >> v1:172.21.15.55:6789/0 conn(0x7f2d3c0ceff0 legacy=0x7f2d3c069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:27.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.948+0000 7f2d40d7e640 1 -- 172.21.15.55:0/965324515 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c06cab0 con 0x7f2d3c0cc700 2023-08-25T05:19:27.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.952+0000 7f2d40d7e640 1 --2- 172.21.15.55:0/965324515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0cc700 0x7f2d3c1678b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2d34009dc0 tx=0x7f2d3401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9defabd5cc389b68 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:27.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.952+0000 7f2d3affd640 1 -- 172.21.15.55:0/965324515 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d340a5830 con 0x7f2d3c0cc700 2023-08-25T05:19:27.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.952+0000 7f2d3affd640 1 -- 172.21.15.55:0/965324515 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d340a5990 con 0x7f2d3c0cc700 2023-08-25T05:19:27.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.952+0000 7f2d3affd640 1 -- 172.21.15.55:0/965324515 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d340a5d00 con 0x7f2d3c0cc700 2023-08-25T05:19:27.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.952+0000 7f2d427e1640 1 -- 172.21.15.55:0/965324515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0cc700 msgr2=0x7f2d3c1678b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:27.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.952+0000 7f2d427e1640 1 --2- 172.21.15.55:0/965324515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0cc700 0x7f2d3c1678b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2d34009dc0 tx=0x7f2d3401c970 comp rx=0 tx=0).stop 2023-08-25T05:19:27.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d427e1640 1 -- 172.21.15.55:0/965324515 shutdown_connections 2023-08-25T05:19:27.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d427e1640 1 --2- 172.21.15.55:0/965324515 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0cc700 0x7f2d3c1678b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:27.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d427e1640 1 -- 172.21.15.55:0/965324515 >> 172.21.15.55:0/965324515 conn(0x7f2d3c0cf530 msgr2=0x7f2d3c0cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:27.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d427e1640 1 -- 172.21.15.55:0/965324515 shutdown_connections 2023-08-25T05:19:27.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d427e1640 1 -- 172.21.15.55:0/965324515 wait complete. 2023-08-25T05:19:27.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d427e1640 1 Processor -- start 2023-08-25T05:19:27.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d427e1640 1 -- start start 2023-08-25T05:19:27.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d427e1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0aeb10 0x7f2d3c15b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:27.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d427e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3c0cc700 0x7f2d3c152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:27.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d427e1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d3c0ceff0 0x7f2d3c1fd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:27.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d427e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c0c2c40 con 0x7f2d3c0cc700 2023-08-25T05:19:27.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d427e1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c1fcea0 con 0x7f2d3c0ceff0 2023-08-25T05:19:27.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d427e1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c152dc0 con 0x7f2d3c0aeb10 2023-08-25T05:19:27.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d3b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3c0cc700 0x7f2d3c152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:27.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d3b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3c0cc700 0x7f2d3c152880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51214/0 (socket says 172.21.15.55:51214) 2023-08-25T05:19:27.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d3b7fe640 1 -- 172.21.15.55:0/3485980077 learned_addr learned my addr 172.21.15.55:0/3485980077 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:27.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d3bfff640 1 --2- 172.21.15.55:0/3485980077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0aeb10 0x7f2d3c15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:27.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d40d7e640 1 --2- 172.21.15.55:0/3485980077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d3c0ceff0 0x7f2d3c1fd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:27.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d3b7fe640 1 -- 172.21.15.55:0/3485980077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0aeb10 msgr2=0x7f2d3c15b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:27.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d3b7fe640 1 --2- 172.21.15.55:0/3485980077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0aeb10 0x7f2d3c15b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:27.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d3b7fe640 1 -- 172.21.15.55:0/3485980077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d3c0ceff0 msgr2=0x7f2d3c1fd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:27.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d3b7fe640 1 --2- 172.21.15.55:0/3485980077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d3c0ceff0 0x7f2d3c1fd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:27.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.956+0000 7f2d3b7fe640 1 -- 172.21.15.55:0/3485980077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d34009a70 con 0x7f2d3c0cc700 2023-08-25T05:19:27.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.960+0000 7f2d3b7fe640 1 --2- 172.21.15.55:0/3485980077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3c0cc700 0x7f2d3c152880 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000c420 tx=0x7f2d3000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:27.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.960+0000 7f2d38ff9640 1 -- 172.21.15.55:0/3485980077 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30005cf0 con 0x7f2d3c0cc700 2023-08-25T05:19:27.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.960+0000 7f2d38ff9640 1 -- 172.21.15.55:0/3485980077 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d30005e50 con 0x7f2d3c0cc700 2023-08-25T05:19:27.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.960+0000 7f2d427e1640 1 -- 172.21.15.55:0/3485980077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3c153060 con 0x7f2d3c0cc700 2023-08-25T05:19:27.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.960+0000 7f2d38ff9640 1 -- 172.21.15.55:0/3485980077 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d30007310 con 0x7f2d3c0cc700 2023-08-25T05:19:27.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.960+0000 7f2d427e1640 1 -- 172.21.15.55:0/3485980077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3c153620 con 0x7f2d3c0cc700 2023-08-25T05:19:27.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.960+0000 7f2d427e1640 1 -- 172.21.15.55:0/3485980077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3c04dbe0 con 0x7f2d3c0cc700 2023-08-25T05:19:27.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.960+0000 7f2d38ff9640 1 -- 172.21.15.55:0/3485980077 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f2d30007470 con 0x7f2d3c0cc700 2023-08-25T05:19:27.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.960+0000 7f2d38ff9640 1 --2- 172.21.15.55:0/3485980077 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f2d280657a0 0x7f2d28067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:27.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.960+0000 7f2d38ff9640 1 -- 172.21.15.55:0/3485980077 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2d30082650 con 0x7f2d3c0cc700 2023-08-25T05:19:27.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.964+0000 7f2d3bfff640 1 --2- 172.21.15.55:0/3485980077 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f2d280657a0 0x7f2d28067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:27.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.964+0000 7f2d3bfff640 1 --2- 172.21.15.55:0/3485980077 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f2d280657a0 0x7f2d28067c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c007fd0 tx=0x7f2d2c009040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:27.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:27.968+0000 7f2d38ff9640 1 -- 172.21.15.55:0/3485980077 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2d3004fed0 con 0x7f2d3c0cc700 2023-08-25T05:19:28.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.120+0000 7f2d427e1640 1 -- 172.21.15.55:0/3485980077 --> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d3c1fcfe0 con 0x7f2d280657a0 2023-08-25T05:19:28.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.128+0000 7f2d38ff9640 1 -- 172.21.15.55:0/3485980077 <== mgr.9163 v2:172.21.15.110:6832/221263034 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311582 (secure 0 0 0) 0x7f2d3c1fcfe0 con 0x7f2d280657a0 2023-08-25T05:19:28.138 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:28.140 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:19:28.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.132+0000 7f2d427e1640 1 -- 172.21.15.55:0/3485980077 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f2d280657a0 msgr2=0x7f2d28067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:28.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.132+0000 7f2d427e1640 1 --2- 172.21.15.55:0/3485980077 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f2d280657a0 0x7f2d28067c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c007fd0 tx=0x7f2d2c009040 comp rx=0 tx=0).stop 2023-08-25T05:19:28.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.132+0000 7f2d427e1640 1 -- 172.21.15.55:0/3485980077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3c0cc700 msgr2=0x7f2d3c152880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:28.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.132+0000 7f2d427e1640 1 --2- 172.21.15.55:0/3485980077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3c0cc700 0x7f2d3c152880 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000c420 tx=0x7f2d3000c8e0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.132+0000 7f2d427e1640 1 -- 172.21.15.55:0/3485980077 shutdown_connections 2023-08-25T05:19:28.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.132+0000 7f2d427e1640 1 --2- 172.21.15.55:0/3485980077 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f2d280657a0 0x7f2d28067c60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.132+0000 7f2d427e1640 1 --2- 172.21.15.55:0/3485980077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2d3c0ceff0 0x7f2d3c1fd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.132+0000 7f2d427e1640 1 --2- 172.21.15.55:0/3485980077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2d3c0cc700 0x7f2d3c152880 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.132+0000 7f2d427e1640 1 --2- 172.21.15.55:0/3485980077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2d3c0aeb10 0x7f2d3c15b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.132+0000 7f2d427e1640 1 -- 172.21.15.55:0/3485980077 >> 172.21.15.55:0/3485980077 conn(0x7f2d3c0cf530 msgr2=0x7f2d3c0cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:28.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.132+0000 7f2d427e1640 1 -- 172.21.15.55:0/3485980077 shutdown_connections 2023-08-25T05:19:28.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.132+0000 7f2d427e1640 1 -- 172.21.15.55:0/3485980077 wait complete. 2023-08-25T05:19:28.158 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-08-25T05:19:27.734307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1616,"num_read_kb":3373,"num_write":509,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3636,"ondisk_log_size":3636,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":394884,"kb_used_data":17736,"kb_used_omap":13,"kb_used_meta":377010,"kb_avail":754579836,"statfs":{"total":773094113280,"available":772689752064,"internally_reserved":0,"allocated":18161664,"data_stored":9720236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":386058328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.654319"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387222+0000","last_change":"2023-08-25T05:19:19.105458+0000","last_active":"2023-08-25T05:19:20.387222+0000","last_peered":"2023-08-25T05:19:20.387222+0000","last_clean":"2023-08-25T05:19:20.387222+0000","last_became_active":"2023-08-25T05:19:19.104947+0000","last_became_peered":"2023-08-25T05:19:19.104947+0000","last_unstale":"2023-08-25T05:19:20.387222+0000","last_undegraded":"2023-08-25T05:19:20.387222+0000","last_fullsized":"2023-08-25T05:19:20.387222+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:04:23.125561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670934+0000","last_change":"2023-08-25T05:19:19.097697+0000","last_active":"2023-08-25T05:19:20.670934+0000","last_peered":"2023-08-25T05:19:20.670934+0000","last_clean":"2023-08-25T05:19:20.670934+0000","last_became_active":"2023-08-25T05:19:19.097401+0000","last_became_peered":"2023-08-25T05:19:19.097401+0000","last_unstale":"2023-08-25T05:19:20.670934+0000","last_undegraded":"2023-08-25T05:19:20.670934+0000","last_fullsized":"2023-08-25T05:19:20.670934+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:22:06.016604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670720+0000","last_change":"2023-08-25T05:19:19.109971+0000","last_active":"2023-08-25T05:19:20.670720+0000","last_peered":"2023-08-25T05:19:20.670720+0000","last_clean":"2023-08-25T05:19:20.670720+0000","last_became_active":"2023-08-25T05:19:19.109681+0000","last_became_peered":"2023-08-25T05:19:19.109681+0000","last_unstale":"2023-08-25T05:19:20.670720+0000","last_undegraded":"2023-08-25T05:19:20.670720+0000","last_fullsized":"2023-08-25T05:19:20.670720+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:59:08.669080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101723+0000","last_change":"2023-08-25T05:19:19.087934+0000","last_active":"2023-08-25T05:19:20.101723+0000","last_peered":"2023-08-25T05:19:20.101723+0000","last_clean":"2023-08-25T05:19:20.101723+0000","last_became_active":"2023-08-25T05:19:19.087573+0000","last_became_peered":"2023-08-25T05:19:19.087573+0000","last_unstale":"2023-08-25T05:19:20.101723+0000","last_undegraded":"2023-08-25T05:19:20.101723+0000","last_fullsized":"2023-08-25T05:19:20.101723+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:08:47.094804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100398+0000","last_change":"2023-08-25T05:19:19.110091+0000","last_active":"2023-08-25T05:19:20.100398+0000","last_peered":"2023-08-25T05:19:20.100398+0000","last_clean":"2023-08-25T05:19:20.100398+0000","last_became_active":"2023-08-25T05:19:19.108036+0000","last_became_peered":"2023-08-25T05:19:19.108036+0000","last_unstale":"2023-08-25T05:19:20.100398+0000","last_undegraded":"2023-08-25T05:19:20.100398+0000","last_fullsized":"2023-08-25T05:19:20.100398+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:11:56.343935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100257+0000","last_change":"2023-08-25T05:19:19.111006+0000","last_active":"2023-08-25T05:19:20.100257+0000","last_peered":"2023-08-25T05:19:20.100257+0000","last_clean":"2023-08-25T05:19:20.100257+0000","last_became_active":"2023-08-25T05:19:19.110679+0000","last_became_peered":"2023-08-25T05:19:19.110679+0000","last_unstale":"2023-08-25T05:19:20.100257+0000","last_undegraded":"2023-08-25T05:19:20.100257+0000","last_fullsized":"2023-08-25T05:19:20.100257+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:30:50.264686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386815+0000","last_change":"2023-08-25T05:19:19.111964+0000","last_active":"2023-08-25T05:19:20.386815+0000","last_peered":"2023-08-25T05:19:20.386815+0000","last_clean":"2023-08-25T05:19:20.386815+0000","last_became_active":"2023-08-25T05:19:19.110964+0000","last_became_peered":"2023-08-25T05:19:19.110964+0000","last_unstale":"2023-08-25T05:19:20.386815+0000","last_undegraded":"2023-08-25T05:19:20.386815+0000","last_fullsized":"2023-08-25T05:19:20.386815+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:36:09.034953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102061+0000","last_change":"2023-08-25T05:19:19.096673+0000","last_active":"2023-08-25T05:19:20.102061+0000","last_peered":"2023-08-25T05:19:20.102061+0000","last_clean":"2023-08-25T05:19:20.102061+0000","last_became_active":"2023-08-25T05:19:19.094244+0000","last_became_peered":"2023-08-25T05:19:19.094244+0000","last_unstale":"2023-08-25T05:19:20.102061+0000","last_undegraded":"2023-08-25T05:19:20.102061+0000","last_fullsized":"2023-08-25T05:19:20.102061+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:17:01.615689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100562+0000","last_change":"2023-08-25T05:19:19.118566+0000","last_active":"2023-08-25T05:19:20.100562+0000","last_peered":"2023-08-25T05:19:20.100562+0000","last_clean":"2023-08-25T05:19:20.100562+0000","last_became_active":"2023-08-25T05:19:19.112749+0000","last_became_peered":"2023-08-25T05:19:19.112749+0000","last_unstale":"2023-08-25T05:19:20.100562+0000","last_undegraded":"2023-08-25T05:19:20.100562+0000","last_fullsized":"2023-08-25T05:19:20.100562+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:29:06.105129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100587+0000","last_change":"2023-08-25T05:19:19.110305+0000","last_active":"2023-08-25T05:19:20.100587+0000","last_peered":"2023-08-25T05:19:20.100587+0000","last_clean":"2023-08-25T05:19:20.100587+0000","last_became_active":"2023-08-25T05:19:19.108828+0000","last_became_peered":"2023-08-25T05:19:19.108828+0000","last_unstale":"2023-08-25T05:19:20.100587+0000","last_undegraded":"2023-08-25T05:19:20.100587+0000","last_fullsized":"2023-08-25T05:19:20.100587+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:59:56.021201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669617+0000","last_change":"2023-08-25T05:19:19.101083+0000","last_active":"2023-08-25T05:19:20.669617+0000","last_peered":"2023-08-25T05:19:20.669617+0000","last_clean":"2023-08-25T05:19:20.669617+0000","last_became_active":"2023-08-25T05:19:19.100783+0000","last_became_peered":"2023-08-25T05:19:19.100783+0000","last_unstale":"2023-08-25T05:19:20.669617+0000","last_undegraded":"2023-08-25T05:19:20.669617+0000","last_fullsized":"2023-08-25T05:19:20.669617+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:06:27.041983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102187+0000","last_change":"2023-08-25T05:19:19.105347+0000","last_active":"2023-08-25T05:19:20.102187+0000","last_peered":"2023-08-25T05:19:20.102187+0000","last_clean":"2023-08-25T05:19:20.102187+0000","last_became_active":"2023-08-25T05:19:19.105087+0000","last_became_peered":"2023-08-25T05:19:19.105087+0000","last_unstale":"2023-08-25T05:19:20.102187+0000","last_undegraded":"2023-08-25T05:19:20.102187+0000","last_fullsized":"2023-08-25T05:19:20.102187+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:53:45.015387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.099965+0000","last_change":"2023-08-25T05:19:19.110786+0000","last_active":"2023-08-25T05:19:20.099965+0000","last_peered":"2023-08-25T05:19:20.099965+0000","last_clean":"2023-08-25T05:19:20.099965+0000","last_became_active":"2023-08-25T05:19:19.108699+0000","last_became_peered":"2023-08-25T05:19:19.108699+0000","last_unstale":"2023-08-25T05:19:20.099965+0000","last_undegraded":"2023-08-25T05:19:20.099965+0000","last_fullsized":"2023-08-25T05:19:20.099965+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:59.578688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.103004+0000","last_change":"2023-08-25T05:19:19.104814+0000","last_active":"2023-08-25T05:19:20.103004+0000","last_peered":"2023-08-25T05:19:20.103004+0000","last_clean":"2023-08-25T05:19:20.103004+0000","last_became_active":"2023-08-25T05:19:19.104517+0000","last_became_peered":"2023-08-25T05:19:19.104517+0000","last_unstale":"2023-08-25T05:19:20.103004+0000","last_undegraded":"2023-08-25T05:19:20.103004+0000","last_fullsized":"2023-08-25T05:19:20.103004+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:48:12.851567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670538+0000","last_change":"2023-08-25T05:19:19.101295+0000","last_active":"2023-08-25T05:19:20.670538+0000","last_peered":"2023-08-25T05:19:20.670538+0000","last_clean":"2023-08-25T05:19:20.670538+0000","last_became_active":"2023-08-25T05:19:19.100728+0000","last_became_peered":"2023-08-25T05:19:19.100728+0000","last_unstale":"2023-08-25T05:19:20.670538+0000","last_undegraded":"2023-08-25T05:19:20.670538+0000","last_fullsized":"2023-08-25T05:19:20.670538+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:06:43.803011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.099751+0000","last_change":"2023-08-25T05:19:19.105817+0000","last_active":"2023-08-25T05:19:20.099751+0000","last_peered":"2023-08-25T05:19:20.099751+0000","last_clean":"2023-08-25T05:19:20.099751+0000","last_became_active":"2023-08-25T05:19:19.105440+0000","last_became_peered":"2023-08-25T05:19:19.105440+0000","last_unstale":"2023-08-25T05:19:20.099751+0000","last_undegraded":"2023-08-25T05:19:20.099751+0000","last_fullsized":"2023-08-25T05:19:20.099751+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:54:15.215671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102346+0000","last_change":"2023-08-25T05:19:19.107687+0000","last_active":"2023-08-25T05:19:20.102346+0000","last_peered":"2023-08-25T05:19:20.102346+0000","last_clean":"2023-08-25T05:19:20.102346+0000","last_became_active":"2023-08-25T05:19:19.107352+0000","last_became_peered":"2023-08-25T05:19:19.107352+0000","last_unstale":"2023-08-25T05:19:20.102346+0000","last_undegraded":"2023-08-25T05:19:20.102346+0000","last_fullsized":"2023-08-25T05:19:20.102346+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:16.742610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669842+0000","last_change":"2023-08-25T05:19:19.106678+0000","last_active":"2023-08-25T05:19:20.669842+0000","last_peered":"2023-08-25T05:19:20.669842+0000","last_clean":"2023-08-25T05:19:20.669842+0000","last_became_active":"2023-08-25T05:19:19.106200+0000","last_became_peered":"2023-08-25T05:19:19.106200+0000","last_unstale":"2023-08-25T05:19:20.669842+0000","last_undegraded":"2023-08-25T05:19:20.669842+0000","last_fullsized":"2023-08-25T05:19:20.669842+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:16:30.547249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.671022+0000","last_change":"2023-08-25T05:19:19.109289+0000","last_active":"2023-08-25T05:19:20.671022+0000","last_peered":"2023-08-25T05:19:20.671022+0000","last_clean":"2023-08-25T05:19:20.671022+0000","last_became_active":"2023-08-25T05:19:19.108896+0000","last_became_peered":"2023-08-25T05:19:19.108896+0000","last_unstale":"2023-08-25T05:19:20.671022+0000","last_undegraded":"2023-08-25T05:19:20.671022+0000","last_fullsized":"2023-08-25T05:19:20.671022+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:53:01.852132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669753+0000","last_change":"2023-08-25T05:19:19.101815+0000","last_active":"2023-08-25T05:19:20.669753+0000","last_peered":"2023-08-25T05:19:20.669753+0000","last_clean":"2023-08-25T05:19:20.669753+0000","last_became_active":"2023-08-25T05:19:19.101418+0000","last_became_peered":"2023-08-25T05:19:19.101418+0000","last_unstale":"2023-08-25T05:19:20.669753+0000","last_undegraded":"2023-08-25T05:19:20.669753+0000","last_fullsized":"2023-08-25T05:19:20.669753+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:02:40.529229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100089+0000","last_change":"2023-08-25T05:19:19.114228+0000","last_active":"2023-08-25T05:19:20.100089+0000","last_peered":"2023-08-25T05:19:20.100089+0000","last_clean":"2023-08-25T05:19:20.100089+0000","last_became_active":"2023-08-25T05:19:19.112823+0000","last_became_peered":"2023-08-25T05:19:19.112823+0000","last_unstale":"2023-08-25T05:19:20.100089+0000","last_undegraded":"2023-08-25T05:19:20.100089+0000","last_fullsized":"2023-08-25T05:19:20.100089+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:36:55.589906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386836+0000","last_change":"2023-08-25T05:19:19.111385+0000","last_active":"2023-08-25T05:19:20.386836+0000","last_peered":"2023-08-25T05:19:20.386836+0000","last_clean":"2023-08-25T05:19:20.386836+0000","last_became_active":"2023-08-25T05:19:19.111045+0000","last_became_peered":"2023-08-25T05:19:19.111045+0000","last_unstale":"2023-08-25T05:19:20.386836+0000","last_undegraded":"2023-08-25T05:19:20.386836+0000","last_fullsized":"2023-08-25T05:19:20.386836+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:17:09.619856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101958+0000","last_change":"2023-08-25T05:19:19.107378+0000","last_active":"2023-08-25T05:19:20.101958+0000","last_peered":"2023-08-25T05:19:20.101958+0000","last_clean":"2023-08-25T05:19:20.101958+0000","last_became_active":"2023-08-25T05:19:19.106704+0000","last_became_peered":"2023-08-25T05:19:19.106704+0000","last_unstale":"2023-08-25T05:19:20.101958+0000","last_undegraded":"2023-08-25T05:19:20.101958+0000","last_fullsized":"2023-08-25T05:19:20.101958+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:02:41.116429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669789+0000","last_change":"2023-08-25T05:19:19.109734+0000","last_active":"2023-08-25T05:19:20.669789+0000","last_peered":"2023-08-25T05:19:20.669789+0000","last_clean":"2023-08-25T05:19:20.669789+0000","last_became_active":"2023-08-25T05:19:19.109437+0000","last_became_peered":"2023-08-25T05:19:19.109437+0000","last_unstale":"2023-08-25T05:19:20.669789+0000","last_undegraded":"2023-08-25T05:19:20.669789+0000","last_fullsized":"2023-08-25T05:19:20.669789+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:45:41.480896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387260+0000","last_change":"2023-08-25T05:19:19.108235+0000","last_active":"2023-08-25T05:19:20.387260+0000","last_peered":"2023-08-25T05:19:20.387260+0000","last_clean":"2023-08-25T05:19:20.387260+0000","last_became_active":"2023-08-25T05:19:19.107876+0000","last_became_peered":"2023-08-25T05:19:19.107876+0000","last_unstale":"2023-08-25T05:19:20.387260+0000","last_undegraded":"2023-08-25T05:19:20.387260+0000","last_fullsized":"2023-08-25T05:19:20.387260+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:20:41.091758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387186+0000","last_change":"2023-08-25T05:19:19.113934+0000","last_active":"2023-08-25T05:19:20.387186+0000","last_peered":"2023-08-25T05:19:20.387186+0000","last_clean":"2023-08-25T05:19:20.387186+0000","last_became_active":"2023-08-25T05:19:19.113434+0000","last_became_peered":"2023-08-25T05:19:19.113434+0000","last_unstale":"2023-08-25T05:19:20.387186+0000","last_undegraded":"2023-08-25T05:19:20.387186+0000","last_fullsized":"2023-08-25T05:19:20.387186+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:45:10.087683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100452+0000","last_change":"2023-08-25T05:19:19.113088+0000","last_active":"2023-08-25T05:19:20.100452+0000","last_peered":"2023-08-25T05:19:20.100452+0000","last_clean":"2023-08-25T05:19:20.100452+0000","last_became_active":"2023-08-25T05:19:19.112714+0000","last_became_peered":"2023-08-25T05:19:19.112714+0000","last_unstale":"2023-08-25T05:19:20.100452+0000","last_undegraded":"2023-08-25T05:19:20.100452+0000","last_fullsized":"2023-08-25T05:19:20.100452+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:09.499178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670051+0000","last_change":"2023-08-25T05:19:19.106903+0000","last_active":"2023-08-25T05:19:20.670051+0000","last_peered":"2023-08-25T05:19:20.670051+0000","last_clean":"2023-08-25T05:19:20.670051+0000","last_became_active":"2023-08-25T05:19:19.106619+0000","last_became_peered":"2023-08-25T05:19:19.106619+0000","last_unstale":"2023-08-25T05:19:20.670051+0000","last_undegraded":"2023-08-25T05:19:20.670051+0000","last_fullsized":"2023-08-25T05:19:20.670051+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:17:02.980043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102736+0000","last_change":"2023-08-25T05:19:19.115725+0000","last_active":"2023-08-25T05:19:20.102736+0000","last_peered":"2023-08-25T05:19:20.102736+0000","last_clean":"2023-08-25T05:19:20.102736+0000","last_became_active":"2023-08-25T05:19:19.115107+0000","last_became_peered":"2023-08-25T05:19:19.115107+0000","last_unstale":"2023-08-25T05:19:20.102736+0000","last_undegraded":"2023-08-25T05:19:20.102736+0000","last_fullsized":"2023-08-25T05:19:20.102736+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:47:19.466677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669974+0000","last_change":"2023-08-25T05:19:19.091428+0000","last_active":"2023-08-25T05:19:20.669974+0000","last_peered":"2023-08-25T05:19:20.669974+0000","last_clean":"2023-08-25T05:19:20.669974+0000","last_became_active":"2023-08-25T05:19:19.090567+0000","last_became_peered":"2023-08-25T05:19:19.090567+0000","last_unstale":"2023-08-25T05:19:20.669974+0000","last_undegraded":"2023-08-25T05:19:20.669974+0000","last_fullsized":"2023-08-25T05:19:20.669974+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:29:12.750973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.099772+0000","last_change":"2023-08-25T05:19:19.101493+0000","last_active":"2023-08-25T05:19:20.099772+0000","last_peered":"2023-08-25T05:19:20.099772+0000","last_clean":"2023-08-25T05:19:20.099772+0000","last_became_active":"2023-08-25T05:19:19.101085+0000","last_became_peered":"2023-08-25T05:19:19.101085+0000","last_unstale":"2023-08-25T05:19:20.099772+0000","last_undegraded":"2023-08-25T05:19:20.099772+0000","last_fullsized":"2023-08-25T05:19:20.099772+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:39:18.042193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102195+0000","last_change":"2023-08-25T05:19:19.094244+0000","last_active":"2023-08-25T05:19:20.102195+0000","last_peered":"2023-08-25T05:19:20.102195+0000","last_clean":"2023-08-25T05:19:20.102195+0000","last_became_active":"2023-08-25T05:19:19.093926+0000","last_became_peered":"2023-08-25T05:19:19.093926+0000","last_unstale":"2023-08-25T05:19:20.102195+0000","last_undegraded":"2023-08-25T05:19:20.102195+0000","last_fullsized":"2023-08-25T05:19:20.102195+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:09:55.883591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670822+0000","last_change":"2023-08-25T05:19:19.109818+0000","last_active":"2023-08-25T05:19:20.670822+0000","last_peered":"2023-08-25T05:19:20.670822+0000","last_clean":"2023-08-25T05:19:20.670822+0000","last_became_active":"2023-08-25T05:19:19.109520+0000","last_became_peered":"2023-08-25T05:19:19.109520+0000","last_unstale":"2023-08-25T05:19:20.670822+0000","last_undegraded":"2023-08-25T05:19:20.670822+0000","last_fullsized":"2023-08-25T05:19:20.670822+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:30:12.342980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"169'4","reported_seq":17,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100652+0000","last_change":"2023-08-25T05:19:18.096852+0000","last_active":"2023-08-25T05:19:20.100652+0000","last_peered":"2023-08-25T05:19:20.100652+0000","last_clean":"2023-08-25T05:19:20.100652+0000","last_became_active":"2023-08-25T05:19:18.096586+0000","last_became_peered":"2023-08-25T05:19:18.096586+0000","last_unstale":"2023-08-25T05:19:20.100652+0000","last_undegraded":"2023-08-25T05:19:20.100652+0000","last_fullsized":"2023-08-25T05:19:20.100652+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:10:33.739986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670769+0000","last_change":"2023-08-25T05:19:19.099800+0000","last_active":"2023-08-25T05:19:20.670769+0000","last_peered":"2023-08-25T05:19:20.670769+0000","last_clean":"2023-08-25T05:19:20.670769+0000","last_became_active":"2023-08-25T05:19:19.099476+0000","last_became_peered":"2023-08-25T05:19:19.099476+0000","last_unstale":"2023-08-25T05:19:20.670769+0000","last_undegraded":"2023-08-25T05:19:20.670769+0000","last_fullsized":"2023-08-25T05:19:20.670769+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:09:33.219847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"169'1","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670612+0000","last_change":"2023-08-25T05:19:18.103369+0000","last_active":"2023-08-25T05:19:20.670612+0000","last_peered":"2023-08-25T05:19:20.670612+0000","last_clean":"2023-08-25T05:19:20.670612+0000","last_became_active":"2023-08-25T05:19:18.103067+0000","last_became_peered":"2023-08-25T05:19:18.103067+0000","last_unstale":"2023-08-25T05:19:20.670612+0000","last_undegraded":"2023-08-25T05:19:20.670612+0000","last_fullsized":"2023-08-25T05:19:20.670612+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:24:17.716029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102787+0000","last_change":"2023-08-25T05:19:19.088435+0000","last_active":"2023-08-25T05:19:20.102787+0000","last_peered":"2023-08-25T05:19:20.102787+0000","last_clean":"2023-08-25T05:19:20.102787+0000","last_became_active":"2023-08-25T05:19:19.088107+0000","last_became_peered":"2023-08-25T05:19:19.088107+0000","last_unstale":"2023-08-25T05:19:20.102787+0000","last_undegraded":"2023-08-25T05:19:20.102787+0000","last_fullsized":"2023-08-25T05:19:20.102787+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:20:52.631756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"169'2","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670847+0000","last_change":"2023-08-25T05:19:18.103473+0000","last_active":"2023-08-25T05:19:20.670847+0000","last_peered":"2023-08-25T05:19:20.670847+0000","last_clean":"2023-08-25T05:19:20.670847+0000","last_became_active":"2023-08-25T05:19:18.103177+0000","last_became_peered":"2023-08-25T05:19:18.103177+0000","last_unstale":"2023-08-25T05:19:20.670847+0000","last_undegraded":"2023-08-25T05:19:20.670847+0000","last_fullsized":"2023-08-25T05:19:20.670847+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:23:45.700005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670811+0000","last_change":"2023-08-25T05:19:19.110072+0000","last_active":"2023-08-25T05:19:20.670811+0000","last_peered":"2023-08-25T05:19:20.670811+0000","last_clean":"2023-08-25T05:19:20.670811+0000","last_became_active":"2023-08-25T05:19:19.109776+0000","last_became_peered":"2023-08-25T05:19:19.109776+0000","last_unstale":"2023-08-25T05:19:20.670811+0000","last_undegraded":"2023-08-25T05:19:20.670811+0000","last_fullsized":"2023-08-25T05:19:20.670811+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:31:17.527448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"169'2","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670688+0000","last_change":"2023-08-25T05:19:18.091924+0000","last_active":"2023-08-25T05:19:20.670688+0000","last_peered":"2023-08-25T05:19:20.670688+0000","last_clean":"2023-08-25T05:19:20.670688+0000","last_became_active":"2023-08-25T05:19:18.091634+0000","last_became_peered":"2023-08-25T05:19:18.091634+0000","last_unstale":"2023-08-25T05:19:20.670688+0000","last_undegraded":"2023-08-25T05:19:20.670688+0000","last_fullsized":"2023-08-25T05:19:20.670688+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:12.984060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669406+0000","last_change":"2023-08-25T05:19:19.116242+0000","last_active":"2023-08-25T05:19:20.669406+0000","last_peered":"2023-08-25T05:19:20.669406+0000","last_clean":"2023-08-25T05:19:20.669406+0000","last_became_active":"2023-08-25T05:19:19.114880+0000","last_became_peered":"2023-08-25T05:19:19.114880+0000","last_unstale":"2023-08-25T05:19:20.669406+0000","last_undegraded":"2023-08-25T05:19:20.669406+0000","last_fullsized":"2023-08-25T05:19:20.669406+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:35:28.182090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"169'1","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102829+0000","last_change":"2023-08-25T05:19:18.091169+0000","last_active":"2023-08-25T05:19:20.102829+0000","last_peered":"2023-08-25T05:19:20.102829+0000","last_clean":"2023-08-25T05:19:20.102829+0000","last_became_active":"2023-08-25T05:19:18.090883+0000","last_became_peered":"2023-08-25T05:19:18.090883+0000","last_unstale":"2023-08-25T05:19:20.102829+0000","last_undegraded":"2023-08-25T05:19:20.102829+0000","last_fullsized":"2023-08-25T05:19:20.102829+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:42:56.038398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101698+0000","last_change":"2023-08-25T05:19:19.103477+0000","last_active":"2023-08-25T05:19:20.101698+0000","last_peered":"2023-08-25T05:19:20.101698+0000","last_clean":"2023-08-25T05:19:20.101698+0000","last_became_active":"2023-08-25T05:19:19.103091+0000","last_became_peered":"2023-08-25T05:19:19.103091+0000","last_unstale":"2023-08-25T05:19:20.101698+0000","last_undegraded":"2023-08-25T05:19:20.101698+0000","last_fullsized":"2023-08-25T05:19:20.101698+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:01:06.559858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"169'1","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100129+0000","last_change":"2023-08-25T05:19:18.095404+0000","last_active":"2023-08-25T05:19:20.100129+0000","last_peered":"2023-08-25T05:19:20.100129+0000","last_clean":"2023-08-25T05:19:20.100129+0000","last_became_active":"2023-08-25T05:19:18.095131+0000","last_became_peered":"2023-08-25T05:19:18.095131+0000","last_unstale":"2023-08-25T05:19:20.100129+0000","last_undegraded":"2023-08-25T05:19:20.100129+0000","last_fullsized":"2023-08-25T05:19:20.100129+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:25:28.110408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670533+0000","last_change":"2023-08-25T05:19:19.104380+0000","last_active":"2023-08-25T05:19:20.670533+0000","last_peered":"2023-08-25T05:19:20.670533+0000","last_clean":"2023-08-25T05:19:20.670533+0000","last_became_active":"2023-08-25T05:19:19.104058+0000","last_became_peered":"2023-08-25T05:19:19.104058+0000","last_unstale":"2023-08-25T05:19:20.670533+0000","last_undegraded":"2023-08-25T05:19:20.670533+0000","last_fullsized":"2023-08-25T05:19:20.670533+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:07:07.905137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386872+0000","last_change":"2023-08-25T05:19:18.100455+0000","last_active":"2023-08-25T05:19:20.386872+0000","last_peered":"2023-08-25T05:19:20.386872+0000","last_clean":"2023-08-25T05:19:20.386872+0000","last_became_active":"2023-08-25T05:19:18.100020+0000","last_became_peered":"2023-08-25T05:19:18.100020+0000","last_unstale":"2023-08-25T05:19:20.386872+0000","last_undegraded":"2023-08-25T05:19:20.386872+0000","last_fullsized":"2023-08-25T05:19:20.386872+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:30:30.194970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386825+0000","last_change":"2023-08-25T05:19:19.104588+0000","last_active":"2023-08-25T05:19:20.386825+0000","last_peered":"2023-08-25T05:19:20.386825+0000","last_clean":"2023-08-25T05:19:20.386825+0000","last_became_active":"2023-08-25T05:19:19.104190+0000","last_became_peered":"2023-08-25T05:19:19.104190+0000","last_unstale":"2023-08-25T05:19:20.386825+0000","last_undegraded":"2023-08-25T05:19:20.386825+0000","last_fullsized":"2023-08-25T05:19:20.386825+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:19:34.804176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.099794+0000","last_change":"2023-08-25T05:19:18.099984+0000","last_active":"2023-08-25T05:19:20.099794+0000","last_peered":"2023-08-25T05:19:20.099794+0000","last_clean":"2023-08-25T05:19:20.099794+0000","last_became_active":"2023-08-25T05:19:18.099639+0000","last_became_peered":"2023-08-25T05:19:18.099639+0000","last_unstale":"2023-08-25T05:19:20.099794+0000","last_undegraded":"2023-08-25T05:19:20.099794+0000","last_fullsized":"2023-08-25T05:19:20.099794+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:43.410039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670547+0000","last_change":"2023-08-25T05:19:19.114870+0000","last_active":"2023-08-25T05:19:20.670547+0000","last_peered":"2023-08-25T05:19:20.670547+0000","last_clean":"2023-08-25T05:19:20.670547+0000","last_became_active":"2023-08-25T05:19:19.114345+0000","last_became_peered":"2023-08-25T05:19:19.114345+0000","last_unstale":"2023-08-25T05:19:20.670547+0000","last_undegraded":"2023-08-25T05:19:20.670547+0000","last_fullsized":"2023-08-25T05:19:20.670547+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:26:19.530079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"169'1","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670084+0000","last_change":"2023-08-25T05:19:18.096880+0000","last_active":"2023-08-25T05:19:20.670084+0000","last_peered":"2023-08-25T05:19:20.670084+0000","last_clean":"2023-08-25T05:19:20.670084+0000","last_became_active":"2023-08-25T05:19:18.096570+0000","last_became_peered":"2023-08-25T05:19:18.096570+0000","last_unstale":"2023-08-25T05:19:20.670084+0000","last_undegraded":"2023-08-25T05:19:20.670084+0000","last_fullsized":"2023-08-25T05:19:20.670084+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:38:43.808966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670858+0000","last_change":"2023-08-25T05:19:19.100758+0000","last_active":"2023-08-25T05:19:20.670858+0000","last_peered":"2023-08-25T05:19:20.670858+0000","last_clean":"2023-08-25T05:19:20.670858+0000","last_became_active":"2023-08-25T05:19:19.100420+0000","last_became_peered":"2023-08-25T05:19:19.100420+0000","last_unstale":"2023-08-25T05:19:20.670858+0000","last_undegraded":"2023-08-25T05:19:20.670858+0000","last_fullsized":"2023-08-25T05:19:20.670858+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:09:39.333299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"169'2","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670653+0000","last_change":"2023-08-25T05:19:18.100557+0000","last_active":"2023-08-25T05:19:20.670653+0000","last_peered":"2023-08-25T05:19:20.670653+0000","last_clean":"2023-08-25T05:19:20.670653+0000","last_became_active":"2023-08-25T05:19:18.100282+0000","last_became_peered":"2023-08-25T05:19:18.100282+0000","last_unstale":"2023-08-25T05:19:20.670653+0000","last_undegraded":"2023-08-25T05:19:20.670653+0000","last_fullsized":"2023-08-25T05:19:20.670653+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:20:03.474378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387190+0000","last_change":"2023-08-25T05:19:19.106251+0000","last_active":"2023-08-25T05:19:20.387190+0000","last_peered":"2023-08-25T05:19:20.387190+0000","last_clean":"2023-08-25T05:19:20.387190+0000","last_became_active":"2023-08-25T05:19:19.105964+0000","last_became_peered":"2023-08-25T05:19:19.105964+0000","last_unstale":"2023-08-25T05:19:20.387190+0000","last_undegraded":"2023-08-25T05:19:20.387190+0000","last_fullsized":"2023-08-25T05:19:20.387190+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:14:57.389520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"169'1","reported_seq":14,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670844+0000","last_change":"2023-08-25T05:19:18.093116+0000","last_active":"2023-08-25T05:19:20.670844+0000","last_peered":"2023-08-25T05:19:20.670844+0000","last_clean":"2023-08-25T05:19:20.670844+0000","last_became_active":"2023-08-25T05:19:18.092653+0000","last_became_peered":"2023-08-25T05:19:18.092653+0000","last_unstale":"2023-08-25T05:19:20.670844+0000","last_undegraded":"2023-08-25T05:19:20.670844+0000","last_fullsized":"2023-08-25T05:19:20.670844+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:05.472719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387368+0000","last_change":"2023-08-25T05:19:19.105286+0000","last_active":"2023-08-25T05:19:20.387368+0000","last_peered":"2023-08-25T05:19:20.387368+0000","last_clean":"2023-08-25T05:19:20.387368+0000","last_became_active":"2023-08-25T05:19:19.104634+0000","last_became_peered":"2023-08-25T05:19:19.104634+0000","last_unstale":"2023-08-25T05:19:20.387368+0000","last_undegraded":"2023-08-25T05:19:20.387368+0000","last_fullsized":"2023-08-25T05:19:20.387368+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:47:08.696601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102178+0000","last_change":"2023-08-25T05:19:18.094164+0000","last_active":"2023-08-25T05:19:20.102178+0000","last_peered":"2023-08-25T05:19:20.102178+0000","last_clean":"2023-08-25T05:19:20.102178+0000","last_became_active":"2023-08-25T05:19:18.093896+0000","last_became_peered":"2023-08-25T05:19:18.093896+0000","last_unstale":"2023-08-25T05:19:20.102178+0000","last_undegraded":"2023-08-25T05:19:20.102178+0000","last_fullsized":"2023-08-25T05:19:20.102178+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:05:08.912305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670476+0000","last_change":"2023-08-25T05:19:19.100598+0000","last_active":"2023-08-25T05:19:20.670476+0000","last_peered":"2023-08-25T05:19:20.670476+0000","last_clean":"2023-08-25T05:19:20.670476+0000","last_became_active":"2023-08-25T05:19:19.100286+0000","last_became_peered":"2023-08-25T05:19:19.100286+0000","last_unstale":"2023-08-25T05:19:20.670476+0000","last_undegraded":"2023-08-25T05:19:20.670476+0000","last_fullsized":"2023-08-25T05:19:20.670476+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:25.142761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"169'2","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669623+0000","last_change":"2023-08-25T05:19:18.095970+0000","last_active":"2023-08-25T05:19:20.669623+0000","last_peered":"2023-08-25T05:19:20.669623+0000","last_clean":"2023-08-25T05:19:20.669623+0000","last_became_active":"2023-08-25T05:19:18.095674+0000","last_became_peered":"2023-08-25T05:19:18.095674+0000","last_unstale":"2023-08-25T05:19:20.669623+0000","last_undegraded":"2023-08-25T05:19:20.669623+0000","last_fullsized":"2023-08-25T05:19:20.669623+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:24:15.408544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670727+0000","last_change":"2023-08-25T05:19:19.108226+0000","last_active":"2023-08-25T05:19:20.670727+0000","last_peered":"2023-08-25T05:19:20.670727+0000","last_clean":"2023-08-25T05:19:20.670727+0000","last_became_active":"2023-08-25T05:19:19.107952+0000","last_became_peered":"2023-08-25T05:19:19.107952+0000","last_unstale":"2023-08-25T05:19:20.670727+0000","last_undegraded":"2023-08-25T05:19:20.670727+0000","last_fullsized":"2023-08-25T05:19:20.670727+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:02:58.784477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102713+0000","last_change":"2023-08-25T05:19:18.085032+0000","last_active":"2023-08-25T05:19:20.102713+0000","last_peered":"2023-08-25T05:19:20.102713+0000","last_clean":"2023-08-25T05:19:20.102713+0000","last_became_active":"2023-08-25T05:19:18.084389+0000","last_became_peered":"2023-08-25T05:19:18.084389+0000","last_unstale":"2023-08-25T05:19:20.102713+0000","last_undegraded":"2023-08-25T05:19:20.102713+0000","last_fullsized":"2023-08-25T05:19:20.102713+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:10:06.746194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670403+0000","last_change":"2023-08-25T05:19:19.097860+0000","last_active":"2023-08-25T05:19:20.670403+0000","last_peered":"2023-08-25T05:19:20.670403+0000","last_clean":"2023-08-25T05:19:20.670403+0000","last_became_active":"2023-08-25T05:19:19.097569+0000","last_became_peered":"2023-08-25T05:19:19.097569+0000","last_unstale":"2023-08-25T05:19:20.670403+0000","last_undegraded":"2023-08-25T05:19:20.670403+0000","last_fullsized":"2023-08-25T05:19:20.670403+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:59:29.544988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669318+0000","last_change":"2023-08-25T05:19:18.095969+0000","last_active":"2023-08-25T05:19:20.669318+0000","last_peered":"2023-08-25T05:19:20.669318+0000","last_clean":"2023-08-25T05:19:20.669318+0000","last_became_active":"2023-08-25T05:19:18.095659+0000","last_became_peered":"2023-08-25T05:19:18.095659+0000","last_unstale":"2023-08-25T05:19:20.669318+0000","last_undegraded":"2023-08-25T05:19:20.669318+0000","last_fullsized":"2023-08-25T05:19:20.669318+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:10:13.656262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.671026+0000","last_change":"2023-08-25T05:19:19.097622+0000","last_active":"2023-08-25T05:19:20.671026+0000","last_peered":"2023-08-25T05:19:20.671026+0000","last_clean":"2023-08-25T05:19:20.671026+0000","last_became_active":"2023-08-25T05:19:19.097309+0000","last_became_peered":"2023-08-25T05:19:19.097309+0000","last_unstale":"2023-08-25T05:19:20.671026+0000","last_undegraded":"2023-08-25T05:19:20.671026+0000","last_fullsized":"2023-08-25T05:19:20.671026+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:32:40.698453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102541+0000","last_change":"2023-08-25T05:19:18.097856+0000","last_active":"2023-08-25T05:19:20.102541+0000","last_peered":"2023-08-25T05:19:20.102541+0000","last_clean":"2023-08-25T05:19:20.102541+0000","last_became_active":"2023-08-25T05:19:18.097185+0000","last_became_peered":"2023-08-25T05:19:18.097185+0000","last_unstale":"2023-08-25T05:19:20.102541+0000","last_undegraded":"2023-08-25T05:19:20.102541+0000","last_fullsized":"2023-08-25T05:19:20.102541+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:46:31.312925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100822+0000","last_change":"2023-08-25T05:19:19.108821+0000","last_active":"2023-08-25T05:19:20.100822+0000","last_peered":"2023-08-25T05:19:20.100822+0000","last_clean":"2023-08-25T05:19:20.100822+0000","last_became_active":"2023-08-25T05:19:19.108491+0000","last_became_peered":"2023-08-25T05:19:19.108491+0000","last_unstale":"2023-08-25T05:19:20.100822+0000","last_undegraded":"2023-08-25T05:19:20.100822+0000","last_fullsized":"2023-08-25T05:19:20.100822+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:32:30.407510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"169'2","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102445+0000","last_change":"2023-08-25T05:19:18.095293+0000","last_active":"2023-08-25T05:19:20.102445+0000","last_peered":"2023-08-25T05:19:20.102445+0000","last_clean":"2023-08-25T05:19:20.102445+0000","last_became_active":"2023-08-25T05:19:18.094917+0000","last_became_peered":"2023-08-25T05:19:18.094917+0000","last_unstale":"2023-08-25T05:19:20.102445+0000","last_undegraded":"2023-08-25T05:19:20.102445+0000","last_fullsized":"2023-08-25T05:19:20.102445+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:22:59.213187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101995+0000","last_change":"2023-08-25T05:19:19.104831+0000","last_active":"2023-08-25T05:19:20.101995+0000","last_peered":"2023-08-25T05:19:20.101995+0000","last_clean":"2023-08-25T05:19:20.101995+0000","last_became_active":"2023-08-25T05:19:19.104547+0000","last_became_peered":"2023-08-25T05:19:19.104547+0000","last_unstale":"2023-08-25T05:19:20.101995+0000","last_undegraded":"2023-08-25T05:19:20.101995+0000","last_fullsized":"2023-08-25T05:19:20.101995+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:10:49.389866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387262+0000","last_change":"2023-08-25T05:19:18.101512+0000","last_active":"2023-08-25T05:19:20.387262+0000","last_peered":"2023-08-25T05:19:20.387262+0000","last_clean":"2023-08-25T05:19:20.387262+0000","last_became_active":"2023-08-25T05:19:18.100932+0000","last_became_peered":"2023-08-25T05:19:18.100932+0000","last_unstale":"2023-08-25T05:19:20.387262+0000","last_undegraded":"2023-08-25T05:19:20.387262+0000","last_fullsized":"2023-08-25T05:19:20.387262+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:36:54.617809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387333+0000","last_change":"2023-08-25T05:19:19.106309+0000","last_active":"2023-08-25T05:19:20.387333+0000","last_peered":"2023-08-25T05:19:20.387333+0000","last_clean":"2023-08-25T05:19:20.387333+0000","last_became_active":"2023-08-25T05:19:19.105633+0000","last_became_peered":"2023-08-25T05:19:19.105633+0000","last_unstale":"2023-08-25T05:19:20.387333+0000","last_undegraded":"2023-08-25T05:19:20.387333+0000","last_fullsized":"2023-08-25T05:19:20.387333+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:42:35.210980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670971+0000","last_change":"2023-08-25T05:19:18.092916+0000","last_active":"2023-08-25T05:19:20.670971+0000","last_peered":"2023-08-25T05:19:20.670971+0000","last_clean":"2023-08-25T05:19:20.670971+0000","last_became_active":"2023-08-25T05:19:18.092251+0000","last_became_peered":"2023-08-25T05:19:18.092251+0000","last_unstale":"2023-08-25T05:19:20.670971+0000","last_undegraded":"2023-08-25T05:19:20.670971+0000","last_fullsized":"2023-08-25T05:19:20.670971+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:06:49.660235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100648+0000","last_change":"2023-08-25T05:19:19.101644+0000","last_active":"2023-08-25T05:19:20.100648+0000","last_peered":"2023-08-25T05:19:20.100648+0000","last_clean":"2023-08-25T05:19:20.100648+0000","last_became_active":"2023-08-25T05:19:19.101339+0000","last_became_peered":"2023-08-25T05:19:19.101339+0000","last_unstale":"2023-08-25T05:19:20.100648+0000","last_undegraded":"2023-08-25T05:19:20.100648+0000","last_fullsized":"2023-08-25T05:19:20.100648+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:30:26.456155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100558+0000","last_change":"2023-08-25T05:19:18.093466+0000","last_active":"2023-08-25T05:19:20.100558+0000","last_peered":"2023-08-25T05:19:20.100558+0000","last_clean":"2023-08-25T05:19:20.100558+0000","last_became_active":"2023-08-25T05:19:18.093177+0000","last_became_peered":"2023-08-25T05:19:18.093177+0000","last_unstale":"2023-08-25T05:19:20.100558+0000","last_undegraded":"2023-08-25T05:19:20.100558+0000","last_fullsized":"2023-08-25T05:19:20.100558+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:42:18.077337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102354+0000","last_change":"2023-08-25T05:19:19.104021+0000","last_active":"2023-08-25T05:19:20.102354+0000","last_peered":"2023-08-25T05:19:20.102354+0000","last_clean":"2023-08-25T05:19:20.102354+0000","last_became_active":"2023-08-25T05:19:19.103708+0000","last_became_peered":"2023-08-25T05:19:19.103708+0000","last_unstale":"2023-08-25T05:19:20.102354+0000","last_undegraded":"2023-08-25T05:19:20.102354+0000","last_fullsized":"2023-08-25T05:19:20.102354+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:40:08.903268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386949+0000","last_change":"2023-08-25T05:19:18.100268+0000","last_active":"2023-08-25T05:19:20.386949+0000","last_peered":"2023-08-25T05:19:20.386949+0000","last_clean":"2023-08-25T05:19:20.386949+0000","last_became_active":"2023-08-25T05:19:18.099889+0000","last_became_peered":"2023-08-25T05:19:18.099889+0000","last_unstale":"2023-08-25T05:19:20.386949+0000","last_undegraded":"2023-08-25T05:19:20.386949+0000","last_fullsized":"2023-08-25T05:19:20.386949+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:29:35.762327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101763+0000","last_change":"2023-08-25T05:19:19.104177+0000","last_active":"2023-08-25T05:19:20.101763+0000","last_peered":"2023-08-25T05:19:20.101763+0000","last_clean":"2023-08-25T05:19:20.101763+0000","last_became_active":"2023-08-25T05:19:19.103862+0000","last_became_peered":"2023-08-25T05:19:19.103862+0000","last_unstale":"2023-08-25T05:19:20.101763+0000","last_undegraded":"2023-08-25T05:19:20.101763+0000","last_fullsized":"2023-08-25T05:19:20.101763+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:16:56.937872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670073+0000","last_change":"2023-08-25T05:19:18.103122+0000","last_active":"2023-08-25T05:19:20.670073+0000","last_peered":"2023-08-25T05:19:20.670073+0000","last_clean":"2023-08-25T05:19:20.670073+0000","last_became_active":"2023-08-25T05:19:18.102803+0000","last_became_peered":"2023-08-25T05:19:18.102803+0000","last_unstale":"2023-08-25T05:19:20.670073+0000","last_undegraded":"2023-08-25T05:19:20.670073+0000","last_fullsized":"2023-08-25T05:19:20.670073+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:43:50.153960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670536+0000","last_change":"2023-08-25T05:19:19.099519+0000","last_active":"2023-08-25T05:19:20.670536+0000","last_peered":"2023-08-25T05:19:20.670536+0000","last_clean":"2023-08-25T05:19:20.670536+0000","last_became_active":"2023-08-25T05:19:19.099205+0000","last_became_peered":"2023-08-25T05:19:19.099205+0000","last_unstale":"2023-08-25T05:19:20.670536+0000","last_undegraded":"2023-08-25T05:19:20.670536+0000","last_fullsized":"2023-08-25T05:19:20.670536+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:55:24.322604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386935+0000","last_change":"2023-08-25T05:19:18.100661+0000","last_active":"2023-08-25T05:19:20.386935+0000","last_peered":"2023-08-25T05:19:20.386935+0000","last_clean":"2023-08-25T05:19:20.386935+0000","last_became_active":"2023-08-25T05:19:18.100392+0000","last_became_peered":"2023-08-25T05:19:18.100392+0000","last_unstale":"2023-08-25T05:19:20.386935+0000","last_undegraded":"2023-08-25T05:19:20.386935+0000","last_fullsized":"2023-08-25T05:19:20.386935+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:11:31.150609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102574+0000","last_change":"2023-08-25T05:19:19.116107+0000","last_active":"2023-08-25T05:19:20.102574+0000","last_peered":"2023-08-25T05:19:20.102574+0000","last_clean":"2023-08-25T05:19:20.102574+0000","last_became_active":"2023-08-25T05:19:19.115467+0000","last_became_peered":"2023-08-25T05:19:19.115467+0000","last_unstale":"2023-08-25T05:19:20.102574+0000","last_undegraded":"2023-08-25T05:19:20.102574+0000","last_fullsized":"2023-08-25T05:19:20.102574+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:02:00.326701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670600+0000","last_change":"2023-08-25T05:19:18.098107+0000","last_active":"2023-08-25T05:19:20.670600+0000","last_peered":"2023-08-25T05:19:20.670600+0000","last_clean":"2023-08-25T05:19:20.670600+0000","last_became_active":"2023-08-25T05:19:18.096554+0000","last_became_peered":"2023-08-25T05:19:18.096554+0000","last_unstale":"2023-08-25T05:19:20.670600+0000","last_undegraded":"2023-08-25T05:19:20.670600+0000","last_fullsized":"2023-08-25T05:19:20.670600+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:32:51.417009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.103100+0000","last_change":"2023-08-25T05:19:19.100511+0000","last_active":"2023-08-25T05:19:20.103100+0000","last_peered":"2023-08-25T05:19:20.103100+0000","last_clean":"2023-08-25T05:19:20.103100+0000","last_became_active":"2023-08-25T05:19:19.100224+0000","last_became_peered":"2023-08-25T05:19:19.100224+0000","last_unstale":"2023-08-25T05:19:20.103100+0000","last_undegraded":"2023-08-25T05:19:20.103100+0000","last_fullsized":"2023-08-25T05:19:20.103100+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:08:47.094804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"169'6","reported_seq":19,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669575+0000","last_change":"2023-08-25T05:19:18.097720+0000","last_active":"2023-08-25T05:19:20.669575+0000","last_peered":"2023-08-25T05:19:20.669575+0000","last_clean":"2023-08-25T05:19:20.669575+0000","last_became_active":"2023-08-25T05:19:18.097437+0000","last_became_peered":"2023-08-25T05:19:18.097437+0000","last_unstale":"2023-08-25T05:19:20.669575+0000","last_undegraded":"2023-08-25T05:19:20.669575+0000","last_fullsized":"2023-08-25T05:19:20.669575+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:27:10.667868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"159'3598","reported_seq":4395,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670815+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:19:20.670815+0000","last_peered":"2023-08-25T05:19:20.670815+0000","last_clean":"2023-08-25T05:19:20.670815+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:19:20.670815+0000","last_undegraded":"2023-08-25T05:19:20.670815+0000","last_fullsized":"2023-08-25T05:19:20.670815+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3598,"log_dups_size":0,"ondisk_log_size":3598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:39:34.018928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1616,"num_read_kb":3373,"num_write":465,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":297,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387034+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:19:20.387034+0000","last_peered":"2023-08-25T05:19:20.387034+0000","last_clean":"2023-08-25T05:19:20.387034+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:19:20.387034+0000","last_undegraded":"2023-08-25T05:19:20.387034+0000","last_fullsized":"2023-08-25T05:19:20.387034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:57:41.321145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.103027+0000","last_change":"2023-08-25T05:19:19.099971+0000","last_active":"2023-08-25T05:19:20.103027+0000","last_peered":"2023-08-25T05:19:20.103027+0000","last_clean":"2023-08-25T05:19:20.103027+0000","last_became_active":"2023-08-25T05:19:19.099675+0000","last_became_peered":"2023-08-25T05:19:19.099675+0000","last_unstale":"2023-08-25T05:19:20.103027+0000","last_undegraded":"2023-08-25T05:19:20.103027+0000","last_fullsized":"2023-08-25T05:19:20.103027+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:01:06.559858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670874+0000","last_change":"2023-08-25T05:19:18.101899+0000","last_active":"2023-08-25T05:19:20.670874+0000","last_peered":"2023-08-25T05:19:20.670874+0000","last_clean":"2023-08-25T05:19:20.670874+0000","last_became_active":"2023-08-25T05:19:18.101630+0000","last_became_peered":"2023-08-25T05:19:18.101630+0000","last_unstale":"2023-08-25T05:19:20.670874+0000","last_undegraded":"2023-08-25T05:19:20.670874+0000","last_fullsized":"2023-08-25T05:19:20.670874+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:00.294806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":294,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670641+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:19:20.670641+0000","last_peered":"2023-08-25T05:19:20.670641+0000","last_clean":"2023-08-25T05:19:20.670641+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:19:20.670641+0000","last_undegraded":"2023-08-25T05:19:20.670641+0000","last_fullsized":"2023-08-25T05:19:20.670641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:21:16.671755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669776+0000","last_change":"2023-08-25T05:19:19.100942+0000","last_active":"2023-08-25T05:19:20.669776+0000","last_peered":"2023-08-25T05:19:20.669776+0000","last_clean":"2023-08-25T05:19:20.669776+0000","last_became_active":"2023-08-25T05:19:19.100643+0000","last_became_peered":"2023-08-25T05:19:19.100643+0000","last_unstale":"2023-08-25T05:19:20.669776+0000","last_undegraded":"2023-08-25T05:19:20.669776+0000","last_fullsized":"2023-08-25T05:19:20.669776+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:03:30.222315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.387360+0000","last_change":"2023-08-25T05:19:18.101699+0000","last_active":"2023-08-25T05:19:20.387360+0000","last_peered":"2023-08-25T05:19:20.387360+0000","last_clean":"2023-08-25T05:19:20.387360+0000","last_became_active":"2023-08-25T05:19:18.101250+0000","last_became_peered":"2023-08-25T05:19:18.101250+0000","last_unstale":"2023-08-25T05:19:20.387360+0000","last_undegraded":"2023-08-25T05:19:20.387360+0000","last_fullsized":"2023-08-25T05:19:20.387360+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:15:02.972695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":301,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669659+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:19:20.669659+0000","last_peered":"2023-08-25T05:19:20.669659+0000","last_clean":"2023-08-25T05:19:20.669659+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:19:20.669659+0000","last_undegraded":"2023-08-25T05:19:20.669659+0000","last_fullsized":"2023-08-25T05:19:20.669659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:28:55.023977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669978+0000","last_change":"2023-08-25T05:19:19.106477+0000","last_active":"2023-08-25T05:19:20.669978+0000","last_peered":"2023-08-25T05:19:20.669978+0000","last_clean":"2023-08-25T05:19:20.669978+0000","last_became_active":"2023-08-25T05:19:19.105841+0000","last_became_peered":"2023-08-25T05:19:19.105841+0000","last_unstale":"2023-08-25T05:19:20.669978+0000","last_undegraded":"2023-08-25T05:19:20.669978+0000","last_fullsized":"2023-08-25T05:19:20.669978+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:26:48.556516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"169'3","reported_seq":16,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.669891+0000","last_change":"2023-08-25T05:19:18.096878+0000","last_active":"2023-08-25T05:19:20.669891+0000","last_peered":"2023-08-25T05:19:20.669891+0000","last_clean":"2023-08-25T05:19:20.669891+0000","last_became_active":"2023-08-25T05:19:18.096598+0000","last_became_peered":"2023-08-25T05:19:18.096598+0000","last_unstale":"2023-08-25T05:19:20.669891+0000","last_undegraded":"2023-08-25T05:19:20.669891+0000","last_fullsized":"2023-08-25T05:19:20.669891+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:14:03.569363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":297,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386771+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:19:20.386771+0000","last_peered":"2023-08-25T05:19:20.386771+0000","last_clean":"2023-08-25T05:19:20.386771+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:19:20.386771+0000","last_undegraded":"2023-08-25T05:19:20.386771+0000","last_fullsized":"2023-08-25T05:19:20.386771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:28:51.230788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102292+0000","last_change":"2023-08-25T05:19:19.101369+0000","last_active":"2023-08-25T05:19:20.102292+0000","last_peered":"2023-08-25T05:19:20.102292+0000","last_clean":"2023-08-25T05:19:20.102292+0000","last_became_active":"2023-08-25T05:19:19.101088+0000","last_became_peered":"2023-08-25T05:19:19.101088+0000","last_unstale":"2023-08-25T05:19:20.102292+0000","last_undegraded":"2023-08-25T05:19:20.102292+0000","last_fullsized":"2023-08-25T05:19:20.102292+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:25:10.949007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"169'2","reported_seq":15,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.100387+0000","last_change":"2023-08-25T05:19:18.093716+0000","last_active":"2023-08-25T05:19:20.100387+0000","last_peered":"2023-08-25T05:19:20.100387+0000","last_clean":"2023-08-25T05:19:20.100387+0000","last_became_active":"2023-08-25T05:19:18.093405+0000","last_became_peered":"2023-08-25T05:19:18.093405+0000","last_unstale":"2023-08-25T05:19:20.100387+0000","last_undegraded":"2023-08-25T05:19:20.100387+0000","last_fullsized":"2023-08-25T05:19:20.100387+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:31:11.585564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":321,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670917+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:19:20.670917+0000","last_peered":"2023-08-25T05:19:20.670917+0000","last_clean":"2023-08-25T05:19:20.670917+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:19:20.670917+0000","last_undegraded":"2023-08-25T05:19:20.670917+0000","last_fullsized":"2023-08-25T05:19:20.670917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:59:33.954297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670543+0000","last_change":"2023-08-25T05:19:19.101066+0000","last_active":"2023-08-25T05:19:20.670543+0000","last_peered":"2023-08-25T05:19:20.670543+0000","last_clean":"2023-08-25T05:19:20.670543+0000","last_became_active":"2023-08-25T05:19:19.100413+0000","last_became_peered":"2023-08-25T05:19:19.100413+0000","last_unstale":"2023-08-25T05:19:20.670543+0000","last_undegraded":"2023-08-25T05:19:20.670543+0000","last_fullsized":"2023-08-25T05:19:20.670543+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:51:57.187189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101945+0000","last_change":"2023-08-25T05:19:18.095988+0000","last_active":"2023-08-25T05:19:20.101945+0000","last_peered":"2023-08-25T05:19:20.101945+0000","last_clean":"2023-08-25T05:19:20.101945+0000","last_became_active":"2023-08-25T05:19:18.095703+0000","last_became_peered":"2023-08-25T05:19:18.095703+0000","last_unstale":"2023-08-25T05:19:20.101945+0000","last_undegraded":"2023-08-25T05:19:20.101945+0000","last_fullsized":"2023-08-25T05:19:20.101945+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:00:07.720641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":293,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670981+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:19:20.670981+0000","last_peered":"2023-08-25T05:19:20.670981+0000","last_clean":"2023-08-25T05:19:20.670981+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:19:20.670981+0000","last_undegraded":"2023-08-25T05:19:20.670981+0000","last_fullsized":"2023-08-25T05:19:20.670981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:08:17.333118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.099924+0000","last_change":"2023-08-25T05:19:19.102358+0000","last_active":"2023-08-25T05:19:20.099924+0000","last_peered":"2023-08-25T05:19:20.099924+0000","last_clean":"2023-08-25T05:19:20.099924+0000","last_became_active":"2023-08-25T05:19:19.102056+0000","last_became_peered":"2023-08-25T05:19:19.102056+0000","last_unstale":"2023-08-25T05:19:20.099924+0000","last_undegraded":"2023-08-25T05:19:20.099924+0000","last_fullsized":"2023-08-25T05:19:20.099924+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:52:53.748952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.101790+0000","last_change":"2023-08-25T05:19:18.094251+0000","last_active":"2023-08-25T05:19:20.101790+0000","last_peered":"2023-08-25T05:19:20.101790+0000","last_clean":"2023-08-25T05:19:20.101790+0000","last_became_active":"2023-08-25T05:19:18.093738+0000","last_became_peered":"2023-08-25T05:19:18.093738+0000","last_unstale":"2023-08-25T05:19:20.101790+0000","last_undegraded":"2023-08-25T05:19:20.101790+0000","last_fullsized":"2023-08-25T05:19:20.101790+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:17.035462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":320,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670955+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:19:20.670955+0000","last_peered":"2023-08-25T05:19:20.670955+0000","last_clean":"2023-08-25T05:19:20.670955+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:19:20.670955+0000","last_undegraded":"2023-08-25T05:19:20.670955+0000","last_fullsized":"2023-08-25T05:19:20.670955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:48:10.515420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.670901+0000","last_change":"2023-08-25T05:19:19.110969+0000","last_active":"2023-08-25T05:19:20.670901+0000","last_peered":"2023-08-25T05:19:20.670901+0000","last_clean":"2023-08-25T05:19:20.670901+0000","last_became_active":"2023-08-25T05:19:19.110658+0000","last_became_peered":"2023-08-25T05:19:19.110658+0000","last_unstale":"2023-08-25T05:19:20.670901+0000","last_undegraded":"2023-08-25T05:19:20.670901+0000","last_fullsized":"2023-08-25T05:19:20.670901+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":168,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:18.065974+0000","last_clean_scrub_stamp":"2023-08-25T05:19:18.065974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:18:12.887154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"169'8","reported_seq":21,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.386584+0000","last_change":"2023-08-25T05:19:18.103067+0000","last_active":"2023-08-25T05:19:20.386584+0000","last_peered":"2023-08-25T05:19:20.386584+0000","last_clean":"2023-08-25T05:19:20.386584+0000","last_became_active":"2023-08-25T05:19:18.102725+0000","last_became_peered":"2023-08-25T05:19:18.102725+0000","last_unstale":"2023-08-25T05:19:20.386584+0000","last_undegraded":"2023-08-25T05:19:20.386584+0000","last_fullsized":"2023-08-25T05:19:20.386584+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:19:17.055494+0000","last_clean_scrub_stamp":"2023-08-25T05:19:17.055494+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:47:24.864465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":340,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-08-25T05:19:20.102822+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:19:20.102822+0000","last_peered":"2023-08-25T05:19:20.102822+0000","last_clean":"2023-08-25T05:19:20.102822+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:19:20.102822+0000","last_undegraded":"2023-08-25T05:19:20.102822+0000","last_fullsized":"2023-08-25T05:19:20.102822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:15:58.285824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1616,"num_read_kb":3373,"num_write":465,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3598,"ondisk_log_size":3598,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510355,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51876,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319964,"statfs":{"total":96636764160,"available":96583643136,"internally_reserved":0,"allocated":2711552,"data_stored":1657225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73499999999999999,"15min":0.73599999999999999},"min":{"1min":0.51000000000000001,"5min":0.433,"15min":0.433},"max":{"1min":0.89000000000000001,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.47799999999999998,"15min":0.38500000000000001},"max":{"1min":0.98299999999999998,"5min":1.0069999999999999,"15min":1.0089999999999999},"last":0.55700000000000005}]},{"osd":1,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.96999999999999997,"5min":0.99399999999999999,"15min":1.0629999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.45100000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0329999999999999,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.745,"15min":0.748},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.46200000000000002},"max":{"1min":0.95699999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.54400000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0109999999999999,"5min":1.405,"15min":1.405},"last":0.626}]},{"osd":3,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.496},"max":{"1min":0.92600000000000005,"5min":1.0409999999999999,"15min":1.0469999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.752,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84599999999999997,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82999999999999996,"5min":0.96499999999999997,"15min":0.97499999999999998},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63700000000000001,"15min":0.627},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82899999999999996,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66700000000000004,"15min":0.67200000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.90300000000000002,"5min":0.97899999999999998,"15min":1.0309999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Aug 25 05:18:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.72599999999999998,"15min":0.71699999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94099999999999995,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69399999999999995,"15min":0.69299999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.45100000000000001},"max":{"1min":0.874,"5min":0.996,"15min":1.0649999999999999},"last":0.84099999999999997}]}]},{"osd":6,"up_from":15,"seq":64424510356,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29092,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342748,"statfs":{"total":96636764160,"available":96606973952,"internally_reserved":0,"allocated":2117632,"data_stored":1066905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.71699999999999997,"15min":0.73899999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91100000000000003,"5min":0.96799999999999997,"15min":1.2070000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.432,"5min":0.42699999999999999,"15min":0.41299999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.73299999999999998,"15min":0.73599999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.85499999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.74099999999999999,"15min":0.75},"min":{"1min":0.441,"5min":0.441,"15min":0.42999999999999999},"max":{"1min":0.94599999999999995,"5min":1.0169999999999999,"15min":1.3009999999999999},"last":0.56200000000000006}]},{"osd":2,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.77900000000000003},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.94899999999999995,"5min":0.95699999999999996,"15min":1.1240000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.92700000000000005,"5min":1.0249999999999999,"15min":1.0549999999999999},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.75800000000000001,"15min":0.76600000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.499},"max":{"1min":0.82699999999999996,"5min":1.0229999999999999,"15min":1.6020000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.77200000000000002,"15min":0.77400000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.84799999999999998,"5min":1.004,"15min":1.1519999999999999},"last":0.67900000000000005}]},{"osd":4,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60999999999999999,"15min":0.61399999999999999},"min":{"1min":0.39500000000000002,"5min":0.39300000000000002,"15min":0.375},"max":{"1min":0.81699999999999995,"5min":0.95099999999999996,"15min":1.2589999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.628,"15min":0.62},"min":{"1min":0.44400000000000001,"5min":0.42999999999999999,"15min":0.373},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.571},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65400000000000003,"15min":0.65800000000000003},"min":{"1min":0.42099999999999999,"5min":0.41399999999999998,"15min":0.40799999999999997},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.0269999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.75,"15min":0.746},"min":{"1min":0.503,"5min":0.46999999999999997,"15min":0.44800000000000001},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.3380000000000001},"last":0.84899999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:19:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68799999999999994,"15min":0.66800000000000004},"min":{"1min":0.46500000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.0740000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70099999999999996,"15min":0.69299999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90300000000000002,"5min":1.038,"15min":1.667},"last":0.751}]}]},{"osd":5,"up_from":14,"seq":60129543058,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55452,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316388,"statfs":{"total":96636764160,"available":96579981312,"internally_reserved":0,"allocated":2113536,"data_stored":1066835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":54655243},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":1.175,"15min":1.175},"last":0.878},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.73899999999999999,"15min":0.749},"min":{"1min":0.441,"5min":0.441,"15min":0.41599999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.0620000000000001},"last":0.85399999999999998}]},{"osd":1,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72599999999999998,"15min":0.748},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.96099999999999997,"5min":1.02,"15min":1.042},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.76100000000000001,"15min":0.76400000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.94699999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.94299999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90600000000000003,"5min":1.0349999999999999,"15min":1.038},"last":0.96099999999999997}]},{"osd":3,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.755,"15min":0.76100000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.86599999999999999,"5min":1.131,"15min":1.131},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.88600000000000001,"5min":1.032,"15min":1.073},"last":0.98399999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:19:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.61799999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Fri Aug 25 05:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.67300000000000004,"15min":0.66300000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.39700000000000002},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68400000000000005,"15min":0.67100000000000004},"min":{"1min":0.496,"5min":0.47299999999999998,"15min":0.41799999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.91400000000000003}]},{"osd":7,"last update":"Fri Aug 25 05:19:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.66300000000000003,"15min":0.63700000000000001},"min":{"1min":0.47999999999999998,"5min":0.42799999999999999,"15min":0.32100000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73099999999999998,"15min":0.71499999999999997},"min":{"1min":0.56799999999999995,"5min":0.48199999999999998,"15min":0.45100000000000001},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.79900000000000004}]}]},{"osd":4,"up_from":14,"seq":60129543059,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41576,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330264,"statfs":{"total":96636764160,"available":96594190336,"internally_reserved":0,"allocated":2125824,"data_stored":1068447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.746,"15min":0.73599999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91200000000000003,"5min":1.0509999999999999,"15min":1.0720000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.79700000000000004,"5min":0.96399999999999997,"15min":0.96999999999999997},"last":0.73499999999999999}]},{"osd":1,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.75900000000000001,"15min":0.76000000000000001},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93000000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.752,"15min":0.755},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89800000000000002,"5min":1.008,"15min":1.0660000000000001},"last":0.754}]},{"osd":2,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.76000000000000001,"15min":0.76700000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.97099999999999997,"5min":1.002,"15min":1.0669999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.76300000000000001,"15min":0.76500000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47199999999999998},"max":{"1min":0.84399999999999997,"5min":1.093,"15min":1.093},"last":0.81599999999999995}]},{"osd":3,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.78200000000000003,"15min":0.77500000000000002},"min":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.51700000000000002},"max":{"1min":1.0129999999999999,"5min":1.0369999999999999,"15min":1.044},"last":0.88},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89500000000000002,"5min":1.048,"15min":1.1180000000000001},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.56999999999999995,"15min":0.55500000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.751,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.61099999999999999,"15min":0.59699999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.0449999999999999},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.746,"15min":0.73899999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.66000000000000003,"15min":0.66200000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.90000000000000002}]},{"osd":7,"last update":"Fri Aug 25 05:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.628,"15min":0.624},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94399999999999995},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":0.70499999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.46100000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.91800000000000004}]}]},{"osd":3,"up_from":14,"seq":60129543059,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59628,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312212,"statfs":{"total":96636764160,"available":96575705088,"internally_reserved":0,"allocated":2121728,"data_stored":1067451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.45400000000000001,"15min":0.46800000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.499}]},{"osd":1,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.72999999999999998,"5min":0.871,"15min":0.92700000000000005},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.628,"15min":0.63100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.88100000000000001,"15min":0.96199999999999997},"last":0.56699999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.59199999999999997,"15min":0.60599999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73999999999999999,"5min":0.85099999999999998,"15min":0.89400000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73899999999999999,"5min":0.85599999999999998,"15min":0.89400000000000002},"last":0.59199999999999997}]},{"osd":4,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.81200000000000006,"15min":0.80300000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0900000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81200000000000006,"15min":0.83399999999999996},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.97599999999999998,"5min":1.2050000000000001,"15min":1.3220000000000001},"last":0.75600000000000001}]},{"osd":5,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.81100000000000005,"15min":0.81799999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.054,"5min":1.1830000000000001,"15min":1.2749999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.82099999999999995,"15min":0.82899999999999996},"min":{"1min":0.58899999999999997,"5min":0.58399999999999996,"15min":0.58299999999999996},"max":{"1min":1.1619999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.93100000000000005}]},{"osd":6,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.85899999999999999,"15min":0.86199999999999999},"min":{"1min":0.58599999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.113,"5min":1.357,"15min":1.357},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.83499999999999996,"15min":0.83899999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.085,"5min":1.274,"15min":1.274},"last":0.79700000000000004}]},{"osd":7,"last update":"Fri Aug 25 05:19:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.872,"15min":0.875},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.115,"5min":1.29,"15min":1.2929999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.82299999999999995,"15min":0.82699999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1339999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.83899999999999997}]}]},{"osd":2,"up_from":14,"seq":60129543060,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59624,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312216,"statfs":{"total":96636764160,"available":96575709184,"internally_reserved":0,"allocated":2121728,"data_stored":1066947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.28799999999999998},"max":{"1min":0.66000000000000003,"5min":0.72599999999999998,"15min":0.76800000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.51800000000000002}]},{"osd":1,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33200000000000002},"max":{"1min":0.69599999999999995,"5min":0.76300000000000001,"15min":0.77600000000000002},"last":0.497},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.628},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55500000000000005,"15min":0.55000000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.67300000000000004,"5min":0.78100000000000003,"15min":0.83599999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82899999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.85099999999999998,"15min":0.83599999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1870000000000001,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.48299999999999998},"max":{"1min":1.089,"5min":1.163,"15min":1.163},"last":0.73099999999999998}]},{"osd":5,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.82599999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.54300000000000004},"max":{"1min":1.113,"5min":1.393,"15min":1.393},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.53900000000000003},"max":{"1min":1.2310000000000001,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.88200000000000001,"15min":0.85999999999999999},"min":{"1min":0.63800000000000001,"5min":0.63700000000000001,"15min":0.58699999999999997},"max":{"1min":1.169,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.88900000000000001,"15min":0.89400000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.1910000000000001,"5min":1.2529999999999999,"15min":1.369},"last":0.749}]},{"osd":7,"last update":"Fri Aug 25 05:18:36 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84899999999999998,"15min":0.82999999999999996},"min":{"1min":0.68799999999999994,"5min":0.621,"15min":0.54300000000000004},"max":{"1min":1.131,"5min":1.292,"15min":1.292},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.85399999999999998,"15min":0.83799999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.125,"5min":1.1870000000000001,"15min":1.254},"last":0.79100000000000004}]}]},{"osd":1,"up_from":14,"seq":60129543060,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37416,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334424,"statfs":{"total":96636764160,"available":96598450176,"internally_reserved":0,"allocated":2117632,"data_stored":1066905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36174091},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.49099999999999999,"15min":0.48299999999999998},"min":{"1min":0.32300000000000001,"5min":0.32100000000000001,"15min":0.30199999999999999},"max":{"1min":0.68200000000000005,"5min":0.752,"15min":0.91700000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34399999999999997},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.88700000000000001},"last":0.42499999999999999}]},{"osd":2,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73699999999999999,"5min":0.749,"15min":0.78900000000000003},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58599999999999997,"15min":0.57799999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.38}]},{"osd":3,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64800000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82299999999999995,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.437,"5min":0.435,"15min":0.40600000000000003},"max":{"1min":0.86799999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.52500000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.55300000000000005,"5min":0.52900000000000003,"15min":0.499},"max":{"1min":0.97899999999999998,"5min":1.0680000000000001,"15min":1.212},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.83099999999999996,"15min":0.82499999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.55700000000000005},"max":{"1min":1.0229999999999999,"5min":1.0429999999999999,"15min":1.163},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.52900000000000003},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.81999999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.083,"5min":1.115,"15min":1.171},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86499999999999999,"15min":0.84599999999999997},"min":{"1min":0.64400000000000002,"5min":0.627,"15min":0.51500000000000001},"max":{"1min":1.107,"5min":1.1579999999999999,"15min":1.3700000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83299999999999996,"15min":0.83399999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.1830000000000001},"last":0.67800000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83699999999999997,"15min":0.84199999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.044,"5min":1.1659999999999999,"15min":1.3320000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.58899999999999997},"max":{"1min":1.115,"5min":1.115,"15min":1.268},"last":0.73099999999999998}]}]},{"osd":0,"up_from":14,"seq":60129543059,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60220,"kb_used_data":2668,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311620,"statfs":{"total":96636764160,"available":96575098880,"internally_reserved":0,"allocated":2732032,"data_stored":1659521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.49199999999999999,"15min":0.50600000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77500000000000002,"5min":0.79600000000000004,"15min":0.82599999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.56799999999999995,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.64500000000000002,"5min":0.876,"15min":0.876},"last":0.623}]},{"osd":2,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71499999999999997,"5min":0.82899999999999996,"15min":0.90700000000000003},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.57699999999999996,"5min":0.83099999999999996,"15min":0.86099999999999999},"last":0.57199999999999995}]},{"osd":3,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.499,"15min":0.50900000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.60199999999999998,"5min":0.93799999999999994,"15min":1.0409999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.59399999999999997,"15min":0.61099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79900000000000004,"5min":0.878,"15min":0.878},"last":0.72899999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.92900000000000005,"5min":1.2649999999999999,"15min":1.3740000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.125,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.78100000000000003}]},{"osd":5,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.78500000000000003,"15min":0.79900000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.46100000000000002},"max":{"1min":1.012,"5min":1.0820000000000001,"15min":1.2210000000000001},"last":0.749},{"interface":"front","average":{"1min":0.747,"5min":0.80900000000000005,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.3260000000000001},"last":0.86399999999999999}]},{"osd":6,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.80500000000000005,"15min":0.81399999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.89600000000000002,"5min":1.196,"15min":1.196},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.83399999999999996,"15min":0.84999999999999998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0589999999999999,"5min":1.216,"15min":1.2849999999999999},"last":0.80800000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.85099999999999998,"15min":0.86299999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.149,"5min":1.22,"15min":1.2410000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.81899999999999995,"15min":0.83599999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.95999999999999996,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.83499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:19:28.166 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-25T05:19:28.167 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-25T05:19:28.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.344+0000 7fa241e9c640 1 Processor -- start 2023-08-25T05:19:28.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.344+0000 7fa241e9c640 1 -- start start 2023-08-25T05:19:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.344+0000 7fa241e9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa23c0c9900 0x7fa23c0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.344+0000 7fa241e9c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa23c06c720 0x7fa23c06cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.344+0000 7fa241e9c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23c0c9d90 con 0x7fa23c0cb020 2023-08-25T05:19:28.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.344+0000 7fa241e9c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23c06d0d0 con 0x7fa23c06c720 2023-08-25T05:19:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.344+0000 7fa241e9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0cbca0 con 0x7fa23c0c9900 2023-08-25T05:19:28.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.344+0000 7fa23bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa23c06c720 0x7fa23c06cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.344+0000 7fa23bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa23c06c720 0x7fa23c06cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51228/0 (socket says 172.21.15.55:51228) 2023-08-25T05:19:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.344+0000 7fa23bfff640 1 -- 172.21.15.55:0/678986550 learned_addr learned my addr 172.21.15.55:0/678986550 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.344+0000 7fa233fff640 1 --2- 172.21.15.55:0/678986550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa23c0c9900 0x7fa23c0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.344+0000 7fa23bfff640 1 -- 172.21.15.55:0/678986550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa23c0c9900 msgr2=0x7fa23c0cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.344+0000 7fa23bfff640 1 --2- 172.21.15.55:0/678986550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa23c0c9900 0x7fa23c0cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.344+0000 7fa23bfff640 1 -- 172.21.15.55:0/678986550 >> v1:172.21.15.110:6789/0 conn(0x7fa23c0cb020 legacy=0x7fa23c0cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:28.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.344+0000 7fa23bfff640 1 -- 172.21.15.55:0/678986550 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c0c9470 con 0x7fa23c06c720 2023-08-25T05:19:28.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.348+0000 7fa23bfff640 1 --2- 172.21.15.55:0/678986550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa23c06c720 0x7fa23c06cb90 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fa23400d150 tx=0x7fa23401eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63bca3ba5c79f67 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:28.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.348+0000 7fa23affd640 1 -- 172.21.15.55:0/678986550 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23400b2d0 con 0x7fa23c06c720 2023-08-25T05:19:28.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.348+0000 7fa23affd640 1 -- 172.21.15.55:0/678986550 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23400b430 con 0x7fa23c06c720 2023-08-25T05:19:28.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.348+0000 7fa23affd640 1 -- 172.21.15.55:0/678986550 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2340a7a70 con 0x7fa23c06c720 2023-08-25T05:19:28.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.348+0000 7fa241e9c640 1 -- 172.21.15.55:0/678986550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa23c06c720 msgr2=0x7fa23c06cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:28.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.348+0000 7fa241e9c640 1 --2- 172.21.15.55:0/678986550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa23c06c720 0x7fa23c06cb90 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fa23400d150 tx=0x7fa23401eb80 comp rx=0 tx=0).stop 2023-08-25T05:19:28.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.348+0000 7fa241e9c640 1 -- 172.21.15.55:0/678986550 shutdown_connections 2023-08-25T05:19:28.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.348+0000 7fa241e9c640 1 --2- 172.21.15.55:0/678986550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa23c06c720 0x7fa23c06cb90 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.348+0000 7fa241e9c640 1 --2- 172.21.15.55:0/678986550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa23c0c9900 0x7fa23c0cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.348+0000 7fa241e9c640 1 -- 172.21.15.55:0/678986550 >> 172.21.15.55:0/678986550 conn(0x7fa23c069900 msgr2=0x7fa23c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:28.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.348+0000 7fa241e9c640 1 -- 172.21.15.55:0/678986550 shutdown_connections 2023-08-25T05:19:28.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.348+0000 7fa241e9c640 1 -- 172.21.15.55:0/678986550 wait complete. 2023-08-25T05:19:28.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa241e9c640 1 Processor -- start 2023-08-25T05:19:28.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa241e9c640 1 -- start start 2023-08-25T05:19:28.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa241e9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa23c06c720 0x7fa23c157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:28.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa241e9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa23c0c9900 0x7fa23c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:28.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa241e9c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa23c0cb020 0x7fa23c06b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:28.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa241e9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c158450 con 0x7fa23c0c9900 2023-08-25T05:19:28.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa241e9c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c09b740 con 0x7fa23c0cb020 2023-08-25T05:19:28.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa241e9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23c0b0240 con 0x7fa23c06c720 2023-08-25T05:19:28.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa233fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa23c0c9900 0x7fa23c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:28.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa233fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa23c0c9900 0x7fa23c0b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51230/0 (socket says 172.21.15.55:51230) 2023-08-25T05:19:28.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa233fff640 1 -- 172.21.15.55:0/2792522298 learned_addr learned my addr 172.21.15.55:0/2792522298 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:28.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa23b7fe640 1 --2- 172.21.15.55:0/2792522298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa23c06c720 0x7fa23c157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:28.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa23bfff640 1 --2- 172.21.15.55:0/2792522298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa23c0cb020 0x7fa23c06b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:28.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa233fff640 1 -- 172.21.15.55:0/2792522298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa23c06c720 msgr2=0x7fa23c157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:28.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa233fff640 1 --2- 172.21.15.55:0/2792522298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa23c06c720 0x7fa23c157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa233fff640 1 -- 172.21.15.55:0/2792522298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa23c0cb020 msgr2=0x7fa23c06b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:28.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa233fff640 1 --2- 172.21.15.55:0/2792522298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa23c0cb020 0x7fa23c06b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa233fff640 1 -- 172.21.15.55:0/2792522298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23400bd40 con 0x7fa23c0c9900 2023-08-25T05:19:28.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa233fff640 1 --2- 172.21.15.55:0/2792522298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa23c0c9900 0x7fa23c0b0630 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fa22400e930 tx=0x7fa22400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:28.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa238ff9640 1 -- 172.21.15.55:0/2792522298 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224009690 con 0x7fa23c0c9900 2023-08-25T05:19:28.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa238ff9640 1 -- 172.21.15.55:0/2792522298 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22400ca00 con 0x7fa23c0c9900 2023-08-25T05:19:28.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa238ff9640 1 -- 172.21.15.55:0/2792522298 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22400cd70 con 0x7fa23c0c9900 2023-08-25T05:19:28.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa241e9c640 1 -- 172.21.15.55:0/2792522298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23c099d20 con 0x7fa23c0c9900 2023-08-25T05:19:28.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.352+0000 7fa241e9c640 1 -- 172.21.15.55:0/2792522298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23c0af250 con 0x7fa23c0c9900 2023-08-25T05:19:28.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.356+0000 7fa241e9c640 1 -- 172.21.15.55:0/2792522298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23c073ec0 con 0x7fa23c0c9900 2023-08-25T05:19:28.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.356+0000 7fa238ff9640 1 -- 172.21.15.55:0/2792522298 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fa224013470 con 0x7fa23c0c9900 2023-08-25T05:19:28.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.356+0000 7fa238ff9640 1 --2- 172.21.15.55:0/2792522298 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa21c0657a0 0x7fa21c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:28.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.356+0000 7fa238ff9640 1 -- 172.21.15.55:0/2792522298 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa2240835e0 con 0x7fa23c0c9900 2023-08-25T05:19:28.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.356+0000 7fa23b7fe640 1 --2- 172.21.15.55:0/2792522298 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa21c0657a0 0x7fa21c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:28.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.356+0000 7fa23b7fe640 1 --2- 172.21.15.55:0/2792522298 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa21c0657a0 0x7fa21c067c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa23c06c1f0 tx=0x7fa22c009040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:28.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.360+0000 7fa238ff9640 1 -- 172.21.15.55:0/2792522298 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa224050fb0 con 0x7fa23c0c9900 2023-08-25T05:19:28.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.568+0000 7fa241e9c640 1 -- 172.21.15.55:0/2792522298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa23c0cc230 con 0x7fa23c0c9900 2023-08-25T05:19:28.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.576+0000 7fa238ff9640 1 -- 172.21.15.55:0/2792522298 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v42) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa2240545d0 con 0x7fa23c0c9900 2023-08-25T05:19:28.580 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2023-08-25T05:19:28.580 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g== 2023-08-25T05:19:28.581 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2023-08-25T05:19:28.581 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2023-08-25T05:19:28.581 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-25T05:19:28.582 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-08-25T05:19:28.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.576+0000 7fa241e9c640 1 -- 172.21.15.55:0/2792522298 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa21c0657a0 msgr2=0x7fa21c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:28.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.576+0000 7fa241e9c640 1 --2- 172.21.15.55:0/2792522298 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa21c0657a0 0x7fa21c067c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa23c06c1f0 tx=0x7fa22c009040 comp rx=0 tx=0).stop 2023-08-25T05:19:28.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.576+0000 7fa241e9c640 1 -- 172.21.15.55:0/2792522298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa23c0c9900 msgr2=0x7fa23c0b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:28.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.576+0000 7fa241e9c640 1 --2- 172.21.15.55:0/2792522298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa23c0c9900 0x7fa23c0b0630 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fa22400e930 tx=0x7fa22400edf0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.576+0000 7fa241e9c640 1 -- 172.21.15.55:0/2792522298 shutdown_connections 2023-08-25T05:19:28.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.576+0000 7fa241e9c640 1 --2- 172.21.15.55:0/2792522298 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fa21c0657a0 0x7fa21c067c60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.576+0000 7fa241e9c640 1 --2- 172.21.15.55:0/2792522298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa23c0cb020 0x7fa23c06b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.576+0000 7fa241e9c640 1 --2- 172.21.15.55:0/2792522298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa23c0c9900 0x7fa23c0b0630 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.576+0000 7fa241e9c640 1 --2- 172.21.15.55:0/2792522298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa23c06c720 0x7fa23c157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.576+0000 7fa241e9c640 1 -- 172.21.15.55:0/2792522298 >> 172.21.15.55:0/2792522298 conn(0x7fa23c069900 msgr2=0x7fa23c070750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:28.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.576+0000 7fa241e9c640 1 -- 172.21.15.55:0/2792522298 shutdown_connections 2023-08-25T05:19:28.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.576+0000 7fa241e9c640 1 -- 172.21.15.55:0/2792522298 wait complete. 2023-08-25T05:19:28.601 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:19:28.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.740+0000 7f1c1f848640 1 Processor -- start 2023-08-25T05:19:28.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.740+0000 7f1c1f848640 1 -- start start 2023-08-25T05:19:28.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.740+0000 7f1c1f848640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1c18164410 0x7f1c180b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:28.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.740+0000 7f1c1f848640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c180cddf0 0x7f1c180c1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:28.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.740+0000 7f1c1f848640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c180cc510 con 0x7f1c180c18b0 2023-08-25T05:19:28.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.740+0000 7f1c1f848640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c180c1d60 con 0x7f1c18164410 2023-08-25T05:19:28.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.740+0000 7f1c1f848640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c181647f0 con 0x7f1c180cddf0 2023-08-25T05:19:28.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.740+0000 7f1c1d5e4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1c18164410 0x7f1c180b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:28.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.740+0000 7f1c1d5e4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1c18164410 0x7f1c180b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51242/0 (socket says 172.21.15.55:51242) 2023-08-25T05:19:28.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.740+0000 7f1c1d5e4640 1 -- 172.21.15.55:0/561083603 learned_addr learned my addr 172.21.15.55:0/561083603 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:28.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.744+0000 7f1c1cde3640 1 --2- 172.21.15.55:0/561083603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c180cddf0 0x7f1c180c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:28.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.744+0000 7f1c1d5e4640 1 -- 172.21.15.55:0/561083603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c180cddf0 msgr2=0x7f1c180c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:28.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.744+0000 7f1c1d5e4640 1 --2- 172.21.15.55:0/561083603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c180cddf0 0x7f1c180c1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.744+0000 7f1c1d5e4640 1 -- 172.21.15.55:0/561083603 >> v1:172.21.15.110:6789/0 conn(0x7f1c180c18b0 legacy=0x7f1c180cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:28.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.744+0000 7f1c1d5e4640 1 -- 172.21.15.55:0/561083603 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c180cc9b0 con 0x7f1c18164410 2023-08-25T05:19:28.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.744+0000 7f1c1d5e4640 1 --2- 172.21.15.55:0/561083603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c18164410 0x7f1c180b21b0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009870 tx=0x7f1c1401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd6b5240ac278ac server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:28.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.744+0000 7f1c0ffff640 1 -- 172.21.15.55:0/561083603 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140ab600 con 0x7f1c18164410 2023-08-25T05:19:28.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.744+0000 7f1c0ffff640 1 -- 172.21.15.55:0/561083603 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c140a7050 con 0x7f1c18164410 2023-08-25T05:19:28.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.744+0000 7f1c0ffff640 1 -- 172.21.15.55:0/561083603 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140ab980 con 0x7f1c18164410 2023-08-25T05:19:28.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.744+0000 7f1c1f848640 1 -- 172.21.15.55:0/561083603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c18164410 msgr2=0x7f1c180b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:28.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.744+0000 7f1c1f848640 1 --2- 172.21.15.55:0/561083603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c18164410 0x7f1c180b21b0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009870 tx=0x7f1c1401c540 comp rx=0 tx=0).stop 2023-08-25T05:19:28.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.744+0000 7f1c1f848640 1 -- 172.21.15.55:0/561083603 shutdown_connections 2023-08-25T05:19:28.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.744+0000 7f1c1f848640 1 --2- 172.21.15.55:0/561083603 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c180cddf0 0x7f1c180c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.744+0000 7f1c1f848640 1 --2- 172.21.15.55:0/561083603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c18164410 0x7f1c180b21b0 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.744+0000 7f1c1f848640 1 -- 172.21.15.55:0/561083603 >> 172.21.15.55:0/561083603 conn(0x7f1c18069d00 msgr2=0x7f1c1806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:28.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1f848640 1 -- 172.21.15.55:0/561083603 shutdown_connections 2023-08-25T05:19:28.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1f848640 1 -- 172.21.15.55:0/561083603 wait complete. 2023-08-25T05:19:28.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1f848640 1 Processor -- start 2023-08-25T05:19:28.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1f848640 1 -- start start 2023-08-25T05:19:28.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1f848640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c180c18b0 0x7f1c180ac160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:28.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1f848640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c180cddf0 0x7f1c180ab920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:28.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1f848640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c18164410 0x7f1c18163180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:28.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1f848640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c180ab500 con 0x7f1c180cddf0 2023-08-25T05:19:28.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1f848640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c180ad130 con 0x7f1c18164410 2023-08-25T05:19:28.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1f848640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c180ac6a0 con 0x7f1c180c18b0 2023-08-25T05:19:28.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1cde3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c180cddf0 0x7f1c180ab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:28.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1cde3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c180cddf0 0x7f1c180ab920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51250/0 (socket says 172.21.15.55:51250) 2023-08-25T05:19:28.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1cde3640 1 -- 172.21.15.55:0/2387904049 learned_addr learned my addr 172.21.15.55:0/2387904049 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:28.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1d5e4640 1 --2- 172.21.15.55:0/2387904049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c180c18b0 0x7f1c180ac160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:28.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1dde5640 1 --2- 172.21.15.55:0/2387904049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c18164410 0x7f1c18163180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:28.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1cde3640 1 -- 172.21.15.55:0/2387904049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c180c18b0 msgr2=0x7f1c180ac160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:28.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1cde3640 1 --2- 172.21.15.55:0/2387904049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c180c18b0 0x7f1c180ac160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1cde3640 1 -- 172.21.15.55:0/2387904049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c18164410 msgr2=0x7f1c18163180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:28.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1cde3640 1 --2- 172.21.15.55:0/2387904049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c18164410 0x7f1c18163180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1cde3640 1 -- 172.21.15.55:0/2387904049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c140094d0 con 0x7f1c180cddf0 2023-08-25T05:19:28.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.748+0000 7f1c1cde3640 1 --2- 172.21.15.55:0/2387904049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c180cddf0 0x7f1c180ab920 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800d7d0 tx=0x7f1c0800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:28.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.752+0000 7f1c0dffb640 1 -- 172.21.15.55:0/2387904049 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c08018070 con 0x7f1c180cddf0 2023-08-25T05:19:28.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.752+0000 7f1c0dffb640 1 -- 172.21.15.55:0/2387904049 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c08004020 con 0x7f1c180cddf0 2023-08-25T05:19:28.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.752+0000 7f1c0dffb640 1 -- 172.21.15.55:0/2387904049 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c080041d0 con 0x7f1c180cddf0 2023-08-25T05:19:28.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.752+0000 7f1c1f848640 1 -- 172.21.15.55:0/2387904049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c180acb70 con 0x7f1c180cddf0 2023-08-25T05:19:28.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.752+0000 7f1c1f848640 1 -- 172.21.15.55:0/2387904049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c180ab120 con 0x7f1c180cddf0 2023-08-25T05:19:28.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.752+0000 7f1c1f848640 1 -- 172.21.15.55:0/2387904049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c180ab640 con 0x7f1c180cddf0 2023-08-25T05:19:28.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.752+0000 7f1c0dffb640 1 -- 172.21.15.55:0/2387904049 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f1c08004330 con 0x7f1c180cddf0 2023-08-25T05:19:28.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.752+0000 7f1c0dffb640 1 --2- 172.21.15.55:0/2387904049 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f1bfc0657a0 0x7f1bfc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:28.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.752+0000 7f1c0dffb640 1 -- 172.21.15.55:0/2387904049 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1c08082e00 con 0x7f1c180cddf0 2023-08-25T05:19:28.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.752+0000 7f1c1d5e4640 1 --2- 172.21.15.55:0/2387904049 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f1bfc0657a0 0x7f1bfc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:28.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.756+0000 7f1c1d5e4640 1 --2- 172.21.15.55:0/2387904049 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f1bfc0657a0 0x7f1bfc067c60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1c140ad000 tx=0x7f1c140a6000 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:28.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.756+0000 7f1c0dffb640 1 -- 172.21.15.55:0/2387904049 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1c180ab640 con 0x7f1c180cddf0 2023-08-25T05:19:28.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.944+0000 7f1c1f848640 1 -- 172.21.15.55:0/2387904049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c180ab640 con 0x7f1c180cddf0 2023-08-25T05:19:28.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.944+0000 7f1c0dffb640 1 -- 172.21.15.55:0/2387904049 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f1c180ab640 con 0x7f1c180cddf0 2023-08-25T05:19:28.950 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:19:28.950 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/934106390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":934106390},{"type":"v1","addr":"172.21.15.110:6836","nonce":934106390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":78},{"gid":8303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/759320040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":759320040},{"type":"v1","addr":"172.21.15.110:6837","nonce":759320040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":78},{"gid":10140,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2128942930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2128942930},{"type":"v1","addr":"172.21.15.55:6833","nonce":2128942930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:19:18.477714+0000","modified":"2023-08-25T05:19:22.105735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":10149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10149":{"gid":10149,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1451359895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1451359895},{"type":"v1","addr":"172.21.15.55:6835","nonce":1451359895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-25T05:19:28.950 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 83 2023-08-25T05:19:28.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.948+0000 7f1c1f848640 1 -- 172.21.15.55:0/2387904049 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f1bfc0657a0 msgr2=0x7f1bfc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.948+0000 7f1c1f848640 1 --2- 172.21.15.55:0/2387904049 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f1bfc0657a0 0x7f1bfc067c60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1c140ad000 tx=0x7f1c140a6000 comp rx=0 tx=0).stop 2023-08-25T05:19:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.948+0000 7f1c1f848640 1 -- 172.21.15.55:0/2387904049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c180cddf0 msgr2=0x7f1c180ab920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.948+0000 7f1c1f848640 1 --2- 172.21.15.55:0/2387904049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c180cddf0 0x7f1c180ab920 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800d7d0 tx=0x7f1c0800dc90 comp rx=0 tx=0).stop 2023-08-25T05:19:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.948+0000 7f1c1f848640 1 -- 172.21.15.55:0/2387904049 shutdown_connections 2023-08-25T05:19:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.948+0000 7f1c1f848640 1 --2- 172.21.15.55:0/2387904049 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f1bfc0657a0 0x7f1bfc067c60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.948+0000 7f1c1f848640 1 --2- 172.21.15.55:0/2387904049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c18164410 0x7f1c18163180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.948+0000 7f1c1f848640 1 --2- 172.21.15.55:0/2387904049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c180cddf0 0x7f1c180ab920 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.948+0000 7f1c1f848640 1 --2- 172.21.15.55:0/2387904049 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c180c18b0 0x7f1c180ac160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.948+0000 7f1c1f848640 1 -- 172.21.15.55:0/2387904049 >> 172.21.15.55:0/2387904049 conn(0x7f1c18069d00 msgr2=0x7f1c1806a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.948+0000 7f1c1f848640 1 -- 172.21.15.55:0/2387904049 shutdown_connections 2023-08-25T05:19:28.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:28.948+0000 7f1c1f848640 1 -- 172.21.15.55:0/2387904049 wait complete. 2023-08-25T05:19:29.372 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-25T05:19:18.477714+0000', 'modified': '2023-08-25T05:19:22.105735+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10149}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10149': {'gid': 10149, 'name': 'c', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6835/1451359895', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6834', 'nonce': 1451359895}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 1451359895}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-25T05:19:29.373 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-25T05:19:29.374 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-25T05:19:29.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.516+0000 7fcae0903640 1 Processor -- start 2023-08-25T05:19:29.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.516+0000 7fcae0903640 1 -- start start 2023-08-25T05:19:29.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.516+0000 7fcae0903640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcadc0d0da0 0x7fcadc0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.516+0000 7fcae0903640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcadc0b3e50 0x7fcadc0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.516+0000 7fcae0903640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcadc0b29b0 con 0x7fcadc0cdde0 2023-08-25T05:19:29.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.516+0000 7fcae0903640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcadc0ce760 con 0x7fcadc0d0da0 2023-08-25T05:19:29.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.516+0000 7fcae0903640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0d16c0 con 0x7fcadc0b3e50 2023-08-25T05:19:29.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.516+0000 7fcad1d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcadc0cdde0 0x7fcadc0cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38306/0 (socket says 172.21.15.55:38306) 2023-08-25T05:19:29.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.516+0000 7fcad1d9b640 1 -- 172.21.15.55:0/1498069786 learned_addr learned my addr 172.21.15.55:0/1498069786 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:29.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.516+0000 7fcada59c640 1 --2- 172.21.15.55:0/1498069786 >> v2:172.21.15.110:3300/0 conn(0x7fcadc0d0da0 0x7fcadc0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.516+0000 7fcadad9d640 1 --2- 172.21.15.55:0/1498069786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcadc0b3e50 0x7fcadc0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.516+0000 7fcad9d9b640 1 -- 172.21.15.55:0/1498069786 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671478394 0 0) 0x7fcadc0b29b0 con 0x7fcadc0cdde0 2023-08-25T05:19:29.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.516+0000 7fcad9d9b640 1 -- 172.21.15.55:0/1498069786 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcac8003530 con 0x7fcadc0cdde0 2023-08-25T05:19:29.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.516+0000 7fcada59c640 1 -- 172.21.15.55:0/1498069786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcadc0b3e50 msgr2=0x7fcadc0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:29.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.516+0000 7fcada59c640 1 --2- 172.21.15.55:0/1498069786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcadc0b3e50 0x7fcadc0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.516+0000 7fcada59c640 1 -- 172.21.15.55:0/1498069786 >> v1:172.21.15.55:6789/0 conn(0x7fcadc0cdde0 legacy=0x7fcadc0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:29.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.516+0000 7fcada59c640 1 -- 172.21.15.55:0/1498069786 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc0b1dc0 con 0x7fcadc0d0da0 2023-08-25T05:19:29.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.516+0000 7fcadad9d640 1 --2- 172.21.15.55:0/1498069786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcadc0b3e50 0x7fcadc0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:19:29.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.520+0000 7fcada59c640 1 --2- 172.21.15.55:0/1498069786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcadc0d0da0 0x7fcadc0d1180 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0097a0 tx=0x7fcacc01ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1ba8540721d9bb4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:29.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.520+0000 7fcad9d9b640 1 -- 172.21.15.55:0/1498069786 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0a8950 con 0x7fcadc0d0da0 2023-08-25T05:19:29.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.520+0000 7fcad9d9b640 1 -- 172.21.15.55:0/1498069786 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc0a8ab0 con 0x7fcadc0d0da0 2023-08-25T05:19:29.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.520+0000 7fcad9d9b640 1 -- 172.21.15.55:0/1498069786 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0a8e40 con 0x7fcadc0d0da0 2023-08-25T05:19:29.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.520+0000 7fcae0903640 1 -- 172.21.15.55:0/1498069786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcadc0d0da0 msgr2=0x7fcadc0d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:29.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.520+0000 7fcae0903640 1 --2- 172.21.15.55:0/1498069786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcadc0d0da0 0x7fcadc0d1180 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0097a0 tx=0x7fcacc01ec50 comp rx=0 tx=0).stop 2023-08-25T05:19:29.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.520+0000 7fcae0903640 1 -- 172.21.15.55:0/1498069786 shutdown_connections 2023-08-25T05:19:29.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.520+0000 7fcae0903640 1 --2- 172.21.15.55:0/1498069786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcadc0b3e50 0x7fcadc0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.520+0000 7fcae0903640 1 --2- 172.21.15.55:0/1498069786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcadc0d0da0 0x7fcadc0d1180 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.520+0000 7fcae0903640 1 -- 172.21.15.55:0/1498069786 >> 172.21.15.55:0/1498069786 conn(0x7fcadc09bae0 msgr2=0x7fcadc0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:29.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.520+0000 7fcae0903640 1 -- 172.21.15.55:0/1498069786 shutdown_connections 2023-08-25T05:19:29.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.520+0000 7fcae0903640 1 -- 172.21.15.55:0/1498069786 wait complete. 2023-08-25T05:19:29.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcae0903640 1 Processor -- start 2023-08-25T05:19:29.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcae0903640 1 -- start start 2023-08-25T05:19:29.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcae0903640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcadc0b3e50 0x7fcadc0cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcae0903640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcadc0cdde0 0x7fcadc15fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcae0903640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcadc0d0da0 0x7fcadc0c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcae0903640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc160080 con 0x7fcadc0cdde0 2023-08-25T05:19:29.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcae0903640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0c6830 con 0x7fcadc0b3e50 2023-08-25T05:19:29.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcae0903640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcadc0c6a60 con 0x7fcadc0d0da0 2023-08-25T05:19:29.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcad1d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcadc0cdde0 0x7fcadc15fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcad1d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcadc0cdde0 0x7fcadc15fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51260/0 (socket says 172.21.15.55:51260) 2023-08-25T05:19:29.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcad1d9b640 1 -- 172.21.15.55:0/2216068323 learned_addr learned my addr 172.21.15.55:0/2216068323 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:29.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcada59c640 1 --2- 172.21.15.55:0/2216068323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcadc0b3e50 0x7fcadc0cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcadad9d640 1 --2- 172.21.15.55:0/2216068323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcadc0d0da0 0x7fcadc0c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcad1d9b640 1 -- 172.21.15.55:0/2216068323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcadc0d0da0 msgr2=0x7fcadc0c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:29.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcad1d9b640 1 --2- 172.21.15.55:0/2216068323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcadc0d0da0 0x7fcadc0c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcad1d9b640 1 -- 172.21.15.55:0/2216068323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcadc0b3e50 msgr2=0x7fcadc0cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:29.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcad1d9b640 1 --2- 172.21.15.55:0/2216068323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcadc0b3e50 0x7fcadc0cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcad1d9b640 1 -- 172.21.15.55:0/2216068323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad4009420 con 0x7fcadc0cdde0 2023-08-25T05:19:29.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcada59c640 1 --2- 172.21.15.55:0/2216068323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcadc0b3e50 0x7fcadc0cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:29.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.524+0000 7fcad1d9b640 1 --2- 172.21.15.55:0/2216068323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcadc0cdde0 0x7fcadc15fb40 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fcac400cbf0 tx=0x7fcac400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:29.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.528+0000 7fcad37fe640 1 -- 172.21.15.55:0/2216068323 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac400ad50 con 0x7fcadc0cdde0 2023-08-25T05:19:29.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.528+0000 7fcad37fe640 1 -- 172.21.15.55:0/2216068323 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac4012400 con 0x7fcadc0cdde0 2023-08-25T05:19:29.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.528+0000 7fcad37fe640 1 -- 172.21.15.55:0/2216068323 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4012790 con 0x7fcadc0cdde0 2023-08-25T05:19:29.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.528+0000 7fcae0903640 1 -- 172.21.15.55:0/2216068323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcacc0093b0 con 0x7fcadc0cdde0 2023-08-25T05:19:29.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.528+0000 7fcae0903640 1 -- 172.21.15.55:0/2216068323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcadc0c7020 con 0x7fcadc0cdde0 2023-08-25T05:19:29.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.528+0000 7fcad37fe640 1 -- 172.21.15.55:0/2216068323 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fcac4007070 con 0x7fcadc0cdde0 2023-08-25T05:19:29.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.528+0000 7fcad37fe640 1 --2- 172.21.15.55:0/2216068323 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fcabc0657a0 0x7fcabc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.528+0000 7fcad37fe640 1 -- 172.21.15.55:0/2216068323 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcac40830d0 con 0x7fcadc0cdde0 2023-08-25T05:19:29.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcae3c6f000 1 Processor -- start 2023-08-25T05:19:29.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcae3c6f000 1 -- start start 2023-08-25T05:19:29.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcada59c640 1 --2- 172.21.15.55:0/2216068323 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fcabc0657a0 0x7fcabc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcae3c6f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c020 0x55566715c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcae3c6f000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55566715c940 0x555667112070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcae3c6f000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556671125b0 0x555667112990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcae3c6f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555666f68440 con 0x55566715c020 2023-08-25T05:19:29.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcae3c6f000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555666f65970 con 0x5556671125b0 2023-08-25T05:19:29.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcae3c6f000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x555666f61260 con 0x55566715c940 2023-08-25T05:19:29.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcada59c640 1 --2- 172.21.15.55:0/2216068323 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fcabc0657a0 0x7fcabc067c60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0b2000 tx=0x7fcacc008040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:29.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcada59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c020 0x55566715c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcada59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c020 0x55566715c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51268/0 (socket says 172.21.15.55:51268) 2023-08-25T05:19:29.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcada59c640 1 -- 172.21.15.55:0/647126708 learned_addr learned my addr 172.21.15.55:0/647126708 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:29.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcadad9d640 1 --2- 172.21.15.55:0/647126708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556671125b0 0x555667112990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcad1d9b640 1 --2- 172.21.15.55:0/647126708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55566715c940 0x555667112070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcada59c640 1 -- 172.21.15.55:0/647126708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55566715c940 msgr2=0x555667112070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:29.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcada59c640 1 --2- 172.21.15.55:0/647126708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55566715c940 0x555667112070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcada59c640 1 -- 172.21.15.55:0/647126708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556671125b0 msgr2=0x555667112990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:29.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcada59c640 1 --2- 172.21.15.55:0/647126708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556671125b0 0x555667112990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcada59c640 1 -- 172.21.15.55:0/647126708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555666ff9ec0 con 0x55566715c020 2023-08-25T05:19:29.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcada59c640 1 --2- 172.21.15.55:0/647126708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c020 0x55566715c400 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0b3040 tx=0x7fcacc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9776cf2114582972 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:29.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcabbfff640 1 -- 172.21.15.55:0/647126708 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0c1070 con 0x55566715c020 2023-08-25T05:19:29.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcabbfff640 1 -- 172.21.15.55:0/647126708 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc0b0740 con 0x55566715c020 2023-08-25T05:19:29.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcabbfff640 1 -- 172.21.15.55:0/647126708 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0b0ab0 con 0x55566715c020 2023-08-25T05:19:29.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcae3c6f000 1 -- 172.21.15.55:0/647126708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c020 msgr2=0x55566715c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:29.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/647126708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c020 0x55566715c400 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0b3040 tx=0x7fcacc004740 comp rx=0 tx=0).stop 2023-08-25T05:19:29.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcae3c6f000 1 -- 172.21.15.55:0/647126708 shutdown_connections 2023-08-25T05:19:29.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/647126708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x5556671125b0 0x555667112990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/647126708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55566715c940 0x555667112070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/647126708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c020 0x55566715c400 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcae3c6f000 1 -- 172.21.15.55:0/647126708 >> 172.21.15.55:0/647126708 conn(0x55566710e560 msgr2=0x555667110950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:29.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcae3c6f000 1 -- 172.21.15.55:0/647126708 shutdown_connections 2023-08-25T05:19:29.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.532+0000 7fcae3c6f000 1 -- 172.21.15.55:0/647126708 wait complete. 2023-08-25T05:19:29.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcae3c6f000 1 -- start start 2023-08-25T05:19:29.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcae3c6f000 1 Processor -- start 2023-08-25T05:19:29.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcae3c6f000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5556671125b0 0x555667163380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcae3c6f000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55566715c020 0x5556671638c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcae3c6f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c940 0x555667149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcae3c6f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555666f1bf60 con 0x55566715c940 2023-08-25T05:19:29.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcae3c6f000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555666f1bc00 con 0x55566715c020 2023-08-25T05:19:29.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcae3c6f000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x555666c1c940 con 0x5556671125b0 2023-08-25T05:19:29.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcae3c6f000 10 client.0 _ll_register_callbacks cb 0x5556670fd900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T05:19:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcadad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c940 0x555667149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcadad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c940 0x555667149dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51274/0 (socket says 172.21.15.55:51274) 2023-08-25T05:19:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcadad9d640 1 -- 172.21.15.55:0/3752557693 learned_addr learned my addr 172.21.15.55:0/3752557693 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcad1d9b640 1 --2- 172.21.15.55:0/3752557693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55566715c020 0x5556671638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcada59c640 1 --2- 172.21.15.55:0/3752557693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5556671125b0 0x555667163380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcadad9d640 1 -- 172.21.15.55:0/3752557693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5556671125b0 msgr2=0x555667163380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcadad9d640 1 --2- 172.21.15.55:0/3752557693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5556671125b0 0x555667163380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcadad9d640 1 -- 172.21.15.55:0/3752557693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55566715c020 msgr2=0x5556671638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcadad9d640 1 --2- 172.21.15.55:0/3752557693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55566715c020 0x5556671638c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcadad9d640 1 -- 172.21.15.55:0/3752557693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcadc0b1dc0 con 0x55566715c940 2023-08-25T05:19:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcad1d9b640 1 --2- 172.21.15.55:0/3752557693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55566715c020 0x5556671638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:19:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcadad9d640 1 --2- 172.21.15.55:0/3752557693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c940 0x555667149dd0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fcad4014660 tx=0x7fcad4014a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd32317f5fd95c9d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcab97fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T05:19:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcab97fa640 1 -- 172.21.15.55:0/3752557693 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad4004220 con 0x55566715c940 2023-08-25T05:19:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcae3c6f000 1 -- 172.21.15.55:0/3752557693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555666ef89d0 con 0x55566715c940 2023-08-25T05:19:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcab97fa640 1 -- 172.21.15.55:0/3752557693 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcad401a070 con 0x55566715c940 2023-08-25T05:19:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcab97fa640 1 -- 172.21.15.55:0/3752557693 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcad4004380 con 0x55566715c940 2023-08-25T05:19:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcae3c6f000 10 client.10311 fetch_fsmap learned FSMap version 83 2023-08-25T05:19:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcae3c6f000 1 -- 172.21.15.55:0/3752557693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x555666c5b890 con 0x55566715c940 2023-08-25T05:19:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcab97fa640 1 -- 172.21.15.55:0/3752557693 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555666ef89d0 con 0x55566715c940 2023-08-25T05:19:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcab97fa640 1 -- 172.21.15.55:0/3752557693 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 83) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcad40167c0 con 0x55566715c940 2023-08-25T05:19:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcae3c6f000 10 client.10311 fetch_fsmap finished waiting for FSMap version 83 2023-08-25T05:19:29.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcae3c6f000 10 client.10311 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T05:19:29.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcae3c6f000 20 client.10311 populate_metadata read hostname 'smithi055' 2023-08-25T05:19:29.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/3752557693 >> [v2:172.21.15.55:6834/1451359895,v1:172.21.15.55:6835/1451359895] conn(0x55566714ab70 0x55566714af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcae3c6f000 4 client.10311 mds_command: new command op to 10149 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-25T05:19:29.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.536+0000 7fcae3c6f000 1 -- 172.21.15.55:0/3752557693 --> [v2:172.21.15.55:6834/1451359895,v1:172.21.15.55:6835/1451359895] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555666f187a0 con 0x55566714ab70 2023-08-25T05:19:29.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.540+0000 7fcada59c640 1 --2- 172.21.15.55:0/3752557693 >> [v2:172.21.15.55:6834/1451359895,v1:172.21.15.55:6835/1451359895] conn(0x55566714ab70 0x55566714af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.540+0000 7fcada59c640 1 --2- 172.21.15.55:0/3752557693 >> [v2:172.21.15.55:6834/1451359895,v1:172.21.15.55:6835/1451359895] conn(0x55566714ab70 0x55566714af50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b3c03475507493a server_cookie=c1b61a0d2dfb85f2 in_seq=0 out_seq=0 2023-08-25T05:19:29.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.540+0000 7fcab97fa640 10 client.10311 ms_handle_connect on v2:172.21.15.55:6834/1451359895 2023-08-25T05:19:29.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.540+0000 7fcab97fa640 1 -- 172.21.15.55:0/3752557693 <== mds.0 v2:172.21.15.55:6834/1451359895 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555666f187a0 con 0x55566714ab70 2023-08-25T05:19:29.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.540+0000 7fcab97fa640 10 client.10311 handle_command_reply: tid=0 2023-08-25T05:19:29.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.540+0000 7fcae3c6f000 1 client.10311 shutdown 2023-08-25T05:19:29.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.540+0000 7fcae3c6f000 1 -- 172.21.15.55:0/3752557693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c940 msgr2=0x555667149dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:29.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.540+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/3752557693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c940 0x555667149dd0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fcad4014660 tx=0x7fcad4014a60 comp rx=0 tx=0).stop 2023-08-25T05:19:29.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.540+0000 7fcae3c6f000 1 -- 172.21.15.55:0/3752557693 shutdown_connections 2023-08-25T05:19:29.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.540+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/3752557693 >> [v2:172.21.15.55:6834/1451359895,v1:172.21.15.55:6835/1451359895] conn(0x55566714ab70 0x55566714af50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.540+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/3752557693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c940 0x555667149dd0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.540+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/3752557693 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55566715c020 0x5556671638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.540+0000 7fcab97fa640 0 client.10311 ms_handle_reset on v2:172.21.15.55:6834/1451359895 2023-08-25T05:19:29.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.540+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/3752557693 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5556671125b0 0x555667163380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.540+0000 7fcae3c6f000 1 -- 172.21.15.55:0/3752557693 >> 172.21.15.55:0/3752557693 conn(0x55566710e560 msgr2=0x5556671111e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:29.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.540+0000 7fcae3c6f000 1 -- 172.21.15.55:0/3752557693 shutdown_connections 2023-08-25T05:19:29.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.540+0000 7fcae3c6f000 1 -- 172.21.15.55:0/3752557693 wait complete. 2023-08-25T05:19:29.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.540+0000 7fcae3c6f000 20 client.10311 trim_cache size 0 max 16384 2023-08-25T05:19:29.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcae3c6f000 1 Processor -- start 2023-08-25T05:19:29.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcae3c6f000 1 -- start start 2023-08-25T05:19:29.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcae3c6f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556671125b0 0x555667110950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcae3c6f000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55566715c020 0x555667110e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcae3c6f000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55566715c940 0x55566715ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcae3c6f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555666f18640 con 0x5556671125b0 2023-08-25T05:19:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcae3c6f000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555666fa2f90 con 0x55566715c020 2023-08-25T05:19:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcae3c6f000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x555666f5de70 con 0x55566715c940 2023-08-25T05:19:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcada59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556671125b0 0x555667110950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcada59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556671125b0 0x555667110950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51286/0 (socket says 172.21.15.55:51286) 2023-08-25T05:19:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcada59c640 1 -- 172.21.15.55:0/1400791337 learned_addr learned my addr 172.21.15.55:0/1400791337 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcadad9d640 1 --2- 172.21.15.55:0/1400791337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55566715c940 0x55566715ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcad1d9b640 1 --2- 172.21.15.55:0/1400791337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55566715c020 0x555667110e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcada59c640 1 -- 172.21.15.55:0/1400791337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55566715c940 msgr2=0x55566715ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcada59c640 1 --2- 172.21.15.55:0/1400791337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55566715c940 0x55566715ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcada59c640 1 -- 172.21.15.55:0/1400791337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55566715c020 msgr2=0x555667110e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcada59c640 1 --2- 172.21.15.55:0/1400791337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55566715c020 0x555667110e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcada59c640 1 -- 172.21.15.55:0/1400791337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555666f24190 con 0x5556671125b0 2023-08-25T05:19:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcada59c640 1 --2- 172.21.15.55:0/1400791337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556671125b0 0x555667110950 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fcacc01d300 tx=0x7fcacc0aa000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b99ea0f9d49473 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcad0d99640 1 -- 172.21.15.55:0/1400791337 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0c1040 con 0x5556671125b0 2023-08-25T05:19:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcad0d99640 1 -- 172.21.15.55:0/1400791337 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc0d5c60 con 0x5556671125b0 2023-08-25T05:19:29.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcad0d99640 1 -- 172.21.15.55:0/1400791337 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc006dc0 con 0x5556671125b0 2023-08-25T05:19:29.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcae3c6f000 1 -- 172.21.15.55:0/1400791337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556671125b0 msgr2=0x555667110950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:29.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/1400791337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556671125b0 0x555667110950 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fcacc01d300 tx=0x7fcacc0aa000 comp rx=0 tx=0).stop 2023-08-25T05:19:29.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcae3c6f000 1 -- 172.21.15.55:0/1400791337 shutdown_connections 2023-08-25T05:19:29.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/1400791337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55566715c940 0x55566715ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/1400791337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55566715c020 0x555667110e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/1400791337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556671125b0 0x555667110950 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcae3c6f000 1 -- 172.21.15.55:0/1400791337 >> 172.21.15.55:0/1400791337 conn(0x55566710e560 msgr2=0x55566715afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:29.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcae3c6f000 1 -- 172.21.15.55:0/1400791337 shutdown_connections 2023-08-25T05:19:29.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.556+0000 7fcae3c6f000 1 -- 172.21.15.55:0/1400791337 wait complete. 2023-08-25T05:19:29.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcae3c6f000 1 -- start start 2023-08-25T05:19:29.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcae3c6f000 1 Processor -- start 2023-08-25T05:19:29.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcae3c6f000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5556671125b0 0x5556671ba7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcae3c6f000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55566715c020 0x5556671bace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcae3c6f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c940 0x555667161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcae3c6f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555667172970 con 0x55566715c940 2023-08-25T05:19:29.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcae3c6f000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x555666f28e80 con 0x55566715c020 2023-08-25T05:19:29.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcae3c6f000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x555666f65260 con 0x5556671125b0 2023-08-25T05:19:29.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcae3c6f000 10 client.0 _ll_register_callbacks cb 0x7fcacc0b3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T05:19:29.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcadad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c940 0x555667161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcadad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c940 0x555667161000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51298/0 (socket says 172.21.15.55:51298) 2023-08-25T05:19:29.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcada59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5556671125b0 0x5556671ba7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcadad9d640 1 -- 172.21.15.55:0/2647115296 learned_addr learned my addr 172.21.15.55:0/2647115296 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:29.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcad1d9b640 1 --2- 172.21.15.55:0/2647115296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55566715c020 0x5556671bace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcada59c640 1 -- 172.21.15.55:0/2647115296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55566715c020 msgr2=0x5556671bace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:29.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcada59c640 1 --2- 172.21.15.55:0/2647115296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55566715c020 0x5556671bace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcada59c640 1 -- 172.21.15.55:0/2647115296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c940 msgr2=0x555667161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:29.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcada59c640 1 --2- 172.21.15.55:0/2647115296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c940 0x555667161000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcada59c640 1 -- 172.21.15.55:0/2647115296 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555666ff9ec0 con 0x5556671125b0 2023-08-25T05:19:29.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcada59c640 1 --2- 172.21.15.55:0/2647115296 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5556671125b0 0x5556671ba7a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcacc01b860 tx=0x7fcacc01d490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=286c2bfe09c85e2f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:29.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcab97fa640 10 client.0 ms_handle_connect on v2:172.21.15.110:3301/0 2023-08-25T05:19:29.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcab97fa640 1 -- 172.21.15.55:0/2647115296 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc0c1030 con 0x5556671125b0 2023-08-25T05:19:29.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcab97fa640 1 -- 172.21.15.55:0/2647115296 <== mon.2 v2:172.21.15.110:3301/0 2 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcacc0b0a00 con 0x5556671125b0 2023-08-25T05:19:29.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcae3c6f000 1 -- 172.21.15.55:0/2647115296 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555667172ab0 con 0x5556671125b0 2023-08-25T05:19:29.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcab97fa640 1 -- 172.21.15.55:0/2647115296 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcacc0b0bc0 con 0x5556671125b0 2023-08-25T05:19:29.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcae3c6f000 10 client.8420 fetch_fsmap learned FSMap version 83 2023-08-25T05:19:29.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcae3c6f000 1 -- 172.21.15.55:0/2647115296 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x555666f0a420 con 0x5556671125b0 2023-08-25T05:19:29.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcab97fa640 1 -- 172.21.15.55:0/2647115296 <== mon.2 v2:172.21.15.110:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555667172ab0 con 0x5556671125b0 2023-08-25T05:19:29.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcab97fa640 1 -- 172.21.15.55:0/2647115296 <== mon.2 v2:172.21.15.110:3301/0 5 ==== fsmap(e 83) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcacc0b0d20 con 0x5556671125b0 2023-08-25T05:19:29.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcae3c6f000 10 client.8420 fetch_fsmap finished waiting for FSMap version 83 2023-08-25T05:19:29.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcae3c6f000 10 client.8420 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T05:19:29.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.560+0000 7fcae3c6f000 20 client.8420 populate_metadata read hostname 'smithi055' 2023-08-25T05:19:29.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/2647115296 >> [v2:172.21.15.55:6834/1451359895,v1:172.21.15.55:6835/1451359895] conn(0x5556671619c0 0x555667161da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae3c6f000 4 client.8420 mds_command: new command op to 10149 tid=0[{"prefix": "status"}] 2023-08-25T05:19:29.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae3c6f000 1 -- 172.21.15.55:0/2647115296 --> [v2:172.21.15.55:6834/1451359895,v1:172.21.15.55:6835/1451359895] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555666f1c880 con 0x5556671619c0 2023-08-25T05:19:29.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcad1d9b640 1 --2- 172.21.15.55:0/2647115296 >> [v2:172.21.15.55:6834/1451359895,v1:172.21.15.55:6835/1451359895] conn(0x5556671619c0 0x555667161da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcad1d9b640 1 --2- 172.21.15.55:0/2647115296 >> [v2:172.21.15.55:6834/1451359895,v1:172.21.15.55:6835/1451359895] conn(0x5556671619c0 0x555667161da0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=995e828c32220afa server_cookie=821cbcbad0e44e6a in_seq=0 out_seq=0 2023-08-25T05:19:29.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcab97fa640 10 client.8420 ms_handle_connect on v2:172.21.15.55:6834/1451359895 2023-08-25T05:19:29.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcab97fa640 1 -- 172.21.15.55:0/2647115296 <== mds.0 v2:172.21.15.55:6834/1451359895 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x555666f1c880 con 0x5556671619c0 2023-08-25T05:19:29.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcab97fa640 10 client.8420 handle_command_reply: tid=0 2023-08-25T05:19:29.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae3c6f000 1 client.8420 shutdown 2023-08-25T05:19:29.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae3c6f000 1 -- 172.21.15.55:0/2647115296 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5556671125b0 msgr2=0x5556671ba7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:29.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/2647115296 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5556671125b0 0x5556671ba7a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcacc01b860 tx=0x7fcacc01d490 comp rx=0 tx=0).stop 2023-08-25T05:19:29.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae3c6f000 1 -- 172.21.15.55:0/2647115296 shutdown_connections 2023-08-25T05:19:29.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/2647115296 >> [v2:172.21.15.55:6834/1451359895,v1:172.21.15.55:6835/1451359895] conn(0x5556671619c0 0x555667161da0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/2647115296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55566715c940 0x555667161000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/2647115296 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55566715c020 0x5556671bace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcab97fa640 0 client.8420 ms_handle_reset on v2:172.21.15.55:6834/1451359895 2023-08-25T05:19:29.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae3c6f000 1 --2- 172.21.15.55:0/2647115296 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x5556671125b0 0x5556671ba7a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae3c6f000 1 -- 172.21.15.55:0/2647115296 >> 172.21.15.55:0/2647115296 conn(0x55566710e560 msgr2=0x555667148f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:29.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae3c6f000 1 -- 172.21.15.55:0/2647115296 shutdown_connections 2023-08-25T05:19:29.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae3c6f000 1 -- 172.21.15.55:0/2647115296 wait complete. 2023-08-25T05:19:29.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae3c6f000 20 client.8420 trim_cache size 0 max 16384 2023-08-25T05:19:29.577 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T05:19:29.577 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2d2a9024-b152-4d40-880c-1686d1810590", 2023-08-25T05:19:29.578 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-08-25T05:19:29.578 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 10149, 2023-08-25T05:19:29.578 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-08-25T05:19:29.578 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-08-25T05:19:29.578 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-08-25T05:19:29.578 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.476229711, 2023-08-25T05:19:29.578 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 83, 2023-08-25T05:19:29.579 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 170, 2023-08-25T05:19:29.579 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 170, 2023-08-25T05:19:29.579 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 16.386409028999999 2023-08-25T05:19:29.579 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T05:19:29.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae0903640 1 -- 172.21.15.55:0/2216068323 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fcabc0657a0 msgr2=0x7fcabc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:29.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae0903640 1 --2- 172.21.15.55:0/2216068323 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fcabc0657a0 0x7fcabc067c60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcacc0b2000 tx=0x7fcacc008040 comp rx=0 tx=0).stop 2023-08-25T05:19:29.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae0903640 1 -- 172.21.15.55:0/2216068323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcadc0cdde0 msgr2=0x7fcadc15fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:29.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae0903640 1 --2- 172.21.15.55:0/2216068323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcadc0cdde0 0x7fcadc15fb40 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fcac400cbf0 tx=0x7fcac400a430 comp rx=0 tx=0).stop 2023-08-25T05:19:29.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae0903640 1 -- 172.21.15.55:0/2216068323 shutdown_connections 2023-08-25T05:19:29.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae0903640 1 --2- 172.21.15.55:0/2216068323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcadc0d0da0 0x7fcadc0c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae0903640 1 --2- 172.21.15.55:0/2216068323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcadc0cdde0 0x7fcadc15fb40 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae0903640 1 --2- 172.21.15.55:0/2216068323 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fcabc0657a0 0x7fcabc067c60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae0903640 1 --2- 172.21.15.55:0/2216068323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcadc0b3e50 0x7fcadc0cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae0903640 1 -- 172.21.15.55:0/2216068323 >> 172.21.15.55:0/2216068323 conn(0x7fcadc09bae0 msgr2=0x7fcadc06b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:29.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae0903640 1 -- 172.21.15.55:0/2216068323 shutdown_connections 2023-08-25T05:19:29.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.564+0000 7fcae0903640 1 -- 172.21.15.55:0/2216068323 wait complete. 2023-08-25T05:19:29.588 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T05:19:29.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.728+0000 7f600ac5c640 1 Processor -- start 2023-08-25T05:19:29.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.728+0000 7f600ac5c640 1 -- start start 2023-08-25T05:19:29.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.728+0000 7f600ac5c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f60040cdde0 0x7f60040ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.728+0000 7f600ac5c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60040b2e40 0x7f60040b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.728+0000 7f600ac5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60040b29b0 con 0x7f60040d0da0 2023-08-25T05:19:29.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.728+0000 7f600ac5c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60040ce760 con 0x7f60040cdde0 2023-08-25T05:19:29.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.728+0000 7f600ac5c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60040b1dc0 con 0x7f60040b2e40 2023-08-25T05:19:29.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.728+0000 7f60089f8640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f60040d0da0 0x7f60040d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:38312/0 (socket says 172.21.15.55:38312) 2023-08-25T05:19:29.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.728+0000 7f60089f8640 1 -- 172.21.15.55:0/2918776312 learned_addr learned my addr 172.21.15.55:0/2918776312 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:29.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.728+0000 7f6003fff640 1 --2- 172.21.15.55:0/2918776312 >> v2:172.21.15.110:3300/0 conn(0x7f60040cdde0 0x7f60040ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.728+0000 7f60091f9640 1 --2- 172.21.15.55:0/2918776312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60040b2e40 0x7f60040b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.728+0000 7f60037fe640 1 -- 172.21.15.55:0/2918776312 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138092397 0 0) 0x7f60040b29b0 con 0x7f60040d0da0 2023-08-25T05:19:29.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.728+0000 7f60037fe640 1 -- 172.21.15.55:0/2918776312 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff4003530 con 0x7f60040d0da0 2023-08-25T05:19:29.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.728+0000 7f6003fff640 1 -- 172.21.15.55:0/2918776312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60040b2e40 msgr2=0x7f60040b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:29.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.728+0000 7f6003fff640 1 --2- 172.21.15.55:0/2918776312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60040b2e40 0x7f60040b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.728+0000 7f6003fff640 1 -- 172.21.15.55:0/2918776312 >> v1:172.21.15.55:6789/0 conn(0x7f60040d0da0 legacy=0x7f60040d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:29.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.728+0000 7f6003fff640 1 -- 172.21.15.55:0/2918776312 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60040b2080 con 0x7f60040cdde0 2023-08-25T05:19:29.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.732+0000 7f6003fff640 1 --2- 172.21.15.55:0/2918776312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60040cdde0 0x7f60040ce220 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00097c0 tx=0x7f5ff001ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a08e767d4fddae4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:29.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.732+0000 7f60037fe640 1 -- 172.21.15.55:0/2918776312 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff00a8970 con 0x7f60040cdde0 2023-08-25T05:19:29.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.732+0000 7f60037fe640 1 -- 172.21.15.55:0/2918776312 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff00a8ad0 con 0x7f60040cdde0 2023-08-25T05:19:29.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.732+0000 7f60037fe640 1 -- 172.21.15.55:0/2918776312 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff00a8e60 con 0x7f60040cdde0 2023-08-25T05:19:29.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.732+0000 7f600ac5c640 1 -- 172.21.15.55:0/2918776312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60040cdde0 msgr2=0x7f60040ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:29.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.732+0000 7f600ac5c640 1 --2- 172.21.15.55:0/2918776312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60040cdde0 0x7f60040ce220 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00097c0 tx=0x7f5ff001ec70 comp rx=0 tx=0).stop 2023-08-25T05:19:29.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.732+0000 7f600ac5c640 1 -- 172.21.15.55:0/2918776312 shutdown_connections 2023-08-25T05:19:29.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.732+0000 7f600ac5c640 1 --2- 172.21.15.55:0/2918776312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60040b2e40 0x7f60040b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.732+0000 7f600ac5c640 1 --2- 172.21.15.55:0/2918776312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60040cdde0 0x7f60040ce220 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.732+0000 7f600ac5c640 1 -- 172.21.15.55:0/2918776312 >> 172.21.15.55:0/2918776312 conn(0x7f600409bae0 msgr2=0x7f60040d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:29.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.732+0000 7f600ac5c640 1 -- 172.21.15.55:0/2918776312 shutdown_connections 2023-08-25T05:19:29.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.732+0000 7f600ac5c640 1 -- 172.21.15.55:0/2918776312 wait complete. 2023-08-25T05:19:29.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f600ac5c640 1 Processor -- start 2023-08-25T05:19:29.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f600ac5c640 1 -- start start 2023-08-25T05:19:29.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f600ac5c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60040b2e40 0x7f60041f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f600ac5c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60040cdde0 0x7f60040c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f600ac5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60040d0da0 0x7f60041e6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f600ac5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60041e7200 con 0x7f60040d0da0 2023-08-25T05:19:29.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f600ac5c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60041e7460 con 0x7f60040b2e40 2023-08-25T05:19:29.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f600ac5c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60040c74d0 con 0x7f60040cdde0 2023-08-25T05:19:29.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f60091f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60040d0da0 0x7f60041e6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f60091f9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60040d0da0 0x7f60041e6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51300/0 (socket says 172.21.15.55:51300) 2023-08-25T05:19:29.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f60091f9640 1 -- 172.21.15.55:0/2384477571 learned_addr learned my addr 172.21.15.55:0/2384477571 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:29.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f60089f8640 1 --2- 172.21.15.55:0/2384477571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60040b2e40 0x7f60041f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f6003fff640 1 --2- 172.21.15.55:0/2384477571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60040cdde0 0x7f60040c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f60091f9640 1 -- 172.21.15.55:0/2384477571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60040cdde0 msgr2=0x7f60040c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:29.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f60091f9640 1 --2- 172.21.15.55:0/2384477571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60040cdde0 0x7f60040c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f60091f9640 1 -- 172.21.15.55:0/2384477571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60040b2e40 msgr2=0x7f60041f5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:29.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f60091f9640 1 --2- 172.21.15.55:0/2384477571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60040b2e40 0x7f60041f5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f60091f9640 1 -- 172.21.15.55:0/2384477571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff0009420 con 0x7f60040d0da0 2023-08-25T05:19:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f6003fff640 1 --2- 172.21.15.55:0/2384477571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60040cdde0 0x7f60040c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:19:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f60091f9640 1 --2- 172.21.15.55:0/2384477571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60040d0da0 0x7f60041e6cc0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc00efc0 tx=0x7f5ffc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f60017fa640 1 -- 172.21.15.55:0/2384477571 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc009ba0 con 0x7f60040d0da0 2023-08-25T05:19:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f60017fa640 1 -- 172.21.15.55:0/2384477571 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ffc00f040 con 0x7f60040d0da0 2023-08-25T05:19:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f600ac5c640 1 -- 172.21.15.55:0/2384477571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60040c77b0 con 0x7f60040d0da0 2023-08-25T05:19:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f60017fa640 1 -- 172.21.15.55:0/2384477571 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc0146c0 con 0x7f60040d0da0 2023-08-25T05:19:29.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.736+0000 7f600ac5c640 1 -- 172.21.15.55:0/2384477571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60040c7d70 con 0x7f60040d0da0 2023-08-25T05:19:29.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.740+0000 7f600ac5c640 1 -- 172.21.15.55:0/2384477571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60040c7f60 con 0x7f60040d0da0 2023-08-25T05:19:29.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.740+0000 7f60017fa640 1 -- 172.21.15.55:0/2384477571 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f5ffc014820 con 0x7f60040d0da0 2023-08-25T05:19:29.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.740+0000 7f60017fa640 1 --2- 172.21.15.55:0/2384477571 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f5fe80657a0 0x7f5fe8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:29.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.740+0000 7f60017fa640 1 -- 172.21.15.55:0/2384477571 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ffc083cb0 con 0x7f60040d0da0 2023-08-25T05:19:29.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.740+0000 7f60089f8640 1 --2- 172.21.15.55:0/2384477571 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f5fe80657a0 0x7f5fe8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:29.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.740+0000 7f60089f8640 1 --2- 172.21.15.55:0/2384477571 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f5fe80657a0 0x7f5fe8067c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8007fd0 tx=0x7f5ff8009040 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:29.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.744+0000 7f60017fa640 1 -- 172.21.15.55:0/2384477571 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5ffc051430 con 0x7f60040d0da0 2023-08-25T05:19:29.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.936+0000 7f600ac5c640 1 -- 172.21.15.55:0/2384477571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f600404dbe0 con 0x7f60040d0da0 2023-08-25T05:19:29.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.936+0000 7f60017fa640 1 -- 172.21.15.55:0/2384477571 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5ffc018060 con 0x7f60040d0da0 2023-08-25T05:19:29.940 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T05:19:29.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.936+0000 7f600ac5c640 1 -- 172.21.15.55:0/2384477571 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f5fe80657a0 msgr2=0x7f5fe8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.936+0000 7f600ac5c640 1 --2- 172.21.15.55:0/2384477571 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f5fe80657a0 0x7f5fe8067c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8007fd0 tx=0x7f5ff8009040 comp rx=0 tx=0).stop 2023-08-25T05:19:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.936+0000 7f600ac5c640 1 -- 172.21.15.55:0/2384477571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60040d0da0 msgr2=0x7f60041e6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.936+0000 7f600ac5c640 1 --2- 172.21.15.55:0/2384477571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60040d0da0 0x7f60041e6cc0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc00efc0 tx=0x7f5ffc00c490 comp rx=0 tx=0).stop 2023-08-25T05:19:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.936+0000 7f600ac5c640 1 -- 172.21.15.55:0/2384477571 shutdown_connections 2023-08-25T05:19:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.936+0000 7f600ac5c640 1 --2- 172.21.15.55:0/2384477571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60040d0da0 0x7f60041e6cc0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.936+0000 7f600ac5c640 1 --2- 172.21.15.55:0/2384477571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60040cdde0 0x7f60040c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.936+0000 7f600ac5c640 1 --2- 172.21.15.55:0/2384477571 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f5fe80657a0 0x7f5fe8067c60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.936+0000 7f600ac5c640 1 --2- 172.21.15.55:0/2384477571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60040b2e40 0x7f60041f5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:29.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.936+0000 7f600ac5c640 1 -- 172.21.15.55:0/2384477571 >> 172.21.15.55:0/2384477571 conn(0x7f600409bae0 msgr2=0x7f600406c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:29.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.936+0000 7f600ac5c640 1 -- 172.21.15.55:0/2384477571 shutdown_connections 2023-08-25T05:19:29.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:29.936+0000 7f600ac5c640 1 -- 172.21.15.55:0/2384477571 wait complete. 2023-08-25T05:19:29.961 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-25T05:19:29.961 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T05:19:29.962 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-08-25T05:19:29.962 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-25T05:19:29.962 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T05:19:29.963 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-25T05:19:29.963 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-25T05:19:29.963 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T05:19:29.963 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T05:19:29.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:19:29.964 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-08-25T05:19:29.975 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T05:19:29.975 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T05:19:29.975 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T05:19:29.975 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:19:29.975 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-08-25T05:19:29.976 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:19:29.976 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T05:19:29.976 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-08-25T05:19:29.976 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-08-25T05:19:29.976 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T05:19:29.977 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-08-25T05:19:29.977 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-08-25T05:19:29.977 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T05:19:29.977 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-08-25T05:19:29.977 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-08-25T05:19:29.977 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-08-25T05:19:29.977 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 37818sec preferred_lft 37818sec 2023-08-25T05:19:29.978 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-08-25T05:19:29.978 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:19:29.978 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T05:19:29.978 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-08-25T05:19:29.978 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-08-25T05:19:29.978 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-25T05:19:29.978 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:98:6a:38:6a brd ff:ff:ff:ff:ff:ff 2023-08-25T05:19:29.979 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-25T05:19:29.979 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:19:29.979 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T05:19:29.979 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-08-25T05:19:29.979 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T05:19:29.979 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:19:29.979 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-08-25T05:19:29.979 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:19:29.980 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T05:19:29.980 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T05:19:29.980 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-08-25T05:19:29.980 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:19:29.980 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T05:19:29.980 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-25T05:19:29.980 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-08-25T05:19:29.980 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:19:29.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:19:29.981 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T05:19:30.038 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-08-25T05:19:30.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:19:30.040 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-08-25T05:19:30.092 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-08-25T05:19:30.092 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T05:19:30.093 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-08-25T05:19:30.093 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-25T05:19:30.093 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-08-25T05:19:30.094 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T05:19:30.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:19:30.095 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T05:19:30.095 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T05:19:30.096 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-25T05:19:30.096 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-25T05:19:30.096 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-25T05:19:30.097 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T05:19:30.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:19:30.190 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-08-25T05:19:30.201 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-25T05:19:30.201 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-25T05:19:30.201 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T05:19:30.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:19:30.202 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-08-25T05:19:30.263 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T05:19:30.264 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-25T05:19:30.316 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-25T05:19:30.316 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T05:19:30.317 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-25T05:19:30.366 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-25T05:19:30.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:19:30.367 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T05:19:30.462 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T05:19:30.462 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T05:19:30.474 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T05:19:30.475 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T05:19:30.475 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.110:3300,172.21.15.110:3301" 2023-08-25T05:19:30.475 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2d2a9024-b152-4d40-880c-1686d1810590.cephfs=/ 2023-08-25T05:19:30.475 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2023-08-25T05:19:30.478 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T05:19:30.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:19:30.479 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-25T05:19:30.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:19:30.501 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T05:19:30.563 INFO:teuthology.orchestra.run.smithi055.stdout:client10326 2023-08-25T05:19:30.564 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:19:30.564 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:19:30.619 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-25T05:19:30.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.800+0000 7f740ff0a640 1 Processor -- start 2023-08-25T05:19:30.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.800+0000 7f740ff0a640 1 -- start start 2023-08-25T05:19:30.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.800+0000 7f740ff0a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f740815c9c0 0x7f7408160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:30.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.800+0000 7f740ff0a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f74080cfa70 0x7f7408160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:30.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.800+0000 7f740ff0a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f740806eaf0 con 0x7f7408160f90 2023-08-25T05:19:30.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.800+0000 7f740ff0a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f740806e530 con 0x7f74080cfa70 2023-08-25T05:19:30.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.800+0000 7f740ff0a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740806e810 con 0x7f740815c9c0 2023-08-25T05:19:30.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.804+0000 7f740d4a5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f74080cfa70 0x7f7408160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:30.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.804+0000 7f740dca6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f740815c9c0 0x7f7408160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:30.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.804+0000 7f740e4a7640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7408160f90 0x7f74080ce910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:44592/0 (socket says 172.21.15.55:44592) 2023-08-25T05:19:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.804+0000 7f740e4a7640 1 -- 172.21.15.55:0/2195702877 learned_addr learned my addr 172.21.15.55:0/2195702877 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.804+0000 7f740dca6640 1 -- 172.21.15.55:0/2195702877 >> v2:172.21.15.110:3300/0 conn(0x7f74080cfa70 msgr2=0x7f7408160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.804+0000 7f740dca6640 1 --2- 172.21.15.55:0/2195702877 >> v2:172.21.15.110:3300/0 conn(0x7f74080cfa70 0x7f7408160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.804+0000 7f740dca6640 1 -- 172.21.15.55:0/2195702877 >> v1:172.21.15.110:6789/0 conn(0x7f7408160f90 legacy=0x7f74080ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:30.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.804+0000 7f740dca6640 1 -- 172.21.15.55:0/2195702877 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740806aab0 con 0x7f740815c9c0 2023-08-25T05:19:30.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.804+0000 7f740d4a5640 1 --2- 172.21.15.55:0/2195702877 >> v2:172.21.15.110:3300/0 conn(0x7f74080cfa70 0x7f7408160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:19:30.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740dca6640 1 --2- 172.21.15.55:0/2195702877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f740815c9c0 0x7f7408160510 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f74040097a0 tx=0x7f740401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=647dcfcbedb4e2a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:30.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740cca4640 1 -- 172.21.15.55:0/2195702877 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74040ab600 con 0x7f740815c9c0 2023-08-25T05:19:30.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740cca4640 1 -- 172.21.15.55:0/2195702877 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74040a7050 con 0x7f740815c9c0 2023-08-25T05:19:30.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740cca4640 1 -- 172.21.15.55:0/2195702877 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74040ab980 con 0x7f740815c9c0 2023-08-25T05:19:30.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740ff0a640 1 -- 172.21.15.55:0/2195702877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f740815c9c0 msgr2=0x7f7408160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:30.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740ff0a640 1 --2- 172.21.15.55:0/2195702877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f740815c9c0 0x7f7408160510 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f74040097a0 tx=0x7f740401c430 comp rx=0 tx=0).stop 2023-08-25T05:19:30.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740ff0a640 1 -- 172.21.15.55:0/2195702877 shutdown_connections 2023-08-25T05:19:30.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740ff0a640 1 --2- 172.21.15.55:0/2195702877 >> v2:172.21.15.110:3300/0 conn(0x7f74080cfa70 0x7f7408160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:30.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740ff0a640 1 --2- 172.21.15.55:0/2195702877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f740815c9c0 0x7f7408160510 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:30.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740ff0a640 1 -- 172.21.15.55:0/2195702877 >> 172.21.15.55:0/2195702877 conn(0x7f74080d05a0 msgr2=0x7f74080d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:30.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740ff0a640 1 -- 172.21.15.55:0/2195702877 shutdown_connections 2023-08-25T05:19:30.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740ff0a640 1 -- 172.21.15.55:0/2195702877 wait complete. 2023-08-25T05:19:30.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740ff0a640 1 Processor -- start 2023-08-25T05:19:30.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740ff0a640 1 -- start start 2023-08-25T05:19:30.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740ff0a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74080cfa70 0x7f740814a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:30.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740ff0a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f740815c9c0 0x7f740813c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:30.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740ff0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7408160f90 0x7f74080b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:30.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740ff0a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740814bb90 con 0x7f7408160f90 2023-08-25T05:19:30.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740ff0a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74081529f0 con 0x7f74080cfa70 2023-08-25T05:19:30.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.808+0000 7f740ff0a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740814b010 con 0x7f740815c9c0 2023-08-25T05:19:30.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f740e4a7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7408160f90 0x7f74080b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:30.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f740e4a7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7408160f90 0x7f74080b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59114/0 (socket says 172.21.15.55:59114) 2023-08-25T05:19:30.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f740e4a7640 1 -- 172.21.15.55:0/1091969383 learned_addr learned my addr 172.21.15.55:0/1091969383 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:30.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f740dca6640 1 --2- 172.21.15.55:0/1091969383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74080cfa70 0x7f740814a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:30.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f740d4a5640 1 --2- 172.21.15.55:0/1091969383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f740815c9c0 0x7f740813c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:30.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f740e4a7640 1 -- 172.21.15.55:0/1091969383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f740815c9c0 msgr2=0x7f740813c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:30.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f740e4a7640 1 --2- 172.21.15.55:0/1091969383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f740815c9c0 0x7f740813c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:30.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f740e4a7640 1 -- 172.21.15.55:0/1091969383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74080cfa70 msgr2=0x7f740814a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:30.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f740e4a7640 1 --2- 172.21.15.55:0/1091969383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74080cfa70 0x7f740814a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:30.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f740e4a7640 1 -- 172.21.15.55:0/1091969383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f8009420 con 0x7f7408160f90 2023-08-25T05:19:30.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f740e4a7640 1 --2- 172.21.15.55:0/1091969383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7408160f90 0x7f74080b1210 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f740000ca80 tx=0x7f740000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:30.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f73fe7fc640 1 -- 172.21.15.55:0/1091969383 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740000ac30 con 0x7f7408160f90 2023-08-25T05:19:30.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f73fe7fc640 1 -- 172.21.15.55:0/1091969383 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740000ad90 con 0x7f7408160f90 2023-08-25T05:19:30.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f73fe7fc640 1 -- 172.21.15.55:0/1091969383 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7400012600 con 0x7f7408160f90 2023-08-25T05:19:30.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f740ff0a640 1 -- 172.21.15.55:0/1091969383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74040093b0 con 0x7f7408160f90 2023-08-25T05:19:30.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f740ff0a640 1 -- 172.21.15.55:0/1091969383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740814b5d0 con 0x7f7408160f90 2023-08-25T05:19:30.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f740ff0a640 1 -- 172.21.15.55:0/1091969383 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74080b64f0 con 0x7f7408160f90 2023-08-25T05:19:30.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f73fe7fc640 1 -- 172.21.15.55:0/1091969383 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f7400007070 con 0x7f7408160f90 2023-08-25T05:19:30.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.812+0000 7f73fe7fc640 1 --2- 172.21.15.55:0/1091969383 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f73ec0657a0 0x7f73ec067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:30.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.816+0000 7f73fe7fc640 1 -- 172.21.15.55:0/1091969383 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7400082e30 con 0x7f7408160f90 2023-08-25T05:19:30.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.816+0000 7f740dca6640 1 --2- 172.21.15.55:0/1091969383 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f73ec0657a0 0x7f73ec067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:30.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.816+0000 7f740dca6640 1 --2- 172.21.15.55:0/1091969383 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f73ec0657a0 0x7f73ec067c60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74080c4080 tx=0x7f74040a6000 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:30.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.816+0000 7f73fe7fc640 1 -- 172.21.15.55:0/1091969383 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f74000507f0 con 0x7f7408160f90 2023-08-25T05:19:31.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:30.996+0000 7f740ff0a640 1 -- 172.21.15.55:0/1091969383 --> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7408169850 con 0x7f73ec0657a0 2023-08-25T05:19:31.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.000+0000 7f73fe7fc640 1 -- 172.21.15.55:0/1091969383 <== mgr.9163 v2:172.21.15.110:6832/221263034 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f74040ab6a0 con 0x7f73ec0657a0 2023-08-25T05:19:31.003 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T05:19:31.003 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:19:31.003 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-08-25T05:19:31.003 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:19:31.004 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T05:19:31.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.000+0000 7f740ff0a640 1 -- 172.21.15.55:0/1091969383 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f73ec0657a0 msgr2=0x7f73ec067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:31.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.000+0000 7f740ff0a640 1 --2- 172.21.15.55:0/1091969383 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f73ec0657a0 0x7f73ec067c60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74080c4080 tx=0x7f74040a6000 comp rx=0 tx=0).stop 2023-08-25T05:19:31.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.000+0000 7f740ff0a640 1 -- 172.21.15.55:0/1091969383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7408160f90 msgr2=0x7f74080b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:31.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.000+0000 7f740ff0a640 1 --2- 172.21.15.55:0/1091969383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7408160f90 0x7f74080b1210 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f740000ca80 tx=0x7f740000cf40 comp rx=0 tx=0).stop 2023-08-25T05:19:31.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.000+0000 7f740ff0a640 1 -- 172.21.15.55:0/1091969383 shutdown_connections 2023-08-25T05:19:31.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.000+0000 7f740ff0a640 1 --2- 172.21.15.55:0/1091969383 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7408160f90 0x7f74080b1210 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:31.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.000+0000 7f740ff0a640 1 --2- 172.21.15.55:0/1091969383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f740815c9c0 0x7f740813c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:31.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.000+0000 7f740ff0a640 1 --2- 172.21.15.55:0/1091969383 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f73ec0657a0 0x7f73ec067c60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:31.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.000+0000 7f740ff0a640 1 --2- 172.21.15.55:0/1091969383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74080cfa70 0x7f740814a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:31.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.000+0000 7f740ff0a640 1 -- 172.21.15.55:0/1091969383 >> 172.21.15.55:0/1091969383 conn(0x7f74080d05a0 msgr2=0x7f74080adc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:31.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.000+0000 7f740ff0a640 1 -- 172.21.15.55:0/1091969383 shutdown_connections 2023-08-25T05:19:31.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.000+0000 7f740ff0a640 1 -- 172.21.15.55:0/1091969383 wait complete. 2023-08-25T05:19:31.024 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-25T05:19:31.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.164+0000 7f3bc0f8f640 1 Processor -- start 2023-08-25T05:19:31.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.164+0000 7f3bc0f8f640 1 -- start start 2023-08-25T05:19:31.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.164+0000 7f3bc0f8f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bbc06e5a0 0x7f3bbc0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:31.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.164+0000 7f3bc0f8f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3bbc06c790 0x7f3bbc0ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:31.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.164+0000 7f3bc0f8f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bbc0cab90 con 0x7f3bbc06c3b0 2023-08-25T05:19:31.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.164+0000 7f3bc0f8f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bbc06dbb0 con 0x7f3bbc06c790 2023-08-25T05:19:31.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.164+0000 7f3bc0f8f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc0cae50 con 0x7f3bbc06e5a0 2023-08-25T05:19:31.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.168+0000 7f3bbad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3bbc06c790 0x7f3bbc0ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:31.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.168+0000 7f3bbad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3bbc06c790 0x7f3bbc0ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59128/0 (socket says 172.21.15.55:59128) 2023-08-25T05:19:31.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.168+0000 7f3bba59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3bbc06c3b0 0x7f3bbc06de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58958/0 (socket says 172.21.15.55:58958) 2023-08-25T05:19:31.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.168+0000 7f3bbad9d640 1 -- 172.21.15.55:0/2563144763 learned_addr learned my addr 172.21.15.55:0/2563144763 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:31.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.168+0000 7f3bb1d9b640 1 --2- 172.21.15.55:0/2563144763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bbc06e5a0 0x7f3bbc0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:31.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.168+0000 7f3bbad9d640 1 -- 172.21.15.55:0/2563144763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bbc06e5a0 msgr2=0x7f3bbc0cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:31.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.168+0000 7f3bbad9d640 1 --2- 172.21.15.55:0/2563144763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bbc06e5a0 0x7f3bbc0cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:31.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.168+0000 7f3bbad9d640 1 -- 172.21.15.55:0/2563144763 >> v1:172.21.15.55:6789/0 conn(0x7f3bbc06c3b0 legacy=0x7f3bbc06de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:31.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.168+0000 7f3bbad9d640 1 -- 172.21.15.55:0/2563144763 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc0cb130 con 0x7f3bbc06c790 2023-08-25T05:19:31.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.168+0000 7f3bb9d9b640 1 -- 172.21.15.55:0/2563144763 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864160141 0 0) 0x7f3bbc0cab90 con 0x7f3bbc06c3b0 2023-08-25T05:19:31.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.168+0000 7f3bbad9d640 1 --2- 172.21.15.55:0/2563144763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bbc06c790 0x7f3bbc0ce8b0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4009870 tx=0x7f3bb401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4767187665530598 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:31.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.168+0000 7f3bb9d9b640 1 -- 172.21.15.55:0/2563144763 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb40aa650 con 0x7f3bbc06c790 2023-08-25T05:19:31.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.168+0000 7f3bb9d9b640 1 -- 172.21.15.55:0/2563144763 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb40aa7b0 con 0x7f3bbc06c790 2023-08-25T05:19:31.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.168+0000 7f3bb9d9b640 1 -- 172.21.15.55:0/2563144763 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb40aab40 con 0x7f3bbc06c790 2023-08-25T05:19:31.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bc0f8f640 1 -- 172.21.15.55:0/2563144763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bbc06c790 msgr2=0x7f3bbc0ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:31.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bc0f8f640 1 --2- 172.21.15.55:0/2563144763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bbc06c790 0x7f3bbc0ce8b0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4009870 tx=0x7f3bb401c510 comp rx=0 tx=0).stop 2023-08-25T05:19:31.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bc0f8f640 1 -- 172.21.15.55:0/2563144763 shutdown_connections 2023-08-25T05:19:31.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bc0f8f640 1 --2- 172.21.15.55:0/2563144763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bbc06e5a0 0x7f3bbc0cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:31.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bc0f8f640 1 --2- 172.21.15.55:0/2563144763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bbc06c790 0x7f3bbc0ce8b0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:31.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bc0f8f640 1 -- 172.21.15.55:0/2563144763 >> 172.21.15.55:0/2563144763 conn(0x7f3bbc0d0540 msgr2=0x7f3bbc0d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:31.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bc0f8f640 1 -- 172.21.15.55:0/2563144763 shutdown_connections 2023-08-25T05:19:31.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bc0f8f640 1 -- 172.21.15.55:0/2563144763 wait complete. 2023-08-25T05:19:31.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bc0f8f640 1 Processor -- start 2023-08-25T05:19:31.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bc0f8f640 1 -- start start 2023-08-25T05:19:31.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bc0f8f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bbc06c3b0 0x7f3bbc0b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:31.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bc0f8f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bbc06c790 0x7f3bbc156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:31.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bc0f8f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bbc06e5a0 0x7f3bbc15a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:31.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bc0f8f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc157fd0 con 0x7f3bbc06c3b0 2023-08-25T05:19:31.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bc0f8f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc1573c0 con 0x7f3bbc06c790 2023-08-25T05:19:31.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bc0f8f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc1576a0 con 0x7f3bbc06e5a0 2023-08-25T05:19:31.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bba59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bbc06c3b0 0x7f3bbc0b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:31.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bba59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bbc06c3b0 0x7f3bbc0b38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59144/0 (socket says 172.21.15.55:59144) 2023-08-25T05:19:31.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bba59c640 1 -- 172.21.15.55:0/3458607465 learned_addr learned my addr 172.21.15.55:0/3458607465 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:31.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bb1d9b640 1 --2- 172.21.15.55:0/3458607465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bbc06c790 0x7f3bbc156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:31.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bbad9d640 1 --2- 172.21.15.55:0/3458607465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bbc06e5a0 0x7f3bbc15a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:31.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bba59c640 1 -- 172.21.15.55:0/3458607465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bbc06e5a0 msgr2=0x7f3bbc15a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:31.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.172+0000 7f3bba59c640 1 --2- 172.21.15.55:0/3458607465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bbc06e5a0 0x7f3bbc15a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:31.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.176+0000 7f3bba59c640 1 -- 172.21.15.55:0/3458607465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bbc06c790 msgr2=0x7f3bbc156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:31.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.176+0000 7f3bba59c640 1 --2- 172.21.15.55:0/3458607465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bbc06c790 0x7f3bbc156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:31.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.176+0000 7f3bba59c640 1 -- 172.21.15.55:0/3458607465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb40094d0 con 0x7f3bbc06c3b0 2023-08-25T05:19:31.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.176+0000 7f3bbad9d640 1 --2- 172.21.15.55:0/3458607465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bbc06e5a0 0x7f3bbc15a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:19:31.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.176+0000 7f3bba59c640 1 --2- 172.21.15.55:0/3458607465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bbc06c3b0 0x7f3bbc0b38f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00c4d0 tx=0x7f3bac00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:31.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.176+0000 7f3bb37fe640 1 -- 172.21.15.55:0/3458607465 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac007480 con 0x7f3bbc06c3b0 2023-08-25T05:19:31.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.176+0000 7f3bb37fe640 1 -- 172.21.15.55:0/3458607465 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac0075e0 con 0x7f3bbc06c3b0 2023-08-25T05:19:31.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.176+0000 7f3bc0f8f640 1 -- 172.21.15.55:0/3458607465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bbc157980 con 0x7f3bbc06c3b0 2023-08-25T05:19:31.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.176+0000 7f3bb37fe640 1 -- 172.21.15.55:0/3458607465 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac0059d0 con 0x7f3bbc06c3b0 2023-08-25T05:19:31.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.176+0000 7f3bc0f8f640 1 -- 172.21.15.55:0/3458607465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bbc156dc0 con 0x7f3bbc06c3b0 2023-08-25T05:19:31.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.176+0000 7f3bc0f8f640 1 -- 172.21.15.55:0/3458607465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bbc073ec0 con 0x7f3bbc06c3b0 2023-08-25T05:19:31.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.176+0000 7f3bb37fe640 1 -- 172.21.15.55:0/3458607465 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 88) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f3bac005b30 con 0x7f3bbc06c3b0 2023-08-25T05:19:31.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.176+0000 7f3bb37fe640 1 --2- 172.21.15.55:0/3458607465 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f3b9c0657a0 0x7f3b9c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.176+0000 7f3bb37fe640 1 -- 172.21.15.55:0/3458607465 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3bac082550 con 0x7f3bbc06c3b0 2023-08-25T05:19:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.180+0000 7f3bb1d9b640 1 --2- 172.21.15.55:0/3458607465 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f3b9c0657a0 0x7f3b9c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:31.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.180+0000 7f3bb1d9b640 1 --2- 172.21.15.55:0/3458607465 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f3b9c0657a0 0x7f3b9c067c60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc15b570 tx=0x7f3ba4009830 comp rx=0 tx=0).ready entity=mgr.9163 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:31.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.180+0000 7f3bb37fe640 1 -- 172.21.15.55:0/3458607465 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3bac04ff10 con 0x7f3bbc06c3b0 2023-08-25T05:19:31.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.372+0000 7f3bc0f8f640 1 -- 172.21.15.55:0/3458607465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f3bbc158f90 con 0x7f3bbc06c3b0 2023-08-25T05:19:31.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.888+0000 7f3bb37fe640 1 -- 172.21.15.55:0/3458607465 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 89) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f3bac0502e0 con 0x7f3bbc06c3b0 2023-08-25T05:19:31.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.892+0000 7f3bb37fe640 1 -- 172.21.15.55:0/3458607465 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v89) v1 ==== 92+0+0 (secure 0 0 0) 0x7f3bac04ff10 con 0x7f3bbc06c3b0 2023-08-25T05:19:31.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.896+0000 7f3bc0f8f640 1 -- 172.21.15.55:0/3458607465 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f3b9c0657a0 msgr2=0x7f3b9c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:31.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.896+0000 7f3bc0f8f640 1 --2- 172.21.15.55:0/3458607465 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f3b9c0657a0 0x7f3b9c067c60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc15b570 tx=0x7f3ba4009830 comp rx=0 tx=0).stop 2023-08-25T05:19:31.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.896+0000 7f3bc0f8f640 1 -- 172.21.15.55:0/3458607465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bbc06c3b0 msgr2=0x7f3bbc0b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:31.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.896+0000 7f3bc0f8f640 1 --2- 172.21.15.55:0/3458607465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bbc06c3b0 0x7f3bbc0b38f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f3bac00c4d0 tx=0x7f3bac00c990 comp rx=0 tx=0).stop 2023-08-25T05:19:31.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.896+0000 7f3bc0f8f640 1 -- 172.21.15.55:0/3458607465 shutdown_connections 2023-08-25T05:19:31.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.896+0000 7f3bc0f8f640 1 --2- 172.21.15.55:0/3458607465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bbc06e5a0 0x7f3bbc15a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:31.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.896+0000 7f3bc0f8f640 1 --2- 172.21.15.55:0/3458607465 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f3b9c0657a0 0x7f3b9c067c60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:31.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.896+0000 7f3bc0f8f640 1 --2- 172.21.15.55:0/3458607465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bbc06c790 0x7f3bbc156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:31.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.896+0000 7f3bc0f8f640 1 --2- 172.21.15.55:0/3458607465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bbc06c3b0 0x7f3bbc0b38f0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:31.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.896+0000 7f3bc0f8f640 1 -- 172.21.15.55:0/3458607465 >> 172.21.15.55:0/3458607465 conn(0x7f3bbc0d0540 msgr2=0x7f3bbc0adb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:31.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.896+0000 7f3bc0f8f640 1 -- 172.21.15.55:0/3458607465 shutdown_connections 2023-08-25T05:19:31.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:31.896+0000 7f3bc0f8f640 1 -- 172.21.15.55:0/3458607465 wait complete. 2023-08-25T05:19:31.928 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-25T05:19:32.073 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:32.070+0000 7f931863a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:19:32.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.072+0000 7f20d52cb640 1 Processor -- start 2023-08-25T05:19:32.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.072+0000 7f20d52cb640 1 -- start start 2023-08-25T05:19:32.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.076+0000 7f20d52cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20d015ca30 0x7f20d00cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:32.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.076+0000 7f20d52cb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f20d00ce610 0x7f20d00cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:32.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.076+0000 7f20d52cb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d00cd340 con 0x7f20d00d0e10 2023-08-25T05:19:32.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.076+0000 7f20d52cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d00ce180 con 0x7f20d015ca30 2023-08-25T05:19:32.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.076+0000 7f20d52cb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d00cd570 con 0x7f20d00ce610 2023-08-25T05:19:32.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.076+0000 7f20ceffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20d015ca30 0x7f20d00cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:32.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.076+0000 7f20ceffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f20d015ca30 0x7f20d00cf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59180/0 (socket says 172.21.15.55:59180) 2023-08-25T05:19:32.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.076+0000 7f20ceffd640 1 -- 172.21.15.55:0/1515709331 learned_addr learned my addr 172.21.15.55:0/1515709331 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:32.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.076+0000 7f20c7fff640 1 --2- 172.21.15.55:0/1515709331 >> v2:172.21.15.110:3300/0 conn(0x7f20d00ce610 0x7f20d00cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:32.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.076+0000 7f20ceffd640 1 -- 172.21.15.55:0/1515709331 >> v2:172.21.15.110:3300/0 conn(0x7f20d00ce610 msgr2=0x7f20d00cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:32.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.076+0000 7f20ceffd640 1 --2- 172.21.15.55:0/1515709331 >> v2:172.21.15.110:3300/0 conn(0x7f20d00ce610 0x7f20d00cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.076+0000 7f20ceffd640 1 -- 172.21.15.55:0/1515709331 >> v1:172.21.15.110:6789/0 conn(0x7f20d00d0e10 legacy=0x7f20d00d11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:32.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.076+0000 7f20ceffd640 1 -- 172.21.15.55:0/1515709331 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d00cd850 con 0x7f20d015ca30 2023-08-25T05:19:32.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.076+0000 7f20ceffd640 1 --2- 172.21.15.55:0/1515709331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d015ca30 0x7f20d00cf190 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f20d00a0770 tx=0x7f20c001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43b7d10ea344deb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:32.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20ce7fc640 1 -- 172.21.15.55:0/1515709331 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c00aa430 con 0x7f20d015ca30 2023-08-25T05:19:32.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20ce7fc640 1 -- 172.21.15.55:0/1515709331 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c00aa590 con 0x7f20d015ca30 2023-08-25T05:19:32.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20ce7fc640 1 -- 172.21.15.55:0/1515709331 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c00aa920 con 0x7f20d015ca30 2023-08-25T05:19:32.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20d52cb640 1 -- 172.21.15.55:0/1515709331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d015ca30 msgr2=0x7f20d00cf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:32.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20d52cb640 1 --2- 172.21.15.55:0/1515709331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d015ca30 0x7f20d00cf190 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f20d00a0770 tx=0x7f20c001c4d0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20d52cb640 1 -- 172.21.15.55:0/1515709331 shutdown_connections 2023-08-25T05:19:32.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20d52cb640 1 --2- 172.21.15.55:0/1515709331 >> v2:172.21.15.110:3300/0 conn(0x7f20d00ce610 0x7f20d00cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20d52cb640 1 --2- 172.21.15.55:0/1515709331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d015ca30 0x7f20d00cf190 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20d52cb640 1 -- 172.21.15.55:0/1515709331 >> 172.21.15.55:0/1515709331 conn(0x7f20d009bb30 msgr2=0x7f20d00d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:32.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20d52cb640 1 -- 172.21.15.55:0/1515709331 shutdown_connections 2023-08-25T05:19:32.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20d52cb640 1 -- 172.21.15.55:0/1515709331 wait complete. 2023-08-25T05:19:32.085 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f29d9ae2180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:19:32.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20d52cb640 1 Processor -- start 2023-08-25T05:19:32.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20d52cb640 1 -- start start 2023-08-25T05:19:32.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20d52cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20d00ce610 0x7f20d014e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:32.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20d52cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20d00d0e10 0x7f20d014cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:32.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20d52cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d015ca30 0x7f20d015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:32.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20d52cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d00b5cd0 con 0x7f20d015ca30 2023-08-25T05:19:32.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20d52cb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d01597f0 con 0x7f20d00d0e10 2023-08-25T05:19:32.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.080+0000 7f20d52cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d0159fc0 con 0x7f20d00ce610 2023-08-25T05:19:32.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20cf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d015ca30 0x7f20d015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:32.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20ceffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20d00ce610 0x7f20d014e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:32.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20c7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20d00d0e10 0x7f20d014cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:32.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20c7fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20d00d0e10 0x7f20d014cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:54950/0 (socket says 172.21.15.55:54950) 2023-08-25T05:19:32.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20ceffd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20d00ce610 0x7f20d014e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:47944/0 (socket says 172.21.15.55:47944) 2023-08-25T05:19:32.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20c7fff640 1 -- 172.21.15.55:0/2442670957 learned_addr learned my addr 172.21.15.55:0/2442670957 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20cf7fe640 1 -- 172.21.15.55:0/2442670957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20d00ce610 msgr2=0x7f20d014e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20cf7fe640 1 --2- 172.21.15.55:0/2442670957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20d00ce610 0x7f20d014e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20cf7fe640 1 -- 172.21.15.55:0/2442670957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20d00d0e10 msgr2=0x7f20d014cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:32.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20cf7fe640 1 --2- 172.21.15.55:0/2442670957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20d00d0e10 0x7f20d014cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20cf7fe640 1 -- 172.21.15.55:0/2442670957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c0009470 con 0x7f20d015ca30 2023-08-25T05:19:32.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20ceffd640 1 --2- 172.21.15.55:0/2442670957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20d00ce610 0x7f20d014e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:19:32.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20cf7fe640 1 --2- 172.21.15.55:0/2442670957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d015ca30 0x7f20d015a180 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c700 tx=0x7f20c800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:32.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20c77fe640 1 -- 172.21.15.55:0/2442670957 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8003b80 con 0x7f20d015ca30 2023-08-25T05:19:32.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20c77fe640 1 -- 172.21.15.55:0/2442670957 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c8003ce0 con 0x7f20d015ca30 2023-08-25T05:19:32.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20c77fe640 1 -- 172.21.15.55:0/2442670957 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c800aa30 con 0x7f20d015ca30 2023-08-25T05:19:32.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20d52cb640 1 -- 172.21.15.55:0/2442670957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d00b59f0 con 0x7f20d015ca30 2023-08-25T05:19:32.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20d52cb640 1 -- 172.21.15.55:0/2442670957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d0159ce0 con 0x7f20d015ca30 2023-08-25T05:19:32.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20d52cb640 1 -- 172.21.15.55:0/2442670957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d0073ec0 con 0x7f20d015ca30 2023-08-25T05:19:32.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.084+0000 7f20c77fe640 1 -- 172.21.15.55:0/2442670957 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 89) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f20c800ab90 con 0x7f20d015ca30 2023-08-25T05:19:32.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.088+0000 7f20c77fe640 1 --2- 172.21.15.55:0/2442670957 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f20b00657f0 0x7f20b0067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:32.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.088+0000 7f20c77fe640 1 -- 172.21.15.55:0/2442670957 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f20c8082d10 con 0x7f20d015ca30 2023-08-25T05:19:32.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.088+0000 7f20ceffd640 1 -- 172.21.15.55:0/2442670957 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f20b00657f0 msgr2=0x7f20b0067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/221263034 2023-08-25T05:19:32.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.088+0000 7f20ceffd640 1 --2- 172.21.15.55:0/2442670957 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f20b00657f0 0x7f20b0067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:19:32.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.092+0000 7f20c77fe640 1 -- 172.21.15.55:0/2442670957 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f20c8088020 con 0x7f20d015ca30 2023-08-25T05:19:32.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.248+0000 7f20d52cb640 1 -- 172.21.15.55:0/2442670957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f20d00cfeb0 con 0x7f20d015ca30 2023-08-25T05:19:32.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.252+0000 7f20c77fe640 1 -- 172.21.15.55:0/2442670957 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v59)=0 v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7f20c80506d0 con 0x7f20d015ca30 2023-08-25T05:19:32.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.256+0000 7f20d52cb640 1 -- 172.21.15.55:0/2442670957 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f20b00657f0 msgr2=0x7f20b0067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:19:32.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.256+0000 7f20d52cb640 1 --2- 172.21.15.55:0/2442670957 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f20b00657f0 0x7f20b0067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.256+0000 7f20d52cb640 1 -- 172.21.15.55:0/2442670957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d015ca30 msgr2=0x7f20d015a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:32.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.256+0000 7f20d52cb640 1 --2- 172.21.15.55:0/2442670957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d015ca30 0x7f20d015a180 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c700 tx=0x7f20c800cbc0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.256+0000 7f20d52cb640 1 -- 172.21.15.55:0/2442670957 shutdown_connections 2023-08-25T05:19:32.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.256+0000 7f20d52cb640 1 --2- 172.21.15.55:0/2442670957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f20d015ca30 0x7f20d015a180 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.256+0000 7f20d52cb640 1 --2- 172.21.15.55:0/2442670957 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f20b00657f0 0x7f20b0067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.256+0000 7f20d52cb640 1 --2- 172.21.15.55:0/2442670957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20d00d0e10 0x7f20d014cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.256+0000 7f20d52cb640 1 --2- 172.21.15.55:0/2442670957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20d00ce610 0x7f20d014e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.256+0000 7f20d52cb640 1 -- 172.21.15.55:0/2442670957 >> 172.21.15.55:0/2442670957 conn(0x7f20d009bb30 msgr2=0x7f20d015d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:32.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.256+0000 7f20d52cb640 1 -- 172.21.15.55:0/2442670957 shutdown_connections 2023-08-25T05:19:32.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.256+0000 7f20d52cb640 1 -- 172.21.15.55:0/2442670957 wait complete. 2023-08-25T05:19:32.280 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-08-25T05:19:32.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.424+0000 7fabaeb2c640 1 Processor -- start 2023-08-25T05:19:32.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.424+0000 7fabaeb2c640 1 -- start start 2023-08-25T05:19:32.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.424+0000 7fabaeb2c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faba81601f0 0x7faba815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:32.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.424+0000 7fabaeb2c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faba80d1290 0x7faba815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:32.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.424+0000 7fabaeb2c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba80cd5a0 con 0x7faba815e3c0 2023-08-25T05:19:32.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.424+0000 7fabaeb2c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba80cd880 con 0x7faba80d1290 2023-08-25T05:19:32.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.424+0000 7fabaeb2c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba80cdb60 con 0x7faba81601f0 2023-08-25T05:19:32.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.424+0000 7fabad0c9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faba80d1290 0x7faba815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:32.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.424+0000 7fabad0c9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faba80d1290 0x7faba815e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59202/0 (socket says 172.21.15.55:59202) 2023-08-25T05:19:32.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.424+0000 7fabad0c9640 1 -- 172.21.15.55:0/3439103924 learned_addr learned my addr 172.21.15.55:0/3439103924 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:32.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.424+0000 7fabac8c8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faba81601f0 0x7faba815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:32.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.424+0000 7fabad0c9640 1 -- 172.21.15.55:0/3439103924 >> v2:172.21.15.110:3300/0 conn(0x7faba81601f0 msgr2=0x7faba815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:32.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.424+0000 7fabad0c9640 1 --2- 172.21.15.55:0/3439103924 >> v2:172.21.15.110:3300/0 conn(0x7faba81601f0 0x7faba815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.424+0000 7fabad0c9640 1 -- 172.21.15.55:0/3439103924 >> v1:172.21.15.110:6789/0 conn(0x7faba815e3c0 legacy=0x7faba80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:32.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.424+0000 7fabad0c9640 1 -- 172.21.15.55:0/3439103924 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba80cde40 con 0x7faba80d1290 2023-08-25T05:19:32.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.428+0000 7fabad0c9640 1 --2- 172.21.15.55:0/3439103924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faba80d1290 0x7faba815e8a0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7faba808b7f0 tx=0x7faba001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27e502a1b8b5e02 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:32.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.428+0000 7faba77fe640 1 -- 172.21.15.55:0/3439103924 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba00a5790 con 0x7faba80d1290 2023-08-25T05:19:32.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.428+0000 7faba77fe640 1 -- 172.21.15.55:0/3439103924 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba00a58f0 con 0x7faba80d1290 2023-08-25T05:19:32.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.428+0000 7faba77fe640 1 -- 172.21.15.55:0/3439103924 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba00a5c80 con 0x7faba80d1290 2023-08-25T05:19:32.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.428+0000 7fabaeb2c640 1 -- 172.21.15.55:0/3439103924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faba80d1290 msgr2=0x7faba815e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:32.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.428+0000 7fabaeb2c640 1 --2- 172.21.15.55:0/3439103924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faba80d1290 0x7faba815e8a0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7faba808b7f0 tx=0x7faba001c9a0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.428+0000 7fabaeb2c640 1 -- 172.21.15.55:0/3439103924 shutdown_connections 2023-08-25T05:19:32.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.428+0000 7fabaeb2c640 1 --2- 172.21.15.55:0/3439103924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faba80d1290 0x7faba815e8a0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.428+0000 7fabaeb2c640 1 --2- 172.21.15.55:0/3439103924 >> v2:172.21.15.110:3300/0 conn(0x7faba81601f0 0x7faba815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.428+0000 7fabaeb2c640 1 -- 172.21.15.55:0/3439103924 >> 172.21.15.55:0/3439103924 conn(0x7faba80d27d0 msgr2=0x7faba80d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:32.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.428+0000 7fabaeb2c640 1 -- 172.21.15.55:0/3439103924 shutdown_connections 2023-08-25T05:19:32.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.428+0000 7fabaeb2c640 1 -- 172.21.15.55:0/3439103924 wait complete. 2023-08-25T05:19:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabaeb2c640 1 Processor -- start 2023-08-25T05:19:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabaeb2c640 1 -- start start 2023-08-25T05:19:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabaeb2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faba80d1290 0x7faba8153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabaeb2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faba815e3c0 0x7faba81563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabaeb2c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faba81601f0 0x7faba8159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabaeb2c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba8154650 con 0x7faba80d1290 2023-08-25T05:19:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabaeb2c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba80c7ff0 con 0x7faba815e3c0 2023-08-25T05:19:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabaeb2c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba80c82d0 con 0x7faba81601f0 2023-08-25T05:19:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabac8c8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faba80d1290 0x7faba8153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:32.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabac8c8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faba80d1290 0x7faba8153930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59206/0 (socket says 172.21.15.55:59206) 2023-08-25T05:19:32.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabac8c8640 1 -- 172.21.15.55:0/2195997744 learned_addr learned my addr 172.21.15.55:0/2195997744 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:32.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7faba7fff640 1 --2- 172.21.15.55:0/2195997744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faba815e3c0 0x7faba81563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:32.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabad0c9640 1 --2- 172.21.15.55:0/2195997744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faba81601f0 0x7faba8159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:32.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabac8c8640 1 -- 172.21.15.55:0/2195997744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faba81601f0 msgr2=0x7faba8159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:32.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabac8c8640 1 --2- 172.21.15.55:0/2195997744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faba81601f0 0x7faba8159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabac8c8640 1 -- 172.21.15.55:0/2195997744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faba815e3c0 msgr2=0x7faba81563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:32.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabac8c8640 1 --2- 172.21.15.55:0/2195997744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faba815e3c0 0x7faba81563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabac8c8640 1 -- 172.21.15.55:0/2195997744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba0009b30 con 0x7faba80d1290 2023-08-25T05:19:32.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabac8c8640 1 --2- 172.21.15.55:0/2195997744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faba80d1290 0x7faba8153930 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00e870 tx=0x7fab9c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:32.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7faba57fa640 1 -- 172.21.15.55:0/2195997744 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c0095d0 con 0x7faba80d1290 2023-08-25T05:19:32.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7faba57fa640 1 -- 172.21.15.55:0/2195997744 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c00c940 con 0x7faba80d1290 2023-08-25T05:19:32.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7faba57fa640 1 -- 172.21.15.55:0/2195997744 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c00ccb0 con 0x7faba80d1290 2023-08-25T05:19:32.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.432+0000 7fabaeb2c640 1 -- 172.21.15.55:0/2195997744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba80ce7c0 con 0x7faba80d1290 2023-08-25T05:19:32.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.436+0000 7fabaeb2c640 1 -- 172.21.15.55:0/2195997744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba80c8890 con 0x7faba80d1290 2023-08-25T05:19:32.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.436+0000 7fabaeb2c640 1 -- 172.21.15.55:0/2195997744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba80b5260 con 0x7faba80d1290 2023-08-25T05:19:32.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.436+0000 7faba57fa640 1 -- 172.21.15.55:0/2195997744 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 89) v1 ==== 85081+0+0 (secure 0 0 0) 0x7fab9c013470 con 0x7faba80d1290 2023-08-25T05:19:32.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.440+0000 7faba57fa640 1 --2- 172.21.15.55:0/2195997744 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fab8c0657f0 0x7fab8c067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:32.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.440+0000 7faba57fa640 1 -- 172.21.15.55:0/2195997744 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab9c083480 con 0x7faba80d1290 2023-08-25T05:19:32.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.440+0000 7faba7fff640 1 -- 172.21.15.55:0/2195997744 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fab8c0657f0 msgr2=0x7fab8c067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/221263034 2023-08-25T05:19:32.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.440+0000 7faba7fff640 1 --2- 172.21.15.55:0/2195997744 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fab8c0657f0 0x7fab8c067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:19:32.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.444+0000 7faba57fa640 1 -- 172.21.15.55:0/2195997744 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fab9c050f90 con 0x7faba80d1290 2023-08-25T05:19:32.489 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:32.490+0000 7f931863a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:19:32.529 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:32.524+0000 7f29d9ae2180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:19:32.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.604+0000 7fabaeb2c640 1 -- 172.21.15.55:0/2195997744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7faba8073ec0 con 0x7faba80d1290 2023-08-25T05:19:32.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.608+0000 7faba57fa640 1 -- 172.21.15.55:0/2195997744 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v60)=0 v60) v1 ==== 133+0+0 (secure 0 0 0) 0x7fab9c0545b0 con 0x7faba80d1290 2023-08-25T05:19:32.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.612+0000 7fabaeb2c640 1 -- 172.21.15.55:0/2195997744 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fab8c0657f0 msgr2=0x7fab8c067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:19:32.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.612+0000 7fabaeb2c640 1 --2- 172.21.15.55:0/2195997744 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fab8c0657f0 0x7fab8c067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.612+0000 7fabaeb2c640 1 -- 172.21.15.55:0/2195997744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faba80d1290 msgr2=0x7faba8153930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:32.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.612+0000 7fabaeb2c640 1 --2- 172.21.15.55:0/2195997744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faba80d1290 0x7faba8153930 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00e870 tx=0x7fab9c00ed30 comp rx=0 tx=0).stop 2023-08-25T05:19:32.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.612+0000 7fabaeb2c640 1 -- 172.21.15.55:0/2195997744 shutdown_connections 2023-08-25T05:19:32.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.612+0000 7fabaeb2c640 1 --2- 172.21.15.55:0/2195997744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faba81601f0 0x7faba8159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.612+0000 7fabaeb2c640 1 --2- 172.21.15.55:0/2195997744 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7fab8c0657f0 0x7fab8c067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.612+0000 7fabaeb2c640 1 --2- 172.21.15.55:0/2195997744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faba815e3c0 0x7faba81563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.612+0000 7fabaeb2c640 1 --2- 172.21.15.55:0/2195997744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faba80d1290 0x7faba8153930 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.612+0000 7fabaeb2c640 1 -- 172.21.15.55:0/2195997744 >> 172.21.15.55:0/2195997744 conn(0x7faba80d27d0 msgr2=0x7faba80d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:32.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.612+0000 7fabaeb2c640 1 -- 172.21.15.55:0/2195997744 shutdown_connections 2023-08-25T05:19:32.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.612+0000 7fabaeb2c640 1 -- 172.21.15.55:0/2195997744 wait complete. 2023-08-25T05:19:32.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:19:32.637 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-25T05:19:32.640 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:32.638+0000 7f931863a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:19:32.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:19:32.654 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-08-25T05:19:32.688 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:32.684+0000 7f29d9ae2180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:19:32.700 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-08-25T05:19:32.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.892+0000 7f10dcdd2640 1 Processor -- start 2023-08-25T05:19:32.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.892+0000 7f10dcdd2640 1 -- start start 2023-08-25T05:19:32.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.896+0000 7f10dcdd2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f10d815cb40 0x7f10d80d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:32.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.896+0000 7f10dcdd2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f10d80b6a00 0x7f10d80cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:32.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.896+0000 7f10dcdd2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d80d1970 con 0x7f10d80cf340 2023-08-25T05:19:32.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.896+0000 7f10dcdd2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d80cfcf0 con 0x7f10d815cb40 2023-08-25T05:19:32.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.896+0000 7f10dcdd2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d80d0d80 con 0x7f10d80b6a00 2023-08-25T05:19:32.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.896+0000 7f10d659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f10d815cb40 0x7f10d80d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:32.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.896+0000 7f10cffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f10d80cf340 0x7f10d80b43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58962/0 (socket says 172.21.15.55:58962) 2023-08-25T05:19:32.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.896+0000 7f10cffff640 1 -- 172.21.15.55:0/1960830203 learned_addr learned my addr 172.21.15.55:0/1960830203 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:32.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.896+0000 7f10d6d9d640 1 --2- 172.21.15.55:0/1960830203 >> v2:172.21.15.110:3300/0 conn(0x7f10d80b6a00 0x7f10d80cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:32.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.896+0000 7f10d6d9d640 1 -- 172.21.15.55:0/1960830203 >> v2:172.21.15.55:3300/0 conn(0x7f10d815cb40 msgr2=0x7f10d80d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:19:32.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.896+0000 7f10d6d9d640 1 --2- 172.21.15.55:0/1960830203 >> v2:172.21.15.55:3300/0 conn(0x7f10d815cb40 0x7f10d80d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.896+0000 7f10d5d9b640 1 -- 172.21.15.55:0/1960830203 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850910200 0 0) 0x7f10d80d1970 con 0x7f10d80cf340 2023-08-25T05:19:32.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.896+0000 7f10d6d9d640 1 -- 172.21.15.55:0/1960830203 >> v1:172.21.15.55:6789/0 conn(0x7f10d80cf340 legacy=0x7f10d80b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:32.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.896+0000 7f10d6d9d640 1 -- 172.21.15.55:0/1960830203 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d80d1040 con 0x7f10d80b6a00 2023-08-25T05:19:32.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.900+0000 7f10d6d9d640 1 --2- 172.21.15.55:0/1960830203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10d80b6a00 0x7f10d80cf7b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f10d806b8b0 tx=0x7f10d001f0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0c146a55f08935f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:32.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.900+0000 7f10d5d9b640 1 -- 172.21.15.55:0/1960830203 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d00b0440 con 0x7f10d80b6a00 2023-08-25T05:19:32.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.900+0000 7f10d5d9b640 1 -- 172.21.15.55:0/1960830203 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d00b05a0 con 0x7f10d80b6a00 2023-08-25T05:19:32.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.900+0000 7f10d5d9b640 1 -- 172.21.15.55:0/1960830203 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d00b0930 con 0x7f10d80b6a00 2023-08-25T05:19:32.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.900+0000 7f10dcdd2640 1 -- 172.21.15.55:0/1960830203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10d80b6a00 msgr2=0x7f10d80cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:32.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.900+0000 7f10dcdd2640 1 --2- 172.21.15.55:0/1960830203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10d80b6a00 0x7f10d80cf7b0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f10d806b8b0 tx=0x7f10d001f0f0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.900+0000 7f10dcdd2640 1 -- 172.21.15.55:0/1960830203 shutdown_connections 2023-08-25T05:19:32.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.900+0000 7f10dcdd2640 1 --2- 172.21.15.55:0/1960830203 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10d80b6a00 0x7f10d80cf7b0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.900+0000 7f10dcdd2640 1 --2- 172.21.15.55:0/1960830203 >> v2:172.21.15.55:3300/0 conn(0x7f10d815cb40 0x7f10d80d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.900+0000 7f10dcdd2640 1 -- 172.21.15.55:0/1960830203 >> 172.21.15.55:0/1960830203 conn(0x7f10d806aae0 msgr2=0x7f10d806aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:32.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.900+0000 7f10dcdd2640 1 -- 172.21.15.55:0/1960830203 shutdown_connections 2023-08-25T05:19:32.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.900+0000 7f10dcdd2640 1 -- 172.21.15.55:0/1960830203 wait complete. 2023-08-25T05:19:32.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.900+0000 7f10dcdd2640 1 Processor -- start 2023-08-25T05:19:32.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.900+0000 7f10dcdd2640 1 -- start start 2023-08-25T05:19:32.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10dcdd2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10d80b6a00 0x7f10d81f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:32.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10dcdd2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10d80cf340 0x7f10d815a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:32.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10dcdd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10d815cb40 0x7f10d815a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:32.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10dcdd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d81f6920 con 0x7f10d815cb40 2023-08-25T05:19:32.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10dcdd2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d815e9a0 con 0x7f10d80cf340 2023-08-25T05:19:32.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10dcdd2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d80b2760 con 0x7f10d80b6a00 2023-08-25T05:19:32.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10d6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10d815cb40 0x7f10d815a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:32.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10d659c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10d80b6a00 0x7f10d81f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:32.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10d6d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10d815cb40 0x7f10d815a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59226/0 (socket says 172.21.15.55:59226) 2023-08-25T05:19:32.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10d6d9d640 1 -- 172.21.15.55:0/1478223077 learned_addr learned my addr 172.21.15.55:0/1478223077 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:32.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10cffff640 1 --2- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10d80cf340 0x7f10d815a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:32.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10d659c640 1 -- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10d80cf340 msgr2=0x7f10d815a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:32.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10d659c640 1 --2- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10d80cf340 0x7f10d815a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10d659c640 1 -- 172.21.15.55:0/1478223077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10d815cb40 msgr2=0x7f10d815a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10d659c640 1 --2- 172.21.15.55:0/1478223077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10d815cb40 0x7f10d815a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10d659c640 1 -- 172.21.15.55:0/1478223077 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d0009a70 con 0x7f10d80b6a00 2023-08-25T05:19:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10d659c640 1 --2- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10d80b6a00 0x7f10d81f63e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f10c800e8a0 tx=0x7f10c800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10ceffd640 1 -- 172.21.15.55:0/1478223077 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c800c940 con 0x7f10d80b6a00 2023-08-25T05:19:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10ceffd640 1 -- 172.21.15.55:0/1478223077 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c800caa0 con 0x7f10d80b6a00 2023-08-25T05:19:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10ceffd640 1 -- 172.21.15.55:0/1478223077 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c800ce10 con 0x7f10d80b6a00 2023-08-25T05:19:32.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10dcdd2640 1 -- 172.21.15.55:0/1478223077 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d8151a80 con 0x7f10d80b6a00 2023-08-25T05:19:32.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10dcdd2640 1 -- 172.21.15.55:0/1478223077 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d8152040 con 0x7f10d80b6a00 2023-08-25T05:19:32.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10dcdd2640 1 -- 172.21.15.55:0/1478223077 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d8071f80 con 0x7f10d80b6a00 2023-08-25T05:19:32.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.904+0000 7f10ceffd640 1 -- 172.21.15.55:0/1478223077 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 89) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f10c8013470 con 0x7f10d80b6a00 2023-08-25T05:19:32.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.908+0000 7f10ceffd640 1 --2- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f10b80657f0 0x7f10b8067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:32.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.908+0000 7f10ceffd640 1 -- 172.21.15.55:0/1478223077 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10c80831a0 con 0x7f10d80b6a00 2023-08-25T05:19:32.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.908+0000 7f10cffff640 1 -- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f10b80657f0 msgr2=0x7f10b8067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/221263034 2023-08-25T05:19:32.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.908+0000 7f10cffff640 1 --2- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f10b80657f0 0x7f10b8067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:19:32.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:32.912+0000 7f10ceffd640 1 -- 172.21.15.55:0/1478223077 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f10c8050b60 con 0x7f10d80b6a00 2023-08-25T05:19:33.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:33.088+0000 7f10dcdd2640 1 -- 172.21.15.55:0/1478223077 --> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f10d80d1600 con 0x7f10b80657f0 2023-08-25T05:19:33.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:33.112+0000 7f10cffff640 1 -- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f10b80657f0 msgr2=0x7f10b8067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/221263034 2023-08-25T05:19:33.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:33.112+0000 7f10cffff640 1 --2- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f10b80657f0 0x7f10b8067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-25T05:19:33.121 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:33.122+0000 7f931863a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:19:33.179 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:33.178+0000 7f931863a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:19:33.201 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:33.196+0000 7f29d9ae2180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:19:33.236 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:33.234+0000 7f931863a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:19:33.263 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:33.260+0000 7f29d9ae2180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:19:33.321 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:33.316+0000 7f29d9ae2180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:19:33.322 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:33.322+0000 7f931863a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:19:33.380 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:33.378+0000 7f931863a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:19:33.412 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:33.408+0000 7f29d9ae2180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:19:33.463 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:33.462+0000 7f931863a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:19:33.471 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:33.468+0000 7f29d9ae2180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:19:33.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:33.516+0000 7f10cffff640 1 -- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f10b80657f0 msgr2=0x7f10b8067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/221263034 2023-08-25T05:19:33.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:33.516+0000 7f10cffff640 1 --2- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f10b80657f0 0x7f10b8067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-25T05:19:33.519 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:33.518+0000 7f931863a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:19:33.559 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:33.556+0000 7f29d9ae2180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:19:33.617 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:33.612+0000 7f29d9ae2180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:19:33.663 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:33.662+0000 7f931863a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:19:33.720 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:33.718+0000 7f931863a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:19:33.767 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:33.764+0000 7f29d9ae2180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:19:33.828 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:33.824+0000 7f29d9ae2180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:19:33.959 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:19:33.960 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:19:33.960 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:19:33.967 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:33.966+0000 7f931863a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:19:34.076 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:19:34.077 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:19:34.077 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:19:34.086 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:34.080+0000 7f29d9ae2180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:19:34.104 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:34.102+0000 7f931863a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:19:34.227 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:34.224+0000 7f29d9ae2180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:19:34.228 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:34.226+0000 7f931863a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:19:34.298 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:34.298+0000 7f931863a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:19:34.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:34.320+0000 7f10cffff640 1 -- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f10b80657f0 msgr2=0x7f10b8067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/221263034 2023-08-25T05:19:34.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:34.320+0000 7f10cffff640 1 --2- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f10b80657f0 0x7f10b8067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-25T05:19:34.358 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:34.352+0000 7f29d9ae2180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:19:34.431 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:34.428+0000 7f29d9ae2180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:19:34.432 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:34.430+0000 7f931863a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:19:34.574 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:34.568+0000 7f29d9ae2180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:19:34.970 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:34.970+0000 7f931863a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:19:35.054 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:35.054+0000 7f931863a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:19:35.141 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:35.136+0000 7f29d9ae2180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:19:35.206 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:35.206+0000 7f931863a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:19:35.229 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:35.224+0000 7f29d9ae2180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:19:35.289 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:35.286+0000 7f931863a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:19:35.385 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:35.380+0000 7f29d9ae2180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:19:35.472 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:35.468+0000 7f29d9ae2180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:19:35.606 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:35.606+0000 7f931863a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:19:35.665 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:35.666+0000 7f931863a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:19:35.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:35.676+0000 7f10ceffd640 1 -- 172.21.15.55:0/1478223077 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mgrmap(e 90) v1 ==== 84690+0+0 (secure 0 0 0) 0x7f10c8050f30 con 0x7f10d80b6a00 2023-08-25T05:19:35.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:35.676+0000 7f10ceffd640 1 -- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f10b80657f0 msgr2=0x7f10b8067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:19:35.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:35.676+0000 7f10ceffd640 1 --2- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:6832/221263034,v1:172.21.15.110:6833/221263034] conn(0x7f10b80657f0 0x7f10b8067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:35.801 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:35.798+0000 7f929e55e640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:35.801 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:35.798+0000 7f929e55e640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:35.801 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:35.798+0000 7f929e55e640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:35.802 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:35.798+0000 7f929e55e640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:35.802 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:35.798+0000 7f929e55e640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:35.802 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:35.798+0000 7f929b558640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:35.802 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:35.798+0000 7f929b558640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:35.802 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:35.798+0000 7f929b558640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:35.803 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:35.798+0000 7f929b558640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:35.803 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:19:35.798+0000 7f929b558640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:19:35.820 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:35.816+0000 7f29d9ae2180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:19:35.884 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:19:35.880+0000 7f29d9ae2180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:19:36.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.684+0000 7f10ceffd640 1 -- 172.21.15.55:0/1478223077 <== mon.2 v2:172.21.15.110:3301/0 8 ==== mgrmap(e 91) v1 ==== 84817+0+0 (secure 0 0 0) 0x7f10c80814c0 con 0x7f10d80b6a00 2023-08-25T05:19:36.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.684+0000 7f10ceffd640 1 --2- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f10b8033910 0x7f10b806fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:36.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.684+0000 7f10ceffd640 1 -- 172.21.15.55:0/1478223077 --> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f10b8033cf0 con 0x7f10b8033910 2023-08-25T05:19:36.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.688+0000 7f10cffff640 1 --2- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f10b8033910 0x7f10b806fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:36.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.692+0000 7f10cffff640 1 --2- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f10b8033910 0x7f10b806fcd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f10d80ca440 tx=0x7f10c0007df0 comp rx=0 tx=0).ready entity=mgr.9568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:36.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.748+0000 7f10ceffd640 1 -- 172.21.15.55:0/1478223077 <== mgr.9568 v2:172.21.15.110:6832/758142785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f10b8033cf0 con 0x7f10b8033910 2023-08-25T05:19:36.752 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-08-25T05:19:36.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.748+0000 7f10dcdd2640 1 -- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f10b8033910 msgr2=0x7f10b806fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:36.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.748+0000 7f10dcdd2640 1 --2- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f10b8033910 0x7f10b806fcd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f10d80ca440 tx=0x7f10c0007df0 comp rx=0 tx=0).stop 2023-08-25T05:19:36.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.748+0000 7f10dcdd2640 1 -- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10d80b6a00 msgr2=0x7f10d81f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:36.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.748+0000 7f10dcdd2640 1 --2- 172.21.15.55:0/1478223077 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10d80b6a00 0x7f10d81f63e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f10c800e8a0 tx=0x7f10c800ed60 comp rx=0 tx=0).stop 2023-08-25T05:19:36.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.748+0000 7f10d6d9d640 1 -- 172.21.15.55:0/1478223077 reap_dead start 2023-08-25T05:19:36.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.748+0000 7f10dcdd2640 1 -- 172.21.15.55:0/1478223077 shutdown_connections 2023-08-25T05:19:36.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.748+0000 7f10dcdd2640 1 -- 172.21.15.55:0/1478223077 >> 172.21.15.55:0/1478223077 conn(0x7f10d806aae0 msgr2=0x7f10d80d1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:36.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.748+0000 7f10dcdd2640 1 -- 172.21.15.55:0/1478223077 shutdown_connections 2023-08-25T05:19:36.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.748+0000 7f10dcdd2640 1 -- 172.21.15.55:0/1478223077 wait complete. 2023-08-25T05:19:36.776 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-08-25T05:19:36.777 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-08-25T05:19:36.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.940+0000 7f9f73dfa640 1 Processor -- start 2023-08-25T05:19:36.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.940+0000 7f9f73dfa640 1 -- start start 2023-08-25T05:19:36.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.940+0000 7f9f73dfa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9f6c0cf340 0x7f9f6c0cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:36.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.940+0000 7f9f73dfa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f6c0d1970 con 0x7f9f6c15cb40 2023-08-25T05:19:36.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.940+0000 7f9f73dfa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f6c0cfcf0 con 0x7f9f6c0b59f0 2023-08-25T05:19:36.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.940+0000 7f9f73dfa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f6c0d2790 con 0x7f9f6c0cf340 2023-08-25T05:19:36.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.940+0000 7f9f71395640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9f6c0cf340 0x7f9f6c0cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:36.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.940+0000 7f9f71b96640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9f6c15cb40 0x7f9f6c0d2080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58966/0 (socket says 172.21.15.55:58966) 2023-08-25T05:19:36.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.940+0000 7f9f71b96640 1 -- 172.21.15.55:0/1386626150 learned_addr learned my addr 172.21.15.55:0/1386626150 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:19:36.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.940+0000 7f9f71395640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9f6c0cf340 0x7f9f6c0cf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59232/0 (socket says 172.21.15.55:59232) 2023-08-25T05:19:36.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.940+0000 7f9f71395640 1 -- 172.21.15.55:0/1386626150 >> v1:172.21.15.110:6789/0 conn(0x7f9f6c0b59f0 legacy=0x7f9f6c0b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:36.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.940+0000 7f9f71395640 1 -- 172.21.15.55:0/1386626150 >> v1:172.21.15.55:6789/0 conn(0x7f9f6c15cb40 legacy=0x7f9f6c0d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:36.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.940+0000 7f9f71395640 1 -- 172.21.15.55:0/1386626150 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c0d0d80 con 0x7f9f6c0cf340 2023-08-25T05:19:36.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.944+0000 7f9f71395640 1 --2- 172.21.15.55:0/1386626150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f6c0cf340 0x7f9f6c0cf7b0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0097c0 tx=0x7f9f5c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7874553ad93f97db server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:36.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.944+0000 7f9f70b94640 1 -- 172.21.15.55:0/1386626150 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c0a8970 con 0x7f9f6c0cf340 2023-08-25T05:19:36.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.944+0000 7f9f70b94640 1 -- 172.21.15.55:0/1386626150 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c0a8ad0 con 0x7f9f6c0cf340 2023-08-25T05:19:36.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.944+0000 7f9f70b94640 1 -- 172.21.15.55:0/1386626150 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c0a8e60 con 0x7f9f6c0cf340 2023-08-25T05:19:36.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.944+0000 7f9f73dfa640 1 -- 172.21.15.55:0/1386626150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f6c0cf340 msgr2=0x7f9f6c0cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:36.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.944+0000 7f9f73dfa640 1 --2- 172.21.15.55:0/1386626150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f6c0cf340 0x7f9f6c0cf7b0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c0097c0 tx=0x7f9f5c01ec70 comp rx=0 tx=0).stop 2023-08-25T05:19:36.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.944+0000 7f9f73dfa640 1 -- 172.21.15.55:0/1386626150 shutdown_connections 2023-08-25T05:19:36.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.944+0000 7f9f73dfa640 1 --2- 172.21.15.55:0/1386626150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f6c0cf340 0x7f9f6c0cf7b0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:36.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.944+0000 7f9f73dfa640 1 -- 172.21.15.55:0/1386626150 >> 172.21.15.55:0/1386626150 conn(0x7f9f6c06aae0 msgr2=0x7f9f6c06aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:36.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.944+0000 7f9f73dfa640 1 -- 172.21.15.55:0/1386626150 shutdown_connections 2023-08-25T05:19:36.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.944+0000 7f9f73dfa640 1 -- 172.21.15.55:0/1386626150 wait complete. 2023-08-25T05:19:36.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f73dfa640 1 Processor -- start 2023-08-25T05:19:36.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f73dfa640 1 -- start start 2023-08-25T05:19:36.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f73dfa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f6c0b59f0 0x7f9f6c151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:36.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f73dfa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f6c0cf340 0x7f9f6c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:36.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f73dfa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f6c15cb40 0x7f9f6c155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:36.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f73dfa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c15feb0 con 0x7f9f6c15cb40 2023-08-25T05:19:36.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f73dfa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c155990 con 0x7f9f6c0cf340 2023-08-25T05:19:36.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f73dfa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c15f330 con 0x7f9f6c0b59f0 2023-08-25T05:19:36.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f72397640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f6c15cb40 0x7f9f6c155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:36.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f72397640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f6c15cb40 0x7f9f6c155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59236/0 (socket says 172.21.15.55:59236) 2023-08-25T05:19:36.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f72397640 1 -- 172.21.15.55:0/3817050773 learned_addr learned my addr 172.21.15.55:0/3817050773 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:19:36.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f71b96640 1 --2- 172.21.15.55:0/3817050773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f6c0b59f0 0x7f9f6c151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:36.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f71395640 1 --2- 172.21.15.55:0/3817050773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f6c0cf340 0x7f9f6c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:36.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f72397640 1 -- 172.21.15.55:0/3817050773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f6c0b59f0 msgr2=0x7f9f6c151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:36.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f72397640 1 --2- 172.21.15.55:0/3817050773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f6c0b59f0 0x7f9f6c151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:36.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f72397640 1 -- 172.21.15.55:0/3817050773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f6c0cf340 msgr2=0x7f9f6c154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:36.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f72397640 1 --2- 172.21.15.55:0/3817050773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f6c0cf340 0x7f9f6c154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:36.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f72397640 1 -- 172.21.15.55:0/3817050773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c009420 con 0x7f9f6c15cb40 2023-08-25T05:19:36.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f72397640 1 --2- 172.21.15.55:0/3817050773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f6c15cb40 0x7f9f6c155450 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400c730 tx=0x7f9f6400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:36.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f627fc640 1 -- 172.21.15.55:0/3817050773 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f64003b80 con 0x7f9f6c15cb40 2023-08-25T05:19:36.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f627fc640 1 -- 172.21.15.55:0/3817050773 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f64003ce0 con 0x7f9f6c15cb40 2023-08-25T05:19:36.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.948+0000 7f9f627fc640 1 -- 172.21.15.55:0/3817050773 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6400aa30 con 0x7f9f6c15cb40 2023-08-25T05:19:36.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.952+0000 7f9f73dfa640 1 -- 172.21.15.55:0/3817050773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6c15f610 con 0x7f9f6c15cb40 2023-08-25T05:19:36.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.952+0000 7f9f73dfa640 1 -- 172.21.15.55:0/3817050773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6c15fbd0 con 0x7f9f6c15cb40 2023-08-25T05:19:36.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.952+0000 7f9f73dfa640 1 -- 172.21.15.55:0/3817050773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6c071f80 con 0x7f9f6c15cb40 2023-08-25T05:19:36.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.952+0000 7f9f627fc640 1 -- 172.21.15.55:0/3817050773 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 91) v1 ==== 84817+0+0 (secure 0 0 0) 0x7f9f6400ab90 con 0x7f9f6c15cb40 2023-08-25T05:19:36.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.952+0000 7f9f627fc640 1 --2- 172.21.15.55:0/3817050773 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f9f50065520 0x7f9f500679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:19:36.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.952+0000 7f9f627fc640 1 -- 172.21.15.55:0/3817050773 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f9f64082870 con 0x7f9f6c15cb40 2023-08-25T05:19:36.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.956+0000 7f9f71b96640 1 --2- 172.21.15.55:0/3817050773 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f9f50065520 0x7f9f500679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:19:36.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.956+0000 7f9f71b96640 1 --2- 172.21.15.55:0/3817050773 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f9f50065520 0x7f9f500679e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9f68005890 tx=0x7f9f68009040 comp rx=0 tx=0).ready entity=mgr.9568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:19:36.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:36.960+0000 7f9f627fc640 1 -- 172.21.15.55:0/3817050773 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9f640505c0 con 0x7f9f6c15cb40 2023-08-25T05:19:37.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:37.136+0000 7f9f73dfa640 1 -- 172.21.15.55:0/3817050773 --> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f6c0d1320 con 0x7f9f50065520 2023-08-25T05:19:37.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:37.180+0000 7f9f627fc640 1 -- 172.21.15.55:0/3817050773 <== mgr.9568 v2:172.21.15.110:6832/758142785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7f9f68001530 con 0x7f9f50065520 2023-08-25T05:19:37.184 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-08-25T05:19:37.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:37.180+0000 7f9f73dfa640 1 -- 172.21.15.55:0/3817050773 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f9f50065520 msgr2=0x7f9f500679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:37.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:37.180+0000 7f9f73dfa640 1 --2- 172.21.15.55:0/3817050773 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f9f50065520 0x7f9f500679e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9f68005890 tx=0x7f9f68009040 comp rx=0 tx=0).stop 2023-08-25T05:19:37.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:37.180+0000 7f9f73dfa640 1 -- 172.21.15.55:0/3817050773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f6c15cb40 msgr2=0x7f9f6c155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:19:37.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:37.180+0000 7f9f73dfa640 1 --2- 172.21.15.55:0/3817050773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f6c15cb40 0x7f9f6c155450 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f9f6400c730 tx=0x7f9f6400cbf0 comp rx=0 tx=0).stop 2023-08-25T05:19:37.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:37.180+0000 7f9f73dfa640 1 -- 172.21.15.55:0/3817050773 shutdown_connections 2023-08-25T05:19:37.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:37.180+0000 7f9f73dfa640 1 --2- 172.21.15.55:0/3817050773 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f9f50065520 0x7f9f500679e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:37.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:37.180+0000 7f9f73dfa640 1 --2- 172.21.15.55:0/3817050773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f6c15cb40 0x7f9f6c155450 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:37.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:37.180+0000 7f9f73dfa640 1 --2- 172.21.15.55:0/3817050773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f6c0cf340 0x7f9f6c154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:37.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:37.180+0000 7f9f73dfa640 1 --2- 172.21.15.55:0/3817050773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f6c0b59f0 0x7f9f6c151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:19:37.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:37.180+0000 7f9f73dfa640 1 -- 172.21.15.55:0/3817050773 >> 172.21.15.55:0/3817050773 conn(0x7f9f6c06aae0 msgr2=0x7f9f6c0ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:19:37.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:37.180+0000 7f9f73dfa640 1 -- 172.21.15.55:0/3817050773 shutdown_connections 2023-08-25T05:19:37.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:19:37.180+0000 7f9f73dfa640 1 -- 172.21.15.55:0/3817050773 wait complete. 2023-08-25T05:19:37.205 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-08-25T05:19:43.555 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:19:43.561 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:20:00.196 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:20:00.194+0000 7f928d53c640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:20:00.196 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:20:00.194+0000 7f928d53c640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:20:00.197 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:20:00.194+0000 7f928d53c640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:20:00.197 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:20:00.194+0000 7f928d53c640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:20:00.197 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:20:00.194+0000 7f928d53c640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:20:13.615 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:20:13.620 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:20:43.680 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:20:43.686 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:21:13.772 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:21:13.777 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:21:43.890 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:21:43.895 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:22:14.256 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:22:14.260 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:22:44.312 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:22:44.316 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:23:14.385 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:23:14.391 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:23:44.450 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:23:44.455 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:24:14.598 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:24:14.602 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:24:44.788 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:24:44.792 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:25:14.852 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:25:14.857 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:25:44.910 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:25:44.915 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:26:15.283 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:26:15.287 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:26:45.572 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:26:45.577 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:27:15.637 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:27:15.641 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:27:45.708 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:27:45.713 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:28:15.773 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:28:15.777 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:28:45.890 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:28:45.895 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:29:15.954 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:29:15.959 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:29:46.029 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:29:46.033 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:30:16.135 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:30:16.139 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:30:16.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:30:16.206 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-08-25T05:30:16.218 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_20_00_UTC 2023-08-25T05:30:16.218 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_21_00_UTC 2023-08-25T05:30:16.218 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_22_00_UTC 2023-08-25T05:30:16.218 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_23_00_UTC 2023-08-25T05:30:16.219 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_24_00_UTC 2023-08-25T05:30:16.219 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_25_00_UTC 2023-08-25T05:30:16.219 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_26_00_UTC 2023-08-25T05:30:16.219 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_27_00_UTC 2023-08-25T05:30:16.219 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_28_00_UTC 2023-08-25T05:30:16.219 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_29_00_UTC 2023-08-25T05:30:16.219 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_30_00_UTC 2023-08-25T05:30:16.220 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-25-05_20_00_UTC', 'scheduled-2023-08-25-05_21_00_UTC', 'scheduled-2023-08-25-05_22_00_UTC', 'scheduled-2023-08-25-05_23_00_UTC', 'scheduled-2023-08-25-05_24_00_UTC', 'scheduled-2023-08-25-05_25_00_UTC', 'scheduled-2023-08-25-05_26_00_UTC', 'scheduled-2023-08-25-05_27_00_UTC', 'scheduled-2023-08-25-05_28_00_UTC', 'scheduled-2023-08-25-05_29_00_UTC', 'scheduled-2023-08-25-05_30_00_UTC'] 2023-08-25T05:30:16.221 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-08-25T05:30:16.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.416+0000 7f5f41619640 1 Processor -- start 2023-08-25T05:30:16.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.416+0000 7f5f41619640 1 -- start start 2023-08-25T05:30:16.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.420+0000 7f5f41619640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f3c06e690 0x7f5f3c069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:30:16.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.420+0000 7f5f41619640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f3c071500 0x7f5f3c0c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:30:16.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.420+0000 7f5f41619640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c071070 con 0x7f5f3c161070 2023-08-25T05:30:16.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.420+0000 7f5f41619640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c06b370 con 0x7f5f3c071500 2023-08-25T05:30:16.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.420+0000 7f5f41619640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c160420 con 0x7f5f3c06e690 2023-08-25T05:30:16.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.420+0000 7f5f3b7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f3c071500 0x7f5f3c0c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:30:16.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.420+0000 7f5f3affd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f3c06e690 0x7f5f3c069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:30:16.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.420+0000 7f5f3b7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5f3c071500 0x7f5f3c0c9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:38038/0 (socket says 172.21.15.55:38038) 2023-08-25T05:30:16.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.420+0000 7f5f327fc640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f5f3c161070 0x7f5f3c06ea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:55816/0 (socket says 172.21.15.55:55816) 2023-08-25T05:30:16.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.420+0000 7f5f3b7fe640 1 -- 172.21.15.55:0/3023801023 learned_addr learned my addr 172.21.15.55:0/3023801023 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:30:16.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.420+0000 7f5f3b7fe640 1 -- 172.21.15.55:0/3023801023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f3c06e690 msgr2=0x7f5f3c069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:30:16.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.420+0000 7f5f3b7fe640 1 --2- 172.21.15.55:0/3023801023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f3c06e690 0x7f5f3c069900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:30:16.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.420+0000 7f5f3b7fe640 1 -- 172.21.15.55:0/3023801023 >> v1:172.21.15.110:6789/0 conn(0x7f5f3c161070 legacy=0x7f5f3c06ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:30:16.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.420+0000 7f5f3b7fe640 1 -- 172.21.15.55:0/3023801023 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c069f90 con 0x7f5f3c071500 2023-08-25T05:30:16.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.420+0000 7f5f3affd640 1 --2- 172.21.15.55:0/3023801023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f3c06e690 0x7f5f3c069900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:30:16.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.424+0000 7f5f3b7fe640 1 --2- 172.21.15.55:0/3023801023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f3c071500 0x7f5f3c0c9be0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009e50 tx=0x7f5f3401c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=995572830c4f50b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:30:16.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.424+0000 7f5f3a7fc640 1 -- 172.21.15.55:0/3023801023 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f340a58a0 con 0x7f5f3c071500 2023-08-25T05:30:16.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.424+0000 7f5f3a7fc640 1 -- 172.21.15.55:0/3023801023 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f340a5a00 con 0x7f5f3c071500 2023-08-25T05:30:16.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.424+0000 7f5f3a7fc640 1 -- 172.21.15.55:0/3023801023 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f340a5d90 con 0x7f5f3c071500 2023-08-25T05:30:16.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.424+0000 7f5f41619640 1 -- 172.21.15.55:0/3023801023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f3c071500 msgr2=0x7f5f3c0c9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:30:16.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.424+0000 7f5f41619640 1 --2- 172.21.15.55:0/3023801023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f3c071500 0x7f5f3c0c9be0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009e50 tx=0x7f5f3401c9e0 comp rx=0 tx=0).stop 2023-08-25T05:30:16.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.424+0000 7f5f41619640 1 -- 172.21.15.55:0/3023801023 shutdown_connections 2023-08-25T05:30:16.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.424+0000 7f5f41619640 1 --2- 172.21.15.55:0/3023801023 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f3c071500 0x7f5f3c0c9be0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:30:16.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.424+0000 7f5f41619640 1 --2- 172.21.15.55:0/3023801023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f3c06e690 0x7f5f3c069900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:30:16.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.424+0000 7f5f41619640 1 -- 172.21.15.55:0/3023801023 >> 172.21.15.55:0/3023801023 conn(0x7f5f3c0cc010 msgr2=0x7f5f3c0cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:30:16.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.424+0000 7f5f41619640 1 -- 172.21.15.55:0/3023801023 shutdown_connections 2023-08-25T05:30:16.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.424+0000 7f5f41619640 1 -- 172.21.15.55:0/3023801023 wait complete. 2023-08-25T05:30:16.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.424+0000 7f5f41619640 1 Processor -- start 2023-08-25T05:30:16.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.424+0000 7f5f41619640 1 -- start start 2023-08-25T05:30:16.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f41619640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f3c06e690 0x7f5f3c15e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:30:16.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f41619640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f3c071500 0x7f5f3c0c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:30:16.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f41619640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3c161070 0x7f5f3c1498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:30:16.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f41619640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0c6340 con 0x7f5f3c161070 2023-08-25T05:30:16.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f41619640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0c52a0 con 0x7f5f3c071500 2023-08-25T05:30:16.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f41619640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0c5580 con 0x7f5f3c06e690 2023-08-25T05:30:16.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f3b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3c161070 0x7f5f3c1498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:30:16.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f327fc640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f3c071500 0x7f5f3c0c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:30:16.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f3affd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f3c06e690 0x7f5f3c15e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:30:16.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f3affd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f3c06e690 0x7f5f3c15e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:44838/0 (socket says 172.21.15.55:44838) 2023-08-25T05:30:16.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f3affd640 1 -- 172.21.15.55:0/413913517 learned_addr learned my addr 172.21.15.55:0/413913517 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:30:16.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f3b7fe640 1 -- 172.21.15.55:0/413913517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f3c06e690 msgr2=0x7f5f3c15e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:30:16.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f3b7fe640 1 --2- 172.21.15.55:0/413913517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f3c06e690 0x7f5f3c15e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:30:16.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f3b7fe640 1 -- 172.21.15.55:0/413913517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f3c071500 msgr2=0x7f5f3c0c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:30:16.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f3b7fe640 1 --2- 172.21.15.55:0/413913517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f3c071500 0x7f5f3c0c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:30:16.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f3b7fe640 1 -- 172.21.15.55:0/413913517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f24009420 con 0x7f5f3c161070 2023-08-25T05:30:16.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f3affd640 1 --2- 172.21.15.55:0/413913517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f3c06e690 0x7f5f3c15e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:30:16.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f327fc640 1 --2- 172.21.15.55:0/413913517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f3c071500 0x7f5f3c0c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:30:16.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f3b7fe640 1 --2- 172.21.15.55:0/413913517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3c161070 0x7f5f3c1498f0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f5f340ab000 tx=0x7f5f34019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:30:16.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f33fff640 1 -- 172.21.15.55:0/413913517 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f340bd070 con 0x7f5f3c161070 2023-08-25T05:30:16.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f33fff640 1 -- 172.21.15.55:0/413913517 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f340b8470 con 0x7f5f3c161070 2023-08-25T05:30:16.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f41619640 1 -- 172.21.15.55:0/413913517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f34009b30 con 0x7f5f3c161070 2023-08-25T05:30:16.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f33fff640 1 -- 172.21.15.55:0/413913517 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f340b8820 con 0x7f5f3c161070 2023-08-25T05:30:16.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f41619640 1 -- 172.21.15.55:0/413913517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c0c5b40 con 0x7f5f3c161070 2023-08-25T05:30:16.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f41619640 1 -- 172.21.15.55:0/413913517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3c04dbe0 con 0x7f5f3c161070 2023-08-25T05:30:16.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.428+0000 7f5f33fff640 1 -- 172.21.15.55:0/413913517 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85093+0+0 (secure 0 0 0) 0x7f5f340b8980 con 0x7f5f3c161070 2023-08-25T05:30:16.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.432+0000 7f5f33fff640 1 --2- 172.21.15.55:0/413913517 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f5f1c0657f0 0x7f5f1c067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:30:16.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.432+0000 7f5f33fff640 1 -- 172.21.15.55:0/413913517 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f5f3411dee0 con 0x7f5f3c161070 2023-08-25T05:30:16.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.432+0000 7f5f3affd640 1 --2- 172.21.15.55:0/413913517 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f5f1c0657f0 0x7f5f1c067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:30:16.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.432+0000 7f5f3affd640 1 --2- 172.21.15.55:0/413913517 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f5f1c0657f0 0x7f5f1c067cb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5f240114b0 tx=0x7f5f24009190 comp rx=0 tx=0).ready entity=mgr.9568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:30:16.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.436+0000 7f5f33fff640 1 -- 172.21.15.55:0/413913517 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5f340eb850 con 0x7f5f3c161070 2023-08-25T05:30:16.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.608+0000 7f5f41619640 1 -- 172.21.15.55:0/413913517 --> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5f3c06a550 con 0x7f5f1c0657f0 2023-08-25T05:30:16.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.620+0000 7f5f33fff640 1 -- 172.21.15.55:0/413913517 <== mgr.9568 v2:172.21.15.110:6832/758142785 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f5f24013460 con 0x7f5f1c0657f0 2023-08-25T05:30:16.619 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:30:16.619 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T05:19:36", "first": "2023-08-25T05:20:00", "last": "2023-08-25T05:30:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-08-25T05:30:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.620+0000 7f5f41619640 1 -- 172.21.15.55:0/413913517 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f5f1c0657f0 msgr2=0x7f5f1c067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:30:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.620+0000 7f5f41619640 1 --2- 172.21.15.55:0/413913517 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f5f1c0657f0 0x7f5f1c067cb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5f240114b0 tx=0x7f5f24009190 comp rx=0 tx=0).stop 2023-08-25T05:30:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.620+0000 7f5f41619640 1 -- 172.21.15.55:0/413913517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3c161070 msgr2=0x7f5f3c1498f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:30:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.620+0000 7f5f41619640 1 --2- 172.21.15.55:0/413913517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3c161070 0x7f5f3c1498f0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f5f340ab000 tx=0x7f5f34019780 comp rx=0 tx=0).stop 2023-08-25T05:30:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.620+0000 7f5f41619640 1 -- 172.21.15.55:0/413913517 shutdown_connections 2023-08-25T05:30:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.620+0000 7f5f41619640 1 --2- 172.21.15.55:0/413913517 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f5f1c0657f0 0x7f5f1c067cb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:30:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.620+0000 7f5f41619640 1 --2- 172.21.15.55:0/413913517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3c161070 0x7f5f3c1498f0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:30:16.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.620+0000 7f5f41619640 1 --2- 172.21.15.55:0/413913517 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5f3c071500 0x7f5f3c0c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:30:16.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.620+0000 7f5f41619640 1 --2- 172.21.15.55:0/413913517 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5f3c06e690 0x7f5f3c15e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:30:16.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.620+0000 7f5f41619640 1 -- 172.21.15.55:0/413913517 >> 172.21.15.55:0/413913517 conn(0x7f5f3c0cc010 msgr2=0x7f5f3c0aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:30:16.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.620+0000 7f5f41619640 1 -- 172.21.15.55:0/413913517 shutdown_connections 2023-08-25T05:30:16.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.620+0000 7f5f41619640 1 -- 172.21.15.55:0/413913517 wait complete. 2023-08-25T05:30:16.640 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T05:19:36", "first": "2023-08-25T05:20:00", "last": "2023-08-25T05:30:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-08-25T05:30:16.641 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-08-25T00:00:00', 'created': '2023-08-25T05:19:36', 'first': '2023-08-25T05:20:00', 'last': '2023-08-25T05:30:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-08-25T05:30:16.641 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-08-25T05:30:16.641 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-08-25T05:30:16.642 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-25T05:30:16.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.784+0000 7f8b35900640 1 Processor -- start 2023-08-25T05:30:16.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b35900640 1 -- start start 2023-08-25T05:30:16.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b35900640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b300ceeb0 0x7f8b300b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:30:16.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b35900640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b30160570 con 0x7f8b300cce60 2023-08-25T05:30:16.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b35900640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b301602d0 con 0x7f8b3015fef0 2023-08-25T05:30:16.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b35900640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b300cd2f0 con 0x7f8b300ceeb0 2023-08-25T05:30:16.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b27fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8b300cce60 0x7f8b300ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34090/0 (socket says 172.21.15.55:34090) 2023-08-25T05:30:16.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b27fff640 1 -- 172.21.15.55:0/4163153808 learned_addr learned my addr 172.21.15.55:0/4163153808 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:30:16.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2f7fe640 1 --2- 172.21.15.55:0/4163153808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b300ceeb0 0x7f8b300b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:30:16.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2e7fc640 1 -- 172.21.15.55:0/4163153808 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616917410 0 0) 0x7f8b30160570 con 0x7f8b300cce60 2023-08-25T05:30:16.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2e7fc640 1 -- 172.21.15.55:0/4163153808 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b1c003530 con 0x7f8b300cce60 2023-08-25T05:30:16.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2e7fc640 1 -- 172.21.15.55:0/4163153808 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1386441540 0 0) 0x7f8b1c003530 con 0x7f8b300cce60 2023-08-25T05:30:16.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2e7fc640 1 -- 172.21.15.55:0/4163153808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b300ceeb0 msgr2=0x7f8b300b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:30:16.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2e7fc640 1 --2- 172.21.15.55:0/4163153808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b300ceeb0 0x7f8b300b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:30:16.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2e7fc640 1 -- 172.21.15.55:0/4163153808 >> v1:172.21.15.110:6789/0 conn(0x7f8b3015fef0 legacy=0x7f8b300b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:30:16.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2e7fc640 1 -- 172.21.15.55:0/4163153808 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b30160810 con 0x7f8b300cce60 2023-08-25T05:30:16.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2e7fc640 1 -- 172.21.15.55:0/4163153808 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f8b18001680 con 0x7f8b300cce60 2023-08-25T05:30:16.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2e7fc640 1 -- 172.21.15.55:0/4163153808 >> v1:172.21.15.55:6789/0 conn(0x7f8b300cce60 legacy=0x7f8b300ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:30:16.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2e7fc640 1 --2- 172.21.15.55:0/4163153808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b1c0039b0 0x7f8b1c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:30:16.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2e7fc640 1 --2- 172.21.15.55:0/4163153808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b300ceeb0 0x7f8b1c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:30:16.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2e7fc640 1 --2- 172.21.15.55:0/4163153808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b1c004d10 0x7f8b1c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:30:16.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2e7fc640 1 -- 172.21.15.55:0/4163153808 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b300cd2f0 con 0x7f8b1c004d10 2023-08-25T05:30:16.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2e7fc640 1 -- 172.21.15.55:0/4163153808 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c00b9c0 con 0x7f8b1c0039b0 2023-08-25T05:30:16.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2e7fc640 1 -- 172.21.15.55:0/4163153808 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c00bb80 con 0x7f8b300ceeb0 2023-08-25T05:30:16.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2f7fe640 1 --2- 172.21.15.55:0/4163153808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b1c004d10 0x7f8b1c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:30:16.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2effd640 1 --2- 172.21.15.55:0/4163153808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b1c0039b0 0x7f8b1c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:30:16.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b27fff640 1 --2- 172.21.15.55:0/4163153808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b300ceeb0 0x7f8b1c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:30:16.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2f7fe640 1 -- 172.21.15.55:0/4163153808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b300ceeb0 msgr2=0x7f8b1c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:30:16.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2f7fe640 1 --2- 172.21.15.55:0/4163153808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b300ceeb0 0x7f8b1c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:30:16.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2f7fe640 1 -- 172.21.15.55:0/4163153808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b1c0039b0 msgr2=0x7f8b1c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:30:16.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2f7fe640 1 --2- 172.21.15.55:0/4163153808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b1c0039b0 0x7f8b1c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:30:16.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.788+0000 7f8b2f7fe640 1 -- 172.21.15.55:0/4163153808 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c003530 con 0x7f8b1c004d10 2023-08-25T05:30:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.792+0000 7f8b2f7fe640 1 --2- 172.21.15.55:0/4163153808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b1c004d10 0x7f8b1c005190 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009f90 tx=0x7f8b2801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297d53e7202a23a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:30:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.792+0000 7f8b2e7fc640 1 -- 172.21.15.55:0/4163153808 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b280a5b50 con 0x7f8b1c004d10 2023-08-25T05:30:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.792+0000 7f8b2e7fc640 1 -- 172.21.15.55:0/4163153808 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2800f040 con 0x7f8b1c004d10 2023-08-25T05:30:16.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.792+0000 7f8b2e7fc640 1 -- 172.21.15.55:0/4163153808 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b280ad440 con 0x7f8b1c004d10 2023-08-25T05:30:16.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.792+0000 7f8b35900640 1 -- 172.21.15.55:0/4163153808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b1c004d10 msgr2=0x7f8b1c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:30:16.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.792+0000 7f8b35900640 1 --2- 172.21.15.55:0/4163153808 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b1c004d10 0x7f8b1c005190 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009f90 tx=0x7f8b2801cc20 comp rx=0 tx=0).stop 2023-08-25T05:30:16.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.792+0000 7f8b2f7fe640 1 -- 172.21.15.55:0/4163153808 reap_dead start 2023-08-25T05:30:16.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.792+0000 7f8b35900640 1 -- 172.21.15.55:0/4163153808 shutdown_connections 2023-08-25T05:30:16.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.792+0000 7f8b35900640 1 -- 172.21.15.55:0/4163153808 >> 172.21.15.55:0/4163153808 conn(0x7f8b30069d00 msgr2=0x7f8b3006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:30:16.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.792+0000 7f8b35900640 1 -- 172.21.15.55:0/4163153808 shutdown_connections 2023-08-25T05:30:16.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.792+0000 7f8b35900640 1 -- 172.21.15.55:0/4163153808 wait complete. 2023-08-25T05:30:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b35900640 1 Processor -- start 2023-08-25T05:30:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b35900640 1 -- start start 2023-08-25T05:30:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b35900640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b1c004d10 0x7f8b300ad560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:30:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b35900640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b300af5b0 0x7f8b30154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:30:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b35900640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b3015e0c0 0x7f8b3015e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:30:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b35900640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b301f27f0 con 0x7f8b1c004d10 2023-08-25T05:30:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b35900640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b301547c0 con 0x7f8b300af5b0 2023-08-25T05:30:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b35900640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b300af170 con 0x7f8b3015e0c0 2023-08-25T05:30:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b2effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b1c004d10 0x7f8b300ad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:30:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b2effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b1c004d10 0x7f8b300ad560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42072/0 (socket says 172.21.15.55:42072) 2023-08-25T05:30:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b2effd640 1 -- 172.21.15.55:0/2377779089 learned_addr learned my addr 172.21.15.55:0/2377779089 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:30:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b27fff640 1 --2- 172.21.15.55:0/2377779089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b300af5b0 0x7f8b30154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:30:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b2f7fe640 1 --2- 172.21.15.55:0/2377779089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b3015e0c0 0x7f8b3015e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:30:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b2effd640 1 -- 172.21.15.55:0/2377779089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b3015e0c0 msgr2=0x7f8b3015e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:30:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b2effd640 1 --2- 172.21.15.55:0/2377779089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b3015e0c0 0x7f8b3015e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:30:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b2effd640 1 -- 172.21.15.55:0/2377779089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b300af5b0 msgr2=0x7f8b30154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:30:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b2effd640 1 --2- 172.21.15.55:0/2377779089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b300af5b0 0x7f8b30154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:30:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b2effd640 1 -- 172.21.15.55:0/2377779089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b300ae490 con 0x7f8b1c004d10 2023-08-25T05:30:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b2effd640 1 --2- 172.21.15.55:0/2377779089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b1c004d10 0x7f8b300ad560 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f8b2000f740 tx=0x7f8b2000fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:30:16.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b2cff9640 1 -- 172.21.15.55:0/2377779089 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2000fe50 con 0x7f8b1c004d10 2023-08-25T05:30:16.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b2cff9640 1 -- 172.21.15.55:0/2377779089 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b200052e0 con 0x7f8b1c004d10 2023-08-25T05:30:16.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b2cff9640 1 -- 172.21.15.55:0/2377779089 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2000d910 con 0x7f8b1c004d10 2023-08-25T05:30:16.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b35900640 1 -- 172.21.15.55:0/2377779089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b300afa30 con 0x7f8b1c004d10 2023-08-25T05:30:16.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b35900640 1 -- 172.21.15.55:0/2377779089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b300aded0 con 0x7f8b1c004d10 2023-08-25T05:30:16.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.796+0000 7f8b35900640 1 -- 172.21.15.55:0/2377779089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b301f2520 con 0x7f8b1c004d10 2023-08-25T05:30:16.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.800+0000 7f8b2cff9640 1 -- 172.21.15.55:0/2377779089 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 95) v1 ==== 85093+0+0 (secure 0 0 0) 0x7f8b2000da70 con 0x7f8b1c004d10 2023-08-25T05:30:16.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.800+0000 7f8b2cff9640 1 --2- 172.21.15.55:0/2377779089 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f8b10065820 0x7f8b10067ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:30:16.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.800+0000 7f8b2cff9640 1 -- 172.21.15.55:0/2377779089 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f8b200831f0 con 0x7f8b1c004d10 2023-08-25T05:30:16.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.800+0000 7f8b27fff640 1 --2- 172.21.15.55:0/2377779089 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f8b10065820 0x7f8b10067ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:30:16.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.800+0000 7f8b27fff640 1 --2- 172.21.15.55:0/2377779089 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f8b10065820 0x7f8b10067ce0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8b3015ed70 tx=0x7f8b18009040 comp rx=0 tx=0).ready entity=mgr.9568 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:30:16.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:16.804+0000 7f8b2cff9640 1 -- 172.21.15.55:0/2377779089 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8b20050990 con 0x7f8b1c004d10 2023-08-25T05:30:16.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:17.000+0000 7f8b35900640 1 -- 172.21.15.55:0/2377779089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f8b3004dbe0 con 0x7f8b1c004d10 2023-08-25T05:30:17.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:17.000+0000 7f8b2cff9640 1 -- 172.21.15.55:0/2377779089 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v95) v1 ==== 74+0+163104 (secure 0 0 0) 0x7f8b20053fb0 con 0x7f8b1c004d10 2023-08-25T05:30:17.004 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:30:17.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:17.004+0000 7f8b35900640 1 -- 172.21.15.55:0/2377779089 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f8b10065820 msgr2=0x7f8b10067ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:30:17.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:17.004+0000 7f8b35900640 1 --2- 172.21.15.55:0/2377779089 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f8b10065820 0x7f8b10067ce0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8b3015ed70 tx=0x7f8b18009040 comp rx=0 tx=0).stop 2023-08-25T05:30:17.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:17.004+0000 7f8b35900640 1 -- 172.21.15.55:0/2377779089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b1c004d10 msgr2=0x7f8b300ad560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:30:17.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:17.004+0000 7f8b35900640 1 --2- 172.21.15.55:0/2377779089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b1c004d10 0x7f8b300ad560 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f8b2000f740 tx=0x7f8b2000fc00 comp rx=0 tx=0).stop 2023-08-25T05:30:17.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:17.004+0000 7f8b35900640 1 -- 172.21.15.55:0/2377779089 shutdown_connections 2023-08-25T05:30:17.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:17.004+0000 7f8b35900640 1 --2- 172.21.15.55:0/2377779089 >> [v2:172.21.15.110:6832/758142785,v1:172.21.15.110:6833/758142785] conn(0x7f8b10065820 0x7f8b10067ce0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:30:17.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:17.004+0000 7f8b35900640 1 --2- 172.21.15.55:0/2377779089 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8b3015e0c0 0x7f8b3015e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:30:17.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:17.004+0000 7f8b35900640 1 --2- 172.21.15.55:0/2377779089 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8b300af5b0 0x7f8b30154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:30:17.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:17.004+0000 7f8b35900640 1 --2- 172.21.15.55:0/2377779089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b1c004d10 0x7f8b300ad560 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:30:17.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:17.004+0000 7f8b35900640 1 -- 172.21.15.55:0/2377779089 >> 172.21.15.55:0/2377779089 conn(0x7f8b30069d00 msgr2=0x7f8b300cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:30:17.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:17.004+0000 7f8b35900640 1 -- 172.21.15.55:0/2377779089 shutdown_connections 2023-08-25T05:30:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:30:17.004+0000 7f8b35900640 1 -- 172.21.15.55:0/2377779089 wait complete. 2023-08-25T05:30:17.024 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":95,"active_gid":9568,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":758142785},{"type":"v1","addr":"172.21.15.110:6833","nonce":758142785}]},"active_addr":"172.21.15.110:6833/758142785","active_change":"2023-08-25T05:19:35.670241+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":10347,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":171,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":4158794211}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":555519094}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":1448709432}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":2517199041}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":2185378335}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.110:0","nonce":186183046}]}]} 2023-08-25T05:30:17.029 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: x 2023-08-25T05:30:17.029 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-25T05:30:17.030 INFO:tasks.ceph.mgr.x:Stopping old one... 2023-08-25T05:30:17.030 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-08-25T05:30:17.030 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:30:17.094 INFO:tasks.ceph.mgr.x:Stopped 2023-08-25T05:30:17.095 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-25T05:30:17.099 INFO:tasks.ceph.mgr.x:Started 2023-08-25T05:30:17.278 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:17.274+0000 7f059b6b3180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:30:17.685 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:17.682+0000 7f059b6b3180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:30:17.834 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:17.830+0000 7f059b6b3180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:30:18.306 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:18.302+0000 7f059b6b3180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:30:18.364 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:18.362+0000 7f059b6b3180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:30:18.432 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:18.418+0000 7f059b6b3180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:30:18.504 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:18.502+0000 7f059b6b3180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:30:18.561 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:18.558+0000 7f059b6b3180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:30:18.643 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:18.642+0000 7f059b6b3180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:30:18.698 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:18.694+0000 7f059b6b3180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:30:18.840 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:18.838+0000 7f059b6b3180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:30:18.898 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:18.894+0000 7f059b6b3180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:30:19.135 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:30:19.135 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:30:19.136 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:30:19.143 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:19.142+0000 7f059b6b3180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:30:19.276 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:19.274+0000 7f059b6b3180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:30:19.399 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:19.398+0000 7f059b6b3180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:30:19.469 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:19.466+0000 7f059b6b3180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:30:19.604 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:19.602+0000 7f059b6b3180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:30:20.135 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:20.134+0000 7f059b6b3180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:30:20.219 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:20.214+0000 7f059b6b3180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:30:20.365 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:20.362+0000 7f059b6b3180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:30:20.447 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:20.446+0000 7f059b6b3180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:30:20.760 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:20.758+0000 7f059b6b3180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:30:20.820 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:20.818+0000 7f059b6b3180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:30:20.975 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:20.970+0000 7f051dcde640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:30:20.975 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:20.970+0000 7f051dcde640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:30:20.975 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:20.970+0000 7f051dcde640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:30:20.975 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:20.970+0000 7f051dcde640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:30:20.976 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:20.970+0000 7f051dcde640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:30:20.976 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:20.970+0000 7f0520ce4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:30:20.976 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:20.970+0000 7f0520ce4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:30:20.976 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:20.970+0000 7f0520ce4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:30:20.976 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:20.970+0000 7f0520ce4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:30:20.977 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:30:20.970+0000 7f0520ce4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:30:46.392 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:30:46.397 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:31:00.970 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:31:00.965+0000 7f0528cf4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:31:00.971 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:31:00.965+0000 7f0528cf4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:31:00.971 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:31:00.965+0000 7f0528cf4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:31:00.971 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:31:00.965+0000 7f0528cf4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:31:00.971 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:31:00.965+0000 7f0528cf4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:31:16.494 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:31:16.498 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:31:46.558 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:31:46.563 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:32:16.620 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:32:16.625 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:32:46.793 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:32:46.797 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:33:16.858 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:33:16.862 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:33:46.922 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:33:46.933 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:34:17.038 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:34:17.042 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:34:47.361 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:34:47.366 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:35:17.100 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-08-25T05:35:17.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.257+0000 7f87a3359640 1 Processor -- start 2023-08-25T05:35:17.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.257+0000 7f87a3359640 1 -- start start 2023-08-25T05:35:17.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.257+0000 7f87a3359640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f879c1611f0 0x7f879c1615d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:17.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.257+0000 7f87a3359640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f879c165090 0x7f879c0c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:17.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.257+0000 7f87a3359640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f879c0aff90 0x7f879c0b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:17.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.257+0000 7f87a3359640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f879c0ca0c0 con 0x7f879c165090 2023-08-25T05:35:17.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.257+0000 7f87a3359640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f879c0b0920 con 0x7f879c0aff90 2023-08-25T05:35:17.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.257+0000 7f87a3359640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879c0c9440 con 0x7f879c1611f0 2023-08-25T05:35:17.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.257+0000 7f87a08f4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f879c165090 0x7f879c0c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:17.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.261+0000 7f87a08f4640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f879c165090 0x7f879c0c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49530/0 (socket says 172.21.15.55:49530) 2023-08-25T05:35:17.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.261+0000 7f87a08f4640 1 -- 172.21.15.55:0/1036663888 learned_addr learned my addr 172.21.15.55:0/1036663888 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:17.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.261+0000 7f87a10f5640 1 --2- 172.21.15.55:0/1036663888 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f879c1611f0 0x7f879c1615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:17.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.261+0000 7f87a18f6640 1 --2- 172.21.15.55:0/1036663888 >> v2:172.21.15.110:3300/0 conn(0x7f879c0aff90 0x7f879c0b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:17.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.261+0000 7f87a08f4640 1 -- 172.21.15.55:0/1036663888 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f879c1611f0 msgr2=0x7f879c1615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:17.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.261+0000 7f87a08f4640 1 --2- 172.21.15.55:0/1036663888 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f879c1611f0 0x7f879c1615d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.261+0000 7f87a08f4640 1 -- 172.21.15.55:0/1036663888 >> v2:172.21.15.110:3300/0 conn(0x7f879c0aff90 msgr2=0x7f879c0b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:17.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.261+0000 7f87a08f4640 1 --2- 172.21.15.55:0/1036663888 >> v2:172.21.15.110:3300/0 conn(0x7f879c0aff90 0x7f879c0b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.261+0000 7f87a08f4640 1 -- 172.21.15.55:0/1036663888 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c0c9720 con 0x7f879c165090 2023-08-25T05:35:17.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.261+0000 7f87a08f4640 1 --2- 172.21.15.55:0/1036663888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f879c165090 0x7f879c0c8b60 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f879c0c9fc0 tx=0x7f878c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379a10c5e91ee791 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:17.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.261+0000 7f8793fff640 1 -- 172.21.15.55:0/1036663888 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c0aa620 con 0x7f879c165090 2023-08-25T05:35:17.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.261+0000 7f8793fff640 1 -- 172.21.15.55:0/1036663888 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878c0aa780 con 0x7f879c165090 2023-08-25T05:35:17.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.261+0000 7f8793fff640 1 -- 172.21.15.55:0/1036663888 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c0aab10 con 0x7f879c165090 2023-08-25T05:35:17.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.261+0000 7f87a3359640 1 -- 172.21.15.55:0/1036663888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f879c165090 msgr2=0x7f879c0c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:17.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.261+0000 7f87a3359640 1 --2- 172.21.15.55:0/1036663888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f879c165090 0x7f879c0c8b60 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f879c0c9fc0 tx=0x7f878c01c500 comp rx=0 tx=0).stop 2023-08-25T05:35:17.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a3359640 1 -- 172.21.15.55:0/1036663888 shutdown_connections 2023-08-25T05:35:17.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a3359640 1 --2- 172.21.15.55:0/1036663888 >> v2:172.21.15.110:3300/0 conn(0x7f879c0aff90 0x7f879c0b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a3359640 1 --2- 172.21.15.55:0/1036663888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f879c165090 0x7f879c0c8b60 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a3359640 1 --2- 172.21.15.55:0/1036663888 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f879c1611f0 0x7f879c1615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a3359640 1 -- 172.21.15.55:0/1036663888 >> 172.21.15.55:0/1036663888 conn(0x7f879c0caf90 msgr2=0x7f879c0cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:17.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a3359640 1 -- 172.21.15.55:0/1036663888 shutdown_connections 2023-08-25T05:35:17.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a3359640 1 -- 172.21.15.55:0/1036663888 wait complete. 2023-08-25T05:35:17.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a3359640 1 Processor -- start 2023-08-25T05:35:17.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a3359640 1 -- start start 2023-08-25T05:35:17.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a3359640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f879c0aff90 0x7f879c151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a3359640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f879c1611f0 0x7f879c1625c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a3359640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f879c165090 0x7f879c163cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a3359640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c163940 con 0x7f879c0aff90 2023-08-25T05:35:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a3359640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879c152130 con 0x7f879c165090 2023-08-25T05:35:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a3359640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879c1630a0 con 0x7f879c1611f0 2023-08-25T05:35:17.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a10f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f879c0aff90 0x7f879c151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a10f5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f879c0aff90 0x7f879c151bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49538/0 (socket says 172.21.15.55:49538) 2023-08-25T05:35:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a10f5640 1 -- 172.21.15.55:0/1693370962 learned_addr learned my addr 172.21.15.55:0/1693370962 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a18f6640 1 --2- 172.21.15.55:0/1693370962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f879c165090 0x7f879c163cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a08f4640 1 --2- 172.21.15.55:0/1693370962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f879c1611f0 0x7f879c1625c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a10f5640 1 -- 172.21.15.55:0/1693370962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f879c1611f0 msgr2=0x7f879c1625c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a10f5640 1 --2- 172.21.15.55:0/1693370962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f879c1611f0 0x7f879c1625c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a10f5640 1 -- 172.21.15.55:0/1693370962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f879c165090 msgr2=0x7f879c163cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a10f5640 1 --2- 172.21.15.55:0/1693370962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f879c165090 0x7f879c163cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a10f5640 1 -- 172.21.15.55:0/1693370962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c0094d0 con 0x7f879c0aff90 2023-08-25T05:35:17.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a08f4640 1 --2- 172.21.15.55:0/1693370962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f879c1611f0 0x7f879c1625c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:17.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.265+0000 7f87a10f5640 1 --2- 172.21.15.55:0/1693370962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f879c0aff90 0x7f879c151bf0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f879800d800 tx=0x7f879800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:17.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.269+0000 7f8791ffb640 1 -- 172.21.15.55:0/1693370962 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879800b6c0 con 0x7f879c0aff90 2023-08-25T05:35:17.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.269+0000 7f8791ffb640 1 -- 172.21.15.55:0/1693370962 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879800b820 con 0x7f879c0aff90 2023-08-25T05:35:17.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.269+0000 7f8791ffb640 1 -- 172.21.15.55:0/1693370962 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879800bb90 con 0x7f879c0aff90 2023-08-25T05:35:17.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.269+0000 7f87a3359640 1 -- 172.21.15.55:0/1693370962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879c163380 con 0x7f879c0aff90 2023-08-25T05:35:17.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.269+0000 7f87a3359640 1 -- 172.21.15.55:0/1693370962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879c0c5780 con 0x7f879c0aff90 2023-08-25T05:35:17.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.269+0000 7f87a3359640 1 -- 172.21.15.55:0/1693370962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f879c0c5940 con 0x7f879c0aff90 2023-08-25T05:35:17.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.269+0000 7f8791ffb640 1 -- 172.21.15.55:0/1693370962 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 101) v1 ==== 85093+0+0 (secure 0 0 0) 0x7f879800bcf0 con 0x7f879c0aff90 2023-08-25T05:35:17.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.269+0000 7f8791ffb640 1 --2- 172.21.15.55:0/1693370962 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f87800657f0 0x7f8780067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.269+0000 7f8791ffb640 1 -- 172.21.15.55:0/1693370962 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6808+0+0 (secure 0 0 0) 0x7f8798083790 con 0x7f879c0aff90 2023-08-25T05:35:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.269+0000 7f87a08f4640 1 --2- 172.21.15.55:0/1693370962 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f87800657f0 0x7f8780067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:17.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.273+0000 7f87a08f4640 1 --2- 172.21.15.55:0/1693370962 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f87800657f0 0x7f8780067cb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f878c0ae000 tx=0x7f878c0a7000 comp rx=0 tx=0).ready entity=mgr.8522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:17.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.273+0000 7f8791ffb640 1 -- 172.21.15.55:0/1693370962 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f87980548d0 con 0x7f879c0aff90 2023-08-25T05:35:17.417 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:35:17.421 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:35:17.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.449+0000 7f87a3359640 1 -- 172.21.15.55:0/1693370962 --> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f879c06a110 con 0x7f87800657f0 2023-08-25T05:35:17.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.513+0000 7f8791ffb640 1 -- 172.21.15.55:0/1693370962 <== mgr.8522 v2:172.21.15.110:6832/2233108903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7f878c0aa8f0 con 0x7f87800657f0 2023-08-25T05:35:17.516 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-08-25T05:35:17.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.513+0000 7f87a3359640 1 -- 172.21.15.55:0/1693370962 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f87800657f0 msgr2=0x7f8780067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:17.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.513+0000 7f87a3359640 1 --2- 172.21.15.55:0/1693370962 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f87800657f0 0x7f8780067cb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f878c0ae000 tx=0x7f878c0a7000 comp rx=0 tx=0).stop 2023-08-25T05:35:17.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.513+0000 7f87a3359640 1 -- 172.21.15.55:0/1693370962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f879c0aff90 msgr2=0x7f879c151bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:17.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.513+0000 7f87a3359640 1 --2- 172.21.15.55:0/1693370962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f879c0aff90 0x7f879c151bf0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f879800d800 tx=0x7f879800dcc0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.513+0000 7f87a3359640 1 -- 172.21.15.55:0/1693370962 shutdown_connections 2023-08-25T05:35:17.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.513+0000 7f87a3359640 1 --2- 172.21.15.55:0/1693370962 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f87800657f0 0x7f8780067cb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.513+0000 7f87a3359640 1 --2- 172.21.15.55:0/1693370962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f879c165090 0x7f879c163cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.513+0000 7f87a3359640 1 --2- 172.21.15.55:0/1693370962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f879c1611f0 0x7f879c1625c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.513+0000 7f87a3359640 1 --2- 172.21.15.55:0/1693370962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f879c0aff90 0x7f879c151bf0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.513+0000 7f87a3359640 1 -- 172.21.15.55:0/1693370962 >> 172.21.15.55:0/1693370962 conn(0x7f879c0caf90 msgr2=0x7f879c0cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:17.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.513+0000 7f87a3359640 1 -- 172.21.15.55:0/1693370962 shutdown_connections 2023-08-25T05:35:17.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.513+0000 7f87a3359640 1 -- 172.21.15.55:0/1693370962 wait complete. 2023-08-25T05:35:17.537 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-08-25T05:35:17.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:17.537 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-08-25T05:35:17.547 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_20_00_UTC 2023-08-25T05:35:17.547 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_21_00_UTC 2023-08-25T05:35:17.548 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_22_00_UTC 2023-08-25T05:35:17.548 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_23_00_UTC 2023-08-25T05:35:17.548 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_24_00_UTC 2023-08-25T05:35:17.548 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_25_00_UTC 2023-08-25T05:35:17.548 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_26_00_UTC 2023-08-25T05:35:17.548 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_27_00_UTC 2023-08-25T05:35:17.548 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_28_00_UTC 2023-08-25T05:35:17.549 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_29_00_UTC 2023-08-25T05:35:17.549 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_30_00_UTC 2023-08-25T05:35:17.549 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_31_00_UTC 2023-08-25T05:35:17.549 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_32_00_UTC 2023-08-25T05:35:17.549 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_33_00_UTC 2023-08-25T05:35:17.549 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_34_00_UTC 2023-08-25T05:35:17.549 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_35_00_UTC 2023-08-25T05:35:17.550 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-08-25-05_20_00_UTC', 'scheduled-2023-08-25-05_21_00_UTC', 'scheduled-2023-08-25-05_22_00_UTC', 'scheduled-2023-08-25-05_23_00_UTC', 'scheduled-2023-08-25-05_24_00_UTC', 'scheduled-2023-08-25-05_25_00_UTC', 'scheduled-2023-08-25-05_26_00_UTC', 'scheduled-2023-08-25-05_27_00_UTC', 'scheduled-2023-08-25-05_28_00_UTC', 'scheduled-2023-08-25-05_29_00_UTC', 'scheduled-2023-08-25-05_30_00_UTC', 'scheduled-2023-08-25-05_31_00_UTC', 'scheduled-2023-08-25-05_32_00_UTC', 'scheduled-2023-08-25-05_33_00_UTC', 'scheduled-2023-08-25-05_34_00_UTC', 'scheduled-2023-08-25-05_35_00_UTC'] 2023-08-25T05:35:17.551 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-08-25T05:35:17.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c8ae19640 1 Processor -- start 2023-08-25T05:35:17.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c8ae19640 1 -- start start 2023-08-25T05:35:17.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c8ae19640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1c840cd260 0x7f1c840cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:17.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c8ae19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c840cf230 0x7f1c840cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:17.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c8ae19640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c840cdc00 con 0x7f1c8415cbe0 2023-08-25T05:35:17.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c8ae19640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c840d0f70 con 0x7f1c840cd260 2023-08-25T05:35:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c8ae19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c84160b80 con 0x7f1c840cf230 2023-08-25T05:35:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c88bb5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1c8415cbe0 0x7f1c840b5c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49386/0 (socket says 172.21.15.55:49386) 2023-08-25T05:35:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c88bb5640 1 -- 172.21.15.55:0/2219001384 learned_addr learned my addr 172.21.15.55:0/2219001384 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:17.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c893b6640 1 --2- 172.21.15.55:0/2219001384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c840cf230 0x7f1c840cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:17.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c7bfff640 1 --2- 172.21.15.55:0/2219001384 >> v2:172.21.15.110:3300/0 conn(0x7f1c840cd260 0x7f1c840cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:17.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c7b7fe640 1 -- 172.21.15.55:0/2219001384 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455606162 0 0) 0x7f1c80001120 con 0x7f1c8415cbe0 2023-08-25T05:35:17.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c7b7fe640 1 -- 172.21.15.55:0/2219001384 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c6c003530 con 0x7f1c8415cbe0 2023-08-25T05:35:17.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c7b7fe640 1 -- 172.21.15.55:0/2219001384 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3337632151 0 0) 0x7f1c6c003530 con 0x7f1c8415cbe0 2023-08-25T05:35:17.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c7b7fe640 1 -- 172.21.15.55:0/2219001384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c840cf230 msgr2=0x7f1c840cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:17.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c7b7fe640 1 --2- 172.21.15.55:0/2219001384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c840cf230 0x7f1c840cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c7b7fe640 1 -- 172.21.15.55:0/2219001384 >> v2:172.21.15.110:3300/0 conn(0x7f1c840cd260 msgr2=0x7f1c840cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:17.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c7b7fe640 1 --2- 172.21.15.55:0/2219001384 >> v2:172.21.15.110:3300/0 conn(0x7f1c840cd260 0x7f1c840cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c7b7fe640 1 -- 172.21.15.55:0/2219001384 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c840cfc00 con 0x7f1c8415cbe0 2023-08-25T05:35:17.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c7b7fe640 1 -- 172.21.15.55:0/2219001384 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f1c80001810 con 0x7f1c8415cbe0 2023-08-25T05:35:17.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.733+0000 7f1c7b7fe640 1 -- 172.21.15.55:0/2219001384 >> v1:172.21.15.55:6789/0 conn(0x7f1c8415cbe0 legacy=0x7f1c840b5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:17.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.737+0000 7f1c7b7fe640 1 --2- 172.21.15.55:0/2219001384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c6c003980 0x7f1c6c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:17.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.737+0000 7f1c7b7fe640 1 --2- 172.21.15.55:0/2219001384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c6c0047d0 0x7f1c6c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:17.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.737+0000 7f1c7b7fe640 1 --2- 172.21.15.55:0/2219001384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c840cf230 0x7f1c6c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:17.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.737+0000 7f1c7b7fe640 1 -- 172.21.15.55:0/2219001384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c840d0f70 con 0x7f1c6c0047d0 2023-08-25T05:35:17.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.737+0000 7f1c7b7fe640 1 -- 172.21.15.55:0/2219001384 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c84160b80 con 0x7f1c6c003980 2023-08-25T05:35:17.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.737+0000 7f1c7b7fe640 1 -- 172.21.15.55:0/2219001384 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c00b990 con 0x7f1c840cf230 2023-08-25T05:35:17.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.737+0000 7f1c7bfff640 1 --2- 172.21.15.55:0/2219001384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c6c0047d0 0x7f1c6c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:17.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.737+0000 7f1c88bb5640 1 --2- 172.21.15.55:0/2219001384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c6c003980 0x7f1c6c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:17.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.737+0000 7f1c893b6640 1 --2- 172.21.15.55:0/2219001384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c840cf230 0x7f1c6c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:17.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.737+0000 7f1c7bfff640 1 -- 172.21.15.55:0/2219001384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c840cf230 msgr2=0x7f1c6c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:17.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.737+0000 7f1c7bfff640 1 --2- 172.21.15.55:0/2219001384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c840cf230 0x7f1c6c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.737+0000 7f1c7bfff640 1 -- 172.21.15.55:0/2219001384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c6c003980 msgr2=0x7f1c6c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:17.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.737+0000 7f1c7bfff640 1 --2- 172.21.15.55:0/2219001384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c6c003980 0x7f1c6c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.737+0000 7f1c7bfff640 1 -- 172.21.15.55:0/2219001384 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c003530 con 0x7f1c6c0047d0 2023-08-25T05:35:17.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.737+0000 7f1c7bfff640 1 --2- 172.21.15.55:0/2219001384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c6c0047d0 0x7f1c6c004c50 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f1c74009ae0 tx=0x7f1c7401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b621623f3aefacde server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:17.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.737+0000 7f1c7b7fe640 1 -- 172.21.15.55:0/2219001384 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c740a64a0 con 0x7f1c6c0047d0 2023-08-25T05:35:17.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.737+0000 7f1c7b7fe640 1 -- 172.21.15.55:0/2219001384 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c740a6600 con 0x7f1c6c0047d0 2023-08-25T05:35:17.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.737+0000 7f1c7b7fe640 1 -- 172.21.15.55:0/2219001384 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c740a69b0 con 0x7f1c6c0047d0 2023-08-25T05:35:17.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c8ae19640 1 -- 172.21.15.55:0/2219001384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c6c0047d0 msgr2=0x7f1c6c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:17.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c8ae19640 1 --2- 172.21.15.55:0/2219001384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c6c0047d0 0x7f1c6c004c50 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f1c74009ae0 tx=0x7f1c7401ca90 comp rx=0 tx=0).stop 2023-08-25T05:35:17.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c893b6640 1 -- 172.21.15.55:0/2219001384 reap_dead start 2023-08-25T05:35:17.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c8ae19640 1 -- 172.21.15.55:0/2219001384 shutdown_connections 2023-08-25T05:35:17.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c8ae19640 1 -- 172.21.15.55:0/2219001384 >> 172.21.15.55:0/2219001384 conn(0x7f1c840b4480 msgr2=0x7f1c840b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:17.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c8ae19640 1 -- 172.21.15.55:0/2219001384 shutdown_connections 2023-08-25T05:35:17.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c8ae19640 1 -- 172.21.15.55:0/2219001384 wait complete. 2023-08-25T05:35:17.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c8ae19640 1 Processor -- start 2023-08-25T05:35:17.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c8ae19640 1 -- start start 2023-08-25T05:35:17.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c8ae19640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c6c0047d0 0x7f1c841f6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:17.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c8ae19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c841e5a70 0x7f1c840b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:17.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c8ae19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c841e5ef0 0x7f1c840b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:17.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c8ae19640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c841f5dc0 con 0x7f1c841e5ef0 2023-08-25T05:35:17.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c8ae19640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c841f6380 con 0x7f1c6c0047d0 2023-08-25T05:35:17.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c8ae19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c841e64c0 con 0x7f1c841e5a70 2023-08-25T05:35:17.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c893b6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c841e5ef0 0x7f1c840b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:17.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c893b6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c841e5ef0 0x7f1c840b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49554/0 (socket says 172.21.15.55:49554) 2023-08-25T05:35:17.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c893b6640 1 -- 172.21.15.55:0/2523105851 learned_addr learned my addr 172.21.15.55:0/2523105851 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:17.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c7bfff640 1 --2- 172.21.15.55:0/2523105851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c841e5a70 0x7f1c840b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:17.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c88bb5640 1 --2- 172.21.15.55:0/2523105851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c6c0047d0 0x7f1c841f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:17.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c893b6640 1 -- 172.21.15.55:0/2523105851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c841e5a70 msgr2=0x7f1c840b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:17.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.741+0000 7f1c893b6640 1 --2- 172.21.15.55:0/2523105851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c841e5a70 0x7f1c840b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.745+0000 7f1c893b6640 1 -- 172.21.15.55:0/2523105851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c6c0047d0 msgr2=0x7f1c841f6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:17.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.745+0000 7f1c893b6640 1 --2- 172.21.15.55:0/2523105851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c6c0047d0 0x7f1c841f6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.745+0000 7f1c893b6640 1 -- 172.21.15.55:0/2523105851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c841e67a0 con 0x7f1c841e5ef0 2023-08-25T05:35:17.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.745+0000 7f1c893b6640 1 --2- 172.21.15.55:0/2523105851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c841e5ef0 0x7f1c840b3b10 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f1c8406c110 tx=0x7f1c7c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:17.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.745+0000 7f1c797fa640 1 -- 172.21.15.55:0/2523105851 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c00e040 con 0x7f1c841e5ef0 2023-08-25T05:35:17.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.745+0000 7f1c797fa640 1 -- 172.21.15.55:0/2523105851 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c00f040 con 0x7f1c841e5ef0 2023-08-25T05:35:17.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.745+0000 7f1c8ae19640 1 -- 172.21.15.55:0/2523105851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c841f6010 con 0x7f1c841e5ef0 2023-08-25T05:35:17.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.745+0000 7f1c797fa640 1 -- 172.21.15.55:0/2523105851 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c015670 con 0x7f1c841e5ef0 2023-08-25T05:35:17.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.745+0000 7f1c8ae19640 1 -- 172.21.15.55:0/2523105851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c840cbc20 con 0x7f1c841e5ef0 2023-08-25T05:35:17.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.745+0000 7f1c8ae19640 1 -- 172.21.15.55:0/2523105851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c841f61a0 con 0x7f1c841e5ef0 2023-08-25T05:35:17.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.745+0000 7f1c797fa640 1 -- 172.21.15.55:0/2523105851 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 101) v1 ==== 85093+0+0 (secure 0 0 0) 0x7f1c7c0157d0 con 0x7f1c841e5ef0 2023-08-25T05:35:17.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.745+0000 7f1c797fa640 1 --2- 172.21.15.55:0/2523105851 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f1c700657f0 0x7f1c70067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:17.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.745+0000 7f1c797fa640 1 -- 172.21.15.55:0/2523105851 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6808+0+0 (secure 0 0 0) 0x7f1c7c083cc0 con 0x7f1c841e5ef0 2023-08-25T05:35:17.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.745+0000 7f1c88bb5640 1 --2- 172.21.15.55:0/2523105851 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f1c700657f0 0x7f1c70067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:17.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.749+0000 7f1c88bb5640 1 --2- 172.21.15.55:0/2523105851 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f1c700657f0 0x7f1c70067cb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1c800012c0 tx=0x7f1c80007a80 comp rx=0 tx=0).ready entity=mgr.8522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:17.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.749+0000 7f1c797fa640 1 -- 172.21.15.55:0/2523105851 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1c7c08a080 con 0x7f1c841e5ef0 2023-08-25T05:35:17.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.925+0000 7f1c8ae19640 1 -- 172.21.15.55:0/2523105851 --> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c840d11e0 con 0x7f1c700657f0 2023-08-25T05:35:17.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.933+0000 7f1c797fa640 1 -- 172.21.15.55:0/2523105851 <== mgr.8522 v2:172.21.15.110:6832/2233108903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7f1c80005550 con 0x7f1c700657f0 2023-08-25T05:35:17.936 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:17.936 INFO:teuthology.orchestra.run.smithi055.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T05:19:36", "first": "2023-08-25T05:20:00", "last": "2023-08-25T05:35:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-08-25T05:35:17.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.933+0000 7f1c8ae19640 1 -- 172.21.15.55:0/2523105851 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f1c700657f0 msgr2=0x7f1c70067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:17.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.933+0000 7f1c8ae19640 1 --2- 172.21.15.55:0/2523105851 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f1c700657f0 0x7f1c70067cb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1c800012c0 tx=0x7f1c80007a80 comp rx=0 tx=0).stop 2023-08-25T05:35:17.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.933+0000 7f1c8ae19640 1 -- 172.21.15.55:0/2523105851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c841e5ef0 msgr2=0x7f1c840b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:17.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.933+0000 7f1c8ae19640 1 --2- 172.21.15.55:0/2523105851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c841e5ef0 0x7f1c840b3b10 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f1c8406c110 tx=0x7f1c7c00f580 comp rx=0 tx=0).stop 2023-08-25T05:35:17.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.933+0000 7f1c8ae19640 1 -- 172.21.15.55:0/2523105851 shutdown_connections 2023-08-25T05:35:17.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.933+0000 7f1c8ae19640 1 --2- 172.21.15.55:0/2523105851 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f1c700657f0 0x7f1c70067cb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.933+0000 7f1c8ae19640 1 --2- 172.21.15.55:0/2523105851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c841e5ef0 0x7f1c840b3b10 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.933+0000 7f1c8ae19640 1 --2- 172.21.15.55:0/2523105851 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c841e5a70 0x7f1c840b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.933+0000 7f1c8ae19640 1 --2- 172.21.15.55:0/2523105851 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c6c0047d0 0x7f1c841f6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:17.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.933+0000 7f1c8ae19640 1 -- 172.21.15.55:0/2523105851 >> 172.21.15.55:0/2523105851 conn(0x7f1c840b4480 msgr2=0x7f1c840b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:17.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.933+0000 7f1c8ae19640 1 -- 172.21.15.55:0/2523105851 shutdown_connections 2023-08-25T05:35:17.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:17.933+0000 7f1c8ae19640 1 -- 172.21.15.55:0/2523105851 wait complete. 2023-08-25T05:35:17.957 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-08-25T00:00:00", "created": "2023-08-25T05:19:36", "first": "2023-08-25T05:20:00", "last": "2023-08-25T05:35:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-08-25T05:35:17.957 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-08-25T00:00:00', 'created': '2023-08-25T05:19:36', 'first': '2023-08-25T05:20:00', 'last': '2023-08-25T05:35:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-08-25T05:35:17.958 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 16 2023-08-25T05:35:17.958 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 16 2023-08-25T05:35:17.958 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-08-25T05:35:18.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.101+0000 7fa0435ba640 1 Processor -- start 2023-08-25T05:35:18.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.101+0000 7fa0435ba640 1 -- start start 2023-08-25T05:35:18.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.105+0000 7fa0435ba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa03c069900 0x7fa03c161070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:18.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.105+0000 7fa0435ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c071500 0x7fa03c0c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:18.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.105+0000 7fa0435ba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03c069d60 con 0x7fa03c06e690 2023-08-25T05:35:18.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.105+0000 7fa0435ba640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03c06b370 con 0x7fa03c069900 2023-08-25T05:35:18.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.105+0000 7fa0435ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c071070 con 0x7fa03c071500 2023-08-25T05:35:18.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.105+0000 7fa040b55640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa03c069900 0x7fa03c161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:18.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.105+0000 7fa040b55640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa03c069900 0x7fa03c161070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49558/0 (socket says 172.21.15.55:49558) 2023-08-25T05:35:18.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.105+0000 7fa040b55640 1 -- 172.21.15.55:0/80700269 learned_addr learned my addr 172.21.15.55:0/80700269 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:18.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.105+0000 7fa041b57640 1 --2- 172.21.15.55:0/80700269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c071500 0x7fa03c0c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:18.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.105+0000 7fa040b55640 1 -- 172.21.15.55:0/80700269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c071500 msgr2=0x7fa03c0c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:18.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.105+0000 7fa040b55640 1 --2- 172.21.15.55:0/80700269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c071500 0x7fa03c0c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:18.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.105+0000 7fa040b55640 1 -- 172.21.15.55:0/80700269 >> v1:172.21.15.110:6789/0 conn(0x7fa03c06e690 legacy=0x7fa03c06ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:18.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.105+0000 7fa040b55640 1 -- 172.21.15.55:0/80700269 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c1615b0 con 0x7fa03c069900 2023-08-25T05:35:18.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.109+0000 7fa040b55640 1 --2- 172.21.15.55:0/80700269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c069900 0x7fa03c161070 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fa02c009870 tx=0x7fa02c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e9e08a1184ecac server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.109+0000 7fa033fff640 1 -- 172.21.15.55:0/80700269 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c0a7070 con 0x7fa03c069900 2023-08-25T05:35:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.109+0000 7fa033fff640 1 -- 172.21.15.55:0/80700269 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c0ab430 con 0x7fa03c069900 2023-08-25T05:35:18.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.109+0000 7fa033fff640 1 -- 172.21.15.55:0/80700269 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c0ab7c0 con 0x7fa03c069900 2023-08-25T05:35:18.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.109+0000 7fa0435ba640 1 -- 172.21.15.55:0/80700269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c069900 msgr2=0x7fa03c161070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:18.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.109+0000 7fa0435ba640 1 --2- 172.21.15.55:0/80700269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c069900 0x7fa03c161070 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fa02c009870 tx=0x7fa02c01c540 comp rx=0 tx=0).stop 2023-08-25T05:35:18.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.109+0000 7fa0435ba640 1 -- 172.21.15.55:0/80700269 shutdown_connections 2023-08-25T05:35:18.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.109+0000 7fa0435ba640 1 --2- 172.21.15.55:0/80700269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c071500 0x7fa03c0c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:18.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.109+0000 7fa0435ba640 1 --2- 172.21.15.55:0/80700269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c069900 0x7fa03c161070 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:18.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.109+0000 7fa0435ba640 1 -- 172.21.15.55:0/80700269 >> 172.21.15.55:0/80700269 conn(0x7fa03c0cc010 msgr2=0x7fa03c0cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:18.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.109+0000 7fa0435ba640 1 -- 172.21.15.55:0/80700269 shutdown_connections 2023-08-25T05:35:18.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.109+0000 7fa0435ba640 1 -- 172.21.15.55:0/80700269 wait complete. 2023-08-25T05:35:18.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.109+0000 7fa0435ba640 1 Processor -- start 2023-08-25T05:35:18.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.109+0000 7fa0435ba640 1 -- start start 2023-08-25T05:35:18.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa0435ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c069900 0x7fa03c150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:18.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa0435ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa03c06e690 0x7fa03c156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:18.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa0435ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c071500 0x7fa03c0acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:18.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa0435ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c1f7330 con 0x7fa03c069900 2023-08-25T05:35:18.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa0435ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c1f7050 con 0x7fa03c06e690 2023-08-25T05:35:18.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa0435ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c155790 con 0x7fa03c071500 2023-08-25T05:35:18.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa041356640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c069900 0x7fa03c150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:18.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa041356640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c069900 0x7fa03c150100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49560/0 (socket says 172.21.15.55:49560) 2023-08-25T05:35:18.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa041356640 1 -- 172.21.15.55:0/2440542535 learned_addr learned my addr 172.21.15.55:0/2440542535 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:18.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa040b55640 1 --2- 172.21.15.55:0/2440542535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa03c06e690 0x7fa03c156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:18.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa041b57640 1 --2- 172.21.15.55:0/2440542535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c071500 0x7fa03c0acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:18.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa041356640 1 -- 172.21.15.55:0/2440542535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c071500 msgr2=0x7fa03c0acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:18.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa041356640 1 --2- 172.21.15.55:0/2440542535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c071500 0x7fa03c0acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:18.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa041356640 1 -- 172.21.15.55:0/2440542535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa03c06e690 msgr2=0x7fa03c156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:18.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa041356640 1 --2- 172.21.15.55:0/2440542535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa03c06e690 0x7fa03c156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:18.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa041356640 1 -- 172.21.15.55:0/2440542535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c0094d0 con 0x7fa03c069900 2023-08-25T05:35:18.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa041356640 1 --2- 172.21.15.55:0/2440542535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c069900 0x7fa03c150100 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fa03800c500 tx=0x7fa03800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:18.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa031ffb640 1 -- 172.21.15.55:0/2440542535 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038005220 con 0x7fa03c069900 2023-08-25T05:35:18.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa031ffb640 1 -- 172.21.15.55:0/2440542535 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa038005380 con 0x7fa03c069900 2023-08-25T05:35:18.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa0435ba640 1 -- 172.21.15.55:0/2440542535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03c155a70 con 0x7fa03c069900 2023-08-25T05:35:18.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa031ffb640 1 -- 172.21.15.55:0/2440542535 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038007270 con 0x7fa03c069900 2023-08-25T05:35:18.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa0435ba640 1 -- 172.21.15.55:0/2440542535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03c1f6c70 con 0x7fa03c069900 2023-08-25T05:35:18.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa0435ba640 1 -- 172.21.15.55:0/2440542535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03c04dbe0 con 0x7fa03c069900 2023-08-25T05:35:18.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.113+0000 7fa031ffb640 1 -- 172.21.15.55:0/2440542535 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 101) v1 ==== 85093+0+0 (secure 0 0 0) 0x7fa0380073d0 con 0x7fa03c069900 2023-08-25T05:35:18.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.117+0000 7fa031ffb640 1 --2- 172.21.15.55:0/2440542535 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fa0200657f0 0x7fa020067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:18.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.117+0000 7fa031ffb640 1 -- 172.21.15.55:0/2440542535 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6808+0+0 (secure 0 0 0) 0x7fa038082b40 con 0x7fa03c069900 2023-08-25T05:35:18.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.117+0000 7fa040b55640 1 --2- 172.21.15.55:0/2440542535 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fa0200657f0 0x7fa020067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:18.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.117+0000 7fa040b55640 1 --2- 172.21.15.55:0/2440542535 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fa0200657f0 0x7fa020067cb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0af000 tx=0x7fa02c008040 comp rx=0 tx=0).ready entity=mgr.8522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:18.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.121+0000 7fa031ffb640 1 -- 172.21.15.55:0/2440542535 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa0380501f0 con 0x7fa03c069900 2023-08-25T05:35:18.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.297+0000 7fa0435ba640 1 -- 172.21.15.55:0/2440542535 --> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa03c0c64f0 con 0x7fa0200657f0 2023-08-25T05:35:18.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.365+0000 7fa031ffb640 1 -- 172.21.15.55:0/2440542535 <== mgr.8522 v2:172.21.15.110:6832/2233108903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7fa03c0c64f0 con 0x7fa0200657f0 2023-08-25T05:35:18.371 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-08-25T05:35:18.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.369+0000 7fa0435ba640 1 -- 172.21.15.55:0/2440542535 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fa0200657f0 msgr2=0x7fa020067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:18.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.369+0000 7fa0435ba640 1 --2- 172.21.15.55:0/2440542535 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fa0200657f0 0x7fa020067cb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa02c0af000 tx=0x7fa02c008040 comp rx=0 tx=0).stop 2023-08-25T05:35:18.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.369+0000 7fa0435ba640 1 -- 172.21.15.55:0/2440542535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c069900 msgr2=0x7fa03c150100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:18.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.369+0000 7fa0435ba640 1 --2- 172.21.15.55:0/2440542535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c069900 0x7fa03c150100 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fa03800c500 tx=0x7fa03800c9c0 comp rx=0 tx=0).stop 2023-08-25T05:35:18.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.369+0000 7fa0435ba640 1 -- 172.21.15.55:0/2440542535 shutdown_connections 2023-08-25T05:35:18.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.369+0000 7fa0435ba640 1 --2- 172.21.15.55:0/2440542535 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fa0200657f0 0x7fa020067cb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:18.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.369+0000 7fa0435ba640 1 --2- 172.21.15.55:0/2440542535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa03c071500 0x7fa03c0acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:18.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.369+0000 7fa0435ba640 1 --2- 172.21.15.55:0/2440542535 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa03c06e690 0x7fa03c156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:18.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.369+0000 7fa0435ba640 1 --2- 172.21.15.55:0/2440542535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa03c069900 0x7fa03c150100 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:18.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.369+0000 7fa0435ba640 1 -- 172.21.15.55:0/2440542535 >> 172.21.15.55:0/2440542535 conn(0x7fa03c0cc010 msgr2=0x7fa03c0cdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:18.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.369+0000 7fa0435ba640 1 -- 172.21.15.55:0/2440542535 shutdown_connections 2023-08-25T05:35:18.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:18.369+0000 7fa0435ba640 1 -- 172.21.15.55:0/2440542535 wait complete. 2023-08-25T05:35:18.392 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-08-25T05:35:18.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:18.393 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-08-25T05:35:18.403 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_20_00_UTC 2023-08-25T05:35:18.403 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_21_00_UTC 2023-08-25T05:35:18.403 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_22_00_UTC 2023-08-25T05:35:18.403 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_23_00_UTC 2023-08-25T05:35:18.403 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_24_00_UTC 2023-08-25T05:35:18.403 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_25_00_UTC 2023-08-25T05:35:18.404 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_26_00_UTC 2023-08-25T05:35:18.404 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_27_00_UTC 2023-08-25T05:35:18.404 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_28_00_UTC 2023-08-25T05:35:18.404 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_29_00_UTC 2023-08-25T05:35:18.404 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_30_00_UTC 2023-08-25T05:35:18.404 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_31_00_UTC 2023-08-25T05:35:18.404 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_32_00_UTC 2023-08-25T05:35:18.405 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_33_00_UTC 2023-08-25T05:35:18.405 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_34_00_UTC 2023-08-25T05:35:18.405 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_35_00_UTC 2023-08-25T05:35:18.406 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_20_00_UTC 2023-08-25T05:35:18.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:18.406 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_20_00_UTC) 2023-08-25T05:35:18.464 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_21_00_UTC 2023-08-25T05:35:18.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:18.465 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_21_00_UTC) 2023-08-25T05:35:18.525 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_22_00_UTC 2023-08-25T05:35:18.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:18.526 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_22_00_UTC) 2023-08-25T05:35:18.581 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_23_00_UTC 2023-08-25T05:35:18.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:18.582 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_23_00_UTC) 2023-08-25T05:35:18.636 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_24_00_UTC 2023-08-25T05:35:18.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:18.637 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_24_00_UTC) 2023-08-25T05:35:18.692 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_25_00_UTC 2023-08-25T05:35:18.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:18.693 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_25_00_UTC) 2023-08-25T05:35:18.748 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_26_00_UTC 2023-08-25T05:35:18.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:18.749 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_26_00_UTC) 2023-08-25T05:35:18.805 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_27_00_UTC 2023-08-25T05:35:18.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:18.806 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_27_00_UTC) 2023-08-25T05:35:18.861 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_28_00_UTC 2023-08-25T05:35:18.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:18.862 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_28_00_UTC) 2023-08-25T05:35:18.916 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_29_00_UTC 2023-08-25T05:35:18.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:18.917 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_29_00_UTC) 2023-08-25T05:35:18.976 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_30_00_UTC 2023-08-25T05:35:18.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:18.977 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_30_00_UTC) 2023-08-25T05:35:19.033 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_31_00_UTC 2023-08-25T05:35:19.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:19.033 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_31_00_UTC) 2023-08-25T05:35:19.088 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_32_00_UTC 2023-08-25T05:35:19.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:19.089 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_32_00_UTC) 2023-08-25T05:35:19.149 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_33_00_UTC 2023-08-25T05:35:19.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:19.149 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_33_00_UTC) 2023-08-25T05:35:19.204 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_34_00_UTC 2023-08-25T05:35:19.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:19.205 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_34_00_UTC) 2023-08-25T05:35:19.265 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_35_00_UTC 2023-08-25T05:35:19.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:19.266 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-08-25-05_35_00_UTC) 2023-08-25T05:35:19.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:19.321 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-08-25T05:35:19.378 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-25T05:35:19.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.557+0000 7fdf0c367640 1 Processor -- start 2023-08-25T05:35:19.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.557+0000 7fdf0c367640 1 -- start start 2023-08-25T05:35:19.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf0c367640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0406e5a0 0x7fdf040cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:19.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf0c367640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf040cab90 con 0x7fdf0406c790 2023-08-25T05:35:19.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf0c367640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0406dbb0 con 0x7fdf0406c3b0 2023-08-25T05:35:19.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf0c367640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf040cae50 con 0x7fdf0406e5a0 2023-08-25T05:35:19.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf0a904640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdf0406c790 0x7fdf040ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49400/0 (socket says 172.21.15.55:49400) 2023-08-25T05:35:19.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf0a904640 1 -- 172.21.15.55:0/1527608412 learned_addr learned my addr 172.21.15.55:0/1527608412 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:19.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf09902640 1 --2- 172.21.15.55:0/1527608412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0406e5a0 0x7fdf040cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:19.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf09101640 1 -- 172.21.15.55:0/1527608412 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705630198 0 0) 0x7fdf040cab90 con 0x7fdf0406c790 2023-08-25T05:35:19.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf09101640 1 -- 172.21.15.55:0/1527608412 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdef0003530 con 0x7fdf0406c790 2023-08-25T05:35:19.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf09101640 1 -- 172.21.15.55:0/1527608412 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1679266693 0 0) 0x7fdef0003530 con 0x7fdf0406c790 2023-08-25T05:35:19.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf09101640 1 -- 172.21.15.55:0/1527608412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0406e5a0 msgr2=0x7fdf040cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:19.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf09101640 1 --2- 172.21.15.55:0/1527608412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0406e5a0 0x7fdf040cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf09101640 1 -- 172.21.15.55:0/1527608412 >> v1:172.21.15.110:6789/0 conn(0x7fdf0406c3b0 legacy=0x7fdf0406de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf09101640 1 -- 172.21.15.55:0/1527608412 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf040cb130 con 0x7fdf0406c790 2023-08-25T05:35:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf09101640 1 -- 172.21.15.55:0/1527608412 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fdefc001a00 con 0x7fdf0406c790 2023-08-25T05:35:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf09101640 1 -- 172.21.15.55:0/1527608412 >> v1:172.21.15.55:6789/0 conn(0x7fdf0406c790 legacy=0x7fdf040ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf09101640 1 --2- 172.21.15.55:0/1527608412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0406e5a0 0x7fdef00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf09101640 1 --2- 172.21.15.55:0/1527608412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdef0003f30 0x7fdef00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf09101640 1 --2- 172.21.15.55:0/1527608412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdef0004d10 0x7fdef0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:19.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf09101640 1 -- 172.21.15.55:0/1527608412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf040cae50 con 0x7fdef0004d10 2023-08-25T05:35:19.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf09101640 1 -- 172.21.15.55:0/1527608412 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef000ba70 con 0x7fdef0003f30 2023-08-25T05:35:19.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf09101640 1 -- 172.21.15.55:0/1527608412 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef000bc30 con 0x7fdf0406e5a0 2023-08-25T05:35:19.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf0a103640 1 --2- 172.21.15.55:0/1527608412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0406e5a0 0x7fdef00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:19.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf09902640 1 --2- 172.21.15.55:0/1527608412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdef0003f30 0x7fdef00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:19.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf0a904640 1 --2- 172.21.15.55:0/1527608412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdef0004d10 0x7fdef0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:19.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf0a103640 1 -- 172.21.15.55:0/1527608412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdef0003f30 msgr2=0x7fdef00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:19.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf0a103640 1 --2- 172.21.15.55:0/1527608412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdef0003f30 0x7fdef00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:19.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf0a103640 1 -- 172.21.15.55:0/1527608412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdef0004d10 msgr2=0x7fdef0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:19.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf0a103640 1 --2- 172.21.15.55:0/1527608412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdef0004d10 0x7fdef0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:19.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.561+0000 7fdf0a103640 1 -- 172.21.15.55:0/1527608412 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef0003530 con 0x7fdf0406e5a0 2023-08-25T05:35:19.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.565+0000 7fdf0a103640 1 --2- 172.21.15.55:0/1527608412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0406e5a0 0x7fdef00039b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdf000017b0 tx=0x7fdf0001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82307fb0f35e8b9a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:19.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.565+0000 7fdf09101640 1 -- 172.21.15.55:0/1527608412 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf000052d0 con 0x7fdf0406e5a0 2023-08-25T05:35:19.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.565+0000 7fdf09101640 1 -- 172.21.15.55:0/1527608412 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf000a7050 con 0x7fdf0406e5a0 2023-08-25T05:35:19.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.565+0000 7fdf09101640 1 -- 172.21.15.55:0/1527608412 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00003650 con 0x7fdf0406e5a0 2023-08-25T05:35:19.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.565+0000 7fdf0c367640 1 -- 172.21.15.55:0/1527608412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0406e5a0 msgr2=0x7fdef00039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:19.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.565+0000 7fdf0c367640 1 --2- 172.21.15.55:0/1527608412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0406e5a0 0x7fdef00039b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdf000017b0 tx=0x7fdf0001c3e0 comp rx=0 tx=0).stop 2023-08-25T05:35:19.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.565+0000 7fdf0a904640 1 -- 172.21.15.55:0/1527608412 reap_dead start 2023-08-25T05:35:19.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.565+0000 7fdf0c367640 1 -- 172.21.15.55:0/1527608412 shutdown_connections 2023-08-25T05:35:19.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.565+0000 7fdf0c367640 1 -- 172.21.15.55:0/1527608412 >> 172.21.15.55:0/1527608412 conn(0x7fdf040d0540 msgr2=0x7fdf040d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:19.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.565+0000 7fdf0c367640 1 -- 172.21.15.55:0/1527608412 shutdown_connections 2023-08-25T05:35:19.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.565+0000 7fdf0c367640 1 -- 172.21.15.55:0/1527608412 wait complete. 2023-08-25T05:35:19.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0c367640 1 Processor -- start 2023-08-25T05:35:19.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0c367640 1 -- start start 2023-08-25T05:35:19.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0c367640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf0406e5a0 0x7fdf041558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:19.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0c367640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf040ae160 0x7fdf040ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:19.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0c367640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf040c91d0 0x7fdf040c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:19.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0c367640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf040aeb20 con 0x7fdf0406e5a0 2023-08-25T05:35:19.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0c367640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf040c83c0 con 0x7fdf040c91d0 2023-08-25T05:35:19.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0c367640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf040c9ba0 con 0x7fdf040ae160 2023-08-25T05:35:19.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0a103640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf0406e5a0 0x7fdf041558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:19.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0a103640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf0406e5a0 0x7fdf041558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49578/0 (socket says 172.21.15.55:49578) 2023-08-25T05:35:19.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0a103640 1 -- 172.21.15.55:0/1773590469 learned_addr learned my addr 172.21.15.55:0/1773590469 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:19.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0a904640 1 --2- 172.21.15.55:0/1773590469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf040c91d0 0x7fdf040c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:19.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf09902640 1 --2- 172.21.15.55:0/1773590469 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf040ae160 0x7fdf040ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:19.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0a103640 1 -- 172.21.15.55:0/1773590469 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf040ae160 msgr2=0x7fdf040ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:19.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0a103640 1 --2- 172.21.15.55:0/1773590469 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf040ae160 0x7fdf040ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:19.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0a103640 1 -- 172.21.15.55:0/1773590469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf040c91d0 msgr2=0x7fdf040c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:19.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0a103640 1 --2- 172.21.15.55:0/1773590469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf040c91d0 0x7fdf040c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:19.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0a103640 1 -- 172.21.15.55:0/1773590469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf040c77b0 con 0x7fdf0406e5a0 2023-08-25T05:35:19.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0a904640 1 --2- 172.21.15.55:0/1773590469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf040c91d0 0x7fdf040c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:19.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf09902640 1 --2- 172.21.15.55:0/1773590469 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf040ae160 0x7fdf040ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:19.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0a103640 1 --2- 172.21.15.55:0/1773590469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf0406e5a0 0x7fdf041558f0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fdf00005040 tx=0x7fdef0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:19.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdefaffd640 1 -- 172.21.15.55:0/1773590469 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00006e70 con 0x7fdf0406e5a0 2023-08-25T05:35:19.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdefaffd640 1 -- 172.21.15.55:0/1773590469 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf00000f30 con 0x7fdf0406e5a0 2023-08-25T05:35:19.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdefaffd640 1 -- 172.21.15.55:0/1773590469 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00007260 con 0x7fdf0406e5a0 2023-08-25T05:35:19.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0c367640 1 -- 172.21.15.55:0/1773590469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf040c7a90 con 0x7fdf0406e5a0 2023-08-25T05:35:19.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.569+0000 7fdf0c367640 1 -- 172.21.15.55:0/1773590469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf040c8050 con 0x7fdf0406e5a0 2023-08-25T05:35:19.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.573+0000 7fdf0c367640 1 -- 172.21.15.55:0/1773590469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf04073ec0 con 0x7fdf0406e5a0 2023-08-25T05:35:19.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.573+0000 7fdefaffd640 1 -- 172.21.15.55:0/1773590469 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 101) v1 ==== 85093+0+0 (secure 0 0 0) 0x7fdf000073c0 con 0x7fdf0406e5a0 2023-08-25T05:35:19.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.573+0000 7fdefaffd640 1 --2- 172.21.15.55:0/1773590469 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fdee8065820 0x7fdee8067ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:19.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.573+0000 7fdefaffd640 1 -- 172.21.15.55:0/1773590469 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6808+0+0 (secure 0 0 0) 0x7fdf0011dff0 con 0x7fdf0406e5a0 2023-08-25T05:35:19.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.573+0000 7fdf09902640 1 --2- 172.21.15.55:0/1773590469 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fdee8065820 0x7fdee8067ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:19.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.573+0000 7fdf09902640 1 --2- 172.21.15.55:0/1773590469 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fdee8065820 0x7fdee8067ce0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdef4006d50 tx=0x7fdef4008040 comp rx=0 tx=0).ready entity=mgr.8522 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:19.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.577+0000 7fdefaffd640 1 -- 172.21.15.55:0/1773590469 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fdf000eb560 con 0x7fdf0406e5a0 2023-08-25T05:35:19.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:19.769+0000 7fdf0c367640 1 -- 172.21.15.55:0/1773590469 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fdf040b1500 con 0x7fdf0406e5a0 2023-08-25T05:35:20.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.237+0000 7fdefaffd640 1 -- 172.21.15.55:0/1773590469 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 102) v1 ==== 85076+0+0 (secure 0 0 0) 0x7fdf0011c080 con 0x7fdf0406e5a0 2023-08-25T05:35:20.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.237+0000 7fdefaffd640 1 -- 172.21.15.55:0/1773590469 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v102) v1 ==== 93+0+0 (secure 0 0 0) 0x7fdf000eb560 con 0x7fdf0406e5a0 2023-08-25T05:35:20.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.241+0000 7fdf0c367640 1 -- 172.21.15.55:0/1773590469 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fdee8065820 msgr2=0x7fdee8067ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:20.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.241+0000 7fdf0c367640 1 --2- 172.21.15.55:0/1773590469 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fdee8065820 0x7fdee8067ce0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdef4006d50 tx=0x7fdef4008040 comp rx=0 tx=0).stop 2023-08-25T05:35:20.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.241+0000 7fdf0c367640 1 -- 172.21.15.55:0/1773590469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf0406e5a0 msgr2=0x7fdf041558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:20.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.241+0000 7fdf0c367640 1 --2- 172.21.15.55:0/1773590469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf0406e5a0 0x7fdf041558f0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fdf00005040 tx=0x7fdef0005800 comp rx=0 tx=0).stop 2023-08-25T05:35:20.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.241+0000 7fdf0c367640 1 -- 172.21.15.55:0/1773590469 shutdown_connections 2023-08-25T05:35:20.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.241+0000 7fdf0c367640 1 --2- 172.21.15.55:0/1773590469 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fdee8065820 0x7fdee8067ce0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.241+0000 7fdf0c367640 1 --2- 172.21.15.55:0/1773590469 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf040c91d0 0x7fdf040c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.241+0000 7fdf0c367640 1 --2- 172.21.15.55:0/1773590469 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf040ae160 0x7fdf040ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.241+0000 7fdf0c367640 1 --2- 172.21.15.55:0/1773590469 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf0406e5a0 0x7fdf041558f0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.241+0000 7fdf0c367640 1 -- 172.21.15.55:0/1773590469 >> 172.21.15.55:0/1773590469 conn(0x7fdf040d0540 msgr2=0x7fdf040b0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:20.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.241+0000 7fdf0c367640 1 -- 172.21.15.55:0/1773590469 shutdown_connections 2023-08-25T05:35:20.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.241+0000 7fdf0c367640 1 -- 172.21.15.55:0/1773590469 wait complete. 2023-08-25T05:35:20.265 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T05:35:20.266 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T05:35:20.326 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T05:35:20.406 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T05:35:20.406 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:35:20.407 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:35:20.416 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:35:20.416 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:35:20.418 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:20.413+0000 7f65c38d5180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:35:20.423 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:20.416+0000 7f907b342180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:35:20.426 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:35:20.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.613+0000 7f5dc5619640 1 Processor -- start 2023-08-25T05:35:20.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.613+0000 7f5dc5619640 1 -- start start 2023-08-25T05:35:20.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.613+0000 7f5dc5619640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5dc0160120 0x7f5dc00b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:20.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.613+0000 7f5dc5619640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5dc00b4080 0x7f5dc00b4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:20.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.613+0000 7f5dc5619640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc00b1f20 con 0x7f5dc00d0500 2023-08-25T05:35:20.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.613+0000 7f5dc5619640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc00b4a50 con 0x7f5dc00b4080 2023-08-25T05:35:20.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.613+0000 7f5dc5619640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc00cddf0 con 0x7f5dc0160120 2023-08-25T05:35:20.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.613+0000 7f5dbe7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5dc00b4080 0x7f5dc00b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:20.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.613+0000 7f5dbe7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5dc00b4080 0x7f5dc00b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47276/0 (socket says 172.21.15.55:47276) 2023-08-25T05:35:20.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.613+0000 7f5dbe7fc640 1 -- 172.21.15.55:0/2401914462 learned_addr learned my addr 172.21.15.55:0/2401914462 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:20.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.613+0000 7f5dbeffd640 1 --2- 172.21.15.55:0/2401914462 >> v2:172.21.15.110:3300/0 conn(0x7f5dc0160120 0x7f5dc00b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:20.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.613+0000 7f5dbe7fc640 1 -- 172.21.15.55:0/2401914462 >> v2:172.21.15.110:3300/0 conn(0x7f5dc0160120 msgr2=0x7f5dc00b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:20.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.613+0000 7f5dbe7fc640 1 --2- 172.21.15.55:0/2401914462 >> v2:172.21.15.110:3300/0 conn(0x7f5dc0160120 0x7f5dc00b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.613+0000 7f5dbe7fc640 1 -- 172.21.15.55:0/2401914462 >> v1:172.21.15.110:6789/0 conn(0x7f5dc00d0500 legacy=0x7f5dc00d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:20.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.613+0000 7f5dbe7fc640 1 -- 172.21.15.55:0/2401914462 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc00ce0d0 con 0x7f5dc00b4080 2023-08-25T05:35:20.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.617+0000 7f5dbe7fc640 1 --2- 172.21.15.55:0/2401914462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc00b4080 0x7f5dc00b4510 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f5db4009870 tx=0x7f5db401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72f97458e2db7ce server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:20.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.617+0000 7f5dbdffb640 1 -- 172.21.15.55:0/2401914462 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db40aa430 con 0x7f5dc00b4080 2023-08-25T05:35:20.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.617+0000 7f5dbdffb640 1 -- 172.21.15.55:0/2401914462 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db40aa590 con 0x7f5dc00b4080 2023-08-25T05:35:20.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.617+0000 7f5dbdffb640 1 -- 172.21.15.55:0/2401914462 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db40aa920 con 0x7f5dc00b4080 2023-08-25T05:35:20.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.617+0000 7f5dc5619640 1 -- 172.21.15.55:0/2401914462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc00b4080 msgr2=0x7f5dc00b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:20.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.617+0000 7f5dc5619640 1 --2- 172.21.15.55:0/2401914462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc00b4080 0x7f5dc00b4510 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f5db4009870 tx=0x7f5db401c4d0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.617+0000 7f5dc5619640 1 -- 172.21.15.55:0/2401914462 shutdown_connections 2023-08-25T05:35:20.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.617+0000 7f5dc5619640 1 --2- 172.21.15.55:0/2401914462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc00b4080 0x7f5dc00b4510 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.617+0000 7f5dc5619640 1 --2- 172.21.15.55:0/2401914462 >> v2:172.21.15.110:3300/0 conn(0x7f5dc0160120 0x7f5dc00b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.617+0000 7f5dc5619640 1 -- 172.21.15.55:0/2401914462 >> 172.21.15.55:0/2401914462 conn(0x7f5dc009b950 msgr2=0x7f5dc00d2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:20.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.617+0000 7f5dc5619640 1 -- 172.21.15.55:0/2401914462 shutdown_connections 2023-08-25T05:35:20.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.617+0000 7f5dc5619640 1 -- 172.21.15.55:0/2401914462 wait complete. 2023-08-25T05:35:20.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dc5619640 1 Processor -- start 2023-08-25T05:35:20.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dc5619640 1 -- start start 2023-08-25T05:35:20.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dc5619640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dc00b4080 0x7f5dc00b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:20.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dc5619640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dc00d0500 0x7f5dc00b7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:20.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dc5619640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc0160120 0x7f5dc00cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:20.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dc5619640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc0150d40 con 0x7f5dc0160120 2023-08-25T05:35:20.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dc5619640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc00cbe20 con 0x7f5dc00d0500 2023-08-25T05:35:20.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dc5619640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc00cc100 con 0x7f5dc00b4080 2023-08-25T05:35:20.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dbf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc0160120 0x7f5dc00cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:20.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dbf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc0160120 0x7f5dc00cb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47278/0 (socket says 172.21.15.55:47278) 2023-08-25T05:35:20.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dbf7fe640 1 -- 172.21.15.55:0/1406994010 learned_addr learned my addr 172.21.15.55:0/1406994010 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:20.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dbeffd640 1 --2- 172.21.15.55:0/1406994010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dc00b4080 0x7f5dc00b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:20.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dbe7fc640 1 --2- 172.21.15.55:0/1406994010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dc00d0500 0x7f5dc00b7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:20.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dbf7fe640 1 -- 172.21.15.55:0/1406994010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dc00b4080 msgr2=0x7f5dc00b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:20.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dbf7fe640 1 --2- 172.21.15.55:0/1406994010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dc00b4080 0x7f5dc00b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dbf7fe640 1 -- 172.21.15.55:0/1406994010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dc00d0500 msgr2=0x7f5dc00b7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:20.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dbf7fe640 1 --2- 172.21.15.55:0/1406994010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dc00d0500 0x7f5dc00b7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dbf7fe640 1 -- 172.21.15.55:0/1406994010 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db40094d0 con 0x7f5dc0160120 2023-08-25T05:35:20.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dbeffd640 1 --2- 172.21.15.55:0/1406994010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dc00b4080 0x7f5dc00b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:35:20.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dbf7fe640 1 --2- 172.21.15.55:0/1406994010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc0160120 0x7f5dc00cb3b0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f5db800c770 tx=0x7f5db800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:20.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5da77fe640 1 -- 172.21.15.55:0/1406994010 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db8003b80 con 0x7f5dc0160120 2023-08-25T05:35:20.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5da77fe640 1 -- 172.21.15.55:0/1406994010 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db8003ce0 con 0x7f5dc0160120 2023-08-25T05:35:20.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dc5619640 1 -- 172.21.15.55:0/1406994010 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc00cc3e0 con 0x7f5dc0160120 2023-08-25T05:35:20.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5da77fe640 1 -- 172.21.15.55:0/1406994010 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db800aa90 con 0x7f5dc0160120 2023-08-25T05:35:20.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dc5619640 1 -- 172.21.15.55:0/1406994010 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc00b8400 con 0x7f5dc0160120 2023-08-25T05:35:20.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.621+0000 7f5dc5619640 1 -- 172.21.15.55:0/1406994010 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc0073e50 con 0x7f5dc0160120 2023-08-25T05:35:20.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.625+0000 7f5da77fe640 1 -- 172.21.15.55:0/1406994010 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 102) v1 ==== 85076+0+0 (secure 0 0 0) 0x7f5db800abf0 con 0x7f5dc0160120 2023-08-25T05:35:20.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.625+0000 7f5da77fe640 1 --2- 172.21.15.55:0/1406994010 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f5dac0657a0 0x7f5dac067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:20.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.625+0000 7f5da77fe640 1 -- 172.21.15.55:0/1406994010 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6808+0+0 (secure 0 0 0) 0x7f5db8082f20 con 0x7f5dc0160120 2023-08-25T05:35:20.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.625+0000 7f5dbeffd640 1 -- 172.21.15.55:0/1406994010 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f5dac0657a0 msgr2=0x7f5dac067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2233108903 2023-08-25T05:35:20.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.625+0000 7f5dbeffd640 1 --2- 172.21.15.55:0/1406994010 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f5dac0657a0 0x7f5dac067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:35:20.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.629+0000 7f5da77fe640 1 -- 172.21.15.55:0/1406994010 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5db8050700 con 0x7f5dc0160120 2023-08-25T05:35:20.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.789+0000 7f5dc5619640 1 -- 172.21.15.55:0/1406994010 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5dc00c9400 con 0x7f5dc0160120 2023-08-25T05:35:20.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.789+0000 7f5da77fe640 1 -- 172.21.15.55:0/1406994010 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+19421 (secure 0 0 0) 0x7f5db8053d20 con 0x7f5dc0160120 2023-08-25T05:35:20.793 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:20.794 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":174,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:30:20.824529+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:19:16.250564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-25T05:19:17.474382+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.5","mappings":[{"from":3,"to":0}]},{"pgid":"22.34","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/186183046":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/555519094":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/4158794211":"2023-08-26T05:30:20.824468+0000","172.21.15.110:6832/758142785":"2023-08-26T05:30:20.824468+0000","172.21.15.110:6833/758142785":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/1448709432":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/2185378335":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/1252154583":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/2517199041":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/2871001293":"2023-08-26T05:19:35.670048+0000","172.21.15.110:6833/221263034":"2023-08-26T05:19:35.670048+0000","172.21.15.110:6832/221263034":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/678216564":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/4272437355":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/914246484":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/1054752082":"2023-08-26T05:19:35.670048+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:35:20.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.789+0000 7f5dc5619640 1 -- 172.21.15.55:0/1406994010 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f5dac0657a0 msgr2=0x7f5dac067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:35:20.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.789+0000 7f5dc5619640 1 --2- 172.21.15.55:0/1406994010 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f5dac0657a0 0x7f5dac067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.789+0000 7f5dc5619640 1 -- 172.21.15.55:0/1406994010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc0160120 msgr2=0x7f5dc00cb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:20.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.789+0000 7f5dc5619640 1 --2- 172.21.15.55:0/1406994010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc0160120 0x7f5dc00cb3b0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f5db800c770 tx=0x7f5db800cc30 comp rx=0 tx=0).stop 2023-08-25T05:35:20.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.789+0000 7f5dc5619640 1 -- 172.21.15.55:0/1406994010 shutdown_connections 2023-08-25T05:35:20.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.789+0000 7f5dc5619640 1 --2- 172.21.15.55:0/1406994010 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f5dac0657a0 0x7f5dac067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.789+0000 7f5dc5619640 1 --2- 172.21.15.55:0/1406994010 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5dc0160120 0x7f5dc00cb3b0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.789+0000 7f5dc5619640 1 --2- 172.21.15.55:0/1406994010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dc00d0500 0x7f5dc00b7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.789+0000 7f5dc5619640 1 --2- 172.21.15.55:0/1406994010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dc00b4080 0x7f5dc00b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.789+0000 7f5dc5619640 1 -- 172.21.15.55:0/1406994010 >> 172.21.15.55:0/1406994010 conn(0x7f5dc009b950 msgr2=0x7f5dc00af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:20.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.789+0000 7f5dc5619640 1 -- 172.21.15.55:0/1406994010 shutdown_connections 2023-08-25T05:35:20.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.789+0000 7f5dc5619640 1 -- 172.21.15.55:0/1406994010 wait complete. 2023-08-25T05:35:20.815 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T05:19:16.250564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '169', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T05:19:17.474382+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '170', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T05:35:20.816 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T05:35:20.835 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:20.832+0000 7f907b342180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:35:20.862 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:20.857+0000 7f65c38d5180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:35:20.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.961+0000 7f0fac744640 1 Processor -- start 2023-08-25T05:35:20.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.961+0000 7f0fac744640 1 -- start start 2023-08-25T05:35:20.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.961+0000 7f0fac744640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0fa41601f0 0x7f0fa415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:20.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.961+0000 7f0fac744640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0fa40d1290 0x7f0fa415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:20.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.961+0000 7f0fac744640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa40cd5a0 con 0x7f0fa415e3c0 2023-08-25T05:35:20.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.961+0000 7f0fac744640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa40cd880 con 0x7f0fa40d1290 2023-08-25T05:35:20.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.961+0000 7f0fac744640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa40cdb60 con 0x7f0fa41601f0 2023-08-25T05:35:20.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.965+0000 7f0fa9cdf640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0fa415e3c0 0x7f0fa40d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53592/0 (socket says 172.21.15.55:53592) 2023-08-25T05:35:20.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.965+0000 7f0fa9cdf640 1 -- 172.21.15.55:0/3093880714 learned_addr learned my addr 172.21.15.55:0/3093880714 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:20.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.965+0000 7f0faace1640 1 --2- 172.21.15.55:0/3093880714 >> v2:172.21.15.55:3300/0 conn(0x7f0fa40d1290 0x7f0fa415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:20.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.965+0000 7f0faa4e0640 1 --2- 172.21.15.55:0/3093880714 >> v2:172.21.15.110:3300/0 conn(0x7f0fa41601f0 0x7f0fa415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:20.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.965+0000 7f0fa94de640 1 -- 172.21.15.55:0/3093880714 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785640023 0 0) 0x7f0fa40cd5a0 con 0x7f0fa415e3c0 2023-08-25T05:35:20.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.965+0000 7f0fa94de640 1 -- 172.21.15.55:0/3093880714 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f90003530 con 0x7f0fa415e3c0 2023-08-25T05:35:20.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.965+0000 7f0faa4e0640 1 -- 172.21.15.55:0/3093880714 >> v2:172.21.15.55:3300/0 conn(0x7f0fa40d1290 msgr2=0x7f0fa415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:20.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.965+0000 7f0faa4e0640 1 --2- 172.21.15.55:0/3093880714 >> v2:172.21.15.55:3300/0 conn(0x7f0fa40d1290 0x7f0fa415e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.965+0000 7f0faa4e0640 1 -- 172.21.15.55:0/3093880714 >> v1:172.21.15.55:6789/0 conn(0x7f0fa415e3c0 legacy=0x7f0fa40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:20.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.965+0000 7f0faa4e0640 1 -- 172.21.15.55:0/3093880714 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa40cde40 con 0x7f0fa41601f0 2023-08-25T05:35:20.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.965+0000 7f0faa4e0640 1 --2- 172.21.15.55:0/3093880714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fa41601f0 0x7f0fa415d430 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f0fa408b7f0 tx=0x7f0fa001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=861db997fa9511f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:20.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.965+0000 7f0fa94de640 1 -- 172.21.15.55:0/3093880714 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa00ab600 con 0x7f0fa41601f0 2023-08-25T05:35:20.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fa94de640 1 -- 172.21.15.55:0/3093880714 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa00a7050 con 0x7f0fa41601f0 2023-08-25T05:35:20.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fa94de640 1 -- 172.21.15.55:0/3093880714 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa00ab980 con 0x7f0fa41601f0 2023-08-25T05:35:20.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fac744640 1 -- 172.21.15.55:0/3093880714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fa41601f0 msgr2=0x7f0fa415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:20.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fac744640 1 --2- 172.21.15.55:0/3093880714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fa41601f0 0x7f0fa415d430 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f0fa408b7f0 tx=0x7f0fa001c410 comp rx=0 tx=0).stop 2023-08-25T05:35:20.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fac744640 1 -- 172.21.15.55:0/3093880714 shutdown_connections 2023-08-25T05:35:20.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fac744640 1 --2- 172.21.15.55:0/3093880714 >> v2:172.21.15.55:3300/0 conn(0x7f0fa40d1290 0x7f0fa415e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fac744640 1 --2- 172.21.15.55:0/3093880714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fa41601f0 0x7f0fa415d430 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fac744640 1 -- 172.21.15.55:0/3093880714 >> 172.21.15.55:0/3093880714 conn(0x7f0fa40d27d0 msgr2=0x7f0fa40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:20.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fac744640 1 -- 172.21.15.55:0/3093880714 shutdown_connections 2023-08-25T05:35:20.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fac744640 1 -- 172.21.15.55:0/3093880714 wait complete. 2023-08-25T05:35:20.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fac744640 1 Processor -- start 2023-08-25T05:35:20.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fac744640 1 -- start start 2023-08-25T05:35:20.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fac744640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fa40d1290 0x7f0fa415d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:20.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fac744640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fa415e3c0 0x7f0fa4154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:20.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fac744640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fa41601f0 0x7f0fa415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:20.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fac744640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa415ce80 con 0x7f0fa41601f0 2023-08-25T05:35:20.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fac744640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa415d850 con 0x7f0fa415e3c0 2023-08-25T05:35:20.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fac744640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa4154ea0 con 0x7f0fa40d1290 2023-08-25T05:35:20.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0faace1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fa41601f0 0x7f0fa415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:20.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0faace1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fa41601f0 0x7f0fa415acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47298/0 (socket says 172.21.15.55:47298) 2023-08-25T05:35:20.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0faace1640 1 -- 172.21.15.55:0/3897758298 learned_addr learned my addr 172.21.15.55:0/3897758298 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:20.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0fa9cdf640 1 --2- 172.21.15.55:0/3897758298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fa415e3c0 0x7f0fa4154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:20.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.969+0000 7f0faa4e0640 1 --2- 172.21.15.55:0/3897758298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fa40d1290 0x7f0fa415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:20.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.973+0000 7f0faace1640 1 -- 172.21.15.55:0/3897758298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fa40d1290 msgr2=0x7f0fa415d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:20.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.973+0000 7f0faace1640 1 --2- 172.21.15.55:0/3897758298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fa40d1290 0x7f0fa415d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.973+0000 7f0faace1640 1 -- 172.21.15.55:0/3897758298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fa415e3c0 msgr2=0x7f0fa4154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:20.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.973+0000 7f0faace1640 1 --2- 172.21.15.55:0/3897758298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fa415e3c0 0x7f0fa4154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:20.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.973+0000 7f0faace1640 1 -- 172.21.15.55:0/3897758298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa00093b0 con 0x7f0fa41601f0 2023-08-25T05:35:20.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.973+0000 7f0faace1640 1 --2- 172.21.15.55:0/3897758298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fa41601f0 0x7f0fa415acd0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00efc0 tx=0x7f0f9c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:20.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.973+0000 7f0f9affd640 1 -- 172.21.15.55:0/3897758298 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c014480 con 0x7f0fa41601f0 2023-08-25T05:35:20.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.973+0000 7f0f9affd640 1 -- 172.21.15.55:0/3897758298 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c00f040 con 0x7f0fa41601f0 2023-08-25T05:35:20.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.973+0000 7f0f9affd640 1 -- 172.21.15.55:0/3897758298 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c014820 con 0x7f0fa41601f0 2023-08-25T05:35:20.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.973+0000 7f0fac744640 1 -- 172.21.15.55:0/3897758298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa415c270 con 0x7f0fa41601f0 2023-08-25T05:35:20.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.973+0000 7f0fac744640 1 -- 172.21.15.55:0/3897758298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa415c830 con 0x7f0fa41601f0 2023-08-25T05:35:20.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.973+0000 7f0fac744640 1 -- 172.21.15.55:0/3897758298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa40b5260 con 0x7f0fa41601f0 2023-08-25T05:35:20.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.973+0000 7f0f9affd640 1 -- 172.21.15.55:0/3897758298 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 102) v1 ==== 85076+0+0 (secure 0 0 0) 0x7f0f9c014980 con 0x7f0fa41601f0 2023-08-25T05:35:20.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.977+0000 7f0f9affd640 1 --2- 172.21.15.55:0/3897758298 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f0f880657d0 0x7f0f88067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:20.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.977+0000 7f0f9affd640 1 -- 172.21.15.55:0/3897758298 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6808+0+0 (secure 0 0 0) 0x7f0f9c084510 con 0x7f0fa41601f0 2023-08-25T05:35:20.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.977+0000 7f0faa4e0640 1 -- 172.21.15.55:0/3897758298 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f0f880657d0 msgr2=0x7f0f88067c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2233108903 2023-08-25T05:35:20.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.977+0000 7f0faa4e0640 1 --2- 172.21.15.55:0/3897758298 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f0f880657d0 0x7f0f88067c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:35:20.985 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:20.980+0000 7f907b342180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:35:20.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:20.981+0000 7f0f9affd640 1 -- 172.21.15.55:0/3897758298 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0f9c051be0 con 0x7f0fa41601f0 2023-08-25T05:35:21.026 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:21.021+0000 7f65c38d5180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:35:21.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.137+0000 7f0fac744640 1 -- 172.21.15.55:0/3897758298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0fa4073ec0 con 0x7f0fa41601f0 2023-08-25T05:35:21.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.141+0000 7f0f9affd640 1 -- 172.21.15.55:0/3897758298 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v174) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f9c018020 con 0x7f0fa41601f0 2023-08-25T05:35:21.145 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T05:35:21.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.141+0000 7f0fac744640 1 -- 172.21.15.55:0/3897758298 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f0f880657d0 msgr2=0x7f0f88067c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:35:21.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.141+0000 7f0fac744640 1 --2- 172.21.15.55:0/3897758298 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f0f880657d0 0x7f0f88067c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.141+0000 7f0fac744640 1 -- 172.21.15.55:0/3897758298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fa41601f0 msgr2=0x7f0fa415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:21.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.141+0000 7f0fac744640 1 --2- 172.21.15.55:0/3897758298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fa41601f0 0x7f0fa415acd0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00efc0 tx=0x7f0f9c00c490 comp rx=0 tx=0).stop 2023-08-25T05:35:21.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.141+0000 7f0fac744640 1 -- 172.21.15.55:0/3897758298 shutdown_connections 2023-08-25T05:35:21.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.141+0000 7f0fac744640 1 --2- 172.21.15.55:0/3897758298 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f0f880657d0 0x7f0f88067c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.141+0000 7f0fac744640 1 --2- 172.21.15.55:0/3897758298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fa41601f0 0x7f0fa415acd0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.141+0000 7f0fac744640 1 --2- 172.21.15.55:0/3897758298 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fa415e3c0 0x7f0fa4154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.141+0000 7f0fac744640 1 --2- 172.21.15.55:0/3897758298 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fa40d1290 0x7f0fa415d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.141+0000 7f0fac744640 1 -- 172.21.15.55:0/3897758298 >> 172.21.15.55:0/3897758298 conn(0x7f0fa40d27d0 msgr2=0x7f0fa40b6530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.141+0000 7f0fac744640 1 -- 172.21.15.55:0/3897758298 shutdown_connections 2023-08-25T05:35:21.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.141+0000 7f0fac744640 1 -- 172.21.15.55:0/3897758298 wait complete. 2023-08-25T05:35:21.166 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T05:35:21.359 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.353+0000 7f05c8219640 1 Processor -- start 2023-08-25T05:35:21.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.357+0000 7f05c8219640 1 -- start start 2023-08-25T05:35:21.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.357+0000 7f05c8219640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c01601f0 0x7f05c015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:21.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.357+0000 7f05c8219640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05c00d1290 0x7f05c015e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:21.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.357+0000 7f05c8219640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c00cd5a0 con 0x7f05c015e3c0 2023-08-25T05:35:21.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.357+0000 7f05c8219640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c00cd880 con 0x7f05c00d1290 2023-08-25T05:35:21.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.357+0000 7f05c8219640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00cdb60 con 0x7f05c01601f0 2023-08-25T05:35:21.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.357+0000 7f05c5fb5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c01601f0 0x7f05c015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:21.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.357+0000 7f05c67b6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f05c00d1290 0x7f05c015e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:21.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.357+0000 7f05c57b4640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f05c015e3c0 0x7f05c00d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:47118/0 (socket says 172.21.15.55:47118) 2023-08-25T05:35:21.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.357+0000 7f05c57b4640 1 -- 172.21.15.55:0/276369280 learned_addr learned my addr 172.21.15.55:0/276369280 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:21.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.357+0000 7f05c5fb5640 1 -- 172.21.15.55:0/276369280 >> v2:172.21.15.55:3300/0 conn(0x7f05c00d1290 msgr2=0x7f05c015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:21.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.357+0000 7f05c5fb5640 1 --2- 172.21.15.55:0/276369280 >> v2:172.21.15.55:3300/0 conn(0x7f05c00d1290 0x7f05c015e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.357+0000 7f05c5fb5640 1 -- 172.21.15.55:0/276369280 >> v1:172.21.15.110:6789/0 conn(0x7f05c015e3c0 legacy=0x7f05c00d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:21.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.357+0000 7f05c5fb5640 1 -- 172.21.15.55:0/276369280 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c00cde40 con 0x7f05c01601f0 2023-08-25T05:35:21.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.357+0000 7f05c4fb3640 1 -- 172.21.15.55:0/276369280 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190611037 0 0) 0x7f05c00cd5a0 con 0x7f05c015e3c0 2023-08-25T05:35:21.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.361+0000 7f05c5fb5640 1 --2- 172.21.15.55:0/276369280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c01601f0 0x7f05c015d430 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0097a0 tx=0x7f05bc01ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1570ce38ec231f1f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:21.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.361+0000 7f05c4fb3640 1 -- 172.21.15.55:0/276369280 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0a8950 con 0x7f05c01601f0 2023-08-25T05:35:21.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.361+0000 7f05c4fb3640 1 -- 172.21.15.55:0/276369280 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc0a8ab0 con 0x7f05c01601f0 2023-08-25T05:35:21.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.361+0000 7f05c4fb3640 1 -- 172.21.15.55:0/276369280 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0a8e40 con 0x7f05c01601f0 2023-08-25T05:35:21.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.361+0000 7f05c8219640 1 -- 172.21.15.55:0/276369280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c01601f0 msgr2=0x7f05c015d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:21.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.361+0000 7f05c8219640 1 --2- 172.21.15.55:0/276369280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c01601f0 0x7f05c015d430 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0097a0 tx=0x7f05bc01ec50 comp rx=0 tx=0).stop 2023-08-25T05:35:21.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.361+0000 7f05c8219640 1 -- 172.21.15.55:0/276369280 shutdown_connections 2023-08-25T05:35:21.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.361+0000 7f05c8219640 1 --2- 172.21.15.55:0/276369280 >> v2:172.21.15.55:3300/0 conn(0x7f05c00d1290 0x7f05c015e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.361+0000 7f05c8219640 1 --2- 172.21.15.55:0/276369280 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c01601f0 0x7f05c015d430 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.361+0000 7f05c8219640 1 -- 172.21.15.55:0/276369280 >> 172.21.15.55:0/276369280 conn(0x7f05c00d27d0 msgr2=0x7f05c00d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:21.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.361+0000 7f05c8219640 1 -- 172.21.15.55:0/276369280 shutdown_connections 2023-08-25T05:35:21.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.361+0000 7f05c8219640 1 -- 172.21.15.55:0/276369280 wait complete. 2023-08-25T05:35:21.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c8219640 1 Processor -- start 2023-08-25T05:35:21.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c8219640 1 -- start start 2023-08-25T05:35:21.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c8219640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c00d1290 0x7f05c00afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:21.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c8219640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c015e3c0 0x7f05c01f1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:21.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c8219640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c01601f0 0x7f05c006b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:21.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c8219640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c01532a0 con 0x7f05c01601f0 2023-08-25T05:35:21.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c8219640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00b0280 con 0x7f05c00d1290 2023-08-25T05:35:21.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c8219640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00c6c50 con 0x7f05c015e3c0 2023-08-25T05:35:21.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c67b6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c01601f0 0x7f05c006b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:21.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c57b4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c015e3c0 0x7f05c01f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:21.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c5fb5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c00d1290 0x7f05c00afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:21.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c57b4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c015e3c0 0x7f05c01f1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:49326/0 (socket says 172.21.15.55:49326) 2023-08-25T05:35:21.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c57b4640 1 -- 172.21.15.55:0/2182455720 learned_addr learned my addr 172.21.15.55:0/2182455720 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:21.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c57b4640 1 -- 172.21.15.55:0/2182455720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c00d1290 msgr2=0x7f05c00afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:21.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c57b4640 1 --2- 172.21.15.55:0/2182455720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c00d1290 0x7f05c00afd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c57b4640 1 -- 172.21.15.55:0/2182455720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c01601f0 msgr2=0x7f05c006b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:21.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c57b4640 1 --2- 172.21.15.55:0/2182455720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c01601f0 0x7f05c006b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c57b4640 1 -- 172.21.15.55:0/2182455720 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc0093b0 con 0x7f05c015e3c0 2023-08-25T05:35:21.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c57b4640 1 --2- 172.21.15.55:0/2182455720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c015e3c0 0x7f05c01f1860 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f05b000c520 tx=0x7f05b000c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:21.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05b67fc640 1 -- 172.21.15.55:0/2182455720 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b00074e0 con 0x7f05c015e3c0 2023-08-25T05:35:21.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05b67fc640 1 -- 172.21.15.55:0/2182455720 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b0007640 con 0x7f05c015e3c0 2023-08-25T05:35:21.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c8219640 1 -- 172.21.15.55:0/2182455720 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c00ce7c0 con 0x7f05c015e3c0 2023-08-25T05:35:21.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05b67fc640 1 -- 172.21.15.55:0/2182455720 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b00049f0 con 0x7f05c015e3c0 2023-08-25T05:35:21.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c8219640 1 -- 172.21.15.55:0/2182455720 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c00b3170 con 0x7f05c015e3c0 2023-08-25T05:35:21.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.365+0000 7f05c8219640 1 -- 172.21.15.55:0/2182455720 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c00b5260 con 0x7f05c015e3c0 2023-08-25T05:35:21.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.369+0000 7f05b67fc640 1 -- 172.21.15.55:0/2182455720 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 102) v1 ==== 85076+0+0 (secure 0 0 0) 0x7f05b0004b50 con 0x7f05c015e3c0 2023-08-25T05:35:21.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.369+0000 7f05b67fc640 1 --2- 172.21.15.55:0/2182455720 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f05a40657a0 0x7f05a4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:21.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.369+0000 7f05b67fc640 1 -- 172.21.15.55:0/2182455720 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6808+0+0 (secure 0 0 0) 0x7f05b00828d0 con 0x7f05c015e3c0 2023-08-25T05:35:21.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.369+0000 7f05c5fb5640 1 -- 172.21.15.55:0/2182455720 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f05a40657a0 msgr2=0x7f05a4067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2233108903 2023-08-25T05:35:21.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.369+0000 7f05c5fb5640 1 --2- 172.21.15.55:0/2182455720 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f05a40657a0 0x7f05a4067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:35:21.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.373+0000 7f05b67fc640 1 -- 172.21.15.55:0/2182455720 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f05b004ffa0 con 0x7f05c015e3c0 2023-08-25T05:35:21.464 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:21.460+0000 7f907b342180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:35:21.521 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:21.516+0000 7f907b342180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:35:21.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.529+0000 7f05c8219640 1 -- 172.21.15.55:0/2182455720 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f05c0073ec0 con 0x7f05c015e3c0 2023-08-25T05:35:21.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.529+0000 7f05b67fc640 1 -- 172.21.15.55:0/2182455720 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v174) v1 ==== 92+0+10 (secure 0 0 0) 0x7f05b00180a0 con 0x7f05c015e3c0 2023-08-25T05:35:21.534 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T05:35:21.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.533+0000 7f05c8219640 1 -- 172.21.15.55:0/2182455720 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f05a40657a0 msgr2=0x7f05a4067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:35:21.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.533+0000 7f05c8219640 1 --2- 172.21.15.55:0/2182455720 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f05a40657a0 0x7f05a4067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.533+0000 7f05c8219640 1 -- 172.21.15.55:0/2182455720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c015e3c0 msgr2=0x7f05c01f1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:21.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.533+0000 7f05c8219640 1 --2- 172.21.15.55:0/2182455720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c015e3c0 0x7f05c01f1860 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f05b000c520 tx=0x7f05b000c9e0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.533+0000 7f05c8219640 1 -- 172.21.15.55:0/2182455720 shutdown_connections 2023-08-25T05:35:21.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.533+0000 7f05c8219640 1 --2- 172.21.15.55:0/2182455720 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f05a40657a0 0x7f05a4067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.533+0000 7f05c8219640 1 --2- 172.21.15.55:0/2182455720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05c01601f0 0x7f05c006b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.533+0000 7f05c8219640 1 --2- 172.21.15.55:0/2182455720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f05c015e3c0 0x7f05c01f1860 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.533+0000 7f05c8219640 1 --2- 172.21.15.55:0/2182455720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f05c00d1290 0x7f05c00afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.533+0000 7f05c8219640 1 -- 172.21.15.55:0/2182455720 >> 172.21.15.55:0/2182455720 conn(0x7f05c00d27d0 msgr2=0x7f05c00d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.533+0000 7f05c8219640 1 -- 172.21.15.55:0/2182455720 shutdown_connections 2023-08-25T05:35:21.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.533+0000 7f05c8219640 1 -- 172.21.15.55:0/2182455720 wait complete. 2023-08-25T05:35:21.541 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:21.537+0000 7f65c38d5180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:35:21.556 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T05:35:21.577 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:21.572+0000 7f907b342180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:35:21.604 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:21.601+0000 7f65c38d5180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:35:21.661 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:21.656+0000 7f907b342180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:35:21.663 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:21.661+0000 7f65c38d5180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:35:21.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.701+0000 7f29d6634640 1 Processor -- start 2023-08-25T05:35:21.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.701+0000 7f29d6634640 1 -- start start 2023-08-25T05:35:21.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.705+0000 7f29d6634640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f29d01601f0 0x7f29d015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:21.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.705+0000 7f29d6634640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29d015e3c0 0x7f29d00d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:21.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.705+0000 7f29d6634640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d015f8b0 con 0x7f29d00d10c0 2023-08-25T05:35:21.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.705+0000 7f29d6634640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d00cd5a0 con 0x7f29d01601f0 2023-08-25T05:35:21.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.705+0000 7f29d6634640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d00cd880 con 0x7f29d015e3c0 2023-08-25T05:35:21.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.705+0000 7f29cffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f29d01601f0 0x7f29d015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:21.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.705+0000 7f29cffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f29d01601f0 0x7f29d015d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:53628/0 (socket says 172.21.15.55:53628) 2023-08-25T05:35:21.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.705+0000 7f29cffff640 1 -- 172.21.15.55:0/1657160428 learned_addr learned my addr 172.21.15.55:0/1657160428 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:21.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.705+0000 7f29d4bd1640 1 --1- 172.21.15.55:0/1657160428 >> v1:172.21.15.110:6789/0 conn(0x7f29d00d10c0 0x7f29d00b4250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:47128/0 (socket says 172.21.15.55:47128) 2023-08-25T05:35:21.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.705+0000 7f29c7fff640 1 --2- 172.21.15.55:0/1657160428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29d015e3c0 0x7f29d00d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:21.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.705+0000 7f29cffff640 1 -- 172.21.15.55:0/1657160428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29d015e3c0 msgr2=0x7f29d00d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:21.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.705+0000 7f29cffff640 1 --2- 172.21.15.55:0/1657160428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29d015e3c0 0x7f29d00d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.705+0000 7f29cffff640 1 -- 172.21.15.55:0/1657160428 >> v1:172.21.15.110:6789/0 conn(0x7f29d00d10c0 legacy=0x7f29d00b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:21.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.705+0000 7f29cffff640 1 -- 172.21.15.55:0/1657160428 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d00cdb60 con 0x7f29d01601f0 2023-08-25T05:35:21.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.709+0000 7f29cffff640 1 --2- 172.21.15.55:0/1657160428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29d01601f0 0x7f29d015d430 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f29c0006fd0 tx=0x7f29c001ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fd5629c6525ffa3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:21.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.709+0000 7f29cf7fe640 1 -- 172.21.15.55:0/1657160428 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c00a8a10 con 0x7f29d01601f0 2023-08-25T05:35:21.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.709+0000 7f29cf7fe640 1 -- 172.21.15.55:0/1657160428 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c00a8b70 con 0x7f29d01601f0 2023-08-25T05:35:21.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.709+0000 7f29cf7fe640 1 -- 172.21.15.55:0/1657160428 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c00b0440 con 0x7f29d01601f0 2023-08-25T05:35:21.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.709+0000 7f29d6634640 1 -- 172.21.15.55:0/1657160428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29d01601f0 msgr2=0x7f29d015d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:21.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.709+0000 7f29d6634640 1 --2- 172.21.15.55:0/1657160428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29d01601f0 0x7f29d015d430 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f29c0006fd0 tx=0x7f29c001ed10 comp rx=0 tx=0).stop 2023-08-25T05:35:21.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.709+0000 7f29d6634640 1 -- 172.21.15.55:0/1657160428 shutdown_connections 2023-08-25T05:35:21.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.709+0000 7f29d6634640 1 --2- 172.21.15.55:0/1657160428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29d015e3c0 0x7f29d00d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.709+0000 7f29d6634640 1 --2- 172.21.15.55:0/1657160428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29d01601f0 0x7f29d015d430 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.709+0000 7f29d6634640 1 -- 172.21.15.55:0/1657160428 >> 172.21.15.55:0/1657160428 conn(0x7f29d00d27d0 msgr2=0x7f29d00d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:21.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.709+0000 7f29d6634640 1 -- 172.21.15.55:0/1657160428 shutdown_connections 2023-08-25T05:35:21.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.709+0000 7f29d6634640 1 -- 172.21.15.55:0/1657160428 wait complete. 2023-08-25T05:35:21.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29d6634640 1 Processor -- start 2023-08-25T05:35:21.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29d6634640 1 -- start start 2023-08-25T05:35:21.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29d6634640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29d00d10c0 0x7f29d014fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:21.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29d6634640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29d015e3c0 0x7f29d00c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:21.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29d6634640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29d01601f0 0x7f29d00c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:21.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29d6634640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d01f39e0 con 0x7f29d01601f0 2023-08-25T05:35:21.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29d6634640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d01f2e10 con 0x7f29d00d10c0 2023-08-25T05:35:21.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29d6634640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d01f30b0 con 0x7f29d015e3c0 2023-08-25T05:35:21.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29d4bd1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29d01601f0 0x7f29d00c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:21.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29cffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29d00d10c0 0x7f29d014fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:21.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29d4bd1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29d01601f0 0x7f29d00c6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47320/0 (socket says 172.21.15.55:47320) 2023-08-25T05:35:21.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29d4bd1640 1 -- 172.21.15.55:0/1364563350 learned_addr learned my addr 172.21.15.55:0/1364563350 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:21.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29c7fff640 1 --2- 172.21.15.55:0/1364563350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29d015e3c0 0x7f29d00c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:21.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29cffff640 1 -- 172.21.15.55:0/1364563350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29d015e3c0 msgr2=0x7f29d00c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:21.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29cffff640 1 --2- 172.21.15.55:0/1364563350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29d015e3c0 0x7f29d00c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29cffff640 1 -- 172.21.15.55:0/1364563350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29d01601f0 msgr2=0x7f29d00c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:21.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29cffff640 1 --2- 172.21.15.55:0/1364563350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29d01601f0 0x7f29d00c6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29cffff640 1 -- 172.21.15.55:0/1364563350 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c0009480 con 0x7f29d00d10c0 2023-08-25T05:35:21.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29cffff640 1 --2- 172.21.15.55:0/1364563350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29d00d10c0 0x7f29d014fbc0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f29c00af000 tx=0x7f29c001bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:21.720 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:21.716+0000 7f907b342180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:35:21.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29cd7fa640 1 -- 172.21.15.55:0/1364563350 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c00bd070 con 0x7f29d00d10c0 2023-08-25T05:35:21.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29cd7fa640 1 -- 172.21.15.55:0/1364563350 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c00a9e30 con 0x7f29d00d10c0 2023-08-25T05:35:21.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29cd7fa640 1 -- 172.21.15.55:0/1364563350 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c0003860 con 0x7f29d00d10c0 2023-08-25T05:35:21.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29d6634640 1 -- 172.21.15.55:0/1364563350 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d01f3390 con 0x7f29d00d10c0 2023-08-25T05:35:21.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.713+0000 7f29d6634640 1 -- 172.21.15.55:0/1364563350 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d0150100 con 0x7f29d00d10c0 2023-08-25T05:35:21.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.717+0000 7f29d6634640 1 -- 172.21.15.55:0/1364563350 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d00b63e0 con 0x7f29d00d10c0 2023-08-25T05:35:21.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.717+0000 7f29cd7fa640 1 -- 172.21.15.55:0/1364563350 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 102) v1 ==== 85076+0+0 (secure 0 0 0) 0x7f29c00039c0 con 0x7f29d00d10c0 2023-08-25T05:35:21.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.717+0000 7f29cd7fa640 1 --2- 172.21.15.55:0/1364563350 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f29b00657a0 0x7f29b0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:21.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.717+0000 7f29cd7fa640 1 -- 172.21.15.55:0/1364563350 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6808+0+0 (secure 0 0 0) 0x7f29c0120340 con 0x7f29d00d10c0 2023-08-25T05:35:21.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.717+0000 7f29c7fff640 1 -- 172.21.15.55:0/1364563350 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f29b00657a0 msgr2=0x7f29b0067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2233108903 2023-08-25T05:35:21.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.717+0000 7f29c7fff640 1 --2- 172.21.15.55:0/1364563350 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f29b00657a0 0x7f29b0067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:35:21.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.721+0000 7f29cd7fa640 1 -- 172.21.15.55:0/1364563350 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f29c00edb20 con 0x7f29d00d10c0 2023-08-25T05:35:21.757 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:21.753+0000 7f65c38d5180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:35:21.804 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:21.800+0000 7f907b342180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:35:21.817 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:21.813+0000 7f65c38d5180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:35:21.860 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:21.856+0000 7f907b342180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:35:21.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.877+0000 7f29d6634640 1 -- 172.21.15.55:0/1364563350 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29d0073ec0 con 0x7f29d00d10c0 2023-08-25T05:35:21.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.877+0000 7f29cd7fa640 1 -- 172.21.15.55:0/1364563350 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v174) v1 ==== 104+0+11 (secure 0 0 0) 0x7f29c00f1140 con 0x7f29d00d10c0 2023-08-25T05:35:21.882 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T05:35:21.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.881+0000 7f29d6634640 1 -- 172.21.15.55:0/1364563350 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f29b00657a0 msgr2=0x7f29b0067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:35:21.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.881+0000 7f29d6634640 1 --2- 172.21.15.55:0/1364563350 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f29b00657a0 0x7f29b0067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.881+0000 7f29d6634640 1 -- 172.21.15.55:0/1364563350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29d00d10c0 msgr2=0x7f29d014fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.881+0000 7f29d6634640 1 --2- 172.21.15.55:0/1364563350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29d00d10c0 0x7f29d014fbc0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f29c00af000 tx=0x7f29c001bab0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.881+0000 7f29d6634640 1 -- 172.21.15.55:0/1364563350 shutdown_connections 2023-08-25T05:35:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.881+0000 7f29d6634640 1 --2- 172.21.15.55:0/1364563350 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f29b00657a0 0x7f29b0067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.881+0000 7f29d6634640 1 --2- 172.21.15.55:0/1364563350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29d01601f0 0x7f29d00c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.881+0000 7f29d6634640 1 --2- 172.21.15.55:0/1364563350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f29d015e3c0 0x7f29d00c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.881+0000 7f29d6634640 1 --2- 172.21.15.55:0/1364563350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29d00d10c0 0x7f29d014fbc0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:21.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.881+0000 7f29d6634640 1 -- 172.21.15.55:0/1364563350 >> 172.21.15.55:0/1364563350 conn(0x7f29d00d27d0 msgr2=0x7f29d006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:21.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.881+0000 7f29d6634640 1 -- 172.21.15.55:0/1364563350 shutdown_connections 2023-08-25T05:35:21.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:21.881+0000 7f29d6634640 1 -- 172.21.15.55:0/1364563350 wait complete. 2023-08-25T05:35:21.905 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T05:35:21.907 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:21.905+0000 7f65c38d5180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:35:21.968 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:21.965+0000 7f65c38d5180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:35:22.001 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:21.996+0000 7f907b342180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:35:22.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.049+0000 7f5a7346a640 1 Processor -- start 2023-08-25T05:35:22.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.049+0000 7f5a7346a640 1 -- start start 2023-08-25T05:35:22.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.053+0000 7f5a7346a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a6c1601f0 0x7f5a6c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:22.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.053+0000 7f5a7346a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a6c15e3c0 0x7f5a6c0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:22.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.053+0000 7f5a7346a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6c15f8b0 con 0x7f5a6c0d10c0 2023-08-25T05:35:22.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.053+0000 7f5a7346a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6c0cd5a0 con 0x7f5a6c1601f0 2023-08-25T05:35:22.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.053+0000 7f5a7346a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0cd880 con 0x7f5a6c15e3c0 2023-08-25T05:35:22.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.053+0000 7f5a71206640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a6c1601f0 0x7f5a6c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:22.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.053+0000 7f5a71206640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5a6c1601f0 0x7f5a6c15d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47330/0 (socket says 172.21.15.55:47330) 2023-08-25T05:35:22.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.053+0000 7f5a71206640 1 -- 172.21.15.55:0/1720465335 learned_addr learned my addr 172.21.15.55:0/1720465335 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:22.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.053+0000 7f5a70a05640 1 --2- 172.21.15.55:0/1720465335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a6c15e3c0 0x7f5a6c0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.053+0000 7f5a71206640 1 -- 172.21.15.55:0/1720465335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a6c15e3c0 msgr2=0x7f5a6c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.053+0000 7f5a71206640 1 --2- 172.21.15.55:0/1720465335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a6c15e3c0 0x7f5a6c0d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.053+0000 7f5a71206640 1 -- 172.21.15.55:0/1720465335 >> v1:172.21.15.110:6789/0 conn(0x7f5a6c0d10c0 legacy=0x7f5a6c0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:22.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.053+0000 7f5a71206640 1 -- 172.21.15.55:0/1720465335 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c0cdb60 con 0x7f5a6c1601f0 2023-08-25T05:35:22.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.053+0000 7f5a63fff640 1 -- 172.21.15.55:0/1720465335 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880410406 0 0) 0x7f5a6c15f8b0 con 0x7f5a6c0d10c0 2023-08-25T05:35:22.060 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:22.056+0000 7f907b342180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:35:22.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.057+0000 7f5a71206640 1 --2- 172.21.15.55:0/1720465335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a6c1601f0 0x7f5a6c15d430 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f5a68006fd0 tx=0x7f5a6801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa9f6450e29df51 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:22.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.057+0000 7f5a63fff640 1 -- 172.21.15.55:0/1720465335 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a680a8a10 con 0x7f5a6c1601f0 2023-08-25T05:35:22.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.057+0000 7f5a63fff640 1 -- 172.21.15.55:0/1720465335 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a680a8b70 con 0x7f5a6c1601f0 2023-08-25T05:35:22.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.057+0000 7f5a63fff640 1 -- 172.21.15.55:0/1720465335 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a680b0440 con 0x7f5a6c1601f0 2023-08-25T05:35:22.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.057+0000 7f5a7346a640 1 -- 172.21.15.55:0/1720465335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a6c1601f0 msgr2=0x7f5a6c15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:22.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.057+0000 7f5a7346a640 1 --2- 172.21.15.55:0/1720465335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a6c1601f0 0x7f5a6c15d430 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f5a68006fd0 tx=0x7f5a6801ed10 comp rx=0 tx=0).stop 2023-08-25T05:35:22.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.057+0000 7f5a7346a640 1 -- 172.21.15.55:0/1720465335 shutdown_connections 2023-08-25T05:35:22.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.057+0000 7f5a7346a640 1 --2- 172.21.15.55:0/1720465335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a6c15e3c0 0x7f5a6c0d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.057+0000 7f5a7346a640 1 --2- 172.21.15.55:0/1720465335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a6c1601f0 0x7f5a6c15d430 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.057+0000 7f5a7346a640 1 -- 172.21.15.55:0/1720465335 >> 172.21.15.55:0/1720465335 conn(0x7f5a6c0d27d0 msgr2=0x7f5a6c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:22.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.057+0000 7f5a7346a640 1 -- 172.21.15.55:0/1720465335 shutdown_connections 2023-08-25T05:35:22.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.057+0000 7f5a7346a640 1 -- 172.21.15.55:0/1720465335 wait complete. 2023-08-25T05:35:22.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a7346a640 1 Processor -- start 2023-08-25T05:35:22.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a7346a640 1 -- start start 2023-08-25T05:35:22.066 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a7346a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a6c0d10c0 0x7f5a6c15bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:22.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a7346a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a6c15e3c0 0x7f5a6c0ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:22.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a7346a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a6c1601f0 0x7f5a6c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:22.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a7346a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c09ed10 con 0x7f5a6c15e3c0 2023-08-25T05:35:22.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a7346a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0c8440 con 0x7f5a6c0d10c0 2023-08-25T05:35:22.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a7346a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c0c86e0 con 0x7f5a6c1601f0 2023-08-25T05:35:22.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a70a05640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a6c15e3c0 0x7f5a6c0ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:22.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a70a05640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a6c15e3c0 0x7f5a6c0ca1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47344/0 (socket says 172.21.15.55:47344) 2023-08-25T05:35:22.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a70a05640 1 -- 172.21.15.55:0/3149074824 learned_addr learned my addr 172.21.15.55:0/3149074824 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:22.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a71a07640 1 --2- 172.21.15.55:0/3149074824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a6c1601f0 0x7f5a6c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:22.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a71206640 1 --2- 172.21.15.55:0/3149074824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a6c0d10c0 0x7f5a6c15bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:22.068 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a70a05640 1 -- 172.21.15.55:0/3149074824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a6c1601f0 msgr2=0x7f5a6c0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:22.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a70a05640 1 --2- 172.21.15.55:0/3149074824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a6c1601f0 0x7f5a6c0ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a70a05640 1 -- 172.21.15.55:0/3149074824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a6c0d10c0 msgr2=0x7f5a6c15bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:22.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a70a05640 1 --2- 172.21.15.55:0/3149074824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a6c0d10c0 0x7f5a6c15bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a70a05640 1 -- 172.21.15.55:0/3149074824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a68009480 con 0x7f5a6c15e3c0 2023-08-25T05:35:22.069 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.061+0000 7f5a70a05640 1 --2- 172.21.15.55:0/3149074824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a6c15e3c0 0x7f5a6c0ca1f0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00e930 tx=0x7f5a5c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:22.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.065+0000 7f5a61ffb640 1 -- 172.21.15.55:0/3149074824 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c009690 con 0x7f5a6c15e3c0 2023-08-25T05:35:22.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.065+0000 7f5a61ffb640 1 -- 172.21.15.55:0/3149074824 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5c00ca00 con 0x7f5a6c15e3c0 2023-08-25T05:35:22.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.065+0000 7f5a61ffb640 1 -- 172.21.15.55:0/3149074824 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c00cd70 con 0x7f5a6c15e3c0 2023-08-25T05:35:22.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.065+0000 7f5a7346a640 1 -- 172.21.15.55:0/3149074824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6c0c89c0 con 0x7f5a6c15e3c0 2023-08-25T05:35:22.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.065+0000 7f5a7346a640 1 -- 172.21.15.55:0/3149074824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6c09e9a0 con 0x7f5a6c15e3c0 2023-08-25T05:35:22.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.065+0000 7f5a7346a640 1 -- 172.21.15.55:0/3149074824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6c0b5260 con 0x7f5a6c15e3c0 2023-08-25T05:35:22.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.065+0000 7f5a61ffb640 1 -- 172.21.15.55:0/3149074824 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 102) v1 ==== 85076+0+0 (secure 0 0 0) 0x7f5a5c013470 con 0x7f5a6c15e3c0 2023-08-25T05:35:22.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.065+0000 7f5a61ffb640 1 --2- 172.21.15.55:0/3149074824 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f5a500657a0 0x7f5a50067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:22.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.065+0000 7f5a61ffb640 1 -- 172.21.15.55:0/3149074824 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6808+0+0 (secure 0 0 0) 0x7f5a5c0834c0 con 0x7f5a6c15e3c0 2023-08-25T05:35:22.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.065+0000 7f5a71206640 1 -- 172.21.15.55:0/3149074824 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f5a500657a0 msgr2=0x7f5a50067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2233108903 2023-08-25T05:35:22.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.065+0000 7f5a71206640 1 --2- 172.21.15.55:0/3149074824 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f5a500657a0 0x7f5a50067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:35:22.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.069+0000 7f5a61ffb640 1 -- 172.21.15.55:0/3149074824 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5a5c050c50 con 0x7f5a6c15e3c0 2023-08-25T05:35:22.126 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:22.121+0000 7f65c38d5180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:35:22.187 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:22.185+0000 7f65c38d5180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:35:22.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.237+0000 7f5a7346a640 1 -- 172.21.15.55:0/3149074824 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a6c073ec0 con 0x7f5a6c15e3c0 2023-08-25T05:35:22.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.237+0000 7f5a61ffb640 1 -- 172.21.15.55:0/3149074824 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v174) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a5c054270 con 0x7f5a6c15e3c0 2023-08-25T05:35:22.243 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T05:35:22.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.241+0000 7f5a7346a640 1 -- 172.21.15.55:0/3149074824 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f5a500657a0 msgr2=0x7f5a50067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:35:22.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.241+0000 7f5a7346a640 1 --2- 172.21.15.55:0/3149074824 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f5a500657a0 0x7f5a50067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.241+0000 7f5a7346a640 1 -- 172.21.15.55:0/3149074824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a6c15e3c0 msgr2=0x7f5a6c0ca1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:22.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.241+0000 7f5a7346a640 1 --2- 172.21.15.55:0/3149074824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a6c15e3c0 0x7f5a6c0ca1f0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c00e930 tx=0x7f5a5c00edf0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.241+0000 7f5a7346a640 1 -- 172.21.15.55:0/3149074824 shutdown_connections 2023-08-25T05:35:22.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.241+0000 7f5a7346a640 1 --2- 172.21.15.55:0/3149074824 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f5a500657a0 0x7f5a50067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.241+0000 7f5a7346a640 1 --2- 172.21.15.55:0/3149074824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a6c1601f0 0x7f5a6c0ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.241+0000 7f5a7346a640 1 --2- 172.21.15.55:0/3149074824 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a6c15e3c0 0x7f5a6c0ca1f0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.241+0000 7f5a7346a640 1 --2- 172.21.15.55:0/3149074824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a6c0d10c0 0x7f5a6c15bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.241+0000 7f5a7346a640 1 -- 172.21.15.55:0/3149074824 >> 172.21.15.55:0/3149074824 conn(0x7f5a6c0d27d0 msgr2=0x7f5a6c06bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:22.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.241+0000 7f5a7346a640 1 -- 172.21.15.55:0/3149074824 shutdown_connections 2023-08-25T05:35:22.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.241+0000 7f5a7346a640 1 -- 172.21.15.55:0/3149074824 wait complete. 2023-08-25T05:35:22.264 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T05:35:22.299 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:35:22.300 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:35:22.300 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:35:22.307 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:22.304+0000 7f907b342180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:35:22.441 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:22.436+0000 7f907b342180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:35:22.444 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:35:22.444 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:35:22.444 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:35:22.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.441+0000 7f6351419640 1 Processor -- start 2023-08-25T05:35:22.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.441+0000 7f6351419640 1 -- start start 2023-08-25T05:35:22.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.441+0000 7f6351419640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f634c0d0da0 0x7f634c0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:22.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.441+0000 7f6351419640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f634c0cdde0 0x7f634c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:22.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.441+0000 7f6351419640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634c0b29b0 con 0x7f634c0cee60 2023-08-25T05:35:22.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.441+0000 7f6351419640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c0ce760 con 0x7f634c0d0da0 2023-08-25T05:35:22.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.441+0000 7f6351419640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0d16c0 con 0x7f634c0cdde0 2023-08-25T05:35:22.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.441+0000 7f6343fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f634c0cdde0 0x7f634c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:22.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.441+0000 7f634affd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f634c0d0da0 0x7f634c0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:22.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.441+0000 7f6343fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f634c0cdde0 0x7f634c0ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:49370/0 (socket says 172.21.15.55:49370) 2023-08-25T05:35:22.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.441+0000 7f6343fff640 1 -- 172.21.15.55:0/3926159187 learned_addr learned my addr 172.21.15.55:0/3926159187 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:22.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.441+0000 7f6343fff640 1 -- 172.21.15.55:0/3926159187 >> v2:172.21.15.110:3300/0 conn(0x7f634c0d0da0 msgr2=0x7f634c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:22.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.441+0000 7f6343fff640 1 --2- 172.21.15.55:0/3926159187 >> v2:172.21.15.110:3300/0 conn(0x7f634c0d0da0 0x7f634c0d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.445+0000 7f6343fff640 1 -- 172.21.15.55:0/3926159187 >> v1:172.21.15.110:6789/0 conn(0x7f634c0cee60 legacy=0x7f634c0cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:22.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.445+0000 7f6343fff640 1 -- 172.21.15.55:0/3926159187 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c0b1dc0 con 0x7f634c0cdde0 2023-08-25T05:35:22.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.445+0000 7f6343fff640 1 --2- 172.21.15.55:0/3926159187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f634c0cdde0 0x7f634c0ce220 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6334009870 tx=0x7f633401ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd1670b9e42f3709 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:22.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.445+0000 7f634a7fc640 1 -- 172.21.15.55:0/3926159187 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63340a8a30 con 0x7f634c0cdde0 2023-08-25T05:35:22.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.445+0000 7f634a7fc640 1 -- 172.21.15.55:0/3926159187 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63340a8b90 con 0x7f634c0cdde0 2023-08-25T05:35:22.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.445+0000 7f634a7fc640 1 -- 172.21.15.55:0/3926159187 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63340b0440 con 0x7f634c0cdde0 2023-08-25T05:35:22.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.445+0000 7f6351419640 1 -- 172.21.15.55:0/3926159187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f634c0cdde0 msgr2=0x7f634c0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:22.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.445+0000 7f6351419640 1 --2- 172.21.15.55:0/3926159187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f634c0cdde0 0x7f634c0ce220 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6334009870 tx=0x7f633401ed30 comp rx=0 tx=0).stop 2023-08-25T05:35:22.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.445+0000 7f6351419640 1 -- 172.21.15.55:0/3926159187 shutdown_connections 2023-08-25T05:35:22.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.445+0000 7f6351419640 1 --2- 172.21.15.55:0/3926159187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f634c0cdde0 0x7f634c0ce220 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.445+0000 7f6351419640 1 --2- 172.21.15.55:0/3926159187 >> v2:172.21.15.110:3300/0 conn(0x7f634c0d0da0 0x7f634c0d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.445+0000 7f6351419640 1 -- 172.21.15.55:0/3926159187 >> 172.21.15.55:0/3926159187 conn(0x7f634c09bae0 msgr2=0x7f634c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:22.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f6351419640 1 -- 172.21.15.55:0/3926159187 shutdown_connections 2023-08-25T05:35:22.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f6351419640 1 -- 172.21.15.55:0/3926159187 wait complete. 2023-08-25T05:35:22.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f6351419640 1 Processor -- start 2023-08-25T05:35:22.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f6351419640 1 -- start start 2023-08-25T05:35:22.453 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f65c38d5180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:35:22.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f6351419640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f634c0cdde0 0x7f634c1f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:22.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f6351419640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f634c0cee60 0x7f634c06bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:22.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f6351419640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f634c0d0da0 0x7f634c06c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:22.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f6351419640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c15fa40 con 0x7f634c0cdde0 2023-08-25T05:35:22.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f6351419640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c15fd20 con 0x7f634c0cee60 2023-08-25T05:35:22.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f6351419640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c0c6390 con 0x7f634c0d0da0 2023-08-25T05:35:22.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f634affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f634c0cdde0 0x7f634c1f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:22.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f634b7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f634c0d0da0 0x7f634c06c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:22.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f634affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f634c0cdde0 0x7f634c1f16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47352/0 (socket says 172.21.15.55:47352) 2023-08-25T05:35:22.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f634affd640 1 -- 172.21.15.55:0/3038390533 learned_addr learned my addr 172.21.15.55:0/3038390533 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:22.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f6343fff640 1 --2- 172.21.15.55:0/3038390533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f634c0cee60 0x7f634c06bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:22.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f634affd640 1 -- 172.21.15.55:0/3038390533 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f634c0d0da0 msgr2=0x7f634c06c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:22.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f634affd640 1 --2- 172.21.15.55:0/3038390533 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f634c0d0da0 0x7f634c06c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f634affd640 1 -- 172.21.15.55:0/3038390533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f634c0cee60 msgr2=0x7f634c06bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:22.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f634affd640 1 --2- 172.21.15.55:0/3038390533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f634c0cee60 0x7f634c06bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f634affd640 1 -- 172.21.15.55:0/3038390533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63340094d0 con 0x7f634c0cdde0 2023-08-25T05:35:22.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f634affd640 1 --2- 172.21.15.55:0/3038390533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f634c0cdde0 0x7f634c1f16d0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f633c00e870 tx=0x7f633c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:22.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.449+0000 7f63437fe640 1 -- 172.21.15.55:0/3038390533 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c0095d0 con 0x7f634c0cdde0 2023-08-25T05:35:22.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.453+0000 7f6351419640 1 -- 172.21.15.55:0/3038390533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634c0c6670 con 0x7f634c0cdde0 2023-08-25T05:35:22.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.453+0000 7f63437fe640 1 -- 172.21.15.55:0/3038390533 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c00c940 con 0x7f634c0cdde0 2023-08-25T05:35:22.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.453+0000 7f63437fe640 1 -- 172.21.15.55:0/3038390533 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c00ccb0 con 0x7f634c0cdde0 2023-08-25T05:35:22.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.453+0000 7f6351419640 1 -- 172.21.15.55:0/3038390533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c1f1c10 con 0x7f634c0cdde0 2023-08-25T05:35:22.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.453+0000 7f6351419640 1 -- 172.21.15.55:0/3038390533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634c1f1e60 con 0x7f634c0cdde0 2023-08-25T05:35:22.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.453+0000 7f63437fe640 1 -- 172.21.15.55:0/3038390533 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 102) v1 ==== 85076+0+0 (secure 0 0 0) 0x7f633c026480 con 0x7f634c0cdde0 2023-08-25T05:35:22.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.453+0000 7f63437fe640 1 --2- 172.21.15.55:0/3038390533 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f632c0657a0 0x7f632c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:22.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.453+0000 7f63437fe640 1 -- 172.21.15.55:0/3038390533 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6808+0+0 (secure 0 0 0) 0x7f633c083b80 con 0x7f634c0cdde0 2023-08-25T05:35:22.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.453+0000 7f6343fff640 1 -- 172.21.15.55:0/3038390533 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f632c0657a0 msgr2=0x7f632c067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2233108903 2023-08-25T05:35:22.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.453+0000 7f6343fff640 1 --2- 172.21.15.55:0/3038390533 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f632c0657a0 0x7f632c067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:35:22.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.457+0000 7f63437fe640 1 -- 172.21.15.55:0/3038390533 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f633c051420 con 0x7f634c0cdde0 2023-08-25T05:35:22.564 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:22.560+0000 7f907b342180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:35:22.598 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:22.593+0000 7f65c38d5180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:35:22.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.625+0000 7f6351419640 1 -- 172.21.15.55:0/3038390533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f634c04dbe0 con 0x7f634c0cdde0 2023-08-25T05:35:22.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.629+0000 7f63437fe640 1 -- 172.21.15.55:0/3038390533 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v174) v1 ==== 81+0+948 (secure 0 0 0) 0x7f633c021080 con 0x7f634c0cdde0 2023-08-25T05:35:22.631 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/186183046 2023-08-26T05:30:20.824468+0000 2023-08-25T05:35:22.632 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/555519094 2023-08-26T05:30:20.824468+0000 2023-08-25T05:35:22.632 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/4158794211 2023-08-26T05:30:20.824468+0000 2023-08-25T05:35:22.632 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6832/758142785 2023-08-26T05:30:20.824468+0000 2023-08-25T05:35:22.632 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6833/758142785 2023-08-26T05:30:20.824468+0000 2023-08-25T05:35:22.632 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/1448709432 2023-08-26T05:30:20.824468+0000 2023-08-25T05:35:22.632 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/2185378335 2023-08-26T05:30:20.824468+0000 2023-08-25T05:35:22.633 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/1252154583 2023-08-26T05:19:35.670048+0000 2023-08-25T05:35:22.633 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/2517199041 2023-08-26T05:30:20.824468+0000 2023-08-25T05:35:22.633 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/2871001293 2023-08-26T05:19:35.670048+0000 2023-08-25T05:35:22.633 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6833/221263034 2023-08-26T05:19:35.670048+0000 2023-08-25T05:35:22.633 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6832/221263034 2023-08-26T05:19:35.670048+0000 2023-08-25T05:35:22.633 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/678216564 2023-08-26T05:19:35.670048+0000 2023-08-25T05:35:22.633 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/4272437355 2023-08-26T05:19:35.670048+0000 2023-08-25T05:35:22.634 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/914246484 2023-08-26T05:19:35.670048+0000 2023-08-25T05:35:22.634 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/1054752082 2023-08-26T05:19:35.670048+0000 2023-08-25T05:35:22.635 INFO:teuthology.orchestra.run.smithi055.stderr:listed 16 entries 2023-08-25T05:35:22.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.629+0000 7f6351419640 1 -- 172.21.15.55:0/3038390533 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f632c0657a0 msgr2=0x7f632c067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:35:22.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.629+0000 7f6351419640 1 --2- 172.21.15.55:0/3038390533 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f632c0657a0 0x7f632c067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.629+0000 7f6351419640 1 -- 172.21.15.55:0/3038390533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f634c0cdde0 msgr2=0x7f634c1f16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:22.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.629+0000 7f6351419640 1 --2- 172.21.15.55:0/3038390533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f634c0cdde0 0x7f634c1f16d0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f633c00e870 tx=0x7f633c00ed30 comp rx=0 tx=0).stop 2023-08-25T05:35:22.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.629+0000 7f6351419640 1 -- 172.21.15.55:0/3038390533 shutdown_connections 2023-08-25T05:35:22.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.629+0000 7f6351419640 1 --2- 172.21.15.55:0/3038390533 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f632c0657a0 0x7f632c067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.629+0000 7f6351419640 1 --2- 172.21.15.55:0/3038390533 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f634c0d0da0 0x7f634c06c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.629+0000 7f6351419640 1 --2- 172.21.15.55:0/3038390533 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f634c0cee60 0x7f634c06bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.629+0000 7f6351419640 1 --2- 172.21.15.55:0/3038390533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f634c0cdde0 0x7f634c1f16d0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.629+0000 7f6351419640 1 -- 172.21.15.55:0/3038390533 >> 172.21.15.55:0/3038390533 conn(0x7f634c09bae0 msgr2=0x7f634c0cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:22.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.629+0000 7f6351419640 1 -- 172.21.15.55:0/3038390533 shutdown_connections 2023-08-25T05:35:22.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.629+0000 7f6351419640 1 -- 172.21.15.55:0/3038390533 wait complete. 2023-08-25T05:35:22.637 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:22.628+0000 7f907b342180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:35:22.653 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-25T05:35:22.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:22.654 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-25T05:35:22.724 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T05:35:22.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:22.725 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-25T05:35:22.733 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:22.729+0000 7f65c38d5180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:35:22.735 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:35:22.735 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:35:22.745 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:35:22.745 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:35:22.745 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:35:22.769 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:22.764+0000 7f907b342180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:35:22.787 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T05:35:22.787 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:35:22.788 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:35:22.797 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:35:22.797 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:35:22.807 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:22.805+0000 7f65c38d5180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:35:22.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.945+0000 7f4c23e34640 1 Processor -- start 2023-08-25T05:35:22.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.945+0000 7f4c23e34640 1 -- start start 2023-08-25T05:35:22.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.949+0000 7f4c23e34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c1c0ce220 0x7f4c1c0b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:22.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.949+0000 7f4c23e34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c0b29b0 con 0x7f4c1c0cdde0 2023-08-25T05:35:22.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.949+0000 7f4c23e34640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c0ce690 con 0x7f4c1c0d0da0 2023-08-25T05:35:22.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.949+0000 7f4c23e34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c0b1dc0 con 0x7f4c1c0ce220 2023-08-25T05:35:22.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.949+0000 7f4c223d1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4c1c0ce220 0x7f4c1c0b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:22.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.949+0000 7f4c21bd0640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f4c1c0d0da0 0x7f4c1c0d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:47156/0 (socket says 172.21.15.55:47156) 2023-08-25T05:35:22.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.949+0000 7f4c21bd0640 1 -- 172.21.15.55:0/4027896390 learned_addr learned my addr 172.21.15.55:0/4027896390 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:22.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.949+0000 7f4c20bce640 1 -- 172.21.15.55:0/4027896390 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728300420 0 0) 0x7f4c1c0ce690 con 0x7f4c1c0d0da0 2023-08-25T05:35:22.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.949+0000 7f4c20bce640 1 -- 172.21.15.55:0/4027896390 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c08003530 con 0x7f4c1c0d0da0 2023-08-25T05:35:22.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.949+0000 7f4c223d1640 1 -- 172.21.15.55:0/4027896390 >> v1:172.21.15.110:6789/0 conn(0x7f4c1c0d0da0 legacy=0x7f4c1c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:22.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.949+0000 7f4c223d1640 1 -- 172.21.15.55:0/4027896390 >> v1:172.21.15.55:6789/0 conn(0x7f4c1c0cdde0 legacy=0x7f4c1c0b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:22.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.949+0000 7f4c223d1640 1 -- 172.21.15.55:0/4027896390 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0b2080 con 0x7f4c1c0ce220 2023-08-25T05:35:22.955 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:22.949+0000 7f65c38d5180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:35:22.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.953+0000 7f4c223d1640 1 --2- 172.21.15.55:0/4027896390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c1c0ce220 0x7f4c1c0b3550 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009d90 tx=0x7f4c1401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16f7c30d6cac2f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:22.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.953+0000 7f4c20bce640 1 -- 172.21.15.55:0/4027896390 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c140af600 con 0x7f4c1c0ce220 2023-08-25T05:35:22.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.953+0000 7f4c20bce640 1 -- 172.21.15.55:0/4027896390 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c140ab050 con 0x7f4c1c0ce220 2023-08-25T05:35:22.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.953+0000 7f4c20bce640 1 -- 172.21.15.55:0/4027896390 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c140af980 con 0x7f4c1c0ce220 2023-08-25T05:35:22.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.953+0000 7f4c23e34640 1 -- 172.21.15.55:0/4027896390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c1c0ce220 msgr2=0x7f4c1c0b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:22.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.953+0000 7f4c23e34640 1 --2- 172.21.15.55:0/4027896390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c1c0ce220 0x7f4c1c0b3550 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009d90 tx=0x7f4c1401f130 comp rx=0 tx=0).stop 2023-08-25T05:35:22.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.953+0000 7f4c23e34640 1 -- 172.21.15.55:0/4027896390 shutdown_connections 2023-08-25T05:35:22.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.953+0000 7f4c23e34640 1 --2- 172.21.15.55:0/4027896390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c1c0ce220 0x7f4c1c0b3550 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.953+0000 7f4c23e34640 1 -- 172.21.15.55:0/4027896390 >> 172.21.15.55:0/4027896390 conn(0x7f4c1c09bae0 msgr2=0x7f4c1c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:22.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.953+0000 7f4c23e34640 1 -- 172.21.15.55:0/4027896390 shutdown_connections 2023-08-25T05:35:22.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.953+0000 7f4c23e34640 1 -- 172.21.15.55:0/4027896390 wait complete. 2023-08-25T05:35:22.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c23e34640 1 Processor -- start 2023-08-25T05:35:22.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c23e34640 1 -- start start 2023-08-25T05:35:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c23e34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c1c0cdde0 0x7f4c1c15dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c23e34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c1c0ce220 0x7f4c1c0cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c23e34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c1c0d0da0 0x7f4c1c0c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:22.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c23e34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c15f1b0 con 0x7f4c1c0d0da0 2023-08-25T05:35:22.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c23e34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c15e5a0 con 0x7f4c1c0ce220 2023-08-25T05:35:22.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c23e34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c15e880 con 0x7f4c1c0cdde0 2023-08-25T05:35:22.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c223d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c1c0d0da0 0x7f4c1c0c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:22.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c223d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c1c0d0da0 0x7f4c1c0c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47370/0 (socket says 172.21.15.55:47370) 2023-08-25T05:35:22.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c213cf640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c1c0ce220 0x7f4c1c0cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:22.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c223d1640 1 -- 172.21.15.55:0/3150138072 learned_addr learned my addr 172.21.15.55:0/3150138072 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:22.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c21bd0640 1 --2- 172.21.15.55:0/3150138072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c1c0cdde0 0x7f4c1c15dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:22.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c213cf640 1 -- 172.21.15.55:0/3150138072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c1c0cdde0 msgr2=0x7f4c1c15dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:22.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c213cf640 1 --2- 172.21.15.55:0/3150138072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c1c0cdde0 0x7f4c1c15dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c213cf640 1 -- 172.21.15.55:0/3150138072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c1c0d0da0 msgr2=0x7f4c1c0c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:22.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c213cf640 1 --2- 172.21.15.55:0/3150138072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c1c0d0da0 0x7f4c1c0c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:22.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c213cf640 1 -- 172.21.15.55:0/3150138072 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c14009a70 con 0x7f4c1c0ce220 2023-08-25T05:35:22.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c223d1640 1 --2- 172.21.15.55:0/3150138072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c1c0d0da0 0x7f4c1c0c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:35:22.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c213cf640 1 --2- 172.21.15.55:0/3150138072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c1c0ce220 0x7f4c1c0cb4a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c000f70 tx=0x7f4c0c00c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:22.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c127fc640 1 -- 172.21.15.55:0/3150138072 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0052d0 con 0x7f4c1c0ce220 2023-08-25T05:35:22.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c127fc640 1 -- 172.21.15.55:0/3150138072 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c005430 con 0x7f4c1c0ce220 2023-08-25T05:35:22.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c127fc640 1 -- 172.21.15.55:0/3150138072 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c003840 con 0x7f4c1c0ce220 2023-08-25T05:35:22.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c23e34640 1 -- 172.21.15.55:0/3150138072 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1c15eb60 con 0x7f4c1c0ce220 2023-08-25T05:35:22.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c23e34640 1 -- 172.21.15.55:0/3150138072 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1c15f640 con 0x7f4c1c0ce220 2023-08-25T05:35:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.957+0000 7f4c23e34640 1 -- 172.21.15.55:0/3150138072 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c04dbe0 con 0x7f4c1c0ce220 2023-08-25T05:35:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.961+0000 7f4c127fc640 1 -- 172.21.15.55:0/3150138072 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 102) v1 ==== 85076+0+0 (secure 0 0 0) 0x7f4c0c0039a0 con 0x7f4c1c0ce220 2023-08-25T05:35:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.961+0000 7f4c127fc640 1 --2- 172.21.15.55:0/3150138072 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f4c000657d0 0x7f4c00067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.961+0000 7f4c127fc640 1 -- 172.21.15.55:0/3150138072 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6808+0+0 (secure 0 0 0) 0x7f4c0c0827c0 con 0x7f4c1c0ce220 2023-08-25T05:35:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.961+0000 7f4c21bd0640 1 -- 172.21.15.55:0/3150138072 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f4c000657d0 msgr2=0x7f4c00067c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2233108903 2023-08-25T05:35:22.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.961+0000 7f4c21bd0640 1 --2- 172.21.15.55:0/3150138072 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f4c000657d0 0x7f4c00067c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:35:22.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:22.969+0000 7f4c127fc640 1 -- 172.21.15.55:0/3150138072 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4c0c04fe90 con 0x7f4c1c0ce220 2023-08-25T05:35:23.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.157+0000 7f4c23e34640 1 -- 172.21.15.55:0/3150138072 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c1c0d0b80 con 0x7f4c1c0ce220 2023-08-25T05:35:23.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.157+0000 7f4c127fc640 1 -- 172.21.15.55:0/3150138072 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f4c0c0534b0 con 0x7f4c1c0ce220 2023-08-25T05:35:23.163 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:23.163 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/934106390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":934106390},{"type":"v1","addr":"172.21.15.110:6836","nonce":934106390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":78},{"gid":8303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/759320040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":759320040},{"type":"v1","addr":"172.21.15.110:6837","nonce":759320040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":78},{"gid":10140,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2128942930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2128942930},{"type":"v1","addr":"172.21.15.55:6833","nonce":2128942930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:19:18.477714+0000","modified":"2023-08-25T05:19:22.105735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":10149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10149":{"gid":10149,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1451359895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1451359895},{"type":"v1","addr":"172.21.15.55:6835","nonce":1451359895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-25T05:35:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 83 2023-08-25T05:35:23.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.161+0000 7f4c23e34640 1 -- 172.21.15.55:0/3150138072 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f4c000657d0 msgr2=0x7f4c00067c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:35:23.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.161+0000 7f4c23e34640 1 --2- 172.21.15.55:0/3150138072 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f4c000657d0 0x7f4c00067c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.161+0000 7f4c23e34640 1 -- 172.21.15.55:0/3150138072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c1c0ce220 msgr2=0x7f4c1c0cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:23.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.161+0000 7f4c23e34640 1 --2- 172.21.15.55:0/3150138072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c1c0ce220 0x7f4c1c0cb4a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c000f70 tx=0x7f4c0c00c820 comp rx=0 tx=0).stop 2023-08-25T05:35:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.161+0000 7f4c23e34640 1 -- 172.21.15.55:0/3150138072 shutdown_connections 2023-08-25T05:35:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.161+0000 7f4c23e34640 1 --2- 172.21.15.55:0/3150138072 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7f4c000657d0 0x7f4c00067c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.161+0000 7f4c23e34640 1 --2- 172.21.15.55:0/3150138072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4c1c0d0da0 0x7f4c1c0c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.161+0000 7f4c23e34640 1 --2- 172.21.15.55:0/3150138072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c1c0ce220 0x7f4c1c0cb4a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.161+0000 7f4c23e34640 1 --2- 172.21.15.55:0/3150138072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c1c0cdde0 0x7f4c1c15dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.161+0000 7f4c23e34640 1 -- 172.21.15.55:0/3150138072 >> 172.21.15.55:0/3150138072 conn(0x7f4c1c09bae0 msgr2=0x7f4c1c15c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.161+0000 7f4c23e34640 1 -- 172.21.15.55:0/3150138072 shutdown_connections 2023-08-25T05:35:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.161+0000 7f4c23e34640 1 -- 172.21.15.55:0/3150138072 wait complete. 2023-08-25T05:35:23.184 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:35:23.362 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:23.356+0000 7f907b342180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:35:23.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.397+0000 7fd8e4ef7640 1 Processor -- start 2023-08-25T05:35:23.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.397+0000 7fd8e4ef7640 1 -- start start 2023-08-25T05:35:23.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.401+0000 7fd8e4ef7640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8e00b12c0 0x7fd8e006c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:23.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.401+0000 7fd8e4ef7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e00afe20 con 0x7fd8e015ca50 2023-08-25T05:35:23.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.401+0000 7fd8e4ef7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e00af210 con 0x7fd8e00d1120 2023-08-25T05:35:23.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.401+0000 7fd8e4ef7640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e00af4f0 con 0x7fd8e00b12c0 2023-08-25T05:35:23.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.401+0000 7fd8dffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8e00b12c0 0x7fd8e006c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:23.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.401+0000 7fd8dffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8e00b12c0 0x7fd8e006c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47380/0 (socket says 172.21.15.55:47380) 2023-08-25T05:35:23.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.401+0000 7fd8dffff640 1 -- 172.21.15.55:0/159247047 learned_addr learned my addr 172.21.15.55:0/159247047 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:23.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.401+0000 7fd8dffff640 1 -- 172.21.15.55:0/159247047 >> v1:172.21.15.110:6789/0 conn(0x7fd8e00d1120 legacy=0x7fd8e006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:23.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.401+0000 7fd8dffff640 1 -- 172.21.15.55:0/159247047 >> v1:172.21.15.55:6789/0 conn(0x7fd8e015ca50 legacy=0x7fd8e00d0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:23.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.401+0000 7fd8dffff640 1 -- 172.21.15.55:0/159247047 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e00af7d0 con 0x7fd8e00b12c0 2023-08-25T05:35:23.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.401+0000 7fd8dffff640 1 --2- 172.21.15.55:0/159247047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8e00b12c0 0x7fd8e006c320 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009e50 tx=0x7fd8d801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28834ef0675a8fe0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:23.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.405+0000 7fd8de7fc640 1 -- 172.21.15.55:0/159247047 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d80a58d0 con 0x7fd8e00b12c0 2023-08-25T05:35:23.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.405+0000 7fd8de7fc640 1 -- 172.21.15.55:0/159247047 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d80a5a30 con 0x7fd8e00b12c0 2023-08-25T05:35:23.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.405+0000 7fd8de7fc640 1 -- 172.21.15.55:0/159247047 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d80a5dc0 con 0x7fd8e00b12c0 2023-08-25T05:35:23.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.405+0000 7fd8e4ef7640 1 -- 172.21.15.55:0/159247047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8e00b12c0 msgr2=0x7fd8e006c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:23.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.405+0000 7fd8e4ef7640 1 --2- 172.21.15.55:0/159247047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8e00b12c0 0x7fd8e006c320 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009e50 tx=0x7fd8d801c9e0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.405+0000 7fd8e4ef7640 1 -- 172.21.15.55:0/159247047 shutdown_connections 2023-08-25T05:35:23.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.405+0000 7fd8e4ef7640 1 --2- 172.21.15.55:0/159247047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8e00b12c0 0x7fd8e006c320 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.405+0000 7fd8e4ef7640 1 -- 172.21.15.55:0/159247047 >> 172.21.15.55:0/159247047 conn(0x7fd8e0065f40 msgr2=0x7fd8e009b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:23.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.405+0000 7fd8e4ef7640 1 -- 172.21.15.55:0/159247047 shutdown_connections 2023-08-25T05:35:23.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.405+0000 7fd8e4ef7640 1 -- 172.21.15.55:0/159247047 wait complete. 2023-08-25T05:35:23.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.405+0000 7fd8e4ef7640 1 Processor -- start 2023-08-25T05:35:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.405+0000 7fd8e4ef7640 1 -- start start 2023-08-25T05:35:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.405+0000 7fd8e4ef7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8e00b12c0 0x7fd8e00b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.405+0000 7fd8e4ef7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e00d1120 0x7fd8e014d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.405+0000 7fd8e4ef7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8e015ca50 0x7fd8e006b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.405+0000 7fd8e4ef7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e00c9f70 con 0x7fd8e015ca50 2023-08-25T05:35:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.405+0000 7fd8e4ef7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e00c9680 con 0x7fd8e00d1120 2023-08-25T05:35:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.405+0000 7fd8e4ef7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e0157440 con 0x7fd8e00b12c0 2023-08-25T05:35:23.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.409+0000 7fd8dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8e015ca50 0x7fd8e006b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:23.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.409+0000 7fd8dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8e015ca50 0x7fd8e006b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47396/0 (socket says 172.21.15.55:47396) 2023-08-25T05:35:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.409+0000 7fd8dffff640 1 -- 172.21.15.55:0/3700996227 learned_addr learned my addr 172.21.15.55:0/3700996227 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.409+0000 7fd8deffd640 1 --2- 172.21.15.55:0/3700996227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e00d1120 0x7fd8e014d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.409+0000 7fd8df7fe640 1 --2- 172.21.15.55:0/3700996227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8e00b12c0 0x7fd8e00b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.409+0000 7fd8dffff640 1 -- 172.21.15.55:0/3700996227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8e00b12c0 msgr2=0x7fd8e00b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.409+0000 7fd8dffff640 1 --2- 172.21.15.55:0/3700996227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8e00b12c0 0x7fd8e00b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.409+0000 7fd8dffff640 1 -- 172.21.15.55:0/3700996227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e00d1120 msgr2=0x7fd8e014d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.409+0000 7fd8dffff640 1 --2- 172.21.15.55:0/3700996227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e00d1120 0x7fd8e014d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.409+0000 7fd8dffff640 1 -- 172.21.15.55:0/3700996227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d8009b30 con 0x7fd8e015ca50 2023-08-25T05:35:23.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.409+0000 7fd8dffff640 1 --2- 172.21.15.55:0/3700996227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8e015ca50 0x7fd8e006b7c0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fd8d80195f0 tx=0x7fd8d8019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:23.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.409+0000 7fd8c7fff640 1 -- 172.21.15.55:0/3700996227 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d80b8880 con 0x7fd8e015ca50 2023-08-25T05:35:23.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.409+0000 7fd8c7fff640 1 -- 172.21.15.55:0/3700996227 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d80b8a00 con 0x7fd8e015ca50 2023-08-25T05:35:23.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.409+0000 7fd8c7fff640 1 -- 172.21.15.55:0/3700996227 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d80b8db0 con 0x7fd8e015ca50 2023-08-25T05:35:23.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.409+0000 7fd8e4ef7640 1 -- 172.21.15.55:0/3700996227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e00c9920 con 0x7fd8e015ca50 2023-08-25T05:35:23.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.409+0000 7fd8e4ef7640 1 -- 172.21.15.55:0/3700996227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e014dbf0 con 0x7fd8e015ca50 2023-08-25T05:35:23.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.409+0000 7fd8e4ef7640 1 -- 172.21.15.55:0/3700996227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e00ca0e0 con 0x7fd8e015ca50 2023-08-25T05:35:23.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.413+0000 7fd8c7fff640 1 -- 172.21.15.55:0/3700996227 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 102) v1 ==== 85076+0+0 (secure 0 0 0) 0x7fd8d8007470 con 0x7fd8e015ca50 2023-08-25T05:35:23.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.413+0000 7fd8c7fff640 1 --2- 172.21.15.55:0/3700996227 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fd8cc0657a0 0x7fd8cc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:23.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.413+0000 7fd8c7fff640 1 -- 172.21.15.55:0/3700996227 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6864+0+0 (secure 0 0 0) 0x7fd8d811f500 con 0x7fd8e015ca50 2023-08-25T05:35:23.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.413+0000 7fd8df7fe640 1 -- 172.21.15.55:0/3700996227 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fd8cc0657a0 msgr2=0x7fd8cc067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2233108903 2023-08-25T05:35:23.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.413+0000 7fd8df7fe640 1 --2- 172.21.15.55:0/3700996227 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fd8cc0657a0 0x7fd8cc067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:35:23.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.417+0000 7fd8c7fff640 1 -- 172.21.15.55:0/3700996227 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd8d80ecd90 con 0x7fd8e015ca50 2023-08-25T05:35:23.452 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:23.448+0000 7f907b342180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:35:23.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.573+0000 7fd8e4ef7640 1 -- 172.21.15.55:0/3700996227 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8e0073e50 con 0x7fd8e015ca50 2023-08-25T05:35:23.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.573+0000 7fd8c7fff640 1 -- 172.21.15.55:0/3700996227 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+19535 (secure 0 0 0) 0x7fd8d80f03b0 con 0x7fd8e015ca50 2023-08-25T05:35:23.579 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:23.579 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":175,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:35:23.240989+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:19:16.250564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-25T05:19:17.474382+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":175,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.5","mappings":[{"from":3,"to":0}]},{"pgid":"22.34","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/186183046":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/555519094":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/4158794211":"2023-08-26T05:30:20.824468+0000","172.21.15.110:6832/758142785":"2023-08-26T05:30:20.824468+0000","172.21.15.110:6833/758142785":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/1448709432":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/2185378335":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/1252154583":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/2517199041":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/2871001293":"2023-08-26T05:19:35.670048+0000","172.21.15.110:6833/221263034":"2023-08-26T05:19:35.670048+0000","172.21.15.110:6832/221263034":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/678216564":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/4272437355":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/914246484":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/1054752082":"2023-08-26T05:19:35.670048+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:35:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.577+0000 7fd8e4ef7640 1 -- 172.21.15.55:0/3700996227 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fd8cc0657a0 msgr2=0x7fd8cc067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:35:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.577+0000 7fd8e4ef7640 1 --2- 172.21.15.55:0/3700996227 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fd8cc0657a0 0x7fd8cc067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.577+0000 7fd8e4ef7640 1 -- 172.21.15.55:0/3700996227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8e015ca50 msgr2=0x7fd8e006b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.577+0000 7fd8e4ef7640 1 --2- 172.21.15.55:0/3700996227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8e015ca50 0x7fd8e006b7c0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fd8d80195f0 tx=0x7fd8d8019780 comp rx=0 tx=0).stop 2023-08-25T05:35:23.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.577+0000 7fd8e4ef7640 1 -- 172.21.15.55:0/3700996227 shutdown_connections 2023-08-25T05:35:23.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.577+0000 7fd8e4ef7640 1 --2- 172.21.15.55:0/3700996227 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fd8cc0657a0 0x7fd8cc067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.577+0000 7fd8e4ef7640 1 --2- 172.21.15.55:0/3700996227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8e015ca50 0x7fd8e006b7c0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.577+0000 7fd8e4ef7640 1 --2- 172.21.15.55:0/3700996227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd8e00d1120 0x7fd8e014d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.577+0000 7fd8e4ef7640 1 --2- 172.21.15.55:0/3700996227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8e00b12c0 0x7fd8e00b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.577+0000 7fd8e4ef7640 1 -- 172.21.15.55:0/3700996227 >> 172.21.15.55:0/3700996227 conn(0x7fd8e0065f40 msgr2=0x7fd8e01577d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:23.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.577+0000 7fd8e4ef7640 1 -- 172.21.15.55:0/3700996227 shutdown_connections 2023-08-25T05:35:23.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.577+0000 7fd8e4ef7640 1 -- 172.21.15.55:0/3700996227 wait complete. 2023-08-25T05:35:23.600 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:23.596+0000 7f907b342180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:35:23.602 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T05:19:16.250564+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '169', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T05:19:17.474382+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '175', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 33, 'snap_epoch': 175, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T05:35:23.602 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T05:35:23.624 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:23.621+0000 7f65c38d5180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:35:23.683 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:23.676+0000 7f907b342180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:35:23.714 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:23.709+0000 7f65c38d5180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:35:23.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.745+0000 7fa436d11640 1 Processor -- start 2023-08-25T05:35:23.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.745+0000 7fa436d11640 1 -- start start 2023-08-25T05:35:23.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.745+0000 7fa436d11640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4301601f0 0x7fa43015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:23.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa436d11640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa4300d1290 0x7fa43015e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:23.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa436d11640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4300cd5a0 con 0x7fa43015e3c0 2023-08-25T05:35:23.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa436d11640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4300cd880 con 0x7fa4300d1290 2023-08-25T05:35:23.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa436d11640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300cdb60 con 0x7fa4301601f0 2023-08-25T05:35:23.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa427fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa43015e3c0 0x7fa4300d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53618/0 (socket says 172.21.15.55:53618) 2023-08-25T05:35:23.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa427fff640 1 -- 172.21.15.55:0/4182619926 learned_addr learned my addr 172.21.15.55:0/4182619926 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:23.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa434aad640 1 --2- 172.21.15.55:0/4182619926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4301601f0 0x7fa43015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:23.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa4277fe640 1 -- 172.21.15.55:0/4182619926 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107001165 0 0) 0x7fa4300cd5a0 con 0x7fa43015e3c0 2023-08-25T05:35:23.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa4277fe640 1 -- 172.21.15.55:0/4182619926 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa418003530 con 0x7fa43015e3c0 2023-08-25T05:35:23.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa4277fe640 1 -- 172.21.15.55:0/4182619926 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3696680993 0 0) 0x7fa418003530 con 0x7fa43015e3c0 2023-08-25T05:35:23.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa4277fe640 1 -- 172.21.15.55:0/4182619926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4301601f0 msgr2=0x7fa43015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:23.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa4277fe640 1 --2- 172.21.15.55:0/4182619926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4301601f0 0x7fa43015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa4277fe640 1 -- 172.21.15.55:0/4182619926 >> v2:172.21.15.110:3300/0 conn(0x7fa4300d1290 msgr2=0x7fa43015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:23.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa4277fe640 1 --2- 172.21.15.55:0/4182619926 >> v2:172.21.15.110:3300/0 conn(0x7fa4300d1290 0x7fa43015e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa4277fe640 1 -- 172.21.15.55:0/4182619926 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4300cde40 con 0x7fa43015e3c0 2023-08-25T05:35:23.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa4277fe640 1 -- 172.21.15.55:0/4182619926 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fa420001680 con 0x7fa43015e3c0 2023-08-25T05:35:23.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa4277fe640 1 -- 172.21.15.55:0/4182619926 >> v1:172.21.15.55:6789/0 conn(0x7fa43015e3c0 legacy=0x7fa4300d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:23.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa4277fe640 1 --2- 172.21.15.55:0/4182619926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa418003980 0x7fa418003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:23.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa4277fe640 1 --2- 172.21.15.55:0/4182619926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4301601f0 0x7fa4180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:23.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa4277fe640 1 --2- 172.21.15.55:0/4182619926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa418004d10 0x7fa418005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:23.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa4277fe640 1 -- 172.21.15.55:0/4182619926 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300cd880 con 0x7fa418003980 2023-08-25T05:35:23.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa4277fe640 1 -- 172.21.15.55:0/4182619926 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300cdb60 con 0x7fa418004d10 2023-08-25T05:35:23.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa4277fe640 1 -- 172.21.15.55:0/4182619926 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41800bbb0 con 0x7fa4301601f0 2023-08-25T05:35:23.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa434aad640 1 --2- 172.21.15.55:0/4182619926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa418003980 0x7fa418003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:23.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa434aad640 1 -- 172.21.15.55:0/4182619926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4301601f0 msgr2=0x7fa4180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:23.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa434aad640 1 --2- 172.21.15.55:0/4182619926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4301601f0 0x7fa4180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa434aad640 1 -- 172.21.15.55:0/4182619926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa418004d10 msgr2=0x7fa418005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:23.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa434aad640 1 --2- 172.21.15.55:0/4182619926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa418004d10 0x7fa418005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.749+0000 7fa434aad640 1 -- 172.21.15.55:0/4182619926 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa418003530 con 0x7fa418003980 2023-08-25T05:35:23.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.753+0000 7fa434aad640 1 --2- 172.21.15.55:0/4182619926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa418003980 0x7fa418003da0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00ba30 tx=0x7fa42c01c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24bddcafc6d41b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:23.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.753+0000 7fa4277fe640 1 -- 172.21.15.55:0/4182619926 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c0ab410 con 0x7fa418003980 2023-08-25T05:35:23.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.753+0000 7fa4277fe640 1 -- 172.21.15.55:0/4182619926 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c0ab570 con 0x7fa418003980 2023-08-25T05:35:23.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.753+0000 7fa4277fe640 1 -- 172.21.15.55:0/4182619926 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c0ab920 con 0x7fa418003980 2023-08-25T05:35:23.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.753+0000 7fa436d11640 1 -- 172.21.15.55:0/4182619926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa418003980 msgr2=0x7fa418003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:23.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.753+0000 7fa436d11640 1 --2- 172.21.15.55:0/4182619926 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa418003980 0x7fa418003da0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00ba30 tx=0x7fa42c01c600 comp rx=0 tx=0).stop 2023-08-25T05:35:23.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.753+0000 7fa4352ae640 1 -- 172.21.15.55:0/4182619926 reap_dead start 2023-08-25T05:35:23.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.753+0000 7fa436d11640 1 -- 172.21.15.55:0/4182619926 shutdown_connections 2023-08-25T05:35:23.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.753+0000 7fa436d11640 1 -- 172.21.15.55:0/4182619926 >> 172.21.15.55:0/4182619926 conn(0x7fa4300d27d0 msgr2=0x7fa4300d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:23.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.753+0000 7fa436d11640 1 -- 172.21.15.55:0/4182619926 shutdown_connections 2023-08-25T05:35:23.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.753+0000 7fa436d11640 1 -- 172.21.15.55:0/4182619926 wait complete. 2023-08-25T05:35:23.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa436d11640 1 Processor -- start 2023-08-25T05:35:23.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa436d11640 1 -- start start 2023-08-25T05:35:23.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa436d11640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa418003980 0x7fa43009fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:23.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa436d11640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4300cbc40 0x7fa430152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:23.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa436d11640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4300cc0a0 0x7fa430152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:23.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa436d11640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300c6380 con 0x7fa418003980 2023-08-25T05:35:23.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa436d11640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300c6660 con 0x7fa4300cc0a0 2023-08-25T05:35:23.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa436d11640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4300c6940 con 0x7fa4300cbc40 2023-08-25T05:35:23.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa434aad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa418003980 0x7fa43009fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:23.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa434aad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa418003980 0x7fa43009fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47418/0 (socket says 172.21.15.55:47418) 2023-08-25T05:35:23.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa434aad640 1 -- 172.21.15.55:0/3827191132 learned_addr learned my addr 172.21.15.55:0/3827191132 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:23.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa427fff640 1 --2- 172.21.15.55:0/3827191132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4300cbc40 0x7fa430152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:23.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa4352ae640 1 --2- 172.21.15.55:0/3827191132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4300cc0a0 0x7fa430152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:23.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa434aad640 1 -- 172.21.15.55:0/3827191132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4300cbc40 msgr2=0x7fa430152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:23.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa434aad640 1 --2- 172.21.15.55:0/3827191132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4300cbc40 0x7fa430152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa434aad640 1 -- 172.21.15.55:0/3827191132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4300cc0a0 msgr2=0x7fa430152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:23.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa434aad640 1 --2- 172.21.15.55:0/3827191132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4300cc0a0 0x7fa430152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa434aad640 1 -- 172.21.15.55:0/3827191132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4300ce7c0 con 0x7fa418003980 2023-08-25T05:35:23.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa434aad640 1 --2- 172.21.15.55:0/3827191132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa418003980 0x7fa43009fd20 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0ad040 tx=0x7fa418005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:23.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa4257fa640 1 -- 172.21.15.55:0/3827191132 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c0abdb0 con 0x7fa418003980 2023-08-25T05:35:23.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa4257fa640 1 -- 172.21.15.55:0/3827191132 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c0b8070 con 0x7fa418003980 2023-08-25T05:35:23.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa4257fa640 1 -- 172.21.15.55:0/3827191132 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c004260 con 0x7fa418003980 2023-08-25T05:35:23.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa436d11640 1 -- 172.21.15.55:0/3827191132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4300c6c20 con 0x7fa418003980 2023-08-25T05:35:23.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.757+0000 7fa436d11640 1 -- 172.21.15.55:0/3827191132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4301532e0 con 0x7fa418003980 2023-08-25T05:35:23.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.761+0000 7fa436d11640 1 -- 172.21.15.55:0/3827191132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4300b5260 con 0x7fa418003980 2023-08-25T05:35:23.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.761+0000 7fa4257fa640 1 -- 172.21.15.55:0/3827191132 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 102) v1 ==== 85076+0+0 (secure 0 0 0) 0x7fa42c0043c0 con 0x7fa418003980 2023-08-25T05:35:23.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.761+0000 7fa4257fa640 1 --2- 172.21.15.55:0/3827191132 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fa41c0657d0 0x7fa41c067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:23.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.761+0000 7fa4257fa640 1 -- 172.21.15.55:0/3827191132 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6864+0+0 (secure 0 0 0) 0x7fa42c11d8c0 con 0x7fa418003980 2023-08-25T05:35:23.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.761+0000 7fa427fff640 1 -- 172.21.15.55:0/3827191132 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fa41c0657d0 msgr2=0x7fa41c067c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/2233108903 2023-08-25T05:35:23.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.761+0000 7fa427fff640 1 --2- 172.21.15.55:0/3827191132 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fa41c0657d0 0x7fa41c067c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:35:23.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.769+0000 7fa4257fa640 1 -- 172.21.15.55:0/3827191132 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa42c0eaef0 con 0x7fa418003980 2023-08-25T05:35:23.882 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:23.877+0000 7f65c38d5180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:35:23.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.925+0000 7fa436d11640 1 -- 172.21.15.55:0/3827191132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa430073ec0 con 0x7fa418003980 2023-08-25T05:35:23.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.929+0000 7fa4257fa640 1 -- 172.21.15.55:0/3827191132 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v175) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa42c0c3020 con 0x7fa418003980 2023-08-25T05:35:23.932 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T05:35:23.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.929+0000 7fa436d11640 1 -- 172.21.15.55:0/3827191132 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fa41c0657d0 msgr2=0x7fa41c067c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:35:23.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.929+0000 7fa436d11640 1 --2- 172.21.15.55:0/3827191132 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fa41c0657d0 0x7fa41c067c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.929+0000 7fa436d11640 1 -- 172.21.15.55:0/3827191132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa418003980 msgr2=0x7fa43009fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:23.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.929+0000 7fa436d11640 1 --2- 172.21.15.55:0/3827191132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa418003980 0x7fa43009fd20 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0ad040 tx=0x7fa418005800 comp rx=0 tx=0).stop 2023-08-25T05:35:23.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.929+0000 7fa436d11640 1 -- 172.21.15.55:0/3827191132 shutdown_connections 2023-08-25T05:35:23.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.929+0000 7fa436d11640 1 --2- 172.21.15.55:0/3827191132 >> [v2:172.21.15.110:6832/2233108903,v1:172.21.15.110:6833/2233108903] conn(0x7fa41c0657d0 0x7fa41c067c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.929+0000 7fa436d11640 1 --2- 172.21.15.55:0/3827191132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa4300cc0a0 0x7fa430152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.929+0000 7fa436d11640 1 --2- 172.21.15.55:0/3827191132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4300cbc40 0x7fa430152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.929+0000 7fa436d11640 1 --2- 172.21.15.55:0/3827191132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa418003980 0x7fa43009fd20 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:23.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.929+0000 7fa436d11640 1 -- 172.21.15.55:0/3827191132 >> 172.21.15.55:0/3827191132 conn(0x7fa4300d27d0 msgr2=0x7fa4300b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:23.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.929+0000 7fa436d11640 1 -- 172.21.15.55:0/3827191132 shutdown_connections 2023-08-25T05:35:23.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:23.929+0000 7fa436d11640 1 -- 172.21.15.55:0/3827191132 wait complete. 2023-08-25T05:35:23.963 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T05:35:23.994 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:23.989+0000 7f65c38d5180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:35:24.053 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:24.048+0000 7f907b342180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:35:24.113 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:24.108+0000 7f907b342180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:35:24.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.141+0000 7f4df50d8640 1 Processor -- start 2023-08-25T05:35:24.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.145+0000 7f4df50d8640 1 -- start start 2023-08-25T05:35:24.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.145+0000 7f4df50d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4df00cd190 0x7f4df00d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:24.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.145+0000 7f4df50d8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df00d14f0 con 0x7f4df015c8a0 2023-08-25T05:35:24.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.145+0000 7f4df50d8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df00d0690 con 0x7f4df00d10a0 2023-08-25T05:35:24.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.145+0000 7f4df50d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df00cd6c0 con 0x7f4df00cd190 2023-08-25T05:35:24.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.145+0000 7f4def7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4df00cd190 0x7f4df00d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:24.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.145+0000 7f4deffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4df015c8a0 0x7f4df00b4aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53630/0 (socket says 172.21.15.55:53630) 2023-08-25T05:35:24.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.145+0000 7f4deffff640 1 -- 172.21.15.55:0/2583996475 learned_addr learned my addr 172.21.15.55:0/2583996475 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:24.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.145+0000 7f4def7fe640 1 -- 172.21.15.55:0/2583996475 >> v1:172.21.15.110:6789/0 conn(0x7f4df00d10a0 legacy=0x7f4df00b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:24.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.145+0000 7f4deeffd640 1 -- 172.21.15.55:0/2583996475 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276394925 0 0) 0x7f4de00012a0 con 0x7f4df015c8a0 2023-08-25T05:35:24.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.145+0000 7f4def7fe640 1 -- 172.21.15.55:0/2583996475 >> v1:172.21.15.55:6789/0 conn(0x7f4df015c8a0 legacy=0x7f4df00b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:24.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.145+0000 7f4def7fe640 1 -- 172.21.15.55:0/2583996475 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df00cd9a0 con 0x7f4df00cd190 2023-08-25T05:35:24.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.149+0000 7f4def7fe640 1 --2- 172.21.15.55:0/2583996475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4df00cd190 0x7f4df00d0b60 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f4de40097c0 tx=0x7f4de401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2adefd77802a1a51 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:24.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.149+0000 7f4deeffd640 1 -- 172.21.15.55:0/2583996475 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de40ab650 con 0x7f4df00cd190 2023-08-25T05:35:24.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.149+0000 7f4deeffd640 1 -- 172.21.15.55:0/2583996475 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de40ab7b0 con 0x7f4df00cd190 2023-08-25T05:35:24.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.149+0000 7f4deeffd640 1 -- 172.21.15.55:0/2583996475 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de40abb40 con 0x7f4df00cd190 2023-08-25T05:35:24.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.149+0000 7f4df50d8640 1 -- 172.21.15.55:0/2583996475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4df00cd190 msgr2=0x7f4df00d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.149+0000 7f4df50d8640 1 --2- 172.21.15.55:0/2583996475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4df00cd190 0x7f4df00d0b60 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f4de40097c0 tx=0x7f4de401c450 comp rx=0 tx=0).stop 2023-08-25T05:35:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.149+0000 7f4df50d8640 1 -- 172.21.15.55:0/2583996475 shutdown_connections 2023-08-25T05:35:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.149+0000 7f4df50d8640 1 --2- 172.21.15.55:0/2583996475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4df00cd190 0x7f4df00d0b60 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.149+0000 7f4df50d8640 1 -- 172.21.15.55:0/2583996475 >> 172.21.15.55:0/2583996475 conn(0x7f4df00d2610 msgr2=0x7f4df00d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.149+0000 7f4df50d8640 1 -- 172.21.15.55:0/2583996475 shutdown_connections 2023-08-25T05:35:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.149+0000 7f4df50d8640 1 -- 172.21.15.55:0/2583996475 wait complete. 2023-08-25T05:35:24.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.149+0000 7f4df50d8640 1 Processor -- start 2023-08-25T05:35:24.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.149+0000 7f4df50d8640 1 -- start start 2023-08-25T05:35:24.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4df50d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4df00cd190 0x7f4df0156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:24.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4df50d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4df00d10a0 0x7f4df00b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:24.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4df50d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4df015c8a0 0x7f4df015ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:24.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4df50d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df0156c40 con 0x7f4df015c8a0 2023-08-25T05:35:24.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4df50d8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df00b6c90 con 0x7f4df00d10a0 2023-08-25T05:35:24.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4df50d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df00b5bf0 con 0x7f4df00cd190 2023-08-25T05:35:24.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4df48d7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4df015c8a0 0x7f4df015ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:24.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4deffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4df00cd190 0x7f4df0156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:24.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4def7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4df00d10a0 0x7f4df00b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:24.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4def7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4df00d10a0 0x7f4df00b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:53748/0 (socket says 172.21.15.55:53748) 2023-08-25T05:35:24.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4def7fe640 1 -- 172.21.15.55:0/1094300096 learned_addr learned my addr 172.21.15.55:0/1094300096 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:24.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4def7fe640 1 -- 172.21.15.55:0/1094300096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4df00cd190 msgr2=0x7f4df0156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:24.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4def7fe640 1 --2- 172.21.15.55:0/1094300096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4df00cd190 0x7f4df0156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:24.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4def7fe640 1 -- 172.21.15.55:0/1094300096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4df015c8a0 msgr2=0x7f4df015ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:24.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4def7fe640 1 --2- 172.21.15.55:0/1094300096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4df015c8a0 0x7f4df015ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:24.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4def7fe640 1 -- 172.21.15.55:0/1094300096 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de4009420 con 0x7f4df00d10a0 2023-08-25T05:35:24.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4deffff640 1 --2- 172.21.15.55:0/1094300096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4df00cd190 0x7f4df0156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:35:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4df48d7640 1 --2- 172.21.15.55:0/1094300096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4df015c8a0 0x7f4df015ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:35:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4def7fe640 1 --2- 172.21.15.55:0/1094300096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4df00d10a0 0x7f4df00b5210 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4de40ad040 tx=0x7f4de401ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4decff9640 1 -- 172.21.15.55:0/1094300096 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de40b5810 con 0x7f4df00d10a0 2023-08-25T05:35:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4decff9640 1 -- 172.21.15.55:0/1094300096 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de40b5990 con 0x7f4df00d10a0 2023-08-25T05:35:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4df50d8640 1 -- 172.21.15.55:0/1094300096 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df00b5ed0 con 0x7f4df00d10a0 2023-08-25T05:35:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4decff9640 1 -- 172.21.15.55:0/1094300096 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de40b5d40 con 0x7f4df00d10a0 2023-08-25T05:35:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4df50d8640 1 -- 172.21.15.55:0/1094300096 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df00b6490 con 0x7f4df00d10a0 2023-08-25T05:35:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.153+0000 7f4df50d8640 1 -- 172.21.15.55:0/1094300096 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df00d0940 con 0x7f4df00d10a0 2023-08-25T05:35:24.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.157+0000 7f4decff9640 1 -- 172.21.15.55:0/1094300096 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 103) v1 ==== 84673+0+0 (secure 0 0 0) 0x7f4de40c83f0 con 0x7f4df00d10a0 2023-08-25T05:35:24.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.157+0000 7f4decff9640 1 -- 172.21.15.55:0/1094300096 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 7180+0+0 (secure 0 0 0) 0x7f4de411dd00 con 0x7f4df00d10a0 2023-08-25T05:35:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.161+0000 7f4decff9640 1 -- 172.21.15.55:0/1094300096 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4de4121030 con 0x7f4df00d10a0 2023-08-25T05:35:24.191 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:24.184+0000 7f9007272640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:24.192 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:24.184+0000 7f9007272640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:24.192 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:24.184+0000 7f9007272640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:24.192 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:24.184+0000 7f9007272640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:24.192 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:24.184+0000 7f9007272640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:24.192 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:24.188+0000 7f9004a6d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:24.192 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:24.188+0000 7f9004a6d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:24.193 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:24.188+0000 7f9004a6d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:24.193 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:24.188+0000 7f9004a6d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:24.193 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:24.188+0000 7f9004a6d640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:24.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.325+0000 7f4df50d8640 1 -- 172.21.15.55:0/1094300096 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4df0071480 con 0x7f4df00d10a0 2023-08-25T05:35:24.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.325+0000 7f4decff9640 1 -- 172.21.15.55:0/1094300096 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v176) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4de40eb860 con 0x7f4df00d10a0 2023-08-25T05:35:24.329 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T05:35:24.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.325+0000 7f4df50d8640 1 -- 172.21.15.55:0/1094300096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4df00d10a0 msgr2=0x7f4df00b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:24.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.325+0000 7f4df50d8640 1 --2- 172.21.15.55:0/1094300096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4df00d10a0 0x7f4df00b5210 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4de40ad040 tx=0x7f4de401ac90 comp rx=0 tx=0).stop 2023-08-25T05:35:24.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.325+0000 7f4df50d8640 1 -- 172.21.15.55:0/1094300096 shutdown_connections 2023-08-25T05:35:24.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.325+0000 7f4df50d8640 1 --2- 172.21.15.55:0/1094300096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4df015c8a0 0x7f4df015ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:24.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.325+0000 7f4df50d8640 1 --2- 172.21.15.55:0/1094300096 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4df00d10a0 0x7f4df00b5210 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:24.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.325+0000 7f4df50d8640 1 --2- 172.21.15.55:0/1094300096 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4df00cd190 0x7f4df0156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:24.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.325+0000 7f4df50d8640 1 -- 172.21.15.55:0/1094300096 >> 172.21.15.55:0/1094300096 conn(0x7f4df00d2610 msgr2=0x7f4df00af870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:24.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.329+0000 7f4df50d8640 1 -- 172.21.15.55:0/1094300096 shutdown_connections 2023-08-25T05:35:24.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.329+0000 7f4df50d8640 1 -- 172.21.15.55:0/1094300096 wait complete. 2023-08-25T05:35:24.345 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:24.341+0000 7f65c38d5180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:35:24.350 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T05:35:24.410 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:24.405+0000 7f65c38d5180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:35:24.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.497+0000 7ff8458e6640 1 Processor -- start 2023-08-25T05:35:24.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.497+0000 7ff8458e6640 1 -- start start 2023-08-25T05:35:24.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.497+0000 7ff8458e6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8401601f0 0x7ff84015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:24.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.497+0000 7ff8458e6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8400cd5a0 con 0x7ff84015e3c0 2023-08-25T05:35:24.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.497+0000 7ff8458e6640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8400cd880 con 0x7ff8400d1290 2023-08-25T05:35:24.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.497+0000 7ff8458e6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400cdb60 con 0x7ff8401601f0 2023-08-25T05:35:24.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.497+0000 7ff837fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff84015e3c0 0x7ff8400d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53642/0 (socket says 172.21.15.55:53642) 2023-08-25T05:35:24.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.497+0000 7ff837fff640 1 -- 172.21.15.55:0/982778757 learned_addr learned my addr 172.21.15.55:0/982778757 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:24.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.497+0000 7ff83effd640 1 --2- 172.21.15.55:0/982778757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8401601f0 0x7ff84015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:24.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.497+0000 7ff83e7fc640 1 -- 172.21.15.55:0/982778757 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195860880 0 0) 0x7ff8400cd5a0 con 0x7ff84015e3c0 2023-08-25T05:35:24.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.497+0000 7ff83e7fc640 1 -- 172.21.15.55:0/982778757 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff82c003530 con 0x7ff84015e3c0 2023-08-25T05:35:24.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.497+0000 7ff83e7fc640 1 -- 172.21.15.55:0/982778757 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180879602 0 0) 0x7ff8400cd880 con 0x7ff8400d1290 2023-08-25T05:35:24.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.497+0000 7ff83e7fc640 1 -- 172.21.15.55:0/982778757 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8400cd5a0 con 0x7ff8400d1290 2023-08-25T05:35:24.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.497+0000 7ff83effd640 1 -- 172.21.15.55:0/982778757 >> v1:172.21.15.110:6789/0 conn(0x7ff8400d1290 legacy=0x7ff84015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:24.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.497+0000 7ff83e7fc640 1 -- 172.21.15.55:0/982778757 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4127784388 0 0) 0x7ff82c003530 con 0x7ff84015e3c0 2023-08-25T05:35:24.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.497+0000 7ff83effd640 1 -- 172.21.15.55:0/982778757 >> v1:172.21.15.55:6789/0 conn(0x7ff84015e3c0 legacy=0x7ff8400d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:24.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.497+0000 7ff83effd640 1 -- 172.21.15.55:0/982778757 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8400cde40 con 0x7ff8401601f0 2023-08-25T05:35:24.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.501+0000 7ff83effd640 1 --2- 172.21.15.55:0/982778757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8401601f0 0x7ff84015d430 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff8300097d0 tx=0x7ff83001ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84f3d5abb4d4d9fe server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:24.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.501+0000 7ff83e7fc640 1 -- 172.21.15.55:0/982778757 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828001680 con 0x7ff8401601f0 2023-08-25T05:35:24.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.501+0000 7ff83e7fc640 1 -- 172.21.15.55:0/982778757 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8300a8630 con 0x7ff8401601f0 2023-08-25T05:35:24.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.501+0000 7ff83e7fc640 1 -- 172.21.15.55:0/982778757 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8300a89c0 con 0x7ff8401601f0 2023-08-25T05:35:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.501+0000 7ff8458e6640 1 -- 172.21.15.55:0/982778757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8401601f0 msgr2=0x7ff84015d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.501+0000 7ff8458e6640 1 --2- 172.21.15.55:0/982778757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8401601f0 0x7ff84015d430 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff8300097d0 tx=0x7ff83001ebb0 comp rx=0 tx=0).stop 2023-08-25T05:35:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.501+0000 7ff8458e6640 1 -- 172.21.15.55:0/982778757 shutdown_connections 2023-08-25T05:35:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.501+0000 7ff8458e6640 1 --2- 172.21.15.55:0/982778757 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8401601f0 0x7ff84015d430 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.501+0000 7ff8458e6640 1 -- 172.21.15.55:0/982778757 >> 172.21.15.55:0/982778757 conn(0x7ff8400d27d0 msgr2=0x7ff8400d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.501+0000 7ff8458e6640 1 -- 172.21.15.55:0/982778757 shutdown_connections 2023-08-25T05:35:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.501+0000 7ff8458e6640 1 -- 172.21.15.55:0/982778757 wait complete. 2023-08-25T05:35:24.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff8458e6640 1 Processor -- start 2023-08-25T05:35:24.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff8458e6640 1 -- start start 2023-08-25T05:35:24.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff8458e6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8400d1290 0x7ff8400b6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:24.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff8458e6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84015e3c0 0x7ff84014b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff8458e6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8401601f0 0x7ff84006b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff8458e6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff840151aa0 con 0x7ff84015e3c0 2023-08-25T05:35:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff8458e6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400ccad0 con 0x7ff8401601f0 2023-08-25T05:35:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff8458e6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8401f6990 con 0x7ff8400d1290 2023-08-25T05:35:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff837fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84015e3c0 0x7ff84014b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff837fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84015e3c0 0x7ff84014b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47440/0 (socket says 172.21.15.55:47440) 2023-08-25T05:35:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff837fff640 1 -- 172.21.15.55:0/134439577 learned_addr learned my addr 172.21.15.55:0/134439577 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff83f7fe640 1 --2- 172.21.15.55:0/134439577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8401601f0 0x7ff84006b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:24.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff83effd640 1 --2- 172.21.15.55:0/134439577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8400d1290 0x7ff8400b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:24.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff837fff640 1 -- 172.21.15.55:0/134439577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8400d1290 msgr2=0x7ff8400b6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:24.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff837fff640 1 --2- 172.21.15.55:0/134439577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8400d1290 0x7ff8400b6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:24.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff837fff640 1 -- 172.21.15.55:0/134439577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8401601f0 msgr2=0x7ff84006b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:24.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff837fff640 1 --2- 172.21.15.55:0/134439577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8401601f0 0x7ff84006b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:24.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff837fff640 1 -- 172.21.15.55:0/134439577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8300093b0 con 0x7ff84015e3c0 2023-08-25T05:35:24.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff837fff640 1 --2- 172.21.15.55:0/134439577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84015e3c0 0x7ff84014b310 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7ff82800c780 tx=0x7ff82800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:24.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff83cff9640 1 -- 172.21.15.55:0/134439577 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828005cf0 con 0x7ff84015e3c0 2023-08-25T05:35:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff83cff9640 1 -- 172.21.15.55:0/134439577 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff828005e50 con 0x7ff84015e3c0 2023-08-25T05:35:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff83cff9640 1 -- 172.21.15.55:0/134439577 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8280072b0 con 0x7ff84015e3c0 2023-08-25T05:35:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff8458e6640 1 -- 172.21.15.55:0/134439577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8400ce7c0 con 0x7ff84015e3c0 2023-08-25T05:35:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.505+0000 7ff8458e6640 1 -- 172.21.15.55:0/134439577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8400b5d30 con 0x7ff84015e3c0 2023-08-25T05:35:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.509+0000 7ff8458e6640 1 -- 172.21.15.55:0/134439577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8400b5260 con 0x7ff84015e3c0 2023-08-25T05:35:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.509+0000 7ff83cff9640 1 -- 172.21.15.55:0/134439577 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 103) v1 ==== 84673+0+0 (secure 0 0 0) 0x7ff828007410 con 0x7ff84015e3c0 2023-08-25T05:35:24.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.509+0000 7ff83cff9640 1 -- 172.21.15.55:0/134439577 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 7180+0+0 (secure 0 0 0) 0x7ff828082480 con 0x7ff84015e3c0 2023-08-25T05:35:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.513+0000 7ff83cff9640 1 -- 172.21.15.55:0/134439577 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff82804fef0 con 0x7ff84015e3c0 2023-08-25T05:35:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.669+0000 7ff8458e6640 1 -- 172.21.15.55:0/134439577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff840073ec0 con 0x7ff84015e3c0 2023-08-25T05:35:24.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.673+0000 7ff83cff9640 1 -- 172.21.15.55:0/134439577 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v176) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff828053510 con 0x7ff84015e3c0 2023-08-25T05:35:24.676 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T05:35:24.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.673+0000 7ff8458e6640 1 -- 172.21.15.55:0/134439577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84015e3c0 msgr2=0x7ff84014b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:24.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.673+0000 7ff8458e6640 1 --2- 172.21.15.55:0/134439577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84015e3c0 0x7ff84014b310 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7ff82800c780 tx=0x7ff82800cc40 comp rx=0 tx=0).stop 2023-08-25T05:35:24.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.673+0000 7ff8458e6640 1 -- 172.21.15.55:0/134439577 shutdown_connections 2023-08-25T05:35:24.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.673+0000 7ff8458e6640 1 --2- 172.21.15.55:0/134439577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff8401601f0 0x7ff84006b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:24.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.673+0000 7ff8458e6640 1 --2- 172.21.15.55:0/134439577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84015e3c0 0x7ff84014b310 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:24.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.673+0000 7ff8458e6640 1 --2- 172.21.15.55:0/134439577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8400d1290 0x7ff8400b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:24.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.673+0000 7ff8458e6640 1 -- 172.21.15.55:0/134439577 >> 172.21.15.55:0/134439577 conn(0x7ff8400d27d0 msgr2=0x7ff84015dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:24.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.673+0000 7ff8458e6640 1 -- 172.21.15.55:0/134439577 shutdown_connections 2023-08-25T05:35:24.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.673+0000 7ff8458e6640 1 -- 172.21.15.55:0/134439577 wait complete. 2023-08-25T05:35:24.696 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T05:35:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.837+0000 7f2cac5ac640 1 Processor -- start 2023-08-25T05:35:24.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.837+0000 7f2cac5ac640 1 -- start start 2023-08-25T05:35:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.841+0000 7f2cac5ac640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2ca40c9900 0x7f2ca40cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.841+0000 7f2cac5ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ca406c720 0x7f2ca406cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.841+0000 7f2cac5ac640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca40c9d90 con 0x7f2ca40cb020 2023-08-25T05:35:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.841+0000 7f2cac5ac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca40cbca0 con 0x7f2ca406c720 2023-08-25T05:35:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.841+0000 7f2cac5ac640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca40c9470 con 0x7f2ca40c9900 2023-08-25T05:35:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.841+0000 7f2caab49640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ca406c720 0x7f2ca406cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.841+0000 7f2ca9b47640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2ca40c9900 0x7f2ca40cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.841+0000 7f2caab49640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ca406c720 0x7f2ca406cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47448/0 (socket says 172.21.15.55:47448) 2023-08-25T05:35:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.841+0000 7f2caab49640 1 -- 172.21.15.55:0/1494566382 learned_addr learned my addr 172.21.15.55:0/1494566382 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.841+0000 7f2caab49640 1 -- 172.21.15.55:0/1494566382 >> v2:172.21.15.110:3300/0 conn(0x7f2ca40c9900 msgr2=0x7f2ca40cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.841+0000 7f2caab49640 1 --2- 172.21.15.55:0/1494566382 >> v2:172.21.15.110:3300/0 conn(0x7f2ca40c9900 0x7f2ca40cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.841+0000 7f2caab49640 1 -- 172.21.15.55:0/1494566382 >> v1:172.21.15.110:6789/0 conn(0x7f2ca40cb020 legacy=0x7f2ca40cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.841+0000 7f2caab49640 1 -- 172.21.15.55:0/1494566382 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca406d040 con 0x7f2ca406c720 2023-08-25T05:35:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.845+0000 7f2caab49640 1 --2- 172.21.15.55:0/1494566382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca406c720 0x7f2ca406cb00 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4071fe0 tx=0x7f2c9c01eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575ecb3cc36856da server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.845+0000 7f2ca9346640 1 -- 172.21.15.55:0/1494566382 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c0a7820 con 0x7f2ca406c720 2023-08-25T05:35:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.845+0000 7f2ca9346640 1 -- 172.21.15.55:0/1494566382 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c0a7980 con 0x7f2ca406c720 2023-08-25T05:35:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.845+0000 7f2ca9346640 1 -- 172.21.15.55:0/1494566382 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c0a7d10 con 0x7f2ca406c720 2023-08-25T05:35:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.845+0000 7f2cac5ac640 1 -- 172.21.15.55:0/1494566382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca406c720 msgr2=0x7f2ca406cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:24.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.845+0000 7f2cac5ac640 1 --2- 172.21.15.55:0/1494566382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca406c720 0x7f2ca406cb00 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4071fe0 tx=0x7f2c9c01eb50 comp rx=0 tx=0).stop 2023-08-25T05:35:24.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.845+0000 7f2cac5ac640 1 -- 172.21.15.55:0/1494566382 shutdown_connections 2023-08-25T05:35:24.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.845+0000 7f2cac5ac640 1 --2- 172.21.15.55:0/1494566382 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca406c720 0x7f2ca406cb00 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:24.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.845+0000 7f2cac5ac640 1 --2- 172.21.15.55:0/1494566382 >> v2:172.21.15.110:3300/0 conn(0x7f2ca40c9900 0x7f2ca40cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.845+0000 7f2cac5ac640 1 -- 172.21.15.55:0/1494566382 >> 172.21.15.55:0/1494566382 conn(0x7f2ca4069900 msgr2=0x7f2ca4069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.845+0000 7f2cac5ac640 1 -- 172.21.15.55:0/1494566382 shutdown_connections 2023-08-25T05:35:24.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.845+0000 7f2cac5ac640 1 -- 172.21.15.55:0/1494566382 wait complete. 2023-08-25T05:35:24.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.845+0000 7f2cac5ac640 1 Processor -- start 2023-08-25T05:35:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.845+0000 7f2cac5ac640 1 -- start start 2023-08-25T05:35:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2cac5ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca406c720 0x7f2ca40b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2cac5ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ca40c9900 0x7f2ca40c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2cac5ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ca40cb020 0x7f2ca40c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:24.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2cac5ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca4151600 con 0x7f2ca406c720 2023-08-25T05:35:24.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2cac5ac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca40c83d0 con 0x7f2ca40cb020 2023-08-25T05:35:24.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2cac5ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca4159f60 con 0x7f2ca40c9900 2023-08-25T05:35:24.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2caa348640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca406c720 0x7f2ca40b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:24.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2caa348640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca406c720 0x7f2ca40b09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47452/0 (socket says 172.21.15.55:47452) 2023-08-25T05:35:24.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2caa348640 1 -- 172.21.15.55:0/2269722479 learned_addr learned my addr 172.21.15.55:0/2269722479 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:24.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2ca9b47640 1 --2- 172.21.15.55:0/2269722479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ca40c9900 0x7f2ca40c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:24.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2caab49640 1 --2- 172.21.15.55:0/2269722479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ca40cb020 0x7f2ca40c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:24.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2caa348640 1 -- 172.21.15.55:0/2269722479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ca40c9900 msgr2=0x7f2ca40c5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:24.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2caa348640 1 --2- 172.21.15.55:0/2269722479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ca40c9900 0x7f2ca40c5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2caa348640 1 -- 172.21.15.55:0/2269722479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ca40cb020 msgr2=0x7f2ca40c64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2caa348640 1 --2- 172.21.15.55:0/2269722479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ca40cb020 0x7f2ca40c64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2caa348640 1 -- 172.21.15.55:0/2269722479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9c009b30 con 0x7f2ca406c720 2023-08-25T05:35:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2ca9b47640 1 --2- 172.21.15.55:0/2269722479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ca40c9900 0x7f2ca40c5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2caab49640 1 --2- 172.21.15.55:0/2269722479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ca40cb020 0x7f2ca40c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2caa348640 1 --2- 172.21.15.55:0/2269722479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca406c720 0x7f2ca40b09d0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000c400 tx=0x7f2ca000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2c9affd640 1 -- 172.21.15.55:0/2269722479 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca00052d0 con 0x7f2ca406c720 2023-08-25T05:35:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2c9affd640 1 -- 172.21.15.55:0/2269722479 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca0005430 con 0x7f2ca406c720 2023-08-25T05:35:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2c9affd640 1 -- 172.21.15.55:0/2269722479 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0003890 con 0x7f2ca406c720 2023-08-25T05:35:24.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2cac5ac640 1 -- 172.21.15.55:0/2269722479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca4159350 con 0x7f2ca406c720 2023-08-25T05:35:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2cac5ac640 1 -- 172.21.15.55:0/2269722479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca4159910 con 0x7f2ca406c720 2023-08-25T05:35:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.849+0000 7f2cac5ac640 1 -- 172.21.15.55:0/2269722479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca4073ec0 con 0x7f2ca406c720 2023-08-25T05:35:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.853+0000 7f2c9affd640 1 -- 172.21.15.55:0/2269722479 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 103) v1 ==== 84673+0+0 (secure 0 0 0) 0x7f2ca00039f0 con 0x7f2ca406c720 2023-08-25T05:35:24.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.853+0000 7f2c9affd640 1 -- 172.21.15.55:0/2269722479 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 7180+0+0 (secure 0 0 0) 0x7f2ca0082370 con 0x7f2ca406c720 2023-08-25T05:35:24.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:24.857+0000 7f2c9affd640 1 -- 172.21.15.55:0/2269722479 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2ca004fd30 con 0x7f2ca406c720 2023-08-25T05:35:25.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.009+0000 7f2cac5ac640 1 -- 172.21.15.55:0/2269722479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ca40cc230 con 0x7f2ca406c720 2023-08-25T05:35:25.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.009+0000 7f2c9affd640 1 -- 172.21.15.55:0/2269722479 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v176) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ca0053350 con 0x7f2ca406c720 2023-08-25T05:35:25.015 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T05:35:25.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.013+0000 7f2cac5ac640 1 -- 172.21.15.55:0/2269722479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca406c720 msgr2=0x7f2ca40b09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:25.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.013+0000 7f2cac5ac640 1 --2- 172.21.15.55:0/2269722479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca406c720 0x7f2ca40b09d0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000c400 tx=0x7f2ca000c8c0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.013+0000 7f2cac5ac640 1 -- 172.21.15.55:0/2269722479 shutdown_connections 2023-08-25T05:35:25.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.013+0000 7f2cac5ac640 1 --2- 172.21.15.55:0/2269722479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ca40cb020 0x7f2ca40c64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.013+0000 7f2cac5ac640 1 --2- 172.21.15.55:0/2269722479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ca40c9900 0x7f2ca40c5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.013+0000 7f2cac5ac640 1 --2- 172.21.15.55:0/2269722479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ca406c720 0x7f2ca40b09d0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.013+0000 7f2cac5ac640 1 -- 172.21.15.55:0/2269722479 >> 172.21.15.55:0/2269722479 conn(0x7f2ca4069900 msgr2=0x7f2ca4069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:25.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.013+0000 7f2cac5ac640 1 -- 172.21.15.55:0/2269722479 shutdown_connections 2023-08-25T05:35:25.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.013+0000 7f2cac5ac640 1 -- 172.21.15.55:0/2269722479 wait complete. 2023-08-25T05:35:25.035 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:35:25.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.181+0000 7fac7b4d8640 1 Processor -- start 2023-08-25T05:35:25.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.181+0000 7fac7b4d8640 1 -- start start 2023-08-25T05:35:25.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.181+0000 7fac7b4d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac740cdde0 0x7fac740ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:25.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.181+0000 7fac7b4d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac740b2e40 0x7fac740b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:25.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.181+0000 7fac7b4d8640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac740b29b0 con 0x7fac740d0da0 2023-08-25T05:35:25.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.181+0000 7fac7b4d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac740ce760 con 0x7fac740cdde0 2023-08-25T05:35:25.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.181+0000 7fac7b4d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac740b1dc0 con 0x7fac740b2e40 2023-08-25T05:35:25.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.181+0000 7fac78a73640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac740cdde0 0x7fac740ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:25.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.181+0000 7fac79274640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fac740d0da0 0x7fac740d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53646/0 (socket says 172.21.15.55:53646) 2023-08-25T05:35:25.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.181+0000 7fac79274640 1 -- 172.21.15.55:0/812495973 learned_addr learned my addr 172.21.15.55:0/812495973 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:25.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.181+0000 7fac79a75640 1 --2- 172.21.15.55:0/812495973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac740b2e40 0x7fac740b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:25.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.181+0000 7fac78a73640 1 -- 172.21.15.55:0/812495973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac740b2e40 msgr2=0x7fac740b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:25.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.181+0000 7fac78a73640 1 --2- 172.21.15.55:0/812495973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac740b2e40 0x7fac740b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.181+0000 7fac78a73640 1 -- 172.21.15.55:0/812495973 >> v1:172.21.15.55:6789/0 conn(0x7fac740d0da0 legacy=0x7fac740d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:25.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.181+0000 7fac78a73640 1 -- 172.21.15.55:0/812495973 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac740b2080 con 0x7fac740cdde0 2023-08-25T05:35:25.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.181+0000 7fac79a75640 1 --2- 172.21.15.55:0/812495973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac740b2e40 0x7fac740b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:25.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.185+0000 7fac78a73640 1 --2- 172.21.15.55:0/812495973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac740cdde0 0x7fac740ce220 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fac640097c0 tx=0x7fac6401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a701a6ec21a86f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:25.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.185+0000 7fac6bfff640 1 -- 172.21.15.55:0/812495973 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac640a8970 con 0x7fac740cdde0 2023-08-25T05:35:25.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.185+0000 7fac6bfff640 1 -- 172.21.15.55:0/812495973 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac640a8ad0 con 0x7fac740cdde0 2023-08-25T05:35:25.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.185+0000 7fac6bfff640 1 -- 172.21.15.55:0/812495973 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac640a8e60 con 0x7fac740cdde0 2023-08-25T05:35:25.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.185+0000 7fac7b4d8640 1 -- 172.21.15.55:0/812495973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac740cdde0 msgr2=0x7fac740ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:25.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.185+0000 7fac7b4d8640 1 --2- 172.21.15.55:0/812495973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac740cdde0 0x7fac740ce220 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fac640097c0 tx=0x7fac6401ec70 comp rx=0 tx=0).stop 2023-08-25T05:35:25.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.185+0000 7fac7b4d8640 1 -- 172.21.15.55:0/812495973 shutdown_connections 2023-08-25T05:35:25.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.185+0000 7fac7b4d8640 1 --2- 172.21.15.55:0/812495973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac740b2e40 0x7fac740b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.185+0000 7fac7b4d8640 1 --2- 172.21.15.55:0/812495973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac740cdde0 0x7fac740ce220 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.185+0000 7fac7b4d8640 1 -- 172.21.15.55:0/812495973 >> 172.21.15.55:0/812495973 conn(0x7fac7409bae0 msgr2=0x7fac740d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:25.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.185+0000 7fac7b4d8640 1 -- 172.21.15.55:0/812495973 shutdown_connections 2023-08-25T05:35:25.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.185+0000 7fac7b4d8640 1 -- 172.21.15.55:0/812495973 wait complete. 2023-08-25T05:35:25.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac7b4d8640 1 Processor -- start 2023-08-25T05:35:25.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac7b4d8640 1 -- start start 2023-08-25T05:35:25.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac7b4d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac740b2e40 0x7fac740c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:25.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac7b4d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac740cdde0 0x7fac740ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:25.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac7b4d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac740d0da0 0x7fac740b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:25.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac7b4d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac740cb110 con 0x7fac740d0da0 2023-08-25T05:35:25.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac7b4d8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac740cb3f0 con 0x7fac740cdde0 2023-08-25T05:35:25.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac7b4d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac740cb6d0 con 0x7fac740b2e40 2023-08-25T05:35:25.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac79a75640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac740d0da0 0x7fac740b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:25.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac79a75640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac740d0da0 0x7fac740b08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47466/0 (socket says 172.21.15.55:47466) 2023-08-25T05:35:25.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac79a75640 1 -- 172.21.15.55:0/2467831245 learned_addr learned my addr 172.21.15.55:0/2467831245 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:25.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac78a73640 1 --2- 172.21.15.55:0/2467831245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac740cdde0 0x7fac740ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:25.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac79274640 1 --2- 172.21.15.55:0/2467831245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac740b2e40 0x7fac740c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:25.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac79a75640 1 -- 172.21.15.55:0/2467831245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac740b2e40 msgr2=0x7fac740c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:25.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac79a75640 1 --2- 172.21.15.55:0/2467831245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac740b2e40 0x7fac740c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac79a75640 1 -- 172.21.15.55:0/2467831245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac740cdde0 msgr2=0x7fac740ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:25.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac79a75640 1 --2- 172.21.15.55:0/2467831245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac740cdde0 0x7fac740ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac79a75640 1 -- 172.21.15.55:0/2467831245 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac64009420 con 0x7fac740d0da0 2023-08-25T05:35:25.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac79a75640 1 --2- 172.21.15.55:0/2467831245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac740d0da0 0x7fac740b08f0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fac6c00cd50 tx=0x7fac6c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:25.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac69ffb640 1 -- 172.21.15.55:0/2467831245 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c00f680 con 0x7fac740d0da0 2023-08-25T05:35:25.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac69ffb640 1 -- 172.21.15.55:0/2467831245 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6c00f800 con 0x7fac740d0da0 2023-08-25T05:35:25.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac7b4d8640 1 -- 172.21.15.55:0/2467831245 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac7415e5a0 con 0x7fac740d0da0 2023-08-25T05:35:25.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac69ffb640 1 -- 172.21.15.55:0/2467831245 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6c00fbb0 con 0x7fac740d0da0 2023-08-25T05:35:25.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.189+0000 7fac7b4d8640 1 -- 172.21.15.55:0/2467831245 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7415e250 con 0x7fac740d0da0 2023-08-25T05:35:25.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.193+0000 7fac7b4d8640 1 -- 172.21.15.55:0/2467831245 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac7415e7e0 con 0x7fac740d0da0 2023-08-25T05:35:25.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.193+0000 7fac69ffb640 1 -- 172.21.15.55:0/2467831245 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 104) v1 ==== 84800+0+0 (secure 0 0 0) 0x7fac6c00b040 con 0x7fac740d0da0 2023-08-25T05:35:25.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.193+0000 7fac69ffb640 1 --2- 172.21.15.55:0/2467831245 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fac58065520 0x7fac580679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:25.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.193+0000 7fac69ffb640 1 -- 172.21.15.55:0/2467831245 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 7180+0+0 (secure 0 0 0) 0x7fac6c0837c0 con 0x7fac740d0da0 2023-08-25T05:35:25.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.193+0000 7fac79274640 1 --2- 172.21.15.55:0/2467831245 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fac58065520 0x7fac580679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:25.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.193+0000 7fac79274640 1 --2- 172.21.15.55:0/2467831245 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fac58065520 0x7fac580679e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fac700010f0 tx=0x7fac70009040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:25.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.197+0000 7fac69ffb640 1 -- 172.21.15.55:0/2467831245 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fac7415e7e0 con 0x7fac740d0da0 2023-08-25T05:35:25.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.389+0000 7fac7b4d8640 1 -- 172.21.15.55:0/2467831245 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac7415e7e0 con 0x7fac740d0da0 2023-08-25T05:35:25.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.389+0000 7fac69ffb640 1 -- 172.21.15.55:0/2467831245 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4883 (secure 0 0 0) 0x7fac7415e7e0 con 0x7fac740d0da0 2023-08-25T05:35:25.393 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:25.393 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/934106390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":934106390},{"type":"v1","addr":"172.21.15.110:6836","nonce":934106390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":78},{"gid":8303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/759320040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":759320040},{"type":"v1","addr":"172.21.15.110:6837","nonce":759320040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":78},{"gid":10140,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2128942930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2128942930},{"type":"v1","addr":"172.21.15.55:6833","nonce":2128942930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:19:18.477714+0000","modified":"2023-08-25T05:19:22.105735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":10149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10149":{"gid":10149,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1451359895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1451359895},{"type":"v1","addr":"172.21.15.55:6835","nonce":1451359895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-25T05:35:25.393 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 83 2023-08-25T05:35:25.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.389+0000 7fac7b4d8640 1 -- 172.21.15.55:0/2467831245 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fac58065520 msgr2=0x7fac580679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:25.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.389+0000 7fac7b4d8640 1 --2- 172.21.15.55:0/2467831245 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fac58065520 0x7fac580679e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fac700010f0 tx=0x7fac70009040 comp rx=0 tx=0).stop 2023-08-25T05:35:25.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.389+0000 7fac7b4d8640 1 -- 172.21.15.55:0/2467831245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac740d0da0 msgr2=0x7fac740b08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:25.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.389+0000 7fac7b4d8640 1 --2- 172.21.15.55:0/2467831245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac740d0da0 0x7fac740b08f0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fac6c00cd50 tx=0x7fac6c00a650 comp rx=0 tx=0).stop 2023-08-25T05:35:25.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.389+0000 7fac7b4d8640 1 -- 172.21.15.55:0/2467831245 shutdown_connections 2023-08-25T05:35:25.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.389+0000 7fac7b4d8640 1 --2- 172.21.15.55:0/2467831245 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fac58065520 0x7fac580679e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.389+0000 7fac7b4d8640 1 --2- 172.21.15.55:0/2467831245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac740d0da0 0x7fac740b08f0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.389+0000 7fac7b4d8640 1 --2- 172.21.15.55:0/2467831245 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac740cdde0 0x7fac740ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.389+0000 7fac7b4d8640 1 --2- 172.21.15.55:0/2467831245 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac740b2e40 0x7fac740c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.389+0000 7fac7b4d8640 1 -- 172.21.15.55:0/2467831245 >> 172.21.15.55:0/2467831245 conn(0x7fac7409bae0 msgr2=0x7fac7406b610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:25.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.389+0000 7fac7b4d8640 1 -- 172.21.15.55:0/2467831245 shutdown_connections 2023-08-25T05:35:25.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.389+0000 7fac7b4d8640 1 -- 172.21.15.55:0/2467831245 wait complete. 2023-08-25T05:35:25.413 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:35:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.553+0000 7f79c5056640 1 Processor -- start 2023-08-25T05:35:25.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.553+0000 7f79c5056640 1 -- start start 2023-08-25T05:35:25.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.553+0000 7f79c5056640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f79c00d0da0 0x7f79c00d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:25.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.553+0000 7f79c5056640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79c00b3e50 0x7f79c00ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:25.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.553+0000 7f79c5056640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c00b29b0 con 0x7f79c00cdde0 2023-08-25T05:35:25.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.553+0000 7f79c5056640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c00ce760 con 0x7f79c00d0da0 2023-08-25T05:35:25.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.553+0000 7f79c5056640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c00d16c0 con 0x7f79c00b3e50 2023-08-25T05:35:25.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.553+0000 7f79bf59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79c00b3e50 0x7f79c00ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:25.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.553+0000 7f79bf59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79c00b3e50 0x7f79c00ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:49526/0 (socket says 172.21.15.55:49526) 2023-08-25T05:35:25.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.553+0000 7f79bf59e640 1 -- 172.21.15.55:0/954133875 learned_addr learned my addr 172.21.15.55:0/954133875 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:25.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.553+0000 7f79bed9d640 1 --2- 172.21.15.55:0/954133875 >> v2:172.21.15.110:3300/0 conn(0x7f79c00d0da0 0x7f79c00d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:25.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.553+0000 7f79b7fff640 1 --1- 172.21.15.55:0/954133875 >> v1:172.21.15.110:6789/0 conn(0x7f79c00cdde0 0x7f79c00cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:47208/0 (socket says 172.21.15.55:47208) 2023-08-25T05:35:25.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.553+0000 7f79bed9d640 1 -- 172.21.15.55:0/954133875 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79c00b3e50 msgr2=0x7f79c00ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:25.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.553+0000 7f79bed9d640 1 --2- 172.21.15.55:0/954133875 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79c00b3e50 0x7f79c00ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.553+0000 7f79bed9d640 1 -- 172.21.15.55:0/954133875 >> v1:172.21.15.110:6789/0 conn(0x7f79c00cdde0 legacy=0x7f79c00cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:25.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.553+0000 7f79bed9d640 1 -- 172.21.15.55:0/954133875 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c00b1dc0 con 0x7f79c00d0da0 2023-08-25T05:35:25.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.553+0000 7f79bf59e640 1 --2- 172.21.15.55:0/954133875 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79c00b3e50 0x7f79c00ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:35:25.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.557+0000 7f79bed9d640 1 --2- 172.21.15.55:0/954133875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c00d0da0 0x7f79c00d1180 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f79b00097a0 tx=0x7f79b001ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b5d472c8464b2dc server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:25.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.557+0000 7f79be59c640 1 -- 172.21.15.55:0/954133875 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00a8950 con 0x7f79c00d0da0 2023-08-25T05:35:25.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.557+0000 7f79be59c640 1 -- 172.21.15.55:0/954133875 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b00a8ab0 con 0x7f79c00d0da0 2023-08-25T05:35:25.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.557+0000 7f79be59c640 1 -- 172.21.15.55:0/954133875 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00a8e40 con 0x7f79c00d0da0 2023-08-25T05:35:25.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.557+0000 7f79c5056640 1 -- 172.21.15.55:0/954133875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c00d0da0 msgr2=0x7f79c00d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:25.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.557+0000 7f79c5056640 1 --2- 172.21.15.55:0/954133875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c00d0da0 0x7f79c00d1180 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f79b00097a0 tx=0x7f79b001ec50 comp rx=0 tx=0).stop 2023-08-25T05:35:25.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.557+0000 7f79c5056640 1 -- 172.21.15.55:0/954133875 shutdown_connections 2023-08-25T05:35:25.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.557+0000 7f79c5056640 1 --2- 172.21.15.55:0/954133875 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79c00b3e50 0x7f79c00ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.557+0000 7f79c5056640 1 --2- 172.21.15.55:0/954133875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c00d0da0 0x7f79c00d1180 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.557+0000 7f79c5056640 1 -- 172.21.15.55:0/954133875 >> 172.21.15.55:0/954133875 conn(0x7f79c009bae0 msgr2=0x7f79c00d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:25.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.557+0000 7f79c5056640 1 -- 172.21.15.55:0/954133875 shutdown_connections 2023-08-25T05:35:25.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.557+0000 7f79c5056640 1 -- 172.21.15.55:0/954133875 wait complete. 2023-08-25T05:35:25.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79c5056640 1 Processor -- start 2023-08-25T05:35:25.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79c5056640 1 -- start start 2023-08-25T05:35:25.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79c5056640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79c00b3e50 0x7f79c00c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:25.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79c5056640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c00cdde0 0x7f79c00c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:25.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79c5056640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c00d0da0 0x7f79c01f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:25.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79c5056640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c00c9b30 con 0x7f79c00d0da0 2023-08-25T05:35:25.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79c5056640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c00c7fa0 con 0x7f79c00cdde0 2023-08-25T05:35:25.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79c5056640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c00c8280 con 0x7f79c00b3e50 2023-08-25T05:35:25.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79bf59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c00d0da0 0x7f79c01f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:25.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79bf59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c00d0da0 0x7f79c01f54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47476/0 (socket says 172.21.15.55:47476) 2023-08-25T05:35:25.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79bf59e640 1 -- 172.21.15.55:0/2702702561 learned_addr learned my addr 172.21.15.55:0/2702702561 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:25.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79bed9d640 1 --2- 172.21.15.55:0/2702702561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79c00b3e50 0x7f79c00c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:25.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79b7fff640 1 --2- 172.21.15.55:0/2702702561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c00cdde0 0x7f79c00c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:25.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79bf59e640 1 -- 172.21.15.55:0/2702702561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79c00b3e50 msgr2=0x7f79c00c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:25.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79bf59e640 1 --2- 172.21.15.55:0/2702702561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79c00b3e50 0x7f79c00c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79bf59e640 1 -- 172.21.15.55:0/2702702561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c00cdde0 msgr2=0x7f79c00c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:25.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79bf59e640 1 --2- 172.21.15.55:0/2702702561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c00cdde0 0x7f79c00c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79bf59e640 1 -- 172.21.15.55:0/2702702561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b8009b30 con 0x7f79c00d0da0 2023-08-25T05:35:25.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79bf59e640 1 --2- 172.21.15.55:0/2702702561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c00d0da0 0x7f79c01f54c0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f79b800ef90 tx=0x7f79b800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:25.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79b77fe640 1 -- 172.21.15.55:0/2702702561 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b8018070 con 0x7f79c00d0da0 2023-08-25T05:35:25.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79b77fe640 1 -- 172.21.15.55:0/2702702561 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b800f040 con 0x7f79c00d0da0 2023-08-25T05:35:25.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79c5056640 1 -- 172.21.15.55:0/2702702561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b00093b0 con 0x7f79c00d0da0 2023-08-25T05:35:25.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79b77fe640 1 -- 172.21.15.55:0/2702702561 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b800cd40 con 0x7f79c00d0da0 2023-08-25T05:35:25.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.561+0000 7f79c5056640 1 -- 172.21.15.55:0/2702702561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c00c7c10 con 0x7f79c00d0da0 2023-08-25T05:35:25.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.565+0000 7f79c5056640 1 -- 172.21.15.55:0/2702702561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c00c9890 con 0x7f79c00d0da0 2023-08-25T05:35:25.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.565+0000 7f79b77fe640 1 -- 172.21.15.55:0/2702702561 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 104) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f79b8014480 con 0x7f79c00d0da0 2023-08-25T05:35:25.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.565+0000 7f79b77fe640 1 --2- 172.21.15.55:0/2702702561 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f79a00654d0 0x7f79a0067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:25.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.565+0000 7f79b77fe640 1 -- 172.21.15.55:0/2702702561 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 7180+0+0 (secure 0 0 0) 0x7f79b8082ff0 con 0x7f79c00d0da0 2023-08-25T05:35:25.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.565+0000 7f79bed9d640 1 --2- 172.21.15.55:0/2702702561 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f79a00654d0 0x7f79a0067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:25.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.565+0000 7f79bed9d640 1 --2- 172.21.15.55:0/2702702561 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f79a00654d0 0x7f79a0067990 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f79b00b2000 tx=0x7f79b0008040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.569+0000 7f79b77fe640 1 -- 172.21.15.55:0/2702702561 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f79b80b3d90 con 0x7f79c00d0da0 2023-08-25T05:35:25.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.725+0000 7f79c5056640 1 -- 172.21.15.55:0/2702702561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79c00c9c70 con 0x7f79c00d0da0 2023-08-25T05:35:25.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.725+0000 7f79b77fe640 1 -- 172.21.15.55:0/2702702561 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+19999 (secure 0 0 0) 0x7f79c00c9c70 con 0x7f79c00d0da0 2023-08-25T05:35:25.731 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:25.731 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":176,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:35:24.116604+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:19:16.250564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-25T05:19:17.474382+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":175,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.5","mappings":[{"from":3,"to":0}]},{"pgid":"22.34","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6833/2233108903":"2023-08-26T05:35:24.116484+0000","172.21.15.110:6832/2233108903":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/519197304":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/2996229992":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/4286652448":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/186183046":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/555519094":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/4158794211":"2023-08-26T05:30:20.824468+0000","172.21.15.110:6832/758142785":"2023-08-26T05:30:20.824468+0000","172.21.15.110:6833/758142785":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/1448709432":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/2185378335":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/1252154583":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/3987879293":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/2517199041":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/2871001293":"2023-08-26T05:19:35.670048+0000","172.21.15.110:6833/221263034":"2023-08-26T05:19:35.670048+0000","172.21.15.110:6832/221263034":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/678216564":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/1492208798":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/4272437355":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/914246484":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/1432610606":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/1054752082":"2023-08-26T05:19:35.670048+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:35:25.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.729+0000 7f79c5056640 1 -- 172.21.15.55:0/2702702561 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f79a00654d0 msgr2=0x7f79a0067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:25.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.729+0000 7f79c5056640 1 --2- 172.21.15.55:0/2702702561 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f79a00654d0 0x7f79a0067990 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f79b00b2000 tx=0x7f79b0008040 comp rx=0 tx=0).stop 2023-08-25T05:35:25.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.729+0000 7f79c5056640 1 -- 172.21.15.55:0/2702702561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c00d0da0 msgr2=0x7f79c01f54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:25.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.729+0000 7f79c5056640 1 --2- 172.21.15.55:0/2702702561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c00d0da0 0x7f79c01f54c0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f79b800ef90 tx=0x7f79b800c490 comp rx=0 tx=0).stop 2023-08-25T05:35:25.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.729+0000 7f79c5056640 1 -- 172.21.15.55:0/2702702561 shutdown_connections 2023-08-25T05:35:25.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.729+0000 7f79c5056640 1 --2- 172.21.15.55:0/2702702561 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f79a00654d0 0x7f79a0067990 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.729+0000 7f79c5056640 1 --2- 172.21.15.55:0/2702702561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79c00d0da0 0x7f79c01f54c0 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.729+0000 7f79c5056640 1 --2- 172.21.15.55:0/2702702561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79c00cdde0 0x7f79c00c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.729+0000 7f79c5056640 1 --2- 172.21.15.55:0/2702702561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79c00b3e50 0x7f79c00c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.729+0000 7f79c5056640 1 -- 172.21.15.55:0/2702702561 >> 172.21.15.55:0/2702702561 conn(0x7f79c009bae0 msgr2=0x7f79c006bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:25.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.729+0000 7f79c5056640 1 -- 172.21.15.55:0/2702702561 shutdown_connections 2023-08-25T05:35:25.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.729+0000 7f79c5056640 1 -- 172.21.15.55:0/2702702561 wait complete. 2023-08-25T05:35:25.752 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-25T05:35:25.753 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:35:25.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.893+0000 7fcabb311640 1 Processor -- start 2023-08-25T05:35:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.893+0000 7fcabb311640 1 -- start start 2023-08-25T05:35:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.893+0000 7fcabb311640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcab415eba0 0x7fcab40b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.893+0000 7fcabb311640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcab40ceeb0 0x7fcab40ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.893+0000 7fcabb311640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab40ac3a0 con 0x7fcab415ef80 2023-08-25T05:35:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.893+0000 7fcabb311640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab40b1390 con 0x7fcab40ceeb0 2023-08-25T05:35:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.893+0000 7fcabb311640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab40b1670 con 0x7fcab415eba0 2023-08-25T05:35:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.893+0000 7fcab90ad640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcab415eba0 0x7fcab40b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.893+0000 7fcab90ad640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcab415eba0 0x7fcab40b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:49542/0 (socket says 172.21.15.55:49542) 2023-08-25T05:35:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.893+0000 7fcab90ad640 1 -- 172.21.15.55:0/2624721302 learned_addr learned my addr 172.21.15.55:0/2624721302 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.893+0000 7fcab88ac640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fcab415ef80 0x7fcab40ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:47214/0 (socket says 172.21.15.55:47214) 2023-08-25T05:35:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.893+0000 7fcab98ae640 1 --2- 172.21.15.55:0/2624721302 >> v2:172.21.15.110:3300/0 conn(0x7fcab40ceeb0 0x7fcab40ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:25.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.893+0000 7fcab90ad640 1 -- 172.21.15.55:0/2624721302 >> v2:172.21.15.110:3300/0 conn(0x7fcab40ceeb0 msgr2=0x7fcab40ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:25.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.893+0000 7fcab90ad640 1 --2- 172.21.15.55:0/2624721302 >> v2:172.21.15.110:3300/0 conn(0x7fcab40ceeb0 0x7fcab40ab0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.893+0000 7fcab90ad640 1 -- 172.21.15.55:0/2624721302 >> v1:172.21.15.110:6789/0 conn(0x7fcab415ef80 legacy=0x7fcab40ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:25.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.893+0000 7fcab90ad640 1 -- 172.21.15.55:0/2624721302 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab40b1950 con 0x7fcab415eba0 2023-08-25T05:35:25.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.897+0000 7fcab90ad640 1 --2- 172.21.15.55:0/2624721302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcab415eba0 0x7fcab40b2a40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcab0009870 tx=0x7fcab001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b655eae0ac22f1d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:25.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.897+0000 7fcaabfff640 1 -- 172.21.15.55:0/2624721302 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab00aa670 con 0x7fcab415eba0 2023-08-25T05:35:25.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.897+0000 7fcaabfff640 1 -- 172.21.15.55:0/2624721302 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab00aa7d0 con 0x7fcab415eba0 2023-08-25T05:35:25.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.897+0000 7fcaabfff640 1 -- 172.21.15.55:0/2624721302 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab00aab60 con 0x7fcab415eba0 2023-08-25T05:35:25.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.897+0000 7fcabb311640 1 -- 172.21.15.55:0/2624721302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcab415eba0 msgr2=0x7fcab40b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:25.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.897+0000 7fcabb311640 1 --2- 172.21.15.55:0/2624721302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcab415eba0 0x7fcab40b2a40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcab0009870 tx=0x7fcab001c510 comp rx=0 tx=0).stop 2023-08-25T05:35:25.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.897+0000 7fcabb311640 1 -- 172.21.15.55:0/2624721302 shutdown_connections 2023-08-25T05:35:25.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.897+0000 7fcabb311640 1 --2- 172.21.15.55:0/2624721302 >> v2:172.21.15.110:3300/0 conn(0x7fcab40ceeb0 0x7fcab40ab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.897+0000 7fcabb311640 1 --2- 172.21.15.55:0/2624721302 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcab415eba0 0x7fcab40b2a40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.897+0000 7fcabb311640 1 -- 172.21.15.55:0/2624721302 >> 172.21.15.55:0/2624721302 conn(0x7fcab4069d00 msgr2=0x7fcab406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:25.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.897+0000 7fcabb311640 1 -- 172.21.15.55:0/2624721302 shutdown_connections 2023-08-25T05:35:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.897+0000 7fcabb311640 1 -- 172.21.15.55:0/2624721302 wait complete. 2023-08-25T05:35:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcabb311640 1 Processor -- start 2023-08-25T05:35:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcabb311640 1 -- start start 2023-08-25T05:35:25.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcabb311640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcab40ceeb0 0x7fcab4153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:25.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcabb311640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcab415eba0 0x7fcab40c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcabb311640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcab415ef80 0x7fcab40c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcabb311640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab41554e0 con 0x7fcab40ceeb0 2023-08-25T05:35:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcabb311640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab4154300 con 0x7fcab415eba0 2023-08-25T05:35:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcabb311640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab4154860 con 0x7fcab415ef80 2023-08-25T05:35:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcab90ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcab40ceeb0 0x7fcab4153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcab90ad640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcab40ceeb0 0x7fcab4153dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47486/0 (socket says 172.21.15.55:47486) 2023-08-25T05:35:25.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcab90ad640 1 -- 172.21.15.55:0/3823894973 learned_addr learned my addr 172.21.15.55:0/3823894973 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:25.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcab98ae640 1 --2- 172.21.15.55:0/3823894973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcab415ef80 0x7fcab40c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:25.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcab88ac640 1 --2- 172.21.15.55:0/3823894973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcab415eba0 0x7fcab40c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:25.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcab90ad640 1 -- 172.21.15.55:0/3823894973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcab415ef80 msgr2=0x7fcab40c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:25.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcab90ad640 1 --2- 172.21.15.55:0/3823894973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcab415ef80 0x7fcab40c4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcab90ad640 1 -- 172.21.15.55:0/3823894973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcab415eba0 msgr2=0x7fcab40c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:25.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcab90ad640 1 --2- 172.21.15.55:0/3823894973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcab415eba0 0x7fcab40c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:25.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcab90ad640 1 -- 172.21.15.55:0/3823894973 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab00094d0 con 0x7fcab40ceeb0 2023-08-25T05:35:25.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcab90ad640 1 --2- 172.21.15.55:0/3823894973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcab40ceeb0 0x7fcab4153dc0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fcab001abc0 tx=0x7fcab001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:25.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcaa9ffb640 1 -- 172.21.15.55:0/3823894973 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab00b3800 con 0x7fcab40ceeb0 2023-08-25T05:35:25.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcaa9ffb640 1 -- 172.21.15.55:0/3823894973 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab00b3980 con 0x7fcab40ceeb0 2023-08-25T05:35:25.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcaa9ffb640 1 -- 172.21.15.55:0/3823894973 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab00b3d30 con 0x7fcab40ceeb0 2023-08-25T05:35:25.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcabb311640 1 -- 172.21.15.55:0/3823894973 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab4154b40 con 0x7fcab40ceeb0 2023-08-25T05:35:25.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.901+0000 7fcabb311640 1 -- 172.21.15.55:0/3823894973 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab4155100 con 0x7fcab40ceeb0 2023-08-25T05:35:25.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.905+0000 7fcabb311640 1 -- 172.21.15.55:0/3823894973 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab4155290 con 0x7fcab40ceeb0 2023-08-25T05:35:25.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.905+0000 7fcaa9ffb640 1 -- 172.21.15.55:0/3823894973 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 104) v1 ==== 84800+0+0 (secure 0 0 0) 0x7fcab00b2380 con 0x7fcab40ceeb0 2023-08-25T05:35:25.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.905+0000 7fcaa9ffb640 1 --2- 172.21.15.55:0/3823894973 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fca980654d0 0x7fca98067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:25.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.905+0000 7fcaa9ffb640 1 -- 172.21.15.55:0/3823894973 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 7180+0+0 (secure 0 0 0) 0x7fcab011d340 con 0x7fcab40ceeb0 2023-08-25T05:35:25.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.905+0000 7fcab88ac640 1 --2- 172.21.15.55:0/3823894973 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fca980654d0 0x7fca98067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:25.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.905+0000 7fcab88ac640 1 --2- 172.21.15.55:0/3823894973 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fca980654d0 0x7fca98067990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcab41f60c0 tx=0x7fcaa4007e50 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:25.909+0000 7fcaa9ffb640 1 -- 172.21.15.55:0/3823894973 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fcab00eacc0 con 0x7fcab40ceeb0 2023-08-25T05:35:26.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.097+0000 7fcabb311640 1 -- 172.21.15.55:0/3823894973 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcab404dbe0 con 0x7fcab40ceeb0 2023-08-25T05:35:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.097+0000 7fcaa9ffb640 1 -- 172.21.15.55:0/3823894973 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4883 (secure 0 0 0) 0x7fcab00ee2e0 con 0x7fcab40ceeb0 2023-08-25T05:35:26.102 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:26.102 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/934106390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":934106390},{"type":"v1","addr":"172.21.15.110:6836","nonce":934106390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":78},{"gid":8303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/759320040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":759320040},{"type":"v1","addr":"172.21.15.110:6837","nonce":759320040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":78},{"gid":10140,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2128942930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2128942930},{"type":"v1","addr":"172.21.15.55:6833","nonce":2128942930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:19:18.477714+0000","modified":"2023-08-25T05:19:22.105735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":10149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10149":{"gid":10149,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1451359895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1451359895},{"type":"v1","addr":"172.21.15.55:6835","nonce":1451359895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-25T05:35:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 83 2023-08-25T05:35:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.101+0000 7fcabb311640 1 -- 172.21.15.55:0/3823894973 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fca980654d0 msgr2=0x7fca98067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.101+0000 7fcabb311640 1 --2- 172.21.15.55:0/3823894973 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fca980654d0 0x7fca98067990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcab41f60c0 tx=0x7fcaa4007e50 comp rx=0 tx=0).stop 2023-08-25T05:35:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.101+0000 7fcabb311640 1 -- 172.21.15.55:0/3823894973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcab40ceeb0 msgr2=0x7fcab4153dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.101+0000 7fcabb311640 1 --2- 172.21.15.55:0/3823894973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcab40ceeb0 0x7fcab4153dc0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fcab001abc0 tx=0x7fcab001ad50 comp rx=0 tx=0).stop 2023-08-25T05:35:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.101+0000 7fcabb311640 1 -- 172.21.15.55:0/3823894973 shutdown_connections 2023-08-25T05:35:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.101+0000 7fcabb311640 1 --2- 172.21.15.55:0/3823894973 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fca980654d0 0x7fca98067990 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.101+0000 7fcabb311640 1 --2- 172.21.15.55:0/3823894973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcab415ef80 0x7fcab40c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.101+0000 7fcabb311640 1 --2- 172.21.15.55:0/3823894973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcab415eba0 0x7fcab40c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.101+0000 7fcabb311640 1 --2- 172.21.15.55:0/3823894973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcab40ceeb0 0x7fcab4153dc0 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.101+0000 7fcabb311640 1 -- 172.21.15.55:0/3823894973 >> 172.21.15.55:0/3823894973 conn(0x7fcab4069d00 msgr2=0x7fcab4157260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.101+0000 7fcabb311640 1 -- 172.21.15.55:0/3823894973 shutdown_connections 2023-08-25T05:35:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.101+0000 7fcabb311640 1 -- 172.21.15.55:0/3823894973 wait complete. 2023-08-25T05:35:26.123 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:35:26.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.269+0000 7f078c9ba640 1 Processor -- start 2023-08-25T05:35:26.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.269+0000 7f078c9ba640 1 -- start start 2023-08-25T05:35:26.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.269+0000 7f078c9ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f07880d0da0 0x7f07880d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:26.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.269+0000 7f078c9ba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f07880b3e50 0x7f07880ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:26.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.269+0000 7f078c9ba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07880b29b0 con 0x7f07880cdde0 2023-08-25T05:35:26.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.269+0000 7f078c9ba640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07880ce760 con 0x7f07880b3e50 2023-08-25T05:35:26.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.269+0000 7f078c9ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07880d16c0 con 0x7f07880d0da0 2023-08-25T05:35:26.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.269+0000 7f0786d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f07880b3e50 0x7f07880ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:26.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.269+0000 7f0786d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f07880b3e50 0x7f07880ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47490/0 (socket says 172.21.15.55:47490) 2023-08-25T05:35:26.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.269+0000 7f0786d9d640 1 -- 172.21.15.55:0/2639763801 learned_addr learned my addr 172.21.15.55:0/2639763801 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:26.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.273+0000 7f0786d9d640 1 -- 172.21.15.55:0/2639763801 >> v2:172.21.15.110:3300/0 conn(0x7f07880d0da0 msgr2=0x7f07880d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:26.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.273+0000 7f078659c640 1 --2- 172.21.15.55:0/2639763801 >> v2:172.21.15.110:3300/0 conn(0x7f07880d0da0 0x7f07880d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:26.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.273+0000 7f0786d9d640 1 --2- 172.21.15.55:0/2639763801 >> v2:172.21.15.110:3300/0 conn(0x7f07880d0da0 0x7f07880d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.273+0000 7f0786d9d640 1 -- 172.21.15.55:0/2639763801 >> v1:172.21.15.110:6789/0 conn(0x7f07880cdde0 legacy=0x7f07880cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:26.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.273+0000 7f0786d9d640 1 -- 172.21.15.55:0/2639763801 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880b1dc0 con 0x7f07880b3e50 2023-08-25T05:35:26.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.273+0000 7f078659c640 1 --2- 172.21.15.55:0/2639763801 >> v2:172.21.15.110:3300/0 conn(0x7f07880d0da0 0x7f07880d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:26.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.277+0000 7f0786d9d640 1 --2- 172.21.15.55:0/2639763801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07880b3e50 0x7f07880ce220 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f0788073720 tx=0x7f078001f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549e31e26942b05e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:26.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.277+0000 7f0785d9b640 1 -- 172.21.15.55:0/2639763801 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07800af400 con 0x7f07880b3e50 2023-08-25T05:35:26.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.277+0000 7f0785d9b640 1 -- 172.21.15.55:0/2639763801 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07800ab050 con 0x7f07880b3e50 2023-08-25T05:35:26.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.277+0000 7f0785d9b640 1 -- 172.21.15.55:0/2639763801 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07800af780 con 0x7f07880b3e50 2023-08-25T05:35:26.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.277+0000 7f078c9ba640 1 -- 172.21.15.55:0/2639763801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07880b3e50 msgr2=0x7f07880ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:26.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.277+0000 7f078c9ba640 1 --2- 172.21.15.55:0/2639763801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07880b3e50 0x7f07880ce220 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f0788073720 tx=0x7f078001f180 comp rx=0 tx=0).stop 2023-08-25T05:35:26.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.277+0000 7f078c9ba640 1 -- 172.21.15.55:0/2639763801 shutdown_connections 2023-08-25T05:35:26.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.277+0000 7f078c9ba640 1 --2- 172.21.15.55:0/2639763801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07880b3e50 0x7f07880ce220 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.277+0000 7f078c9ba640 1 --2- 172.21.15.55:0/2639763801 >> v2:172.21.15.110:3300/0 conn(0x7f07880d0da0 0x7f07880d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.277+0000 7f078c9ba640 1 -- 172.21.15.55:0/2639763801 >> 172.21.15.55:0/2639763801 conn(0x7f078809bae0 msgr2=0x7f07880d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:26.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.277+0000 7f078c9ba640 1 -- 172.21.15.55:0/2639763801 shutdown_connections 2023-08-25T05:35:26.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.277+0000 7f078c9ba640 1 -- 172.21.15.55:0/2639763801 wait complete. 2023-08-25T05:35:26.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.277+0000 7f078c9ba640 1 Processor -- start 2023-08-25T05:35:26.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.277+0000 7f078c9ba640 1 -- start start 2023-08-25T05:35:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f078c9ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07880b3e50 0x7f07880c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f078c9ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07880cdde0 0x7f07881efbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f078c9ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07880d0da0 0x7f07881f3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f078c9ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07881f4ac0 con 0x7f07880b3e50 2023-08-25T05:35:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f078c9ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07880c7a90 con 0x7f07880d0da0 2023-08-25T05:35:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f078c9ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07881f3e40 con 0x7f07880cdde0 2023-08-25T05:35:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f078659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07880b3e50 0x7f07880c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f078659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07880b3e50 0x7f07880c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47494/0 (socket says 172.21.15.55:47494) 2023-08-25T05:35:26.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f078659c640 1 -- 172.21.15.55:0/3950851613 learned_addr learned my addr 172.21.15.55:0/3950851613 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f0786d9d640 1 --2- 172.21.15.55:0/3950851613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07880d0da0 0x7f07881f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:26.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f077ffff640 1 --2- 172.21.15.55:0/3950851613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07880cdde0 0x7f07881efbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:26.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f078659c640 1 -- 172.21.15.55:0/3950851613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07880cdde0 msgr2=0x7f07881efbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:26.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f078659c640 1 --2- 172.21.15.55:0/3950851613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07880cdde0 0x7f07881efbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f078659c640 1 -- 172.21.15.55:0/3950851613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07880d0da0 msgr2=0x7f07881f3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:26.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f078659c640 1 --2- 172.21.15.55:0/3950851613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07880d0da0 0x7f07881f3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f078659c640 1 -- 172.21.15.55:0/3950851613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0780009b30 con 0x7f07880b3e50 2023-08-25T05:35:26.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f078659c640 1 --2- 172.21.15.55:0/3950851613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07880b3e50 0x7f07880c85f0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f077800c820 tx=0x7f077800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:26.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f077effd640 1 -- 172.21.15.55:0/3950851613 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0778005ba0 con 0x7f07880b3e50 2023-08-25T05:35:26.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f077effd640 1 -- 172.21.15.55:0/3950851613 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0778005d00 con 0x7f07880b3e50 2023-08-25T05:35:26.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f078c9ba640 1 -- 172.21.15.55:0/3950851613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07881f4120 con 0x7f07880b3e50 2023-08-25T05:35:26.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f077effd640 1 -- 172.21.15.55:0/3950851613 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0778007a50 con 0x7f07880b3e50 2023-08-25T05:35:26.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f078c9ba640 1 -- 172.21.15.55:0/3950851613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07881f46e0 con 0x7f07880b3e50 2023-08-25T05:35:26.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.281+0000 7f078c9ba640 1 -- 172.21.15.55:0/3950851613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078804dbe0 con 0x7f07880b3e50 2023-08-25T05:35:26.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.285+0000 7f077effd640 1 -- 172.21.15.55:0/3950851613 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f0778007bb0 con 0x7f07880b3e50 2023-08-25T05:35:26.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.285+0000 7f077effd640 1 --2- 172.21.15.55:0/3950851613 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f0768065740 0x7f0768067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:26.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.285+0000 7f077effd640 1 -- 172.21.15.55:0/3950851613 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 7180+0+0 (secure 0 0 0) 0x7f0778083330 con 0x7f07880b3e50 2023-08-25T05:35:26.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.285+0000 7f077ffff640 1 --2- 172.21.15.55:0/3950851613 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f0768065740 0x7f0768067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:26.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.285+0000 7f077ffff640 1 --2- 172.21.15.55:0/3950851613 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f0768065740 0x7f0768067c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f07880ce240 tx=0x7f0770007e40 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:26.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.289+0000 7f077effd640 1 -- 172.21.15.55:0/3950851613 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f07780508d0 con 0x7f07880b3e50 2023-08-25T05:35:26.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.477+0000 7f078c9ba640 1 -- 172.21.15.55:0/3950851613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f078806c830 con 0x7f07880b3e50 2023-08-25T05:35:26.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.481+0000 7f077effd640 1 -- 172.21.15.55:0/3950851613 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4883 (secure 0 0 0) 0x7f0778007e60 con 0x7f07880b3e50 2023-08-25T05:35:26.484 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:26.484 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/934106390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":934106390},{"type":"v1","addr":"172.21.15.110:6836","nonce":934106390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":78},{"gid":8303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/759320040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":759320040},{"type":"v1","addr":"172.21.15.110:6837","nonce":759320040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":78},{"gid":10140,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2128942930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2128942930},{"type":"v1","addr":"172.21.15.55:6833","nonce":2128942930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:19:18.477714+0000","modified":"2023-08-25T05:19:22.105735+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":10149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10149":{"gid":10149,"name":"c","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1451359895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1451359895},{"type":"v1","addr":"172.21.15.55:6835","nonce":1451359895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-08-25T05:35:26.484 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 83 2023-08-25T05:35:26.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.481+0000 7f078c9ba640 1 -- 172.21.15.55:0/3950851613 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f0768065740 msgr2=0x7f0768067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:26.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.481+0000 7f078c9ba640 1 --2- 172.21.15.55:0/3950851613 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f0768065740 0x7f0768067c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f07880ce240 tx=0x7f0770007e40 comp rx=0 tx=0).stop 2023-08-25T05:35:26.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.481+0000 7f078c9ba640 1 -- 172.21.15.55:0/3950851613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07880b3e50 msgr2=0x7f07880c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:26.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.481+0000 7f078c9ba640 1 --2- 172.21.15.55:0/3950851613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07880b3e50 0x7f07880c85f0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f077800c820 tx=0x7f077800cc20 comp rx=0 tx=0).stop 2023-08-25T05:35:26.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.481+0000 7f078c9ba640 1 -- 172.21.15.55:0/3950851613 shutdown_connections 2023-08-25T05:35:26.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.481+0000 7f078c9ba640 1 --2- 172.21.15.55:0/3950851613 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f0768065740 0x7f0768067c00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.481+0000 7f078c9ba640 1 --2- 172.21.15.55:0/3950851613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07880d0da0 0x7f07881f3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.481+0000 7f078c9ba640 1 --2- 172.21.15.55:0/3950851613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07880cdde0 0x7f07881efbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.481+0000 7f078c9ba640 1 --2- 172.21.15.55:0/3950851613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f07880b3e50 0x7f07880c85f0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.481+0000 7f078c9ba640 1 -- 172.21.15.55:0/3950851613 >> 172.21.15.55:0/3950851613 conn(0x7f078809bae0 msgr2=0x7f07880cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:26.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.481+0000 7f078c9ba640 1 -- 172.21.15.55:0/3950851613 shutdown_connections 2023-08-25T05:35:26.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.481+0000 7f078c9ba640 1 -- 172.21.15.55:0/3950851613 wait complete. 2023-08-25T05:35:26.505 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:35:26.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.645+0000 7f9145456640 1 Processor -- start 2023-08-25T05:35:26.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.645+0000 7f9145456640 1 -- start start 2023-08-25T05:35:26.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.645+0000 7f9145456640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f91400cdde0 0x7f91400ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:26.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.645+0000 7f9145456640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f91400b2e40 0x7f91400b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:26.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.645+0000 7f9145456640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91400b29b0 con 0x7f91400d0da0 2023-08-25T05:35:26.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.645+0000 7f9145456640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91400ce760 con 0x7f91400b2e40 2023-08-25T05:35:26.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.645+0000 7f9145456640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91400b1dc0 con 0x7f91400cdde0 2023-08-25T05:35:26.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.645+0000 7f913f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f91400b2e40 0x7f91400b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:26.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.645+0000 7f913effd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f91400d0da0 0x7f91400d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53654/0 (socket says 172.21.15.55:53654) 2023-08-25T05:35:26.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.645+0000 7f913effd640 1 -- 172.21.15.55:0/2350343331 learned_addr learned my addr 172.21.15.55:0/2350343331 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:26.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.645+0000 7f9137fff640 1 --2- 172.21.15.55:0/2350343331 >> v2:172.21.15.110:3300/0 conn(0x7f91400cdde0 0x7f91400ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:26.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.645+0000 7f913f7fe640 1 -- 172.21.15.55:0/2350343331 >> v2:172.21.15.110:3300/0 conn(0x7f91400cdde0 msgr2=0x7f91400ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:26.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.645+0000 7f913f7fe640 1 --2- 172.21.15.55:0/2350343331 >> v2:172.21.15.110:3300/0 conn(0x7f91400cdde0 0x7f91400ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.645+0000 7f913f7fe640 1 -- 172.21.15.55:0/2350343331 >> v1:172.21.15.55:6789/0 conn(0x7f91400d0da0 legacy=0x7f91400d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:26.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.645+0000 7f913f7fe640 1 -- 172.21.15.55:0/2350343331 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91400b2080 con 0x7f91400b2e40 2023-08-25T05:35:26.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.645+0000 7f913e7fc640 1 -- 172.21.15.55:0/2350343331 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391754813 0 0) 0x7f91400b29b0 con 0x7f91400d0da0 2023-08-25T05:35:26.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.649+0000 7f913f7fe640 1 --2- 172.21.15.55:0/2350343331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91400b2e40 0x7f91400b32b0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f91400d38c0 tx=0x7f913801f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1993ff0c204b7b01 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:26.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.649+0000 7f913e7fc640 1 -- 172.21.15.55:0/2350343331 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91380b0440 con 0x7f91400b2e40 2023-08-25T05:35:26.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.649+0000 7f913e7fc640 1 -- 172.21.15.55:0/2350343331 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91380b05a0 con 0x7f91400b2e40 2023-08-25T05:35:26.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.649+0000 7f913e7fc640 1 -- 172.21.15.55:0/2350343331 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91380b0930 con 0x7f91400b2e40 2023-08-25T05:35:26.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.649+0000 7f9145456640 1 -- 172.21.15.55:0/2350343331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91400b2e40 msgr2=0x7f91400b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:26.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.649+0000 7f9145456640 1 --2- 172.21.15.55:0/2350343331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91400b2e40 0x7f91400b32b0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f91400d38c0 tx=0x7f913801f0f0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.649+0000 7f9145456640 1 -- 172.21.15.55:0/2350343331 shutdown_connections 2023-08-25T05:35:26.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.649+0000 7f9145456640 1 --2- 172.21.15.55:0/2350343331 >> v2:172.21.15.110:3300/0 conn(0x7f91400cdde0 0x7f91400ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.649+0000 7f9145456640 1 --2- 172.21.15.55:0/2350343331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91400b2e40 0x7f91400b32b0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.649+0000 7f9145456640 1 -- 172.21.15.55:0/2350343331 >> 172.21.15.55:0/2350343331 conn(0x7f914009bae0 msgr2=0x7f91400d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:26.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.649+0000 7f9145456640 1 -- 172.21.15.55:0/2350343331 shutdown_connections 2023-08-25T05:35:26.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.649+0000 7f9145456640 1 -- 172.21.15.55:0/2350343331 wait complete. 2023-08-25T05:35:26.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f9145456640 1 Processor -- start 2023-08-25T05:35:26.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f9145456640 1 -- start start 2023-08-25T05:35:26.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f9145456640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91400b2e40 0x7f9140151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:26.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f9145456640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91400cdde0 0x7f91400ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:26.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f9145456640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91400d0da0 0x7f91400c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:26.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f9145456640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91400c7170 con 0x7f91400d0da0 2023-08-25T05:35:26.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f9145456640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91400cb5b0 con 0x7f91400cdde0 2023-08-25T05:35:26.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f9145456640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91400ca9a0 con 0x7f91400b2e40 2023-08-25T05:35:26.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f913f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91400d0da0 0x7f91400c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:26.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f913f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91400d0da0 0x7f91400c62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47518/0 (socket says 172.21.15.55:47518) 2023-08-25T05:35:26.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f913f7fe640 1 -- 172.21.15.55:0/3435899479 learned_addr learned my addr 172.21.15.55:0/3435899479 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:26.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f9137fff640 1 --2- 172.21.15.55:0/3435899479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91400cdde0 0x7f91400ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:26.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f913f7fe640 1 -- 172.21.15.55:0/3435899479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91400b2e40 msgr2=0x7f9140151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:26.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f913effd640 1 --2- 172.21.15.55:0/3435899479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91400b2e40 0x7f9140151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:26.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f913f7fe640 1 --2- 172.21.15.55:0/3435899479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91400b2e40 0x7f9140151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f913f7fe640 1 -- 172.21.15.55:0/3435899479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91400cdde0 msgr2=0x7f91400ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:26.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f913f7fe640 1 --2- 172.21.15.55:0/3435899479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91400cdde0 0x7f91400ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f913f7fe640 1 -- 172.21.15.55:0/3435899479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9138009a70 con 0x7f91400d0da0 2023-08-25T05:35:26.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f9137fff640 1 --2- 172.21.15.55:0/3435899479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91400cdde0 0x7f91400ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:26.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f913effd640 1 --2- 172.21.15.55:0/3435899479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91400b2e40 0x7f9140151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:26.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f913f7fe640 1 --2- 172.21.15.55:0/3435899479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91400d0da0 0x7f91400c62f0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f913801bd00 tx=0x7f913801be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:26.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f91377fe640 1 -- 172.21.15.55:0/3435899479 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91380b0440 con 0x7f91400d0da0 2023-08-25T05:35:26.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f91377fe640 1 -- 172.21.15.55:0/3435899479 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91380bc860 con 0x7f91400d0da0 2023-08-25T05:35:26.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f91377fe640 1 -- 172.21.15.55:0/3435899479 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91380bcc10 con 0x7f91400d0da0 2023-08-25T05:35:26.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f9145456640 1 -- 172.21.15.55:0/3435899479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91400cac80 con 0x7f91400d0da0 2023-08-25T05:35:26.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.653+0000 7f9145456640 1 -- 172.21.15.55:0/3435899479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91400cb240 con 0x7f91400d0da0 2023-08-25T05:35:26.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.657+0000 7f9145456640 1 -- 172.21.15.55:0/3435899479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914004dbe0 con 0x7f91400d0da0 2023-08-25T05:35:26.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.657+0000 7f91377fe640 1 -- 172.21.15.55:0/3435899479 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f91380c7460 con 0x7f91400d0da0 2023-08-25T05:35:26.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.657+0000 7f91377fe640 1 --2- 172.21.15.55:0/3435899479 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f9120065710 0x7f9120067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:26.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.657+0000 7f91377fe640 1 -- 172.21.15.55:0/3435899479 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 7180+0+0 (secure 0 0 0) 0x7f91381220c0 con 0x7f91400d0da0 2023-08-25T05:35:26.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.657+0000 7f913effd640 1 --2- 172.21.15.55:0/3435899479 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f9120065710 0x7f9120067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:26.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.657+0000 7f913effd640 1 --2- 172.21.15.55:0/3435899479 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f9120065710 0x7f9120067bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f91400732d0 tx=0x7f9130009040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:26.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.661+0000 7f91377fe640 1 -- 172.21.15.55:0/3435899479 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f91380ef750 con 0x7f91400d0da0 2023-08-25T05:35:26.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.821+0000 7f9145456640 1 -- 172.21.15.55:0/3435899479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91400d0b80 con 0x7f91400d0da0 2023-08-25T05:35:26.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.821+0000 7f91377fe640 1 -- 172.21.15.55:0/3435899479 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+19999 (secure 0 0 0) 0x7f9138009450 con 0x7f91400d0da0 2023-08-25T05:35:26.826 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:26.826 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":176,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:35:24.116604+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:19:16.250564+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-25T05:19:17.474382+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":175,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.5","mappings":[{"from":3,"to":0}]},{"pgid":"22.34","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6833/2233108903":"2023-08-26T05:35:24.116484+0000","172.21.15.110:6832/2233108903":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/519197304":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/2996229992":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/4286652448":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/186183046":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/555519094":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/4158794211":"2023-08-26T05:30:20.824468+0000","172.21.15.110:6832/758142785":"2023-08-26T05:30:20.824468+0000","172.21.15.110:6833/758142785":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/1448709432":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/2185378335":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/1252154583":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/3987879293":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/2517199041":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/2871001293":"2023-08-26T05:19:35.670048+0000","172.21.15.110:6833/221263034":"2023-08-26T05:19:35.670048+0000","172.21.15.110:6832/221263034":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/678216564":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/1492208798":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/4272437355":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/914246484":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/1432610606":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/1054752082":"2023-08-26T05:19:35.670048+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":22,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:35:26.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.825+0000 7f9145456640 1 -- 172.21.15.55:0/3435899479 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f9120065710 msgr2=0x7f9120067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:26.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.825+0000 7f9145456640 1 --2- 172.21.15.55:0/3435899479 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f9120065710 0x7f9120067bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f91400732d0 tx=0x7f9130009040 comp rx=0 tx=0).stop 2023-08-25T05:35:26.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.825+0000 7f9145456640 1 -- 172.21.15.55:0/3435899479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91400d0da0 msgr2=0x7f91400c62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:26.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.825+0000 7f9145456640 1 --2- 172.21.15.55:0/3435899479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91400d0da0 0x7f91400c62f0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f913801bd00 tx=0x7f913801be90 comp rx=0 tx=0).stop 2023-08-25T05:35:26.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.825+0000 7f9145456640 1 -- 172.21.15.55:0/3435899479 shutdown_connections 2023-08-25T05:35:26.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.825+0000 7f9145456640 1 --2- 172.21.15.55:0/3435899479 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f9120065710 0x7f9120067bd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.825+0000 7f9145456640 1 --2- 172.21.15.55:0/3435899479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91400d0da0 0x7f91400c62f0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.825+0000 7f9145456640 1 --2- 172.21.15.55:0/3435899479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f91400cdde0 0x7f91400ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.825+0000 7f9145456640 1 --2- 172.21.15.55:0/3435899479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f91400b2e40 0x7f9140151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:26.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.825+0000 7f9145456640 1 -- 172.21.15.55:0/3435899479 >> 172.21.15.55:0/3435899479 conn(0x7f914009bae0 msgr2=0x7f914015c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:26.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.825+0000 7f9145456640 1 -- 172.21.15.55:0/3435899479 shutdown_connections 2023-08-25T05:35:26.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:26.825+0000 7f9145456640 1 -- 172.21.15.55:0/3435899479 wait complete. 2023-08-25T05:35:26.848 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-25T05:35:27.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.001+0000 7fbba7e34640 1 Processor -- start 2023-08-25T05:35:27.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.001+0000 7fbba7e34640 1 -- start start 2023-08-25T05:35:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.005+0000 7fbba7e34640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbba015eba0 0x7fbba00b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.005+0000 7fbba7e34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbba015ef80 0x7fbba00ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.005+0000 7fbba7e34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba00ac100 con 0x7fbba00cece0 2023-08-25T05:35:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.005+0000 7fbba7e34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba00cf170 con 0x7fbba015ef80 2023-08-25T05:35:27.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.005+0000 7fbba7e34640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba00ac3a0 con 0x7fbba015eba0 2023-08-25T05:35:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.005+0000 7fbba53cf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbba015ef80 0x7fbba00ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.005+0000 7fbba53cf640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbba015ef80 0x7fbba00ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47530/0 (socket says 172.21.15.55:47530) 2023-08-25T05:35:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.005+0000 7fbba53cf640 1 -- 172.21.15.55:0/2893125806 learned_addr learned my addr 172.21.15.55:0/2893125806 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:27.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.005+0000 7fbba5bd0640 1 --2- 172.21.15.55:0/2893125806 >> v2:172.21.15.110:3300/0 conn(0x7fbba015eba0 0x7fbba00b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:27.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.005+0000 7fbba53cf640 1 -- 172.21.15.55:0/2893125806 >> v2:172.21.15.110:3300/0 conn(0x7fbba015eba0 msgr2=0x7fbba00b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:27.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.005+0000 7fbba53cf640 1 --2- 172.21.15.55:0/2893125806 >> v2:172.21.15.110:3300/0 conn(0x7fbba015eba0 0x7fbba00b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:27.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.005+0000 7fbba53cf640 1 -- 172.21.15.55:0/2893125806 >> v1:172.21.15.55:6789/0 conn(0x7fbba00cece0 legacy=0x7fbba00cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:27.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.005+0000 7fbba53cf640 1 -- 172.21.15.55:0/2893125806 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba00b1390 con 0x7fbba015ef80 2023-08-25T05:35:27.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.005+0000 7fbba5bd0640 1 --2- 172.21.15.55:0/2893125806 >> v2:172.21.15.110:3300/0 conn(0x7fbba015eba0 0x7fbba00b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:27.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.005+0000 7fbba53cf640 1 --2- 172.21.15.55:0/2893125806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba015ef80 0x7fbba00ce7a0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fbba00b4450 tx=0x7fbb9001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179cea9f1f6b88d5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:27.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba4bce640 1 -- 172.21.15.55:0/2893125806 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb900ab5f0 con 0x7fbba015ef80 2023-08-25T05:35:27.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba4bce640 1 -- 172.21.15.55:0/2893125806 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb900ab750 con 0x7fbba015ef80 2023-08-25T05:35:27.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba4bce640 1 -- 172.21.15.55:0/2893125806 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb900abae0 con 0x7fbba015ef80 2023-08-25T05:35:27.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba7e34640 1 -- 172.21.15.55:0/2893125806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba015ef80 msgr2=0x7fbba00ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:27.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba7e34640 1 --2- 172.21.15.55:0/2893125806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba015ef80 0x7fbba00ce7a0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fbba00b4450 tx=0x7fbb9001c4d0 comp rx=0 tx=0).stop 2023-08-25T05:35:27.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba7e34640 1 -- 172.21.15.55:0/2893125806 shutdown_connections 2023-08-25T05:35:27.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba7e34640 1 --2- 172.21.15.55:0/2893125806 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba015ef80 0x7fbba00ce7a0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:27.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba7e34640 1 --2- 172.21.15.55:0/2893125806 >> v2:172.21.15.110:3300/0 conn(0x7fbba015eba0 0x7fbba00b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:27.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba7e34640 1 -- 172.21.15.55:0/2893125806 >> 172.21.15.55:0/2893125806 conn(0x7fbba0069d00 msgr2=0x7fbba006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:27.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba7e34640 1 -- 172.21.15.55:0/2893125806 shutdown_connections 2023-08-25T05:35:27.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba7e34640 1 -- 172.21.15.55:0/2893125806 wait complete. 2023-08-25T05:35:27.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba7e34640 1 Processor -- start 2023-08-25T05:35:27.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba7e34640 1 -- start start 2023-08-25T05:35:27.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba7e34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbba00cece0 0x7fbba0159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:27.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba7e34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba015eba0 0x7fbba0156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:27.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba7e34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbba015ef80 0x7fbba0097850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:27.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba7e34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba00c5dc0 con 0x7fbba015eba0 2023-08-25T05:35:27.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba7e34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba0159e70 con 0x7fbba015ef80 2023-08-25T05:35:27.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.009+0000 7fbba7e34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba015a150 con 0x7fbba00cece0 2023-08-25T05:35:27.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbba53cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba015eba0 0x7fbba0156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:27.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbba53cf640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba015eba0 0x7fbba0156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47542/0 (socket says 172.21.15.55:47542) 2023-08-25T05:35:27.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbba53cf640 1 -- 172.21.15.55:0/3278303940 learned_addr learned my addr 172.21.15.55:0/3278303940 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:27.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbba5bd0640 1 --2- 172.21.15.55:0/3278303940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbba00cece0 0x7fbba0159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:27.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbba63d1640 1 --2- 172.21.15.55:0/3278303940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbba015ef80 0x7fbba0097850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:27.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbba53cf640 1 -- 172.21.15.55:0/3278303940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbba00cece0 msgr2=0x7fbba0159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:27.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbba53cf640 1 --2- 172.21.15.55:0/3278303940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbba00cece0 0x7fbba0159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:27.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbba53cf640 1 -- 172.21.15.55:0/3278303940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbba015ef80 msgr2=0x7fbba0097850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:27.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbba53cf640 1 --2- 172.21.15.55:0/3278303940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbba015ef80 0x7fbba0097850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:27.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbba53cf640 1 -- 172.21.15.55:0/3278303940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb900094d0 con 0x7fbba015eba0 2023-08-25T05:35:27.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbba63d1640 1 --2- 172.21.15.55:0/3278303940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbba015ef80 0x7fbba0097850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:27.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbba53cf640 1 --2- 172.21.15.55:0/3278303940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba015eba0 0x7fbba0156330 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fbb900ad040 tx=0x7fbb90019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:27.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbb967fc640 1 -- 172.21.15.55:0/3278303940 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb900b5810 con 0x7fbba015eba0 2023-08-25T05:35:27.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbb967fc640 1 -- 172.21.15.55:0/3278303940 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb900b5990 con 0x7fbba015eba0 2023-08-25T05:35:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbba7e34640 1 -- 172.21.15.55:0/3278303940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba015a430 con 0x7fbba015eba0 2023-08-25T05:35:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbb967fc640 1 -- 172.21.15.55:0/3278303940 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb900b5d40 con 0x7fbba015eba0 2023-08-25T05:35:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbba7e34640 1 -- 172.21.15.55:0/3278303940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba015a710 con 0x7fbba015eba0 2023-08-25T05:35:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbba7e34640 1 -- 172.21.15.55:0/3278303940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba004dbe0 con 0x7fbba015eba0 2023-08-25T05:35:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbb967fc640 1 -- 172.21.15.55:0/3278303940 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fbb900c83f0 con 0x7fbba015eba0 2023-08-25T05:35:27.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.013+0000 7fbb967fc640 1 --2- 172.21.15.55:0/3278303940 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fbb84065710 0x7fbb84067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:27.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.017+0000 7fbb967fc640 1 -- 172.21.15.55:0/3278303940 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 7180+0+0 (secure 0 0 0) 0x7fbb900a8050 con 0x7fbba015eba0 2023-08-25T05:35:27.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.017+0000 7fbba5bd0640 1 --2- 172.21.15.55:0/3278303940 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fbb84065710 0x7fbb84067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:27.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.017+0000 7fbba5bd0640 1 --2- 172.21.15.55:0/3278303940 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fbb84065710 0x7fbb84067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbba00c1810 tx=0x7fbb9c008040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:27.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.021+0000 7fbb967fc640 1 -- 172.21.15.55:0/3278303940 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbb900eb560 con 0x7fbba015eba0 2023-08-25T05:35:27.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.213+0000 7fbba7e34640 1 -- 172.21.15.55:0/3278303940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbba00ccc40 con 0x7fbba015eba0 2023-08-25T05:35:27.216 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-08-25T05:35:27.213+0000 7f7f18c38640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-25T05:35:27.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.217+0000 7fbb967fc640 1 -- 172.21.15.55:0/3278303940 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v84) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbb900eeb80 con 0x7fbba015eba0 2023-08-25T05:35:27.222 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-25T05:35:27.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.221+0000 7fbba7e34640 1 -- 172.21.15.55:0/3278303940 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fbb84065710 msgr2=0x7fbb84067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:27.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.221+0000 7fbba7e34640 1 --2- 172.21.15.55:0/3278303940 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fbb84065710 0x7fbb84067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbba00c1810 tx=0x7fbb9c008040 comp rx=0 tx=0).stop 2023-08-25T05:35:27.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.221+0000 7fbba7e34640 1 -- 172.21.15.55:0/3278303940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba015eba0 msgr2=0x7fbba0156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:27.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.221+0000 7fbba7e34640 1 --2- 172.21.15.55:0/3278303940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba015eba0 0x7fbba0156330 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fbb900ad040 tx=0x7fbb90019270 comp rx=0 tx=0).stop 2023-08-25T05:35:27.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.221+0000 7fbba7e34640 1 -- 172.21.15.55:0/3278303940 shutdown_connections 2023-08-25T05:35:27.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.221+0000 7fbba7e34640 1 --2- 172.21.15.55:0/3278303940 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fbb84065710 0x7fbb84067bd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:27.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.221+0000 7fbba7e34640 1 --2- 172.21.15.55:0/3278303940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbba015ef80 0x7fbba0097850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:27.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.221+0000 7fbba7e34640 1 --2- 172.21.15.55:0/3278303940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbba015eba0 0x7fbba0156330 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:27.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.221+0000 7fbba7e34640 1 --2- 172.21.15.55:0/3278303940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbba00cece0 0x7fbba0159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:27.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.221+0000 7fbba7e34640 1 -- 172.21.15.55:0/3278303940 >> 172.21.15.55:0/3278303940 conn(0x7fbba0069d00 msgr2=0x7fbba00af2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:27.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.221+0000 7fbba7e34640 1 -- 172.21.15.55:0/3278303940 shutdown_connections 2023-08-25T05:35:27.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.221+0000 7fbba7e34640 1 -- 172.21.15.55:0/3278303940 wait complete. 2023-08-25T05:35:27.252 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-25T05:35:27.299 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T05:35:27.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc197f10640 1 Processor -- start 2023-08-25T05:35:27.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc197f10640 1 -- start start 2023-08-25T05:35:27.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc197f10640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1900ad7b0 0x7fc19006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:27.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc197f10640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc190164b30 0x7fc1900c1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:27.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc197f10640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc190161440 con 0x7fc1900c18d0 2023-08-25T05:35:27.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc197f10640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1900c1d60 con 0x7fc190164b30 2023-08-25T05:35:27.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc197f10640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900caba0 con 0x7fc1900ad7b0 2023-08-25T05:35:27.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc1964ad640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc1900c18d0 0x7fc1900cadd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53680/0 (socket says 172.21.15.55:53680) 2023-08-25T05:35:27.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc1964ad640 1 -- 172.21.15.55:0/3128413470 learned_addr learned my addr 172.21.15.55:0/3128413470 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:27.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc1954ab640 1 --2- 172.21.15.55:0/3128413470 >> v2:172.21.15.110:3300/0 conn(0x7fc190164b30 0x7fc1900c1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:27.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc195cac640 1 --2- 172.21.15.55:0/3128413470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1900ad7b0 0x7fc19006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:27.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc194caa640 1 -- 172.21.15.55:0/3128413470 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761307239 0 0) 0x7fc190161440 con 0x7fc1900c18d0 2023-08-25T05:35:27.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc194caa640 1 -- 172.21.15.55:0/3128413470 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc17c003530 con 0x7fc1900c18d0 2023-08-25T05:35:27.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc1954ab640 1 -- 172.21.15.55:0/3128413470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1900ad7b0 msgr2=0x7fc19006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:27.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc1954ab640 1 --2- 172.21.15.55:0/3128413470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1900ad7b0 0x7fc19006c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:27.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc1954ab640 1 -- 172.21.15.55:0/3128413470 >> v1:172.21.15.55:6789/0 conn(0x7fc1900c18d0 legacy=0x7fc1900cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:27.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc194caa640 1 -- 172.21.15.55:0/3128413470 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4261198217 0 0) 0x7fc17c003530 con 0x7fc1900c18d0 2023-08-25T05:35:27.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc1954ab640 1 -- 172.21.15.55:0/3128413470 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19006cb20 con 0x7fc190164b30 2023-08-25T05:35:27.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.401+0000 7fc195cac640 1 --2- 172.21.15.55:0/3128413470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1900ad7b0 0x7fc19006c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:35:27.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.405+0000 7fc1954ab640 1 --2- 172.21.15.55:0/3128413470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc190164b30 0x7fc1900c1390 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc1800097c0 tx=0x7fc18001eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e64e6d34b4912d0c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:27.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.405+0000 7fc194caa640 1 -- 172.21.15.55:0/3128413470 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc188001a00 con 0x7fc190164b30 2023-08-25T05:35:27.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.405+0000 7fc194caa640 1 -- 172.21.15.55:0/3128413470 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1800a85d0 con 0x7fc190164b30 2023-08-25T05:35:27.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.405+0000 7fc194caa640 1 -- 172.21.15.55:0/3128413470 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1800a8960 con 0x7fc190164b30 2023-08-25T05:35:27.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.405+0000 7fc197f10640 1 -- 172.21.15.55:0/3128413470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc190164b30 msgr2=0x7fc1900c1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:27.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.405+0000 7fc197f10640 1 --2- 172.21.15.55:0/3128413470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc190164b30 0x7fc1900c1390 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc1800097c0 tx=0x7fc18001eb90 comp rx=0 tx=0).stop 2023-08-25T05:35:27.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.405+0000 7fc197f10640 1 -- 172.21.15.55:0/3128413470 shutdown_connections 2023-08-25T05:35:27.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.405+0000 7fc197f10640 1 --2- 172.21.15.55:0/3128413470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc190164b30 0x7fc1900c1390 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:27.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.405+0000 7fc197f10640 1 --2- 172.21.15.55:0/3128413470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1900ad7b0 0x7fc19006c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:27.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.405+0000 7fc197f10640 1 -- 172.21.15.55:0/3128413470 >> 172.21.15.55:0/3128413470 conn(0x7fc190069900 msgr2=0x7fc190069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:27.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.405+0000 7fc197f10640 1 -- 172.21.15.55:0/3128413470 shutdown_connections 2023-08-25T05:35:27.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.405+0000 7fc197f10640 1 -- 172.21.15.55:0/3128413470 wait complete. 2023-08-25T05:35:27.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc197f10640 1 Processor -- start 2023-08-25T05:35:27.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc197f10640 1 -- start start 2023-08-25T05:35:27.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc197f10640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1900ad7b0 0x7fc1900aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:27.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc197f10640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1900c18d0 0x7fc19015ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:27.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc197f10640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190164b30 0x7fc1900c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:27.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc197f10640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900b0a00 con 0x7fc1900ad7b0 2023-08-25T05:35:27.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc197f10640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900aefc0 con 0x7fc1900c18d0 2023-08-25T05:35:27.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc197f10640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc190160460 con 0x7fc190164b30 2023-08-25T05:35:27.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc195cac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1900ad7b0 0x7fc1900aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:27.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc195cac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1900ad7b0 0x7fc1900aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47572/0 (socket says 172.21.15.55:47572) 2023-08-25T05:35:27.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc195cac640 1 -- 172.21.15.55:0/3084166224 learned_addr learned my addr 172.21.15.55:0/3084166224 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:27.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc1954ab640 1 --2- 172.21.15.55:0/3084166224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1900c18d0 0x7fc19015ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:27.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc1964ad640 1 --2- 172.21.15.55:0/3084166224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190164b30 0x7fc1900c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:27.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc195cac640 1 -- 172.21.15.55:0/3084166224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190164b30 msgr2=0x7fc1900c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:27.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc195cac640 1 --2- 172.21.15.55:0/3084166224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190164b30 0x7fc1900c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:27.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc195cac640 1 -- 172.21.15.55:0/3084166224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1900c18d0 msgr2=0x7fc19015ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:27.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc195cac640 1 --2- 172.21.15.55:0/3084166224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1900c18d0 0x7fc19015ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:27.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc195cac640 1 -- 172.21.15.55:0/3084166224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c0093b0 con 0x7fc1900ad7b0 2023-08-25T05:35:27.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc195cac640 1 --2- 172.21.15.55:0/3084166224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1900ad7b0 0x7fc1900aea80 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00e960 tx=0x7fc18c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:27.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc1867fc640 1 -- 172.21.15.55:0/3084166224 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c00ca00 con 0x7fc1900ad7b0 2023-08-25T05:35:27.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc1867fc640 1 -- 172.21.15.55:0/3084166224 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18c00cb60 con 0x7fc1900ad7b0 2023-08-25T05:35:27.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc1867fc640 1 -- 172.21.15.55:0/3084166224 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18c0059a0 con 0x7fc1900ad7b0 2023-08-25T05:35:27.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc197f10640 1 -- 172.21.15.55:0/3084166224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc180009420 con 0x7fc1900ad7b0 2023-08-25T05:35:27.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.409+0000 7fc197f10640 1 -- 172.21.15.55:0/3084166224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1900c7180 con 0x7fc1900ad7b0 2023-08-25T05:35:27.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.413+0000 7fc197f10640 1 -- 172.21.15.55:0/3084166224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc190073ec0 con 0x7fc1900ad7b0 2023-08-25T05:35:27.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.413+0000 7fc1867fc640 1 -- 172.21.15.55:0/3084166224 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 105) v1 ==== 85008+0+0 (secure 0 0 0) 0x7fc18c005b00 con 0x7fc1900ad7b0 2023-08-25T05:35:27.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.413+0000 7fc1867fc640 1 --2- 172.21.15.55:0/3084166224 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fc174065710 0x7fc174067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:27.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.413+0000 7fc1867fc640 1 -- 172.21.15.55:0/3084166224 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fc18c0836c0 con 0x7fc1900ad7b0 2023-08-25T05:35:27.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.413+0000 7fc1954ab640 1 --2- 172.21.15.55:0/3084166224 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fc174065710 0x7fc174067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:27.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.413+0000 7fc1954ab640 1 --2- 172.21.15.55:0/3084166224 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fc174065710 0x7fc174067bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc1800b2000 tx=0x7fc180008040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:27.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.417+0000 7fc1867fc640 1 -- 172.21.15.55:0/3084166224 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc18c050d30 con 0x7fc1900ad7b0 2023-08-25T05:35:27.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:27.605+0000 7fc197f10640 1 -- 172.21.15.55:0/3084166224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc19006be10 con 0x7fc1900ad7b0 2023-08-25T05:35:28.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.277+0000 7fc1867fc640 1 -- 172.21.15.55:0/3084166224 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v85) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc18c054350 con 0x7fc1900ad7b0 2023-08-25T05:35:28.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.281+0000 7fc197f10640 1 -- 172.21.15.55:0/3084166224 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fc174065710 msgr2=0x7fc174067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:28.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.281+0000 7fc197f10640 1 --2- 172.21.15.55:0/3084166224 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fc174065710 0x7fc174067bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc1800b2000 tx=0x7fc180008040 comp rx=0 tx=0).stop 2023-08-25T05:35:28.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.281+0000 7fc197f10640 1 -- 172.21.15.55:0/3084166224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1900ad7b0 msgr2=0x7fc1900aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:28.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.281+0000 7fc197f10640 1 --2- 172.21.15.55:0/3084166224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1900ad7b0 0x7fc1900aea80 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fc18c00e960 tx=0x7fc18c00ee20 comp rx=0 tx=0).stop 2023-08-25T05:35:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.281+0000 7fc197f10640 1 -- 172.21.15.55:0/3084166224 shutdown_connections 2023-08-25T05:35:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.281+0000 7fc197f10640 1 --2- 172.21.15.55:0/3084166224 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fc174065710 0x7fc174067bd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.281+0000 7fc197f10640 1 --2- 172.21.15.55:0/3084166224 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc190164b30 0x7fc1900c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.281+0000 7fc197f10640 1 --2- 172.21.15.55:0/3084166224 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1900c18d0 0x7fc19015ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.281+0000 7fc197f10640 1 --2- 172.21.15.55:0/3084166224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1900ad7b0 0x7fc1900aea80 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:28.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.281+0000 7fc197f10640 1 -- 172.21.15.55:0/3084166224 >> 172.21.15.55:0/3084166224 conn(0x7fc190069900 msgr2=0x7fc1900b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:28.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.281+0000 7fc197f10640 1 -- 172.21.15.55:0/3084166224 shutdown_connections 2023-08-25T05:35:28.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.281+0000 7fc197f10640 1 -- 172.21.15.55:0/3084166224 wait complete. 2023-08-25T05:35:28.312 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-25T05:35:28.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.505+0000 7f87e6bba640 1 Processor -- start 2023-08-25T05:35:28.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.505+0000 7f87e6bba640 1 -- start start 2023-08-25T05:35:28.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.505+0000 7f87e6bba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87e00cd040 0x7f87e00cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.505+0000 7f87e6bba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e00c9270 con 0x7f87e0159d00 2023-08-25T05:35:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.505+0000 7f87e6bba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e00ce220 con 0x7f87e006fb50 2023-08-25T05:35:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.505+0000 7f87e6bba640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e00cc510 con 0x7f87e00cd040 2023-08-25T05:35:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.505+0000 7f87e4956640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f87e0159d00 0x7f87e00c8b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53692/0 (socket says 172.21.15.55:53692) 2023-08-25T05:35:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.505+0000 7f87e4956640 1 -- 172.21.15.55:0/2620754588 learned_addr learned my addr 172.21.15.55:0/2620754588 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:28.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.505+0000 7f87e5157640 1 --2- 172.21.15.55:0/2620754588 >> v2:172.21.15.55:3300/0 conn(0x7f87e00cd040 0x7f87e00cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.505+0000 7f87e5157640 1 -- 172.21.15.55:0/2620754588 >> v1:172.21.15.110:6789/0 conn(0x7f87e006fb50 legacy=0x7f87e00cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.505+0000 7f87e5157640 1 -- 172.21.15.55:0/2620754588 >> v1:172.21.15.55:6789/0 conn(0x7f87e0159d00 legacy=0x7f87e00c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:28.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.505+0000 7f87e5157640 1 -- 172.21.15.55:0/2620754588 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e00ca6c0 con 0x7f87e00cd040 2023-08-25T05:35:28.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.505+0000 7f87df7fe640 1 -- 172.21.15.55:0/2620754588 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135448216 0 0) 0x7f87e00c9270 con 0x7f87e0159d00 2023-08-25T05:35:28.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.509+0000 7f87e5157640 1 --2- 172.21.15.55:0/2620754588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e00cd040 0x7f87e00cdc40 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009d90 tx=0x7f87d801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901342a880afdd89 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:28.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.509+0000 7f87df7fe640 1 -- 172.21.15.55:0/2620754588 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d80a5910 con 0x7f87e00cd040 2023-08-25T05:35:28.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.509+0000 7f87df7fe640 1 -- 172.21.15.55:0/2620754588 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d80a5a70 con 0x7f87e00cd040 2023-08-25T05:35:28.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.509+0000 7f87df7fe640 1 -- 172.21.15.55:0/2620754588 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d80a5e00 con 0x7f87e00cd040 2023-08-25T05:35:28.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.509+0000 7f87e6bba640 1 -- 172.21.15.55:0/2620754588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e00cd040 msgr2=0x7f87e00cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:28.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.509+0000 7f87e6bba640 1 --2- 172.21.15.55:0/2620754588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e00cd040 0x7f87e00cdc40 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009d90 tx=0x7f87d801c850 comp rx=0 tx=0).stop 2023-08-25T05:35:28.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.509+0000 7f87e6bba640 1 -- 172.21.15.55:0/2620754588 shutdown_connections 2023-08-25T05:35:28.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.509+0000 7f87e6bba640 1 --2- 172.21.15.55:0/2620754588 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e00cd040 0x7f87e00cdc40 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:28.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.509+0000 7f87e6bba640 1 -- 172.21.15.55:0/2620754588 >> 172.21.15.55:0/2620754588 conn(0x7f87e00caf90 msgr2=0x7f87e00cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:28.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.509+0000 7f87e6bba640 1 -- 172.21.15.55:0/2620754588 shutdown_connections 2023-08-25T05:35:28.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.509+0000 7f87e6bba640 1 -- 172.21.15.55:0/2620754588 wait complete. 2023-08-25T05:35:28.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.509+0000 7f87e6bba640 1 Processor -- start 2023-08-25T05:35:28.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.509+0000 7f87e6bba640 1 -- start start 2023-08-25T05:35:28.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87e6bba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87e006fb50 0x7f87e00c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:28.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87e6bba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e00cd040 0x7f87e00c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:28.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87e6bba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87e0159d00 0x7f87e0156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:28.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87e6bba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e00c2500 con 0x7f87e00cd040 2023-08-25T05:35:28.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87e6bba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e0156a60 con 0x7f87e006fb50 2023-08-25T05:35:28.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87e6bba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e00c27a0 con 0x7f87e0159d00 2023-08-25T05:35:28.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e00cd040 0x7f87e00c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:28.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87dffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e00cd040 0x7f87e00c1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47592/0 (socket says 172.21.15.55:47592) 2023-08-25T05:35:28.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87dffff640 1 -- 172.21.15.55:0/1225384893 learned_addr learned my addr 172.21.15.55:0/1225384893 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:28.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87e5157640 1 --2- 172.21.15.55:0/1225384893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87e0159d00 0x7f87e0156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:28.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87e4956640 1 --2- 172.21.15.55:0/1225384893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87e006fb50 0x7f87e00c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:28.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87dffff640 1 -- 172.21.15.55:0/1225384893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87e0159d00 msgr2=0x7f87e0156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:28.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87dffff640 1 --2- 172.21.15.55:0/1225384893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87e0159d00 0x7f87e0156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:28.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87dffff640 1 -- 172.21.15.55:0/1225384893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87e006fb50 msgr2=0x7f87e00c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:28.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87dffff640 1 --2- 172.21.15.55:0/1225384893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87e006fb50 0x7f87e00c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:28.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87dffff640 1 -- 172.21.15.55:0/1225384893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d8009a70 con 0x7f87e00cd040 2023-08-25T05:35:28.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87e4956640 1 --2- 172.21.15.55:0/1225384893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87e006fb50 0x7f87e00c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:28.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87dffff640 1 --2- 172.21.15.55:0/1225384893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e00cd040 0x7f87e00c1fc0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f87cc00c450 tx=0x7f87cc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:28.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87dd7fa640 1 -- 172.21.15.55:0/1225384893 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc012830 con 0x7f87e00cd040 2023-08-25T05:35:28.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87dd7fa640 1 -- 172.21.15.55:0/1225384893 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87cc0129b0 con 0x7f87e00cd040 2023-08-25T05:35:28.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87dd7fa640 1 -- 172.21.15.55:0/1225384893 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc012d60 con 0x7f87e00cd040 2023-08-25T05:35:28.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87e6bba640 1 -- 172.21.15.55:0/1225384893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e00c2a80 con 0x7f87e00cd040 2023-08-25T05:35:28.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87e6bba640 1 -- 172.21.15.55:0/1225384893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e00c3040 con 0x7f87e00cd040 2023-08-25T05:35:28.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.513+0000 7f87e6bba640 1 -- 172.21.15.55:0/1225384893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e00cce40 con 0x7f87e00cd040 2023-08-25T05:35:28.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.517+0000 7f87dd7fa640 1 -- 172.21.15.55:0/1225384893 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f87cc01c460 con 0x7f87e00cd040 2023-08-25T05:35:28.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.517+0000 7f87dd7fa640 1 --2- 172.21.15.55:0/1225384893 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f87c40657a0 0x7f87c4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:28.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.517+0000 7f87dd7fa640 1 -- 172.21.15.55:0/1225384893 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f87cc083250 con 0x7f87e00cd040 2023-08-25T05:35:28.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.517+0000 7f87e4956640 1 --2- 172.21.15.55:0/1225384893 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f87c40657a0 0x7f87c4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:28.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.517+0000 7f87e4956640 1 --2- 172.21.15.55:0/1225384893 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f87c40657a0 0x7f87c4067c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f87d4000f70 tx=0x7f87d4007cb0 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:28.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.521+0000 7f87dd7fa640 1 -- 172.21.15.55:0/1225384893 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f87cc0506c0 con 0x7f87e00cd040 2023-08-25T05:35:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:28.677+0000 7f87e6bba640 1 -- 172.21.15.55:0/1225384893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f87e00ad6a0 con 0x7f87e00cd040 2023-08-25T05:35:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.297+0000 7f87dd7fa640 1 -- 172.21.15.55:0/1225384893 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v179) v1 ==== 181+0+0 (secure 0 0 0) 0x7f87cc053ce0 con 0x7f87e00cd040 2023-08-25T05:35:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-08-25T05:35:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.301+0000 7f87e6bba640 1 -- 172.21.15.55:0/1225384893 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f87c40657a0 msgr2=0x7f87c4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:29.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.301+0000 7f87e6bba640 1 --2- 172.21.15.55:0/1225384893 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f87c40657a0 0x7f87c4067c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f87d4000f70 tx=0x7f87d4007cb0 comp rx=0 tx=0).stop 2023-08-25T05:35:29.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.301+0000 7f87e6bba640 1 -- 172.21.15.55:0/1225384893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e00cd040 msgr2=0x7f87e00c1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:29.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.301+0000 7f87e6bba640 1 --2- 172.21.15.55:0/1225384893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e00cd040 0x7f87e00c1fc0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f87cc00c450 tx=0x7f87cc00c910 comp rx=0 tx=0).stop 2023-08-25T05:35:29.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.301+0000 7f87e6bba640 1 -- 172.21.15.55:0/1225384893 shutdown_connections 2023-08-25T05:35:29.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.301+0000 7f87e6bba640 1 --2- 172.21.15.55:0/1225384893 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f87c40657a0 0x7f87c4067c60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:29.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.301+0000 7f87e6bba640 1 --2- 172.21.15.55:0/1225384893 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87e0159d00 0x7f87e0156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:29.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.301+0000 7f87e6bba640 1 --2- 172.21.15.55:0/1225384893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e00cd040 0x7f87e00c1fc0 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:29.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.301+0000 7f87e6bba640 1 --2- 172.21.15.55:0/1225384893 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87e006fb50 0x7f87e00c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:29.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.301+0000 7f87e6bba640 1 -- 172.21.15.55:0/1225384893 >> 172.21.15.55:0/1225384893 conn(0x7f87e00caf90 msgr2=0x7f87e00cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:29.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.301+0000 7f87e6bba640 1 -- 172.21.15.55:0/1225384893 shutdown_connections 2023-08-25T05:35:29.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.301+0000 7f87e6bba640 1 -- 172.21.15.55:0/1225384893 wait complete. 2023-08-25T05:35:29.326 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-25T05:35:29.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.469+0000 7f1bef9ba640 1 Processor -- start 2023-08-25T05:35:29.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.469+0000 7f1bef9ba640 1 -- start start 2023-08-25T05:35:29.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.473+0000 7f1bef9ba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1be8155740 0x7f1be815c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:29.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.473+0000 7f1bef9ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1be806fb50 0x7f1be80aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:29.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.473+0000 7f1bef9ba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be815fa50 con 0x7f1be8155360 2023-08-25T05:35:29.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.473+0000 7f1bef9ba640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be815f2a0 con 0x7f1be8155740 2023-08-25T05:35:29.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.473+0000 7f1bef9ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be815f490 con 0x7f1be806fb50 2023-08-25T05:35:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.473+0000 7f1becf55640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1be8155740 0x7f1be815c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.473+0000 7f1becf55640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1be8155740 0x7f1be815c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47606/0 (socket says 172.21.15.55:47606) 2023-08-25T05:35:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.473+0000 7f1becf55640 1 -- 172.21.15.55:0/514478434 learned_addr learned my addr 172.21.15.55:0/514478434 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.473+0000 7f1bedf57640 1 --2- 172.21.15.55:0/514478434 >> v2:172.21.15.110:3300/0 conn(0x7f1be806fb50 0x7f1be80aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.473+0000 7f1becf55640 1 -- 172.21.15.55:0/514478434 >> v2:172.21.15.110:3300/0 conn(0x7f1be806fb50 msgr2=0x7f1be80aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.473+0000 7f1becf55640 1 --2- 172.21.15.55:0/514478434 >> v2:172.21.15.110:3300/0 conn(0x7f1be806fb50 0x7f1be80aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.473+0000 7f1becf55640 1 -- 172.21.15.55:0/514478434 >> v1:172.21.15.110:6789/0 conn(0x7f1be8155360 legacy=0x7f1be815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.473+0000 7f1becf55640 1 -- 172.21.15.55:0/514478434 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be815f770 con 0x7f1be8155740 2023-08-25T05:35:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.477+0000 7f1becf55640 1 --2- 172.21.15.55:0/514478434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1be8155740 0x7f1be815c180 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f1be81590d0 tx=0x7f1bd801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207ec1b7c1c58a2c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.477+0000 7f1bdffff640 1 -- 172.21.15.55:0/514478434 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80ab600 con 0x7f1be8155740 2023-08-25T05:35:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.477+0000 7f1bdffff640 1 -- 172.21.15.55:0/514478434 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd80a7050 con 0x7f1be8155740 2023-08-25T05:35:29.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.477+0000 7f1bdffff640 1 -- 172.21.15.55:0/514478434 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd80ab980 con 0x7f1be8155740 2023-08-25T05:35:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.477+0000 7f1bef9ba640 1 -- 172.21.15.55:0/514478434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1be8155740 msgr2=0x7f1be815c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.477+0000 7f1bef9ba640 1 --2- 172.21.15.55:0/514478434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1be8155740 0x7f1be815c180 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f1be81590d0 tx=0x7f1bd801c3e0 comp rx=0 tx=0).stop 2023-08-25T05:35:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.477+0000 7f1bef9ba640 1 -- 172.21.15.55:0/514478434 shutdown_connections 2023-08-25T05:35:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.477+0000 7f1bef9ba640 1 --2- 172.21.15.55:0/514478434 >> v2:172.21.15.110:3300/0 conn(0x7f1be806fb50 0x7f1be80aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:29.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.477+0000 7f1bef9ba640 1 --2- 172.21.15.55:0/514478434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1be8155740 0x7f1be815c180 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.477+0000 7f1bef9ba640 1 -- 172.21.15.55:0/514478434 >> 172.21.15.55:0/514478434 conn(0x7f1be80caf90 msgr2=0x7f1be80cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.477+0000 7f1bef9ba640 1 -- 172.21.15.55:0/514478434 shutdown_connections 2023-08-25T05:35:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.477+0000 7f1bef9ba640 1 -- 172.21.15.55:0/514478434 wait complete. 2023-08-25T05:35:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.477+0000 7f1bef9ba640 1 Processor -- start 2023-08-25T05:35:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.477+0000 7f1bef9ba640 1 -- start start 2023-08-25T05:35:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bef9ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1be806fb50 0x7f1be8157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bef9ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1be8155360 0x7f1be80b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bef9ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1be8155740 0x7f1be80b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bef9ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be815a7f0 con 0x7f1be806fb50 2023-08-25T05:35:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bef9ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be815aa00 con 0x7f1be8155360 2023-08-25T05:35:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bef9ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be815ace0 con 0x7f1be8155740 2023-08-25T05:35:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bed756640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1be806fb50 0x7f1be8157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bed756640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1be806fb50 0x7f1be8157a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47608/0 (socket says 172.21.15.55:47608) 2023-08-25T05:35:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bed756640 1 -- 172.21.15.55:0/277800241 learned_addr learned my addr 172.21.15.55:0/277800241 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1becf55640 1 --2- 172.21.15.55:0/277800241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1be8155360 0x7f1be80b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bed756640 1 -- 172.21.15.55:0/277800241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1be8155740 msgr2=0x7f1be80b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bedf57640 1 --2- 172.21.15.55:0/277800241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1be8155740 0x7f1be80b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bed756640 1 --2- 172.21.15.55:0/277800241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1be8155740 0x7f1be80b21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bed756640 1 -- 172.21.15.55:0/277800241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1be8155360 msgr2=0x7f1be80b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:29.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bed756640 1 --2- 172.21.15.55:0/277800241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1be8155360 0x7f1be80b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bed756640 1 -- 172.21.15.55:0/277800241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd80094d0 con 0x7f1be806fb50 2023-08-25T05:35:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1becf55640 1 --2- 172.21.15.55:0/277800241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1be8155360 0x7f1be80b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bedf57640 1 --2- 172.21.15.55:0/277800241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1be8155740 0x7f1be80b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bed756640 1 --2- 172.21.15.55:0/277800241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1be806fb50 0x7f1be8157a70 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f1be400c500 tx=0x7f1be400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bddffb640 1 -- 172.21.15.55:0/277800241 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be4005220 con 0x7f1be806fb50 2023-08-25T05:35:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bddffb640 1 -- 172.21.15.55:0/277800241 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be4005380 con 0x7f1be806fb50 2023-08-25T05:35:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bef9ba640 1 -- 172.21.15.55:0/277800241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be815afc0 con 0x7f1be806fb50 2023-08-25T05:35:29.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bddffb640 1 -- 172.21.15.55:0/277800241 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be4007270 con 0x7f1be806fb50 2023-08-25T05:35:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bef9ba640 1 -- 172.21.15.55:0/277800241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be8157fb0 con 0x7f1be806fb50 2023-08-25T05:35:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.481+0000 7f1bef9ba640 1 -- 172.21.15.55:0/277800241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be804dbe0 con 0x7f1be806fb50 2023-08-25T05:35:29.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.485+0000 7f1bddffb640 1 -- 172.21.15.55:0/277800241 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f1be40073d0 con 0x7f1be806fb50 2023-08-25T05:35:29.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.485+0000 7f1bddffb640 1 --2- 172.21.15.55:0/277800241 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f1bcc0657a0 0x7f1bcc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:29.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.485+0000 7f1bddffb640 1 -- 172.21.15.55:0/277800241 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6800+0+0 (secure 0 0 0) 0x7f1be4082b60 con 0x7f1be806fb50 2023-08-25T05:35:29.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.485+0000 7f1becf55640 1 --2- 172.21.15.55:0/277800241 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f1bcc0657a0 0x7f1bcc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:29.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.485+0000 7f1becf55640 1 --2- 172.21.15.55:0/277800241 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f1bcc0657a0 0x7f1bcc067c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80ad000 tx=0x7f1bd80a6000 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:29.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.489+0000 7f1bddffb640 1 -- 172.21.15.55:0/277800241 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1be4050240 con 0x7f1be806fb50 2023-08-25T05:35:29.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:29.645+0000 7f1bef9ba640 1 -- 172.21.15.55:0/277800241 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1be80cc5c0 con 0x7f1be806fb50 2023-08-25T05:35:30.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.309+0000 7f1bddffb640 1 -- 172.21.15.55:0/277800241 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v180) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1be4053860 con 0x7f1be806fb50 2023-08-25T05:35:30.315 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-08-25T05:35:30.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.313+0000 7f1bef9ba640 1 -- 172.21.15.55:0/277800241 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f1bcc0657a0 msgr2=0x7f1bcc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:30.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.313+0000 7f1bef9ba640 1 --2- 172.21.15.55:0/277800241 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f1bcc0657a0 0x7f1bcc067c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80ad000 tx=0x7f1bd80a6000 comp rx=0 tx=0).stop 2023-08-25T05:35:30.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.313+0000 7f1bef9ba640 1 -- 172.21.15.55:0/277800241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1be806fb50 msgr2=0x7f1be8157a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:30.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.313+0000 7f1bef9ba640 1 --2- 172.21.15.55:0/277800241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1be806fb50 0x7f1be8157a70 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f1be400c500 tx=0x7f1be400c9c0 comp rx=0 tx=0).stop 2023-08-25T05:35:30.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.313+0000 7f1bef9ba640 1 -- 172.21.15.55:0/277800241 shutdown_connections 2023-08-25T05:35:30.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.313+0000 7f1bef9ba640 1 --2- 172.21.15.55:0/277800241 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f1bcc0657a0 0x7f1bcc067c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:30.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.313+0000 7f1bef9ba640 1 --2- 172.21.15.55:0/277800241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1be8155740 0x7f1be80b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:30.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.313+0000 7f1bef9ba640 1 --2- 172.21.15.55:0/277800241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1be8155360 0x7f1be80b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:30.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.313+0000 7f1bef9ba640 1 --2- 172.21.15.55:0/277800241 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1be806fb50 0x7f1be8157a70 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:30.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.313+0000 7f1bef9ba640 1 -- 172.21.15.55:0/277800241 >> 172.21.15.55:0/277800241 conn(0x7f1be80caf90 msgr2=0x7f1be80b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:30.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.313+0000 7f1bef9ba640 1 -- 172.21.15.55:0/277800241 shutdown_connections 2023-08-25T05:35:30.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.313+0000 7f1bef9ba640 1 -- 172.21.15.55:0/277800241 wait complete. 2023-08-25T05:35:30.342 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-08-25T05:35:30.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.485+0000 7f0b039d2640 1 Processor -- start 2023-08-25T05:35:30.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.485+0000 7f0b039d2640 1 -- start start 2023-08-25T05:35:30.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.489+0000 7f0b039d2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0afc06e5a0 0x7f0afc0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:30.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.489+0000 7f0b039d2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc0cab90 con 0x7f0afc06c3b0 2023-08-25T05:35:30.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.489+0000 7f0b039d2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc06dbb0 con 0x7f0afc06c790 2023-08-25T05:35:30.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.489+0000 7f0b039d2640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0afc0cae50 con 0x7f0afc06e5a0 2023-08-25T05:35:30.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.489+0000 7f0b00f6d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0afc06e5a0 0x7f0afc0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:30.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.489+0000 7f0b0176e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0afc06c3b0 0x7f0afc06de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53704/0 (socket says 172.21.15.55:53704) 2023-08-25T05:35:30.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.489+0000 7f0b0176e640 1 -- 172.21.15.55:0/4210380047 learned_addr learned my addr 172.21.15.55:0/4210380047 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:30.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.489+0000 7f0b00f6d640 1 -- 172.21.15.55:0/4210380047 >> v1:172.21.15.110:6789/0 conn(0x7f0afc06c790 legacy=0x7f0afc0ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:30.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.489+0000 7f0b00f6d640 1 -- 172.21.15.55:0/4210380047 >> v1:172.21.15.55:6789/0 conn(0x7f0afc06c3b0 legacy=0x7f0afc06de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:30.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.489+0000 7f0b00f6d640 1 -- 172.21.15.55:0/4210380047 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc0cb130 con 0x7f0afc06e5a0 2023-08-25T05:35:30.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.489+0000 7f0af3fff640 1 -- 172.21.15.55:0/4210380047 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571176789 0 0) 0x7f0afc0cab90 con 0x7f0afc06c3b0 2023-08-25T05:35:30.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0b00f6d640 1 --2- 172.21.15.55:0/4210380047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0afc06e5a0 0x7f0afc0cd7d0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0097c0 tx=0x7f0aec01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6650f046fed4c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:30.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0af3fff640 1 -- 172.21.15.55:0/4210380047 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0a7070 con 0x7f0afc06e5a0 2023-08-25T05:35:30.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0af3fff640 1 -- 172.21.15.55:0/4210380047 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aec0ab430 con 0x7f0afc06e5a0 2023-08-25T05:35:30.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0af3fff640 1 -- 172.21.15.55:0/4210380047 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0ab7c0 con 0x7f0afc06e5a0 2023-08-25T05:35:30.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0b039d2640 1 -- 172.21.15.55:0/4210380047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0afc06e5a0 msgr2=0x7f0afc0cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:30.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0b039d2640 1 --2- 172.21.15.55:0/4210380047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0afc06e5a0 0x7f0afc0cd7d0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0097c0 tx=0x7f0aec01c450 comp rx=0 tx=0).stop 2023-08-25T05:35:30.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0b039d2640 1 -- 172.21.15.55:0/4210380047 shutdown_connections 2023-08-25T05:35:30.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0b039d2640 1 --2- 172.21.15.55:0/4210380047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0afc06e5a0 0x7f0afc0cd7d0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:30.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0b039d2640 1 -- 172.21.15.55:0/4210380047 >> 172.21.15.55:0/4210380047 conn(0x7f0afc0d0540 msgr2=0x7f0afc0d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:30.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0b039d2640 1 -- 172.21.15.55:0/4210380047 shutdown_connections 2023-08-25T05:35:30.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0b039d2640 1 -- 172.21.15.55:0/4210380047 wait complete. 2023-08-25T05:35:30.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0b039d2640 1 Processor -- start 2023-08-25T05:35:30.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0b039d2640 1 -- start start 2023-08-25T05:35:30.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0b039d2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0afc06c3b0 0x7f0afc1556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:30.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0b039d2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0afc06c790 0x7f0afc0ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:30.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0b039d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0afc06e5a0 0x7f0afc0b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:30.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0b039d2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc15e600 con 0x7f0afc06e5a0 2023-08-25T05:35:30.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0b039d2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc15d980 con 0x7f0afc06c3b0 2023-08-25T05:35:30.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.493+0000 7f0b039d2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc15dc60 con 0x7f0afc06c790 2023-08-25T05:35:30.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.497+0000 7f0b01f6f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0afc06e5a0 0x7f0afc0b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:30.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.497+0000 7f0b01f6f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0afc06e5a0 0x7f0afc0b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47634/0 (socket says 172.21.15.55:47634) 2023-08-25T05:35:30.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.497+0000 7f0b01f6f640 1 -- 172.21.15.55:0/504808114 learned_addr learned my addr 172.21.15.55:0/504808114 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:30.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.497+0000 7f0b01f6f640 1 -- 172.21.15.55:0/504808114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0afc06c790 msgr2=0x7f0afc0ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:30.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.497+0000 7f0b01f6f640 1 --2- 172.21.15.55:0/504808114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0afc06c790 0x7f0afc0ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:30.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.497+0000 7f0b01f6f640 1 -- 172.21.15.55:0/504808114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0afc06c3b0 msgr2=0x7f0afc1556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:30.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.497+0000 7f0b01f6f640 1 --2- 172.21.15.55:0/504808114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0afc06c3b0 0x7f0afc1556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:30.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.497+0000 7f0b01f6f640 1 -- 172.21.15.55:0/504808114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec009420 con 0x7f0afc06e5a0 2023-08-25T05:35:30.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.497+0000 7f0b01f6f640 1 --2- 172.21.15.55:0/504808114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0afc06e5a0 0x7f0afc0b0e50 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f0af400c770 tx=0x7f0af400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:30.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.497+0000 7f0af1ffb640 1 -- 172.21.15.55:0/504808114 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4003b80 con 0x7f0afc06e5a0 2023-08-25T05:35:30.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.497+0000 7f0af1ffb640 1 -- 172.21.15.55:0/504808114 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af4003ce0 con 0x7f0afc06e5a0 2023-08-25T05:35:30.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.497+0000 7f0b039d2640 1 -- 172.21.15.55:0/504808114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0afc15df40 con 0x7f0afc06e5a0 2023-08-25T05:35:30.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.497+0000 7f0af1ffb640 1 -- 172.21.15.55:0/504808114 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af400aa90 con 0x7f0afc06e5a0 2023-08-25T05:35:30.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.497+0000 7f0b039d2640 1 -- 172.21.15.55:0/504808114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0afc155fa0 con 0x7f0afc06e5a0 2023-08-25T05:35:30.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.497+0000 7f0b039d2640 1 -- 172.21.15.55:0/504808114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0afc073ec0 con 0x7f0afc06e5a0 2023-08-25T05:35:30.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.497+0000 7f0af1ffb640 1 -- 172.21.15.55:0/504808114 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f0af400abf0 con 0x7f0afc06e5a0 2023-08-25T05:35:30.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.501+0000 7f0af1ffb640 1 --2- 172.21.15.55:0/504808114 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f0ae00657a0 0x7f0ae0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:30.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.501+0000 7f0af1ffb640 1 -- 172.21.15.55:0/504808114 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f0af4082ef0 con 0x7f0afc06e5a0 2023-08-25T05:35:30.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.501+0000 7f0b0176e640 1 --2- 172.21.15.55:0/504808114 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f0ae00657a0 0x7f0ae0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:30.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.501+0000 7f0b0176e640 1 --2- 172.21.15.55:0/504808114 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f0ae00657a0 0x7f0ae0067c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0af8001370 tx=0x7f0af80077d0 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:30.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.505+0000 7f0af1ffb640 1 -- 172.21.15.55:0/504808114 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0af4050780 con 0x7f0afc06e5a0 2023-08-25T05:35:30.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.673+0000 7f0b039d2640 1 -- 172.21.15.55:0/504808114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f0afc06f280 con 0x7f0afc06e5a0 2023-08-25T05:35:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.681+0000 7f0af1ffb640 1 -- 172.21.15.55:0/504808114 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v61) v1 ==== 115+0+0 (secure 0 0 0) 0x7f0af4053da0 con 0x7f0afc06e5a0 2023-08-25T05:35:30.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.681+0000 7f0b039d2640 1 -- 172.21.15.55:0/504808114 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f0ae00657a0 msgr2=0x7f0ae0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:30.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.681+0000 7f0b039d2640 1 --2- 172.21.15.55:0/504808114 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f0ae00657a0 0x7f0ae0067c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0af8001370 tx=0x7f0af80077d0 comp rx=0 tx=0).stop 2023-08-25T05:35:30.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.681+0000 7f0b039d2640 1 -- 172.21.15.55:0/504808114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0afc06e5a0 msgr2=0x7f0afc0b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:30.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.681+0000 7f0b039d2640 1 --2- 172.21.15.55:0/504808114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0afc06e5a0 0x7f0afc0b0e50 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f0af400c770 tx=0x7f0af400cc30 comp rx=0 tx=0).stop 2023-08-25T05:35:30.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.681+0000 7f0b039d2640 1 -- 172.21.15.55:0/504808114 shutdown_connections 2023-08-25T05:35:30.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.681+0000 7f0b039d2640 1 --2- 172.21.15.55:0/504808114 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f0ae00657a0 0x7f0ae0067c60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:30.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.681+0000 7f0b039d2640 1 --2- 172.21.15.55:0/504808114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0afc06e5a0 0x7f0afc0b0e50 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:30.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.681+0000 7f0b039d2640 1 --2- 172.21.15.55:0/504808114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0afc06c790 0x7f0afc0ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:30.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.681+0000 7f0b039d2640 1 --2- 172.21.15.55:0/504808114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0afc06c3b0 0x7f0afc1556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:30.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.681+0000 7f0b039d2640 1 -- 172.21.15.55:0/504808114 >> 172.21.15.55:0/504808114 conn(0x7f0afc0d0540 msgr2=0x7f0afc0ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:30.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.681+0000 7f0b039d2640 1 -- 172.21.15.55:0/504808114 shutdown_connections 2023-08-25T05:35:30.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.681+0000 7f0b039d2640 1 -- 172.21.15.55:0/504808114 wait complete. 2023-08-25T05:35:30.706 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-25T05:35:30.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.849+0000 7f3c993a2640 1 Processor -- start 2023-08-25T05:35:30.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.849+0000 7f3c993a2640 1 -- start start 2023-08-25T05:35:30.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.849+0000 7f3c993a2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3c940cc500 0x7f3c94160710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:30.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.849+0000 7f3c993a2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c940ca650 con 0x7f3c94160260 2023-08-25T05:35:30.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.849+0000 7f3c993a2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c94160d00 con 0x7f3c9415d930 2023-08-25T05:35:30.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.849+0000 7f3c993a2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c94160fe0 con 0x7f3c940cc500 2023-08-25T05:35:30.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.849+0000 7f3c937fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3c94160260 0x7f3c940cbdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59304/0 (socket says 172.21.15.55:59304) 2023-08-25T05:35:30.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.849+0000 7f3c937fe640 1 -- 172.21.15.55:0/1200098177 learned_addr learned my addr 172.21.15.55:0/1200098177 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:30.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.849+0000 7f3c98ba1640 1 --2- 172.21.15.55:0/1200098177 >> v2:172.21.15.110:3300/0 conn(0x7f3c940cc500 0x7f3c94160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:30.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.849+0000 7f3c92ffd640 1 -- 172.21.15.55:0/1200098177 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543870859 0 0) 0x7f3c940ca650 con 0x7f3c94160260 2023-08-25T05:35:30.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.849+0000 7f3c92ffd640 1 -- 172.21.15.55:0/1200098177 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c7c003530 con 0x7f3c94160260 2023-08-25T05:35:30.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.849+0000 7f3c98ba1640 1 -- 172.21.15.55:0/1200098177 >> v1:172.21.15.110:6789/0 conn(0x7f3c9415d930 legacy=0x7f3c940cb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:30.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.849+0000 7f3c98ba1640 1 -- 172.21.15.55:0/1200098177 >> v1:172.21.15.55:6789/0 conn(0x7f3c94160260 legacy=0x7f3c940cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:30.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.849+0000 7f3c98ba1640 1 -- 172.21.15.55:0/1200098177 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c940ca8a0 con 0x7f3c940cc500 2023-08-25T05:35:30.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.853+0000 7f3c98ba1640 1 --2- 172.21.15.55:0/1200098177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c940cc500 0x7f3c94160710 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009d90 tx=0x7f3c8c01d320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc7c3f8b3071e16b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:30.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.853+0000 7f3c92ffd640 1 -- 172.21.15.55:0/1200098177 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c0a5890 con 0x7f3c940cc500 2023-08-25T05:35:30.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.853+0000 7f3c92ffd640 1 -- 172.21.15.55:0/1200098177 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8c0a59f0 con 0x7f3c940cc500 2023-08-25T05:35:30.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.853+0000 7f3c92ffd640 1 -- 172.21.15.55:0/1200098177 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c0a5d80 con 0x7f3c940cc500 2023-08-25T05:35:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.853+0000 7f3c993a2640 1 -- 172.21.15.55:0/1200098177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c940cc500 msgr2=0x7f3c94160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.853+0000 7f3c993a2640 1 --2- 172.21.15.55:0/1200098177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c940cc500 0x7f3c94160710 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009d90 tx=0x7f3c8c01d320 comp rx=0 tx=0).stop 2023-08-25T05:35:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.853+0000 7f3c993a2640 1 -- 172.21.15.55:0/1200098177 shutdown_connections 2023-08-25T05:35:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.853+0000 7f3c993a2640 1 --2- 172.21.15.55:0/1200098177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c940cc500 0x7f3c94160710 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.853+0000 7f3c993a2640 1 -- 172.21.15.55:0/1200098177 >> 172.21.15.55:0/1200098177 conn(0x7f3c94069f00 msgr2=0x7f3c940afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.853+0000 7f3c993a2640 1 -- 172.21.15.55:0/1200098177 shutdown_connections 2023-08-25T05:35:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.853+0000 7f3c993a2640 1 -- 172.21.15.55:0/1200098177 wait complete. 2023-08-25T05:35:30.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c993a2640 1 Processor -- start 2023-08-25T05:35:30.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c993a2640 1 -- start start 2023-08-25T05:35:30.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c993a2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c940cc500 0x7f3c9414c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:30.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c993a2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c9415d930 0x7f3c940add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:30.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c993a2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c94160260 0x7f3c940af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:30.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c993a2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940af310 con 0x7f3c94160260 2023-08-25T05:35:30.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c993a2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940ae700 con 0x7f3c940cc500 2023-08-25T05:35:30.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c993a2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c940ae9e0 con 0x7f3c9415d930 2023-08-25T05:35:30.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c98ba1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c94160260 0x7f3c940af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:30.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c98ba1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c94160260 0x7f3c940af9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59818/0 (socket says 172.21.15.55:59818) 2023-08-25T05:35:30.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c98ba1640 1 -- 172.21.15.55:0/2928474453 learned_addr learned my addr 172.21.15.55:0/2928474453 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:30.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c93fff640 1 --2- 172.21.15.55:0/2928474453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c940cc500 0x7f3c9414c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:30.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c937fe640 1 --2- 172.21.15.55:0/2928474453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c9415d930 0x7f3c940add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:30.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c98ba1640 1 -- 172.21.15.55:0/2928474453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c9415d930 msgr2=0x7f3c940add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:30.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c98ba1640 1 --2- 172.21.15.55:0/2928474453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c9415d930 0x7f3c940add20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:30.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c98ba1640 1 -- 172.21.15.55:0/2928474453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c940cc500 msgr2=0x7f3c9414c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:30.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c98ba1640 1 --2- 172.21.15.55:0/2928474453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c940cc500 0x7f3c9414c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:30.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c98ba1640 1 -- 172.21.15.55:0/2928474453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8c009a70 con 0x7f3c94160260 2023-08-25T05:35:30.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c93fff640 1 --2- 172.21.15.55:0/2928474453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c940cc500 0x7f3c9414c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:30.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c98ba1640 1 --2- 172.21.15.55:0/2928474453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c94160260 0x7f3c940af9f0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009d90 tx=0x7f3c8c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:30.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c90ff9640 1 -- 172.21.15.55:0/2928474453 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c0b9650 con 0x7f3c94160260 2023-08-25T05:35:30.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c90ff9640 1 -- 172.21.15.55:0/2928474453 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8c0b97b0 con 0x7f3c94160260 2023-08-25T05:35:30.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c90ff9640 1 -- 172.21.15.55:0/2928474453 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c0b9b60 con 0x7f3c94160260 2023-08-25T05:35:30.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.857+0000 7f3c993a2640 1 -- 172.21.15.55:0/2928474453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c940aecc0 con 0x7f3c94160260 2023-08-25T05:35:30.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.861+0000 7f3c993a2640 1 -- 172.21.15.55:0/2928474453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9414c5f0 con 0x7f3c94160260 2023-08-25T05:35:30.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.861+0000 7f3c993a2640 1 -- 172.21.15.55:0/2928474453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c940af480 con 0x7f3c94160260 2023-08-25T05:35:30.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.861+0000 7f3c90ff9640 1 -- 172.21.15.55:0/2928474453 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f3c8c0b9cc0 con 0x7f3c94160260 2023-08-25T05:35:30.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.861+0000 7f3c90ff9640 1 --2- 172.21.15.55:0/2928474453 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f3c800657a0 0x7f3c80067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:30.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.861+0000 7f3c90ff9640 1 -- 172.21.15.55:0/2928474453 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f3c8c11e3b0 con 0x7f3c94160260 2023-08-25T05:35:30.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.861+0000 7f3c93fff640 1 --2- 172.21.15.55:0/2928474453 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f3c800657a0 0x7f3c80067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:30.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.861+0000 7f3c93fff640 1 --2- 172.21.15.55:0/2928474453 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f3c800657a0 0x7f3c80067c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c84001710 tx=0x7f3c84009040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:30.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:30.865+0000 7f3c90ff9640 1 -- 172.21.15.55:0/2928474453 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3c8c0ebbb0 con 0x7f3c94160260 2023-08-25T05:35:31.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.033+0000 7f3c993a2640 1 -- 172.21.15.55:0/2928474453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f3c94073e50 con 0x7f3c94160260 2023-08-25T05:35:31.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.037+0000 7f3c90ff9640 1 -- 172.21.15.55:0/2928474453 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v62) v1 ==== 120+0+0 (secure 0 0 0) 0x7f3c8c0ef1d0 con 0x7f3c94160260 2023-08-25T05:35:31.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.041+0000 7f3c993a2640 1 -- 172.21.15.55:0/2928474453 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f3c800657a0 msgr2=0x7f3c80067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:31.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.041+0000 7f3c993a2640 1 --2- 172.21.15.55:0/2928474453 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f3c800657a0 0x7f3c80067c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c84001710 tx=0x7f3c84009040 comp rx=0 tx=0).stop 2023-08-25T05:35:31.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.041+0000 7f3c993a2640 1 -- 172.21.15.55:0/2928474453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c94160260 msgr2=0x7f3c940af9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:31.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.041+0000 7f3c993a2640 1 --2- 172.21.15.55:0/2928474453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c94160260 0x7f3c940af9f0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009d90 tx=0x7f3c8c019660 comp rx=0 tx=0).stop 2023-08-25T05:35:31.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.041+0000 7f3c993a2640 1 -- 172.21.15.55:0/2928474453 shutdown_connections 2023-08-25T05:35:31.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.041+0000 7f3c993a2640 1 --2- 172.21.15.55:0/2928474453 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f3c800657a0 0x7f3c80067c60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:31.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.041+0000 7f3c993a2640 1 --2- 172.21.15.55:0/2928474453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c94160260 0x7f3c940af9f0 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:31.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.041+0000 7f3c993a2640 1 --2- 172.21.15.55:0/2928474453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c9415d930 0x7f3c940add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:31.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.041+0000 7f3c993a2640 1 --2- 172.21.15.55:0/2928474453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c940cc500 0x7f3c9414c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:31.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.041+0000 7f3c993a2640 1 -- 172.21.15.55:0/2928474453 >> 172.21.15.55:0/2928474453 conn(0x7f3c94069f00 msgr2=0x7f3c940ce860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:31.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.041+0000 7f3c993a2640 1 -- 172.21.15.55:0/2928474453 shutdown_connections 2023-08-25T05:35:31.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.041+0000 7f3c993a2640 1 -- 172.21.15.55:0/2928474453 wait complete. 2023-08-25T05:35:31.063 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-25T05:35:31.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.205+0000 7fa5470ec640 1 Processor -- start 2023-08-25T05:35:31.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.205+0000 7fa5470ec640 1 -- start start 2023-08-25T05:35:31.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.209+0000 7fa5470ec640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa54006e5a0 0x7fa5400cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:31.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.209+0000 7fa5470ec640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5400cab90 con 0x7fa54006c790 2023-08-25T05:35:31.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.209+0000 7fa5470ec640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54006dbb0 con 0x7fa54006c3b0 2023-08-25T05:35:31.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.209+0000 7fa5470ec640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5400cae50 con 0x7fa54006e5a0 2023-08-25T05:35:31.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.209+0000 7fa537fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa54006e5a0 0x7fa5400cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:31.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.209+0000 7fa545689640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa54006c790 0x7fa5400ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59314/0 (socket says 172.21.15.55:59314) 2023-08-25T05:35:31.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.209+0000 7fa545689640 1 -- 172.21.15.55:0/2141373404 learned_addr learned my addr 172.21.15.55:0/2141373404 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:31.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.209+0000 7fa537fff640 1 -- 172.21.15.55:0/2141373404 >> v1:172.21.15.110:6789/0 conn(0x7fa54006c3b0 legacy=0x7fa54006de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:31.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.209+0000 7fa537fff640 1 -- 172.21.15.55:0/2141373404 >> v1:172.21.15.55:6789/0 conn(0x7fa54006c790 legacy=0x7fa5400ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:31.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.209+0000 7fa537fff640 1 -- 172.21.15.55:0/2141373404 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5400cb130 con 0x7fa54006e5a0 2023-08-25T05:35:31.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.209+0000 7fa5377fe640 1 -- 172.21.15.55:0/2141373404 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2917887221 0 0) 0x7fa5400cab90 con 0x7fa54006c790 2023-08-25T05:35:31.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.209+0000 7fa537fff640 1 --2- 172.21.15.55:0/2141373404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa54006e5a0 0x7fa5400cd7d0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fa5300097c0 tx=0x7fa53001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7dd78ca7ad85a6b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:31.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.209+0000 7fa5377fe640 1 -- 172.21.15.55:0/2141373404 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5300a7070 con 0x7fa54006e5a0 2023-08-25T05:35:31.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.209+0000 7fa5377fe640 1 -- 172.21.15.55:0/2141373404 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5300ab430 con 0x7fa54006e5a0 2023-08-25T05:35:31.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.209+0000 7fa5377fe640 1 -- 172.21.15.55:0/2141373404 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5300ab7c0 con 0x7fa54006e5a0 2023-08-25T05:35:31.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa5470ec640 1 -- 172.21.15.55:0/2141373404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa54006e5a0 msgr2=0x7fa5400cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:31.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa5470ec640 1 --2- 172.21.15.55:0/2141373404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa54006e5a0 0x7fa5400cd7d0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fa5300097c0 tx=0x7fa53001c450 comp rx=0 tx=0).stop 2023-08-25T05:35:31.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa5470ec640 1 -- 172.21.15.55:0/2141373404 shutdown_connections 2023-08-25T05:35:31.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa5470ec640 1 --2- 172.21.15.55:0/2141373404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa54006e5a0 0x7fa5400cd7d0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:31.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa5470ec640 1 -- 172.21.15.55:0/2141373404 >> 172.21.15.55:0/2141373404 conn(0x7fa5400d0540 msgr2=0x7fa5400d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:31.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa5470ec640 1 -- 172.21.15.55:0/2141373404 shutdown_connections 2023-08-25T05:35:31.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa5470ec640 1 -- 172.21.15.55:0/2141373404 wait complete. 2023-08-25T05:35:31.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa5470ec640 1 Processor -- start 2023-08-25T05:35:31.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa5470ec640 1 -- start start 2023-08-25T05:35:31.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa5470ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa54006c3b0 0x7fa5401506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:31.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa5470ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa54006c790 0x7fa5400b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:31.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa5470ec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa54006e5a0 0x7fa5400b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:31.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa5470ec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400c9050 con 0x7fa54006c3b0 2023-08-25T05:35:31.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa5470ec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400ca300 con 0x7fa54006e5a0 2023-08-25T05:35:31.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa5470ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400b53a0 con 0x7fa54006c790 2023-08-25T05:35:31.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa544e88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa54006c3b0 0x7fa5401506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:31.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa544e88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa54006c3b0 0x7fa5401506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59834/0 (socket says 172.21.15.55:59834) 2023-08-25T05:35:31.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa544e88640 1 -- 172.21.15.55:0/720831067 learned_addr learned my addr 172.21.15.55:0/720831067 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:31.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.213+0000 7fa544e88640 1 -- 172.21.15.55:0/720831067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa54006c790 msgr2=0x7fa5400b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:31.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.217+0000 7fa544e88640 1 --2- 172.21.15.55:0/720831067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa54006c790 0x7fa5400b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:31.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.217+0000 7fa544e88640 1 -- 172.21.15.55:0/720831067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa54006e5a0 msgr2=0x7fa5400b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:31.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.217+0000 7fa544e88640 1 --2- 172.21.15.55:0/720831067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa54006e5a0 0x7fa5400b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:31.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.217+0000 7fa544e88640 1 -- 172.21.15.55:0/720831067 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa530009420 con 0x7fa54006c3b0 2023-08-25T05:35:31.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.217+0000 7fa544e88640 1 --2- 172.21.15.55:0/720831067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa54006c3b0 0x7fa5401506d0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00c450 tx=0x7fa53c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:31.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.217+0000 7fa5357fa640 1 -- 172.21.15.55:0/720831067 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c0052d0 con 0x7fa54006c3b0 2023-08-25T05:35:31.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.217+0000 7fa5357fa640 1 -- 172.21.15.55:0/720831067 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c005430 con 0x7fa54006c3b0 2023-08-25T05:35:31.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.217+0000 7fa5470ec640 1 -- 172.21.15.55:0/720831067 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5400c96f0 con 0x7fa54006c3b0 2023-08-25T05:35:31.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.217+0000 7fa5357fa640 1 -- 172.21.15.55:0/720831067 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c003890 con 0x7fa54006c3b0 2023-08-25T05:35:31.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.217+0000 7fa5470ec640 1 -- 172.21.15.55:0/720831067 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5400c9cb0 con 0x7fa54006c3b0 2023-08-25T05:35:31.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.217+0000 7fa5470ec640 1 -- 172.21.15.55:0/720831067 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa540073ec0 con 0x7fa54006c3b0 2023-08-25T05:35:31.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.217+0000 7fa5357fa640 1 -- 172.21.15.55:0/720831067 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fa53c0039f0 con 0x7fa54006c3b0 2023-08-25T05:35:31.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.217+0000 7fa5357fa640 1 --2- 172.21.15.55:0/720831067 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fa52c0657d0 0x7fa52c067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:31.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.217+0000 7fa5357fa640 1 -- 172.21.15.55:0/720831067 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fa53c082c80 con 0x7fa54006c3b0 2023-08-25T05:35:31.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.217+0000 7fa537fff640 1 --2- 172.21.15.55:0/720831067 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fa52c0657d0 0x7fa52c067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:31.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.221+0000 7fa537fff640 1 --2- 172.21.15.55:0/720831067 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fa52c0657d0 0x7fa52c067c90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa5300af000 tx=0x7fa530008040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:31.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.221+0000 7fa5357fa640 1 -- 172.21.15.55:0/720831067 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa53c050480 con 0x7fa54006c3b0 2023-08-25T05:35:31.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.385+0000 7fa5470ec640 1 -- 172.21.15.55:0/720831067 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa54006ed00 con 0x7fa54006c3b0 2023-08-25T05:35:31.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.389+0000 7fa5357fa640 1 -- 172.21.15.55:0/720831067 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa53c053aa0 con 0x7fa54006c3b0 2023-08-25T05:35:31.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.393+0000 7fa5470ec640 1 -- 172.21.15.55:0/720831067 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fa52c0657d0 msgr2=0x7fa52c067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:31.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.393+0000 7fa5470ec640 1 --2- 172.21.15.55:0/720831067 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fa52c0657d0 0x7fa52c067c90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa5300af000 tx=0x7fa530008040 comp rx=0 tx=0).stop 2023-08-25T05:35:31.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.393+0000 7fa5470ec640 1 -- 172.21.15.55:0/720831067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa54006c3b0 msgr2=0x7fa5401506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:31.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.393+0000 7fa5470ec640 1 --2- 172.21.15.55:0/720831067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa54006c3b0 0x7fa5401506d0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00c450 tx=0x7fa53c00c910 comp rx=0 tx=0).stop 2023-08-25T05:35:31.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.393+0000 7fa5470ec640 1 -- 172.21.15.55:0/720831067 shutdown_connections 2023-08-25T05:35:31.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.393+0000 7fa5470ec640 1 --2- 172.21.15.55:0/720831067 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fa52c0657d0 0x7fa52c067c90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:31.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.393+0000 7fa5470ec640 1 --2- 172.21.15.55:0/720831067 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa54006e5a0 0x7fa5400b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:31.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.393+0000 7fa5470ec640 1 --2- 172.21.15.55:0/720831067 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa54006c790 0x7fa5400b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:31.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.393+0000 7fa5470ec640 1 --2- 172.21.15.55:0/720831067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa54006c3b0 0x7fa5401506d0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:31.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.393+0000 7fa5470ec640 1 -- 172.21.15.55:0/720831067 >> 172.21.15.55:0/720831067 conn(0x7fa5400d0540 msgr2=0x7fa5400d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:31.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.393+0000 7fa5470ec640 1 -- 172.21.15.55:0/720831067 shutdown_connections 2023-08-25T05:35:31.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.393+0000 7fa5470ec640 1 -- 172.21.15.55:0/720831067 wait complete. 2023-08-25T05:35:31.415 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-08-25T05:35:31.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f6067959640 1 Processor -- start 2023-08-25T05:35:31.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f6067959640 1 -- start start 2023-08-25T05:35:31.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f6067959640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6060164410 0x7f60600b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f6067959640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f60600cddf0 0x7f60600c1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f6067959640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60600c18b0 0x7f60600cac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f6067959640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60600c1d60 con 0x7f60600c18b0 2023-08-25T05:35:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f6067959640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60600cc510 con 0x7f60600cddf0 2023-08-25T05:35:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f6067959640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60601647f0 con 0x7f6060164410 2023-08-25T05:35:31.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f6065ef6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60600c18b0 0x7f60600cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:31.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f6065ef6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60600c18b0 0x7f60600cac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59844/0 (socket says 172.21.15.55:59844) 2023-08-25T05:35:31.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f6065ef6640 1 -- 172.21.15.55:0/1642963188 learned_addr learned my addr 172.21.15.55:0/1642963188 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:31.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f6065ef6640 1 -- 172.21.15.55:0/1642963188 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6060164410 msgr2=0x7f60600b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:31.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f60656f5640 1 --2- 172.21.15.55:0/1642963188 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6060164410 0x7f60600b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:31.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f6064ef4640 1 --2- 172.21.15.55:0/1642963188 >> v2:172.21.15.110:3300/0 conn(0x7f60600cddf0 0x7f60600c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:31.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f6065ef6640 1 --2- 172.21.15.55:0/1642963188 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6060164410 0x7f60600b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:31.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f6065ef6640 1 -- 172.21.15.55:0/1642963188 >> v2:172.21.15.110:3300/0 conn(0x7f60600cddf0 msgr2=0x7f60600c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:31.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f6065ef6640 1 --2- 172.21.15.55:0/1642963188 >> v2:172.21.15.110:3300/0 conn(0x7f60600cddf0 0x7f60600c1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:31.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f6065ef6640 1 -- 172.21.15.55:0/1642963188 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60600cc9b0 con 0x7f60600c18b0 2023-08-25T05:35:31.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f60656f5640 1 --2- 172.21.15.55:0/1642963188 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6060164410 0x7f60600b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:31.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.557+0000 7f6064ef4640 1 --2- 172.21.15.55:0/1642963188 >> v2:172.21.15.110:3300/0 conn(0x7f60600cddf0 0x7f60600c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:31.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.561+0000 7f6065ef6640 1 --2- 172.21.15.55:0/1642963188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60600c18b0 0x7f60600cac20 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f60600cbe30 tx=0x7f605801c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26d1e5b4a160b1a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:31.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.561+0000 7f6057fff640 1 -- 172.21.15.55:0/1642963188 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60580a9480 con 0x7f60600c18b0 2023-08-25T05:35:31.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.561+0000 7f6057fff640 1 -- 172.21.15.55:0/1642963188 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60580a95e0 con 0x7f60600c18b0 2023-08-25T05:35:31.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.561+0000 7f6057fff640 1 -- 172.21.15.55:0/1642963188 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60580a9970 con 0x7f60600c18b0 2023-08-25T05:35:31.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.561+0000 7f6067959640 1 -- 172.21.15.55:0/1642963188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60600c18b0 msgr2=0x7f60600cac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:31.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.561+0000 7f6067959640 1 --2- 172.21.15.55:0/1642963188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60600c18b0 0x7f60600cac20 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f60600cbe30 tx=0x7f605801c710 comp rx=0 tx=0).stop 2023-08-25T05:35:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.561+0000 7f6067959640 1 -- 172.21.15.55:0/1642963188 shutdown_connections 2023-08-25T05:35:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.561+0000 7f6067959640 1 --2- 172.21.15.55:0/1642963188 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60600c18b0 0x7f60600cac20 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.561+0000 7f6067959640 1 --2- 172.21.15.55:0/1642963188 >> v2:172.21.15.110:3300/0 conn(0x7f60600cddf0 0x7f60600c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.561+0000 7f6067959640 1 --2- 172.21.15.55:0/1642963188 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6060164410 0x7f60600b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.561+0000 7f6067959640 1 -- 172.21.15.55:0/1642963188 >> 172.21.15.55:0/1642963188 conn(0x7f6060069d00 msgr2=0x7f606006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:31.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.561+0000 7f6067959640 1 -- 172.21.15.55:0/1642963188 shutdown_connections 2023-08-25T05:35:31.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.561+0000 7f6067959640 1 -- 172.21.15.55:0/1642963188 wait complete. 2023-08-25T05:35:31.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.561+0000 7f6067959640 1 Processor -- start 2023-08-25T05:35:31.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.561+0000 7f6067959640 1 -- start start 2023-08-25T05:35:31.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6067959640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60600c18b0 0x7f60600ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:31.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6067959640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60600cddf0 0x7f606015a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:31.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6067959640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6060164410 0x7f6060162480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:31.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6067959640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606015ba70 con 0x7f60600cddf0 2023-08-25T05:35:31.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6067959640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606015b460 con 0x7f6060164410 2023-08-25T05:35:31.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6067959640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60600ac600 con 0x7f60600c18b0 2023-08-25T05:35:31.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6064ef4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60600cddf0 0x7f606015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:31.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6064ef4640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60600cddf0 0x7f606015a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59856/0 (socket says 172.21.15.55:59856) 2023-08-25T05:35:31.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6064ef4640 1 -- 172.21.15.55:0/1576428445 learned_addr learned my addr 172.21.15.55:0/1576428445 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:31.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f60656f5640 1 --2- 172.21.15.55:0/1576428445 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60600c18b0 0x7f60600ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:31.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6065ef6640 1 --2- 172.21.15.55:0/1576428445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6060164410 0x7f6060162480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:31.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6064ef4640 1 -- 172.21.15.55:0/1576428445 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60600c18b0 msgr2=0x7f60600ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:31.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6064ef4640 1 --2- 172.21.15.55:0/1576428445 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60600c18b0 0x7f60600ad0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:31.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6064ef4640 1 -- 172.21.15.55:0/1576428445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6060164410 msgr2=0x7f6060162480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:31.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6064ef4640 1 --2- 172.21.15.55:0/1576428445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6060164410 0x7f6060162480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:31.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6064ef4640 1 -- 172.21.15.55:0/1576428445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6058009b30 con 0x7f60600cddf0 2023-08-25T05:35:31.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6064ef4640 1 --2- 172.21.15.55:0/1576428445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60600cddf0 0x7f606015a260 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f605000c7f0 tx=0x7f605000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:31.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6055ffb640 1 -- 172.21.15.55:0/1576428445 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605000cea0 con 0x7f60600cddf0 2023-08-25T05:35:31.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6055ffb640 1 -- 172.21.15.55:0/1576428445 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6050004230 con 0x7f60600cddf0 2023-08-25T05:35:31.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6055ffb640 1 -- 172.21.15.55:0/1576428445 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050007830 con 0x7f60600cddf0 2023-08-25T05:35:31.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6067959640 1 -- 172.21.15.55:0/1576428445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60600ac8e0 con 0x7f60600cddf0 2023-08-25T05:35:31.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6067959640 1 -- 172.21.15.55:0/1576428445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60600ac290 con 0x7f60600cddf0 2023-08-25T05:35:31.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.565+0000 7f6067959640 1 -- 172.21.15.55:0/1576428445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606004dbe0 con 0x7f60600cddf0 2023-08-25T05:35:31.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.569+0000 7f6055ffb640 1 -- 172.21.15.55:0/1576428445 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f6050007990 con 0x7f60600cddf0 2023-08-25T05:35:31.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.569+0000 7f6055ffb640 1 --2- 172.21.15.55:0/1576428445 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f60440657a0 0x7f6044067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:31.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.569+0000 7f6055ffb640 1 -- 172.21.15.55:0/1576428445 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f60500831d0 con 0x7f60600cddf0 2023-08-25T05:35:31.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.569+0000 7f60656f5640 1 --2- 172.21.15.55:0/1576428445 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f60440657a0 0x7f6044067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:31.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.569+0000 7f60656f5640 1 --2- 172.21.15.55:0/1576428445 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f60440657a0 0x7f6044067c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f60600b12c0 tx=0x7f605c008040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:31.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.573+0000 7f6055ffb640 1 -- 172.21.15.55:0/1576428445 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f60500508e0 con 0x7f60600cddf0 2023-08-25T05:35:31.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:31.781+0000 7f6067959640 1 -- 172.21.15.55:0/1576428445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f60600b2310 con 0x7f60600cddf0 2023-08-25T05:35:32.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.313+0000 7f6055ffb640 1 -- 172.21.15.55:0/1576428445 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2999) v1 ==== 165+0+0 (secure 0 0 0) 0x7f6050053f00 con 0x7f60600cddf0 2023-08-25T05:35:32.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.313+0000 7f6067959640 1 -- 172.21.15.55:0/1576428445 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f60440657a0 msgr2=0x7f6044067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:32.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.313+0000 7f6067959640 1 --2- 172.21.15.55:0/1576428445 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f60440657a0 0x7f6044067c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f60600b12c0 tx=0x7f605c008040 comp rx=0 tx=0).stop 2023-08-25T05:35:32.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.313+0000 7f6067959640 1 -- 172.21.15.55:0/1576428445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60600cddf0 msgr2=0x7f606015a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:32.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.313+0000 7f6067959640 1 --2- 172.21.15.55:0/1576428445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60600cddf0 0x7f606015a260 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f605000c7f0 tx=0x7f605000ccb0 comp rx=0 tx=0).stop 2023-08-25T05:35:32.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.313+0000 7f6067959640 1 -- 172.21.15.55:0/1576428445 shutdown_connections 2023-08-25T05:35:32.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.313+0000 7f6067959640 1 --2- 172.21.15.55:0/1576428445 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f60440657a0 0x7f6044067c60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:32.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.313+0000 7f6067959640 1 --2- 172.21.15.55:0/1576428445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6060164410 0x7f6060162480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.313+0000 7f6067959640 1 --2- 172.21.15.55:0/1576428445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60600cddf0 0x7f606015a260 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.313+0000 7f6067959640 1 --2- 172.21.15.55:0/1576428445 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60600c18b0 0x7f60600ad0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.313+0000 7f6067959640 1 -- 172.21.15.55:0/1576428445 >> 172.21.15.55:0/1576428445 conn(0x7f6060069d00 msgr2=0x7f606015cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.313+0000 7f6067959640 1 -- 172.21.15.55:0/1576428445 shutdown_connections 2023-08-25T05:35:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.313+0000 7f6067959640 1 -- 172.21.15.55:0/1576428445 wait complete. 2023-08-25T05:35:32.339 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-08-25T05:35:32.340 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-08-25T05:35:32.340 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-08-25T05:35:32.340 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-08-25T05:35:32.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.485+0000 7fee58a93640 1 Processor -- start 2023-08-25T05:35:32.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.485+0000 7fee58a93640 1 -- start start 2023-08-25T05:35:32.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.485+0000 7fee58a93640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee540cdde0 0x7fee540ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:32.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.485+0000 7fee58a93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fee540b2e40 0x7fee540b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:32.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.485+0000 7fee58a93640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee540b29b0 con 0x7fee540d0da0 2023-08-25T05:35:32.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.485+0000 7fee58a93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee540ce760 con 0x7fee540b2e40 2023-08-25T05:35:32.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.485+0000 7fee58a93640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee540b1dc0 con 0x7fee540cdde0 2023-08-25T05:35:32.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.485+0000 7fee52d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fee540b2e40 0x7fee540b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:32.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.485+0000 7fee5259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fee540d0da0 0x7fee540d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59326/0 (socket says 172.21.15.55:59326) 2023-08-25T05:35:32.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.485+0000 7fee52d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fee540b2e40 0x7fee540b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59870/0 (socket says 172.21.15.55:59870) 2023-08-25T05:35:32.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.485+0000 7fee5259c640 1 -- 172.21.15.55:0/1203777914 learned_addr learned my addr 172.21.15.55:0/1203777914 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:32.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.485+0000 7fee51d9b640 1 --2- 172.21.15.55:0/1203777914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee540cdde0 0x7fee540ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:32.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.485+0000 7fee52d9d640 1 -- 172.21.15.55:0/1203777914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee540cdde0 msgr2=0x7fee540ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:32.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.485+0000 7fee52d9d640 1 --2- 172.21.15.55:0/1203777914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee540cdde0 0x7fee540ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:32.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.485+0000 7fee52d9d640 1 -- 172.21.15.55:0/1203777914 >> v1:172.21.15.55:6789/0 conn(0x7fee540d0da0 legacy=0x7fee540d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:32.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.485+0000 7fee52d9d640 1 -- 172.21.15.55:0/1203777914 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee540b2080 con 0x7fee540b2e40 2023-08-25T05:35:32.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.485+0000 7fee5159a640 1 -- 172.21.15.55:0/1203777914 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514645835 0 0) 0x7fee540b29b0 con 0x7fee540d0da0 2023-08-25T05:35:32.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.485+0000 7fee51d9b640 1 --2- 172.21.15.55:0/1203777914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee540cdde0 0x7fee540ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:32.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.489+0000 7fee52d9d640 1 --2- 172.21.15.55:0/1203777914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee540b2e40 0x7fee540b32d0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009d90 tx=0x7fee4c01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390c38223e429f4a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:32.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.489+0000 7fee5159a640 1 -- 172.21.15.55:0/1203777914 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c0af600 con 0x7fee540b2e40 2023-08-25T05:35:32.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.489+0000 7fee5159a640 1 -- 172.21.15.55:0/1203777914 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c0ab050 con 0x7fee540b2e40 2023-08-25T05:35:32.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.489+0000 7fee5159a640 1 -- 172.21.15.55:0/1203777914 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c0af980 con 0x7fee540b2e40 2023-08-25T05:35:32.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.489+0000 7fee58a93640 1 -- 172.21.15.55:0/1203777914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee540b2e40 msgr2=0x7fee540b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:32.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.489+0000 7fee58a93640 1 --2- 172.21.15.55:0/1203777914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee540b2e40 0x7fee540b32d0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7fee4c009d90 tx=0x7fee4c01f130 comp rx=0 tx=0).stop 2023-08-25T05:35:32.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.489+0000 7fee58a93640 1 -- 172.21.15.55:0/1203777914 shutdown_connections 2023-08-25T05:35:32.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.489+0000 7fee58a93640 1 --2- 172.21.15.55:0/1203777914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee540cdde0 0x7fee540ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:32.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.489+0000 7fee58a93640 1 --2- 172.21.15.55:0/1203777914 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee540b2e40 0x7fee540b32d0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:32.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.489+0000 7fee58a93640 1 -- 172.21.15.55:0/1203777914 >> 172.21.15.55:0/1203777914 conn(0x7fee5409bae0 msgr2=0x7fee540d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:32.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.489+0000 7fee58a93640 1 -- 172.21.15.55:0/1203777914 shutdown_connections 2023-08-25T05:35:32.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.489+0000 7fee58a93640 1 -- 172.21.15.55:0/1203777914 wait complete. 2023-08-25T05:35:32.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee58a93640 1 Processor -- start 2023-08-25T05:35:32.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee58a93640 1 -- start start 2023-08-25T05:35:32.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee58a93640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee540b2e40 0x7fee54151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:32.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee58a93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee540cdde0 0x7fee540cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:32.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee58a93640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee540d0da0 0x7fee540c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:32.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee58a93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540cb270 con 0x7fee540cdde0 2023-08-25T05:35:32.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee58a93640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540ca660 con 0x7fee540b2e40 2023-08-25T05:35:32.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee58a93640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee540ca940 con 0x7fee540d0da0 2023-08-25T05:35:32.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee51d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee540cdde0 0x7fee540cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:32.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee51d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee540cdde0 0x7fee540cb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59874/0 (socket says 172.21.15.55:59874) 2023-08-25T05:35:32.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee51d9b640 1 -- 172.21.15.55:0/6832816 learned_addr learned my addr 172.21.15.55:0/6832816 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:32.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee5259c640 1 --2- 172.21.15.55:0/6832816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee540b2e40 0x7fee54151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:32.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee52d9d640 1 --2- 172.21.15.55:0/6832816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee540d0da0 0x7fee540c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:32.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee51d9b640 1 -- 172.21.15.55:0/6832816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee540d0da0 msgr2=0x7fee540c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:32.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee51d9b640 1 --2- 172.21.15.55:0/6832816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee540d0da0 0x7fee540c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:32.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee51d9b640 1 -- 172.21.15.55:0/6832816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee540b2e40 msgr2=0x7fee54151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:32.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee51d9b640 1 --2- 172.21.15.55:0/6832816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee540b2e40 0x7fee54151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:32.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee51d9b640 1 -- 172.21.15.55:0/6832816 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c009a70 con 0x7fee540cdde0 2023-08-25T05:35:32.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee51d9b640 1 --2- 172.21.15.55:0/6832816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee540cdde0 0x7fee540cb680 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fee4800c7c0 tx=0x7fee4800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:32.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee42ffd640 1 -- 172.21.15.55:0/6832816 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee48007a30 con 0x7fee540cdde0 2023-08-25T05:35:32.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee42ffd640 1 -- 172.21.15.55:0/6832816 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee48007b90 con 0x7fee540cdde0 2023-08-25T05:35:32.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee58a93640 1 -- 172.21.15.55:0/6832816 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee540cac20 con 0x7fee540cdde0 2023-08-25T05:35:32.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee42ffd640 1 -- 172.21.15.55:0/6832816 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4800ce70 con 0x7fee540cdde0 2023-08-25T05:35:32.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee58a93640 1 -- 172.21.15.55:0/6832816 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee540ca2a0 con 0x7fee540cdde0 2023-08-25T05:35:32.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.493+0000 7fee58a93640 1 -- 172.21.15.55:0/6832816 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee540cb3e0 con 0x7fee540cdde0 2023-08-25T05:35:32.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.497+0000 7fee42ffd640 1 -- 172.21.15.55:0/6832816 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fee480113f0 con 0x7fee540cdde0 2023-08-25T05:35:32.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.497+0000 7fee42ffd640 1 --2- 172.21.15.55:0/6832816 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fee340657a0 0x7fee34067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:32.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.497+0000 7fee42ffd640 1 -- 172.21.15.55:0/6832816 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fee48083650 con 0x7fee540cdde0 2023-08-25T05:35:32.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.497+0000 7fee5259c640 1 --2- 172.21.15.55:0/6832816 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fee340657a0 0x7fee34067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:32.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.497+0000 7fee5259c640 1 --2- 172.21.15.55:0/6832816 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fee340657a0 0x7fee34067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fee440010f0 tx=0x7fee44009040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:32.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.501+0000 7fee42ffd640 1 -- 172.21.15.55:0/6832816 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fee48050df0 con 0x7fee540cdde0 2023-08-25T05:35:32.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:32.709+0000 7fee58a93640 1 -- 172.21.15.55:0/6832816 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7fee5404dbe0 con 0x7fee540cdde0 2023-08-25T05:35:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.313+0000 7fee42ffd640 1 -- 172.21.15.55:0/6832816 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v3000) v1 ==== 166+0+0 (secure 0 0 0) 0x7fee48054410 con 0x7fee540cdde0 2023-08-25T05:35:33.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.317+0000 7fee58a93640 1 -- 172.21.15.55:0/6832816 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fee340657a0 msgr2=0x7fee34067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:33.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.317+0000 7fee58a93640 1 --2- 172.21.15.55:0/6832816 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fee340657a0 0x7fee34067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fee440010f0 tx=0x7fee44009040 comp rx=0 tx=0).stop 2023-08-25T05:35:33.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.317+0000 7fee58a93640 1 -- 172.21.15.55:0/6832816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee540cdde0 msgr2=0x7fee540cb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:33.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.317+0000 7fee58a93640 1 --2- 172.21.15.55:0/6832816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee540cdde0 0x7fee540cb680 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fee4800c7c0 tx=0x7fee4800cc80 comp rx=0 tx=0).stop 2023-08-25T05:35:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.317+0000 7fee58a93640 1 -- 172.21.15.55:0/6832816 shutdown_connections 2023-08-25T05:35:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.317+0000 7fee58a93640 1 --2- 172.21.15.55:0/6832816 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fee340657a0 0x7fee34067c60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.317+0000 7fee58a93640 1 --2- 172.21.15.55:0/6832816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee540d0da0 0x7fee540c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.317+0000 7fee58a93640 1 --2- 172.21.15.55:0/6832816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee540cdde0 0x7fee540cb680 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.317+0000 7fee58a93640 1 --2- 172.21.15.55:0/6832816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee540b2e40 0x7fee54151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.317+0000 7fee58a93640 1 -- 172.21.15.55:0/6832816 >> 172.21.15.55:0/6832816 conn(0x7fee5409bae0 msgr2=0x7fee540cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.317+0000 7fee58a93640 1 -- 172.21.15.55:0/6832816 shutdown_connections 2023-08-25T05:35:33.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.317+0000 7fee58a93640 1 -- 172.21.15.55:0/6832816 wait complete. 2023-08-25T05:35:33.344 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:35:33.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.489+0000 7fbdff100640 1 Processor -- start 2023-08-25T05:35:33.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.489+0000 7fbdff100640 1 -- start start 2023-08-25T05:35:33.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.489+0000 7fbdff100640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbdf80ceeb0 0x7fbdf8165690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:33.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.489+0000 7fbdff100640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf80ac100 con 0x7fbdf815eba0 2023-08-25T05:35:33.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.489+0000 7fbdff100640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf80ac3a0 con 0x7fbdf815ef80 2023-08-25T05:35:33.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.489+0000 7fbdff100640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf80b3150 con 0x7fbdf80ceeb0 2023-08-25T05:35:33.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.489+0000 7fbdfce9c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbdf815eba0 0x7fbdf80b2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59328/0 (socket says 172.21.15.55:59328) 2023-08-25T05:35:33.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.489+0000 7fbdfce9c640 1 -- 172.21.15.55:0/3760295385 learned_addr learned my addr 172.21.15.55:0/3760295385 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:33.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.489+0000 7fbdfd69d640 1 --2- 172.21.15.55:0/3760295385 >> v2:172.21.15.55:3300/0 conn(0x7fbdf80ceeb0 0x7fbdf8165690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:33.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.489+0000 7fbdfd69d640 1 -- 172.21.15.55:0/3760295385 >> v1:172.21.15.110:6789/0 conn(0x7fbdf815ef80 legacy=0x7fbdf80ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:33.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.489+0000 7fbdf77fe640 1 -- 172.21.15.55:0/3760295385 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893178886 0 0) 0x7fbdf80ac100 con 0x7fbdf815eba0 2023-08-25T05:35:33.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.489+0000 7fbdfd69d640 1 -- 172.21.15.55:0/3760295385 >> v1:172.21.15.55:6789/0 conn(0x7fbdf815eba0 legacy=0x7fbdf80b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:33.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.489+0000 7fbdfd69d640 1 -- 172.21.15.55:0/3760295385 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf80b1390 con 0x7fbdf80ceeb0 2023-08-25T05:35:33.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.493+0000 7fbdfd69d640 1 --2- 172.21.15.55:0/3760295385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf80ceeb0 0x7fbdf8165690 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009d90 tx=0x7fbdf001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d61e90c38cd424 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:33.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.493+0000 7fbdf77fe640 1 -- 172.21.15.55:0/3760295385 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf00a59a0 con 0x7fbdf80ceeb0 2023-08-25T05:35:33.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.493+0000 7fbdf77fe640 1 -- 172.21.15.55:0/3760295385 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf00a5b00 con 0x7fbdf80ceeb0 2023-08-25T05:35:33.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.493+0000 7fbdf77fe640 1 -- 172.21.15.55:0/3760295385 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf00a5e90 con 0x7fbdf80ceeb0 2023-08-25T05:35:33.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.493+0000 7fbdff100640 1 -- 172.21.15.55:0/3760295385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf80ceeb0 msgr2=0x7fbdf8165690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:33.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.493+0000 7fbdff100640 1 --2- 172.21.15.55:0/3760295385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf80ceeb0 0x7fbdf8165690 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009d90 tx=0x7fbdf001c8e0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.493+0000 7fbdff100640 1 -- 172.21.15.55:0/3760295385 shutdown_connections 2023-08-25T05:35:33.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.493+0000 7fbdff100640 1 --2- 172.21.15.55:0/3760295385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf80ceeb0 0x7fbdf8165690 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.493+0000 7fbdff100640 1 -- 172.21.15.55:0/3760295385 >> 172.21.15.55:0/3760295385 conn(0x7fbdf8069d00 msgr2=0x7fbdf806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:33.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.493+0000 7fbdff100640 1 -- 172.21.15.55:0/3760295385 shutdown_connections 2023-08-25T05:35:33.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.493+0000 7fbdff100640 1 -- 172.21.15.55:0/3760295385 wait complete. 2023-08-25T05:35:33.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.493+0000 7fbdff100640 1 Processor -- start 2023-08-25T05:35:33.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.493+0000 7fbdff100640 1 -- start start 2023-08-25T05:35:33.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdff100640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf80ceeb0 0x7fbdf8164f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:33.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdff100640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf815eba0 0x7fbdf81f8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:33.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdff100640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf815ef80 0x7fbdf81f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:33.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdff100640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf80c25c0 con 0x7fbdf815ef80 2023-08-25T05:35:33.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdff100640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf80cbc70 con 0x7fbdf815eba0 2023-08-25T05:35:33.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdff100640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf80cb990 con 0x7fbdf80ceeb0 2023-08-25T05:35:33.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdfd69d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf815ef80 0x7fbdf81f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:33.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdfd69d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf815ef80 0x7fbdf81f8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59888/0 (socket says 172.21.15.55:59888) 2023-08-25T05:35:33.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdfd69d640 1 -- 172.21.15.55:0/2905431569 learned_addr learned my addr 172.21.15.55:0/2905431569 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:33.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdfce9c640 1 --2- 172.21.15.55:0/2905431569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf80ceeb0 0x7fbdf8164f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:33.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdf7fff640 1 --2- 172.21.15.55:0/2905431569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf815eba0 0x7fbdf81f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:33.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdfd69d640 1 -- 172.21.15.55:0/2905431569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf80ceeb0 msgr2=0x7fbdf8164f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:33.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdfd69d640 1 --2- 172.21.15.55:0/2905431569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf80ceeb0 0x7fbdf8164f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdfd69d640 1 -- 172.21.15.55:0/2905431569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf815eba0 msgr2=0x7fbdf81f8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:33.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdfd69d640 1 --2- 172.21.15.55:0/2905431569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf815eba0 0x7fbdf81f8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdfd69d640 1 -- 172.21.15.55:0/2905431569 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf0009a70 con 0x7fbdf815ef80 2023-08-25T05:35:33.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdfd69d640 1 --2- 172.21.15.55:0/2905431569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf815ef80 0x7fbdf81f8dd0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7fbdf001a510 tx=0x7fbdf0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:33.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdf57fa640 1 -- 172.21.15.55:0/2905431569 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf00addc0 con 0x7fbdf815ef80 2023-08-25T05:35:33.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdf57fa640 1 -- 172.21.15.55:0/2905431569 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf00b7410 con 0x7fbdf815ef80 2023-08-25T05:35:33.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdf57fa640 1 -- 172.21.15.55:0/2905431569 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf00b77a0 con 0x7fbdf815ef80 2023-08-25T05:35:33.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdff100640 1 -- 172.21.15.55:0/2905431569 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf80c1f70 con 0x7fbdf815ef80 2023-08-25T05:35:33.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdff100640 1 -- 172.21.15.55:0/2905431569 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf80c2a00 con 0x7fbdf815ef80 2023-08-25T05:35:33.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.497+0000 7fbdff100640 1 -- 172.21.15.55:0/2905431569 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf815ad10 con 0x7fbdf815ef80 2023-08-25T05:35:33.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.501+0000 7fbdf57fa640 1 -- 172.21.15.55:0/2905431569 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fbdf00b4050 con 0x7fbdf815ef80 2023-08-25T05:35:33.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.501+0000 7fbdf57fa640 1 --2- 172.21.15.55:0/2905431569 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fbddc0657d0 0x7fbddc067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:33.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.501+0000 7fbdf57fa640 1 -- 172.21.15.55:0/2905431569 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fbdf011e1d0 con 0x7fbdf815ef80 2023-08-25T05:35:33.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.501+0000 7fbdfce9c640 1 --2- 172.21.15.55:0/2905431569 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fbddc0657d0 0x7fbddc067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:33.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.501+0000 7fbdfce9c640 1 --2- 172.21.15.55:0/2905431569 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fbddc0657d0 0x7fbddc067c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbdec000f70 tx=0x7fbdec007b60 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:33.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.505+0000 7fbdf57fa640 1 -- 172.21.15.55:0/2905431569 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbdf815ad10 con 0x7fbdf815ef80 2023-08-25T05:35:33.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.661+0000 7fbdff100640 1 -- 172.21.15.55:0/2905431569 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdf815ad10 con 0x7fbdf815ef80 2023-08-25T05:35:33.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.661+0000 7fbdf57fa640 1 -- 172.21.15.55:0/2905431569 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+16311 (secure 0 0 0) 0x7fbdf815ad10 con 0x7fbdf815ef80 2023-08-25T05:35:33.666 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:33.666 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":180,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:35:30.299542+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6834/1451359895":"2023-08-26T05:35:27.217281+0000","172.21.15.110:6833/2233108903":"2023-08-26T05:35:24.116484+0000","172.21.15.110:6832/2233108903":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/519197304":"2023-08-26T05:35:24.116484+0000","172.21.15.55:6835/1451359895":"2023-08-26T05:35:27.217281+0000","172.21.15.110:0/2996229992":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/4286652448":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/186183046":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/555519094":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/4158794211":"2023-08-26T05:30:20.824468+0000","172.21.15.110:6832/758142785":"2023-08-26T05:30:20.824468+0000","172.21.15.110:6833/758142785":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/1448709432":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/2185378335":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/1252154583":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/3987879293":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/2517199041":"2023-08-26T05:30:20.824468+0000","172.21.15.110:0/2871001293":"2023-08-26T05:19:35.670048+0000","172.21.15.110:6833/221263034":"2023-08-26T05:19:35.670048+0000","172.21.15.110:6832/221263034":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/678216564":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/1492208798":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/4272437355":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/914246484":"2023-08-26T05:19:35.670048+0000","172.21.15.110:0/1432610606":"2023-08-26T05:35:24.116484+0000","172.21.15.110:0/1054752082":"2023-08-26T05:19:35.670048+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:35:33.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.665+0000 7fbdff100640 1 -- 172.21.15.55:0/2905431569 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fbddc0657d0 msgr2=0x7fbddc067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:33.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.665+0000 7fbdff100640 1 --2- 172.21.15.55:0/2905431569 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fbddc0657d0 0x7fbddc067c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbdec000f70 tx=0x7fbdec007b60 comp rx=0 tx=0).stop 2023-08-25T05:35:33.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.665+0000 7fbdff100640 1 -- 172.21.15.55:0/2905431569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf815ef80 msgr2=0x7fbdf81f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.665+0000 7fbdff100640 1 --2- 172.21.15.55:0/2905431569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf815ef80 0x7fbdf81f8dd0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7fbdf001a510 tx=0x7fbdf0019680 comp rx=0 tx=0).stop 2023-08-25T05:35:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.665+0000 7fbdff100640 1 -- 172.21.15.55:0/2905431569 shutdown_connections 2023-08-25T05:35:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.665+0000 7fbdff100640 1 --2- 172.21.15.55:0/2905431569 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fbddc0657d0 0x7fbddc067c90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.665+0000 7fbdff100640 1 --2- 172.21.15.55:0/2905431569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbdf815ef80 0x7fbdf81f8dd0 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.665+0000 7fbdff100640 1 --2- 172.21.15.55:0/2905431569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbdf815eba0 0x7fbdf81f8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.665+0000 7fbdff100640 1 --2- 172.21.15.55:0/2905431569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbdf80ceeb0 0x7fbdf8164f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.665+0000 7fbdff100640 1 -- 172.21.15.55:0/2905431569 >> 172.21.15.55:0/2905431569 conn(0x7fbdf8069d00 msgr2=0x7fbdf80afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:33.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.665+0000 7fbdff100640 1 -- 172.21.15.55:0/2905431569 shutdown_connections 2023-08-25T05:35:33.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.665+0000 7fbdff100640 1 -- 172.21.15.55:0/2905431569 wait complete. 2023-08-25T05:35:33.687 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T05:35:33.688 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T05:35:33.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.829+0000 7fafd698f640 1 Processor -- start 2023-08-25T05:35:33.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.833+0000 7fafd698f640 1 -- start start 2023-08-25T05:35:33.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.833+0000 7fafd698f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fafd00cb020 0x7fafd00c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:33.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.833+0000 7fafd698f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafd00cdd50 0x7fafd00cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:33.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.833+0000 7fafd698f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fafd006c720 0x7fafd006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:33.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.833+0000 7fafd698f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd006d0d0 con 0x7fafd006c720 2023-08-25T05:35:33.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.833+0000 7fafd698f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd00cbca0 con 0x7fafd00cb020 2023-08-25T05:35:33.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.833+0000 7fafd698f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd00c9470 con 0x7fafd00cdd50 2023-08-25T05:35:33.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.833+0000 7fafd4f2c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fafd006c720 0x7fafd006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:33.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.833+0000 7fafd4f2c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fafd006c720 0x7fafd006cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59904/0 (socket says 172.21.15.55:59904) 2023-08-25T05:35:33.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.833+0000 7fafd4f2c640 1 -- 172.21.15.55:0/953448023 learned_addr learned my addr 172.21.15.55:0/953448023 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:33.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.833+0000 7fafcf7fe640 1 --2- 172.21.15.55:0/953448023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafd00cdd50 0x7fafd00cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:33.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.833+0000 7fafcffff640 1 --2- 172.21.15.55:0/953448023 >> v2:172.21.15.110:3300/0 conn(0x7fafd00cb020 0x7fafd00c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:33.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.833+0000 7fafd4f2c640 1 -- 172.21.15.55:0/953448023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafd00cdd50 msgr2=0x7fafd00cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:33.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.833+0000 7fafd4f2c640 1 --2- 172.21.15.55:0/953448023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafd00cdd50 0x7fafd00cb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.833+0000 7fafd4f2c640 1 -- 172.21.15.55:0/953448023 >> v2:172.21.15.110:3300/0 conn(0x7fafd00cb020 msgr2=0x7fafd00c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:33.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.833+0000 7fafd4f2c640 1 --2- 172.21.15.55:0/953448023 >> v2:172.21.15.110:3300/0 conn(0x7fafd00cb020 0x7fafd00c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.833+0000 7fafd4f2c640 1 -- 172.21.15.55:0/953448023 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd00ce1e0 con 0x7fafd006c720 2023-08-25T05:35:33.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.833+0000 7fafcffff640 1 --2- 172.21.15.55:0/953448023 >> v2:172.21.15.110:3300/0 conn(0x7fafd00cb020 0x7fafd00c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:33.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.837+0000 7fafd4f2c640 1 --2- 172.21.15.55:0/953448023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd006c720 0x7fafd006cb90 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7fafd006daf0 tx=0x7fafc801eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eec6a226aa7bd70 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:33.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.837+0000 7fafceffd640 1 -- 172.21.15.55:0/953448023 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc800b2d0 con 0x7fafd006c720 2023-08-25T05:35:33.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.837+0000 7fafceffd640 1 -- 172.21.15.55:0/953448023 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc800b430 con 0x7fafd006c720 2023-08-25T05:35:33.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.837+0000 7fafceffd640 1 -- 172.21.15.55:0/953448023 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc80a7ae0 con 0x7fafd006c720 2023-08-25T05:35:33.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.837+0000 7fafd698f640 1 -- 172.21.15.55:0/953448023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd006c720 msgr2=0x7fafd006cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:33.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.837+0000 7fafd698f640 1 --2- 172.21.15.55:0/953448023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd006c720 0x7fafd006cb90 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7fafd006daf0 tx=0x7fafc801eb40 comp rx=0 tx=0).stop 2023-08-25T05:35:33.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.837+0000 7fafd698f640 1 -- 172.21.15.55:0/953448023 shutdown_connections 2023-08-25T05:35:33.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.837+0000 7fafd698f640 1 --2- 172.21.15.55:0/953448023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd006c720 0x7fafd006cb90 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.837+0000 7fafd698f640 1 --2- 172.21.15.55:0/953448023 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafd00cdd50 0x7fafd00cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.837+0000 7fafd698f640 1 --2- 172.21.15.55:0/953448023 >> v2:172.21.15.110:3300/0 conn(0x7fafd00cb020 0x7fafd00c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.837+0000 7fafd698f640 1 -- 172.21.15.55:0/953448023 >> 172.21.15.55:0/953448023 conn(0x7fafd0069900 msgr2=0x7fafd0069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:33.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.837+0000 7fafd698f640 1 -- 172.21.15.55:0/953448023 shutdown_connections 2023-08-25T05:35:33.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.837+0000 7fafd698f640 1 -- 172.21.15.55:0/953448023 wait complete. 2023-08-25T05:35:33.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.837+0000 7fafd698f640 1 Processor -- start 2023-08-25T05:35:33.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.837+0000 7fafd698f640 1 -- start start 2023-08-25T05:35:33.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafd698f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafd006c720 0x7fafd009aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:33.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafd698f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd00cb020 0x7fafd00c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:33.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafd698f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafd00cdd50 0x7fafd00b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:33.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafd698f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd00c82f0 con 0x7fafd00cb020 2023-08-25T05:35:33.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafd698f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd00ade20 con 0x7fafd00cdd50 2023-08-25T05:35:33.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafd698f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd009b0b0 con 0x7fafd006c720 2023-08-25T05:35:33.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafcf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd00cb020 0x7fafd00c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:33.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafcf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd00cb020 0x7fafd00c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59920/0 (socket says 172.21.15.55:59920) 2023-08-25T05:35:33.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafcf7fe640 1 -- 172.21.15.55:0/352766949 learned_addr learned my addr 172.21.15.55:0/352766949 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:33.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafcffff640 1 --2- 172.21.15.55:0/352766949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafd006c720 0x7fafd009aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:33.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafd4f2c640 1 --2- 172.21.15.55:0/352766949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafd00cdd50 0x7fafd00b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:33.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafcf7fe640 1 -- 172.21.15.55:0/352766949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafd006c720 msgr2=0x7fafd009aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:33.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafcf7fe640 1 --2- 172.21.15.55:0/352766949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafd006c720 0x7fafd009aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafcf7fe640 1 -- 172.21.15.55:0/352766949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafd00cdd50 msgr2=0x7fafd00b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:33.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafcf7fe640 1 --2- 172.21.15.55:0/352766949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafd00cdd50 0x7fafd00b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:33.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafcf7fe640 1 -- 172.21.15.55:0/352766949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc800bd40 con 0x7fafd00cb020 2023-08-25T05:35:33.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafcf7fe640 1 --2- 172.21.15.55:0/352766949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd00cb020 0x7fafd00c7db0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fafc400d5f0 tx=0x7fafc400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:33.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafccff9640 1 -- 172.21.15.55:0/352766949 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc40125f0 con 0x7fafd00cb020 2023-08-25T05:35:33.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafccff9640 1 -- 172.21.15.55:0/352766949 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc4012750 con 0x7fafd00cb020 2023-08-25T05:35:33.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafd698f640 1 -- 172.21.15.55:0/352766949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd009b390 con 0x7fafd00cb020 2023-08-25T05:35:33.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafccff9640 1 -- 172.21.15.55:0/352766949 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc4012ae0 con 0x7fafd00cb020 2023-08-25T05:35:33.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafd698f640 1 -- 172.21.15.55:0/352766949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd00ae070 con 0x7fafd00cb020 2023-08-25T05:35:33.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.841+0000 7fafd698f640 1 -- 172.21.15.55:0/352766949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd009b840 con 0x7fafd00cb020 2023-08-25T05:35:33.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.845+0000 7fafccff9640 1 -- 172.21.15.55:0/352766949 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fafc4012c40 con 0x7fafd00cb020 2023-08-25T05:35:33.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.845+0000 7fafccff9640 1 --2- 172.21.15.55:0/352766949 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fafbc0657a0 0x7fafbc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:33.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.845+0000 7fafccff9640 1 -- 172.21.15.55:0/352766949 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fafc4083470 con 0x7fafd00cb020 2023-08-25T05:35:33.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.845+0000 7fafcffff640 1 --2- 172.21.15.55:0/352766949 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fafbc0657a0 0x7fafbc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:33.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.845+0000 7fafcffff640 1 --2- 172.21.15.55:0/352766949 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fafbc0657a0 0x7fafbc067c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fafc000ab60 tx=0x7fafc0008040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:33.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:33.849+0000 7fafccff9640 1 -- 172.21.15.55:0/352766949 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fafc4050d20 con 0x7fafd00cb020 2023-08-25T05:35:34.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.005+0000 7fafd698f640 1 -- 172.21.15.55:0/352766949 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fafd0073ec0 con 0x7fafd00cb020 2023-08-25T05:35:34.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.005+0000 7fafccff9640 1 -- 172.21.15.55:0/352766949 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v180) v1 ==== 93+0+10 (secure 0 0 0) 0x7fafc4007380 con 0x7fafd00cb020 2023-08-25T05:35:34.011 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T05:35:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.009+0000 7fafd698f640 1 -- 172.21.15.55:0/352766949 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fafbc0657a0 msgr2=0x7fafbc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.009+0000 7fafd698f640 1 --2- 172.21.15.55:0/352766949 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fafbc0657a0 0x7fafbc067c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fafc000ab60 tx=0x7fafc0008040 comp rx=0 tx=0).stop 2023-08-25T05:35:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.009+0000 7fafd698f640 1 -- 172.21.15.55:0/352766949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd00cb020 msgr2=0x7fafd00c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.009+0000 7fafd698f640 1 --2- 172.21.15.55:0/352766949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd00cb020 0x7fafd00c7db0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fafc400d5f0 tx=0x7fafc400dab0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.009+0000 7fafd698f640 1 -- 172.21.15.55:0/352766949 shutdown_connections 2023-08-25T05:35:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.009+0000 7fafd698f640 1 --2- 172.21.15.55:0/352766949 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fafbc0657a0 0x7fafbc067c60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.009+0000 7fafd698f640 1 --2- 172.21.15.55:0/352766949 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafd00cdd50 0x7fafd00b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.009+0000 7fafd698f640 1 --2- 172.21.15.55:0/352766949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafd00cb020 0x7fafd00c7db0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.009+0000 7fafd698f640 1 --2- 172.21.15.55:0/352766949 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafd006c720 0x7fafd009aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.009+0000 7fafd698f640 1 -- 172.21.15.55:0/352766949 >> 172.21.15.55:0/352766949 conn(0x7fafd0069900 msgr2=0x7fafd00ab420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.009+0000 7fafd698f640 1 -- 172.21.15.55:0/352766949 shutdown_connections 2023-08-25T05:35:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.009+0000 7fafd698f640 1 -- 172.21.15.55:0/352766949 wait complete. 2023-08-25T05:35:34.031 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T05:35:34.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.173+0000 7f759cbba640 1 Processor -- start 2023-08-25T05:35:34.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.173+0000 7f759cbba640 1 -- start start 2023-08-25T05:35:34.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.177+0000 7f759cbba640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75980c9830 0x7f759809bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:34.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.177+0000 7f759cbba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759815abd0 con 0x7f759806c020 2023-08-25T05:35:34.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.177+0000 7f759cbba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75980c8ab0 con 0x7f759815a7f0 2023-08-25T05:35:34.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.177+0000 7f759cbba640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75980c8d50 con 0x7f75980c9830 2023-08-25T05:35:34.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.177+0000 7f758ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75980c9830 0x7f759809bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:34.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.177+0000 7f7596d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f759806c020 0x7f75980acff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59338/0 (socket says 172.21.15.55:59338) 2023-08-25T05:35:34.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.177+0000 7f758ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f75980c9830 0x7f759809bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59930/0 (socket says 172.21.15.55:59930) 2023-08-25T05:35:34.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.177+0000 7f7596d9d640 1 -- 172.21.15.55:0/1495650048 learned_addr learned my addr 172.21.15.55:0/1495650048 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:34.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.177+0000 7f758ffff640 1 -- 172.21.15.55:0/1495650048 >> v1:172.21.15.110:6789/0 conn(0x7f759815a7f0 legacy=0x7f7598070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:34.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.177+0000 7f758ffff640 1 -- 172.21.15.55:0/1495650048 >> v1:172.21.15.55:6789/0 conn(0x7f759806c020 legacy=0x7f75980acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:34.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.177+0000 7f758ffff640 1 -- 172.21.15.55:0/1495650048 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75980c9030 con 0x7f75980c9830 2023-08-25T05:35:34.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.177+0000 7f7595d9b640 1 -- 172.21.15.55:0/1495650048 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374297326 0 0) 0x7f759815abd0 con 0x7f759806c020 2023-08-25T05:35:34.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.177+0000 7f758ffff640 1 --2- 172.21.15.55:0/1495650048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75980c9830 0x7f759809bde0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f75800097c0 tx=0x7f758001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f764a3ff8306f641 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:34.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.177+0000 7f7595d9b640 1 -- 172.21.15.55:0/1495650048 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75800ab600 con 0x7f75980c9830 2023-08-25T05:35:34.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f7595d9b640 1 -- 172.21.15.55:0/1495650048 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75800a7050 con 0x7f75980c9830 2023-08-25T05:35:34.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f7595d9b640 1 -- 172.21.15.55:0/1495650048 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75800ab980 con 0x7f75980c9830 2023-08-25T05:35:34.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f759cbba640 1 -- 172.21.15.55:0/1495650048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75980c9830 msgr2=0x7f759809bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:34.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f759cbba640 1 --2- 172.21.15.55:0/1495650048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75980c9830 0x7f759809bde0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f75800097c0 tx=0x7f758001c410 comp rx=0 tx=0).stop 2023-08-25T05:35:34.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f759cbba640 1 -- 172.21.15.55:0/1495650048 shutdown_connections 2023-08-25T05:35:34.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f759cbba640 1 --2- 172.21.15.55:0/1495650048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75980c9830 0x7f759809bde0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f759cbba640 1 -- 172.21.15.55:0/1495650048 >> 172.21.15.55:0/1495650048 conn(0x7f7598069900 msgr2=0x7f7598069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:34.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f759cbba640 1 -- 172.21.15.55:0/1495650048 shutdown_connections 2023-08-25T05:35:34.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f759cbba640 1 -- 172.21.15.55:0/1495650048 wait complete. 2023-08-25T05:35:34.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f759cbba640 1 Processor -- start 2023-08-25T05:35:34.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f759cbba640 1 -- start start 2023-08-25T05:35:34.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f759cbba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f759806c020 0x7f75980cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:34.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f759cbba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75980c9830 0x7f75980c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:34.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f759cbba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f759815a7f0 0x7f759809b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:34.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f759cbba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75980cce70 con 0x7f759806c020 2023-08-25T05:35:34.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f759cbba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75980c5d10 con 0x7f759815a7f0 2023-08-25T05:35:34.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f759cbba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75980cd090 con 0x7f75980c9830 2023-08-25T05:35:34.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f759659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f759806c020 0x7f75980cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:34.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f759659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f759806c020 0x7f75980cc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59942/0 (socket says 172.21.15.55:59942) 2023-08-25T05:35:34.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f759659c640 1 -- 172.21.15.55:0/2406941886 learned_addr learned my addr 172.21.15.55:0/2406941886 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:34.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f7596d9d640 1 --2- 172.21.15.55:0/2406941886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f759815a7f0 0x7f759809b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:34.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.181+0000 7f758ffff640 1 --2- 172.21.15.55:0/2406941886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75980c9830 0x7f75980c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:34.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.185+0000 7f759659c640 1 -- 172.21.15.55:0/2406941886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75980c9830 msgr2=0x7f75980c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:34.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.185+0000 7f759659c640 1 --2- 172.21.15.55:0/2406941886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75980c9830 0x7f75980c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.185+0000 7f759659c640 1 -- 172.21.15.55:0/2406941886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f759815a7f0 msgr2=0x7f759809b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:34.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.185+0000 7f759659c640 1 --2- 172.21.15.55:0/2406941886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f759815a7f0 0x7f759809b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.185+0000 7f759659c640 1 -- 172.21.15.55:0/2406941886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7580009420 con 0x7f759806c020 2023-08-25T05:35:34.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.185+0000 7f758ffff640 1 --2- 172.21.15.55:0/2406941886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75980c9830 0x7f75980c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:34.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.185+0000 7f759659c640 1 --2- 172.21.15.55:0/2406941886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f759806c020 0x7f75980cc930 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f758800b420 tx=0x7f758800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:34.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.185+0000 7f758effd640 1 -- 172.21.15.55:0/2406941886 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7588011830 con 0x7f759806c020 2023-08-25T05:35:34.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.185+0000 7f758effd640 1 -- 172.21.15.55:0/2406941886 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75880119b0 con 0x7f759806c020 2023-08-25T05:35:34.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.185+0000 7f758effd640 1 -- 172.21.15.55:0/2406941886 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7588011d60 con 0x7f759806c020 2023-08-25T05:35:34.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.185+0000 7f759cbba640 1 -- 172.21.15.55:0/2406941886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75980adc90 con 0x7f759806c020 2023-08-25T05:35:34.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.185+0000 7f759cbba640 1 -- 172.21.15.55:0/2406941886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75980cd650 con 0x7f759806c020 2023-08-25T05:35:34.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.185+0000 7f759cbba640 1 -- 172.21.15.55:0/2406941886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759806d5b0 con 0x7f759806c020 2023-08-25T05:35:34.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.185+0000 7f758effd640 1 -- 172.21.15.55:0/2406941886 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f758801b460 con 0x7f759806c020 2023-08-25T05:35:34.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.185+0000 7f758effd640 1 --2- 172.21.15.55:0/2406941886 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f75780657a0 0x7f7578067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:34.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.185+0000 7f758effd640 1 -- 172.21.15.55:0/2406941886 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f7588082dd0 con 0x7f759806c020 2023-08-25T05:35:34.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.189+0000 7f758ffff640 1 --2- 172.21.15.55:0/2406941886 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f75780657a0 0x7f7578067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:34.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.189+0000 7f758ffff640 1 --2- 172.21.15.55:0/2406941886 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f75780657a0 0x7f7578067c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f75800ad000 tx=0x7f75800a6000 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:34.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.189+0000 7f758effd640 1 -- 172.21.15.55:0/2406941886 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f75880505d0 con 0x7f759806c020 2023-08-25T05:35:34.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.353+0000 7f759cbba640 1 -- 172.21.15.55:0/2406941886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7598073ec0 con 0x7f759806c020 2023-08-25T05:35:34.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.353+0000 7f758effd640 1 -- 172.21.15.55:0/2406941886 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v180) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7588053bf0 con 0x7f759806c020 2023-08-25T05:35:34.358 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T05:35:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.357+0000 7f759cbba640 1 -- 172.21.15.55:0/2406941886 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f75780657a0 msgr2=0x7f7578067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.357+0000 7f759cbba640 1 --2- 172.21.15.55:0/2406941886 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f75780657a0 0x7f7578067c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f75800ad000 tx=0x7f75800a6000 comp rx=0 tx=0).stop 2023-08-25T05:35:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.357+0000 7f759cbba640 1 -- 172.21.15.55:0/2406941886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f759806c020 msgr2=0x7f75980cc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:34.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.357+0000 7f759cbba640 1 --2- 172.21.15.55:0/2406941886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f759806c020 0x7f75980cc930 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f758800b420 tx=0x7f758800b8e0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.357+0000 7f759cbba640 1 -- 172.21.15.55:0/2406941886 shutdown_connections 2023-08-25T05:35:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.357+0000 7f759cbba640 1 --2- 172.21.15.55:0/2406941886 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f75780657a0 0x7f7578067c60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.357+0000 7f759cbba640 1 --2- 172.21.15.55:0/2406941886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f759815a7f0 0x7f759809b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.357+0000 7f759cbba640 1 --2- 172.21.15.55:0/2406941886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75980c9830 0x7f75980c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.357+0000 7f759cbba640 1 --2- 172.21.15.55:0/2406941886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f759806c020 0x7f75980cc930 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.357+0000 7f759cbba640 1 -- 172.21.15.55:0/2406941886 >> 172.21.15.55:0/2406941886 conn(0x7f7598069900 msgr2=0x7f759815e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.357+0000 7f759cbba640 1 -- 172.21.15.55:0/2406941886 shutdown_connections 2023-08-25T05:35:34.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.357+0000 7f759cbba640 1 -- 172.21.15.55:0/2406941886 wait complete. 2023-08-25T05:35:34.379 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-25T05:35:34.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.521+0000 7f7350b2c640 1 Processor -- start 2023-08-25T05:35:34.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.521+0000 7f7350b2c640 1 -- start start 2023-08-25T05:35:34.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.521+0000 7f7350b2c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0c9830 0x7f734c09bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:34.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.521+0000 7f7350b2c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734c15abd0 con 0x7f734c15a7f0 2023-08-25T05:35:34.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.521+0000 7f7350b2c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734c0c8ab0 con 0x7f734c06c020 2023-08-25T05:35:34.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.521+0000 7f7350b2c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734c0c8d50 con 0x7f734c0c9830 2023-08-25T05:35:34.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.521+0000 7f734a59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f734c15a7f0 0x7f734c070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59342/0 (socket says 172.21.15.55:59342) 2023-08-25T05:35:34.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.521+0000 7f734a59c640 1 -- 172.21.15.55:0/1377197428 learned_addr learned my addr 172.21.15.55:0/1377197428 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:34.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.521+0000 7f7343fff640 1 --2- 172.21.15.55:0/1377197428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0c9830 0x7f734c09bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:34.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7349d9b640 1 -- 172.21.15.55:0/1377197428 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324091494 0 0) 0x7f734c15abd0 con 0x7f734c15a7f0 2023-08-25T05:35:34.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7349d9b640 1 -- 172.21.15.55:0/1377197428 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7338003530 con 0x7f734c15a7f0 2023-08-25T05:35:34.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7349d9b640 1 -- 172.21.15.55:0/1377197428 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2514108699 0 0) 0x7f7338003530 con 0x7f734c15a7f0 2023-08-25T05:35:34.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7349d9b640 1 -- 172.21.15.55:0/1377197428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0c9830 msgr2=0x7f734c09bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:34.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7349d9b640 1 --2- 172.21.15.55:0/1377197428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0c9830 0x7f734c09bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7349d9b640 1 -- 172.21.15.55:0/1377197428 >> v1:172.21.15.110:6789/0 conn(0x7f734c06c020 legacy=0x7f734c0acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:34.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7349d9b640 1 -- 172.21.15.55:0/1377197428 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c0c9030 con 0x7f734c15a7f0 2023-08-25T05:35:34.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7349d9b640 1 -- 172.21.15.55:0/1377197428 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f733c001800 con 0x7f734c15a7f0 2023-08-25T05:35:34.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7349d9b640 1 -- 172.21.15.55:0/1377197428 >> v1:172.21.15.55:6789/0 conn(0x7f734c15a7f0 legacy=0x7f734c070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:34.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7349d9b640 1 --2- 172.21.15.55:0/1377197428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73380039b0 0x7f7338003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:34.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7349d9b640 1 --2- 172.21.15.55:0/1377197428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73380047d0 0x7f7338004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:34.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7349d9b640 1 --2- 172.21.15.55:0/1377197428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0c9830 0x7f7338005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:34.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7349d9b640 1 -- 172.21.15.55:0/1377197428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c0c8d50 con 0x7f73380047d0 2023-08-25T05:35:34.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7349d9b640 1 -- 172.21.15.55:0/1377197428 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733800ba40 con 0x7f73380039b0 2023-08-25T05:35:34.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7349d9b640 1 -- 172.21.15.55:0/1377197428 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733800bc00 con 0x7f734c0c9830 2023-08-25T05:35:34.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7343fff640 1 --2- 172.21.15.55:0/1377197428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73380047d0 0x7f7338004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:34.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f734ad9d640 1 --2- 172.21.15.55:0/1377197428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0c9830 0x7f7338005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:34.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f734a59c640 1 --2- 172.21.15.55:0/1377197428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73380039b0 0x7f7338003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:34.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7343fff640 1 -- 172.21.15.55:0/1377197428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0c9830 msgr2=0x7f7338005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:34.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7343fff640 1 --2- 172.21.15.55:0/1377197428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0c9830 0x7f7338005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7343fff640 1 -- 172.21.15.55:0/1377197428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73380039b0 msgr2=0x7f7338003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:34.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7343fff640 1 --2- 172.21.15.55:0/1377197428 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73380039b0 0x7f7338003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7343fff640 1 -- 172.21.15.55:0/1377197428 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7338003530 con 0x7f73380047d0 2023-08-25T05:35:34.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f734ad9d640 1 --2- 172.21.15.55:0/1377197428 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c0c9830 0x7f7338005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:34.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.525+0000 7f7343fff640 1 --2- 172.21.15.55:0/1377197428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73380047d0 0x7f7338004c50 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f734c09c320 tx=0x7f733401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25335710069fff4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:34.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f7349d9b640 1 -- 172.21.15.55:0/1377197428 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73340a5590 con 0x7f73380047d0 2023-08-25T05:35:34.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f7349d9b640 1 -- 172.21.15.55:0/1377197428 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73340a56f0 con 0x7f73380047d0 2023-08-25T05:35:34.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f7349d9b640 1 -- 172.21.15.55:0/1377197428 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73340a5a60 con 0x7f73380047d0 2023-08-25T05:35:34.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f7350b2c640 1 -- 172.21.15.55:0/1377197428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73380047d0 msgr2=0x7f7338004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:34.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f7350b2c640 1 --2- 172.21.15.55:0/1377197428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73380047d0 0x7f7338004c50 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f734c09c320 tx=0x7f733401c9d0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f734ad9d640 1 -- 172.21.15.55:0/1377197428 reap_dead start 2023-08-25T05:35:34.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f7350b2c640 1 -- 172.21.15.55:0/1377197428 shutdown_connections 2023-08-25T05:35:34.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f7350b2c640 1 -- 172.21.15.55:0/1377197428 >> 172.21.15.55:0/1377197428 conn(0x7f734c069900 msgr2=0x7f734c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:34.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f7350b2c640 1 -- 172.21.15.55:0/1377197428 shutdown_connections 2023-08-25T05:35:34.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f7350b2c640 1 -- 172.21.15.55:0/1377197428 wait complete. 2023-08-25T05:35:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f7350b2c640 1 Processor -- start 2023-08-25T05:35:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f7350b2c640 1 -- start start 2023-08-25T05:35:34.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f7350b2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73380047d0 0x7f734c1f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f7350b2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f734c1f1a80 0x7f734c1f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f7350b2c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c1f1f00 0x7f734c1f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f7350b2c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c1f6200 con 0x7f73380047d0 2023-08-25T05:35:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f7350b2c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734c1f64e0 con 0x7f734c1f1a80 2023-08-25T05:35:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f7350b2c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734c1f23f0 con 0x7f734c1f1f00 2023-08-25T05:35:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f734a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73380047d0 0x7f734c1f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f734a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73380047d0 0x7f734c1f2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59972/0 (socket says 172.21.15.55:59972) 2023-08-25T05:35:34.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.529+0000 7f734a59c640 1 -- 172.21.15.55:0/3193827634 learned_addr learned my addr 172.21.15.55:0/3193827634 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:34.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.533+0000 7f734ad9d640 1 --2- 172.21.15.55:0/3193827634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c1f1f00 0x7f734c1f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:34.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.533+0000 7f7343fff640 1 --2- 172.21.15.55:0/3193827634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f734c1f1a80 0x7f734c1f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:34.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.533+0000 7f734a59c640 1 -- 172.21.15.55:0/3193827634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c1f1f00 msgr2=0x7f734c1f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:34.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.533+0000 7f734a59c640 1 --2- 172.21.15.55:0/3193827634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c1f1f00 0x7f734c1f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.533+0000 7f734a59c640 1 -- 172.21.15.55:0/3193827634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f734c1f1a80 msgr2=0x7f734c1f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:34.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.533+0000 7f734a59c640 1 --2- 172.21.15.55:0/3193827634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f734c1f1a80 0x7f734c1f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.533+0000 7f734a59c640 1 -- 172.21.15.55:0/3193827634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c1f26d0 con 0x7f73380047d0 2023-08-25T05:35:34.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.533+0000 7f7343fff640 1 --2- 172.21.15.55:0/3193827634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f734c1f1a80 0x7f734c1f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:34.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.533+0000 7f734a59c640 1 --2- 172.21.15.55:0/3193827634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73380047d0 0x7f734c1f2bf0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f733c0011e0 tx=0x7f733c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:34.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.533+0000 7f7342ffd640 1 -- 172.21.15.55:0/3193827634 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c014600 con 0x7f73380047d0 2023-08-25T05:35:34.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.533+0000 7f7342ffd640 1 -- 172.21.15.55:0/3193827634 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c00d030 con 0x7f73380047d0 2023-08-25T05:35:34.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.533+0000 7f7350b2c640 1 -- 172.21.15.55:0/3193827634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734c0c4ec0 con 0x7f73380047d0 2023-08-25T05:35:34.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.533+0000 7f7342ffd640 1 -- 172.21.15.55:0/3193827634 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c0149c0 con 0x7f73380047d0 2023-08-25T05:35:34.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.533+0000 7f7350b2c640 1 -- 172.21.15.55:0/3193827634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f734c0c7830 con 0x7f73380047d0 2023-08-25T05:35:34.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.533+0000 7f7350b2c640 1 -- 172.21.15.55:0/3193827634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734c06d5b0 con 0x7f73380047d0 2023-08-25T05:35:34.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.533+0000 7f7342ffd640 1 -- 172.21.15.55:0/3193827634 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f733c014b20 con 0x7f73380047d0 2023-08-25T05:35:34.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.533+0000 7f7342ffd640 1 --2- 172.21.15.55:0/3193827634 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f732c0657a0 0x7f732c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:34.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.537+0000 7f7342ffd640 1 -- 172.21.15.55:0/3193827634 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6328+0+0 (secure 0 0 0) 0x7f733c0859d0 con 0x7f73380047d0 2023-08-25T05:35:34.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.537+0000 7f7343fff640 1 --2- 172.21.15.55:0/3193827634 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f732c0657a0 0x7f732c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:34.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.537+0000 7f7343fff640 1 --2- 172.21.15.55:0/3193827634 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f732c0657a0 0x7f732c067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f73340af000 tx=0x7f73340046d0 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:34.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.537+0000 7f7342ffd640 1 -- 172.21.15.55:0/3193827634 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f733c053150 con 0x7f73380047d0 2023-08-25T05:35:34.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.697+0000 7f7350b2c640 1 -- 172.21.15.55:0/3193827634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f734c073ec0 con 0x7f73380047d0 2023-08-25T05:35:34.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.701+0000 7f7342ffd640 1 -- 172.21.15.55:0/3193827634 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v64)=0 v64) v1 ==== 122+0+0 (secure 0 0 0) 0x7f733c018020 con 0x7f73380047d0 2023-08-25T05:35:34.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.701+0000 7f7350b2c640 1 -- 172.21.15.55:0/3193827634 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f732c0657a0 msgr2=0x7f732c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:34.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.701+0000 7f7350b2c640 1 --2- 172.21.15.55:0/3193827634 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f732c0657a0 0x7f732c067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f73340af000 tx=0x7f73340046d0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.701+0000 7f7350b2c640 1 -- 172.21.15.55:0/3193827634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73380047d0 msgr2=0x7f734c1f2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:34.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.701+0000 7f7350b2c640 1 --2- 172.21.15.55:0/3193827634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73380047d0 0x7f734c1f2bf0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f733c0011e0 tx=0x7f733c00e530 comp rx=0 tx=0).stop 2023-08-25T05:35:34.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.701+0000 7f7350b2c640 1 -- 172.21.15.55:0/3193827634 shutdown_connections 2023-08-25T05:35:34.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.701+0000 7f7350b2c640 1 --2- 172.21.15.55:0/3193827634 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f732c0657a0 0x7f732c067c60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.701+0000 7f7350b2c640 1 --2- 172.21.15.55:0/3193827634 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f734c1f1f00 0x7f734c1f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.701+0000 7f7350b2c640 1 --2- 172.21.15.55:0/3193827634 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f734c1f1a80 0x7f734c1f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.701+0000 7f7350b2c640 1 --2- 172.21.15.55:0/3193827634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73380047d0 0x7f734c1f2bf0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.701+0000 7f7350b2c640 1 -- 172.21.15.55:0/3193827634 >> 172.21.15.55:0/3193827634 conn(0x7f734c069900 msgr2=0x7f734c15adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.701+0000 7f7350b2c640 1 -- 172.21.15.55:0/3193827634 shutdown_connections 2023-08-25T05:35:34.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:34.701+0000 7f7350b2c640 1 -- 172.21.15.55:0/3193827634 wait complete. 2023-08-25T05:35:34.726 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T05:35:34.726 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T05:35:34.774 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T05:35:34.842 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T05:35:34.842 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:35:34.843 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:35:34.852 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T05:35:34.852 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:35:34.853 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:35:34.862 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:35:34.862 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:35:34.862 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:35:34.906 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T05:35:34.907 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:35:34.907 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:35:34.916 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:35:34.917 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-25T05:35:34.917 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:35:35.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.089+0000 7fbfea511640 1 Processor -- start 2023-08-25T05:35:35.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.089+0000 7fbfea511640 1 -- start start 2023-08-25T05:35:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.089+0000 7fbfea511640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfe40d0da0 0x7fbfe40d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.089+0000 7fbfea511640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe40b29b0 con 0x7fbfe40cdde0 2023-08-25T05:35:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.089+0000 7fbfea511640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe40cfc80 con 0x7fbfe40b3e50 2023-08-25T05:35:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.089+0000 7fbfea511640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe40d16c0 con 0x7fbfe40d0da0 2023-08-25T05:35:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.089+0000 7fbfe3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfe40d0da0 0x7fbfe40d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:35.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.089+0000 7fbfe3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfe40d0da0 0x7fbfe40d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59974/0 (socket says 172.21.15.55:59974) 2023-08-25T05:35:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.089+0000 7fbfe3fff640 1 -- 172.21.15.55:0/2484508326 learned_addr learned my addr 172.21.15.55:0/2484508326 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.089+0000 7fbfe37fe640 1 --1- 172.21.15.55:0/2484508326 >> v1:172.21.15.55:6789/0 conn(0x7fbfe40cdde0 0x7fbfe40cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59358/0 (socket says 172.21.15.55:59358) 2023-08-25T05:35:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.089+0000 7fbfe3fff640 1 -- 172.21.15.55:0/2484508326 >> v1:172.21.15.110:6789/0 conn(0x7fbfe40b3e50 legacy=0x7fbfe40cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.089+0000 7fbfe3fff640 1 -- 172.21.15.55:0/2484508326 >> v1:172.21.15.55:6789/0 conn(0x7fbfe40cdde0 legacy=0x7fbfe40cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:35.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.089+0000 7fbfe3fff640 1 -- 172.21.15.55:0/2484508326 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe40b1dc0 con 0x7fbfe40d0da0 2023-08-25T05:35:35.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.093+0000 7fbfe3fff640 1 --2- 172.21.15.55:0/2484508326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40d0da0 0x7fbfe40d1180 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4006fd0 tx=0x7fbfd401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c53da75b90ddd3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.093+0000 7fbfe2ffd640 1 -- 172.21.15.55:0/2484508326 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd40ac640 con 0x7fbfe40d0da0 2023-08-25T05:35:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.093+0000 7fbfe2ffd640 1 -- 172.21.15.55:0/2484508326 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd40ac7a0 con 0x7fbfe40d0da0 2023-08-25T05:35:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.093+0000 7fbfe2ffd640 1 -- 172.21.15.55:0/2484508326 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd40acb30 con 0x7fbfe40d0da0 2023-08-25T05:35:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.093+0000 7fbfea511640 1 -- 172.21.15.55:0/2484508326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40d0da0 msgr2=0x7fbfe40d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.093+0000 7fbfea511640 1 --2- 172.21.15.55:0/2484508326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40d0da0 0x7fbfe40d1180 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4006fd0 tx=0x7fbfd401c400 comp rx=0 tx=0).stop 2023-08-25T05:35:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.093+0000 7fbfea511640 1 -- 172.21.15.55:0/2484508326 shutdown_connections 2023-08-25T05:35:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.093+0000 7fbfea511640 1 --2- 172.21.15.55:0/2484508326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40d0da0 0x7fbfe40d1180 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.093+0000 7fbfea511640 1 -- 172.21.15.55:0/2484508326 >> 172.21.15.55:0/2484508326 conn(0x7fbfe409bae0 msgr2=0x7fbfe40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.093+0000 7fbfea511640 1 -- 172.21.15.55:0/2484508326 shutdown_connections 2023-08-25T05:35:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.093+0000 7fbfea511640 1 -- 172.21.15.55:0/2484508326 wait complete. 2023-08-25T05:35:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfea511640 1 Processor -- start 2023-08-25T05:35:35.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfea511640 1 -- start start 2023-08-25T05:35:35.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfea511640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfe40b3e50 0x7fbfe40b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:35.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfea511640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfe40cdde0 0x7fbfe4151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:35.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfea511640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40d0da0 0x7fbfe4151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:35.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfea511640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe40cc770 con 0x7fbfe40d0da0 2023-08-25T05:35:35.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfea511640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe40c89b0 con 0x7fbfe40cdde0 2023-08-25T05:35:35.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfea511640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe40cb9d0 con 0x7fbfe40b3e50 2023-08-25T05:35:35.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfe8aae640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40d0da0 0x7fbfe4151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:35.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfe8aae640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40d0da0 0x7fbfe4151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59986/0 (socket says 172.21.15.55:59986) 2023-08-25T05:35:35.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfe8aae640 1 -- 172.21.15.55:0/1304423288 learned_addr learned my addr 172.21.15.55:0/1304423288 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:35.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfe37fe640 1 --2- 172.21.15.55:0/1304423288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfe40cdde0 0x7fbfe4151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:35.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfe3fff640 1 --2- 172.21.15.55:0/1304423288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfe40b3e50 0x7fbfe40b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfe8aae640 1 -- 172.21.15.55:0/1304423288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfe40b3e50 msgr2=0x7fbfe40b7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfe8aae640 1 --2- 172.21.15.55:0/1304423288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfe40b3e50 0x7fbfe40b7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfe8aae640 1 -- 172.21.15.55:0/1304423288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfe40cdde0 msgr2=0x7fbfe4151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfe8aae640 1 --2- 172.21.15.55:0/1304423288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfe40cdde0 0x7fbfe4151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfe8aae640 1 -- 172.21.15.55:0/1304423288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd4009480 con 0x7fbfe40d0da0 2023-08-25T05:35:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfe8aae640 1 --2- 172.21.15.55:0/1304423288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40d0da0 0x7fbfe4151ad0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00b9e0 tx=0x7fbfdc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfe0ff9640 1 -- 172.21.15.55:0/1304423288 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc003b80 con 0x7fbfe40d0da0 2023-08-25T05:35:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfe0ff9640 1 -- 172.21.15.55:0/1304423288 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc003ce0 con 0x7fbfe40d0da0 2023-08-25T05:35:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfe0ff9640 1 -- 172.21.15.55:0/1304423288 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc00cb60 con 0x7fbfe40d0da0 2023-08-25T05:35:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfea511640 1 -- 172.21.15.55:0/1304423288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe40cbcb0 con 0x7fbfe40d0da0 2023-08-25T05:35:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.097+0000 7fbfea511640 1 -- 172.21.15.55:0/1304423288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe40cc270 con 0x7fbfe40d0da0 2023-08-25T05:35:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.101+0000 7fbfea511640 1 -- 172.21.15.55:0/1304423288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe404dbe0 con 0x7fbfe40d0da0 2023-08-25T05:35:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.101+0000 7fbfe0ff9640 1 -- 172.21.15.55:0/1304423288 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fbfdc00ccc0 con 0x7fbfe40d0da0 2023-08-25T05:35:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.101+0000 7fbfe0ff9640 1 --2- 172.21.15.55:0/1304423288 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fbfd00657a0 0x7fbfd0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.101+0000 7fbfe0ff9640 1 -- 172.21.15.55:0/1304423288 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6328+0+0 (secure 0 0 0) 0x7fbfdc082e90 con 0x7fbfe40d0da0 2023-08-25T05:35:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.101+0000 7fbfe3fff640 1 --2- 172.21.15.55:0/1304423288 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fbfd00657a0 0x7fbfd0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:35.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.101+0000 7fbfe3fff640 1 --2- 172.21.15.55:0/1304423288 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fbfd00657a0 0x7fbfd0067c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40ae000 tx=0x7fbfd4009040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:35.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.105+0000 7fbfe0ff9640 1 -- 172.21.15.55:0/1304423288 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fbfdc050690 con 0x7fbfe40d0da0 2023-08-25T05:35:35.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.293+0000 7fbfea511640 1 -- 172.21.15.55:0/1304423288 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbfe40d0b80 con 0x7fbfe40d0da0 2023-08-25T05:35:35.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.293+0000 7fbfe0ff9640 1 -- 172.21.15.55:0/1304423288 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+3698 (secure 0 0 0) 0x7fbfdc084020 con 0x7fbfe40d0da0 2023-08-25T05:35:35.298 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:35.299 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":85,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/934106390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":934106390},{"type":"v1","addr":"172.21.15.110:6836","nonce":934106390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":78},{"gid":8303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/759320040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":759320040},{"type":"v1","addr":"172.21.15.110:6837","nonce":759320040}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":78},{"gid":10140,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2128942930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2128942930},{"type":"v1","addr":"172.21.15.55:6833","nonce":2128942930}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":77},{"gid":10671,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/660901635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":660901635},{"type":"v1","addr":"172.21.15.55:6835","nonce":660901635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":85}],"filesystems":[]} 2023-08-25T05:35:35.299 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 85 2023-08-25T05:35:35.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.297+0000 7fbfea511640 1 -- 172.21.15.55:0/1304423288 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fbfd00657a0 msgr2=0x7fbfd0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:35.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.297+0000 7fbfea511640 1 --2- 172.21.15.55:0/1304423288 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fbfd00657a0 0x7fbfd0067c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbfd40ae000 tx=0x7fbfd4009040 comp rx=0 tx=0).stop 2023-08-25T05:35:35.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.297+0000 7fbfea511640 1 -- 172.21.15.55:0/1304423288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40d0da0 msgr2=0x7fbfe4151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:35.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.297+0000 7fbfea511640 1 --2- 172.21.15.55:0/1304423288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40d0da0 0x7fbfe4151ad0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc00b9e0 tx=0x7fbfdc00bea0 comp rx=0 tx=0).stop 2023-08-25T05:35:35.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.297+0000 7fbfea511640 1 -- 172.21.15.55:0/1304423288 shutdown_connections 2023-08-25T05:35:35.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.297+0000 7fbfea511640 1 --2- 172.21.15.55:0/1304423288 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fbfd00657a0 0x7fbfd0067c60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:35.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.297+0000 7fbfea511640 1 --2- 172.21.15.55:0/1304423288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfe40d0da0 0x7fbfe4151ad0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:35.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.297+0000 7fbfea511640 1 --2- 172.21.15.55:0/1304423288 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfe40cdde0 0x7fbfe4151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:35.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.297+0000 7fbfea511640 1 --2- 172.21.15.55:0/1304423288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfe40b3e50 0x7fbfe40b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:35.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.297+0000 7fbfea511640 1 -- 172.21.15.55:0/1304423288 >> 172.21.15.55:0/1304423288 conn(0x7fbfe409bae0 msgr2=0x7fbfe415c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:35.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.297+0000 7fbfea511640 1 -- 172.21.15.55:0/1304423288 shutdown_connections 2023-08-25T05:35:35.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.297+0000 7fbfea511640 1 -- 172.21.15.55:0/1304423288 wait complete. 2023-08-25T05:35:35.320 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-25T05:35:35.320 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-25T05:35:35.320 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-25T05:35:35.321 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:35:35.321 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-25T05:35:35.321 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-25T05:35:35.321 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-25T05:35:35.321 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:35:35.322 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-25T05:35:35.322 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-25T05:35:35.322 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-25T05:35:35.322 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:35:35.323 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-25T05:35:35.323 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-25T05:35:35.323 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-25T05:35:35.323 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:35:35.333 INFO:tasks.ceph.mds.a:Stopped 2023-08-25T05:35:35.334 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-25T05:35:35.335 INFO:tasks.ceph.mds.c:Stopped 2023-08-25T05:35:35.335 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-25T05:35:35.337 INFO:tasks.ceph.mds.d:Stopped 2023-08-25T05:35:35.337 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-25T05:35:35.338 INFO:tasks.ceph.mds.b:Stopped 2023-08-25T05:35:35.338 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-25T05:35:35.381 INFO:tasks.ceph.mds.a:Started 2023-08-25T05:35:35.382 DEBUG:teuthology.parallel:result is None 2023-08-25T05:35:35.384 INFO:tasks.ceph.mds.c:Started 2023-08-25T05:35:35.384 DEBUG:teuthology.parallel:result is None 2023-08-25T05:35:35.386 INFO:tasks.ceph.mds.d:Started 2023-08-25T05:35:35.386 DEBUG:teuthology.parallel:result is None 2023-08-25T05:35:35.388 INFO:tasks.ceph.mds.b:Started 2023-08-25T05:35:35.388 DEBUG:teuthology.parallel:result is None 2023-08-25T05:35:35.389 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-25T05:35:35.470 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-08-25T05:35:35.470 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T05:35:35.478 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2023-08-25T05:35:35.479 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2023-08-25T05:35:35.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.533+0000 7ff3cb944640 1 Processor -- start 2023-08-25T05:35:35.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.533+0000 7ff3cb944640 1 -- start start 2023-08-25T05:35:35.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.537+0000 7ff3cb944640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3c40ce220 0x7ff3c40b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:35.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.537+0000 7ff3cb944640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c40b29b0 con 0x7ff3c40d0da0 2023-08-25T05:35:35.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.537+0000 7ff3cb944640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c40ce6b0 con 0x7ff3c40cdde0 2023-08-25T05:35:35.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.537+0000 7ff3cb944640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c40b1dc0 con 0x7ff3c40ce220 2023-08-25T05:35:35.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.537+0000 7ff3c96e0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff3c40d0da0 0x7ff3c40d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59368/0 (socket says 172.21.15.55:59368) 2023-08-25T05:35:35.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.537+0000 7ff3c96e0640 1 -- 172.21.15.55:0/293039997 learned_addr learned my addr 172.21.15.55:0/293039997 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:35.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.537+0000 7ff3c9ee1640 1 --2- 172.21.15.55:0/293039997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3c40ce220 0x7ff3c40b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:35.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.537+0000 7ff3bbfff640 1 -- 172.21.15.55:0/293039997 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805962737 0 0) 0x7ff3c40b29b0 con 0x7ff3c40d0da0 2023-08-25T05:35:35.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.537+0000 7ff3bbfff640 1 -- 172.21.15.55:0/293039997 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3b0003530 con 0x7ff3c40d0da0 2023-08-25T05:35:35.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.537+0000 7ff3bbfff640 1 -- 172.21.15.55:0/293039997 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221154741 0 0) 0x7ff3c40ce6b0 con 0x7ff3c40cdde0 2023-08-25T05:35:35.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.537+0000 7ff3bbfff640 1 -- 172.21.15.55:0/293039997 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3c40b29b0 con 0x7ff3c40cdde0 2023-08-25T05:35:35.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.537+0000 7ff3c9ee1640 1 -- 172.21.15.55:0/293039997 >> v1:172.21.15.110:6789/0 conn(0x7ff3c40cdde0 legacy=0x7ff3c40b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:35.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.537+0000 7ff3c9ee1640 1 -- 172.21.15.55:0/293039997 >> v1:172.21.15.55:6789/0 conn(0x7ff3c40d0da0 legacy=0x7ff3c40d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:35.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.537+0000 7ff3c9ee1640 1 -- 172.21.15.55:0/293039997 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c40b2080 con 0x7ff3c40ce220 2023-08-25T05:35:35.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3c9ee1640 1 --2- 172.21.15.55:0/293039997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3c40ce220 0x7ff3c40b3550 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009dc0 tx=0x7ff3bc01f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79c941d130dd003a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:35.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3bbfff640 1 -- 172.21.15.55:0/293039997 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc0af600 con 0x7ff3c40ce220 2023-08-25T05:35:35.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3bbfff640 1 -- 172.21.15.55:0/293039997 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3bc0ab050 con 0x7ff3c40ce220 2023-08-25T05:35:35.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3bbfff640 1 -- 172.21.15.55:0/293039997 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc0af980 con 0x7ff3c40ce220 2023-08-25T05:35:35.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3cb944640 1 -- 172.21.15.55:0/293039997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3c40ce220 msgr2=0x7ff3c40b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:35.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3cb944640 1 --2- 172.21.15.55:0/293039997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3c40ce220 0x7ff3c40b3550 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc009dc0 tx=0x7ff3bc01f150 comp rx=0 tx=0).stop 2023-08-25T05:35:35.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3cb944640 1 -- 172.21.15.55:0/293039997 shutdown_connections 2023-08-25T05:35:35.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3cb944640 1 --2- 172.21.15.55:0/293039997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3c40ce220 0x7ff3c40b3550 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:35.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3cb944640 1 -- 172.21.15.55:0/293039997 >> 172.21.15.55:0/293039997 conn(0x7ff3c409bae0 msgr2=0x7ff3c40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:35.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3cb944640 1 -- 172.21.15.55:0/293039997 shutdown_connections 2023-08-25T05:35:35.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3cb944640 1 -- 172.21.15.55:0/293039997 wait complete. 2023-08-25T05:35:35.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3cb944640 1 Processor -- start 2023-08-25T05:35:35.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3cb944640 1 -- start start 2023-08-25T05:35:35.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3cb944640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3c40cdde0 0x7ff3c4155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:35.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3cb944640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3c40ce220 0x7ff3c40c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:35.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3cb944640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3c40d0da0 0x7ff3c4155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:35.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3cb944640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c40b5730 con 0x7ff3c40cdde0 2023-08-25T05:35:35.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3cb944640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c4155890 con 0x7ff3c40ce220 2023-08-25T05:35:35.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3cb944640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c40b7a90 con 0x7ff3c40d0da0 2023-08-25T05:35:35.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.541+0000 7ff3c96e0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3c40cdde0 0x7ff3c4155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:35.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3c96e0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3c40cdde0 0x7ff3c4155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60022/0 (socket says 172.21.15.55:60022) 2023-08-25T05:35:35.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3c96e0640 1 -- 172.21.15.55:0/1130322409 learned_addr learned my addr 172.21.15.55:0/1130322409 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:35.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3c8edf640 1 --2- 172.21.15.55:0/1130322409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3c40ce220 0x7ff3c40c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:35.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3c9ee1640 1 --2- 172.21.15.55:0/1130322409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3c40d0da0 0x7ff3c4155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:35.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3c96e0640 1 -- 172.21.15.55:0/1130322409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3c40d0da0 msgr2=0x7ff3c4155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:35.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3c96e0640 1 --2- 172.21.15.55:0/1130322409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3c40d0da0 0x7ff3c4155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:35.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3c96e0640 1 -- 172.21.15.55:0/1130322409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3c40ce220 msgr2=0x7ff3c40c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:35.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3c96e0640 1 --2- 172.21.15.55:0/1130322409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3c40ce220 0x7ff3c40c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:35.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3c96e0640 1 -- 172.21.15.55:0/1130322409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc009a70 con 0x7ff3c40cdde0 2023-08-25T05:35:35.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3c8edf640 1 --2- 172.21.15.55:0/1130322409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3c40ce220 0x7ff3c40c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:35:35.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3c96e0640 1 --2- 172.21.15.55:0/1130322409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3c40cdde0 0x7ff3c4155a70 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000c700 tx=0x7ff3c000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:35.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3b9ffb640 1 -- 172.21.15.55:0/1130322409 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0007270 con 0x7ff3c40cdde0 2023-08-25T05:35:35.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3b9ffb640 1 -- 172.21.15.55:0/1130322409 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c00073d0 con 0x7ff3c40cdde0 2023-08-25T05:35:35.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3cb944640 1 -- 172.21.15.55:0/1130322409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c40b7d70 con 0x7ff3c40cdde0 2023-08-25T05:35:35.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3b9ffb640 1 -- 172.21.15.55:0/1130322409 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c00057b0 con 0x7ff3c40cdde0 2023-08-25T05:35:35.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3cb944640 1 -- 172.21.15.55:0/1130322409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c40b8330 con 0x7ff3c40cdde0 2023-08-25T05:35:35.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3cb944640 1 -- 172.21.15.55:0/1130322409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c40c62f0 con 0x7ff3c40cdde0 2023-08-25T05:35:35.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3b9ffb640 1 -- 172.21.15.55:0/1130322409 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7ff3c0005910 con 0x7ff3c40cdde0 2023-08-25T05:35:35.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3b9ffb640 1 --2- 172.21.15.55:0/1130322409 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7ff3a80657a0 0x7ff3a8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:35.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.545+0000 7ff3b9ffb640 1 -- 172.21.15.55:0/1130322409 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6328+0+0 (secure 0 0 0) 0x7ff3c00825c0 con 0x7ff3c40cdde0 2023-08-25T05:35:35.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.549+0000 7ff3c8edf640 1 --2- 172.21.15.55:0/1130322409 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7ff3a80657a0 0x7ff3a8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:35.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.549+0000 7ff3c8edf640 1 --2- 172.21.15.55:0/1130322409 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7ff3a80657a0 0x7ff3a8067c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40b4020 tx=0x7ff3b4009040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:35.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.549+0000 7ff3b9ffb640 1 -- 172.21.15.55:0/1130322409 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff3c004ff00 con 0x7ff3c40cdde0 2023-08-25T05:35:35.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:35.717+0000 7ff3cb944640 1 -- 172.21.15.55:0/1130322409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff3c404dbe0 con 0x7ff3c40cdde0 2023-08-25T05:35:36.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.337+0000 7ff3b9ffb640 1 -- 172.21.15.55:0/1130322409 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v182) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff3c0053520 con 0x7ff3c40cdde0 2023-08-25T05:35:36.344 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-08-25T05:35:36.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.341+0000 7ff3cb944640 1 -- 172.21.15.55:0/1130322409 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7ff3a80657a0 msgr2=0x7ff3a8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:36.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.341+0000 7ff3cb944640 1 --2- 172.21.15.55:0/1130322409 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7ff3a80657a0 0x7ff3a8067c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff3c40b4020 tx=0x7ff3b4009040 comp rx=0 tx=0).stop 2023-08-25T05:35:36.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.341+0000 7ff3cb944640 1 -- 172.21.15.55:0/1130322409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3c40cdde0 msgr2=0x7ff3c4155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:36.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.341+0000 7ff3cb944640 1 --2- 172.21.15.55:0/1130322409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3c40cdde0 0x7ff3c4155a70 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000c700 tx=0x7ff3c000cbc0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.341+0000 7ff3cb944640 1 -- 172.21.15.55:0/1130322409 shutdown_connections 2023-08-25T05:35:36.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.341+0000 7ff3cb944640 1 --2- 172.21.15.55:0/1130322409 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7ff3a80657a0 0x7ff3a8067c60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.341+0000 7ff3cb944640 1 --2- 172.21.15.55:0/1130322409 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3c40d0da0 0x7ff3c4155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.341+0000 7ff3cb944640 1 --2- 172.21.15.55:0/1130322409 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3c40ce220 0x7ff3c40c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.341+0000 7ff3cb944640 1 --2- 172.21.15.55:0/1130322409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3c40cdde0 0x7ff3c4155a70 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.341+0000 7ff3cb944640 1 -- 172.21.15.55:0/1130322409 >> 172.21.15.55:0/1130322409 conn(0x7ff3c409bae0 msgr2=0x7ff3c40af440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:36.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.341+0000 7ff3cb944640 1 -- 172.21.15.55:0/1130322409 shutdown_connections 2023-08-25T05:35:36.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.341+0000 7ff3cb944640 1 -- 172.21.15.55:0/1130322409 wait complete. 2023-08-25T05:35:36.370 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-25T05:35:36.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.513+0000 7ff8660e5640 1 Processor -- start 2023-08-25T05:35:36.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.513+0000 7ff8660e5640 1 -- start start 2023-08-25T05:35:36.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.513+0000 7ff8660e5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff86015ef80 0x7ff8600ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:36.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.513+0000 7ff8660e5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8600cece0 0x7ff8600ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:36.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.513+0000 7ff8660e5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8600ac3a0 con 0x7ff86015eba0 2023-08-25T05:35:36.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.513+0000 7ff8660e5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8600cf170 con 0x7ff86015ef80 2023-08-25T05:35:36.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.513+0000 7ff8660e5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600b3150 con 0x7ff8600cece0 2023-08-25T05:35:36.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.513+0000 7ff85f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff86015eba0 0x7ff8600b2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59370/0 (socket says 172.21.15.55:59370) 2023-08-25T05:35:36.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.513+0000 7ff85f7fe640 1 -- 172.21.15.55:0/340109552 learned_addr learned my addr 172.21.15.55:0/340109552 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:36.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85effd640 1 -- 172.21.15.55:0/340109552 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134737044 0 0) 0x7ff8600ac3a0 con 0x7ff86015eba0 2023-08-25T05:35:36.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85effd640 1 -- 172.21.15.55:0/340109552 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff84c003530 con 0x7ff86015eba0 2023-08-25T05:35:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff857fff640 1 --2- 172.21.15.55:0/340109552 >> v2:172.21.15.110:3300/0 conn(0x7ff86015ef80 0x7ff8600ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85ffff640 1 --2- 172.21.15.55:0/340109552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8600cece0 0x7ff8600ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85effd640 1 -- 172.21.15.55:0/340109552 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 88078090 0 0) 0x7ff84c003530 con 0x7ff86015eba0 2023-08-25T05:35:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85effd640 1 -- 172.21.15.55:0/340109552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8600cece0 msgr2=0x7ff8600ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85effd640 1 --2- 172.21.15.55:0/340109552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8600cece0 0x7ff8600ab0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85effd640 1 -- 172.21.15.55:0/340109552 >> v2:172.21.15.110:3300/0 conn(0x7ff86015ef80 msgr2=0x7ff8600ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:36.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85effd640 1 --2- 172.21.15.55:0/340109552 >> v2:172.21.15.110:3300/0 conn(0x7ff86015ef80 0x7ff8600ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85effd640 1 -- 172.21.15.55:0/340109552 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8600b1390 con 0x7ff86015eba0 2023-08-25T05:35:36.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85effd640 1 -- 172.21.15.55:0/340109552 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7ff850001680 con 0x7ff86015eba0 2023-08-25T05:35:36.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85effd640 1 -- 172.21.15.55:0/340109552 >> v1:172.21.15.55:6789/0 conn(0x7ff86015eba0 legacy=0x7ff8600b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:36.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85effd640 1 --2- 172.21.15.55:0/340109552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8600cece0 0x7ff84c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:36.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85effd640 1 --2- 172.21.15.55:0/340109552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84c003f00 0x7ff84c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:36.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85effd640 1 --2- 172.21.15.55:0/340109552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff84c004d10 0x7ff84c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:36.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85effd640 1 -- 172.21.15.55:0/340109552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600cf170 con 0x7ff84c003f00 2023-08-25T05:35:36.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85effd640 1 -- 172.21.15.55:0/340109552 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600b3150 con 0x7ff84c004d10 2023-08-25T05:35:36.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85effd640 1 -- 172.21.15.55:0/340109552 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c00b9e0 con 0x7ff8600cece0 2023-08-25T05:35:36.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff857fff640 1 --2- 172.21.15.55:0/340109552 >> v2:172.21.15.110:3300/0 conn(0x7ff86015ef80 0x7ff8600ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:36.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff857fff640 1 --2- 172.21.15.55:0/340109552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84c003f00 0x7ff84c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:36.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85f7fe640 1 --2- 172.21.15.55:0/340109552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8600cece0 0x7ff84c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:36.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85ffff640 1 --2- 172.21.15.55:0/340109552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff84c004d10 0x7ff84c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:36.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff857fff640 1 -- 172.21.15.55:0/340109552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8600cece0 msgr2=0x7ff84c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:36.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff857fff640 1 --2- 172.21.15.55:0/340109552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8600cece0 0x7ff84c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff857fff640 1 -- 172.21.15.55:0/340109552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff84c004d10 msgr2=0x7ff84c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:36.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff857fff640 1 --2- 172.21.15.55:0/340109552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff84c004d10 0x7ff84c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff857fff640 1 -- 172.21.15.55:0/340109552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c003530 con 0x7ff84c003f00 2023-08-25T05:35:36.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.517+0000 7ff85f7fe640 1 --2- 172.21.15.55:0/340109552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8600cece0 0x7ff84c003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:35:36.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.521+0000 7ff857fff640 1 --2- 172.21.15.55:0/340109552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84c003f00 0x7ff84c0047d0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7ff8480098b0 tx=0x7ff84801c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ffca48b8753f39 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:36.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.521+0000 7ff85effd640 1 -- 172.21.15.55:0/340109552 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848004220 con 0x7ff84c003f00 2023-08-25T05:35:36.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.521+0000 7ff85effd640 1 -- 172.21.15.55:0/340109552 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff848004380 con 0x7ff84c003f00 2023-08-25T05:35:36.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.521+0000 7ff85effd640 1 -- 172.21.15.55:0/340109552 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848003840 con 0x7ff84c003f00 2023-08-25T05:35:36.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.521+0000 7ff8660e5640 1 -- 172.21.15.55:0/340109552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84c003f00 msgr2=0x7ff84c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:36.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.521+0000 7ff8660e5640 1 --2- 172.21.15.55:0/340109552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff84c003f00 0x7ff84c0047d0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7ff8480098b0 tx=0x7ff84801c610 comp rx=0 tx=0).stop 2023-08-25T05:35:36.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.521+0000 7ff85ffff640 1 -- 172.21.15.55:0/340109552 reap_dead start 2023-08-25T05:35:36.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.521+0000 7ff8660e5640 1 -- 172.21.15.55:0/340109552 shutdown_connections 2023-08-25T05:35:36.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.521+0000 7ff8660e5640 1 -- 172.21.15.55:0/340109552 >> 172.21.15.55:0/340109552 conn(0x7ff860069d00 msgr2=0x7ff86006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:36.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.521+0000 7ff8660e5640 1 -- 172.21.15.55:0/340109552 shutdown_connections 2023-08-25T05:35:36.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.521+0000 7ff8660e5640 1 -- 172.21.15.55:0/340109552 wait complete. 2023-08-25T05:35:36.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.521+0000 7ff8660e5640 1 Processor -- start 2023-08-25T05:35:36.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.521+0000 7ff8660e5640 1 -- start start 2023-08-25T05:35:36.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff8660e5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff84c003f00 0x7ff86015d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:36.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff8660e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8600c2850 0x7ff860158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:36.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff8660e5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8600709e0 0x7ff860070e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:36.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff8660e5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600713a0 con 0x7ff8600c2850 2023-08-25T05:35:36.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff8660e5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86015c500 con 0x7ff84c003f00 2023-08-25T05:35:36.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff8660e5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86015c7e0 con 0x7ff8600709e0 2023-08-25T05:35:36.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff857fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8600c2850 0x7ff860158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:36.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff857fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8600c2850 0x7ff860158b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60030/0 (socket says 172.21.15.55:60030) 2023-08-25T05:35:36.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff857fff640 1 -- 172.21.15.55:0/1761195385 learned_addr learned my addr 172.21.15.55:0/1761195385 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:36.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff85ffff640 1 --2- 172.21.15.55:0/1761195385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8600709e0 0x7ff860070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:36.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff85f7fe640 1 --2- 172.21.15.55:0/1761195385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff84c003f00 0x7ff86015d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:36.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff857fff640 1 -- 172.21.15.55:0/1761195385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8600709e0 msgr2=0x7ff860070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:36.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff857fff640 1 --2- 172.21.15.55:0/1761195385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8600709e0 0x7ff860070e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff857fff640 1 -- 172.21.15.55:0/1761195385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff84c003f00 msgr2=0x7ff86015d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:36.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff857fff640 1 --2- 172.21.15.55:0/1761195385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff84c003f00 0x7ff86015d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff857fff640 1 -- 172.21.15.55:0/1761195385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86015cac0 con 0x7ff8600c2850 2023-08-25T05:35:36.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff85ffff640 1 --2- 172.21.15.55:0/1761195385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8600709e0 0x7ff860070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:36.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff857fff640 1 --2- 172.21.15.55:0/1761195385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8600c2850 0x7ff860158b30 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7ff84801c440 tx=0x7ff84c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:36.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff85cff9640 1 -- 172.21.15.55:0/1761195385 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8480b7070 con 0x7ff8600c2850 2023-08-25T05:35:36.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff85cff9640 1 -- 172.21.15.55:0/1761195385 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8480bc420 con 0x7ff8600c2850 2023-08-25T05:35:36.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff85cff9640 1 -- 172.21.15.55:0/1761195385 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8480bc7d0 con 0x7ff8600c2850 2023-08-25T05:35:36.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff8660e5640 1 -- 172.21.15.55:0/1761195385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff86015cda0 con 0x7ff8600c2850 2023-08-25T05:35:36.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff8660e5640 1 -- 172.21.15.55:0/1761195385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86015dae0 con 0x7ff8600c2850 2023-08-25T05:35:36.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff8660e5640 1 -- 172.21.15.55:0/1761195385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86004dbe0 con 0x7ff8600c2850 2023-08-25T05:35:36.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.525+0000 7ff85cff9640 1 -- 172.21.15.55:0/1761195385 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7ff8480c5440 con 0x7ff8600c2850 2023-08-25T05:35:36.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.529+0000 7ff85cff9640 1 --2- 172.21.15.55:0/1761195385 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7ff8400657d0 0x7ff840067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:36.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.529+0000 7ff85cff9640 1 -- 172.21.15.55:0/1761195385 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff84811d1b0 con 0x7ff8600c2850 2023-08-25T05:35:36.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.529+0000 7ff85f7fe640 1 --2- 172.21.15.55:0/1761195385 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7ff8400657d0 0x7ff840067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:36.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.529+0000 7ff85f7fe640 1 --2- 172.21.15.55:0/1761195385 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7ff8400657d0 0x7ff840067c90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff850000fc0 tx=0x7ff850009040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:36.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.533+0000 7ff85cff9640 1 -- 172.21.15.55:0/1761195385 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff8480eaf50 con 0x7ff8600c2850 2023-08-25T05:35:36.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.741+0000 7ff8660e5640 1 -- 172.21.15.55:0/1761195385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff8600ccc40 con 0x7ff8600c2850 2023-08-25T05:35:36.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.741+0000 7ff85cff9640 1 -- 172.21.15.55:0/1761195385 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v48) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff84800f040 con 0x7ff8600c2850 2023-08-25T05:35:36.744 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:36.745 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T05:35:36.745 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-08-25T05:35:36.745 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.745 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-08-25T05:35:36.745 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkgFrTEBAAoan9rk8Q+qPyMjb2vGUHhA==", 2023-08-25T05:35:36.745 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.745 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:35:36.746 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:35:36.746 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:35:36.746 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:35:36.746 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.746 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:36.746 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.746 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-08-25T05:35:36.747 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk18hNHRAAzXuhzQEONXRzRXTeCH9fKQ==", 2023-08-25T05:35:36.747 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.747 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:35:36.747 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:35:36.747 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:35:36.747 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:35:36.747 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.748 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:36.748 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.748 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-08-25T05:35:36.748 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkLF9CGBAAqxgRU/02SsZfWuZPSYxuZA==", 2023-08-25T05:35:36.748 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.748 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:35:36.748 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:35:36.749 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:35:36.749 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:35:36.749 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.749 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:36.749 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.749 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-08-25T05:35:36.749 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hky6HiJBAAsrXlTDn2cxbk7PnqSgNNkA==", 2023-08-25T05:35:36.750 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.750 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:35:36.750 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:35:36.750 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:35:36.750 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:35:36.750 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.750 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:36.751 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.751 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-08-25T05:35:36.751 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC+J+hkY1tDFBAAVQY5Xl8On9pN3jLWwKWGTA==", 2023-08-25T05:35:36.751 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.751 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:35:36.751 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:35:36.751 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:35:36.752 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.752 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:36.752 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.752 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-08-25T05:35:36.752 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDBJ+hkpdBCHRAADyMAxTsnQfkD9G0p48H4zQ==", 2023-08-25T05:35:36.752 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.752 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:35:36.753 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:35:36.753 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:35:36.753 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.753 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:36.753 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.753 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-08-25T05:35:36.753 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDEJ+hkOR49KRAAudbqAxLItsoczide8ybzAg==", 2023-08-25T05:35:36.754 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.754 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:35:36.754 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:35:36.754 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:35:36.754 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.754 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:36.754 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.754 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-08-25T05:35:36.755 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDHJ+hkxun5MBAAAhGtJYVeL3ogL3TQV67diw==", 2023-08-25T05:35:36.755 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.755 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:35:36.755 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:35:36.755 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:35:36.755 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.755 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:36.756 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.756 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-08-25T05:35:36.756 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDMJ+hkuosTCRAAqCuwHFZFBVR/7nFtHHByNg==", 2023-08-25T05:35:36.756 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.756 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:35:36.756 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:35:36.756 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:35:36.757 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.757 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:36.757 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.757 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-08-25T05:35:36.757 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDPJ+hkJa+SDhAAllo6biVE99BZWvv5K/gXGw==", 2023-08-25T05:35:36.757 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.757 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:35:36.758 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:35:36.758 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:35:36.758 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.758 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:36.758 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.758 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-08-25T05:35:36.758 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDSJ+hkUPywFBAA4jua1Eu1nRl2L6hX/mycfw==", 2023-08-25T05:35:36.759 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.759 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:35:36.759 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:35:36.759 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:35:36.759 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.759 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:36.759 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.759 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-08-25T05:35:36.760 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDVJ+hkhyDMGxAAmcSWLzJqIE5w5H/E4wIurQ==", 2023-08-25T05:35:36.760 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.760 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:35:36.760 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:35:36.760 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:35:36.760 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.760 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:36.761 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.761 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-08-25T05:35:36.761 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g==", 2023-08-25T05:35:36.761 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.761 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:35:36.761 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-08-25T05:35:36.761 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-25T05:35:36.762 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.762 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:36.762 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.762 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-08-25T05:35:36.762 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk8KsDMxAAKyK4jMKflYNnJXYIbr2OBQ==", 2023-08-25T05:35:36.762 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.762 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:35:36.763 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T05:35:36.763 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T05:35:36.763 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T05:35:36.763 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.763 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:36.763 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.763 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-08-25T05:35:36.764 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjSA4LxAAxzbnHeV85qYZYhSqTOT2rw==", 2023-08-25T05:35:36.764 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.764 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:35:36.764 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T05:35:36.764 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T05:35:36.764 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T05:35:36.764 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.765 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:36.765 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.765 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-08-25T05:35:36.765 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkl9AoORAARYZcPObsM/HT/yrTmneZrw==", 2023-08-25T05:35:36.765 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.765 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:35:36.765 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T05:35:36.765 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T05:35:36.766 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T05:35:36.766 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.766 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:36.766 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.766 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-08-25T05:35:36.766 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC2J+hkgTdcLxAAqxSepXXhEultFAFYBBKSag==", 2023-08-25T05:35:36.766 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.767 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T05:35:36.767 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:35:36.767 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:35:36.767 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:35:36.767 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.767 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:36.767 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.768 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-08-25T05:35:36.768 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkYGUZDBAAiuDo9hqavWq7zQlGd6x4YQ==", 2023-08-25T05:35:36.768 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.768 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T05:35:36.768 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T05:35:36.768 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:35:36.768 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.769 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:36.769 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:36.769 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-08-25T05:35:36.769 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjr9KCBAApSqjtFhLnjHduMBu/eaaKw==", 2023-08-25T05:35:36.769 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:35:36.769 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T05:35:36.769 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T05:35:36.769 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:35:36.770 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.770 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:36.770 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-08-25T05:35:36.770 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T05:35:36.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.741+0000 7ff8660e5640 1 -- 172.21.15.55:0/1761195385 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7ff8400657d0 msgr2=0x7ff840067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:36.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.741+0000 7ff8660e5640 1 --2- 172.21.15.55:0/1761195385 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7ff8400657d0 0x7ff840067c90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff850000fc0 tx=0x7ff850009040 comp rx=0 tx=0).stop 2023-08-25T05:35:36.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.741+0000 7ff8660e5640 1 -- 172.21.15.55:0/1761195385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8600c2850 msgr2=0x7ff860158b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:36.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.741+0000 7ff8660e5640 1 --2- 172.21.15.55:0/1761195385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8600c2850 0x7ff860158b30 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7ff84801c440 tx=0x7ff84c005800 comp rx=0 tx=0).stop 2023-08-25T05:35:36.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.741+0000 7ff8660e5640 1 -- 172.21.15.55:0/1761195385 shutdown_connections 2023-08-25T05:35:36.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.741+0000 7ff8660e5640 1 --2- 172.21.15.55:0/1761195385 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7ff8400657d0 0x7ff840067c90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.741+0000 7ff8660e5640 1 --2- 172.21.15.55:0/1761195385 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff8600709e0 0x7ff860070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.741+0000 7ff8660e5640 1 --2- 172.21.15.55:0/1761195385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8600c2850 0x7ff860158b30 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.741+0000 7ff8660e5640 1 --2- 172.21.15.55:0/1761195385 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff84c003f00 0x7ff86015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.741+0000 7ff8660e5640 1 -- 172.21.15.55:0/1761195385 >> 172.21.15.55:0/1761195385 conn(0x7ff860069d00 msgr2=0x7ff8600aaff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:36.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.741+0000 7ff8660e5640 1 -- 172.21.15.55:0/1761195385 shutdown_connections 2023-08-25T05:35:36.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.741+0000 7ff8660e5640 1 -- 172.21.15.55:0/1761195385 wait complete. 2023-08-25T05:35:36.773 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:35:36.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.913+0000 7f55ea8cb640 1 Processor -- start 2023-08-25T05:35:36.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.913+0000 7f55ea8cb640 1 -- start start 2023-08-25T05:35:36.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.917+0000 7f55ea8cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55e415c9c0 0x7f55e4160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:36.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.917+0000 7f55ea8cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55e40cfa70 0x7f55e4160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:36.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.917+0000 7f55ea8cb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e406eaf0 con 0x7f55e4160f90 2023-08-25T05:35:36.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.917+0000 7f55ea8cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e406e530 con 0x7f55e40cfa70 2023-08-25T05:35:36.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.917+0000 7f55ea8cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e406e810 con 0x7f55e415c9c0 2023-08-25T05:35:36.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.917+0000 7f55e37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55e40cfa70 0x7f55e4160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:36.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.917+0000 7f55e37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55e40cfa70 0x7f55e4160a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60046/0 (socket says 172.21.15.55:60046) 2023-08-25T05:35:36.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.917+0000 7f55e37fe640 1 -- 172.21.15.55:0/744814793 learned_addr learned my addr 172.21.15.55:0/744814793 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:36.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.917+0000 7f55e3fff640 1 --2- 172.21.15.55:0/744814793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55e415c9c0 0x7f55e4160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:36.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.917+0000 7f55e37fe640 1 -- 172.21.15.55:0/744814793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55e415c9c0 msgr2=0x7f55e4160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:36.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.917+0000 7f55e37fe640 1 --2- 172.21.15.55:0/744814793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55e415c9c0 0x7f55e4160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.917+0000 7f55e37fe640 1 -- 172.21.15.55:0/744814793 >> v1:172.21.15.110:6789/0 conn(0x7f55e4160f90 legacy=0x7f55e40ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:36.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.917+0000 7f55e37fe640 1 -- 172.21.15.55:0/744814793 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e406aab0 con 0x7f55e40cfa70 2023-08-25T05:35:36.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.917+0000 7f55e3fff640 1 --2- 172.21.15.55:0/744814793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55e415c9c0 0x7f55e4160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:36.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.917+0000 7f55e37fe640 1 --2- 172.21.15.55:0/744814793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e40cfa70 0x7f55e4160a50 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009870 tx=0x7f55d801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a294d1472638afa server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:36.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55e2ffd640 1 -- 172.21.15.55:0/744814793 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d80ab620 con 0x7f55e40cfa70 2023-08-25T05:35:36.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55e2ffd640 1 -- 172.21.15.55:0/744814793 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d80ab780 con 0x7f55e40cfa70 2023-08-25T05:35:36.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55e2ffd640 1 -- 172.21.15.55:0/744814793 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d80abb10 con 0x7f55e40cfa70 2023-08-25T05:35:36.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55ea8cb640 1 -- 172.21.15.55:0/744814793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e40cfa70 msgr2=0x7f55e4160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:36.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55ea8cb640 1 --2- 172.21.15.55:0/744814793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e40cfa70 0x7f55e4160a50 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f55d8009870 tx=0x7f55d801c510 comp rx=0 tx=0).stop 2023-08-25T05:35:36.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55ea8cb640 1 -- 172.21.15.55:0/744814793 shutdown_connections 2023-08-25T05:35:36.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55ea8cb640 1 --2- 172.21.15.55:0/744814793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e40cfa70 0x7f55e4160a50 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55ea8cb640 1 --2- 172.21.15.55:0/744814793 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55e415c9c0 0x7f55e4160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55ea8cb640 1 -- 172.21.15.55:0/744814793 >> 172.21.15.55:0/744814793 conn(0x7f55e40d05a0 msgr2=0x7f55e40d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:36.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55ea8cb640 1 -- 172.21.15.55:0/744814793 shutdown_connections 2023-08-25T05:35:36.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55ea8cb640 1 -- 172.21.15.55:0/744814793 wait complete. 2023-08-25T05:35:36.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55ea8cb640 1 Processor -- start 2023-08-25T05:35:36.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55ea8cb640 1 -- start start 2023-08-25T05:35:36.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55ea8cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55e40cfa70 0x7f55e415b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:36.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55ea8cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e415c9c0 0x7f55e4157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:36.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55ea8cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55e4160f90 0x7f55e4152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:36.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55ea8cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e414baa0 con 0x7f55e415c9c0 2023-08-25T05:35:36.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55ea8cb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e4154e90 con 0x7f55e40cfa70 2023-08-25T05:35:36.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.921+0000 7f55ea8cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e415d190 con 0x7f55e4160f90 2023-08-25T05:35:36.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55e37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e415c9c0 0x7f55e4157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:36.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55e37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e415c9c0 0x7f55e4157740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60048/0 (socket says 172.21.15.55:60048) 2023-08-25T05:35:36.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55e37fe640 1 -- 172.21.15.55:0/2280450400 learned_addr learned my addr 172.21.15.55:0/2280450400 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:36.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55e3fff640 1 --2- 172.21.15.55:0/2280450400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55e40cfa70 0x7f55e415b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:36.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55e8e68640 1 --2- 172.21.15.55:0/2280450400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55e4160f90 0x7f55e4152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:36.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55e37fe640 1 -- 172.21.15.55:0/2280450400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55e4160f90 msgr2=0x7f55e4152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:36.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55e37fe640 1 --2- 172.21.15.55:0/2280450400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55e4160f90 0x7f55e4152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55e37fe640 1 -- 172.21.15.55:0/2280450400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55e40cfa70 msgr2=0x7f55e415b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:36.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55e37fe640 1 --2- 172.21.15.55:0/2280450400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55e40cfa70 0x7f55e415b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:36.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55e37fe640 1 -- 172.21.15.55:0/2280450400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d80094d0 con 0x7f55e415c9c0 2023-08-25T05:35:36.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55e37fe640 1 --2- 172.21.15.55:0/2280450400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e415c9c0 0x7f55e4157740 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f55d80ad040 tx=0x7f55d801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:36.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55e0ff9640 1 -- 172.21.15.55:0/2280450400 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d80be3f0 con 0x7f55e415c9c0 2023-08-25T05:35:36.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55e0ff9640 1 -- 172.21.15.55:0/2280450400 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d80be570 con 0x7f55e415c9c0 2023-08-25T05:35:36.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55e0ff9640 1 -- 172.21.15.55:0/2280450400 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d80be920 con 0x7f55e415c9c0 2023-08-25T05:35:36.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55ea8cb640 1 -- 172.21.15.55:0/2280450400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e415d470 con 0x7f55e415c9c0 2023-08-25T05:35:36.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55ea8cb640 1 -- 172.21.15.55:0/2280450400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e4157c80 con 0x7f55e415c9c0 2023-08-25T05:35:36.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55ea8cb640 1 -- 172.21.15.55:0/2280450400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e4157e70 con 0x7f55e415c9c0 2023-08-25T05:35:36.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55e0ff9640 1 -- 172.21.15.55:0/2280450400 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f55d80b43f0 con 0x7f55e415c9c0 2023-08-25T05:35:36.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.925+0000 7f55e0ff9640 1 --2- 172.21.15.55:0/2280450400 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f55d00657a0 0x7f55d0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:36.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.929+0000 7f55e0ff9640 1 -- 172.21.15.55:0/2280450400 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f55d811d070 con 0x7f55e415c9c0 2023-08-25T05:35:36.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.929+0000 7f55e3fff640 1 --2- 172.21.15.55:0/2280450400 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f55d00657a0 0x7f55d0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:36.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.929+0000 7f55e3fff640 1 --2- 172.21.15.55:0/2280450400 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f55d00657a0 0x7f55d0067c60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f55d4006e30 tx=0x7f55d4008040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:36.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:36.929+0000 7f55e0ff9640 1 -- 172.21.15.55:0/2280450400 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f55e4157e70 con 0x7f55e415c9c0 2023-08-25T05:35:37.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.093+0000 7f55ea8cb640 1 -- 172.21.15.55:0/2280450400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55e4157e70 con 0x7f55e415c9c0 2023-08-25T05:35:37.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.093+0000 7f55e0ff9640 1 -- 172.21.15.55:0/2280450400 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+14661 (secure 0 0 0) 0x7f55e4157e70 con 0x7f55e415c9c0 2023-08-25T05:35:37.097 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:37.098 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":184,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:35:36.350211+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:35:37.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.097+0000 7f55ea8cb640 1 -- 172.21.15.55:0/2280450400 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f55d00657a0 msgr2=0x7f55d0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:37.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.097+0000 7f55ea8cb640 1 --2- 172.21.15.55:0/2280450400 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f55d00657a0 0x7f55d0067c60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f55d4006e30 tx=0x7f55d4008040 comp rx=0 tx=0).stop 2023-08-25T05:35:37.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.097+0000 7f55ea8cb640 1 -- 172.21.15.55:0/2280450400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e415c9c0 msgr2=0x7f55e4157740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:37.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.097+0000 7f55ea8cb640 1 --2- 172.21.15.55:0/2280450400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e415c9c0 0x7f55e4157740 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f55d80ad040 tx=0x7f55d801ad50 comp rx=0 tx=0).stop 2023-08-25T05:35:37.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.097+0000 7f55ea8cb640 1 -- 172.21.15.55:0/2280450400 shutdown_connections 2023-08-25T05:35:37.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.097+0000 7f55ea8cb640 1 --2- 172.21.15.55:0/2280450400 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f55d00657a0 0x7f55d0067c60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.097+0000 7f55ea8cb640 1 --2- 172.21.15.55:0/2280450400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55e4160f90 0x7f55e4152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.097+0000 7f55ea8cb640 1 --2- 172.21.15.55:0/2280450400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e415c9c0 0x7f55e4157740 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.097+0000 7f55ea8cb640 1 --2- 172.21.15.55:0/2280450400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55e40cfa70 0x7f55e415b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.097+0000 7f55ea8cb640 1 -- 172.21.15.55:0/2280450400 >> 172.21.15.55:0/2280450400 conn(0x7f55e40d05a0 msgr2=0x7f55e4155920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:37.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.097+0000 7f55ea8cb640 1 -- 172.21.15.55:0/2280450400 shutdown_connections 2023-08-25T05:35:37.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.097+0000 7f55ea8cb640 1 -- 172.21.15.55:0/2280450400 wait complete. 2023-08-25T05:35:37.119 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T05:35:37.120 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T05:35:37.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.265+0000 7fb37b288640 1 Processor -- start 2023-08-25T05:35:37.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.265+0000 7fb37b288640 1 -- start start 2023-08-25T05:35:37.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.265+0000 7fb37b288640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb37415d430 0x7fb3741679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:37.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.265+0000 7fb37b288640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37415f8b0 con 0x7fb3741601f0 2023-08-25T05:35:37.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.265+0000 7fb37b288640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3740cd5a0 con 0x7fb37415e3c0 2023-08-25T05:35:37.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.265+0000 7fb37b288640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3740cd880 con 0x7fb37415d430 2023-08-25T05:35:37.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.265+0000 7fb379024640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb3741601f0 0x7fb3740d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59382/0 (socket says 172.21.15.55:59382) 2023-08-25T05:35:37.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.265+0000 7fb379024640 1 -- 172.21.15.55:0/1485051389 learned_addr learned my addr 172.21.15.55:0/1485051389 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:37.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.265+0000 7fb379825640 1 --2- 172.21.15.55:0/1485051389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb37415d430 0x7fb3741679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:37.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.265+0000 7fb36bfff640 1 -- 172.21.15.55:0/1485051389 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1787228174 0 0) 0x7fb37415f8b0 con 0x7fb3741601f0 2023-08-25T05:35:37.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.265+0000 7fb36bfff640 1 -- 172.21.15.55:0/1485051389 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb360003530 con 0x7fb3741601f0 2023-08-25T05:35:37.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.269+0000 7fb379825640 1 -- 172.21.15.55:0/1485051389 >> v1:172.21.15.110:6789/0 conn(0x7fb37415e3c0 legacy=0x7fb3740d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:37.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.269+0000 7fb379825640 1 -- 172.21.15.55:0/1485051389 >> v1:172.21.15.55:6789/0 conn(0x7fb3741601f0 legacy=0x7fb3740d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:37.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.269+0000 7fb379825640 1 -- 172.21.15.55:0/1485051389 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3740cdb60 con 0x7fb37415d430 2023-08-25T05:35:37.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.269+0000 7fb379825640 1 --2- 172.21.15.55:0/1485051389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb37415d430 0x7fb3741679e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009df0 tx=0x7fb36c01f160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fadd3ab1b8ffe0ea server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:37.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.269+0000 7fb36bfff640 1 -- 172.21.15.55:0/1485051389 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c0af600 con 0x7fb37415d430 2023-08-25T05:35:37.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.269+0000 7fb36bfff640 1 -- 172.21.15.55:0/1485051389 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36c0ab050 con 0x7fb37415d430 2023-08-25T05:35:37.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.269+0000 7fb36bfff640 1 -- 172.21.15.55:0/1485051389 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c0af960 con 0x7fb37415d430 2023-08-25T05:35:37.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb37b288640 1 -- 172.21.15.55:0/1485051389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb37415d430 msgr2=0x7fb3741679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:37.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb37b288640 1 --2- 172.21.15.55:0/1485051389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb37415d430 0x7fb3741679e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009df0 tx=0x7fb36c01f160 comp rx=0 tx=0).stop 2023-08-25T05:35:37.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb37b288640 1 -- 172.21.15.55:0/1485051389 shutdown_connections 2023-08-25T05:35:37.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb37b288640 1 --2- 172.21.15.55:0/1485051389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb37415d430 0x7fb3741679e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb37b288640 1 -- 172.21.15.55:0/1485051389 >> 172.21.15.55:0/1485051389 conn(0x7fb3740d27d0 msgr2=0x7fb3740d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:37.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb37b288640 1 -- 172.21.15.55:0/1485051389 shutdown_connections 2023-08-25T05:35:37.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb37b288640 1 -- 172.21.15.55:0/1485051389 wait complete. 2023-08-25T05:35:37.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb37b288640 1 Processor -- start 2023-08-25T05:35:37.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb37b288640 1 -- start start 2023-08-25T05:35:37.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb37b288640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb37415d430 0x7fb3740b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:37.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb37b288640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb37415e3c0 0x7fb3740c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:37.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb37b288640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3741601f0 0x7fb3740d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:37.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb37b288640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3740c8030 con 0x7fb3741601f0 2023-08-25T05:35:37.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb37b288640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3740c71c0 con 0x7fb37415e3c0 2023-08-25T05:35:37.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb37b288640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3740c7420 con 0x7fb37415d430 2023-08-25T05:35:37.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb379825640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3741601f0 0x7fb3740d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:37.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb379024640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb37415d430 0x7fb3740b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:37.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb378823640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb37415e3c0 0x7fb3740c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:37.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb379825640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3741601f0 0x7fb3740d08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60054/0 (socket says 172.21.15.55:60054) 2023-08-25T05:35:37.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.273+0000 7fb379825640 1 -- 172.21.15.55:0/2136124883 learned_addr learned my addr 172.21.15.55:0/2136124883 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:37.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.277+0000 7fb379825640 1 -- 172.21.15.55:0/2136124883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb37415d430 msgr2=0x7fb3740b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:37.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.277+0000 7fb379825640 1 --2- 172.21.15.55:0/2136124883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb37415d430 0x7fb3740b71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.277+0000 7fb379825640 1 -- 172.21.15.55:0/2136124883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb37415e3c0 msgr2=0x7fb3740c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:37.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.277+0000 7fb379825640 1 --2- 172.21.15.55:0/2136124883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb37415e3c0 0x7fb3740c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.277+0000 7fb379825640 1 -- 172.21.15.55:0/2136124883 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c009a70 con 0x7fb3741601f0 2023-08-25T05:35:37.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.277+0000 7fb379825640 1 --2- 172.21.15.55:0/2136124883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3741601f0 0x7fb3740d08e0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fb36c01cd90 tx=0x7fb36c01bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:37.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.277+0000 7fb369ffb640 1 -- 172.21.15.55:0/2136124883 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c0afc40 con 0x7fb3741601f0 2023-08-25T05:35:37.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.277+0000 7fb369ffb640 1 -- 172.21.15.55:0/2136124883 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36c0afda0 con 0x7fb3741601f0 2023-08-25T05:35:37.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.277+0000 7fb37b288640 1 -- 172.21.15.55:0/2136124883 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3740c7700 con 0x7fb3741601f0 2023-08-25T05:35:37.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.277+0000 7fb369ffb640 1 -- 172.21.15.55:0/2136124883 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c003ba0 con 0x7fb3741601f0 2023-08-25T05:35:37.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.277+0000 7fb37b288640 1 -- 172.21.15.55:0/2136124883 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3740c7cc0 con 0x7fb3741601f0 2023-08-25T05:35:37.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.277+0000 7fb37b288640 1 -- 172.21.15.55:0/2136124883 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb374157640 con 0x7fb3741601f0 2023-08-25T05:35:37.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.277+0000 7fb369ffb640 1 -- 172.21.15.55:0/2136124883 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fb36c003d00 con 0x7fb3741601f0 2023-08-25T05:35:37.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.277+0000 7fb369ffb640 1 --2- 172.21.15.55:0/2136124883 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fb3580657a0 0x7fb358067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:37.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.281+0000 7fb369ffb640 1 -- 172.21.15.55:0/2136124883 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb36c121340 con 0x7fb3741601f0 2023-08-25T05:35:37.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.281+0000 7fb379024640 1 --2- 172.21.15.55:0/2136124883 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fb3580657a0 0x7fb358067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:37.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.281+0000 7fb379024640 1 --2- 172.21.15.55:0/2136124883 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fb3580657a0 0x7fb358067c60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb3700010f0 tx=0x7fb370007bf0 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:37.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.281+0000 7fb369ffb640 1 -- 172.21.15.55:0/2136124883 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb36c0ef000 con 0x7fb3741601f0 2023-08-25T05:35:37.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.461+0000 7fb37b288640 1 -- 172.21.15.55:0/2136124883 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3740c8170 con 0x7fb3741601f0 2023-08-25T05:35:37.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.461+0000 7fb369ffb640 1 -- 172.21.15.55:0/2136124883 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v184) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb36c0f2620 con 0x7fb3741601f0 2023-08-25T05:35:37.465 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T05:35:37.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.461+0000 7fb37b288640 1 -- 172.21.15.55:0/2136124883 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fb3580657a0 msgr2=0x7fb358067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:37.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.461+0000 7fb37b288640 1 --2- 172.21.15.55:0/2136124883 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fb3580657a0 0x7fb358067c60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb3700010f0 tx=0x7fb370007bf0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.461+0000 7fb37b288640 1 -- 172.21.15.55:0/2136124883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3741601f0 msgr2=0x7fb3740d08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:37.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.461+0000 7fb37b288640 1 --2- 172.21.15.55:0/2136124883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3741601f0 0x7fb3740d08e0 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fb36c01cd90 tx=0x7fb36c01bf00 comp rx=0 tx=0).stop 2023-08-25T05:35:37.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.461+0000 7fb37b288640 1 -- 172.21.15.55:0/2136124883 shutdown_connections 2023-08-25T05:35:37.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.461+0000 7fb37b288640 1 --2- 172.21.15.55:0/2136124883 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fb3580657a0 0x7fb358067c60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.461+0000 7fb37b288640 1 --2- 172.21.15.55:0/2136124883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3741601f0 0x7fb3740d08e0 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.461+0000 7fb37b288640 1 --2- 172.21.15.55:0/2136124883 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb37415e3c0 0x7fb3740c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.461+0000 7fb37b288640 1 --2- 172.21.15.55:0/2136124883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb37415d430 0x7fb3740b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.461+0000 7fb37b288640 1 -- 172.21.15.55:0/2136124883 >> 172.21.15.55:0/2136124883 conn(0x7fb3740d27d0 msgr2=0x7fb37406b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:37.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.461+0000 7fb37b288640 1 -- 172.21.15.55:0/2136124883 shutdown_connections 2023-08-25T05:35:37.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.461+0000 7fb37b288640 1 -- 172.21.15.55:0/2136124883 wait complete. 2023-08-25T05:35:37.487 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T05:35:37.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.633+0000 7f21e75fa640 1 Processor -- start 2023-08-25T05:35:37.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.633+0000 7f21e75fa640 1 -- start start 2023-08-25T05:35:37.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.633+0000 7f21e75fa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f21e006c3b0 0x7f21e00cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:37.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.633+0000 7f21e75fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21e006e5a0 0x7f21e00ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:37.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.633+0000 7f21e75fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e00cab90 con 0x7f21e006c790 2023-08-25T05:35:37.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.633+0000 7f21e75fa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e006dbb0 con 0x7f21e006c3b0 2023-08-25T05:35:37.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.633+0000 7f21e75fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00cae50 con 0x7f21e006e5a0 2023-08-25T05:35:37.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.633+0000 7f21e4b95640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f21e006c790 0x7f21e006de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59390/0 (socket says 172.21.15.55:59390) 2023-08-25T05:35:37.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.633+0000 7f21e4b95640 1 -- 172.21.15.55:0/3929911384 learned_addr learned my addr 172.21.15.55:0/3929911384 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:37.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.633+0000 7f21e5b97640 1 --2- 172.21.15.55:0/3929911384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21e006e5a0 0x7f21e00ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:37.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.633+0000 7f21e5396640 1 --2- 172.21.15.55:0/3929911384 >> v2:172.21.15.110:3300/0 conn(0x7f21e006c3b0 0x7f21e00cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:37.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.633+0000 7f21d7fff640 1 -- 172.21.15.55:0/3929911384 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1885246047 0 0) 0x7f21e00cab90 con 0x7f21e006c790 2023-08-25T05:35:37.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.633+0000 7f21d7fff640 1 -- 172.21.15.55:0/3929911384 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21cc003530 con 0x7f21e006c790 2023-08-25T05:35:37.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.633+0000 7f21e5396640 1 -- 172.21.15.55:0/3929911384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21e006e5a0 msgr2=0x7f21e00ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:37.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.633+0000 7f21e5396640 1 --2- 172.21.15.55:0/3929911384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21e006e5a0 0x7f21e00ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.633+0000 7f21e5396640 1 -- 172.21.15.55:0/3929911384 >> v1:172.21.15.55:6789/0 conn(0x7f21e006c790 legacy=0x7f21e006de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:37.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.633+0000 7f21e5396640 1 -- 172.21.15.55:0/3929911384 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e00cb130 con 0x7f21e006c3b0 2023-08-25T05:35:37.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.633+0000 7f21e5b97640 1 --2- 172.21.15.55:0/3929911384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21e006e5a0 0x7f21e00ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:35:37.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.637+0000 7f21e5396640 1 --2- 172.21.15.55:0/3929911384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21e006c3b0 0x7f21e00cd7d0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0097a0 tx=0x7f21dc01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8791ca3e4aa48686 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:37.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.637+0000 7f21d7fff640 1 -- 172.21.15.55:0/3929911384 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc0ab610 con 0x7f21e006c3b0 2023-08-25T05:35:37.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.637+0000 7f21d7fff640 1 -- 172.21.15.55:0/3929911384 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc0ab770 con 0x7f21e006c3b0 2023-08-25T05:35:37.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.637+0000 7f21d7fff640 1 -- 172.21.15.55:0/3929911384 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc0abae0 con 0x7f21e006c3b0 2023-08-25T05:35:37.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.637+0000 7f21e75fa640 1 -- 172.21.15.55:0/3929911384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21e006c3b0 msgr2=0x7f21e00cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:37.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.637+0000 7f21e75fa640 1 --2- 172.21.15.55:0/3929911384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21e006c3b0 0x7f21e00cd7d0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0097a0 tx=0x7f21dc01c430 comp rx=0 tx=0).stop 2023-08-25T05:35:37.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.637+0000 7f21e75fa640 1 -- 172.21.15.55:0/3929911384 shutdown_connections 2023-08-25T05:35:37.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.637+0000 7f21e75fa640 1 --2- 172.21.15.55:0/3929911384 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21e006e5a0 0x7f21e00ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.637+0000 7f21e75fa640 1 --2- 172.21.15.55:0/3929911384 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21e006c3b0 0x7f21e00cd7d0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.637+0000 7f21e75fa640 1 -- 172.21.15.55:0/3929911384 >> 172.21.15.55:0/3929911384 conn(0x7f21e00d0540 msgr2=0x7f21e00d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:37.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.637+0000 7f21e75fa640 1 -- 172.21.15.55:0/3929911384 shutdown_connections 2023-08-25T05:35:37.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.637+0000 7f21e75fa640 1 -- 172.21.15.55:0/3929911384 wait complete. 2023-08-25T05:35:37.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e75fa640 1 Processor -- start 2023-08-25T05:35:37.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e75fa640 1 -- start start 2023-08-25T05:35:37.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e75fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21e006c3b0 0x7f21e015dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:37.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e75fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21e006c790 0x7f21e01579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:37.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e75fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21e006e5a0 0x7f21e00b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:37.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e75fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e015e6e0 con 0x7f21e006c3b0 2023-08-25T05:35:37.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e75fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e015e9c0 con 0x7f21e006e5a0 2023-08-25T05:35:37.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e75fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e015eca0 con 0x7f21e006c790 2023-08-25T05:35:37.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e5396640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21e006c3b0 0x7f21e015dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:37.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e5396640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21e006c3b0 0x7f21e015dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60056/0 (socket says 172.21.15.55:60056) 2023-08-25T05:35:37.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e5396640 1 -- 172.21.15.55:0/3184348156 learned_addr learned my addr 172.21.15.55:0/3184348156 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:37.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e5b97640 1 --2- 172.21.15.55:0/3184348156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21e006e5a0 0x7f21e00b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:37.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e4b95640 1 --2- 172.21.15.55:0/3184348156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21e006c790 0x7f21e01579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:37.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e5396640 1 -- 172.21.15.55:0/3184348156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21e006c790 msgr2=0x7f21e01579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:37.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e5396640 1 --2- 172.21.15.55:0/3184348156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21e006c790 0x7f21e01579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e5396640 1 -- 172.21.15.55:0/3184348156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21e006e5a0 msgr2=0x7f21e00b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:37.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e5396640 1 --2- 172.21.15.55:0/3184348156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21e006e5a0 0x7f21e00b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e5396640 1 -- 172.21.15.55:0/3184348156 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d8009a70 con 0x7f21e006c3b0 2023-08-25T05:35:37.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e5b97640 1 --2- 172.21.15.55:0/3184348156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21e006e5a0 0x7f21e00b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:37.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e5396640 1 --2- 172.21.15.55:0/3184348156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21e006c3b0 0x7f21e015dde0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f21dc01a060 tx=0x7f21dc01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:37.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21d5ffb640 1 -- 172.21.15.55:0/3184348156 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc0bf610 con 0x7f21e006c3b0 2023-08-25T05:35:37.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21d5ffb640 1 -- 172.21.15.55:0/3184348156 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc0bf770 con 0x7f21e006c3b0 2023-08-25T05:35:37.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e75fa640 1 -- 172.21.15.55:0/3184348156 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21dc0093b0 con 0x7f21e006c3b0 2023-08-25T05:35:37.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21d5ffb640 1 -- 172.21.15.55:0/3184348156 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc0bfb00 con 0x7f21e006c3b0 2023-08-25T05:35:37.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e75fa640 1 -- 172.21.15.55:0/3184348156 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e015f260 con 0x7f21e006c3b0 2023-08-25T05:35:37.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.641+0000 7f21e75fa640 1 -- 172.21.15.55:0/3184348156 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e015f450 con 0x7f21e006c3b0 2023-08-25T05:35:37.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.645+0000 7f21d5ffb640 1 -- 172.21.15.55:0/3184348156 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f21dc0b5400 con 0x7f21e006c3b0 2023-08-25T05:35:37.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.645+0000 7f21d5ffb640 1 --2- 172.21.15.55:0/3184348156 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f21c40657a0 0x7f21c4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:37.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.645+0000 7f21d5ffb640 1 -- 172.21.15.55:0/3184348156 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f21dc11d9f0 con 0x7f21e006c3b0 2023-08-25T05:35:37.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.645+0000 7f21e4b95640 1 --2- 172.21.15.55:0/3184348156 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f21c40657a0 0x7f21c4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:37.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.645+0000 7f21e4b95640 1 --2- 172.21.15.55:0/3184348156 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f21c40657a0 0x7f21c4067c60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f21e00b6520 tx=0x7f21d0009040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:37.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.649+0000 7f21d5ffb640 1 -- 172.21.15.55:0/3184348156 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f21dc0eb540 con 0x7f21e006c3b0 2023-08-25T05:35:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.805+0000 7f21e75fa640 1 -- 172.21.15.55:0/3184348156 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f21e0073ec0 con 0x7f21e006c3b0 2023-08-25T05:35:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.805+0000 7f21d5ffb640 1 -- 172.21.15.55:0/3184348156 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v184) v1 ==== 92+0+10 (secure 0 0 0) 0x7f21dc0eeb60 con 0x7f21e006c3b0 2023-08-25T05:35:37.814 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T05:35:37.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.809+0000 7f21e75fa640 1 -- 172.21.15.55:0/3184348156 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f21c40657a0 msgr2=0x7f21c4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:37.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.809+0000 7f21e75fa640 1 --2- 172.21.15.55:0/3184348156 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f21c40657a0 0x7f21c4067c60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f21e00b6520 tx=0x7f21d0009040 comp rx=0 tx=0).stop 2023-08-25T05:35:37.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.809+0000 7f21e75fa640 1 -- 172.21.15.55:0/3184348156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21e006c3b0 msgr2=0x7f21e015dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:37.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.809+0000 7f21e75fa640 1 --2- 172.21.15.55:0/3184348156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21e006c3b0 0x7f21e015dde0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f21dc01a060 tx=0x7f21dc01ac70 comp rx=0 tx=0).stop 2023-08-25T05:35:37.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.809+0000 7f21e75fa640 1 -- 172.21.15.55:0/3184348156 shutdown_connections 2023-08-25T05:35:37.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.809+0000 7f21e75fa640 1 --2- 172.21.15.55:0/3184348156 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f21c40657a0 0x7f21c4067c60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.809+0000 7f21e75fa640 1 --2- 172.21.15.55:0/3184348156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21e006e5a0 0x7f21e00b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.809+0000 7f21e75fa640 1 --2- 172.21.15.55:0/3184348156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21e006c790 0x7f21e01579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.809+0000 7f21e75fa640 1 --2- 172.21.15.55:0/3184348156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f21e006c3b0 0x7f21e015dde0 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.809+0000 7f21e75fa640 1 -- 172.21.15.55:0/3184348156 >> 172.21.15.55:0/3184348156 conn(0x7f21e00d0540 msgr2=0x7f21e00ada20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:37.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.809+0000 7f21e75fa640 1 -- 172.21.15.55:0/3184348156 shutdown_connections 2023-08-25T05:35:37.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.809+0000 7f21e75fa640 1 -- 172.21.15.55:0/3184348156 wait complete. 2023-08-25T05:35:37.831 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-25T05:35:37.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.969+0000 7fa1767fa640 1 Processor -- start 2023-08-25T05:35:37.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.973+0000 7fa1767fa640 1 -- start start 2023-08-25T05:35:37.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.973+0000 7fa1767fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700aeb10 0x7fa1700ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:37.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.973+0000 7fa1767fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1700cee20 0x7fa170069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:37.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.973+0000 7fa1767fa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa170069e40 0x7fa170160520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:37.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.973+0000 7fa1767fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1700d0380 con 0x7fa1700cee20 2023-08-25T05:35:37.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.973+0000 7fa1767fa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17006d590 con 0x7fa170069e40 2023-08-25T05:35:37.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.973+0000 7fa1767fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1700cf280 con 0x7fa1700aeb10 2023-08-25T05:35:37.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.973+0000 7fa16f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1700cee20 0x7fa170069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:37.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.973+0000 7fa16f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1700cee20 0x7fa170069900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60068/0 (socket says 172.21.15.55:60068) 2023-08-25T05:35:37.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.973+0000 7fa16f7fe640 1 -- 172.21.15.55:0/2111867736 learned_addr learned my addr 172.21.15.55:0/2111867736 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:37.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.973+0000 7fa16ffff640 1 --2- 172.21.15.55:0/2111867736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700aeb10 0x7fa1700ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:37.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.973+0000 7fa174d97640 1 --2- 172.21.15.55:0/2111867736 >> v2:172.21.15.110:3300/0 conn(0x7fa170069e40 0x7fa170160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:37.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.973+0000 7fa16f7fe640 1 -- 172.21.15.55:0/2111867736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700aeb10 msgr2=0x7fa1700ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:37.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.973+0000 7fa16f7fe640 1 --2- 172.21.15.55:0/2111867736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700aeb10 0x7fa1700ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.973+0000 7fa16f7fe640 1 -- 172.21.15.55:0/2111867736 >> v2:172.21.15.110:3300/0 conn(0x7fa170069e40 msgr2=0x7fa170160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:37.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.973+0000 7fa16f7fe640 1 --2- 172.21.15.55:0/2111867736 >> v2:172.21.15.110:3300/0 conn(0x7fa170069e40 0x7fa170160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.973+0000 7fa16f7fe640 1 -- 172.21.15.55:0/2111867736 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17006c4f0 con 0x7fa1700cee20 2023-08-25T05:35:37.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.977+0000 7fa16f7fe640 1 --2- 172.21.15.55:0/2111867736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700cee20 0x7fa170069900 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fa170070b30 tx=0x7fa16401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140129eb60c9f6bf server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:37.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.977+0000 7fa16effd640 1 -- 172.21.15.55:0/2111867736 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1640ab600 con 0x7fa1700cee20 2023-08-25T05:35:37.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.977+0000 7fa16effd640 1 -- 172.21.15.55:0/2111867736 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1640a7050 con 0x7fa1700cee20 2023-08-25T05:35:37.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.977+0000 7fa16effd640 1 -- 172.21.15.55:0/2111867736 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1640ab980 con 0x7fa1700cee20 2023-08-25T05:35:37.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.977+0000 7fa1767fa640 1 -- 172.21.15.55:0/2111867736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700cee20 msgr2=0x7fa170069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:37.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.977+0000 7fa1767fa640 1 --2- 172.21.15.55:0/2111867736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700cee20 0x7fa170069900 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fa170070b30 tx=0x7fa16401c240 comp rx=0 tx=0).stop 2023-08-25T05:35:37.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.977+0000 7fa1767fa640 1 -- 172.21.15.55:0/2111867736 shutdown_connections 2023-08-25T05:35:37.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.977+0000 7fa1767fa640 1 --2- 172.21.15.55:0/2111867736 >> v2:172.21.15.110:3300/0 conn(0x7fa170069e40 0x7fa170160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.977+0000 7fa1767fa640 1 --2- 172.21.15.55:0/2111867736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700cee20 0x7fa170069900 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.977+0000 7fa1767fa640 1 --2- 172.21.15.55:0/2111867736 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700aeb10 0x7fa1700ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.977+0000 7fa1767fa640 1 -- 172.21.15.55:0/2111867736 >> 172.21.15.55:0/2111867736 conn(0x7fa1700cf530 msgr2=0x7fa1700cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:37.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.977+0000 7fa1767fa640 1 -- 172.21.15.55:0/2111867736 shutdown_connections 2023-08-25T05:35:37.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.977+0000 7fa1767fa640 1 -- 172.21.15.55:0/2111867736 wait complete. 2023-08-25T05:35:37.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.977+0000 7fa1767fa640 1 Processor -- start 2023-08-25T05:35:37.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa1767fa640 1 -- start start 2023-08-25T05:35:37.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa1767fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa170069e40 0x7fa1700ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:37.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa1767fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700aeb10 0x7fa1700b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:37.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa1767fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700cee20 0x7fa17015f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:37.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa1767fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1700c3060 con 0x7fa1700cee20 2023-08-25T05:35:37.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa1767fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1700c3e80 con 0x7fa1700aeb10 2023-08-25T05:35:37.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa1767fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1700c32a0 con 0x7fa170069e40 2023-08-25T05:35:37.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa174d97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700cee20 0x7fa17015f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:37.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa174d97640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700cee20 0x7fa17015f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60072/0 (socket says 172.21.15.55:60072) 2023-08-25T05:35:37.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa174d97640 1 -- 172.21.15.55:0/1106170683 learned_addr learned my addr 172.21.15.55:0/1106170683 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:37.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa16ffff640 1 --2- 172.21.15.55:0/1106170683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa170069e40 0x7fa1700ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:37.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa174d97640 1 -- 172.21.15.55:0/1106170683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa170069e40 msgr2=0x7fa1700ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:37.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa16f7fe640 1 --2- 172.21.15.55:0/1106170683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700aeb10 0x7fa1700b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:37.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa174d97640 1 --2- 172.21.15.55:0/1106170683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa170069e40 0x7fa1700ad3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa174d97640 1 -- 172.21.15.55:0/1106170683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700aeb10 msgr2=0x7fa1700b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:37.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa174d97640 1 --2- 172.21.15.55:0/1106170683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700aeb10 0x7fa1700b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:37.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa174d97640 1 -- 172.21.15.55:0/1106170683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1640094d0 con 0x7fa1700cee20 2023-08-25T05:35:37.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa16ffff640 1 --2- 172.21.15.55:0/1106170683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa170069e40 0x7fa1700ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:37.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa16f7fe640 1 --2- 172.21.15.55:0/1106170683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700aeb10 0x7fa1700b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:37.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa174d97640 1 --2- 172.21.15.55:0/1106170683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700cee20 0x7fa17015f590 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7fa16800eed0 tx=0x7fa16800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:37.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa16cff9640 1 -- 172.21.15.55:0/1106170683 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa168010040 con 0x7fa1700cee20 2023-08-25T05:35:37.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa16cff9640 1 -- 172.21.15.55:0/1106170683 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16800bd20 con 0x7fa1700cee20 2023-08-25T05:35:37.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa16cff9640 1 -- 172.21.15.55:0/1106170683 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa168014640 con 0x7fa1700cee20 2023-08-25T05:35:37.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa1767fa640 1 -- 172.21.15.55:0/1106170683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1700c3830 con 0x7fa1700cee20 2023-08-25T05:35:37.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa1767fa640 1 -- 172.21.15.55:0/1106170683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1700ad930 con 0x7fa1700cee20 2023-08-25T05:35:37.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.981+0000 7fa1767fa640 1 -- 172.21.15.55:0/1106170683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17006cd70 con 0x7fa1700cee20 2023-08-25T05:35:37.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.985+0000 7fa16cff9640 1 -- 172.21.15.55:0/1106170683 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fa1680147a0 con 0x7fa1700cee20 2023-08-25T05:35:37.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.985+0000 7fa16cff9640 1 --2- 172.21.15.55:0/1106170683 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fa15c0657a0 0x7fa15c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:37.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.985+0000 7fa16cff9640 1 -- 172.21.15.55:0/1106170683 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa168083540 con 0x7fa1700cee20 2023-08-25T05:35:37.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.985+0000 7fa16ffff640 1 --2- 172.21.15.55:0/1106170683 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fa15c0657a0 0x7fa15c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:37.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.985+0000 7fa16ffff640 1 --2- 172.21.15.55:0/1106170683 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fa15c0657a0 0x7fa15c067c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa160009a40 tx=0x7fa160008040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:37.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:37.989+0000 7fa16cff9640 1 -- 172.21.15.55:0/1106170683 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa17006cd70 con 0x7fa1700cee20 2023-08-25T05:35:38.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.145+0000 7fa1767fa640 1 -- 172.21.15.55:0/1106170683 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa17006cd70 con 0x7fa1700cee20 2023-08-25T05:35:38.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.145+0000 7fa16cff9640 1 -- 172.21.15.55:0/1106170683 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v184) v1 ==== 84+0+126 (secure 0 0 0) 0x7fa168018090 con 0x7fa1700cee20 2023-08-25T05:35:38.151 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:38.151 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T05:35:38.152 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:38.152 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-08-25T05:35:38.152 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-08-25T05:35:38.152 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:35:38.152 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:38.152 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-08-25T05:35:38.152 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-08-25T05:35:38.153 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:38.153 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T05:35:38.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.149+0000 7fa1767fa640 1 -- 172.21.15.55:0/1106170683 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fa15c0657a0 msgr2=0x7fa15c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:38.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.149+0000 7fa1767fa640 1 --2- 172.21.15.55:0/1106170683 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fa15c0657a0 0x7fa15c067c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa160009a40 tx=0x7fa160008040 comp rx=0 tx=0).stop 2023-08-25T05:35:38.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.149+0000 7fa1767fa640 1 -- 172.21.15.55:0/1106170683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700cee20 msgr2=0x7fa17015f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:38.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.149+0000 7fa1767fa640 1 --2- 172.21.15.55:0/1106170683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700cee20 0x7fa17015f590 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7fa16800eed0 tx=0x7fa16800b480 comp rx=0 tx=0).stop 2023-08-25T05:35:38.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.149+0000 7fa1767fa640 1 -- 172.21.15.55:0/1106170683 shutdown_connections 2023-08-25T05:35:38.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.149+0000 7fa1767fa640 1 --2- 172.21.15.55:0/1106170683 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fa15c0657a0 0x7fa15c067c60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:38.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.149+0000 7fa1767fa640 1 --2- 172.21.15.55:0/1106170683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700cee20 0x7fa17015f590 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:38.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.149+0000 7fa1767fa640 1 --2- 172.21.15.55:0/1106170683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700aeb10 0x7fa1700b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:38.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.149+0000 7fa1767fa640 1 --2- 172.21.15.55:0/1106170683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa170069e40 0x7fa1700ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:38.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.149+0000 7fa1767fa640 1 -- 172.21.15.55:0/1106170683 >> 172.21.15.55:0/1106170683 conn(0x7fa1700cf530 msgr2=0x7fa1700cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:38.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.149+0000 7fa1767fa640 1 -- 172.21.15.55:0/1106170683 shutdown_connections 2023-08-25T05:35:38.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.149+0000 7fa1767fa640 1 -- 172.21.15.55:0/1106170683 wait complete. 2023-08-25T05:35:38.172 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-25T05:35:38.173 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-25T05:35:38.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.317+0000 7fd74c53a640 1 Processor -- start 2023-08-25T05:35:38.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.317+0000 7fd74c53a640 1 -- start start 2023-08-25T05:35:38.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.317+0000 7fd74c53a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd7440ca880 0x7fd744069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:38.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.317+0000 7fd74c53a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7440c8b60 0x7fd744069e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:38.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.317+0000 7fd74c53a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7440cc970 con 0x7fd7440ca4a0 2023-08-25T05:35:38.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.317+0000 7fd74c53a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7440ccc50 con 0x7fd7440ca880 2023-08-25T05:35:38.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.317+0000 7fd74c53a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7440ccf30 con 0x7fd7440c8b60 2023-08-25T05:35:38.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.317+0000 7fd74a2d6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd7440ca4a0 0x7fd74415a4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59400/0 (socket says 172.21.15.55:59400) 2023-08-25T05:35:38.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.317+0000 7fd74a2d6640 1 -- 172.21.15.55:0/2454605925 learned_addr learned my addr 172.21.15.55:0/2454605925 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:38.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.317+0000 7fd74aad7640 1 --2- 172.21.15.55:0/2454605925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7440c8b60 0x7fd744069e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:38.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.317+0000 7fd749ad5640 1 --2- 172.21.15.55:0/2454605925 >> v2:172.21.15.110:3300/0 conn(0x7fd7440ca880 0x7fd744069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:38.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.317+0000 7fd7492d4640 1 -- 172.21.15.55:0/2454605925 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684458704 0 0) 0x7fd7440cc970 con 0x7fd7440ca4a0 2023-08-25T05:35:38.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.317+0000 7fd7492d4640 1 -- 172.21.15.55:0/2454605925 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd730003530 con 0x7fd7440ca4a0 2023-08-25T05:35:38.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.317+0000 7fd749ad5640 1 -- 172.21.15.55:0/2454605925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7440c8b60 msgr2=0x7fd744069e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:38.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.317+0000 7fd749ad5640 1 --2- 172.21.15.55:0/2454605925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7440c8b60 0x7fd744069e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:38.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.317+0000 7fd749ad5640 1 -- 172.21.15.55:0/2454605925 >> v1:172.21.15.55:6789/0 conn(0x7fd7440ca4a0 legacy=0x7fd74415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:38.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.317+0000 7fd749ad5640 1 -- 172.21.15.55:0/2454605925 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7440cd210 con 0x7fd7440ca880 2023-08-25T05:35:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.321+0000 7fd749ad5640 1 --2- 172.21.15.55:0/2454605925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7440ca880 0x7fd744069900 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fd7340097c0 tx=0x7fd73401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bf7ec6ff3a90d4f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:38.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.321+0000 7fd7492d4640 1 -- 172.21.15.55:0/2454605925 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7340ad640 con 0x7fd7440ca880 2023-08-25T05:35:38.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.321+0000 7fd7492d4640 1 -- 172.21.15.55:0/2454605925 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7340ad7a0 con 0x7fd7440ca880 2023-08-25T05:35:38.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.321+0000 7fd7492d4640 1 -- 172.21.15.55:0/2454605925 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7340adb30 con 0x7fd7440ca880 2023-08-25T05:35:38.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.321+0000 7fd74c53a640 1 -- 172.21.15.55:0/2454605925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7440ca880 msgr2=0x7fd744069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:38.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.321+0000 7fd74c53a640 1 --2- 172.21.15.55:0/2454605925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7440ca880 0x7fd744069900 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fd7340097c0 tx=0x7fd73401c3f0 comp rx=0 tx=0).stop 2023-08-25T05:35:38.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.321+0000 7fd74c53a640 1 -- 172.21.15.55:0/2454605925 shutdown_connections 2023-08-25T05:35:38.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.321+0000 7fd74c53a640 1 --2- 172.21.15.55:0/2454605925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7440c8b60 0x7fd744069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:38.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.321+0000 7fd74c53a640 1 --2- 172.21.15.55:0/2454605925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7440ca880 0x7fd744069900 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:38.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.321+0000 7fd74c53a640 1 -- 172.21.15.55:0/2454605925 >> 172.21.15.55:0/2454605925 conn(0x7fd7440caf90 msgr2=0x7fd7440cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:38.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.321+0000 7fd74c53a640 1 -- 172.21.15.55:0/2454605925 shutdown_connections 2023-08-25T05:35:38.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.321+0000 7fd74c53a640 1 -- 172.21.15.55:0/2454605925 wait complete. 2023-08-25T05:35:38.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74c53a640 1 Processor -- start 2023-08-25T05:35:38.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74c53a640 1 -- start start 2023-08-25T05:35:38.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74c53a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7440c8b60 0x7fd744156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:38.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74c53a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7440ca4a0 0x7fd744167290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:38.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74c53a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7440ca880 0x7fd7441677d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:38.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74c53a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7441572a0 con 0x7fd7440ca880 2023-08-25T05:35:38.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74c53a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd744166f70 con 0x7fd7440ca4a0 2023-08-25T05:35:38.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74c53a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd744152f50 con 0x7fd7440c8b60 2023-08-25T05:35:38.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74aad7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7440ca880 0x7fd7441677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:38.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74aad7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7440ca880 0x7fd7441677d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60076/0 (socket says 172.21.15.55:60076) 2023-08-25T05:35:38.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74aad7640 1 -- 172.21.15.55:0/1198929107 learned_addr learned my addr 172.21.15.55:0/1198929107 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:38.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74a2d6640 1 --2- 172.21.15.55:0/1198929107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7440c8b60 0x7fd744156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:38.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd749ad5640 1 --2- 172.21.15.55:0/1198929107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7440ca4a0 0x7fd744167290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:38.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74aad7640 1 -- 172.21.15.55:0/1198929107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7440c8b60 msgr2=0x7fd744156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:38.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74aad7640 1 --2- 172.21.15.55:0/1198929107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7440c8b60 0x7fd744156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:38.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74aad7640 1 -- 172.21.15.55:0/1198929107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7440ca4a0 msgr2=0x7fd744167290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:38.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74aad7640 1 --2- 172.21.15.55:0/1198929107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7440ca4a0 0x7fd744167290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:38.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74aad7640 1 -- 172.21.15.55:0/1198929107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd734009420 con 0x7fd7440ca880 2023-08-25T05:35:38.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74aad7640 1 --2- 172.21.15.55:0/1198929107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7440ca880 0x7fd7441677d0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00efc0 tx=0x7fd73c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:38.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd73affd640 1 -- 172.21.15.55:0/1198929107 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c00ced0 con 0x7fd7440ca880 2023-08-25T05:35:38.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd73affd640 1 -- 172.21.15.55:0/1198929107 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73c00f040 con 0x7fd7440ca880 2023-08-25T05:35:38.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74c53a640 1 -- 172.21.15.55:0/1198929107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7440b1820 con 0x7fd7440ca880 2023-08-25T05:35:38.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd73affd640 1 -- 172.21.15.55:0/1198929107 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c0146c0 con 0x7fd7440ca880 2023-08-25T05:35:38.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.325+0000 7fd74c53a640 1 -- 172.21.15.55:0/1198929107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7440ad150 con 0x7fd7440ca880 2023-08-25T05:35:38.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.329+0000 7fd74c53a640 1 -- 172.21.15.55:0/1198929107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7440b19b0 con 0x7fd7440ca880 2023-08-25T05:35:38.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.329+0000 7fd73affd640 1 -- 172.21.15.55:0/1198929107 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fd73c014820 con 0x7fd7440ca880 2023-08-25T05:35:38.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.329+0000 7fd73affd640 1 --2- 172.21.15.55:0/1198929107 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fd7280657d0 0x7fd728067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:38.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.329+0000 7fd73affd640 1 -- 172.21.15.55:0/1198929107 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd73c0837d0 con 0x7fd7440ca880 2023-08-25T05:35:38.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.329+0000 7fd74a2d6640 1 --2- 172.21.15.55:0/1198929107 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fd7280657d0 0x7fd728067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:38.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.329+0000 7fd74a2d6640 1 --2- 172.21.15.55:0/1198929107 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fd7280657d0 0x7fd728067c90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7400011f0 tx=0x7fd740007d40 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:38.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.333+0000 7fd73affd640 1 -- 172.21.15.55:0/1198929107 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd73c054e60 con 0x7fd7440ca880 2023-08-25T05:35:38.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:38.493+0000 7fd74c53a640 1 -- 172.21.15.55:0/1198929107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd74404dbe0 con 0x7fd7440ca880 2023-08-25T05:35:39.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.377+0000 7fd73affd640 1 -- 172.21.15.55:0/1198929107 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v185) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd73c0549f0 con 0x7fd7440ca880 2023-08-25T05:35:39.383 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-08-25T05:35:39.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.389+0000 7fd74c53a640 1 -- 172.21.15.55:0/1198929107 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fd7280657d0 msgr2=0x7fd728067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:39.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.389+0000 7fd74c53a640 1 --2- 172.21.15.55:0/1198929107 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fd7280657d0 0x7fd728067c90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd7400011f0 tx=0x7fd740007d40 comp rx=0 tx=0).stop 2023-08-25T05:35:39.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.389+0000 7fd74c53a640 1 -- 172.21.15.55:0/1198929107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7440ca880 msgr2=0x7fd7441677d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:39.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.389+0000 7fd74c53a640 1 --2- 172.21.15.55:0/1198929107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7440ca880 0x7fd7441677d0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fd73c00efc0 tx=0x7fd73c00c490 comp rx=0 tx=0).stop 2023-08-25T05:35:39.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.389+0000 7fd74c53a640 1 -- 172.21.15.55:0/1198929107 shutdown_connections 2023-08-25T05:35:39.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.389+0000 7fd74c53a640 1 --2- 172.21.15.55:0/1198929107 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fd7280657d0 0x7fd728067c90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:39.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.389+0000 7fd74c53a640 1 --2- 172.21.15.55:0/1198929107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7440ca880 0x7fd7441677d0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:39.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.389+0000 7fd74c53a640 1 --2- 172.21.15.55:0/1198929107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7440ca4a0 0x7fd744167290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:39.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.389+0000 7fd74c53a640 1 --2- 172.21.15.55:0/1198929107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7440c8b60 0x7fd744156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:39.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.389+0000 7fd74c53a640 1 -- 172.21.15.55:0/1198929107 >> 172.21.15.55:0/1198929107 conn(0x7fd7440caf90 msgr2=0x7fd74415c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:39.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.389+0000 7fd74c53a640 1 -- 172.21.15.55:0/1198929107 shutdown_connections 2023-08-25T05:35:39.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.389+0000 7fd74c53a640 1 -- 172.21.15.55:0/1198929107 wait complete. 2023-08-25T05:35:39.417 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-25T05:35:39.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.569+0000 7fcb61e88640 1 Processor -- start 2023-08-25T05:35:39.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.569+0000 7fcb61e88640 1 -- start start 2023-08-25T05:35:39.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.569+0000 7fcb61e88640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcb5c0ae8e0 0x7fcb5c069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:39.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.569+0000 7fcb61e88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5c0cef20 0x7fcb5c15c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:39.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.569+0000 7fcb61e88640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb5c06a2a0 con 0x7fcb5c069e40 2023-08-25T05:35:39.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.569+0000 7fcb61e88640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb5c06d200 con 0x7fcb5c0ae8e0 2023-08-25T05:35:39.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.569+0000 7fcb61e88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c06c5f0 con 0x7fcb5c0cef20 2023-08-25T05:35:39.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.569+0000 7fcb5b7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcb5c0ae8e0 0x7fcb5c069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:39.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.569+0000 7fcb5bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5c0cef20 0x7fcb5c15c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:39.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.569+0000 7fcb5b7fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcb5c0ae8e0 0x7fcb5c069900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:35054/0 (socket says 172.21.15.55:35054) 2023-08-25T05:35:39.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.569+0000 7fcb5b7fe640 1 -- 172.21.15.55:0/3091529669 learned_addr learned my addr 172.21.15.55:0/3091529669 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:39.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.569+0000 7fcb5bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5c0cef20 0x7fcb5c15c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:37528/0 (socket says 172.21.15.55:37528) 2023-08-25T05:35:39.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.569+0000 7fcb53fff640 1 --1- 172.21.15.55:0/3091529669 >> v1:172.21.15.110:6789/0 conn(0x7fcb5c069e40 0x7fcb5c0ce810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:55906/0 (socket says 172.21.15.55:55906) 2023-08-25T05:35:39.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.573+0000 7fcb5b7fe640 1 -- 172.21.15.55:0/3091529669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5c0cef20 msgr2=0x7fcb5c15c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:39.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.573+0000 7fcb5b7fe640 1 --2- 172.21.15.55:0/3091529669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5c0cef20 0x7fcb5c15c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:39.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.573+0000 7fcb5b7fe640 1 -- 172.21.15.55:0/3091529669 >> v1:172.21.15.110:6789/0 conn(0x7fcb5c069e40 legacy=0x7fcb5c0ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:39.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.573+0000 7fcb5b7fe640 1 -- 172.21.15.55:0/3091529669 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c06c8d0 con 0x7fcb5c0ae8e0 2023-08-25T05:35:39.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.573+0000 7fcb5affd640 1 -- 172.21.15.55:0/3091529669 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821758921 0 0) 0x7fcb5c06a2a0 con 0x7fcb5c069e40 2023-08-25T05:35:39.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.573+0000 7fcb5bfff640 1 --2- 172.21.15.55:0/3091529669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5c0cef20 0x7fcb5c15c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:35:39.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.573+0000 7fcb5b7fe640 1 --2- 172.21.15.55:0/3091529669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb5c0ae8e0 0x7fcb5c069900 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009870 tx=0x7fcb4c01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9211af99462d76b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.573+0000 7fcb5affd640 1 -- 172.21.15.55:0/3091529669 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c0a9400 con 0x7fcb5c0ae8e0 2023-08-25T05:35:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.573+0000 7fcb5affd640 1 -- 172.21.15.55:0/3091529669 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c0a9560 con 0x7fcb5c0ae8e0 2023-08-25T05:35:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.573+0000 7fcb5affd640 1 -- 172.21.15.55:0/3091529669 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c0a96f0 con 0x7fcb5c0ae8e0 2023-08-25T05:35:39.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb61e88640 1 -- 172.21.15.55:0/3091529669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb5c0ae8e0 msgr2=0x7fcb5c069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:39.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb61e88640 1 --2- 172.21.15.55:0/3091529669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb5c0ae8e0 0x7fcb5c069900 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c009870 tx=0x7fcb4c01c540 comp rx=0 tx=0).stop 2023-08-25T05:35:39.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb61e88640 1 -- 172.21.15.55:0/3091529669 shutdown_connections 2023-08-25T05:35:39.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb61e88640 1 --2- 172.21.15.55:0/3091529669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5c0cef20 0x7fcb5c15c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:39.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb61e88640 1 --2- 172.21.15.55:0/3091529669 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb5c0ae8e0 0x7fcb5c069900 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:39.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb61e88640 1 -- 172.21.15.55:0/3091529669 >> 172.21.15.55:0/3091529669 conn(0x7fcb5c0cf4d0 msgr2=0x7fcb5c0cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:39.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb61e88640 1 -- 172.21.15.55:0/3091529669 shutdown_connections 2023-08-25T05:35:39.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb61e88640 1 -- 172.21.15.55:0/3091529669 wait complete. 2023-08-25T05:35:39.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb61e88640 1 Processor -- start 2023-08-25T05:35:39.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb61e88640 1 -- start start 2023-08-25T05:35:39.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb61e88640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb5c069e40 0x7fcb5c14cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:39.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb61e88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb5c0ae8e0 0x7fcb5c154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:39.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb61e88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5c0cef20 0x7fcb5c1549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:39.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb61e88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c155cc0 con 0x7fcb5c0ae8e0 2023-08-25T05:35:39.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb61e88640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c158d50 con 0x7fcb5c069e40 2023-08-25T05:35:39.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb61e88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c154ef0 con 0x7fcb5c0cef20 2023-08-25T05:35:39.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb53fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb5c0ae8e0 0x7fcb5c154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:39.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb53fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb5c0ae8e0 0x7fcb5c154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60084/0 (socket says 172.21.15.55:60084) 2023-08-25T05:35:39.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb53fff640 1 -- 172.21.15.55:0/186009651 learned_addr learned my addr 172.21.15.55:0/186009651 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:39.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb5b7fe640 1 --2- 172.21.15.55:0/186009651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb5c069e40 0x7fcb5c14cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:39.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb5bfff640 1 --2- 172.21.15.55:0/186009651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5c0cef20 0x7fcb5c1549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:39.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb53fff640 1 -- 172.21.15.55:0/186009651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5c0cef20 msgr2=0x7fcb5c1549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:39.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb53fff640 1 --2- 172.21.15.55:0/186009651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5c0cef20 0x7fcb5c1549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:39.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb53fff640 1 -- 172.21.15.55:0/186009651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb5c069e40 msgr2=0x7fcb5c14cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:39.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb53fff640 1 --2- 172.21.15.55:0/186009651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb5c069e40 0x7fcb5c14cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:39.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.577+0000 7fcb53fff640 1 -- 172.21.15.55:0/186009651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb54009a70 con 0x7fcb5c0ae8e0 2023-08-25T05:35:39.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.581+0000 7fcb53fff640 1 --2- 172.21.15.55:0/186009651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb5c0ae8e0 0x7fcb5c154470 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c520 tx=0x7fcb4400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:39.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.581+0000 7fcb58ff9640 1 -- 172.21.15.55:0/186009651 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb440074e0 con 0x7fcb5c0ae8e0 2023-08-25T05:35:39.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.581+0000 7fcb58ff9640 1 -- 172.21.15.55:0/186009651 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb44007640 con 0x7fcb5c0ae8e0 2023-08-25T05:35:39.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.581+0000 7fcb58ff9640 1 -- 172.21.15.55:0/186009651 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb440049f0 con 0x7fcb5c0ae8e0 2023-08-25T05:35:39.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.581+0000 7fcb61e88640 1 -- 172.21.15.55:0/186009651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4c0094d0 con 0x7fcb5c0ae8e0 2023-08-25T05:35:39.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.581+0000 7fcb61e88640 1 -- 172.21.15.55:0/186009651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5c155140 con 0x7fcb5c0ae8e0 2023-08-25T05:35:39.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.581+0000 7fcb61e88640 1 -- 172.21.15.55:0/186009651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb5c15a6c0 con 0x7fcb5c0ae8e0 2023-08-25T05:35:39.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.581+0000 7fcb58ff9640 1 -- 172.21.15.55:0/186009651 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fcb4401b360 con 0x7fcb5c0ae8e0 2023-08-25T05:35:39.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.581+0000 7fcb58ff9640 1 --2- 172.21.15.55:0/186009651 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fcb3c0657a0 0x7fcb3c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:39.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.581+0000 7fcb58ff9640 1 -- 172.21.15.55:0/186009651 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fcb44082160 con 0x7fcb5c0ae8e0 2023-08-25T05:35:39.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.585+0000 7fcb5b7fe640 1 --2- 172.21.15.55:0/186009651 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fcb3c0657a0 0x7fcb3c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:39.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.585+0000 7fcb5b7fe640 1 --2- 172.21.15.55:0/186009651 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fcb3c0657a0 0x7fcb3c067c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0ae000 tx=0x7fcb4c0b3040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:39.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.585+0000 7fcb58ff9640 1 -- 172.21.15.55:0/186009651 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fcb4404fd80 con 0x7fcb5c0ae8e0 2023-08-25T05:35:39.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:39.741+0000 7fcb61e88640 1 -- 172.21.15.55:0/186009651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcb5c073ec0 con 0x7fcb5c0ae8e0 2023-08-25T05:35:40.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.401+0000 7fcb58ff9640 1 -- 172.21.15.55:0/186009651 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v186) v1 ==== 170+0+0 (secure 0 0 0) 0x7fcb440533a0 con 0x7fcb5c0ae8e0 2023-08-25T05:35:40.415 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-08-25T05:35:40.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.417+0000 7fcb61e88640 1 -- 172.21.15.55:0/186009651 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fcb3c0657a0 msgr2=0x7fcb3c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:40.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.417+0000 7fcb61e88640 1 --2- 172.21.15.55:0/186009651 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fcb3c0657a0 0x7fcb3c067c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c0ae000 tx=0x7fcb4c0b3040 comp rx=0 tx=0).stop 2023-08-25T05:35:40.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.417+0000 7fcb61e88640 1 -- 172.21.15.55:0/186009651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb5c0ae8e0 msgr2=0x7fcb5c154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:40.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.417+0000 7fcb61e88640 1 --2- 172.21.15.55:0/186009651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb5c0ae8e0 0x7fcb5c154470 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c520 tx=0x7fcb4400c920 comp rx=0 tx=0).stop 2023-08-25T05:35:40.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.417+0000 7fcb61e88640 1 -- 172.21.15.55:0/186009651 shutdown_connections 2023-08-25T05:35:40.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.417+0000 7fcb61e88640 1 --2- 172.21.15.55:0/186009651 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fcb3c0657a0 0x7fcb3c067c60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:40.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.417+0000 7fcb61e88640 1 --2- 172.21.15.55:0/186009651 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb5c0cef20 0x7fcb5c1549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:40.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.417+0000 7fcb61e88640 1 --2- 172.21.15.55:0/186009651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb5c0ae8e0 0x7fcb5c154470 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:40.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.417+0000 7fcb61e88640 1 --2- 172.21.15.55:0/186009651 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb5c069e40 0x7fcb5c14cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:40.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.417+0000 7fcb61e88640 1 -- 172.21.15.55:0/186009651 >> 172.21.15.55:0/186009651 conn(0x7fcb5c0cf4d0 msgr2=0x7fcb5c0c65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:40.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.417+0000 7fcb61e88640 1 -- 172.21.15.55:0/186009651 shutdown_connections 2023-08-25T05:35:40.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.417+0000 7fcb61e88640 1 -- 172.21.15.55:0/186009651 wait complete. 2023-08-25T05:35:40.440 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-25T05:35:40.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.585+0000 7f40f61a3640 1 Processor -- start 2023-08-25T05:35:40.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.585+0000 7f40f61a3640 1 -- start start 2023-08-25T05:35:40.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.585+0000 7f40f61a3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f40f006c3b0 0x7f40f00cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:40.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.585+0000 7f40f61a3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f40f006c790 0x7f40f006de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:40.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.585+0000 7f40f61a3640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f00cab90 con 0x7f40f00d1060 2023-08-25T05:35:40.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.585+0000 7f40f61a3640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f006dbb0 con 0x7f40f006c790 2023-08-25T05:35:40.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.585+0000 7f40f61a3640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f00cae50 con 0x7f40f006c3b0 2023-08-25T05:35:40.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.585+0000 7f40e7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f40f006c790 0x7f40f006de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:40.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.585+0000 7f40e7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f40f006c790 0x7f40f006de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41086/0 (socket says 172.21.15.55:41086) 2023-08-25T05:35:40.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.585+0000 7f40e7fff640 1 -- 172.21.15.55:0/3410466642 learned_addr learned my addr 172.21.15.55:0/3410466642 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:40.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.585+0000 7f40ef7fe640 1 --2- 172.21.15.55:0/3410466642 >> v2:172.21.15.110:3300/0 conn(0x7f40f006c3b0 0x7f40f00cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:40.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.585+0000 7f40e7fff640 1 -- 172.21.15.55:0/3410466642 >> v2:172.21.15.110:3300/0 conn(0x7f40f006c3b0 msgr2=0x7f40f00cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:40.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.585+0000 7f40e7fff640 1 --2- 172.21.15.55:0/3410466642 >> v2:172.21.15.110:3300/0 conn(0x7f40f006c3b0 0x7f40f00cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:40.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.585+0000 7f40e7fff640 1 -- 172.21.15.55:0/3410466642 >> v1:172.21.15.110:6789/0 conn(0x7f40f00d1060 legacy=0x7f40f015c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:40.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.585+0000 7f40e7fff640 1 -- 172.21.15.55:0/3410466642 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f00cb130 con 0x7f40f006c790 2023-08-25T05:35:40.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.589+0000 7f40e7fff640 1 --2- 172.21.15.55:0/3410466642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f006c790 0x7f40f006de90 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f40f00718a0 tx=0x7f40d801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b0425e94eb4edb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:40.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.589+0000 7f40eeffd640 1 -- 172.21.15.55:0/3410466642 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d80ac640 con 0x7f40f006c790 2023-08-25T05:35:40.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.589+0000 7f40eeffd640 1 -- 172.21.15.55:0/3410466642 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d80ac7a0 con 0x7f40f006c790 2023-08-25T05:35:40.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.589+0000 7f40eeffd640 1 -- 172.21.15.55:0/3410466642 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d80acb30 con 0x7f40f006c790 2023-08-25T05:35:40.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.589+0000 7f40f61a3640 1 -- 172.21.15.55:0/3410466642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f006c790 msgr2=0x7f40f006de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:40.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.589+0000 7f40f61a3640 1 --2- 172.21.15.55:0/3410466642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f006c790 0x7f40f006de90 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f40f00718a0 tx=0x7f40d801c4d0 comp rx=0 tx=0).stop 2023-08-25T05:35:40.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.589+0000 7f40f61a3640 1 -- 172.21.15.55:0/3410466642 shutdown_connections 2023-08-25T05:35:40.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.589+0000 7f40f61a3640 1 --2- 172.21.15.55:0/3410466642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f006c790 0x7f40f006de90 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:40.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.589+0000 7f40f61a3640 1 --2- 172.21.15.55:0/3410466642 >> v2:172.21.15.110:3300/0 conn(0x7f40f006c3b0 0x7f40f00cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:40.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.589+0000 7f40f61a3640 1 -- 172.21.15.55:0/3410466642 >> 172.21.15.55:0/3410466642 conn(0x7f40f00d0540 msgr2=0x7f40f00d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:40.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.589+0000 7f40f61a3640 1 -- 172.21.15.55:0/3410466642 shutdown_connections 2023-08-25T05:35:40.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.589+0000 7f40f61a3640 1 -- 172.21.15.55:0/3410466642 wait complete. 2023-08-25T05:35:40.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.589+0000 7f40f61a3640 1 Processor -- start 2023-08-25T05:35:40.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.589+0000 7f40f61a3640 1 -- start start 2023-08-25T05:35:40.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40f61a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f006c3b0 0x7f40f014f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:40.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40f61a3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40f006c790 0x7f40f01531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:40.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40f61a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40f00d1060 0x7f40f00cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:40.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40f61a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0153af0 con 0x7f40f006c3b0 2023-08-25T05:35:40.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40f61a3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0153dd0 con 0x7f40f006c790 2023-08-25T05:35:40.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40f61a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f01540b0 con 0x7f40f00d1060 2023-08-25T05:35:40.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40ef7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f006c3b0 0x7f40f014f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:40.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40ef7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f006c3b0 0x7f40f014f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41102/0 (socket says 172.21.15.55:41102) 2023-08-25T05:35:40.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40ef7fe640 1 -- 172.21.15.55:0/3429546580 learned_addr learned my addr 172.21.15.55:0/3429546580 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:40.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40e7fff640 1 --2- 172.21.15.55:0/3429546580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40f006c790 0x7f40f01531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:40.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40effff640 1 --2- 172.21.15.55:0/3429546580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40f00d1060 0x7f40f00cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:40.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40ef7fe640 1 -- 172.21.15.55:0/3429546580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40f00d1060 msgr2=0x7f40f00cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:40.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40ef7fe640 1 --2- 172.21.15.55:0/3429546580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40f00d1060 0x7f40f00cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:40.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40ef7fe640 1 -- 172.21.15.55:0/3429546580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40f006c790 msgr2=0x7f40f01531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:40.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40ef7fe640 1 --2- 172.21.15.55:0/3429546580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40f006c790 0x7f40f01531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:40.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40ef7fe640 1 -- 172.21.15.55:0/3429546580 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d80094d0 con 0x7f40f006c3b0 2023-08-25T05:35:40.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40ef7fe640 1 --2- 172.21.15.55:0/3429546580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f006c3b0 0x7f40f014f9c0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f40e000d800 tx=0x7f40e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:40.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40ecff9640 1 -- 172.21.15.55:0/3429546580 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e0018070 con 0x7f40f006c3b0 2023-08-25T05:35:40.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40ecff9640 1 -- 172.21.15.55:0/3429546580 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e00059a0 con 0x7f40f006c3b0 2023-08-25T05:35:40.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40ecff9640 1 -- 172.21.15.55:0/3429546580 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e0005b50 con 0x7f40f006c3b0 2023-08-25T05:35:40.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40f61a3640 1 -- 172.21.15.55:0/3429546580 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f0154390 con 0x7f40f006c3b0 2023-08-25T05:35:40.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40f61a3640 1 -- 172.21.15.55:0/3429546580 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f014ff00 con 0x7f40f006c3b0 2023-08-25T05:35:40.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.593+0000 7f40f61a3640 1 -- 172.21.15.55:0/3429546580 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f0073ec0 con 0x7f40f006c3b0 2023-08-25T05:35:40.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.597+0000 7f40ecff9640 1 -- 172.21.15.55:0/3429546580 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f40e0005cb0 con 0x7f40f006c3b0 2023-08-25T05:35:40.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.597+0000 7f40ecff9640 1 --2- 172.21.15.55:0/3429546580 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f40d00657d0 0x7f40d0067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:40.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.597+0000 7f40ecff9640 1 -- 172.21.15.55:0/3429546580 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f40e0082e50 con 0x7f40f006c3b0 2023-08-25T05:35:40.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.597+0000 7f40e7fff640 1 --2- 172.21.15.55:0/3429546580 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f40d00657d0 0x7f40d0067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:40.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.597+0000 7f40e7fff640 1 --2- 172.21.15.55:0/3429546580 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f40d00657d0 0x7f40d0067c90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f40d80ae000 tx=0x7f40d8008040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:40.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.601+0000 7f40ecff9640 1 -- 172.21.15.55:0/3429546580 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f40e0050730 con 0x7f40f006c3b0 2023-08-25T05:35:40.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:40.789+0000 7f40f61a3640 1 -- 172.21.15.55:0/3429546580 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f40f00d0210 con 0x7f40f006c3b0 2023-08-25T05:35:41.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.397+0000 7f40ecff9640 1 -- 172.21.15.55:0/3429546580 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v88) v1 ==== 174+0+0 (secure 0 0 0) 0x7f40e0053d50 con 0x7f40f006c3b0 2023-08-25T05:35:41.405 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 23 and data pool 24 2023-08-25T05:35:41.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.417+0000 7f40f61a3640 1 -- 172.21.15.55:0/3429546580 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f40d00657d0 msgr2=0x7f40d0067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:41.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.417+0000 7f40f61a3640 1 --2- 172.21.15.55:0/3429546580 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f40d00657d0 0x7f40d0067c90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f40d80ae000 tx=0x7f40d8008040 comp rx=0 tx=0).stop 2023-08-25T05:35:41.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.421+0000 7f40f61a3640 1 -- 172.21.15.55:0/3429546580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f006c3b0 msgr2=0x7f40f014f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:41.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.421+0000 7f40f61a3640 1 --2- 172.21.15.55:0/3429546580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f006c3b0 0x7f40f014f9c0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f40e000d800 tx=0x7f40e000dcc0 comp rx=0 tx=0).stop 2023-08-25T05:35:41.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.421+0000 7f40f61a3640 1 -- 172.21.15.55:0/3429546580 shutdown_connections 2023-08-25T05:35:41.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.421+0000 7f40f61a3640 1 --2- 172.21.15.55:0/3429546580 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f40d00657d0 0x7f40d0067c90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:41.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.421+0000 7f40f61a3640 1 --2- 172.21.15.55:0/3429546580 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f40f00d1060 0x7f40f00cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:41.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.421+0000 7f40f61a3640 1 --2- 172.21.15.55:0/3429546580 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f40f006c790 0x7f40f01531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:41.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.421+0000 7f40f61a3640 1 --2- 172.21.15.55:0/3429546580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40f006c3b0 0x7f40f014f9c0 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:41.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.421+0000 7f40f61a3640 1 -- 172.21.15.55:0/3429546580 >> 172.21.15.55:0/3429546580 conn(0x7f40f00d0540 msgr2=0x7f40f00b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:41.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.421+0000 7f40f61a3640 1 -- 172.21.15.55:0/3429546580 shutdown_connections 2023-08-25T05:35:41.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.421+0000 7f40f61a3640 1 -- 172.21.15.55:0/3429546580 wait complete. 2023-08-25T05:35:41.454 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:35:41.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.597+0000 7f159f500640 1 Processor -- start 2023-08-25T05:35:41.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.597+0000 7f159f500640 1 -- start start 2023-08-25T05:35:41.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.597+0000 7f159f500640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15980d0da0 0x7f15980d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:41.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.597+0000 7f159f500640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15980b3e50 0x7f15980ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:41.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.597+0000 7f159f500640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15980b29b0 con 0x7f15980cdde0 2023-08-25T05:35:41.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.597+0000 7f159f500640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15980ce760 con 0x7f15980d0da0 2023-08-25T05:35:41.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.597+0000 7f159f500640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15980d16c0 con 0x7f15980b3e50 2023-08-25T05:35:41.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.597+0000 7f159d29c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15980d0da0 0x7f15980d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:41.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.597+0000 7f159d29c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15980d0da0 0x7f15980d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41118/0 (socket says 172.21.15.55:41118) 2023-08-25T05:35:41.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.597+0000 7f159d29c640 1 -- 172.21.15.55:0/6235484 learned_addr learned my addr 172.21.15.55:0/6235484 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:41.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.597+0000 7f159ca9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f15980cdde0 0x7f15980cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:51874/0 (socket says 172.21.15.55:51874) 2023-08-25T05:35:41.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.597+0000 7f159da9d640 1 --2- 172.21.15.55:0/6235484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15980b3e50 0x7f15980ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:41.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.597+0000 7f159d29c640 1 -- 172.21.15.55:0/6235484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15980b3e50 msgr2=0x7f15980ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:41.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.597+0000 7f159d29c640 1 --2- 172.21.15.55:0/6235484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15980b3e50 0x7f15980ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:41.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.597+0000 7f159d29c640 1 -- 172.21.15.55:0/6235484 >> v1:172.21.15.55:6789/0 conn(0x7f15980cdde0 legacy=0x7f15980cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:41.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.597+0000 7f159d29c640 1 -- 172.21.15.55:0/6235484 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15980b1dc0 con 0x7f15980d0da0 2023-08-25T05:35:41.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.601+0000 7f159d29c640 1 --2- 172.21.15.55:0/6235484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15980d0da0 0x7f15980d1180 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f1594006fd0 tx=0x7f159401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6378686cde3f6323 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:41.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.601+0000 7f158ffff640 1 -- 172.21.15.55:0/6235484 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15940a8a10 con 0x7f15980d0da0 2023-08-25T05:35:41.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.601+0000 7f158ffff640 1 -- 172.21.15.55:0/6235484 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15940a8b70 con 0x7f15980d0da0 2023-08-25T05:35:41.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.601+0000 7f158ffff640 1 -- 172.21.15.55:0/6235484 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15940b0440 con 0x7f15980d0da0 2023-08-25T05:35:41.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.601+0000 7f159f500640 1 -- 172.21.15.55:0/6235484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15980d0da0 msgr2=0x7f15980d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:41.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.601+0000 7f159f500640 1 --2- 172.21.15.55:0/6235484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15980d0da0 0x7f15980d1180 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f1594006fd0 tx=0x7f159401ed10 comp rx=0 tx=0).stop 2023-08-25T05:35:41.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.601+0000 7f159f500640 1 -- 172.21.15.55:0/6235484 shutdown_connections 2023-08-25T05:35:41.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.601+0000 7f159f500640 1 --2- 172.21.15.55:0/6235484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15980b3e50 0x7f15980ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:41.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.601+0000 7f159f500640 1 --2- 172.21.15.55:0/6235484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15980d0da0 0x7f15980d1180 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:41.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.601+0000 7f159f500640 1 -- 172.21.15.55:0/6235484 >> 172.21.15.55:0/6235484 conn(0x7f159809bae0 msgr2=0x7f15980d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:41.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.601+0000 7f159f500640 1 -- 172.21.15.55:0/6235484 shutdown_connections 2023-08-25T05:35:41.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.601+0000 7f159f500640 1 -- 172.21.15.55:0/6235484 wait complete. 2023-08-25T05:35:41.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159f500640 1 Processor -- start 2023-08-25T05:35:41.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159f500640 1 -- start start 2023-08-25T05:35:41.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159f500640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15980b3e50 0x7f159814df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:41.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159f500640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15980cdde0 0x7f15980c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:41.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159f500640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15980d0da0 0x7f15980d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:41.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159f500640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15980c7420 con 0x7f15980d0da0 2023-08-25T05:35:41.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159f500640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159814e460 con 0x7f15980cdde0 2023-08-25T05:35:41.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159f500640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15980c6db0 con 0x7f15980b3e50 2023-08-25T05:35:41.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159da9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15980d0da0 0x7f15980d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:41.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159da9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15980d0da0 0x7f15980d2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41120/0 (socket says 172.21.15.55:41120) 2023-08-25T05:35:41.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159da9d640 1 -- 172.21.15.55:0/2402680662 learned_addr learned my addr 172.21.15.55:0/2402680662 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:41.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159d29c640 1 --2- 172.21.15.55:0/2402680662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15980b3e50 0x7f159814df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:41.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159ca9b640 1 --2- 172.21.15.55:0/2402680662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15980cdde0 0x7f15980c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:41.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159da9d640 1 -- 172.21.15.55:0/2402680662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15980b3e50 msgr2=0x7f159814df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:41.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159da9d640 1 --2- 172.21.15.55:0/2402680662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15980b3e50 0x7f159814df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:41.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159da9d640 1 -- 172.21.15.55:0/2402680662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15980cdde0 msgr2=0x7f15980c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:41.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159da9d640 1 --2- 172.21.15.55:0/2402680662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15980cdde0 0x7f15980c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:41.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159da9d640 1 -- 172.21.15.55:0/2402680662 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1594009480 con 0x7f15980d0da0 2023-08-25T05:35:41.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159da9d640 1 --2- 172.21.15.55:0/2402680662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15980d0da0 0x7f15980d2bd0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f1590007d40 tx=0x7f159000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:41.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f158dffb640 1 -- 172.21.15.55:0/2402680662 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590014420 con 0x7f15980d0da0 2023-08-25T05:35:41.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f158dffb640 1 -- 172.21.15.55:0/2402680662 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15900145a0 con 0x7f15980d0da0 2023-08-25T05:35:41.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159f500640 1 -- 172.21.15.55:0/2402680662 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15980c7090 con 0x7f15980d0da0 2023-08-25T05:35:41.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f158dffb640 1 -- 172.21.15.55:0/2402680662 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590014950 con 0x7f15980d0da0 2023-08-25T05:35:41.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.605+0000 7f159f500640 1 -- 172.21.15.55:0/2402680662 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15980c79c0 con 0x7f15980d0da0 2023-08-25T05:35:41.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.609+0000 7f159f500640 1 -- 172.21.15.55:0/2402680662 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159804dbe0 con 0x7f15980d0da0 2023-08-25T05:35:41.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.609+0000 7f158dffb640 1 -- 172.21.15.55:0/2402680662 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f1590014ab0 con 0x7f15980d0da0 2023-08-25T05:35:41.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.609+0000 7f158dffb640 1 --2- 172.21.15.55:0/2402680662 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f157c0657a0 0x7f157c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:41.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.609+0000 7f158dffb640 1 -- 172.21.15.55:0/2402680662 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15900837d0 con 0x7f15980d0da0 2023-08-25T05:35:41.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.609+0000 7f159d29c640 1 --2- 172.21.15.55:0/2402680662 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f157c0657a0 0x7f157c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:41.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.609+0000 7f159d29c640 1 --2- 172.21.15.55:0/2402680662 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f157c0657a0 0x7f157c067c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15940b2000 tx=0x7f1594009040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:41.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.613+0000 7f158dffb640 1 -- 172.21.15.55:0/2402680662 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1590051190 con 0x7f15980d0da0 2023-08-25T05:35:41.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.769+0000 7f159f500640 1 -- 172.21.15.55:0/2402680662 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15980d0b80 con 0x7f15980d0da0 2023-08-25T05:35:41.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.773+0000 7f158dffb640 1 -- 172.21.15.55:0/2402680662 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+18318 (secure 0 0 0) 0x7f15900547b0 con 0x7f15980d0da0 2023-08-25T05:35:41.776 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:41.777 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":187,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:35:40.794281+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:35:38.546524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-25T05:35:39.796267+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:35:41.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.773+0000 7f159f500640 1 -- 172.21.15.55:0/2402680662 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f157c0657a0 msgr2=0x7f157c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:41.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.773+0000 7f159f500640 1 --2- 172.21.15.55:0/2402680662 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f157c0657a0 0x7f157c067c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15940b2000 tx=0x7f1594009040 comp rx=0 tx=0).stop 2023-08-25T05:35:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.773+0000 7f159f500640 1 -- 172.21.15.55:0/2402680662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15980d0da0 msgr2=0x7f15980d2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.773+0000 7f159f500640 1 --2- 172.21.15.55:0/2402680662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15980d0da0 0x7f15980d2bd0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f1590007d40 tx=0x7f159000e4b0 comp rx=0 tx=0).stop 2023-08-25T05:35:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.773+0000 7f159f500640 1 -- 172.21.15.55:0/2402680662 shutdown_connections 2023-08-25T05:35:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.773+0000 7f159f500640 1 --2- 172.21.15.55:0/2402680662 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f157c0657a0 0x7f157c067c60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:41.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.773+0000 7f159f500640 1 --2- 172.21.15.55:0/2402680662 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15980d0da0 0x7f15980d2bd0 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.773+0000 7f159f500640 1 --2- 172.21.15.55:0/2402680662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15980cdde0 0x7f15980c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.773+0000 7f159f500640 1 --2- 172.21.15.55:0/2402680662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15980b3e50 0x7f159814df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.773+0000 7f159f500640 1 -- 172.21.15.55:0/2402680662 >> 172.21.15.55:0/2402680662 conn(0x7f159809bae0 msgr2=0x7f159806b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.773+0000 7f159f500640 1 -- 172.21.15.55:0/2402680662 shutdown_connections 2023-08-25T05:35:41.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.773+0000 7f159f500640 1 -- 172.21.15.55:0/2402680662 wait complete. 2023-08-25T05:35:41.798 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:35:41.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.937+0000 7f0d4b034640 1 Processor -- start 2023-08-25T05:35:41.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.937+0000 7f0d4b034640 1 -- start start 2023-08-25T05:35:41.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.937+0000 7f0d4b034640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0d440cd360 0x7f0d4406dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:41.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.937+0000 7f0d4b034640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d440ce170 con 0x7f0d440ccf20 2023-08-25T05:35:41.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.937+0000 7f0d4b034640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d440ce3a0 con 0x7f0d4415a830 2023-08-25T05:35:41.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.941+0000 7f0d4b034640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d440ce660 con 0x7f0d440cd360 2023-08-25T05:35:41.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.941+0000 7f0d43fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0d440ccf20 0x7f0d4406d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:51890/0 (socket says 172.21.15.55:51890) 2023-08-25T05:35:41.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.941+0000 7f0d43fff640 1 -- 172.21.15.55:0/1720281466 learned_addr learned my addr 172.21.15.55:0/1720281466 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:41.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.941+0000 7f0d495d1640 1 --2- 172.21.15.55:0/1720281466 >> v2:172.21.15.110:3300/0 conn(0x7f0d440cd360 0x7f0d4406dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:41.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.941+0000 7f0d437fe640 1 -- 172.21.15.55:0/1720281466 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129599971 0 0) 0x7f0d440ce170 con 0x7f0d440ccf20 2023-08-25T05:35:41.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.941+0000 7f0d437fe640 1 -- 172.21.15.55:0/1720281466 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d34003530 con 0x7f0d440ccf20 2023-08-25T05:35:41.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.941+0000 7f0d495d1640 1 -- 172.21.15.55:0/1720281466 >> v1:172.21.15.110:6789/0 conn(0x7f0d4415a830 legacy=0x7f0d440cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:41.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.941+0000 7f0d495d1640 1 -- 172.21.15.55:0/1720281466 >> v1:172.21.15.55:6789/0 conn(0x7f0d440ccf20 legacy=0x7f0d4406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:41.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.941+0000 7f0d495d1640 1 -- 172.21.15.55:0/1720281466 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d440ce940 con 0x7f0d440cd360 2023-08-25T05:35:41.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.941+0000 7f0d495d1640 1 --2- 172.21.15.55:0/1720281466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d440cd360 0x7f0d4406dc60 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009d90 tx=0x7f0d3c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e757d54ed191a77 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:41.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d437fe640 1 -- 172.21.15.55:0/1720281466 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0a59e0 con 0x7f0d440cd360 2023-08-25T05:35:41.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d437fe640 1 -- 172.21.15.55:0/1720281466 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3c0a5b40 con 0x7f0d440cd360 2023-08-25T05:35:41.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d437fe640 1 -- 172.21.15.55:0/1720281466 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0ad440 con 0x7f0d440cd360 2023-08-25T05:35:41.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d4b034640 1 -- 172.21.15.55:0/1720281466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d440cd360 msgr2=0x7f0d4406dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:41.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d4b034640 1 --2- 172.21.15.55:0/1720281466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d440cd360 0x7f0d4406dc60 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009d90 tx=0x7f0d3c01c920 comp rx=0 tx=0).stop 2023-08-25T05:35:41.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d4b034640 1 -- 172.21.15.55:0/1720281466 shutdown_connections 2023-08-25T05:35:41.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d4b034640 1 --2- 172.21.15.55:0/1720281466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d440cd360 0x7f0d4406dc60 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:41.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d4b034640 1 -- 172.21.15.55:0/1720281466 >> 172.21.15.55:0/1720281466 conn(0x7f0d440d05a0 msgr2=0x7f0d440d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:41.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d4b034640 1 -- 172.21.15.55:0/1720281466 shutdown_connections 2023-08-25T05:35:41.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d4b034640 1 -- 172.21.15.55:0/1720281466 wait complete. 2023-08-25T05:35:41.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d4b034640 1 Processor -- start 2023-08-25T05:35:41.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d4b034640 1 -- start start 2023-08-25T05:35:41.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d4b034640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d440ccf20 0x7f0d440c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:41.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d4b034640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d440cd360 0x7f0d4406b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:41.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d4b034640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d4415a830 0x7f0d44165940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:41.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d4b034640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d44166100 con 0x7f0d4415a830 2023-08-25T05:35:41.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d4b034640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440c9560 con 0x7f0d440ccf20 2023-08-25T05:35:41.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d4b034640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d44165e80 con 0x7f0d440cd360 2023-08-25T05:35:41.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.945+0000 7f0d495d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d4415a830 0x7f0d44165940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:41.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.949+0000 7f0d495d1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d4415a830 0x7f0d44165940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41136/0 (socket says 172.21.15.55:41136) 2023-08-25T05:35:41.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.949+0000 7f0d495d1640 1 -- 172.21.15.55:0/3875348119 learned_addr learned my addr 172.21.15.55:0/3875348119 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:41.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.949+0000 7f0d48dd0640 1 --2- 172.21.15.55:0/3875348119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d440ccf20 0x7f0d440c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:41.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.949+0000 7f0d43fff640 1 --2- 172.21.15.55:0/3875348119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d440cd360 0x7f0d4406b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:41.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.949+0000 7f0d495d1640 1 -- 172.21.15.55:0/3875348119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d440cd360 msgr2=0x7f0d4406b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:41.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.949+0000 7f0d495d1640 1 --2- 172.21.15.55:0/3875348119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d440cd360 0x7f0d4406b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:41.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.949+0000 7f0d495d1640 1 -- 172.21.15.55:0/3875348119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d440ccf20 msgr2=0x7f0d440c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:41.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.949+0000 7f0d495d1640 1 --2- 172.21.15.55:0/3875348119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d440ccf20 0x7f0d440c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:41.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.949+0000 7f0d495d1640 1 -- 172.21.15.55:0/3875348119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c009a70 con 0x7f0d4415a830 2023-08-25T05:35:41.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.949+0000 7f0d43fff640 1 --2- 172.21.15.55:0/3875348119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d440cd360 0x7f0d4406b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:41.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.949+0000 7f0d495d1640 1 --2- 172.21.15.55:0/3875348119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d4415a830 0x7f0d44165940 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009d90 tx=0x7f0d3c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:41.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.949+0000 7f0d417fa640 1 -- 172.21.15.55:0/3875348119 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0aee00 con 0x7f0d4415a830 2023-08-25T05:35:41.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.949+0000 7f0d417fa640 1 -- 172.21.15.55:0/3875348119 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3c009450 con 0x7f0d4415a830 2023-08-25T05:35:41.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.949+0000 7f0d417fa640 1 -- 172.21.15.55:0/3875348119 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0b7610 con 0x7f0d4415a830 2023-08-25T05:35:41.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.949+0000 7f0d4b034640 1 -- 172.21.15.55:0/3875348119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d440c8c30 con 0x7f0d4415a830 2023-08-25T05:35:41.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.949+0000 7f0d4b034640 1 -- 172.21.15.55:0/3875348119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d440c91f0 con 0x7f0d4415a830 2023-08-25T05:35:41.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.949+0000 7f0d4b034640 1 -- 172.21.15.55:0/3875348119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4404dbe0 con 0x7f0d4415a830 2023-08-25T05:35:41.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.949+0000 7f0d417fa640 1 -- 172.21.15.55:0/3875348119 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f0d3c0b4050 con 0x7f0d4415a830 2023-08-25T05:35:41.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.953+0000 7f0d417fa640 1 --2- 172.21.15.55:0/3875348119 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f0d280657d0 0x7f0d28067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:41.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.953+0000 7f0d417fa640 1 -- 172.21.15.55:0/3875348119 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0d3c11dd60 con 0x7f0d4415a830 2023-08-25T05:35:41.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.953+0000 7f0d48dd0640 1 --2- 172.21.15.55:0/3875348119 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f0d280657d0 0x7f0d28067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:41.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.953+0000 7f0d48dd0640 1 --2- 172.21.15.55:0/3875348119 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f0d280657d0 0x7f0d28067c90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0d380017e0 tx=0x7f0d38009040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:41.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:41.953+0000 7f0d417fa640 1 -- 172.21.15.55:0/3875348119 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0d3c0eb7b0 con 0x7f0d4415a830 2023-08-25T05:35:42.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.113+0000 7f0d4b034640 1 -- 172.21.15.55:0/3875348119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d44155cb0 con 0x7f0d4415a830 2023-08-25T05:35:42.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.117+0000 7f0d417fa640 1 -- 172.21.15.55:0/3875348119 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v187) v1 ==== 74+0+18318 (secure 0 0 0) 0x7f0d3c0c6090 con 0x7f0d4415a830 2023-08-25T05:35:42.120 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:42.120 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":187,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:35:40.794281+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:35:38.546524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-25T05:35:39.796267+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:35:42.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.117+0000 7f0d4b034640 1 -- 172.21.15.55:0/3875348119 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f0d280657d0 msgr2=0x7f0d28067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:42.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.117+0000 7f0d4b034640 1 --2- 172.21.15.55:0/3875348119 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f0d280657d0 0x7f0d28067c90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0d380017e0 tx=0x7f0d38009040 comp rx=0 tx=0).stop 2023-08-25T05:35:42.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.117+0000 7f0d4b034640 1 -- 172.21.15.55:0/3875348119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d4415a830 msgr2=0x7f0d44165940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:42.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.117+0000 7f0d4b034640 1 --2- 172.21.15.55:0/3875348119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d4415a830 0x7f0d44165940 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c009d90 tx=0x7f0d3c0196c0 comp rx=0 tx=0).stop 2023-08-25T05:35:42.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.117+0000 7f0d4b034640 1 -- 172.21.15.55:0/3875348119 shutdown_connections 2023-08-25T05:35:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.117+0000 7f0d4b034640 1 --2- 172.21.15.55:0/3875348119 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f0d280657d0 0x7f0d28067c90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.117+0000 7f0d4b034640 1 --2- 172.21.15.55:0/3875348119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d4415a830 0x7f0d44165940 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.117+0000 7f0d4b034640 1 --2- 172.21.15.55:0/3875348119 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d440cd360 0x7f0d4406b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.117+0000 7f0d4b034640 1 --2- 172.21.15.55:0/3875348119 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d440ccf20 0x7f0d440c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.117+0000 7f0d4b034640 1 -- 172.21.15.55:0/3875348119 >> 172.21.15.55:0/3875348119 conn(0x7f0d440d05a0 msgr2=0x7f0d4406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.117+0000 7f0d4b034640 1 -- 172.21.15.55:0/3875348119 shutdown_connections 2023-08-25T05:35:42.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.117+0000 7f0d4b034640 1 -- 172.21.15.55:0/3875348119 wait complete. 2023-08-25T05:35:42.141 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-25T05:35:42.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.285+0000 7f59cedba640 1 Processor -- start 2023-08-25T05:35:42.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.285+0000 7f59cedba640 1 -- start start 2023-08-25T05:35:42.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.285+0000 7f59cedba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f59c80cb020 0x7f59c80c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:42.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.285+0000 7f59cedba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c80cdd50 0x7f59c80cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:42.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.285+0000 7f59cedba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c80cbca0 con 0x7f59c806c720 2023-08-25T05:35:42.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.285+0000 7f59cedba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c80c9470 con 0x7f59c80cb020 2023-08-25T05:35:42.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.285+0000 7f59cedba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80ce1e0 con 0x7f59c80cdd50 2023-08-25T05:35:42.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.289+0000 7f59cd357640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f59c806c720 0x7f59c80cc450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:51904/0 (socket says 172.21.15.55:51904) 2023-08-25T05:35:42.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.289+0000 7f59cd357640 1 -- 172.21.15.55:0/2082445488 learned_addr learned my addr 172.21.15.55:0/2082445488 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:42.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.289+0000 7f59c7fff640 1 --2- 172.21.15.55:0/2082445488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c80cdd50 0x7f59c80cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:42.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.289+0000 7f59ccb56640 1 --2- 172.21.15.55:0/2082445488 >> v2:172.21.15.110:3300/0 conn(0x7f59c80cb020 0x7f59c80c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:42.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.289+0000 7f59c77fe640 1 -- 172.21.15.55:0/2082445488 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576454123 0 0) 0x7f59c80cbca0 con 0x7f59c806c720 2023-08-25T05:35:42.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.289+0000 7f59c77fe640 1 -- 172.21.15.55:0/2082445488 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59b8003530 con 0x7f59c806c720 2023-08-25T05:35:42.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.289+0000 7f59c7fff640 1 -- 172.21.15.55:0/2082445488 >> v2:172.21.15.110:3300/0 conn(0x7f59c80cb020 msgr2=0x7f59c80c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:42.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.289+0000 7f59c7fff640 1 --2- 172.21.15.55:0/2082445488 >> v2:172.21.15.110:3300/0 conn(0x7f59c80cb020 0x7f59c80c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:42.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.289+0000 7f59c7fff640 1 -- 172.21.15.55:0/2082445488 >> v1:172.21.15.55:6789/0 conn(0x7f59c806c720 legacy=0x7f59c80cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:42.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.289+0000 7f59c7fff640 1 -- 172.21.15.55:0/2082445488 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80c8b40 con 0x7f59c80cdd50 2023-08-25T05:35:42.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.289+0000 7f59ccb56640 1 --2- 172.21.15.55:0/2082445488 >> v2:172.21.15.110:3300/0 conn(0x7f59c80cb020 0x7f59c80c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:35:42.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.289+0000 7f59c7fff640 1 --2- 172.21.15.55:0/2082445488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c80cdd50 0x7f59c80cb400 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f59b40097c0 tx=0x7f59b401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afadd5623c7395b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:42.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59c77fe640 1 -- 172.21.15.55:0/2082445488 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40ab600 con 0x7f59c80cdd50 2023-08-25T05:35:42.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59c77fe640 1 -- 172.21.15.55:0/2082445488 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b40a7050 con 0x7f59c80cdd50 2023-08-25T05:35:42.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59c77fe640 1 -- 172.21.15.55:0/2082445488 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40ab980 con 0x7f59c80cdd50 2023-08-25T05:35:42.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59cedba640 1 -- 172.21.15.55:0/2082445488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c80cdd50 msgr2=0x7f59c80cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:42.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59cedba640 1 --2- 172.21.15.55:0/2082445488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c80cdd50 0x7f59c80cb400 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f59b40097c0 tx=0x7f59b401c3f0 comp rx=0 tx=0).stop 2023-08-25T05:35:42.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59cedba640 1 -- 172.21.15.55:0/2082445488 shutdown_connections 2023-08-25T05:35:42.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59cedba640 1 --2- 172.21.15.55:0/2082445488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c80cdd50 0x7f59c80cb400 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:42.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59cedba640 1 --2- 172.21.15.55:0/2082445488 >> v2:172.21.15.110:3300/0 conn(0x7f59c80cb020 0x7f59c80c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:42.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59cedba640 1 -- 172.21.15.55:0/2082445488 >> 172.21.15.55:0/2082445488 conn(0x7f59c8069900 msgr2=0x7f59c8069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:42.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59cedba640 1 -- 172.21.15.55:0/2082445488 shutdown_connections 2023-08-25T05:35:42.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59cedba640 1 -- 172.21.15.55:0/2082445488 wait complete. 2023-08-25T05:35:42.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59cedba640 1 Processor -- start 2023-08-25T05:35:42.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59cedba640 1 -- start start 2023-08-25T05:35:42.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59cedba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c806c720 0x7f59c81499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:42.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59cedba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c80cb020 0x7f59c8098a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:42.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59cedba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c80cdd50 0x7f59c81639b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:42.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59cedba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c809b7d0 con 0x7f59c80cdd50 2023-08-25T05:35:42.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59cedba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80ac400 con 0x7f59c806c720 2023-08-25T05:35:42.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59cedba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80ac6e0 con 0x7f59c80cb020 2023-08-25T05:35:42.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.293+0000 7f59cd357640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c80cdd50 0x7f59c81639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:42.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.297+0000 7f59cd357640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c80cdd50 0x7f59c81639b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41150/0 (socket says 172.21.15.55:41150) 2023-08-25T05:35:42.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.297+0000 7f59cd357640 1 -- 172.21.15.55:0/720177311 learned_addr learned my addr 172.21.15.55:0/720177311 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:42.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.297+0000 7f59ccb56640 1 --2- 172.21.15.55:0/720177311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c806c720 0x7f59c81499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:42.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.297+0000 7f59c7fff640 1 --2- 172.21.15.55:0/720177311 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c80cb020 0x7f59c8098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:42.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.297+0000 7f59cd357640 1 -- 172.21.15.55:0/720177311 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c80cb020 msgr2=0x7f59c8098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:42.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.297+0000 7f59cd357640 1 --2- 172.21.15.55:0/720177311 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c80cb020 0x7f59c8098a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:42.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.297+0000 7f59cd357640 1 -- 172.21.15.55:0/720177311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c806c720 msgr2=0x7f59c81499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:42.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.297+0000 7f59cd357640 1 --2- 172.21.15.55:0/720177311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c806c720 0x7f59c81499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:42.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.297+0000 7f59cd357640 1 -- 172.21.15.55:0/720177311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc0093b0 con 0x7f59c80cdd50 2023-08-25T05:35:42.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.297+0000 7f59cd357640 1 --2- 172.21.15.55:0/720177311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c80cdd50 0x7f59c81639b0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f59c000cb40 tx=0x7f59c000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:42.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.297+0000 7f59c57fa640 1 -- 172.21.15.55:0/720177311 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c000aca0 con 0x7f59c80cdd50 2023-08-25T05:35:42.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.297+0000 7f59c57fa640 1 -- 172.21.15.55:0/720177311 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c000ae00 con 0x7f59c80cdd50 2023-08-25T05:35:42.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.297+0000 7f59c57fa640 1 -- 172.21.15.55:0/720177311 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c0012620 con 0x7f59c80cdd50 2023-08-25T05:35:42.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.297+0000 7f59cedba640 1 -- 172.21.15.55:0/720177311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b4009420 con 0x7f59c80cdd50 2023-08-25T05:35:42.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.297+0000 7f59cedba640 1 -- 172.21.15.55:0/720177311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c806d0c0 con 0x7f59c80cdd50 2023-08-25T05:35:42.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.297+0000 7f59cedba640 1 -- 172.21.15.55:0/720177311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c809b910 con 0x7f59c80cdd50 2023-08-25T05:35:42.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.297+0000 7f59c57fa640 1 -- 172.21.15.55:0/720177311 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f59c0007070 con 0x7f59c80cdd50 2023-08-25T05:35:42.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.301+0000 7f59c57fa640 1 --2- 172.21.15.55:0/720177311 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f59ac0657a0 0x7f59ac067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:42.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.301+0000 7f59c57fa640 1 -- 172.21.15.55:0/720177311 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f59c0082fc0 con 0x7f59c80cdd50 2023-08-25T05:35:42.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.301+0000 7f59ccb56640 1 --2- 172.21.15.55:0/720177311 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f59ac0657a0 0x7f59ac067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:42.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.301+0000 7f59ccb56640 1 --2- 172.21.15.55:0/720177311 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f59ac0657a0 0x7f59ac067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009c60 tx=0x7f59bc008040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:42.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.305+0000 7f59c57fa640 1 -- 172.21.15.55:0/720177311 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f59c809b910 con 0x7f59c80cdd50 2023-08-25T05:35:42.370 INFO:tasks.ceph.mds.c.smithi055.stderr:2023-08-25T05:35:42.365+0000 7fa7c2e1e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T05:35:42.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:42.501+0000 7f59cedba640 1 -- 172.21.15.55:0/720177311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f59c809b910 con 0x7f59c80cdd50 2023-08-25T05:35:43.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.421+0000 7f59c57fa640 1 -- 172.21.15.55:0/720177311 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v90) v1 ==== 118+0+0 (secure 0 0 0) 0x7f59c809b910 con 0x7f59c80cdd50 2023-08-25T05:35:43.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.425+0000 7f59cedba640 1 -- 172.21.15.55:0/720177311 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f59ac0657a0 msgr2=0x7f59ac067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:43.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.425+0000 7f59cedba640 1 --2- 172.21.15.55:0/720177311 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f59ac0657a0 0x7f59ac067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009c60 tx=0x7f59bc008040 comp rx=0 tx=0).stop 2023-08-25T05:35:43.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.425+0000 7f59cedba640 1 -- 172.21.15.55:0/720177311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c80cdd50 msgr2=0x7f59c81639b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:43.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.425+0000 7f59cedba640 1 --2- 172.21.15.55:0/720177311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c80cdd50 0x7f59c81639b0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f59c000cb40 tx=0x7f59c000a060 comp rx=0 tx=0).stop 2023-08-25T05:35:43.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.425+0000 7f59cedba640 1 -- 172.21.15.55:0/720177311 shutdown_connections 2023-08-25T05:35:43.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.425+0000 7f59cedba640 1 --2- 172.21.15.55:0/720177311 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f59ac0657a0 0x7f59ac067c60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:43.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.425+0000 7f59cedba640 1 --2- 172.21.15.55:0/720177311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59c80cdd50 0x7f59c81639b0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:43.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.425+0000 7f59cedba640 1 --2- 172.21.15.55:0/720177311 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59c80cb020 0x7f59c8098a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:43.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.425+0000 7f59cedba640 1 --2- 172.21.15.55:0/720177311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59c806c720 0x7f59c81499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:43.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.425+0000 7f59cedba640 1 -- 172.21.15.55:0/720177311 >> 172.21.15.55:0/720177311 conn(0x7f59c8069900 msgr2=0x7f59c80ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:43.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.425+0000 7f59cedba640 1 -- 172.21.15.55:0/720177311 shutdown_connections 2023-08-25T05:35:43.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.425+0000 7f59cedba640 1 -- 172.21.15.55:0/720177311 wait complete. 2023-08-25T05:35:43.453 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-25T05:35:43.453 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-25T05:35:43.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.601+0000 7feb06c56640 1 Processor -- start 2023-08-25T05:35:43.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.601+0000 7feb06c56640 1 -- start start 2023-08-25T05:35:43.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.601+0000 7feb06c56640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feb0015cba0 0x7feb000ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:43.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.601+0000 7feb06c56640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb0006dc80 0x7feb00069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:43.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.601+0000 7feb06c56640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb0006cd40 con 0x7feb000b11c0 2023-08-25T05:35:43.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.601+0000 7feb06c56640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0006be90 con 0x7feb0006dc80 2023-08-25T05:35:43.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.601+0000 7feb06c56640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0006c130 con 0x7feb0015cba0 2023-08-25T05:35:43.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.601+0000 7feb051f3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb0006dc80 0x7feb00069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:43.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.601+0000 7feb051f3640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb0006dc80 0x7feb00069900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41160/0 (socket says 172.21.15.55:41160) 2023-08-25T05:35:43.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.601+0000 7feb051f3640 1 -- 172.21.15.55:0/767702481 learned_addr learned my addr 172.21.15.55:0/767702481 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:43.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.601+0000 7feb049f2640 1 --2- 172.21.15.55:0/767702481 >> v2:172.21.15.110:3300/0 conn(0x7feb0015cba0 0x7feb000ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:43.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.601+0000 7feb051f3640 1 -- 172.21.15.55:0/767702481 >> v2:172.21.15.110:3300/0 conn(0x7feb0015cba0 msgr2=0x7feb000ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:43.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.601+0000 7feb051f3640 1 --2- 172.21.15.55:0/767702481 >> v2:172.21.15.110:3300/0 conn(0x7feb0015cba0 0x7feb000ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:43.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.601+0000 7feb051f3640 1 -- 172.21.15.55:0/767702481 >> v1:172.21.15.110:6789/0 conn(0x7feb000b11c0 legacy=0x7feb0006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:43.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.601+0000 7feb051f3640 1 -- 172.21.15.55:0/767702481 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0006c410 con 0x7feb0006dc80 2023-08-25T05:35:43.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.605+0000 7feb051f3640 1 --2- 172.21.15.55:0/767702481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb0006dc80 0x7feb00069900 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7feb00066e90 tx=0x7feaf801c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf9f3869de1fc91 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:43.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.605+0000 7feaff7fe640 1 -- 172.21.15.55:0/767702481 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf80a5850 con 0x7feb0006dc80 2023-08-25T05:35:43.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.605+0000 7feaff7fe640 1 -- 172.21.15.55:0/767702481 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf80a59b0 con 0x7feb0006dc80 2023-08-25T05:35:43.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.605+0000 7feaff7fe640 1 -- 172.21.15.55:0/767702481 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf80a5d40 con 0x7feb0006dc80 2023-08-25T05:35:43.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.605+0000 7feb06c56640 1 -- 172.21.15.55:0/767702481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb0006dc80 msgr2=0x7feb00069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:43.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.605+0000 7feb06c56640 1 --2- 172.21.15.55:0/767702481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb0006dc80 0x7feb00069900 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7feb00066e90 tx=0x7feaf801c990 comp rx=0 tx=0).stop 2023-08-25T05:35:43.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.605+0000 7feb06c56640 1 -- 172.21.15.55:0/767702481 shutdown_connections 2023-08-25T05:35:43.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.605+0000 7feb06c56640 1 --2- 172.21.15.55:0/767702481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb0006dc80 0x7feb00069900 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:43.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.605+0000 7feb06c56640 1 --2- 172.21.15.55:0/767702481 >> v2:172.21.15.110:3300/0 conn(0x7feb0015cba0 0x7feb000ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:43.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.605+0000 7feb06c56640 1 -- 172.21.15.55:0/767702481 >> 172.21.15.55:0/767702481 conn(0x7feb000b06a0 msgr2=0x7feb000b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:43.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.605+0000 7feb06c56640 1 -- 172.21.15.55:0/767702481 shutdown_connections 2023-08-25T05:35:43.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.605+0000 7feb06c56640 1 -- 172.21.15.55:0/767702481 wait complete. 2023-08-25T05:35:43.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.605+0000 7feb06c56640 1 Processor -- start 2023-08-25T05:35:43.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.605+0000 7feb06c56640 1 -- start start 2023-08-25T05:35:43.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feb06c56640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb0006dc80 0x7feb000c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:43.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feb06c56640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb000b11c0 0x7feb000af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:43.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feb06c56640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb0015cba0 0x7feb000afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:43.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feb06c56640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb000c59e0 con 0x7feb000b11c0 2023-08-25T05:35:43.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feb06c56640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb00156350 con 0x7feb0006dc80 2023-08-25T05:35:43.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feb06c56640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb000c5700 con 0x7feb0015cba0 2023-08-25T05:35:43.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feafffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb000b11c0 0x7feb000af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:43.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feafffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb000b11c0 0x7feb000af5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41164/0 (socket says 172.21.15.55:41164) 2023-08-25T05:35:43.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feafffff640 1 -- 172.21.15.55:0/3758796582 learned_addr learned my addr 172.21.15.55:0/3758796582 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:43.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feb049f2640 1 --2- 172.21.15.55:0/3758796582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb0006dc80 0x7feb000c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:43.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feb051f3640 1 --2- 172.21.15.55:0/3758796582 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb0015cba0 0x7feb000afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:43.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feafffff640 1 -- 172.21.15.55:0/3758796582 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb0015cba0 msgr2=0x7feb000afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:43.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feafffff640 1 --2- 172.21.15.55:0/3758796582 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb0015cba0 0x7feb000afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:43.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feafffff640 1 -- 172.21.15.55:0/3758796582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb0006dc80 msgr2=0x7feb000c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:43.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feafffff640 1 --2- 172.21.15.55:0/3758796582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb0006dc80 0x7feb000c5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:43.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feafffff640 1 -- 172.21.15.55:0/3758796582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf8009b30 con 0x7feb000b11c0 2023-08-25T05:35:43.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feafffff640 1 --2- 172.21.15.55:0/3758796582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb000b11c0 0x7feb000af5b0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7feaec00c480 tx=0x7feaec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:43.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feafd7fa640 1 -- 172.21.15.55:0/3758796582 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec012830 con 0x7feb000b11c0 2023-08-25T05:35:43.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feafd7fa640 1 -- 172.21.15.55:0/3758796582 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaec0129b0 con 0x7feb000b11c0 2023-08-25T05:35:43.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feafd7fa640 1 -- 172.21.15.55:0/3758796582 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec012d60 con 0x7feb000b11c0 2023-08-25T05:35:43.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feb06c56640 1 -- 172.21.15.55:0/3758796582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb00155d00 con 0x7feb000b11c0 2023-08-25T05:35:43.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feb06c56640 1 -- 172.21.15.55:0/3758796582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb001541b0 con 0x7feb000b11c0 2023-08-25T05:35:43.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.609+0000 7feb06c56640 1 -- 172.21.15.55:0/3758796582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb00073ec0 con 0x7feb000b11c0 2023-08-25T05:35:43.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.613+0000 7feafd7fa640 1 -- 172.21.15.55:0/3758796582 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7feaec01c460 con 0x7feb000b11c0 2023-08-25T05:35:43.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.613+0000 7feafd7fa640 1 --2- 172.21.15.55:0/3758796582 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7feae40657d0 0x7feae4067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:43.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.613+0000 7feafd7fa640 1 -- 172.21.15.55:0/3758796582 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feaec082c70 con 0x7feb000b11c0 2023-08-25T05:35:43.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.613+0000 7feb049f2640 1 --2- 172.21.15.55:0/3758796582 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7feae40657d0 0x7feae4067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:43.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.613+0000 7feb049f2640 1 --2- 172.21.15.55:0/3758796582 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7feae40657d0 0x7feae4067c90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feaf4007a60 tx=0x7feaf4008040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:43.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.617+0000 7feafd7fa640 1 -- 172.21.15.55:0/3758796582 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7feaec0506c0 con 0x7feb000b11c0 2023-08-25T05:35:43.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:43.809+0000 7feb06c56640 1 -- 172.21.15.55:0/3758796582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7feb00167140 con 0x7feb000b11c0 2023-08-25T05:35:44.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.437+0000 7feafd7fa640 1 -- 172.21.15.55:0/3758796582 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v91) v1 ==== 122+0+0 (secure 0 0 0) 0x7feaec053ce0 con 0x7feb000b11c0 2023-08-25T05:35:44.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.441+0000 7feb06c56640 1 -- 172.21.15.55:0/3758796582 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7feae40657d0 msgr2=0x7feae4067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:44.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.441+0000 7feb06c56640 1 --2- 172.21.15.55:0/3758796582 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7feae40657d0 0x7feae4067c90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feaf4007a60 tx=0x7feaf4008040 comp rx=0 tx=0).stop 2023-08-25T05:35:44.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.441+0000 7feb06c56640 1 -- 172.21.15.55:0/3758796582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb000b11c0 msgr2=0x7feb000af5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:44.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.441+0000 7feb06c56640 1 --2- 172.21.15.55:0/3758796582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb000b11c0 0x7feb000af5b0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7feaec00c480 tx=0x7feaec00c940 comp rx=0 tx=0).stop 2023-08-25T05:35:44.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.441+0000 7feb06c56640 1 -- 172.21.15.55:0/3758796582 shutdown_connections 2023-08-25T05:35:44.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.441+0000 7feb06c56640 1 --2- 172.21.15.55:0/3758796582 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7feae40657d0 0x7feae4067c90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:44.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.441+0000 7feb06c56640 1 --2- 172.21.15.55:0/3758796582 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb0015cba0 0x7feb000afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:44.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.441+0000 7feb06c56640 1 --2- 172.21.15.55:0/3758796582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb000b11c0 0x7feb000af5b0 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:44.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.441+0000 7feb06c56640 1 --2- 172.21.15.55:0/3758796582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb0006dc80 0x7feb000c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:44.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.441+0000 7feb06c56640 1 -- 172.21.15.55:0/3758796582 >> 172.21.15.55:0/3758796582 conn(0x7feb000b06a0 msgr2=0x7feb000c5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:44.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.441+0000 7feb06c56640 1 -- 172.21.15.55:0/3758796582 shutdown_connections 2023-08-25T05:35:44.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.441+0000 7feb06c56640 1 -- 172.21.15.55:0/3758796582 wait complete. 2023-08-25T05:35:44.466 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-25T05:35:44.467 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:35:44.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.609+0000 7fa902967640 1 Processor -- start 2023-08-25T05:35:44.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.609+0000 7fa902967640 1 -- start start 2023-08-25T05:35:44.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.609+0000 7fa902967640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8fc15eba0 0x7fa8fc0b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:44.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.609+0000 7fa902967640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8fc0ceeb0 0x7fa8fc0ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:44.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.609+0000 7fa902967640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8fc0ac3a0 con 0x7fa8fc15ef80 2023-08-25T05:35:44.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.609+0000 7fa902967640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8fc0b1390 con 0x7fa8fc15eba0 2023-08-25T05:35:44.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.609+0000 7fa902967640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc0b1670 con 0x7fa8fc0ceeb0 2023-08-25T05:35:44.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.609+0000 7fa8fbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8fc15eba0 0x7fa8fc0b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:44.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.609+0000 7fa8fbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8fc15eba0 0x7fa8fc0b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41166/0 (socket says 172.21.15.55:41166) 2023-08-25T05:35:44.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.609+0000 7fa8fbfff640 1 -- 172.21.15.55:0/1906817012 learned_addr learned my addr 172.21.15.55:0/1906817012 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:44.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.609+0000 7fa8fb7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa8fc15ef80 0x7fa8fc0ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:51908/0 (socket says 172.21.15.55:51908) 2023-08-25T05:35:44.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.609+0000 7fa8fbfff640 1 -- 172.21.15.55:0/1906817012 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8fc0ceeb0 msgr2=0x7fa8fc0ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:44.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.609+0000 7fa8fbfff640 1 --2- 172.21.15.55:0/1906817012 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8fc0ceeb0 0x7fa8fc0ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:44.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.609+0000 7fa8fbfff640 1 -- 172.21.15.55:0/1906817012 >> v1:172.21.15.55:6789/0 conn(0x7fa8fc15ef80 legacy=0x7fa8fc0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:44.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.609+0000 7fa8fbfff640 1 -- 172.21.15.55:0/1906817012 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc0b1950 con 0x7fa8fc15eba0 2023-08-25T05:35:44.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.613+0000 7fa8fbfff640 1 --2- 172.21.15.55:0/1906817012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8fc15eba0 0x7fa8fc0b2a40 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec009870 tx=0x7fa8ec01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a638785cf46fbd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:44.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.613+0000 7fa8faffd640 1 -- 172.21.15.55:0/1906817012 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0aa670 con 0x7fa8fc15eba0 2023-08-25T05:35:44.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.613+0000 7fa8faffd640 1 -- 172.21.15.55:0/1906817012 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ec0aa7d0 con 0x7fa8fc15eba0 2023-08-25T05:35:44.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.613+0000 7fa8faffd640 1 -- 172.21.15.55:0/1906817012 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0aab60 con 0x7fa8fc15eba0 2023-08-25T05:35:44.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.613+0000 7fa902967640 1 -- 172.21.15.55:0/1906817012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8fc15eba0 msgr2=0x7fa8fc0b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:44.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.613+0000 7fa902967640 1 --2- 172.21.15.55:0/1906817012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8fc15eba0 0x7fa8fc0b2a40 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec009870 tx=0x7fa8ec01c510 comp rx=0 tx=0).stop 2023-08-25T05:35:44.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.613+0000 7fa902967640 1 -- 172.21.15.55:0/1906817012 shutdown_connections 2023-08-25T05:35:44.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.613+0000 7fa902967640 1 --2- 172.21.15.55:0/1906817012 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8fc0ceeb0 0x7fa8fc0ab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:44.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.613+0000 7fa902967640 1 --2- 172.21.15.55:0/1906817012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8fc15eba0 0x7fa8fc0b2a40 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:44.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.613+0000 7fa902967640 1 -- 172.21.15.55:0/1906817012 >> 172.21.15.55:0/1906817012 conn(0x7fa8fc069d00 msgr2=0x7fa8fc06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:44.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.613+0000 7fa902967640 1 -- 172.21.15.55:0/1906817012 shutdown_connections 2023-08-25T05:35:44.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.613+0000 7fa902967640 1 -- 172.21.15.55:0/1906817012 wait complete. 2023-08-25T05:35:44.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa902967640 1 Processor -- start 2023-08-25T05:35:44.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa902967640 1 -- start start 2023-08-25T05:35:44.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa902967640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8fc0ceeb0 0x7fa8fc156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:44.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa902967640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8fc15eba0 0x7fa8fc159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:44.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa902967640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8fc15ef80 0x7fa8fc159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:44.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa902967640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc15a3c0 con 0x7fa8fc0ceeb0 2023-08-25T05:35:44.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa902967640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc15c080 con 0x7fa8fc15eba0 2023-08-25T05:35:44.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa902967640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8fc1f5200 con 0x7fa8fc15ef80 2023-08-25T05:35:44.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa8fbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8fc0ceeb0 0x7fa8fc156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:44.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa8fbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8fc0ceeb0 0x7fa8fc156550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41172/0 (socket says 172.21.15.55:41172) 2023-08-25T05:35:44.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa8fbfff640 1 -- 172.21.15.55:0/875254208 learned_addr learned my addr 172.21.15.55:0/875254208 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:44.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa900f04640 1 --2- 172.21.15.55:0/875254208 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8fc15ef80 0x7fa8fc159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:44.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa8fb7fe640 1 --2- 172.21.15.55:0/875254208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8fc15eba0 0x7fa8fc159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:44.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa8fbfff640 1 -- 172.21.15.55:0/875254208 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8fc15ef80 msgr2=0x7fa8fc159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:44.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa8fbfff640 1 --2- 172.21.15.55:0/875254208 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8fc15ef80 0x7fa8fc159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:44.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa8fbfff640 1 -- 172.21.15.55:0/875254208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8fc15eba0 msgr2=0x7fa8fc159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:44.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa8fbfff640 1 --2- 172.21.15.55:0/875254208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8fc15eba0 0x7fa8fc159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:44.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa8fbfff640 1 -- 172.21.15.55:0/875254208 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec0094d0 con 0x7fa8fc0ceeb0 2023-08-25T05:35:44.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa8fbfff640 1 --2- 172.21.15.55:0/875254208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8fc0ceeb0 0x7fa8fc156550 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0ac040 tx=0x7fa8ec01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:44.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa8f8ff9640 1 -- 172.21.15.55:0/875254208 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0b38c0 con 0x7fa8fc0ceeb0 2023-08-25T05:35:44.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa8f8ff9640 1 -- 172.21.15.55:0/875254208 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ec0b3a40 con 0x7fa8fc0ceeb0 2023-08-25T05:35:44.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa902967640 1 -- 172.21.15.55:0/875254208 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8fc1f54e0 con 0x7fa8fc0ceeb0 2023-08-25T05:35:44.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa8f8ff9640 1 -- 172.21.15.55:0/875254208 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec0b3df0 con 0x7fa8fc0ceeb0 2023-08-25T05:35:44.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa902967640 1 -- 172.21.15.55:0/875254208 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8fc1f5aa0 con 0x7fa8fc0ceeb0 2023-08-25T05:35:44.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.617+0000 7fa902967640 1 -- 172.21.15.55:0/875254208 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8fc1f60f0 con 0x7fa8fc0ceeb0 2023-08-25T05:35:44.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.621+0000 7fa8f8ff9640 1 -- 172.21.15.55:0/875254208 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fa8ec0c6390 con 0x7fa8fc0ceeb0 2023-08-25T05:35:44.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.621+0000 7fa8f8ff9640 1 --2- 172.21.15.55:0/875254208 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fa8e80657a0 0x7fa8e8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:44.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.621+0000 7fa8f8ff9640 1 -- 172.21.15.55:0/875254208 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa8ec11de70 con 0x7fa8fc0ceeb0 2023-08-25T05:35:44.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.621+0000 7fa8fb7fe640 1 --2- 172.21.15.55:0/875254208 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fa8e80657a0 0x7fa8e8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:44.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.621+0000 7fa8fb7fe640 1 --2- 172.21.15.55:0/875254208 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fa8e80657a0 0x7fa8e8067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc15a5a0 tx=0x7fa8f0007cb0 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:44.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.625+0000 7fa8f8ff9640 1 -- 172.21.15.55:0/875254208 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa8ec0eb7a0 con 0x7fa8fc0ceeb0 2023-08-25T05:35:44.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.813+0000 7fa902967640 1 -- 172.21.15.55:0/875254208 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8fc04dbe0 con 0x7fa8fc0ceeb0 2023-08-25T05:35:44.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.813+0000 7fa8f8ff9640 1 -- 172.21.15.55:0/875254208 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4886 (secure 0 0 0) 0x7fa8ec0eedc0 con 0x7fa8fc0ceeb0 2023-08-25T05:35:44.817 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:44.817 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8768,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1348996798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1348996798},{"type":"v1","addr":"172.21.15.110:6837","nonce":1348996798}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":9988,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/623585793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":623585793},{"type":"v1","addr":"172.21.15.110:6836","nonce":623585793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":10782,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3873137631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3873137631},{"type":"v1","addr":"172.21.15.55:6834","nonce":3873137631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:35:40.794599+0000","modified":"2023-08-25T05:35:44.431342+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":10785},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10785":{"gid":10785,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1770370805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1770370805},{"type":"v1","addr":"172.21.15.55:6835","nonce":1770370805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-25T05:35:44.818 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 91 2023-08-25T05:35:44.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.813+0000 7fa902967640 1 -- 172.21.15.55:0/875254208 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fa8e80657a0 msgr2=0x7fa8e8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:44.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.813+0000 7fa902967640 1 --2- 172.21.15.55:0/875254208 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fa8e80657a0 0x7fa8e8067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc15a5a0 tx=0x7fa8f0007cb0 comp rx=0 tx=0).stop 2023-08-25T05:35:44.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.813+0000 7fa902967640 1 -- 172.21.15.55:0/875254208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8fc0ceeb0 msgr2=0x7fa8fc156550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:44.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.813+0000 7fa902967640 1 --2- 172.21.15.55:0/875254208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8fc0ceeb0 0x7fa8fc156550 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0ac040 tx=0x7fa8ec01ad50 comp rx=0 tx=0).stop 2023-08-25T05:35:44.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.813+0000 7fa902967640 1 -- 172.21.15.55:0/875254208 shutdown_connections 2023-08-25T05:35:44.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.813+0000 7fa902967640 1 --2- 172.21.15.55:0/875254208 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fa8e80657a0 0x7fa8e8067c60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:44.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.813+0000 7fa902967640 1 --2- 172.21.15.55:0/875254208 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8fc15ef80 0x7fa8fc159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:44.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.813+0000 7fa902967640 1 --2- 172.21.15.55:0/875254208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8fc15eba0 0x7fa8fc159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:44.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.813+0000 7fa902967640 1 --2- 172.21.15.55:0/875254208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8fc0ceeb0 0x7fa8fc156550 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:44.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.813+0000 7fa902967640 1 -- 172.21.15.55:0/875254208 >> 172.21.15.55:0/875254208 conn(0x7fa8fc069d00 msgr2=0x7fa8fc0cd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:44.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.813+0000 7fa902967640 1 -- 172.21.15.55:0/875254208 shutdown_connections 2023-08-25T05:35:44.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.813+0000 7fa902967640 1 -- 172.21.15.55:0/875254208 wait complete. 2023-08-25T05:35:44.837 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:35:44.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.977+0000 7efebf92c640 1 Processor -- start 2023-08-25T05:35:44.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.977+0000 7efebf92c640 1 -- start start 2023-08-25T05:35:44.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.977+0000 7efebf92c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efeb815a830 0x7efeb80cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:44.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.977+0000 7efebf92c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb80ce170 con 0x7efeb80cc2b0 2023-08-25T05:35:44.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.977+0000 7efebf92c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb80ce3a0 con 0x7efeb80cd630 2023-08-25T05:35:44.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.977+0000 7efebf92c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb80cc6f0 con 0x7efeb815a830 2023-08-25T05:35:44.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.977+0000 7efebcec7640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efeb80cc2b0 0x7efeb80ccf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:51918/0 (socket says 172.21.15.55:51918) 2023-08-25T05:35:44.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.977+0000 7efebcec7640 1 -- 172.21.15.55:0/1756206444 learned_addr learned my addr 172.21.15.55:0/1756206444 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:44.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.977+0000 7efebd6c8640 1 --2- 172.21.15.55:0/1756206444 >> v2:172.21.15.110:3300/0 conn(0x7efeb815a830 0x7efeb80cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:44.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.977+0000 7efeaffff640 1 -- 172.21.15.55:0/1756206444 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611627163 0 0) 0x7efeb80ce170 con 0x7efeb80cc2b0 2023-08-25T05:35:44.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.977+0000 7efeaffff640 1 -- 172.21.15.55:0/1756206444 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efea4003530 con 0x7efeb80cc2b0 2023-08-25T05:35:44.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.977+0000 7efeaffff640 1 -- 172.21.15.55:0/1756206444 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2298551808 0 0) 0x7efea4003530 con 0x7efeb80cc2b0 2023-08-25T05:35:44.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.977+0000 7efebd6c8640 1 -- 172.21.15.55:0/1756206444 >> v1:172.21.15.110:6789/0 conn(0x7efeb80cd630 legacy=0x7efeb806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:44.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.977+0000 7efebd6c8640 1 -- 172.21.15.55:0/1756206444 >> v1:172.21.15.55:6789/0 conn(0x7efeb80cc2b0 legacy=0x7efeb80ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:44.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.977+0000 7efebd6c8640 1 -- 172.21.15.55:0/1756206444 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb80ce660 con 0x7efeb815a830 2023-08-25T05:35:44.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.981+0000 7efebd6c8640 1 --2- 172.21.15.55:0/1756206444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efeb815a830 0x7efeb80cbd70 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7efeb40097a0 tx=0x7efeb401c230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92a7c03bbbdea752 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:44.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.981+0000 7efeaffff640 1 -- 172.21.15.55:0/1756206444 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb40a4ea0 con 0x7efeb815a830 2023-08-25T05:35:44.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.981+0000 7efeaffff640 1 -- 172.21.15.55:0/1756206444 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb40a7050 con 0x7efeb815a830 2023-08-25T05:35:44.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.981+0000 7efeaffff640 1 -- 172.21.15.55:0/1756206444 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea8001680 con 0x7efeb815a830 2023-08-25T05:35:44.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.981+0000 7efebf92c640 1 -- 172.21.15.55:0/1756206444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efeb815a830 msgr2=0x7efeb80cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:44.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.981+0000 7efebf92c640 1 --2- 172.21.15.55:0/1756206444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efeb815a830 0x7efeb80cbd70 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7efeb40097a0 tx=0x7efeb401c230 comp rx=0 tx=0).stop 2023-08-25T05:35:44.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.981+0000 7efebf92c640 1 -- 172.21.15.55:0/1756206444 shutdown_connections 2023-08-25T05:35:44.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.981+0000 7efebf92c640 1 --2- 172.21.15.55:0/1756206444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efeb815a830 0x7efeb80cbd70 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:44.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.981+0000 7efebf92c640 1 -- 172.21.15.55:0/1756206444 >> 172.21.15.55:0/1756206444 conn(0x7efeb80d05a0 msgr2=0x7efeb80d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:44.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.981+0000 7efebf92c640 1 -- 172.21.15.55:0/1756206444 shutdown_connections 2023-08-25T05:35:44.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.981+0000 7efebf92c640 1 -- 172.21.15.55:0/1756206444 wait complete. 2023-08-25T05:35:44.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebf92c640 1 Processor -- start 2023-08-25T05:35:44.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebf92c640 1 -- start start 2023-08-25T05:35:44.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebf92c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efeb80cc2b0 0x7efeb80c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:44.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebf92c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efeb80cd630 0x7efeb814f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:44.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebf92c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efeb815a830 0x7efeb81f0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:44.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebf92c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb814fb10 con 0x7efeb80cc2b0 2023-08-25T05:35:44.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebf92c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb81f36d0 con 0x7efeb80cd630 2023-08-25T05:35:44.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebf92c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb80c8ab0 con 0x7efeb815a830 2023-08-25T05:35:44.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebd6c8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efeb80cc2b0 0x7efeb80c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:44.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebd6c8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efeb80cc2b0 0x7efeb80c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41180/0 (socket says 172.21.15.55:41180) 2023-08-25T05:35:44.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebd6c8640 1 -- 172.21.15.55:0/4073836101 learned_addr learned my addr 172.21.15.55:0/4073836101 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:44.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebcec7640 1 --2- 172.21.15.55:0/4073836101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efeb80cd630 0x7efeb814f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:44.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebdec9640 1 --2- 172.21.15.55:0/4073836101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efeb815a830 0x7efeb81f0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:44.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebd6c8640 1 -- 172.21.15.55:0/4073836101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efeb815a830 msgr2=0x7efeb81f0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:44.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebd6c8640 1 --2- 172.21.15.55:0/4073836101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efeb815a830 0x7efeb81f0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:44.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebd6c8640 1 -- 172.21.15.55:0/4073836101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efeb80cd630 msgr2=0x7efeb814f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:44.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebd6c8640 1 --2- 172.21.15.55:0/4073836101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efeb80cd630 0x7efeb814f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:44.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebd6c8640 1 -- 172.21.15.55:0/4073836101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb40093b0 con 0x7efeb80cc2b0 2023-08-25T05:35:44.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebcec7640 1 --2- 172.21.15.55:0/4073836101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efeb80cd630 0x7efeb814f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:44.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebd6c8640 1 --2- 172.21.15.55:0/4073836101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efeb80cc2b0 0x7efeb80c84d0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7efeb401c710 tx=0x7efeb401aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:44.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efeadffb640 1 -- 172.21.15.55:0/4073836101 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4004230 con 0x7efeb80cc2b0 2023-08-25T05:35:44.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efeadffb640 1 -- 172.21.15.55:0/4073836101 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb40043b0 con 0x7efeb80cc2b0 2023-08-25T05:35:44.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efebf92c640 1 -- 172.21.15.55:0/4073836101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb80c8d90 con 0x7efeb80cc2b0 2023-08-25T05:35:44.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.985+0000 7efeadffb640 1 -- 172.21.15.55:0/4073836101 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4005be0 con 0x7efeb80cc2b0 2023-08-25T05:35:44.996 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.989+0000 7efebf92c640 1 -- 172.21.15.55:0/4073836101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb80c9350 con 0x7efeb80cc2b0 2023-08-25T05:35:44.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.989+0000 7efebf92c640 1 -- 172.21.15.55:0/4073836101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb804dbe0 con 0x7efeb80cc2b0 2023-08-25T05:35:44.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.989+0000 7efeadffb640 1 -- 172.21.15.55:0/4073836101 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7efeb40b7660 con 0x7efeb80cc2b0 2023-08-25T05:35:44.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.989+0000 7efeadffb640 1 --2- 172.21.15.55:0/4073836101 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7efe9c0657a0 0x7efe9c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:44.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.989+0000 7efeadffb640 1 -- 172.21.15.55:0/4073836101 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efeb411c750 con 0x7efeb80cc2b0 2023-08-25T05:35:44.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.989+0000 7efebcec7640 1 --2- 172.21.15.55:0/4073836101 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7efe9c0657a0 0x7efe9c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:44.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.989+0000 7efebcec7640 1 --2- 172.21.15.55:0/4073836101 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7efe9c0657a0 0x7efe9c067c60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efeb8153d20 tx=0x7efea8009040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:44.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:44.993+0000 7efeadffb640 1 -- 172.21.15.55:0/4073836101 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7efeb40e9ff0 con 0x7efeb80cc2b0 2023-08-25T05:35:45.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.153+0000 7efebf92c640 1 -- 172.21.15.55:0/4073836101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efeb80afca0 con 0x7efeb80cc2b0 2023-08-25T05:35:45.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.157+0000 7efeadffb640 1 -- 172.21.15.55:0/4073836101 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+18305 (secure 0 0 0) 0x7efeb4006dc0 con 0x7efeb80cc2b0 2023-08-25T05:35:45.161 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:45.161 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":188,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:35:42.393070+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:35:38.546524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-25T05:35:39.796267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:35:45.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.157+0000 7efebf92c640 1 -- 172.21.15.55:0/4073836101 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7efe9c0657a0 msgr2=0x7efe9c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:45.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.157+0000 7efebf92c640 1 --2- 172.21.15.55:0/4073836101 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7efe9c0657a0 0x7efe9c067c60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efeb8153d20 tx=0x7efea8009040 comp rx=0 tx=0).stop 2023-08-25T05:35:45.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.157+0000 7efebf92c640 1 -- 172.21.15.55:0/4073836101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efeb80cc2b0 msgr2=0x7efeb80c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:45.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.157+0000 7efebf92c640 1 --2- 172.21.15.55:0/4073836101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efeb80cc2b0 0x7efeb80c84d0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7efeb401c710 tx=0x7efeb401aa70 comp rx=0 tx=0).stop 2023-08-25T05:35:45.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.157+0000 7efebf92c640 1 -- 172.21.15.55:0/4073836101 shutdown_connections 2023-08-25T05:35:45.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.157+0000 7efebf92c640 1 --2- 172.21.15.55:0/4073836101 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7efe9c0657a0 0x7efe9c067c60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.157+0000 7efebf92c640 1 --2- 172.21.15.55:0/4073836101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efeb815a830 0x7efeb81f0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.157+0000 7efebf92c640 1 --2- 172.21.15.55:0/4073836101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efeb80cd630 0x7efeb814f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.157+0000 7efebf92c640 1 --2- 172.21.15.55:0/4073836101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efeb80cc2b0 0x7efeb80c84d0 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.157+0000 7efebf92c640 1 -- 172.21.15.55:0/4073836101 >> 172.21.15.55:0/4073836101 conn(0x7efeb80d05a0 msgr2=0x7efeb80ae450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:45.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.157+0000 7efebf92c640 1 -- 172.21.15.55:0/4073836101 shutdown_connections 2023-08-25T05:35:45.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.157+0000 7efebf92c640 1 -- 172.21.15.55:0/4073836101 wait complete. 2023-08-25T05:35:45.182 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-25T05:35:45.183 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:35:45.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.321+0000 7f06ca219640 1 Processor -- start 2023-08-25T05:35:45.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.321+0000 7f06ca219640 1 -- start start 2023-08-25T05:35:45.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.321+0000 7f06ca219640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f06c40ad950 0x7f06c40cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:45.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.321+0000 7f06ca219640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06c40c89f0 0x7f06c40ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:45.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.321+0000 7f06ca219640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c40b2650 con 0x7f06c406c000 2023-08-25T05:35:45.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.321+0000 7f06ca219640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c40b11f0 con 0x7f06c40c89f0 2023-08-25T05:35:45.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.321+0000 7f06ca219640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c4159d50 con 0x7f06c40ad950 2023-08-25T05:35:45.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.321+0000 7f06bbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06c40c89f0 0x7f06c40ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:45.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.325+0000 7f06bbfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06c40c89f0 0x7f06c40ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41192/0 (socket says 172.21.15.55:41192) 2023-08-25T05:35:45.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.325+0000 7f06bbfff640 1 -- 172.21.15.55:0/4190479604 learned_addr learned my addr 172.21.15.55:0/4190479604 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:45.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.325+0000 7f06c37fe640 1 --2- 172.21.15.55:0/4190479604 >> v2:172.21.15.110:3300/0 conn(0x7f06c40ad950 0x7f06c40cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:45.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.325+0000 7f06bbfff640 1 -- 172.21.15.55:0/4190479604 >> v2:172.21.15.110:3300/0 conn(0x7f06c40ad950 msgr2=0x7f06c40cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:45.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.325+0000 7f06bbfff640 1 --2- 172.21.15.55:0/4190479604 >> v2:172.21.15.110:3300/0 conn(0x7f06c40ad950 0x7f06c40cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.325+0000 7f06bbfff640 1 -- 172.21.15.55:0/4190479604 >> v1:172.21.15.110:6789/0 conn(0x7f06c406c000 legacy=0x7f06c415d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:45.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.325+0000 7f06bbfff640 1 -- 172.21.15.55:0/4190479604 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c40cc880 con 0x7f06c40c89f0 2023-08-25T05:35:45.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.325+0000 7f06c37fe640 1 --2- 172.21.15.55:0/4190479604 >> v2:172.21.15.110:3300/0 conn(0x7f06c40ad950 0x7f06c40cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:45.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.325+0000 7f06bbfff640 1 --2- 172.21.15.55:0/4190479604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c40c89f0 0x7f06c40ce7a0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f06c40cd4b0 tx=0x7f06ac01e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b61e558e2bd24b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:45.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.325+0000 7f06c2ffd640 1 -- 172.21.15.55:0/4190479604 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac0ab5f0 con 0x7f06c40c89f0 2023-08-25T05:35:45.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.325+0000 7f06c2ffd640 1 -- 172.21.15.55:0/4190479604 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ac0ab750 con 0x7f06c40c89f0 2023-08-25T05:35:45.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.325+0000 7f06c2ffd640 1 -- 172.21.15.55:0/4190479604 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac0abae0 con 0x7f06c40c89f0 2023-08-25T05:35:45.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06ca219640 1 -- 172.21.15.55:0/4190479604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c40c89f0 msgr2=0x7f06c40ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:45.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06ca219640 1 --2- 172.21.15.55:0/4190479604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c40c89f0 0x7f06c40ce7a0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f06c40cd4b0 tx=0x7f06ac01e610 comp rx=0 tx=0).stop 2023-08-25T05:35:45.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06ca219640 1 -- 172.21.15.55:0/4190479604 shutdown_connections 2023-08-25T05:35:45.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06ca219640 1 --2- 172.21.15.55:0/4190479604 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c40c89f0 0x7f06c40ce7a0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06ca219640 1 --2- 172.21.15.55:0/4190479604 >> v2:172.21.15.110:3300/0 conn(0x7f06c40ad950 0x7f06c40cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06ca219640 1 -- 172.21.15.55:0/4190479604 >> 172.21.15.55:0/4190479604 conn(0x7f06c4069d00 msgr2=0x7f06c406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:45.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06ca219640 1 -- 172.21.15.55:0/4190479604 shutdown_connections 2023-08-25T05:35:45.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06ca219640 1 -- 172.21.15.55:0/4190479604 wait complete. 2023-08-25T05:35:45.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06ca219640 1 Processor -- start 2023-08-25T05:35:45.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06ca219640 1 -- start start 2023-08-25T05:35:45.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06ca219640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c406c000 0x7f06c409b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:45.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06ca219640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06c40ad950 0x7f06c4151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:45.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06ca219640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c40c89f0 0x7f06c41522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:45.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06ca219640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40aba00 con 0x7f06c40c89f0 2023-08-25T05:35:45.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06ca219640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c409b7b0 con 0x7f06c40ad950 2023-08-25T05:35:45.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06ca219640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c40abc50 con 0x7f06c406c000 2023-08-25T05:35:45.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c40c89f0 0x7f06c41522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:45.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06c3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c40c89f0 0x7f06c41522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41206/0 (socket says 172.21.15.55:41206) 2023-08-25T05:35:45.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06c3fff640 1 -- 172.21.15.55:0/2668141273 learned_addr learned my addr 172.21.15.55:0/2668141273 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:45.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06bbfff640 1 --2- 172.21.15.55:0/2668141273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06c40ad950 0x7f06c4151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:45.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06c37fe640 1 --2- 172.21.15.55:0/2668141273 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c406c000 0x7f06c409b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:45.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06c3fff640 1 -- 172.21.15.55:0/2668141273 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c406c000 msgr2=0x7f06c409b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:45.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06c3fff640 1 --2- 172.21.15.55:0/2668141273 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c406c000 0x7f06c409b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06c3fff640 1 -- 172.21.15.55:0/2668141273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06c40ad950 msgr2=0x7f06c4151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:45.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06c3fff640 1 --2- 172.21.15.55:0/2668141273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06c40ad950 0x7f06c4151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06c3fff640 1 -- 172.21.15.55:0/2668141273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac0094d0 con 0x7f06c40c89f0 2023-08-25T05:35:45.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06c37fe640 1 --2- 172.21.15.55:0/2668141273 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c406c000 0x7f06c409b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:45.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.329+0000 7f06c3fff640 1 --2- 172.21.15.55:0/2668141273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c40c89f0 0x7f06c41522e0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00c780 tx=0x7f06bc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:45.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.333+0000 7f06c0ff9640 1 -- 172.21.15.55:0/2668141273 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc004b70 con 0x7f06c40c89f0 2023-08-25T05:35:45.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.333+0000 7f06c0ff9640 1 -- 172.21.15.55:0/2668141273 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06bc00ce90 con 0x7f06c40c89f0 2023-08-25T05:35:45.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.333+0000 7f06ca219640 1 -- 172.21.15.55:0/2668141273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c40abf30 con 0x7f06c40c89f0 2023-08-25T05:35:45.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.333+0000 7f06c0ff9640 1 -- 172.21.15.55:0/2668141273 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc00a850 con 0x7f06c40c89f0 2023-08-25T05:35:45.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.333+0000 7f06ca219640 1 -- 172.21.15.55:0/2668141273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c40ac4f0 con 0x7f06c40c89f0 2023-08-25T05:35:45.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.333+0000 7f06ca219640 1 -- 172.21.15.55:0/2668141273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c40ac6e0 con 0x7f06c40c89f0 2023-08-25T05:35:45.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.333+0000 7f06c0ff9640 1 -- 172.21.15.55:0/2668141273 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f06bc00a9b0 con 0x7f06c40c89f0 2023-08-25T05:35:45.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.333+0000 7f06c0ff9640 1 --2- 172.21.15.55:0/2668141273 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f06a40657a0 0x7f06a4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:45.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.333+0000 7f06c0ff9640 1 -- 172.21.15.55:0/2668141273 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f06bc0830b0 con 0x7f06c40c89f0 2023-08-25T05:35:45.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.333+0000 7f06c37fe640 1 --2- 172.21.15.55:0/2668141273 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f06a40657a0 0x7f06a4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:45.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.337+0000 7f06c37fe640 1 --2- 172.21.15.55:0/2668141273 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f06a40657a0 0x7f06a4067c60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f06b4009970 tx=0x7f06b4008040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:45.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.337+0000 7f06c0ff9640 1 -- 172.21.15.55:0/2668141273 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f06bc0544e0 con 0x7f06c40c89f0 2023-08-25T05:35:45.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.493+0000 7f06ca219640 1 -- 172.21.15.55:0/2668141273 --> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06c40b3130 con 0x7f06a40657a0 2023-08-25T05:35:45.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.501+0000 7f06c0ff9640 1 -- 172.21.15.55:0/2668141273 <== mgr.9763 v2:172.21.15.110:6832/3764131781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299444 (secure 0 0 0) 0x7f06b4009600 con 0x7f06a40657a0 2023-08-25T05:35:45.509 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:45.510 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:35:45.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.505+0000 7f06ca219640 1 -- 172.21.15.55:0/2668141273 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f06a40657a0 msgr2=0x7f06a4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:45.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.505+0000 7f06ca219640 1 --2- 172.21.15.55:0/2668141273 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f06a40657a0 0x7f06a4067c60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f06b4009970 tx=0x7f06b4008040 comp rx=0 tx=0).stop 2023-08-25T05:35:45.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.505+0000 7f06ca219640 1 -- 172.21.15.55:0/2668141273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c40c89f0 msgr2=0x7f06c41522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:45.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.505+0000 7f06ca219640 1 --2- 172.21.15.55:0/2668141273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c40c89f0 0x7f06c41522e0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00c780 tx=0x7f06bc00cc40 comp rx=0 tx=0).stop 2023-08-25T05:35:45.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.505+0000 7f06ca219640 1 -- 172.21.15.55:0/2668141273 shutdown_connections 2023-08-25T05:35:45.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.505+0000 7f06ca219640 1 --2- 172.21.15.55:0/2668141273 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f06a40657a0 0x7f06a4067c60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.505+0000 7f06ca219640 1 --2- 172.21.15.55:0/2668141273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06c40c89f0 0x7f06c41522e0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.505+0000 7f06ca219640 1 --2- 172.21.15.55:0/2668141273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06c40ad950 0x7f06c4151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.505+0000 7f06ca219640 1 --2- 172.21.15.55:0/2668141273 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06c406c000 0x7f06c409b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.505+0000 7f06ca219640 1 -- 172.21.15.55:0/2668141273 >> 172.21.15.55:0/2668141273 conn(0x7f06c4069d00 msgr2=0x7f06c40af630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:45.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.505+0000 7f06ca219640 1 -- 172.21.15.55:0/2668141273 shutdown_connections 2023-08-25T05:35:45.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.505+0000 7f06ca219640 1 -- 172.21.15.55:0/2668141273 wait complete. 2023-08-25T05:35:45.530 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-25T05:35:44.141518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1904,"num_read_kb":3991,"num_write":525,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3631,"ondisk_log_size":3631,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":396280,"kb_used_data":19152,"kb_used_omap":13,"kb_used_meta":377010,"kb_avail":754578440,"statfs":{"total":773094113280,"available":772688322560,"internally_reserved":0,"allocated":19611648,"data_stored":10523148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":386058328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.759821"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.387613+0000","last_change":"2023-08-25T05:35:39.387613+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.387613+0000","last_undegraded":"2023-08-25T05:35:39.387613+0000","last_fullsized":"2023-08-25T05:35:39.387613+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.390361+0000","last_change":"2023-08-25T05:35:39.390361+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.390361+0000","last_undegraded":"2023-08-25T05:35:39.390361+0000","last_fullsized":"2023-08-25T05:35:39.390361+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.383867+0000","last_change":"2023-08-25T05:35:39.383867+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.383867+0000","last_undegraded":"2023-08-25T05:35:39.383867+0000","last_fullsized":"2023-08-25T05:35:39.383867+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.388395+0000","last_change":"2023-08-25T05:35:39.388395+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.388395+0000","last_undegraded":"2023-08-25T05:35:39.388395+0000","last_fullsized":"2023-08-25T05:35:39.388395+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.389603+0000","last_change":"2023-08-25T05:35:39.389603+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.389603+0000","last_undegraded":"2023-08-25T05:35:39.389603+0000","last_fullsized":"2023-08-25T05:35:39.389603+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.388850+0000","last_change":"2023-08-25T05:35:39.388850+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.388850+0000","last_undegraded":"2023-08-25T05:35:39.388850+0000","last_fullsized":"2023-08-25T05:35:39.388850+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.390348+0000","last_change":"2023-08-25T05:35:39.390348+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.390348+0000","last_undegraded":"2023-08-25T05:35:39.390348+0000","last_fullsized":"2023-08-25T05:35:39.390348+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.390135+0000","last_change":"2023-08-25T05:35:39.390135+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.390135+0000","last_undegraded":"2023-08-25T05:35:39.390135+0000","last_fullsized":"2023-08-25T05:35:39.390135+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.385095+0000","last_change":"2023-08-25T05:35:39.385095+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.385095+0000","last_undegraded":"2023-08-25T05:35:39.385095+0000","last_fullsized":"2023-08-25T05:35:39.385095+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.390427+0000","last_change":"2023-08-25T05:35:39.390427+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.390427+0000","last_undegraded":"2023-08-25T05:35:39.390427+0000","last_fullsized":"2023-08-25T05:35:39.390427+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.389703+0000","last_change":"2023-08-25T05:35:39.389703+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.389703+0000","last_undegraded":"2023-08-25T05:35:39.389703+0000","last_fullsized":"2023-08-25T05:35:39.389703+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.390943+0000","last_change":"2023-08-25T05:35:39.390943+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.390943+0000","last_undegraded":"2023-08-25T05:35:39.390943+0000","last_fullsized":"2023-08-25T05:35:39.390943+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.388994+0000","last_change":"2023-08-25T05:35:39.388994+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.388994+0000","last_undegraded":"2023-08-25T05:35:39.388994+0000","last_fullsized":"2023-08-25T05:35:39.388994+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.383867+0000","last_change":"2023-08-25T05:35:39.383867+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.383867+0000","last_undegraded":"2023-08-25T05:35:39.383867+0000","last_fullsized":"2023-08-25T05:35:39.383867+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.387823+0000","last_change":"2023-08-25T05:35:39.387823+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.387823+0000","last_undegraded":"2023-08-25T05:35:39.387823+0000","last_fullsized":"2023-08-25T05:35:39.387823+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.387235+0000","last_change":"2023-08-25T05:35:39.387235+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.387235+0000","last_undegraded":"2023-08-25T05:35:39.387235+0000","last_fullsized":"2023-08-25T05:35:39.387235+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.389174+0000","last_change":"2023-08-25T05:35:39.389174+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.389174+0000","last_undegraded":"2023-08-25T05:35:39.389174+0000","last_fullsized":"2023-08-25T05:35:39.389174+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.385052+0000","last_change":"2023-08-25T05:35:39.385052+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.385052+0000","last_undegraded":"2023-08-25T05:35:39.385052+0000","last_fullsized":"2023-08-25T05:35:39.385052+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.385093+0000","last_change":"2023-08-25T05:35:39.385093+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.385093+0000","last_undegraded":"2023-08-25T05:35:39.385093+0000","last_fullsized":"2023-08-25T05:35:39.385093+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.387804+0000","last_change":"2023-08-25T05:35:39.387804+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.387804+0000","last_undegraded":"2023-08-25T05:35:39.387804+0000","last_fullsized":"2023-08-25T05:35:39.387804+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.387406+0000","last_change":"2023-08-25T05:35:39.387406+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.387406+0000","last_undegraded":"2023-08-25T05:35:39.387406+0000","last_fullsized":"2023-08-25T05:35:39.387406+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.385055+0000","last_change":"2023-08-25T05:35:39.385055+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.385055+0000","last_undegraded":"2023-08-25T05:35:39.385055+0000","last_fullsized":"2023-08-25T05:35:39.385055+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.383868+0000","last_change":"2023-08-25T05:35:39.383868+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.383868+0000","last_undegraded":"2023-08-25T05:35:39.383868+0000","last_fullsized":"2023-08-25T05:35:39.383868+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.388673+0000","last_change":"2023-08-25T05:35:39.388673+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.388673+0000","last_undegraded":"2023-08-25T05:35:39.388673+0000","last_fullsized":"2023-08-25T05:35:39.388673+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.386171+0000","last_change":"2023-08-25T05:35:39.386171+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.386171+0000","last_undegraded":"2023-08-25T05:35:39.386171+0000","last_fullsized":"2023-08-25T05:35:39.386171+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"176'3631","reported_seq":4540,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-08-25T05:35:39.387904+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:35:39.387904+0000","last_peered":"2023-08-25T05:35:39.387904+0000","last_clean":"2023-08-25T05:35:39.387904+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:35:39.387904+0000","last_undegraded":"2023-08-25T05:35:39.387904+0000","last_fullsized":"2023-08-25T05:35:39.387904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3631,"log_dups_size":0,"ondisk_log_size":3631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:50:59.424205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1904,"num_read_kb":3991,"num_write":525,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":327,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-08-25T05:35:39.385026+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:35:39.385026+0000","last_peered":"2023-08-25T05:35:39.385026+0000","last_clean":"2023-08-25T05:35:39.385026+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:35:39.385026+0000","last_undegraded":"2023-08-25T05:35:39.385026+0000","last_fullsized":"2023-08-25T05:35:39.385026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:24:09.253085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.387439+0000","last_change":"2023-08-25T05:35:39.387439+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.387439+0000","last_undegraded":"2023-08-25T05:35:39.387439+0000","last_fullsized":"2023-08-25T05:35:39.387439+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":323,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-08-25T05:35:39.387773+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:35:39.387773+0000","last_peered":"2023-08-25T05:35:39.387773+0000","last_clean":"2023-08-25T05:35:39.387773+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:35:39.387773+0000","last_undegraded":"2023-08-25T05:35:39.387773+0000","last_fullsized":"2023-08-25T05:35:39.387773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:38:14.008598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.385992+0000","last_change":"2023-08-25T05:35:39.385992+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.385992+0000","last_undegraded":"2023-08-25T05:35:39.385992+0000","last_fullsized":"2023-08-25T05:35:39.385992+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":331,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-08-25T05:35:39.390940+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:35:39.390940+0000","last_peered":"2023-08-25T05:35:39.390940+0000","last_clean":"2023-08-25T05:35:39.390940+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:35:39.390940+0000","last_undegraded":"2023-08-25T05:35:39.390940+0000","last_fullsized":"2023-08-25T05:35:39.390940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:31:47.803496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.386394+0000","last_change":"2023-08-25T05:35:39.386394+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.386394+0000","last_undegraded":"2023-08-25T05:35:39.386394+0000","last_fullsized":"2023-08-25T05:35:39.386394+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":327,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-08-25T05:35:39.385024+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:35:39.385024+0000","last_peered":"2023-08-25T05:35:39.385024+0000","last_clean":"2023-08-25T05:35:39.385024+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:35:39.385024+0000","last_undegraded":"2023-08-25T05:35:39.385024+0000","last_fullsized":"2023-08-25T05:35:39.385024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:51:13.315404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.384499+0000","last_change":"2023-08-25T05:35:39.384499+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.384499+0000","last_undegraded":"2023-08-25T05:35:39.384499+0000","last_fullsized":"2023-08-25T05:35:39.384499+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":357,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-08-25T05:35:39.391302+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:35:39.391302+0000","last_peered":"2023-08-25T05:35:39.391302+0000","last_clean":"2023-08-25T05:35:39.391302+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:35:39.391302+0000","last_undegraded":"2023-08-25T05:35:39.391302+0000","last_fullsized":"2023-08-25T05:35:39.391302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:23:22.751308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.390745+0000","last_change":"2023-08-25T05:35:39.390745+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.390745+0000","last_undegraded":"2023-08-25T05:35:39.390745+0000","last_fullsized":"2023-08-25T05:35:39.390745+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":321,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-08-25T05:35:39.388174+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:35:39.388174+0000","last_peered":"2023-08-25T05:35:39.388174+0000","last_clean":"2023-08-25T05:35:39.388174+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:35:39.388174+0000","last_undegraded":"2023-08-25T05:35:39.388174+0000","last_fullsized":"2023-08-25T05:35:39.388174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:58:12.578556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.389511+0000","last_change":"2023-08-25T05:35:39.389511+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.389511+0000","last_undegraded":"2023-08-25T05:35:39.389511+0000","last_fullsized":"2023-08-25T05:35:39.389511+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":355,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-08-25T05:35:39.390825+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:35:39.390825+0000","last_peered":"2023-08-25T05:35:39.390825+0000","last_clean":"2023-08-25T05:35:39.390825+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:35:39.390825+0000","last_undegraded":"2023-08-25T05:35:39.390825+0000","last_fullsized":"2023-08-25T05:35:39.390825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:39:08.897640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.386870+0000","last_change":"2023-08-25T05:35:39.386870+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.386870+0000","last_undegraded":"2023-08-25T05:35:39.386870+0000","last_fullsized":"2023-08-25T05:35:39.386870+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":377,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-08-25T05:35:39.384123+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:35:39.384123+0000","last_peered":"2023-08-25T05:35:39.384123+0000","last_clean":"2023-08-25T05:35:39.384123+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:35:39.384123+0000","last_undegraded":"2023-08-25T05:35:39.384123+0000","last_fullsized":"2023-08-25T05:35:39.384123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:58:06.098009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1904,"num_read_kb":3991,"num_write":525,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3631,"ondisk_log_size":3631,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510549,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52060,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319780,"statfs":{"total":96636764160,"available":96583454720,"internally_reserved":0,"allocated":2899968,"data_stored":1759712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.745,"15min":0.74199999999999999},"min":{"1min":0.60099999999999998,"5min":0.44400000000000001,"15min":0.40999999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0169999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.53900000000000003,"5min":0.48199999999999998,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.71099999999999997}]},{"osd":1,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.52700000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.59299999999999997,"5min":0.47999999999999998,"15min":0.46800000000000003},"max":{"1min":0.97999999999999998,"5min":0.98099999999999998,"15min":1.026},"last":0.624}]},{"osd":2,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.747,"15min":0.753},"min":{"1min":0.54700000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95899999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76900000000000002,"15min":0.76400000000000001},"min":{"1min":0.58899999999999997,"5min":0.55500000000000005,"15min":0.53600000000000003},"max":{"1min":0.97299999999999998,"5min":1.0329999999999999,"15min":1.0840000000000001},"last":0.749}]},{"osd":3,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.57999999999999996,"5min":0.53300000000000003,"15min":0.51700000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.49399999999999999},"max":{"1min":0.93600000000000005,"5min":1.0600000000000001,"15min":1.0680000000000001},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.44,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.032},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90400000000000003,"5min":1.163,"15min":1.163},"last":0.42299999999999999}]},{"osd":5,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60699999999999998,"15min":0.623},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.36599999999999999},"max":{"1min":0.77000000000000002,"5min":0.997,"15min":1.1120000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65900000000000003,"15min":0.66900000000000004},"min":{"1min":0.47499999999999998,"5min":0.435,"15min":0.42699999999999999},"max":{"1min":0.873,"5min":1.04,"15min":1.0640000000000001},"last":0.46600000000000003}]},{"osd":6,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.499,"15min":0.47999999999999998},"max":{"1min":0.94499999999999995,"5min":1.028,"15min":1.0960000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68700000000000006,"15min":0.69699999999999995},"min":{"1min":0.47299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95999999999999996,"5min":1.119,"15min":1.119},"last":0.51600000000000001}]}]},{"osd":6,"up_from":15,"seq":64424510549,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33432,"kb_used_data":2252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338408,"statfs":{"total":96636764160,"available":96602529792,"internally_reserved":0,"allocated":2306048,"data_stored":1169344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.753,"15min":0.751},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93300000000000005,"5min":0.99099999999999999,"15min":1.0449999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.40100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91700000000000004,"5min":1.0389999999999999,"15min":1.1699999999999999},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76000000000000001,"15min":0.76300000000000001},"min":{"1min":0.55000000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.89500000000000002,"5min":0.97299999999999998,"15min":1.1559999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.74299999999999999,"15min":0.76000000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89900000000000002,"5min":1.022,"15min":1.1299999999999999},"last":0.76000000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.77000000000000002,"15min":0.79100000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97699999999999998,"5min":1.0760000000000001,"15min":1.0780000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.51900000000000002},"max":{"1min":0.94499999999999995,"5min":1.0669999999999999,"15min":1.1599999999999999},"last":0.41299999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.46400000000000002},"max":{"1min":0.90500000000000003,"5min":1.0049999999999999,"15min":1.208},"last":0.497},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92500000000000004,"5min":1.054,"15min":1.236},"last":0.72399999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.33200000000000002},"max":{"1min":0.80400000000000005,"5min":0.84899999999999998,"15min":1.018},"last":0.623},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.44700000000000001,"5min":0.40500000000000003,"15min":0.35499999999999998},"max":{"1min":0.74299999999999999,"5min":0.85799999999999998,"15min":1.016},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.48899999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.77700000000000002,"5min":0.95599999999999996,"15min":1.1319999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72199999999999998,"15min":0.73399999999999999},"min":{"1min":0.44500000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.1659999999999999},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65500000000000003,"15min":0.66200000000000003},"min":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.39700000000000002},"max":{"1min":0.81699999999999995,"5min":0.97199999999999998,"15min":1.044},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68200000000000005,"15min":0.69699999999999995},"min":{"1min":0.502,"5min":0.48499999999999999,"15min":0.42899999999999999},"max":{"1min":0.95299999999999996,"5min":1.228,"15min":1.228},"last":0.53200000000000003}]}]},{"osd":5,"up_from":14,"seq":60129543252,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59800,"kb_used_data":2252,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312040,"statfs":{"total":96636764160,"available":96575528960,"internally_reserved":0,"allocated":2306048,"data_stored":1169344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76600000000000001,"15min":0.753},"min":{"1min":0.52400000000000002,"5min":0.499,"15min":0.38600000000000001},"max":{"1min":0.97799999999999998,"5min":0.98199999999999998,"15min":1.034},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76900000000000002,"15min":0.76000000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71799999999999997}]},{"osd":1,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77200000000000002,"15min":0.76900000000000002},"min":{"1min":0.497,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78800000000000003,"15min":0.77600000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45000000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.51400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.503},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77400000000000002,"15min":0.77500000000000002},"min":{"1min":0.56799999999999995,"5min":0.55300000000000005,"15min":0.47999999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.63}]},{"osd":3,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77800000000000002,"15min":0.76900000000000002},"min":{"1min":0.59899999999999998,"5min":0.56200000000000006,"15min":0.51400000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.80500000000000005,"15min":0.79500000000000004},"min":{"1min":0.63,"5min":0.55200000000000005,"15min":0.54800000000000004},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.746}]},{"osd":4,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.64800000000000002,"15min":0.60499999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.66300000000000003,"15min":0.63100000000000001},"min":{"1min":0.50700000000000001,"5min":0.48599999999999999,"15min":0.42499999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Aug 25 05:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.68999999999999995,"15min":0.66800000000000004},"min":{"1min":0.56699999999999995,"5min":0.47899999999999998,"15min":0.42199999999999999},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68799999999999994,"15min":0.68000000000000005},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.44900000000000001},"max":{"1min":0.97299999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67300000000000004,"15min":0.65800000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42499999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.76000000000000001,"15min":0.73599999999999999},"min":{"1min":0.56100000000000005,"5min":0.52700000000000002,"15min":0.46000000000000002},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.78500000000000003}]}]},{"osd":4,"up_from":14,"seq":60129543252,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29272,"kb_used_data":2252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342568,"statfs":{"total":96636764160,"available":96606789632,"internally_reserved":0,"allocated":2306048,"data_stored":1169344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.53000000000000003,"5min":0.49199999999999999,"15min":0.46700000000000003},"max":{"1min":0.92900000000000005,"5min":0.94099999999999995,"15min":1.054},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.54800000000000004,"5min":0.503,"15min":0.44700000000000001},"max":{"1min":0.90600000000000003,"5min":0.97799999999999998,"15min":1.02},"last":0.51800000000000002}]},{"osd":1,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.46200000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.113},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.995,"5min":0.995,"15min":1.097},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76200000000000001,"15min":0.77600000000000002},"min":{"1min":0.55700000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.079},"last":0.501}]},{"osd":3,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.57199999999999995,"5min":0.49099999999999999,"15min":0.47799999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78900000000000003,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.1559999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41499999999999998,"5min":0.377,"15min":0.36899999999999999},"max":{"1min":0.88,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":0.96799999999999997,"15min":0.98299999999999998},"last":0.625}]},{"osd":6,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.748,"15min":0.75},"min":{"1min":0.59899999999999998,"5min":0.49399999999999999,"15min":0.49199999999999999},"max":{"1min":0.99299999999999999,"5min":1.008,"15min":1.1240000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.98299999999999998,"5min":0.98799999999999999,"15min":1.0629999999999999},"last":0.40799999999999997}]},{"osd":7,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.46400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83099999999999996,"5min":0.996,"15min":0.996},"last":0.44},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.496,"5min":0.48799999999999999,"15min":0.47599999999999998},"max":{"1min":1.018,"5min":1.0389999999999999,"15min":1.0860000000000001},"last":0.53200000000000003}]}]},{"osd":3,"up_from":14,"seq":60129543252,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59788,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312052,"statfs":{"total":96636764160,"available":96575541248,"internally_reserved":0,"allocated":2293760,"data_stored":1163174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.34100000000000003,"5min":0.33800000000000002,"15min":0.311},"max":{"1min":0.77400000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.38300000000000001,"5min":0.34300000000000003,"15min":0.313},"max":{"1min":0.72499999999999998,"5min":0.76800000000000002,"15min":0.92900000000000005},"last":0.63}]},{"osd":1,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.31900000000000001},"max":{"1min":0.70499999999999996,"5min":0.71999999999999997,"15min":1.0780000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.625,"15min":0.625},"min":{"1min":0.47999999999999998,"5min":0.44800000000000001,"15min":0.40300000000000002},"max":{"1min":0.83999999999999997,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.748}]},{"osd":2,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.42699999999999999},"max":{"1min":1.006,"5min":1.038,"15min":1.038},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.435,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.77100000000000002,"5min":0.79000000000000004,"15min":0.95799999999999996},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.04,"5min":1.109,"15min":1.123},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83999999999999997,"15min":0.82799999999999996},"min":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.52800000000000002},"max":{"1min":1.079,"5min":1.0980000000000001,"15min":1.286},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81100000000000005,"15min":0.80300000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.47999999999999998},"max":{"1min":1.0169999999999999,"5min":1.1220000000000001,"15min":1.149},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82999999999999996,"15min":0.82899999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.085,"5min":1.1419999999999999,"15min":1.1879999999999999},"last":0.872}]},{"osd":6,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.86399999999999999,"15min":0.86499999999999999},"min":{"1min":0.68799999999999994,"5min":0.63400000000000001,"15min":0.59399999999999997},"max":{"1min":1.107,"5min":1.161,"15min":1.2410000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.48999999999999999},"max":{"1min":1.0640000000000001,"5min":1.091,"15min":1.194},"last":0.95699999999999996}]},{"osd":7,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.86699999999999999,"15min":0.876},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.60399999999999998},"max":{"1min":1.054,"5min":1.145,"15min":1.165},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.62,"5min":0.58299999999999996,"15min":0.51800000000000002},"max":{"1min":1.0580000000000001,"5min":1.141,"15min":1.147},"last":0.89300000000000002}]}]},{"osd":2,"up_from":14,"seq":60129543253,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59800,"kb_used_data":2252,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312040,"statfs":{"total":96636764160,"available":96575528960,"internally_reserved":0,"allocated":2306048,"data_stored":1169344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.64200000000000002,"5min":0.71799999999999997,"15min":0.81100000000000005},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.746,"5min":0.85099999999999998,"15min":0.86099999999999999},"last":0.501}]},{"osd":1,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51500000000000001,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33300000000000002},"max":{"1min":0.66900000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.52800000000000002,"5min":0.51300000000000001,"15min":0.47799999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.89700000000000002},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.36899999999999999},"max":{"1min":0.745,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.59899999999999998},"min":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.41299999999999998},"max":{"1min":0.83699999999999997,"5min":0.89500000000000002,"15min":0.91200000000000003},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83299999999999996,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.59199999999999997,"15min":0.48699999999999999},"max":{"1min":1.0089999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.54600000000000004},"max":{"1min":1.0489999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83299999999999996,"15min":0.82599999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.51700000000000002},"max":{"1min":1.075,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.84099999999999997,"15min":0.85699999999999998},"min":{"1min":0.70699999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.98399999999999999,"5min":1.266,"15min":1.266},"last":0.629}]},{"osd":6,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84499999999999997,"15min":0.85899999999999999},"min":{"1min":0.68799999999999994,"5min":0.61599999999999999,"15min":0.61199999999999999},"max":{"1min":1.0680000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.875,"5min":0.89000000000000001,"15min":0.88300000000000001},"min":{"1min":0.65200000000000002,"5min":0.63100000000000001,"15min":0.58899999999999997},"max":{"1min":1.089,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.74199999999999999}]},{"osd":7,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.64400000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.095,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83399999999999996,"15min":0.83699999999999997},"min":{"1min":0.67700000000000005,"5min":0.60699999999999998,"15min":0.58399999999999996},"max":{"1min":1.0109999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.60199999999999998}]}]},{"osd":1,"up_from":14,"seq":60129543253,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41756,"kb_used_data":2252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330084,"statfs":{"total":96636764160,"available":96594006016,"internally_reserved":0,"allocated":2306048,"data_stored":1169344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48999999999999999,"15min":0.48499999999999999},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.75600000000000001,"15min":0.94399999999999995},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.33500000000000002},"max":{"1min":0.73799999999999999,"5min":0.80400000000000005,"15min":0.879},"last":0.34499999999999997}]},{"osd":2,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.51200000000000001},"min":{"1min":0.437,"5min":0.36299999999999999,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.81399999999999995},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.58999999999999997},"min":{"1min":0.45200000000000001,"5min":0.41599999999999998,"15min":0.41199999999999998},"max":{"1min":0.80800000000000005,"5min":0.88300000000000001,"15min":0.91400000000000003},"last":0.48199999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66000000000000003,"15min":0.65300000000000002},"min":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.46100000000000002},"max":{"1min":0.90600000000000003,"5min":0.998,"15min":0.998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.51300000000000001,"5min":0.42499999999999999,"15min":0.39300000000000002},"max":{"1min":0.84699999999999998,"5min":0.88700000000000001,"15min":0.98699999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.81200000000000006,"15min":0.80300000000000005},"min":{"1min":0.59299999999999997,"5min":0.57399999999999995,"15min":0.48299999999999998},"max":{"1min":1.079,"5min":1.1559999999999999,"15min":1.2350000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.85699999999999998,"15min":0.84599999999999997},"min":{"1min":0.66800000000000004,"5min":0.63300000000000001,"15min":0.56999999999999995},"max":{"1min":1.147,"5min":1.268,"15min":1.268},"last":0.67300000000000004}]},{"osd":5,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81699999999999995,"15min":0.81899999999999995},"min":{"1min":0.58899999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.1950000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84799999999999998,"15min":0.83399999999999996},"min":{"1min":0.64600000000000002,"5min":0.57099999999999995,"15min":0.55300000000000005},"max":{"1min":1.1890000000000001,"5min":1.214,"15min":1.214},"last":0.72099999999999997}]},{"osd":6,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90000000000000002,"15min":0.878},"min":{"1min":0.72199999999999998,"5min":0.67800000000000005,"15min":0.59599999999999997},"max":{"1min":1.034,"5min":1.244,"15min":1.244},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85399999999999998,"15min":0.84599999999999997},"min":{"1min":0.64500000000000002,"5min":0.57999999999999996,"15min":0.55600000000000005},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84999999999999998,"15min":0.84699999999999998},"min":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.55600000000000005},"max":{"1min":1.149,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90800000000000003,"15min":0.89900000000000002},"min":{"1min":0.73699999999999999,"5min":0.69599999999999995,"15min":0.626},"max":{"1min":1.127,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.64100000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543252,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60372,"kb_used_data":2820,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311468,"statfs":{"total":96636764160,"available":96574943232,"internally_reserved":0,"allocated":2887680,"data_stored":1753542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.5,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66400000000000003,"5min":0.70799999999999996,"15min":1.2170000000000001},"last":0.377},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.59099999999999997},"min":{"1min":0.46999999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.85999999999999999},"last":0.56899999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.33900000000000002},"max":{"1min":0.624,"5min":0.81799999999999995,"15min":0.91000000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41699999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71099999999999997,"5min":0.85199999999999998,"15min":0.86799999999999999},"last":0.47199999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51900000000000002,"15min":0.53200000000000003},"min":{"1min":0.378,"5min":0.34399999999999997,"15min":0.33700000000000002},"max":{"1min":0.67800000000000005,"5min":0.83499999999999996,"15min":1.855},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61899999999999999,"15min":0.63},"min":{"1min":0.45200000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.69799999999999995,"5min":0.86599999999999999,"15min":1.3480000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86399999999999999,"15min":0.84799999999999998},"min":{"1min":0.63700000000000001,"5min":0.59999999999999998,"15min":0.53500000000000003},"max":{"1min":1.2210000000000001,"5min":1.2729999999999999,"15min":1.3799999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83099999999999996,"15min":0.84099999999999997},"min":{"1min":0.64600000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2729999999999999,"5min":1.2809999999999999,"15min":1.2849999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81899999999999995,"15min":0.83299999999999996},"min":{"1min":0.57399999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0960000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.84799999999999998,"15min":0.85299999999999998},"min":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.996,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.628}]},{"osd":6,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.256,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.68000000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.141,"5min":1.3560000000000001,"15min":1.5129999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.88900000000000001,"15min":0.88500000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0740000000000001,"5min":1.4339999999999999,"15min":1.5720000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84699999999999998,"15min":0.85699999999999998},"min":{"1min":0.65700000000000003,"5min":0.60099999999999998,"15min":0.58099999999999996},"max":{"1min":1.161,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:35:45.538 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:35:45.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.709+0000 7fb56cb2c640 1 Processor -- start 2023-08-25T05:35:45.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.709+0000 7fb56cb2c640 1 -- start start 2023-08-25T05:35:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.709+0000 7fb56cb2c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb5680ad950 0x7fb5680cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.709+0000 7fb56cb2c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5680cc880 con 0x7fb5680c89f0 2023-08-25T05:35:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.709+0000 7fb56cb2c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5680ccb60 con 0x7fb5680ceeb0 2023-08-25T05:35:45.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.709+0000 7fb56cb2c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5680b11f0 con 0x7fb5680ad950 2023-08-25T05:35:45.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.709+0000 7fb55ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb5680c89f0 0x7fb5680ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:51934/0 (socket says 172.21.15.55:51934) 2023-08-25T05:35:45.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.709+0000 7fb55ffff640 1 -- 172.21.15.55:0/2431347207 learned_addr learned my addr 172.21.15.55:0/2431347207 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:45.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.709+0000 7fb56659c640 1 --2- 172.21.15.55:0/2431347207 >> v2:172.21.15.110:3300/0 conn(0x7fb5680ad950 0x7fb5680cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:45.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.709+0000 7fb565d9b640 1 -- 172.21.15.55:0/2431347207 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492543586 0 0) 0x7fb5680cc880 con 0x7fb5680c89f0 2023-08-25T05:35:45.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.709+0000 7fb565d9b640 1 -- 172.21.15.55:0/2431347207 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb554003530 con 0x7fb5680c89f0 2023-08-25T05:35:45.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.713+0000 7fb56659c640 1 -- 172.21.15.55:0/2431347207 >> v1:172.21.15.110:6789/0 conn(0x7fb5680ceeb0 legacy=0x7fb5680b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:45.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.713+0000 7fb56659c640 1 -- 172.21.15.55:0/2431347207 >> v1:172.21.15.55:6789/0 conn(0x7fb5680c89f0 legacy=0x7fb5680ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:45.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.713+0000 7fb56659c640 1 -- 172.21.15.55:0/2431347207 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5680cce40 con 0x7fb5680ad950 2023-08-25T05:35:45.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.713+0000 7fb56659c640 1 --2- 172.21.15.55:0/2431347207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5680ad950 0x7fb5680cc2a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb5680b1330 tx=0x7fb55801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f24335aa6be78d6c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:45.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.713+0000 7fb565d9b640 1 -- 172.21.15.55:0/2431347207 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5580ab600 con 0x7fb5680ad950 2023-08-25T05:35:45.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.713+0000 7fb565d9b640 1 -- 172.21.15.55:0/2431347207 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5580a7050 con 0x7fb5680ad950 2023-08-25T05:35:45.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.713+0000 7fb565d9b640 1 -- 172.21.15.55:0/2431347207 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5580ab980 con 0x7fb5680ad950 2023-08-25T05:35:45.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.713+0000 7fb56cb2c640 1 -- 172.21.15.55:0/2431347207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5680ad950 msgr2=0x7fb5680cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:45.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.713+0000 7fb56cb2c640 1 --2- 172.21.15.55:0/2431347207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5680ad950 0x7fb5680cc2a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb5680b1330 tx=0x7fb55801c3f0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.713+0000 7fb56cb2c640 1 -- 172.21.15.55:0/2431347207 shutdown_connections 2023-08-25T05:35:45.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.713+0000 7fb56cb2c640 1 --2- 172.21.15.55:0/2431347207 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5680ad950 0x7fb5680cc2a0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.713+0000 7fb56cb2c640 1 -- 172.21.15.55:0/2431347207 >> 172.21.15.55:0/2431347207 conn(0x7fb568069d00 msgr2=0x7fb56806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:45.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.713+0000 7fb56cb2c640 1 -- 172.21.15.55:0/2431347207 shutdown_connections 2023-08-25T05:35:45.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.713+0000 7fb56cb2c640 1 -- 172.21.15.55:0/2431347207 wait complete. 2023-08-25T05:35:45.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb56cb2c640 1 Processor -- start 2023-08-25T05:35:45.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb56cb2c640 1 -- start start 2023-08-25T05:35:45.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb56cb2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5680ad950 0x7fb5680978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:45.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb56cb2c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5680c89f0 0x7fb5680c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:45.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb56cb2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5680ceeb0 0x7fb5680c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:45.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb56cb2c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680c2930 con 0x7fb5680ceeb0 2023-08-25T05:35:45.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb56cb2c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680cb910 con 0x7fb5680ad950 2023-08-25T05:35:45.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb56cb2c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680c2b80 con 0x7fb5680c89f0 2023-08-25T05:35:45.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb566d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5680ceeb0 0x7fb5680c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:45.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb566d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5680ceeb0 0x7fb5680c23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41210/0 (socket says 172.21.15.55:41210) 2023-08-25T05:35:45.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb566d9d640 1 -- 172.21.15.55:0/862366303 learned_addr learned my addr 172.21.15.55:0/862366303 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:45.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb56659c640 1 --2- 172.21.15.55:0/862366303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5680ad950 0x7fb5680978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:45.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb55ffff640 1 --2- 172.21.15.55:0/862366303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5680c89f0 0x7fb5680c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:45.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb566d9d640 1 -- 172.21.15.55:0/862366303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5680c89f0 msgr2=0x7fb5680c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:45.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb566d9d640 1 --2- 172.21.15.55:0/862366303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5680c89f0 0x7fb5680c1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb566d9d640 1 -- 172.21.15.55:0/862366303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5680ad950 msgr2=0x7fb5680978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:45.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb566d9d640 1 --2- 172.21.15.55:0/862366303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5680ad950 0x7fb5680978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb566d9d640 1 -- 172.21.15.55:0/862366303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb558009420 con 0x7fb5680ceeb0 2023-08-25T05:35:45.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb566d9d640 1 --2- 172.21.15.55:0/862366303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5680ceeb0 0x7fb5680c23f0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fb56000c730 tx=0x7fb56000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:45.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb55effd640 1 -- 172.21.15.55:0/862366303 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560003b80 con 0x7fb5680ceeb0 2023-08-25T05:35:45.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb55effd640 1 -- 172.21.15.55:0/862366303 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb560003ce0 con 0x7fb5680ceeb0 2023-08-25T05:35:45.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb55effd640 1 -- 172.21.15.55:0/862366303 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560005310 con 0x7fb5680ceeb0 2023-08-25T05:35:45.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.717+0000 7fb56cb2c640 1 -- 172.21.15.55:0/862366303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5680c2e60 con 0x7fb5680ceeb0 2023-08-25T05:35:45.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.721+0000 7fb56cb2c640 1 -- 172.21.15.55:0/862366303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5680c3420 con 0x7fb5680ceeb0 2023-08-25T05:35:45.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.721+0000 7fb56cb2c640 1 -- 172.21.15.55:0/862366303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56804dbe0 con 0x7fb5680ceeb0 2023-08-25T05:35:45.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.721+0000 7fb55effd640 1 -- 172.21.15.55:0/862366303 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fb560005680 con 0x7fb5680ceeb0 2023-08-25T05:35:45.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.721+0000 7fb55effd640 1 --2- 172.21.15.55:0/862366303 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fb5480657a0 0x7fb548067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:45.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.721+0000 7fb55effd640 1 -- 172.21.15.55:0/862366303 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb560082e50 con 0x7fb5680ceeb0 2023-08-25T05:35:45.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.721+0000 7fb56659c640 1 --2- 172.21.15.55:0/862366303 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fb5480657a0 0x7fb548067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:45.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.721+0000 7fb56659c640 1 --2- 172.21.15.55:0/862366303 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fb5480657a0 0x7fb548067c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5580ad000 tx=0x7fb5580a6000 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:45.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.725+0000 7fb55effd640 1 -- 172.21.15.55:0/862366303 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb560050810 con 0x7fb5680ceeb0 2023-08-25T05:35:45.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.877+0000 7fb56cb2c640 1 -- 172.21.15.55:0/862366303 --> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5680cbb70 con 0x7fb5480657a0 2023-08-25T05:35:45.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.885+0000 7fb55effd640 1 -- 172.21.15.55:0/862366303 <== mgr.9763 v2:172.21.15.110:6832/3764131781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299444 (secure 0 0 0) 0x7fb5680cbb70 con 0x7fb5480657a0 2023-08-25T05:35:45.892 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:45.894 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:35:45.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.889+0000 7fb56cb2c640 1 -- 172.21.15.55:0/862366303 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fb5480657a0 msgr2=0x7fb548067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:45.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.889+0000 7fb56cb2c640 1 --2- 172.21.15.55:0/862366303 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fb5480657a0 0x7fb548067c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5580ad000 tx=0x7fb5580a6000 comp rx=0 tx=0).stop 2023-08-25T05:35:45.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.889+0000 7fb56cb2c640 1 -- 172.21.15.55:0/862366303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5680ceeb0 msgr2=0x7fb5680c23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:45.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.889+0000 7fb56cb2c640 1 --2- 172.21.15.55:0/862366303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5680ceeb0 0x7fb5680c23f0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fb56000c730 tx=0x7fb56000cbf0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.889+0000 7fb56cb2c640 1 -- 172.21.15.55:0/862366303 shutdown_connections 2023-08-25T05:35:45.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.889+0000 7fb56cb2c640 1 --2- 172.21.15.55:0/862366303 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fb5480657a0 0x7fb548067c60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.889+0000 7fb56cb2c640 1 --2- 172.21.15.55:0/862366303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5680ceeb0 0x7fb5680c23f0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.889+0000 7fb56cb2c640 1 --2- 172.21.15.55:0/862366303 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb5680c89f0 0x7fb5680c1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.889+0000 7fb56cb2c640 1 --2- 172.21.15.55:0/862366303 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5680ad950 0x7fb5680978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:45.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.889+0000 7fb56cb2c640 1 -- 172.21.15.55:0/862366303 >> 172.21.15.55:0/862366303 conn(0x7fb568069d00 msgr2=0x7fb568071290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:45.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.889+0000 7fb56cb2c640 1 -- 172.21.15.55:0/862366303 shutdown_connections 2023-08-25T05:35:45.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:45.889+0000 7fb56cb2c640 1 -- 172.21.15.55:0/862366303 wait complete. 2023-08-25T05:35:45.913 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-25T05:35:44.141518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1904,"num_read_kb":3991,"num_write":525,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3631,"ondisk_log_size":3631,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":396280,"kb_used_data":19152,"kb_used_omap":13,"kb_used_meta":377010,"kb_avail":754578440,"statfs":{"total":773094113280,"available":772688322560,"internally_reserved":0,"allocated":19611648,"data_stored":10523148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":386058328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.759821"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.387613+0000","last_change":"2023-08-25T05:35:39.387613+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.387613+0000","last_undegraded":"2023-08-25T05:35:39.387613+0000","last_fullsized":"2023-08-25T05:35:39.387613+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.390361+0000","last_change":"2023-08-25T05:35:39.390361+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.390361+0000","last_undegraded":"2023-08-25T05:35:39.390361+0000","last_fullsized":"2023-08-25T05:35:39.390361+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.383867+0000","last_change":"2023-08-25T05:35:39.383867+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.383867+0000","last_undegraded":"2023-08-25T05:35:39.383867+0000","last_fullsized":"2023-08-25T05:35:39.383867+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.388395+0000","last_change":"2023-08-25T05:35:39.388395+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.388395+0000","last_undegraded":"2023-08-25T05:35:39.388395+0000","last_fullsized":"2023-08-25T05:35:39.388395+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.389603+0000","last_change":"2023-08-25T05:35:39.389603+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.389603+0000","last_undegraded":"2023-08-25T05:35:39.389603+0000","last_fullsized":"2023-08-25T05:35:39.389603+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.388850+0000","last_change":"2023-08-25T05:35:39.388850+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.388850+0000","last_undegraded":"2023-08-25T05:35:39.388850+0000","last_fullsized":"2023-08-25T05:35:39.388850+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.390348+0000","last_change":"2023-08-25T05:35:39.390348+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.390348+0000","last_undegraded":"2023-08-25T05:35:39.390348+0000","last_fullsized":"2023-08-25T05:35:39.390348+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.390135+0000","last_change":"2023-08-25T05:35:39.390135+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.390135+0000","last_undegraded":"2023-08-25T05:35:39.390135+0000","last_fullsized":"2023-08-25T05:35:39.390135+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.385095+0000","last_change":"2023-08-25T05:35:39.385095+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.385095+0000","last_undegraded":"2023-08-25T05:35:39.385095+0000","last_fullsized":"2023-08-25T05:35:39.385095+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.390427+0000","last_change":"2023-08-25T05:35:39.390427+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.390427+0000","last_undegraded":"2023-08-25T05:35:39.390427+0000","last_fullsized":"2023-08-25T05:35:39.390427+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.389703+0000","last_change":"2023-08-25T05:35:39.389703+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.389703+0000","last_undegraded":"2023-08-25T05:35:39.389703+0000","last_fullsized":"2023-08-25T05:35:39.389703+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.390943+0000","last_change":"2023-08-25T05:35:39.390943+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.390943+0000","last_undegraded":"2023-08-25T05:35:39.390943+0000","last_fullsized":"2023-08-25T05:35:39.390943+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.388994+0000","last_change":"2023-08-25T05:35:39.388994+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.388994+0000","last_undegraded":"2023-08-25T05:35:39.388994+0000","last_fullsized":"2023-08-25T05:35:39.388994+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.383867+0000","last_change":"2023-08-25T05:35:39.383867+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.383867+0000","last_undegraded":"2023-08-25T05:35:39.383867+0000","last_fullsized":"2023-08-25T05:35:39.383867+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.387823+0000","last_change":"2023-08-25T05:35:39.387823+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.387823+0000","last_undegraded":"2023-08-25T05:35:39.387823+0000","last_fullsized":"2023-08-25T05:35:39.387823+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.387235+0000","last_change":"2023-08-25T05:35:39.387235+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.387235+0000","last_undegraded":"2023-08-25T05:35:39.387235+0000","last_fullsized":"2023-08-25T05:35:39.387235+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.389174+0000","last_change":"2023-08-25T05:35:39.389174+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.389174+0000","last_undegraded":"2023-08-25T05:35:39.389174+0000","last_fullsized":"2023-08-25T05:35:39.389174+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.385052+0000","last_change":"2023-08-25T05:35:39.385052+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.385052+0000","last_undegraded":"2023-08-25T05:35:39.385052+0000","last_fullsized":"2023-08-25T05:35:39.385052+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.385093+0000","last_change":"2023-08-25T05:35:39.385093+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.385093+0000","last_undegraded":"2023-08-25T05:35:39.385093+0000","last_fullsized":"2023-08-25T05:35:39.385093+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.387804+0000","last_change":"2023-08-25T05:35:39.387804+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.387804+0000","last_undegraded":"2023-08-25T05:35:39.387804+0000","last_fullsized":"2023-08-25T05:35:39.387804+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.387406+0000","last_change":"2023-08-25T05:35:39.387406+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.387406+0000","last_undegraded":"2023-08-25T05:35:39.387406+0000","last_fullsized":"2023-08-25T05:35:39.387406+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.385055+0000","last_change":"2023-08-25T05:35:39.385055+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.385055+0000","last_undegraded":"2023-08-25T05:35:39.385055+0000","last_fullsized":"2023-08-25T05:35:39.385055+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.383868+0000","last_change":"2023-08-25T05:35:39.383868+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.383868+0000","last_undegraded":"2023-08-25T05:35:39.383868+0000","last_fullsized":"2023-08-25T05:35:39.383868+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.388673+0000","last_change":"2023-08-25T05:35:39.388673+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.388673+0000","last_undegraded":"2023-08-25T05:35:39.388673+0000","last_fullsized":"2023-08-25T05:35:39.388673+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.386171+0000","last_change":"2023-08-25T05:35:39.386171+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.386171+0000","last_undegraded":"2023-08-25T05:35:39.386171+0000","last_fullsized":"2023-08-25T05:35:39.386171+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"176'3631","reported_seq":4540,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-08-25T05:35:39.387904+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:35:39.387904+0000","last_peered":"2023-08-25T05:35:39.387904+0000","last_clean":"2023-08-25T05:35:39.387904+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:35:39.387904+0000","last_undegraded":"2023-08-25T05:35:39.387904+0000","last_fullsized":"2023-08-25T05:35:39.387904+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3631,"log_dups_size":0,"ondisk_log_size":3631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:50:59.424205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1904,"num_read_kb":3991,"num_write":525,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":327,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-08-25T05:35:39.385026+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:35:39.385026+0000","last_peered":"2023-08-25T05:35:39.385026+0000","last_clean":"2023-08-25T05:35:39.385026+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:35:39.385026+0000","last_undegraded":"2023-08-25T05:35:39.385026+0000","last_fullsized":"2023-08-25T05:35:39.385026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:24:09.253085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.387439+0000","last_change":"2023-08-25T05:35:39.387439+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.387439+0000","last_undegraded":"2023-08-25T05:35:39.387439+0000","last_fullsized":"2023-08-25T05:35:39.387439+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":323,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-08-25T05:35:39.387773+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:35:39.387773+0000","last_peered":"2023-08-25T05:35:39.387773+0000","last_clean":"2023-08-25T05:35:39.387773+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:35:39.387773+0000","last_undegraded":"2023-08-25T05:35:39.387773+0000","last_fullsized":"2023-08-25T05:35:39.387773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:38:14.008598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.385992+0000","last_change":"2023-08-25T05:35:39.385992+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.385992+0000","last_undegraded":"2023-08-25T05:35:39.385992+0000","last_fullsized":"2023-08-25T05:35:39.385992+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":331,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-08-25T05:35:39.390940+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:35:39.390940+0000","last_peered":"2023-08-25T05:35:39.390940+0000","last_clean":"2023-08-25T05:35:39.390940+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:35:39.390940+0000","last_undegraded":"2023-08-25T05:35:39.390940+0000","last_fullsized":"2023-08-25T05:35:39.390940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:31:47.803496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.386394+0000","last_change":"2023-08-25T05:35:39.386394+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.386394+0000","last_undegraded":"2023-08-25T05:35:39.386394+0000","last_fullsized":"2023-08-25T05:35:39.386394+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":327,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-08-25T05:35:39.385024+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:35:39.385024+0000","last_peered":"2023-08-25T05:35:39.385024+0000","last_clean":"2023-08-25T05:35:39.385024+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:35:39.385024+0000","last_undegraded":"2023-08-25T05:35:39.385024+0000","last_fullsized":"2023-08-25T05:35:39.385024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:51:13.315404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.384499+0000","last_change":"2023-08-25T05:35:39.384499+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.384499+0000","last_undegraded":"2023-08-25T05:35:39.384499+0000","last_fullsized":"2023-08-25T05:35:39.384499+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":357,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-08-25T05:35:39.391302+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:35:39.391302+0000","last_peered":"2023-08-25T05:35:39.391302+0000","last_clean":"2023-08-25T05:35:39.391302+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:35:39.391302+0000","last_undegraded":"2023-08-25T05:35:39.391302+0000","last_fullsized":"2023-08-25T05:35:39.391302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:23:22.751308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.390745+0000","last_change":"2023-08-25T05:35:39.390745+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.390745+0000","last_undegraded":"2023-08-25T05:35:39.390745+0000","last_fullsized":"2023-08-25T05:35:39.390745+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":321,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-08-25T05:35:39.388174+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:35:39.388174+0000","last_peered":"2023-08-25T05:35:39.388174+0000","last_clean":"2023-08-25T05:35:39.388174+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:35:39.388174+0000","last_undegraded":"2023-08-25T05:35:39.388174+0000","last_fullsized":"2023-08-25T05:35:39.388174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:58:12.578556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.389511+0000","last_change":"2023-08-25T05:35:39.389511+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.389511+0000","last_undegraded":"2023-08-25T05:35:39.389511+0000","last_fullsized":"2023-08-25T05:35:39.389511+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":355,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-08-25T05:35:39.390825+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:35:39.390825+0000","last_peered":"2023-08-25T05:35:39.390825+0000","last_clean":"2023-08-25T05:35:39.390825+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:35:39.390825+0000","last_undegraded":"2023-08-25T05:35:39.390825+0000","last_fullsized":"2023-08-25T05:35:39.390825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:39:08.897640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:35:40.381621+0000","last_change":"2023-08-25T05:35:40.381621+0000","last_active":"2023-08-25T05:35:40.381621+0000","last_peered":"2023-08-25T05:35:40.381621+0000","last_clean":"2023-08-25T05:35:40.381621+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:40.381621+0000","last_undegraded":"2023-08-25T05:35:40.381621+0000","last_fullsized":"2023-08-25T05:35:40.381621+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":1,"reported_epoch":185,"state":"creating+peering","last_fresh":"2023-08-25T05:35:39.386870+0000","last_change":"2023-08-25T05:35:39.386870+0000","last_active":"2023-08-25T05:35:39.370172+0000","last_peered":"2023-08-25T05:35:39.370172+0000","last_clean":"2023-08-25T05:35:39.370172+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:35:39.386870+0000","last_undegraded":"2023-08-25T05:35:39.386870+0000","last_fullsized":"2023-08-25T05:35:39.386870+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":377,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-08-25T05:35:39.384123+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:35:39.384123+0000","last_peered":"2023-08-25T05:35:39.384123+0000","last_clean":"2023-08-25T05:35:39.384123+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:35:39.384123+0000","last_undegraded":"2023-08-25T05:35:39.384123+0000","last_fullsized":"2023-08-25T05:35:39.384123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:58:06.098009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1904,"num_read_kb":3991,"num_write":525,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3631,"ondisk_log_size":3631,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510549,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52060,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319780,"statfs":{"total":96636764160,"available":96583454720,"internally_reserved":0,"allocated":2899968,"data_stored":1759712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.745,"15min":0.74199999999999999},"min":{"1min":0.60099999999999998,"5min":0.44400000000000001,"15min":0.40999999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0169999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.53900000000000003,"5min":0.48199999999999998,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.71099999999999997}]},{"osd":1,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.52700000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.59299999999999997,"5min":0.47999999999999998,"15min":0.46800000000000003},"max":{"1min":0.97999999999999998,"5min":0.98099999999999998,"15min":1.026},"last":0.624}]},{"osd":2,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.747,"15min":0.753},"min":{"1min":0.54700000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95899999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76900000000000002,"15min":0.76400000000000001},"min":{"1min":0.58899999999999997,"5min":0.55500000000000005,"15min":0.53600000000000003},"max":{"1min":0.97299999999999998,"5min":1.0329999999999999,"15min":1.0840000000000001},"last":0.749}]},{"osd":3,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.57999999999999996,"5min":0.53300000000000003,"15min":0.51700000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.49399999999999999},"max":{"1min":0.93600000000000005,"5min":1.0600000000000001,"15min":1.0680000000000001},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.44,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.032},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90400000000000003,"5min":1.163,"15min":1.163},"last":0.42299999999999999}]},{"osd":5,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60699999999999998,"15min":0.623},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.36599999999999999},"max":{"1min":0.77000000000000002,"5min":0.997,"15min":1.1120000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65900000000000003,"15min":0.66900000000000004},"min":{"1min":0.47499999999999998,"5min":0.435,"15min":0.42699999999999999},"max":{"1min":0.873,"5min":1.04,"15min":1.0640000000000001},"last":0.46600000000000003}]},{"osd":6,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.499,"15min":0.47999999999999998},"max":{"1min":0.94499999999999995,"5min":1.028,"15min":1.0960000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68700000000000006,"15min":0.69699999999999995},"min":{"1min":0.47299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95999999999999996,"5min":1.119,"15min":1.119},"last":0.51600000000000001}]}]},{"osd":6,"up_from":15,"seq":64424510549,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33432,"kb_used_data":2252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338408,"statfs":{"total":96636764160,"available":96602529792,"internally_reserved":0,"allocated":2306048,"data_stored":1169344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.753,"15min":0.751},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93300000000000005,"5min":0.99099999999999999,"15min":1.0449999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.40100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91700000000000004,"5min":1.0389999999999999,"15min":1.1699999999999999},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76000000000000001,"15min":0.76300000000000001},"min":{"1min":0.55000000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.89500000000000002,"5min":0.97299999999999998,"15min":1.1559999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.74299999999999999,"15min":0.76000000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89900000000000002,"5min":1.022,"15min":1.1299999999999999},"last":0.76000000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.77000000000000002,"15min":0.79100000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97699999999999998,"5min":1.0760000000000001,"15min":1.0780000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.51900000000000002},"max":{"1min":0.94499999999999995,"5min":1.0669999999999999,"15min":1.1599999999999999},"last":0.41299999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.46400000000000002},"max":{"1min":0.90500000000000003,"5min":1.0049999999999999,"15min":1.208},"last":0.497},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92500000000000004,"5min":1.054,"15min":1.236},"last":0.72399999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.33200000000000002},"max":{"1min":0.80400000000000005,"5min":0.84899999999999998,"15min":1.018},"last":0.623},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.44700000000000001,"5min":0.40500000000000003,"15min":0.35499999999999998},"max":{"1min":0.74299999999999999,"5min":0.85799999999999998,"15min":1.016},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.48899999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.77700000000000002,"5min":0.95599999999999996,"15min":1.1319999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72199999999999998,"15min":0.73399999999999999},"min":{"1min":0.44500000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.1659999999999999},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65500000000000003,"15min":0.66200000000000003},"min":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.39700000000000002},"max":{"1min":0.81699999999999995,"5min":0.97199999999999998,"15min":1.044},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68200000000000005,"15min":0.69699999999999995},"min":{"1min":0.502,"5min":0.48499999999999999,"15min":0.42899999999999999},"max":{"1min":0.95299999999999996,"5min":1.228,"15min":1.228},"last":0.53200000000000003}]}]},{"osd":5,"up_from":14,"seq":60129543252,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59800,"kb_used_data":2252,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312040,"statfs":{"total":96636764160,"available":96575528960,"internally_reserved":0,"allocated":2306048,"data_stored":1169344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76600000000000001,"15min":0.753},"min":{"1min":0.52400000000000002,"5min":0.499,"15min":0.38600000000000001},"max":{"1min":0.97799999999999998,"5min":0.98199999999999998,"15min":1.034},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76900000000000002,"15min":0.76000000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71799999999999997}]},{"osd":1,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77200000000000002,"15min":0.76900000000000002},"min":{"1min":0.497,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78800000000000003,"15min":0.77600000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45000000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.75900000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.51400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.503},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77400000000000002,"15min":0.77500000000000002},"min":{"1min":0.56799999999999995,"5min":0.55300000000000005,"15min":0.47999999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.63}]},{"osd":3,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77800000000000002,"15min":0.76900000000000002},"min":{"1min":0.59899999999999998,"5min":0.56200000000000006,"15min":0.51400000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.80500000000000005,"15min":0.79500000000000004},"min":{"1min":0.63,"5min":0.55200000000000005,"15min":0.54800000000000004},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.746}]},{"osd":4,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.64800000000000002,"15min":0.60499999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.66300000000000003,"15min":0.63100000000000001},"min":{"1min":0.50700000000000001,"5min":0.48599999999999999,"15min":0.42499999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Aug 25 05:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.68999999999999995,"15min":0.66800000000000004},"min":{"1min":0.56699999999999995,"5min":0.47899999999999998,"15min":0.42199999999999999},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68799999999999994,"15min":0.68000000000000005},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.44900000000000001},"max":{"1min":0.97299999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67300000000000004,"15min":0.65800000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42499999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.76000000000000001,"15min":0.73599999999999999},"min":{"1min":0.56100000000000005,"5min":0.52700000000000002,"15min":0.46000000000000002},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.78500000000000003}]}]},{"osd":4,"up_from":14,"seq":60129543252,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29272,"kb_used_data":2252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342568,"statfs":{"total":96636764160,"available":96606789632,"internally_reserved":0,"allocated":2306048,"data_stored":1169344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.53000000000000003,"5min":0.49199999999999999,"15min":0.46700000000000003},"max":{"1min":0.92900000000000005,"5min":0.94099999999999995,"15min":1.054},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.54800000000000004,"5min":0.503,"15min":0.44700000000000001},"max":{"1min":0.90600000000000003,"5min":0.97799999999999998,"15min":1.02},"last":0.51800000000000002}]},{"osd":1,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.46200000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.113},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.995,"5min":0.995,"15min":1.097},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76200000000000001,"15min":0.77600000000000002},"min":{"1min":0.55700000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.079},"last":0.501}]},{"osd":3,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.57199999999999995,"5min":0.49099999999999999,"15min":0.47799999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78900000000000003,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.1559999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41499999999999998,"5min":0.377,"15min":0.36899999999999999},"max":{"1min":0.88,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":0.96799999999999997,"15min":0.98299999999999998},"last":0.625}]},{"osd":6,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.748,"15min":0.75},"min":{"1min":0.59899999999999998,"5min":0.49399999999999999,"15min":0.49199999999999999},"max":{"1min":0.99299999999999999,"5min":1.008,"15min":1.1240000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.98299999999999998,"5min":0.98799999999999999,"15min":1.0629999999999999},"last":0.40799999999999997}]},{"osd":7,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.46400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83099999999999996,"5min":0.996,"15min":0.996},"last":0.44},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.496,"5min":0.48799999999999999,"15min":0.47599999999999998},"max":{"1min":1.018,"5min":1.0389999999999999,"15min":1.0860000000000001},"last":0.53200000000000003}]}]},{"osd":3,"up_from":14,"seq":60129543252,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59788,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312052,"statfs":{"total":96636764160,"available":96575541248,"internally_reserved":0,"allocated":2293760,"data_stored":1163174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.34100000000000003,"5min":0.33800000000000002,"15min":0.311},"max":{"1min":0.77400000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.38300000000000001,"5min":0.34300000000000003,"15min":0.313},"max":{"1min":0.72499999999999998,"5min":0.76800000000000002,"15min":0.92900000000000005},"last":0.63}]},{"osd":1,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.31900000000000001},"max":{"1min":0.70499999999999996,"5min":0.71999999999999997,"15min":1.0780000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.625,"15min":0.625},"min":{"1min":0.47999999999999998,"5min":0.44800000000000001,"15min":0.40300000000000002},"max":{"1min":0.83999999999999997,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.748}]},{"osd":2,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.42699999999999999},"max":{"1min":1.006,"5min":1.038,"15min":1.038},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.435,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.77100000000000002,"5min":0.79000000000000004,"15min":0.95799999999999996},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.04,"5min":1.109,"15min":1.123},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83999999999999997,"15min":0.82799999999999996},"min":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.52800000000000002},"max":{"1min":1.079,"5min":1.0980000000000001,"15min":1.286},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81100000000000005,"15min":0.80300000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.47999999999999998},"max":{"1min":1.0169999999999999,"5min":1.1220000000000001,"15min":1.149},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82999999999999996,"15min":0.82899999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.085,"5min":1.1419999999999999,"15min":1.1879999999999999},"last":0.872}]},{"osd":6,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.86399999999999999,"15min":0.86499999999999999},"min":{"1min":0.68799999999999994,"5min":0.63400000000000001,"15min":0.59399999999999997},"max":{"1min":1.107,"5min":1.161,"15min":1.2410000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.48999999999999999},"max":{"1min":1.0640000000000001,"5min":1.091,"15min":1.194},"last":0.95699999999999996}]},{"osd":7,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.86699999999999999,"15min":0.876},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.60399999999999998},"max":{"1min":1.054,"5min":1.145,"15min":1.165},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.62,"5min":0.58299999999999996,"15min":0.51800000000000002},"max":{"1min":1.0580000000000001,"5min":1.141,"15min":1.147},"last":0.89300000000000002}]}]},{"osd":2,"up_from":14,"seq":60129543253,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59800,"kb_used_data":2252,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312040,"statfs":{"total":96636764160,"available":96575528960,"internally_reserved":0,"allocated":2306048,"data_stored":1169344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.64200000000000002,"5min":0.71799999999999997,"15min":0.81100000000000005},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.746,"5min":0.85099999999999998,"15min":0.86099999999999999},"last":0.501}]},{"osd":1,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51500000000000001,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33300000000000002},"max":{"1min":0.66900000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.52800000000000002,"5min":0.51300000000000001,"15min":0.47799999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.89700000000000002},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.36899999999999999},"max":{"1min":0.745,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.59899999999999998},"min":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.41299999999999998},"max":{"1min":0.83699999999999997,"5min":0.89500000000000002,"15min":0.91200000000000003},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83299999999999996,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.59199999999999997,"15min":0.48699999999999999},"max":{"1min":1.0089999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.54600000000000004},"max":{"1min":1.0489999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83299999999999996,"15min":0.82599999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.51700000000000002},"max":{"1min":1.075,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.84099999999999997,"15min":0.85699999999999998},"min":{"1min":0.70699999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.98399999999999999,"5min":1.266,"15min":1.266},"last":0.629}]},{"osd":6,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84499999999999997,"15min":0.85899999999999999},"min":{"1min":0.68799999999999994,"5min":0.61599999999999999,"15min":0.61199999999999999},"max":{"1min":1.0680000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.875,"5min":0.89000000000000001,"15min":0.88300000000000001},"min":{"1min":0.65200000000000002,"5min":0.63100000000000001,"15min":0.58899999999999997},"max":{"1min":1.089,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.74199999999999999}]},{"osd":7,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.64400000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.095,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83399999999999996,"15min":0.83699999999999997},"min":{"1min":0.67700000000000005,"5min":0.60699999999999998,"15min":0.58399999999999996},"max":{"1min":1.0109999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.60199999999999998}]}]},{"osd":1,"up_from":14,"seq":60129543253,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41756,"kb_used_data":2252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330084,"statfs":{"total":96636764160,"available":96594006016,"internally_reserved":0,"allocated":2306048,"data_stored":1169344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48999999999999999,"15min":0.48499999999999999},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.75600000000000001,"15min":0.94399999999999995},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.33500000000000002},"max":{"1min":0.73799999999999999,"5min":0.80400000000000005,"15min":0.879},"last":0.34499999999999997}]},{"osd":2,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.51200000000000001},"min":{"1min":0.437,"5min":0.36299999999999999,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.81399999999999995},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.58999999999999997},"min":{"1min":0.45200000000000001,"5min":0.41599999999999998,"15min":0.41199999999999998},"max":{"1min":0.80800000000000005,"5min":0.88300000000000001,"15min":0.91400000000000003},"last":0.48199999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66000000000000003,"15min":0.65300000000000002},"min":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.46100000000000002},"max":{"1min":0.90600000000000003,"5min":0.998,"15min":0.998},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.51300000000000001,"5min":0.42499999999999999,"15min":0.39300000000000002},"max":{"1min":0.84699999999999998,"5min":0.88700000000000001,"15min":0.98699999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.81200000000000006,"15min":0.80300000000000005},"min":{"1min":0.59299999999999997,"5min":0.57399999999999995,"15min":0.48299999999999998},"max":{"1min":1.079,"5min":1.1559999999999999,"15min":1.2350000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.85699999999999998,"15min":0.84599999999999997},"min":{"1min":0.66800000000000004,"5min":0.63300000000000001,"15min":0.56999999999999995},"max":{"1min":1.147,"5min":1.268,"15min":1.268},"last":0.67300000000000004}]},{"osd":5,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81699999999999995,"15min":0.81899999999999995},"min":{"1min":0.58899999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.1950000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84799999999999998,"15min":0.83399999999999996},"min":{"1min":0.64600000000000002,"5min":0.57099999999999995,"15min":0.55300000000000005},"max":{"1min":1.1890000000000001,"5min":1.214,"15min":1.214},"last":0.72099999999999997}]},{"osd":6,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90000000000000002,"15min":0.878},"min":{"1min":0.72199999999999998,"5min":0.67800000000000005,"15min":0.59599999999999997},"max":{"1min":1.034,"5min":1.244,"15min":1.244},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85399999999999998,"15min":0.84599999999999997},"min":{"1min":0.64500000000000002,"5min":0.57999999999999996,"15min":0.55600000000000005},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73699999999999999}]},{"osd":7,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84999999999999998,"15min":0.84699999999999998},"min":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.55600000000000005},"max":{"1min":1.149,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90800000000000003,"15min":0.89900000000000002},"min":{"1min":0.73699999999999999,"5min":0.69599999999999995,"15min":0.626},"max":{"1min":1.127,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.64100000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543252,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60372,"kb_used_data":2820,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311468,"statfs":{"total":96636764160,"available":96574943232,"internally_reserved":0,"allocated":2887680,"data_stored":1753542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.5,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66400000000000003,"5min":0.70799999999999996,"15min":1.2170000000000001},"last":0.377},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.59099999999999997},"min":{"1min":0.46999999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.85999999999999999},"last":0.56899999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.33900000000000002},"max":{"1min":0.624,"5min":0.81799999999999995,"15min":0.91000000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41699999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71099999999999997,"5min":0.85199999999999998,"15min":0.86799999999999999},"last":0.47199999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51900000000000002,"15min":0.53200000000000003},"min":{"1min":0.378,"5min":0.34399999999999997,"15min":0.33700000000000002},"max":{"1min":0.67800000000000005,"5min":0.83499999999999996,"15min":1.855},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61899999999999999,"15min":0.63},"min":{"1min":0.45200000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.69799999999999995,"5min":0.86599999999999999,"15min":1.3480000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86399999999999999,"15min":0.84799999999999998},"min":{"1min":0.63700000000000001,"5min":0.59999999999999998,"15min":0.53500000000000003},"max":{"1min":1.2210000000000001,"5min":1.2729999999999999,"15min":1.3799999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83099999999999996,"15min":0.84099999999999997},"min":{"1min":0.64600000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2729999999999999,"5min":1.2809999999999999,"15min":1.2849999999999999},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81899999999999995,"15min":0.83299999999999996},"min":{"1min":0.57399999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0960000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.84799999999999998,"15min":0.85299999999999998},"min":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.996,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.628}]},{"osd":6,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.256,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.68000000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.141,"5min":1.3560000000000001,"15min":1.5129999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.88900000000000001,"15min":0.88500000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0740000000000001,"5min":1.4339999999999999,"15min":1.5720000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84699999999999998,"15min":0.85699999999999998},"min":{"1min":0.65700000000000003,"5min":0.60099999999999998,"15min":0.58099999999999996},"max":{"1min":1.161,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:35:45.920 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:35:46.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.093+0000 7f58364cb640 1 Processor -- start 2023-08-25T05:35:46.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.093+0000 7f58364cb640 1 -- start start 2023-08-25T05:35:46.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.093+0000 7f58364cb640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f58300ad950 0x7f58300cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:46.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.093+0000 7f58364cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58300ceeb0 0x7f58300b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:46.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.093+0000 7f58364cb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58300cc880 con 0x7f58300c89f0 2023-08-25T05:35:46.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.093+0000 7f58364cb640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58300b11f0 con 0x7f58300ad950 2023-08-25T05:35:46.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.093+0000 7f58364cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5830159d50 con 0x7f58300ceeb0 2023-08-25T05:35:46.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.093+0000 7f582ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f58300ad950 0x7f58300cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:46.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.093+0000 7f582ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f58300ad950 0x7f58300cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41218/0 (socket says 172.21.15.55:41218) 2023-08-25T05:35:46.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.093+0000 7f582ffff640 1 -- 172.21.15.55:0/964640101 learned_addr learned my addr 172.21.15.55:0/964640101 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:46.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.093+0000 7f5834a68640 1 --2- 172.21.15.55:0/964640101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58300ceeb0 0x7f58300b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:46.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.093+0000 7f582ffff640 1 -- 172.21.15.55:0/964640101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58300ceeb0 msgr2=0x7f58300b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:46.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.097+0000 7f582ffff640 1 --2- 172.21.15.55:0/964640101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58300ceeb0 0x7f58300b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.097+0000 7f582ffff640 1 -- 172.21.15.55:0/964640101 >> v1:172.21.15.110:6789/0 conn(0x7f58300c89f0 legacy=0x7f58300ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:46.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.097+0000 7f582ffff640 1 -- 172.21.15.55:0/964640101 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58300ccb60 con 0x7f58300ad950 2023-08-25T05:35:46.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.097+0000 7f5834a68640 1 --2- 172.21.15.55:0/964640101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58300ceeb0 0x7f58300b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:46.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.097+0000 7f582ffff640 1 --2- 172.21.15.55:0/964640101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58300ad950 0x7f58300cc2a0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f5820009870 tx=0x7f582001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a6dc23aee5dd8c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:46.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.097+0000 7f582effd640 1 -- 172.21.15.55:0/964640101 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58200ac640 con 0x7f58300ad950 2023-08-25T05:35:46.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.097+0000 7f582effd640 1 -- 172.21.15.55:0/964640101 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58200ac7a0 con 0x7f58300ad950 2023-08-25T05:35:46.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.097+0000 7f582effd640 1 -- 172.21.15.55:0/964640101 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58200acb30 con 0x7f58300ad950 2023-08-25T05:35:46.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.097+0000 7f58364cb640 1 -- 172.21.15.55:0/964640101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58300ad950 msgr2=0x7f58300cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:46.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.097+0000 7f58364cb640 1 --2- 172.21.15.55:0/964640101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58300ad950 0x7f58300cc2a0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f5820009870 tx=0x7f582001c440 comp rx=0 tx=0).stop 2023-08-25T05:35:46.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.097+0000 7f58364cb640 1 -- 172.21.15.55:0/964640101 shutdown_connections 2023-08-25T05:35:46.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.097+0000 7f58364cb640 1 --2- 172.21.15.55:0/964640101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58300ceeb0 0x7f58300b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.097+0000 7f58364cb640 1 --2- 172.21.15.55:0/964640101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58300ad950 0x7f58300cc2a0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.097+0000 7f58364cb640 1 -- 172.21.15.55:0/964640101 >> 172.21.15.55:0/964640101 conn(0x7f5830069d00 msgr2=0x7f583006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:46.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.097+0000 7f58364cb640 1 -- 172.21.15.55:0/964640101 shutdown_connections 2023-08-25T05:35:46.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.097+0000 7f58364cb640 1 -- 172.21.15.55:0/964640101 wait complete. 2023-08-25T05:35:46.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f58364cb640 1 Processor -- start 2023-08-25T05:35:46.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f58364cb640 1 -- start start 2023-08-25T05:35:46.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f58364cb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58300ad950 0x7f5830151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:46.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f58364cb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58300c89f0 0x7f5830096bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:46.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f58364cb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58300ceeb0 0x7f58300c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:46.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f58364cb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58300975d0 con 0x7f58300c89f0 2023-08-25T05:35:46.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f58364cb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58300972f0 con 0x7f58300ceeb0 2023-08-25T05:35:46.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f58364cb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58300ab190 con 0x7f58300ad950 2023-08-25T05:35:46.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f582f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58300c89f0 0x7f5830096bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:46.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f582f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58300c89f0 0x7f5830096bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41220/0 (socket says 172.21.15.55:41220) 2023-08-25T05:35:46.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f582f7fe640 1 -- 172.21.15.55:0/2680112369 learned_addr learned my addr 172.21.15.55:0/2680112369 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:46.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f582ffff640 1 --2- 172.21.15.55:0/2680112369 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58300ad950 0x7f5830151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:46.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f5834a68640 1 --2- 172.21.15.55:0/2680112369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58300ceeb0 0x7f58300c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:46.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f582f7fe640 1 -- 172.21.15.55:0/2680112369 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58300ad950 msgr2=0x7f5830151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:46.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f582f7fe640 1 --2- 172.21.15.55:0/2680112369 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58300ad950 0x7f5830151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f582f7fe640 1 -- 172.21.15.55:0/2680112369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58300ceeb0 msgr2=0x7f58300c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:46.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f582f7fe640 1 --2- 172.21.15.55:0/2680112369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58300ceeb0 0x7f58300c6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f582f7fe640 1 -- 172.21.15.55:0/2680112369 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58200094d0 con 0x7f58300c89f0 2023-08-25T05:35:46.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f582f7fe640 1 --2- 172.21.15.55:0/2680112369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58300c89f0 0x7f5830096bf0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f582400c450 tx=0x7f582400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:46.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f582cff9640 1 -- 172.21.15.55:0/2680112369 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824012830 con 0x7f58300c89f0 2023-08-25T05:35:46.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f582cff9640 1 -- 172.21.15.55:0/2680112369 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58240129b0 con 0x7f58300c89f0 2023-08-25T05:35:46.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f582cff9640 1 -- 172.21.15.55:0/2680112369 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5824012d60 con 0x7f58300c89f0 2023-08-25T05:35:46.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.101+0000 7f58364cb640 1 -- 172.21.15.55:0/2680112369 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58300ab470 con 0x7f58300c89f0 2023-08-25T05:35:46.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.105+0000 7f58364cb640 1 -- 172.21.15.55:0/2680112369 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58300c7c80 con 0x7f58300c89f0 2023-08-25T05:35:46.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.105+0000 7f58364cb640 1 -- 172.21.15.55:0/2680112369 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58300aaff0 con 0x7f58300c89f0 2023-08-25T05:35:46.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.105+0000 7f582cff9640 1 -- 172.21.15.55:0/2680112369 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f582401c460 con 0x7f58300c89f0 2023-08-25T05:35:46.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.105+0000 7f582cff9640 1 --2- 172.21.15.55:0/2680112369 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f581c0657a0 0x7f581c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:46.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.105+0000 7f582cff9640 1 -- 172.21.15.55:0/2680112369 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5824082bd0 con 0x7f58300c89f0 2023-08-25T05:35:46.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.105+0000 7f582ffff640 1 --2- 172.21.15.55:0/2680112369 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f581c0657a0 0x7f581c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:46.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.109+0000 7f582ffff640 1 --2- 172.21.15.55:0/2680112369 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f581c0657a0 0x7f581c067c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f58200ae000 tx=0x7f5820008040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:46.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.109+0000 7f582cff9640 1 -- 172.21.15.55:0/2680112369 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f58300aaff0 con 0x7f58300c89f0 2023-08-25T05:35:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.261+0000 7f58364cb640 1 -- 172.21.15.55:0/2680112369 --> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58300b3130 con 0x7f581c0657a0 2023-08-25T05:35:46.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.273+0000 7f582cff9640 1 -- 172.21.15.55:0/2680112369 <== mgr.9763 v2:172.21.15.110:6832/3764131781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311911 (secure 0 0 0) 0x7f58200bc090 con 0x7f581c0657a0 2023-08-25T05:35:46.278 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:46.280 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:35:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.277+0000 7f58364cb640 1 -- 172.21.15.55:0/2680112369 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f581c0657a0 msgr2=0x7f581c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.277+0000 7f58364cb640 1 --2- 172.21.15.55:0/2680112369 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f581c0657a0 0x7f581c067c60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f58200ae000 tx=0x7f5820008040 comp rx=0 tx=0).stop 2023-08-25T05:35:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.277+0000 7f58364cb640 1 -- 172.21.15.55:0/2680112369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58300c89f0 msgr2=0x7f5830096bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:46.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.277+0000 7f58364cb640 1 --2- 172.21.15.55:0/2680112369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58300c89f0 0x7f5830096bf0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f582400c450 tx=0x7f582400c910 comp rx=0 tx=0).stop 2023-08-25T05:35:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.277+0000 7f58364cb640 1 -- 172.21.15.55:0/2680112369 shutdown_connections 2023-08-25T05:35:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.277+0000 7f58364cb640 1 --2- 172.21.15.55:0/2680112369 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f581c0657a0 0x7f581c067c60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.277+0000 7f58364cb640 1 --2- 172.21.15.55:0/2680112369 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58300ceeb0 0x7f58300c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.277+0000 7f58364cb640 1 --2- 172.21.15.55:0/2680112369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58300c89f0 0x7f5830096bf0 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.277+0000 7f58364cb640 1 --2- 172.21.15.55:0/2680112369 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58300ad950 0x7f5830151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.277+0000 7f58364cb640 1 -- 172.21.15.55:0/2680112369 >> 172.21.15.55:0/2680112369 conn(0x7f5830069d00 msgr2=0x7f583015d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:46.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.277+0000 7f58364cb640 1 -- 172.21.15.55:0/2680112369 shutdown_connections 2023-08-25T05:35:46.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.277+0000 7f58364cb640 1 -- 172.21.15.55:0/2680112369 wait complete. 2023-08-25T05:35:46.298 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-25T05:35:46.141986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1904,"num_read_kb":3991,"num_write":569,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3669,"ondisk_log_size":3669,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":396672,"kb_used_data":19528,"kb_used_omap":13,"kb_used_meta":377010,"kb_avail":754578048,"statfs":{"total":773094113280,"available":772687921152,"internally_reserved":0,"allocated":19996672,"data_stored":10703516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":386058328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001493"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400982+0000","last_change":"2023-08-25T05:35:41.419581+0000","last_active":"2023-08-25T05:35:42.400982+0000","last_peered":"2023-08-25T05:35:42.400982+0000","last_clean":"2023-08-25T05:35:42.400982+0000","last_became_active":"2023-08-25T05:35:41.418336+0000","last_became_peered":"2023-08-25T05:35:41.418336+0000","last_unstale":"2023-08-25T05:35:42.400982+0000","last_undegraded":"2023-08-25T05:35:42.400982+0000","last_fullsized":"2023-08-25T05:35:42.400982+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:00:11.264045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049225+0000","last_change":"2023-08-25T05:35:41.411853+0000","last_active":"2023-08-25T05:35:43.049225+0000","last_peered":"2023-08-25T05:35:43.049225+0000","last_clean":"2023-08-25T05:35:43.049225+0000","last_became_active":"2023-08-25T05:35:41.411511+0000","last_became_peered":"2023-08-25T05:35:41.411511+0000","last_unstale":"2023-08-25T05:35:43.049225+0000","last_undegraded":"2023-08-25T05:35:43.049225+0000","last_fullsized":"2023-08-25T05:35:43.049225+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:24.848516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.399993+0000","last_change":"2023-08-25T05:35:41.414546+0000","last_active":"2023-08-25T05:35:42.399993+0000","last_peered":"2023-08-25T05:35:42.399993+0000","last_clean":"2023-08-25T05:35:42.399993+0000","last_became_active":"2023-08-25T05:35:41.414262+0000","last_became_peered":"2023-08-25T05:35:41.414262+0000","last_unstale":"2023-08-25T05:35:42.399993+0000","last_undegraded":"2023-08-25T05:35:42.399993+0000","last_fullsized":"2023-08-25T05:35:42.399993+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:35.302712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400310+0000","last_change":"2023-08-25T05:35:41.412829+0000","last_active":"2023-08-25T05:35:42.400310+0000","last_peered":"2023-08-25T05:35:42.400310+0000","last_clean":"2023-08-25T05:35:42.400310+0000","last_became_active":"2023-08-25T05:35:41.412521+0000","last_became_peered":"2023-08-25T05:35:41.412521+0000","last_unstale":"2023-08-25T05:35:42.400310+0000","last_undegraded":"2023-08-25T05:35:42.400310+0000","last_fullsized":"2023-08-25T05:35:42.400310+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:50:53.533000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048390+0000","last_change":"2023-08-25T05:35:41.431979+0000","last_active":"2023-08-25T05:35:43.048390+0000","last_peered":"2023-08-25T05:35:43.048390+0000","last_clean":"2023-08-25T05:35:43.048390+0000","last_became_active":"2023-08-25T05:35:41.431538+0000","last_became_peered":"2023-08-25T05:35:41.431538+0000","last_unstale":"2023-08-25T05:35:43.048390+0000","last_undegraded":"2023-08-25T05:35:43.048390+0000","last_fullsized":"2023-08-25T05:35:43.048390+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:10:25.020976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048588+0000","last_change":"2023-08-25T05:35:41.408186+0000","last_active":"2023-08-25T05:35:43.048588+0000","last_peered":"2023-08-25T05:35:43.048588+0000","last_clean":"2023-08-25T05:35:43.048588+0000","last_became_active":"2023-08-25T05:35:41.407855+0000","last_became_peered":"2023-08-25T05:35:41.407855+0000","last_unstale":"2023-08-25T05:35:43.048588+0000","last_undegraded":"2023-08-25T05:35:43.048588+0000","last_fullsized":"2023-08-25T05:35:43.048588+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:59:53.689428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548022+0000","last_change":"2023-08-25T05:35:41.431845+0000","last_active":"2023-08-25T05:35:42.548022+0000","last_peered":"2023-08-25T05:35:42.548022+0000","last_clean":"2023-08-25T05:35:42.548022+0000","last_became_active":"2023-08-25T05:35:41.431572+0000","last_became_peered":"2023-08-25T05:35:41.431572+0000","last_unstale":"2023-08-25T05:35:42.548022+0000","last_undegraded":"2023-08-25T05:35:42.548022+0000","last_fullsized":"2023-08-25T05:35:42.548022+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:35:07.333341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.547938+0000","last_change":"2023-08-25T05:35:41.430379+0000","last_active":"2023-08-25T05:35:42.547938+0000","last_peered":"2023-08-25T05:35:42.547938+0000","last_clean":"2023-08-25T05:35:42.547938+0000","last_became_active":"2023-08-25T05:35:41.430122+0000","last_became_peered":"2023-08-25T05:35:41.430122+0000","last_unstale":"2023-08-25T05:35:42.547938+0000","last_undegraded":"2023-08-25T05:35:42.547938+0000","last_fullsized":"2023-08-25T05:35:42.547938+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:54.008665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548469+0000","last_change":"2023-08-25T05:35:41.424794+0000","last_active":"2023-08-25T05:35:42.548469+0000","last_peered":"2023-08-25T05:35:42.548469+0000","last_clean":"2023-08-25T05:35:42.548469+0000","last_became_active":"2023-08-25T05:35:41.424428+0000","last_became_peered":"2023-08-25T05:35:41.424428+0000","last_unstale":"2023-08-25T05:35:42.548469+0000","last_undegraded":"2023-08-25T05:35:42.548469+0000","last_fullsized":"2023-08-25T05:35:42.548469+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:23:45.020253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548359+0000","last_change":"2023-08-25T05:35:41.430334+0000","last_active":"2023-08-25T05:35:42.548359+0000","last_peered":"2023-08-25T05:35:42.548359+0000","last_clean":"2023-08-25T05:35:42.548359+0000","last_became_active":"2023-08-25T05:35:41.430075+0000","last_became_peered":"2023-08-25T05:35:41.430075+0000","last_unstale":"2023-08-25T05:35:42.548359+0000","last_undegraded":"2023-08-25T05:35:42.548359+0000","last_fullsized":"2023-08-25T05:35:42.548359+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:40:28.497330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049341+0000","last_change":"2023-08-25T05:35:41.414476+0000","last_active":"2023-08-25T05:35:43.049341+0000","last_peered":"2023-08-25T05:35:43.049341+0000","last_clean":"2023-08-25T05:35:43.049341+0000","last_became_active":"2023-08-25T05:35:41.414193+0000","last_became_peered":"2023-08-25T05:35:41.414193+0000","last_unstale":"2023-08-25T05:35:43.049341+0000","last_undegraded":"2023-08-25T05:35:43.049341+0000","last_fullsized":"2023-08-25T05:35:43.049341+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:36:23.028051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048762+0000","last_change":"2023-08-25T05:35:41.408499+0000","last_active":"2023-08-25T05:35:43.048762+0000","last_peered":"2023-08-25T05:35:43.048762+0000","last_clean":"2023-08-25T05:35:43.048762+0000","last_became_active":"2023-08-25T05:35:41.408216+0000","last_became_peered":"2023-08-25T05:35:41.408216+0000","last_unstale":"2023-08-25T05:35:43.048762+0000","last_undegraded":"2023-08-25T05:35:43.048762+0000","last_fullsized":"2023-08-25T05:35:43.048762+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:42:38.586904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400941+0000","last_change":"2023-08-25T05:35:41.407770+0000","last_active":"2023-08-25T05:35:42.400941+0000","last_peered":"2023-08-25T05:35:42.400941+0000","last_clean":"2023-08-25T05:35:42.400941+0000","last_became_active":"2023-08-25T05:35:41.407484+0000","last_became_peered":"2023-08-25T05:35:41.407484+0000","last_unstale":"2023-08-25T05:35:42.400941+0000","last_undegraded":"2023-08-25T05:35:42.400941+0000","last_fullsized":"2023-08-25T05:35:42.400941+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:55:53.541995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048272+0000","last_change":"2023-08-25T05:35:41.432870+0000","last_active":"2023-08-25T05:35:43.048272+0000","last_peered":"2023-08-25T05:35:43.048272+0000","last_clean":"2023-08-25T05:35:43.048272+0000","last_became_active":"2023-08-25T05:35:41.432603+0000","last_became_peered":"2023-08-25T05:35:41.432603+0000","last_unstale":"2023-08-25T05:35:43.048272+0000","last_undegraded":"2023-08-25T05:35:43.048272+0000","last_fullsized":"2023-08-25T05:35:43.048272+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:51:53.872466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048473+0000","last_change":"2023-08-25T05:35:41.424943+0000","last_active":"2023-08-25T05:35:43.048473+0000","last_peered":"2023-08-25T05:35:43.048473+0000","last_clean":"2023-08-25T05:35:43.048473+0000","last_became_active":"2023-08-25T05:35:41.424614+0000","last_became_peered":"2023-08-25T05:35:41.424614+0000","last_unstale":"2023-08-25T05:35:43.048473+0000","last_undegraded":"2023-08-25T05:35:43.048473+0000","last_fullsized":"2023-08-25T05:35:43.048473+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:22:40.321564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.399911+0000","last_change":"2023-08-25T05:35:41.412913+0000","last_active":"2023-08-25T05:35:42.399911+0000","last_peered":"2023-08-25T05:35:42.399911+0000","last_clean":"2023-08-25T05:35:42.399911+0000","last_became_active":"2023-08-25T05:35:41.412414+0000","last_became_peered":"2023-08-25T05:35:41.412414+0000","last_unstale":"2023-08-25T05:35:42.399911+0000","last_undegraded":"2023-08-25T05:35:42.399911+0000","last_fullsized":"2023-08-25T05:35:42.399911+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:05:07.052743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548582+0000","last_change":"2023-08-25T05:35:41.427643+0000","last_active":"2023-08-25T05:35:42.548582+0000","last_peered":"2023-08-25T05:35:42.548582+0000","last_clean":"2023-08-25T05:35:42.548582+0000","last_became_active":"2023-08-25T05:35:41.427278+0000","last_became_peered":"2023-08-25T05:35:41.427278+0000","last_unstale":"2023-08-25T05:35:42.548582+0000","last_undegraded":"2023-08-25T05:35:42.548582+0000","last_fullsized":"2023-08-25T05:35:42.548582+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:44:54.277771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400520+0000","last_change":"2023-08-25T05:35:41.426111+0000","last_active":"2023-08-25T05:35:42.400520+0000","last_peered":"2023-08-25T05:35:42.400520+0000","last_clean":"2023-08-25T05:35:42.400520+0000","last_became_active":"2023-08-25T05:35:41.425718+0000","last_became_peered":"2023-08-25T05:35:41.425718+0000","last_unstale":"2023-08-25T05:35:42.400520+0000","last_undegraded":"2023-08-25T05:35:42.400520+0000","last_fullsized":"2023-08-25T05:35:42.400520+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:03:36.587559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049436+0000","last_change":"2023-08-25T05:35:41.427598+0000","last_active":"2023-08-25T05:35:43.049436+0000","last_peered":"2023-08-25T05:35:43.049436+0000","last_clean":"2023-08-25T05:35:43.049436+0000","last_became_active":"2023-08-25T05:35:41.427281+0000","last_became_peered":"2023-08-25T05:35:41.427281+0000","last_unstale":"2023-08-25T05:35:43.049436+0000","last_undegraded":"2023-08-25T05:35:43.049436+0000","last_fullsized":"2023-08-25T05:35:43.049436+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:35:40.501781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048824+0000","last_change":"2023-08-25T05:35:41.424326+0000","last_active":"2023-08-25T05:35:43.048824+0000","last_peered":"2023-08-25T05:35:43.048824+0000","last_clean":"2023-08-25T05:35:43.048824+0000","last_became_active":"2023-08-25T05:35:41.424046+0000","last_became_peered":"2023-08-25T05:35:41.424046+0000","last_unstale":"2023-08-25T05:35:43.048824+0000","last_undegraded":"2023-08-25T05:35:43.048824+0000","last_fullsized":"2023-08-25T05:35:43.048824+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:41:25.322218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401070+0000","last_change":"2023-08-25T05:35:41.412969+0000","last_active":"2023-08-25T05:35:42.401070+0000","last_peered":"2023-08-25T05:35:42.401070+0000","last_clean":"2023-08-25T05:35:42.401070+0000","last_became_active":"2023-08-25T05:35:41.412710+0000","last_became_peered":"2023-08-25T05:35:41.412710+0000","last_unstale":"2023-08-25T05:35:42.401070+0000","last_undegraded":"2023-08-25T05:35:42.401070+0000","last_fullsized":"2023-08-25T05:35:42.401070+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:45:46.714226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048649+0000","last_change":"2023-08-25T05:35:41.412077+0000","last_active":"2023-08-25T05:35:43.048649+0000","last_peered":"2023-08-25T05:35:43.048649+0000","last_clean":"2023-08-25T05:35:43.048649+0000","last_became_active":"2023-08-25T05:35:41.411721+0000","last_became_peered":"2023-08-25T05:35:41.411721+0000","last_unstale":"2023-08-25T05:35:43.048649+0000","last_undegraded":"2023-08-25T05:35:43.048649+0000","last_fullsized":"2023-08-25T05:35:43.048649+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:00:53.558676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048121+0000","last_change":"2023-08-25T05:35:41.419838+0000","last_active":"2023-08-25T05:35:43.048121+0000","last_peered":"2023-08-25T05:35:43.048121+0000","last_clean":"2023-08-25T05:35:43.048121+0000","last_became_active":"2023-08-25T05:35:41.419571+0000","last_became_peered":"2023-08-25T05:35:41.419571+0000","last_unstale":"2023-08-25T05:35:43.048121+0000","last_undegraded":"2023-08-25T05:35:43.048121+0000","last_fullsized":"2023-08-25T05:35:43.048121+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:50:18.882576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400079+0000","last_change":"2023-08-25T05:35:41.412716+0000","last_active":"2023-08-25T05:35:42.400079+0000","last_peered":"2023-08-25T05:35:42.400079+0000","last_clean":"2023-08-25T05:35:42.400079+0000","last_became_active":"2023-08-25T05:35:41.412047+0000","last_became_peered":"2023-08-25T05:35:41.412047+0000","last_unstale":"2023-08-25T05:35:42.400079+0000","last_undegraded":"2023-08-25T05:35:42.400079+0000","last_fullsized":"2023-08-25T05:35:42.400079+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:50:22.152959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401342+0000","last_change":"2023-08-25T05:35:41.428492+0000","last_active":"2023-08-25T05:35:42.401342+0000","last_peered":"2023-08-25T05:35:42.401342+0000","last_clean":"2023-08-25T05:35:42.401342+0000","last_became_active":"2023-08-25T05:35:41.428216+0000","last_became_peered":"2023-08-25T05:35:41.428216+0000","last_unstale":"2023-08-25T05:35:42.401342+0000","last_undegraded":"2023-08-25T05:35:42.401342+0000","last_fullsized":"2023-08-25T05:35:42.401342+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:35:18.637705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048600+0000","last_change":"2023-08-25T05:35:41.412937+0000","last_active":"2023-08-25T05:35:43.048600+0000","last_peered":"2023-08-25T05:35:43.048600+0000","last_clean":"2023-08-25T05:35:43.048600+0000","last_became_active":"2023-08-25T05:35:41.412668+0000","last_became_peered":"2023-08-25T05:35:41.412668+0000","last_unstale":"2023-08-25T05:35:43.048600+0000","last_undegraded":"2023-08-25T05:35:43.048600+0000","last_fullsized":"2023-08-25T05:35:43.048600+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:31:54.977441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049386+0000","last_change":"2023-08-25T05:35:41.412222+0000","last_active":"2023-08-25T05:35:43.049386+0000","last_peered":"2023-08-25T05:35:43.049386+0000","last_clean":"2023-08-25T05:35:43.049386+0000","last_became_active":"2023-08-25T05:35:41.411835+0000","last_became_peered":"2023-08-25T05:35:41.411835+0000","last_unstale":"2023-08-25T05:35:43.049386+0000","last_undegraded":"2023-08-25T05:35:43.049386+0000","last_fullsized":"2023-08-25T05:35:43.049386+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:25:21.536344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400906+0000","last_change":"2023-08-25T05:35:41.413829+0000","last_active":"2023-08-25T05:35:42.400906+0000","last_peered":"2023-08-25T05:35:42.400906+0000","last_clean":"2023-08-25T05:35:42.400906+0000","last_became_active":"2023-08-25T05:35:41.413239+0000","last_became_peered":"2023-08-25T05:35:41.413239+0000","last_unstale":"2023-08-25T05:35:42.400906+0000","last_undegraded":"2023-08-25T05:35:42.400906+0000","last_fullsized":"2023-08-25T05:35:42.400906+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:53:11.533167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048999+0000","last_change":"2023-08-25T05:35:41.427634+0000","last_active":"2023-08-25T05:35:43.048999+0000","last_peered":"2023-08-25T05:35:43.048999+0000","last_clean":"2023-08-25T05:35:43.048999+0000","last_became_active":"2023-08-25T05:35:41.427293+0000","last_became_peered":"2023-08-25T05:35:41.427293+0000","last_unstale":"2023-08-25T05:35:43.048999+0000","last_undegraded":"2023-08-25T05:35:43.048999+0000","last_fullsized":"2023-08-25T05:35:43.048999+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:05.376425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400243+0000","last_change":"2023-08-25T05:35:41.414509+0000","last_active":"2023-08-25T05:35:42.400243+0000","last_peered":"2023-08-25T05:35:42.400243+0000","last_clean":"2023-08-25T05:35:42.400243+0000","last_became_active":"2023-08-25T05:35:41.414047+0000","last_became_peered":"2023-08-25T05:35:41.414047+0000","last_unstale":"2023-08-25T05:35:42.400243+0000","last_undegraded":"2023-08-25T05:35:42.400243+0000","last_fullsized":"2023-08-25T05:35:42.400243+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:55:34.140935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048621+0000","last_change":"2023-08-25T05:35:41.419820+0000","last_active":"2023-08-25T05:35:43.048621+0000","last_peered":"2023-08-25T05:35:43.048621+0000","last_clean":"2023-08-25T05:35:43.048621+0000","last_became_active":"2023-08-25T05:35:41.419511+0000","last_became_peered":"2023-08-25T05:35:41.419511+0000","last_unstale":"2023-08-25T05:35:43.048621+0000","last_undegraded":"2023-08-25T05:35:43.048621+0000","last_fullsized":"2023-08-25T05:35:43.048621+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:50:17.425904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.399994+0000","last_change":"2023-08-25T05:35:41.415137+0000","last_active":"2023-08-25T05:35:42.399994+0000","last_peered":"2023-08-25T05:35:42.399994+0000","last_clean":"2023-08-25T05:35:42.399994+0000","last_became_active":"2023-08-25T05:35:41.414859+0000","last_became_peered":"2023-08-25T05:35:41.414859+0000","last_unstale":"2023-08-25T05:35:42.399994+0000","last_undegraded":"2023-08-25T05:35:42.399994+0000","last_fullsized":"2023-08-25T05:35:42.399994+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:48:33.827393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049054+0000","last_change":"2023-08-25T05:35:41.407983+0000","last_active":"2023-08-25T05:35:43.049054+0000","last_peered":"2023-08-25T05:35:43.049054+0000","last_clean":"2023-08-25T05:35:43.049054+0000","last_became_active":"2023-08-25T05:35:41.407473+0000","last_became_peered":"2023-08-25T05:35:41.407473+0000","last_unstale":"2023-08-25T05:35:43.049054+0000","last_undegraded":"2023-08-25T05:35:43.049054+0000","last_fullsized":"2023-08-25T05:35:43.049054+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:34:08.979155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"187'4","reported_seq":17,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401071+0000","last_change":"2023-08-25T05:35:40.411419+0000","last_active":"2023-08-25T05:35:42.401071+0000","last_peered":"2023-08-25T05:35:42.401071+0000","last_clean":"2023-08-25T05:35:42.401071+0000","last_became_active":"2023-08-25T05:35:40.411110+0000","last_became_peered":"2023-08-25T05:35:40.411110+0000","last_unstale":"2023-08-25T05:35:42.401071+0000","last_undegraded":"2023-08-25T05:35:42.401071+0000","last_fullsized":"2023-08-25T05:35:42.401071+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:49:18.231466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400781+0000","last_change":"2023-08-25T05:35:41.415906+0000","last_active":"2023-08-25T05:35:42.400781+0000","last_peered":"2023-08-25T05:35:42.400781+0000","last_clean":"2023-08-25T05:35:42.400781+0000","last_became_active":"2023-08-25T05:35:41.415626+0000","last_became_peered":"2023-08-25T05:35:41.415626+0000","last_unstale":"2023-08-25T05:35:42.400781+0000","last_undegraded":"2023-08-25T05:35:42.400781+0000","last_fullsized":"2023-08-25T05:35:42.400781+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:54.772065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"187'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049141+0000","last_change":"2023-08-25T05:35:40.407365+0000","last_active":"2023-08-25T05:35:43.049141+0000","last_peered":"2023-08-25T05:35:43.049141+0000","last_clean":"2023-08-25T05:35:43.049141+0000","last_became_active":"2023-08-25T05:35:40.407011+0000","last_became_peered":"2023-08-25T05:35:40.407011+0000","last_unstale":"2023-08-25T05:35:43.049141+0000","last_undegraded":"2023-08-25T05:35:43.049141+0000","last_fullsized":"2023-08-25T05:35:43.049141+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:47.692846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048273+0000","last_change":"2023-08-25T05:35:41.422436+0000","last_active":"2023-08-25T05:35:43.048273+0000","last_peered":"2023-08-25T05:35:43.048273+0000","last_clean":"2023-08-25T05:35:43.048273+0000","last_became_active":"2023-08-25T05:35:41.422159+0000","last_became_peered":"2023-08-25T05:35:41.422159+0000","last_unstale":"2023-08-25T05:35:43.048273+0000","last_undegraded":"2023-08-25T05:35:43.048273+0000","last_fullsized":"2023-08-25T05:35:43.048273+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:00:11.497954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049544+0000","last_change":"2023-08-25T05:35:40.413501+0000","last_active":"2023-08-25T05:35:43.049544+0000","last_peered":"2023-08-25T05:35:43.049544+0000","last_clean":"2023-08-25T05:35:43.049544+0000","last_became_active":"2023-08-25T05:35:40.413184+0000","last_became_peered":"2023-08-25T05:35:40.413184+0000","last_unstale":"2023-08-25T05:35:43.049544+0000","last_undegraded":"2023-08-25T05:35:43.049544+0000","last_fullsized":"2023-08-25T05:35:43.049544+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:16:49.296973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049009+0000","last_change":"2023-08-25T05:35:41.412402+0000","last_active":"2023-08-25T05:35:43.049009+0000","last_peered":"2023-08-25T05:35:43.049009+0000","last_clean":"2023-08-25T05:35:43.049009+0000","last_became_active":"2023-08-25T05:35:41.412061+0000","last_became_peered":"2023-08-25T05:35:41.412061+0000","last_unstale":"2023-08-25T05:35:43.049009+0000","last_undegraded":"2023-08-25T05:35:43.049009+0000","last_fullsized":"2023-08-25T05:35:43.049009+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:40:30.940804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048737+0000","last_change":"2023-08-25T05:35:40.411432+0000","last_active":"2023-08-25T05:35:43.048737+0000","last_peered":"2023-08-25T05:35:43.048737+0000","last_clean":"2023-08-25T05:35:43.048737+0000","last_became_active":"2023-08-25T05:35:40.411091+0000","last_became_peered":"2023-08-25T05:35:40.411091+0000","last_unstale":"2023-08-25T05:35:43.048737+0000","last_undegraded":"2023-08-25T05:35:43.048737+0000","last_fullsized":"2023-08-25T05:35:43.048737+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:59:55.528663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548083+0000","last_change":"2023-08-25T05:35:41.430252+0000","last_active":"2023-08-25T05:35:42.548083+0000","last_peered":"2023-08-25T05:35:42.548083+0000","last_clean":"2023-08-25T05:35:42.548083+0000","last_became_active":"2023-08-25T05:35:41.429891+0000","last_became_peered":"2023-08-25T05:35:41.429891+0000","last_unstale":"2023-08-25T05:35:42.548083+0000","last_undegraded":"2023-08-25T05:35:42.548083+0000","last_fullsized":"2023-08-25T05:35:42.548083+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:23.764839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"187'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548148+0000","last_change":"2023-08-25T05:35:40.403861+0000","last_active":"2023-08-25T05:35:42.548148+0000","last_peered":"2023-08-25T05:35:42.548148+0000","last_clean":"2023-08-25T05:35:42.548148+0000","last_became_active":"2023-08-25T05:35:40.403587+0000","last_became_peered":"2023-08-25T05:35:40.403587+0000","last_unstale":"2023-08-25T05:35:42.548148+0000","last_undegraded":"2023-08-25T05:35:42.548148+0000","last_fullsized":"2023-08-25T05:35:42.548148+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:44:31.114715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048686+0000","last_change":"2023-08-25T05:35:41.425495+0000","last_active":"2023-08-25T05:35:43.048686+0000","last_peered":"2023-08-25T05:35:43.048686+0000","last_clean":"2023-08-25T05:35:43.048686+0000","last_became_active":"2023-08-25T05:35:41.425189+0000","last_became_peered":"2023-08-25T05:35:41.425189+0000","last_unstale":"2023-08-25T05:35:43.048686+0000","last_undegraded":"2023-08-25T05:35:43.048686+0000","last_fullsized":"2023-08-25T05:35:43.048686+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:50:14.964099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"187'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048376+0000","last_change":"2023-08-25T05:35:40.411408+0000","last_active":"2023-08-25T05:35:43.048376+0000","last_peered":"2023-08-25T05:35:43.048376+0000","last_clean":"2023-08-25T05:35:43.048376+0000","last_became_active":"2023-08-25T05:35:40.411086+0000","last_became_peered":"2023-08-25T05:35:40.411086+0000","last_unstale":"2023-08-25T05:35:43.048376+0000","last_undegraded":"2023-08-25T05:35:43.048376+0000","last_fullsized":"2023-08-25T05:35:43.048376+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:36:40.352529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048744+0000","last_change":"2023-08-25T05:35:41.412432+0000","last_active":"2023-08-25T05:35:43.048744+0000","last_peered":"2023-08-25T05:35:43.048744+0000","last_clean":"2023-08-25T05:35:43.048744+0000","last_became_active":"2023-08-25T05:35:41.412128+0000","last_became_peered":"2023-08-25T05:35:41.412128+0000","last_unstale":"2023-08-25T05:35:43.048744+0000","last_undegraded":"2023-08-25T05:35:43.048744+0000","last_fullsized":"2023-08-25T05:35:43.048744+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:19.276006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048391+0000","last_change":"2023-08-25T05:35:40.417142+0000","last_active":"2023-08-25T05:35:43.048391+0000","last_peered":"2023-08-25T05:35:43.048391+0000","last_clean":"2023-08-25T05:35:43.048391+0000","last_became_active":"2023-08-25T05:35:40.416873+0000","last_became_peered":"2023-08-25T05:35:40.416873+0000","last_unstale":"2023-08-25T05:35:43.048391+0000","last_undegraded":"2023-08-25T05:35:43.048391+0000","last_fullsized":"2023-08-25T05:35:43.048391+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:05:14.678680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401009+0000","last_change":"2023-08-25T05:35:41.411759+0000","last_active":"2023-08-25T05:35:42.401009+0000","last_peered":"2023-08-25T05:35:42.401009+0000","last_clean":"2023-08-25T05:35:42.401009+0000","last_became_active":"2023-08-25T05:35:41.411476+0000","last_became_peered":"2023-08-25T05:35:41.411476+0000","last_unstale":"2023-08-25T05:35:42.401009+0000","last_undegraded":"2023-08-25T05:35:42.401009+0000","last_fullsized":"2023-08-25T05:35:42.401009+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:36:46.795428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548062+0000","last_change":"2023-08-25T05:35:40.410462+0000","last_active":"2023-08-25T05:35:42.548062+0000","last_peered":"2023-08-25T05:35:42.548062+0000","last_clean":"2023-08-25T05:35:42.548062+0000","last_became_active":"2023-08-25T05:35:40.410176+0000","last_became_peered":"2023-08-25T05:35:40.410176+0000","last_unstale":"2023-08-25T05:35:42.548062+0000","last_undegraded":"2023-08-25T05:35:42.548062+0000","last_fullsized":"2023-08-25T05:35:42.548062+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:52:55.173377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.547973+0000","last_change":"2023-08-25T05:35:41.431789+0000","last_active":"2023-08-25T05:35:42.547973+0000","last_peered":"2023-08-25T05:35:42.547973+0000","last_clean":"2023-08-25T05:35:42.547973+0000","last_became_active":"2023-08-25T05:35:41.431517+0000","last_became_peered":"2023-08-25T05:35:41.431517+0000","last_unstale":"2023-08-25T05:35:42.547973+0000","last_undegraded":"2023-08-25T05:35:42.547973+0000","last_fullsized":"2023-08-25T05:35:42.547973+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:43:00.132802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"187'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401396+0000","last_change":"2023-08-25T05:35:40.414259+0000","last_active":"2023-08-25T05:35:42.401396+0000","last_peered":"2023-08-25T05:35:42.401396+0000","last_clean":"2023-08-25T05:35:42.401396+0000","last_became_active":"2023-08-25T05:35:40.413974+0000","last_became_peered":"2023-08-25T05:35:40.413974+0000","last_unstale":"2023-08-25T05:35:42.401396+0000","last_undegraded":"2023-08-25T05:35:42.401396+0000","last_fullsized":"2023-08-25T05:35:42.401396+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:05.843267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400586+0000","last_change":"2023-08-25T05:35:41.410857+0000","last_active":"2023-08-25T05:35:42.400586+0000","last_peered":"2023-08-25T05:35:42.400586+0000","last_clean":"2023-08-25T05:35:42.400586+0000","last_became_active":"2023-08-25T05:35:41.410591+0000","last_became_peered":"2023-08-25T05:35:41.410591+0000","last_unstale":"2023-08-25T05:35:42.400586+0000","last_undegraded":"2023-08-25T05:35:42.400586+0000","last_fullsized":"2023-08-25T05:35:42.400586+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:16:32.942553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548406+0000","last_change":"2023-08-25T05:35:40.413149+0000","last_active":"2023-08-25T05:35:42.548406+0000","last_peered":"2023-08-25T05:35:42.548406+0000","last_clean":"2023-08-25T05:35:42.548406+0000","last_became_active":"2023-08-25T05:35:40.412876+0000","last_became_peered":"2023-08-25T05:35:40.412876+0000","last_unstale":"2023-08-25T05:35:42.548406+0000","last_undegraded":"2023-08-25T05:35:42.548406+0000","last_fullsized":"2023-08-25T05:35:42.548406+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:30:29.914434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048569+0000","last_change":"2023-08-25T05:35:41.410345+0000","last_active":"2023-08-25T05:35:43.048569+0000","last_peered":"2023-08-25T05:35:43.048569+0000","last_clean":"2023-08-25T05:35:43.048569+0000","last_became_active":"2023-08-25T05:35:41.410074+0000","last_became_peered":"2023-08-25T05:35:41.410074+0000","last_unstale":"2023-08-25T05:35:43.048569+0000","last_undegraded":"2023-08-25T05:35:43.048569+0000","last_fullsized":"2023-08-25T05:35:43.048569+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:12.232022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"187'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049246+0000","last_change":"2023-08-25T05:35:40.405785+0000","last_active":"2023-08-25T05:35:43.049246+0000","last_peered":"2023-08-25T05:35:43.049246+0000","last_clean":"2023-08-25T05:35:43.049246+0000","last_became_active":"2023-08-25T05:35:40.405505+0000","last_became_peered":"2023-08-25T05:35:40.405505+0000","last_unstale":"2023-08-25T05:35:43.049246+0000","last_undegraded":"2023-08-25T05:35:43.049246+0000","last_fullsized":"2023-08-25T05:35:43.049246+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:54:33.803778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049269+0000","last_change":"2023-08-25T05:35:41.413795+0000","last_active":"2023-08-25T05:35:43.049269+0000","last_peered":"2023-08-25T05:35:43.049269+0000","last_clean":"2023-08-25T05:35:43.049269+0000","last_became_active":"2023-08-25T05:35:41.413488+0000","last_became_peered":"2023-08-25T05:35:41.413488+0000","last_unstale":"2023-08-25T05:35:43.049269+0000","last_undegraded":"2023-08-25T05:35:43.049269+0000","last_fullsized":"2023-08-25T05:35:43.049269+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:47:54.794261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548198+0000","last_change":"2023-08-25T05:35:40.406720+0000","last_active":"2023-08-25T05:35:42.548198+0000","last_peered":"2023-08-25T05:35:42.548198+0000","last_clean":"2023-08-25T05:35:42.548198+0000","last_became_active":"2023-08-25T05:35:40.405992+0000","last_became_peered":"2023-08-25T05:35:40.405992+0000","last_unstale":"2023-08-25T05:35:42.548198+0000","last_undegraded":"2023-08-25T05:35:42.548198+0000","last_fullsized":"2023-08-25T05:35:42.548198+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:38.103093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400937+0000","last_change":"2023-08-25T05:35:41.413997+0000","last_active":"2023-08-25T05:35:42.400937+0000","last_peered":"2023-08-25T05:35:42.400937+0000","last_clean":"2023-08-25T05:35:42.400937+0000","last_became_active":"2023-08-25T05:35:41.413579+0000","last_became_peered":"2023-08-25T05:35:41.413579+0000","last_unstale":"2023-08-25T05:35:42.400937+0000","last_undegraded":"2023-08-25T05:35:42.400937+0000","last_fullsized":"2023-08-25T05:35:42.400937+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:00:20.374889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049013+0000","last_change":"2023-08-25T05:35:40.410371+0000","last_active":"2023-08-25T05:35:43.049013+0000","last_peered":"2023-08-25T05:35:43.049013+0000","last_clean":"2023-08-25T05:35:43.049013+0000","last_became_active":"2023-08-25T05:35:40.410055+0000","last_became_peered":"2023-08-25T05:35:40.410055+0000","last_unstale":"2023-08-25T05:35:43.049013+0000","last_undegraded":"2023-08-25T05:35:43.049013+0000","last_fullsized":"2023-08-25T05:35:43.049013+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:19:41.424451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049229+0000","last_change":"2023-08-25T05:35:41.434853+0000","last_active":"2023-08-25T05:35:43.049229+0000","last_peered":"2023-08-25T05:35:43.049229+0000","last_clean":"2023-08-25T05:35:43.049229+0000","last_became_active":"2023-08-25T05:35:41.434480+0000","last_became_peered":"2023-08-25T05:35:41.434480+0000","last_unstale":"2023-08-25T05:35:43.049229+0000","last_undegraded":"2023-08-25T05:35:43.049229+0000","last_fullsized":"2023-08-25T05:35:43.049229+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:16:56.444696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049107+0000","last_change":"2023-08-25T05:35:40.408621+0000","last_active":"2023-08-25T05:35:43.049107+0000","last_peered":"2023-08-25T05:35:43.049107+0000","last_clean":"2023-08-25T05:35:43.049107+0000","last_became_active":"2023-08-25T05:35:40.408273+0000","last_became_peered":"2023-08-25T05:35:40.408273+0000","last_unstale":"2023-08-25T05:35:43.049107+0000","last_undegraded":"2023-08-25T05:35:43.049107+0000","last_fullsized":"2023-08-25T05:35:43.049107+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:27:05.606309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049051+0000","last_change":"2023-08-25T05:35:41.426812+0000","last_active":"2023-08-25T05:35:43.049051+0000","last_peered":"2023-08-25T05:35:43.049051+0000","last_clean":"2023-08-25T05:35:43.049051+0000","last_became_active":"2023-08-25T05:35:41.426533+0000","last_became_peered":"2023-08-25T05:35:41.426533+0000","last_unstale":"2023-08-25T05:35:43.049051+0000","last_undegraded":"2023-08-25T05:35:43.049051+0000","last_fullsized":"2023-08-25T05:35:43.049051+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:15:29.376118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048456+0000","last_change":"2023-08-25T05:35:40.411511+0000","last_active":"2023-08-25T05:35:43.048456+0000","last_peered":"2023-08-25T05:35:43.048456+0000","last_clean":"2023-08-25T05:35:43.048456+0000","last_became_active":"2023-08-25T05:35:40.411197+0000","last_became_peered":"2023-08-25T05:35:40.411197+0000","last_unstale":"2023-08-25T05:35:43.048456+0000","last_undegraded":"2023-08-25T05:35:43.048456+0000","last_fullsized":"2023-08-25T05:35:43.048456+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:51:47.975073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049174+0000","last_change":"2023-08-25T05:35:41.420762+0000","last_active":"2023-08-25T05:35:43.049174+0000","last_peered":"2023-08-25T05:35:43.049174+0000","last_clean":"2023-08-25T05:35:43.049174+0000","last_became_active":"2023-08-25T05:35:41.420331+0000","last_became_peered":"2023-08-25T05:35:41.420331+0000","last_unstale":"2023-08-25T05:35:43.049174+0000","last_undegraded":"2023-08-25T05:35:43.049174+0000","last_fullsized":"2023-08-25T05:35:43.049174+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:18:21.935963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049078+0000","last_change":"2023-08-25T05:35:40.414188+0000","last_active":"2023-08-25T05:35:43.049078+0000","last_peered":"2023-08-25T05:35:43.049078+0000","last_clean":"2023-08-25T05:35:43.049078+0000","last_became_active":"2023-08-25T05:35:40.413850+0000","last_became_peered":"2023-08-25T05:35:40.413850+0000","last_unstale":"2023-08-25T05:35:43.049078+0000","last_undegraded":"2023-08-25T05:35:43.049078+0000","last_fullsized":"2023-08-25T05:35:43.049078+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:37:33.219813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048401+0000","last_change":"2023-08-25T05:35:41.418394+0000","last_active":"2023-08-25T05:35:43.048401+0000","last_peered":"2023-08-25T05:35:43.048401+0000","last_clean":"2023-08-25T05:35:43.048401+0000","last_became_active":"2023-08-25T05:35:41.417373+0000","last_became_peered":"2023-08-25T05:35:41.417373+0000","last_unstale":"2023-08-25T05:35:43.048401+0000","last_undegraded":"2023-08-25T05:35:43.048401+0000","last_fullsized":"2023-08-25T05:35:43.048401+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:01:58.749724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049167+0000","last_change":"2023-08-25T05:35:40.406707+0000","last_active":"2023-08-25T05:35:43.049167+0000","last_peered":"2023-08-25T05:35:43.049167+0000","last_clean":"2023-08-25T05:35:43.049167+0000","last_became_active":"2023-08-25T05:35:40.406429+0000","last_became_peered":"2023-08-25T05:35:40.406429+0000","last_unstale":"2023-08-25T05:35:43.049167+0000","last_undegraded":"2023-08-25T05:35:43.049167+0000","last_fullsized":"2023-08-25T05:35:43.049167+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:00:42.395339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548102+0000","last_change":"2023-08-25T05:35:41.424871+0000","last_active":"2023-08-25T05:35:42.548102+0000","last_peered":"2023-08-25T05:35:42.548102+0000","last_clean":"2023-08-25T05:35:42.548102+0000","last_became_active":"2023-08-25T05:35:41.424548+0000","last_became_peered":"2023-08-25T05:35:41.424548+0000","last_unstale":"2023-08-25T05:35:42.548102+0000","last_undegraded":"2023-08-25T05:35:42.548102+0000","last_fullsized":"2023-08-25T05:35:42.548102+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:59.984677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401329+0000","last_change":"2023-08-25T05:35:40.419160+0000","last_active":"2023-08-25T05:35:42.401329+0000","last_peered":"2023-08-25T05:35:42.401329+0000","last_clean":"2023-08-25T05:35:42.401329+0000","last_became_active":"2023-08-25T05:35:40.418867+0000","last_became_peered":"2023-08-25T05:35:40.418867+0000","last_unstale":"2023-08-25T05:35:42.401329+0000","last_undegraded":"2023-08-25T05:35:42.401329+0000","last_fullsized":"2023-08-25T05:35:42.401329+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:25:25.921734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048686+0000","last_change":"2023-08-25T05:35:41.412777+0000","last_active":"2023-08-25T05:35:43.048686+0000","last_peered":"2023-08-25T05:35:43.048686+0000","last_clean":"2023-08-25T05:35:43.048686+0000","last_became_active":"2023-08-25T05:35:41.412478+0000","last_became_peered":"2023-08-25T05:35:41.412478+0000","last_unstale":"2023-08-25T05:35:43.048686+0000","last_undegraded":"2023-08-25T05:35:43.048686+0000","last_fullsized":"2023-08-25T05:35:43.048686+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:52:28.055587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401243+0000","last_change":"2023-08-25T05:35:40.414212+0000","last_active":"2023-08-25T05:35:42.401243+0000","last_peered":"2023-08-25T05:35:42.401243+0000","last_clean":"2023-08-25T05:35:42.401243+0000","last_became_active":"2023-08-25T05:35:40.413942+0000","last_became_peered":"2023-08-25T05:35:40.413942+0000","last_unstale":"2023-08-25T05:35:42.401243+0000","last_undegraded":"2023-08-25T05:35:42.401243+0000","last_fullsized":"2023-08-25T05:35:42.401243+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:44:01.225110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548104+0000","last_change":"2023-08-25T05:35:41.425451+0000","last_active":"2023-08-25T05:35:42.548104+0000","last_peered":"2023-08-25T05:35:42.548104+0000","last_clean":"2023-08-25T05:35:42.548104+0000","last_became_active":"2023-08-25T05:35:41.425115+0000","last_became_peered":"2023-08-25T05:35:41.425115+0000","last_unstale":"2023-08-25T05:35:42.548104+0000","last_undegraded":"2023-08-25T05:35:42.548104+0000","last_fullsized":"2023-08-25T05:35:42.548104+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:52:03.049176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048877+0000","last_change":"2023-08-25T05:35:40.414225+0000","last_active":"2023-08-25T05:35:43.048877+0000","last_peered":"2023-08-25T05:35:43.048877+0000","last_clean":"2023-08-25T05:35:43.048877+0000","last_became_active":"2023-08-25T05:35:40.413875+0000","last_became_peered":"2023-08-25T05:35:40.413875+0000","last_unstale":"2023-08-25T05:35:43.048877+0000","last_undegraded":"2023-08-25T05:35:43.048877+0000","last_fullsized":"2023-08-25T05:35:43.048877+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:55:52.258432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400446+0000","last_change":"2023-08-25T05:35:41.420349+0000","last_active":"2023-08-25T05:35:42.400446+0000","last_peered":"2023-08-25T05:35:42.400446+0000","last_clean":"2023-08-25T05:35:42.400446+0000","last_became_active":"2023-08-25T05:35:41.420070+0000","last_became_peered":"2023-08-25T05:35:41.420070+0000","last_unstale":"2023-08-25T05:35:42.400446+0000","last_undegraded":"2023-08-25T05:35:42.400446+0000","last_fullsized":"2023-08-25T05:35:42.400446+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:43.798231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400377+0000","last_change":"2023-08-25T05:35:40.401833+0000","last_active":"2023-08-25T05:35:42.400377+0000","last_peered":"2023-08-25T05:35:42.400377+0000","last_clean":"2023-08-25T05:35:42.400377+0000","last_became_active":"2023-08-25T05:35:40.401410+0000","last_became_peered":"2023-08-25T05:35:40.401410+0000","last_unstale":"2023-08-25T05:35:42.400377+0000","last_undegraded":"2023-08-25T05:35:42.400377+0000","last_fullsized":"2023-08-25T05:35:42.400377+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:38:18.310667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049523+0000","last_change":"2023-08-25T05:35:41.411460+0000","last_active":"2023-08-25T05:35:43.049523+0000","last_peered":"2023-08-25T05:35:43.049523+0000","last_clean":"2023-08-25T05:35:43.049523+0000","last_became_active":"2023-08-25T05:35:41.411139+0000","last_became_peered":"2023-08-25T05:35:41.411139+0000","last_unstale":"2023-08-25T05:35:43.049523+0000","last_undegraded":"2023-08-25T05:35:43.049523+0000","last_fullsized":"2023-08-25T05:35:43.049523+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:05:13.838540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401009+0000","last_change":"2023-08-25T05:35:40.415437+0000","last_active":"2023-08-25T05:35:42.401009+0000","last_peered":"2023-08-25T05:35:42.401009+0000","last_clean":"2023-08-25T05:35:42.401009+0000","last_became_active":"2023-08-25T05:35:40.415149+0000","last_became_peered":"2023-08-25T05:35:40.415149+0000","last_unstale":"2023-08-25T05:35:42.401009+0000","last_undegraded":"2023-08-25T05:35:42.401009+0000","last_fullsized":"2023-08-25T05:35:42.401009+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:41:44.542923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401251+0000","last_change":"2023-08-25T05:35:41.411974+0000","last_active":"2023-08-25T05:35:42.401251+0000","last_peered":"2023-08-25T05:35:42.401251+0000","last_clean":"2023-08-25T05:35:42.401251+0000","last_became_active":"2023-08-25T05:35:41.411700+0000","last_became_peered":"2023-08-25T05:35:41.411700+0000","last_unstale":"2023-08-25T05:35:42.401251+0000","last_undegraded":"2023-08-25T05:35:42.401251+0000","last_fullsized":"2023-08-25T05:35:42.401251+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:17.173963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048775+0000","last_change":"2023-08-25T05:35:40.413516+0000","last_active":"2023-08-25T05:35:43.048775+0000","last_peered":"2023-08-25T05:35:43.048775+0000","last_clean":"2023-08-25T05:35:43.048775+0000","last_became_active":"2023-08-25T05:35:40.413218+0000","last_became_peered":"2023-08-25T05:35:40.413218+0000","last_unstale":"2023-08-25T05:35:43.048775+0000","last_undegraded":"2023-08-25T05:35:43.048775+0000","last_fullsized":"2023-08-25T05:35:43.048775+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:12:16.082782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048882+0000","last_change":"2023-08-25T05:35:41.424427+0000","last_active":"2023-08-25T05:35:43.048882+0000","last_peered":"2023-08-25T05:35:43.048882+0000","last_clean":"2023-08-25T05:35:43.048882+0000","last_became_active":"2023-08-25T05:35:41.424098+0000","last_became_peered":"2023-08-25T05:35:41.424098+0000","last_unstale":"2023-08-25T05:35:43.048882+0000","last_undegraded":"2023-08-25T05:35:43.048882+0000","last_fullsized":"2023-08-25T05:35:43.048882+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:59:39.438262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.047989+0000","last_change":"2023-08-25T05:35:40.412563+0000","last_active":"2023-08-25T05:35:43.047989+0000","last_peered":"2023-08-25T05:35:43.047989+0000","last_clean":"2023-08-25T05:35:43.047989+0000","last_became_active":"2023-08-25T05:35:40.412276+0000","last_became_peered":"2023-08-25T05:35:40.412276+0000","last_unstale":"2023-08-25T05:35:43.047989+0000","last_undegraded":"2023-08-25T05:35:43.047989+0000","last_fullsized":"2023-08-25T05:35:43.047989+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:46:35.252558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048607+0000","last_change":"2023-08-25T05:35:41.418774+0000","last_active":"2023-08-25T05:35:43.048607+0000","last_peered":"2023-08-25T05:35:43.048607+0000","last_clean":"2023-08-25T05:35:43.048607+0000","last_became_active":"2023-08-25T05:35:41.418472+0000","last_became_peered":"2023-08-25T05:35:41.418472+0000","last_unstale":"2023-08-25T05:35:43.048607+0000","last_undegraded":"2023-08-25T05:35:43.048607+0000","last_fullsized":"2023-08-25T05:35:43.048607+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:19.217529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401211+0000","last_change":"2023-08-25T05:35:40.418728+0000","last_active":"2023-08-25T05:35:42.401211+0000","last_peered":"2023-08-25T05:35:42.401211+0000","last_clean":"2023-08-25T05:35:42.401211+0000","last_became_active":"2023-08-25T05:35:40.418445+0000","last_became_peered":"2023-08-25T05:35:40.418445+0000","last_unstale":"2023-08-25T05:35:42.401211+0000","last_undegraded":"2023-08-25T05:35:42.401211+0000","last_fullsized":"2023-08-25T05:35:42.401211+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:07:02.816830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"176'3631","reported_seq":4546,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049223+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:35:43.049223+0000","last_peered":"2023-08-25T05:35:43.049223+0000","last_clean":"2023-08-25T05:35:43.049223+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:35:43.049223+0000","last_undegraded":"2023-08-25T05:35:43.049223+0000","last_fullsized":"2023-08-25T05:35:43.049223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3631,"log_dups_size":0,"ondisk_log_size":3631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:38:35.230013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1904,"num_read_kb":3991,"num_write":525,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":333,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049370+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:35:43.049370+0000","last_peered":"2023-08-25T05:35:43.049370+0000","last_clean":"2023-08-25T05:35:43.049370+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:35:43.049370+0000","last_undegraded":"2023-08-25T05:35:43.049370+0000","last_fullsized":"2023-08-25T05:35:43.049370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:21:40.444029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400759+0000","last_change":"2023-08-25T05:35:41.425051+0000","last_active":"2023-08-25T05:35:42.400759+0000","last_peered":"2023-08-25T05:35:42.400759+0000","last_clean":"2023-08-25T05:35:42.400759+0000","last_became_active":"2023-08-25T05:35:41.424778+0000","last_became_peered":"2023-08-25T05:35:41.424778+0000","last_unstale":"2023-08-25T05:35:42.400759+0000","last_undegraded":"2023-08-25T05:35:42.400759+0000","last_fullsized":"2023-08-25T05:35:42.400759+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:57:11.814103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"187'3","reported_seq":16,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400733+0000","last_change":"2023-08-25T05:35:40.409842+0000","last_active":"2023-08-25T05:35:42.400733+0000","last_peered":"2023-08-25T05:35:42.400733+0000","last_clean":"2023-08-25T05:35:42.400733+0000","last_became_active":"2023-08-25T05:35:40.409487+0000","last_became_peered":"2023-08-25T05:35:40.409487+0000","last_unstale":"2023-08-25T05:35:42.400733+0000","last_undegraded":"2023-08-25T05:35:42.400733+0000","last_fullsized":"2023-08-25T05:35:42.400733+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:27:01.220692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":329,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049187+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:35:43.049187+0000","last_peered":"2023-08-25T05:35:43.049187+0000","last_clean":"2023-08-25T05:35:43.049187+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:35:43.049187+0000","last_undegraded":"2023-08-25T05:35:43.049187+0000","last_fullsized":"2023-08-25T05:35:43.049187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:04.380893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048384+0000","last_change":"2023-08-25T05:35:41.419498+0000","last_active":"2023-08-25T05:35:43.048384+0000","last_peered":"2023-08-25T05:35:43.048384+0000","last_clean":"2023-08-25T05:35:43.048384+0000","last_became_active":"2023-08-25T05:35:41.419216+0000","last_became_peered":"2023-08-25T05:35:41.419216+0000","last_unstale":"2023-08-25T05:35:43.048384+0000","last_undegraded":"2023-08-25T05:35:43.048384+0000","last_fullsized":"2023-08-25T05:35:43.048384+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:32:41.108174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"187'6","reported_seq":19,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401062+0000","last_change":"2023-08-25T05:35:40.418772+0000","last_active":"2023-08-25T05:35:42.401062+0000","last_peered":"2023-08-25T05:35:42.401062+0000","last_clean":"2023-08-25T05:35:42.401062+0000","last_became_active":"2023-08-25T05:35:40.418526+0000","last_became_peered":"2023-08-25T05:35:40.418526+0000","last_unstale":"2023-08-25T05:35:42.401062+0000","last_undegraded":"2023-08-25T05:35:42.401062+0000","last_fullsized":"2023-08-25T05:35:42.401062+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:15.554963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":337,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048546+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:35:43.048546+0000","last_peered":"2023-08-25T05:35:43.048546+0000","last_clean":"2023-08-25T05:35:43.048546+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:35:43.048546+0000","last_undegraded":"2023-08-25T05:35:43.048546+0000","last_fullsized":"2023-08-25T05:35:43.048546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:15:17.631751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048863+0000","last_change":"2023-08-25T05:35:41.408501+0000","last_active":"2023-08-25T05:35:43.048863+0000","last_peered":"2023-08-25T05:35:43.048863+0000","last_clean":"2023-08-25T05:35:43.048863+0000","last_became_active":"2023-08-25T05:35:41.408179+0000","last_became_peered":"2023-08-25T05:35:41.408179+0000","last_unstale":"2023-08-25T05:35:43.048863+0000","last_undegraded":"2023-08-25T05:35:43.048863+0000","last_fullsized":"2023-08-25T05:35:43.048863+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:13.001472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401279+0000","last_change":"2023-08-25T05:35:40.416043+0000","last_active":"2023-08-25T05:35:42.401279+0000","last_peered":"2023-08-25T05:35:42.401279+0000","last_clean":"2023-08-25T05:35:42.401279+0000","last_became_active":"2023-08-25T05:35:40.415749+0000","last_became_peered":"2023-08-25T05:35:40.415749+0000","last_unstale":"2023-08-25T05:35:42.401279+0000","last_undegraded":"2023-08-25T05:35:42.401279+0000","last_fullsized":"2023-08-25T05:35:42.401279+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:52.123478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":333,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048658+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:35:43.048658+0000","last_peered":"2023-08-25T05:35:43.048658+0000","last_clean":"2023-08-25T05:35:43.048658+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:35:43.048658+0000","last_undegraded":"2023-08-25T05:35:43.048658+0000","last_fullsized":"2023-08-25T05:35:43.048658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:11:09.193027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049448+0000","last_change":"2023-08-25T05:35:41.417745+0000","last_active":"2023-08-25T05:35:43.049448+0000","last_peered":"2023-08-25T05:35:43.049448+0000","last_clean":"2023-08-25T05:35:43.049448+0000","last_became_active":"2023-08-25T05:35:41.417432+0000","last_became_peered":"2023-08-25T05:35:41.417432+0000","last_unstale":"2023-08-25T05:35:43.049448+0000","last_undegraded":"2023-08-25T05:35:43.049448+0000","last_fullsized":"2023-08-25T05:35:43.049448+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:45:36.691656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048717+0000","last_change":"2023-08-25T05:35:40.407963+0000","last_active":"2023-08-25T05:35:43.048717+0000","last_peered":"2023-08-25T05:35:43.048717+0000","last_clean":"2023-08-25T05:35:43.048717+0000","last_became_active":"2023-08-25T05:35:40.407674+0000","last_became_peered":"2023-08-25T05:35:40.407674+0000","last_unstale":"2023-08-25T05:35:43.048717+0000","last_undegraded":"2023-08-25T05:35:43.048717+0000","last_fullsized":"2023-08-25T05:35:43.048717+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:25:39.852933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":363,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548360+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:35:42.548360+0000","last_peered":"2023-08-25T05:35:42.548360+0000","last_clean":"2023-08-25T05:35:42.548360+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:35:42.548360+0000","last_undegraded":"2023-08-25T05:35:42.548360+0000","last_fullsized":"2023-08-25T05:35:42.548360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:50:24.550266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048744+0000","last_change":"2023-08-25T05:35:41.421488+0000","last_active":"2023-08-25T05:35:43.048744+0000","last_peered":"2023-08-25T05:35:43.048744+0000","last_clean":"2023-08-25T05:35:43.048744+0000","last_became_active":"2023-08-25T05:35:41.420950+0000","last_became_peered":"2023-08-25T05:35:41.420950+0000","last_unstale":"2023-08-25T05:35:43.048744+0000","last_undegraded":"2023-08-25T05:35:43.048744+0000","last_fullsized":"2023-08-25T05:35:43.048744+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:19:08.128371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"187'8","reported_seq":21,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548059+0000","last_change":"2023-08-25T05:35:40.408649+0000","last_active":"2023-08-25T05:35:42.548059+0000","last_peered":"2023-08-25T05:35:42.548059+0000","last_clean":"2023-08-25T05:35:42.548059+0000","last_became_active":"2023-08-25T05:35:40.408384+0000","last_became_peered":"2023-08-25T05:35:40.408384+0000","last_unstale":"2023-08-25T05:35:42.548059+0000","last_undegraded":"2023-08-25T05:35:42.548059+0000","last_fullsized":"2023-08-25T05:35:42.548059+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:28:41.500292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":327,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049550+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:35:43.049550+0000","last_peered":"2023-08-25T05:35:43.049550+0000","last_clean":"2023-08-25T05:35:43.049550+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:35:43.049550+0000","last_undegraded":"2023-08-25T05:35:43.049550+0000","last_fullsized":"2023-08-25T05:35:43.049550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:56:16.988841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400258+0000","last_change":"2023-08-25T05:35:41.415881+0000","last_active":"2023-08-25T05:35:42.400258+0000","last_peered":"2023-08-25T05:35:42.400258+0000","last_clean":"2023-08-25T05:35:42.400258+0000","last_became_active":"2023-08-25T05:35:41.415589+0000","last_became_peered":"2023-08-25T05:35:41.415589+0000","last_unstale":"2023-08-25T05:35:42.400258+0000","last_undegraded":"2023-08-25T05:35:42.400258+0000","last_fullsized":"2023-08-25T05:35:42.400258+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:09:10.011656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048870+0000","last_change":"2023-08-25T05:35:40.411989+0000","last_active":"2023-08-25T05:35:43.048870+0000","last_peered":"2023-08-25T05:35:43.048870+0000","last_clean":"2023-08-25T05:35:43.048870+0000","last_became_active":"2023-08-25T05:35:40.411679+0000","last_became_peered":"2023-08-25T05:35:40.411679+0000","last_unstale":"2023-08-25T05:35:43.048870+0000","last_undegraded":"2023-08-25T05:35:43.048870+0000","last_fullsized":"2023-08-25T05:35:43.048870+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:27:24.581704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":361,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548567+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:35:42.548567+0000","last_peered":"2023-08-25T05:35:42.548567+0000","last_clean":"2023-08-25T05:35:42.548567+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:35:42.548567+0000","last_undegraded":"2023-08-25T05:35:42.548567+0000","last_fullsized":"2023-08-25T05:35:42.548567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:00:51.036225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548368+0000","last_change":"2023-08-25T05:35:41.425099+0000","last_active":"2023-08-25T05:35:42.548368+0000","last_peered":"2023-08-25T05:35:42.548368+0000","last_clean":"2023-08-25T05:35:42.548368+0000","last_became_active":"2023-08-25T05:35:41.424715+0000","last_became_peered":"2023-08-25T05:35:41.424715+0000","last_unstale":"2023-08-25T05:35:42.548368+0000","last_undegraded":"2023-08-25T05:35:42.548368+0000","last_fullsized":"2023-08-25T05:35:42.548368+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:38:13.442695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401003+0000","last_change":"2023-08-25T05:35:40.411718+0000","last_active":"2023-08-25T05:35:42.401003+0000","last_peered":"2023-08-25T05:35:42.401003+0000","last_clean":"2023-08-25T05:35:42.401003+0000","last_became_active":"2023-08-25T05:35:40.411291+0000","last_became_peered":"2023-08-25T05:35:40.411291+0000","last_unstale":"2023-08-25T05:35:42.401003+0000","last_undegraded":"2023-08-25T05:35:42.401003+0000","last_fullsized":"2023-08-25T05:35:42.401003+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:54:55.227629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":383,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400626+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:35:42.400626+0000","last_peered":"2023-08-25T05:35:42.400626+0000","last_clean":"2023-08-25T05:35:42.400626+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:35:42.400626+0000","last_undegraded":"2023-08-25T05:35:42.400626+0000","last_fullsized":"2023-08-25T05:35:42.400626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:32:21.310345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1904,"num_read_kb":3991,"num_write":525,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3631,"ondisk_log_size":3631,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510550,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52096,"kb_used_data":2868,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319744,"statfs":{"total":96636764160,"available":96583417856,"internally_reserved":0,"allocated":2936832,"data_stored":1780113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.745,"15min":0.74199999999999999},"min":{"1min":0.60099999999999998,"5min":0.44400000000000001,"15min":0.40999999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0169999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.53900000000000003,"5min":0.48199999999999998,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.52700000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.751},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.59299999999999997,"5min":0.47999999999999998,"15min":0.46800000000000003},"max":{"1min":0.97999999999999998,"5min":0.98099999999999998,"15min":1.026},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.747,"15min":0.753},"min":{"1min":0.54700000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95899999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76900000000000002,"15min":0.76400000000000001},"min":{"1min":0.58899999999999997,"5min":0.55500000000000005,"15min":0.53600000000000003},"max":{"1min":0.97299999999999998,"5min":1.0329999999999999,"15min":1.0840000000000001},"last":0.70099999999999996}]},{"osd":3,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.57999999999999996,"5min":0.53300000000000003,"15min":0.51700000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.49399999999999999},"max":{"1min":0.93600000000000005,"5min":1.0600000000000001,"15min":1.0680000000000001},"last":0.79500000000000004}]},{"osd":4,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.44,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.032},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90400000000000003,"5min":1.163,"15min":1.163},"last":0.54100000000000004}]},{"osd":5,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60699999999999998,"15min":0.623},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.36599999999999999},"max":{"1min":0.77000000000000002,"5min":0.997,"15min":1.1120000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65900000000000003,"15min":0.66900000000000004},"min":{"1min":0.47499999999999998,"5min":0.435,"15min":0.42699999999999999},"max":{"1min":0.873,"5min":1.04,"15min":1.0640000000000001},"last":0.73599999999999999}]},{"osd":6,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.499,"15min":0.47999999999999998},"max":{"1min":0.94499999999999995,"5min":1.028,"15min":1.0960000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68700000000000006,"15min":0.69699999999999995},"min":{"1min":0.47299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95999999999999996,"5min":1.119,"15min":1.119},"last":0.71999999999999997}]}]},{"osd":6,"up_from":15,"seq":64424510550,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33476,"kb_used_data":2288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338364,"statfs":{"total":96636764160,"available":96602484736,"internally_reserved":0,"allocated":2342912,"data_stored":1189745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.753,"15min":0.751},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93300000000000005,"5min":0.99099999999999999,"15min":1.0449999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.40100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91700000000000004,"5min":1.0389999999999999,"15min":1.1699999999999999},"last":0.51800000000000002}]},{"osd":1,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76000000000000001,"15min":0.76300000000000001},"min":{"1min":0.55000000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.89500000000000002,"5min":0.97299999999999998,"15min":1.1559999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.74299999999999999,"15min":0.76000000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89900000000000002,"5min":1.022,"15min":1.1299999999999999},"last":0.76900000000000002}]},{"osd":2,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.77000000000000002,"15min":0.79100000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97699999999999998,"5min":1.0760000000000001,"15min":1.0780000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.51900000000000002},"max":{"1min":0.94499999999999995,"5min":1.0669999999999999,"15min":1.1599999999999999},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.46400000000000002},"max":{"1min":0.90500000000000003,"5min":1.0049999999999999,"15min":1.208},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92500000000000004,"5min":1.054,"15min":1.236},"last":0.59699999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.33200000000000002},"max":{"1min":0.80400000000000005,"5min":0.84899999999999998,"15min":1.018},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.44700000000000001,"5min":0.40500000000000003,"15min":0.35499999999999998},"max":{"1min":0.74299999999999999,"5min":0.85799999999999998,"15min":1.016},"last":0.625}]},{"osd":5,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.48899999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.77700000000000002,"5min":0.95599999999999996,"15min":1.1319999999999999},"last":0.747},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72199999999999998,"15min":0.73399999999999999},"min":{"1min":0.44500000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.1659999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65500000000000003,"15min":0.66200000000000003},"min":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.39700000000000002},"max":{"1min":0.81699999999999995,"5min":0.97199999999999998,"15min":1.044},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68200000000000005,"15min":0.69699999999999995},"min":{"1min":0.502,"5min":0.48499999999999999,"15min":0.42899999999999999},"max":{"1min":0.95299999999999996,"5min":1.228,"15min":1.228},"last":0.78400000000000003}]}]},{"osd":5,"up_from":14,"seq":60129543253,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59844,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311996,"statfs":{"total":96636764160,"available":96575483904,"internally_reserved":0,"allocated":2351104,"data_stored":1189869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76600000000000001,"15min":0.753},"min":{"1min":0.52400000000000002,"5min":0.499,"15min":0.38600000000000001},"max":{"1min":0.97799999999999998,"5min":0.98199999999999998,"15min":1.034},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76900000000000002,"15min":0.76000000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63900000000000001}]},{"osd":1,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77200000000000002,"15min":0.76900000000000002},"min":{"1min":0.497,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78800000000000003,"15min":0.77600000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45000000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.50600000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.51400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77400000000000002,"15min":0.77500000000000002},"min":{"1min":0.56799999999999995,"5min":0.55300000000000005,"15min":0.47999999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77800000000000002,"15min":0.76900000000000002},"min":{"1min":0.59899999999999998,"5min":0.56200000000000006,"15min":0.51400000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.80500000000000005,"15min":0.79500000000000004},"min":{"1min":0.63,"5min":0.55200000000000005,"15min":0.54800000000000004},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.45500000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.64800000000000002,"15min":0.60499999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.434},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.66300000000000003,"15min":0.63100000000000001},"min":{"1min":0.50700000000000001,"5min":0.48599999999999999,"15min":0.42499999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.56999999999999995}]},{"osd":6,"last update":"Fri Aug 25 05:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.68999999999999995,"15min":0.66800000000000004},"min":{"1min":0.56699999999999995,"5min":0.47899999999999998,"15min":0.42199999999999999},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68799999999999994,"15min":0.68000000000000005},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.44900000000000001},"max":{"1min":0.97299999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Aug 25 05:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67300000000000004,"15min":0.65800000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42499999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.76000000000000001,"15min":0.73599999999999999},"min":{"1min":0.56100000000000005,"5min":0.52700000000000002,"15min":0.46000000000000002},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.754}]}]},{"osd":4,"up_from":14,"seq":60129543253,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29328,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342512,"statfs":{"total":96636764160,"available":96606732288,"internally_reserved":0,"allocated":2359296,"data_stored":1190509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.53000000000000003,"5min":0.49199999999999999,"15min":0.46700000000000003},"max":{"1min":0.92900000000000005,"5min":0.94099999999999995,"15min":1.054},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.54800000000000004,"5min":0.503,"15min":0.44700000000000001},"max":{"1min":0.90600000000000003,"5min":0.97799999999999998,"15min":1.02},"last":0.625}]},{"osd":1,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.46200000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.113},"last":0.82399999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.995,"5min":0.995,"15min":1.097},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76200000000000001,"15min":0.77600000000000002},"min":{"1min":0.55700000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.079},"last":0.67300000000000004}]},{"osd":3,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.57199999999999995,"5min":0.49099999999999999,"15min":0.47799999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78900000000000003,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.1559999999999999},"last":0.749}]},{"osd":5,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41499999999999998,"5min":0.377,"15min":0.36899999999999999},"max":{"1min":0.88,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":0.96799999999999997,"15min":0.98299999999999998},"last":0.89500000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.748,"15min":0.75},"min":{"1min":0.59899999999999998,"5min":0.49399999999999999,"15min":0.49199999999999999},"max":{"1min":0.99299999999999999,"5min":1.008,"15min":1.1240000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.98299999999999998,"5min":0.98799999999999999,"15min":1.0629999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.46400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83099999999999996,"5min":0.996,"15min":0.996},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.496,"5min":0.48799999999999999,"15min":0.47599999999999998},"max":{"1min":1.018,"5min":1.0389999999999999,"15min":1.0860000000000001},"last":0.76200000000000001}]}]},{"osd":3,"up_from":14,"seq":60129543253,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59856,"kb_used_data":2308,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311984,"statfs":{"total":96636764160,"available":96575471616,"internally_reserved":0,"allocated":2363392,"data_stored":1191961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.34100000000000003,"5min":0.33800000000000002,"15min":0.311},"max":{"1min":0.77400000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.38300000000000001,"5min":0.34300000000000003,"15min":0.313},"max":{"1min":0.72499999999999998,"5min":0.76800000000000002,"15min":0.92900000000000005},"last":0.51600000000000001}]},{"osd":1,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.31900000000000001},"max":{"1min":0.70499999999999996,"5min":0.71999999999999997,"15min":1.0780000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.625,"15min":0.625},"min":{"1min":0.47999999999999998,"5min":0.44800000000000001,"15min":0.40300000000000002},"max":{"1min":0.83999999999999997,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.42699999999999999},"max":{"1min":1.006,"5min":1.038,"15min":1.038},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.435,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.77100000000000002,"5min":0.79000000000000004,"15min":0.95799999999999996},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.04,"5min":1.109,"15min":1.123},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83999999999999997,"15min":0.82799999999999996},"min":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.52800000000000002},"max":{"1min":1.079,"5min":1.0980000000000001,"15min":1.286},"last":1.0880000000000001}]},{"osd":5,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81100000000000005,"15min":0.80300000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.47999999999999998},"max":{"1min":1.0169999999999999,"5min":1.1220000000000001,"15min":1.149},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82999999999999996,"15min":0.82899999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.085,"5min":1.1419999999999999,"15min":1.1879999999999999},"last":0.95499999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.86399999999999999,"15min":0.86499999999999999},"min":{"1min":0.68799999999999994,"5min":0.63400000000000001,"15min":0.59399999999999997},"max":{"1min":1.107,"5min":1.161,"15min":1.2410000000000001},"last":1.119},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.48999999999999999},"max":{"1min":1.0640000000000001,"5min":1.091,"15min":1.194},"last":1.1040000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.86699999999999999,"15min":0.876},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.60399999999999998},"max":{"1min":1.054,"5min":1.145,"15min":1.165},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.62,"5min":0.58299999999999996,"15min":0.51800000000000002},"max":{"1min":1.0580000000000001,"5min":1.141,"15min":1.147},"last":1.1479999999999999}]}]},{"osd":2,"up_from":14,"seq":60129543254,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59836,"kb_used_data":2288,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312004,"statfs":{"total":96636764160,"available":96575492096,"internally_reserved":0,"allocated":2342912,"data_stored":1189745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.64200000000000002,"5min":0.71799999999999997,"15min":0.81100000000000005},"last":0.314},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.746,"5min":0.85099999999999998,"15min":0.86099999999999999},"last":0.432}]},{"osd":1,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51500000000000001,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33300000000000002},"max":{"1min":0.66900000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.52800000000000002,"5min":0.51300000000000001,"15min":0.47799999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.89700000000000002},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.36899999999999999},"max":{"1min":0.745,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.59899999999999998},"min":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.41299999999999998},"max":{"1min":0.83699999999999997,"5min":0.89500000000000002,"15min":0.91200000000000003},"last":0.48599999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83299999999999996,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.59199999999999997,"15min":0.48699999999999999},"max":{"1min":1.0089999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.54600000000000004},"max":{"1min":1.0489999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83299999999999996,"15min":0.82599999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.51700000000000002},"max":{"1min":1.075,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.84099999999999997,"15min":0.85699999999999998},"min":{"1min":0.70699999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.98399999999999999,"5min":1.266,"15min":1.266},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84499999999999997,"15min":0.85899999999999999},"min":{"1min":0.68799999999999994,"5min":0.61599999999999999,"15min":0.61199999999999999},"max":{"1min":1.0680000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.89000000000000001,"15min":0.88300000000000001},"min":{"1min":0.65200000000000002,"5min":0.63100000000000001,"15min":0.58899999999999997},"max":{"1min":1.089,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.64400000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.095,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83399999999999996,"15min":0.83699999999999997},"min":{"1min":0.67700000000000005,"5min":0.60699999999999998,"15min":0.58399999999999996},"max":{"1min":1.0109999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.74199999999999999}]}]},{"osd":1,"up_from":14,"seq":60129543254,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41808,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330032,"statfs":{"total":96636764160,"available":96593952768,"internally_reserved":0,"allocated":2355200,"data_stored":1191357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48999999999999999,"15min":0.48499999999999999},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.75600000000000001,"15min":0.94399999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.33500000000000002},"max":{"1min":0.73799999999999999,"5min":0.80400000000000005,"15min":0.879},"last":0.44900000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.51200000000000001},"min":{"1min":0.437,"5min":0.36299999999999999,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.81399999999999995},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.58999999999999997},"min":{"1min":0.45200000000000001,"5min":0.41599999999999998,"15min":0.41199999999999998},"max":{"1min":0.80800000000000005,"5min":0.88300000000000001,"15min":0.91400000000000003},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66000000000000003,"15min":0.65300000000000002},"min":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.46100000000000002},"max":{"1min":0.90600000000000003,"5min":0.998,"15min":0.998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.51300000000000001,"5min":0.42499999999999999,"15min":0.39300000000000002},"max":{"1min":0.84699999999999998,"5min":0.88700000000000001,"15min":0.98699999999999999},"last":0.33900000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.81200000000000006,"15min":0.80300000000000005},"min":{"1min":0.59299999999999997,"5min":0.57399999999999995,"15min":0.48299999999999998},"max":{"1min":1.079,"5min":1.1559999999999999,"15min":1.2350000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.85699999999999998,"15min":0.84599999999999997},"min":{"1min":0.66800000000000004,"5min":0.63300000000000001,"15min":0.56999999999999995},"max":{"1min":1.147,"5min":1.268,"15min":1.268},"last":0.94799999999999995}]},{"osd":5,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81699999999999995,"15min":0.81899999999999995},"min":{"1min":0.58899999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.1950000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84799999999999998,"15min":0.83399999999999996},"min":{"1min":0.64600000000000002,"5min":0.57099999999999995,"15min":0.55300000000000005},"max":{"1min":1.1890000000000001,"5min":1.214,"15min":1.214},"last":0.97999999999999998}]},{"osd":6,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90000000000000002,"15min":0.878},"min":{"1min":0.72199999999999998,"5min":0.67800000000000005,"15min":0.59599999999999997},"max":{"1min":1.034,"5min":1.244,"15min":1.244},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85399999999999998,"15min":0.84599999999999997},"min":{"1min":0.64500000000000002,"5min":0.57999999999999996,"15min":0.55600000000000005},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.91800000000000004}]},{"osd":7,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84999999999999998,"15min":0.84699999999999998},"min":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.55600000000000005},"max":{"1min":1.149,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90800000000000003,"15min":0.89900000000000002},"min":{"1min":0.73699999999999999,"5min":0.69599999999999995,"15min":0.626},"max":{"1min":1.127,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.88600000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543253,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60428,"kb_used_data":2876,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311412,"statfs":{"total":96636764160,"available":96574885888,"internally_reserved":0,"allocated":2945024,"data_stored":1780217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.5,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66400000000000003,"5min":0.70799999999999996,"15min":1.2170000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.59099999999999997},"min":{"1min":0.46999999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.85999999999999999},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.33900000000000002},"max":{"1min":0.624,"5min":0.81799999999999995,"15min":0.91000000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41699999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71099999999999997,"5min":0.85199999999999998,"15min":0.86799999999999999},"last":0.41599999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51900000000000002,"15min":0.53200000000000003},"min":{"1min":0.378,"5min":0.34399999999999997,"15min":0.33700000000000002},"max":{"1min":0.67800000000000005,"5min":0.83499999999999996,"15min":1.855},"last":0.374},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61899999999999999,"15min":0.63},"min":{"1min":0.45200000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.69799999999999995,"5min":0.86599999999999999,"15min":1.3480000000000001},"last":0.443}]},{"osd":4,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86399999999999999,"15min":0.84799999999999998},"min":{"1min":0.63700000000000001,"5min":0.59999999999999998,"15min":0.53500000000000003},"max":{"1min":1.2210000000000001,"5min":1.2729999999999999,"15min":1.3799999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83099999999999996,"15min":0.84099999999999997},"min":{"1min":0.64600000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2729999999999999,"5min":1.2809999999999999,"15min":1.2849999999999999},"last":0.61299999999999999}]},{"osd":5,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81899999999999995,"15min":0.83299999999999996},"min":{"1min":0.57399999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0960000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.84799999999999998,"15min":0.85299999999999998},"min":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.996,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.256,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.68000000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.141,"5min":1.3560000000000001,"15min":1.5129999999999999},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.88900000000000001,"15min":0.88500000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0740000000000001,"5min":1.4339999999999999,"15min":1.5720000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84699999999999998,"15min":0.85699999999999998},"min":{"1min":0.65700000000000003,"5min":0.60099999999999998,"15min":0.58099999999999996},"max":{"1min":1.161,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.68799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:35:46.306 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-25T05:35:46.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.481+0000 7f671df03640 1 Processor -- start 2023-08-25T05:35:46.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.481+0000 7f671df03640 1 -- start start 2023-08-25T05:35:46.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.481+0000 7f671df03640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6718069c20 0x7f671815dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:46.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.481+0000 7f671df03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67180c8a40 0x7f67180c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:46.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.481+0000 7f671df03640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671815d260 con 0x7f671806a000 2023-08-25T05:35:46.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.481+0000 7f671df03640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6718159b70 con 0x7f6718069c20 2023-08-25T05:35:46.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.481+0000 7f671df03640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671806c570 con 0x7f67180c8a40 2023-08-25T05:35:46.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.485+0000 7f67177fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6718069c20 0x7f671815dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:46.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.485+0000 7f670ffff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f671806a000 0x7f671806bb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:33810/0 (socket says 172.21.15.55:33810) 2023-08-25T05:35:46.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.485+0000 7f670ffff640 1 -- 172.21.15.55:0/1325048994 learned_addr learned my addr 172.21.15.55:0/1325048994 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:46.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.485+0000 7f6717fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67180c8a40 0x7f67180c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:46.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.485+0000 7f67177fe640 1 -- 172.21.15.55:0/1325048994 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67180c8a40 msgr2=0x7f67180c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:46.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.485+0000 7f67177fe640 1 --2- 172.21.15.55:0/1325048994 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67180c8a40 0x7f67180c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.485+0000 7f67177fe640 1 -- 172.21.15.55:0/1325048994 >> v1:172.21.15.110:6789/0 conn(0x7f671806a000 legacy=0x7f671806bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:46.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.485+0000 7f67177fe640 1 -- 172.21.15.55:0/1325048994 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671806c850 con 0x7f6718069c20 2023-08-25T05:35:46.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.485+0000 7f6716ffd640 1 -- 172.21.15.55:0/1325048994 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2385648524 0 0) 0x7f671815d260 con 0x7f671806a000 2023-08-25T05:35:46.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.485+0000 7f6717fff640 1 --2- 172.21.15.55:0/1325048994 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67180c8a40 0x7f67180c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:35:46.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.485+0000 7f67177fe640 1 --2- 172.21.15.55:0/1325048994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6718069c20 0x7f671815dcb0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f67080097c0 tx=0x7f670801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36edff33aa641cad server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:46.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.485+0000 7f6716ffd640 1 -- 172.21.15.55:0/1325048994 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67080ab600 con 0x7f6718069c20 2023-08-25T05:35:46.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.485+0000 7f6716ffd640 1 -- 172.21.15.55:0/1325048994 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67080a7050 con 0x7f6718069c20 2023-08-25T05:35:46.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.485+0000 7f6716ffd640 1 -- 172.21.15.55:0/1325048994 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67080ab980 con 0x7f6718069c20 2023-08-25T05:35:46.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f671df03640 1 -- 172.21.15.55:0/1325048994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6718069c20 msgr2=0x7f671815dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:46.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f671df03640 1 --2- 172.21.15.55:0/1325048994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6718069c20 0x7f671815dcb0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f67080097c0 tx=0x7f670801c3c0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f671df03640 1 -- 172.21.15.55:0/1325048994 shutdown_connections 2023-08-25T05:35:46.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f671df03640 1 --2- 172.21.15.55:0/1325048994 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67180c8a40 0x7f67180c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f671df03640 1 --2- 172.21.15.55:0/1325048994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6718069c20 0x7f671815dcb0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f671df03640 1 -- 172.21.15.55:0/1325048994 >> 172.21.15.55:0/1325048994 conn(0x7f67180ce7f0 msgr2=0x7f67180cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:46.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f671df03640 1 -- 172.21.15.55:0/1325048994 shutdown_connections 2023-08-25T05:35:46.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f671df03640 1 -- 172.21.15.55:0/1325048994 wait complete. 2023-08-25T05:35:46.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f671df03640 1 Processor -- start 2023-08-25T05:35:46.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f671df03640 1 -- start start 2023-08-25T05:35:46.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f671df03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6718069c20 0x7f6718070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:46.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f671df03640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f671806a000 0x7f6718096bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:46.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f671df03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67180c8a40 0x7f67180c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:46.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f671df03640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671806bfa0 con 0x7f67180c8a40 2023-08-25T05:35:46.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f671df03640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6718097100 con 0x7f671806a000 2023-08-25T05:35:46.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f671df03640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67180ca630 con 0x7f6718069c20 2023-08-25T05:35:46.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f6717fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67180c8a40 0x7f67180c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:46.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f670ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f671806a000 0x7f6718096bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:46.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f67177fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6718069c20 0x7f6718070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:46.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f670ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f671806a000 0x7f6718096bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:46782/0 (socket says 172.21.15.55:46782) 2023-08-25T05:35:46.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.489+0000 7f670ffff640 1 -- 172.21.15.55:0/1029764429 learned_addr learned my addr 172.21.15.55:0/1029764429 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:46.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.493+0000 7f670ffff640 1 -- 172.21.15.55:0/1029764429 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6718069c20 msgr2=0x7f6718070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:46.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.493+0000 7f670ffff640 1 --2- 172.21.15.55:0/1029764429 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6718069c20 0x7f6718070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.493+0000 7f670ffff640 1 -- 172.21.15.55:0/1029764429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67180c8a40 msgr2=0x7f67180c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:46.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.493+0000 7f670ffff640 1 --2- 172.21.15.55:0/1029764429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67180c8a40 0x7f67180c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.493+0000 7f670ffff640 1 -- 172.21.15.55:0/1029764429 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6710009a70 con 0x7f671806a000 2023-08-25T05:35:46.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.493+0000 7f670ffff640 1 --2- 172.21.15.55:0/1029764429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f671806a000 0x7f6718096bc0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f67000011f0 tx=0x7f670000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:46.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.493+0000 7f6714ff9640 1 -- 172.21.15.55:0/1029764429 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67000074e0 con 0x7f671806a000 2023-08-25T05:35:46.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.493+0000 7f6714ff9640 1 -- 172.21.15.55:0/1029764429 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6700007640 con 0x7f671806a000 2023-08-25T05:35:46.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.493+0000 7f6714ff9640 1 -- 172.21.15.55:0/1029764429 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67000049f0 con 0x7f671806a000 2023-08-25T05:35:46.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.493+0000 7f671df03640 1 -- 172.21.15.55:0/1029764429 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6708009420 con 0x7f671806a000 2023-08-25T05:35:46.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.493+0000 7f671df03640 1 -- 172.21.15.55:0/1029764429 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67180ac470 con 0x7f671806a000 2023-08-25T05:35:46.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.493+0000 7f671df03640 1 -- 172.21.15.55:0/1029764429 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671804dbe0 con 0x7f671806a000 2023-08-25T05:35:46.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.493+0000 7f6714ff9640 1 -- 172.21.15.55:0/1029764429 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f6700004b50 con 0x7f671806a000 2023-08-25T05:35:46.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.497+0000 7f6714ff9640 1 --2- 172.21.15.55:0/1029764429 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f66f80657a0 0x7f66f8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:46.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.497+0000 7f6714ff9640 1 -- 172.21.15.55:0/1029764429 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f67000833f0 con 0x7f671806a000 2023-08-25T05:35:46.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.497+0000 7f67177fe640 1 --2- 172.21.15.55:0/1029764429 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f66f80657a0 0x7f66f8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:46.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.497+0000 7f67177fe640 1 --2- 172.21.15.55:0/1029764429 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f66f80657a0 0x7f66f8067c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f67080ad000 tx=0x7f67080a6000 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:46.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.497+0000 7f6714ff9640 1 -- 172.21.15.55:0/1029764429 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6700050d80 con 0x7f671806a000 2023-08-25T05:35:46.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.709+0000 7f671df03640 1 -- 172.21.15.55:0/1029764429 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f671806d780 con 0x7f671806a000 2023-08-25T05:35:46.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.709+0000 7f6714ff9640 1 -- 172.21.15.55:0/1029764429 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3215 (secure 0 0 0) 0x7f67000543a0 con 0x7f671806a000 2023-08-25T05:35:46.714 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:46.714 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5591,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":188,"num_osds":8,"num_up_osds":8,"osd_up_since":1692936167,"num_in_osds":8,"osd_in_since":1692936158,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592778,"bytes_used":406192128,"bytes_avail":772687921152,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":91,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":10785}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2023-08-25T05:35:28.137863+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-25T05:35:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.713+0000 7f671df03640 1 -- 172.21.15.55:0/1029764429 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f66f80657a0 msgr2=0x7f66f8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:46.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.713+0000 7f671df03640 1 --2- 172.21.15.55:0/1029764429 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f66f80657a0 0x7f66f8067c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f67080ad000 tx=0x7f67080a6000 comp rx=0 tx=0).stop 2023-08-25T05:35:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.713+0000 7f671df03640 1 -- 172.21.15.55:0/1029764429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f671806a000 msgr2=0x7f6718096bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.713+0000 7f671df03640 1 --2- 172.21.15.55:0/1029764429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f671806a000 0x7f6718096bc0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f67000011f0 tx=0x7f670000c8f0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.713+0000 7f671df03640 1 -- 172.21.15.55:0/1029764429 shutdown_connections 2023-08-25T05:35:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.713+0000 7f671df03640 1 --2- 172.21.15.55:0/1029764429 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f66f80657a0 0x7f66f8067c60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.713+0000 7f671df03640 1 --2- 172.21.15.55:0/1029764429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f67180c8a40 0x7f67180c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.713+0000 7f671df03640 1 --2- 172.21.15.55:0/1029764429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f671806a000 0x7f6718096bc0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.713+0000 7f671df03640 1 --2- 172.21.15.55:0/1029764429 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6718069c20 0x7f6718070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.713+0000 7f671df03640 1 -- 172.21.15.55:0/1029764429 >> 172.21.15.55:0/1029764429 conn(0x7f67180ce7f0 msgr2=0x7f6718070f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.713+0000 7f671df03640 1 -- 172.21.15.55:0/1029764429 shutdown_connections 2023-08-25T05:35:46.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.713+0000 7f671df03640 1 -- 172.21.15.55:0/1029764429 wait complete. 2023-08-25T05:35:46.735 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-25T05:35:46.735 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:35:46.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.873+0000 7f6c2ed59640 1 Processor -- start 2023-08-25T05:35:46.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.873+0000 7f6c2ed59640 1 -- start start 2023-08-25T05:35:46.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.877+0000 7f6c2ed59640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6c2815eba0 0x7f6c280b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:46.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.877+0000 7f6c2ed59640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c280ac3a0 con 0x7f6c280ceeb0 2023-08-25T05:35:46.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.877+0000 7f6c2ed59640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c280b1390 con 0x7f6c2815ef80 2023-08-25T05:35:46.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.877+0000 7f6c2ed59640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c280b1670 con 0x7f6c2815eba0 2023-08-25T05:35:46.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.877+0000 7f6c2caf5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6c2815eba0 0x7f6c280b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:46.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.877+0000 7f6c2d2f6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6c280ceeb0 0x7f6c280ab0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:51946/0 (socket says 172.21.15.55:51946) 2023-08-25T05:35:46.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.877+0000 7f6c2d2f6640 1 -- 172.21.15.55:0/4215392282 learned_addr learned my addr 172.21.15.55:0/4215392282 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:46.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.877+0000 7f6c2caf5640 1 -- 172.21.15.55:0/4215392282 >> v1:172.21.15.110:6789/0 conn(0x7f6c2815ef80 legacy=0x7f6c280ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:46.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.877+0000 7f6c2caf5640 1 -- 172.21.15.55:0/4215392282 >> v1:172.21.15.55:6789/0 conn(0x7f6c280ceeb0 legacy=0x7f6c280ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:46.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.877+0000 7f6c2caf5640 1 -- 172.21.15.55:0/4215392282 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c280b1950 con 0x7f6c2815eba0 2023-08-25T05:35:46.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.877+0000 7f6c2caf5640 1 --2- 172.21.15.55:0/4215392282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c2815eba0 0x7f6c280b2a40 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0097c0 tx=0x7f6c1c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7a56d273cc9b5a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:46.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.881+0000 7f6c277fe640 1 -- 172.21.15.55:0/4215392282 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c0ab650 con 0x7f6c2815eba0 2023-08-25T05:35:46.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.881+0000 7f6c277fe640 1 -- 172.21.15.55:0/4215392282 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1c0ab7b0 con 0x7f6c2815eba0 2023-08-25T05:35:46.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.881+0000 7f6c277fe640 1 -- 172.21.15.55:0/4215392282 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c0abb40 con 0x7f6c2815eba0 2023-08-25T05:35:46.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.881+0000 7f6c2ed59640 1 -- 172.21.15.55:0/4215392282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c2815eba0 msgr2=0x7f6c280b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:46.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.881+0000 7f6c2ed59640 1 --2- 172.21.15.55:0/4215392282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c2815eba0 0x7f6c280b2a40 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0097c0 tx=0x7f6c1c01c450 comp rx=0 tx=0).stop 2023-08-25T05:35:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.881+0000 7f6c2ed59640 1 -- 172.21.15.55:0/4215392282 shutdown_connections 2023-08-25T05:35:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.881+0000 7f6c2ed59640 1 --2- 172.21.15.55:0/4215392282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c2815eba0 0x7f6c280b2a40 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.881+0000 7f6c2ed59640 1 -- 172.21.15.55:0/4215392282 >> 172.21.15.55:0/4215392282 conn(0x7f6c28069d00 msgr2=0x7f6c2806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.881+0000 7f6c2ed59640 1 -- 172.21.15.55:0/4215392282 shutdown_connections 2023-08-25T05:35:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.881+0000 7f6c2ed59640 1 -- 172.21.15.55:0/4215392282 wait complete. 2023-08-25T05:35:46.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.881+0000 7f6c2ed59640 1 Processor -- start 2023-08-25T05:35:46.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.881+0000 7f6c2ed59640 1 -- start start 2023-08-25T05:35:46.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.881+0000 7f6c2ed59640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c280ceeb0 0x7f6c28153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:46.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.881+0000 7f6c2ed59640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c2815eba0 0x7f6c280c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:46.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.881+0000 7f6c2ed59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c2815ef80 0x7f6c281565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:46.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.881+0000 7f6c2ed59640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c28154150 con 0x7f6c2815ef80 2023-08-25T05:35:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.881+0000 7f6c2ed59640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c28154430 con 0x7f6c2815eba0 2023-08-25T05:35:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.881+0000 7f6c2ed59640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c28154710 con 0x7f6c280ceeb0 2023-08-25T05:35:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c2d2f6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c2815ef80 0x7f6c281565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c2d2f6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c2815ef80 0x7f6c281565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41256/0 (socket says 172.21.15.55:41256) 2023-08-25T05:35:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c2d2f6640 1 -- 172.21.15.55:0/851788823 learned_addr learned my addr 172.21.15.55:0/851788823 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c2caf5640 1 --2- 172.21.15.55:0/851788823 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c280ceeb0 0x7f6c28153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:46.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c27fff640 1 --2- 172.21.15.55:0/851788823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c2815eba0 0x7f6c280c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:46.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c2d2f6640 1 -- 172.21.15.55:0/851788823 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c280ceeb0 msgr2=0x7f6c28153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:46.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c2d2f6640 1 --2- 172.21.15.55:0/851788823 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c280ceeb0 0x7f6c28153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c2d2f6640 1 -- 172.21.15.55:0/851788823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c2815eba0 msgr2=0x7f6c280c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:46.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c2d2f6640 1 --2- 172.21.15.55:0/851788823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c2815eba0 0x7f6c280c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:46.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c2d2f6640 1 -- 172.21.15.55:0/851788823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c009420 con 0x7f6c2815ef80 2023-08-25T05:35:46.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c2caf5640 1 --2- 172.21.15.55:0/851788823 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c280ceeb0 0x7f6c28153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:46.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c27fff640 1 --2- 172.21.15.55:0/851788823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c2815eba0 0x7f6c280c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:46.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c2d2f6640 1 --2- 172.21.15.55:0/851788823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c2815ef80 0x7f6c281565d0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000caa0 tx=0x7f6c2000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c257fa640 1 -- 172.21.15.55:0/851788823 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2000ac00 con 0x7f6c2815ef80 2023-08-25T05:35:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c257fa640 1 -- 172.21.15.55:0/851788823 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2000ad60 con 0x7f6c2815ef80 2023-08-25T05:35:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c2ed59640 1 -- 172.21.15.55:0/851788823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c281549f0 con 0x7f6c2815ef80 2023-08-25T05:35:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c257fa640 1 -- 172.21.15.55:0/851788823 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20012600 con 0x7f6c2815ef80 2023-08-25T05:35:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c2ed59640 1 -- 172.21.15.55:0/851788823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c28097a90 con 0x7f6c2815ef80 2023-08-25T05:35:46.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c2ed59640 1 -- 172.21.15.55:0/851788823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2804dbe0 con 0x7f6c2815ef80 2023-08-25T05:35:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c257fa640 1 -- 172.21.15.55:0/851788823 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f6c20007070 con 0x7f6c2815ef80 2023-08-25T05:35:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c257fa640 1 --2- 172.21.15.55:0/851788823 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f6c0c0657d0 0x7f6c0c067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.885+0000 7f6c257fa640 1 -- 172.21.15.55:0/851788823 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6c20082cf0 con 0x7f6c2815ef80 2023-08-25T05:35:46.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.889+0000 7f6c2caf5640 1 --2- 172.21.15.55:0/851788823 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f6c0c0657d0 0x7f6c0c067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:46.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.889+0000 7f6c2caf5640 1 --2- 172.21.15.55:0/851788823 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f6c0c0657d0 0x7f6c0c067c90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0af000 tx=0x7f6c1c0a7000 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:46.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:46.889+0000 7f6c257fa640 1 -- 172.21.15.55:0/851788823 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6c20087070 con 0x7f6c2815ef80 2023-08-25T05:35:47.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:47.041+0000 7f6c2ed59640 1 -- 172.21.15.55:0/851788823 --> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6c281545a0 con 0x7f6c0c0657d0 2023-08-25T05:35:47.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:47.053+0000 7f6c257fa640 1 -- 172.21.15.55:0/851788823 <== mgr.9763 v2:172.21.15.110:6832/3764131781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311911 (secure 0 0 0) 0x7f6c281545a0 con 0x7f6c0c0657d0 2023-08-25T05:35:47.058 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:47.059 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:35:47.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:47.057+0000 7f6c2ed59640 1 -- 172.21.15.55:0/851788823 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f6c0c0657d0 msgr2=0x7f6c0c067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:47.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:47.057+0000 7f6c2ed59640 1 --2- 172.21.15.55:0/851788823 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f6c0c0657d0 0x7f6c0c067c90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0af000 tx=0x7f6c1c0a7000 comp rx=0 tx=0).stop 2023-08-25T05:35:47.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:47.057+0000 7f6c2ed59640 1 -- 172.21.15.55:0/851788823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c2815ef80 msgr2=0x7f6c281565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:47.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:47.057+0000 7f6c2ed59640 1 --2- 172.21.15.55:0/851788823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c2815ef80 0x7f6c281565d0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000caa0 tx=0x7f6c2000cf60 comp rx=0 tx=0).stop 2023-08-25T05:35:47.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:47.057+0000 7f6c2ed59640 1 -- 172.21.15.55:0/851788823 shutdown_connections 2023-08-25T05:35:47.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:47.057+0000 7f6c2ed59640 1 --2- 172.21.15.55:0/851788823 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f6c0c0657d0 0x7f6c0c067c90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:47.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:47.057+0000 7f6c2ed59640 1 --2- 172.21.15.55:0/851788823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c2815ef80 0x7f6c281565d0 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:47.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:47.057+0000 7f6c2ed59640 1 --2- 172.21.15.55:0/851788823 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c2815eba0 0x7f6c280c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:47.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:47.057+0000 7f6c2ed59640 1 --2- 172.21.15.55:0/851788823 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c280ceeb0 0x7f6c28153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:47.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:47.057+0000 7f6c2ed59640 1 -- 172.21.15.55:0/851788823 >> 172.21.15.55:0/851788823 conn(0x7f6c28069d00 msgr2=0x7f6c280ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:47.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:47.057+0000 7f6c2ed59640 1 -- 172.21.15.55:0/851788823 shutdown_connections 2023-08-25T05:35:47.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:47.057+0000 7f6c2ed59640 1 -- 172.21.15.55:0/851788823 wait complete. 2023-08-25T05:35:47.079 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-08-25T05:35:46.141986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1904,"num_read_kb":3991,"num_write":569,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3669,"ondisk_log_size":3669,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":396672,"kb_used_data":19528,"kb_used_omap":13,"kb_used_meta":377010,"kb_avail":754578048,"statfs":{"total":773094113280,"available":772687921152,"internally_reserved":0,"allocated":19996672,"data_stored":10703516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":386058328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001493"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400982+0000","last_change":"2023-08-25T05:35:41.419581+0000","last_active":"2023-08-25T05:35:42.400982+0000","last_peered":"2023-08-25T05:35:42.400982+0000","last_clean":"2023-08-25T05:35:42.400982+0000","last_became_active":"2023-08-25T05:35:41.418336+0000","last_became_peered":"2023-08-25T05:35:41.418336+0000","last_unstale":"2023-08-25T05:35:42.400982+0000","last_undegraded":"2023-08-25T05:35:42.400982+0000","last_fullsized":"2023-08-25T05:35:42.400982+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:00:11.264045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049225+0000","last_change":"2023-08-25T05:35:41.411853+0000","last_active":"2023-08-25T05:35:43.049225+0000","last_peered":"2023-08-25T05:35:43.049225+0000","last_clean":"2023-08-25T05:35:43.049225+0000","last_became_active":"2023-08-25T05:35:41.411511+0000","last_became_peered":"2023-08-25T05:35:41.411511+0000","last_unstale":"2023-08-25T05:35:43.049225+0000","last_undegraded":"2023-08-25T05:35:43.049225+0000","last_fullsized":"2023-08-25T05:35:43.049225+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:24.848516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.399993+0000","last_change":"2023-08-25T05:35:41.414546+0000","last_active":"2023-08-25T05:35:42.399993+0000","last_peered":"2023-08-25T05:35:42.399993+0000","last_clean":"2023-08-25T05:35:42.399993+0000","last_became_active":"2023-08-25T05:35:41.414262+0000","last_became_peered":"2023-08-25T05:35:41.414262+0000","last_unstale":"2023-08-25T05:35:42.399993+0000","last_undegraded":"2023-08-25T05:35:42.399993+0000","last_fullsized":"2023-08-25T05:35:42.399993+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:35.302712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400310+0000","last_change":"2023-08-25T05:35:41.412829+0000","last_active":"2023-08-25T05:35:42.400310+0000","last_peered":"2023-08-25T05:35:42.400310+0000","last_clean":"2023-08-25T05:35:42.400310+0000","last_became_active":"2023-08-25T05:35:41.412521+0000","last_became_peered":"2023-08-25T05:35:41.412521+0000","last_unstale":"2023-08-25T05:35:42.400310+0000","last_undegraded":"2023-08-25T05:35:42.400310+0000","last_fullsized":"2023-08-25T05:35:42.400310+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:50:53.533000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048390+0000","last_change":"2023-08-25T05:35:41.431979+0000","last_active":"2023-08-25T05:35:43.048390+0000","last_peered":"2023-08-25T05:35:43.048390+0000","last_clean":"2023-08-25T05:35:43.048390+0000","last_became_active":"2023-08-25T05:35:41.431538+0000","last_became_peered":"2023-08-25T05:35:41.431538+0000","last_unstale":"2023-08-25T05:35:43.048390+0000","last_undegraded":"2023-08-25T05:35:43.048390+0000","last_fullsized":"2023-08-25T05:35:43.048390+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:10:25.020976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048588+0000","last_change":"2023-08-25T05:35:41.408186+0000","last_active":"2023-08-25T05:35:43.048588+0000","last_peered":"2023-08-25T05:35:43.048588+0000","last_clean":"2023-08-25T05:35:43.048588+0000","last_became_active":"2023-08-25T05:35:41.407855+0000","last_became_peered":"2023-08-25T05:35:41.407855+0000","last_unstale":"2023-08-25T05:35:43.048588+0000","last_undegraded":"2023-08-25T05:35:43.048588+0000","last_fullsized":"2023-08-25T05:35:43.048588+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:59:53.689428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548022+0000","last_change":"2023-08-25T05:35:41.431845+0000","last_active":"2023-08-25T05:35:42.548022+0000","last_peered":"2023-08-25T05:35:42.548022+0000","last_clean":"2023-08-25T05:35:42.548022+0000","last_became_active":"2023-08-25T05:35:41.431572+0000","last_became_peered":"2023-08-25T05:35:41.431572+0000","last_unstale":"2023-08-25T05:35:42.548022+0000","last_undegraded":"2023-08-25T05:35:42.548022+0000","last_fullsized":"2023-08-25T05:35:42.548022+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:35:07.333341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.547938+0000","last_change":"2023-08-25T05:35:41.430379+0000","last_active":"2023-08-25T05:35:42.547938+0000","last_peered":"2023-08-25T05:35:42.547938+0000","last_clean":"2023-08-25T05:35:42.547938+0000","last_became_active":"2023-08-25T05:35:41.430122+0000","last_became_peered":"2023-08-25T05:35:41.430122+0000","last_unstale":"2023-08-25T05:35:42.547938+0000","last_undegraded":"2023-08-25T05:35:42.547938+0000","last_fullsized":"2023-08-25T05:35:42.547938+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:54.008665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548469+0000","last_change":"2023-08-25T05:35:41.424794+0000","last_active":"2023-08-25T05:35:42.548469+0000","last_peered":"2023-08-25T05:35:42.548469+0000","last_clean":"2023-08-25T05:35:42.548469+0000","last_became_active":"2023-08-25T05:35:41.424428+0000","last_became_peered":"2023-08-25T05:35:41.424428+0000","last_unstale":"2023-08-25T05:35:42.548469+0000","last_undegraded":"2023-08-25T05:35:42.548469+0000","last_fullsized":"2023-08-25T05:35:42.548469+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:23:45.020253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548359+0000","last_change":"2023-08-25T05:35:41.430334+0000","last_active":"2023-08-25T05:35:42.548359+0000","last_peered":"2023-08-25T05:35:42.548359+0000","last_clean":"2023-08-25T05:35:42.548359+0000","last_became_active":"2023-08-25T05:35:41.430075+0000","last_became_peered":"2023-08-25T05:35:41.430075+0000","last_unstale":"2023-08-25T05:35:42.548359+0000","last_undegraded":"2023-08-25T05:35:42.548359+0000","last_fullsized":"2023-08-25T05:35:42.548359+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:40:28.497330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049341+0000","last_change":"2023-08-25T05:35:41.414476+0000","last_active":"2023-08-25T05:35:43.049341+0000","last_peered":"2023-08-25T05:35:43.049341+0000","last_clean":"2023-08-25T05:35:43.049341+0000","last_became_active":"2023-08-25T05:35:41.414193+0000","last_became_peered":"2023-08-25T05:35:41.414193+0000","last_unstale":"2023-08-25T05:35:43.049341+0000","last_undegraded":"2023-08-25T05:35:43.049341+0000","last_fullsized":"2023-08-25T05:35:43.049341+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:36:23.028051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048762+0000","last_change":"2023-08-25T05:35:41.408499+0000","last_active":"2023-08-25T05:35:43.048762+0000","last_peered":"2023-08-25T05:35:43.048762+0000","last_clean":"2023-08-25T05:35:43.048762+0000","last_became_active":"2023-08-25T05:35:41.408216+0000","last_became_peered":"2023-08-25T05:35:41.408216+0000","last_unstale":"2023-08-25T05:35:43.048762+0000","last_undegraded":"2023-08-25T05:35:43.048762+0000","last_fullsized":"2023-08-25T05:35:43.048762+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:42:38.586904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400941+0000","last_change":"2023-08-25T05:35:41.407770+0000","last_active":"2023-08-25T05:35:42.400941+0000","last_peered":"2023-08-25T05:35:42.400941+0000","last_clean":"2023-08-25T05:35:42.400941+0000","last_became_active":"2023-08-25T05:35:41.407484+0000","last_became_peered":"2023-08-25T05:35:41.407484+0000","last_unstale":"2023-08-25T05:35:42.400941+0000","last_undegraded":"2023-08-25T05:35:42.400941+0000","last_fullsized":"2023-08-25T05:35:42.400941+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:55:53.541995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048272+0000","last_change":"2023-08-25T05:35:41.432870+0000","last_active":"2023-08-25T05:35:43.048272+0000","last_peered":"2023-08-25T05:35:43.048272+0000","last_clean":"2023-08-25T05:35:43.048272+0000","last_became_active":"2023-08-25T05:35:41.432603+0000","last_became_peered":"2023-08-25T05:35:41.432603+0000","last_unstale":"2023-08-25T05:35:43.048272+0000","last_undegraded":"2023-08-25T05:35:43.048272+0000","last_fullsized":"2023-08-25T05:35:43.048272+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:51:53.872466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048473+0000","last_change":"2023-08-25T05:35:41.424943+0000","last_active":"2023-08-25T05:35:43.048473+0000","last_peered":"2023-08-25T05:35:43.048473+0000","last_clean":"2023-08-25T05:35:43.048473+0000","last_became_active":"2023-08-25T05:35:41.424614+0000","last_became_peered":"2023-08-25T05:35:41.424614+0000","last_unstale":"2023-08-25T05:35:43.048473+0000","last_undegraded":"2023-08-25T05:35:43.048473+0000","last_fullsized":"2023-08-25T05:35:43.048473+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:22:40.321564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.399911+0000","last_change":"2023-08-25T05:35:41.412913+0000","last_active":"2023-08-25T05:35:42.399911+0000","last_peered":"2023-08-25T05:35:42.399911+0000","last_clean":"2023-08-25T05:35:42.399911+0000","last_became_active":"2023-08-25T05:35:41.412414+0000","last_became_peered":"2023-08-25T05:35:41.412414+0000","last_unstale":"2023-08-25T05:35:42.399911+0000","last_undegraded":"2023-08-25T05:35:42.399911+0000","last_fullsized":"2023-08-25T05:35:42.399911+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:05:07.052743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548582+0000","last_change":"2023-08-25T05:35:41.427643+0000","last_active":"2023-08-25T05:35:42.548582+0000","last_peered":"2023-08-25T05:35:42.548582+0000","last_clean":"2023-08-25T05:35:42.548582+0000","last_became_active":"2023-08-25T05:35:41.427278+0000","last_became_peered":"2023-08-25T05:35:41.427278+0000","last_unstale":"2023-08-25T05:35:42.548582+0000","last_undegraded":"2023-08-25T05:35:42.548582+0000","last_fullsized":"2023-08-25T05:35:42.548582+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:44:54.277771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400520+0000","last_change":"2023-08-25T05:35:41.426111+0000","last_active":"2023-08-25T05:35:42.400520+0000","last_peered":"2023-08-25T05:35:42.400520+0000","last_clean":"2023-08-25T05:35:42.400520+0000","last_became_active":"2023-08-25T05:35:41.425718+0000","last_became_peered":"2023-08-25T05:35:41.425718+0000","last_unstale":"2023-08-25T05:35:42.400520+0000","last_undegraded":"2023-08-25T05:35:42.400520+0000","last_fullsized":"2023-08-25T05:35:42.400520+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:03:36.587559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049436+0000","last_change":"2023-08-25T05:35:41.427598+0000","last_active":"2023-08-25T05:35:43.049436+0000","last_peered":"2023-08-25T05:35:43.049436+0000","last_clean":"2023-08-25T05:35:43.049436+0000","last_became_active":"2023-08-25T05:35:41.427281+0000","last_became_peered":"2023-08-25T05:35:41.427281+0000","last_unstale":"2023-08-25T05:35:43.049436+0000","last_undegraded":"2023-08-25T05:35:43.049436+0000","last_fullsized":"2023-08-25T05:35:43.049436+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:35:40.501781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048824+0000","last_change":"2023-08-25T05:35:41.424326+0000","last_active":"2023-08-25T05:35:43.048824+0000","last_peered":"2023-08-25T05:35:43.048824+0000","last_clean":"2023-08-25T05:35:43.048824+0000","last_became_active":"2023-08-25T05:35:41.424046+0000","last_became_peered":"2023-08-25T05:35:41.424046+0000","last_unstale":"2023-08-25T05:35:43.048824+0000","last_undegraded":"2023-08-25T05:35:43.048824+0000","last_fullsized":"2023-08-25T05:35:43.048824+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:41:25.322218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401070+0000","last_change":"2023-08-25T05:35:41.412969+0000","last_active":"2023-08-25T05:35:42.401070+0000","last_peered":"2023-08-25T05:35:42.401070+0000","last_clean":"2023-08-25T05:35:42.401070+0000","last_became_active":"2023-08-25T05:35:41.412710+0000","last_became_peered":"2023-08-25T05:35:41.412710+0000","last_unstale":"2023-08-25T05:35:42.401070+0000","last_undegraded":"2023-08-25T05:35:42.401070+0000","last_fullsized":"2023-08-25T05:35:42.401070+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:45:46.714226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048649+0000","last_change":"2023-08-25T05:35:41.412077+0000","last_active":"2023-08-25T05:35:43.048649+0000","last_peered":"2023-08-25T05:35:43.048649+0000","last_clean":"2023-08-25T05:35:43.048649+0000","last_became_active":"2023-08-25T05:35:41.411721+0000","last_became_peered":"2023-08-25T05:35:41.411721+0000","last_unstale":"2023-08-25T05:35:43.048649+0000","last_undegraded":"2023-08-25T05:35:43.048649+0000","last_fullsized":"2023-08-25T05:35:43.048649+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:00:53.558676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048121+0000","last_change":"2023-08-25T05:35:41.419838+0000","last_active":"2023-08-25T05:35:43.048121+0000","last_peered":"2023-08-25T05:35:43.048121+0000","last_clean":"2023-08-25T05:35:43.048121+0000","last_became_active":"2023-08-25T05:35:41.419571+0000","last_became_peered":"2023-08-25T05:35:41.419571+0000","last_unstale":"2023-08-25T05:35:43.048121+0000","last_undegraded":"2023-08-25T05:35:43.048121+0000","last_fullsized":"2023-08-25T05:35:43.048121+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:50:18.882576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400079+0000","last_change":"2023-08-25T05:35:41.412716+0000","last_active":"2023-08-25T05:35:42.400079+0000","last_peered":"2023-08-25T05:35:42.400079+0000","last_clean":"2023-08-25T05:35:42.400079+0000","last_became_active":"2023-08-25T05:35:41.412047+0000","last_became_peered":"2023-08-25T05:35:41.412047+0000","last_unstale":"2023-08-25T05:35:42.400079+0000","last_undegraded":"2023-08-25T05:35:42.400079+0000","last_fullsized":"2023-08-25T05:35:42.400079+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:50:22.152959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401342+0000","last_change":"2023-08-25T05:35:41.428492+0000","last_active":"2023-08-25T05:35:42.401342+0000","last_peered":"2023-08-25T05:35:42.401342+0000","last_clean":"2023-08-25T05:35:42.401342+0000","last_became_active":"2023-08-25T05:35:41.428216+0000","last_became_peered":"2023-08-25T05:35:41.428216+0000","last_unstale":"2023-08-25T05:35:42.401342+0000","last_undegraded":"2023-08-25T05:35:42.401342+0000","last_fullsized":"2023-08-25T05:35:42.401342+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:35:18.637705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048600+0000","last_change":"2023-08-25T05:35:41.412937+0000","last_active":"2023-08-25T05:35:43.048600+0000","last_peered":"2023-08-25T05:35:43.048600+0000","last_clean":"2023-08-25T05:35:43.048600+0000","last_became_active":"2023-08-25T05:35:41.412668+0000","last_became_peered":"2023-08-25T05:35:41.412668+0000","last_unstale":"2023-08-25T05:35:43.048600+0000","last_undegraded":"2023-08-25T05:35:43.048600+0000","last_fullsized":"2023-08-25T05:35:43.048600+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:31:54.977441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049386+0000","last_change":"2023-08-25T05:35:41.412222+0000","last_active":"2023-08-25T05:35:43.049386+0000","last_peered":"2023-08-25T05:35:43.049386+0000","last_clean":"2023-08-25T05:35:43.049386+0000","last_became_active":"2023-08-25T05:35:41.411835+0000","last_became_peered":"2023-08-25T05:35:41.411835+0000","last_unstale":"2023-08-25T05:35:43.049386+0000","last_undegraded":"2023-08-25T05:35:43.049386+0000","last_fullsized":"2023-08-25T05:35:43.049386+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:25:21.536344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400906+0000","last_change":"2023-08-25T05:35:41.413829+0000","last_active":"2023-08-25T05:35:42.400906+0000","last_peered":"2023-08-25T05:35:42.400906+0000","last_clean":"2023-08-25T05:35:42.400906+0000","last_became_active":"2023-08-25T05:35:41.413239+0000","last_became_peered":"2023-08-25T05:35:41.413239+0000","last_unstale":"2023-08-25T05:35:42.400906+0000","last_undegraded":"2023-08-25T05:35:42.400906+0000","last_fullsized":"2023-08-25T05:35:42.400906+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:53:11.533167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048999+0000","last_change":"2023-08-25T05:35:41.427634+0000","last_active":"2023-08-25T05:35:43.048999+0000","last_peered":"2023-08-25T05:35:43.048999+0000","last_clean":"2023-08-25T05:35:43.048999+0000","last_became_active":"2023-08-25T05:35:41.427293+0000","last_became_peered":"2023-08-25T05:35:41.427293+0000","last_unstale":"2023-08-25T05:35:43.048999+0000","last_undegraded":"2023-08-25T05:35:43.048999+0000","last_fullsized":"2023-08-25T05:35:43.048999+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:05.376425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400243+0000","last_change":"2023-08-25T05:35:41.414509+0000","last_active":"2023-08-25T05:35:42.400243+0000","last_peered":"2023-08-25T05:35:42.400243+0000","last_clean":"2023-08-25T05:35:42.400243+0000","last_became_active":"2023-08-25T05:35:41.414047+0000","last_became_peered":"2023-08-25T05:35:41.414047+0000","last_unstale":"2023-08-25T05:35:42.400243+0000","last_undegraded":"2023-08-25T05:35:42.400243+0000","last_fullsized":"2023-08-25T05:35:42.400243+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:55:34.140935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048621+0000","last_change":"2023-08-25T05:35:41.419820+0000","last_active":"2023-08-25T05:35:43.048621+0000","last_peered":"2023-08-25T05:35:43.048621+0000","last_clean":"2023-08-25T05:35:43.048621+0000","last_became_active":"2023-08-25T05:35:41.419511+0000","last_became_peered":"2023-08-25T05:35:41.419511+0000","last_unstale":"2023-08-25T05:35:43.048621+0000","last_undegraded":"2023-08-25T05:35:43.048621+0000","last_fullsized":"2023-08-25T05:35:43.048621+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:50:17.425904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.399994+0000","last_change":"2023-08-25T05:35:41.415137+0000","last_active":"2023-08-25T05:35:42.399994+0000","last_peered":"2023-08-25T05:35:42.399994+0000","last_clean":"2023-08-25T05:35:42.399994+0000","last_became_active":"2023-08-25T05:35:41.414859+0000","last_became_peered":"2023-08-25T05:35:41.414859+0000","last_unstale":"2023-08-25T05:35:42.399994+0000","last_undegraded":"2023-08-25T05:35:42.399994+0000","last_fullsized":"2023-08-25T05:35:42.399994+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:48:33.827393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049054+0000","last_change":"2023-08-25T05:35:41.407983+0000","last_active":"2023-08-25T05:35:43.049054+0000","last_peered":"2023-08-25T05:35:43.049054+0000","last_clean":"2023-08-25T05:35:43.049054+0000","last_became_active":"2023-08-25T05:35:41.407473+0000","last_became_peered":"2023-08-25T05:35:41.407473+0000","last_unstale":"2023-08-25T05:35:43.049054+0000","last_undegraded":"2023-08-25T05:35:43.049054+0000","last_fullsized":"2023-08-25T05:35:43.049054+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:34:08.979155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"187'4","reported_seq":17,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401071+0000","last_change":"2023-08-25T05:35:40.411419+0000","last_active":"2023-08-25T05:35:42.401071+0000","last_peered":"2023-08-25T05:35:42.401071+0000","last_clean":"2023-08-25T05:35:42.401071+0000","last_became_active":"2023-08-25T05:35:40.411110+0000","last_became_peered":"2023-08-25T05:35:40.411110+0000","last_unstale":"2023-08-25T05:35:42.401071+0000","last_undegraded":"2023-08-25T05:35:42.401071+0000","last_fullsized":"2023-08-25T05:35:42.401071+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:49:18.231466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400781+0000","last_change":"2023-08-25T05:35:41.415906+0000","last_active":"2023-08-25T05:35:42.400781+0000","last_peered":"2023-08-25T05:35:42.400781+0000","last_clean":"2023-08-25T05:35:42.400781+0000","last_became_active":"2023-08-25T05:35:41.415626+0000","last_became_peered":"2023-08-25T05:35:41.415626+0000","last_unstale":"2023-08-25T05:35:42.400781+0000","last_undegraded":"2023-08-25T05:35:42.400781+0000","last_fullsized":"2023-08-25T05:35:42.400781+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:54.772065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"187'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049141+0000","last_change":"2023-08-25T05:35:40.407365+0000","last_active":"2023-08-25T05:35:43.049141+0000","last_peered":"2023-08-25T05:35:43.049141+0000","last_clean":"2023-08-25T05:35:43.049141+0000","last_became_active":"2023-08-25T05:35:40.407011+0000","last_became_peered":"2023-08-25T05:35:40.407011+0000","last_unstale":"2023-08-25T05:35:43.049141+0000","last_undegraded":"2023-08-25T05:35:43.049141+0000","last_fullsized":"2023-08-25T05:35:43.049141+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:47.692846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048273+0000","last_change":"2023-08-25T05:35:41.422436+0000","last_active":"2023-08-25T05:35:43.048273+0000","last_peered":"2023-08-25T05:35:43.048273+0000","last_clean":"2023-08-25T05:35:43.048273+0000","last_became_active":"2023-08-25T05:35:41.422159+0000","last_became_peered":"2023-08-25T05:35:41.422159+0000","last_unstale":"2023-08-25T05:35:43.048273+0000","last_undegraded":"2023-08-25T05:35:43.048273+0000","last_fullsized":"2023-08-25T05:35:43.048273+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:00:11.497954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049544+0000","last_change":"2023-08-25T05:35:40.413501+0000","last_active":"2023-08-25T05:35:43.049544+0000","last_peered":"2023-08-25T05:35:43.049544+0000","last_clean":"2023-08-25T05:35:43.049544+0000","last_became_active":"2023-08-25T05:35:40.413184+0000","last_became_peered":"2023-08-25T05:35:40.413184+0000","last_unstale":"2023-08-25T05:35:43.049544+0000","last_undegraded":"2023-08-25T05:35:43.049544+0000","last_fullsized":"2023-08-25T05:35:43.049544+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:16:49.296973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049009+0000","last_change":"2023-08-25T05:35:41.412402+0000","last_active":"2023-08-25T05:35:43.049009+0000","last_peered":"2023-08-25T05:35:43.049009+0000","last_clean":"2023-08-25T05:35:43.049009+0000","last_became_active":"2023-08-25T05:35:41.412061+0000","last_became_peered":"2023-08-25T05:35:41.412061+0000","last_unstale":"2023-08-25T05:35:43.049009+0000","last_undegraded":"2023-08-25T05:35:43.049009+0000","last_fullsized":"2023-08-25T05:35:43.049009+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:40:30.940804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048737+0000","last_change":"2023-08-25T05:35:40.411432+0000","last_active":"2023-08-25T05:35:43.048737+0000","last_peered":"2023-08-25T05:35:43.048737+0000","last_clean":"2023-08-25T05:35:43.048737+0000","last_became_active":"2023-08-25T05:35:40.411091+0000","last_became_peered":"2023-08-25T05:35:40.411091+0000","last_unstale":"2023-08-25T05:35:43.048737+0000","last_undegraded":"2023-08-25T05:35:43.048737+0000","last_fullsized":"2023-08-25T05:35:43.048737+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:59:55.528663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548083+0000","last_change":"2023-08-25T05:35:41.430252+0000","last_active":"2023-08-25T05:35:42.548083+0000","last_peered":"2023-08-25T05:35:42.548083+0000","last_clean":"2023-08-25T05:35:42.548083+0000","last_became_active":"2023-08-25T05:35:41.429891+0000","last_became_peered":"2023-08-25T05:35:41.429891+0000","last_unstale":"2023-08-25T05:35:42.548083+0000","last_undegraded":"2023-08-25T05:35:42.548083+0000","last_fullsized":"2023-08-25T05:35:42.548083+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:23.764839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"187'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548148+0000","last_change":"2023-08-25T05:35:40.403861+0000","last_active":"2023-08-25T05:35:42.548148+0000","last_peered":"2023-08-25T05:35:42.548148+0000","last_clean":"2023-08-25T05:35:42.548148+0000","last_became_active":"2023-08-25T05:35:40.403587+0000","last_became_peered":"2023-08-25T05:35:40.403587+0000","last_unstale":"2023-08-25T05:35:42.548148+0000","last_undegraded":"2023-08-25T05:35:42.548148+0000","last_fullsized":"2023-08-25T05:35:42.548148+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:44:31.114715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048686+0000","last_change":"2023-08-25T05:35:41.425495+0000","last_active":"2023-08-25T05:35:43.048686+0000","last_peered":"2023-08-25T05:35:43.048686+0000","last_clean":"2023-08-25T05:35:43.048686+0000","last_became_active":"2023-08-25T05:35:41.425189+0000","last_became_peered":"2023-08-25T05:35:41.425189+0000","last_unstale":"2023-08-25T05:35:43.048686+0000","last_undegraded":"2023-08-25T05:35:43.048686+0000","last_fullsized":"2023-08-25T05:35:43.048686+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:50:14.964099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"187'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048376+0000","last_change":"2023-08-25T05:35:40.411408+0000","last_active":"2023-08-25T05:35:43.048376+0000","last_peered":"2023-08-25T05:35:43.048376+0000","last_clean":"2023-08-25T05:35:43.048376+0000","last_became_active":"2023-08-25T05:35:40.411086+0000","last_became_peered":"2023-08-25T05:35:40.411086+0000","last_unstale":"2023-08-25T05:35:43.048376+0000","last_undegraded":"2023-08-25T05:35:43.048376+0000","last_fullsized":"2023-08-25T05:35:43.048376+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:36:40.352529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048744+0000","last_change":"2023-08-25T05:35:41.412432+0000","last_active":"2023-08-25T05:35:43.048744+0000","last_peered":"2023-08-25T05:35:43.048744+0000","last_clean":"2023-08-25T05:35:43.048744+0000","last_became_active":"2023-08-25T05:35:41.412128+0000","last_became_peered":"2023-08-25T05:35:41.412128+0000","last_unstale":"2023-08-25T05:35:43.048744+0000","last_undegraded":"2023-08-25T05:35:43.048744+0000","last_fullsized":"2023-08-25T05:35:43.048744+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:19.276006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048391+0000","last_change":"2023-08-25T05:35:40.417142+0000","last_active":"2023-08-25T05:35:43.048391+0000","last_peered":"2023-08-25T05:35:43.048391+0000","last_clean":"2023-08-25T05:35:43.048391+0000","last_became_active":"2023-08-25T05:35:40.416873+0000","last_became_peered":"2023-08-25T05:35:40.416873+0000","last_unstale":"2023-08-25T05:35:43.048391+0000","last_undegraded":"2023-08-25T05:35:43.048391+0000","last_fullsized":"2023-08-25T05:35:43.048391+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:05:14.678680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401009+0000","last_change":"2023-08-25T05:35:41.411759+0000","last_active":"2023-08-25T05:35:42.401009+0000","last_peered":"2023-08-25T05:35:42.401009+0000","last_clean":"2023-08-25T05:35:42.401009+0000","last_became_active":"2023-08-25T05:35:41.411476+0000","last_became_peered":"2023-08-25T05:35:41.411476+0000","last_unstale":"2023-08-25T05:35:42.401009+0000","last_undegraded":"2023-08-25T05:35:42.401009+0000","last_fullsized":"2023-08-25T05:35:42.401009+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:36:46.795428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548062+0000","last_change":"2023-08-25T05:35:40.410462+0000","last_active":"2023-08-25T05:35:42.548062+0000","last_peered":"2023-08-25T05:35:42.548062+0000","last_clean":"2023-08-25T05:35:42.548062+0000","last_became_active":"2023-08-25T05:35:40.410176+0000","last_became_peered":"2023-08-25T05:35:40.410176+0000","last_unstale":"2023-08-25T05:35:42.548062+0000","last_undegraded":"2023-08-25T05:35:42.548062+0000","last_fullsized":"2023-08-25T05:35:42.548062+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:52:55.173377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.547973+0000","last_change":"2023-08-25T05:35:41.431789+0000","last_active":"2023-08-25T05:35:42.547973+0000","last_peered":"2023-08-25T05:35:42.547973+0000","last_clean":"2023-08-25T05:35:42.547973+0000","last_became_active":"2023-08-25T05:35:41.431517+0000","last_became_peered":"2023-08-25T05:35:41.431517+0000","last_unstale":"2023-08-25T05:35:42.547973+0000","last_undegraded":"2023-08-25T05:35:42.547973+0000","last_fullsized":"2023-08-25T05:35:42.547973+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:43:00.132802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"187'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401396+0000","last_change":"2023-08-25T05:35:40.414259+0000","last_active":"2023-08-25T05:35:42.401396+0000","last_peered":"2023-08-25T05:35:42.401396+0000","last_clean":"2023-08-25T05:35:42.401396+0000","last_became_active":"2023-08-25T05:35:40.413974+0000","last_became_peered":"2023-08-25T05:35:40.413974+0000","last_unstale":"2023-08-25T05:35:42.401396+0000","last_undegraded":"2023-08-25T05:35:42.401396+0000","last_fullsized":"2023-08-25T05:35:42.401396+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:05.843267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400586+0000","last_change":"2023-08-25T05:35:41.410857+0000","last_active":"2023-08-25T05:35:42.400586+0000","last_peered":"2023-08-25T05:35:42.400586+0000","last_clean":"2023-08-25T05:35:42.400586+0000","last_became_active":"2023-08-25T05:35:41.410591+0000","last_became_peered":"2023-08-25T05:35:41.410591+0000","last_unstale":"2023-08-25T05:35:42.400586+0000","last_undegraded":"2023-08-25T05:35:42.400586+0000","last_fullsized":"2023-08-25T05:35:42.400586+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:16:32.942553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548406+0000","last_change":"2023-08-25T05:35:40.413149+0000","last_active":"2023-08-25T05:35:42.548406+0000","last_peered":"2023-08-25T05:35:42.548406+0000","last_clean":"2023-08-25T05:35:42.548406+0000","last_became_active":"2023-08-25T05:35:40.412876+0000","last_became_peered":"2023-08-25T05:35:40.412876+0000","last_unstale":"2023-08-25T05:35:42.548406+0000","last_undegraded":"2023-08-25T05:35:42.548406+0000","last_fullsized":"2023-08-25T05:35:42.548406+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:30:29.914434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048569+0000","last_change":"2023-08-25T05:35:41.410345+0000","last_active":"2023-08-25T05:35:43.048569+0000","last_peered":"2023-08-25T05:35:43.048569+0000","last_clean":"2023-08-25T05:35:43.048569+0000","last_became_active":"2023-08-25T05:35:41.410074+0000","last_became_peered":"2023-08-25T05:35:41.410074+0000","last_unstale":"2023-08-25T05:35:43.048569+0000","last_undegraded":"2023-08-25T05:35:43.048569+0000","last_fullsized":"2023-08-25T05:35:43.048569+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:12.232022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"187'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049246+0000","last_change":"2023-08-25T05:35:40.405785+0000","last_active":"2023-08-25T05:35:43.049246+0000","last_peered":"2023-08-25T05:35:43.049246+0000","last_clean":"2023-08-25T05:35:43.049246+0000","last_became_active":"2023-08-25T05:35:40.405505+0000","last_became_peered":"2023-08-25T05:35:40.405505+0000","last_unstale":"2023-08-25T05:35:43.049246+0000","last_undegraded":"2023-08-25T05:35:43.049246+0000","last_fullsized":"2023-08-25T05:35:43.049246+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:54:33.803778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049269+0000","last_change":"2023-08-25T05:35:41.413795+0000","last_active":"2023-08-25T05:35:43.049269+0000","last_peered":"2023-08-25T05:35:43.049269+0000","last_clean":"2023-08-25T05:35:43.049269+0000","last_became_active":"2023-08-25T05:35:41.413488+0000","last_became_peered":"2023-08-25T05:35:41.413488+0000","last_unstale":"2023-08-25T05:35:43.049269+0000","last_undegraded":"2023-08-25T05:35:43.049269+0000","last_fullsized":"2023-08-25T05:35:43.049269+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:47:54.794261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548198+0000","last_change":"2023-08-25T05:35:40.406720+0000","last_active":"2023-08-25T05:35:42.548198+0000","last_peered":"2023-08-25T05:35:42.548198+0000","last_clean":"2023-08-25T05:35:42.548198+0000","last_became_active":"2023-08-25T05:35:40.405992+0000","last_became_peered":"2023-08-25T05:35:40.405992+0000","last_unstale":"2023-08-25T05:35:42.548198+0000","last_undegraded":"2023-08-25T05:35:42.548198+0000","last_fullsized":"2023-08-25T05:35:42.548198+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:38.103093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400937+0000","last_change":"2023-08-25T05:35:41.413997+0000","last_active":"2023-08-25T05:35:42.400937+0000","last_peered":"2023-08-25T05:35:42.400937+0000","last_clean":"2023-08-25T05:35:42.400937+0000","last_became_active":"2023-08-25T05:35:41.413579+0000","last_became_peered":"2023-08-25T05:35:41.413579+0000","last_unstale":"2023-08-25T05:35:42.400937+0000","last_undegraded":"2023-08-25T05:35:42.400937+0000","last_fullsized":"2023-08-25T05:35:42.400937+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:00:20.374889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049013+0000","last_change":"2023-08-25T05:35:40.410371+0000","last_active":"2023-08-25T05:35:43.049013+0000","last_peered":"2023-08-25T05:35:43.049013+0000","last_clean":"2023-08-25T05:35:43.049013+0000","last_became_active":"2023-08-25T05:35:40.410055+0000","last_became_peered":"2023-08-25T05:35:40.410055+0000","last_unstale":"2023-08-25T05:35:43.049013+0000","last_undegraded":"2023-08-25T05:35:43.049013+0000","last_fullsized":"2023-08-25T05:35:43.049013+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:19:41.424451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049229+0000","last_change":"2023-08-25T05:35:41.434853+0000","last_active":"2023-08-25T05:35:43.049229+0000","last_peered":"2023-08-25T05:35:43.049229+0000","last_clean":"2023-08-25T05:35:43.049229+0000","last_became_active":"2023-08-25T05:35:41.434480+0000","last_became_peered":"2023-08-25T05:35:41.434480+0000","last_unstale":"2023-08-25T05:35:43.049229+0000","last_undegraded":"2023-08-25T05:35:43.049229+0000","last_fullsized":"2023-08-25T05:35:43.049229+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:16:56.444696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049107+0000","last_change":"2023-08-25T05:35:40.408621+0000","last_active":"2023-08-25T05:35:43.049107+0000","last_peered":"2023-08-25T05:35:43.049107+0000","last_clean":"2023-08-25T05:35:43.049107+0000","last_became_active":"2023-08-25T05:35:40.408273+0000","last_became_peered":"2023-08-25T05:35:40.408273+0000","last_unstale":"2023-08-25T05:35:43.049107+0000","last_undegraded":"2023-08-25T05:35:43.049107+0000","last_fullsized":"2023-08-25T05:35:43.049107+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:27:05.606309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049051+0000","last_change":"2023-08-25T05:35:41.426812+0000","last_active":"2023-08-25T05:35:43.049051+0000","last_peered":"2023-08-25T05:35:43.049051+0000","last_clean":"2023-08-25T05:35:43.049051+0000","last_became_active":"2023-08-25T05:35:41.426533+0000","last_became_peered":"2023-08-25T05:35:41.426533+0000","last_unstale":"2023-08-25T05:35:43.049051+0000","last_undegraded":"2023-08-25T05:35:43.049051+0000","last_fullsized":"2023-08-25T05:35:43.049051+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:15:29.376118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048456+0000","last_change":"2023-08-25T05:35:40.411511+0000","last_active":"2023-08-25T05:35:43.048456+0000","last_peered":"2023-08-25T05:35:43.048456+0000","last_clean":"2023-08-25T05:35:43.048456+0000","last_became_active":"2023-08-25T05:35:40.411197+0000","last_became_peered":"2023-08-25T05:35:40.411197+0000","last_unstale":"2023-08-25T05:35:43.048456+0000","last_undegraded":"2023-08-25T05:35:43.048456+0000","last_fullsized":"2023-08-25T05:35:43.048456+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:51:47.975073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049174+0000","last_change":"2023-08-25T05:35:41.420762+0000","last_active":"2023-08-25T05:35:43.049174+0000","last_peered":"2023-08-25T05:35:43.049174+0000","last_clean":"2023-08-25T05:35:43.049174+0000","last_became_active":"2023-08-25T05:35:41.420331+0000","last_became_peered":"2023-08-25T05:35:41.420331+0000","last_unstale":"2023-08-25T05:35:43.049174+0000","last_undegraded":"2023-08-25T05:35:43.049174+0000","last_fullsized":"2023-08-25T05:35:43.049174+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:18:21.935963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049078+0000","last_change":"2023-08-25T05:35:40.414188+0000","last_active":"2023-08-25T05:35:43.049078+0000","last_peered":"2023-08-25T05:35:43.049078+0000","last_clean":"2023-08-25T05:35:43.049078+0000","last_became_active":"2023-08-25T05:35:40.413850+0000","last_became_peered":"2023-08-25T05:35:40.413850+0000","last_unstale":"2023-08-25T05:35:43.049078+0000","last_undegraded":"2023-08-25T05:35:43.049078+0000","last_fullsized":"2023-08-25T05:35:43.049078+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:37:33.219813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048401+0000","last_change":"2023-08-25T05:35:41.418394+0000","last_active":"2023-08-25T05:35:43.048401+0000","last_peered":"2023-08-25T05:35:43.048401+0000","last_clean":"2023-08-25T05:35:43.048401+0000","last_became_active":"2023-08-25T05:35:41.417373+0000","last_became_peered":"2023-08-25T05:35:41.417373+0000","last_unstale":"2023-08-25T05:35:43.048401+0000","last_undegraded":"2023-08-25T05:35:43.048401+0000","last_fullsized":"2023-08-25T05:35:43.048401+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:01:58.749724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049167+0000","last_change":"2023-08-25T05:35:40.406707+0000","last_active":"2023-08-25T05:35:43.049167+0000","last_peered":"2023-08-25T05:35:43.049167+0000","last_clean":"2023-08-25T05:35:43.049167+0000","last_became_active":"2023-08-25T05:35:40.406429+0000","last_became_peered":"2023-08-25T05:35:40.406429+0000","last_unstale":"2023-08-25T05:35:43.049167+0000","last_undegraded":"2023-08-25T05:35:43.049167+0000","last_fullsized":"2023-08-25T05:35:43.049167+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:00:42.395339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548102+0000","last_change":"2023-08-25T05:35:41.424871+0000","last_active":"2023-08-25T05:35:42.548102+0000","last_peered":"2023-08-25T05:35:42.548102+0000","last_clean":"2023-08-25T05:35:42.548102+0000","last_became_active":"2023-08-25T05:35:41.424548+0000","last_became_peered":"2023-08-25T05:35:41.424548+0000","last_unstale":"2023-08-25T05:35:42.548102+0000","last_undegraded":"2023-08-25T05:35:42.548102+0000","last_fullsized":"2023-08-25T05:35:42.548102+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:59.984677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401329+0000","last_change":"2023-08-25T05:35:40.419160+0000","last_active":"2023-08-25T05:35:42.401329+0000","last_peered":"2023-08-25T05:35:42.401329+0000","last_clean":"2023-08-25T05:35:42.401329+0000","last_became_active":"2023-08-25T05:35:40.418867+0000","last_became_peered":"2023-08-25T05:35:40.418867+0000","last_unstale":"2023-08-25T05:35:42.401329+0000","last_undegraded":"2023-08-25T05:35:42.401329+0000","last_fullsized":"2023-08-25T05:35:42.401329+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:25:25.921734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048686+0000","last_change":"2023-08-25T05:35:41.412777+0000","last_active":"2023-08-25T05:35:43.048686+0000","last_peered":"2023-08-25T05:35:43.048686+0000","last_clean":"2023-08-25T05:35:43.048686+0000","last_became_active":"2023-08-25T05:35:41.412478+0000","last_became_peered":"2023-08-25T05:35:41.412478+0000","last_unstale":"2023-08-25T05:35:43.048686+0000","last_undegraded":"2023-08-25T05:35:43.048686+0000","last_fullsized":"2023-08-25T05:35:43.048686+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:52:28.055587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401243+0000","last_change":"2023-08-25T05:35:40.414212+0000","last_active":"2023-08-25T05:35:42.401243+0000","last_peered":"2023-08-25T05:35:42.401243+0000","last_clean":"2023-08-25T05:35:42.401243+0000","last_became_active":"2023-08-25T05:35:40.413942+0000","last_became_peered":"2023-08-25T05:35:40.413942+0000","last_unstale":"2023-08-25T05:35:42.401243+0000","last_undegraded":"2023-08-25T05:35:42.401243+0000","last_fullsized":"2023-08-25T05:35:42.401243+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:44:01.225110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548104+0000","last_change":"2023-08-25T05:35:41.425451+0000","last_active":"2023-08-25T05:35:42.548104+0000","last_peered":"2023-08-25T05:35:42.548104+0000","last_clean":"2023-08-25T05:35:42.548104+0000","last_became_active":"2023-08-25T05:35:41.425115+0000","last_became_peered":"2023-08-25T05:35:41.425115+0000","last_unstale":"2023-08-25T05:35:42.548104+0000","last_undegraded":"2023-08-25T05:35:42.548104+0000","last_fullsized":"2023-08-25T05:35:42.548104+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:52:03.049176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048877+0000","last_change":"2023-08-25T05:35:40.414225+0000","last_active":"2023-08-25T05:35:43.048877+0000","last_peered":"2023-08-25T05:35:43.048877+0000","last_clean":"2023-08-25T05:35:43.048877+0000","last_became_active":"2023-08-25T05:35:40.413875+0000","last_became_peered":"2023-08-25T05:35:40.413875+0000","last_unstale":"2023-08-25T05:35:43.048877+0000","last_undegraded":"2023-08-25T05:35:43.048877+0000","last_fullsized":"2023-08-25T05:35:43.048877+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:55:52.258432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400446+0000","last_change":"2023-08-25T05:35:41.420349+0000","last_active":"2023-08-25T05:35:42.400446+0000","last_peered":"2023-08-25T05:35:42.400446+0000","last_clean":"2023-08-25T05:35:42.400446+0000","last_became_active":"2023-08-25T05:35:41.420070+0000","last_became_peered":"2023-08-25T05:35:41.420070+0000","last_unstale":"2023-08-25T05:35:42.400446+0000","last_undegraded":"2023-08-25T05:35:42.400446+0000","last_fullsized":"2023-08-25T05:35:42.400446+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:43.798231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400377+0000","last_change":"2023-08-25T05:35:40.401833+0000","last_active":"2023-08-25T05:35:42.400377+0000","last_peered":"2023-08-25T05:35:42.400377+0000","last_clean":"2023-08-25T05:35:42.400377+0000","last_became_active":"2023-08-25T05:35:40.401410+0000","last_became_peered":"2023-08-25T05:35:40.401410+0000","last_unstale":"2023-08-25T05:35:42.400377+0000","last_undegraded":"2023-08-25T05:35:42.400377+0000","last_fullsized":"2023-08-25T05:35:42.400377+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:38:18.310667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049523+0000","last_change":"2023-08-25T05:35:41.411460+0000","last_active":"2023-08-25T05:35:43.049523+0000","last_peered":"2023-08-25T05:35:43.049523+0000","last_clean":"2023-08-25T05:35:43.049523+0000","last_became_active":"2023-08-25T05:35:41.411139+0000","last_became_peered":"2023-08-25T05:35:41.411139+0000","last_unstale":"2023-08-25T05:35:43.049523+0000","last_undegraded":"2023-08-25T05:35:43.049523+0000","last_fullsized":"2023-08-25T05:35:43.049523+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:05:13.838540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401009+0000","last_change":"2023-08-25T05:35:40.415437+0000","last_active":"2023-08-25T05:35:42.401009+0000","last_peered":"2023-08-25T05:35:42.401009+0000","last_clean":"2023-08-25T05:35:42.401009+0000","last_became_active":"2023-08-25T05:35:40.415149+0000","last_became_peered":"2023-08-25T05:35:40.415149+0000","last_unstale":"2023-08-25T05:35:42.401009+0000","last_undegraded":"2023-08-25T05:35:42.401009+0000","last_fullsized":"2023-08-25T05:35:42.401009+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:41:44.542923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401251+0000","last_change":"2023-08-25T05:35:41.411974+0000","last_active":"2023-08-25T05:35:42.401251+0000","last_peered":"2023-08-25T05:35:42.401251+0000","last_clean":"2023-08-25T05:35:42.401251+0000","last_became_active":"2023-08-25T05:35:41.411700+0000","last_became_peered":"2023-08-25T05:35:41.411700+0000","last_unstale":"2023-08-25T05:35:42.401251+0000","last_undegraded":"2023-08-25T05:35:42.401251+0000","last_fullsized":"2023-08-25T05:35:42.401251+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:17.173963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048775+0000","last_change":"2023-08-25T05:35:40.413516+0000","last_active":"2023-08-25T05:35:43.048775+0000","last_peered":"2023-08-25T05:35:43.048775+0000","last_clean":"2023-08-25T05:35:43.048775+0000","last_became_active":"2023-08-25T05:35:40.413218+0000","last_became_peered":"2023-08-25T05:35:40.413218+0000","last_unstale":"2023-08-25T05:35:43.048775+0000","last_undegraded":"2023-08-25T05:35:43.048775+0000","last_fullsized":"2023-08-25T05:35:43.048775+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:12:16.082782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048882+0000","last_change":"2023-08-25T05:35:41.424427+0000","last_active":"2023-08-25T05:35:43.048882+0000","last_peered":"2023-08-25T05:35:43.048882+0000","last_clean":"2023-08-25T05:35:43.048882+0000","last_became_active":"2023-08-25T05:35:41.424098+0000","last_became_peered":"2023-08-25T05:35:41.424098+0000","last_unstale":"2023-08-25T05:35:43.048882+0000","last_undegraded":"2023-08-25T05:35:43.048882+0000","last_fullsized":"2023-08-25T05:35:43.048882+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:59:39.438262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.047989+0000","last_change":"2023-08-25T05:35:40.412563+0000","last_active":"2023-08-25T05:35:43.047989+0000","last_peered":"2023-08-25T05:35:43.047989+0000","last_clean":"2023-08-25T05:35:43.047989+0000","last_became_active":"2023-08-25T05:35:40.412276+0000","last_became_peered":"2023-08-25T05:35:40.412276+0000","last_unstale":"2023-08-25T05:35:43.047989+0000","last_undegraded":"2023-08-25T05:35:43.047989+0000","last_fullsized":"2023-08-25T05:35:43.047989+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:46:35.252558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048607+0000","last_change":"2023-08-25T05:35:41.418774+0000","last_active":"2023-08-25T05:35:43.048607+0000","last_peered":"2023-08-25T05:35:43.048607+0000","last_clean":"2023-08-25T05:35:43.048607+0000","last_became_active":"2023-08-25T05:35:41.418472+0000","last_became_peered":"2023-08-25T05:35:41.418472+0000","last_unstale":"2023-08-25T05:35:43.048607+0000","last_undegraded":"2023-08-25T05:35:43.048607+0000","last_fullsized":"2023-08-25T05:35:43.048607+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:19.217529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401211+0000","last_change":"2023-08-25T05:35:40.418728+0000","last_active":"2023-08-25T05:35:42.401211+0000","last_peered":"2023-08-25T05:35:42.401211+0000","last_clean":"2023-08-25T05:35:42.401211+0000","last_became_active":"2023-08-25T05:35:40.418445+0000","last_became_peered":"2023-08-25T05:35:40.418445+0000","last_unstale":"2023-08-25T05:35:42.401211+0000","last_undegraded":"2023-08-25T05:35:42.401211+0000","last_fullsized":"2023-08-25T05:35:42.401211+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:07:02.816830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"176'3631","reported_seq":4546,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049223+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:35:43.049223+0000","last_peered":"2023-08-25T05:35:43.049223+0000","last_clean":"2023-08-25T05:35:43.049223+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:35:43.049223+0000","last_undegraded":"2023-08-25T05:35:43.049223+0000","last_fullsized":"2023-08-25T05:35:43.049223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3631,"log_dups_size":0,"ondisk_log_size":3631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:38:35.230013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1904,"num_read_kb":3991,"num_write":525,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":333,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049370+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:35:43.049370+0000","last_peered":"2023-08-25T05:35:43.049370+0000","last_clean":"2023-08-25T05:35:43.049370+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:35:43.049370+0000","last_undegraded":"2023-08-25T05:35:43.049370+0000","last_fullsized":"2023-08-25T05:35:43.049370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:21:40.444029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400759+0000","last_change":"2023-08-25T05:35:41.425051+0000","last_active":"2023-08-25T05:35:42.400759+0000","last_peered":"2023-08-25T05:35:42.400759+0000","last_clean":"2023-08-25T05:35:42.400759+0000","last_became_active":"2023-08-25T05:35:41.424778+0000","last_became_peered":"2023-08-25T05:35:41.424778+0000","last_unstale":"2023-08-25T05:35:42.400759+0000","last_undegraded":"2023-08-25T05:35:42.400759+0000","last_fullsized":"2023-08-25T05:35:42.400759+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:57:11.814103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"187'3","reported_seq":16,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400733+0000","last_change":"2023-08-25T05:35:40.409842+0000","last_active":"2023-08-25T05:35:42.400733+0000","last_peered":"2023-08-25T05:35:42.400733+0000","last_clean":"2023-08-25T05:35:42.400733+0000","last_became_active":"2023-08-25T05:35:40.409487+0000","last_became_peered":"2023-08-25T05:35:40.409487+0000","last_unstale":"2023-08-25T05:35:42.400733+0000","last_undegraded":"2023-08-25T05:35:42.400733+0000","last_fullsized":"2023-08-25T05:35:42.400733+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:27:01.220692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":329,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049187+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:35:43.049187+0000","last_peered":"2023-08-25T05:35:43.049187+0000","last_clean":"2023-08-25T05:35:43.049187+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:35:43.049187+0000","last_undegraded":"2023-08-25T05:35:43.049187+0000","last_fullsized":"2023-08-25T05:35:43.049187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:04.380893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048384+0000","last_change":"2023-08-25T05:35:41.419498+0000","last_active":"2023-08-25T05:35:43.048384+0000","last_peered":"2023-08-25T05:35:43.048384+0000","last_clean":"2023-08-25T05:35:43.048384+0000","last_became_active":"2023-08-25T05:35:41.419216+0000","last_became_peered":"2023-08-25T05:35:41.419216+0000","last_unstale":"2023-08-25T05:35:43.048384+0000","last_undegraded":"2023-08-25T05:35:43.048384+0000","last_fullsized":"2023-08-25T05:35:43.048384+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:32:41.108174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"187'6","reported_seq":19,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401062+0000","last_change":"2023-08-25T05:35:40.418772+0000","last_active":"2023-08-25T05:35:42.401062+0000","last_peered":"2023-08-25T05:35:42.401062+0000","last_clean":"2023-08-25T05:35:42.401062+0000","last_became_active":"2023-08-25T05:35:40.418526+0000","last_became_peered":"2023-08-25T05:35:40.418526+0000","last_unstale":"2023-08-25T05:35:42.401062+0000","last_undegraded":"2023-08-25T05:35:42.401062+0000","last_fullsized":"2023-08-25T05:35:42.401062+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:15.554963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":337,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048546+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:35:43.048546+0000","last_peered":"2023-08-25T05:35:43.048546+0000","last_clean":"2023-08-25T05:35:43.048546+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:35:43.048546+0000","last_undegraded":"2023-08-25T05:35:43.048546+0000","last_fullsized":"2023-08-25T05:35:43.048546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:15:17.631751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048863+0000","last_change":"2023-08-25T05:35:41.408501+0000","last_active":"2023-08-25T05:35:43.048863+0000","last_peered":"2023-08-25T05:35:43.048863+0000","last_clean":"2023-08-25T05:35:43.048863+0000","last_became_active":"2023-08-25T05:35:41.408179+0000","last_became_peered":"2023-08-25T05:35:41.408179+0000","last_unstale":"2023-08-25T05:35:43.048863+0000","last_undegraded":"2023-08-25T05:35:43.048863+0000","last_fullsized":"2023-08-25T05:35:43.048863+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:13.001472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401279+0000","last_change":"2023-08-25T05:35:40.416043+0000","last_active":"2023-08-25T05:35:42.401279+0000","last_peered":"2023-08-25T05:35:42.401279+0000","last_clean":"2023-08-25T05:35:42.401279+0000","last_became_active":"2023-08-25T05:35:40.415749+0000","last_became_peered":"2023-08-25T05:35:40.415749+0000","last_unstale":"2023-08-25T05:35:42.401279+0000","last_undegraded":"2023-08-25T05:35:42.401279+0000","last_fullsized":"2023-08-25T05:35:42.401279+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:52.123478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":333,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048658+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:35:43.048658+0000","last_peered":"2023-08-25T05:35:43.048658+0000","last_clean":"2023-08-25T05:35:43.048658+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:35:43.048658+0000","last_undegraded":"2023-08-25T05:35:43.048658+0000","last_fullsized":"2023-08-25T05:35:43.048658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:11:09.193027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049448+0000","last_change":"2023-08-25T05:35:41.417745+0000","last_active":"2023-08-25T05:35:43.049448+0000","last_peered":"2023-08-25T05:35:43.049448+0000","last_clean":"2023-08-25T05:35:43.049448+0000","last_became_active":"2023-08-25T05:35:41.417432+0000","last_became_peered":"2023-08-25T05:35:41.417432+0000","last_unstale":"2023-08-25T05:35:43.049448+0000","last_undegraded":"2023-08-25T05:35:43.049448+0000","last_fullsized":"2023-08-25T05:35:43.049448+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:45:36.691656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048717+0000","last_change":"2023-08-25T05:35:40.407963+0000","last_active":"2023-08-25T05:35:43.048717+0000","last_peered":"2023-08-25T05:35:43.048717+0000","last_clean":"2023-08-25T05:35:43.048717+0000","last_became_active":"2023-08-25T05:35:40.407674+0000","last_became_peered":"2023-08-25T05:35:40.407674+0000","last_unstale":"2023-08-25T05:35:43.048717+0000","last_undegraded":"2023-08-25T05:35:43.048717+0000","last_fullsized":"2023-08-25T05:35:43.048717+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:25:39.852933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":363,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548360+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:35:42.548360+0000","last_peered":"2023-08-25T05:35:42.548360+0000","last_clean":"2023-08-25T05:35:42.548360+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:35:42.548360+0000","last_undegraded":"2023-08-25T05:35:42.548360+0000","last_fullsized":"2023-08-25T05:35:42.548360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:50:24.550266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048744+0000","last_change":"2023-08-25T05:35:41.421488+0000","last_active":"2023-08-25T05:35:43.048744+0000","last_peered":"2023-08-25T05:35:43.048744+0000","last_clean":"2023-08-25T05:35:43.048744+0000","last_became_active":"2023-08-25T05:35:41.420950+0000","last_became_peered":"2023-08-25T05:35:41.420950+0000","last_unstale":"2023-08-25T05:35:43.048744+0000","last_undegraded":"2023-08-25T05:35:43.048744+0000","last_fullsized":"2023-08-25T05:35:43.048744+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:19:08.128371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"187'8","reported_seq":21,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548059+0000","last_change":"2023-08-25T05:35:40.408649+0000","last_active":"2023-08-25T05:35:42.548059+0000","last_peered":"2023-08-25T05:35:42.548059+0000","last_clean":"2023-08-25T05:35:42.548059+0000","last_became_active":"2023-08-25T05:35:40.408384+0000","last_became_peered":"2023-08-25T05:35:40.408384+0000","last_unstale":"2023-08-25T05:35:42.548059+0000","last_undegraded":"2023-08-25T05:35:42.548059+0000","last_fullsized":"2023-08-25T05:35:42.548059+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:28:41.500292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":327,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049550+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:35:43.049550+0000","last_peered":"2023-08-25T05:35:43.049550+0000","last_clean":"2023-08-25T05:35:43.049550+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:35:43.049550+0000","last_undegraded":"2023-08-25T05:35:43.049550+0000","last_fullsized":"2023-08-25T05:35:43.049550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:56:16.988841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400258+0000","last_change":"2023-08-25T05:35:41.415881+0000","last_active":"2023-08-25T05:35:42.400258+0000","last_peered":"2023-08-25T05:35:42.400258+0000","last_clean":"2023-08-25T05:35:42.400258+0000","last_became_active":"2023-08-25T05:35:41.415589+0000","last_became_peered":"2023-08-25T05:35:41.415589+0000","last_unstale":"2023-08-25T05:35:42.400258+0000","last_undegraded":"2023-08-25T05:35:42.400258+0000","last_fullsized":"2023-08-25T05:35:42.400258+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:09:10.011656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048870+0000","last_change":"2023-08-25T05:35:40.411989+0000","last_active":"2023-08-25T05:35:43.048870+0000","last_peered":"2023-08-25T05:35:43.048870+0000","last_clean":"2023-08-25T05:35:43.048870+0000","last_became_active":"2023-08-25T05:35:40.411679+0000","last_became_peered":"2023-08-25T05:35:40.411679+0000","last_unstale":"2023-08-25T05:35:43.048870+0000","last_undegraded":"2023-08-25T05:35:43.048870+0000","last_fullsized":"2023-08-25T05:35:43.048870+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:27:24.581704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":361,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548567+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:35:42.548567+0000","last_peered":"2023-08-25T05:35:42.548567+0000","last_clean":"2023-08-25T05:35:42.548567+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:35:42.548567+0000","last_undegraded":"2023-08-25T05:35:42.548567+0000","last_fullsized":"2023-08-25T05:35:42.548567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:00:51.036225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548368+0000","last_change":"2023-08-25T05:35:41.425099+0000","last_active":"2023-08-25T05:35:42.548368+0000","last_peered":"2023-08-25T05:35:42.548368+0000","last_clean":"2023-08-25T05:35:42.548368+0000","last_became_active":"2023-08-25T05:35:41.424715+0000","last_became_peered":"2023-08-25T05:35:41.424715+0000","last_unstale":"2023-08-25T05:35:42.548368+0000","last_undegraded":"2023-08-25T05:35:42.548368+0000","last_fullsized":"2023-08-25T05:35:42.548368+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:38:13.442695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401003+0000","last_change":"2023-08-25T05:35:40.411718+0000","last_active":"2023-08-25T05:35:42.401003+0000","last_peered":"2023-08-25T05:35:42.401003+0000","last_clean":"2023-08-25T05:35:42.401003+0000","last_became_active":"2023-08-25T05:35:40.411291+0000","last_became_peered":"2023-08-25T05:35:40.411291+0000","last_unstale":"2023-08-25T05:35:42.401003+0000","last_undegraded":"2023-08-25T05:35:42.401003+0000","last_fullsized":"2023-08-25T05:35:42.401003+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:54:55.227629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":383,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400626+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:35:42.400626+0000","last_peered":"2023-08-25T05:35:42.400626+0000","last_clean":"2023-08-25T05:35:42.400626+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:35:42.400626+0000","last_undegraded":"2023-08-25T05:35:42.400626+0000","last_fullsized":"2023-08-25T05:35:42.400626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:32:21.310345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1904,"num_read_kb":3991,"num_write":525,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3631,"ondisk_log_size":3631,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510550,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52096,"kb_used_data":2868,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319744,"statfs":{"total":96636764160,"available":96583417856,"internally_reserved":0,"allocated":2936832,"data_stored":1780113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.745,"15min":0.74199999999999999},"min":{"1min":0.60099999999999998,"5min":0.44400000000000001,"15min":0.40999999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0169999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.53900000000000003,"5min":0.48199999999999998,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.52700000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.751},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.59299999999999997,"5min":0.47999999999999998,"15min":0.46800000000000003},"max":{"1min":0.97999999999999998,"5min":0.98099999999999998,"15min":1.026},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.747,"15min":0.753},"min":{"1min":0.54700000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95899999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76900000000000002,"15min":0.76400000000000001},"min":{"1min":0.58899999999999997,"5min":0.55500000000000005,"15min":0.53600000000000003},"max":{"1min":0.97299999999999998,"5min":1.0329999999999999,"15min":1.0840000000000001},"last":0.70099999999999996}]},{"osd":3,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.57999999999999996,"5min":0.53300000000000003,"15min":0.51700000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.49399999999999999},"max":{"1min":0.93600000000000005,"5min":1.0600000000000001,"15min":1.0680000000000001},"last":0.79500000000000004}]},{"osd":4,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.44,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.032},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90400000000000003,"5min":1.163,"15min":1.163},"last":0.54100000000000004}]},{"osd":5,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60699999999999998,"15min":0.623},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.36599999999999999},"max":{"1min":0.77000000000000002,"5min":0.997,"15min":1.1120000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65900000000000003,"15min":0.66900000000000004},"min":{"1min":0.47499999999999998,"5min":0.435,"15min":0.42699999999999999},"max":{"1min":0.873,"5min":1.04,"15min":1.0640000000000001},"last":0.73599999999999999}]},{"osd":6,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.499,"15min":0.47999999999999998},"max":{"1min":0.94499999999999995,"5min":1.028,"15min":1.0960000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68700000000000006,"15min":0.69699999999999995},"min":{"1min":0.47299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95999999999999996,"5min":1.119,"15min":1.119},"last":0.71999999999999997}]}]},{"osd":6,"up_from":15,"seq":64424510550,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33476,"kb_used_data":2288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338364,"statfs":{"total":96636764160,"available":96602484736,"internally_reserved":0,"allocated":2342912,"data_stored":1189745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.753,"15min":0.751},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93300000000000005,"5min":0.99099999999999999,"15min":1.0449999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.40100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91700000000000004,"5min":1.0389999999999999,"15min":1.1699999999999999},"last":0.51800000000000002}]},{"osd":1,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76000000000000001,"15min":0.76300000000000001},"min":{"1min":0.55000000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.89500000000000002,"5min":0.97299999999999998,"15min":1.1559999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.74299999999999999,"15min":0.76000000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89900000000000002,"5min":1.022,"15min":1.1299999999999999},"last":0.76900000000000002}]},{"osd":2,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.77000000000000002,"15min":0.79100000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97699999999999998,"5min":1.0760000000000001,"15min":1.0780000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.51900000000000002},"max":{"1min":0.94499999999999995,"5min":1.0669999999999999,"15min":1.1599999999999999},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.46400000000000002},"max":{"1min":0.90500000000000003,"5min":1.0049999999999999,"15min":1.208},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92500000000000004,"5min":1.054,"15min":1.236},"last":0.59699999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.33200000000000002},"max":{"1min":0.80400000000000005,"5min":0.84899999999999998,"15min":1.018},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.44700000000000001,"5min":0.40500000000000003,"15min":0.35499999999999998},"max":{"1min":0.74299999999999999,"5min":0.85799999999999998,"15min":1.016},"last":0.625}]},{"osd":5,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.48899999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.77700000000000002,"5min":0.95599999999999996,"15min":1.1319999999999999},"last":0.747},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72199999999999998,"15min":0.73399999999999999},"min":{"1min":0.44500000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.1659999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65500000000000003,"15min":0.66200000000000003},"min":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.39700000000000002},"max":{"1min":0.81699999999999995,"5min":0.97199999999999998,"15min":1.044},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68200000000000005,"15min":0.69699999999999995},"min":{"1min":0.502,"5min":0.48499999999999999,"15min":0.42899999999999999},"max":{"1min":0.95299999999999996,"5min":1.228,"15min":1.228},"last":0.78400000000000003}]}]},{"osd":5,"up_from":14,"seq":60129543253,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59844,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311996,"statfs":{"total":96636764160,"available":96575483904,"internally_reserved":0,"allocated":2351104,"data_stored":1189869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76600000000000001,"15min":0.753},"min":{"1min":0.52400000000000002,"5min":0.499,"15min":0.38600000000000001},"max":{"1min":0.97799999999999998,"5min":0.98199999999999998,"15min":1.034},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76900000000000002,"15min":0.76000000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63900000000000001}]},{"osd":1,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77200000000000002,"15min":0.76900000000000002},"min":{"1min":0.497,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78800000000000003,"15min":0.77600000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45000000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.50600000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.51400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77400000000000002,"15min":0.77500000000000002},"min":{"1min":0.56799999999999995,"5min":0.55300000000000005,"15min":0.47999999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77800000000000002,"15min":0.76900000000000002},"min":{"1min":0.59899999999999998,"5min":0.56200000000000006,"15min":0.51400000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.80500000000000005,"15min":0.79500000000000004},"min":{"1min":0.63,"5min":0.55200000000000005,"15min":0.54800000000000004},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.45500000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.64800000000000002,"15min":0.60499999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.434},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.66300000000000003,"15min":0.63100000000000001},"min":{"1min":0.50700000000000001,"5min":0.48599999999999999,"15min":0.42499999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.56999999999999995}]},{"osd":6,"last update":"Fri Aug 25 05:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.68999999999999995,"15min":0.66800000000000004},"min":{"1min":0.56699999999999995,"5min":0.47899999999999998,"15min":0.42199999999999999},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68799999999999994,"15min":0.68000000000000005},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.44900000000000001},"max":{"1min":0.97299999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Aug 25 05:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67300000000000004,"15min":0.65800000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42499999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.76000000000000001,"15min":0.73599999999999999},"min":{"1min":0.56100000000000005,"5min":0.52700000000000002,"15min":0.46000000000000002},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.754}]}]},{"osd":4,"up_from":14,"seq":60129543253,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29328,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342512,"statfs":{"total":96636764160,"available":96606732288,"internally_reserved":0,"allocated":2359296,"data_stored":1190509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.53000000000000003,"5min":0.49199999999999999,"15min":0.46700000000000003},"max":{"1min":0.92900000000000005,"5min":0.94099999999999995,"15min":1.054},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.54800000000000004,"5min":0.503,"15min":0.44700000000000001},"max":{"1min":0.90600000000000003,"5min":0.97799999999999998,"15min":1.02},"last":0.625}]},{"osd":1,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.46200000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.113},"last":0.82399999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.995,"5min":0.995,"15min":1.097},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76200000000000001,"15min":0.77600000000000002},"min":{"1min":0.55700000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.079},"last":0.67300000000000004}]},{"osd":3,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.57199999999999995,"5min":0.49099999999999999,"15min":0.47799999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78900000000000003,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.1559999999999999},"last":0.749}]},{"osd":5,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41499999999999998,"5min":0.377,"15min":0.36899999999999999},"max":{"1min":0.88,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":0.96799999999999997,"15min":0.98299999999999998},"last":0.89500000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.748,"15min":0.75},"min":{"1min":0.59899999999999998,"5min":0.49399999999999999,"15min":0.49199999999999999},"max":{"1min":0.99299999999999999,"5min":1.008,"15min":1.1240000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.98299999999999998,"5min":0.98799999999999999,"15min":1.0629999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.46400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83099999999999996,"5min":0.996,"15min":0.996},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.496,"5min":0.48799999999999999,"15min":0.47599999999999998},"max":{"1min":1.018,"5min":1.0389999999999999,"15min":1.0860000000000001},"last":0.76200000000000001}]}]},{"osd":3,"up_from":14,"seq":60129543253,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59856,"kb_used_data":2308,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311984,"statfs":{"total":96636764160,"available":96575471616,"internally_reserved":0,"allocated":2363392,"data_stored":1191961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46999999999999997,"15min":0.46700000000000003},"min":{"1min":0.34100000000000003,"5min":0.33800000000000002,"15min":0.311},"max":{"1min":0.77400000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.53100000000000003},"min":{"1min":0.38300000000000001,"5min":0.34300000000000003,"15min":0.313},"max":{"1min":0.72499999999999998,"5min":0.76800000000000002,"15min":0.92900000000000005},"last":0.51600000000000001}]},{"osd":1,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.31900000000000001},"max":{"1min":0.70499999999999996,"5min":0.71999999999999997,"15min":1.0780000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.625,"15min":0.625},"min":{"1min":0.47999999999999998,"5min":0.44800000000000001,"15min":0.40300000000000002},"max":{"1min":0.83999999999999997,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.47999999999999998,"5min":0.45500000000000002,"15min":0.42699999999999999},"max":{"1min":1.006,"5min":1.038,"15min":1.038},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57699999999999996,"15min":0.56999999999999995},"min":{"1min":0.435,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.77100000000000002,"5min":0.79000000000000004,"15min":0.95799999999999996},"last":0.64200000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.04,"5min":1.109,"15min":1.123},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83999999999999997,"15min":0.82799999999999996},"min":{"1min":0.63400000000000001,"5min":0.63100000000000001,"15min":0.52800000000000002},"max":{"1min":1.079,"5min":1.0980000000000001,"15min":1.286},"last":1.0880000000000001}]},{"osd":5,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.81100000000000005,"15min":0.80300000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.47999999999999998},"max":{"1min":1.0169999999999999,"5min":1.1220000000000001,"15min":1.149},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82999999999999996,"15min":0.82899999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.085,"5min":1.1419999999999999,"15min":1.1879999999999999},"last":0.95499999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.86399999999999999,"15min":0.86499999999999999},"min":{"1min":0.68799999999999994,"5min":0.63400000000000001,"15min":0.59399999999999997},"max":{"1min":1.107,"5min":1.161,"15min":1.2410000000000001},"last":1.119},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.48999999999999999},"max":{"1min":1.0640000000000001,"5min":1.091,"15min":1.194},"last":1.1040000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.86699999999999999,"15min":0.876},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.60399999999999998},"max":{"1min":1.054,"5min":1.145,"15min":1.165},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.83799999999999997,"15min":0.83699999999999997},"min":{"1min":0.62,"5min":0.58299999999999996,"15min":0.51800000000000002},"max":{"1min":1.0580000000000001,"5min":1.141,"15min":1.147},"last":1.1479999999999999}]}]},{"osd":2,"up_from":14,"seq":60129543254,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59836,"kb_used_data":2288,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312004,"statfs":{"total":96636764160,"available":96575492096,"internally_reserved":0,"allocated":2342912,"data_stored":1189745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.64200000000000002,"5min":0.71799999999999997,"15min":0.81100000000000005},"last":0.314},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.746,"5min":0.85099999999999998,"15min":0.86099999999999999},"last":0.432}]},{"osd":1,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51500000000000001,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33300000000000002},"max":{"1min":0.66900000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.52800000000000002,"5min":0.51300000000000001,"15min":0.47799999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.89700000000000002},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.36899999999999999},"max":{"1min":0.745,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.59899999999999998},"min":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.41299999999999998},"max":{"1min":0.83699999999999997,"5min":0.89500000000000002,"15min":0.91200000000000003},"last":0.48599999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83299999999999996,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.59199999999999997,"15min":0.48699999999999999},"max":{"1min":1.0089999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.54600000000000004},"max":{"1min":1.0489999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83299999999999996,"15min":0.82599999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.51700000000000002},"max":{"1min":1.075,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.84099999999999997,"15min":0.85699999999999998},"min":{"1min":0.70699999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.98399999999999999,"5min":1.266,"15min":1.266},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84499999999999997,"15min":0.85899999999999999},"min":{"1min":0.68799999999999994,"5min":0.61599999999999999,"15min":0.61199999999999999},"max":{"1min":1.0680000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.89000000000000001,"15min":0.88300000000000001},"min":{"1min":0.65200000000000002,"5min":0.63100000000000001,"15min":0.58899999999999997},"max":{"1min":1.089,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.64400000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.095,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83399999999999996,"15min":0.83699999999999997},"min":{"1min":0.67700000000000005,"5min":0.60699999999999998,"15min":0.58399999999999996},"max":{"1min":1.0109999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.74199999999999999}]}]},{"osd":1,"up_from":14,"seq":60129543254,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41808,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330032,"statfs":{"total":96636764160,"available":96593952768,"internally_reserved":0,"allocated":2355200,"data_stored":1191357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48999999999999999,"15min":0.48499999999999999},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.75600000000000001,"15min":0.94399999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.33500000000000002},"max":{"1min":0.73799999999999999,"5min":0.80400000000000005,"15min":0.879},"last":0.44900000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.51200000000000001},"min":{"1min":0.437,"5min":0.36299999999999999,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.81399999999999995},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.58999999999999997},"min":{"1min":0.45200000000000001,"5min":0.41599999999999998,"15min":0.41199999999999998},"max":{"1min":0.80800000000000005,"5min":0.88300000000000001,"15min":0.91400000000000003},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66000000000000003,"15min":0.65300000000000002},"min":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.46100000000000002},"max":{"1min":0.90600000000000003,"5min":0.998,"15min":0.998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.51300000000000001,"5min":0.42499999999999999,"15min":0.39300000000000002},"max":{"1min":0.84699999999999998,"5min":0.88700000000000001,"15min":0.98699999999999999},"last":0.33900000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.81200000000000006,"15min":0.80300000000000005},"min":{"1min":0.59299999999999997,"5min":0.57399999999999995,"15min":0.48299999999999998},"max":{"1min":1.079,"5min":1.1559999999999999,"15min":1.2350000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.85699999999999998,"15min":0.84599999999999997},"min":{"1min":0.66800000000000004,"5min":0.63300000000000001,"15min":0.56999999999999995},"max":{"1min":1.147,"5min":1.268,"15min":1.268},"last":0.94799999999999995}]},{"osd":5,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81699999999999995,"15min":0.81899999999999995},"min":{"1min":0.58899999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.1950000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84799999999999998,"15min":0.83399999999999996},"min":{"1min":0.64600000000000002,"5min":0.57099999999999995,"15min":0.55300000000000005},"max":{"1min":1.1890000000000001,"5min":1.214,"15min":1.214},"last":0.97999999999999998}]},{"osd":6,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90000000000000002,"15min":0.878},"min":{"1min":0.72199999999999998,"5min":0.67800000000000005,"15min":0.59599999999999997},"max":{"1min":1.034,"5min":1.244,"15min":1.244},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85399999999999998,"15min":0.84599999999999997},"min":{"1min":0.64500000000000002,"5min":0.57999999999999996,"15min":0.55600000000000005},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.91800000000000004}]},{"osd":7,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84999999999999998,"15min":0.84699999999999998},"min":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.55600000000000005},"max":{"1min":1.149,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90800000000000003,"15min":0.89900000000000002},"min":{"1min":0.73699999999999999,"5min":0.69599999999999995,"15min":0.626},"max":{"1min":1.127,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.88600000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543253,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60428,"kb_used_data":2876,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311412,"statfs":{"total":96636764160,"available":96574885888,"internally_reserved":0,"allocated":2945024,"data_stored":1780217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.5,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66400000000000003,"5min":0.70799999999999996,"15min":1.2170000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.59099999999999997},"min":{"1min":0.46999999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.85999999999999999},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.33900000000000002},"max":{"1min":0.624,"5min":0.81799999999999995,"15min":0.91000000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41699999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71099999999999997,"5min":0.85199999999999998,"15min":0.86799999999999999},"last":0.41599999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51900000000000002,"15min":0.53200000000000003},"min":{"1min":0.378,"5min":0.34399999999999997,"15min":0.33700000000000002},"max":{"1min":0.67800000000000005,"5min":0.83499999999999996,"15min":1.855},"last":0.374},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61899999999999999,"15min":0.63},"min":{"1min":0.45200000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.69799999999999995,"5min":0.86599999999999999,"15min":1.3480000000000001},"last":0.443}]},{"osd":4,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86399999999999999,"15min":0.84799999999999998},"min":{"1min":0.63700000000000001,"5min":0.59999999999999998,"15min":0.53500000000000003},"max":{"1min":1.2210000000000001,"5min":1.2729999999999999,"15min":1.3799999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83099999999999996,"15min":0.84099999999999997},"min":{"1min":0.64600000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2729999999999999,"5min":1.2809999999999999,"15min":1.2849999999999999},"last":0.61299999999999999}]},{"osd":5,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81899999999999995,"15min":0.83299999999999996},"min":{"1min":0.57399999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0960000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.84799999999999998,"15min":0.85299999999999998},"min":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.996,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.256,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.68000000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.141,"5min":1.3560000000000001,"15min":1.5129999999999999},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.88900000000000001,"15min":0.88500000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0740000000000001,"5min":1.4339999999999999,"15min":1.5720000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84699999999999998,"15min":0.85699999999999998},"min":{"1min":0.65700000000000003,"5min":0.60099999999999998,"15min":0.58099999999999996},"max":{"1min":1.161,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.68799999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:35:47.474 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:35:47.477 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:35:50.087 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:35:50.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.233+0000 7f70fc09c640 1 Processor -- start 2023-08-25T05:35:50.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.233+0000 7f70fc09c640 1 -- start start 2023-08-25T05:35:50.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.233+0000 7f70fc09c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f70f40d0da0 0x7f70f40d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:50.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.233+0000 7f70fc09c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f70f40b3e50 0x7f70f40ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:50.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.233+0000 7f70fc09c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f40b29b0 con 0x7f70f40cdde0 2023-08-25T05:35:50.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.233+0000 7f70fc09c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f40ce760 con 0x7f70f40d0da0 2023-08-25T05:35:50.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.233+0000 7f70fc09c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f40d16c0 con 0x7f70f40b3e50 2023-08-25T05:35:50.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.233+0000 7f70f9e38640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f70f40d0da0 0x7f70f40d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:50.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.233+0000 7f70f9e38640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f70f40d0da0 0x7f70f40d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41268/0 (socket says 172.21.15.55:41268) 2023-08-25T05:35:50.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.233+0000 7f70f9e38640 1 -- 172.21.15.55:0/4038782368 learned_addr learned my addr 172.21.15.55:0/4038782368 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:50.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.233+0000 7f70fa639640 1 --2- 172.21.15.55:0/4038782368 >> v2:172.21.15.110:3300/0 conn(0x7f70f40b3e50 0x7f70f40ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:50.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.233+0000 7f70f9e38640 1 -- 172.21.15.55:0/4038782368 >> v2:172.21.15.110:3300/0 conn(0x7f70f40b3e50 msgr2=0x7f70f40ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:50.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.233+0000 7f70f9e38640 1 --2- 172.21.15.55:0/4038782368 >> v2:172.21.15.110:3300/0 conn(0x7f70f40b3e50 0x7f70f40ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.233+0000 7f70f9e38640 1 -- 172.21.15.55:0/4038782368 >> v1:172.21.15.110:6789/0 conn(0x7f70f40cdde0 legacy=0x7f70f40cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:50.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.233+0000 7f70f9e38640 1 -- 172.21.15.55:0/4038782368 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f40b1dc0 con 0x7f70f40d0da0 2023-08-25T05:35:50.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.233+0000 7f70fa639640 1 --2- 172.21.15.55:0/4038782368 >> v2:172.21.15.110:3300/0 conn(0x7f70f40b3e50 0x7f70f40ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:50.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.237+0000 7f70f9e38640 1 --2- 172.21.15.55:0/4038782368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70f40d0da0 0x7f70f40d1180 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f70f409c1c0 tx=0x7f70f001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c412189e6fd792ed server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:50.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.237+0000 7f70f8e36640 1 -- 172.21.15.55:0/4038782368 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f00a89b0 con 0x7f70f40d0da0 2023-08-25T05:35:50.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.237+0000 7f70f8e36640 1 -- 172.21.15.55:0/4038782368 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f00a8b10 con 0x7f70f40d0da0 2023-08-25T05:35:50.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.237+0000 7f70f8e36640 1 -- 172.21.15.55:0/4038782368 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f00a8ea0 con 0x7f70f40d0da0 2023-08-25T05:35:50.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.237+0000 7f70fc09c640 1 -- 172.21.15.55:0/4038782368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70f40d0da0 msgr2=0x7f70f40d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:50.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.237+0000 7f70fc09c640 1 --2- 172.21.15.55:0/4038782368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70f40d0da0 0x7f70f40d1180 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f70f409c1c0 tx=0x7f70f001ecb0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.237+0000 7f70fc09c640 1 -- 172.21.15.55:0/4038782368 shutdown_connections 2023-08-25T05:35:50.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.237+0000 7f70fc09c640 1 --2- 172.21.15.55:0/4038782368 >> v2:172.21.15.110:3300/0 conn(0x7f70f40b3e50 0x7f70f40ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.237+0000 7f70fc09c640 1 --2- 172.21.15.55:0/4038782368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70f40d0da0 0x7f70f40d1180 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.237+0000 7f70fc09c640 1 -- 172.21.15.55:0/4038782368 >> 172.21.15.55:0/4038782368 conn(0x7f70f409bae0 msgr2=0x7f70f40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:50.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.237+0000 7f70fc09c640 1 -- 172.21.15.55:0/4038782368 shutdown_connections 2023-08-25T05:35:50.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.237+0000 7f70fc09c640 1 -- 172.21.15.55:0/4038782368 wait complete. 2023-08-25T05:35:50.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70fc09c640 1 Processor -- start 2023-08-25T05:35:50.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70fc09c640 1 -- start start 2023-08-25T05:35:50.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70fc09c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70f40b3e50 0x7f70f4151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:50.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70fc09c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70f40cdde0 0x7f70f40b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:50.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70fc09c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70f40d0da0 0x7f70f40b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:50.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70fc09c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f40cb0a0 con 0x7f70f40cdde0 2023-08-25T05:35:50.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70fc09c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f40ca420 con 0x7f70f40b3e50 2023-08-25T05:35:50.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70fc09c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f40ca700 con 0x7f70f40d0da0 2023-08-25T05:35:50.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70f9637640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70f40cdde0 0x7f70f40b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:50.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70f9637640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70f40cdde0 0x7f70f40b53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41278/0 (socket says 172.21.15.55:41278) 2023-08-25T05:35:50.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70f9637640 1 -- 172.21.15.55:0/866330733 learned_addr learned my addr 172.21.15.55:0/866330733 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:50.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70f9e38640 1 --2- 172.21.15.55:0/866330733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70f40b3e50 0x7f70f4151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:50.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70fa639640 1 --2- 172.21.15.55:0/866330733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70f40d0da0 0x7f70f40b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:50.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70f9637640 1 -- 172.21.15.55:0/866330733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70f40d0da0 msgr2=0x7f70f40b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:50.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70f9637640 1 --2- 172.21.15.55:0/866330733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70f40d0da0 0x7f70f40b5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70f9637640 1 -- 172.21.15.55:0/866330733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70f40b3e50 msgr2=0x7f70f4151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:50.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70f9637640 1 --2- 172.21.15.55:0/866330733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70f40b3e50 0x7f70f4151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70f9637640 1 -- 172.21.15.55:0/866330733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f0009480 con 0x7f70f40cdde0 2023-08-25T05:35:50.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70fa639640 1 --2- 172.21.15.55:0/866330733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70f40d0da0 0x7f70f40b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:50.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70f9637640 1 --2- 172.21.15.55:0/866330733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70f40cdde0 0x7f70f40b53e0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f70e400c450 tx=0x7f70e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:50.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70ea7fc640 1 -- 172.21.15.55:0/866330733 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4012830 con 0x7f70f40cdde0 2023-08-25T05:35:50.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70ea7fc640 1 -- 172.21.15.55:0/866330733 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e40129b0 con 0x7f70f40cdde0 2023-08-25T05:35:50.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70ea7fc640 1 -- 172.21.15.55:0/866330733 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4012d60 con 0x7f70f40cdde0 2023-08-25T05:35:50.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70fc09c640 1 -- 172.21.15.55:0/866330733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f40ca9e0 con 0x7f70f40cdde0 2023-08-25T05:35:50.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70fc09c640 1 -- 172.21.15.55:0/866330733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f4151fc0 con 0x7f70f40cdde0 2023-08-25T05:35:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.241+0000 7f70fc09c640 1 -- 172.21.15.55:0/866330733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f40cb1e0 con 0x7f70f40cdde0 2023-08-25T05:35:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.245+0000 7f70ea7fc640 1 -- 172.21.15.55:0/866330733 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f70e401c460 con 0x7f70f40cdde0 2023-08-25T05:35:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.245+0000 7f70ea7fc640 1 --2- 172.21.15.55:0/866330733 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f70d80657a0 0x7f70d8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.245+0000 7f70ea7fc640 1 -- 172.21.15.55:0/866330733 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f70e4082d50 con 0x7f70f40cdde0 2023-08-25T05:35:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.245+0000 7f70f9e38640 1 --2- 172.21.15.55:0/866330733 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f70d80657a0 0x7f70d8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:50.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.245+0000 7f70f9e38640 1 --2- 172.21.15.55:0/866330733 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f70d80657a0 0x7f70d8067c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f70f00b2000 tx=0x7f70f00aa070 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.249+0000 7f70ea7fc640 1 -- 172.21.15.55:0/866330733 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f70e4086030 con 0x7f70f40cdde0 2023-08-25T05:35:50.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.401+0000 7f70fc09c640 1 -- 172.21.15.55:0/866330733 --> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f70f40c6c40 con 0x7f70d80657a0 2023-08-25T05:35:50.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.409+0000 7f70ea7fc640 1 -- 172.21.15.55:0/866330733 <== mgr.9763 v2:172.21.15.110:6832/3764131781 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312025 (secure 0 0 0) 0x7f70f40c6c40 con 0x7f70d80657a0 2023-08-25T05:35:50.417 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:50.419 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:35:50.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.413+0000 7f70fc09c640 1 -- 172.21.15.55:0/866330733 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f70d80657a0 msgr2=0x7f70d8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:50.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.413+0000 7f70fc09c640 1 --2- 172.21.15.55:0/866330733 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f70d80657a0 0x7f70d8067c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f70f00b2000 tx=0x7f70f00aa070 comp rx=0 tx=0).stop 2023-08-25T05:35:50.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.413+0000 7f70fc09c640 1 -- 172.21.15.55:0/866330733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70f40cdde0 msgr2=0x7f70f40b53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:50.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.413+0000 7f70fc09c640 1 --2- 172.21.15.55:0/866330733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70f40cdde0 0x7f70f40b53e0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f70e400c450 tx=0x7f70e400c910 comp rx=0 tx=0).stop 2023-08-25T05:35:50.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.413+0000 7f70fc09c640 1 -- 172.21.15.55:0/866330733 shutdown_connections 2023-08-25T05:35:50.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.413+0000 7f70fc09c640 1 --2- 172.21.15.55:0/866330733 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f70d80657a0 0x7f70d8067c60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.413+0000 7f70fc09c640 1 --2- 172.21.15.55:0/866330733 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70f40d0da0 0x7f70f40b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.413+0000 7f70fc09c640 1 --2- 172.21.15.55:0/866330733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70f40cdde0 0x7f70f40b53e0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.413+0000 7f70fc09c640 1 --2- 172.21.15.55:0/866330733 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70f40b3e50 0x7f70f4151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.413+0000 7f70fc09c640 1 -- 172.21.15.55:0/866330733 >> 172.21.15.55:0/866330733 conn(0x7f70f409bae0 msgr2=0x7f70f406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:50.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.413+0000 7f70fc09c640 1 -- 172.21.15.55:0/866330733 shutdown_connections 2023-08-25T05:35:50.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.413+0000 7f70fc09c640 1 -- 172.21.15.55:0/866330733 wait complete. 2023-08-25T05:35:50.438 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-08-25T05:35:50.143056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1904,"num_read_kb":3991,"num_write":570,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3670,"ondisk_log_size":3670,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":396672,"kb_used_data":19528,"kb_used_omap":13,"kb_used_meta":377010,"kb_avail":754578048,"statfs":{"total":773094113280,"available":772687921152,"internally_reserved":0,"allocated":19996672,"data_stored":10703516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":386058328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.748285"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400982+0000","last_change":"2023-08-25T05:35:41.419581+0000","last_active":"2023-08-25T05:35:42.400982+0000","last_peered":"2023-08-25T05:35:42.400982+0000","last_clean":"2023-08-25T05:35:42.400982+0000","last_became_active":"2023-08-25T05:35:41.418336+0000","last_became_peered":"2023-08-25T05:35:41.418336+0000","last_unstale":"2023-08-25T05:35:42.400982+0000","last_undegraded":"2023-08-25T05:35:42.400982+0000","last_fullsized":"2023-08-25T05:35:42.400982+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:00:11.264045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049225+0000","last_change":"2023-08-25T05:35:41.411853+0000","last_active":"2023-08-25T05:35:43.049225+0000","last_peered":"2023-08-25T05:35:43.049225+0000","last_clean":"2023-08-25T05:35:43.049225+0000","last_became_active":"2023-08-25T05:35:41.411511+0000","last_became_peered":"2023-08-25T05:35:41.411511+0000","last_unstale":"2023-08-25T05:35:43.049225+0000","last_undegraded":"2023-08-25T05:35:43.049225+0000","last_fullsized":"2023-08-25T05:35:43.049225+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:24.848516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.399993+0000","last_change":"2023-08-25T05:35:41.414546+0000","last_active":"2023-08-25T05:35:42.399993+0000","last_peered":"2023-08-25T05:35:42.399993+0000","last_clean":"2023-08-25T05:35:42.399993+0000","last_became_active":"2023-08-25T05:35:41.414262+0000","last_became_peered":"2023-08-25T05:35:41.414262+0000","last_unstale":"2023-08-25T05:35:42.399993+0000","last_undegraded":"2023-08-25T05:35:42.399993+0000","last_fullsized":"2023-08-25T05:35:42.399993+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:57:35.302712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400310+0000","last_change":"2023-08-25T05:35:41.412829+0000","last_active":"2023-08-25T05:35:42.400310+0000","last_peered":"2023-08-25T05:35:42.400310+0000","last_clean":"2023-08-25T05:35:42.400310+0000","last_became_active":"2023-08-25T05:35:41.412521+0000","last_became_peered":"2023-08-25T05:35:41.412521+0000","last_unstale":"2023-08-25T05:35:42.400310+0000","last_undegraded":"2023-08-25T05:35:42.400310+0000","last_fullsized":"2023-08-25T05:35:42.400310+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:50:53.533000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048390+0000","last_change":"2023-08-25T05:35:41.431979+0000","last_active":"2023-08-25T05:35:43.048390+0000","last_peered":"2023-08-25T05:35:43.048390+0000","last_clean":"2023-08-25T05:35:43.048390+0000","last_became_active":"2023-08-25T05:35:41.431538+0000","last_became_peered":"2023-08-25T05:35:41.431538+0000","last_unstale":"2023-08-25T05:35:43.048390+0000","last_undegraded":"2023-08-25T05:35:43.048390+0000","last_fullsized":"2023-08-25T05:35:43.048390+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:10:25.020976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048588+0000","last_change":"2023-08-25T05:35:41.408186+0000","last_active":"2023-08-25T05:35:43.048588+0000","last_peered":"2023-08-25T05:35:43.048588+0000","last_clean":"2023-08-25T05:35:43.048588+0000","last_became_active":"2023-08-25T05:35:41.407855+0000","last_became_peered":"2023-08-25T05:35:41.407855+0000","last_unstale":"2023-08-25T05:35:43.048588+0000","last_undegraded":"2023-08-25T05:35:43.048588+0000","last_fullsized":"2023-08-25T05:35:43.048588+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:59:53.689428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548022+0000","last_change":"2023-08-25T05:35:41.431845+0000","last_active":"2023-08-25T05:35:42.548022+0000","last_peered":"2023-08-25T05:35:42.548022+0000","last_clean":"2023-08-25T05:35:42.548022+0000","last_became_active":"2023-08-25T05:35:41.431572+0000","last_became_peered":"2023-08-25T05:35:41.431572+0000","last_unstale":"2023-08-25T05:35:42.548022+0000","last_undegraded":"2023-08-25T05:35:42.548022+0000","last_fullsized":"2023-08-25T05:35:42.548022+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:35:07.333341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.547938+0000","last_change":"2023-08-25T05:35:41.430379+0000","last_active":"2023-08-25T05:35:42.547938+0000","last_peered":"2023-08-25T05:35:42.547938+0000","last_clean":"2023-08-25T05:35:42.547938+0000","last_became_active":"2023-08-25T05:35:41.430122+0000","last_became_peered":"2023-08-25T05:35:41.430122+0000","last_unstale":"2023-08-25T05:35:42.547938+0000","last_undegraded":"2023-08-25T05:35:42.547938+0000","last_fullsized":"2023-08-25T05:35:42.547938+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:25:54.008665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548469+0000","last_change":"2023-08-25T05:35:41.424794+0000","last_active":"2023-08-25T05:35:42.548469+0000","last_peered":"2023-08-25T05:35:42.548469+0000","last_clean":"2023-08-25T05:35:42.548469+0000","last_became_active":"2023-08-25T05:35:41.424428+0000","last_became_peered":"2023-08-25T05:35:41.424428+0000","last_unstale":"2023-08-25T05:35:42.548469+0000","last_undegraded":"2023-08-25T05:35:42.548469+0000","last_fullsized":"2023-08-25T05:35:42.548469+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:23:45.020253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548359+0000","last_change":"2023-08-25T05:35:41.430334+0000","last_active":"2023-08-25T05:35:42.548359+0000","last_peered":"2023-08-25T05:35:42.548359+0000","last_clean":"2023-08-25T05:35:42.548359+0000","last_became_active":"2023-08-25T05:35:41.430075+0000","last_became_peered":"2023-08-25T05:35:41.430075+0000","last_unstale":"2023-08-25T05:35:42.548359+0000","last_undegraded":"2023-08-25T05:35:42.548359+0000","last_fullsized":"2023-08-25T05:35:42.548359+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:40:28.497330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049341+0000","last_change":"2023-08-25T05:35:41.414476+0000","last_active":"2023-08-25T05:35:43.049341+0000","last_peered":"2023-08-25T05:35:43.049341+0000","last_clean":"2023-08-25T05:35:43.049341+0000","last_became_active":"2023-08-25T05:35:41.414193+0000","last_became_peered":"2023-08-25T05:35:41.414193+0000","last_unstale":"2023-08-25T05:35:43.049341+0000","last_undegraded":"2023-08-25T05:35:43.049341+0000","last_fullsized":"2023-08-25T05:35:43.049341+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:36:23.028051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048762+0000","last_change":"2023-08-25T05:35:41.408499+0000","last_active":"2023-08-25T05:35:43.048762+0000","last_peered":"2023-08-25T05:35:43.048762+0000","last_clean":"2023-08-25T05:35:43.048762+0000","last_became_active":"2023-08-25T05:35:41.408216+0000","last_became_peered":"2023-08-25T05:35:41.408216+0000","last_unstale":"2023-08-25T05:35:43.048762+0000","last_undegraded":"2023-08-25T05:35:43.048762+0000","last_fullsized":"2023-08-25T05:35:43.048762+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:42:38.586904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400941+0000","last_change":"2023-08-25T05:35:41.407770+0000","last_active":"2023-08-25T05:35:42.400941+0000","last_peered":"2023-08-25T05:35:42.400941+0000","last_clean":"2023-08-25T05:35:42.400941+0000","last_became_active":"2023-08-25T05:35:41.407484+0000","last_became_peered":"2023-08-25T05:35:41.407484+0000","last_unstale":"2023-08-25T05:35:42.400941+0000","last_undegraded":"2023-08-25T05:35:42.400941+0000","last_fullsized":"2023-08-25T05:35:42.400941+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:55:53.541995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048272+0000","last_change":"2023-08-25T05:35:41.432870+0000","last_active":"2023-08-25T05:35:43.048272+0000","last_peered":"2023-08-25T05:35:43.048272+0000","last_clean":"2023-08-25T05:35:43.048272+0000","last_became_active":"2023-08-25T05:35:41.432603+0000","last_became_peered":"2023-08-25T05:35:41.432603+0000","last_unstale":"2023-08-25T05:35:43.048272+0000","last_undegraded":"2023-08-25T05:35:43.048272+0000","last_fullsized":"2023-08-25T05:35:43.048272+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:51:53.872466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048473+0000","last_change":"2023-08-25T05:35:41.424943+0000","last_active":"2023-08-25T05:35:43.048473+0000","last_peered":"2023-08-25T05:35:43.048473+0000","last_clean":"2023-08-25T05:35:43.048473+0000","last_became_active":"2023-08-25T05:35:41.424614+0000","last_became_peered":"2023-08-25T05:35:41.424614+0000","last_unstale":"2023-08-25T05:35:43.048473+0000","last_undegraded":"2023-08-25T05:35:43.048473+0000","last_fullsized":"2023-08-25T05:35:43.048473+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:22:40.321564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.399911+0000","last_change":"2023-08-25T05:35:41.412913+0000","last_active":"2023-08-25T05:35:42.399911+0000","last_peered":"2023-08-25T05:35:42.399911+0000","last_clean":"2023-08-25T05:35:42.399911+0000","last_became_active":"2023-08-25T05:35:41.412414+0000","last_became_peered":"2023-08-25T05:35:41.412414+0000","last_unstale":"2023-08-25T05:35:42.399911+0000","last_undegraded":"2023-08-25T05:35:42.399911+0000","last_fullsized":"2023-08-25T05:35:42.399911+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:05:07.052743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548582+0000","last_change":"2023-08-25T05:35:41.427643+0000","last_active":"2023-08-25T05:35:42.548582+0000","last_peered":"2023-08-25T05:35:42.548582+0000","last_clean":"2023-08-25T05:35:42.548582+0000","last_became_active":"2023-08-25T05:35:41.427278+0000","last_became_peered":"2023-08-25T05:35:41.427278+0000","last_unstale":"2023-08-25T05:35:42.548582+0000","last_undegraded":"2023-08-25T05:35:42.548582+0000","last_fullsized":"2023-08-25T05:35:42.548582+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:44:54.277771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400520+0000","last_change":"2023-08-25T05:35:41.426111+0000","last_active":"2023-08-25T05:35:42.400520+0000","last_peered":"2023-08-25T05:35:42.400520+0000","last_clean":"2023-08-25T05:35:42.400520+0000","last_became_active":"2023-08-25T05:35:41.425718+0000","last_became_peered":"2023-08-25T05:35:41.425718+0000","last_unstale":"2023-08-25T05:35:42.400520+0000","last_undegraded":"2023-08-25T05:35:42.400520+0000","last_fullsized":"2023-08-25T05:35:42.400520+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:03:36.587559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049436+0000","last_change":"2023-08-25T05:35:41.427598+0000","last_active":"2023-08-25T05:35:43.049436+0000","last_peered":"2023-08-25T05:35:43.049436+0000","last_clean":"2023-08-25T05:35:43.049436+0000","last_became_active":"2023-08-25T05:35:41.427281+0000","last_became_peered":"2023-08-25T05:35:41.427281+0000","last_unstale":"2023-08-25T05:35:43.049436+0000","last_undegraded":"2023-08-25T05:35:43.049436+0000","last_fullsized":"2023-08-25T05:35:43.049436+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:35:40.501781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048824+0000","last_change":"2023-08-25T05:35:41.424326+0000","last_active":"2023-08-25T05:35:43.048824+0000","last_peered":"2023-08-25T05:35:43.048824+0000","last_clean":"2023-08-25T05:35:43.048824+0000","last_became_active":"2023-08-25T05:35:41.424046+0000","last_became_peered":"2023-08-25T05:35:41.424046+0000","last_unstale":"2023-08-25T05:35:43.048824+0000","last_undegraded":"2023-08-25T05:35:43.048824+0000","last_fullsized":"2023-08-25T05:35:43.048824+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:41:25.322218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401070+0000","last_change":"2023-08-25T05:35:41.412969+0000","last_active":"2023-08-25T05:35:42.401070+0000","last_peered":"2023-08-25T05:35:42.401070+0000","last_clean":"2023-08-25T05:35:42.401070+0000","last_became_active":"2023-08-25T05:35:41.412710+0000","last_became_peered":"2023-08-25T05:35:41.412710+0000","last_unstale":"2023-08-25T05:35:42.401070+0000","last_undegraded":"2023-08-25T05:35:42.401070+0000","last_fullsized":"2023-08-25T05:35:42.401070+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:45:46.714226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048649+0000","last_change":"2023-08-25T05:35:41.412077+0000","last_active":"2023-08-25T05:35:43.048649+0000","last_peered":"2023-08-25T05:35:43.048649+0000","last_clean":"2023-08-25T05:35:43.048649+0000","last_became_active":"2023-08-25T05:35:41.411721+0000","last_became_peered":"2023-08-25T05:35:41.411721+0000","last_unstale":"2023-08-25T05:35:43.048649+0000","last_undegraded":"2023-08-25T05:35:43.048649+0000","last_fullsized":"2023-08-25T05:35:43.048649+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:00:53.558676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048121+0000","last_change":"2023-08-25T05:35:41.419838+0000","last_active":"2023-08-25T05:35:43.048121+0000","last_peered":"2023-08-25T05:35:43.048121+0000","last_clean":"2023-08-25T05:35:43.048121+0000","last_became_active":"2023-08-25T05:35:41.419571+0000","last_became_peered":"2023-08-25T05:35:41.419571+0000","last_unstale":"2023-08-25T05:35:43.048121+0000","last_undegraded":"2023-08-25T05:35:43.048121+0000","last_fullsized":"2023-08-25T05:35:43.048121+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:50:18.882576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400079+0000","last_change":"2023-08-25T05:35:41.412716+0000","last_active":"2023-08-25T05:35:42.400079+0000","last_peered":"2023-08-25T05:35:42.400079+0000","last_clean":"2023-08-25T05:35:42.400079+0000","last_became_active":"2023-08-25T05:35:41.412047+0000","last_became_peered":"2023-08-25T05:35:41.412047+0000","last_unstale":"2023-08-25T05:35:42.400079+0000","last_undegraded":"2023-08-25T05:35:42.400079+0000","last_fullsized":"2023-08-25T05:35:42.400079+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:50:22.152959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401342+0000","last_change":"2023-08-25T05:35:41.428492+0000","last_active":"2023-08-25T05:35:42.401342+0000","last_peered":"2023-08-25T05:35:42.401342+0000","last_clean":"2023-08-25T05:35:42.401342+0000","last_became_active":"2023-08-25T05:35:41.428216+0000","last_became_peered":"2023-08-25T05:35:41.428216+0000","last_unstale":"2023-08-25T05:35:42.401342+0000","last_undegraded":"2023-08-25T05:35:42.401342+0000","last_fullsized":"2023-08-25T05:35:42.401342+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:35:18.637705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048600+0000","last_change":"2023-08-25T05:35:41.412937+0000","last_active":"2023-08-25T05:35:43.048600+0000","last_peered":"2023-08-25T05:35:43.048600+0000","last_clean":"2023-08-25T05:35:43.048600+0000","last_became_active":"2023-08-25T05:35:41.412668+0000","last_became_peered":"2023-08-25T05:35:41.412668+0000","last_unstale":"2023-08-25T05:35:43.048600+0000","last_undegraded":"2023-08-25T05:35:43.048600+0000","last_fullsized":"2023-08-25T05:35:43.048600+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:31:54.977441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049386+0000","last_change":"2023-08-25T05:35:41.412222+0000","last_active":"2023-08-25T05:35:43.049386+0000","last_peered":"2023-08-25T05:35:43.049386+0000","last_clean":"2023-08-25T05:35:43.049386+0000","last_became_active":"2023-08-25T05:35:41.411835+0000","last_became_peered":"2023-08-25T05:35:41.411835+0000","last_unstale":"2023-08-25T05:35:43.049386+0000","last_undegraded":"2023-08-25T05:35:43.049386+0000","last_fullsized":"2023-08-25T05:35:43.049386+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:25:21.536344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400906+0000","last_change":"2023-08-25T05:35:41.413829+0000","last_active":"2023-08-25T05:35:42.400906+0000","last_peered":"2023-08-25T05:35:42.400906+0000","last_clean":"2023-08-25T05:35:42.400906+0000","last_became_active":"2023-08-25T05:35:41.413239+0000","last_became_peered":"2023-08-25T05:35:41.413239+0000","last_unstale":"2023-08-25T05:35:42.400906+0000","last_undegraded":"2023-08-25T05:35:42.400906+0000","last_fullsized":"2023-08-25T05:35:42.400906+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:53:11.533167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048999+0000","last_change":"2023-08-25T05:35:41.427634+0000","last_active":"2023-08-25T05:35:43.048999+0000","last_peered":"2023-08-25T05:35:43.048999+0000","last_clean":"2023-08-25T05:35:43.048999+0000","last_became_active":"2023-08-25T05:35:41.427293+0000","last_became_peered":"2023-08-25T05:35:41.427293+0000","last_unstale":"2023-08-25T05:35:43.048999+0000","last_undegraded":"2023-08-25T05:35:43.048999+0000","last_fullsized":"2023-08-25T05:35:43.048999+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:49:05.376425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400243+0000","last_change":"2023-08-25T05:35:41.414509+0000","last_active":"2023-08-25T05:35:42.400243+0000","last_peered":"2023-08-25T05:35:42.400243+0000","last_clean":"2023-08-25T05:35:42.400243+0000","last_became_active":"2023-08-25T05:35:41.414047+0000","last_became_peered":"2023-08-25T05:35:41.414047+0000","last_unstale":"2023-08-25T05:35:42.400243+0000","last_undegraded":"2023-08-25T05:35:42.400243+0000","last_fullsized":"2023-08-25T05:35:42.400243+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:55:34.140935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048621+0000","last_change":"2023-08-25T05:35:41.419820+0000","last_active":"2023-08-25T05:35:43.048621+0000","last_peered":"2023-08-25T05:35:43.048621+0000","last_clean":"2023-08-25T05:35:43.048621+0000","last_became_active":"2023-08-25T05:35:41.419511+0000","last_became_peered":"2023-08-25T05:35:41.419511+0000","last_unstale":"2023-08-25T05:35:43.048621+0000","last_undegraded":"2023-08-25T05:35:43.048621+0000","last_fullsized":"2023-08-25T05:35:43.048621+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:50:17.425904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.399994+0000","last_change":"2023-08-25T05:35:41.415137+0000","last_active":"2023-08-25T05:35:42.399994+0000","last_peered":"2023-08-25T05:35:42.399994+0000","last_clean":"2023-08-25T05:35:42.399994+0000","last_became_active":"2023-08-25T05:35:41.414859+0000","last_became_peered":"2023-08-25T05:35:41.414859+0000","last_unstale":"2023-08-25T05:35:42.399994+0000","last_undegraded":"2023-08-25T05:35:42.399994+0000","last_fullsized":"2023-08-25T05:35:42.399994+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:48:33.827393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049054+0000","last_change":"2023-08-25T05:35:41.407983+0000","last_active":"2023-08-25T05:35:43.049054+0000","last_peered":"2023-08-25T05:35:43.049054+0000","last_clean":"2023-08-25T05:35:43.049054+0000","last_became_active":"2023-08-25T05:35:41.407473+0000","last_became_peered":"2023-08-25T05:35:41.407473+0000","last_unstale":"2023-08-25T05:35:43.049054+0000","last_undegraded":"2023-08-25T05:35:43.049054+0000","last_fullsized":"2023-08-25T05:35:43.049054+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:34:08.979155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"187'4","reported_seq":17,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401071+0000","last_change":"2023-08-25T05:35:40.411419+0000","last_active":"2023-08-25T05:35:42.401071+0000","last_peered":"2023-08-25T05:35:42.401071+0000","last_clean":"2023-08-25T05:35:42.401071+0000","last_became_active":"2023-08-25T05:35:40.411110+0000","last_became_peered":"2023-08-25T05:35:40.411110+0000","last_unstale":"2023-08-25T05:35:42.401071+0000","last_undegraded":"2023-08-25T05:35:42.401071+0000","last_fullsized":"2023-08-25T05:35:42.401071+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:49:18.231466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400781+0000","last_change":"2023-08-25T05:35:41.415906+0000","last_active":"2023-08-25T05:35:42.400781+0000","last_peered":"2023-08-25T05:35:42.400781+0000","last_clean":"2023-08-25T05:35:42.400781+0000","last_became_active":"2023-08-25T05:35:41.415626+0000","last_became_peered":"2023-08-25T05:35:41.415626+0000","last_unstale":"2023-08-25T05:35:42.400781+0000","last_undegraded":"2023-08-25T05:35:42.400781+0000","last_fullsized":"2023-08-25T05:35:42.400781+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:44:54.772065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"187'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049141+0000","last_change":"2023-08-25T05:35:40.407365+0000","last_active":"2023-08-25T05:35:43.049141+0000","last_peered":"2023-08-25T05:35:43.049141+0000","last_clean":"2023-08-25T05:35:43.049141+0000","last_became_active":"2023-08-25T05:35:40.407011+0000","last_became_peered":"2023-08-25T05:35:40.407011+0000","last_unstale":"2023-08-25T05:35:43.049141+0000","last_undegraded":"2023-08-25T05:35:43.049141+0000","last_fullsized":"2023-08-25T05:35:43.049141+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:34:47.692846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048273+0000","last_change":"2023-08-25T05:35:41.422436+0000","last_active":"2023-08-25T05:35:43.048273+0000","last_peered":"2023-08-25T05:35:43.048273+0000","last_clean":"2023-08-25T05:35:43.048273+0000","last_became_active":"2023-08-25T05:35:41.422159+0000","last_became_peered":"2023-08-25T05:35:41.422159+0000","last_unstale":"2023-08-25T05:35:43.048273+0000","last_undegraded":"2023-08-25T05:35:43.048273+0000","last_fullsized":"2023-08-25T05:35:43.048273+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:00:11.497954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049544+0000","last_change":"2023-08-25T05:35:40.413501+0000","last_active":"2023-08-25T05:35:43.049544+0000","last_peered":"2023-08-25T05:35:43.049544+0000","last_clean":"2023-08-25T05:35:43.049544+0000","last_became_active":"2023-08-25T05:35:40.413184+0000","last_became_peered":"2023-08-25T05:35:40.413184+0000","last_unstale":"2023-08-25T05:35:43.049544+0000","last_undegraded":"2023-08-25T05:35:43.049544+0000","last_fullsized":"2023-08-25T05:35:43.049544+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:16:49.296973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049009+0000","last_change":"2023-08-25T05:35:41.412402+0000","last_active":"2023-08-25T05:35:43.049009+0000","last_peered":"2023-08-25T05:35:43.049009+0000","last_clean":"2023-08-25T05:35:43.049009+0000","last_became_active":"2023-08-25T05:35:41.412061+0000","last_became_peered":"2023-08-25T05:35:41.412061+0000","last_unstale":"2023-08-25T05:35:43.049009+0000","last_undegraded":"2023-08-25T05:35:43.049009+0000","last_fullsized":"2023-08-25T05:35:43.049009+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:40:30.940804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048737+0000","last_change":"2023-08-25T05:35:40.411432+0000","last_active":"2023-08-25T05:35:43.048737+0000","last_peered":"2023-08-25T05:35:43.048737+0000","last_clean":"2023-08-25T05:35:43.048737+0000","last_became_active":"2023-08-25T05:35:40.411091+0000","last_became_peered":"2023-08-25T05:35:40.411091+0000","last_unstale":"2023-08-25T05:35:43.048737+0000","last_undegraded":"2023-08-25T05:35:43.048737+0000","last_fullsized":"2023-08-25T05:35:43.048737+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:59:55.528663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548083+0000","last_change":"2023-08-25T05:35:41.430252+0000","last_active":"2023-08-25T05:35:42.548083+0000","last_peered":"2023-08-25T05:35:42.548083+0000","last_clean":"2023-08-25T05:35:42.548083+0000","last_became_active":"2023-08-25T05:35:41.429891+0000","last_became_peered":"2023-08-25T05:35:41.429891+0000","last_unstale":"2023-08-25T05:35:42.548083+0000","last_undegraded":"2023-08-25T05:35:42.548083+0000","last_fullsized":"2023-08-25T05:35:42.548083+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:23.764839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"187'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548148+0000","last_change":"2023-08-25T05:35:40.403861+0000","last_active":"2023-08-25T05:35:42.548148+0000","last_peered":"2023-08-25T05:35:42.548148+0000","last_clean":"2023-08-25T05:35:42.548148+0000","last_became_active":"2023-08-25T05:35:40.403587+0000","last_became_peered":"2023-08-25T05:35:40.403587+0000","last_unstale":"2023-08-25T05:35:42.548148+0000","last_undegraded":"2023-08-25T05:35:42.548148+0000","last_fullsized":"2023-08-25T05:35:42.548148+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:44:31.114715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048686+0000","last_change":"2023-08-25T05:35:41.425495+0000","last_active":"2023-08-25T05:35:43.048686+0000","last_peered":"2023-08-25T05:35:43.048686+0000","last_clean":"2023-08-25T05:35:43.048686+0000","last_became_active":"2023-08-25T05:35:41.425189+0000","last_became_peered":"2023-08-25T05:35:41.425189+0000","last_unstale":"2023-08-25T05:35:43.048686+0000","last_undegraded":"2023-08-25T05:35:43.048686+0000","last_fullsized":"2023-08-25T05:35:43.048686+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:50:14.964099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"187'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048376+0000","last_change":"2023-08-25T05:35:40.411408+0000","last_active":"2023-08-25T05:35:43.048376+0000","last_peered":"2023-08-25T05:35:43.048376+0000","last_clean":"2023-08-25T05:35:43.048376+0000","last_became_active":"2023-08-25T05:35:40.411086+0000","last_became_peered":"2023-08-25T05:35:40.411086+0000","last_unstale":"2023-08-25T05:35:43.048376+0000","last_undegraded":"2023-08-25T05:35:43.048376+0000","last_fullsized":"2023-08-25T05:35:43.048376+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:36:40.352529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048744+0000","last_change":"2023-08-25T05:35:41.412432+0000","last_active":"2023-08-25T05:35:43.048744+0000","last_peered":"2023-08-25T05:35:43.048744+0000","last_clean":"2023-08-25T05:35:43.048744+0000","last_became_active":"2023-08-25T05:35:41.412128+0000","last_became_peered":"2023-08-25T05:35:41.412128+0000","last_unstale":"2023-08-25T05:35:43.048744+0000","last_undegraded":"2023-08-25T05:35:43.048744+0000","last_fullsized":"2023-08-25T05:35:43.048744+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:06:19.276006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048391+0000","last_change":"2023-08-25T05:35:40.417142+0000","last_active":"2023-08-25T05:35:43.048391+0000","last_peered":"2023-08-25T05:35:43.048391+0000","last_clean":"2023-08-25T05:35:43.048391+0000","last_became_active":"2023-08-25T05:35:40.416873+0000","last_became_peered":"2023-08-25T05:35:40.416873+0000","last_unstale":"2023-08-25T05:35:43.048391+0000","last_undegraded":"2023-08-25T05:35:43.048391+0000","last_fullsized":"2023-08-25T05:35:43.048391+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:05:14.678680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401009+0000","last_change":"2023-08-25T05:35:41.411759+0000","last_active":"2023-08-25T05:35:42.401009+0000","last_peered":"2023-08-25T05:35:42.401009+0000","last_clean":"2023-08-25T05:35:42.401009+0000","last_became_active":"2023-08-25T05:35:41.411476+0000","last_became_peered":"2023-08-25T05:35:41.411476+0000","last_unstale":"2023-08-25T05:35:42.401009+0000","last_undegraded":"2023-08-25T05:35:42.401009+0000","last_fullsized":"2023-08-25T05:35:42.401009+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:36:46.795428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548062+0000","last_change":"2023-08-25T05:35:40.410462+0000","last_active":"2023-08-25T05:35:42.548062+0000","last_peered":"2023-08-25T05:35:42.548062+0000","last_clean":"2023-08-25T05:35:42.548062+0000","last_became_active":"2023-08-25T05:35:40.410176+0000","last_became_peered":"2023-08-25T05:35:40.410176+0000","last_unstale":"2023-08-25T05:35:42.548062+0000","last_undegraded":"2023-08-25T05:35:42.548062+0000","last_fullsized":"2023-08-25T05:35:42.548062+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:52:55.173377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.547973+0000","last_change":"2023-08-25T05:35:41.431789+0000","last_active":"2023-08-25T05:35:42.547973+0000","last_peered":"2023-08-25T05:35:42.547973+0000","last_clean":"2023-08-25T05:35:42.547973+0000","last_became_active":"2023-08-25T05:35:41.431517+0000","last_became_peered":"2023-08-25T05:35:41.431517+0000","last_unstale":"2023-08-25T05:35:42.547973+0000","last_undegraded":"2023-08-25T05:35:42.547973+0000","last_fullsized":"2023-08-25T05:35:42.547973+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:43:00.132802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"187'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401396+0000","last_change":"2023-08-25T05:35:40.414259+0000","last_active":"2023-08-25T05:35:42.401396+0000","last_peered":"2023-08-25T05:35:42.401396+0000","last_clean":"2023-08-25T05:35:42.401396+0000","last_became_active":"2023-08-25T05:35:40.413974+0000","last_became_peered":"2023-08-25T05:35:40.413974+0000","last_unstale":"2023-08-25T05:35:42.401396+0000","last_undegraded":"2023-08-25T05:35:42.401396+0000","last_fullsized":"2023-08-25T05:35:42.401396+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:50:05.843267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400586+0000","last_change":"2023-08-25T05:35:41.410857+0000","last_active":"2023-08-25T05:35:42.400586+0000","last_peered":"2023-08-25T05:35:42.400586+0000","last_clean":"2023-08-25T05:35:42.400586+0000","last_became_active":"2023-08-25T05:35:41.410591+0000","last_became_peered":"2023-08-25T05:35:41.410591+0000","last_unstale":"2023-08-25T05:35:42.400586+0000","last_undegraded":"2023-08-25T05:35:42.400586+0000","last_fullsized":"2023-08-25T05:35:42.400586+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:16:32.942553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548406+0000","last_change":"2023-08-25T05:35:40.413149+0000","last_active":"2023-08-25T05:35:42.548406+0000","last_peered":"2023-08-25T05:35:42.548406+0000","last_clean":"2023-08-25T05:35:42.548406+0000","last_became_active":"2023-08-25T05:35:40.412876+0000","last_became_peered":"2023-08-25T05:35:40.412876+0000","last_unstale":"2023-08-25T05:35:42.548406+0000","last_undegraded":"2023-08-25T05:35:42.548406+0000","last_fullsized":"2023-08-25T05:35:42.548406+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:30:29.914434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048569+0000","last_change":"2023-08-25T05:35:41.410345+0000","last_active":"2023-08-25T05:35:43.048569+0000","last_peered":"2023-08-25T05:35:43.048569+0000","last_clean":"2023-08-25T05:35:43.048569+0000","last_became_active":"2023-08-25T05:35:41.410074+0000","last_became_peered":"2023-08-25T05:35:41.410074+0000","last_unstale":"2023-08-25T05:35:43.048569+0000","last_undegraded":"2023-08-25T05:35:43.048569+0000","last_fullsized":"2023-08-25T05:35:43.048569+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:34:12.232022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"187'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049246+0000","last_change":"2023-08-25T05:35:40.405785+0000","last_active":"2023-08-25T05:35:43.049246+0000","last_peered":"2023-08-25T05:35:43.049246+0000","last_clean":"2023-08-25T05:35:43.049246+0000","last_became_active":"2023-08-25T05:35:40.405505+0000","last_became_peered":"2023-08-25T05:35:40.405505+0000","last_unstale":"2023-08-25T05:35:43.049246+0000","last_undegraded":"2023-08-25T05:35:43.049246+0000","last_fullsized":"2023-08-25T05:35:43.049246+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:54:33.803778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049269+0000","last_change":"2023-08-25T05:35:41.413795+0000","last_active":"2023-08-25T05:35:43.049269+0000","last_peered":"2023-08-25T05:35:43.049269+0000","last_clean":"2023-08-25T05:35:43.049269+0000","last_became_active":"2023-08-25T05:35:41.413488+0000","last_became_peered":"2023-08-25T05:35:41.413488+0000","last_unstale":"2023-08-25T05:35:43.049269+0000","last_undegraded":"2023-08-25T05:35:43.049269+0000","last_fullsized":"2023-08-25T05:35:43.049269+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:47:54.794261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548198+0000","last_change":"2023-08-25T05:35:40.406720+0000","last_active":"2023-08-25T05:35:42.548198+0000","last_peered":"2023-08-25T05:35:42.548198+0000","last_clean":"2023-08-25T05:35:42.548198+0000","last_became_active":"2023-08-25T05:35:40.405992+0000","last_became_peered":"2023-08-25T05:35:40.405992+0000","last_unstale":"2023-08-25T05:35:42.548198+0000","last_undegraded":"2023-08-25T05:35:42.548198+0000","last_fullsized":"2023-08-25T05:35:42.548198+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:38.103093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400937+0000","last_change":"2023-08-25T05:35:41.413997+0000","last_active":"2023-08-25T05:35:42.400937+0000","last_peered":"2023-08-25T05:35:42.400937+0000","last_clean":"2023-08-25T05:35:42.400937+0000","last_became_active":"2023-08-25T05:35:41.413579+0000","last_became_peered":"2023-08-25T05:35:41.413579+0000","last_unstale":"2023-08-25T05:35:42.400937+0000","last_undegraded":"2023-08-25T05:35:42.400937+0000","last_fullsized":"2023-08-25T05:35:42.400937+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:00:20.374889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049013+0000","last_change":"2023-08-25T05:35:40.410371+0000","last_active":"2023-08-25T05:35:43.049013+0000","last_peered":"2023-08-25T05:35:43.049013+0000","last_clean":"2023-08-25T05:35:43.049013+0000","last_became_active":"2023-08-25T05:35:40.410055+0000","last_became_peered":"2023-08-25T05:35:40.410055+0000","last_unstale":"2023-08-25T05:35:43.049013+0000","last_undegraded":"2023-08-25T05:35:43.049013+0000","last_fullsized":"2023-08-25T05:35:43.049013+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:19:41.424451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049229+0000","last_change":"2023-08-25T05:35:41.434853+0000","last_active":"2023-08-25T05:35:43.049229+0000","last_peered":"2023-08-25T05:35:43.049229+0000","last_clean":"2023-08-25T05:35:43.049229+0000","last_became_active":"2023-08-25T05:35:41.434480+0000","last_became_peered":"2023-08-25T05:35:41.434480+0000","last_unstale":"2023-08-25T05:35:43.049229+0000","last_undegraded":"2023-08-25T05:35:43.049229+0000","last_fullsized":"2023-08-25T05:35:43.049229+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:16:56.444696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049107+0000","last_change":"2023-08-25T05:35:40.408621+0000","last_active":"2023-08-25T05:35:43.049107+0000","last_peered":"2023-08-25T05:35:43.049107+0000","last_clean":"2023-08-25T05:35:43.049107+0000","last_became_active":"2023-08-25T05:35:40.408273+0000","last_became_peered":"2023-08-25T05:35:40.408273+0000","last_unstale":"2023-08-25T05:35:43.049107+0000","last_undegraded":"2023-08-25T05:35:43.049107+0000","last_fullsized":"2023-08-25T05:35:43.049107+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:27:05.606309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049051+0000","last_change":"2023-08-25T05:35:41.426812+0000","last_active":"2023-08-25T05:35:43.049051+0000","last_peered":"2023-08-25T05:35:43.049051+0000","last_clean":"2023-08-25T05:35:43.049051+0000","last_became_active":"2023-08-25T05:35:41.426533+0000","last_became_peered":"2023-08-25T05:35:41.426533+0000","last_unstale":"2023-08-25T05:35:43.049051+0000","last_undegraded":"2023-08-25T05:35:43.049051+0000","last_fullsized":"2023-08-25T05:35:43.049051+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:15:29.376118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048456+0000","last_change":"2023-08-25T05:35:40.411511+0000","last_active":"2023-08-25T05:35:43.048456+0000","last_peered":"2023-08-25T05:35:43.048456+0000","last_clean":"2023-08-25T05:35:43.048456+0000","last_became_active":"2023-08-25T05:35:40.411197+0000","last_became_peered":"2023-08-25T05:35:40.411197+0000","last_unstale":"2023-08-25T05:35:43.048456+0000","last_undegraded":"2023-08-25T05:35:43.048456+0000","last_fullsized":"2023-08-25T05:35:43.048456+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:51:47.975073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049174+0000","last_change":"2023-08-25T05:35:41.420762+0000","last_active":"2023-08-25T05:35:43.049174+0000","last_peered":"2023-08-25T05:35:43.049174+0000","last_clean":"2023-08-25T05:35:43.049174+0000","last_became_active":"2023-08-25T05:35:41.420331+0000","last_became_peered":"2023-08-25T05:35:41.420331+0000","last_unstale":"2023-08-25T05:35:43.049174+0000","last_undegraded":"2023-08-25T05:35:43.049174+0000","last_fullsized":"2023-08-25T05:35:43.049174+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:18:21.935963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049078+0000","last_change":"2023-08-25T05:35:40.414188+0000","last_active":"2023-08-25T05:35:43.049078+0000","last_peered":"2023-08-25T05:35:43.049078+0000","last_clean":"2023-08-25T05:35:43.049078+0000","last_became_active":"2023-08-25T05:35:40.413850+0000","last_became_peered":"2023-08-25T05:35:40.413850+0000","last_unstale":"2023-08-25T05:35:43.049078+0000","last_undegraded":"2023-08-25T05:35:43.049078+0000","last_fullsized":"2023-08-25T05:35:43.049078+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:37:33.219813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048401+0000","last_change":"2023-08-25T05:35:41.418394+0000","last_active":"2023-08-25T05:35:43.048401+0000","last_peered":"2023-08-25T05:35:43.048401+0000","last_clean":"2023-08-25T05:35:43.048401+0000","last_became_active":"2023-08-25T05:35:41.417373+0000","last_became_peered":"2023-08-25T05:35:41.417373+0000","last_unstale":"2023-08-25T05:35:43.048401+0000","last_undegraded":"2023-08-25T05:35:43.048401+0000","last_fullsized":"2023-08-25T05:35:43.048401+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:01:58.749724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049167+0000","last_change":"2023-08-25T05:35:40.406707+0000","last_active":"2023-08-25T05:35:43.049167+0000","last_peered":"2023-08-25T05:35:43.049167+0000","last_clean":"2023-08-25T05:35:43.049167+0000","last_became_active":"2023-08-25T05:35:40.406429+0000","last_became_peered":"2023-08-25T05:35:40.406429+0000","last_unstale":"2023-08-25T05:35:43.049167+0000","last_undegraded":"2023-08-25T05:35:43.049167+0000","last_fullsized":"2023-08-25T05:35:43.049167+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:00:42.395339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548102+0000","last_change":"2023-08-25T05:35:41.424871+0000","last_active":"2023-08-25T05:35:42.548102+0000","last_peered":"2023-08-25T05:35:42.548102+0000","last_clean":"2023-08-25T05:35:42.548102+0000","last_became_active":"2023-08-25T05:35:41.424548+0000","last_became_peered":"2023-08-25T05:35:41.424548+0000","last_unstale":"2023-08-25T05:35:42.548102+0000","last_undegraded":"2023-08-25T05:35:42.548102+0000","last_fullsized":"2023-08-25T05:35:42.548102+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:58:59.984677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"188'1","reported_seq":14,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401361+0000","last_change":"2023-08-25T05:35:40.419160+0000","last_active":"2023-08-25T05:35:42.401361+0000","last_peered":"2023-08-25T05:35:42.401361+0000","last_clean":"2023-08-25T05:35:42.401361+0000","last_became_active":"2023-08-25T05:35:40.418867+0000","last_became_peered":"2023-08-25T05:35:40.418867+0000","last_unstale":"2023-08-25T05:35:42.401361+0000","last_undegraded":"2023-08-25T05:35:42.401361+0000","last_fullsized":"2023-08-25T05:35:42.401361+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:25:25.921734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048686+0000","last_change":"2023-08-25T05:35:41.412777+0000","last_active":"2023-08-25T05:35:43.048686+0000","last_peered":"2023-08-25T05:35:43.048686+0000","last_clean":"2023-08-25T05:35:43.048686+0000","last_became_active":"2023-08-25T05:35:41.412478+0000","last_became_peered":"2023-08-25T05:35:41.412478+0000","last_unstale":"2023-08-25T05:35:43.048686+0000","last_undegraded":"2023-08-25T05:35:43.048686+0000","last_fullsized":"2023-08-25T05:35:43.048686+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:52:28.055587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401243+0000","last_change":"2023-08-25T05:35:40.414212+0000","last_active":"2023-08-25T05:35:42.401243+0000","last_peered":"2023-08-25T05:35:42.401243+0000","last_clean":"2023-08-25T05:35:42.401243+0000","last_became_active":"2023-08-25T05:35:40.413942+0000","last_became_peered":"2023-08-25T05:35:40.413942+0000","last_unstale":"2023-08-25T05:35:42.401243+0000","last_undegraded":"2023-08-25T05:35:42.401243+0000","last_fullsized":"2023-08-25T05:35:42.401243+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:44:01.225110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548104+0000","last_change":"2023-08-25T05:35:41.425451+0000","last_active":"2023-08-25T05:35:42.548104+0000","last_peered":"2023-08-25T05:35:42.548104+0000","last_clean":"2023-08-25T05:35:42.548104+0000","last_became_active":"2023-08-25T05:35:41.425115+0000","last_became_peered":"2023-08-25T05:35:41.425115+0000","last_unstale":"2023-08-25T05:35:42.548104+0000","last_undegraded":"2023-08-25T05:35:42.548104+0000","last_fullsized":"2023-08-25T05:35:42.548104+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:52:03.049176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048877+0000","last_change":"2023-08-25T05:35:40.414225+0000","last_active":"2023-08-25T05:35:43.048877+0000","last_peered":"2023-08-25T05:35:43.048877+0000","last_clean":"2023-08-25T05:35:43.048877+0000","last_became_active":"2023-08-25T05:35:40.413875+0000","last_became_peered":"2023-08-25T05:35:40.413875+0000","last_unstale":"2023-08-25T05:35:43.048877+0000","last_undegraded":"2023-08-25T05:35:43.048877+0000","last_fullsized":"2023-08-25T05:35:43.048877+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:55:52.258432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400446+0000","last_change":"2023-08-25T05:35:41.420349+0000","last_active":"2023-08-25T05:35:42.400446+0000","last_peered":"2023-08-25T05:35:42.400446+0000","last_clean":"2023-08-25T05:35:42.400446+0000","last_became_active":"2023-08-25T05:35:41.420070+0000","last_became_peered":"2023-08-25T05:35:41.420070+0000","last_unstale":"2023-08-25T05:35:42.400446+0000","last_undegraded":"2023-08-25T05:35:42.400446+0000","last_fullsized":"2023-08-25T05:35:42.400446+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:17:43.798231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400377+0000","last_change":"2023-08-25T05:35:40.401833+0000","last_active":"2023-08-25T05:35:42.400377+0000","last_peered":"2023-08-25T05:35:42.400377+0000","last_clean":"2023-08-25T05:35:42.400377+0000","last_became_active":"2023-08-25T05:35:40.401410+0000","last_became_peered":"2023-08-25T05:35:40.401410+0000","last_unstale":"2023-08-25T05:35:42.400377+0000","last_undegraded":"2023-08-25T05:35:42.400377+0000","last_fullsized":"2023-08-25T05:35:42.400377+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:38:18.310667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049523+0000","last_change":"2023-08-25T05:35:41.411460+0000","last_active":"2023-08-25T05:35:43.049523+0000","last_peered":"2023-08-25T05:35:43.049523+0000","last_clean":"2023-08-25T05:35:43.049523+0000","last_became_active":"2023-08-25T05:35:41.411139+0000","last_became_peered":"2023-08-25T05:35:41.411139+0000","last_unstale":"2023-08-25T05:35:43.049523+0000","last_undegraded":"2023-08-25T05:35:43.049523+0000","last_fullsized":"2023-08-25T05:35:43.049523+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:05:13.838540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401009+0000","last_change":"2023-08-25T05:35:40.415437+0000","last_active":"2023-08-25T05:35:42.401009+0000","last_peered":"2023-08-25T05:35:42.401009+0000","last_clean":"2023-08-25T05:35:42.401009+0000","last_became_active":"2023-08-25T05:35:40.415149+0000","last_became_peered":"2023-08-25T05:35:40.415149+0000","last_unstale":"2023-08-25T05:35:42.401009+0000","last_undegraded":"2023-08-25T05:35:42.401009+0000","last_fullsized":"2023-08-25T05:35:42.401009+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:41:44.542923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401251+0000","last_change":"2023-08-25T05:35:41.411974+0000","last_active":"2023-08-25T05:35:42.401251+0000","last_peered":"2023-08-25T05:35:42.401251+0000","last_clean":"2023-08-25T05:35:42.401251+0000","last_became_active":"2023-08-25T05:35:41.411700+0000","last_became_peered":"2023-08-25T05:35:41.411700+0000","last_unstale":"2023-08-25T05:35:42.401251+0000","last_undegraded":"2023-08-25T05:35:42.401251+0000","last_fullsized":"2023-08-25T05:35:42.401251+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:49:17.173963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048775+0000","last_change":"2023-08-25T05:35:40.413516+0000","last_active":"2023-08-25T05:35:43.048775+0000","last_peered":"2023-08-25T05:35:43.048775+0000","last_clean":"2023-08-25T05:35:43.048775+0000","last_became_active":"2023-08-25T05:35:40.413218+0000","last_became_peered":"2023-08-25T05:35:40.413218+0000","last_unstale":"2023-08-25T05:35:43.048775+0000","last_undegraded":"2023-08-25T05:35:43.048775+0000","last_fullsized":"2023-08-25T05:35:43.048775+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:12:16.082782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048882+0000","last_change":"2023-08-25T05:35:41.424427+0000","last_active":"2023-08-25T05:35:43.048882+0000","last_peered":"2023-08-25T05:35:43.048882+0000","last_clean":"2023-08-25T05:35:43.048882+0000","last_became_active":"2023-08-25T05:35:41.424098+0000","last_became_peered":"2023-08-25T05:35:41.424098+0000","last_unstale":"2023-08-25T05:35:43.048882+0000","last_undegraded":"2023-08-25T05:35:43.048882+0000","last_fullsized":"2023-08-25T05:35:43.048882+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:59:39.438262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.047989+0000","last_change":"2023-08-25T05:35:40.412563+0000","last_active":"2023-08-25T05:35:43.047989+0000","last_peered":"2023-08-25T05:35:43.047989+0000","last_clean":"2023-08-25T05:35:43.047989+0000","last_became_active":"2023-08-25T05:35:40.412276+0000","last_became_peered":"2023-08-25T05:35:40.412276+0000","last_unstale":"2023-08-25T05:35:43.047989+0000","last_undegraded":"2023-08-25T05:35:43.047989+0000","last_fullsized":"2023-08-25T05:35:43.047989+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:46:35.252558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048607+0000","last_change":"2023-08-25T05:35:41.418774+0000","last_active":"2023-08-25T05:35:43.048607+0000","last_peered":"2023-08-25T05:35:43.048607+0000","last_clean":"2023-08-25T05:35:43.048607+0000","last_became_active":"2023-08-25T05:35:41.418472+0000","last_became_peered":"2023-08-25T05:35:41.418472+0000","last_unstale":"2023-08-25T05:35:43.048607+0000","last_undegraded":"2023-08-25T05:35:43.048607+0000","last_fullsized":"2023-08-25T05:35:43.048607+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:19.217529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401211+0000","last_change":"2023-08-25T05:35:40.418728+0000","last_active":"2023-08-25T05:35:42.401211+0000","last_peered":"2023-08-25T05:35:42.401211+0000","last_clean":"2023-08-25T05:35:42.401211+0000","last_became_active":"2023-08-25T05:35:40.418445+0000","last_became_peered":"2023-08-25T05:35:40.418445+0000","last_unstale":"2023-08-25T05:35:42.401211+0000","last_undegraded":"2023-08-25T05:35:42.401211+0000","last_fullsized":"2023-08-25T05:35:42.401211+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:07:02.816830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"176'3631","reported_seq":4546,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049223+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:35:43.049223+0000","last_peered":"2023-08-25T05:35:43.049223+0000","last_clean":"2023-08-25T05:35:43.049223+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:35:43.049223+0000","last_undegraded":"2023-08-25T05:35:43.049223+0000","last_fullsized":"2023-08-25T05:35:43.049223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3631,"log_dups_size":0,"ondisk_log_size":3631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:38:35.230013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1904,"num_read_kb":3991,"num_write":525,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":333,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049370+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:35:43.049370+0000","last_peered":"2023-08-25T05:35:43.049370+0000","last_clean":"2023-08-25T05:35:43.049370+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:35:43.049370+0000","last_undegraded":"2023-08-25T05:35:43.049370+0000","last_fullsized":"2023-08-25T05:35:43.049370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:21:40.444029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400759+0000","last_change":"2023-08-25T05:35:41.425051+0000","last_active":"2023-08-25T05:35:42.400759+0000","last_peered":"2023-08-25T05:35:42.400759+0000","last_clean":"2023-08-25T05:35:42.400759+0000","last_became_active":"2023-08-25T05:35:41.424778+0000","last_became_peered":"2023-08-25T05:35:41.424778+0000","last_unstale":"2023-08-25T05:35:42.400759+0000","last_undegraded":"2023-08-25T05:35:42.400759+0000","last_fullsized":"2023-08-25T05:35:42.400759+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:57:11.814103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"187'3","reported_seq":16,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400733+0000","last_change":"2023-08-25T05:35:40.409842+0000","last_active":"2023-08-25T05:35:42.400733+0000","last_peered":"2023-08-25T05:35:42.400733+0000","last_clean":"2023-08-25T05:35:42.400733+0000","last_became_active":"2023-08-25T05:35:40.409487+0000","last_became_peered":"2023-08-25T05:35:40.409487+0000","last_unstale":"2023-08-25T05:35:42.400733+0000","last_undegraded":"2023-08-25T05:35:42.400733+0000","last_fullsized":"2023-08-25T05:35:42.400733+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:27:01.220692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":329,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049187+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:35:43.049187+0000","last_peered":"2023-08-25T05:35:43.049187+0000","last_clean":"2023-08-25T05:35:43.049187+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:35:43.049187+0000","last_undegraded":"2023-08-25T05:35:43.049187+0000","last_fullsized":"2023-08-25T05:35:43.049187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:28:04.380893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048384+0000","last_change":"2023-08-25T05:35:41.419498+0000","last_active":"2023-08-25T05:35:43.048384+0000","last_peered":"2023-08-25T05:35:43.048384+0000","last_clean":"2023-08-25T05:35:43.048384+0000","last_became_active":"2023-08-25T05:35:41.419216+0000","last_became_peered":"2023-08-25T05:35:41.419216+0000","last_unstale":"2023-08-25T05:35:43.048384+0000","last_undegraded":"2023-08-25T05:35:43.048384+0000","last_fullsized":"2023-08-25T05:35:43.048384+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:32:41.108174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"187'6","reported_seq":19,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401062+0000","last_change":"2023-08-25T05:35:40.418772+0000","last_active":"2023-08-25T05:35:42.401062+0000","last_peered":"2023-08-25T05:35:42.401062+0000","last_clean":"2023-08-25T05:35:42.401062+0000","last_became_active":"2023-08-25T05:35:40.418526+0000","last_became_peered":"2023-08-25T05:35:40.418526+0000","last_unstale":"2023-08-25T05:35:42.401062+0000","last_undegraded":"2023-08-25T05:35:42.401062+0000","last_fullsized":"2023-08-25T05:35:42.401062+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:15.554963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":337,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048546+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:35:43.048546+0000","last_peered":"2023-08-25T05:35:43.048546+0000","last_clean":"2023-08-25T05:35:43.048546+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:35:43.048546+0000","last_undegraded":"2023-08-25T05:35:43.048546+0000","last_fullsized":"2023-08-25T05:35:43.048546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:15:17.631751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048863+0000","last_change":"2023-08-25T05:35:41.408501+0000","last_active":"2023-08-25T05:35:43.048863+0000","last_peered":"2023-08-25T05:35:43.048863+0000","last_clean":"2023-08-25T05:35:43.048863+0000","last_became_active":"2023-08-25T05:35:41.408179+0000","last_became_peered":"2023-08-25T05:35:41.408179+0000","last_unstale":"2023-08-25T05:35:43.048863+0000","last_undegraded":"2023-08-25T05:35:43.048863+0000","last_fullsized":"2023-08-25T05:35:43.048863+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:45:13.001472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401279+0000","last_change":"2023-08-25T05:35:40.416043+0000","last_active":"2023-08-25T05:35:42.401279+0000","last_peered":"2023-08-25T05:35:42.401279+0000","last_clean":"2023-08-25T05:35:42.401279+0000","last_became_active":"2023-08-25T05:35:40.415749+0000","last_became_peered":"2023-08-25T05:35:40.415749+0000","last_unstale":"2023-08-25T05:35:42.401279+0000","last_undegraded":"2023-08-25T05:35:42.401279+0000","last_fullsized":"2023-08-25T05:35:42.401279+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:41:52.123478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":333,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048658+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:35:43.048658+0000","last_peered":"2023-08-25T05:35:43.048658+0000","last_clean":"2023-08-25T05:35:43.048658+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:35:43.048658+0000","last_undegraded":"2023-08-25T05:35:43.048658+0000","last_fullsized":"2023-08-25T05:35:43.048658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:11:09.193027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049448+0000","last_change":"2023-08-25T05:35:41.417745+0000","last_active":"2023-08-25T05:35:43.049448+0000","last_peered":"2023-08-25T05:35:43.049448+0000","last_clean":"2023-08-25T05:35:43.049448+0000","last_became_active":"2023-08-25T05:35:41.417432+0000","last_became_peered":"2023-08-25T05:35:41.417432+0000","last_unstale":"2023-08-25T05:35:43.049448+0000","last_undegraded":"2023-08-25T05:35:43.049448+0000","last_fullsized":"2023-08-25T05:35:43.049448+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:45:36.691656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048717+0000","last_change":"2023-08-25T05:35:40.407963+0000","last_active":"2023-08-25T05:35:43.048717+0000","last_peered":"2023-08-25T05:35:43.048717+0000","last_clean":"2023-08-25T05:35:43.048717+0000","last_became_active":"2023-08-25T05:35:40.407674+0000","last_became_peered":"2023-08-25T05:35:40.407674+0000","last_unstale":"2023-08-25T05:35:43.048717+0000","last_undegraded":"2023-08-25T05:35:43.048717+0000","last_fullsized":"2023-08-25T05:35:43.048717+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:25:39.852933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":363,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548360+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:35:42.548360+0000","last_peered":"2023-08-25T05:35:42.548360+0000","last_clean":"2023-08-25T05:35:42.548360+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:35:42.548360+0000","last_undegraded":"2023-08-25T05:35:42.548360+0000","last_fullsized":"2023-08-25T05:35:42.548360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:50:24.550266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048744+0000","last_change":"2023-08-25T05:35:41.421488+0000","last_active":"2023-08-25T05:35:43.048744+0000","last_peered":"2023-08-25T05:35:43.048744+0000","last_clean":"2023-08-25T05:35:43.048744+0000","last_became_active":"2023-08-25T05:35:41.420950+0000","last_became_peered":"2023-08-25T05:35:41.420950+0000","last_unstale":"2023-08-25T05:35:43.048744+0000","last_undegraded":"2023-08-25T05:35:43.048744+0000","last_fullsized":"2023-08-25T05:35:43.048744+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:19:08.128371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"187'8","reported_seq":21,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548059+0000","last_change":"2023-08-25T05:35:40.408649+0000","last_active":"2023-08-25T05:35:42.548059+0000","last_peered":"2023-08-25T05:35:42.548059+0000","last_clean":"2023-08-25T05:35:42.548059+0000","last_became_active":"2023-08-25T05:35:40.408384+0000","last_became_peered":"2023-08-25T05:35:40.408384+0000","last_unstale":"2023-08-25T05:35:42.548059+0000","last_undegraded":"2023-08-25T05:35:42.548059+0000","last_fullsized":"2023-08-25T05:35:42.548059+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:28:41.500292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":327,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.049550+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:35:43.049550+0000","last_peered":"2023-08-25T05:35:43.049550+0000","last_clean":"2023-08-25T05:35:43.049550+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:35:43.049550+0000","last_undegraded":"2023-08-25T05:35:43.049550+0000","last_fullsized":"2023-08-25T05:35:43.049550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:56:16.988841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400258+0000","last_change":"2023-08-25T05:35:41.415881+0000","last_active":"2023-08-25T05:35:42.400258+0000","last_peered":"2023-08-25T05:35:42.400258+0000","last_clean":"2023-08-25T05:35:42.400258+0000","last_became_active":"2023-08-25T05:35:41.415589+0000","last_became_peered":"2023-08-25T05:35:41.415589+0000","last_unstale":"2023-08-25T05:35:42.400258+0000","last_undegraded":"2023-08-25T05:35:42.400258+0000","last_fullsized":"2023-08-25T05:35:42.400258+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:09:10.011656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"187'2","reported_seq":15,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:43.048870+0000","last_change":"2023-08-25T05:35:40.411989+0000","last_active":"2023-08-25T05:35:43.048870+0000","last_peered":"2023-08-25T05:35:43.048870+0000","last_clean":"2023-08-25T05:35:43.048870+0000","last_became_active":"2023-08-25T05:35:40.411679+0000","last_became_peered":"2023-08-25T05:35:40.411679+0000","last_unstale":"2023-08-25T05:35:43.048870+0000","last_undegraded":"2023-08-25T05:35:43.048870+0000","last_fullsized":"2023-08-25T05:35:43.048870+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:27:24.581704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":361,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548567+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:35:42.548567+0000","last_peered":"2023-08-25T05:35:42.548567+0000","last_clean":"2023-08-25T05:35:42.548567+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:35:42.548567+0000","last_undegraded":"2023-08-25T05:35:42.548567+0000","last_fullsized":"2023-08-25T05:35:42.548567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:00:51.036225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":11,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.548368+0000","last_change":"2023-08-25T05:35:41.425099+0000","last_active":"2023-08-25T05:35:42.548368+0000","last_peered":"2023-08-25T05:35:42.548368+0000","last_clean":"2023-08-25T05:35:42.548368+0000","last_became_active":"2023-08-25T05:35:41.424715+0000","last_became_peered":"2023-08-25T05:35:41.424715+0000","last_unstale":"2023-08-25T05:35:42.548368+0000","last_undegraded":"2023-08-25T05:35:42.548368+0000","last_fullsized":"2023-08-25T05:35:42.548368+0000","mapping_epoch":186,"log_start":"0'0","ondisk_log_start":"0'0","created":186,"last_epoch_clean":187,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:40.381621+0000","last_clean_scrub_stamp":"2023-08-25T05:35:40.381621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:38:13.442695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.401003+0000","last_change":"2023-08-25T05:35:40.411718+0000","last_active":"2023-08-25T05:35:42.401003+0000","last_peered":"2023-08-25T05:35:42.401003+0000","last_clean":"2023-08-25T05:35:42.401003+0000","last_became_active":"2023-08-25T05:35:40.411291+0000","last_became_peered":"2023-08-25T05:35:40.411291+0000","last_unstale":"2023-08-25T05:35:42.401003+0000","last_undegraded":"2023-08-25T05:35:42.401003+0000","last_fullsized":"2023-08-25T05:35:42.401003+0000","mapping_epoch":185,"log_start":"0'0","ondisk_log_start":"0'0","created":185,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:35:39.370172+0000","last_clean_scrub_stamp":"2023-08-25T05:35:39.370172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:54:55.227629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":383,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-25T05:35:42.400626+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:35:42.400626+0000","last_peered":"2023-08-25T05:35:42.400626+0000","last_clean":"2023-08-25T05:35:42.400626+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:35:42.400626+0000","last_undegraded":"2023-08-25T05:35:42.400626+0000","last_fullsized":"2023-08-25T05:35:42.400626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:32:21.310345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1904,"num_read_kb":3991,"num_write":525,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3631,"ondisk_log_size":3631,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510550,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52096,"kb_used_data":2868,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319744,"statfs":{"total":96636764160,"available":96583417856,"internally_reserved":0,"allocated":2936832,"data_stored":1780113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.745,"15min":0.74199999999999999},"min":{"1min":0.60099999999999998,"5min":0.44400000000000001,"15min":0.40999999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":1.0169999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.74399999999999999,"15min":0.751},"min":{"1min":0.53900000000000003,"5min":0.48199999999999998,"15min":0.441},"max":{"1min":0.93100000000000005,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.747,"15min":0.75900000000000001},"min":{"1min":0.52700000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.96299999999999997,"5min":1.054,"15min":1.054},"last":0.751},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.59299999999999997,"5min":0.47999999999999998,"15min":0.46800000000000003},"max":{"1min":0.97999999999999998,"5min":0.98099999999999998,"15min":1.026},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.747,"15min":0.753},"min":{"1min":0.54700000000000004,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95899999999999996,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76900000000000002,"15min":0.76400000000000001},"min":{"1min":0.58899999999999997,"5min":0.55500000000000005,"15min":0.53600000000000003},"max":{"1min":0.97299999999999998,"5min":1.0329999999999999,"15min":1.0840000000000001},"last":0.70099999999999996}]},{"osd":3,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76100000000000001,"15min":0.76900000000000002},"min":{"1min":0.57999999999999996,"5min":0.53300000000000003,"15min":0.51700000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.49399999999999999},"max":{"1min":0.93600000000000005,"5min":1.0600000000000001,"15min":1.0680000000000001},"last":0.79500000000000004}]},{"osd":4,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.44,"5min":0.40799999999999997,"15min":0.39100000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.032},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.61699999999999999,"15min":0.61799999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.90400000000000003,"5min":1.163,"15min":1.163},"last":0.54100000000000004}]},{"osd":5,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60699999999999998,"15min":0.623},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.36599999999999999},"max":{"1min":0.77000000000000002,"5min":0.997,"15min":1.1120000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.65900000000000003,"15min":0.66900000000000004},"min":{"1min":0.47499999999999998,"5min":0.435,"15min":0.42699999999999999},"max":{"1min":0.873,"5min":1.04,"15min":1.0640000000000001},"last":0.73599999999999999}]},{"osd":6,"last update":"Fri Aug 25 05:35:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.499,"15min":0.47999999999999998},"max":{"1min":0.94499999999999995,"5min":1.028,"15min":1.0960000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68700000000000006,"15min":0.69699999999999995},"min":{"1min":0.47299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95999999999999996,"5min":1.119,"15min":1.119},"last":0.71999999999999997}]}]},{"osd":6,"up_from":15,"seq":64424510551,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33476,"kb_used_data":2288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338364,"statfs":{"total":96636764160,"available":96602484736,"internally_reserved":0,"allocated":2342912,"data_stored":1189745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.753,"15min":0.751},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.93300000000000005,"5min":0.99099999999999999,"15min":1.0449999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.73999999999999999},"min":{"1min":0.40100000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91700000000000004,"5min":1.0389999999999999,"15min":1.1699999999999999},"last":0.61899999999999999}]},{"osd":1,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.76000000000000001,"15min":0.76300000000000001},"min":{"1min":0.55000000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.89500000000000002,"5min":0.97299999999999998,"15min":1.1559999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.74299999999999999,"15min":0.76000000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89900000000000002,"5min":1.022,"15min":1.1299999999999999},"last":0.79500000000000004}]},{"osd":2,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.77000000000000002,"15min":0.79100000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.97699999999999998,"5min":1.0760000000000001,"15min":1.0780000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.51900000000000002},"max":{"1min":0.94499999999999995,"5min":1.0669999999999999,"15min":1.1599999999999999},"last":0.83899999999999997}]},{"osd":3,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.46400000000000002},"max":{"1min":0.90500000000000003,"5min":1.0049999999999999,"15min":1.208},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.78400000000000003,"15min":0.79000000000000004},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92500000000000004,"5min":1.054,"15min":1.236},"last":0.76200000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.59099999999999997},"min":{"1min":0.439,"5min":0.38400000000000001,"15min":0.33200000000000002},"max":{"1min":0.80400000000000005,"5min":0.84899999999999998,"15min":1.018},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.44700000000000001,"5min":0.40500000000000003,"15min":0.35499999999999998},"max":{"1min":0.74299999999999999,"5min":0.85799999999999998,"15min":1.016},"last":0.503}]},{"osd":5,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64700000000000002,"15min":0.65100000000000002},"min":{"1min":0.48899999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.77700000000000002,"5min":0.95599999999999996,"15min":1.1319999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.72199999999999998,"15min":0.73399999999999999},"min":{"1min":0.44500000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.1659999999999999},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:35:34 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65500000000000003,"15min":0.66200000000000003},"min":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.39700000000000002},"max":{"1min":0.81699999999999995,"5min":0.97199999999999998,"15min":1.044},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.68200000000000005,"15min":0.69699999999999995},"min":{"1min":0.502,"5min":0.48499999999999999,"15min":0.42899999999999999},"max":{"1min":0.95299999999999996,"5min":1.228,"15min":1.228},"last":0.63700000000000001}]}]},{"osd":5,"up_from":14,"seq":60129543253,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59844,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311996,"statfs":{"total":96636764160,"available":96575483904,"internally_reserved":0,"allocated":2351104,"data_stored":1189869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76600000000000001,"15min":0.753},"min":{"1min":0.52400000000000002,"5min":0.499,"15min":0.38600000000000001},"max":{"1min":0.97799999999999998,"5min":0.98199999999999998,"15min":1.034},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76900000000000002,"15min":0.76000000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63900000000000001}]},{"osd":1,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77200000000000002,"15min":0.76900000000000002},"min":{"1min":0.497,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78800000000000003,"15min":0.77600000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45000000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.50600000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.75700000000000001},"min":{"1min":0.51400000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.77400000000000002,"15min":0.77500000000000002},"min":{"1min":0.56799999999999995,"5min":0.55300000000000005,"15min":0.47999999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.77800000000000002,"15min":0.76900000000000002},"min":{"1min":0.59899999999999998,"5min":0.56200000000000006,"15min":0.51400000000000001},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.80500000000000005,"15min":0.79500000000000004},"min":{"1min":0.63,"5min":0.55200000000000005,"15min":0.54800000000000004},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.45500000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:35:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.64800000000000002,"15min":0.60499999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.434},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.66300000000000003,"15min":0.63100000000000001},"min":{"1min":0.50700000000000001,"5min":0.48599999999999999,"15min":0.42499999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.56999999999999995}]},{"osd":6,"last update":"Fri Aug 25 05:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.68999999999999995,"15min":0.66800000000000004},"min":{"1min":0.56699999999999995,"5min":0.47899999999999998,"15min":0.42199999999999999},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.68799999999999994,"15min":0.68000000000000005},"min":{"1min":0.52000000000000002,"5min":0.496,"15min":0.44900000000000001},"max":{"1min":0.97299999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Aug 25 05:34:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.67300000000000004,"15min":0.65800000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.42499999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.76000000000000001,"15min":0.73599999999999999},"min":{"1min":0.56100000000000005,"5min":0.52700000000000002,"15min":0.46000000000000002},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.754}]}]},{"osd":4,"up_from":14,"seq":60129543253,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29328,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342512,"statfs":{"total":96636764160,"available":96606732288,"internally_reserved":0,"allocated":2359296,"data_stored":1190509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.72999999999999998,"15min":0.74099999999999999},"min":{"1min":0.53000000000000003,"5min":0.49199999999999999,"15min":0.46700000000000003},"max":{"1min":0.92900000000000005,"5min":0.94099999999999995,"15min":1.054},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.54800000000000004,"5min":0.503,"15min":0.44700000000000001},"max":{"1min":0.90600000000000003,"5min":0.97799999999999998,"15min":1.02},"last":0.625}]},{"osd":1,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.51000000000000001,"15min":0.46200000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.113},"last":0.82399999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54100000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.995,"5min":0.995,"15min":1.097},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76200000000000001,"15min":0.77600000000000002},"min":{"1min":0.55700000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.069,"5min":1.069,"15min":1.079},"last":0.67300000000000004}]},{"osd":3,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.57199999999999995,"5min":0.49099999999999999,"15min":0.47799999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78900000000000003,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.1559999999999999},"last":0.749}]},{"osd":5,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41499999999999998,"5min":0.377,"15min":0.36899999999999999},"max":{"1min":0.88,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.46500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":0.96799999999999997,"15min":0.98299999999999998},"last":0.89500000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.748,"15min":0.75},"min":{"1min":0.59899999999999998,"5min":0.49399999999999999,"15min":0.49199999999999999},"max":{"1min":0.99299999999999999,"5min":1.008,"15min":1.1240000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.98299999999999998,"5min":0.98799999999999999,"15min":1.0629999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri Aug 25 05:35:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.46400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.83099999999999996,"5min":0.996,"15min":0.996},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71899999999999997,"15min":0.72499999999999998},"min":{"1min":0.496,"5min":0.48799999999999999,"15min":0.47599999999999998},"max":{"1min":1.018,"5min":1.0389999999999999,"15min":1.0860000000000001},"last":0.76200000000000001}]}]},{"osd":3,"up_from":14,"seq":60129543254,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59856,"kb_used_data":2308,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311984,"statfs":{"total":96636764160,"available":96575471616,"internally_reserved":0,"allocated":2363392,"data_stored":1191961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.745,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34000000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.92900000000000005},"last":0.68799999999999994}]},{"osd":1,"last update":"Fri Aug 25 05:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.34999999999999998,"5min":0.33800000000000002,"15min":0.33300000000000002},"max":{"1min":0.61299999999999999,"5min":0.70899999999999996,"15min":1.0780000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61899999999999999,"15min":0.626},"min":{"1min":0.438,"5min":0.438,"15min":0.40300000000000002},"max":{"1min":0.88900000000000001,"5min":0.93200000000000005,"15min":0.97999999999999998},"last":0.73199999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61499999999999999,"15min":0.61699999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88800000000000001,"5min":1.0089999999999999,"15min":1.038},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70499999999999996,"5min":0.79000000000000004,"15min":0.95799999999999996},"last":0.63500000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79100000000000004,"15min":0.79600000000000004},"min":{"1min":0.56399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.84099999999999997,"15min":0.82999999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.82099999999999995}]},{"osd":5,"last update":"Fri Aug 25 05:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81000000000000005,"15min":0.80300000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.82999999999999996,"15min":0.82899999999999996},"min":{"1min":0.59699999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.016,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.88100000000000001}]},{"osd":6,"last update":"Fri Aug 25 05:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.86199999999999999,"15min":0.86699999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59399999999999997},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84199999999999997,"15min":0.83899999999999997},"min":{"1min":0.60699999999999998,"5min":0.58399999999999996,"15min":0.48999999999999999},"max":{"1min":1.133,"5min":1.133,"15min":1.194},"last":0.93500000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:35:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.87,"15min":0.877},"min":{"1min":0.63500000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.51800000000000002},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.80100000000000005}]}]},{"osd":2,"up_from":14,"seq":60129543255,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59836,"kb_used_data":2288,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312004,"statfs":{"total":96636764160,"available":96575492096,"internally_reserved":0,"allocated":2342912,"data_stored":1189745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.32800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.64200000000000002,"5min":0.71799999999999997,"15min":0.81100000000000005},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53500000000000003,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.746,"5min":0.85099999999999998,"15min":0.86099999999999999},"last":0.51800000000000002}]},{"osd":1,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51500000000000001,"15min":0.504},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.33300000000000002},"max":{"1min":0.66900000000000004,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64200000000000002,"15min":0.63300000000000001},"min":{"1min":0.52800000000000002,"5min":0.51300000000000001,"15min":0.47799999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.89700000000000002},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.36899999999999999},"max":{"1min":0.745,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60399999999999998,"15min":0.59899999999999998},"min":{"1min":0.41699999999999998,"5min":0.41599999999999998,"15min":0.41299999999999998},"max":{"1min":0.83699999999999997,"5min":0.89500000000000002,"15min":0.91200000000000003},"last":0.70699999999999996}]},{"osd":4,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83299999999999996,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.59199999999999997,"15min":0.48699999999999999},"max":{"1min":1.0089999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.54600000000000004},"max":{"1min":1.0489999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":1.028}]},{"osd":5,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83299999999999996,"15min":0.82599999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.51700000000000002},"max":{"1min":1.075,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.097},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.84099999999999997,"15min":0.85699999999999998},"min":{"1min":0.70699999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.98399999999999999,"5min":1.266,"15min":1.266},"last":1.0149999999999999}]},{"osd":6,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84499999999999997,"15min":0.85899999999999999},"min":{"1min":0.68799999999999994,"5min":0.61599999999999999,"15min":0.61199999999999999},"max":{"1min":1.0680000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.875,"5min":0.89000000000000001,"15min":0.88300000000000001},"min":{"1min":0.65200000000000002,"5min":0.63100000000000001,"15min":0.58899999999999997},"max":{"1min":1.089,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.0509999999999999}]},{"osd":7,"last update":"Fri Aug 25 05:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83099999999999996,"15min":0.83699999999999997},"min":{"1min":0.64400000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.095,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83399999999999996,"15min":0.83699999999999997},"min":{"1min":0.67700000000000005,"5min":0.60699999999999998,"15min":0.58399999999999996},"max":{"1min":1.0109999999999999,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.137}]}]},{"osd":1,"up_from":14,"seq":60129543255,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41808,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330032,"statfs":{"total":96636764160,"available":96593952768,"internally_reserved":0,"allocated":2355200,"data_stored":1191357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48999999999999999,"15min":0.48499999999999999},"min":{"1min":0.34799999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":0.75600000000000001,"15min":0.94399999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54700000000000004,"15min":0.54300000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.33500000000000002},"max":{"1min":0.73799999999999999,"5min":0.80400000000000005,"15min":0.879},"last":0.316}]},{"osd":2,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52500000000000002,"15min":0.51200000000000001},"min":{"1min":0.437,"5min":0.36299999999999999,"15min":0.33300000000000002},"max":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.81399999999999995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60199999999999998,"15min":0.58999999999999997},"min":{"1min":0.45200000000000001,"5min":0.41599999999999998,"15min":0.41199999999999998},"max":{"1min":0.80800000000000005,"5min":0.88300000000000001,"15min":0.91400000000000003},"last":0.39000000000000001}]},{"osd":3,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66000000000000003,"15min":0.65300000000000002},"min":{"1min":0.48799999999999999,"5min":0.47299999999999998,"15min":0.46100000000000002},"max":{"1min":0.90600000000000003,"5min":0.998,"15min":0.998},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.51300000000000001,"5min":0.42499999999999999,"15min":0.39300000000000002},"max":{"1min":0.84699999999999998,"5min":0.88700000000000001,"15min":0.98699999999999999},"last":0.42099999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.81200000000000006,"15min":0.80300000000000005},"min":{"1min":0.59299999999999997,"5min":0.57399999999999995,"15min":0.48299999999999998},"max":{"1min":1.079,"5min":1.1559999999999999,"15min":1.2350000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.85699999999999998,"15min":0.84599999999999997},"min":{"1min":0.66800000000000004,"5min":0.63300000000000001,"15min":0.56999999999999995},"max":{"1min":1.147,"5min":1.268,"15min":1.268},"last":0.75900000000000001}]},{"osd":5,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.81699999999999995,"15min":0.81899999999999995},"min":{"1min":0.58899999999999997,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.1950000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84799999999999998,"15min":0.83399999999999996},"min":{"1min":0.64600000000000002,"5min":0.57099999999999995,"15min":0.55300000000000005},"max":{"1min":1.1890000000000001,"5min":1.214,"15min":1.214},"last":0.79100000000000004}]},{"osd":6,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.90000000000000002,"15min":0.878},"min":{"1min":0.72199999999999998,"5min":0.67800000000000005,"15min":0.59599999999999997},"max":{"1min":1.034,"5min":1.244,"15min":1.244},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85399999999999998,"15min":0.84599999999999997},"min":{"1min":0.64500000000000002,"5min":0.57999999999999996,"15min":0.55600000000000005},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.63400000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:34:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.84999999999999998,"15min":0.84699999999999998},"min":{"1min":0.60899999999999999,"5min":0.59999999999999998,"15min":0.55600000000000005},"max":{"1min":1.149,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90800000000000003,"15min":0.89900000000000002},"min":{"1min":0.73699999999999999,"5min":0.69599999999999995,"15min":0.626},"max":{"1min":1.127,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.72399999999999998}]}]},{"osd":0,"up_from":14,"seq":60129543254,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60428,"kb_used_data":2876,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311412,"statfs":{"total":96636764160,"available":96574885888,"internally_reserved":0,"allocated":2945024,"data_stored":1780217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.5,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66400000000000003,"5min":0.70799999999999996,"15min":1.2170000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58799999999999997,"15min":0.59099999999999997},"min":{"1min":0.46999999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.85999999999999999},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.36199999999999999,"15min":0.33900000000000002},"max":{"1min":0.624,"5min":0.81799999999999995,"15min":0.91000000000000003},"last":0.438},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41699999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71099999999999997,"5min":0.85199999999999998,"15min":0.86799999999999999},"last":0.48199999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51900000000000002,"15min":0.53200000000000003},"min":{"1min":0.378,"5min":0.34399999999999997,"15min":0.33700000000000002},"max":{"1min":0.67800000000000005,"5min":0.83499999999999996,"15min":1.855},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61899999999999999,"15min":0.63},"min":{"1min":0.45200000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.69799999999999995,"5min":0.86599999999999999,"15min":1.3480000000000001},"last":0.61199999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.86399999999999999,"15min":0.84799999999999998},"min":{"1min":0.63700000000000001,"5min":0.59999999999999998,"15min":0.53500000000000003},"max":{"1min":1.2210000000000001,"5min":1.2729999999999999,"15min":1.3799999999999999},"last":0.879},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83099999999999996,"15min":0.84099999999999997},"min":{"1min":0.64600000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2729999999999999,"5min":1.2809999999999999,"15min":1.2849999999999999},"last":0.85799999999999998}]},{"osd":5,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81899999999999995,"15min":0.83299999999999996},"min":{"1min":0.57399999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0960000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.84799999999999998,"15min":0.85299999999999998},"min":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.996,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.98199999999999998}]},{"osd":6,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.59099999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.256,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.68000000000000005,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.141,"5min":1.3560000000000001,"15min":1.5129999999999999},"last":0.94199999999999995}]},{"osd":7,"last update":"Fri Aug 25 05:35:07 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.88900000000000001,"15min":0.88500000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0740000000000001,"5min":1.4339999999999999,"15min":1.5720000000000001},"last":1.012},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.84699999999999998,"15min":0.85699999999999998},"min":{"1min":0.65700000000000003,"5min":0.60099999999999998,"15min":0.58099999999999996},"max":{"1min":1.161,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.92600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:35:50.446 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-25T05:35:50.446 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-25T05:35:50.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0fe9c640 1 Processor -- start 2023-08-25T05:35:50.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0fe9c640 1 -- start start 2023-08-25T05:35:50.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0fe9c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3a0815e3c0 0x7f3a0815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:50.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0fe9c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a080cd5a0 con 0x7f3a081601f0 2023-08-25T05:35:50.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0fe9c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a080cd880 con 0x7f3a080d1290 2023-08-25T05:35:50.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0fe9c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a080cdb60 con 0x7f3a0815e3c0 2023-08-25T05:35:50.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0dc38640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3a081601f0 0x7f3a080d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46346/0 (socket says 172.21.15.55:46346) 2023-08-25T05:35:50.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0dc38640 1 -- 172.21.15.55:0/3510206673 learned_addr learned my addr 172.21.15.55:0/3510206673 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:50.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0d437640 1 --2- 172.21.15.55:0/3510206673 >> v2:172.21.15.110:3300/0 conn(0x7f3a0815e3c0 0x7f3a0815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:50.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0cc36640 1 -- 172.21.15.55:0/3510206673 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1904831783 0 0) 0x7f3a080cd5a0 con 0x7f3a081601f0 2023-08-25T05:35:50.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0cc36640 1 -- 172.21.15.55:0/3510206673 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39f4003530 con 0x7f3a081601f0 2023-08-25T05:35:50.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0cc36640 1 -- 172.21.15.55:0/3510206673 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 743983940 0 0) 0x7f39f4003530 con 0x7f3a081601f0 2023-08-25T05:35:50.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0cc36640 1 -- 172.21.15.55:0/3510206673 >> v2:172.21.15.110:3300/0 conn(0x7f3a0815e3c0 msgr2=0x7f3a0815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:50.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0cc36640 1 --2- 172.21.15.55:0/3510206673 >> v2:172.21.15.110:3300/0 conn(0x7f3a0815e3c0 0x7f3a0815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0cc36640 1 -- 172.21.15.55:0/3510206673 >> v1:172.21.15.110:6789/0 conn(0x7f3a080d1290 legacy=0x7f3a0815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:50.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0cc36640 1 -- 172.21.15.55:0/3510206673 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a080cde40 con 0x7f3a081601f0 2023-08-25T05:35:50.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0cc36640 1 -- 172.21.15.55:0/3510206673 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f3a04001800 con 0x7f3a081601f0 2023-08-25T05:35:50.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0cc36640 1 -- 172.21.15.55:0/3510206673 >> v1:172.21.15.55:6789/0 conn(0x7f3a081601f0 legacy=0x7f3a080d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:50.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0cc36640 1 --2- 172.21.15.55:0/3510206673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39f4003980 0x7f39f4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:50.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0cc36640 1 --2- 172.21.15.55:0/3510206673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39f40047d0 0x7f39f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:50.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0cc36640 1 --2- 172.21.15.55:0/3510206673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39f4005190 0x7f39f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:50.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0cc36640 1 -- 172.21.15.55:0/3510206673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080cdb60 con 0x7f39f40047d0 2023-08-25T05:35:50.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0cc36640 1 -- 172.21.15.55:0/3510206673 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f400c030 con 0x7f39f4005190 2023-08-25T05:35:50.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0cc36640 1 -- 172.21.15.55:0/3510206673 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f400c1f0 con 0x7f39f4003980 2023-08-25T05:35:50.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0d437640 1 --2- 172.21.15.55:0/3510206673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39f40047d0 0x7f39f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:50.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.629+0000 7f3a0dc38640 1 --2- 172.21.15.55:0/3510206673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39f4003980 0x7f39f4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:50.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.633+0000 7f3a0e439640 1 --2- 172.21.15.55:0/3510206673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39f4005190 0x7f39f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:50.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.633+0000 7f3a0d437640 1 -- 172.21.15.55:0/3510206673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39f4003980 msgr2=0x7f39f4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:50.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.633+0000 7f3a0d437640 1 --2- 172.21.15.55:0/3510206673 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39f4003980 0x7f39f4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.633+0000 7f3a0d437640 1 -- 172.21.15.55:0/3510206673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39f4005190 msgr2=0x7f39f400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:50.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.633+0000 7f3a0d437640 1 --2- 172.21.15.55:0/3510206673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39f4005190 0x7f39f400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.633+0000 7f3a0d437640 1 -- 172.21.15.55:0/3510206673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f4003530 con 0x7f39f40047d0 2023-08-25T05:35:50.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.633+0000 7f3a0e439640 1 --2- 172.21.15.55:0/3510206673 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39f4005190 0x7f39f400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:50.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.633+0000 7f3a0e439640 1 -- 172.21.15.55:0/3510206673 reap_dead start 2023-08-25T05:35:50.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.633+0000 7f3a0d437640 1 --2- 172.21.15.55:0/3510206673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39f40047d0 0x7f39f4004c50 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009ae0 tx=0x7f39f801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c16c669c61efdb3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:50.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.633+0000 7f3a0cc36640 1 -- 172.21.15.55:0/3510206673 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f80a6430 con 0x7f39f40047d0 2023-08-25T05:35:50.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.633+0000 7f3a0cc36640 1 -- 172.21.15.55:0/3510206673 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f80a6590 con 0x7f39f40047d0 2023-08-25T05:35:50.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.633+0000 7f3a0cc36640 1 -- 172.21.15.55:0/3510206673 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f80a6940 con 0x7f39f40047d0 2023-08-25T05:35:50.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.633+0000 7f3a0fe9c640 1 -- 172.21.15.55:0/3510206673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39f40047d0 msgr2=0x7f39f4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:50.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.633+0000 7f3a0fe9c640 1 --2- 172.21.15.55:0/3510206673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39f40047d0 0x7f39f4004c50 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009ae0 tx=0x7f39f801ca50 comp rx=0 tx=0).stop 2023-08-25T05:35:50.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0fe9c640 1 -- 172.21.15.55:0/3510206673 shutdown_connections 2023-08-25T05:35:50.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0fe9c640 1 --2- 172.21.15.55:0/3510206673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39f40047d0 0x7f39f4004c50 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0fe9c640 1 -- 172.21.15.55:0/3510206673 >> 172.21.15.55:0/3510206673 conn(0x7f3a080d27d0 msgr2=0x7f3a080d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:50.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0fe9c640 1 -- 172.21.15.55:0/3510206673 shutdown_connections 2023-08-25T05:35:50.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0fe9c640 1 -- 172.21.15.55:0/3510206673 wait complete. 2023-08-25T05:35:50.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0fe9c640 1 Processor -- start 2023-08-25T05:35:50.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0fe9c640 1 -- start start 2023-08-25T05:35:50.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0fe9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39f40047d0 0x7f3a0814b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:50.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0fe9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a0814b850 0x7f3a080cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:50.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0fe9c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a080cc480 0x7f3a080c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:50.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0fe9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080cc910 con 0x7f3a0814b850 2023-08-25T05:35:50.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0fe9c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080c8990 con 0x7f3a080cc480 2023-08-25T05:35:50.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0fe9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a080c8c70 con 0x7f39f40047d0 2023-08-25T05:35:50.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0d437640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a0814b850 0x7f3a080cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:50.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0d437640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a0814b850 0x7f3a080cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40630/0 (socket says 172.21.15.55:40630) 2023-08-25T05:35:50.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0d437640 1 -- 172.21.15.55:0/1170048170 learned_addr learned my addr 172.21.15.55:0/1170048170 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:50.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0dc38640 1 --2- 172.21.15.55:0/1170048170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39f40047d0 0x7f3a0814b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:50.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0e439640 1 --2- 172.21.15.55:0/1170048170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a080cc480 0x7f3a080c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:50.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0d437640 1 -- 172.21.15.55:0/1170048170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39f40047d0 msgr2=0x7f3a0814b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:50.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0d437640 1 --2- 172.21.15.55:0/1170048170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39f40047d0 0x7f3a0814b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0d437640 1 -- 172.21.15.55:0/1170048170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a080cc480 msgr2=0x7f3a080c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:50.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0d437640 1 --2- 172.21.15.55:0/1170048170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a080cc480 0x7f3a080c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0d437640 1 -- 172.21.15.55:0/1170048170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a080c8f50 con 0x7f3a0814b850 2023-08-25T05:35:50.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.637+0000 7f3a0d437640 1 --2- 172.21.15.55:0/1170048170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a0814b850 0x7f3a080cbf40 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009ae0 tx=0x7f39f80197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:50.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.641+0000 7f39fe7fc640 1 -- 172.21.15.55:0/1170048170 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f80b9440 con 0x7f3a0814b850 2023-08-25T05:35:50.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.641+0000 7f39fe7fc640 1 -- 172.21.15.55:0/1170048170 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f80b95a0 con 0x7f3a0814b850 2023-08-25T05:35:50.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.641+0000 7f3a0fe9c640 1 -- 172.21.15.55:0/1170048170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0814bd40 con 0x7f3a0814b850 2023-08-25T05:35:50.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.641+0000 7f39fe7fc640 1 -- 172.21.15.55:0/1170048170 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f80b9930 con 0x7f3a0814b850 2023-08-25T05:35:50.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.641+0000 7f3a0fe9c640 1 -- 172.21.15.55:0/1170048170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a080c8210 con 0x7f3a0814b850 2023-08-25T05:35:50.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.641+0000 7f3a0fe9c640 1 -- 172.21.15.55:0/1170048170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a080b5260 con 0x7f3a0814b850 2023-08-25T05:35:50.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.641+0000 7f39fe7fc640 1 -- 172.21.15.55:0/1170048170 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f39f80a7410 con 0x7f3a0814b850 2023-08-25T05:35:50.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.641+0000 7f39fe7fc640 1 --2- 172.21.15.55:0/1170048170 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f39ec0657d0 0x7f39ec067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:50.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.641+0000 7f39fe7fc640 1 -- 172.21.15.55:0/1170048170 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f39f811d3d0 con 0x7f3a0814b850 2023-08-25T05:35:50.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.641+0000 7f3a0dc38640 1 --2- 172.21.15.55:0/1170048170 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f39ec0657d0 0x7f39ec067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:50.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.645+0000 7f3a0dc38640 1 --2- 172.21.15.55:0/1170048170 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f39ec0657d0 0x7f39ec067c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3a04000c10 tx=0x7f3a04000f80 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:50.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.645+0000 7f39fe7fc640 1 -- 172.21.15.55:0/1170048170 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f39f80ee710 con 0x7f3a0814b850 2023-08-25T05:35:50.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.857+0000 7f3a0fe9c640 1 -- 172.21.15.55:0/1170048170 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3a080c8db0 con 0x7f3a0814b850 2023-08-25T05:35:50.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.861+0000 7f39fe7fc640 1 -- 172.21.15.55:0/1170048170 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v49) v1 ==== 190+0+147 (secure 0 0 0) 0x7f3a080c8db0 con 0x7f3a0814b850 2023-08-25T05:35:50.866 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2023-08-25T05:35:50.866 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g== 2023-08-25T05:35:50.866 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2023-08-25T05:35:50.866 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2023-08-25T05:35:50.866 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-25T05:35:50.866 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-08-25T05:35:50.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.865+0000 7f3a0fe9c640 1 -- 172.21.15.55:0/1170048170 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f39ec0657d0 msgr2=0x7f39ec067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:50.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.865+0000 7f3a0fe9c640 1 --2- 172.21.15.55:0/1170048170 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f39ec0657d0 0x7f39ec067c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3a04000c10 tx=0x7f3a04000f80 comp rx=0 tx=0).stop 2023-08-25T05:35:50.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.865+0000 7f3a0fe9c640 1 -- 172.21.15.55:0/1170048170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a0814b850 msgr2=0x7f3a080cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:50.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.865+0000 7f3a0fe9c640 1 --2- 172.21.15.55:0/1170048170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a0814b850 0x7f3a080cbf40 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009ae0 tx=0x7f39f80197f0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.865+0000 7f3a0fe9c640 1 -- 172.21.15.55:0/1170048170 shutdown_connections 2023-08-25T05:35:50.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.865+0000 7f3a0fe9c640 1 --2- 172.21.15.55:0/1170048170 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f39ec0657d0 0x7f39ec067c90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.865+0000 7f3a0fe9c640 1 --2- 172.21.15.55:0/1170048170 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a080cc480 0x7f3a080c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.865+0000 7f3a0fe9c640 1 --2- 172.21.15.55:0/1170048170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a0814b850 0x7f3a080cbf40 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.865+0000 7f3a0fe9c640 1 --2- 172.21.15.55:0/1170048170 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39f40047d0 0x7f3a0814b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:50.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.865+0000 7f3a0fe9c640 1 -- 172.21.15.55:0/1170048170 >> 172.21.15.55:0/1170048170 conn(0x7f3a080d27d0 msgr2=0x7f3a080d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:50.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.865+0000 7f3a0fe9c640 1 -- 172.21.15.55:0/1170048170 shutdown_connections 2023-08-25T05:35:50.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:50.865+0000 7f3a0fe9c640 1 -- 172.21.15.55:0/1170048170 wait complete. 2023-08-25T05:35:50.886 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:35:51.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.025+0000 7f603f396640 1 Processor -- start 2023-08-25T05:35:51.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.025+0000 7f603f396640 1 -- start start 2023-08-25T05:35:51.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.025+0000 7f603f396640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6038164410 0x7f60380b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.025+0000 7f603f396640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60380cddf0 0x7f60380c1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.025+0000 7f603f396640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60380cc510 con 0x7f60380c18b0 2023-08-25T05:35:51.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.025+0000 7f603f396640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60380c1d60 con 0x7f6038164410 2023-08-25T05:35:51.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.025+0000 7f603f396640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60381647f0 con 0x7f60380cddf0 2023-08-25T05:35:51.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.025+0000 7f603d132640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6038164410 0x7f60380b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.025+0000 7f603d933640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f60380c18b0 0x7f60380cac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46354/0 (socket says 172.21.15.55:46354) 2023-08-25T05:35:51.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.025+0000 7f603d933640 1 -- 172.21.15.55:0/2867886205 learned_addr learned my addr 172.21.15.55:0/2867886205 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:51.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.029+0000 7f603c931640 1 --2- 172.21.15.55:0/2867886205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60380cddf0 0x7f60380c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.029+0000 7f603d132640 1 -- 172.21.15.55:0/2867886205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60380cddf0 msgr2=0x7f60380c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:51.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.029+0000 7f603d132640 1 --2- 172.21.15.55:0/2867886205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60380cddf0 0x7f60380c1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.029+0000 7f603d132640 1 -- 172.21.15.55:0/2867886205 >> v1:172.21.15.55:6789/0 conn(0x7f60380c18b0 legacy=0x7f60380cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:51.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.029+0000 7f603d132640 1 -- 172.21.15.55:0/2867886205 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60380cc9b0 con 0x7f6038164410 2023-08-25T05:35:51.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.029+0000 7f602ffff640 1 -- 172.21.15.55:0/2867886205 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2881459580 0 0) 0x7f60380cc510 con 0x7f60380c18b0 2023-08-25T05:35:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.029+0000 7f603d132640 1 --2- 172.21.15.55:0/2867886205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6038164410 0x7f60380b21b0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f60340097c0 tx=0x7f603401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18faa66efb9f445c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.029+0000 7f602ffff640 1 -- 172.21.15.55:0/2867886205 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60340ab600 con 0x7f6038164410 2023-08-25T05:35:51.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.029+0000 7f602ffff640 1 -- 172.21.15.55:0/2867886205 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60340a7050 con 0x7f6038164410 2023-08-25T05:35:51.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.029+0000 7f602ffff640 1 -- 172.21.15.55:0/2867886205 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60340ab980 con 0x7f6038164410 2023-08-25T05:35:51.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.029+0000 7f603f396640 1 -- 172.21.15.55:0/2867886205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6038164410 msgr2=0x7f60380b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:51.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.029+0000 7f603f396640 1 --2- 172.21.15.55:0/2867886205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6038164410 0x7f60380b21b0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f60340097c0 tx=0x7f603401c480 comp rx=0 tx=0).stop 2023-08-25T05:35:51.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603f396640 1 -- 172.21.15.55:0/2867886205 shutdown_connections 2023-08-25T05:35:51.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603f396640 1 --2- 172.21.15.55:0/2867886205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60380cddf0 0x7f60380c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603f396640 1 --2- 172.21.15.55:0/2867886205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6038164410 0x7f60380b21b0 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603f396640 1 -- 172.21.15.55:0/2867886205 >> 172.21.15.55:0/2867886205 conn(0x7f6038069d00 msgr2=0x7f603806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:51.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603f396640 1 -- 172.21.15.55:0/2867886205 shutdown_connections 2023-08-25T05:35:51.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603f396640 1 -- 172.21.15.55:0/2867886205 wait complete. 2023-08-25T05:35:51.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603f396640 1 Processor -- start 2023-08-25T05:35:51.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603f396640 1 -- start start 2023-08-25T05:35:51.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603f396640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60380c18b0 0x7f603815fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603f396640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60380cddf0 0x7f60380ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603f396640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6038164410 0x7f6038162a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603f396640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603815ecb0 con 0x7f60380c18b0 2023-08-25T05:35:51.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603f396640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603815ef90 con 0x7f6038164410 2023-08-25T05:35:51.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603f396640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603815f270 con 0x7f60380cddf0 2023-08-25T05:35:51.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603d132640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60380c18b0 0x7f603815fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603d132640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60380c18b0 0x7f603815fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40640/0 (socket says 172.21.15.55:40640) 2023-08-25T05:35:51.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603d132640 1 -- 172.21.15.55:0/1977723665 learned_addr learned my addr 172.21.15.55:0/1977723665 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:51.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603c931640 1 --2- 172.21.15.55:0/1977723665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60380cddf0 0x7f60380ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603d933640 1 --2- 172.21.15.55:0/1977723665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6038164410 0x7f6038162a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603d132640 1 -- 172.21.15.55:0/1977723665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60380cddf0 msgr2=0x7f60380ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:51.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603d132640 1 --2- 172.21.15.55:0/1977723665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60380cddf0 0x7f60380ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603d132640 1 -- 172.21.15.55:0/1977723665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6038164410 msgr2=0x7f6038162a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:51.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603d132640 1 --2- 172.21.15.55:0/1977723665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6038164410 0x7f6038162a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603d132640 1 -- 172.21.15.55:0/1977723665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6034009420 con 0x7f60380c18b0 2023-08-25T05:35:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f603d132640 1 --2- 172.21.15.55:0/1977723665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60380c18b0 0x7f603815fd50 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f603401ab30 tx=0x7f603401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.033+0000 7f602dffb640 1 -- 172.21.15.55:0/1977723665 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034004230 con 0x7f60380c18b0 2023-08-25T05:35:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.037+0000 7f602dffb640 1 -- 172.21.15.55:0/1977723665 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6034004390 con 0x7f60380c18b0 2023-08-25T05:35:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.037+0000 7f603f396640 1 -- 172.21.15.55:0/1977723665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603815f550 con 0x7f60380c18b0 2023-08-25T05:35:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.037+0000 7f602dffb640 1 -- 172.21.15.55:0/1977723665 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034003820 con 0x7f60380c18b0 2023-08-25T05:35:51.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.037+0000 7f603f396640 1 -- 172.21.15.55:0/1977723665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603815e960 con 0x7f60380c18b0 2023-08-25T05:35:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.037+0000 7f603f396640 1 -- 172.21.15.55:0/1977723665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603804dbe0 con 0x7f60380c18b0 2023-08-25T05:35:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.037+0000 7f602dffb640 1 -- 172.21.15.55:0/1977723665 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f6034003980 con 0x7f60380c18b0 2023-08-25T05:35:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.037+0000 7f602dffb640 1 --2- 172.21.15.55:0/1977723665 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f601c0657d0 0x7f601c067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.037+0000 7f602dffb640 1 -- 172.21.15.55:0/1977723665 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f603411d780 con 0x7f60380c18b0 2023-08-25T05:35:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.037+0000 7f603c931640 1 --2- 172.21.15.55:0/1977723665 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f601c0657d0 0x7f601c067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.041+0000 7f603c931640 1 --2- 172.21.15.55:0/1977723665 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f601c0657d0 0x7f601c067c90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6038071e50 tx=0x7f6028008040 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:51.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.041+0000 7f602dffb640 1 -- 172.21.15.55:0/1977723665 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f60340eb130 con 0x7f60380c18b0 2023-08-25T05:35:51.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.229+0000 7f603f396640 1 -- 172.21.15.55:0/1977723665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f603815d360 con 0x7f60380c18b0 2023-08-25T05:35:51.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.229+0000 7f602dffb640 1 -- 172.21.15.55:0/1977723665 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4886 (secure 0 0 0) 0x7f6034006e20 con 0x7f60380c18b0 2023-08-25T05:35:51.234 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:51.234 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8768,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1348996798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1348996798},{"type":"v1","addr":"172.21.15.110:6837","nonce":1348996798}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":9988,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/623585793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":623585793},{"type":"v1","addr":"172.21.15.110:6836","nonce":623585793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":10782,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3873137631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3873137631},{"type":"v1","addr":"172.21.15.55:6834","nonce":3873137631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:35:40.794599+0000","modified":"2023-08-25T05:35:44.431342+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":10785},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10785":{"gid":10785,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1770370805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1770370805},{"type":"v1","addr":"172.21.15.55:6835","nonce":1770370805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-25T05:35:51.235 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 91 2023-08-25T05:35:51.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.233+0000 7f603f396640 1 -- 172.21.15.55:0/1977723665 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f601c0657d0 msgr2=0x7f601c067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:51.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.233+0000 7f603f396640 1 --2- 172.21.15.55:0/1977723665 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f601c0657d0 0x7f601c067c90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6038071e50 tx=0x7f6028008040 comp rx=0 tx=0).stop 2023-08-25T05:35:51.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.233+0000 7f603f396640 1 -- 172.21.15.55:0/1977723665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60380c18b0 msgr2=0x7f603815fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:51.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.233+0000 7f603f396640 1 --2- 172.21.15.55:0/1977723665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60380c18b0 0x7f603815fd50 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f603401ab30 tx=0x7f603401acc0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.233+0000 7f603f396640 1 -- 172.21.15.55:0/1977723665 shutdown_connections 2023-08-25T05:35:51.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.233+0000 7f603f396640 1 --2- 172.21.15.55:0/1977723665 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f601c0657d0 0x7f601c067c90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.233+0000 7f603f396640 1 --2- 172.21.15.55:0/1977723665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6038164410 0x7f6038162a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.233+0000 7f603f396640 1 --2- 172.21.15.55:0/1977723665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60380cddf0 0x7f60380ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.233+0000 7f603f396640 1 --2- 172.21.15.55:0/1977723665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60380c18b0 0x7f603815fd50 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.233+0000 7f603f396640 1 -- 172.21.15.55:0/1977723665 >> 172.21.15.55:0/1977723665 conn(0x7f6038069d00 msgr2=0x7f60381539c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:51.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.233+0000 7f603f396640 1 -- 172.21.15.55:0/1977723665 shutdown_connections 2023-08-25T05:35:51.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.233+0000 7f603f396640 1 -- 172.21.15.55:0/1977723665 wait complete. 2023-08-25T05:35:51.658 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 91, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-25T05:35:40.794599+0000', 'modified': '2023-08-25T05:35:44.431342+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10785}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10785': {'gid': 10785, 'name': 'c', 'rank': 0, 'incarnation': 88, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6835/1770370805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6833', 'nonce': 1770370805}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 1770370805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-25T05:35:51.659 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-25T05:35:51.659 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-25T05:35:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.801+0000 7f1fc243c640 1 Processor -- start 2023-08-25T05:35:51.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.805+0000 7f1fc243c640 1 -- start start 2023-08-25T05:35:51.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.805+0000 7f1fc243c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fbc15ca50 0x7f1fbc0d0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.805+0000 7f1fc243c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fbc0afe20 con 0x7f1fbc06c320 2023-08-25T05:35:51.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.805+0000 7f1fc243c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fbc0af210 con 0x7f1fbc0d0f50 2023-08-25T05:35:51.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.805+0000 7f1fc243c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc0d13d0 con 0x7f1fbc15ca50 2023-08-25T05:35:51.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.805+0000 7f1fc1c3b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1fbc06c320 0x7f1fbc0b02b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46362/0 (socket says 172.21.15.55:46362) 2023-08-25T05:35:51.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.805+0000 7f1fc1c3b640 1 -- 172.21.15.55:0/3698950502 learned_addr learned my addr 172.21.15.55:0/3698950502 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:51.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.805+0000 7f1fc143a640 1 --2- 172.21.15.55:0/3698950502 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fbc15ca50 0x7f1fbc0d0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.805+0000 7f1fb3fff640 1 -- 172.21.15.55:0/3698950502 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637206802 0 0) 0x7f1fbc0afe20 con 0x7f1fbc06c320 2023-08-25T05:35:51.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.805+0000 7f1fb3fff640 1 -- 172.21.15.55:0/3698950502 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fa8003530 con 0x7f1fbc06c320 2023-08-25T05:35:51.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.805+0000 7f1fb3fff640 1 -- 172.21.15.55:0/3698950502 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212902996 0 0) 0x7f1fbc0af210 con 0x7f1fbc0d0f50 2023-08-25T05:35:51.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.805+0000 7f1fb3fff640 1 -- 172.21.15.55:0/3698950502 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fbc0afe20 con 0x7f1fbc0d0f50 2023-08-25T05:35:51.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.805+0000 7f1fb3fff640 1 -- 172.21.15.55:0/3698950502 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4002821756 0 0) 0x7f1fa8003530 con 0x7f1fbc06c320 2023-08-25T05:35:51.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.805+0000 7f1fc143a640 1 -- 172.21.15.55:0/3698950502 >> v1:172.21.15.110:6789/0 conn(0x7f1fbc0d0f50 legacy=0x7f1fbc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:51.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.805+0000 7f1fc143a640 1 -- 172.21.15.55:0/3698950502 >> v1:172.21.15.55:6789/0 conn(0x7f1fbc06c320 legacy=0x7f1fbc0b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:51.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.805+0000 7f1fc143a640 1 -- 172.21.15.55:0/3698950502 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fbc0af4f0 con 0x7f1fbc15ca50 2023-08-25T05:35:51.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.809+0000 7f1fc143a640 1 --2- 172.21.15.55:0/3698950502 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fbc15ca50 0x7f1fbc0d0a10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80097d0 tx=0x7f1fb801c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1c30545ae14da1e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:51.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.809+0000 7f1fb3fff640 1 -- 172.21.15.55:0/3698950502 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4001a00 con 0x7f1fbc15ca50 2023-08-25T05:35:51.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.809+0000 7f1fb3fff640 1 -- 172.21.15.55:0/3698950502 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb80ac440 con 0x7f1fbc15ca50 2023-08-25T05:35:51.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.809+0000 7f1fb3fff640 1 -- 172.21.15.55:0/3698950502 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb80ac7d0 con 0x7f1fbc15ca50 2023-08-25T05:35:51.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.809+0000 7f1fc243c640 1 -- 172.21.15.55:0/3698950502 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fbc15ca50 msgr2=0x7f1fbc0d0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:51.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.809+0000 7f1fc243c640 1 --2- 172.21.15.55:0/3698950502 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fbc15ca50 0x7f1fbc0d0a10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80097d0 tx=0x7f1fb801c390 comp rx=0 tx=0).stop 2023-08-25T05:35:51.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.809+0000 7f1fc243c640 1 -- 172.21.15.55:0/3698950502 shutdown_connections 2023-08-25T05:35:51.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.809+0000 7f1fc243c640 1 --2- 172.21.15.55:0/3698950502 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fbc15ca50 0x7f1fbc0d0a10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.809+0000 7f1fc243c640 1 -- 172.21.15.55:0/3698950502 >> 172.21.15.55:0/3698950502 conn(0x7f1fbc065f40 msgr2=0x7f1fbc09b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:51.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.809+0000 7f1fc243c640 1 -- 172.21.15.55:0/3698950502 shutdown_connections 2023-08-25T05:35:51.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.809+0000 7f1fc243c640 1 -- 172.21.15.55:0/3698950502 wait complete. 2023-08-25T05:35:51.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc243c640 1 Processor -- start 2023-08-25T05:35:51.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc243c640 1 -- start start 2023-08-25T05:35:51.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc243c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fbc06c320 0x7f1fbc0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc243c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fbc0d0f50 0x7f1fbc15bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc243c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fbc15ca50 0x7f1fbc0caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc243c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc0cc110 con 0x7f1fbc15ca50 2023-08-25T05:35:51.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc243c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc0cd080 con 0x7f1fbc06c320 2023-08-25T05:35:51.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc243c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc0cd2f0 con 0x7f1fbc0d0f50 2023-08-25T05:35:51.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc1c3b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fbc15ca50 0x7f1fbc0caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc1c3b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fbc15ca50 0x7f1fbc0caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40644/0 (socket says 172.21.15.55:40644) 2023-08-25T05:35:51.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc1c3b640 1 -- 172.21.15.55:0/1246343528 learned_addr learned my addr 172.21.15.55:0/1246343528 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:51.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc143a640 1 --2- 172.21.15.55:0/1246343528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fbc06c320 0x7f1fbc0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc0c39640 1 --2- 172.21.15.55:0/1246343528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fbc0d0f50 0x7f1fbc15bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc1c3b640 1 -- 172.21.15.55:0/1246343528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fbc0d0f50 msgr2=0x7f1fbc15bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:51.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc1c3b640 1 --2- 172.21.15.55:0/1246343528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fbc0d0f50 0x7f1fbc15bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc1c3b640 1 -- 172.21.15.55:0/1246343528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fbc06c320 msgr2=0x7f1fbc0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:51.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc1c3b640 1 --2- 172.21.15.55:0/1246343528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fbc06c320 0x7f1fbc0b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc1c3b640 1 -- 172.21.15.55:0/1246343528 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb80093b0 con 0x7f1fbc15ca50 2023-08-25T05:35:51.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc0c39640 1 --2- 172.21.15.55:0/1246343528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fbc0d0f50 0x7f1fbc15bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:35:51.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc1c3b640 1 --2- 172.21.15.55:0/1246343528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fbc15ca50 0x7f1fbc0caef0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4002030 tx=0x7f1fb400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:51.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fb1ffb640 1 -- 172.21.15.55:0/1246343528 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4012400 con 0x7f1fbc15ca50 2023-08-25T05:35:51.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fb1ffb640 1 -- 172.21.15.55:0/1246343528 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb4012560 con 0x7f1fbc15ca50 2023-08-25T05:35:51.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fb1ffb640 1 -- 172.21.15.55:0/1246343528 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4012910 con 0x7f1fbc15ca50 2023-08-25T05:35:51.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc243c640 1 -- 172.21.15.55:0/1246343528 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fbc0cd5d0 con 0x7f1fbc15ca50 2023-08-25T05:35:51.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.813+0000 7f1fc243c640 1 -- 172.21.15.55:0/1246343528 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fbc0cbad0 con 0x7f1fbc15ca50 2023-08-25T05:35:51.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.817+0000 7f1fb1ffb640 1 -- 172.21.15.55:0/1246343528 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f1fb4012a70 con 0x7f1fbc15ca50 2023-08-25T05:35:51.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.817+0000 7f1fb1ffb640 1 --2- 172.21.15.55:0/1246343528 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f1fa00657a0 0x7f1fa0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.817+0000 7f1fb1ffb640 1 -- 172.21.15.55:0/1246343528 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1fb4083760 con 0x7f1fbc15ca50 2023-08-25T05:35:51.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.817+0000 7f1fc143a640 1 --2- 172.21.15.55:0/1246343528 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f1fa00657a0 0x7f1fa0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.817+0000 7f1fc6a0e000 1 Processor -- start 2023-08-25T05:35:51.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.817+0000 7f1fc6a0e000 1 -- start start 2023-08-25T05:35:51.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.817+0000 7f1fc143a640 1 --2- 172.21.15.55:0/1246343528 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f1fa00657a0 0x7f1fa0067c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80ae000 tx=0x7f1fb80a6070 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:51.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.817+0000 7f1fc6a0e000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12f20020 0x558c12f20400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.817+0000 7f1fc6a0e000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12f20940 0x558c12ed6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.817+0000 7f1fc6a0e000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12ed65b0 0x558c12ed6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.817+0000 7f1fc6a0e000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c12d2c440 con 0x558c12ed65b0 2023-08-25T05:35:51.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.817+0000 7f1fc6a0e000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c12d29970 con 0x558c12f20940 2023-08-25T05:35:51.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.817+0000 7f1fc6a0e000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x558c12d25260 con 0x558c12f20020 2023-08-25T05:35:51.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc1c3b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12ed65b0 0x558c12ed6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc143a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12f20020 0x558c12f20400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc1c3b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12ed65b0 0x558c12ed6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40654/0 (socket says 172.21.15.55:40654) 2023-08-25T05:35:51.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc1c3b640 1 -- 172.21.15.55:0/73482056 learned_addr learned my addr 172.21.15.55:0/73482056 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:51.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc0c39640 1 --2- 172.21.15.55:0/73482056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12f20940 0x558c12ed6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc1c3b640 1 -- 172.21.15.55:0/73482056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12f20020 msgr2=0x558c12f20400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:51.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc1c3b640 1 --2- 172.21.15.55:0/73482056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12f20020 0x558c12f20400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc1c3b640 1 -- 172.21.15.55:0/73482056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12f20940 msgr2=0x558c12ed6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:51.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc1c3b640 1 --2- 172.21.15.55:0/73482056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12f20940 0x558c12ed6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc1c3b640 1 -- 172.21.15.55:0/73482056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c12dbdec0 con 0x558c12ed65b0 2023-08-25T05:35:51.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc1c3b640 1 --2- 172.21.15.55:0/73482056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12ed65b0 0x558c12ed6990 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4054d60 tx=0x7f1fb4058b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c60aece0d6ba29 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:51.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1f9effd640 1 -- 172.21.15.55:0/73482056 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4052fd0 con 0x558c12ed65b0 2023-08-25T05:35:51.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1f9effd640 1 -- 172.21.15.55:0/73482056 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb4012d20 con 0x558c12ed65b0 2023-08-25T05:35:51.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1f9effd640 1 -- 172.21.15.55:0/73482056 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4012e90 con 0x558c12ed65b0 2023-08-25T05:35:51.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/73482056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12ed65b0 msgr2=0x558c12ed6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:51.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/73482056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12ed65b0 0x558c12ed6990 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4054d60 tx=0x7f1fb4058b90 comp rx=0 tx=0).stop 2023-08-25T05:35:51.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/73482056 shutdown_connections 2023-08-25T05:35:51.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/73482056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12ed65b0 0x558c12ed6990 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/73482056 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12f20940 0x558c12ed6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/73482056 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12f20020 0x558c12f20400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/73482056 >> 172.21.15.55:0/73482056 conn(0x558c12ed2560 msgr2=0x558c12ed4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:51.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/73482056 shutdown_connections 2023-08-25T05:35:51.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/73482056 wait complete. 2023-08-25T05:35:51.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc6a0e000 1 -- start start 2023-08-25T05:35:51.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc6a0e000 1 Processor -- start 2023-08-25T05:35:51.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc6a0e000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12ed65b0 0x558c12f27380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc6a0e000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20020 0x558c12f278c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.821+0000 7f1fc6a0e000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12f20940 0x558c12f0ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c12cdff60 con 0x558c12f20020 2023-08-25T05:35:51.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c12cdfc00 con 0x558c12ed65b0 2023-08-25T05:35:51.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x558c129e0940 con 0x558c12f20940 2023-08-25T05:35:51.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 10 client.0 _ll_register_callbacks cb 0x558c12ec1900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T05:35:51.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc0c39640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20020 0x558c12f278c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc0c39640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20020 0x558c12f278c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40658/0 (socket says 172.21.15.55:40658) 2023-08-25T05:35:51.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc0c39640 1 -- 172.21.15.55:0/2336940742 learned_addr learned my addr 172.21.15.55:0/2336940742 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:51.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc143a640 1 --2- 172.21.15.55:0/2336940742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12ed65b0 0x558c12f27380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc1c3b640 1 --2- 172.21.15.55:0/2336940742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12f20940 0x558c12f0ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc0c39640 1 -- 172.21.15.55:0/2336940742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12f20940 msgr2=0x558c12f0ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:51.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc0c39640 1 --2- 172.21.15.55:0/2336940742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12f20940 0x558c12f0ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc0c39640 1 -- 172.21.15.55:0/2336940742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12ed65b0 msgr2=0x558c12f27380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc0c39640 1 --2- 172.21.15.55:0/2336940742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12ed65b0 0x558c12f27380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc0c39640 1 -- 172.21.15.55:0/2336940742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fbc0cbad0 con 0x558c12f20020 2023-08-25T05:35:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc0c39640 1 --2- 172.21.15.55:0/2336940742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20020 0x558c12f278c0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0104d0 tx=0x7f1fac010990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528ca3825454667f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1f97fff640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T05:35:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1f97fff640 1 -- 172.21.15.55:0/2336940742 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0054e0 con 0x558c12f20020 2023-08-25T05:35:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/2336940742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c12cbc9d0 con 0x558c12f20020 2023-08-25T05:35:51.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1f97fff640 1 -- 172.21.15.55:0/2336940742 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1fac003600 con 0x558c12f20020 2023-08-25T05:35:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1f97fff640 1 -- 172.21.15.55:0/2336940742 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fac0037c0 con 0x558c12f20020 2023-08-25T05:35:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 10 client.10947 fetch_fsmap learned FSMap version 91 2023-08-25T05:35:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/2336940742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x558c12a1f890 con 0x558c12f20020 2023-08-25T05:35:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1f97fff640 1 -- 172.21.15.55:0/2336940742 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558c12cbc9d0 con 0x558c12f20020 2023-08-25T05:35:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1f97fff640 1 -- 172.21.15.55:0/2336940742 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 91) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1fac012040 con 0x558c12f20020 2023-08-25T05:35:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 10 client.10947 fetch_fsmap finished waiting for FSMap version 91 2023-08-25T05:35:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 10 client.10947 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T05:35:51.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 20 client.10947 populate_metadata read hostname 'smithi055' 2023-08-25T05:35:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/2336940742 >> [v2:172.21.15.55:6833/1770370805,v1:172.21.15.55:6835/1770370805] conn(0x558c12f0eb70 0x558c12f0ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 4 client.10947 mds_command: new command op to 10785 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-25T05:35:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/2336940742 --> [v2:172.21.15.55:6833/1770370805,v1:172.21.15.55:6835/1770370805] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558c12cdc7a0 con 0x558c12f0eb70 2023-08-25T05:35:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc143a640 1 --2- 172.21.15.55:0/2336940742 >> [v2:172.21.15.55:6833/1770370805,v1:172.21.15.55:6835/1770370805] conn(0x558c12f0eb70 0x558c12f0ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc143a640 1 --2- 172.21.15.55:0/2336940742 >> [v2:172.21.15.55:6833/1770370805,v1:172.21.15.55:6835/1770370805] conn(0x558c12f0eb70 0x558c12f0ef50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8288222564d51f21 server_cookie=5dfe8ed3eead2c4b in_seq=0 out_seq=0 2023-08-25T05:35:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1f97fff640 10 client.10947 ms_handle_connect on v2:172.21.15.55:6833/1770370805 2023-08-25T05:35:51.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1f97fff640 1 -- 172.21.15.55:0/2336940742 <== mds.0 v2:172.21.15.55:6833/1770370805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558c12cdc7a0 con 0x558c12f0eb70 2023-08-25T05:35:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1f97fff640 10 client.10947 handle_command_reply: tid=0 2023-08-25T05:35:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 1 client.10947 shutdown 2023-08-25T05:35:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/2336940742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20020 msgr2=0x558c12f278c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/2336940742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20020 0x558c12f278c0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0104d0 tx=0x7f1fac010990 comp rx=0 tx=0).stop 2023-08-25T05:35:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/2336940742 shutdown_connections 2023-08-25T05:35:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/2336940742 >> [v2:172.21.15.55:6833/1770370805,v1:172.21.15.55:6835/1770370805] conn(0x558c12f0eb70 0x558c12f0ef50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/2336940742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12f20940 0x558c12f0ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/2336940742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20020 0x558c12f278c0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1f97fff640 0 client.10947 ms_handle_reset on v2:172.21.15.55:6833/1770370805 2023-08-25T05:35:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/2336940742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12ed65b0 0x558c12f27380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.825+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/2336940742 >> 172.21.15.55:0/2336940742 conn(0x558c12ed2560 msgr2=0x558c12ed51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.829+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/2336940742 shutdown_connections 2023-08-25T05:35:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.829+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/2336940742 wait complete. 2023-08-25T05:35:51.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.829+0000 7f1fc6a0e000 20 client.10947 trim_cache size 0 max 16384 2023-08-25T05:35:51.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.841+0000 7f1fc6a0e000 1 Processor -- start 2023-08-25T05:35:51.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.841+0000 7f1fc6a0e000 1 -- start start 2023-08-25T05:35:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc6a0e000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12ed65b0 0x558c12ed5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc6a0e000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20020 0x558c12ed5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc6a0e000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12f20940 0x558c12f7ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc6a0e000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c12d240f0 con 0x558c12f20020 2023-08-25T05:35:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc6a0e000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c12cf6e80 con 0x558c12f20940 2023-08-25T05:35:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc6a0e000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x558c12d22a70 con 0x558c12ed65b0 2023-08-25T05:35:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc0c39640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20020 0x558c12ed5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc0c39640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20020 0x558c12ed5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40660/0 (socket says 172.21.15.55:40660) 2023-08-25T05:35:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc0c39640 1 -- 172.21.15.55:0/1682795088 learned_addr learned my addr 172.21.15.55:0/1682795088 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc0c39640 1 -- 172.21.15.55:0/1682795088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12ed65b0 msgr2=0x558c12ed5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:51.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc0c39640 1 --2- 172.21.15.55:0/1682795088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12ed65b0 0x558c12ed5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc0c39640 1 -- 172.21.15.55:0/1682795088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12f20940 msgr2=0x558c12f7ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:51.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc0c39640 1 --2- 172.21.15.55:0/1682795088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12f20940 0x558c12f7ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc0c39640 1 -- 172.21.15.55:0/1682795088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c12ce8190 con 0x558c12f20020 2023-08-25T05:35:51.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc0c39640 1 --2- 172.21.15.55:0/1682795088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20020 0x558c12ed5ea0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f1fac001510 tx=0x7f1fac00b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64cc3f45a79384d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:51.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1f9f7fe640 1 -- 172.21.15.55:0/1682795088 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac007b20 con 0x558c12f20020 2023-08-25T05:35:51.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1f9f7fe640 1 -- 172.21.15.55:0/1682795088 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac00d050 con 0x558c12f20020 2023-08-25T05:35:51.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1f9f7fe640 1 -- 172.21.15.55:0/1682795088 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac001c30 con 0x558c12f20020 2023-08-25T05:35:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/1682795088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20020 msgr2=0x558c12ed5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/1682795088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20020 0x558c12ed5ea0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f1fac001510 tx=0x7f1fac00b000 comp rx=0 tx=0).stop 2023-08-25T05:35:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/1682795088 shutdown_connections 2023-08-25T05:35:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/1682795088 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12f20940 0x558c12f7ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/1682795088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20020 0x558c12ed5ea0 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/1682795088 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12ed65b0 0x558c12ed5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/1682795088 >> 172.21.15.55:0/1682795088 conn(0x558c12ed2560 msgr2=0x558c12f0cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/1682795088 shutdown_connections 2023-08-25T05:35:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/1682795088 wait complete. 2023-08-25T05:35:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc6a0e000 1 -- start start 2023-08-25T05:35:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.845+0000 7f1fc6a0e000 1 Processor -- start 2023-08-25T05:35:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12ed65b0 0x558c12f25d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20940 0x558c12f7b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12f7b850 0x558c12f7bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c12d2ab10 con 0x558c12f20940 2023-08-25T05:35:51.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c12d27dc0 con 0x558c12f7b850 2023-08-25T05:35:51.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x558c12cc80d0 con 0x558c12ed65b0 2023-08-25T05:35:51.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 10 client.0 _ll_register_callbacks cb 0x7f1fb4051190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T05:35:51.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc0c39640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20940 0x558c12f7b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc0c39640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20940 0x558c12f7b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40670/0 (socket says 172.21.15.55:40670) 2023-08-25T05:35:51.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc0c39640 1 -- 172.21.15.55:0/788603323 learned_addr learned my addr 172.21.15.55:0/788603323 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:51.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc143a640 1 --2- 172.21.15.55:0/788603323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12ed65b0 0x558c12f25d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc1c3b640 1 --2- 172.21.15.55:0/788603323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12f7b850 0x558c12f7bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc0c39640 1 -- 172.21.15.55:0/788603323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12ed65b0 msgr2=0x558c12f25d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc0c39640 1 --2- 172.21.15.55:0/788603323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12ed65b0 0x558c12f25d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc0c39640 1 -- 172.21.15.55:0/788603323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12f7b850 msgr2=0x558c12f7bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc0c39640 1 --2- 172.21.15.55:0/788603323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12f7b850 0x558c12f7bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc0c39640 1 -- 172.21.15.55:0/788603323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558c12a1f890 con 0x558c12f20940 2023-08-25T05:35:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc0c39640 1 --2- 172.21.15.55:0/788603323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20940 0x558c12f7b310 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0109d0 tx=0x7f1fac001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6713fc7305f78438 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:51.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1f97fff640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T05:35:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1f97fff640 1 -- 172.21.15.55:0/788603323 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac007b20 con 0x558c12f20940 2023-08-25T05:35:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/788603323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c12f36ab0 con 0x558c12f20940 2023-08-25T05:35:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1f97fff640 1 -- 172.21.15.55:0/788603323 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1fac001c30 con 0x558c12f20940 2023-08-25T05:35:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1f97fff640 1 -- 172.21.15.55:0/788603323 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fac014460 con 0x558c12f20940 2023-08-25T05:35:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 10 client.10953 fetch_fsmap learned FSMap version 91 2023-08-25T05:35:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/788603323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x558c12cce420 con 0x558c12f20940 2023-08-25T05:35:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1f97fff640 1 -- 172.21.15.55:0/788603323 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558c12f36ab0 con 0x558c12f20940 2023-08-25T05:35:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1f97fff640 1 -- 172.21.15.55:0/788603323 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 91) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1fac012040 con 0x558c12f20940 2023-08-25T05:35:51.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 10 client.10953 fetch_fsmap finished waiting for FSMap version 91 2023-08-25T05:35:51.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 10 client.10953 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T05:35:51.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 20 client.10953 populate_metadata read hostname 'smithi055' 2023-08-25T05:35:51.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/788603323 >> [v2:172.21.15.55:6833/1770370805,v1:172.21.15.55:6835/1770370805] conn(0x558c12f7c5c0 0x558c12f7c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:51.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 4 client.10953 mds_command: new command op to 10785 tid=0[{"prefix": "status"}] 2023-08-25T05:35:51.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/788603323 --> [v2:172.21.15.55:6833/1770370805,v1:172.21.15.55:6835/1770370805] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558c12ce0880 con 0x558c12f7c5c0 2023-08-25T05:35:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc143a640 1 --2- 172.21.15.55:0/788603323 >> [v2:172.21.15.55:6833/1770370805,v1:172.21.15.55:6835/1770370805] conn(0x558c12f7c5c0 0x558c12f7c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:51.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1f97fff640 10 client.10953 ms_handle_connect on v2:172.21.15.55:6833/1770370805 2023-08-25T05:35:51.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc143a640 1 --2- 172.21.15.55:0/788603323 >> [v2:172.21.15.55:6833/1770370805,v1:172.21.15.55:6835/1770370805] conn(0x558c12f7c5c0 0x558c12f7c9a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fef8f1929797e52b server_cookie=149d3c17eb33fdbc in_seq=0 out_seq=0 2023-08-25T05:35:51.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1f97fff640 1 -- 172.21.15.55:0/788603323 <== mds.0 v2:172.21.15.55:6833/1770370805 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x558c12ce0880 con 0x558c12f7c5c0 2023-08-25T05:35:51.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1f97fff640 10 client.10953 handle_command_reply: tid=0 2023-08-25T05:35:51.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 client.10953 shutdown 2023-08-25T05:35:51.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/788603323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20940 msgr2=0x558c12f7b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:51.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/788603323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20940 0x558c12f7b310 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f1fac0109d0 tx=0x7f1fac001160 comp rx=0 tx=0).stop 2023-08-25T05:35:51.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/788603323 shutdown_connections 2023-08-25T05:35:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/788603323 >> [v2:172.21.15.55:6833/1770370805,v1:172.21.15.55:6835/1770370805] conn(0x558c12f7c5c0 0x558c12f7c9a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/788603323 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x558c12f7b850 0x558c12f7bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/788603323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558c12f20940 0x558c12f7b310 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 --2- 172.21.15.55:0/788603323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x558c12ed65b0 0x558c12f25d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1f97fff640 0 client.10953 ms_handle_reset on v2:172.21.15.55:6833/1770370805 2023-08-25T05:35:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/788603323 >> 172.21.15.55:0/788603323 conn(0x558c12ed2560 msgr2=0x558c12ed4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/788603323 shutdown_connections 2023-08-25T05:35:51.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 1 -- 172.21.15.55:0/788603323 wait complete. 2023-08-25T05:35:51.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.849+0000 7f1fc6a0e000 20 client.10953 trim_cache size 0 max 16384 2023-08-25T05:35:51.863 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T05:35:51.863 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2d2a9024-b152-4d40-880c-1686d1810590", 2023-08-25T05:35:51.863 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-08-25T05:35:51.863 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 10785, 2023-08-25T05:35:51.864 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-08-25T05:35:51.864 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-08-25T05:35:51.864 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-08-25T05:35:51.864 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.461377446, 2023-08-25T05:35:51.864 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 91, 2023-08-25T05:35:51.864 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 188, 2023-08-25T05:35:51.864 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 188, 2023-08-25T05:35:51.864 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 16.378478506 2023-08-25T05:35:51.865 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T05:35:51.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.853+0000 7f1fc243c640 1 -- 172.21.15.55:0/1246343528 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f1fa00657a0 msgr2=0x7f1fa0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:51.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.853+0000 7f1fc243c640 1 --2- 172.21.15.55:0/1246343528 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f1fa00657a0 0x7f1fa0067c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80ae000 tx=0x7f1fb80a6070 comp rx=0 tx=0).stop 2023-08-25T05:35:51.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.853+0000 7f1fc243c640 1 -- 172.21.15.55:0/1246343528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fbc15ca50 msgr2=0x7f1fbc0caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:51.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.853+0000 7f1fc243c640 1 --2- 172.21.15.55:0/1246343528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fbc15ca50 0x7f1fbc0caef0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4002030 tx=0x7f1fb400a430 comp rx=0 tx=0).stop 2023-08-25T05:35:51.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.853+0000 7f1fc243c640 1 -- 172.21.15.55:0/1246343528 shutdown_connections 2023-08-25T05:35:51.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.853+0000 7f1fc243c640 1 --2- 172.21.15.55:0/1246343528 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f1fa00657a0 0x7f1fa0067c60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.853+0000 7f1fc243c640 1 --2- 172.21.15.55:0/1246343528 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fbc15ca50 0x7f1fbc0caef0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.853+0000 7f1fc243c640 1 --2- 172.21.15.55:0/1246343528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fbc0d0f50 0x7f1fbc15bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.853+0000 7f1fc243c640 1 --2- 172.21.15.55:0/1246343528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fbc06c320 0x7f1fbc0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:51.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.853+0000 7f1fc243c640 1 -- 172.21.15.55:0/1246343528 >> 172.21.15.55:0/1246343528 conn(0x7f1fbc065f40 msgr2=0x7f1fbc15f820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:51.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.853+0000 7f1fc243c640 1 -- 172.21.15.55:0/1246343528 shutdown_connections 2023-08-25T05:35:51.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:51.853+0000 7f1fc243c640 1 -- 172.21.15.55:0/1246343528 wait complete. 2023-08-25T05:35:51.874 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T05:35:52.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.013+0000 7f7be1034640 1 Processor -- start 2023-08-25T05:35:52.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.013+0000 7f7be1034640 1 -- start start 2023-08-25T05:35:52.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.017+0000 7f7be1034640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7bdc15c9c0 0x7f7bdc160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:52.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.017+0000 7f7be1034640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bdc06eaf0 con 0x7f7bdc0cfa70 2023-08-25T05:35:52.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.017+0000 7f7be1034640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bdc06e530 con 0x7f7bdc06b2b0 2023-08-25T05:35:52.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.017+0000 7f7be1034640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bdc06e810 con 0x7f7bdc15c9c0 2023-08-25T05:35:52.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.017+0000 7f7bd3fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7bdc0cfa70 0x7f7bdc160a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46376/0 (socket says 172.21.15.55:46376) 2023-08-25T05:35:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.017+0000 7f7bd3fff640 1 -- 172.21.15.55:0/1607981361 learned_addr learned my addr 172.21.15.55:0/1607981361 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.017+0000 7f7bdad9d640 1 --2- 172.21.15.55:0/1607981361 >> v2:172.21.15.110:3300/0 conn(0x7f7bdc15c9c0 0x7f7bdc160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.017+0000 7f7bda59c640 1 -- 172.21.15.55:0/1607981361 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365427588 0 0) 0x7f7bdc06eaf0 con 0x7f7bdc0cfa70 2023-08-25T05:35:52.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.017+0000 7f7bda59c640 1 -- 172.21.15.55:0/1607981361 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bc8003530 con 0x7f7bdc0cfa70 2023-08-25T05:35:52.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.017+0000 7f7bdad9d640 1 -- 172.21.15.55:0/1607981361 >> v1:172.21.15.110:6789/0 conn(0x7f7bdc06b2b0 legacy=0x7f7bdc06b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:52.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.017+0000 7f7bdad9d640 1 -- 172.21.15.55:0/1607981361 >> v1:172.21.15.55:6789/0 conn(0x7f7bdc0cfa70 legacy=0x7f7bdc160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:52.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.017+0000 7f7bdad9d640 1 -- 172.21.15.55:0/1607981361 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc06aab0 con 0x7f7bdc15c9c0 2023-08-25T05:35:52.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.021+0000 7f7bdad9d640 1 --2- 172.21.15.55:0/1607981361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bdc15c9c0 0x7f7bdc160510 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0097a0 tx=0x7f7bcc01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=296a13ab40bade35 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:52.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.021+0000 7f7bda59c640 1 -- 172.21.15.55:0/1607981361 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc0ab5f0 con 0x7f7bdc15c9c0 2023-08-25T05:35:52.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.021+0000 7f7bda59c640 1 -- 172.21.15.55:0/1607981361 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bcc0ab750 con 0x7f7bdc15c9c0 2023-08-25T05:35:52.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.021+0000 7f7bda59c640 1 -- 172.21.15.55:0/1607981361 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc0abae0 con 0x7f7bdc15c9c0 2023-08-25T05:35:52.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.021+0000 7f7be1034640 1 -- 172.21.15.55:0/1607981361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bdc15c9c0 msgr2=0x7f7bdc160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:52.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.021+0000 7f7be1034640 1 --2- 172.21.15.55:0/1607981361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bdc15c9c0 0x7f7bdc160510 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0097a0 tx=0x7f7bcc01c430 comp rx=0 tx=0).stop 2023-08-25T05:35:52.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.021+0000 7f7be1034640 1 -- 172.21.15.55:0/1607981361 shutdown_connections 2023-08-25T05:35:52.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.021+0000 7f7be1034640 1 --2- 172.21.15.55:0/1607981361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bdc15c9c0 0x7f7bdc160510 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:52.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.021+0000 7f7be1034640 1 -- 172.21.15.55:0/1607981361 >> 172.21.15.55:0/1607981361 conn(0x7f7bdc0d05a0 msgr2=0x7f7bdc0d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:52.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.021+0000 7f7be1034640 1 -- 172.21.15.55:0/1607981361 shutdown_connections 2023-08-25T05:35:52.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.021+0000 7f7be1034640 1 -- 172.21.15.55:0/1607981361 wait complete. 2023-08-25T05:35:52.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.021+0000 7f7be1034640 1 Processor -- start 2023-08-25T05:35:52.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.021+0000 7f7be1034640 1 -- start start 2023-08-25T05:35:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7be1034640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bdc06b2b0 0x7f7bdc149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7be1034640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bdc0cfa70 0x7f7bdc158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7be1034640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7bdc15c9c0 0x7f7bdc0b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7be1034640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc14a520 con 0x7f7bdc0cfa70 2023-08-25T05:35:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7be1034640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0b3ba0 con 0x7f7bdc06b2b0 2023-08-25T05:35:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7be1034640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc149f70 con 0x7f7bdc15c9c0 2023-08-25T05:35:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7bd3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bdc0cfa70 0x7f7bdc158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7bd3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bdc0cfa70 0x7f7bdc158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40676/0 (socket says 172.21.15.55:40676) 2023-08-25T05:35:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7bd3fff640 1 -- 172.21.15.55:0/59986111 learned_addr learned my addr 172.21.15.55:0/59986111 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7bdad9d640 1 --2- 172.21.15.55:0/59986111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bdc06b2b0 0x7f7bdc149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7bdb59e640 1 --2- 172.21.15.55:0/59986111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7bdc15c9c0 0x7f7bdc0b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7bd3fff640 1 -- 172.21.15.55:0/59986111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7bdc15c9c0 msgr2=0x7f7bdc0b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7bd3fff640 1 --2- 172.21.15.55:0/59986111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7bdc15c9c0 0x7f7bdc0b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7bd3fff640 1 -- 172.21.15.55:0/59986111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bdc06b2b0 msgr2=0x7f7bdc149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7bd3fff640 1 --2- 172.21.15.55:0/59986111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bdc06b2b0 0x7f7bdc149a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7bd3fff640 1 -- 172.21.15.55:0/59986111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc0093b0 con 0x7f7bdc0cfa70 2023-08-25T05:35:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7bdad9d640 1 --2- 172.21.15.55:0/59986111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bdc06b2b0 0x7f7bdc149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7bd3fff640 1 --2- 172.21.15.55:0/59986111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bdc0cfa70 0x7f7bdc158f00 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400c500 tx=0x7f7bc400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:52.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7bd37fe640 1 -- 172.21.15.55:0/59986111 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4005cf0 con 0x7f7bdc0cfa70 2023-08-25T05:35:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7bd37fe640 1 -- 172.21.15.55:0/59986111 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc4005e50 con 0x7f7bdc0cfa70 2023-08-25T05:35:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7bd37fe640 1 -- 172.21.15.55:0/59986111 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc40072f0 con 0x7f7bdc0cfa70 2023-08-25T05:35:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7be1034640 1 -- 172.21.15.55:0/59986111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bdc0cf350 con 0x7f7bdc0cfa70 2023-08-25T05:35:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7be1034640 1 -- 172.21.15.55:0/59986111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bdc159d20 con 0x7f7bdc0cfa70 2023-08-25T05:35:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.025+0000 7f7be1034640 1 -- 172.21.15.55:0/59986111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bdc04dbe0 con 0x7f7bdc0cfa70 2023-08-25T05:35:52.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.029+0000 7f7bd37fe640 1 -- 172.21.15.55:0/59986111 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f7bc4007450 con 0x7f7bdc0cfa70 2023-08-25T05:35:52.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.029+0000 7f7bd37fe640 1 --2- 172.21.15.55:0/59986111 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f7bbc0657a0 0x7f7bbc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:52.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.029+0000 7f7bd37fe640 1 -- 172.21.15.55:0/59986111 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7bc4082410 con 0x7f7bdc0cfa70 2023-08-25T05:35:52.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.029+0000 7f7bdad9d640 1 --2- 172.21.15.55:0/59986111 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f7bbc0657a0 0x7f7bbc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:52.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.029+0000 7f7bdad9d640 1 --2- 172.21.15.55:0/59986111 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f7bbc0657a0 0x7f7bbc067c60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0af000 tx=0x7f7bcc0a7000 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:52.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.033+0000 7f7bd37fe640 1 -- 172.21.15.55:0/59986111 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7bc404ff00 con 0x7f7bdc0cfa70 2023-08-25T05:35:52.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.225+0000 7f7be1034640 1 -- 172.21.15.55:0/59986111 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7bdc0cdc20 con 0x7f7bdc0cfa70 2023-08-25T05:35:52.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.225+0000 7f7bd37fe640 1 -- 172.21.15.55:0/59986111 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v91) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7bc4053520 con 0x7f7bdc0cfa70 2023-08-25T05:35:52.229 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T05:35:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.225+0000 7f7be1034640 1 -- 172.21.15.55:0/59986111 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f7bbc0657a0 msgr2=0x7f7bbc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.225+0000 7f7be1034640 1 --2- 172.21.15.55:0/59986111 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f7bbc0657a0 0x7f7bbc067c60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0af000 tx=0x7f7bcc0a7000 comp rx=0 tx=0).stop 2023-08-25T05:35:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.225+0000 7f7be1034640 1 -- 172.21.15.55:0/59986111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bdc0cfa70 msgr2=0x7f7bdc158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.225+0000 7f7be1034640 1 --2- 172.21.15.55:0/59986111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bdc0cfa70 0x7f7bdc158f00 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400c500 tx=0x7f7bc400c9c0 comp rx=0 tx=0).stop 2023-08-25T05:35:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.225+0000 7f7be1034640 1 -- 172.21.15.55:0/59986111 shutdown_connections 2023-08-25T05:35:52.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.225+0000 7f7be1034640 1 --2- 172.21.15.55:0/59986111 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f7bbc0657a0 0x7f7bbc067c60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:52.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.225+0000 7f7be1034640 1 --2- 172.21.15.55:0/59986111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7bdc15c9c0 0x7f7bdc0b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:52.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.225+0000 7f7be1034640 1 --2- 172.21.15.55:0/59986111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bdc0cfa70 0x7f7bdc158f00 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:52.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.225+0000 7f7be1034640 1 --2- 172.21.15.55:0/59986111 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7bdc06b2b0 0x7f7bdc149a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:52.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.225+0000 7f7be1034640 1 -- 172.21.15.55:0/59986111 >> 172.21.15.55:0/59986111 conn(0x7f7bdc0d05a0 msgr2=0x7f7bdc0af6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:52.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.225+0000 7f7be1034640 1 -- 172.21.15.55:0/59986111 shutdown_connections 2023-08-25T05:35:52.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:52.225+0000 7f7be1034640 1 -- 172.21.15.55:0/59986111 wait complete. 2023-08-25T05:35:52.250 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-25T05:35:52.250 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T05:35:52.250 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-08-25T05:35:52.251 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-25T05:35:52.251 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T05:35:52.251 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-25T05:35:52.251 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-25T05:35:52.252 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T05:35:52.252 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T05:35:52.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:52.253 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-08-25T05:35:52.263 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T05:35:52.263 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T05:35:52.263 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T05:35:52.263 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:35:52.264 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-08-25T05:35:52.264 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:35:52.264 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T05:35:52.264 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-08-25T05:35:52.264 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-08-25T05:35:52.264 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T05:35:52.265 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-08-25T05:35:52.265 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-08-25T05:35:52.265 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T05:35:52.265 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-08-25T05:35:52.265 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-08-25T05:35:52.265 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-08-25T05:35:52.266 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 36836sec preferred_lft 36836sec 2023-08-25T05:35:52.266 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-08-25T05:35:52.266 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:35:52.266 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T05:35:52.266 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-08-25T05:35:52.266 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-08-25T05:35:52.267 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-25T05:35:52.267 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:98:6a:38:6a brd ff:ff:ff:ff:ff:ff 2023-08-25T05:35:52.267 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-25T05:35:52.267 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:35:52.267 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T05:35:52.267 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-08-25T05:35:52.268 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T05:35:52.268 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:35:52.268 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-08-25T05:35:52.268 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:35:52.268 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T05:35:52.269 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T05:35:52.269 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-08-25T05:35:52.269 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:35:52.269 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T05:35:52.269 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-25T05:35:52.269 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-08-25T05:35:52.270 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:35:52.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:52.271 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T05:35:52.338 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-08-25T05:35:52.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:52.341 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-08-25T05:35:52.393 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-08-25T05:35:52.393 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T05:35:52.393 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-08-25T05:35:52.394 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-25T05:35:52.394 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-08-25T05:35:52.394 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T05:35:52.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:52.395 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T05:35:52.395 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T05:35:52.395 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-25T05:35:52.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-25T05:35:52.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-25T05:35:52.396 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T05:35:52.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:52.489 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-08-25T05:35:52.499 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-25T05:35:52.499 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-25T05:35:52.499 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T05:35:52.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:52.500 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-08-25T05:35:52.568 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T05:35:52.569 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-25T05:35:52.621 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-25T05:35:52.621 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T05:35:52.621 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-25T05:35:52.675 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-25T05:35:52.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:52.676 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T05:35:52.774 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T05:35:52.774 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T05:35:52.786 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T05:35:52.787 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T05:35:52.787 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.110:3300,172.21.15.110:3301" 2023-08-25T05:35:52.787 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2d2a9024-b152-4d40-880c-1686d1810590.cephfs=/ 2023-08-25T05:35:52.787 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2023-08-25T05:35:52.790 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T05:35:52.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:52.791 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-25T05:35:52.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:52.813 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T05:35:52.875 INFO:teuthology.orchestra.run.smithi055.stdout:client10159 2023-08-25T05:35:52.875 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:35:52.876 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:35:52.927 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-25T05:35:53.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.113+0000 7f6c8c888640 1 Processor -- start 2023-08-25T05:35:53.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.113+0000 7f6c8c888640 1 -- start start 2023-08-25T05:35:53.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.113+0000 7f6c8c888640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c8815eba0 0x7f6c880b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:53.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.113+0000 7f6c8c888640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6c8815ef80 0x7f6c880ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:53.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.113+0000 7f6c8c888640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c880ac100 con 0x7f6c880cece0 2023-08-25T05:35:53.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.113+0000 7f6c8c888640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c880cf170 con 0x7f6c8815ef80 2023-08-25T05:35:53.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.113+0000 7f6c8c888640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880ac3a0 con 0x7f6c8815eba0 2023-08-25T05:35:53.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.113+0000 7f6c8659c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c8815eba0 0x7f6c880b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:53.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.113+0000 7f6c85d9b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6c8815ef80 0x7f6c880ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:53.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.113+0000 7f6c8659c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c8815eba0 0x7f6c880b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:33386/0 (socket says 172.21.15.55:33386) 2023-08-25T05:35:53.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.113+0000 7f6c86d9d640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f6c880cece0 0x7f6c880cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:41814/0 (socket says 172.21.15.55:41814) 2023-08-25T05:35:53.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.113+0000 7f6c8659c640 1 -- 172.21.15.55:0/425843489 learned_addr learned my addr 172.21.15.55:0/425843489 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:53.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.113+0000 7f6c8659c640 1 -- 172.21.15.55:0/425843489 >> v2:172.21.15.110:3300/0 conn(0x7f6c8815ef80 msgr2=0x7f6c880ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:53.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.113+0000 7f6c8659c640 1 --2- 172.21.15.55:0/425843489 >> v2:172.21.15.110:3300/0 conn(0x7f6c8815ef80 0x7f6c880ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:53.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.113+0000 7f6c8659c640 1 -- 172.21.15.55:0/425843489 >> v1:172.21.15.110:6789/0 conn(0x7f6c880cece0 legacy=0x7f6c880cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:53.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.113+0000 7f6c8659c640 1 -- 172.21.15.55:0/425843489 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c880b1390 con 0x7f6c8815eba0 2023-08-25T05:35:53.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.113+0000 7f6c85d9b640 1 --2- 172.21.15.55:0/425843489 >> v2:172.21.15.110:3300/0 conn(0x7f6c8815ef80 0x7f6c880ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:35:53.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.117+0000 7f6c8659c640 1 --2- 172.21.15.55:0/425843489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c8815eba0 0x7f6c880b2a40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009870 tx=0x7f6c7801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f68e3ae10d41f714 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:53.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.117+0000 7f6c8559a640 1 -- 172.21.15.55:0/425843489 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c780a7070 con 0x7f6c8815eba0 2023-08-25T05:35:53.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.117+0000 7f6c8559a640 1 -- 172.21.15.55:0/425843489 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c780ab430 con 0x7f6c8815eba0 2023-08-25T05:35:53.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.117+0000 7f6c8559a640 1 -- 172.21.15.55:0/425843489 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c780ab7c0 con 0x7f6c8815eba0 2023-08-25T05:35:53.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.117+0000 7f6c8c888640 1 -- 172.21.15.55:0/425843489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c8815eba0 msgr2=0x7f6c880b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:53.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.117+0000 7f6c8c888640 1 --2- 172.21.15.55:0/425843489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c8815eba0 0x7f6c880b2a40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6c78009870 tx=0x7f6c7801c510 comp rx=0 tx=0).stop 2023-08-25T05:35:53.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.117+0000 7f6c8c888640 1 -- 172.21.15.55:0/425843489 shutdown_connections 2023-08-25T05:35:53.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.117+0000 7f6c8c888640 1 --2- 172.21.15.55:0/425843489 >> v2:172.21.15.110:3300/0 conn(0x7f6c8815ef80 0x7f6c880ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:53.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.117+0000 7f6c8c888640 1 --2- 172.21.15.55:0/425843489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c8815eba0 0x7f6c880b2a40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:53.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.117+0000 7f6c8c888640 1 -- 172.21.15.55:0/425843489 >> 172.21.15.55:0/425843489 conn(0x7f6c88069d00 msgr2=0x7f6c8806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:53.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.117+0000 7f6c8c888640 1 -- 172.21.15.55:0/425843489 shutdown_connections 2023-08-25T05:35:53.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.117+0000 7f6c8c888640 1 -- 172.21.15.55:0/425843489 wait complete. 2023-08-25T05:35:53.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8c888640 1 Processor -- start 2023-08-25T05:35:53.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8c888640 1 -- start start 2023-08-25T05:35:53.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8c888640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c880cece0 0x7f6c880c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:53.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8c888640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c8815eba0 0x7f6c88153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:53.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8c888640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c8815ef80 0x7f6c8806c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:53.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8c888640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88157f50 con 0x7f6c880cece0 2023-08-25T05:35:53.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8c888640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88158230 con 0x7f6c8815ef80 2023-08-25T05:35:53.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8c888640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c88158510 con 0x7f6c8815eba0 2023-08-25T05:35:53.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c880cece0 0x7f6c880c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:53.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c880cece0 0x7f6c880c1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40690/0 (socket says 172.21.15.55:40690) 2023-08-25T05:35:53.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8659c640 1 -- 172.21.15.55:0/283527076 learned_addr learned my addr 172.21.15.55:0/283527076 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:53.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8659c640 1 -- 172.21.15.55:0/283527076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c8815eba0 msgr2=0x7f6c88153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:53.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8659c640 1 --2- 172.21.15.55:0/283527076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c8815eba0 0x7f6c88153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:53.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8659c640 1 -- 172.21.15.55:0/283527076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c8815ef80 msgr2=0x7f6c8806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:53.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8659c640 1 --2- 172.21.15.55:0/283527076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c8815ef80 0x7f6c8806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:53.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8659c640 1 -- 172.21.15.55:0/283527076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c009420 con 0x7f6c880cece0 2023-08-25T05:35:53.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8659c640 1 --2- 172.21.15.55:0/283527076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c880cece0 0x7f6c880c1f10 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f6c780ad040 tx=0x7f6c780192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:53.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c76ffd640 1 -- 172.21.15.55:0/283527076 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c780bc070 con 0x7f6c880cece0 2023-08-25T05:35:53.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c76ffd640 1 -- 172.21.15.55:0/283527076 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c780b4420 con 0x7f6c880cece0 2023-08-25T05:35:53.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c76ffd640 1 -- 172.21.15.55:0/283527076 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c780b47f0 con 0x7f6c880cece0 2023-08-25T05:35:53.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8c888640 1 -- 172.21.15.55:0/283527076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c780094d0 con 0x7f6c880cece0 2023-08-25T05:35:53.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8c888640 1 -- 172.21.15.55:0/283527076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c88158ad0 con 0x7f6c880cece0 2023-08-25T05:35:53.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.121+0000 7f6c8c888640 1 -- 172.21.15.55:0/283527076 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8804dbe0 con 0x7f6c880cece0 2023-08-25T05:35:53.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.125+0000 7f6c76ffd640 1 -- 172.21.15.55:0/283527076 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f6c780b4950 con 0x7f6c880cece0 2023-08-25T05:35:53.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.125+0000 7f6c76ffd640 1 --2- 172.21.15.55:0/283527076 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f6c680657a0 0x7f6c68067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:53.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.125+0000 7f6c76ffd640 1 -- 172.21.15.55:0/283527076 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6c7811ca20 con 0x7f6c880cece0 2023-08-25T05:35:53.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.125+0000 7f6c85d9b640 1 --2- 172.21.15.55:0/283527076 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f6c680657a0 0x7f6c68067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:53.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.125+0000 7f6c85d9b640 1 --2- 172.21.15.55:0/283527076 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f6c680657a0 0x7f6c68067c60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c006e90 tx=0x7f6c7c006de0 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:53.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.129+0000 7f6c76ffd640 1 -- 172.21.15.55:0/283527076 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6c780ea2b0 con 0x7f6c880cece0 2023-08-25T05:35:53.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.309+0000 7f6c8c888640 1 -- 172.21.15.55:0/283527076 --> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c88158680 con 0x7f6c680657a0 2023-08-25T05:35:53.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.313+0000 7f6c76ffd640 1 -- 172.21.15.55:0/283527076 <== mgr.9763 v2:172.21.15.110:6832/3764131781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f6c88158680 con 0x7f6c680657a0 2023-08-25T05:35:53.315 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T05:35:53.316 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:35:53.316 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-08-25T05:35:53.316 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:35:53.316 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T05:35:53.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.313+0000 7f6c8c888640 1 -- 172.21.15.55:0/283527076 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f6c680657a0 msgr2=0x7f6c68067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:53.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.313+0000 7f6c8c888640 1 --2- 172.21.15.55:0/283527076 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f6c680657a0 0x7f6c68067c60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c006e90 tx=0x7f6c7c006de0 comp rx=0 tx=0).stop 2023-08-25T05:35:53.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.313+0000 7f6c8c888640 1 -- 172.21.15.55:0/283527076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c880cece0 msgr2=0x7f6c880c1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:53.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.313+0000 7f6c8c888640 1 --2- 172.21.15.55:0/283527076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c880cece0 0x7f6c880c1f10 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f6c780ad040 tx=0x7f6c780192b0 comp rx=0 tx=0).stop 2023-08-25T05:35:53.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.313+0000 7f6c8c888640 1 -- 172.21.15.55:0/283527076 shutdown_connections 2023-08-25T05:35:53.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.313+0000 7f6c8c888640 1 --2- 172.21.15.55:0/283527076 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f6c680657a0 0x7f6c68067c60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:53.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.313+0000 7f6c8c888640 1 --2- 172.21.15.55:0/283527076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c8815ef80 0x7f6c8806c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:53.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.313+0000 7f6c8c888640 1 --2- 172.21.15.55:0/283527076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c8815eba0 0x7f6c88153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:53.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.313+0000 7f6c8c888640 1 --2- 172.21.15.55:0/283527076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c880cece0 0x7f6c880c1f10 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:53.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.313+0000 7f6c8c888640 1 -- 172.21.15.55:0/283527076 >> 172.21.15.55:0/283527076 conn(0x7f6c88069d00 msgr2=0x7f6c880afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:53.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.313+0000 7f6c8c888640 1 -- 172.21.15.55:0/283527076 shutdown_connections 2023-08-25T05:35:53.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.313+0000 7f6c8c888640 1 -- 172.21.15.55:0/283527076 wait complete. 2023-08-25T05:35:53.336 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-25T05:35:53.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.477+0000 7f4520ee5640 1 Processor -- start 2023-08-25T05:35:53.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.481+0000 7f4520ee5640 1 -- start start 2023-08-25T05:35:53.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.481+0000 7f4520ee5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f451c0cc6a0 0x7f451c0cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:53.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.481+0000 7f4520ee5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451c0cdf40 con 0x7f451c0ada40 2023-08-25T05:35:53.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.481+0000 7f4520ee5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451c06b7b0 con 0x7f451c0ad660 2023-08-25T05:35:53.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.481+0000 7f4520ee5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451c06ba90 con 0x7f451c0cc6a0 2023-08-25T05:35:53.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.481+0000 7f451ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f451c0cc6a0 0x7f451c0cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:53.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.481+0000 7f4511d9b640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f451c0ada40 0x7f451c0ca0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46390/0 (socket says 172.21.15.55:46390) 2023-08-25T05:35:53.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.481+0000 7f4511d9b640 1 -- 172.21.15.55:0/1670181680 learned_addr learned my addr 172.21.15.55:0/1670181680 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:35:53.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.481+0000 7f451ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f451c0cc6a0 0x7f451c0cd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40694/0 (socket says 172.21.15.55:40694) 2023-08-25T05:35:53.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.481+0000 7f451ad9d640 1 -- 172.21.15.55:0/1670181680 >> v1:172.21.15.110:6789/0 conn(0x7f451c0ad660 legacy=0x7f451c0cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:53.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.481+0000 7f451ad9d640 1 -- 172.21.15.55:0/1670181680 >> v1:172.21.15.55:6789/0 conn(0x7f451c0ada40 legacy=0x7f451c0ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:53.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.481+0000 7f451ad9d640 1 -- 172.21.15.55:0/1670181680 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c06bd70 con 0x7f451c0cc6a0 2023-08-25T05:35:53.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.481+0000 7f4519d9b640 1 -- 172.21.15.55:0/1670181680 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290132132 0 0) 0x7f451c0cdf40 con 0x7f451c0ada40 2023-08-25T05:35:53.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.485+0000 7f451ad9d640 1 --2- 172.21.15.55:0/1670181680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f451c0cc6a0 0x7f451c0cd8b0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f45140097c0 tx=0x7f451401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3eb4c076a12bee server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:53.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.485+0000 7f4519d9b640 1 -- 172.21.15.55:0/1670181680 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45140a8050 con 0x7f451c0cc6a0 2023-08-25T05:35:53.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.485+0000 7f4519d9b640 1 -- 172.21.15.55:0/1670181680 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45140ac5f0 con 0x7f451c0cc6a0 2023-08-25T05:35:53.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.485+0000 7f4519d9b640 1 -- 172.21.15.55:0/1670181680 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45140ac980 con 0x7f451c0cc6a0 2023-08-25T05:35:53.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.485+0000 7f4520ee5640 1 -- 172.21.15.55:0/1670181680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f451c0cc6a0 msgr2=0x7f451c0cd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:53.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.485+0000 7f4520ee5640 1 --2- 172.21.15.55:0/1670181680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f451c0cc6a0 0x7f451c0cd8b0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f45140097c0 tx=0x7f451401c480 comp rx=0 tx=0).stop 2023-08-25T05:35:53.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.485+0000 7f4520ee5640 1 -- 172.21.15.55:0/1670181680 shutdown_connections 2023-08-25T05:35:53.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.485+0000 7f4520ee5640 1 --2- 172.21.15.55:0/1670181680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f451c0cc6a0 0x7f451c0cd8b0 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:53.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.485+0000 7f4520ee5640 1 -- 172.21.15.55:0/1670181680 >> 172.21.15.55:0/1670181680 conn(0x7f451c069900 msgr2=0x7f451c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:53.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.485+0000 7f4520ee5640 1 -- 172.21.15.55:0/1670181680 shutdown_connections 2023-08-25T05:35:53.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.485+0000 7f4520ee5640 1 -- 172.21.15.55:0/1670181680 wait complete. 2023-08-25T05:35:53.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.485+0000 7f4520ee5640 1 Processor -- start 2023-08-25T05:35:53.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.485+0000 7f4520ee5640 1 -- start start 2023-08-25T05:35:53.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f4520ee5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f451c0ad660 0x7f451c152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:53.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f4520ee5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f451c0ada40 0x7f451c099ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:53.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f4520ee5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f451c0cc6a0 0x7f451c156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:53.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f4520ee5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c09b230 con 0x7f451c0ad660 2023-08-25T05:35:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f4520ee5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c152590 con 0x7f451c0ada40 2023-08-25T05:35:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f4520ee5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451c09a5b0 con 0x7f451c0cc6a0 2023-08-25T05:35:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f451a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f451c0ad660 0x7f451c152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f451a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f451c0ad660 0x7f451c152050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40696/0 (socket says 172.21.15.55:40696) 2023-08-25T05:35:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f451a59c640 1 -- 172.21.15.55:0/1947789042 learned_addr learned my addr 172.21.15.55:0/1947789042 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f4511d9b640 1 --2- 172.21.15.55:0/1947789042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f451c0ada40 0x7f451c099ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:53.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f451ad9d640 1 --2- 172.21.15.55:0/1947789042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f451c0cc6a0 0x7f451c156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:53.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f451a59c640 1 -- 172.21.15.55:0/1947789042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f451c0cc6a0 msgr2=0x7f451c156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:53.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f451a59c640 1 --2- 172.21.15.55:0/1947789042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f451c0cc6a0 0x7f451c156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:53.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f451a59c640 1 -- 172.21.15.55:0/1947789042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f451c0ada40 msgr2=0x7f451c099ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:53.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f451a59c640 1 --2- 172.21.15.55:0/1947789042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f451c0ada40 0x7f451c099ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:53.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f451a59c640 1 -- 172.21.15.55:0/1947789042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4514009420 con 0x7f451c0ad660 2023-08-25T05:35:53.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f4511d9b640 1 --2- 172.21.15.55:0/1947789042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f451c0ada40 0x7f451c099ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:35:53.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f451a59c640 1 --2- 172.21.15.55:0/1947789042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f451c0ad660 0x7f451c152050 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f450c00c450 tx=0x7f450c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:53.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f45137fe640 1 -- 172.21.15.55:0/1947789042 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c0052d0 con 0x7f451c0ad660 2023-08-25T05:35:53.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f45137fe640 1 -- 172.21.15.55:0/1947789042 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450c005430 con 0x7f451c0ad660 2023-08-25T05:35:53.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f4520ee5640 1 -- 172.21.15.55:0/1947789042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f451c09a890 con 0x7f451c0ad660 2023-08-25T05:35:53.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f45137fe640 1 -- 172.21.15.55:0/1947789042 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c003890 con 0x7f451c0ad660 2023-08-25T05:35:53.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f4520ee5640 1 -- 172.21.15.55:0/1947789042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451c09ae50 con 0x7f451c0ad660 2023-08-25T05:35:53.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f4520ee5640 1 -- 172.21.15.55:0/1947789042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451c09afe0 con 0x7f451c0ad660 2023-08-25T05:35:53.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.489+0000 7f45137fe640 1 -- 172.21.15.55:0/1947789042 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 106) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f450c0039f0 con 0x7f451c0ad660 2023-08-25T05:35:53.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.493+0000 7f45137fe640 1 --2- 172.21.15.55:0/1947789042 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f44fc0657a0 0x7f44fc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:53.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.493+0000 7f45137fe640 1 -- 172.21.15.55:0/1947789042 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f450c082b00 con 0x7f451c0ad660 2023-08-25T05:35:53.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.493+0000 7f4511d9b640 1 --2- 172.21.15.55:0/1947789042 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f44fc0657a0 0x7f44fc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:53.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.493+0000 7f4511d9b640 1 --2- 172.21.15.55:0/1947789042 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f44fc0657a0 0x7f44fc067c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f45040012f0 tx=0x7f4504005b80 comp rx=0 tx=0).ready entity=mgr.9763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:53.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.497+0000 7f45137fe640 1 -- 172.21.15.55:0/1947789042 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f450c0504c0 con 0x7f451c0ad660 2023-08-25T05:35:53.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:53.693+0000 7f4520ee5640 1 -- 172.21.15.55:0/1947789042 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f451c073ec0 con 0x7f451c0ad660 2023-08-25T05:35:54.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.241+0000 7f45137fe640 1 -- 172.21.15.55:0/1947789042 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 107) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f450c050890 con 0x7f451c0ad660 2023-08-25T05:35:54.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.245+0000 7f45137fe640 1 -- 172.21.15.55:0/1947789042 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v107) v1 ==== 92+0+0 (secure 0 0 0) 0x7f450c053f50 con 0x7f451c0ad660 2023-08-25T05:35:54.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.245+0000 7f4520ee5640 1 -- 172.21.15.55:0/1947789042 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f44fc0657a0 msgr2=0x7f44fc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:54.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.245+0000 7f4520ee5640 1 --2- 172.21.15.55:0/1947789042 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f44fc0657a0 0x7f44fc067c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f45040012f0 tx=0x7f4504005b80 comp rx=0 tx=0).stop 2023-08-25T05:35:54.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.245+0000 7f4520ee5640 1 -- 172.21.15.55:0/1947789042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f451c0ad660 msgr2=0x7f451c152050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:54.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.245+0000 7f4520ee5640 1 --2- 172.21.15.55:0/1947789042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f451c0ad660 0x7f451c152050 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f450c00c450 tx=0x7f450c00c910 comp rx=0 tx=0).stop 2023-08-25T05:35:54.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.245+0000 7f4520ee5640 1 -- 172.21.15.55:0/1947789042 shutdown_connections 2023-08-25T05:35:54.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.245+0000 7f4520ee5640 1 --2- 172.21.15.55:0/1947789042 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f44fc0657a0 0x7f44fc067c60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.245+0000 7f4520ee5640 1 --2- 172.21.15.55:0/1947789042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f451c0cc6a0 0x7f451c156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.245+0000 7f4520ee5640 1 --2- 172.21.15.55:0/1947789042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f451c0ada40 0x7f451c099ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.245+0000 7f4520ee5640 1 --2- 172.21.15.55:0/1947789042 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f451c0ad660 0x7f451c152050 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.245+0000 7f4520ee5640 1 -- 172.21.15.55:0/1947789042 >> 172.21.15.55:0/1947789042 conn(0x7f451c069900 msgr2=0x7f451c0ac5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:54.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.245+0000 7f4520ee5640 1 -- 172.21.15.55:0/1947789042 shutdown_connections 2023-08-25T05:35:54.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.245+0000 7f4520ee5640 1 -- 172.21.15.55:0/1947789042 wait complete. 2023-08-25T05:35:54.272 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-25T05:35:54.423 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:54.423+0000 7f2a5d4be180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:35:54.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.421+0000 7fc55c167640 1 Processor -- start 2023-08-25T05:35:54.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.421+0000 7fc55c167640 1 -- start start 2023-08-25T05:35:54.425 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:54.421+0000 7f86eaa55180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:35:54.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.421+0000 7fc55c167640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc5541601f0 0x7fc55415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:54.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.421+0000 7fc55c167640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5540d1290 0x7fc55415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:54.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.421+0000 7fc55c167640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5540cd5a0 con 0x7fc55415e3c0 2023-08-25T05:35:54.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.421+0000 7fc55c167640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5540cd880 con 0x7fc5541601f0 2023-08-25T05:35:54.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.421+0000 7fc55c167640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5540cdb60 con 0x7fc5540d1290 2023-08-25T05:35:54.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.421+0000 7fc55a704640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5540d1290 0x7fc55415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:54.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.421+0000 7fc559f03640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc5541601f0 0x7fc55415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:54.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.421+0000 7fc55a704640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5540d1290 0x7fc55415e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:33434/0 (socket says 172.21.15.55:33434) 2023-08-25T05:35:54.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.421+0000 7fc55a704640 1 -- 172.21.15.55:0/3597178667 learned_addr learned my addr 172.21.15.55:0/3597178667 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:54.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.425+0000 7fc55a704640 1 -- 172.21.15.55:0/3597178667 >> v2:172.21.15.110:3300/0 conn(0x7fc5541601f0 msgr2=0x7fc55415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:54.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.425+0000 7fc55a704640 1 --2- 172.21.15.55:0/3597178667 >> v2:172.21.15.110:3300/0 conn(0x7fc5541601f0 0x7fc55415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.425+0000 7fc55a704640 1 -- 172.21.15.55:0/3597178667 >> v1:172.21.15.110:6789/0 conn(0x7fc55415e3c0 legacy=0x7fc5540d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:54.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.425+0000 7fc55a704640 1 -- 172.21.15.55:0/3597178667 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5540cde40 con 0x7fc5540d1290 2023-08-25T05:35:54.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.425+0000 7fc55a704640 1 --2- 172.21.15.55:0/3597178667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5540d1290 0x7fc55415e8a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009e50 tx=0x7fc54c01f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9590bc004c36066 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:54.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.425+0000 7fc558f01640 1 -- 172.21.15.55:0/3597178667 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c0af400 con 0x7fc5540d1290 2023-08-25T05:35:54.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.425+0000 7fc558f01640 1 -- 172.21.15.55:0/3597178667 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c0ab050 con 0x7fc5540d1290 2023-08-25T05:35:54.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.425+0000 7fc558f01640 1 -- 172.21.15.55:0/3597178667 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c0af780 con 0x7fc5540d1290 2023-08-25T05:35:54.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.425+0000 7fc55c167640 1 -- 172.21.15.55:0/3597178667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5540d1290 msgr2=0x7fc55415e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:54.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.425+0000 7fc55c167640 1 --2- 172.21.15.55:0/3597178667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5540d1290 0x7fc55415e8a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009e50 tx=0x7fc54c01f1f0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55c167640 1 -- 172.21.15.55:0/3597178667 shutdown_connections 2023-08-25T05:35:54.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55c167640 1 --2- 172.21.15.55:0/3597178667 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5540d1290 0x7fc55415e8a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55c167640 1 --2- 172.21.15.55:0/3597178667 >> v2:172.21.15.110:3300/0 conn(0x7fc5541601f0 0x7fc55415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55c167640 1 -- 172.21.15.55:0/3597178667 >> 172.21.15.55:0/3597178667 conn(0x7fc5540d27d0 msgr2=0x7fc5540d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:54.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55c167640 1 -- 172.21.15.55:0/3597178667 shutdown_connections 2023-08-25T05:35:54.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55c167640 1 -- 172.21.15.55:0/3597178667 wait complete. 2023-08-25T05:35:54.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55c167640 1 Processor -- start 2023-08-25T05:35:54.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55c167640 1 -- start start 2023-08-25T05:35:54.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55c167640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5540d1290 0x7fc55415c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:54.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55c167640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc55415e3c0 0x7fc5541f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:54.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55c167640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5541601f0 0x7fc5540c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:54.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55c167640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5541f67f0 con 0x7fc55415e3c0 2023-08-25T05:35:54.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55c167640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55415ccd0 con 0x7fc5540d1290 2023-08-25T05:35:54.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55c167640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5541f5b70 con 0x7fc5541601f0 2023-08-25T05:35:54.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc559702640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc55415e3c0 0x7fc5541f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:54.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc559f03640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5540d1290 0x7fc55415c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:54.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc559702640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc55415e3c0 0x7fc5541f2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40722/0 (socket says 172.21.15.55:40722) 2023-08-25T05:35:54.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc559702640 1 -- 172.21.15.55:0/773043859 learned_addr learned my addr 172.21.15.55:0/773043859 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:54.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55a704640 1 --2- 172.21.15.55:0/773043859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5541601f0 0x7fc5540c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:54.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55a704640 1 -- 172.21.15.55:0/773043859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5540d1290 msgr2=0x7fc55415c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:54.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55a704640 1 --2- 172.21.15.55:0/773043859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5540d1290 0x7fc55415c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55a704640 1 -- 172.21.15.55:0/773043859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc55415e3c0 msgr2=0x7fc5541f2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:54.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55a704640 1 --2- 172.21.15.55:0/773043859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc55415e3c0 0x7fc5541f2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.429+0000 7fc55a704640 1 -- 172.21.15.55:0/773043859 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c009b30 con 0x7fc5541601f0 2023-08-25T05:35:54.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.433+0000 7fc55a704640 1 --2- 172.21.15.55:0/773043859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5541601f0 0x7fc5540c8440 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0ae000 tx=0x7fc54c01bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:54.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.433+0000 7fc54a7fc640 1 -- 172.21.15.55:0/773043859 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c0c0070 con 0x7fc5541601f0 2023-08-25T05:35:54.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.433+0000 7fc54a7fc640 1 -- 172.21.15.55:0/773043859 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c009510 con 0x7fc5541601f0 2023-08-25T05:35:54.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.433+0000 7fc54a7fc640 1 -- 172.21.15.55:0/773043859 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c0afd30 con 0x7fc5541601f0 2023-08-25T05:35:54.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.433+0000 7fc55c167640 1 -- 172.21.15.55:0/773043859 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5541f5e50 con 0x7fc5541601f0 2023-08-25T05:35:54.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.433+0000 7fc55c167640 1 -- 172.21.15.55:0/773043859 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5541f6410 con 0x7fc5541601f0 2023-08-25T05:35:54.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.433+0000 7fc55c167640 1 -- 172.21.15.55:0/773043859 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5540b5260 con 0x7fc5541601f0 2023-08-25T05:35:54.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.433+0000 7fc54a7fc640 1 -- 172.21.15.55:0/773043859 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 107) v1 ==== 85081+0+0 (secure 0 0 0) 0x7fc54c0b6040 con 0x7fc5541601f0 2023-08-25T05:35:54.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.433+0000 7fc54a7fc640 1 --2- 172.21.15.55:0/773043859 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fc5380657f0 0x7fc538067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:54.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.433+0000 7fc54a7fc640 1 -- 172.21.15.55:0/773043859 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc54c120860 con 0x7fc5541601f0 2023-08-25T05:35:54.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.433+0000 7fc559f03640 1 -- 172.21.15.55:0/773043859 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fc5380657f0 msgr2=0x7fc538067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3764131781 2023-08-25T05:35:54.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.433+0000 7fc559f03640 1 --2- 172.21.15.55:0/773043859 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fc5380657f0 0x7fc538067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:35:54.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.437+0000 7fc54a7fc640 1 -- 172.21.15.55:0/773043859 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc54c0ee110 con 0x7fc5541601f0 2023-08-25T05:35:54.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.597+0000 7fc55c167640 1 -- 172.21.15.55:0/773043859 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fc5541f6930 con 0x7fc5541601f0 2023-08-25T05:35:54.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.605+0000 7fc54a7fc640 1 -- 172.21.15.55:0/773043859 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v65)=0 v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc5541f6930 con 0x7fc5541601f0 2023-08-25T05:35:54.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.605+0000 7fc55c167640 1 -- 172.21.15.55:0/773043859 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fc5380657f0 msgr2=0x7fc538067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:35:54.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.605+0000 7fc55c167640 1 --2- 172.21.15.55:0/773043859 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fc5380657f0 0x7fc538067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.605+0000 7fc55c167640 1 -- 172.21.15.55:0/773043859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5541601f0 msgr2=0x7fc5540c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:54.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.605+0000 7fc55c167640 1 --2- 172.21.15.55:0/773043859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5541601f0 0x7fc5540c8440 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0ae000 tx=0x7fc54c01bf90 comp rx=0 tx=0).stop 2023-08-25T05:35:54.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.605+0000 7fc55c167640 1 -- 172.21.15.55:0/773043859 shutdown_connections 2023-08-25T05:35:54.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.605+0000 7fc55c167640 1 --2- 172.21.15.55:0/773043859 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7fc5380657f0 0x7fc538067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.605+0000 7fc55c167640 1 --2- 172.21.15.55:0/773043859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5541601f0 0x7fc5540c8440 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.605+0000 7fc55c167640 1 --2- 172.21.15.55:0/773043859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc55415e3c0 0x7fc5541f2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.605+0000 7fc55c167640 1 --2- 172.21.15.55:0/773043859 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc5540d1290 0x7fc55415c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.605+0000 7fc55c167640 1 -- 172.21.15.55:0/773043859 >> 172.21.15.55:0/773043859 conn(0x7fc5540d27d0 msgr2=0x7fc55415d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:54.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.605+0000 7fc55c167640 1 -- 172.21.15.55:0/773043859 shutdown_connections 2023-08-25T05:35:54.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.605+0000 7fc55c167640 1 -- 172.21.15.55:0/773043859 wait complete. 2023-08-25T05:35:54.630 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-08-25T05:35:54.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.773+0000 7f944ea48640 1 Processor -- start 2023-08-25T05:35:54.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.773+0000 7f944ea48640 1 -- start start 2023-08-25T05:35:54.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.773+0000 7f944ea48640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f944815e3c0 0x7f944815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:54.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.773+0000 7f944ea48640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f94480d1290 0x7f944815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:54.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.773+0000 7f944ea48640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94480cd5a0 con 0x7f94481601f0 2023-08-25T05:35:54.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.773+0000 7f944ea48640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94480cd880 con 0x7f94480d1290 2023-08-25T05:35:54.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.773+0000 7f944ea48640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94480cdb60 con 0x7f944815e3c0 2023-08-25T05:35:54.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.777+0000 7f944cfe5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f94480d1290 0x7f944815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:54.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.777+0000 7f944cfe5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f94480d1290 0x7f944815e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40730/0 (socket says 172.21.15.55:40730) 2023-08-25T05:35:54.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.777+0000 7f944cfe5640 1 -- 172.21.15.55:0/1035952335 learned_addr learned my addr 172.21.15.55:0/1035952335 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:54.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.777+0000 7f9447fff640 1 --1- 172.21.15.55:0/1035952335 >> v1:172.21.15.55:6789/0 conn(0x7f94481601f0 0x7f94480d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46422/0 (socket says 172.21.15.55:46422) 2023-08-25T05:35:54.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.777+0000 7f94477fe640 1 --2- 172.21.15.55:0/1035952335 >> v2:172.21.15.110:3300/0 conn(0x7f944815e3c0 0x7f944815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:54.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.777+0000 7f944cfe5640 1 -- 172.21.15.55:0/1035952335 >> v2:172.21.15.110:3300/0 conn(0x7f944815e3c0 msgr2=0x7f944815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:54.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.777+0000 7f944cfe5640 1 --2- 172.21.15.55:0/1035952335 >> v2:172.21.15.110:3300/0 conn(0x7f944815e3c0 0x7f944815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.777+0000 7f944cfe5640 1 -- 172.21.15.55:0/1035952335 >> v1:172.21.15.55:6789/0 conn(0x7f94481601f0 legacy=0x7f94480d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:54.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.777+0000 7f944cfe5640 1 -- 172.21.15.55:0/1035952335 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94480cde40 con 0x7f94480d1290 2023-08-25T05:35:54.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.777+0000 7f9446ffd640 1 -- 172.21.15.55:0/1035952335 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231522329 0 0) 0x7f94480cd5a0 con 0x7f94481601f0 2023-08-25T05:35:54.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.777+0000 7f944cfe5640 1 --2- 172.21.15.55:0/1035952335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94480d1290 0x7f944815e8a0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f94480cd350 tx=0x7f944001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8efa71007c3a49d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:54.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.777+0000 7f9446ffd640 1 -- 172.21.15.55:0/1035952335 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94400a5790 con 0x7f94480d1290 2023-08-25T05:35:54.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.777+0000 7f9446ffd640 1 -- 172.21.15.55:0/1035952335 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94400a58f0 con 0x7f94480d1290 2023-08-25T05:35:54.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.777+0000 7f9446ffd640 1 -- 172.21.15.55:0/1035952335 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94400a5c80 con 0x7f94480d1290 2023-08-25T05:35:54.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f944ea48640 1 -- 172.21.15.55:0/1035952335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94480d1290 msgr2=0x7f944815e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:54.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f944ea48640 1 --2- 172.21.15.55:0/1035952335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94480d1290 0x7f944815e8a0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f94480cd350 tx=0x7f944001c9a0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f944ea48640 1 -- 172.21.15.55:0/1035952335 shutdown_connections 2023-08-25T05:35:54.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f944ea48640 1 --2- 172.21.15.55:0/1035952335 >> v2:172.21.15.110:3300/0 conn(0x7f944815e3c0 0x7f944815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f944ea48640 1 --2- 172.21.15.55:0/1035952335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94480d1290 0x7f944815e8a0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f944ea48640 1 -- 172.21.15.55:0/1035952335 >> 172.21.15.55:0/1035952335 conn(0x7f94480d27d0 msgr2=0x7f94480d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:54.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f944ea48640 1 -- 172.21.15.55:0/1035952335 shutdown_connections 2023-08-25T05:35:54.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f944ea48640 1 -- 172.21.15.55:0/1035952335 wait complete. 2023-08-25T05:35:54.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f944ea48640 1 Processor -- start 2023-08-25T05:35:54.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f944ea48640 1 -- start start 2023-08-25T05:35:54.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f944ea48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94480d1290 0x7f94480c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:54.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f944ea48640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f944815e3c0 0x7f9448154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:54.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f944ea48640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94481601f0 0x7f944815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:54.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f944ea48640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944806bca0 con 0x7f94480d1290 2023-08-25T05:35:54.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f944ea48640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9448154690 con 0x7f94481601f0 2023-08-25T05:35:54.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f944ea48640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94480c9230 con 0x7f944815e3c0 2023-08-25T05:35:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f9447fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94480d1290 0x7f94480c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f9447fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94480d1290 0x7f94480c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40738/0 (socket says 172.21.15.55:40738) 2023-08-25T05:35:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f9447fff640 1 -- 172.21.15.55:0/321896500 learned_addr learned my addr 172.21.15.55:0/321896500 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.781+0000 7f94477fe640 1 --2- 172.21.15.55:0/321896500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f944815e3c0 0x7f9448154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:54.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.785+0000 7f944cfe5640 1 --2- 172.21.15.55:0/321896500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94481601f0 0x7f944815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:54.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.785+0000 7f9447fff640 1 -- 172.21.15.55:0/321896500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f944815e3c0 msgr2=0x7f9448154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:54.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.785+0000 7f9447fff640 1 --2- 172.21.15.55:0/321896500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f944815e3c0 0x7f9448154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.785+0000 7f9447fff640 1 -- 172.21.15.55:0/321896500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94481601f0 msgr2=0x7f944815a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:54.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.785+0000 7f9447fff640 1 --2- 172.21.15.55:0/321896500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94481601f0 0x7f944815a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.785+0000 7f9447fff640 1 -- 172.21.15.55:0/321896500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9440009b30 con 0x7f94480d1290 2023-08-25T05:35:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.785+0000 7f9447fff640 1 --2- 172.21.15.55:0/321896500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94480d1290 0x7f94480c8b20 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f943800c450 tx=0x7f943800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.785+0000 7f9444ff9640 1 -- 172.21.15.55:0/321896500 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9438007480 con 0x7f94480d1290 2023-08-25T05:35:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.785+0000 7f9444ff9640 1 -- 172.21.15.55:0/321896500 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94380075e0 con 0x7f94480d1290 2023-08-25T05:35:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.785+0000 7f944ea48640 1 -- 172.21.15.55:0/321896500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94480ce7c0 con 0x7f94480d1290 2023-08-25T05:35:54.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.785+0000 7f9444ff9640 1 -- 172.21.15.55:0/321896500 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94380059f0 con 0x7f94480d1290 2023-08-25T05:35:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.785+0000 7f944ea48640 1 -- 172.21.15.55:0/321896500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94480c7e50 con 0x7f94480d1290 2023-08-25T05:35:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.785+0000 7f944ea48640 1 -- 172.21.15.55:0/321896500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94480b5260 con 0x7f94480d1290 2023-08-25T05:35:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.785+0000 7f9444ff9640 1 -- 172.21.15.55:0/321896500 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 107) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f9438005b50 con 0x7f94480d1290 2023-08-25T05:35:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.785+0000 7f9444ff9640 1 --2- 172.21.15.55:0/321896500 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f94340657f0 0x7f9434067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.785+0000 7f9444ff9640 1 -- 172.21.15.55:0/321896500 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9438082490 con 0x7f94480d1290 2023-08-25T05:35:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.789+0000 7f94477fe640 1 -- 172.21.15.55:0/321896500 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f94340657f0 msgr2=0x7f9434067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3764131781 2023-08-25T05:35:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.789+0000 7f94477fe640 1 --2- 172.21.15.55:0/321896500 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f94340657f0 0x7f9434067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:35:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.789+0000 7f9444ff9640 1 -- 172.21.15.55:0/321896500 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f943804fef0 con 0x7f94480d1290 2023-08-25T05:35:54.837 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:54.835+0000 7f2a5d4be180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:35:54.870 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:54.865+0000 7f86eaa55180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:35:54.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.953+0000 7f944ea48640 1 -- 172.21.15.55:0/321896500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f94480b6190 con 0x7f94480d1290 2023-08-25T05:35:54.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.957+0000 7f9444ff9640 1 -- 172.21.15.55:0/321896500 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v66)=0 v66) v1 ==== 133+0+0 (secure 0 0 0) 0x7f94480b6190 con 0x7f94480d1290 2023-08-25T05:35:54.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.961+0000 7f944ea48640 1 -- 172.21.15.55:0/321896500 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f94340657f0 msgr2=0x7f9434067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:35:54.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.961+0000 7f944ea48640 1 --2- 172.21.15.55:0/321896500 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f94340657f0 0x7f9434067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.961+0000 7f944ea48640 1 -- 172.21.15.55:0/321896500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94480d1290 msgr2=0x7f94480c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:54.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.961+0000 7f944ea48640 1 --2- 172.21.15.55:0/321896500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94480d1290 0x7f94480c8b20 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f943800c450 tx=0x7f943800c910 comp rx=0 tx=0).stop 2023-08-25T05:35:54.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.961+0000 7f944ea48640 1 -- 172.21.15.55:0/321896500 shutdown_connections 2023-08-25T05:35:54.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.961+0000 7f944ea48640 1 --2- 172.21.15.55:0/321896500 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f94340657f0 0x7f9434067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.961+0000 7f944ea48640 1 --2- 172.21.15.55:0/321896500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f94481601f0 0x7f944815a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.961+0000 7f944ea48640 1 --2- 172.21.15.55:0/321896500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f944815e3c0 0x7f9448154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.961+0000 7f944ea48640 1 --2- 172.21.15.55:0/321896500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f94480d1290 0x7f94480c8b20 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:54.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.961+0000 7f944ea48640 1 -- 172.21.15.55:0/321896500 >> 172.21.15.55:0/321896500 conn(0x7f94480d27d0 msgr2=0x7f94480cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:54.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.961+0000 7f944ea48640 1 -- 172.21.15.55:0/321896500 shutdown_connections 2023-08-25T05:35:54.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:54.961+0000 7f944ea48640 1 -- 172.21.15.55:0/321896500 wait complete. 2023-08-25T05:35:54.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:54.985 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-25T05:35:54.986 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:54.983+0000 7f2a5d4be180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:35:55.002 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-08-25T05:35:55.029 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:55.025+0000 7f86eaa55180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:35:55.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.173+0000 7f54a9f03640 1 Processor -- start 2023-08-25T05:35:55.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.173+0000 7f54a9f03640 1 -- start start 2023-08-25T05:35:55.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.173+0000 7f54a9f03640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f54a415cb40 0x7f54a40d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:55.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.173+0000 7f54a9f03640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54a40b6a00 0x7f54a40cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:55.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.173+0000 7f54a9f03640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a40d1970 con 0x7f54a40cf340 2023-08-25T05:35:55.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.173+0000 7f54a9f03640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a40cfcf0 con 0x7f54a40b6a00 2023-08-25T05:35:55.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.173+0000 7f54a9f03640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a40d0d80 con 0x7f54a415cb40 2023-08-25T05:35:55.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.177+0000 7f54a3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54a40b6a00 0x7f54a40cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:55.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.177+0000 7f54a37fe640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f54a415cb40 0x7f54a40d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:55.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.177+0000 7f54a3fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54a40b6a00 0x7f54a40cf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40750/0 (socket says 172.21.15.55:40750) 2023-08-25T05:35:55.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.177+0000 7f54a3fff640 1 -- 172.21.15.55:0/4152952478 learned_addr learned my addr 172.21.15.55:0/4152952478 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:55.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.177+0000 7f54a3fff640 1 -- 172.21.15.55:0/4152952478 >> v2:172.21.15.110:3300/0 conn(0x7f54a415cb40 msgr2=0x7f54a40d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:55.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.177+0000 7f54a3fff640 1 --2- 172.21.15.55:0/4152952478 >> v2:172.21.15.110:3300/0 conn(0x7f54a415cb40 0x7f54a40d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:55.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.177+0000 7f54a3fff640 1 -- 172.21.15.55:0/4152952478 >> v1:172.21.15.110:6789/0 conn(0x7f54a40cf340 legacy=0x7f54a40b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:55.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.177+0000 7f54a3fff640 1 -- 172.21.15.55:0/4152952478 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a40d1040 con 0x7f54a40b6a00 2023-08-25T05:35:55.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.181+0000 7f54a3fff640 1 --2- 172.21.15.55:0/4152952478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54a40b6a00 0x7f54a40cf7b0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f54a408b5a0 tx=0x7f549c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb6f2ea1f33bcb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:55.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.181+0000 7f54a2ffd640 1 -- 172.21.15.55:0/4152952478 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0af400 con 0x7f54a40b6a00 2023-08-25T05:35:55.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.181+0000 7f54a2ffd640 1 -- 172.21.15.55:0/4152952478 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c0ab050 con 0x7f54a40b6a00 2023-08-25T05:35:55.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.181+0000 7f54a2ffd640 1 -- 172.21.15.55:0/4152952478 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0af780 con 0x7f54a40b6a00 2023-08-25T05:35:55.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.181+0000 7f54a9f03640 1 -- 172.21.15.55:0/4152952478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54a40b6a00 msgr2=0x7f54a40cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:55.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.181+0000 7f54a9f03640 1 --2- 172.21.15.55:0/4152952478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54a40b6a00 0x7f54a40cf7b0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f54a408b5a0 tx=0x7f549c01f1c0 comp rx=0 tx=0).stop 2023-08-25T05:35:55.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.181+0000 7f54a9f03640 1 -- 172.21.15.55:0/4152952478 shutdown_connections 2023-08-25T05:35:55.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.181+0000 7f54a9f03640 1 --2- 172.21.15.55:0/4152952478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54a40b6a00 0x7f54a40cf7b0 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:55.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.181+0000 7f54a9f03640 1 --2- 172.21.15.55:0/4152952478 >> v2:172.21.15.110:3300/0 conn(0x7f54a415cb40 0x7f54a40d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:55.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.181+0000 7f54a9f03640 1 -- 172.21.15.55:0/4152952478 >> 172.21.15.55:0/4152952478 conn(0x7f54a406aae0 msgr2=0x7f54a406aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:55.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.181+0000 7f54a9f03640 1 -- 172.21.15.55:0/4152952478 shutdown_connections 2023-08-25T05:35:55.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.181+0000 7f54a9f03640 1 -- 172.21.15.55:0/4152952478 wait complete. 2023-08-25T05:35:55.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a9f03640 1 Processor -- start 2023-08-25T05:35:55.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a9f03640 1 -- start start 2023-08-25T05:35:55.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a9f03640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a40b6a00 0x7f54a4151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:55.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a9f03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a40cf340 0x7f54a40ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:55.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a9f03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54a415cb40 0x7f54a40ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:55.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a9f03640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40c73a0 con 0x7f54a415cb40 2023-08-25T05:35:55.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a9f03640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40c9350 con 0x7f54a40b6a00 2023-08-25T05:35:55.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a9f03640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a41522f0 con 0x7f54a40cf340 2023-08-25T05:35:55.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54a415cb40 0x7f54a40ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:55.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54a415cb40 0x7f54a40ca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40754/0 (socket says 172.21.15.55:40754) 2023-08-25T05:35:55.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a3fff640 1 -- 172.21.15.55:0/2528512429 learned_addr learned my addr 172.21.15.55:0/2528512429 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:55.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a37fe640 1 --2- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a40b6a00 0x7f54a4151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:55.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f549bfff640 1 --2- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a40cf340 0x7f54a40ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:55.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a3fff640 1 -- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a40cf340 msgr2=0x7f54a40ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:55.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a3fff640 1 --2- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54a40cf340 0x7f54a40ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:55.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a3fff640 1 -- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a40b6a00 msgr2=0x7f54a4151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:55.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a3fff640 1 --2- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f54a40b6a00 0x7f54a4151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:55.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a3fff640 1 -- 172.21.15.55:0/2528512429 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c009b30 con 0x7f54a415cb40 2023-08-25T05:35:55.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a3fff640 1 --2- 172.21.15.55:0/2528512429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54a415cb40 0x7f54a40ca860 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f549c0b2040 tx=0x7f549c01bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:55.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a0ff9640 1 -- 172.21.15.55:0/2528512429 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0afcb0 con 0x7f54a415cb40 2023-08-25T05:35:55.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a0ff9640 1 -- 172.21.15.55:0/2528512429 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c0afe30 con 0x7f54a415cb40 2023-08-25T05:35:55.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a0ff9640 1 -- 172.21.15.55:0/2528512429 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0ba660 con 0x7f54a415cb40 2023-08-25T05:35:55.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a9f03640 1 -- 172.21.15.55:0/2528512429 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a40c87c0 con 0x7f54a415cb40 2023-08-25T05:35:55.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a9f03640 1 -- 172.21.15.55:0/2528512429 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a40c8d00 con 0x7f54a415cb40 2023-08-25T05:35:55.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.185+0000 7f54a9f03640 1 -- 172.21.15.55:0/2528512429 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a4071f80 con 0x7f54a415cb40 2023-08-25T05:35:55.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.189+0000 7f54a0ff9640 1 -- 172.21.15.55:0/2528512429 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 107) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f549c0b6040 con 0x7f54a415cb40 2023-08-25T05:35:55.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.189+0000 7f54a0ff9640 1 --2- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f54840657f0 0x7f5484067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:55.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.189+0000 7f54a0ff9640 1 -- 172.21.15.55:0/2528512429 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f549c121070 con 0x7f54a415cb40 2023-08-25T05:35:55.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.189+0000 7f54a37fe640 1 -- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f54840657f0 msgr2=0x7f5484067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3764131781 2023-08-25T05:35:55.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.189+0000 7f54a37fe640 1 --2- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f54840657f0 0x7f5484067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:35:55.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.197+0000 7f54a0ff9640 1 -- 172.21.15.55:0/2528512429 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f549c0eea50 con 0x7f54a415cb40 2023-08-25T05:35:55.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.373+0000 7f54a9f03640 1 -- 172.21.15.55:0/2528512429 --> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f54a40d1600 con 0x7f54840657f0 2023-08-25T05:35:55.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.393+0000 7f54a37fe640 1 -- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f54840657f0 msgr2=0x7f5484067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3764131781 2023-08-25T05:35:55.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.393+0000 7f54a37fe640 1 --2- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f54840657f0 0x7f5484067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-25T05:35:55.461 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:55.459+0000 7f2a5d4be180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:35:55.520 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:55.519+0000 7f2a5d4be180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:35:55.548 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:55.545+0000 7f86eaa55180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:35:55.574 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:55.571+0000 7f2a5d4be180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:35:55.609 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:55.605+0000 7f86eaa55180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:35:55.658 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:55.655+0000 7f2a5d4be180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:35:55.667 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:55.661+0000 7f86eaa55180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:35:55.716 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:55.715+0000 7f2a5d4be180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:35:55.756 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:55.753+0000 7f86eaa55180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:35:55.799 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:55.795+0000 7f2a5d4be180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:35:55.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.797+0000 7f54a37fe640 1 -- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f54840657f0 msgr2=0x7f5484067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3764131781 2023-08-25T05:35:55.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:55.797+0000 7f54a37fe640 1 --2- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f54840657f0 0x7f5484067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-25T05:35:55.815 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:55.813+0000 7f86eaa55180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:35:55.854 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:55.851+0000 7f2a5d4be180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:35:55.902 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:55.897+0000 7f86eaa55180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:35:55.961 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:55.957+0000 7f86eaa55180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:35:55.996 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:55.995+0000 7f2a5d4be180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:35:56.054 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:56.051+0000 7f2a5d4be180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:35:56.112 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:56.109+0000 7f86eaa55180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:35:56.173 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:56.169+0000 7f86eaa55180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:35:56.292 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:35:56.293 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:35:56.293 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:35:56.301 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:56.299+0000 7f2a5d4be180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:35:56.423 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:35:56.423 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:35:56.424 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:35:56.432 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:56.429+0000 7f86eaa55180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:35:56.436 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:56.435+0000 7f2a5d4be180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:35:56.560 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:56.559+0000 7f2a5d4be180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:35:56.574 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:56.569+0000 7f86eaa55180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:35:56.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:56.601+0000 7f54a37fe640 1 -- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f54840657f0 msgr2=0x7f5484067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3764131781 2023-08-25T05:35:56.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:56.601+0000 7f54a37fe640 1 --2- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f54840657f0 0x7f5484067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-25T05:35:56.630 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:56.627+0000 7f2a5d4be180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:35:56.704 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:56.701+0000 7f86eaa55180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:35:56.765 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:56.763+0000 7f2a5d4be180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:35:56.777 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:56.773+0000 7f86eaa55180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:35:56.919 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:56.913+0000 7f86eaa55180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:35:57.297 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:57.295+0000 7f2a5d4be180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:35:57.382 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:57.379+0000 7f2a5d4be180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:35:57.488 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:57.485+0000 7f86eaa55180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:35:57.533 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:57.531+0000 7f2a5d4be180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:35:57.575 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:57.573+0000 7f86eaa55180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:35:57.616 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:57.615+0000 7f2a5d4be180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:35:57.731 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:57.729+0000 7f86eaa55180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:35:57.818 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:57.813+0000 7f86eaa55180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:35:57.930 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:57.927+0000 7f2a5d4be180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:35:57.990 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:57.987+0000 7f2a5d4be180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:35:58.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:58.005+0000 7f54a0ff9640 1 -- 172.21.15.55:0/2528512429 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 108) v1 ==== 84690+0+0 (secure 0 0 0) 0x7f549c11f430 con 0x7f54a415cb40 2023-08-25T05:35:58.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:58.005+0000 7f54a0ff9640 1 -- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f54840657f0 msgr2=0x7f5484067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:35:58.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:58.005+0000 7f54a0ff9640 1 --2- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:6832/3764131781,v1:172.21.15.110:6833/3764131781] conn(0x7f54840657f0 0x7f5484067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:58.121 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:58.119+0000 7f29e2ae4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:58.122 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:58.119+0000 7f29e2ae4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:58.122 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:58.119+0000 7f29e2ae4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:58.122 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:58.119+0000 7f29e2ae4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:58.122 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:58.119+0000 7f29e2ae4640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:58.122 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:58.119+0000 7f29df2dd640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:58.122 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:58.119+0000 7f29df2dd640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:58.122 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:58.119+0000 7f29df2dd640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:58.123 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:58.119+0000 7f29df2dd640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:58.123 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:35:58.119+0000 7f29df2dd640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:35:58.174 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:58.169+0000 7f86eaa55180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:35:58.239 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:35:58.233+0000 7f86eaa55180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:35:59.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.009+0000 7f54a0ff9640 1 -- 172.21.15.55:0/2528512429 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 109) v1 ==== 84817+0+0 (secure 0 0 0) 0x7f549c0f1c00 con 0x7f54a415cb40 2023-08-25T05:35:59.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.009+0000 7f54a0ff9640 1 --2- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f5484033770 0x7f548406fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:59.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.009+0000 7f54a0ff9640 1 -- 172.21.15.55:0/2528512429 --> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f54840038a0 con 0x7f5484033770 2023-08-25T05:35:59.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.009+0000 7f54a37fe640 1 --2- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f5484033770 0x7f548406fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:59.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.013+0000 7f54a37fe640 1 --2- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f5484033770 0x7f548406fcd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5494009730 tx=0x7f5494009190 comp rx=0 tx=0).ready entity=mgr.10180 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:59.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.081+0000 7f54a0ff9640 1 -- 172.21.15.55:0/2528512429 <== mgr.10180 v2:172.21.15.110:6832/3676103183 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5494009d50 con 0x7f5484033770 2023-08-25T05:35:59.087 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path snap_test_dir1 2023-08-25T05:35:59.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.085+0000 7f54a9f03640 1 -- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f5484033770 msgr2=0x7f548406fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:59.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.085+0000 7f54a9f03640 1 --2- 172.21.15.55:0/2528512429 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f5484033770 0x7f548406fcd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5494009730 tx=0x7f5494009190 comp rx=0 tx=0).stop 2023-08-25T05:35:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.085+0000 7f54a9f03640 1 -- 172.21.15.55:0/2528512429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54a415cb40 msgr2=0x7f54a40ca860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.085+0000 7f54a9f03640 1 --2- 172.21.15.55:0/2528512429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54a415cb40 0x7f54a40ca860 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f549c0b2040 tx=0x7f549c01bf60 comp rx=0 tx=0).stop 2023-08-25T05:35:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.085+0000 7f54a3fff640 1 -- 172.21.15.55:0/2528512429 reap_dead start 2023-08-25T05:35:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.085+0000 7f54a9f03640 1 -- 172.21.15.55:0/2528512429 shutdown_connections 2023-08-25T05:35:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.085+0000 7f54a9f03640 1 -- 172.21.15.55:0/2528512429 >> 172.21.15.55:0/2528512429 conn(0x7f54a406aae0 msgr2=0x7f54a40d3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.085+0000 7f54a9f03640 1 -- 172.21.15.55:0/2528512429 shutdown_connections 2023-08-25T05:35:59.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.085+0000 7f54a9f03640 1 -- 172.21.15.55:0/2528512429 wait complete. 2023-08-25T05:35:59.109 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-25T05:35:59.109 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-08-25T05:35:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.257+0000 7f0ebace5640 1 Processor -- start 2023-08-25T05:35:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.257+0000 7f0ebace5640 1 -- start start 2023-08-25T05:35:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.257+0000 7f0ebace5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0eb40c9830 0x7f0eb409bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.257+0000 7f0ebace5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0eb406c020 0x7f0eb40acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.257+0000 7f0ebace5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb415abd0 con 0x7f0eb415a7f0 2023-08-25T05:35:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.257+0000 7f0ebace5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb40c8ab0 con 0x7f0eb40c9830 2023-08-25T05:35:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.257+0000 7f0ebace5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb40c8d50 con 0x7f0eb406c020 2023-08-25T05:35:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.257+0000 7f0eabfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0eb40c9830 0x7f0eb409bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.257+0000 7f0eabfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0eb40c9830 0x7f0eb409bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40756/0 (socket says 172.21.15.55:40756) 2023-08-25T05:35:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.257+0000 7f0eabfff640 1 -- 172.21.15.55:0/525114051 learned_addr learned my addr 172.21.15.55:0/525114051 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.257+0000 7f0eb9282640 1 --2- 172.21.15.55:0/525114051 >> v2:172.21.15.110:3300/0 conn(0x7f0eb406c020 0x7f0eb40acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.257+0000 7f0eabfff640 1 -- 172.21.15.55:0/525114051 >> v2:172.21.15.110:3300/0 conn(0x7f0eb406c020 msgr2=0x7f0eb40acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.257+0000 7f0eabfff640 1 --2- 172.21.15.55:0/525114051 >> v2:172.21.15.110:3300/0 conn(0x7f0eb406c020 0x7f0eb40acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.257+0000 7f0eabfff640 1 -- 172.21.15.55:0/525114051 >> v1:172.21.15.110:6789/0 conn(0x7f0eb415a7f0 legacy=0x7f0eb4070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.257+0000 7f0eabfff640 1 -- 172.21.15.55:0/525114051 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb40c9030 con 0x7f0eb40c9830 2023-08-25T05:35:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.261+0000 7f0eabfff640 1 --2- 172.21.15.55:0/525114051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0eb40c9830 0x7f0eb409bde0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40cbf20 tx=0x7f0ea401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc9a6fef8c2971e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.261+0000 7f0eab7fe640 1 -- 172.21.15.55:0/525114051 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40ac640 con 0x7f0eb40c9830 2023-08-25T05:35:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.261+0000 7f0eab7fe640 1 -- 172.21.15.55:0/525114051 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea40ac7a0 con 0x7f0eb40c9830 2023-08-25T05:35:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.261+0000 7f0eab7fe640 1 -- 172.21.15.55:0/525114051 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40acb30 con 0x7f0eb40c9830 2023-08-25T05:35:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.261+0000 7f0ebace5640 1 -- 172.21.15.55:0/525114051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0eb40c9830 msgr2=0x7f0eb409bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.261+0000 7f0ebace5640 1 --2- 172.21.15.55:0/525114051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0eb40c9830 0x7f0eb409bde0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40cbf20 tx=0x7f0ea401c4d0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.261+0000 7f0ebace5640 1 -- 172.21.15.55:0/525114051 shutdown_connections 2023-08-25T05:35:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.261+0000 7f0ebace5640 1 --2- 172.21.15.55:0/525114051 >> v2:172.21.15.110:3300/0 conn(0x7f0eb406c020 0x7f0eb40acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.261+0000 7f0ebace5640 1 --2- 172.21.15.55:0/525114051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0eb40c9830 0x7f0eb409bde0 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.261+0000 7f0ebace5640 1 -- 172.21.15.55:0/525114051 >> 172.21.15.55:0/525114051 conn(0x7f0eb4069900 msgr2=0x7f0eb4069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.261+0000 7f0ebace5640 1 -- 172.21.15.55:0/525114051 shutdown_connections 2023-08-25T05:35:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.261+0000 7f0ebace5640 1 -- 172.21.15.55:0/525114051 wait complete. 2023-08-25T05:35:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0ebace5640 1 Processor -- start 2023-08-25T05:35:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0ebace5640 1 -- start start 2023-08-25T05:35:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0ebace5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb406c020 0x7f0eb4164f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0ebace5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0eb40c9830 0x7f0eb40c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0ebace5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0eb415a7f0 0x7f0eb4154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0ebace5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb4165480 con 0x7f0eb415a7f0 2023-08-25T05:35:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0ebace5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb40c7f80 con 0x7f0eb406c020 2023-08-25T05:35:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0ebace5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb40c75b0 con 0x7f0eb40c9830 2023-08-25T05:35:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0eb9282640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0eb415a7f0 0x7f0eb4154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0eb9282640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0eb415a7f0 0x7f0eb4154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40768/0 (socket says 172.21.15.55:40768) 2023-08-25T05:35:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0eb9282640 1 -- 172.21.15.55:0/2017322071 learned_addr learned my addr 172.21.15.55:0/2017322071 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0eabfff640 1 --2- 172.21.15.55:0/2017322071 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0eb40c9830 0x7f0eb40c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0eb8a81640 1 --2- 172.21.15.55:0/2017322071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb406c020 0x7f0eb4164f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0eb9282640 1 -- 172.21.15.55:0/2017322071 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0eb40c9830 msgr2=0x7f0eb40c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0eb9282640 1 --2- 172.21.15.55:0/2017322071 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0eb40c9830 0x7f0eb40c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0eb9282640 1 -- 172.21.15.55:0/2017322071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb406c020 msgr2=0x7f0eb4164f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0eb9282640 1 --2- 172.21.15.55:0/2017322071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb406c020 0x7f0eb4164f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0eb9282640 1 -- 172.21.15.55:0/2017322071 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea40094d0 con 0x7f0eb415a7f0 2023-08-25T05:35:59.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0eb9282640 1 --2- 172.21.15.55:0/2017322071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0eb415a7f0 0x7f0eb4154de0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00ef90 tx=0x7f0eac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:59.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.265+0000 7f0ea97fa640 1 -- 172.21.15.55:0/2017322071 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac009ca0 con 0x7f0eb415a7f0 2023-08-25T05:35:59.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.269+0000 7f0ea97fa640 1 -- 172.21.15.55:0/2017322071 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac00f040 con 0x7f0eb415a7f0 2023-08-25T05:35:59.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.269+0000 7f0ea97fa640 1 -- 172.21.15.55:0/2017322071 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0146c0 con 0x7f0eb415a7f0 2023-08-25T05:35:59.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.269+0000 7f0ebace5640 1 -- 172.21.15.55:0/2017322071 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb40c69a0 con 0x7f0eb415a7f0 2023-08-25T05:35:59.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.269+0000 7f0ebace5640 1 -- 172.21.15.55:0/2017322071 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb40c6f60 con 0x7f0eb415a7f0 2023-08-25T05:35:59.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.269+0000 7f0ebace5640 1 -- 172.21.15.55:0/2017322071 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb406d5b0 con 0x7f0eb415a7f0 2023-08-25T05:35:59.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.269+0000 7f0ea97fa640 1 -- 172.21.15.55:0/2017322071 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 109) v1 ==== 84817+0+0 (secure 0 0 0) 0x7f0eac014820 con 0x7f0eb415a7f0 2023-08-25T05:35:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.269+0000 7f0ea97fa640 1 --2- 172.21.15.55:0/2017322071 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f0ea0065550 0x7f0ea0067a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.269+0000 7f0ea97fa640 1 -- 172.21.15.55:0/2017322071 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f0eac0838f0 con 0x7f0eb415a7f0 2023-08-25T05:35:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.269+0000 7f0eb8a81640 1 --2- 172.21.15.55:0/2017322071 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f0ea0065550 0x7f0ea0067a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.269+0000 7f0eb8a81640 1 --2- 172.21.15.55:0/2017322071 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f0ea0065550 0x7f0ea0067a10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0000fc0 tx=0x7f0eb0009040 comp rx=0 tx=0).ready entity=mgr.10180 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:59.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.273+0000 7f0ea97fa640 1 -- 172.21.15.55:0/2017322071 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0eac051640 con 0x7f0eb415a7f0 2023-08-25T05:35:59.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.449+0000 7f0ebace5640 1 -- 172.21.15.55:0/2017322071 --> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0eb40ca130 con 0x7f0ea0065550 2023-08-25T05:35:59.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.513+0000 7f0ea97fa640 1 -- 172.21.15.55:0/2017322071 <== mgr.10180 v2:172.21.15.110:6832/3676103183 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f0eb0001460 con 0x7f0ea0065550 2023-08-25T05:35:59.516 INFO:teuthology.orchestra.run.smithi055.stdout:Retention added to path snap_test_dir1 2023-08-25T05:35:59.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.513+0000 7f0ebace5640 1 -- 172.21.15.55:0/2017322071 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f0ea0065550 msgr2=0x7f0ea0067a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:59.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.513+0000 7f0ebace5640 1 --2- 172.21.15.55:0/2017322071 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f0ea0065550 0x7f0ea0067a10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0000fc0 tx=0x7f0eb0009040 comp rx=0 tx=0).stop 2023-08-25T05:35:59.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.513+0000 7f0ebace5640 1 -- 172.21.15.55:0/2017322071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0eb415a7f0 msgr2=0x7f0eb4154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:59.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.513+0000 7f0ebace5640 1 --2- 172.21.15.55:0/2017322071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0eb415a7f0 0x7f0eb4154de0 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00ef90 tx=0x7f0eac00c490 comp rx=0 tx=0).stop 2023-08-25T05:35:59.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.513+0000 7f0ebace5640 1 -- 172.21.15.55:0/2017322071 shutdown_connections 2023-08-25T05:35:59.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.513+0000 7f0ebace5640 1 --2- 172.21.15.55:0/2017322071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0eb415a7f0 0x7f0eb4154de0 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.513+0000 7f0ebace5640 1 --2- 172.21.15.55:0/2017322071 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0eb40c9830 0x7f0eb40c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.513+0000 7f0ebace5640 1 --2- 172.21.15.55:0/2017322071 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f0ea0065550 0x7f0ea0067a10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.513+0000 7f0ebace5640 1 --2- 172.21.15.55:0/2017322071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb406c020 0x7f0eb4164f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.513+0000 7f0ebace5640 1 -- 172.21.15.55:0/2017322071 >> 172.21.15.55:0/2017322071 conn(0x7f0eb4069900 msgr2=0x7f0eb40ae750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.513+0000 7f0ebace5640 1 -- 172.21.15.55:0/2017322071 shutdown_connections 2023-08-25T05:35:59.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.513+0000 7f0ebace5640 1 -- 172.21.15.55:0/2017322071 wait complete. 2023-08-25T05:35:59.537 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-08-25T05:35:59.537 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-25-05_36_00 in ~1s... 2023-08-25T05:35:59.538 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-08-25T05:35:59.538 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-08-25T05:35:59.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.681+0000 7f6d72382640 1 Processor -- start 2023-08-25T05:35:59.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.681+0000 7f6d72382640 1 -- start start 2023-08-25T05:35:59.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.681+0000 7f6d72382640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d6c155360 0x7f6d6c15c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:59.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.681+0000 7f6d72382640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6d6c155740 0x7f6d6c15eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:59.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.681+0000 7f6d72382640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6c15fa50 con 0x7f6d6c06fb50 2023-08-25T05:35:59.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.681+0000 7f6d72382640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6c15f490 con 0x7f6d6c155740 2023-08-25T05:35:59.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.681+0000 7f6d72382640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c15f770 con 0x7f6d6c155360 2023-08-25T05:35:59.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.685+0000 7f6d6b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6d6c155740 0x7f6d6c15eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:59.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.685+0000 7f6d6b7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6d6c155740 0x7f6d6c15eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40778/0 (socket says 172.21.15.55:40778) 2023-08-25T05:35:59.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.685+0000 7f6d6b7fe640 1 -- 172.21.15.55:0/3131897621 learned_addr learned my addr 172.21.15.55:0/3131897621 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:59.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.685+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/3131897621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d6c155360 0x7f6d6c15c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:59.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.685+0000 7f6d6b7fe640 1 -- 172.21.15.55:0/3131897621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d6c155360 msgr2=0x7f6d6c15c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:59.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.685+0000 7f6d6b7fe640 1 --2- 172.21.15.55:0/3131897621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d6c155360 0x7f6d6c15c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.685+0000 7f6d6b7fe640 1 -- 172.21.15.55:0/3131897621 >> v1:172.21.15.110:6789/0 conn(0x7f6d6c06fb50 legacy=0x7f6d6c0aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:35:59.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.685+0000 7f6d6b7fe640 1 -- 172.21.15.55:0/3131897621 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c0ccb40 con 0x7f6d6c155740 2023-08-25T05:35:59.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.685+0000 7f6d6b7fe640 1 --2- 172.21.15.55:0/3131897621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c155740 0x7f6d6c15eb90 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f6d60009870 tx=0x7f6d6001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add3f4cbb58ba4d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:59.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.685+0000 7f6d6affd640 1 -- 172.21.15.55:0/3131897621 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d600ab600 con 0x7f6d6c155740 2023-08-25T05:35:59.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.685+0000 7f6d6affd640 1 -- 172.21.15.55:0/3131897621 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d600a7050 con 0x7f6d6c155740 2023-08-25T05:35:59.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.685+0000 7f6d6affd640 1 -- 172.21.15.55:0/3131897621 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d600ab980 con 0x7f6d6c155740 2023-08-25T05:35:59.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d72382640 1 -- 172.21.15.55:0/3131897621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c155740 msgr2=0x7f6d6c15eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:59.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d72382640 1 --2- 172.21.15.55:0/3131897621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c155740 0x7f6d6c15eb90 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f6d60009870 tx=0x7f6d6001c420 comp rx=0 tx=0).stop 2023-08-25T05:35:59.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d72382640 1 -- 172.21.15.55:0/3131897621 shutdown_connections 2023-08-25T05:35:59.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d72382640 1 --2- 172.21.15.55:0/3131897621 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c155740 0x7f6d6c15eb90 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d72382640 1 --2- 172.21.15.55:0/3131897621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d6c155360 0x7f6d6c15c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d72382640 1 -- 172.21.15.55:0/3131897621 >> 172.21.15.55:0/3131897621 conn(0x7f6d6c0caf90 msgr2=0x7f6d6c0cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:59.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d72382640 1 -- 172.21.15.55:0/3131897621 shutdown_connections 2023-08-25T05:35:59.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d72382640 1 -- 172.21.15.55:0/3131897621 wait complete. 2023-08-25T05:35:59.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d72382640 1 Processor -- start 2023-08-25T05:35:59.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d72382640 1 -- start start 2023-08-25T05:35:59.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d72382640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c06fb50 0x7f6d6c14bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:59.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d72382640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d6c155360 0x7f6d6c0c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:59.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d72382640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d6c155740 0x7f6d6c153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:59.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d72382640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c156890 con 0x7f6d6c06fb50 2023-08-25T05:35:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d72382640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c156b70 con 0x7f6d6c155740 2023-08-25T05:35:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d72382640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c0c6de0 con 0x7f6d6c155360 2023-08-25T05:35:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d6bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c06fb50 0x7f6d6c14bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d6bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c06fb50 0x7f6d6c14bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40792/0 (socket says 172.21.15.55:40792) 2023-08-25T05:35:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d6bfff640 1 -- 172.21.15.55:0/3864640062 learned_addr learned my addr 172.21.15.55:0/3864640062 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:35:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d6b7fe640 1 --2- 172.21.15.55:0/3864640062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d6c155360 0x7f6d6c0c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d7091f640 1 --2- 172.21.15.55:0/3864640062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d6c155740 0x7f6d6c153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d6bfff640 1 -- 172.21.15.55:0/3864640062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d6c155360 msgr2=0x7f6d6c0c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/3864640062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d6c155360 0x7f6d6c0c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d6bfff640 1 -- 172.21.15.55:0/3864640062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d6c155740 msgr2=0x7f6d6c153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/3864640062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d6c155740 0x7f6d6c153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.689+0000 7f6d6bfff640 1 -- 172.21.15.55:0/3864640062 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d600094d0 con 0x7f6d6c06fb50 2023-08-25T05:35:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.693+0000 7f6d6bfff640 1 --2- 172.21.15.55:0/3864640062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c06fb50 0x7f6d6c14bd90 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00d5f0 tx=0x7f6d5c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.693+0000 7f6d68ff9640 1 -- 172.21.15.55:0/3864640062 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c0125f0 con 0x7f6d6c06fb50 2023-08-25T05:35:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.693+0000 7f6d68ff9640 1 -- 172.21.15.55:0/3864640062 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5c012750 con 0x7f6d6c06fb50 2023-08-25T05:35:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.693+0000 7f6d68ff9640 1 -- 172.21.15.55:0/3864640062 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c012ae0 con 0x7f6d6c06fb50 2023-08-25T05:35:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.693+0000 7f6d72382640 1 -- 172.21.15.55:0/3864640062 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6c0c70c0 con 0x7f6d6c06fb50 2023-08-25T05:35:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.693+0000 7f6d72382640 1 -- 172.21.15.55:0/3864640062 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6c14c2d0 con 0x7f6d6c06fb50 2023-08-25T05:35:59.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.693+0000 7f6d72382640 1 -- 172.21.15.55:0/3864640062 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6c04dbe0 con 0x7f6d6c06fb50 2023-08-25T05:35:59.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.693+0000 7f6d68ff9640 1 -- 172.21.15.55:0/3864640062 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 109) v1 ==== 84817+0+0 (secure 0 0 0) 0x7f6d5c012c40 con 0x7f6d6c06fb50 2023-08-25T05:35:59.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.697+0000 7f6d68ff9640 1 --2- 172.21.15.55:0/3864640062 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f6d58065520 0x7f6d580679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:35:59.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.697+0000 7f6d68ff9640 1 -- 172.21.15.55:0/3864640062 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f6d5c083180 con 0x7f6d6c06fb50 2023-08-25T05:35:59.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.697+0000 7f6d6b7fe640 1 --2- 172.21.15.55:0/3864640062 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f6d58065520 0x7f6d580679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:35:59.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.697+0000 7f6d6b7fe640 1 --2- 172.21.15.55:0/3864640062 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f6d58065520 0x7f6d580679e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6d600ad000 tx=0x7f6d600a6000 comp rx=0 tx=0).ready entity=mgr.10180 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:35:59.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.701+0000 7f6d68ff9640 1 -- 172.21.15.55:0/3864640062 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6d5c050cd0 con 0x7f6d6c06fb50 2023-08-25T05:35:59.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.877+0000 7f6d72382640 1 -- 172.21.15.55:0/3864640062 --> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d6c0b06a0 con 0x7f6d58065520 2023-08-25T05:35:59.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.885+0000 7f6d68ff9640 1 -- 172.21.15.55:0/3864640062 <== mgr.10180 v2:172.21.15.110:6832/3676103183 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f6d600bc0d0 con 0x7f6d58065520 2023-08-25T05:35:59.889 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:35:59.889 INFO:teuthology.orchestra.run.smithi055.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-08-25T05:35:59.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.885+0000 7f6d72382640 1 -- 172.21.15.55:0/3864640062 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f6d58065520 msgr2=0x7f6d580679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:59.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.885+0000 7f6d72382640 1 --2- 172.21.15.55:0/3864640062 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f6d58065520 0x7f6d580679e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6d600ad000 tx=0x7f6d600a6000 comp rx=0 tx=0).stop 2023-08-25T05:35:59.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.885+0000 7f6d72382640 1 -- 172.21.15.55:0/3864640062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c06fb50 msgr2=0x7f6d6c14bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:35:59.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.885+0000 7f6d72382640 1 --2- 172.21.15.55:0/3864640062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c06fb50 0x7f6d6c14bd90 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00d5f0 tx=0x7f6d5c00dab0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.885+0000 7f6d72382640 1 -- 172.21.15.55:0/3864640062 shutdown_connections 2023-08-25T05:35:59.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.885+0000 7f6d72382640 1 --2- 172.21.15.55:0/3864640062 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f6d58065520 0x7f6d580679e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.885+0000 7f6d72382640 1 --2- 172.21.15.55:0/3864640062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d6c155740 0x7f6d6c153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.885+0000 7f6d72382640 1 --2- 172.21.15.55:0/3864640062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d6c155360 0x7f6d6c0c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.885+0000 7f6d72382640 1 --2- 172.21.15.55:0/3864640062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c06fb50 0x7f6d6c14bd90 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:35:59.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.885+0000 7f6d72382640 1 -- 172.21.15.55:0/3864640062 >> 172.21.15.55:0/3864640062 conn(0x7f6d6c0caf90 msgr2=0x7f6d6c0cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:35:59.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.885+0000 7f6d72382640 1 -- 172.21.15.55:0/3864640062 shutdown_connections 2023-08-25T05:35:59.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:35:59.885+0000 7f6d72382640 1 -- 172.21.15.55:0/3864640062 wait complete. 2023-08-25T05:35:59.910 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-08-25T05:35:59.910 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-08-25T05:35:59.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:35:59.911 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:35:59.922 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-08-25T05:35:59.922 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:35:59.922 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:00.528 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:36:00.527+0000 7f29d22c3640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:36:00.529 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:36:00.527+0000 7f29d22c3640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:36:00.529 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:36:00.527+0000 7f29d22c3640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:36:00.529 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:36:00.527+0000 7f29d22c3640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:36:00.529 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:36:00.527+0000 7f29d22c3640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:36:00.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:00.923 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:00.934 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:00.935 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:00.935 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:00.935 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:00.935 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-08-25-05_36_00_UTC'] 2023-08-25T05:36:00.936 DEBUG:tasks.cephfs.test_snap_schedules:exec=1692941759.5379257, now = 1692941760.9362483, timo = 1 2023-08-25T05:36:01.936 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-08-25-05_36_00 in ~61s... 2023-08-25T05:36:01.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:01.937 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:01.949 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:01.949 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:01.950 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:01.950 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:02.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:02.952 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:02.963 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:02.964 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:02.964 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:02.965 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:03.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:03.966 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:03.977 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:03.978 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:03.978 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:03.978 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:04.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:04.980 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:04.991 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:04.992 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:04.992 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:04.992 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:05.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:05.994 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:06.005 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:06.007 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:06.007 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:06.008 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:07.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:07.010 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:07.021 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:07.022 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:07.023 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:07.023 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:08.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:08.025 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:08.036 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:08.037 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:08.037 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:08.037 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:09.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:09.039 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:09.050 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:09.051 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:09.051 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:09.051 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:10.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:10.053 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:10.064 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:10.071 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:10.071 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:10.071 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:11.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:11.073 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:11.084 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:11.085 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:11.085 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:11.085 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:12.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:12.087 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:12.098 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:12.099 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:12.099 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:12.099 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:13.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:13.101 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:13.112 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:13.113 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:13.113 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:13.114 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:14.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:14.115 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:14.126 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:14.127 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:14.128 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:14.128 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:15.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:15.130 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:15.141 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:15.142 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:15.142 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:15.142 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:16.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:16.144 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:16.155 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:16.156 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:16.156 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:16.156 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:17.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:17.157 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:17.168 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:17.169 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:17.169 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:17.170 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:17.555 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:36:17.559 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:36:18.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:18.171 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:18.182 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:18.183 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:18.183 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:18.184 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:19.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:19.186 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:19.200 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:19.201 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:19.201 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:19.201 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:20.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:20.203 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:20.214 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:20.215 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:20.215 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:20.215 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:21.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:21.217 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:21.228 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:21.229 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:21.230 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:21.230 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:22.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:22.231 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:22.242 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:22.244 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:22.244 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:22.244 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:23.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:23.246 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:23.257 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:23.258 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:23.258 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:23.258 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:24.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:24.260 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:24.271 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:24.272 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:24.272 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:24.272 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:25.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:25.274 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:25.285 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:25.286 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:25.286 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:25.287 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:26.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:26.288 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:26.299 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:26.300 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:26.300 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:26.300 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:27.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:27.302 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:27.313 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:27.314 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:27.314 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:27.315 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:28.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:28.316 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:28.326 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:28.327 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:28.328 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:28.328 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:29.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:29.330 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:29.341 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:29.342 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:29.343 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:29.343 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:30.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:30.344 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:30.355 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:30.356 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:30.356 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:30.356 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:31.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:31.358 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:31.369 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:31.370 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:31.371 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:31.371 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:32.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:32.372 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:32.383 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:32.384 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:32.384 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:32.385 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:33.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:33.386 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:33.397 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:33.398 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:33.398 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:33.399 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:34.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:34.400 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:34.416 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:34.417 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:34.418 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:34.418 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:35.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:35.419 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:35.431 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:35.432 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:35.432 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:35.432 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:36.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:36.433 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:36.444 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:36.445 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:36.445 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:36.445 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:37.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:37.447 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:37.458 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:37.459 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:37.459 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:37.459 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:38.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:38.461 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:38.471 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:38.472 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:38.473 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:38.473 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:39.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:39.475 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:39.486 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:39.487 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:39.487 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:39.487 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:40.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:40.489 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:40.500 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:40.501 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:40.502 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:40.502 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:41.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:41.503 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:41.514 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:41.515 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:41.515 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:41.516 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:42.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:42.517 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:42.528 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:42.529 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:42.529 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:42.530 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:43.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:43.531 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:43.542 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:43.543 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:43.544 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:43.544 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:44.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:44.546 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:44.557 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:44.558 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:44.558 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:44.558 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:45.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:45.560 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:45.571 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:45.572 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:45.572 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:45.572 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:46.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:46.574 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:46.585 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:46.586 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:46.586 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:46.586 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:47.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:47.588 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:47.599 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:47.600 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:47.601 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:47.601 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:47.765 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:36:47.768 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:36:48.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:48.603 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:48.613 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:48.614 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:48.615 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:48.615 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:49.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:49.616 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:49.627 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:49.628 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:49.628 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:49.628 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:50.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:50.630 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:50.641 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:50.642 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:50.642 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:50.643 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:51.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:51.644 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:51.655 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:51.656 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:51.657 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:51.657 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:52.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:52.659 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:52.670 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:52.671 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:52.671 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:52.671 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:53.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:53.673 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:53.684 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:53.685 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:53.685 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:53.685 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:54.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:54.687 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:54.698 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:54.699 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:54.699 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:54.699 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:55.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:55.701 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:55.712 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:55.713 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:55.713 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:55.714 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:56.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:56.716 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:56.727 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:56.728 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:56.728 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:56.728 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:57.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:57.730 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:57.741 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:57.742 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:57.742 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:57.742 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:58.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:58.744 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:58.755 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:58.756 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:58.757 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:58.757 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:36:59.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:36:59.758 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:36:59.769 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_36_00_UTC 2023-08-25T05:36:59.770 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:36:59.770 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-08-25T05:36:59.771 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-08-25T05:37:00.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:00.772 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:37:00.783 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_37_00_UTC 2023-08-25T05:37:00.784 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-08-25-05_37_00_UTC'} 2023-08-25T05:37:00.785 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-08-25-05_37_00_UTC'} 2023-08-25T05:37:00.785 INFO:tasks.cephfs.test_snap_schedules:removed: {'scheduled-2023-08-25-05_36_00_UTC'} 2023-08-25T05:37:00.785 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-08-25-05_36_00_UTC'] 2023-08-25T05:37:00.786 DEBUG:tasks.cephfs.test_snap_schedules:exec=1692941759.5379257, now = 1692941820.7860954, timo = 61 2023-08-25T05:37:01.786 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-25T05:37:01.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.943+0000 7f1fa6d74640 1 Processor -- start 2023-08-25T05:37:01.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.943+0000 7f1fa6d74640 1 -- start start 2023-08-25T05:37:01.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.943+0000 7f1fa6d74640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa00ccc90 0x7f1fa00aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:01.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.943+0000 7f1fa6d74640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1fa00cd120 0x7f1fa00b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:01.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.943+0000 7f1fa6d74640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa0161b50 con 0x7f1fa01575e0 2023-08-25T05:37:01.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.943+0000 7f1fa6d74640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa00702f0 con 0x7f1fa00cd120 2023-08-25T05:37:01.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.943+0000 7f1fa6d74640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa01612e0 con 0x7f1fa00ccc90 2023-08-25T05:37:01.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.943+0000 7f1fa5311640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1fa00cd120 0x7f1fa00b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:01.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.943+0000 7f1fa5311640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1fa00cd120 0x7f1fa00b04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60312/0 (socket says 172.21.15.55:60312) 2023-08-25T05:37:01.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.943+0000 7f1fa5311640 1 -- 172.21.15.55:0/2294661519 learned_addr learned my addr 172.21.15.55:0/2294661519 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:01.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.943+0000 7f1f97fff640 1 --2- 172.21.15.55:0/2294661519 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa00ccc90 0x7f1fa00aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:01.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.943+0000 7f1fa5311640 1 -- 172.21.15.55:0/2294661519 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa00ccc90 msgr2=0x7f1fa00aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:01.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.943+0000 7f1fa5311640 1 --2- 172.21.15.55:0/2294661519 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa00ccc90 0x7f1fa00aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:01.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.943+0000 7f1fa5311640 1 -- 172.21.15.55:0/2294661519 >> v1:172.21.15.110:6789/0 conn(0x7f1fa01575e0 legacy=0x7f1fa0160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:01.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.943+0000 7f1fa5311640 1 -- 172.21.15.55:0/2294661519 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa0161590 con 0x7f1fa00cd120 2023-08-25T05:37:01.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.947+0000 7f1fa5311640 1 --2- 172.21.15.55:0/2294661519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa00cd120 0x7f1fa00b04d0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009e80 tx=0x7f1f9801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6f40c5e6542f3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:01.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.947+0000 7f1f977fe640 1 -- 172.21.15.55:0/2294661519 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f980a57f0 con 0x7f1fa00cd120 2023-08-25T05:37:01.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.947+0000 7f1f977fe640 1 -- 172.21.15.55:0/2294661519 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f980a5950 con 0x7f1fa00cd120 2023-08-25T05:37:01.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.947+0000 7f1f977fe640 1 -- 172.21.15.55:0/2294661519 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f980a5ce0 con 0x7f1fa00cd120 2023-08-25T05:37:01.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.947+0000 7f1fa6d74640 1 -- 172.21.15.55:0/2294661519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa00cd120 msgr2=0x7f1fa00b04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:01.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.947+0000 7f1fa6d74640 1 --2- 172.21.15.55:0/2294661519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa00cd120 0x7f1fa00b04d0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009e80 tx=0x7f1f9801c930 comp rx=0 tx=0).stop 2023-08-25T05:37:01.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.947+0000 7f1fa6d74640 1 -- 172.21.15.55:0/2294661519 shutdown_connections 2023-08-25T05:37:01.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.947+0000 7f1fa6d74640 1 --2- 172.21.15.55:0/2294661519 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa00cd120 0x7f1fa00b04d0 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:01.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.947+0000 7f1fa6d74640 1 --2- 172.21.15.55:0/2294661519 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa00ccc90 0x7f1fa00aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:01.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.947+0000 7f1fa6d74640 1 -- 172.21.15.55:0/2294661519 >> 172.21.15.55:0/2294661519 conn(0x7f1fa00caf90 msgr2=0x7f1fa00cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:01.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.947+0000 7f1fa6d74640 1 -- 172.21.15.55:0/2294661519 shutdown_connections 2023-08-25T05:37:01.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.947+0000 7f1fa6d74640 1 -- 172.21.15.55:0/2294661519 wait complete. 2023-08-25T05:37:01.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1fa6d74640 1 Processor -- start 2023-08-25T05:37:01.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1fa6d74640 1 -- start start 2023-08-25T05:37:01.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1fa6d74640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa00ccc90 0x7f1fa00c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:01.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1fa6d74640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa00cd120 0x7f1fa01558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:01.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1fa6d74640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa01575e0 0x7f1fa0155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:01.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1fa6d74640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00c3d60 con 0x7f1fa00cd120 2023-08-25T05:37:01.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1fa6d74640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00b0600 con 0x7f1fa00ccc90 2023-08-25T05:37:01.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1fa6d74640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00c3150 con 0x7f1fa01575e0 2023-08-25T05:37:01.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1f97fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa00cd120 0x7f1fa01558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:01.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1f97fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa00cd120 0x7f1fa01558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60320/0 (socket says 172.21.15.55:60320) 2023-08-25T05:37:01.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1f97fff640 1 -- 172.21.15.55:0/2417472592 learned_addr learned my addr 172.21.15.55:0/2417472592 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:01.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1fa4b10640 1 --2- 172.21.15.55:0/2417472592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa00ccc90 0x7f1fa00c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:01.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1fa5311640 1 --2- 172.21.15.55:0/2417472592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa01575e0 0x7f1fa0155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:01.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1f97fff640 1 -- 172.21.15.55:0/2417472592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa01575e0 msgr2=0x7f1fa0155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:01.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1f97fff640 1 --2- 172.21.15.55:0/2417472592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa01575e0 0x7f1fa0155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:01.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1f97fff640 1 -- 172.21.15.55:0/2417472592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa00ccc90 msgr2=0x7f1fa00c2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:01.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1f97fff640 1 --2- 172.21.15.55:0/2417472592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa00ccc90 0x7f1fa00c2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:01.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1f97fff640 1 -- 172.21.15.55:0/2417472592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f98009b30 con 0x7f1fa00cd120 2023-08-25T05:37:01.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1fa5311640 1 --2- 172.21.15.55:0/2417472592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa01575e0 0x7f1fa0155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:01.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1f97fff640 1 --2- 172.21.15.55:0/2417472592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa00cd120 0x7f1fa01558c0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000d800 tx=0x7f1f9000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:01.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1f957fa640 1 -- 172.21.15.55:0/2417472592 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9000b6c0 con 0x7f1fa00cd120 2023-08-25T05:37:01.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1f957fa640 1 -- 172.21.15.55:0/2417472592 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9000b820 con 0x7f1fa00cd120 2023-08-25T05:37:01.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1f957fa640 1 -- 172.21.15.55:0/2417472592 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9000bb90 con 0x7f1fa00cd120 2023-08-25T05:37:01.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.951+0000 7f1fa6d74640 1 -- 172.21.15.55:0/2417472592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa00c3430 con 0x7f1fa00cd120 2023-08-25T05:37:01.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.955+0000 7f1fa6d74640 1 -- 172.21.15.55:0/2417472592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa00c39f0 con 0x7f1fa00cd120 2023-08-25T05:37:01.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.955+0000 7f1fa6d74640 1 -- 172.21.15.55:0/2417472592 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa00c3bb0 con 0x7f1fa00cd120 2023-08-25T05:37:01.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.955+0000 7f1f957fa640 1 -- 172.21.15.55:0/2417472592 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 111) v1 ==== 85195+0+0 (secure 0 0 0) 0x7f1f9000bcf0 con 0x7f1fa00cd120 2023-08-25T05:37:01.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.955+0000 7f1f957fa640 1 --2- 172.21.15.55:0/2417472592 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f1f8c065910 0x7f1f8c067dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:01.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.955+0000 7f1f957fa640 1 -- 172.21.15.55:0/2417472592 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f1f90083960 con 0x7f1fa00cd120 2023-08-25T05:37:01.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.955+0000 7f1fa4b10640 1 --2- 172.21.15.55:0/2417472592 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f1f8c065910 0x7f1f8c067dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:01.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.959+0000 7f1fa4b10640 1 --2- 172.21.15.55:0/2417472592 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f1f8c065910 0x7f1f8c067dd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c007fd0 tx=0x7f1f9c009040 comp rx=0 tx=0).ready entity=mgr.10180 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:01.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:01.959+0000 7f1f957fa640 1 -- 172.21.15.55:0/2417472592 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1f90054950 con 0x7f1fa00cd120 2023-08-25T05:37:02.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.139+0000 7f1fa6d74640 1 -- 172.21.15.55:0/2417472592 --> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fa00b1550 con 0x7f1f8c065910 2023-08-25T05:37:02.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.207+0000 7f1f957fa640 1 -- 172.21.15.55:0/2417472592 <== mgr.10180 v2:172.21.15.110:6832/3676103183 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f1fa00b1550 con 0x7f1f8c065910 2023-08-25T05:37:02.211 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path snap_test_dir1 2023-08-25T05:37:02.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.211+0000 7f1fa6d74640 1 -- 172.21.15.55:0/2417472592 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f1f8c065910 msgr2=0x7f1f8c067dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:02.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.211+0000 7f1fa6d74640 1 --2- 172.21.15.55:0/2417472592 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f1f8c065910 0x7f1f8c067dd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c007fd0 tx=0x7f1f9c009040 comp rx=0 tx=0).stop 2023-08-25T05:37:02.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.211+0000 7f1fa6d74640 1 -- 172.21.15.55:0/2417472592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa00cd120 msgr2=0x7f1fa01558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:02.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.211+0000 7f1fa6d74640 1 --2- 172.21.15.55:0/2417472592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa00cd120 0x7f1fa01558c0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000d800 tx=0x7f1f9000dcc0 comp rx=0 tx=0).stop 2023-08-25T05:37:02.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.211+0000 7f1fa6d74640 1 -- 172.21.15.55:0/2417472592 shutdown_connections 2023-08-25T05:37:02.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.211+0000 7f1fa6d74640 1 --2- 172.21.15.55:0/2417472592 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1fa01575e0 0x7f1fa0155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:02.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.211+0000 7f1fa6d74640 1 --2- 172.21.15.55:0/2417472592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fa00cd120 0x7f1fa01558c0 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:02.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.211+0000 7f1fa6d74640 1 --2- 172.21.15.55:0/2417472592 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f1f8c065910 0x7f1f8c067dd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:02.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.211+0000 7f1fa6d74640 1 --2- 172.21.15.55:0/2417472592 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1fa00ccc90 0x7f1fa00c2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:02.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.211+0000 7f1fa6d74640 1 -- 172.21.15.55:0/2417472592 >> 172.21.15.55:0/2417472592 conn(0x7f1fa00caf90 msgr2=0x7f1fa00ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:02.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.211+0000 7f1fa6d74640 1 -- 172.21.15.55:0/2417472592 shutdown_connections 2023-08-25T05:37:02.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.211+0000 7f1fa6d74640 1 -- 172.21.15.55:0/2417472592 wait complete. 2023-08-25T05:37:02.232 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-25T05:37:02.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:02.233 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:37:02.242 INFO:teuthology.orchestra.run.smithi055.stdout:scheduled-2023-08-25-05_37_00_UTC 2023-08-25T05:37:02.243 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-08-25-05_37_00_UTC 2023-08-25T05:37:02.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:02.244 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-08-25-05_37_00_UTC) 2023-08-25T05:37:02.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:02.305 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-25T05:37:02.364 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-25T05:37:02.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.551+0000 7fb2e9234640 1 Processor -- start 2023-08-25T05:37:02.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.551+0000 7fb2e9234640 1 -- start start 2023-08-25T05:37:02.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.551+0000 7fb2e9234640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb2e40c9830 0x7fb2e409bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:02.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.551+0000 7fb2e9234640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2e406c020 0x7fb2e40acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:02.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.551+0000 7fb2e9234640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e415abd0 con 0x7fb2e415a7f0 2023-08-25T05:37:02.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.551+0000 7fb2e9234640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e40c8ab0 con 0x7fb2e406c020 2023-08-25T05:37:02.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.551+0000 7fb2e9234640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e40c8d50 con 0x7fb2e40c9830 2023-08-25T05:37:02.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.551+0000 7fb2e359e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2e406c020 0x7fb2e40acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:02.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.551+0000 7fb2e359e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2e406c020 0x7fb2e40acff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60322/0 (socket says 172.21.15.55:60322) 2023-08-25T05:37:02.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.551+0000 7fb2e359e640 1 -- 172.21.15.55:0/3620130368 learned_addr learned my addr 172.21.15.55:0/3620130368 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:02.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.551+0000 7fb2dbfff640 1 --2- 172.21.15.55:0/3620130368 >> v2:172.21.15.110:3300/0 conn(0x7fb2e40c9830 0x7fb2e409bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:02.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.551+0000 7fb2e359e640 1 -- 172.21.15.55:0/3620130368 >> v2:172.21.15.110:3300/0 conn(0x7fb2e40c9830 msgr2=0x7fb2e409bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:02.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.551+0000 7fb2e359e640 1 --2- 172.21.15.55:0/3620130368 >> v2:172.21.15.110:3300/0 conn(0x7fb2e40c9830 0x7fb2e409bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:02.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.551+0000 7fb2e359e640 1 -- 172.21.15.55:0/3620130368 >> v1:172.21.15.110:6789/0 conn(0x7fb2e415a7f0 legacy=0x7fb2e4070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:02.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.551+0000 7fb2e359e640 1 -- 172.21.15.55:0/3620130368 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e40c9030 con 0x7fb2e406c020 2023-08-25T05:37:02.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.555+0000 7fb2e359e640 1 --2- 172.21.15.55:0/3620130368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e406c020 0x7fb2e40acff0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fb2e406d740 tx=0x7fb2dc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6585bf3ac9bdce3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:02.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.555+0000 7fb2e259c640 1 -- 172.21.15.55:0/3620130368 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0a5770 con 0x7fb2e406c020 2023-08-25T05:37:02.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.555+0000 7fb2e259c640 1 -- 172.21.15.55:0/3620130368 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc0a58d0 con 0x7fb2e406c020 2023-08-25T05:37:02.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.555+0000 7fb2e259c640 1 -- 172.21.15.55:0/3620130368 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0a5c60 con 0x7fb2e406c020 2023-08-25T05:37:02.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.555+0000 7fb2e9234640 1 -- 172.21.15.55:0/3620130368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e406c020 msgr2=0x7fb2e40acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:02.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.555+0000 7fb2e9234640 1 --2- 172.21.15.55:0/3620130368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e406c020 0x7fb2e40acff0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fb2e406d740 tx=0x7fb2dc01c9a0 comp rx=0 tx=0).stop 2023-08-25T05:37:02.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.555+0000 7fb2e9234640 1 -- 172.21.15.55:0/3620130368 shutdown_connections 2023-08-25T05:37:02.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.555+0000 7fb2e9234640 1 --2- 172.21.15.55:0/3620130368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e406c020 0x7fb2e40acff0 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:02.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.555+0000 7fb2e9234640 1 --2- 172.21.15.55:0/3620130368 >> v2:172.21.15.110:3300/0 conn(0x7fb2e40c9830 0x7fb2e409bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:02.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.555+0000 7fb2e9234640 1 -- 172.21.15.55:0/3620130368 >> 172.21.15.55:0/3620130368 conn(0x7fb2e4069900 msgr2=0x7fb2e4069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:02.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.555+0000 7fb2e9234640 1 -- 172.21.15.55:0/3620130368 shutdown_connections 2023-08-25T05:37:02.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.555+0000 7fb2e9234640 1 -- 172.21.15.55:0/3620130368 wait complete. 2023-08-25T05:37:02.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.555+0000 7fb2e9234640 1 Processor -- start 2023-08-25T05:37:02.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e9234640 1 -- start start 2023-08-25T05:37:02.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e9234640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e406c020 0x7fb2e41551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:02.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e9234640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e40c9830 0x7fb2e4156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:02.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e9234640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2e415a7f0 0x7fb2e41544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:02.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e9234640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e41557a0 con 0x7fb2e406c020 2023-08-25T05:37:02.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e9234640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4155a80 con 0x7fb2e40c9830 2023-08-25T05:37:02.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e9234640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4155d60 con 0x7fb2e415a7f0 2023-08-25T05:37:02.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e406c020 0x7fb2e41551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:02.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e406c020 0x7fb2e41551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60330/0 (socket says 172.21.15.55:60330) 2023-08-25T05:37:02.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e2d9d640 1 -- 172.21.15.55:0/3365176181 learned_addr learned my addr 172.21.15.55:0/3365176181 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:02.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2dbfff640 1 --2- 172.21.15.55:0/3365176181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e40c9830 0x7fb2e4156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:02.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e359e640 1 --2- 172.21.15.55:0/3365176181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2e415a7f0 0x7fb2e41544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:02.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e2d9d640 1 -- 172.21.15.55:0/3365176181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2e415a7f0 msgr2=0x7fb2e41544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:02.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e2d9d640 1 --2- 172.21.15.55:0/3365176181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2e415a7f0 0x7fb2e41544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:02.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e2d9d640 1 -- 172.21.15.55:0/3365176181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e40c9830 msgr2=0x7fb2e4156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:02.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e2d9d640 1 --2- 172.21.15.55:0/3365176181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e40c9830 0x7fb2e4156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:02.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e2d9d640 1 -- 172.21.15.55:0/3365176181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc009b30 con 0x7fb2e406c020 2023-08-25T05:37:02.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e2d9d640 1 --2- 172.21.15.55:0/3365176181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e406c020 0x7fb2e41551c0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400c400 tx=0x7fb2d400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:02.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2db7fe640 1 -- 172.21.15.55:0/3365176181 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d40052d0 con 0x7fb2e406c020 2023-08-25T05:37:02.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2db7fe640 1 -- 172.21.15.55:0/3365176181 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d4005430 con 0x7fb2e406c020 2023-08-25T05:37:02.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e9234640 1 -- 172.21.15.55:0/3365176181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e4156040 con 0x7fb2e406c020 2023-08-25T05:37:02.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2db7fe640 1 -- 172.21.15.55:0/3365176181 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4003890 con 0x7fb2e406c020 2023-08-25T05:37:02.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e9234640 1 -- 172.21.15.55:0/3365176181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e4154a00 con 0x7fb2e406c020 2023-08-25T05:37:02.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.559+0000 7fb2e9234640 1 -- 172.21.15.55:0/3365176181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e406d5b0 con 0x7fb2e406c020 2023-08-25T05:37:02.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.563+0000 7fb2db7fe640 1 -- 172.21.15.55:0/3365176181 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 111) v1 ==== 85195+0+0 (secure 0 0 0) 0x7fb2d40039f0 con 0x7fb2e406c020 2023-08-25T05:37:02.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.563+0000 7fb2db7fe640 1 --2- 172.21.15.55:0/3365176181 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7fb2c4065910 0x7fb2c4067dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:02.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.563+0000 7fb2db7fe640 1 -- 172.21.15.55:0/3365176181 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fb2d4082860 con 0x7fb2e406c020 2023-08-25T05:37:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.563+0000 7fb2dbfff640 1 --2- 172.21.15.55:0/3365176181 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7fb2c4065910 0x7fb2c4067dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.563+0000 7fb2dbfff640 1 --2- 172.21.15.55:0/3365176181 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7fb2c4065910 0x7fb2c4067dd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb2e41f6850 tx=0x7fb2cc009190 comp rx=0 tx=0).ready entity=mgr.10180 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.567+0000 7fb2db7fe640 1 -- 172.21.15.55:0/3365176181 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb2d404ffe0 con 0x7fb2e406c020 2023-08-25T05:37:02.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:02.759+0000 7fb2e9234640 1 -- 172.21.15.55:0/3365176181 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fb2e4073ec0 con 0x7fb2e406c020 2023-08-25T05:37:03.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.367+0000 7fb2db7fe640 1 -- 172.21.15.55:0/3365176181 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 112) v1 ==== 85178+0+0 (secure 0 0 0) 0x7fb2d40503b0 con 0x7fb2e406c020 2023-08-25T05:37:03.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.367+0000 7fb2db7fe640 1 -- 172.21.15.55:0/3365176181 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v112) v1 ==== 93+0+0 (secure 0 0 0) 0x7fb2d4071840 con 0x7fb2e406c020 2023-08-25T05:37:03.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.367+0000 7fb2e9234640 1 -- 172.21.15.55:0/3365176181 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7fb2c4065910 msgr2=0x7fb2c4067dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:03.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.367+0000 7fb2e9234640 1 --2- 172.21.15.55:0/3365176181 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7fb2c4065910 0x7fb2c4067dd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb2e41f6850 tx=0x7fb2cc009190 comp rx=0 tx=0).stop 2023-08-25T05:37:03.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.367+0000 7fb2e9234640 1 -- 172.21.15.55:0/3365176181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e406c020 msgr2=0x7fb2e41551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:03.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.367+0000 7fb2e9234640 1 --2- 172.21.15.55:0/3365176181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e406c020 0x7fb2e41551c0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400c400 tx=0x7fb2d400c8c0 comp rx=0 tx=0).stop 2023-08-25T05:37:03.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.367+0000 7fb2e9234640 1 -- 172.21.15.55:0/3365176181 shutdown_connections 2023-08-25T05:37:03.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.367+0000 7fb2e9234640 1 --2- 172.21.15.55:0/3365176181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb2e415a7f0 0x7fb2e41544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:03.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.367+0000 7fb2e9234640 1 --2- 172.21.15.55:0/3365176181 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7fb2c4065910 0x7fb2c4067dd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:03.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.367+0000 7fb2e9234640 1 --2- 172.21.15.55:0/3365176181 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2e40c9830 0x7fb2e4156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:03.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.367+0000 7fb2e9234640 1 --2- 172.21.15.55:0/3365176181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2e406c020 0x7fb2e41551c0 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:03.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.367+0000 7fb2e9234640 1 -- 172.21.15.55:0/3365176181 >> 172.21.15.55:0/3365176181 conn(0x7fb2e4069900 msgr2=0x7fb2e40aafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:03.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.371+0000 7fb2e9234640 1 -- 172.21.15.55:0/3365176181 shutdown_connections 2023-08-25T05:37:03.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.371+0000 7fb2e9234640 1 -- 172.21.15.55:0/3365176181 wait complete. 2023-08-25T05:37:03.393 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T05:37:03.394 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T05:37:03.450 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T05:37:03.518 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T05:37:03.519 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:37:03.519 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:03.529 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:37:03.529 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:03.545 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:03.543+0000 7fd686b18180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:37:03.548 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:03.546+0000 7f0c2fc69180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:37:03.554 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:37:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.739+0000 7f24cbaec640 1 Processor -- start 2023-08-25T05:37:03.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.739+0000 7f24cbaec640 1 -- start start 2023-08-25T05:37:03.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.739+0000 7f24cbaec640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f24c40ad950 0x7f24c40cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:03.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.739+0000 7f24cbaec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24c40ceeb0 0x7f24c40b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:03.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.739+0000 7f24cbaec640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c40cc880 con 0x7f24c40c89f0 2023-08-25T05:37:03.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.739+0000 7f24cbaec640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c40b11f0 con 0x7f24c40ad950 2023-08-25T05:37:03.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.739+0000 7f24cbaec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c4159d50 con 0x7f24c40ceeb0 2023-08-25T05:37:03.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.739+0000 7f24c9087640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f24c40c89f0 0x7f24c40ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45722/0 (socket says 172.21.15.55:45722) 2023-08-25T05:37:03.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.739+0000 7f24c9087640 1 -- 172.21.15.55:0/56320887 learned_addr learned my addr 172.21.15.55:0/56320887 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:03.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.739+0000 7f24ca089640 1 --2- 172.21.15.55:0/56320887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24c40ceeb0 0x7f24c40b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:03.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.739+0000 7f24c9888640 1 --2- 172.21.15.55:0/56320887 >> v2:172.21.15.110:3300/0 conn(0x7f24c40ad950 0x7f24c40cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:03.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.739+0000 7f24c8886640 1 -- 172.21.15.55:0/56320887 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256067053 0 0) 0x7f24c40cc880 con 0x7f24c40c89f0 2023-08-25T05:37:03.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.739+0000 7f24c8886640 1 -- 172.21.15.55:0/56320887 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b0003530 con 0x7f24c40c89f0 2023-08-25T05:37:03.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.739+0000 7f24ca089640 1 -- 172.21.15.55:0/56320887 >> v2:172.21.15.110:3300/0 conn(0x7f24c40ad950 msgr2=0x7f24c40cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:03.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.739+0000 7f24ca089640 1 --2- 172.21.15.55:0/56320887 >> v2:172.21.15.110:3300/0 conn(0x7f24c40ad950 0x7f24c40cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:03.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.739+0000 7f24ca089640 1 -- 172.21.15.55:0/56320887 >> v1:172.21.15.55:6789/0 conn(0x7f24c40c89f0 legacy=0x7f24c40ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:03.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.739+0000 7f24ca089640 1 -- 172.21.15.55:0/56320887 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c40ccb60 con 0x7f24c40ceeb0 2023-08-25T05:37:03.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.743+0000 7f24ca089640 1 --2- 172.21.15.55:0/56320887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24c40ceeb0 0x7f24c40b1640 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009d90 tx=0x7f24bc01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51487f3f9816f65 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:03.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.743+0000 7f24c8886640 1 -- 172.21.15.55:0/56320887 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc0a5860 con 0x7f24c40ceeb0 2023-08-25T05:37:03.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.743+0000 7f24c8886640 1 -- 172.21.15.55:0/56320887 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc0a59c0 con 0x7f24c40ceeb0 2023-08-25T05:37:03.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.743+0000 7f24c8886640 1 -- 172.21.15.55:0/56320887 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc0a5d50 con 0x7f24c40ceeb0 2023-08-25T05:37:03.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.743+0000 7f24cbaec640 1 -- 172.21.15.55:0/56320887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24c40ceeb0 msgr2=0x7f24c40b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:03.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.743+0000 7f24cbaec640 1 --2- 172.21.15.55:0/56320887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24c40ceeb0 0x7f24c40b1640 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f24bc009d90 tx=0x7f24bc01c890 comp rx=0 tx=0).stop 2023-08-25T05:37:03.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.743+0000 7f24cbaec640 1 -- 172.21.15.55:0/56320887 shutdown_connections 2023-08-25T05:37:03.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.743+0000 7f24cbaec640 1 --2- 172.21.15.55:0/56320887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24c40ceeb0 0x7f24c40b1640 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:03.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.743+0000 7f24cbaec640 1 --2- 172.21.15.55:0/56320887 >> v2:172.21.15.110:3300/0 conn(0x7f24c40ad950 0x7f24c40cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:03.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.743+0000 7f24cbaec640 1 -- 172.21.15.55:0/56320887 >> 172.21.15.55:0/56320887 conn(0x7f24c4069d00 msgr2=0x7f24c406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:03.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.743+0000 7f24cbaec640 1 -- 172.21.15.55:0/56320887 shutdown_connections 2023-08-25T05:37:03.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.743+0000 7f24cbaec640 1 -- 172.21.15.55:0/56320887 wait complete. 2023-08-25T05:37:03.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24cbaec640 1 Processor -- start 2023-08-25T05:37:03.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24cbaec640 1 -- start start 2023-08-25T05:37:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24cbaec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24c40ad950 0x7f24c4097850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24cbaec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24c40c89f0 0x7f24c41530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24cbaec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24c40ceeb0 0x7f24c40cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24cbaec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c4162e00 con 0x7f24c40c89f0 2023-08-25T05:37:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24cbaec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c415a000 con 0x7f24c40ceeb0 2023-08-25T05:37:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24cbaec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c41639c0 con 0x7f24c40ad950 2023-08-25T05:37:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24c9087640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24c40c89f0 0x7f24c41530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24c9087640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24c40c89f0 0x7f24c41530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60366/0 (socket says 172.21.15.55:60366) 2023-08-25T05:37:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24c9087640 1 -- 172.21.15.55:0/2603479769 learned_addr learned my addr 172.21.15.55:0/2603479769 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24c9888640 1 --2- 172.21.15.55:0/2603479769 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24c40ad950 0x7f24c4097850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24ca089640 1 --2- 172.21.15.55:0/2603479769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24c40ceeb0 0x7f24c40cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:03.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24c9087640 1 -- 172.21.15.55:0/2603479769 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24c40ad950 msgr2=0x7f24c4097850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:03.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24c9087640 1 --2- 172.21.15.55:0/2603479769 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24c40ad950 0x7f24c4097850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:03.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24c9087640 1 -- 172.21.15.55:0/2603479769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24c40ceeb0 msgr2=0x7f24c40cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:03.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24c9087640 1 --2- 172.21.15.55:0/2603479769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24c40ceeb0 0x7f24c40cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:03.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24c9087640 1 -- 172.21.15.55:0/2603479769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc009a70 con 0x7f24c40c89f0 2023-08-25T05:37:03.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24c9087640 1 --2- 172.21.15.55:0/2603479769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24c40c89f0 0x7f24c41530d0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f24b400c4d0 tx=0x7f24b400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:03.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24ba7fc640 1 -- 172.21.15.55:0/2603479769 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b4005cf0 con 0x7f24c40c89f0 2023-08-25T05:37:03.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24ba7fc640 1 -- 172.21.15.55:0/2603479769 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b4005e50 con 0x7f24c40c89f0 2023-08-25T05:37:03.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24ba7fc640 1 -- 172.21.15.55:0/2603479769 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b4007270 con 0x7f24c40c89f0 2023-08-25T05:37:03.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24cbaec640 1 -- 172.21.15.55:0/2603479769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c4163ca0 con 0x7f24c40c89f0 2023-08-25T05:37:03.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.747+0000 7f24cbaec640 1 -- 172.21.15.55:0/2603479769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c4164260 con 0x7f24c40c89f0 2023-08-25T05:37:03.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.751+0000 7f24cbaec640 1 -- 172.21.15.55:0/2603479769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c404dbe0 con 0x7f24c40c89f0 2023-08-25T05:37:03.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.751+0000 7f24ba7fc640 1 -- 172.21.15.55:0/2603479769 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 112) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f24b40073d0 con 0x7f24c40c89f0 2023-08-25T05:37:03.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.751+0000 7f24ba7fc640 1 --2- 172.21.15.55:0/2603479769 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f24a80658c0 0x7f24a8067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:03.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.751+0000 7f24ba7fc640 1 -- 172.21.15.55:0/2603479769 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f24b40828c0 con 0x7f24c40c89f0 2023-08-25T05:37:03.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.751+0000 7f24c9888640 1 -- 172.21.15.55:0/2603479769 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f24a80658c0 msgr2=0x7f24a8067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3676103183 2023-08-25T05:37:03.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.751+0000 7f24c9888640 1 --2- 172.21.15.55:0/2603479769 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f24a80658c0 0x7f24a8067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:03.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.755+0000 7f24ba7fc640 1 -- 172.21.15.55:0/2603479769 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f24b404fed0 con 0x7f24c40c89f0 2023-08-25T05:37:03.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.915+0000 7f24cbaec640 1 -- 172.21.15.55:0/2603479769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24c40cddf0 con 0x7f24c40c89f0 2023-08-25T05:37:03.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.915+0000 7f24ba7fc640 1 -- 172.21.15.55:0/2603479769 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+18813 (secure 0 0 0) 0x7f24b40534f0 con 0x7f24c40c89f0 2023-08-25T05:37:03.919 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:03.919 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":189,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:35:57.993477+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:35:38.546524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-25T05:35:39.796267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"188","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/4153312762":"2023-08-26T05:35:57.993440+0000","172.21.15.110:6833/3764131781":"2023-08-26T05:35:57.993440+0000","172.21.15.110:6832/3764131781":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/850752631":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/3196857459":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/3481018175":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/3113850402":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/2668066062":"2023-08-26T05:35:57.993440+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:37:03.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.919+0000 7f24cbaec640 1 -- 172.21.15.55:0/2603479769 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f24a80658c0 msgr2=0x7f24a8067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:03.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.919+0000 7f24cbaec640 1 --2- 172.21.15.55:0/2603479769 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f24a80658c0 0x7f24a8067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:03.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.919+0000 7f24cbaec640 1 -- 172.21.15.55:0/2603479769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24c40c89f0 msgr2=0x7f24c41530d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:03.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.919+0000 7f24cbaec640 1 --2- 172.21.15.55:0/2603479769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24c40c89f0 0x7f24c41530d0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f24b400c4d0 tx=0x7f24b400c990 comp rx=0 tx=0).stop 2023-08-25T05:37:03.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.919+0000 7f24cbaec640 1 -- 172.21.15.55:0/2603479769 shutdown_connections 2023-08-25T05:37:03.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.919+0000 7f24cbaec640 1 --2- 172.21.15.55:0/2603479769 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f24a80658c0 0x7f24a8067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:03.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.919+0000 7f24cbaec640 1 --2- 172.21.15.55:0/2603479769 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24c40ceeb0 0x7f24c40cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:03.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.919+0000 7f24cbaec640 1 --2- 172.21.15.55:0/2603479769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24c40c89f0 0x7f24c41530d0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:03.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.919+0000 7f24cbaec640 1 --2- 172.21.15.55:0/2603479769 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24c40ad950 0x7f24c4097850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:03.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.919+0000 7f24cbaec640 1 -- 172.21.15.55:0/2603479769 >> 172.21.15.55:0/2603479769 conn(0x7f24c4069d00 msgr2=0x7f24c4158460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:03.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.919+0000 7f24cbaec640 1 -- 172.21.15.55:0/2603479769 shutdown_connections 2023-08-25T05:37:03.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:03.919+0000 7f24cbaec640 1 -- 172.21.15.55:0/2603479769 wait complete. 2023-08-25T05:37:03.941 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T05:35:38.546524+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '187', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T05:35:39.796267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '188', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T05:37:03.942 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T05:37:03.961 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:03.958+0000 7f0c2fc69180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:37:03.991 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:03.991+0000 7fd686b18180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:37:04.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.091+0000 7f73c8888640 1 Processor -- start 2023-08-25T05:37:04.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.091+0000 7f73c8888640 1 -- start start 2023-08-25T05:37:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.091+0000 7f73c8888640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73c41601f0 0x7f73c415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.091+0000 7f73c8888640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f73c415e3c0 0x7f73c40d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.091+0000 7f73c8888640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73c40d10c0 0x7f73c40b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.091+0000 7f73c8888640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c40cd5a0 con 0x7f73c40d10c0 2023-08-25T05:37:04.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.091+0000 7f73c8888640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c40cd880 con 0x7f73c415e3c0 2023-08-25T05:37:04.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.091+0000 7f73c8888640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c40cdb60 con 0x7f73c41601f0 2023-08-25T05:37:04.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.091+0000 7f73c2d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73c40d10c0 0x7f73c40b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:04.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.091+0000 7f73c1d9b640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f73c415e3c0 0x7f73c40d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:04.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.091+0000 7f73c2d9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73c40d10c0 0x7f73c40b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60372/0 (socket says 172.21.15.55:60372) 2023-08-25T05:37:04.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.091+0000 7f73c2d9d640 1 -- 172.21.15.55:0/1817941946 learned_addr learned my addr 172.21.15.55:0/1817941946 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:04.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.091+0000 7f73c259c640 1 --2- 172.21.15.55:0/1817941946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73c41601f0 0x7f73c415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:04.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.091+0000 7f73c2d9d640 1 -- 172.21.15.55:0/1817941946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73c41601f0 msgr2=0x7f73c415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:04.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.091+0000 7f73c2d9d640 1 --2- 172.21.15.55:0/1817941946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73c41601f0 0x7f73c415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.091+0000 7f73c2d9d640 1 -- 172.21.15.55:0/1817941946 >> v2:172.21.15.110:3300/0 conn(0x7f73c415e3c0 msgr2=0x7f73c40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:04.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.091+0000 7f73c2d9d640 1 --2- 172.21.15.55:0/1817941946 >> v2:172.21.15.110:3300/0 conn(0x7f73c415e3c0 0x7f73c40d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.091+0000 7f73c2d9d640 1 -- 172.21.15.55:0/1817941946 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c40cde40 con 0x7f73c40d10c0 2023-08-25T05:37:04.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.095+0000 7f73c2d9d640 1 --2- 172.21.15.55:0/1817941946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73c40d10c0 0x7f73c40b4250 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f73c40d05a0 tx=0x7f73bc01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4801c615b8e1d4e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:04.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.095+0000 7f73c159a640 1 -- 172.21.15.55:0/1817941946 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc0af400 con 0x7f73c40d10c0 2023-08-25T05:37:04.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c159a640 1 -- 172.21.15.55:0/1817941946 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc0ab050 con 0x7f73c40d10c0 2023-08-25T05:37:04.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c159a640 1 -- 172.21.15.55:0/1817941946 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc0af780 con 0x7f73c40d10c0 2023-08-25T05:37:04.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c8888640 1 -- 172.21.15.55:0/1817941946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73c40d10c0 msgr2=0x7f73c40b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:04.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c8888640 1 --2- 172.21.15.55:0/1817941946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73c40d10c0 0x7f73c40b4250 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f73c40d05a0 tx=0x7f73bc01f1c0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c8888640 1 -- 172.21.15.55:0/1817941946 shutdown_connections 2023-08-25T05:37:04.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c8888640 1 --2- 172.21.15.55:0/1817941946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73c40d10c0 0x7f73c40b4250 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c8888640 1 --2- 172.21.15.55:0/1817941946 >> v2:172.21.15.110:3300/0 conn(0x7f73c415e3c0 0x7f73c40d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c8888640 1 --2- 172.21.15.55:0/1817941946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73c41601f0 0x7f73c415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c8888640 1 -- 172.21.15.55:0/1817941946 >> 172.21.15.55:0/1817941946 conn(0x7f73c40d27d0 msgr2=0x7f73c40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:04.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c8888640 1 -- 172.21.15.55:0/1817941946 shutdown_connections 2023-08-25T05:37:04.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c8888640 1 -- 172.21.15.55:0/1817941946 wait complete. 2023-08-25T05:37:04.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c8888640 1 Processor -- start 2023-08-25T05:37:04.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c8888640 1 -- start start 2023-08-25T05:37:04.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c8888640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73c40d10c0 0x7f73c415c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:04.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c8888640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73c415e3c0 0x7f73c40c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:04.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c8888640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73c41601f0 0x7f73c40cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:04.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c8888640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c40cb3b0 con 0x7f73c41601f0 2023-08-25T05:37:04.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c8888640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c409eff0 con 0x7f73c415e3c0 2023-08-25T05:37:04.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.099+0000 7f73c8888640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c40c9f10 con 0x7f73c40d10c0 2023-08-25T05:37:04.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73c1d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73c415e3c0 0x7f73c40c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:04.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73c259c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73c40d10c0 0x7f73c415c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:04.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73c2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73c41601f0 0x7f73c40cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:04.105 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73c1d9b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73c415e3c0 0x7f73c40c9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:60572/0 (socket says 172.21.15.55:60572) 2023-08-25T05:37:04.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73c259c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73c40d10c0 0x7f73c415c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:50766/0 (socket says 172.21.15.55:50766) 2023-08-25T05:37:04.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73c259c640 1 -- 172.21.15.55:0/3328510417 learned_addr learned my addr 172.21.15.55:0/3328510417 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:04.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73c259c640 1 -- 172.21.15.55:0/3328510417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73c415e3c0 msgr2=0x7f73c40c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:04.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73c259c640 1 --2- 172.21.15.55:0/3328510417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73c415e3c0 0x7f73c40c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73c259c640 1 -- 172.21.15.55:0/3328510417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73c41601f0 msgr2=0x7f73c40cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:04.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73c259c640 1 --2- 172.21.15.55:0/3328510417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73c41601f0 0x7f73c40cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73c259c640 1 -- 172.21.15.55:0/3328510417 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73bc009b30 con 0x7f73c40d10c0 2023-08-25T05:37:04.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73c2d9d640 1 --2- 172.21.15.55:0/3328510417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73c41601f0 0x7f73c40cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:04.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73c259c640 1 --2- 172.21.15.55:0/3328510417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73c40d10c0 0x7f73c415c080 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f73b400e8a0 tx=0x7f73b400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:04.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73b2ffd640 1 -- 172.21.15.55:0/3328510417 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b40095d0 con 0x7f73c40d10c0 2023-08-25T05:37:04.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73b2ffd640 1 -- 172.21.15.55:0/3328510417 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b400c940 con 0x7f73c40d10c0 2023-08-25T05:37:04.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73b2ffd640 1 -- 172.21.15.55:0/3328510417 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b400ccb0 con 0x7f73c40d10c0 2023-08-25T05:37:04.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73c8888640 1 -- 172.21.15.55:0/3328510417 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c40ce7c0 con 0x7f73c40d10c0 2023-08-25T05:37:04.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73c8888640 1 -- 172.21.15.55:0/3328510417 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c40ca4d0 con 0x7f73c40d10c0 2023-08-25T05:37:04.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73c8888640 1 -- 172.21.15.55:0/3328510417 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c40b5260 con 0x7f73c40d10c0 2023-08-25T05:37:04.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.103+0000 7f73b2ffd640 1 -- 172.21.15.55:0/3328510417 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 112) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f73b4013470 con 0x7f73c40d10c0 2023-08-25T05:37:04.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.107+0000 7f73b2ffd640 1 --2- 172.21.15.55:0/3328510417 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f73a40658c0 0x7f73a4067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:04.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.107+0000 7f73b2ffd640 1 -- 172.21.15.55:0/3328510417 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f73b40837c0 con 0x7f73c40d10c0 2023-08-25T05:37:04.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.107+0000 7f73c1d9b640 1 -- 172.21.15.55:0/3328510417 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f73a40658c0 msgr2=0x7f73a4067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3676103183 2023-08-25T05:37:04.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.107+0000 7f73c1d9b640 1 --2- 172.21.15.55:0/3328510417 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f73a40658c0 0x7f73a4067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:04.110 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:04.106+0000 7f0c2fc69180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:37:04.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.111+0000 7f73b2ffd640 1 -- 172.21.15.55:0/3328510417 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f73b4050e70 con 0x7f73c40d10c0 2023-08-25T05:37:04.153 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:04.151+0000 7fd686b18180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:37:04.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.271+0000 7f73c8888640 1 -- 172.21.15.55:0/3328510417 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f73c409edc0 con 0x7f73c40d10c0 2023-08-25T05:37:04.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.271+0000 7f73b2ffd640 1 -- 172.21.15.55:0/3328510417 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v189) v1 ==== 93+0+10 (secure 0 0 0) 0x7f73c409edc0 con 0x7f73c40d10c0 2023-08-25T05:37:04.272 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T05:37:04.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.271+0000 7f73c8888640 1 -- 172.21.15.55:0/3328510417 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f73a40658c0 msgr2=0x7f73a4067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:04.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.271+0000 7f73c8888640 1 --2- 172.21.15.55:0/3328510417 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f73a40658c0 0x7f73a4067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.271+0000 7f73c8888640 1 -- 172.21.15.55:0/3328510417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73c40d10c0 msgr2=0x7f73c415c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:04.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.271+0000 7f73c8888640 1 --2- 172.21.15.55:0/3328510417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73c40d10c0 0x7f73c415c080 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f73b400e8a0 tx=0x7f73b400ed60 comp rx=0 tx=0).stop 2023-08-25T05:37:04.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.271+0000 7f73c8888640 1 -- 172.21.15.55:0/3328510417 shutdown_connections 2023-08-25T05:37:04.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.271+0000 7f73c8888640 1 --2- 172.21.15.55:0/3328510417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73c41601f0 0x7f73c40cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.271+0000 7f73c8888640 1 --2- 172.21.15.55:0/3328510417 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f73a40658c0 0x7f73a4067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.271+0000 7f73c8888640 1 --2- 172.21.15.55:0/3328510417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73c415e3c0 0x7f73c40c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.271+0000 7f73c8888640 1 --2- 172.21.15.55:0/3328510417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73c40d10c0 0x7f73c415c080 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.271+0000 7f73c8888640 1 -- 172.21.15.55:0/3328510417 >> 172.21.15.55:0/3328510417 conn(0x7f73c40d27d0 msgr2=0x7f73c40b7570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:04.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.271+0000 7f73c8888640 1 -- 172.21.15.55:0/3328510417 shutdown_connections 2023-08-25T05:37:04.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.271+0000 7f73c8888640 1 -- 172.21.15.55:0/3328510417 wait complete. 2023-08-25T05:37:04.294 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T05:37:04.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.439+0000 7f44921ba640 1 Processor -- start 2023-08-25T05:37:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.439+0000 7f44921ba640 1 -- start start 2023-08-25T05:37:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.439+0000 7f44921ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f448c0cf8a0 0x7f448c0d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.439+0000 7f44921ba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448c0cd340 con 0x7f448c15ca30 2023-08-25T05:37:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.439+0000 7f44921ba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448c0ce180 con 0x7f448c0ce610 2023-08-25T05:37:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.439+0000 7f44921ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448c0cd570 con 0x7f448c0cf8a0 2023-08-25T05:37:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.439+0000 7f448b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f448c15ca30 0x7f448c0cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45728/0 (socket says 172.21.15.55:45728) 2023-08-25T05:37:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.439+0000 7f448b7fe640 1 -- 172.21.15.55:0/4108741663 learned_addr learned my addr 172.21.15.55:0/4108741663 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:04.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.443+0000 7f448affd640 1 --2- 172.21.15.55:0/4108741663 >> v2:172.21.15.110:3300/0 conn(0x7f448c0cf8a0 0x7f448c0d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:04.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.443+0000 7f448a7fc640 1 -- 172.21.15.55:0/4108741663 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494222815 0 0) 0x7f448c0cd340 con 0x7f448c15ca30 2023-08-25T05:37:04.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.443+0000 7f448a7fc640 1 -- 172.21.15.55:0/4108741663 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4474003530 con 0x7f448c15ca30 2023-08-25T05:37:04.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.443+0000 7f448affd640 1 -- 172.21.15.55:0/4108741663 >> v1:172.21.15.110:6789/0 conn(0x7f448c0ce610 legacy=0x7f448c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:04.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.443+0000 7f448a7fc640 1 -- 172.21.15.55:0/4108741663 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453143439 0 0) 0x7f448c0ce180 con 0x7f448c0ce610 2023-08-25T05:37:04.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.443+0000 7f448affd640 1 -- 172.21.15.55:0/4108741663 >> v1:172.21.15.55:6789/0 conn(0x7f448c15ca30 legacy=0x7f448c0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:04.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.443+0000 7f448affd640 1 -- 172.21.15.55:0/4108741663 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c0cd850 con 0x7f448c0cf8a0 2023-08-25T05:37:04.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.443+0000 7f448affd640 1 --2- 172.21.15.55:0/4108741663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f448c0cf8a0 0x7f448c0d0e10 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f44800097c0 tx=0x7f448001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4328912d2c2cc76 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:04.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.443+0000 7f448a7fc640 1 -- 172.21.15.55:0/4108741663 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800ab650 con 0x7f448c0cf8a0 2023-08-25T05:37:04.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.443+0000 7f448a7fc640 1 -- 172.21.15.55:0/4108741663 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44800ab7b0 con 0x7f448c0cf8a0 2023-08-25T05:37:04.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.443+0000 7f448a7fc640 1 -- 172.21.15.55:0/4108741663 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800abb40 con 0x7f448c0cf8a0 2023-08-25T05:37:04.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f44921ba640 1 -- 172.21.15.55:0/4108741663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f448c0cf8a0 msgr2=0x7f448c0d0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:04.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f44921ba640 1 --2- 172.21.15.55:0/4108741663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f448c0cf8a0 0x7f448c0d0e10 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f44800097c0 tx=0x7f448001c450 comp rx=0 tx=0).stop 2023-08-25T05:37:04.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f44921ba640 1 -- 172.21.15.55:0/4108741663 shutdown_connections 2023-08-25T05:37:04.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f44921ba640 1 --2- 172.21.15.55:0/4108741663 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f448c0cf8a0 0x7f448c0d0e10 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f44921ba640 1 -- 172.21.15.55:0/4108741663 >> 172.21.15.55:0/4108741663 conn(0x7f448c09bb30 msgr2=0x7f448c0d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:04.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f44921ba640 1 -- 172.21.15.55:0/4108741663 shutdown_connections 2023-08-25T05:37:04.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f44921ba640 1 -- 172.21.15.55:0/4108741663 wait complete. 2023-08-25T05:37:04.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f44921ba640 1 Processor -- start 2023-08-25T05:37:04.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f44921ba640 1 -- start start 2023-08-25T05:37:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f44921ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f448c0ce610 0x7f448c0cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f44921ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f448c0cf8a0 0x7f448c159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f44921ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f448c15ca30 0x7f448c1538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f44921ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c159790 con 0x7f448c0ce610 2023-08-25T05:37:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f44921ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c15a5d0 con 0x7f448c0cf8a0 2023-08-25T05:37:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f44921ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448c1599c0 con 0x7f448c15ca30 2023-08-25T05:37:04.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f448b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f448c0ce610 0x7f448c0cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:04.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f448b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f448c0ce610 0x7f448c0cc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60400/0 (socket says 172.21.15.55:60400) 2023-08-25T05:37:04.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f448b7fe640 1 -- 172.21.15.55:0/1713765777 learned_addr learned my addr 172.21.15.55:0/1713765777 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:04.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.447+0000 7f448affd640 1 --2- 172.21.15.55:0/1713765777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f448c0cf8a0 0x7f448c159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:04.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.451+0000 7f448bfff640 1 --2- 172.21.15.55:0/1713765777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f448c15ca30 0x7f448c1538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.451+0000 7f448b7fe640 1 -- 172.21.15.55:0/1713765777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f448c15ca30 msgr2=0x7f448c1538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.451+0000 7f448b7fe640 1 --2- 172.21.15.55:0/1713765777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f448c15ca30 0x7f448c1538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.451+0000 7f448b7fe640 1 -- 172.21.15.55:0/1713765777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f448c0cf8a0 msgr2=0x7f448c159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.451+0000 7f448b7fe640 1 --2- 172.21.15.55:0/1713765777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f448c0cf8a0 0x7f448c159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.451+0000 7f448b7fe640 1 -- 172.21.15.55:0/1713765777 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4480009420 con 0x7f448c0ce610 2023-08-25T05:37:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.451+0000 7f448b7fe640 1 --2- 172.21.15.55:0/1713765777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f448c0ce610 0x7f448c0cc380 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f447c00c400 tx=0x7f447c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.451+0000 7f4473fff640 1 -- 172.21.15.55:0/1713765777 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c0074e0 con 0x7f448c0ce610 2023-08-25T05:37:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.451+0000 7f4473fff640 1 -- 172.21.15.55:0/1713765777 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c007660 con 0x7f448c0ce610 2023-08-25T05:37:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.451+0000 7f44921ba640 1 -- 172.21.15.55:0/1713765777 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448c159ca0 con 0x7f448c0ce610 2023-08-25T05:37:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.451+0000 7f4473fff640 1 -- 172.21.15.55:0/1713765777 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c0059f0 con 0x7f448c0ce610 2023-08-25T05:37:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.451+0000 7f44921ba640 1 -- 172.21.15.55:0/1713765777 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448c15a260 con 0x7f448c0ce610 2023-08-25T05:37:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.451+0000 7f44921ba640 1 -- 172.21.15.55:0/1713765777 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f448c073ec0 con 0x7f448c0ce610 2023-08-25T05:37:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.451+0000 7f4473fff640 1 -- 172.21.15.55:0/1713765777 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 112) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f447c005b50 con 0x7f448c0ce610 2023-08-25T05:37:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.451+0000 7f4473fff640 1 --2- 172.21.15.55:0/1713765777 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f44780658f0 0x7f4478067db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.451+0000 7f4473fff640 1 -- 172.21.15.55:0/1713765777 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f447c0828b0 con 0x7f448c0ce610 2023-08-25T05:37:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.455+0000 7f448affd640 1 -- 172.21.15.55:0/1713765777 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f44780658f0 msgr2=0x7f4478067db0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3676103183 2023-08-25T05:37:04.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.455+0000 7f448affd640 1 --2- 172.21.15.55:0/1713765777 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f44780658f0 0x7f4478067db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:04.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.455+0000 7f4473fff640 1 -- 172.21.15.55:0/1713765777 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f447c04ff50 con 0x7f448c0ce610 2023-08-25T05:37:04.591 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:04.586+0000 7f0c2fc69180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:37:04.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.615+0000 7f44921ba640 1 -- 172.21.15.55:0/1713765777 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f448c0cf680 con 0x7f448c0ce610 2023-08-25T05:37:04.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.615+0000 7f4473fff640 1 -- 172.21.15.55:0/1713765777 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v189) v1 ==== 92+0+10 (secure 0 0 0) 0x7f447c017020 con 0x7f448c0ce610 2023-08-25T05:37:04.617 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T05:37:04.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.615+0000 7f44921ba640 1 -- 172.21.15.55:0/1713765777 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f44780658f0 msgr2=0x7f4478067db0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:04.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.615+0000 7f44921ba640 1 --2- 172.21.15.55:0/1713765777 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f44780658f0 0x7f4478067db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.615+0000 7f44921ba640 1 -- 172.21.15.55:0/1713765777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f448c0ce610 msgr2=0x7f448c0cc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:04.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.615+0000 7f44921ba640 1 --2- 172.21.15.55:0/1713765777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f448c0ce610 0x7f448c0cc380 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f447c00c400 tx=0x7f447c00c8c0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.615+0000 7f44921ba640 1 -- 172.21.15.55:0/1713765777 shutdown_connections 2023-08-25T05:37:04.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.615+0000 7f44921ba640 1 --2- 172.21.15.55:0/1713765777 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f448c15ca30 0x7f448c1538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.615+0000 7f44921ba640 1 --2- 172.21.15.55:0/1713765777 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f44780658f0 0x7f4478067db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.615+0000 7f44921ba640 1 --2- 172.21.15.55:0/1713765777 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f448c0cf8a0 0x7f448c159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.615+0000 7f44921ba640 1 --2- 172.21.15.55:0/1713765777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f448c0ce610 0x7f448c0cc380 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.615+0000 7f44921ba640 1 -- 172.21.15.55:0/1713765777 >> 172.21.15.55:0/1713765777 conn(0x7f448c09bb30 msgr2=0x7f448c0c9020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.615+0000 7f44921ba640 1 -- 172.21.15.55:0/1713765777 shutdown_connections 2023-08-25T05:37:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.615+0000 7f44921ba640 1 -- 172.21.15.55:0/1713765777 wait complete. 2023-08-25T05:37:04.639 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T05:37:04.649 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:04.646+0000 7f0c2fc69180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:37:04.671 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:04.667+0000 7fd686b18180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:37:04.704 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:04.702+0000 7f0c2fc69180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:37:04.733 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:04.731+0000 7fd686b18180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:37:04.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.783+0000 7ff4ab503640 1 Processor -- start 2023-08-25T05:37:04.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.787+0000 7ff4ab503640 1 -- start start 2023-08-25T05:37:04.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.787+0000 7ff4ab503640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4a415e3c0 0x7ff4a415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:04.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.787+0000 7ff4ab503640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4a40d1290 0x7ff4a415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:04.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.787+0000 7ff4ab503640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a40cd5a0 con 0x7ff4a41601f0 2023-08-25T05:37:04.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.787+0000 7ff4ab503640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a40cd880 con 0x7ff4a40d1290 2023-08-25T05:37:04.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.787+0000 7ff4ab503640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a40cdb60 con 0x7ff4a415e3c0 2023-08-25T05:37:04.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.787+0000 7ff4a9aa0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4a40d1290 0x7ff4a415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:04.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.787+0000 7ff4a8a9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4a415e3c0 0x7ff4a415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:04.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.787+0000 7ff4a929f640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff4a41601f0 0x7ff4a40d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:36102/0 (socket says 172.21.15.55:36102) 2023-08-25T05:37:04.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.787+0000 7ff4a9aa0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4a40d1290 0x7ff4a415e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60410/0 (socket says 172.21.15.55:60410) 2023-08-25T05:37:04.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.787+0000 7ff4a929f640 1 -- 172.21.15.55:0/131195226 learned_addr learned my addr 172.21.15.55:0/131195226 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:04.790 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:04.786+0000 7f0c2fc69180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:37:04.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.787+0000 7ff4a8a9e640 1 -- 172.21.15.55:0/131195226 >> v2:172.21.15.55:3300/0 conn(0x7ff4a40d1290 msgr2=0x7ff4a415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:04.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.787+0000 7ff4a8a9e640 1 --2- 172.21.15.55:0/131195226 >> v2:172.21.15.55:3300/0 conn(0x7ff4a40d1290 0x7ff4a415e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.787+0000 7ff4a8a9e640 1 -- 172.21.15.55:0/131195226 >> v1:172.21.15.110:6789/0 conn(0x7ff4a41601f0 legacy=0x7ff4a40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:04.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.787+0000 7ff4a8a9e640 1 -- 172.21.15.55:0/131195226 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a40cde40 con 0x7ff4a415e3c0 2023-08-25T05:37:04.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.791+0000 7ff4a8a9e640 1 --2- 172.21.15.55:0/131195226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4a415e3c0 0x7ff4a415d430 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff4940097c0 tx=0x7ff49401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cf295b500bc4b42 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:04.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.791+0000 7ff49bfff640 1 -- 172.21.15.55:0/131195226 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4940a8970 con 0x7ff4a415e3c0 2023-08-25T05:37:04.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.791+0000 7ff49bfff640 1 -- 172.21.15.55:0/131195226 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4940a8ad0 con 0x7ff4a415e3c0 2023-08-25T05:37:04.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.791+0000 7ff49bfff640 1 -- 172.21.15.55:0/131195226 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4940a8e60 con 0x7ff4a415e3c0 2023-08-25T05:37:04.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.791+0000 7ff4ab503640 1 -- 172.21.15.55:0/131195226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4a415e3c0 msgr2=0x7ff4a415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:04.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.791+0000 7ff4ab503640 1 --2- 172.21.15.55:0/131195226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4a415e3c0 0x7ff4a415d430 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff4940097c0 tx=0x7ff49401ec70 comp rx=0 tx=0).stop 2023-08-25T05:37:04.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.791+0000 7ff4ab503640 1 -- 172.21.15.55:0/131195226 shutdown_connections 2023-08-25T05:37:04.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.791+0000 7ff4ab503640 1 --2- 172.21.15.55:0/131195226 >> v2:172.21.15.55:3300/0 conn(0x7ff4a40d1290 0x7ff4a415e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.791+0000 7ff4ab503640 1 --2- 172.21.15.55:0/131195226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4a415e3c0 0x7ff4a415d430 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.791+0000 7ff4ab503640 1 -- 172.21.15.55:0/131195226 >> 172.21.15.55:0/131195226 conn(0x7ff4a40d27d0 msgr2=0x7ff4a40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:04.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.791+0000 7ff4ab503640 1 -- 172.21.15.55:0/131195226 shutdown_connections 2023-08-25T05:37:04.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.791+0000 7ff4ab503640 1 -- 172.21.15.55:0/131195226 wait complete. 2023-08-25T05:37:04.795 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:04.791+0000 7fd686b18180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:37:04.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.791+0000 7ff4ab503640 1 Processor -- start 2023-08-25T05:37:04.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4ab503640 1 -- start start 2023-08-25T05:37:04.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4ab503640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4a40d1290 0x7ff4a40c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:04.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4ab503640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4a415e3c0 0x7ff4a41f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:04.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4ab503640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4a41601f0 0x7ff4a41f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:04.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4ab503640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a40c6ac0 con 0x7ff4a415e3c0 2023-08-25T05:37:04.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4ab503640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a40c6da0 con 0x7ff4a41601f0 2023-08-25T05:37:04.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4ab503640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a40c7080 con 0x7ff4a40d1290 2023-08-25T05:37:04.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4a8a9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4a415e3c0 0x7ff4a41f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:04.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4a8a9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4a415e3c0 0x7ff4a41f2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60418/0 (socket says 172.21.15.55:60418) 2023-08-25T05:37:04.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4a8a9e640 1 -- 172.21.15.55:0/2554025952 learned_addr learned my addr 172.21.15.55:0/2554025952 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:04.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4a9aa0640 1 --2- 172.21.15.55:0/2554025952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4a41601f0 0x7ff4a41f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:04.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4a929f640 1 --2- 172.21.15.55:0/2554025952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4a40d1290 0x7ff4a40c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:04.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4a9aa0640 1 -- 172.21.15.55:0/2554025952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4a40d1290 msgr2=0x7ff4a40c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:04.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4a9aa0640 1 --2- 172.21.15.55:0/2554025952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4a40d1290 0x7ff4a40c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4a9aa0640 1 -- 172.21.15.55:0/2554025952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4a415e3c0 msgr2=0x7ff4a41f2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:04.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4a9aa0640 1 --2- 172.21.15.55:0/2554025952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4a415e3c0 0x7ff4a41f2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4a9aa0640 1 -- 172.21.15.55:0/2554025952 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff494009420 con 0x7ff4a41601f0 2023-08-25T05:37:04.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4a8a9e640 1 --2- 172.21.15.55:0/2554025952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4a415e3c0 0x7ff4a41f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:04.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4a9aa0640 1 --2- 172.21.15.55:0/2554025952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4a41601f0 0x7ff4a41f2590 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00efc0 tx=0x7ff49c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:04.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff499ffb640 1 -- 172.21.15.55:0/2554025952 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c009c00 con 0x7ff4a41601f0 2023-08-25T05:37:04.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff499ffb640 1 -- 172.21.15.55:0/2554025952 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c00f040 con 0x7ff4a41601f0 2023-08-25T05:37:04.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff499ffb640 1 -- 172.21.15.55:0/2554025952 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c0146c0 con 0x7ff4a41601f0 2023-08-25T05:37:04.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4ab503640 1 -- 172.21.15.55:0/2554025952 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a40ce7c0 con 0x7ff4a41601f0 2023-08-25T05:37:04.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4ab503640 1 -- 172.21.15.55:0/2554025952 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a40c7640 con 0x7ff4a41601f0 2023-08-25T05:37:04.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.795+0000 7ff4ab503640 1 -- 172.21.15.55:0/2554025952 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a40b5260 con 0x7ff4a41601f0 2023-08-25T05:37:04.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.799+0000 7ff499ffb640 1 -- 172.21.15.55:0/2554025952 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 112) v1 ==== 85178+0+0 (secure 0 0 0) 0x7ff49c014820 con 0x7ff4a41601f0 2023-08-25T05:37:04.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.799+0000 7ff499ffb640 1 --2- 172.21.15.55:0/2554025952 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7ff4880658c0 0x7ff488067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:04.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.799+0000 7ff499ffb640 1 -- 172.21.15.55:0/2554025952 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6406+0+0 (secure 0 0 0) 0x7ff49c0841e0 con 0x7ff4a41601f0 2023-08-25T05:37:04.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.799+0000 7ff4a929f640 1 -- 172.21.15.55:0/2554025952 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7ff4880658c0 msgr2=0x7ff488067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3676103183 2023-08-25T05:37:04.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.799+0000 7ff4a929f640 1 --2- 172.21.15.55:0/2554025952 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7ff4880658c0 0x7ff488067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:04.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.803+0000 7ff499ffb640 1 -- 172.21.15.55:0/2554025952 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff49c051770 con 0x7ff4a41601f0 2023-08-25T05:37:04.848 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:04.846+0000 7f0c2fc69180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:37:04.887 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:04.887+0000 7fd686b18180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:37:04.931 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:04.930+0000 7f0c2fc69180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:37:04.946 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:04.943+0000 7fd686b18180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:37:04.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.959+0000 7ff4ab503640 1 -- 172.21.15.55:0/2554025952 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4a40c7830 con 0x7ff4a41601f0 2023-08-25T05:37:04.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.963+0000 7ff499ffb640 1 -- 172.21.15.55:0/2554025952 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v189) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff4a40c7830 con 0x7ff4a41601f0 2023-08-25T05:37:04.963 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T05:37:04.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.963+0000 7ff4ab503640 1 -- 172.21.15.55:0/2554025952 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7ff4880658c0 msgr2=0x7ff488067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:04.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.963+0000 7ff4ab503640 1 --2- 172.21.15.55:0/2554025952 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7ff4880658c0 0x7ff488067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.963+0000 7ff4ab503640 1 -- 172.21.15.55:0/2554025952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4a41601f0 msgr2=0x7ff4a41f2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:04.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.963+0000 7ff4ab503640 1 --2- 172.21.15.55:0/2554025952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4a41601f0 0x7ff4a41f2590 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00efc0 tx=0x7ff49c00c490 comp rx=0 tx=0).stop 2023-08-25T05:37:04.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.963+0000 7ff4ab503640 1 -- 172.21.15.55:0/2554025952 shutdown_connections 2023-08-25T05:37:04.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.963+0000 7ff4ab503640 1 --2- 172.21.15.55:0/2554025952 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7ff4880658c0 0x7ff488067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.963+0000 7ff4ab503640 1 --2- 172.21.15.55:0/2554025952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4a41601f0 0x7ff4a41f2590 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.963+0000 7ff4ab503640 1 --2- 172.21.15.55:0/2554025952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4a415e3c0 0x7ff4a41f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.963+0000 7ff4ab503640 1 --2- 172.21.15.55:0/2554025952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4a40d1290 0x7ff4a40c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:04.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.963+0000 7ff4ab503640 1 -- 172.21.15.55:0/2554025952 >> 172.21.15.55:0/2554025952 conn(0x7ff4a40d27d0 msgr2=0x7ff4a40cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:04.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.963+0000 7ff4ab503640 1 -- 172.21.15.55:0/2554025952 shutdown_connections 2023-08-25T05:37:04.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:04.963+0000 7ff4ab503640 1 -- 172.21.15.55:0/2554025952 wait complete. 2023-08-25T05:37:04.986 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T05:37:04.988 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:04.986+0000 7f0c2fc69180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:37:05.037 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:05.035+0000 7fd686b18180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:37:05.097 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:05.095+0000 7fd686b18180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:37:05.129 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:05.126+0000 7f0c2fc69180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:37:05.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.171+0000 7fe952e34640 1 Processor -- start 2023-08-25T05:37:05.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.171+0000 7fe952e34640 1 -- start start 2023-08-25T05:37:05.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.171+0000 7fe952e34640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe94c15e3c0 0x7fe94c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:05.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.171+0000 7fe952e34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe94c0d1290 0x7fe94c15e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:05.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.171+0000 7fe952e34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94c0cd5a0 con 0x7fe94c1601f0 2023-08-25T05:37:05.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.171+0000 7fe952e34640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe94c0cd880 con 0x7fe94c15e3c0 2023-08-25T05:37:05.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.175+0000 7fe952e34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c0cdb60 con 0x7fe94c0d1290 2023-08-25T05:37:05.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.175+0000 7fe950bd0640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe94c1601f0 0x7fe94c0d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45738/0 (socket says 172.21.15.55:45738) 2023-08-25T05:37:05.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.175+0000 7fe950bd0640 1 -- 172.21.15.55:0/3961936218 learned_addr learned my addr 172.21.15.55:0/3961936218 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.175+0000 7fe94bfff640 1 --2- 172.21.15.55:0/3961936218 >> v2:172.21.15.110:3300/0 conn(0x7fe94c15e3c0 0x7fe94c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.175+0000 7fe9513d1640 1 --2- 172.21.15.55:0/3961936218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe94c0d1290 0x7fe94c15e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.175+0000 7fe94b7fe640 1 -- 172.21.15.55:0/3961936218 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373540325 0 0) 0x7fe94c0cd5a0 con 0x7fe94c1601f0 2023-08-25T05:37:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.175+0000 7fe94b7fe640 1 -- 172.21.15.55:0/3961936218 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe93c003530 con 0x7fe94c1601f0 2023-08-25T05:37:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.175+0000 7fe94bfff640 1 -- 172.21.15.55:0/3961936218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe94c0d1290 msgr2=0x7fe94c15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.175+0000 7fe94bfff640 1 --2- 172.21.15.55:0/3961936218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe94c0d1290 0x7fe94c15e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.175+0000 7fe94bfff640 1 -- 172.21.15.55:0/3961936218 >> v1:172.21.15.55:6789/0 conn(0x7fe94c1601f0 legacy=0x7fe94c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:05.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.175+0000 7fe94bfff640 1 -- 172.21.15.55:0/3961936218 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c0cde40 con 0x7fe94c15e3c0 2023-08-25T05:37:05.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.175+0000 7fe9513d1640 1 --2- 172.21.15.55:0/3961936218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe94c0d1290 0x7fe94c15e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:05.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.175+0000 7fe94bfff640 1 --2- 172.21.15.55:0/3961936218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe94c15e3c0 0x7fe94c15d430 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fe9380097c0 tx=0x7fe93801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5dfd2303b44ad55 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:05.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.175+0000 7fe94b7fe640 1 -- 172.21.15.55:0/3961936218 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9380a8970 con 0x7fe94c15e3c0 2023-08-25T05:37:05.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.179+0000 7fe94b7fe640 1 -- 172.21.15.55:0/3961936218 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9380a8ad0 con 0x7fe94c15e3c0 2023-08-25T05:37:05.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.179+0000 7fe94b7fe640 1 -- 172.21.15.55:0/3961936218 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9380a8e60 con 0x7fe94c15e3c0 2023-08-25T05:37:05.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.179+0000 7fe952e34640 1 -- 172.21.15.55:0/3961936218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe94c15e3c0 msgr2=0x7fe94c15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:05.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.179+0000 7fe952e34640 1 --2- 172.21.15.55:0/3961936218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe94c15e3c0 0x7fe94c15d430 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fe9380097c0 tx=0x7fe93801ec70 comp rx=0 tx=0).stop 2023-08-25T05:37:05.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.179+0000 7fe952e34640 1 -- 172.21.15.55:0/3961936218 shutdown_connections 2023-08-25T05:37:05.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.179+0000 7fe952e34640 1 --2- 172.21.15.55:0/3961936218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe94c0d1290 0x7fe94c15e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.179+0000 7fe952e34640 1 --2- 172.21.15.55:0/3961936218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe94c15e3c0 0x7fe94c15d430 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.179+0000 7fe952e34640 1 -- 172.21.15.55:0/3961936218 >> 172.21.15.55:0/3961936218 conn(0x7fe94c0d27d0 msgr2=0x7fe94c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.179+0000 7fe952e34640 1 -- 172.21.15.55:0/3961936218 shutdown_connections 2023-08-25T05:37:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.179+0000 7fe952e34640 1 -- 172.21.15.55:0/3961936218 wait complete. 2023-08-25T05:37:05.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.179+0000 7fe952e34640 1 Processor -- start 2023-08-25T05:37:05.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.179+0000 7fe952e34640 1 -- start start 2023-08-25T05:37:05.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe952e34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe94c0d1290 0x7fe94c0cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:05.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe952e34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe94c15e3c0 0x7fe94c1f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:05.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe952e34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe94c1601f0 0x7fe94c1f3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:05.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe952e34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c0ccb80 con 0x7fe94c0d1290 2023-08-25T05:37:05.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe952e34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c0ca6c0 con 0x7fe94c1601f0 2023-08-25T05:37:05.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe952e34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c0ca390 con 0x7fe94c15e3c0 2023-08-25T05:37:05.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe950bd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe94c0d1290 0x7fe94c0cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:05.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe94bfff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe94c15e3c0 0x7fe94c1f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:05.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe950bd0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe94c0d1290 0x7fe94c0cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60422/0 (socket says 172.21.15.55:60422) 2023-08-25T05:37:05.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe950bd0640 1 -- 172.21.15.55:0/306665035 learned_addr learned my addr 172.21.15.55:0/306665035 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:05.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe9513d1640 1 --2- 172.21.15.55:0/306665035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe94c1601f0 0x7fe94c1f3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:05.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe94bfff640 1 -- 172.21.15.55:0/306665035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe94c1601f0 msgr2=0x7fe94c1f3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:05.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe94bfff640 1 --2- 172.21.15.55:0/306665035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe94c1601f0 0x7fe94c1f3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe94bfff640 1 -- 172.21.15.55:0/306665035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe94c0d1290 msgr2=0x7fe94c0cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:05.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe94bfff640 1 --2- 172.21.15.55:0/306665035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe94c0d1290 0x7fe94c0cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe94bfff640 1 -- 172.21.15.55:0/306665035 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe944009a70 con 0x7fe94c15e3c0 2023-08-25T05:37:05.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe950bd0640 1 --2- 172.21.15.55:0/306665035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe94c0d1290 0x7fe94c0cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:05.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe94bfff640 1 --2- 172.21.15.55:0/306665035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe94c15e3c0 0x7fe94c1f2060 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe9380af000 tx=0x7fe93801ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:05.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe9497fa640 1 -- 172.21.15.55:0/306665035 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9380bd070 con 0x7fe94c15e3c0 2023-08-25T05:37:05.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe9497fa640 1 -- 172.21.15.55:0/306665035 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe938006e20 con 0x7fe94c15e3c0 2023-08-25T05:37:05.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe9497fa640 1 -- 172.21.15.55:0/306665035 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9380b0de0 con 0x7fe94c15e3c0 2023-08-25T05:37:05.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe952e34640 1 -- 172.21.15.55:0/306665035 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe938009420 con 0x7fe94c15e3c0 2023-08-25T05:37:05.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe952e34640 1 -- 172.21.15.55:0/306665035 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94c1f2c30 con 0x7fe94c15e3c0 2023-08-25T05:37:05.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe952e34640 1 -- 172.21.15.55:0/306665035 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe94c0b5260 con 0x7fe94c15e3c0 2023-08-25T05:37:05.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.183+0000 7fe9497fa640 1 -- 172.21.15.55:0/306665035 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 112) v1 ==== 85178+0+0 (secure 0 0 0) 0x7fe9380b7040 con 0x7fe94c15e3c0 2023-08-25T05:37:05.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.187+0000 7fe9497fa640 1 --2- 172.21.15.55:0/306665035 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7fe9300658f0 0x7fe930067db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:05.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.187+0000 7fe9497fa640 1 -- 172.21.15.55:0/306665035 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fe9381208b0 con 0x7fe94c15e3c0 2023-08-25T05:37:05.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.187+0000 7fe950bd0640 1 -- 172.21.15.55:0/306665035 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7fe9300658f0 msgr2=0x7fe930067db0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3676103183 2023-08-25T05:37:05.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.187+0000 7fe950bd0640 1 --2- 172.21.15.55:0/306665035 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7fe9300658f0 0x7fe930067db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:05.189 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:05.186+0000 7f0c2fc69180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:37:05.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.187+0000 7fe9497fa640 1 -- 172.21.15.55:0/306665035 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe9380edfb0 con 0x7fe94c15e3c0 2023-08-25T05:37:05.260 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:05.259+0000 7fd686b18180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:37:05.322 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:05.319+0000 7fd686b18180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:37:05.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.355+0000 7fe952e34640 1 -- 172.21.15.55:0/306665035 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe94c073ec0 con 0x7fe94c15e3c0 2023-08-25T05:37:05.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.355+0000 7fe9497fa640 1 -- 172.21.15.55:0/306665035 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v189) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe9380f15d0 con 0x7fe94c15e3c0 2023-08-25T05:37:05.358 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T05:37:05.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.359+0000 7fe952e34640 1 -- 172.21.15.55:0/306665035 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7fe9300658f0 msgr2=0x7fe930067db0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:05.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.359+0000 7fe952e34640 1 --2- 172.21.15.55:0/306665035 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7fe9300658f0 0x7fe930067db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.359+0000 7fe952e34640 1 -- 172.21.15.55:0/306665035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe94c15e3c0 msgr2=0x7fe94c1f2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:05.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.359+0000 7fe952e34640 1 --2- 172.21.15.55:0/306665035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe94c15e3c0 0x7fe94c1f2060 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe9380af000 tx=0x7fe93801ba10 comp rx=0 tx=0).stop 2023-08-25T05:37:05.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.359+0000 7fe952e34640 1 -- 172.21.15.55:0/306665035 shutdown_connections 2023-08-25T05:37:05.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.359+0000 7fe952e34640 1 --2- 172.21.15.55:0/306665035 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7fe9300658f0 0x7fe930067db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.359+0000 7fe952e34640 1 --2- 172.21.15.55:0/306665035 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe94c1601f0 0x7fe94c1f3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.359+0000 7fe952e34640 1 --2- 172.21.15.55:0/306665035 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe94c15e3c0 0x7fe94c1f2060 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.359+0000 7fe952e34640 1 --2- 172.21.15.55:0/306665035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe94c0d1290 0x7fe94c0cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.359+0000 7fe952e34640 1 -- 172.21.15.55:0/306665035 >> 172.21.15.55:0/306665035 conn(0x7fe94c0d27d0 msgr2=0x7fe94c0d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:05.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.359+0000 7fe952e34640 1 -- 172.21.15.55:0/306665035 shutdown_connections 2023-08-25T05:37:05.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.359+0000 7fe952e34640 1 -- 172.21.15.55:0/306665035 wait complete. 2023-08-25T05:37:05.382 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T05:37:05.431 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:37:05.432 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:37:05.432 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:37:05.440 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:05.438+0000 7f0c2fc69180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:37:05.573 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:05.570+0000 7f0c2fc69180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:37:05.580 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:37:05.580 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:37:05.580 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:37:05.589 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:05.587+0000 7fd686b18180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:37:05.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.603+0000 7f9788d82640 1 Processor -- start 2023-08-25T05:37:05.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.603+0000 7f9788d82640 1 -- start start 2023-08-25T05:37:05.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.603+0000 7f9788d82640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f97840d0da0 0x7f97840d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:05.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.603+0000 7f9788d82640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97840b3e50 0x7f97840ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:05.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.603+0000 7f9788d82640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97840b29b0 con 0x7f97840cdde0 2023-08-25T05:37:05.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.603+0000 7f9788d82640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97840ce760 con 0x7f97840d0da0 2023-08-25T05:37:05.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.603+0000 7f9788d82640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97840d16c0 con 0x7f97840b3e50 2023-08-25T05:37:05.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.603+0000 7f978259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f97840d0da0 0x7f97840d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:05.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.603+0000 7f978259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f97840d0da0 0x7f97840d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60436/0 (socket says 172.21.15.55:60436) 2023-08-25T05:37:05.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.603+0000 7f978259c640 1 -- 172.21.15.55:0/437337566 learned_addr learned my addr 172.21.15.55:0/437337566 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:05.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.603+0000 7f9782d9d640 1 --2- 172.21.15.55:0/437337566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97840b3e50 0x7f97840ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:05.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.603+0000 7f978259c640 1 -- 172.21.15.55:0/437337566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97840b3e50 msgr2=0x7f97840ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:05.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.603+0000 7f978259c640 1 --2- 172.21.15.55:0/437337566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97840b3e50 0x7f97840ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.603+0000 7f978259c640 1 -- 172.21.15.55:0/437337566 >> v1:172.21.15.110:6789/0 conn(0x7f97840cdde0 legacy=0x7f97840cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:05.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.603+0000 7f978259c640 1 -- 172.21.15.55:0/437337566 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97840b1dc0 con 0x7f97840d0da0 2023-08-25T05:37:05.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.603+0000 7f9782d9d640 1 --2- 172.21.15.55:0/437337566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97840b3e50 0x7f97840ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:05.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.607+0000 7f978259c640 1 --2- 172.21.15.55:0/437337566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97840d0da0 0x7f97840d1180 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f9774009860 tx=0x7f977401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd4dd68e2d6733b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:05.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.607+0000 7f9781d9b640 1 -- 172.21.15.55:0/437337566 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97740a8a10 con 0x7f97840d0da0 2023-08-25T05:37:05.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.607+0000 7f9781d9b640 1 -- 172.21.15.55:0/437337566 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97740a8b70 con 0x7f97840d0da0 2023-08-25T05:37:05.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.607+0000 7f9781d9b640 1 -- 172.21.15.55:0/437337566 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97740b0440 con 0x7f97840d0da0 2023-08-25T05:37:05.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.607+0000 7f9788d82640 1 -- 172.21.15.55:0/437337566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97840d0da0 msgr2=0x7f97840d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:05.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.607+0000 7f9788d82640 1 --2- 172.21.15.55:0/437337566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97840d0da0 0x7f97840d1180 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f9774009860 tx=0x7f977401ed10 comp rx=0 tx=0).stop 2023-08-25T05:37:05.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.607+0000 7f9788d82640 1 -- 172.21.15.55:0/437337566 shutdown_connections 2023-08-25T05:37:05.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.607+0000 7f9788d82640 1 --2- 172.21.15.55:0/437337566 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97840b3e50 0x7f97840ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.607+0000 7f9788d82640 1 --2- 172.21.15.55:0/437337566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97840d0da0 0x7f97840d1180 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.607+0000 7f9788d82640 1 -- 172.21.15.55:0/437337566 >> 172.21.15.55:0/437337566 conn(0x7f978409bae0 msgr2=0x7f97840d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:05.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.607+0000 7f9788d82640 1 -- 172.21.15.55:0/437337566 shutdown_connections 2023-08-25T05:37:05.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.607+0000 7f9788d82640 1 -- 172.21.15.55:0/437337566 wait complete. 2023-08-25T05:37:05.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f9788d82640 1 Processor -- start 2023-08-25T05:37:05.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f9788d82640 1 -- start start 2023-08-25T05:37:05.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f9788d82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97840b3e50 0x7f97840c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:05.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f9788d82640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97840cdde0 0x7f97840c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:05.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f9788d82640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97840d0da0 0x7f97841f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:05.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f9788d82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97840c9b30 con 0x7f97840b3e50 2023-08-25T05:37:05.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f9788d82640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97840c7fa0 con 0x7f97840d0da0 2023-08-25T05:37:05.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f9788d82640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97840c8280 con 0x7f97840cdde0 2023-08-25T05:37:05.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f978259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97840b3e50 0x7f97840c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:05.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f978259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97840b3e50 0x7f97840c7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60442/0 (socket says 172.21.15.55:60442) 2023-08-25T05:37:05.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f978259c640 1 -- 172.21.15.55:0/2049152444 learned_addr learned my addr 172.21.15.55:0/2049152444 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:05.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f9782d9d640 1 --2- 172.21.15.55:0/2049152444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97840d0da0 0x7f97841f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:05.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f977bfff640 1 --2- 172.21.15.55:0/2049152444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97840cdde0 0x7f97840c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:05.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f978259c640 1 -- 172.21.15.55:0/2049152444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97840cdde0 msgr2=0x7f97840c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:05.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f978259c640 1 --2- 172.21.15.55:0/2049152444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97840cdde0 0x7f97840c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f978259c640 1 -- 172.21.15.55:0/2049152444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97840d0da0 msgr2=0x7f97841f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:05.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f978259c640 1 --2- 172.21.15.55:0/2049152444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97840d0da0 0x7f97841f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f978259c640 1 -- 172.21.15.55:0/2049152444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9774009470 con 0x7f97840b3e50 2023-08-25T05:37:05.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f978259c640 1 --2- 172.21.15.55:0/2049152444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97840b3e50 0x7f97840c7190 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f97740b3040 tx=0x7f977401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:05.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f977affd640 1 -- 172.21.15.55:0/2049152444 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97740be070 con 0x7f97840b3e50 2023-08-25T05:37:05.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f977affd640 1 -- 172.21.15.55:0/2049152444 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97740ba400 con 0x7f97840b3e50 2023-08-25T05:37:05.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f977affd640 1 -- 172.21.15.55:0/2049152444 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97740ba7d0 con 0x7f97840b3e50 2023-08-25T05:37:05.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f9788d82640 1 -- 172.21.15.55:0/2049152444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97840c8560 con 0x7f97840b3e50 2023-08-25T05:37:05.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.611+0000 7f9788d82640 1 -- 172.21.15.55:0/2049152444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97841f5a00 con 0x7f97840b3e50 2023-08-25T05:37:05.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.615+0000 7f9788d82640 1 -- 172.21.15.55:0/2049152444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97840c9870 con 0x7f97840b3e50 2023-08-25T05:37:05.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.615+0000 7f977affd640 1 -- 172.21.15.55:0/2049152444 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 112) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f97740c3410 con 0x7f97840b3e50 2023-08-25T05:37:05.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.615+0000 7f977affd640 1 --2- 172.21.15.55:0/2049152444 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f97640658c0 0x7f9764067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:05.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.619+0000 7f977affd640 1 -- 172.21.15.55:0/2049152444 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f9774120ef0 con 0x7f97840b3e50 2023-08-25T05:37:05.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.619+0000 7f977bfff640 1 -- 172.21.15.55:0/2049152444 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f97640658c0 msgr2=0x7f9764067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3676103183 2023-08-25T05:37:05.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.619+0000 7f977bfff640 1 --2- 172.21.15.55:0/2049152444 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f97640658c0 0x7f9764067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:05.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.623+0000 7f977affd640 1 -- 172.21.15.55:0/2049152444 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f97740ee590 con 0x7f97840b3e50 2023-08-25T05:37:05.697 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:05.694+0000 7f0c2fc69180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:37:05.735 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:05.735+0000 7fd686b18180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:37:05.766 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:05.762+0000 7f0c2fc69180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:37:05.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.795+0000 7f9788d82640 1 -- 172.21.15.55:0/2049152444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f97840b2330 con 0x7f97840b3e50 2023-08-25T05:37:05.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.795+0000 7f977affd640 1 -- 172.21.15.55:0/2049152444 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v189) v1 ==== 80+0+477 (secure 0 0 0) 0x7f97740f1bb0 con 0x7f97840b3e50 2023-08-25T05:37:05.797 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/4153312762 2023-08-26T05:35:57.993440+0000 2023-08-25T05:37:05.797 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6833/3764131781 2023-08-26T05:35:57.993440+0000 2023-08-25T05:37:05.798 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6832/3764131781 2023-08-26T05:35:57.993440+0000 2023-08-25T05:37:05.798 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/850752631 2023-08-26T05:35:57.993440+0000 2023-08-25T05:37:05.798 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3196857459 2023-08-26T05:35:57.993440+0000 2023-08-25T05:37:05.798 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3481018175 2023-08-26T05:35:57.993440+0000 2023-08-25T05:37:05.798 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/3113850402 2023-08-26T05:35:57.993440+0000 2023-08-25T05:37:05.798 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/2668066062 2023-08-26T05:35:57.993440+0000 2023-08-25T05:37:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:listed 8 entries 2023-08-25T05:37:05.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.795+0000 7f9788d82640 1 -- 172.21.15.55:0/2049152444 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f97640658c0 msgr2=0x7f9764067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:05.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.795+0000 7f9788d82640 1 --2- 172.21.15.55:0/2049152444 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f97640658c0 0x7f9764067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.795+0000 7f9788d82640 1 -- 172.21.15.55:0/2049152444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97840b3e50 msgr2=0x7f97840c7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:05.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.795+0000 7f9788d82640 1 --2- 172.21.15.55:0/2049152444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97840b3e50 0x7f97840c7190 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f97740b3040 tx=0x7f977401bab0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.795+0000 7f9788d82640 1 -- 172.21.15.55:0/2049152444 shutdown_connections 2023-08-25T05:37:05.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.795+0000 7f9788d82640 1 --2- 172.21.15.55:0/2049152444 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f97640658c0 0x7f9764067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.795+0000 7f9788d82640 1 --2- 172.21.15.55:0/2049152444 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97840d0da0 0x7f97841f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.795+0000 7f9788d82640 1 --2- 172.21.15.55:0/2049152444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f97840cdde0 0x7f97840c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.795+0000 7f9788d82640 1 --2- 172.21.15.55:0/2049152444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97840b3e50 0x7f97840c7190 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:05.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.795+0000 7f9788d82640 1 -- 172.21.15.55:0/2049152444 >> 172.21.15.55:0/2049152444 conn(0x7f978409bae0 msgr2=0x7f978406bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:05.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.795+0000 7f9788d82640 1 -- 172.21.15.55:0/2049152444 shutdown_connections 2023-08-25T05:37:05.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:05.795+0000 7f9788d82640 1 -- 172.21.15.55:0/2049152444 wait complete. 2023-08-25T05:37:05.819 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-25T05:37:05.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:05.820 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-25T05:37:05.870 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:05.867+0000 7fd686b18180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:37:05.891 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T05:37:05.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:05.892 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-25T05:37:05.901 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:05.898+0000 7f0c2fc69180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:37:05.902 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:37:05.902 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:05.912 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:37:05.913 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:37:05.913 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:05.946 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:05.943+0000 7fd686b18180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:37:05.951 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T05:37:05.951 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:37:05.952 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:05.964 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:37:05.965 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:37:06.088 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:06.087+0000 7fd686b18180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:37:06.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.135+0000 7f844aae5640 1 Processor -- start 2023-08-25T05:37:06.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.135+0000 7f844aae5640 1 -- start start 2023-08-25T05:37:06.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.139+0000 7f844aae5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84440d0da0 0x7f84440d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:06.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.139+0000 7f844aae5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84440cdde0 0x7f84440ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:06.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.139+0000 7f844aae5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84440b29b0 con 0x7f84440cee60 2023-08-25T05:37:06.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.139+0000 7f844aae5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84440ce760 con 0x7f84440cdde0 2023-08-25T05:37:06.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.139+0000 7f844aae5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84440d16c0 con 0x7f84440d0da0 2023-08-25T05:37:06.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.139+0000 7f8443fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84440cdde0 0x7f84440ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:06.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.139+0000 7f8443fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84440cdde0 0x7f84440ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60450/0 (socket says 172.21.15.55:60450) 2023-08-25T05:37:06.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.139+0000 7f8443fff640 1 -- 172.21.15.55:0/2214900015 learned_addr learned my addr 172.21.15.55:0/2214900015 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:06.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.139+0000 7f8448881640 1 --2- 172.21.15.55:0/2214900015 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84440d0da0 0x7f84440d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:06.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.139+0000 7f8443fff640 1 -- 172.21.15.55:0/2214900015 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84440d0da0 msgr2=0x7f84440d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:06.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.139+0000 7f8443fff640 1 --2- 172.21.15.55:0/2214900015 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84440d0da0 0x7f84440d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.139+0000 7f8443fff640 1 -- 172.21.15.55:0/2214900015 >> v1:172.21.15.110:6789/0 conn(0x7f84440cee60 legacy=0x7f84440cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:06.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.139+0000 7f8443fff640 1 -- 172.21.15.55:0/2214900015 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84440b1dc0 con 0x7f84440cdde0 2023-08-25T05:37:06.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.143+0000 7f8443fff640 1 --2- 172.21.15.55:0/2214900015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84440cdde0 0x7f84440ce220 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f8430009870 tx=0x7f843001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954a82aa48696977 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:06.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.143+0000 7f84437fe640 1 -- 172.21.15.55:0/2214900015 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300a8a30 con 0x7f84440cdde0 2023-08-25T05:37:06.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.143+0000 7f84437fe640 1 -- 172.21.15.55:0/2214900015 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84300a8b90 con 0x7f84440cdde0 2023-08-25T05:37:06.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.143+0000 7f84437fe640 1 -- 172.21.15.55:0/2214900015 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300b0440 con 0x7f84440cdde0 2023-08-25T05:37:06.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.143+0000 7f844aae5640 1 -- 172.21.15.55:0/2214900015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84440cdde0 msgr2=0x7f84440ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:06.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.143+0000 7f844aae5640 1 --2- 172.21.15.55:0/2214900015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84440cdde0 0x7f84440ce220 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f8430009870 tx=0x7f843001ed30 comp rx=0 tx=0).stop 2023-08-25T05:37:06.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.143+0000 7f844aae5640 1 -- 172.21.15.55:0/2214900015 shutdown_connections 2023-08-25T05:37:06.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.143+0000 7f844aae5640 1 --2- 172.21.15.55:0/2214900015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84440cdde0 0x7f84440ce220 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.143+0000 7f844aae5640 1 --2- 172.21.15.55:0/2214900015 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84440d0da0 0x7f84440d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.143+0000 7f844aae5640 1 -- 172.21.15.55:0/2214900015 >> 172.21.15.55:0/2214900015 conn(0x7f844409bae0 msgr2=0x7f84440d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:06.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.143+0000 7f844aae5640 1 -- 172.21.15.55:0/2214900015 shutdown_connections 2023-08-25T05:37:06.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.143+0000 7f844aae5640 1 -- 172.21.15.55:0/2214900015 wait complete. 2023-08-25T05:37:06.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.143+0000 7f844aae5640 1 Processor -- start 2023-08-25T05:37:06.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.143+0000 7f844aae5640 1 -- start start 2023-08-25T05:37:06.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f844aae5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84440cdde0 0x7f8444151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:06.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f844aae5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84440cee60 0x7f84440cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:06.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f844aae5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84440d0da0 0x7f844415a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:06.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f844aae5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84441f2890 con 0x7f84440cdde0 2023-08-25T05:37:06.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f844aae5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84441f1fe0 con 0x7f84440cee60 2023-08-25T05:37:06.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f844aae5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84440c89d0 con 0x7f84440d0da0 2023-08-25T05:37:06.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f8448881640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84440cdde0 0x7f8444151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:06.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f8443fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84440cee60 0x7f84440cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:06.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f8443fff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84440cee60 0x7f84440cb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:60622/0 (socket says 172.21.15.55:60622) 2023-08-25T05:37:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f8449082640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84440d0da0 0x7f844415a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f8443fff640 1 -- 172.21.15.55:0/4193280272 learned_addr learned my addr 172.21.15.55:0/4193280272 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f8448881640 1 --2- 172.21.15.55:0/4193280272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84440cdde0 0x7f8444151910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60452/0 (socket says 172.21.15.55:60452) 2023-08-25T05:37:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f8448881640 1 -- 172.21.15.55:0/4193280272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84440d0da0 msgr2=0x7f844415a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f8448881640 1 --2- 172.21.15.55:0/4193280272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84440d0da0 0x7f844415a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f8448881640 1 -- 172.21.15.55:0/4193280272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84440cee60 msgr2=0x7f84440cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:06.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f8448881640 1 --2- 172.21.15.55:0/4193280272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84440cee60 0x7f84440cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f8448881640 1 -- 172.21.15.55:0/4193280272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84300094d0 con 0x7f84440cdde0 2023-08-25T05:37:06.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f8449082640 1 --2- 172.21.15.55:0/4193280272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84440d0da0 0x7f844415a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:06.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f8443fff640 1 --2- 172.21.15.55:0/4193280272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84440cee60 0x7f84440cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:06.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f8448881640 1 --2- 172.21.15.55:0/4193280272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84440cdde0 0x7f8444151910 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f843800e870 tx=0x7f843800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:06.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f84417fa640 1 -- 172.21.15.55:0/4193280272 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843800eec0 con 0x7f84440cdde0 2023-08-25T05:37:06.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f84417fa640 1 -- 172.21.15.55:0/4193280272 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843800c940 con 0x7f84440cdde0 2023-08-25T05:37:06.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f844aae5640 1 -- 172.21.15.55:0/4193280272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84440cc4b0 con 0x7f84440cdde0 2023-08-25T05:37:06.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f84417fa640 1 -- 172.21.15.55:0/4193280272 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843800ccb0 con 0x7f84440cdde0 2023-08-25T05:37:06.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f844aae5640 1 -- 172.21.15.55:0/4193280272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84441f24b0 con 0x7f84440cdde0 2023-08-25T05:37:06.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f844aae5640 1 -- 172.21.15.55:0/4193280272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f844404dbe0 con 0x7f84440cdde0 2023-08-25T05:37:06.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.147+0000 7f84417fa640 1 -- 172.21.15.55:0/4193280272 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 112) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f8438013470 con 0x7f84440cdde0 2023-08-25T05:37:06.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.151+0000 7f84417fa640 1 --2- 172.21.15.55:0/4193280272 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f84280658c0 0x7f8428067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:06.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.151+0000 7f84417fa640 1 -- 172.21.15.55:0/4193280272 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f84380834f0 con 0x7f84440cdde0 2023-08-25T05:37:06.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.151+0000 7f8443fff640 1 -- 172.21.15.55:0/4193280272 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f84280658c0 msgr2=0x7f8428067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3676103183 2023-08-25T05:37:06.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.151+0000 7f8443fff640 1 --2- 172.21.15.55:0/4193280272 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f84280658c0 0x7f8428067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:06.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.155+0000 7f84417fa640 1 -- 172.21.15.55:0/4193280272 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8438050b10 con 0x7f84440cdde0 2023-08-25T05:37:06.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.343+0000 7f844aae5640 1 -- 172.21.15.55:0/4193280272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84440d0b80 con 0x7f84440cdde0 2023-08-25T05:37:06.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.343+0000 7f84417fa640 1 -- 172.21.15.55:0/4193280272 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4886 (secure 0 0 0) 0x7f8438054130 con 0x7f84440cdde0 2023-08-25T05:37:06.347 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:06.347 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8768,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1348996798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1348996798},{"type":"v1","addr":"172.21.15.110:6837","nonce":1348996798}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":9988,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/623585793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":623585793},{"type":"v1","addr":"172.21.15.110:6836","nonce":623585793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":10782,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3873137631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3873137631},{"type":"v1","addr":"172.21.15.55:6834","nonce":3873137631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:35:40.794599+0000","modified":"2023-08-25T05:35:44.431342+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":10785},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10785":{"gid":10785,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1770370805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1770370805},{"type":"v1","addr":"172.21.15.55:6835","nonce":1770370805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-25T05:37:06.348 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 91 2023-08-25T05:37:06.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.347+0000 7f844aae5640 1 -- 172.21.15.55:0/4193280272 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f84280658c0 msgr2=0x7f8428067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:06.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.347+0000 7f844aae5640 1 --2- 172.21.15.55:0/4193280272 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f84280658c0 0x7f8428067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.347+0000 7f844aae5640 1 -- 172.21.15.55:0/4193280272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84440cdde0 msgr2=0x7f8444151910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:06.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.347+0000 7f844aae5640 1 --2- 172.21.15.55:0/4193280272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84440cdde0 0x7f8444151910 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f843800e870 tx=0x7f843800ec70 comp rx=0 tx=0).stop 2023-08-25T05:37:06.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.347+0000 7f844aae5640 1 -- 172.21.15.55:0/4193280272 shutdown_connections 2023-08-25T05:37:06.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.347+0000 7f844aae5640 1 --2- 172.21.15.55:0/4193280272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84440d0da0 0x7f844415a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.347+0000 7f844aae5640 1 --2- 172.21.15.55:0/4193280272 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f84280658c0 0x7f8428067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.347+0000 7f844aae5640 1 --2- 172.21.15.55:0/4193280272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84440cee60 0x7f84440cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.347+0000 7f844aae5640 1 --2- 172.21.15.55:0/4193280272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84440cdde0 0x7f8444151910 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.347+0000 7f844aae5640 1 -- 172.21.15.55:0/4193280272 >> 172.21.15.55:0/4193280272 conn(0x7f844409bae0 msgr2=0x7f84440b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:06.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.347+0000 7f844aae5640 1 -- 172.21.15.55:0/4193280272 shutdown_connections 2023-08-25T05:37:06.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.347+0000 7f844aae5640 1 -- 172.21.15.55:0/4193280272 wait complete. 2023-08-25T05:37:06.370 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:37:06.450 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:06.446+0000 7f0c2fc69180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:37:06.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.519+0000 7f43e25e9640 1 Processor -- start 2023-08-25T05:37:06.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.519+0000 7f43e25e9640 1 -- start start 2023-08-25T05:37:06.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.523+0000 7f43e25e9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f43dc0d0da0 0x7f43dc0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:06.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.523+0000 7f43e25e9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0b3e50 0x7f43dc0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:06.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.523+0000 7f43e25e9640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43dc0b29b0 con 0x7f43dc0cdde0 2023-08-25T05:37:06.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.523+0000 7f43e25e9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43dc0ce760 con 0x7f43dc0d0da0 2023-08-25T05:37:06.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.523+0000 7f43e25e9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0d16c0 con 0x7f43dc0b3e50 2023-08-25T05:37:06.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.523+0000 7f43e0b86640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0b3e50 0x7f43dc0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:06.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.523+0000 7f43dbfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f43dc0d0da0 0x7f43dc0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:06.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.523+0000 7f43e0b86640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0b3e50 0x7f43dc0ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:50864/0 (socket says 172.21.15.55:50864) 2023-08-25T05:37:06.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.523+0000 7f43e0b86640 1 -- 172.21.15.55:0/672870343 learned_addr learned my addr 172.21.15.55:0/672870343 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:06.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.523+0000 7f43e0b86640 1 -- 172.21.15.55:0/672870343 >> v2:172.21.15.110:3300/0 conn(0x7f43dc0d0da0 msgr2=0x7f43dc0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:06.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.523+0000 7f43e0b86640 1 --2- 172.21.15.55:0/672870343 >> v2:172.21.15.110:3300/0 conn(0x7f43dc0d0da0 0x7f43dc0d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.523+0000 7f43e0b86640 1 -- 172.21.15.55:0/672870343 >> v1:172.21.15.110:6789/0 conn(0x7f43dc0cdde0 legacy=0x7f43dc0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:06.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.523+0000 7f43e0b86640 1 -- 172.21.15.55:0/672870343 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc0b1dc0 con 0x7f43dc0b3e50 2023-08-25T05:37:06.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.523+0000 7f43dbfff640 1 --2- 172.21.15.55:0/672870343 >> v2:172.21.15.110:3300/0 conn(0x7f43dc0d0da0 0x7f43dc0d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:06.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.527+0000 7f43e0b86640 1 --2- 172.21.15.55:0/672870343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0b3e50 0x7f43dc0ce220 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f43d4009e50 tx=0x7f43d401f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bab5ae0ef098ca0b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:06.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.527+0000 7f43daffd640 1 -- 172.21.15.55:0/672870343 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d40af400 con 0x7f43dc0b3e50 2023-08-25T05:37:06.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.527+0000 7f43daffd640 1 -- 172.21.15.55:0/672870343 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d40ab050 con 0x7f43dc0b3e50 2023-08-25T05:37:06.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.527+0000 7f43daffd640 1 -- 172.21.15.55:0/672870343 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d40af780 con 0x7f43dc0b3e50 2023-08-25T05:37:06.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.527+0000 7f43e25e9640 1 -- 172.21.15.55:0/672870343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0b3e50 msgr2=0x7f43dc0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:06.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.527+0000 7f43e25e9640 1 --2- 172.21.15.55:0/672870343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0b3e50 0x7f43dc0ce220 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f43d4009e50 tx=0x7f43d401f1f0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.527+0000 7f43e25e9640 1 -- 172.21.15.55:0/672870343 shutdown_connections 2023-08-25T05:37:06.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.527+0000 7f43e25e9640 1 --2- 172.21.15.55:0/672870343 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0b3e50 0x7f43dc0ce220 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.527+0000 7f43e25e9640 1 --2- 172.21.15.55:0/672870343 >> v2:172.21.15.110:3300/0 conn(0x7f43dc0d0da0 0x7f43dc0d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.527+0000 7f43e25e9640 1 -- 172.21.15.55:0/672870343 >> 172.21.15.55:0/672870343 conn(0x7f43dc09bae0 msgr2=0x7f43dc0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:06.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.527+0000 7f43e25e9640 1 -- 172.21.15.55:0/672870343 shutdown_connections 2023-08-25T05:37:06.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.527+0000 7f43e25e9640 1 -- 172.21.15.55:0/672870343 wait complete. 2023-08-25T05:37:06.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.527+0000 7f43e25e9640 1 Processor -- start 2023-08-25T05:37:06.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.527+0000 7f43e25e9640 1 -- start start 2023-08-25T05:37:06.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.527+0000 7f43e25e9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43dc0b3e50 0x7f43dc0b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:06.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.527+0000 7f43e25e9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43dc0cdde0 0x7f43dc0b7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:06.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.527+0000 7f43e25e9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0d0da0 0x7f43dc0c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:06.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43e25e9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0ca480 con 0x7f43dc0b3e50 2023-08-25T05:37:06.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43e25e9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0c9890 con 0x7f43dc0cdde0 2023-08-25T05:37:06.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43e25e9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc0c9ae0 con 0x7f43dc0d0da0 2023-08-25T05:37:06.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43dbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43dc0b3e50 0x7f43dc0b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:06.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43e0b86640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0d0da0 0x7f43dc0c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:06.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43db7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43dc0cdde0 0x7f43dc0b7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:06.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43dbfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43dc0b3e50 0x7f43dc0b53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60466/0 (socket says 172.21.15.55:60466) 2023-08-25T05:37:06.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43dbfff640 1 -- 172.21.15.55:0/3783746579 learned_addr learned my addr 172.21.15.55:0/3783746579 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:06.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43e0b86640 1 -- 172.21.15.55:0/3783746579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43dc0cdde0 msgr2=0x7f43dc0b7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:06.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43e0b86640 1 --2- 172.21.15.55:0/3783746579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43dc0cdde0 0x7f43dc0b7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43e0b86640 1 -- 172.21.15.55:0/3783746579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43dc0b3e50 msgr2=0x7f43dc0b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:06.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43e0b86640 1 --2- 172.21.15.55:0/3783746579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43dc0b3e50 0x7f43dc0b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43e0b86640 1 -- 172.21.15.55:0/3783746579 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc0093b0 con 0x7f43dc0d0da0 2023-08-25T05:37:06.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43dbfff640 1 --2- 172.21.15.55:0/3783746579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43dc0b3e50 0x7f43dc0b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:06.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43e0b86640 1 --2- 172.21.15.55:0/3783746579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0d0da0 0x7f43dc0c7d10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f43d40ae000 tx=0x7f43d401bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:06.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43d8ff9640 1 -- 172.21.15.55:0/3783746579 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d40afd70 con 0x7f43dc0d0da0 2023-08-25T05:37:06.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43d8ff9640 1 -- 172.21.15.55:0/3783746579 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d4009510 con 0x7f43dc0d0da0 2023-08-25T05:37:06.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43e25e9640 1 -- 172.21.15.55:0/3783746579 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d4009b30 con 0x7f43dc0d0da0 2023-08-25T05:37:06.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43d8ff9640 1 -- 172.21.15.55:0/3783746579 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d40ba680 con 0x7f43dc0d0da0 2023-08-25T05:37:06.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43e25e9640 1 -- 172.21.15.55:0/3783746579 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43dc0ca0a0 con 0x7f43dc0d0da0 2023-08-25T05:37:06.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43e25e9640 1 -- 172.21.15.55:0/3783746579 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43dc0ca5c0 con 0x7f43dc0d0da0 2023-08-25T05:37:06.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.531+0000 7f43d8ff9640 1 -- 172.21.15.55:0/3783746579 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 112) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f43d40b6040 con 0x7f43dc0d0da0 2023-08-25T05:37:06.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.535+0000 7f43d8ff9640 1 --2- 172.21.15.55:0/3783746579 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f43c80658c0 0x7f43c8067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:06.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.535+0000 7f43d8ff9640 1 -- 172.21.15.55:0/3783746579 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6494+0+0 (secure 0 0 0) 0x7f43d41202a0 con 0x7f43dc0d0da0 2023-08-25T05:37:06.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.535+0000 7f43dbfff640 1 -- 172.21.15.55:0/3783746579 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f43c80658c0 msgr2=0x7f43c8067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3676103183 2023-08-25T05:37:06.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.535+0000 7f43dbfff640 1 --2- 172.21.15.55:0/3783746579 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f43c80658c0 0x7f43c8067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:06.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.539+0000 7f43d8ff9640 1 -- 172.21.15.55:0/3783746579 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f43dc0ca5c0 con 0x7f43dc0d0da0 2023-08-25T05:37:06.541 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:06.538+0000 7f0c2fc69180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:37:06.678 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:06.675+0000 7fd686b18180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:37:06.689 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:06.686+0000 7f0c2fc69180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:37:06.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.699+0000 7f43e25e9640 1 -- 172.21.15.55:0/3783746579 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43dc0ca5c0 con 0x7f43dc0d0da0 2023-08-25T05:37:06.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.699+0000 7f43d8ff9640 1 -- 172.21.15.55:0/3783746579 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+18970 (secure 0 0 0) 0x7f43dc0ca5c0 con 0x7f43dc0d0da0 2023-08-25T05:37:06.702 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:06.702 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":190,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:37:06.375093+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:35:38.546524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-25T05:35:39.796267+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":4,"snap_epoch":190,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/4153312762":"2023-08-26T05:35:57.993440+0000","172.21.15.110:6833/3764131781":"2023-08-26T05:35:57.993440+0000","172.21.15.110:6832/3764131781":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/850752631":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/3196857459":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/3481018175":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/3113850402":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/2668066062":"2023-08-26T05:35:57.993440+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":24,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[{"pool":24,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:37:06.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.703+0000 7f43e25e9640 1 -- 172.21.15.55:0/3783746579 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f43c80658c0 msgr2=0x7f43c8067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:06.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.703+0000 7f43e25e9640 1 --2- 172.21.15.55:0/3783746579 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f43c80658c0 0x7f43c8067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.703+0000 7f43e25e9640 1 -- 172.21.15.55:0/3783746579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0d0da0 msgr2=0x7f43dc0c7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:06.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.703+0000 7f43e25e9640 1 --2- 172.21.15.55:0/3783746579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0d0da0 0x7f43dc0c7d10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f43d40ae000 tx=0x7f43d401bf90 comp rx=0 tx=0).stop 2023-08-25T05:37:06.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.703+0000 7f43e25e9640 1 -- 172.21.15.55:0/3783746579 shutdown_connections 2023-08-25T05:37:06.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.703+0000 7f43e25e9640 1 --2- 172.21.15.55:0/3783746579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0d0da0 0x7f43dc0c7d10 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.703+0000 7f43e25e9640 1 --2- 172.21.15.55:0/3783746579 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f43c80658c0 0x7f43c8067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.703+0000 7f43e25e9640 1 --2- 172.21.15.55:0/3783746579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43dc0cdde0 0x7f43dc0b7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.703+0000 7f43e25e9640 1 --2- 172.21.15.55:0/3783746579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43dc0b3e50 0x7f43dc0b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.703+0000 7f43e25e9640 1 -- 172.21.15.55:0/3783746579 >> 172.21.15.55:0/3783746579 conn(0x7f43dc09bae0 msgr2=0x7f43dc15c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:06.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.703+0000 7f43e25e9640 1 -- 172.21.15.55:0/3783746579 shutdown_connections 2023-08-25T05:37:06.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.703+0000 7f43e25e9640 1 -- 172.21.15.55:0/3783746579 wait complete. 2023-08-25T05:37:06.724 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T05:35:38.546524+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '187', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T05:35:39.796267+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '190', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 4, 'snap_epoch': 190, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T05:37:06.725 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T05:37:06.768 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:06.767+0000 7fd686b18180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:37:06.772 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:06.770+0000 7f0c2fc69180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:37:06.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.871+0000 7f2319d03640 1 Processor -- start 2023-08-25T05:37:06.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.871+0000 7f2319d03640 1 -- start start 2023-08-25T05:37:06.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.871+0000 7f2319d03640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23141601f0 0x7f231415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:06.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.871+0000 7f2319d03640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23140cd5a0 con 0x7f231415e3c0 2023-08-25T05:37:06.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.871+0000 7f2319d03640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23140cd880 con 0x7f23140d1290 2023-08-25T05:37:06.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.871+0000 7f2319d03640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23140cdb60 con 0x7f23141601f0 2023-08-25T05:37:06.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.871+0000 7f23137fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23141601f0 0x7f231415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:06.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.871+0000 7f23137fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23141601f0 0x7f231415d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60478/0 (socket says 172.21.15.55:60478) 2023-08-25T05:37:06.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.871+0000 7f23137fe640 1 -- 172.21.15.55:0/2538569393 learned_addr learned my addr 172.21.15.55:0/2538569393 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:06.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.871+0000 7f230bfff640 1 --1- 172.21.15.55:0/2538569393 >> v1:172.21.15.55:6789/0 conn(0x7f231415e3c0 0x7f23140d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45740/0 (socket says 172.21.15.55:45740) 2023-08-25T05:37:06.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.875+0000 7f23137fe640 1 -- 172.21.15.55:0/2538569393 >> v1:172.21.15.110:6789/0 conn(0x7f23140d1290 legacy=0x7f231415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:06.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.875+0000 7f23137fe640 1 -- 172.21.15.55:0/2538569393 >> v1:172.21.15.55:6789/0 conn(0x7f231415e3c0 legacy=0x7f23140d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:06.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.875+0000 7f23137fe640 1 -- 172.21.15.55:0/2538569393 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23140cde40 con 0x7f23141601f0 2023-08-25T05:37:06.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.875+0000 7f23137fe640 1 --2- 172.21.15.55:0/2538569393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23141601f0 0x7f231415d430 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f2304006fd0 tx=0x7f230401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb6f2720af62fe6 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:06.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.875+0000 7f2312ffd640 1 -- 172.21.15.55:0/2538569393 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23040ab610 con 0x7f23141601f0 2023-08-25T05:37:06.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.875+0000 7f2312ffd640 1 -- 172.21.15.55:0/2538569393 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23040ab770 con 0x7f23141601f0 2023-08-25T05:37:06.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.875+0000 7f2312ffd640 1 -- 172.21.15.55:0/2538569393 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23040abb00 con 0x7f23141601f0 2023-08-25T05:37:06.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2319d03640 1 -- 172.21.15.55:0/2538569393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23141601f0 msgr2=0x7f231415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:06.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2319d03640 1 --2- 172.21.15.55:0/2538569393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23141601f0 0x7f231415d430 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f2304006fd0 tx=0x7f230401c4f0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2319d03640 1 -- 172.21.15.55:0/2538569393 shutdown_connections 2023-08-25T05:37:06.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2319d03640 1 --2- 172.21.15.55:0/2538569393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23141601f0 0x7f231415d430 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2319d03640 1 -- 172.21.15.55:0/2538569393 >> 172.21.15.55:0/2538569393 conn(0x7f23140d27d0 msgr2=0x7f23140d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:06.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2319d03640 1 -- 172.21.15.55:0/2538569393 shutdown_connections 2023-08-25T05:37:06.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2319d03640 1 -- 172.21.15.55:0/2538569393 wait complete. 2023-08-25T05:37:06.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2319d03640 1 Processor -- start 2023-08-25T05:37:06.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2319d03640 1 -- start start 2023-08-25T05:37:06.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2319d03640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23140d1290 0x7f2314154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:06.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2319d03640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f231415e3c0 0x7f23141575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:06.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2319d03640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23141601f0 0x7f2314157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:06.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2319d03640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2314153ef0 con 0x7f23141601f0 2023-08-25T05:37:06.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2319d03640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23140c8940 con 0x7f231415e3c0 2023-08-25T05:37:06.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2319d03640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23140c8c20 con 0x7f23140d1290 2023-08-25T05:37:06.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2313fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23141601f0 0x7f2314157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:06.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f230bfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f231415e3c0 0x7f23141575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:06.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f23137fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23140d1290 0x7f2314154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:06.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2313fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23141601f0 0x7f2314157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60492/0 (socket says 172.21.15.55:60492) 2023-08-25T05:37:06.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2313fff640 1 -- 172.21.15.55:0/1719181747 learned_addr learned my addr 172.21.15.55:0/1719181747 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:06.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2313fff640 1 -- 172.21.15.55:0/1719181747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23140d1290 msgr2=0x7f2314154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:06.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2313fff640 1 --2- 172.21.15.55:0/1719181747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23140d1290 0x7f2314154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2313fff640 1 -- 172.21.15.55:0/1719181747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f231415e3c0 msgr2=0x7f23141575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:06.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2313fff640 1 --2- 172.21.15.55:0/1719181747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f231415e3c0 0x7f23141575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:06.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.879+0000 7f2313fff640 1 -- 172.21.15.55:0/1719181747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2304009480 con 0x7f23141601f0 2023-08-25T05:37:06.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.883+0000 7f2313fff640 1 --2- 172.21.15.55:0/1719181747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23141601f0 0x7f2314157af0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f230c00c770 tx=0x7f230c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:06.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.883+0000 7f2310ff9640 1 -- 172.21.15.55:0/1719181747 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c003b80 con 0x7f23141601f0 2023-08-25T05:37:06.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.883+0000 7f2310ff9640 1 -- 172.21.15.55:0/1719181747 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c003ce0 con 0x7f23141601f0 2023-08-25T05:37:06.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.883+0000 7f2319d03640 1 -- 172.21.15.55:0/1719181747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23140c8f00 con 0x7f23141601f0 2023-08-25T05:37:06.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.883+0000 7f2310ff9640 1 -- 172.21.15.55:0/1719181747 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c00aa90 con 0x7f23141601f0 2023-08-25T05:37:06.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.883+0000 7f2319d03640 1 -- 172.21.15.55:0/1719181747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2314154b90 con 0x7f23141601f0 2023-08-25T05:37:06.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.883+0000 7f2319d03640 1 -- 172.21.15.55:0/1719181747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23140b5260 con 0x7f23141601f0 2023-08-25T05:37:06.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.883+0000 7f2310ff9640 1 -- 172.21.15.55:0/1719181747 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 112) v1 ==== 85178+0+0 (secure 0 0 0) 0x7f230c00abf0 con 0x7f23141601f0 2023-08-25T05:37:06.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.883+0000 7f2310ff9640 1 --2- 172.21.15.55:0/1719181747 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f22f40658c0 0x7f22f4067d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:06.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.883+0000 7f2310ff9640 1 -- 172.21.15.55:0/1719181747 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6494+0+0 (secure 0 0 0) 0x7f230c083110 con 0x7f23141601f0 2023-08-25T05:37:06.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.883+0000 7f23137fe640 1 -- 172.21.15.55:0/1719181747 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f22f40658c0 msgr2=0x7f22f4067d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3676103183 2023-08-25T05:37:06.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.883+0000 7f23137fe640 1 --2- 172.21.15.55:0/1719181747 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f22f40658c0 0x7f22f4067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:06.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:06.891+0000 7f2310ff9640 1 -- 172.21.15.55:0/1719181747 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f230c050760 con 0x7f23141601f0 2023-08-25T05:37:06.929 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:06.927+0000 7fd686b18180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:37:07.024 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:07.023+0000 7fd686b18180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:37:07.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.055+0000 7f2319d03640 1 -- 172.21.15.55:0/1719181747 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f23140c7230 con 0x7f23141601f0 2023-08-25T05:37:07.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.055+0000 7f2310ff9640 1 -- 172.21.15.55:0/1719181747 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v190) v1 ==== 93+0+10 (secure 0 0 0) 0x7f230c053d80 con 0x7f23141601f0 2023-08-25T05:37:07.057 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T05:37:07.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.055+0000 7f2319d03640 1 -- 172.21.15.55:0/1719181747 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f22f40658c0 msgr2=0x7f22f4067d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:07.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.055+0000 7f2319d03640 1 --2- 172.21.15.55:0/1719181747 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f22f40658c0 0x7f22f4067d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.055+0000 7f2319d03640 1 -- 172.21.15.55:0/1719181747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23141601f0 msgr2=0x7f2314157af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:07.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.055+0000 7f2319d03640 1 --2- 172.21.15.55:0/1719181747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23141601f0 0x7f2314157af0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f230c00c770 tx=0x7f230c00cc30 comp rx=0 tx=0).stop 2023-08-25T05:37:07.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.059+0000 7f2319d03640 1 -- 172.21.15.55:0/1719181747 shutdown_connections 2023-08-25T05:37:07.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.059+0000 7f2319d03640 1 --2- 172.21.15.55:0/1719181747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23141601f0 0x7f2314157af0 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.059+0000 7f2319d03640 1 --2- 172.21.15.55:0/1719181747 >> [v2:172.21.15.110:6832/3676103183,v1:172.21.15.110:6833/3676103183] conn(0x7f22f40658c0 0x7f22f4067d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.059+0000 7f2319d03640 1 --2- 172.21.15.55:0/1719181747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f231415e3c0 0x7f23141575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.059+0000 7f2319d03640 1 --2- 172.21.15.55:0/1719181747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23140d1290 0x7f2314154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.059+0000 7f2319d03640 1 -- 172.21.15.55:0/1719181747 >> 172.21.15.55:0/1719181747 conn(0x7f23140d27d0 msgr2=0x7f23140cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:07.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.059+0000 7f2319d03640 1 -- 172.21.15.55:0/1719181747 shutdown_connections 2023-08-25T05:37:07.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.059+0000 7f2319d03640 1 -- 172.21.15.55:0/1719181747 wait complete. 2023-08-25T05:37:07.079 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T05:37:07.091 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:07.090+0000 7f0c2fc69180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:37:07.151 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:07.146+0000 7f0c2fc69180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:37:07.233 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:07.230+0000 7f0bb8394640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:07.234 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:07.230+0000 7f0bb8394640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:07.234 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:07.230+0000 7f0bb8394640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:07.234 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:07.230+0000 7f0bb8394640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:07.234 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:07.230+0000 7f0bb8394640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:07.235 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:07.230+0000 7f0bbc39c640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:07.235 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:07.230+0000 7f0bbc39c640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:07.235 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:07.230+0000 7f0bbc39c640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:07.236 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:07.230+0000 7f0bbc39c640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:07.236 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:07.230+0000 7f0bbc39c640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:07.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.283+0000 7fd667596640 1 Processor -- start 2023-08-25T05:37:07.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.283+0000 7fd667596640 1 -- start start 2023-08-25T05:37:07.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.283+0000 7fd667596640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd66015a7f0 0x7fd66009bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:07.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.283+0000 7fd667596640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd6600c9830 0x7fd660070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:07.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.283+0000 7fd667596640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd66015abd0 con 0x7fd66006c020 2023-08-25T05:37:07.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.283+0000 7fd667596640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6600c8ab0 con 0x7fd6600c9830 2023-08-25T05:37:07.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.283+0000 7fd667596640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600c8d50 con 0x7fd66015a7f0 2023-08-25T05:37:07.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.283+0000 7fd664b31640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd6600c9830 0x7fd660070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:07.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.283+0000 7fd665332640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd66015a7f0 0x7fd66009bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:07.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.283+0000 7fd664b31640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd6600c9830 0x7fd660070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60494/0 (socket says 172.21.15.55:60494) 2023-08-25T05:37:07.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.283+0000 7fd664b31640 1 -- 172.21.15.55:0/3362947649 learned_addr learned my addr 172.21.15.55:0/3362947649 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:07.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.283+0000 7fd664b31640 1 -- 172.21.15.55:0/3362947649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd66015a7f0 msgr2=0x7fd66009bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:07.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.283+0000 7fd664b31640 1 --2- 172.21.15.55:0/3362947649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd66015a7f0 0x7fd66009bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.283+0000 7fd664b31640 1 -- 172.21.15.55:0/3362947649 >> v1:172.21.15.110:6789/0 conn(0x7fd66006c020 legacy=0x7fd6600acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:07.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.283+0000 7fd657fff640 1 -- 172.21.15.55:0/3362947649 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627748778 0 0) 0x7fd66015abd0 con 0x7fd66006c020 2023-08-25T05:37:07.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.283+0000 7fd664b31640 1 -- 172.21.15.55:0/3362947649 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6600c9030 con 0x7fd6600c9830 2023-08-25T05:37:07.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.287+0000 7fd664b31640 1 --2- 172.21.15.55:0/3362947649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6600c9830 0x7fd660070f00 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fd650009870 tx=0x7fd65001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7037d0befff5cf90 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:07.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd657fff640 1 -- 172.21.15.55:0/3362947649 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6500a95f0 con 0x7fd6600c9830 2023-08-25T05:37:07.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd657fff640 1 -- 172.21.15.55:0/3362947649 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6500a9750 con 0x7fd6600c9830 2023-08-25T05:37:07.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd657fff640 1 -- 172.21.15.55:0/3362947649 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6500a9ae0 con 0x7fd6600c9830 2023-08-25T05:37:07.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd667596640 1 -- 172.21.15.55:0/3362947649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6600c9830 msgr2=0x7fd660070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:07.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd667596640 1 --2- 172.21.15.55:0/3362947649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6600c9830 0x7fd660070f00 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fd650009870 tx=0x7fd65001c510 comp rx=0 tx=0).stop 2023-08-25T05:37:07.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd667596640 1 -- 172.21.15.55:0/3362947649 shutdown_connections 2023-08-25T05:37:07.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd667596640 1 --2- 172.21.15.55:0/3362947649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6600c9830 0x7fd660070f00 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd667596640 1 --2- 172.21.15.55:0/3362947649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd66015a7f0 0x7fd66009bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd667596640 1 -- 172.21.15.55:0/3362947649 >> 172.21.15.55:0/3362947649 conn(0x7fd660069900 msgr2=0x7fd660069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:07.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd667596640 1 -- 172.21.15.55:0/3362947649 shutdown_connections 2023-08-25T05:37:07.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd667596640 1 -- 172.21.15.55:0/3362947649 wait complete. 2023-08-25T05:37:07.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd667596640 1 Processor -- start 2023-08-25T05:37:07.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd667596640 1 -- start start 2023-08-25T05:37:07.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd667596640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd66006c020 0x7fd6601f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:07.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd667596640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6600c9830 0x7fd6600af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:07.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd667596640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd66015a7f0 0x7fd660157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:07.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd667596640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600afc70 con 0x7fd66006c020 2023-08-25T05:37:07.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd667596640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6601f3ce0 con 0x7fd66015a7f0 2023-08-25T05:37:07.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd667596640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd660157db0 con 0x7fd6600c9830 2023-08-25T05:37:07.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.291+0000 7fd665332640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd66006c020 0x7fd6601f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:07.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.295+0000 7fd665332640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd66006c020 0x7fd6601f4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60504/0 (socket says 172.21.15.55:60504) 2023-08-25T05:37:07.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.295+0000 7fd664b31640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6600c9830 0x7fd6600af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:07.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.295+0000 7fd665b33640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd66015a7f0 0x7fd660157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:07.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.295+0000 7fd665332640 1 -- 172.21.15.55:0/1978213864 learned_addr learned my addr 172.21.15.55:0/1978213864 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:07.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.295+0000 7fd665332640 1 -- 172.21.15.55:0/1978213864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6600c9830 msgr2=0x7fd6600af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:07.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.295+0000 7fd665332640 1 --2- 172.21.15.55:0/1978213864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6600c9830 0x7fd6600af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.295+0000 7fd665332640 1 -- 172.21.15.55:0/1978213864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd66015a7f0 msgr2=0x7fd660157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:07.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.295+0000 7fd665332640 1 --2- 172.21.15.55:0/1978213864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd66015a7f0 0x7fd660157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.295+0000 7fd665332640 1 -- 172.21.15.55:0/1978213864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6500094d0 con 0x7fd66006c020 2023-08-25T05:37:07.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.295+0000 7fd665b33640 1 --2- 172.21.15.55:0/1978213864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd66015a7f0 0x7fd660157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:07.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.295+0000 7fd665332640 1 --2- 172.21.15.55:0/1978213864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd66006c020 0x7fd6601f4780 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00e9b0 tx=0x7fd65c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:07.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.295+0000 7fd655ffb640 1 -- 172.21.15.55:0/1978213864 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c009670 con 0x7fd66006c020 2023-08-25T05:37:07.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.295+0000 7fd655ffb640 1 -- 172.21.15.55:0/1978213864 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65c00c9a0 con 0x7fd66006c020 2023-08-25T05:37:07.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.295+0000 7fd667596640 1 -- 172.21.15.55:0/1978213864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6600adc90 con 0x7fd66006c020 2023-08-25T05:37:07.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.295+0000 7fd655ffb640 1 -- 172.21.15.55:0/1978213864 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c00cd10 con 0x7fd66006c020 2023-08-25T05:37:07.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.295+0000 7fd667596640 1 -- 172.21.15.55:0/1978213864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6601f4260 con 0x7fd66006c020 2023-08-25T05:37:07.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.295+0000 7fd667596640 1 -- 172.21.15.55:0/1978213864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd66006d5b0 con 0x7fd66006c020 2023-08-25T05:37:07.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.299+0000 7fd655ffb640 1 -- 172.21.15.55:0/1978213864 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 113) v1 ==== 84673+0+0 (secure 0 0 0) 0x7fd65c013470 con 0x7fd66006c020 2023-08-25T05:37:07.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.299+0000 7fd655ffb640 1 -- 172.21.15.55:0/1978213864 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6908+0+0 (secure 0 0 0) 0x7fd65c0831e0 con 0x7fd66006c020 2023-08-25T05:37:07.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.303+0000 7fd655ffb640 1 -- 172.21.15.55:0/1978213864 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd65c050d60 con 0x7fd66006c020 2023-08-25T05:37:07.384 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:07.383+0000 7fd686b18180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:37:07.448 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:07.447+0000 7fd686b18180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:37:07.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.467+0000 7fd667596640 1 -- 172.21.15.55:0/1978213864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd660073ec0 con 0x7fd66006c020 2023-08-25T05:37:07.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.467+0000 7fd655ffb640 1 -- 172.21.15.55:0/1978213864 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v191) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd65c054380 con 0x7fd66006c020 2023-08-25T05:37:07.470 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T05:37:07.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.471+0000 7fd667596640 1 -- 172.21.15.55:0/1978213864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd66006c020 msgr2=0x7fd6601f4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:07.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.471+0000 7fd667596640 1 --2- 172.21.15.55:0/1978213864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd66006c020 0x7fd6601f4780 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00e9b0 tx=0x7fd65c00ee70 comp rx=0 tx=0).stop 2023-08-25T05:37:07.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.471+0000 7fd667596640 1 -- 172.21.15.55:0/1978213864 shutdown_connections 2023-08-25T05:37:07.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.471+0000 7fd667596640 1 --2- 172.21.15.55:0/1978213864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd66015a7f0 0x7fd660157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.471+0000 7fd667596640 1 --2- 172.21.15.55:0/1978213864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6600c9830 0x7fd6600af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.471+0000 7fd667596640 1 --2- 172.21.15.55:0/1978213864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd66006c020 0x7fd6601f4780 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.471+0000 7fd667596640 1 -- 172.21.15.55:0/1978213864 >> 172.21.15.55:0/1978213864 conn(0x7fd660069900 msgr2=0x7fd660156c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:07.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.471+0000 7fd667596640 1 -- 172.21.15.55:0/1978213864 shutdown_connections 2023-08-25T05:37:07.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.471+0000 7fd667596640 1 -- 172.21.15.55:0/1978213864 wait complete. 2023-08-25T05:37:07.490 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T05:37:07.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.635+0000 7ff3be234640 1 Processor -- start 2023-08-25T05:37:07.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.635+0000 7ff3be234640 1 -- start start 2023-08-25T05:37:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.635+0000 7ff3be234640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff3b806e5a0 0x7ff3b80cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.635+0000 7ff3be234640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff3b806c790 0x7ff3b80ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.635+0000 7ff3be234640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b80cab90 con 0x7ff3b806c3b0 2023-08-25T05:37:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.635+0000 7ff3be234640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b806dbb0 con 0x7ff3b806c790 2023-08-25T05:37:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.635+0000 7ff3be234640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b80cae50 con 0x7ff3b806e5a0 2023-08-25T05:37:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.635+0000 7ff3b7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff3b806c790 0x7ff3b80ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.635+0000 7ff3b7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff3b806c790 0x7ff3b80ce8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60510/0 (socket says 172.21.15.55:60510) 2023-08-25T05:37:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.635+0000 7ff3b7fff640 1 -- 172.21.15.55:0/1842830339 learned_addr learned my addr 172.21.15.55:0/1842830339 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.635+0000 7ff3b6ffd640 1 --2- 172.21.15.55:0/1842830339 >> v2:172.21.15.110:3300/0 conn(0x7ff3b806e5a0 0x7ff3b80cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.635+0000 7ff3b7fff640 1 -- 172.21.15.55:0/1842830339 >> v2:172.21.15.110:3300/0 conn(0x7ff3b806e5a0 msgr2=0x7ff3b80cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.635+0000 7ff3b7fff640 1 --2- 172.21.15.55:0/1842830339 >> v2:172.21.15.110:3300/0 conn(0x7ff3b806e5a0 0x7ff3b80cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.635+0000 7ff3b7fff640 1 -- 172.21.15.55:0/1842830339 >> v1:172.21.15.110:6789/0 conn(0x7ff3b806c3b0 legacy=0x7ff3b806de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.635+0000 7ff3b7fff640 1 -- 172.21.15.55:0/1842830339 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b80cb130 con 0x7ff3b806c790 2023-08-25T05:37:07.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.639+0000 7ff3b7fff640 1 --2- 172.21.15.55:0/1842830339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3b806c790 0x7ff3b80ce8b0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8071900 tx=0x7ff3b001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb1c0f47f203c85 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.639+0000 7ff3b67fc640 1 -- 172.21.15.55:0/1842830339 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b00a5840 con 0x7ff3b806c790 2023-08-25T05:37:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.639+0000 7ff3b67fc640 1 -- 172.21.15.55:0/1842830339 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b00a59a0 con 0x7ff3b806c790 2023-08-25T05:37:07.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.639+0000 7ff3b67fc640 1 -- 172.21.15.55:0/1842830339 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b00a5d30 con 0x7ff3b806c790 2023-08-25T05:37:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.639+0000 7ff3be234640 1 -- 172.21.15.55:0/1842830339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3b806c790 msgr2=0x7ff3b80ce8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.639+0000 7ff3be234640 1 --2- 172.21.15.55:0/1842830339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3b806c790 0x7ff3b80ce8b0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8071900 tx=0x7ff3b001c9a0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.639+0000 7ff3be234640 1 -- 172.21.15.55:0/1842830339 shutdown_connections 2023-08-25T05:37:07.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.639+0000 7ff3be234640 1 --2- 172.21.15.55:0/1842830339 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3b806c790 0x7ff3b80ce8b0 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.639+0000 7ff3be234640 1 --2- 172.21.15.55:0/1842830339 >> v2:172.21.15.110:3300/0 conn(0x7ff3b806e5a0 0x7ff3b80cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.639+0000 7ff3be234640 1 -- 172.21.15.55:0/1842830339 >> 172.21.15.55:0/1842830339 conn(0x7ff3b80d0540 msgr2=0x7ff3b80d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.639+0000 7ff3be234640 1 -- 172.21.15.55:0/1842830339 shutdown_connections 2023-08-25T05:37:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.639+0000 7ff3be234640 1 -- 172.21.15.55:0/1842830339 wait complete. 2023-08-25T05:37:07.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3be234640 1 Processor -- start 2023-08-25T05:37:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3be234640 1 -- start start 2023-08-25T05:37:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3be234640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3b806c3b0 0x7ff3b80c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3be234640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3b806c790 0x7ff3b815aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3be234640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3b806e5a0 0x7ff3b81549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3be234640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8157280 con 0x7ff3b806e5a0 2023-08-25T05:37:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3be234640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b80c9020 con 0x7ff3b806c790 2023-08-25T05:37:07.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3be234640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b8156fa0 con 0x7ff3b806c3b0 2023-08-25T05:37:07.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3b7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3b806e5a0 0x7ff3b81549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:07.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3b77fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3b806c3b0 0x7ff3b80c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:07.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3b6ffd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3b806c790 0x7ff3b815aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:07.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3b77fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3b806c3b0 0x7ff3b80c94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:50902/0 (socket says 172.21.15.55:50902) 2023-08-25T05:37:07.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3b77fe640 1 -- 172.21.15.55:0/3734943853 learned_addr learned my addr 172.21.15.55:0/3734943853 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:07.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3b6ffd640 1 -- 172.21.15.55:0/3734943853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3b806c3b0 msgr2=0x7ff3b80c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:07.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3b6ffd640 1 --2- 172.21.15.55:0/3734943853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3b806c3b0 0x7ff3b80c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3b6ffd640 1 -- 172.21.15.55:0/3734943853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3b806e5a0 msgr2=0x7ff3b81549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:07.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3b6ffd640 1 --2- 172.21.15.55:0/3734943853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3b806e5a0 0x7ff3b81549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3b6ffd640 1 -- 172.21.15.55:0/3734943853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b0009b30 con 0x7ff3b806c790 2023-08-25T05:37:07.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3b6ffd640 1 --2- 172.21.15.55:0/3734943853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3b806c790 0x7ff3b815aab0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00e870 tx=0x7ff3ac00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:07.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff39ffff640 1 -- 172.21.15.55:0/3734943853 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac00ee60 con 0x7ff3b806c790 2023-08-25T05:37:07.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff39ffff640 1 -- 172.21.15.55:0/3734943853 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ac00c940 con 0x7ff3b806c790 2023-08-25T05:37:07.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff39ffff640 1 -- 172.21.15.55:0/3734943853 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac00ccd0 con 0x7ff3b806c790 2023-08-25T05:37:07.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.643+0000 7ff3be234640 1 -- 172.21.15.55:0/3734943853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b80c89d0 con 0x7ff3b806c790 2023-08-25T05:37:07.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.647+0000 7ff3be234640 1 -- 172.21.15.55:0/3734943853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b80c99f0 con 0x7ff3b806c790 2023-08-25T05:37:07.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.647+0000 7ff3be234640 1 -- 172.21.15.55:0/3734943853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b80c8830 con 0x7ff3b806c790 2023-08-25T05:37:07.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.647+0000 7ff39ffff640 1 -- 172.21.15.55:0/3734943853 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 113) v1 ==== 84673+0+0 (secure 0 0 0) 0x7ff3ac013470 con 0x7ff3b806c790 2023-08-25T05:37:07.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.647+0000 7ff39ffff640 1 -- 172.21.15.55:0/3734943853 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6908+0+0 (secure 0 0 0) 0x7ff3ac082c00 con 0x7ff3b806c790 2023-08-25T05:37:07.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.651+0000 7ff39ffff640 1 -- 172.21.15.55:0/3734943853 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff3b80c8830 con 0x7ff3b806c790 2023-08-25T05:37:07.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.807+0000 7ff3be234640 1 -- 172.21.15.55:0/3734943853 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3b80c8830 con 0x7ff3b806c790 2023-08-25T05:37:07.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.807+0000 7ff39ffff640 1 -- 172.21.15.55:0/3734943853 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v191) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff3b80c8830 con 0x7ff3b806c790 2023-08-25T05:37:07.808 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T05:37:07.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.807+0000 7ff3be234640 1 -- 172.21.15.55:0/3734943853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3b806c790 msgr2=0x7ff3b815aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:07.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.807+0000 7ff3be234640 1 --2- 172.21.15.55:0/3734943853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3b806c790 0x7ff3b815aab0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00e870 tx=0x7ff3ac00ed30 comp rx=0 tx=0).stop 2023-08-25T05:37:07.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.807+0000 7ff3be234640 1 -- 172.21.15.55:0/3734943853 shutdown_connections 2023-08-25T05:37:07.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.807+0000 7ff3be234640 1 --2- 172.21.15.55:0/3734943853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff3b806e5a0 0x7ff3b81549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.807+0000 7ff3be234640 1 --2- 172.21.15.55:0/3734943853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff3b806c790 0x7ff3b815aab0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.807+0000 7ff3be234640 1 --2- 172.21.15.55:0/3734943853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff3b806c3b0 0x7ff3b80c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.807+0000 7ff3be234640 1 -- 172.21.15.55:0/3734943853 >> 172.21.15.55:0/3734943853 conn(0x7ff3b80d0540 msgr2=0x7ff3b81585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:07.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.807+0000 7ff3be234640 1 -- 172.21.15.55:0/3734943853 shutdown_connections 2023-08-25T05:37:07.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.807+0000 7ff3be234640 1 -- 172.21.15.55:0/3734943853 wait complete. 2023-08-25T05:37:07.829 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T05:37:07.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.971+0000 7f0520a3c640 1 Processor -- start 2023-08-25T05:37:07.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.971+0000 7f0520a3c640 1 -- start start 2023-08-25T05:37:07.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.975+0000 7f0520a3c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f051c15fca0 0x7f051c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:07.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.975+0000 7f0520a3c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f051c0cfac0 0x7f051c0b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:07.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.975+0000 7f0520a3c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f051c0cfee0 con 0x7f051c0b8330 2023-08-25T05:37:07.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.975+0000 7f0520a3c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f051c160080 con 0x7f051c0cfac0 2023-08-25T05:37:07.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.975+0000 7f0520a3c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f051c0b70c0 con 0x7f051c15fca0 2023-08-25T05:37:07.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.975+0000 7f051bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f051c0cfac0 0x7f051c0b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:07.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.975+0000 7f051bfff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f051c0cfac0 0x7f051c0b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60528/0 (socket says 172.21.15.55:60528) 2023-08-25T05:37:07.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.975+0000 7f051bfff640 1 -- 172.21.15.55:0/1753443301 learned_addr learned my addr 172.21.15.55:0/1753443301 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:07.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.975+0000 7f051b7fe640 1 --2- 172.21.15.55:0/1753443301 >> v2:172.21.15.110:3300/0 conn(0x7f051c15fca0 0x7f051c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:07.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.975+0000 7f051affd640 1 --1- 172.21.15.55:0/1753443301 >> v1:172.21.15.55:6789/0 conn(0x7f051c0b8330 0x7f051c0d0bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45750/0 (socket says 172.21.15.55:45750) 2023-08-25T05:37:07.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.975+0000 7f051bfff640 1 -- 172.21.15.55:0/1753443301 >> v2:172.21.15.110:3300/0 conn(0x7f051c15fca0 msgr2=0x7f051c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:07.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.975+0000 7f051bfff640 1 --2- 172.21.15.55:0/1753443301 >> v2:172.21.15.110:3300/0 conn(0x7f051c15fca0 0x7f051c0cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.975+0000 7f051bfff640 1 -- 172.21.15.55:0/1753443301 >> v1:172.21.15.55:6789/0 conn(0x7f051c0b8330 legacy=0x7f051c0d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:07.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.975+0000 7f051bfff640 1 -- 172.21.15.55:0/1753443301 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051c0b73a0 con 0x7f051c0cfac0 2023-08-25T05:37:07.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.975+0000 7f051b7fe640 1 --2- 172.21.15.55:0/1753443301 >> v2:172.21.15.110:3300/0 conn(0x7f051c15fca0 0x7f051c0cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:07.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f051bfff640 1 --2- 172.21.15.55:0/1753443301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f051c0cfac0 0x7f051c0b65e0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f051c0b4af0 tx=0x7f051401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f4911068ee0b87 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:07.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f051a7fc640 1 -- 172.21.15.55:0/1753443301 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05140af400 con 0x7f051c0cfac0 2023-08-25T05:37:07.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f051a7fc640 1 -- 172.21.15.55:0/1753443301 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05140ab050 con 0x7f051c0cfac0 2023-08-25T05:37:07.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f051a7fc640 1 -- 172.21.15.55:0/1753443301 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05140af780 con 0x7f051c0cfac0 2023-08-25T05:37:07.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f0520a3c640 1 -- 172.21.15.55:0/1753443301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f051c0cfac0 msgr2=0x7f051c0b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:07.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f0520a3c640 1 --2- 172.21.15.55:0/1753443301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f051c0cfac0 0x7f051c0b65e0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f051c0b4af0 tx=0x7f051401f1c0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f0520a3c640 1 -- 172.21.15.55:0/1753443301 shutdown_connections 2023-08-25T05:37:07.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f0520a3c640 1 --2- 172.21.15.55:0/1753443301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f051c0cfac0 0x7f051c0b65e0 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f0520a3c640 1 --2- 172.21.15.55:0/1753443301 >> v2:172.21.15.110:3300/0 conn(0x7f051c15fca0 0x7f051c0cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f0520a3c640 1 -- 172.21.15.55:0/1753443301 >> 172.21.15.55:0/1753443301 conn(0x7f051c0658c0 msgr2=0x7f051c065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:07.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f0520a3c640 1 -- 172.21.15.55:0/1753443301 shutdown_connections 2023-08-25T05:37:07.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f0520a3c640 1 -- 172.21.15.55:0/1753443301 wait complete. 2023-08-25T05:37:07.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f0520a3c640 1 Processor -- start 2023-08-25T05:37:07.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f0520a3c640 1 -- start start 2023-08-25T05:37:07.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f0520a3c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f051c0b8330 0x7f051c151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:07.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f0520a3c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f051c0cfac0 0x7f051c156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:07.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f0520a3c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f051c15fca0 0x7f051c0c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f0520a3c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051c1583f0 con 0x7f051c15fca0 2023-08-25T05:37:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f0520a3c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051c153a10 con 0x7f051c0b8330 2023-08-25T05:37:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.979+0000 7f0520a3c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051c153390 con 0x7f051c0cfac0 2023-08-25T05:37:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f051bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f051c15fca0 0x7f051c0c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f051b7fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f051c0b8330 0x7f051c151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f051bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f051c15fca0 0x7f051c0c7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60536/0 (socket says 172.21.15.55:60536) 2023-08-25T05:37:07.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f051bfff640 1 -- 172.21.15.55:0/1818434199 learned_addr learned my addr 172.21.15.55:0/1818434199 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:07.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f051affd640 1 --2- 172.21.15.55:0/1818434199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f051c0cfac0 0x7f051c156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f051b7fe640 1 -- 172.21.15.55:0/1818434199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f051c0cfac0 msgr2=0x7f051c156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f051b7fe640 1 --2- 172.21.15.55:0/1818434199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f051c0cfac0 0x7f051c156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f051b7fe640 1 -- 172.21.15.55:0/1818434199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f051c15fca0 msgr2=0x7f051c0c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f051b7fe640 1 --2- 172.21.15.55:0/1818434199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f051c15fca0 0x7f051c0c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f051b7fe640 1 -- 172.21.15.55:0/1818434199 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c009420 con 0x7f051c0b8330 2023-08-25T05:37:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f051bfff640 1 --2- 172.21.15.55:0/1818434199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f051c15fca0 0x7f051c0c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:07.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f051b7fe640 1 --2- 172.21.15.55:0/1818434199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f051c0b8330 0x7f051c151aa0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f050c00e8e0 tx=0x7f050c00eda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:07.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f0503fff640 1 -- 172.21.15.55:0/1818434199 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c00c8e0 con 0x7f051c0b8330 2023-08-25T05:37:07.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f0503fff640 1 -- 172.21.15.55:0/1818434199 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050c00ca40 con 0x7f051c0b8330 2023-08-25T05:37:07.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f0520a3c640 1 -- 172.21.15.55:0/1818434199 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0514009b30 con 0x7f051c0b8330 2023-08-25T05:37:07.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f0503fff640 1 -- 172.21.15.55:0/1818434199 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c00cdf0 con 0x7f051c0b8330 2023-08-25T05:37:07.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f0520a3c640 1 -- 172.21.15.55:0/1818434199 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051c158110 con 0x7f051c0b8330 2023-08-25T05:37:07.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f0520a3c640 1 -- 172.21.15.55:0/1818434199 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051c073e50 con 0x7f051c0b8330 2023-08-25T05:37:07.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.983+0000 7f0503fff640 1 -- 172.21.15.55:0/1818434199 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 113) v1 ==== 84673+0+0 (secure 0 0 0) 0x7f050c013470 con 0x7f051c0b8330 2023-08-25T05:37:07.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.987+0000 7f0503fff640 1 -- 172.21.15.55:0/1818434199 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6908+0+0 (secure 0 0 0) 0x7f050c083600 con 0x7f051c0b8330 2023-08-25T05:37:07.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:07.987+0000 7f0503fff640 1 -- 172.21.15.55:0/1818434199 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f050c051200 con 0x7f051c0b8330 2023-08-25T05:37:08.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.143+0000 7f0520a3c640 1 -- 172.21.15.55:0/1818434199 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f051c0b8110 con 0x7f051c0b8330 2023-08-25T05:37:08.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.143+0000 7f0503fff640 1 -- 172.21.15.55:0/1818434199 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v191) v1 ==== 100+0+11 (secure 0 0 0) 0x7f050c054820 con 0x7f051c0b8330 2023-08-25T05:37:08.145 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T05:37:08.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.147+0000 7f0520a3c640 1 -- 172.21.15.55:0/1818434199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f051c0b8330 msgr2=0x7f051c151aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:08.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.147+0000 7f0520a3c640 1 --2- 172.21.15.55:0/1818434199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f051c0b8330 0x7f051c151aa0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f050c00e8e0 tx=0x7f050c00eda0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.147+0000 7f0520a3c640 1 -- 172.21.15.55:0/1818434199 shutdown_connections 2023-08-25T05:37:08.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.147+0000 7f0520a3c640 1 --2- 172.21.15.55:0/1818434199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f051c15fca0 0x7f051c0c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.147+0000 7f0520a3c640 1 --2- 172.21.15.55:0/1818434199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f051c0cfac0 0x7f051c156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.147+0000 7f0520a3c640 1 --2- 172.21.15.55:0/1818434199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f051c0b8330 0x7f051c151aa0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.147+0000 7f0520a3c640 1 -- 172.21.15.55:0/1818434199 >> 172.21.15.55:0/1818434199 conn(0x7f051c0658c0 msgr2=0x7f051c15bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:08.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.147+0000 7f0520a3c640 1 -- 172.21.15.55:0/1818434199 shutdown_connections 2023-08-25T05:37:08.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.147+0000 7f0520a3c640 1 -- 172.21.15.55:0/1818434199 wait complete. 2023-08-25T05:37:08.168 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:37:08.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.311+0000 7f60ec66a640 1 Processor -- start 2023-08-25T05:37:08.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.311+0000 7f60ec66a640 1 -- start start 2023-08-25T05:37:08.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.311+0000 7f60ec66a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f60e40cde20 0x7f60e40ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:08.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.311+0000 7f60ec66a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60e40b1220 0x7f60e406be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:08.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.311+0000 7f60ec66a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e406d2b0 con 0x7f60e40cabf0 2023-08-25T05:37:08.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.311+0000 7f60ec66a640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e40c9490 con 0x7f60e40b1220 2023-08-25T05:37:08.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.311+0000 7f60ec66a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e40cb1e0 con 0x7f60e40cde20 2023-08-25T05:37:08.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.311+0000 7f60eac07640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f60e40cabf0 0x7f60e406c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45758/0 (socket says 172.21.15.55:45758) 2023-08-25T05:37:08.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.311+0000 7f60eac07640 1 -- 172.21.15.55:0/3485938149 learned_addr learned my addr 172.21.15.55:0/3485938149 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:08.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.311+0000 7f60e9c05640 1 --2- 172.21.15.55:0/3485938149 >> v2:172.21.15.55:3300/0 conn(0x7f60e40b1220 0x7f60e406be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:08.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.315+0000 7f60ea406640 1 --2- 172.21.15.55:0/3485938149 >> v2:172.21.15.110:3300/0 conn(0x7f60e40cde20 0x7f60e40ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:08.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.315+0000 7f60e9404640 1 -- 172.21.15.55:0/3485938149 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436638521 0 0) 0x7f60e406d2b0 con 0x7f60e40cabf0 2023-08-25T05:37:08.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.315+0000 7f60e9404640 1 -- 172.21.15.55:0/3485938149 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60d0003530 con 0x7f60e40cabf0 2023-08-25T05:37:08.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.315+0000 7f60e9c05640 1 -- 172.21.15.55:0/3485938149 >> v2:172.21.15.110:3300/0 conn(0x7f60e40cde20 msgr2=0x7f60e40ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:08.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.315+0000 7f60e9c05640 1 --2- 172.21.15.55:0/3485938149 >> v2:172.21.15.110:3300/0 conn(0x7f60e40cde20 0x7f60e40ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.315+0000 7f60e9c05640 1 -- 172.21.15.55:0/3485938149 >> v1:172.21.15.55:6789/0 conn(0x7f60e40cabf0 legacy=0x7f60e406c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:08.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.315+0000 7f60e9c05640 1 -- 172.21.15.55:0/3485938149 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e40cb480 con 0x7f60e40b1220 2023-08-25T05:37:08.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.315+0000 7f60e9c05640 1 --2- 172.21.15.55:0/3485938149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e40b1220 0x7f60e406be90 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f60d40097c0 tx=0x7f60d401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5f7a5419335c2e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:08.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.315+0000 7f60e9404640 1 -- 172.21.15.55:0/3485938149 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d40ab660 con 0x7f60e40b1220 2023-08-25T05:37:08.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.315+0000 7f60e9404640 1 -- 172.21.15.55:0/3485938149 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d40ab7c0 con 0x7f60e40b1220 2023-08-25T05:37:08.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.315+0000 7f60e9404640 1 -- 172.21.15.55:0/3485938149 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d40abb30 con 0x7f60e40b1220 2023-08-25T05:37:08.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.315+0000 7f60ec66a640 1 -- 172.21.15.55:0/3485938149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e40b1220 msgr2=0x7f60e406be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:08.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ec66a640 1 --2- 172.21.15.55:0/3485938149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e40b1220 0x7f60e406be90 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7f60d40097c0 tx=0x7f60d401c440 comp rx=0 tx=0).stop 2023-08-25T05:37:08.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ec66a640 1 -- 172.21.15.55:0/3485938149 shutdown_connections 2023-08-25T05:37:08.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ec66a640 1 --2- 172.21.15.55:0/3485938149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e40b1220 0x7f60e406be90 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ec66a640 1 --2- 172.21.15.55:0/3485938149 >> v2:172.21.15.110:3300/0 conn(0x7f60e40cde20 0x7f60e40ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ec66a640 1 -- 172.21.15.55:0/3485938149 >> 172.21.15.55:0/3485938149 conn(0x7f60e40b0700 msgr2=0x7f60e40b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:08.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ec66a640 1 -- 172.21.15.55:0/3485938149 shutdown_connections 2023-08-25T05:37:08.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ec66a640 1 -- 172.21.15.55:0/3485938149 wait complete. 2023-08-25T05:37:08.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ec66a640 1 Processor -- start 2023-08-25T05:37:08.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ec66a640 1 -- start start 2023-08-25T05:37:08.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ec66a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e40b1220 0x7f60e41544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:08.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ec66a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e40cabf0 0x7f60e40b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:08.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ec66a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e40cde20 0x7f60e41590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:08.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ec66a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e409eed0 con 0x7f60e40b1220 2023-08-25T05:37:08.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ec66a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e40b1690 con 0x7f60e40cde20 2023-08-25T05:37:08.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ec66a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e40b24d0 con 0x7f60e40cabf0 2023-08-25T05:37:08.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ea406640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e40b1220 0x7f60e41544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:08.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ea406640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e40b1220 0x7f60e41544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60554/0 (socket says 172.21.15.55:60554) 2023-08-25T05:37:08.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ea406640 1 -- 172.21.15.55:0/4113385109 learned_addr learned my addr 172.21.15.55:0/4113385109 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:08.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60e9c05640 1 --2- 172.21.15.55:0/4113385109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e40cabf0 0x7f60e40b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60eac07640 1 --2- 172.21.15.55:0/4113385109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e40cde20 0x7f60e41590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ea406640 1 -- 172.21.15.55:0/4113385109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e40cabf0 msgr2=0x7f60e40b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ea406640 1 --2- 172.21.15.55:0/4113385109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e40cabf0 0x7f60e40b1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ea406640 1 -- 172.21.15.55:0/4113385109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e40cde20 msgr2=0x7f60e41590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ea406640 1 --2- 172.21.15.55:0/4113385109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e40cde20 0x7f60e41590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ea406640 1 -- 172.21.15.55:0/4113385109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d4009420 con 0x7f60e40b1220 2023-08-25T05:37:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.319+0000 7f60ea406640 1 --2- 172.21.15.55:0/4113385109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e40b1220 0x7f60e41544b0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f60e000d800 tx=0x7f60e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.323+0000 7f60daffd640 1 -- 172.21.15.55:0/4113385109 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e000b6c0 con 0x7f60e40b1220 2023-08-25T05:37:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.323+0000 7f60daffd640 1 -- 172.21.15.55:0/4113385109 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e000b820 con 0x7f60e40b1220 2023-08-25T05:37:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.323+0000 7f60daffd640 1 -- 172.21.15.55:0/4113385109 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e000bb90 con 0x7f60e40b1220 2023-08-25T05:37:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.323+0000 7f60ec66a640 1 -- 172.21.15.55:0/4113385109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e40b18e0 con 0x7f60e40b1220 2023-08-25T05:37:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.323+0000 7f60ec66a640 1 -- 172.21.15.55:0/4113385109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e409eaf0 con 0x7f60e40b1220 2023-08-25T05:37:08.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.323+0000 7f60ec66a640 1 -- 172.21.15.55:0/4113385109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e409f140 con 0x7f60e40b1220 2023-08-25T05:37:08.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.323+0000 7f60daffd640 1 -- 172.21.15.55:0/4113385109 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 114) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f60e000bcf0 con 0x7f60e40b1220 2023-08-25T05:37:08.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.323+0000 7f60daffd640 1 --2- 172.21.15.55:0/4113385109 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f60c80654d0 0x7f60c8067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:08.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.323+0000 7f60daffd640 1 -- 172.21.15.55:0/4113385109 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6908+0+0 (secure 0 0 0) 0x7f60e0083380 con 0x7f60e40b1220 2023-08-25T05:37:08.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.323+0000 7f60e9c05640 1 --2- 172.21.15.55:0/4113385109 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f60c80654d0 0x7f60c8067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:08.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.323+0000 7f60e9c05640 1 --2- 172.21.15.55:0/4113385109 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f60c80654d0 0x7f60c8067990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f60d40af000 tx=0x7f60d40a7000 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.327+0000 7f60daffd640 1 -- 172.21.15.55:0/4113385109 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f60e00547f0 con 0x7f60e40b1220 2023-08-25T05:37:08.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.519+0000 7f60ec66a640 1 -- 172.21.15.55:0/4113385109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60e404dbe0 con 0x7f60e40b1220 2023-08-25T05:37:08.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.519+0000 7f60daffd640 1 -- 172.21.15.55:0/4113385109 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4886 (secure 0 0 0) 0x7f60e0054380 con 0x7f60e40b1220 2023-08-25T05:37:08.521 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:08.521 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8768,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1348996798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1348996798},{"type":"v1","addr":"172.21.15.110:6837","nonce":1348996798}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":9988,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/623585793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":623585793},{"type":"v1","addr":"172.21.15.110:6836","nonce":623585793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":10782,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3873137631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3873137631},{"type":"v1","addr":"172.21.15.55:6834","nonce":3873137631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:35:40.794599+0000","modified":"2023-08-25T05:35:44.431342+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":10785},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10785":{"gid":10785,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1770370805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1770370805},{"type":"v1","addr":"172.21.15.55:6835","nonce":1770370805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-25T05:37:08.521 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 91 2023-08-25T05:37:08.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.519+0000 7f60ec66a640 1 -- 172.21.15.55:0/4113385109 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f60c80654d0 msgr2=0x7f60c8067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:08.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.519+0000 7f60ec66a640 1 --2- 172.21.15.55:0/4113385109 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f60c80654d0 0x7f60c8067990 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f60d40af000 tx=0x7f60d40a7000 comp rx=0 tx=0).stop 2023-08-25T05:37:08.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.519+0000 7f60ec66a640 1 -- 172.21.15.55:0/4113385109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e40b1220 msgr2=0x7f60e41544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:08.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.519+0000 7f60ec66a640 1 --2- 172.21.15.55:0/4113385109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e40b1220 0x7f60e41544b0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f60e000d800 tx=0x7f60e000dcc0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.519+0000 7f60ec66a640 1 -- 172.21.15.55:0/4113385109 shutdown_connections 2023-08-25T05:37:08.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.519+0000 7f60ec66a640 1 --2- 172.21.15.55:0/4113385109 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f60c80654d0 0x7f60c8067990 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.519+0000 7f60ec66a640 1 --2- 172.21.15.55:0/4113385109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60e40cde20 0x7f60e41590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.519+0000 7f60ec66a640 1 --2- 172.21.15.55:0/4113385109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60e40cabf0 0x7f60e40b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.519+0000 7f60ec66a640 1 --2- 172.21.15.55:0/4113385109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60e40b1220 0x7f60e41544b0 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.519+0000 7f60ec66a640 1 -- 172.21.15.55:0/4113385109 >> 172.21.15.55:0/4113385109 conn(0x7f60e40b0700 msgr2=0x7f60e4069b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:08.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.519+0000 7f60ec66a640 1 -- 172.21.15.55:0/4113385109 shutdown_connections 2023-08-25T05:37:08.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.519+0000 7f60ec66a640 1 -- 172.21.15.55:0/4113385109 wait complete. 2023-08-25T05:37:08.542 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:37:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.683+0000 7f0621a19640 1 Processor -- start 2023-08-25T05:37:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.683+0000 7f0621a19640 1 -- start start 2023-08-25T05:37:08.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f0621a19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f061c0ceeb0 0x7f061c0cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:08.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f0621a19640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f061c0cc880 con 0x7f061c0ad950 2023-08-25T05:37:08.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f0621a19640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f061c0ccb60 con 0x7f061c0c89f0 2023-08-25T05:37:08.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f0621a19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c0b11f0 con 0x7f061c0ceeb0 2023-08-25T05:37:08.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061affd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f061c0ad950 0x7f061c0ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45772/0 (socket says 172.21.15.55:45772) 2023-08-25T05:37:08.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061affd640 1 -- 172.21.15.55:0/574858463 learned_addr learned my addr 172.21.15.55:0/574858463 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f0613fff640 1 --2- 172.21.15.55:0/574858463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f061c0ceeb0 0x7f061c0cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:08.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061a7fc640 1 -- 172.21.15.55:0/574858463 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034280411 0 0) 0x7f061c0cc880 con 0x7f061c0ad950 2023-08-25T05:37:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061a7fc640 1 -- 172.21.15.55:0/574858463 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0608003530 con 0x7f061c0ad950 2023-08-25T05:37:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061a7fc640 1 -- 172.21.15.55:0/574858463 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2431431706 0 0) 0x7f0608003530 con 0x7f061c0ad950 2023-08-25T05:37:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061a7fc640 1 -- 172.21.15.55:0/574858463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f061c0ceeb0 msgr2=0x7f061c0cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061a7fc640 1 --2- 172.21.15.55:0/574858463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f061c0ceeb0 0x7f061c0cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061a7fc640 1 -- 172.21.15.55:0/574858463 >> v1:172.21.15.110:6789/0 conn(0x7f061c0c89f0 legacy=0x7f061c0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:08.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061a7fc640 1 -- 172.21.15.55:0/574858463 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c0cce40 con 0x7f061c0ad950 2023-08-25T05:37:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061a7fc640 1 -- 172.21.15.55:0/574858463 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f060c001680 con 0x7f061c0ad950 2023-08-25T05:37:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061a7fc640 1 -- 172.21.15.55:0/574858463 >> v1:172.21.15.55:6789/0 conn(0x7f061c0ad950 legacy=0x7f061c0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061a7fc640 1 --2- 172.21.15.55:0/574858463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06080039b0 0x7f0608003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061a7fc640 1 --2- 172.21.15.55:0/574858463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f061c0ceeb0 0x7f06080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061a7fc640 1 --2- 172.21.15.55:0/574858463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0608004d10 0x7f0608005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061a7fc640 1 -- 172.21.15.55:0/574858463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c0b11f0 con 0x7f0608004d10 2023-08-25T05:37:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061a7fc640 1 -- 172.21.15.55:0/574858463 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060800dc50 con 0x7f06080039b0 2023-08-25T05:37:08.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061a7fc640 1 -- 172.21.15.55:0/574858463 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060800de10 con 0x7f061c0ceeb0 2023-08-25T05:37:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061b7fe640 1 --2- 172.21.15.55:0/574858463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0608004d10 0x7f0608005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f0613fff640 1 --2- 172.21.15.55:0/574858463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f061c0ceeb0 0x7f06080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061affd640 1 --2- 172.21.15.55:0/574858463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06080039b0 0x7f0608003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061b7fe640 1 -- 172.21.15.55:0/574858463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f061c0ceeb0 msgr2=0x7f06080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061b7fe640 1 --2- 172.21.15.55:0/574858463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f061c0ceeb0 0x7f06080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061b7fe640 1 -- 172.21.15.55:0/574858463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06080039b0 msgr2=0x7f0608003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:08.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061b7fe640 1 --2- 172.21.15.55:0/574858463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06080039b0 0x7f0608003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.687+0000 7f061b7fe640 1 -- 172.21.15.55:0/574858463 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0608003530 con 0x7f0608004d10 2023-08-25T05:37:08.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.691+0000 7f061b7fe640 1 --2- 172.21.15.55:0/574858463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0608004d10 0x7f0608005190 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f061c15e490 tx=0x7f061401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69919ef1886f3ad7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:08.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.691+0000 7f061a7fc640 1 -- 172.21.15.55:0/574858463 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140a9680 con 0x7f0608004d10 2023-08-25T05:37:08.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.691+0000 7f061a7fc640 1 -- 172.21.15.55:0/574858463 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06140a9800 con 0x7f0608004d10 2023-08-25T05:37:08.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.691+0000 7f061a7fc640 1 -- 172.21.15.55:0/574858463 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140a9bb0 con 0x7f0608004d10 2023-08-25T05:37:08.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.691+0000 7f0621a19640 1 -- 172.21.15.55:0/574858463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0608004d10 msgr2=0x7f0608005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:08.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.691+0000 7f0621a19640 1 --2- 172.21.15.55:0/574858463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0608004d10 0x7f0608005190 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f061c15e490 tx=0x7f061401c8a0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.691+0000 7f061b7fe640 1 -- 172.21.15.55:0/574858463 reap_dead start 2023-08-25T05:37:08.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.691+0000 7f0621a19640 1 -- 172.21.15.55:0/574858463 shutdown_connections 2023-08-25T05:37:08.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.691+0000 7f0621a19640 1 -- 172.21.15.55:0/574858463 >> 172.21.15.55:0/574858463 conn(0x7f061c069d00 msgr2=0x7f061c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:08.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.691+0000 7f0621a19640 1 -- 172.21.15.55:0/574858463 shutdown_connections 2023-08-25T05:37:08.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.691+0000 7f0621a19640 1 -- 172.21.15.55:0/574858463 wait complete. 2023-08-25T05:37:08.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.691+0000 7f0621a19640 1 Processor -- start 2023-08-25T05:37:08.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.691+0000 7f0621a19640 1 -- start start 2023-08-25T05:37:08.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f0621a19640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0608004d10 0x7f061c0c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:08.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f0621a19640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f061c151040 0x7f061c152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:08.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f0621a19640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f061c0c5e80 0x7f061c0c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:08.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f0621a19640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c0c6840 con 0x7f061c0c5e80 2023-08-25T05:37:08.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f0621a19640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c153550 con 0x7f061c151040 2023-08-25T05:37:08.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f0621a19640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c1526a0 con 0x7f0608004d10 2023-08-25T05:37:08.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f061b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f061c0c5e80 0x7f061c0c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:08.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f061b7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f061c0c5e80 0x7f061c0c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60572/0 (socket says 172.21.15.55:60572) 2023-08-25T05:37:08.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f061b7fe640 1 -- 172.21.15.55:0/2901698563 learned_addr learned my addr 172.21.15.55:0/2901698563 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:08.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f061affd640 1 --2- 172.21.15.55:0/2901698563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0608004d10 0x7f061c0c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:08.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f0613fff640 1 --2- 172.21.15.55:0/2901698563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f061c151040 0x7f061c152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:08.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f061b7fe640 1 -- 172.21.15.55:0/2901698563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0608004d10 msgr2=0x7f061c0c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:08.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f061b7fe640 1 --2- 172.21.15.55:0/2901698563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0608004d10 0x7f061c0c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f061b7fe640 1 -- 172.21.15.55:0/2901698563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f061c151040 msgr2=0x7f061c152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:08.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f061b7fe640 1 --2- 172.21.15.55:0/2901698563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f061c151040 0x7f061c152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f061b7fe640 1 -- 172.21.15.55:0/2901698563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c152940 con 0x7f061c0c5e80 2023-08-25T05:37:08.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f061b7fe640 1 --2- 172.21.15.55:0/2901698563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f061c0c5e80 0x7f061c0c6300 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f061401c8e0 tx=0x7f0608005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:08.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f0618ff9640 1 -- 172.21.15.55:0/2901698563 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140b6070 con 0x7f061c0c5e80 2023-08-25T05:37:08.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f0618ff9640 1 -- 172.21.15.55:0/2901698563 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06140a9970 con 0x7f061c0c5e80 2023-08-25T05:37:08.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f0618ff9640 1 -- 172.21.15.55:0/2901698563 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140a9680 con 0x7f061c0c5e80 2023-08-25T05:37:08.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f0621a19640 1 -- 172.21.15.55:0/2901698563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f061c152c20 con 0x7f061c0c5e80 2023-08-25T05:37:08.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f0621a19640 1 -- 172.21.15.55:0/2901698563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061c1531e0 con 0x7f061c0c5e80 2023-08-25T05:37:08.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.695+0000 7f0621a19640 1 -- 172.21.15.55:0/2901698563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061c04dbe0 con 0x7f061c0c5e80 2023-08-25T05:37:08.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.699+0000 7f0618ff9640 1 -- 172.21.15.55:0/2901698563 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 114) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f0614006b60 con 0x7f061c0c5e80 2023-08-25T05:37:08.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.699+0000 7f0618ff9640 1 --2- 172.21.15.55:0/2901698563 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f05fc0654d0 0x7f05fc067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:08.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.699+0000 7f0618ff9640 1 -- 172.21.15.55:0/2901698563 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6908+0+0 (secure 0 0 0) 0x7f061411cb20 con 0x7f061c0c5e80 2023-08-25T05:37:08.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.699+0000 7f061affd640 1 --2- 172.21.15.55:0/2901698563 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f05fc0654d0 0x7f05fc067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:08.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.699+0000 7f061affd640 1 --2- 172.21.15.55:0/2901698563 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f05fc0654d0 0x7f05fc067990 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f060c000c10 tx=0x7f060c000ee0 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:08.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.703+0000 7f0618ff9640 1 -- 172.21.15.55:0/2901698563 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f06140ea530 con 0x7f061c0c5e80 2023-08-25T05:37:08.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.863+0000 7f0621a19640 1 -- 172.21.15.55:0/2901698563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f061c0cddf0 con 0x7f061c0c5e80 2023-08-25T05:37:08.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.863+0000 7f0618ff9640 1 -- 172.21.15.55:0/2901698563 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+19583 (secure 0 0 0) 0x7f06140c0020 con 0x7f061c0c5e80 2023-08-25T05:37:08.865 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:08.865 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":191,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:37:07.154855+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:35:38.546524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-25T05:35:39.796267+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":191,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/1879414910":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/2364681532":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/3445363124":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/1365337144":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/3636080411":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/2719509011":"2023-08-26T05:37:07.154812+0000","172.21.15.110:6833/3676103183":"2023-08-26T05:37:07.154812+0000","172.21.15.110:6832/3676103183":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/4153312762":"2023-08-26T05:35:57.993440+0000","172.21.15.110:6833/3764131781":"2023-08-26T05:35:57.993440+0000","172.21.15.110:6832/3764131781":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/850752631":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/1738610480":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/3196857459":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/3481018175":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/3113850402":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/1309145938":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/2668066062":"2023-08-26T05:35:57.993440+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":24,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:37:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.863+0000 7f0621a19640 1 -- 172.21.15.55:0/2901698563 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f05fc0654d0 msgr2=0x7f05fc067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.863+0000 7f0621a19640 1 --2- 172.21.15.55:0/2901698563 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f05fc0654d0 0x7f05fc067990 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f060c000c10 tx=0x7f060c000ee0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.863+0000 7f0621a19640 1 -- 172.21.15.55:0/2901698563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f061c0c5e80 msgr2=0x7f061c0c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.863+0000 7f0621a19640 1 --2- 172.21.15.55:0/2901698563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f061c0c5e80 0x7f061c0c6300 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f061401c8e0 tx=0x7f0608005800 comp rx=0 tx=0).stop 2023-08-25T05:37:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.867+0000 7f0621a19640 1 -- 172.21.15.55:0/2901698563 shutdown_connections 2023-08-25T05:37:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.867+0000 7f0621a19640 1 --2- 172.21.15.55:0/2901698563 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f05fc0654d0 0x7f05fc067990 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.867+0000 7f0621a19640 1 --2- 172.21.15.55:0/2901698563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f061c0c5e80 0x7f061c0c6300 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.867+0000 7f0621a19640 1 --2- 172.21.15.55:0/2901698563 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f061c151040 0x7f061c152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.867+0000 7f0621a19640 1 --2- 172.21.15.55:0/2901698563 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0608004d10 0x7f061c0c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.867+0000 7f0621a19640 1 -- 172.21.15.55:0/2901698563 >> 172.21.15.55:0/2901698563 conn(0x7f061c069d00 msgr2=0x7f061c0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.867+0000 7f0621a19640 1 -- 172.21.15.55:0/2901698563 shutdown_connections 2023-08-25T05:37:08.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:08.867+0000 7f0621a19640 1 -- 172.21.15.55:0/2901698563 wait complete. 2023-08-25T05:37:08.886 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-25T05:37:08.887 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:37:09.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.027+0000 7f64a5f67640 1 Processor -- start 2023-08-25T05:37:09.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.027+0000 7f64a5f67640 1 -- start start 2023-08-25T05:37:09.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f64a5f67640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64a00ad950 0x7f64a00cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:09.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f64a5f67640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64a00c89f0 0x7f64a00ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:09.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f64a5f67640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f64a006c000 0x7f64a00cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:09.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f64a5f67640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a00b11f0 con 0x7f64a00ad950 2023-08-25T05:37:09.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f64a5f67640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a0159d50 con 0x7f64a006c000 2023-08-25T05:37:09.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f64a5f67640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a00cc880 con 0x7f64a00c89f0 2023-08-25T05:37:09.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f649f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64a00ad950 0x7f64a00cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:09.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f649f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f64a00ad950 0x7f64a00cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60582/0 (socket says 172.21.15.55:60582) 2023-08-25T05:37:09.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f649f7fe640 1 -- 172.21.15.55:0/3970851913 learned_addr learned my addr 172.21.15.55:0/3970851913 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:09.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f649f7fe640 1 -- 172.21.15.55:0/3970851913 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64a00c89f0 msgr2=0x7f64a00ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:09.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f649effd640 1 --2- 172.21.15.55:0/3970851913 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64a00c89f0 0x7f64a00ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:09.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f649ffff640 1 --2- 172.21.15.55:0/3970851913 >> v2:172.21.15.110:3300/0 conn(0x7f64a006c000 0x7f64a00cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:09.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f649f7fe640 1 --2- 172.21.15.55:0/3970851913 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64a00c89f0 0x7f64a00ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f649f7fe640 1 -- 172.21.15.55:0/3970851913 >> v2:172.21.15.110:3300/0 conn(0x7f64a006c000 msgr2=0x7f64a00cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:09.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f649f7fe640 1 --2- 172.21.15.55:0/3970851913 >> v2:172.21.15.110:3300/0 conn(0x7f64a006c000 0x7f64a00cece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f649f7fe640 1 -- 172.21.15.55:0/3970851913 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a00ccb60 con 0x7f64a00ad950 2023-08-25T05:37:09.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f649effd640 1 --2- 172.21.15.55:0/3970851913 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64a00c89f0 0x7f64a00ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:09.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f649ffff640 1 --2- 172.21.15.55:0/3970851913 >> v2:172.21.15.110:3300/0 conn(0x7f64a006c000 0x7f64a00cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:09.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.031+0000 7f649f7fe640 1 --2- 172.21.15.55:0/3970851913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64a00ad950 0x7f64a00cc2a0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f64a00afe20 tx=0x7f649001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d879cd33673a19ed server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:09.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f649e7fc640 1 -- 172.21.15.55:0/3970851913 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64900ac640 con 0x7f64a00ad950 2023-08-25T05:37:09.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f649e7fc640 1 -- 172.21.15.55:0/3970851913 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64900ac7a0 con 0x7f64a00ad950 2023-08-25T05:37:09.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f649e7fc640 1 -- 172.21.15.55:0/3970851913 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64900acb30 con 0x7f64a00ad950 2023-08-25T05:37:09.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f64a5f67640 1 -- 172.21.15.55:0/3970851913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64a00ad950 msgr2=0x7f64a00cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:09.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f64a5f67640 1 --2- 172.21.15.55:0/3970851913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64a00ad950 0x7f64a00cc2a0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7f64a00afe20 tx=0x7f649001c440 comp rx=0 tx=0).stop 2023-08-25T05:37:09.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f64a5f67640 1 -- 172.21.15.55:0/3970851913 shutdown_connections 2023-08-25T05:37:09.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f64a5f67640 1 --2- 172.21.15.55:0/3970851913 >> v2:172.21.15.110:3300/0 conn(0x7f64a006c000 0x7f64a00cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f64a5f67640 1 --2- 172.21.15.55:0/3970851913 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64a00c89f0 0x7f64a00ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f64a5f67640 1 --2- 172.21.15.55:0/3970851913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64a00ad950 0x7f64a00cc2a0 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f64a5f67640 1 -- 172.21.15.55:0/3970851913 >> 172.21.15.55:0/3970851913 conn(0x7f64a0069d00 msgr2=0x7f64a006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:09.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f64a5f67640 1 -- 172.21.15.55:0/3970851913 shutdown_connections 2023-08-25T05:37:09.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f64a5f67640 1 -- 172.21.15.55:0/3970851913 wait complete. 2023-08-25T05:37:09.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f64a5f67640 1 Processor -- start 2023-08-25T05:37:09.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f64a5f67640 1 -- start start 2023-08-25T05:37:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f64a5f67640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64a006c000 0x7f64a0097a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f64a5f67640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64a00ad950 0x7f64a00965e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f64a5f67640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64a00c89f0 0x7f64a00b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f64a5f67640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a0096cb0 con 0x7f64a006c000 2023-08-25T05:37:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f64a5f67640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a0096f90 con 0x7f64a00c89f0 2023-08-25T05:37:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f64a5f67640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a0097270 con 0x7f64a00ad950 2023-08-25T05:37:09.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f649f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64a006c000 0x7f64a0097a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f649f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64a006c000 0x7f64a0097a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60596/0 (socket says 172.21.15.55:60596) 2023-08-25T05:37:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f649f7fe640 1 -- 172.21.15.55:0/46050417 learned_addr learned my addr 172.21.15.55:0/46050417 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f649ffff640 1 --2- 172.21.15.55:0/46050417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64a00c89f0 0x7f64a00b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.035+0000 7f649effd640 1 --2- 172.21.15.55:0/46050417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64a00ad950 0x7f64a00965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.039+0000 7f649f7fe640 1 -- 172.21.15.55:0/46050417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64a00ad950 msgr2=0x7f64a00965e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.039+0000 7f649f7fe640 1 --2- 172.21.15.55:0/46050417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64a00ad950 0x7f64a00965e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.039+0000 7f649f7fe640 1 -- 172.21.15.55:0/46050417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64a00c89f0 msgr2=0x7f64a00b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.039+0000 7f649f7fe640 1 --2- 172.21.15.55:0/46050417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64a00c89f0 0x7f64a00b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.039+0000 7f649f7fe640 1 -- 172.21.15.55:0/46050417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64900094d0 con 0x7f64a006c000 2023-08-25T05:37:09.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.039+0000 7f649f7fe640 1 --2- 172.21.15.55:0/46050417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64a006c000 0x7f64a0097a70 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f64900af040 tx=0x7f64900191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.039+0000 7f6487fff640 1 -- 172.21.15.55:0/46050417 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64900ac640 con 0x7f64a006c000 2023-08-25T05:37:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.039+0000 7f6487fff640 1 -- 172.21.15.55:0/46050417 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64900b5870 con 0x7f64a006c000 2023-08-25T05:37:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.039+0000 7f6487fff640 1 -- 172.21.15.55:0/46050417 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64900b5c20 con 0x7f64a006c000 2023-08-25T05:37:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.039+0000 7f64a5f67640 1 -- 172.21.15.55:0/46050417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a0097550 con 0x7f64a006c000 2023-08-25T05:37:09.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.039+0000 7f64a5f67640 1 -- 172.21.15.55:0/46050417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a014eda0 con 0x7f64a006c000 2023-08-25T05:37:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.039+0000 7f64a5f67640 1 -- 172.21.15.55:0/46050417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a004dbe0 con 0x7f64a006c000 2023-08-25T05:37:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.039+0000 7f6487fff640 1 -- 172.21.15.55:0/46050417 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 114) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f64900b3070 con 0x7f64a006c000 2023-08-25T05:37:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.039+0000 7f6487fff640 1 --2- 172.21.15.55:0/46050417 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f648c065500 0x7f648c0679c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.039+0000 7f6487fff640 1 -- 172.21.15.55:0/46050417 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6908+0+0 (secure 0 0 0) 0x7f649011d3a0 con 0x7f64a006c000 2023-08-25T05:37:09.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.043+0000 7f649effd640 1 --2- 172.21.15.55:0/46050417 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f648c065500 0x7f648c0679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:09.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.043+0000 7f649effd640 1 --2- 172.21.15.55:0/46050417 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f648c065500 0x7f648c0679c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f64a0150f00 tx=0x7f6494008040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:09.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.043+0000 7f6487fff640 1 -- 172.21.15.55:0/46050417 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f64900eaeb0 con 0x7f64a006c000 2023-08-25T05:37:09.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.239+0000 7f64a5f67640 1 -- 172.21.15.55:0/46050417 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64a0096df0 con 0x7f64a006c000 2023-08-25T05:37:09.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.243+0000 7f6487fff640 1 -- 172.21.15.55:0/46050417 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4886 (secure 0 0 0) 0x7f64a0096df0 con 0x7f64a006c000 2023-08-25T05:37:09.243 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:09.244 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8768,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1348996798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1348996798},{"type":"v1","addr":"172.21.15.110:6837","nonce":1348996798}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":9988,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/623585793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":623585793},{"type":"v1","addr":"172.21.15.110:6836","nonce":623585793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":10782,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3873137631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3873137631},{"type":"v1","addr":"172.21.15.55:6834","nonce":3873137631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:35:40.794599+0000","modified":"2023-08-25T05:35:44.431342+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":10785},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10785":{"gid":10785,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1770370805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1770370805},{"type":"v1","addr":"172.21.15.55:6835","nonce":1770370805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-25T05:37:09.244 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 91 2023-08-25T05:37:09.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.243+0000 7f64a5f67640 1 -- 172.21.15.55:0/46050417 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f648c065500 msgr2=0x7f648c0679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:09.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.243+0000 7f64a5f67640 1 --2- 172.21.15.55:0/46050417 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f648c065500 0x7f648c0679c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f64a0150f00 tx=0x7f6494008040 comp rx=0 tx=0).stop 2023-08-25T05:37:09.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.243+0000 7f64a5f67640 1 -- 172.21.15.55:0/46050417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64a006c000 msgr2=0x7f64a0097a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:09.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.243+0000 7f64a5f67640 1 --2- 172.21.15.55:0/46050417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64a006c000 0x7f64a0097a70 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f64900af040 tx=0x7f64900191e0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.243+0000 7f64a5f67640 1 -- 172.21.15.55:0/46050417 shutdown_connections 2023-08-25T05:37:09.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.243+0000 7f64a5f67640 1 --2- 172.21.15.55:0/46050417 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f648c065500 0x7f648c0679c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.243+0000 7f64a5f67640 1 --2- 172.21.15.55:0/46050417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64a00c89f0 0x7f64a00b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.243+0000 7f64a5f67640 1 --2- 172.21.15.55:0/46050417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64a00ad950 0x7f64a00965e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.243+0000 7f64a5f67640 1 --2- 172.21.15.55:0/46050417 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f64a006c000 0x7f64a0097a70 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.243+0000 7f64a5f67640 1 -- 172.21.15.55:0/46050417 >> 172.21.15.55:0/46050417 conn(0x7f64a0069d00 msgr2=0x7f64a006b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:09.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.243+0000 7f64a5f67640 1 -- 172.21.15.55:0/46050417 shutdown_connections 2023-08-25T05:37:09.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.243+0000 7f64a5f67640 1 -- 172.21.15.55:0/46050417 wait complete. 2023-08-25T05:37:09.264 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:37:09.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.407+0000 7f6f56f96640 1 Processor -- start 2023-08-25T05:37:09.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.407+0000 7f6f56f96640 1 -- start start 2023-08-25T05:37:09.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.407+0000 7f6f56f96640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6f500aeb10 0x7f6f500ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:09.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.407+0000 7f6f56f96640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f500cee20 0x7f6f50069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:09.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.407+0000 7f6f56f96640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f500cf2b0 con 0x7f6f50069e40 2023-08-25T05:37:09.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.407+0000 7f6f56f96640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f500d0380 con 0x7f6f500cee20 2023-08-25T05:37:09.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.407+0000 7f6f56f96640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5006d590 con 0x7f6f500aeb10 2023-08-25T05:37:09.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.407+0000 7f6f4ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f500cee20 0x7f6f50069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:09.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.411+0000 7f6f4ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f500cee20 0x7f6f50069900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60610/0 (socket says 172.21.15.55:60610) 2023-08-25T05:37:09.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.411+0000 7f6f55533640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f6f50069e40 0x7f6f50160520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:36160/0 (socket says 172.21.15.55:36160) 2023-08-25T05:37:09.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.411+0000 7f6f4ffff640 1 -- 172.21.15.55:0/2993885653 learned_addr learned my addr 172.21.15.55:0/2993885653 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:09.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.411+0000 7f6f54d32640 1 --2- 172.21.15.55:0/2993885653 >> v2:172.21.15.110:3300/0 conn(0x7f6f500aeb10 0x7f6f500ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:09.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.411+0000 7f6f4ffff640 1 -- 172.21.15.55:0/2993885653 >> v2:172.21.15.110:3300/0 conn(0x7f6f500aeb10 msgr2=0x7f6f500ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:09.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.411+0000 7f6f4ffff640 1 --2- 172.21.15.55:0/2993885653 >> v2:172.21.15.110:3300/0 conn(0x7f6f500aeb10 0x7f6f500ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.411+0000 7f6f4ffff640 1 -- 172.21.15.55:0/2993885653 >> v1:172.21.15.110:6789/0 conn(0x7f6f50069e40 legacy=0x7f6f50160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:09.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.411+0000 7f6f4ffff640 1 -- 172.21.15.55:0/2993885653 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5006c4f0 con 0x7f6f500cee20 2023-08-25T05:37:09.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.411+0000 7f6f4ffff640 1 --2- 172.21.15.55:0/2993885653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f500cee20 0x7f6f50069900 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f6f5006d6d0 tx=0x7f6f3c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6614189bca9fc48 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:09.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f4f7fe640 1 -- 172.21.15.55:0/2993885653 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0ab5f0 con 0x7f6f500cee20 2023-08-25T05:37:09.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f4f7fe640 1 -- 172.21.15.55:0/2993885653 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3c0ab750 con 0x7f6f500cee20 2023-08-25T05:37:09.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f4f7fe640 1 -- 172.21.15.55:0/2993885653 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0abae0 con 0x7f6f500cee20 2023-08-25T05:37:09.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f56f96640 1 -- 172.21.15.55:0/2993885653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f500cee20 msgr2=0x7f6f50069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:09.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f56f96640 1 --2- 172.21.15.55:0/2993885653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f500cee20 0x7f6f50069900 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f6f5006d6d0 tx=0x7f6f3c01c500 comp rx=0 tx=0).stop 2023-08-25T05:37:09.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f56f96640 1 -- 172.21.15.55:0/2993885653 shutdown_connections 2023-08-25T05:37:09.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f56f96640 1 --2- 172.21.15.55:0/2993885653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f500cee20 0x7f6f50069900 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f56f96640 1 --2- 172.21.15.55:0/2993885653 >> v2:172.21.15.110:3300/0 conn(0x7f6f500aeb10 0x7f6f500ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f56f96640 1 -- 172.21.15.55:0/2993885653 >> 172.21.15.55:0/2993885653 conn(0x7f6f500cf530 msgr2=0x7f6f500cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:09.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f56f96640 1 -- 172.21.15.55:0/2993885653 shutdown_connections 2023-08-25T05:37:09.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f56f96640 1 -- 172.21.15.55:0/2993885653 wait complete. 2023-08-25T05:37:09.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f56f96640 1 Processor -- start 2023-08-25T05:37:09.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f56f96640 1 -- start start 2023-08-25T05:37:09.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f56f96640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f50069e40 0x7f6f500c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:09.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f56f96640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f500aeb10 0x7f6f500cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:09.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f56f96640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f500cee20 0x7f6f500cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:09.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f56f96640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500b2120 con 0x7f6f50069e40 2023-08-25T05:37:09.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f56f96640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500c3960 con 0x7f6f500cee20 2023-08-25T05:37:09.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.415+0000 7f6f56f96640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500c3c40 con 0x7f6f500aeb10 2023-08-25T05:37:09.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f54d32640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f50069e40 0x7f6f500c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:09.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f54d32640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f50069e40 0x7f6f500c3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60620/0 (socket says 172.21.15.55:60620) 2023-08-25T05:37:09.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f54d32640 1 -- 172.21.15.55:0/3470974960 learned_addr learned my addr 172.21.15.55:0/3470974960 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:09.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f4ffff640 1 --2- 172.21.15.55:0/3470974960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f500aeb10 0x7f6f500cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:09.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f55533640 1 --2- 172.21.15.55:0/3470974960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f500cee20 0x7f6f500cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:09.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f54d32640 1 -- 172.21.15.55:0/3470974960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f500aeb10 msgr2=0x7f6f500cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:09.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f54d32640 1 --2- 172.21.15.55:0/3470974960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f500aeb10 0x7f6f500cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f54d32640 1 -- 172.21.15.55:0/3470974960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f500cee20 msgr2=0x7f6f500cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:09.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f54d32640 1 --2- 172.21.15.55:0/3470974960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f500cee20 0x7f6f500cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f54d32640 1 -- 172.21.15.55:0/3470974960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c0094d0 con 0x7f6f50069e40 2023-08-25T05:37:09.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f55533640 1 --2- 172.21.15.55:0/3470974960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f500cee20 0x7f6f500cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:09.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f54d32640 1 --2- 172.21.15.55:0/3470974960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f50069e40 0x7f6f500c3060 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400e930 tx=0x7f6f4400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:09.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f4d7fa640 1 -- 172.21.15.55:0/3470974960 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f44009690 con 0x7f6f50069e40 2023-08-25T05:37:09.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f4d7fa640 1 -- 172.21.15.55:0/3470974960 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4400ca00 con 0x7f6f50069e40 2023-08-25T05:37:09.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f56f96640 1 -- 172.21.15.55:0/3470974960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f500c3f20 con 0x7f6f50069e40 2023-08-25T05:37:09.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f4d7fa640 1 -- 172.21.15.55:0/3470974960 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4400cd70 con 0x7f6f50069e40 2023-08-25T05:37:09.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f56f96640 1 -- 172.21.15.55:0/3470974960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f500c35a0 con 0x7f6f50069e40 2023-08-25T05:37:09.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f56f96640 1 -- 172.21.15.55:0/3470974960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5004dbe0 con 0x7f6f50069e40 2023-08-25T05:37:09.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.419+0000 7f6f4d7fa640 1 -- 172.21.15.55:0/3470974960 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f6f44013470 con 0x7f6f50069e40 2023-08-25T05:37:09.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.423+0000 7f6f4d7fa640 1 --2- 172.21.15.55:0/3470974960 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f6f34065710 0x7f6f34067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:09.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.423+0000 7f6f4d7fa640 1 -- 172.21.15.55:0/3470974960 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6908+0+0 (secure 0 0 0) 0x7f6f44083340 con 0x7f6f50069e40 2023-08-25T05:37:09.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.423+0000 7f6f4ffff640 1 --2- 172.21.15.55:0/3470974960 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f6f34065710 0x7f6f34067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:09.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.423+0000 7f6f4ffff640 1 --2- 172.21.15.55:0/3470974960 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f6f34065710 0x7f6f34067bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0af000 tx=0x7f6f3c0b6040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:09.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.427+0000 7f6f4d7fa640 1 -- 172.21.15.55:0/3470974960 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6f44050c30 con 0x7f6f50069e40 2023-08-25T05:37:09.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.615+0000 7f6f56f96640 1 -- 172.21.15.55:0/3470974960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f5006cd60 con 0x7f6f50069e40 2023-08-25T05:37:09.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.615+0000 7f6f4d7fa640 1 -- 172.21.15.55:0/3470974960 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4886 (secure 0 0 0) 0x7f6f44054250 con 0x7f6f50069e40 2023-08-25T05:37:09.619 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:09.619 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8768,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1348996798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1348996798},{"type":"v1","addr":"172.21.15.110:6837","nonce":1348996798}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":9988,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/623585793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":623585793},{"type":"v1","addr":"172.21.15.110:6836","nonce":623585793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":10782,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3873137631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3873137631},{"type":"v1","addr":"172.21.15.55:6834","nonce":3873137631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:35:40.794599+0000","modified":"2023-08-25T05:35:44.431342+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":10785},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10785":{"gid":10785,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1770370805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":1770370805},{"type":"v1","addr":"172.21.15.55:6835","nonce":1770370805}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-08-25T05:37:09.621 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 91 2023-08-25T05:37:09.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.619+0000 7f6f56f96640 1 -- 172.21.15.55:0/3470974960 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f6f34065710 msgr2=0x7f6f34067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:09.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.619+0000 7f6f56f96640 1 --2- 172.21.15.55:0/3470974960 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f6f34065710 0x7f6f34067bd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0af000 tx=0x7f6f3c0b6040 comp rx=0 tx=0).stop 2023-08-25T05:37:09.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.619+0000 7f6f56f96640 1 -- 172.21.15.55:0/3470974960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f50069e40 msgr2=0x7f6f500c3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:09.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.619+0000 7f6f56f96640 1 --2- 172.21.15.55:0/3470974960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f50069e40 0x7f6f500c3060 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400e930 tx=0x7f6f4400edf0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.619+0000 7f6f56f96640 1 -- 172.21.15.55:0/3470974960 shutdown_connections 2023-08-25T05:37:09.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.619+0000 7f6f56f96640 1 --2- 172.21.15.55:0/3470974960 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f6f34065710 0x7f6f34067bd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.619+0000 7f6f56f96640 1 --2- 172.21.15.55:0/3470974960 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f500cee20 0x7f6f500cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.619+0000 7f6f56f96640 1 --2- 172.21.15.55:0/3470974960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f500aeb10 0x7f6f500cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.619+0000 7f6f56f96640 1 --2- 172.21.15.55:0/3470974960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f50069e40 0x7f6f500c3060 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.619+0000 7f6f56f96640 1 -- 172.21.15.55:0/3470974960 >> 172.21.15.55:0/3470974960 conn(0x7f6f500cf530 msgr2=0x7f6f500ac380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:09.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.619+0000 7f6f56f96640 1 -- 172.21.15.55:0/3470974960 shutdown_connections 2023-08-25T05:37:09.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.619+0000 7f6f56f96640 1 -- 172.21.15.55:0/3470974960 wait complete. 2023-08-25T05:37:09.640 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:37:09.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.779+0000 7f23ce18f640 1 Processor -- start 2023-08-25T05:37:09.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.779+0000 7f23ce18f640 1 -- start start 2023-08-25T05:37:09.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.783+0000 7f23ce18f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f23c80ceeb0 0x7f23c80cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:09.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.783+0000 7f23ce18f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c80cc880 con 0x7f23c80c89f0 2023-08-25T05:37:09.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.783+0000 7f23ce18f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c80ccb60 con 0x7f23c80ad950 2023-08-25T05:37:09.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.783+0000 7f23ce18f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c80b11f0 con 0x7f23c80ceeb0 2023-08-25T05:37:09.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.783+0000 7f23c7fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f23c80c89f0 0x7f23c80b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45786/0 (socket says 172.21.15.55:45786) 2023-08-25T05:37:09.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.783+0000 7f23c7fff640 1 -- 172.21.15.55:0/2136561095 learned_addr learned my addr 172.21.15.55:0/2136561095 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:09.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.783+0000 7f23c6ffd640 1 --2- 172.21.15.55:0/2136561095 >> v2:172.21.15.55:3300/0 conn(0x7f23c80ceeb0 0x7f23c80cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:09.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.783+0000 7f23c6ffd640 1 -- 172.21.15.55:0/2136561095 >> v1:172.21.15.110:6789/0 conn(0x7f23c80ad950 legacy=0x7f23c80ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:09.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.783+0000 7f23c6ffd640 1 -- 172.21.15.55:0/2136561095 >> v1:172.21.15.55:6789/0 conn(0x7f23c80c89f0 legacy=0x7f23c80b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:09.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.783+0000 7f23c6ffd640 1 -- 172.21.15.55:0/2136561095 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c80cce40 con 0x7f23c80ceeb0 2023-08-25T05:37:09.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.783+0000 7f23c67fc640 1 -- 172.21.15.55:0/2136561095 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003508712 0 0) 0x7f23c80cc880 con 0x7f23c80c89f0 2023-08-25T05:37:09.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.783+0000 7f23c6ffd640 1 --2- 172.21.15.55:0/2136561095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c80ceeb0 0x7f23c80cc2a0 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0097c0 tx=0x7f23bc01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23196a65a6cb5924 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:09.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.787+0000 7f23c67fc640 1 -- 172.21.15.55:0/2136561095 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc0ab600 con 0x7f23c80ceeb0 2023-08-25T05:37:09.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.787+0000 7f23c67fc640 1 -- 172.21.15.55:0/2136561095 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23bc0a7050 con 0x7f23c80ceeb0 2023-08-25T05:37:09.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.787+0000 7f23c67fc640 1 -- 172.21.15.55:0/2136561095 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23bc0ab980 con 0x7f23c80ceeb0 2023-08-25T05:37:09.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.787+0000 7f23ce18f640 1 -- 172.21.15.55:0/2136561095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c80ceeb0 msgr2=0x7f23c80cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:09.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.787+0000 7f23ce18f640 1 --2- 172.21.15.55:0/2136561095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c80ceeb0 0x7f23c80cc2a0 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0097c0 tx=0x7f23bc01c3b0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.787+0000 7f23ce18f640 1 -- 172.21.15.55:0/2136561095 shutdown_connections 2023-08-25T05:37:09.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.787+0000 7f23ce18f640 1 --2- 172.21.15.55:0/2136561095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c80ceeb0 0x7f23c80cc2a0 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.787+0000 7f23ce18f640 1 -- 172.21.15.55:0/2136561095 >> 172.21.15.55:0/2136561095 conn(0x7f23c8069d00 msgr2=0x7f23c806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:09.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.787+0000 7f23ce18f640 1 -- 172.21.15.55:0/2136561095 shutdown_connections 2023-08-25T05:37:09.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.787+0000 7f23ce18f640 1 -- 172.21.15.55:0/2136561095 wait complete. 2023-08-25T05:37:09.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.787+0000 7f23ce18f640 1 Processor -- start 2023-08-25T05:37:09.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.787+0000 7f23ce18f640 1 -- start start 2023-08-25T05:37:09.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.787+0000 7f23ce18f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c80ad950 0x7f23c8162180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:09.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.787+0000 7f23ce18f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c80c89f0 0x7f23c8097810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:09.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.787+0000 7f23ce18f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c80ceeb0 0x7f23c8158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:09.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.787+0000 7f23ce18f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c81638b0 con 0x7f23c80ceeb0 2023-08-25T05:37:09.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.787+0000 7f23ce18f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c8162810 con 0x7f23c80ad950 2023-08-25T05:37:09.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.787+0000 7f23ce18f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c8162af0 con 0x7f23c80c89f0 2023-08-25T05:37:09.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23c7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c80ceeb0 0x7f23c8158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:09.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23c7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c80ceeb0 0x7f23c8158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60648/0 (socket says 172.21.15.55:60648) 2023-08-25T05:37:09.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23c7fff640 1 -- 172.21.15.55:0/2288438792 learned_addr learned my addr 172.21.15.55:0/2288438792 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:09.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23c6ffd640 1 --2- 172.21.15.55:0/2288438792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c80c89f0 0x7f23c8097810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:09.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23c77fe640 1 --2- 172.21.15.55:0/2288438792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c80ad950 0x7f23c8162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:09.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23c7fff640 1 -- 172.21.15.55:0/2288438792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c80c89f0 msgr2=0x7f23c8097810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:09.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23c7fff640 1 --2- 172.21.15.55:0/2288438792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c80c89f0 0x7f23c8097810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23c7fff640 1 -- 172.21.15.55:0/2288438792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c80ad950 msgr2=0x7f23c8162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:09.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23c7fff640 1 --2- 172.21.15.55:0/2288438792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c80ad950 0x7f23c8162180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23c7fff640 1 -- 172.21.15.55:0/2288438792 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23bc009420 con 0x7f23c80ceeb0 2023-08-25T05:37:09.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23c7fff640 1 --2- 172.21.15.55:0/2288438792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c80ceeb0 0x7f23c8158c30 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f23c0001570 tx=0x7f23c000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:09.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23affff640 1 -- 172.21.15.55:0/2288438792 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c000a640 con 0x7f23c80ceeb0 2023-08-25T05:37:09.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23affff640 1 -- 172.21.15.55:0/2288438792 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c000a7c0 con 0x7f23c80ceeb0 2023-08-25T05:37:09.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23affff640 1 -- 172.21.15.55:0/2288438792 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c000ab70 con 0x7f23c80ceeb0 2023-08-25T05:37:09.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23ce18f640 1 -- 172.21.15.55:0/2288438792 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c8162dd0 con 0x7f23c80ceeb0 2023-08-25T05:37:09.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23ce18f640 1 -- 172.21.15.55:0/2288438792 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c8163390 con 0x7f23c80ceeb0 2023-08-25T05:37:09.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23ce18f640 1 -- 172.21.15.55:0/2288438792 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c8163580 con 0x7f23c80ceeb0 2023-08-25T05:37:09.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23affff640 1 -- 172.21.15.55:0/2288438792 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f23c000acd0 con 0x7f23c80ceeb0 2023-08-25T05:37:09.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.791+0000 7f23affff640 1 --2- 172.21.15.55:0/2288438792 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f23b4065710 0x7f23b4067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:09.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.795+0000 7f23affff640 1 -- 172.21.15.55:0/2288438792 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6908+0+0 (secure 0 0 0) 0x7f23c00827b0 con 0x7f23c80ceeb0 2023-08-25T05:37:09.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.795+0000 7f23c77fe640 1 --2- 172.21.15.55:0/2288438792 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f23b4065710 0x7f23b4067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:09.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.795+0000 7f23c77fe640 1 --2- 172.21.15.55:0/2288438792 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f23b4065710 0x7f23b4067bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f23c8158ac0 tx=0x7f23b8007e40 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:09.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.795+0000 7f23affff640 1 -- 172.21.15.55:0/2288438792 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f23c004fee0 con 0x7f23c80ceeb0 2023-08-25T05:37:09.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.951+0000 7f23ce18f640 1 -- 172.21.15.55:0/2288438792 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23c804dbe0 con 0x7f23c80ceeb0 2023-08-25T05:37:09.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.955+0000 7f23affff640 1 -- 172.21.15.55:0/2288438792 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+19583 (secure 0 0 0) 0x7f23c0053500 con 0x7f23c80ceeb0 2023-08-25T05:37:09.956 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:09.957 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":191,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:37:07.154855+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:35:38.546524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-25T05:35:39.796267+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":191,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/1879414910":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/2364681532":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/3445363124":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/1365337144":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/3636080411":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/2719509011":"2023-08-26T05:37:07.154812+0000","172.21.15.110:6833/3676103183":"2023-08-26T05:37:07.154812+0000","172.21.15.110:6832/3676103183":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/4153312762":"2023-08-26T05:35:57.993440+0000","172.21.15.110:6833/3764131781":"2023-08-26T05:35:57.993440+0000","172.21.15.110:6832/3764131781":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/850752631":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/1738610480":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/3196857459":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/3481018175":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/3113850402":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/1309145938":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/2668066062":"2023-08-26T05:35:57.993440+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":24,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":24,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:37:09.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.955+0000 7f23ce18f640 1 -- 172.21.15.55:0/2288438792 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f23b4065710 msgr2=0x7f23b4067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:09.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.955+0000 7f23ce18f640 1 --2- 172.21.15.55:0/2288438792 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f23b4065710 0x7f23b4067bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f23c8158ac0 tx=0x7f23b8007e40 comp rx=0 tx=0).stop 2023-08-25T05:37:09.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.955+0000 7f23ce18f640 1 -- 172.21.15.55:0/2288438792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c80ceeb0 msgr2=0x7f23c8158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:09.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.955+0000 7f23ce18f640 1 --2- 172.21.15.55:0/2288438792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c80ceeb0 0x7f23c8158c30 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f23c0001570 tx=0x7f23c000cca0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.955+0000 7f23ce18f640 1 -- 172.21.15.55:0/2288438792 shutdown_connections 2023-08-25T05:37:09.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.955+0000 7f23ce18f640 1 --2- 172.21.15.55:0/2288438792 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f23b4065710 0x7f23b4067bd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.955+0000 7f23ce18f640 1 --2- 172.21.15.55:0/2288438792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23c80ceeb0 0x7f23c8158c30 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.955+0000 7f23ce18f640 1 --2- 172.21.15.55:0/2288438792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c80c89f0 0x7f23c8097810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.955+0000 7f23ce18f640 1 --2- 172.21.15.55:0/2288438792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c80ad950 0x7f23c8162180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:09.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.955+0000 7f23ce18f640 1 -- 172.21.15.55:0/2288438792 >> 172.21.15.55:0/2288438792 conn(0x7f23c8069d00 msgr2=0x7f23c80b1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:09.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.955+0000 7f23ce18f640 1 -- 172.21.15.55:0/2288438792 shutdown_connections 2023-08-25T05:37:09.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:09.955+0000 7f23ce18f640 1 -- 172.21.15.55:0/2288438792 wait complete. 2023-08-25T05:37:09.978 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-25T05:37:10.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.119+0000 7f3c16767640 1 Processor -- start 2023-08-25T05:37:10.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.119+0000 7f3c16767640 1 -- start start 2023-08-25T05:37:10.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.119+0000 7f3c16767640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c100ca110 0x7f3c100b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:10.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.119+0000 7f3c16767640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c100cdbf0 con 0x7f3c10158e10 2023-08-25T05:37:10.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.119+0000 7f3c16767640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c100ca520 con 0x7f3c100cb2a0 2023-08-25T05:37:10.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.119+0000 7f3c16767640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c100ad940 con 0x7f3c100ca110 2023-08-25T05:37:10.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.123+0000 7f3c14d04640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c100ca110 0x7f3c100b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:10.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.123+0000 7f3c0ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3c10158e10 0x7f3c100cab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45792/0 (socket says 172.21.15.55:45792) 2023-08-25T05:37:10.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.123+0000 7f3c0ffff640 1 -- 172.21.15.55:0/2659552412 learned_addr learned my addr 172.21.15.55:0/2659552412 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:10.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.123+0000 7f3c14d04640 1 -- 172.21.15.55:0/2659552412 >> v1:172.21.15.110:6789/0 conn(0x7f3c100cb2a0 legacy=0x7f3c100c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:10.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.123+0000 7f3c14d04640 1 -- 172.21.15.55:0/2659552412 >> v1:172.21.15.55:6789/0 conn(0x7f3c10158e10 legacy=0x7f3c100cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:10.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.123+0000 7f3c14d04640 1 -- 172.21.15.55:0/2659552412 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1006d380 con 0x7f3c100ca110 2023-08-25T05:37:10.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.123+0000 7f3c0f7fe640 1 -- 172.21.15.55:0/2659552412 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871719605 0 0) 0x7f3c100cdbf0 con 0x7f3c10158e10 2023-08-25T05:37:10.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.123+0000 7f3c14d04640 1 --2- 172.21.15.55:0/2659552412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c100ca110 0x7f3c100b2d30 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009d90 tx=0x7f3c0801da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b2ad4342530693 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:10.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.123+0000 7f3c0f7fe640 1 -- 172.21.15.55:0/2659552412 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c080a6aa0 con 0x7f3c100ca110 2023-08-25T05:37:10.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.123+0000 7f3c0f7fe640 1 -- 172.21.15.55:0/2659552412 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c080a6c00 con 0x7f3c100ca110 2023-08-25T05:37:10.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.123+0000 7f3c0f7fe640 1 -- 172.21.15.55:0/2659552412 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c080ae440 con 0x7f3c100ca110 2023-08-25T05:37:10.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c16767640 1 -- 172.21.15.55:0/2659552412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c100ca110 msgr2=0x7f3c100b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:10.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c16767640 1 --2- 172.21.15.55:0/2659552412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c100ca110 0x7f3c100b2d30 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009d90 tx=0x7f3c0801da60 comp rx=0 tx=0).stop 2023-08-25T05:37:10.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c16767640 1 -- 172.21.15.55:0/2659552412 shutdown_connections 2023-08-25T05:37:10.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c16767640 1 --2- 172.21.15.55:0/2659552412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c100ca110 0x7f3c100b2d30 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:10.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c16767640 1 -- 172.21.15.55:0/2659552412 >> 172.21.15.55:0/2659552412 conn(0x7f3c10069d00 msgr2=0x7f3c1006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:10.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c16767640 1 -- 172.21.15.55:0/2659552412 shutdown_connections 2023-08-25T05:37:10.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c16767640 1 -- 172.21.15.55:0/2659552412 wait complete. 2023-08-25T05:37:10.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c16767640 1 Processor -- start 2023-08-25T05:37:10.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c16767640 1 -- start start 2023-08-25T05:37:10.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c16767640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c100ca110 0x7f3c101556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:10.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c16767640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c100cb2a0 0x7f3c100b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c16767640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c10158e10 0x7f3c100b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c16767640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c101542f0 con 0x7f3c100ca110 2023-08-25T05:37:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c16767640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c100b1360 con 0x7f3c100cb2a0 2023-08-25T05:37:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c16767640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c10153ae0 con 0x7f3c10158e10 2023-08-25T05:37:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c0ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c100ca110 0x7f3c101556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c0ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c100ca110 0x7f3c101556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60668/0 (socket says 172.21.15.55:60668) 2023-08-25T05:37:10.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c0ffff640 1 -- 172.21.15.55:0/1257057995 learned_addr learned my addr 172.21.15.55:0/1257057995 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:10.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c07fff640 1 --2- 172.21.15.55:0/1257057995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c100cb2a0 0x7f3c100b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:10.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c14d04640 1 --2- 172.21.15.55:0/1257057995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c10158e10 0x7f3c100b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:10.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.127+0000 7f3c0ffff640 1 -- 172.21.15.55:0/1257057995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c10158e10 msgr2=0x7f3c100b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:10.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.131+0000 7f3c0ffff640 1 --2- 172.21.15.55:0/1257057995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c10158e10 0x7f3c100b1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:10.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.131+0000 7f3c0ffff640 1 -- 172.21.15.55:0/1257057995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c100cb2a0 msgr2=0x7f3c100b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:10.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.131+0000 7f3c0ffff640 1 --2- 172.21.15.55:0/1257057995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c100cb2a0 0x7f3c100b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:10.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.131+0000 7f3c0ffff640 1 -- 172.21.15.55:0/1257057995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c08009a70 con 0x7f3c100ca110 2023-08-25T05:37:10.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.131+0000 7f3c0ffff640 1 --2- 172.21.15.55:0/1257057995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c100ca110 0x7f3c101556e0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000c410 tx=0x7f3c0000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:10.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.131+0000 7f3c0d7fa640 1 -- 172.21.15.55:0/1257057995 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c000074e0 con 0x7f3c100ca110 2023-08-25T05:37:10.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.131+0000 7f3c0d7fa640 1 -- 172.21.15.55:0/1257057995 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c00007640 con 0x7f3c100ca110 2023-08-25T05:37:10.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.131+0000 7f3c0d7fa640 1 -- 172.21.15.55:0/1257057995 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00004a30 con 0x7f3c100ca110 2023-08-25T05:37:10.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.131+0000 7f3c16767640 1 -- 172.21.15.55:0/1257057995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c10159370 con 0x7f3c100ca110 2023-08-25T05:37:10.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.131+0000 7f3c16767640 1 -- 172.21.15.55:0/1257057995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c10153d30 con 0x7f3c100ca110 2023-08-25T05:37:10.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.131+0000 7f3c16767640 1 -- 172.21.15.55:0/1257057995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c1004dbe0 con 0x7f3c100ca110 2023-08-25T05:37:10.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.131+0000 7f3c0d7fa640 1 -- 172.21.15.55:0/1257057995 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f3c00004b90 con 0x7f3c100ca110 2023-08-25T05:37:10.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.131+0000 7f3c0d7fa640 1 --2- 172.21.15.55:0/1257057995 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f3bf0065710 0x7f3bf0067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:10.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.135+0000 7f3c0d7fa640 1 -- 172.21.15.55:0/1257057995 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6908+0+0 (secure 0 0 0) 0x7f3c00082fa0 con 0x7f3c100ca110 2023-08-25T05:37:10.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.135+0000 7f3c07fff640 1 --2- 172.21.15.55:0/1257057995 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f3bf0065710 0x7f3bf0067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:10.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.135+0000 7f3c07fff640 1 --2- 172.21.15.55:0/1257057995 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f3bf0065710 0x7f3bf0067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3c100b11c0 tx=0x7f3bf8009040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:10.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.139+0000 7f3c0d7fa640 1 -- 172.21.15.55:0/1257057995 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3c000506b0 con 0x7f3c100ca110 2023-08-25T05:37:10.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.327+0000 7f3c16767640 1 -- 172.21.15.55:0/1257057995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3c100c1910 con 0x7f3c100ca110 2023-08-25T05:37:10.328 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-08-25T05:37:10.327+0000 7f7f18c38640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-25T05:37:10.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.335+0000 7f3c0d7fa640 1 -- 172.21.15.55:0/1257057995 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v92) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3c00053cd0 con 0x7f3c100ca110 2023-08-25T05:37:10.336 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-25T05:37:10.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.335+0000 7f3c16767640 1 -- 172.21.15.55:0/1257057995 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f3bf0065710 msgr2=0x7f3bf0067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:10.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.335+0000 7f3c16767640 1 --2- 172.21.15.55:0/1257057995 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f3bf0065710 0x7f3bf0067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3c100b11c0 tx=0x7f3bf8009040 comp rx=0 tx=0).stop 2023-08-25T05:37:10.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.335+0000 7f3c16767640 1 -- 172.21.15.55:0/1257057995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c100ca110 msgr2=0x7f3c101556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:10.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.335+0000 7f3c16767640 1 --2- 172.21.15.55:0/1257057995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c100ca110 0x7f3c101556e0 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000c410 tx=0x7f3c0000c8d0 comp rx=0 tx=0).stop 2023-08-25T05:37:10.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.335+0000 7f3c16767640 1 -- 172.21.15.55:0/1257057995 shutdown_connections 2023-08-25T05:37:10.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.335+0000 7f3c16767640 1 --2- 172.21.15.55:0/1257057995 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f3bf0065710 0x7f3bf0067bd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:10.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.335+0000 7f3c16767640 1 --2- 172.21.15.55:0/1257057995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c10158e10 0x7f3c100b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:10.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.335+0000 7f3c16767640 1 --2- 172.21.15.55:0/1257057995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c100cb2a0 0x7f3c100b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:10.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.335+0000 7f3c16767640 1 --2- 172.21.15.55:0/1257057995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c100ca110 0x7f3c101556e0 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:10.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.335+0000 7f3c16767640 1 -- 172.21.15.55:0/1257057995 >> 172.21.15.55:0/1257057995 conn(0x7f3c10069d00 msgr2=0x7f3c100ac9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:10.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.339+0000 7f3c16767640 1 -- 172.21.15.55:0/1257057995 shutdown_connections 2023-08-25T05:37:10.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.339+0000 7f3c16767640 1 -- 172.21.15.55:0/1257057995 wait complete. 2023-08-25T05:37:10.367 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-25T05:37:10.410 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T05:37:10.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.515+0000 7f0c67ed8640 1 Processor -- start 2023-08-25T05:37:10.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.515+0000 7f0c67ed8640 1 -- start start 2023-08-25T05:37:10.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.515+0000 7f0c67ed8640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0c600ad7b0 0x7f0c6006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:10.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.515+0000 7f0c67ed8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c60164b30 0x7f0c600c1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:10.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c67ed8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0c600c18d0 0x7f0c600cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:10.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c67ed8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c600c1d60 con 0x7f0c600c18d0 2023-08-25T05:37:10.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c67ed8640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c60161440 con 0x7f0c600ad7b0 2023-08-25T05:37:10.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c67ed8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6006cb20 con 0x7f0c60164b30 2023-08-25T05:37:10.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c66475640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0c600c18d0 0x7f0c600cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:10.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c66475640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0c600c18d0 0x7f0c600cadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60696/0 (socket says 172.21.15.55:60696) 2023-08-25T05:37:10.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c66475640 1 -- 172.21.15.55:0/4142372014 learned_addr learned my addr 172.21.15.55:0/4142372014 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:10.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c65c74640 1 --2- 172.21.15.55:0/4142372014 >> v2:172.21.15.110:3300/0 conn(0x7f0c600ad7b0 0x7f0c6006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:10.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c65473640 1 --2- 172.21.15.55:0/4142372014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c60164b30 0x7f0c600c1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:10.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c66475640 1 -- 172.21.15.55:0/4142372014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c60164b30 msgr2=0x7f0c600c1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:10.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c66475640 1 --2- 172.21.15.55:0/4142372014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c60164b30 0x7f0c600c1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:10.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c66475640 1 -- 172.21.15.55:0/4142372014 >> v2:172.21.15.110:3300/0 conn(0x7f0c600ad7b0 msgr2=0x7f0c6006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:10.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c66475640 1 --2- 172.21.15.55:0/4142372014 >> v2:172.21.15.110:3300/0 conn(0x7f0c600ad7b0 0x7f0c6006c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:10.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c66475640 1 -- 172.21.15.55:0/4142372014 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6006ce00 con 0x7f0c600c18d0 2023-08-25T05:37:10.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c65473640 1 --2- 172.21.15.55:0/4142372014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c60164b30 0x7f0c600c1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:10.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c66475640 1 --2- 172.21.15.55:0/4142372014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c600c18d0 0x7f0c600cadd0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f0c6006dbe0 tx=0x7f0c5801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c967c729d2ed2d93 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:10.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c64c72640 1 -- 172.21.15.55:0/4142372014 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c580af400 con 0x7f0c600c18d0 2023-08-25T05:37:10.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c64c72640 1 -- 172.21.15.55:0/4142372014 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c580ab050 con 0x7f0c600c18d0 2023-08-25T05:37:10.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.519+0000 7f0c64c72640 1 -- 172.21.15.55:0/4142372014 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c580af780 con 0x7f0c600c18d0 2023-08-25T05:37:10.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c67ed8640 1 -- 172.21.15.55:0/4142372014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c600c18d0 msgr2=0x7f0c600cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:10.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c67ed8640 1 --2- 172.21.15.55:0/4142372014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c600c18d0 0x7f0c600cadd0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7f0c6006dbe0 tx=0x7f0c5801f1c0 comp rx=0 tx=0).stop 2023-08-25T05:37:10.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c67ed8640 1 -- 172.21.15.55:0/4142372014 shutdown_connections 2023-08-25T05:37:10.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c67ed8640 1 --2- 172.21.15.55:0/4142372014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c600c18d0 0x7f0c600cadd0 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:10.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c67ed8640 1 --2- 172.21.15.55:0/4142372014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c60164b30 0x7f0c600c1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:10.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c67ed8640 1 --2- 172.21.15.55:0/4142372014 >> v2:172.21.15.110:3300/0 conn(0x7f0c600ad7b0 0x7f0c6006c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:10.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c67ed8640 1 -- 172.21.15.55:0/4142372014 >> 172.21.15.55:0/4142372014 conn(0x7f0c60069900 msgr2=0x7f0c60069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:10.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c67ed8640 1 -- 172.21.15.55:0/4142372014 shutdown_connections 2023-08-25T05:37:10.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c67ed8640 1 -- 172.21.15.55:0/4142372014 wait complete. 2023-08-25T05:37:10.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c67ed8640 1 Processor -- start 2023-08-25T05:37:10.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c67ed8640 1 -- start start 2023-08-25T05:37:10.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c67ed8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c600ad7b0 0x7f0c6015f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:10.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c67ed8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c600c18d0 0x7f0c60162fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:10.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c67ed8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c60164b30 0x7f0c601634e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:10.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c67ed8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c60162be0 con 0x7f0c60164b30 2023-08-25T05:37:10.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c67ed8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600af3b0 con 0x7f0c600c18d0 2023-08-25T05:37:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c67ed8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600ae7a0 con 0x7f0c600ad7b0 2023-08-25T05:37:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c66475640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c60164b30 0x7f0c601634e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c66475640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c60164b30 0x7f0c601634e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60712/0 (socket says 172.21.15.55:60712) 2023-08-25T05:37:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c66475640 1 -- 172.21.15.55:0/2101313064 learned_addr learned my addr 172.21.15.55:0/2101313064 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c65c74640 1 --2- 172.21.15.55:0/2101313064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c600ad7b0 0x7f0c6015f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.523+0000 7f0c65473640 1 --2- 172.21.15.55:0/2101313064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c600c18d0 0x7f0c60162fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:10.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.527+0000 7f0c66475640 1 -- 172.21.15.55:0/2101313064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c600ad7b0 msgr2=0x7f0c6015f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:10.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.527+0000 7f0c66475640 1 --2- 172.21.15.55:0/2101313064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c600ad7b0 0x7f0c6015f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:10.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.527+0000 7f0c66475640 1 -- 172.21.15.55:0/2101313064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c600c18d0 msgr2=0x7f0c60162fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:10.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.527+0000 7f0c66475640 1 --2- 172.21.15.55:0/2101313064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c600c18d0 0x7f0c60162fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:10.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.527+0000 7f0c66475640 1 -- 172.21.15.55:0/2101313064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c58009b30 con 0x7f0c60164b30 2023-08-25T05:37:10.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.527+0000 7f0c66475640 1 --2- 172.21.15.55:0/2101313064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c60164b30 0x7f0c601634e0 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f0c580b2040 tx=0x7f0c5801bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:10.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.527+0000 7f0c567fc640 1 -- 172.21.15.55:0/2101313064 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c580afdc0 con 0x7f0c60164b30 2023-08-25T05:37:10.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.527+0000 7f0c567fc640 1 -- 172.21.15.55:0/2101313064 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c58009510 con 0x7f0c60164b30 2023-08-25T05:37:10.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.527+0000 7f0c67ed8640 1 -- 172.21.15.55:0/2101313064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c600aea80 con 0x7f0c60164b30 2023-08-25T05:37:10.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.527+0000 7f0c567fc640 1 -- 172.21.15.55:0/2101313064 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c580ba660 con 0x7f0c60164b30 2023-08-25T05:37:10.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.527+0000 7f0c67ed8640 1 -- 172.21.15.55:0/2101313064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c600af040 con 0x7f0c60164b30 2023-08-25T05:37:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.527+0000 7f0c67ed8640 1 -- 172.21.15.55:0/2101313064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c600c5c30 con 0x7f0c60164b30 2023-08-25T05:37:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.527+0000 7f0c567fc640 1 -- 172.21.15.55:0/2101313064 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 115) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f0c580b6040 con 0x7f0c60164b30 2023-08-25T05:37:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.527+0000 7f0c567fc640 1 --2- 172.21.15.55:0/2101313064 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f0c44065710 0x7f0c44067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:10.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.527+0000 7f0c567fc640 1 -- 172.21.15.55:0/2101313064 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6950+0+0 (secure 0 0 0) 0x7f0c581214b0 con 0x7f0c60164b30 2023-08-25T05:37:10.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.531+0000 7f0c65c74640 1 --2- 172.21.15.55:0/2101313064 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f0c44065710 0x7f0c44067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:10.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.531+0000 7f0c65c74640 1 --2- 172.21.15.55:0/2101313064 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f0c44065710 0x7f0c44067bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c006fd0 tx=0x7f0c5c008040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:10.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.531+0000 7f0c567fc640 1 -- 172.21.15.55:0/2101313064 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0c580eeaa0 con 0x7f0c60164b30 2023-08-25T05:37:10.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:10.719+0000 7f0c67ed8640 1 -- 172.21.15.55:0/2101313064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0c60073ec0 con 0x7f0c60164b30 2023-08-25T05:37:11.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.423+0000 7f0c567fc640 1 -- 172.21.15.55:0/2101313064 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f0c580eee70 con 0x7f0c60164b30 2023-08-25T05:37:11.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.423+0000 7f0c567fc640 1 -- 172.21.15.55:0/2101313064 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v93) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0c58105c70 con 0x7f0c60164b30 2023-08-25T05:37:11.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.427+0000 7f0c67ed8640 1 -- 172.21.15.55:0/2101313064 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f0c44065710 msgr2=0x7f0c44067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:11.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.427+0000 7f0c67ed8640 1 --2- 172.21.15.55:0/2101313064 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f0c44065710 0x7f0c44067bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c006fd0 tx=0x7f0c5c008040 comp rx=0 tx=0).stop 2023-08-25T05:37:11.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.427+0000 7f0c67ed8640 1 -- 172.21.15.55:0/2101313064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c60164b30 msgr2=0x7f0c601634e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:11.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.427+0000 7f0c67ed8640 1 --2- 172.21.15.55:0/2101313064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c60164b30 0x7f0c601634e0 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7f0c580b2040 tx=0x7f0c5801bf60 comp rx=0 tx=0).stop 2023-08-25T05:37:11.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.427+0000 7f0c67ed8640 1 -- 172.21.15.55:0/2101313064 shutdown_connections 2023-08-25T05:37:11.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.427+0000 7f0c67ed8640 1 --2- 172.21.15.55:0/2101313064 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f0c44065710 0x7f0c44067bd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:11.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.427+0000 7f0c67ed8640 1 --2- 172.21.15.55:0/2101313064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c60164b30 0x7f0c601634e0 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:11.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.427+0000 7f0c67ed8640 1 --2- 172.21.15.55:0/2101313064 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c600c18d0 0x7f0c60162fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:11.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.427+0000 7f0c67ed8640 1 --2- 172.21.15.55:0/2101313064 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c600ad7b0 0x7f0c6015f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:11.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.427+0000 7f0c67ed8640 1 -- 172.21.15.55:0/2101313064 >> 172.21.15.55:0/2101313064 conn(0x7f0c60069900 msgr2=0x7f0c60160910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:11.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.427+0000 7f0c67ed8640 1 -- 172.21.15.55:0/2101313064 shutdown_connections 2023-08-25T05:37:11.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.427+0000 7f0c67ed8640 1 -- 172.21.15.55:0/2101313064 wait complete. 2023-08-25T05:37:11.452 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-25T05:37:11.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.647+0000 7f6060893640 1 Processor -- start 2023-08-25T05:37:11.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.651+0000 7f6060893640 1 -- start start 2023-08-25T05:37:11.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.651+0000 7f6060893640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f605c069900 0x7f605c161070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:11.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.651+0000 7f6060893640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f605c071500 0x7f605c0c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:11.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.651+0000 7f6060893640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605c069d60 con 0x7f605c06e690 2023-08-25T05:37:11.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.651+0000 7f6060893640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605c06b370 con 0x7f605c071500 2023-08-25T05:37:11.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.651+0000 7f6060893640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c071070 con 0x7f605c069900 2023-08-25T05:37:11.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.651+0000 7f605ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f605c071500 0x7f605c0c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:11.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.651+0000 7f605a59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f605c06e690 0x7f605c06ea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43554/0 (socket says 172.21.15.55:43554) 2023-08-25T05:37:11.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.651+0000 7f605a59c640 1 -- 172.21.15.55:0/3884666595 learned_addr learned my addr 172.21.15.55:0/3884666595 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:11.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.651+0000 7f6053fff640 1 --2- 172.21.15.55:0/3884666595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f605c069900 0x7f605c161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:11.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.651+0000 7f605ad9d640 1 -- 172.21.15.55:0/3884666595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f605c069900 msgr2=0x7f605c161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:11.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.651+0000 7f605ad9d640 1 --2- 172.21.15.55:0/3884666595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f605c069900 0x7f605c161070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:11.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.651+0000 7f605ad9d640 1 -- 172.21.15.55:0/3884666595 >> v1:172.21.15.55:6789/0 conn(0x7f605c06e690 legacy=0x7f605c06ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:11.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.651+0000 7f605ad9d640 1 -- 172.21.15.55:0/3884666595 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c1615b0 con 0x7f605c071500 2023-08-25T05:37:11.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.651+0000 7f6059d9b640 1 -- 172.21.15.55:0/3884666595 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903585901 0 0) 0x7f605c069d60 con 0x7f605c06e690 2023-08-25T05:37:11.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.655+0000 7f605ad9d640 1 --2- 172.21.15.55:0/3884666595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605c071500 0x7f605c0c9be0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f6054009d90 tx=0x7f605401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730eb9294b0380c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:11.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.655+0000 7f6059d9b640 1 -- 172.21.15.55:0/3884666595 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60540a5900 con 0x7f605c071500 2023-08-25T05:37:11.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.655+0000 7f6059d9b640 1 -- 172.21.15.55:0/3884666595 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60540a5a60 con 0x7f605c071500 2023-08-25T05:37:11.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.655+0000 7f6059d9b640 1 -- 172.21.15.55:0/3884666595 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60540a5df0 con 0x7f605c071500 2023-08-25T05:37:11.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.655+0000 7f6060893640 1 -- 172.21.15.55:0/3884666595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605c071500 msgr2=0x7f605c0c9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:11.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.655+0000 7f6060893640 1 --2- 172.21.15.55:0/3884666595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605c071500 0x7f605c0c9be0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f6054009d90 tx=0x7f605401c950 comp rx=0 tx=0).stop 2023-08-25T05:37:11.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.655+0000 7f6060893640 1 -- 172.21.15.55:0/3884666595 shutdown_connections 2023-08-25T05:37:11.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.655+0000 7f6060893640 1 --2- 172.21.15.55:0/3884666595 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f605c069900 0x7f605c161070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:11.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.655+0000 7f6060893640 1 --2- 172.21.15.55:0/3884666595 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605c071500 0x7f605c0c9be0 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:11.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.655+0000 7f6060893640 1 -- 172.21.15.55:0/3884666595 >> 172.21.15.55:0/3884666595 conn(0x7f605c0cc010 msgr2=0x7f605c0cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:11.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.655+0000 7f6060893640 1 -- 172.21.15.55:0/3884666595 shutdown_connections 2023-08-25T05:37:11.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.655+0000 7f6060893640 1 -- 172.21.15.55:0/3884666595 wait complete. 2023-08-25T05:37:11.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.655+0000 7f6060893640 1 Processor -- start 2023-08-25T05:37:11.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.655+0000 7f6060893640 1 -- start start 2023-08-25T05:37:11.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f6060893640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f605c069900 0x7f605c155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:11.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f6060893640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f605c06e690 0x7f605c0c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:11.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f6060893640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605c071500 0x7f605c157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:11.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f6060893640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c0b27a0 con 0x7f605c071500 2023-08-25T05:37:11.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f6060893640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c1555f0 con 0x7f605c06e690 2023-08-25T05:37:11.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f6060893640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c0b2220 con 0x7f605c069900 2023-08-25T05:37:11.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f605ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605c071500 0x7f605c157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:11.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f605ad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605c071500 0x7f605c157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33482/0 (socket says 172.21.15.55:33482) 2023-08-25T05:37:11.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f605ad9d640 1 -- 172.21.15.55:0/3487614407 learned_addr learned my addr 172.21.15.55:0/3487614407 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:11.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f6053fff640 1 --2- 172.21.15.55:0/3487614407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f605c06e690 0x7f605c0c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:11.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f605a59c640 1 --2- 172.21.15.55:0/3487614407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f605c069900 0x7f605c155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:11.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f605ad9d640 1 -- 172.21.15.55:0/3487614407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f605c069900 msgr2=0x7f605c155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:11.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f605ad9d640 1 --2- 172.21.15.55:0/3487614407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f605c069900 0x7f605c155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:11.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f605ad9d640 1 -- 172.21.15.55:0/3487614407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f605c06e690 msgr2=0x7f605c0c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:11.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f605ad9d640 1 --2- 172.21.15.55:0/3487614407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f605c06e690 0x7f605c0c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:11.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f605ad9d640 1 -- 172.21.15.55:0/3487614407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6054009a70 con 0x7f605c071500 2023-08-25T05:37:11.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f605a59c640 1 --2- 172.21.15.55:0/3487614407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f605c069900 0x7f605c155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:11.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f605ad9d640 1 --2- 172.21.15.55:0/3487614407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605c071500 0x7f605c157640 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f60540b0040 tx=0x7f60540196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:11.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f6052ffd640 1 -- 172.21.15.55:0/3487614407 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60540b9860 con 0x7f605c071500 2023-08-25T05:37:11.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f6052ffd640 1 -- 172.21.15.55:0/3487614407 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60540a58f0 con 0x7f605c071500 2023-08-25T05:37:11.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f6052ffd640 1 -- 172.21.15.55:0/3487614407 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60540b9be0 con 0x7f605c071500 2023-08-25T05:37:11.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f6060893640 1 -- 172.21.15.55:0/3487614407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605c0b4b30 con 0x7f605c071500 2023-08-25T05:37:11.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f6060893640 1 -- 172.21.15.55:0/3487614407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605c0b4dd0 con 0x7f605c071500 2023-08-25T05:37:11.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.659+0000 7f6060893640 1 -- 172.21.15.55:0/3487614407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605c0b4970 con 0x7f605c071500 2023-08-25T05:37:11.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.663+0000 7f6052ffd640 1 -- 172.21.15.55:0/3487614407 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f60540b9d40 con 0x7f605c071500 2023-08-25T05:37:11.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.663+0000 7f6052ffd640 1 --2- 172.21.15.55:0/3487614407 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f603c0657d0 0x7f603c067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:11.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.663+0000 7f6052ffd640 1 -- 172.21.15.55:0/3487614407 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6950+0+0 (secure 0 0 0) 0x7f605411e040 con 0x7f605c071500 2023-08-25T05:37:11.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.663+0000 7f605a59c640 1 --2- 172.21.15.55:0/3487614407 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f603c0657d0 0x7f603c067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:11.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.663+0000 7f605a59c640 1 --2- 172.21.15.55:0/3487614407 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f603c0657d0 0x7f603c067c90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f604c000f70 tx=0x7f604c009040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:11.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.667+0000 7f6052ffd640 1 -- 172.21.15.55:0/3487614407 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f60540eb670 con 0x7f605c071500 2023-08-25T05:37:11.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:11.823+0000 7f6060893640 1 -- 172.21.15.55:0/3487614407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f605c04dbe0 con 0x7f605c071500 2023-08-25T05:37:12.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.267+0000 7f6052ffd640 1 -- 172.21.15.55:0/3487614407 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v193) v1 ==== 181+0+0 (secure 0 0 0) 0x7f60540eec90 con 0x7f605c071500 2023-08-25T05:37:12.268 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-08-25T05:37:12.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.271+0000 7f6060893640 1 -- 172.21.15.55:0/3487614407 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f603c0657d0 msgr2=0x7f603c067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:12.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.271+0000 7f6060893640 1 --2- 172.21.15.55:0/3487614407 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f603c0657d0 0x7f603c067c90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f604c000f70 tx=0x7f604c009040 comp rx=0 tx=0).stop 2023-08-25T05:37:12.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.271+0000 7f6060893640 1 -- 172.21.15.55:0/3487614407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605c071500 msgr2=0x7f605c157640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:12.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.271+0000 7f6060893640 1 --2- 172.21.15.55:0/3487614407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605c071500 0x7f605c157640 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f60540b0040 tx=0x7f60540196f0 comp rx=0 tx=0).stop 2023-08-25T05:37:12.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.271+0000 7f6060893640 1 -- 172.21.15.55:0/3487614407 shutdown_connections 2023-08-25T05:37:12.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.271+0000 7f6060893640 1 --2- 172.21.15.55:0/3487614407 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f603c0657d0 0x7f603c067c90 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f604c000f70 tx=0x7f604c009040 comp rx=0 tx=0).stop 2023-08-25T05:37:12.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.271+0000 7f6060893640 1 --2- 172.21.15.55:0/3487614407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f605c071500 0x7f605c157640 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:12.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.271+0000 7f6060893640 1 --2- 172.21.15.55:0/3487614407 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f605c06e690 0x7f605c0c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:12.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.271+0000 7f6060893640 1 --2- 172.21.15.55:0/3487614407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f605c069900 0x7f605c155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:12.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.271+0000 7f6060893640 1 -- 172.21.15.55:0/3487614407 >> 172.21.15.55:0/3487614407 conn(0x7f605c0cc010 msgr2=0x7f605c0ad890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:12.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.271+0000 7f6060893640 1 -- 172.21.15.55:0/3487614407 shutdown_connections 2023-08-25T05:37:12.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.271+0000 7f6060893640 1 -- 172.21.15.55:0/3487614407 wait complete. 2023-08-25T05:37:12.296 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-25T05:37:12.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.439+0000 7f8986903640 1 Processor -- start 2023-08-25T05:37:12.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.439+0000 7f8986903640 1 -- start start 2023-08-25T05:37:12.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.443+0000 7f8986903640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f898015c8e0 0x7f89800cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:12.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.443+0000 7f8986903640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89800cda70 0x7f89800c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:12.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.443+0000 7f8986903640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89800c4f40 con 0x7f898006ea10 2023-08-25T05:37:12.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.443+0000 7f8986903640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89800c4d50 con 0x7f898015c8e0 2023-08-25T05:37:12.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.443+0000 7f8986903640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898006eea0 con 0x7f89800cda70 2023-08-25T05:37:12.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.443+0000 7f897ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f898015c8e0 0x7f89800cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:12.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.443+0000 7f897ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f898015c8e0 0x7f89800cc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33490/0 (socket says 172.21.15.55:33490) 2023-08-25T05:37:12.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.443+0000 7f897ffff640 1 -- 172.21.15.55:0/2082521014 learned_addr learned my addr 172.21.15.55:0/2082521014 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:12.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.443+0000 7f8984ea0640 1 --2- 172.21.15.55:0/2082521014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89800cda70 0x7f89800c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:12.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.443+0000 7f897ffff640 1 -- 172.21.15.55:0/2082521014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89800cda70 msgr2=0x7f89800c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:12.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.443+0000 7f897ffff640 1 --2- 172.21.15.55:0/2082521014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89800cda70 0x7f89800c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:12.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.443+0000 7f897ffff640 1 -- 172.21.15.55:0/2082521014 >> v1:172.21.15.110:6789/0 conn(0x7f898006ea10 legacy=0x7f89800cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:12.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.443+0000 7f897ffff640 1 -- 172.21.15.55:0/2082521014 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89800c5220 con 0x7f898015c8e0 2023-08-25T05:37:12.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.443+0000 7f8984ea0640 1 --2- 172.21.15.55:0/2082521014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89800cda70 0x7f89800c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:12.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.447+0000 7f897ffff640 1 --2- 172.21.15.55:0/2082521014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f898015c8e0 0x7f89800cc8e0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f8970009870 tx=0x7f897001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188da961169ff3e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:12.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.447+0000 7f897effd640 1 -- 172.21.15.55:0/2082521014 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89700aa5f0 con 0x7f898015c8e0 2023-08-25T05:37:12.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.447+0000 7f897effd640 1 -- 172.21.15.55:0/2082521014 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89700aa750 con 0x7f898015c8e0 2023-08-25T05:37:12.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.447+0000 7f897effd640 1 -- 172.21.15.55:0/2082521014 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89700aaae0 con 0x7f898015c8e0 2023-08-25T05:37:12.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.447+0000 7f8986903640 1 -- 172.21.15.55:0/2082521014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f898015c8e0 msgr2=0x7f89800cc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:12.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.447+0000 7f8986903640 1 --2- 172.21.15.55:0/2082521014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f898015c8e0 0x7f89800cc8e0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f8970009870 tx=0x7f897001c4d0 comp rx=0 tx=0).stop 2023-08-25T05:37:12.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.447+0000 7f8986903640 1 -- 172.21.15.55:0/2082521014 shutdown_connections 2023-08-25T05:37:12.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.447+0000 7f8986903640 1 --2- 172.21.15.55:0/2082521014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89800cda70 0x7f89800c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:12.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.447+0000 7f8986903640 1 --2- 172.21.15.55:0/2082521014 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f898015c8e0 0x7f89800cc8e0 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:12.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.447+0000 7f8986903640 1 -- 172.21.15.55:0/2082521014 >> 172.21.15.55:0/2082521014 conn(0x7f89800cb790 msgr2=0x7f89800cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:12.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.447+0000 7f8986903640 1 -- 172.21.15.55:0/2082521014 shutdown_connections 2023-08-25T05:37:12.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.447+0000 7f8986903640 1 -- 172.21.15.55:0/2082521014 wait complete. 2023-08-25T05:37:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.447+0000 7f8986903640 1 Processor -- start 2023-08-25T05:37:12.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.447+0000 7f8986903640 1 -- start start 2023-08-25T05:37:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f8986903640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f898006ea10 0x7f89800adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f8986903640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89800cda70 0x7f89800ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f8986903640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f898015c8e0 0x7f8980144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f8986903640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89800abdb0 con 0x7f898015c8e0 2023-08-25T05:37:12.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f8986903640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8980144dc0 con 0x7f89800cda70 2023-08-25T05:37:12.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f8986903640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89800abfc0 con 0x7f898006ea10 2023-08-25T05:37:12.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f8984ea0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f898015c8e0 0x7f8980144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:12.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f897ffff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f898006ea10 0x7f89800adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:12.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f8984ea0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f898015c8e0 0x7f8980144880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33500/0 (socket says 172.21.15.55:33500) 2023-08-25T05:37:12.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f8984ea0640 1 -- 172.21.15.55:0/1062105335 learned_addr learned my addr 172.21.15.55:0/1062105335 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:12.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f897f7fe640 1 --2- 172.21.15.55:0/1062105335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89800cda70 0x7f89800ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:12.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f8984ea0640 1 -- 172.21.15.55:0/1062105335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f898006ea10 msgr2=0x7f89800adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:12.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f8984ea0640 1 --2- 172.21.15.55:0/1062105335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f898006ea10 0x7f89800adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:12.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f8984ea0640 1 -- 172.21.15.55:0/1062105335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89800cda70 msgr2=0x7f89800ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:12.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f8984ea0640 1 --2- 172.21.15.55:0/1062105335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89800cda70 0x7f89800ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:12.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f8984ea0640 1 -- 172.21.15.55:0/1062105335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89700094d0 con 0x7f898015c8e0 2023-08-25T05:37:12.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f8984ea0640 1 --2- 172.21.15.55:0/1062105335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f898015c8e0 0x7f8980144880 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f897800cea0 tx=0x7f897800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:12.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f897cff9640 1 -- 172.21.15.55:0/1062105335 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8978003ba0 con 0x7f898015c8e0 2023-08-25T05:37:12.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f897cff9640 1 -- 172.21.15.55:0/1062105335 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8978003d20 con 0x7f898015c8e0 2023-08-25T05:37:12.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f897cff9640 1 -- 172.21.15.55:0/1062105335 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897800d880 con 0x7f898015c8e0 2023-08-25T05:37:12.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f8986903640 1 -- 172.21.15.55:0/1062105335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89800ac2a0 con 0x7f898015c8e0 2023-08-25T05:37:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f8986903640 1 -- 172.21.15.55:0/1062105335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89800ac860 con 0x7f898015c8e0 2023-08-25T05:37:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f8986903640 1 -- 172.21.15.55:0/1062105335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898004dbe0 con 0x7f898015c8e0 2023-08-25T05:37:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.451+0000 7f897cff9640 1 -- 172.21.15.55:0/1062105335 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f897800d9e0 con 0x7f898015c8e0 2023-08-25T05:37:12.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.455+0000 7f897cff9640 1 --2- 172.21.15.55:0/1062105335 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f896c0657a0 0x7f896c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.455+0000 7f897cff9640 1 -- 172.21.15.55:0/1062105335 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6512+0+0 (secure 0 0 0) 0x7f89780839f0 con 0x7f898015c8e0 2023-08-25T05:37:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.455+0000 7f897ffff640 1 --2- 172.21.15.55:0/1062105335 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f896c0657a0 0x7f896c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:12.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.455+0000 7f897ffff640 1 --2- 172.21.15.55:0/1062105335 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f896c0657a0 0x7f896c067c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f89700ae000 tx=0x7f89700b5040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:12.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.459+0000 7f897cff9640 1 -- 172.21.15.55:0/1062105335 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8978051190 con 0x7f898015c8e0 2023-08-25T05:37:12.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:12.615+0000 7f8986903640 1 -- 172.21.15.55:0/1062105335 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f89800adff0 con 0x7f898015c8e0 2023-08-25T05:37:13.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.439+0000 7f897cff9640 1 -- 172.21.15.55:0/1062105335 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v194) v1 ==== 169+0+0 (secure 0 0 0) 0x7f89780547b0 con 0x7f898015c8e0 2023-08-25T05:37:13.441 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-08-25T05:37:13.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.443+0000 7f8986903640 1 -- 172.21.15.55:0/1062105335 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f896c0657a0 msgr2=0x7f896c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:13.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.443+0000 7f8986903640 1 --2- 172.21.15.55:0/1062105335 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f896c0657a0 0x7f896c067c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f89700ae000 tx=0x7f89700b5040 comp rx=0 tx=0).stop 2023-08-25T05:37:13.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.443+0000 7f8986903640 1 -- 172.21.15.55:0/1062105335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f898015c8e0 msgr2=0x7f8980144880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:13.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.443+0000 7f8986903640 1 --2- 172.21.15.55:0/1062105335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f898015c8e0 0x7f8980144880 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f897800cea0 tx=0x7f897800cf90 comp rx=0 tx=0).stop 2023-08-25T05:37:13.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.443+0000 7f8986903640 1 -- 172.21.15.55:0/1062105335 shutdown_connections 2023-08-25T05:37:13.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.443+0000 7f8986903640 1 --2- 172.21.15.55:0/1062105335 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f896c0657a0 0x7f896c067c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.443+0000 7f8986903640 1 --2- 172.21.15.55:0/1062105335 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f898015c8e0 0x7f8980144880 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.443+0000 7f8986903640 1 --2- 172.21.15.55:0/1062105335 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89800cda70 0x7f89800ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.443+0000 7f8986903640 1 --2- 172.21.15.55:0/1062105335 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f898006ea10 0x7f89800adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.443+0000 7f8986903640 1 -- 172.21.15.55:0/1062105335 >> 172.21.15.55:0/1062105335 conn(0x7f89800cb790 msgr2=0x7f898015bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:13.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.443+0000 7f8986903640 1 -- 172.21.15.55:0/1062105335 shutdown_connections 2023-08-25T05:37:13.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.443+0000 7f8986903640 1 -- 172.21.15.55:0/1062105335 wait complete. 2023-08-25T05:37:13.470 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-08-25T05:37:13.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.619+0000 7f2c0b227640 1 Processor -- start 2023-08-25T05:37:13.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.619+0000 7f2c0b227640 1 -- start start 2023-08-25T05:37:13.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.619+0000 7f2c0b227640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c0415a7f0 0x7f2c0409bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:13.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.619+0000 7f2c0b227640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2c0406c020 0x7f2c040acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:13.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.619+0000 7f2c0b227640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c0415abd0 con 0x7f2c040c9830 2023-08-25T05:37:13.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.619+0000 7f2c0b227640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c040c8ab0 con 0x7f2c0406c020 2023-08-25T05:37:13.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.619+0000 7f2c0b227640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040c8d50 con 0x7f2c0415a7f0 2023-08-25T05:37:13.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.619+0000 7f2c097c4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2c0406c020 0x7f2c040acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:13.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.619+0000 7f2c08fc3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c0415a7f0 0x7f2c0409bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:13.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.619+0000 7f2c097c4640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2c0406c020 0x7f2c040acff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:55408/0 (socket says 172.21.15.55:55408) 2023-08-25T05:37:13.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.619+0000 7f2c097c4640 1 -- 172.21.15.55:0/3261685584 learned_addr learned my addr 172.21.15.55:0/3261685584 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:13.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.619+0000 7f2c097c4640 1 -- 172.21.15.55:0/3261685584 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c0415a7f0 msgr2=0x7f2c0409bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:13.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.619+0000 7f2c097c4640 1 --2- 172.21.15.55:0/3261685584 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c0415a7f0 0x7f2c0409bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.619+0000 7f2c097c4640 1 -- 172.21.15.55:0/3261685584 >> v1:172.21.15.110:6789/0 conn(0x7f2c040c9830 legacy=0x7f2c04070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:13.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.619+0000 7f2c097c4640 1 -- 172.21.15.55:0/3261685584 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c040c9030 con 0x7f2c0406c020 2023-08-25T05:37:13.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.619+0000 7f2c08fc3640 1 --2- 172.21.15.55:0/3261685584 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c0415a7f0 0x7f2c0409bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:13.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.623+0000 7f2c097c4640 1 --2- 172.21.15.55:0/3261685584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c0406c020 0x7f2c040acff0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc009e50 tx=0x7f2bfc01c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=474dd8abf261f575 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:13.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.623+0000 7f2bfb7fe640 1 -- 172.21.15.55:0/3261685584 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc0a56c0 con 0x7f2c0406c020 2023-08-25T05:37:13.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.623+0000 7f2bfb7fe640 1 -- 172.21.15.55:0/3261685584 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bfc0a5820 con 0x7f2c0406c020 2023-08-25T05:37:13.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.623+0000 7f2bfb7fe640 1 -- 172.21.15.55:0/3261685584 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc0a5bb0 con 0x7f2c0406c020 2023-08-25T05:37:13.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.623+0000 7f2c0b227640 1 -- 172.21.15.55:0/3261685584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c0406c020 msgr2=0x7f2c040acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:13.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.623+0000 7f2c0b227640 1 --2- 172.21.15.55:0/3261685584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c0406c020 0x7f2c040acff0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc009e50 tx=0x7f2bfc01c8a0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.623+0000 7f2c0b227640 1 -- 172.21.15.55:0/3261685584 shutdown_connections 2023-08-25T05:37:13.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.623+0000 7f2c0b227640 1 --2- 172.21.15.55:0/3261685584 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c0406c020 0x7f2c040acff0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.623+0000 7f2c0b227640 1 --2- 172.21.15.55:0/3261685584 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c0415a7f0 0x7f2c0409bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.623+0000 7f2c0b227640 1 -- 172.21.15.55:0/3261685584 >> 172.21.15.55:0/3261685584 conn(0x7f2c04069900 msgr2=0x7f2c04069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:13.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.623+0000 7f2c0b227640 1 -- 172.21.15.55:0/3261685584 shutdown_connections 2023-08-25T05:37:13.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.623+0000 7f2c0b227640 1 -- 172.21.15.55:0/3261685584 wait complete. 2023-08-25T05:37:13.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c0b227640 1 Processor -- start 2023-08-25T05:37:13.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c0b227640 1 -- start start 2023-08-25T05:37:13.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c0b227640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c0406c020 0x7f2c04154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:13.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c0b227640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c040c9830 0x7f2c040c2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:13.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c0b227640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c0415a7f0 0x7f2c041580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:13.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c0b227640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0415bb00 con 0x7f2c0406c020 2023-08-25T05:37:13.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c0b227640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0415aef0 con 0x7f2c040c9830 2023-08-25T05:37:13.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c0b227640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0415b1d0 con 0x7f2c0415a7f0 2023-08-25T05:37:13.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c08fc3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c0406c020 0x7f2c04154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:13.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c08fc3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c0406c020 0x7f2c04154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33516/0 (socket says 172.21.15.55:33516) 2023-08-25T05:37:13.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c08fc3640 1 -- 172.21.15.55:0/565078727 learned_addr learned my addr 172.21.15.55:0/565078727 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:13.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2bfbfff640 1 --2- 172.21.15.55:0/565078727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c040c9830 0x7f2c040c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:13.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c097c4640 1 --2- 172.21.15.55:0/565078727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c0415a7f0 0x7f2c041580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:13.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c08fc3640 1 -- 172.21.15.55:0/565078727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c0415a7f0 msgr2=0x7f2c041580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:13.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c08fc3640 1 --2- 172.21.15.55:0/565078727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c0415a7f0 0x7f2c041580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c08fc3640 1 -- 172.21.15.55:0/565078727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c040c9830 msgr2=0x7f2c040c2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:13.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c08fc3640 1 --2- 172.21.15.55:0/565078727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c040c9830 0x7f2c040c2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c08fc3640 1 -- 172.21.15.55:0/565078727 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0000d850 con 0x7f2c0406c020 2023-08-25T05:37:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c08fc3640 1 --2- 172.21.15.55:0/565078727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c0406c020 0x7f2c04154670 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f2c00012fc0 tx=0x7f2c00010490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2bf97fa640 1 -- 172.21.15.55:0/565078727 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000dc00 con 0x7f2c0406c020 2023-08-25T05:37:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2bf97fa640 1 -- 172.21.15.55:0/565078727 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c00013040 con 0x7f2c0406c020 2023-08-25T05:37:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2bf97fa640 1 -- 172.21.15.55:0/565078727 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000d2e0 con 0x7f2c0406c020 2023-08-25T05:37:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c0b227640 1 -- 172.21.15.55:0/565078727 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bfc009b30 con 0x7f2c0406c020 2023-08-25T05:37:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.627+0000 7f2c0b227640 1 -- 172.21.15.55:0/565078727 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c0415b790 con 0x7f2c0406c020 2023-08-25T05:37:13.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.631+0000 7f2c0b227640 1 -- 172.21.15.55:0/565078727 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c0406d5b0 con 0x7f2c0406c020 2023-08-25T05:37:13.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.631+0000 7f2bf97fa640 1 -- 172.21.15.55:0/565078727 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f2c000059a0 con 0x7f2c0406c020 2023-08-25T05:37:13.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.631+0000 7f2bf97fa640 1 --2- 172.21.15.55:0/565078727 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f2bf00657a0 0x7f2bf0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:13.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.631+0000 7f2bf97fa640 1 -- 172.21.15.55:0/565078727 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f2c000875f0 con 0x7f2c0406c020 2023-08-25T05:37:13.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.631+0000 7f2bfbfff640 1 --2- 172.21.15.55:0/565078727 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f2bf00657a0 0x7f2bf0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:13.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.631+0000 7f2bfbfff640 1 --2- 172.21.15.55:0/565078727 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f2bf00657a0 0x7f2bf0067c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2c040c45e0 tx=0x7f2bf400b040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:13.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.635+0000 7f2bf97fa640 1 -- 172.21.15.55:0/565078727 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2c00058900 con 0x7f2c0406c020 2023-08-25T05:37:13.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.791+0000 7f2c0b227640 1 -- 172.21.15.55:0/565078727 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f2c04073ec0 con 0x7f2c0406c020 2023-08-25T05:37:13.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.799+0000 7f2bf97fa640 1 -- 172.21.15.55:0/565078727 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v67) v1 ==== 115+0+0 (secure 0 0 0) 0x7f2c00058490 con 0x7f2c0406c020 2023-08-25T05:37:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.799+0000 7f2c0b227640 1 -- 172.21.15.55:0/565078727 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f2bf00657a0 msgr2=0x7f2bf0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.799+0000 7f2c0b227640 1 --2- 172.21.15.55:0/565078727 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f2bf00657a0 0x7f2bf0067c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2c040c45e0 tx=0x7f2bf400b040 comp rx=0 tx=0).stop 2023-08-25T05:37:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.799+0000 7f2c0b227640 1 -- 172.21.15.55:0/565078727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c0406c020 msgr2=0x7f2c04154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.799+0000 7f2c0b227640 1 --2- 172.21.15.55:0/565078727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c0406c020 0x7f2c04154670 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f2c00012fc0 tx=0x7f2c00010490 comp rx=0 tx=0).stop 2023-08-25T05:37:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.799+0000 7f2c0b227640 1 -- 172.21.15.55:0/565078727 shutdown_connections 2023-08-25T05:37:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.799+0000 7f2c0b227640 1 --2- 172.21.15.55:0/565078727 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f2bf00657a0 0x7f2bf0067c60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.799+0000 7f2c0b227640 1 --2- 172.21.15.55:0/565078727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c0415a7f0 0x7f2c041580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.799+0000 7f2c0b227640 1 --2- 172.21.15.55:0/565078727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c040c9830 0x7f2c040c2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.799+0000 7f2c0b227640 1 --2- 172.21.15.55:0/565078727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c0406c020 0x7f2c04154670 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.799+0000 7f2c0b227640 1 -- 172.21.15.55:0/565078727 >> 172.21.15.55:0/565078727 conn(0x7f2c04069900 msgr2=0x7f2c040b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.799+0000 7f2c0b227640 1 -- 172.21.15.55:0/565078727 shutdown_connections 2023-08-25T05:37:13.804 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.799+0000 7f2c0b227640 1 -- 172.21.15.55:0/565078727 wait complete. 2023-08-25T05:37:13.821 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-25T05:37:13.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.975+0000 7ff56d9db640 1 Processor -- start 2023-08-25T05:37:13.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.975+0000 7ff56d9db640 1 -- start start 2023-08-25T05:37:13.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.975+0000 7ff56d9db640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5681601f0 0x7ff56815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:13.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.975+0000 7ff56d9db640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5680d1290 0x7ff56815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:13.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.975+0000 7ff56d9db640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5680cd5a0 con 0x7ff56815e3c0 2023-08-25T05:37:13.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.975+0000 7ff56d9db640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5680cd880 con 0x7ff5680d1290 2023-08-25T05:37:13.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.975+0000 7ff56d9db640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680cdb60 con 0x7ff5681601f0 2023-08-25T05:37:13.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.975+0000 7ff5677fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5680d1290 0x7ff56815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:13.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.975+0000 7ff5677fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5680d1290 0x7ff56815e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33528/0 (socket says 172.21.15.55:33528) 2023-08-25T05:37:13.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.975+0000 7ff5677fe640 1 -- 172.21.15.55:0/632655266 learned_addr learned my addr 172.21.15.55:0/632655266 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:13.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.975+0000 7ff566ffd640 1 --2- 172.21.15.55:0/632655266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5681601f0 0x7ff56815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:13.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.975+0000 7ff5677fe640 1 -- 172.21.15.55:0/632655266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5681601f0 msgr2=0x7ff56815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:13.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.975+0000 7ff5677fe640 1 --2- 172.21.15.55:0/632655266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5681601f0 0x7ff56815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.975+0000 7ff5677fe640 1 -- 172.21.15.55:0/632655266 >> v1:172.21.15.110:6789/0 conn(0x7ff56815e3c0 legacy=0x7ff5680d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:13.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.975+0000 7ff5677fe640 1 -- 172.21.15.55:0/632655266 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5680cde40 con 0x7ff5680d1290 2023-08-25T05:37:13.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.979+0000 7ff5677fe640 1 --2- 172.21.15.55:0/632655266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5680d1290 0x7ff56815e8a0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7ff560009870 tx=0x7ff56001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e31faa2ede8e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:13.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.979+0000 7ff5667fc640 1 -- 172.21.15.55:0/632655266 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5600a8a30 con 0x7ff5680d1290 2023-08-25T05:37:13.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.979+0000 7ff5667fc640 1 -- 172.21.15.55:0/632655266 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5600a8b90 con 0x7ff5680d1290 2023-08-25T05:37:13.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.979+0000 7ff5667fc640 1 -- 172.21.15.55:0/632655266 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5600b0440 con 0x7ff5680d1290 2023-08-25T05:37:13.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.979+0000 7ff56d9db640 1 -- 172.21.15.55:0/632655266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5680d1290 msgr2=0x7ff56815e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:13.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.979+0000 7ff56d9db640 1 --2- 172.21.15.55:0/632655266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5680d1290 0x7ff56815e8a0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7ff560009870 tx=0x7ff56001ed30 comp rx=0 tx=0).stop 2023-08-25T05:37:13.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.979+0000 7ff56d9db640 1 -- 172.21.15.55:0/632655266 shutdown_connections 2023-08-25T05:37:13.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.979+0000 7ff56d9db640 1 --2- 172.21.15.55:0/632655266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5680d1290 0x7ff56815e8a0 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.979+0000 7ff56d9db640 1 --2- 172.21.15.55:0/632655266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5681601f0 0x7ff56815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.979+0000 7ff56d9db640 1 -- 172.21.15.55:0/632655266 >> 172.21.15.55:0/632655266 conn(0x7ff5680d27d0 msgr2=0x7ff5680d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:13.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.979+0000 7ff56d9db640 1 -- 172.21.15.55:0/632655266 shutdown_connections 2023-08-25T05:37:13.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.979+0000 7ff56d9db640 1 -- 172.21.15.55:0/632655266 wait complete. 2023-08-25T05:37:13.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff56d9db640 1 Processor -- start 2023-08-25T05:37:13.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff56d9db640 1 -- start start 2023-08-25T05:37:13.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff56d9db640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5680d1290 0x7ff5680c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:13.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff56d9db640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff56815e3c0 0x7ff5681f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:13.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff56d9db640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5681601f0 0x7ff5681f5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:13.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff56d9db640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5681f6780 con 0x7ff5680d1290 2023-08-25T05:37:13.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff56d9db640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680c7a40 con 0x7ff56815e3c0 2023-08-25T05:37:13.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff56d9db640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56809f220 con 0x7ff5681601f0 2023-08-25T05:37:13.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff566ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5680d1290 0x7ff5680c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:13.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff566ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5680d1290 0x7ff5680c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33538/0 (socket says 172.21.15.55:33538) 2023-08-25T05:37:13.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff566ffd640 1 -- 172.21.15.55:0/700697804 learned_addr learned my addr 172.21.15.55:0/700697804 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:13.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff5677fe640 1 --2- 172.21.15.55:0/700697804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5681601f0 0x7ff5681f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:13.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff55e7fc640 1 --2- 172.21.15.55:0/700697804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff56815e3c0 0x7ff5681f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:13.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff566ffd640 1 -- 172.21.15.55:0/700697804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5681601f0 msgr2=0x7ff5681f5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:13.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff566ffd640 1 --2- 172.21.15.55:0/700697804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5681601f0 0x7ff5681f5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff566ffd640 1 -- 172.21.15.55:0/700697804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff56815e3c0 msgr2=0x7ff5681f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:13.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff566ffd640 1 --2- 172.21.15.55:0/700697804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff56815e3c0 0x7ff5681f19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:13.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff566ffd640 1 -- 172.21.15.55:0/700697804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5600094d0 con 0x7ff5680d1290 2023-08-25T05:37:13.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff566ffd640 1 --2- 172.21.15.55:0/700697804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5680d1290 0x7ff5680c7500 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7ff55800d7d0 tx=0x7ff55800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:13.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff564ff9640 1 -- 172.21.15.55:0/700697804 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55800b6c0 con 0x7ff5680d1290 2023-08-25T05:37:13.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff564ff9640 1 -- 172.21.15.55:0/700697804 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55800b820 con 0x7ff5680d1290 2023-08-25T05:37:13.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff564ff9640 1 -- 172.21.15.55:0/700697804 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55800bbd0 con 0x7ff5680d1290 2023-08-25T05:37:13.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff56d9db640 1 -- 172.21.15.55:0/700697804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5680ce7c0 con 0x7ff5680d1290 2023-08-25T05:37:13.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.983+0000 7ff56d9db640 1 -- 172.21.15.55:0/700697804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5681f61c0 con 0x7ff5680d1290 2023-08-25T05:37:13.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.987+0000 7ff56d9db640 1 -- 172.21.15.55:0/700697804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff568073ec0 con 0x7ff5680d1290 2023-08-25T05:37:13.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.987+0000 7ff564ff9640 1 -- 172.21.15.55:0/700697804 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7ff55800bd30 con 0x7ff5680d1290 2023-08-25T05:37:13.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.987+0000 7ff564ff9640 1 --2- 172.21.15.55:0/700697804 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7ff5480657a0 0x7ff548067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:13.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.987+0000 7ff564ff9640 1 -- 172.21.15.55:0/700697804 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6070+0+0 (secure 0 0 0) 0x7ff5580833c0 con 0x7ff5680d1290 2023-08-25T05:37:13.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.987+0000 7ff55e7fc640 1 --2- 172.21.15.55:0/700697804 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7ff5480657a0 0x7ff548067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:13.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.987+0000 7ff55e7fc640 1 --2- 172.21.15.55:0/700697804 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7ff5480657a0 0x7ff548067c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff5681531f0 tx=0x7ff550009040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:13.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:13.991+0000 7ff564ff9640 1 -- 172.21.15.55:0/700697804 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff558054800 con 0x7ff5680d1290 2023-08-25T05:37:14.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.147+0000 7ff56d9db640 1 -- 172.21.15.55:0/700697804 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ff5681f6560 con 0x7ff5680d1290 2023-08-25T05:37:14.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.151+0000 7ff564ff9640 1 -- 172.21.15.55:0/700697804 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v68) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff558054390 con 0x7ff5680d1290 2023-08-25T05:37:14.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.155+0000 7ff56d9db640 1 -- 172.21.15.55:0/700697804 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7ff5480657a0 msgr2=0x7ff548067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:14.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.155+0000 7ff56d9db640 1 --2- 172.21.15.55:0/700697804 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7ff5480657a0 0x7ff548067c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff5681531f0 tx=0x7ff550009040 comp rx=0 tx=0).stop 2023-08-25T05:37:14.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.155+0000 7ff56d9db640 1 -- 172.21.15.55:0/700697804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5680d1290 msgr2=0x7ff5680c7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:14.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.155+0000 7ff56d9db640 1 --2- 172.21.15.55:0/700697804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5680d1290 0x7ff5680c7500 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7ff55800d7d0 tx=0x7ff55800dc90 comp rx=0 tx=0).stop 2023-08-25T05:37:14.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.155+0000 7ff56d9db640 1 -- 172.21.15.55:0/700697804 shutdown_connections 2023-08-25T05:37:14.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.155+0000 7ff56d9db640 1 --2- 172.21.15.55:0/700697804 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7ff5480657a0 0x7ff548067c60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.155+0000 7ff56d9db640 1 --2- 172.21.15.55:0/700697804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5681601f0 0x7ff5681f5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.155+0000 7ff56d9db640 1 --2- 172.21.15.55:0/700697804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff56815e3c0 0x7ff5681f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.155+0000 7ff56d9db640 1 --2- 172.21.15.55:0/700697804 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5680d1290 0x7ff5680c7500 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.155+0000 7ff56d9db640 1 -- 172.21.15.55:0/700697804 >> 172.21.15.55:0/700697804 conn(0x7ff5680d27d0 msgr2=0x7ff5680b3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:14.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.155+0000 7ff56d9db640 1 -- 172.21.15.55:0/700697804 shutdown_connections 2023-08-25T05:37:14.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.155+0000 7ff56d9db640 1 -- 172.21.15.55:0/700697804 wait complete. 2023-08-25T05:37:14.175 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-25T05:37:14.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.319+0000 7f181cfd2640 1 Processor -- start 2023-08-25T05:37:14.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.319+0000 7f181cfd2640 1 -- start start 2023-08-25T05:37:14.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.319+0000 7f181cfd2640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f181815ccd0 0x7f18180ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:14.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.319+0000 7f181cfd2640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1818160a70 con 0x7f18180cac70 2023-08-25T05:37:14.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.319+0000 7f181cfd2640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1818160cc0 con 0x7f18181605c0 2023-08-25T05:37:14.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.319+0000 7f181cfd2640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1818161560 con 0x7f181815ccd0 2023-08-25T05:37:14.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.319+0000 7f181659c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f18180cac70 0x7f18180cb050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43564/0 (socket says 172.21.15.55:43564) 2023-08-25T05:37:14.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.319+0000 7f181659c640 1 -- 172.21.15.55:0/693896316 learned_addr learned my addr 172.21.15.55:0/693896316 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:14.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f180dd9b640 1 --2- 172.21.15.55:0/693896316 >> v2:172.21.15.110:3300/0 conn(0x7f181815ccd0 0x7f18180ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:14.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1815d9b640 1 -- 172.21.15.55:0/693896316 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779253986 0 0) 0x7f1818160a70 con 0x7f18180cac70 2023-08-25T05:37:14.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1815d9b640 1 -- 172.21.15.55:0/693896316 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1804003530 con 0x7f18180cac70 2023-08-25T05:37:14.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1815d9b640 1 -- 172.21.15.55:0/693896316 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2061588829 0 0) 0x7f1818160cc0 con 0x7f18181605c0 2023-08-25T05:37:14.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1815d9b640 1 -- 172.21.15.55:0/693896316 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1818160a70 con 0x7f18181605c0 2023-08-25T05:37:14.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1815d9b640 1 -- 172.21.15.55:0/693896316 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 563640379 0 0) 0x7f1804003530 con 0x7f18180cac70 2023-08-25T05:37:14.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1815d9b640 1 -- 172.21.15.55:0/693896316 >> v2:172.21.15.110:3300/0 conn(0x7f181815ccd0 msgr2=0x7f18180ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:14.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1815d9b640 1 --2- 172.21.15.55:0/693896316 >> v2:172.21.15.110:3300/0 conn(0x7f181815ccd0 0x7f18180ceee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1815d9b640 1 -- 172.21.15.55:0/693896316 >> v1:172.21.15.110:6789/0 conn(0x7f18181605c0 legacy=0x7f181815d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:14.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1815d9b640 1 -- 172.21.15.55:0/693896316 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1818160fa0 con 0x7f18180cac70 2023-08-25T05:37:14.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1815d9b640 1 -- 172.21.15.55:0/693896316 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f1808005020 con 0x7f18180cac70 2023-08-25T05:37:14.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f180dd9b640 1 --2- 172.21.15.55:0/693896316 >> v2:172.21.15.110:3300/0 conn(0x7f181815ccd0 0x7f18180ceee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:14.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1815d9b640 1 -- 172.21.15.55:0/693896316 >> v1:172.21.15.55:6789/0 conn(0x7f18180cac70 legacy=0x7f18180cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:14.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1815d9b640 1 --2- 172.21.15.55:0/693896316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1804003b60 0x7f1804003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:14.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1815d9b640 1 --2- 172.21.15.55:0/693896316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18040047d0 0x7f1804004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:14.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1815d9b640 1 --2- 172.21.15.55:0/693896316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1804005190 0x7f180400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:14.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1815d9b640 1 -- 172.21.15.55:0/693896316 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1818161560 con 0x7f1804005190 2023-08-25T05:37:14.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1815d9b640 1 -- 172.21.15.55:0/693896316 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180400bfb0 con 0x7f18040047d0 2023-08-25T05:37:14.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1815d9b640 1 -- 172.21.15.55:0/693896316 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180400c170 con 0x7f1804003b60 2023-08-25T05:37:14.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1816d9d640 1 --2- 172.21.15.55:0/693896316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1804005190 0x7f180400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:14.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f180dd9b640 1 --2- 172.21.15.55:0/693896316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18040047d0 0x7f1804004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:14.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f181659c640 1 --2- 172.21.15.55:0/693896316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1804003b60 0x7f1804003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:14.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1816d9d640 1 -- 172.21.15.55:0/693896316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1804003b60 msgr2=0x7f1804003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:14.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1816d9d640 1 --2- 172.21.15.55:0/693896316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1804003b60 0x7f1804003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1816d9d640 1 -- 172.21.15.55:0/693896316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18040047d0 msgr2=0x7f1804004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:14.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1816d9d640 1 --2- 172.21.15.55:0/693896316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18040047d0 0x7f1804004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f1816d9d640 1 -- 172.21.15.55:0/693896316 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1804003530 con 0x7f1804005190 2023-08-25T05:37:14.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.323+0000 7f181659c640 1 --2- 172.21.15.55:0/693896316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1804003b60 0x7f1804003f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:14.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.327+0000 7f1816d9d640 1 -- 172.21.15.55:0/693896316 reap_dead start 2023-08-25T05:37:14.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.327+0000 7f1816d9d640 1 --2- 172.21.15.55:0/693896316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1804005190 0x7f180400b990 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f18100018d0 tx=0x7f181001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a413666d5d7324 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:14.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.327+0000 7f1815d9b640 1 -- 172.21.15.55:0/693896316 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18100a6040 con 0x7f1804005190 2023-08-25T05:37:14.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.327+0000 7f1815d9b640 1 -- 172.21.15.55:0/693896316 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18100052d0 con 0x7f1804005190 2023-08-25T05:37:14.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.327+0000 7f1815d9b640 1 -- 172.21.15.55:0/693896316 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810003600 con 0x7f1804005190 2023-08-25T05:37:14.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.327+0000 7f181cfd2640 1 -- 172.21.15.55:0/693896316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1804005190 msgr2=0x7f180400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:14.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.327+0000 7f181cfd2640 1 --2- 172.21.15.55:0/693896316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1804005190 0x7f180400b990 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f18100018d0 tx=0x7f181001c560 comp rx=0 tx=0).stop 2023-08-25T05:37:14.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.327+0000 7f181cfd2640 1 -- 172.21.15.55:0/693896316 shutdown_connections 2023-08-25T05:37:14.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.327+0000 7f181cfd2640 1 --2- 172.21.15.55:0/693896316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1804005190 0x7f180400b990 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.327+0000 7f181cfd2640 1 -- 172.21.15.55:0/693896316 >> 172.21.15.55:0/693896316 conn(0x7f18180ce3c0 msgr2=0x7f18180ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:14.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.327+0000 7f181cfd2640 1 -- 172.21.15.55:0/693896316 shutdown_connections 2023-08-25T05:37:14.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.327+0000 7f181cfd2640 1 -- 172.21.15.55:0/693896316 wait complete. 2023-08-25T05:37:14.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.327+0000 7f181cfd2640 1 Processor -- start 2023-08-25T05:37:14.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.327+0000 7f181cfd2640 1 -- start start 2023-08-25T05:37:14.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f181cfd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1804005190 0x7f1818157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:14.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f181cfd2640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f181814cdd0 0x7f18180b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:14.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f181cfd2640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18180b0af0 0x7f18180aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:14.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f181cfd2640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18181f61e0 con 0x7f1804005190 2023-08-25T05:37:14.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f181cfd2640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18180c4d60 con 0x7f18180b0af0 2023-08-25T05:37:14.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f181cfd2640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18180c47a0 con 0x7f181814cdd0 2023-08-25T05:37:14.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f181659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1804005190 0x7f1818157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:14.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f181659c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1804005190 0x7f1818157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33550/0 (socket says 172.21.15.55:33550) 2023-08-25T05:37:14.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f181659c640 1 -- 172.21.15.55:0/1857730925 learned_addr learned my addr 172.21.15.55:0/1857730925 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:14.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f1816d9d640 1 --2- 172.21.15.55:0/1857730925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18180b0af0 0x7f18180aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:14.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f180dd9b640 1 --2- 172.21.15.55:0/1857730925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f181814cdd0 0x7f18180b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:14.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f181659c640 1 -- 172.21.15.55:0/1857730925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f181814cdd0 msgr2=0x7f18180b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:14.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f181659c640 1 --2- 172.21.15.55:0/1857730925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f181814cdd0 0x7f18180b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f181659c640 1 -- 172.21.15.55:0/1857730925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18180b0af0 msgr2=0x7f18180aafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:14.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f181659c640 1 --2- 172.21.15.55:0/1857730925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18180b0af0 0x7f18180aafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f181659c640 1 -- 172.21.15.55:0/1857730925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18180c4a80 con 0x7f1804005190 2023-08-25T05:37:14.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f180dd9b640 1 --2- 172.21.15.55:0/1857730925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f181814cdd0 0x7f18180b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:14.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f181659c640 1 --2- 172.21.15.55:0/1857730925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1804005190 0x7f1818157d30 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f180800e4b0 tx=0x7f180800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:14.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f180f7fe640 1 -- 172.21.15.55:0/1857730925 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18080072e0 con 0x7f1804005190 2023-08-25T05:37:14.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f180f7fe640 1 -- 172.21.15.55:0/1857730925 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1808005460 con 0x7f1804005190 2023-08-25T05:37:14.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f180f7fe640 1 -- 172.21.15.55:0/1857730925 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808005810 con 0x7f1804005190 2023-08-25T05:37:14.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f181cfd2640 1 -- 172.21.15.55:0/1857730925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18180b0090 con 0x7f1804005190 2023-08-25T05:37:14.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f181cfd2640 1 -- 172.21.15.55:0/1857730925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181814c970 con 0x7f1804005190 2023-08-25T05:37:14.337 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f181cfd2640 1 -- 172.21.15.55:0/1857730925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18180afef0 con 0x7f1804005190 2023-08-25T05:37:14.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.331+0000 7f180f7fe640 1 -- 172.21.15.55:0/1857730925 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f1808005970 con 0x7f1804005190 2023-08-25T05:37:14.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.335+0000 7f180f7fe640 1 --2- 172.21.15.55:0/1857730925 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f17f80657d0 0x7f17f8067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:14.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.335+0000 7f180f7fe640 1 -- 172.21.15.55:0/1857730925 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f1808082c80 con 0x7f1804005190 2023-08-25T05:37:14.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.335+0000 7f180dd9b640 1 --2- 172.21.15.55:0/1857730925 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f17f80657d0 0x7f17f8067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:14.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.335+0000 7f180dd9b640 1 --2- 172.21.15.55:0/1857730925 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f17f80657d0 0x7f17f8067c90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f181806cc40 tx=0x7f180000b040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:14.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.339+0000 7f180f7fe640 1 -- 172.21.15.55:0/1857730925 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f18180afef0 con 0x7f1804005190 2023-08-25T05:37:14.499 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.499+0000 7f181cfd2640 1 -- 172.21.15.55:0/1857730925 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f18180afef0 con 0x7f1804005190 2023-08-25T05:37:14.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.503+0000 7f180f7fe640 1 -- 172.21.15.55:0/1857730925 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v69) v1 ==== 104+0+0 (secure 0 0 0) 0x7f18180afef0 con 0x7f1804005190 2023-08-25T05:37:14.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.503+0000 7f181cfd2640 1 -- 172.21.15.55:0/1857730925 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f17f80657d0 msgr2=0x7f17f8067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:14.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.503+0000 7f181cfd2640 1 --2- 172.21.15.55:0/1857730925 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f17f80657d0 0x7f17f8067c90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f181806cc40 tx=0x7f180000b040 comp rx=0 tx=0).stop 2023-08-25T05:37:14.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.503+0000 7f181cfd2640 1 -- 172.21.15.55:0/1857730925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1804005190 msgr2=0x7f1818157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:14.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.503+0000 7f181cfd2640 1 --2- 172.21.15.55:0/1857730925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1804005190 0x7f1818157d30 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f180800e4b0 tx=0x7f180800e970 comp rx=0 tx=0).stop 2023-08-25T05:37:14.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.503+0000 7f181cfd2640 1 -- 172.21.15.55:0/1857730925 shutdown_connections 2023-08-25T05:37:14.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.503+0000 7f181cfd2640 1 --2- 172.21.15.55:0/1857730925 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f17f80657d0 0x7f17f8067c90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.503+0000 7f181cfd2640 1 --2- 172.21.15.55:0/1857730925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f18180b0af0 0x7f18180aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.503+0000 7f181cfd2640 1 --2- 172.21.15.55:0/1857730925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f181814cdd0 0x7f18180b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.503+0000 7f181cfd2640 1 --2- 172.21.15.55:0/1857730925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1804005190 0x7f1818157d30 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.503+0000 7f181cfd2640 1 -- 172.21.15.55:0/1857730925 >> 172.21.15.55:0/1857730925 conn(0x7f18180ce3c0 msgr2=0x7f181815ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:14.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.503+0000 7f181cfd2640 1 -- 172.21.15.55:0/1857730925 shutdown_connections 2023-08-25T05:37:14.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.503+0000 7f181cfd2640 1 -- 172.21.15.55:0/1857730925 wait complete. 2023-08-25T05:37:14.526 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-08-25T05:37:14.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.667+0000 7f550e208640 1 Processor -- start 2023-08-25T05:37:14.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.667+0000 7f550e208640 1 -- start start 2023-08-25T05:37:14.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.667+0000 7f550e208640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55080ae450 0x7f55080cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:14.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.667+0000 7f550e208640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550806cc50 0x7f550806d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:14.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.667+0000 7f550e208640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550806c7c0 con 0x7f55080cdb10 2023-08-25T05:37:14.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.667+0000 7f550e208640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55080ae9a0 con 0x7f55080ae450 2023-08-25T05:37:14.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.667+0000 7f550e208640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55080cb5e0 con 0x7f550806cc50 2023-08-25T05:37:14.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.667+0000 7f5507fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550806cc50 0x7f550806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:14.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.667+0000 7f55077fe640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f55080cdb10 0x7f55080cdef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:49528/0 (socket says 172.21.15.55:49528) 2023-08-25T05:37:14.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.667+0000 7f5506ffd640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55080ae450 0x7f55080cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:14.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.667+0000 7f55077fe640 1 -- 172.21.15.55:0/274066918 learned_addr learned my addr 172.21.15.55:0/274066918 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:14.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.667+0000 7f55067fc640 1 -- 172.21.15.55:0/274066918 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434010935 0 0) 0x7f550806c7c0 con 0x7f55080cdb10 2023-08-25T05:37:14.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.667+0000 7f55067fc640 1 -- 172.21.15.55:0/274066918 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54f0005740 con 0x7f55080cdb10 2023-08-25T05:37:14.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.667+0000 7f5507fff640 1 -- 172.21.15.55:0/274066918 >> v2:172.21.15.110:3300/0 conn(0x7f55080ae450 msgr2=0x7f55080cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:14.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.667+0000 7f5507fff640 1 --2- 172.21.15.55:0/274066918 >> v2:172.21.15.110:3300/0 conn(0x7f55080ae450 0x7f55080cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.667+0000 7f5507fff640 1 -- 172.21.15.55:0/274066918 >> v1:172.21.15.110:6789/0 conn(0x7f55080cdb10 legacy=0x7f55080cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:14.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.667+0000 7f5507fff640 1 -- 172.21.15.55:0/274066918 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55080aec60 con 0x7f550806cc50 2023-08-25T05:37:14.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.667+0000 7f5506ffd640 1 --2- 172.21.15.55:0/274066918 >> v2:172.21.15.110:3300/0 conn(0x7f55080ae450 0x7f55080cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:14.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.671+0000 7f5507fff640 1 --2- 172.21.15.55:0/274066918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550806cc50 0x7f550806d100 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5500009d90 tx=0x7f550001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db4390aaf492c3d4 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:14.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.671+0000 7f55067fc640 1 -- 172.21.15.55:0/274066918 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55000a5a00 con 0x7f550806cc50 2023-08-25T05:37:14.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.671+0000 7f55067fc640 1 -- 172.21.15.55:0/274066918 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55000a5b60 con 0x7f550806cc50 2023-08-25T05:37:14.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.671+0000 7f55067fc640 1 -- 172.21.15.55:0/274066918 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55000ad440 con 0x7f550806cc50 2023-08-25T05:37:14.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.671+0000 7f550e208640 1 -- 172.21.15.55:0/274066918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550806cc50 msgr2=0x7f550806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:14.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.671+0000 7f550e208640 1 --2- 172.21.15.55:0/274066918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550806cc50 0x7f550806d100 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5500009d90 tx=0x7f550001c920 comp rx=0 tx=0).stop 2023-08-25T05:37:14.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.671+0000 7f550e208640 1 -- 172.21.15.55:0/274066918 shutdown_connections 2023-08-25T05:37:14.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.671+0000 7f550e208640 1 --2- 172.21.15.55:0/274066918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550806cc50 0x7f550806d100 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.671+0000 7f550e208640 1 --2- 172.21.15.55:0/274066918 >> v2:172.21.15.110:3300/0 conn(0x7f55080ae450 0x7f55080cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.671+0000 7f550e208640 1 -- 172.21.15.55:0/274066918 >> 172.21.15.55:0/274066918 conn(0x7f55080cf530 msgr2=0x7f55080cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:14.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.671+0000 7f550e208640 1 -- 172.21.15.55:0/274066918 shutdown_connections 2023-08-25T05:37:14.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.671+0000 7f550e208640 1 -- 172.21.15.55:0/274066918 wait complete. 2023-08-25T05:37:14.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f550e208640 1 Processor -- start 2023-08-25T05:37:14.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f550e208640 1 -- start start 2023-08-25T05:37:14.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f550e208640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550806cc50 0x7f550814f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:14.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f550e208640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55080ae450 0x7f55080b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:14.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f550e208640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55080cdb10 0x7f55080b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:14.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f550e208640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550814f300 con 0x7f55080ae450 2023-08-25T05:37:14.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f550e208640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5508150cc0 con 0x7f55080cdb10 2023-08-25T05:37:14.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f550e208640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55080b4a20 con 0x7f550806cc50 2023-08-25T05:37:14.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f5506ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55080ae450 0x7f55080b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:14.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f5506ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55080ae450 0x7f55080b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33560/0 (socket says 172.21.15.55:33560) 2023-08-25T05:37:14.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f5506ffd640 1 -- 172.21.15.55:0/2887845440 learned_addr learned my addr 172.21.15.55:0/2887845440 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:14.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f55077fe640 1 --2- 172.21.15.55:0/2887845440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550806cc50 0x7f550814f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:14.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f5507fff640 1 --2- 172.21.15.55:0/2887845440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55080cdb10 0x7f55080b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:14.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f5506ffd640 1 -- 172.21.15.55:0/2887845440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550806cc50 msgr2=0x7f550814f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:14.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f5506ffd640 1 --2- 172.21.15.55:0/2887845440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550806cc50 0x7f550814f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f5506ffd640 1 -- 172.21.15.55:0/2887845440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55080cdb10 msgr2=0x7f55080b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f5506ffd640 1 --2- 172.21.15.55:0/2887845440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55080cdb10 0x7f55080b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f5506ffd640 1 -- 172.21.15.55:0/2887845440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc009420 con 0x7f55080ae450 2023-08-25T05:37:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f5506ffd640 1 --2- 172.21.15.55:0/2887845440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55080ae450 0x7f55080b1b20 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00ebb0 tx=0x7f54fc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f54effff640 1 -- 172.21.15.55:0/2887845440 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc00eeb0 con 0x7f55080ae450 2023-08-25T05:37:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f54effff640 1 -- 172.21.15.55:0/2887845440 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54fc00cc30 con 0x7f55080ae450 2023-08-25T05:37:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f54effff640 1 -- 172.21.15.55:0/2887845440 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc013470 con 0x7f55080ae450 2023-08-25T05:37:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.675+0000 7f550e208640 1 -- 172.21.15.55:0/2887845440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5500009a70 con 0x7f55080ae450 2023-08-25T05:37:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.679+0000 7f550e208640 1 -- 172.21.15.55:0/2887845440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5508150f30 con 0x7f55080ae450 2023-08-25T05:37:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.679+0000 7f550e208640 1 -- 172.21.15.55:0/2887845440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55080cf1d0 con 0x7f55080ae450 2023-08-25T05:37:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.679+0000 7f54effff640 1 -- 172.21.15.55:0/2887845440 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f54fc0135d0 con 0x7f55080ae450 2023-08-25T05:37:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.679+0000 7f54effff640 1 --2- 172.21.15.55:0/2887845440 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f54f40657a0 0x7f54f4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:14.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.679+0000 7f54effff640 1 -- 172.21.15.55:0/2887845440 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f54fc083290 con 0x7f55080ae450 2023-08-25T05:37:14.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.679+0000 7f55077fe640 1 --2- 172.21.15.55:0/2887845440 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f54f40657a0 0x7f54f4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:14.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.683+0000 7f55077fe640 1 --2- 172.21.15.55:0/2887845440 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f54f40657a0 0x7f54f4067c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f54f80011f0 tx=0x7f54f8007d40 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:14.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.683+0000 7f54effff640 1 -- 172.21.15.55:0/2887845440 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f54fc050c40 con 0x7f55080ae450 2023-08-25T05:37:14.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:14.895+0000 7f550e208640 1 -- 172.21.15.55:0/2887845440 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f550804dbe0 con 0x7f55080ae450 2023-08-25T05:37:15.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.439+0000 7f54effff640 1 -- 172.21.15.55:0/2887845440 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v3067) v1 ==== 163+0+0 (secure 0 0 0) 0x7f54fc054260 con 0x7f55080ae450 2023-08-25T05:37:15.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.443+0000 7f550e208640 1 -- 172.21.15.55:0/2887845440 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f54f40657a0 msgr2=0x7f54f4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:15.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.443+0000 7f550e208640 1 --2- 172.21.15.55:0/2887845440 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f54f40657a0 0x7f54f4067c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f54f80011f0 tx=0x7f54f8007d40 comp rx=0 tx=0).stop 2023-08-25T05:37:15.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.443+0000 7f550e208640 1 -- 172.21.15.55:0/2887845440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55080ae450 msgr2=0x7f55080b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:15.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.443+0000 7f550e208640 1 --2- 172.21.15.55:0/2887845440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55080ae450 0x7f55080b1b20 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f54fc00ebb0 tx=0x7f54fc00c520 comp rx=0 tx=0).stop 2023-08-25T05:37:15.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.443+0000 7f550e208640 1 -- 172.21.15.55:0/2887845440 shutdown_connections 2023-08-25T05:37:15.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.443+0000 7f550e208640 1 --2- 172.21.15.55:0/2887845440 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f54f40657a0 0x7f54f4067c60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:15.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.443+0000 7f550e208640 1 --2- 172.21.15.55:0/2887845440 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55080cdb10 0x7f55080b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:15.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.443+0000 7f550e208640 1 --2- 172.21.15.55:0/2887845440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55080ae450 0x7f55080b1b20 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:15.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.443+0000 7f550e208640 1 --2- 172.21.15.55:0/2887845440 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f550806cc50 0x7f550814f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:15.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.443+0000 7f550e208640 1 -- 172.21.15.55:0/2887845440 >> 172.21.15.55:0/2887845440 conn(0x7f55080cf530 msgr2=0x7f550815c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:15.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.443+0000 7f550e208640 1 -- 172.21.15.55:0/2887845440 shutdown_connections 2023-08-25T05:37:15.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.443+0000 7f550e208640 1 -- 172.21.15.55:0/2887845440 wait complete. 2023-08-25T05:37:15.466 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-08-25T05:37:15.467 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-08-25T05:37:15.467 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-08-25T05:37:15.468 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-08-25T05:37:15.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.611+0000 7f64b3fe1640 1 Processor -- start 2023-08-25T05:37:15.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.611+0000 7f64b3fe1640 1 -- start start 2023-08-25T05:37:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b3fe1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64ac164410 0x7f64ac0b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b3fe1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac0cc510 con 0x7f64ac0c1a80 2023-08-25T05:37:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b3fe1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64ac1647f0 con 0x7f64ac0cddf0 2023-08-25T05:37:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b3fe1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0cc9b0 con 0x7f64ac164410 2023-08-25T05:37:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b257e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f64ac0c1a80 0x7f64ac06bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43578/0 (socket says 172.21.15.55:43578) 2023-08-25T05:37:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b257e640 1 -- 172.21.15.55:0/3480418743 learned_addr learned my addr 172.21.15.55:0/3480418743 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b1d7d640 1 --2- 172.21.15.55:0/3480418743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64ac164410 0x7f64ac0b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b0d7b640 1 -- 172.21.15.55:0/3480418743 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855756210 0 0) 0x7f64ac0cc510 con 0x7f64ac0c1a80 2023-08-25T05:37:15.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b0d7b640 1 -- 172.21.15.55:0/3480418743 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6498003530 con 0x7f64ac0c1a80 2023-08-25T05:37:15.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b0d7b640 1 -- 172.21.15.55:0/3480418743 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3377279263 0 0) 0x7f6498003530 con 0x7f64ac0c1a80 2023-08-25T05:37:15.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b0d7b640 1 -- 172.21.15.55:0/3480418743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64ac164410 msgr2=0x7f64ac0b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:15.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b0d7b640 1 --2- 172.21.15.55:0/3480418743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64ac164410 0x7f64ac0b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:15.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b0d7b640 1 -- 172.21.15.55:0/3480418743 >> v1:172.21.15.110:6789/0 conn(0x7f64ac0cddf0 legacy=0x7f64ac0c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:15.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b0d7b640 1 -- 172.21.15.55:0/3480418743 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac0ccc90 con 0x7f64ac0c1a80 2023-08-25T05:37:15.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b0d7b640 1 -- 172.21.15.55:0/3480418743 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f64a4001a00 con 0x7f64ac0c1a80 2023-08-25T05:37:15.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b0d7b640 1 -- 172.21.15.55:0/3480418743 >> v1:172.21.15.55:6789/0 conn(0x7f64ac0c1a80 legacy=0x7f64ac06bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:15.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b0d7b640 1 --2- 172.21.15.55:0/3480418743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64980039b0 0x7f6498003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:15.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b0d7b640 1 --2- 172.21.15.55:0/3480418743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64ac164410 0x7f64980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:15.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b0d7b640 1 --2- 172.21.15.55:0/3480418743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6498004d10 0x7f6498005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:15.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b0d7b640 1 -- 172.21.15.55:0/3480418743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0cc9b0 con 0x7f6498004d10 2023-08-25T05:37:15.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b0d7b640 1 -- 172.21.15.55:0/3480418743 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649800ba40 con 0x7f64980039b0 2023-08-25T05:37:15.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b0d7b640 1 -- 172.21.15.55:0/3480418743 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649800bc00 con 0x7f64ac164410 2023-08-25T05:37:15.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b257e640 1 --2- 172.21.15.55:0/3480418743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6498004d10 0x7f6498005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:15.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b1d7d640 1 --2- 172.21.15.55:0/3480418743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64980039b0 0x7f6498003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:15.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b157c640 1 --2- 172.21.15.55:0/3480418743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64ac164410 0x7f64980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:15.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b257e640 1 -- 172.21.15.55:0/3480418743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64ac164410 msgr2=0x7f64980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:15.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b257e640 1 --2- 172.21.15.55:0/3480418743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64ac164410 0x7f64980047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:15.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b257e640 1 -- 172.21.15.55:0/3480418743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64980039b0 msgr2=0x7f6498003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:15.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b257e640 1 --2- 172.21.15.55:0/3480418743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64980039b0 0x7f6498003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:15.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.615+0000 7f64b257e640 1 -- 172.21.15.55:0/3480418743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6498003530 con 0x7f6498004d10 2023-08-25T05:37:15.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.619+0000 7f64b257e640 1 --2- 172.21.15.55:0/3480418743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6498004d10 0x7f6498005190 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0b3370 tx=0x7f64a401d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55774148bae2985e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:15.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.619+0000 7f64b0d7b640 1 -- 172.21.15.55:0/3480418743 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a40072d0 con 0x7f6498004d10 2023-08-25T05:37:15.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.619+0000 7f64b0d7b640 1 -- 172.21.15.55:0/3480418743 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a40a8070 con 0x7f6498004d10 2023-08-25T05:37:15.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.619+0000 7f64b0d7b640 1 -- 172.21.15.55:0/3480418743 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a40076b0 con 0x7f6498004d10 2023-08-25T05:37:15.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.619+0000 7f64b3fe1640 1 -- 172.21.15.55:0/3480418743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6498004d10 msgr2=0x7f6498005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:15.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.619+0000 7f64b3fe1640 1 --2- 172.21.15.55:0/3480418743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6498004d10 0x7f6498005190 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0b3370 tx=0x7f64a401d2a0 comp rx=0 tx=0).stop 2023-08-25T05:37:15.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.619+0000 7f64b257e640 1 -- 172.21.15.55:0/3480418743 reap_dead start 2023-08-25T05:37:15.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.619+0000 7f64b3fe1640 1 -- 172.21.15.55:0/3480418743 shutdown_connections 2023-08-25T05:37:15.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.619+0000 7f64b3fe1640 1 -- 172.21.15.55:0/3480418743 >> 172.21.15.55:0/3480418743 conn(0x7f64ac069d00 msgr2=0x7f64ac06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:15.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.619+0000 7f64b3fe1640 1 -- 172.21.15.55:0/3480418743 shutdown_connections 2023-08-25T05:37:15.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.619+0000 7f64b3fe1640 1 -- 172.21.15.55:0/3480418743 wait complete. 2023-08-25T05:37:15.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b3fe1640 1 Processor -- start 2023-08-25T05:37:15.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b3fe1640 1 -- start start 2023-08-25T05:37:15.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b3fe1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6498004d10 0x7f64ac0ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:15.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b3fe1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64ac0af340 0x7f64ac0af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:15.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b3fe1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64ac151bd0 0x7f64ac152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:15.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b3fe1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac1529e0 con 0x7f6498004d10 2023-08-25T05:37:15.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b3fe1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0afce0 con 0x7f64ac0af340 2023-08-25T05:37:15.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b3fe1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ac0affb0 con 0x7f64ac151bd0 2023-08-25T05:37:15.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b1d7d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6498004d10 0x7f64ac0ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:15.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b1d7d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6498004d10 0x7f64ac0ab250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33580/0 (socket says 172.21.15.55:33580) 2023-08-25T05:37:15.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b1d7d640 1 -- 172.21.15.55:0/787029140 learned_addr learned my addr 172.21.15.55:0/787029140 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:15.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b157c640 1 --2- 172.21.15.55:0/787029140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64ac0af340 0x7f64ac0af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:15.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b257e640 1 --2- 172.21.15.55:0/787029140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64ac151bd0 0x7f64ac152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:15.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b1d7d640 1 -- 172.21.15.55:0/787029140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64ac151bd0 msgr2=0x7f64ac152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:15.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b1d7d640 1 --2- 172.21.15.55:0/787029140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64ac151bd0 0x7f64ac152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:15.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b1d7d640 1 -- 172.21.15.55:0/787029140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64ac0af340 msgr2=0x7f64ac0af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:15.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b1d7d640 1 --2- 172.21.15.55:0/787029140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64ac0af340 0x7f64ac0af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:15.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b1d7d640 1 -- 172.21.15.55:0/787029140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ac0b0290 con 0x7f6498004d10 2023-08-25T05:37:15.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b1d7d640 1 --2- 172.21.15.55:0/787029140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6498004d10 0x7f64ac0ab250 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f64a80119d0 tx=0x7f64a8011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:15.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64a27fc640 1 -- 172.21.15.55:0/787029140 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a800fb50 con 0x7f6498004d10 2023-08-25T05:37:15.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64a27fc640 1 -- 172.21.15.55:0/787029140 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a800fcb0 con 0x7f6498004d10 2023-08-25T05:37:15.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64a27fc640 1 -- 172.21.15.55:0/787029140 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8014440 con 0x7f6498004d10 2023-08-25T05:37:15.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b3fe1640 1 -- 172.21.15.55:0/787029140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ac152c80 con 0x7f6498004d10 2023-08-25T05:37:15.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b3fe1640 1 -- 172.21.15.55:0/787029140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ac1525a0 con 0x7f6498004d10 2023-08-25T05:37:15.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.623+0000 7f64b3fe1640 1 -- 172.21.15.55:0/787029140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64ac0cd230 con 0x7f6498004d10 2023-08-25T05:37:15.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.627+0000 7f64a27fc640 1 -- 172.21.15.55:0/787029140 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f64a80145a0 con 0x7f6498004d10 2023-08-25T05:37:15.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.627+0000 7f64a27fc640 1 --2- 172.21.15.55:0/787029140 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f64900657a0 0x7f6490067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:15.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.627+0000 7f64a27fc640 1 -- 172.21.15.55:0/787029140 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f64a8083a30 con 0x7f6498004d10 2023-08-25T05:37:15.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.627+0000 7f64b157c640 1 --2- 172.21.15.55:0/787029140 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f64900657a0 0x7f6490067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:15.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.627+0000 7f64b157c640 1 --2- 172.21.15.55:0/787029140 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f64900657a0 0x7f6490067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0b08b0 tx=0x7f649c009040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:15.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.631+0000 7f64a27fc640 1 -- 172.21.15.55:0/787029140 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f64ac0cd230 con 0x7f6498004d10 2023-08-25T05:37:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:15.839+0000 7f64b3fe1640 1 -- 172.21.15.55:0/787029140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f64ac0cd230 con 0x7f6498004d10 2023-08-25T05:37:16.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.443+0000 7f64a27fc640 1 -- 172.21.15.55:0/787029140 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3068) v1 ==== 158+0+0 (secure 0 0 0) 0x7f64ac0cd230 con 0x7f6498004d10 2023-08-25T05:37:16.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.443+0000 7f64b3fe1640 1 -- 172.21.15.55:0/787029140 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f64900657a0 msgr2=0x7f6490067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:16.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.443+0000 7f64b3fe1640 1 --2- 172.21.15.55:0/787029140 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f64900657a0 0x7f6490067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f64ac0b08b0 tx=0x7f649c009040 comp rx=0 tx=0).stop 2023-08-25T05:37:16.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.443+0000 7f64b3fe1640 1 -- 172.21.15.55:0/787029140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6498004d10 msgr2=0x7f64ac0ab250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:16.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.443+0000 7f64b3fe1640 1 --2- 172.21.15.55:0/787029140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6498004d10 0x7f64ac0ab250 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7f64a80119d0 tx=0x7f64a8011e90 comp rx=0 tx=0).stop 2023-08-25T05:37:16.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.443+0000 7f64b3fe1640 1 -- 172.21.15.55:0/787029140 shutdown_connections 2023-08-25T05:37:16.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.443+0000 7f64b3fe1640 1 --2- 172.21.15.55:0/787029140 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f64900657a0 0x7f6490067c60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:16.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.443+0000 7f64b3fe1640 1 --2- 172.21.15.55:0/787029140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64ac151bd0 0x7f64ac152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:16.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.443+0000 7f64b3fe1640 1 --2- 172.21.15.55:0/787029140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64ac0af340 0x7f64ac0af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:16.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.443+0000 7f64b3fe1640 1 --2- 172.21.15.55:0/787029140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6498004d10 0x7f64ac0ab250 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:16.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.443+0000 7f64b3fe1640 1 -- 172.21.15.55:0/787029140 >> 172.21.15.55:0/787029140 conn(0x7f64ac069d00 msgr2=0x7f64ac0ac020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:16.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.443+0000 7f64b3fe1640 1 -- 172.21.15.55:0/787029140 shutdown_connections 2023-08-25T05:37:16.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.443+0000 7f64b3fe1640 1 -- 172.21.15.55:0/787029140 wait complete. 2023-08-25T05:37:16.470 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:37:16.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.615+0000 7f4a3f219640 1 Processor -- start 2023-08-25T05:37:16.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.615+0000 7f4a3f219640 1 -- start start 2023-08-25T05:37:16.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.615+0000 7f4a3f219640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4a380ce220 0x7f4a380b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:16.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.615+0000 7f4a3f219640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a380b29b0 con 0x7f4a380cdde0 2023-08-25T05:37:16.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.615+0000 7f4a3f219640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a380ce690 con 0x7f4a380d0da0 2023-08-25T05:37:16.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.615+0000 7f4a3f219640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a380b1dc0 con 0x7f4a380ce220 2023-08-25T05:37:16.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.615+0000 7f4a2ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4a380cdde0 0x7f4a380b2e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43592/0 (socket says 172.21.15.55:43592) 2023-08-25T05:37:16.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.615+0000 7f4a2ffff640 1 -- 172.21.15.55:0/4206819144 learned_addr learned my addr 172.21.15.55:0/4206819144 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:16.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.615+0000 7f4a3d7b6640 1 --2- 172.21.15.55:0/4206819144 >> v2:172.21.15.110:3300/0 conn(0x7f4a380ce220 0x7f4a380b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.615+0000 7f4a2f7fe640 1 -- 172.21.15.55:0/4206819144 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860646111 0 0) 0x7f4a380b29b0 con 0x7f4a380cdde0 2023-08-25T05:37:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.615+0000 7f4a2f7fe640 1 -- 172.21.15.55:0/4206819144 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a20003530 con 0x7f4a380cdde0 2023-08-25T05:37:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.615+0000 7f4a3d7b6640 1 -- 172.21.15.55:0/4206819144 >> v1:172.21.15.110:6789/0 conn(0x7f4a380d0da0 legacy=0x7f4a380d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.615+0000 7f4a3d7b6640 1 -- 172.21.15.55:0/4206819144 >> v1:172.21.15.55:6789/0 conn(0x7f4a380cdde0 legacy=0x7f4a380b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:16.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.615+0000 7f4a3d7b6640 1 -- 172.21.15.55:0/4206819144 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a380b2080 con 0x7f4a380ce220 2023-08-25T05:37:16.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.619+0000 7f4a3d7b6640 1 --2- 172.21.15.55:0/4206819144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a380ce220 0x7f4a380b3550 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009d90 tx=0x7f4a3001f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd36e0d346ec06ea server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:16.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.619+0000 7f4a2f7fe640 1 -- 172.21.15.55:0/4206819144 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a300af600 con 0x7f4a380ce220 2023-08-25T05:37:16.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.619+0000 7f4a2f7fe640 1 -- 172.21.15.55:0/4206819144 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a300ab050 con 0x7f4a380ce220 2023-08-25T05:37:16.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.619+0000 7f4a2f7fe640 1 -- 172.21.15.55:0/4206819144 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a300af980 con 0x7f4a380ce220 2023-08-25T05:37:16.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.619+0000 7f4a3f219640 1 -- 172.21.15.55:0/4206819144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a380ce220 msgr2=0x7f4a380b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:16.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.619+0000 7f4a3f219640 1 --2- 172.21.15.55:0/4206819144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a380ce220 0x7f4a380b3550 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f4a30009d90 tx=0x7f4a3001f130 comp rx=0 tx=0).stop 2023-08-25T05:37:16.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.619+0000 7f4a3f219640 1 -- 172.21.15.55:0/4206819144 shutdown_connections 2023-08-25T05:37:16.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.619+0000 7f4a3f219640 1 --2- 172.21.15.55:0/4206819144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a380ce220 0x7f4a380b3550 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:16.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.619+0000 7f4a3f219640 1 -- 172.21.15.55:0/4206819144 >> 172.21.15.55:0/4206819144 conn(0x7f4a3809bae0 msgr2=0x7f4a380d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:16.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.619+0000 7f4a3f219640 1 -- 172.21.15.55:0/4206819144 shutdown_connections 2023-08-25T05:37:16.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.619+0000 7f4a3f219640 1 -- 172.21.15.55:0/4206819144 wait complete. 2023-08-25T05:37:16.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a3f219640 1 Processor -- start 2023-08-25T05:37:16.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a3f219640 1 -- start start 2023-08-25T05:37:16.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a3f219640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a380cdde0 0x7f4a381f4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:16.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a3f219640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a380ce220 0x7f4a380b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:16.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a3f219640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a380d0da0 0x7f4a380caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:16.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a3f219640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a380cbdc0 con 0x7f4a380ce220 2023-08-25T05:37:16.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a3f219640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a380cb1b0 con 0x7f4a380cdde0 2023-08-25T05:37:16.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a3f219640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a380cb490 con 0x7f4a380d0da0 2023-08-25T05:37:16.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a2ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a380ce220 0x7f4a380b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:16.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a2ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a380ce220 0x7f4a380b5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33592/0 (socket says 172.21.15.55:33592) 2023-08-25T05:37:16.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a2ffff640 1 -- 172.21.15.55:0/873371598 learned_addr learned my addr 172.21.15.55:0/873371598 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:16.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a3cfb5640 1 --2- 172.21.15.55:0/873371598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a380cdde0 0x7f4a381f4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:16.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a3d7b6640 1 --2- 172.21.15.55:0/873371598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a380d0da0 0x7f4a380caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:16.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a2ffff640 1 -- 172.21.15.55:0/873371598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a380d0da0 msgr2=0x7f4a380caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:16.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a2ffff640 1 --2- 172.21.15.55:0/873371598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a380d0da0 0x7f4a380caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:16.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a2ffff640 1 -- 172.21.15.55:0/873371598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a380cdde0 msgr2=0x7f4a381f4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:16.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a2ffff640 1 --2- 172.21.15.55:0/873371598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a380cdde0 0x7f4a381f4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:16.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a2ffff640 1 -- 172.21.15.55:0/873371598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a30009a70 con 0x7f4a380ce220 2023-08-25T05:37:16.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a2ffff640 1 --2- 172.21.15.55:0/873371598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a380ce220 0x7f4a380b5df0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800c420 tx=0x7f4a2800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:16.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a2d7fa640 1 -- 172.21.15.55:0/873371598 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28005cf0 con 0x7f4a380ce220 2023-08-25T05:37:16.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a2d7fa640 1 -- 172.21.15.55:0/873371598 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a28005e50 con 0x7f4a380ce220 2023-08-25T05:37:16.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a3f219640 1 -- 172.21.15.55:0/873371598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a380cb770 con 0x7f4a380ce220 2023-08-25T05:37:16.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.623+0000 7f4a2d7fa640 1 -- 172.21.15.55:0/873371598 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a280072d0 con 0x7f4a380ce220 2023-08-25T05:37:16.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.627+0000 7f4a3f219640 1 -- 172.21.15.55:0/873371598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3815a950 con 0x7f4a380ce220 2023-08-25T05:37:16.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.627+0000 7f4a3f219640 1 -- 172.21.15.55:0/873371598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a380b8710 con 0x7f4a380ce220 2023-08-25T05:37:16.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.627+0000 7f4a2d7fa640 1 -- 172.21.15.55:0/873371598 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f4a28007430 con 0x7f4a380ce220 2023-08-25T05:37:16.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.627+0000 7f4a2d7fa640 1 --2- 172.21.15.55:0/873371598 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f4a240657a0 0x7f4a24067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:16.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.627+0000 7f4a2d7fa640 1 -- 172.21.15.55:0/873371598 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f4a28082560 con 0x7f4a380ce220 2023-08-25T05:37:16.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.627+0000 7f4a3cfb5640 1 --2- 172.21.15.55:0/873371598 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f4a240657a0 0x7f4a24067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:16.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.627+0000 7f4a3cfb5640 1 --2- 172.21.15.55:0/873371598 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f4a240657a0 0x7f4a24067c60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a34000fc0 tx=0x7f4a34009040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:16.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.631+0000 7f4a2d7fa640 1 -- 172.21.15.55:0/873371598 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4a2804ff20 con 0x7f4a380ce220 2023-08-25T05:37:16.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.791+0000 7f4a3f219640 1 -- 172.21.15.55:0/873371598 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a3804dbe0 con 0x7f4a380ce220 2023-08-25T05:37:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.791+0000 7f4a2d7fa640 1 -- 172.21.15.55:0/873371598 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+15935 (secure 0 0 0) 0x7f4a28053540 con 0x7f4a380ce220 2023-08-25T05:37:16.794 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:16.795 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":194,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:37:13.421099+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/1879414910":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/2364681532":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/3445363124":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/1365337144":"2023-08-26T05:37:07.154812+0000","172.21.15.55:6835/1770370805":"2023-08-26T05:37:10.329156+0000","172.21.15.110:0/3636080411":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/2719509011":"2023-08-26T05:37:07.154812+0000","172.21.15.110:6833/3676103183":"2023-08-26T05:37:07.154812+0000","172.21.15.110:6832/3676103183":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/4153312762":"2023-08-26T05:35:57.993440+0000","172.21.15.110:6833/3764131781":"2023-08-26T05:35:57.993440+0000","172.21.15.110:6832/3764131781":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/850752631":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/1738610480":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/3196857459":"2023-08-26T05:35:57.993440+0000","172.21.15.55:6833/1770370805":"2023-08-26T05:37:10.329156+0000","172.21.15.110:0/3481018175":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/3113850402":"2023-08-26T05:35:57.993440+0000","172.21.15.110:0/1309145938":"2023-08-26T05:37:07.154812+0000","172.21.15.110:0/2668066062":"2023-08-26T05:35:57.993440+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:37:16.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.795+0000 7f4a3f219640 1 -- 172.21.15.55:0/873371598 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f4a240657a0 msgr2=0x7f4a24067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.795+0000 7f4a3f219640 1 --2- 172.21.15.55:0/873371598 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f4a240657a0 0x7f4a24067c60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4a34000fc0 tx=0x7f4a34009040 comp rx=0 tx=0).stop 2023-08-25T05:37:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.795+0000 7f4a3f219640 1 -- 172.21.15.55:0/873371598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a380ce220 msgr2=0x7f4a380b5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.795+0000 7f4a3f219640 1 --2- 172.21.15.55:0/873371598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a380ce220 0x7f4a380b5df0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800c420 tx=0x7f4a2800c8e0 comp rx=0 tx=0).stop 2023-08-25T05:37:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.795+0000 7f4a3f219640 1 -- 172.21.15.55:0/873371598 shutdown_connections 2023-08-25T05:37:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.795+0000 7f4a3f219640 1 --2- 172.21.15.55:0/873371598 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f4a240657a0 0x7f4a24067c60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.795+0000 7f4a3f219640 1 --2- 172.21.15.55:0/873371598 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4a380d0da0 0x7f4a380caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:16.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.795+0000 7f4a3f219640 1 --2- 172.21.15.55:0/873371598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4a380ce220 0x7f4a380b5df0 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.795+0000 7f4a3f219640 1 --2- 172.21.15.55:0/873371598 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4a380cdde0 0x7f4a381f4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.795+0000 7f4a3f219640 1 -- 172.21.15.55:0/873371598 >> 172.21.15.55:0/873371598 conn(0x7f4a3809bae0 msgr2=0x7f4a380b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.795+0000 7f4a3f219640 1 -- 172.21.15.55:0/873371598 shutdown_connections 2023-08-25T05:37:16.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.795+0000 7f4a3f219640 1 -- 172.21.15.55:0/873371598 wait complete. 2023-08-25T05:37:16.815 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T05:37:16.816 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T05:37:16.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.959+0000 7faa0e40b640 1 Processor -- start 2023-08-25T05:37:16.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.959+0000 7faa0e40b640 1 -- start start 2023-08-25T05:37:16.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.963+0000 7faa0e40b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa080cfc90 0x7faa080b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:16.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.963+0000 7faa0e40b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa080b8330 0x7faa080b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:16.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.963+0000 7faa0e40b640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa080b70c0 con 0x7faa0815fca0 2023-08-25T05:37:16.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.963+0000 7faa0e40b640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa08160080 con 0x7faa080b8330 2023-08-25T05:37:16.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.963+0000 7faa0e40b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa080b73a0 con 0x7faa080cfc90 2023-08-25T05:37:16.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.963+0000 7faa0dc0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa080b8330 0x7faa080b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:16.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.963+0000 7faa0d409640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faa0815fca0 0x7faa080cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43596/0 (socket says 172.21.15.55:43596) 2023-08-25T05:37:16.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.963+0000 7faa0d409640 1 -- 172.21.15.55:0/384348379 learned_addr learned my addr 172.21.15.55:0/384348379 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:16.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.963+0000 7faa0cc08640 1 --2- 172.21.15.55:0/384348379 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa080cfc90 0x7faa080b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:16.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.963+0000 7faa0dc0a640 1 -- 172.21.15.55:0/384348379 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa080cfc90 msgr2=0x7faa080b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:16.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.963+0000 7faa0dc0a640 1 --2- 172.21.15.55:0/384348379 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa080cfc90 0x7faa080b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:16.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.963+0000 7faa0dc0a640 1 -- 172.21.15.55:0/384348379 >> v1:172.21.15.55:6789/0 conn(0x7faa0815fca0 legacy=0x7faa080cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:16.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.963+0000 7faa0dc0a640 1 -- 172.21.15.55:0/384348379 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa080b7680 con 0x7faa080b8330 2023-08-25T05:37:16.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.963+0000 7fa9fffff640 1 -- 172.21.15.55:0/384348379 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136462732 0 0) 0x7faa080b70c0 con 0x7faa0815fca0 2023-08-25T05:37:16.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7faa0dc0a640 1 --2- 172.21.15.55:0/384348379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa080b8330 0x7faa080b5b10 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7faa00009d90 tx=0x7faa0001f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1699326aed3ef63 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:16.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7fa9fffff640 1 -- 172.21.15.55:0/384348379 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000af600 con 0x7faa080b8330 2023-08-25T05:37:16.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7fa9fffff640 1 -- 172.21.15.55:0/384348379 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa000ab050 con 0x7faa080b8330 2023-08-25T05:37:16.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7fa9fffff640 1 -- 172.21.15.55:0/384348379 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000af980 con 0x7faa080b8330 2023-08-25T05:37:16.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7faa0e40b640 1 -- 172.21.15.55:0/384348379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa080b8330 msgr2=0x7faa080b5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:16.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7faa0e40b640 1 --2- 172.21.15.55:0/384348379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa080b8330 0x7faa080b5b10 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7faa00009d90 tx=0x7faa0001f130 comp rx=0 tx=0).stop 2023-08-25T05:37:16.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7faa0e40b640 1 -- 172.21.15.55:0/384348379 shutdown_connections 2023-08-25T05:37:16.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7faa0e40b640 1 --2- 172.21.15.55:0/384348379 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa080cfc90 0x7faa080b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:16.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7faa0e40b640 1 --2- 172.21.15.55:0/384348379 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa080b8330 0x7faa080b5b10 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:16.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7faa0e40b640 1 -- 172.21.15.55:0/384348379 >> 172.21.15.55:0/384348379 conn(0x7faa080658c0 msgr2=0x7faa08065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:16.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7faa0e40b640 1 -- 172.21.15.55:0/384348379 shutdown_connections 2023-08-25T05:37:16.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7faa0e40b640 1 -- 172.21.15.55:0/384348379 wait complete. 2023-08-25T05:37:16.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7faa0e40b640 1 Processor -- start 2023-08-25T05:37:16.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7faa0e40b640 1 -- start start 2023-08-25T05:37:16.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7faa0e40b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa080b8330 0x7faa0814c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:16.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7faa0e40b640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa080cfc90 0x7faa080c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:16.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7faa0e40b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0815fca0 0x7faa0814a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7faa0e40b640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0814f2b0 con 0x7faa0815fca0 2023-08-25T05:37:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7faa0e40b640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0814e0c0 con 0x7faa080cfc90 2023-08-25T05:37:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7faa0e40b640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0814c5f0 con 0x7faa080b8330 2023-08-25T05:37:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.967+0000 7faa0dc0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0815fca0 0x7faa0814a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.971+0000 7faa0dc0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0815fca0 0x7faa0814a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33604/0 (socket says 172.21.15.55:33604) 2023-08-25T05:37:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.971+0000 7faa0dc0a640 1 -- 172.21.15.55:0/4281713944 learned_addr learned my addr 172.21.15.55:0/4281713944 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.971+0000 7faa0cc08640 1 --2- 172.21.15.55:0/4281713944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa080cfc90 0x7faa080c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.971+0000 7faa0d409640 1 --2- 172.21.15.55:0/4281713944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa080b8330 0x7faa0814c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.971+0000 7faa0dc0a640 1 -- 172.21.15.55:0/4281713944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa080b8330 msgr2=0x7faa0814c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.971+0000 7faa0dc0a640 1 --2- 172.21.15.55:0/4281713944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa080b8330 0x7faa0814c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.971+0000 7faa0dc0a640 1 -- 172.21.15.55:0/4281713944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa080cfc90 msgr2=0x7faa080c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.971+0000 7faa0dc0a640 1 --2- 172.21.15.55:0/4281713944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa080cfc90 0x7faa080c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.971+0000 7faa0dc0a640 1 -- 172.21.15.55:0/4281713944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa00009a70 con 0x7faa0815fca0 2023-08-25T05:37:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.971+0000 7faa0dc0a640 1 --2- 172.21.15.55:0/4281713944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0815fca0 0x7faa0814a9a0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7faa000b2040 tx=0x7faa0001bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.971+0000 7fa9fdffb640 1 -- 172.21.15.55:0/4281713944 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000b9610 con 0x7faa0815fca0 2023-08-25T05:37:16.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.971+0000 7fa9fdffb640 1 -- 172.21.15.55:0/4281713944 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa000b9770 con 0x7faa0815fca0 2023-08-25T05:37:16.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.971+0000 7fa9fdffb640 1 -- 172.21.15.55:0/4281713944 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000b9b20 con 0x7faa0815fca0 2023-08-25T05:37:16.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.971+0000 7faa0e40b640 1 -- 172.21.15.55:0/4281713944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa081527f0 con 0x7faa0815fca0 2023-08-25T05:37:16.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.971+0000 7faa0e40b640 1 -- 172.21.15.55:0/4281713944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0814eed0 con 0x7faa0815fca0 2023-08-25T05:37:16.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.971+0000 7faa0e40b640 1 -- 172.21.15.55:0/4281713944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0814f3f0 con 0x7faa0815fca0 2023-08-25T05:37:16.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.971+0000 7fa9fdffb640 1 -- 172.21.15.55:0/4281713944 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7faa000b6050 con 0x7faa0815fca0 2023-08-25T05:37:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.975+0000 7fa9fdffb640 1 --2- 172.21.15.55:0/4281713944 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fa9ec0657a0 0x7fa9ec067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.975+0000 7fa9fdffb640 1 -- 172.21.15.55:0/4281713944 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6070+0+0 (secure 0 0 0) 0x7faa00121680 con 0x7faa0815fca0 2023-08-25T05:37:16.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.975+0000 7faa0d409640 1 --2- 172.21.15.55:0/4281713944 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fa9ec0657a0 0x7fa9ec067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:16.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.975+0000 7faa0d409640 1 --2- 172.21.15.55:0/4281713944 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fa9ec0657a0 0x7fa9ec067c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faa04000f70 tx=0x7faa04007c10 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:16.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:16.979+0000 7fa9fdffb640 1 -- 172.21.15.55:0/4281713944 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7faa000eef00 con 0x7faa0815fca0 2023-08-25T05:37:17.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.135+0000 7faa0e40b640 1 -- 172.21.15.55:0/4281713944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa08073e50 con 0x7faa0815fca0 2023-08-25T05:37:17.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.135+0000 7fa9fdffb640 1 -- 172.21.15.55:0/4281713944 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v194) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa00009450 con 0x7faa0815fca0 2023-08-25T05:37:17.140 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T05:37:17.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.139+0000 7faa0e40b640 1 -- 172.21.15.55:0/4281713944 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fa9ec0657a0 msgr2=0x7fa9ec067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:17.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.139+0000 7faa0e40b640 1 --2- 172.21.15.55:0/4281713944 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fa9ec0657a0 0x7fa9ec067c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faa04000f70 tx=0x7faa04007c10 comp rx=0 tx=0).stop 2023-08-25T05:37:17.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.139+0000 7faa0e40b640 1 -- 172.21.15.55:0/4281713944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0815fca0 msgr2=0x7faa0814a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:17.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.139+0000 7faa0e40b640 1 --2- 172.21.15.55:0/4281713944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0815fca0 0x7faa0814a9a0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7faa000b2040 tx=0x7faa0001bed0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.139+0000 7faa0e40b640 1 -- 172.21.15.55:0/4281713944 shutdown_connections 2023-08-25T05:37:17.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.139+0000 7faa0e40b640 1 --2- 172.21.15.55:0/4281713944 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fa9ec0657a0 0x7fa9ec067c60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.139+0000 7faa0e40b640 1 --2- 172.21.15.55:0/4281713944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa0815fca0 0x7faa0814a9a0 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.139+0000 7faa0e40b640 1 --2- 172.21.15.55:0/4281713944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa080cfc90 0x7faa080c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.139+0000 7faa0e40b640 1 --2- 172.21.15.55:0/4281713944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa080b8330 0x7faa0814c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.139+0000 7faa0e40b640 1 -- 172.21.15.55:0/4281713944 >> 172.21.15.55:0/4281713944 conn(0x7faa080658c0 msgr2=0x7faa080b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:17.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.139+0000 7faa0e40b640 1 -- 172.21.15.55:0/4281713944 shutdown_connections 2023-08-25T05:37:17.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.139+0000 7faa0e40b640 1 -- 172.21.15.55:0/4281713944 wait complete. 2023-08-25T05:37:17.161 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T05:37:17.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.307+0000 7fcc4d38f640 1 Processor -- start 2023-08-25T05:37:17.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.307+0000 7fcc4d38f640 1 -- start start 2023-08-25T05:37:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.307+0000 7fcc4d38f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcc4806c790 0x7fcc480cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.307+0000 7fcc4d38f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc480cab90 con 0x7fcc4806e5a0 2023-08-25T05:37:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.307+0000 7fcc4d38f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4806dbb0 con 0x7fcc4806c3b0 2023-08-25T05:37:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.307+0000 7fcc4d38f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc480cae50 con 0x7fcc4806c790 2023-08-25T05:37:17.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.307+0000 7fcc3ffff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcc4806e5a0 0x7fcc480ce8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43612/0 (socket says 172.21.15.55:43612) 2023-08-25T05:37:17.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.307+0000 7fcc3ffff640 1 -- 172.21.15.55:0/4270498720 learned_addr learned my addr 172.21.15.55:0/4270498720 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:17.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.311+0000 7fcc477fe640 1 --2- 172.21.15.55:0/4270498720 >> v2:172.21.15.55:3300/0 conn(0x7fcc4806c790 0x7fcc480cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:17.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.311+0000 7fcc467fc640 1 -- 172.21.15.55:0/4270498720 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517598273 0 0) 0x7fcc480cab90 con 0x7fcc4806e5a0 2023-08-25T05:37:17.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.311+0000 7fcc467fc640 1 -- 172.21.15.55:0/4270498720 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc34003530 con 0x7fcc4806e5a0 2023-08-25T05:37:17.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.311+0000 7fcc477fe640 1 -- 172.21.15.55:0/4270498720 >> v1:172.21.15.110:6789/0 conn(0x7fcc4806c3b0 legacy=0x7fcc4806de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:17.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.311+0000 7fcc477fe640 1 -- 172.21.15.55:0/4270498720 >> v1:172.21.15.55:6789/0 conn(0x7fcc4806e5a0 legacy=0x7fcc480ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:17.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.311+0000 7fcc477fe640 1 -- 172.21.15.55:0/4270498720 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc480cb130 con 0x7fcc4806c790 2023-08-25T05:37:17.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.311+0000 7fcc477fe640 1 --2- 172.21.15.55:0/4270498720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc4806c790 0x7fcc480cd7d0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009d90 tx=0x7fcc4001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0457dfe63931d9a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:17.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.311+0000 7fcc467fc640 1 -- 172.21.15.55:0/4270498720 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc400a59c0 con 0x7fcc4806c790 2023-08-25T05:37:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.311+0000 7fcc467fc640 1 -- 172.21.15.55:0/4270498720 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc400a5b20 con 0x7fcc4806c790 2023-08-25T05:37:17.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.311+0000 7fcc467fc640 1 -- 172.21.15.55:0/4270498720 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc400ad440 con 0x7fcc4806c790 2023-08-25T05:37:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc4d38f640 1 -- 172.21.15.55:0/4270498720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc4806c790 msgr2=0x7fcc480cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc4d38f640 1 --2- 172.21.15.55:0/4270498720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc4806c790 0x7fcc480cd7d0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009d90 tx=0x7fcc4001c920 comp rx=0 tx=0).stop 2023-08-25T05:37:17.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc4d38f640 1 -- 172.21.15.55:0/4270498720 shutdown_connections 2023-08-25T05:37:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc4d38f640 1 --2- 172.21.15.55:0/4270498720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc4806c790 0x7fcc480cd7d0 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc4d38f640 1 -- 172.21.15.55:0/4270498720 >> 172.21.15.55:0/4270498720 conn(0x7fcc480d0540 msgr2=0x7fcc480d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc4d38f640 1 -- 172.21.15.55:0/4270498720 shutdown_connections 2023-08-25T05:37:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc4d38f640 1 -- 172.21.15.55:0/4270498720 wait complete. 2023-08-25T05:37:17.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc4d38f640 1 Processor -- start 2023-08-25T05:37:17.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc4d38f640 1 -- start start 2023-08-25T05:37:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc4d38f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc4806c3b0 0x7fcc4814b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc4d38f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc4806c790 0x7fcc48159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc4d38f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc4806e5a0 0x7fcc480c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:17.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc4d38f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4814ba70 con 0x7fcc4806c3b0 2023-08-25T05:37:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc4d38f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc48159b60 con 0x7fcc4806e5a0 2023-08-25T05:37:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc4d38f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc48159e40 con 0x7fcc4806c790 2023-08-25T05:37:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc46ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc4806c3b0 0x7fcc4814b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc46ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc4806c3b0 0x7fcc4814b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33628/0 (socket says 172.21.15.55:33628) 2023-08-25T05:37:17.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc46ffd640 1 -- 172.21.15.55:0/2655697892 learned_addr learned my addr 172.21.15.55:0/2655697892 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc3ffff640 1 --2- 172.21.15.55:0/2655697892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc4806c790 0x7fcc48159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc477fe640 1 --2- 172.21.15.55:0/2655697892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc4806e5a0 0x7fcc480c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc46ffd640 1 -- 172.21.15.55:0/2655697892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc4806c790 msgr2=0x7fcc48159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc46ffd640 1 --2- 172.21.15.55:0/2655697892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc4806c790 0x7fcc48159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc46ffd640 1 -- 172.21.15.55:0/2655697892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc4806e5a0 msgr2=0x7fcc480c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:17.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc46ffd640 1 --2- 172.21.15.55:0/2655697892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc4806e5a0 0x7fcc480c7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc46ffd640 1 -- 172.21.15.55:0/2655697892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc40009a70 con 0x7fcc4806c3b0 2023-08-25T05:37:17.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc477fe640 1 --2- 172.21.15.55:0/2655697892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc4806e5a0 0x7fcc480c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:17.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.315+0000 7fcc3ffff640 1 --2- 172.21.15.55:0/2655697892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc4806c790 0x7fcc48159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:17.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.319+0000 7fcc46ffd640 1 --2- 172.21.15.55:0/2655697892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc4806c3b0 0x7fcc4814b530 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800c450 tx=0x7fcc3800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:17.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.319+0000 7fcc3f7fe640 1 -- 172.21.15.55:0/2655697892 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc380052d0 con 0x7fcc4806c3b0 2023-08-25T05:37:17.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.319+0000 7fcc3f7fe640 1 -- 172.21.15.55:0/2655697892 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc38005430 con 0x7fcc4806c3b0 2023-08-25T05:37:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.319+0000 7fcc3f7fe640 1 -- 172.21.15.55:0/2655697892 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc38003890 con 0x7fcc4806c3b0 2023-08-25T05:37:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.319+0000 7fcc4d38f640 1 -- 172.21.15.55:0/2655697892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4815a120 con 0x7fcc4806c3b0 2023-08-25T05:37:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.319+0000 7fcc4d38f640 1 -- 172.21.15.55:0/2655697892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4815a6e0 con 0x7fcc4806c3b0 2023-08-25T05:37:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.319+0000 7fcc4d38f640 1 -- 172.21.15.55:0/2655697892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4815a8d0 con 0x7fcc4806c3b0 2023-08-25T05:37:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.319+0000 7fcc3f7fe640 1 -- 172.21.15.55:0/2655697892 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fcc380039f0 con 0x7fcc4806c3b0 2023-08-25T05:37:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.319+0000 7fcc3f7fe640 1 --2- 172.21.15.55:0/2655697892 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fcc280657a0 0x7fcc28067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:17.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.319+0000 7fcc3f7fe640 1 -- 172.21.15.55:0/2655697892 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fcc38082b60 con 0x7fcc4806c3b0 2023-08-25T05:37:17.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.319+0000 7fcc3ffff640 1 --2- 172.21.15.55:0/2655697892 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fcc280657a0 0x7fcc28067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:17.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.323+0000 7fcc3ffff640 1 --2- 172.21.15.55:0/2655697892 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fcc280657a0 0x7fcc28067c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcc481f8260 tx=0x7fcc30009040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:17.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.323+0000 7fcc3f7fe640 1 -- 172.21.15.55:0/2655697892 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fcc380504f0 con 0x7fcc4806c3b0 2023-08-25T05:37:17.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.483+0000 7fcc4d38f640 1 -- 172.21.15.55:0/2655697892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcc48073ec0 con 0x7fcc4806c3b0 2023-08-25T05:37:17.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.483+0000 7fcc3f7fe640 1 -- 172.21.15.55:0/2655697892 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v194) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcc38053b10 con 0x7fcc4806c3b0 2023-08-25T05:37:17.486 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T05:37:17.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.487+0000 7fcc4d38f640 1 -- 172.21.15.55:0/2655697892 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fcc280657a0 msgr2=0x7fcc28067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:17.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.487+0000 7fcc4d38f640 1 --2- 172.21.15.55:0/2655697892 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fcc280657a0 0x7fcc28067c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcc481f8260 tx=0x7fcc30009040 comp rx=0 tx=0).stop 2023-08-25T05:37:17.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.487+0000 7fcc4d38f640 1 -- 172.21.15.55:0/2655697892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc4806c3b0 msgr2=0x7fcc4814b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:17.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.487+0000 7fcc4d38f640 1 --2- 172.21.15.55:0/2655697892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc4806c3b0 0x7fcc4814b530 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800c450 tx=0x7fcc3800c910 comp rx=0 tx=0).stop 2023-08-25T05:37:17.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.487+0000 7fcc4d38f640 1 -- 172.21.15.55:0/2655697892 shutdown_connections 2023-08-25T05:37:17.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.487+0000 7fcc4d38f640 1 --2- 172.21.15.55:0/2655697892 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fcc280657a0 0x7fcc28067c60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.487+0000 7fcc4d38f640 1 --2- 172.21.15.55:0/2655697892 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc4806e5a0 0x7fcc480c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.487+0000 7fcc4d38f640 1 --2- 172.21.15.55:0/2655697892 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc4806c790 0x7fcc48159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.487+0000 7fcc4d38f640 1 --2- 172.21.15.55:0/2655697892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcc4806c3b0 0x7fcc4814b530 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.487+0000 7fcc4d38f640 1 -- 172.21.15.55:0/2655697892 >> 172.21.15.55:0/2655697892 conn(0x7fcc480d0540 msgr2=0x7fcc4815bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:17.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.487+0000 7fcc4d38f640 1 -- 172.21.15.55:0/2655697892 shutdown_connections 2023-08-25T05:37:17.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.487+0000 7fcc4d38f640 1 -- 172.21.15.55:0/2655697892 wait complete. 2023-08-25T05:37:17.507 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-25T05:37:17.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.651+0000 7fa6e0d67640 1 Processor -- start 2023-08-25T05:37:17.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.651+0000 7fa6e0d67640 1 -- start start 2023-08-25T05:37:17.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.651+0000 7fa6e0d67640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6dc15a7f0 0x7fa6dc09bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:17.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.651+0000 7fa6e0d67640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa6dc06c020 0x7fa6dc0acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:17.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.651+0000 7fa6e0d67640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6dc15abd0 con 0x7fa6dc0c9830 2023-08-25T05:37:17.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.651+0000 7fa6e0d67640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6dc0c8ab0 con 0x7fa6dc06c020 2023-08-25T05:37:17.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.651+0000 7fa6e0d67640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc0c8d50 con 0x7fa6dc15a7f0 2023-08-25T05:37:17.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.655+0000 7fa6dad9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa6dc06c020 0x7fa6dc0acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:17.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.655+0000 7fa6d3fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa6dc0c9830 0x7fa6dc070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:49558/0 (socket says 172.21.15.55:49558) 2023-08-25T05:37:17.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.655+0000 7fa6da59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6dc15a7f0 0x7fa6dc09bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:17.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.655+0000 7fa6d3fff640 1 -- 172.21.15.55:0/2579611873 learned_addr learned my addr 172.21.15.55:0/2579611873 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:17.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.655+0000 7fa6dad9d640 1 -- 172.21.15.55:0/2579611873 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6dc15a7f0 msgr2=0x7fa6dc09bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:17.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.655+0000 7fa6dad9d640 1 --2- 172.21.15.55:0/2579611873 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6dc15a7f0 0x7fa6dc09bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.655+0000 7fa6dad9d640 1 -- 172.21.15.55:0/2579611873 >> v1:172.21.15.110:6789/0 conn(0x7fa6dc0c9830 legacy=0x7fa6dc070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:17.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.655+0000 7fa6dad9d640 1 -- 172.21.15.55:0/2579611873 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc0c9030 con 0x7fa6dc06c020 2023-08-25T05:37:17.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.655+0000 7fa6dad9d640 1 --2- 172.21.15.55:0/2579611873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6dc06c020 0x7fa6dc0acff0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4009d90 tx=0x7fa6d401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c80b17ed80913aa server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:17.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.655+0000 7fa6d9d9b640 1 -- 172.21.15.55:0/2579611873 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40a58f0 con 0x7fa6dc06c020 2023-08-25T05:37:17.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.655+0000 7fa6d9d9b640 1 -- 172.21.15.55:0/2579611873 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d40a5a50 con 0x7fa6dc06c020 2023-08-25T05:37:17.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.655+0000 7fa6d9d9b640 1 -- 172.21.15.55:0/2579611873 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40a5de0 con 0x7fa6dc06c020 2023-08-25T05:37:17.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6e0d67640 1 -- 172.21.15.55:0/2579611873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6dc06c020 msgr2=0x7fa6dc0acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:17.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6e0d67640 1 --2- 172.21.15.55:0/2579611873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6dc06c020 0x7fa6dc0acff0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4009d90 tx=0x7fa6d401c920 comp rx=0 tx=0).stop 2023-08-25T05:37:17.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6e0d67640 1 -- 172.21.15.55:0/2579611873 shutdown_connections 2023-08-25T05:37:17.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6e0d67640 1 --2- 172.21.15.55:0/2579611873 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6dc06c020 0x7fa6dc0acff0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6e0d67640 1 --2- 172.21.15.55:0/2579611873 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6dc15a7f0 0x7fa6dc09bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6e0d67640 1 -- 172.21.15.55:0/2579611873 >> 172.21.15.55:0/2579611873 conn(0x7fa6dc069900 msgr2=0x7fa6dc069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:17.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6e0d67640 1 -- 172.21.15.55:0/2579611873 shutdown_connections 2023-08-25T05:37:17.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6e0d67640 1 -- 172.21.15.55:0/2579611873 wait complete. 2023-08-25T05:37:17.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6e0d67640 1 Processor -- start 2023-08-25T05:37:17.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6e0d67640 1 -- start start 2023-08-25T05:37:17.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6e0d67640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6dc06c020 0x7fa6dc146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:17.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6e0d67640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6dc0c9830 0x7fa6dc0c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:17.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6e0d67640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6dc15a7f0 0x7fa6dc15cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:17.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6e0d67640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc0c6830 con 0x7fa6dc15a7f0 2023-08-25T05:37:17.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6e0d67640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc0c8300 con 0x7fa6dc06c020 2023-08-25T05:37:17.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6e0d67640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc15d560 con 0x7fa6dc0c9830 2023-08-25T05:37:17.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6dad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6dc15a7f0 0x7fa6dc15cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:17.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6dad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6dc15a7f0 0x7fa6dc15cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33630/0 (socket says 172.21.15.55:33630) 2023-08-25T05:37:17.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6dad9d640 1 -- 172.21.15.55:0/267661487 learned_addr learned my addr 172.21.15.55:0/267661487 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:17.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6d3fff640 1 --2- 172.21.15.55:0/267661487 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6dc0c9830 0x7fa6dc0c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:17.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6da59c640 1 --2- 172.21.15.55:0/267661487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6dc06c020 0x7fa6dc146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:17.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6dad9d640 1 -- 172.21.15.55:0/267661487 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6dc0c9830 msgr2=0x7fa6dc0c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:17.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6dad9d640 1 --2- 172.21.15.55:0/267661487 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6dc0c9830 0x7fa6dc0c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6dad9d640 1 -- 172.21.15.55:0/267661487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6dc06c020 msgr2=0x7fa6dc146360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:17.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6dad9d640 1 --2- 172.21.15.55:0/267661487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6dc06c020 0x7fa6dc146360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.659+0000 7fa6dad9d640 1 -- 172.21.15.55:0/267661487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d4009a70 con 0x7fa6dc15a7f0 2023-08-25T05:37:17.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.663+0000 7fa6dad9d640 1 --2- 172.21.15.55:0/267661487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6dc15a7f0 0x7fa6dc15cd10 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40b0040 tx=0x7fa6d40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:17.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.663+0000 7fa6d2ffd640 1 -- 172.21.15.55:0/267661487 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40b9860 con 0x7fa6dc15a7f0 2023-08-25T05:37:17.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.663+0000 7fa6d2ffd640 1 -- 172.21.15.55:0/267661487 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d40b99c0 con 0x7fa6dc15a7f0 2023-08-25T05:37:17.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.663+0000 7fa6d2ffd640 1 -- 172.21.15.55:0/267661487 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40b9d70 con 0x7fa6dc15a7f0 2023-08-25T05:37:17.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.663+0000 7fa6e0d67640 1 -- 172.21.15.55:0/267661487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6dc0c5530 con 0x7fa6dc15a7f0 2023-08-25T05:37:17.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.663+0000 7fa6e0d67640 1 -- 172.21.15.55:0/267661487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6dc0c5af0 con 0x7fa6dc15a7f0 2023-08-25T05:37:17.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.663+0000 7fa6e0d67640 1 -- 172.21.15.55:0/267661487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6dc06d5b0 con 0x7fa6dc15a7f0 2023-08-25T05:37:17.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.663+0000 7fa6d2ffd640 1 -- 172.21.15.55:0/267661487 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fa6d40c4460 con 0x7fa6dc15a7f0 2023-08-25T05:37:17.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.663+0000 7fa6d2ffd640 1 --2- 172.21.15.55:0/267661487 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fa6bc0657a0 0x7fa6bc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:17.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.667+0000 7fa6d2ffd640 1 -- 172.21.15.55:0/267661487 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fa6d411e380 con 0x7fa6dc15a7f0 2023-08-25T05:37:17.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.667+0000 7fa6da59c640 1 --2- 172.21.15.55:0/267661487 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fa6bc0657a0 0x7fa6bc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:17.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.667+0000 7fa6da59c640 1 --2- 172.21.15.55:0/267661487 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fa6bc0657a0 0x7fa6bc067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0aca50 tx=0x7fa6cc006f90 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:17.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.671+0000 7fa6d2ffd640 1 -- 172.21.15.55:0/267661487 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa6d40ebe50 con 0x7fa6dc15a7f0 2023-08-25T05:37:17.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.823+0000 7fa6e0d67640 1 -- 172.21.15.55:0/267661487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa6dc073ec0 con 0x7fa6dc15a7f0 2023-08-25T05:37:17.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.831+0000 7fa6d2ffd640 1 -- 172.21.15.55:0/267661487 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v70)=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa6d40ef470 con 0x7fa6dc15a7f0 2023-08-25T05:37:17.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.831+0000 7fa6e0d67640 1 -- 172.21.15.55:0/267661487 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fa6bc0657a0 msgr2=0x7fa6bc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:17.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.831+0000 7fa6e0d67640 1 --2- 172.21.15.55:0/267661487 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fa6bc0657a0 0x7fa6bc067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0aca50 tx=0x7fa6cc006f90 comp rx=0 tx=0).stop 2023-08-25T05:37:17.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.831+0000 7fa6e0d67640 1 -- 172.21.15.55:0/267661487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6dc15a7f0 msgr2=0x7fa6dc15cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:17.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.831+0000 7fa6e0d67640 1 --2- 172.21.15.55:0/267661487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6dc15a7f0 0x7fa6dc15cd10 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40b0040 tx=0x7fa6d40196c0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.831+0000 7fa6e0d67640 1 -- 172.21.15.55:0/267661487 shutdown_connections 2023-08-25T05:37:17.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.831+0000 7fa6e0d67640 1 --2- 172.21.15.55:0/267661487 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fa6bc0657a0 0x7fa6bc067c60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.831+0000 7fa6e0d67640 1 --2- 172.21.15.55:0/267661487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6dc15a7f0 0x7fa6dc15cd10 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.831+0000 7fa6e0d67640 1 --2- 172.21.15.55:0/267661487 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6dc0c9830 0x7fa6dc0c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.831+0000 7fa6e0d67640 1 --2- 172.21.15.55:0/267661487 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6dc06c020 0x7fa6dc146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:17.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.831+0000 7fa6e0d67640 1 -- 172.21.15.55:0/267661487 >> 172.21.15.55:0/267661487 conn(0x7fa6dc069900 msgr2=0x7fa6dc155410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:17.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.831+0000 7fa6e0d67640 1 -- 172.21.15.55:0/267661487 shutdown_connections 2023-08-25T05:37:17.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:17.831+0000 7fa6e0d67640 1 -- 172.21.15.55:0/267661487 wait complete. 2023-08-25T05:37:17.844 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:37:17.848 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:37:17.853 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T05:37:17.853 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T05:37:17.998 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T05:37:18.046 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T05:37:18.047 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:37:18.047 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:18.057 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T05:37:18.057 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:37:18.058 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:18.067 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:37:18.068 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:37:18.068 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:18.111 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T05:37:18.111 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:37:18.112 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:18.120 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:37:18.121 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-25T05:37:18.121 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:37:18.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.295+0000 7f7eb131e640 1 Processor -- start 2023-08-25T05:37:18.298 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.295+0000 7f7eb131e640 1 -- start start 2023-08-25T05:37:18.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.295+0000 7f7eb131e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7eac06dcf0 0x7f7eac0ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:18.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.295+0000 7f7eb131e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7eac06d5c0 0x7f7eac15c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:18.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.295+0000 7f7eb131e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eac0b1660 con 0x7f7eac158de0 2023-08-25T05:37:18.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.295+0000 7f7eb131e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eac0cea00 con 0x7f7eac06d5c0 2023-08-25T05:37:18.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.295+0000 7f7eb131e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eac1591c0 con 0x7f7eac06dcf0 2023-08-25T05:37:18.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.299+0000 7f7eab7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7eac06d5c0 0x7f7eac15c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:18.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.299+0000 7f7eab7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7eac06d5c0 0x7f7eac15c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33642/0 (socket says 172.21.15.55:33642) 2023-08-25T05:37:18.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.299+0000 7f7eab7fe640 1 -- 172.21.15.55:0/1994949316 learned_addr learned my addr 172.21.15.55:0/1994949316 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:18.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.299+0000 7f7ea3fff640 1 --2- 172.21.15.55:0/1994949316 >> v2:172.21.15.110:3300/0 conn(0x7f7eac06dcf0 0x7f7eac0ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:18.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.299+0000 7f7eab7fe640 1 -- 172.21.15.55:0/1994949316 >> v2:172.21.15.110:3300/0 conn(0x7f7eac06dcf0 msgr2=0x7f7eac0ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:18.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.299+0000 7f7eab7fe640 1 --2- 172.21.15.55:0/1994949316 >> v2:172.21.15.110:3300/0 conn(0x7f7eac06dcf0 0x7f7eac0ce4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:18.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.299+0000 7f7eab7fe640 1 -- 172.21.15.55:0/1994949316 >> v1:172.21.15.110:6789/0 conn(0x7f7eac158de0 legacy=0x7f7eac0ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:18.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.299+0000 7f7eab7fe640 1 -- 172.21.15.55:0/1994949316 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac0b13c0 con 0x7f7eac06d5c0 2023-08-25T05:37:18.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.299+0000 7f7eab7fe640 1 --2- 172.21.15.55:0/1994949316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eac06d5c0 0x7f7eac15c880 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f7eac066ee0 tx=0x7f7ea401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c59a5195180f0e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:18.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.299+0000 7f7eaa7fc640 1 -- 172.21.15.55:0/1994949316 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea40a5760 con 0x7f7eac06d5c0 2023-08-25T05:37:18.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.299+0000 7f7eaa7fc640 1 -- 172.21.15.55:0/1994949316 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea40a58c0 con 0x7f7eac06d5c0 2023-08-25T05:37:18.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.299+0000 7f7eaa7fc640 1 -- 172.21.15.55:0/1994949316 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea40a5c50 con 0x7f7eac06d5c0 2023-08-25T05:37:18.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eb131e640 1 -- 172.21.15.55:0/1994949316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eac06d5c0 msgr2=0x7f7eac15c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:18.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eb131e640 1 --2- 172.21.15.55:0/1994949316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eac06d5c0 0x7f7eac15c880 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f7eac066ee0 tx=0x7f7ea401c990 comp rx=0 tx=0).stop 2023-08-25T05:37:18.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eb131e640 1 -- 172.21.15.55:0/1994949316 shutdown_connections 2023-08-25T05:37:18.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eb131e640 1 --2- 172.21.15.55:0/1994949316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eac06d5c0 0x7f7eac15c880 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:18.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eb131e640 1 --2- 172.21.15.55:0/1994949316 >> v2:172.21.15.110:3300/0 conn(0x7f7eac06dcf0 0x7f7eac0ce4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:18.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eb131e640 1 -- 172.21.15.55:0/1994949316 >> 172.21.15.55:0/1994949316 conn(0x7f7eac0b0700 msgr2=0x7f7eac0b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:18.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eb131e640 1 -- 172.21.15.55:0/1994949316 shutdown_connections 2023-08-25T05:37:18.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eb131e640 1 -- 172.21.15.55:0/1994949316 wait complete. 2023-08-25T05:37:18.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eb131e640 1 Processor -- start 2023-08-25T05:37:18.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eb131e640 1 -- start start 2023-08-25T05:37:18.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eb131e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eac06dcf0 0x7f7eac0b9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:18.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eb131e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7eac158de0 0x7f7eac0bb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:18.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eb131e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7eac154ca0 0x7f7eac0bb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:18.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eb131e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0baa60 con 0x7f7eac06dcf0 2023-08-25T05:37:18.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eb131e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0b9e50 con 0x7f7eac158de0 2023-08-25T05:37:18.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eb131e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0ba130 con 0x7f7eac154ca0 2023-08-25T05:37:18.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eaaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eac06dcf0 0x7f7eac0b9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:18.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eaaffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eac06dcf0 0x7f7eac0b9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33652/0 (socket says 172.21.15.55:33652) 2023-08-25T05:37:18.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eaaffd640 1 -- 172.21.15.55:0/2411383484 learned_addr learned my addr 172.21.15.55:0/2411383484 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:18.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7ea3fff640 1 --2- 172.21.15.55:0/2411383484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7eac158de0 0x7f7eac0bb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:18.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.303+0000 7f7eab7fe640 1 --2- 172.21.15.55:0/2411383484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7eac154ca0 0x7f7eac0bb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:18.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.307+0000 7f7eaaffd640 1 -- 172.21.15.55:0/2411383484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7eac154ca0 msgr2=0x7f7eac0bb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:18.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.307+0000 7f7eaaffd640 1 --2- 172.21.15.55:0/2411383484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7eac154ca0 0x7f7eac0bb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:18.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.307+0000 7f7eaaffd640 1 -- 172.21.15.55:0/2411383484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7eac158de0 msgr2=0x7f7eac0bb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:18.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.307+0000 7f7eaaffd640 1 --2- 172.21.15.55:0/2411383484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7eac158de0 0x7f7eac0bb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:18.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.307+0000 7f7eaaffd640 1 -- 172.21.15.55:0/2411383484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea4009b30 con 0x7f7eac06dcf0 2023-08-25T05:37:18.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.307+0000 7f7eaaffd640 1 --2- 172.21.15.55:0/2411383484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eac06dcf0 0x7f7eac0b9600 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00b410 tx=0x7f7e9c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:18.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.307+0000 7f7ea37fe640 1 -- 172.21.15.55:0/2411383484 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c004020 con 0x7f7eac06dcf0 2023-08-25T05:37:18.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.307+0000 7f7ea37fe640 1 -- 172.21.15.55:0/2411383484 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c004180 con 0x7f7eac06dcf0 2023-08-25T05:37:18.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.307+0000 7f7ea37fe640 1 -- 172.21.15.55:0/2411383484 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c011630 con 0x7f7eac06dcf0 2023-08-25T05:37:18.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.307+0000 7f7eb131e640 1 -- 172.21.15.55:0/2411383484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eac0ba410 con 0x7f7eac06dcf0 2023-08-25T05:37:18.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.307+0000 7f7eb131e640 1 -- 172.21.15.55:0/2411383484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eac0b9b40 con 0x7f7eac06dcf0 2023-08-25T05:37:18.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.307+0000 7f7eb131e640 1 -- 172.21.15.55:0/2411383484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eac04dbe0 con 0x7f7eac06dcf0 2023-08-25T05:37:18.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.307+0000 7f7ea37fe640 1 -- 172.21.15.55:0/2411383484 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f7e9c011790 con 0x7f7eac06dcf0 2023-08-25T05:37:18.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.307+0000 7f7ea37fe640 1 --2- 172.21.15.55:0/2411383484 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f7e8c0657a0 0x7f7e8c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:18.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.307+0000 7f7ea37fe640 1 -- 172.21.15.55:0/2411383484 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f7e9c082b30 con 0x7f7eac06dcf0 2023-08-25T05:37:18.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.311+0000 7f7ea3fff640 1 --2- 172.21.15.55:0/2411383484 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f7e8c0657a0 0x7f7e8c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:18.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.311+0000 7f7ea3fff640 1 --2- 172.21.15.55:0/2411383484 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f7e8c0657a0 0x7f7e8c067c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7eac1470e0 tx=0x7f7e94008040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:18.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.311+0000 7f7ea37fe640 1 -- 172.21.15.55:0/2411383484 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7e9c050610 con 0x7f7eac06dcf0 2023-08-25T05:37:18.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.503+0000 7f7eb131e640 1 -- 172.21.15.55:0/2411383484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7eac09fb70 con 0x7f7eac06dcf0 2023-08-25T05:37:18.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.503+0000 7f7ea37fe640 1 -- 172.21.15.55:0/2411383484 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+3704 (secure 0 0 0) 0x7f7e9c015090 con 0x7f7eac06dcf0 2023-08-25T05:37:18.504 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:18.504 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":93,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8768,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/1348996798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":1348996798},{"type":"v1","addr":"172.21.15.110:6837","nonce":1348996798}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":9988,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/623585793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":623585793},{"type":"v1","addr":"172.21.15.110:6836","nonce":623585793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":87},{"gid":10782,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3873137631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3873137631},{"type":"v1","addr":"172.21.15.55:6834","nonce":3873137631}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86},{"gid":11256,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2582562876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2582562876},{"type":"v1","addr":"172.21.15.55:6835","nonce":2582562876}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":93}],"filesystems":[]} 2023-08-25T05:37:18.505 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 93 2023-08-25T05:37:18.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.503+0000 7f7eb131e640 1 -- 172.21.15.55:0/2411383484 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f7e8c0657a0 msgr2=0x7f7e8c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:18.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.503+0000 7f7eb131e640 1 --2- 172.21.15.55:0/2411383484 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f7e8c0657a0 0x7f7e8c067c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7eac1470e0 tx=0x7f7e94008040 comp rx=0 tx=0).stop 2023-08-25T05:37:18.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.503+0000 7f7eb131e640 1 -- 172.21.15.55:0/2411383484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eac06dcf0 msgr2=0x7f7eac0b9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:18.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.503+0000 7f7eb131e640 1 --2- 172.21.15.55:0/2411383484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eac06dcf0 0x7f7eac0b9600 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00b410 tx=0x7f7e9c00b8d0 comp rx=0 tx=0).stop 2023-08-25T05:37:18.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.503+0000 7f7eb131e640 1 -- 172.21.15.55:0/2411383484 shutdown_connections 2023-08-25T05:37:18.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.503+0000 7f7eb131e640 1 --2- 172.21.15.55:0/2411383484 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f7e8c0657a0 0x7f7e8c067c60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:18.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.503+0000 7f7eb131e640 1 --2- 172.21.15.55:0/2411383484 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7eac154ca0 0x7f7eac0bb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:18.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.503+0000 7f7eb131e640 1 --2- 172.21.15.55:0/2411383484 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7eac158de0 0x7f7eac0bb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:18.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.503+0000 7f7eb131e640 1 --2- 172.21.15.55:0/2411383484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eac06dcf0 0x7f7eac0b9600 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:18.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.503+0000 7f7eb131e640 1 -- 172.21.15.55:0/2411383484 >> 172.21.15.55:0/2411383484 conn(0x7f7eac0b0700 msgr2=0x7f7eac1563e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:18.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.503+0000 7f7eb131e640 1 -- 172.21.15.55:0/2411383484 shutdown_connections 2023-08-25T05:37:18.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.503+0000 7f7eb131e640 1 -- 172.21.15.55:0/2411383484 wait complete. 2023-08-25T05:37:18.525 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-25T05:37:18.525 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-25T05:37:18.526 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-25T05:37:18.526 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:37:18.526 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-25T05:37:18.527 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-25T05:37:18.527 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-25T05:37:18.527 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:37:18.528 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-25T05:37:18.528 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-25T05:37:18.528 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-25T05:37:18.528 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:37:18.529 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-25T05:37:18.529 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-25T05:37:18.529 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-25T05:37:18.530 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:37:18.538 INFO:tasks.ceph.mds.a:Stopped 2023-08-25T05:37:18.538 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-25T05:37:18.539 INFO:tasks.ceph.mds.c:Stopped 2023-08-25T05:37:18.539 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-25T05:37:18.545 INFO:tasks.ceph.mds.b:Stopped 2023-08-25T05:37:18.545 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-25T05:37:18.546 INFO:tasks.ceph.mds.d:Stopped 2023-08-25T05:37:18.547 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-25T05:37:18.586 INFO:tasks.ceph.mds.a:Started 2023-08-25T05:37:18.586 DEBUG:teuthology.parallel:result is None 2023-08-25T05:37:18.588 INFO:tasks.ceph.mds.c:Started 2023-08-25T05:37:18.588 DEBUG:teuthology.parallel:result is None 2023-08-25T05:37:18.593 INFO:tasks.ceph.mds.b:Started 2023-08-25T05:37:18.594 DEBUG:teuthology.parallel:result is None 2023-08-25T05:37:18.596 INFO:tasks.ceph.mds.d:Started 2023-08-25T05:37:18.596 DEBUG:teuthology.parallel:result is None 2023-08-25T05:37:18.597 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-25T05:37:18.676 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-08-25T05:37:18.676 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T05:37:18.688 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2023-08-25T05:37:18.688 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2023-08-25T05:37:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.743+0000 7f7a2bc9c640 1 Processor -- start 2023-08-25T05:37:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.743+0000 7f7a2bc9c640 1 -- start start 2023-08-25T05:37:18.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.747+0000 7f7a2bc9c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7a240ceeb0 0x7f7a240cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:18.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.747+0000 7f7a2bc9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a240c89f0 0x7f7a240b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:18.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.747+0000 7f7a2bc9c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a240cc880 con 0x7f7a240ad950 2023-08-25T05:37:18.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.747+0000 7f7a2bc9c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a240b11f0 con 0x7f7a240ceeb0 2023-08-25T05:37:18.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.747+0000 7f7a2bc9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a24159d50 con 0x7f7a240c89f0 2023-08-25T05:37:18.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.747+0000 7f7a29237640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7a240ceeb0 0x7f7a240cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:18.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.747+0000 7f7a29237640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7a240ceeb0 0x7f7a240cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33688/0 (socket says 172.21.15.55:33688) 2023-08-25T05:37:18.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.747+0000 7f7a29237640 1 -- 172.21.15.55:0/906274230 learned_addr learned my addr 172.21.15.55:0/906274230 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:18.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.747+0000 7f7a29237640 1 -- 172.21.15.55:0/906274230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a240c89f0 msgr2=0x7f7a240b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:18.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.747+0000 7f7a29237640 1 --2- 172.21.15.55:0/906274230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a240c89f0 0x7f7a240b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:18.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.747+0000 7f7a29237640 1 -- 172.21.15.55:0/906274230 >> v1:172.21.15.110:6789/0 conn(0x7f7a240ad950 legacy=0x7f7a240ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:18.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.747+0000 7f7a29237640 1 -- 172.21.15.55:0/906274230 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a240ccb60 con 0x7f7a240ceeb0 2023-08-25T05:37:18.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.751+0000 7f7a29237640 1 --2- 172.21.15.55:0/906274230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a240ceeb0 0x7f7a240cc2a0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009870 tx=0x7f7a1401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372aaa3d47736a2a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:18.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.751+0000 7f7a28a36640 1 -- 172.21.15.55:0/906274230 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a140ac640 con 0x7f7a240ceeb0 2023-08-25T05:37:18.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.751+0000 7f7a28a36640 1 -- 172.21.15.55:0/906274230 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a140ac7a0 con 0x7f7a240ceeb0 2023-08-25T05:37:18.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.751+0000 7f7a28a36640 1 -- 172.21.15.55:0/906274230 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a140acb30 con 0x7f7a240ceeb0 2023-08-25T05:37:18.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.751+0000 7f7a2bc9c640 1 -- 172.21.15.55:0/906274230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a240ceeb0 msgr2=0x7f7a240cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:18.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.751+0000 7f7a2bc9c640 1 --2- 172.21.15.55:0/906274230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a240ceeb0 0x7f7a240cc2a0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009870 tx=0x7f7a1401c440 comp rx=0 tx=0).stop 2023-08-25T05:37:18.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.751+0000 7f7a2bc9c640 1 -- 172.21.15.55:0/906274230 shutdown_connections 2023-08-25T05:37:18.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.751+0000 7f7a2bc9c640 1 --2- 172.21.15.55:0/906274230 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a240c89f0 0x7f7a240b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:18.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.751+0000 7f7a2bc9c640 1 --2- 172.21.15.55:0/906274230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a240ceeb0 0x7f7a240cc2a0 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:18.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.751+0000 7f7a2bc9c640 1 -- 172.21.15.55:0/906274230 >> 172.21.15.55:0/906274230 conn(0x7f7a24069d00 msgr2=0x7f7a2406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:18.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.751+0000 7f7a2bc9c640 1 -- 172.21.15.55:0/906274230 shutdown_connections 2023-08-25T05:37:18.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.751+0000 7f7a2bc9c640 1 -- 172.21.15.55:0/906274230 wait complete. 2023-08-25T05:37:18.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.751+0000 7f7a2bc9c640 1 Processor -- start 2023-08-25T05:37:18.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.751+0000 7f7a2bc9c640 1 -- start start 2023-08-25T05:37:18.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a2bc9c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a240ad950 0x7f7a240c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:18.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a2bc9c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a240c89f0 0x7f7a2415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:18.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a2bc9c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a240ceeb0 0x7f7a24158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:18.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a2bc9c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a24159ed0 con 0x7f7a240ceeb0 2023-08-25T05:37:18.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a2bc9c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a240c8e20 con 0x7f7a240ad950 2023-08-25T05:37:18.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a2bc9c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a240c9100 con 0x7f7a240c89f0 2023-08-25T05:37:18.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a29a38640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a240ad950 0x7f7a240c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:18.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a29a38640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a240ad950 0x7f7a240c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:55642/0 (socket says 172.21.15.55:55642) 2023-08-25T05:37:18.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a29237640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a240c89f0 0x7f7a2415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:18.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a29a38640 1 -- 172.21.15.55:0/3818610418 learned_addr learned my addr 172.21.15.55:0/3818610418 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:18.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a2a239640 1 --2- 172.21.15.55:0/3818610418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a240ceeb0 0x7f7a24158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:18.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a29a38640 1 -- 172.21.15.55:0/3818610418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a240c89f0 msgr2=0x7f7a2415c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:18.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a29a38640 1 --2- 172.21.15.55:0/3818610418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a240c89f0 0x7f7a2415c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:18.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a29a38640 1 -- 172.21.15.55:0/3818610418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a240ceeb0 msgr2=0x7f7a24158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:18.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a29a38640 1 --2- 172.21.15.55:0/3818610418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a240ceeb0 0x7f7a24158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:18.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a29a38640 1 -- 172.21.15.55:0/3818610418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a140094d0 con 0x7f7a240ad950 2023-08-25T05:37:18.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a2a239640 1 --2- 172.21.15.55:0/3818610418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a240ceeb0 0x7f7a24158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:18.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a29a38640 1 --2- 172.21.15.55:0/3818610418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a240ad950 0x7f7a240c5500 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000b3e0 tx=0x7f7a2000b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:18.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a1a7fc640 1 -- 172.21.15.55:0/3818610418 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20011830 con 0x7f7a240ad950 2023-08-25T05:37:18.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a1a7fc640 1 -- 172.21.15.55:0/3818610418 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a200119b0 con 0x7f7a240ad950 2023-08-25T05:37:18.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a1a7fc640 1 -- 172.21.15.55:0/3818610418 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20011d60 con 0x7f7a240ad950 2023-08-25T05:37:18.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a2bc9c640 1 -- 172.21.15.55:0/3818610418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a240c93e0 con 0x7f7a240ad950 2023-08-25T05:37:18.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a2bc9c640 1 -- 172.21.15.55:0/3818610418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2415cc20 con 0x7f7a240ad950 2023-08-25T05:37:18.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a2bc9c640 1 -- 172.21.15.55:0/3818610418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a2404dbe0 con 0x7f7a240ad950 2023-08-25T05:37:18.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.755+0000 7f7a1a7fc640 1 -- 172.21.15.55:0/3818610418 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f7a2001a400 con 0x7f7a240ad950 2023-08-25T05:37:18.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.759+0000 7f7a1a7fc640 1 --2- 172.21.15.55:0/3818610418 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f7a080657a0 0x7f7a08067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:18.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.759+0000 7f7a1a7fc640 1 -- 172.21.15.55:0/3818610418 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f7a20082ff0 con 0x7f7a240ad950 2023-08-25T05:37:18.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.759+0000 7f7a29237640 1 --2- 172.21.15.55:0/3818610418 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f7a080657a0 0x7f7a08067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:18.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.759+0000 7f7a29237640 1 --2- 172.21.15.55:0/3818610418 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f7a080657a0 0x7f7a08067c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7a140ae000 tx=0x7f7a140a6070 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:18.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.763+0000 7f7a1a7fc640 1 -- 172.21.15.55:0/3818610418 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7a200b3d90 con 0x7f7a240ad950 2023-08-25T05:37:18.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:18.927+0000 7f7a2bc9c640 1 -- 172.21.15.55:0/3818610418 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7a240b2c10 con 0x7f7a240ad950 2023-08-25T05:37:19.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.467+0000 7f7a1a7fc640 1 -- 172.21.15.55:0/3818610418 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v196) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7a20015080 con 0x7f7a240ad950 2023-08-25T05:37:19.471 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2023-08-25T05:37:19.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.471+0000 7f7a2bc9c640 1 -- 172.21.15.55:0/3818610418 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f7a080657a0 msgr2=0x7f7a08067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:19.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.471+0000 7f7a2bc9c640 1 --2- 172.21.15.55:0/3818610418 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f7a080657a0 0x7f7a08067c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7a140ae000 tx=0x7f7a140a6070 comp rx=0 tx=0).stop 2023-08-25T05:37:19.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.471+0000 7f7a2bc9c640 1 -- 172.21.15.55:0/3818610418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a240ad950 msgr2=0x7f7a240c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:19.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.471+0000 7f7a2bc9c640 1 --2- 172.21.15.55:0/3818610418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a240ad950 0x7f7a240c5500 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000b3e0 tx=0x7f7a2000b8a0 comp rx=0 tx=0).stop 2023-08-25T05:37:19.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.471+0000 7f7a2bc9c640 1 -- 172.21.15.55:0/3818610418 shutdown_connections 2023-08-25T05:37:19.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.471+0000 7f7a2bc9c640 1 --2- 172.21.15.55:0/3818610418 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f7a080657a0 0x7f7a08067c60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:19.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.471+0000 7f7a2bc9c640 1 --2- 172.21.15.55:0/3818610418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a240ceeb0 0x7f7a24158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:19.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.471+0000 7f7a2bc9c640 1 --2- 172.21.15.55:0/3818610418 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a240c89f0 0x7f7a2415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:19.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.471+0000 7f7a2bc9c640 1 --2- 172.21.15.55:0/3818610418 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a240ad950 0x7f7a240c5500 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:19.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.471+0000 7f7a2bc9c640 1 -- 172.21.15.55:0/3818610418 >> 172.21.15.55:0/3818610418 conn(0x7f7a24069d00 msgr2=0x7f7a240ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:19.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.471+0000 7f7a2bc9c640 1 -- 172.21.15.55:0/3818610418 shutdown_connections 2023-08-25T05:37:19.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.471+0000 7f7a2bc9c640 1 -- 172.21.15.55:0/3818610418 wait complete. 2023-08-25T05:37:19.497 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-25T05:37:19.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.643+0000 7fae7e488640 1 Processor -- start 2023-08-25T05:37:19.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.643+0000 7fae7e488640 1 -- start start 2023-08-25T05:37:19.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.643+0000 7fae7e488640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae780ceff0 0x7fae78069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:19.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.643+0000 7fae7e488640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae78069e40 0x7fae780cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:19.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.643+0000 7fae7e488640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7806c4f0 con 0x7fae780aeb10 2023-08-25T05:37:19.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.643+0000 7fae7e488640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae780d0380 con 0x7fae780ceff0 2023-08-25T05:37:19.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.643+0000 7fae7e488640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7806d590 con 0x7fae78069e40 2023-08-25T05:37:19.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.643+0000 7fae77fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fae780aeb10 0x7fae780ce8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43634/0 (socket says 172.21.15.55:43634) 2023-08-25T05:37:19.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.643+0000 7fae77fff640 1 -- 172.21.15.55:0/3664917748 learned_addr learned my addr 172.21.15.55:0/3664917748 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:19.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.643+0000 7fae777fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae780ceff0 0x7fae78069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:19.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.643+0000 7fae7ca25640 1 --2- 172.21.15.55:0/3664917748 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae78069e40 0x7fae780cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:19.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.647+0000 7fae777fe640 1 -- 172.21.15.55:0/3664917748 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae78069e40 msgr2=0x7fae780cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:19.648 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.647+0000 7fae777fe640 1 --2- 172.21.15.55:0/3664917748 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae78069e40 0x7fae780cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:19.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.647+0000 7fae777fe640 1 -- 172.21.15.55:0/3664917748 >> v1:172.21.15.55:6789/0 conn(0x7fae780aeb10 legacy=0x7fae780ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:19.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.647+0000 7fae777fe640 1 -- 172.21.15.55:0/3664917748 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7806c7d0 con 0x7fae780ceff0 2023-08-25T05:37:19.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.647+0000 7fae76ffd640 1 -- 172.21.15.55:0/3664917748 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496734565 0 0) 0x7fae7806c4f0 con 0x7fae780aeb10 2023-08-25T05:37:19.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.647+0000 7fae777fe640 1 --2- 172.21.15.55:0/3664917748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae780ceff0 0x7fae78069900 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0097c0 tx=0x7fae6c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9411a65dd53e9499 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:19.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.647+0000 7fae76ffd640 1 -- 172.21.15.55:0/3664917748 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c0ab600 con 0x7fae780ceff0 2023-08-25T05:37:19.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.647+0000 7fae76ffd640 1 -- 172.21.15.55:0/3664917748 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c0a7050 con 0x7fae780ceff0 2023-08-25T05:37:19.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.647+0000 7fae76ffd640 1 -- 172.21.15.55:0/3664917748 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6c0ab980 con 0x7fae780ceff0 2023-08-25T05:37:19.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.647+0000 7fae7e488640 1 -- 172.21.15.55:0/3664917748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae780ceff0 msgr2=0x7fae78069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:19.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.647+0000 7fae7e488640 1 --2- 172.21.15.55:0/3664917748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae780ceff0 0x7fae78069900 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7fae6c0097c0 tx=0x7fae6c01c480 comp rx=0 tx=0).stop 2023-08-25T05:37:19.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.647+0000 7fae7e488640 1 -- 172.21.15.55:0/3664917748 shutdown_connections 2023-08-25T05:37:19.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.647+0000 7fae7e488640 1 --2- 172.21.15.55:0/3664917748 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae78069e40 0x7fae780cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:19.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.647+0000 7fae7e488640 1 --2- 172.21.15.55:0/3664917748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae780ceff0 0x7fae78069900 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:19.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.647+0000 7fae7e488640 1 -- 172.21.15.55:0/3664917748 >> 172.21.15.55:0/3664917748 conn(0x7fae780cf530 msgr2=0x7fae780cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:19.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.647+0000 7fae7e488640 1 -- 172.21.15.55:0/3664917748 shutdown_connections 2023-08-25T05:37:19.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.647+0000 7fae7e488640 1 -- 172.21.15.55:0/3664917748 wait complete. 2023-08-25T05:37:19.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae7e488640 1 Processor -- start 2023-08-25T05:37:19.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae7e488640 1 -- start start 2023-08-25T05:37:19.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae7e488640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae78069e40 0x7fae781488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:19.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae7e488640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae780aeb10 0x7fae780c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:19.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae7e488640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae780ceff0 0x7fae780ac110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:19.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae7e488640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae780c5b40 con 0x7fae780ceff0 2023-08-25T05:37:19.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae7e488640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae780c4f30 con 0x7fae780aeb10 2023-08-25T05:37:19.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae7e488640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae780c5210 con 0x7fae78069e40 2023-08-25T05:37:19.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae7ca25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae780ceff0 0x7fae780ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:19.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae7ca25640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae780ceff0 0x7fae780ac110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33720/0 (socket says 172.21.15.55:33720) 2023-08-25T05:37:19.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae7ca25640 1 -- 172.21.15.55:0/1660894574 learned_addr learned my addr 172.21.15.55:0/1660894574 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:19.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae77fff640 1 --2- 172.21.15.55:0/1660894574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae78069e40 0x7fae781488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:19.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae777fe640 1 --2- 172.21.15.55:0/1660894574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae780aeb10 0x7fae780c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:19.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae7ca25640 1 -- 172.21.15.55:0/1660894574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae78069e40 msgr2=0x7fae781488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:19.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae7ca25640 1 --2- 172.21.15.55:0/1660894574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae78069e40 0x7fae781488e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:19.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae7ca25640 1 -- 172.21.15.55:0/1660894574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae780aeb10 msgr2=0x7fae780c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:19.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae7ca25640 1 --2- 172.21.15.55:0/1660894574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae780aeb10 0x7fae780c4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:19.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae7ca25640 1 -- 172.21.15.55:0/1660894574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c009420 con 0x7fae780ceff0 2023-08-25T05:37:19.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae7ca25640 1 --2- 172.21.15.55:0/1660894574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae780ceff0 0x7fae780ac110 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7fae70007e40 tx=0x7fae7000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:19.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.651+0000 7fae74ff9640 1 -- 172.21.15.55:0/1660894574 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70014620 con 0x7fae780ceff0 2023-08-25T05:37:19.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.655+0000 7fae74ff9640 1 -- 172.21.15.55:0/1660894574 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7000ee90 con 0x7fae780ceff0 2023-08-25T05:37:19.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.655+0000 7fae74ff9640 1 -- 172.21.15.55:0/1660894574 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae700149e0 con 0x7fae780ceff0 2023-08-25T05:37:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.655+0000 7fae7e488640 1 -- 172.21.15.55:0/1660894574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae780c54f0 con 0x7fae780ceff0 2023-08-25T05:37:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.655+0000 7fae7e488640 1 -- 172.21.15.55:0/1660894574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae78148e20 con 0x7fae780ceff0 2023-08-25T05:37:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.655+0000 7fae7e488640 1 -- 172.21.15.55:0/1660894574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae780c5cb0 con 0x7fae780ceff0 2023-08-25T05:37:19.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.655+0000 7fae74ff9640 1 -- 172.21.15.55:0/1660894574 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fae70014b40 con 0x7fae780ceff0 2023-08-25T05:37:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.655+0000 7fae74ff9640 1 --2- 172.21.15.55:0/1660894574 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fae640657a0 0x7fae64067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.655+0000 7fae74ff9640 1 -- 172.21.15.55:0/1660894574 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fae70083640 con 0x7fae780ceff0 2023-08-25T05:37:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.655+0000 7fae77fff640 1 --2- 172.21.15.55:0/1660894574 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fae640657a0 0x7fae64067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.655+0000 7fae77fff640 1 --2- 172.21.15.55:0/1660894574 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fae640657a0 0x7fae64067c60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fae68000f70 tx=0x7fae68007b80 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:19.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.659+0000 7fae74ff9640 1 -- 172.21.15.55:0/1660894574 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fae70051340 con 0x7fae780ceff0 2023-08-25T05:37:19.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.867+0000 7fae7e488640 1 -- 172.21.15.55:0/1660894574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fae7804dbe0 con 0x7fae780ceff0 2023-08-25T05:37:19.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.867+0000 7fae74ff9640 1 -- 172.21.15.55:0/1660894574 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v49) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fae70054960 con 0x7fae780ceff0 2023-08-25T05:37:19.871 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:19.871 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T05:37:19.872 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2023-08-25T05:37:19.872 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.872 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2023-08-25T05:37:19.872 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkgFrTEBAAoan9rk8Q+qPyMjb2vGUHhA==", 2023-08-25T05:37:19.872 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.872 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:37:19.872 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:37:19.873 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:37:19.873 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:37:19.873 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.873 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:19.873 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.873 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2023-08-25T05:37:19.873 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk18hNHRAAzXuhzQEONXRzRXTeCH9fKQ==", 2023-08-25T05:37:19.873 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.874 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:37:19.874 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:37:19.874 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:37:19.874 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:37:19.874 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.874 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:19.874 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.875 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2023-08-25T05:37:19.875 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkLF9CGBAAqxgRU/02SsZfWuZPSYxuZA==", 2023-08-25T05:37:19.875 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.875 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:37:19.875 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:37:19.875 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:37:19.875 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:37:19.875 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.876 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:19.876 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.876 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2023-08-25T05:37:19.876 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hky6HiJBAAsrXlTDn2cxbk7PnqSgNNkA==", 2023-08-25T05:37:19.876 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.876 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:37:19.876 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:37:19.876 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:37:19.877 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:37:19.877 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.877 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:19.877 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.877 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2023-08-25T05:37:19.877 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC+J+hkY1tDFBAAVQY5Xl8On9pN3jLWwKWGTA==", 2023-08-25T05:37:19.877 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.878 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:37:19.878 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:37:19.878 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:37:19.878 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.878 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:19.878 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.878 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2023-08-25T05:37:19.878 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDBJ+hkpdBCHRAADyMAxTsnQfkD9G0p48H4zQ==", 2023-08-25T05:37:19.879 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.879 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:37:19.879 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:37:19.879 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:37:19.879 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.879 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:19.879 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.879 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2023-08-25T05:37:19.880 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDEJ+hkOR49KRAAudbqAxLItsoczide8ybzAg==", 2023-08-25T05:37:19.880 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.880 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:37:19.880 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:37:19.880 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:37:19.880 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.880 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:19.881 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.881 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2023-08-25T05:37:19.881 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDHJ+hkxun5MBAAAhGtJYVeL3ogL3TQV67diw==", 2023-08-25T05:37:19.881 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.881 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:37:19.881 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:37:19.881 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:37:19.881 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.882 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:19.882 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.882 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2023-08-25T05:37:19.882 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDMJ+hkuosTCRAAqCuwHFZFBVR/7nFtHHByNg==", 2023-08-25T05:37:19.882 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.882 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:37:19.882 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:37:19.882 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:37:19.883 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.883 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:19.883 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.883 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2023-08-25T05:37:19.883 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDPJ+hkJa+SDhAAllo6biVE99BZWvv5K/gXGw==", 2023-08-25T05:37:19.883 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.883 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:37:19.883 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:37:19.884 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:37:19.884 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.884 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:19.884 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.884 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2023-08-25T05:37:19.884 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDSJ+hkUPywFBAA4jua1Eu1nRl2L6hX/mycfw==", 2023-08-25T05:37:19.884 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.885 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:37:19.885 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:37:19.885 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:37:19.885 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.885 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:19.885 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.885 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2023-08-25T05:37:19.885 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDVJ+hkhyDMGxAAmcSWLzJqIE5w5H/E4wIurQ==", 2023-08-25T05:37:19.886 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.886 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2023-08-25T05:37:19.886 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2023-08-25T05:37:19.886 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:37:19.886 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.886 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:19.886 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.886 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2023-08-25T05:37:19.887 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g==", 2023-08-25T05:37:19.887 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.887 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:37:19.887 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2023-08-25T05:37:19.887 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-25T05:37:19.887 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.887 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:19.887 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.888 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2023-08-25T05:37:19.888 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hk8KsDMxAAKyK4jMKflYNnJXYIbr2OBQ==", 2023-08-25T05:37:19.888 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.888 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:37:19.888 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T05:37:19.888 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T05:37:19.888 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T05:37:19.889 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.889 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:19.889 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.889 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2023-08-25T05:37:19.889 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjSA4LxAAxzbnHeV85qYZYhSqTOT2rw==", 2023-08-25T05:37:19.889 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.889 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:37:19.889 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T05:37:19.890 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T05:37:19.890 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T05:37:19.890 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.890 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:19.890 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.890 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2023-08-25T05:37:19.890 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkl9AoORAARYZcPObsM/HT/yrTmneZrw==", 2023-08-25T05:37:19.890 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.891 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2023-08-25T05:37:19.891 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2023-08-25T05:37:19.891 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2023-08-25T05:37:19.891 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2023-08-25T05:37:19.891 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.891 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:19.891 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.891 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2023-08-25T05:37:19.892 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC2J+hkgTdcLxAAqxSepXXhEultFAFYBBKSag==", 2023-08-25T05:37:19.892 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.892 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T05:37:19.892 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2023-08-25T05:37:19.892 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2023-08-25T05:37:19.892 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:37:19.892 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.893 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:19.893 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.893 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2023-08-25T05:37:19.893 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkYGUZDBAAiuDo9hqavWq7zQlGd6x4YQ==", 2023-08-25T05:37:19.893 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.893 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T05:37:19.893 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T05:37:19.893 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:37:19.894 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.894 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:19.894 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:19.894 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2023-08-25T05:37:19.894 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQC3J+hkjr9KCBAApSqjtFhLnjHduMBu/eaaKw==", 2023-08-25T05:37:19.894 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2023-08-25T05:37:19.894 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2023-08-25T05:37:19.894 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2023-08-25T05:37:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2023-08-25T05:37:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2023-08-25T05:37:19.895 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T05:37:19.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.871+0000 7fae7e488640 1 -- 172.21.15.55:0/1660894574 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fae640657a0 msgr2=0x7fae64067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:19.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.871+0000 7fae7e488640 1 --2- 172.21.15.55:0/1660894574 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fae640657a0 0x7fae64067c60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fae68000f70 tx=0x7fae68007b80 comp rx=0 tx=0).stop 2023-08-25T05:37:19.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.871+0000 7fae7e488640 1 -- 172.21.15.55:0/1660894574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae780ceff0 msgr2=0x7fae780ac110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:19.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.871+0000 7fae7e488640 1 --2- 172.21.15.55:0/1660894574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae780ceff0 0x7fae780ac110 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7fae70007e40 tx=0x7fae7000e4b0 comp rx=0 tx=0).stop 2023-08-25T05:37:19.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.871+0000 7fae7e488640 1 -- 172.21.15.55:0/1660894574 shutdown_connections 2023-08-25T05:37:19.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.871+0000 7fae7e488640 1 --2- 172.21.15.55:0/1660894574 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fae640657a0 0x7fae64067c60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:19.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.871+0000 7fae7e488640 1 --2- 172.21.15.55:0/1660894574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae780ceff0 0x7fae780ac110 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:19.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.871+0000 7fae7e488640 1 --2- 172.21.15.55:0/1660894574 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae780aeb10 0x7fae780c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:19.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.871+0000 7fae7e488640 1 --2- 172.21.15.55:0/1660894574 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae78069e40 0x7fae781488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:19.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.871+0000 7fae7e488640 1 -- 172.21.15.55:0/1660894574 >> 172.21.15.55:0/1660894574 conn(0x7fae780cf530 msgr2=0x7fae78072b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:19.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.871+0000 7fae7e488640 1 -- 172.21.15.55:0/1660894574 shutdown_connections 2023-08-25T05:37:19.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:19.871+0000 7fae7e488640 1 -- 172.21.15.55:0/1660894574 wait complete. 2023-08-25T05:37:19.898 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:37:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.039+0000 7f02b7737640 1 Processor -- start 2023-08-25T05:37:20.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.039+0000 7f02b7737640 1 -- start start 2023-08-25T05:37:20.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.043+0000 7f02b7737640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02b015eba0 0x7f02b00b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:20.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.043+0000 7f02b7737640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02b015ef80 0x7f02b00ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:20.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.043+0000 7f02b7737640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f02b00cece0 0x7f02b00cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:20.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.043+0000 7f02b7737640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b00cf170 con 0x7f02b015ef80 2023-08-25T05:37:20.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.043+0000 7f02b7737640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b00ac3a0 con 0x7f02b00cece0 2023-08-25T05:37:20.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.043+0000 7f02b7737640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00b1390 con 0x7f02b015eba0 2023-08-25T05:37:20.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.043+0000 7f02b4cd2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02b015ef80 0x7f02b00ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:20.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.043+0000 7f02b4cd2640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02b015ef80 0x7f02b00ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33730/0 (socket says 172.21.15.55:33730) 2023-08-25T05:37:20.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.043+0000 7f02b4cd2640 1 -- 172.21.15.55:0/1244783625 learned_addr learned my addr 172.21.15.55:0/1244783625 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.043+0000 7f02b54d3640 1 --2- 172.21.15.55:0/1244783625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02b015eba0 0x7f02b00b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.043+0000 7f02b4cd2640 1 -- 172.21.15.55:0/1244783625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02b015eba0 msgr2=0x7f02b00b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.043+0000 7f02b5cd4640 1 --2- 172.21.15.55:0/1244783625 >> v2:172.21.15.110:3300/0 conn(0x7f02b00cece0 0x7f02b00cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:20.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.043+0000 7f02b4cd2640 1 --2- 172.21.15.55:0/1244783625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02b015eba0 0x7f02b00b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.043+0000 7f02b4cd2640 1 -- 172.21.15.55:0/1244783625 >> v2:172.21.15.110:3300/0 conn(0x7f02b00cece0 msgr2=0x7f02b00cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.043+0000 7f02b4cd2640 1 --2- 172.21.15.55:0/1244783625 >> v2:172.21.15.110:3300/0 conn(0x7f02b00cece0 0x7f02b00cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.043+0000 7f02b4cd2640 1 -- 172.21.15.55:0/1244783625 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b00b1670 con 0x7f02b015ef80 2023-08-25T05:37:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.043+0000 7f02b54d3640 1 --2- 172.21.15.55:0/1244783625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02b015eba0 0x7f02b00b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:20.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.043+0000 7f02b5cd4640 1 --2- 172.21.15.55:0/1244783625 >> v2:172.21.15.110:3300/0 conn(0x7f02b00cece0 0x7f02b00cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:20.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.047+0000 7f02b4cd2640 1 --2- 172.21.15.55:0/1244783625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b015ef80 0x7f02b00ce7a0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f02b006a8c0 tx=0x7f02a001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2cb056f527b0971 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:20.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.047+0000 7f02a7fff640 1 -- 172.21.15.55:0/1244783625 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a00ab600 con 0x7f02b015ef80 2023-08-25T05:37:20.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.047+0000 7f02a7fff640 1 -- 172.21.15.55:0/1244783625 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a00a7050 con 0x7f02b015ef80 2023-08-25T05:37:20.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.047+0000 7f02a7fff640 1 -- 172.21.15.55:0/1244783625 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a00ab980 con 0x7f02b015ef80 2023-08-25T05:37:20.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.047+0000 7f02b7737640 1 -- 172.21.15.55:0/1244783625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b015ef80 msgr2=0x7f02b00ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:20.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.047+0000 7f02b7737640 1 --2- 172.21.15.55:0/1244783625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b015ef80 0x7f02b00ce7a0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f02b006a8c0 tx=0x7f02a001c210 comp rx=0 tx=0).stop 2023-08-25T05:37:20.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.047+0000 7f02b7737640 1 -- 172.21.15.55:0/1244783625 shutdown_connections 2023-08-25T05:37:20.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.047+0000 7f02b7737640 1 --2- 172.21.15.55:0/1244783625 >> v2:172.21.15.110:3300/0 conn(0x7f02b00cece0 0x7f02b00cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.047+0000 7f02b7737640 1 --2- 172.21.15.55:0/1244783625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b015ef80 0x7f02b00ce7a0 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.047+0000 7f02b7737640 1 --2- 172.21.15.55:0/1244783625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02b015eba0 0x7f02b00b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.047+0000 7f02b7737640 1 -- 172.21.15.55:0/1244783625 >> 172.21.15.55:0/1244783625 conn(0x7f02b0069d00 msgr2=0x7f02b006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:20.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.047+0000 7f02b7737640 1 -- 172.21.15.55:0/1244783625 shutdown_connections 2023-08-25T05:37:20.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.047+0000 7f02b7737640 1 -- 172.21.15.55:0/1244783625 wait complete. 2023-08-25T05:37:20.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.047+0000 7f02b7737640 1 Processor -- start 2023-08-25T05:37:20.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.047+0000 7f02b7737640 1 -- start start 2023-08-25T05:37:20.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b7737640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02b00cece0 0x7f02b00c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:20.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b7737640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b015eba0 0x7f02b0159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:20.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b7737640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02b015ef80 0x7f02b01646b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:20.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b7737640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00c5470 con 0x7f02b015eba0 2023-08-25T05:37:20.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b7737640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00c47a0 con 0x7f02b00cece0 2023-08-25T05:37:20.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b7737640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00c4a80 con 0x7f02b015ef80 2023-08-25T05:37:20.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b4cd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b015eba0 0x7f02b0159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:20.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b4cd2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b015eba0 0x7f02b0159ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33742/0 (socket says 172.21.15.55:33742) 2023-08-25T05:37:20.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b4cd2640 1 -- 172.21.15.55:0/1545260248 learned_addr learned my addr 172.21.15.55:0/1545260248 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:20.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b54d3640 1 --2- 172.21.15.55:0/1545260248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02b00cece0 0x7f02b00c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:20.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b5cd4640 1 --2- 172.21.15.55:0/1545260248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02b015ef80 0x7f02b01646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:20.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b4cd2640 1 -- 172.21.15.55:0/1545260248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02b015ef80 msgr2=0x7f02b01646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:20.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b4cd2640 1 --2- 172.21.15.55:0/1545260248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02b015ef80 0x7f02b01646b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b4cd2640 1 -- 172.21.15.55:0/1545260248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02b00cece0 msgr2=0x7f02b00c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:20.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b4cd2640 1 --2- 172.21.15.55:0/1545260248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02b00cece0 0x7f02b00c4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b4cd2640 1 -- 172.21.15.55:0/1545260248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a00094d0 con 0x7f02b015eba0 2023-08-25T05:37:20.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b5cd4640 1 --2- 172.21.15.55:0/1545260248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02b015ef80 0x7f02b01646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:20.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b4cd2640 1 --2- 172.21.15.55:0/1545260248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b015eba0 0x7f02b0159ba0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f02a00ae040 tx=0x7f02a0018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:20.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02a5ffb640 1 -- 172.21.15.55:0/1545260248 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a00b4640 con 0x7f02b015eba0 2023-08-25T05:37:20.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02a5ffb640 1 -- 172.21.15.55:0/1545260248 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a00b47c0 con 0x7f02b015eba0 2023-08-25T05:37:20.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02a5ffb640 1 -- 172.21.15.55:0/1545260248 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a00b4b70 con 0x7f02b015eba0 2023-08-25T05:37:20.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b7737640 1 -- 172.21.15.55:0/1545260248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b00c4d60 con 0x7f02b015eba0 2023-08-25T05:37:20.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b7737640 1 -- 172.21.15.55:0/1545260248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b00c20d0 con 0x7f02b015eba0 2023-08-25T05:37:20.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02b7737640 1 -- 172.21.15.55:0/1545260248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b004dbe0 con 0x7f02b015eba0 2023-08-25T05:37:20.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.051+0000 7f02a5ffb640 1 -- 172.21.15.55:0/1545260248 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f02a00b2070 con 0x7f02b015eba0 2023-08-25T05:37:20.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.055+0000 7f02a5ffb640 1 --2- 172.21.15.55:0/1545260248 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f02940657d0 0x7f0294067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:20.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.055+0000 7f02a5ffb640 1 -- 172.21.15.55:0/1545260248 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f02a011cbd0 con 0x7f02b015eba0 2023-08-25T05:37:20.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.055+0000 7f02b54d3640 1 --2- 172.21.15.55:0/1545260248 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f02940657d0 0x7f0294067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:20.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.055+0000 7f02b54d3640 1 --2- 172.21.15.55:0/1545260248 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f02940657d0 0x7f0294067c90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f02b00afa00 tx=0x7f02ac008040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:20.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.059+0000 7f02a5ffb640 1 -- 172.21.15.55:0/1545260248 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f02a00ea720 con 0x7f02b015eba0 2023-08-25T05:37:20.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.215+0000 7f02b7737640 1 -- 172.21.15.55:0/1545260248 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02b00ccc40 con 0x7f02b015eba0 2023-08-25T05:37:20.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.215+0000 7f02a5ffb640 1 -- 172.21.15.55:0/1545260248 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v198) v1 ==== 74+0+14661 (secure 0 0 0) 0x7f02a0119960 con 0x7f02b015eba0 2023-08-25T05:37:20.218 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:20.218 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":198,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:37:19.477530+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":186,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:37:20.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.219+0000 7f02b7737640 1 -- 172.21.15.55:0/1545260248 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f02940657d0 msgr2=0x7f0294067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:20.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.219+0000 7f02b7737640 1 --2- 172.21.15.55:0/1545260248 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f02940657d0 0x7f0294067c90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f02b00afa00 tx=0x7f02ac008040 comp rx=0 tx=0).stop 2023-08-25T05:37:20.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.219+0000 7f02b7737640 1 -- 172.21.15.55:0/1545260248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b015eba0 msgr2=0x7f02b0159ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:20.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.219+0000 7f02b7737640 1 --2- 172.21.15.55:0/1545260248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b015eba0 0x7f02b0159ba0 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f02a00ae040 tx=0x7f02a0018fb0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.219+0000 7f02b7737640 1 -- 172.21.15.55:0/1545260248 shutdown_connections 2023-08-25T05:37:20.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.219+0000 7f02b7737640 1 --2- 172.21.15.55:0/1545260248 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f02940657d0 0x7f0294067c90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.219+0000 7f02b7737640 1 --2- 172.21.15.55:0/1545260248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02b015ef80 0x7f02b01646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.219+0000 7f02b7737640 1 --2- 172.21.15.55:0/1545260248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02b015eba0 0x7f02b0159ba0 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.219+0000 7f02b7737640 1 --2- 172.21.15.55:0/1545260248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02b00cece0 0x7f02b00c4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.219+0000 7f02b7737640 1 -- 172.21.15.55:0/1545260248 >> 172.21.15.55:0/1545260248 conn(0x7f02b0069d00 msgr2=0x7f02b00ac5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:20.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.219+0000 7f02b7737640 1 -- 172.21.15.55:0/1545260248 shutdown_connections 2023-08-25T05:37:20.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.219+0000 7f02b7737640 1 -- 172.21.15.55:0/1545260248 wait complete. 2023-08-25T05:37:20.239 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T05:37:20.240 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T05:37:20.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.383+0000 7f6ab3a88640 1 Processor -- start 2023-08-25T05:37:20.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.383+0000 7f6ab3a88640 1 -- start start 2023-08-25T05:37:20.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.387+0000 7f6ab3a88640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6aac0cd620 0x7f6aac0cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:20.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.387+0000 7f6ab3a88640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aac0ce5a0 con 0x7f6aac0ce110 2023-08-25T05:37:20.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.387+0000 7f6ab3a88640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aac0ce880 con 0x7f6aac15a840 2023-08-25T05:37:20.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.387+0000 7f6ab3a88640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aac0cf640 con 0x7f6aac0cd620 2023-08-25T05:37:20.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.387+0000 7f6ab1023640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6aac0ce110 0x7f6aac1626d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43646/0 (socket says 172.21.15.55:43646) 2023-08-25T05:37:20.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.387+0000 7f6ab1023640 1 -- 172.21.15.55:0/2454664354 learned_addr learned my addr 172.21.15.55:0/2454664354 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:20.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.387+0000 7f6ab2025640 1 --2- 172.21.15.55:0/2454664354 >> v2:172.21.15.55:3300/0 conn(0x7f6aac0cd620 0x7f6aac0cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:20.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.387+0000 7f6ab2025640 1 -- 172.21.15.55:0/2454664354 >> v1:172.21.15.110:6789/0 conn(0x7f6aac15a840 legacy=0x7f6aac0ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:20.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.387+0000 7f6ab2025640 1 -- 172.21.15.55:0/2454664354 >> v1:172.21.15.55:6789/0 conn(0x7f6aac0ce110 legacy=0x7f6aac1626d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:20.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.387+0000 7f6ab2025640 1 -- 172.21.15.55:0/2454664354 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aac0ceb60 con 0x7f6aac0cd620 2023-08-25T05:37:20.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.387+0000 7f6ab2025640 1 --2- 172.21.15.55:0/2454664354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aac0cd620 0x7f6aac0cc140 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009d90 tx=0x7f6aa401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a02f7b1099b887f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:20.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.387+0000 7f6ab0822640 1 -- 172.21.15.55:0/2454664354 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40a5900 con 0x7f6aac0cd620 2023-08-25T05:37:20.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab0822640 1 -- 172.21.15.55:0/2454664354 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa40a5a60 con 0x7f6aac0cd620 2023-08-25T05:37:20.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab0822640 1 -- 172.21.15.55:0/2454664354 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40a5df0 con 0x7f6aac0cd620 2023-08-25T05:37:20.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab3a88640 1 -- 172.21.15.55:0/2454664354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aac0cd620 msgr2=0x7f6aac0cc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:20.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab3a88640 1 --2- 172.21.15.55:0/2454664354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aac0cd620 0x7f6aac0cc140 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009d90 tx=0x7f6aa401c950 comp rx=0 tx=0).stop 2023-08-25T05:37:20.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab3a88640 1 -- 172.21.15.55:0/2454664354 shutdown_connections 2023-08-25T05:37:20.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab3a88640 1 --2- 172.21.15.55:0/2454664354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aac0cd620 0x7f6aac0cc140 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab3a88640 1 -- 172.21.15.55:0/2454664354 >> 172.21.15.55:0/2454664354 conn(0x7f6aac0d0540 msgr2=0x7f6aac0d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:20.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab3a88640 1 -- 172.21.15.55:0/2454664354 shutdown_connections 2023-08-25T05:37:20.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab3a88640 1 -- 172.21.15.55:0/2454664354 wait complete. 2023-08-25T05:37:20.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab3a88640 1 Processor -- start 2023-08-25T05:37:20.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab3a88640 1 -- start start 2023-08-25T05:37:20.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab3a88640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aac0cd620 0x7f6aac0c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:20.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab3a88640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6aac15a840 0x7f6aac0c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:20.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab3a88640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6aac0b1e00 0x7f6aac0b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:20.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab3a88640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac0c9890 con 0x7f6aac0cd620 2023-08-25T05:37:20.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab3a88640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac0c8c80 con 0x7f6aac0b1e00 2023-08-25T05:37:20.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab3a88640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aac0c8f60 con 0x7f6aac15a840 2023-08-25T05:37:20.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab1824640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aac0cd620 0x7f6aac0c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:20.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab1824640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aac0cd620 0x7f6aac0c9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33746/0 (socket says 172.21.15.55:33746) 2023-08-25T05:37:20.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab1824640 1 -- 172.21.15.55:0/702301500 learned_addr learned my addr 172.21.15.55:0/702301500 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:20.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.391+0000 7f6ab1023640 1 --2- 172.21.15.55:0/702301500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6aac15a840 0x7f6aac0c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:20.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.395+0000 7f6ab2025640 1 --2- 172.21.15.55:0/702301500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6aac0b1e00 0x7f6aac0b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:20.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.395+0000 7f6ab1824640 1 -- 172.21.15.55:0/702301500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6aac15a840 msgr2=0x7f6aac0c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:20.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.395+0000 7f6ab1824640 1 --2- 172.21.15.55:0/702301500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6aac15a840 0x7f6aac0c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.395+0000 7f6ab1824640 1 -- 172.21.15.55:0/702301500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6aac0b1e00 msgr2=0x7f6aac0b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:20.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.395+0000 7f6ab1824640 1 --2- 172.21.15.55:0/702301500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6aac0b1e00 0x7f6aac0b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.395+0000 7f6ab1824640 1 -- 172.21.15.55:0/702301500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa4009a70 con 0x7f6aac0cd620 2023-08-25T05:37:20.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.395+0000 7f6ab1824640 1 --2- 172.21.15.55:0/702301500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aac0cd620 0x7f6aac0c9d20 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f6aa800c450 tx=0x7f6aa800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:20.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.395+0000 7f6aa27fc640 1 -- 172.21.15.55:0/702301500 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa80052d0 con 0x7f6aac0cd620 2023-08-25T05:37:20.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.395+0000 7f6aa27fc640 1 -- 172.21.15.55:0/702301500 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa8005430 con 0x7f6aac0cd620 2023-08-25T05:37:20.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.395+0000 7f6aa27fc640 1 -- 172.21.15.55:0/702301500 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8003890 con 0x7f6aac0cd620 2023-08-25T05:37:20.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.395+0000 7f6ab3a88640 1 -- 172.21.15.55:0/702301500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aac0c9240 con 0x7f6aac0cd620 2023-08-25T05:37:20.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.395+0000 7f6ab3a88640 1 -- 172.21.15.55:0/702301500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aac152280 con 0x7f6aac0cd620 2023-08-25T05:37:20.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.395+0000 7f6ab3a88640 1 -- 172.21.15.55:0/702301500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aac0b6490 con 0x7f6aac0cd620 2023-08-25T05:37:20.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.395+0000 7f6aa27fc640 1 -- 172.21.15.55:0/702301500 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f6aa80039f0 con 0x7f6aac0cd620 2023-08-25T05:37:20.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.395+0000 7f6aa27fc640 1 --2- 172.21.15.55:0/702301500 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f6a900657a0 0x7f6a90067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:20.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.395+0000 7f6aa27fc640 1 -- 172.21.15.55:0/702301500 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6aa8082850 con 0x7f6aac0cd620 2023-08-25T05:37:20.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.399+0000 7f6ab1023640 1 --2- 172.21.15.55:0/702301500 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f6a900657a0 0x7f6a90067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:20.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.399+0000 7f6ab1023640 1 --2- 172.21.15.55:0/702301500 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f6a900657a0 0x7f6a90067c60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0ad460 tx=0x7f6a9c009040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:20.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.399+0000 7f6aa27fc640 1 -- 172.21.15.55:0/702301500 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f6aa80504b0 con 0x7f6aac0cd620 2023-08-25T05:37:20.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.563+0000 7f6ab3a88640 1 -- 172.21.15.55:0/702301500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6aac06f450 con 0x7f6aac0cd620 2023-08-25T05:37:20.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.563+0000 7f6aa27fc640 1 -- 172.21.15.55:0/702301500 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v198) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6aa8053ad0 con 0x7f6aac0cd620 2023-08-25T05:37:20.565 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T05:37:20.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.563+0000 7f6ab3a88640 1 -- 172.21.15.55:0/702301500 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f6a900657a0 msgr2=0x7f6a90067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:20.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.563+0000 7f6ab3a88640 1 --2- 172.21.15.55:0/702301500 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f6a900657a0 0x7f6a90067c60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6aac0ad460 tx=0x7f6a9c009040 comp rx=0 tx=0).stop 2023-08-25T05:37:20.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.563+0000 7f6ab3a88640 1 -- 172.21.15.55:0/702301500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aac0cd620 msgr2=0x7f6aac0c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:20.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.563+0000 7f6ab3a88640 1 --2- 172.21.15.55:0/702301500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aac0cd620 0x7f6aac0c9d20 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f6aa800c450 tx=0x7f6aa800c910 comp rx=0 tx=0).stop 2023-08-25T05:37:20.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.563+0000 7f6ab3a88640 1 -- 172.21.15.55:0/702301500 shutdown_connections 2023-08-25T05:37:20.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.563+0000 7f6ab3a88640 1 --2- 172.21.15.55:0/702301500 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f6a900657a0 0x7f6a90067c60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.563+0000 7f6ab3a88640 1 --2- 172.21.15.55:0/702301500 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6aac0b1e00 0x7f6aac0b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.563+0000 7f6ab3a88640 1 --2- 172.21.15.55:0/702301500 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6aac15a840 0x7f6aac0c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.563+0000 7f6ab3a88640 1 --2- 172.21.15.55:0/702301500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aac0cd620 0x7f6aac0c9d20 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.563+0000 7f6ab3a88640 1 -- 172.21.15.55:0/702301500 >> 172.21.15.55:0/702301500 conn(0x7f6aac0d0540 msgr2=0x7f6aac0d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:20.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.563+0000 7f6ab3a88640 1 -- 172.21.15.55:0/702301500 shutdown_connections 2023-08-25T05:37:20.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.563+0000 7f6ab3a88640 1 -- 172.21.15.55:0/702301500 wait complete. 2023-08-25T05:37:20.586 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T05:37:20.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe889d640 1 Processor -- start 2023-08-25T05:37:20.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe889d640 1 -- start start 2023-08-25T05:37:20.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe889d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffbe415fca0 0x7ffbe40cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:20.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe889d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe40cfac0 0x7ffbe40b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:20.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe889d640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe40cfee0 con 0x7ffbe40b8330 2023-08-25T05:37:20.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe889d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe4160080 con 0x7ffbe415fca0 2023-08-25T05:37:20.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe889d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40b70c0 con 0x7ffbe40cfac0 2023-08-25T05:37:20.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe359e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe40cfac0 0x7ffbe40b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:20.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe2d9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffbe415fca0 0x7ffbe40cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:20.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe2d9d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ffbe415fca0 0x7ffbe40cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:34652/0 (socket says 172.21.15.55:34652) 2023-08-25T05:37:20.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe2d9d640 1 -- 172.21.15.55:0/3712846358 learned_addr learned my addr 172.21.15.55:0/3712846358 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:20.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe359e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe40cfac0 0x7ffbe40b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:58258/0 (socket says 172.21.15.55:58258) 2023-08-25T05:37:20.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe259c640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ffbe40b8330 0x7ffbe40d0bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:49146/0 (socket says 172.21.15.55:49146) 2023-08-25T05:37:20.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe2d9d640 1 -- 172.21.15.55:0/3712846358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe40cfac0 msgr2=0x7ffbe40b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:20.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe2d9d640 1 --2- 172.21.15.55:0/3712846358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe40cfac0 0x7ffbe40b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe2d9d640 1 -- 172.21.15.55:0/3712846358 >> v1:172.21.15.110:6789/0 conn(0x7ffbe40b8330 legacy=0x7ffbe40d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:20.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe2d9d640 1 -- 172.21.15.55:0/3712846358 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe40b73a0 con 0x7ffbe415fca0 2023-08-25T05:37:20.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe1d9b640 1 -- 172.21.15.55:0/3712846358 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391395256 0 0) 0x7ffbe40cfee0 con 0x7ffbe40b8330 2023-08-25T05:37:20.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.731+0000 7ffbe359e640 1 --2- 172.21.15.55:0/3712846358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe40cfac0 0x7ffbe40b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:20.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.735+0000 7ffbe2d9d640 1 --2- 172.21.15.55:0/3712846358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe415fca0 0x7ffbe40cf580 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009870 tx=0x7ffbd401ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9afb99d30c73da82 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:20.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.735+0000 7ffbe1d9b640 1 -- 172.21.15.55:0/3712846358 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd40a8a30 con 0x7ffbe415fca0 2023-08-25T05:37:20.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.735+0000 7ffbe1d9b640 1 -- 172.21.15.55:0/3712846358 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd40a8b90 con 0x7ffbe415fca0 2023-08-25T05:37:20.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.735+0000 7ffbe1d9b640 1 -- 172.21.15.55:0/3712846358 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd40b0440 con 0x7ffbe415fca0 2023-08-25T05:37:20.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.735+0000 7ffbe889d640 1 -- 172.21.15.55:0/3712846358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe415fca0 msgr2=0x7ffbe40cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:20.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.735+0000 7ffbe889d640 1 --2- 172.21.15.55:0/3712846358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe415fca0 0x7ffbe40cf580 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7ffbd4009870 tx=0x7ffbd401ed30 comp rx=0 tx=0).stop 2023-08-25T05:37:20.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.735+0000 7ffbe889d640 1 -- 172.21.15.55:0/3712846358 shutdown_connections 2023-08-25T05:37:20.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.735+0000 7ffbe889d640 1 --2- 172.21.15.55:0/3712846358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe40cfac0 0x7ffbe40b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.735+0000 7ffbe889d640 1 --2- 172.21.15.55:0/3712846358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe415fca0 0x7ffbe40cf580 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.735+0000 7ffbe889d640 1 -- 172.21.15.55:0/3712846358 >> 172.21.15.55:0/3712846358 conn(0x7ffbe40658c0 msgr2=0x7ffbe4065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:20.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.735+0000 7ffbe889d640 1 -- 172.21.15.55:0/3712846358 shutdown_connections 2023-08-25T05:37:20.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.735+0000 7ffbe889d640 1 -- 172.21.15.55:0/3712846358 wait complete. 2023-08-25T05:37:20.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe889d640 1 Processor -- start 2023-08-25T05:37:20.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe889d640 1 -- start start 2023-08-25T05:37:20.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe889d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe40b8330 0x7ffbe40c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:20.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe889d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe40cfac0 0x7ffbe4150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:20.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe889d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbe415fca0 0x7ffbe40cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:20.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe889d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40cab70 con 0x7ffbe415fca0 2023-08-25T05:37:20.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe889d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe4150570 con 0x7ffbe40cfac0 2023-08-25T05:37:20.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe889d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40c9ef0 con 0x7ffbe40b8330 2023-08-25T05:37:20.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbe415fca0 0x7ffbe40cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:20.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe2d9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe40b8330 0x7ffbe40c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:20.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbe415fca0 0x7ffbe40cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54074/0 (socket says 172.21.15.55:54074) 2023-08-25T05:37:20.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe2d9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe40b8330 0x7ffbe40c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:58272/0 (socket says 172.21.15.55:58272) 2023-08-25T05:37:20.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe359e640 1 -- 172.21.15.55:0/2712628021 learned_addr learned my addr 172.21.15.55:0/2712628021 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:20.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe259c640 1 --2- 172.21.15.55:0/2712628021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe40cfac0 0x7ffbe4150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:20.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe2d9d640 1 -- 172.21.15.55:0/2712628021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe40cfac0 msgr2=0x7ffbe4150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:20.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe2d9d640 1 --2- 172.21.15.55:0/2712628021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe40cfac0 0x7ffbe4150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe2d9d640 1 -- 172.21.15.55:0/2712628021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbe415fca0 msgr2=0x7ffbe40cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:20.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe2d9d640 1 --2- 172.21.15.55:0/2712628021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbe415fca0 0x7ffbe40cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe2d9d640 1 -- 172.21.15.55:0/2712628021 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbdc009a70 con 0x7ffbe40b8330 2023-08-25T05:37:20.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe359e640 1 --2- 172.21.15.55:0/2712628021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbe415fca0 0x7ffbe40cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:20.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe2d9d640 1 --2- 172.21.15.55:0/2712628021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe40b8330 0x7ffbe40c96c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40af000 tx=0x7ffbd401bad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:20.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbcb7fe640 1 -- 172.21.15.55:0/2712628021 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd40b0e70 con 0x7ffbe40b8330 2023-08-25T05:37:20.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbcb7fe640 1 -- 172.21.15.55:0/2712628021 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd40bb480 con 0x7ffbe40b8330 2023-08-25T05:37:20.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbcb7fe640 1 -- 172.21.15.55:0/2712628021 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd40bb850 con 0x7ffbe40b8330 2023-08-25T05:37:20.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe889d640 1 -- 172.21.15.55:0/2712628021 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd40094d0 con 0x7ffbe40b8330 2023-08-25T05:37:20.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.739+0000 7ffbe889d640 1 -- 172.21.15.55:0/2712628021 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe40ca4b0 con 0x7ffbe40b8330 2023-08-25T05:37:20.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.743+0000 7ffbe889d640 1 -- 172.21.15.55:0/2712628021 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe4073e50 con 0x7ffbe40b8330 2023-08-25T05:37:20.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.743+0000 7ffbcb7fe640 1 -- 172.21.15.55:0/2712628021 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7ffbd40bb9b0 con 0x7ffbe40b8330 2023-08-25T05:37:20.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.743+0000 7ffbcb7fe640 1 --2- 172.21.15.55:0/2712628021 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7ffbd00657a0 0x7ffbd0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:20.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.743+0000 7ffbcb7fe640 1 -- 172.21.15.55:0/2712628021 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ffbd4121a20 con 0x7ffbe40b8330 2023-08-25T05:37:20.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.743+0000 7ffbe259c640 1 --2- 172.21.15.55:0/2712628021 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7ffbd00657a0 0x7ffbd0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:20.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.743+0000 7ffbe259c640 1 --2- 172.21.15.55:0/2712628021 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7ffbd00657a0 0x7ffbd0067c60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4153c90 tx=0x7ffbd8007d60 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:20.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.747+0000 7ffbcb7fe640 1 -- 172.21.15.55:0/2712628021 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ffbd40ef7b0 con 0x7ffbe40b8330 2023-08-25T05:37:20.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.907+0000 7ffbe889d640 1 -- 172.21.15.55:0/2712628021 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ffbe415f0f0 con 0x7ffbe40b8330 2023-08-25T05:37:20.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.907+0000 7ffbcb7fe640 1 -- 172.21.15.55:0/2712628021 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v198) v1 ==== 92+0+10 (secure 0 0 0) 0x7ffbd40b5020 con 0x7ffbe40b8330 2023-08-25T05:37:20.911 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T05:37:20.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.911+0000 7ffbe889d640 1 -- 172.21.15.55:0/2712628021 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7ffbd00657a0 msgr2=0x7ffbd0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:20.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.911+0000 7ffbe889d640 1 --2- 172.21.15.55:0/2712628021 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7ffbd00657a0 0x7ffbd0067c60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4153c90 tx=0x7ffbd8007d60 comp rx=0 tx=0).stop 2023-08-25T05:37:20.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.911+0000 7ffbe889d640 1 -- 172.21.15.55:0/2712628021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe40b8330 msgr2=0x7ffbe40c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:20.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.911+0000 7ffbe889d640 1 --2- 172.21.15.55:0/2712628021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe40b8330 0x7ffbe40c96c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ffbd40af000 tx=0x7ffbd401bad0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.911+0000 7ffbe889d640 1 -- 172.21.15.55:0/2712628021 shutdown_connections 2023-08-25T05:37:20.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.911+0000 7ffbe889d640 1 --2- 172.21.15.55:0/2712628021 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7ffbd00657a0 0x7ffbd0067c60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.911+0000 7ffbe889d640 1 --2- 172.21.15.55:0/2712628021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffbe415fca0 0x7ffbe40cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.911+0000 7ffbe889d640 1 --2- 172.21.15.55:0/2712628021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffbe40cfac0 0x7ffbe4150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.911+0000 7ffbe889d640 1 --2- 172.21.15.55:0/2712628021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffbe40b8330 0x7ffbe40c96c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:20.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.911+0000 7ffbe889d640 1 -- 172.21.15.55:0/2712628021 >> 172.21.15.55:0/2712628021 conn(0x7ffbe40658c0 msgr2=0x7ffbe4152880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:20.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.911+0000 7ffbe889d640 1 -- 172.21.15.55:0/2712628021 shutdown_connections 2023-08-25T05:37:20.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:20.911+0000 7ffbe889d640 1 -- 172.21.15.55:0/2712628021 wait complete. 2023-08-25T05:37:20.933 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-25T05:37:21.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.075+0000 7faa8d29e640 1 Processor -- start 2023-08-25T05:37:21.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.075+0000 7faa8d29e640 1 -- start start 2023-08-25T05:37:21.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.079+0000 7faa8d29e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faa880ce220 0x7faa880b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:21.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.079+0000 7faa8d29e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa880b29b0 con 0x7faa880d0da0 2023-08-25T05:37:21.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.079+0000 7faa8d29e640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa880ce690 con 0x7faa880cdde0 2023-08-25T05:37:21.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.079+0000 7faa8d29e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa880b1dc0 con 0x7faa880ce220 2023-08-25T05:37:21.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.079+0000 7faa86ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faa880d0da0 0x7faa880d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34328/0 (socket says 172.21.15.55:34328) 2023-08-25T05:37:21.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.079+0000 7faa86ffd640 1 -- 172.21.15.55:0/477380243 learned_addr learned my addr 172.21.15.55:0/477380243 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:21.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.079+0000 7faa877fe640 1 --2- 172.21.15.55:0/477380243 >> v2:172.21.15.110:3300/0 conn(0x7faa880ce220 0x7faa880b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:21.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.079+0000 7faa867fc640 1 -- 172.21.15.55:0/477380243 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824447365 0 0) 0x7faa880b29b0 con 0x7faa880d0da0 2023-08-25T05:37:21.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.079+0000 7faa867fc640 1 -- 172.21.15.55:0/477380243 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa74003530 con 0x7faa880d0da0 2023-08-25T05:37:21.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.079+0000 7faa877fe640 1 -- 172.21.15.55:0/477380243 >> v1:172.21.15.110:6789/0 conn(0x7faa880cdde0 legacy=0x7faa880b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:21.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.079+0000 7faa867fc640 1 -- 172.21.15.55:0/477380243 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3378203958 0 0) 0x7faa880ce690 con 0x7faa880cdde0 2023-08-25T05:37:21.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.079+0000 7faa877fe640 1 -- 172.21.15.55:0/477380243 >> v1:172.21.15.55:6789/0 conn(0x7faa880d0da0 legacy=0x7faa880d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:21.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.079+0000 7faa877fe640 1 -- 172.21.15.55:0/477380243 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa880b2080 con 0x7faa880ce220 2023-08-25T05:37:21.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa877fe640 1 --2- 172.21.15.55:0/477380243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa880ce220 0x7faa880b3550 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7faa80009d90 tx=0x7faa8001f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b36675f549fd7ead server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:21.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa867fc640 1 -- 172.21.15.55:0/477380243 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa800af600 con 0x7faa880ce220 2023-08-25T05:37:21.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa867fc640 1 -- 172.21.15.55:0/477380243 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa800ab050 con 0x7faa880ce220 2023-08-25T05:37:21.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa867fc640 1 -- 172.21.15.55:0/477380243 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa800af980 con 0x7faa880ce220 2023-08-25T05:37:21.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa8d29e640 1 -- 172.21.15.55:0/477380243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa880ce220 msgr2=0x7faa880b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:21.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa8d29e640 1 --2- 172.21.15.55:0/477380243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa880ce220 0x7faa880b3550 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7faa80009d90 tx=0x7faa8001f130 comp rx=0 tx=0).stop 2023-08-25T05:37:21.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa8d29e640 1 -- 172.21.15.55:0/477380243 shutdown_connections 2023-08-25T05:37:21.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa8d29e640 1 --2- 172.21.15.55:0/477380243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa880ce220 0x7faa880b3550 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:21.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa8d29e640 1 -- 172.21.15.55:0/477380243 >> 172.21.15.55:0/477380243 conn(0x7faa8809bae0 msgr2=0x7faa880d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:21.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa8d29e640 1 -- 172.21.15.55:0/477380243 shutdown_connections 2023-08-25T05:37:21.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa8d29e640 1 -- 172.21.15.55:0/477380243 wait complete. 2023-08-25T05:37:21.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa8d29e640 1 Processor -- start 2023-08-25T05:37:21.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa8d29e640 1 -- start start 2023-08-25T05:37:21.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa8d29e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa880cdde0 0x7faa8806ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:21.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa8d29e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa880ce220 0x7faa8806b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:21.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa8d29e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa880d0da0 0x7faa88159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:21.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa8d29e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa881579d0 con 0x7faa880d0da0 2023-08-25T05:37:21.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa8d29e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8815b470 con 0x7faa880cdde0 2023-08-25T05:37:21.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa8d29e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa88156dc0 con 0x7faa880ce220 2023-08-25T05:37:21.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.083+0000 7faa877fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa880d0da0 0x7faa88159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:21.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.087+0000 7faa877fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa880d0da0 0x7faa88159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54082/0 (socket says 172.21.15.55:54082) 2023-08-25T05:37:21.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.087+0000 7faa877fe640 1 -- 172.21.15.55:0/1643909552 learned_addr learned my addr 172.21.15.55:0/1643909552 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:21.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.087+0000 7faa86ffd640 1 --2- 172.21.15.55:0/1643909552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa880cdde0 0x7faa8806ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:21.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.087+0000 7faa7ffff640 1 --2- 172.21.15.55:0/1643909552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa880ce220 0x7faa8806b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:21.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.087+0000 7faa877fe640 1 -- 172.21.15.55:0/1643909552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa880ce220 msgr2=0x7faa8806b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:21.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.087+0000 7faa877fe640 1 --2- 172.21.15.55:0/1643909552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa880ce220 0x7faa8806b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:21.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.087+0000 7faa877fe640 1 -- 172.21.15.55:0/1643909552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa880cdde0 msgr2=0x7faa8806ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:21.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.087+0000 7faa877fe640 1 --2- 172.21.15.55:0/1643909552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa880cdde0 0x7faa8806ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:21.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.087+0000 7faa877fe640 1 -- 172.21.15.55:0/1643909552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa80009a70 con 0x7faa880d0da0 2023-08-25T05:37:21.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.087+0000 7faa877fe640 1 --2- 172.21.15.55:0/1643909552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa880d0da0 0x7faa88159440 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7faa80009d90 tx=0x7faa8001bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:21.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.087+0000 7faa7f7fe640 1 -- 172.21.15.55:0/1643909552 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa80009450 con 0x7faa880d0da0 2023-08-25T05:37:21.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.087+0000 7faa7f7fe640 1 -- 172.21.15.55:0/1643909552 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa800039a0 con 0x7faa880d0da0 2023-08-25T05:37:21.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.087+0000 7faa8d29e640 1 -- 172.21.15.55:0/1643909552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa881570a0 con 0x7faa880d0da0 2023-08-25T05:37:21.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.087+0000 7faa7f7fe640 1 -- 172.21.15.55:0/1643909552 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa80003d50 con 0x7faa880d0da0 2023-08-25T05:37:21.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.087+0000 7faa8d29e640 1 -- 172.21.15.55:0/1643909552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa88157660 con 0x7faa880d0da0 2023-08-25T05:37:21.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.087+0000 7faa8d29e640 1 -- 172.21.15.55:0/1643909552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa88157b40 con 0x7faa880d0da0 2023-08-25T05:37:21.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.087+0000 7faa7f7fe640 1 -- 172.21.15.55:0/1643909552 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7faa800b6050 con 0x7faa880d0da0 2023-08-25T05:37:21.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.087+0000 7faa7f7fe640 1 --2- 172.21.15.55:0/1643909552 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7faa680657d0 0x7faa68067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:21.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.091+0000 7faa7f7fe640 1 -- 172.21.15.55:0/1643909552 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5210+0+0 (secure 0 0 0) 0x7faa8011f910 con 0x7faa880d0da0 2023-08-25T05:37:21.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.091+0000 7faa86ffd640 1 --2- 172.21.15.55:0/1643909552 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7faa680657d0 0x7faa68067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:21.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.091+0000 7faa86ffd640 1 --2- 172.21.15.55:0/1643909552 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7faa680657d0 0x7faa68067c90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa78001370 tx=0x7faa78009040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:21.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.095+0000 7faa7f7fe640 1 -- 172.21.15.55:0/1643909552 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7faa800ed5d0 con 0x7faa880d0da0 2023-08-25T05:37:21.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.251+0000 7faa8d29e640 1 -- 172.21.15.55:0/1643909552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7faa8804dbe0 con 0x7faa880d0da0 2023-08-25T05:37:21.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.251+0000 7faa7f7fe640 1 -- 172.21.15.55:0/1643909552 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v198) v1 ==== 84+0+126 (secure 0 0 0) 0x7faa800b4090 con 0x7faa880d0da0 2023-08-25T05:37:21.255 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:21.255 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T05:37:21.256 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:21.256 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-08-25T05:37:21.256 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-08-25T05:37:21.256 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-08-25T05:37:21.256 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:21.256 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-08-25T05:37:21.256 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-08-25T05:37:21.257 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:21.257 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T05:37:21.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.255+0000 7faa8d29e640 1 -- 172.21.15.55:0/1643909552 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7faa680657d0 msgr2=0x7faa68067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:21.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.255+0000 7faa8d29e640 1 --2- 172.21.15.55:0/1643909552 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7faa680657d0 0x7faa68067c90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa78001370 tx=0x7faa78009040 comp rx=0 tx=0).stop 2023-08-25T05:37:21.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.255+0000 7faa8d29e640 1 -- 172.21.15.55:0/1643909552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa880d0da0 msgr2=0x7faa88159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:21.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.255+0000 7faa8d29e640 1 --2- 172.21.15.55:0/1643909552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa880d0da0 0x7faa88159440 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7faa80009d90 tx=0x7faa8001bed0 comp rx=0 tx=0).stop 2023-08-25T05:37:21.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.255+0000 7faa8d29e640 1 -- 172.21.15.55:0/1643909552 shutdown_connections 2023-08-25T05:37:21.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.255+0000 7faa8d29e640 1 --2- 172.21.15.55:0/1643909552 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7faa680657d0 0x7faa68067c90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:21.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.255+0000 7faa8d29e640 1 --2- 172.21.15.55:0/1643909552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa880d0da0 0x7faa88159440 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:21.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.255+0000 7faa8d29e640 1 --2- 172.21.15.55:0/1643909552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa880ce220 0x7faa8806b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:21.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.255+0000 7faa8d29e640 1 --2- 172.21.15.55:0/1643909552 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa880cdde0 0x7faa8806ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:21.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.255+0000 7faa8d29e640 1 -- 172.21.15.55:0/1643909552 >> 172.21.15.55:0/1643909552 conn(0x7faa8809bae0 msgr2=0x7faa880b4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:21.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.255+0000 7faa8d29e640 1 -- 172.21.15.55:0/1643909552 shutdown_connections 2023-08-25T05:37:21.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.255+0000 7faa8d29e640 1 -- 172.21.15.55:0/1643909552 wait complete. 2023-08-25T05:37:21.276 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-25T05:37:21.277 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-25T05:37:21.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f916c0ac640 1 Processor -- start 2023-08-25T05:37:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f916c0ac640 1 -- start start 2023-08-25T05:37:21.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f916c0ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9164155360 0x7f916415c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:21.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f916c0ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9164155740 0x7f916415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:21.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f916c0ac640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f916406fb50 0x7f91640aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:21.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f916c0ac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f916415fa50 con 0x7f9164155740 2023-08-25T05:37:21.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f916c0ac640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f916415f490 con 0x7f916406fb50 2023-08-25T05:37:21.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f916c0ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916415f770 con 0x7f9164155360 2023-08-25T05:37:21.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f9169647640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9164155740 0x7f916415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:21.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f9169647640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9164155740 0x7f916415eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54088/0 (socket says 172.21.15.55:54088) 2023-08-25T05:37:21.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f9169647640 1 -- 172.21.15.55:0/3714791973 learned_addr learned my addr 172.21.15.55:0/3714791973 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f9169e48640 1 --2- 172.21.15.55:0/3714791973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9164155360 0x7f916415c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f916a649640 1 --2- 172.21.15.55:0/3714791973 >> v2:172.21.15.110:3300/0 conn(0x7f916406fb50 0x7f91640aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f9169647640 1 -- 172.21.15.55:0/3714791973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9164155360 msgr2=0x7f916415c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:21.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f9169647640 1 --2- 172.21.15.55:0/3714791973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9164155360 0x7f916415c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:21.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f9169647640 1 -- 172.21.15.55:0/3714791973 >> v2:172.21.15.110:3300/0 conn(0x7f916406fb50 msgr2=0x7f91640aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:21.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f9169647640 1 --2- 172.21.15.55:0/3714791973 >> v2:172.21.15.110:3300/0 conn(0x7f916406fb50 0x7f91640aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:21.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f9169647640 1 -- 172.21.15.55:0/3714791973 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91640ccb40 con 0x7f9164155740 2023-08-25T05:37:21.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.423+0000 7f916a649640 1 --2- 172.21.15.55:0/3714791973 >> v2:172.21.15.110:3300/0 conn(0x7f916406fb50 0x7f91640aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:21.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.427+0000 7f9169647640 1 --2- 172.21.15.55:0/3714791973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9164155740 0x7f916415eb90 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f9164159100 tx=0x7f915401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabcdd541fde0b42 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.427+0000 7f9168e46640 1 -- 172.21.15.55:0/3714791973 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91540ab600 con 0x7f9164155740 2023-08-25T05:37:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.427+0000 7f9168e46640 1 -- 172.21.15.55:0/3714791973 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91540a7050 con 0x7f9164155740 2023-08-25T05:37:21.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.427+0000 7f9168e46640 1 -- 172.21.15.55:0/3714791973 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91540ab980 con 0x7f9164155740 2023-08-25T05:37:21.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.427+0000 7f916c0ac640 1 -- 172.21.15.55:0/3714791973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9164155740 msgr2=0x7f916415eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:21.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.427+0000 7f916c0ac640 1 --2- 172.21.15.55:0/3714791973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9164155740 0x7f916415eb90 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f9164159100 tx=0x7f915401c3e0 comp rx=0 tx=0).stop 2023-08-25T05:37:21.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.427+0000 7f916c0ac640 1 -- 172.21.15.55:0/3714791973 shutdown_connections 2023-08-25T05:37:21.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.427+0000 7f916c0ac640 1 --2- 172.21.15.55:0/3714791973 >> v2:172.21.15.110:3300/0 conn(0x7f916406fb50 0x7f91640aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:21.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.427+0000 7f916c0ac640 1 --2- 172.21.15.55:0/3714791973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9164155740 0x7f916415eb90 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:21.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.427+0000 7f916c0ac640 1 --2- 172.21.15.55:0/3714791973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9164155360 0x7f916415c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:21.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.427+0000 7f916c0ac640 1 -- 172.21.15.55:0/3714791973 >> 172.21.15.55:0/3714791973 conn(0x7f91640caf90 msgr2=0x7f91640cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:21.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.427+0000 7f916c0ac640 1 -- 172.21.15.55:0/3714791973 shutdown_connections 2023-08-25T05:37:21.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.427+0000 7f916c0ac640 1 -- 172.21.15.55:0/3714791973 wait complete. 2023-08-25T05:37:21.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f916c0ac640 1 Processor -- start 2023-08-25T05:37:21.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f916c0ac640 1 -- start start 2023-08-25T05:37:21.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f916c0ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f916406fb50 0x7f91641524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:21.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f916c0ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9164155360 0x7f91640ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:21.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f916c0ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9164155740 0x7f916415d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:21.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f916c0ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91640c6b80 con 0x7f916406fb50 2023-08-25T05:37:21.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f916c0ac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9164152a20 con 0x7f9164155740 2023-08-25T05:37:21.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f916c0ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91640c5ae0 con 0x7f9164155360 2023-08-25T05:37:21.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f9169e48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f916406fb50 0x7f91641524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:21.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f9169e48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f916406fb50 0x7f91641524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54100/0 (socket says 172.21.15.55:54100) 2023-08-25T05:37:21.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f9169e48640 1 -- 172.21.15.55:0/3342564788 learned_addr learned my addr 172.21.15.55:0/3342564788 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:21.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f9169e48640 1 -- 172.21.15.55:0/3342564788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9164155360 msgr2=0x7f91640ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:21.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f9169e48640 1 --2- 172.21.15.55:0/3342564788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9164155360 0x7f91640ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:21.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f9169e48640 1 -- 172.21.15.55:0/3342564788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9164155740 msgr2=0x7f916415d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:21.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f9169e48640 1 --2- 172.21.15.55:0/3342564788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9164155740 0x7f916415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:21.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f9169e48640 1 -- 172.21.15.55:0/3342564788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91540094d0 con 0x7f916406fb50 2023-08-25T05:37:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f9169e48640 1 --2- 172.21.15.55:0/3342564788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f916406fb50 0x7f91641524e0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f916000e930 tx=0x7f916000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f915a7fc640 1 -- 172.21.15.55:0/3342564788 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916000ca00 con 0x7f916406fb50 2023-08-25T05:37:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f915a7fc640 1 -- 172.21.15.55:0/3342564788 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916000cb60 con 0x7f916406fb50 2023-08-25T05:37:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f916c0ac640 1 -- 172.21.15.55:0/3342564788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91640c5dc0 con 0x7f916406fb50 2023-08-25T05:37:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f915a7fc640 1 -- 172.21.15.55:0/3342564788 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160013470 con 0x7f916406fb50 2023-08-25T05:37:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f916c0ac640 1 -- 172.21.15.55:0/3342564788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91640c6380 con 0x7f916406fb50 2023-08-25T05:37:21.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.431+0000 7f916c0ac640 1 -- 172.21.15.55:0/3342564788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916404dbe0 con 0x7f916406fb50 2023-08-25T05:37:21.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.435+0000 7f915a7fc640 1 -- 172.21.15.55:0/3342564788 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f91600135d0 con 0x7f916406fb50 2023-08-25T05:37:21.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.435+0000 7f915a7fc640 1 --2- 172.21.15.55:0/3342564788 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f91480657a0 0x7f9148067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:21.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.435+0000 7f915a7fc640 1 -- 172.21.15.55:0/3342564788 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9160082eb0 con 0x7f916406fb50 2023-08-25T05:37:21.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.435+0000 7f9169647640 1 --2- 172.21.15.55:0/3342564788 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f91480657a0 0x7f9148067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:21.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.435+0000 7f9169647640 1 --2- 172.21.15.55:0/3342564788 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f91480657a0 0x7f9148067c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f91540ad000 tx=0x7f9154004740 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:21.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.439+0000 7f915a7fc640 1 -- 172.21.15.55:0/3342564788 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9160050c60 con 0x7f916406fb50 2023-08-25T05:37:21.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:21.595+0000 7f916c0ac640 1 -- 172.21.15.55:0/3342564788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f91640cc5c0 con 0x7f916406fb50 2023-08-25T05:37:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.511+0000 7f915a7fc640 1 -- 172.21.15.55:0/3342564788 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v199) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9160054280 con 0x7f916406fb50 2023-08-25T05:37:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-08-25T05:37:22.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.519+0000 7f916c0ac640 1 -- 172.21.15.55:0/3342564788 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f91480657a0 msgr2=0x7f9148067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:22.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.519+0000 7f916c0ac640 1 --2- 172.21.15.55:0/3342564788 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f91480657a0 0x7f9148067c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f91540ad000 tx=0x7f9154004740 comp rx=0 tx=0).stop 2023-08-25T05:37:22.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.519+0000 7f916c0ac640 1 -- 172.21.15.55:0/3342564788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f916406fb50 msgr2=0x7f91641524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:22.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.519+0000 7f916c0ac640 1 --2- 172.21.15.55:0/3342564788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f916406fb50 0x7f91641524e0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f916000e930 tx=0x7f916000edf0 comp rx=0 tx=0).stop 2023-08-25T05:37:22.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.519+0000 7f916c0ac640 1 -- 172.21.15.55:0/3342564788 shutdown_connections 2023-08-25T05:37:22.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.519+0000 7f916c0ac640 1 --2- 172.21.15.55:0/3342564788 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f91480657a0 0x7f9148067c60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:22.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.519+0000 7f916c0ac640 1 --2- 172.21.15.55:0/3342564788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9164155740 0x7f916415d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:22.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.519+0000 7f916c0ac640 1 --2- 172.21.15.55:0/3342564788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9164155360 0x7f91640ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:22.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.519+0000 7f916c0ac640 1 --2- 172.21.15.55:0/3342564788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f916406fb50 0x7f91641524e0 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:22.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.519+0000 7f916c0ac640 1 -- 172.21.15.55:0/3342564788 >> 172.21.15.55:0/3342564788 conn(0x7f91640caf90 msgr2=0x7f91640cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:22.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.519+0000 7f916c0ac640 1 -- 172.21.15.55:0/3342564788 shutdown_connections 2023-08-25T05:37:22.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.519+0000 7f916c0ac640 1 -- 172.21.15.55:0/3342564788 wait complete. 2023-08-25T05:37:22.547 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-25T05:37:22.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.699+0000 7fc30188a640 1 Processor -- start 2023-08-25T05:37:22.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.699+0000 7fc30188a640 1 -- start start 2023-08-25T05:37:22.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc30188a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc2fc0cfc90 0x7fc2fc0b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:22.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc30188a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2fc0b70c0 con 0x7fc2fc15fca0 2023-08-25T05:37:22.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc30188a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2fc0b73a0 con 0x7fc2fc0b8330 2023-08-25T05:37:22.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc30188a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2fc160080 con 0x7fc2fc0cfc90 2023-08-25T05:37:22.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc300888640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc2fc15fca0 0x7fc2fc0cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34342/0 (socket says 172.21.15.55:34342) 2023-08-25T05:37:22.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc300888640 1 -- 172.21.15.55:0/4150855620 learned_addr learned my addr 172.21.15.55:0/4150855620 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:22.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f3fff640 1 --2- 172.21.15.55:0/4150855620 >> v2:172.21.15.110:3300/0 conn(0x7fc2fc0cfc90 0x7fc2fc0b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:22.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f37fe640 1 -- 172.21.15.55:0/4150855620 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321484483 0 0) 0x7fc2fc0b70c0 con 0x7fc2fc15fca0 2023-08-25T05:37:22.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f37fe640 1 -- 172.21.15.55:0/4150855620 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e4003530 con 0x7fc2fc15fca0 2023-08-25T05:37:22.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f37fe640 1 -- 172.21.15.55:0/4150855620 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1274195936 0 0) 0x7fc2e4003530 con 0x7fc2fc15fca0 2023-08-25T05:37:22.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f37fe640 1 -- 172.21.15.55:0/4150855620 >> v2:172.21.15.110:3300/0 conn(0x7fc2fc0cfc90 msgr2=0x7fc2fc0b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:22.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f37fe640 1 --2- 172.21.15.55:0/4150855620 >> v2:172.21.15.110:3300/0 conn(0x7fc2fc0cfc90 0x7fc2fc0b55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:22.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f37fe640 1 -- 172.21.15.55:0/4150855620 >> v1:172.21.15.110:6789/0 conn(0x7fc2fc0b8330 legacy=0x7fc2fc0b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:22.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f37fe640 1 -- 172.21.15.55:0/4150855620 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc0b7680 con 0x7fc2fc15fca0 2023-08-25T05:37:22.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f37fe640 1 -- 172.21.15.55:0/4150855620 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fc2f8001680 con 0x7fc2fc15fca0 2023-08-25T05:37:22.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f37fe640 1 -- 172.21.15.55:0/4150855620 >> v1:172.21.15.55:6789/0 conn(0x7fc2fc15fca0 legacy=0x7fc2fc0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:22.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f37fe640 1 --2- 172.21.15.55:0/4150855620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e4003980 0x7fc2e4003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:22.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f37fe640 1 --2- 172.21.15.55:0/4150855620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2e4004380 0x7fc2e4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:22.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f37fe640 1 --2- 172.21.15.55:0/4150855620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e4005050 0x7fc2e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:22.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f37fe640 1 -- 172.21.15.55:0/4150855620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc160080 con 0x7fc2e4004380 2023-08-25T05:37:22.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f37fe640 1 -- 172.21.15.55:0/4150855620 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e400bf00 con 0x7fc2e4005050 2023-08-25T05:37:22.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f37fe640 1 -- 172.21.15.55:0/4150855620 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e400c0c0 con 0x7fc2e4003980 2023-08-25T05:37:22.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f3fff640 1 --2- 172.21.15.55:0/4150855620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2e4004380 0x7fc2e4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:22.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc300888640 1 --2- 172.21.15.55:0/4150855620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e4003980 0x7fc2e4003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:22.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc301089640 1 --2- 172.21.15.55:0/4150855620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e4005050 0x7fc2e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:22.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f3fff640 1 -- 172.21.15.55:0/4150855620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e4003980 msgr2=0x7fc2e4003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:22.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f3fff640 1 --2- 172.21.15.55:0/4150855620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e4003980 0x7fc2e4003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:22.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f3fff640 1 -- 172.21.15.55:0/4150855620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e4005050 msgr2=0x7fc2e400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:22.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f3fff640 1 --2- 172.21.15.55:0/4150855620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e4005050 0x7fc2e400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:22.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc2f3fff640 1 -- 172.21.15.55:0/4150855620 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4003530 con 0x7fc2e4004380 2023-08-25T05:37:22.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.703+0000 7fc301089640 1 -- 172.21.15.55:0/4150855620 reap_dead start 2023-08-25T05:37:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.707+0000 7fc2f3fff640 1 --2- 172.21.15.55:0/4150855620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2e4004380 0x7fc2e4004850 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009ab0 tx=0x7fc2ec01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7db0d097d2defa server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.707+0000 7fc2f37fe640 1 -- 172.21.15.55:0/4150855620 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8007ea0 con 0x7fc2e4004380 2023-08-25T05:37:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.707+0000 7fc2f37fe640 1 -- 172.21.15.55:0/4150855620 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ec0a5620 con 0x7fc2e4004380 2023-08-25T05:37:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.707+0000 7fc2f37fe640 1 -- 172.21.15.55:0/4150855620 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec0a59d0 con 0x7fc2e4004380 2023-08-25T05:37:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.707+0000 7fc30188a640 1 -- 172.21.15.55:0/4150855620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2e4004380 msgr2=0x7fc2e4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.707+0000 7fc30188a640 1 --2- 172.21.15.55:0/4150855620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2e4004380 0x7fc2e4004850 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009ab0 tx=0x7fc2ec01ca30 comp rx=0 tx=0).stop 2023-08-25T05:37:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.707+0000 7fc30188a640 1 -- 172.21.15.55:0/4150855620 shutdown_connections 2023-08-25T05:37:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.707+0000 7fc30188a640 1 --2- 172.21.15.55:0/4150855620 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2e4004380 0x7fc2e4004850 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.707+0000 7fc30188a640 1 -- 172.21.15.55:0/4150855620 >> 172.21.15.55:0/4150855620 conn(0x7fc2fc0658c0 msgr2=0x7fc2fc065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.707+0000 7fc30188a640 1 -- 172.21.15.55:0/4150855620 shutdown_connections 2023-08-25T05:37:22.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.707+0000 7fc30188a640 1 -- 172.21.15.55:0/4150855620 wait complete. 2023-08-25T05:37:22.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.707+0000 7fc30188a640 1 Processor -- start 2023-08-25T05:37:22.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc30188a640 1 -- start start 2023-08-25T05:37:22.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc30188a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e4004380 0x7fc2fc1f2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:22.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc30188a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2fc1f5360 0x7fc2fc157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:22.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc30188a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2fc1465c0 0x7fc2fc143dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:22.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc30188a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc145e50 con 0x7fc2fc1465c0 2023-08-25T05:37:22.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc30188a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc146130 con 0x7fc2e4004380 2023-08-25T05:37:22.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc30188a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc1f5ad0 con 0x7fc2fc1f5360 2023-08-25T05:37:22.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc301089640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2fc1465c0 0x7fc2fc143dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:22.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc301089640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2fc1465c0 0x7fc2fc143dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54118/0 (socket says 172.21.15.55:54118) 2023-08-25T05:37:22.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc301089640 1 -- 172.21.15.55:0/4012247735 learned_addr learned my addr 172.21.15.55:0/4012247735 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:22.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc300888640 1 --2- 172.21.15.55:0/4012247735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e4004380 0x7fc2fc1f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:22.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc2f3fff640 1 --2- 172.21.15.55:0/4012247735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2fc1f5360 0x7fc2fc157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:22.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc301089640 1 -- 172.21.15.55:0/4012247735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2fc1f5360 msgr2=0x7fc2fc157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:22.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc301089640 1 --2- 172.21.15.55:0/4012247735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2fc1f5360 0x7fc2fc157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:22.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc301089640 1 -- 172.21.15.55:0/4012247735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e4004380 msgr2=0x7fc2fc1f2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:22.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc301089640 1 --2- 172.21.15.55:0/4012247735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e4004380 0x7fc2fc1f2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:22.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc301089640 1 -- 172.21.15.55:0/4012247735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc1f5db0 con 0x7fc2fc1465c0 2023-08-25T05:37:22.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc301089640 1 --2- 172.21.15.55:0/4012247735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2fc1465c0 0x7fc2fc143dc0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0ce990 tx=0x7fc2f400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:22.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc2f17fa640 1 -- 172.21.15.55:0/4012247735 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4003980 con 0x7fc2fc1465c0 2023-08-25T05:37:22.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc2f17fa640 1 -- 172.21.15.55:0/4012247735 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f4003ae0 con 0x7fc2fc1465c0 2023-08-25T05:37:22.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc2f17fa640 1 -- 172.21.15.55:0/4012247735 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4003e90 con 0x7fc2fc1465c0 2023-08-25T05:37:22.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc30188a640 1 -- 172.21.15.55:0/4012247735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2fc1f6090 con 0x7fc2fc1465c0 2023-08-25T05:37:22.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc30188a640 1 -- 172.21.15.55:0/4012247735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2fc157f50 con 0x7fc2fc1465c0 2023-08-25T05:37:22.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.711+0000 7fc30188a640 1 -- 172.21.15.55:0/4012247735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2fc1462c0 con 0x7fc2fc1465c0 2023-08-25T05:37:22.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.715+0000 7fc2f17fa640 1 -- 172.21.15.55:0/4012247735 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fc2f40050d0 con 0x7fc2fc1465c0 2023-08-25T05:37:22.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.715+0000 7fc2f17fa640 1 --2- 172.21.15.55:0/4012247735 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fc2e80657a0 0x7fc2e8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:22.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.715+0000 7fc2f17fa640 1 -- 172.21.15.55:0/4012247735 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fc2f40835a0 con 0x7fc2fc1465c0 2023-08-25T05:37:22.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.715+0000 7fc300888640 1 --2- 172.21.15.55:0/4012247735 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fc2e80657a0 0x7fc2e8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:22.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.715+0000 7fc300888640 1 --2- 172.21.15.55:0/4012247735 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fc2e80657a0 0x7fc2e8067c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8001060 tx=0x7fc2f8007f50 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:22.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.719+0000 7fc2f17fa640 1 -- 172.21.15.55:0/4012247735 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc2f4051250 con 0x7fc2fc1465c0 2023-08-25T05:37:22.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:22.871+0000 7fc30188a640 1 -- 172.21.15.55:0/4012247735 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc2fc0c5a10 con 0x7fc2fc1465c0 2023-08-25T05:37:23.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.519+0000 7fc2f17fa640 1 -- 172.21.15.55:0/4012247735 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v200) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc2f4054870 con 0x7fc2fc1465c0 2023-08-25T05:37:23.523 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-08-25T05:37:23.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.527+0000 7fc30188a640 1 -- 172.21.15.55:0/4012247735 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fc2e80657a0 msgr2=0x7fc2e8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:23.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.527+0000 7fc30188a640 1 --2- 172.21.15.55:0/4012247735 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fc2e80657a0 0x7fc2e8067c60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8001060 tx=0x7fc2f8007f50 comp rx=0 tx=0).stop 2023-08-25T05:37:23.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.527+0000 7fc30188a640 1 -- 172.21.15.55:0/4012247735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2fc1465c0 msgr2=0x7fc2fc143dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:23.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.527+0000 7fc30188a640 1 --2- 172.21.15.55:0/4012247735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2fc1465c0 0x7fc2fc143dc0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0ce990 tx=0x7fc2f400eb90 comp rx=0 tx=0).stop 2023-08-25T05:37:23.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.527+0000 7fc30188a640 1 -- 172.21.15.55:0/4012247735 shutdown_connections 2023-08-25T05:37:23.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.527+0000 7fc30188a640 1 --2- 172.21.15.55:0/4012247735 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fc2e80657a0 0x7fc2e8067c60 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8001060 tx=0x7fc2f8007f50 comp rx=0 tx=0).stop 2023-08-25T05:37:23.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.527+0000 7fc30188a640 1 --2- 172.21.15.55:0/4012247735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2fc1465c0 0x7fc2fc143dc0 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:23.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.527+0000 7fc30188a640 1 --2- 172.21.15.55:0/4012247735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2fc1f5360 0x7fc2fc157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:23.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.527+0000 7fc30188a640 1 --2- 172.21.15.55:0/4012247735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e4004380 0x7fc2fc1f2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:23.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.527+0000 7fc30188a640 1 -- 172.21.15.55:0/4012247735 >> 172.21.15.55:0/4012247735 conn(0x7fc2fc0658c0 msgr2=0x7fc2fc0b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:23.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.531+0000 7fc30188a640 1 -- 172.21.15.55:0/4012247735 shutdown_connections 2023-08-25T05:37:23.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.531+0000 7fc30188a640 1 -- 172.21.15.55:0/4012247735 wait complete. 2023-08-25T05:37:23.566 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-25T05:37:23.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.711+0000 7f1385a69640 1 Processor -- start 2023-08-25T05:37:23.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.711+0000 7f1385a69640 1 -- start start 2023-08-25T05:37:23.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.715+0000 7f1385a69640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f138015fca0 0x7f13800cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:23.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.715+0000 7f1385a69640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13800b8330 0x7f13800cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:23.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.715+0000 7f1385a69640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800b70c0 con 0x7f13800d0bd0 2023-08-25T05:37:23.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.715+0000 7f1385a69640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1380160080 con 0x7f138015fca0 2023-08-25T05:37:23.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.715+0000 7f1385a69640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13800b73a0 con 0x7f13800b8330 2023-08-25T05:37:23.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.715+0000 7f1384a67640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f138015fca0 0x7f13800cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:23.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.715+0000 7f1385268640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f13800d0bd0 0x7f13800d1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34348/0 (socket says 172.21.15.55:34348) 2023-08-25T05:37:23.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.715+0000 7f1385268640 1 -- 172.21.15.55:0/4142330696 learned_addr learned my addr 172.21.15.55:0/4142330696 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:23.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.715+0000 7f137ffff640 1 --2- 172.21.15.55:0/4142330696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13800b8330 0x7f13800cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:23.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.715+0000 7f1384a67640 1 -- 172.21.15.55:0/4142330696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13800b8330 msgr2=0x7f13800cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:23.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.715+0000 7f1384a67640 1 --2- 172.21.15.55:0/4142330696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13800b8330 0x7f13800cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:23.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.715+0000 7f1384a67640 1 -- 172.21.15.55:0/4142330696 >> v1:172.21.15.55:6789/0 conn(0x7f13800d0bd0 legacy=0x7f13800d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:23.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.715+0000 7f1384a67640 1 -- 172.21.15.55:0/4142330696 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13800b7680 con 0x7f138015fca0 2023-08-25T05:37:23.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.715+0000 7f137f7fe640 1 -- 172.21.15.55:0/4142330696 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482724176 0 0) 0x7f13800b70c0 con 0x7f13800d0bd0 2023-08-25T05:37:23.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.719+0000 7f1384a67640 1 --2- 172.21.15.55:0/4142330696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138015fca0 0x7f13800cf580 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f13740097c0 tx=0x7f137401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3b75e6f485ab76 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:23.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.719+0000 7f137f7fe640 1 -- 172.21.15.55:0/4142330696 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740a8970 con 0x7f138015fca0 2023-08-25T05:37:23.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.719+0000 7f137f7fe640 1 -- 172.21.15.55:0/4142330696 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13740a8ad0 con 0x7f138015fca0 2023-08-25T05:37:23.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.719+0000 7f137f7fe640 1 -- 172.21.15.55:0/4142330696 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740a8e60 con 0x7f138015fca0 2023-08-25T05:37:23.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.719+0000 7f1385a69640 1 -- 172.21.15.55:0/4142330696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138015fca0 msgr2=0x7f13800cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:23.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.719+0000 7f1385a69640 1 --2- 172.21.15.55:0/4142330696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138015fca0 0x7f13800cf580 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f13740097c0 tx=0x7f137401ec70 comp rx=0 tx=0).stop 2023-08-25T05:37:23.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.719+0000 7f1385a69640 1 -- 172.21.15.55:0/4142330696 shutdown_connections 2023-08-25T05:37:23.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.719+0000 7f1385a69640 1 --2- 172.21.15.55:0/4142330696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13800b8330 0x7f13800cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:23.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.719+0000 7f1385a69640 1 --2- 172.21.15.55:0/4142330696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138015fca0 0x7f13800cf580 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:23.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.719+0000 7f1385a69640 1 -- 172.21.15.55:0/4142330696 >> 172.21.15.55:0/4142330696 conn(0x7f13800658c0 msgr2=0x7f1380065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:23.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.719+0000 7f1385a69640 1 -- 172.21.15.55:0/4142330696 shutdown_connections 2023-08-25T05:37:23.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.719+0000 7f1385a69640 1 -- 172.21.15.55:0/4142330696 wait complete. 2023-08-25T05:37:23.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.719+0000 7f1385a69640 1 Processor -- start 2023-08-25T05:37:23.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.719+0000 7f1385a69640 1 -- start start 2023-08-25T05:37:23.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1385a69640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13800b8330 0x7f138014f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:23.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1385a69640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13800d0bd0 0x7f13800c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:23.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1385a69640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138015fca0 0x7f1380150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:23.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1385a69640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13800c8b10 con 0x7f138015fca0 2023-08-25T05:37:23.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1385a69640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1380150610 con 0x7f13800d0bd0 2023-08-25T05:37:23.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1385a69640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1380150fe0 con 0x7f13800b8330 2023-08-25T05:37:23.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1385268640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138015fca0 0x7f1380150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:23.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1385268640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138015fca0 0x7f1380150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54134/0 (socket says 172.21.15.55:54134) 2023-08-25T05:37:23.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1385268640 1 -- 172.21.15.55:0/4032539838 learned_addr learned my addr 172.21.15.55:0/4032539838 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:23.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1384a67640 1 --2- 172.21.15.55:0/4032539838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13800b8330 0x7f138014f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:23.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f137ffff640 1 --2- 172.21.15.55:0/4032539838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13800d0bd0 0x7f13800c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:23.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1385268640 1 -- 172.21.15.55:0/4032539838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13800b8330 msgr2=0x7f138014f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:23.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1385268640 1 --2- 172.21.15.55:0/4032539838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13800b8330 0x7f138014f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:23.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1385268640 1 -- 172.21.15.55:0/4032539838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13800d0bd0 msgr2=0x7f13800c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:23.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1385268640 1 --2- 172.21.15.55:0/4032539838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13800d0bd0 0x7f13800c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:23.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1385268640 1 -- 172.21.15.55:0/4032539838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1374009420 con 0x7f138015fca0 2023-08-25T05:37:23.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1385268640 1 --2- 172.21.15.55:0/4032539838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138015fca0 0x7f1380150aa0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f1378001570 tx=0x7f137800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:23.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f137d7fa640 1 -- 172.21.15.55:0/4032539838 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137800a640 con 0x7f138015fca0 2023-08-25T05:37:23.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f137d7fa640 1 -- 172.21.15.55:0/4032539838 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137800a7c0 con 0x7f138015fca0 2023-08-25T05:37:23.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1385a69640 1 -- 172.21.15.55:0/4032539838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138014fa00 con 0x7f138015fca0 2023-08-25T05:37:23.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f137d7fa640 1 -- 172.21.15.55:0/4032539838 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137800ab70 con 0x7f138015fca0 2023-08-25T05:37:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1385a69640 1 -- 172.21.15.55:0/4032539838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138014ffc0 con 0x7f138015fca0 2023-08-25T05:37:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f1385a69640 1 -- 172.21.15.55:0/4032539838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13801507c0 con 0x7f138015fca0 2023-08-25T05:37:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.723+0000 7f137d7fa640 1 -- 172.21.15.55:0/4032539838 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f137800acd0 con 0x7f138015fca0 2023-08-25T05:37:23.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.727+0000 7f137d7fa640 1 --2- 172.21.15.55:0/4032539838 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f13640657a0 0x7f1364067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:23.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.727+0000 7f137d7fa640 1 -- 172.21.15.55:0/4032539838 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f1378082750 con 0x7f138015fca0 2023-08-25T05:37:23.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.727+0000 7f1384a67640 1 --2- 172.21.15.55:0/4032539838 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f13640657a0 0x7f1364067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:23.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.727+0000 7f1384a67640 1 --2- 172.21.15.55:0/4032539838 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f13640657a0 0x7f1364067c60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f13740b2000 tx=0x7f1374008040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:23.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.731+0000 7f137d7fa640 1 -- 172.21.15.55:0/4032539838 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1378050170 con 0x7f138015fca0 2023-08-25T05:37:23.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:23.919+0000 7f1385a69640 1 -- 172.21.15.55:0/4032539838 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1380073e50 con 0x7f138015fca0 2023-08-25T05:37:24.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.555+0000 7f137d7fa640 1 -- 172.21.15.55:0/4032539838 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 25 and data pool 26 v96) v1 ==== 174+0+0 (secure 0 0 0) 0x7f1378053790 con 0x7f138015fca0 2023-08-25T05:37:24.557 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 25 and data pool 26 2023-08-25T05:37:24.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.559+0000 7f1385a69640 1 -- 172.21.15.55:0/4032539838 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f13640657a0 msgr2=0x7f1364067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:24.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.559+0000 7f1385a69640 1 --2- 172.21.15.55:0/4032539838 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f13640657a0 0x7f1364067c60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f13740b2000 tx=0x7f1374008040 comp rx=0 tx=0).stop 2023-08-25T05:37:24.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.559+0000 7f1385a69640 1 -- 172.21.15.55:0/4032539838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138015fca0 msgr2=0x7f1380150aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:24.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.559+0000 7f1385a69640 1 --2- 172.21.15.55:0/4032539838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138015fca0 0x7f1380150aa0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f1378001570 tx=0x7f137800cca0 comp rx=0 tx=0).stop 2023-08-25T05:37:24.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.559+0000 7f1385a69640 1 -- 172.21.15.55:0/4032539838 shutdown_connections 2023-08-25T05:37:24.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.559+0000 7f1385a69640 1 --2- 172.21.15.55:0/4032539838 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f13640657a0 0x7f1364067c60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:24.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.559+0000 7f1385a69640 1 --2- 172.21.15.55:0/4032539838 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f138015fca0 0x7f1380150aa0 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:24.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.559+0000 7f1385a69640 1 --2- 172.21.15.55:0/4032539838 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13800d0bd0 0x7f13800c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:24.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.559+0000 7f1385a69640 1 --2- 172.21.15.55:0/4032539838 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13800b8330 0x7f138014f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:24.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.559+0000 7f1385a69640 1 -- 172.21.15.55:0/4032539838 >> 172.21.15.55:0/4032539838 conn(0x7f13800658c0 msgr2=0x7f13800d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:24.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.563+0000 7f1385a69640 1 -- 172.21.15.55:0/4032539838 shutdown_connections 2023-08-25T05:37:24.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.567+0000 7f1385a69640 1 -- 172.21.15.55:0/4032539838 wait complete. 2023-08-25T05:37:24.591 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:37:24.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.735+0000 7fec67488640 1 Processor -- start 2023-08-25T05:37:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.735+0000 7fec67488640 1 -- start start 2023-08-25T05:37:24.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.735+0000 7fec67488640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fec600d0da0 0x7fec600d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:24.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.735+0000 7fec67488640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec600b3e50 0x7fec600ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:24.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.735+0000 7fec67488640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec600b29b0 con 0x7fec600cdde0 2023-08-25T05:37:24.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.735+0000 7fec67488640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec600ce760 con 0x7fec600b3e50 2023-08-25T05:37:24.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.735+0000 7fec67488640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec600d16c0 con 0x7fec600d0da0 2023-08-25T05:37:24.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.735+0000 7fec65a25640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec600b3e50 0x7fec600ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:24.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.735+0000 7fec65a25640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec600b3e50 0x7fec600ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54146/0 (socket says 172.21.15.55:54146) 2023-08-25T05:37:24.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.735+0000 7fec65a25640 1 -- 172.21.15.55:0/928626845 learned_addr learned my addr 172.21.15.55:0/928626845 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.735+0000 7fec65224640 1 --2- 172.21.15.55:0/928626845 >> v2:172.21.15.110:3300/0 conn(0x7fec600d0da0 0x7fec600d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.735+0000 7fec65a25640 1 -- 172.21.15.55:0/928626845 >> v2:172.21.15.110:3300/0 conn(0x7fec600d0da0 msgr2=0x7fec600d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.735+0000 7fec65a25640 1 --2- 172.21.15.55:0/928626845 >> v2:172.21.15.110:3300/0 conn(0x7fec600d0da0 0x7fec600d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.735+0000 7fec65a25640 1 -- 172.21.15.55:0/928626845 >> v1:172.21.15.110:6789/0 conn(0x7fec600cdde0 legacy=0x7fec600cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.735+0000 7fec65a25640 1 -- 172.21.15.55:0/928626845 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec600b1dc0 con 0x7fec600b3e50 2023-08-25T05:37:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.739+0000 7fec65a25640 1 --2- 172.21.15.55:0/928626845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec600b3e50 0x7fec600ce220 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7fec60073720 tx=0x7fec5801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05ded75ebad7cbe server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.739+0000 7fec57fff640 1 -- 172.21.15.55:0/928626845 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec580af400 con 0x7fec600b3e50 2023-08-25T05:37:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.739+0000 7fec57fff640 1 -- 172.21.15.55:0/928626845 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec580ab050 con 0x7fec600b3e50 2023-08-25T05:37:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.739+0000 7fec57fff640 1 -- 172.21.15.55:0/928626845 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec580af780 con 0x7fec600b3e50 2023-08-25T05:37:24.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.739+0000 7fec67488640 1 -- 172.21.15.55:0/928626845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec600b3e50 msgr2=0x7fec600ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:24.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.739+0000 7fec67488640 1 --2- 172.21.15.55:0/928626845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec600b3e50 0x7fec600ce220 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7fec60073720 tx=0x7fec5801f1c0 comp rx=0 tx=0).stop 2023-08-25T05:37:24.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.739+0000 7fec67488640 1 -- 172.21.15.55:0/928626845 shutdown_connections 2023-08-25T05:37:24.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.739+0000 7fec67488640 1 --2- 172.21.15.55:0/928626845 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec600b3e50 0x7fec600ce220 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:24.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.739+0000 7fec67488640 1 --2- 172.21.15.55:0/928626845 >> v2:172.21.15.110:3300/0 conn(0x7fec600d0da0 0x7fec600d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.739+0000 7fec67488640 1 -- 172.21.15.55:0/928626845 >> 172.21.15.55:0/928626845 conn(0x7fec6009bae0 msgr2=0x7fec600d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.739+0000 7fec67488640 1 -- 172.21.15.55:0/928626845 shutdown_connections 2023-08-25T05:37:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.739+0000 7fec67488640 1 -- 172.21.15.55:0/928626845 wait complete. 2023-08-25T05:37:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec67488640 1 Processor -- start 2023-08-25T05:37:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec67488640 1 -- start start 2023-08-25T05:37:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec67488640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec600b3e50 0x7fec601517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec67488640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec600cdde0 0x7fec600cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec67488640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec600d0da0 0x7fec600c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec67488640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec600c99c0 con 0x7fec600b3e50 2023-08-25T05:37:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec67488640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec600c9ca0 con 0x7fec600d0da0 2023-08-25T05:37:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec67488640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec600c9f80 con 0x7fec600cdde0 2023-08-25T05:37:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec65224640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec600b3e50 0x7fec601517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec65224640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec600b3e50 0x7fec601517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54160/0 (socket says 172.21.15.55:54160) 2023-08-25T05:37:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec65224640 1 -- 172.21.15.55:0/1844965403 learned_addr learned my addr 172.21.15.55:0/1844965403 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec65a25640 1 --2- 172.21.15.55:0/1844965403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec600d0da0 0x7fec600c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec64a23640 1 --2- 172.21.15.55:0/1844965403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec600cdde0 0x7fec600cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec65224640 1 -- 172.21.15.55:0/1844965403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec600cdde0 msgr2=0x7fec600cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec65224640 1 --2- 172.21.15.55:0/1844965403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec600cdde0 0x7fec600cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec65224640 1 -- 172.21.15.55:0/1844965403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec600d0da0 msgr2=0x7fec600c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:24.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec65224640 1 --2- 172.21.15.55:0/1844965403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec600d0da0 0x7fec600c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:24.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec65224640 1 -- 172.21.15.55:0/1844965403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec58009b30 con 0x7fec600b3e50 2023-08-25T05:37:24.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec65224640 1 --2- 172.21.15.55:0/1844965403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec600b3e50 0x7fec601517b0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00e9b0 tx=0x7fec5c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:24.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec55ffb640 1 -- 172.21.15.55:0/1844965403 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c009670 con 0x7fec600b3e50 2023-08-25T05:37:24.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec55ffb640 1 -- 172.21.15.55:0/1844965403 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c00c9a0 con 0x7fec600b3e50 2023-08-25T05:37:24.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec55ffb640 1 -- 172.21.15.55:0/1844965403 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c00cd10 con 0x7fec600b3e50 2023-08-25T05:37:24.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.743+0000 7fec67488640 1 -- 172.21.15.55:0/1844965403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec600ca260 con 0x7fec600b3e50 2023-08-25T05:37:24.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.747+0000 7fec67488640 1 -- 172.21.15.55:0/1844965403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec60151f20 con 0x7fec600b3e50 2023-08-25T05:37:24.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.747+0000 7fec67488640 1 -- 172.21.15.55:0/1844965403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6004dbe0 con 0x7fec600b3e50 2023-08-25T05:37:24.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.747+0000 7fec55ffb640 1 -- 172.21.15.55:0/1844965403 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fec5c013470 con 0x7fec600b3e50 2023-08-25T05:37:24.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.747+0000 7fec55ffb640 1 --2- 172.21.15.55:0/1844965403 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fec440657a0 0x7fec44067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:24.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.747+0000 7fec55ffb640 1 -- 172.21.15.55:0/1844965403 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fec5c083500 con 0x7fec600b3e50 2023-08-25T05:37:24.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.747+0000 7fec64a23640 1 --2- 172.21.15.55:0/1844965403 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fec440657a0 0x7fec44067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:24.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.751+0000 7fec64a23640 1 --2- 172.21.15.55:0/1844965403 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fec440657a0 0x7fec44067c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fec600c6d60 tx=0x7fec50009040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:24.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.751+0000 7fec55ffb640 1 -- 172.21.15.55:0/1844965403 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fec5c050f50 con 0x7fec600b3e50 2023-08-25T05:37:24.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.911+0000 7fec67488640 1 -- 172.21.15.55:0/1844965403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec600c9b00 con 0x7fec600b3e50 2023-08-25T05:37:24.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.911+0000 7fec55ffb640 1 -- 172.21.15.55:0/1844965403 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fec600c9b00 con 0x7fec600b3e50 2023-08-25T05:37:24.913 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:24.914 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":201,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:37:23.923130+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:37:21.649130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-08-25T05:37:22.924825+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:37:24.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.915+0000 7fec67488640 1 -- 172.21.15.55:0/1844965403 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fec440657a0 msgr2=0x7fec44067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:24.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.915+0000 7fec67488640 1 --2- 172.21.15.55:0/1844965403 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fec440657a0 0x7fec44067c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fec600c6d60 tx=0x7fec50009040 comp rx=0 tx=0).stop 2023-08-25T05:37:24.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.915+0000 7fec67488640 1 -- 172.21.15.55:0/1844965403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec600b3e50 msgr2=0x7fec601517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:24.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.915+0000 7fec67488640 1 --2- 172.21.15.55:0/1844965403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec600b3e50 0x7fec601517b0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00e9b0 tx=0x7fec5c00ee70 comp rx=0 tx=0).stop 2023-08-25T05:37:24.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.915+0000 7fec67488640 1 -- 172.21.15.55:0/1844965403 shutdown_connections 2023-08-25T05:37:24.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.915+0000 7fec67488640 1 --2- 172.21.15.55:0/1844965403 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fec440657a0 0x7fec44067c60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:24.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.915+0000 7fec67488640 1 --2- 172.21.15.55:0/1844965403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec600d0da0 0x7fec600c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:24.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.915+0000 7fec67488640 1 --2- 172.21.15.55:0/1844965403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec600cdde0 0x7fec600cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:24.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.915+0000 7fec67488640 1 --2- 172.21.15.55:0/1844965403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec600b3e50 0x7fec601517b0 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:24.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.915+0000 7fec67488640 1 -- 172.21.15.55:0/1844965403 >> 172.21.15.55:0/1844965403 conn(0x7fec6009bae0 msgr2=0x7fec6006ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:24.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.915+0000 7fec67488640 1 -- 172.21.15.55:0/1844965403 shutdown_connections 2023-08-25T05:37:24.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:24.915+0000 7fec67488640 1 -- 172.21.15.55:0/1844965403 wait complete. 2023-08-25T05:37:24.935 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:37:25.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.075+0000 7fa4871fa640 1 Processor -- start 2023-08-25T05:37:25.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.075+0000 7fa4871fa640 1 -- start start 2023-08-25T05:37:25.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.079+0000 7fa4871fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa48015eba0 0x7fa4800b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:25.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.079+0000 7fa4871fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4800ceeb0 0x7fa4800ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:25.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.079+0000 7fa4871fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4800ac3a0 con 0x7fa48015ef80 2023-08-25T05:37:25.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.079+0000 7fa4871fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4800b1390 con 0x7fa48015eba0 2023-08-25T05:37:25.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.079+0000 7fa4871fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800b1670 con 0x7fa4800ceeb0 2023-08-25T05:37:25.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.079+0000 7fa477fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa48015ef80 0x7fa4800ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34362/0 (socket says 172.21.15.55:34362) 2023-08-25T05:37:25.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.079+0000 7fa477fff640 1 -- 172.21.15.55:0/2602614073 learned_addr learned my addr 172.21.15.55:0/2602614073 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:25.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.079+0000 7fa484f96640 1 --2- 172.21.15.55:0/2602614073 >> v2:172.21.15.55:3300/0 conn(0x7fa48015eba0 0x7fa4800b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:25.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.079+0000 7fa485797640 1 --2- 172.21.15.55:0/2602614073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4800ceeb0 0x7fa4800ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:25.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.079+0000 7fa484f96640 1 -- 172.21.15.55:0/2602614073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4800ceeb0 msgr2=0x7fa4800ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:25.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.079+0000 7fa484f96640 1 --2- 172.21.15.55:0/2602614073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4800ceeb0 0x7fa4800ab0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:25.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.079+0000 7fa484f96640 1 -- 172.21.15.55:0/2602614073 >> v1:172.21.15.55:6789/0 conn(0x7fa48015ef80 legacy=0x7fa4800ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:25.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.079+0000 7fa484f96640 1 -- 172.21.15.55:0/2602614073 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4800b1950 con 0x7fa48015eba0 2023-08-25T05:37:25.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.079+0000 7fa4777fe640 1 -- 172.21.15.55:0/2602614073 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281291427 0 0) 0x7fa4800ac3a0 con 0x7fa48015ef80 2023-08-25T05:37:25.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.079+0000 7fa484f96640 1 --2- 172.21.15.55:0/2602614073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa48015eba0 0x7fa4800b2a40 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0097c0 tx=0x7fa47c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13aee2fc2eddacd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:25.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4777fe640 1 -- 172.21.15.55:0/2602614073 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0ab650 con 0x7fa48015eba0 2023-08-25T05:37:25.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4777fe640 1 -- 172.21.15.55:0/2602614073 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c0ab7b0 con 0x7fa48015eba0 2023-08-25T05:37:25.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4777fe640 1 -- 172.21.15.55:0/2602614073 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0abb40 con 0x7fa48015eba0 2023-08-25T05:37:25.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4871fa640 1 -- 172.21.15.55:0/2602614073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa48015eba0 msgr2=0x7fa4800b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:25.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4871fa640 1 --2- 172.21.15.55:0/2602614073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa48015eba0 0x7fa4800b2a40 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0097c0 tx=0x7fa47c01c450 comp rx=0 tx=0).stop 2023-08-25T05:37:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4871fa640 1 -- 172.21.15.55:0/2602614073 shutdown_connections 2023-08-25T05:37:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4871fa640 1 --2- 172.21.15.55:0/2602614073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4800ceeb0 0x7fa4800ab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4871fa640 1 --2- 172.21.15.55:0/2602614073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa48015eba0 0x7fa4800b2a40 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4871fa640 1 -- 172.21.15.55:0/2602614073 >> 172.21.15.55:0/2602614073 conn(0x7fa480069d00 msgr2=0x7fa48006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4871fa640 1 -- 172.21.15.55:0/2602614073 shutdown_connections 2023-08-25T05:37:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4871fa640 1 -- 172.21.15.55:0/2602614073 wait complete. 2023-08-25T05:37:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4871fa640 1 Processor -- start 2023-08-25T05:37:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4871fa640 1 -- start start 2023-08-25T05:37:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4871fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4800ceeb0 0x7fa4801f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4871fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa48015eba0 0x7fa480156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4871fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa48015ef80 0x7fa4800cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4871fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4801f5f10 con 0x7fa48015eba0 2023-08-25T05:37:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4871fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa480159f20 con 0x7fa48015ef80 2023-08-25T05:37:25.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa4871fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa480158f70 con 0x7fa4800ceeb0 2023-08-25T05:37:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.083+0000 7fa477fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa48015eba0 0x7fa480156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.087+0000 7fa477fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa48015eba0 0x7fa480156100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54184/0 (socket says 172.21.15.55:54184) 2023-08-25T05:37:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.087+0000 7fa477fff640 1 -- 172.21.15.55:0/4057145247 learned_addr learned my addr 172.21.15.55:0/4057145247 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.087+0000 7fa484f96640 1 --2- 172.21.15.55:0/4057145247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4800ceeb0 0x7fa4801f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.087+0000 7fa485797640 1 --2- 172.21.15.55:0/4057145247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa48015ef80 0x7fa4800cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.087+0000 7fa477fff640 1 -- 172.21.15.55:0/4057145247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4800ceeb0 msgr2=0x7fa4801f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.087+0000 7fa477fff640 1 --2- 172.21.15.55:0/4057145247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4800ceeb0 0x7fa4801f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.087+0000 7fa477fff640 1 -- 172.21.15.55:0/4057145247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa48015ef80 msgr2=0x7fa4800cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.087+0000 7fa477fff640 1 --2- 172.21.15.55:0/4057145247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa48015ef80 0x7fa4800cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.087+0000 7fa477fff640 1 -- 172.21.15.55:0/4057145247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c009420 con 0x7fa48015eba0 2023-08-25T05:37:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.087+0000 7fa485797640 1 --2- 172.21.15.55:0/4057145247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa48015ef80 0x7fa4800cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.087+0000 7fa477fff640 1 --2- 172.21.15.55:0/4057145247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa48015eba0 0x7fa480156100 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7fa47000c520 tx=0x7fa47000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.087+0000 7fa4757fa640 1 -- 172.21.15.55:0/4057145247 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4700074e0 con 0x7fa48015eba0 2023-08-25T05:37:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.087+0000 7fa4757fa640 1 -- 172.21.15.55:0/4057145247 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa470007640 con 0x7fa48015eba0 2023-08-25T05:37:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.087+0000 7fa4757fa640 1 -- 172.21.15.55:0/4057145247 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4700049f0 con 0x7fa48015eba0 2023-08-25T05:37:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.087+0000 7fa4871fa640 1 -- 172.21.15.55:0/4057145247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa480158360 con 0x7fa48015eba0 2023-08-25T05:37:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.087+0000 7fa4871fa640 1 -- 172.21.15.55:0/4057145247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa480158920 con 0x7fa48015eba0 2023-08-25T05:37:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.087+0000 7fa4871fa640 1 -- 172.21.15.55:0/4057145247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48004dbe0 con 0x7fa48015eba0 2023-08-25T05:37:25.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.087+0000 7fa4757fa640 1 -- 172.21.15.55:0/4057145247 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fa470004b50 con 0x7fa48015eba0 2023-08-25T05:37:25.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.091+0000 7fa4757fa640 1 --2- 172.21.15.55:0/4057145247 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fa46c0657d0 0x7fa46c067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:25.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.091+0000 7fa4757fa640 1 -- 172.21.15.55:0/4057145247 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa470082100 con 0x7fa48015eba0 2023-08-25T05:37:25.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.091+0000 7fa484f96640 1 --2- 172.21.15.55:0/4057145247 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fa46c0657d0 0x7fa46c067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:25.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.091+0000 7fa484f96640 1 --2- 172.21.15.55:0/4057145247 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fa46c0657d0 0x7fa46c067c90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0af000 tx=0x7fa47c0a7000 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.095+0000 7fa4757fa640 1 -- 172.21.15.55:0/4057145247 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa47004fb50 con 0x7fa48015eba0 2023-08-25T05:37:25.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.251+0000 7fa4871fa640 1 -- 172.21.15.55:0/4057145247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4800ccc40 con 0x7fa48015eba0 2023-08-25T05:37:25.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.255+0000 7fa4757fa640 1 -- 172.21.15.55:0/4057145247 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+18322 (secure 0 0 0) 0x7fa470053170 con 0x7fa48015eba0 2023-08-25T05:37:25.256 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:25.256 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":201,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:37:23.923130+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:37:21.649130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-08-25T05:37:22.924825+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:37:25.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.255+0000 7fa4871fa640 1 -- 172.21.15.55:0/4057145247 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fa46c0657d0 msgr2=0x7fa46c067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:25.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.255+0000 7fa4871fa640 1 --2- 172.21.15.55:0/4057145247 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fa46c0657d0 0x7fa46c067c90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0af000 tx=0x7fa47c0a7000 comp rx=0 tx=0).stop 2023-08-25T05:37:25.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.255+0000 7fa4871fa640 1 -- 172.21.15.55:0/4057145247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa48015eba0 msgr2=0x7fa480156100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:25.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.255+0000 7fa4871fa640 1 --2- 172.21.15.55:0/4057145247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa48015eba0 0x7fa480156100 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7fa47000c520 tx=0x7fa47000c9e0 comp rx=0 tx=0).stop 2023-08-25T05:37:25.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.255+0000 7fa4871fa640 1 -- 172.21.15.55:0/4057145247 shutdown_connections 2023-08-25T05:37:25.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.255+0000 7fa4871fa640 1 --2- 172.21.15.55:0/4057145247 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fa46c0657d0 0x7fa46c067c90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:25.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.255+0000 7fa4871fa640 1 --2- 172.21.15.55:0/4057145247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa48015ef80 0x7fa4800cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:25.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.255+0000 7fa4871fa640 1 --2- 172.21.15.55:0/4057145247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa48015eba0 0x7fa480156100 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:25.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.255+0000 7fa4871fa640 1 --2- 172.21.15.55:0/4057145247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa4800ceeb0 0x7fa4801f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:25.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.255+0000 7fa4871fa640 1 -- 172.21.15.55:0/4057145247 >> 172.21.15.55:0/4057145247 conn(0x7fa480069d00 msgr2=0x7fa4800ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:25.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.255+0000 7fa4871fa640 1 -- 172.21.15.55:0/4057145247 shutdown_connections 2023-08-25T05:37:25.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.255+0000 7fa4871fa640 1 -- 172.21.15.55:0/4057145247 wait complete. 2023-08-25T05:37:25.277 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-25T05:37:25.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.423+0000 7fec8c019640 1 Processor -- start 2023-08-25T05:37:25.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.423+0000 7fec8c019640 1 -- start start 2023-08-25T05:37:25.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.423+0000 7fec8c019640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec8406d0d0 0x7fec840cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:25.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.423+0000 7fec8c019640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec840cdf20 con 0x7fec840ad6b0 2023-08-25T05:37:25.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.423+0000 7fec8c019640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8409bc40 con 0x7fec840cb710 2023-08-25T05:37:25.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.423+0000 7fec8c019640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8409bf20 con 0x7fec8406d0d0 2023-08-25T05:37:25.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.423+0000 7fec89db5640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fec840ad6b0 0x7fec840b1210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34372/0 (socket says 172.21.15.55:34372) 2023-08-25T05:37:25.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.423+0000 7fec89db5640 1 -- 172.21.15.55:0/3054921070 learned_addr learned my addr 172.21.15.55:0/3054921070 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:25.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.423+0000 7fec8a5b6640 1 --2- 172.21.15.55:0/3054921070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec8406d0d0 0x7fec840cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:25.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.423+0000 7fec88db3640 1 -- 172.21.15.55:0/3054921070 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093809713 0 0) 0x7fec840cdf20 con 0x7fec840ad6b0 2023-08-25T05:37:25.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.423+0000 7fec88db3640 1 -- 172.21.15.55:0/3054921070 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec70003530 con 0x7fec840ad6b0 2023-08-25T05:37:25.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.423+0000 7fec88db3640 1 -- 172.21.15.55:0/3054921070 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560973651 0 0) 0x7fec8409bc40 con 0x7fec840cb710 2023-08-25T05:37:25.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.423+0000 7fec88db3640 1 -- 172.21.15.55:0/3054921070 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec840cdf20 con 0x7fec840cb710 2023-08-25T05:37:25.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.423+0000 7fec8a5b6640 1 -- 172.21.15.55:0/3054921070 >> v1:172.21.15.110:6789/0 conn(0x7fec840cb710 legacy=0x7fec8406c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:25.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.423+0000 7fec8a5b6640 1 -- 172.21.15.55:0/3054921070 >> v1:172.21.15.55:6789/0 conn(0x7fec840ad6b0 legacy=0x7fec840b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:25.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.423+0000 7fec8a5b6640 1 -- 172.21.15.55:0/3054921070 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8406c1c0 con 0x7fec8406d0d0 2023-08-25T05:37:25.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.427+0000 7fec8a5b6640 1 --2- 172.21.15.55:0/3054921070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec8406d0d0 0x7fec840cd1b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009dc0 tx=0x7fec7c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f480f15528c80e81 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:25.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.427+0000 7fec88db3640 1 -- 172.21.15.55:0/3054921070 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c0a57c0 con 0x7fec8406d0d0 2023-08-25T05:37:25.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.427+0000 7fec88db3640 1 -- 172.21.15.55:0/3054921070 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c0a5920 con 0x7fec8406d0d0 2023-08-25T05:37:25.430 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.427+0000 7fec88db3640 1 -- 172.21.15.55:0/3054921070 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c0a5c90 con 0x7fec8406d0d0 2023-08-25T05:37:25.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.427+0000 7fec8c019640 1 -- 172.21.15.55:0/3054921070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec8406d0d0 msgr2=0x7fec840cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:25.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.427+0000 7fec8c019640 1 --2- 172.21.15.55:0/3054921070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec8406d0d0 0x7fec840cd1b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009dc0 tx=0x7fec7c01c970 comp rx=0 tx=0).stop 2023-08-25T05:37:25.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.427+0000 7fec8c019640 1 -- 172.21.15.55:0/3054921070 shutdown_connections 2023-08-25T05:37:25.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.427+0000 7fec8c019640 1 --2- 172.21.15.55:0/3054921070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec8406d0d0 0x7fec840cd1b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:25.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.427+0000 7fec8c019640 1 -- 172.21.15.55:0/3054921070 >> 172.21.15.55:0/3054921070 conn(0x7fec84069900 msgr2=0x7fec84069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:25.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.427+0000 7fec8c019640 1 -- 172.21.15.55:0/3054921070 shutdown_connections 2023-08-25T05:37:25.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.427+0000 7fec8c019640 1 -- 172.21.15.55:0/3054921070 wait complete. 2023-08-25T05:37:25.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec8c019640 1 Processor -- start 2023-08-25T05:37:25.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec8c019640 1 -- start start 2023-08-25T05:37:25.433 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec8c019640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec840ad6b0 0x7fec840ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:25.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec8c019640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec840cb710 0x7fec84099860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:25.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec8c019640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec840ab740 0x7fec840abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:25.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec8c019640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec840ac100 con 0x7fec840ad6b0 2023-08-25T05:37:25.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec8c019640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec84099da0 con 0x7fec840ab740 2023-08-25T05:37:25.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec8c019640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec840993d0 con 0x7fec840cb710 2023-08-25T05:37:25.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec89db5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec840ad6b0 0x7fec840ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec89db5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec840ad6b0 0x7fec840ac900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54200/0 (socket says 172.21.15.55:54200) 2023-08-25T05:37:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec89db5640 1 -- 172.21.15.55:0/2289404639 learned_addr learned my addr 172.21.15.55:0/2289404639 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec895b4640 1 --2- 172.21.15.55:0/2289404639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec840cb710 0x7fec84099860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec8a5b6640 1 --2- 172.21.15.55:0/2289404639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec840ab740 0x7fec840abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:25.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec89db5640 1 -- 172.21.15.55:0/2289404639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec840cb710 msgr2=0x7fec84099860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:25.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec89db5640 1 --2- 172.21.15.55:0/2289404639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec840cb710 0x7fec84099860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:25.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec89db5640 1 -- 172.21.15.55:0/2289404639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec840ab740 msgr2=0x7fec840abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:25.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec89db5640 1 --2- 172.21.15.55:0/2289404639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec840ab740 0x7fec840abbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:25.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec89db5640 1 -- 172.21.15.55:0/2289404639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c009a70 con 0x7fec840ad6b0 2023-08-25T05:37:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec89db5640 1 --2- 172.21.15.55:0/2289404639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec840ad6b0 0x7fec840ac900 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7fec8000c6e0 tx=0x7fec8000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec7a7fc640 1 -- 172.21.15.55:0/2289404639 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec80007270 con 0x7fec840ad6b0 2023-08-25T05:37:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec7a7fc640 1 -- 172.21.15.55:0/2289404639 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec800073d0 con 0x7fec840ad6b0 2023-08-25T05:37:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec7a7fc640 1 -- 172.21.15.55:0/2289404639 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec800057b0 con 0x7fec840ad6b0 2023-08-25T05:37:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec8c019640 1 -- 172.21.15.55:0/2289404639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec840c43e0 con 0x7fec840ad6b0 2023-08-25T05:37:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.431+0000 7fec8c019640 1 -- 172.21.15.55:0/2289404639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec84098d80 con 0x7fec840ad6b0 2023-08-25T05:37:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.435+0000 7fec8c019640 1 -- 172.21.15.55:0/2289404639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec84073ec0 con 0x7fec840ad6b0 2023-08-25T05:37:25.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.435+0000 7fec7a7fc640 1 -- 172.21.15.55:0/2289404639 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fec80005910 con 0x7fec840ad6b0 2023-08-25T05:37:25.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.435+0000 7fec7a7fc640 1 --2- 172.21.15.55:0/2289404639 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fec680657a0 0x7fec68067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:25.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.435+0000 7fec7a7fc640 1 -- 172.21.15.55:0/2289404639 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fec800824b0 con 0x7fec840ad6b0 2023-08-25T05:37:25.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.435+0000 7fec895b4640 1 --2- 172.21.15.55:0/2289404639 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fec680657a0 0x7fec68067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:25.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.435+0000 7fec895b4640 1 --2- 172.21.15.55:0/2289404639 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fec680657a0 0x7fec68067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fec840c2e30 tx=0x7fec74009040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:25.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.439+0000 7fec7a7fc640 1 -- 172.21.15.55:0/2289404639 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fec8004fe70 con 0x7fec840ad6b0 2023-08-25T05:37:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:25.631+0000 7fec8c019640 1 -- 172.21.15.55:0/2289404639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fec840b1580 con 0x7fec840ad6b0 2023-08-25T05:37:26.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.559+0000 7fec7a7fc640 1 -- 172.21.15.55:0/2289404639 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v99) v1 ==== 118+0+0 (secure 0 0 0) 0x7fec80053490 con 0x7fec840ad6b0 2023-08-25T05:37:26.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.563+0000 7fec8c019640 1 -- 172.21.15.55:0/2289404639 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fec680657a0 msgr2=0x7fec68067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:26.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.563+0000 7fec8c019640 1 --2- 172.21.15.55:0/2289404639 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fec680657a0 0x7fec68067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fec840c2e30 tx=0x7fec74009040 comp rx=0 tx=0).stop 2023-08-25T05:37:26.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.563+0000 7fec8c019640 1 -- 172.21.15.55:0/2289404639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec840ad6b0 msgr2=0x7fec840ac900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:26.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.563+0000 7fec8c019640 1 --2- 172.21.15.55:0/2289404639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec840ad6b0 0x7fec840ac900 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7fec8000c6e0 tx=0x7fec8000cba0 comp rx=0 tx=0).stop 2023-08-25T05:37:26.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.563+0000 7fec8c019640 1 -- 172.21.15.55:0/2289404639 shutdown_connections 2023-08-25T05:37:26.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.563+0000 7fec8c019640 1 --2- 172.21.15.55:0/2289404639 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fec680657a0 0x7fec68067c60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:26.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.563+0000 7fec8c019640 1 --2- 172.21.15.55:0/2289404639 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fec840ab740 0x7fec840abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:26.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.563+0000 7fec8c019640 1 --2- 172.21.15.55:0/2289404639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fec840cb710 0x7fec84099860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:26.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.563+0000 7fec8c019640 1 --2- 172.21.15.55:0/2289404639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec840ad6b0 0x7fec840ac900 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:26.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.563+0000 7fec8c019640 1 -- 172.21.15.55:0/2289404639 >> 172.21.15.55:0/2289404639 conn(0x7fec84069900 msgr2=0x7fec84158b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:26.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.563+0000 7fec8c019640 1 -- 172.21.15.55:0/2289404639 shutdown_connections 2023-08-25T05:37:26.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.563+0000 7fec8c019640 1 -- 172.21.15.55:0/2289404639 wait complete. 2023-08-25T05:37:26.587 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-25T05:37:26.587 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-25T05:37:26.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.739+0000 7f9a7c8ec640 1 Processor -- start 2023-08-25T05:37:26.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.739+0000 7f9a7c8ec640 1 -- start start 2023-08-25T05:37:26.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.739+0000 7f9a7c8ec640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9a780ae8e0 0x7f9a78069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:26.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.739+0000 7f9a7c8ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a78069e40 0x7f9a780ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:26.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.739+0000 7f9a7c8ec640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7806a2a0 con 0x7f9a780ced50 2023-08-25T05:37:26.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.739+0000 7f9a7c8ec640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7806d200 con 0x7f9a780ae8e0 2023-08-25T05:37:26.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.739+0000 7f9a7c8ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7806c5f0 con 0x7f9a78069e40 2023-08-25T05:37:26.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.739+0000 7f9a76d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9a780ced50 0x7f9a7815c150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34388/0 (socket says 172.21.15.55:34388) 2023-08-25T05:37:26.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.739+0000 7f9a76d9d640 1 -- 172.21.15.55:0/2386826735 learned_addr learned my addr 172.21.15.55:0/2386826735 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:26.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.743+0000 7f9a7659c640 1 --2- 172.21.15.55:0/2386826735 >> v2:172.21.15.110:3300/0 conn(0x7f9a780ae8e0 0x7f9a78069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:26.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.743+0000 7f9a6ffff640 1 --2- 172.21.15.55:0/2386826735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a78069e40 0x7f9a780ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:26.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.743+0000 7f9a75d9b640 1 -- 172.21.15.55:0/2386826735 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435118727 0 0) 0x7f9a7806a2a0 con 0x7f9a780ced50 2023-08-25T05:37:26.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.743+0000 7f9a75d9b640 1 -- 172.21.15.55:0/2386826735 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a64003530 con 0x7f9a780ced50 2023-08-25T05:37:26.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.743+0000 7f9a7659c640 1 -- 172.21.15.55:0/2386826735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a78069e40 msgr2=0x7f9a780ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:26.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.743+0000 7f9a75d9b640 1 -- 172.21.15.55:0/2386826735 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 243663533 0 0) 0x7f9a64003530 con 0x7f9a780ced50 2023-08-25T05:37:26.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.743+0000 7f9a7659c640 1 --2- 172.21.15.55:0/2386826735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a78069e40 0x7f9a780ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:26.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.743+0000 7f9a7659c640 1 -- 172.21.15.55:0/2386826735 >> v1:172.21.15.55:6789/0 conn(0x7f9a780ced50 legacy=0x7f9a7815c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:26.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.743+0000 7f9a7659c640 1 -- 172.21.15.55:0/2386826735 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7806c8d0 con 0x7f9a780ae8e0 2023-08-25T05:37:26.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.743+0000 7f9a6ffff640 1 --2- 172.21.15.55:0/2386826735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a78069e40 0x7f9a780ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:26.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.743+0000 7f9a7659c640 1 --2- 172.21.15.55:0/2386826735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a780ae8e0 0x7f9a78069900 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f9a680097c0 tx=0x7f9a6801c340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bdec52e8d4c292e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:26.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.747+0000 7f9a75d9b640 1 -- 172.21.15.55:0/2386826735 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70001a00 con 0x7f9a780ae8e0 2023-08-25T05:37:26.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.747+0000 7f9a75d9b640 1 -- 172.21.15.55:0/2386826735 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a680a7050 con 0x7f9a780ae8e0 2023-08-25T05:37:26.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.747+0000 7f9a75d9b640 1 -- 172.21.15.55:0/2386826735 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a680ab620 con 0x7f9a780ae8e0 2023-08-25T05:37:26.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.747+0000 7f9a7c8ec640 1 -- 172.21.15.55:0/2386826735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a780ae8e0 msgr2=0x7f9a78069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:26.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.747+0000 7f9a7c8ec640 1 --2- 172.21.15.55:0/2386826735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a780ae8e0 0x7f9a78069900 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f9a680097c0 tx=0x7f9a6801c340 comp rx=0 tx=0).stop 2023-08-25T05:37:26.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.747+0000 7f9a7c8ec640 1 -- 172.21.15.55:0/2386826735 shutdown_connections 2023-08-25T05:37:26.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.747+0000 7f9a7c8ec640 1 --2- 172.21.15.55:0/2386826735 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a78069e40 0x7f9a780ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:26.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.747+0000 7f9a7c8ec640 1 --2- 172.21.15.55:0/2386826735 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a780ae8e0 0x7f9a78069900 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:26.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.747+0000 7f9a7c8ec640 1 -- 172.21.15.55:0/2386826735 >> 172.21.15.55:0/2386826735 conn(0x7f9a780cf4d0 msgr2=0x7f9a780cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:26.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.747+0000 7f9a7c8ec640 1 -- 172.21.15.55:0/2386826735 shutdown_connections 2023-08-25T05:37:26.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.747+0000 7f9a7c8ec640 1 -- 172.21.15.55:0/2386826735 wait complete. 2023-08-25T05:37:26.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.747+0000 7f9a7c8ec640 1 Processor -- start 2023-08-25T05:37:26.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.747+0000 7f9a7c8ec640 1 -- start start 2023-08-25T05:37:26.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.747+0000 7f9a7c8ec640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a78069e40 0x7f9a78159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:26.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.747+0000 7f9a7c8ec640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a780ae8e0 0x7f9a78158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:26.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a7c8ec640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a780ced50 0x7f9a78159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:26.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a7c8ec640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7809cc90 con 0x7f9a780ced50 2023-08-25T05:37:26.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a7c8ec640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a78151cd0 con 0x7f9a78069e40 2023-08-25T05:37:26.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a7c8ec640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7809d1c0 con 0x7f9a780ae8e0 2023-08-25T05:37:26.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a76d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a780ced50 0x7f9a78159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:26.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a7659c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a78069e40 0x7f9a78159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:26.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a76d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a780ced50 0x7f9a78159210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54216/0 (socket says 172.21.15.55:54216) 2023-08-25T05:37:26.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a76d9d640 1 -- 172.21.15.55:0/1791338393 learned_addr learned my addr 172.21.15.55:0/1791338393 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:26.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a6ffff640 1 --2- 172.21.15.55:0/1791338393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a780ae8e0 0x7f9a78158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:26.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a76d9d640 1 -- 172.21.15.55:0/1791338393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a780ae8e0 msgr2=0x7f9a78158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:26.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a76d9d640 1 --2- 172.21.15.55:0/1791338393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a780ae8e0 0x7f9a78158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:26.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a76d9d640 1 -- 172.21.15.55:0/1791338393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a78069e40 msgr2=0x7f9a78159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:26.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a76d9d640 1 --2- 172.21.15.55:0/1791338393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a78069e40 0x7f9a78159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:26.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a76d9d640 1 -- 172.21.15.55:0/1791338393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a60009420 con 0x7f9a780ced50 2023-08-25T05:37:26.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a76d9d640 1 --2- 172.21.15.55:0/1791338393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a780ced50 0x7f9a78159210 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000cca0 tx=0x7f9a7000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:26.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a6effd640 1 -- 172.21.15.55:0/1791338393 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70012400 con 0x7f9a780ced50 2023-08-25T05:37:26.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a6effd640 1 -- 172.21.15.55:0/1791338393 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a70012560 con 0x7f9a780ced50 2023-08-25T05:37:26.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a6effd640 1 -- 172.21.15.55:0/1791338393 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70012910 con 0x7f9a780ced50 2023-08-25T05:37:26.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a7c8ec640 1 -- 172.21.15.55:0/1791338393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a68009420 con 0x7f9a780ced50 2023-08-25T05:37:26.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a7c8ec640 1 -- 172.21.15.55:0/1791338393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a78153a20 con 0x7f9a780ced50 2023-08-25T05:37:26.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a7c8ec640 1 -- 172.21.15.55:0/1791338393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a78168710 con 0x7f9a780ced50 2023-08-25T05:37:26.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.751+0000 7f9a6effd640 1 -- 172.21.15.55:0/1791338393 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f9a70007070 con 0x7f9a780ced50 2023-08-25T05:37:26.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.755+0000 7f9a6effd640 1 --2- 172.21.15.55:0/1791338393 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f9a580657a0 0x7f9a58067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:26.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.755+0000 7f9a6effd640 1 -- 172.21.15.55:0/1791338393 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a70082ff0 con 0x7f9a780ced50 2023-08-25T05:37:26.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.755+0000 7f9a7659c640 1 --2- 172.21.15.55:0/1791338393 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f9a580657a0 0x7f9a58067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:26.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.755+0000 7f9a7659c640 1 --2- 172.21.15.55:0/1791338393 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f9a580657a0 0x7f9a58067c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9a680ad000 tx=0x7f9a680a6000 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:26.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.755+0000 7f9a6effd640 1 -- 172.21.15.55:0/1791338393 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9a700b3d90 con 0x7f9a780ced50 2023-08-25T05:37:26.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:26.943+0000 7f9a7c8ec640 1 -- 172.21.15.55:0/1791338393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9a78073ec0 con 0x7f9a780ced50 2023-08-25T05:37:27.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.575+0000 7f9a6effd640 1 -- 172.21.15.55:0/1791338393 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v100) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9a70017020 con 0x7f9a780ced50 2023-08-25T05:37:27.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.579+0000 7f9a7c8ec640 1 -- 172.21.15.55:0/1791338393 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f9a580657a0 msgr2=0x7f9a58067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:27.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.579+0000 7f9a7c8ec640 1 --2- 172.21.15.55:0/1791338393 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f9a580657a0 0x7f9a58067c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9a680ad000 tx=0x7f9a680a6000 comp rx=0 tx=0).stop 2023-08-25T05:37:27.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.579+0000 7f9a7c8ec640 1 -- 172.21.15.55:0/1791338393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a780ced50 msgr2=0x7f9a78159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:27.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.579+0000 7f9a7c8ec640 1 --2- 172.21.15.55:0/1791338393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a780ced50 0x7f9a78159210 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000cca0 tx=0x7f9a7000a430 comp rx=0 tx=0).stop 2023-08-25T05:37:27.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.579+0000 7f9a7c8ec640 1 -- 172.21.15.55:0/1791338393 shutdown_connections 2023-08-25T05:37:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.579+0000 7f9a7c8ec640 1 --2- 172.21.15.55:0/1791338393 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f9a580657a0 0x7f9a58067c60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.579+0000 7f9a7c8ec640 1 --2- 172.21.15.55:0/1791338393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a780ced50 0x7f9a78159210 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.579+0000 7f9a7c8ec640 1 --2- 172.21.15.55:0/1791338393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9a780ae8e0 0x7f9a78158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.579+0000 7f9a7c8ec640 1 --2- 172.21.15.55:0/1791338393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9a78069e40 0x7f9a78159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.579+0000 7f9a7c8ec640 1 -- 172.21.15.55:0/1791338393 >> 172.21.15.55:0/1791338393 conn(0x7f9a780cf4d0 msgr2=0x7f9a78154620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.579+0000 7f9a7c8ec640 1 -- 172.21.15.55:0/1791338393 shutdown_connections 2023-08-25T05:37:27.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.579+0000 7f9a7c8ec640 1 -- 172.21.15.55:0/1791338393 wait complete. 2023-08-25T05:37:27.603 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-25T05:37:27.603 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:37:27.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.747+0000 7f5a41710640 1 Processor -- start 2023-08-25T05:37:27.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.747+0000 7f5a41710640 1 -- start start 2023-08-25T05:37:27.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.751+0000 7f5a41710640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5a3c0cb2a0 0x7f5a3c0b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:27.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.751+0000 7f5a41710640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a3c159f10 0x7f5a3c0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:27.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.751+0000 7f5a41710640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3c0cdbf0 con 0x7f5a3c158e10 2023-08-25T05:37:27.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.751+0000 7f5a41710640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3c0ad940 con 0x7f5a3c0cb2a0 2023-08-25T05:37:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.751+0000 7f5a41710640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c06d380 con 0x7f5a3c159f10 2023-08-25T05:37:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.751+0000 7f5a327fc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5a3c0cb2a0 0x7f5a3c0b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.751+0000 7f5a3b7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a3c159f10 0x7f5a3c0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:27.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.751+0000 7f5a327fc640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5a3c0cb2a0 0x7f5a3c0b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:34810/0 (socket says 172.21.15.55:34810) 2023-08-25T05:37:27.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.751+0000 7f5a327fc640 1 -- 172.21.15.55:0/2336338586 learned_addr learned my addr 172.21.15.55:0/2336338586 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:27.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.751+0000 7f5a3b7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a3c159f10 0x7f5a3c0c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:58410/0 (socket says 172.21.15.55:58410) 2023-08-25T05:37:27.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.751+0000 7f5a3affd640 1 --1- 172.21.15.55:0/2336338586 >> v1:172.21.15.110:6789/0 conn(0x7f5a3c158e10 0x7f5a3c0cab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:49200/0 (socket says 172.21.15.55:49200) 2023-08-25T05:37:27.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.751+0000 7f5a3b7fe640 1 -- 172.21.15.55:0/2336338586 >> v2:172.21.15.110:3300/0 conn(0x7f5a3c0cb2a0 msgr2=0x7f5a3c0b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:27.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.751+0000 7f5a3b7fe640 1 --2- 172.21.15.55:0/2336338586 >> v2:172.21.15.110:3300/0 conn(0x7f5a3c0cb2a0 0x7f5a3c0b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:27.754 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.751+0000 7f5a3b7fe640 1 -- 172.21.15.55:0/2336338586 >> v1:172.21.15.110:6789/0 conn(0x7f5a3c158e10 legacy=0x7f5a3c0cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:27.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.751+0000 7f5a3b7fe640 1 -- 172.21.15.55:0/2336338586 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c06d660 con 0x7f5a3c159f10 2023-08-25T05:37:27.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.755+0000 7f5a3b7fe640 1 --2- 172.21.15.55:0/2336338586 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a3c159f10 0x7f5a3c0c9a00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5a340097c0 tx=0x7f5a3401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3d14a4613851677 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:27.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.755+0000 7f5a3a7fc640 1 -- 172.21.15.55:0/2336338586 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340ab620 con 0x7f5a3c159f10 2023-08-25T05:37:27.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.755+0000 7f5a3a7fc640 1 -- 172.21.15.55:0/2336338586 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a340ab780 con 0x7f5a3c159f10 2023-08-25T05:37:27.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.755+0000 7f5a3a7fc640 1 -- 172.21.15.55:0/2336338586 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340abb10 con 0x7f5a3c159f10 2023-08-25T05:37:27.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.755+0000 7f5a41710640 1 -- 172.21.15.55:0/2336338586 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a3c159f10 msgr2=0x7f5a3c0c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:27.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.755+0000 7f5a41710640 1 --2- 172.21.15.55:0/2336338586 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a3c159f10 0x7f5a3c0c9a00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5a340097c0 tx=0x7f5a3401c480 comp rx=0 tx=0).stop 2023-08-25T05:37:27.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.755+0000 7f5a41710640 1 -- 172.21.15.55:0/2336338586 shutdown_connections 2023-08-25T05:37:27.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.755+0000 7f5a41710640 1 --2- 172.21.15.55:0/2336338586 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a3c159f10 0x7f5a3c0c9a00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.755+0000 7f5a41710640 1 --2- 172.21.15.55:0/2336338586 >> v2:172.21.15.110:3300/0 conn(0x7f5a3c0cb2a0 0x7f5a3c0b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.755+0000 7f5a41710640 1 -- 172.21.15.55:0/2336338586 >> 172.21.15.55:0/2336338586 conn(0x7f5a3c069d00 msgr2=0x7f5a3c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.755+0000 7f5a41710640 1 -- 172.21.15.55:0/2336338586 shutdown_connections 2023-08-25T05:37:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.755+0000 7f5a41710640 1 -- 172.21.15.55:0/2336338586 wait complete. 2023-08-25T05:37:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a41710640 1 Processor -- start 2023-08-25T05:37:27.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a41710640 1 -- start start 2023-08-25T05:37:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a41710640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a3c0cb2a0 0x7f5a3c154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a41710640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a3c158e10 0x7f5a3c0adce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a41710640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a3c159f10 0x7f5a3c0cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a41710640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c0ae220 con 0x7f5a3c0cb2a0 2023-08-25T05:37:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a41710640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c0ab190 con 0x7f5a3c159f10 2023-08-25T05:37:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a41710640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c0ab470 con 0x7f5a3c158e10 2023-08-25T05:37:27.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a3affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a3c0cb2a0 0x7f5a3c154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:27.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a3affd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a3c0cb2a0 0x7f5a3c154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54226/0 (socket says 172.21.15.55:54226) 2023-08-25T05:37:27.762 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a3affd640 1 -- 172.21.15.55:0/3692726571 learned_addr learned my addr 172.21.15.55:0/3692726571 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:27.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a3b7fe640 1 --2- 172.21.15.55:0/3692726571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a3c159f10 0x7f5a3c0cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:27.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a327fc640 1 --2- 172.21.15.55:0/3692726571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a3c158e10 0x7f5a3c0adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:27.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a3affd640 1 -- 172.21.15.55:0/3692726571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a3c158e10 msgr2=0x7f5a3c0adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:27.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a3affd640 1 --2- 172.21.15.55:0/3692726571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a3c158e10 0x7f5a3c0adce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:27.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a3affd640 1 -- 172.21.15.55:0/3692726571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a3c159f10 msgr2=0x7f5a3c0cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:27.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a3affd640 1 --2- 172.21.15.55:0/3692726571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a3c159f10 0x7f5a3c0cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:27.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a3affd640 1 -- 172.21.15.55:0/3692726571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a34009420 con 0x7f5a3c0cb2a0 2023-08-25T05:37:27.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a3b7fe640 1 --2- 172.21.15.55:0/3692726571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a3c159f10 0x7f5a3c0cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:27.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a327fc640 1 --2- 172.21.15.55:0/3692726571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a3c158e10 0x7f5a3c0adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:27.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a3affd640 1 --2- 172.21.15.55:0/3692726571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a3c0cb2a0 0x7f5a3c154180 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00c790 tx=0x7f5a2c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:27.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a33fff640 1 -- 172.21.15.55:0/3692726571 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c00cea0 con 0x7f5a3c0cb2a0 2023-08-25T05:37:27.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a33fff640 1 -- 172.21.15.55:0/3692726571 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c00a640 con 0x7f5a3c0cb2a0 2023-08-25T05:37:27.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a41710640 1 -- 172.21.15.55:0/3692726571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3c159370 con 0x7f5a3c0cb2a0 2023-08-25T05:37:27.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a33fff640 1 -- 172.21.15.55:0/3692726571 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c00a9b0 con 0x7f5a3c0cb2a0 2023-08-25T05:37:27.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.759+0000 7f5a41710640 1 -- 172.21.15.55:0/3692726571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3c0aba30 con 0x7f5a3c0cb2a0 2023-08-25T05:37:27.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.763+0000 7f5a41710640 1 -- 172.21.15.55:0/3692726571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3c04dbe0 con 0x7f5a3c0cb2a0 2023-08-25T05:37:27.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.763+0000 7f5a33fff640 1 -- 172.21.15.55:0/3692726571 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f5a2c00ab10 con 0x7f5a3c0cb2a0 2023-08-25T05:37:27.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.763+0000 7f5a33fff640 1 --2- 172.21.15.55:0/3692726571 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f5a1c0657a0 0x7f5a1c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:27.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.763+0000 7f5a33fff640 1 -- 172.21.15.55:0/3692726571 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5a2c0826d0 con 0x7f5a3c0cb2a0 2023-08-25T05:37:27.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.763+0000 7f5a327fc640 1 --2- 172.21.15.55:0/3692726571 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f5a1c0657a0 0x7f5a1c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:27.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.763+0000 7f5a327fc640 1 --2- 172.21.15.55:0/3692726571 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f5a1c0657a0 0x7f5a1c067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0cd160 tx=0x7f5a24008040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:27.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.767+0000 7f5a33fff640 1 -- 172.21.15.55:0/3692726571 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5a2c050110 con 0x7f5a3c0cb2a0 2023-08-25T05:37:27.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.959+0000 7f5a41710640 1 -- 172.21.15.55:0/3692726571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a3c0c86d0 con 0x7f5a3c0cb2a0 2023-08-25T05:37:27.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.959+0000 7f5a33fff640 1 -- 172.21.15.55:0/3692726571 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4891 (secure 0 0 0) 0x7f5a2c053730 con 0x7f5a3c0cb2a0 2023-08-25T05:37:27.963 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:27.963 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":100,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/2330461418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2330461418},{"type":"v1","addr":"172.21.15.110:6836","nonce":2330461418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":9182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3918521245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3918521245},{"type":"v1","addr":"172.21.15.110:6837","nonce":3918521245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":11343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3205982255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3205982255},{"type":"v1","addr":"172.21.15.55:6834","nonce":3205982255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:37:23.923618+0000","modified":"2023-08-25T05:37:27.560216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":11349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11349":{"gid":11349,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3936252180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3936252180},{"type":"v1","addr":"172.21.15.55:6835","nonce":3936252180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-08-25T05:37:27.963 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 100 2023-08-25T05:37:27.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.963+0000 7f5a41710640 1 -- 172.21.15.55:0/3692726571 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f5a1c0657a0 msgr2=0x7f5a1c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:27.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.963+0000 7f5a41710640 1 --2- 172.21.15.55:0/3692726571 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f5a1c0657a0 0x7f5a1c067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0cd160 tx=0x7f5a24008040 comp rx=0 tx=0).stop 2023-08-25T05:37:27.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.963+0000 7f5a41710640 1 -- 172.21.15.55:0/3692726571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a3c0cb2a0 msgr2=0x7f5a3c154180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:27.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.963+0000 7f5a41710640 1 --2- 172.21.15.55:0/3692726571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a3c0cb2a0 0x7f5a3c154180 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00c790 tx=0x7f5a2c00cc50 comp rx=0 tx=0).stop 2023-08-25T05:37:27.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.963+0000 7f5a41710640 1 -- 172.21.15.55:0/3692726571 shutdown_connections 2023-08-25T05:37:27.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.963+0000 7f5a41710640 1 --2- 172.21.15.55:0/3692726571 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f5a1c0657a0 0x7f5a1c067c60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:27.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.963+0000 7f5a41710640 1 --2- 172.21.15.55:0/3692726571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a3c159f10 0x7f5a3c0cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:27.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.963+0000 7f5a41710640 1 --2- 172.21.15.55:0/3692726571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a3c158e10 0x7f5a3c0adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:27.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.963+0000 7f5a41710640 1 --2- 172.21.15.55:0/3692726571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5a3c0cb2a0 0x7f5a3c154180 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:27.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.963+0000 7f5a41710640 1 -- 172.21.15.55:0/3692726571 >> 172.21.15.55:0/3692726571 conn(0x7f5a3c069d00 msgr2=0x7f5a3c155330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:27.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.963+0000 7f5a41710640 1 -- 172.21.15.55:0/3692726571 shutdown_connections 2023-08-25T05:37:27.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:27.963+0000 7f5a41710640 1 -- 172.21.15.55:0/3692726571 wait complete. 2023-08-25T05:37:27.984 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:37:28.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.123+0000 7f418766d640 1 Processor -- start 2023-08-25T05:37:28.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.123+0000 7f418766d640 1 -- start start 2023-08-25T05:37:28.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.127+0000 7f418766d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f418015eba0 0x7f41800b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.127+0000 7f418766d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f418015ef80 0x7f41800ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.127+0000 7f418766d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f41800cece0 0x7f41800cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.127+0000 7f418766d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41800cf170 con 0x7f41800cece0 2023-08-25T05:37:28.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.127+0000 7f418766d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41800ac3a0 con 0x7f418015ef80 2023-08-25T05:37:28.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.127+0000 7f418766d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41800b1390 con 0x7f418015eba0 2023-08-25T05:37:28.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.127+0000 7f4185c0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f41800cece0 0x7f41800cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.127+0000 7f4185c0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f41800cece0 0x7f41800cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54230/0 (socket says 172.21.15.55:54230) 2023-08-25T05:37:28.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.127+0000 7f4185c0a640 1 -- 172.21.15.55:0/242040111 learned_addr learned my addr 172.21.15.55:0/242040111 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:28.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.127+0000 7f4185409640 1 --2- 172.21.15.55:0/242040111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f418015eba0 0x7f41800b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.127+0000 7f4184c08640 1 --2- 172.21.15.55:0/242040111 >> v2:172.21.15.110:3300/0 conn(0x7f418015ef80 0x7f41800ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.127+0000 7f4185c0a640 1 -- 172.21.15.55:0/242040111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f418015eba0 msgr2=0x7f41800b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:28.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.127+0000 7f4185c0a640 1 --2- 172.21.15.55:0/242040111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f418015eba0 0x7f41800b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.127+0000 7f4185c0a640 1 -- 172.21.15.55:0/242040111 >> v2:172.21.15.110:3300/0 conn(0x7f418015ef80 msgr2=0x7f41800ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:28.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.127+0000 7f4185c0a640 1 --2- 172.21.15.55:0/242040111 >> v2:172.21.15.110:3300/0 conn(0x7f418015ef80 0x7f41800ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.127+0000 7f4185c0a640 1 -- 172.21.15.55:0/242040111 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41800b1670 con 0x7f41800cece0 2023-08-25T05:37:28.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.131+0000 7f4185c0a640 1 --2- 172.21.15.55:0/242040111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41800cece0 0x7f41800cd370 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f41800cbe60 tx=0x7f417801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963410618f71064c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:28.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.131+0000 7f4177fff640 1 -- 172.21.15.55:0/242040111 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41780a5560 con 0x7f41800cece0 2023-08-25T05:37:28.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.131+0000 7f4177fff640 1 -- 172.21.15.55:0/242040111 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41780a56c0 con 0x7f41800cece0 2023-08-25T05:37:28.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.131+0000 7f4177fff640 1 -- 172.21.15.55:0/242040111 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41780a5a50 con 0x7f41800cece0 2023-08-25T05:37:28.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.131+0000 7f418766d640 1 -- 172.21.15.55:0/242040111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41800cece0 msgr2=0x7f41800cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:28.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.131+0000 7f418766d640 1 --2- 172.21.15.55:0/242040111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41800cece0 0x7f41800cd370 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f41800cbe60 tx=0x7f417801c6e0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.131+0000 7f418766d640 1 -- 172.21.15.55:0/242040111 shutdown_connections 2023-08-25T05:37:28.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.131+0000 7f418766d640 1 --2- 172.21.15.55:0/242040111 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41800cece0 0x7f41800cd370 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.131+0000 7f418766d640 1 --2- 172.21.15.55:0/242040111 >> v2:172.21.15.110:3300/0 conn(0x7f418015ef80 0x7f41800ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.131+0000 7f418766d640 1 --2- 172.21.15.55:0/242040111 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f418015eba0 0x7f41800b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.131+0000 7f418766d640 1 -- 172.21.15.55:0/242040111 >> 172.21.15.55:0/242040111 conn(0x7f4180069d00 msgr2=0x7f418006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:28.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.131+0000 7f418766d640 1 -- 172.21.15.55:0/242040111 shutdown_connections 2023-08-25T05:37:28.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.131+0000 7f418766d640 1 -- 172.21.15.55:0/242040111 wait complete. 2023-08-25T05:37:28.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.131+0000 7f418766d640 1 Processor -- start 2023-08-25T05:37:28.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.131+0000 7f418766d640 1 -- start start 2023-08-25T05:37:28.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f418766d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41800cece0 0x7f41800c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f418766d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f418015eba0 0x7f4180153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f418766d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f418015ef80 0x7f4180070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f418766d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41800c2870 con 0x7f418015ef80 2023-08-25T05:37:28.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f418766d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41800c2b50 con 0x7f41800cece0 2023-08-25T05:37:28.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f418766d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41800c2e30 con 0x7f418015eba0 2023-08-25T05:37:28.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f4185c0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f418015ef80 0x7f4180070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f4185c0a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f418015ef80 0x7f4180070d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54244/0 (socket says 172.21.15.55:54244) 2023-08-25T05:37:28.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f4185c0a640 1 -- 172.21.15.55:0/2648722269 learned_addr learned my addr 172.21.15.55:0/2648722269 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:28.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f4184c08640 1 --2- 172.21.15.55:0/2648722269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f418015eba0 0x7f4180153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f4185409640 1 --2- 172.21.15.55:0/2648722269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41800cece0 0x7f41800c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f4185c0a640 1 -- 172.21.15.55:0/2648722269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f418015eba0 msgr2=0x7f4180153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:28.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f4185c0a640 1 --2- 172.21.15.55:0/2648722269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f418015eba0 0x7f4180153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f4185c0a640 1 -- 172.21.15.55:0/2648722269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41800cece0 msgr2=0x7f41800c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:28.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f4185c0a640 1 --2- 172.21.15.55:0/2648722269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41800cece0 0x7f41800c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f4185c0a640 1 -- 172.21.15.55:0/2648722269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178009b30 con 0x7f418015ef80 2023-08-25T05:37:28.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f4185c0a640 1 --2- 172.21.15.55:0/2648722269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f418015ef80 0x7f4180070d90 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f417801ad90 tx=0x7f4178019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:28.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f4175ffb640 1 -- 172.21.15.55:0/2648722269 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41780a5560 con 0x7f418015ef80 2023-08-25T05:37:28.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f4175ffb640 1 -- 172.21.15.55:0/2648722269 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41780b8690 con 0x7f418015ef80 2023-08-25T05:37:28.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f418766d640 1 -- 172.21.15.55:0/2648722269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418015b850 con 0x7f418015ef80 2023-08-25T05:37:28.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f4175ffb640 1 -- 172.21.15.55:0/2648722269 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41780b8a80 con 0x7f418015ef80 2023-08-25T05:37:28.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f418766d640 1 -- 172.21.15.55:0/2648722269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418015be10 con 0x7f418015ef80 2023-08-25T05:37:28.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f418766d640 1 -- 172.21.15.55:0/2648722269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418015c000 con 0x7f418015ef80 2023-08-25T05:37:28.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.135+0000 7f4175ffb640 1 -- 172.21.15.55:0/2648722269 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f41780b8be0 con 0x7f418015ef80 2023-08-25T05:37:28.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.139+0000 7f4175ffb640 1 --2- 172.21.15.55:0/2648722269 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f41640657a0 0x7f4164067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.139+0000 7f4175ffb640 1 -- 172.21.15.55:0/2648722269 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f417811e1b0 con 0x7f418015ef80 2023-08-25T05:37:28.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.139+0000 7f4185409640 1 --2- 172.21.15.55:0/2648722269 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f41640657a0 0x7f4164067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.139+0000 7f4185409640 1 --2- 172.21.15.55:0/2648722269 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f41640657a0 0x7f4164067c60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f417c009af0 tx=0x7f417c008040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:28.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.143+0000 7f4175ffb640 1 -- 172.21.15.55:0/2648722269 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f41780ebb70 con 0x7f418015ef80 2023-08-25T05:37:28.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.299+0000 7f418766d640 1 -- 172.21.15.55:0/2648722269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f418004dbe0 con 0x7f418015ef80 2023-08-25T05:37:28.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.299+0000 7f4175ffb640 1 -- 172.21.15.55:0/2648722269 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) v1 ==== 74+0+18309 (secure 0 0 0) 0x7f4178009510 con 0x7f418015ef80 2023-08-25T05:37:28.303 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:28.303 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":202,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:37:25.523184+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:37:21.649130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-08-25T05:37:22.924825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:37:28.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.303+0000 7f418766d640 1 -- 172.21.15.55:0/2648722269 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f41640657a0 msgr2=0x7f4164067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:28.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.303+0000 7f418766d640 1 --2- 172.21.15.55:0/2648722269 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f41640657a0 0x7f4164067c60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f417c009af0 tx=0x7f417c008040 comp rx=0 tx=0).stop 2023-08-25T05:37:28.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.303+0000 7f418766d640 1 -- 172.21.15.55:0/2648722269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f418015ef80 msgr2=0x7f4180070d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:28.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.303+0000 7f418766d640 1 --2- 172.21.15.55:0/2648722269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f418015ef80 0x7f4180070d90 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f417801ad90 tx=0x7f4178019480 comp rx=0 tx=0).stop 2023-08-25T05:37:28.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.303+0000 7f418766d640 1 -- 172.21.15.55:0/2648722269 shutdown_connections 2023-08-25T05:37:28.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.303+0000 7f418766d640 1 --2- 172.21.15.55:0/2648722269 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f41640657a0 0x7f4164067c60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.303+0000 7f418766d640 1 --2- 172.21.15.55:0/2648722269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f418015ef80 0x7f4180070d90 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.303+0000 7f418766d640 1 --2- 172.21.15.55:0/2648722269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f418015eba0 0x7f4180153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.303+0000 7f418766d640 1 --2- 172.21.15.55:0/2648722269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41800cece0 0x7f41800c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.303+0000 7f418766d640 1 -- 172.21.15.55:0/2648722269 >> 172.21.15.55:0/2648722269 conn(0x7f4180069d00 msgr2=0x7f418006f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:28.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.303+0000 7f418766d640 1 -- 172.21.15.55:0/2648722269 shutdown_connections 2023-08-25T05:37:28.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.303+0000 7f418766d640 1 -- 172.21.15.55:0/2648722269 wait complete. 2023-08-25T05:37:28.324 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-25T05:37:28.325 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:37:28.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.463+0000 7f2a34574640 1 Processor -- start 2023-08-25T05:37:28.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.467+0000 7f2a34574640 1 -- start start 2023-08-25T05:37:28.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.467+0000 7f2a34574640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2a2c0ad950 0x7f2a2c0cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.467+0000 7f2a34574640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a2c0c89f0 0x7f2a2c0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.467+0000 7f2a34574640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a2c06c000 0x7f2a2c0cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.467+0000 7f2a34574640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c0b11f0 con 0x7f2a2c0c89f0 2023-08-25T05:37:28.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.467+0000 7f2a34574640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c159d50 con 0x7f2a2c0ad950 2023-08-25T05:37:28.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.467+0000 7f2a34574640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c0cc880 con 0x7f2a2c06c000 2023-08-25T05:37:28.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.467+0000 7f2a31b0f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a2c0c89f0 0x7f2a2c0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.467+0000 7f2a31b0f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a2c0c89f0 0x7f2a2c0ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54250/0 (socket says 172.21.15.55:54250) 2023-08-25T05:37:28.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.467+0000 7f2a31b0f640 1 -- 172.21.15.55:0/2888781036 learned_addr learned my addr 172.21.15.55:0/2888781036 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:28.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.467+0000 7f2a32b11640 1 --2- 172.21.15.55:0/2888781036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a2c06c000 0x7f2a2c0cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.467+0000 7f2a32310640 1 --2- 172.21.15.55:0/2888781036 >> v2:172.21.15.110:3300/0 conn(0x7f2a2c0ad950 0x7f2a2c0cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.467+0000 7f2a31b0f640 1 -- 172.21.15.55:0/2888781036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a2c06c000 msgr2=0x7f2a2c0cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:28.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.467+0000 7f2a31b0f640 1 --2- 172.21.15.55:0/2888781036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a2c06c000 0x7f2a2c0cece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.467+0000 7f2a31b0f640 1 -- 172.21.15.55:0/2888781036 >> v2:172.21.15.110:3300/0 conn(0x7f2a2c0ad950 msgr2=0x7f2a2c0cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:28.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.467+0000 7f2a31b0f640 1 --2- 172.21.15.55:0/2888781036 >> v2:172.21.15.110:3300/0 conn(0x7f2a2c0ad950 0x7f2a2c0cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.467+0000 7f2a31b0f640 1 -- 172.21.15.55:0/2888781036 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c0ccb60 con 0x7f2a2c0c89f0 2023-08-25T05:37:28.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.471+0000 7f2a31b0f640 1 --2- 172.21.15.55:0/2888781036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a2c0c89f0 0x7f2a2c0ce7a0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0cd4b0 tx=0x7f2a1c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd825545b952ebf0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:28.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.471+0000 7f2a3130e640 1 -- 172.21.15.55:0/2888781036 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c0ac640 con 0x7f2a2c0c89f0 2023-08-25T05:37:28.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.471+0000 7f2a3130e640 1 -- 172.21.15.55:0/2888781036 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c0ac7a0 con 0x7f2a2c0c89f0 2023-08-25T05:37:28.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.471+0000 7f2a3130e640 1 -- 172.21.15.55:0/2888781036 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c0acb30 con 0x7f2a2c0c89f0 2023-08-25T05:37:28.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.471+0000 7f2a34574640 1 -- 172.21.15.55:0/2888781036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a2c0c89f0 msgr2=0x7f2a2c0ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:28.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.471+0000 7f2a34574640 1 --2- 172.21.15.55:0/2888781036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a2c0c89f0 0x7f2a2c0ce7a0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0cd4b0 tx=0x7f2a1c01c440 comp rx=0 tx=0).stop 2023-08-25T05:37:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.471+0000 7f2a34574640 1 -- 172.21.15.55:0/2888781036 shutdown_connections 2023-08-25T05:37:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.471+0000 7f2a34574640 1 --2- 172.21.15.55:0/2888781036 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a2c06c000 0x7f2a2c0cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.471+0000 7f2a34574640 1 --2- 172.21.15.55:0/2888781036 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a2c0c89f0 0x7f2a2c0ce7a0 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.471+0000 7f2a34574640 1 --2- 172.21.15.55:0/2888781036 >> v2:172.21.15.110:3300/0 conn(0x7f2a2c0ad950 0x7f2a2c0cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.471+0000 7f2a34574640 1 -- 172.21.15.55:0/2888781036 >> 172.21.15.55:0/2888781036 conn(0x7f2a2c069d00 msgr2=0x7f2a2c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.471+0000 7f2a34574640 1 -- 172.21.15.55:0/2888781036 shutdown_connections 2023-08-25T05:37:28.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.471+0000 7f2a34574640 1 -- 172.21.15.55:0/2888781036 wait complete. 2023-08-25T05:37:28.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.471+0000 7f2a34574640 1 Processor -- start 2023-08-25T05:37:28.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.471+0000 7f2a34574640 1 -- start start 2023-08-25T05:37:28.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a34574640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a2c06c000 0x7f2a2c0acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a34574640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a2c0ad950 0x7f2a2c0977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a34574640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a2c0c89f0 0x7f2a2c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a34574640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c154a00 con 0x7f2a2c0ad950 2023-08-25T05:37:28.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a34574640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c1554f0 con 0x7f2a2c0c89f0 2023-08-25T05:37:28.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a34574640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c154c50 con 0x7f2a2c06c000 2023-08-25T05:37:28.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a31b0f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a2c0ad950 0x7f2a2c0977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a31b0f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a2c0ad950 0x7f2a2c0977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54256/0 (socket says 172.21.15.55:54256) 2023-08-25T05:37:28.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a31b0f640 1 -- 172.21.15.55:0/1385507728 learned_addr learned my addr 172.21.15.55:0/1385507728 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:28.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a32310640 1 --2- 172.21.15.55:0/1385507728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a2c06c000 0x7f2a2c0acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a32b11640 1 --2- 172.21.15.55:0/1385507728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a2c0c89f0 0x7f2a2c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a31b0f640 1 -- 172.21.15.55:0/1385507728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a2c06c000 msgr2=0x7f2a2c0acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:28.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a31b0f640 1 --2- 172.21.15.55:0/1385507728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a2c06c000 0x7f2a2c0acbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a31b0f640 1 -- 172.21.15.55:0/1385507728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a2c0c89f0 msgr2=0x7f2a2c0709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:28.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a31b0f640 1 --2- 172.21.15.55:0/1385507728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a2c0c89f0 0x7f2a2c0709e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a31b0f640 1 -- 172.21.15.55:0/1385507728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c0094d0 con 0x7f2a2c0ad950 2023-08-25T05:37:28.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a32310640 1 --2- 172.21.15.55:0/1385507728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a2c06c000 0x7f2a2c0acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:28.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a32b11640 1 --2- 172.21.15.55:0/1385507728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a2c0c89f0 0x7f2a2c0709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:28.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a31b0f640 1 --2- 172.21.15.55:0/1385507728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a2c0ad950 0x7f2a2c0977f0 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c0af040 tx=0x7f2a1c0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:28.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a22ffd640 1 -- 172.21.15.55:0/1385507728 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c0b5660 con 0x7f2a2c0ad950 2023-08-25T05:37:28.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a22ffd640 1 -- 172.21.15.55:0/1385507728 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c0b57c0 con 0x7f2a2c0ad950 2023-08-25T05:37:28.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a22ffd640 1 -- 172.21.15.55:0/1385507728 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c0b5b70 con 0x7f2a2c0ad950 2023-08-25T05:37:28.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a34574640 1 -- 172.21.15.55:0/1385507728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c154f30 con 0x7f2a2c0ad950 2023-08-25T05:37:28.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a34574640 1 -- 172.21.15.55:0/1385507728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c156970 con 0x7f2a2c0ad950 2023-08-25T05:37:28.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.475+0000 7f2a34574640 1 -- 172.21.15.55:0/1385507728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c156b60 con 0x7f2a2c0ad950 2023-08-25T05:37:28.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.479+0000 7f2a22ffd640 1 -- 172.21.15.55:0/1385507728 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f2a1c0b3070 con 0x7f2a2c0ad950 2023-08-25T05:37:28.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.479+0000 7f2a22ffd640 1 --2- 172.21.15.55:0/1385507728 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f2a100657a0 0x7f2a10067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.479+0000 7f2a22ffd640 1 -- 172.21.15.55:0/1385507728 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2a1c11d020 con 0x7f2a2c0ad950 2023-08-25T05:37:28.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.479+0000 7f2a32310640 1 --2- 172.21.15.55:0/1385507728 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f2a100657a0 0x7f2a10067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.479+0000 7f2a32310640 1 --2- 172.21.15.55:0/1385507728 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f2a100657a0 0x7f2a10067c60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009ae0 tx=0x7f2a28008040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:28.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.483+0000 7f2a22ffd640 1 -- 172.21.15.55:0/1385507728 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2a1c0eaa60 con 0x7f2a2c0ad950 2023-08-25T05:37:28.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.635+0000 7f2a34574640 1 -- 172.21.15.55:0/1385507728 --> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a2c0b3130 con 0x7f2a100657a0 2023-08-25T05:37:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.647+0000 7f2a22ffd640 1 -- 172.21.15.55:0/1385507728 <== mgr.8987 v2:172.21.15.110:6832/3630541271 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299601 (secure 0 0 0) 0x7f2a28010930 con 0x7f2a100657a0 2023-08-25T05:37:28.653 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:28.654 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:37:28.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.651+0000 7f2a34574640 1 -- 172.21.15.55:0/1385507728 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f2a100657a0 msgr2=0x7f2a10067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:28.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.651+0000 7f2a34574640 1 --2- 172.21.15.55:0/1385507728 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f2a100657a0 0x7f2a10067c60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009ae0 tx=0x7f2a28008040 comp rx=0 tx=0).stop 2023-08-25T05:37:28.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.651+0000 7f2a34574640 1 -- 172.21.15.55:0/1385507728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a2c0ad950 msgr2=0x7f2a2c0977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:28.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.651+0000 7f2a34574640 1 --2- 172.21.15.55:0/1385507728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a2c0ad950 0x7f2a2c0977f0 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c0af040 tx=0x7f2a1c0191e0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.651+0000 7f2a34574640 1 -- 172.21.15.55:0/1385507728 shutdown_connections 2023-08-25T05:37:28.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.651+0000 7f2a34574640 1 --2- 172.21.15.55:0/1385507728 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f2a100657a0 0x7f2a10067c60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.651+0000 7f2a34574640 1 --2- 172.21.15.55:0/1385507728 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a2c0c89f0 0x7f2a2c0709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.651+0000 7f2a34574640 1 --2- 172.21.15.55:0/1385507728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a2c0ad950 0x7f2a2c0977f0 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.651+0000 7f2a34574640 1 --2- 172.21.15.55:0/1385507728 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a2c06c000 0x7f2a2c0acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.651+0000 7f2a34574640 1 -- 172.21.15.55:0/1385507728 >> 172.21.15.55:0/1385507728 conn(0x7f2a2c069d00 msgr2=0x7f2a2c162c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:28.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.651+0000 7f2a34574640 1 -- 172.21.15.55:0/1385507728 shutdown_connections 2023-08-25T05:37:28.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.651+0000 7f2a34574640 1 -- 172.21.15.55:0/1385507728 wait complete. 2023-08-25T05:37:28.673 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-25T05:37:27.184079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2096,"num_read_kb":4403,"num_write":565,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3653,"ondisk_log_size":3653,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":419912,"kb_used_data":20584,"kb_used_omap":13,"kb_used_meta":399218,"kb_avail":754554808,"statfs":{"total":773094113280,"available":772664123392,"internally_reserved":0,"allocated":21078016,"data_stored":11278984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":408799320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.671311"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.521027+0000","last_change":"2023-08-25T05:37:22.521027+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.521027+0000","last_undegraded":"2023-08-25T05:37:22.521027+0000","last_fullsized":"2023-08-25T05:37:22.521027+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.521357+0000","last_change":"2023-08-25T05:37:22.521357+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.521357+0000","last_undegraded":"2023-08-25T05:37:22.521357+0000","last_fullsized":"2023-08-25T05:37:22.521357+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.519182+0000","last_change":"2023-08-25T05:37:22.519182+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.519182+0000","last_undegraded":"2023-08-25T05:37:22.519182+0000","last_fullsized":"2023-08-25T05:37:22.519182+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.514998+0000","last_change":"2023-08-25T05:37:22.514998+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.514998+0000","last_undegraded":"2023-08-25T05:37:22.514998+0000","last_fullsized":"2023-08-25T05:37:22.514998+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.515737+0000","last_change":"2023-08-25T05:37:22.515737+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.515737+0000","last_undegraded":"2023-08-25T05:37:22.515737+0000","last_fullsized":"2023-08-25T05:37:22.515737+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.520828+0000","last_change":"2023-08-25T05:37:22.520828+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.520828+0000","last_undegraded":"2023-08-25T05:37:22.520828+0000","last_fullsized":"2023-08-25T05:37:22.520828+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.519171+0000","last_change":"2023-08-25T05:37:22.519171+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.519171+0000","last_undegraded":"2023-08-25T05:37:22.519171+0000","last_fullsized":"2023-08-25T05:37:22.519171+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.518353+0000","last_change":"2023-08-25T05:37:22.518353+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.518353+0000","last_undegraded":"2023-08-25T05:37:22.518353+0000","last_fullsized":"2023-08-25T05:37:22.518353+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.518371+0000","last_change":"2023-08-25T05:37:22.518371+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.518371+0000","last_undegraded":"2023-08-25T05:37:22.518371+0000","last_fullsized":"2023-08-25T05:37:22.518371+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.519268+0000","last_change":"2023-08-25T05:37:22.519268+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.519268+0000","last_undegraded":"2023-08-25T05:37:22.519268+0000","last_fullsized":"2023-08-25T05:37:22.519268+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.516067+0000","last_change":"2023-08-25T05:37:22.516067+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.516067+0000","last_undegraded":"2023-08-25T05:37:22.516067+0000","last_fullsized":"2023-08-25T05:37:22.516067+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.518342+0000","last_change":"2023-08-25T05:37:22.518342+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.518342+0000","last_undegraded":"2023-08-25T05:37:22.518342+0000","last_fullsized":"2023-08-25T05:37:22.518342+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.515217+0000","last_change":"2023-08-25T05:37:22.515217+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.515217+0000","last_undegraded":"2023-08-25T05:37:22.515217+0000","last_fullsized":"2023-08-25T05:37:22.515217+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.519157+0000","last_change":"2023-08-25T05:37:22.519157+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.519157+0000","last_undegraded":"2023-08-25T05:37:22.519157+0000","last_fullsized":"2023-08-25T05:37:22.519157+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.517204+0000","last_change":"2023-08-25T05:37:22.517204+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.517204+0000","last_undegraded":"2023-08-25T05:37:22.517204+0000","last_fullsized":"2023-08-25T05:37:22.517204+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.515978+0000","last_change":"2023-08-25T05:37:22.515978+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.515978+0000","last_undegraded":"2023-08-25T05:37:22.515978+0000","last_fullsized":"2023-08-25T05:37:22.515978+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.519275+0000","last_change":"2023-08-25T05:37:22.519275+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.519275+0000","last_undegraded":"2023-08-25T05:37:22.519275+0000","last_fullsized":"2023-08-25T05:37:22.519275+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.515996+0000","last_change":"2023-08-25T05:37:22.515996+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.515996+0000","last_undegraded":"2023-08-25T05:37:22.515996+0000","last_fullsized":"2023-08-25T05:37:22.515996+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.520730+0000","last_change":"2023-08-25T05:37:22.520730+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.520730+0000","last_undegraded":"2023-08-25T05:37:22.520730+0000","last_fullsized":"2023-08-25T05:37:22.520730+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.520830+0000","last_change":"2023-08-25T05:37:22.520830+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.520830+0000","last_undegraded":"2023-08-25T05:37:22.520830+0000","last_fullsized":"2023-08-25T05:37:22.520830+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.518209+0000","last_change":"2023-08-25T05:37:22.518209+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.518209+0000","last_undegraded":"2023-08-25T05:37:22.518209+0000","last_fullsized":"2023-08-25T05:37:22.518209+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.518775+0000","last_change":"2023-08-25T05:37:22.518775+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.518775+0000","last_undegraded":"2023-08-25T05:37:22.518775+0000","last_fullsized":"2023-08-25T05:37:22.518775+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.515977+0000","last_change":"2023-08-25T05:37:22.515977+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.515977+0000","last_undegraded":"2023-08-25T05:37:22.515977+0000","last_fullsized":"2023-08-25T05:37:22.515977+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.515396+0000","last_change":"2023-08-25T05:37:22.515396+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.515396+0000","last_undegraded":"2023-08-25T05:37:22.515396+0000","last_fullsized":"2023-08-25T05:37:22.515396+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.519096+0000","last_change":"2023-08-25T05:37:22.519096+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.519096+0000","last_undegraded":"2023-08-25T05:37:22.519096+0000","last_fullsized":"2023-08-25T05:37:22.519096+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"191'3653","reported_seq":4640,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-08-25T05:37:22.518236+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:37:22.518236+0000","last_peered":"2023-08-25T05:37:22.518236+0000","last_clean":"2023-08-25T05:37:22.518236+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:37:22.518236+0000","last_undegraded":"2023-08-25T05:37:22.518236+0000","last_fullsized":"2023-08-25T05:37:22.518236+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3653,"log_dups_size":0,"ondisk_log_size":3653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:21:52.960595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2096,"num_read_kb":4403,"num_write":565,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":354,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-08-25T05:37:22.519544+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:37:22.519544+0000","last_peered":"2023-08-25T05:37:22.519544+0000","last_clean":"2023-08-25T05:37:22.519544+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:37:22.519544+0000","last_undegraded":"2023-08-25T05:37:22.519544+0000","last_fullsized":"2023-08-25T05:37:22.519544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:33:18.931212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.520096+0000","last_change":"2023-08-25T05:37:22.520096+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.520096+0000","last_undegraded":"2023-08-25T05:37:22.520096+0000","last_fullsized":"2023-08-25T05:37:22.520096+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":345,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-08-25T05:37:22.518101+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:37:22.518101+0000","last_peered":"2023-08-25T05:37:22.518101+0000","last_clean":"2023-08-25T05:37:22.518101+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:37:22.518101+0000","last_undegraded":"2023-08-25T05:37:22.518101+0000","last_fullsized":"2023-08-25T05:37:22.518101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:27:25.958313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.519719+0000","last_change":"2023-08-25T05:37:22.519719+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.519719+0000","last_undegraded":"2023-08-25T05:37:22.519719+0000","last_fullsized":"2023-08-25T05:37:22.519719+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":354,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-08-25T05:37:22.514651+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:37:22.514651+0000","last_peered":"2023-08-25T05:37:22.514651+0000","last_clean":"2023-08-25T05:37:22.514651+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:37:22.514651+0000","last_undegraded":"2023-08-25T05:37:22.514651+0000","last_fullsized":"2023-08-25T05:37:22.514651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:12:39.121338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.514984+0000","last_change":"2023-08-25T05:37:22.514984+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.514984+0000","last_undegraded":"2023-08-25T05:37:22.514984+0000","last_fullsized":"2023-08-25T05:37:22.514984+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":354,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-08-25T05:37:22.519474+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:37:22.519474+0000","last_peered":"2023-08-25T05:37:22.519474+0000","last_clean":"2023-08-25T05:37:22.519474+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:37:22.519474+0000","last_undegraded":"2023-08-25T05:37:22.519474+0000","last_fullsized":"2023-08-25T05:37:22.519474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:08:44.940489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.522564+0000","last_change":"2023-08-25T05:37:22.522564+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.522564+0000","last_undegraded":"2023-08-25T05:37:22.522564+0000","last_fullsized":"2023-08-25T05:37:22.522564+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":384,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-08-25T05:37:22.520085+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:37:22.520085+0000","last_peered":"2023-08-25T05:37:22.520085+0000","last_clean":"2023-08-25T05:37:22.520085+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:37:22.520085+0000","last_undegraded":"2023-08-25T05:37:22.520085+0000","last_fullsized":"2023-08-25T05:37:22.520085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:24:31.770546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.520103+0000","last_change":"2023-08-25T05:37:22.520103+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.520103+0000","last_undegraded":"2023-08-25T05:37:22.520103+0000","last_fullsized":"2023-08-25T05:37:22.520103+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":344,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-08-25T05:37:22.517891+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:37:22.517891+0000","last_peered":"2023-08-25T05:37:22.517891+0000","last_clean":"2023-08-25T05:37:22.517891+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:37:22.517891+0000","last_undegraded":"2023-08-25T05:37:22.517891+0000","last_fullsized":"2023-08-25T05:37:22.517891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:16:54.648165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.518697+0000","last_change":"2023-08-25T05:37:22.518697+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.518697+0000","last_undegraded":"2023-08-25T05:37:22.518697+0000","last_fullsized":"2023-08-25T05:37:22.518697+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":382,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-08-25T05:37:22.521779+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:37:22.521779+0000","last_peered":"2023-08-25T05:37:22.521779+0000","last_clean":"2023-08-25T05:37:22.521779+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:37:22.521779+0000","last_undegraded":"2023-08-25T05:37:22.521779+0000","last_fullsized":"2023-08-25T05:37:22.521779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:20.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.515723+0000","last_change":"2023-08-25T05:37:22.515723+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.515723+0000","last_undegraded":"2023-08-25T05:37:22.515723+0000","last_fullsized":"2023-08-25T05:37:22.515723+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":406,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-08-25T05:37:22.514944+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:37:22.514944+0000","last_peered":"2023-08-25T05:37:22.514944+0000","last_clean":"2023-08-25T05:37:22.514944+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:37:22.514944+0000","last_undegraded":"2023-08-25T05:37:22.514944+0000","last_fullsized":"2023-08-25T05:37:22.514944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:45:07.188170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2096,"num_read_kb":4403,"num_write":565,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3653,"ondisk_log_size":3653,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510568,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52236,"kb_used_data":3008,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319604,"statfs":{"total":96636764160,"available":96583274496,"internally_reserved":0,"allocated":3080192,"data_stored":1852649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.40999999999999998},"max":{"1min":0.94599999999999995,"5min":0.95499999999999996,"15min":1.0169999999999999},"last":0.75},{"interface":"front","average":{"1min":0.752,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.441},"max":{"1min":0.90700000000000003,"5min":1.016,"15min":1.0189999999999999},"last":0.83199999999999996}]},{"osd":1,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93799999999999994,"5min":0.99199999999999999,"15min":1.054},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.749,"15min":0.77300000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.77500000000000002}]},{"osd":2,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.753},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77300000000000002,"15min":0.76800000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.53600000000000003},"max":{"1min":1.0129999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.86099999999999999}]},{"osd":3,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76700000000000002,"15min":0.77000000000000002},"min":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94499999999999995,"5min":1.006,"15min":1.006},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98299999999999998,"5min":1.0600000000000001,"15min":1.0680000000000001},"last":0.81000000000000005}]},{"osd":4,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.44},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0449999999999999,"5min":1.163,"15min":1.163},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.36599999999999999},"max":{"1min":0.97199999999999998,"5min":0.997,"15min":1.1120000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.501,"5min":0.44,"15min":0.42699999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.623}]},{"osd":6,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.74399999999999999,"15min":0.73099999999999998},"min":{"1min":0.50900000000000001,"5min":0.499,"15min":0.47999999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.71499999999999997,"15min":0.69999999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0900000000000001,"5min":1.119,"15min":1.119},"last":0.70099999999999996}]}]},{"osd":6,"up_from":15,"seq":64424510568,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33608,"kb_used_data":2428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338232,"statfs":{"total":96636764160,"available":96602349568,"internally_reserved":0,"allocated":2486272,"data_stored":1262281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73899999999999999,"15min":0.745},"min":{"1min":0.45600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.876,"5min":0.99099999999999999,"15min":1.0449999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.50800000000000001,"5min":0.40100000000000002,"15min":0.40000000000000002},"max":{"1min":0.88600000000000001,"5min":1.0389999999999999,"15min":1.1699999999999999},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.76300000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.1559999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.48899999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1299999999999999},"last":0.77600000000000002}]},{"osd":2,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76100000000000001,"15min":0.78700000000000003},"min":{"1min":0.55000000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98099999999999998,"5min":1.0760000000000001,"15min":1.0780000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.81699999999999995,"15min":0.82499999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96799999999999997,"5min":1.0669999999999999,"15min":1.1599999999999999},"last":0.753}]},{"osd":3,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.497,"5min":0.47999999999999998,"15min":0.46400000000000002},"max":{"1min":1.002,"5min":1.0049999999999999,"15min":1.208},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.58699999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0149999999999999,"5min":1.054,"15min":1.236},"last":0.85299999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.45300000000000001,"5min":0.38400000000000001,"15min":0.33200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.018},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.42799999999999999,"5min":0.40699999999999997,"15min":0.35499999999999998},"max":{"1min":0.83999999999999997,"5min":0.85799999999999998,"15min":1.016},"last":0.89700000000000002}]},{"osd":5,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64900000000000002,"15min":0.65200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.44},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.1319999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.73499999999999999},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.1659999999999999},"last":0.91900000000000004}]},{"osd":7,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.39700000000000002},"max":{"1min":0.78000000000000003,"5min":0.97199999999999998,"15min":1.044},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68700000000000006,"15min":0.69699999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.42899999999999999},"max":{"1min":0.96399999999999997,"5min":1.228,"15min":1.228},"last":0.872}]}]},{"osd":5,"up_from":14,"seq":60129543271,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59976,"kb_used_data":2428,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311864,"statfs":{"total":96636764160,"available":96575348736,"internally_reserved":0,"allocated":2486272,"data_stored":1262281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75700000000000001,"15min":0.754},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.97499999999999998,"5min":0.98199999999999998,"15min":1.034},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94599999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78200000000000003}]},{"osd":1,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96099999999999997,"5min":1.073,"15min":1.073},"last":0.62},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77400000000000002,"15min":0.77600000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.99199999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81999999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95699999999999996,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47999999999999998},"max":{"1min":1.018,"5min":1.208,"15min":1.208},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77000000000000002,"15min":0.76700000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96199999999999997,"5min":1.155,"15min":1.155},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79900000000000004,"15min":0.79500000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0089999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.76700000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64400000000000002,"15min":0.60599999999999998},"min":{"1min":0.41799999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.86399999999999999,"5min":1.681,"15min":1.681},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.63400000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.42499999999999999},"max":{"1min":0.89200000000000002,"5min":1.381,"15min":1.381},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69999999999999996,"15min":0.67000000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.42199999999999999},"max":{"1min":0.92200000000000004,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68700000000000006,"15min":0.68200000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.44900000000000001},"max":{"1min":0.86799999999999999,"5min":1.276,"15min":1.276},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68200000000000005,"15min":0.66100000000000003},"min":{"1min":0.46500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.874,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77400000000000002,"15min":0.74099999999999999},"min":{"1min":0.53300000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96799999999999997,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.91300000000000003}]}]},{"osd":4,"up_from":14,"seq":60129543271,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47496,"kb_used_data":2428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324344,"statfs":{"total":96636764160,"available":96588128256,"internally_reserved":0,"allocated":2486272,"data_stored":1262281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.054},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96499999999999997,"5min":0.97799999999999998,"15min":1.02},"last":0.627}]},{"osd":1,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.77300000000000002},"min":{"1min":0.48199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0449999999999999,"5min":1.05,"15min":1.05},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.505},"max":{"1min":0.97999999999999998,"5min":1.022,"15min":1.103},"last":0.65900000000000003}]},{"osd":2,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.51800000000000002},"max":{"1min":0.95699999999999996,"5min":0.995,"15min":1.0780000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.76100000000000001,"15min":0.77200000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.47999999999999998},"max":{"1min":1.0649999999999999,"5min":1.069,"15min":1.069},"last":0.57099999999999995}]},{"osd":3,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76500000000000001,"15min":0.78800000000000003},"min":{"1min":0.55800000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.995,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95599999999999996,"5min":1.101,"15min":1.101},"last":0.52900000000000003}]},{"osd":5,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81200000000000006,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.46899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93700000000000006,"5min":0.96799999999999997,"15min":0.98299999999999998},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.755,"15min":0.75},"min":{"1min":0.58399999999999996,"5min":0.49399999999999999,"15min":0.49199999999999999},"max":{"1min":1.0029999999999999,"5min":1.008,"15min":1.1240000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.66700000000000004,"15min":0.65800000000000003},"min":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.0629999999999999},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91000000000000003,"5min":0.996,"15min":0.996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.53200000000000003,"5min":0.496,"15min":0.47599999999999998},"max":{"1min":0.96699999999999997,"5min":1.0389999999999999,"15min":1.0860000000000001},"last":0.752}]}]},{"osd":3,"up_from":14,"seq":60129543271,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64136,"kb_used_data":2428,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307704,"statfs":{"total":96636764160,"available":96571088896,"internally_reserved":0,"allocated":2486272,"data_stored":1262281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":63174923},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.33400000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.35499999999999998,"15min":0.34000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.92900000000000005},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52300000000000002,"15min":0.52800000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.0780000000000001},"last":0.44},{"interface":"front","average":{"1min":0.628,"5min":0.61299999999999999,"15min":0.629},"min":{"1min":0.44400000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":0.97999999999999998},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.50600000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81100000000000005,"5min":1.0089999999999999,"15min":1.038},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.44800000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71999999999999997,"5min":0.79000000000000004,"15min":0.95799999999999996},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.52300000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.046,"5min":1.26,"15min":1.26},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.83899999999999997,"15min":0.83199999999999996},"min":{"1min":0.58099999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.125,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.86299999999999999}]},{"osd":5,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.65300000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.026,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82299999999999995,"15min":0.82999999999999996},"min":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.1419999999999999},"last":0.745}]},{"osd":6,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85799999999999998,"15min":0.86699999999999999},"min":{"1min":0.60999999999999999,"5min":0.59499999999999997,"15min":0.59399999999999997},"max":{"1min":1.1160000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.65200000000000002,"5min":0.58399999999999996,"15min":0.48999999999999999},"max":{"1min":1.0469999999999999,"5min":1.133,"15min":1.194},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.86699999999999999,"15min":0.879},"min":{"1min":0.63100000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.169,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.83299999999999996,"15min":0.83599999999999997},"min":{"1min":0.625,"5min":0.52900000000000003,"15min":0.51800000000000002},"max":{"1min":1.0669999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.879}]}]},{"osd":2,"up_from":14,"seq":60129543272,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59976,"kb_used_data":2428,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311864,"statfs":{"total":96636764160,"available":96575348736,"internally_reserved":0,"allocated":2486272,"data_stored":1262281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.46000000000000002,"15min":0.47699999999999998},"min":{"1min":0.33400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.378},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.35499999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71699999999999997,"5min":0.85099999999999998,"15min":0.86099999999999999},"last":0.44}]},{"osd":1,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66200000000000003,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83099999999999996,"5min":0.88800000000000001,"15min":0.89700000000000002},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.41099999999999998,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.78000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.505}]},{"osd":4,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.63200000000000001,"5min":0.56399999999999995,"15min":0.48699999999999999},"max":{"1min":1.0720000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80400000000000005,"15min":0.81100000000000005},"min":{"1min":0.66200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.1619999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.75}]},{"osd":5,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.60899999999999999,"5min":0.53200000000000003,"15min":0.51700000000000002},"max":{"1min":1.0089999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.84699999999999998},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.246,"5min":1.266,"15min":1.266},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.103,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.875,"15min":0.88},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.58899999999999997},"max":{"1min":1.204,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.84799999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.82599999999999996,"15min":0.83799999999999997},"min":{"1min":0.69299999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1040000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.82699999999999996,"15min":0.83199999999999996},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1870000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.72199999999999998}]}]},{"osd":1,"up_from":14,"seq":60129543272,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41928,"kb_used_data":2428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329912,"statfs":{"total":96636764160,"available":96593829888,"internally_reserved":0,"allocated":2486272,"data_stored":1262281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.47699999999999998},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.70299999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.34100000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.71099999999999997,"5min":0.73799999999999999,"15min":0.879},"last":0.41999999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.81399999999999995},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66600000000000004,"5min":0.82899999999999996,"15min":0.91400000000000003},"last":0.628}]},{"osd":3,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73199999999999998,"5min":0.998,"15min":0.998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.376,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73299999999999998,"5min":0.88700000000000001,"15min":0.98699999999999999},"last":0.45000000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91000000000000003,"5min":1.1559999999999999,"15min":1.2350000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82999999999999996,"15min":0.83699999999999997},"min":{"1min":0.69099999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98699999999999999,"5min":1.268,"15min":1.268},"last":0.71299999999999997}]},{"osd":5,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.80900000000000005},"min":{"1min":0.624,"5min":0.54800000000000004,"15min":0.47699999999999998},"max":{"1min":0.89800000000000002,"5min":1.109,"15min":1.1950000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.66200000000000003,"5min":0.61899999999999999,"15min":0.55300000000000005},"max":{"1min":0.97899999999999998,"5min":1.214,"15min":1.214},"last":0.64900000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.66100000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.94499999999999995,"5min":1.212,"15min":1.244},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.81899999999999995,"15min":0.83699999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.94699999999999995,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81200000000000006,"15min":0.83699999999999997},"min":{"1min":0.61699999999999999,"5min":0.60899999999999999,"15min":0.55600000000000005},"max":{"1min":1.0069999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.751},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.626},"max":{"1min":0.96799999999999997,"5min":1.127,"15min":1.2110000000000001},"last":0.85399999999999998}]}]},{"osd":0,"up_from":14,"seq":60129543271,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60556,"kb_used_data":3008,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311284,"statfs":{"total":96636764160,"available":96574754816,"internally_reserved":0,"allocated":3080192,"data_stored":1852649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48999999999999999,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.308,"15min":0.30599999999999999},"max":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":1.2170000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.81599999999999995,"15min":0.85999999999999999},"last":0.58799999999999997}]},{"osd":2,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36399999999999999,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":0.81399999999999995,"15min":0.91000000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55000000000000004,"15min":0.56100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71499999999999997,"5min":0.755,"15min":0.86799999999999999},"last":0.48699999999999999}]},{"osd":3,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.754,"15min":1.855},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.75900000000000001,"5min":0.90000000000000002,"15min":1.3480000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.57599999999999996,"5min":0.495,"15min":0.495},"max":{"1min":1.0600000000000001,"5min":1.258,"15min":1.3799999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81699999999999995,"15min":0.83199999999999996},"min":{"1min":0.627,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0529999999999999,"5min":1.2809999999999999,"15min":1.2849999999999999},"last":1.208}]},{"osd":5,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.58999999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.004,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.167},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82499999999999996,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0620000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.0660000000000001}]},{"osd":6,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82199999999999995,"15min":0.83599999999999997},"min":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0429999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.097},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86499999999999999,"15min":0.85999999999999999},"min":{"1min":0.51600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.0880000000000001,"5min":1.3560000000000001,"15min":1.5129999999999999},"last":1.3460000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85799999999999998,"15min":0.876},"min":{"1min":0.64600000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0760000000000001,"5min":1.4339999999999999,"15min":1.5720000000000001},"last":1.2609999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58099999999999996},"max":{"1min":1.0620000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.329}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:37:28.679 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:37:28.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.855+0000 7f52d9c93640 1 Processor -- start 2023-08-25T05:37:28.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.855+0000 7f52d9c93640 1 -- start start 2023-08-25T05:37:28.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.855+0000 7f52d9c93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52d4158e10 0x7f52d40b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.855+0000 7f52d9c93640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52d40cb2a0 0x7f52d40c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.855+0000 7f52d9c93640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d40cdbf0 con 0x7f52d4159f10 2023-08-25T05:37:28.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.855+0000 7f52d9c93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d40ad940 con 0x7f52d4158e10 2023-08-25T05:37:28.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.855+0000 7f52d9c93640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d415a3c0 con 0x7f52d40cb2a0 2023-08-25T05:37:28.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.855+0000 7f52d37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52d4158e10 0x7f52d40b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.855+0000 7f52d37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52d4158e10 0x7f52d40b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54272/0 (socket says 172.21.15.55:54272) 2023-08-25T05:37:28.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.855+0000 7f52d37fe640 1 -- 172.21.15.55:0/3004018271 learned_addr learned my addr 172.21.15.55:0/3004018271 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:28.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.855+0000 7f52d3fff640 1 --2- 172.21.15.55:0/3004018271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52d40cb2a0 0x7f52d40c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.855+0000 7f52d37fe640 1 -- 172.21.15.55:0/3004018271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52d40cb2a0 msgr2=0x7f52d40c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:28.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.855+0000 7f52d37fe640 1 --2- 172.21.15.55:0/3004018271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52d40cb2a0 0x7f52d40c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.855+0000 7f52d37fe640 1 -- 172.21.15.55:0/3004018271 >> v1:172.21.15.110:6789/0 conn(0x7f52d4159f10 legacy=0x7f52d40cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:28.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.855+0000 7f52d37fe640 1 -- 172.21.15.55:0/3004018271 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d406d380 con 0x7f52d4158e10 2023-08-25T05:37:28.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.855+0000 7f52d3fff640 1 --2- 172.21.15.55:0/3004018271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52d40cb2a0 0x7f52d40c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:28.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.859+0000 7f52d37fe640 1 --2- 172.21.15.55:0/3004018271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52d4158e10 0x7f52d40b2d30 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009870 tx=0x7f52c401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04bd523c3ffca6f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:28.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.859+0000 7f52d2ffd640 1 -- 172.21.15.55:0/3004018271 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c40ab640 con 0x7f52d4158e10 2023-08-25T05:37:28.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.859+0000 7f52d2ffd640 1 -- 172.21.15.55:0/3004018271 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c40a7070 con 0x7f52d4158e10 2023-08-25T05:37:28.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.859+0000 7f52d2ffd640 1 -- 172.21.15.55:0/3004018271 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c40ab9c0 con 0x7f52d4158e10 2023-08-25T05:37:28.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.859+0000 7f52d9c93640 1 -- 172.21.15.55:0/3004018271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52d4158e10 msgr2=0x7f52d40b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:28.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.859+0000 7f52d9c93640 1 --2- 172.21.15.55:0/3004018271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52d4158e10 0x7f52d40b2d30 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009870 tx=0x7f52c401c500 comp rx=0 tx=0).stop 2023-08-25T05:37:28.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.859+0000 7f52d9c93640 1 -- 172.21.15.55:0/3004018271 shutdown_connections 2023-08-25T05:37:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.859+0000 7f52d9c93640 1 --2- 172.21.15.55:0/3004018271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52d40cb2a0 0x7f52d40c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.859+0000 7f52d9c93640 1 --2- 172.21.15.55:0/3004018271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52d4158e10 0x7f52d40b2d30 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.859+0000 7f52d9c93640 1 -- 172.21.15.55:0/3004018271 >> 172.21.15.55:0/3004018271 conn(0x7f52d4069d00 msgr2=0x7f52d406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.859+0000 7f52d9c93640 1 -- 172.21.15.55:0/3004018271 shutdown_connections 2023-08-25T05:37:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.859+0000 7f52d9c93640 1 -- 172.21.15.55:0/3004018271 wait complete. 2023-08-25T05:37:28.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d9c93640 1 Processor -- start 2023-08-25T05:37:28.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d9c93640 1 -- start start 2023-08-25T05:37:28.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d9c93640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52d40cb2a0 0x7f52d40cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d9c93640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52d4158e10 0x7f52d40ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d9c93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52d4159f10 0x7f52d40acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d9c93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d40cc340 con 0x7f52d4159f10 2023-08-25T05:37:28.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d9c93640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d414a480 con 0x7f52d40cb2a0 2023-08-25T05:37:28.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d9c93640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d40cc5b0 con 0x7f52d4158e10 2023-08-25T05:37:28.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52d4159f10 0x7f52d40acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52d4159f10 0x7f52d40acc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54284/0 (socket says 172.21.15.55:54284) 2023-08-25T05:37:28.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d3fff640 1 -- 172.21.15.55:0/964298521 learned_addr learned my addr 172.21.15.55:0/964298521 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:28.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52cbfff640 1 --2- 172.21.15.55:0/964298521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52d4158e10 0x7f52d40ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d37fe640 1 --2- 172.21.15.55:0/964298521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52d40cb2a0 0x7f52d40cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d3fff640 1 -- 172.21.15.55:0/964298521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52d4158e10 msgr2=0x7f52d40ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:28.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d3fff640 1 --2- 172.21.15.55:0/964298521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52d4158e10 0x7f52d40ac6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d3fff640 1 -- 172.21.15.55:0/964298521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52d40cb2a0 msgr2=0x7f52d40cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:28.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d3fff640 1 --2- 172.21.15.55:0/964298521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52d40cb2a0 0x7f52d40cd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:28.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d3fff640 1 -- 172.21.15.55:0/964298521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c40094d0 con 0x7f52d4159f10 2023-08-25T05:37:28.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d37fe640 1 --2- 172.21.15.55:0/964298521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52d40cb2a0 0x7f52d40cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:28.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d3fff640 1 --2- 172.21.15.55:0/964298521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52d4159f10 0x7f52d40acc10 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00cd80 tx=0x7f52cc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:28.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d0ff9640 1 -- 172.21.15.55:0/964298521 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00f680 con 0x7f52d4159f10 2023-08-25T05:37:28.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d0ff9640 1 -- 172.21.15.55:0/964298521 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc00f800 con 0x7f52d4159f10 2023-08-25T05:37:28.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d0ff9640 1 -- 172.21.15.55:0/964298521 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00fbb0 con 0x7f52d4159f10 2023-08-25T05:37:28.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d9c93640 1 -- 172.21.15.55:0/964298521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d4159370 con 0x7f52d4159f10 2023-08-25T05:37:28.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.863+0000 7f52d9c93640 1 -- 172.21.15.55:0/964298521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d40ccb70 con 0x7f52d4159f10 2023-08-25T05:37:28.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.867+0000 7f52d9c93640 1 -- 172.21.15.55:0/964298521 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d40ccd90 con 0x7f52d4159f10 2023-08-25T05:37:28.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.867+0000 7f52d0ff9640 1 -- 172.21.15.55:0/964298521 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f52cc00b040 con 0x7f52d4159f10 2023-08-25T05:37:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.867+0000 7f52d0ff9640 1 --2- 172.21.15.55:0/964298521 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f52b40657a0 0x7f52b4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.867+0000 7f52d0ff9640 1 -- 172.21.15.55:0/964298521 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f52cc083a90 con 0x7f52d4159f10 2023-08-25T05:37:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.867+0000 7f52d37fe640 1 --2- 172.21.15.55:0/964298521 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f52b40657a0 0x7f52b4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.867+0000 7f52d37fe640 1 --2- 172.21.15.55:0/964298521 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f52b40657a0 0x7f52b4067c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f52c40af000 tx=0x7f52c40a7000 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:28.871+0000 7f52d0ff9640 1 -- 172.21.15.55:0/964298521 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f52cc051330 con 0x7f52d4159f10 2023-08-25T05:37:29.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.027+0000 7f52d9c93640 1 -- 172.21.15.55:0/964298521 --> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52d41591f0 con 0x7f52b40657a0 2023-08-25T05:37:29.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.035+0000 7f52d0ff9640 1 -- 172.21.15.55:0/964298521 <== mgr.8987 v2:172.21.15.110:6832/3630541271 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+299601 (secure 0 0 0) 0x7f52c40ab4c0 con 0x7f52b40657a0 2023-08-25T05:37:29.038 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:29.039 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:37:29.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.039+0000 7f52d9c93640 1 -- 172.21.15.55:0/964298521 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f52b40657a0 msgr2=0x7f52b4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:29.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.039+0000 7f52d9c93640 1 --2- 172.21.15.55:0/964298521 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f52b40657a0 0x7f52b4067c60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f52c40af000 tx=0x7f52c40a7000 comp rx=0 tx=0).stop 2023-08-25T05:37:29.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.039+0000 7f52d9c93640 1 -- 172.21.15.55:0/964298521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52d4159f10 msgr2=0x7f52d40acc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:29.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.039+0000 7f52d9c93640 1 --2- 172.21.15.55:0/964298521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52d4159f10 0x7f52d40acc10 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00cd80 tx=0x7f52cc00a650 comp rx=0 tx=0).stop 2023-08-25T05:37:29.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.039+0000 7f52d9c93640 1 -- 172.21.15.55:0/964298521 shutdown_connections 2023-08-25T05:37:29.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.039+0000 7f52d9c93640 1 --2- 172.21.15.55:0/964298521 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f52b40657a0 0x7f52b4067c60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.039+0000 7f52d9c93640 1 --2- 172.21.15.55:0/964298521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52d4159f10 0x7f52d40acc10 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.039+0000 7f52d9c93640 1 --2- 172.21.15.55:0/964298521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f52d4158e10 0x7f52d40ac6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.039+0000 7f52d9c93640 1 --2- 172.21.15.55:0/964298521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f52d40cb2a0 0x7f52d40cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.039+0000 7f52d9c93640 1 -- 172.21.15.55:0/964298521 >> 172.21.15.55:0/964298521 conn(0x7f52d4069d00 msgr2=0x7f52d40c89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:29.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.039+0000 7f52d9c93640 1 -- 172.21.15.55:0/964298521 shutdown_connections 2023-08-25T05:37:29.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.039+0000 7f52d9c93640 1 -- 172.21.15.55:0/964298521 wait complete. 2023-08-25T05:37:29.058 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-25T05:37:27.184079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2096,"num_read_kb":4403,"num_write":565,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3653,"ondisk_log_size":3653,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":419912,"kb_used_data":20584,"kb_used_omap":13,"kb_used_meta":399218,"kb_avail":754554808,"statfs":{"total":773094113280,"available":772664123392,"internally_reserved":0,"allocated":21078016,"data_stored":11278984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":408799320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.671311"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.521027+0000","last_change":"2023-08-25T05:37:22.521027+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.521027+0000","last_undegraded":"2023-08-25T05:37:22.521027+0000","last_fullsized":"2023-08-25T05:37:22.521027+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.521357+0000","last_change":"2023-08-25T05:37:22.521357+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.521357+0000","last_undegraded":"2023-08-25T05:37:22.521357+0000","last_fullsized":"2023-08-25T05:37:22.521357+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.519182+0000","last_change":"2023-08-25T05:37:22.519182+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.519182+0000","last_undegraded":"2023-08-25T05:37:22.519182+0000","last_fullsized":"2023-08-25T05:37:22.519182+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.514998+0000","last_change":"2023-08-25T05:37:22.514998+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.514998+0000","last_undegraded":"2023-08-25T05:37:22.514998+0000","last_fullsized":"2023-08-25T05:37:22.514998+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.515737+0000","last_change":"2023-08-25T05:37:22.515737+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.515737+0000","last_undegraded":"2023-08-25T05:37:22.515737+0000","last_fullsized":"2023-08-25T05:37:22.515737+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.520828+0000","last_change":"2023-08-25T05:37:22.520828+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.520828+0000","last_undegraded":"2023-08-25T05:37:22.520828+0000","last_fullsized":"2023-08-25T05:37:22.520828+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.519171+0000","last_change":"2023-08-25T05:37:22.519171+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.519171+0000","last_undegraded":"2023-08-25T05:37:22.519171+0000","last_fullsized":"2023-08-25T05:37:22.519171+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.518353+0000","last_change":"2023-08-25T05:37:22.518353+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.518353+0000","last_undegraded":"2023-08-25T05:37:22.518353+0000","last_fullsized":"2023-08-25T05:37:22.518353+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.518371+0000","last_change":"2023-08-25T05:37:22.518371+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.518371+0000","last_undegraded":"2023-08-25T05:37:22.518371+0000","last_fullsized":"2023-08-25T05:37:22.518371+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.519268+0000","last_change":"2023-08-25T05:37:22.519268+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.519268+0000","last_undegraded":"2023-08-25T05:37:22.519268+0000","last_fullsized":"2023-08-25T05:37:22.519268+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.516067+0000","last_change":"2023-08-25T05:37:22.516067+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.516067+0000","last_undegraded":"2023-08-25T05:37:22.516067+0000","last_fullsized":"2023-08-25T05:37:22.516067+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.518342+0000","last_change":"2023-08-25T05:37:22.518342+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.518342+0000","last_undegraded":"2023-08-25T05:37:22.518342+0000","last_fullsized":"2023-08-25T05:37:22.518342+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.515217+0000","last_change":"2023-08-25T05:37:22.515217+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.515217+0000","last_undegraded":"2023-08-25T05:37:22.515217+0000","last_fullsized":"2023-08-25T05:37:22.515217+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.519157+0000","last_change":"2023-08-25T05:37:22.519157+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.519157+0000","last_undegraded":"2023-08-25T05:37:22.519157+0000","last_fullsized":"2023-08-25T05:37:22.519157+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.517204+0000","last_change":"2023-08-25T05:37:22.517204+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.517204+0000","last_undegraded":"2023-08-25T05:37:22.517204+0000","last_fullsized":"2023-08-25T05:37:22.517204+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.515978+0000","last_change":"2023-08-25T05:37:22.515978+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.515978+0000","last_undegraded":"2023-08-25T05:37:22.515978+0000","last_fullsized":"2023-08-25T05:37:22.515978+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.519275+0000","last_change":"2023-08-25T05:37:22.519275+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.519275+0000","last_undegraded":"2023-08-25T05:37:22.519275+0000","last_fullsized":"2023-08-25T05:37:22.519275+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.515996+0000","last_change":"2023-08-25T05:37:22.515996+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.515996+0000","last_undegraded":"2023-08-25T05:37:22.515996+0000","last_fullsized":"2023-08-25T05:37:22.515996+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.520730+0000","last_change":"2023-08-25T05:37:22.520730+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.520730+0000","last_undegraded":"2023-08-25T05:37:22.520730+0000","last_fullsized":"2023-08-25T05:37:22.520730+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.520830+0000","last_change":"2023-08-25T05:37:22.520830+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.520830+0000","last_undegraded":"2023-08-25T05:37:22.520830+0000","last_fullsized":"2023-08-25T05:37:22.520830+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.518209+0000","last_change":"2023-08-25T05:37:22.518209+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.518209+0000","last_undegraded":"2023-08-25T05:37:22.518209+0000","last_fullsized":"2023-08-25T05:37:22.518209+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.518775+0000","last_change":"2023-08-25T05:37:22.518775+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.518775+0000","last_undegraded":"2023-08-25T05:37:22.518775+0000","last_fullsized":"2023-08-25T05:37:22.518775+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.515977+0000","last_change":"2023-08-25T05:37:22.515977+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.515977+0000","last_undegraded":"2023-08-25T05:37:22.515977+0000","last_fullsized":"2023-08-25T05:37:22.515977+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.515396+0000","last_change":"2023-08-25T05:37:22.515396+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.515396+0000","last_undegraded":"2023-08-25T05:37:22.515396+0000","last_fullsized":"2023-08-25T05:37:22.515396+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.519096+0000","last_change":"2023-08-25T05:37:22.519096+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.519096+0000","last_undegraded":"2023-08-25T05:37:22.519096+0000","last_fullsized":"2023-08-25T05:37:22.519096+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"191'3653","reported_seq":4640,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-08-25T05:37:22.518236+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:37:22.518236+0000","last_peered":"2023-08-25T05:37:22.518236+0000","last_clean":"2023-08-25T05:37:22.518236+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:37:22.518236+0000","last_undegraded":"2023-08-25T05:37:22.518236+0000","last_fullsized":"2023-08-25T05:37:22.518236+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3653,"log_dups_size":0,"ondisk_log_size":3653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:21:52.960595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2096,"num_read_kb":4403,"num_write":565,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":354,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-08-25T05:37:22.519544+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:37:22.519544+0000","last_peered":"2023-08-25T05:37:22.519544+0000","last_clean":"2023-08-25T05:37:22.519544+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:37:22.519544+0000","last_undegraded":"2023-08-25T05:37:22.519544+0000","last_fullsized":"2023-08-25T05:37:22.519544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:33:18.931212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.520096+0000","last_change":"2023-08-25T05:37:22.520096+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.520096+0000","last_undegraded":"2023-08-25T05:37:22.520096+0000","last_fullsized":"2023-08-25T05:37:22.520096+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":345,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-08-25T05:37:22.518101+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:37:22.518101+0000","last_peered":"2023-08-25T05:37:22.518101+0000","last_clean":"2023-08-25T05:37:22.518101+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:37:22.518101+0000","last_undegraded":"2023-08-25T05:37:22.518101+0000","last_fullsized":"2023-08-25T05:37:22.518101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:27:25.958313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.519719+0000","last_change":"2023-08-25T05:37:22.519719+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.519719+0000","last_undegraded":"2023-08-25T05:37:22.519719+0000","last_fullsized":"2023-08-25T05:37:22.519719+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":354,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-08-25T05:37:22.514651+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:37:22.514651+0000","last_peered":"2023-08-25T05:37:22.514651+0000","last_clean":"2023-08-25T05:37:22.514651+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:37:22.514651+0000","last_undegraded":"2023-08-25T05:37:22.514651+0000","last_fullsized":"2023-08-25T05:37:22.514651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:12:39.121338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.514984+0000","last_change":"2023-08-25T05:37:22.514984+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.514984+0000","last_undegraded":"2023-08-25T05:37:22.514984+0000","last_fullsized":"2023-08-25T05:37:22.514984+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":354,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-08-25T05:37:22.519474+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:37:22.519474+0000","last_peered":"2023-08-25T05:37:22.519474+0000","last_clean":"2023-08-25T05:37:22.519474+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:37:22.519474+0000","last_undegraded":"2023-08-25T05:37:22.519474+0000","last_fullsized":"2023-08-25T05:37:22.519474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:08:44.940489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.522564+0000","last_change":"2023-08-25T05:37:22.522564+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.522564+0000","last_undegraded":"2023-08-25T05:37:22.522564+0000","last_fullsized":"2023-08-25T05:37:22.522564+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":384,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-08-25T05:37:22.520085+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:37:22.520085+0000","last_peered":"2023-08-25T05:37:22.520085+0000","last_clean":"2023-08-25T05:37:22.520085+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:37:22.520085+0000","last_undegraded":"2023-08-25T05:37:22.520085+0000","last_fullsized":"2023-08-25T05:37:22.520085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:24:31.770546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.520103+0000","last_change":"2023-08-25T05:37:22.520103+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.520103+0000","last_undegraded":"2023-08-25T05:37:22.520103+0000","last_fullsized":"2023-08-25T05:37:22.520103+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":344,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-08-25T05:37:22.517891+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:37:22.517891+0000","last_peered":"2023-08-25T05:37:22.517891+0000","last_clean":"2023-08-25T05:37:22.517891+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:37:22.517891+0000","last_undegraded":"2023-08-25T05:37:22.517891+0000","last_fullsized":"2023-08-25T05:37:22.517891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:16:54.648165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.518697+0000","last_change":"2023-08-25T05:37:22.518697+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.518697+0000","last_undegraded":"2023-08-25T05:37:22.518697+0000","last_fullsized":"2023-08-25T05:37:22.518697+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":382,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-08-25T05:37:22.521779+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:37:22.521779+0000","last_peered":"2023-08-25T05:37:22.521779+0000","last_clean":"2023-08-25T05:37:22.521779+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:37:22.521779+0000","last_undegraded":"2023-08-25T05:37:22.521779+0000","last_fullsized":"2023-08-25T05:37:22.521779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:24:20.318335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-25T05:37:23.512067+0000","last_change":"2023-08-25T05:37:23.512067+0000","last_active":"2023-08-25T05:37:23.512067+0000","last_peered":"2023-08-25T05:37:23.512067+0000","last_clean":"2023-08-25T05:37:23.512067+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:23.512067+0000","last_undegraded":"2023-08-25T05:37:23.512067+0000","last_fullsized":"2023-08-25T05:37:23.512067+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":1,"reported_epoch":199,"state":"creating+peering","last_fresh":"2023-08-25T05:37:22.515723+0000","last_change":"2023-08-25T05:37:22.515723+0000","last_active":"2023-08-25T05:37:22.491450+0000","last_peered":"2023-08-25T05:37:22.491450+0000","last_clean":"2023-08-25T05:37:22.491450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-25T05:37:22.515723+0000","last_undegraded":"2023-08-25T05:37:22.515723+0000","last_fullsized":"2023-08-25T05:37:22.515723+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":406,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-08-25T05:37:22.514944+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:37:22.514944+0000","last_peered":"2023-08-25T05:37:22.514944+0000","last_clean":"2023-08-25T05:37:22.514944+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:37:22.514944+0000","last_undegraded":"2023-08-25T05:37:22.514944+0000","last_fullsized":"2023-08-25T05:37:22.514944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:45:07.188170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2096,"num_read_kb":4403,"num_write":565,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3653,"ondisk_log_size":3653,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510568,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52236,"kb_used_data":3008,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319604,"statfs":{"total":96636764160,"available":96583274496,"internally_reserved":0,"allocated":3080192,"data_stored":1852649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.40999999999999998},"max":{"1min":0.94599999999999995,"5min":0.95499999999999996,"15min":1.0169999999999999},"last":0.75},{"interface":"front","average":{"1min":0.752,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.441},"max":{"1min":0.90700000000000003,"5min":1.016,"15min":1.0189999999999999},"last":0.83199999999999996}]},{"osd":1,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93799999999999994,"5min":0.99199999999999999,"15min":1.054},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.749,"15min":0.77300000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.77500000000000002}]},{"osd":2,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.753},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77300000000000002,"15min":0.76800000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.53600000000000003},"max":{"1min":1.0129999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.86099999999999999}]},{"osd":3,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76700000000000002,"15min":0.77000000000000002},"min":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94499999999999995,"5min":1.006,"15min":1.006},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98299999999999998,"5min":1.0600000000000001,"15min":1.0680000000000001},"last":0.81000000000000005}]},{"osd":4,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.44},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0449999999999999,"5min":1.163,"15min":1.163},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.36599999999999999},"max":{"1min":0.97199999999999998,"5min":0.997,"15min":1.1120000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.501,"5min":0.44,"15min":0.42699999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.623}]},{"osd":6,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.74399999999999999,"15min":0.73099999999999998},"min":{"1min":0.50900000000000001,"5min":0.499,"15min":0.47999999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.71499999999999997,"15min":0.69999999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0900000000000001,"5min":1.119,"15min":1.119},"last":0.70099999999999996}]}]},{"osd":6,"up_from":15,"seq":64424510568,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33608,"kb_used_data":2428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338232,"statfs":{"total":96636764160,"available":96602349568,"internally_reserved":0,"allocated":2486272,"data_stored":1262281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73899999999999999,"15min":0.745},"min":{"1min":0.45600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.876,"5min":0.99099999999999999,"15min":1.0449999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.50800000000000001,"5min":0.40100000000000002,"15min":0.40000000000000002},"max":{"1min":0.88600000000000001,"5min":1.0389999999999999,"15min":1.1699999999999999},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.76300000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.1559999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.48899999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1299999999999999},"last":0.77600000000000002}]},{"osd":2,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76100000000000001,"15min":0.78700000000000003},"min":{"1min":0.55000000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98099999999999998,"5min":1.0760000000000001,"15min":1.0780000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.81699999999999995,"15min":0.82499999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96799999999999997,"5min":1.0669999999999999,"15min":1.1599999999999999},"last":0.753}]},{"osd":3,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.497,"5min":0.47999999999999998,"15min":0.46400000000000002},"max":{"1min":1.002,"5min":1.0049999999999999,"15min":1.208},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.58699999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0149999999999999,"5min":1.054,"15min":1.236},"last":0.85299999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.45300000000000001,"5min":0.38400000000000001,"15min":0.33200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.018},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.42799999999999999,"5min":0.40699999999999997,"15min":0.35499999999999998},"max":{"1min":0.83999999999999997,"5min":0.85799999999999998,"15min":1.016},"last":0.89700000000000002}]},{"osd":5,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64900000000000002,"15min":0.65200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.44},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.1319999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.73499999999999999},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.1659999999999999},"last":0.91900000000000004}]},{"osd":7,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.39700000000000002},"max":{"1min":0.78000000000000003,"5min":0.97199999999999998,"15min":1.044},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68700000000000006,"15min":0.69699999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.42899999999999999},"max":{"1min":0.96399999999999997,"5min":1.228,"15min":1.228},"last":0.872}]}]},{"osd":5,"up_from":14,"seq":60129543271,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59976,"kb_used_data":2428,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311864,"statfs":{"total":96636764160,"available":96575348736,"internally_reserved":0,"allocated":2486272,"data_stored":1262281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75700000000000001,"15min":0.754},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.97499999999999998,"5min":0.98199999999999998,"15min":1.034},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94599999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78200000000000003}]},{"osd":1,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96099999999999997,"5min":1.073,"15min":1.073},"last":0.62},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77400000000000002,"15min":0.77600000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.99199999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81999999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95699999999999996,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47999999999999998},"max":{"1min":1.018,"5min":1.208,"15min":1.208},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77000000000000002,"15min":0.76700000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96199999999999997,"5min":1.155,"15min":1.155},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79900000000000004,"15min":0.79500000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0089999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.76700000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64400000000000002,"15min":0.60599999999999998},"min":{"1min":0.41799999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.86399999999999999,"5min":1.681,"15min":1.681},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.63400000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.42499999999999999},"max":{"1min":0.89200000000000002,"5min":1.381,"15min":1.381},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69999999999999996,"15min":0.67000000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.42199999999999999},"max":{"1min":0.92200000000000004,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68700000000000006,"15min":0.68200000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.44900000000000001},"max":{"1min":0.86799999999999999,"5min":1.276,"15min":1.276},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68200000000000005,"15min":0.66100000000000003},"min":{"1min":0.46500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.874,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77400000000000002,"15min":0.74099999999999999},"min":{"1min":0.53300000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96799999999999997,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.91300000000000003}]}]},{"osd":4,"up_from":14,"seq":60129543271,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47496,"kb_used_data":2428,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324344,"statfs":{"total":96636764160,"available":96588128256,"internally_reserved":0,"allocated":2486272,"data_stored":1262281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.054},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96499999999999997,"5min":0.97799999999999998,"15min":1.02},"last":0.627}]},{"osd":1,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.77300000000000002},"min":{"1min":0.48199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0449999999999999,"5min":1.05,"15min":1.05},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.505},"max":{"1min":0.97999999999999998,"5min":1.022,"15min":1.103},"last":0.65900000000000003}]},{"osd":2,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.51800000000000002},"max":{"1min":0.95699999999999996,"5min":0.995,"15min":1.0780000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.76100000000000001,"15min":0.77200000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.47999999999999998},"max":{"1min":1.0649999999999999,"5min":1.069,"15min":1.069},"last":0.57099999999999995}]},{"osd":3,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76500000000000001,"15min":0.78800000000000003},"min":{"1min":0.55800000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.995,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95599999999999996,"5min":1.101,"15min":1.101},"last":0.52900000000000003}]},{"osd":5,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81200000000000006,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.46899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93700000000000006,"5min":0.96799999999999997,"15min":0.98299999999999998},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.755,"15min":0.75},"min":{"1min":0.58399999999999996,"5min":0.49399999999999999,"15min":0.49199999999999999},"max":{"1min":1.0029999999999999,"5min":1.008,"15min":1.1240000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.66700000000000004,"15min":0.65800000000000003},"min":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.0629999999999999},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91000000000000003,"5min":0.996,"15min":0.996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.53200000000000003,"5min":0.496,"15min":0.47599999999999998},"max":{"1min":0.96699999999999997,"5min":1.0389999999999999,"15min":1.0860000000000001},"last":0.752}]}]},{"osd":3,"up_from":14,"seq":60129543271,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64136,"kb_used_data":2428,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307704,"statfs":{"total":96636764160,"available":96571088896,"internally_reserved":0,"allocated":2486272,"data_stored":1262281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":63174923},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.33400000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.35499999999999998,"15min":0.34000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.92900000000000005},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52300000000000002,"15min":0.52800000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.0780000000000001},"last":0.44},{"interface":"front","average":{"1min":0.628,"5min":0.61299999999999999,"15min":0.629},"min":{"1min":0.44400000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":0.97999999999999998},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.50600000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81100000000000005,"5min":1.0089999999999999,"15min":1.038},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.44800000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71999999999999997,"5min":0.79000000000000004,"15min":0.95799999999999996},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.52300000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.046,"5min":1.26,"15min":1.26},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.83899999999999997,"15min":0.83199999999999996},"min":{"1min":0.58099999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.125,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.86299999999999999}]},{"osd":5,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.65300000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.026,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82299999999999995,"15min":0.82999999999999996},"min":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.1419999999999999},"last":0.745}]},{"osd":6,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85799999999999998,"15min":0.86699999999999999},"min":{"1min":0.60999999999999999,"5min":0.59499999999999997,"15min":0.59399999999999997},"max":{"1min":1.1160000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.65200000000000002,"5min":0.58399999999999996,"15min":0.48999999999999999},"max":{"1min":1.0469999999999999,"5min":1.133,"15min":1.194},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.86699999999999999,"15min":0.879},"min":{"1min":0.63100000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.169,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.83299999999999996,"15min":0.83599999999999997},"min":{"1min":0.625,"5min":0.52900000000000003,"15min":0.51800000000000002},"max":{"1min":1.0669999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.879}]}]},{"osd":2,"up_from":14,"seq":60129543272,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59976,"kb_used_data":2428,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311864,"statfs":{"total":96636764160,"available":96575348736,"internally_reserved":0,"allocated":2486272,"data_stored":1262281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.46000000000000002,"15min":0.47699999999999998},"min":{"1min":0.33400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.378},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.35499999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71699999999999997,"5min":0.85099999999999998,"15min":0.86099999999999999},"last":0.44}]},{"osd":1,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66200000000000003,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83099999999999996,"5min":0.88800000000000001,"15min":0.89700000000000002},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.41099999999999998,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.78000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.505}]},{"osd":4,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.63200000000000001,"5min":0.56399999999999995,"15min":0.48699999999999999},"max":{"1min":1.0720000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80400000000000005,"15min":0.81100000000000005},"min":{"1min":0.66200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.1619999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.75}]},{"osd":5,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.60899999999999999,"5min":0.53200000000000003,"15min":0.51700000000000002},"max":{"1min":1.0089999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.84699999999999998},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.246,"5min":1.266,"15min":1.266},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.103,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.875,"15min":0.88},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.58899999999999997},"max":{"1min":1.204,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.84799999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.82599999999999996,"15min":0.83799999999999997},"min":{"1min":0.69299999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1040000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.82699999999999996,"15min":0.83199999999999996},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1870000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.72199999999999998}]}]},{"osd":1,"up_from":14,"seq":60129543272,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41928,"kb_used_data":2428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329912,"statfs":{"total":96636764160,"available":96593829888,"internally_reserved":0,"allocated":2486272,"data_stored":1262281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.47699999999999998},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.70299999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.34100000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.71099999999999997,"5min":0.73799999999999999,"15min":0.879},"last":0.41999999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.81399999999999995},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66600000000000004,"5min":0.82899999999999996,"15min":0.91400000000000003},"last":0.628}]},{"osd":3,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73199999999999998,"5min":0.998,"15min":0.998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.376,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73299999999999998,"5min":0.88700000000000001,"15min":0.98699999999999999},"last":0.45000000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91000000000000003,"5min":1.1559999999999999,"15min":1.2350000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82999999999999996,"15min":0.83699999999999997},"min":{"1min":0.69099999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98699999999999999,"5min":1.268,"15min":1.268},"last":0.71299999999999997}]},{"osd":5,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.80900000000000005},"min":{"1min":0.624,"5min":0.54800000000000004,"15min":0.47699999999999998},"max":{"1min":0.89800000000000002,"5min":1.109,"15min":1.1950000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.66200000000000003,"5min":0.61899999999999999,"15min":0.55300000000000005},"max":{"1min":0.97899999999999998,"5min":1.214,"15min":1.214},"last":0.64900000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.66100000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.94499999999999995,"5min":1.212,"15min":1.244},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.81899999999999995,"15min":0.83699999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.94699999999999995,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81200000000000006,"15min":0.83699999999999997},"min":{"1min":0.61699999999999999,"5min":0.60899999999999999,"15min":0.55600000000000005},"max":{"1min":1.0069999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.751},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.626},"max":{"1min":0.96799999999999997,"5min":1.127,"15min":1.2110000000000001},"last":0.85399999999999998}]}]},{"osd":0,"up_from":14,"seq":60129543271,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60556,"kb_used_data":3008,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311284,"statfs":{"total":96636764160,"available":96574754816,"internally_reserved":0,"allocated":3080192,"data_stored":1852649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48999999999999999,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.308,"15min":0.30599999999999999},"max":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":1.2170000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.81599999999999995,"15min":0.85999999999999999},"last":0.58799999999999997}]},{"osd":2,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36399999999999999,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":0.81399999999999995,"15min":0.91000000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55000000000000004,"15min":0.56100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71499999999999997,"5min":0.755,"15min":0.86799999999999999},"last":0.48699999999999999}]},{"osd":3,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.754,"15min":1.855},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.75900000000000001,"5min":0.90000000000000002,"15min":1.3480000000000001},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.57599999999999996,"5min":0.495,"15min":0.495},"max":{"1min":1.0600000000000001,"5min":1.258,"15min":1.3799999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81699999999999995,"15min":0.83199999999999996},"min":{"1min":0.627,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0529999999999999,"5min":1.2809999999999999,"15min":1.2849999999999999},"last":1.208}]},{"osd":5,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.58999999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.004,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.167},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82499999999999996,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0620000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":1.0660000000000001}]},{"osd":6,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82199999999999995,"15min":0.83599999999999997},"min":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0429999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":1.097},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86499999999999999,"15min":0.85999999999999999},"min":{"1min":0.51600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.0880000000000001,"5min":1.3560000000000001,"15min":1.5129999999999999},"last":1.3460000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85799999999999998,"15min":0.876},"min":{"1min":0.64600000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0760000000000001,"5min":1.4339999999999999,"15min":1.5720000000000001},"last":1.2609999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58099999999999996},"max":{"1min":1.0620000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.329}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:37:29.065 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:37:29.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.239+0000 7f2eaad59640 1 Processor -- start 2023-08-25T05:37:29.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.239+0000 7f2eaad59640 1 -- start start 2023-08-25T05:37:29.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.243+0000 7f2eaad59640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ea40aeb10 0x7f2ea40ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:29.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.243+0000 7f2eaad59640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2ea40cee20 0x7f2ea4069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:29.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.243+0000 7f2eaad59640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea40cf2b0 con 0x7f2ea4069e40 2023-08-25T05:37:29.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.243+0000 7f2eaad59640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea40d0380 con 0x7f2ea40aeb10 2023-08-25T05:37:29.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.243+0000 7f2eaad59640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea406d590 con 0x7f2ea40cee20 2023-08-25T05:37:29.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.243+0000 7f2ea92f6640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2ea4069e40 0x7f2ea4160520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34392/0 (socket says 172.21.15.55:34392) 2023-08-25T05:37:29.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.243+0000 7f2ea92f6640 1 -- 172.21.15.55:0/2047160074 learned_addr learned my addr 172.21.15.55:0/2047160074 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:29.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.243+0000 7f2ea8af5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ea40aeb10 0x7f2ea40ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:29.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.243+0000 7f2ea3fff640 1 --2- 172.21.15.55:0/2047160074 >> v2:172.21.15.110:3300/0 conn(0x7f2ea40cee20 0x7f2ea4069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:29.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.243+0000 7f2ea8af5640 1 -- 172.21.15.55:0/2047160074 >> v2:172.21.15.110:3300/0 conn(0x7f2ea40cee20 msgr2=0x7f2ea4069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:29.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.243+0000 7f2ea8af5640 1 --2- 172.21.15.55:0/2047160074 >> v2:172.21.15.110:3300/0 conn(0x7f2ea40cee20 0x7f2ea4069900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.243+0000 7f2ea8af5640 1 -- 172.21.15.55:0/2047160074 >> v1:172.21.15.55:6789/0 conn(0x7f2ea4069e40 legacy=0x7f2ea4160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:29.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.243+0000 7f2ea8af5640 1 -- 172.21.15.55:0/2047160074 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea406c4f0 con 0x7f2ea40aeb10 2023-08-25T05:37:29.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.243+0000 7f2ea37fe640 1 -- 172.21.15.55:0/2047160074 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826243698 0 0) 0x7f2ea40cf2b0 con 0x7f2ea4069e40 2023-08-25T05:37:29.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.243+0000 7f2ea8af5640 1 --2- 172.21.15.55:0/2047160074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea40aeb10 0x7f2ea40ce8e0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f2ea406d6d0 tx=0x7f2e9801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb0e905c663cba5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:29.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2ea37fe640 1 -- 172.21.15.55:0/2047160074 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e980ab600 con 0x7f2ea40aeb10 2023-08-25T05:37:29.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2ea37fe640 1 -- 172.21.15.55:0/2047160074 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e980a7050 con 0x7f2ea40aeb10 2023-08-25T05:37:29.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2ea37fe640 1 -- 172.21.15.55:0/2047160074 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e980ab980 con 0x7f2ea40aeb10 2023-08-25T05:37:29.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2eaad59640 1 -- 172.21.15.55:0/2047160074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea40aeb10 msgr2=0x7f2ea40ce8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:29.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2eaad59640 1 --2- 172.21.15.55:0/2047160074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea40aeb10 0x7f2ea40ce8e0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f2ea406d6d0 tx=0x7f2e9801c440 comp rx=0 tx=0).stop 2023-08-25T05:37:29.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2eaad59640 1 -- 172.21.15.55:0/2047160074 shutdown_connections 2023-08-25T05:37:29.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2eaad59640 1 --2- 172.21.15.55:0/2047160074 >> v2:172.21.15.110:3300/0 conn(0x7f2ea40cee20 0x7f2ea4069900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2eaad59640 1 --2- 172.21.15.55:0/2047160074 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea40aeb10 0x7f2ea40ce8e0 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2eaad59640 1 -- 172.21.15.55:0/2047160074 >> 172.21.15.55:0/2047160074 conn(0x7f2ea40cf530 msgr2=0x7f2ea40cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:29.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2eaad59640 1 -- 172.21.15.55:0/2047160074 shutdown_connections 2023-08-25T05:37:29.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2eaad59640 1 -- 172.21.15.55:0/2047160074 wait complete. 2023-08-25T05:37:29.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2eaad59640 1 Processor -- start 2023-08-25T05:37:29.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2eaad59640 1 -- start start 2023-08-25T05:37:29.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2eaad59640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ea4069e40 0x7f2ea40b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:29.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2eaad59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea40aeb10 0x7f2ea40b3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:29.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2eaad59640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ea40cee20 0x7f2ea40b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:29.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2eaad59640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea40c3aa0 con 0x7f2ea40aeb10 2023-08-25T05:37:29.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2eaad59640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea40b0760 con 0x7f2ea40cee20 2023-08-25T05:37:29.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2eaad59640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea40afbe0 con 0x7f2ea4069e40 2023-08-25T05:37:29.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2ea3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea40aeb10 0x7f2ea40b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:29.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2ea3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea40aeb10 0x7f2ea40b3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54300/0 (socket says 172.21.15.55:54300) 2023-08-25T05:37:29.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.247+0000 7f2ea3fff640 1 -- 172.21.15.55:0/3840489800 learned_addr learned my addr 172.21.15.55:0/3840489800 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:29.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.251+0000 7f2ea8af5640 1 --2- 172.21.15.55:0/3840489800 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ea4069e40 0x7f2ea40b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:29.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.251+0000 7f2ea92f6640 1 --2- 172.21.15.55:0/3840489800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ea40cee20 0x7f2ea40b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:29.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.251+0000 7f2ea3fff640 1 -- 172.21.15.55:0/3840489800 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ea4069e40 msgr2=0x7f2ea40b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:29.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.251+0000 7f2ea3fff640 1 --2- 172.21.15.55:0/3840489800 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ea4069e40 0x7f2ea40b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.251+0000 7f2ea3fff640 1 -- 172.21.15.55:0/3840489800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ea40cee20 msgr2=0x7f2ea40b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:29.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.251+0000 7f2ea3fff640 1 --2- 172.21.15.55:0/3840489800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ea40cee20 0x7f2ea40b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.251+0000 7f2ea3fff640 1 -- 172.21.15.55:0/3840489800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e98009420 con 0x7f2ea40aeb10 2023-08-25T05:37:29.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.251+0000 7f2ea8af5640 1 --2- 172.21.15.55:0/3840489800 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ea4069e40 0x7f2ea40b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:29.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.251+0000 7f2ea3fff640 1 --2- 172.21.15.55:0/3840489800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea40aeb10 0x7f2ea40b3890 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000e930 tx=0x7f2e9000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:29.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.251+0000 7f2ea17fa640 1 -- 172.21.15.55:0/3840489800 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90009690 con 0x7f2ea40aeb10 2023-08-25T05:37:29.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.251+0000 7f2ea17fa640 1 -- 172.21.15.55:0/3840489800 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9000ca00 con 0x7f2ea40aeb10 2023-08-25T05:37:29.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.251+0000 7f2ea17fa640 1 -- 172.21.15.55:0/3840489800 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9000cd70 con 0x7f2ea40aeb10 2023-08-25T05:37:29.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.251+0000 7f2eaad59640 1 -- 172.21.15.55:0/3840489800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea40afec0 con 0x7f2ea40aeb10 2023-08-25T05:37:29.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.251+0000 7f2eaad59640 1 -- 172.21.15.55:0/3840489800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea40b0480 con 0x7f2ea40aeb10 2023-08-25T05:37:29.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.251+0000 7f2eaad59640 1 -- 172.21.15.55:0/3840489800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea404dbe0 con 0x7f2ea40aeb10 2023-08-25T05:37:29.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.251+0000 7f2ea17fa640 1 -- 172.21.15.55:0/3840489800 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f2e90013470 con 0x7f2ea40aeb10 2023-08-25T05:37:29.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.255+0000 7f2ea17fa640 1 --2- 172.21.15.55:0/3840489800 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f2e880657d0 0x7f2e88067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:29.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.255+0000 7f2ea17fa640 1 -- 172.21.15.55:0/3840489800 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e900832b0 con 0x7f2ea40aeb10 2023-08-25T05:37:29.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.255+0000 7f2ea8af5640 1 --2- 172.21.15.55:0/3840489800 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f2e880657d0 0x7f2e88067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:29.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.255+0000 7f2ea8af5640 1 --2- 172.21.15.55:0/3840489800 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f2e880657d0 0x7f2e88067c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2e980ad000 tx=0x7f2e98008040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:29.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.259+0000 7f2ea17fa640 1 -- 172.21.15.55:0/3840489800 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2e90050bf0 con 0x7f2ea40aeb10 2023-08-25T05:37:29.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.411+0000 7f2eaad59640 1 -- 172.21.15.55:0/3840489800 --> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ea406d070 con 0x7f2e880657d0 2023-08-25T05:37:29.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.419+0000 7f2ea17fa640 1 -- 172.21.15.55:0/3840489800 <== mgr.8987 v2:172.21.15.110:6832/3630541271 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311949 (secure 0 0 0) 0x7f2e980ab400 con 0x7f2e880657d0 2023-08-25T05:37:29.425 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:29.427 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:37:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.423+0000 7f2eaad59640 1 -- 172.21.15.55:0/3840489800 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f2e880657d0 msgr2=0x7f2e88067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.423+0000 7f2eaad59640 1 --2- 172.21.15.55:0/3840489800 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f2e880657d0 0x7f2e88067c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2e980ad000 tx=0x7f2e98008040 comp rx=0 tx=0).stop 2023-08-25T05:37:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.423+0000 7f2eaad59640 1 -- 172.21.15.55:0/3840489800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea40aeb10 msgr2=0x7f2ea40b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.423+0000 7f2eaad59640 1 --2- 172.21.15.55:0/3840489800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea40aeb10 0x7f2ea40b3890 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000e930 tx=0x7f2e9000edf0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.423+0000 7f2eaad59640 1 -- 172.21.15.55:0/3840489800 shutdown_connections 2023-08-25T05:37:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.423+0000 7f2eaad59640 1 --2- 172.21.15.55:0/3840489800 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f2e880657d0 0x7f2e88067c90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.423+0000 7f2eaad59640 1 --2- 172.21.15.55:0/3840489800 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ea40cee20 0x7f2ea40b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.423+0000 7f2eaad59640 1 --2- 172.21.15.55:0/3840489800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea40aeb10 0x7f2ea40b3890 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.423+0000 7f2eaad59640 1 --2- 172.21.15.55:0/3840489800 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ea4069e40 0x7f2ea40b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.423+0000 7f2eaad59640 1 -- 172.21.15.55:0/3840489800 >> 172.21.15.55:0/3840489800 conn(0x7f2ea40cf530 msgr2=0x7f2ea40ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.423+0000 7f2eaad59640 1 -- 172.21.15.55:0/3840489800 shutdown_connections 2023-08-25T05:37:29.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.423+0000 7f2eaad59640 1 -- 172.21.15.55:0/3840489800 wait complete. 2023-08-25T05:37:29.446 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-25T05:37:29.184556+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2096,"num_read_kb":4403,"num_write":609,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3691,"ondisk_log_size":3691,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":420292,"kb_used_data":20936,"kb_used_omap":13,"kb_used_meta":399218,"kb_avail":754554428,"statfs":{"total":773094113280,"available":772663734272,"internally_reserved":0,"allocated":21438464,"data_stored":11447076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":408799320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001410"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946915+0000","last_change":"2023-08-25T05:37:24.558861+0000","last_active":"2023-08-25T05:37:25.946915+0000","last_peered":"2023-08-25T05:37:25.946915+0000","last_clean":"2023-08-25T05:37:25.946915+0000","last_became_active":"2023-08-25T05:37:24.558588+0000","last_became_peered":"2023-08-25T05:37:24.558588+0000","last_unstale":"2023-08-25T05:37:25.946915+0000","last_undegraded":"2023-08-25T05:37:25.946915+0000","last_fullsized":"2023-08-25T05:37:25.946915+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:40:20.607628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947254+0000","last_change":"2023-08-25T05:37:24.550046+0000","last_active":"2023-08-25T05:37:25.947254+0000","last_peered":"2023-08-25T05:37:25.947254+0000","last_clean":"2023-08-25T05:37:25.947254+0000","last_became_active":"2023-08-25T05:37:24.549770+0000","last_became_peered":"2023-08-25T05:37:24.549770+0000","last_unstale":"2023-08-25T05:37:25.947254+0000","last_undegraded":"2023-08-25T05:37:25.947254+0000","last_fullsized":"2023-08-25T05:37:25.947254+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:44:37.817651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.536047+0000","last_change":"2023-08-25T05:37:24.531155+0000","last_active":"2023-08-25T05:37:25.536047+0000","last_peered":"2023-08-25T05:37:25.536047+0000","last_clean":"2023-08-25T05:37:25.536047+0000","last_became_active":"2023-08-25T05:37:24.530836+0000","last_became_peered":"2023-08-25T05:37:24.530836+0000","last_unstale":"2023-08-25T05:37:25.536047+0000","last_undegraded":"2023-08-25T05:37:25.536047+0000","last_fullsized":"2023-08-25T05:37:25.536047+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:28.065393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945718+0000","last_change":"2023-08-25T05:37:24.544721+0000","last_active":"2023-08-25T05:37:25.945718+0000","last_peered":"2023-08-25T05:37:25.945718+0000","last_clean":"2023-08-25T05:37:25.945718+0000","last_became_active":"2023-08-25T05:37:24.544390+0000","last_became_peered":"2023-08-25T05:37:24.544390+0000","last_unstale":"2023-08-25T05:37:25.945718+0000","last_undegraded":"2023-08-25T05:37:25.945718+0000","last_fullsized":"2023-08-25T05:37:25.945718+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:29:44.533780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535305+0000","last_change":"2023-08-25T05:37:24.546648+0000","last_active":"2023-08-25T05:37:25.535305+0000","last_peered":"2023-08-25T05:37:25.535305+0000","last_clean":"2023-08-25T05:37:25.535305+0000","last_became_active":"2023-08-25T05:37:24.546097+0000","last_became_peered":"2023-08-25T05:37:24.546097+0000","last_unstale":"2023-08-25T05:37:25.535305+0000","last_undegraded":"2023-08-25T05:37:25.535305+0000","last_fullsized":"2023-08-25T05:37:25.535305+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:12:49.450829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535529+0000","last_change":"2023-08-25T05:37:24.555791+0000","last_active":"2023-08-25T05:37:25.535529+0000","last_peered":"2023-08-25T05:37:25.535529+0000","last_clean":"2023-08-25T05:37:25.535529+0000","last_became_active":"2023-08-25T05:37:24.555323+0000","last_became_peered":"2023-08-25T05:37:24.555323+0000","last_unstale":"2023-08-25T05:37:25.535529+0000","last_undegraded":"2023-08-25T05:37:25.535529+0000","last_fullsized":"2023-08-25T05:37:25.535529+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:44.720821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945686+0000","last_change":"2023-08-25T05:37:24.550505+0000","last_active":"2023-08-25T05:37:25.945686+0000","last_peered":"2023-08-25T05:37:25.945686+0000","last_clean":"2023-08-25T05:37:25.945686+0000","last_became_active":"2023-08-25T05:37:24.550152+0000","last_became_peered":"2023-08-25T05:37:24.550152+0000","last_unstale":"2023-08-25T05:37:25.945686+0000","last_undegraded":"2023-08-25T05:37:25.945686+0000","last_fullsized":"2023-08-25T05:37:25.945686+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:47:32.743962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946199+0000","last_change":"2023-08-25T05:37:24.547757+0000","last_active":"2023-08-25T05:37:25.946199+0000","last_peered":"2023-08-25T05:37:25.946199+0000","last_clean":"2023-08-25T05:37:25.946199+0000","last_became_active":"2023-08-25T05:37:24.547485+0000","last_became_peered":"2023-08-25T05:37:24.547485+0000","last_unstale":"2023-08-25T05:37:25.946199+0000","last_undegraded":"2023-08-25T05:37:25.946199+0000","last_fullsized":"2023-08-25T05:37:25.946199+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:28:19.214287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947052+0000","last_change":"2023-08-25T05:37:24.547748+0000","last_active":"2023-08-25T05:37:25.947052+0000","last_peered":"2023-08-25T05:37:25.947052+0000","last_clean":"2023-08-25T05:37:25.947052+0000","last_became_active":"2023-08-25T05:37:24.547416+0000","last_became_peered":"2023-08-25T05:37:24.547416+0000","last_unstale":"2023-08-25T05:37:25.947052+0000","last_undegraded":"2023-08-25T05:37:25.947052+0000","last_fullsized":"2023-08-25T05:37:25.947052+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:34:42.593857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535709+0000","last_change":"2023-08-25T05:37:24.544494+0000","last_active":"2023-08-25T05:37:25.535709+0000","last_peered":"2023-08-25T05:37:25.535709+0000","last_clean":"2023-08-25T05:37:25.535709+0000","last_became_active":"2023-08-25T05:37:24.544188+0000","last_became_peered":"2023-08-25T05:37:24.544188+0000","last_unstale":"2023-08-25T05:37:25.535709+0000","last_undegraded":"2023-08-25T05:37:25.535709+0000","last_fullsized":"2023-08-25T05:37:25.535709+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:07:21.041111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945924+0000","last_change":"2023-08-25T05:37:24.546120+0000","last_active":"2023-08-25T05:37:25.945924+0000","last_peered":"2023-08-25T05:37:25.945924+0000","last_clean":"2023-08-25T05:37:25.945924+0000","last_became_active":"2023-08-25T05:37:24.545846+0000","last_became_peered":"2023-08-25T05:37:24.545846+0000","last_unstale":"2023-08-25T05:37:25.945924+0000","last_undegraded":"2023-08-25T05:37:25.945924+0000","last_fullsized":"2023-08-25T05:37:25.945924+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:55:43.946369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945853+0000","last_change":"2023-08-25T05:37:24.556431+0000","last_active":"2023-08-25T05:37:25.945853+0000","last_peered":"2023-08-25T05:37:25.945853+0000","last_clean":"2023-08-25T05:37:25.945853+0000","last_became_active":"2023-08-25T05:37:24.556133+0000","last_became_peered":"2023-08-25T05:37:24.556133+0000","last_unstale":"2023-08-25T05:37:25.945853+0000","last_undegraded":"2023-08-25T05:37:25.945853+0000","last_fullsized":"2023-08-25T05:37:25.945853+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:38:26.995904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534692+0000","last_change":"2023-08-25T05:37:24.532883+0000","last_active":"2023-08-25T05:37:25.534692+0000","last_peered":"2023-08-25T05:37:25.534692+0000","last_clean":"2023-08-25T05:37:25.534692+0000","last_became_active":"2023-08-25T05:37:24.532366+0000","last_became_peered":"2023-08-25T05:37:24.532366+0000","last_unstale":"2023-08-25T05:37:25.534692+0000","last_undegraded":"2023-08-25T05:37:25.534692+0000","last_fullsized":"2023-08-25T05:37:25.534692+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:28:52.144447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945968+0000","last_change":"2023-08-25T05:37:24.535380+0000","last_active":"2023-08-25T05:37:25.945968+0000","last_peered":"2023-08-25T05:37:25.945968+0000","last_clean":"2023-08-25T05:37:25.945968+0000","last_became_active":"2023-08-25T05:37:24.534767+0000","last_became_peered":"2023-08-25T05:37:24.534767+0000","last_unstale":"2023-08-25T05:37:25.945968+0000","last_undegraded":"2023-08-25T05:37:25.945968+0000","last_fullsized":"2023-08-25T05:37:25.945968+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:06:33.432253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946749+0000","last_change":"2023-08-25T05:37:24.552244+0000","last_active":"2023-08-25T05:37:25.946749+0000","last_peered":"2023-08-25T05:37:25.946749+0000","last_clean":"2023-08-25T05:37:25.946749+0000","last_became_active":"2023-08-25T05:37:24.551943+0000","last_became_peered":"2023-08-25T05:37:24.551943+0000","last_unstale":"2023-08-25T05:37:25.946749+0000","last_undegraded":"2023-08-25T05:37:25.946749+0000","last_fullsized":"2023-08-25T05:37:25.946749+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:44:49.308482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535135+0000","last_change":"2023-08-25T05:37:24.546795+0000","last_active":"2023-08-25T05:37:25.535135+0000","last_peered":"2023-08-25T05:37:25.535135+0000","last_clean":"2023-08-25T05:37:25.535135+0000","last_became_active":"2023-08-25T05:37:24.546491+0000","last_became_peered":"2023-08-25T05:37:24.546491+0000","last_unstale":"2023-08-25T05:37:25.535135+0000","last_undegraded":"2023-08-25T05:37:25.535135+0000","last_fullsized":"2023-08-25T05:37:25.535135+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:00.912224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535914+0000","last_change":"2023-08-25T05:37:24.547692+0000","last_active":"2023-08-25T05:37:25.535914+0000","last_peered":"2023-08-25T05:37:25.535914+0000","last_clean":"2023-08-25T05:37:25.535914+0000","last_became_active":"2023-08-25T05:37:24.547384+0000","last_became_peered":"2023-08-25T05:37:24.547384+0000","last_unstale":"2023-08-25T05:37:25.535914+0000","last_undegraded":"2023-08-25T05:37:25.535914+0000","last_fullsized":"2023-08-25T05:37:25.535914+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:15:56.203680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535905+0000","last_change":"2023-08-25T05:37:24.547956+0000","last_active":"2023-08-25T05:37:25.535905+0000","last_peered":"2023-08-25T05:37:25.535905+0000","last_clean":"2023-08-25T05:37:25.535905+0000","last_became_active":"2023-08-25T05:37:24.547672+0000","last_became_peered":"2023-08-25T05:37:24.547672+0000","last_unstale":"2023-08-25T05:37:25.535905+0000","last_undegraded":"2023-08-25T05:37:25.535905+0000","last_fullsized":"2023-08-25T05:37:25.535905+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:56:09.207727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535528+0000","last_change":"2023-08-25T05:37:24.533024+0000","last_active":"2023-08-25T05:37:25.535528+0000","last_peered":"2023-08-25T05:37:25.535528+0000","last_clean":"2023-08-25T05:37:25.535528+0000","last_became_active":"2023-08-25T05:37:24.532738+0000","last_became_peered":"2023-08-25T05:37:24.532738+0000","last_unstale":"2023-08-25T05:37:25.535528+0000","last_undegraded":"2023-08-25T05:37:25.535528+0000","last_fullsized":"2023-08-25T05:37:25.535528+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:37:07.452993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535438+0000","last_change":"2023-08-25T05:37:24.556390+0000","last_active":"2023-08-25T05:37:25.535438+0000","last_peered":"2023-08-25T05:37:25.535438+0000","last_clean":"2023-08-25T05:37:25.535438+0000","last_became_active":"2023-08-25T05:37:24.556024+0000","last_became_peered":"2023-08-25T05:37:24.556024+0000","last_unstale":"2023-08-25T05:37:25.535438+0000","last_undegraded":"2023-08-25T05:37:25.535438+0000","last_fullsized":"2023-08-25T05:37:25.535438+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:57:51.562974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947080+0000","last_change":"2023-08-25T05:37:24.551353+0000","last_active":"2023-08-25T05:37:25.947080+0000","last_peered":"2023-08-25T05:37:25.947080+0000","last_clean":"2023-08-25T05:37:25.947080+0000","last_became_active":"2023-08-25T05:37:24.550781+0000","last_became_peered":"2023-08-25T05:37:24.550781+0000","last_unstale":"2023-08-25T05:37:25.947080+0000","last_undegraded":"2023-08-25T05:37:25.947080+0000","last_fullsized":"2023-08-25T05:37:25.947080+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:58.661092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946988+0000","last_change":"2023-08-25T05:37:24.554168+0000","last_active":"2023-08-25T05:37:25.946988+0000","last_peered":"2023-08-25T05:37:25.946988+0000","last_clean":"2023-08-25T05:37:25.946988+0000","last_became_active":"2023-08-25T05:37:24.552463+0000","last_became_peered":"2023-08-25T05:37:24.552463+0000","last_unstale":"2023-08-25T05:37:25.946988+0000","last_undegraded":"2023-08-25T05:37:25.946988+0000","last_fullsized":"2023-08-25T05:37:25.946988+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:14:34.953794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945755+0000","last_change":"2023-08-25T05:37:24.555483+0000","last_active":"2023-08-25T05:37:25.945755+0000","last_peered":"2023-08-25T05:37:25.945755+0000","last_clean":"2023-08-25T05:37:25.945755+0000","last_became_active":"2023-08-25T05:37:24.555033+0000","last_became_peered":"2023-08-25T05:37:24.555033+0000","last_unstale":"2023-08-25T05:37:25.945755+0000","last_undegraded":"2023-08-25T05:37:25.945755+0000","last_fullsized":"2023-08-25T05:37:25.945755+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:15:24.769439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946584+0000","last_change":"2023-08-25T05:37:24.559438+0000","last_active":"2023-08-25T05:37:25.946584+0000","last_peered":"2023-08-25T05:37:25.946584+0000","last_clean":"2023-08-25T05:37:25.946584+0000","last_became_active":"2023-08-25T05:37:24.559145+0000","last_became_peered":"2023-08-25T05:37:24.559145+0000","last_unstale":"2023-08-25T05:37:25.946584+0000","last_undegraded":"2023-08-25T05:37:25.946584+0000","last_fullsized":"2023-08-25T05:37:25.946584+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:00:18.745428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946405+0000","last_change":"2023-08-25T05:37:24.541944+0000","last_active":"2023-08-25T05:37:25.946405+0000","last_peered":"2023-08-25T05:37:25.946405+0000","last_clean":"2023-08-25T05:37:25.946405+0000","last_became_active":"2023-08-25T05:37:24.541431+0000","last_became_peered":"2023-08-25T05:37:24.541431+0000","last_unstale":"2023-08-25T05:37:25.946405+0000","last_undegraded":"2023-08-25T05:37:25.946405+0000","last_fullsized":"2023-08-25T05:37:25.946405+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:21:16.606470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946369+0000","last_change":"2023-08-25T05:37:24.553682+0000","last_active":"2023-08-25T05:37:25.946369+0000","last_peered":"2023-08-25T05:37:25.946369+0000","last_clean":"2023-08-25T05:37:25.946369+0000","last_became_active":"2023-08-25T05:37:24.553346+0000","last_became_peered":"2023-08-25T05:37:24.553346+0000","last_unstale":"2023-08-25T05:37:25.946369+0000","last_undegraded":"2023-08-25T05:37:25.946369+0000","last_fullsized":"2023-08-25T05:37:25.946369+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:02:51.650825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946048+0000","last_change":"2023-08-25T05:37:24.549328+0000","last_active":"2023-08-25T05:37:25.946048+0000","last_peered":"2023-08-25T05:37:25.946048+0000","last_clean":"2023-08-25T05:37:25.946048+0000","last_became_active":"2023-08-25T05:37:24.549039+0000","last_became_peered":"2023-08-25T05:37:24.549039+0000","last_unstale":"2023-08-25T05:37:25.946048+0000","last_undegraded":"2023-08-25T05:37:25.946048+0000","last_fullsized":"2023-08-25T05:37:25.946048+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:49:12.761722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535574+0000","last_change":"2023-08-25T05:37:24.546985+0000","last_active":"2023-08-25T05:37:25.535574+0000","last_peered":"2023-08-25T05:37:25.535574+0000","last_clean":"2023-08-25T05:37:25.535574+0000","last_became_active":"2023-08-25T05:37:24.546612+0000","last_became_peered":"2023-08-25T05:37:24.546612+0000","last_unstale":"2023-08-25T05:37:25.535574+0000","last_undegraded":"2023-08-25T05:37:25.535574+0000","last_fullsized":"2023-08-25T05:37:25.535574+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:48:59.505607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945696+0000","last_change":"2023-08-25T05:37:24.553008+0000","last_active":"2023-08-25T05:37:25.945696+0000","last_peered":"2023-08-25T05:37:25.945696+0000","last_clean":"2023-08-25T05:37:25.945696+0000","last_became_active":"2023-08-25T05:37:24.552707+0000","last_became_peered":"2023-08-25T05:37:24.552707+0000","last_unstale":"2023-08-25T05:37:25.945696+0000","last_undegraded":"2023-08-25T05:37:25.945696+0000","last_fullsized":"2023-08-25T05:37:25.945696+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:32:17.258659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945561+0000","last_change":"2023-08-25T05:37:24.550494+0000","last_active":"2023-08-25T05:37:25.945561+0000","last_peered":"2023-08-25T05:37:25.945561+0000","last_clean":"2023-08-25T05:37:25.945561+0000","last_became_active":"2023-08-25T05:37:24.550200+0000","last_became_peered":"2023-08-25T05:37:24.550200+0000","last_unstale":"2023-08-25T05:37:25.945561+0000","last_undegraded":"2023-08-25T05:37:25.945561+0000","last_fullsized":"2023-08-25T05:37:25.945561+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:42:44.478485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945711+0000","last_change":"2023-08-25T05:37:24.553860+0000","last_active":"2023-08-25T05:37:25.945711+0000","last_peered":"2023-08-25T05:37:25.945711+0000","last_clean":"2023-08-25T05:37:25.945711+0000","last_became_active":"2023-08-25T05:37:24.553548+0000","last_became_peered":"2023-08-25T05:37:24.553548+0000","last_unstale":"2023-08-25T05:37:25.945711+0000","last_undegraded":"2023-08-25T05:37:25.945711+0000","last_fullsized":"2023-08-25T05:37:25.945711+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:51.067437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535197+0000","last_change":"2023-08-25T05:37:24.545544+0000","last_active":"2023-08-25T05:37:25.535197+0000","last_peered":"2023-08-25T05:37:25.535197+0000","last_clean":"2023-08-25T05:37:25.535197+0000","last_became_active":"2023-08-25T05:37:24.545268+0000","last_became_peered":"2023-08-25T05:37:24.545268+0000","last_unstale":"2023-08-25T05:37:25.535197+0000","last_undegraded":"2023-08-25T05:37:25.535197+0000","last_fullsized":"2023-08-25T05:37:25.535197+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:57:38.266164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946446+0000","last_change":"2023-08-25T05:37:24.547757+0000","last_active":"2023-08-25T05:37:25.946446+0000","last_peered":"2023-08-25T05:37:25.946446+0000","last_clean":"2023-08-25T05:37:25.946446+0000","last_became_active":"2023-08-25T05:37:24.546529+0000","last_became_peered":"2023-08-25T05:37:24.546529+0000","last_unstale":"2023-08-25T05:37:25.946446+0000","last_undegraded":"2023-08-25T05:37:25.946446+0000","last_fullsized":"2023-08-25T05:37:25.946446+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:49:03.907963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535924+0000","last_change":"2023-08-25T05:37:23.547915+0000","last_active":"2023-08-25T05:37:25.535924+0000","last_peered":"2023-08-25T05:37:25.535924+0000","last_clean":"2023-08-25T05:37:25.535924+0000","last_became_active":"2023-08-25T05:37:23.547587+0000","last_became_peered":"2023-08-25T05:37:23.547587+0000","last_unstale":"2023-08-25T05:37:25.535924+0000","last_undegraded":"2023-08-25T05:37:25.535924+0000","last_fullsized":"2023-08-25T05:37:25.535924+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:00.481841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535833+0000","last_change":"2023-08-25T05:37:24.541483+0000","last_active":"2023-08-25T05:37:25.535833+0000","last_peered":"2023-08-25T05:37:25.535833+0000","last_clean":"2023-08-25T05:37:25.535833+0000","last_became_active":"2023-08-25T05:37:24.541119+0000","last_became_peered":"2023-08-25T05:37:24.541119+0000","last_unstale":"2023-08-25T05:37:25.535833+0000","last_undegraded":"2023-08-25T05:37:25.535833+0000","last_fullsized":"2023-08-25T05:37:25.535833+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:49:16.515630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947179+0000","last_change":"2023-08-25T05:37:23.536250+0000","last_active":"2023-08-25T05:37:25.947179+0000","last_peered":"2023-08-25T05:37:25.947179+0000","last_clean":"2023-08-25T05:37:25.947179+0000","last_became_active":"2023-08-25T05:37:23.535955+0000","last_became_peered":"2023-08-25T05:37:23.535955+0000","last_unstale":"2023-08-25T05:37:25.947179+0000","last_undegraded":"2023-08-25T05:37:25.947179+0000","last_fullsized":"2023-08-25T05:37:25.947179+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:50:29.397169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.536185+0000","last_change":"2023-08-25T05:37:24.541685+0000","last_active":"2023-08-25T05:37:25.536185+0000","last_peered":"2023-08-25T05:37:25.536185+0000","last_clean":"2023-08-25T05:37:25.536185+0000","last_became_active":"2023-08-25T05:37:24.541377+0000","last_became_peered":"2023-08-25T05:37:24.541377+0000","last_unstale":"2023-08-25T05:37:25.536185+0000","last_undegraded":"2023-08-25T05:37:25.536185+0000","last_fullsized":"2023-08-25T05:37:25.536185+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:44:54.540661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"201'3","reported_seq":16,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945901+0000","last_change":"2023-08-25T05:37:23.548267+0000","last_active":"2023-08-25T05:37:25.945901+0000","last_peered":"2023-08-25T05:37:25.945901+0000","last_clean":"2023-08-25T05:37:25.945901+0000","last_became_active":"2023-08-25T05:37:23.547980+0000","last_became_peered":"2023-08-25T05:37:23.547980+0000","last_unstale":"2023-08-25T05:37:25.945901+0000","last_undegraded":"2023-08-25T05:37:25.945901+0000","last_fullsized":"2023-08-25T05:37:25.945901+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:27:46.810103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947163+0000","last_change":"2023-08-25T05:37:24.552195+0000","last_active":"2023-08-25T05:37:25.947163+0000","last_peered":"2023-08-25T05:37:25.947163+0000","last_clean":"2023-08-25T05:37:25.947163+0000","last_became_active":"2023-08-25T05:37:24.549006+0000","last_became_peered":"2023-08-25T05:37:24.549006+0000","last_unstale":"2023-08-25T05:37:25.947163+0000","last_undegraded":"2023-08-25T05:37:25.947163+0000","last_fullsized":"2023-08-25T05:37:25.947163+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:24:14.831092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"201'6","reported_seq":19,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535248+0000","last_change":"2023-08-25T05:37:23.538204+0000","last_active":"2023-08-25T05:37:25.535248+0000","last_peered":"2023-08-25T05:37:25.535248+0000","last_clean":"2023-08-25T05:37:25.535248+0000","last_became_active":"2023-08-25T05:37:23.537792+0000","last_became_peered":"2023-08-25T05:37:23.537792+0000","last_unstale":"2023-08-25T05:37:25.535248+0000","last_undegraded":"2023-08-25T05:37:25.535248+0000","last_fullsized":"2023-08-25T05:37:25.535248+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:27:36.351358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945730+0000","last_change":"2023-08-25T05:37:24.556730+0000","last_active":"2023-08-25T05:37:25.945730+0000","last_peered":"2023-08-25T05:37:25.945730+0000","last_clean":"2023-08-25T05:37:25.945730+0000","last_became_active":"2023-08-25T05:37:24.556341+0000","last_became_peered":"2023-08-25T05:37:24.556341+0000","last_unstale":"2023-08-25T05:37:25.945730+0000","last_undegraded":"2023-08-25T05:37:25.945730+0000","last_fullsized":"2023-08-25T05:37:25.945730+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:25:16.614521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"201'2","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534859+0000","last_change":"2023-08-25T05:37:23.548985+0000","last_active":"2023-08-25T05:37:25.534859+0000","last_peered":"2023-08-25T05:37:25.534859+0000","last_clean":"2023-08-25T05:37:25.534859+0000","last_became_active":"2023-08-25T05:37:23.548687+0000","last_became_peered":"2023-08-25T05:37:23.548687+0000","last_unstale":"2023-08-25T05:37:25.534859+0000","last_undegraded":"2023-08-25T05:37:25.534859+0000","last_fullsized":"2023-08-25T05:37:25.534859+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:04:42.060140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535148+0000","last_change":"2023-08-25T05:37:24.546752+0000","last_active":"2023-08-25T05:37:25.535148+0000","last_peered":"2023-08-25T05:37:25.535148+0000","last_clean":"2023-08-25T05:37:25.535148+0000","last_became_active":"2023-08-25T05:37:24.546439+0000","last_became_peered":"2023-08-25T05:37:24.546439+0000","last_unstale":"2023-08-25T05:37:25.535148+0000","last_undegraded":"2023-08-25T05:37:25.535148+0000","last_fullsized":"2023-08-25T05:37:25.535148+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:31:19.135726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947189+0000","last_change":"2023-08-25T05:37:23.549604+0000","last_active":"2023-08-25T05:37:25.947189+0000","last_peered":"2023-08-25T05:37:25.947189+0000","last_clean":"2023-08-25T05:37:25.947189+0000","last_became_active":"2023-08-25T05:37:23.549308+0000","last_became_peered":"2023-08-25T05:37:23.549308+0000","last_unstale":"2023-08-25T05:37:25.947189+0000","last_undegraded":"2023-08-25T05:37:25.947189+0000","last_fullsized":"2023-08-25T05:37:25.947189+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:06:03.095644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534915+0000","last_change":"2023-08-25T05:37:24.542958+0000","last_active":"2023-08-25T05:37:25.534915+0000","last_peered":"2023-08-25T05:37:25.534915+0000","last_clean":"2023-08-25T05:37:25.534915+0000","last_became_active":"2023-08-25T05:37:24.542607+0000","last_became_peered":"2023-08-25T05:37:24.542607+0000","last_unstale":"2023-08-25T05:37:25.534915+0000","last_undegraded":"2023-08-25T05:37:25.534915+0000","last_fullsized":"2023-08-25T05:37:25.534915+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:25:09.219567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945619+0000","last_change":"2023-08-25T05:37:23.541331+0000","last_active":"2023-08-25T05:37:25.945619+0000","last_peered":"2023-08-25T05:37:25.945619+0000","last_clean":"2023-08-25T05:37:25.945619+0000","last_became_active":"2023-08-25T05:37:23.541030+0000","last_became_peered":"2023-08-25T05:37:23.541030+0000","last_unstale":"2023-08-25T05:37:25.945619+0000","last_undegraded":"2023-08-25T05:37:25.945619+0000","last_fullsized":"2023-08-25T05:37:25.945619+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:55:58.500515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534831+0000","last_change":"2023-08-25T05:37:24.548890+0000","last_active":"2023-08-25T05:37:25.534831+0000","last_peered":"2023-08-25T05:37:25.534831+0000","last_clean":"2023-08-25T05:37:25.534831+0000","last_became_active":"2023-08-25T05:37:24.548602+0000","last_became_peered":"2023-08-25T05:37:24.548602+0000","last_unstale":"2023-08-25T05:37:25.534831+0000","last_undegraded":"2023-08-25T05:37:25.534831+0000","last_fullsized":"2023-08-25T05:37:25.534831+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:59:37.441946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"201'8","reported_seq":21,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945446+0000","last_change":"2023-08-25T05:37:23.547927+0000","last_active":"2023-08-25T05:37:25.945446+0000","last_peered":"2023-08-25T05:37:25.945446+0000","last_clean":"2023-08-25T05:37:25.945446+0000","last_became_active":"2023-08-25T05:37:23.547702+0000","last_became_peered":"2023-08-25T05:37:23.547702+0000","last_unstale":"2023-08-25T05:37:25.945446+0000","last_undegraded":"2023-08-25T05:37:25.945446+0000","last_fullsized":"2023-08-25T05:37:25.945446+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:06.549399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945911+0000","last_change":"2023-08-25T05:37:24.552074+0000","last_active":"2023-08-25T05:37:25.945911+0000","last_peered":"2023-08-25T05:37:25.945911+0000","last_clean":"2023-08-25T05:37:25.945911+0000","last_became_active":"2023-08-25T05:37:24.551757+0000","last_became_peered":"2023-08-25T05:37:24.551757+0000","last_unstale":"2023-08-25T05:37:25.945911+0000","last_undegraded":"2023-08-25T05:37:25.945911+0000","last_fullsized":"2023-08-25T05:37:25.945911+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:48:42.020311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"201'1","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946658+0000","last_change":"2023-08-25T05:37:23.546252+0000","last_active":"2023-08-25T05:37:25.946658+0000","last_peered":"2023-08-25T05:37:25.946658+0000","last_clean":"2023-08-25T05:37:25.946658+0000","last_became_active":"2023-08-25T05:37:23.545932+0000","last_became_peered":"2023-08-25T05:37:23.545932+0000","last_unstale":"2023-08-25T05:37:25.946658+0000","last_undegraded":"2023-08-25T05:37:25.946658+0000","last_fullsized":"2023-08-25T05:37:25.946658+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:39:45.038273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535626+0000","last_change":"2023-08-25T05:37:24.543501+0000","last_active":"2023-08-25T05:37:25.535626+0000","last_peered":"2023-08-25T05:37:25.535626+0000","last_clean":"2023-08-25T05:37:25.535626+0000","last_became_active":"2023-08-25T05:37:24.543196+0000","last_became_peered":"2023-08-25T05:37:24.543196+0000","last_unstale":"2023-08-25T05:37:25.535626+0000","last_undegraded":"2023-08-25T05:37:25.535626+0000","last_fullsized":"2023-08-25T05:37:25.535626+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:21:46.850100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"201'2","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946117+0000","last_change":"2023-08-25T05:37:23.548811+0000","last_active":"2023-08-25T05:37:25.946117+0000","last_peered":"2023-08-25T05:37:25.946117+0000","last_clean":"2023-08-25T05:37:25.946117+0000","last_became_active":"2023-08-25T05:37:23.548482+0000","last_became_peered":"2023-08-25T05:37:23.548482+0000","last_unstale":"2023-08-25T05:37:25.946117+0000","last_undegraded":"2023-08-25T05:37:25.946117+0000","last_fullsized":"2023-08-25T05:37:25.946117+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:38:58.552530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946575+0000","last_change":"2023-08-25T05:37:24.553658+0000","last_active":"2023-08-25T05:37:25.946575+0000","last_peered":"2023-08-25T05:37:25.946575+0000","last_clean":"2023-08-25T05:37:25.946575+0000","last_became_active":"2023-08-25T05:37:24.552951+0000","last_became_peered":"2023-08-25T05:37:24.552951+0000","last_unstale":"2023-08-25T05:37:25.946575+0000","last_undegraded":"2023-08-25T05:37:25.946575+0000","last_fullsized":"2023-08-25T05:37:25.946575+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:23:29.974261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"201'1","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.536130+0000","last_change":"2023-08-25T05:37:23.537881+0000","last_active":"2023-08-25T05:37:25.536130+0000","last_peered":"2023-08-25T05:37:25.536130+0000","last_clean":"2023-08-25T05:37:25.536130+0000","last_became_active":"2023-08-25T05:37:23.537336+0000","last_became_peered":"2023-08-25T05:37:23.537336+0000","last_unstale":"2023-08-25T05:37:25.536130+0000","last_undegraded":"2023-08-25T05:37:25.536130+0000","last_fullsized":"2023-08-25T05:37:25.536130+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:39:50.643839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947197+0000","last_change":"2023-08-25T05:37:24.554823+0000","last_active":"2023-08-25T05:37:25.947197+0000","last_peered":"2023-08-25T05:37:25.947197+0000","last_clean":"2023-08-25T05:37:25.947197+0000","last_became_active":"2023-08-25T05:37:24.554515+0000","last_became_peered":"2023-08-25T05:37:24.554515+0000","last_unstale":"2023-08-25T05:37:25.947197+0000","last_undegraded":"2023-08-25T05:37:25.947197+0000","last_fullsized":"2023-08-25T05:37:25.947197+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:53:07.229342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945988+0000","last_change":"2023-08-25T05:37:23.539762+0000","last_active":"2023-08-25T05:37:25.945988+0000","last_peered":"2023-08-25T05:37:25.945988+0000","last_clean":"2023-08-25T05:37:25.945988+0000","last_became_active":"2023-08-25T05:37:23.539481+0000","last_became_peered":"2023-08-25T05:37:23.539481+0000","last_unstale":"2023-08-25T05:37:25.945988+0000","last_undegraded":"2023-08-25T05:37:25.945988+0000","last_fullsized":"2023-08-25T05:37:25.945988+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:00:44.311947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946660+0000","last_change":"2023-08-25T05:37:24.554762+0000","last_active":"2023-08-25T05:37:25.946660+0000","last_peered":"2023-08-25T05:37:25.946660+0000","last_clean":"2023-08-25T05:37:25.946660+0000","last_became_active":"2023-08-25T05:37:24.554485+0000","last_became_peered":"2023-08-25T05:37:24.554485+0000","last_unstale":"2023-08-25T05:37:25.946660+0000","last_undegraded":"2023-08-25T05:37:25.946660+0000","last_fullsized":"2023-08-25T05:37:25.946660+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:18:54.928517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"201'2","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534974+0000","last_change":"2023-08-25T05:37:23.541541+0000","last_active":"2023-08-25T05:37:25.534974+0000","last_peered":"2023-08-25T05:37:25.534974+0000","last_clean":"2023-08-25T05:37:25.534974+0000","last_became_active":"2023-08-25T05:37:23.540976+0000","last_became_peered":"2023-08-25T05:37:23.540976+0000","last_unstale":"2023-08-25T05:37:25.534974+0000","last_undegraded":"2023-08-25T05:37:25.534974+0000","last_fullsized":"2023-08-25T05:37:25.534974+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:46:36.155036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945530+0000","last_change":"2023-08-25T05:37:24.545173+0000","last_active":"2023-08-25T05:37:25.945530+0000","last_peered":"2023-08-25T05:37:25.945530+0000","last_clean":"2023-08-25T05:37:25.945530+0000","last_became_active":"2023-08-25T05:37:24.544902+0000","last_became_peered":"2023-08-25T05:37:24.544902+0000","last_unstale":"2023-08-25T05:37:25.945530+0000","last_undegraded":"2023-08-25T05:37:25.945530+0000","last_fullsized":"2023-08-25T05:37:25.945530+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:39:55.790643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946159+0000","last_change":"2023-08-25T05:37:23.542964+0000","last_active":"2023-08-25T05:37:25.946159+0000","last_peered":"2023-08-25T05:37:25.946159+0000","last_clean":"2023-08-25T05:37:25.946159+0000","last_became_active":"2023-08-25T05:37:23.542633+0000","last_became_peered":"2023-08-25T05:37:23.542633+0000","last_unstale":"2023-08-25T05:37:25.946159+0000","last_undegraded":"2023-08-25T05:37:25.946159+0000","last_fullsized":"2023-08-25T05:37:25.946159+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:17:16.343159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945930+0000","last_change":"2023-08-25T05:37:24.547086+0000","last_active":"2023-08-25T05:37:25.945930+0000","last_peered":"2023-08-25T05:37:25.945930+0000","last_clean":"2023-08-25T05:37:25.945930+0000","last_became_active":"2023-08-25T05:37:24.546792+0000","last_became_peered":"2023-08-25T05:37:24.546792+0000","last_unstale":"2023-08-25T05:37:25.945930+0000","last_undegraded":"2023-08-25T05:37:25.945930+0000","last_fullsized":"2023-08-25T05:37:25.945930+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:59:11.190834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945918+0000","last_change":"2023-08-25T05:37:23.544805+0000","last_active":"2023-08-25T05:37:25.945918+0000","last_peered":"2023-08-25T05:37:25.945918+0000","last_clean":"2023-08-25T05:37:25.945918+0000","last_became_active":"2023-08-25T05:37:23.543947+0000","last_became_peered":"2023-08-25T05:37:23.543947+0000","last_unstale":"2023-08-25T05:37:25.945918+0000","last_undegraded":"2023-08-25T05:37:25.945918+0000","last_fullsized":"2023-08-25T05:37:25.945918+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:48:34.380051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535332+0000","last_change":"2023-08-25T05:37:24.546431+0000","last_active":"2023-08-25T05:37:25.535332+0000","last_peered":"2023-08-25T05:37:25.535332+0000","last_clean":"2023-08-25T05:37:25.535332+0000","last_became_active":"2023-08-25T05:37:24.545627+0000","last_became_peered":"2023-08-25T05:37:24.545627+0000","last_unstale":"2023-08-25T05:37:25.535332+0000","last_undegraded":"2023-08-25T05:37:25.535332+0000","last_fullsized":"2023-08-25T05:37:25.535332+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:26:02.366734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535593+0000","last_change":"2023-08-25T05:37:23.534208+0000","last_active":"2023-08-25T05:37:25.535593+0000","last_peered":"2023-08-25T05:37:25.535593+0000","last_clean":"2023-08-25T05:37:25.535593+0000","last_became_active":"2023-08-25T05:37:23.533909+0000","last_became_peered":"2023-08-25T05:37:23.533909+0000","last_unstale":"2023-08-25T05:37:25.535593+0000","last_undegraded":"2023-08-25T05:37:25.535593+0000","last_fullsized":"2023-08-25T05:37:25.535593+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:21:30.377787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946049+0000","last_change":"2023-08-25T05:37:24.542966+0000","last_active":"2023-08-25T05:37:25.946049+0000","last_peered":"2023-08-25T05:37:25.946049+0000","last_clean":"2023-08-25T05:37:25.946049+0000","last_became_active":"2023-08-25T05:37:24.542653+0000","last_became_peered":"2023-08-25T05:37:24.542653+0000","last_unstale":"2023-08-25T05:37:25.946049+0000","last_undegraded":"2023-08-25T05:37:25.946049+0000","last_fullsized":"2023-08-25T05:37:25.946049+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:30.878640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"201'2","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946363+0000","last_change":"2023-08-25T05:37:23.545045+0000","last_active":"2023-08-25T05:37:25.946363+0000","last_peered":"2023-08-25T05:37:25.946363+0000","last_clean":"2023-08-25T05:37:25.946363+0000","last_became_active":"2023-08-25T05:37:23.544775+0000","last_became_peered":"2023-08-25T05:37:23.544775+0000","last_unstale":"2023-08-25T05:37:25.946363+0000","last_undegraded":"2023-08-25T05:37:25.946363+0000","last_fullsized":"2023-08-25T05:37:25.946363+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:19:29.581252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947238+0000","last_change":"2023-08-25T05:37:24.553584+0000","last_active":"2023-08-25T05:37:25.947238+0000","last_peered":"2023-08-25T05:37:25.947238+0000","last_clean":"2023-08-25T05:37:25.947238+0000","last_became_active":"2023-08-25T05:37:24.552603+0000","last_became_peered":"2023-08-25T05:37:24.552603+0000","last_unstale":"2023-08-25T05:37:25.947238+0000","last_undegraded":"2023-08-25T05:37:25.947238+0000","last_fullsized":"2023-08-25T05:37:25.947238+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:13:14.044256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946133+0000","last_change":"2023-08-25T05:37:23.544372+0000","last_active":"2023-08-25T05:37:25.946133+0000","last_peered":"2023-08-25T05:37:25.946133+0000","last_clean":"2023-08-25T05:37:25.946133+0000","last_became_active":"2023-08-25T05:37:23.543939+0000","last_became_peered":"2023-08-25T05:37:23.543939+0000","last_unstale":"2023-08-25T05:37:25.946133+0000","last_undegraded":"2023-08-25T05:37:25.946133+0000","last_fullsized":"2023-08-25T05:37:25.946133+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:16.893751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946120+0000","last_change":"2023-08-25T05:37:24.545017+0000","last_active":"2023-08-25T05:37:25.946120+0000","last_peered":"2023-08-25T05:37:25.946120+0000","last_clean":"2023-08-25T05:37:25.946120+0000","last_became_active":"2023-08-25T05:37:24.544711+0000","last_became_peered":"2023-08-25T05:37:24.544711+0000","last_unstale":"2023-08-25T05:37:25.946120+0000","last_undegraded":"2023-08-25T05:37:25.946120+0000","last_fullsized":"2023-08-25T05:37:25.946120+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:52:58.754758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535844+0000","last_change":"2023-08-25T05:37:23.538786+0000","last_active":"2023-08-25T05:37:25.535844+0000","last_peered":"2023-08-25T05:37:25.535844+0000","last_clean":"2023-08-25T05:37:25.535844+0000","last_became_active":"2023-08-25T05:37:23.538507+0000","last_became_peered":"2023-08-25T05:37:23.538507+0000","last_unstale":"2023-08-25T05:37:25.535844+0000","last_undegraded":"2023-08-25T05:37:25.535844+0000","last_fullsized":"2023-08-25T05:37:25.535844+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:37.306930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946527+0000","last_change":"2023-08-25T05:37:24.541718+0000","last_active":"2023-08-25T05:37:25.946527+0000","last_peered":"2023-08-25T05:37:25.946527+0000","last_clean":"2023-08-25T05:37:25.946527+0000","last_became_active":"2023-08-25T05:37:24.541001+0000","last_became_peered":"2023-08-25T05:37:24.541001+0000","last_unstale":"2023-08-25T05:37:25.946527+0000","last_undegraded":"2023-08-25T05:37:25.946527+0000","last_fullsized":"2023-08-25T05:37:25.946527+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:51:00.799593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535651+0000","last_change":"2023-08-25T05:37:23.543861+0000","last_active":"2023-08-25T05:37:25.535651+0000","last_peered":"2023-08-25T05:37:25.535651+0000","last_clean":"2023-08-25T05:37:25.535651+0000","last_became_active":"2023-08-25T05:37:23.543553+0000","last_became_peered":"2023-08-25T05:37:23.543553+0000","last_unstale":"2023-08-25T05:37:25.535651+0000","last_undegraded":"2023-08-25T05:37:25.535651+0000","last_fullsized":"2023-08-25T05:37:25.535651+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:16:41.083760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535494+0000","last_change":"2023-08-25T05:37:24.542295+0000","last_active":"2023-08-25T05:37:25.535494+0000","last_peered":"2023-08-25T05:37:25.535494+0000","last_clean":"2023-08-25T05:37:25.535494+0000","last_became_active":"2023-08-25T05:37:24.541954+0000","last_became_peered":"2023-08-25T05:37:24.541954+0000","last_unstale":"2023-08-25T05:37:25.535494+0000","last_undegraded":"2023-08-25T05:37:25.535494+0000","last_fullsized":"2023-08-25T05:37:25.535494+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:39:29.777580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946028+0000","last_change":"2023-08-25T05:37:23.538266+0000","last_active":"2023-08-25T05:37:25.946028+0000","last_peered":"2023-08-25T05:37:25.946028+0000","last_clean":"2023-08-25T05:37:25.946028+0000","last_became_active":"2023-08-25T05:37:23.537926+0000","last_became_peered":"2023-08-25T05:37:23.537926+0000","last_unstale":"2023-08-25T05:37:25.946028+0000","last_undegraded":"2023-08-25T05:37:25.946028+0000","last_fullsized":"2023-08-25T05:37:25.946028+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:23:16.862189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534754+0000","last_change":"2023-08-25T05:37:24.534975+0000","last_active":"2023-08-25T05:37:25.534754+0000","last_peered":"2023-08-25T05:37:25.534754+0000","last_clean":"2023-08-25T05:37:25.534754+0000","last_became_active":"2023-08-25T05:37:24.532274+0000","last_became_peered":"2023-08-25T05:37:24.532274+0000","last_unstale":"2023-08-25T05:37:25.534754+0000","last_undegraded":"2023-08-25T05:37:25.534754+0000","last_fullsized":"2023-08-25T05:37:25.534754+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:59:23.180394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945680+0000","last_change":"2023-08-25T05:37:23.540495+0000","last_active":"2023-08-25T05:37:25.945680+0000","last_peered":"2023-08-25T05:37:25.945680+0000","last_clean":"2023-08-25T05:37:25.945680+0000","last_became_active":"2023-08-25T05:37:23.540219+0000","last_became_peered":"2023-08-25T05:37:23.540219+0000","last_unstale":"2023-08-25T05:37:25.945680+0000","last_undegraded":"2023-08-25T05:37:25.945680+0000","last_fullsized":"2023-08-25T05:37:25.945680+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:03:56.780044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947065+0000","last_change":"2023-08-25T05:37:24.557494+0000","last_active":"2023-08-25T05:37:25.947065+0000","last_peered":"2023-08-25T05:37:25.947065+0000","last_clean":"2023-08-25T05:37:25.947065+0000","last_became_active":"2023-08-25T05:37:24.555335+0000","last_became_peered":"2023-08-25T05:37:24.555335+0000","last_unstale":"2023-08-25T05:37:25.947065+0000","last_undegraded":"2023-08-25T05:37:25.947065+0000","last_fullsized":"2023-08-25T05:37:25.947065+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:24:11.216210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945773+0000","last_change":"2023-08-25T05:37:23.539559+0000","last_active":"2023-08-25T05:37:25.945773+0000","last_peered":"2023-08-25T05:37:25.945773+0000","last_clean":"2023-08-25T05:37:25.945773+0000","last_became_active":"2023-08-25T05:37:23.539274+0000","last_became_peered":"2023-08-25T05:37:23.539274+0000","last_unstale":"2023-08-25T05:37:25.945773+0000","last_undegraded":"2023-08-25T05:37:25.945773+0000","last_fullsized":"2023-08-25T05:37:25.945773+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:07:52.604161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945927+0000","last_change":"2023-08-25T05:37:24.553628+0000","last_active":"2023-08-25T05:37:25.945927+0000","last_peered":"2023-08-25T05:37:25.945927+0000","last_clean":"2023-08-25T05:37:25.945927+0000","last_became_active":"2023-08-25T05:37:24.553348+0000","last_became_peered":"2023-08-25T05:37:24.553348+0000","last_unstale":"2023-08-25T05:37:25.945927+0000","last_undegraded":"2023-08-25T05:37:25.945927+0000","last_fullsized":"2023-08-25T05:37:25.945927+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:32:16.659695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535724+0000","last_change":"2023-08-25T05:37:23.539963+0000","last_active":"2023-08-25T05:37:25.535724+0000","last_peered":"2023-08-25T05:37:25.535724+0000","last_clean":"2023-08-25T05:37:25.535724+0000","last_became_active":"2023-08-25T05:37:23.539671+0000","last_became_peered":"2023-08-25T05:37:23.539671+0000","last_unstale":"2023-08-25T05:37:25.535724+0000","last_undegraded":"2023-08-25T05:37:25.535724+0000","last_fullsized":"2023-08-25T05:37:25.535724+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:02:54.269091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535936+0000","last_change":"2023-08-25T05:37:24.540958+0000","last_active":"2023-08-25T05:37:25.535936+0000","last_peered":"2023-08-25T05:37:25.535936+0000","last_clean":"2023-08-25T05:37:25.535936+0000","last_became_active":"2023-08-25T05:37:24.539077+0000","last_became_peered":"2023-08-25T05:37:24.539077+0000","last_unstale":"2023-08-25T05:37:25.535936+0000","last_undegraded":"2023-08-25T05:37:25.535936+0000","last_fullsized":"2023-08-25T05:37:25.535936+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:22:31.241833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945498+0000","last_change":"2023-08-25T05:37:23.545056+0000","last_active":"2023-08-25T05:37:25.945498+0000","last_peered":"2023-08-25T05:37:25.945498+0000","last_clean":"2023-08-25T05:37:25.945498+0000","last_became_active":"2023-08-25T05:37:23.544817+0000","last_became_peered":"2023-08-25T05:37:23.544817+0000","last_unstale":"2023-08-25T05:37:25.945498+0000","last_undegraded":"2023-08-25T05:37:25.945498+0000","last_fullsized":"2023-08-25T05:37:25.945498+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:56:49.193533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"191'3653","reported_seq":4647,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946353+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:37:25.946353+0000","last_peered":"2023-08-25T05:37:25.946353+0000","last_clean":"2023-08-25T05:37:25.946353+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:37:25.946353+0000","last_undegraded":"2023-08-25T05:37:25.946353+0000","last_fullsized":"2023-08-25T05:37:25.946353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3653,"log_dups_size":0,"ondisk_log_size":3653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:07:43.317595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2096,"num_read_kb":4403,"num_write":565,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":360,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945672+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:37:25.945672+0000","last_peered":"2023-08-25T05:37:25.945672+0000","last_clean":"2023-08-25T05:37:25.945672+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:37:25.945672+0000","last_undegraded":"2023-08-25T05:37:25.945672+0000","last_fullsized":"2023-08-25T05:37:25.945672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:20:26.158476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534798+0000","last_change":"2023-08-25T05:37:24.542467+0000","last_active":"2023-08-25T05:37:25.534798+0000","last_peered":"2023-08-25T05:37:25.534798+0000","last_clean":"2023-08-25T05:37:25.534798+0000","last_became_active":"2023-08-25T05:37:24.542059+0000","last_became_peered":"2023-08-25T05:37:24.542059+0000","last_unstale":"2023-08-25T05:37:25.534798+0000","last_undegraded":"2023-08-25T05:37:25.534798+0000","last_fullsized":"2023-08-25T05:37:25.534798+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:20:35.194400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"201'1","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535425+0000","last_change":"2023-08-25T05:37:23.540887+0000","last_active":"2023-08-25T05:37:25.535425+0000","last_peered":"2023-08-25T05:37:25.535425+0000","last_clean":"2023-08-25T05:37:25.535425+0000","last_became_active":"2023-08-25T05:37:23.540612+0000","last_became_peered":"2023-08-25T05:37:23.540612+0000","last_unstale":"2023-08-25T05:37:25.535425+0000","last_undegraded":"2023-08-25T05:37:25.535425+0000","last_fullsized":"2023-08-25T05:37:25.535425+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:25:21.656718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":351,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946256+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:37:25.946256+0000","last_peered":"2023-08-25T05:37:25.946256+0000","last_clean":"2023-08-25T05:37:25.946256+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:37:25.946256+0000","last_undegraded":"2023-08-25T05:37:25.946256+0000","last_fullsized":"2023-08-25T05:37:25.946256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:37:35.236035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946896+0000","last_change":"2023-08-25T05:37:24.550171+0000","last_active":"2023-08-25T05:37:25.946896+0000","last_peered":"2023-08-25T05:37:25.946896+0000","last_clean":"2023-08-25T05:37:25.946896+0000","last_became_active":"2023-08-25T05:37:24.548942+0000","last_became_peered":"2023-08-25T05:37:24.548942+0000","last_unstale":"2023-08-25T05:37:25.946896+0000","last_undegraded":"2023-08-25T05:37:25.946896+0000","last_fullsized":"2023-08-25T05:37:25.946896+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:21:55.876731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"201'1","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946034+0000","last_change":"2023-08-25T05:37:23.548551+0000","last_active":"2023-08-25T05:37:25.946034+0000","last_peered":"2023-08-25T05:37:25.946034+0000","last_clean":"2023-08-25T05:37:25.946034+0000","last_became_active":"2023-08-25T05:37:23.548254+0000","last_became_peered":"2023-08-25T05:37:23.548254+0000","last_unstale":"2023-08-25T05:37:25.946034+0000","last_undegraded":"2023-08-25T05:37:25.946034+0000","last_fullsized":"2023-08-25T05:37:25.946034+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:10:03.239783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":360,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946039+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:37:25.946039+0000","last_peered":"2023-08-25T05:37:25.946039+0000","last_clean":"2023-08-25T05:37:25.946039+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:37:25.946039+0000","last_undegraded":"2023-08-25T05:37:25.946039+0000","last_fullsized":"2023-08-25T05:37:25.946039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:41:11.257962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947341+0000","last_change":"2023-08-25T05:37:24.548621+0000","last_active":"2023-08-25T05:37:25.947341+0000","last_peered":"2023-08-25T05:37:25.947341+0000","last_clean":"2023-08-25T05:37:25.947341+0000","last_became_active":"2023-08-25T05:37:24.548234+0000","last_became_peered":"2023-08-25T05:37:24.548234+0000","last_unstale":"2023-08-25T05:37:25.947341+0000","last_undegraded":"2023-08-25T05:37:25.947341+0000","last_fullsized":"2023-08-25T05:37:25.947341+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:37:00.408184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534798+0000","last_change":"2023-08-25T05:37:23.535156+0000","last_active":"2023-08-25T05:37:25.534798+0000","last_peered":"2023-08-25T05:37:25.534798+0000","last_clean":"2023-08-25T05:37:25.534798+0000","last_became_active":"2023-08-25T05:37:23.534879+0000","last_became_peered":"2023-08-25T05:37:23.534879+0000","last_unstale":"2023-08-25T05:37:25.534798+0000","last_undegraded":"2023-08-25T05:37:25.534798+0000","last_fullsized":"2023-08-25T05:37:25.534798+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:01:28.425270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":360,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945826+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:37:25.945826+0000","last_peered":"2023-08-25T05:37:25.945826+0000","last_clean":"2023-08-25T05:37:25.945826+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:37:25.945826+0000","last_undegraded":"2023-08-25T05:37:25.945826+0000","last_fullsized":"2023-08-25T05:37:25.945826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:22:48.193179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946355+0000","last_change":"2023-08-25T05:37:24.544922+0000","last_active":"2023-08-25T05:37:25.946355+0000","last_peered":"2023-08-25T05:37:25.946355+0000","last_clean":"2023-08-25T05:37:25.946355+0000","last_became_active":"2023-08-25T05:37:24.544633+0000","last_became_peered":"2023-08-25T05:37:24.544633+0000","last_unstale":"2023-08-25T05:37:25.946355+0000","last_undegraded":"2023-08-25T05:37:25.946355+0000","last_fullsized":"2023-08-25T05:37:25.946355+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:46:30.308620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"201'4","reported_seq":17,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946273+0000","last_change":"2023-08-25T05:37:23.545829+0000","last_active":"2023-08-25T05:37:25.946273+0000","last_peered":"2023-08-25T05:37:25.946273+0000","last_clean":"2023-08-25T05:37:25.946273+0000","last_became_active":"2023-08-25T05:37:23.545567+0000","last_became_peered":"2023-08-25T05:37:23.545567+0000","last_unstale":"2023-08-25T05:37:25.946273+0000","last_undegraded":"2023-08-25T05:37:25.946273+0000","last_fullsized":"2023-08-25T05:37:25.946273+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:53:54.916939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":390,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946952+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:37:25.946952+0000","last_peered":"2023-08-25T05:37:25.946952+0000","last_clean":"2023-08-25T05:37:25.946952+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:37:25.946952+0000","last_undegraded":"2023-08-25T05:37:25.946952+0000","last_fullsized":"2023-08-25T05:37:25.946952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:27:24.654491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946312+0000","last_change":"2023-08-25T05:37:24.548353+0000","last_active":"2023-08-25T05:37:25.946312+0000","last_peered":"2023-08-25T05:37:25.946312+0000","last_clean":"2023-08-25T05:37:25.946312+0000","last_became_active":"2023-08-25T05:37:24.546455+0000","last_became_peered":"2023-08-25T05:37:24.546455+0000","last_unstale":"2023-08-25T05:37:25.946312+0000","last_undegraded":"2023-08-25T05:37:25.946312+0000","last_fullsized":"2023-08-25T05:37:25.946312+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:56:59.133449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"201'1","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535883+0000","last_change":"2023-08-25T05:37:23.538911+0000","last_active":"2023-08-25T05:37:25.535883+0000","last_peered":"2023-08-25T05:37:25.535883+0000","last_clean":"2023-08-25T05:37:25.535883+0000","last_became_active":"2023-08-25T05:37:23.538567+0000","last_became_peered":"2023-08-25T05:37:23.538567+0000","last_unstale":"2023-08-25T05:37:25.535883+0000","last_undegraded":"2023-08-25T05:37:25.535883+0000","last_fullsized":"2023-08-25T05:37:25.535883+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:24:04.911704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":350,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946253+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:37:25.946253+0000","last_peered":"2023-08-25T05:37:25.946253+0000","last_clean":"2023-08-25T05:37:25.946253+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:37:25.946253+0000","last_undegraded":"2023-08-25T05:37:25.946253+0000","last_fullsized":"2023-08-25T05:37:25.946253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:13:20.329031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946323+0000","last_change":"2023-08-25T05:37:24.555758+0000","last_active":"2023-08-25T05:37:25.946323+0000","last_peered":"2023-08-25T05:37:25.946323+0000","last_clean":"2023-08-25T05:37:25.946323+0000","last_became_active":"2023-08-25T05:37:24.555465+0000","last_became_peered":"2023-08-25T05:37:24.555465+0000","last_unstale":"2023-08-25T05:37:25.946323+0000","last_undegraded":"2023-08-25T05:37:25.946323+0000","last_fullsized":"2023-08-25T05:37:25.946323+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:15:54.144699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"201'2","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946034+0000","last_change":"2023-08-25T05:37:23.537014+0000","last_active":"2023-08-25T05:37:25.946034+0000","last_peered":"2023-08-25T05:37:25.946034+0000","last_clean":"2023-08-25T05:37:25.946034+0000","last_became_active":"2023-08-25T05:37:23.536588+0000","last_became_peered":"2023-08-25T05:37:23.536588+0000","last_unstale":"2023-08-25T05:37:25.946034+0000","last_undegraded":"2023-08-25T05:37:25.946034+0000","last_fullsized":"2023-08-25T05:37:25.946034+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:27:40.337374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":388,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947298+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:37:25.947298+0000","last_peered":"2023-08-25T05:37:25.947298+0000","last_clean":"2023-08-25T05:37:25.947298+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:37:25.947298+0000","last_undegraded":"2023-08-25T05:37:25.947298+0000","last_fullsized":"2023-08-25T05:37:25.947298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:56:44.758824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.536308+0000","last_change":"2023-08-25T05:37:24.540049+0000","last_active":"2023-08-25T05:37:25.536308+0000","last_peered":"2023-08-25T05:37:25.536308+0000","last_clean":"2023-08-25T05:37:25.536308+0000","last_became_active":"2023-08-25T05:37:24.538824+0000","last_became_peered":"2023-08-25T05:37:24.538824+0000","last_unstale":"2023-08-25T05:37:25.536308+0000","last_undegraded":"2023-08-25T05:37:25.536308+0000","last_fullsized":"2023-08-25T05:37:25.536308+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:27:53.789408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"201'2","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535172+0000","last_change":"2023-08-25T05:37:23.540783+0000","last_active":"2023-08-25T05:37:25.535172+0000","last_peered":"2023-08-25T05:37:25.535172+0000","last_clean":"2023-08-25T05:37:25.535172+0000","last_became_active":"2023-08-25T05:37:23.540346+0000","last_became_peered":"2023-08-25T05:37:23.540346+0000","last_unstale":"2023-08-25T05:37:25.535172+0000","last_undegraded":"2023-08-25T05:37:25.535172+0000","last_fullsized":"2023-08-25T05:37:25.535172+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:46.613445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":412,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.536309+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:37:25.536309+0000","last_peered":"2023-08-25T05:37:25.536309+0000","last_clean":"2023-08-25T05:37:25.536309+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:37:25.536309+0000","last_undegraded":"2023-08-25T05:37:25.536309+0000","last_fullsized":"2023-08-25T05:37:25.536309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:59:16.212909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2096,"num_read_kb":4403,"num_write":565,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3653,"ondisk_log_size":3653,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510569,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52276,"kb_used_data":3044,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319564,"statfs":{"total":96636764160,"available":96583233536,"internally_reserved":0,"allocated":3117056,"data_stored":1873058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.40999999999999998},"max":{"1min":0.94599999999999995,"5min":0.95499999999999996,"15min":1.0169999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.441},"max":{"1min":0.90700000000000003,"5min":1.016,"15min":1.0189999999999999},"last":0.73799999999999999}]},{"osd":1,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93799999999999994,"5min":0.99199999999999999,"15min":1.054},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.749,"15min":0.77300000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.84999999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.753},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77300000000000002,"15min":0.76800000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.53600000000000003},"max":{"1min":1.0129999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.70999999999999996}]},{"osd":3,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76700000000000002,"15min":0.77000000000000002},"min":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94499999999999995,"5min":1.006,"15min":1.006},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98299999999999998,"5min":1.0600000000000001,"15min":1.0680000000000001},"last":0.76400000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0449999999999999,"5min":1.163,"15min":1.163},"last":0.69099999999999995}]},{"osd":5,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.36599999999999999},"max":{"1min":0.97199999999999998,"5min":0.997,"15min":1.1120000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.501,"5min":0.44,"15min":0.42699999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.90200000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.74399999999999999,"15min":0.73099999999999998},"min":{"1min":0.50900000000000001,"5min":0.499,"15min":0.47999999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.71499999999999997,"15min":0.69999999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0900000000000001,"5min":1.119,"15min":1.119},"last":0.87}]}]},{"osd":6,"up_from":15,"seq":64424510569,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33648,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338192,"statfs":{"total":96636764160,"available":96602308608,"internally_reserved":0,"allocated":2527232,"data_stored":1282760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73899999999999999,"15min":0.745},"min":{"1min":0.45600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.876,"5min":0.99099999999999999,"15min":1.0449999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.50800000000000001,"5min":0.40100000000000002,"15min":0.40000000000000002},"max":{"1min":0.88600000000000001,"5min":1.0389999999999999,"15min":1.1699999999999999},"last":0.505}]},{"osd":1,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.76300000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.1559999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.48899999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1299999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76100000000000001,"15min":0.78700000000000003},"min":{"1min":0.55000000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98099999999999998,"5min":1.0760000000000001,"15min":1.0780000000000001},"last":0.622},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.81699999999999995,"15min":0.82499999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96799999999999997,"5min":1.0669999999999999,"15min":1.1599999999999999},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.497,"5min":0.47999999999999998,"15min":0.46400000000000002},"max":{"1min":1.002,"5min":1.0049999999999999,"15min":1.208},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.58699999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0149999999999999,"5min":1.054,"15min":1.236},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.45300000000000001,"5min":0.38400000000000001,"15min":0.33200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.018},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.42799999999999999,"5min":0.40699999999999997,"15min":0.35499999999999998},"max":{"1min":0.83999999999999997,"5min":0.85799999999999998,"15min":1.016},"last":0.44600000000000001}]},{"osd":5,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64900000000000002,"15min":0.65200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.44},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.1319999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.73499999999999999},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.1659999999999999},"last":0.76700000000000002}]},{"osd":7,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.39700000000000002},"max":{"1min":0.78000000000000003,"5min":0.97199999999999998,"15min":1.044},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68700000000000006,"15min":0.69699999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.42899999999999999},"max":{"1min":0.96399999999999997,"5min":1.228,"15min":1.228},"last":0.73899999999999999}]}]},{"osd":5,"up_from":14,"seq":60129543272,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60032,"kb_used_data":2480,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311808,"statfs":{"total":96636764160,"available":96575291392,"internally_reserved":0,"allocated":2539520,"data_stored":1284324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75700000000000001,"15min":0.754},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.97499999999999998,"5min":0.98199999999999998,"15min":1.034},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94599999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.79100000000000004}]},{"osd":1,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96099999999999997,"5min":1.073,"15min":1.073},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77400000000000002,"15min":0.77600000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.99199999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95699999999999996,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.752,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47999999999999998},"max":{"1min":1.018,"5min":1.208,"15min":1.208},"last":0.626}]},{"osd":3,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77000000000000002,"15min":0.76700000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96199999999999997,"5min":1.155,"15min":1.155},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79900000000000004,"15min":0.79500000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0089999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.77600000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64400000000000002,"15min":0.60599999999999998},"min":{"1min":0.41799999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.86399999999999999,"5min":1.681,"15min":1.681},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.63400000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.42499999999999999},"max":{"1min":0.89200000000000002,"5min":1.381,"15min":1.381},"last":0.754}]},{"osd":6,"last update":"Fri Aug 25 05:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69999999999999996,"15min":0.67000000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.42199999999999999},"max":{"1min":0.92200000000000004,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68700000000000006,"15min":0.68200000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.44900000000000001},"max":{"1min":0.86799999999999999,"5min":1.276,"15min":1.276},"last":0.85099999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68200000000000005,"15min":0.66100000000000003},"min":{"1min":0.46500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.874,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77400000000000002,"15min":0.74099999999999999},"min":{"1min":0.53300000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96799999999999997,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.73999999999999999}]}]},{"osd":4,"up_from":14,"seq":60129543272,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47556,"kb_used_data":2480,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324284,"statfs":{"total":96636764160,"available":96588066816,"internally_reserved":0,"allocated":2539520,"data_stored":1284336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.054},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96499999999999997,"5min":0.97799999999999998,"15min":1.02},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.77300000000000002},"min":{"1min":0.48199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0449999999999999,"5min":1.05,"15min":1.05},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.505},"max":{"1min":0.97999999999999998,"5min":1.022,"15min":1.103},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.51800000000000002},"max":{"1min":0.95699999999999996,"5min":0.995,"15min":1.0780000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.76100000000000001,"15min":0.77200000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.47999999999999998},"max":{"1min":1.0649999999999999,"5min":1.069,"15min":1.069},"last":0.67100000000000004}]},{"osd":3,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76500000000000001,"15min":0.78800000000000003},"min":{"1min":0.55800000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.995,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95599999999999996,"5min":1.101,"15min":1.101},"last":0.72099999999999997}]},{"osd":5,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81200000000000006,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.46899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93700000000000006,"5min":0.96799999999999997,"15min":0.98299999999999998},"last":0.64400000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.755,"15min":0.75},"min":{"1min":0.58399999999999996,"5min":0.49399999999999999,"15min":0.49199999999999999},"max":{"1min":1.0029999999999999,"5min":1.008,"15min":1.1240000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.66700000000000004,"15min":0.65800000000000003},"min":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.0629999999999999},"last":0.76200000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91000000000000003,"5min":0.996,"15min":0.996},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.53200000000000003,"5min":0.496,"15min":0.47599999999999998},"max":{"1min":0.96699999999999997,"5min":1.0389999999999999,"15min":1.0860000000000001},"last":0.79500000000000004}]}]},{"osd":3,"up_from":14,"seq":60129543272,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64184,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307656,"statfs":{"total":96636764160,"available":96571039744,"internally_reserved":0,"allocated":2531328,"data_stored":1282850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":63174923},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.33400000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.35499999999999998,"15min":0.34000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.92900000000000005},"last":0.33400000000000002}]},{"osd":1,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52300000000000002,"15min":0.52800000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.0780000000000001},"last":0.434},{"interface":"front","average":{"1min":0.628,"5min":0.61299999999999999,"15min":0.629},"min":{"1min":0.44400000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":0.97999999999999998},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.50600000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81100000000000005,"5min":1.0089999999999999,"15min":1.038},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.44800000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71999999999999997,"5min":0.79000000000000004,"15min":0.95799999999999996},"last":0.47699999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.52300000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.046,"5min":1.26,"15min":1.26},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.83899999999999997,"15min":0.83199999999999996},"min":{"1min":0.58099999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.125,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.65300000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.026,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82299999999999995,"15min":0.82999999999999996},"min":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.1419999999999999},"last":0.84699999999999998}]},{"osd":6,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85799999999999998,"15min":0.86699999999999999},"min":{"1min":0.60999999999999999,"5min":0.59499999999999997,"15min":0.59399999999999997},"max":{"1min":1.1160000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.65200000000000002,"5min":0.58399999999999996,"15min":0.48999999999999999},"max":{"1min":1.0469999999999999,"5min":1.133,"15min":1.194},"last":0.94499999999999995}]},{"osd":7,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.86699999999999999,"15min":0.879},"min":{"1min":0.63100000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.169,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.83299999999999996,"15min":0.83599999999999997},"min":{"1min":0.625,"5min":0.52900000000000003,"15min":0.51800000000000002},"max":{"1min":1.0669999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.878}]}]},{"osd":2,"up_from":14,"seq":60129543273,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60016,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311824,"statfs":{"total":96636764160,"available":96575307776,"internally_reserved":0,"allocated":2527232,"data_stored":1283272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.46000000000000002,"15min":0.47699999999999998},"min":{"1min":0.33400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.35499999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71699999999999997,"5min":0.85099999999999998,"15min":0.86099999999999999},"last":0.57299999999999995}]},{"osd":1,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66200000000000003,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83099999999999996,"5min":0.88800000000000001,"15min":0.89700000000000002},"last":0.64600000000000002}]},{"osd":3,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.41099999999999998,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.78000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.63200000000000001,"5min":0.56399999999999995,"15min":0.48699999999999999},"max":{"1min":1.0720000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80400000000000005,"15min":0.81100000000000005},"min":{"1min":0.66200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.1619999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.60899999999999999}]},{"osd":5,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.60899999999999999,"5min":0.53200000000000003,"15min":0.51700000000000002},"max":{"1min":1.0089999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.84699999999999998},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.246,"5min":1.266,"15min":1.266},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.103,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.871},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.875,"15min":0.88},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.58899999999999997},"max":{"1min":1.204,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.83299999999999996}]},{"osd":7,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.82599999999999996,"15min":0.83799999999999997},"min":{"1min":0.69299999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1040000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.82699999999999996,"15min":0.83199999999999996},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1870000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.76000000000000001}]}]},{"osd":1,"up_from":14,"seq":60129543273,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41964,"kb_used_data":2464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329876,"statfs":{"total":96636764160,"available":96593793024,"internally_reserved":0,"allocated":2523136,"data_stored":1282690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.47699999999999998},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.70299999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.34100000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.71099999999999997,"5min":0.73799999999999999,"15min":0.879},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.81399999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66600000000000004,"5min":0.82899999999999996,"15min":0.91400000000000003},"last":0.67400000000000004}]},{"osd":3,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73199999999999998,"5min":0.998,"15min":0.998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.376,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73299999999999998,"5min":0.88700000000000001,"15min":0.98699999999999999},"last":0.55000000000000004}]},{"osd":4,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91000000000000003,"5min":1.1559999999999999,"15min":1.2350000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82999999999999996,"15min":0.83699999999999997},"min":{"1min":0.69099999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98699999999999999,"5min":1.268,"15min":1.268},"last":0.82299999999999995}]},{"osd":5,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.80900000000000005},"min":{"1min":0.624,"5min":0.54800000000000004,"15min":0.47699999999999998},"max":{"1min":0.89800000000000002,"5min":1.109,"15min":1.1950000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.66200000000000003,"5min":0.61899999999999999,"15min":0.55300000000000005},"max":{"1min":0.97899999999999998,"5min":1.214,"15min":1.214},"last":0.75600000000000001}]},{"osd":6,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.66100000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.94499999999999995,"5min":1.212,"15min":1.244},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.81899999999999995,"15min":0.83699999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.94699999999999995,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.63}]},{"osd":7,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81200000000000006,"15min":0.83699999999999997},"min":{"1min":0.61699999999999999,"5min":0.60899999999999999,"15min":0.55600000000000005},"max":{"1min":1.0069999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.626},"max":{"1min":0.96799999999999997,"5min":1.127,"15min":1.2110000000000001},"last":0.77300000000000002}]}]},{"osd":0,"up_from":14,"seq":60129543272,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60616,"kb_used_data":3060,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311224,"statfs":{"total":96636764160,"available":96574693376,"internally_reserved":0,"allocated":3133440,"data_stored":1873786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48999999999999999,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.308,"15min":0.30599999999999999},"max":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":1.2170000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.81599999999999995,"15min":0.85999999999999999},"last":0.47199999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36399999999999999,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":0.81399999999999995,"15min":0.91000000000000003},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55000000000000004,"15min":0.56100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71499999999999997,"5min":0.755,"15min":0.86799999999999999},"last":0.42899999999999999}]},{"osd":3,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.754,"15min":1.855},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.75900000000000001,"5min":0.90000000000000002,"15min":1.3480000000000001},"last":0.52300000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.57599999999999996,"5min":0.495,"15min":0.495},"max":{"1min":1.0600000000000001,"5min":1.258,"15min":1.3799999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81699999999999995,"15min":0.83199999999999996},"min":{"1min":0.627,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0529999999999999,"5min":1.2809999999999999,"15min":1.2849999999999999},"last":0.68700000000000006}]},{"osd":5,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.58999999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.004,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.875},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82499999999999996,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0620000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.63900000000000001}]},{"osd":6,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82199999999999995,"15min":0.83599999999999997},"min":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0429999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86499999999999999,"15min":0.85999999999999999},"min":{"1min":0.51600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.0880000000000001,"5min":1.3560000000000001,"15min":1.5129999999999999},"last":0.85099999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85799999999999998,"15min":0.876},"min":{"1min":0.64600000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0760000000000001,"5min":1.4339999999999999,"15min":1.5720000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58099999999999996},"max":{"1min":1.0620000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:37:29.453 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-25T05:37:29.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.631+0000 7f8d7eabd640 1 Processor -- start 2023-08-25T05:37:29.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.631+0000 7f8d7eabd640 1 -- start start 2023-08-25T05:37:29.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.631+0000 7f8d7eabd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8d780cd9d0 0x7f8d780cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:29.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.631+0000 7f8d7eabd640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d780cfbc0 con 0x7f8d780d0d30 2023-08-25T05:37:29.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.631+0000 7f8d7eabd640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d780cf320 con 0x7f8d780b55c0 2023-08-25T05:37:29.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.631+0000 7f8d7eabd640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d780cd5b0 con 0x7f8d780cd9d0 2023-08-25T05:37:29.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.631+0000 7f8d7c859640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8d780d0d30 0x7f8d780d1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34408/0 (socket says 172.21.15.55:34408) 2023-08-25T05:37:29.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.631+0000 7f8d7c859640 1 -- 172.21.15.55:0/4082068016 learned_addr learned my addr 172.21.15.55:0/4082068016 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:29.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.631+0000 7f8d7d05a640 1 --2- 172.21.15.55:0/4082068016 >> v2:172.21.15.55:3300/0 conn(0x7f8d780cd9d0 0x7f8d780cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:29.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.631+0000 7f8d6f7fe640 1 -- 172.21.15.55:0/4082068016 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509319569 0 0) 0x7f8d780cfbc0 con 0x7f8d780d0d30 2023-08-25T05:37:29.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.631+0000 7f8d6f7fe640 1 -- 172.21.15.55:0/4082068016 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d60003530 con 0x7f8d780d0d30 2023-08-25T05:37:29.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.631+0000 7f8d7d05a640 1 -- 172.21.15.55:0/4082068016 >> v1:172.21.15.110:6789/0 conn(0x7f8d780b55c0 legacy=0x7f8d780d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:29.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.631+0000 7f8d7d05a640 1 -- 172.21.15.55:0/4082068016 >> v1:172.21.15.55:6789/0 conn(0x7f8d780d0d30 legacy=0x7f8d780d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:29.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.631+0000 7f8d7d05a640 1 -- 172.21.15.55:0/4082068016 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d780cf600 con 0x7f8d780cd9d0 2023-08-25T05:37:29.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.635+0000 7f8d7d05a640 1 --2- 172.21.15.55:0/4082068016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d780cd9d0 0x7f8d780cde60 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f8d70009d90 tx=0x7f8d7001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710543d45d3d151a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:29.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.635+0000 7f8d6f7fe640 1 -- 172.21.15.55:0/4082068016 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d700a5890 con 0x7f8d780cd9d0 2023-08-25T05:37:29.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.635+0000 7f8d6f7fe640 1 -- 172.21.15.55:0/4082068016 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d700a59f0 con 0x7f8d780cd9d0 2023-08-25T05:37:29.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.635+0000 7f8d6f7fe640 1 -- 172.21.15.55:0/4082068016 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d700a5d80 con 0x7f8d780cd9d0 2023-08-25T05:37:29.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.635+0000 7f8d7eabd640 1 -- 172.21.15.55:0/4082068016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d780cd9d0 msgr2=0x7f8d780cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:29.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.635+0000 7f8d7eabd640 1 --2- 172.21.15.55:0/4082068016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d780cd9d0 0x7f8d780cde60 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f8d70009d90 tx=0x7f8d7001c8c0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.635+0000 7f8d7eabd640 1 -- 172.21.15.55:0/4082068016 shutdown_connections 2023-08-25T05:37:29.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.635+0000 7f8d7eabd640 1 --2- 172.21.15.55:0/4082068016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d780cd9d0 0x7f8d780cde60 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.635+0000 7f8d7eabd640 1 -- 172.21.15.55:0/4082068016 >> 172.21.15.55:0/4082068016 conn(0x7f8d7809baf0 msgr2=0x7f8d780d2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:29.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.635+0000 7f8d7eabd640 1 -- 172.21.15.55:0/4082068016 shutdown_connections 2023-08-25T05:37:29.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.635+0000 7f8d7eabd640 1 -- 172.21.15.55:0/4082068016 wait complete. 2023-08-25T05:37:29.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7eabd640 1 Processor -- start 2023-08-25T05:37:29.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7eabd640 1 -- start start 2023-08-25T05:37:29.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7eabd640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d780b55c0 0x7f8d7815d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:29.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7eabd640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d780cd9d0 0x7f8d78148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:29.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7eabd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d780d0d30 0x7f8d780c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:29.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7eabd640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7815d7f0 con 0x7f8d780d0d30 2023-08-25T05:37:29.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7eabd640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d781494b0 con 0x7f8d780cd9d0 2023-08-25T05:37:29.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7eabd640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d78149790 con 0x7f8d780b55c0 2023-08-25T05:37:29.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7d05a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d780d0d30 0x7f8d780c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:29.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7d05a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d780d0d30 0x7f8d780c83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54316/0 (socket says 172.21.15.55:54316) 2023-08-25T05:37:29.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7d05a640 1 -- 172.21.15.55:0/2400114101 learned_addr learned my addr 172.21.15.55:0/2400114101 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:29.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7c859640 1 --2- 172.21.15.55:0/2400114101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d780b55c0 0x7f8d7815d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:29.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d6ffff640 1 --2- 172.21.15.55:0/2400114101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d780cd9d0 0x7f8d78148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:29.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7d05a640 1 -- 172.21.15.55:0/2400114101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d780b55c0 msgr2=0x7f8d7815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:29.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7d05a640 1 --2- 172.21.15.55:0/2400114101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d780b55c0 0x7f8d7815d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7d05a640 1 -- 172.21.15.55:0/2400114101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d780cd9d0 msgr2=0x7f8d78148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:29.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7d05a640 1 --2- 172.21.15.55:0/2400114101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d780cd9d0 0x7f8d78148c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7d05a640 1 -- 172.21.15.55:0/2400114101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d70009a70 con 0x7f8d780d0d30 2023-08-25T05:37:29.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7d05a640 1 --2- 172.21.15.55:0/2400114101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d780d0d30 0x7f8d780c83a0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f8d700194d0 tx=0x7f8d70019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:29.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d6d7fa640 1 -- 172.21.15.55:0/2400114101 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d70003ba0 con 0x7f8d780d0d30 2023-08-25T05:37:29.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d6d7fa640 1 -- 172.21.15.55:0/2400114101 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d70003d00 con 0x7f8d780d0d30 2023-08-25T05:37:29.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d6d7fa640 1 -- 172.21.15.55:0/2400114101 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d70004230 con 0x7f8d780d0d30 2023-08-25T05:37:29.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7eabd640 1 -- 172.21.15.55:0/2400114101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d78149a70 con 0x7f8d780d0d30 2023-08-25T05:37:29.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.639+0000 7f8d7eabd640 1 -- 172.21.15.55:0/2400114101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7814a030 con 0x7f8d780d0d30 2023-08-25T05:37:29.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.643+0000 7f8d7eabd640 1 -- 172.21.15.55:0/2400114101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7804dbe0 con 0x7f8d780d0d30 2023-08-25T05:37:29.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.643+0000 7f8d6d7fa640 1 -- 172.21.15.55:0/2400114101 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f8d700b4070 con 0x7f8d780d0d30 2023-08-25T05:37:29.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.643+0000 7f8d6d7fa640 1 --2- 172.21.15.55:0/2400114101 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f8d640657a0 0x7f8d64067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:29.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.643+0000 7f8d6d7fa640 1 -- 172.21.15.55:0/2400114101 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8d7011d090 con 0x7f8d780d0d30 2023-08-25T05:37:29.646 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.643+0000 7f8d7c859640 1 --2- 172.21.15.55:0/2400114101 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f8d640657a0 0x7f8d64067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:29.647 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.643+0000 7f8d7c859640 1 --2- 172.21.15.55:0/2400114101 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f8d640657a0 0x7f8d64067c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8d74004990 tx=0x7f8d74007d20 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:29.649 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.647+0000 7f8d6d7fa640 1 -- 172.21.15.55:0/2400114101 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8d700eaa50 con 0x7f8d780d0d30 2023-08-25T05:37:29.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.859+0000 7f8d7eabd640 1 -- 172.21.15.55:0/2400114101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8d780cfdf0 con 0x7f8d780d0d30 2023-08-25T05:37:29.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.859+0000 7f8d6d7fa640 1 -- 172.21.15.55:0/2400114101 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3216 (secure 0 0 0) 0x7f8d700b2ca0 con 0x7f8d780d0d30 2023-08-25T05:37:29.861 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:29.861 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5694,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":202,"num_osds":8,"num_up_osds":8,"osd_up_since":1692936167,"num_in_osds":8,"osd_in_since":1692936158,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592778,"bytes_used":430379008,"bytes_avail":772663734272,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":100,"id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"c","status":"up:active","gid":11349}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2023-08-25T05:37:11.181117+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-25T05:37:29.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.859+0000 7f8d7eabd640 1 -- 172.21.15.55:0/2400114101 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f8d640657a0 msgr2=0x7f8d64067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:29.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.859+0000 7f8d7eabd640 1 --2- 172.21.15.55:0/2400114101 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f8d640657a0 0x7f8d64067c60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8d74004990 tx=0x7f8d74007d20 comp rx=0 tx=0).stop 2023-08-25T05:37:29.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.859+0000 7f8d7eabd640 1 -- 172.21.15.55:0/2400114101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d780d0d30 msgr2=0x7f8d780c83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:29.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.859+0000 7f8d7eabd640 1 --2- 172.21.15.55:0/2400114101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d780d0d30 0x7f8d780c83a0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f8d700194d0 tx=0x7f8d70019660 comp rx=0 tx=0).stop 2023-08-25T05:37:29.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.859+0000 7f8d7eabd640 1 -- 172.21.15.55:0/2400114101 shutdown_connections 2023-08-25T05:37:29.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.859+0000 7f8d7eabd640 1 --2- 172.21.15.55:0/2400114101 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f8d640657a0 0x7f8d64067c60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.859+0000 7f8d7eabd640 1 --2- 172.21.15.55:0/2400114101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d780d0d30 0x7f8d780c83a0 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.859+0000 7f8d7eabd640 1 --2- 172.21.15.55:0/2400114101 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8d780cd9d0 0x7f8d78148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.859+0000 7f8d7eabd640 1 --2- 172.21.15.55:0/2400114101 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8d780b55c0 0x7f8d7815d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:29.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.859+0000 7f8d7eabd640 1 -- 172.21.15.55:0/2400114101 >> 172.21.15.55:0/2400114101 conn(0x7f8d7809baf0 msgr2=0x7f8d780b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:29.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.859+0000 7f8d7eabd640 1 -- 172.21.15.55:0/2400114101 shutdown_connections 2023-08-25T05:37:29.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:29.859+0000 7f8d7eabd640 1 -- 172.21.15.55:0/2400114101 wait complete. 2023-08-25T05:37:29.882 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-25T05:37:29.883 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:37:30.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.023+0000 7f3332e6a640 1 Processor -- start 2023-08-25T05:37:30.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.023+0000 7f3332e6a640 1 -- start start 2023-08-25T05:37:30.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.027+0000 7f3332e6a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f332c15eba0 0x7f332c0b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:30.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.027+0000 7f3332e6a640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332c0ac3a0 con 0x7f332c0ceeb0 2023-08-25T05:37:30.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.027+0000 7f3332e6a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332c0b1390 con 0x7f332c15ef80 2023-08-25T05:37:30.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.027+0000 7f3332e6a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c0b1670 con 0x7f332c15eba0 2023-08-25T05:37:30.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.027+0000 7f3331407640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f332c0ceeb0 0x7f332c0ab0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34412/0 (socket says 172.21.15.55:34412) 2023-08-25T05:37:30.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.027+0000 7f3331407640 1 -- 172.21.15.55:0/865534153 learned_addr learned my addr 172.21.15.55:0/865534153 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:30.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.027+0000 7f3330c06640 1 --2- 172.21.15.55:0/865534153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f332c15eba0 0x7f332c0b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:30.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.027+0000 7f33237fe640 1 -- 172.21.15.55:0/865534153 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1594656541 0 0) 0x7f332c0ac3a0 con 0x7f332c0ceeb0 2023-08-25T05:37:30.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.027+0000 7f33237fe640 1 -- 172.21.15.55:0/865534153 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3314003530 con 0x7f332c0ceeb0 2023-08-25T05:37:30.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.027+0000 7f33237fe640 1 -- 172.21.15.55:0/865534153 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60090199 0 0) 0x7f332c0b1390 con 0x7f332c15ef80 2023-08-25T05:37:30.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.027+0000 7f3330c06640 1 -- 172.21.15.55:0/865534153 >> v1:172.21.15.110:6789/0 conn(0x7f332c15ef80 legacy=0x7f332c0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:30.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.027+0000 7f3330c06640 1 -- 172.21.15.55:0/865534153 >> v1:172.21.15.55:6789/0 conn(0x7f332c0ceeb0 legacy=0x7f332c0ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:30.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.027+0000 7f3330c06640 1 -- 172.21.15.55:0/865534153 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c0b1950 con 0x7f332c15eba0 2023-08-25T05:37:30.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.031+0000 7f3330c06640 1 --2- 172.21.15.55:0/865534153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f332c15eba0 0x7f332c0b2a40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f33280097f0 tx=0x7f332801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2423c18dbe6203c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:30.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.031+0000 7f33237fe640 1 -- 172.21.15.55:0/865534153 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33280aa5f0 con 0x7f332c15eba0 2023-08-25T05:37:30.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.031+0000 7f33237fe640 1 -- 172.21.15.55:0/865534153 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33280aa750 con 0x7f332c15eba0 2023-08-25T05:37:30.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.031+0000 7f33237fe640 1 -- 172.21.15.55:0/865534153 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33280aaae0 con 0x7f332c15eba0 2023-08-25T05:37:30.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.031+0000 7f3332e6a640 1 -- 172.21.15.55:0/865534153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f332c15eba0 msgr2=0x7f332c0b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:30.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.031+0000 7f3332e6a640 1 --2- 172.21.15.55:0/865534153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f332c15eba0 0x7f332c0b2a40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f33280097f0 tx=0x7f332801c490 comp rx=0 tx=0).stop 2023-08-25T05:37:30.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.031+0000 7f3332e6a640 1 -- 172.21.15.55:0/865534153 shutdown_connections 2023-08-25T05:37:30.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.031+0000 7f3332e6a640 1 --2- 172.21.15.55:0/865534153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f332c15eba0 0x7f332c0b2a40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:30.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.031+0000 7f3332e6a640 1 -- 172.21.15.55:0/865534153 >> 172.21.15.55:0/865534153 conn(0x7f332c069d00 msgr2=0x7f332c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:30.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.031+0000 7f3332e6a640 1 -- 172.21.15.55:0/865534153 shutdown_connections 2023-08-25T05:37:30.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.031+0000 7f3332e6a640 1 -- 172.21.15.55:0/865534153 wait complete. 2023-08-25T05:37:30.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.031+0000 7f3332e6a640 1 Processor -- start 2023-08-25T05:37:30.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.031+0000 7f3332e6a640 1 -- start start 2023-08-25T05:37:30.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3332e6a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f332c0ceeb0 0x7f332c096c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3332e6a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c15eba0 0x7f332c097190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3332e6a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f332c15ef80 0x7f332c06b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3332e6a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c097800 con 0x7f332c15eba0 2023-08-25T05:37:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3332e6a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c15a2a0 con 0x7f332c0ceeb0 2023-08-25T05:37:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3332e6a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c097c00 con 0x7f332c15ef80 2023-08-25T05:37:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3323fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c15eba0 0x7f332c097190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3323fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c15eba0 0x7f332c097190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54318/0 (socket says 172.21.15.55:54318) 2023-08-25T05:37:30.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3323fff640 1 -- 172.21.15.55:0/604633086 learned_addr learned my addr 172.21.15.55:0/604633086 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:30.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3330c06640 1 --2- 172.21.15.55:0/604633086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f332c0ceeb0 0x7f332c096c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:30.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3331407640 1 --2- 172.21.15.55:0/604633086 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f332c15ef80 0x7f332c06b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:30.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3323fff640 1 -- 172.21.15.55:0/604633086 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f332c15ef80 msgr2=0x7f332c06b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:30.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3323fff640 1 --2- 172.21.15.55:0/604633086 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f332c15ef80 0x7f332c06b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:30.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3323fff640 1 -- 172.21.15.55:0/604633086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f332c0ceeb0 msgr2=0x7f332c096c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:30.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3323fff640 1 --2- 172.21.15.55:0/604633086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f332c0ceeb0 0x7f332c096c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:30.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3323fff640 1 -- 172.21.15.55:0/604633086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3328009420 con 0x7f332c15eba0 2023-08-25T05:37:30.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3323fff640 1 --2- 172.21.15.55:0/604633086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c15eba0 0x7f332c097190 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f331c00c4d0 tx=0x7f331c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:30.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f33217fa640 1 -- 172.21.15.55:0/604633086 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c005480 con 0x7f332c15eba0 2023-08-25T05:37:30.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f33217fa640 1 -- 172.21.15.55:0/604633086 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331c003600 con 0x7f332c15eba0 2023-08-25T05:37:30.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f33217fa640 1 -- 172.21.15.55:0/604633086 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331c0039b0 con 0x7f332c15eba0 2023-08-25T05:37:30.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3332e6a640 1 -- 172.21.15.55:0/604633086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332c159fc0 con 0x7f332c15eba0 2023-08-25T05:37:30.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3332e6a640 1 -- 172.21.15.55:0/604633086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332c153db0 con 0x7f332c15eba0 2023-08-25T05:37:30.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f3332e6a640 1 -- 172.21.15.55:0/604633086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332c153fa0 con 0x7f332c15eba0 2023-08-25T05:37:30.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.035+0000 7f33217fa640 1 -- 172.21.15.55:0/604633086 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f331c003b10 con 0x7f332c15eba0 2023-08-25T05:37:30.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.039+0000 7f33217fa640 1 --2- 172.21.15.55:0/604633086 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f33180657a0 0x7f3318067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:30.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.039+0000 7f33217fa640 1 -- 172.21.15.55:0/604633086 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f331c082440 con 0x7f332c15eba0 2023-08-25T05:37:30.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.039+0000 7f3330c06640 1 --2- 172.21.15.55:0/604633086 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f33180657a0 0x7f3318067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:30.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.039+0000 7f3330c06640 1 --2- 172.21.15.55:0/604633086 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f33180657a0 0x7f3318067c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f33280ae000 tx=0x7f33280a7000 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:30.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.043+0000 7f33217fa640 1 -- 172.21.15.55:0/604633086 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f331c04fff0 con 0x7f332c15eba0 2023-08-25T05:37:30.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.195+0000 7f3332e6a640 1 -- 172.21.15.55:0/604633086 --> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f332c1686b0 con 0x7f33180657a0 2023-08-25T05:37:30.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.203+0000 7f33217fa640 1 -- 172.21.15.55:0/604633086 <== mgr.8987 v2:172.21.15.110:6832/3630541271 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311949 (secure 0 0 0) 0x7f33280aa8c0 con 0x7f33180657a0 2023-08-25T05:37:30.209 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:30.210 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:37:30.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.207+0000 7f3332e6a640 1 -- 172.21.15.55:0/604633086 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f33180657a0 msgr2=0x7f3318067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:30.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.207+0000 7f3332e6a640 1 --2- 172.21.15.55:0/604633086 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f33180657a0 0x7f3318067c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f33280ae000 tx=0x7f33280a7000 comp rx=0 tx=0).stop 2023-08-25T05:37:30.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.207+0000 7f3332e6a640 1 -- 172.21.15.55:0/604633086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c15eba0 msgr2=0x7f332c097190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:30.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.207+0000 7f3332e6a640 1 --2- 172.21.15.55:0/604633086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c15eba0 0x7f332c097190 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f331c00c4d0 tx=0x7f331c00c990 comp rx=0 tx=0).stop 2023-08-25T05:37:30.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.207+0000 7f3332e6a640 1 -- 172.21.15.55:0/604633086 shutdown_connections 2023-08-25T05:37:30.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.207+0000 7f3332e6a640 1 --2- 172.21.15.55:0/604633086 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f33180657a0 0x7f3318067c60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:30.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.207+0000 7f3332e6a640 1 --2- 172.21.15.55:0/604633086 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f332c15ef80 0x7f332c06b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:30.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.207+0000 7f3332e6a640 1 --2- 172.21.15.55:0/604633086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f332c15eba0 0x7f332c097190 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:30.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.207+0000 7f3332e6a640 1 --2- 172.21.15.55:0/604633086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f332c0ceeb0 0x7f332c096c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:30.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.207+0000 7f3332e6a640 1 -- 172.21.15.55:0/604633086 >> 172.21.15.55:0/604633086 conn(0x7f332c069d00 msgr2=0x7f332c0cd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:30.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.207+0000 7f3332e6a640 1 -- 172.21.15.55:0/604633086 shutdown_connections 2023-08-25T05:37:30.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:30.207+0000 7f3332e6a640 1 -- 172.21.15.55:0/604633086 wait complete. 2023-08-25T05:37:30.229 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-25T05:37:29.184556+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2096,"num_read_kb":4403,"num_write":609,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3691,"ondisk_log_size":3691,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":202,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":420292,"kb_used_data":20936,"kb_used_omap":13,"kb_used_meta":399218,"kb_avail":754554428,"statfs":{"total":773094113280,"available":772663734272,"internally_reserved":0,"allocated":21438464,"data_stored":11447076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":408799320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001410"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946915+0000","last_change":"2023-08-25T05:37:24.558861+0000","last_active":"2023-08-25T05:37:25.946915+0000","last_peered":"2023-08-25T05:37:25.946915+0000","last_clean":"2023-08-25T05:37:25.946915+0000","last_became_active":"2023-08-25T05:37:24.558588+0000","last_became_peered":"2023-08-25T05:37:24.558588+0000","last_unstale":"2023-08-25T05:37:25.946915+0000","last_undegraded":"2023-08-25T05:37:25.946915+0000","last_fullsized":"2023-08-25T05:37:25.946915+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:40:20.607628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947254+0000","last_change":"2023-08-25T05:37:24.550046+0000","last_active":"2023-08-25T05:37:25.947254+0000","last_peered":"2023-08-25T05:37:25.947254+0000","last_clean":"2023-08-25T05:37:25.947254+0000","last_became_active":"2023-08-25T05:37:24.549770+0000","last_became_peered":"2023-08-25T05:37:24.549770+0000","last_unstale":"2023-08-25T05:37:25.947254+0000","last_undegraded":"2023-08-25T05:37:25.947254+0000","last_fullsized":"2023-08-25T05:37:25.947254+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:44:37.817651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.536047+0000","last_change":"2023-08-25T05:37:24.531155+0000","last_active":"2023-08-25T05:37:25.536047+0000","last_peered":"2023-08-25T05:37:25.536047+0000","last_clean":"2023-08-25T05:37:25.536047+0000","last_became_active":"2023-08-25T05:37:24.530836+0000","last_became_peered":"2023-08-25T05:37:24.530836+0000","last_unstale":"2023-08-25T05:37:25.536047+0000","last_undegraded":"2023-08-25T05:37:25.536047+0000","last_fullsized":"2023-08-25T05:37:25.536047+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:28.065393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945718+0000","last_change":"2023-08-25T05:37:24.544721+0000","last_active":"2023-08-25T05:37:25.945718+0000","last_peered":"2023-08-25T05:37:25.945718+0000","last_clean":"2023-08-25T05:37:25.945718+0000","last_became_active":"2023-08-25T05:37:24.544390+0000","last_became_peered":"2023-08-25T05:37:24.544390+0000","last_unstale":"2023-08-25T05:37:25.945718+0000","last_undegraded":"2023-08-25T05:37:25.945718+0000","last_fullsized":"2023-08-25T05:37:25.945718+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:29:44.533780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535305+0000","last_change":"2023-08-25T05:37:24.546648+0000","last_active":"2023-08-25T05:37:25.535305+0000","last_peered":"2023-08-25T05:37:25.535305+0000","last_clean":"2023-08-25T05:37:25.535305+0000","last_became_active":"2023-08-25T05:37:24.546097+0000","last_became_peered":"2023-08-25T05:37:24.546097+0000","last_unstale":"2023-08-25T05:37:25.535305+0000","last_undegraded":"2023-08-25T05:37:25.535305+0000","last_fullsized":"2023-08-25T05:37:25.535305+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:12:49.450829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535529+0000","last_change":"2023-08-25T05:37:24.555791+0000","last_active":"2023-08-25T05:37:25.535529+0000","last_peered":"2023-08-25T05:37:25.535529+0000","last_clean":"2023-08-25T05:37:25.535529+0000","last_became_active":"2023-08-25T05:37:24.555323+0000","last_became_peered":"2023-08-25T05:37:24.555323+0000","last_unstale":"2023-08-25T05:37:25.535529+0000","last_undegraded":"2023-08-25T05:37:25.535529+0000","last_fullsized":"2023-08-25T05:37:25.535529+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:44.720821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945686+0000","last_change":"2023-08-25T05:37:24.550505+0000","last_active":"2023-08-25T05:37:25.945686+0000","last_peered":"2023-08-25T05:37:25.945686+0000","last_clean":"2023-08-25T05:37:25.945686+0000","last_became_active":"2023-08-25T05:37:24.550152+0000","last_became_peered":"2023-08-25T05:37:24.550152+0000","last_unstale":"2023-08-25T05:37:25.945686+0000","last_undegraded":"2023-08-25T05:37:25.945686+0000","last_fullsized":"2023-08-25T05:37:25.945686+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:47:32.743962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946199+0000","last_change":"2023-08-25T05:37:24.547757+0000","last_active":"2023-08-25T05:37:25.946199+0000","last_peered":"2023-08-25T05:37:25.946199+0000","last_clean":"2023-08-25T05:37:25.946199+0000","last_became_active":"2023-08-25T05:37:24.547485+0000","last_became_peered":"2023-08-25T05:37:24.547485+0000","last_unstale":"2023-08-25T05:37:25.946199+0000","last_undegraded":"2023-08-25T05:37:25.946199+0000","last_fullsized":"2023-08-25T05:37:25.946199+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:28:19.214287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947052+0000","last_change":"2023-08-25T05:37:24.547748+0000","last_active":"2023-08-25T05:37:25.947052+0000","last_peered":"2023-08-25T05:37:25.947052+0000","last_clean":"2023-08-25T05:37:25.947052+0000","last_became_active":"2023-08-25T05:37:24.547416+0000","last_became_peered":"2023-08-25T05:37:24.547416+0000","last_unstale":"2023-08-25T05:37:25.947052+0000","last_undegraded":"2023-08-25T05:37:25.947052+0000","last_fullsized":"2023-08-25T05:37:25.947052+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:34:42.593857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535709+0000","last_change":"2023-08-25T05:37:24.544494+0000","last_active":"2023-08-25T05:37:25.535709+0000","last_peered":"2023-08-25T05:37:25.535709+0000","last_clean":"2023-08-25T05:37:25.535709+0000","last_became_active":"2023-08-25T05:37:24.544188+0000","last_became_peered":"2023-08-25T05:37:24.544188+0000","last_unstale":"2023-08-25T05:37:25.535709+0000","last_undegraded":"2023-08-25T05:37:25.535709+0000","last_fullsized":"2023-08-25T05:37:25.535709+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:07:21.041111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945924+0000","last_change":"2023-08-25T05:37:24.546120+0000","last_active":"2023-08-25T05:37:25.945924+0000","last_peered":"2023-08-25T05:37:25.945924+0000","last_clean":"2023-08-25T05:37:25.945924+0000","last_became_active":"2023-08-25T05:37:24.545846+0000","last_became_peered":"2023-08-25T05:37:24.545846+0000","last_unstale":"2023-08-25T05:37:25.945924+0000","last_undegraded":"2023-08-25T05:37:25.945924+0000","last_fullsized":"2023-08-25T05:37:25.945924+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:55:43.946369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945853+0000","last_change":"2023-08-25T05:37:24.556431+0000","last_active":"2023-08-25T05:37:25.945853+0000","last_peered":"2023-08-25T05:37:25.945853+0000","last_clean":"2023-08-25T05:37:25.945853+0000","last_became_active":"2023-08-25T05:37:24.556133+0000","last_became_peered":"2023-08-25T05:37:24.556133+0000","last_unstale":"2023-08-25T05:37:25.945853+0000","last_undegraded":"2023-08-25T05:37:25.945853+0000","last_fullsized":"2023-08-25T05:37:25.945853+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:38:26.995904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534692+0000","last_change":"2023-08-25T05:37:24.532883+0000","last_active":"2023-08-25T05:37:25.534692+0000","last_peered":"2023-08-25T05:37:25.534692+0000","last_clean":"2023-08-25T05:37:25.534692+0000","last_became_active":"2023-08-25T05:37:24.532366+0000","last_became_peered":"2023-08-25T05:37:24.532366+0000","last_unstale":"2023-08-25T05:37:25.534692+0000","last_undegraded":"2023-08-25T05:37:25.534692+0000","last_fullsized":"2023-08-25T05:37:25.534692+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:28:52.144447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945968+0000","last_change":"2023-08-25T05:37:24.535380+0000","last_active":"2023-08-25T05:37:25.945968+0000","last_peered":"2023-08-25T05:37:25.945968+0000","last_clean":"2023-08-25T05:37:25.945968+0000","last_became_active":"2023-08-25T05:37:24.534767+0000","last_became_peered":"2023-08-25T05:37:24.534767+0000","last_unstale":"2023-08-25T05:37:25.945968+0000","last_undegraded":"2023-08-25T05:37:25.945968+0000","last_fullsized":"2023-08-25T05:37:25.945968+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:06:33.432253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946749+0000","last_change":"2023-08-25T05:37:24.552244+0000","last_active":"2023-08-25T05:37:25.946749+0000","last_peered":"2023-08-25T05:37:25.946749+0000","last_clean":"2023-08-25T05:37:25.946749+0000","last_became_active":"2023-08-25T05:37:24.551943+0000","last_became_peered":"2023-08-25T05:37:24.551943+0000","last_unstale":"2023-08-25T05:37:25.946749+0000","last_undegraded":"2023-08-25T05:37:25.946749+0000","last_fullsized":"2023-08-25T05:37:25.946749+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:44:49.308482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535135+0000","last_change":"2023-08-25T05:37:24.546795+0000","last_active":"2023-08-25T05:37:25.535135+0000","last_peered":"2023-08-25T05:37:25.535135+0000","last_clean":"2023-08-25T05:37:25.535135+0000","last_became_active":"2023-08-25T05:37:24.546491+0000","last_became_peered":"2023-08-25T05:37:24.546491+0000","last_unstale":"2023-08-25T05:37:25.535135+0000","last_undegraded":"2023-08-25T05:37:25.535135+0000","last_fullsized":"2023-08-25T05:37:25.535135+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:00.912224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535914+0000","last_change":"2023-08-25T05:37:24.547692+0000","last_active":"2023-08-25T05:37:25.535914+0000","last_peered":"2023-08-25T05:37:25.535914+0000","last_clean":"2023-08-25T05:37:25.535914+0000","last_became_active":"2023-08-25T05:37:24.547384+0000","last_became_peered":"2023-08-25T05:37:24.547384+0000","last_unstale":"2023-08-25T05:37:25.535914+0000","last_undegraded":"2023-08-25T05:37:25.535914+0000","last_fullsized":"2023-08-25T05:37:25.535914+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:15:56.203680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535905+0000","last_change":"2023-08-25T05:37:24.547956+0000","last_active":"2023-08-25T05:37:25.535905+0000","last_peered":"2023-08-25T05:37:25.535905+0000","last_clean":"2023-08-25T05:37:25.535905+0000","last_became_active":"2023-08-25T05:37:24.547672+0000","last_became_peered":"2023-08-25T05:37:24.547672+0000","last_unstale":"2023-08-25T05:37:25.535905+0000","last_undegraded":"2023-08-25T05:37:25.535905+0000","last_fullsized":"2023-08-25T05:37:25.535905+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:56:09.207727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535528+0000","last_change":"2023-08-25T05:37:24.533024+0000","last_active":"2023-08-25T05:37:25.535528+0000","last_peered":"2023-08-25T05:37:25.535528+0000","last_clean":"2023-08-25T05:37:25.535528+0000","last_became_active":"2023-08-25T05:37:24.532738+0000","last_became_peered":"2023-08-25T05:37:24.532738+0000","last_unstale":"2023-08-25T05:37:25.535528+0000","last_undegraded":"2023-08-25T05:37:25.535528+0000","last_fullsized":"2023-08-25T05:37:25.535528+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:37:07.452993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535438+0000","last_change":"2023-08-25T05:37:24.556390+0000","last_active":"2023-08-25T05:37:25.535438+0000","last_peered":"2023-08-25T05:37:25.535438+0000","last_clean":"2023-08-25T05:37:25.535438+0000","last_became_active":"2023-08-25T05:37:24.556024+0000","last_became_peered":"2023-08-25T05:37:24.556024+0000","last_unstale":"2023-08-25T05:37:25.535438+0000","last_undegraded":"2023-08-25T05:37:25.535438+0000","last_fullsized":"2023-08-25T05:37:25.535438+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:57:51.562974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947080+0000","last_change":"2023-08-25T05:37:24.551353+0000","last_active":"2023-08-25T05:37:25.947080+0000","last_peered":"2023-08-25T05:37:25.947080+0000","last_clean":"2023-08-25T05:37:25.947080+0000","last_became_active":"2023-08-25T05:37:24.550781+0000","last_became_peered":"2023-08-25T05:37:24.550781+0000","last_unstale":"2023-08-25T05:37:25.947080+0000","last_undegraded":"2023-08-25T05:37:25.947080+0000","last_fullsized":"2023-08-25T05:37:25.947080+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:58.661092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946988+0000","last_change":"2023-08-25T05:37:24.554168+0000","last_active":"2023-08-25T05:37:25.946988+0000","last_peered":"2023-08-25T05:37:25.946988+0000","last_clean":"2023-08-25T05:37:25.946988+0000","last_became_active":"2023-08-25T05:37:24.552463+0000","last_became_peered":"2023-08-25T05:37:24.552463+0000","last_unstale":"2023-08-25T05:37:25.946988+0000","last_undegraded":"2023-08-25T05:37:25.946988+0000","last_fullsized":"2023-08-25T05:37:25.946988+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:14:34.953794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945755+0000","last_change":"2023-08-25T05:37:24.555483+0000","last_active":"2023-08-25T05:37:25.945755+0000","last_peered":"2023-08-25T05:37:25.945755+0000","last_clean":"2023-08-25T05:37:25.945755+0000","last_became_active":"2023-08-25T05:37:24.555033+0000","last_became_peered":"2023-08-25T05:37:24.555033+0000","last_unstale":"2023-08-25T05:37:25.945755+0000","last_undegraded":"2023-08-25T05:37:25.945755+0000","last_fullsized":"2023-08-25T05:37:25.945755+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:15:24.769439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946584+0000","last_change":"2023-08-25T05:37:24.559438+0000","last_active":"2023-08-25T05:37:25.946584+0000","last_peered":"2023-08-25T05:37:25.946584+0000","last_clean":"2023-08-25T05:37:25.946584+0000","last_became_active":"2023-08-25T05:37:24.559145+0000","last_became_peered":"2023-08-25T05:37:24.559145+0000","last_unstale":"2023-08-25T05:37:25.946584+0000","last_undegraded":"2023-08-25T05:37:25.946584+0000","last_fullsized":"2023-08-25T05:37:25.946584+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:00:18.745428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946405+0000","last_change":"2023-08-25T05:37:24.541944+0000","last_active":"2023-08-25T05:37:25.946405+0000","last_peered":"2023-08-25T05:37:25.946405+0000","last_clean":"2023-08-25T05:37:25.946405+0000","last_became_active":"2023-08-25T05:37:24.541431+0000","last_became_peered":"2023-08-25T05:37:24.541431+0000","last_unstale":"2023-08-25T05:37:25.946405+0000","last_undegraded":"2023-08-25T05:37:25.946405+0000","last_fullsized":"2023-08-25T05:37:25.946405+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:21:16.606470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946369+0000","last_change":"2023-08-25T05:37:24.553682+0000","last_active":"2023-08-25T05:37:25.946369+0000","last_peered":"2023-08-25T05:37:25.946369+0000","last_clean":"2023-08-25T05:37:25.946369+0000","last_became_active":"2023-08-25T05:37:24.553346+0000","last_became_peered":"2023-08-25T05:37:24.553346+0000","last_unstale":"2023-08-25T05:37:25.946369+0000","last_undegraded":"2023-08-25T05:37:25.946369+0000","last_fullsized":"2023-08-25T05:37:25.946369+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:02:51.650825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946048+0000","last_change":"2023-08-25T05:37:24.549328+0000","last_active":"2023-08-25T05:37:25.946048+0000","last_peered":"2023-08-25T05:37:25.946048+0000","last_clean":"2023-08-25T05:37:25.946048+0000","last_became_active":"2023-08-25T05:37:24.549039+0000","last_became_peered":"2023-08-25T05:37:24.549039+0000","last_unstale":"2023-08-25T05:37:25.946048+0000","last_undegraded":"2023-08-25T05:37:25.946048+0000","last_fullsized":"2023-08-25T05:37:25.946048+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:49:12.761722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535574+0000","last_change":"2023-08-25T05:37:24.546985+0000","last_active":"2023-08-25T05:37:25.535574+0000","last_peered":"2023-08-25T05:37:25.535574+0000","last_clean":"2023-08-25T05:37:25.535574+0000","last_became_active":"2023-08-25T05:37:24.546612+0000","last_became_peered":"2023-08-25T05:37:24.546612+0000","last_unstale":"2023-08-25T05:37:25.535574+0000","last_undegraded":"2023-08-25T05:37:25.535574+0000","last_fullsized":"2023-08-25T05:37:25.535574+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:48:59.505607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945696+0000","last_change":"2023-08-25T05:37:24.553008+0000","last_active":"2023-08-25T05:37:25.945696+0000","last_peered":"2023-08-25T05:37:25.945696+0000","last_clean":"2023-08-25T05:37:25.945696+0000","last_became_active":"2023-08-25T05:37:24.552707+0000","last_became_peered":"2023-08-25T05:37:24.552707+0000","last_unstale":"2023-08-25T05:37:25.945696+0000","last_undegraded":"2023-08-25T05:37:25.945696+0000","last_fullsized":"2023-08-25T05:37:25.945696+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:32:17.258659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945561+0000","last_change":"2023-08-25T05:37:24.550494+0000","last_active":"2023-08-25T05:37:25.945561+0000","last_peered":"2023-08-25T05:37:25.945561+0000","last_clean":"2023-08-25T05:37:25.945561+0000","last_became_active":"2023-08-25T05:37:24.550200+0000","last_became_peered":"2023-08-25T05:37:24.550200+0000","last_unstale":"2023-08-25T05:37:25.945561+0000","last_undegraded":"2023-08-25T05:37:25.945561+0000","last_fullsized":"2023-08-25T05:37:25.945561+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:42:44.478485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945711+0000","last_change":"2023-08-25T05:37:24.553860+0000","last_active":"2023-08-25T05:37:25.945711+0000","last_peered":"2023-08-25T05:37:25.945711+0000","last_clean":"2023-08-25T05:37:25.945711+0000","last_became_active":"2023-08-25T05:37:24.553548+0000","last_became_peered":"2023-08-25T05:37:24.553548+0000","last_unstale":"2023-08-25T05:37:25.945711+0000","last_undegraded":"2023-08-25T05:37:25.945711+0000","last_fullsized":"2023-08-25T05:37:25.945711+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:51.067437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535197+0000","last_change":"2023-08-25T05:37:24.545544+0000","last_active":"2023-08-25T05:37:25.535197+0000","last_peered":"2023-08-25T05:37:25.535197+0000","last_clean":"2023-08-25T05:37:25.535197+0000","last_became_active":"2023-08-25T05:37:24.545268+0000","last_became_peered":"2023-08-25T05:37:24.545268+0000","last_unstale":"2023-08-25T05:37:25.535197+0000","last_undegraded":"2023-08-25T05:37:25.535197+0000","last_fullsized":"2023-08-25T05:37:25.535197+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:57:38.266164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946446+0000","last_change":"2023-08-25T05:37:24.547757+0000","last_active":"2023-08-25T05:37:25.946446+0000","last_peered":"2023-08-25T05:37:25.946446+0000","last_clean":"2023-08-25T05:37:25.946446+0000","last_became_active":"2023-08-25T05:37:24.546529+0000","last_became_peered":"2023-08-25T05:37:24.546529+0000","last_unstale":"2023-08-25T05:37:25.946446+0000","last_undegraded":"2023-08-25T05:37:25.946446+0000","last_fullsized":"2023-08-25T05:37:25.946446+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:49:03.907963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535924+0000","last_change":"2023-08-25T05:37:23.547915+0000","last_active":"2023-08-25T05:37:25.535924+0000","last_peered":"2023-08-25T05:37:25.535924+0000","last_clean":"2023-08-25T05:37:25.535924+0000","last_became_active":"2023-08-25T05:37:23.547587+0000","last_became_peered":"2023-08-25T05:37:23.547587+0000","last_unstale":"2023-08-25T05:37:25.535924+0000","last_undegraded":"2023-08-25T05:37:25.535924+0000","last_fullsized":"2023-08-25T05:37:25.535924+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:00.481841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535833+0000","last_change":"2023-08-25T05:37:24.541483+0000","last_active":"2023-08-25T05:37:25.535833+0000","last_peered":"2023-08-25T05:37:25.535833+0000","last_clean":"2023-08-25T05:37:25.535833+0000","last_became_active":"2023-08-25T05:37:24.541119+0000","last_became_peered":"2023-08-25T05:37:24.541119+0000","last_unstale":"2023-08-25T05:37:25.535833+0000","last_undegraded":"2023-08-25T05:37:25.535833+0000","last_fullsized":"2023-08-25T05:37:25.535833+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:49:16.515630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947179+0000","last_change":"2023-08-25T05:37:23.536250+0000","last_active":"2023-08-25T05:37:25.947179+0000","last_peered":"2023-08-25T05:37:25.947179+0000","last_clean":"2023-08-25T05:37:25.947179+0000","last_became_active":"2023-08-25T05:37:23.535955+0000","last_became_peered":"2023-08-25T05:37:23.535955+0000","last_unstale":"2023-08-25T05:37:25.947179+0000","last_undegraded":"2023-08-25T05:37:25.947179+0000","last_fullsized":"2023-08-25T05:37:25.947179+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:50:29.397169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.536185+0000","last_change":"2023-08-25T05:37:24.541685+0000","last_active":"2023-08-25T05:37:25.536185+0000","last_peered":"2023-08-25T05:37:25.536185+0000","last_clean":"2023-08-25T05:37:25.536185+0000","last_became_active":"2023-08-25T05:37:24.541377+0000","last_became_peered":"2023-08-25T05:37:24.541377+0000","last_unstale":"2023-08-25T05:37:25.536185+0000","last_undegraded":"2023-08-25T05:37:25.536185+0000","last_fullsized":"2023-08-25T05:37:25.536185+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:44:54.540661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"201'3","reported_seq":16,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945901+0000","last_change":"2023-08-25T05:37:23.548267+0000","last_active":"2023-08-25T05:37:25.945901+0000","last_peered":"2023-08-25T05:37:25.945901+0000","last_clean":"2023-08-25T05:37:25.945901+0000","last_became_active":"2023-08-25T05:37:23.547980+0000","last_became_peered":"2023-08-25T05:37:23.547980+0000","last_unstale":"2023-08-25T05:37:25.945901+0000","last_undegraded":"2023-08-25T05:37:25.945901+0000","last_fullsized":"2023-08-25T05:37:25.945901+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:27:46.810103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947163+0000","last_change":"2023-08-25T05:37:24.552195+0000","last_active":"2023-08-25T05:37:25.947163+0000","last_peered":"2023-08-25T05:37:25.947163+0000","last_clean":"2023-08-25T05:37:25.947163+0000","last_became_active":"2023-08-25T05:37:24.549006+0000","last_became_peered":"2023-08-25T05:37:24.549006+0000","last_unstale":"2023-08-25T05:37:25.947163+0000","last_undegraded":"2023-08-25T05:37:25.947163+0000","last_fullsized":"2023-08-25T05:37:25.947163+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:24:14.831092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"201'6","reported_seq":19,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535248+0000","last_change":"2023-08-25T05:37:23.538204+0000","last_active":"2023-08-25T05:37:25.535248+0000","last_peered":"2023-08-25T05:37:25.535248+0000","last_clean":"2023-08-25T05:37:25.535248+0000","last_became_active":"2023-08-25T05:37:23.537792+0000","last_became_peered":"2023-08-25T05:37:23.537792+0000","last_unstale":"2023-08-25T05:37:25.535248+0000","last_undegraded":"2023-08-25T05:37:25.535248+0000","last_fullsized":"2023-08-25T05:37:25.535248+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:27:36.351358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945730+0000","last_change":"2023-08-25T05:37:24.556730+0000","last_active":"2023-08-25T05:37:25.945730+0000","last_peered":"2023-08-25T05:37:25.945730+0000","last_clean":"2023-08-25T05:37:25.945730+0000","last_became_active":"2023-08-25T05:37:24.556341+0000","last_became_peered":"2023-08-25T05:37:24.556341+0000","last_unstale":"2023-08-25T05:37:25.945730+0000","last_undegraded":"2023-08-25T05:37:25.945730+0000","last_fullsized":"2023-08-25T05:37:25.945730+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:25:16.614521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"201'2","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534859+0000","last_change":"2023-08-25T05:37:23.548985+0000","last_active":"2023-08-25T05:37:25.534859+0000","last_peered":"2023-08-25T05:37:25.534859+0000","last_clean":"2023-08-25T05:37:25.534859+0000","last_became_active":"2023-08-25T05:37:23.548687+0000","last_became_peered":"2023-08-25T05:37:23.548687+0000","last_unstale":"2023-08-25T05:37:25.534859+0000","last_undegraded":"2023-08-25T05:37:25.534859+0000","last_fullsized":"2023-08-25T05:37:25.534859+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:04:42.060140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535148+0000","last_change":"2023-08-25T05:37:24.546752+0000","last_active":"2023-08-25T05:37:25.535148+0000","last_peered":"2023-08-25T05:37:25.535148+0000","last_clean":"2023-08-25T05:37:25.535148+0000","last_became_active":"2023-08-25T05:37:24.546439+0000","last_became_peered":"2023-08-25T05:37:24.546439+0000","last_unstale":"2023-08-25T05:37:25.535148+0000","last_undegraded":"2023-08-25T05:37:25.535148+0000","last_fullsized":"2023-08-25T05:37:25.535148+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:31:19.135726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947189+0000","last_change":"2023-08-25T05:37:23.549604+0000","last_active":"2023-08-25T05:37:25.947189+0000","last_peered":"2023-08-25T05:37:25.947189+0000","last_clean":"2023-08-25T05:37:25.947189+0000","last_became_active":"2023-08-25T05:37:23.549308+0000","last_became_peered":"2023-08-25T05:37:23.549308+0000","last_unstale":"2023-08-25T05:37:25.947189+0000","last_undegraded":"2023-08-25T05:37:25.947189+0000","last_fullsized":"2023-08-25T05:37:25.947189+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:06:03.095644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534915+0000","last_change":"2023-08-25T05:37:24.542958+0000","last_active":"2023-08-25T05:37:25.534915+0000","last_peered":"2023-08-25T05:37:25.534915+0000","last_clean":"2023-08-25T05:37:25.534915+0000","last_became_active":"2023-08-25T05:37:24.542607+0000","last_became_peered":"2023-08-25T05:37:24.542607+0000","last_unstale":"2023-08-25T05:37:25.534915+0000","last_undegraded":"2023-08-25T05:37:25.534915+0000","last_fullsized":"2023-08-25T05:37:25.534915+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:25:09.219567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945619+0000","last_change":"2023-08-25T05:37:23.541331+0000","last_active":"2023-08-25T05:37:25.945619+0000","last_peered":"2023-08-25T05:37:25.945619+0000","last_clean":"2023-08-25T05:37:25.945619+0000","last_became_active":"2023-08-25T05:37:23.541030+0000","last_became_peered":"2023-08-25T05:37:23.541030+0000","last_unstale":"2023-08-25T05:37:25.945619+0000","last_undegraded":"2023-08-25T05:37:25.945619+0000","last_fullsized":"2023-08-25T05:37:25.945619+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:55:58.500515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534831+0000","last_change":"2023-08-25T05:37:24.548890+0000","last_active":"2023-08-25T05:37:25.534831+0000","last_peered":"2023-08-25T05:37:25.534831+0000","last_clean":"2023-08-25T05:37:25.534831+0000","last_became_active":"2023-08-25T05:37:24.548602+0000","last_became_peered":"2023-08-25T05:37:24.548602+0000","last_unstale":"2023-08-25T05:37:25.534831+0000","last_undegraded":"2023-08-25T05:37:25.534831+0000","last_fullsized":"2023-08-25T05:37:25.534831+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:59:37.441946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"201'8","reported_seq":21,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945446+0000","last_change":"2023-08-25T05:37:23.547927+0000","last_active":"2023-08-25T05:37:25.945446+0000","last_peered":"2023-08-25T05:37:25.945446+0000","last_clean":"2023-08-25T05:37:25.945446+0000","last_became_active":"2023-08-25T05:37:23.547702+0000","last_became_peered":"2023-08-25T05:37:23.547702+0000","last_unstale":"2023-08-25T05:37:25.945446+0000","last_undegraded":"2023-08-25T05:37:25.945446+0000","last_fullsized":"2023-08-25T05:37:25.945446+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:06.549399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945911+0000","last_change":"2023-08-25T05:37:24.552074+0000","last_active":"2023-08-25T05:37:25.945911+0000","last_peered":"2023-08-25T05:37:25.945911+0000","last_clean":"2023-08-25T05:37:25.945911+0000","last_became_active":"2023-08-25T05:37:24.551757+0000","last_became_peered":"2023-08-25T05:37:24.551757+0000","last_unstale":"2023-08-25T05:37:25.945911+0000","last_undegraded":"2023-08-25T05:37:25.945911+0000","last_fullsized":"2023-08-25T05:37:25.945911+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:48:42.020311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"201'1","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946658+0000","last_change":"2023-08-25T05:37:23.546252+0000","last_active":"2023-08-25T05:37:25.946658+0000","last_peered":"2023-08-25T05:37:25.946658+0000","last_clean":"2023-08-25T05:37:25.946658+0000","last_became_active":"2023-08-25T05:37:23.545932+0000","last_became_peered":"2023-08-25T05:37:23.545932+0000","last_unstale":"2023-08-25T05:37:25.946658+0000","last_undegraded":"2023-08-25T05:37:25.946658+0000","last_fullsized":"2023-08-25T05:37:25.946658+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:39:45.038273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535626+0000","last_change":"2023-08-25T05:37:24.543501+0000","last_active":"2023-08-25T05:37:25.535626+0000","last_peered":"2023-08-25T05:37:25.535626+0000","last_clean":"2023-08-25T05:37:25.535626+0000","last_became_active":"2023-08-25T05:37:24.543196+0000","last_became_peered":"2023-08-25T05:37:24.543196+0000","last_unstale":"2023-08-25T05:37:25.535626+0000","last_undegraded":"2023-08-25T05:37:25.535626+0000","last_fullsized":"2023-08-25T05:37:25.535626+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:21:46.850100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"201'2","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946117+0000","last_change":"2023-08-25T05:37:23.548811+0000","last_active":"2023-08-25T05:37:25.946117+0000","last_peered":"2023-08-25T05:37:25.946117+0000","last_clean":"2023-08-25T05:37:25.946117+0000","last_became_active":"2023-08-25T05:37:23.548482+0000","last_became_peered":"2023-08-25T05:37:23.548482+0000","last_unstale":"2023-08-25T05:37:25.946117+0000","last_undegraded":"2023-08-25T05:37:25.946117+0000","last_fullsized":"2023-08-25T05:37:25.946117+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:38:58.552530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946575+0000","last_change":"2023-08-25T05:37:24.553658+0000","last_active":"2023-08-25T05:37:25.946575+0000","last_peered":"2023-08-25T05:37:25.946575+0000","last_clean":"2023-08-25T05:37:25.946575+0000","last_became_active":"2023-08-25T05:37:24.552951+0000","last_became_peered":"2023-08-25T05:37:24.552951+0000","last_unstale":"2023-08-25T05:37:25.946575+0000","last_undegraded":"2023-08-25T05:37:25.946575+0000","last_fullsized":"2023-08-25T05:37:25.946575+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:23:29.974261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"201'1","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.536130+0000","last_change":"2023-08-25T05:37:23.537881+0000","last_active":"2023-08-25T05:37:25.536130+0000","last_peered":"2023-08-25T05:37:25.536130+0000","last_clean":"2023-08-25T05:37:25.536130+0000","last_became_active":"2023-08-25T05:37:23.537336+0000","last_became_peered":"2023-08-25T05:37:23.537336+0000","last_unstale":"2023-08-25T05:37:25.536130+0000","last_undegraded":"2023-08-25T05:37:25.536130+0000","last_fullsized":"2023-08-25T05:37:25.536130+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:39:50.643839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947197+0000","last_change":"2023-08-25T05:37:24.554823+0000","last_active":"2023-08-25T05:37:25.947197+0000","last_peered":"2023-08-25T05:37:25.947197+0000","last_clean":"2023-08-25T05:37:25.947197+0000","last_became_active":"2023-08-25T05:37:24.554515+0000","last_became_peered":"2023-08-25T05:37:24.554515+0000","last_unstale":"2023-08-25T05:37:25.947197+0000","last_undegraded":"2023-08-25T05:37:25.947197+0000","last_fullsized":"2023-08-25T05:37:25.947197+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:53:07.229342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945988+0000","last_change":"2023-08-25T05:37:23.539762+0000","last_active":"2023-08-25T05:37:25.945988+0000","last_peered":"2023-08-25T05:37:25.945988+0000","last_clean":"2023-08-25T05:37:25.945988+0000","last_became_active":"2023-08-25T05:37:23.539481+0000","last_became_peered":"2023-08-25T05:37:23.539481+0000","last_unstale":"2023-08-25T05:37:25.945988+0000","last_undegraded":"2023-08-25T05:37:25.945988+0000","last_fullsized":"2023-08-25T05:37:25.945988+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:00:44.311947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946660+0000","last_change":"2023-08-25T05:37:24.554762+0000","last_active":"2023-08-25T05:37:25.946660+0000","last_peered":"2023-08-25T05:37:25.946660+0000","last_clean":"2023-08-25T05:37:25.946660+0000","last_became_active":"2023-08-25T05:37:24.554485+0000","last_became_peered":"2023-08-25T05:37:24.554485+0000","last_unstale":"2023-08-25T05:37:25.946660+0000","last_undegraded":"2023-08-25T05:37:25.946660+0000","last_fullsized":"2023-08-25T05:37:25.946660+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:18:54.928517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"201'2","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534974+0000","last_change":"2023-08-25T05:37:23.541541+0000","last_active":"2023-08-25T05:37:25.534974+0000","last_peered":"2023-08-25T05:37:25.534974+0000","last_clean":"2023-08-25T05:37:25.534974+0000","last_became_active":"2023-08-25T05:37:23.540976+0000","last_became_peered":"2023-08-25T05:37:23.540976+0000","last_unstale":"2023-08-25T05:37:25.534974+0000","last_undegraded":"2023-08-25T05:37:25.534974+0000","last_fullsized":"2023-08-25T05:37:25.534974+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:46:36.155036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945530+0000","last_change":"2023-08-25T05:37:24.545173+0000","last_active":"2023-08-25T05:37:25.945530+0000","last_peered":"2023-08-25T05:37:25.945530+0000","last_clean":"2023-08-25T05:37:25.945530+0000","last_became_active":"2023-08-25T05:37:24.544902+0000","last_became_peered":"2023-08-25T05:37:24.544902+0000","last_unstale":"2023-08-25T05:37:25.945530+0000","last_undegraded":"2023-08-25T05:37:25.945530+0000","last_fullsized":"2023-08-25T05:37:25.945530+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:39:55.790643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946159+0000","last_change":"2023-08-25T05:37:23.542964+0000","last_active":"2023-08-25T05:37:25.946159+0000","last_peered":"2023-08-25T05:37:25.946159+0000","last_clean":"2023-08-25T05:37:25.946159+0000","last_became_active":"2023-08-25T05:37:23.542633+0000","last_became_peered":"2023-08-25T05:37:23.542633+0000","last_unstale":"2023-08-25T05:37:25.946159+0000","last_undegraded":"2023-08-25T05:37:25.946159+0000","last_fullsized":"2023-08-25T05:37:25.946159+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:17:16.343159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945930+0000","last_change":"2023-08-25T05:37:24.547086+0000","last_active":"2023-08-25T05:37:25.945930+0000","last_peered":"2023-08-25T05:37:25.945930+0000","last_clean":"2023-08-25T05:37:25.945930+0000","last_became_active":"2023-08-25T05:37:24.546792+0000","last_became_peered":"2023-08-25T05:37:24.546792+0000","last_unstale":"2023-08-25T05:37:25.945930+0000","last_undegraded":"2023-08-25T05:37:25.945930+0000","last_fullsized":"2023-08-25T05:37:25.945930+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:59:11.190834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945918+0000","last_change":"2023-08-25T05:37:23.544805+0000","last_active":"2023-08-25T05:37:25.945918+0000","last_peered":"2023-08-25T05:37:25.945918+0000","last_clean":"2023-08-25T05:37:25.945918+0000","last_became_active":"2023-08-25T05:37:23.543947+0000","last_became_peered":"2023-08-25T05:37:23.543947+0000","last_unstale":"2023-08-25T05:37:25.945918+0000","last_undegraded":"2023-08-25T05:37:25.945918+0000","last_fullsized":"2023-08-25T05:37:25.945918+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:48:34.380051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535332+0000","last_change":"2023-08-25T05:37:24.546431+0000","last_active":"2023-08-25T05:37:25.535332+0000","last_peered":"2023-08-25T05:37:25.535332+0000","last_clean":"2023-08-25T05:37:25.535332+0000","last_became_active":"2023-08-25T05:37:24.545627+0000","last_became_peered":"2023-08-25T05:37:24.545627+0000","last_unstale":"2023-08-25T05:37:25.535332+0000","last_undegraded":"2023-08-25T05:37:25.535332+0000","last_fullsized":"2023-08-25T05:37:25.535332+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:26:02.366734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535593+0000","last_change":"2023-08-25T05:37:23.534208+0000","last_active":"2023-08-25T05:37:25.535593+0000","last_peered":"2023-08-25T05:37:25.535593+0000","last_clean":"2023-08-25T05:37:25.535593+0000","last_became_active":"2023-08-25T05:37:23.533909+0000","last_became_peered":"2023-08-25T05:37:23.533909+0000","last_unstale":"2023-08-25T05:37:25.535593+0000","last_undegraded":"2023-08-25T05:37:25.535593+0000","last_fullsized":"2023-08-25T05:37:25.535593+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:21:30.377787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946049+0000","last_change":"2023-08-25T05:37:24.542966+0000","last_active":"2023-08-25T05:37:25.946049+0000","last_peered":"2023-08-25T05:37:25.946049+0000","last_clean":"2023-08-25T05:37:25.946049+0000","last_became_active":"2023-08-25T05:37:24.542653+0000","last_became_peered":"2023-08-25T05:37:24.542653+0000","last_unstale":"2023-08-25T05:37:25.946049+0000","last_undegraded":"2023-08-25T05:37:25.946049+0000","last_fullsized":"2023-08-25T05:37:25.946049+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:30.878640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"201'2","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946363+0000","last_change":"2023-08-25T05:37:23.545045+0000","last_active":"2023-08-25T05:37:25.946363+0000","last_peered":"2023-08-25T05:37:25.946363+0000","last_clean":"2023-08-25T05:37:25.946363+0000","last_became_active":"2023-08-25T05:37:23.544775+0000","last_became_peered":"2023-08-25T05:37:23.544775+0000","last_unstale":"2023-08-25T05:37:25.946363+0000","last_undegraded":"2023-08-25T05:37:25.946363+0000","last_fullsized":"2023-08-25T05:37:25.946363+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:19:29.581252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947238+0000","last_change":"2023-08-25T05:37:24.553584+0000","last_active":"2023-08-25T05:37:25.947238+0000","last_peered":"2023-08-25T05:37:25.947238+0000","last_clean":"2023-08-25T05:37:25.947238+0000","last_became_active":"2023-08-25T05:37:24.552603+0000","last_became_peered":"2023-08-25T05:37:24.552603+0000","last_unstale":"2023-08-25T05:37:25.947238+0000","last_undegraded":"2023-08-25T05:37:25.947238+0000","last_fullsized":"2023-08-25T05:37:25.947238+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:13:14.044256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946133+0000","last_change":"2023-08-25T05:37:23.544372+0000","last_active":"2023-08-25T05:37:25.946133+0000","last_peered":"2023-08-25T05:37:25.946133+0000","last_clean":"2023-08-25T05:37:25.946133+0000","last_became_active":"2023-08-25T05:37:23.543939+0000","last_became_peered":"2023-08-25T05:37:23.543939+0000","last_unstale":"2023-08-25T05:37:25.946133+0000","last_undegraded":"2023-08-25T05:37:25.946133+0000","last_fullsized":"2023-08-25T05:37:25.946133+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:16.893751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946120+0000","last_change":"2023-08-25T05:37:24.545017+0000","last_active":"2023-08-25T05:37:25.946120+0000","last_peered":"2023-08-25T05:37:25.946120+0000","last_clean":"2023-08-25T05:37:25.946120+0000","last_became_active":"2023-08-25T05:37:24.544711+0000","last_became_peered":"2023-08-25T05:37:24.544711+0000","last_unstale":"2023-08-25T05:37:25.946120+0000","last_undegraded":"2023-08-25T05:37:25.946120+0000","last_fullsized":"2023-08-25T05:37:25.946120+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:52:58.754758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535844+0000","last_change":"2023-08-25T05:37:23.538786+0000","last_active":"2023-08-25T05:37:25.535844+0000","last_peered":"2023-08-25T05:37:25.535844+0000","last_clean":"2023-08-25T05:37:25.535844+0000","last_became_active":"2023-08-25T05:37:23.538507+0000","last_became_peered":"2023-08-25T05:37:23.538507+0000","last_unstale":"2023-08-25T05:37:25.535844+0000","last_undegraded":"2023-08-25T05:37:25.535844+0000","last_fullsized":"2023-08-25T05:37:25.535844+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:37.306930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946527+0000","last_change":"2023-08-25T05:37:24.541718+0000","last_active":"2023-08-25T05:37:25.946527+0000","last_peered":"2023-08-25T05:37:25.946527+0000","last_clean":"2023-08-25T05:37:25.946527+0000","last_became_active":"2023-08-25T05:37:24.541001+0000","last_became_peered":"2023-08-25T05:37:24.541001+0000","last_unstale":"2023-08-25T05:37:25.946527+0000","last_undegraded":"2023-08-25T05:37:25.946527+0000","last_fullsized":"2023-08-25T05:37:25.946527+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:51:00.799593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535651+0000","last_change":"2023-08-25T05:37:23.543861+0000","last_active":"2023-08-25T05:37:25.535651+0000","last_peered":"2023-08-25T05:37:25.535651+0000","last_clean":"2023-08-25T05:37:25.535651+0000","last_became_active":"2023-08-25T05:37:23.543553+0000","last_became_peered":"2023-08-25T05:37:23.543553+0000","last_unstale":"2023-08-25T05:37:25.535651+0000","last_undegraded":"2023-08-25T05:37:25.535651+0000","last_fullsized":"2023-08-25T05:37:25.535651+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:16:41.083760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535494+0000","last_change":"2023-08-25T05:37:24.542295+0000","last_active":"2023-08-25T05:37:25.535494+0000","last_peered":"2023-08-25T05:37:25.535494+0000","last_clean":"2023-08-25T05:37:25.535494+0000","last_became_active":"2023-08-25T05:37:24.541954+0000","last_became_peered":"2023-08-25T05:37:24.541954+0000","last_unstale":"2023-08-25T05:37:25.535494+0000","last_undegraded":"2023-08-25T05:37:25.535494+0000","last_fullsized":"2023-08-25T05:37:25.535494+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:39:29.777580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946028+0000","last_change":"2023-08-25T05:37:23.538266+0000","last_active":"2023-08-25T05:37:25.946028+0000","last_peered":"2023-08-25T05:37:25.946028+0000","last_clean":"2023-08-25T05:37:25.946028+0000","last_became_active":"2023-08-25T05:37:23.537926+0000","last_became_peered":"2023-08-25T05:37:23.537926+0000","last_unstale":"2023-08-25T05:37:25.946028+0000","last_undegraded":"2023-08-25T05:37:25.946028+0000","last_fullsized":"2023-08-25T05:37:25.946028+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:23:16.862189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534754+0000","last_change":"2023-08-25T05:37:24.534975+0000","last_active":"2023-08-25T05:37:25.534754+0000","last_peered":"2023-08-25T05:37:25.534754+0000","last_clean":"2023-08-25T05:37:25.534754+0000","last_became_active":"2023-08-25T05:37:24.532274+0000","last_became_peered":"2023-08-25T05:37:24.532274+0000","last_unstale":"2023-08-25T05:37:25.534754+0000","last_undegraded":"2023-08-25T05:37:25.534754+0000","last_fullsized":"2023-08-25T05:37:25.534754+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:59:23.180394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945680+0000","last_change":"2023-08-25T05:37:23.540495+0000","last_active":"2023-08-25T05:37:25.945680+0000","last_peered":"2023-08-25T05:37:25.945680+0000","last_clean":"2023-08-25T05:37:25.945680+0000","last_became_active":"2023-08-25T05:37:23.540219+0000","last_became_peered":"2023-08-25T05:37:23.540219+0000","last_unstale":"2023-08-25T05:37:25.945680+0000","last_undegraded":"2023-08-25T05:37:25.945680+0000","last_fullsized":"2023-08-25T05:37:25.945680+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:03:56.780044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947065+0000","last_change":"2023-08-25T05:37:24.557494+0000","last_active":"2023-08-25T05:37:25.947065+0000","last_peered":"2023-08-25T05:37:25.947065+0000","last_clean":"2023-08-25T05:37:25.947065+0000","last_became_active":"2023-08-25T05:37:24.555335+0000","last_became_peered":"2023-08-25T05:37:24.555335+0000","last_unstale":"2023-08-25T05:37:25.947065+0000","last_undegraded":"2023-08-25T05:37:25.947065+0000","last_fullsized":"2023-08-25T05:37:25.947065+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:24:11.216210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945773+0000","last_change":"2023-08-25T05:37:23.539559+0000","last_active":"2023-08-25T05:37:25.945773+0000","last_peered":"2023-08-25T05:37:25.945773+0000","last_clean":"2023-08-25T05:37:25.945773+0000","last_became_active":"2023-08-25T05:37:23.539274+0000","last_became_peered":"2023-08-25T05:37:23.539274+0000","last_unstale":"2023-08-25T05:37:25.945773+0000","last_undegraded":"2023-08-25T05:37:25.945773+0000","last_fullsized":"2023-08-25T05:37:25.945773+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:07:52.604161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945927+0000","last_change":"2023-08-25T05:37:24.553628+0000","last_active":"2023-08-25T05:37:25.945927+0000","last_peered":"2023-08-25T05:37:25.945927+0000","last_clean":"2023-08-25T05:37:25.945927+0000","last_became_active":"2023-08-25T05:37:24.553348+0000","last_became_peered":"2023-08-25T05:37:24.553348+0000","last_unstale":"2023-08-25T05:37:25.945927+0000","last_undegraded":"2023-08-25T05:37:25.945927+0000","last_fullsized":"2023-08-25T05:37:25.945927+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:32:16.659695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535724+0000","last_change":"2023-08-25T05:37:23.539963+0000","last_active":"2023-08-25T05:37:25.535724+0000","last_peered":"2023-08-25T05:37:25.535724+0000","last_clean":"2023-08-25T05:37:25.535724+0000","last_became_active":"2023-08-25T05:37:23.539671+0000","last_became_peered":"2023-08-25T05:37:23.539671+0000","last_unstale":"2023-08-25T05:37:25.535724+0000","last_undegraded":"2023-08-25T05:37:25.535724+0000","last_fullsized":"2023-08-25T05:37:25.535724+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:02:54.269091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535936+0000","last_change":"2023-08-25T05:37:24.540958+0000","last_active":"2023-08-25T05:37:25.535936+0000","last_peered":"2023-08-25T05:37:25.535936+0000","last_clean":"2023-08-25T05:37:25.535936+0000","last_became_active":"2023-08-25T05:37:24.539077+0000","last_became_peered":"2023-08-25T05:37:24.539077+0000","last_unstale":"2023-08-25T05:37:25.535936+0000","last_undegraded":"2023-08-25T05:37:25.535936+0000","last_fullsized":"2023-08-25T05:37:25.535936+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:22:31.241833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945498+0000","last_change":"2023-08-25T05:37:23.545056+0000","last_active":"2023-08-25T05:37:25.945498+0000","last_peered":"2023-08-25T05:37:25.945498+0000","last_clean":"2023-08-25T05:37:25.945498+0000","last_became_active":"2023-08-25T05:37:23.544817+0000","last_became_peered":"2023-08-25T05:37:23.544817+0000","last_unstale":"2023-08-25T05:37:25.945498+0000","last_undegraded":"2023-08-25T05:37:25.945498+0000","last_fullsized":"2023-08-25T05:37:25.945498+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:56:49.193533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"191'3653","reported_seq":4647,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946353+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:37:25.946353+0000","last_peered":"2023-08-25T05:37:25.946353+0000","last_clean":"2023-08-25T05:37:25.946353+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:37:25.946353+0000","last_undegraded":"2023-08-25T05:37:25.946353+0000","last_fullsized":"2023-08-25T05:37:25.946353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3653,"log_dups_size":0,"ondisk_log_size":3653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:07:43.317595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2096,"num_read_kb":4403,"num_write":565,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":360,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945672+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:37:25.945672+0000","last_peered":"2023-08-25T05:37:25.945672+0000","last_clean":"2023-08-25T05:37:25.945672+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:37:25.945672+0000","last_undegraded":"2023-08-25T05:37:25.945672+0000","last_fullsized":"2023-08-25T05:37:25.945672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:20:26.158476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534798+0000","last_change":"2023-08-25T05:37:24.542467+0000","last_active":"2023-08-25T05:37:25.534798+0000","last_peered":"2023-08-25T05:37:25.534798+0000","last_clean":"2023-08-25T05:37:25.534798+0000","last_became_active":"2023-08-25T05:37:24.542059+0000","last_became_peered":"2023-08-25T05:37:24.542059+0000","last_unstale":"2023-08-25T05:37:25.534798+0000","last_undegraded":"2023-08-25T05:37:25.534798+0000","last_fullsized":"2023-08-25T05:37:25.534798+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:20:35.194400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"201'1","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535425+0000","last_change":"2023-08-25T05:37:23.540887+0000","last_active":"2023-08-25T05:37:25.535425+0000","last_peered":"2023-08-25T05:37:25.535425+0000","last_clean":"2023-08-25T05:37:25.535425+0000","last_became_active":"2023-08-25T05:37:23.540612+0000","last_became_peered":"2023-08-25T05:37:23.540612+0000","last_unstale":"2023-08-25T05:37:25.535425+0000","last_undegraded":"2023-08-25T05:37:25.535425+0000","last_fullsized":"2023-08-25T05:37:25.535425+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:25:21.656718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":351,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946256+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:37:25.946256+0000","last_peered":"2023-08-25T05:37:25.946256+0000","last_clean":"2023-08-25T05:37:25.946256+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:37:25.946256+0000","last_undegraded":"2023-08-25T05:37:25.946256+0000","last_fullsized":"2023-08-25T05:37:25.946256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:37:35.236035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946896+0000","last_change":"2023-08-25T05:37:24.550171+0000","last_active":"2023-08-25T05:37:25.946896+0000","last_peered":"2023-08-25T05:37:25.946896+0000","last_clean":"2023-08-25T05:37:25.946896+0000","last_became_active":"2023-08-25T05:37:24.548942+0000","last_became_peered":"2023-08-25T05:37:24.548942+0000","last_unstale":"2023-08-25T05:37:25.946896+0000","last_undegraded":"2023-08-25T05:37:25.946896+0000","last_fullsized":"2023-08-25T05:37:25.946896+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:21:55.876731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"201'1","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946034+0000","last_change":"2023-08-25T05:37:23.548551+0000","last_active":"2023-08-25T05:37:25.946034+0000","last_peered":"2023-08-25T05:37:25.946034+0000","last_clean":"2023-08-25T05:37:25.946034+0000","last_became_active":"2023-08-25T05:37:23.548254+0000","last_became_peered":"2023-08-25T05:37:23.548254+0000","last_unstale":"2023-08-25T05:37:25.946034+0000","last_undegraded":"2023-08-25T05:37:25.946034+0000","last_fullsized":"2023-08-25T05:37:25.946034+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:10:03.239783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":360,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946039+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:37:25.946039+0000","last_peered":"2023-08-25T05:37:25.946039+0000","last_clean":"2023-08-25T05:37:25.946039+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:37:25.946039+0000","last_undegraded":"2023-08-25T05:37:25.946039+0000","last_fullsized":"2023-08-25T05:37:25.946039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:41:11.257962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947341+0000","last_change":"2023-08-25T05:37:24.548621+0000","last_active":"2023-08-25T05:37:25.947341+0000","last_peered":"2023-08-25T05:37:25.947341+0000","last_clean":"2023-08-25T05:37:25.947341+0000","last_became_active":"2023-08-25T05:37:24.548234+0000","last_became_peered":"2023-08-25T05:37:24.548234+0000","last_unstale":"2023-08-25T05:37:25.947341+0000","last_undegraded":"2023-08-25T05:37:25.947341+0000","last_fullsized":"2023-08-25T05:37:25.947341+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:37:00.408184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534798+0000","last_change":"2023-08-25T05:37:23.535156+0000","last_active":"2023-08-25T05:37:25.534798+0000","last_peered":"2023-08-25T05:37:25.534798+0000","last_clean":"2023-08-25T05:37:25.534798+0000","last_became_active":"2023-08-25T05:37:23.534879+0000","last_became_peered":"2023-08-25T05:37:23.534879+0000","last_unstale":"2023-08-25T05:37:25.534798+0000","last_undegraded":"2023-08-25T05:37:25.534798+0000","last_fullsized":"2023-08-25T05:37:25.534798+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:01:28.425270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":360,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945826+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:37:25.945826+0000","last_peered":"2023-08-25T05:37:25.945826+0000","last_clean":"2023-08-25T05:37:25.945826+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:37:25.945826+0000","last_undegraded":"2023-08-25T05:37:25.945826+0000","last_fullsized":"2023-08-25T05:37:25.945826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:22:48.193179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946355+0000","last_change":"2023-08-25T05:37:24.544922+0000","last_active":"2023-08-25T05:37:25.946355+0000","last_peered":"2023-08-25T05:37:25.946355+0000","last_clean":"2023-08-25T05:37:25.946355+0000","last_became_active":"2023-08-25T05:37:24.544633+0000","last_became_peered":"2023-08-25T05:37:24.544633+0000","last_unstale":"2023-08-25T05:37:25.946355+0000","last_undegraded":"2023-08-25T05:37:25.946355+0000","last_fullsized":"2023-08-25T05:37:25.946355+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:46:30.308620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"201'4","reported_seq":17,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946273+0000","last_change":"2023-08-25T05:37:23.545829+0000","last_active":"2023-08-25T05:37:25.946273+0000","last_peered":"2023-08-25T05:37:25.946273+0000","last_clean":"2023-08-25T05:37:25.946273+0000","last_became_active":"2023-08-25T05:37:23.545567+0000","last_became_peered":"2023-08-25T05:37:23.545567+0000","last_unstale":"2023-08-25T05:37:25.946273+0000","last_undegraded":"2023-08-25T05:37:25.946273+0000","last_fullsized":"2023-08-25T05:37:25.946273+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:53:54.916939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":390,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946952+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:37:25.946952+0000","last_peered":"2023-08-25T05:37:25.946952+0000","last_clean":"2023-08-25T05:37:25.946952+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:37:25.946952+0000","last_undegraded":"2023-08-25T05:37:25.946952+0000","last_fullsized":"2023-08-25T05:37:25.946952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:27:24.654491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946312+0000","last_change":"2023-08-25T05:37:24.548353+0000","last_active":"2023-08-25T05:37:25.946312+0000","last_peered":"2023-08-25T05:37:25.946312+0000","last_clean":"2023-08-25T05:37:25.946312+0000","last_became_active":"2023-08-25T05:37:24.546455+0000","last_became_peered":"2023-08-25T05:37:24.546455+0000","last_unstale":"2023-08-25T05:37:25.946312+0000","last_undegraded":"2023-08-25T05:37:25.946312+0000","last_fullsized":"2023-08-25T05:37:25.946312+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:56:59.133449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"201'1","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535883+0000","last_change":"2023-08-25T05:37:23.538911+0000","last_active":"2023-08-25T05:37:25.535883+0000","last_peered":"2023-08-25T05:37:25.535883+0000","last_clean":"2023-08-25T05:37:25.535883+0000","last_became_active":"2023-08-25T05:37:23.538567+0000","last_became_peered":"2023-08-25T05:37:23.538567+0000","last_unstale":"2023-08-25T05:37:25.535883+0000","last_undegraded":"2023-08-25T05:37:25.535883+0000","last_fullsized":"2023-08-25T05:37:25.535883+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:24:04.911704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":350,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946253+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:37:25.946253+0000","last_peered":"2023-08-25T05:37:25.946253+0000","last_clean":"2023-08-25T05:37:25.946253+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:37:25.946253+0000","last_undegraded":"2023-08-25T05:37:25.946253+0000","last_fullsized":"2023-08-25T05:37:25.946253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:13:20.329031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946323+0000","last_change":"2023-08-25T05:37:24.555758+0000","last_active":"2023-08-25T05:37:25.946323+0000","last_peered":"2023-08-25T05:37:25.946323+0000","last_clean":"2023-08-25T05:37:25.946323+0000","last_became_active":"2023-08-25T05:37:24.555465+0000","last_became_peered":"2023-08-25T05:37:24.555465+0000","last_unstale":"2023-08-25T05:37:25.946323+0000","last_undegraded":"2023-08-25T05:37:25.946323+0000","last_fullsized":"2023-08-25T05:37:25.946323+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:15:54.144699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"201'2","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946034+0000","last_change":"2023-08-25T05:37:23.537014+0000","last_active":"2023-08-25T05:37:25.946034+0000","last_peered":"2023-08-25T05:37:25.946034+0000","last_clean":"2023-08-25T05:37:25.946034+0000","last_became_active":"2023-08-25T05:37:23.536588+0000","last_became_peered":"2023-08-25T05:37:23.536588+0000","last_unstale":"2023-08-25T05:37:25.946034+0000","last_undegraded":"2023-08-25T05:37:25.946034+0000","last_fullsized":"2023-08-25T05:37:25.946034+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:27:40.337374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":388,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947298+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:37:25.947298+0000","last_peered":"2023-08-25T05:37:25.947298+0000","last_clean":"2023-08-25T05:37:25.947298+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:37:25.947298+0000","last_undegraded":"2023-08-25T05:37:25.947298+0000","last_fullsized":"2023-08-25T05:37:25.947298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:56:44.758824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.536308+0000","last_change":"2023-08-25T05:37:24.540049+0000","last_active":"2023-08-25T05:37:25.536308+0000","last_peered":"2023-08-25T05:37:25.536308+0000","last_clean":"2023-08-25T05:37:25.536308+0000","last_became_active":"2023-08-25T05:37:24.538824+0000","last_became_peered":"2023-08-25T05:37:24.538824+0000","last_unstale":"2023-08-25T05:37:25.536308+0000","last_undegraded":"2023-08-25T05:37:25.536308+0000","last_fullsized":"2023-08-25T05:37:25.536308+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:27:53.789408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"201'2","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535172+0000","last_change":"2023-08-25T05:37:23.540783+0000","last_active":"2023-08-25T05:37:25.535172+0000","last_peered":"2023-08-25T05:37:25.535172+0000","last_clean":"2023-08-25T05:37:25.535172+0000","last_became_active":"2023-08-25T05:37:23.540346+0000","last_became_peered":"2023-08-25T05:37:23.540346+0000","last_unstale":"2023-08-25T05:37:25.535172+0000","last_undegraded":"2023-08-25T05:37:25.535172+0000","last_fullsized":"2023-08-25T05:37:25.535172+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:46.613445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":412,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.536309+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:37:25.536309+0000","last_peered":"2023-08-25T05:37:25.536309+0000","last_clean":"2023-08-25T05:37:25.536309+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:37:25.536309+0000","last_undegraded":"2023-08-25T05:37:25.536309+0000","last_fullsized":"2023-08-25T05:37:25.536309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:59:16.212909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2096,"num_read_kb":4403,"num_write":565,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3653,"ondisk_log_size":3653,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510569,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52276,"kb_used_data":3044,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319564,"statfs":{"total":96636764160,"available":96583233536,"internally_reserved":0,"allocated":3117056,"data_stored":1873058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.40999999999999998},"max":{"1min":0.94599999999999995,"5min":0.95499999999999996,"15min":1.0169999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.441},"max":{"1min":0.90700000000000003,"5min":1.016,"15min":1.0189999999999999},"last":0.73799999999999999}]},{"osd":1,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93799999999999994,"5min":0.99199999999999999,"15min":1.054},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.749,"15min":0.77300000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.84999999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.753},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77300000000000002,"15min":0.76800000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.53600000000000003},"max":{"1min":1.0129999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.70999999999999996}]},{"osd":3,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76700000000000002,"15min":0.77000000000000002},"min":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94499999999999995,"5min":1.006,"15min":1.006},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98299999999999998,"5min":1.0600000000000001,"15min":1.0680000000000001},"last":0.76400000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0449999999999999,"5min":1.163,"15min":1.163},"last":0.69099999999999995}]},{"osd":5,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.36599999999999999},"max":{"1min":0.97199999999999998,"5min":0.997,"15min":1.1120000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.501,"5min":0.44,"15min":0.42699999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.90200000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.74399999999999999,"15min":0.73099999999999998},"min":{"1min":0.50900000000000001,"5min":0.499,"15min":0.47999999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.71499999999999997,"15min":0.69999999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0900000000000001,"5min":1.119,"15min":1.119},"last":0.87}]}]},{"osd":6,"up_from":15,"seq":64424510569,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33648,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338192,"statfs":{"total":96636764160,"available":96602308608,"internally_reserved":0,"allocated":2527232,"data_stored":1282760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73899999999999999,"15min":0.745},"min":{"1min":0.45600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.876,"5min":0.99099999999999999,"15min":1.0449999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.50800000000000001,"5min":0.40100000000000002,"15min":0.40000000000000002},"max":{"1min":0.88600000000000001,"5min":1.0389999999999999,"15min":1.1699999999999999},"last":0.505}]},{"osd":1,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.76300000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.1559999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.48899999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1299999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76100000000000001,"15min":0.78700000000000003},"min":{"1min":0.55000000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98099999999999998,"5min":1.0760000000000001,"15min":1.0780000000000001},"last":0.622},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.81699999999999995,"15min":0.82499999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96799999999999997,"5min":1.0669999999999999,"15min":1.1599999999999999},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.497,"5min":0.47999999999999998,"15min":0.46400000000000002},"max":{"1min":1.002,"5min":1.0049999999999999,"15min":1.208},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.58699999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0149999999999999,"5min":1.054,"15min":1.236},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.45300000000000001,"5min":0.38400000000000001,"15min":0.33200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.018},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.42799999999999999,"5min":0.40699999999999997,"15min":0.35499999999999998},"max":{"1min":0.83999999999999997,"5min":0.85799999999999998,"15min":1.016},"last":0.44600000000000001}]},{"osd":5,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64900000000000002,"15min":0.65200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.44},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.1319999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.73499999999999999},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.1659999999999999},"last":0.76700000000000002}]},{"osd":7,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.39700000000000002},"max":{"1min":0.78000000000000003,"5min":0.97199999999999998,"15min":1.044},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68700000000000006,"15min":0.69699999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.42899999999999999},"max":{"1min":0.96399999999999997,"5min":1.228,"15min":1.228},"last":0.73899999999999999}]}]},{"osd":5,"up_from":14,"seq":60129543272,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60032,"kb_used_data":2480,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311808,"statfs":{"total":96636764160,"available":96575291392,"internally_reserved":0,"allocated":2539520,"data_stored":1284324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75700000000000001,"15min":0.754},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.97499999999999998,"5min":0.98199999999999998,"15min":1.034},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94599999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.79100000000000004}]},{"osd":1,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96099999999999997,"5min":1.073,"15min":1.073},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77400000000000002,"15min":0.77600000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.99199999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95699999999999996,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.752,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47999999999999998},"max":{"1min":1.018,"5min":1.208,"15min":1.208},"last":0.626}]},{"osd":3,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77000000000000002,"15min":0.76700000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96199999999999997,"5min":1.155,"15min":1.155},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79900000000000004,"15min":0.79500000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0089999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.77600000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64400000000000002,"15min":0.60599999999999998},"min":{"1min":0.41799999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.86399999999999999,"5min":1.681,"15min":1.681},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.63400000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.42499999999999999},"max":{"1min":0.89200000000000002,"5min":1.381,"15min":1.381},"last":0.754}]},{"osd":6,"last update":"Fri Aug 25 05:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69999999999999996,"15min":0.67000000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.42199999999999999},"max":{"1min":0.92200000000000004,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68700000000000006,"15min":0.68200000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.44900000000000001},"max":{"1min":0.86799999999999999,"5min":1.276,"15min":1.276},"last":0.85099999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68200000000000005,"15min":0.66100000000000003},"min":{"1min":0.46500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.874,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77400000000000002,"15min":0.74099999999999999},"min":{"1min":0.53300000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96799999999999997,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.73999999999999999}]}]},{"osd":4,"up_from":14,"seq":60129543272,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47556,"kb_used_data":2480,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324284,"statfs":{"total":96636764160,"available":96588066816,"internally_reserved":0,"allocated":2539520,"data_stored":1284336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.054},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96499999999999997,"5min":0.97799999999999998,"15min":1.02},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.77300000000000002},"min":{"1min":0.48199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0449999999999999,"5min":1.05,"15min":1.05},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.505},"max":{"1min":0.97999999999999998,"5min":1.022,"15min":1.103},"last":0.60399999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.51800000000000002},"max":{"1min":0.95699999999999996,"5min":0.995,"15min":1.0780000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.76100000000000001,"15min":0.77200000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.47999999999999998},"max":{"1min":1.0649999999999999,"5min":1.069,"15min":1.069},"last":0.67100000000000004}]},{"osd":3,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76500000000000001,"15min":0.78800000000000003},"min":{"1min":0.55800000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.995,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95599999999999996,"5min":1.101,"15min":1.101},"last":0.72099999999999997}]},{"osd":5,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81200000000000006,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.46899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93700000000000006,"5min":0.96799999999999997,"15min":0.98299999999999998},"last":0.64400000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.755,"15min":0.75},"min":{"1min":0.58399999999999996,"5min":0.49399999999999999,"15min":0.49199999999999999},"max":{"1min":1.0029999999999999,"5min":1.008,"15min":1.1240000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.66700000000000004,"15min":0.65800000000000003},"min":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.0629999999999999},"last":0.76200000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91000000000000003,"5min":0.996,"15min":0.996},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.53200000000000003,"5min":0.496,"15min":0.47599999999999998},"max":{"1min":0.96699999999999997,"5min":1.0389999999999999,"15min":1.0860000000000001},"last":0.79500000000000004}]}]},{"osd":3,"up_from":14,"seq":60129543272,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64184,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307656,"statfs":{"total":96636764160,"available":96571039744,"internally_reserved":0,"allocated":2531328,"data_stored":1282850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":63174923},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.33400000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.35499999999999998,"15min":0.34000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.92900000000000005},"last":0.33400000000000002}]},{"osd":1,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52300000000000002,"15min":0.52800000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.0780000000000001},"last":0.434},{"interface":"front","average":{"1min":0.628,"5min":0.61299999999999999,"15min":0.629},"min":{"1min":0.44400000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":0.97999999999999998},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.50600000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81100000000000005,"5min":1.0089999999999999,"15min":1.038},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.44800000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71999999999999997,"5min":0.79000000000000004,"15min":0.95799999999999996},"last":0.47699999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.52300000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.046,"5min":1.26,"15min":1.26},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.83899999999999997,"15min":0.83199999999999996},"min":{"1min":0.58099999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.125,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.92600000000000005}]},{"osd":5,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.65300000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.026,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82299999999999995,"15min":0.82999999999999996},"min":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.1419999999999999},"last":0.84699999999999998}]},{"osd":6,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85799999999999998,"15min":0.86699999999999999},"min":{"1min":0.60999999999999999,"5min":0.59499999999999997,"15min":0.59399999999999997},"max":{"1min":1.1160000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.65200000000000002,"5min":0.58399999999999996,"15min":0.48999999999999999},"max":{"1min":1.0469999999999999,"5min":1.133,"15min":1.194},"last":0.94499999999999995}]},{"osd":7,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.86699999999999999,"15min":0.879},"min":{"1min":0.63100000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.169,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.83299999999999996,"15min":0.83599999999999997},"min":{"1min":0.625,"5min":0.52900000000000003,"15min":0.51800000000000002},"max":{"1min":1.0669999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.878}]}]},{"osd":2,"up_from":14,"seq":60129543273,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60016,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311824,"statfs":{"total":96636764160,"available":96575307776,"internally_reserved":0,"allocated":2527232,"data_stored":1283272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.46000000000000002,"15min":0.47699999999999998},"min":{"1min":0.33400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.35499999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71699999999999997,"5min":0.85099999999999998,"15min":0.86099999999999999},"last":0.57299999999999995}]},{"osd":1,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66200000000000003,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83099999999999996,"5min":0.88800000000000001,"15min":0.89700000000000002},"last":0.64600000000000002}]},{"osd":3,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.41099999999999998,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.78000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.63200000000000001,"5min":0.56399999999999995,"15min":0.48699999999999999},"max":{"1min":1.0720000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80400000000000005,"15min":0.81100000000000005},"min":{"1min":0.66200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.1619999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.60899999999999999}]},{"osd":5,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.60899999999999999,"5min":0.53200000000000003,"15min":0.51700000000000002},"max":{"1min":1.0089999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.84699999999999998},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.246,"5min":1.266,"15min":1.266},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.103,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.871},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.875,"15min":0.88},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.58899999999999997},"max":{"1min":1.204,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.83299999999999996}]},{"osd":7,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.82599999999999996,"15min":0.83799999999999997},"min":{"1min":0.69299999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1040000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.82699999999999996,"15min":0.83199999999999996},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1870000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.76000000000000001}]}]},{"osd":1,"up_from":14,"seq":60129543273,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41964,"kb_used_data":2464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329876,"statfs":{"total":96636764160,"available":96593793024,"internally_reserved":0,"allocated":2523136,"data_stored":1282690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.47699999999999998},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.70299999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.34100000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.71099999999999997,"5min":0.73799999999999999,"15min":0.879},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.81399999999999995},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66600000000000004,"5min":0.82899999999999996,"15min":0.91400000000000003},"last":0.67400000000000004}]},{"osd":3,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73199999999999998,"5min":0.998,"15min":0.998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.376,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73299999999999998,"5min":0.88700000000000001,"15min":0.98699999999999999},"last":0.55000000000000004}]},{"osd":4,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91000000000000003,"5min":1.1559999999999999,"15min":1.2350000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82999999999999996,"15min":0.83699999999999997},"min":{"1min":0.69099999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98699999999999999,"5min":1.268,"15min":1.268},"last":0.82299999999999995}]},{"osd":5,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.80900000000000005},"min":{"1min":0.624,"5min":0.54800000000000004,"15min":0.47699999999999998},"max":{"1min":0.89800000000000002,"5min":1.109,"15min":1.1950000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.66200000000000003,"5min":0.61899999999999999,"15min":0.55300000000000005},"max":{"1min":0.97899999999999998,"5min":1.214,"15min":1.214},"last":0.75600000000000001}]},{"osd":6,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.66100000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.94499999999999995,"5min":1.212,"15min":1.244},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.81899999999999995,"15min":0.83699999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.94699999999999995,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.63}]},{"osd":7,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81200000000000006,"15min":0.83699999999999997},"min":{"1min":0.61699999999999999,"5min":0.60899999999999999,"15min":0.55600000000000005},"max":{"1min":1.0069999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.626},"max":{"1min":0.96799999999999997,"5min":1.127,"15min":1.2110000000000001},"last":0.77300000000000002}]}]},{"osd":0,"up_from":14,"seq":60129543272,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60616,"kb_used_data":3060,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311224,"statfs":{"total":96636764160,"available":96574693376,"internally_reserved":0,"allocated":3133440,"data_stored":1873786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48999999999999999,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.308,"15min":0.30599999999999999},"max":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":1.2170000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.81599999999999995,"15min":0.85999999999999999},"last":0.47199999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36399999999999999,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":0.81399999999999995,"15min":0.91000000000000003},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55000000000000004,"15min":0.56100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71499999999999997,"5min":0.755,"15min":0.86799999999999999},"last":0.42899999999999999}]},{"osd":3,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.754,"15min":1.855},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.75900000000000001,"5min":0.90000000000000002,"15min":1.3480000000000001},"last":0.52300000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.57599999999999996,"5min":0.495,"15min":0.495},"max":{"1min":1.0600000000000001,"5min":1.258,"15min":1.3799999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81699999999999995,"15min":0.83199999999999996},"min":{"1min":0.627,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0529999999999999,"5min":1.2809999999999999,"15min":1.2849999999999999},"last":0.68700000000000006}]},{"osd":5,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.58999999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.004,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.875},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82499999999999996,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0620000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.63900000000000001}]},{"osd":6,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82199999999999995,"15min":0.83599999999999997},"min":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0429999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86499999999999999,"15min":0.85999999999999999},"min":{"1min":0.51600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.0880000000000001,"5min":1.3560000000000001,"15min":1.5129999999999999},"last":0.85099999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85799999999999998,"15min":0.876},"min":{"1min":0.64600000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0760000000000001,"5min":1.4339999999999999,"15min":1.5720000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58099999999999996},"max":{"1min":1.0620000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:37:30.481 INFO:tasks.ceph.mds.c.smithi055.stderr:2023-08-25T05:37:30.479+0000 7f8b34f73640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T05:37:33.237 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:37:33.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d87567640 1 Processor -- start 2023-08-25T05:37:33.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d87567640 1 -- start start 2023-08-25T05:37:33.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d87567640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5d800ceeb0 0x7f5d800cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:33.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d87567640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d800c89f0 0x7f5d800b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:33.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d87567640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d800cc880 con 0x7f5d800ad950 2023-08-25T05:37:33.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d87567640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d800b11f0 con 0x7f5d800ceeb0 2023-08-25T05:37:33.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d87567640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d80159d50 con 0x7f5d800c89f0 2023-08-25T05:37:33.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d85303640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5d800ad950 0x7f5d800ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43924/0 (socket says 172.21.15.55:43924) 2023-08-25T05:37:33.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d85303640 1 -- 172.21.15.55:0/1101591887 learned_addr learned my addr 172.21.15.55:0/1101591887 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:33.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d84b02640 1 --2- 172.21.15.55:0/1101591887 >> v2:172.21.15.110:3300/0 conn(0x7f5d800ceeb0 0x7f5d800cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:33.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d85b04640 1 --2- 172.21.15.55:0/1101591887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d800c89f0 0x7f5d800b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:33.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d77fff640 1 -- 172.21.15.55:0/1101591887 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641249036 0 0) 0x7f5d800cc880 con 0x7f5d800ad950 2023-08-25T05:37:33.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d77fff640 1 -- 172.21.15.55:0/1101591887 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d6c005740 con 0x7f5d800ad950 2023-08-25T05:37:33.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d77fff640 1 -- 172.21.15.55:0/1101591887 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3164373082 0 0) 0x7f5d6c005740 con 0x7f5d800ad950 2023-08-25T05:37:33.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d77fff640 1 -- 172.21.15.55:0/1101591887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d800c89f0 msgr2=0x7f5d800b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:33.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d77fff640 1 --2- 172.21.15.55:0/1101591887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d800c89f0 0x7f5d800b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d77fff640 1 -- 172.21.15.55:0/1101591887 >> v2:172.21.15.110:3300/0 conn(0x7f5d800ceeb0 msgr2=0x7f5d800cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:33.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d77fff640 1 --2- 172.21.15.55:0/1101591887 >> v2:172.21.15.110:3300/0 conn(0x7f5d800ceeb0 0x7f5d800cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d77fff640 1 -- 172.21.15.55:0/1101591887 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d800ccb60 con 0x7f5d800ad950 2023-08-25T05:37:33.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d77fff640 1 -- 172.21.15.55:0/1101591887 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f5d7c001680 con 0x7f5d800ad950 2023-08-25T05:37:33.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d77fff640 1 -- 172.21.15.55:0/1101591887 >> v1:172.21.15.55:6789/0 conn(0x7f5d800ad950 legacy=0x7f5d800ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:33.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d77fff640 1 --2- 172.21.15.55:0/1101591887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d800c89f0 0x7f5d6c005b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:33.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d77fff640 1 --2- 172.21.15.55:0/1101591887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6c006110 0x7f5d6c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:33.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d77fff640 1 --2- 172.21.15.55:0/1101591887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d6c006590 0x7f5d6c006f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:33.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d77fff640 1 -- 172.21.15.55:0/1101591887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800b11f0 con 0x7f5d6c006110 2023-08-25T05:37:33.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d77fff640 1 -- 172.21.15.55:0/1101591887 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d80159d50 con 0x7f5d6c006590 2023-08-25T05:37:33.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d77fff640 1 -- 172.21.15.55:0/1101591887 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c007830 con 0x7f5d800c89f0 2023-08-25T05:37:33.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d84b02640 1 --2- 172.21.15.55:0/1101591887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6c006110 0x7f5d6c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:33.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.391+0000 7f5d85303640 1 --2- 172.21.15.55:0/1101591887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d800c89f0 0x7f5d6c005b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:33.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.395+0000 7f5d85b04640 1 --2- 172.21.15.55:0/1101591887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d6c006590 0x7f5d6c006f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:33.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.395+0000 7f5d84b02640 1 -- 172.21.15.55:0/1101591887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d800c89f0 msgr2=0x7f5d6c005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:33.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.395+0000 7f5d84b02640 1 --2- 172.21.15.55:0/1101591887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d800c89f0 0x7f5d6c005b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.395+0000 7f5d84b02640 1 -- 172.21.15.55:0/1101591887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d6c006590 msgr2=0x7f5d6c006f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:33.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.395+0000 7f5d84b02640 1 --2- 172.21.15.55:0/1101591887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d6c006590 0x7f5d6c006f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.395+0000 7f5d84b02640 1 -- 172.21.15.55:0/1101591887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c005740 con 0x7f5d6c006110 2023-08-25T05:37:33.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.395+0000 7f5d84b02640 1 --2- 172.21.15.55:0/1101591887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6c006110 0x7f5d6c0069e0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f5d70009ae0 tx=0x7f5d7001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1fc400ae7e4976 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:33.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.395+0000 7f5d77fff640 1 -- 172.21.15.55:0/1101591887 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d700a6450 con 0x7f5d6c006110 2023-08-25T05:37:33.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.395+0000 7f5d77fff640 1 -- 172.21.15.55:0/1101591887 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d700a65b0 con 0x7f5d6c006110 2023-08-25T05:37:33.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.395+0000 7f5d77fff640 1 -- 172.21.15.55:0/1101591887 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d700a6960 con 0x7f5d6c006110 2023-08-25T05:37:33.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.395+0000 7f5d87567640 1 -- 172.21.15.55:0/1101591887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6c006110 msgr2=0x7f5d6c0069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:33.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.395+0000 7f5d87567640 1 --2- 172.21.15.55:0/1101591887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6c006110 0x7f5d6c0069e0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f5d70009ae0 tx=0x7f5d7001ca60 comp rx=0 tx=0).stop 2023-08-25T05:37:33.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d85b04640 1 -- 172.21.15.55:0/1101591887 reap_dead start 2023-08-25T05:37:33.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d87567640 1 -- 172.21.15.55:0/1101591887 shutdown_connections 2023-08-25T05:37:33.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d87567640 1 -- 172.21.15.55:0/1101591887 >> 172.21.15.55:0/1101591887 conn(0x7f5d80069d00 msgr2=0x7f5d8006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:33.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d87567640 1 -- 172.21.15.55:0/1101591887 shutdown_connections 2023-08-25T05:37:33.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d87567640 1 -- 172.21.15.55:0/1101591887 wait complete. 2023-08-25T05:37:33.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d87567640 1 Processor -- start 2023-08-25T05:37:33.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d87567640 1 -- start start 2023-08-25T05:37:33.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d87567640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6c006110 0x7f5d80152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:33.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d87567640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d80154a60 0x7f5d800abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:33.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d87567640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d80154ee0 0x7f5d800ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:33.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d87567640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800ab190 con 0x7f5d6c006110 2023-08-25T05:37:33.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d87567640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800ab470 con 0x7f5d80154ee0 2023-08-25T05:37:33.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d87567640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d800ab750 con 0x7f5d80154a60 2023-08-25T05:37:33.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d85303640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6c006110 0x7f5d80152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:33.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d85303640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6c006110 0x7f5d80152e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58854/0 (socket says 172.21.15.55:58854) 2023-08-25T05:37:33.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d85303640 1 -- 172.21.15.55:0/1988662256 learned_addr learned my addr 172.21.15.55:0/1988662256 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:33.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d84b02640 1 --2- 172.21.15.55:0/1988662256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d80154a60 0x7f5d800abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:33.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d85b04640 1 --2- 172.21.15.55:0/1988662256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d80154ee0 0x7f5d800ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:33.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d85303640 1 -- 172.21.15.55:0/1988662256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d80154a60 msgr2=0x7f5d800abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:33.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d85303640 1 --2- 172.21.15.55:0/1988662256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d80154a60 0x7f5d800abf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d85303640 1 -- 172.21.15.55:0/1988662256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d80154ee0 msgr2=0x7f5d800ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:33.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d85303640 1 --2- 172.21.15.55:0/1988662256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d80154ee0 0x7f5d800ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d85303640 1 -- 172.21.15.55:0/1988662256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d800aba30 con 0x7f5d6c006110 2023-08-25T05:37:33.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d85b04640 1 --2- 172.21.15.55:0/1988662256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d80154ee0 0x7f5d800ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:33.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.399+0000 7f5d84b02640 1 --2- 172.21.15.55:0/1988662256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d80154a60 0x7f5d800abf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:33.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.403+0000 7f5d85303640 1 --2- 172.21.15.55:0/1988662256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6c006110 0x7f5d80152e40 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c004f80 tx=0x7f5d7c0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:33.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.403+0000 7f5d75ffb640 1 -- 172.21.15.55:0/1988662256 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c007740 con 0x7f5d6c006110 2023-08-25T05:37:33.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.403+0000 7f5d75ffb640 1 -- 172.21.15.55:0/1988662256 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c00f9c0 con 0x7f5d6c006110 2023-08-25T05:37:33.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.403+0000 7f5d87567640 1 -- 172.21.15.55:0/1988662256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d80153380 con 0x7f5d6c006110 2023-08-25T05:37:33.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.403+0000 7f5d75ffb640 1 -- 172.21.15.55:0/1988662256 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c00fd70 con 0x7f5d6c006110 2023-08-25T05:37:33.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.403+0000 7f5d87567640 1 -- 172.21.15.55:0/1988662256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d800c2080 con 0x7f5d6c006110 2023-08-25T05:37:33.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.403+0000 7f5d87567640 1 -- 172.21.15.55:0/1988662256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8004dbe0 con 0x7f5d6c006110 2023-08-25T05:37:33.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.403+0000 7f5d75ffb640 1 -- 172.21.15.55:0/1988662256 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f5d7c01d460 con 0x7f5d6c006110 2023-08-25T05:37:33.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.403+0000 7f5d75ffb640 1 --2- 172.21.15.55:0/1988662256 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f5d640657d0 0x7f5d64067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:33.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.403+0000 7f5d75ffb640 1 -- 172.21.15.55:0/1988662256 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5d7c083130 con 0x7f5d6c006110 2023-08-25T05:37:33.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.403+0000 7f5d84b02640 1 --2- 172.21.15.55:0/1988662256 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f5d640657d0 0x7f5d64067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:33.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.407+0000 7f5d84b02640 1 --2- 172.21.15.55:0/1988662256 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f5d640657d0 0x7f5d64067c90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5d700ad000 tx=0x7f5d700b2040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:33.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.407+0000 7f5d75ffb640 1 -- 172.21.15.55:0/1988662256 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5d7c050a40 con 0x7f5d6c006110 2023-08-25T05:37:33.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.563+0000 7f5d87567640 1 -- 172.21.15.55:0/1988662256 --> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d800b3130 con 0x7f5d640657d0 2023-08-25T05:37:33.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.571+0000 7f5d75ffb640 1 -- 172.21.15.55:0/1988662256 <== mgr.8987 v2:172.21.15.110:6832/3630541271 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311812 (secure 0 0 0) 0x7f5d700a6820 con 0x7f5d640657d0 2023-08-25T05:37:33.576 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:33.577 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:37:33.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.575+0000 7f5d87567640 1 -- 172.21.15.55:0/1988662256 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f5d640657d0 msgr2=0x7f5d64067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:33.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.575+0000 7f5d87567640 1 --2- 172.21.15.55:0/1988662256 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f5d640657d0 0x7f5d64067c90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5d700ad000 tx=0x7f5d700b2040 comp rx=0 tx=0).stop 2023-08-25T05:37:33.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.575+0000 7f5d87567640 1 -- 172.21.15.55:0/1988662256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6c006110 msgr2=0x7f5d80152e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:33.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.575+0000 7f5d87567640 1 --2- 172.21.15.55:0/1988662256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6c006110 0x7f5d80152e40 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c004f80 tx=0x7f5d7c0074f0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.575+0000 7f5d87567640 1 -- 172.21.15.55:0/1988662256 shutdown_connections 2023-08-25T05:37:33.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.575+0000 7f5d87567640 1 --2- 172.21.15.55:0/1988662256 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f5d640657d0 0x7f5d64067c90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.575+0000 7f5d87567640 1 --2- 172.21.15.55:0/1988662256 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d80154ee0 0x7f5d800ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.575+0000 7f5d87567640 1 --2- 172.21.15.55:0/1988662256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d80154a60 0x7f5d800abf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.575+0000 7f5d87567640 1 --2- 172.21.15.55:0/1988662256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d6c006110 0x7f5d80152e40 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.575+0000 7f5d87567640 1 -- 172.21.15.55:0/1988662256 >> 172.21.15.55:0/1988662256 conn(0x7f5d80069d00 msgr2=0x7f5d800ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:33.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.575+0000 7f5d87567640 1 -- 172.21.15.55:0/1988662256 shutdown_connections 2023-08-25T05:37:33.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.575+0000 7f5d87567640 1 -- 172.21.15.55:0/1988662256 wait complete. 2023-08-25T05:37:33.596 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-08-25T05:37:33.185720+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2096,"num_read_kb":4403,"num_write":610,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3692,"ondisk_log_size":3692,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":420292,"kb_used_data":20936,"kb_used_omap":13,"kb_used_meta":399218,"kb_avail":754554428,"statfs":{"total":773094113280,"available":772663734272,"internally_reserved":0,"allocated":21438464,"data_stored":11447076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":408799320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.661372"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946915+0000","last_change":"2023-08-25T05:37:24.558861+0000","last_active":"2023-08-25T05:37:25.946915+0000","last_peered":"2023-08-25T05:37:25.946915+0000","last_clean":"2023-08-25T05:37:25.946915+0000","last_became_active":"2023-08-25T05:37:24.558588+0000","last_became_peered":"2023-08-25T05:37:24.558588+0000","last_unstale":"2023-08-25T05:37:25.946915+0000","last_undegraded":"2023-08-25T05:37:25.946915+0000","last_fullsized":"2023-08-25T05:37:25.946915+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:40:20.607628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947254+0000","last_change":"2023-08-25T05:37:24.550046+0000","last_active":"2023-08-25T05:37:25.947254+0000","last_peered":"2023-08-25T05:37:25.947254+0000","last_clean":"2023-08-25T05:37:25.947254+0000","last_became_active":"2023-08-25T05:37:24.549770+0000","last_became_peered":"2023-08-25T05:37:24.549770+0000","last_unstale":"2023-08-25T05:37:25.947254+0000","last_undegraded":"2023-08-25T05:37:25.947254+0000","last_fullsized":"2023-08-25T05:37:25.947254+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:44:37.817651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.536047+0000","last_change":"2023-08-25T05:37:24.531155+0000","last_active":"2023-08-25T05:37:25.536047+0000","last_peered":"2023-08-25T05:37:25.536047+0000","last_clean":"2023-08-25T05:37:25.536047+0000","last_became_active":"2023-08-25T05:37:24.530836+0000","last_became_peered":"2023-08-25T05:37:24.530836+0000","last_unstale":"2023-08-25T05:37:25.536047+0000","last_undegraded":"2023-08-25T05:37:25.536047+0000","last_fullsized":"2023-08-25T05:37:25.536047+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:32:28.065393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945718+0000","last_change":"2023-08-25T05:37:24.544721+0000","last_active":"2023-08-25T05:37:25.945718+0000","last_peered":"2023-08-25T05:37:25.945718+0000","last_clean":"2023-08-25T05:37:25.945718+0000","last_became_active":"2023-08-25T05:37:24.544390+0000","last_became_peered":"2023-08-25T05:37:24.544390+0000","last_unstale":"2023-08-25T05:37:25.945718+0000","last_undegraded":"2023-08-25T05:37:25.945718+0000","last_fullsized":"2023-08-25T05:37:25.945718+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:29:44.533780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535305+0000","last_change":"2023-08-25T05:37:24.546648+0000","last_active":"2023-08-25T05:37:25.535305+0000","last_peered":"2023-08-25T05:37:25.535305+0000","last_clean":"2023-08-25T05:37:25.535305+0000","last_became_active":"2023-08-25T05:37:24.546097+0000","last_became_peered":"2023-08-25T05:37:24.546097+0000","last_unstale":"2023-08-25T05:37:25.535305+0000","last_undegraded":"2023-08-25T05:37:25.535305+0000","last_fullsized":"2023-08-25T05:37:25.535305+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:12:49.450829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535529+0000","last_change":"2023-08-25T05:37:24.555791+0000","last_active":"2023-08-25T05:37:25.535529+0000","last_peered":"2023-08-25T05:37:25.535529+0000","last_clean":"2023-08-25T05:37:25.535529+0000","last_became_active":"2023-08-25T05:37:24.555323+0000","last_became_peered":"2023-08-25T05:37:24.555323+0000","last_unstale":"2023-08-25T05:37:25.535529+0000","last_undegraded":"2023-08-25T05:37:25.535529+0000","last_fullsized":"2023-08-25T05:37:25.535529+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:44.720821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945686+0000","last_change":"2023-08-25T05:37:24.550505+0000","last_active":"2023-08-25T05:37:25.945686+0000","last_peered":"2023-08-25T05:37:25.945686+0000","last_clean":"2023-08-25T05:37:25.945686+0000","last_became_active":"2023-08-25T05:37:24.550152+0000","last_became_peered":"2023-08-25T05:37:24.550152+0000","last_unstale":"2023-08-25T05:37:25.945686+0000","last_undegraded":"2023-08-25T05:37:25.945686+0000","last_fullsized":"2023-08-25T05:37:25.945686+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:47:32.743962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946199+0000","last_change":"2023-08-25T05:37:24.547757+0000","last_active":"2023-08-25T05:37:25.946199+0000","last_peered":"2023-08-25T05:37:25.946199+0000","last_clean":"2023-08-25T05:37:25.946199+0000","last_became_active":"2023-08-25T05:37:24.547485+0000","last_became_peered":"2023-08-25T05:37:24.547485+0000","last_unstale":"2023-08-25T05:37:25.946199+0000","last_undegraded":"2023-08-25T05:37:25.946199+0000","last_fullsized":"2023-08-25T05:37:25.946199+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:28:19.214287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947052+0000","last_change":"2023-08-25T05:37:24.547748+0000","last_active":"2023-08-25T05:37:25.947052+0000","last_peered":"2023-08-25T05:37:25.947052+0000","last_clean":"2023-08-25T05:37:25.947052+0000","last_became_active":"2023-08-25T05:37:24.547416+0000","last_became_peered":"2023-08-25T05:37:24.547416+0000","last_unstale":"2023-08-25T05:37:25.947052+0000","last_undegraded":"2023-08-25T05:37:25.947052+0000","last_fullsized":"2023-08-25T05:37:25.947052+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:34:42.593857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535709+0000","last_change":"2023-08-25T05:37:24.544494+0000","last_active":"2023-08-25T05:37:25.535709+0000","last_peered":"2023-08-25T05:37:25.535709+0000","last_clean":"2023-08-25T05:37:25.535709+0000","last_became_active":"2023-08-25T05:37:24.544188+0000","last_became_peered":"2023-08-25T05:37:24.544188+0000","last_unstale":"2023-08-25T05:37:25.535709+0000","last_undegraded":"2023-08-25T05:37:25.535709+0000","last_fullsized":"2023-08-25T05:37:25.535709+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:07:21.041111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945924+0000","last_change":"2023-08-25T05:37:24.546120+0000","last_active":"2023-08-25T05:37:25.945924+0000","last_peered":"2023-08-25T05:37:25.945924+0000","last_clean":"2023-08-25T05:37:25.945924+0000","last_became_active":"2023-08-25T05:37:24.545846+0000","last_became_peered":"2023-08-25T05:37:24.545846+0000","last_unstale":"2023-08-25T05:37:25.945924+0000","last_undegraded":"2023-08-25T05:37:25.945924+0000","last_fullsized":"2023-08-25T05:37:25.945924+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:55:43.946369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945853+0000","last_change":"2023-08-25T05:37:24.556431+0000","last_active":"2023-08-25T05:37:25.945853+0000","last_peered":"2023-08-25T05:37:25.945853+0000","last_clean":"2023-08-25T05:37:25.945853+0000","last_became_active":"2023-08-25T05:37:24.556133+0000","last_became_peered":"2023-08-25T05:37:24.556133+0000","last_unstale":"2023-08-25T05:37:25.945853+0000","last_undegraded":"2023-08-25T05:37:25.945853+0000","last_fullsized":"2023-08-25T05:37:25.945853+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:38:26.995904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534692+0000","last_change":"2023-08-25T05:37:24.532883+0000","last_active":"2023-08-25T05:37:25.534692+0000","last_peered":"2023-08-25T05:37:25.534692+0000","last_clean":"2023-08-25T05:37:25.534692+0000","last_became_active":"2023-08-25T05:37:24.532366+0000","last_became_peered":"2023-08-25T05:37:24.532366+0000","last_unstale":"2023-08-25T05:37:25.534692+0000","last_undegraded":"2023-08-25T05:37:25.534692+0000","last_fullsized":"2023-08-25T05:37:25.534692+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:28:52.144447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945968+0000","last_change":"2023-08-25T05:37:24.535380+0000","last_active":"2023-08-25T05:37:25.945968+0000","last_peered":"2023-08-25T05:37:25.945968+0000","last_clean":"2023-08-25T05:37:25.945968+0000","last_became_active":"2023-08-25T05:37:24.534767+0000","last_became_peered":"2023-08-25T05:37:24.534767+0000","last_unstale":"2023-08-25T05:37:25.945968+0000","last_undegraded":"2023-08-25T05:37:25.945968+0000","last_fullsized":"2023-08-25T05:37:25.945968+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:06:33.432253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946749+0000","last_change":"2023-08-25T05:37:24.552244+0000","last_active":"2023-08-25T05:37:25.946749+0000","last_peered":"2023-08-25T05:37:25.946749+0000","last_clean":"2023-08-25T05:37:25.946749+0000","last_became_active":"2023-08-25T05:37:24.551943+0000","last_became_peered":"2023-08-25T05:37:24.551943+0000","last_unstale":"2023-08-25T05:37:25.946749+0000","last_undegraded":"2023-08-25T05:37:25.946749+0000","last_fullsized":"2023-08-25T05:37:25.946749+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:44:49.308482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535135+0000","last_change":"2023-08-25T05:37:24.546795+0000","last_active":"2023-08-25T05:37:25.535135+0000","last_peered":"2023-08-25T05:37:25.535135+0000","last_clean":"2023-08-25T05:37:25.535135+0000","last_became_active":"2023-08-25T05:37:24.546491+0000","last_became_peered":"2023-08-25T05:37:24.546491+0000","last_unstale":"2023-08-25T05:37:25.535135+0000","last_undegraded":"2023-08-25T05:37:25.535135+0000","last_fullsized":"2023-08-25T05:37:25.535135+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:07:00.912224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535914+0000","last_change":"2023-08-25T05:37:24.547692+0000","last_active":"2023-08-25T05:37:25.535914+0000","last_peered":"2023-08-25T05:37:25.535914+0000","last_clean":"2023-08-25T05:37:25.535914+0000","last_became_active":"2023-08-25T05:37:24.547384+0000","last_became_peered":"2023-08-25T05:37:24.547384+0000","last_unstale":"2023-08-25T05:37:25.535914+0000","last_undegraded":"2023-08-25T05:37:25.535914+0000","last_fullsized":"2023-08-25T05:37:25.535914+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:15:56.203680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535905+0000","last_change":"2023-08-25T05:37:24.547956+0000","last_active":"2023-08-25T05:37:25.535905+0000","last_peered":"2023-08-25T05:37:25.535905+0000","last_clean":"2023-08-25T05:37:25.535905+0000","last_became_active":"2023-08-25T05:37:24.547672+0000","last_became_peered":"2023-08-25T05:37:24.547672+0000","last_unstale":"2023-08-25T05:37:25.535905+0000","last_undegraded":"2023-08-25T05:37:25.535905+0000","last_fullsized":"2023-08-25T05:37:25.535905+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:56:09.207727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535528+0000","last_change":"2023-08-25T05:37:24.533024+0000","last_active":"2023-08-25T05:37:25.535528+0000","last_peered":"2023-08-25T05:37:25.535528+0000","last_clean":"2023-08-25T05:37:25.535528+0000","last_became_active":"2023-08-25T05:37:24.532738+0000","last_became_peered":"2023-08-25T05:37:24.532738+0000","last_unstale":"2023-08-25T05:37:25.535528+0000","last_undegraded":"2023-08-25T05:37:25.535528+0000","last_fullsized":"2023-08-25T05:37:25.535528+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:37:07.452993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535438+0000","last_change":"2023-08-25T05:37:24.556390+0000","last_active":"2023-08-25T05:37:25.535438+0000","last_peered":"2023-08-25T05:37:25.535438+0000","last_clean":"2023-08-25T05:37:25.535438+0000","last_became_active":"2023-08-25T05:37:24.556024+0000","last_became_peered":"2023-08-25T05:37:24.556024+0000","last_unstale":"2023-08-25T05:37:25.535438+0000","last_undegraded":"2023-08-25T05:37:25.535438+0000","last_fullsized":"2023-08-25T05:37:25.535438+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:57:51.562974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947080+0000","last_change":"2023-08-25T05:37:24.551353+0000","last_active":"2023-08-25T05:37:25.947080+0000","last_peered":"2023-08-25T05:37:25.947080+0000","last_clean":"2023-08-25T05:37:25.947080+0000","last_became_active":"2023-08-25T05:37:24.550781+0000","last_became_peered":"2023-08-25T05:37:24.550781+0000","last_unstale":"2023-08-25T05:37:25.947080+0000","last_undegraded":"2023-08-25T05:37:25.947080+0000","last_fullsized":"2023-08-25T05:37:25.947080+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:19:58.661092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946988+0000","last_change":"2023-08-25T05:37:24.554168+0000","last_active":"2023-08-25T05:37:25.946988+0000","last_peered":"2023-08-25T05:37:25.946988+0000","last_clean":"2023-08-25T05:37:25.946988+0000","last_became_active":"2023-08-25T05:37:24.552463+0000","last_became_peered":"2023-08-25T05:37:24.552463+0000","last_unstale":"2023-08-25T05:37:25.946988+0000","last_undegraded":"2023-08-25T05:37:25.946988+0000","last_fullsized":"2023-08-25T05:37:25.946988+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:14:34.953794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945755+0000","last_change":"2023-08-25T05:37:24.555483+0000","last_active":"2023-08-25T05:37:25.945755+0000","last_peered":"2023-08-25T05:37:25.945755+0000","last_clean":"2023-08-25T05:37:25.945755+0000","last_became_active":"2023-08-25T05:37:24.555033+0000","last_became_peered":"2023-08-25T05:37:24.555033+0000","last_unstale":"2023-08-25T05:37:25.945755+0000","last_undegraded":"2023-08-25T05:37:25.945755+0000","last_fullsized":"2023-08-25T05:37:25.945755+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:15:24.769439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946584+0000","last_change":"2023-08-25T05:37:24.559438+0000","last_active":"2023-08-25T05:37:25.946584+0000","last_peered":"2023-08-25T05:37:25.946584+0000","last_clean":"2023-08-25T05:37:25.946584+0000","last_became_active":"2023-08-25T05:37:24.559145+0000","last_became_peered":"2023-08-25T05:37:24.559145+0000","last_unstale":"2023-08-25T05:37:25.946584+0000","last_undegraded":"2023-08-25T05:37:25.946584+0000","last_fullsized":"2023-08-25T05:37:25.946584+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:00:18.745428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946405+0000","last_change":"2023-08-25T05:37:24.541944+0000","last_active":"2023-08-25T05:37:25.946405+0000","last_peered":"2023-08-25T05:37:25.946405+0000","last_clean":"2023-08-25T05:37:25.946405+0000","last_became_active":"2023-08-25T05:37:24.541431+0000","last_became_peered":"2023-08-25T05:37:24.541431+0000","last_unstale":"2023-08-25T05:37:25.946405+0000","last_undegraded":"2023-08-25T05:37:25.946405+0000","last_fullsized":"2023-08-25T05:37:25.946405+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:21:16.606470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946369+0000","last_change":"2023-08-25T05:37:24.553682+0000","last_active":"2023-08-25T05:37:25.946369+0000","last_peered":"2023-08-25T05:37:25.946369+0000","last_clean":"2023-08-25T05:37:25.946369+0000","last_became_active":"2023-08-25T05:37:24.553346+0000","last_became_peered":"2023-08-25T05:37:24.553346+0000","last_unstale":"2023-08-25T05:37:25.946369+0000","last_undegraded":"2023-08-25T05:37:25.946369+0000","last_fullsized":"2023-08-25T05:37:25.946369+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:02:51.650825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946048+0000","last_change":"2023-08-25T05:37:24.549328+0000","last_active":"2023-08-25T05:37:25.946048+0000","last_peered":"2023-08-25T05:37:25.946048+0000","last_clean":"2023-08-25T05:37:25.946048+0000","last_became_active":"2023-08-25T05:37:24.549039+0000","last_became_peered":"2023-08-25T05:37:24.549039+0000","last_unstale":"2023-08-25T05:37:25.946048+0000","last_undegraded":"2023-08-25T05:37:25.946048+0000","last_fullsized":"2023-08-25T05:37:25.946048+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:49:12.761722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535574+0000","last_change":"2023-08-25T05:37:24.546985+0000","last_active":"2023-08-25T05:37:25.535574+0000","last_peered":"2023-08-25T05:37:25.535574+0000","last_clean":"2023-08-25T05:37:25.535574+0000","last_became_active":"2023-08-25T05:37:24.546612+0000","last_became_peered":"2023-08-25T05:37:24.546612+0000","last_unstale":"2023-08-25T05:37:25.535574+0000","last_undegraded":"2023-08-25T05:37:25.535574+0000","last_fullsized":"2023-08-25T05:37:25.535574+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:48:59.505607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945696+0000","last_change":"2023-08-25T05:37:24.553008+0000","last_active":"2023-08-25T05:37:25.945696+0000","last_peered":"2023-08-25T05:37:25.945696+0000","last_clean":"2023-08-25T05:37:25.945696+0000","last_became_active":"2023-08-25T05:37:24.552707+0000","last_became_peered":"2023-08-25T05:37:24.552707+0000","last_unstale":"2023-08-25T05:37:25.945696+0000","last_undegraded":"2023-08-25T05:37:25.945696+0000","last_fullsized":"2023-08-25T05:37:25.945696+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:32:17.258659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945561+0000","last_change":"2023-08-25T05:37:24.550494+0000","last_active":"2023-08-25T05:37:25.945561+0000","last_peered":"2023-08-25T05:37:25.945561+0000","last_clean":"2023-08-25T05:37:25.945561+0000","last_became_active":"2023-08-25T05:37:24.550200+0000","last_became_peered":"2023-08-25T05:37:24.550200+0000","last_unstale":"2023-08-25T05:37:25.945561+0000","last_undegraded":"2023-08-25T05:37:25.945561+0000","last_fullsized":"2023-08-25T05:37:25.945561+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:42:44.478485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945711+0000","last_change":"2023-08-25T05:37:24.553860+0000","last_active":"2023-08-25T05:37:25.945711+0000","last_peered":"2023-08-25T05:37:25.945711+0000","last_clean":"2023-08-25T05:37:25.945711+0000","last_became_active":"2023-08-25T05:37:24.553548+0000","last_became_peered":"2023-08-25T05:37:24.553548+0000","last_unstale":"2023-08-25T05:37:25.945711+0000","last_undegraded":"2023-08-25T05:37:25.945711+0000","last_fullsized":"2023-08-25T05:37:25.945711+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:51.067437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535197+0000","last_change":"2023-08-25T05:37:24.545544+0000","last_active":"2023-08-25T05:37:25.535197+0000","last_peered":"2023-08-25T05:37:25.535197+0000","last_clean":"2023-08-25T05:37:25.535197+0000","last_became_active":"2023-08-25T05:37:24.545268+0000","last_became_peered":"2023-08-25T05:37:24.545268+0000","last_unstale":"2023-08-25T05:37:25.535197+0000","last_undegraded":"2023-08-25T05:37:25.535197+0000","last_fullsized":"2023-08-25T05:37:25.535197+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:57:38.266164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946446+0000","last_change":"2023-08-25T05:37:24.547757+0000","last_active":"2023-08-25T05:37:25.946446+0000","last_peered":"2023-08-25T05:37:25.946446+0000","last_clean":"2023-08-25T05:37:25.946446+0000","last_became_active":"2023-08-25T05:37:24.546529+0000","last_became_peered":"2023-08-25T05:37:24.546529+0000","last_unstale":"2023-08-25T05:37:25.946446+0000","last_undegraded":"2023-08-25T05:37:25.946446+0000","last_fullsized":"2023-08-25T05:37:25.946446+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:49:03.907963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535924+0000","last_change":"2023-08-25T05:37:23.547915+0000","last_active":"2023-08-25T05:37:25.535924+0000","last_peered":"2023-08-25T05:37:25.535924+0000","last_clean":"2023-08-25T05:37:25.535924+0000","last_became_active":"2023-08-25T05:37:23.547587+0000","last_became_peered":"2023-08-25T05:37:23.547587+0000","last_unstale":"2023-08-25T05:37:25.535924+0000","last_undegraded":"2023-08-25T05:37:25.535924+0000","last_fullsized":"2023-08-25T05:37:25.535924+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:34:00.481841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535833+0000","last_change":"2023-08-25T05:37:24.541483+0000","last_active":"2023-08-25T05:37:25.535833+0000","last_peered":"2023-08-25T05:37:25.535833+0000","last_clean":"2023-08-25T05:37:25.535833+0000","last_became_active":"2023-08-25T05:37:24.541119+0000","last_became_peered":"2023-08-25T05:37:24.541119+0000","last_unstale":"2023-08-25T05:37:25.535833+0000","last_undegraded":"2023-08-25T05:37:25.535833+0000","last_fullsized":"2023-08-25T05:37:25.535833+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:49:16.515630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947179+0000","last_change":"2023-08-25T05:37:23.536250+0000","last_active":"2023-08-25T05:37:25.947179+0000","last_peered":"2023-08-25T05:37:25.947179+0000","last_clean":"2023-08-25T05:37:25.947179+0000","last_became_active":"2023-08-25T05:37:23.535955+0000","last_became_peered":"2023-08-25T05:37:23.535955+0000","last_unstale":"2023-08-25T05:37:25.947179+0000","last_undegraded":"2023-08-25T05:37:25.947179+0000","last_fullsized":"2023-08-25T05:37:25.947179+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:50:29.397169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.536185+0000","last_change":"2023-08-25T05:37:24.541685+0000","last_active":"2023-08-25T05:37:25.536185+0000","last_peered":"2023-08-25T05:37:25.536185+0000","last_clean":"2023-08-25T05:37:25.536185+0000","last_became_active":"2023-08-25T05:37:24.541377+0000","last_became_peered":"2023-08-25T05:37:24.541377+0000","last_unstale":"2023-08-25T05:37:25.536185+0000","last_undegraded":"2023-08-25T05:37:25.536185+0000","last_fullsized":"2023-08-25T05:37:25.536185+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:44:54.540661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"201'3","reported_seq":16,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945901+0000","last_change":"2023-08-25T05:37:23.548267+0000","last_active":"2023-08-25T05:37:25.945901+0000","last_peered":"2023-08-25T05:37:25.945901+0000","last_clean":"2023-08-25T05:37:25.945901+0000","last_became_active":"2023-08-25T05:37:23.547980+0000","last_became_peered":"2023-08-25T05:37:23.547980+0000","last_unstale":"2023-08-25T05:37:25.945901+0000","last_undegraded":"2023-08-25T05:37:25.945901+0000","last_fullsized":"2023-08-25T05:37:25.945901+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:27:46.810103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947163+0000","last_change":"2023-08-25T05:37:24.552195+0000","last_active":"2023-08-25T05:37:25.947163+0000","last_peered":"2023-08-25T05:37:25.947163+0000","last_clean":"2023-08-25T05:37:25.947163+0000","last_became_active":"2023-08-25T05:37:24.549006+0000","last_became_peered":"2023-08-25T05:37:24.549006+0000","last_unstale":"2023-08-25T05:37:25.947163+0000","last_undegraded":"2023-08-25T05:37:25.947163+0000","last_fullsized":"2023-08-25T05:37:25.947163+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:24:14.831092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"201'6","reported_seq":19,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535248+0000","last_change":"2023-08-25T05:37:23.538204+0000","last_active":"2023-08-25T05:37:25.535248+0000","last_peered":"2023-08-25T05:37:25.535248+0000","last_clean":"2023-08-25T05:37:25.535248+0000","last_became_active":"2023-08-25T05:37:23.537792+0000","last_became_peered":"2023-08-25T05:37:23.537792+0000","last_unstale":"2023-08-25T05:37:25.535248+0000","last_undegraded":"2023-08-25T05:37:25.535248+0000","last_fullsized":"2023-08-25T05:37:25.535248+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:27:36.351358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945730+0000","last_change":"2023-08-25T05:37:24.556730+0000","last_active":"2023-08-25T05:37:25.945730+0000","last_peered":"2023-08-25T05:37:25.945730+0000","last_clean":"2023-08-25T05:37:25.945730+0000","last_became_active":"2023-08-25T05:37:24.556341+0000","last_became_peered":"2023-08-25T05:37:24.556341+0000","last_unstale":"2023-08-25T05:37:25.945730+0000","last_undegraded":"2023-08-25T05:37:25.945730+0000","last_fullsized":"2023-08-25T05:37:25.945730+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:25:16.614521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"201'2","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534859+0000","last_change":"2023-08-25T05:37:23.548985+0000","last_active":"2023-08-25T05:37:25.534859+0000","last_peered":"2023-08-25T05:37:25.534859+0000","last_clean":"2023-08-25T05:37:25.534859+0000","last_became_active":"2023-08-25T05:37:23.548687+0000","last_became_peered":"2023-08-25T05:37:23.548687+0000","last_unstale":"2023-08-25T05:37:25.534859+0000","last_undegraded":"2023-08-25T05:37:25.534859+0000","last_fullsized":"2023-08-25T05:37:25.534859+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:04:42.060140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535148+0000","last_change":"2023-08-25T05:37:24.546752+0000","last_active":"2023-08-25T05:37:25.535148+0000","last_peered":"2023-08-25T05:37:25.535148+0000","last_clean":"2023-08-25T05:37:25.535148+0000","last_became_active":"2023-08-25T05:37:24.546439+0000","last_became_peered":"2023-08-25T05:37:24.546439+0000","last_unstale":"2023-08-25T05:37:25.535148+0000","last_undegraded":"2023-08-25T05:37:25.535148+0000","last_fullsized":"2023-08-25T05:37:25.535148+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:31:19.135726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947189+0000","last_change":"2023-08-25T05:37:23.549604+0000","last_active":"2023-08-25T05:37:25.947189+0000","last_peered":"2023-08-25T05:37:25.947189+0000","last_clean":"2023-08-25T05:37:25.947189+0000","last_became_active":"2023-08-25T05:37:23.549308+0000","last_became_peered":"2023-08-25T05:37:23.549308+0000","last_unstale":"2023-08-25T05:37:25.947189+0000","last_undegraded":"2023-08-25T05:37:25.947189+0000","last_fullsized":"2023-08-25T05:37:25.947189+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:06:03.095644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534915+0000","last_change":"2023-08-25T05:37:24.542958+0000","last_active":"2023-08-25T05:37:25.534915+0000","last_peered":"2023-08-25T05:37:25.534915+0000","last_clean":"2023-08-25T05:37:25.534915+0000","last_became_active":"2023-08-25T05:37:24.542607+0000","last_became_peered":"2023-08-25T05:37:24.542607+0000","last_unstale":"2023-08-25T05:37:25.534915+0000","last_undegraded":"2023-08-25T05:37:25.534915+0000","last_fullsized":"2023-08-25T05:37:25.534915+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:25:09.219567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945619+0000","last_change":"2023-08-25T05:37:23.541331+0000","last_active":"2023-08-25T05:37:25.945619+0000","last_peered":"2023-08-25T05:37:25.945619+0000","last_clean":"2023-08-25T05:37:25.945619+0000","last_became_active":"2023-08-25T05:37:23.541030+0000","last_became_peered":"2023-08-25T05:37:23.541030+0000","last_unstale":"2023-08-25T05:37:25.945619+0000","last_undegraded":"2023-08-25T05:37:25.945619+0000","last_fullsized":"2023-08-25T05:37:25.945619+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:55:58.500515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534831+0000","last_change":"2023-08-25T05:37:24.548890+0000","last_active":"2023-08-25T05:37:25.534831+0000","last_peered":"2023-08-25T05:37:25.534831+0000","last_clean":"2023-08-25T05:37:25.534831+0000","last_became_active":"2023-08-25T05:37:24.548602+0000","last_became_peered":"2023-08-25T05:37:24.548602+0000","last_unstale":"2023-08-25T05:37:25.534831+0000","last_undegraded":"2023-08-25T05:37:25.534831+0000","last_fullsized":"2023-08-25T05:37:25.534831+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:59:37.441946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"201'8","reported_seq":21,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945446+0000","last_change":"2023-08-25T05:37:23.547927+0000","last_active":"2023-08-25T05:37:25.945446+0000","last_peered":"2023-08-25T05:37:25.945446+0000","last_clean":"2023-08-25T05:37:25.945446+0000","last_became_active":"2023-08-25T05:37:23.547702+0000","last_became_peered":"2023-08-25T05:37:23.547702+0000","last_unstale":"2023-08-25T05:37:25.945446+0000","last_undegraded":"2023-08-25T05:37:25.945446+0000","last_fullsized":"2023-08-25T05:37:25.945446+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:20:06.549399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945911+0000","last_change":"2023-08-25T05:37:24.552074+0000","last_active":"2023-08-25T05:37:25.945911+0000","last_peered":"2023-08-25T05:37:25.945911+0000","last_clean":"2023-08-25T05:37:25.945911+0000","last_became_active":"2023-08-25T05:37:24.551757+0000","last_became_peered":"2023-08-25T05:37:24.551757+0000","last_unstale":"2023-08-25T05:37:25.945911+0000","last_undegraded":"2023-08-25T05:37:25.945911+0000","last_fullsized":"2023-08-25T05:37:25.945911+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:48:42.020311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"201'1","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946658+0000","last_change":"2023-08-25T05:37:23.546252+0000","last_active":"2023-08-25T05:37:25.946658+0000","last_peered":"2023-08-25T05:37:25.946658+0000","last_clean":"2023-08-25T05:37:25.946658+0000","last_became_active":"2023-08-25T05:37:23.545932+0000","last_became_peered":"2023-08-25T05:37:23.545932+0000","last_unstale":"2023-08-25T05:37:25.946658+0000","last_undegraded":"2023-08-25T05:37:25.946658+0000","last_fullsized":"2023-08-25T05:37:25.946658+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:39:45.038273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535626+0000","last_change":"2023-08-25T05:37:24.543501+0000","last_active":"2023-08-25T05:37:25.535626+0000","last_peered":"2023-08-25T05:37:25.535626+0000","last_clean":"2023-08-25T05:37:25.535626+0000","last_became_active":"2023-08-25T05:37:24.543196+0000","last_became_peered":"2023-08-25T05:37:24.543196+0000","last_unstale":"2023-08-25T05:37:25.535626+0000","last_undegraded":"2023-08-25T05:37:25.535626+0000","last_fullsized":"2023-08-25T05:37:25.535626+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:21:46.850100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"201'2","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946117+0000","last_change":"2023-08-25T05:37:23.548811+0000","last_active":"2023-08-25T05:37:25.946117+0000","last_peered":"2023-08-25T05:37:25.946117+0000","last_clean":"2023-08-25T05:37:25.946117+0000","last_became_active":"2023-08-25T05:37:23.548482+0000","last_became_peered":"2023-08-25T05:37:23.548482+0000","last_unstale":"2023-08-25T05:37:25.946117+0000","last_undegraded":"2023-08-25T05:37:25.946117+0000","last_fullsized":"2023-08-25T05:37:25.946117+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:38:58.552530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946575+0000","last_change":"2023-08-25T05:37:24.553658+0000","last_active":"2023-08-25T05:37:25.946575+0000","last_peered":"2023-08-25T05:37:25.946575+0000","last_clean":"2023-08-25T05:37:25.946575+0000","last_became_active":"2023-08-25T05:37:24.552951+0000","last_became_peered":"2023-08-25T05:37:24.552951+0000","last_unstale":"2023-08-25T05:37:25.946575+0000","last_undegraded":"2023-08-25T05:37:25.946575+0000","last_fullsized":"2023-08-25T05:37:25.946575+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:23:29.974261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"201'1","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.536130+0000","last_change":"2023-08-25T05:37:23.537881+0000","last_active":"2023-08-25T05:37:25.536130+0000","last_peered":"2023-08-25T05:37:25.536130+0000","last_clean":"2023-08-25T05:37:25.536130+0000","last_became_active":"2023-08-25T05:37:23.537336+0000","last_became_peered":"2023-08-25T05:37:23.537336+0000","last_unstale":"2023-08-25T05:37:25.536130+0000","last_undegraded":"2023-08-25T05:37:25.536130+0000","last_fullsized":"2023-08-25T05:37:25.536130+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:39:50.643839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947197+0000","last_change":"2023-08-25T05:37:24.554823+0000","last_active":"2023-08-25T05:37:25.947197+0000","last_peered":"2023-08-25T05:37:25.947197+0000","last_clean":"2023-08-25T05:37:25.947197+0000","last_became_active":"2023-08-25T05:37:24.554515+0000","last_became_peered":"2023-08-25T05:37:24.554515+0000","last_unstale":"2023-08-25T05:37:25.947197+0000","last_undegraded":"2023-08-25T05:37:25.947197+0000","last_fullsized":"2023-08-25T05:37:25.947197+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:53:07.229342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945988+0000","last_change":"2023-08-25T05:37:23.539762+0000","last_active":"2023-08-25T05:37:25.945988+0000","last_peered":"2023-08-25T05:37:25.945988+0000","last_clean":"2023-08-25T05:37:25.945988+0000","last_became_active":"2023-08-25T05:37:23.539481+0000","last_became_peered":"2023-08-25T05:37:23.539481+0000","last_unstale":"2023-08-25T05:37:25.945988+0000","last_undegraded":"2023-08-25T05:37:25.945988+0000","last_fullsized":"2023-08-25T05:37:25.945988+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:00:44.311947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946660+0000","last_change":"2023-08-25T05:37:24.554762+0000","last_active":"2023-08-25T05:37:25.946660+0000","last_peered":"2023-08-25T05:37:25.946660+0000","last_clean":"2023-08-25T05:37:25.946660+0000","last_became_active":"2023-08-25T05:37:24.554485+0000","last_became_peered":"2023-08-25T05:37:24.554485+0000","last_unstale":"2023-08-25T05:37:25.946660+0000","last_undegraded":"2023-08-25T05:37:25.946660+0000","last_fullsized":"2023-08-25T05:37:25.946660+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:18:54.928517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"201'2","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534974+0000","last_change":"2023-08-25T05:37:23.541541+0000","last_active":"2023-08-25T05:37:25.534974+0000","last_peered":"2023-08-25T05:37:25.534974+0000","last_clean":"2023-08-25T05:37:25.534974+0000","last_became_active":"2023-08-25T05:37:23.540976+0000","last_became_peered":"2023-08-25T05:37:23.540976+0000","last_unstale":"2023-08-25T05:37:25.534974+0000","last_undegraded":"2023-08-25T05:37:25.534974+0000","last_fullsized":"2023-08-25T05:37:25.534974+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:46:36.155036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945530+0000","last_change":"2023-08-25T05:37:24.545173+0000","last_active":"2023-08-25T05:37:25.945530+0000","last_peered":"2023-08-25T05:37:25.945530+0000","last_clean":"2023-08-25T05:37:25.945530+0000","last_became_active":"2023-08-25T05:37:24.544902+0000","last_became_peered":"2023-08-25T05:37:24.544902+0000","last_unstale":"2023-08-25T05:37:25.945530+0000","last_undegraded":"2023-08-25T05:37:25.945530+0000","last_fullsized":"2023-08-25T05:37:25.945530+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:39:55.790643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946159+0000","last_change":"2023-08-25T05:37:23.542964+0000","last_active":"2023-08-25T05:37:25.946159+0000","last_peered":"2023-08-25T05:37:25.946159+0000","last_clean":"2023-08-25T05:37:25.946159+0000","last_became_active":"2023-08-25T05:37:23.542633+0000","last_became_peered":"2023-08-25T05:37:23.542633+0000","last_unstale":"2023-08-25T05:37:25.946159+0000","last_undegraded":"2023-08-25T05:37:25.946159+0000","last_fullsized":"2023-08-25T05:37:25.946159+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:17:16.343159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945930+0000","last_change":"2023-08-25T05:37:24.547086+0000","last_active":"2023-08-25T05:37:25.945930+0000","last_peered":"2023-08-25T05:37:25.945930+0000","last_clean":"2023-08-25T05:37:25.945930+0000","last_became_active":"2023-08-25T05:37:24.546792+0000","last_became_peered":"2023-08-25T05:37:24.546792+0000","last_unstale":"2023-08-25T05:37:25.945930+0000","last_undegraded":"2023-08-25T05:37:25.945930+0000","last_fullsized":"2023-08-25T05:37:25.945930+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:59:11.190834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945918+0000","last_change":"2023-08-25T05:37:23.544805+0000","last_active":"2023-08-25T05:37:25.945918+0000","last_peered":"2023-08-25T05:37:25.945918+0000","last_clean":"2023-08-25T05:37:25.945918+0000","last_became_active":"2023-08-25T05:37:23.543947+0000","last_became_peered":"2023-08-25T05:37:23.543947+0000","last_unstale":"2023-08-25T05:37:25.945918+0000","last_undegraded":"2023-08-25T05:37:25.945918+0000","last_fullsized":"2023-08-25T05:37:25.945918+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:48:34.380051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535332+0000","last_change":"2023-08-25T05:37:24.546431+0000","last_active":"2023-08-25T05:37:25.535332+0000","last_peered":"2023-08-25T05:37:25.535332+0000","last_clean":"2023-08-25T05:37:25.535332+0000","last_became_active":"2023-08-25T05:37:24.545627+0000","last_became_peered":"2023-08-25T05:37:24.545627+0000","last_unstale":"2023-08-25T05:37:25.535332+0000","last_undegraded":"2023-08-25T05:37:25.535332+0000","last_fullsized":"2023-08-25T05:37:25.535332+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:26:02.366734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535593+0000","last_change":"2023-08-25T05:37:23.534208+0000","last_active":"2023-08-25T05:37:25.535593+0000","last_peered":"2023-08-25T05:37:25.535593+0000","last_clean":"2023-08-25T05:37:25.535593+0000","last_became_active":"2023-08-25T05:37:23.533909+0000","last_became_peered":"2023-08-25T05:37:23.533909+0000","last_unstale":"2023-08-25T05:37:25.535593+0000","last_undegraded":"2023-08-25T05:37:25.535593+0000","last_fullsized":"2023-08-25T05:37:25.535593+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:21:30.377787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946049+0000","last_change":"2023-08-25T05:37:24.542966+0000","last_active":"2023-08-25T05:37:25.946049+0000","last_peered":"2023-08-25T05:37:25.946049+0000","last_clean":"2023-08-25T05:37:25.946049+0000","last_became_active":"2023-08-25T05:37:24.542653+0000","last_became_peered":"2023-08-25T05:37:24.542653+0000","last_unstale":"2023-08-25T05:37:25.946049+0000","last_undegraded":"2023-08-25T05:37:25.946049+0000","last_fullsized":"2023-08-25T05:37:25.946049+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:19:30.878640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"201'2","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946363+0000","last_change":"2023-08-25T05:37:23.545045+0000","last_active":"2023-08-25T05:37:25.946363+0000","last_peered":"2023-08-25T05:37:25.946363+0000","last_clean":"2023-08-25T05:37:25.946363+0000","last_became_active":"2023-08-25T05:37:23.544775+0000","last_became_peered":"2023-08-25T05:37:23.544775+0000","last_unstale":"2023-08-25T05:37:25.946363+0000","last_undegraded":"2023-08-25T05:37:25.946363+0000","last_fullsized":"2023-08-25T05:37:25.946363+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:19:29.581252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947238+0000","last_change":"2023-08-25T05:37:24.553584+0000","last_active":"2023-08-25T05:37:25.947238+0000","last_peered":"2023-08-25T05:37:25.947238+0000","last_clean":"2023-08-25T05:37:25.947238+0000","last_became_active":"2023-08-25T05:37:24.552603+0000","last_became_peered":"2023-08-25T05:37:24.552603+0000","last_unstale":"2023-08-25T05:37:25.947238+0000","last_undegraded":"2023-08-25T05:37:25.947238+0000","last_fullsized":"2023-08-25T05:37:25.947238+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:13:14.044256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"202'1","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946168+0000","last_change":"2023-08-25T05:37:23.544372+0000","last_active":"2023-08-25T05:37:25.946168+0000","last_peered":"2023-08-25T05:37:25.946168+0000","last_clean":"2023-08-25T05:37:25.946168+0000","last_became_active":"2023-08-25T05:37:23.543939+0000","last_became_peered":"2023-08-25T05:37:23.543939+0000","last_unstale":"2023-08-25T05:37:25.946168+0000","last_undegraded":"2023-08-25T05:37:25.946168+0000","last_fullsized":"2023-08-25T05:37:25.946168+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:16:16.893751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946120+0000","last_change":"2023-08-25T05:37:24.545017+0000","last_active":"2023-08-25T05:37:25.946120+0000","last_peered":"2023-08-25T05:37:25.946120+0000","last_clean":"2023-08-25T05:37:25.946120+0000","last_became_active":"2023-08-25T05:37:24.544711+0000","last_became_peered":"2023-08-25T05:37:24.544711+0000","last_unstale":"2023-08-25T05:37:25.946120+0000","last_undegraded":"2023-08-25T05:37:25.946120+0000","last_fullsized":"2023-08-25T05:37:25.946120+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:52:58.754758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535844+0000","last_change":"2023-08-25T05:37:23.538786+0000","last_active":"2023-08-25T05:37:25.535844+0000","last_peered":"2023-08-25T05:37:25.535844+0000","last_clean":"2023-08-25T05:37:25.535844+0000","last_became_active":"2023-08-25T05:37:23.538507+0000","last_became_peered":"2023-08-25T05:37:23.538507+0000","last_unstale":"2023-08-25T05:37:25.535844+0000","last_undegraded":"2023-08-25T05:37:25.535844+0000","last_fullsized":"2023-08-25T05:37:25.535844+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:55:37.306930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946527+0000","last_change":"2023-08-25T05:37:24.541718+0000","last_active":"2023-08-25T05:37:25.946527+0000","last_peered":"2023-08-25T05:37:25.946527+0000","last_clean":"2023-08-25T05:37:25.946527+0000","last_became_active":"2023-08-25T05:37:24.541001+0000","last_became_peered":"2023-08-25T05:37:24.541001+0000","last_unstale":"2023-08-25T05:37:25.946527+0000","last_undegraded":"2023-08-25T05:37:25.946527+0000","last_fullsized":"2023-08-25T05:37:25.946527+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:51:00.799593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535651+0000","last_change":"2023-08-25T05:37:23.543861+0000","last_active":"2023-08-25T05:37:25.535651+0000","last_peered":"2023-08-25T05:37:25.535651+0000","last_clean":"2023-08-25T05:37:25.535651+0000","last_became_active":"2023-08-25T05:37:23.543553+0000","last_became_peered":"2023-08-25T05:37:23.543553+0000","last_unstale":"2023-08-25T05:37:25.535651+0000","last_undegraded":"2023-08-25T05:37:25.535651+0000","last_fullsized":"2023-08-25T05:37:25.535651+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:16:41.083760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535494+0000","last_change":"2023-08-25T05:37:24.542295+0000","last_active":"2023-08-25T05:37:25.535494+0000","last_peered":"2023-08-25T05:37:25.535494+0000","last_clean":"2023-08-25T05:37:25.535494+0000","last_became_active":"2023-08-25T05:37:24.541954+0000","last_became_peered":"2023-08-25T05:37:24.541954+0000","last_unstale":"2023-08-25T05:37:25.535494+0000","last_undegraded":"2023-08-25T05:37:25.535494+0000","last_fullsized":"2023-08-25T05:37:25.535494+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:39:29.777580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946028+0000","last_change":"2023-08-25T05:37:23.538266+0000","last_active":"2023-08-25T05:37:25.946028+0000","last_peered":"2023-08-25T05:37:25.946028+0000","last_clean":"2023-08-25T05:37:25.946028+0000","last_became_active":"2023-08-25T05:37:23.537926+0000","last_became_peered":"2023-08-25T05:37:23.537926+0000","last_unstale":"2023-08-25T05:37:25.946028+0000","last_undegraded":"2023-08-25T05:37:25.946028+0000","last_fullsized":"2023-08-25T05:37:25.946028+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:23:16.862189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534754+0000","last_change":"2023-08-25T05:37:24.534975+0000","last_active":"2023-08-25T05:37:25.534754+0000","last_peered":"2023-08-25T05:37:25.534754+0000","last_clean":"2023-08-25T05:37:25.534754+0000","last_became_active":"2023-08-25T05:37:24.532274+0000","last_became_peered":"2023-08-25T05:37:24.532274+0000","last_unstale":"2023-08-25T05:37:25.534754+0000","last_undegraded":"2023-08-25T05:37:25.534754+0000","last_fullsized":"2023-08-25T05:37:25.534754+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:59:23.180394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945680+0000","last_change":"2023-08-25T05:37:23.540495+0000","last_active":"2023-08-25T05:37:25.945680+0000","last_peered":"2023-08-25T05:37:25.945680+0000","last_clean":"2023-08-25T05:37:25.945680+0000","last_became_active":"2023-08-25T05:37:23.540219+0000","last_became_peered":"2023-08-25T05:37:23.540219+0000","last_unstale":"2023-08-25T05:37:25.945680+0000","last_undegraded":"2023-08-25T05:37:25.945680+0000","last_fullsized":"2023-08-25T05:37:25.945680+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:03:56.780044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947065+0000","last_change":"2023-08-25T05:37:24.557494+0000","last_active":"2023-08-25T05:37:25.947065+0000","last_peered":"2023-08-25T05:37:25.947065+0000","last_clean":"2023-08-25T05:37:25.947065+0000","last_became_active":"2023-08-25T05:37:24.555335+0000","last_became_peered":"2023-08-25T05:37:24.555335+0000","last_unstale":"2023-08-25T05:37:25.947065+0000","last_undegraded":"2023-08-25T05:37:25.947065+0000","last_fullsized":"2023-08-25T05:37:25.947065+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:24:11.216210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945773+0000","last_change":"2023-08-25T05:37:23.539559+0000","last_active":"2023-08-25T05:37:25.945773+0000","last_peered":"2023-08-25T05:37:25.945773+0000","last_clean":"2023-08-25T05:37:25.945773+0000","last_became_active":"2023-08-25T05:37:23.539274+0000","last_became_peered":"2023-08-25T05:37:23.539274+0000","last_unstale":"2023-08-25T05:37:25.945773+0000","last_undegraded":"2023-08-25T05:37:25.945773+0000","last_fullsized":"2023-08-25T05:37:25.945773+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:07:52.604161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945927+0000","last_change":"2023-08-25T05:37:24.553628+0000","last_active":"2023-08-25T05:37:25.945927+0000","last_peered":"2023-08-25T05:37:25.945927+0000","last_clean":"2023-08-25T05:37:25.945927+0000","last_became_active":"2023-08-25T05:37:24.553348+0000","last_became_peered":"2023-08-25T05:37:24.553348+0000","last_unstale":"2023-08-25T05:37:25.945927+0000","last_undegraded":"2023-08-25T05:37:25.945927+0000","last_fullsized":"2023-08-25T05:37:25.945927+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:32:16.659695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535724+0000","last_change":"2023-08-25T05:37:23.539963+0000","last_active":"2023-08-25T05:37:25.535724+0000","last_peered":"2023-08-25T05:37:25.535724+0000","last_clean":"2023-08-25T05:37:25.535724+0000","last_became_active":"2023-08-25T05:37:23.539671+0000","last_became_peered":"2023-08-25T05:37:23.539671+0000","last_unstale":"2023-08-25T05:37:25.535724+0000","last_undegraded":"2023-08-25T05:37:25.535724+0000","last_fullsized":"2023-08-25T05:37:25.535724+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:02:54.269091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535936+0000","last_change":"2023-08-25T05:37:24.540958+0000","last_active":"2023-08-25T05:37:25.535936+0000","last_peered":"2023-08-25T05:37:25.535936+0000","last_clean":"2023-08-25T05:37:25.535936+0000","last_became_active":"2023-08-25T05:37:24.539077+0000","last_became_peered":"2023-08-25T05:37:24.539077+0000","last_unstale":"2023-08-25T05:37:25.535936+0000","last_undegraded":"2023-08-25T05:37:25.535936+0000","last_fullsized":"2023-08-25T05:37:25.535936+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:22:31.241833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945498+0000","last_change":"2023-08-25T05:37:23.545056+0000","last_active":"2023-08-25T05:37:25.945498+0000","last_peered":"2023-08-25T05:37:25.945498+0000","last_clean":"2023-08-25T05:37:25.945498+0000","last_became_active":"2023-08-25T05:37:23.544817+0000","last_became_peered":"2023-08-25T05:37:23.544817+0000","last_unstale":"2023-08-25T05:37:25.945498+0000","last_undegraded":"2023-08-25T05:37:25.945498+0000","last_fullsized":"2023-08-25T05:37:25.945498+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:56:49.193533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"191'3653","reported_seq":4647,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946353+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:37:25.946353+0000","last_peered":"2023-08-25T05:37:25.946353+0000","last_clean":"2023-08-25T05:37:25.946353+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:37:25.946353+0000","last_undegraded":"2023-08-25T05:37:25.946353+0000","last_fullsized":"2023-08-25T05:37:25.946353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3653,"log_dups_size":0,"ondisk_log_size":3653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:07:43.317595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2096,"num_read_kb":4403,"num_write":565,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":360,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945672+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:37:25.945672+0000","last_peered":"2023-08-25T05:37:25.945672+0000","last_clean":"2023-08-25T05:37:25.945672+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:37:25.945672+0000","last_undegraded":"2023-08-25T05:37:25.945672+0000","last_fullsized":"2023-08-25T05:37:25.945672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:20:26.158476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534798+0000","last_change":"2023-08-25T05:37:24.542467+0000","last_active":"2023-08-25T05:37:25.534798+0000","last_peered":"2023-08-25T05:37:25.534798+0000","last_clean":"2023-08-25T05:37:25.534798+0000","last_became_active":"2023-08-25T05:37:24.542059+0000","last_became_peered":"2023-08-25T05:37:24.542059+0000","last_unstale":"2023-08-25T05:37:25.534798+0000","last_undegraded":"2023-08-25T05:37:25.534798+0000","last_fullsized":"2023-08-25T05:37:25.534798+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:20:35.194400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"201'1","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535425+0000","last_change":"2023-08-25T05:37:23.540887+0000","last_active":"2023-08-25T05:37:25.535425+0000","last_peered":"2023-08-25T05:37:25.535425+0000","last_clean":"2023-08-25T05:37:25.535425+0000","last_became_active":"2023-08-25T05:37:23.540612+0000","last_became_peered":"2023-08-25T05:37:23.540612+0000","last_unstale":"2023-08-25T05:37:25.535425+0000","last_undegraded":"2023-08-25T05:37:25.535425+0000","last_fullsized":"2023-08-25T05:37:25.535425+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:25:21.656718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":351,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946256+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:37:25.946256+0000","last_peered":"2023-08-25T05:37:25.946256+0000","last_clean":"2023-08-25T05:37:25.946256+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:37:25.946256+0000","last_undegraded":"2023-08-25T05:37:25.946256+0000","last_fullsized":"2023-08-25T05:37:25.946256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:37:35.236035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946896+0000","last_change":"2023-08-25T05:37:24.550171+0000","last_active":"2023-08-25T05:37:25.946896+0000","last_peered":"2023-08-25T05:37:25.946896+0000","last_clean":"2023-08-25T05:37:25.946896+0000","last_became_active":"2023-08-25T05:37:24.548942+0000","last_became_peered":"2023-08-25T05:37:24.548942+0000","last_unstale":"2023-08-25T05:37:25.946896+0000","last_undegraded":"2023-08-25T05:37:25.946896+0000","last_fullsized":"2023-08-25T05:37:25.946896+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:21:55.876731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"201'1","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946034+0000","last_change":"2023-08-25T05:37:23.548551+0000","last_active":"2023-08-25T05:37:25.946034+0000","last_peered":"2023-08-25T05:37:25.946034+0000","last_clean":"2023-08-25T05:37:25.946034+0000","last_became_active":"2023-08-25T05:37:23.548254+0000","last_became_peered":"2023-08-25T05:37:23.548254+0000","last_unstale":"2023-08-25T05:37:25.946034+0000","last_undegraded":"2023-08-25T05:37:25.946034+0000","last_fullsized":"2023-08-25T05:37:25.946034+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:10:03.239783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":360,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946039+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:37:25.946039+0000","last_peered":"2023-08-25T05:37:25.946039+0000","last_clean":"2023-08-25T05:37:25.946039+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:37:25.946039+0000","last_undegraded":"2023-08-25T05:37:25.946039+0000","last_fullsized":"2023-08-25T05:37:25.946039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:41:11.257962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947341+0000","last_change":"2023-08-25T05:37:24.548621+0000","last_active":"2023-08-25T05:37:25.947341+0000","last_peered":"2023-08-25T05:37:25.947341+0000","last_clean":"2023-08-25T05:37:25.947341+0000","last_became_active":"2023-08-25T05:37:24.548234+0000","last_became_peered":"2023-08-25T05:37:24.548234+0000","last_unstale":"2023-08-25T05:37:25.947341+0000","last_undegraded":"2023-08-25T05:37:25.947341+0000","last_fullsized":"2023-08-25T05:37:25.947341+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:37:00.408184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":13,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.534798+0000","last_change":"2023-08-25T05:37:23.535156+0000","last_active":"2023-08-25T05:37:25.534798+0000","last_peered":"2023-08-25T05:37:25.534798+0000","last_clean":"2023-08-25T05:37:25.534798+0000","last_became_active":"2023-08-25T05:37:23.534879+0000","last_became_peered":"2023-08-25T05:37:23.534879+0000","last_unstale":"2023-08-25T05:37:25.534798+0000","last_undegraded":"2023-08-25T05:37:25.534798+0000","last_fullsized":"2023-08-25T05:37:25.534798+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:01:28.425270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":360,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.945826+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:37:25.945826+0000","last_peered":"2023-08-25T05:37:25.945826+0000","last_clean":"2023-08-25T05:37:25.945826+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:37:25.945826+0000","last_undegraded":"2023-08-25T05:37:25.945826+0000","last_fullsized":"2023-08-25T05:37:25.945826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:22:48.193179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946355+0000","last_change":"2023-08-25T05:37:24.544922+0000","last_active":"2023-08-25T05:37:25.946355+0000","last_peered":"2023-08-25T05:37:25.946355+0000","last_clean":"2023-08-25T05:37:25.946355+0000","last_became_active":"2023-08-25T05:37:24.544633+0000","last_became_peered":"2023-08-25T05:37:24.544633+0000","last_unstale":"2023-08-25T05:37:25.946355+0000","last_undegraded":"2023-08-25T05:37:25.946355+0000","last_fullsized":"2023-08-25T05:37:25.946355+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T10:46:30.308620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"201'4","reported_seq":17,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946273+0000","last_change":"2023-08-25T05:37:23.545829+0000","last_active":"2023-08-25T05:37:25.946273+0000","last_peered":"2023-08-25T05:37:25.946273+0000","last_clean":"2023-08-25T05:37:25.946273+0000","last_became_active":"2023-08-25T05:37:23.545567+0000","last_became_peered":"2023-08-25T05:37:23.545567+0000","last_unstale":"2023-08-25T05:37:25.946273+0000","last_undegraded":"2023-08-25T05:37:25.946273+0000","last_fullsized":"2023-08-25T05:37:25.946273+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:53:54.916939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":390,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946952+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:37:25.946952+0000","last_peered":"2023-08-25T05:37:25.946952+0000","last_clean":"2023-08-25T05:37:25.946952+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:37:25.946952+0000","last_undegraded":"2023-08-25T05:37:25.946952+0000","last_fullsized":"2023-08-25T05:37:25.946952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:27:24.654491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946312+0000","last_change":"2023-08-25T05:37:24.548353+0000","last_active":"2023-08-25T05:37:25.946312+0000","last_peered":"2023-08-25T05:37:25.946312+0000","last_clean":"2023-08-25T05:37:25.946312+0000","last_became_active":"2023-08-25T05:37:24.546455+0000","last_became_peered":"2023-08-25T05:37:24.546455+0000","last_unstale":"2023-08-25T05:37:25.946312+0000","last_undegraded":"2023-08-25T05:37:25.946312+0000","last_fullsized":"2023-08-25T05:37:25.946312+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T07:56:59.133449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"201'1","reported_seq":14,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535883+0000","last_change":"2023-08-25T05:37:23.538911+0000","last_active":"2023-08-25T05:37:25.535883+0000","last_peered":"2023-08-25T05:37:25.535883+0000","last_clean":"2023-08-25T05:37:25.535883+0000","last_became_active":"2023-08-25T05:37:23.538567+0000","last_became_peered":"2023-08-25T05:37:23.538567+0000","last_unstale":"2023-08-25T05:37:25.535883+0000","last_undegraded":"2023-08-25T05:37:25.535883+0000","last_fullsized":"2023-08-25T05:37:25.535883+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:24:04.911704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":350,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946253+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:37:25.946253+0000","last_peered":"2023-08-25T05:37:25.946253+0000","last_clean":"2023-08-25T05:37:25.946253+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:37:25.946253+0000","last_undegraded":"2023-08-25T05:37:25.946253+0000","last_fullsized":"2023-08-25T05:37:25.946253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:13:20.329031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946323+0000","last_change":"2023-08-25T05:37:24.555758+0000","last_active":"2023-08-25T05:37:25.946323+0000","last_peered":"2023-08-25T05:37:25.946323+0000","last_clean":"2023-08-25T05:37:25.946323+0000","last_became_active":"2023-08-25T05:37:24.555465+0000","last_became_peered":"2023-08-25T05:37:24.555465+0000","last_unstale":"2023-08-25T05:37:25.946323+0000","last_undegraded":"2023-08-25T05:37:25.946323+0000","last_fullsized":"2023-08-25T05:37:25.946323+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:15:54.144699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"201'2","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.946034+0000","last_change":"2023-08-25T05:37:23.537014+0000","last_active":"2023-08-25T05:37:25.946034+0000","last_peered":"2023-08-25T05:37:25.946034+0000","last_clean":"2023-08-25T05:37:25.946034+0000","last_became_active":"2023-08-25T05:37:23.536588+0000","last_became_peered":"2023-08-25T05:37:23.536588+0000","last_unstale":"2023-08-25T05:37:25.946034+0000","last_undegraded":"2023-08-25T05:37:25.946034+0000","last_fullsized":"2023-08-25T05:37:25.946034+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:27:40.337374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":388,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.947298+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:37:25.947298+0000","last_peered":"2023-08-25T05:37:25.947298+0000","last_clean":"2023-08-25T05:37:25.947298+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:37:25.947298+0000","last_undegraded":"2023-08-25T05:37:25.947298+0000","last_fullsized":"2023-08-25T05:37:25.947298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:56:44.758824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":11,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.536308+0000","last_change":"2023-08-25T05:37:24.540049+0000","last_active":"2023-08-25T05:37:25.536308+0000","last_peered":"2023-08-25T05:37:25.536308+0000","last_clean":"2023-08-25T05:37:25.536308+0000","last_became_active":"2023-08-25T05:37:24.538824+0000","last_became_peered":"2023-08-25T05:37:24.538824+0000","last_unstale":"2023-08-25T05:37:25.536308+0000","last_undegraded":"2023-08-25T05:37:25.536308+0000","last_fullsized":"2023-08-25T05:37:25.536308+0000","mapping_epoch":200,"log_start":"0'0","ondisk_log_start":"0'0","created":200,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:23.512067+0000","last_clean_scrub_stamp":"2023-08-25T05:37:23.512067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T17:27:53.789408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"201'2","reported_seq":15,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.535172+0000","last_change":"2023-08-25T05:37:23.540783+0000","last_active":"2023-08-25T05:37:25.535172+0000","last_peered":"2023-08-25T05:37:25.535172+0000","last_clean":"2023-08-25T05:37:25.535172+0000","last_became_active":"2023-08-25T05:37:23.540346+0000","last_became_peered":"2023-08-25T05:37:23.540346+0000","last_unstale":"2023-08-25T05:37:25.535172+0000","last_undegraded":"2023-08-25T05:37:25.535172+0000","last_fullsized":"2023-08-25T05:37:25.535172+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":199,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:37:22.491450+0000","last_clean_scrub_stamp":"2023-08-25T05:37:22.491450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:59:46.613445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":412,"reported_epoch":202,"state":"active+clean","last_fresh":"2023-08-25T05:37:25.536309+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:37:25.536309+0000","last_peered":"2023-08-25T05:37:25.536309+0000","last_clean":"2023-08-25T05:37:25.536309+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:37:25.536309+0000","last_undegraded":"2023-08-25T05:37:25.536309+0000","last_fullsized":"2023-08-25T05:37:25.536309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:59:16.212909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2096,"num_read_kb":4403,"num_write":565,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3653,"ondisk_log_size":3653,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510570,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52276,"kb_used_data":3044,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319564,"statfs":{"total":96636764160,"available":96583233536,"internally_reserved":0,"allocated":3117056,"data_stored":1873058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.40999999999999998},"max":{"1min":0.94599999999999995,"5min":0.95499999999999996,"15min":1.0169999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.441},"max":{"1min":0.90700000000000003,"5min":1.016,"15min":1.0189999999999999},"last":0.73799999999999999}]},{"osd":1,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93799999999999994,"5min":0.99199999999999999,"15min":1.054},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.749,"15min":0.77300000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.84999999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.753},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77300000000000002,"15min":0.76800000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.53600000000000003},"max":{"1min":1.0129999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.70999999999999996}]},{"osd":3,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76700000000000002,"15min":0.77000000000000002},"min":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94499999999999995,"5min":1.006,"15min":1.006},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98299999999999998,"5min":1.0600000000000001,"15min":1.0680000000000001},"last":0.76400000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0449999999999999,"5min":1.163,"15min":1.163},"last":0.69099999999999995}]},{"osd":5,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.36599999999999999},"max":{"1min":0.97199999999999998,"5min":0.997,"15min":1.1120000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.501,"5min":0.44,"15min":0.42699999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.90200000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.74399999999999999,"15min":0.73099999999999998},"min":{"1min":0.50900000000000001,"5min":0.499,"15min":0.47999999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.71499999999999997,"15min":0.69999999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0900000000000001,"5min":1.119,"15min":1.119},"last":0.87}]}]},{"osd":6,"up_from":15,"seq":64424510570,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33648,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338192,"statfs":{"total":96636764160,"available":96602308608,"internally_reserved":0,"allocated":2527232,"data_stored":1282760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31914251},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.73899999999999999,"15min":0.745},"min":{"1min":0.45600000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.876,"5min":0.99099999999999999,"15min":1.0449999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.72399999999999998,"15min":0.73599999999999999},"min":{"1min":0.50800000000000001,"5min":0.40100000000000002,"15min":0.40000000000000002},"max":{"1min":0.88600000000000001,"5min":1.0389999999999999,"15min":1.1699999999999999},"last":0.62}]},{"osd":1,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.75,"15min":0.76300000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":1.1559999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.48899999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1299999999999999},"last":0.77000000000000002}]},{"osd":2,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76100000000000001,"15min":0.78700000000000003},"min":{"1min":0.55000000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98099999999999998,"5min":1.0760000000000001,"15min":1.0780000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.81699999999999995,"15min":0.82499999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.96799999999999997,"5min":1.0669999999999999,"15min":1.1599999999999999},"last":0.86799999999999999}]},{"osd":3,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.497,"5min":0.47999999999999998,"15min":0.46400000000000002},"max":{"1min":1.002,"5min":1.0049999999999999,"15min":1.208},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77300000000000002,"15min":0.78600000000000003},"min":{"1min":0.58699999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0149999999999999,"5min":1.054,"15min":1.236},"last":0.88400000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58399999999999996,"15min":0.59199999999999997},"min":{"1min":0.45300000000000001,"5min":0.38400000000000001,"15min":0.33200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.018},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59899999999999998,"15min":0.60499999999999998},"min":{"1min":0.42799999999999999,"5min":0.40699999999999997,"15min":0.35499999999999998},"max":{"1min":0.83999999999999997,"5min":0.85799999999999998,"15min":1.016},"last":0.67300000000000004}]},{"osd":5,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64900000000000002,"15min":0.65200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.44},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":1.1319999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.73499999999999999},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.1659999999999999},"last":0.91400000000000003}]},{"osd":7,"last update":"Fri Aug 25 05:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.39700000000000002},"max":{"1min":0.78000000000000003,"5min":0.97199999999999998,"15min":1.044},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68700000000000006,"15min":0.69699999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.42899999999999999},"max":{"1min":0.96399999999999997,"5min":1.228,"15min":1.228},"last":0.83299999999999996}]}]},{"osd":5,"up_from":14,"seq":60129543273,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60032,"kb_used_data":2480,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311808,"statfs":{"total":96636764160,"available":96575291392,"internally_reserved":0,"allocated":2539520,"data_stored":1284324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75700000000000001,"15min":0.754},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.97499999999999998,"5min":0.98199999999999998,"15min":1.034},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.45100000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94599999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.94699999999999995}]},{"osd":1,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96099999999999997,"5min":1.073,"15min":1.073},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77400000000000002,"15min":0.77600000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.99199999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.95699999999999996,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.47999999999999998},"max":{"1min":1.018,"5min":1.208,"15min":1.208},"last":0.93100000000000005}]},{"osd":3,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77000000000000002,"15min":0.76700000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96199999999999997,"5min":1.155,"15min":1.155},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79900000000000004,"15min":0.79500000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0089999999999999,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.85299999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:36:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64400000000000002,"15min":0.60599999999999998},"min":{"1min":0.41799999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.86399999999999999,"5min":1.681,"15min":1.681},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.66100000000000003,"15min":0.63400000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.42499999999999999},"max":{"1min":0.89200000000000002,"5min":1.381,"15min":1.381},"last":0.90800000000000003}]},{"osd":6,"last update":"Fri Aug 25 05:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.69999999999999996,"15min":0.67000000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.42199999999999999},"max":{"1min":0.92200000000000004,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68700000000000006,"15min":0.68200000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.44900000000000001},"max":{"1min":0.86799999999999999,"5min":1.276,"15min":1.276},"last":0.79600000000000004}]},{"osd":7,"last update":"Fri Aug 25 05:36:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68200000000000005,"15min":0.66100000000000003},"min":{"1min":0.46500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.874,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77400000000000002,"15min":0.74099999999999999},"min":{"1min":0.53300000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96799999999999997,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.876}]}]},{"osd":4,"up_from":14,"seq":60129543273,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47556,"kb_used_data":2480,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324284,"statfs":{"total":96636764160,"available":96588066816,"internally_reserved":0,"allocated":2539520,"data_stored":1284336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.054},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96499999999999997,"5min":0.97799999999999998,"15min":1.02},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.77300000000000002},"min":{"1min":0.48199999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0449999999999999,"5min":1.05,"15min":1.05},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.75800000000000001,"15min":0.76400000000000001},"min":{"1min":0.57799999999999996,"5min":0.51000000000000001,"15min":0.505},"max":{"1min":0.97999999999999998,"5min":1.022,"15min":1.103},"last":0.66300000000000003}]},{"osd":2,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.77700000000000002,"15min":0.78700000000000003},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.51800000000000002},"max":{"1min":0.95699999999999996,"5min":0.995,"15min":1.0780000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.76100000000000001,"15min":0.77200000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.47999999999999998},"max":{"1min":1.0649999999999999,"5min":1.069,"15min":1.069},"last":0.55100000000000005}]},{"osd":3,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76500000000000001,"15min":0.78800000000000003},"min":{"1min":0.55800000000000005,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.995,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.77600000000000002,"15min":0.78200000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95599999999999996,"5min":1.101,"15min":1.101},"last":0.60199999999999998}]},{"osd":5,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56699999999999995,"15min":0.55300000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81200000000000006,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.60299999999999998},"min":{"1min":0.46899999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93700000000000006,"5min":0.96799999999999997,"15min":0.98299999999999998},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.755,"15min":0.75},"min":{"1min":0.58399999999999996,"5min":0.49399999999999999,"15min":0.49199999999999999},"max":{"1min":1.0029999999999999,"5min":1.008,"15min":1.1240000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.66700000000000004,"15min":0.65800000000000003},"min":{"1min":0.40799999999999997,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.0629999999999999},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Aug 25 05:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61899999999999999,"15min":0.623},"min":{"1min":0.41899999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91000000000000003,"5min":0.996,"15min":0.996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.72299999999999998},"min":{"1min":0.53200000000000003,"5min":0.496,"15min":0.47599999999999998},"max":{"1min":0.96699999999999997,"5min":1.0389999999999999,"15min":1.0860000000000001},"last":0.68799999999999994}]}]},{"osd":3,"up_from":14,"seq":60129543273,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64184,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307656,"statfs":{"total":96636764160,"available":96571039744,"internally_reserved":0,"allocated":2531328,"data_stored":1282850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":63174923},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.33400000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.35499999999999998,"15min":0.34000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.92900000000000005},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52300000000000002,"15min":0.52800000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33300000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":1.0780000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.61299999999999999,"15min":0.629},"min":{"1min":0.44400000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.80500000000000005,"5min":0.88900000000000001,"15min":0.97999999999999998},"last":0.48899999999999999}]},{"osd":2,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.50600000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.81100000000000005,"5min":1.0089999999999999,"15min":1.038},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.44800000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71999999999999997,"5min":0.79000000000000004,"15min":0.95799999999999996},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.52300000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.046,"5min":1.26,"15min":1.26},"last":1.014},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.83899999999999997,"15min":0.83199999999999996},"min":{"1min":0.58099999999999996,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.125,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.98099999999999998}]},{"osd":5,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.65300000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.026,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82299999999999995,"15min":0.82999999999999996},"min":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.1419999999999999},"last":0.95799999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85799999999999998,"15min":0.86699999999999999},"min":{"1min":0.60999999999999999,"5min":0.59499999999999997,"15min":0.59399999999999997},"max":{"1min":1.1160000000000001,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.65200000000000002,"5min":0.58399999999999996,"15min":0.48999999999999999},"max":{"1min":1.0469999999999999,"5min":1.133,"15min":1.194},"last":0.89900000000000002}]},{"osd":7,"last update":"Fri Aug 25 05:36:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.86699999999999999,"15min":0.879},"min":{"1min":0.63100000000000001,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.169,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.871},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.83299999999999996,"15min":0.83599999999999997},"min":{"1min":0.625,"5min":0.52900000000000003,"15min":0.51800000000000002},"max":{"1min":1.0669999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.997}]}]},{"osd":2,"up_from":14,"seq":60129543274,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60016,"kb_used_data":2468,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311824,"statfs":{"total":96636764160,"available":96575307776,"internally_reserved":0,"allocated":2527232,"data_stored":1283272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.46000000000000002,"15min":0.47699999999999998},"min":{"1min":0.33400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.439},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.35499999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71699999999999997,"5min":0.85099999999999998,"15min":0.86099999999999999},"last":0.47999999999999998}]},{"osd":1,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66200000000000003,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83099999999999996,"5min":0.88800000000000001,"15min":0.89700000000000002},"last":0.53000000000000003}]},{"osd":3,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.41099999999999998,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.78000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.63200000000000001,"5min":0.56399999999999995,"15min":0.48699999999999999},"max":{"1min":1.0720000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80400000000000005,"15min":0.81100000000000005},"min":{"1min":0.66200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.1619999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.77700000000000002}]},{"osd":5,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.60899999999999999,"5min":0.53200000000000003,"15min":0.51700000000000002},"max":{"1min":1.0089999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.84699999999999998},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.246,"5min":1.266,"15min":1.266},"last":0.66800000000000004}]},{"osd":6,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.103,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.875,"15min":0.88},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.58899999999999997},"max":{"1min":1.204,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.749}]},{"osd":7,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.82599999999999996,"15min":0.83799999999999997},"min":{"1min":0.69299999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1040000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.624},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.82699999999999996,"15min":0.83199999999999996},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1870000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.76300000000000001}]}]},{"osd":1,"up_from":14,"seq":60129543274,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41964,"kb_used_data":2464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329876,"statfs":{"total":96636764160,"available":96593793024,"internally_reserved":0,"allocated":2523136,"data_stored":1282690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.47699999999999998},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.70299999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.34100000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.71099999999999997,"5min":0.73799999999999999,"15min":0.879},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.81399999999999995},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66600000000000004,"5min":0.82899999999999996,"15min":0.91400000000000003},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73199999999999998,"5min":0.998,"15min":0.998},"last":0.497},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.376,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73299999999999998,"5min":0.88700000000000001,"15min":0.98699999999999999},"last":0.42599999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91000000000000003,"5min":1.1559999999999999,"15min":1.2350000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82999999999999996,"15min":0.83699999999999997},"min":{"1min":0.69099999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98699999999999999,"5min":1.268,"15min":1.268},"last":0.96199999999999997}]},{"osd":5,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.80900000000000005},"min":{"1min":0.624,"5min":0.54800000000000004,"15min":0.47699999999999998},"max":{"1min":0.89800000000000002,"5min":1.109,"15min":1.1950000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.66200000000000003,"5min":0.61899999999999999,"15min":0.55300000000000005},"max":{"1min":0.97899999999999998,"5min":1.214,"15min":1.214},"last":0.78600000000000003}]},{"osd":6,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.66100000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.94499999999999995,"5min":1.212,"15min":1.244},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.81899999999999995,"15min":0.83699999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.94699999999999995,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.75900000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81200000000000006,"15min":0.83699999999999997},"min":{"1min":0.61699999999999999,"5min":0.60899999999999999,"15min":0.55600000000000005},"max":{"1min":1.0069999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.626},"max":{"1min":0.96799999999999997,"5min":1.127,"15min":1.2110000000000001},"last":0.79400000000000004}]}]},{"osd":0,"up_from":14,"seq":60129543273,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60616,"kb_used_data":3060,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311224,"statfs":{"total":96636764160,"available":96574693376,"internally_reserved":0,"allocated":3133440,"data_stored":1873786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48999999999999999,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.308,"15min":0.30599999999999999},"max":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":1.2170000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.81599999999999995,"15min":0.85999999999999999},"last":0.374}]},{"osd":2,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36399999999999999,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":0.81399999999999995,"15min":0.91000000000000003},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55000000000000004,"15min":0.56100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71499999999999997,"5min":0.755,"15min":0.86799999999999999},"last":0.498}]},{"osd":3,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.754,"15min":1.855},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.75900000000000001,"5min":0.90000000000000002,"15min":1.3480000000000001},"last":0.42599999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.57599999999999996,"5min":0.495,"15min":0.495},"max":{"1min":1.0600000000000001,"5min":1.258,"15min":1.3799999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81699999999999995,"15min":0.83199999999999996},"min":{"1min":0.627,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0529999999999999,"5min":1.2809999999999999,"15min":1.2849999999999999},"last":0.67800000000000005}]},{"osd":5,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.58999999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.004,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82499999999999996,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0620000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.51800000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82199999999999995,"15min":0.83599999999999997},"min":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0429999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86499999999999999,"15min":0.85999999999999999},"min":{"1min":0.51600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.0880000000000001,"5min":1.3560000000000001,"15min":1.5129999999999999},"last":0.63200000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85799999999999998,"15min":0.876},"min":{"1min":0.64600000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0760000000000001,"5min":1.4339999999999999,"15min":1.5720000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58099999999999996},"max":{"1min":1.0620000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.58399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:37:33.603 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-25T05:37:33.604 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-25T05:37:33.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f73ad4e5640 1 Processor -- start 2023-08-25T05:37:33.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f73ad4e5640 1 -- start start 2023-08-25T05:37:33.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f73ad4e5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f73a81601f0 0x7f73a815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:33.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f73ad4e5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73a815e3c0 0x7f73a80d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:33.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f73ad4e5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73a80d10c0 0x7f73a80b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:33.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f73ad4e5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a80cd5a0 con 0x7f73a80d10c0 2023-08-25T05:37:33.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f73ad4e5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a80cd880 con 0x7f73a81601f0 2023-08-25T05:37:33.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f73ad4e5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a80cdb60 con 0x7f73a815e3c0 2023-08-25T05:37:33.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f73a77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73a80d10c0 0x7f73a80b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:33.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f73a77fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73a80d10c0 0x7f73a80b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58858/0 (socket says 172.21.15.55:58858) 2023-08-25T05:37:33.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f73a77fe640 1 -- 172.21.15.55:0/251290597 learned_addr learned my addr 172.21.15.55:0/251290597 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:33.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f739e7fc640 1 --2- 172.21.15.55:0/251290597 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73a815e3c0 0x7f73a80d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:33.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f73a6ffd640 1 --2- 172.21.15.55:0/251290597 >> v2:172.21.15.110:3300/0 conn(0x7f73a81601f0 0x7f73a815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:33.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f73a77fe640 1 -- 172.21.15.55:0/251290597 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73a815e3c0 msgr2=0x7f73a80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:33.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f73a77fe640 1 --2- 172.21.15.55:0/251290597 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73a815e3c0 0x7f73a80d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f73a77fe640 1 -- 172.21.15.55:0/251290597 >> v2:172.21.15.110:3300/0 conn(0x7f73a81601f0 msgr2=0x7f73a815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:33.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f73a77fe640 1 --2- 172.21.15.55:0/251290597 >> v2:172.21.15.110:3300/0 conn(0x7f73a81601f0 0x7f73a815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f73a77fe640 1 -- 172.21.15.55:0/251290597 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a80cde40 con 0x7f73a80d10c0 2023-08-25T05:37:33.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f73a6ffd640 1 --2- 172.21.15.55:0/251290597 >> v2:172.21.15.110:3300/0 conn(0x7f73a81601f0 0x7f73a815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:33.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.787+0000 7f739e7fc640 1 --2- 172.21.15.55:0/251290597 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73a815e3c0 0x7f73a80d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:33.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.791+0000 7f73a77fe640 1 --2- 172.21.15.55:0/251290597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a80d10c0 0x7f73a80b4250 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f73a808b7f0 tx=0x7f73a001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f22762602787af server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:33.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.791+0000 7f73a67fc640 1 -- 172.21.15.55:0/251290597 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a00a89b0 con 0x7f73a80d10c0 2023-08-25T05:37:33.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.791+0000 7f73a67fc640 1 -- 172.21.15.55:0/251290597 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a00a8b10 con 0x7f73a80d10c0 2023-08-25T05:37:33.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.791+0000 7f73a67fc640 1 -- 172.21.15.55:0/251290597 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a00a8ea0 con 0x7f73a80d10c0 2023-08-25T05:37:33.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.791+0000 7f73ad4e5640 1 -- 172.21.15.55:0/251290597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a80d10c0 msgr2=0x7f73a80b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:33.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.791+0000 7f73ad4e5640 1 --2- 172.21.15.55:0/251290597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a80d10c0 0x7f73a80b4250 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f73a808b7f0 tx=0x7f73a001ecf0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.791+0000 7f73ad4e5640 1 -- 172.21.15.55:0/251290597 shutdown_connections 2023-08-25T05:37:33.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.791+0000 7f73ad4e5640 1 --2- 172.21.15.55:0/251290597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a80d10c0 0x7f73a80b4250 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.791+0000 7f73ad4e5640 1 --2- 172.21.15.55:0/251290597 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73a815e3c0 0x7f73a80d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.791+0000 7f73ad4e5640 1 --2- 172.21.15.55:0/251290597 >> v2:172.21.15.110:3300/0 conn(0x7f73a81601f0 0x7f73a815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.791+0000 7f73ad4e5640 1 -- 172.21.15.55:0/251290597 >> 172.21.15.55:0/251290597 conn(0x7f73a80d27d0 msgr2=0x7f73a80d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:33.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.791+0000 7f73ad4e5640 1 -- 172.21.15.55:0/251290597 shutdown_connections 2023-08-25T05:37:33.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.791+0000 7f73ad4e5640 1 -- 172.21.15.55:0/251290597 wait complete. 2023-08-25T05:37:33.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73ad4e5640 1 Processor -- start 2023-08-25T05:37:33.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73ad4e5640 1 -- start start 2023-08-25T05:37:33.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73ad4e5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73a80d10c0 0x7f73a809f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:33.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73ad4e5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73a815e3c0 0x7f73a80c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:33.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73ad4e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a81601f0 0x7f73a809cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:33.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73ad4e5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a809fff0 con 0x7f73a81601f0 2023-08-25T05:37:33.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73ad4e5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a80c7110 con 0x7f73a815e3c0 2023-08-25T05:37:33.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73ad4e5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a80c9560 con 0x7f73a80d10c0 2023-08-25T05:37:33.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73a77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a81601f0 0x7f73a809cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73a77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a81601f0 0x7f73a809cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58874/0 (socket says 172.21.15.55:58874) 2023-08-25T05:37:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73a77fe640 1 -- 172.21.15.55:0/2098382117 learned_addr learned my addr 172.21.15.55:0/2098382117 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73a6ffd640 1 --2- 172.21.15.55:0/2098382117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73a80d10c0 0x7f73a809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:33.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f739e7fc640 1 --2- 172.21.15.55:0/2098382117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73a815e3c0 0x7f73a80c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:33.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73a77fe640 1 -- 172.21.15.55:0/2098382117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73a80d10c0 msgr2=0x7f73a809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:33.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73a77fe640 1 --2- 172.21.15.55:0/2098382117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73a80d10c0 0x7f73a809f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73a77fe640 1 -- 172.21.15.55:0/2098382117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73a815e3c0 msgr2=0x7f73a80c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:33.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73a77fe640 1 --2- 172.21.15.55:0/2098382117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73a815e3c0 0x7f73a80c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:33.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73a77fe640 1 -- 172.21.15.55:0/2098382117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a00094d0 con 0x7f73a81601f0 2023-08-25T05:37:33.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73a77fe640 1 --2- 172.21.15.55:0/2098382117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a81601f0 0x7f73a809cb70 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f73a001f590 tx=0x7f73a001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:33.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f739ffff640 1 -- 172.21.15.55:0/2098382117 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a00b0d80 con 0x7f73a81601f0 2023-08-25T05:37:33.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f739ffff640 1 -- 172.21.15.55:0/2098382117 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a00b9430 con 0x7f73a81601f0 2023-08-25T05:37:33.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f739ffff640 1 -- 172.21.15.55:0/2098382117 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a00b97e0 con 0x7f73a81601f0 2023-08-25T05:37:33.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73ad4e5640 1 -- 172.21.15.55:0/2098382117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a80ce7c0 con 0x7f73a81601f0 2023-08-25T05:37:33.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.795+0000 7f73ad4e5640 1 -- 172.21.15.55:0/2098382117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a809fa30 con 0x7f73a81601f0 2023-08-25T05:37:33.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.799+0000 7f73ad4e5640 1 -- 172.21.15.55:0/2098382117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a80b5260 con 0x7f73a81601f0 2023-08-25T05:37:33.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.799+0000 7f739ffff640 1 -- 172.21.15.55:0/2098382117 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f73a00b7040 con 0x7f73a81601f0 2023-08-25T05:37:33.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.799+0000 7f739ffff640 1 --2- 172.21.15.55:0/2098382117 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f73880657a0 0x7f7388067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:33.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.799+0000 7f739ffff640 1 -- 172.21.15.55:0/2098382117 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f73a0120a60 con 0x7f73a81601f0 2023-08-25T05:37:33.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.799+0000 7f73a6ffd640 1 --2- 172.21.15.55:0/2098382117 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f73880657a0 0x7f7388067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:33.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.799+0000 7f73a6ffd640 1 --2- 172.21.15.55:0/2098382117 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f73880657a0 0x7f7388067c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f739800aac0 tx=0x7f7398008040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:33.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:33.803+0000 7f739ffff640 1 -- 172.21.15.55:0/2098382117 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f73a00ee4b0 con 0x7f73a81601f0 2023-08-25T05:37:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.015+0000 7f73ad4e5640 1 -- 172.21.15.55:0/2098382117 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f73a80c72a0 con 0x7f73a81601f0 2023-08-25T05:37:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.019+0000 7f739ffff640 1 -- 172.21.15.55:0/2098382117 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v50) v1 ==== 190+0+147 (secure 0 0 0) 0x7f73a00f1ad0 con 0x7f73a81601f0 2023-08-25T05:37:34.021 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2023-08-25T05:37:34.021 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQC3J+hk3owZKRAAudNWEkqEnTCs1SBeIx5G9g== 2023-08-25T05:37:34.021 INFO:teuthology.orchestra.run.smithi055.stdout: caps mds = "allow" 2023-08-25T05:37:34.021 INFO:teuthology.orchestra.run.smithi055.stdout: caps mon = "allow r" 2023-08-25T05:37:34.021 INFO:teuthology.orchestra.run.smithi055.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-25T05:37:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2023-08-25T05:37:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.019+0000 7f73ad4e5640 1 -- 172.21.15.55:0/2098382117 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f73880657a0 msgr2=0x7f7388067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:34.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.019+0000 7f73ad4e5640 1 --2- 172.21.15.55:0/2098382117 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f73880657a0 0x7f7388067c60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f739800aac0 tx=0x7f7398008040 comp rx=0 tx=0).stop 2023-08-25T05:37:34.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.019+0000 7f73ad4e5640 1 -- 172.21.15.55:0/2098382117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a81601f0 msgr2=0x7f73a809cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:34.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.019+0000 7f73ad4e5640 1 --2- 172.21.15.55:0/2098382117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a81601f0 0x7f73a809cb70 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f73a001f590 tx=0x7f73a001ba90 comp rx=0 tx=0).stop 2023-08-25T05:37:34.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.019+0000 7f73ad4e5640 1 -- 172.21.15.55:0/2098382117 shutdown_connections 2023-08-25T05:37:34.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.019+0000 7f73ad4e5640 1 --2- 172.21.15.55:0/2098382117 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f73880657a0 0x7f7388067c60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.019+0000 7f73ad4e5640 1 --2- 172.21.15.55:0/2098382117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a81601f0 0x7f73a809cb70 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.019+0000 7f73ad4e5640 1 --2- 172.21.15.55:0/2098382117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f73a815e3c0 0x7f73a80c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.019+0000 7f73ad4e5640 1 --2- 172.21.15.55:0/2098382117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73a80d10c0 0x7f73a809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.019+0000 7f73ad4e5640 1 -- 172.21.15.55:0/2098382117 >> 172.21.15.55:0/2098382117 conn(0x7f73a80d27d0 msgr2=0x7f73a815cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:34.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.019+0000 7f73ad4e5640 1 -- 172.21.15.55:0/2098382117 shutdown_connections 2023-08-25T05:37:34.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.019+0000 7f73ad4e5640 1 -- 172.21.15.55:0/2098382117 wait complete. 2023-08-25T05:37:34.042 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:37:34.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.183+0000 7f784ffac640 1 Processor -- start 2023-08-25T05:37:34.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.183+0000 7f784ffac640 1 -- start start 2023-08-25T05:37:34.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.183+0000 7f784ffac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f784815ef80 0x7f78480ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:34.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.183+0000 7f784ffac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f78480cece0 0x7f78480ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:34.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.183+0000 7f784ffac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78480ac3a0 con 0x7f784815eba0 2023-08-25T05:37:34.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.183+0000 7f784ffac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78480cf170 con 0x7f78480cece0 2023-08-25T05:37:34.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.183+0000 7f784ffac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78480b3150 con 0x7f784815ef80 2023-08-25T05:37:34.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.183+0000 7f784dd48640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f784815eba0 0x7f78480b2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43930/0 (socket says 172.21.15.55:43930) 2023-08-25T05:37:34.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.183+0000 7f784dd48640 1 -- 172.21.15.55:0/2470629143 learned_addr learned my addr 172.21.15.55:0/2470629143 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:34.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.183+0000 7f784e549640 1 --2- 172.21.15.55:0/2470629143 >> v2:172.21.15.55:3300/0 conn(0x7f78480cece0 0x7f78480ab0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:34.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.187+0000 7f784d547640 1 --2- 172.21.15.55:0/2470629143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f784815ef80 0x7f78480ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:34.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.187+0000 7f784cd46640 1 -- 172.21.15.55:0/2470629143 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601657124 0 0) 0x7f78480ac3a0 con 0x7f784815eba0 2023-08-25T05:37:34.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.187+0000 7f784cd46640 1 -- 172.21.15.55:0/2470629143 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7834003530 con 0x7f784815eba0 2023-08-25T05:37:34.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.187+0000 7f784e549640 1 -- 172.21.15.55:0/2470629143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f784815ef80 msgr2=0x7f78480ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:34.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.187+0000 7f784e549640 1 --2- 172.21.15.55:0/2470629143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f784815ef80 0x7f78480ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.187+0000 7f784e549640 1 -- 172.21.15.55:0/2470629143 >> v1:172.21.15.55:6789/0 conn(0x7f784815eba0 legacy=0x7f78480b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:34.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.187+0000 7f784e549640 1 -- 172.21.15.55:0/2470629143 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78480b1390 con 0x7f78480cece0 2023-08-25T05:37:34.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.187+0000 7f784e549640 1 --2- 172.21.15.55:0/2470629143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78480cece0 0x7f78480ab0f0 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f7840009d90 tx=0x7f784001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3be442db1ff995 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:34.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.187+0000 7f784cd46640 1 -- 172.21.15.55:0/2470629143 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78400a59e0 con 0x7f78480cece0 2023-08-25T05:37:34.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.187+0000 7f784cd46640 1 -- 172.21.15.55:0/2470629143 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78400a5b40 con 0x7f78480cece0 2023-08-25T05:37:34.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.187+0000 7f784cd46640 1 -- 172.21.15.55:0/2470629143 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78400ad440 con 0x7f78480cece0 2023-08-25T05:37:34.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.187+0000 7f784ffac640 1 -- 172.21.15.55:0/2470629143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78480cece0 msgr2=0x7f78480ab0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:34.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.187+0000 7f784ffac640 1 --2- 172.21.15.55:0/2470629143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78480cece0 0x7f78480ab0f0 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f7840009d90 tx=0x7f784001c920 comp rx=0 tx=0).stop 2023-08-25T05:37:34.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784ffac640 1 -- 172.21.15.55:0/2470629143 shutdown_connections 2023-08-25T05:37:34.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784ffac640 1 --2- 172.21.15.55:0/2470629143 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f784815ef80 0x7f78480ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784ffac640 1 --2- 172.21.15.55:0/2470629143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78480cece0 0x7f78480ab0f0 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784ffac640 1 -- 172.21.15.55:0/2470629143 >> 172.21.15.55:0/2470629143 conn(0x7f7848069d00 msgr2=0x7f784806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:34.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784ffac640 1 -- 172.21.15.55:0/2470629143 shutdown_connections 2023-08-25T05:37:34.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784ffac640 1 -- 172.21.15.55:0/2470629143 wait complete. 2023-08-25T05:37:34.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784ffac640 1 Processor -- start 2023-08-25T05:37:34.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784ffac640 1 -- start start 2023-08-25T05:37:34.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784ffac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78480cece0 0x7f7848163770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:34.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784ffac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f784815eba0 0x7f7848157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:34.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784ffac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f784815ef80 0x7f78480ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:34.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784ffac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7848164a80 con 0x7f784815ef80 2023-08-25T05:37:34.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784ffac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78480ad430 con 0x7f78480cece0 2023-08-25T05:37:34.194 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784ffac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7848163e70 con 0x7f784815eba0 2023-08-25T05:37:34.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784e549640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f784815ef80 0x7f78480ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:34.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784e549640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f784815ef80 0x7f78480ade00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58878/0 (socket says 172.21.15.55:58878) 2023-08-25T05:37:34.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784e549640 1 -- 172.21.15.55:0/2335005984 learned_addr learned my addr 172.21.15.55:0/2335005984 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:34.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784dd48640 1 --2- 172.21.15.55:0/2335005984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78480cece0 0x7f7848163770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:34.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784d547640 1 --2- 172.21.15.55:0/2335005984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f784815eba0 0x7f7848157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:34.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784e549640 1 -- 172.21.15.55:0/2335005984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f784815eba0 msgr2=0x7f7848157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:34.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784e549640 1 --2- 172.21.15.55:0/2335005984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f784815eba0 0x7f7848157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784e549640 1 -- 172.21.15.55:0/2335005984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78480cece0 msgr2=0x7f7848163770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:34.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784e549640 1 --2- 172.21.15.55:0/2335005984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78480cece0 0x7f7848163770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784e549640 1 -- 172.21.15.55:0/2335005984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7840009a70 con 0x7f784815ef80 2023-08-25T05:37:34.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784dd48640 1 --2- 172.21.15.55:0/2335005984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78480cece0 0x7f7848163770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:34.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784d547640 1 --2- 172.21.15.55:0/2335005984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f784815eba0 0x7f7848157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:34.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.191+0000 7f784e549640 1 --2- 172.21.15.55:0/2335005984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f784815ef80 0x7f78480ade00 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7f78400b0040 tx=0x7f78400196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:34.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.195+0000 7f783e7fc640 1 -- 172.21.15.55:0/2335005984 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78400adce0 con 0x7f784815ef80 2023-08-25T05:37:34.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.195+0000 7f783e7fc640 1 -- 172.21.15.55:0/2335005984 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78400ade40 con 0x7f784815ef80 2023-08-25T05:37:34.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.195+0000 7f784ffac640 1 -- 172.21.15.55:0/2335005984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7848164150 con 0x7f784815ef80 2023-08-25T05:37:34.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.195+0000 7f783e7fc640 1 -- 172.21.15.55:0/2335005984 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78400b7650 con 0x7f784815ef80 2023-08-25T05:37:34.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.195+0000 7f784ffac640 1 -- 172.21.15.55:0/2335005984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7848164710 con 0x7f784815ef80 2023-08-25T05:37:34.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.195+0000 7f784ffac640 1 -- 172.21.15.55:0/2335005984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784815bd60 con 0x7f784815ef80 2023-08-25T05:37:34.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.195+0000 7f783e7fc640 1 -- 172.21.15.55:0/2335005984 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f78400b4050 con 0x7f784815ef80 2023-08-25T05:37:34.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.195+0000 7f783e7fc640 1 --2- 172.21.15.55:0/2335005984 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f782c0657a0 0x7f782c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:34.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.195+0000 7f783e7fc640 1 -- 172.21.15.55:0/2335005984 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f784011e0b0 con 0x7f784815ef80 2023-08-25T05:37:34.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.195+0000 7f784dd48640 1 --2- 172.21.15.55:0/2335005984 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f782c0657a0 0x7f782c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:34.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.199+0000 7f784dd48640 1 --2- 172.21.15.55:0/2335005984 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f782c0657a0 0x7f782c067c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f78440011f0 tx=0x7f7844009040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:34.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.199+0000 7f783e7fc640 1 -- 172.21.15.55:0/2335005984 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f784815bd60 con 0x7f784815ef80 2023-08-25T05:37:34.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.391+0000 7f784ffac640 1 -- 172.21.15.55:0/2335005984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f784815bd60 con 0x7f784815ef80 2023-08-25T05:37:34.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.391+0000 7f783e7fc640 1 -- 172.21.15.55:0/2335005984 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4891 (secure 0 0 0) 0x7f784815bd60 con 0x7f784815ef80 2023-08-25T05:37:34.393 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:34.393 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":100,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/2330461418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2330461418},{"type":"v1","addr":"172.21.15.110:6836","nonce":2330461418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":9182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3918521245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3918521245},{"type":"v1","addr":"172.21.15.110:6837","nonce":3918521245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":11343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3205982255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3205982255},{"type":"v1","addr":"172.21.15.55:6834","nonce":3205982255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:37:23.923618+0000","modified":"2023-08-25T05:37:27.560216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":11349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11349":{"gid":11349,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3936252180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3936252180},{"type":"v1","addr":"172.21.15.55:6835","nonce":3936252180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-08-25T05:37:34.394 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 100 2023-08-25T05:37:34.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.391+0000 7f784ffac640 1 -- 172.21.15.55:0/2335005984 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f782c0657a0 msgr2=0x7f782c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:34.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.391+0000 7f784ffac640 1 --2- 172.21.15.55:0/2335005984 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f782c0657a0 0x7f782c067c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f78440011f0 tx=0x7f7844009040 comp rx=0 tx=0).stop 2023-08-25T05:37:34.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.391+0000 7f784ffac640 1 -- 172.21.15.55:0/2335005984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f784815ef80 msgr2=0x7f78480ade00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:34.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.391+0000 7f784ffac640 1 --2- 172.21.15.55:0/2335005984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f784815ef80 0x7f78480ade00 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7f78400b0040 tx=0x7f78400196c0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.391+0000 7f784ffac640 1 -- 172.21.15.55:0/2335005984 shutdown_connections 2023-08-25T05:37:34.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.391+0000 7f784ffac640 1 --2- 172.21.15.55:0/2335005984 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f782c0657a0 0x7f782c067c60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.391+0000 7f784ffac640 1 --2- 172.21.15.55:0/2335005984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f784815ef80 0x7f78480ade00 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.391+0000 7f784ffac640 1 --2- 172.21.15.55:0/2335005984 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f784815eba0 0x7f7848157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.391+0000 7f784ffac640 1 --2- 172.21.15.55:0/2335005984 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78480cece0 0x7f7848163770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.391+0000 7f784ffac640 1 -- 172.21.15.55:0/2335005984 >> 172.21.15.55:0/2335005984 conn(0x7f7848069d00 msgr2=0x7f78480b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:34.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.391+0000 7f784ffac640 1 -- 172.21.15.55:0/2335005984 shutdown_connections 2023-08-25T05:37:34.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.391+0000 7f784ffac640 1 -- 172.21.15.55:0/2335005984 wait complete. 2023-08-25T05:37:34.815 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 100, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-25T05:37:23.923618+0000', 'modified': '2023-08-25T05:37:27.560216+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 11349}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_11349': {'gid': 11349, 'name': 'c', 'rank': 0, 'incarnation': 96, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6835/3936252180', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6833', 'nonce': 3936252180}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 3936252180}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-25T05:37:34.816 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-25T05:37:34.817 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-25T05:37:34.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.963+0000 7fc328acb640 1 Processor -- start 2023-08-25T05:37:34.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.963+0000 7fc328acb640 1 -- start start 2023-08-25T05:37:34.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.963+0000 7fc328acb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240ceeb0 0x7fc3240cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:34.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.963+0000 7fc328acb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3240cc880 con 0x7fc3240c89f0 2023-08-25T05:37:34.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.963+0000 7fc328acb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3240ccb60 con 0x7fc3240ad950 2023-08-25T05:37:34.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.963+0000 7fc328acb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3240b11f0 con 0x7fc3240ceeb0 2023-08-25T05:37:34.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.963+0000 7fc322d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc3240c89f0 0x7fc3240b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43944/0 (socket says 172.21.15.55:43944) 2023-08-25T05:37:34.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.963+0000 7fc322d9d640 1 -- 172.21.15.55:0/2834261376 learned_addr learned my addr 172.21.15.55:0/2834261376 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:34.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.963+0000 7fc31bfff640 1 --2- 172.21.15.55:0/2834261376 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240ceeb0 0x7fc3240cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:34.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.967+0000 7fc321d9b640 1 -- 172.21.15.55:0/2834261376 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2604674279 0 0) 0x7fc3240cc880 con 0x7fc3240c89f0 2023-08-25T05:37:34.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.967+0000 7fc321d9b640 1 -- 172.21.15.55:0/2834261376 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc310003530 con 0x7fc3240c89f0 2023-08-25T05:37:34.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.967+0000 7fc321d9b640 1 -- 172.21.15.55:0/2834261376 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407862730 0 0) 0x7fc3240ccb60 con 0x7fc3240ad950 2023-08-25T05:37:34.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.967+0000 7fc321d9b640 1 -- 172.21.15.55:0/2834261376 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3240cc880 con 0x7fc3240ad950 2023-08-25T05:37:34.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.967+0000 7fc31bfff640 1 -- 172.21.15.55:0/2834261376 >> v1:172.21.15.110:6789/0 conn(0x7fc3240ad950 legacy=0x7fc3240ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:34.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.967+0000 7fc31bfff640 1 -- 172.21.15.55:0/2834261376 >> v1:172.21.15.55:6789/0 conn(0x7fc3240c89f0 legacy=0x7fc3240b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:34.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.967+0000 7fc31bfff640 1 -- 172.21.15.55:0/2834261376 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3240cce40 con 0x7fc3240ceeb0 2023-08-25T05:37:34.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.967+0000 7fc31bfff640 1 --2- 172.21.15.55:0/2834261376 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240ceeb0 0x7fc3240cc2a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0097f0 tx=0x7fc30c01c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59276609ee9bfef0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:34.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.967+0000 7fc321d9b640 1 -- 172.21.15.55:0/2834261376 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c0ab600 con 0x7fc3240ceeb0 2023-08-25T05:37:34.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.967+0000 7fc321d9b640 1 -- 172.21.15.55:0/2834261376 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c0a7050 con 0x7fc3240ceeb0 2023-08-25T05:37:34.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.967+0000 7fc321d9b640 1 -- 172.21.15.55:0/2834261376 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c0ab980 con 0x7fc3240ceeb0 2023-08-25T05:37:34.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc328acb640 1 -- 172.21.15.55:0/2834261376 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240ceeb0 msgr2=0x7fc3240cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:34.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc328acb640 1 --2- 172.21.15.55:0/2834261376 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240ceeb0 0x7fc3240cc2a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0097f0 tx=0x7fc30c01c430 comp rx=0 tx=0).stop 2023-08-25T05:37:34.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc328acb640 1 -- 172.21.15.55:0/2834261376 shutdown_connections 2023-08-25T05:37:34.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc328acb640 1 --2- 172.21.15.55:0/2834261376 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240ceeb0 0x7fc3240cc2a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc328acb640 1 -- 172.21.15.55:0/2834261376 >> 172.21.15.55:0/2834261376 conn(0x7fc324069d00 msgr2=0x7fc32406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:34.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc328acb640 1 -- 172.21.15.55:0/2834261376 shutdown_connections 2023-08-25T05:37:34.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc328acb640 1 -- 172.21.15.55:0/2834261376 wait complete. 2023-08-25T05:37:34.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc328acb640 1 Processor -- start 2023-08-25T05:37:34.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc328acb640 1 -- start start 2023-08-25T05:37:34.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc328acb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3240ad950 0x7fc324158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:34.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc328acb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3240c89f0 0x7fc324097ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:34.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc328acb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240ceeb0 0x7fc32415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:34.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc328acb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc324159e60 con 0x7fc3240c89f0 2023-08-25T05:37:34.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc328acb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32415a420 con 0x7fc3240ad950 2023-08-25T05:37:34.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc328acb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc324164450 con 0x7fc3240ceeb0 2023-08-25T05:37:34.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc31bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3240c89f0 0x7fc324097ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:34.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc31bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3240c89f0 0x7fc324097ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58894/0 (socket says 172.21.15.55:58894) 2023-08-25T05:37:34.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc31bfff640 1 -- 172.21.15.55:0/2523286690 learned_addr learned my addr 172.21.15.55:0/2523286690 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:34.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc32259c640 1 --2- 172.21.15.55:0/2523286690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3240ad950 0x7fc324158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:34.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.971+0000 7fc322d9d640 1 --2- 172.21.15.55:0/2523286690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240ceeb0 0x7fc32415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.975+0000 7fc31bfff640 1 -- 172.21.15.55:0/2523286690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240ceeb0 msgr2=0x7fc32415a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.975+0000 7fc31bfff640 1 --2- 172.21.15.55:0/2523286690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240ceeb0 0x7fc32415a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.975+0000 7fc31bfff640 1 -- 172.21.15.55:0/2523286690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3240ad950 msgr2=0x7fc324158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.975+0000 7fc31bfff640 1 --2- 172.21.15.55:0/2523286690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3240ad950 0x7fc324158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.975+0000 7fc31bfff640 1 -- 172.21.15.55:0/2523286690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c009420 con 0x7fc3240c89f0 2023-08-25T05:37:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.975+0000 7fc31bfff640 1 --2- 172.21.15.55:0/2523286690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3240c89f0 0x7fc324097ad0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7fc30c019040 tx=0x7fc30c0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.975+0000 7fc31affd640 1 -- 172.21.15.55:0/2523286690 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c0b4430 con 0x7fc3240c89f0 2023-08-25T05:37:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.975+0000 7fc31affd640 1 -- 172.21.15.55:0/2523286690 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c0b45b0 con 0x7fc3240c89f0 2023-08-25T05:37:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.975+0000 7fc31affd640 1 -- 172.21.15.55:0/2523286690 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c0b4960 con 0x7fc3240c89f0 2023-08-25T05:37:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.975+0000 7fc328acb640 1 -- 172.21.15.55:0/2523286690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc324164730 con 0x7fc3240c89f0 2023-08-25T05:37:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.975+0000 7fc328acb640 1 -- 172.21.15.55:0/2523286690 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32415adf0 con 0x7fc3240c89f0 2023-08-25T05:37:34.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.975+0000 7fc31affd640 1 -- 172.21.15.55:0/2523286690 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fc30c0b2040 con 0x7fc3240c89f0 2023-08-25T05:37:34.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.975+0000 7fc31affd640 1 --2- 172.21.15.55:0/2523286690 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fc3040657a0 0x7fc304067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:34.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.975+0000 7fc31affd640 1 -- 172.21.15.55:0/2523286690 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc30c11ce70 con 0x7fc3240c89f0 2023-08-25T05:37:34.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32259c640 1 --2- 172.21.15.55:0/2523286690 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fc3040657a0 0x7fc304067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:34.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32be34000 1 Processor -- start 2023-08-25T05:37:34.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32be34000 1 -- start start 2023-08-25T05:37:34.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32259c640 1 --2- 172.21.15.55:0/2523286690 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fc3040657a0 0x7fc304067c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3140011f0 tx=0x7fc314009040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:34.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32be34000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e020 0x55b57db3e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:34.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32be34000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57db3e940 0x55b57daf4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:34.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32be34000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 0x55b57daf4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:34.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32be34000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57d94a440 con 0x55b57daf45b0 2023-08-25T05:37:34.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32be34000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57d947970 con 0x55b57db3e020 2023-08-25T05:37:34.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32be34000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b57d943260 con 0x55b57db3e940 2023-08-25T05:37:34.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc322d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 0x55b57daf4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:34.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc322d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 0x55b57daf4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58898/0 (socket says 172.21.15.55:58898) 2023-08-25T05:37:34.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc322d9d640 1 -- 172.21.15.55:0/1567290132 learned_addr learned my addr 172.21.15.55:0/1567290132 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:34.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc31bfff640 1 --2- 172.21.15.55:0/1567290132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57db3e940 0x55b57daf4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:34.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32259c640 1 --2- 172.21.15.55:0/1567290132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e020 0x55b57db3e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:34.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc322d9d640 1 -- 172.21.15.55:0/1567290132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57db3e940 msgr2=0x55b57daf4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:34.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc322d9d640 1 --2- 172.21.15.55:0/1567290132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57db3e940 0x55b57daf4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc322d9d640 1 -- 172.21.15.55:0/1567290132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e020 msgr2=0x55b57db3e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:34.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc322d9d640 1 --2- 172.21.15.55:0/1567290132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e020 0x55b57db3e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc322d9d640 1 -- 172.21.15.55:0/1567290132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b57d9dbec0 con 0x55b57daf45b0 2023-08-25T05:37:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc322d9d640 1 --2- 172.21.15.55:0/1567290132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 0x55b57daf4990 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7fc31c002020 tx=0x7fc31c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8900df200c703753 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc303fff640 1 -- 172.21.15.55:0/1567290132 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c00ee50 con 0x55b57daf45b0 2023-08-25T05:37:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc303fff640 1 -- 172.21.15.55:0/1567290132 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c014480 con 0x55b57daf45b0 2023-08-25T05:37:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc303fff640 1 -- 172.21.15.55:0/1567290132 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0147f0 con 0x55b57daf45b0 2023-08-25T05:37:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32be34000 1 -- 172.21.15.55:0/1567290132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 msgr2=0x55b57daf4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32be34000 1 --2- 172.21.15.55:0/1567290132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 0x55b57daf4990 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7fc31c002020 tx=0x7fc31c00e530 comp rx=0 tx=0).stop 2023-08-25T05:37:34.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32be34000 1 -- 172.21.15.55:0/1567290132 shutdown_connections 2023-08-25T05:37:34.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32be34000 1 --2- 172.21.15.55:0/1567290132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 0x55b57daf4990 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32be34000 1 --2- 172.21.15.55:0/1567290132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57db3e940 0x55b57daf4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32be34000 1 --2- 172.21.15.55:0/1567290132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e020 0x55b57db3e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32be34000 1 -- 172.21.15.55:0/1567290132 >> 172.21.15.55:0/1567290132 conn(0x55b57daf0560 msgr2=0x55b57daf2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:34.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32be34000 1 -- 172.21.15.55:0/1567290132 shutdown_connections 2023-08-25T05:37:34.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.979+0000 7fc32be34000 1 -- 172.21.15.55:0/1567290132 wait complete. 2023-08-25T05:37:34.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32be34000 1 -- start start 2023-08-25T05:37:34.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32be34000 1 Processor -- start 2023-08-25T05:37:34.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32be34000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57daf45b0 0x55b57db45380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:34.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32be34000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57db3e020 0x55b57db458c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:34.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32be34000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e940 0x55b57db2bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:34.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32be34000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57d8fdf60 con 0x55b57db3e020 2023-08-25T05:37:34.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32be34000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57d8fdc00 con 0x55b57db3e940 2023-08-25T05:37:34.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32be34000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b57d5fe940 con 0x55b57daf45b0 2023-08-25T05:37:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32be34000 10 client.0 _ll_register_callbacks cb 0x55b57dadf900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T05:37:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc31bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57db3e020 0x55b57db458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc31bfff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57db3e020 0x55b57db458c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58906/0 (socket says 172.21.15.55:58906) 2023-08-25T05:37:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc31bfff640 1 -- 172.21.15.55:0/3547096479 learned_addr learned my addr 172.21.15.55:0/3547096479 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32259c640 1 --2- 172.21.15.55:0/3547096479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57daf45b0 0x55b57db45380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc322d9d640 1 --2- 172.21.15.55:0/3547096479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e940 0x55b57db2bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:34.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc31bfff640 1 -- 172.21.15.55:0/3547096479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57daf45b0 msgr2=0x55b57db45380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:34.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc31bfff640 1 --2- 172.21.15.55:0/3547096479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57daf45b0 0x55b57db45380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc31bfff640 1 -- 172.21.15.55:0/3547096479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e940 msgr2=0x55b57db2bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc31bfff640 1 --2- 172.21.15.55:0/3547096479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e940 0x55b57db2bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc31bfff640 1 -- 172.21.15.55:0/3547096479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31c00f040 con 0x55b57db3e020 2023-08-25T05:37:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc322d9d640 1 --2- 172.21.15.55:0/3547096479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e940 0x55b57db2bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc31bfff640 1 --2- 172.21.15.55:0/3547096479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57db3e020 0x55b57db458c0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009740 tx=0x7fc30c0eeaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda479117b82c9de server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc3017fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T05:37:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc3017fa640 1 -- 172.21.15.55:0/3547096479 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c0f5db0 con 0x55b57db3e020 2023-08-25T05:37:34.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32be34000 1 -- 172.21.15.55:0/3547096479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b57d8da9d0 con 0x55b57db3e020 2023-08-25T05:37:34.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc3017fa640 1 -- 172.21.15.55:0/3547096479 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc30c11aab0 con 0x55b57db3e020 2023-08-25T05:37:34.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc3017fa640 1 -- 172.21.15.55:0/3547096479 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc30c11ac70 con 0x55b57db3e020 2023-08-25T05:37:34.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32be34000 10 client.11526 fetch_fsmap learned FSMap version 100 2023-08-25T05:37:34.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32be34000 1 -- 172.21.15.55:0/3547096479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) v3 -- 0x55b57d63d890 con 0x55b57db3e020 2023-08-25T05:37:34.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc3017fa640 1 -- 172.21.15.55:0/3547096479 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b57d8da9d0 con 0x55b57db3e020 2023-08-25T05:37:34.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc3017fa640 1 -- 172.21.15.55:0/3547096479 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 100) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc30c0ea120 con 0x55b57db3e020 2023-08-25T05:37:34.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32be34000 10 client.11526 fetch_fsmap finished waiting for FSMap version 100 2023-08-25T05:37:34.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32be34000 10 client.11526 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T05:37:34.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32be34000 20 client.11526 populate_metadata read hostname 'smithi055' 2023-08-25T05:37:34.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32be34000 1 --2- 172.21.15.55:0/3547096479 >> [v2:172.21.15.55:6833/3936252180,v1:172.21.15.55:6835/3936252180] conn(0x55b57db2cb40 0x55b57db2cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:34.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32be34000 4 client.11526 mds_command: new command op to 11349 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-25T05:37:34.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32be34000 1 -- 172.21.15.55:0/3547096479 --> [v2:172.21.15.55:6833/3936252180,v1:172.21.15.55:6835/3936252180] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b57d8fa7a0 con 0x55b57db2cb40 2023-08-25T05:37:34.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.983+0000 7fc32259c640 1 --2- 172.21.15.55:0/3547096479 >> [v2:172.21.15.55:6833/3936252180,v1:172.21.15.55:6835/3936252180] conn(0x55b57db2cb40 0x55b57db2cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:34.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.987+0000 7fc32259c640 1 --2- 172.21.15.55:0/3547096479 >> [v2:172.21.15.55:6833/3936252180,v1:172.21.15.55:6835/3936252180] conn(0x55b57db2cb40 0x55b57db2cf20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6d4ced75f5f2b96 server_cookie=2606e364045a9136 in_seq=0 out_seq=0 2023-08-25T05:37:34.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.987+0000 7fc3017fa640 10 client.11526 ms_handle_connect on v2:172.21.15.55:6833/3936252180 2023-08-25T05:37:34.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.987+0000 7fc3017fa640 1 -- 172.21.15.55:0/3547096479 <== mds.0 v2:172.21.15.55:6833/3936252180 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b57d8fa7a0 con 0x55b57db2cb40 2023-08-25T05:37:34.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.987+0000 7fc3017fa640 10 client.11526 handle_command_reply: tid=0 2023-08-25T05:37:34.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.987+0000 7fc32be34000 1 client.11526 shutdown 2023-08-25T05:37:34.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.987+0000 7fc32be34000 1 -- 172.21.15.55:0/3547096479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57db3e020 msgr2=0x55b57db458c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:34.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.987+0000 7fc32be34000 1 --2- 172.21.15.55:0/3547096479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57db3e020 0x55b57db458c0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009740 tx=0x7fc30c0eeaf0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.987+0000 7fc32be34000 1 -- 172.21.15.55:0/3547096479 shutdown_connections 2023-08-25T05:37:34.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.987+0000 7fc32be34000 1 --2- 172.21.15.55:0/3547096479 >> [v2:172.21.15.55:6833/3936252180,v1:172.21.15.55:6835/3936252180] conn(0x55b57db2cb40 0x55b57db2cf20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.987+0000 7fc32be34000 1 --2- 172.21.15.55:0/3547096479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e940 0x55b57db2bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.987+0000 7fc32be34000 1 --2- 172.21.15.55:0/3547096479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57db3e020 0x55b57db458c0 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.987+0000 7fc3017fa640 0 client.11526 ms_handle_reset on v2:172.21.15.55:6833/3936252180 2023-08-25T05:37:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.987+0000 7fc32be34000 1 --2- 172.21.15.55:0/3547096479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57daf45b0 0x55b57db45380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.987+0000 7fc32be34000 1 -- 172.21.15.55:0/3547096479 >> 172.21.15.55:0/3547096479 conn(0x55b57daf0560 msgr2=0x55b57daf31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.987+0000 7fc32be34000 1 -- 172.21.15.55:0/3547096479 shutdown_connections 2023-08-25T05:37:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.987+0000 7fc32be34000 1 -- 172.21.15.55:0/3547096479 wait complete. 2023-08-25T05:37:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:34.987+0000 7fc32be34000 20 client.11526 trim_cache size 0 max 16384 2023-08-25T05:37:35.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32be34000 1 Processor -- start 2023-08-25T05:37:35.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32be34000 1 -- start start 2023-08-25T05:37:35.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32be34000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 0x55b57daf2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:35.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32be34000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57db3e020 0x55b57daf2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:35.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32be34000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e940 0x55b57db40d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:35.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32be34000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57db54970 con 0x55b57daf45b0 2023-08-25T05:37:35.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32be34000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57daf7370 con 0x55b57db3e940 2023-08-25T05:37:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32be34000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b57d90ae80 con 0x55b57db3e020 2023-08-25T05:37:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 0x55b57daf2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 0x55b57daf2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58910/0 (socket says 172.21.15.55:58910) 2023-08-25T05:37:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32259c640 1 -- 172.21.15.55:0/1298898934 learned_addr learned my addr 172.21.15.55:0/1298898934 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32259c640 1 -- 172.21.15.55:0/1298898934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57db3e020 msgr2=0x55b57daf2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32259c640 1 --2- 172.21.15.55:0/1298898934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57db3e020 0x55b57daf2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32259c640 1 -- 172.21.15.55:0/1298898934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e940 msgr2=0x55b57db40d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:35.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32259c640 1 --2- 172.21.15.55:0/1298898934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e940 0x55b57db40d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32259c640 1 -- 172.21.15.55:0/1298898934 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b57d906190 con 0x55b57daf45b0 2023-08-25T05:37:35.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32259c640 1 --2- 172.21.15.55:0/1298898934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 0x55b57daf2950 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x55b57d9497e0 tx=0x7fc314012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231a26f2077dbf42 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:35.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc318ff9640 1 -- 172.21.15.55:0/1298898934 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314028070 con 0x55b57daf45b0 2023-08-25T05:37:35.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc318ff9640 1 -- 172.21.15.55:0/1298898934 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc314029d70 con 0x55b57daf45b0 2023-08-25T05:37:35.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc318ff9640 1 -- 172.21.15.55:0/1298898934 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314029250 con 0x55b57daf45b0 2023-08-25T05:37:35.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32be34000 1 -- 172.21.15.55:0/1298898934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 msgr2=0x55b57daf2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:35.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32be34000 1 --2- 172.21.15.55:0/1298898934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 0x55b57daf2950 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x55b57d9497e0 tx=0x7fc314012000 comp rx=0 tx=0).stop 2023-08-25T05:37:35.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32be34000 1 -- 172.21.15.55:0/1298898934 shutdown_connections 2023-08-25T05:37:35.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32be34000 1 --2- 172.21.15.55:0/1298898934 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e940 0x55b57db40d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32be34000 1 --2- 172.21.15.55:0/1298898934 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57db3e020 0x55b57daf2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32be34000 1 --2- 172.21.15.55:0/1298898934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 0x55b57daf2950 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32be34000 1 -- 172.21.15.55:0/1298898934 >> 172.21.15.55:0/1298898934 conn(0x55b57daf0560 msgr2=0x55b57daf94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:35.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32be34000 1 -- 172.21.15.55:0/1298898934 shutdown_connections 2023-08-25T05:37:35.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32be34000 1 -- 172.21.15.55:0/1298898934 wait complete. 2023-08-25T05:37:35.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.003+0000 7fc32be34000 1 -- start start 2023-08-25T05:37:35.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32be34000 1 Processor -- start 2023-08-25T05:37:35.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32be34000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 0x55b57db9cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:35.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32be34000 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e020 0x55b57db9d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:35.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32be34000 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57db3e940 0x55b57db43000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:35.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32be34000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57d984f90 con 0x55b57daf45b0 2023-08-25T05:37:35.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32be34000 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b57daf6bd0 con 0x55b57db3e020 2023-08-25T05:37:35.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32be34000 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b57daeff00 con 0x55b57db3e940 2023-08-25T05:37:35.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32be34000 10 client.0 _ll_register_callbacks cb 0x7fc31c001a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-25T05:37:35.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 0x55b57db9cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:35.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 0x55b57db9cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58912/0 (socket says 172.21.15.55:58912) 2023-08-25T05:37:35.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32259c640 1 -- 172.21.15.55:0/455688855 learned_addr learned my addr 172.21.15.55:0/455688855 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc31bfff640 1 --2- 172.21.15.55:0/455688855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e020 0x55b57db9d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc322d9d640 1 --2- 172.21.15.55:0/455688855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57db3e940 0x55b57db43000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32259c640 1 -- 172.21.15.55:0/455688855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57db3e940 msgr2=0x55b57db43000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32259c640 1 --2- 172.21.15.55:0/455688855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57db3e940 0x55b57db43000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32259c640 1 -- 172.21.15.55:0/455688855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e020 msgr2=0x55b57db9d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32259c640 1 --2- 172.21.15.55:0/455688855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e020 0x55b57db9d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32259c640 1 -- 172.21.15.55:0/455688855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3240cc880 con 0x55b57daf45b0 2023-08-25T05:37:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32259c640 1 --2- 172.21.15.55:0/455688855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 0x55b57db9cde0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7fc31402d040 tx=0x7fc314001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508491ca1ceddb94 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:35.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc3017fa640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2023-08-25T05:37:35.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc3017fa640 1 -- 172.21.15.55:0/455688855 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314014860 con 0x55b57daf45b0 2023-08-25T05:37:35.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32be34000 1 -- 172.21.15.55:0/455688855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b57db54ab0 con 0x55b57daf45b0 2023-08-25T05:37:35.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc3017fa640 1 -- 172.21.15.55:0/455688855 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc31401c040 con 0x55b57daf45b0 2023-08-25T05:37:35.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc3017fa640 1 -- 172.21.15.55:0/455688855 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc314029540 con 0x55b57daf45b0 2023-08-25T05:37:35.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32be34000 10 client.11532 fetch_fsmap learned FSMap version 100 2023-08-25T05:37:35.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32be34000 1 -- 172.21.15.55:0/455688855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) v3 -- 0x55b57d8ec420 con 0x55b57daf45b0 2023-08-25T05:37:35.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc3017fa640 1 -- 172.21.15.55:0/455688855 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b57db54ab0 con 0x55b57daf45b0 2023-08-25T05:37:35.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc3017fa640 1 -- 172.21.15.55:0/455688855 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 100) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc314012070 con 0x55b57daf45b0 2023-08-25T05:37:35.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32be34000 10 client.11532 fetch_fsmap finished waiting for FSMap version 100 2023-08-25T05:37:35.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32be34000 10 client.11532 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-25T05:37:35.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32be34000 20 client.11532 populate_metadata read hostname 'smithi055' 2023-08-25T05:37:35.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32be34000 1 --2- 172.21.15.55:0/455688855 >> [v2:172.21.15.55:6833/3936252180,v1:172.21.15.55:6835/3936252180] conn(0x55b57dba3cb0 0x55b57dba60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:35.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32be34000 4 client.11532 mds_command: new command op to 11349 tid=0[{"prefix": "status"}] 2023-08-25T05:37:35.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc32be34000 1 -- 172.21.15.55:0/455688855 --> [v2:172.21.15.55:6833/3936252180,v1:172.21.15.55:6835/3936252180] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b57d8fe880 con 0x55b57dba3cb0 2023-08-25T05:37:35.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.007+0000 7fc31bfff640 1 --2- 172.21.15.55:0/455688855 >> [v2:172.21.15.55:6833/3936252180,v1:172.21.15.55:6835/3936252180] conn(0x55b57dba3cb0 0x55b57dba60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:35.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc31bfff640 1 --2- 172.21.15.55:0/455688855 >> [v2:172.21.15.55:6833/3936252180,v1:172.21.15.55:6835/3936252180] conn(0x55b57dba3cb0 0x55b57dba60a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9afbfad3be64e60 server_cookie=268d585a79128481 in_seq=0 out_seq=0 2023-08-25T05:37:35.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc3017fa640 10 client.11532 ms_handle_connect on v2:172.21.15.55:6833/3936252180 2023-08-25T05:37:35.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc3017fa640 1 -- 172.21.15.55:0/455688855 <== mds.0 v2:172.21.15.55:6833/3936252180 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+329 (crc 0 0 0) 0x55b57d8fe880 con 0x55b57dba3cb0 2023-08-25T05:37:35.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc3017fa640 10 client.11532 handle_command_reply: tid=0 2023-08-25T05:37:35.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc32be34000 1 client.11532 shutdown 2023-08-25T05:37:35.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc32be34000 1 -- 172.21.15.55:0/455688855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 msgr2=0x55b57db9cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:35.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc32be34000 1 --2- 172.21.15.55:0/455688855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 0x55b57db9cde0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7fc31402d040 tx=0x7fc314001160 comp rx=0 tx=0).stop 2023-08-25T05:37:35.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc32be34000 1 -- 172.21.15.55:0/455688855 shutdown_connections 2023-08-25T05:37:35.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc32be34000 1 --2- 172.21.15.55:0/455688855 >> [v2:172.21.15.55:6833/3936252180,v1:172.21.15.55:6835/3936252180] conn(0x55b57dba3cb0 0x55b57dba60a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc32be34000 1 --2- 172.21.15.55:0/455688855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55b57db3e940 0x55b57db43000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc32be34000 1 --2- 172.21.15.55:0/455688855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55b57db3e020 0x55b57db9d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc3017fa640 0 client.11532 ms_handle_reset on v2:172.21.15.55:6833/3936252180 2023-08-25T05:37:35.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc32be34000 1 --2- 172.21.15.55:0/455688855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b57daf45b0 0x55b57db9cde0 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc32be34000 1 -- 172.21.15.55:0/455688855 >> 172.21.15.55:0/455688855 conn(0x55b57daf0560 msgr2=0x55b57db2af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:35.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc32be34000 1 -- 172.21.15.55:0/455688855 shutdown_connections 2023-08-25T05:37:35.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc32be34000 1 -- 172.21.15.55:0/455688855 wait complete. 2023-08-25T05:37:35.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc32be34000 20 client.11532 trim_cache size 0 max 16384 2023-08-25T05:37:35.019 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T05:37:35.019 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "2d2a9024-b152-4d40-880c-1686d1810590", 2023-08-25T05:37:35.019 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2023-08-25T05:37:35.020 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 11349, 2023-08-25T05:37:35.020 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2023-08-25T05:37:35.020 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2023-08-25T05:37:35.020 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2023-08-25T05:37:35.020 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.468462089000001, 2023-08-25T05:37:35.020 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 100, 2023-08-25T05:37:35.020 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 202, 2023-08-25T05:37:35.021 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 202, 2023-08-25T05:37:35.021 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 16.330401833 2023-08-25T05:37:35.021 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T05:37:35.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc328acb640 1 -- 172.21.15.55:0/2523286690 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fc3040657a0 msgr2=0x7fc304067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:35.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc328acb640 1 --2- 172.21.15.55:0/2523286690 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fc3040657a0 0x7fc304067c60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3140011f0 tx=0x7fc314009040 comp rx=0 tx=0).stop 2023-08-25T05:37:35.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc328acb640 1 -- 172.21.15.55:0/2523286690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3240c89f0 msgr2=0x7fc324097ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:35.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc328acb640 1 --2- 172.21.15.55:0/2523286690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3240c89f0 0x7fc324097ad0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7fc30c019040 tx=0x7fc30c0191d0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc328acb640 1 -- 172.21.15.55:0/2523286690 shutdown_connections 2023-08-25T05:37:35.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc328acb640 1 --2- 172.21.15.55:0/2523286690 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fc3040657a0 0x7fc304067c60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc328acb640 1 --2- 172.21.15.55:0/2523286690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240ceeb0 0x7fc32415a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc328acb640 1 --2- 172.21.15.55:0/2523286690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3240c89f0 0x7fc324097ad0 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc328acb640 1 --2- 172.21.15.55:0/2523286690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3240ad950 0x7fc324158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc328acb640 1 -- 172.21.15.55:0/2523286690 >> 172.21.15.55:0/2523286690 conn(0x7fc324069d00 msgr2=0x7fc3240b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:35.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc328acb640 1 -- 172.21.15.55:0/2523286690 shutdown_connections 2023-08-25T05:37:35.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.011+0000 7fc328acb640 1 -- 172.21.15.55:0/2523286690 wait complete. 2023-08-25T05:37:35.031 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-25T05:37:35.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd9ecb640 1 Processor -- start 2023-08-25T05:37:35.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd9ecb640 1 -- start start 2023-08-25T05:37:35.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd9ecb640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0fd40cdde0 0x7f0fd40ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:35.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd9ecb640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd40b29b0 con 0x7f0fd40d0da0 2023-08-25T05:37:35.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd9ecb640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd40b1dc0 con 0x7f0fd40b2e40 2023-08-25T05:37:35.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd9ecb640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd40ce760 con 0x7f0fd40cdde0 2023-08-25T05:37:35.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd37fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0fd40d0da0 0x7f0fd40d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43948/0 (socket says 172.21.15.55:43948) 2023-08-25T05:37:35.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd37fe640 1 -- 172.21.15.55:0/2216348619 learned_addr learned my addr 172.21.15.55:0/2216348619 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:35.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd2ffd640 1 --2- 172.21.15.55:0/2216348619 >> v2:172.21.15.110:3300/0 conn(0x7f0fd40cdde0 0x7f0fd40ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:35.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd27fc640 1 -- 172.21.15.55:0/2216348619 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500377747 0 0) 0x7f0fd40b29b0 con 0x7f0fd40d0da0 2023-08-25T05:37:35.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd27fc640 1 -- 172.21.15.55:0/2216348619 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fbc003530 con 0x7f0fd40d0da0 2023-08-25T05:37:35.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd27fc640 1 -- 172.21.15.55:0/2216348619 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2460030170 0 0) 0x7f0fbc003530 con 0x7f0fd40d0da0 2023-08-25T05:37:35.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd27fc640 1 -- 172.21.15.55:0/2216348619 >> v2:172.21.15.110:3300/0 conn(0x7f0fd40cdde0 msgr2=0x7f0fd40ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:35.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd27fc640 1 --2- 172.21.15.55:0/2216348619 >> v2:172.21.15.110:3300/0 conn(0x7f0fd40cdde0 0x7f0fd40ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd27fc640 1 -- 172.21.15.55:0/2216348619 >> v1:172.21.15.110:6789/0 conn(0x7f0fd40b2e40 legacy=0x7f0fd40b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:35.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd27fc640 1 -- 172.21.15.55:0/2216348619 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd40b2080 con 0x7f0fd40d0da0 2023-08-25T05:37:35.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd27fc640 1 -- 172.21.15.55:0/2216348619 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f0fc4001800 con 0x7f0fd40d0da0 2023-08-25T05:37:35.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd27fc640 1 -- 172.21.15.55:0/2216348619 >> v1:172.21.15.55:6789/0 conn(0x7f0fd40d0da0 legacy=0x7f0fd40d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:35.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd27fc640 1 --2- 172.21.15.55:0/2216348619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fbc003980 0x7f0fbc003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:35.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd27fc640 1 --2- 172.21.15.55:0/2216348619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fbc004380 0x7f0fbc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:35.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd27fc640 1 --2- 172.21.15.55:0/2216348619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fbc005050 0x7f0fbc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:35.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd27fc640 1 -- 172.21.15.55:0/2216348619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40ce760 con 0x7f0fbc003980 2023-08-25T05:37:35.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd27fc640 1 -- 172.21.15.55:0/2216348619 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc00bf00 con 0x7f0fbc004380 2023-08-25T05:37:35.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.175+0000 7f0fd27fc640 1 -- 172.21.15.55:0/2216348619 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc00c0c0 con 0x7f0fbc005050 2023-08-25T05:37:35.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.179+0000 7f0fd37fe640 1 --2- 172.21.15.55:0/2216348619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fbc003980 0x7f0fbc003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:35.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.179+0000 7f0fd2ffd640 1 --2- 172.21.15.55:0/2216348619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fbc004380 0x7f0fbc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:35.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.179+0000 7f0fd3fff640 1 --2- 172.21.15.55:0/2216348619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fbc005050 0x7f0fbc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:35.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.179+0000 7f0fd37fe640 1 -- 172.21.15.55:0/2216348619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fbc005050 msgr2=0x7f0fbc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:35.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.179+0000 7f0fd37fe640 1 --2- 172.21.15.55:0/2216348619 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fbc005050 0x7f0fbc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.179+0000 7f0fd37fe640 1 -- 172.21.15.55:0/2216348619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fbc004380 msgr2=0x7f0fbc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:35.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.179+0000 7f0fd37fe640 1 --2- 172.21.15.55:0/2216348619 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fbc004380 0x7f0fbc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.179+0000 7f0fd37fe640 1 -- 172.21.15.55:0/2216348619 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc003530 con 0x7f0fbc003980 2023-08-25T05:37:35.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.179+0000 7f0fd3fff640 1 -- 172.21.15.55:0/2216348619 reap_dead start 2023-08-25T05:37:35.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.179+0000 7f0fd37fe640 1 --2- 172.21.15.55:0/2216348619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fbc003980 0x7f0fbc003d60 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400c1c0 tx=0x7f0fc401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141cfdaea631f639 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:35.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.179+0000 7f0fd27fc640 1 -- 172.21.15.55:0/2216348619 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40a5b40 con 0x7f0fbc003980 2023-08-25T05:37:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.179+0000 7f0fd27fc640 1 -- 172.21.15.55:0/2216348619 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc40a5ca0 con 0x7f0fbc003980 2023-08-25T05:37:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.179+0000 7f0fd27fc640 1 -- 172.21.15.55:0/2216348619 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40072b0 con 0x7f0fbc003980 2023-08-25T05:37:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd9ecb640 1 -- 172.21.15.55:0/2216348619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fbc003980 msgr2=0x7f0fbc003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd9ecb640 1 --2- 172.21.15.55:0/2216348619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fbc003980 0x7f0fbc003d60 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400c1c0 tx=0x7f0fc401cc40 comp rx=0 tx=0).stop 2023-08-25T05:37:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd9ecb640 1 -- 172.21.15.55:0/2216348619 shutdown_connections 2023-08-25T05:37:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd9ecb640 1 --2- 172.21.15.55:0/2216348619 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fbc003980 0x7f0fbc003d60 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd9ecb640 1 -- 172.21.15.55:0/2216348619 >> 172.21.15.55:0/2216348619 conn(0x7f0fd409bae0 msgr2=0x7f0fd40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:35.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd9ecb640 1 -- 172.21.15.55:0/2216348619 shutdown_connections 2023-08-25T05:37:35.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd9ecb640 1 -- 172.21.15.55:0/2216348619 wait complete. 2023-08-25T05:37:35.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd9ecb640 1 Processor -- start 2023-08-25T05:37:35.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd9ecb640 1 -- start start 2023-08-25T05:37:35.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd9ecb640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fbc003980 0x7f0fd41574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:35.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd9ecb640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fd41f1d80 0x7f0fd40c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:35.187 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd9ecb640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fd40ca100 0x7f0fd40ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:35.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd9ecb640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd414b6e0 con 0x7f0fbc003980 2023-08-25T05:37:35.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd9ecb640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd41f2200 con 0x7f0fd40ca100 2023-08-25T05:37:35.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd9ecb640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd4157ab0 con 0x7f0fd41f1d80 2023-08-25T05:37:35.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fbc003980 0x7f0fd41574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:35.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fbc003980 0x7f0fd41574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58934/0 (socket says 172.21.15.55:58934) 2023-08-25T05:37:35.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd37fe640 1 -- 172.21.15.55:0/95248210 learned_addr learned my addr 172.21.15.55:0/95248210 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:35.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd2ffd640 1 --2- 172.21.15.55:0/95248210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fd41f1d80 0x7f0fd40c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:35.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd3fff640 1 --2- 172.21.15.55:0/95248210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fd40ca100 0x7f0fd40ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:35.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd37fe640 1 -- 172.21.15.55:0/95248210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fd41f1d80 msgr2=0x7f0fd40c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:35.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd37fe640 1 --2- 172.21.15.55:0/95248210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fd41f1d80 0x7f0fd40c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd37fe640 1 -- 172.21.15.55:0/95248210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fd40ca100 msgr2=0x7f0fd40ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:35.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd37fe640 1 --2- 172.21.15.55:0/95248210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fd40ca100 0x7f0fd40ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.183+0000 7f0fd37fe640 1 -- 172.21.15.55:0/95248210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd414f7e0 con 0x7f0fbc003980 2023-08-25T05:37:35.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.187+0000 7f0fd37fe640 1 --2- 172.21.15.55:0/95248210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fbc003980 0x7f0fd41574d0 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f0fc401ca70 tx=0x7f0fbc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:35.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.187+0000 7f0fbbfff640 1 -- 172.21.15.55:0/95248210 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40b3070 con 0x7f0fbc003980 2023-08-25T05:37:35.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.187+0000 7f0fbbfff640 1 -- 172.21.15.55:0/95248210 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc40aed10 con 0x7f0fbc003980 2023-08-25T05:37:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.187+0000 7f0fbbfff640 1 -- 172.21.15.55:0/95248210 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40aee80 con 0x7f0fbc003980 2023-08-25T05:37:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.187+0000 7f0fd9ecb640 1 -- 172.21.15.55:0/95248210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd414fac0 con 0x7f0fbc003980 2023-08-25T05:37:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.187+0000 7f0fd9ecb640 1 -- 172.21.15.55:0/95248210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd4150080 con 0x7f0fbc003980 2023-08-25T05:37:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.187+0000 7f0fd9ecb640 1 -- 172.21.15.55:0/95248210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd40b2620 con 0x7f0fbc003980 2023-08-25T05:37:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.187+0000 7f0fbbfff640 1 -- 172.21.15.55:0/95248210 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f0fc40015c0 con 0x7f0fbc003980 2023-08-25T05:37:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.187+0000 7f0fbbfff640 1 --2- 172.21.15.55:0/95248210 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f0fc00657a0 0x7f0fc0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:35.191 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.187+0000 7f0fbbfff640 1 -- 172.21.15.55:0/95248210 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0fc411c970 con 0x7f0fbc003980 2023-08-25T05:37:35.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.187+0000 7f0fd2ffd640 1 --2- 172.21.15.55:0/95248210 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f0fc00657a0 0x7f0fc0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:35.192 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.191+0000 7f0fd2ffd640 1 --2- 172.21.15.55:0/95248210 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f0fc00657a0 0x7f0fc0067c60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4159500 tx=0x7f0fc8009190 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:35.195 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.195+0000 7f0fbbfff640 1 -- 172.21.15.55:0/95248210 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0fd40b2620 con 0x7f0fbc003980 2023-08-25T05:37:35.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.387+0000 7f0fd9ecb640 1 -- 172.21.15.55:0/95248210 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0fd40b2620 con 0x7f0fbc003980 2023-08-25T05:37:35.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.387+0000 7f0fbbfff640 1 -- 172.21.15.55:0/95248210 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v100) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0fd40b2620 con 0x7f0fbc003980 2023-08-25T05:37:35.388 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-25T05:37:35.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.387+0000 7f0fd9ecb640 1 -- 172.21.15.55:0/95248210 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f0fc00657a0 msgr2=0x7f0fc0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:35.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.387+0000 7f0fd9ecb640 1 --2- 172.21.15.55:0/95248210 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f0fc00657a0 0x7f0fc0067c60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4159500 tx=0x7f0fc8009190 comp rx=0 tx=0).stop 2023-08-25T05:37:35.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.387+0000 7f0fd9ecb640 1 -- 172.21.15.55:0/95248210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fbc003980 msgr2=0x7f0fd41574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:35.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.387+0000 7f0fd9ecb640 1 --2- 172.21.15.55:0/95248210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fbc003980 0x7f0fd41574d0 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f0fc401ca70 tx=0x7f0fbc005800 comp rx=0 tx=0).stop 2023-08-25T05:37:35.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.387+0000 7f0fd9ecb640 1 -- 172.21.15.55:0/95248210 shutdown_connections 2023-08-25T05:37:35.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.387+0000 7f0fd9ecb640 1 --2- 172.21.15.55:0/95248210 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f0fc00657a0 0x7f0fc0067c60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.387+0000 7f0fd9ecb640 1 --2- 172.21.15.55:0/95248210 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fd40ca100 0x7f0fd40ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.387+0000 7f0fd9ecb640 1 --2- 172.21.15.55:0/95248210 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fd41f1d80 0x7f0fd40c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.387+0000 7f0fd9ecb640 1 --2- 172.21.15.55:0/95248210 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0fbc003980 0x7f0fd41574d0 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:35.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.387+0000 7f0fd9ecb640 1 -- 172.21.15.55:0/95248210 >> 172.21.15.55:0/95248210 conn(0x7f0fd409bae0 msgr2=0x7f0fd40cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:35.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.387+0000 7f0fd9ecb640 1 -- 172.21.15.55:0/95248210 shutdown_connections 2023-08-25T05:37:35.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:35.387+0000 7f0fd9ecb640 1 -- 172.21.15.55:0/95248210 wait complete. 2023-08-25T05:37:35.409 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-25T05:37:35.409 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-25T05:37:35.410 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2023-08-25T05:37:35.410 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-25T05:37:35.410 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-25T05:37:35.410 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-25T05:37:35.411 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-25T05:37:35.411 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-25T05:37:35.411 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T05:37:35.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:35.412 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2023-08-25T05:37:35.421 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-25T05:37:35.421 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-25T05:37:35.422 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2023-08-25T05:37:35.422 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:37:35.422 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2023-08-25T05:37:35.422 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:37:35.422 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T05:37:35.422 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2023-08-25T05:37:35.422 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2023-08-25T05:37:35.423 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T05:37:35.423 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2023-08-25T05:37:35.423 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2023-08-25T05:37:35.423 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-25T05:37:35.423 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2023-08-25T05:37:35.423 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2023-08-25T05:37:35.423 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-08-25T05:37:35.424 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 36733sec preferred_lft 36733sec 2023-08-25T05:37:35.424 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2023-08-25T05:37:35.424 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:37:35.424 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-25T05:37:35.424 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2023-08-25T05:37:35.424 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2023-08-25T05:37:35.424 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-25T05:37:35.424 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:98:6a:38:6a brd ff:ff:ff:ff:ff:ff 2023-08-25T05:37:35.425 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-25T05:37:35.425 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:37:35.425 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-25T05:37:35.425 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-08-25T05:37:35.425 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-25T05:37:35.425 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:37:35.425 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-08-25T05:37:35.425 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:37:35.426 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T05:37:35.426 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T05:37:35.426 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-08-25T05:37:35.426 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:37:35.426 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-25T05:37:35.426 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-25T05:37:35.426 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-08-25T05:37:35.427 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2023-08-25T05:37:35.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:35.428 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-25T05:37:35.494 INFO:teuthology.orchestra.run.smithi055.stdout:1 2023-08-25T05:37:35.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:35.496 DEBUG:teuthology.orchestra.run.smithi055:> route 2023-08-25T05:37:35.548 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2023-08-25T05:37:35.548 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-25T05:37:35.548 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-08-25T05:37:35.549 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-25T05:37:35.549 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-08-25T05:37:35.549 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-25T05:37:35.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:35.550 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2023-08-25T05:37:35.550 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2023-08-25T05:37:35.550 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-08-25T05:37:35.550 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-08-25T05:37:35.551 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-08-25T05:37:35.551 DEBUG:teuthology.orchestra.run.smithi055:> ') 2023-08-25T05:37:35.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:35.648 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-08-25T05:37:35.657 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-25T05:37:35.658 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-25T05:37:35.658 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-25T05:37:35.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:35.659 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2023-08-25T05:37:35.719 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T05:37:35.720 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-25T05:37:35.771 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-25T05:37:35.771 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-25T05:37:35.771 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-25T05:37:35.826 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-25T05:37:35.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:35.827 DEBUG:teuthology.orchestra.run.smithi055:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T05:37:35.923 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T05:37:35.924 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T05:37:35.936 INFO:teuthology.orchestra.run.smithi055.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-25T05:37:35.937 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-25T05:37:35.937 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: resolved to: "172.21.15.55:3300,172.21.15.110:3300,172.21.15.110:3301" 2023-08-25T05:37:35.937 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: trying mount with new device syntax: 0@2d2a9024-b152-4d40-880c-1686d1810590.cephfs=/ 2023-08-25T05:37:35.937 INFO:teuthology.orchestra.run.smithi055.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.55:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2023-08-25T05:37:35.940 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-25T05:37:35.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:35.941 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-25T05:37:35.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:35.963 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-25T05:37:36.024 INFO:teuthology.orchestra.run.smithi055.stdout:client10702 2023-08-25T05:37:36.025 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:37:36.025 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:36.075 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-08-25T05:37:36.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.259+0000 7f9d18d8f640 1 Processor -- start 2023-08-25T05:37:36.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.259+0000 7f9d18d8f640 1 -- start start 2023-08-25T05:37:36.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.259+0000 7f9d18d8f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9d140d0da0 0x7f9d140d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:36.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.259+0000 7f9d18d8f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d140b3e50 0x7f9d140ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:36.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.259+0000 7f9d18d8f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d140b29b0 con 0x7f9d140cdde0 2023-08-25T05:37:36.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.259+0000 7f9d18d8f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d140ce760 con 0x7f9d140d0da0 2023-08-25T05:37:36.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.259+0000 7f9d18d8f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140d16c0 con 0x7f9d140b3e50 2023-08-25T05:37:36.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.263+0000 7f9d1259c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9d140d0da0 0x7f9d140d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:36.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.263+0000 7f9d12d9d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d140b3e50 0x7f9d140ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:36.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.263+0000 7f9d1259c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9d140d0da0 0x7f9d140d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:38550/0 (socket says 172.21.15.55:38550) 2023-08-25T05:37:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.263+0000 7f9d1259c640 1 -- 172.21.15.55:0/2081820776 learned_addr learned my addr 172.21.15.55:0/2081820776 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.263+0000 7f9d1259c640 1 -- 172.21.15.55:0/2081820776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d140b3e50 msgr2=0x7f9d140ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.263+0000 7f9d1259c640 1 --2- 172.21.15.55:0/2081820776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d140b3e50 0x7f9d140ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.263+0000 7f9d1259c640 1 -- 172.21.15.55:0/2081820776 >> v1:172.21.15.110:6789/0 conn(0x7f9d140cdde0 legacy=0x7f9d140cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.263+0000 7f9d1259c640 1 -- 172.21.15.55:0/2081820776 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d140b1dc0 con 0x7f9d140d0da0 2023-08-25T05:37:36.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.263+0000 7f9d12d9d640 1 --2- 172.21.15.55:0/2081820776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d140b3e50 0x7f9d140ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:36.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.263+0000 7f9d1259c640 1 --2- 172.21.15.55:0/2081820776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d140d0da0 0x7f9d140d1180 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f9d04006fd0 tx=0x7f9d0401ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22ec471e80b1d170 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:36.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.263+0000 7f9d11d9b640 1 -- 172.21.15.55:0/2081820776 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d040a8a10 con 0x7f9d140d0da0 2023-08-25T05:37:36.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.267+0000 7f9d11d9b640 1 -- 172.21.15.55:0/2081820776 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d040a8b70 con 0x7f9d140d0da0 2023-08-25T05:37:36.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.267+0000 7f9d11d9b640 1 -- 172.21.15.55:0/2081820776 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d040b0440 con 0x7f9d140d0da0 2023-08-25T05:37:36.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.267+0000 7f9d18d8f640 1 -- 172.21.15.55:0/2081820776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d140d0da0 msgr2=0x7f9d140d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:36.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.267+0000 7f9d18d8f640 1 --2- 172.21.15.55:0/2081820776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d140d0da0 0x7f9d140d1180 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f9d04006fd0 tx=0x7f9d0401ed10 comp rx=0 tx=0).stop 2023-08-25T05:37:36.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.267+0000 7f9d18d8f640 1 -- 172.21.15.55:0/2081820776 shutdown_connections 2023-08-25T05:37:36.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.267+0000 7f9d18d8f640 1 --2- 172.21.15.55:0/2081820776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d140b3e50 0x7f9d140ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:36.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.267+0000 7f9d18d8f640 1 --2- 172.21.15.55:0/2081820776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d140d0da0 0x7f9d140d1180 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:36.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.267+0000 7f9d18d8f640 1 -- 172.21.15.55:0/2081820776 >> 172.21.15.55:0/2081820776 conn(0x7f9d1409bae0 msgr2=0x7f9d140d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:36.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.267+0000 7f9d18d8f640 1 -- 172.21.15.55:0/2081820776 shutdown_connections 2023-08-25T05:37:36.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.267+0000 7f9d18d8f640 1 -- 172.21.15.55:0/2081820776 wait complete. 2023-08-25T05:37:36.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.267+0000 7f9d18d8f640 1 Processor -- start 2023-08-25T05:37:36.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.267+0000 7f9d18d8f640 1 -- start start 2023-08-25T05:37:36.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d18d8f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d140b3e50 0x7f9d140c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:36.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d18d8f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d140cdde0 0x7f9d140b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:36.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d18d8f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d140d0da0 0x7f9d140b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d18d8f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140cae50 con 0x7f9d140b3e50 2023-08-25T05:37:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d18d8f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140cb130 con 0x7f9d140d0da0 2023-08-25T05:37:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d18d8f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d140cb410 con 0x7f9d140cdde0 2023-08-25T05:37:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d1259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d140b3e50 0x7f9d140c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d1259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d140b3e50 0x7f9d140c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58938/0 (socket says 172.21.15.55:58938) 2023-08-25T05:37:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d1259c640 1 -- 172.21.15.55:0/3630500332 learned_addr learned my addr 172.21.15.55:0/3630500332 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d09d9b640 1 --2- 172.21.15.55:0/3630500332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d140cdde0 0x7f9d140b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d12d9d640 1 --2- 172.21.15.55:0/3630500332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d140d0da0 0x7f9d140b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d1259c640 1 -- 172.21.15.55:0/3630500332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d140cdde0 msgr2=0x7f9d140b7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d1259c640 1 --2- 172.21.15.55:0/3630500332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d140cdde0 0x7f9d140b7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d1259c640 1 -- 172.21.15.55:0/3630500332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d140d0da0 msgr2=0x7f9d140b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d1259c640 1 --2- 172.21.15.55:0/3630500332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d140d0da0 0x7f9d140b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d1259c640 1 -- 172.21.15.55:0/3630500332 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c009420 con 0x7f9d140b3e50 2023-08-25T05:37:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d1259c640 1 --2- 172.21.15.55:0/3630500332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d140b3e50 0x7f9d140c8af0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f9d0401c940 tx=0x7f9d0401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d0b7fe640 1 -- 172.21.15.55:0/3630500332 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d04004220 con 0x7f9d140b3e50 2023-08-25T05:37:36.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d0b7fe640 1 -- 172.21.15.55:0/3630500332 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d04004380 con 0x7f9d140b3e50 2023-08-25T05:37:36.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d0b7fe640 1 -- 172.21.15.55:0/3630500332 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d04006240 con 0x7f9d140b3e50 2023-08-25T05:37:36.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d18d8f640 1 -- 172.21.15.55:0/3630500332 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d04009480 con 0x7f9d140b3e50 2023-08-25T05:37:36.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d18d8f640 1 -- 172.21.15.55:0/3630500332 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d140cb9d0 con 0x7f9d140b3e50 2023-08-25T05:37:36.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d18d8f640 1 -- 172.21.15.55:0/3630500332 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1404dbe0 con 0x7f9d140b3e50 2023-08-25T05:37:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.271+0000 7f9d0b7fe640 1 -- 172.21.15.55:0/3630500332 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f9d040b7040 con 0x7f9d140b3e50 2023-08-25T05:37:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.275+0000 7f9d0b7fe640 1 --2- 172.21.15.55:0/3630500332 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f9cf40657a0 0x7f9cf4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.275+0000 7f9d0b7fe640 1 -- 172.21.15.55:0/3630500332 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9d0411fa20 con 0x7f9d140b3e50 2023-08-25T05:37:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.275+0000 7f9d09d9b640 1 --2- 172.21.15.55:0/3630500332 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f9cf40657a0 0x7f9cf4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.275+0000 7f9d09d9b640 1 --2- 172.21.15.55:0/3630500332 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f9cf40657a0 0x7f9cf4067c60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9d1415c1e0 tx=0x7f9cfc009040 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:36.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.279+0000 7f9d0b7fe640 1 -- 172.21.15.55:0/3630500332 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9d040ed330 con 0x7f9d140b3e50 2023-08-25T05:37:36.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.455+0000 7f9d18d8f640 1 -- 172.21.15.55:0/3630500332 --> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d140b2360 con 0x7f9cf40657a0 2023-08-25T05:37:36.460 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.459+0000 7f9d0b7fe640 1 -- 172.21.15.55:0/3630500332 <== mgr.8987 v2:172.21.15.110:6832/3630541271 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f9cfc003980 con 0x7f9cf40657a0 2023-08-25T05:37:36.460 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-08-25T05:37:36.461 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-08-25T05:37:36.461 INFO:teuthology.orchestra.run.smithi055.stdout: "name": "cephfs" 2023-08-25T05:37:36.461 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-08-25T05:37:36.461 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-08-25T05:37:36.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.459+0000 7f9d18d8f640 1 -- 172.21.15.55:0/3630500332 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f9cf40657a0 msgr2=0x7f9cf4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:36.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.459+0000 7f9d18d8f640 1 --2- 172.21.15.55:0/3630500332 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f9cf40657a0 0x7f9cf4067c60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9d1415c1e0 tx=0x7f9cfc009040 comp rx=0 tx=0).stop 2023-08-25T05:37:36.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.459+0000 7f9d18d8f640 1 -- 172.21.15.55:0/3630500332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d140b3e50 msgr2=0x7f9d140c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:36.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.459+0000 7f9d18d8f640 1 --2- 172.21.15.55:0/3630500332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d140b3e50 0x7f9d140c8af0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f9d0401c940 tx=0x7f9d0401bab0 comp rx=0 tx=0).stop 2023-08-25T05:37:36.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.459+0000 7f9d18d8f640 1 -- 172.21.15.55:0/3630500332 shutdown_connections 2023-08-25T05:37:36.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.459+0000 7f9d18d8f640 1 --2- 172.21.15.55:0/3630500332 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f9cf40657a0 0x7f9cf4067c60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:36.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.459+0000 7f9d18d8f640 1 --2- 172.21.15.55:0/3630500332 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d140d0da0 0x7f9d140b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:36.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.459+0000 7f9d18d8f640 1 --2- 172.21.15.55:0/3630500332 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d140cdde0 0x7f9d140b7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:36.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.459+0000 7f9d18d8f640 1 --2- 172.21.15.55:0/3630500332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d140b3e50 0x7f9d140c8af0 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:36.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.459+0000 7f9d18d8f640 1 -- 172.21.15.55:0/3630500332 >> 172.21.15.55:0/3630500332 conn(0x7f9d1409bae0 msgr2=0x7f9d140ceb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:36.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.459+0000 7f9d18d8f640 1 -- 172.21.15.55:0/3630500332 shutdown_connections 2023-08-25T05:37:36.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.459+0000 7f9d18d8f640 1 -- 172.21.15.55:0/3630500332 wait complete. 2023-08-25T05:37:36.481 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-08-25T05:37:36.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.623+0000 7fd21c8d7640 1 Processor -- start 2023-08-25T05:37:36.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.623+0000 7fd21c8d7640 1 -- start start 2023-08-25T05:37:36.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21c8d7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21815fca0 0x7fd2180cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:36.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21c8d7640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2180b70c0 con 0x7fd2180cfac0 2023-08-25T05:37:36.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21c8d7640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2180b73a0 con 0x7fd2180b8330 2023-08-25T05:37:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21c8d7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd218160080 con 0x7fd21815fca0 2023-08-25T05:37:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21759e640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd2180cfac0 0x7fd2180b65e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43962/0 (socket says 172.21.15.55:43962) 2023-08-25T05:37:36.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21759e640 1 -- 172.21.15.55:0/390077585 learned_addr learned my addr 172.21.15.55:0/390077585 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:36.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd216d9d640 1 --2- 172.21.15.55:0/390077585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21815fca0 0x7fd2180cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:36.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21659c640 1 -- 172.21.15.55:0/390077585 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374334917 0 0) 0x7fd2180b70c0 con 0x7fd2180cfac0 2023-08-25T05:37:36.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21659c640 1 -- 172.21.15.55:0/390077585 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd204003530 con 0x7fd2180cfac0 2023-08-25T05:37:36.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21659c640 1 -- 172.21.15.55:0/390077585 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347030179 0 0) 0x7fd2180b73a0 con 0x7fd2180b8330 2023-08-25T05:37:36.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21659c640 1 -- 172.21.15.55:0/390077585 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2180b70c0 con 0x7fd2180b8330 2023-08-25T05:37:36.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21659c640 1 -- 172.21.15.55:0/390077585 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2534999337 0 0) 0x7fd204003530 con 0x7fd2180cfac0 2023-08-25T05:37:36.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21659c640 1 -- 172.21.15.55:0/390077585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21815fca0 msgr2=0x7fd2180cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:36.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21659c640 1 --2- 172.21.15.55:0/390077585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21815fca0 0x7fd2180cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:36.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21659c640 1 -- 172.21.15.55:0/390077585 >> v1:172.21.15.110:6789/0 conn(0x7fd2180b8330 legacy=0x7fd2180d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:36.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21659c640 1 -- 172.21.15.55:0/390077585 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2180b7680 con 0x7fd2180cfac0 2023-08-25T05:37:36.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21659c640 1 -- 172.21.15.55:0/390077585 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fd210001a00 con 0x7fd2180cfac0 2023-08-25T05:37:36.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21659c640 1 -- 172.21.15.55:0/390077585 >> v1:172.21.15.55:6789/0 conn(0x7fd2180cfac0 legacy=0x7fd2180b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:36.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21659c640 1 --2- 172.21.15.55:0/390077585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21815fca0 0x7fd204003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:36.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21659c640 1 --2- 172.21.15.55:0/390077585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2040040a0 0x7fd2040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:36.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21659c640 1 --2- 172.21.15.55:0/390077585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd204004d10 0x7fd204005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:36.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21659c640 1 -- 172.21.15.55:0/390077585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd218160080 con 0x7fd204004d10 2023-08-25T05:37:36.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21659c640 1 -- 172.21.15.55:0/390077585 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20400ba70 con 0x7fd2040040a0 2023-08-25T05:37:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21659c640 1 -- 172.21.15.55:0/390077585 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20400bc30 con 0x7fd21815fca0 2023-08-25T05:37:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd216d9d640 1 --2- 172.21.15.55:0/390077585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21815fca0 0x7fd204003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd20ffff640 1 --2- 172.21.15.55:0/390077585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2040040a0 0x7fd2040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd21759e640 1 --2- 172.21.15.55:0/390077585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd204004d10 0x7fd204005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:36.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd216d9d640 1 -- 172.21.15.55:0/390077585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2040040a0 msgr2=0x7fd2040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd216d9d640 1 --2- 172.21.15.55:0/390077585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2040040a0 0x7fd2040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd216d9d640 1 -- 172.21.15.55:0/390077585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd204004d10 msgr2=0x7fd204005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd216d9d640 1 --2- 172.21.15.55:0/390077585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd204004d10 0x7fd204005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:36.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.627+0000 7fd216d9d640 1 -- 172.21.15.55:0/390077585 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd204003530 con 0x7fd21815fca0 2023-08-25T05:37:36.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.631+0000 7fd216d9d640 1 --2- 172.21.15.55:0/390077585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21815fca0 0x7fd204003b40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd208009ae0 tx=0x7fd20801ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be1ff2924e5fe60f server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:36.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.631+0000 7fd21659c640 1 -- 172.21.15.55:0/390077585 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2080a5680 con 0x7fd21815fca0 2023-08-25T05:37:36.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.631+0000 7fd21659c640 1 -- 172.21.15.55:0/390077585 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2080a57e0 con 0x7fd21815fca0 2023-08-25T05:37:36.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.631+0000 7fd21659c640 1 -- 172.21.15.55:0/390077585 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2080a5b90 con 0x7fd21815fca0 2023-08-25T05:37:36.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.631+0000 7fd21c8d7640 1 -- 172.21.15.55:0/390077585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21815fca0 msgr2=0x7fd204003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:36.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.631+0000 7fd21c8d7640 1 --2- 172.21.15.55:0/390077585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21815fca0 0x7fd204003b40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd208009ae0 tx=0x7fd20801ca90 comp rx=0 tx=0).stop 2023-08-25T05:37:36.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.631+0000 7fd21759e640 1 -- 172.21.15.55:0/390077585 reap_dead start 2023-08-25T05:37:36.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.631+0000 7fd21c8d7640 1 -- 172.21.15.55:0/390077585 shutdown_connections 2023-08-25T05:37:36.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.631+0000 7fd21c8d7640 1 -- 172.21.15.55:0/390077585 >> 172.21.15.55:0/390077585 conn(0x7fd2180658c0 msgr2=0x7fd218065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:36.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.631+0000 7fd21c8d7640 1 -- 172.21.15.55:0/390077585 shutdown_connections 2023-08-25T05:37:36.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.631+0000 7fd21c8d7640 1 -- 172.21.15.55:0/390077585 wait complete. 2023-08-25T05:37:36.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd21c8d7640 1 Processor -- start 2023-08-25T05:37:36.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd21c8d7640 1 -- start start 2023-08-25T05:37:36.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd21c8d7640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd21815fca0 0x7fd2181528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:36.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd21c8d7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd218155520 0x7fd21815b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:36.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd21c8d7640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2181559a0 0x7fd21815bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:36.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd21c8d7640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd218156d80 con 0x7fd218155520 2023-08-25T05:37:36.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd21c8d7640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd218157060 con 0x7fd21815fca0 2023-08-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd21c8d7640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd218157340 con 0x7fd2181559a0 2023-08-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd20ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd218155520 0x7fd21815b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd20ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd218155520 0x7fd21815b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58956/0 (socket says 172.21.15.55:58956) 2023-08-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd20ffff640 1 -- 172.21.15.55:0/1683143610 learned_addr learned my addr 172.21.15.55:0/1683143610 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd216d9d640 1 --2- 172.21.15.55:0/1683143610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd21815fca0 0x7fd2181528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd21759e640 1 --2- 172.21.15.55:0/1683143610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2181559a0 0x7fd21815bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:36.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd20ffff640 1 -- 172.21.15.55:0/1683143610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2181559a0 msgr2=0x7fd21815bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:36.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd20ffff640 1 --2- 172.21.15.55:0/1683143610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2181559a0 0x7fd21815bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:36.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd20ffff640 1 -- 172.21.15.55:0/1683143610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd21815fca0 msgr2=0x7fd2181528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:36.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd20ffff640 1 --2- 172.21.15.55:0/1683143610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd21815fca0 0x7fd2181528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:36.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd20ffff640 1 -- 172.21.15.55:0/1683143610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd218157620 con 0x7fd218155520 2023-08-25T05:37:36.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd216d9d640 1 --2- 172.21.15.55:0/1683143610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd21815fca0 0x7fd2181528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:36.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd21759e640 1 --2- 172.21.15.55:0/1683143610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2181559a0 0x7fd21815bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:36.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd20ffff640 1 --2- 172.21.15.55:0/1683143610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd218155520 0x7fd21815b5e0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fd20000f730 tx=0x7fd20000fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:36.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd20f7fe640 1 -- 172.21.15.55:0/1683143610 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20000fe40 con 0x7fd218155520 2023-08-25T05:37:36.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd20f7fe640 1 -- 172.21.15.55:0/1683143610 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2000052e0 con 0x7fd218155520 2023-08-25T05:37:36.641 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd21c8d7640 1 -- 172.21.15.55:0/1683143610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd218157900 con 0x7fd218155520 2023-08-25T05:37:36.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd20f7fe640 1 -- 172.21.15.55:0/1683143610 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20000d970 con 0x7fd218155520 2023-08-25T05:37:36.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.635+0000 7fd21c8d7640 1 -- 172.21.15.55:0/1683143610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2181f4450 con 0x7fd218155520 2023-08-25T05:37:36.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.639+0000 7fd21c8d7640 1 -- 172.21.15.55:0/1683143610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd218073e50 con 0x7fd218155520 2023-08-25T05:37:36.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.639+0000 7fd20f7fe640 1 -- 172.21.15.55:0/1683143610 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 116) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fd20000dad0 con 0x7fd218155520 2023-08-25T05:37:36.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.639+0000 7fd20f7fe640 1 --2- 172.21.15.55:0/1683143610 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fd1f80657d0 0x7fd1f8067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:36.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.639+0000 7fd20f7fe640 1 -- 172.21.15.55:0/1683143610 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd200082ff0 con 0x7fd218155520 2023-08-25T05:37:36.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.639+0000 7fd216d9d640 1 --2- 172.21.15.55:0/1683143610 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fd1f80657d0 0x7fd1f8067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:36.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.639+0000 7fd216d9d640 1 --2- 172.21.15.55:0/1683143610 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fd1f80657d0 0x7fd1f8067c90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd2080af000 tx=0x7fd2080046d0 comp rx=0 tx=0).ready entity=mgr.8987 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:36.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.643+0000 7fd20f7fe640 1 -- 172.21.15.55:0/1683143610 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd200050960 con 0x7fd218155520 2023-08-25T05:37:36.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:36.839+0000 7fd21c8d7640 1 -- 172.21.15.55:0/1683143610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fd2180d0680 con 0x7fd218155520 2023-08-25T05:37:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.303+0000 7fd20f7fe640 1 -- 172.21.15.55:0/1683143610 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 117) v1 ==== 85081+0+0 (secure 0 0 0) 0x7fd200081370 con 0x7fd218155520 2023-08-25T05:37:37.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.303+0000 7fd20f7fe640 1 -- 172.21.15.55:0/1683143610 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v117) v1 ==== 92+0+0 (secure 0 0 0) 0x7fd200050960 con 0x7fd218155520 2023-08-25T05:37:37.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.307+0000 7fd21c8d7640 1 -- 172.21.15.55:0/1683143610 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fd1f80657d0 msgr2=0x7fd1f8067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:37.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.307+0000 7fd21c8d7640 1 --2- 172.21.15.55:0/1683143610 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fd1f80657d0 0x7fd1f8067c90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd2080af000 tx=0x7fd2080046d0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.307+0000 7fd21c8d7640 1 -- 172.21.15.55:0/1683143610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd218155520 msgr2=0x7fd21815b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:37.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.307+0000 7fd21c8d7640 1 --2- 172.21.15.55:0/1683143610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd218155520 0x7fd21815b5e0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fd20000f730 tx=0x7fd20000fbf0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.307+0000 7fd21c8d7640 1 -- 172.21.15.55:0/1683143610 shutdown_connections 2023-08-25T05:37:37.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.307+0000 7fd21c8d7640 1 --2- 172.21.15.55:0/1683143610 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7fd1f80657d0 0x7fd1f8067c90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.307+0000 7fd21c8d7640 1 --2- 172.21.15.55:0/1683143610 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2181559a0 0x7fd21815bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.307+0000 7fd21c8d7640 1 --2- 172.21.15.55:0/1683143610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd218155520 0x7fd21815b5e0 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.307+0000 7fd21c8d7640 1 --2- 172.21.15.55:0/1683143610 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd21815fca0 0x7fd2181528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.307+0000 7fd21c8d7640 1 -- 172.21.15.55:0/1683143610 >> 172.21.15.55:0/1683143610 conn(0x7fd2180658c0 msgr2=0x7fd2180c8840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:37.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.307+0000 7fd21c8d7640 1 -- 172.21.15.55:0/1683143610 shutdown_connections 2023-08-25T05:37:37.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.307+0000 7fd21c8d7640 1 -- 172.21.15.55:0/1683143610 wait complete. 2023-08-25T05:37:37.328 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-08-25T05:37:37.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.475+0000 7f1f65c5c640 1 Processor -- start 2023-08-25T05:37:37.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.475+0000 7f1f65c5c640 1 -- start start 2023-08-25T05:37:37.481 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:37.477+0000 7f0674846180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:37:37.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.479+0000 7f1f65c5c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1f601601f0 0x7f1f6015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:37.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.479+0000 7f1f65c5c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6015e3c0 0x7f1f600d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:37.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.479+0000 7f1f65c5c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6015f8b0 con 0x7f1f600d10c0 2023-08-25T05:37:37.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.479+0000 7f1f65c5c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f600cd5a0 con 0x7f1f601601f0 2023-08-25T05:37:37.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.479+0000 7f1f65c5c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f600cd880 con 0x7f1f6015e3c0 2023-08-25T05:37:37.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.479+0000 7f1f5f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1f601601f0 0x7f1f6015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:37.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.479+0000 7f1f5f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1f601601f0 0x7f1f6015d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58978/0 (socket says 172.21.15.55:58978) 2023-08-25T05:37:37.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.479+0000 7f1f5f7fe640 1 -- 172.21.15.55:0/1140739468 learned_addr learned my addr 172.21.15.55:0/1140739468 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:37.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.479+0000 7f1f5effd640 1 --2- 172.21.15.55:0/1140739468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6015e3c0 0x7f1f600d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:37.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.479+0000 7f1f5f7fe640 1 -- 172.21.15.55:0/1140739468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6015e3c0 msgr2=0x7f1f600d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:37.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.479+0000 7f1f5f7fe640 1 --2- 172.21.15.55:0/1140739468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6015e3c0 0x7f1f600d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.479+0000 7f1f5f7fe640 1 -- 172.21.15.55:0/1140739468 >> v1:172.21.15.55:6789/0 conn(0x7f1f600d10c0 legacy=0x7f1f600b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:37.484 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:37.479+0000 7f5d5c848180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:37:37.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.479+0000 7f1f5f7fe640 1 -- 172.21.15.55:0/1140739468 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f600cdb60 con 0x7f1f601601f0 2023-08-25T05:37:37.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.483+0000 7f1f5f7fe640 1 --2- 172.21.15.55:0/1140739468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f601601f0 0x7f1f6015d430 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f1f50006fd0 tx=0x7f1f5001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7217b3ab1bcd760 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:37.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.483+0000 7f1f5e7fc640 1 -- 172.21.15.55:0/1140739468 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f500a8a10 con 0x7f1f601601f0 2023-08-25T05:37:37.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.483+0000 7f1f5e7fc640 1 -- 172.21.15.55:0/1140739468 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f500a8b70 con 0x7f1f601601f0 2023-08-25T05:37:37.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.483+0000 7f1f5e7fc640 1 -- 172.21.15.55:0/1140739468 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f500b0440 con 0x7f1f601601f0 2023-08-25T05:37:37.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.483+0000 7f1f65c5c640 1 -- 172.21.15.55:0/1140739468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f601601f0 msgr2=0x7f1f6015d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:37.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.483+0000 7f1f65c5c640 1 --2- 172.21.15.55:0/1140739468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f601601f0 0x7f1f6015d430 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f1f50006fd0 tx=0x7f1f5001ed10 comp rx=0 tx=0).stop 2023-08-25T05:37:37.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.483+0000 7f1f65c5c640 1 -- 172.21.15.55:0/1140739468 shutdown_connections 2023-08-25T05:37:37.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.483+0000 7f1f65c5c640 1 --2- 172.21.15.55:0/1140739468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6015e3c0 0x7f1f600d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.483+0000 7f1f65c5c640 1 --2- 172.21.15.55:0/1140739468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f601601f0 0x7f1f6015d430 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.483+0000 7f1f65c5c640 1 -- 172.21.15.55:0/1140739468 >> 172.21.15.55:0/1140739468 conn(0x7f1f600d27d0 msgr2=0x7f1f600d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:37.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.483+0000 7f1f65c5c640 1 -- 172.21.15.55:0/1140739468 shutdown_connections 2023-08-25T05:37:37.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.483+0000 7f1f65c5c640 1 -- 172.21.15.55:0/1140739468 wait complete. 2023-08-25T05:37:37.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f65c5c640 1 Processor -- start 2023-08-25T05:37:37.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f65c5c640 1 -- start start 2023-08-25T05:37:37.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f65c5c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f600d10c0 0x7f1f60152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:37.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f65c5c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6015e3c0 0x7f1f6009c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:37.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f65c5c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f601601f0 0x7f1f6009f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:37.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f65c5c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f60153210 con 0x7f1f601601f0 2023-08-25T05:37:37.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f65c5c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6009e890 con 0x7f1f600d10c0 2023-08-25T05:37:37.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f65c5c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6009eac0 con 0x7f1f6015e3c0 2023-08-25T05:37:37.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f5ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f601601f0 0x7f1f6009f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:37.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f5ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f601601f0 0x7f1f6009f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58980/0 (socket says 172.21.15.55:58980) 2023-08-25T05:37:37.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f5ffff640 1 -- 172.21.15.55:0/2130120886 learned_addr learned my addr 172.21.15.55:0/2130120886 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:37.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f5effd640 1 --2- 172.21.15.55:0/2130120886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6015e3c0 0x7f1f6009c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:37.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f5f7fe640 1 --2- 172.21.15.55:0/2130120886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f600d10c0 0x7f1f60152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:37.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f5ffff640 1 -- 172.21.15.55:0/2130120886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6015e3c0 msgr2=0x7f1f6009c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:37.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f5ffff640 1 --2- 172.21.15.55:0/2130120886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6015e3c0 0x7f1f6009c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f5ffff640 1 -- 172.21.15.55:0/2130120886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f600d10c0 msgr2=0x7f1f60152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:37.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f5ffff640 1 --2- 172.21.15.55:0/2130120886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f600d10c0 0x7f1f60152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f5ffff640 1 -- 172.21.15.55:0/2130120886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f50009480 con 0x7f1f601601f0 2023-08-25T05:37:37.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f5ffff640 1 --2- 172.21.15.55:0/2130120886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f601601f0 0x7f1f6009f880 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800c770 tx=0x7f1f5800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:37.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f47fff640 1 -- 172.21.15.55:0/2130120886 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58003b80 con 0x7f1f601601f0 2023-08-25T05:37:37.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f47fff640 1 -- 172.21.15.55:0/2130120886 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f58003ce0 con 0x7f1f601601f0 2023-08-25T05:37:37.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f47fff640 1 -- 172.21.15.55:0/2130120886 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5800aa90 con 0x7f1f601601f0 2023-08-25T05:37:37.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f65c5c640 1 -- 172.21.15.55:0/2130120886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f6009eda0 con 0x7f1f601601f0 2023-08-25T05:37:37.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.487+0000 7f1f65c5c640 1 -- 172.21.15.55:0/2130120886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6009f360 con 0x7f1f601601f0 2023-08-25T05:37:37.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.491+0000 7f1f65c5c640 1 -- 172.21.15.55:0/2130120886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f600b5260 con 0x7f1f601601f0 2023-08-25T05:37:37.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.491+0000 7f1f47fff640 1 -- 172.21.15.55:0/2130120886 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 117) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f1f5800abf0 con 0x7f1f601601f0 2023-08-25T05:37:37.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.491+0000 7f1f47fff640 1 --2- 172.21.15.55:0/2130120886 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f1f4c0657f0 0x7f1f4c067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:37.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.491+0000 7f1f47fff640 1 -- 172.21.15.55:0/2130120886 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f58082e20 con 0x7f1f601601f0 2023-08-25T05:37:37.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.491+0000 7f1f5f7fe640 1 -- 172.21.15.55:0/2130120886 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f1f4c0657f0 msgr2=0x7f1f4c067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3630541271 2023-08-25T05:37:37.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.491+0000 7f1f5f7fe640 1 --2- 172.21.15.55:0/2130120886 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f1f4c0657f0 0x7f1f4c067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:37.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.495+0000 7f1f47fff640 1 -- 172.21.15.55:0/2130120886 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f1f58050730 con 0x7f1f601601f0 2023-08-25T05:37:37.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.659+0000 7f1f65c5c640 1 -- 172.21.15.55:0/2130120886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f1f60073ec0 con 0x7f1f601601f0 2023-08-25T05:37:37.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.663+0000 7f1f47fff640 1 -- 172.21.15.55:0/2130120886 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v71)=0 v71) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1f58053d50 con 0x7f1f601601f0 2023-08-25T05:37:37.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.667+0000 7f1f65c5c640 1 -- 172.21.15.55:0/2130120886 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f1f4c0657f0 msgr2=0x7f1f4c067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:37.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.667+0000 7f1f65c5c640 1 --2- 172.21.15.55:0/2130120886 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f1f4c0657f0 0x7f1f4c067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.667+0000 7f1f65c5c640 1 -- 172.21.15.55:0/2130120886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f601601f0 msgr2=0x7f1f6009f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:37.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.667+0000 7f1f65c5c640 1 --2- 172.21.15.55:0/2130120886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f601601f0 0x7f1f6009f880 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800c770 tx=0x7f1f5800cc30 comp rx=0 tx=0).stop 2023-08-25T05:37:37.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.667+0000 7f1f65c5c640 1 -- 172.21.15.55:0/2130120886 shutdown_connections 2023-08-25T05:37:37.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.667+0000 7f1f65c5c640 1 --2- 172.21.15.55:0/2130120886 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f1f4c0657f0 0x7f1f4c067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.667+0000 7f1f65c5c640 1 --2- 172.21.15.55:0/2130120886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f601601f0 0x7f1f6009f880 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.667+0000 7f1f65c5c640 1 --2- 172.21.15.55:0/2130120886 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1f6015e3c0 0x7f1f6009c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.667+0000 7f1f65c5c640 1 --2- 172.21.15.55:0/2130120886 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1f600d10c0 0x7f1f60152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.667+0000 7f1f65c5c640 1 -- 172.21.15.55:0/2130120886 >> 172.21.15.55:0/2130120886 conn(0x7f1f600d27d0 msgr2=0x7f1f600b7400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:37.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.667+0000 7f1f65c5c640 1 -- 172.21.15.55:0/2130120886 shutdown_connections 2023-08-25T05:37:37.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.667+0000 7f1f65c5c640 1 -- 172.21.15.55:0/2130120886 wait complete. 2023-08-25T05:37:37.689 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-08-25T05:37:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.835+0000 7f4b4cd59640 1 Processor -- start 2023-08-25T05:37:37.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.835+0000 7f4b4cd59640 1 -- start start 2023-08-25T05:37:37.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.835+0000 7f4b4cd59640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b481601f0 0x7f4b4815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:37.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.835+0000 7f4b4cd59640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b480cd5a0 con 0x7f4b480d1290 2023-08-25T05:37:37.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.835+0000 7f4b4cd59640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b480cd880 con 0x7f4b4815e3c0 2023-08-25T05:37:37.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.835+0000 7f4b4cd59640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b480cdb60 con 0x7f4b481601f0 2023-08-25T05:37:37.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.835+0000 7f4b4659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b481601f0 0x7f4b4815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:37.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.835+0000 7f4b4659c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b481601f0 0x7f4b4815d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58984/0 (socket says 172.21.15.55:58984) 2023-08-25T05:37:37.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.835+0000 7f4b4659c640 1 -- 172.21.15.55:0/3337495372 learned_addr learned my addr 172.21.15.55:0/3337495372 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:37.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.835+0000 7f4b46d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4b480d1290 0x7f4b4815e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43974/0 (socket says 172.21.15.55:43974) 2023-08-25T05:37:37.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.835+0000 7f4b4659c640 1 -- 172.21.15.55:0/3337495372 >> v1:172.21.15.110:6789/0 conn(0x7f4b4815e3c0 legacy=0x7f4b480d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:37.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.835+0000 7f4b4659c640 1 -- 172.21.15.55:0/3337495372 >> v1:172.21.15.55:6789/0 conn(0x7f4b480d1290 legacy=0x7f4b4815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:37.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.835+0000 7f4b4659c640 1 -- 172.21.15.55:0/3337495372 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b480cde40 con 0x7f4b481601f0 2023-08-25T05:37:37.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.839+0000 7f4b4659c640 1 --2- 172.21.15.55:0/3337495372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b481601f0 0x7f4b4815d430 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f4b38006fd0 tx=0x7f4b3801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1662cd47079b0423 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.839+0000 7f4b45d9b640 1 -- 172.21.15.55:0/3337495372 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b380ab610 con 0x7f4b481601f0 2023-08-25T05:37:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.839+0000 7f4b45d9b640 1 -- 172.21.15.55:0/3337495372 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b380ab770 con 0x7f4b481601f0 2023-08-25T05:37:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.839+0000 7f4b45d9b640 1 -- 172.21.15.55:0/3337495372 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b380abb00 con 0x7f4b481601f0 2023-08-25T05:37:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.839+0000 7f4b4cd59640 1 -- 172.21.15.55:0/3337495372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b481601f0 msgr2=0x7f4b4815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.839+0000 7f4b4cd59640 1 --2- 172.21.15.55:0/3337495372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b481601f0 0x7f4b4815d430 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f4b38006fd0 tx=0x7f4b3801c4f0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.839+0000 7f4b4cd59640 1 -- 172.21.15.55:0/3337495372 shutdown_connections 2023-08-25T05:37:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.839+0000 7f4b4cd59640 1 --2- 172.21.15.55:0/3337495372 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b481601f0 0x7f4b4815d430 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.839+0000 7f4b4cd59640 1 -- 172.21.15.55:0/3337495372 >> 172.21.15.55:0/3337495372 conn(0x7f4b480d27d0 msgr2=0x7f4b480d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.839+0000 7f4b4cd59640 1 -- 172.21.15.55:0/3337495372 shutdown_connections 2023-08-25T05:37:37.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.839+0000 7f4b4cd59640 1 -- 172.21.15.55:0/3337495372 wait complete. 2023-08-25T05:37:37.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b4cd59640 1 Processor -- start 2023-08-25T05:37:37.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b4cd59640 1 -- start start 2023-08-25T05:37:37.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b4cd59640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b480d1290 0x7f4b48155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:37.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b4cd59640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b4815e3c0 0x7f4b480b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:37.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b4cd59640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b481601f0 0x7f4b481557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:37.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b4cd59640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480b1980 con 0x7f4b4815e3c0 2023-08-25T05:37:37.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b4cd59640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480b27e0 con 0x7f4b480d1290 2023-08-25T05:37:37.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b4cd59640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480b1bd0 con 0x7f4b481601f0 2023-08-25T05:37:37.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b3ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b4815e3c0 0x7f4b480b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:37.846 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b3ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b4815e3c0 0x7f4b480b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58988/0 (socket says 172.21.15.55:58988) 2023-08-25T05:37:37.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b3ffff640 1 -- 172.21.15.55:0/657168163 learned_addr learned my addr 172.21.15.55:0/657168163 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:37.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b4659c640 1 --2- 172.21.15.55:0/657168163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b480d1290 0x7f4b48155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:37.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b46d9d640 1 --2- 172.21.15.55:0/657168163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b481601f0 0x7f4b481557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:37.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b3ffff640 1 -- 172.21.15.55:0/657168163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b481601f0 msgr2=0x7f4b481557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:37.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b3ffff640 1 --2- 172.21.15.55:0/657168163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b481601f0 0x7f4b481557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b3ffff640 1 -- 172.21.15.55:0/657168163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b480d1290 msgr2=0x7f4b48155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:37.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b3ffff640 1 --2- 172.21.15.55:0/657168163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b480d1290 0x7f4b48155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:37.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b3ffff640 1 -- 172.21.15.55:0/657168163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b38009480 con 0x7f4b4815e3c0 2023-08-25T05:37:37.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b3ffff640 1 --2- 172.21.15.55:0/657168163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b4815e3c0 0x7f4b480b2c70 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000c500 tx=0x7f4b3000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:37.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b3effd640 1 -- 172.21.15.55:0/657168163 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30005220 con 0x7f4b4815e3c0 2023-08-25T05:37:37.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b3effd640 1 -- 172.21.15.55:0/657168163 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b30005380 con 0x7f4b4815e3c0 2023-08-25T05:37:37.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b3effd640 1 -- 172.21.15.55:0/657168163 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30007270 con 0x7f4b4815e3c0 2023-08-25T05:37:37.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b4cd59640 1 -- 172.21.15.55:0/657168163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b480b1eb0 con 0x7f4b4815e3c0 2023-08-25T05:37:37.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.843+0000 7f4b4cd59640 1 -- 172.21.15.55:0/657168163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b480b2470 con 0x7f4b4815e3c0 2023-08-25T05:37:37.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.847+0000 7f4b4cd59640 1 -- 172.21.15.55:0/657168163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b480b5260 con 0x7f4b4815e3c0 2023-08-25T05:37:37.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.847+0000 7f4b3effd640 1 -- 172.21.15.55:0/657168163 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 117) v1 ==== 85081+0+0 (secure 0 0 0) 0x7f4b300073d0 con 0x7f4b4815e3c0 2023-08-25T05:37:37.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.847+0000 7f4b3effd640 1 --2- 172.21.15.55:0/657168163 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f4b280657f0 0x7f4b28067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:37.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.847+0000 7f4b3effd640 1 -- 172.21.15.55:0/657168163 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4b30082840 con 0x7f4b4815e3c0 2023-08-25T05:37:37.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.847+0000 7f4b4659c640 1 -- 172.21.15.55:0/657168163 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f4b280657f0 msgr2=0x7f4b28067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3630541271 2023-08-25T05:37:37.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.847+0000 7f4b4659c640 1 --2- 172.21.15.55:0/657168163 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f4b280657f0 0x7f4b28067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:37.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:37.851+0000 7f4b3effd640 1 -- 172.21.15.55:0/657168163 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f4b30050210 con 0x7f4b4815e3c0 2023-08-25T05:37:37.896 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:37.893+0000 7f0674846180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:37:37.928 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:37.927+0000 7f5d5c848180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:37:38.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.011+0000 7f4b4cd59640 1 -- 172.21.15.55:0/657168163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f4b48073ec0 con 0x7f4b4815e3c0 2023-08-25T05:37:38.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.019+0000 7f4b3effd640 1 -- 172.21.15.55:0/657168163 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v72)=0 v72) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4b30053830 con 0x7f4b4815e3c0 2023-08-25T05:37:38.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.019+0000 7f4b4cd59640 1 -- 172.21.15.55:0/657168163 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f4b280657f0 msgr2=0x7f4b28067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:38.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.019+0000 7f4b4cd59640 1 --2- 172.21.15.55:0/657168163 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f4b280657f0 0x7f4b28067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:38.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.019+0000 7f4b4cd59640 1 -- 172.21.15.55:0/657168163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b4815e3c0 msgr2=0x7f4b480b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:38.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.019+0000 7f4b4cd59640 1 --2- 172.21.15.55:0/657168163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b4815e3c0 0x7f4b480b2c70 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000c500 tx=0x7f4b3000c9c0 comp rx=0 tx=0).stop 2023-08-25T05:37:38.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.019+0000 7f4b4cd59640 1 -- 172.21.15.55:0/657168163 shutdown_connections 2023-08-25T05:37:38.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.019+0000 7f4b4cd59640 1 --2- 172.21.15.55:0/657168163 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7f4b280657f0 0x7f4b28067cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:38.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.019+0000 7f4b4cd59640 1 --2- 172.21.15.55:0/657168163 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4b481601f0 0x7f4b481557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:38.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.019+0000 7f4b4cd59640 1 --2- 172.21.15.55:0/657168163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b4815e3c0 0x7f4b480b2c70 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:38.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.019+0000 7f4b4cd59640 1 --2- 172.21.15.55:0/657168163 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4b480d1290 0x7f4b48155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:38.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.019+0000 7f4b4cd59640 1 -- 172.21.15.55:0/657168163 >> 172.21.15.55:0/657168163 conn(0x7f4b480d27d0 msgr2=0x7f4b480d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:38.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.019+0000 7f4b4cd59640 1 -- 172.21.15.55:0/657168163 shutdown_connections 2023-08-25T05:37:38.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.019+0000 7f4b4cd59640 1 -- 172.21.15.55:0/657168163 wait complete. 2023-08-25T05:37:38.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:38.042 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-08-25T05:37:38.046 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:38.041+0000 7f0674846180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:37:38.058 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-08-25T05:37:38.089 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:38.087+0000 7f5d5c848180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:37:38.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.235+0000 7efd5e710640 1 Processor -- start 2023-08-25T05:37:38.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.235+0000 7efd5e710640 1 -- start start 2023-08-25T05:37:38.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.239+0000 7efd5e710640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd5815cb40 0x7efd580d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:38.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.239+0000 7efd5e710640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd580cf340 0x7efd580cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:38.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.239+0000 7efd5e710640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd580d1970 con 0x7efd580b43e0 2023-08-25T05:37:38.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.239+0000 7efd5e710640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd580cfcc0 con 0x7efd580cf340 2023-08-25T05:37:38.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.239+0000 7efd5e710640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd580d0d80 con 0x7efd5815cb40 2023-08-25T05:37:38.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.239+0000 7efd577fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd580cf340 0x7efd580cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:38.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.239+0000 7efd577fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd580cf340 0x7efd580cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58994/0 (socket says 172.21.15.55:58994) 2023-08-25T05:37:38.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.239+0000 7efd57fff640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd5815cb40 0x7efd580d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:38.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.239+0000 7efd577fe640 1 -- 172.21.15.55:0/755949478 learned_addr learned my addr 172.21.15.55:0/755949478 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:38.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.239+0000 7efd5ccad640 1 --1- 172.21.15.55:0/755949478 >> v1:172.21.15.110:6789/0 conn(0x7efd580b43e0 0x7efd580b4850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:52012/0 (socket says 172.21.15.55:52012) 2023-08-25T05:37:38.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.239+0000 7efd577fe640 1 -- 172.21.15.55:0/755949478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd5815cb40 msgr2=0x7efd580d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:38.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.239+0000 7efd577fe640 1 --2- 172.21.15.55:0/755949478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd5815cb40 0x7efd580d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:38.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.239+0000 7efd56ffd640 1 -- 172.21.15.55:0/755949478 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878244948 0 0) 0x7efd580d1970 con 0x7efd580b43e0 2023-08-25T05:37:38.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.239+0000 7efd577fe640 1 -- 172.21.15.55:0/755949478 >> v1:172.21.15.110:6789/0 conn(0x7efd580b43e0 legacy=0x7efd580b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:38.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.239+0000 7efd577fe640 1 -- 172.21.15.55:0/755949478 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd580d1040 con 0x7efd580cf340 2023-08-25T05:37:38.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.243+0000 7efd577fe640 1 --2- 172.21.15.55:0/755949478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd580cf340 0x7efd580cf780 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009870 tx=0x7efd4c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791939e869ee7b2b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:38.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.243+0000 7efd56ffd640 1 -- 172.21.15.55:0/755949478 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c0a8a30 con 0x7efd580cf340 2023-08-25T05:37:38.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.243+0000 7efd56ffd640 1 -- 172.21.15.55:0/755949478 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4c0a8b90 con 0x7efd580cf340 2023-08-25T05:37:38.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.243+0000 7efd56ffd640 1 -- 172.21.15.55:0/755949478 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c0b0440 con 0x7efd580cf340 2023-08-25T05:37:38.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.243+0000 7efd5e710640 1 -- 172.21.15.55:0/755949478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd580cf340 msgr2=0x7efd580cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:38.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.243+0000 7efd5e710640 1 --2- 172.21.15.55:0/755949478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd580cf340 0x7efd580cf780 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7efd4c009870 tx=0x7efd4c01ed30 comp rx=0 tx=0).stop 2023-08-25T05:37:38.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.243+0000 7efd5e710640 1 -- 172.21.15.55:0/755949478 shutdown_connections 2023-08-25T05:37:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.243+0000 7efd5e710640 1 --2- 172.21.15.55:0/755949478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd580cf340 0x7efd580cf780 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.243+0000 7efd5e710640 1 --2- 172.21.15.55:0/755949478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd5815cb40 0x7efd580d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.243+0000 7efd5e710640 1 -- 172.21.15.55:0/755949478 >> 172.21.15.55:0/755949478 conn(0x7efd5806aae0 msgr2=0x7efd5806aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.243+0000 7efd5e710640 1 -- 172.21.15.55:0/755949478 shutdown_connections 2023-08-25T05:37:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.243+0000 7efd5e710640 1 -- 172.21.15.55:0/755949478 wait complete. 2023-08-25T05:37:38.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd5e710640 1 Processor -- start 2023-08-25T05:37:38.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd5e710640 1 -- start start 2023-08-25T05:37:38.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd5e710640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd580b43e0 0x7efd5814e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:38.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd5e710640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd580cf340 0x7efd580c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:38.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd5e710640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd5815cb40 0x7efd5814c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:38.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd5e710640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5814c0c0 con 0x7efd580b43e0 2023-08-25T05:37:38.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd5e710640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd580c9560 con 0x7efd580cf340 2023-08-25T05:37:38.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd5e710640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd580c9280 con 0x7efd5815cb40 2023-08-25T05:37:38.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd57fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd580b43e0 0x7efd5814e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:38.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd57fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd580b43e0 0x7efd5814e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59000/0 (socket says 172.21.15.55:59000) 2023-08-25T05:37:38.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd57fff640 1 -- 172.21.15.55:0/1236303424 learned_addr learned my addr 172.21.15.55:0/1236303424 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:38.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd5ccad640 1 --2- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd5815cb40 0x7efd5814c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:38.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd577fe640 1 --2- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd580cf340 0x7efd580c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:38.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd57fff640 1 -- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd5815cb40 msgr2=0x7efd5814c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:38.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd57fff640 1 --2- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd5815cb40 0x7efd5814c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:38.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd57fff640 1 -- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd580cf340 msgr2=0x7efd580c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:38.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd57fff640 1 --2- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd580cf340 0x7efd580c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:38.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd57fff640 1 -- 172.21.15.55:0/1236303424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c0094d0 con 0x7efd580b43e0 2023-08-25T05:37:38.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd57fff640 1 --2- 172.21.15.55:0/1236303424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd580b43e0 0x7efd5814e170 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7efd4800e930 tx=0x7efd4800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:38.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.247+0000 7efd54ff9640 1 -- 172.21.15.55:0/1236303424 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48009690 con 0x7efd580b43e0 2023-08-25T05:37:38.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.251+0000 7efd54ff9640 1 -- 172.21.15.55:0/1236303424 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4800ca00 con 0x7efd580b43e0 2023-08-25T05:37:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.251+0000 7efd54ff9640 1 -- 172.21.15.55:0/1236303424 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4800cd70 con 0x7efd580b43e0 2023-08-25T05:37:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.251+0000 7efd5e710640 1 -- 172.21.15.55:0/1236303424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5814ba00 con 0x7efd580b43e0 2023-08-25T05:37:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.251+0000 7efd5e710640 1 -- 172.21.15.55:0/1236303424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5814e6b0 con 0x7efd580b43e0 2023-08-25T05:37:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.251+0000 7efd5e710640 1 -- 172.21.15.55:0/1236303424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd58071f80 con 0x7efd580b43e0 2023-08-25T05:37:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.251+0000 7efd54ff9640 1 -- 172.21.15.55:0/1236303424 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 117) v1 ==== 85081+0+0 (secure 0 0 0) 0x7efd48013470 con 0x7efd580b43e0 2023-08-25T05:37:38.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.251+0000 7efd54ff9640 1 --2- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7efd440657f0 0x7efd44067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:38.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.251+0000 7efd54ff9640 1 -- 172.21.15.55:0/1236303424 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efd48083240 con 0x7efd580b43e0 2023-08-25T05:37:38.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.251+0000 7efd577fe640 1 -- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7efd440657f0 msgr2=0x7efd44067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3630541271 2023-08-25T05:37:38.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.251+0000 7efd577fe640 1 --2- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7efd440657f0 0x7efd44067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:38.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.255+0000 7efd54ff9640 1 -- 172.21.15.55:0/1236303424 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7efd48050d50 con 0x7efd580b43e0 2023-08-25T05:37:38.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.435+0000 7efd5e710640 1 -- 172.21.15.55:0/1236303424 --> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7efd580d1600 con 0x7efd440657f0 2023-08-25T05:37:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.455+0000 7efd577fe640 1 -- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7efd440657f0 msgr2=0x7efd44067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3630541271 2023-08-25T05:37:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.455+0000 7efd577fe640 1 --2- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7efd440657f0 0x7efd44067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-08-25T05:37:38.528 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:38.525+0000 7f0674846180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:37:38.586 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:38.581+0000 7f0674846180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:37:38.606 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:38.603+0000 7f5d5c848180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:37:38.642 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:38.637+0000 7f0674846180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:37:38.668 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:38.667+0000 7f5d5c848180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:37:38.727 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:38.727+0000 7f5d5c848180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:37:38.728 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:38.725+0000 7f0674846180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:37:38.786 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:38.781+0000 7f0674846180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:37:38.819 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:38.819+0000 7f5d5c848180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:37:38.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.859+0000 7efd577fe640 1 -- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7efd440657f0 msgr2=0x7efd44067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3630541271 2023-08-25T05:37:38.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:38.859+0000 7efd577fe640 1 --2- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7efd440657f0 0x7efd44067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-08-25T05:37:38.870 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:38.865+0000 7f0674846180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:37:38.878 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:38.875+0000 7f5d5c848180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:37:38.926 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:38.921+0000 7f0674846180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:37:38.966 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:38.963+0000 7f5d5c848180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:37:39.025 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:39.023+0000 7f5d5c848180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:37:39.068 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:39.065+0000 7f0674846180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:37:39.127 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:39.121+0000 7f0674846180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:37:39.175 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:39.175+0000 7f5d5c848180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:37:39.237 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:39.235+0000 7f5d5c848180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:37:39.366 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:37:39.366 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:37:39.366 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:37:39.374 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:39.369+0000 7f0674846180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:37:39.487 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:37:39.488 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:37:39.488 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:37:39.496 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:39.495+0000 7f5d5c848180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:37:39.508 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:39.505+0000 7f0674846180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:37:39.634 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:39.629+0000 7f0674846180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:37:39.639 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:39.635+0000 7f5d5c848180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:37:39.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:39.663+0000 7efd577fe640 1 -- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7efd440657f0 msgr2=0x7efd44067cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/3630541271 2023-08-25T05:37:39.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:39.663+0000 7efd577fe640 1 --2- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7efd440657f0 0x7efd44067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-08-25T05:37:39.704 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:39.701+0000 7f0674846180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:37:39.769 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:39.767+0000 7f5d5c848180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:37:39.840 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:39.837+0000 7f0674846180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:37:39.843 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:39.843+0000 7f5d5c848180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:37:39.985 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:39.983+0000 7f5d5c848180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:37:40.378 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:40.373+0000 7f0674846180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:37:40.462 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:40.457+0000 7f0674846180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:37:40.554 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:40.551+0000 7f5d5c848180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:37:40.614 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:40.609+0000 7f0674846180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:37:40.643 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:40.639+0000 7f5d5c848180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:37:40.697 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:40.693+0000 7f0674846180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:37:40.798 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:40.795+0000 7f5d5c848180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:37:40.886 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:40.883+0000 7f5d5c848180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:37:41.014 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:41.009+0000 7f0674846180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:37:41.074 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:41.069+0000 7f0674846180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:37:41.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:41.083+0000 7efd54ff9640 1 -- 172.21.15.55:0/1236303424 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 118) v1 ==== 84690+0+0 (secure 0 0 0) 0x7efd48051120 con 0x7efd580b43e0 2023-08-25T05:37:41.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:41.083+0000 7efd54ff9640 1 -- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7efd440657f0 msgr2=0x7efd44067cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:41.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:41.083+0000 7efd54ff9640 1 --2- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:6832/3630541271,v1:172.21.15.110:6833/3630541271] conn(0x7efd440657f0 0x7efd44067cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:41.206 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:41.201+0000 7f05f9bbe640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:41.207 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:41.201+0000 7f05f9bbe640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:41.207 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:41.201+0000 7f05f9bbe640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:41.207 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:41.201+0000 7f05f9bbe640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:41.207 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:41.201+0000 7f05f9bbe640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:41.207 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:41.201+0000 7f05f6bb8640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:41.207 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:41.201+0000 7f05f6bb8640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:41.207 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:41.201+0000 7f05f6bb8640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:41.208 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:41.201+0000 7f05f6bb8640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:41.208 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:41.201+0000 7f05f6bb8640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:41.238 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:41.235+0000 7f5d5c848180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:37:41.301 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:41.299+0000 7f5d5c848180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:37:42.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.091+0000 7efd54ff9640 1 -- 172.21.15.55:0/1236303424 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mgrmap(e 119) v1 ==== 84817+0+0 (secure 0 0 0) 0x7efd48081560 con 0x7efd580b43e0 2023-08-25T05:37:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.091+0000 7efd54ff9640 1 --2- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7efd44033910 0x7efd4406fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:42.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.091+0000 7efd54ff9640 1 -- 172.21.15.55:0/1236303424 --> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7efd4400f6a0 con 0x7efd44033910 2023-08-25T05:37:42.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.095+0000 7efd577fe640 1 --2- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7efd44033910 0x7efd4406fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:42.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.095+0000 7efd577fe640 1 --2- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7efd44033910 0x7efd4406fcd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0b2000 tx=0x7efd4c0aa070 comp rx=0 tx=0).ready entity=mgr.10723 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:42.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.167+0000 7efd54ff9640 1 -- 172.21.15.55:0/1236303424 <== mgr.10723 v2:172.21.15.110:6832/4020115519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efd4400f6a0 con 0x7efd44033910 2023-08-25T05:37:42.169 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule set for path snap_test_dir1 2023-08-25T05:37:42.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.167+0000 7efd5e710640 1 -- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7efd44033910 msgr2=0x7efd4406fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.167+0000 7efd5e710640 1 --2- 172.21.15.55:0/1236303424 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7efd44033910 0x7efd4406fcd0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0b2000 tx=0x7efd4c0aa070 comp rx=0 tx=0).stop 2023-08-25T05:37:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.167+0000 7efd5e710640 1 -- 172.21.15.55:0/1236303424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd580b43e0 msgr2=0x7efd5814e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.167+0000 7efd5e710640 1 --2- 172.21.15.55:0/1236303424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd580b43e0 0x7efd5814e170 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7efd4800e930 tx=0x7efd4800edf0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.167+0000 7efd5ccad640 1 -- 172.21.15.55:0/1236303424 reap_dead start 2023-08-25T05:37:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.167+0000 7efd5e710640 1 -- 172.21.15.55:0/1236303424 shutdown_connections 2023-08-25T05:37:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.167+0000 7efd5e710640 1 -- 172.21.15.55:0/1236303424 >> 172.21.15.55:0/1236303424 conn(0x7efd5806aae0 msgr2=0x7efd5815bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.167+0000 7efd5e710640 1 -- 172.21.15.55:0/1236303424 shutdown_connections 2023-08-25T05:37:42.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.167+0000 7efd5e710640 1 -- 172.21.15.55:0/1236303424 wait complete. 2023-08-25T05:37:42.192 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-08-25T05:37:42.193 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-08-25T05:37:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.343+0000 7fb993367640 1 Processor -- start 2023-08-25T05:37:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.343+0000 7fb993367640 1 -- start start 2023-08-25T05:37:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.343+0000 7fb993367640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb98c15a7f0 0x7fb98c09bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.343+0000 7fb993367640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb98c0c9830 0x7fb98c070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.343+0000 7fb993367640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb98c15abd0 con 0x7fb98c06c020 2023-08-25T05:37:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.343+0000 7fb993367640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb98c0c8ab0 con 0x7fb98c0c9830 2023-08-25T05:37:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.343+0000 7fb993367640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c0c8d50 con 0x7fb98c15a7f0 2023-08-25T05:37:42.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.343+0000 7fb990902640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb98c0c9830 0x7fb98c070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:42.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.343+0000 7fb990902640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb98c0c9830 0x7fb98c070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41248/0 (socket says 172.21.15.55:41248) 2023-08-25T05:37:42.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.343+0000 7fb990902640 1 -- 172.21.15.55:0/980091185 learned_addr learned my addr 172.21.15.55:0/980091185 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.343+0000 7fb991103640 1 --2- 172.21.15.55:0/980091185 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb98c15a7f0 0x7fb98c09bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.343+0000 7fb990902640 1 -- 172.21.15.55:0/980091185 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb98c15a7f0 msgr2=0x7fb98c09bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.343+0000 7fb990902640 1 --2- 172.21.15.55:0/980091185 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb98c15a7f0 0x7fb98c09bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.343+0000 7fb990902640 1 -- 172.21.15.55:0/980091185 >> v1:172.21.15.110:6789/0 conn(0x7fb98c06c020 legacy=0x7fb98c0acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.343+0000 7fb990902640 1 -- 172.21.15.55:0/980091185 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98c0c9030 con 0x7fb98c0c9830 2023-08-25T05:37:42.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.347+0000 7fb990902640 1 --2- 172.21.15.55:0/980091185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb98c0c9830 0x7fb98c070f00 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009870 tx=0x7fb97c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b800e0eda360ac9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:42.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.347+0000 7fb983fff640 1 -- 172.21.15.55:0/980091185 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c0a95f0 con 0x7fb98c0c9830 2023-08-25T05:37:42.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.347+0000 7fb983fff640 1 -- 172.21.15.55:0/980091185 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97c0a9750 con 0x7fb98c0c9830 2023-08-25T05:37:42.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.347+0000 7fb983fff640 1 -- 172.21.15.55:0/980091185 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c0a9ae0 con 0x7fb98c0c9830 2023-08-25T05:37:42.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.347+0000 7fb993367640 1 -- 172.21.15.55:0/980091185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb98c0c9830 msgr2=0x7fb98c070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:42.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.347+0000 7fb993367640 1 --2- 172.21.15.55:0/980091185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb98c0c9830 0x7fb98c070f00 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009870 tx=0x7fb97c01c510 comp rx=0 tx=0).stop 2023-08-25T05:37:42.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.347+0000 7fb993367640 1 -- 172.21.15.55:0/980091185 shutdown_connections 2023-08-25T05:37:42.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.347+0000 7fb993367640 1 --2- 172.21.15.55:0/980091185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb98c0c9830 0x7fb98c070f00 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.347+0000 7fb993367640 1 --2- 172.21.15.55:0/980091185 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb98c15a7f0 0x7fb98c09bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.347+0000 7fb993367640 1 -- 172.21.15.55:0/980091185 >> 172.21.15.55:0/980091185 conn(0x7fb98c069900 msgr2=0x7fb98c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:42.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.347+0000 7fb993367640 1 -- 172.21.15.55:0/980091185 shutdown_connections 2023-08-25T05:37:42.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.347+0000 7fb993367640 1 -- 172.21.15.55:0/980091185 wait complete. 2023-08-25T05:37:42.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb993367640 1 Processor -- start 2023-08-25T05:37:42.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb993367640 1 -- start start 2023-08-25T05:37:42.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb993367640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb98c06c020 0x7fb98c0c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb993367640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb98c0c9830 0x7fb98c15c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb993367640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb98c15a7f0 0x7fb98c0af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb993367640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c15d650 con 0x7fb98c0c9830 2023-08-25T05:37:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb993367640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c15d8a0 con 0x7fb98c15a7f0 2023-08-25T05:37:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb993367640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c15db80 con 0x7fb98c06c020 2023-08-25T05:37:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb990902640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb98c0c9830 0x7fb98c15c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb990902640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb98c0c9830 0x7fb98c15c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41256/0 (socket says 172.21.15.55:41256) 2023-08-25T05:37:42.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb990902640 1 -- 172.21.15.55:0/142557904 learned_addr learned my addr 172.21.15.55:0/142557904 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:42.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb991103640 1 --2- 172.21.15.55:0/142557904 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb98c06c020 0x7fb98c0c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:42.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb991904640 1 --2- 172.21.15.55:0/142557904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb98c15a7f0 0x7fb98c0af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb990902640 1 -- 172.21.15.55:0/142557904 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb98c06c020 msgr2=0x7fb98c0c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb990902640 1 --2- 172.21.15.55:0/142557904 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb98c06c020 0x7fb98c0c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb990902640 1 -- 172.21.15.55:0/142557904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb98c15a7f0 msgr2=0x7fb98c0af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb990902640 1 --2- 172.21.15.55:0/142557904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb98c15a7f0 0x7fb98c0af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb990902640 1 -- 172.21.15.55:0/142557904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c0094d0 con 0x7fb98c0c9830 2023-08-25T05:37:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb990902640 1 --2- 172.21.15.55:0/142557904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb98c0c9830 0x7fb98c15c890 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0ab040 tx=0x7fb97c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:42.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb981ffb640 1 -- 172.21.15.55:0/142557904 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c0b1800 con 0x7fb98c0c9830 2023-08-25T05:37:42.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb981ffb640 1 -- 172.21.15.55:0/142557904 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97c0b1960 con 0x7fb98c0c9830 2023-08-25T05:37:42.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb993367640 1 -- 172.21.15.55:0/142557904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98c0adc90 con 0x7fb98c0c9830 2023-08-25T05:37:42.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb981ffb640 1 -- 172.21.15.55:0/142557904 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c0b1d10 con 0x7fb98c0c9830 2023-08-25T05:37:42.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb993367640 1 -- 172.21.15.55:0/142557904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98c15c370 con 0x7fb98c0c9830 2023-08-25T05:37:42.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.351+0000 7fb993367640 1 -- 172.21.15.55:0/142557904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb98c06d5b0 con 0x7fb98c0c9830 2023-08-25T05:37:42.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.355+0000 7fb981ffb640 1 -- 172.21.15.55:0/142557904 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 119) v1 ==== 84817+0+0 (secure 0 0 0) 0x7fb97c0bc450 con 0x7fb98c0c9830 2023-08-25T05:37:42.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.355+0000 7fb981ffb640 1 --2- 172.21.15.55:0/142557904 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7fb970065550 0x7fb970067a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:42.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.355+0000 7fb981ffb640 1 -- 172.21.15.55:0/142557904 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fb97c11d4e0 con 0x7fb98c0c9830 2023-08-25T05:37:42.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.355+0000 7fb991103640 1 --2- 172.21.15.55:0/142557904 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7fb970065550 0x7fb970067a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.355+0000 7fb991103640 1 --2- 172.21.15.55:0/142557904 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7fb970065550 0x7fb970067a10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb988006fd0 tx=0x7fb988008040 comp rx=0 tx=0).ready entity=mgr.10723 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:42.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.359+0000 7fb981ffb640 1 -- 172.21.15.55:0/142557904 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb97c0eb160 con 0x7fb98c0c9830 2023-08-25T05:37:42.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.539+0000 7fb993367640 1 -- 172.21.15.55:0/142557904 --> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb98c0adb10 con 0x7fb970065550 2023-08-25T05:37:42.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.595+0000 7fb981ffb640 1 -- 172.21.15.55:0/142557904 <== mgr.10723 v2:172.21.15.110:6832/4020115519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7fb9880059a0 con 0x7fb970065550 2023-08-25T05:37:42.599 INFO:teuthology.orchestra.run.smithi055.stdout:Retention added to path snap_test_dir1 2023-08-25T05:37:42.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.599+0000 7fb993367640 1 -- 172.21.15.55:0/142557904 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7fb970065550 msgr2=0x7fb970067a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:42.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.599+0000 7fb993367640 1 --2- 172.21.15.55:0/142557904 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7fb970065550 0x7fb970067a10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb988006fd0 tx=0x7fb988008040 comp rx=0 tx=0).stop 2023-08-25T05:37:42.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.599+0000 7fb993367640 1 -- 172.21.15.55:0/142557904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb98c0c9830 msgr2=0x7fb98c15c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:42.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.599+0000 7fb993367640 1 --2- 172.21.15.55:0/142557904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb98c0c9830 0x7fb98c15c890 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0ab040 tx=0x7fb97c01ad50 comp rx=0 tx=0).stop 2023-08-25T05:37:42.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.599+0000 7fb993367640 1 -- 172.21.15.55:0/142557904 shutdown_connections 2023-08-25T05:37:42.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.599+0000 7fb993367640 1 --2- 172.21.15.55:0/142557904 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7fb970065550 0x7fb970067a10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.599+0000 7fb993367640 1 --2- 172.21.15.55:0/142557904 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb98c15a7f0 0x7fb98c0af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.599+0000 7fb993367640 1 --2- 172.21.15.55:0/142557904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb98c0c9830 0x7fb98c15c890 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.599+0000 7fb993367640 1 --2- 172.21.15.55:0/142557904 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb98c06c020 0x7fb98c0c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.599+0000 7fb993367640 1 -- 172.21.15.55:0/142557904 >> 172.21.15.55:0/142557904 conn(0x7fb98c069900 msgr2=0x7fb98c15eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:42.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.599+0000 7fb993367640 1 -- 172.21.15.55:0/142557904 shutdown_connections 2023-08-25T05:37:42.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.599+0000 7fb993367640 1 -- 172.21.15.55:0/142557904 wait complete. 2023-08-25T05:37:42.620 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-08-25T05:37:42.625 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-08-25-05_38_00 in ~18s... 2023-08-25T05:37:42.625 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-08-25T05:37:42.625 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-08-25T05:37:42.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b3893640 1 Processor -- start 2023-08-25T05:37:42.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b3893640 1 -- start start 2023-08-25T05:37:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b3893640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33ac15cb40 0x7f33ac0d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b3893640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33ac0cf340 0x7f33ac0cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b3893640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f33ac0b43e0 0x7f33ac0b4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b3893640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ac0d1970 con 0x7f33ac0cf340 2023-08-25T05:37:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b3893640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ac0cfcc0 con 0x7f33ac0b43e0 2023-08-25T05:37:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b3893640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0d0d80 con 0x7f33ac15cb40 2023-08-25T05:37:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b0e2e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33ac0cf340 0x7f33ac0cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b0e2e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33ac0cf340 0x7f33ac0cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41264/0 (socket says 172.21.15.55:41264) 2023-08-25T05:37:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b0e2e640 1 -- 172.21.15.55:0/2095492867 learned_addr learned my addr 172.21.15.55:0/2095492867 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b162f640 1 --2- 172.21.15.55:0/2095492867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33ac15cb40 0x7f33ac0d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b1e30640 1 --2- 172.21.15.55:0/2095492867 >> v2:172.21.15.110:3300/0 conn(0x7f33ac0b43e0 0x7f33ac0b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b0e2e640 1 -- 172.21.15.55:0/2095492867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33ac15cb40 msgr2=0x7f33ac0d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b0e2e640 1 --2- 172.21.15.55:0/2095492867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33ac15cb40 0x7f33ac0d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b0e2e640 1 -- 172.21.15.55:0/2095492867 >> v2:172.21.15.110:3300/0 conn(0x7f33ac0b43e0 msgr2=0x7f33ac0b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b0e2e640 1 --2- 172.21.15.55:0/2095492867 >> v2:172.21.15.110:3300/0 conn(0x7f33ac0b43e0 0x7f33ac0b4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b0e2e640 1 -- 172.21.15.55:0/2095492867 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac0d1040 con 0x7f33ac0cf340 2023-08-25T05:37:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.771+0000 7f33b162f640 1 --2- 172.21.15.55:0/2095492867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33ac15cb40 0x7f33ac0d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:42.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.775+0000 7f33b0e2e640 1 --2- 172.21.15.55:0/2095492867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33ac0cf340 0x7f33ac0cf780 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f33ac08bc30 tx=0x7f339c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f930d92a0a833c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:42.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.775+0000 7f33a3fff640 1 -- 172.21.15.55:0/2095492867 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c0a89b0 con 0x7f33ac0cf340 2023-08-25T05:37:42.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.775+0000 7f33a3fff640 1 -- 172.21.15.55:0/2095492867 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339c0a8b10 con 0x7f33ac0cf340 2023-08-25T05:37:42.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.775+0000 7f33a3fff640 1 -- 172.21.15.55:0/2095492867 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c0a8ea0 con 0x7f33ac0cf340 2023-08-25T05:37:42.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.775+0000 7f33b3893640 1 -- 172.21.15.55:0/2095492867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33ac0cf340 msgr2=0x7f33ac0cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:42.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.775+0000 7f33b3893640 1 --2- 172.21.15.55:0/2095492867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33ac0cf340 0x7f33ac0cf780 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f33ac08bc30 tx=0x7f339c01ecf0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.775+0000 7f33b3893640 1 -- 172.21.15.55:0/2095492867 shutdown_connections 2023-08-25T05:37:42.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.775+0000 7f33b3893640 1 --2- 172.21.15.55:0/2095492867 >> v2:172.21.15.110:3300/0 conn(0x7f33ac0b43e0 0x7f33ac0b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.775+0000 7f33b3893640 1 --2- 172.21.15.55:0/2095492867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33ac0cf340 0x7f33ac0cf780 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.775+0000 7f33b3893640 1 --2- 172.21.15.55:0/2095492867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33ac15cb40 0x7f33ac0d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.775+0000 7f33b3893640 1 -- 172.21.15.55:0/2095492867 >> 172.21.15.55:0/2095492867 conn(0x7f33ac06aae0 msgr2=0x7f33ac06aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:42.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.775+0000 7f33b3893640 1 -- 172.21.15.55:0/2095492867 shutdown_connections 2023-08-25T05:37:42.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.775+0000 7f33b3893640 1 -- 172.21.15.55:0/2095492867 wait complete. 2023-08-25T05:37:42.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b3893640 1 Processor -- start 2023-08-25T05:37:42.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b3893640 1 -- start start 2023-08-25T05:37:42.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b3893640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33ac0b43e0 0x7f33ac1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:42.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b3893640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33ac0cf340 0x7f33ac0b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:42.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b3893640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33ac15cb40 0x7f33ac0b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:42.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b3893640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0b14a0 con 0x7f33ac0b43e0 2023-08-25T05:37:42.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b3893640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0b0ee0 con 0x7f33ac15cb40 2023-08-25T05:37:42.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b3893640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0b11c0 con 0x7f33ac0cf340 2023-08-25T05:37:42.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b162f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33ac0b43e0 0x7f33ac1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:42.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b162f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33ac0b43e0 0x7f33ac1589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41272/0 (socket says 172.21.15.55:41272) 2023-08-25T05:37:42.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b162f640 1 -- 172.21.15.55:0/4097520197 learned_addr learned my addr 172.21.15.55:0/4097520197 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:42.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b162f640 1 -- 172.21.15.55:0/4097520197 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33ac0cf340 msgr2=0x7f33ac0b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b162f640 1 --2- 172.21.15.55:0/4097520197 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33ac0cf340 0x7f33ac0b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b162f640 1 -- 172.21.15.55:0/4097520197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33ac15cb40 msgr2=0x7f33ac0b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b162f640 1 --2- 172.21.15.55:0/4097520197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33ac15cb40 0x7f33ac0b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b162f640 1 -- 172.21.15.55:0/4097520197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a8009420 con 0x7f33ac0b43e0 2023-08-25T05:37:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b162f640 1 --2- 172.21.15.55:0/4097520197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33ac0b43e0 0x7f33ac1589c0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f33a800e980 tx=0x7f33a800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33a1ffb640 1 -- 172.21.15.55:0/4097520197 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a800c980 con 0x7f33ac0b43e0 2023-08-25T05:37:42.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33a1ffb640 1 -- 172.21.15.55:0/4097520197 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a800cae0 con 0x7f33ac0b43e0 2023-08-25T05:37:42.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b3893640 1 -- 172.21.15.55:0/4097520197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339c0094d0 con 0x7f33ac0b43e0 2023-08-25T05:37:42.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33a1ffb640 1 -- 172.21.15.55:0/4097520197 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a800ce70 con 0x7f33ac0b43e0 2023-08-25T05:37:42.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.779+0000 7f33b3893640 1 -- 172.21.15.55:0/4097520197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ac0c7220 con 0x7f33ac0b43e0 2023-08-25T05:37:42.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.783+0000 7f33b3893640 1 -- 172.21.15.55:0/4097520197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ac071f80 con 0x7f33ac0b43e0 2023-08-25T05:37:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.783+0000 7f33a1ffb640 1 -- 172.21.15.55:0/4097520197 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 119) v1 ==== 84817+0+0 (secure 0 0 0) 0x7f33a8013470 con 0x7f33ac0b43e0 2023-08-25T05:37:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.783+0000 7f33a1ffb640 1 --2- 172.21.15.55:0/4097520197 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f3390065520 0x7f33900679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.783+0000 7f33a1ffb640 1 -- 172.21.15.55:0/4097520197 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f33a8082e50 con 0x7f33ac0b43e0 2023-08-25T05:37:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.783+0000 7f33b0e2e640 1 --2- 172.21.15.55:0/4097520197 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f3390065520 0x7f33900679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.783+0000 7f33b0e2e640 1 --2- 172.21.15.55:0/4097520197 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f3390065520 0x7f33900679e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f339c0b2000 tx=0x7f339c004740 comp rx=0 tx=0).ready entity=mgr.10723 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.787+0000 7f33a1ffb640 1 -- 172.21.15.55:0/4097520197 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f33a8050a20 con 0x7f33ac0b43e0 2023-08-25T05:37:42.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.959+0000 7f33b3893640 1 -- 172.21.15.55:0/4097520197 --> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33ac0d1600 con 0x7f3390065520 2023-08-25T05:37:42.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.967+0000 7f33a1ffb640 1 -- 172.21.15.55:0/4097520197 <== mgr.10723 v2:172.21.15.110:6832/4020115519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f339c0b0440 con 0x7f3390065520 2023-08-25T05:37:42.971 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:42.971 INFO:teuthology.orchestra.run.smithi055.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-08-25T05:37:42.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.971+0000 7f33b3893640 1 -- 172.21.15.55:0/4097520197 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f3390065520 msgr2=0x7f33900679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:42.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.971+0000 7f33b3893640 1 --2- 172.21.15.55:0/4097520197 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f3390065520 0x7f33900679e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f339c0b2000 tx=0x7f339c004740 comp rx=0 tx=0).stop 2023-08-25T05:37:42.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.971+0000 7f33b3893640 1 -- 172.21.15.55:0/4097520197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33ac0b43e0 msgr2=0x7f33ac1589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:42.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.971+0000 7f33b3893640 1 --2- 172.21.15.55:0/4097520197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33ac0b43e0 0x7f33ac1589c0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f33a800e980 tx=0x7f33a800ee40 comp rx=0 tx=0).stop 2023-08-25T05:37:42.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.971+0000 7f33b3893640 1 -- 172.21.15.55:0/4097520197 shutdown_connections 2023-08-25T05:37:42.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.971+0000 7f33b3893640 1 --2- 172.21.15.55:0/4097520197 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f3390065520 0x7f33900679e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.971+0000 7f33b3893640 1 --2- 172.21.15.55:0/4097520197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33ac15cb40 0x7f33ac0b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.971+0000 7f33b3893640 1 --2- 172.21.15.55:0/4097520197 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33ac0cf340 0x7f33ac0b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.971+0000 7f33b3893640 1 --2- 172.21.15.55:0/4097520197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33ac0b43e0 0x7f33ac1589c0 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:42.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.971+0000 7f33b3893640 1 -- 172.21.15.55:0/4097520197 >> 172.21.15.55:0/4097520197 conn(0x7f33ac06aae0 msgr2=0x7f33ac0ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:42.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.971+0000 7f33b3893640 1 -- 172.21.15.55:0/4097520197 shutdown_connections 2023-08-25T05:37:42.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:42.971+0000 7f33b3893640 1 -- 172.21.15.55:0/4097520197 wait complete. 2023-08-25T05:37:42.992 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-08-25T05:37:42.992 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-08-25T05:37:42.992 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-08-25T05:37:43.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.139+0000 7effb2582640 1 Processor -- start 2023-08-25T05:37:43.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.139+0000 7effb2582640 1 -- start start 2023-08-25T05:37:43.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.139+0000 7effb2582640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7effac15cb40 0x7effac0d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:43.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.139+0000 7effb2582640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effac0cf340 0x7effac0cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:43.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.139+0000 7effb2582640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effac0d1970 con 0x7effac0b43e0 2023-08-25T05:37:43.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.139+0000 7effb2582640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effac0cfcc0 con 0x7effac15cb40 2023-08-25T05:37:43.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.139+0000 7effb2582640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac0d0d80 con 0x7effac0cf340 2023-08-25T05:37:43.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.139+0000 7effabfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7effac15cb40 0x7effac0d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:43.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.139+0000 7effab7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effac0cf340 0x7effac0cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:43.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.139+0000 7effab7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effac0cf340 0x7effac0cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:49962/0 (socket says 172.21.15.55:49962) 2023-08-25T05:37:43.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.139+0000 7effabfff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7effac15cb40 0x7effac0d2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:45296/0 (socket says 172.21.15.55:45296) 2023-08-25T05:37:43.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.139+0000 7effab7fe640 1 -- 172.21.15.55:0/3196540650 learned_addr learned my addr 172.21.15.55:0/3196540650 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:43.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.139+0000 7effab7fe640 1 -- 172.21.15.55:0/3196540650 >> v2:172.21.15.110:3300/0 conn(0x7effac15cb40 msgr2=0x7effac0d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:43.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.139+0000 7effab7fe640 1 --2- 172.21.15.55:0/3196540650 >> v2:172.21.15.110:3300/0 conn(0x7effac15cb40 0x7effac0d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:43.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.139+0000 7effab7fe640 1 -- 172.21.15.55:0/3196540650 >> v1:172.21.15.110:6789/0 conn(0x7effac0b43e0 legacy=0x7effac0b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:43.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.139+0000 7effab7fe640 1 -- 172.21.15.55:0/3196540650 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac0d1040 con 0x7effac0cf340 2023-08-25T05:37:43.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.143+0000 7effab7fe640 1 --2- 172.21.15.55:0/3196540650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effac0cf340 0x7effac0cf780 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7effa0009870 tx=0x7effa001ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21a7c3e713be7b98 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:43.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.143+0000 7effaaffd640 1 -- 172.21.15.55:0/3196540650 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa00a8a30 con 0x7effac0cf340 2023-08-25T05:37:43.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.143+0000 7effaaffd640 1 -- 172.21.15.55:0/3196540650 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa00a8b90 con 0x7effac0cf340 2023-08-25T05:37:43.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.143+0000 7effaaffd640 1 -- 172.21.15.55:0/3196540650 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa00b0440 con 0x7effac0cf340 2023-08-25T05:37:43.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.143+0000 7effb2582640 1 -- 172.21.15.55:0/3196540650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effac0cf340 msgr2=0x7effac0cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:43.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.143+0000 7effb2582640 1 --2- 172.21.15.55:0/3196540650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effac0cf340 0x7effac0cf780 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7effa0009870 tx=0x7effa001ed30 comp rx=0 tx=0).stop 2023-08-25T05:37:43.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.143+0000 7effb2582640 1 -- 172.21.15.55:0/3196540650 shutdown_connections 2023-08-25T05:37:43.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.143+0000 7effb2582640 1 --2- 172.21.15.55:0/3196540650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effac0cf340 0x7effac0cf780 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:43.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.143+0000 7effb2582640 1 --2- 172.21.15.55:0/3196540650 >> v2:172.21.15.110:3300/0 conn(0x7effac15cb40 0x7effac0d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:43.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.143+0000 7effb2582640 1 -- 172.21.15.55:0/3196540650 >> 172.21.15.55:0/3196540650 conn(0x7effac06aae0 msgr2=0x7effac06aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:43.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.143+0000 7effb2582640 1 -- 172.21.15.55:0/3196540650 shutdown_connections 2023-08-25T05:37:43.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.143+0000 7effb2582640 1 -- 172.21.15.55:0/3196540650 wait complete. 2023-08-25T05:37:43.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effb2582640 1 Processor -- start 2023-08-25T05:37:43.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effb2582640 1 -- start start 2023-08-25T05:37:43.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effb2582640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effac0b43e0 0x7effac0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:43.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effb2582640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effac0cf340 0x7effac0a9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:43.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effb2582640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effac15cb40 0x7effac15f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:43.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effb2582640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0ca7b0 con 0x7effac0cf340 2023-08-25T05:37:43.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effb2582640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0caa90 con 0x7effac0b43e0 2023-08-25T05:37:43.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effb2582640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac0cad70 con 0x7effac15cb40 2023-08-25T05:37:43.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effab7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effac0cf340 0x7effac0a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:43.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effabfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effac0b43e0 0x7effac0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:43.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effabfff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effac0b43e0 0x7effac0c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:45300/0 (socket says 172.21.15.55:45300) 2023-08-25T05:37:43.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effabfff640 1 -- 172.21.15.55:0/3191064006 learned_addr learned my addr 172.21.15.55:0/3191064006 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:43.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effb0b1f640 1 --2- 172.21.15.55:0/3191064006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effac15cb40 0x7effac15f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:43.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effabfff640 1 -- 172.21.15.55:0/3191064006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effac15cb40 msgr2=0x7effac15f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:43.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effabfff640 1 --2- 172.21.15.55:0/3191064006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effac15cb40 0x7effac15f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:43.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effabfff640 1 -- 172.21.15.55:0/3191064006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effac0cf340 msgr2=0x7effac0a9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:43.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effabfff640 1 --2- 172.21.15.55:0/3191064006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effac0cf340 0x7effac0a9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:43.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effabfff640 1 -- 172.21.15.55:0/3191064006 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa00094d0 con 0x7effac0b43e0 2023-08-25T05:37:43.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effab7fe640 1 --2- 172.21.15.55:0/3191064006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effac0cf340 0x7effac0a9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:43.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effabfff640 1 --2- 172.21.15.55:0/3191064006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effac0b43e0 0x7effac0c8700 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00e930 tx=0x7eff9c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:43.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effa8ff9640 1 -- 172.21.15.55:0/3191064006 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c009690 con 0x7effac0b43e0 2023-08-25T05:37:43.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effa8ff9640 1 -- 172.21.15.55:0/3191064006 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c00ca00 con 0x7effac0b43e0 2023-08-25T05:37:43.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effa8ff9640 1 -- 172.21.15.55:0/3191064006 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c00cd70 con 0x7effac0b43e0 2023-08-25T05:37:43.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effb2582640 1 -- 172.21.15.55:0/3191064006 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effac0cb050 con 0x7effac0b43e0 2023-08-25T05:37:43.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.147+0000 7effb2582640 1 -- 172.21.15.55:0/3191064006 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effac0c8c40 con 0x7effac0b43e0 2023-08-25T05:37:43.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.151+0000 7effb2582640 1 -- 172.21.15.55:0/3191064006 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effac071f80 con 0x7effac0b43e0 2023-08-25T05:37:43.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.151+0000 7effa8ff9640 1 -- 172.21.15.55:0/3191064006 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 119) v1 ==== 84817+0+0 (secure 0 0 0) 0x7eff9c013470 con 0x7effac0b43e0 2023-08-25T05:37:43.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.151+0000 7effa8ff9640 1 --2- 172.21.15.55:0/3191064006 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7eff98065520 0x7eff980679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:43.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.151+0000 7effa8ff9640 1 -- 172.21.15.55:0/3191064006 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6406+0+0 (secure 0 0 0) 0x7eff9c082f10 con 0x7effac0b43e0 2023-08-25T05:37:43.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.151+0000 7effab7fe640 1 --2- 172.21.15.55:0/3191064006 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7eff98065520 0x7eff980679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:43.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.155+0000 7effab7fe640 1 --2- 172.21.15.55:0/3191064006 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7eff98065520 0x7eff980679e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7effa00b2000 tx=0x7effa0008040 comp rx=0 tx=0).ready entity=mgr.10723 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:43.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.155+0000 7effa8ff9640 1 -- 172.21.15.55:0/3191064006 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7eff9c050c50 con 0x7effac0b43e0 2023-08-25T05:37:43.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.279+0000 7effa8ff9640 1 -- 172.21.15.55:0/3191064006 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mgrmap(e 120) v1 ==== 85082+0+0 (secure 0 0 0) 0x7eff9c051020 con 0x7effac0b43e0 2023-08-25T05:37:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.335+0000 7effb2582640 1 -- 172.21.15.55:0/3191064006 --> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7effac0ca920 con 0x7eff98065520 2023-08-25T05:37:43.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.403+0000 7effa8ff9640 1 -- 172.21.15.55:0/3191064006 <== mgr.10723 v2:172.21.15.110:6832/4020115519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7effac0ca920 con 0x7eff98065520 2023-08-25T05:37:43.407 INFO:teuthology.orchestra.run.smithi055.stdout:Schedule removed for path snap_test_dir1 2023-08-25T05:37:43.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.407+0000 7effb2582640 1 -- 172.21.15.55:0/3191064006 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7eff98065520 msgr2=0x7eff980679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:43.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.407+0000 7effb2582640 1 --2- 172.21.15.55:0/3191064006 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7eff98065520 0x7eff980679e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7effa00b2000 tx=0x7effa0008040 comp rx=0 tx=0).stop 2023-08-25T05:37:43.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.407+0000 7effb2582640 1 -- 172.21.15.55:0/3191064006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effac0b43e0 msgr2=0x7effac0c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:43.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.407+0000 7effb2582640 1 --2- 172.21.15.55:0/3191064006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effac0b43e0 0x7effac0c8700 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00e930 tx=0x7eff9c00edf0 comp rx=0 tx=0).stop 2023-08-25T05:37:43.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.407+0000 7effb2582640 1 -- 172.21.15.55:0/3191064006 shutdown_connections 2023-08-25T05:37:43.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.407+0000 7effb2582640 1 --2- 172.21.15.55:0/3191064006 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7eff98065520 0x7eff980679e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:43.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.407+0000 7effb2582640 1 --2- 172.21.15.55:0/3191064006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7effac15cb40 0x7effac15f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:43.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.407+0000 7effb2582640 1 --2- 172.21.15.55:0/3191064006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7effac0cf340 0x7effac0a9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:43.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.407+0000 7effb2582640 1 --2- 172.21.15.55:0/3191064006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7effac0b43e0 0x7effac0c8700 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:43.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.407+0000 7effb2582640 1 -- 172.21.15.55:0/3191064006 >> 172.21.15.55:0/3191064006 conn(0x7effac06aae0 msgr2=0x7effac0b49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:43.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.407+0000 7effb2582640 1 -- 172.21.15.55:0/3191064006 shutdown_connections 2023-08-25T05:37:43.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.407+0000 7effb2582640 1 -- 172.21.15.55:0/3191064006 wait complete. 2023-08-25T05:37:43.429 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-08-25T05:37:43.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:43.429 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-08-25T05:37:43.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:43.441 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-08-25T05:37:43.497 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-08-25T05:37:43.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c83656640 1 Processor -- start 2023-08-25T05:37:43.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c83656640 1 -- start start 2023-08-25T05:37:43.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c83656640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c15a840 0x7f2c7c0cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:43.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c83656640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2c7c0cd620 0x7f2c7c1646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:43.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c83656640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c7c0ce5a0 con 0x7f2c7c0ce110 2023-08-25T05:37:43.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c83656640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7c0cf640 con 0x7f2c7c0cd620 2023-08-25T05:37:43.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c83656640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c0ce880 con 0x7f2c7c15a840 2023-08-25T05:37:43.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c80bf1640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2c7c0ce110 0x7f2c7c0ccf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42928/0 (socket says 172.21.15.55:42928) 2023-08-25T05:37:43.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c80bf1640 1 -- 172.21.15.55:0/1394427225 learned_addr learned my addr 172.21.15.55:0/1394427225 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:43.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c813f2640 1 --2- 172.21.15.55:0/1394427225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c15a840 0x7f2c7c0cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:43.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c81bf3640 1 --2- 172.21.15.55:0/1394427225 >> v2:172.21.15.110:3300/0 conn(0x7f2c7c0cd620 0x7f2c7c1646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:43.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c73fff640 1 -- 172.21.15.55:0/1394427225 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199840537 0 0) 0x7f2c7c0ce5a0 con 0x7f2c7c0ce110 2023-08-25T05:37:43.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c73fff640 1 -- 172.21.15.55:0/1394427225 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c68003530 con 0x7f2c7c0ce110 2023-08-25T05:37:43.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c73fff640 1 -- 172.21.15.55:0/1394427225 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 700975657 0 0) 0x7f2c68003530 con 0x7f2c7c0ce110 2023-08-25T05:37:43.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c73fff640 1 -- 172.21.15.55:0/1394427225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c15a840 msgr2=0x7f2c7c0cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:43.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c73fff640 1 --2- 172.21.15.55:0/1394427225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c15a840 0x7f2c7c0cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:43.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c73fff640 1 -- 172.21.15.55:0/1394427225 >> v2:172.21.15.110:3300/0 conn(0x7f2c7c0cd620 msgr2=0x7f2c7c1646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:43.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c73fff640 1 --2- 172.21.15.55:0/1394427225 >> v2:172.21.15.110:3300/0 conn(0x7f2c7c0cd620 0x7f2c7c1646e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:43.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c73fff640 1 -- 172.21.15.55:0/1394427225 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7c0ceb60 con 0x7f2c7c0ce110 2023-08-25T05:37:43.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c73fff640 1 -- 172.21.15.55:0/1394427225 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f2c6c001680 con 0x7f2c7c0ce110 2023-08-25T05:37:43.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c73fff640 1 -- 172.21.15.55:0/1394427225 >> v1:172.21.15.55:6789/0 conn(0x7f2c7c0ce110 legacy=0x7f2c7c0ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:43.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c73fff640 1 --2- 172.21.15.55:0/1394427225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c15a840 0x7f2c68003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:43.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c73fff640 1 --2- 172.21.15.55:0/1394427225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c68003f00 0x7f2c680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:43.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c73fff640 1 --2- 172.21.15.55:0/1394427225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c68004d10 0x7f2c68005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:43.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c73fff640 1 -- 172.21.15.55:0/1394427225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c0cf640 con 0x7f2c68004d10 2023-08-25T05:37:43.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c73fff640 1 -- 172.21.15.55:0/1394427225 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c0ce880 con 0x7f2c68003f00 2023-08-25T05:37:43.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c73fff640 1 -- 172.21.15.55:0/1394427225 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6800b990 con 0x7f2c7c15a840 2023-08-25T05:37:43.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c813f2640 1 --2- 172.21.15.55:0/1394427225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c15a840 0x7f2c68003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:43.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c81bf3640 1 --2- 172.21.15.55:0/1394427225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c68004d10 0x7f2c68005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:43.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c80bf1640 1 --2- 172.21.15.55:0/1394427225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c68003f00 0x7f2c680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:43.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c81bf3640 1 -- 172.21.15.55:0/1394427225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c15a840 msgr2=0x7f2c68003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:43.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c81bf3640 1 --2- 172.21.15.55:0/1394427225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c15a840 0x7f2c68003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:43.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c81bf3640 1 -- 172.21.15.55:0/1394427225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c68003f00 msgr2=0x7f2c680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:43.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c81bf3640 1 --2- 172.21.15.55:0/1394427225 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c68003f00 0x7f2c680047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:43.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.683+0000 7f2c81bf3640 1 -- 172.21.15.55:0/1394427225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c68003530 con 0x7f2c68004d10 2023-08-25T05:37:43.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.687+0000 7f2c81bf3640 1 --2- 172.21.15.55:0/1394427225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c68004d10 0x7f2c68005190 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0719f0 tx=0x7f2c7401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b3dd2d5e2e97a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:43.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.687+0000 7f2c73fff640 1 -- 172.21.15.55:0/1394427225 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c740a5c50 con 0x7f2c68004d10 2023-08-25T05:37:43.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.687+0000 7f2c73fff640 1 -- 172.21.15.55:0/1394427225 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7400f040 con 0x7f2c68004d10 2023-08-25T05:37:43.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.687+0000 7f2c73fff640 1 -- 172.21.15.55:0/1394427225 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c740ad440 con 0x7f2c68004d10 2023-08-25T05:37:43.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.687+0000 7f2c83656640 1 -- 172.21.15.55:0/1394427225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c68004d10 msgr2=0x7f2c68005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:43.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.687+0000 7f2c83656640 1 --2- 172.21.15.55:0/1394427225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c68004d10 0x7f2c68005190 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0719f0 tx=0x7f2c7401cbe0 comp rx=0 tx=0).stop 2023-08-25T05:37:43.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.687+0000 7f2c81bf3640 1 -- 172.21.15.55:0/1394427225 reap_dead start 2023-08-25T05:37:43.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.687+0000 7f2c83656640 1 -- 172.21.15.55:0/1394427225 shutdown_connections 2023-08-25T05:37:43.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.687+0000 7f2c83656640 1 -- 172.21.15.55:0/1394427225 >> 172.21.15.55:0/1394427225 conn(0x7f2c7c0d0540 msgr2=0x7f2c7c0d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:43.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.687+0000 7f2c83656640 1 -- 172.21.15.55:0/1394427225 shutdown_connections 2023-08-25T05:37:43.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.687+0000 7f2c83656640 1 -- 172.21.15.55:0/1394427225 wait complete. 2023-08-25T05:37:43.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c83656640 1 Processor -- start 2023-08-25T05:37:43.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c83656640 1 -- start start 2023-08-25T05:37:43.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c83656640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c68004d10 0x7f2c7c148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:43.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c83656640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c0c4070 0x7f2c7c0c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:43.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c83656640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c7c1e6590 0x7f2c7c1e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:43.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c83656640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c0c57f0 con 0x7f2c68004d10 2023-08-25T05:37:43.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c83656640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c1e6f50 con 0x7f2c7c1e6590 2023-08-25T05:37:43.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c83656640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c154dc0 con 0x7f2c7c0c4070 2023-08-25T05:37:43.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c813f2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c68004d10 0x7f2c7c148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:43.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c813f2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c68004d10 0x7f2c7c148950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41302/0 (socket says 172.21.15.55:41302) 2023-08-25T05:37:43.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c813f2640 1 -- 172.21.15.55:0/362301404 learned_addr learned my addr 172.21.15.55:0/362301404 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:43.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c80bf1640 1 --2- 172.21.15.55:0/362301404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c0c4070 0x7f2c7c0c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:43.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c81bf3640 1 --2- 172.21.15.55:0/362301404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c7c1e6590 0x7f2c7c1e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:43.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c813f2640 1 -- 172.21.15.55:0/362301404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c0c4070 msgr2=0x7f2c7c0c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:43.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c813f2640 1 --2- 172.21.15.55:0/362301404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c0c4070 0x7f2c7c0c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:43.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c813f2640 1 -- 172.21.15.55:0/362301404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c7c1e6590 msgr2=0x7f2c7c1e6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:43.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c813f2640 1 --2- 172.21.15.55:0/362301404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c7c1e6590 0x7f2c7c1e6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:43.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c813f2640 1 -- 172.21.15.55:0/362301404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7c0c4be0 con 0x7f2c68004d10 2023-08-25T05:37:43.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c81bf3640 1 --2- 172.21.15.55:0/362301404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c7c1e6590 0x7f2c7c1e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:43.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c813f2640 1 --2- 172.21.15.55:0/362301404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c68004d10 0x7f2c7c148950 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f2c780119d0 tx=0x7f2c78011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:43.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c71ffb640 1 -- 172.21.15.55:0/362301404 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c78005bb0 con 0x7f2c68004d10 2023-08-25T05:37:43.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c71ffb640 1 -- 172.21.15.55:0/362301404 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c78005d10 con 0x7f2c68004d10 2023-08-25T05:37:43.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c83656640 1 -- 172.21.15.55:0/362301404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7c0c4ec0 con 0x7f2c68004d10 2023-08-25T05:37:43.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.691+0000 7f2c71ffb640 1 -- 172.21.15.55:0/362301404 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7800faa0 con 0x7f2c68004d10 2023-08-25T05:37:43.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.695+0000 7f2c83656640 1 -- 172.21.15.55:0/362301404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7c0c5480 con 0x7f2c68004d10 2023-08-25T05:37:43.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.695+0000 7f2c83656640 1 -- 172.21.15.55:0/362301404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7c073ec0 con 0x7f2c68004d10 2023-08-25T05:37:43.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.695+0000 7f2c71ffb640 1 -- 172.21.15.55:0/362301404 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 120) v1 ==== 85082+0+0 (secure 0 0 0) 0x7f2c7800fc00 con 0x7f2c68004d10 2023-08-25T05:37:43.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.695+0000 7f2c71ffb640 1 --2- 172.21.15.55:0/362301404 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f2c60065820 0x7f2c60067ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:43.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.695+0000 7f2c71ffb640 1 -- 172.21.15.55:0/362301404 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f2c780839a0 con 0x7f2c68004d10 2023-08-25T05:37:43.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.695+0000 7f2c80bf1640 1 --2- 172.21.15.55:0/362301404 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f2c60065820 0x7f2c60067ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:43.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.699+0000 7f2c80bf1640 1 --2- 172.21.15.55:0/362301404 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f2c60065820 0x7f2c60067ce0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0ca390 tx=0x7f2c6c007900 comp rx=0 tx=0).ready entity=mgr.10723 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:43.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.699+0000 7f2c71ffb640 1 -- 172.21.15.55:0/362301404 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f2c78051210 con 0x7f2c68004d10 2023-08-25T05:37:43.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:43.895+0000 7f2c83656640 1 -- 172.21.15.55:0/362301404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f2c7c0cdb80 con 0x7f2c68004d10 2023-08-25T05:37:44.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.287+0000 7f2c71ffb640 1 -- 172.21.15.55:0/362301404 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 121) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f2c780515e0 con 0x7f2c68004d10 2023-08-25T05:37:44.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.291+0000 7f2c71ffb640 1 -- 172.21.15.55:0/362301404 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v121) v1 ==== 93+0+0 (secure 0 0 0) 0x7f2c78054ca0 con 0x7f2c68004d10 2023-08-25T05:37:44.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.291+0000 7f2c83656640 1 -- 172.21.15.55:0/362301404 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f2c60065820 msgr2=0x7f2c60067ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:44.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.291+0000 7f2c83656640 1 --2- 172.21.15.55:0/362301404 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f2c60065820 0x7f2c60067ce0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0ca390 tx=0x7f2c6c007900 comp rx=0 tx=0).stop 2023-08-25T05:37:44.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.291+0000 7f2c83656640 1 -- 172.21.15.55:0/362301404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c68004d10 msgr2=0x7f2c7c148950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:44.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.291+0000 7f2c83656640 1 --2- 172.21.15.55:0/362301404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c68004d10 0x7f2c7c148950 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f2c780119d0 tx=0x7f2c78011dd0 comp rx=0 tx=0).stop 2023-08-25T05:37:44.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.291+0000 7f2c83656640 1 -- 172.21.15.55:0/362301404 shutdown_connections 2023-08-25T05:37:44.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.291+0000 7f2c83656640 1 --2- 172.21.15.55:0/362301404 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f2c60065820 0x7f2c60067ce0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:44.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.291+0000 7f2c83656640 1 --2- 172.21.15.55:0/362301404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2c7c1e6590 0x7f2c7c1e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:44.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.291+0000 7f2c83656640 1 --2- 172.21.15.55:0/362301404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2c7c0c4070 0x7f2c7c0c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:44.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.291+0000 7f2c83656640 1 --2- 172.21.15.55:0/362301404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c68004d10 0x7f2c7c148950 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:44.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.291+0000 7f2c83656640 1 -- 172.21.15.55:0/362301404 >> 172.21.15.55:0/362301404 conn(0x7f2c7c0d0540 msgr2=0x7f2c7c0af570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:44.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.291+0000 7f2c83656640 1 -- 172.21.15.55:0/362301404 shutdown_connections 2023-08-25T05:37:44.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.291+0000 7f2c83656640 1 -- 172.21.15.55:0/362301404 wait complete. 2023-08-25T05:37:44.315 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-25T05:37:44.316 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T05:37:44.382 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-25T05:37:44.458 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-25T05:37:44.459 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:37:44.459 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:44.468 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:37:44.468 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:44.471 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:44.465+0000 7fb26ea47180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:37:44.471 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:44.471+0000 7f5967148180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-25T05:37:44.479 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:37:44.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.667+0000 7fa010b00640 1 Processor -- start 2023-08-25T05:37:44.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.667+0000 7fa010b00640 1 -- start start 2023-08-25T05:37:44.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.667+0000 7fa010b00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa00c0cdde0 0x7fa00c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:44.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.667+0000 7fa010b00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00c0b29b0 con 0x7fa00c0b2e40 2023-08-25T05:37:44.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.667+0000 7fa010b00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00c0b1dc0 con 0x7fa00c0d0da0 2023-08-25T05:37:44.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.667+0000 7fa010b00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0ce760 con 0x7fa00c0cdde0 2023-08-25T05:37:44.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.667+0000 7fa00ad9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa00c0b2e40 0x7fa00c0b32d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42936/0 (socket says 172.21.15.55:42936) 2023-08-25T05:37:44.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.667+0000 7fa001d9b640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa00c0cdde0 0x7fa00c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:44.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.667+0000 7fa00ad9d640 1 -- 172.21.15.55:0/2450140270 learned_addr learned my addr 172.21.15.55:0/2450140270 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:44.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.667+0000 7fa001d9b640 1 -- 172.21.15.55:0/2450140270 >> v1:172.21.15.110:6789/0 conn(0x7fa00c0d0da0 legacy=0x7fa00c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:44.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.667+0000 7fa009d9b640 1 -- 172.21.15.55:0/2450140270 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537881334 0 0) 0x7fa00c0b29b0 con 0x7fa00c0b2e40 2023-08-25T05:37:44.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.667+0000 7fa001d9b640 1 -- 172.21.15.55:0/2450140270 >> v1:172.21.15.55:6789/0 conn(0x7fa00c0b2e40 legacy=0x7fa00c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:44.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.667+0000 7fa001d9b640 1 -- 172.21.15.55:0/2450140270 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c0b2080 con 0x7fa00c0cdde0 2023-08-25T05:37:44.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.671+0000 7fa001d9b640 1 --2- 172.21.15.55:0/2450140270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa00c0cdde0 0x7fa00c0ce220 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009dc0 tx=0x7f9ff401f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66f80b8c319dac55 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:44.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.671+0000 7fa009d9b640 1 -- 172.21.15.55:0/2450140270 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40af600 con 0x7fa00c0cdde0 2023-08-25T05:37:44.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.671+0000 7fa009d9b640 1 -- 172.21.15.55:0/2450140270 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff40ab050 con 0x7fa00c0cdde0 2023-08-25T05:37:44.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.671+0000 7fa009d9b640 1 -- 172.21.15.55:0/2450140270 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40af980 con 0x7fa00c0cdde0 2023-08-25T05:37:44.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.671+0000 7fa010b00640 1 -- 172.21.15.55:0/2450140270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa00c0cdde0 msgr2=0x7fa00c0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:44.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.671+0000 7fa010b00640 1 --2- 172.21.15.55:0/2450140270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa00c0cdde0 0x7fa00c0ce220 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009dc0 tx=0x7f9ff401f150 comp rx=0 tx=0).stop 2023-08-25T05:37:44.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.671+0000 7fa010b00640 1 -- 172.21.15.55:0/2450140270 shutdown_connections 2023-08-25T05:37:44.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.671+0000 7fa010b00640 1 --2- 172.21.15.55:0/2450140270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa00c0cdde0 0x7fa00c0ce220 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:44.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.671+0000 7fa010b00640 1 -- 172.21.15.55:0/2450140270 >> 172.21.15.55:0/2450140270 conn(0x7fa00c09bae0 msgr2=0x7fa00c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:44.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.671+0000 7fa010b00640 1 -- 172.21.15.55:0/2450140270 shutdown_connections 2023-08-25T05:37:44.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.671+0000 7fa010b00640 1 -- 172.21.15.55:0/2450140270 wait complete. 2023-08-25T05:37:44.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa010b00640 1 Processor -- start 2023-08-25T05:37:44.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa010b00640 1 -- start start 2023-08-25T05:37:44.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa010b00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa00c0b2e40 0x7fa00c1f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:44.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa010b00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa00c0cdde0 0x7fa00c15e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:44.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa010b00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa00c0d0da0 0x7fa00c15e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:44.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa010b00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0ca2a0 con 0x7fa00c0cdde0 2023-08-25T05:37:44.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa010b00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0cb590 con 0x7fa00c0d0da0 2023-08-25T05:37:44.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa010b00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00c0ca4f0 con 0x7fa00c0b2e40 2023-08-25T05:37:44.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa001d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa00c0cdde0 0x7fa00c15e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:44.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa001d9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa00c0cdde0 0x7fa00c15e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41334/0 (socket says 172.21.15.55:41334) 2023-08-25T05:37:44.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa001d9b640 1 -- 172.21.15.55:0/3441866048 learned_addr learned my addr 172.21.15.55:0/3441866048 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:44.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa00a59c640 1 --2- 172.21.15.55:0/3441866048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa00c0b2e40 0x7fa00c1f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:44.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa00ad9d640 1 --2- 172.21.15.55:0/3441866048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa00c0d0da0 0x7fa00c15e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:44.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa001d9b640 1 -- 172.21.15.55:0/3441866048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa00c0b2e40 msgr2=0x7fa00c1f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:44.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa001d9b640 1 --2- 172.21.15.55:0/3441866048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa00c0b2e40 0x7fa00c1f1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:44.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa001d9b640 1 -- 172.21.15.55:0/3441866048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa00c0d0da0 msgr2=0x7fa00c15e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:44.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa001d9b640 1 --2- 172.21.15.55:0/3441866048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa00c0d0da0 0x7fa00c15e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:44.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa001d9b640 1 -- 172.21.15.55:0/3441866048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff4009a70 con 0x7fa00c0cdde0 2023-08-25T05:37:44.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa001d9b640 1 --2- 172.21.15.55:0/3441866048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa00c0cdde0 0x7fa00c15e1c0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40b2040 tx=0x7f9ff401bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:44.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa0037fe640 1 -- 172.21.15.55:0/3441866048 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40ba680 con 0x7fa00c0cdde0 2023-08-25T05:37:44.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa0037fe640 1 -- 172.21.15.55:0/3441866048 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff40ba800 con 0x7fa00c0cdde0 2023-08-25T05:37:44.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa010b00640 1 -- 172.21.15.55:0/3441866048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00c0ca7d0 con 0x7fa00c0cdde0 2023-08-25T05:37:44.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa0037fe640 1 -- 172.21.15.55:0/3441866048 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40babb0 con 0x7fa00c0cdde0 2023-08-25T05:37:44.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.675+0000 7fa010b00640 1 -- 172.21.15.55:0/3441866048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00c0cad90 con 0x7fa00c0cdde0 2023-08-25T05:37:44.681 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.679+0000 7fa010b00640 1 -- 172.21.15.55:0/3441866048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00c04dbe0 con 0x7fa00c0cdde0 2023-08-25T05:37:44.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.679+0000 7fa0037fe640 1 -- 172.21.15.55:0/3441866048 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 121) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f9ff40b6040 con 0x7fa00c0cdde0 2023-08-25T05:37:44.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.679+0000 7fa0037fe640 1 --2- 172.21.15.55:0/3441866048 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f9fec0657a0 0x7f9fec067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:44.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.679+0000 7fa0037fe640 1 -- 172.21.15.55:0/3441866048 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f9ff4122690 con 0x7fa00c0cdde0 2023-08-25T05:37:44.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.679+0000 7fa00a59c640 1 -- 172.21.15.55:0/3441866048 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f9fec0657a0 msgr2=0x7f9fec067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4020115519 2023-08-25T05:37:44.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.679+0000 7fa00a59c640 1 --2- 172.21.15.55:0/3441866048 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f9fec0657a0 0x7f9fec067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:44.685 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.683+0000 7fa0037fe640 1 -- 172.21.15.55:0/3441866048 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9ff40efe60 con 0x7fa00c0cdde0 2023-08-25T05:37:44.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.843+0000 7fa010b00640 1 -- 172.21.15.55:0/3441866048 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa00c0d0b80 con 0x7fa00c0cdde0 2023-08-25T05:37:44.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.843+0000 7fa0037fe640 1 -- 172.21.15.55:0/3441866048 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) v1 ==== 74+0+18814 (secure 0 0 0) 0x7f9ff40f3480 con 0x7fa00c0cdde0 2023-08-25T05:37:44.845 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:44.845 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":203,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:37:41.077512+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:37:21.649130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-08-25T05:37:22.924825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6833/3630541271":"2023-08-26T05:37:41.077473+0000","172.21.15.110:6832/3630541271":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/546735057":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/2235590334":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/1481231262":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/19806955":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/645754688":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/4203127837":"2023-08-26T05:37:41.077473+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:37:44.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.843+0000 7fa010b00640 1 -- 172.21.15.55:0/3441866048 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f9fec0657a0 msgr2=0x7f9fec067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:44.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.843+0000 7fa010b00640 1 --2- 172.21.15.55:0/3441866048 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f9fec0657a0 0x7f9fec067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:44.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.843+0000 7fa010b00640 1 -- 172.21.15.55:0/3441866048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa00c0cdde0 msgr2=0x7fa00c15e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:44.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.843+0000 7fa010b00640 1 --2- 172.21.15.55:0/3441866048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa00c0cdde0 0x7fa00c15e1c0 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40b2040 tx=0x7f9ff401bef0 comp rx=0 tx=0).stop 2023-08-25T05:37:44.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.843+0000 7fa010b00640 1 -- 172.21.15.55:0/3441866048 shutdown_connections 2023-08-25T05:37:44.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.843+0000 7fa010b00640 1 --2- 172.21.15.55:0/3441866048 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f9fec0657a0 0x7f9fec067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.843+0000 7fa010b00640 1 --2- 172.21.15.55:0/3441866048 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa00c0d0da0 0x7fa00c15e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.843+0000 7fa010b00640 1 --2- 172.21.15.55:0/3441866048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa00c0cdde0 0x7fa00c15e1c0 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.843+0000 7fa010b00640 1 --2- 172.21.15.55:0/3441866048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa00c0b2e40 0x7fa00c1f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.843+0000 7fa010b00640 1 -- 172.21.15.55:0/3441866048 >> 172.21.15.55:0/3441866048 conn(0x7fa00c09bae0 msgr2=0x7fa00c0cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.843+0000 7fa010b00640 1 -- 172.21.15.55:0/3441866048 shutdown_connections 2023-08-25T05:37:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:44.843+0000 7fa010b00640 1 -- 172.21.15.55:0/3441866048 wait complete. 2023-08-25T05:37:44.868 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T05:37:21.649130+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '201', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T05:37:22.924825+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '202', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T05:37:44.868 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T05:37:44.886 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:44.881+0000 7fb26ea47180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:37:44.916 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:44.915+0000 7f5967148180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-25T05:37:45.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.015+0000 7f53de104640 1 Processor -- start 2023-08-25T05:37:45.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.015+0000 7f53de104640 1 -- start start 2023-08-25T05:37:45.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.019+0000 7f53de104640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53d815fca0 0x7f53d80cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:45.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.019+0000 7f53de104640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d80cfee0 con 0x7f53d80b8330 2023-08-25T05:37:45.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.019+0000 7f53de104640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d80b70c0 con 0x7f53d80cfac0 2023-08-25T05:37:45.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.019+0000 7f53de104640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d8160080 con 0x7f53d815fca0 2023-08-25T05:37:45.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.019+0000 7f53dd102640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53d815fca0 0x7f53d80cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:45.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.019+0000 7f53dc901640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f53d80b8330 0x7f53d80d0bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42940/0 (socket says 172.21.15.55:42940) 2023-08-25T05:37:45.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.019+0000 7f53dc901640 1 -- 172.21.15.55:0/4274318275 learned_addr learned my addr 172.21.15.55:0/4274318275 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:45.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.019+0000 7f53dd102640 1 -- 172.21.15.55:0/4274318275 >> v1:172.21.15.110:6789/0 conn(0x7f53d80cfac0 legacy=0x7f53d80b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:45.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.019+0000 7f53dd102640 1 -- 172.21.15.55:0/4274318275 >> v1:172.21.15.55:6789/0 conn(0x7f53d80b8330 legacy=0x7f53d80d0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:45.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.019+0000 7f53dd102640 1 -- 172.21.15.55:0/4274318275 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d80b73a0 con 0x7f53d815fca0 2023-08-25T05:37:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.019+0000 7f53cffff640 1 -- 172.21.15.55:0/4274318275 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256216913 0 0) 0x7f53d80cfee0 con 0x7f53d80b8330 2023-08-25T05:37:45.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.023+0000 7f53dd102640 1 --2- 172.21.15.55:0/4274318275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d815fca0 0x7f53d80cf580 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f53d40097c0 tx=0x7f53d401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770b1073929f9e3d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:45.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.023+0000 7f53cffff640 1 -- 172.21.15.55:0/4274318275 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d40a8970 con 0x7f53d815fca0 2023-08-25T05:37:45.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.023+0000 7f53cffff640 1 -- 172.21.15.55:0/4274318275 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d40a8ad0 con 0x7f53d815fca0 2023-08-25T05:37:45.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.023+0000 7f53cffff640 1 -- 172.21.15.55:0/4274318275 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d40a8e60 con 0x7f53d815fca0 2023-08-25T05:37:45.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.023+0000 7f53de104640 1 -- 172.21.15.55:0/4274318275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d815fca0 msgr2=0x7f53d80cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:45.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.023+0000 7f53de104640 1 --2- 172.21.15.55:0/4274318275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d815fca0 0x7f53d80cf580 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f53d40097c0 tx=0x7f53d401ec70 comp rx=0 tx=0).stop 2023-08-25T05:37:45.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.023+0000 7f53de104640 1 -- 172.21.15.55:0/4274318275 shutdown_connections 2023-08-25T05:37:45.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.023+0000 7f53de104640 1 --2- 172.21.15.55:0/4274318275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d815fca0 0x7f53d80cf580 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.023+0000 7f53de104640 1 -- 172.21.15.55:0/4274318275 >> 172.21.15.55:0/4274318275 conn(0x7f53d80658c0 msgr2=0x7f53d8065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:45.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.023+0000 7f53de104640 1 -- 172.21.15.55:0/4274318275 shutdown_connections 2023-08-25T05:37:45.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.023+0000 7f53de104640 1 -- 172.21.15.55:0/4274318275 wait complete. 2023-08-25T05:37:45.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.023+0000 7f53de104640 1 Processor -- start 2023-08-25T05:37:45.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.023+0000 7f53de104640 1 -- start start 2023-08-25T05:37:45.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53de104640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d80b8330 0x7f53d80b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:45.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53de104640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d80cfac0 0x7f53d80cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:45.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53de104640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d815fca0 0x7f53d81f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:45.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53de104640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80b3ed0 con 0x7f53d80b8330 2023-08-25T05:37:45.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53de104640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80ca840 con 0x7f53d815fca0 2023-08-25T05:37:45.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53de104640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80cab20 con 0x7f53d80cfac0 2023-08-25T05:37:45.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53dd102640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d80b8330 0x7f53d80b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:45.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53dd102640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d80b8330 0x7f53d80b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41356/0 (socket says 172.21.15.55:41356) 2023-08-25T05:37:45.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53dd102640 1 -- 172.21.15.55:0/597493890 learned_addr learned my addr 172.21.15.55:0/597493890 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:45.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53dc901640 1 --2- 172.21.15.55:0/597493890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d80cfac0 0x7f53d80cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:45.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53dd903640 1 --2- 172.21.15.55:0/597493890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d815fca0 0x7f53d81f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:45.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53dd102640 1 -- 172.21.15.55:0/597493890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d80cfac0 msgr2=0x7f53d80cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:45.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53dd102640 1 --2- 172.21.15.55:0/597493890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d80cfac0 0x7f53d80cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53dd102640 1 -- 172.21.15.55:0/597493890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d815fca0 msgr2=0x7f53d81f2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:45.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53dd102640 1 --2- 172.21.15.55:0/597493890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d815fca0 0x7f53d81f2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53dd102640 1 -- 172.21.15.55:0/597493890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d4009420 con 0x7f53d80b8330 2023-08-25T05:37:45.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53dd102640 1 --2- 172.21.15.55:0/597493890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d80b8330 0x7f53d80b3990 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f53d401c8a0 tx=0x7f53d401d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:45.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53cdffb640 1 -- 172.21.15.55:0/597493890 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d40b1e30 con 0x7f53d80b8330 2023-08-25T05:37:45.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53cdffb640 1 -- 172.21.15.55:0/597493890 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d4004030 con 0x7f53d80b8330 2023-08-25T05:37:45.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53de104640 1 -- 172.21.15.55:0/597493890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d80cae00 con 0x7f53d80b8330 2023-08-25T05:37:45.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53cdffb640 1 -- 172.21.15.55:0/597493890 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d40043a0 con 0x7f53d80b8330 2023-08-25T05:37:45.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53de104640 1 -- 172.21.15.55:0/597493890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d80cb3c0 con 0x7f53d80b8330 2023-08-25T05:37:45.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.027+0000 7f53de104640 1 -- 172.21.15.55:0/597493890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d8073e50 con 0x7f53d80b8330 2023-08-25T05:37:45.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.031+0000 7f53cdffb640 1 -- 172.21.15.55:0/597493890 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 121) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f53d4003620 con 0x7f53d80b8330 2023-08-25T05:37:45.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.031+0000 7f53cdffb640 1 --2- 172.21.15.55:0/597493890 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f53bc0657a0 0x7f53bc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:45.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.031+0000 7f53cdffb640 1 -- 172.21.15.55:0/597493890 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f53d4121340 con 0x7f53d80b8330 2023-08-25T05:37:45.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.031+0000 7f53dc901640 1 -- 172.21.15.55:0/597493890 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f53bc0657a0 msgr2=0x7f53bc067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4020115519 2023-08-25T05:37:45.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.031+0000 7f53dc901640 1 --2- 172.21.15.55:0/597493890 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f53bc0657a0 0x7f53bc067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:45.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.035+0000 7f53cdffb640 1 -- 172.21.15.55:0/597493890 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f53d40eecd0 con 0x7f53d80b8330 2023-08-25T05:37:45.037 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:45.033+0000 7fb26ea47180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:37:45.080 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:45.079+0000 7f5967148180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-25T05:37:45.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.195+0000 7f53de104640 1 -- 172.21.15.55:0/597493890 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53d80cb5b0 con 0x7f53d80b8330 2023-08-25T05:37:45.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.195+0000 7f53cdffb640 1 -- 172.21.15.55:0/597493890 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v203) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53d40f22f0 con 0x7f53d80b8330 2023-08-25T05:37:45.198 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T05:37:45.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.199+0000 7f53de104640 1 -- 172.21.15.55:0/597493890 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f53bc0657a0 msgr2=0x7f53bc067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:45.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.199+0000 7f53de104640 1 --2- 172.21.15.55:0/597493890 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f53bc0657a0 0x7f53bc067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.199+0000 7f53de104640 1 -- 172.21.15.55:0/597493890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d80b8330 msgr2=0x7f53d80b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:45.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.199+0000 7f53de104640 1 --2- 172.21.15.55:0/597493890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d80b8330 0x7f53d80b3990 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f53d401c8a0 tx=0x7f53d401d4b0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.199+0000 7f53de104640 1 -- 172.21.15.55:0/597493890 shutdown_connections 2023-08-25T05:37:45.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.199+0000 7f53de104640 1 --2- 172.21.15.55:0/597493890 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f53bc0657a0 0x7f53bc067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.199+0000 7f53de104640 1 --2- 172.21.15.55:0/597493890 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f53d815fca0 0x7f53d81f2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.199+0000 7f53de104640 1 --2- 172.21.15.55:0/597493890 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f53d80cfac0 0x7f53d80cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.199+0000 7f53de104640 1 --2- 172.21.15.55:0/597493890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53d80b8330 0x7f53d80b3990 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.199+0000 7f53de104640 1 -- 172.21.15.55:0/597493890 >> 172.21.15.55:0/597493890 conn(0x7f53d80658c0 msgr2=0x7f53d80d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:45.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.199+0000 7f53de104640 1 -- 172.21.15.55:0/597493890 shutdown_connections 2023-08-25T05:37:45.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.199+0000 7f53de104640 1 -- 172.21.15.55:0/597493890 wait complete. 2023-08-25T05:37:45.220 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T05:37:45.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.367+0000 7ff2e48d8640 1 Processor -- start 2023-08-25T05:37:45.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.367+0000 7ff2e48d8640 1 -- start start 2023-08-25T05:37:45.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.367+0000 7ff2e48d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e01601f0 0x7ff2e015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:45.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.367+0000 7ff2e48d8640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2e00d1290 0x7ff2e015e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.367+0000 7ff2e48d8640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e00cd5a0 con 0x7ff2e015e3c0 2023-08-25T05:37:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.367+0000 7ff2e48d8640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e00cd880 con 0x7ff2e00d1290 2023-08-25T05:37:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.367+0000 7ff2e48d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00cdb60 con 0x7ff2e01601f0 2023-08-25T05:37:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.367+0000 7ff2ded9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2e00d1290 0x7ff2e015e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.367+0000 7ff2ded9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2e00d1290 0x7ff2e015e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41366/0 (socket says 172.21.15.55:41366) 2023-08-25T05:37:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.367+0000 7ff2ded9d640 1 -- 172.21.15.55:0/390899931 learned_addr learned my addr 172.21.15.55:0/390899931 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:45.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.367+0000 7ff2de59c640 1 --2- 172.21.15.55:0/390899931 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e01601f0 0x7ff2e015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:45.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.367+0000 7ff2ded9d640 1 -- 172.21.15.55:0/390899931 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e01601f0 msgr2=0x7ff2e015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:45.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.367+0000 7ff2ded9d640 1 --2- 172.21.15.55:0/390899931 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e01601f0 0x7ff2e015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.367+0000 7ff2ded9d640 1 -- 172.21.15.55:0/390899931 >> v1:172.21.15.110:6789/0 conn(0x7ff2e015e3c0 legacy=0x7ff2e00d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:45.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.367+0000 7ff2ded9d640 1 -- 172.21.15.55:0/390899931 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e00cde40 con 0x7ff2e00d1290 2023-08-25T05:37:45.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.367+0000 7ff2ddd9b640 1 -- 172.21.15.55:0/390899931 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878956007 0 0) 0x7ff2e00cd5a0 con 0x7ff2e015e3c0 2023-08-25T05:37:45.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.371+0000 7ff2ded9d640 1 --2- 172.21.15.55:0/390899931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e00d1290 0x7ff2e015e8a0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009e50 tx=0x7ff2d801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42e13e5e983dc9e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:45.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.371+0000 7ff2ddd9b640 1 -- 172.21.15.55:0/390899931 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80af400 con 0x7ff2e00d1290 2023-08-25T05:37:45.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.371+0000 7ff2ddd9b640 1 -- 172.21.15.55:0/390899931 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d80ab050 con 0x7ff2e00d1290 2023-08-25T05:37:45.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.371+0000 7ff2ddd9b640 1 -- 172.21.15.55:0/390899931 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80af780 con 0x7ff2e00d1290 2023-08-25T05:37:45.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.371+0000 7ff2e48d8640 1 -- 172.21.15.55:0/390899931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e00d1290 msgr2=0x7ff2e015e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:45.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.371+0000 7ff2e48d8640 1 --2- 172.21.15.55:0/390899931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e00d1290 0x7ff2e015e8a0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009e50 tx=0x7ff2d801f1f0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.375+0000 7ff2e48d8640 1 -- 172.21.15.55:0/390899931 shutdown_connections 2023-08-25T05:37:45.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.375+0000 7ff2e48d8640 1 --2- 172.21.15.55:0/390899931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e00d1290 0x7ff2e015e8a0 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.375+0000 7ff2e48d8640 1 --2- 172.21.15.55:0/390899931 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e01601f0 0x7ff2e015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.375+0000 7ff2e48d8640 1 -- 172.21.15.55:0/390899931 >> 172.21.15.55:0/390899931 conn(0x7ff2e00d27d0 msgr2=0x7ff2e00d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:45.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.375+0000 7ff2e48d8640 1 -- 172.21.15.55:0/390899931 shutdown_connections 2023-08-25T05:37:45.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.375+0000 7ff2e48d8640 1 -- 172.21.15.55:0/390899931 wait complete. 2023-08-25T05:37:45.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.375+0000 7ff2e48d8640 1 Processor -- start 2023-08-25T05:37:45.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.375+0000 7ff2e48d8640 1 -- start start 2023-08-25T05:37:45.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2e48d8640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e00d1290 0x7ff2e015b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:45.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2e48d8640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e015e3c0 0x7ff2e00c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:45.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2e48d8640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2e01601f0 0x7ff2e01587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:45.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2e48d8640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00c91c0 con 0x7ff2e00d1290 2023-08-25T05:37:45.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2e48d8640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e015a510 con 0x7ff2e01601f0 2023-08-25T05:37:45.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2e48d8640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e015a7f0 con 0x7ff2e015e3c0 2023-08-25T05:37:45.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2de59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e00d1290 0x7ff2e015b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:45.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2de59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e00d1290 0x7ff2e015b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41380/0 (socket says 172.21.15.55:41380) 2023-08-25T05:37:45.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2de59c640 1 -- 172.21.15.55:0/3240173493 learned_addr learned my addr 172.21.15.55:0/3240173493 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:45.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2d7fff640 1 --2- 172.21.15.55:0/3240173493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e015e3c0 0x7ff2e00c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:45.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2ded9d640 1 --2- 172.21.15.55:0/3240173493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2e01601f0 0x7ff2e01587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:45.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2de59c640 1 -- 172.21.15.55:0/3240173493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e015e3c0 msgr2=0x7ff2e00c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:45.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2de59c640 1 --2- 172.21.15.55:0/3240173493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e015e3c0 0x7ff2e00c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2de59c640 1 -- 172.21.15.55:0/3240173493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2e01601f0 msgr2=0x7ff2e01587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:45.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2de59c640 1 --2- 172.21.15.55:0/3240173493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2e01601f0 0x7ff2e01587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2de59c640 1 -- 172.21.15.55:0/3240173493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d8009b30 con 0x7ff2e00d1290 2023-08-25T05:37:45.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2d7fff640 1 --2- 172.21.15.55:0/3240173493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e015e3c0 0x7ff2e00c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:45.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2ded9d640 1 --2- 172.21.15.55:0/3240173493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2e01601f0 0x7ff2e01587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:45.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2de59c640 1 --2- 172.21.15.55:0/3240173493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e00d1290 0x7ff2e015b5b0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000e870 tx=0x7ff2d000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:45.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2d6ffd640 1 -- 172.21.15.55:0/3240173493 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00095d0 con 0x7ff2e00d1290 2023-08-25T05:37:45.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2d6ffd640 1 -- 172.21.15.55:0/3240173493 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d000c940 con 0x7ff2e00d1290 2023-08-25T05:37:45.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2e48d8640 1 -- 172.21.15.55:0/3240173493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e00ce7c0 con 0x7ff2e00d1290 2023-08-25T05:37:45.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2d6ffd640 1 -- 172.21.15.55:0/3240173493 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d000ccb0 con 0x7ff2e00d1290 2023-08-25T05:37:45.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2e48d8640 1 -- 172.21.15.55:0/3240173493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e015adb0 con 0x7ff2e00d1290 2023-08-25T05:37:45.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.379+0000 7ff2e48d8640 1 -- 172.21.15.55:0/3240173493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e0073ec0 con 0x7ff2e00d1290 2023-08-25T05:37:45.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.383+0000 7ff2d6ffd640 1 -- 172.21.15.55:0/3240173493 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 121) v1 ==== 85065+0+0 (secure 0 0 0) 0x7ff2d0013470 con 0x7ff2e00d1290 2023-08-25T05:37:45.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.383+0000 7ff2d6ffd640 1 --2- 172.21.15.55:0/3240173493 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7ff2c00657a0 0x7ff2c0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:45.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.383+0000 7ff2d7fff640 1 -- 172.21.15.55:0/3240173493 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7ff2c00657a0 msgr2=0x7ff2c0067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4020115519 2023-08-25T05:37:45.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.383+0000 7ff2d6ffd640 1 -- 172.21.15.55:0/3240173493 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6406+0+0 (secure 0 0 0) 0x7ff2d00836c0 con 0x7ff2e00d1290 2023-08-25T05:37:45.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.383+0000 7ff2d7fff640 1 --2- 172.21.15.55:0/3240173493 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7ff2c00657a0 0x7ff2c0067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:45.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.387+0000 7ff2d6ffd640 1 -- 172.21.15.55:0/3240173493 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff2d00549c0 con 0x7ff2e00d1290 2023-08-25T05:37:45.523 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:45.521+0000 7fb26ea47180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:37:45.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.543+0000 7ff2e48d8640 1 -- 172.21.15.55:0/3240173493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff2e00714d0 con 0x7ff2e00d1290 2023-08-25T05:37:45.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.547+0000 7ff2d6ffd640 1 -- 172.21.15.55:0/3240173493 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v203) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff2d0054550 con 0x7ff2e00d1290 2023-08-25T05:37:45.548 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T05:37:45.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.547+0000 7ff2e48d8640 1 -- 172.21.15.55:0/3240173493 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7ff2c00657a0 msgr2=0x7ff2c0067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:45.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.547+0000 7ff2e48d8640 1 --2- 172.21.15.55:0/3240173493 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7ff2c00657a0 0x7ff2c0067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.547+0000 7ff2e48d8640 1 -- 172.21.15.55:0/3240173493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e00d1290 msgr2=0x7ff2e015b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:45.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.547+0000 7ff2e48d8640 1 --2- 172.21.15.55:0/3240173493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e00d1290 0x7ff2e015b5b0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000e870 tx=0x7ff2d000ed30 comp rx=0 tx=0).stop 2023-08-25T05:37:45.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.547+0000 7ff2e48d8640 1 -- 172.21.15.55:0/3240173493 shutdown_connections 2023-08-25T05:37:45.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.547+0000 7ff2e48d8640 1 --2- 172.21.15.55:0/3240173493 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7ff2c00657a0 0x7ff2c0067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.547+0000 7ff2e48d8640 1 --2- 172.21.15.55:0/3240173493 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff2e01601f0 0x7ff2e01587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.547+0000 7ff2e48d8640 1 --2- 172.21.15.55:0/3240173493 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff2e015e3c0 0x7ff2e00c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.547+0000 7ff2e48d8640 1 --2- 172.21.15.55:0/3240173493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2e00d1290 0x7ff2e015b5b0 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.547+0000 7ff2e48d8640 1 -- 172.21.15.55:0/3240173493 >> 172.21.15.55:0/3240173493 conn(0x7ff2e00d27d0 msgr2=0x7ff2e00b5910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:45.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.547+0000 7ff2e48d8640 1 -- 172.21.15.55:0/3240173493 shutdown_connections 2023-08-25T05:37:45.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.547+0000 7ff2e48d8640 1 -- 172.21.15.55:0/3240173493 wait complete. 2023-08-25T05:37:45.570 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T05:37:45.582 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:45.577+0000 7fb26ea47180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:37:45.605 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:45.603+0000 7f5967148180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-25T05:37:45.637 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:45.633+0000 7fb26ea47180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:37:45.668 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:45.667+0000 7f5967148180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-25T05:37:45.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.715+0000 7f5ef71ba640 1 Processor -- start 2023-08-25T05:37:45.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.715+0000 7f5ef71ba640 1 -- start start 2023-08-25T05:37:45.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.719+0000 7f5ef71ba640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5ef015e3c0 0x7f5ef015d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:45.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.719+0000 7f5ef71ba640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef00cd5a0 con 0x7f5ef00d1290 2023-08-25T05:37:45.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.719+0000 7f5ef71ba640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef00cd880 con 0x7f5ef01601f0 2023-08-25T05:37:45.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.719+0000 7f5ef71ba640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef00cdb60 con 0x7f5ef015e3c0 2023-08-25T05:37:45.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.719+0000 7f5ef5757640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5ef00d1290 0x7f5ef015e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42952/0 (socket says 172.21.15.55:42952) 2023-08-25T05:37:45.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.719+0000 7f5ef5757640 1 -- 172.21.15.55:0/2058993807 learned_addr learned my addr 172.21.15.55:0/2058993807 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:45.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.719+0000 7f5eeffff640 1 --2- 172.21.15.55:0/2058993807 >> v2:172.21.15.110:3300/0 conn(0x7f5ef015e3c0 0x7f5ef015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:45.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.719+0000 7f5eef7fe640 1 -- 172.21.15.55:0/2058993807 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028883971 0 0) 0x7f5ef00cd5a0 con 0x7f5ef00d1290 2023-08-25T05:37:45.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.719+0000 7f5eef7fe640 1 -- 172.21.15.55:0/2058993807 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ee0003530 con 0x7f5ef00d1290 2023-08-25T05:37:45.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.719+0000 7f5eeffff640 1 -- 172.21.15.55:0/2058993807 >> v1:172.21.15.110:6789/0 conn(0x7f5ef01601f0 legacy=0x7f5ef00d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:45.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.719+0000 7f5eeffff640 1 -- 172.21.15.55:0/2058993807 >> v1:172.21.15.55:6789/0 conn(0x7f5ef00d1290 legacy=0x7f5ef015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:45.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.719+0000 7f5eeffff640 1 -- 172.21.15.55:0/2058993807 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef00cde40 con 0x7f5ef015e3c0 2023-08-25T05:37:45.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.719+0000 7f5eeffff640 1 --2- 172.21.15.55:0/2058993807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ef015e3c0 0x7f5ef015d430 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0097c0 tx=0x7f5edc01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=246152bb517843ab server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:45.723 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:45.717+0000 7fb26ea47180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:37:45.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.723+0000 7f5eef7fe640 1 -- 172.21.15.55:0/2058993807 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0ab600 con 0x7f5ef015e3c0 2023-08-25T05:37:45.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.723+0000 7f5eef7fe640 1 -- 172.21.15.55:0/2058993807 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc0a7050 con 0x7f5ef015e3c0 2023-08-25T05:37:45.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.723+0000 7f5eef7fe640 1 -- 172.21.15.55:0/2058993807 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc0ab960 con 0x7f5ef015e3c0 2023-08-25T05:37:45.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.723+0000 7f5ef71ba640 1 -- 172.21.15.55:0/2058993807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ef015e3c0 msgr2=0x7f5ef015d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:45.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.723+0000 7f5ef71ba640 1 --2- 172.21.15.55:0/2058993807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ef015e3c0 0x7f5ef015d430 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f5edc0097c0 tx=0x7f5edc01c450 comp rx=0 tx=0).stop 2023-08-25T05:37:45.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.723+0000 7f5ef71ba640 1 -- 172.21.15.55:0/2058993807 shutdown_connections 2023-08-25T05:37:45.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.723+0000 7f5ef71ba640 1 --2- 172.21.15.55:0/2058993807 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ef015e3c0 0x7f5ef015d430 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.723+0000 7f5ef71ba640 1 -- 172.21.15.55:0/2058993807 >> 172.21.15.55:0/2058993807 conn(0x7f5ef00d27d0 msgr2=0x7f5ef00d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:45.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.723+0000 7f5ef71ba640 1 -- 172.21.15.55:0/2058993807 shutdown_connections 2023-08-25T05:37:45.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.723+0000 7f5ef71ba640 1 -- 172.21.15.55:0/2058993807 wait complete. 2023-08-25T05:37:45.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.723+0000 7f5ef71ba640 1 Processor -- start 2023-08-25T05:37:45.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.723+0000 7f5ef71ba640 1 -- start start 2023-08-25T05:37:45.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.723+0000 7f5ef71ba640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ef00d1290 0x7f5ef00b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:45.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.723+0000 7f5ef71ba640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ef015e3c0 0x7f5ef00af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:45.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.723+0000 7f5ef71ba640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ef01601f0 0x7f5ef00afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:45.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.723+0000 7f5ef71ba640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef00b0060 con 0x7f5ef00d1290 2023-08-25T05:37:45.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.723+0000 7f5ef71ba640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef00cc550 con 0x7f5ef01601f0 2023-08-25T05:37:45.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.723+0000 7f5ef71ba640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef0157b70 con 0x7f5ef015e3c0 2023-08-25T05:37:45.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5ef4f56640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ef00d1290 0x7f5ef00b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:45.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5ef4f56640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ef00d1290 0x7f5ef00b2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41392/0 (socket says 172.21.15.55:41392) 2023-08-25T05:37:45.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5ef4f56640 1 -- 172.21.15.55:0/445713912 learned_addr learned my addr 172.21.15.55:0/445713912 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:45.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5ef5757640 1 --2- 172.21.15.55:0/445713912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ef01601f0 0x7f5ef00afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:45.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5eeffff640 1 --2- 172.21.15.55:0/445713912 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ef015e3c0 0x7f5ef00af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:45.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5ef4f56640 1 -- 172.21.15.55:0/445713912 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ef015e3c0 msgr2=0x7f5ef00af5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:45.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5ef4f56640 1 --2- 172.21.15.55:0/445713912 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ef015e3c0 0x7f5ef00af5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5ef4f56640 1 -- 172.21.15.55:0/445713912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ef01601f0 msgr2=0x7f5ef00afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:45.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5ef4f56640 1 --2- 172.21.15.55:0/445713912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ef01601f0 0x7f5ef00afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5ef4f56640 1 -- 172.21.15.55:0/445713912 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc009420 con 0x7f5ef00d1290 2023-08-25T05:37:45.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5ef4f56640 1 --2- 172.21.15.55:0/445713912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ef00d1290 0x7f5ef00b2f40 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400c3c0 tx=0x7f5ee400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:45.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5eed7fa640 1 -- 172.21.15.55:0/445713912 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee40052d0 con 0x7f5ef00d1290 2023-08-25T05:37:45.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5eed7fa640 1 -- 172.21.15.55:0/445713912 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee4005470 con 0x7f5ef00d1290 2023-08-25T05:37:45.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5eed7fa640 1 -- 172.21.15.55:0/445713912 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4006a70 con 0x7f5ef00d1290 2023-08-25T05:37:45.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5ef71ba640 1 -- 172.21.15.55:0/445713912 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef00cbe90 con 0x7f5ef00d1290 2023-08-25T05:37:45.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5ef71ba640 1 -- 172.21.15.55:0/445713912 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef009c400 con 0x7f5ef00d1290 2023-08-25T05:37:45.731 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5967148180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-25T05:37:45.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5ef71ba640 1 -- 172.21.15.55:0/445713912 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef00b5260 con 0x7f5ef00d1290 2023-08-25T05:37:45.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.727+0000 7f5eed7fa640 1 -- 172.21.15.55:0/445713912 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 121) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f5ee4006bd0 con 0x7f5ef00d1290 2023-08-25T05:37:45.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.731+0000 7f5eed7fa640 1 --2- 172.21.15.55:0/445713912 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f5ed40657a0 0x7f5ed4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:45.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.731+0000 7f5eed7fa640 1 -- 172.21.15.55:0/445713912 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f5ee4082350 con 0x7f5ef00d1290 2023-08-25T05:37:45.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.731+0000 7f5eeffff640 1 -- 172.21.15.55:0/445713912 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f5ed40657a0 msgr2=0x7f5ed4067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4020115519 2023-08-25T05:37:45.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.731+0000 7f5eeffff640 1 --2- 172.21.15.55:0/445713912 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f5ed40657a0 0x7f5ed4067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:45.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.735+0000 7f5eed7fa640 1 -- 172.21.15.55:0/445713912 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5ee404fce0 con 0x7f5ef00d1290 2023-08-25T05:37:45.781 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:45.777+0000 7fb26ea47180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:37:45.823 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:45.823+0000 7f5967148180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-25T05:37:45.866 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:45.861+0000 7fb26ea47180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:37:45.883 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:45.879+0000 7f5967148180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-25T05:37:45.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.891+0000 7f5ef71ba640 1 -- 172.21.15.55:0/445713912 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ef0073ec0 con 0x7f5ef00d1290 2023-08-25T05:37:45.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.895+0000 7f5eed7fa640 1 -- 172.21.15.55:0/445713912 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v203) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5ee4053300 con 0x7f5ef00d1290 2023-08-25T05:37:45.895 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T05:37:45.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.895+0000 7f5ef71ba640 1 -- 172.21.15.55:0/445713912 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f5ed40657a0 msgr2=0x7f5ed4067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:45.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.895+0000 7f5ef71ba640 1 --2- 172.21.15.55:0/445713912 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f5ed40657a0 0x7f5ed4067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.895+0000 7f5ef71ba640 1 -- 172.21.15.55:0/445713912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ef00d1290 msgr2=0x7f5ef00b2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:45.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.895+0000 7f5ef71ba640 1 --2- 172.21.15.55:0/445713912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ef00d1290 0x7f5ef00b2f40 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f5ee400c3c0 tx=0x7f5ee400c880 comp rx=0 tx=0).stop 2023-08-25T05:37:45.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.895+0000 7f5ef71ba640 1 -- 172.21.15.55:0/445713912 shutdown_connections 2023-08-25T05:37:45.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.895+0000 7f5ef71ba640 1 --2- 172.21.15.55:0/445713912 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f5ed40657a0 0x7f5ed4067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.895+0000 7f5ef71ba640 1 --2- 172.21.15.55:0/445713912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ef01601f0 0x7f5ef00afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.895+0000 7f5ef71ba640 1 --2- 172.21.15.55:0/445713912 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ef015e3c0 0x7f5ef00af5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.895+0000 7f5ef71ba640 1 --2- 172.21.15.55:0/445713912 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ef00d1290 0x7f5ef00b2f40 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:45.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.895+0000 7f5ef71ba640 1 -- 172.21.15.55:0/445713912 >> 172.21.15.55:0/445713912 conn(0x7f5ef00d27d0 msgr2=0x7f5ef00cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:45.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.895+0000 7f5ef71ba640 1 -- 172.21.15.55:0/445713912 shutdown_connections 2023-08-25T05:37:45.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:45.895+0000 7f5ef71ba640 1 -- 172.21.15.55:0/445713912 wait complete. 2023-08-25T05:37:45.917 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T05:37:45.922 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:45.917+0000 7fb26ea47180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:37:45.975 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:45.975+0000 7f5967148180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-25T05:37:46.035 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:46.035+0000 7f5967148180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-25T05:37:46.065 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:46.061+0000 7fb26ea47180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:37:46.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.103+0000 7f2558a5f640 1 Processor -- start 2023-08-25T05:37:46.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.107+0000 7f2558a5f640 1 -- start start 2023-08-25T05:37:46.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.107+0000 7f2558a5f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25541601f0 0x7f255415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:46.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.107+0000 7f2558a5f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f255415e3c0 0x7f25540d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:46.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.107+0000 7f2558a5f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25540d10c0 0x7f25540b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:46.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.107+0000 7f2558a5f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25540cd5a0 con 0x7f25541601f0 2023-08-25T05:37:46.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.107+0000 7f2558a5f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25540cd880 con 0x7f255415e3c0 2023-08-25T05:37:46.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.107+0000 7f2558a5f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25540cdb60 con 0x7f25540d10c0 2023-08-25T05:37:46.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.107+0000 7f255259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25541601f0 0x7f255415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:46.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.107+0000 7f255259c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25541601f0 0x7f255415d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41396/0 (socket says 172.21.15.55:41396) 2023-08-25T05:37:46.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.107+0000 7f255259c640 1 -- 172.21.15.55:0/4073469304 learned_addr learned my addr 172.21.15.55:0/4073469304 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:46.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.107+0000 7f254bfff640 1 --2- 172.21.15.55:0/4073469304 >> v2:172.21.15.110:3300/0 conn(0x7f255415e3c0 0x7f25540d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:46.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.107+0000 7f2552d9d640 1 --2- 172.21.15.55:0/4073469304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25540d10c0 0x7f25540b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:46.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.107+0000 7f255259c640 1 -- 172.21.15.55:0/4073469304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25540d10c0 msgr2=0x7f25540b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:46.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.107+0000 7f255259c640 1 --2- 172.21.15.55:0/4073469304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25540d10c0 0x7f25540b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.107+0000 7f255259c640 1 -- 172.21.15.55:0/4073469304 >> v2:172.21.15.110:3300/0 conn(0x7f255415e3c0 msgr2=0x7f25540d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:46.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.107+0000 7f255259c640 1 --2- 172.21.15.55:0/4073469304 >> v2:172.21.15.110:3300/0 conn(0x7f255415e3c0 0x7f25540d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.111 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.107+0000 7f255259c640 1 -- 172.21.15.55:0/4073469304 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25540cde40 con 0x7f25541601f0 2023-08-25T05:37:46.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.111+0000 7f255259c640 1 --2- 172.21.15.55:0/4073469304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25541601f0 0x7f255415d430 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f25540cd350 tx=0x7f254401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1819fd20480e73 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:46.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.111+0000 7f2551d9b640 1 -- 172.21.15.55:0/4073469304 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25440a89b0 con 0x7f25541601f0 2023-08-25T05:37:46.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.111+0000 7f2551d9b640 1 -- 172.21.15.55:0/4073469304 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25440a8b10 con 0x7f25541601f0 2023-08-25T05:37:46.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.111+0000 7f2551d9b640 1 -- 172.21.15.55:0/4073469304 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25440a8ea0 con 0x7f25541601f0 2023-08-25T05:37:46.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.111+0000 7f2558a5f640 1 -- 172.21.15.55:0/4073469304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25541601f0 msgr2=0x7f255415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:46.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.111+0000 7f2558a5f640 1 --2- 172.21.15.55:0/4073469304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25541601f0 0x7f255415d430 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f25540cd350 tx=0x7f254401ecf0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.111+0000 7f2558a5f640 1 -- 172.21.15.55:0/4073469304 shutdown_connections 2023-08-25T05:37:46.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.111+0000 7f2558a5f640 1 --2- 172.21.15.55:0/4073469304 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f25540d10c0 0x7f25540b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.111+0000 7f2558a5f640 1 --2- 172.21.15.55:0/4073469304 >> v2:172.21.15.110:3300/0 conn(0x7f255415e3c0 0x7f25540d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.111+0000 7f2558a5f640 1 --2- 172.21.15.55:0/4073469304 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25541601f0 0x7f255415d430 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.111+0000 7f2558a5f640 1 -- 172.21.15.55:0/4073469304 >> 172.21.15.55:0/4073469304 conn(0x7f25540d27d0 msgr2=0x7f25540d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:46.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.111+0000 7f2558a5f640 1 -- 172.21.15.55:0/4073469304 shutdown_connections 2023-08-25T05:37:46.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.111+0000 7f2558a5f640 1 -- 172.21.15.55:0/4073469304 wait complete. 2023-08-25T05:37:46.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f2558a5f640 1 Processor -- start 2023-08-25T05:37:46.115 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f2558a5f640 1 -- start start 2023-08-25T05:37:46.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f2558a5f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25540d10c0 0x7f255415ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:46.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f2558a5f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f255415e3c0 0x7f25540cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:46.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f2558a5f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25541601f0 0x7f25540c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:46.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f2558a5f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255415b220 con 0x7f25540d10c0 2023-08-25T05:37:46.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f2558a5f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25540c71d0 con 0x7f25541601f0 2023-08-25T05:37:46.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f2558a5f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25540c74b0 con 0x7f255415e3c0 2023-08-25T05:37:46.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f255259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25540d10c0 0x7f255415ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:46.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f255259c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25540d10c0 0x7f255415ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41406/0 (socket says 172.21.15.55:41406) 2023-08-25T05:37:46.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f255259c640 1 -- 172.21.15.55:0/1683290368 learned_addr learned my addr 172.21.15.55:0/1683290368 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:46.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f2552d9d640 1 --2- 172.21.15.55:0/1683290368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25541601f0 0x7f25540c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:46.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f254bfff640 1 --2- 172.21.15.55:0/1683290368 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f255415e3c0 0x7f25540cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:46.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f255259c640 1 -- 172.21.15.55:0/1683290368 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f255415e3c0 msgr2=0x7f25540cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:46.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f255259c640 1 --2- 172.21.15.55:0/1683290368 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f255415e3c0 0x7f25540cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f255259c640 1 -- 172.21.15.55:0/1683290368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25541601f0 msgr2=0x7f25540c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:46.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f255259c640 1 --2- 172.21.15.55:0/1683290368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25541601f0 0x7f25540c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f255259c640 1 -- 172.21.15.55:0/1683290368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2544009480 con 0x7f25540d10c0 2023-08-25T05:37:46.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f255259c640 1 --2- 172.21.15.55:0/1683290368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25540d10c0 0x7f255415ace0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f254401f590 tx=0x7f254401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:46.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f254affd640 1 -- 172.21.15.55:0/1683290368 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544003820 con 0x7f25540d10c0 2023-08-25T05:37:46.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f254affd640 1 -- 172.21.15.55:0/1683290368 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2544003980 con 0x7f25540d10c0 2023-08-25T05:37:46.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f2558a5f640 1 -- 172.21.15.55:0/1683290368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25540ce7c0 con 0x7f25540d10c0 2023-08-25T05:37:46.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f254affd640 1 -- 172.21.15.55:0/1683290368 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544003cf0 con 0x7f25540d10c0 2023-08-25T05:37:46.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.115+0000 7f2558a5f640 1 -- 172.21.15.55:0/1683290368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25540c7a70 con 0x7f25540d10c0 2023-08-25T05:37:46.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.119+0000 7f2558a5f640 1 -- 172.21.15.55:0/1683290368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25540b5260 con 0x7f25540d10c0 2023-08-25T05:37:46.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.119+0000 7f254affd640 1 -- 172.21.15.55:0/1683290368 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 121) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f25440b7070 con 0x7f25540d10c0 2023-08-25T05:37:46.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.119+0000 7f254affd640 1 --2- 172.21.15.55:0/1683290368 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f25340657a0 0x7f2534067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:46.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.119+0000 7f254affd640 1 -- 172.21.15.55:0/1683290368 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f2544120250 con 0x7f25540d10c0 2023-08-25T05:37:46.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.119+0000 7f254bfff640 1 -- 172.21.15.55:0/1683290368 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f25340657a0 msgr2=0x7f2534067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4020115519 2023-08-25T05:37:46.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.119+0000 7f254bfff640 1 --2- 172.21.15.55:0/1683290368 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f25340657a0 0x7f2534067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:46.125 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:46.121+0000 7fb26ea47180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:37:46.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.127+0000 7f254affd640 1 -- 172.21.15.55:0/1683290368 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f25440edab0 con 0x7f25540d10c0 2023-08-25T05:37:46.194 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:46.191+0000 7f5967148180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-25T05:37:46.256 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:46.255+0000 7f5967148180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-25T05:37:46.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.283+0000 7f2558a5f640 1 -- 172.21.15.55:0/1683290368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2554073ec0 con 0x7f25540d10c0 2023-08-25T05:37:46.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.283+0000 7f254affd640 1 -- 172.21.15.55:0/1683290368 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v203) v1 ==== 100+0+11 (secure 0 0 0) 0x7f25440f10d0 con 0x7f25540d10c0 2023-08-25T05:37:46.287 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T05:37:46.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.287+0000 7f2558a5f640 1 -- 172.21.15.55:0/1683290368 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f25340657a0 msgr2=0x7f2534067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:46.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.287+0000 7f2558a5f640 1 --2- 172.21.15.55:0/1683290368 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f25340657a0 0x7f2534067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.287+0000 7f2558a5f640 1 -- 172.21.15.55:0/1683290368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25540d10c0 msgr2=0x7f255415ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:46.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.287+0000 7f2558a5f640 1 --2- 172.21.15.55:0/1683290368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25540d10c0 0x7f255415ace0 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7f254401f590 tx=0x7f254401ba90 comp rx=0 tx=0).stop 2023-08-25T05:37:46.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.287+0000 7f2558a5f640 1 -- 172.21.15.55:0/1683290368 shutdown_connections 2023-08-25T05:37:46.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.287+0000 7f2558a5f640 1 --2- 172.21.15.55:0/1683290368 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f25340657a0 0x7f2534067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.287+0000 7f2558a5f640 1 --2- 172.21.15.55:0/1683290368 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f25541601f0 0x7f25540c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.287+0000 7f2558a5f640 1 --2- 172.21.15.55:0/1683290368 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f255415e3c0 0x7f25540cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.287+0000 7f2558a5f640 1 --2- 172.21.15.55:0/1683290368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25540d10c0 0x7f255415ace0 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.287+0000 7f2558a5f640 1 -- 172.21.15.55:0/1683290368 >> 172.21.15.55:0/1683290368 conn(0x7f25540d27d0 msgr2=0x7f255406c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:46.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.287+0000 7f2558a5f640 1 -- 172.21.15.55:0/1683290368 shutdown_connections 2023-08-25T05:37:46.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.287+0000 7f2558a5f640 1 -- 172.21.15.55:0/1683290368 wait complete. 2023-08-25T05:37:46.310 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-25T05:37:46.364 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:37:46.365 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:37:46.365 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:37:46.373 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:46.369+0000 7fb26ea47180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:37:46.508 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:46.505+0000 7fb26ea47180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:37:46.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.527+0000 7fabcde93640 1 Processor -- start 2023-08-25T05:37:46.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.527+0000 7fabcde93640 1 -- start start 2023-08-25T05:37:46.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.531+0000 7fabcde93640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabc80cdde0 0x7fabc80ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:46.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.531+0000 7fabcde93640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fabc80b2e40 0x7fabc80b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:46.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.531+0000 7fabcde93640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc80b29b0 con 0x7fabc80d0da0 2023-08-25T05:37:46.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.531+0000 7fabcde93640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc80ce760 con 0x7fabc80b2e40 2023-08-25T05:37:46.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.531+0000 7fabcde93640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80b1dc0 con 0x7fabc80cdde0 2023-08-25T05:37:46.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.531+0000 7fabc7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fabc80b2e40 0x7fabc80b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:46.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.531+0000 7fabc77fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fabc80d0da0 0x7fabc80d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42968/0 (socket says 172.21.15.55:42968) 2023-08-25T05:37:46.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.531+0000 7fabc77fe640 1 -- 172.21.15.55:0/4184278479 learned_addr learned my addr 172.21.15.55:0/4184278479 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:46.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.531+0000 7fabc6ffd640 1 --2- 172.21.15.55:0/4184278479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabc80cdde0 0x7fabc80ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:46.533 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-08-25T05:37:46.533 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-08-25T05:37:46.533 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2023-08-25T05:37:46.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.531+0000 7fabc7fff640 1 -- 172.21.15.55:0/4184278479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabc80cdde0 msgr2=0x7fabc80ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:46.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.531+0000 7fabc7fff640 1 --2- 172.21.15.55:0/4184278479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabc80cdde0 0x7fabc80ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.531+0000 7fabc7fff640 1 -- 172.21.15.55:0/4184278479 >> v1:172.21.15.55:6789/0 conn(0x7fabc80d0da0 legacy=0x7fabc80d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:46.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.531+0000 7fabc7fff640 1 -- 172.21.15.55:0/4184278479 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc80b2080 con 0x7fabc80b2e40 2023-08-25T05:37:46.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.531+0000 7fabc7fff640 1 --2- 172.21.15.55:0/4184278479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabc80b2e40 0x7fabc80b32d0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009d90 tx=0x7fabc001f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd80e9c85f213d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:46.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.531+0000 7fabc67fc640 1 -- 172.21.15.55:0/4184278479 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc00af600 con 0x7fabc80b2e40 2023-08-25T05:37:46.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.531+0000 7fabc67fc640 1 -- 172.21.15.55:0/4184278479 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc00ab050 con 0x7fabc80b2e40 2023-08-25T05:37:46.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.531+0000 7fabc67fc640 1 -- 172.21.15.55:0/4184278479 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc00af980 con 0x7fabc80b2e40 2023-08-25T05:37:46.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.535+0000 7fabcde93640 1 -- 172.21.15.55:0/4184278479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabc80b2e40 msgr2=0x7fabc80b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:46.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.535+0000 7fabcde93640 1 --2- 172.21.15.55:0/4184278479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabc80b2e40 0x7fabc80b32d0 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009d90 tx=0x7fabc001f130 comp rx=0 tx=0).stop 2023-08-25T05:37:46.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.535+0000 7fabcde93640 1 -- 172.21.15.55:0/4184278479 shutdown_connections 2023-08-25T05:37:46.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.535+0000 7fabcde93640 1 --2- 172.21.15.55:0/4184278479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabc80cdde0 0x7fabc80ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.535+0000 7fabcde93640 1 --2- 172.21.15.55:0/4184278479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabc80b2e40 0x7fabc80b32d0 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.535+0000 7fabcde93640 1 -- 172.21.15.55:0/4184278479 >> 172.21.15.55:0/4184278479 conn(0x7fabc809bae0 msgr2=0x7fabc80d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:46.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.535+0000 7fabcde93640 1 -- 172.21.15.55:0/4184278479 shutdown_connections 2023-08-25T05:37:46.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.535+0000 7fabcde93640 1 -- 172.21.15.55:0/4184278479 wait complete. 2023-08-25T05:37:46.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.535+0000 7fabcde93640 1 Processor -- start 2023-08-25T05:37:46.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.535+0000 7fabcde93640 1 -- start start 2023-08-25T05:37:46.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.535+0000 7fabcde93640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabc80b2e40 0x7fabc814f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:46.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.535+0000 7fabcde93640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabc80cdde0 0x7fabc81f6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:46.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.535+0000 7fabcde93640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabc80d0da0 0x7fabc80c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:46.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.535+0000 7fabcde93640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc81f67a0 con 0x7fabc80b2e40 2023-08-25T05:37:46.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.535+0000 7fabcde93640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80c8580 con 0x7fabc80d0da0 2023-08-25T05:37:46.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.535+0000 7fabcde93640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc80b7c80 con 0x7fabc80cdde0 2023-08-25T05:37:46.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.539+0000 7fabc77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabc80b2e40 0x7fabc814f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:46.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.539+0000 7fabc77fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabc80b2e40 0x7fabc814f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41432/0 (socket says 172.21.15.55:41432) 2023-08-25T05:37:46.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.539+0000 7fabc77fe640 1 -- 172.21.15.55:0/453708988 learned_addr learned my addr 172.21.15.55:0/453708988 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:46.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.539+0000 7fabc6ffd640 1 --2- 172.21.15.55:0/453708988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabc80cdde0 0x7fabc81f6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:46.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.539+0000 7fabc7fff640 1 --2- 172.21.15.55:0/453708988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabc80d0da0 0x7fabc80c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:46.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.539+0000 7fabc77fe640 1 -- 172.21.15.55:0/453708988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabc80cdde0 msgr2=0x7fabc81f6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:46.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.539+0000 7fabc77fe640 1 --2- 172.21.15.55:0/453708988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabc80cdde0 0x7fabc81f6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.539+0000 7fabc77fe640 1 -- 172.21.15.55:0/453708988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabc80d0da0 msgr2=0x7fabc80c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:46.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.539+0000 7fabc77fe640 1 --2- 172.21.15.55:0/453708988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabc80d0da0 0x7fabc80c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.539+0000 7fabc77fe640 1 -- 172.21.15.55:0/453708988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc0009a70 con 0x7fabc80b2e40 2023-08-25T05:37:46.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.539+0000 7fabc77fe640 1 --2- 172.21.15.55:0/453708988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabc80b2e40 0x7fabc814f570 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7fabb800c4d0 tx=0x7fabb800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:46.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.539+0000 7fabaffff640 1 -- 172.21.15.55:0/453708988 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8007480 con 0x7fabc80b2e40 2023-08-25T05:37:46.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.539+0000 7fabaffff640 1 -- 172.21.15.55:0/453708988 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb80075e0 con 0x7fabc80b2e40 2023-08-25T05:37:46.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.539+0000 7fabcde93640 1 -- 172.21.15.55:0/453708988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc80b7f60 con 0x7fabc80b2e40 2023-08-25T05:37:46.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.539+0000 7fabaffff640 1 -- 172.21.15.55:0/453708988 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80059b0 con 0x7fabc80b2e40 2023-08-25T05:37:46.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.539+0000 7fabcde93640 1 -- 172.21.15.55:0/453708988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc814be70 con 0x7fabc80b2e40 2023-08-25T05:37:46.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.539+0000 7fabcde93640 1 -- 172.21.15.55:0/453708988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc80b8710 con 0x7fabc80b2e40 2023-08-25T05:37:46.543 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:46.539+0000 7f5967148180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-25T05:37:46.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.543+0000 7fabaffff640 1 -- 172.21.15.55:0/453708988 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 121) v1 ==== 85065+0+0 (secure 0 0 0) 0x7fabb8005b10 con 0x7fabc80b2e40 2023-08-25T05:37:46.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.543+0000 7fabaffff640 1 --2- 172.21.15.55:0/453708988 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7fabb40657a0 0x7fabb4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:46.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.543+0000 7fabaffff640 1 -- 172.21.15.55:0/453708988 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fabb8082610 con 0x7fabc80b2e40 2023-08-25T05:37:46.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.543+0000 7fabc6ffd640 1 -- 172.21.15.55:0/453708988 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7fabb40657a0 msgr2=0x7fabb4067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4020115519 2023-08-25T05:37:46.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.543+0000 7fabc6ffd640 1 --2- 172.21.15.55:0/453708988 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7fabb40657a0 0x7fabb4067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:46.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.547+0000 7fabaffff640 1 -- 172.21.15.55:0/453708988 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fabb804fe70 con 0x7fabc80b2e40 2023-08-25T05:37:46.635 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:46.633+0000 7fb26ea47180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:37:46.691 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:46.687+0000 7f5967148180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:37:46.706 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:46.701+0000 7fb26ea47180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:37:46.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.719+0000 7fabcde93640 1 -- 172.21.15.55:0/453708988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fabc814c060 con 0x7fabc80b2e40 2023-08-25T05:37:46.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.723+0000 7fabaffff640 1 -- 172.21.15.55:0/453708988 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v203) v1 ==== 80+0+474 (secure 0 0 0) 0x7fabb8053490 con 0x7fabc80b2e40 2023-08-25T05:37:46.723 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6833/3630541271 2023-08-26T05:37:41.077473+0000 2023-08-25T05:37:46.724 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:6832/3630541271 2023-08-26T05:37:41.077473+0000 2023-08-25T05:37:46.724 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/546735057 2023-08-26T05:37:41.077473+0000 2023-08-25T05:37:46.724 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/2235590334 2023-08-26T05:37:41.077473+0000 2023-08-25T05:37:46.724 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/1481231262 2023-08-26T05:37:41.077473+0000 2023-08-25T05:37:46.724 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/19806955 2023-08-26T05:37:41.077473+0000 2023-08-25T05:37:46.724 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/645754688 2023-08-26T05:37:41.077473+0000 2023-08-25T05:37:46.724 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.110:0/4203127837 2023-08-26T05:37:41.077473+0000 2023-08-25T05:37:46.725 INFO:teuthology.orchestra.run.smithi055.stderr:listed 8 entries 2023-08-25T05:37:46.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.723+0000 7fabcde93640 1 -- 172.21.15.55:0/453708988 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7fabb40657a0 msgr2=0x7fabb4067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:46.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.723+0000 7fabcde93640 1 --2- 172.21.15.55:0/453708988 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7fabb40657a0 0x7fabb4067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.723+0000 7fabcde93640 1 -- 172.21.15.55:0/453708988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabc80b2e40 msgr2=0x7fabc814f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:46.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.723+0000 7fabcde93640 1 --2- 172.21.15.55:0/453708988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabc80b2e40 0x7fabc814f570 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7fabb800c4d0 tx=0x7fabb800c990 comp rx=0 tx=0).stop 2023-08-25T05:37:46.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.723+0000 7fabcde93640 1 -- 172.21.15.55:0/453708988 shutdown_connections 2023-08-25T05:37:46.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.723+0000 7fabcde93640 1 --2- 172.21.15.55:0/453708988 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7fabb40657a0 0x7fabb4067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.723+0000 7fabcde93640 1 --2- 172.21.15.55:0/453708988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabc80d0da0 0x7fabc80c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.723+0000 7fabcde93640 1 --2- 172.21.15.55:0/453708988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabc80cdde0 0x7fabc81f6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.723+0000 7fabcde93640 1 --2- 172.21.15.55:0/453708988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fabc80b2e40 0x7fabc814f570 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:46.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.723+0000 7fabcde93640 1 -- 172.21.15.55:0/453708988 >> 172.21.15.55:0/453708988 conn(0x7fabc809bae0 msgr2=0x7fabc806b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:46.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.723+0000 7fabcde93640 1 -- 172.21.15.55:0/453708988 shutdown_connections 2023-08-25T05:37:46.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:46.723+0000 7fabcde93640 1 -- 172.21.15.55:0/453708988 wait complete. 2023-08-25T05:37:46.745 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-25T05:37:46.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:46.746 DEBUG:teuthology.orchestra.run.smithi055:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-25T05:37:46.799 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T05:37:46.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:46.800 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-25T05:37:46.809 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:37:46.809 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:46.818 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:37:46.818 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:37:46.819 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:46.825 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:46.823+0000 7f5967148180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-25T05:37:46.836 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T05:37:46.837 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:37:46.837 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:46.845 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:46.841+0000 7fb26ea47180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:37:46.853 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:37:46.854 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:37:46.900 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:46.899+0000 7f5967148180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-25T05:37:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.023+0000 7ffa609fa640 1 Processor -- start 2023-08-25T05:37:47.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.023+0000 7ffa609fa640 1 -- start start 2023-08-25T05:37:47.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.023+0000 7ffa609fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffa5c0d0da0 0x7ffa5c0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.023+0000 7ffa609fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa5c0cdde0 0x7ffa5c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.023+0000 7ffa609fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c0b29b0 con 0x7ffa5c0cee60 2023-08-25T05:37:47.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.023+0000 7ffa609fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5c0ce760 con 0x7ffa5c0d0da0 2023-08-25T05:37:47.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.023+0000 7ffa609fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0d16c0 con 0x7ffa5c0cdde0 2023-08-25T05:37:47.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.023+0000 7ffa5a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffa5c0d0da0 0x7ffa5c0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:47.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.023+0000 7ffa5a59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffa5c0d0da0 0x7ffa5c0d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41442/0 (socket says 172.21.15.55:41442) 2023-08-25T05:37:47.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.023+0000 7ffa5a59c640 1 -- 172.21.15.55:0/3591444744 learned_addr learned my addr 172.21.15.55:0/3591444744 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:47.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.023+0000 7ffa5ad9d640 1 --1- 172.21.15.55:0/3591444744 >> v1:172.21.15.55:6789/0 conn(0x7ffa5c0cee60 0x7ffa5c0cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42974/0 (socket says 172.21.15.55:42974) 2023-08-25T05:37:47.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.023+0000 7ffa51d9b640 1 --2- 172.21.15.55:0/3591444744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa5c0cdde0 0x7ffa5c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:47.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.023+0000 7ffa5a59c640 1 -- 172.21.15.55:0/3591444744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa5c0cdde0 msgr2=0x7ffa5c0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:47.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.023+0000 7ffa5a59c640 1 --2- 172.21.15.55:0/3591444744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa5c0cdde0 0x7ffa5c0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.023+0000 7ffa5a59c640 1 -- 172.21.15.55:0/3591444744 >> v1:172.21.15.55:6789/0 conn(0x7ffa5c0cee60 legacy=0x7ffa5c0cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:47.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.023+0000 7ffa5a59c640 1 -- 172.21.15.55:0/3591444744 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c0b1dc0 con 0x7ffa5c0d0da0 2023-08-25T05:37:47.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.023+0000 7ffa59d9b640 1 -- 172.21.15.55:0/3591444744 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046179058 0 0) 0x7ffa5c0b29b0 con 0x7ffa5c0cee60 2023-08-25T05:37:47.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.027+0000 7ffa5a59c640 1 --2- 172.21.15.55:0/3591444744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa5c0d0da0 0x7ffa5c0d1180 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c006fd0 tx=0x7ffa4c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c66b687a51a753a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:47.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.027+0000 7ffa59d9b640 1 -- 172.21.15.55:0/3591444744 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c0a8a10 con 0x7ffa5c0d0da0 2023-08-25T05:37:47.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.027+0000 7ffa59d9b640 1 -- 172.21.15.55:0/3591444744 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c0a8b70 con 0x7ffa5c0d0da0 2023-08-25T05:37:47.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.027+0000 7ffa59d9b640 1 -- 172.21.15.55:0/3591444744 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c0b0440 con 0x7ffa5c0d0da0 2023-08-25T05:37:47.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.027+0000 7ffa609fa640 1 -- 172.21.15.55:0/3591444744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa5c0d0da0 msgr2=0x7ffa5c0d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:47.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.027+0000 7ffa609fa640 1 --2- 172.21.15.55:0/3591444744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa5c0d0da0 0x7ffa5c0d1180 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c006fd0 tx=0x7ffa4c01ed10 comp rx=0 tx=0).stop 2023-08-25T05:37:47.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.027+0000 7ffa609fa640 1 -- 172.21.15.55:0/3591444744 shutdown_connections 2023-08-25T05:37:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.027+0000 7ffa609fa640 1 --2- 172.21.15.55:0/3591444744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa5c0cdde0 0x7ffa5c0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.027+0000 7ffa609fa640 1 --2- 172.21.15.55:0/3591444744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa5c0d0da0 0x7ffa5c0d1180 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.027+0000 7ffa609fa640 1 -- 172.21.15.55:0/3591444744 >> 172.21.15.55:0/3591444744 conn(0x7ffa5c09bae0 msgr2=0x7ffa5c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.027+0000 7ffa609fa640 1 -- 172.21.15.55:0/3591444744 shutdown_connections 2023-08-25T05:37:47.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.027+0000 7ffa609fa640 1 -- 172.21.15.55:0/3591444744 wait complete. 2023-08-25T05:37:47.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa609fa640 1 Processor -- start 2023-08-25T05:37:47.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa609fa640 1 -- start start 2023-08-25T05:37:47.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa609fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa5c0cdde0 0x7ffa5c0b7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa609fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa5c0cee60 0x7ffa5c0b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa609fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa5c0d0da0 0x7ffa5c0cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa609fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0b81e0 con 0x7ffa5c0cdde0 2023-08-25T05:37:47.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa609fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0b5c30 con 0x7ffa5c0d0da0 2023-08-25T05:37:47.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa609fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0b5f10 con 0x7ffa5c0cee60 2023-08-25T05:37:47.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa5a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa5c0cdde0 0x7ffa5c0b7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:47.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa5a59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa5c0cdde0 0x7ffa5c0b7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41446/0 (socket says 172.21.15.55:41446) 2023-08-25T05:37:47.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa5a59c640 1 -- 172.21.15.55:0/4254237264 learned_addr learned my addr 172.21.15.55:0/4254237264 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:47.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa51d9b640 1 --2- 172.21.15.55:0/4254237264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa5c0cee60 0x7ffa5c0b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:47.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa5ad9d640 1 --2- 172.21.15.55:0/4254237264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa5c0d0da0 0x7ffa5c0cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:47.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa5a59c640 1 -- 172.21.15.55:0/4254237264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa5c0cee60 msgr2=0x7ffa5c0b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:47.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa5a59c640 1 --2- 172.21.15.55:0/4254237264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa5c0cee60 0x7ffa5c0b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa5a59c640 1 -- 172.21.15.55:0/4254237264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa5c0d0da0 msgr2=0x7ffa5c0cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:47.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa5a59c640 1 --2- 172.21.15.55:0/4254237264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa5c0d0da0 0x7ffa5c0cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa5a59c640 1 -- 172.21.15.55:0/4254237264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c009480 con 0x7ffa5c0cdde0 2023-08-25T05:37:47.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa5a59c640 1 --2- 172.21.15.55:0/4254237264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa5c0cdde0 0x7ffa5c0b7ca0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c009930 tx=0x7ffa4c01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:47.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa537fe640 1 -- 172.21.15.55:0/4254237264 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c0be070 con 0x7ffa5c0cdde0 2023-08-25T05:37:47.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa537fe640 1 -- 172.21.15.55:0/4254237264 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c004030 con 0x7ffa5c0cdde0 2023-08-25T05:37:47.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa609fa640 1 -- 172.21.15.55:0/4254237264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5c0b61f0 con 0x7ffa5c0cdde0 2023-08-25T05:37:47.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa537fe640 1 -- 172.21.15.55:0/4254237264 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c0043a0 con 0x7ffa5c0cdde0 2023-08-25T05:37:47.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.031+0000 7ffa609fa640 1 -- 172.21.15.55:0/4254237264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5c0b67b0 con 0x7ffa5c0cdde0 2023-08-25T05:37:47.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.035+0000 7ffa609fa640 1 -- 172.21.15.55:0/4254237264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5c06c880 con 0x7ffa5c0cdde0 2023-08-25T05:37:47.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.035+0000 7ffa537fe640 1 -- 172.21.15.55:0/4254237264 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 121) v1 ==== 85065+0+0 (secure 0 0 0) 0x7ffa4c003620 con 0x7ffa5c0cdde0 2023-08-25T05:37:47.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.035+0000 7ffa537fe640 1 --2- 172.21.15.55:0/4254237264 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7ffa3c0657a0 0x7ffa3c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.035+0000 7ffa537fe640 1 -- 172.21.15.55:0/4254237264 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6406+0+0 (secure 0 0 0) 0x7ffa4c120850 con 0x7ffa5c0cdde0 2023-08-25T05:37:47.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.035+0000 7ffa51d9b640 1 -- 172.21.15.55:0/4254237264 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7ffa3c0657a0 msgr2=0x7ffa3c067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4020115519 2023-08-25T05:37:47.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.035+0000 7ffa51d9b640 1 --2- 172.21.15.55:0/4254237264 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7ffa3c0657a0 0x7ffa3c067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:47.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.043+0000 7ffa537fe640 1 -- 172.21.15.55:0/4254237264 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ffa4c0ee140 con 0x7ffa5c0cdde0 2023-08-25T05:37:47.052 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:47.051+0000 7f5967148180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-25T05:37:47.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.235+0000 7ffa609fa640 1 -- 172.21.15.55:0/4254237264 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa5c04dbe0 con 0x7ffa5c0cdde0 2023-08-25T05:37:47.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.235+0000 7ffa537fe640 1 -- 172.21.15.55:0/4254237264 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4891 (secure 0 0 0) 0x7ffa4c0f1760 con 0x7ffa5c0cdde0 2023-08-25T05:37:47.236 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:47.236 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":100,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/2330461418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2330461418},{"type":"v1","addr":"172.21.15.110:6836","nonce":2330461418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":9182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3918521245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3918521245},{"type":"v1","addr":"172.21.15.110:6837","nonce":3918521245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":11343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3205982255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3205982255},{"type":"v1","addr":"172.21.15.55:6834","nonce":3205982255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:37:23.923618+0000","modified":"2023-08-25T05:37:27.560216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":11349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11349":{"gid":11349,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3936252180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3936252180},{"type":"v1","addr":"172.21.15.55:6835","nonce":3936252180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-08-25T05:37:47.237 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 100 2023-08-25T05:37:47.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.235+0000 7ffa609fa640 1 -- 172.21.15.55:0/4254237264 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7ffa3c0657a0 msgr2=0x7ffa3c067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:47.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.235+0000 7ffa609fa640 1 --2- 172.21.15.55:0/4254237264 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7ffa3c0657a0 0x7ffa3c067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.235+0000 7ffa609fa640 1 -- 172.21.15.55:0/4254237264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa5c0cdde0 msgr2=0x7ffa5c0b7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:47.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.235+0000 7ffa609fa640 1 --2- 172.21.15.55:0/4254237264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa5c0cdde0 0x7ffa5c0b7ca0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c009930 tx=0x7ffa4c01bab0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.235+0000 7ffa609fa640 1 -- 172.21.15.55:0/4254237264 shutdown_connections 2023-08-25T05:37:47.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.235+0000 7ffa609fa640 1 --2- 172.21.15.55:0/4254237264 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7ffa3c0657a0 0x7ffa3c067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.235+0000 7ffa609fa640 1 --2- 172.21.15.55:0/4254237264 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa5c0d0da0 0x7ffa5c0cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.235+0000 7ffa609fa640 1 --2- 172.21.15.55:0/4254237264 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa5c0cee60 0x7ffa5c0b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.235+0000 7ffa609fa640 1 --2- 172.21.15.55:0/4254237264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa5c0cdde0 0x7ffa5c0b7ca0 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.235+0000 7ffa609fa640 1 -- 172.21.15.55:0/4254237264 >> 172.21.15.55:0/4254237264 conn(0x7ffa5c09bae0 msgr2=0x7ffa5c0cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:47.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.235+0000 7ffa609fa640 1 -- 172.21.15.55:0/4254237264 shutdown_connections 2023-08-25T05:37:47.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.235+0000 7ffa609fa640 1 -- 172.21.15.55:0/4254237264 wait complete. 2023-08-25T05:37:47.258 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:37:47.392 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:47.389+0000 7fb26ea47180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:37:47.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.443+0000 7f3d5b86d640 1 Processor -- start 2023-08-25T05:37:47.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.443+0000 7f3d5b86d640 1 -- start start 2023-08-25T05:37:47.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.443+0000 7f3d5b86d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d540d0da0 0x7f3d540d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.443+0000 7f3d5b86d640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3d540cdde0 0x7f3d540ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.443+0000 7f3d5b86d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d540cee60 0x7f3d540cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.443+0000 7f3d5b86d640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d540ce760 con 0x7f3d540cee60 2023-08-25T05:37:47.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.443+0000 7f3d5b86d640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d540b29b0 con 0x7f3d540cdde0 2023-08-25T05:37:47.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.443+0000 7f3d5b86d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d540d16c0 con 0x7f3d540d0da0 2023-08-25T05:37:47.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.443+0000 7f3d59e0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d540cee60 0x7f3d540cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:47.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.443+0000 7f3d59e0a640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d540cee60 0x7f3d540cf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41448/0 (socket says 172.21.15.55:41448) 2023-08-25T05:37:47.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.443+0000 7f3d59e0a640 1 -- 172.21.15.55:0/3813036308 learned_addr learned my addr 172.21.15.55:0/3813036308 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:47.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.443+0000 7f3d59609640 1 --2- 172.21.15.55:0/3813036308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d540d0da0 0x7f3d540d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:47.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.443+0000 7f3d58e08640 1 --2- 172.21.15.55:0/3813036308 >> v2:172.21.15.110:3300/0 conn(0x7f3d540cdde0 0x7f3d540ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:47.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.443+0000 7f3d59e0a640 1 -- 172.21.15.55:0/3813036308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d540d0da0 msgr2=0x7f3d540d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:47.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.443+0000 7f3d59e0a640 1 --2- 172.21.15.55:0/3813036308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d540d0da0 0x7f3d540d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.443+0000 7f3d59e0a640 1 -- 172.21.15.55:0/3813036308 >> v2:172.21.15.110:3300/0 conn(0x7f3d540cdde0 msgr2=0x7f3d540ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:47.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.443+0000 7f3d59e0a640 1 --2- 172.21.15.55:0/3813036308 >> v2:172.21.15.110:3300/0 conn(0x7f3d540cdde0 0x7f3d540ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.443+0000 7f3d59e0a640 1 -- 172.21.15.55:0/3813036308 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d540b1dc0 con 0x7f3d540cee60 2023-08-25T05:37:47.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.447+0000 7f3d59e0a640 1 --2- 172.21.15.55:0/3813036308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d540cee60 0x7f3d540cf2f0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f3d5409c210 tx=0x7f3d4c01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5f3f0150c74fdf server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:47.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.447+0000 7f3d4bfff640 1 -- 172.21.15.55:0/3813036308 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c0af400 con 0x7f3d540cee60 2023-08-25T05:37:47.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.447+0000 7f3d4bfff640 1 -- 172.21.15.55:0/3813036308 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c0ab050 con 0x7f3d540cee60 2023-08-25T05:37:47.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.447+0000 7f3d4bfff640 1 -- 172.21.15.55:0/3813036308 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c0af780 con 0x7f3d540cee60 2023-08-25T05:37:47.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.447+0000 7f3d5b86d640 1 -- 172.21.15.55:0/3813036308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d540cee60 msgr2=0x7f3d540cf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:47.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.447+0000 7f3d5b86d640 1 --2- 172.21.15.55:0/3813036308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d540cee60 0x7f3d540cf2f0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f3d5409c210 tx=0x7f3d4c01f1c0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.447+0000 7f3d5b86d640 1 -- 172.21.15.55:0/3813036308 shutdown_connections 2023-08-25T05:37:47.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.447+0000 7f3d5b86d640 1 --2- 172.21.15.55:0/3813036308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d540cee60 0x7f3d540cf2f0 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.447+0000 7f3d5b86d640 1 --2- 172.21.15.55:0/3813036308 >> v2:172.21.15.110:3300/0 conn(0x7f3d540cdde0 0x7f3d540ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.447+0000 7f3d5b86d640 1 --2- 172.21.15.55:0/3813036308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d540d0da0 0x7f3d540d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.447+0000 7f3d5b86d640 1 -- 172.21.15.55:0/3813036308 >> 172.21.15.55:0/3813036308 conn(0x7f3d5409bae0 msgr2=0x7f3d540d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:47.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.447+0000 7f3d5b86d640 1 -- 172.21.15.55:0/3813036308 shutdown_connections 2023-08-25T05:37:47.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.447+0000 7f3d5b86d640 1 -- 172.21.15.55:0/3813036308 wait complete. 2023-08-25T05:37:47.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d5b86d640 1 Processor -- start 2023-08-25T05:37:47.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d5b86d640 1 -- start start 2023-08-25T05:37:47.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d5b86d640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d540cdde0 0x7f3d541f1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d5b86d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d540cee60 0x7f3d540b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d5b86d640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d540d0da0 0x7f3d5406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d5b86d640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d540c62f0 con 0x7f3d540cee60 2023-08-25T05:37:47.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d5b86d640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d540c6e70 con 0x7f3d540cdde0 2023-08-25T05:37:47.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d5b86d640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d540c6540 con 0x7f3d540d0da0 2023-08-25T05:37:47.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d58e08640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d540cee60 0x7f3d540b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:47.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d58e08640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d540cee60 0x7f3d540b71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41458/0 (socket says 172.21.15.55:41458) 2023-08-25T05:37:47.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d58e08640 1 -- 172.21.15.55:0/788460413 learned_addr learned my addr 172.21.15.55:0/788460413 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:47.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d59609640 1 --2- 172.21.15.55:0/788460413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d540cdde0 0x7f3d541f1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:47.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d59e0a640 1 --2- 172.21.15.55:0/788460413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d540d0da0 0x7f3d5406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:47.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d58e08640 1 -- 172.21.15.55:0/788460413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d540d0da0 msgr2=0x7f3d5406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:47.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d58e08640 1 --2- 172.21.15.55:0/788460413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d540d0da0 0x7f3d5406bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d58e08640 1 -- 172.21.15.55:0/788460413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d540cdde0 msgr2=0x7f3d541f1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:47.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d58e08640 1 --2- 172.21.15.55:0/788460413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d540cdde0 0x7f3d541f1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d58e08640 1 -- 172.21.15.55:0/788460413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c009b30 con 0x7f3d540cee60 2023-08-25T05:37:47.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d59609640 1 --2- 172.21.15.55:0/788460413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d540cdde0 0x7f3d541f1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:47.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d58e08640 1 --2- 172.21.15.55:0/788460413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d540cee60 0x7f3d540b71e0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400e870 tx=0x7f3d4400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:47.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d49ffb640 1 -- 172.21.15.55:0/788460413 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400ee60 con 0x7f3d540cee60 2023-08-25T05:37:47.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d49ffb640 1 -- 172.21.15.55:0/788460413 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4400c940 con 0x7f3d540cee60 2023-08-25T05:37:47.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d5b86d640 1 -- 172.21.15.55:0/788460413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d540c6820 con 0x7f3d540cee60 2023-08-25T05:37:47.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.451+0000 7f3d49ffb640 1 -- 172.21.15.55:0/788460413 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400ccf0 con 0x7f3d540cee60 2023-08-25T05:37:47.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.455+0000 7f3d5b86d640 1 -- 172.21.15.55:0/788460413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d541f1fd0 con 0x7f3d540cee60 2023-08-25T05:37:47.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.455+0000 7f3d5b86d640 1 -- 172.21.15.55:0/788460413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d540c6fe0 con 0x7f3d540cee60 2023-08-25T05:37:47.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.455+0000 7f3d49ffb640 1 -- 172.21.15.55:0/788460413 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 121) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f3d44013470 con 0x7f3d540cee60 2023-08-25T05:37:47.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.455+0000 7f3d49ffb640 1 --2- 172.21.15.55:0/788460413 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f3d380657a0 0x7f3d38067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.455+0000 7f3d49ffb640 1 -- 172.21.15.55:0/788460413 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f3d44083070 con 0x7f3d540cee60 2023-08-25T05:37:47.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.455+0000 7f3d59609640 1 -- 172.21.15.55:0/788460413 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f3d380657a0 msgr2=0x7f3d38067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4020115519 2023-08-25T05:37:47.459 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.455+0000 7f3d59609640 1 --2- 172.21.15.55:0/788460413 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f3d380657a0 0x7f3d38067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:47.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.463+0000 7f3d49ffb640 1 -- 172.21.15.55:0/788460413 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3d44050a00 con 0x7f3d540cee60 2023-08-25T05:37:47.477 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:47.473+0000 7fb26ea47180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:37:47.629 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:47.625+0000 7fb26ea47180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:37:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.626+0000 7f3d5b86d640 1 -- 172.21.15.55:0/788460413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d5404dbe0 con 0x7f3d540cee60 2023-08-25T05:37:47.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.630+0000 7f3d49ffb640 1 -- 172.21.15.55:0/788460413 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v203) v1 ==== 74+0+18814 (secure 0 0 0) 0x7f3d44054020 con 0x7f3d540cee60 2023-08-25T05:37:47.632 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:47.632 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":203,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:37:41.077512+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:37:21.649130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-08-25T05:37:22.924825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6833/3630541271":"2023-08-26T05:37:41.077473+0000","172.21.15.110:6832/3630541271":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/546735057":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/2235590334":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/1481231262":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/19806955":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/645754688":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/4203127837":"2023-08-26T05:37:41.077473+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:37:47.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.630+0000 7f3d5b86d640 1 -- 172.21.15.55:0/788460413 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f3d380657a0 msgr2=0x7f3d38067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:47.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.630+0000 7f3d5b86d640 1 --2- 172.21.15.55:0/788460413 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f3d380657a0 0x7f3d38067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.630+0000 7f3d5b86d640 1 -- 172.21.15.55:0/788460413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d540cee60 msgr2=0x7f3d540b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:47.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.630+0000 7f3d5b86d640 1 --2- 172.21.15.55:0/788460413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d540cee60 0x7f3d540b71e0 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400e870 tx=0x7f3d4400ed30 comp rx=0 tx=0).stop 2023-08-25T05:37:47.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.630+0000 7f3d5b86d640 1 -- 172.21.15.55:0/788460413 shutdown_connections 2023-08-25T05:37:47.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.630+0000 7f3d5b86d640 1 --2- 172.21.15.55:0/788460413 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f3d380657a0 0x7f3d38067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.630+0000 7f3d5b86d640 1 --2- 172.21.15.55:0/788460413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d540d0da0 0x7f3d5406bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.630+0000 7f3d5b86d640 1 --2- 172.21.15.55:0/788460413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d540cee60 0x7f3d540b71e0 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.630+0000 7f3d5b86d640 1 --2- 172.21.15.55:0/788460413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d540cdde0 0x7f3d541f1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.630+0000 7f3d5b86d640 1 -- 172.21.15.55:0/788460413 >> 172.21.15.55:0/788460413 conn(0x7f3d5409bae0 msgr2=0x7f3d540b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:47.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.630+0000 7f3d5b86d640 1 -- 172.21.15.55:0/788460413 shutdown_connections 2023-08-25T05:37:47.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.630+0000 7f3d5b86d640 1 -- 172.21.15.55:0/788460413 wait complete. 2023-08-25T05:37:47.638 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:47.634+0000 7f5967148180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-25T05:37:47.655 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-25T04:02:46.661185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-25T04:02:54.201092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-25T05:37:21.649130+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '201', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2023-08-25T05:37:22.924825+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '202', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-25T05:37:47.656 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-25T05:37:47.712 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:47.709+0000 7fb26ea47180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:37:47.729 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:47.726+0000 7f5967148180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-25T05:37:47.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.802+0000 7f61e0b66640 1 Processor -- start 2023-08-25T05:37:47.803 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.802+0000 7f61e0b66640 1 -- start start 2023-08-25T05:37:47.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.802+0000 7f61e0b66640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f61dc1601f0 0x7f61dc15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.802+0000 7f61e0b66640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f61dc15e3c0 0x7f61dc0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.802+0000 7f61e0b66640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61dc15f8b0 con 0x7f61dc0d10c0 2023-08-25T05:37:47.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.802+0000 7f61e0b66640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61dc0cd5a0 con 0x7f61dc15e3c0 2023-08-25T05:37:47.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.802+0000 7f61e0b66640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61dc0cd880 con 0x7f61dc1601f0 2023-08-25T05:37:47.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.802+0000 7f61d9d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f61dc15e3c0 0x7f61dc0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:47.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.802+0000 7f61d9d9b640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f61dc15e3c0 0x7f61dc0d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41464/0 (socket says 172.21.15.55:41464) 2023-08-25T05:37:47.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.802+0000 7f61d9d9b640 1 -- 172.21.15.55:0/4114947170 learned_addr learned my addr 172.21.15.55:0/4114947170 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:47.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.802+0000 7f61da59c640 1 --2- 172.21.15.55:0/4114947170 >> v2:172.21.15.110:3300/0 conn(0x7f61dc1601f0 0x7f61dc15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:47.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.802+0000 7f61d9d9b640 1 -- 172.21.15.55:0/4114947170 >> v2:172.21.15.110:3300/0 conn(0x7f61dc1601f0 msgr2=0x7f61dc15d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:47.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.802+0000 7f61d9d9b640 1 --2- 172.21.15.55:0/4114947170 >> v2:172.21.15.110:3300/0 conn(0x7f61dc1601f0 0x7f61dc15d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.802+0000 7f61d9d9b640 1 -- 172.21.15.55:0/4114947170 >> v1:172.21.15.110:6789/0 conn(0x7f61dc0d10c0 legacy=0x7f61dc0b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:47.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.802+0000 7f61d9d9b640 1 -- 172.21.15.55:0/4114947170 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc0cdb60 con 0x7f61dc15e3c0 2023-08-25T05:37:47.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.806+0000 7f61d9d9b640 1 --2- 172.21.15.55:0/4114947170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61dc15e3c0 0x7f61dc0d0b80 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f61dc08b7f0 tx=0x7f61d001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6aedb5cc904e45 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:47.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.806+0000 7f61d959a640 1 -- 172.21.15.55:0/4114947170 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00ac640 con 0x7f61dc15e3c0 2023-08-25T05:37:47.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.806+0000 7f61d959a640 1 -- 172.21.15.55:0/4114947170 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d00ac7a0 con 0x7f61dc15e3c0 2023-08-25T05:37:47.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.806+0000 7f61d959a640 1 -- 172.21.15.55:0/4114947170 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00acb30 con 0x7f61dc15e3c0 2023-08-25T05:37:47.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.806+0000 7f61e0b66640 1 -- 172.21.15.55:0/4114947170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61dc15e3c0 msgr2=0x7f61dc0d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:47.809 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.806+0000 7f61e0b66640 1 --2- 172.21.15.55:0/4114947170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61dc15e3c0 0x7f61dc0d0b80 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f61dc08b7f0 tx=0x7f61d001c4d0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.806+0000 7f61e0b66640 1 -- 172.21.15.55:0/4114947170 shutdown_connections 2023-08-25T05:37:47.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.806+0000 7f61e0b66640 1 --2- 172.21.15.55:0/4114947170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61dc15e3c0 0x7f61dc0d0b80 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.806+0000 7f61e0b66640 1 --2- 172.21.15.55:0/4114947170 >> v2:172.21.15.110:3300/0 conn(0x7f61dc1601f0 0x7f61dc15d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.806+0000 7f61e0b66640 1 -- 172.21.15.55:0/4114947170 >> 172.21.15.55:0/4114947170 conn(0x7f61dc0d27d0 msgr2=0x7f61dc0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:47.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.806+0000 7f61e0b66640 1 -- 172.21.15.55:0/4114947170 shutdown_connections 2023-08-25T05:37:47.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.806+0000 7f61e0b66640 1 -- 172.21.15.55:0/4114947170 wait complete. 2023-08-25T05:37:47.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.810+0000 7f61e0b66640 1 Processor -- start 2023-08-25T05:37:47.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.810+0000 7f61e0b66640 1 -- start start 2023-08-25T05:37:47.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.810+0000 7f61e0b66640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61dc0d10c0 0x7f61dc0b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.810+0000 7f61e0b66640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61dc15e3c0 0x7f61dc0c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.810+0000 7f61e0b66640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61dc1601f0 0x7f61dc0b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.810+0000 7f61e0b66640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc0b5800 con 0x7f61dc0d10c0 2023-08-25T05:37:47.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.810+0000 7f61e0b66640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc0c8a20 con 0x7f61dc1601f0 2023-08-25T05:37:47.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.810+0000 7f61e0b66640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc0c8d00 con 0x7f61dc15e3c0 2023-08-25T05:37:47.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.810+0000 7f61da59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61dc0d10c0 0x7f61dc0b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:47.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.810+0000 7f61da59c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61dc0d10c0 0x7f61dc0b6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41472/0 (socket says 172.21.15.55:41472) 2023-08-25T05:37:47.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.810+0000 7f61da59c640 1 -- 172.21.15.55:0/4110612090 learned_addr learned my addr 172.21.15.55:0/4110612090 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:47.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.814+0000 7f61d9d9b640 1 --2- 172.21.15.55:0/4110612090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61dc15e3c0 0x7f61dc0c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:47.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.814+0000 7f61dad9d640 1 --2- 172.21.15.55:0/4110612090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61dc1601f0 0x7f61dc0b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:47.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.814+0000 7f61da59c640 1 -- 172.21.15.55:0/4110612090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61dc15e3c0 msgr2=0x7f61dc0c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:47.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.814+0000 7f61da59c640 1 --2- 172.21.15.55:0/4110612090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61dc15e3c0 0x7f61dc0c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.814+0000 7f61da59c640 1 -- 172.21.15.55:0/4110612090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61dc1601f0 msgr2=0x7f61dc0b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:47.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.814+0000 7f61da59c640 1 --2- 172.21.15.55:0/4110612090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61dc1601f0 0x7f61dc0b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.814+0000 7f61da59c640 1 -- 172.21.15.55:0/4110612090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d00094d0 con 0x7f61dc0d10c0 2023-08-25T05:37:47.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.814+0000 7f61d9d9b640 1 --2- 172.21.15.55:0/4110612090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61dc15e3c0 0x7f61dc0c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:47.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.814+0000 7f61dad9d640 1 --2- 172.21.15.55:0/4110612090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61dc1601f0 0x7f61dc0b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:47.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.814+0000 7f61da59c640 1 --2- 172.21.15.55:0/4110612090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61dc0d10c0 0x7f61dc0b6590 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f61cc00e870 tx=0x7f61cc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:47.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.814+0000 7f61caffd640 1 -- 172.21.15.55:0/4110612090 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0095d0 con 0x7f61dc0d10c0 2023-08-25T05:37:47.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.814+0000 7f61caffd640 1 -- 172.21.15.55:0/4110612090 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc00c940 con 0x7f61dc0d10c0 2023-08-25T05:37:47.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.814+0000 7f61caffd640 1 -- 172.21.15.55:0/4110612090 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc00ccb0 con 0x7f61dc0d10c0 2023-08-25T05:37:47.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.814+0000 7f61e0b66640 1 -- 172.21.15.55:0/4110612090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61dc0ce7c0 con 0x7f61dc0d10c0 2023-08-25T05:37:47.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.814+0000 7f61e0b66640 1 -- 172.21.15.55:0/4110612090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61dc0b5490 con 0x7f61dc0d10c0 2023-08-25T05:37:47.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.814+0000 7f61e0b66640 1 -- 172.21.15.55:0/4110612090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61dc073ec0 con 0x7f61dc0d10c0 2023-08-25T05:37:47.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.814+0000 7f61caffd640 1 -- 172.21.15.55:0/4110612090 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 121) v1 ==== 85065+0+0 (secure 0 0 0) 0x7f61cc013470 con 0x7f61dc0d10c0 2023-08-25T05:37:47.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.818+0000 7f61caffd640 1 --2- 172.21.15.55:0/4110612090 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f61bc0657a0 0x7f61bc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:47.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.818+0000 7f61caffd640 1 -- 172.21.15.55:0/4110612090 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f61cc0835d0 con 0x7f61dc0d10c0 2023-08-25T05:37:47.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.818+0000 7f61d9d9b640 1 -- 172.21.15.55:0/4110612090 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f61bc0657a0 msgr2=0x7f61bc067c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.110:6832/4020115519 2023-08-25T05:37:47.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.818+0000 7f61d9d9b640 1 --2- 172.21.15.55:0/4110612090 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f61bc0657a0 0x7f61bc067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-25T05:37:47.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.826+0000 7f61caffd640 1 -- 172.21.15.55:0/4110612090 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f61cc050f90 con 0x7f61dc0d10c0 2023-08-25T05:37:47.895 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:47.894+0000 7f5967148180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-25T05:37:47.910 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:37:47.913 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:37:47.984 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:47.982+0000 7f5967148180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-25T05:37:47.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.982+0000 7f61e0b66640 1 -- 172.21.15.55:0/4110612090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61dc0cefc0 con 0x7f61dc0d10c0 2023-08-25T05:37:47.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.982+0000 7f61caffd640 1 -- 172.21.15.55:0/4110612090 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v203) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61cc0545b0 con 0x7f61dc0d10c0 2023-08-25T05:37:47.986 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-08-25T05:37:47.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.986+0000 7f61e0b66640 1 -- 172.21.15.55:0/4110612090 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f61bc0657a0 msgr2=0x7f61bc067c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-25T05:37:47.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.986+0000 7f61e0b66640 1 --2- 172.21.15.55:0/4110612090 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f61bc0657a0 0x7f61bc067c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.986+0000 7f61e0b66640 1 -- 172.21.15.55:0/4110612090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61dc0d10c0 msgr2=0x7f61dc0b6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:47.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.986+0000 7f61e0b66640 1 --2- 172.21.15.55:0/4110612090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61dc0d10c0 0x7f61dc0b6590 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f61cc00e870 tx=0x7f61cc00ed30 comp rx=0 tx=0).stop 2023-08-25T05:37:47.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.986+0000 7f61e0b66640 1 -- 172.21.15.55:0/4110612090 shutdown_connections 2023-08-25T05:37:47.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.986+0000 7f61e0b66640 1 --2- 172.21.15.55:0/4110612090 >> [v2:172.21.15.110:6832/4020115519,v1:172.21.15.110:6833/4020115519] conn(0x7f61bc0657a0 0x7f61bc067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.986+0000 7f61e0b66640 1 --2- 172.21.15.55:0/4110612090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f61dc1601f0 0x7f61dc0b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.986+0000 7f61e0b66640 1 --2- 172.21.15.55:0/4110612090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f61dc15e3c0 0x7f61dc0c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.986+0000 7f61e0b66640 1 --2- 172.21.15.55:0/4110612090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61dc0d10c0 0x7f61dc0b6590 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:47.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.986+0000 7f61e0b66640 1 -- 172.21.15.55:0/4110612090 >> 172.21.15.55:0/4110612090 conn(0x7f61dc0d27d0 msgr2=0x7f61dc0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:47.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.986+0000 7f61e0b66640 1 -- 172.21.15.55:0/4110612090 shutdown_connections 2023-08-25T05:37:47.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:47.986+0000 7f61e0b66640 1 -- 172.21.15.55:0/4110612090 wait complete. 2023-08-25T05:37:48.008 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-25T05:37:48.032 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:48.029+0000 7fb26ea47180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:37:48.093 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:48.089+0000 7fb26ea47180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:37:48.167 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:48.161+0000 7fb1f755c640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:48.167 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:48.161+0000 7fb1f755c640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:48.167 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:48.161+0000 7fb1f755c640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:48.168 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:48.161+0000 7fb1f755c640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:48.168 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:48.161+0000 7fb1f755c640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:48.168 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:48.165+0000 7fb1fa562640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:48.168 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:48.165+0000 7fb1fa562640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:48.168 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:48.165+0000 7fb1fa562640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:48.169 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:48.165+0000 7fb1fa562640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:48.169 INFO:tasks.ceph.mgr.x.smithi110.stderr:2023-08-25T05:37:48.165+0000 7fb1fa562640 -1 client.0 error registering admin socket command: (17) File exists 2023-08-25T05:37:48.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.206+0000 7f55ee088640 1 Processor -- start 2023-08-25T05:37:48.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.206+0000 7f55ee088640 1 -- start start 2023-08-25T05:37:48.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.206+0000 7f55ee088640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55e81601f0 0x7f55e815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:48.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.206+0000 7f55ee088640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55e80d1290 0x7f55e815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:48.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.206+0000 7f55ee088640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e80cd5a0 con 0x7f55e815e3c0 2023-08-25T05:37:48.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.206+0000 7f55ee088640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e80cd880 con 0x7f55e80d1290 2023-08-25T05:37:48.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.206+0000 7f55ee088640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55e80cdb60 con 0x7f55e81601f0 2023-08-25T05:37:48.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.206+0000 7f55e7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55e80d1290 0x7f55e815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:48.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.206+0000 7f55e7fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f55e80d1290 0x7f55e815e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41476/0 (socket says 172.21.15.55:41476) 2023-08-25T05:37:48.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.206+0000 7f55e6ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f55e815e3c0 0x7f55e80d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42990/0 (socket says 172.21.15.55:42990) 2023-08-25T05:37:48.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.206+0000 7f55e7fff640 1 -- 172.21.15.55:0/2051566575 learned_addr learned my addr 172.21.15.55:0/2051566575 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:48.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.206+0000 7f55e77fe640 1 --2- 172.21.15.55:0/2051566575 >> v2:172.21.15.110:3300/0 conn(0x7f55e81601f0 0x7f55e815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:48.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.206+0000 7f55e7fff640 1 -- 172.21.15.55:0/2051566575 >> v2:172.21.15.110:3300/0 conn(0x7f55e81601f0 msgr2=0x7f55e815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:48.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.206+0000 7f55e7fff640 1 --2- 172.21.15.55:0/2051566575 >> v2:172.21.15.110:3300/0 conn(0x7f55e81601f0 0x7f55e815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.206+0000 7f55e7fff640 1 -- 172.21.15.55:0/2051566575 >> v1:172.21.15.55:6789/0 conn(0x7f55e815e3c0 legacy=0x7f55e80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:48.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.206+0000 7f55e7fff640 1 -- 172.21.15.55:0/2051566575 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e80cde40 con 0x7f55e80d1290 2023-08-25T05:37:48.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.206+0000 7f55e67fc640 1 -- 172.21.15.55:0/2051566575 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371483957 0 0) 0x7f55e80cd5a0 con 0x7f55e815e3c0 2023-08-25T05:37:48.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.210+0000 7f55e7fff640 1 --2- 172.21.15.55:0/2051566575 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e80d1290 0x7f55e815e8a0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f55e808b7f0 tx=0x7f55e001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5bbb226346e4c4c server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:48.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.210+0000 7f55e67fc640 1 -- 172.21.15.55:0/2051566575 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e00a5790 con 0x7f55e80d1290 2023-08-25T05:37:48.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.210+0000 7f55e67fc640 1 -- 172.21.15.55:0/2051566575 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e00a58f0 con 0x7f55e80d1290 2023-08-25T05:37:48.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.210+0000 7f55e67fc640 1 -- 172.21.15.55:0/2051566575 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e00a5c80 con 0x7f55e80d1290 2023-08-25T05:37:48.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.210+0000 7f55ee088640 1 -- 172.21.15.55:0/2051566575 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e80d1290 msgr2=0x7f55e815e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:48.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.210+0000 7f55ee088640 1 --2- 172.21.15.55:0/2051566575 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e80d1290 0x7f55e815e8a0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f55e808b7f0 tx=0x7f55e001c9a0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.210+0000 7f55ee088640 1 -- 172.21.15.55:0/2051566575 shutdown_connections 2023-08-25T05:37:48.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.210+0000 7f55ee088640 1 --2- 172.21.15.55:0/2051566575 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e80d1290 0x7f55e815e8a0 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.210+0000 7f55ee088640 1 --2- 172.21.15.55:0/2051566575 >> v2:172.21.15.110:3300/0 conn(0x7f55e81601f0 0x7f55e815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.210+0000 7f55ee088640 1 -- 172.21.15.55:0/2051566575 >> 172.21.15.55:0/2051566575 conn(0x7f55e80d27d0 msgr2=0x7f55e80d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:48.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.210+0000 7f55ee088640 1 -- 172.21.15.55:0/2051566575 shutdown_connections 2023-08-25T05:37:48.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.210+0000 7f55ee088640 1 -- 172.21.15.55:0/2051566575 wait complete. 2023-08-25T05:37:48.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55ee088640 1 Processor -- start 2023-08-25T05:37:48.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55ee088640 1 -- start start 2023-08-25T05:37:48.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55ee088640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55e80d1290 0x7f55e8151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:48.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55ee088640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55e815e3c0 0x7f55e8157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:48.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55ee088640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e81601f0 0x7f55e8155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:48.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55ee088640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e80cb870 con 0x7f55e81601f0 2023-08-25T05:37:48.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55ee088640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e80cace0 con 0x7f55e80d1290 2023-08-25T05:37:48.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55ee088640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e8156310 con 0x7f55e815e3c0 2023-08-25T05:37:48.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55e7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e81601f0 0x7f55e8155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:48.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55e77fe640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55e80d1290 0x7f55e8151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:48.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55e7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e81601f0 0x7f55e8155870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41484/0 (socket says 172.21.15.55:41484) 2023-08-25T05:37:48.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55e7fff640 1 -- 172.21.15.55:0/802737704 learned_addr learned my addr 172.21.15.55:0/802737704 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:48.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55e6ffd640 1 --2- 172.21.15.55:0/802737704 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55e815e3c0 0x7f55e8157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:48.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55e77fe640 1 -- 172.21.15.55:0/802737704 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55e815e3c0 msgr2=0x7f55e8157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:48.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55e77fe640 1 --2- 172.21.15.55:0/802737704 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55e815e3c0 0x7f55e8157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55e77fe640 1 -- 172.21.15.55:0/802737704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e81601f0 msgr2=0x7f55e8155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:48.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55e77fe640 1 --2- 172.21.15.55:0/802737704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e81601f0 0x7f55e8155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55e77fe640 1 -- 172.21.15.55:0/802737704 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e0009b30 con 0x7f55e80d1290 2023-08-25T05:37:48.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55e6ffd640 1 --2- 172.21.15.55:0/802737704 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55e815e3c0 0x7f55e8157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:48.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55e7fff640 1 --2- 172.21.15.55:0/802737704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e81601f0 0x7f55e8155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:48.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55e77fe640 1 --2- 172.21.15.55:0/802737704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55e80d1290 0x7f55e8151800 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f55d800e8a0 tx=0x7f55d800eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:48.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55cffff640 1 -- 172.21.15.55:0/802737704 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d8009510 con 0x7f55e80d1290 2023-08-25T05:37:48.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55cffff640 1 -- 172.21.15.55:0/802737704 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d800c940 con 0x7f55e80d1290 2023-08-25T05:37:48.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55cffff640 1 -- 172.21.15.55:0/802737704 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d800ccb0 con 0x7f55e80d1290 2023-08-25T05:37:48.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.214+0000 7f55ee088640 1 -- 172.21.15.55:0/802737704 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e80ce7c0 con 0x7f55e80d1290 2023-08-25T05:37:48.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.218+0000 7f55ee088640 1 -- 172.21.15.55:0/802737704 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e80cb1b0 con 0x7f55e80d1290 2023-08-25T05:37:48.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.218+0000 7f55ee088640 1 -- 172.21.15.55:0/802737704 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e80cbae0 con 0x7f55e80d1290 2023-08-25T05:37:48.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.218+0000 7f55cffff640 1 -- 172.21.15.55:0/802737704 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 122) v1 ==== 84673+0+0 (secure 0 0 0) 0x7f55d80059a0 con 0x7f55e80d1290 2023-08-25T05:37:48.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.218+0000 7f55cffff640 1 -- 172.21.15.55:0/802737704 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f55d8082d90 con 0x7f55e80d1290 2023-08-25T05:37:48.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.222+0000 7f55cffff640 1 -- 172.21.15.55:0/802737704 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f55d8050860 con 0x7f55e80d1290 2023-08-25T05:37:48.340 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:48.338+0000 7f5967148180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-25T05:37:48.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.382+0000 7f55ee088640 1 -- 172.21.15.55:0/802737704 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f55e80b5a20 con 0x7f55e80d1290 2023-08-25T05:37:48.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.382+0000 7f55cffff640 1 -- 172.21.15.55:0/802737704 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v204) v1 ==== 92+0+10 (secure 0 0 0) 0x7f55d8021020 con 0x7f55e80d1290 2023-08-25T05:37:48.385 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-08-25T05:37:48.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.382+0000 7f55ee088640 1 -- 172.21.15.55:0/802737704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55e80d1290 msgr2=0x7f55e8151800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:48.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.382+0000 7f55ee088640 1 --2- 172.21.15.55:0/802737704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55e80d1290 0x7f55e8151800 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f55d800e8a0 tx=0x7f55d800eca0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.382+0000 7f55ee088640 1 -- 172.21.15.55:0/802737704 shutdown_connections 2023-08-25T05:37:48.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.382+0000 7f55ee088640 1 --2- 172.21.15.55:0/802737704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55e81601f0 0x7f55e8155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.382+0000 7f55ee088640 1 --2- 172.21.15.55:0/802737704 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55e815e3c0 0x7f55e8157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.382+0000 7f55ee088640 1 --2- 172.21.15.55:0/802737704 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55e80d1290 0x7f55e8151800 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.382+0000 7f55ee088640 1 -- 172.21.15.55:0/802737704 >> 172.21.15.55:0/802737704 conn(0x7f55e80d27d0 msgr2=0x7f55e815d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:48.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.382+0000 7f55ee088640 1 -- 172.21.15.55:0/802737704 shutdown_connections 2023-08-25T05:37:48.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.382+0000 7f55ee088640 1 -- 172.21.15.55:0/802737704 wait complete. 2023-08-25T05:37:48.405 INFO:tasks.ceph.mgr.y.smithi055.stderr:2023-08-25T05:37:48.402+0000 7f5967148180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-25T05:37:48.406 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-25T05:37:48.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.550+0000 7ff4e8902640 1 Processor -- start 2023-08-25T05:37:48.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.550+0000 7ff4e8902640 1 -- start start 2023-08-25T05:37:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.554+0000 7ff4e8902640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e40b8330 0x7ff4e4167290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.554+0000 7ff4e8902640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e40b70c0 con 0x7ff4e415fca0 2023-08-25T05:37:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.554+0000 7ff4e8902640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e40b73a0 con 0x7ff4e40cfc90 2023-08-25T05:37:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.554+0000 7ff4e8902640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e4160080 con 0x7ff4e40b8330 2023-08-25T05:37:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.554+0000 7ff4e2d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff4e415fca0 0x7ff4e40cf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43002/0 (socket says 172.21.15.55:43002) 2023-08-25T05:37:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.554+0000 7ff4e2d9d640 1 -- 172.21.15.55:0/3107479883 learned_addr learned my addr 172.21.15.55:0/3107479883 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:48.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.554+0000 7ff4e359e640 1 --2- 172.21.15.55:0/3107479883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e40b8330 0x7ff4e4167290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.554+0000 7ff4e259c640 1 -- 172.21.15.55:0/3107479883 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644973201 0 0) 0x7ff4e40b70c0 con 0x7ff4e415fca0 2023-08-25T05:37:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.554+0000 7ff4e259c640 1 -- 172.21.15.55:0/3107479883 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4d0003530 con 0x7ff4e415fca0 2023-08-25T05:37:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.554+0000 7ff4e259c640 1 -- 172.21.15.55:0/3107479883 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28734529 0 0) 0x7ff4e40b73a0 con 0x7ff4e40cfc90 2023-08-25T05:37:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.554+0000 7ff4e259c640 1 -- 172.21.15.55:0/3107479883 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4e40b70c0 con 0x7ff4e40cfc90 2023-08-25T05:37:48.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.554+0000 7ff4e359e640 1 -- 172.21.15.55:0/3107479883 >> v1:172.21.15.110:6789/0 conn(0x7ff4e40cfc90 legacy=0x7ff4e40b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.554+0000 7ff4e359e640 1 -- 172.21.15.55:0/3107479883 >> v1:172.21.15.55:6789/0 conn(0x7ff4e415fca0 legacy=0x7ff4e40cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.554+0000 7ff4e359e640 1 -- 172.21.15.55:0/3107479883 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e40b7680 con 0x7ff4e40b8330 2023-08-25T05:37:48.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.558+0000 7ff4e359e640 1 --2- 172.21.15.55:0/3107479883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e40b8330 0x7ff4e4167290 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009dc0 tx=0x7ff4dc01f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2885e4103a9d9d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:48.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.558+0000 7ff4e259c640 1 -- 172.21.15.55:0/3107479883 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0af600 con 0x7ff4e40b8330 2023-08-25T05:37:48.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.558+0000 7ff4e259c640 1 -- 172.21.15.55:0/3107479883 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc0ab050 con 0x7ff4e40b8330 2023-08-25T05:37:48.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.558+0000 7ff4e259c640 1 -- 172.21.15.55:0/3107479883 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0af960 con 0x7ff4e40b8330 2023-08-25T05:37:48.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.558+0000 7ff4e8902640 1 -- 172.21.15.55:0/3107479883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e40b8330 msgr2=0x7ff4e4167290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:48.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.558+0000 7ff4e8902640 1 --2- 172.21.15.55:0/3107479883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e40b8330 0x7ff4e4167290 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009dc0 tx=0x7ff4dc01f150 comp rx=0 tx=0).stop 2023-08-25T05:37:48.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.558+0000 7ff4e8902640 1 -- 172.21.15.55:0/3107479883 shutdown_connections 2023-08-25T05:37:48.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.558+0000 7ff4e8902640 1 --2- 172.21.15.55:0/3107479883 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e40b8330 0x7ff4e4167290 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.558+0000 7ff4e8902640 1 -- 172.21.15.55:0/3107479883 >> 172.21.15.55:0/3107479883 conn(0x7ff4e40658c0 msgr2=0x7ff4e4065cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:48.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.558+0000 7ff4e8902640 1 -- 172.21.15.55:0/3107479883 shutdown_connections 2023-08-25T05:37:48.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.558+0000 7ff4e8902640 1 -- 172.21.15.55:0/3107479883 wait complete. 2023-08-25T05:37:48.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.558+0000 7ff4e8902640 1 Processor -- start 2023-08-25T05:37:48.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.558+0000 7ff4e8902640 1 -- start start 2023-08-25T05:37:48.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e8902640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e40b8330 0x7ff4e41589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:48.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e8902640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4e40cfc90 0x7ff4e415b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:48.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e8902640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4e415fca0 0x7ff4e415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:48.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e8902640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e4159220 con 0x7ff4e415fca0 2023-08-25T05:37:48.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e8902640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e4159500 con 0x7ff4e40cfc90 2023-08-25T05:37:48.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e8902640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e41597e0 con 0x7ff4e40b8330 2023-08-25T05:37:48.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4e415fca0 0x7ff4e415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:48.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4e415fca0 0x7ff4e415bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41490/0 (socket says 172.21.15.55:41490) 2023-08-25T05:37:48.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e359e640 1 -- 172.21.15.55:0/2022893497 learned_addr learned my addr 172.21.15.55:0/2022893497 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:48.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e2d9d640 1 --2- 172.21.15.55:0/2022893497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e40b8330 0x7ff4e41589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:48.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4dbfff640 1 --2- 172.21.15.55:0/2022893497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4e40cfc90 0x7ff4e415b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:48.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e359e640 1 -- 172.21.15.55:0/2022893497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e40b8330 msgr2=0x7ff4e41589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:48.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e359e640 1 --2- 172.21.15.55:0/2022893497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e40b8330 0x7ff4e41589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e359e640 1 -- 172.21.15.55:0/2022893497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4e40cfc90 msgr2=0x7ff4e415b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:48.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e359e640 1 --2- 172.21.15.55:0/2022893497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4e40cfc90 0x7ff4e415b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e359e640 1 -- 172.21.15.55:0/2022893497 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4dc009a70 con 0x7ff4e415fca0 2023-08-25T05:37:48.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4dbfff640 1 --2- 172.21.15.55:0/2022893497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4e40cfc90 0x7ff4e415b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:48.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e359e640 1 --2- 172.21.15.55:0/2022893497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4e415fca0 0x7ff4e415bae0 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc01cd80 tx=0x7ff4dc01bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:48.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4db7fe640 1 -- 172.21.15.55:0/2022893497 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc009450 con 0x7ff4e415fca0 2023-08-25T05:37:48.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4db7fe640 1 -- 172.21.15.55:0/2022893497 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc0afcf0 con 0x7ff4e415fca0 2023-08-25T05:37:48.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4db7fe640 1 -- 172.21.15.55:0/2022893497 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0ba620 con 0x7ff4e415fca0 2023-08-25T05:37:48.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e8902640 1 -- 172.21.15.55:0/2022893497 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e4159ac0 con 0x7ff4e415fca0 2023-08-25T05:37:48.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e8902640 1 -- 172.21.15.55:0/2022893497 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e4158f10 con 0x7ff4e415fca0 2023-08-25T05:37:48.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4e8902640 1 -- 172.21.15.55:0/2022893497 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e4073e50 con 0x7ff4e415fca0 2023-08-25T05:37:48.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.562+0000 7ff4db7fe640 1 -- 172.21.15.55:0/2022893497 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 122) v1 ==== 84673+0+0 (secure 0 0 0) 0x7ff4dc0ba780 con 0x7ff4e415fca0 2023-08-25T05:37:48.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.566+0000 7ff4db7fe640 1 -- 172.21.15.55:0/2022893497 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6750+0+0 (secure 0 0 0) 0x7ff4dc121290 con 0x7ff4e415fca0 2023-08-25T05:37:48.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.570+0000 7ff4db7fe640 1 -- 172.21.15.55:0/2022893497 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff4dc0eedd0 con 0x7ff4e415fca0 2023-08-25T05:37:48.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.726+0000 7ff4e8902640 1 -- 172.21.15.55:0/2022893497 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4e4159f70 con 0x7ff4e415fca0 2023-08-25T05:37:48.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.726+0000 7ff4db7fe640 1 -- 172.21.15.55:0/2022893497 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v204) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff4dc0b40a0 con 0x7ff4e415fca0 2023-08-25T05:37:48.730 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2023-08-25T05:37:48.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.730+0000 7ff4e8902640 1 -- 172.21.15.55:0/2022893497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4e415fca0 msgr2=0x7ff4e415bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:48.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.730+0000 7ff4e8902640 1 --2- 172.21.15.55:0/2022893497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4e415fca0 0x7ff4e415bae0 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc01cd80 tx=0x7ff4dc01bef0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.730+0000 7ff4e8902640 1 -- 172.21.15.55:0/2022893497 shutdown_connections 2023-08-25T05:37:48.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.730+0000 7ff4e8902640 1 --2- 172.21.15.55:0/2022893497 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4e415fca0 0x7ff4e415bae0 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.730+0000 7ff4e8902640 1 --2- 172.21.15.55:0/2022893497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4e40cfc90 0x7ff4e415b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.730+0000 7ff4e8902640 1 --2- 172.21.15.55:0/2022893497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4e40b8330 0x7ff4e41589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.730+0000 7ff4e8902640 1 -- 172.21.15.55:0/2022893497 >> 172.21.15.55:0/2022893497 conn(0x7ff4e40658c0 msgr2=0x7ff4e41545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:48.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.730+0000 7ff4e8902640 1 -- 172.21.15.55:0/2022893497 shutdown_connections 2023-08-25T05:37:48.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.730+0000 7ff4e8902640 1 -- 172.21.15.55:0/2022893497 wait complete. 2023-08-25T05:37:48.751 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-25T05:37:48.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.894+0000 7fc0aa9ac640 1 Processor -- start 2023-08-25T05:37:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.894+0000 7fc0aa9ac640 1 -- start start 2023-08-25T05:37:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.894+0000 7fc0aa9ac640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc0a40cb020 0x7fc0a40c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.894+0000 7fc0aa9ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0a406c720 0x7fc0a406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.894+0000 7fc0aa9ac640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a40cbca0 con 0x7fc0a40cdd50 2023-08-25T05:37:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.894+0000 7fc0aa9ac640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a40c9470 con 0x7fc0a40cb020 2023-08-25T05:37:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.894+0000 7fc0aa9ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40ce1e0 con 0x7fc0a406c720 2023-08-25T05:37:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.894+0000 7fc0a37fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc0a40cdd50 0x7fc0a40cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43018/0 (socket says 172.21.15.55:43018) 2023-08-25T05:37:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.894+0000 7fc0a37fe640 1 -- 172.21.15.55:0/1040113193 learned_addr learned my addr 172.21.15.55:0/1040113193 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.894+0000 7fc0a8f49640 1 --2- 172.21.15.55:0/1040113193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0a406c720 0x7fc0a406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.894+0000 7fc0a3fff640 1 --2- 172.21.15.55:0/1040113193 >> v2:172.21.15.110:3300/0 conn(0x7fc0a40cb020 0x7fc0a40c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.894+0000 7fc0a2ffd640 1 -- 172.21.15.55:0/1040113193 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406243616 0 0) 0x7fc0a40cbca0 con 0x7fc0a40cdd50 2023-08-25T05:37:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.894+0000 7fc0a2ffd640 1 -- 172.21.15.55:0/1040113193 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc08c003530 con 0x7fc0a40cdd50 2023-08-25T05:37:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.894+0000 7fc0a8f49640 1 -- 172.21.15.55:0/1040113193 >> v2:172.21.15.110:3300/0 conn(0x7fc0a40cb020 msgr2=0x7fc0a40c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.894+0000 7fc0a8f49640 1 --2- 172.21.15.55:0/1040113193 >> v2:172.21.15.110:3300/0 conn(0x7fc0a40cb020 0x7fc0a40c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.894+0000 7fc0a8f49640 1 -- 172.21.15.55:0/1040113193 >> v1:172.21.15.55:6789/0 conn(0x7fc0a40cdd50 legacy=0x7fc0a40cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.894+0000 7fc0a8f49640 1 -- 172.21.15.55:0/1040113193 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a406d070 con 0x7fc0a406c720 2023-08-25T05:37:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.894+0000 7fc0a3fff640 1 --2- 172.21.15.55:0/1040113193 >> v2:172.21.15.110:3300/0 conn(0x7fc0a40cb020 0x7fc0a40c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:48.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.898+0000 7fc0a8f49640 1 --2- 172.21.15.55:0/1040113193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0a406c720 0x7fc0a406cb30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc09c009d90 tx=0x7fc09c01c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b37a32f7696a2755 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:48.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.898+0000 7fc0a2ffd640 1 -- 172.21.15.55:0/1040113193 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0a5870 con 0x7fc0a406c720 2023-08-25T05:37:48.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.898+0000 7fc0a2ffd640 1 -- 172.21.15.55:0/1040113193 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c0a59d0 con 0x7fc0a406c720 2023-08-25T05:37:48.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.898+0000 7fc0a2ffd640 1 -- 172.21.15.55:0/1040113193 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0a5d60 con 0x7fc0a406c720 2023-08-25T05:37:48.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.898+0000 7fc0aa9ac640 1 -- 172.21.15.55:0/1040113193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0a406c720 msgr2=0x7fc0a406cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:48.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.898+0000 7fc0aa9ac640 1 --2- 172.21.15.55:0/1040113193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0a406c720 0x7fc0a406cb30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc09c009d90 tx=0x7fc09c01c8c0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.898+0000 7fc0aa9ac640 1 -- 172.21.15.55:0/1040113193 shutdown_connections 2023-08-25T05:37:48.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.898+0000 7fc0aa9ac640 1 --2- 172.21.15.55:0/1040113193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0a406c720 0x7fc0a406cb30 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.898+0000 7fc0aa9ac640 1 --2- 172.21.15.55:0/1040113193 >> v2:172.21.15.110:3300/0 conn(0x7fc0a40cb020 0x7fc0a40c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.898+0000 7fc0aa9ac640 1 -- 172.21.15.55:0/1040113193 >> 172.21.15.55:0/1040113193 conn(0x7fc0a4069900 msgr2=0x7fc0a4069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:48.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.898+0000 7fc0aa9ac640 1 -- 172.21.15.55:0/1040113193 shutdown_connections 2023-08-25T05:37:48.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.898+0000 7fc0aa9ac640 1 -- 172.21.15.55:0/1040113193 wait complete. 2023-08-25T05:37:48.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0aa9ac640 1 Processor -- start 2023-08-25T05:37:48.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0aa9ac640 1 -- start start 2023-08-25T05:37:48.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0aa9ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0a406c720 0x7fc0a4150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:48.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0aa9ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0a40cb020 0x7fc0a4167f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:48.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0aa9ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0a40cdd50 0x7fc0a4158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:48.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0aa9ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a4157570 con 0x7fc0a40cb020 2023-08-25T05:37:48.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0aa9ac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a4150b90 con 0x7fc0a40cdd50 2023-08-25T05:37:48.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0aa9ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a41568f0 con 0x7fc0a406c720 2023-08-25T05:37:48.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0a37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0a40cb020 0x7fc0a4167f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:48.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0a37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0a40cb020 0x7fc0a4167f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41492/0 (socket says 172.21.15.55:41492) 2023-08-25T05:37:48.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0a37fe640 1 -- 172.21.15.55:0/1646527688 learned_addr learned my addr 172.21.15.55:0/1646527688 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:48.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0a8f49640 1 --2- 172.21.15.55:0/1646527688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0a40cdd50 0x7fc0a4158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:48.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0a3fff640 1 --2- 172.21.15.55:0/1646527688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0a406c720 0x7fc0a4150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:48.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0a37fe640 1 -- 172.21.15.55:0/1646527688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0a406c720 msgr2=0x7fc0a4150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:48.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0a37fe640 1 --2- 172.21.15.55:0/1646527688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0a406c720 0x7fc0a4150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0a37fe640 1 -- 172.21.15.55:0/1646527688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0a40cdd50 msgr2=0x7fc0a4158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:48.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0a37fe640 1 --2- 172.21.15.55:0/1646527688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0a40cdd50 0x7fc0a4158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:48.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0a37fe640 1 -- 172.21.15.55:0/1646527688 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0940093b0 con 0x7fc0a40cb020 2023-08-25T05:37:48.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0a8f49640 1 --2- 172.21.15.55:0/1646527688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0a40cdd50 0x7fc0a4158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:48.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0a3fff640 1 --2- 172.21.15.55:0/1646527688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0a406c720 0x7fc0a4150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:48.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0a37fe640 1 --2- 172.21.15.55:0/1646527688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0a40cb020 0x7fc0a4167f50 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7fc09800c420 tx=0x7fc09800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:48.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0a0ff9640 1 -- 172.21.15.55:0/1646527688 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc098005cf0 con 0x7fc0a40cb020 2023-08-25T05:37:48.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0a0ff9640 1 -- 172.21.15.55:0/1646527688 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc098005e50 con 0x7fc0a40cb020 2023-08-25T05:37:48.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0a0ff9640 1 -- 172.21.15.55:0/1646527688 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0980072d0 con 0x7fc0a40cb020 2023-08-25T05:37:48.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0aa9ac640 1 -- 172.21.15.55:0/1646527688 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09c009a70 con 0x7fc0a40cb020 2023-08-25T05:37:48.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.902+0000 7fc0aa9ac640 1 -- 172.21.15.55:0/1646527688 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a4156eb0 con 0x7fc0a40cb020 2023-08-25T05:37:48.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.906+0000 7fc0aa9ac640 1 -- 172.21.15.55:0/1646527688 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a41576b0 con 0x7fc0a40cb020 2023-08-25T05:37:48.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.906+0000 7fc0a0ff9640 1 -- 172.21.15.55:0/1646527688 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 122) v1 ==== 84673+0+0 (secure 0 0 0) 0x7fc098007430 con 0x7fc0a40cb020 2023-08-25T05:37:48.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.906+0000 7fc0a0ff9640 1 -- 172.21.15.55:0/1646527688 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6750+0+0 (secure 0 0 0) 0x7fc0980820f0 con 0x7fc0a40cb020 2023-08-25T05:37:48.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:48.910+0000 7fc0a0ff9640 1 -- 172.21.15.55:0/1646527688 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc0a41576b0 con 0x7fc0a40cb020 2023-08-25T05:37:49.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.066+0000 7fc0aa9ac640 1 -- 172.21.15.55:0/1646527688 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc0a41576b0 con 0x7fc0a40cb020 2023-08-25T05:37:49.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.066+0000 7fc0a0ff9640 1 -- 172.21.15.55:0/1646527688 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v204) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc0a41576b0 con 0x7fc0a40cb020 2023-08-25T05:37:49.071 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2023-08-25T05:37:49.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.070+0000 7fc0aa9ac640 1 -- 172.21.15.55:0/1646527688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0a40cb020 msgr2=0x7fc0a4167f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:49.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.070+0000 7fc0aa9ac640 1 --2- 172.21.15.55:0/1646527688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0a40cb020 0x7fc0a4167f50 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7fc09800c420 tx=0x7fc09800c8e0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.070+0000 7fc0aa9ac640 1 -- 172.21.15.55:0/1646527688 shutdown_connections 2023-08-25T05:37:49.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.070+0000 7fc0aa9ac640 1 --2- 172.21.15.55:0/1646527688 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0a40cdd50 0x7fc0a4158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.070+0000 7fc0aa9ac640 1 --2- 172.21.15.55:0/1646527688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0a40cb020 0x7fc0a4167f50 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.070+0000 7fc0aa9ac640 1 --2- 172.21.15.55:0/1646527688 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0a406c720 0x7fc0a4150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.070+0000 7fc0aa9ac640 1 -- 172.21.15.55:0/1646527688 >> 172.21.15.55:0/1646527688 conn(0x7fc0a4069900 msgr2=0x7fc0a40ab520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:49.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.070+0000 7fc0aa9ac640 1 -- 172.21.15.55:0/1646527688 shutdown_connections 2023-08-25T05:37:49.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.070+0000 7fc0aa9ac640 1 -- 172.21.15.55:0/1646527688 wait complete. 2023-08-25T05:37:49.092 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:37:49.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51eda48640 1 Processor -- start 2023-08-25T05:37:49.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51eda48640 1 -- start start 2023-08-25T05:37:49.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51eda48640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51e8160120 0x7f51e80b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51eda48640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f51e80b4080 0x7f51e80b4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51eda48640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51e80d0500 0x7f51e80d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51eda48640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e80b4a50 con 0x7f51e8160120 2023-08-25T05:37:49.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51eda48640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e80b1f20 con 0x7f51e80b4080 2023-08-25T05:37:49.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51eda48640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e80cddf0 con 0x7f51e80d0500 2023-08-25T05:37:49.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51e6ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51e8160120 0x7f51e80b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51e6ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51e8160120 0x7f51e80b1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41494/0 (socket says 172.21.15.55:41494) 2023-08-25T05:37:49.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51e6ffd640 1 -- 172.21.15.55:0/3274568181 learned_addr learned my addr 172.21.15.55:0/3274568181 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:49.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51e67fc640 1 --2- 172.21.15.55:0/3274568181 >> v2:172.21.15.110:3300/0 conn(0x7f51e80b4080 0x7f51e80b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51e77fe640 1 --2- 172.21.15.55:0/3274568181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51e80d0500 0x7f51e80d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51e6ffd640 1 -- 172.21.15.55:0/3274568181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51e80d0500 msgr2=0x7f51e80d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:49.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51e6ffd640 1 --2- 172.21.15.55:0/3274568181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51e80d0500 0x7f51e80d0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51e6ffd640 1 -- 172.21.15.55:0/3274568181 >> v2:172.21.15.110:3300/0 conn(0x7f51e80b4080 msgr2=0x7f51e80b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:49.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51e6ffd640 1 --2- 172.21.15.55:0/3274568181 >> v2:172.21.15.110:3300/0 conn(0x7f51e80b4080 0x7f51e80b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51e6ffd640 1 -- 172.21.15.55:0/3274568181 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e80ce0d0 con 0x7f51e8160120 2023-08-25T05:37:49.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.238+0000 7f51e67fc640 1 --2- 172.21.15.55:0/3274568181 >> v2:172.21.15.110:3300/0 conn(0x7f51e80b4080 0x7f51e80b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:49.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.242+0000 7f51e6ffd640 1 --2- 172.21.15.55:0/3274568181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e8160120 0x7f51e80b1480 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f51d8006fd0 tx=0x7f51d801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8dcfac66437d1e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:49.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.242+0000 7f51e5ffb640 1 -- 172.21.15.55:0/3274568181 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d80ab670 con 0x7f51e8160120 2023-08-25T05:37:49.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.242+0000 7f51e5ffb640 1 -- 172.21.15.55:0/3274568181 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d80ab7d0 con 0x7f51e8160120 2023-08-25T05:37:49.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.242+0000 7f51e5ffb640 1 -- 172.21.15.55:0/3274568181 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d80abb60 con 0x7f51e8160120 2023-08-25T05:37:49.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.242+0000 7f51eda48640 1 -- 172.21.15.55:0/3274568181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e8160120 msgr2=0x7f51e80b1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:49.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.242+0000 7f51eda48640 1 --2- 172.21.15.55:0/3274568181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e8160120 0x7f51e80b1480 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f51d8006fd0 tx=0x7f51d801c4b0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.242+0000 7f51eda48640 1 -- 172.21.15.55:0/3274568181 shutdown_connections 2023-08-25T05:37:49.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.242+0000 7f51eda48640 1 --2- 172.21.15.55:0/3274568181 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51e80d0500 0x7f51e80d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.242+0000 7f51eda48640 1 --2- 172.21.15.55:0/3274568181 >> v2:172.21.15.110:3300/0 conn(0x7f51e80b4080 0x7f51e80b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.242+0000 7f51eda48640 1 --2- 172.21.15.55:0/3274568181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e8160120 0x7f51e80b1480 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.242+0000 7f51eda48640 1 -- 172.21.15.55:0/3274568181 >> 172.21.15.55:0/3274568181 conn(0x7f51e809b950 msgr2=0x7f51e80d2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:49.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.242+0000 7f51eda48640 1 -- 172.21.15.55:0/3274568181 shutdown_connections 2023-08-25T05:37:49.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.242+0000 7f51eda48640 1 -- 172.21.15.55:0/3274568181 wait complete. 2023-08-25T05:37:49.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.242+0000 7f51eda48640 1 Processor -- start 2023-08-25T05:37:49.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.242+0000 7f51eda48640 1 -- start start 2023-08-25T05:37:49.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51eda48640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e80b4080 0x7f51e8157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51eda48640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e80d0500 0x7f51e80b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51eda48640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51e8160120 0x7f51e8151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51eda48640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e8153240 con 0x7f51e80b4080 2023-08-25T05:37:49.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51eda48640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e80b5220 con 0x7f51e80d0500 2023-08-25T05:37:49.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51eda48640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e8158c60 con 0x7f51e8160120 2023-08-25T05:37:49.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51e6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e80b4080 0x7f51e8157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51e6ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e80b4080 0x7f51e8157380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41508/0 (socket says 172.21.15.55:41508) 2023-08-25T05:37:49.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51e6ffd640 1 -- 172.21.15.55:0/402208474 learned_addr learned my addr 172.21.15.55:0/402208474 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:49.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51e67fc640 1 --2- 172.21.15.55:0/402208474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e80d0500 0x7f51e80b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51e77fe640 1 --2- 172.21.15.55:0/402208474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51e8160120 0x7f51e8151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51e6ffd640 1 -- 172.21.15.55:0/402208474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51e8160120 msgr2=0x7f51e8151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:49.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51e6ffd640 1 --2- 172.21.15.55:0/402208474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51e8160120 0x7f51e8151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51e6ffd640 1 -- 172.21.15.55:0/402208474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e80d0500 msgr2=0x7f51e80b76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:49.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51e6ffd640 1 --2- 172.21.15.55:0/402208474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e80d0500 0x7f51e80b76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51e6ffd640 1 -- 172.21.15.55:0/402208474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d8009480 con 0x7f51e80b4080 2023-08-25T05:37:49.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51e6ffd640 1 --2- 172.21.15.55:0/402208474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e80b4080 0x7f51e8157380 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f51d801ab60 tx=0x7f51d8019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:49.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51cffff640 1 -- 172.21.15.55:0/402208474 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d80abb40 con 0x7f51e80b4080 2023-08-25T05:37:49.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51cffff640 1 -- 172.21.15.55:0/402208474 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d80abca0 con 0x7f51e80b4080 2023-08-25T05:37:49.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51eda48640 1 -- 172.21.15.55:0/402208474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e8158f40 con 0x7f51e80b4080 2023-08-25T05:37:49.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51cffff640 1 -- 172.21.15.55:0/402208474 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8003860 con 0x7f51e80b4080 2023-08-25T05:37:49.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51eda48640 1 -- 172.21.15.55:0/402208474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e80b5470 con 0x7f51e80b4080 2023-08-25T05:37:49.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51eda48640 1 -- 172.21.15.55:0/402208474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e8073e50 con 0x7f51e80b4080 2023-08-25T05:37:49.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.246+0000 7f51cffff640 1 -- 172.21.15.55:0/402208474 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 123) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f51d80039c0 con 0x7f51e80b4080 2023-08-25T05:37:49.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.250+0000 7f51cffff640 1 --2- 172.21.15.55:0/402208474 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f51d4065500 0x7f51d40679c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.250+0000 7f51cffff640 1 -- 172.21.15.55:0/402208474 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f51d811d910 con 0x7f51e80b4080 2023-08-25T05:37:49.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.250+0000 7f51e67fc640 1 --2- 172.21.15.55:0/402208474 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f51d4065500 0x7f51d40679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.250+0000 7f51e67fc640 1 --2- 172.21.15.55:0/402208474 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f51d4065500 0x7f51d40679c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f51e80cc230 tx=0x7f51dc008040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:49.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.254+0000 7f51cffff640 1 -- 172.21.15.55:0/402208474 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f51d80eb4c0 con 0x7f51e80b4080 2023-08-25T05:37:49.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.442+0000 7f51eda48640 1 -- 172.21.15.55:0/402208474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51e80b0d90 con 0x7f51e80b4080 2023-08-25T05:37:49.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.446+0000 7f51cffff640 1 -- 172.21.15.55:0/402208474 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4891 (secure 0 0 0) 0x7f51d80c4020 con 0x7f51e80b4080 2023-08-25T05:37:49.448 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:49.448 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":100,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/2330461418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2330461418},{"type":"v1","addr":"172.21.15.110:6836","nonce":2330461418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":9182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3918521245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3918521245},{"type":"v1","addr":"172.21.15.110:6837","nonce":3918521245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":11343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3205982255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3205982255},{"type":"v1","addr":"172.21.15.55:6834","nonce":3205982255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:37:23.923618+0000","modified":"2023-08-25T05:37:27.560216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":11349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11349":{"gid":11349,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3936252180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3936252180},{"type":"v1","addr":"172.21.15.55:6835","nonce":3936252180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-08-25T05:37:49.449 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 100 2023-08-25T05:37:49.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.446+0000 7f51eda48640 1 -- 172.21.15.55:0/402208474 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f51d4065500 msgr2=0x7f51d40679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:49.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.446+0000 7f51eda48640 1 --2- 172.21.15.55:0/402208474 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f51d4065500 0x7f51d40679c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f51e80cc230 tx=0x7f51dc008040 comp rx=0 tx=0).stop 2023-08-25T05:37:49.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.446+0000 7f51eda48640 1 -- 172.21.15.55:0/402208474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e80b4080 msgr2=0x7f51e8157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:49.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.446+0000 7f51eda48640 1 --2- 172.21.15.55:0/402208474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e80b4080 0x7f51e8157380 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f51d801ab60 tx=0x7f51d8019250 comp rx=0 tx=0).stop 2023-08-25T05:37:49.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.446+0000 7f51eda48640 1 -- 172.21.15.55:0/402208474 shutdown_connections 2023-08-25T05:37:49.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.446+0000 7f51eda48640 1 --2- 172.21.15.55:0/402208474 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f51d4065500 0x7f51d40679c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.446+0000 7f51eda48640 1 --2- 172.21.15.55:0/402208474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51e8160120 0x7f51e8151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.446+0000 7f51eda48640 1 --2- 172.21.15.55:0/402208474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51e80d0500 0x7f51e80b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.446+0000 7f51eda48640 1 --2- 172.21.15.55:0/402208474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e80b4080 0x7f51e8157380 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.446+0000 7f51eda48640 1 -- 172.21.15.55:0/402208474 >> 172.21.15.55:0/402208474 conn(0x7f51e809b950 msgr2=0x7f51e80af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:49.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.446+0000 7f51eda48640 1 -- 172.21.15.55:0/402208474 shutdown_connections 2023-08-25T05:37:49.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.446+0000 7f51eda48640 1 -- 172.21.15.55:0/402208474 wait complete. 2023-08-25T05:37:49.469 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:37:49.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.610+0000 7f5121693640 1 Processor -- start 2023-08-25T05:37:49.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.610+0000 7f5121693640 1 -- start start 2023-08-25T05:37:49.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.610+0000 7f5121693640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f511c0ceeb0 0x7f511c0cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.610+0000 7f5121693640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f511c0c89f0 0x7f511c0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.610+0000 7f5121693640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511c0cc880 con 0x7f511c0ad950 2023-08-25T05:37:49.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.610+0000 7f5121693640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511c0b11f0 con 0x7f511c0c89f0 2023-08-25T05:37:49.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.610+0000 7f5121693640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c159d50 con 0x7f511c0ceeb0 2023-08-25T05:37:49.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.610+0000 7f511affd640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f511c0ad950 0x7f511c0ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:59754/0 (socket says 172.21.15.55:59754) 2023-08-25T05:37:49.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.610+0000 7f511affd640 1 -- 172.21.15.55:0/1634413364 learned_addr learned my addr 172.21.15.55:0/1634413364 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:49.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.610+0000 7f51127fc640 1 --2- 172.21.15.55:0/1634413364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f511c0ceeb0 0x7f511c0cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.610+0000 7f511b7fe640 1 --2- 172.21.15.55:0/1634413364 >> v2:172.21.15.110:3300/0 conn(0x7f511c0c89f0 0x7f511c0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.610+0000 7f511a7fc640 1 -- 172.21.15.55:0/1634413364 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625712906 0 0) 0x7f511c0cc880 con 0x7f511c0ad950 2023-08-25T05:37:49.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.610+0000 7f511a7fc640 1 -- 172.21.15.55:0/1634413364 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5108003530 con 0x7f511c0ad950 2023-08-25T05:37:49.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.610+0000 7f51127fc640 1 -- 172.21.15.55:0/1634413364 >> v2:172.21.15.110:3300/0 conn(0x7f511c0c89f0 msgr2=0x7f511c0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:49.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.610+0000 7f51127fc640 1 --2- 172.21.15.55:0/1634413364 >> v2:172.21.15.110:3300/0 conn(0x7f511c0c89f0 0x7f511c0b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.610+0000 7f51127fc640 1 -- 172.21.15.55:0/1634413364 >> v1:172.21.15.110:6789/0 conn(0x7f511c0ad950 legacy=0x7f511c0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:49.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.610+0000 7f51127fc640 1 -- 172.21.15.55:0/1634413364 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511c0ccb60 con 0x7f511c0ceeb0 2023-08-25T05:37:49.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.610+0000 7f511b7fe640 1 --2- 172.21.15.55:0/1634413364 >> v2:172.21.15.110:3300/0 conn(0x7f511c0c89f0 0x7f511c0b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:49.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.614+0000 7f51127fc640 1 --2- 172.21.15.55:0/1634413364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f511c0ceeb0 0x7f511c0cc2a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f51040097c0 tx=0x7f510401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fc18af1180ddbaa server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:49.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.614+0000 7f511a7fc640 1 -- 172.21.15.55:0/1634413364 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51040ab600 con 0x7f511c0ceeb0 2023-08-25T05:37:49.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.614+0000 7f511a7fc640 1 -- 172.21.15.55:0/1634413364 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51040a7050 con 0x7f511c0ceeb0 2023-08-25T05:37:49.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.614+0000 7f511a7fc640 1 -- 172.21.15.55:0/1634413364 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51040ab980 con 0x7f511c0ceeb0 2023-08-25T05:37:49.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.614+0000 7f5121693640 1 -- 172.21.15.55:0/1634413364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f511c0ceeb0 msgr2=0x7f511c0cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:49.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.614+0000 7f5121693640 1 --2- 172.21.15.55:0/1634413364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f511c0ceeb0 0x7f511c0cc2a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f51040097c0 tx=0x7f510401c3c0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.614+0000 7f5121693640 1 -- 172.21.15.55:0/1634413364 shutdown_connections 2023-08-25T05:37:49.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.614+0000 7f5121693640 1 --2- 172.21.15.55:0/1634413364 >> v2:172.21.15.110:3300/0 conn(0x7f511c0c89f0 0x7f511c0b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.614+0000 7f5121693640 1 --2- 172.21.15.55:0/1634413364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f511c0ceeb0 0x7f511c0cc2a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.614+0000 7f5121693640 1 -- 172.21.15.55:0/1634413364 >> 172.21.15.55:0/1634413364 conn(0x7f511c069d00 msgr2=0x7f511c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:49.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.614+0000 7f5121693640 1 -- 172.21.15.55:0/1634413364 shutdown_connections 2023-08-25T05:37:49.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.614+0000 7f5121693640 1 -- 172.21.15.55:0/1634413364 wait complete. 2023-08-25T05:37:49.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f5121693640 1 Processor -- start 2023-08-25T05:37:49.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f5121693640 1 -- start start 2023-08-25T05:37:49.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f5121693640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f511c0ad950 0x7f511c0cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f5121693640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f511c0c89f0 0x7f511c097940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f5121693640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f511c0ceeb0 0x7f511c0ac040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f5121693640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c158300 con 0x7f511c0c89f0 2023-08-25T05:37:49.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f5121693640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511c157750 con 0x7f511c0ad950 2023-08-25T05:37:49.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f5121693640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511c0cb7c0 con 0x7f511c0ceeb0 2023-08-25T05:37:49.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f51127fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f511c0c89f0 0x7f511c097940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f51127fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f511c0c89f0 0x7f511c097940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41514/0 (socket says 172.21.15.55:41514) 2023-08-25T05:37:49.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f51127fc640 1 -- 172.21.15.55:0/1581195631 learned_addr learned my addr 172.21.15.55:0/1581195631 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:49.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f511affd640 1 --2- 172.21.15.55:0/1581195631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f511c0ad950 0x7f511c0cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f511b7fe640 1 --2- 172.21.15.55:0/1581195631 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f511c0ceeb0 0x7f511c0ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f51127fc640 1 -- 172.21.15.55:0/1581195631 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f511c0ceeb0 msgr2=0x7f511c0ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:49.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f51127fc640 1 --2- 172.21.15.55:0/1581195631 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f511c0ceeb0 0x7f511c0ac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f51127fc640 1 -- 172.21.15.55:0/1581195631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f511c0ad950 msgr2=0x7f511c0cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:49.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f51127fc640 1 --2- 172.21.15.55:0/1581195631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f511c0ad950 0x7f511c0cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f51127fc640 1 -- 172.21.15.55:0/1581195631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5114009420 con 0x7f511c0c89f0 2023-08-25T05:37:49.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f51127fc640 1 --2- 172.21.15.55:0/1581195631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f511c0c89f0 0x7f511c097940 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f51040ae040 tx=0x7f5104019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:49.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f5113fff640 1 -- 172.21.15.55:0/1581195631 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51040b4430 con 0x7f511c0c89f0 2023-08-25T05:37:49.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f5113fff640 1 -- 172.21.15.55:0/1581195631 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51040b45b0 con 0x7f511c0c89f0 2023-08-25T05:37:49.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f5113fff640 1 -- 172.21.15.55:0/1581195631 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51040b4960 con 0x7f511c0c89f0 2023-08-25T05:37:49.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f5121693640 1 -- 172.21.15.55:0/1581195631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5104009420 con 0x7f511c0c89f0 2023-08-25T05:37:49.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.618+0000 7f5121693640 1 -- 172.21.15.55:0/1581195631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511c157960 con 0x7f511c0c89f0 2023-08-25T05:37:49.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.622+0000 7f5121693640 1 -- 172.21.15.55:0/1581195631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511c158440 con 0x7f511c0c89f0 2023-08-25T05:37:49.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.622+0000 7f5113fff640 1 -- 172.21.15.55:0/1581195631 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 123) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f51040b2040 con 0x7f511c0c89f0 2023-08-25T05:37:49.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.622+0000 7f5113fff640 1 --2- 172.21.15.55:0/1581195631 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f50fc0654d0 0x7f50fc067990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.622+0000 7f5113fff640 1 -- 172.21.15.55:0/1581195631 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f510411cad0 con 0x7f511c0c89f0 2023-08-25T05:37:49.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.622+0000 7f511affd640 1 --2- 172.21.15.55:0/1581195631 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f50fc0654d0 0x7f50fc067990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.622+0000 7f511affd640 1 --2- 172.21.15.55:0/1581195631 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f50fc0654d0 0x7f50fc067990 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f510c001570 tx=0x7f510c001a00 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:49.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.626+0000 7f5113fff640 1 -- 172.21.15.55:0/1581195631 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f511c158440 con 0x7f511c0c89f0 2023-08-25T05:37:49.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.786+0000 7f5121693640 1 -- 172.21.15.55:0/1581195631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f511c158440 con 0x7f511c0c89f0 2023-08-25T05:37:49.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.786+0000 7f5113fff640 1 -- 172.21.15.55:0/1581195631 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+19323 (secure 0 0 0) 0x7f511c158440 con 0x7f511c0c89f0 2023-08-25T05:37:49.789 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:49.789 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":204,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:37:48.096565+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:37:21.649130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-08-25T05:37:22.924825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/4157713130":"2023-08-26T05:37:48.096492+0000","172.21.15.110:0/829410695":"2023-08-26T05:37:48.096492+0000","172.21.15.110:0/3425796478":"2023-08-26T05:37:48.096492+0000","172.21.15.110:0/1202025049":"2023-08-26T05:37:48.096492+0000","172.21.15.110:6833/4020115519":"2023-08-26T05:37:48.096492+0000","172.21.15.110:6832/4020115519":"2023-08-26T05:37:48.096492+0000","172.21.15.110:0/4140183043":"2023-08-26T05:37:48.096492+0000","172.21.15.110:6833/3630541271":"2023-08-26T05:37:41.077473+0000","172.21.15.110:6832/3630541271":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/546735057":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/2752452882":"2023-08-26T05:37:48.096492+0000","172.21.15.110:0/2235590334":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/1481231262":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/19806955":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/645754688":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/4203127837":"2023-08-26T05:37:41.077473+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:37:49.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.786+0000 7f5121693640 1 -- 172.21.15.55:0/1581195631 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f50fc0654d0 msgr2=0x7f50fc067990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:49.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.786+0000 7f5121693640 1 --2- 172.21.15.55:0/1581195631 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f50fc0654d0 0x7f50fc067990 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f510c001570 tx=0x7f510c001a00 comp rx=0 tx=0).stop 2023-08-25T05:37:49.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.786+0000 7f5121693640 1 -- 172.21.15.55:0/1581195631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f511c0c89f0 msgr2=0x7f511c097940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:49.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.786+0000 7f5121693640 1 --2- 172.21.15.55:0/1581195631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f511c0c89f0 0x7f511c097940 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f51040ae040 tx=0x7f5104019160 comp rx=0 tx=0).stop 2023-08-25T05:37:49.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.786+0000 7f5121693640 1 -- 172.21.15.55:0/1581195631 shutdown_connections 2023-08-25T05:37:49.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.786+0000 7f5121693640 1 --2- 172.21.15.55:0/1581195631 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f50fc0654d0 0x7f50fc067990 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.786+0000 7f5121693640 1 --2- 172.21.15.55:0/1581195631 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f511c0ceeb0 0x7f511c0ac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.786+0000 7f5121693640 1 --2- 172.21.15.55:0/1581195631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f511c0c89f0 0x7f511c097940 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.786+0000 7f5121693640 1 --2- 172.21.15.55:0/1581195631 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f511c0ad950 0x7f511c0cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.786+0000 7f5121693640 1 -- 172.21.15.55:0/1581195631 >> 172.21.15.55:0/1581195631 conn(0x7f511c069d00 msgr2=0x7f511c070200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:49.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.786+0000 7f5121693640 1 -- 172.21.15.55:0/1581195631 shutdown_connections 2023-08-25T05:37:49.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.786+0000 7f5121693640 1 -- 172.21.15.55:0/1581195631 wait complete. 2023-08-25T05:37:49.810 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-25T05:37:49.811 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:37:49.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.950+0000 7f9c2d774640 1 Processor -- start 2023-08-25T05:37:49.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.950+0000 7f9c2d774640 1 -- start start 2023-08-25T05:37:49.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.950+0000 7f9c2d774640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9c28158e10 0x7f9c280b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.950+0000 7f9c2d774640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c28159f10 0x7f9c280cab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.950+0000 7f9c2d774640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9c280cb0d0 0x7f9c280c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.954+0000 7f9c2d774640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c280ad940 con 0x7f9c28158e10 2023-08-25T05:37:49.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.954+0000 7f9c2d774640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c280cb540 con 0x7f9c280cb0d0 2023-08-25T05:37:49.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.954+0000 7f9c2d774640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c280cdbf0 con 0x7f9c28159f10 2023-08-25T05:37:49.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.954+0000 7f9c26ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9c28158e10 0x7f9c280b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.954+0000 7f9c26ffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9c28158e10 0x7f9c280b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41528/0 (socket says 172.21.15.55:41528) 2023-08-25T05:37:49.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.954+0000 7f9c26ffd640 1 -- 172.21.15.55:0/91956386 learned_addr learned my addr 172.21.15.55:0/91956386 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:49.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.954+0000 7f9c277fe640 1 --2- 172.21.15.55:0/91956386 >> v2:172.21.15.110:3300/0 conn(0x7f9c280cb0d0 0x7f9c280c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.954+0000 7f9c1e7fc640 1 --2- 172.21.15.55:0/91956386 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c28159f10 0x7f9c280cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.954+0000 7f9c26ffd640 1 -- 172.21.15.55:0/91956386 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c28159f10 msgr2=0x7f9c280cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:49.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.954+0000 7f9c26ffd640 1 --2- 172.21.15.55:0/91956386 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c28159f10 0x7f9c280cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.954+0000 7f9c26ffd640 1 -- 172.21.15.55:0/91956386 >> v2:172.21.15.110:3300/0 conn(0x7f9c280cb0d0 msgr2=0x7f9c280c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:49.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.954+0000 7f9c26ffd640 1 --2- 172.21.15.55:0/91956386 >> v2:172.21.15.110:3300/0 conn(0x7f9c280cb0d0 0x7f9c280c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.954+0000 7f9c26ffd640 1 -- 172.21.15.55:0/91956386 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2815a390 con 0x7f9c28158e10 2023-08-25T05:37:49.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.954+0000 7f9c277fe640 1 --2- 172.21.15.55:0/91956386 >> v2:172.21.15.110:3300/0 conn(0x7f9c280cb0d0 0x7f9c280c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:49.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.954+0000 7f9c26ffd640 1 --2- 172.21.15.55:0/91956386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c28158e10 0x7f9c280b2d30 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f9c280b33d0 tx=0x7f9c1801e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b6627b7120e3b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:49.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.954+0000 7f9c267fc640 1 -- 172.21.15.55:0/91956386 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18004230 con 0x7f9c28158e10 2023-08-25T05:37:49.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c267fc640 1 -- 172.21.15.55:0/91956386 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c180ab070 con 0x7f9c28158e10 2023-08-25T05:37:49.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c267fc640 1 -- 172.21.15.55:0/91956386 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c180a77a0 con 0x7f9c28158e10 2023-08-25T05:37:49.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c2d774640 1 -- 172.21.15.55:0/91956386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c28158e10 msgr2=0x7f9c280b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:49.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c2d774640 1 --2- 172.21.15.55:0/91956386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c28158e10 0x7f9c280b2d30 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f9c280b33d0 tx=0x7f9c1801e990 comp rx=0 tx=0).stop 2023-08-25T05:37:49.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c2d774640 1 -- 172.21.15.55:0/91956386 shutdown_connections 2023-08-25T05:37:49.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c2d774640 1 --2- 172.21.15.55:0/91956386 >> v2:172.21.15.110:3300/0 conn(0x7f9c280cb0d0 0x7f9c280c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c2d774640 1 --2- 172.21.15.55:0/91956386 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c28159f10 0x7f9c280cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c2d774640 1 --2- 172.21.15.55:0/91956386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c28158e10 0x7f9c280b2d30 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c2d774640 1 -- 172.21.15.55:0/91956386 >> 172.21.15.55:0/91956386 conn(0x7f9c28069d00 msgr2=0x7f9c2806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:49.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c2d774640 1 -- 172.21.15.55:0/91956386 shutdown_connections 2023-08-25T05:37:49.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c2d774640 1 -- 172.21.15.55:0/91956386 wait complete. 2023-08-25T05:37:49.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c2d774640 1 Processor -- start 2023-08-25T05:37:49.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c2d774640 1 -- start start 2023-08-25T05:37:49.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c2d774640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c280cb0d0 0x7f9c2806a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c2d774640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c28158e10 0x7f9c280c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c2d774640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c28159f10 0x7f9c28153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c2d774640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c281553d0 con 0x7f9c28158e10 2023-08-25T05:37:49.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c2d774640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c281556b0 con 0x7f9c28159f10 2023-08-25T05:37:49.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c2d774640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c28155990 con 0x7f9c280cb0d0 2023-08-25T05:37:49.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c1e7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c28158e10 0x7f9c280c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c1e7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c28158e10 0x7f9c280c5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41534/0 (socket says 172.21.15.55:41534) 2023-08-25T05:37:49.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c1e7fc640 1 -- 172.21.15.55:0/344048788 learned_addr learned my addr 172.21.15.55:0/344048788 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:49.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.958+0000 7f9c26ffd640 1 --2- 172.21.15.55:0/344048788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c280cb0d0 0x7f9c2806a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.962+0000 7f9c277fe640 1 --2- 172.21.15.55:0/344048788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c28159f10 0x7f9c28153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.962+0000 7f9c1e7fc640 1 -- 172.21.15.55:0/344048788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c280cb0d0 msgr2=0x7f9c2806a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:49.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.962+0000 7f9c1e7fc640 1 --2- 172.21.15.55:0/344048788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c280cb0d0 0x7f9c2806a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.962+0000 7f9c1e7fc640 1 -- 172.21.15.55:0/344048788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c28159f10 msgr2=0x7f9c28153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:49.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.962+0000 7f9c1e7fc640 1 --2- 172.21.15.55:0/344048788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c28159f10 0x7f9c28153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:49.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.962+0000 7f9c1e7fc640 1 -- 172.21.15.55:0/344048788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c20009420 con 0x7f9c28158e10 2023-08-25T05:37:49.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.962+0000 7f9c1e7fc640 1 --2- 172.21.15.55:0/344048788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c28158e10 0x7f9c280c5470 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000efc0 tx=0x7f9c1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:49.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.962+0000 7f9c1ffff640 1 -- 172.21.15.55:0/344048788 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10014480 con 0x7f9c28158e10 2023-08-25T05:37:49.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.962+0000 7f9c1ffff640 1 -- 172.21.15.55:0/344048788 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1000f040 con 0x7f9c28158e10 2023-08-25T05:37:49.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.962+0000 7f9c1ffff640 1 -- 172.21.15.55:0/344048788 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10014820 con 0x7f9c28158e10 2023-08-25T05:37:49.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.962+0000 7f9c2d774640 1 -- 172.21.15.55:0/344048788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1800b780 con 0x7f9c28158e10 2023-08-25T05:37:49.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.962+0000 7f9c2d774640 1 -- 172.21.15.55:0/344048788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c28159370 con 0x7f9c28158e10 2023-08-25T05:37:49.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.962+0000 7f9c2d774640 1 -- 172.21.15.55:0/344048788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c280af100 con 0x7f9c28158e10 2023-08-25T05:37:49.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.962+0000 7f9c1ffff640 1 -- 172.21.15.55:0/344048788 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 123) v1 ==== 84800+0+0 (secure 0 0 0) 0x7f9c10014980 con 0x7f9c28158e10 2023-08-25T05:37:49.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.966+0000 7f9c1ffff640 1 --2- 172.21.15.55:0/344048788 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f9c08065500 0x7f9c080679c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:49.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.966+0000 7f9c1ffff640 1 -- 172.21.15.55:0/344048788 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f9c10083aa0 con 0x7f9c28158e10 2023-08-25T05:37:49.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.966+0000 7f9c26ffd640 1 --2- 172.21.15.55:0/344048788 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f9c08065500 0x7f9c080679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:49.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.966+0000 7f9c26ffd640 1 --2- 172.21.15.55:0/344048788 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f9c08065500 0x7f9c080679c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9c180b1000 tx=0x7f9c180a9070 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:49.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:49.970+0000 7f9c1ffff640 1 -- 172.21.15.55:0/344048788 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9c100515d0 con 0x7f9c28158e10 2023-08-25T05:37:50.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.166+0000 7f9c2d774640 1 -- 172.21.15.55:0/344048788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c2804dbe0 con 0x7f9c28158e10 2023-08-25T05:37:50.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.166+0000 7f9c1ffff640 1 -- 172.21.15.55:0/344048788 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4891 (secure 0 0 0) 0x7f9c10054bf0 con 0x7f9c28158e10 2023-08-25T05:37:50.170 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:50.170 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":100,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/2330461418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2330461418},{"type":"v1","addr":"172.21.15.110:6836","nonce":2330461418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":9182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3918521245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3918521245},{"type":"v1","addr":"172.21.15.110:6837","nonce":3918521245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":11343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3205982255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3205982255},{"type":"v1","addr":"172.21.15.55:6834","nonce":3205982255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:37:23.923618+0000","modified":"2023-08-25T05:37:27.560216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":11349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11349":{"gid":11349,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3936252180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3936252180},{"type":"v1","addr":"172.21.15.55:6835","nonce":3936252180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-08-25T05:37:50.170 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 100 2023-08-25T05:37:50.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.170+0000 7f9c2d774640 1 -- 172.21.15.55:0/344048788 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f9c08065500 msgr2=0x7f9c080679c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:50.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.170+0000 7f9c2d774640 1 --2- 172.21.15.55:0/344048788 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f9c08065500 0x7f9c080679c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9c180b1000 tx=0x7f9c180a9070 comp rx=0 tx=0).stop 2023-08-25T05:37:50.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.170+0000 7f9c2d774640 1 -- 172.21.15.55:0/344048788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c28158e10 msgr2=0x7f9c280c5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:50.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.170+0000 7f9c2d774640 1 --2- 172.21.15.55:0/344048788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c28158e10 0x7f9c280c5470 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000efc0 tx=0x7f9c1000c490 comp rx=0 tx=0).stop 2023-08-25T05:37:50.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.170+0000 7f9c2d774640 1 -- 172.21.15.55:0/344048788 shutdown_connections 2023-08-25T05:37:50.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.170+0000 7f9c2d774640 1 --2- 172.21.15.55:0/344048788 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f9c08065500 0x7f9c080679c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.170+0000 7f9c2d774640 1 --2- 172.21.15.55:0/344048788 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c28159f10 0x7f9c28153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.170+0000 7f9c2d774640 1 --2- 172.21.15.55:0/344048788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c28158e10 0x7f9c280c5470 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.170+0000 7f9c2d774640 1 --2- 172.21.15.55:0/344048788 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c280cb0d0 0x7f9c2806a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.170+0000 7f9c2d774640 1 -- 172.21.15.55:0/344048788 >> 172.21.15.55:0/344048788 conn(0x7f9c28069d00 msgr2=0x7f9c280abcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:50.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.170+0000 7f9c2d774640 1 -- 172.21.15.55:0/344048788 shutdown_connections 2023-08-25T05:37:50.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.170+0000 7f9c2d774640 1 -- 172.21.15.55:0/344048788 wait complete. 2023-08-25T05:37:50.191 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:37:50.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.334+0000 7f8611d37640 1 Processor -- start 2023-08-25T05:37:50.338 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.334+0000 7f8611d37640 1 -- start start 2023-08-25T05:37:50.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.338+0000 7f8611d37640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f860c0cfa70 0x7f860c160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:50.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.338+0000 7f8611d37640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f860c06b2b0 0x7f860c06b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:50.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.338+0000 7f8611d37640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c06eaf0 con 0x7f860c15c9c0 2023-08-25T05:37:50.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.338+0000 7f8611d37640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860c06e530 con 0x7f860c0cfa70 2023-08-25T05:37:50.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.338+0000 7f8611d37640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860c06e810 con 0x7f860c06b2b0 2023-08-25T05:37:50.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.338+0000 7f8603fff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f860c0cfa70 0x7f860c160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:50.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.338+0000 7f860b7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f860c15c9c0 0x7f860c160510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43034/0 (socket says 172.21.15.55:43034) 2023-08-25T05:37:50.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.338+0000 7f860b7fe640 1 -- 172.21.15.55:0/409944243 learned_addr learned my addr 172.21.15.55:0/409944243 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:50.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.338+0000 7f860bfff640 1 --2- 172.21.15.55:0/409944243 >> v2:172.21.15.110:3300/0 conn(0x7f860c06b2b0 0x7f860c06b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:50.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.338+0000 7f8603fff640 1 -- 172.21.15.55:0/409944243 >> v2:172.21.15.110:3300/0 conn(0x7f860c06b2b0 msgr2=0x7f860c06b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:50.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.338+0000 7f8603fff640 1 --2- 172.21.15.55:0/409944243 >> v2:172.21.15.110:3300/0 conn(0x7f860c06b2b0 0x7f860c06b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.338+0000 7f8603fff640 1 -- 172.21.15.55:0/409944243 >> v1:172.21.15.55:6789/0 conn(0x7f860c15c9c0 legacy=0x7f860c160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:50.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.338+0000 7f8603fff640 1 -- 172.21.15.55:0/409944243 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c06aab0 con 0x7f860c0cfa70 2023-08-25T05:37:50.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.338+0000 7f860bfff640 1 --2- 172.21.15.55:0/409944243 >> v2:172.21.15.110:3300/0 conn(0x7f860c06b2b0 0x7f860c06b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:50.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.338+0000 7f860affd640 1 -- 172.21.15.55:0/409944243 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747693862 0 0) 0x7f860c06eaf0 con 0x7f860c15c9c0 2023-08-25T05:37:50.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.338+0000 7f8603fff640 1 --2- 172.21.15.55:0/409944243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c0cfa70 0x7f860c160c20 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f860c071a60 tx=0x7f85f401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ccda1c12d383ca3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:50.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.338+0000 7f860affd640 1 -- 172.21.15.55:0/409944243 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f40ab5f0 con 0x7f860c0cfa70 2023-08-25T05:37:50.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f860affd640 1 -- 172.21.15.55:0/409944243 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f40ab750 con 0x7f860c0cfa70 2023-08-25T05:37:50.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f860affd640 1 -- 172.21.15.55:0/409944243 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f40abae0 con 0x7f860c0cfa70 2023-08-25T05:37:50.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8611d37640 1 -- 172.21.15.55:0/409944243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c0cfa70 msgr2=0x7f860c160c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:50.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8611d37640 1 --2- 172.21.15.55:0/409944243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c0cfa70 0x7f860c160c20 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f860c071a60 tx=0x7f85f401c430 comp rx=0 tx=0).stop 2023-08-25T05:37:50.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8611d37640 1 -- 172.21.15.55:0/409944243 shutdown_connections 2023-08-25T05:37:50.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8611d37640 1 --2- 172.21.15.55:0/409944243 >> v2:172.21.15.110:3300/0 conn(0x7f860c06b2b0 0x7f860c06b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8611d37640 1 --2- 172.21.15.55:0/409944243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c0cfa70 0x7f860c160c20 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8611d37640 1 -- 172.21.15.55:0/409944243 >> 172.21.15.55:0/409944243 conn(0x7f860c0d05a0 msgr2=0x7f860c0d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:50.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8611d37640 1 -- 172.21.15.55:0/409944243 shutdown_connections 2023-08-25T05:37:50.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8611d37640 1 -- 172.21.15.55:0/409944243 wait complete. 2023-08-25T05:37:50.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8611d37640 1 Processor -- start 2023-08-25T05:37:50.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8611d37640 1 -- start start 2023-08-25T05:37:50.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8611d37640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f860c06b2b0 0x7f860c153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:50.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8611d37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c0cfa70 0x7f860c0b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:50.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8611d37640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f860c15c9c0 0x7f860c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:50.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8611d37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c0b4780 con 0x7f860c0cfa70 2023-08-25T05:37:50.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8611d37640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c159b90 con 0x7f860c06b2b0 2023-08-25T05:37:50.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8611d37640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c159e30 con 0x7f860c15c9c0 2023-08-25T05:37:50.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8603fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c0cfa70 0x7f860c0b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:50.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8603fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c0cfa70 0x7f860c0b5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41548/0 (socket says 172.21.15.55:41548) 2023-08-25T05:37:50.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f8603fff640 1 -- 172.21.15.55:0/3274433125 learned_addr learned my addr 172.21.15.55:0/3274433125 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:50.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f860b7fe640 1 --2- 172.21.15.55:0/3274433125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f860c06b2b0 0x7f860c153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:50.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.342+0000 7f860bfff640 1 --2- 172.21.15.55:0/3274433125 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f860c15c9c0 0x7f860c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:50.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.346+0000 7f8603fff640 1 -- 172.21.15.55:0/3274433125 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f860c15c9c0 msgr2=0x7f860c0b6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:50.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.346+0000 7f8603fff640 1 --2- 172.21.15.55:0/3274433125 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f860c15c9c0 0x7f860c0b6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.346+0000 7f8603fff640 1 -- 172.21.15.55:0/3274433125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f860c06b2b0 msgr2=0x7f860c153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:50.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.346+0000 7f8603fff640 1 --2- 172.21.15.55:0/3274433125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f860c06b2b0 0x7f860c153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.346+0000 7f8603fff640 1 -- 172.21.15.55:0/3274433125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8604009a70 con 0x7f860c0cfa70 2023-08-25T05:37:50.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.346+0000 7f8603fff640 1 --2- 172.21.15.55:0/3274433125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c0cfa70 0x7f860c0b5b50 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f85f4019040 tx=0x7f85f401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:50.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.346+0000 7f8608ff9640 1 -- 172.21.15.55:0/3274433125 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f40bf610 con 0x7f860c0cfa70 2023-08-25T05:37:50.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.346+0000 7f8608ff9640 1 -- 172.21.15.55:0/3274433125 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f40bf790 con 0x7f860c0cfa70 2023-08-25T05:37:50.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.346+0000 7f8608ff9640 1 -- 172.21.15.55:0/3274433125 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f40bfb40 con 0x7f860c0cfa70 2023-08-25T05:37:50.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.346+0000 7f8611d37640 1 -- 172.21.15.55:0/3274433125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f4009420 con 0x7f860c0cfa70 2023-08-25T05:37:50.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.346+0000 7f8611d37640 1 -- 172.21.15.55:0/3274433125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860c0b41c0 con 0x7f860c0cfa70 2023-08-25T05:37:50.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.346+0000 7f8611d37640 1 -- 172.21.15.55:0/3274433125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860c0af910 con 0x7f860c0cfa70 2023-08-25T05:37:50.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.346+0000 7f8608ff9640 1 -- 172.21.15.55:0/3274433125 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 124) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f85f40bfca0 con 0x7f860c0cfa70 2023-08-25T05:37:50.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.350+0000 7f8608ff9640 1 --2- 172.21.15.55:0/3274433125 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f85ec065740 0x7f85ec067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:50.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.350+0000 7f8608ff9640 1 -- 172.21.15.55:0/3274433125 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f85f40a8050 con 0x7f860c0cfa70 2023-08-25T05:37:50.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.350+0000 7f860b7fe640 1 --2- 172.21.15.55:0/3274433125 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f85ec065740 0x7f85ec067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:50.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.350+0000 7f860b7fe640 1 --2- 172.21.15.55:0/3274433125 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f85ec065740 0x7f85ec067c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f85fc007fd0 tx=0x7f85fc009040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:50.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.350+0000 7f8608ff9640 1 -- 172.21.15.55:0/3274433125 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f85f40eaf20 con 0x7f860c0cfa70 2023-08-25T05:37:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.542+0000 7f8611d37640 1 -- 172.21.15.55:0/3274433125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f860c04dbe0 con 0x7f860c0cfa70 2023-08-25T05:37:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.542+0000 7f8608ff9640 1 -- 172.21.15.55:0/3274433125 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4891 (secure 0 0 0) 0x7f85f40ee540 con 0x7f860c0cfa70 2023-08-25T05:37:50.546 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:50.546 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":100,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/2330461418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2330461418},{"type":"v1","addr":"172.21.15.110:6836","nonce":2330461418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":9182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3918521245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3918521245},{"type":"v1","addr":"172.21.15.110:6837","nonce":3918521245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":11343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3205982255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3205982255},{"type":"v1","addr":"172.21.15.55:6834","nonce":3205982255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-25T05:37:23.923618+0000","modified":"2023-08-25T05:37:27.560216+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":11349},"failed":[],"damaged":[],"stopped":[],"info":{"gid_11349":{"gid":11349,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/3936252180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3936252180},{"type":"v1","addr":"172.21.15.55:6835","nonce":3936252180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":12}]} 2023-08-25T05:37:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 100 2023-08-25T05:37:50.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.546+0000 7f8611d37640 1 -- 172.21.15.55:0/3274433125 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f85ec065740 msgr2=0x7f85ec067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:50.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.546+0000 7f8611d37640 1 --2- 172.21.15.55:0/3274433125 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f85ec065740 0x7f85ec067c00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f85fc007fd0 tx=0x7f85fc009040 comp rx=0 tx=0).stop 2023-08-25T05:37:50.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.546+0000 7f8611d37640 1 -- 172.21.15.55:0/3274433125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c0cfa70 msgr2=0x7f860c0b5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:50.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.546+0000 7f8611d37640 1 --2- 172.21.15.55:0/3274433125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c0cfa70 0x7f860c0b5b50 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f85f4019040 tx=0x7f85f401ac70 comp rx=0 tx=0).stop 2023-08-25T05:37:50.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.546+0000 7f8611d37640 1 -- 172.21.15.55:0/3274433125 shutdown_connections 2023-08-25T05:37:50.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.546+0000 7f8611d37640 1 --2- 172.21.15.55:0/3274433125 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f85ec065740 0x7f85ec067c00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.546+0000 7f8611d37640 1 --2- 172.21.15.55:0/3274433125 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f860c15c9c0 0x7f860c0b6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.546+0000 7f8611d37640 1 --2- 172.21.15.55:0/3274433125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f860c0cfa70 0x7f860c0b5b50 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.546+0000 7f8611d37640 1 --2- 172.21.15.55:0/3274433125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f860c06b2b0 0x7f860c153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.546+0000 7f8611d37640 1 -- 172.21.15.55:0/3274433125 >> 172.21.15.55:0/3274433125 conn(0x7f860c0d05a0 msgr2=0x7f860c158550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:50.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.546+0000 7f8611d37640 1 -- 172.21.15.55:0/3274433125 shutdown_connections 2023-08-25T05:37:50.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.546+0000 7f8611d37640 1 -- 172.21.15.55:0/3274433125 wait complete. 2023-08-25T05:37:50.567 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:37:50.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.706+0000 7f0ac9048640 1 Processor -- start 2023-08-25T05:37:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.706+0000 7f0ac9048640 1 -- start start 2023-08-25T05:37:50.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.706+0000 7f0ac9048640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ac40cfa70 0x7f0ac4160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.706+0000 7f0ac9048640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ac406b2b0 0x7f0ac406b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.706+0000 7f0ac9048640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac406eaf0 con 0x7f0ac415c9c0 2023-08-25T05:37:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.706+0000 7f0ac9048640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac406e530 con 0x7f0ac406b2b0 2023-08-25T05:37:50.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.706+0000 7f0ac9048640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac406e810 con 0x7f0ac40cfa70 2023-08-25T05:37:50.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.706+0000 7f0ac359e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ac406b2b0 0x7f0ac406b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:50.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.710+0000 7f0ac359e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0ac406b2b0 0x7f0ac406b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53052/0 (socket says 172.21.15.55:53052) 2023-08-25T05:37:50.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.710+0000 7f0ac359e640 1 -- 172.21.15.55:0/2027492135 learned_addr learned my addr 172.21.15.55:0/2027492135 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:50.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.710+0000 7f0abbfff640 1 --2- 172.21.15.55:0/2027492135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ac40cfa70 0x7f0ac4160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:50.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.710+0000 7f0ac359e640 1 -- 172.21.15.55:0/2027492135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ac40cfa70 msgr2=0x7f0ac4160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:50.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.710+0000 7f0ac359e640 1 --2- 172.21.15.55:0/2027492135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ac40cfa70 0x7f0ac4160c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.710+0000 7f0ac359e640 1 -- 172.21.15.55:0/2027492135 >> v1:172.21.15.110:6789/0 conn(0x7f0ac415c9c0 legacy=0x7f0ac4160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:50.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.710+0000 7f0ac359e640 1 -- 172.21.15.55:0/2027492135 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac406aab0 con 0x7f0ac406b2b0 2023-08-25T05:37:50.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.710+0000 7f0ac359e640 1 --2- 172.21.15.55:0/2027492135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac406b2b0 0x7f0ac406b740 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009e50 tx=0x7f0abc01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0e52c97c82bfc7 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:50.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.710+0000 7f0ac259c640 1 -- 172.21.15.55:0/2027492135 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc0a5870 con 0x7f0ac406b2b0 2023-08-25T05:37:50.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.710+0000 7f0ac259c640 1 -- 172.21.15.55:0/2027492135 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc0a59d0 con 0x7f0ac406b2b0 2023-08-25T05:37:50.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.710+0000 7f0ac259c640 1 -- 172.21.15.55:0/2027492135 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc0a5d60 con 0x7f0ac406b2b0 2023-08-25T05:37:50.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.710+0000 7f0ac9048640 1 -- 172.21.15.55:0/2027492135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac406b2b0 msgr2=0x7f0ac406b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.710+0000 7f0ac9048640 1 --2- 172.21.15.55:0/2027492135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac406b2b0 0x7f0ac406b740 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009e50 tx=0x7f0abc01c9e0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac9048640 1 -- 172.21.15.55:0/2027492135 shutdown_connections 2023-08-25T05:37:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac9048640 1 --2- 172.21.15.55:0/2027492135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac406b2b0 0x7f0ac406b740 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac9048640 1 --2- 172.21.15.55:0/2027492135 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ac40cfa70 0x7f0ac4160c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac9048640 1 -- 172.21.15.55:0/2027492135 >> 172.21.15.55:0/2027492135 conn(0x7f0ac40d05a0 msgr2=0x7f0ac40d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac9048640 1 -- 172.21.15.55:0/2027492135 shutdown_connections 2023-08-25T05:37:50.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac9048640 1 -- 172.21.15.55:0/2027492135 wait complete. 2023-08-25T05:37:50.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac9048640 1 Processor -- start 2023-08-25T05:37:50.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac9048640 1 -- start start 2023-08-25T05:37:50.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac9048640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ac406b2b0 0x7f0ac415b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:50.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac9048640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ac40cfa70 0x7f0ac4143540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:50.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac9048640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac415c9c0 0x7f0ac415f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:50.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac9048640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac4154290 con 0x7f0ac415c9c0 2023-08-25T05:37:50.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac9048640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac415f920 con 0x7f0ac406b2b0 2023-08-25T05:37:50.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac9048640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac415fc00 con 0x7f0ac40cfa70 2023-08-25T05:37:50.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac415c9c0 0x7f0ac415f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:50.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac359e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac415c9c0 0x7f0ac415f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53062/0 (socket says 172.21.15.55:53062) 2023-08-25T05:37:50.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac359e640 1 -- 172.21.15.55:0/1342893579 learned_addr learned my addr 172.21.15.55:0/1342893579 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:50.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac2d9d640 1 --2- 172.21.15.55:0/1342893579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ac406b2b0 0x7f0ac415b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:50.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0abbfff640 1 --2- 172.21.15.55:0/1342893579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ac40cfa70 0x7f0ac4143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:50.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac359e640 1 -- 172.21.15.55:0/1342893579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ac40cfa70 msgr2=0x7f0ac4143540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:50.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac359e640 1 --2- 172.21.15.55:0/1342893579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ac40cfa70 0x7f0ac4143540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac359e640 1 -- 172.21.15.55:0/1342893579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ac406b2b0 msgr2=0x7f0ac415b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:50.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac359e640 1 --2- 172.21.15.55:0/1342893579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ac406b2b0 0x7f0ac415b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.714+0000 7f0ac359e640 1 -- 172.21.15.55:0/1342893579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc009b30 con 0x7f0ac415c9c0 2023-08-25T05:37:50.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.718+0000 7f0ac359e640 1 --2- 172.21.15.55:0/1342893579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac415c9c0 0x7f0ac415f040 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0af040 tx=0x7f0abc019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:50.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.718+0000 7f0abb7fe640 1 -- 172.21.15.55:0/1342893579 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc0b8670 con 0x7f0ac415c9c0 2023-08-25T05:37:50.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.718+0000 7f0abb7fe640 1 -- 172.21.15.55:0/1342893579 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc0b87d0 con 0x7f0ac415c9c0 2023-08-25T05:37:50.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.718+0000 7f0abb7fe640 1 -- 172.21.15.55:0/1342893579 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc0b8b80 con 0x7f0ac415c9c0 2023-08-25T05:37:50.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.718+0000 7f0ac9048640 1 -- 172.21.15.55:0/1342893579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac415fee0 con 0x7f0ac415c9c0 2023-08-25T05:37:50.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.718+0000 7f0ac9048640 1 -- 172.21.15.55:0/1342893579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac415f580 con 0x7f0ac415c9c0 2023-08-25T05:37:50.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.718+0000 7f0ac9048640 1 -- 172.21.15.55:0/1342893579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac4154400 con 0x7f0ac415c9c0 2023-08-25T05:37:50.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.718+0000 7f0abb7fe640 1 -- 172.21.15.55:0/1342893579 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 124) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f0abc0b8ce0 con 0x7f0ac415c9c0 2023-08-25T05:37:50.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.718+0000 7f0abb7fe640 1 --2- 172.21.15.55:0/1342893579 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f0aa4065710 0x7f0aa4067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:50.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.718+0000 7f0abb7fe640 1 -- 172.21.15.55:0/1342893579 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f0abc11e720 con 0x7f0ac415c9c0 2023-08-25T05:37:50.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.718+0000 7f0ac2d9d640 1 --2- 172.21.15.55:0/1342893579 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f0aa4065710 0x7f0aa4067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:50.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.722+0000 7f0ac2d9d640 1 --2- 172.21.15.55:0/1342893579 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f0aa4065710 0x7f0aa4067bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4158e50 tx=0x7f0ab4009040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:50.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.722+0000 7f0abb7fe640 1 -- 172.21.15.55:0/1342893579 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f0abc0ebe40 con 0x7f0ac415c9c0 2023-08-25T05:37:50.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.878+0000 7f0ac9048640 1 -- 172.21.15.55:0/1342893579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ac404dbe0 con 0x7f0ac415c9c0 2023-08-25T05:37:50.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.878+0000 7f0abb7fe640 1 -- 172.21.15.55:0/1342893579 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+19323 (secure 0 0 0) 0x7f0abc0ef460 con 0x7f0ac415c9c0 2023-08-25T05:37:50.883 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:50.883 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":204,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:37:48.096565+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-08-25T05:37:21.649130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-08-25T05:37:22.924825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"202","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:0/4157713130":"2023-08-26T05:37:48.096492+0000","172.21.15.110:0/829410695":"2023-08-26T05:37:48.096492+0000","172.21.15.110:0/3425796478":"2023-08-26T05:37:48.096492+0000","172.21.15.110:0/1202025049":"2023-08-26T05:37:48.096492+0000","172.21.15.110:6833/4020115519":"2023-08-26T05:37:48.096492+0000","172.21.15.110:6832/4020115519":"2023-08-26T05:37:48.096492+0000","172.21.15.110:0/4140183043":"2023-08-26T05:37:48.096492+0000","172.21.15.110:6833/3630541271":"2023-08-26T05:37:41.077473+0000","172.21.15.110:6832/3630541271":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/546735057":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/2752452882":"2023-08-26T05:37:48.096492+0000","172.21.15.110:0/2235590334":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/1481231262":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/19806955":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/645754688":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/4203127837":"2023-08-26T05:37:41.077473+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:37:50.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.882+0000 7f0ac9048640 1 -- 172.21.15.55:0/1342893579 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f0aa4065710 msgr2=0x7f0aa4067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:50.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.882+0000 7f0ac9048640 1 --2- 172.21.15.55:0/1342893579 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f0aa4065710 0x7f0aa4067bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4158e50 tx=0x7f0ab4009040 comp rx=0 tx=0).stop 2023-08-25T05:37:50.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.882+0000 7f0ac9048640 1 -- 172.21.15.55:0/1342893579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac415c9c0 msgr2=0x7f0ac415f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:50.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.882+0000 7f0ac9048640 1 --2- 172.21.15.55:0/1342893579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac415c9c0 0x7f0ac415f040 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f0abc0af040 tx=0x7f0abc019780 comp rx=0 tx=0).stop 2023-08-25T05:37:50.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.882+0000 7f0ac9048640 1 -- 172.21.15.55:0/1342893579 shutdown_connections 2023-08-25T05:37:50.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.882+0000 7f0ac9048640 1 --2- 172.21.15.55:0/1342893579 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f0aa4065710 0x7f0aa4067bd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.882+0000 7f0ac9048640 1 --2- 172.21.15.55:0/1342893579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ac415c9c0 0x7f0ac415f040 unknown :-1 s=CLOSED pgs=2178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.882+0000 7f0ac9048640 1 --2- 172.21.15.55:0/1342893579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ac40cfa70 0x7f0ac4143540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.882+0000 7f0ac9048640 1 --2- 172.21.15.55:0/1342893579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ac406b2b0 0x7f0ac415b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:50.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.882+0000 7f0ac9048640 1 -- 172.21.15.55:0/1342893579 >> 172.21.15.55:0/1342893579 conn(0x7f0ac40d05a0 msgr2=0x7f0ac40b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:50.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.882+0000 7f0ac9048640 1 -- 172.21.15.55:0/1342893579 shutdown_connections 2023-08-25T05:37:50.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:50.882+0000 7f0ac9048640 1 -- 172.21.15.55:0/1342893579 wait complete. 2023-08-25T05:37:50.904 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-25T05:37:51.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.046+0000 7f09c03fa640 1 Processor -- start 2023-08-25T05:37:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.046+0000 7f09c03fa640 1 -- start start 2023-08-25T05:37:51.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.046+0000 7f09c03fa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f09b80ad950 0x7f09b80cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:51.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.046+0000 7f09c03fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f09b80ceeb0 0x7f09b80b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:51.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.046+0000 7f09c03fa640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b80cc880 con 0x7f09b80c89f0 2023-08-25T05:37:51.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.046+0000 7f09c03fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b80b11f0 con 0x7f09b80ceeb0 2023-08-25T05:37:51.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.046+0000 7f09c03fa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b8159d50 con 0x7f09b80ad950 2023-08-25T05:37:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.046+0000 7f09bd995640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f09b80c89f0 0x7f09b80ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34508/0 (socket says 172.21.15.55:34508) 2023-08-25T05:37:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.046+0000 7f09bd995640 1 -- 172.21.15.55:0/2855761875 learned_addr learned my addr 172.21.15.55:0/2855761875 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.046+0000 7f09be997640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f09b80ceeb0 0x7f09b80b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:51.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.046+0000 7f09be196640 1 --2- 172.21.15.55:0/2855761875 >> v2:172.21.15.110:3300/0 conn(0x7f09b80ad950 0x7f09b80cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:51.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.046+0000 7f09bd194640 1 -- 172.21.15.55:0/2855761875 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283854825 0 0) 0x7f09b80cc880 con 0x7f09b80c89f0 2023-08-25T05:37:51.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.046+0000 7f09bd194640 1 -- 172.21.15.55:0/2855761875 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09a4003530 con 0x7f09b80c89f0 2023-08-25T05:37:51.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.046+0000 7f09be997640 1 -- 172.21.15.55:0/2855761875 >> v2:172.21.15.110:3300/0 conn(0x7f09b80ad950 msgr2=0x7f09b80cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:51.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.046+0000 7f09be997640 1 --2- 172.21.15.55:0/2855761875 >> v2:172.21.15.110:3300/0 conn(0x7f09b80ad950 0x7f09b80cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:51.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.046+0000 7f09be997640 1 -- 172.21.15.55:0/2855761875 >> v1:172.21.15.55:6789/0 conn(0x7f09b80c89f0 legacy=0x7f09b80ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:51.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.046+0000 7f09be997640 1 -- 172.21.15.55:0/2855761875 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b80ccb60 con 0x7f09b80ceeb0 2023-08-25T05:37:51.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.046+0000 7f09be196640 1 --2- 172.21.15.55:0/2855761875 >> v2:172.21.15.110:3300/0 conn(0x7f09b80ad950 0x7f09b80cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:51.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.050+0000 7f09be997640 1 --2- 172.21.15.55:0/2855761875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09b80ceeb0 0x7f09b80b1640 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f09b80cd4b0 tx=0x7f09b001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8df8b3434dd9a09 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:51.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.050+0000 7f09bd194640 1 -- 172.21.15.55:0/2855761875 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b00a5820 con 0x7f09b80ceeb0 2023-08-25T05:37:51.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.050+0000 7f09bd194640 1 -- 172.21.15.55:0/2855761875 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b00a5980 con 0x7f09b80ceeb0 2023-08-25T05:37:51.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.050+0000 7f09bd194640 1 -- 172.21.15.55:0/2855761875 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b00a5d10 con 0x7f09b80ceeb0 2023-08-25T05:37:51.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.050+0000 7f09c03fa640 1 -- 172.21.15.55:0/2855761875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09b80ceeb0 msgr2=0x7f09b80b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:51.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.050+0000 7f09c03fa640 1 --2- 172.21.15.55:0/2855761875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09b80ceeb0 0x7f09b80b1640 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f09b80cd4b0 tx=0x7f09b001c850 comp rx=0 tx=0).stop 2023-08-25T05:37:51.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.050+0000 7f09c03fa640 1 -- 172.21.15.55:0/2855761875 shutdown_connections 2023-08-25T05:37:51.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.050+0000 7f09c03fa640 1 --2- 172.21.15.55:0/2855761875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09b80ceeb0 0x7f09b80b1640 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:51.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.050+0000 7f09c03fa640 1 --2- 172.21.15.55:0/2855761875 >> v2:172.21.15.110:3300/0 conn(0x7f09b80ad950 0x7f09b80cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:51.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.050+0000 7f09c03fa640 1 -- 172.21.15.55:0/2855761875 >> 172.21.15.55:0/2855761875 conn(0x7f09b8069d00 msgr2=0x7f09b806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:51.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.050+0000 7f09c03fa640 1 -- 172.21.15.55:0/2855761875 shutdown_connections 2023-08-25T05:37:51.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.050+0000 7f09c03fa640 1 -- 172.21.15.55:0/2855761875 wait complete. 2023-08-25T05:37:51.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09c03fa640 1 Processor -- start 2023-08-25T05:37:51.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09c03fa640 1 -- start start 2023-08-25T05:37:51.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09c03fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09b80ad950 0x7f09b8097ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:51.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09c03fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09b80c89f0 0x7f09b80c2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09c03fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09b80ceeb0 0x7f09b80c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09c03fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b8156c10 con 0x7f09b80c89f0 2023-08-25T05:37:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09c03fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b80c60a0 con 0x7f09b80ceeb0 2023-08-25T05:37:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09c03fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b8156e60 con 0x7f09b80ad950 2023-08-25T05:37:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09bd995640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09b80c89f0 0x7f09b80c2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09bd995640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09b80c89f0 0x7f09b80c2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53078/0 (socket says 172.21.15.55:53078) 2023-08-25T05:37:51.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09bd995640 1 -- 172.21.15.55:0/3016895068 learned_addr learned my addr 172.21.15.55:0/3016895068 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:51.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09be997640 1 --2- 172.21.15.55:0/3016895068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09b80ceeb0 0x7f09b80c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09be196640 1 --2- 172.21.15.55:0/3016895068 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09b80ad950 0x7f09b8097ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09bd995640 1 -- 172.21.15.55:0/3016895068 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09b80ad950 msgr2=0x7f09b8097ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09bd995640 1 --2- 172.21.15.55:0/3016895068 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09b80ad950 0x7f09b8097ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09bd995640 1 -- 172.21.15.55:0/3016895068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09b80ceeb0 msgr2=0x7f09b80c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09bd995640 1 --2- 172.21.15.55:0/3016895068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09b80ceeb0 0x7f09b80c3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09bd995640 1 -- 172.21.15.55:0/3016895068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b4009420 con 0x7f09b80c89f0 2023-08-25T05:37:51.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09be196640 1 --2- 172.21.15.55:0/3016895068 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09b80ad950 0x7f09b8097ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:51.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09bd995640 1 --2- 172.21.15.55:0/3016895068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09b80c89f0 0x7f09b80c2d80 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f09a800c4d0 tx=0x7f09a800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:51.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09aeffd640 1 -- 172.21.15.55:0/3016895068 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a8005cf0 con 0x7f09b80c89f0 2023-08-25T05:37:51.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09aeffd640 1 -- 172.21.15.55:0/3016895068 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a8005e50 con 0x7f09b80c89f0 2023-08-25T05:37:51.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09aeffd640 1 -- 172.21.15.55:0/3016895068 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a8007270 con 0x7f09b80c89f0 2023-08-25T05:37:51.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09c03fa640 1 -- 172.21.15.55:0/3016895068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b0009a70 con 0x7f09b80c89f0 2023-08-25T05:37:51.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09c03fa640 1 -- 172.21.15.55:0/3016895068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b8157420 con 0x7f09b80c89f0 2023-08-25T05:37:51.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.054+0000 7f09c03fa640 1 -- 172.21.15.55:0/3016895068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b804dbe0 con 0x7f09b80c89f0 2023-08-25T05:37:51.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.058+0000 7f09aeffd640 1 -- 172.21.15.55:0/3016895068 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 124) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f09a80073d0 con 0x7f09b80c89f0 2023-08-25T05:37:51.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.058+0000 7f09aeffd640 1 --2- 172.21.15.55:0/3016895068 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f099c065710 0x7f099c067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:51.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.058+0000 7f09aeffd640 1 -- 172.21.15.55:0/3016895068 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6750+0+0 (secure 0 0 0) 0x7f09a80825a0 con 0x7f09b80c89f0 2023-08-25T05:37:51.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.058+0000 7f09be196640 1 --2- 172.21.15.55:0/3016895068 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f099c065710 0x7f099c067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:51.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.058+0000 7f09be196640 1 --2- 172.21.15.55:0/3016895068 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f099c065710 0x7f099c067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f09b4009bd0 tx=0x7f09b4008040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:51.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.062+0000 7f09aeffd640 1 -- 172.21.15.55:0/3016895068 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f09a804fe00 con 0x7f09b80c89f0 2023-08-25T05:37:51.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.250+0000 7f09c03fa640 1 -- 172.21.15.55:0/3016895068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f09b80cc330 con 0x7f09b80c89f0 2023-08-25T05:37:51.255 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-08-25T05:37:51.254+0000 7f7f18c38640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-25T05:37:51.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.266+0000 7f09aeffd640 1 -- 172.21.15.55:0/3016895068 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v101) v1 ==== 161+0+0 (secure 0 0 0) 0x7f09a8053420 con 0x7f09b80c89f0 2023-08-25T05:37:51.269 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-25T05:37:51.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.266+0000 7f09c03fa640 1 -- 172.21.15.55:0/3016895068 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f099c065710 msgr2=0x7f099c067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:51.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.266+0000 7f09c03fa640 1 --2- 172.21.15.55:0/3016895068 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f099c065710 0x7f099c067bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f09b4009bd0 tx=0x7f09b4008040 comp rx=0 tx=0).stop 2023-08-25T05:37:51.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.266+0000 7f09c03fa640 1 -- 172.21.15.55:0/3016895068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09b80c89f0 msgr2=0x7f09b80c2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:51.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.266+0000 7f09c03fa640 1 --2- 172.21.15.55:0/3016895068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09b80c89f0 0x7f09b80c2d80 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7f09a800c4d0 tx=0x7f09a800c990 comp rx=0 tx=0).stop 2023-08-25T05:37:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.266+0000 7f09c03fa640 1 -- 172.21.15.55:0/3016895068 shutdown_connections 2023-08-25T05:37:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.266+0000 7f09c03fa640 1 --2- 172.21.15.55:0/3016895068 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f099c065710 0x7f099c067bd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.266+0000 7f09c03fa640 1 --2- 172.21.15.55:0/3016895068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09b80ceeb0 0x7f09b80c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.266+0000 7f09c03fa640 1 --2- 172.21.15.55:0/3016895068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09b80c89f0 0x7f09b80c2d80 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.266+0000 7f09c03fa640 1 --2- 172.21.15.55:0/3016895068 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09b80ad950 0x7f09b8097ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.266+0000 7f09c03fa640 1 -- 172.21.15.55:0/3016895068 >> 172.21.15.55:0/3016895068 conn(0x7f09b8069d00 msgr2=0x7f09b80ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:51.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.266+0000 7f09c03fa640 1 -- 172.21.15.55:0/3016895068 shutdown_connections 2023-08-25T05:37:51.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.270+0000 7f09c03fa640 1 -- 172.21.15.55:0/3016895068 wait complete. 2023-08-25T05:37:51.273 INFO:tasks.ceph.mds.c.smithi055.stderr: -4122> 2023-08-25T05:37:30.479+0000 7f8b34f73640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-25T05:37:51.291 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-25T05:37:51.323 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-08-25T05:37:51.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.434+0000 7f112bf37640 1 Processor -- start 2023-08-25T05:37:51.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.438+0000 7f112bf37640 1 -- start start 2023-08-25T05:37:51.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.438+0000 7f112bf37640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f11240cb020 0x7f11240c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:51.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.438+0000 7f112bf37640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f112406c720 0x7f112406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:51.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.438+0000 7f112bf37640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11240cbca0 con 0x7f11240cdd50 2023-08-25T05:37:51.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.438+0000 7f112bf37640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11240c9470 con 0x7f11240cb020 2023-08-25T05:37:51.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.438+0000 7f112bf37640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11240ce1e0 con 0x7f112406c720 2023-08-25T05:37:51.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.438+0000 7f112a4d4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f112406c720 0x7f112406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:51.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.438+0000 7f112a4d4640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f112406c720 0x7f112406cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:55816/0 (socket says 172.21.15.55:55816) 2023-08-25T05:37:51.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.438+0000 7f112a4d4640 1 -- 172.21.15.55:0/1847847990 learned_addr learned my addr 172.21.15.55:0/1847847990 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:51.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.438+0000 7f1129cd3640 1 --2- 172.21.15.55:0/1847847990 >> v2:172.21.15.110:3300/0 conn(0x7f11240cb020 0x7f11240c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:51.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.438+0000 7f112a4d4640 1 -- 172.21.15.55:0/1847847990 >> v2:172.21.15.110:3300/0 conn(0x7f11240cb020 msgr2=0x7f11240c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:51.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.438+0000 7f112a4d4640 1 --2- 172.21.15.55:0/1847847990 >> v2:172.21.15.110:3300/0 conn(0x7f11240cb020 0x7f11240c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:51.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.438+0000 7f112a4d4640 1 -- 172.21.15.55:0/1847847990 >> v1:172.21.15.110:6789/0 conn(0x7f11240cdd50 legacy=0x7f11240cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:51.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.438+0000 7f112a4d4640 1 -- 172.21.15.55:0/1847847990 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112406d070 con 0x7f112406c720 2023-08-25T05:37:51.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.442+0000 7f112a4d4640 1 --2- 172.21.15.55:0/1847847990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f112406c720 0x7f112406cb30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f111c009e50 tx=0x7f111c01eb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3623446fb26264e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:51.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.442+0000 7f1128cd1640 1 -- 172.21.15.55:0/1847847990 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c0a7950 con 0x7f112406c720 2023-08-25T05:37:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.442+0000 7f1128cd1640 1 -- 172.21.15.55:0/1847847990 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111c0a7ab0 con 0x7f112406c720 2023-08-25T05:37:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.442+0000 7f1128cd1640 1 -- 172.21.15.55:0/1847847990 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c0a7e40 con 0x7f112406c720 2023-08-25T05:37:51.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.442+0000 7f112bf37640 1 -- 172.21.15.55:0/1847847990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f112406c720 msgr2=0x7f112406cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.442+0000 7f112bf37640 1 --2- 172.21.15.55:0/1847847990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f112406c720 0x7f112406cb30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f111c009e50 tx=0x7f111c01eb90 comp rx=0 tx=0).stop 2023-08-25T05:37:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.442+0000 7f112bf37640 1 -- 172.21.15.55:0/1847847990 shutdown_connections 2023-08-25T05:37:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.442+0000 7f112bf37640 1 --2- 172.21.15.55:0/1847847990 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f112406c720 0x7f112406cb30 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.442+0000 7f112bf37640 1 --2- 172.21.15.55:0/1847847990 >> v2:172.21.15.110:3300/0 conn(0x7f11240cb020 0x7f11240c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.442+0000 7f112bf37640 1 -- 172.21.15.55:0/1847847990 >> 172.21.15.55:0/1847847990 conn(0x7f1124069900 msgr2=0x7f1124069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.442+0000 7f112bf37640 1 -- 172.21.15.55:0/1847847990 shutdown_connections 2023-08-25T05:37:51.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.442+0000 7f112bf37640 1 -- 172.21.15.55:0/1847847990 wait complete. 2023-08-25T05:37:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.442+0000 7f112bf37640 1 Processor -- start 2023-08-25T05:37:51.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.442+0000 7f112bf37640 1 -- start start 2023-08-25T05:37:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f112bf37640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f112406c720 0x7f1124155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f112bf37640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11240cb020 0x7f1124163af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f112bf37640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11240cdd50 0x7f1124164030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f112bf37640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1124155750 con 0x7f11240cb020 2023-08-25T05:37:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f112bf37640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112409b2c0 con 0x7f112406c720 2023-08-25T05:37:51.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f112bf37640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112409aa20 con 0x7f11240cdd50 2023-08-25T05:37:51.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f11294d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11240cb020 0x7f1124163af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f11294d2640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11240cb020 0x7f1124163af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53098/0 (socket says 172.21.15.55:53098) 2023-08-25T05:37:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f11294d2640 1 -- 172.21.15.55:0/898014028 learned_addr learned my addr 172.21.15.55:0/898014028 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f112a4d4640 1 --2- 172.21.15.55:0/898014028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11240cdd50 0x7f1124164030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f1129cd3640 1 --2- 172.21.15.55:0/898014028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f112406c720 0x7f1124155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f11294d2640 1 -- 172.21.15.55:0/898014028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11240cdd50 msgr2=0x7f1124164030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f11294d2640 1 --2- 172.21.15.55:0/898014028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11240cdd50 0x7f1124164030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:51.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f11294d2640 1 -- 172.21.15.55:0/898014028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f112406c720 msgr2=0x7f1124155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f11294d2640 1 --2- 172.21.15.55:0/898014028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f112406c720 0x7f1124155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f11294d2640 1 -- 172.21.15.55:0/898014028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c009b30 con 0x7f11240cb020 2023-08-25T05:37:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f11294d2640 1 --2- 172.21.15.55:0/898014028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11240cb020 0x7f1124163af0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f111400c3c0 tx=0x7f111400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f111a7fc640 1 -- 172.21.15.55:0/898014028 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11140052d0 con 0x7f11240cb020 2023-08-25T05:37:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f111a7fc640 1 -- 172.21.15.55:0/898014028 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1114005430 con 0x7f11240cb020 2023-08-25T05:37:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f111a7fc640 1 -- 172.21.15.55:0/898014028 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1114003840 con 0x7f11240cb020 2023-08-25T05:37:51.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f112bf37640 1 -- 172.21.15.55:0/898014028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112409ad00 con 0x7f11240cb020 2023-08-25T05:37:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f112bf37640 1 -- 172.21.15.55:0/898014028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11240c1f90 con 0x7f11240cb020 2023-08-25T05:37:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.446+0000 7f112bf37640 1 -- 172.21.15.55:0/898014028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11240c21b0 con 0x7f11240cb020 2023-08-25T05:37:51.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.450+0000 7f111a7fc640 1 -- 172.21.15.55:0/898014028 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 124) v1 ==== 85008+0+0 (secure 0 0 0) 0x7f11140039a0 con 0x7f11240cb020 2023-08-25T05:37:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.450+0000 7f111a7fc640 1 --2- 172.21.15.55:0/898014028 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f1108065710 0x7f1108067bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.450+0000 7f111a7fc640 1 -- 172.21.15.55:0/898014028 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f1114082690 con 0x7f11240cb020 2023-08-25T05:37:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.450+0000 7f1129cd3640 1 --2- 172.21.15.55:0/898014028 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f1108065710 0x7f1108067bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:51.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.450+0000 7f1129cd3640 1 --2- 172.21.15.55:0/898014028 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f1108065710 0x7f1108067bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1120009b40 tx=0x7f1120006f90 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:51.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.454+0000 7f111a7fc640 1 -- 172.21.15.55:0/898014028 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f111404fe00 con 0x7f11240cb020 2023-08-25T05:37:51.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:51.654+0000 7f112bf37640 1 -- 172.21.15.55:0/898014028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1124073ec0 con 0x7f11240cb020 2023-08-25T05:37:52.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.326+0000 7f111a7fc640 1 -- 172.21.15.55:0/898014028 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f11140501d0 con 0x7f11240cb020 2023-08-25T05:37:52.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.330+0000 7f111a7fc640 1 -- 172.21.15.55:0/898014028 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v102) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1114053890 con 0x7f11240cb020 2023-08-25T05:37:52.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.330+0000 7f112bf37640 1 -- 172.21.15.55:0/898014028 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f1108065710 msgr2=0x7f1108067bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:52.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.330+0000 7f112bf37640 1 --2- 172.21.15.55:0/898014028 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f1108065710 0x7f1108067bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1120009b40 tx=0x7f1120006f90 comp rx=0 tx=0).stop 2023-08-25T05:37:52.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.330+0000 7f112bf37640 1 -- 172.21.15.55:0/898014028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11240cb020 msgr2=0x7f1124163af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:52.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.330+0000 7f112bf37640 1 --2- 172.21.15.55:0/898014028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11240cb020 0x7f1124163af0 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f111400c3c0 tx=0x7f111400c880 comp rx=0 tx=0).stop 2023-08-25T05:37:52.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.330+0000 7f112bf37640 1 -- 172.21.15.55:0/898014028 shutdown_connections 2023-08-25T05:37:52.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.330+0000 7f112bf37640 1 --2- 172.21.15.55:0/898014028 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f1108065710 0x7f1108067bd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:52.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.330+0000 7f112bf37640 1 --2- 172.21.15.55:0/898014028 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f11240cdd50 0x7f1124164030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:52.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.330+0000 7f112bf37640 1 --2- 172.21.15.55:0/898014028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11240cb020 0x7f1124163af0 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:52.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.330+0000 7f112bf37640 1 --2- 172.21.15.55:0/898014028 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f112406c720 0x7f1124155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:52.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.330+0000 7f112bf37640 1 -- 172.21.15.55:0/898014028 >> 172.21.15.55:0/898014028 conn(0x7f1124069900 msgr2=0x7f11241589f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:52.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.330+0000 7f112bf37640 1 -- 172.21.15.55:0/898014028 shutdown_connections 2023-08-25T05:37:52.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.330+0000 7f112bf37640 1 -- 172.21.15.55:0/898014028 wait complete. 2023-08-25T05:37:52.358 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-25T05:37:52.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.550+0000 7fdfd5111640 1 Processor -- start 2023-08-25T05:37:52.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.550+0000 7fdfd5111640 1 -- start start 2023-08-25T05:37:52.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.550+0000 7fdfd5111640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdfd0155740 0x7fdfd015c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:52.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.550+0000 7fdfd5111640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdfd006fb50 0x7fdfd00aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:52.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.550+0000 7fdfd5111640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd015fa50 con 0x7fdfd0155360 2023-08-25T05:37:52.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.550+0000 7fdfd5111640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd015f2a0 con 0x7fdfd006fb50 2023-08-25T05:37:52.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.550+0000 7fdfd5111640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd015f490 con 0x7fdfd0155740 2023-08-25T05:37:52.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.550+0000 7fdfcf59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdfd006fb50 0x7fdfd00aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:52.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.550+0000 7fdfcf59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdfd006fb50 0x7fdfd00aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53110/0 (socket says 172.21.15.55:53110) 2023-08-25T05:37:52.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.550+0000 7fdfcf59e640 1 -- 172.21.15.55:0/1426688375 learned_addr learned my addr 172.21.15.55:0/1426688375 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:52.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.550+0000 7fdfc7fff640 1 --2- 172.21.15.55:0/1426688375 >> v2:172.21.15.110:3300/0 conn(0x7fdfd0155740 0x7fdfd015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:52.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.550+0000 7fdfcf59e640 1 -- 172.21.15.55:0/1426688375 >> v2:172.21.15.110:3300/0 conn(0x7fdfd0155740 msgr2=0x7fdfd015c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:52.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.550+0000 7fdfcf59e640 1 --2- 172.21.15.55:0/1426688375 >> v2:172.21.15.110:3300/0 conn(0x7fdfd0155740 0x7fdfd015c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:52.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.550+0000 7fdfcf59e640 1 -- 172.21.15.55:0/1426688375 >> v1:172.21.15.110:6789/0 conn(0x7fdfd0155360 legacy=0x7fdfd015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:52.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.550+0000 7fdfcf59e640 1 -- 172.21.15.55:0/1426688375 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd015f770 con 0x7fdfd006fb50 2023-08-25T05:37:52.555 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.550+0000 7fdfc7fff640 1 --2- 172.21.15.55:0/1426688375 >> v2:172.21.15.110:3300/0 conn(0x7fdfd0155740 0x7fdfd015c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:52.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.554+0000 7fdfcf59e640 1 --2- 172.21.15.55:0/1426688375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd006fb50 0x7fdfd00aff90 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00b0fe0 tx=0x7fdfc801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93384fd1df21eb42 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:52.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.554+0000 7fdfce59c640 1 -- 172.21.15.55:0/1426688375 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80a5660 con 0x7fdfd006fb50 2023-08-25T05:37:52.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.554+0000 7fdfce59c640 1 -- 172.21.15.55:0/1426688375 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc80a57c0 con 0x7fdfd006fb50 2023-08-25T05:37:52.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.554+0000 7fdfce59c640 1 -- 172.21.15.55:0/1426688375 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80a5b50 con 0x7fdfd006fb50 2023-08-25T05:37:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.554+0000 7fdfd5111640 1 -- 172.21.15.55:0/1426688375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd006fb50 msgr2=0x7fdfd00aff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.554+0000 7fdfd5111640 1 --2- 172.21.15.55:0/1426688375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd006fb50 0x7fdfd00aff90 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00b0fe0 tx=0x7fdfc801c8b0 comp rx=0 tx=0).stop 2023-08-25T05:37:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.554+0000 7fdfd5111640 1 -- 172.21.15.55:0/1426688375 shutdown_connections 2023-08-25T05:37:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.554+0000 7fdfd5111640 1 --2- 172.21.15.55:0/1426688375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd006fb50 0x7fdfd00aff90 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:52.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.554+0000 7fdfd5111640 1 --2- 172.21.15.55:0/1426688375 >> v2:172.21.15.110:3300/0 conn(0x7fdfd0155740 0x7fdfd015c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:52.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.554+0000 7fdfd5111640 1 -- 172.21.15.55:0/1426688375 >> 172.21.15.55:0/1426688375 conn(0x7fdfd00caf90 msgr2=0x7fdfd00cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:52.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.554+0000 7fdfd5111640 1 -- 172.21.15.55:0/1426688375 shutdown_connections 2023-08-25T05:37:52.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.554+0000 7fdfd5111640 1 -- 172.21.15.55:0/1426688375 wait complete. 2023-08-25T05:37:52.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfd5111640 1 Processor -- start 2023-08-25T05:37:52.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfd5111640 1 -- start start 2023-08-25T05:37:52.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfd5111640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdfd006fb50 0x7fdfd0152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:52.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfd5111640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd0155360 0x7fdfd00c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:52.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfd5111640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdfd0155740 0x7fdfd00c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:52.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfd5111640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd00c3c30 con 0x7fdfd0155360 2023-08-25T05:37:52.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfd5111640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd00c7560 con 0x7fdfd006fb50 2023-08-25T05:37:52.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfd5111640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd0152680 con 0x7fdfd0155740 2023-08-25T05:37:52.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfc7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd0155360 0x7fdfd00c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:52.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfc7fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd0155360 0x7fdfd00c4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53114/0 (socket says 172.21.15.55:53114) 2023-08-25T05:37:52.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfc7fff640 1 -- 172.21.15.55:0/1567988316 learned_addr learned my addr 172.21.15.55:0/1567988316 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:52.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfcf59e640 1 --2- 172.21.15.55:0/1567988316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdfd0155740 0x7fdfd00c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:52.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfced9d640 1 --2- 172.21.15.55:0/1567988316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdfd006fb50 0x7fdfd0152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:52.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfc7fff640 1 -- 172.21.15.55:0/1567988316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdfd0155740 msgr2=0x7fdfd00c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:52.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfc7fff640 1 --2- 172.21.15.55:0/1567988316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdfd0155740 0x7fdfd00c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:52.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfc7fff640 1 -- 172.21.15.55:0/1567988316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdfd006fb50 msgr2=0x7fdfd0152140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:52.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfc7fff640 1 --2- 172.21.15.55:0/1567988316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdfd006fb50 0x7fdfd0152140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:52.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfc7fff640 1 -- 172.21.15.55:0/1567988316 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc8009b30 con 0x7fdfd0155360 2023-08-25T05:37:52.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfced9d640 1 --2- 172.21.15.55:0/1567988316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdfd006fb50 0x7fdfd0152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:52.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfcf59e640 1 --2- 172.21.15.55:0/1567988316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdfd0155740 0x7fdfd00c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfc7fff640 1 --2- 172.21.15.55:0/1567988316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd0155360 0x7fdfd00c4050 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800e870 tx=0x7fdfb800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfc77fe640 1 -- 172.21.15.55:0/1567988316 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb800c8d0 con 0x7fdfd0155360 2023-08-25T05:37:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfc77fe640 1 -- 172.21.15.55:0/1567988316 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb800ca30 con 0x7fdfd0155360 2023-08-25T05:37:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfc77fe640 1 -- 172.21.15.55:0/1567988316 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb800cdc0 con 0x7fdfd0155360 2023-08-25T05:37:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfd5111640 1 -- 172.21.15.55:0/1567988316 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd00c6fa0 con 0x7fdfd0155360 2023-08-25T05:37:52.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfd5111640 1 -- 172.21.15.55:0/1567988316 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd00c3850 con 0x7fdfd0155360 2023-08-25T05:37:52.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.558+0000 7fdfd5111640 1 -- 172.21.15.55:0/1567988316 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd00c36b0 con 0x7fdfd0155360 2023-08-25T05:37:52.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.562+0000 7fdfc77fe640 1 -- 172.21.15.55:0/1567988316 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fdfb8013410 con 0x7fdfd0155360 2023-08-25T05:37:52.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.562+0000 7fdfc77fe640 1 --2- 172.21.15.55:0/1567988316 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fdfb00657a0 0x7fdfb0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:52.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.562+0000 7fdfc77fe640 1 -- 172.21.15.55:0/1567988316 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 6836+0+0 (secure 0 0 0) 0x7fdfb8083140 con 0x7fdfd0155360 2023-08-25T05:37:52.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.562+0000 7fdfced9d640 1 --2- 172.21.15.55:0/1567988316 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fdfb00657a0 0x7fdfb0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:52.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.562+0000 7fdfced9d640 1 --2- 172.21.15.55:0/1567988316 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fdfb00657a0 0x7fdfb0067c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0000f70 tx=0x7fdfc0009040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:52.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.566+0000 7fdfc77fe640 1 -- 172.21.15.55:0/1567988316 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fdfd00c36b0 con 0x7fdfd0155360 2023-08-25T05:37:52.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:52.722+0000 7fdfd5111640 1 -- 172.21.15.55:0/1567988316 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdfd00c36b0 con 0x7fdfd0155360 2023-08-25T05:37:53.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.334+0000 7fdfc77fe640 1 -- 172.21.15.55:0/1567988316 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v206) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdfd00c36b0 con 0x7fdfd0155360 2023-08-25T05:37:53.337 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2023-08-25T05:37:53.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.338+0000 7fdfd5111640 1 -- 172.21.15.55:0/1567988316 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fdfb00657a0 msgr2=0x7fdfb0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:53.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.338+0000 7fdfd5111640 1 --2- 172.21.15.55:0/1567988316 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fdfb00657a0 0x7fdfb0067c60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0000f70 tx=0x7fdfc0009040 comp rx=0 tx=0).stop 2023-08-25T05:37:53.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.338+0000 7fdfd5111640 1 -- 172.21.15.55:0/1567988316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd0155360 msgr2=0x7fdfd00c4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:53.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.338+0000 7fdfd5111640 1 --2- 172.21.15.55:0/1567988316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd0155360 0x7fdfd00c4050 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800e870 tx=0x7fdfb800ed30 comp rx=0 tx=0).stop 2023-08-25T05:37:53.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.338+0000 7fdfd5111640 1 -- 172.21.15.55:0/1567988316 shutdown_connections 2023-08-25T05:37:53.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.338+0000 7fdfd5111640 1 --2- 172.21.15.55:0/1567988316 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fdfb00657a0 0x7fdfb0067c60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:53.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.338+0000 7fdfd5111640 1 --2- 172.21.15.55:0/1567988316 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdfd0155740 0x7fdfd00c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:53.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.338+0000 7fdfd5111640 1 --2- 172.21.15.55:0/1567988316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfd0155360 0x7fdfd00c4050 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:53.341 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.338+0000 7fdfd5111640 1 --2- 172.21.15.55:0/1567988316 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdfd006fb50 0x7fdfd0152140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:53.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.338+0000 7fdfd5111640 1 -- 172.21.15.55:0/1567988316 >> 172.21.15.55:0/1567988316 conn(0x7fdfd00caf90 msgr2=0x7fdfd00b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:53.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.338+0000 7fdfd5111640 1 -- 172.21.15.55:0/1567988316 shutdown_connections 2023-08-25T05:37:53.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.338+0000 7fdfd5111640 1 -- 172.21.15.55:0/1567988316 wait complete. 2023-08-25T05:37:53.365 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-25T05:37:53.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.514+0000 7f95fe6a1640 1 Processor -- start 2023-08-25T05:37:53.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.514+0000 7f95fe6a1640 1 -- start start 2023-08-25T05:37:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.514+0000 7f95fe6a1640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f95f80b4080 0x7f95f80b4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.514+0000 7f95fe6a1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f95f80b23b0 0x7f95f80b2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.514+0000 7f95fe6a1640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f80b1b90 con 0x7f95f8160120 2023-08-25T05:37:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.514+0000 7f95fe6a1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f80b4a50 con 0x7f95f80b23b0 2023-08-25T05:37:53.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.514+0000 7f95fe6a1640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f80b1f20 con 0x7f95f80b4080 2023-08-25T05:37:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.518+0000 7f95fdea0640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f95f80b23b0 0x7f95f80b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:53.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.518+0000 7f95fd69f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f95f8160120 0x7f95f80b1480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34528/0 (socket says 172.21.15.55:34528) 2023-08-25T05:37:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.518+0000 7f95fd69f640 1 -- 172.21.15.55:0/2044912205 learned_addr learned my addr 172.21.15.55:0/2044912205 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.518+0000 7f95fce9e640 1 --2- 172.21.15.55:0/2044912205 >> v2:172.21.15.110:3300/0 conn(0x7f95f80b4080 0x7f95f80b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.518+0000 7f95fdea0640 1 -- 172.21.15.55:0/2044912205 >> v2:172.21.15.110:3300/0 conn(0x7f95f80b4080 msgr2=0x7f95f80b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.518+0000 7f95fdea0640 1 --2- 172.21.15.55:0/2044912205 >> v2:172.21.15.110:3300/0 conn(0x7f95f80b4080 0x7f95f80b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.518+0000 7f95fdea0640 1 -- 172.21.15.55:0/2044912205 >> v1:172.21.15.55:6789/0 conn(0x7f95f8160120 legacy=0x7f95f80b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.518+0000 7f95fdea0640 1 -- 172.21.15.55:0/2044912205 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f80cddf0 con 0x7f95f80b23b0 2023-08-25T05:37:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.518+0000 7f95effff640 1 -- 172.21.15.55:0/2044912205 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2303025591 0 0) 0x7f95f40012a0 con 0x7f95f8160120 2023-08-25T05:37:53.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.518+0000 7f95fdea0640 1 --2- 172.21.15.55:0/2044912205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f80b23b0 0x7f95f80b2840 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009d90 tx=0x7f95f001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a831b6ea100f46 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:53.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.518+0000 7f95effff640 1 -- 172.21.15.55:0/2044912205 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f00a59a0 con 0x7f95f80b23b0 2023-08-25T05:37:53.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.518+0000 7f95effff640 1 -- 172.21.15.55:0/2044912205 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f00a5b00 con 0x7f95f80b23b0 2023-08-25T05:37:53.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.518+0000 7f95effff640 1 -- 172.21.15.55:0/2044912205 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f00a5e90 con 0x7f95f80b23b0 2023-08-25T05:37:53.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fe6a1640 1 -- 172.21.15.55:0/2044912205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f80b23b0 msgr2=0x7f95f80b2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:53.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fe6a1640 1 --2- 172.21.15.55:0/2044912205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f80b23b0 0x7f95f80b2840 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009d90 tx=0x7f95f001c8e0 comp rx=0 tx=0).stop 2023-08-25T05:37:53.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fe6a1640 1 -- 172.21.15.55:0/2044912205 shutdown_connections 2023-08-25T05:37:53.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fe6a1640 1 --2- 172.21.15.55:0/2044912205 >> v2:172.21.15.110:3300/0 conn(0x7f95f80b4080 0x7f95f80b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:53.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fe6a1640 1 --2- 172.21.15.55:0/2044912205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f80b23b0 0x7f95f80b2840 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:53.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fe6a1640 1 -- 172.21.15.55:0/2044912205 >> 172.21.15.55:0/2044912205 conn(0x7f95f809b950 msgr2=0x7f95f80d2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:53.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fe6a1640 1 -- 172.21.15.55:0/2044912205 shutdown_connections 2023-08-25T05:37:53.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fe6a1640 1 -- 172.21.15.55:0/2044912205 wait complete. 2023-08-25T05:37:53.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fe6a1640 1 Processor -- start 2023-08-25T05:37:53.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fe6a1640 1 -- start start 2023-08-25T05:37:53.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fe6a1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f80b23b0 0x7f95f8158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:53.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fe6a1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95f80b4080 0x7f95f81539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:53.526 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fe6a1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f8160120 0x7f95f8153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:53.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fe6a1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f81537c0 con 0x7f95f8160120 2023-08-25T05:37:53.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fe6a1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80c8e80 con 0x7f95f80b23b0 2023-08-25T05:37:53.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fe6a1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f80c88c0 con 0x7f95f80b4080 2023-08-25T05:37:53.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fdea0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f8160120 0x7f95f8153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:53.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fdea0640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f8160120 0x7f95f8153ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53136/0 (socket says 172.21.15.55:53136) 2023-08-25T05:37:53.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fdea0640 1 -- 172.21.15.55:0/4216643458 learned_addr learned my addr 172.21.15.55:0/4216643458 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:53.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fd69f640 1 --2- 172.21.15.55:0/4216643458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f80b23b0 0x7f95f8158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:53.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fce9e640 1 --2- 172.21.15.55:0/4216643458 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95f80b4080 0x7f95f81539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:53.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fdea0640 1 -- 172.21.15.55:0/4216643458 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95f80b4080 msgr2=0x7f95f81539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fdea0640 1 --2- 172.21.15.55:0/4216643458 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95f80b4080 0x7f95f81539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fdea0640 1 -- 172.21.15.55:0/4216643458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f80b23b0 msgr2=0x7f95f8158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fdea0640 1 --2- 172.21.15.55:0/4216643458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f80b23b0 0x7f95f8158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fdea0640 1 -- 172.21.15.55:0/4216643458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f0009a70 con 0x7f95f8160120 2023-08-25T05:37:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.522+0000 7f95fce9e640 1 --2- 172.21.15.55:0/4216643458 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95f80b4080 0x7f95f81539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.526+0000 7f95fdea0640 1 --2- 172.21.15.55:0/4216643458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f8160120 0x7f95f8153ef0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009d90 tx=0x7f95f0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.526+0000 7f95edffb640 1 -- 172.21.15.55:0/4216643458 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0009450 con 0x7f95f8160120 2023-08-25T05:37:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.526+0000 7f95edffb640 1 -- 172.21.15.55:0/4216643458 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f00adc80 con 0x7f95f8160120 2023-08-25T05:37:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.526+0000 7f95edffb640 1 -- 172.21.15.55:0/4216643458 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f00b8420 con 0x7f95f8160120 2023-08-25T05:37:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.526+0000 7f95fe6a1640 1 -- 172.21.15.55:0/4216643458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f80c8ba0 con 0x7f95f8160120 2023-08-25T05:37:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.526+0000 7f95fe6a1640 1 -- 172.21.15.55:0/4216643458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f8151950 con 0x7f95f8160120 2023-08-25T05:37:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.526+0000 7f95fe6a1640 1 -- 172.21.15.55:0/4216643458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f8151b40 con 0x7f95f8160120 2023-08-25T05:37:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.526+0000 7f95edffb640 1 -- 172.21.15.55:0/4216643458 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f95f00b8580 con 0x7f95f8160120 2023-08-25T05:37:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.526+0000 7f95edffb640 1 --2- 172.21.15.55:0/4216643458 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f95dc0657a0 0x7f95dc067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.526+0000 7f95edffb640 1 -- 172.21.15.55:0/4216643458 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(206..206 src has 1..206) v4 ==== 6398+0+0 (secure 0 0 0) 0x7f95f011e750 con 0x7f95f8160120 2023-08-25T05:37:53.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.526+0000 7f95fd69f640 1 --2- 172.21.15.55:0/4216643458 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f95dc0657a0 0x7f95dc067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:53.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.530+0000 7f95fd69f640 1 --2- 172.21.15.55:0/4216643458 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f95dc0657a0 0x7f95dc067c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f95f8151580 tx=0x7f95f4009040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:53.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.530+0000 7f95edffb640 1 -- 172.21.15.55:0/4216643458 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f95f00ebfc0 con 0x7f95f8160120 2023-08-25T05:37:53.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:53.686+0000 7f95fe6a1640 1 -- 172.21.15.55:0/4216643458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f95f8073e50 con 0x7f95f8160120 2023-08-25T05:37:54.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.342+0000 7f95edffb640 1 -- 172.21.15.55:0/4216643458 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v207) v1 ==== 169+0+0 (secure 0 0 0) 0x7f95f00ef5e0 con 0x7f95f8160120 2023-08-25T05:37:54.345 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2023-08-25T05:37:54.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.346+0000 7f95fe6a1640 1 -- 172.21.15.55:0/4216643458 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f95dc0657a0 msgr2=0x7f95dc067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:54.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.346+0000 7f95fe6a1640 1 --2- 172.21.15.55:0/4216643458 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f95dc0657a0 0x7f95dc067c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f95f8151580 tx=0x7f95f4009040 comp rx=0 tx=0).stop 2023-08-25T05:37:54.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.346+0000 7f95fe6a1640 1 -- 172.21.15.55:0/4216643458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f8160120 msgr2=0x7f95f8153ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:54.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.346+0000 7f95fe6a1640 1 --2- 172.21.15.55:0/4216643458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f8160120 0x7f95f8153ef0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009d90 tx=0x7f95f0019680 comp rx=0 tx=0).stop 2023-08-25T05:37:54.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.346+0000 7f95fe6a1640 1 -- 172.21.15.55:0/4216643458 shutdown_connections 2023-08-25T05:37:54.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.346+0000 7f95fe6a1640 1 --2- 172.21.15.55:0/4216643458 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f95dc0657a0 0x7f95dc067c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.346+0000 7f95fe6a1640 1 --2- 172.21.15.55:0/4216643458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95f8160120 0x7f95f8153ef0 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.346+0000 7f95fe6a1640 1 --2- 172.21.15.55:0/4216643458 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95f80b4080 0x7f95f81539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.346+0000 7f95fe6a1640 1 --2- 172.21.15.55:0/4216643458 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f80b23b0 0x7f95f8158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.346+0000 7f95fe6a1640 1 -- 172.21.15.55:0/4216643458 >> 172.21.15.55:0/4216643458 conn(0x7f95f809b950 msgr2=0x7f95f80d2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:54.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.346+0000 7f95fe6a1640 1 -- 172.21.15.55:0/4216643458 shutdown_connections 2023-08-25T05:37:54.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.346+0000 7f95fe6a1640 1 -- 172.21.15.55:0/4216643458 wait complete. 2023-08-25T05:37:54.375 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-08-25T05:37:54.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.530+0000 7fe3a9d2c640 1 Processor -- start 2023-08-25T05:37:54.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.530+0000 7fe3a9d2c640 1 -- start start 2023-08-25T05:37:54.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.530+0000 7fe3a9d2c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3a415e3c0 0x7fe3a415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:54.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.530+0000 7fe3a9d2c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe3a40d1290 0x7fe3a415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:54.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.530+0000 7fe3a9d2c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a40cd5a0 con 0x7fe3a41601f0 2023-08-25T05:37:54.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.530+0000 7fe3a9d2c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a40cd880 con 0x7fe3a40d1290 2023-08-25T05:37:54.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.530+0000 7fe3a9d2c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a40cdb60 con 0x7fe3a415e3c0 2023-08-25T05:37:54.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.530+0000 7fe3a37fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe3a41601f0 0x7fe3a40d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34532/0 (socket says 172.21.15.55:34532) 2023-08-25T05:37:54.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.530+0000 7fe3a37fe640 1 -- 172.21.15.55:0/1204404677 learned_addr learned my addr 172.21.15.55:0/1204404677 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:54.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.530+0000 7fe39bfff640 1 --2- 172.21.15.55:0/1204404677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3a415e3c0 0x7fe3a415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:54.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.530+0000 7fe3a3fff640 1 --2- 172.21.15.55:0/1204404677 >> v2:172.21.15.110:3300/0 conn(0x7fe3a40d1290 0x7fe3a415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:54.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.530+0000 7fe3a2ffd640 1 -- 172.21.15.55:0/1204404677 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244383101 0 0) 0x7fe3a40cd5a0 con 0x7fe3a41601f0 2023-08-25T05:37:54.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.530+0000 7fe3a2ffd640 1 -- 172.21.15.55:0/1204404677 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe390003530 con 0x7fe3a41601f0 2023-08-25T05:37:54.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe3a2ffd640 1 -- 172.21.15.55:0/1204404677 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1537336686 0 0) 0x7fe390003530 con 0x7fe3a41601f0 2023-08-25T05:37:54.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe3a2ffd640 1 -- 172.21.15.55:0/1204404677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3a415e3c0 msgr2=0x7fe3a415d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:54.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe3a2ffd640 1 --2- 172.21.15.55:0/1204404677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3a415e3c0 0x7fe3a415d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe3a2ffd640 1 -- 172.21.15.55:0/1204404677 >> v2:172.21.15.110:3300/0 conn(0x7fe3a40d1290 msgr2=0x7fe3a415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe3a2ffd640 1 --2- 172.21.15.55:0/1204404677 >> v2:172.21.15.110:3300/0 conn(0x7fe3a40d1290 0x7fe3a415e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe3a2ffd640 1 -- 172.21.15.55:0/1204404677 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a40cde40 con 0x7fe3a41601f0 2023-08-25T05:37:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe3a2ffd640 1 -- 172.21.15.55:0/1204404677 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fe394001800 con 0x7fe3a41601f0 2023-08-25T05:37:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe3a2ffd640 1 -- 172.21.15.55:0/1204404677 >> v1:172.21.15.55:6789/0 conn(0x7fe3a41601f0 legacy=0x7fe3a40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe3a2ffd640 1 --2- 172.21.15.55:0/1204404677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe390003980 0x7fe390003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe3a2ffd640 1 --2- 172.21.15.55:0/1204404677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3900047d0 0x7fe390004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:54.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe3a2ffd640 1 --2- 172.21.15.55:0/1204404677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe390005190 0x7fe39000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:54.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe3a2ffd640 1 -- 172.21.15.55:0/1204404677 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a40cd880 con 0x7fe3900047d0 2023-08-25T05:37:54.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe3a2ffd640 1 -- 172.21.15.55:0/1204404677 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a40cdb60 con 0x7fe390003980 2023-08-25T05:37:54.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe3a2ffd640 1 -- 172.21.15.55:0/1204404677 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39000bed0 con 0x7fe390005190 2023-08-25T05:37:54.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe39bfff640 1 --2- 172.21.15.55:0/1204404677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3a415e3c0 0x7fe3a415d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:54.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe39bfff640 1 --2- 172.21.15.55:0/1204404677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3900047d0 0x7fe390004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:54.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe3a3fff640 1 --2- 172.21.15.55:0/1204404677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe390005190 0x7fe39000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:54.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe3a37fe640 1 --2- 172.21.15.55:0/1204404677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe390003980 0x7fe390003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:54.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe39bfff640 1 -- 172.21.15.55:0/1204404677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe390005190 msgr2=0x7fe39000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:54.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe39bfff640 1 --2- 172.21.15.55:0/1204404677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe390005190 0x7fe39000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe39bfff640 1 -- 172.21.15.55:0/1204404677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe390003980 msgr2=0x7fe390003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:54.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe39bfff640 1 --2- 172.21.15.55:0/1204404677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe390003980 0x7fe390003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe39bfff640 1 -- 172.21.15.55:0/1204404677 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe390003530 con 0x7fe3900047d0 2023-08-25T05:37:54.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe39bfff640 1 --2- 172.21.15.55:0/1204404677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3900047d0 0x7fe390004c50 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009b20 tx=0x7fe38c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247d597bb106b8ed server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:54.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.534+0000 7fe3a2ffd640 1 -- 172.21.15.55:0/1204404677 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c004030 con 0x7fe3900047d0 2023-08-25T05:37:54.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a2ffd640 1 -- 172.21.15.55:0/1204404677 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c004190 con 0x7fe3900047d0 2023-08-25T05:37:54.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a2ffd640 1 -- 172.21.15.55:0/1204404677 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c004520 con 0x7fe3900047d0 2023-08-25T05:37:54.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a9d2c640 1 -- 172.21.15.55:0/1204404677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3900047d0 msgr2=0x7fe390004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:54.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a9d2c640 1 --2- 172.21.15.55:0/1204404677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3900047d0 0x7fe390004c50 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009b20 tx=0x7fe38c01ca90 comp rx=0 tx=0).stop 2023-08-25T05:37:54.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a3fff640 1 -- 172.21.15.55:0/1204404677 reap_dead start 2023-08-25T05:37:54.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a9d2c640 1 -- 172.21.15.55:0/1204404677 shutdown_connections 2023-08-25T05:37:54.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a9d2c640 1 -- 172.21.15.55:0/1204404677 >> 172.21.15.55:0/1204404677 conn(0x7fe3a40d27d0 msgr2=0x7fe3a40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:54.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a9d2c640 1 -- 172.21.15.55:0/1204404677 shutdown_connections 2023-08-25T05:37:54.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a9d2c640 1 -- 172.21.15.55:0/1204404677 wait complete. 2023-08-25T05:37:54.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a9d2c640 1 Processor -- start 2023-08-25T05:37:54.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a9d2c640 1 -- start start 2023-08-25T05:37:54.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a9d2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3900047d0 0x7fe3a414c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:54.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a9d2c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3a414f990 0x7fe3a40ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:54.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a9d2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3a41f1eb0 0x7fe3a41f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:54.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a9d2c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a40cc270 con 0x7fe3a41f1eb0 2023-08-25T05:37:54.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a9d2c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a40a0530 con 0x7fe3900047d0 2023-08-25T05:37:54.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a9d2c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a41f28a0 con 0x7fe3a414f990 2023-08-25T05:37:54.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3a41f1eb0 0x7fe3a41f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:54.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a3fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3a41f1eb0 0x7fe3a41f2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53150/0 (socket says 172.21.15.55:53150) 2023-08-25T05:37:54.545 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a3fff640 1 -- 172.21.15.55:0/1564554959 learned_addr learned my addr 172.21.15.55:0/1564554959 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:54.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe39bfff640 1 --2- 172.21.15.55:0/1564554959 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3a414f990 0x7fe3a40ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:54.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.538+0000 7fe3a37fe640 1 --2- 172.21.15.55:0/1564554959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3900047d0 0x7fe3a414c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:54.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.542+0000 7fe3a3fff640 1 -- 172.21.15.55:0/1564554959 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3a414f990 msgr2=0x7fe3a40ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:54.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.542+0000 7fe3a3fff640 1 --2- 172.21.15.55:0/1564554959 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3a414f990 0x7fe3a40ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.542+0000 7fe3a3fff640 1 -- 172.21.15.55:0/1564554959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3900047d0 msgr2=0x7fe3a414c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:54.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.542+0000 7fe3a3fff640 1 --2- 172.21.15.55:0/1564554959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3900047d0 0x7fe3a414c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.542+0000 7fe3a3fff640 1 -- 172.21.15.55:0/1564554959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a40ce7c0 con 0x7fe3a41f1eb0 2023-08-25T05:37:54.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.542+0000 7fe3a3fff640 1 --2- 172.21.15.55:0/1564554959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3a41f1eb0 0x7fe3a41f2360 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40d2090 tx=0x7fe39c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:54.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.542+0000 7fe3a0ff9640 1 -- 172.21.15.55:0/1564554959 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00e040 con 0x7fe3a41f1eb0 2023-08-25T05:37:54.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.542+0000 7fe3a0ff9640 1 -- 172.21.15.55:0/1564554959 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c00f040 con 0x7fe3a41f1eb0 2023-08-25T05:37:54.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.542+0000 7fe3a9d2c640 1 -- 172.21.15.55:0/1564554959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a40cb1d0 con 0x7fe3a41f1eb0 2023-08-25T05:37:54.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.542+0000 7fe3a0ff9640 1 -- 172.21.15.55:0/1564554959 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c015430 con 0x7fe3a41f1eb0 2023-08-25T05:37:54.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.542+0000 7fe3a9d2c640 1 -- 172.21.15.55:0/1564554959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a40cb790 con 0x7fe3a41f1eb0 2023-08-25T05:37:54.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.542+0000 7fe3a9d2c640 1 -- 172.21.15.55:0/1564554959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a40b5260 con 0x7fe3a41f1eb0 2023-08-25T05:37:54.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.542+0000 7fe3a0ff9640 1 -- 172.21.15.55:0/1564554959 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fe39c015590 con 0x7fe3a41f1eb0 2023-08-25T05:37:54.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.542+0000 7fe3a0ff9640 1 --2- 172.21.15.55:0/1564554959 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fe3840657a0 0x7fe384067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:54.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.542+0000 7fe3a0ff9640 1 -- 172.21.15.55:0/1564554959 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fe39c0839a0 con 0x7fe3a41f1eb0 2023-08-25T05:37:54.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.542+0000 7fe3a37fe640 1 --2- 172.21.15.55:0/1564554959 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fe3840657a0 0x7fe384067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:54.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.546+0000 7fe3a37fe640 1 --2- 172.21.15.55:0/1564554959 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fe3840657a0 0x7fe384067c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe394000f00 tx=0x7fe394009040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:54.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.546+0000 7fe3a0ff9640 1 -- 172.21.15.55:0/1564554959 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fe39c051350 con 0x7fe3a41f1eb0 2023-08-25T05:37:54.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.706+0000 7fe3a9d2c640 1 -- 172.21.15.55:0/1564554959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fe3a4073ec0 con 0x7fe3a41f1eb0 2023-08-25T05:37:54.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.710+0000 7fe3a0ff9640 1 -- 172.21.15.55:0/1564554959 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v73) v1 ==== 115+0+0 (secure 0 0 0) 0x7fe39c054970 con 0x7fe3a41f1eb0 2023-08-25T05:37:54.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.710+0000 7fe3a9d2c640 1 -- 172.21.15.55:0/1564554959 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fe3840657a0 msgr2=0x7fe384067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:54.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.710+0000 7fe3a9d2c640 1 --2- 172.21.15.55:0/1564554959 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fe3840657a0 0x7fe384067c60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe394000f00 tx=0x7fe394009040 comp rx=0 tx=0).stop 2023-08-25T05:37:54.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.710+0000 7fe3a9d2c640 1 -- 172.21.15.55:0/1564554959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3a41f1eb0 msgr2=0x7fe3a41f2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:54.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.710+0000 7fe3a9d2c640 1 --2- 172.21.15.55:0/1564554959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3a41f1eb0 0x7fe3a41f2360 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40d2090 tx=0x7fe39c00f580 comp rx=0 tx=0).stop 2023-08-25T05:37:54.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.714+0000 7fe3a9d2c640 1 -- 172.21.15.55:0/1564554959 shutdown_connections 2023-08-25T05:37:54.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.714+0000 7fe3a9d2c640 1 --2- 172.21.15.55:0/1564554959 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fe3840657a0 0x7fe384067c60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.714+0000 7fe3a9d2c640 1 --2- 172.21.15.55:0/1564554959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3a41f1eb0 0x7fe3a41f2360 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.714+0000 7fe3a9d2c640 1 --2- 172.21.15.55:0/1564554959 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3a414f990 0x7fe3a40ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.714+0000 7fe3a9d2c640 1 --2- 172.21.15.55:0/1564554959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3900047d0 0x7fe3a414c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.714+0000 7fe3a9d2c640 1 -- 172.21.15.55:0/1564554959 >> 172.21.15.55:0/1564554959 conn(0x7fe3a40d27d0 msgr2=0x7fe3a40b7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:54.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.714+0000 7fe3a9d2c640 1 -- 172.21.15.55:0/1564554959 shutdown_connections 2023-08-25T05:37:54.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.714+0000 7fe3a9d2c640 1 -- 172.21.15.55:0/1564554959 wait complete. 2023-08-25T05:37:54.734 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-08-25T05:37:54.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.878+0000 7fb4c93ac640 1 Processor -- start 2023-08-25T05:37:54.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.878+0000 7fb4c93ac640 1 -- start start 2023-08-25T05:37:54.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.878+0000 7fb4c93ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4c415a7f0 0x7fb4c409bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:54.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.878+0000 7fb4c93ac640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb4c406c020 0x7fb4c40acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:54.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.878+0000 7fb4c93ac640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c415abd0 con 0x7fb4c40c9830 2023-08-25T05:37:54.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.878+0000 7fb4c93ac640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c40c8ab0 con 0x7fb4c406c020 2023-08-25T05:37:54.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.878+0000 7fb4c93ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c40c8d50 con 0x7fb4c415a7f0 2023-08-25T05:37:54.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.878+0000 7fb4c37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb4c406c020 0x7fb4c40acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:54.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.878+0000 7fb4c37fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb4c406c020 0x7fb4c40acff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53162/0 (socket says 172.21.15.55:53162) 2023-08-25T05:37:54.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.878+0000 7fb4c37fe640 1 -- 172.21.15.55:0/4030508392 learned_addr learned my addr 172.21.15.55:0/4030508392 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:54.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.878+0000 7fb4c2ffd640 1 --2- 172.21.15.55:0/4030508392 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4c415a7f0 0x7fb4c409bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:54.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.878+0000 7fb4c37fe640 1 -- 172.21.15.55:0/4030508392 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4c415a7f0 msgr2=0x7fb4c409bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:54.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.878+0000 7fb4c37fe640 1 --2- 172.21.15.55:0/4030508392 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4c415a7f0 0x7fb4c409bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.878+0000 7fb4c37fe640 1 -- 172.21.15.55:0/4030508392 >> v1:172.21.15.110:6789/0 conn(0x7fb4c40c9830 legacy=0x7fb4c4070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:54.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.878+0000 7fb4c37fe640 1 -- 172.21.15.55:0/4030508392 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c40c9030 con 0x7fb4c406c020 2023-08-25T05:37:54.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.882+0000 7fb4c37fe640 1 --2- 172.21.15.55:0/4030508392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4c406c020 0x7fb4c40acff0 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009e50 tx=0x7fb4bc01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deee1d1dc9be39d5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:54.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.882+0000 7fb4c27fc640 1 -- 172.21.15.55:0/4030508392 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc0a57c0 con 0x7fb4c406c020 2023-08-25T05:37:54.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.882+0000 7fb4c27fc640 1 -- 172.21.15.55:0/4030508392 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4bc0a5920 con 0x7fb4c406c020 2023-08-25T05:37:54.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.882+0000 7fb4c27fc640 1 -- 172.21.15.55:0/4030508392 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc0a5cb0 con 0x7fb4c406c020 2023-08-25T05:37:54.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.882+0000 7fb4c93ac640 1 -- 172.21.15.55:0/4030508392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4c406c020 msgr2=0x7fb4c40acff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:54.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.882+0000 7fb4c93ac640 1 --2- 172.21.15.55:0/4030508392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4c406c020 0x7fb4c40acff0 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009e50 tx=0x7fb4bc01c9e0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.882+0000 7fb4c93ac640 1 -- 172.21.15.55:0/4030508392 shutdown_connections 2023-08-25T05:37:54.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.882+0000 7fb4c93ac640 1 --2- 172.21.15.55:0/4030508392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4c406c020 0x7fb4c40acff0 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.882+0000 7fb4c93ac640 1 --2- 172.21.15.55:0/4030508392 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4c415a7f0 0x7fb4c409bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.882+0000 7fb4c93ac640 1 -- 172.21.15.55:0/4030508392 >> 172.21.15.55:0/4030508392 conn(0x7fb4c4069900 msgr2=0x7fb4c4069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:54.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.882+0000 7fb4c93ac640 1 -- 172.21.15.55:0/4030508392 shutdown_connections 2023-08-25T05:37:54.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.882+0000 7fb4c93ac640 1 -- 172.21.15.55:0/4030508392 wait complete. 2023-08-25T05:37:54.887 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c93ac640 1 Processor -- start 2023-08-25T05:37:54.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c93ac640 1 -- start start 2023-08-25T05:37:54.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c93ac640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4c406c020 0x7fb4c41542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:54.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c93ac640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4c40c9830 0x7fb4c40c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:54.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c93ac640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4c415a7f0 0x7fb4c414a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:54.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c93ac640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c41554c0 con 0x7fb4c415a7f0 2023-08-25T05:37:54.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c93ac640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c4154800 con 0x7fb4c40c9830 2023-08-25T05:37:54.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c93ac640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c41551e0 con 0x7fb4c406c020 2023-08-25T05:37:54.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4c415a7f0 0x7fb4c414a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:54.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c37fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4c415a7f0 0x7fb4c414a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53164/0 (socket says 172.21.15.55:53164) 2023-08-25T05:37:54.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c37fe640 1 -- 172.21.15.55:0/4037546973 learned_addr learned my addr 172.21.15.55:0/4037546973 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:54.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c2ffd640 1 --2- 172.21.15.55:0/4037546973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4c406c020 0x7fb4c41542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:54.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4ba7fc640 1 --2- 172.21.15.55:0/4037546973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4c40c9830 0x7fb4c40c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:54.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c37fe640 1 -- 172.21.15.55:0/4037546973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4c406c020 msgr2=0x7fb4c41542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:54.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c37fe640 1 --2- 172.21.15.55:0/4037546973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4c406c020 0x7fb4c41542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c37fe640 1 -- 172.21.15.55:0/4037546973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4c40c9830 msgr2=0x7fb4c40c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:54.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c37fe640 1 --2- 172.21.15.55:0/4037546973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4c40c9830 0x7fb4c40c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:54.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c37fe640 1 -- 172.21.15.55:0/4037546973 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc009b30 con 0x7fb4c415a7f0 2023-08-25T05:37:54.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c37fe640 1 --2- 172.21.15.55:0/4037546973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4c415a7f0 0x7fb4c414a8f0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc01a610 tx=0x7fb4bc019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:54.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4bbfff640 1 -- 172.21.15.55:0/4037546973 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc0b8670 con 0x7fb4c415a7f0 2023-08-25T05:37:54.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4bbfff640 1 -- 172.21.15.55:0/4037546973 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4bc0b87d0 con 0x7fb4c415a7f0 2023-08-25T05:37:54.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4bbfff640 1 -- 172.21.15.55:0/4037546973 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc0b8b80 con 0x7fb4c415a7f0 2023-08-25T05:37:54.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c93ac640 1 -- 172.21.15.55:0/4037546973 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c40c68e0 con 0x7fb4c415a7f0 2023-08-25T05:37:54.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.886+0000 7fb4c93ac640 1 -- 172.21.15.55:0/4037546973 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c40c6ea0 con 0x7fb4c415a7f0 2023-08-25T05:37:54.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.890+0000 7fb4c93ac640 1 -- 172.21.15.55:0/4037546973 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c406d5b0 con 0x7fb4c415a7f0 2023-08-25T05:37:54.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.890+0000 7fb4bbfff640 1 -- 172.21.15.55:0/4037546973 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fb4bc0b8ce0 con 0x7fb4c415a7f0 2023-08-25T05:37:54.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.890+0000 7fb4bbfff640 1 --2- 172.21.15.55:0/4037546973 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fb4a40657a0 0x7fb4a4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:54.893 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.890+0000 7fb4bbfff640 1 -- 172.21.15.55:0/4037546973 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fb4bc11e3f0 con 0x7fb4c415a7f0 2023-08-25T05:37:54.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.890+0000 7fb4c2ffd640 1 --2- 172.21.15.55:0/4037546973 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fb4a40657a0 0x7fb4a4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:54.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.890+0000 7fb4c2ffd640 1 --2- 172.21.15.55:0/4037546973 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fb4a40657a0 0x7fb4a4067c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4156900 tx=0x7fb4b4008040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:54.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:54.894+0000 7fb4bbfff640 1 -- 172.21.15.55:0/4037546973 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb4bc0ec000 con 0x7fb4c415a7f0 2023-08-25T05:37:55.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.050+0000 7fb4c93ac640 1 -- 172.21.15.55:0/4037546973 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fb4c40c6740 con 0x7fb4c415a7f0 2023-08-25T05:37:55.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.054+0000 7fb4bbfff640 1 -- 172.21.15.55:0/4037546973 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v74) v1 ==== 120+0+0 (secure 0 0 0) 0x7fb4c40c6740 con 0x7fb4c415a7f0 2023-08-25T05:37:55.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.058+0000 7fb4c93ac640 1 -- 172.21.15.55:0/4037546973 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fb4a40657a0 msgr2=0x7fb4a4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:55.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.058+0000 7fb4c93ac640 1 --2- 172.21.15.55:0/4037546973 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fb4a40657a0 0x7fb4a4067c60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4156900 tx=0x7fb4b4008040 comp rx=0 tx=0).stop 2023-08-25T05:37:55.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.058+0000 7fb4c93ac640 1 -- 172.21.15.55:0/4037546973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4c415a7f0 msgr2=0x7fb4c414a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:55.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.058+0000 7fb4c93ac640 1 --2- 172.21.15.55:0/4037546973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4c415a7f0 0x7fb4c414a8f0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc01a610 tx=0x7fb4bc019780 comp rx=0 tx=0).stop 2023-08-25T05:37:55.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.058+0000 7fb4c93ac640 1 -- 172.21.15.55:0/4037546973 shutdown_connections 2023-08-25T05:37:55.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.058+0000 7fb4c93ac640 1 --2- 172.21.15.55:0/4037546973 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fb4a40657a0 0x7fb4a4067c60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.058+0000 7fb4c93ac640 1 --2- 172.21.15.55:0/4037546973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4c415a7f0 0x7fb4c414a8f0 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.058+0000 7fb4c93ac640 1 --2- 172.21.15.55:0/4037546973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4c40c9830 0x7fb4c40c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.058+0000 7fb4c93ac640 1 --2- 172.21.15.55:0/4037546973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4c406c020 0x7fb4c41542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.058+0000 7fb4c93ac640 1 -- 172.21.15.55:0/4037546973 >> 172.21.15.55:0/4037546973 conn(0x7fb4c4069900 msgr2=0x7fb4c40ac750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:55.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.058+0000 7fb4c93ac640 1 -- 172.21.15.55:0/4037546973 shutdown_connections 2023-08-25T05:37:55.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.058+0000 7fb4c93ac640 1 -- 172.21.15.55:0/4037546973 wait complete. 2023-08-25T05:37:55.080 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-25T05:37:55.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.226+0000 7fc1e9019640 1 Processor -- start 2023-08-25T05:37:55.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.226+0000 7fc1e9019640 1 -- start start 2023-08-25T05:37:55.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.226+0000 7fc1e9019640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc1e40cb020 0x7fc1e40c9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:55.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.226+0000 7fc1e9019640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc1e406c720 0x7fc1e406cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:55.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.226+0000 7fc1e9019640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e40cbca0 con 0x7fc1e40cdd50 2023-08-25T05:37:55.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.226+0000 7fc1e9019640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e40c9470 con 0x7fc1e406c720 2023-08-25T05:37:55.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.226+0000 7fc1e9019640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e40ce1e0 con 0x7fc1e40cb020 2023-08-25T05:37:55.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.226+0000 7fc1e359e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc1e406c720 0x7fc1e406cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:55.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.230+0000 7fc1da59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc1e40cdd50 0x7fc1e40cb400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34540/0 (socket says 172.21.15.55:34540) 2023-08-25T05:37:55.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.230+0000 7fc1da59c640 1 -- 172.21.15.55:0/4140352102 learned_addr learned my addr 172.21.15.55:0/4140352102 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:55.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.230+0000 7fc1e2d9d640 1 --2- 172.21.15.55:0/4140352102 >> v2:172.21.15.110:3300/0 conn(0x7fc1e40cb020 0x7fc1e40c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:55.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.230+0000 7fc1e359e640 1 -- 172.21.15.55:0/4140352102 >> v2:172.21.15.110:3300/0 conn(0x7fc1e40cb020 msgr2=0x7fc1e40c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:55.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.230+0000 7fc1e359e640 1 --2- 172.21.15.55:0/4140352102 >> v2:172.21.15.110:3300/0 conn(0x7fc1e40cb020 0x7fc1e40c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.230+0000 7fc1e359e640 1 -- 172.21.15.55:0/4140352102 >> v1:172.21.15.55:6789/0 conn(0x7fc1e40cdd50 legacy=0x7fc1e40cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:55.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.230+0000 7fc1e359e640 1 -- 172.21.15.55:0/4140352102 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e406d040 con 0x7fc1e406c720 2023-08-25T05:37:55.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.230+0000 7fc1e259c640 1 -- 172.21.15.55:0/4140352102 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597509283 0 0) 0x7fc1e40cbca0 con 0x7fc1e40cdd50 2023-08-25T05:37:55.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.230+0000 7fc1e359e640 1 --2- 172.21.15.55:0/4140352102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e406c720 0x7fc1e406cb00 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7fc1e406daf0 tx=0x7fc1dc01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b5a707b2fccb23 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:55.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.230+0000 7fc1e259c640 1 -- 172.21.15.55:0/4140352102 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc0ab600 con 0x7fc1e406c720 2023-08-25T05:37:55.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.230+0000 7fc1e259c640 1 -- 172.21.15.55:0/4140352102 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1dc0a7050 con 0x7fc1e406c720 2023-08-25T05:37:55.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.230+0000 7fc1e259c640 1 -- 172.21.15.55:0/4140352102 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc0ab980 con 0x7fc1e406c720 2023-08-25T05:37:55.235 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e9019640 1 -- 172.21.15.55:0/4140352102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e406c720 msgr2=0x7fc1e406cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:55.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e9019640 1 --2- 172.21.15.55:0/4140352102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e406c720 0x7fc1e406cb00 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7fc1e406daf0 tx=0x7fc1dc01c3d0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e9019640 1 -- 172.21.15.55:0/4140352102 shutdown_connections 2023-08-25T05:37:55.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e9019640 1 --2- 172.21.15.55:0/4140352102 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e406c720 0x7fc1e406cb00 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e9019640 1 --2- 172.21.15.55:0/4140352102 >> v2:172.21.15.110:3300/0 conn(0x7fc1e40cb020 0x7fc1e40c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e9019640 1 -- 172.21.15.55:0/4140352102 >> 172.21.15.55:0/4140352102 conn(0x7fc1e4069900 msgr2=0x7fc1e4069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:55.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e9019640 1 -- 172.21.15.55:0/4140352102 shutdown_connections 2023-08-25T05:37:55.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e9019640 1 -- 172.21.15.55:0/4140352102 wait complete. 2023-08-25T05:37:55.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e9019640 1 Processor -- start 2023-08-25T05:37:55.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e9019640 1 -- start start 2023-08-25T05:37:55.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e9019640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e406c720 0x7fc1e40ade20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:55.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e9019640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1e40cb020 0x7fc1e41f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:55.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e9019640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1e40cdd50 0x7fc1e415b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:55.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e9019640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e41f92f0 con 0x7fc1e406c720 2023-08-25T05:37:55.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e9019640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40ae400 con 0x7fc1e40cb020 2023-08-25T05:37:55.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e9019640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e40ae6e0 con 0x7fc1e40cdd50 2023-08-25T05:37:55.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e406c720 0x7fc1e40ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:55.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e406c720 0x7fc1e40ade20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53180/0 (socket says 172.21.15.55:53180) 2023-08-25T05:37:55.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e2d9d640 1 -- 172.21.15.55:0/4220512347 learned_addr learned my addr 172.21.15.55:0/4220512347 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:55.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1da59c640 1 --2- 172.21.15.55:0/4220512347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1e40cb020 0x7fc1e41f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:55.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e359e640 1 --2- 172.21.15.55:0/4220512347 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1e40cdd50 0x7fc1e415b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:55.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e2d9d640 1 -- 172.21.15.55:0/4220512347 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1e40cdd50 msgr2=0x7fc1e415b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:55.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e2d9d640 1 --2- 172.21.15.55:0/4220512347 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1e40cdd50 0x7fc1e415b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e2d9d640 1 -- 172.21.15.55:0/4220512347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1e40cb020 msgr2=0x7fc1e41f8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:55.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e2d9d640 1 --2- 172.21.15.55:0/4220512347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1e40cb020 0x7fc1e41f8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.234+0000 7fc1e2d9d640 1 -- 172.21.15.55:0/4220512347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1dc009420 con 0x7fc1e406c720 2023-08-25T05:37:55.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.238+0000 7fc1e2d9d640 1 --2- 172.21.15.55:0/4220512347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e406c720 0x7fc1e40ade20 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400d800 tx=0x7fc1d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:55.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.238+0000 7fc1dbfff640 1 -- 172.21.15.55:0/4220512347 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4018070 con 0x7fc1e406c720 2023-08-25T05:37:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.238+0000 7fc1dbfff640 1 -- 172.21.15.55:0/4220512347 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d40059a0 con 0x7fc1e406c720 2023-08-25T05:37:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.238+0000 7fc1e9019640 1 -- 172.21.15.55:0/4220512347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e40ae9c0 con 0x7fc1e406c720 2023-08-25T05:37:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.238+0000 7fc1dbfff640 1 -- 172.21.15.55:0/4220512347 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d4005b50 con 0x7fc1e406c720 2023-08-25T05:37:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.238+0000 7fc1e9019640 1 -- 172.21.15.55:0/4220512347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e40aef80 con 0x7fc1e406c720 2023-08-25T05:37:55.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.238+0000 7fc1e9019640 1 -- 172.21.15.55:0/4220512347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e40af140 con 0x7fc1e406c720 2023-08-25T05:37:55.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.238+0000 7fc1dbfff640 1 -- 172.21.15.55:0/4220512347 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fc1d4005cb0 con 0x7fc1e406c720 2023-08-25T05:37:55.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.238+0000 7fc1dbfff640 1 --2- 172.21.15.55:0/4220512347 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fc1c40657a0 0x7fc1c4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:55.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.238+0000 7fc1dbfff640 1 -- 172.21.15.55:0/4220512347 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fc1d4082ca0 con 0x7fc1e406c720 2023-08-25T05:37:55.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.238+0000 7fc1da59c640 1 --2- 172.21.15.55:0/4220512347 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fc1c40657a0 0x7fc1c4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:55.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.242+0000 7fc1da59c640 1 --2- 172.21.15.55:0/4220512347 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fc1c40657a0 0x7fc1c4067c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc1e41f8340 tx=0x7fc1cc001690 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:55.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.242+0000 7fc1dbfff640 1 -- 172.21.15.55:0/4220512347 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fc1d40541f0 con 0x7fc1e406c720 2023-08-25T05:37:55.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.402+0000 7fc1e9019640 1 -- 172.21.15.55:0/4220512347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc1e4073ec0 con 0x7fc1e406c720 2023-08-25T05:37:55.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.406+0000 7fc1dbfff640 1 -- 172.21.15.55:0/4220512347 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v75) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc1d4053d80 con 0x7fc1e406c720 2023-08-25T05:37:55.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.406+0000 7fc1e9019640 1 -- 172.21.15.55:0/4220512347 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fc1c40657a0 msgr2=0x7fc1c4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:55.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.406+0000 7fc1e9019640 1 --2- 172.21.15.55:0/4220512347 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fc1c40657a0 0x7fc1c4067c60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc1e41f8340 tx=0x7fc1cc001690 comp rx=0 tx=0).stop 2023-08-25T05:37:55.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.406+0000 7fc1e9019640 1 -- 172.21.15.55:0/4220512347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e406c720 msgr2=0x7fc1e40ade20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:55.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.406+0000 7fc1e9019640 1 --2- 172.21.15.55:0/4220512347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e406c720 0x7fc1e40ade20 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400d800 tx=0x7fc1d400dcc0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.406+0000 7fc1e9019640 1 -- 172.21.15.55:0/4220512347 shutdown_connections 2023-08-25T05:37:55.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.406+0000 7fc1e9019640 1 --2- 172.21.15.55:0/4220512347 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fc1c40657a0 0x7fc1c4067c60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.406+0000 7fc1e9019640 1 --2- 172.21.15.55:0/4220512347 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc1e40cdd50 0x7fc1e415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.406+0000 7fc1e9019640 1 --2- 172.21.15.55:0/4220512347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc1e40cb020 0x7fc1e41f8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.406+0000 7fc1e9019640 1 --2- 172.21.15.55:0/4220512347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1e406c720 0x7fc1e40ade20 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.406+0000 7fc1e9019640 1 -- 172.21.15.55:0/4220512347 >> 172.21.15.55:0/4220512347 conn(0x7fc1e4069900 msgr2=0x7fc1e415ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:55.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.406+0000 7fc1e9019640 1 -- 172.21.15.55:0/4220512347 shutdown_connections 2023-08-25T05:37:55.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.406+0000 7fc1e9019640 1 -- 172.21.15.55:0/4220512347 wait complete. 2023-08-25T05:37:55.430 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-08-25T05:37:55.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.570+0000 7f824f70a640 1 Processor -- start 2023-08-25T05:37:55.573 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.570+0000 7f824f70a640 1 -- start start 2023-08-25T05:37:55.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.570+0000 7f824f70a640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f824815c9c0 0x7f8248160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:55.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.570+0000 7f824f70a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82480cfa70 0x7f8248160a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:55.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.570+0000 7f824f70a640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f824806eaf0 con 0x7f8248160f90 2023-08-25T05:37:55.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.570+0000 7f824f70a640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f824806e530 con 0x7f824815c9c0 2023-08-25T05:37:55.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.570+0000 7f824f70a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824806e810 con 0x7f82480cfa70 2023-08-25T05:37:55.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.574+0000 7f824cca5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82480cfa70 0x7f8248160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:55.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.574+0000 7f824d4a6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f824815c9c0 0x7f8248160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:55.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.574+0000 7f824d4a6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f824815c9c0 0x7f8248160510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:38044/0 (socket says 172.21.15.55:38044) 2023-08-25T05:37:55.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.574+0000 7f824d4a6640 1 -- 172.21.15.55:0/3301954374 learned_addr learned my addr 172.21.15.55:0/3301954374 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:55.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.574+0000 7f824cca5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82480cfa70 0x7f8248160a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:55874/0 (socket says 172.21.15.55:55874) 2023-08-25T05:37:55.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.574+0000 7f824cca5640 1 -- 172.21.15.55:0/3301954374 >> v2:172.21.15.110:3300/0 conn(0x7f824815c9c0 msgr2=0x7f8248160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:55.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.574+0000 7f824cca5640 1 --2- 172.21.15.55:0/3301954374 >> v2:172.21.15.110:3300/0 conn(0x7f824815c9c0 0x7f8248160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.574+0000 7f823ffff640 1 -- 172.21.15.55:0/3301954374 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327161295 0 0) 0x7f824806eaf0 con 0x7f8248160f90 2023-08-25T05:37:55.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.574+0000 7f824cca5640 1 -- 172.21.15.55:0/3301954374 >> v1:172.21.15.110:6789/0 conn(0x7f8248160f90 legacy=0x7f82480ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:55.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.574+0000 7f824cca5640 1 -- 172.21.15.55:0/3301954374 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824806aab0 con 0x7f82480cfa70 2023-08-25T05:37:55.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.574+0000 7f824d4a6640 1 --2- 172.21.15.55:0/3301954374 >> v2:172.21.15.110:3300/0 conn(0x7f824815c9c0 0x7f8248160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:55.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.574+0000 7f824cca5640 1 --2- 172.21.15.55:0/3301954374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82480cfa70 0x7f8248160a50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f82380097c0 tx=0x7f823801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c99e85e9e65cd2f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:55.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.574+0000 7f823ffff640 1 -- 172.21.15.55:0/3301954374 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82380ad660 con 0x7f82480cfa70 2023-08-25T05:37:55.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.574+0000 7f823ffff640 1 -- 172.21.15.55:0/3301954374 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82380ad7c0 con 0x7f82480cfa70 2023-08-25T05:37:55.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.574+0000 7f823ffff640 1 -- 172.21.15.55:0/3301954374 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82380adb50 con 0x7f82480cfa70 2023-08-25T05:37:55.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824f70a640 1 -- 172.21.15.55:0/3301954374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82480cfa70 msgr2=0x7f8248160a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:55.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824f70a640 1 --2- 172.21.15.55:0/3301954374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82480cfa70 0x7f8248160a50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f82380097c0 tx=0x7f823801c450 comp rx=0 tx=0).stop 2023-08-25T05:37:55.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824f70a640 1 -- 172.21.15.55:0/3301954374 shutdown_connections 2023-08-25T05:37:55.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824f70a640 1 --2- 172.21.15.55:0/3301954374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82480cfa70 0x7f8248160a50 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824f70a640 1 --2- 172.21.15.55:0/3301954374 >> v2:172.21.15.110:3300/0 conn(0x7f824815c9c0 0x7f8248160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824f70a640 1 -- 172.21.15.55:0/3301954374 >> 172.21.15.55:0/3301954374 conn(0x7f82480d05a0 msgr2=0x7f82480d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:55.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824f70a640 1 -- 172.21.15.55:0/3301954374 shutdown_connections 2023-08-25T05:37:55.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824f70a640 1 -- 172.21.15.55:0/3301954374 wait complete. 2023-08-25T05:37:55.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824f70a640 1 Processor -- start 2023-08-25T05:37:55.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824f70a640 1 -- start start 2023-08-25T05:37:55.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824f70a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82480cfa70 0x7f82480c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:55.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824f70a640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f824815c9c0 0x7f82480c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:55.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824f70a640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8248160f90 0x7f8248153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:55.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824f70a640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82480c4150 con 0x7f82480cfa70 2023-08-25T05:37:55.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824f70a640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82480c4430 con 0x7f8248160f90 2023-08-25T05:37:55.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824f70a640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82480c4710 con 0x7f824815c9c0 2023-08-25T05:37:55.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824d4a6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82480cfa70 0x7f82480c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:55.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824d4a6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82480cfa70 0x7f82480c51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53192/0 (socket says 172.21.15.55:53192) 2023-08-25T05:37:55.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824d4a6640 1 -- 172.21.15.55:0/1229016453 learned_addr learned my addr 172.21.15.55:0/1229016453 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:55.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824cca5640 1 --2- 172.21.15.55:0/1229016453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f824815c9c0 0x7f82480c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:55.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824dca7640 1 --2- 172.21.15.55:0/1229016453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8248160f90 0x7f8248153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824d4a6640 1 -- 172.21.15.55:0/1229016453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f824815c9c0 msgr2=0x7f82480c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824d4a6640 1 --2- 172.21.15.55:0/1229016453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f824815c9c0 0x7f82480c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824d4a6640 1 -- 172.21.15.55:0/1229016453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8248160f90 msgr2=0x7f8248153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.578+0000 7f824d4a6640 1 --2- 172.21.15.55:0/1229016453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8248160f90 0x7f8248153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:55.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.582+0000 7f824d4a6640 1 -- 172.21.15.55:0/1229016453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8244009480 con 0x7f82480cfa70 2023-08-25T05:37:55.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.582+0000 7f824cca5640 1 --2- 172.21.15.55:0/1229016453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f824815c9c0 0x7f82480c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:55.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.582+0000 7f824d4a6640 1 --2- 172.21.15.55:0/1229016453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82480cfa70 0x7f82480c51f0 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f824400e980 tx=0x7f824400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:55.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.582+0000 7f823dffb640 1 -- 172.21.15.55:0/1229016453 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82440059a0 con 0x7f82480cfa70 2023-08-25T05:37:55.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.582+0000 7f823dffb640 1 -- 172.21.15.55:0/1229016453 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8244005b00 con 0x7f82480cfa70 2023-08-25T05:37:55.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.582+0000 7f824f70a640 1 -- 172.21.15.55:0/1229016453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8238009420 con 0x7f82480cfa70 2023-08-25T05:37:55.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.582+0000 7f823dffb640 1 -- 172.21.15.55:0/1229016453 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8244005e90 con 0x7f82480cfa70 2023-08-25T05:37:55.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.582+0000 7f824f70a640 1 -- 172.21.15.55:0/1229016453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82480c4cd0 con 0x7f82480cfa70 2023-08-25T05:37:55.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.582+0000 7f824f70a640 1 -- 172.21.15.55:0/1229016453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f824804dbe0 con 0x7f82480cfa70 2023-08-25T05:37:55.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.582+0000 7f823dffb640 1 -- 172.21.15.55:0/1229016453 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f824400c9a0 con 0x7f82480cfa70 2023-08-25T05:37:55.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.582+0000 7f823dffb640 1 --2- 172.21.15.55:0/1229016453 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f822c0657a0 0x7f822c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:55.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.582+0000 7f823dffb640 1 -- 172.21.15.55:0/1229016453 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f82440833c0 con 0x7f82480cfa70 2023-08-25T05:37:55.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.586+0000 7f824cca5640 1 --2- 172.21.15.55:0/1229016453 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f822c0657a0 0x7f822c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:55.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.586+0000 7f824cca5640 1 --2- 172.21.15.55:0/1229016453 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f822c0657a0 0x7f822c067c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f82380af000 tx=0x7f82380a7000 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:55.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.586+0000 7f823dffb640 1 -- 172.21.15.55:0/1229016453 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f8244050d40 con 0x7f82480cfa70 2023-08-25T05:37:55.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:55.798+0000 7f824f70a640 1 -- 172.21.15.55:0/1229016453 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f82480cdc20 con 0x7f82480cfa70 2023-08-25T05:37:56.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:56.346+0000 7f823dffb640 1 -- 172.21.15.55:0/1229016453 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3104) v1 ==== 155+0+0 (secure 0 0 0) 0x7f8244054360 con 0x7f82480cfa70 2023-08-25T05:37:56.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:56.350+0000 7f824f70a640 1 -- 172.21.15.55:0/1229016453 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f822c0657a0 msgr2=0x7f822c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:56.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:56.350+0000 7f824f70a640 1 --2- 172.21.15.55:0/1229016453 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f822c0657a0 0x7f822c067c60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f82380af000 tx=0x7f82380a7000 comp rx=0 tx=0).stop 2023-08-25T05:37:56.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:56.350+0000 7f824f70a640 1 -- 172.21.15.55:0/1229016453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82480cfa70 msgr2=0x7f82480c51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:56.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:56.350+0000 7f824f70a640 1 --2- 172.21.15.55:0/1229016453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82480cfa70 0x7f82480c51f0 secure :-1 s=READY pgs=2199 cs=0 l=1 rev1=1 crypto rx=0x7f824400e980 tx=0x7f824400ee40 comp rx=0 tx=0).stop 2023-08-25T05:37:56.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:56.350+0000 7f824f70a640 1 -- 172.21.15.55:0/1229016453 shutdown_connections 2023-08-25T05:37:56.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:56.350+0000 7f824f70a640 1 --2- 172.21.15.55:0/1229016453 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f822c0657a0 0x7f822c067c60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:56.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:56.350+0000 7f824f70a640 1 --2- 172.21.15.55:0/1229016453 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8248160f90 0x7f8248153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:56.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:56.350+0000 7f824f70a640 1 --2- 172.21.15.55:0/1229016453 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f824815c9c0 0x7f82480c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:56.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:56.350+0000 7f824f70a640 1 --2- 172.21.15.55:0/1229016453 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82480cfa70 0x7f82480c51f0 unknown :-1 s=CLOSED pgs=2199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:56.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:56.350+0000 7f824f70a640 1 -- 172.21.15.55:0/1229016453 >> 172.21.15.55:0/1229016453 conn(0x7f82480d05a0 msgr2=0x7f82481552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:56.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:56.350+0000 7f824f70a640 1 -- 172.21.15.55:0/1229016453 shutdown_connections 2023-08-25T05:37:56.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:56.350+0000 7f824f70a640 1 -- 172.21.15.55:0/1229016453 wait complete. 2023-08-25T05:37:56.372 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-08-25T05:37:56.373 INFO:tasks.cephfs_test_runner: 2023-08-25T05:37:56.373 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-08-25T05:37:56.373 INFO:tasks.cephfs_test_runner:Ran 11 tests in 5665.294s 2023-08-25T05:37:56.373 INFO:tasks.cephfs_test_runner: 2023-08-25T05:37:56.373 INFO:tasks.cephfs_test_runner:OK 2023-08-25T05:37:56.374 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-08-25T05:37:56.384 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-08-25T05:37:56.396 INFO:tasks.kclient:Unmounting kernel clients... 2023-08-25T05:37:56.396 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:37:56.396 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:56.405 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T05:37:56.406 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-08-25T05:37:56.406 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:56.455 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357780k,nr_inodes=4089445,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=261 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-08-25T05:37:56.456 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:37:56.456 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:56.466 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:37:56.466 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2023-08-25T05:37:56.466 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-25T05:37:56.519 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354620k,nr_inodes=4088655,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14722 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-08-25T05:37:56.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:56.520 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-08-25T05:37:56.529 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-25T05:37:56.529 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-25T05:37:56.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:56.530 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-25T05:37:56.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:56.593 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-25T05:37:56.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:56.690 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2023-08-25T05:37:56.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:56.882 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2023-08-25T05:37:56.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:56.894 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2023-08-25T05:37:56.972 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2023-08-25T05:37:56.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T05:37:56.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:56.975 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2023-08-25T05:37:56.988 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-25T05:37:56.988 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-25T05:37:56.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:56.989 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-25T05:37:57.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:57.060 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-25T05:37:57.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:57.165 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2023-08-25T05:37:57.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:57.362 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2023-08-25T05:37:57.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-25T05:37:57.372 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2023-08-25T05:37:57.438 INFO:teuthology.orchestra.run.smithi110.stderr:Cannot find device "ceph-brx" 2023-08-25T05:37:57.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T05:37:57.440 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-08-25T05:37:57.449 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-25T05:37:57.449 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:37:57.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.590+0000 7f5ffcf8f640 1 Processor -- start 2023-08-25T05:37:57.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.590+0000 7f5ffcf8f640 1 -- start start 2023-08-25T05:37:57.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.594+0000 7f5ffcf8f640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5ff80aeb10 0x7f5ff80ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:57.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.594+0000 7f5ffcf8f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff80cee20 0x7f5ff8069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:57.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.594+0000 7f5ffcf8f640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff80cf280 con 0x7f5ff8069e40 2023-08-25T05:37:57.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.594+0000 7f5ffcf8f640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff80d0380 con 0x7f5ff80aeb10 2023-08-25T05:37:57.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.594+0000 7f5ffcf8f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff806d590 con 0x7f5ff80cee20 2023-08-25T05:37:57.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.594+0000 7f5ff6d9d640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5ff8069e40 0x7f5ff8160520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34542/0 (socket says 172.21.15.55:34542) 2023-08-25T05:37:57.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.594+0000 7f5ff6d9d640 1 -- 172.21.15.55:0/2520320225 learned_addr learned my addr 172.21.15.55:0/2520320225 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:57.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.594+0000 7f5fedd9b640 1 --2- 172.21.15.55:0/2520320225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff80cee20 0x7f5ff8069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.594+0000 7f5ff659c640 1 --2- 172.21.15.55:0/2520320225 >> v2:172.21.15.110:3300/0 conn(0x7f5ff80aeb10 0x7f5ff80ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.594+0000 7f5ff5d9b640 1 -- 172.21.15.55:0/2520320225 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795255422 0 0) 0x7f5ff80cf280 con 0x7f5ff8069e40 2023-08-25T05:37:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.594+0000 7f5ff5d9b640 1 -- 172.21.15.55:0/2520320225 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fe4003530 con 0x7f5ff8069e40 2023-08-25T05:37:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.594+0000 7f5fedd9b640 1 -- 172.21.15.55:0/2520320225 >> v2:172.21.15.110:3300/0 conn(0x7f5ff80aeb10 msgr2=0x7f5ff80ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.594+0000 7f5fedd9b640 1 --2- 172.21.15.55:0/2520320225 >> v2:172.21.15.110:3300/0 conn(0x7f5ff80aeb10 0x7f5ff80ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:57.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.594+0000 7f5ff5d9b640 1 -- 172.21.15.55:0/2520320225 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 697561956 0 0) 0x7f5fe4003530 con 0x7f5ff8069e40 2023-08-25T05:37:57.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.594+0000 7f5fedd9b640 1 -- 172.21.15.55:0/2520320225 >> v1:172.21.15.55:6789/0 conn(0x7f5ff8069e40 legacy=0x7f5ff8160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:57.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.594+0000 7f5fedd9b640 1 -- 172.21.15.55:0/2520320225 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff806c4f0 con 0x7f5ff80cee20 2023-08-25T05:37:57.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.598+0000 7f5fedd9b640 1 --2- 172.21.15.55:0/2520320225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff80cee20 0x7f5ff8069900 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00097c0 tx=0x7f5fe001c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=598ba7b8d93388ed server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:57.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.598+0000 7f5ff5d9b640 1 -- 172.21.15.55:0/2520320225 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0001680 con 0x7f5ff80cee20 2023-08-25T05:37:57.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.598+0000 7f5ff5d9b640 1 -- 172.21.15.55:0/2520320225 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe00a7050 con 0x7f5ff80cee20 2023-08-25T05:37:57.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.598+0000 7f5ff5d9b640 1 -- 172.21.15.55:0/2520320225 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00ab620 con 0x7f5ff80cee20 2023-08-25T05:37:57.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.598+0000 7f5ffcf8f640 1 -- 172.21.15.55:0/2520320225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff80cee20 msgr2=0x7f5ff8069900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:57.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.598+0000 7f5ffcf8f640 1 --2- 172.21.15.55:0/2520320225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff80cee20 0x7f5ff8069900 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00097c0 tx=0x7f5fe001c3a0 comp rx=0 tx=0).stop 2023-08-25T05:37:57.601 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.598+0000 7f5ffcf8f640 1 -- 172.21.15.55:0/2520320225 shutdown_connections 2023-08-25T05:37:57.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.598+0000 7f5ffcf8f640 1 --2- 172.21.15.55:0/2520320225 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff80cee20 0x7f5ff8069900 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:57.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.598+0000 7f5ffcf8f640 1 --2- 172.21.15.55:0/2520320225 >> v2:172.21.15.110:3300/0 conn(0x7f5ff80aeb10 0x7f5ff80ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:57.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.598+0000 7f5ffcf8f640 1 -- 172.21.15.55:0/2520320225 >> 172.21.15.55:0/2520320225 conn(0x7f5ff80cf530 msgr2=0x7f5ff80cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:57.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.598+0000 7f5ffcf8f640 1 -- 172.21.15.55:0/2520320225 shutdown_connections 2023-08-25T05:37:57.602 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.598+0000 7f5ffcf8f640 1 -- 172.21.15.55:0/2520320225 wait complete. 2023-08-25T05:37:57.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.598+0000 7f5ffcf8f640 1 Processor -- start 2023-08-25T05:37:57.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.598+0000 7f5ffcf8f640 1 -- start start 2023-08-25T05:37:57.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5ffcf8f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff8069e40 0x7f5ff80c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:57.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5ffcf8f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ff80aeb10 0x7f5ff8159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:57.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5ffcf8f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ff80cee20 0x7f5ff80ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:57.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5ffcf8f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80c45f0 con 0x7f5ff80aeb10 2023-08-25T05:37:57.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5ffcf8f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff8159dc0 con 0x7f5ff80cee20 2023-08-25T05:37:57.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5ffcf8f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80c9770 con 0x7f5ff8069e40 2023-08-25T05:37:57.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5fedd9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ff80aeb10 0x7f5ff8159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:57.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5fedd9b640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ff80aeb10 0x7f5ff8159880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53204/0 (socket says 172.21.15.55:53204) 2023-08-25T05:37:57.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5fedd9b640 1 -- 172.21.15.55:0/3389845397 learned_addr learned my addr 172.21.15.55:0/3389845397 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:57.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5ff6d9d640 1 --2- 172.21.15.55:0/3389845397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ff80cee20 0x7f5ff80ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:57.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5ff659c640 1 --2- 172.21.15.55:0/3389845397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff8069e40 0x7f5ff80c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:57.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5fedd9b640 1 -- 172.21.15.55:0/3389845397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff8069e40 msgr2=0x7f5ff80c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:57.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5fedd9b640 1 --2- 172.21.15.55:0/3389845397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff8069e40 0x7f5ff80c40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:57.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5fedd9b640 1 -- 172.21.15.55:0/3389845397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ff80cee20 msgr2=0x7f5ff80ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:57.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5fedd9b640 1 --2- 172.21.15.55:0/3389845397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ff80cee20 0x7f5ff80ad250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:57.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5fedd9b640 1 -- 172.21.15.55:0/3389845397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe0009420 con 0x7f5ff80aeb10 2023-08-25T05:37:57.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5fedd9b640 1 --2- 172.21.15.55:0/3389845397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ff80aeb10 0x7f5ff8159880 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00ae040 tx=0x7f5fe0019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:57.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5fef7fe640 1 -- 172.21.15.55:0/3389845397 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00b4430 con 0x7f5ff80aeb10 2023-08-25T05:37:57.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5fef7fe640 1 -- 172.21.15.55:0/3389845397 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe00b45b0 con 0x7f5ff80aeb10 2023-08-25T05:37:57.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5fef7fe640 1 -- 172.21.15.55:0/3389845397 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00b4960 con 0x7f5ff80aeb10 2023-08-25T05:37:57.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5ffcf8f640 1 -- 172.21.15.55:0/3389845397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff80b2120 con 0x7f5ff80aeb10 2023-08-25T05:37:57.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5ffcf8f640 1 -- 172.21.15.55:0/3389845397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff80b26e0 con 0x7f5ff80aeb10 2023-08-25T05:37:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5ffcf8f640 1 -- 172.21.15.55:0/3389845397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff804dbe0 con 0x7f5ff80aeb10 2023-08-25T05:37:57.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.602+0000 7f5fef7fe640 1 -- 172.21.15.55:0/3389845397 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f5fe00b2040 con 0x7f5ff80aeb10 2023-08-25T05:37:57.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.606+0000 7f5fef7fe640 1 --2- 172.21.15.55:0/3389845397 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f5fd80657a0 0x7f5fd8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:57.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.606+0000 7f5fef7fe640 1 -- 172.21.15.55:0/3389845397 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f5fe011cbd0 con 0x7f5ff80aeb10 2023-08-25T05:37:57.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.606+0000 7f5ff659c640 1 --2- 172.21.15.55:0/3389845397 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f5fd80657a0 0x7f5fd8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:57.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.606+0000 7f5ff659c640 1 --2- 172.21.15.55:0/3389845397 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f5fd80657a0 0x7f5fd8067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80113e0 tx=0x7f5fe800b040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:57.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.610+0000 7f5fef7fe640 1 -- 172.21.15.55:0/3389845397 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5fe00ea570 con 0x7f5ff80aeb10 2023-08-25T05:37:57.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.762+0000 7f5ffcf8f640 1 -- 172.21.15.55:0/3389845397 --> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ff806d070 con 0x7f5fd80657a0 2023-08-25T05:37:57.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.766+0000 7f5fef7fe640 1 -- 172.21.15.55:0/3389845397 <== mgr.9404 v2:172.21.15.110:6832/1527806048 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72927 (secure 0 0 0) 0x7f5fe800f040 con 0x7f5fd80657a0 2023-08-25T05:37:57.770 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:57.770 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:37:57.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.766+0000 7f5ffcf8f640 1 -- 172.21.15.55:0/3389845397 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f5fd80657a0 msgr2=0x7f5fd8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:57.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.766+0000 7f5ffcf8f640 1 --2- 172.21.15.55:0/3389845397 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f5fd80657a0 0x7f5fd8067c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80113e0 tx=0x7f5fe800b040 comp rx=0 tx=0).stop 2023-08-25T05:37:57.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.766+0000 7f5ffcf8f640 1 -- 172.21.15.55:0/3389845397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ff80aeb10 msgr2=0x7f5ff8159880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:57.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.766+0000 7f5ffcf8f640 1 --2- 172.21.15.55:0/3389845397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ff80aeb10 0x7f5ff8159880 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00ae040 tx=0x7f5fe0019140 comp rx=0 tx=0).stop 2023-08-25T05:37:57.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.766+0000 7f5ffcf8f640 1 -- 172.21.15.55:0/3389845397 shutdown_connections 2023-08-25T05:37:57.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.766+0000 7f5ffcf8f640 1 --2- 172.21.15.55:0/3389845397 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f5fd80657a0 0x7f5fd8067c60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:57.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.766+0000 7f5ffcf8f640 1 --2- 172.21.15.55:0/3389845397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ff80cee20 0x7f5ff80ad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:57.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.770+0000 7f5ffcf8f640 1 --2- 172.21.15.55:0/3389845397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ff80aeb10 0x7f5ff8159880 unknown :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:57.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.770+0000 7f5ffcf8f640 1 --2- 172.21.15.55:0/3389845397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ff8069e40 0x7f5ff80c40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:57.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.770+0000 7f5ffcf8f640 1 -- 172.21.15.55:0/3389845397 >> 172.21.15.55:0/3389845397 conn(0x7f5ff80cf530 msgr2=0x7f5ff80c9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:57.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.770+0000 7f5ffcf8f640 1 -- 172.21.15.55:0/3389845397 shutdown_connections 2023-08-25T05:37:57.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.770+0000 7f5ffcf8f640 1 -- 172.21.15.55:0/3389845397 wait complete. 2023-08-25T05:37:57.790 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-08-25T05:37:56.120848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2288,"num_read_kb":4815,"num_write":605,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":439600,"kb_used_data":22228,"kb_used_omap":13,"kb_used_meta":417266,"kb_avail":754535120,"statfs":{"total":773094113280,"available":772643962880,"internally_reserved":0,"allocated":22761472,"data_stored":12631655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":427280472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-669915,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-221,"num_read_kb":-75,"num_write":-264,"num_write_kb":-2057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001314"},"pg_stats":[{"pgid":"1.0","version":"204'3675","reported_seq":4731,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-25T05:37:51.648847+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:37:51.648847+0000","last_peered":"2023-08-25T05:37:51.648847+0000","last_clean":"2023-08-25T05:37:51.648847+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:37:51.648847+0000","last_undegraded":"2023-08-25T05:37:51.648847+0000","last_fullsized":"2023-08-25T05:37:51.648847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3675,"log_dups_size":0,"ondisk_log_size":3675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:29:52.265239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2288,"num_read_kb":4815,"num_write":605,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":368,"reported_epoch":206,"state":"active+clean","last_fresh":"2023-08-25T05:37:53.364813+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:37:53.364813+0000","last_peered":"2023-08-25T05:37:53.364813+0000","last_clean":"2023-08-25T05:37:53.364813+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:37:53.364813+0000","last_undegraded":"2023-08-25T05:37:53.364813+0000","last_fullsized":"2023-08-25T05:37:53.364813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:57.924216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":358,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-25T05:37:51.649206+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:37:51.649206+0000","last_peered":"2023-08-25T05:37:51.649206+0000","last_clean":"2023-08-25T05:37:51.649206+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:37:51.649206+0000","last_undegraded":"2023-08-25T05:37:51.649206+0000","last_fullsized":"2023-08-25T05:37:51.649206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:37:19.507667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":366,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-25T05:37:51.648868+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:37:51.648868+0000","last_peered":"2023-08-25T05:37:51.648868+0000","last_clean":"2023-08-25T05:37:51.648868+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:37:51.648868+0000","last_undegraded":"2023-08-25T05:37:51.648868+0000","last_fullsized":"2023-08-25T05:37:51.648868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:02:41.995857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":368,"reported_epoch":206,"state":"active+clean","last_fresh":"2023-08-25T05:37:53.364610+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:37:53.364610+0000","last_peered":"2023-08-25T05:37:53.364610+0000","last_clean":"2023-08-25T05:37:53.364610+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:37:53.364610+0000","last_undegraded":"2023-08-25T05:37:53.364610+0000","last_fullsized":"2023-08-25T05:37:53.364610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:59:35.310033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":398,"reported_epoch":206,"state":"active+clean","last_fresh":"2023-08-25T05:37:53.337953+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:37:53.337953+0000","last_peered":"2023-08-25T05:37:53.337953+0000","last_clean":"2023-08-25T05:37:53.337953+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:37:53.337953+0000","last_undegraded":"2023-08-25T05:37:53.337953+0000","last_fullsized":"2023-08-25T05:37:53.337953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:49:54.028883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":356,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-25T05:37:51.649013+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:37:51.649013+0000","last_peered":"2023-08-25T05:37:51.649013+0000","last_clean":"2023-08-25T05:37:51.649013+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:37:51.649013+0000","last_undegraded":"2023-08-25T05:37:51.649013+0000","last_fullsized":"2023-08-25T05:37:51.649013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:08:06.397903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":396,"reported_epoch":206,"state":"active+clean","last_fresh":"2023-08-25T05:37:53.338748+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:37:53.338748+0000","last_peered":"2023-08-25T05:37:53.338748+0000","last_clean":"2023-08-25T05:37:53.338748+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:37:53.338748+0000","last_undegraded":"2023-08-25T05:37:53.338748+0000","last_fullsized":"2023-08-25T05:37:53.338748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:23:11.341721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":420,"reported_epoch":206,"state":"active+clean","last_fresh":"2023-08-25T05:37:53.336876+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:37:53.336876+0000","last_peered":"2023-08-25T05:37:53.336876+0000","last_clean":"2023-08-25T05:37:53.336876+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:37:53.336876+0000","last_undegraded":"2023-08-25T05:37:53.336876+0000","last_fullsized":"2023-08-25T05:37:53.336876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:02:54.620535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2288,"num_read_kb":4815,"num_write":605,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510573,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52308,"kb_used_data":3080,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319532,"statfs":{"total":96636764160,"available":96583200768,"internally_reserved":0,"allocated":3153920,"data_stored":1894424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.40999999999999998},"max":{"1min":0.94599999999999995,"5min":0.95499999999999996,"15min":1.0169999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.441},"max":{"1min":0.90700000000000003,"5min":1.016,"15min":1.0189999999999999},"last":0.73599999999999999}]},{"osd":1,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93799999999999994,"5min":0.99199999999999999,"15min":1.054},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.749,"15min":0.77300000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.753},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77300000000000002,"15min":0.76800000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.53600000000000003},"max":{"1min":1.0129999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.81999999999999995}]},{"osd":3,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76700000000000002,"15min":0.77000000000000002},"min":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94499999999999995,"5min":1.006,"15min":1.006},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98299999999999998,"5min":1.0600000000000001,"15min":1.0680000000000001},"last":0.71799999999999997}]},{"osd":4,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0449999999999999,"5min":1.163,"15min":1.163},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.36599999999999999},"max":{"1min":0.97199999999999998,"5min":0.997,"15min":1.1120000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.501,"5min":0.44,"15min":0.42699999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.56999999999999995}]},{"osd":6,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.74399999999999999,"15min":0.73099999999999998},"min":{"1min":0.50900000000000001,"5min":0.499,"15min":0.47999999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.71499999999999997,"15min":0.69999999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0900000000000001,"5min":1.119,"15min":1.119},"last":0.51100000000000001}]}]},{"osd":6,"up_from":15,"seq":64424510573,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51740,"kb_used_data":2516,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320100,"statfs":{"total":96636764160,"available":96583782400,"internally_reserved":0,"allocated":2576384,"data_stored":1311100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.71599999999999997,"15min":0.74099999999999999},"min":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89900000000000002,"5min":0.99099999999999999,"15min":1.0449999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.505,"5min":0.40100000000000002,"15min":0.40000000000000002},"max":{"1min":0.92400000000000004,"5min":1.0389999999999999,"15min":1.1699999999999999},"last":0.68999999999999995}]},{"osd":1,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73799999999999999,"15min":0.76200000000000001},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89800000000000002,"5min":0.94999999999999996,"15min":1.1559999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72599999999999998,"15min":0.755},"min":{"1min":0.54400000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.91100000000000003,"5min":1.1180000000000001,"15min":1.1299999999999999},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75800000000000001,"15min":0.78600000000000003},"min":{"1min":0.54000000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.89300000000000002,"5min":1.0760000000000001,"15min":1.0780000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80300000000000005,"15min":0.82199999999999995},"min":{"1min":0.56000000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95799999999999996,"5min":1.0669999999999999,"15min":1.1599999999999999},"last":0.751}]},{"osd":3,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.75900000000000001,"15min":0.78300000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.87,"5min":1.002,"15min":1.208},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94399999999999995,"5min":1.054,"15min":1.236},"last":0.79500000000000004}]},{"osd":4,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.41899999999999998,"15min":0.33200000000000002},"max":{"1min":0.83099999999999996,"5min":0.93300000000000005,"15min":1.018},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.35499999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.016},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90600000000000003,"5min":0.98999999999999999,"15min":1.1319999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.73299999999999998},"min":{"1min":0.48599999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91900000000000004,"5min":1.071,"15min":1.1659999999999999},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64300000000000002,"15min":0.65800000000000003},"min":{"1min":0.46800000000000003,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":0.94199999999999995,"5min":0.97199999999999998,"15min":1.044},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68799999999999994,"15min":0.69499999999999995},"min":{"1min":0.501,"5min":0.47099999999999997,"15min":0.42899999999999999},"max":{"1min":0.96899999999999997,"5min":1.228,"15min":1.228},"last":0.88300000000000001}]}]},{"osd":5,"up_from":14,"seq":60129543276,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60076,"kb_used_data":2528,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311764,"statfs":{"total":96636764160,"available":96575246336,"internally_reserved":0,"allocated":2588672,"data_stored":1317182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91600000000000004,"5min":0.97799999999999998,"15min":1.034},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94699999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.85699999999999998}]},{"osd":1,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.73799999999999999,"15min":0.75800000000000001},"min":{"1min":0.48199999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.073},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.75600000000000001,"15min":0.77000000000000002},"min":{"1min":0.52800000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84799999999999998,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.97399999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72899999999999998,"15min":0.75},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.92100000000000004,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75600000000000001,"15min":0.76900000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93100000000000005,"5min":1.208,"15min":1.208},"last":0.63900000000000001}]},{"osd":3,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.76000000000000001,"15min":0.76500000000000001},"min":{"1min":0.56399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98299999999999998,"5min":1.155,"15min":1.155},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94199999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.60999999999999999},"min":{"1min":0.38500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.88900000000000001,"5min":1.681,"15min":1.681},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66000000000000003,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42499999999999999},"max":{"1min":1.0660000000000001,"5min":1.381,"15min":1.381},"last":0.95399999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68799999999999994,"15min":0.67300000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.42199999999999999},"max":{"1min":0.86099999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69499999999999995,"15min":0.68700000000000006},"min":{"1min":0.53100000000000003,"5min":0.49399999999999999,"15min":0.44900000000000001},"max":{"1min":1.0269999999999999,"5min":1.276,"15min":1.276},"last":0.92200000000000004}]},{"osd":7,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67900000000000005,"15min":0.66700000000000004},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.89800000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76400000000000001,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91300000000000003,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.046}]}]},{"osd":4,"up_from":14,"seq":60129543276,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47596,"kb_used_data":2528,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324244,"statfs":{"total":96636764160,"available":96588025856,"internally_reserved":0,"allocated":2588672,"data_stored":1317194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91500000000000004,"5min":0.97799999999999998,"15min":1.054},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.47299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92500000000000004,"5min":0.96499999999999997,"15min":1.02},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.73399999999999999,"15min":0.76400000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88200000000000001,"5min":1.05,"15min":1.05},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.103},"last":0.65300000000000002}]},{"osd":2,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.85999999999999999,"5min":0.995,"15min":1.0780000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.55100000000000005,"5min":0.501,"15min":0.47999999999999998},"max":{"1min":1.0389999999999999,"5min":1.069,"15min":1.069},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.56899999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92300000000000004,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75900000000000001,"15min":0.77700000000000002},"min":{"1min":0.52900000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96399999999999997,"5min":1.101,"15min":1.101},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.55500000000000005},"min":{"1min":0.40300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80100000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.60299999999999998},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83699999999999997,"5min":0.93700000000000006,"15min":0.98299999999999998},"last":0.83099999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75800000000000001,"15min":0.747},"min":{"1min":0.59899999999999998,"5min":0.49399999999999999,"15min":0.49199999999999999},"max":{"1min":0.93500000000000005,"5min":1.0029999999999999,"15min":1.1240000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.67000000000000004,"15min":0.65500000000000003},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93200000000000005,"5min":1.018,"15min":1.0629999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.628,"15min":0.623},"min":{"1min":0.42499999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.996,"15min":0.996},"last":0.754},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73499999999999999,"15min":0.71999999999999997},"min":{"1min":0.53700000000000003,"5min":0.496,"15min":0.47599999999999998},"max":{"1min":0.93000000000000005,"5min":1.018,"15min":1.0860000000000001},"last":0.79500000000000004}]}]},{"osd":3,"up_from":14,"seq":60129543276,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64540,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307300,"statfs":{"total":96636764160,"available":96570675200,"internally_reserved":0,"allocated":2899968,"data_stored":1632448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":63174923},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.32200000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.61099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.92900000000000005},"last":0.377}]},{"osd":1,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.33300000000000002},"max":{"1min":0.74399999999999999,"5min":0.80700000000000005,"15min":1.0780000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61099999999999999,"15min":0.627},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.76400000000000001,"5min":0.88900000000000001,"15min":0.97999999999999998},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96599999999999997,"5min":1.0089999999999999,"15min":1.038},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.95799999999999996},"last":0.49299999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78700000000000003,"15min":0.79800000000000004},"min":{"1min":0.56999999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.014,"5min":1.26,"15min":1.26},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83099999999999996,"15min":0.82999999999999996},"min":{"1min":0.54200000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.069,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.94099999999999995}]},{"osd":5,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80600000000000005},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99399999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.80700000000000005,"15min":0.82199999999999995},"min":{"1min":0.56599999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97899999999999998,"5min":1.0880000000000001,"15min":1.1419999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.85299999999999998,"15min":0.86199999999999999},"min":{"1min":0.63200000000000001,"5min":0.59499999999999997,"15min":0.59399999999999997},"max":{"1min":1.0169999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81399999999999995,"15min":0.83599999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.48999999999999999},"max":{"1min":0.98299999999999998,"5min":1.133,"15min":1.194},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.85999999999999999,"15min":0.878},"min":{"1min":0.68100000000000005,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.056,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.82399999999999995,"15min":0.83099999999999996},"min":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.51800000000000002},"max":{"1min":0.999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.69799999999999995}]}]},{"osd":2,"up_from":14,"seq":60129543277,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60376,"kb_used_data":2828,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311464,"statfs":{"total":96636764160,"available":96574939136,"internally_reserved":0,"allocated":2895872,"data_stored":1632419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.46000000000000002,"15min":0.47699999999999998},"min":{"1min":0.33400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.435},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.35499999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71699999999999997,"5min":0.85099999999999998,"15min":0.86099999999999999},"last":0.41499999999999998}]},{"osd":1,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66200000000000003,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83099999999999996,"5min":0.88800000000000001,"15min":0.89700000000000002},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.41099999999999998,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.78000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.63200000000000001,"5min":0.56399999999999995,"15min":0.48699999999999999},"max":{"1min":1.0720000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.625},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80400000000000005,"15min":0.81100000000000005},"min":{"1min":0.66200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.1619999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.745}]},{"osd":5,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.60899999999999999,"5min":0.53200000000000003,"15min":0.51700000000000002},"max":{"1min":1.0089999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.84699999999999998},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.246,"5min":1.266,"15min":1.266},"last":0.58299999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.103,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.875,"15min":0.88},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.58899999999999997},"max":{"1min":1.204,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.70099999999999996}]},{"osd":7,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.82599999999999996,"15min":0.83799999999999997},"min":{"1min":0.69299999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1040000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.82699999999999996,"15min":0.83199999999999996},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1870000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.76200000000000001}]}]},{"osd":1,"up_from":14,"seq":60129543277,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42320,"kb_used_data":2820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329520,"statfs":{"total":96636764160,"available":96593428480,"internally_reserved":0,"allocated":2887680,"data_stored":1631736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.47699999999999998},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.70299999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.34100000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.71099999999999997,"5min":0.73799999999999999,"15min":0.879},"last":0.44600000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.81399999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66600000000000004,"5min":0.82899999999999996,"15min":0.91400000000000003},"last":0.432}]},{"osd":3,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73199999999999998,"5min":0.998,"15min":0.998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.376,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73299999999999998,"5min":0.88700000000000001,"15min":0.98699999999999999},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91000000000000003,"5min":1.1559999999999999,"15min":1.2350000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82999999999999996,"15min":0.83699999999999997},"min":{"1min":0.69099999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98699999999999999,"5min":1.268,"15min":1.268},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.80900000000000005},"min":{"1min":0.624,"5min":0.54800000000000004,"15min":0.47699999999999998},"max":{"1min":0.89800000000000002,"5min":1.109,"15min":1.1950000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.66200000000000003,"5min":0.61899999999999999,"15min":0.55300000000000005},"max":{"1min":0.97899999999999998,"5min":1.214,"15min":1.214},"last":0.70099999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.66100000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.94499999999999995,"5min":1.212,"15min":1.244},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.81899999999999995,"15min":0.83699999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.94699999999999995,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81200000000000006,"15min":0.83699999999999997},"min":{"1min":0.61699999999999999,"5min":0.60899999999999999,"15min":0.55600000000000005},"max":{"1min":1.0069999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.626},"max":{"1min":0.96799999999999997,"5min":1.127,"15min":1.2110000000000001},"last":0.63200000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543276,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60644,"kb_used_data":3096,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311196,"statfs":{"total":96636764160,"available":96574664704,"internally_reserved":0,"allocated":3170304,"data_stored":1895152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48999999999999999,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.308,"15min":0.30599999999999999},"max":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":1.2170000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.81599999999999995,"15min":0.85999999999999999},"last":0.378}]},{"osd":2,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36399999999999999,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":0.81399999999999995,"15min":0.91000000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55000000000000004,"15min":0.56100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71499999999999997,"5min":0.755,"15min":0.86799999999999999},"last":0.44}]},{"osd":3,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.754,"15min":1.855},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.75900000000000001,"5min":0.90000000000000002,"15min":1.3480000000000001},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.57599999999999996,"5min":0.495,"15min":0.495},"max":{"1min":1.0600000000000001,"5min":1.258,"15min":1.3799999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81699999999999995,"15min":0.83199999999999996},"min":{"1min":0.627,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0529999999999999,"5min":1.2809999999999999,"15min":1.2849999999999999},"last":0.85499999999999998}]},{"osd":5,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.58999999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.004,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82499999999999996,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0620000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.89000000000000001}]},{"osd":6,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82199999999999995,"15min":0.83599999999999997},"min":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0429999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.875},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86499999999999999,"15min":0.85999999999999999},"min":{"1min":0.51600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.0880000000000001,"5min":1.3560000000000001,"15min":1.5129999999999999},"last":0.97799999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85799999999999998,"15min":0.876},"min":{"1min":0.64600000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0760000000000001,"5min":1.4339999999999999,"15min":1.5720000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58099999999999996},"max":{"1min":1.0620000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.89900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:37:57.793 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:37:57.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c8a34640 1 Processor -- start 2023-08-25T05:37:57.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c8a34640 1 -- start start 2023-08-25T05:37:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c8a34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3c40ce220 0x7fa3c40b3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c8a34640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c40b29b0 con 0x7fa3c40d0da0 2023-08-25T05:37:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c8a34640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c40ce6b0 con 0x7fa3c40cdde0 2023-08-25T05:37:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c8a34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40b1dc0 con 0x7fa3c40ce220 2023-08-25T05:37:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c259c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa3c40d0da0 0x7fa3c40d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34548/0 (socket says 172.21.15.55:34548) 2023-08-25T05:37:57.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c259c640 1 -- 172.21.15.55:0/1715981632 learned_addr learned my addr 172.21.15.55:0/1715981632 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:57.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c2d9d640 1 --2- 172.21.15.55:0/1715981632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3c40ce220 0x7fa3c40b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:57.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c159a640 1 -- 172.21.15.55:0/1715981632 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926417919 0 0) 0x7fa3c40b29b0 con 0x7fa3c40d0da0 2023-08-25T05:37:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c159a640 1 -- 172.21.15.55:0/1715981632 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3ac003530 con 0x7fa3c40d0da0 2023-08-25T05:37:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c159a640 1 -- 172.21.15.55:0/1715981632 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2845067093 0 0) 0x7fa3ac003530 con 0x7fa3c40d0da0 2023-08-25T05:37:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c159a640 1 -- 172.21.15.55:0/1715981632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3c40ce220 msgr2=0x7fa3c40b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c159a640 1 --2- 172.21.15.55:0/1715981632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3c40ce220 0x7fa3c40b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c159a640 1 -- 172.21.15.55:0/1715981632 >> v1:172.21.15.110:6789/0 conn(0x7fa3c40cdde0 legacy=0x7fa3c40b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c159a640 1 -- 172.21.15.55:0/1715981632 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c40b2080 con 0x7fa3c40d0da0 2023-08-25T05:37:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c159a640 1 -- 172.21.15.55:0/1715981632 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7fa3b4001800 con 0x7fa3c40d0da0 2023-08-25T05:37:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c159a640 1 -- 172.21.15.55:0/1715981632 >> v1:172.21.15.55:6789/0 conn(0x7fa3c40d0da0 legacy=0x7fa3c40d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c159a640 1 --2- 172.21.15.55:0/1715981632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3ac0039b0 0x7fa3ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c159a640 1 --2- 172.21.15.55:0/1715981632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3c40ce220 0x7fa3ac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c159a640 1 --2- 172.21.15.55:0/1715981632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3ac004d10 0x7fa3ac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c159a640 1 -- 172.21.15.55:0/1715981632 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40b1dc0 con 0x7fa3ac004d10 2023-08-25T05:37:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c159a640 1 -- 172.21.15.55:0/1715981632 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac00bad0 con 0x7fa3ac0039b0 2023-08-25T05:37:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c159a640 1 -- 172.21.15.55:0/1715981632 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac00bc90 con 0x7fa3c40ce220 2023-08-25T05:37:57.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c259c640 1 --2- 172.21.15.55:0/1715981632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3ac0039b0 0x7fa3ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:57.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c2d9d640 1 --2- 172.21.15.55:0/1715981632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3ac004d10 0x7fa3ac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:57.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c1d9b640 1 --2- 172.21.15.55:0/1715981632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3c40ce220 0x7fa3ac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:57.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c259c640 1 -- 172.21.15.55:0/1715981632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3c40ce220 msgr2=0x7fa3ac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:57.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c259c640 1 --2- 172.21.15.55:0/1715981632 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3c40ce220 0x7fa3ac0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:57.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c259c640 1 -- 172.21.15.55:0/1715981632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3ac004d10 msgr2=0x7fa3ac005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:57.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c259c640 1 --2- 172.21.15.55:0/1715981632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3ac004d10 0x7fa3ac005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:57.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c259c640 1 -- 172.21.15.55:0/1715981632 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac003530 con 0x7fa3ac0039b0 2023-08-25T05:37:57.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.934+0000 7fa3c2d9d640 1 --2- 172.21.15.55:0/1715981632 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3ac004d10 0x7fa3ac005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.938+0000 7fa3c259c640 1 --2- 172.21.15.55:0/1715981632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3ac0039b0 0x7fa3ac003dd0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400c210 tx=0x7fa3b401cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b27fa5d16ac2e758 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.938+0000 7fa3c159a640 1 -- 172.21.15.55:0/1715981632 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b40a5b00 con 0x7fa3ac0039b0 2023-08-25T05:37:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.938+0000 7fa3c159a640 1 -- 172.21.15.55:0/1715981632 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b40a5c80 con 0x7fa3ac0039b0 2023-08-25T05:37:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.938+0000 7fa3c159a640 1 -- 172.21.15.55:0/1715981632 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4007070 con 0x7fa3ac0039b0 2023-08-25T05:37:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.938+0000 7fa3c8a34640 1 -- 172.21.15.55:0/1715981632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3ac0039b0 msgr2=0x7fa3ac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.938+0000 7fa3c8a34640 1 --2- 172.21.15.55:0/1715981632 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3ac0039b0 0x7fa3ac003dd0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400c210 tx=0x7fa3b401cc00 comp rx=0 tx=0).stop 2023-08-25T05:37:57.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.938+0000 7fa3c2d9d640 1 -- 172.21.15.55:0/1715981632 reap_dead start 2023-08-25T05:37:57.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.938+0000 7fa3c8a34640 1 -- 172.21.15.55:0/1715981632 shutdown_connections 2023-08-25T05:37:57.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.938+0000 7fa3c8a34640 1 -- 172.21.15.55:0/1715981632 >> 172.21.15.55:0/1715981632 conn(0x7fa3c409bae0 msgr2=0x7fa3c40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:57.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.938+0000 7fa3c8a34640 1 -- 172.21.15.55:0/1715981632 shutdown_connections 2023-08-25T05:37:57.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.938+0000 7fa3c8a34640 1 -- 172.21.15.55:0/1715981632 wait complete. 2023-08-25T05:37:57.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c8a34640 1 Processor -- start 2023-08-25T05:37:57.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c8a34640 1 -- start start 2023-08-25T05:37:57.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c8a34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3ac0039b0 0x7fa3c40c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:57.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c8a34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c40cbe30 0x7fa3c4151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c8a34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3c415ec40 0x7fa3c40c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c8a34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c4152380 con 0x7fa3c415ec40 2023-08-25T05:37:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c8a34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40c62f0 con 0x7fa3c40cbe30 2023-08-25T05:37:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c8a34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c415f470 con 0x7fa3ac0039b0 2023-08-25T05:37:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3c415ec40 0x7fa3c40c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c2d9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3c415ec40 0x7fa3c40c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53224/0 (socket says 172.21.15.55:53224) 2023-08-25T05:37:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c2d9d640 1 -- 172.21.15.55:0/799005058 learned_addr learned my addr 172.21.15.55:0/799005058 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:57.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c259c640 1 --2- 172.21.15.55:0/799005058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3ac0039b0 0x7fa3c40c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:57.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c2d9d640 1 -- 172.21.15.55:0/799005058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3ac0039b0 msgr2=0x7fa3c40c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:57.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c2d9d640 1 --2- 172.21.15.55:0/799005058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3ac0039b0 0x7fa3c40c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:57.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c1d9b640 1 --2- 172.21.15.55:0/799005058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c40cbe30 0x7fa3c4151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:57.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c2d9d640 1 -- 172.21.15.55:0/799005058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c40cbe30 msgr2=0x7fa3c4151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:57.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c2d9d640 1 --2- 172.21.15.55:0/799005058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c40cbe30 0x7fa3c4151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:57.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c2d9d640 1 -- 172.21.15.55:0/799005058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c415f750 con 0x7fa3c415ec40 2023-08-25T05:37:57.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c259c640 1 --2- 172.21.15.55:0/799005058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3ac0039b0 0x7fa3c40c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:57.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c1d9b640 1 --2- 172.21.15.55:0/799005058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c40cbe30 0x7fa3c4151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:37:57.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3c2d9d640 1 --2- 172.21.15.55:0/799005058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3c415ec40 0x7fa3c40c81b0 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7fa3c409c210 tx=0x7fa3bc00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:57.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.942+0000 7fa3b2ffd640 1 -- 172.21.15.55:0/799005058 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc00e040 con 0x7fa3c415ec40 2023-08-25T05:37:57.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.946+0000 7fa3b2ffd640 1 -- 172.21.15.55:0/799005058 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc00f040 con 0x7fa3c415ec40 2023-08-25T05:37:57.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.946+0000 7fa3c8a34640 1 -- 172.21.15.55:0/799005058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c40c65b0 con 0x7fa3c415ec40 2023-08-25T05:37:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.946+0000 7fa3b2ffd640 1 -- 172.21.15.55:0/799005058 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc003be0 con 0x7fa3c415ec40 2023-08-25T05:37:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.946+0000 7fa3c8a34640 1 -- 172.21.15.55:0/799005058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c415f0f0 con 0x7fa3c415ec40 2023-08-25T05:37:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.946+0000 7fa3c8a34640 1 -- 172.21.15.55:0/799005058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c404dbe0 con 0x7fa3c415ec40 2023-08-25T05:37:57.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.946+0000 7fa3b2ffd640 1 -- 172.21.15.55:0/799005058 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fa3bc015430 con 0x7fa3c415ec40 2023-08-25T05:37:57.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.946+0000 7fa3b2ffd640 1 --2- 172.21.15.55:0/799005058 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fa3a40657d0 0x7fa3a4067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:57.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.946+0000 7fa3b2ffd640 1 -- 172.21.15.55:0/799005058 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fa3bc083710 con 0x7fa3c415ec40 2023-08-25T05:37:57.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.946+0000 7fa3c259c640 1 --2- 172.21.15.55:0/799005058 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fa3a40657d0 0x7fa3a4067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:57.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.950+0000 7fa3c259c640 1 --2- 172.21.15.55:0/799005058 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fa3a40657d0 0x7fa3a4067c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40ab000 tx=0x7fa3b40a7070 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:57.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:57.950+0000 7fa3b2ffd640 1 -- 172.21.15.55:0/799005058 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa3bc054aa0 con 0x7fa3c415ec40 2023-08-25T05:37:58.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.102+0000 7fa3c8a34640 1 -- 172.21.15.55:0/799005058 --> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3c415f8e0 con 0x7fa3a40657d0 2023-08-25T05:37:58.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.106+0000 7fa3b2ffd640 1 -- 172.21.15.55:0/799005058 <== mgr.9404 v2:172.21.15.110:6832/1527806048 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72927 (secure 0 0 0) 0x7fa3c415f8e0 con 0x7fa3a40657d0 2023-08-25T05:37:58.111 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:58.111 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:37:58.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.110+0000 7fa3c8a34640 1 -- 172.21.15.55:0/799005058 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fa3a40657d0 msgr2=0x7fa3a4067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:58.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.110+0000 7fa3c8a34640 1 --2- 172.21.15.55:0/799005058 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fa3a40657d0 0x7fa3a4067c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40ab000 tx=0x7fa3b40a7070 comp rx=0 tx=0).stop 2023-08-25T05:37:58.112 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.110+0000 7fa3c8a34640 1 -- 172.21.15.55:0/799005058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3c415ec40 msgr2=0x7fa3c40c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:58.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.110+0000 7fa3c8a34640 1 --2- 172.21.15.55:0/799005058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3c415ec40 0x7fa3c40c81b0 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7fa3c409c210 tx=0x7fa3bc00f580 comp rx=0 tx=0).stop 2023-08-25T05:37:58.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.110+0000 7fa3c8a34640 1 -- 172.21.15.55:0/799005058 shutdown_connections 2023-08-25T05:37:58.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.110+0000 7fa3c8a34640 1 --2- 172.21.15.55:0/799005058 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fa3a40657d0 0x7fa3a4067c90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.110+0000 7fa3c8a34640 1 --2- 172.21.15.55:0/799005058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3c415ec40 0x7fa3c40c81b0 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.110+0000 7fa3c8a34640 1 --2- 172.21.15.55:0/799005058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3c40cbe30 0x7fa3c4151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.113 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.110+0000 7fa3c8a34640 1 --2- 172.21.15.55:0/799005058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3ac0039b0 0x7fa3c40c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.110+0000 7fa3c8a34640 1 -- 172.21.15.55:0/799005058 >> 172.21.15.55:0/799005058 conn(0x7fa3c409bae0 msgr2=0x7fa3c40b4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:58.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.110+0000 7fa3c8a34640 1 -- 172.21.15.55:0/799005058 shutdown_connections 2023-08-25T05:37:58.114 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.110+0000 7fa3c8a34640 1 -- 172.21.15.55:0/799005058 wait complete. 2023-08-25T05:37:58.131 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-08-25T05:37:56.120848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2288,"num_read_kb":4815,"num_write":605,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":439600,"kb_used_data":22228,"kb_used_omap":13,"kb_used_meta":417266,"kb_avail":754535120,"statfs":{"total":773094113280,"available":772643962880,"internally_reserved":0,"allocated":22761472,"data_stored":12631655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":427280472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-669915,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-221,"num_read_kb":-75,"num_write":-264,"num_write_kb":-2057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001314"},"pg_stats":[{"pgid":"1.0","version":"204'3675","reported_seq":4731,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-25T05:37:51.648847+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:37:51.648847+0000","last_peered":"2023-08-25T05:37:51.648847+0000","last_clean":"2023-08-25T05:37:51.648847+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:37:51.648847+0000","last_undegraded":"2023-08-25T05:37:51.648847+0000","last_fullsized":"2023-08-25T05:37:51.648847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3675,"log_dups_size":0,"ondisk_log_size":3675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:29:52.265239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2288,"num_read_kb":4815,"num_write":605,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":368,"reported_epoch":206,"state":"active+clean","last_fresh":"2023-08-25T05:37:53.364813+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:37:53.364813+0000","last_peered":"2023-08-25T05:37:53.364813+0000","last_clean":"2023-08-25T05:37:53.364813+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:37:53.364813+0000","last_undegraded":"2023-08-25T05:37:53.364813+0000","last_fullsized":"2023-08-25T05:37:53.364813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:57.924216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":358,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-25T05:37:51.649206+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:37:51.649206+0000","last_peered":"2023-08-25T05:37:51.649206+0000","last_clean":"2023-08-25T05:37:51.649206+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:37:51.649206+0000","last_undegraded":"2023-08-25T05:37:51.649206+0000","last_fullsized":"2023-08-25T05:37:51.649206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:37:19.507667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":366,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-25T05:37:51.648868+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:37:51.648868+0000","last_peered":"2023-08-25T05:37:51.648868+0000","last_clean":"2023-08-25T05:37:51.648868+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:37:51.648868+0000","last_undegraded":"2023-08-25T05:37:51.648868+0000","last_fullsized":"2023-08-25T05:37:51.648868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:02:41.995857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":368,"reported_epoch":206,"state":"active+clean","last_fresh":"2023-08-25T05:37:53.364610+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:37:53.364610+0000","last_peered":"2023-08-25T05:37:53.364610+0000","last_clean":"2023-08-25T05:37:53.364610+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:37:53.364610+0000","last_undegraded":"2023-08-25T05:37:53.364610+0000","last_fullsized":"2023-08-25T05:37:53.364610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:59:35.310033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":398,"reported_epoch":206,"state":"active+clean","last_fresh":"2023-08-25T05:37:53.337953+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:37:53.337953+0000","last_peered":"2023-08-25T05:37:53.337953+0000","last_clean":"2023-08-25T05:37:53.337953+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:37:53.337953+0000","last_undegraded":"2023-08-25T05:37:53.337953+0000","last_fullsized":"2023-08-25T05:37:53.337953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:49:54.028883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":356,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-25T05:37:51.649013+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:37:51.649013+0000","last_peered":"2023-08-25T05:37:51.649013+0000","last_clean":"2023-08-25T05:37:51.649013+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:37:51.649013+0000","last_undegraded":"2023-08-25T05:37:51.649013+0000","last_fullsized":"2023-08-25T05:37:51.649013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:08:06.397903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":396,"reported_epoch":206,"state":"active+clean","last_fresh":"2023-08-25T05:37:53.338748+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:37:53.338748+0000","last_peered":"2023-08-25T05:37:53.338748+0000","last_clean":"2023-08-25T05:37:53.338748+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:37:53.338748+0000","last_undegraded":"2023-08-25T05:37:53.338748+0000","last_fullsized":"2023-08-25T05:37:53.338748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:23:11.341721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":420,"reported_epoch":206,"state":"active+clean","last_fresh":"2023-08-25T05:37:53.336876+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:37:53.336876+0000","last_peered":"2023-08-25T05:37:53.336876+0000","last_clean":"2023-08-25T05:37:53.336876+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:37:53.336876+0000","last_undegraded":"2023-08-25T05:37:53.336876+0000","last_fullsized":"2023-08-25T05:37:53.336876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:02:54.620535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2288,"num_read_kb":4815,"num_write":605,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510573,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52308,"kb_used_data":3080,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319532,"statfs":{"total":96636764160,"available":96583200768,"internally_reserved":0,"allocated":3153920,"data_stored":1894424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.40999999999999998},"max":{"1min":0.94599999999999995,"5min":0.95499999999999996,"15min":1.0169999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.441},"max":{"1min":0.90700000000000003,"5min":1.016,"15min":1.0189999999999999},"last":0.73599999999999999}]},{"osd":1,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93799999999999994,"5min":0.99199999999999999,"15min":1.054},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.749,"15min":0.77300000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.753},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77300000000000002,"15min":0.76800000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.53600000000000003},"max":{"1min":1.0129999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.81999999999999995}]},{"osd":3,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76700000000000002,"15min":0.77000000000000002},"min":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94499999999999995,"5min":1.006,"15min":1.006},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98299999999999998,"5min":1.0600000000000001,"15min":1.0680000000000001},"last":0.71799999999999997}]},{"osd":4,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0449999999999999,"5min":1.163,"15min":1.163},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.36599999999999999},"max":{"1min":0.97199999999999998,"5min":0.997,"15min":1.1120000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.501,"5min":0.44,"15min":0.42699999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.56999999999999995}]},{"osd":6,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.74399999999999999,"15min":0.73099999999999998},"min":{"1min":0.50900000000000001,"5min":0.499,"15min":0.47999999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.71499999999999997,"15min":0.69999999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0900000000000001,"5min":1.119,"15min":1.119},"last":0.51100000000000001}]}]},{"osd":6,"up_from":15,"seq":64424510573,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51740,"kb_used_data":2516,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320100,"statfs":{"total":96636764160,"available":96583782400,"internally_reserved":0,"allocated":2576384,"data_stored":1311100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.71599999999999997,"15min":0.74099999999999999},"min":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89900000000000002,"5min":0.99099999999999999,"15min":1.0449999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.505,"5min":0.40100000000000002,"15min":0.40000000000000002},"max":{"1min":0.92400000000000004,"5min":1.0389999999999999,"15min":1.1699999999999999},"last":0.68999999999999995}]},{"osd":1,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73799999999999999,"15min":0.76200000000000001},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89800000000000002,"5min":0.94999999999999996,"15min":1.1559999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72599999999999998,"15min":0.755},"min":{"1min":0.54400000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.91100000000000003,"5min":1.1180000000000001,"15min":1.1299999999999999},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75800000000000001,"15min":0.78600000000000003},"min":{"1min":0.54000000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.89300000000000002,"5min":1.0760000000000001,"15min":1.0780000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80300000000000005,"15min":0.82199999999999995},"min":{"1min":0.56000000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95799999999999996,"5min":1.0669999999999999,"15min":1.1599999999999999},"last":0.751}]},{"osd":3,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.75900000000000001,"15min":0.78300000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.87,"5min":1.002,"15min":1.208},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94399999999999995,"5min":1.054,"15min":1.236},"last":0.79500000000000004}]},{"osd":4,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.41899999999999998,"15min":0.33200000000000002},"max":{"1min":0.83099999999999996,"5min":0.93300000000000005,"15min":1.018},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.35499999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.016},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90600000000000003,"5min":0.98999999999999999,"15min":1.1319999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.73299999999999998},"min":{"1min":0.48599999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91900000000000004,"5min":1.071,"15min":1.1659999999999999},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64300000000000002,"15min":0.65800000000000003},"min":{"1min":0.46800000000000003,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":0.94199999999999995,"5min":0.97199999999999998,"15min":1.044},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68799999999999994,"15min":0.69499999999999995},"min":{"1min":0.501,"5min":0.47099999999999997,"15min":0.42899999999999999},"max":{"1min":0.96899999999999997,"5min":1.228,"15min":1.228},"last":0.88300000000000001}]}]},{"osd":5,"up_from":14,"seq":60129543276,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60076,"kb_used_data":2528,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311764,"statfs":{"total":96636764160,"available":96575246336,"internally_reserved":0,"allocated":2588672,"data_stored":1317182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91600000000000004,"5min":0.97799999999999998,"15min":1.034},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94699999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.85699999999999998}]},{"osd":1,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.73799999999999999,"15min":0.75800000000000001},"min":{"1min":0.48199999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.073},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.75600000000000001,"15min":0.77000000000000002},"min":{"1min":0.52800000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84799999999999998,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.97399999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72899999999999998,"15min":0.75},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.92100000000000004,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75600000000000001,"15min":0.76900000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93100000000000005,"5min":1.208,"15min":1.208},"last":0.63900000000000001}]},{"osd":3,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.76000000000000001,"15min":0.76500000000000001},"min":{"1min":0.56399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98299999999999998,"5min":1.155,"15min":1.155},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94199999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.60999999999999999},"min":{"1min":0.38500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.88900000000000001,"5min":1.681,"15min":1.681},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66000000000000003,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42499999999999999},"max":{"1min":1.0660000000000001,"5min":1.381,"15min":1.381},"last":0.95399999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68799999999999994,"15min":0.67300000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.42199999999999999},"max":{"1min":0.86099999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69499999999999995,"15min":0.68700000000000006},"min":{"1min":0.53100000000000003,"5min":0.49399999999999999,"15min":0.44900000000000001},"max":{"1min":1.0269999999999999,"5min":1.276,"15min":1.276},"last":0.92200000000000004}]},{"osd":7,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67900000000000005,"15min":0.66700000000000004},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.89800000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76400000000000001,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91300000000000003,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.046}]}]},{"osd":4,"up_from":14,"seq":60129543276,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47596,"kb_used_data":2528,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324244,"statfs":{"total":96636764160,"available":96588025856,"internally_reserved":0,"allocated":2588672,"data_stored":1317194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91500000000000004,"5min":0.97799999999999998,"15min":1.054},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.47299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92500000000000004,"5min":0.96499999999999997,"15min":1.02},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.73399999999999999,"15min":0.76400000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88200000000000001,"5min":1.05,"15min":1.05},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.103},"last":0.65300000000000002}]},{"osd":2,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.85999999999999999,"5min":0.995,"15min":1.0780000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.55100000000000005,"5min":0.501,"15min":0.47999999999999998},"max":{"1min":1.0389999999999999,"5min":1.069,"15min":1.069},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.56899999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92300000000000004,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75900000000000001,"15min":0.77700000000000002},"min":{"1min":0.52900000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96399999999999997,"5min":1.101,"15min":1.101},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.55500000000000005},"min":{"1min":0.40300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80100000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.60299999999999998},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83699999999999997,"5min":0.93700000000000006,"15min":0.98299999999999998},"last":0.83099999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75800000000000001,"15min":0.747},"min":{"1min":0.59899999999999998,"5min":0.49399999999999999,"15min":0.49199999999999999},"max":{"1min":0.93500000000000005,"5min":1.0029999999999999,"15min":1.1240000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.67000000000000004,"15min":0.65500000000000003},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93200000000000005,"5min":1.018,"15min":1.0629999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.628,"15min":0.623},"min":{"1min":0.42499999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.996,"15min":0.996},"last":0.754},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73499999999999999,"15min":0.71999999999999997},"min":{"1min":0.53700000000000003,"5min":0.496,"15min":0.47599999999999998},"max":{"1min":0.93000000000000005,"5min":1.018,"15min":1.0860000000000001},"last":0.79500000000000004}]}]},{"osd":3,"up_from":14,"seq":60129543276,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64540,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307300,"statfs":{"total":96636764160,"available":96570675200,"internally_reserved":0,"allocated":2899968,"data_stored":1632448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":63174923},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.32200000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.61099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.92900000000000005},"last":0.377}]},{"osd":1,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.33300000000000002},"max":{"1min":0.74399999999999999,"5min":0.80700000000000005,"15min":1.0780000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61099999999999999,"15min":0.627},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.76400000000000001,"5min":0.88900000000000001,"15min":0.97999999999999998},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96599999999999997,"5min":1.0089999999999999,"15min":1.038},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.95799999999999996},"last":0.49299999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78700000000000003,"15min":0.79800000000000004},"min":{"1min":0.56999999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.014,"5min":1.26,"15min":1.26},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83099999999999996,"15min":0.82999999999999996},"min":{"1min":0.54200000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.069,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.94099999999999995}]},{"osd":5,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80600000000000005},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99399999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.80700000000000005,"15min":0.82199999999999995},"min":{"1min":0.56599999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97899999999999998,"5min":1.0880000000000001,"15min":1.1419999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.85299999999999998,"15min":0.86199999999999999},"min":{"1min":0.63200000000000001,"5min":0.59499999999999997,"15min":0.59399999999999997},"max":{"1min":1.0169999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81399999999999995,"15min":0.83599999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.48999999999999999},"max":{"1min":0.98299999999999998,"5min":1.133,"15min":1.194},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.85999999999999999,"15min":0.878},"min":{"1min":0.68100000000000005,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.056,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.82399999999999995,"15min":0.83099999999999996},"min":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.51800000000000002},"max":{"1min":0.999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.69799999999999995}]}]},{"osd":2,"up_from":14,"seq":60129543277,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60376,"kb_used_data":2828,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311464,"statfs":{"total":96636764160,"available":96574939136,"internally_reserved":0,"allocated":2895872,"data_stored":1632419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.46000000000000002,"15min":0.47699999999999998},"min":{"1min":0.33400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.435},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.35499999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71699999999999997,"5min":0.85099999999999998,"15min":0.86099999999999999},"last":0.41499999999999998}]},{"osd":1,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66200000000000003,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83099999999999996,"5min":0.88800000000000001,"15min":0.89700000000000002},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.41099999999999998,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.78000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.63200000000000001,"5min":0.56399999999999995,"15min":0.48699999999999999},"max":{"1min":1.0720000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.625},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80400000000000005,"15min":0.81100000000000005},"min":{"1min":0.66200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.1619999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.745}]},{"osd":5,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.60899999999999999,"5min":0.53200000000000003,"15min":0.51700000000000002},"max":{"1min":1.0089999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.84699999999999998},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.246,"5min":1.266,"15min":1.266},"last":0.58299999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.103,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.875,"15min":0.88},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.58899999999999997},"max":{"1min":1.204,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.70099999999999996}]},{"osd":7,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.82599999999999996,"15min":0.83799999999999997},"min":{"1min":0.69299999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1040000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.82699999999999996,"15min":0.83199999999999996},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1870000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.76200000000000001}]}]},{"osd":1,"up_from":14,"seq":60129543277,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42320,"kb_used_data":2820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329520,"statfs":{"total":96636764160,"available":96593428480,"internally_reserved":0,"allocated":2887680,"data_stored":1631736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.47699999999999998},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.70299999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.34100000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.71099999999999997,"5min":0.73799999999999999,"15min":0.879},"last":0.44600000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.81399999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66600000000000004,"5min":0.82899999999999996,"15min":0.91400000000000003},"last":0.432}]},{"osd":3,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73199999999999998,"5min":0.998,"15min":0.998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.376,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73299999999999998,"5min":0.88700000000000001,"15min":0.98699999999999999},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91000000000000003,"5min":1.1559999999999999,"15min":1.2350000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82999999999999996,"15min":0.83699999999999997},"min":{"1min":0.69099999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98699999999999999,"5min":1.268,"15min":1.268},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.80900000000000005},"min":{"1min":0.624,"5min":0.54800000000000004,"15min":0.47699999999999998},"max":{"1min":0.89800000000000002,"5min":1.109,"15min":1.1950000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.66200000000000003,"5min":0.61899999999999999,"15min":0.55300000000000005},"max":{"1min":0.97899999999999998,"5min":1.214,"15min":1.214},"last":0.70099999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.66100000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.94499999999999995,"5min":1.212,"15min":1.244},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.81899999999999995,"15min":0.83699999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.94699999999999995,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81200000000000006,"15min":0.83699999999999997},"min":{"1min":0.61699999999999999,"5min":0.60899999999999999,"15min":0.55600000000000005},"max":{"1min":1.0069999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.626},"max":{"1min":0.96799999999999997,"5min":1.127,"15min":1.2110000000000001},"last":0.63200000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543276,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60644,"kb_used_data":3096,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311196,"statfs":{"total":96636764160,"available":96574664704,"internally_reserved":0,"allocated":3170304,"data_stored":1895152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48999999999999999,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.308,"15min":0.30599999999999999},"max":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":1.2170000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.81599999999999995,"15min":0.85999999999999999},"last":0.378}]},{"osd":2,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36399999999999999,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":0.81399999999999995,"15min":0.91000000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55000000000000004,"15min":0.56100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71499999999999997,"5min":0.755,"15min":0.86799999999999999},"last":0.44}]},{"osd":3,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.754,"15min":1.855},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.75900000000000001,"5min":0.90000000000000002,"15min":1.3480000000000001},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.57599999999999996,"5min":0.495,"15min":0.495},"max":{"1min":1.0600000000000001,"5min":1.258,"15min":1.3799999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81699999999999995,"15min":0.83199999999999996},"min":{"1min":0.627,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0529999999999999,"5min":1.2809999999999999,"15min":1.2849999999999999},"last":0.85499999999999998}]},{"osd":5,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.58999999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.004,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82499999999999996,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0620000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.89000000000000001}]},{"osd":6,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82199999999999995,"15min":0.83599999999999997},"min":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0429999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.875},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86499999999999999,"15min":0.85999999999999999},"min":{"1min":0.51600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.0880000000000001,"5min":1.3560000000000001,"15min":1.5129999999999999},"last":0.97799999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85799999999999998,"15min":0.876},"min":{"1min":0.64600000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0760000000000001,"5min":1.4339999999999999,"15min":1.5720000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58099999999999996},"max":{"1min":1.0620000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.89900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:37:58.133 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-25T05:37:58.134 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:37:58.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.274+0000 7fa1762e5640 1 Processor -- start 2023-08-25T05:37:58.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.274+0000 7fa1762e5640 1 -- start start 2023-08-25T05:37:58.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.274+0000 7fa1762e5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700d0da0 0x7fa1700d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:58.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.274+0000 7fa1762e5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa1700b3e50 0x7fa1700ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:58.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.274+0000 7fa1762e5640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1700b29b0 con 0x7fa1700cdde0 2023-08-25T05:37:58.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.274+0000 7fa1762e5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1700ce760 con 0x7fa1700b3e50 2023-08-25T05:37:58.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.274+0000 7fa1762e5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1700d16c0 con 0x7fa1700d0da0 2023-08-25T05:37:58.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.274+0000 7fa16f7fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa1700cdde0 0x7fa1700cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34554/0 (socket says 172.21.15.55:34554) 2023-08-25T05:37:58.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.274+0000 7fa16f7fe640 1 -- 172.21.15.55:0/1773053087 learned_addr learned my addr 172.21.15.55:0/1773053087 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:58.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.274+0000 7fa174882640 1 --2- 172.21.15.55:0/1773053087 >> v2:172.21.15.110:3300/0 conn(0x7fa1700b3e50 0x7fa1700ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:58.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.274+0000 7fa16ffff640 1 --2- 172.21.15.55:0/1773053087 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700d0da0 0x7fa1700d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:58.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.274+0000 7fa16effd640 1 -- 172.21.15.55:0/1773053087 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439877579 0 0) 0x7fa1700b29b0 con 0x7fa1700cdde0 2023-08-25T05:37:58.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.274+0000 7fa16effd640 1 -- 172.21.15.55:0/1773053087 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa158003530 con 0x7fa1700cdde0 2023-08-25T05:37:58.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.274+0000 7fa16ffff640 1 -- 172.21.15.55:0/1773053087 >> v2:172.21.15.110:3300/0 conn(0x7fa1700b3e50 msgr2=0x7fa1700ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:58.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.274+0000 7fa16ffff640 1 --2- 172.21.15.55:0/1773053087 >> v2:172.21.15.110:3300/0 conn(0x7fa1700b3e50 0x7fa1700ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.274+0000 7fa16ffff640 1 -- 172.21.15.55:0/1773053087 >> v1:172.21.15.55:6789/0 conn(0x7fa1700cdde0 legacy=0x7fa1700cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:58.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.274+0000 7fa16ffff640 1 -- 172.21.15.55:0/1773053087 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1700b1dc0 con 0x7fa1700d0da0 2023-08-25T05:37:58.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.278+0000 7fa16ffff640 1 --2- 172.21.15.55:0/1773053087 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700d0da0 0x7fa1700d1180 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa1600097a0 tx=0x7fa16001ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6dddda1a48fe71 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:58.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.278+0000 7fa16effd640 1 -- 172.21.15.55:0/1773053087 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1600a8950 con 0x7fa1700d0da0 2023-08-25T05:37:58.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.278+0000 7fa16effd640 1 -- 172.21.15.55:0/1773053087 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1600a8ab0 con 0x7fa1700d0da0 2023-08-25T05:37:58.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.278+0000 7fa16effd640 1 -- 172.21.15.55:0/1773053087 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1600a8e40 con 0x7fa1700d0da0 2023-08-25T05:37:58.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.278+0000 7fa1762e5640 1 -- 172.21.15.55:0/1773053087 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700d0da0 msgr2=0x7fa1700d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:58.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.278+0000 7fa1762e5640 1 --2- 172.21.15.55:0/1773053087 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700d0da0 0x7fa1700d1180 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa1600097a0 tx=0x7fa16001ec50 comp rx=0 tx=0).stop 2023-08-25T05:37:58.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.278+0000 7fa1762e5640 1 -- 172.21.15.55:0/1773053087 shutdown_connections 2023-08-25T05:37:58.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.278+0000 7fa1762e5640 1 --2- 172.21.15.55:0/1773053087 >> v2:172.21.15.110:3300/0 conn(0x7fa1700b3e50 0x7fa1700ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.278+0000 7fa1762e5640 1 --2- 172.21.15.55:0/1773053087 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700d0da0 0x7fa1700d1180 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.278+0000 7fa1762e5640 1 -- 172.21.15.55:0/1773053087 >> 172.21.15.55:0/1773053087 conn(0x7fa17009bae0 msgr2=0x7fa1700d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:58.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.278+0000 7fa1762e5640 1 -- 172.21.15.55:0/1773053087 shutdown_connections 2023-08-25T05:37:58.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.278+0000 7fa1762e5640 1 -- 172.21.15.55:0/1773053087 wait complete. 2023-08-25T05:37:58.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa1762e5640 1 Processor -- start 2023-08-25T05:37:58.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa1762e5640 1 -- start start 2023-08-25T05:37:58.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa1762e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700b3e50 0x7fa1700cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:58.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa1762e5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700cdde0 0x7fa17015dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:58.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa1762e5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700d0da0 0x7fa17015e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:58.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa1762e5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17015f890 con 0x7fa1700b3e50 2023-08-25T05:37:58.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa1762e5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17015ead0 con 0x7fa1700d0da0 2023-08-25T05:37:58.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa1762e5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17015edb0 con 0x7fa1700cdde0 2023-08-25T05:37:58.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa16ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700b3e50 0x7fa1700cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:58.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa16ffff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700b3e50 0x7fa1700cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53236/0 (socket says 172.21.15.55:53236) 2023-08-25T05:37:58.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa16ffff640 1 -- 172.21.15.55:0/3475565180 learned_addr learned my addr 172.21.15.55:0/3475565180 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:58.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa16f7fe640 1 --2- 172.21.15.55:0/3475565180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700cdde0 0x7fa17015dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:58.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa174882640 1 --2- 172.21.15.55:0/3475565180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700d0da0 0x7fa17015e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:58.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa16ffff640 1 -- 172.21.15.55:0/3475565180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700cdde0 msgr2=0x7fa17015dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:58.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa16ffff640 1 --2- 172.21.15.55:0/3475565180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700cdde0 0x7fa17015dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa16ffff640 1 -- 172.21.15.55:0/3475565180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700d0da0 msgr2=0x7fa17015e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:58.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa16ffff640 1 --2- 172.21.15.55:0/3475565180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700d0da0 0x7fa17015e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa16ffff640 1 -- 172.21.15.55:0/3475565180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1600093b0 con 0x7fa1700b3e50 2023-08-25T05:37:58.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa16f7fe640 1 --2- 172.21.15.55:0/3475565180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700cdde0 0x7fa17015dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:58.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa16ffff640 1 --2- 172.21.15.55:0/3475565180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700b3e50 0x7fa1700cbf20 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7fa1600b3040 tx=0x7fa16001b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:58.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa16cff9640 1 -- 172.21.15.55:0/3475565180 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1600bd070 con 0x7fa1700b3e50 2023-08-25T05:37:58.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa16cff9640 1 -- 172.21.15.55:0/3475565180 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1600b0b20 con 0x7fa1700b3e50 2023-08-25T05:37:58.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa16cff9640 1 -- 172.21.15.55:0/3475565180 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1600b9430 con 0x7fa1700b3e50 2023-08-25T05:37:58.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa1762e5640 1 -- 172.21.15.55:0/3475565180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17015f090 con 0x7fa1700b3e50 2023-08-25T05:37:58.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.282+0000 7fa1762e5640 1 -- 172.21.15.55:0/3475565180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1700cc460 con 0x7fa1700b3e50 2023-08-25T05:37:58.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.286+0000 7fa1762e5640 1 -- 172.21.15.55:0/3475565180 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17004dbe0 con 0x7fa1700b3e50 2023-08-25T05:37:58.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.286+0000 7fa16cff9640 1 -- 172.21.15.55:0/3475565180 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fa1600b7040 con 0x7fa1700b3e50 2023-08-25T05:37:58.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.286+0000 7fa16cff9640 1 --2- 172.21.15.55:0/3475565180 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fa15c0657a0 0x7fa15c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:58.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.286+0000 7fa16cff9640 1 -- 172.21.15.55:0/3475565180 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fa16011ff30 con 0x7fa1700b3e50 2023-08-25T05:37:58.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.286+0000 7fa16f7fe640 1 --2- 172.21.15.55:0/3475565180 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fa15c0657a0 0x7fa15c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:58.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.286+0000 7fa16f7fe640 1 --2- 172.21.15.55:0/3475565180 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fa15c0657a0 0x7fa15c067c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa170155d60 tx=0x7fa164009040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:58.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.290+0000 7fa16cff9640 1 -- 172.21.15.55:0/3475565180 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fa1600ed8b0 con 0x7fa1700b3e50 2023-08-25T05:37:58.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.446+0000 7fa1762e5640 1 -- 172.21.15.55:0/3475565180 --> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1700b2360 con 0x7fa15c0657a0 2023-08-25T05:37:58.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.446+0000 7fa16cff9640 1 -- 172.21.15.55:0/3475565180 <== mgr.9404 v2:172.21.15.110:6832/1527806048 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72927 (secure 0 0 0) 0x7fa164001480 con 0x7fa15c0657a0 2023-08-25T05:37:58.451 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:58.452 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:37:58.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.450+0000 7fa1762e5640 1 -- 172.21.15.55:0/3475565180 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fa15c0657a0 msgr2=0x7fa15c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:58.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.450+0000 7fa1762e5640 1 --2- 172.21.15.55:0/3475565180 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fa15c0657a0 0x7fa15c067c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa170155d60 tx=0x7fa164009040 comp rx=0 tx=0).stop 2023-08-25T05:37:58.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.450+0000 7fa1762e5640 1 -- 172.21.15.55:0/3475565180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700b3e50 msgr2=0x7fa1700cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:58.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.450+0000 7fa1762e5640 1 --2- 172.21.15.55:0/3475565180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700b3e50 0x7fa1700cbf20 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7fa1600b3040 tx=0x7fa16001b9f0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.450+0000 7fa1762e5640 1 -- 172.21.15.55:0/3475565180 shutdown_connections 2023-08-25T05:37:58.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.450+0000 7fa1762e5640 1 --2- 172.21.15.55:0/3475565180 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fa15c0657a0 0x7fa15c067c60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.450+0000 7fa1762e5640 1 --2- 172.21.15.55:0/3475565180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1700d0da0 0x7fa17015e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.450+0000 7fa1762e5640 1 --2- 172.21.15.55:0/3475565180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1700cdde0 0x7fa17015dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.450+0000 7fa1762e5640 1 --2- 172.21.15.55:0/3475565180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1700b3e50 0x7fa1700cbf20 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.450+0000 7fa1762e5640 1 -- 172.21.15.55:0/3475565180 >> 172.21.15.55:0/3475565180 conn(0x7fa17009bae0 msgr2=0x7fa1700cd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:58.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.450+0000 7fa1762e5640 1 -- 172.21.15.55:0/3475565180 shutdown_connections 2023-08-25T05:37:58.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.450+0000 7fa1762e5640 1 -- 172.21.15.55:0/3475565180 wait complete. 2023-08-25T05:37:58.472 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-08-25T05:37:58.121359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2288,"num_read_kb":4815,"num_write":605,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":439600,"kb_used_data":22228,"kb_used_omap":13,"kb_used_meta":417266,"kb_avail":754535120,"statfs":{"total":773094113280,"available":772643962880,"internally_reserved":0,"allocated":22761472,"data_stored":12631655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":427280472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-669915,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-221,"num_read_kb":-75,"num_write":-264,"num_write_kb":-2057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.857538"},"pg_stats":[{"pgid":"1.0","version":"204'3675","reported_seq":4731,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-25T05:37:51.648847+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:37:51.648847+0000","last_peered":"2023-08-25T05:37:51.648847+0000","last_clean":"2023-08-25T05:37:51.648847+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:37:51.648847+0000","last_undegraded":"2023-08-25T05:37:51.648847+0000","last_fullsized":"2023-08-25T05:37:51.648847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3675,"log_dups_size":0,"ondisk_log_size":3675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:29:52.265239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2288,"num_read_kb":4815,"num_write":605,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":368,"reported_epoch":206,"state":"active+clean","last_fresh":"2023-08-25T05:37:53.364813+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:37:53.364813+0000","last_peered":"2023-08-25T05:37:53.364813+0000","last_clean":"2023-08-25T05:37:53.364813+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:37:53.364813+0000","last_undegraded":"2023-08-25T05:37:53.364813+0000","last_fullsized":"2023-08-25T05:37:53.364813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:07:57.924216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":358,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-25T05:37:51.649206+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:37:51.649206+0000","last_peered":"2023-08-25T05:37:51.649206+0000","last_clean":"2023-08-25T05:37:51.649206+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:37:51.649206+0000","last_undegraded":"2023-08-25T05:37:51.649206+0000","last_fullsized":"2023-08-25T05:37:51.649206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:37:19.507667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":366,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-25T05:37:51.648868+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:37:51.648868+0000","last_peered":"2023-08-25T05:37:51.648868+0000","last_clean":"2023-08-25T05:37:51.648868+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:37:51.648868+0000","last_undegraded":"2023-08-25T05:37:51.648868+0000","last_fullsized":"2023-08-25T05:37:51.648868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:02:41.995857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":368,"reported_epoch":206,"state":"active+clean","last_fresh":"2023-08-25T05:37:53.364610+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:37:53.364610+0000","last_peered":"2023-08-25T05:37:53.364610+0000","last_clean":"2023-08-25T05:37:53.364610+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:37:53.364610+0000","last_undegraded":"2023-08-25T05:37:53.364610+0000","last_fullsized":"2023-08-25T05:37:53.364610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:59:35.310033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":398,"reported_epoch":206,"state":"active+clean","last_fresh":"2023-08-25T05:37:53.337953+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:37:53.337953+0000","last_peered":"2023-08-25T05:37:53.337953+0000","last_clean":"2023-08-25T05:37:53.337953+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:37:53.337953+0000","last_undegraded":"2023-08-25T05:37:53.337953+0000","last_fullsized":"2023-08-25T05:37:53.337953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T09:49:54.028883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":356,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-08-25T05:37:51.649013+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:37:51.649013+0000","last_peered":"2023-08-25T05:37:51.649013+0000","last_clean":"2023-08-25T05:37:51.649013+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:37:51.649013+0000","last_undegraded":"2023-08-25T05:37:51.649013+0000","last_fullsized":"2023-08-25T05:37:51.649013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T04:08:06.397903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":396,"reported_epoch":206,"state":"active+clean","last_fresh":"2023-08-25T05:37:53.338748+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:37:53.338748+0000","last_peered":"2023-08-25T05:37:53.338748+0000","last_clean":"2023-08-25T05:37:53.338748+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:37:53.338748+0000","last_undegraded":"2023-08-25T05:37:53.338748+0000","last_fullsized":"2023-08-25T05:37:53.338748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T14:23:11.341721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":420,"reported_epoch":206,"state":"active+clean","last_fresh":"2023-08-25T05:37:53.336876+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:37:53.336876+0000","last_peered":"2023-08-25T05:37:53.336876+0000","last_clean":"2023-08-25T05:37:53.336876+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:37:53.336876+0000","last_undegraded":"2023-08-25T05:37:53.336876+0000","last_fullsized":"2023-08-25T05:37:53.336876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:02:54.620535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2288,"num_read_kb":4815,"num_write":605,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510573,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52308,"kb_used_data":3080,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319532,"statfs":{"total":96636764160,"available":96583200768,"internally_reserved":0,"allocated":3153920,"data_stored":1894424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.40999999999999998},"max":{"1min":0.94599999999999995,"5min":0.95499999999999996,"15min":1.0169999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.441},"max":{"1min":0.90700000000000003,"5min":1.016,"15min":1.0189999999999999},"last":0.73599999999999999}]},{"osd":1,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93799999999999994,"5min":0.99199999999999999,"15min":1.054},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.749,"15min":0.77300000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.753},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77300000000000002,"15min":0.76800000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.53600000000000003},"max":{"1min":1.0129999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.81999999999999995}]},{"osd":3,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76700000000000002,"15min":0.77000000000000002},"min":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94499999999999995,"5min":1.006,"15min":1.006},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98299999999999998,"5min":1.0600000000000001,"15min":1.0680000000000001},"last":0.71799999999999997}]},{"osd":4,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0449999999999999,"5min":1.163,"15min":1.163},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.36599999999999999},"max":{"1min":0.97199999999999998,"5min":0.997,"15min":1.1120000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.501,"5min":0.44,"15min":0.42699999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.56999999999999995}]},{"osd":6,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.74399999999999999,"15min":0.73099999999999998},"min":{"1min":0.50900000000000001,"5min":0.499,"15min":0.47999999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.71499999999999997,"15min":0.69999999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0900000000000001,"5min":1.119,"15min":1.119},"last":0.51100000000000001}]}]},{"osd":6,"up_from":15,"seq":64424510573,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51740,"kb_used_data":2516,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320100,"statfs":{"total":96636764160,"available":96583782400,"internally_reserved":0,"allocated":2576384,"data_stored":1311100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.71599999999999997,"15min":0.74099999999999999},"min":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89900000000000002,"5min":0.99099999999999999,"15min":1.0449999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.505,"5min":0.40100000000000002,"15min":0.40000000000000002},"max":{"1min":0.92400000000000004,"5min":1.0389999999999999,"15min":1.1699999999999999},"last":0.68999999999999995}]},{"osd":1,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73799999999999999,"15min":0.76200000000000001},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89800000000000002,"5min":0.94999999999999996,"15min":1.1559999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72599999999999998,"15min":0.755},"min":{"1min":0.54400000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.91100000000000003,"5min":1.1180000000000001,"15min":1.1299999999999999},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75800000000000001,"15min":0.78600000000000003},"min":{"1min":0.54000000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.89300000000000002,"5min":1.0760000000000001,"15min":1.0780000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80300000000000005,"15min":0.82199999999999995},"min":{"1min":0.56000000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95799999999999996,"5min":1.0669999999999999,"15min":1.1599999999999999},"last":0.751}]},{"osd":3,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.75900000000000001,"15min":0.78300000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.87,"5min":1.002,"15min":1.208},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94399999999999995,"5min":1.054,"15min":1.236},"last":0.79500000000000004}]},{"osd":4,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.41899999999999998,"15min":0.33200000000000002},"max":{"1min":0.83099999999999996,"5min":0.93300000000000005,"15min":1.018},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.35499999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.016},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90600000000000003,"5min":0.98999999999999999,"15min":1.1319999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.73299999999999998},"min":{"1min":0.48599999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91900000000000004,"5min":1.071,"15min":1.1659999999999999},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64300000000000002,"15min":0.65800000000000003},"min":{"1min":0.46800000000000003,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":0.94199999999999995,"5min":0.97199999999999998,"15min":1.044},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68799999999999994,"15min":0.69499999999999995},"min":{"1min":0.501,"5min":0.47099999999999997,"15min":0.42899999999999999},"max":{"1min":0.96899999999999997,"5min":1.228,"15min":1.228},"last":0.88300000000000001}]}]},{"osd":5,"up_from":14,"seq":60129543276,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60076,"kb_used_data":2528,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311764,"statfs":{"total":96636764160,"available":96575246336,"internally_reserved":0,"allocated":2588672,"data_stored":1317182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91600000000000004,"5min":0.97799999999999998,"15min":1.034},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94699999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.85699999999999998}]},{"osd":1,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.73799999999999999,"15min":0.75800000000000001},"min":{"1min":0.48199999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.073},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.75600000000000001,"15min":0.77000000000000002},"min":{"1min":0.52800000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84799999999999998,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.97399999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72899999999999998,"15min":0.75},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.92100000000000004,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75600000000000001,"15min":0.76900000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93100000000000005,"5min":1.208,"15min":1.208},"last":0.63900000000000001}]},{"osd":3,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.76000000000000001,"15min":0.76500000000000001},"min":{"1min":0.56399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98299999999999998,"5min":1.155,"15min":1.155},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94199999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.60999999999999999},"min":{"1min":0.38500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.88900000000000001,"5min":1.681,"15min":1.681},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66000000000000003,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42499999999999999},"max":{"1min":1.0660000000000001,"5min":1.381,"15min":1.381},"last":0.95399999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68799999999999994,"15min":0.67300000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.42199999999999999},"max":{"1min":0.86099999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69499999999999995,"15min":0.68700000000000006},"min":{"1min":0.53100000000000003,"5min":0.49399999999999999,"15min":0.44900000000000001},"max":{"1min":1.0269999999999999,"5min":1.276,"15min":1.276},"last":0.92200000000000004}]},{"osd":7,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67900000000000005,"15min":0.66700000000000004},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.89800000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76400000000000001,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91300000000000003,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.046}]}]},{"osd":4,"up_from":14,"seq":60129543276,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47596,"kb_used_data":2528,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324244,"statfs":{"total":96636764160,"available":96588025856,"internally_reserved":0,"allocated":2588672,"data_stored":1317194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91500000000000004,"5min":0.97799999999999998,"15min":1.054},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.47299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92500000000000004,"5min":0.96499999999999997,"15min":1.02},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.73399999999999999,"15min":0.76400000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88200000000000001,"5min":1.05,"15min":1.05},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.103},"last":0.65300000000000002}]},{"osd":2,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.85999999999999999,"5min":0.995,"15min":1.0780000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.55100000000000005,"5min":0.501,"15min":0.47999999999999998},"max":{"1min":1.0389999999999999,"5min":1.069,"15min":1.069},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.56899999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92300000000000004,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75900000000000001,"15min":0.77700000000000002},"min":{"1min":0.52900000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96399999999999997,"5min":1.101,"15min":1.101},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.55500000000000005},"min":{"1min":0.40300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80100000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.60299999999999998},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83699999999999997,"5min":0.93700000000000006,"15min":0.98299999999999998},"last":0.83099999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75800000000000001,"15min":0.747},"min":{"1min":0.59899999999999998,"5min":0.49399999999999999,"15min":0.49199999999999999},"max":{"1min":0.93500000000000005,"5min":1.0029999999999999,"15min":1.1240000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.67000000000000004,"15min":0.65500000000000003},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93200000000000005,"5min":1.018,"15min":1.0629999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.628,"15min":0.623},"min":{"1min":0.42499999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.996,"15min":0.996},"last":0.754},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73499999999999999,"15min":0.71999999999999997},"min":{"1min":0.53700000000000003,"5min":0.496,"15min":0.47599999999999998},"max":{"1min":0.93000000000000005,"5min":1.018,"15min":1.0860000000000001},"last":0.79500000000000004}]}]},{"osd":3,"up_from":14,"seq":60129543276,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64540,"kb_used_data":2832,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307300,"statfs":{"total":96636764160,"available":96570675200,"internally_reserved":0,"allocated":2899968,"data_stored":1632448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":63174923},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.32200000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.61099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.92900000000000005},"last":0.377}]},{"osd":1,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.33300000000000002},"max":{"1min":0.74399999999999999,"5min":0.80700000000000005,"15min":1.0780000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61099999999999999,"15min":0.627},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.76400000000000001,"5min":0.88900000000000001,"15min":0.97999999999999998},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96599999999999997,"5min":1.0089999999999999,"15min":1.038},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.95799999999999996},"last":0.49299999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78700000000000003,"15min":0.79800000000000004},"min":{"1min":0.56999999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.014,"5min":1.26,"15min":1.26},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83099999999999996,"15min":0.82999999999999996},"min":{"1min":0.54200000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.069,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.94099999999999995}]},{"osd":5,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80600000000000005},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99399999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.80700000000000005,"15min":0.82199999999999995},"min":{"1min":0.56599999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97899999999999998,"5min":1.0880000000000001,"15min":1.1419999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.85299999999999998,"15min":0.86199999999999999},"min":{"1min":0.63200000000000001,"5min":0.59499999999999997,"15min":0.59399999999999997},"max":{"1min":1.0169999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81399999999999995,"15min":0.83599999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.48999999999999999},"max":{"1min":0.98299999999999998,"5min":1.133,"15min":1.194},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.85999999999999999,"15min":0.878},"min":{"1min":0.68100000000000005,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.056,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.82399999999999995,"15min":0.83099999999999996},"min":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.51800000000000002},"max":{"1min":0.999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.69799999999999995}]}]},{"osd":2,"up_from":14,"seq":60129543277,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60376,"kb_used_data":2828,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311464,"statfs":{"total":96636764160,"available":96574939136,"internally_reserved":0,"allocated":2895872,"data_stored":1632419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.46000000000000002,"15min":0.47699999999999998},"min":{"1min":0.33400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.435},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.35499999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71699999999999997,"5min":0.85099999999999998,"15min":0.86099999999999999},"last":0.41499999999999998}]},{"osd":1,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66200000000000003,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83099999999999996,"5min":0.88800000000000001,"15min":0.89700000000000002},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.41099999999999998,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.78000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.63200000000000001,"5min":0.56399999999999995,"15min":0.48699999999999999},"max":{"1min":1.0720000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.625},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80400000000000005,"15min":0.81100000000000005},"min":{"1min":0.66200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.1619999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.745}]},{"osd":5,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.60899999999999999,"5min":0.53200000000000003,"15min":0.51700000000000002},"max":{"1min":1.0089999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.84699999999999998},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.246,"5min":1.266,"15min":1.266},"last":0.58299999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.103,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.875,"15min":0.88},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.58899999999999997},"max":{"1min":1.204,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.70099999999999996}]},{"osd":7,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.82599999999999996,"15min":0.83799999999999997},"min":{"1min":0.69299999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1040000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.82699999999999996,"15min":0.83199999999999996},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1870000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.76200000000000001}]}]},{"osd":1,"up_from":14,"seq":60129543277,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42320,"kb_used_data":2820,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329520,"statfs":{"total":96636764160,"available":96593428480,"internally_reserved":0,"allocated":2887680,"data_stored":1631736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.47699999999999998},"min":{"1min":0.30299999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.70299999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.34100000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.71099999999999997,"5min":0.73799999999999999,"15min":0.879},"last":0.44600000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.81399999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66600000000000004,"5min":0.82899999999999996,"15min":0.91400000000000003},"last":0.432}]},{"osd":3,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.73199999999999998,"5min":0.998,"15min":0.998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57499999999999996,"15min":0.58899999999999997},"min":{"1min":0.376,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73299999999999998,"5min":0.88700000000000001,"15min":0.98699999999999999},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78300000000000003,"15min":0.79600000000000004},"min":{"1min":0.58799999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91000000000000003,"5min":1.1559999999999999,"15min":1.2350000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82999999999999996,"15min":0.83699999999999997},"min":{"1min":0.69099999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.98699999999999999,"5min":1.268,"15min":1.268},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78400000000000003,"15min":0.80900000000000005},"min":{"1min":0.624,"5min":0.54800000000000004,"15min":0.47699999999999998},"max":{"1min":0.89800000000000002,"5min":1.109,"15min":1.1950000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.66200000000000003,"5min":0.61899999999999999,"15min":0.55300000000000005},"max":{"1min":0.97899999999999998,"5min":1.214,"15min":1.214},"last":0.70099999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.85499999999999998,"15min":0.871},"min":{"1min":0.66100000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":0.94499999999999995,"5min":1.212,"15min":1.244},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.81899999999999995,"15min":0.83699999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.94699999999999995,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:36:54 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81200000000000006,"15min":0.83699999999999997},"min":{"1min":0.61699999999999999,"5min":0.60899999999999999,"15min":0.55600000000000005},"max":{"1min":1.0069999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86699999999999999,"15min":0.88700000000000001},"min":{"1min":0.69099999999999995,"5min":0.64000000000000001,"15min":0.626},"max":{"1min":0.96799999999999997,"5min":1.127,"15min":1.2110000000000001},"last":0.63200000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543276,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60644,"kb_used_data":3096,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311196,"statfs":{"total":96636764160,"available":96574664704,"internally_reserved":0,"allocated":3170304,"data_stored":1895152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48999999999999999,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.308,"15min":0.30599999999999999},"max":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":1.2170000000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.81599999999999995,"15min":0.85999999999999999},"last":0.378}]},{"osd":2,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36399999999999999,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":0.81399999999999995,"15min":0.91000000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55000000000000004,"15min":0.56100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71499999999999997,"5min":0.755,"15min":0.86799999999999999},"last":0.44}]},{"osd":3,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.754,"15min":1.855},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.75900000000000001,"5min":0.90000000000000002,"15min":1.3480000000000001},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.57599999999999996,"5min":0.495,"15min":0.495},"max":{"1min":1.0600000000000001,"5min":1.258,"15min":1.3799999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81699999999999995,"15min":0.83199999999999996},"min":{"1min":0.627,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0529999999999999,"5min":1.2809999999999999,"15min":1.2849999999999999},"last":0.85499999999999998}]},{"osd":5,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.58999999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.004,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82499999999999996,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0620000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.89000000000000001}]},{"osd":6,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82199999999999995,"15min":0.83599999999999997},"min":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0429999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.875},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86499999999999999,"15min":0.85999999999999999},"min":{"1min":0.51600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.0880000000000001,"5min":1.3560000000000001,"15min":1.5129999999999999},"last":0.97799999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85799999999999998,"15min":0.876},"min":{"1min":0.64600000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0760000000000001,"5min":1.4339999999999999,"15min":1.5720000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58099999999999996},"max":{"1min":1.0620000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.89900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:37:58.475 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-25T05:37:58.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.614+0000 7fb76a559640 1 Processor -- start 2023-08-25T05:37:58.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.614+0000 7fb76a559640 1 -- start start 2023-08-25T05:37:58.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.614+0000 7fb76a559640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7640ca110 0x7fb7640b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:58.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.614+0000 7fb76a559640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7640cdbf0 con 0x7fb7640cb2a0 2023-08-25T05:37:58.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.614+0000 7fb76a559640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7640ca540 con 0x7fb764158e10 2023-08-25T05:37:58.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.614+0000 7fb76a559640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640ad940 con 0x7fb7640ca110 2023-08-25T05:37:58.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.614+0000 7fb7637fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb7640cb2a0 0x7fb7640c9a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34570/0 (socket says 172.21.15.55:34570) 2023-08-25T05:37:58.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.614+0000 7fb7637fe640 1 -- 172.21.15.55:0/57674900 learned_addr learned my addr 172.21.15.55:0/57674900 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:37:58.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.618+0000 7fb768af6640 1 --2- 172.21.15.55:0/57674900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7640ca110 0x7fb7640b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:58.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.618+0000 7fb762ffd640 1 -- 172.21.15.55:0/57674900 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97967565 0 0) 0x7fb7640cdbf0 con 0x7fb7640cb2a0 2023-08-25T05:37:58.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.618+0000 7fb762ffd640 1 -- 172.21.15.55:0/57674900 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb74c004640 con 0x7fb7640cb2a0 2023-08-25T05:37:58.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.618+0000 7fb762ffd640 1 -- 172.21.15.55:0/57674900 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296729665 0 0) 0x7fb7640ca540 con 0x7fb764158e10 2023-08-25T05:37:58.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.618+0000 7fb762ffd640 1 -- 172.21.15.55:0/57674900 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7640cdbf0 con 0x7fb764158e10 2023-08-25T05:37:58.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.618+0000 7fb768af6640 1 -- 172.21.15.55:0/57674900 >> v1:172.21.15.110:6789/0 conn(0x7fb764158e10 legacy=0x7fb7640cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:58.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.618+0000 7fb768af6640 1 -- 172.21.15.55:0/57674900 >> v1:172.21.15.55:6789/0 conn(0x7fb7640cb2a0 legacy=0x7fb7640c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:58.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.618+0000 7fb768af6640 1 -- 172.21.15.55:0/57674900 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76406d380 con 0x7fb7640ca110 2023-08-25T05:37:58.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.618+0000 7fb768af6640 1 --2- 172.21.15.55:0/57674900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7640ca110 0x7fb7640b2d30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009dc0 tx=0x7fb75c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb0fda878f6c44eb server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:58.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.618+0000 7fb762ffd640 1 -- 172.21.15.55:0/57674900 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0a59b0 con 0x7fb7640ca110 2023-08-25T05:37:58.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.618+0000 7fb762ffd640 1 -- 172.21.15.55:0/57674900 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c0a5b10 con 0x7fb7640ca110 2023-08-25T05:37:58.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.618+0000 7fb762ffd640 1 -- 172.21.15.55:0/57674900 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0a5ea0 con 0x7fb7640ca110 2023-08-25T05:37:58.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.622+0000 7fb76a559640 1 -- 172.21.15.55:0/57674900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7640ca110 msgr2=0x7fb7640b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:58.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.622+0000 7fb76a559640 1 --2- 172.21.15.55:0/57674900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7640ca110 0x7fb7640b2d30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009dc0 tx=0x7fb75c01c970 comp rx=0 tx=0).stop 2023-08-25T05:37:58.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.622+0000 7fb76a559640 1 -- 172.21.15.55:0/57674900 shutdown_connections 2023-08-25T05:37:58.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.622+0000 7fb76a559640 1 --2- 172.21.15.55:0/57674900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7640ca110 0x7fb7640b2d30 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.622+0000 7fb76a559640 1 -- 172.21.15.55:0/57674900 >> 172.21.15.55:0/57674900 conn(0x7fb764069d00 msgr2=0x7fb76406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:58.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.622+0000 7fb76a559640 1 -- 172.21.15.55:0/57674900 shutdown_connections 2023-08-25T05:37:58.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.622+0000 7fb76a559640 1 -- 172.21.15.55:0/57674900 wait complete. 2023-08-25T05:37:58.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.622+0000 7fb76a559640 1 Processor -- start 2023-08-25T05:37:58.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.622+0000 7fb76a559640 1 -- start start 2023-08-25T05:37:58.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.622+0000 7fb76a559640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7640ca110 0x7fb7640aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:58.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.622+0000 7fb76a559640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7640cb2a0 0x7fb764161f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:58.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.622+0000 7fb76a559640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb764158e10 0x7fb7640c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:58.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.622+0000 7fb76a559640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640c6c50 con 0x7fb7640cb2a0 2023-08-25T05:37:58.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.622+0000 7fb76a559640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640af160 con 0x7fb764158e10 2023-08-25T05:37:58.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.622+0000 7fb76a559640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb764162a00 con 0x7fb7640ca110 2023-08-25T05:37:58.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.622+0000 7fb7637fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7640cb2a0 0x7fb764161f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:58.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.622+0000 7fb7637fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7640cb2a0 0x7fb764161f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53248/0 (socket says 172.21.15.55:53248) 2023-08-25T05:37:58.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.622+0000 7fb7637fe640 1 -- 172.21.15.55:0/1806061882 learned_addr learned my addr 172.21.15.55:0/1806061882 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:58.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.626+0000 7fb763fff640 1 --2- 172.21.15.55:0/1806061882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7640ca110 0x7fb7640aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:58.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.626+0000 7fb768af6640 1 --2- 172.21.15.55:0/1806061882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb764158e10 0x7fb7640c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:58.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.626+0000 7fb7637fe640 1 -- 172.21.15.55:0/1806061882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7640ca110 msgr2=0x7fb7640aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:58.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.626+0000 7fb7637fe640 1 --2- 172.21.15.55:0/1806061882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7640ca110 0x7fb7640aec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.626+0000 7fb7637fe640 1 -- 172.21.15.55:0/1806061882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb764158e10 msgr2=0x7fb7640c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:58.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.626+0000 7fb7637fe640 1 --2- 172.21.15.55:0/1806061882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb764158e10 0x7fb7640c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.626+0000 7fb7637fe640 1 -- 172.21.15.55:0/1806061882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c009a70 con 0x7fb7640cb2a0 2023-08-25T05:37:58.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.626+0000 7fb763fff640 1 --2- 172.21.15.55:0/1806061882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7640ca110 0x7fb7640aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:37:58.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.626+0000 7fb7637fe640 1 --2- 172.21.15.55:0/1806061882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7640cb2a0 0x7fb764161f80 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7fb75800c4d0 tx=0x7fb75800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:58.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.626+0000 7fb760ff9640 1 -- 172.21.15.55:0/1806061882 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb758005cf0 con 0x7fb7640cb2a0 2023-08-25T05:37:58.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.626+0000 7fb760ff9640 1 -- 172.21.15.55:0/1806061882 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb758005e50 con 0x7fb7640cb2a0 2023-08-25T05:37:58.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.626+0000 7fb76a559640 1 -- 172.21.15.55:0/1806061882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb764159370 con 0x7fb7640cb2a0 2023-08-25T05:37:58.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.626+0000 7fb760ff9640 1 -- 172.21.15.55:0/1806061882 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7580072b0 con 0x7fb7640cb2a0 2023-08-25T05:37:58.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.626+0000 7fb76a559640 1 -- 172.21.15.55:0/1806061882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7640c68e0 con 0x7fb7640cb2a0 2023-08-25T05:37:58.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.626+0000 7fb76a559640 1 -- 172.21.15.55:0/1806061882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7640c6dc0 con 0x7fb7640cb2a0 2023-08-25T05:37:58.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.626+0000 7fb760ff9640 1 -- 172.21.15.55:0/1806061882 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fb758007410 con 0x7fb7640cb2a0 2023-08-25T05:37:58.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.626+0000 7fb760ff9640 1 --2- 172.21.15.55:0/1806061882 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fb7500657a0 0x7fb750067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:58.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.626+0000 7fb760ff9640 1 -- 172.21.15.55:0/1806061882 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fb758082500 con 0x7fb7640cb2a0 2023-08-25T05:37:58.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.630+0000 7fb763fff640 1 --2- 172.21.15.55:0/1806061882 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fb7500657a0 0x7fb750067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:58.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.630+0000 7fb763fff640 1 --2- 172.21.15.55:0/1806061882 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fb7500657a0 0x7fb750067c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb7540011f0 tx=0x7fb754009040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:58.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.630+0000 7fb760ff9640 1 -- 172.21.15.55:0/1806061882 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb75804ff30 con 0x7fb7640cb2a0 2023-08-25T05:37:58.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.790+0000 7fb76a559640 1 -- 172.21.15.55:0/1806061882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb76404dbe0 con 0x7fb7640cb2a0 2023-08-25T05:37:58.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.794+0000 7fb760ff9640 1 -- 172.21.15.55:0/1806061882 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v207) v1 ==== 74+0+15805 (secure 0 0 0) 0x7fb758053550 con 0x7fb7640cb2a0 2023-08-25T05:37:58.796 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:37:58.797 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":207,"fsid":"2d2a9024-b152-4d40-880c-1686d1810590","created":"2023-08-25T04:02:35.555883+0000","modified":"2023-08-25T05:37:54.334743+0000","last_up_change":"2023-08-25T04:02:47.606455+0000","last_in_change":"2023-08-25T04:02:38.124953+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-25T04:02:46.661185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-25T04:02:54.201092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bcc0f659-64ac-44ee-b885-fa842e94819d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6825","nonce":1615684400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6827","nonce":1615684400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6831","nonce":1615684400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":1615684400},{"type":"v1","addr":"172.21.15.55:6829","nonce":1615684400}]},"public_addr":"172.21.15.55:6825/1615684400","cluster_addr":"172.21.15.55:6827/1615684400","heartbeat_back_addr":"172.21.15.55:6831/1615684400","heartbeat_front_addr":"172.21.15.55:6829/1615684400","state":["exists","up"]},{"osd":1,"uuid":"6c684da9-6f70-4db5-8367-4e023636bd8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6801","nonce":1562339076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6803","nonce":1562339076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6807","nonce":1562339076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":1562339076},{"type":"v1","addr":"172.21.15.55:6805","nonce":1562339076}]},"public_addr":"172.21.15.55:6801/1562339076","cluster_addr":"172.21.15.55:6803/1562339076","heartbeat_back_addr":"172.21.15.55:6807/1562339076","heartbeat_front_addr":"172.21.15.55:6805/1562339076","state":["exists","up"]},{"osd":2,"uuid":"b76dbb66-f3d4-4b34-bb99-c917bc154f30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6809","nonce":3999551967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6811","nonce":3999551967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6815","nonce":3999551967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":3999551967},{"type":"v1","addr":"172.21.15.55:6813","nonce":3999551967}]},"public_addr":"172.21.15.55:6809/3999551967","cluster_addr":"172.21.15.55:6811/3999551967","heartbeat_back_addr":"172.21.15.55:6815/3999551967","heartbeat_front_addr":"172.21.15.55:6813/3999551967","state":["exists","up"]},{"osd":3,"uuid":"5ba7d683-f07a-4e97-b299-4ba11d9a1140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6817","nonce":2251401738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6819","nonce":2251401738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6823","nonce":2251401738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":2251401738},{"type":"v1","addr":"172.21.15.55:6821","nonce":2251401738}]},"public_addr":"172.21.15.55:6817/2251401738","cluster_addr":"172.21.15.55:6819/2251401738","heartbeat_back_addr":"172.21.15.55:6823/2251401738","heartbeat_front_addr":"172.21.15.55:6821/2251401738","state":["exists","up"]},{"osd":4,"uuid":"35ce1bdd-bd8b-4041-9dc9-d92c4dc650dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6817","nonce":1700969513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6819","nonce":1700969513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6823","nonce":1700969513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":1700969513},{"type":"v1","addr":"172.21.15.110:6821","nonce":1700969513}]},"public_addr":"172.21.15.110:6817/1700969513","cluster_addr":"172.21.15.110:6819/1700969513","heartbeat_back_addr":"172.21.15.110:6823/1700969513","heartbeat_front_addr":"172.21.15.110:6821/1700969513","state":["exists","up"]},{"osd":5,"uuid":"d6f227fc-9a06-414b-84bd-97df8850ebae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6825","nonce":3619347626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6827","nonce":3619347626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6831","nonce":3619347626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":3619347626},{"type":"v1","addr":"172.21.15.110:6829","nonce":3619347626}]},"public_addr":"172.21.15.110:6825/3619347626","cluster_addr":"172.21.15.110:6827/3619347626","heartbeat_back_addr":"172.21.15.110:6831/3619347626","heartbeat_front_addr":"172.21.15.110:6829/3619347626","state":["exists","up"]},{"osd":6,"uuid":"67454445-1277-4135-8362-fc13874c1c55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6801","nonce":3646933996}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6803","nonce":3646933996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6807","nonce":3646933996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":3646933996},{"type":"v1","addr":"172.21.15.110:6805","nonce":3646933996}]},"public_addr":"172.21.15.110:6801/3646933996","cluster_addr":"172.21.15.110:6803/3646933996","heartbeat_back_addr":"172.21.15.110:6807/3646933996","heartbeat_front_addr":"172.21.15.110:6805/3646933996","state":["exists","up"]},{"osd":7,"uuid":"b9cf8dda-12c0-441f-bcc5-429f79e5fece","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":200,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6809","nonce":2557570989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6811","nonce":2557570989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6815","nonce":2557570989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":2557570989},{"type":"v1","addr":"172.21.15.110:6813","nonce":2557570989}]},"public_addr":"172.21.15.110:6809/2557570989","cluster_addr":"172.21.15.110:6811/2557570989","heartbeat_back_addr":"172.21.15.110:6815/2557570989","heartbeat_front_addr":"172.21.15.110:6813/2557570989","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.621686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.529920+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.511409+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.616739+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.894849+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.882286+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.836591+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-25T04:02:43.868645+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6835/3936252180":"2023-08-26T05:37:51.256611+0000","172.21.15.110:0/4157713130":"2023-08-26T05:37:48.096492+0000","172.21.15.55:6833/3936252180":"2023-08-26T05:37:51.256611+0000","172.21.15.110:0/829410695":"2023-08-26T05:37:48.096492+0000","172.21.15.110:0/3425796478":"2023-08-26T05:37:48.096492+0000","172.21.15.110:0/1202025049":"2023-08-26T05:37:48.096492+0000","172.21.15.110:6833/4020115519":"2023-08-26T05:37:48.096492+0000","172.21.15.110:6832/4020115519":"2023-08-26T05:37:48.096492+0000","172.21.15.110:0/4140183043":"2023-08-26T05:37:48.096492+0000","172.21.15.110:6833/3630541271":"2023-08-26T05:37:41.077473+0000","172.21.15.110:6832/3630541271":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/546735057":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/2752452882":"2023-08-26T05:37:48.096492+0000","172.21.15.110:0/2235590334":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/1481231262":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/19806955":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/645754688":"2023-08-26T05:37:41.077473+0000","172.21.15.110:0/4203127837":"2023-08-26T05:37:41.077473+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-25T05:37:58.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.794+0000 7fb76a559640 1 -- 172.21.15.55:0/1806061882 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fb7500657a0 msgr2=0x7fb750067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:58.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.794+0000 7fb76a559640 1 --2- 172.21.15.55:0/1806061882 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fb7500657a0 0x7fb750067c60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb7540011f0 tx=0x7fb754009040 comp rx=0 tx=0).stop 2023-08-25T05:37:58.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.794+0000 7fb76a559640 1 -- 172.21.15.55:0/1806061882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7640cb2a0 msgr2=0x7fb764161f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:58.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.794+0000 7fb76a559640 1 --2- 172.21.15.55:0/1806061882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7640cb2a0 0x7fb764161f80 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7fb75800c4d0 tx=0x7fb75800c990 comp rx=0 tx=0).stop 2023-08-25T05:37:58.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.794+0000 7fb76a559640 1 -- 172.21.15.55:0/1806061882 shutdown_connections 2023-08-25T05:37:58.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.794+0000 7fb76a559640 1 --2- 172.21.15.55:0/1806061882 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fb7500657a0 0x7fb750067c60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.794+0000 7fb76a559640 1 --2- 172.21.15.55:0/1806061882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb764158e10 0x7fb7640c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.794+0000 7fb76a559640 1 --2- 172.21.15.55:0/1806061882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7640cb2a0 0x7fb764161f80 unknown :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.794+0000 7fb76a559640 1 --2- 172.21.15.55:0/1806061882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7640ca110 0x7fb7640aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:58.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.794+0000 7fb76a559640 1 -- 172.21.15.55:0/1806061882 >> 172.21.15.55:0/1806061882 conn(0x7fb764069d00 msgr2=0x7fb764164460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:58.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.794+0000 7fb76a559640 1 -- 172.21.15.55:0/1806061882 shutdown_connections 2023-08-25T05:37:58.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:58.794+0000 7fb76a559640 1 -- 172.21.15.55:0/1806061882 wait complete. 2023-08-25T05:37:59.817 INFO:tasks.ceph:Scrubbing osd.0 2023-08-25T05:37:59.818 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-08-25T05:37:59.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.974+0000 7fd1265a3640 1 Processor -- start 2023-08-25T05:37:59.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.974+0000 7fd1265a3640 1 -- start start 2023-08-25T05:37:59.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.974+0000 7fd1265a3640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd120159d00 0x7fd1200cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:59.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.974+0000 7fd1265a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1200cc930 0x7fd1200ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:59.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.974+0000 7fd1265a3640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1200c9270 con 0x7fd12006fb50 2023-08-25T05:37:59.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.974+0000 7fd1265a3640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1200cc510 con 0x7fd120159d00 2023-08-25T05:37:59.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.974+0000 7fd1265a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200ce220 con 0x7fd1200cc930 2023-08-25T05:37:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.978+0000 7fd124b40640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1200cc930 0x7fd1200ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.978+0000 7fd11ffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd120159d00 0x7fd1200cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.978+0000 7fd124b40640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1200cc930 0x7fd1200ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:55954/0 (socket says 172.21.15.55:55954) 2023-08-25T05:37:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.978+0000 7fd11ffff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd120159d00 0x7fd1200cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.55:38118/0 (socket says 172.21.15.55:38118) 2023-08-25T05:37:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.978+0000 7fd124b40640 1 -- 172.21.15.55:0/1853884969 learned_addr learned my addr 172.21.15.55:0/1853884969 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:59.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.978+0000 7fd124b40640 1 -- 172.21.15.55:0/1853884969 >> v2:172.21.15.110:3300/0 conn(0x7fd120159d00 msgr2=0x7fd1200cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:37:59.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.978+0000 7fd124b40640 1 --2- 172.21.15.55:0/1853884969 >> v2:172.21.15.110:3300/0 conn(0x7fd120159d00 0x7fd1200cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:59.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.978+0000 7fd124b40640 1 -- 172.21.15.55:0/1853884969 >> v1:172.21.15.110:6789/0 conn(0x7fd12006fb50 legacy=0x7fd1200c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:59.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.978+0000 7fd124b40640 1 -- 172.21.15.55:0/1853884969 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1200ca6c0 con 0x7fd1200cc930 2023-08-25T05:37:59.981 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.978+0000 7fd11ffff640 1 --2- 172.21.15.55:0/1853884969 >> v2:172.21.15.110:3300/0 conn(0x7fd120159d00 0x7fd1200cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:37:59.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.978+0000 7fd124b40640 1 --2- 172.21.15.55:0/1853884969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1200cc930 0x7fd1200ccd80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd118009e50 tx=0x7fd11801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f125232cb5bfb9da server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:59.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.978+0000 7fd11effd640 1 -- 172.21.15.55:0/1853884969 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180a5810 con 0x7fd1200cc930 2023-08-25T05:37:59.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.978+0000 7fd11effd640 1 -- 172.21.15.55:0/1853884969 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1180a5970 con 0x7fd1200cc930 2023-08-25T05:37:59.983 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.978+0000 7fd11effd640 1 -- 172.21.15.55:0/1853884969 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180a5d00 con 0x7fd1200cc930 2023-08-25T05:37:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd1265a3640 1 -- 172.21.15.55:0/1853884969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1200cc930 msgr2=0x7fd1200ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:59.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd1265a3640 1 --2- 172.21.15.55:0/1853884969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1200cc930 0x7fd1200ccd80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd118009e50 tx=0x7fd11801c950 comp rx=0 tx=0).stop 2023-08-25T05:37:59.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd1265a3640 1 -- 172.21.15.55:0/1853884969 shutdown_connections 2023-08-25T05:37:59.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd1265a3640 1 --2- 172.21.15.55:0/1853884969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1200cc930 0x7fd1200ccd80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:59.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd1265a3640 1 --2- 172.21.15.55:0/1853884969 >> v2:172.21.15.110:3300/0 conn(0x7fd120159d00 0x7fd1200cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:59.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd1265a3640 1 -- 172.21.15.55:0/1853884969 >> 172.21.15.55:0/1853884969 conn(0x7fd1200caf90 msgr2=0x7fd1200cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:37:59.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd1265a3640 1 -- 172.21.15.55:0/1853884969 shutdown_connections 2023-08-25T05:37:59.986 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd1265a3640 1 -- 172.21.15.55:0/1853884969 wait complete. 2023-08-25T05:37:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd1265a3640 1 Processor -- start 2023-08-25T05:37:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd1265a3640 1 -- start start 2023-08-25T05:37:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd1265a3640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd12006fb50 0x7fd1200b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd1265a3640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1200cc930 0x7fd1200c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd1265a3640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd120159d00 0x7fd1200c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd1265a3640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200c4b20 con 0x7fd1200cc930 2023-08-25T05:37:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd1265a3640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200c4e00 con 0x7fd12006fb50 2023-08-25T05:37:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd1265a3640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200c6b60 con 0x7fd120159d00 2023-08-25T05:37:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd11f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1200cc930 0x7fd1200c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd11f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1200cc930 0x7fd1200c7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53260/0 (socket says 172.21.15.55:53260) 2023-08-25T05:37:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd11f7fe640 1 -- 172.21.15.55:0/100842015 learned_addr learned my addr 172.21.15.55:0/100842015 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:37:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd124b40640 1 --2- 172.21.15.55:0/100842015 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd120159d00 0x7fd1200c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.982+0000 7fd11ffff640 1 --2- 172.21.15.55:0/100842015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd12006fb50 0x7fd1200b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.986+0000 7fd11f7fe640 1 -- 172.21.15.55:0/100842015 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd120159d00 msgr2=0x7fd1200c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.986+0000 7fd11f7fe640 1 --2- 172.21.15.55:0/100842015 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd120159d00 0x7fd1200c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.986+0000 7fd11f7fe640 1 -- 172.21.15.55:0/100842015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd12006fb50 msgr2=0x7fd1200b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:37:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.986+0000 7fd11f7fe640 1 --2- 172.21.15.55:0/100842015 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd12006fb50 0x7fd1200b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:37:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.986+0000 7fd11f7fe640 1 -- 172.21.15.55:0/100842015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd110009420 con 0x7fd1200cc930 2023-08-25T05:37:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.986+0000 7fd11f7fe640 1 --2- 172.21.15.55:0/100842015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1200cc930 0x7fd1200c7640 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7fd11400c3c0 tx=0x7fd11400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.986+0000 7fd11cff9640 1 -- 172.21.15.55:0/100842015 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1140052d0 con 0x7fd1200cc930 2023-08-25T05:37:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.986+0000 7fd11cff9640 1 -- 172.21.15.55:0/100842015 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd114005430 con 0x7fd1200cc930 2023-08-25T05:37:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.986+0000 7fd1265a3640 1 -- 172.21.15.55:0/100842015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd118009b30 con 0x7fd1200cc930 2023-08-25T05:37:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.986+0000 7fd11cff9640 1 -- 172.21.15.55:0/100842015 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd114003840 con 0x7fd1200cc930 2023-08-25T05:37:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.986+0000 7fd1265a3640 1 -- 172.21.15.55:0/100842015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1200c7120 con 0x7fd1200cc930 2023-08-25T05:37:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.986+0000 7fd1265a3640 1 -- 172.21.15.55:0/100842015 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1200cd2c0 con 0x7fd1200cc930 2023-08-25T05:37:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.986+0000 7fd11cff9640 1 -- 172.21.15.55:0/100842015 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fd1140039a0 con 0x7fd1200cc930 2023-08-25T05:37:59.992 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.986+0000 7fd11cff9640 1 --2- 172.21.15.55:0/100842015 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fd10c0657a0 0x7fd10c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:59.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.990+0000 7fd11cff9640 1 -- 172.21.15.55:0/100842015 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fd114082b80 con 0x7fd1200cc930 2023-08-25T05:37:59.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.990+0000 7fd11cff9640 1 --2- 172.21.15.55:0/100842015 >> [v2:172.21.15.55:6824/1615684400,v1:172.21.15.55:6825/1615684400] conn(0x7fd10c06c210 0x7fd10c06e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:37:59.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.990+0000 7fd11cff9640 1 -- 172.21.15.55:0/100842015 --> [v2:172.21.15.55:6824/1615684400,v1:172.21.15.55:6825/1615684400] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd10c06ece0 con 0x7fd10c06c210 2023-08-25T05:37:59.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.990+0000 7fd11cff9640 1 -- 172.21.15.55:0/100842015 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd114082ef0 con 0x7fd1200cc930 2023-08-25T05:37:59.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.990+0000 7fd11ffff640 1 --2- 172.21.15.55:0/100842015 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fd10c0657a0 0x7fd10c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:59.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.990+0000 7fd124b40640 1 --2- 172.21.15.55:0/100842015 >> [v2:172.21.15.55:6824/1615684400,v1:172.21.15.55:6825/1615684400] conn(0x7fd10c06c210 0x7fd10c06e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:37:59.993 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.990+0000 7fd11ffff640 1 --2- 172.21.15.55:0/100842015 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fd10c0657a0 0x7fd10c067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd110009cf0 tx=0x7fd110009190 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:59.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.990+0000 7fd124b40640 1 --2- 172.21.15.55:0/100842015 >> [v2:172.21.15.55:6824/1615684400,v1:172.21.15.55:6825/1615684400] conn(0x7fd10c06c210 0x7fd10c06e630 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:37:59.994 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:37:59.990+0000 7fd11cff9640 1 -- 172.21.15.55:0/100842015 <== osd.0 v2:172.21.15.55:6824/1615684400 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd10c06ece0 con 0x7fd10c06c210 2023-08-25T05:38:00.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.002+0000 7fd1265a3640 1 -- 172.21.15.55:0/100842015 --> [v2:172.21.15.55:6824/1615684400,v1:172.21.15.55:6825/1615684400] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd12015a0e0 con 0x7fd10c06c210 2023-08-25T05:38:00.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.002+0000 7fd11cff9640 1 -- 172.21.15.55:0/100842015 <== osd.0 v2:172.21.15.55:6824/1615684400 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd118009150 con 0x7fd10c06c210 2023-08-25T05:38:00.006 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T05:38:00.007 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-25T05:38:00.007 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T05:38:00.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.002+0000 7fd1265a3640 1 -- 172.21.15.55:0/100842015 >> [v2:172.21.15.55:6824/1615684400,v1:172.21.15.55:6825/1615684400] conn(0x7fd10c06c210 msgr2=0x7fd10c06e630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.002+0000 7fd1265a3640 1 --2- 172.21.15.55:0/100842015 >> [v2:172.21.15.55:6824/1615684400,v1:172.21.15.55:6825/1615684400] conn(0x7fd10c06c210 0x7fd10c06e630 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.002+0000 7fd1265a3640 1 -- 172.21.15.55:0/100842015 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fd10c0657a0 msgr2=0x7fd10c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.002+0000 7fd1265a3640 1 --2- 172.21.15.55:0/100842015 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fd10c0657a0 0x7fd10c067c60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd110009cf0 tx=0x7fd110009190 comp rx=0 tx=0).stop 2023-08-25T05:38:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.002+0000 7fd1265a3640 1 -- 172.21.15.55:0/100842015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1200cc930 msgr2=0x7fd1200c7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.002+0000 7fd1265a3640 1 --2- 172.21.15.55:0/100842015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1200cc930 0x7fd1200c7640 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7fd11400c3c0 tx=0x7fd11400c880 comp rx=0 tx=0).stop 2023-08-25T05:38:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.002+0000 7fd124b40640 1 -- 172.21.15.55:0/100842015 reap_dead start 2023-08-25T05:38:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.002+0000 7fd1265a3640 1 -- 172.21.15.55:0/100842015 shutdown_connections 2023-08-25T05:38:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.002+0000 7fd1265a3640 1 -- 172.21.15.55:0/100842015 >> 172.21.15.55:0/100842015 conn(0x7fd1200caf90 msgr2=0x7fd1200c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.002+0000 7fd1265a3640 1 -- 172.21.15.55:0/100842015 shutdown_connections 2023-08-25T05:38:00.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.002+0000 7fd1265a3640 1 -- 172.21.15.55:0/100842015 wait complete. 2023-08-25T05:38:00.025 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-08-25T05:38:00.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.166+0000 7f0159737640 1 Processor -- start 2023-08-25T05:38:00.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.166+0000 7f0159737640 1 -- start start 2023-08-25T05:38:00.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.166+0000 7f0159737640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f015415ef80 0x7f01540ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.166+0000 7f0159737640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01540ac3a0 con 0x7f015415eba0 2023-08-25T05:38:00.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.166+0000 7f0159737640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01540b1390 con 0x7f01540cece0 2023-08-25T05:38:00.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.166+0000 7f0159737640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01540cf170 con 0x7f015415ef80 2023-08-25T05:38:00.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f0152ffd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f015415eba0 0x7f01540b2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34578/0 (socket says 172.21.15.55:34578) 2023-08-25T05:38:00.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f0152ffd640 1 -- 172.21.15.55:0/2106599436 learned_addr learned my addr 172.21.15.55:0/2106599436 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:38:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f014a7fc640 1 --2- 172.21.15.55:0/2106599436 >> v2:172.21.15.110:3300/0 conn(0x7f015415ef80 0x7f01540ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01527fc640 1 -- 172.21.15.55:0/2106599436 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519838851 0 0) 0x7f01540ac3a0 con 0x7f015415eba0 2023-08-25T05:38:00.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01527fc640 1 -- 172.21.15.55:0/2106599436 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0140003530 con 0x7f015415eba0 2023-08-25T05:38:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01527fc640 1 -- 172.21.15.55:0/2106599436 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796484449 0 0) 0x7f01540b1390 con 0x7f01540cece0 2023-08-25T05:38:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01527fc640 1 -- 172.21.15.55:0/2106599436 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01540ac3a0 con 0x7f01540cece0 2023-08-25T05:38:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01527fc640 1 -- 172.21.15.55:0/2106599436 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3494259980 0 0) 0x7f0140003530 con 0x7f015415eba0 2023-08-25T05:38:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01527fc640 1 -- 172.21.15.55:0/2106599436 >> v2:172.21.15.110:3300/0 conn(0x7f015415ef80 msgr2=0x7f01540ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01527fc640 1 --2- 172.21.15.55:0/2106599436 >> v2:172.21.15.110:3300/0 conn(0x7f015415ef80 0x7f01540ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01527fc640 1 -- 172.21.15.55:0/2106599436 >> v1:172.21.15.110:6789/0 conn(0x7f01540cece0 legacy=0x7f01540ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01527fc640 1 -- 172.21.15.55:0/2106599436 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01540b1670 con 0x7f015415eba0 2023-08-25T05:38:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01527fc640 1 -- 172.21.15.55:0/2106599436 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f0144001a00 con 0x7f015415eba0 2023-08-25T05:38:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01527fc640 1 -- 172.21.15.55:0/2106599436 >> v1:172.21.15.55:6789/0 conn(0x7f015415eba0 legacy=0x7f01540b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01527fc640 1 --2- 172.21.15.55:0/2106599436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0140003b10 0x7f0140003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01527fc640 1 --2- 172.21.15.55:0/2106599436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01400047d0 0x7f0140004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01527fc640 1 --2- 172.21.15.55:0/2106599436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0140005190 0x7f014000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01527fc640 1 -- 172.21.15.55:0/2106599436 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01540cf170 con 0x7f01400047d0 2023-08-25T05:38:00.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01527fc640 1 -- 172.21.15.55:0/2106599436 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014000c010 con 0x7f0140005190 2023-08-25T05:38:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01527fc640 1 -- 172.21.15.55:0/2106599436 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014000c1d0 con 0x7f0140003b10 2023-08-25T05:38:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f014a7fc640 1 --2- 172.21.15.55:0/2106599436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01400047d0 0x7f0140004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f0152ffd640 1 --2- 172.21.15.55:0/2106599436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0140003b10 0x7f0140003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01537fe640 1 --2- 172.21.15.55:0/2106599436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0140005190 0x7f014000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f014a7fc640 1 -- 172.21.15.55:0/2106599436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0140003b10 msgr2=0x7f0140003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f014a7fc640 1 --2- 172.21.15.55:0/2106599436 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0140003b10 0x7f0140003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f014a7fc640 1 -- 172.21.15.55:0/2106599436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0140005190 msgr2=0x7f014000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f014a7fc640 1 --2- 172.21.15.55:0/2106599436 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0140005190 0x7f014000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f014a7fc640 1 -- 172.21.15.55:0/2106599436 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0140003530 con 0x7f01400047d0 2023-08-25T05:38:00.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.170+0000 7f01537fe640 1 -- 172.21.15.55:0/2106599436 reap_dead start 2023-08-25T05:38:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.174+0000 7f014a7fc640 1 --2- 172.21.15.55:0/2106599436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01400047d0 0x7f0140004c50 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f013c009ae0 tx=0x7f013c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee31c7705377052 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.174+0000 7f01527fc640 1 -- 172.21.15.55:0/2106599436 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c0a5640 con 0x7f01400047d0 2023-08-25T05:38:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.174+0000 7f01527fc640 1 -- 172.21.15.55:0/2106599436 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c0a57a0 con 0x7f01400047d0 2023-08-25T05:38:00.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.174+0000 7f01527fc640 1 -- 172.21.15.55:0/2106599436 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c0a5b50 con 0x7f01400047d0 2023-08-25T05:38:00.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.174+0000 7f0159737640 1 -- 172.21.15.55:0/2106599436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01400047d0 msgr2=0x7f0140004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.174+0000 7f0159737640 1 --2- 172.21.15.55:0/2106599436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01400047d0 0x7f0140004c50 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f013c009ae0 tx=0x7f013c01ca50 comp rx=0 tx=0).stop 2023-08-25T05:38:00.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.174+0000 7f0159737640 1 -- 172.21.15.55:0/2106599436 shutdown_connections 2023-08-25T05:38:00.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.174+0000 7f0159737640 1 --2- 172.21.15.55:0/2106599436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01400047d0 0x7f0140004c50 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.174+0000 7f0159737640 1 -- 172.21.15.55:0/2106599436 >> 172.21.15.55:0/2106599436 conn(0x7f0154069d00 msgr2=0x7f015406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:00.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.174+0000 7f0159737640 1 -- 172.21.15.55:0/2106599436 shutdown_connections 2023-08-25T05:38:00.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.174+0000 7f0159737640 1 -- 172.21.15.55:0/2106599436 wait complete. 2023-08-25T05:38:00.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.174+0000 7f0159737640 1 Processor -- start 2023-08-25T05:38:00.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.174+0000 7f0159737640 1 -- start start 2023-08-25T05:38:00.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f0159737640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01400047d0 0x7f0154158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f0159737640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01540cb670 0x7f01540c28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f0159737640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f015415be30 0x7f01540c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f0159737640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01540c2e20 con 0x7f01540cb670 2023-08-25T05:38:00.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f0159737640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01540c9a80 con 0x7f01400047d0 2023-08-25T05:38:00.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f0159737640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01540c3050 con 0x7f015415be30 2023-08-25T05:38:00.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f014a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01540cb670 0x7f01540c28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f014a7fc640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01540cb670 0x7f01540c28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53282/0 (socket says 172.21.15.55:53282) 2023-08-25T05:38:00.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f014a7fc640 1 -- 172.21.15.55:0/2808563542 learned_addr learned my addr 172.21.15.55:0/2808563542 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:00.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f01537fe640 1 --2- 172.21.15.55:0/2808563542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f015415be30 0x7f01540c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f0152ffd640 1 --2- 172.21.15.55:0/2808563542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01400047d0 0x7f0154158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f014a7fc640 1 -- 172.21.15.55:0/2808563542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f015415be30 msgr2=0x7f01540c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f014a7fc640 1 --2- 172.21.15.55:0/2808563542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f015415be30 0x7f01540c3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f014a7fc640 1 -- 172.21.15.55:0/2808563542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01400047d0 msgr2=0x7f0154158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f014a7fc640 1 --2- 172.21.15.55:0/2808563542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01400047d0 0x7f0154158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f014a7fc640 1 -- 172.21.15.55:0/2808563542 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01540c9cd0 con 0x7f01540cb670 2023-08-25T05:38:00.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f014a7fc640 1 --2- 172.21.15.55:0/2808563542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01540cb670 0x7f01540c28e0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f013c0b0040 tx=0x7f013c0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:00.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f014bfff640 1 -- 172.21.15.55:0/2808563542 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c0ad850 con 0x7f01540cb670 2023-08-25T05:38:00.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f014bfff640 1 -- 172.21.15.55:0/2808563542 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c0ad9d0 con 0x7f01540cb670 2023-08-25T05:38:00.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f0159737640 1 -- 172.21.15.55:0/2808563542 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01540c9fb0 con 0x7f01540cb670 2023-08-25T05:38:00.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f014bfff640 1 -- 172.21.15.55:0/2808563542 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c0add80 con 0x7f01540cb670 2023-08-25T05:38:00.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f0159737640 1 -- 172.21.15.55:0/2808563542 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f015415c2b0 con 0x7f01540cb670 2023-08-25T05:38:00.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f0159737640 1 -- 172.21.15.55:0/2808563542 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015404dbe0 con 0x7f01540cb670 2023-08-25T05:38:00.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.178+0000 7f014bfff640 1 -- 172.21.15.55:0/2808563542 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f013c0b4040 con 0x7f01540cb670 2023-08-25T05:38:00.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.182+0000 7f014bfff640 1 --2- 172.21.15.55:0/2808563542 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f01340657a0 0x7f0134067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.182+0000 7f014bfff640 1 -- 172.21.15.55:0/2808563542 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f014c001d30 con 0x7f01540cb670 2023-08-25T05:38:00.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.182+0000 7f0152ffd640 1 --2- 172.21.15.55:0/2808563542 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f01340657a0 0x7f0134067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.182+0000 7f0152ffd640 1 --2- 172.21.15.55:0/2808563542 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f01340657a0 0x7f0134067c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0144000f90 tx=0x7f0144006040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:00.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.186+0000 7f014bfff640 1 -- 172.21.15.55:0/2808563542 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f013c0ea740 con 0x7f01540cb670 2023-08-25T05:38:00.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.342+0000 7f0159737640 1 -- 172.21.15.55:0/2808563542 --> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f01540b1c30 con 0x7f01340657a0 2023-08-25T05:38:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.342+0000 7f014bfff640 1 -- 172.21.15.55:0/2808563542 <== mgr.9404 v2:172.21.15.110:6832/1527806048 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0144004d10 con 0x7f01340657a0 2023-08-25T05:38:00.347 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 0 to deep-scrub 2023-08-25T05:38:00.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.346+0000 7f0159737640 1 -- 172.21.15.55:0/2808563542 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f01340657a0 msgr2=0x7f0134067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.346+0000 7f0159737640 1 --2- 172.21.15.55:0/2808563542 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f01340657a0 0x7f0134067c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0144000f90 tx=0x7f0144006040 comp rx=0 tx=0).stop 2023-08-25T05:38:00.349 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.346+0000 7f0159737640 1 -- 172.21.15.55:0/2808563542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01540cb670 msgr2=0x7f01540c28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.346+0000 7f0159737640 1 --2- 172.21.15.55:0/2808563542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01540cb670 0x7f01540c28e0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f013c0b0040 tx=0x7f013c0197f0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.346+0000 7f0159737640 1 -- 172.21.15.55:0/2808563542 shutdown_connections 2023-08-25T05:38:00.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.346+0000 7f0159737640 1 --2- 172.21.15.55:0/2808563542 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f01340657a0 0x7f0134067c60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.346+0000 7f0159737640 1 --2- 172.21.15.55:0/2808563542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f015415be30 0x7f01540c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.346+0000 7f0159737640 1 --2- 172.21.15.55:0/2808563542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01540cb670 0x7f01540c28e0 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.346+0000 7f0159737640 1 --2- 172.21.15.55:0/2808563542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01400047d0 0x7f0154158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.346+0000 7f0159737640 1 -- 172.21.15.55:0/2808563542 >> 172.21.15.55:0/2808563542 conn(0x7f0154069d00 msgr2=0x7f01540afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:00.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.346+0000 7f0159737640 1 -- 172.21.15.55:0/2808563542 shutdown_connections 2023-08-25T05:38:00.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.346+0000 7f0159737640 1 -- 172.21.15.55:0/2808563542 wait complete. 2023-08-25T05:38:00.368 INFO:tasks.ceph:Scrubbing osd.1 2023-08-25T05:38:00.369 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-08-25T05:38:00.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.514+0000 7ffa29767640 1 Processor -- start 2023-08-25T05:38:00.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.514+0000 7ffa29767640 1 -- start start 2023-08-25T05:38:00.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.514+0000 7ffa29767640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa24159d00 0x7ffa240cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.514+0000 7ffa29767640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffa2406fb50 0x7ffa240c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.514+0000 7ffa29767640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa240ce220 con 0x7ffa240cc930 2023-08-25T05:38:00.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.514+0000 7ffa29767640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa240cc510 con 0x7ffa2406fb50 2023-08-25T05:38:00.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.514+0000 7ffa29767640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa240ca6c0 con 0x7ffa24159d00 2023-08-25T05:38:00.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.514+0000 7ffa1a7fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffa2406fb50 0x7ffa240c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.514+0000 7ffa237fe640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ffa240cc930 0x7ffa240ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34582/0 (socket says 172.21.15.55:34582) 2023-08-25T05:38:00.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.514+0000 7ffa237fe640 1 -- 172.21.15.55:0/598660971 learned_addr learned my addr 172.21.15.55:0/598660971 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:38:00.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.514+0000 7ffa22ffd640 1 --2- 172.21.15.55:0/598660971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa24159d00 0x7ffa240cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.514+0000 7ffa1a7fc640 1 -- 172.21.15.55:0/598660971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa24159d00 msgr2=0x7ffa240cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:00.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.514+0000 7ffa1a7fc640 1 --2- 172.21.15.55:0/598660971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa24159d00 0x7ffa240cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.514+0000 7ffa1a7fc640 1 -- 172.21.15.55:0/598660971 >> v1:172.21.15.55:6789/0 conn(0x7ffa240cc930 legacy=0x7ffa240ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.514+0000 7ffa1a7fc640 1 -- 172.21.15.55:0/598660971 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa240ca9a0 con 0x7ffa2406fb50 2023-08-25T05:38:00.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.514+0000 7ffa227fc640 1 -- 172.21.15.55:0/598660971 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098437155 0 0) 0x7ffa240ce220 con 0x7ffa240cc930 2023-08-25T05:38:00.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.514+0000 7ffa22ffd640 1 --2- 172.21.15.55:0/598660971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa24159d00 0x7ffa240cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:38:00.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.518+0000 7ffa1a7fc640 1 --2- 172.21.15.55:0/598660971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa2406fb50 0x7ffa240c8b60 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0097c0 tx=0x7ffa0c01cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506af0e4782fe8a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:00.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.518+0000 7ffa227fc640 1 -- 172.21.15.55:0/598660971 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c004230 con 0x7ffa2406fb50 2023-08-25T05:38:00.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.518+0000 7ffa227fc640 1 -- 172.21.15.55:0/598660971 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c0a7050 con 0x7ffa2406fb50 2023-08-25T05:38:00.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.518+0000 7ffa227fc640 1 -- 172.21.15.55:0/598660971 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c003620 con 0x7ffa2406fb50 2023-08-25T05:38:00.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.518+0000 7ffa29767640 1 -- 172.21.15.55:0/598660971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa2406fb50 msgr2=0x7ffa240c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.518+0000 7ffa29767640 1 --2- 172.21.15.55:0/598660971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa2406fb50 0x7ffa240c8b60 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c0097c0 tx=0x7ffa0c01cd90 comp rx=0 tx=0).stop 2023-08-25T05:38:00.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.518+0000 7ffa29767640 1 -- 172.21.15.55:0/598660971 shutdown_connections 2023-08-25T05:38:00.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.518+0000 7ffa29767640 1 --2- 172.21.15.55:0/598660971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa2406fb50 0x7ffa240c8b60 unknown :-1 s=CLOSED pgs=2213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.518+0000 7ffa29767640 1 --2- 172.21.15.55:0/598660971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa24159d00 0x7ffa240cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.518+0000 7ffa29767640 1 -- 172.21.15.55:0/598660971 >> 172.21.15.55:0/598660971 conn(0x7ffa240caf90 msgr2=0x7ffa240cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:00.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.518+0000 7ffa29767640 1 -- 172.21.15.55:0/598660971 shutdown_connections 2023-08-25T05:38:00.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.518+0000 7ffa29767640 1 -- 172.21.15.55:0/598660971 wait complete. 2023-08-25T05:38:00.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa29767640 1 Processor -- start 2023-08-25T05:38:00.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa29767640 1 -- start start 2023-08-25T05:38:00.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa29767640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa2406fb50 0x7ffa24158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa29767640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa240cc930 0x7ffa240b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa29767640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa24159d00 0x7ffa240b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa29767640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa24157000 con 0x7ffa24159d00 2023-08-25T05:38:00.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa29767640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa241589c0 con 0x7ffa240cc930 2023-08-25T05:38:00.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa29767640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa24158bd0 con 0x7ffa2406fb50 2023-08-25T05:38:00.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa237fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa24159d00 0x7ffa240b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa237fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa24159d00 0x7ffa240b2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53292/0 (socket says 172.21.15.55:53292) 2023-08-25T05:38:00.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa237fe640 1 -- 172.21.15.55:0/166641614 learned_addr learned my addr 172.21.15.55:0/166641614 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:00.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa1a7fc640 1 --2- 172.21.15.55:0/166641614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa240cc930 0x7ffa240b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa22ffd640 1 --2- 172.21.15.55:0/166641614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa2406fb50 0x7ffa24158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa237fe640 1 -- 172.21.15.55:0/166641614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa2406fb50 msgr2=0x7ffa24158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa237fe640 1 --2- 172.21.15.55:0/166641614 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ffa2406fb50 0x7ffa24158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa237fe640 1 -- 172.21.15.55:0/166641614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa240cc930 msgr2=0x7ffa240b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa237fe640 1 --2- 172.21.15.55:0/166641614 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ffa240cc930 0x7ffa240b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa237fe640 1 -- 172.21.15.55:0/166641614 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0c009420 con 0x7ffa24159d00 2023-08-25T05:38:00.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa237fe640 1 --2- 172.21.15.55:0/166641614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa24159d00 0x7ffa240b2690 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c001570 tx=0x7ffa1c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:00.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa1bfff640 1 -- 172.21.15.55:0/166641614 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c00a640 con 0x7ffa24159d00 2023-08-25T05:38:00.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa1bfff640 1 -- 172.21.15.55:0/166641614 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1c00a7c0 con 0x7ffa24159d00 2023-08-25T05:38:00.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa1bfff640 1 -- 172.21.15.55:0/166641614 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c00ab70 con 0x7ffa24159d00 2023-08-25T05:38:00.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa29767640 1 -- 172.21.15.55:0/166641614 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa240c6120 con 0x7ffa24159d00 2023-08-25T05:38:00.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.522+0000 7ffa29767640 1 -- 172.21.15.55:0/166641614 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2415a7a0 con 0x7ffa24159d00 2023-08-25T05:38:00.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.526+0000 7ffa29767640 1 -- 172.21.15.55:0/166641614 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffa240cd770 con 0x7ffa24159d00 2023-08-25T05:38:00.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.526+0000 7ffa1bfff640 1 -- 172.21.15.55:0/166641614 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7ffa1c00acd0 con 0x7ffa24159d00 2023-08-25T05:38:00.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.526+0000 7ffa1bfff640 1 --2- 172.21.15.55:0/166641614 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ffa040657a0 0x7ffa04067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.526+0000 7ffa1bfff640 1 -- 172.21.15.55:0/166641614 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7ffa1c082470 con 0x7ffa24159d00 2023-08-25T05:38:00.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.526+0000 7ffa1bfff640 1 --2- 172.21.15.55:0/166641614 >> [v2:172.21.15.55:6800/1562339076,v1:172.21.15.55:6801/1562339076] conn(0x7ffa0406c210 0x7ffa0406e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.526+0000 7ffa1bfff640 1 -- 172.21.15.55:0/166641614 --> [v2:172.21.15.55:6800/1562339076,v1:172.21.15.55:6801/1562339076] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa0406ece0 con 0x7ffa0406c210 2023-08-25T05:38:00.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.526+0000 7ffa1bfff640 1 -- 172.21.15.55:0/166641614 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa1c084a50 con 0x7ffa24159d00 2023-08-25T05:38:00.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.526+0000 7ffa22ffd640 1 --2- 172.21.15.55:0/166641614 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ffa040657a0 0x7ffa04067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.534 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.526+0000 7ffa1a7fc640 1 --2- 172.21.15.55:0/166641614 >> [v2:172.21.15.55:6800/1562339076,v1:172.21.15.55:6801/1562339076] conn(0x7ffa0406c210 0x7ffa0406e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.526+0000 7ffa1a7fc640 1 --2- 172.21.15.55:0/166641614 >> [v2:172.21.15.55:6800/1562339076,v1:172.21.15.55:6801/1562339076] conn(0x7ffa0406c210 0x7ffa0406e630 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:00.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.526+0000 7ffa22ffd640 1 --2- 172.21.15.55:0/166641614 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ffa040657a0 0x7ffa04067c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ffa140045f0 tx=0x7ffa14008040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:00.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.526+0000 7ffa1bfff640 1 -- 172.21.15.55:0/166641614 <== osd.1 v2:172.21.15.55:6800/1562339076 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ffa0406ece0 con 0x7ffa0406c210 2023-08-25T05:38:00.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.542+0000 7ffa29767640 1 -- 172.21.15.55:0/166641614 --> [v2:172.21.15.55:6800/1562339076,v1:172.21.15.55:6801/1562339076] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffa240c62b0 con 0x7ffa0406c210 2023-08-25T05:38:00.544 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.542+0000 7ffa1bfff640 1 -- 172.21.15.55:0/166641614 <== osd.1 v2:172.21.15.55:6800/1562339076 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ffa240c62b0 con 0x7ffa0406c210 2023-08-25T05:38:00.544 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T05:38:00.545 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-25T05:38:00.545 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T05:38:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.542+0000 7ffa29767640 1 -- 172.21.15.55:0/166641614 >> [v2:172.21.15.55:6800/1562339076,v1:172.21.15.55:6801/1562339076] conn(0x7ffa0406c210 msgr2=0x7ffa0406e630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.542+0000 7ffa29767640 1 --2- 172.21.15.55:0/166641614 >> [v2:172.21.15.55:6800/1562339076,v1:172.21.15.55:6801/1562339076] conn(0x7ffa0406c210 0x7ffa0406e630 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.542+0000 7ffa29767640 1 -- 172.21.15.55:0/166641614 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ffa040657a0 msgr2=0x7ffa04067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.542+0000 7ffa29767640 1 --2- 172.21.15.55:0/166641614 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ffa040657a0 0x7ffa04067c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ffa140045f0 tx=0x7ffa14008040 comp rx=0 tx=0).stop 2023-08-25T05:38:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.542+0000 7ffa29767640 1 -- 172.21.15.55:0/166641614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa24159d00 msgr2=0x7ffa240b2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.542+0000 7ffa29767640 1 --2- 172.21.15.55:0/166641614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa24159d00 0x7ffa240b2690 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c001570 tx=0x7ffa1c00cca0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.542+0000 7ffa237fe640 1 -- 172.21.15.55:0/166641614 reap_dead start 2023-08-25T05:38:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.542+0000 7ffa29767640 1 -- 172.21.15.55:0/166641614 shutdown_connections 2023-08-25T05:38:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.542+0000 7ffa29767640 1 -- 172.21.15.55:0/166641614 >> 172.21.15.55:0/166641614 conn(0x7ffa240caf90 msgr2=0x7ffa240ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.542+0000 7ffa29767640 1 -- 172.21.15.55:0/166641614 shutdown_connections 2023-08-25T05:38:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.542+0000 7ffa29767640 1 -- 172.21.15.55:0/166641614 wait complete. 2023-08-25T05:38:00.563 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-08-25T05:38:00.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.706+0000 7f5d29ae6640 1 Processor -- start 2023-08-25T05:38:00.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.706+0000 7f5d29ae6640 1 -- start start 2023-08-25T05:38:00.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.706+0000 7f5d29ae6640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d240aeb10 0x7f5d240ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.706+0000 7f5d29ae6640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5d240cee20 0x7f5d24069900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.706+0000 7f5d29ae6640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d240cf2b0 con 0x7f5d24069e40 2023-08-25T05:38:00.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.706+0000 7f5d29ae6640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d240d0380 con 0x7f5d240aeb10 2023-08-25T05:38:00.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.706+0000 7f5d29ae6640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d2406d590 con 0x7f5d240cee20 2023-08-25T05:38:00.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.706+0000 7f5d237fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d240aeb10 0x7f5d240ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.706+0000 7f5d23fff640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5d24069e40 0x7f5d24160520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37612/0 (socket says 172.21.15.55:37612) 2023-08-25T05:38:00.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.706+0000 7f5d23fff640 1 -- 172.21.15.55:0/2591325697 learned_addr learned my addr 172.21.15.55:0/2591325697 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:38:00.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.706+0000 7f5d1bfff640 1 --2- 172.21.15.55:0/2591325697 >> v2:172.21.15.110:3300/0 conn(0x7f5d240cee20 0x7f5d24069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.706+0000 7f5d237fe640 1 -- 172.21.15.55:0/2591325697 >> v2:172.21.15.110:3300/0 conn(0x7f5d240cee20 msgr2=0x7f5d24069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.706+0000 7f5d237fe640 1 --2- 172.21.15.55:0/2591325697 >> v2:172.21.15.110:3300/0 conn(0x7f5d240cee20 0x7f5d24069900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.706+0000 7f5d237fe640 1 -- 172.21.15.55:0/2591325697 >> v1:172.21.15.55:6789/0 conn(0x7f5d24069e40 legacy=0x7f5d24160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.706+0000 7f5d237fe640 1 -- 172.21.15.55:0/2591325697 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2406c4f0 con 0x7f5d240aeb10 2023-08-25T05:38:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.706+0000 7f5d1bfff640 1 --2- 172.21.15.55:0/2591325697 >> v2:172.21.15.110:3300/0 conn(0x7f5d240cee20 0x7f5d24069900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:38:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.706+0000 7f5d22ffd640 1 -- 172.21.15.55:0/2591325697 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115587970 0 0) 0x7f5d240cf2b0 con 0x7f5d24069e40 2023-08-25T05:38:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.710+0000 7f5d237fe640 1 --2- 172.21.15.55:0/2591325697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d240aeb10 0x7f5d240ce8e0 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f5d2406d6d0 tx=0x7f5d1401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7672ecf10c799268 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.710+0000 7f5d22ffd640 1 -- 172.21.15.55:0/2591325697 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d140ab600 con 0x7f5d240aeb10 2023-08-25T05:38:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.710+0000 7f5d22ffd640 1 -- 172.21.15.55:0/2591325697 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d140a7050 con 0x7f5d240aeb10 2023-08-25T05:38:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.710+0000 7f5d22ffd640 1 -- 172.21.15.55:0/2591325697 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d140ab980 con 0x7f5d240aeb10 2023-08-25T05:38:00.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.710+0000 7f5d29ae6640 1 -- 172.21.15.55:0/2591325697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d240aeb10 msgr2=0x7f5d240ce8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.710+0000 7f5d29ae6640 1 --2- 172.21.15.55:0/2591325697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d240aeb10 0x7f5d240ce8e0 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f5d2406d6d0 tx=0x7f5d1401c440 comp rx=0 tx=0).stop 2023-08-25T05:38:00.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.710+0000 7f5d29ae6640 1 -- 172.21.15.55:0/2591325697 shutdown_connections 2023-08-25T05:38:00.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.710+0000 7f5d29ae6640 1 --2- 172.21.15.55:0/2591325697 >> v2:172.21.15.110:3300/0 conn(0x7f5d240cee20 0x7f5d24069900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.710+0000 7f5d29ae6640 1 --2- 172.21.15.55:0/2591325697 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d240aeb10 0x7f5d240ce8e0 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.715 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.710+0000 7f5d29ae6640 1 -- 172.21.15.55:0/2591325697 >> 172.21.15.55:0/2591325697 conn(0x7f5d240cf530 msgr2=0x7f5d240cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:00.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.710+0000 7f5d29ae6640 1 -- 172.21.15.55:0/2591325697 shutdown_connections 2023-08-25T05:38:00.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.710+0000 7f5d29ae6640 1 -- 172.21.15.55:0/2591325697 wait complete. 2023-08-25T05:38:00.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.710+0000 7f5d29ae6640 1 Processor -- start 2023-08-25T05:38:00.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.710+0000 7f5d29ae6640 1 -- start start 2023-08-25T05:38:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d29ae6640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d24069e40 0x7f5d240b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d29ae6640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d240aeb10 0x7f5d240b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d29ae6640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d240cee20 0x7f5d240b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d29ae6640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2415a160 con 0x7f5d24069e40 2023-08-25T05:38:00.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d29ae6640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d240cb4e0 con 0x7f5d240aeb10 2023-08-25T05:38:00.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d29ae6640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d240cb780 con 0x7f5d240cee20 2023-08-25T05:38:00.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d237fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d24069e40 0x7f5d240b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d237fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d24069e40 0x7f5d240b2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42494/0 (socket says 172.21.15.55:42494) 2023-08-25T05:38:00.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d237fe640 1 -- 172.21.15.55:0/1991013869 learned_addr learned my addr 172.21.15.55:0/1991013869 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d1bfff640 1 --2- 172.21.15.55:0/1991013869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d240aeb10 0x7f5d240b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d23fff640 1 --2- 172.21.15.55:0/1991013869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d240cee20 0x7f5d240b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d237fe640 1 -- 172.21.15.55:0/1991013869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d240cee20 msgr2=0x7f5d240b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d237fe640 1 --2- 172.21.15.55:0/1991013869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d240cee20 0x7f5d240b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d237fe640 1 -- 172.21.15.55:0/1991013869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d240aeb10 msgr2=0x7f5d240b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d237fe640 1 --2- 172.21.15.55:0/1991013869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d240aeb10 0x7f5d240b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d237fe640 1 -- 172.21.15.55:0/1991013869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d14009420 con 0x7f5d24069e40 2023-08-25T05:38:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d23fff640 1 --2- 172.21.15.55:0/1991013869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d240cee20 0x7f5d240b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:38:00.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d237fe640 1 --2- 172.21.15.55:0/1991013869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d24069e40 0x7f5d240b2b30 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f5d140ae040 tx=0x7f5d140191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:00.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d20ff9640 1 -- 172.21.15.55:0/1991013869 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d140b4610 con 0x7f5d24069e40 2023-08-25T05:38:00.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d20ff9640 1 -- 172.21.15.55:0/1991013869 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d140b4770 con 0x7f5d24069e40 2023-08-25T05:38:00.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d29ae6640 1 -- 172.21.15.55:0/1991013869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d240cba60 con 0x7f5d24069e40 2023-08-25T05:38:00.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d20ff9640 1 -- 172.21.15.55:0/1991013869 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d140b4b20 con 0x7f5d24069e40 2023-08-25T05:38:00.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d29ae6640 1 -- 172.21.15.55:0/1991013869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d240cc020 con 0x7f5d24069e40 2023-08-25T05:38:00.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.714+0000 7f5d29ae6640 1 -- 172.21.15.55:0/1991013869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2404dbe0 con 0x7f5d24069e40 2023-08-25T05:38:00.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.718+0000 7f5d20ff9640 1 -- 172.21.15.55:0/1991013869 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f5d140b2040 con 0x7f5d24069e40 2023-08-25T05:38:00.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.718+0000 7f5d20ff9640 1 --2- 172.21.15.55:0/1991013869 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f5d040657a0 0x7f5d04067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:00.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.718+0000 7f5d20ff9640 1 -- 172.21.15.55:0/1991013869 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f5d1411d0c0 con 0x7f5d24069e40 2023-08-25T05:38:00.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.718+0000 7f5d1bfff640 1 --2- 172.21.15.55:0/1991013869 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f5d040657a0 0x7f5d04067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:00.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.718+0000 7f5d1bfff640 1 --2- 172.21.15.55:0/1991013869 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f5d040657a0 0x7f5d04067c60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d240ca8b0 tx=0x7f5d0c008040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:00.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.722+0000 7f5d20ff9640 1 -- 172.21.15.55:0/1991013869 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f5d140ea930 con 0x7f5d24069e40 2023-08-25T05:38:00.879 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.878+0000 7f5d29ae6640 1 -- 172.21.15.55:0/1991013869 --> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d2406d070 con 0x7f5d040657a0 2023-08-25T05:38:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.878+0000 7f5d20ff9640 1 -- 172.21.15.55:0/1991013869 <== mgr.9404 v2:172.21.15.110:6832/1527806048 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5d0c00c040 con 0x7f5d040657a0 2023-08-25T05:38:00.880 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 1 to deep-scrub 2023-08-25T05:38:00.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.878+0000 7f5d29ae6640 1 -- 172.21.15.55:0/1991013869 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f5d040657a0 msgr2=0x7f5d04067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.878+0000 7f5d29ae6640 1 --2- 172.21.15.55:0/1991013869 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f5d040657a0 0x7f5d04067c60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5d240ca8b0 tx=0x7f5d0c008040 comp rx=0 tx=0).stop 2023-08-25T05:38:00.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.878+0000 7f5d29ae6640 1 -- 172.21.15.55:0/1991013869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d24069e40 msgr2=0x7f5d240b2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:00.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.878+0000 7f5d29ae6640 1 --2- 172.21.15.55:0/1991013869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d24069e40 0x7f5d240b2b30 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f5d140ae040 tx=0x7f5d140191e0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.878+0000 7f5d29ae6640 1 -- 172.21.15.55:0/1991013869 shutdown_connections 2023-08-25T05:38:00.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.878+0000 7f5d29ae6640 1 --2- 172.21.15.55:0/1991013869 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f5d040657a0 0x7f5d04067c60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.883 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.878+0000 7f5d29ae6640 1 --2- 172.21.15.55:0/1991013869 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d240cee20 0x7f5d240b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.878+0000 7f5d29ae6640 1 --2- 172.21.15.55:0/1991013869 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d240aeb10 0x7f5d240b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.878+0000 7f5d29ae6640 1 --2- 172.21.15.55:0/1991013869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d24069e40 0x7f5d240b2b30 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:00.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.878+0000 7f5d29ae6640 1 -- 172.21.15.55:0/1991013869 >> 172.21.15.55:0/1991013869 conn(0x7f5d240cf530 msgr2=0x7f5d240ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:00.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.878+0000 7f5d29ae6640 1 -- 172.21.15.55:0/1991013869 shutdown_connections 2023-08-25T05:38:00.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:00.878+0000 7f5d29ae6640 1 -- 172.21.15.55:0/1991013869 wait complete. 2023-08-25T05:38:00.901 INFO:tasks.ceph:Scrubbing osd.2 2023-08-25T05:38:00.902 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-08-25T05:38:01.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.046+0000 7ff4f4d2c640 1 Processor -- start 2023-08-25T05:38:01.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.046+0000 7ff4f4d2c640 1 -- start start 2023-08-25T05:38:01.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.046+0000 7ff4f4d2c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4f00afa20 0x7ff4f00b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.046+0000 7ff4f4d2c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4f00cf9b0 0x7ff4f00ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.046+0000 7ff4f4d2c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff4f00cd160 0x7ff4f00cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.046+0000 7ff4f4d2c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f00cfe10 con 0x7ff4f00afa20 2023-08-25T05:38:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.046+0000 7ff4f4d2c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f00cdb00 con 0x7ff4f00cd160 2023-08-25T05:38:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.046+0000 7ff4f4d2c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00cae70 con 0x7ff4f00cf9b0 2023-08-25T05:38:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.046+0000 7ff4ee59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4f00afa20 0x7ff4f00b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.046+0000 7ff4ee59c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4f00afa20 0x7ff4f00b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42500/0 (socket says 172.21.15.55:42500) 2023-08-25T05:38:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.046+0000 7ff4ee59c640 1 -- 172.21.15.55:0/1033383827 learned_addr learned my addr 172.21.15.55:0/1033383827 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:01.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.046+0000 7ff4eed9d640 1 --2- 172.21.15.55:0/1033383827 >> v2:172.21.15.110:3300/0 conn(0x7ff4f00cd160 0x7ff4f00cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.046+0000 7ff4e5d9b640 1 --2- 172.21.15.55:0/1033383827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4f00cf9b0 0x7ff4f00ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.046+0000 7ff4ee59c640 1 -- 172.21.15.55:0/1033383827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4f00cf9b0 msgr2=0x7ff4f00ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:01.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.046+0000 7ff4ee59c640 1 --2- 172.21.15.55:0/1033383827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4f00cf9b0 0x7ff4f00ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.046+0000 7ff4ee59c640 1 -- 172.21.15.55:0/1033383827 >> v2:172.21.15.110:3300/0 conn(0x7ff4f00cd160 msgr2=0x7ff4f00cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:01.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.046+0000 7ff4ee59c640 1 --2- 172.21.15.55:0/1033383827 >> v2:172.21.15.110:3300/0 conn(0x7ff4f00cd160 0x7ff4f00cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.046+0000 7ff4ee59c640 1 -- 172.21.15.55:0/1033383827 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f00cb0e0 con 0x7ff4f00afa20 2023-08-25T05:38:01.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.050+0000 7ff4ee59c640 1 --2- 172.21.15.55:0/1033383827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f00afa20 0x7ff4f00b00e0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0160730 tx=0x7ff4e001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c1e31be345bea5 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:01.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.050+0000 7ff4edd9b640 1 -- 172.21.15.55:0/1033383827 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00ab600 con 0x7ff4f00afa20 2023-08-25T05:38:01.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.050+0000 7ff4edd9b640 1 -- 172.21.15.55:0/1033383827 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e00ab760 con 0x7ff4f00afa20 2023-08-25T05:38:01.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.050+0000 7ff4edd9b640 1 -- 172.21.15.55:0/1033383827 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e00abaf0 con 0x7ff4f00afa20 2023-08-25T05:38:01.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.050+0000 7ff4f4d2c640 1 -- 172.21.15.55:0/1033383827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f00afa20 msgr2=0x7ff4f00b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.050+0000 7ff4f4d2c640 1 --2- 172.21.15.55:0/1033383827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f00afa20 0x7ff4f00b00e0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0160730 tx=0x7ff4e001c440 comp rx=0 tx=0).stop 2023-08-25T05:38:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.050+0000 7ff4f4d2c640 1 -- 172.21.15.55:0/1033383827 shutdown_connections 2023-08-25T05:38:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.050+0000 7ff4f4d2c640 1 --2- 172.21.15.55:0/1033383827 >> v2:172.21.15.110:3300/0 conn(0x7ff4f00cd160 0x7ff4f00cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.050+0000 7ff4f4d2c640 1 --2- 172.21.15.55:0/1033383827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4f00cf9b0 0x7ff4f00ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.050+0000 7ff4f4d2c640 1 --2- 172.21.15.55:0/1033383827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f00afa20 0x7ff4f00b00e0 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.050+0000 7ff4f4d2c640 1 -- 172.21.15.55:0/1033383827 >> 172.21.15.55:0/1033383827 conn(0x7ff4f00d0780 msgr2=0x7ff4f00d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.050+0000 7ff4f4d2c640 1 -- 172.21.15.55:0/1033383827 shutdown_connections 2023-08-25T05:38:01.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.050+0000 7ff4f4d2c640 1 -- 172.21.15.55:0/1033383827 wait complete. 2023-08-25T05:38:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4f4d2c640 1 Processor -- start 2023-08-25T05:38:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4f4d2c640 1 -- start start 2023-08-25T05:38:01.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4f4d2c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4f00afa20 0x7ff4f00c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4f4d2c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4f00cd160 0x7ff4f014d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4f4d2c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f00cf9b0 0x7ff4f00c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4f4d2c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00c8e20 con 0x7ff4f00cf9b0 2023-08-25T05:38:01.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4f4d2c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00aeb70 con 0x7ff4f00afa20 2023-08-25T05:38:01.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4f4d2c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00ae5b0 con 0x7ff4f00cd160 2023-08-25T05:38:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4eed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f00cf9b0 0x7ff4f00c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4eed9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f00cf9b0 0x7ff4f00c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42504/0 (socket says 172.21.15.55:42504) 2023-08-25T05:38:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4eed9d640 1 -- 172.21.15.55:0/38310142 learned_addr learned my addr 172.21.15.55:0/38310142 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4ee59c640 1 --2- 172.21.15.55:0/38310142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4f00afa20 0x7ff4f00c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4e5d9b640 1 --2- 172.21.15.55:0/38310142 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4f00cd160 0x7ff4f014d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4eed9d640 1 -- 172.21.15.55:0/38310142 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4f00cd160 msgr2=0x7ff4f014d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4eed9d640 1 --2- 172.21.15.55:0/38310142 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4f00cd160 0x7ff4f014d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4eed9d640 1 -- 172.21.15.55:0/38310142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4f00afa20 msgr2=0x7ff4f00c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4eed9d640 1 --2- 172.21.15.55:0/38310142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4f00afa20 0x7ff4f00c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4eed9d640 1 -- 172.21.15.55:0/38310142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e00094d0 con 0x7ff4f00cf9b0 2023-08-25T05:38:01.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4ee59c640 1 --2- 172.21.15.55:0/38310142 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4f00afa20 0x7ff4f00c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:38:01.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4eed9d640 1 --2- 172.21.15.55:0/38310142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f00cf9b0 0x7ff4f00c7850 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8007d20 tx=0x7ff4e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:01.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4e77fe640 1 -- 172.21.15.55:0/38310142 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8014420 con 0x7ff4f00cf9b0 2023-08-25T05:38:01.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4e77fe640 1 -- 172.21.15.55:0/38310142 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e80145a0 con 0x7ff4f00cf9b0 2023-08-25T05:38:01.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4e77fe640 1 -- 172.21.15.55:0/38310142 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8014950 con 0x7ff4f00cf9b0 2023-08-25T05:38:01.063 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4f4d2c640 1 -- 172.21.15.55:0/38310142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f00ae890 con 0x7ff4f00cf9b0 2023-08-25T05:38:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4f4d2c640 1 -- 172.21.15.55:0/38310142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f0151e30 con 0x7ff4f00cf9b0 2023-08-25T05:38:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.054+0000 7ff4f4d2c640 1 -- 172.21.15.55:0/38310142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff4f00afe00 con 0x7ff4f00cf9b0 2023-08-25T05:38:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.058+0000 7ff4e77fe640 1 -- 172.21.15.55:0/38310142 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7ff4e8014ab0 con 0x7ff4f00cf9b0 2023-08-25T05:38:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.058+0000 7ff4e77fe640 1 --2- 172.21.15.55:0/38310142 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ff4d00657a0 0x7ff4d0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.058+0000 7ff4e77fe640 1 -- 172.21.15.55:0/38310142 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7ff4e80837f0 con 0x7ff4f00cf9b0 2023-08-25T05:38:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.058+0000 7ff4e77fe640 1 --2- 172.21.15.55:0/38310142 >> [v2:172.21.15.55:6808/3999551967,v1:172.21.15.55:6809/3999551967] conn(0x7ff4d006c210 0x7ff4d006e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.058+0000 7ff4e77fe640 1 -- 172.21.15.55:0/38310142 --> [v2:172.21.15.55:6808/3999551967,v1:172.21.15.55:6809/3999551967] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4d006ece0 con 0x7ff4d006c210 2023-08-25T05:38:01.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.058+0000 7ff4e77fe640 1 -- 172.21.15.55:0/38310142 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4e8085dd0 con 0x7ff4f00cf9b0 2023-08-25T05:38:01.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.058+0000 7ff4ee59c640 1 --2- 172.21.15.55:0/38310142 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ff4d00657a0 0x7ff4d0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.058+0000 7ff4e5d9b640 1 --2- 172.21.15.55:0/38310142 >> [v2:172.21.15.55:6808/3999551967,v1:172.21.15.55:6809/3999551967] conn(0x7ff4d006c210 0x7ff4d006e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.058+0000 7ff4e5d9b640 1 --2- 172.21.15.55:0/38310142 >> [v2:172.21.15.55:6808/3999551967,v1:172.21.15.55:6809/3999551967] conn(0x7ff4d006c210 0x7ff4d006e630 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:01.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.058+0000 7ff4ee59c640 1 --2- 172.21.15.55:0/38310142 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ff4d00657a0 0x7ff4d0067c60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00af000 tx=0x7ff4e00a7000 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:01.065 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.058+0000 7ff4e77fe640 1 -- 172.21.15.55:0/38310142 <== osd.2 v2:172.21.15.55:6808/3999551967 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff4d006ece0 con 0x7ff4d006c210 2023-08-25T05:38:01.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.074+0000 7ff4f4d2c640 1 -- 172.21.15.55:0/38310142 --> [v2:172.21.15.55:6808/3999551967,v1:172.21.15.55:6809/3999551967] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff4f00cb980 con 0x7ff4d006c210 2023-08-25T05:38:01.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.074+0000 7ff4e77fe640 1 -- 172.21.15.55:0/38310142 <== osd.2 v2:172.21.15.55:6808/3999551967 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff4d800ba60 con 0x7ff4d006c210 2023-08-25T05:38:01.076 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T05:38:01.076 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-25T05:38:01.076 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T05:38:01.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.074+0000 7ff4f4d2c640 1 -- 172.21.15.55:0/38310142 >> [v2:172.21.15.55:6808/3999551967,v1:172.21.15.55:6809/3999551967] conn(0x7ff4d006c210 msgr2=0x7ff4d006e630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.074+0000 7ff4f4d2c640 1 --2- 172.21.15.55:0/38310142 >> [v2:172.21.15.55:6808/3999551967,v1:172.21.15.55:6809/3999551967] conn(0x7ff4d006c210 0x7ff4d006e630 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.074+0000 7ff4f4d2c640 1 -- 172.21.15.55:0/38310142 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ff4d00657a0 msgr2=0x7ff4d0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.074+0000 7ff4f4d2c640 1 --2- 172.21.15.55:0/38310142 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ff4d00657a0 0x7ff4d0067c60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00af000 tx=0x7ff4e00a7000 comp rx=0 tx=0).stop 2023-08-25T05:38:01.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.074+0000 7ff4f4d2c640 1 -- 172.21.15.55:0/38310142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f00cf9b0 msgr2=0x7ff4f00c7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.074+0000 7ff4f4d2c640 1 --2- 172.21.15.55:0/38310142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4f00cf9b0 0x7ff4f00c7850 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8007d20 tx=0x7ff4e800e4b0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.074+0000 7ff4eed9d640 1 -- 172.21.15.55:0/38310142 reap_dead start 2023-08-25T05:38:01.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.074+0000 7ff4f4d2c640 1 -- 172.21.15.55:0/38310142 shutdown_connections 2023-08-25T05:38:01.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.074+0000 7ff4f4d2c640 1 -- 172.21.15.55:0/38310142 >> 172.21.15.55:0/38310142 conn(0x7ff4f00d0780 msgr2=0x7ff4f006a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:01.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.074+0000 7ff4f4d2c640 1 -- 172.21.15.55:0/38310142 shutdown_connections 2023-08-25T05:38:01.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.074+0000 7ff4f4d2c640 1 -- 172.21.15.55:0/38310142 wait complete. 2023-08-25T05:38:01.094 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-08-25T05:38:01.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.234+0000 7ff9a6110640 1 Processor -- start 2023-08-25T05:38:01.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.234+0000 7ff9a6110640 1 -- start start 2023-08-25T05:38:01.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.234+0000 7ff9a6110640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9a00ad950 0x7ff9a00cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.234+0000 7ff9a6110640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9a00ceeb0 0x7ff9a00b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.238+0000 7ff9a6110640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a00cc880 con 0x7ff9a00c89f0 2023-08-25T05:38:01.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.238+0000 7ff9a6110640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a00b11f0 con 0x7ff9a00ceeb0 2023-08-25T05:38:01.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.238+0000 7ff9a6110640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a0159d50 con 0x7ff9a00ad950 2023-08-25T05:38:01.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.238+0000 7ff99ffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff9a00ceeb0 0x7ff9a00b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.238+0000 7ff99effd640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff9a00c89f0 0x7ff9a00ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37624/0 (socket says 172.21.15.55:37624) 2023-08-25T05:38:01.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.238+0000 7ff99effd640 1 -- 172.21.15.55:0/3953019256 learned_addr learned my addr 172.21.15.55:0/3953019256 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:38:01.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.238+0000 7ff99f7fe640 1 --2- 172.21.15.55:0/3953019256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9a00ad950 0x7ff9a00cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.238+0000 7ff99ffff640 1 -- 172.21.15.55:0/3953019256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9a00ad950 msgr2=0x7ff9a00cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:01.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.238+0000 7ff99ffff640 1 --2- 172.21.15.55:0/3953019256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9a00ad950 0x7ff9a00cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.238+0000 7ff99ffff640 1 -- 172.21.15.55:0/3953019256 >> v1:172.21.15.55:6789/0 conn(0x7ff9a00c89f0 legacy=0x7ff9a00ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.238+0000 7ff99ffff640 1 -- 172.21.15.55:0/3953019256 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a00ccb60 con 0x7ff9a00ceeb0 2023-08-25T05:38:01.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.238+0000 7ff99e7fc640 1 -- 172.21.15.55:0/3953019256 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737517428 0 0) 0x7ff9a00cc880 con 0x7ff9a00c89f0 2023-08-25T05:38:01.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.238+0000 7ff99f7fe640 1 --2- 172.21.15.55:0/3953019256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9a00ad950 0x7ff9a00cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:38:01.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.238+0000 7ff99ffff640 1 --2- 172.21.15.55:0/3953019256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a00ceeb0 0x7ff9a00b1640 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7ff99800bfa0 tx=0x7ff99801ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eecdca57560b0ae2 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:01.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.238+0000 7ff99e7fc640 1 -- 172.21.15.55:0/3953019256 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99800b2d0 con 0x7ff9a00ceeb0 2023-08-25T05:38:01.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.238+0000 7ff99e7fc640 1 -- 172.21.15.55:0/3953019256 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9980a7870 con 0x7ff9a00ceeb0 2023-08-25T05:38:01.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.238+0000 7ff99e7fc640 1 -- 172.21.15.55:0/3953019256 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980a7c00 con 0x7ff9a00ceeb0 2023-08-25T05:38:01.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff9a6110640 1 -- 172.21.15.55:0/3953019256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a00ceeb0 msgr2=0x7ff9a00b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff9a6110640 1 --2- 172.21.15.55:0/3953019256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a00ceeb0 0x7ff9a00b1640 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7ff99800bfa0 tx=0x7ff99801ea90 comp rx=0 tx=0).stop 2023-08-25T05:38:01.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff9a6110640 1 -- 172.21.15.55:0/3953019256 shutdown_connections 2023-08-25T05:38:01.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff9a6110640 1 --2- 172.21.15.55:0/3953019256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a00ceeb0 0x7ff9a00b1640 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff9a6110640 1 --2- 172.21.15.55:0/3953019256 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9a00ad950 0x7ff9a00cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff9a6110640 1 -- 172.21.15.55:0/3953019256 >> 172.21.15.55:0/3953019256 conn(0x7ff9a0069d00 msgr2=0x7ff9a006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:01.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff9a6110640 1 -- 172.21.15.55:0/3953019256 shutdown_connections 2023-08-25T05:38:01.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff9a6110640 1 -- 172.21.15.55:0/3953019256 wait complete. 2023-08-25T05:38:01.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff9a6110640 1 Processor -- start 2023-08-25T05:38:01.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff9a6110640 1 -- start start 2023-08-25T05:38:01.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff9a6110640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a00ad950 0x7ff9a0070190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff9a6110640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9a00c89f0 0x7ff9a00c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff9a6110640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a00ceeb0 0x7ff9a00c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff9a6110640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a00b0d30 con 0x7ff9a00ad950 2023-08-25T05:38:01.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff9a6110640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a00ae080 con 0x7ff9a00ceeb0 2023-08-25T05:38:01.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff9a6110640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a00b0490 con 0x7ff9a00c89f0 2023-08-25T05:38:01.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff99f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a00ad950 0x7ff9a0070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff99f7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a00ad950 0x7ff9a0070190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42524/0 (socket says 172.21.15.55:42524) 2023-08-25T05:38:01.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.242+0000 7ff99f7fe640 1 -- 172.21.15.55:0/609484390 learned_addr learned my addr 172.21.15.55:0/609484390 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff99effd640 1 --2- 172.21.15.55:0/609484390 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9a00c89f0 0x7ff9a00c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff99ffff640 1 --2- 172.21.15.55:0/609484390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a00ceeb0 0x7ff9a00c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff99f7fe640 1 -- 172.21.15.55:0/609484390 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9a00c89f0 msgr2=0x7ff9a00c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff99f7fe640 1 --2- 172.21.15.55:0/609484390 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9a00c89f0 0x7ff9a00c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff99f7fe640 1 -- 172.21.15.55:0/609484390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a00ceeb0 msgr2=0x7ff9a00c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff99f7fe640 1 --2- 172.21.15.55:0/609484390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a00ceeb0 0x7ff9a00c4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff99f7fe640 1 -- 172.21.15.55:0/609484390 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99800bc80 con 0x7ff9a00ad950 2023-08-25T05:38:01.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff99ffff640 1 --2- 172.21.15.55:0/609484390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a00ceeb0 0x7ff9a00c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:38:01.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff99f7fe640 1 --2- 172.21.15.55:0/609484390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a00ad950 0x7ff9a0070190 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7ff99000d800 tx=0x7ff99000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:01.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff987fff640 1 -- 172.21.15.55:0/609484390 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9900096c0 con 0x7ff9a00ad950 2023-08-25T05:38:01.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff987fff640 1 -- 172.21.15.55:0/609484390 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff990009820 con 0x7ff9a00ad950 2023-08-25T05:38:01.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff987fff640 1 -- 172.21.15.55:0/609484390 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990009bd0 con 0x7ff9a00ad950 2023-08-25T05:38:01.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff9a6110640 1 -- 172.21.15.55:0/609484390 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a00b0770 con 0x7ff9a00ad950 2023-08-25T05:38:01.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff9a6110640 1 -- 172.21.15.55:0/609484390 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a015a3d0 con 0x7ff9a00ad950 2023-08-25T05:38:01.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff9a6110640 1 -- 172.21.15.55:0/609484390 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a015a590 con 0x7ff9a00ad950 2023-08-25T05:38:01.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff987fff640 1 -- 172.21.15.55:0/609484390 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7ff990009d30 con 0x7ff9a00ad950 2023-08-25T05:38:01.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff987fff640 1 --2- 172.21.15.55:0/609484390 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ff98c0657a0 0x7ff98c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff987fff640 1 -- 172.21.15.55:0/609484390 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7ff990083740 con 0x7ff9a00ad950 2023-08-25T05:38:01.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.246+0000 7ff99effd640 1 --2- 172.21.15.55:0/609484390 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ff98c0657a0 0x7ff98c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.250+0000 7ff99effd640 1 --2- 172.21.15.55:0/609484390 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ff98c0657a0 0x7ff98c067c60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff9a015cf20 tx=0x7ff994007c10 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:01.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.250+0000 7ff987fff640 1 -- 172.21.15.55:0/609484390 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff9900510c0 con 0x7ff9a00ad950 2023-08-25T05:38:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.410+0000 7ff9a6110640 1 -- 172.21.15.55:0/609484390 --> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9a00b3130 con 0x7ff98c0657a0 2023-08-25T05:38:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.410+0000 7ff987fff640 1 -- 172.21.15.55:0/609484390 <== mgr.9404 v2:172.21.15.110:6832/1527806048 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff994007da0 con 0x7ff98c0657a0 2023-08-25T05:38:01.413 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 2 to deep-scrub 2023-08-25T05:38:01.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.410+0000 7ff9a6110640 1 -- 172.21.15.55:0/609484390 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ff98c0657a0 msgr2=0x7ff98c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.410+0000 7ff9a6110640 1 --2- 172.21.15.55:0/609484390 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ff98c0657a0 0x7ff98c067c60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff9a015cf20 tx=0x7ff994007c10 comp rx=0 tx=0).stop 2023-08-25T05:38:01.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.410+0000 7ff9a6110640 1 -- 172.21.15.55:0/609484390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a00ad950 msgr2=0x7ff9a0070190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.410+0000 7ff9a6110640 1 --2- 172.21.15.55:0/609484390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a00ad950 0x7ff9a0070190 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7ff99000d800 tx=0x7ff99000dcc0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.410+0000 7ff9a6110640 1 -- 172.21.15.55:0/609484390 shutdown_connections 2023-08-25T05:38:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.410+0000 7ff9a6110640 1 --2- 172.21.15.55:0/609484390 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ff98c0657a0 0x7ff98c067c60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.410+0000 7ff9a6110640 1 --2- 172.21.15.55:0/609484390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9a00ceeb0 0x7ff9a00c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.410+0000 7ff9a6110640 1 --2- 172.21.15.55:0/609484390 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9a00c89f0 0x7ff9a00c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.410+0000 7ff9a6110640 1 --2- 172.21.15.55:0/609484390 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff9a00ad950 0x7ff9a0070190 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.410+0000 7ff9a6110640 1 -- 172.21.15.55:0/609484390 >> 172.21.15.55:0/609484390 conn(0x7ff9a0069d00 msgr2=0x7ff9a006a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:01.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.410+0000 7ff9a6110640 1 -- 172.21.15.55:0/609484390 shutdown_connections 2023-08-25T05:38:01.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.410+0000 7ff9a6110640 1 -- 172.21.15.55:0/609484390 wait complete. 2023-08-25T05:38:01.434 INFO:tasks.ceph:Scrubbing osd.3 2023-08-25T05:38:01.434 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-08-25T05:38:01.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.578+0000 7fba6d7fa640 1 Processor -- start 2023-08-25T05:38:01.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.578+0000 7fba6d7fa640 1 -- start start 2023-08-25T05:38:01.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.578+0000 7fba6d7fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba68159d00 0x7fba680cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.578+0000 7fba6d7fa640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba6806fb50 0x7fba680c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.578+0000 7fba6d7fa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fba680cc930 0x7fba680ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.578+0000 7fba6d7fa640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba680cc510 con 0x7fba6806fb50 2023-08-25T05:38:01.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.578+0000 7fba6d7fa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba680ce220 con 0x7fba680cc930 2023-08-25T05:38:01.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.578+0000 7fba6d7fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba680ca6c0 con 0x7fba68159d00 2023-08-25T05:38:01.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.578+0000 7fba667fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba6806fb50 0x7fba680c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.578+0000 7fba667fc640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba6806fb50 0x7fba680c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42526/0 (socket says 172.21.15.55:42526) 2023-08-25T05:38:01.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.578+0000 7fba667fc640 1 -- 172.21.15.55:0/350282048 learned_addr learned my addr 172.21.15.55:0/350282048 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:01.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.578+0000 7fba677fe640 1 --2- 172.21.15.55:0/350282048 >> v2:172.21.15.110:3300/0 conn(0x7fba680cc930 0x7fba680ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.578+0000 7fba66ffd640 1 --2- 172.21.15.55:0/350282048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba68159d00 0x7fba680cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.578+0000 7fba667fc640 1 -- 172.21.15.55:0/350282048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba68159d00 msgr2=0x7fba680cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:01.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.578+0000 7fba667fc640 1 --2- 172.21.15.55:0/350282048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba68159d00 0x7fba680cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.578+0000 7fba667fc640 1 -- 172.21.15.55:0/350282048 >> v2:172.21.15.110:3300/0 conn(0x7fba680cc930 msgr2=0x7fba680ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.578+0000 7fba667fc640 1 --2- 172.21.15.55:0/350282048 >> v2:172.21.15.110:3300/0 conn(0x7fba680cc930 0x7fba680ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.582+0000 7fba667fc640 1 -- 172.21.15.55:0/350282048 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba680ca9a0 con 0x7fba6806fb50 2023-08-25T05:38:01.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.582+0000 7fba667fc640 1 --2- 172.21.15.55:0/350282048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba6806fb50 0x7fba680c8b60 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7fba680cbd30 tx=0x7fba5c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719fe2b5a93c25d server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:01.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.582+0000 7fba65ffb640 1 -- 172.21.15.55:0/350282048 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c0ab620 con 0x7fba6806fb50 2023-08-25T05:38:01.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.582+0000 7fba65ffb640 1 -- 172.21.15.55:0/350282048 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c0ab780 con 0x7fba6806fb50 2023-08-25T05:38:01.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.582+0000 7fba65ffb640 1 -- 172.21.15.55:0/350282048 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5c0abb10 con 0x7fba6806fb50 2023-08-25T05:38:01.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.582+0000 7fba6d7fa640 1 -- 172.21.15.55:0/350282048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba6806fb50 msgr2=0x7fba680c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.582+0000 7fba6d7fa640 1 --2- 172.21.15.55:0/350282048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba6806fb50 0x7fba680c8b60 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7fba680cbd30 tx=0x7fba5c01c440 comp rx=0 tx=0).stop 2023-08-25T05:38:01.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.582+0000 7fba6d7fa640 1 -- 172.21.15.55:0/350282048 shutdown_connections 2023-08-25T05:38:01.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.582+0000 7fba6d7fa640 1 --2- 172.21.15.55:0/350282048 >> v2:172.21.15.110:3300/0 conn(0x7fba680cc930 0x7fba680ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.582+0000 7fba6d7fa640 1 --2- 172.21.15.55:0/350282048 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba6806fb50 0x7fba680c8b60 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.582+0000 7fba6d7fa640 1 --2- 172.21.15.55:0/350282048 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba68159d00 0x7fba680cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.582+0000 7fba6d7fa640 1 -- 172.21.15.55:0/350282048 >> 172.21.15.55:0/350282048 conn(0x7fba680caf90 msgr2=0x7fba680cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:01.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.582+0000 7fba6d7fa640 1 -- 172.21.15.55:0/350282048 shutdown_connections 2023-08-25T05:38:01.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba6d7fa640 1 -- 172.21.15.55:0/350282048 wait complete. 2023-08-25T05:38:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba6d7fa640 1 Processor -- start 2023-08-25T05:38:01.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba6d7fa640 1 -- start start 2023-08-25T05:38:01.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba6d7fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba6806fb50 0x7fba6814fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba6d7fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba680cc930 0x7fba681514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba6d7fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba68159d00 0x7fba68162d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba6d7fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba681554d0 con 0x7fba6806fb50 2023-08-25T05:38:01.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba6d7fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba681527f0 con 0x7fba680cc930 2023-08-25T05:38:01.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba6d7fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba68155790 con 0x7fba68159d00 2023-08-25T05:38:01.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba66ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba6806fb50 0x7fba6814fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba66ffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba6806fb50 0x7fba6814fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42530/0 (socket says 172.21.15.55:42530) 2023-08-25T05:38:01.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba66ffd640 1 -- 172.21.15.55:0/2538589551 learned_addr learned my addr 172.21.15.55:0/2538589551 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:01.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba667fc640 1 --2- 172.21.15.55:0/2538589551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba680cc930 0x7fba681514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba677fe640 1 --2- 172.21.15.55:0/2538589551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba68159d00 0x7fba68162d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba66ffd640 1 -- 172.21.15.55:0/2538589551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba68159d00 msgr2=0x7fba68162d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba66ffd640 1 --2- 172.21.15.55:0/2538589551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba68159d00 0x7fba68162d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba66ffd640 1 -- 172.21.15.55:0/2538589551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba680cc930 msgr2=0x7fba681514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba66ffd640 1 --2- 172.21.15.55:0/2538589551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fba680cc930 0x7fba681514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba66ffd640 1 -- 172.21.15.55:0/2538589551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c0094d0 con 0x7fba6806fb50 2023-08-25T05:38:01.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba677fe640 1 --2- 172.21.15.55:0/2538589551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fba68159d00 0x7fba68162d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:38:01.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.586+0000 7fba66ffd640 1 --2- 172.21.15.55:0/2538589551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba6806fb50 0x7fba6814fab0 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7fba5800e8a0 tx=0x7fba5800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:01.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.590+0000 7fba4f7fe640 1 -- 172.21.15.55:0/2538589551 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba58009510 con 0x7fba6806fb50 2023-08-25T05:38:01.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.590+0000 7fba4f7fe640 1 -- 172.21.15.55:0/2538589551 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5800c940 con 0x7fba6806fb50 2023-08-25T05:38:01.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.590+0000 7fba4f7fe640 1 -- 172.21.15.55:0/2538589551 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5800ccb0 con 0x7fba6806fb50 2023-08-25T05:38:01.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.590+0000 7fba6d7fa640 1 -- 172.21.15.55:0/2538589551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba68151f50 con 0x7fba6806fb50 2023-08-25T05:38:01.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.590+0000 7fba6d7fa640 1 -- 172.21.15.55:0/2538589551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba68152510 con 0x7fba6806fb50 2023-08-25T05:38:01.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.590+0000 7fba6d7fa640 1 -- 172.21.15.55:0/2538589551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fba680cd770 con 0x7fba6806fb50 2023-08-25T05:38:01.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.590+0000 7fba4f7fe640 1 -- 172.21.15.55:0/2538589551 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fba58013470 con 0x7fba6806fb50 2023-08-25T05:38:01.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.590+0000 7fba4f7fe640 1 --2- 172.21.15.55:0/2538589551 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fba540657d0 0x7fba54067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.590+0000 7fba4f7fe640 1 -- 172.21.15.55:0/2538589551 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fba58082fa0 con 0x7fba6806fb50 2023-08-25T05:38:01.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.590+0000 7fba4f7fe640 1 --2- 172.21.15.55:0/2538589551 >> [v2:172.21.15.55:6816/2251401738,v1:172.21.15.55:6817/2251401738] conn(0x7fba5406c240 0x7fba5406e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.590+0000 7fba4f7fe640 1 -- 172.21.15.55:0/2538589551 --> [v2:172.21.15.55:6816/2251401738,v1:172.21.15.55:6817/2251401738] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba5406ed10 con 0x7fba5406c240 2023-08-25T05:38:01.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.590+0000 7fba4f7fe640 1 -- 172.21.15.55:0/2538589551 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba58085580 con 0x7fba6806fb50 2023-08-25T05:38:01.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.590+0000 7fba667fc640 1 --2- 172.21.15.55:0/2538589551 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fba540657d0 0x7fba54067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.590+0000 7fba677fe640 1 --2- 172.21.15.55:0/2538589551 >> [v2:172.21.15.55:6816/2251401738,v1:172.21.15.55:6817/2251401738] conn(0x7fba5406c240 0x7fba5406e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.594+0000 7fba677fe640 1 --2- 172.21.15.55:0/2538589551 >> [v2:172.21.15.55:6816/2251401738,v1:172.21.15.55:6817/2251401738] conn(0x7fba5406c240 0x7fba5406e660 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:01.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.594+0000 7fba667fc640 1 --2- 172.21.15.55:0/2538589551 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fba540657d0 0x7fba54067c90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0af000 tx=0x7fba5c0b6040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:01.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.594+0000 7fba4f7fe640 1 -- 172.21.15.55:0/2538589551 <== osd.3 v2:172.21.15.55:6816/2251401738 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fba5406ed10 con 0x7fba5406c240 2023-08-25T05:38:01.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.606+0000 7fba6d7fa640 1 -- 172.21.15.55:0/2538589551 --> [v2:172.21.15.55:6816/2251401738,v1:172.21.15.55:6817/2251401738] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fba6815a0e0 con 0x7fba5406c240 2023-08-25T05:38:01.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.606+0000 7fba4f7fe640 1 -- 172.21.15.55:0/2538589551 <== osd.3 v2:172.21.15.55:6816/2251401738 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fba60007680 con 0x7fba5406c240 2023-08-25T05:38:01.609 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T05:38:01.610 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-25T05:38:01.610 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T05:38:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.606+0000 7fba6d7fa640 1 -- 172.21.15.55:0/2538589551 >> [v2:172.21.15.55:6816/2251401738,v1:172.21.15.55:6817/2251401738] conn(0x7fba5406c240 msgr2=0x7fba5406e660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.606+0000 7fba6d7fa640 1 --2- 172.21.15.55:0/2538589551 >> [v2:172.21.15.55:6816/2251401738,v1:172.21.15.55:6817/2251401738] conn(0x7fba5406c240 0x7fba5406e660 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.606+0000 7fba6d7fa640 1 -- 172.21.15.55:0/2538589551 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fba540657d0 msgr2=0x7fba54067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.606+0000 7fba6d7fa640 1 --2- 172.21.15.55:0/2538589551 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fba540657d0 0x7fba54067c90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0af000 tx=0x7fba5c0b6040 comp rx=0 tx=0).stop 2023-08-25T05:38:01.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.606+0000 7fba6d7fa640 1 -- 172.21.15.55:0/2538589551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba6806fb50 msgr2=0x7fba6814fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.606+0000 7fba6d7fa640 1 --2- 172.21.15.55:0/2538589551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba6806fb50 0x7fba6814fab0 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7fba5800e8a0 tx=0x7fba5800eca0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.606+0000 7fba677fe640 1 -- 172.21.15.55:0/2538589551 reap_dead start 2023-08-25T05:38:01.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.606+0000 7fba6d7fa640 1 -- 172.21.15.55:0/2538589551 shutdown_connections 2023-08-25T05:38:01.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.606+0000 7fba6d7fa640 1 -- 172.21.15.55:0/2538589551 >> 172.21.15.55:0/2538589551 conn(0x7fba680caf90 msgr2=0x7fba68069900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:01.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.606+0000 7fba6d7fa640 1 -- 172.21.15.55:0/2538589551 shutdown_connections 2023-08-25T05:38:01.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.606+0000 7fba6d7fa640 1 -- 172.21.15.55:0/2538589551 wait complete. 2023-08-25T05:38:01.627 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-08-25T05:38:01.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.770+0000 7f01d0c9e640 1 Processor -- start 2023-08-25T05:38:01.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.770+0000 7f01d0c9e640 1 -- start start 2023-08-25T05:38:01.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.774+0000 7f01d0c9e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01cc0cdde0 0x7f01cc0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.774+0000 7f01d0c9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01cc0b2e40 0x7f01cc0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.774+0000 7f01d0c9e640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01cc0b29b0 con 0x7f01cc0d0da0 2023-08-25T05:38:01.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.774+0000 7f01d0c9e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01cc0ce760 con 0x7f01cc0cdde0 2023-08-25T05:38:01.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.774+0000 7f01d0c9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0b1dc0 con 0x7f01cc0b2e40 2023-08-25T05:38:01.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.774+0000 7f01ca59c640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f01cc0d0da0 0x7f01cc0d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37628/0 (socket says 172.21.15.55:37628) 2023-08-25T05:38:01.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.774+0000 7f01ca59c640 1 -- 172.21.15.55:0/3583845812 learned_addr learned my addr 172.21.15.55:0/3583845812 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:38:01.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.774+0000 7f01c3fff640 1 --2- 172.21.15.55:0/3583845812 >> v2:172.21.15.55:3300/0 conn(0x7f01cc0cdde0 0x7f01cc0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.774+0000 7f01cad9d640 1 --2- 172.21.15.55:0/3583845812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01cc0b2e40 0x7f01cc0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.774+0000 7f01c9d9b640 1 -- 172.21.15.55:0/3583845812 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533569512 0 0) 0x7f01cc0b29b0 con 0x7f01cc0d0da0 2023-08-25T05:38:01.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.774+0000 7f01c9d9b640 1 -- 172.21.15.55:0/3583845812 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01b8003530 con 0x7f01cc0d0da0 2023-08-25T05:38:01.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.774+0000 7f01c3fff640 1 -- 172.21.15.55:0/3583845812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01cc0b2e40 msgr2=0x7f01cc0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:01.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.774+0000 7f01c3fff640 1 --2- 172.21.15.55:0/3583845812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01cc0b2e40 0x7f01cc0b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.774+0000 7f01c3fff640 1 -- 172.21.15.55:0/3583845812 >> v1:172.21.15.55:6789/0 conn(0x7f01cc0d0da0 legacy=0x7f01cc0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.774+0000 7f01c3fff640 1 -- 172.21.15.55:0/3583845812 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc0b2080 con 0x7f01cc0cdde0 2023-08-25T05:38:01.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.774+0000 7f01cad9d640 1 --2- 172.21.15.55:0/3583845812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01cc0b2e40 0x7f01cc0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:38:01.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.778+0000 7f01c3fff640 1 --2- 172.21.15.55:0/3583845812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01cc0cdde0 0x7f01cc0ce220 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f01b40097c0 tx=0x7f01b401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3085139f9f82ffac server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:01.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.778+0000 7f01c9d9b640 1 -- 172.21.15.55:0/3583845812 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b40a8970 con 0x7f01cc0cdde0 2023-08-25T05:38:01.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.778+0000 7f01c9d9b640 1 -- 172.21.15.55:0/3583845812 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b40a8ad0 con 0x7f01cc0cdde0 2023-08-25T05:38:01.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.778+0000 7f01c9d9b640 1 -- 172.21.15.55:0/3583845812 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b40a8e40 con 0x7f01cc0cdde0 2023-08-25T05:38:01.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.778+0000 7f01d0c9e640 1 -- 172.21.15.55:0/3583845812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01cc0cdde0 msgr2=0x7f01cc0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.778+0000 7f01d0c9e640 1 --2- 172.21.15.55:0/3583845812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01cc0cdde0 0x7f01cc0ce220 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f01b40097c0 tx=0x7f01b401ec70 comp rx=0 tx=0).stop 2023-08-25T05:38:01.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.778+0000 7f01d0c9e640 1 -- 172.21.15.55:0/3583845812 shutdown_connections 2023-08-25T05:38:01.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.778+0000 7f01d0c9e640 1 --2- 172.21.15.55:0/3583845812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01cc0b2e40 0x7f01cc0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.778+0000 7f01d0c9e640 1 --2- 172.21.15.55:0/3583845812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01cc0cdde0 0x7f01cc0ce220 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.778+0000 7f01d0c9e640 1 -- 172.21.15.55:0/3583845812 >> 172.21.15.55:0/3583845812 conn(0x7f01cc09bae0 msgr2=0x7f01cc0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:01.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.778+0000 7f01d0c9e640 1 -- 172.21.15.55:0/3583845812 shutdown_connections 2023-08-25T05:38:01.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.778+0000 7f01d0c9e640 1 -- 172.21.15.55:0/3583845812 wait complete. 2023-08-25T05:38:01.782 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.778+0000 7f01d0c9e640 1 Processor -- start 2023-08-25T05:38:01.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.778+0000 7f01d0c9e640 1 -- start start 2023-08-25T05:38:01.783 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01d0c9e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01cc0b2e40 0x7f01cc151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01d0c9e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01cc0cdde0 0x7f01cc0cef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01d0c9e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01cc0d0da0 0x7f01cc0cf450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01d0c9e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0ca8e0 con 0x7f01cc0d0da0 2023-08-25T05:38:01.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01d0c9e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc151f50 con 0x7f01cc0b2e40 2023-08-25T05:38:01.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01d0c9e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01cc0c8370 con 0x7f01cc0cdde0 2023-08-25T05:38:01.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01cad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01cc0d0da0 0x7f01cc0cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01cad9d640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01cc0d0da0 0x7f01cc0cf450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42534/0 (socket says 172.21.15.55:42534) 2023-08-25T05:38:01.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01cad9d640 1 -- 172.21.15.55:0/299575364 learned_addr learned my addr 172.21.15.55:0/299575364 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:01.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01ca59c640 1 --2- 172.21.15.55:0/299575364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01cc0b2e40 0x7f01cc151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01c3fff640 1 --2- 172.21.15.55:0/299575364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01cc0cdde0 0x7f01cc0cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01cad9d640 1 -- 172.21.15.55:0/299575364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01cc0cdde0 msgr2=0x7f01cc0cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01cad9d640 1 --2- 172.21.15.55:0/299575364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01cc0cdde0 0x7f01cc0cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01cad9d640 1 -- 172.21.15.55:0/299575364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01cc0b2e40 msgr2=0x7f01cc151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01cad9d640 1 --2- 172.21.15.55:0/299575364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01cc0b2e40 0x7f01cc151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01cad9d640 1 -- 172.21.15.55:0/299575364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b4009420 con 0x7f01cc0d0da0 2023-08-25T05:38:01.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01cad9d640 1 --2- 172.21.15.55:0/299575364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01cc0d0da0 0x7f01cc0cf450 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f01c4007ef0 tx=0x7f01c400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:01.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01c2ffd640 1 -- 172.21.15.55:0/299575364 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4003ba0 con 0x7f01cc0d0da0 2023-08-25T05:38:01.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01c2ffd640 1 -- 172.21.15.55:0/299575364 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c400f040 con 0x7f01cc0d0da0 2023-08-25T05:38:01.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01c2ffd640 1 -- 172.21.15.55:0/299575364 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c400de80 con 0x7f01cc0d0da0 2023-08-25T05:38:01.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01d0c9e640 1 -- 172.21.15.55:0/299575364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01cc0cab30 con 0x7f01cc0d0da0 2023-08-25T05:38:01.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01d0c9e640 1 -- 172.21.15.55:0/299575364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01cc0cb0f0 con 0x7f01cc0d0da0 2023-08-25T05:38:01.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01d0c9e640 1 -- 172.21.15.55:0/299575364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01cc04dbe0 con 0x7f01cc0d0da0 2023-08-25T05:38:01.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.782+0000 7f01c2ffd640 1 -- 172.21.15.55:0/299575364 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f01c4004030 con 0x7f01cc0d0da0 2023-08-25T05:38:01.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.786+0000 7f01c2ffd640 1 --2- 172.21.15.55:0/299575364 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f01ac0657a0 0x7f01ac067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:01.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.786+0000 7f01c2ffd640 1 -- 172.21.15.55:0/299575364 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f01c40833a0 con 0x7f01cc0d0da0 2023-08-25T05:38:01.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.786+0000 7f01ca59c640 1 --2- 172.21.15.55:0/299575364 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f01ac0657a0 0x7f01ac067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:01.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.786+0000 7f01ca59c640 1 --2- 172.21.15.55:0/299575364 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f01ac0657a0 0x7f01ac067c60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f01bc001370 tx=0x7f01bc009040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:01.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.790+0000 7f01c2ffd640 1 -- 172.21.15.55:0/299575364 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f01c4050c30 con 0x7f01cc0d0da0 2023-08-25T05:38:01.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.942+0000 7f01d0c9e640 1 -- 172.21.15.55:0/299575364 --> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f01cc0b2640 con 0x7f01ac0657a0 2023-08-25T05:38:01.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.946+0000 7f01c2ffd640 1 -- 172.21.15.55:0/299575364 <== mgr.9404 v2:172.21.15.110:6832/1527806048 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f01bc007e60 con 0x7f01ac0657a0 2023-08-25T05:38:01.948 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 3 to deep-scrub 2023-08-25T05:38:01.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.946+0000 7f01d0c9e640 1 -- 172.21.15.55:0/299575364 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f01ac0657a0 msgr2=0x7f01ac067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.946+0000 7f01d0c9e640 1 --2- 172.21.15.55:0/299575364 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f01ac0657a0 0x7f01ac067c60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f01bc001370 tx=0x7f01bc009040 comp rx=0 tx=0).stop 2023-08-25T05:38:01.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.946+0000 7f01d0c9e640 1 -- 172.21.15.55:0/299575364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01cc0d0da0 msgr2=0x7f01cc0cf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:01.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.946+0000 7f01d0c9e640 1 --2- 172.21.15.55:0/299575364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01cc0d0da0 0x7f01cc0cf450 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f01c4007ef0 tx=0x7f01c400d4a0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.946+0000 7f01d0c9e640 1 -- 172.21.15.55:0/299575364 shutdown_connections 2023-08-25T05:38:01.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.946+0000 7f01d0c9e640 1 --2- 172.21.15.55:0/299575364 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f01ac0657a0 0x7f01ac067c60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.946+0000 7f01d0c9e640 1 --2- 172.21.15.55:0/299575364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01cc0d0da0 0x7f01cc0cf450 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.946+0000 7f01d0c9e640 1 --2- 172.21.15.55:0/299575364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01cc0cdde0 0x7f01cc0cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.946+0000 7f01d0c9e640 1 --2- 172.21.15.55:0/299575364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01cc0b2e40 0x7f01cc151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:01.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.946+0000 7f01d0c9e640 1 -- 172.21.15.55:0/299575364 >> 172.21.15.55:0/299575364 conn(0x7f01cc09bae0 msgr2=0x7f01cc06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:01.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.946+0000 7f01d0c9e640 1 -- 172.21.15.55:0/299575364 shutdown_connections 2023-08-25T05:38:01.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:01.946+0000 7f01d0c9e640 1 -- 172.21.15.55:0/299575364 wait complete. 2023-08-25T05:38:01.969 INFO:tasks.ceph:Scrubbing osd.4 2023-08-25T05:38:01.969 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-08-25T05:38:02.116 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.114+0000 7efe7a9fa640 1 Processor -- start 2023-08-25T05:38:02.117 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.114+0000 7efe7a9fa640 1 -- start start 2023-08-25T05:38:02.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.114+0000 7efe7a9fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe74069900 0x7efe74161070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.114+0000 7efe7a9fa640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efe74071500 0x7efe740c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.114+0000 7efe7a9fa640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe74069d60 con 0x7efe7406e690 2023-08-25T05:38:02.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.114+0000 7efe7a9fa640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7406b370 con 0x7efe74071500 2023-08-25T05:38:02.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.114+0000 7efe7a9fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe74071070 con 0x7efe74069900 2023-08-25T05:38:02.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.114+0000 7efe73fff640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7efe7406e690 0x7efe7406ea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.55:51170/0 (socket says 172.21.15.55:51170) 2023-08-25T05:38:02.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.114+0000 7efe737fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe74069900 0x7efe74161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.114+0000 7efe73fff640 1 -- 172.21.15.55:0/4283036987 learned_addr learned my addr 172.21.15.55:0/4283036987 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:38:02.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.114+0000 7efe78f97640 1 --2- 172.21.15.55:0/4283036987 >> v2:172.21.15.110:3300/0 conn(0x7efe74071500 0x7efe740c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.114+0000 7efe72ffd640 1 -- 172.21.15.55:0/4283036987 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054129854 0 0) 0x7efe74069d60 con 0x7efe7406e690 2023-08-25T05:38:02.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.114+0000 7efe78f97640 1 -- 172.21.15.55:0/4283036987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe74069900 msgr2=0x7efe74161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:02.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.114+0000 7efe78f97640 1 --2- 172.21.15.55:0/4283036987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe74069900 0x7efe74161070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.114+0000 7efe78f97640 1 -- 172.21.15.55:0/4283036987 >> v1:172.21.15.110:6789/0 conn(0x7efe7406e690 legacy=0x7efe7406ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.114+0000 7efe78f97640 1 -- 172.21.15.55:0/4283036987 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe741615b0 con 0x7efe74071500 2023-08-25T05:38:02.120 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.114+0000 7efe737fe640 1 --2- 172.21.15.55:0/4283036987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe74069900 0x7efe74161070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:38:02.121 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.118+0000 7efe78f97640 1 --2- 172.21.15.55:0/4283036987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe74071500 0x7efe740c9be0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009d90 tx=0x7efe6c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e0251b75c7dec92 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:02.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.118+0000 7efe72ffd640 1 -- 172.21.15.55:0/4283036987 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c0a5900 con 0x7efe74071500 2023-08-25T05:38:02.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.118+0000 7efe72ffd640 1 -- 172.21.15.55:0/4283036987 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c0a5a60 con 0x7efe74071500 2023-08-25T05:38:02.122 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.118+0000 7efe72ffd640 1 -- 172.21.15.55:0/4283036987 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c0a5df0 con 0x7efe74071500 2023-08-25T05:38:02.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.118+0000 7efe7a9fa640 1 -- 172.21.15.55:0/4283036987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe74071500 msgr2=0x7efe740c9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.118+0000 7efe7a9fa640 1 --2- 172.21.15.55:0/4283036987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe74071500 0x7efe740c9be0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009d90 tx=0x7efe6c01c950 comp rx=0 tx=0).stop 2023-08-25T05:38:02.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.118+0000 7efe7a9fa640 1 -- 172.21.15.55:0/4283036987 shutdown_connections 2023-08-25T05:38:02.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.118+0000 7efe7a9fa640 1 --2- 172.21.15.55:0/4283036987 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe74071500 0x7efe740c9be0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.118+0000 7efe7a9fa640 1 --2- 172.21.15.55:0/4283036987 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe74069900 0x7efe74161070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.118+0000 7efe7a9fa640 1 -- 172.21.15.55:0/4283036987 >> 172.21.15.55:0/4283036987 conn(0x7efe740cc010 msgr2=0x7efe740cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:02.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.118+0000 7efe7a9fa640 1 -- 172.21.15.55:0/4283036987 shutdown_connections 2023-08-25T05:38:02.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.118+0000 7efe7a9fa640 1 -- 172.21.15.55:0/4283036987 wait complete. 2023-08-25T05:38:02.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe7a9fa640 1 Processor -- start 2023-08-25T05:38:02.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe7a9fa640 1 -- start start 2023-08-25T05:38:02.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe7a9fa640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe74069900 0x7efe74155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe7a9fa640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe7406e690 0x7efe740c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe7a9fa640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe74071500 0x7efe74157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe7a9fa640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe740b27a0 con 0x7efe7406e690 2023-08-25T05:38:02.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe7a9fa640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe741555f0 con 0x7efe74071500 2023-08-25T05:38:02.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe7a9fa640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe740b2220 con 0x7efe74069900 2023-08-25T05:38:02.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe7406e690 0x7efe740c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe737fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe7406e690 0x7efe740c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42546/0 (socket says 172.21.15.55:42546) 2023-08-25T05:38:02.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe737fe640 1 -- 172.21.15.55:0/3200903337 learned_addr learned my addr 172.21.15.55:0/3200903337 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:02.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe78f97640 1 --2- 172.21.15.55:0/3200903337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe74071500 0x7efe74157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe73fff640 1 --2- 172.21.15.55:0/3200903337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe74069900 0x7efe74155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe737fe640 1 -- 172.21.15.55:0/3200903337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe74069900 msgr2=0x7efe74155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe737fe640 1 --2- 172.21.15.55:0/3200903337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe74069900 0x7efe74155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe737fe640 1 -- 172.21.15.55:0/3200903337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe74071500 msgr2=0x7efe74157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe737fe640 1 --2- 172.21.15.55:0/3200903337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe74071500 0x7efe74157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe737fe640 1 -- 172.21.15.55:0/3200903337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe68009420 con 0x7efe7406e690 2023-08-25T05:38:02.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe78f97640 1 --2- 172.21.15.55:0/3200903337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe74071500 0x7efe74157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:38:02.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe737fe640 1 --2- 172.21.15.55:0/3200903337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe7406e690 0x7efe740c6050 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7efe6800ebe0 tx=0x7efe6800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:02.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe70ff9640 1 -- 172.21.15.55:0/3200903337 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6800eee0 con 0x7efe7406e690 2023-08-25T05:38:02.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe70ff9640 1 -- 172.21.15.55:0/3200903337 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6800cc30 con 0x7efe7406e690 2023-08-25T05:38:02.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe7a9fa640 1 -- 172.21.15.55:0/3200903337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6c009a70 con 0x7efe7406e690 2023-08-25T05:38:02.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe70ff9640 1 -- 172.21.15.55:0/3200903337 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe68013470 con 0x7efe7406e690 2023-08-25T05:38:02.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.122+0000 7efe7a9fa640 1 -- 172.21.15.55:0/3200903337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe740b24c0 con 0x7efe7406e690 2023-08-25T05:38:02.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.126+0000 7efe7a9fa640 1 -- 172.21.15.55:0/3200903337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe74070d00 con 0x7efe7406e690 2023-08-25T05:38:02.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.126+0000 7efe70ff9640 1 -- 172.21.15.55:0/3200903337 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7efe680135d0 con 0x7efe7406e690 2023-08-25T05:38:02.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.126+0000 7efe70ff9640 1 --2- 172.21.15.55:0/3200903337 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7efe600657d0 0x7efe60067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.126+0000 7efe70ff9640 1 -- 172.21.15.55:0/3200903337 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7efe680832c0 con 0x7efe7406e690 2023-08-25T05:38:02.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.126+0000 7efe70ff9640 1 --2- 172.21.15.55:0/3200903337 >> [v2:172.21.15.110:6816/1700969513,v1:172.21.15.110:6817/1700969513] conn(0x7efe6006c240 0x7efe6006e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.126+0000 7efe70ff9640 1 -- 172.21.15.55:0/3200903337 --> [v2:172.21.15.110:6816/1700969513,v1:172.21.15.110:6817/1700969513] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe6006ed10 con 0x7efe6006c240 2023-08-25T05:38:02.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.126+0000 7efe70ff9640 1 -- 172.21.15.55:0/3200903337 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe680858a0 con 0x7efe7406e690 2023-08-25T05:38:02.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.126+0000 7efe73fff640 1 --2- 172.21.15.55:0/3200903337 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7efe600657d0 0x7efe60067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.126+0000 7efe78f97640 1 --2- 172.21.15.55:0/3200903337 >> [v2:172.21.15.110:6816/1700969513,v1:172.21.15.110:6817/1700969513] conn(0x7efe6006c240 0x7efe6006e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.126+0000 7efe73fff640 1 --2- 172.21.15.55:0/3200903337 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7efe600657d0 0x7efe60067c90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efe64000f70 tx=0x7efe64007b60 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:02.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.126+0000 7efe78f97640 1 --2- 172.21.15.55:0/3200903337 >> [v2:172.21.15.110:6816/1700969513,v1:172.21.15.110:6817/1700969513] conn(0x7efe6006c240 0x7efe6006e660 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:02.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.130+0000 7efe70ff9640 1 -- 172.21.15.55:0/3200903337 <== osd.4 v2:172.21.15.110:6816/1700969513 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7efe6006ed10 con 0x7efe6006c240 2023-08-25T05:38:02.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.142+0000 7efe7a9fa640 1 -- 172.21.15.55:0/3200903337 --> [v2:172.21.15.110:6816/1700969513,v1:172.21.15.110:6817/1700969513] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efe7404dbe0 con 0x7efe6006c240 2023-08-25T05:38:02.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.142+0000 7efe70ff9640 1 -- 172.21.15.55:0/3200903337 <== osd.4 v2:172.21.15.110:6816/1700969513 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7efe7404dbe0 con 0x7efe6006c240 2023-08-25T05:38:02.146 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T05:38:02.146 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-25T05:38:02.146 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T05:38:02.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.142+0000 7efe7a9fa640 1 -- 172.21.15.55:0/3200903337 >> [v2:172.21.15.110:6816/1700969513,v1:172.21.15.110:6817/1700969513] conn(0x7efe6006c240 msgr2=0x7efe6006e660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.142+0000 7efe7a9fa640 1 --2- 172.21.15.55:0/3200903337 >> [v2:172.21.15.110:6816/1700969513,v1:172.21.15.110:6817/1700969513] conn(0x7efe6006c240 0x7efe6006e660 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.142+0000 7efe7a9fa640 1 -- 172.21.15.55:0/3200903337 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7efe600657d0 msgr2=0x7efe60067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.142+0000 7efe7a9fa640 1 --2- 172.21.15.55:0/3200903337 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7efe600657d0 0x7efe60067c90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efe64000f70 tx=0x7efe64007b60 comp rx=0 tx=0).stop 2023-08-25T05:38:02.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.142+0000 7efe7a9fa640 1 -- 172.21.15.55:0/3200903337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe7406e690 msgr2=0x7efe740c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.142+0000 7efe7a9fa640 1 --2- 172.21.15.55:0/3200903337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe7406e690 0x7efe740c6050 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7efe6800ebe0 tx=0x7efe6800c520 comp rx=0 tx=0).stop 2023-08-25T05:38:02.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.142+0000 7efe78f97640 1 -- 172.21.15.55:0/3200903337 reap_dead start 2023-08-25T05:38:02.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.142+0000 7efe7a9fa640 1 -- 172.21.15.55:0/3200903337 shutdown_connections 2023-08-25T05:38:02.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.142+0000 7efe7a9fa640 1 -- 172.21.15.55:0/3200903337 >> 172.21.15.55:0/3200903337 conn(0x7efe740cc010 msgr2=0x7efe740ad890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:02.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.142+0000 7efe7a9fa640 1 -- 172.21.15.55:0/3200903337 shutdown_connections 2023-08-25T05:38:02.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.142+0000 7efe7a9fa640 1 -- 172.21.15.55:0/3200903337 wait complete. 2023-08-25T05:38:02.164 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-08-25T05:38:02.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.306+0000 7f3ba565f640 1 Processor -- start 2023-08-25T05:38:02.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.310+0000 7f3ba565f640 1 -- start start 2023-08-25T05:38:02.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.310+0000 7f3ba565f640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ba00d0da0 0x7f3ba00d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.310+0000 7f3ba565f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ba00b3e50 0x7f3ba00ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.310+0000 7f3ba565f640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba00b29b0 con 0x7f3ba00cdde0 2023-08-25T05:38:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.310+0000 7f3ba565f640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba00ce760 con 0x7f3ba00d0da0 2023-08-25T05:38:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.310+0000 7f3ba565f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba00d16c0 con 0x7f3ba00b3e50 2023-08-25T05:38:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.310+0000 7f3b9effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ba00d0da0 0x7f3ba00d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.310+0000 7f3b9effd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3ba00d0da0 0x7f3ba00d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42556/0 (socket says 172.21.15.55:42556) 2023-08-25T05:38:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.310+0000 7f3b9effd640 1 -- 172.21.15.55:0/279353350 learned_addr learned my addr 172.21.15.55:0/279353350 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:02.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.310+0000 7f3b9f7fe640 1 --2- 172.21.15.55:0/279353350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ba00b3e50 0x7f3ba00ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.310+0000 7f3b9effd640 1 -- 172.21.15.55:0/279353350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ba00b3e50 msgr2=0x7f3ba00ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:02.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.310+0000 7f3b9effd640 1 --2- 172.21.15.55:0/279353350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ba00b3e50 0x7f3ba00ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.310+0000 7f3b9effd640 1 -- 172.21.15.55:0/279353350 >> v1:172.21.15.110:6789/0 conn(0x7f3ba00cdde0 legacy=0x7f3ba00cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:02.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.310+0000 7f3b9effd640 1 -- 172.21.15.55:0/279353350 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba00b1dc0 con 0x7f3ba00d0da0 2023-08-25T05:38:02.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.314+0000 7f3b9effd640 1 --2- 172.21.15.55:0/279353350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ba00d0da0 0x7f3ba00d1180 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7f3b90006fd0 tx=0x7f3b9001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e0b5a8b9ed7b2a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:02.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.314+0000 7f3b9e7fc640 1 -- 172.21.15.55:0/279353350 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b900a8990 con 0x7f3ba00d0da0 2023-08-25T05:38:02.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.314+0000 7f3b9e7fc640 1 -- 172.21.15.55:0/279353350 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b900a8af0 con 0x7f3ba00d0da0 2023-08-25T05:38:02.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.314+0000 7f3b9e7fc640 1 -- 172.21.15.55:0/279353350 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b900a8e80 con 0x7f3ba00d0da0 2023-08-25T05:38:02.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.314+0000 7f3ba565f640 1 -- 172.21.15.55:0/279353350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ba00d0da0 msgr2=0x7f3ba00d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.314+0000 7f3ba565f640 1 --2- 172.21.15.55:0/279353350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ba00d0da0 0x7f3ba00d1180 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7f3b90006fd0 tx=0x7f3b9001ecd0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.314+0000 7f3ba565f640 1 -- 172.21.15.55:0/279353350 shutdown_connections 2023-08-25T05:38:02.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.314+0000 7f3ba565f640 1 --2- 172.21.15.55:0/279353350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ba00b3e50 0x7f3ba00ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.314+0000 7f3ba565f640 1 --2- 172.21.15.55:0/279353350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ba00d0da0 0x7f3ba00d1180 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.314+0000 7f3ba565f640 1 -- 172.21.15.55:0/279353350 >> 172.21.15.55:0/279353350 conn(0x7f3ba009bae0 msgr2=0x7f3ba00d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:02.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.314+0000 7f3ba565f640 1 -- 172.21.15.55:0/279353350 shutdown_connections 2023-08-25T05:38:02.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.314+0000 7f3ba565f640 1 -- 172.21.15.55:0/279353350 wait complete. 2023-08-25T05:38:02.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.314+0000 7f3ba565f640 1 Processor -- start 2023-08-25T05:38:02.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.314+0000 7f3ba565f640 1 -- start start 2023-08-25T05:38:02.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3ba565f640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ba00b3e50 0x7f3ba00c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3ba565f640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ba00cdde0 0x7f3ba00c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3ba565f640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ba00d0da0 0x7f3ba00c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3ba565f640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba00b1190 con 0x7f3ba00b3e50 2023-08-25T05:38:02.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3ba565f640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba01f2260 con 0x7f3ba00cdde0 2023-08-25T05:38:02.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3ba565f640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba015efe0 con 0x7f3ba00d0da0 2023-08-25T05:38:02.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3b9effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ba00b3e50 0x7f3ba00c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3b9effd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ba00b3e50 0x7f3ba00c62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42566/0 (socket says 172.21.15.55:42566) 2023-08-25T05:38:02.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3b9effd640 1 -- 172.21.15.55:0/976111585 learned_addr learned my addr 172.21.15.55:0/976111585 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:02.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3b97fff640 1 --2- 172.21.15.55:0/976111585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ba00cdde0 0x7f3ba00c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3b9f7fe640 1 --2- 172.21.15.55:0/976111585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ba00d0da0 0x7f3ba00c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3b9effd640 1 -- 172.21.15.55:0/976111585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ba00d0da0 msgr2=0x7f3ba00c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3b9effd640 1 --2- 172.21.15.55:0/976111585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ba00d0da0 0x7f3ba00c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3b9effd640 1 -- 172.21.15.55:0/976111585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ba00cdde0 msgr2=0x7f3ba00c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3b9effd640 1 --2- 172.21.15.55:0/976111585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ba00cdde0 0x7f3ba00c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3b9effd640 1 -- 172.21.15.55:0/976111585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90009480 con 0x7f3ba00b3e50 2023-08-25T05:38:02.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3b9f7fe640 1 --2- 172.21.15.55:0/976111585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ba00d0da0 0x7f3ba00c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:38:02.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3b9effd640 1 --2- 172.21.15.55:0/976111585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ba00b3e50 0x7f3ba00c62f0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7f3b90006fd0 tx=0x7f3b9001ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3b977fe640 1 -- 172.21.15.55:0/976111585 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b900be070 con 0x7f3ba00b3e50 2023-08-25T05:38:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3b977fe640 1 -- 172.21.15.55:0/976111585 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b900059a0 con 0x7f3ba00b3e50 2023-08-25T05:38:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3b977fe640 1 -- 172.21.15.55:0/976111585 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90005d50 con 0x7f3ba00b3e50 2023-08-25T05:38:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3ba565f640 1 -- 172.21.15.55:0/976111585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba00b0eb0 con 0x7f3ba00b3e50 2023-08-25T05:38:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3ba565f640 1 -- 172.21.15.55:0/976111585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba015ec70 con 0x7f3ba00b3e50 2023-08-25T05:38:02.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.318+0000 7f3ba565f640 1 -- 172.21.15.55:0/976111585 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba015e7f0 con 0x7f3ba00b3e50 2023-08-25T05:38:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.322+0000 7f3b977fe640 1 -- 172.21.15.55:0/976111585 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f3b900b7070 con 0x7f3ba00b3e50 2023-08-25T05:38:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.322+0000 7f3b977fe640 1 --2- 172.21.15.55:0/976111585 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f3b800657a0 0x7f3b80067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.322+0000 7f3b977fe640 1 -- 172.21.15.55:0/976111585 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f3b901204a0 con 0x7f3ba00b3e50 2023-08-25T05:38:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.322+0000 7f3b97fff640 1 --2- 172.21.15.55:0/976111585 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f3b800657a0 0x7f3b80067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.322+0000 7f3b97fff640 1 --2- 172.21.15.55:0/976111585 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f3b800657a0 0x7f3b80067c60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00a0720 tx=0x7f3b88007e40 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:02.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.326+0000 7f3b977fe640 1 -- 172.21.15.55:0/976111585 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3ba015e7f0 con 0x7f3ba00b3e50 2023-08-25T05:38:02.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.486+0000 7f3ba565f640 1 -- 172.21.15.55:0/976111585 --> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ba00b2360 con 0x7f3b800657a0 2023-08-25T05:38:02.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.486+0000 7f3b977fe640 1 -- 172.21.15.55:0/976111585 <== mgr.9404 v2:172.21.15.110:6832/1527806048 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3b88004c00 con 0x7f3b800657a0 2023-08-25T05:38:02.491 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 4 to deep-scrub 2023-08-25T05:38:02.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.490+0000 7f3ba565f640 1 -- 172.21.15.55:0/976111585 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f3b800657a0 msgr2=0x7f3b80067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.492 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.490+0000 7f3ba565f640 1 --2- 172.21.15.55:0/976111585 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f3b800657a0 0x7f3b80067c60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3ba00a0720 tx=0x7f3b88007e40 comp rx=0 tx=0).stop 2023-08-25T05:38:02.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.490+0000 7f3ba565f640 1 -- 172.21.15.55:0/976111585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ba00b3e50 msgr2=0x7f3ba00c62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.490+0000 7f3ba565f640 1 --2- 172.21.15.55:0/976111585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ba00b3e50 0x7f3ba00c62f0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7f3b90006fd0 tx=0x7f3b9001ba70 comp rx=0 tx=0).stop 2023-08-25T05:38:02.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.490+0000 7f3ba565f640 1 -- 172.21.15.55:0/976111585 shutdown_connections 2023-08-25T05:38:02.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.490+0000 7f3ba565f640 1 --2- 172.21.15.55:0/976111585 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f3b800657a0 0x7f3b80067c60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.490+0000 7f3ba565f640 1 --2- 172.21.15.55:0/976111585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ba00d0da0 0x7f3ba00c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.490+0000 7f3ba565f640 1 --2- 172.21.15.55:0/976111585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ba00cdde0 0x7f3ba00c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.490+0000 7f3ba565f640 1 --2- 172.21.15.55:0/976111585 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ba00b3e50 0x7f3ba00c62f0 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.490+0000 7f3ba565f640 1 -- 172.21.15.55:0/976111585 >> 172.21.15.55:0/976111585 conn(0x7f3ba009bae0 msgr2=0x7f3ba006b850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:02.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.490+0000 7f3ba565f640 1 -- 172.21.15.55:0/976111585 shutdown_connections 2023-08-25T05:38:02.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.490+0000 7f3ba565f640 1 -- 172.21.15.55:0/976111585 wait complete. 2023-08-25T05:38:02.512 INFO:tasks.ceph:Scrubbing osd.5 2023-08-25T05:38:02.512 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-08-25T05:38:02.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.658+0000 7efd25be9640 1 Processor -- start 2023-08-25T05:38:02.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.658+0000 7efd25be9640 1 -- start start 2023-08-25T05:38:02.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.658+0000 7efd25be9640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd20159d00 0x7efd200cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.658+0000 7efd25be9640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efd2006fb50 0x7efd200c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.658+0000 7efd25be9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd200cc930 0x7efd200ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.658+0000 7efd25be9640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd200cc510 con 0x7efd20159d00 2023-08-25T05:38:02.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.658+0000 7efd25be9640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd200ce220 con 0x7efd2006fb50 2023-08-25T05:38:02.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.658+0000 7efd25be9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd200ca6c0 con 0x7efd200cc930 2023-08-25T05:38:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.658+0000 7efd1f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd20159d00 0x7efd200cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.658+0000 7efd1f7fe640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd20159d00 0x7efd200cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42580/0 (socket says 172.21.15.55:42580) 2023-08-25T05:38:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.658+0000 7efd1f7fe640 1 -- 172.21.15.55:0/2049251536 learned_addr learned my addr 172.21.15.55:0/2049251536 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.658+0000 7efd17fff640 1 --2- 172.21.15.55:0/2049251536 >> v2:172.21.15.110:3300/0 conn(0x7efd2006fb50 0x7efd200c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.658+0000 7efd1ffff640 1 --2- 172.21.15.55:0/2049251536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd200cc930 0x7efd200ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.662+0000 7efd1f7fe640 1 -- 172.21.15.55:0/2049251536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd200cc930 msgr2=0x7efd200ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:02.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.662+0000 7efd1f7fe640 1 --2- 172.21.15.55:0/2049251536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd200cc930 0x7efd200ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.662+0000 7efd1f7fe640 1 -- 172.21.15.55:0/2049251536 >> v2:172.21.15.110:3300/0 conn(0x7efd2006fb50 msgr2=0x7efd200c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:02.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.662+0000 7efd1f7fe640 1 --2- 172.21.15.55:0/2049251536 >> v2:172.21.15.110:3300/0 conn(0x7efd2006fb50 0x7efd200c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.662+0000 7efd1f7fe640 1 -- 172.21.15.55:0/2049251536 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd200ca9a0 con 0x7efd20159d00 2023-08-25T05:38:02.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.662+0000 7efd1ffff640 1 --2- 172.21.15.55:0/2049251536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd200cc930 0x7efd200ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:38:02.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.662+0000 7efd1f7fe640 1 --2- 172.21.15.55:0/2049251536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd20159d00 0x7efd200cdc40 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7efd200720c0 tx=0x7efd1001f0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e7899bf05c590e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:02.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.662+0000 7efd1effd640 1 -- 172.21.15.55:0/2049251536 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd100aa660 con 0x7efd20159d00 2023-08-25T05:38:02.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.662+0000 7efd1effd640 1 -- 172.21.15.55:0/2049251536 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd100aa7c0 con 0x7efd20159d00 2023-08-25T05:38:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.662+0000 7efd1effd640 1 -- 172.21.15.55:0/2049251536 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd100aab50 con 0x7efd20159d00 2023-08-25T05:38:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.662+0000 7efd25be9640 1 -- 172.21.15.55:0/2049251536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd20159d00 msgr2=0x7efd200cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.662+0000 7efd25be9640 1 --2- 172.21.15.55:0/2049251536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd20159d00 0x7efd200cdc40 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7efd200720c0 tx=0x7efd1001f0b0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd25be9640 1 -- 172.21.15.55:0/2049251536 shutdown_connections 2023-08-25T05:38:02.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd25be9640 1 --2- 172.21.15.55:0/2049251536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd200cc930 0x7efd200ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd25be9640 1 --2- 172.21.15.55:0/2049251536 >> v2:172.21.15.110:3300/0 conn(0x7efd2006fb50 0x7efd200c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd25be9640 1 --2- 172.21.15.55:0/2049251536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd20159d00 0x7efd200cdc40 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd25be9640 1 -- 172.21.15.55:0/2049251536 >> 172.21.15.55:0/2049251536 conn(0x7efd200caf90 msgr2=0x7efd200cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:02.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd25be9640 1 -- 172.21.15.55:0/2049251536 shutdown_connections 2023-08-25T05:38:02.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd25be9640 1 -- 172.21.15.55:0/2049251536 wait complete. 2023-08-25T05:38:02.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd25be9640 1 Processor -- start 2023-08-25T05:38:02.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd25be9640 1 -- start start 2023-08-25T05:38:02.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd25be9640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd2006fb50 0x7efd20142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd25be9640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd200cc930 0x7efd201568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd25be9640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd20159d00 0x7efd20163d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd25be9640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd20143500 con 0x7efd200cc930 2023-08-25T05:38:02.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd25be9640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd20157300 con 0x7efd20159d00 2023-08-25T05:38:02.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd25be9640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd201575e0 con 0x7efd2006fb50 2023-08-25T05:38:02.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd17fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd200cc930 0x7efd201568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd1f7fe640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd2006fb50 0x7efd20142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd1ffff640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd20159d00 0x7efd20163d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd17fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd200cc930 0x7efd201568b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42594/0 (socket says 172.21.15.55:42594) 2023-08-25T05:38:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd17fff640 1 -- 172.21.15.55:0/3305991432 learned_addr learned my addr 172.21.15.55:0/3305991432 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd1f7fe640 1 -- 172.21.15.55:0/3305991432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd20159d00 msgr2=0x7efd20163d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd1f7fe640 1 --2- 172.21.15.55:0/3305991432 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efd20159d00 0x7efd20163d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd1f7fe640 1 -- 172.21.15.55:0/3305991432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd200cc930 msgr2=0x7efd201568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd1f7fe640 1 --2- 172.21.15.55:0/3305991432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd200cc930 0x7efd201568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd1f7fe640 1 -- 172.21.15.55:0/3305991432 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd100094d0 con 0x7efd2006fb50 2023-08-25T05:38:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd17fff640 1 --2- 172.21.15.55:0/3305991432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd200cc930 0x7efd201568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:38:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.666+0000 7efd1f7fe640 1 --2- 172.21.15.55:0/3305991432 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd2006fb50 0x7efd20142fc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efd100ae000 tx=0x7efd1001b3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.670+0000 7efd1cff9640 1 -- 172.21.15.55:0/3305991432 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1000e1d0 con 0x7efd2006fb50 2023-08-25T05:38:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.670+0000 7efd1cff9640 1 -- 172.21.15.55:0/3305991432 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd100aa460 con 0x7efd2006fb50 2023-08-25T05:38:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.670+0000 7efd25be9640 1 -- 172.21.15.55:0/3305991432 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd201578c0 con 0x7efd2006fb50 2023-08-25T05:38:02.673 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.670+0000 7efd1cff9640 1 -- 172.21.15.55:0/3305991432 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd100aab70 con 0x7efd2006fb50 2023-08-25T05:38:02.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.670+0000 7efd25be9640 1 -- 172.21.15.55:0/3305991432 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd200c3220 con 0x7efd2006fb50 2023-08-25T05:38:02.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.670+0000 7efd25be9640 1 -- 172.21.15.55:0/3305991432 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd200cd2c0 con 0x7efd2006fb50 2023-08-25T05:38:02.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.670+0000 7efd1cff9640 1 -- 172.21.15.55:0/3305991432 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7efd100aacd0 con 0x7efd2006fb50 2023-08-25T05:38:02.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.670+0000 7efd1cff9640 1 --2- 172.21.15.55:0/3305991432 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7efd000657a0 0x7efd00067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.670+0000 7efd1cff9640 1 -- 172.21.15.55:0/3305991432 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7efd1011d8e0 con 0x7efd2006fb50 2023-08-25T05:38:02.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.670+0000 7efd1cff9640 1 --2- 172.21.15.55:0/3305991432 >> [v2:172.21.15.110:6824/3619347626,v1:172.21.15.110:6825/3619347626] conn(0x7efd0006c210 0x7efd0006e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.670+0000 7efd1cff9640 1 -- 172.21.15.55:0/3305991432 --> [v2:172.21.15.110:6824/3619347626,v1:172.21.15.110:6825/3619347626] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd0006ece0 con 0x7efd0006c210 2023-08-25T05:38:02.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.670+0000 7efd1cff9640 1 -- 172.21.15.55:0/3305991432 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=207) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd1011dc50 con 0x7efd2006fb50 2023-08-25T05:38:02.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.670+0000 7efd17fff640 1 --2- 172.21.15.55:0/3305991432 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7efd000657a0 0x7efd00067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.670+0000 7efd1ffff640 1 --2- 172.21.15.55:0/3305991432 >> [v2:172.21.15.110:6824/3619347626,v1:172.21.15.110:6825/3619347626] conn(0x7efd0006c210 0x7efd0006e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.674+0000 7efd1ffff640 1 --2- 172.21.15.55:0/3305991432 >> [v2:172.21.15.110:6824/3619347626,v1:172.21.15.110:6825/3619347626] conn(0x7efd0006c210 0x7efd0006e630 crc :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:02.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.674+0000 7efd17fff640 1 --2- 172.21.15.55:0/3305991432 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7efd000657a0 0x7efd00067c60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efd20156860 tx=0x7efd08008040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:02.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.674+0000 7efd1cff9640 1 -- 172.21.15.55:0/3305991432 <== osd.5 v2:172.21.15.110:6824/3619347626 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7efd0006ece0 con 0x7efd0006c210 2023-08-25T05:38:02.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.686+0000 7efd25be9640 1 -- 172.21.15.55:0/3305991432 --> [v2:172.21.15.110:6824/3619347626,v1:172.21.15.110:6825/3619347626] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efd200c90a0 con 0x7efd0006c210 2023-08-25T05:38:02.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.686+0000 7efd1cff9640 1 -- 172.21.15.55:0/3305991432 <== osd.5 v2:172.21.15.110:6824/3619347626 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7efd1800d5e0 con 0x7efd0006c210 2023-08-25T05:38:02.690 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T05:38:02.690 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-25T05:38:02.690 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T05:38:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.686+0000 7efd25be9640 1 -- 172.21.15.55:0/3305991432 >> [v2:172.21.15.110:6824/3619347626,v1:172.21.15.110:6825/3619347626] conn(0x7efd0006c210 msgr2=0x7efd0006e630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.686+0000 7efd25be9640 1 --2- 172.21.15.55:0/3305991432 >> [v2:172.21.15.110:6824/3619347626,v1:172.21.15.110:6825/3619347626] conn(0x7efd0006c210 0x7efd0006e630 crc :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.686+0000 7efd25be9640 1 -- 172.21.15.55:0/3305991432 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7efd000657a0 msgr2=0x7efd00067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.686+0000 7efd25be9640 1 --2- 172.21.15.55:0/3305991432 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7efd000657a0 0x7efd00067c60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efd20156860 tx=0x7efd08008040 comp rx=0 tx=0).stop 2023-08-25T05:38:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.686+0000 7efd25be9640 1 -- 172.21.15.55:0/3305991432 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd2006fb50 msgr2=0x7efd20142fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.686+0000 7efd25be9640 1 --2- 172.21.15.55:0/3305991432 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efd2006fb50 0x7efd20142fc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efd100ae000 tx=0x7efd1001b3f0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.686+0000 7efd1ffff640 1 -- 172.21.15.55:0/3305991432 reap_dead start 2023-08-25T05:38:02.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.686+0000 7efd25be9640 1 -- 172.21.15.55:0/3305991432 shutdown_connections 2023-08-25T05:38:02.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.686+0000 7efd25be9640 1 -- 172.21.15.55:0/3305991432 >> 172.21.15.55:0/3305991432 conn(0x7efd200caf90 msgr2=0x7efd200c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:02.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.686+0000 7efd25be9640 1 -- 172.21.15.55:0/3305991432 shutdown_connections 2023-08-25T05:38:02.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.686+0000 7efd25be9640 1 -- 172.21.15.55:0/3305991432 wait complete. 2023-08-25T05:38:02.708 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-08-25T05:38:02.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.850+0000 7f7ef7a34640 1 Processor -- start 2023-08-25T05:38:02.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.850+0000 7f7ef7a34640 1 -- start start 2023-08-25T05:38:02.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.850+0000 7f7ef7a34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef00ccf20 0x7f7ef00cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.850+0000 7f7ef7a34640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ef006d550 0x7f7ef006d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.850+0000 7f7ef7a34640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef00ce170 con 0x7f7ef015a830 2023-08-25T05:38:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.850+0000 7f7ef7a34640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef00cd8a0 con 0x7f7ef006d550 2023-08-25T05:38:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.850+0000 7f7ef7a34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef00ce3a0 con 0x7f7ef00ccf20 2023-08-25T05:38:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.850+0000 7f7ef5fd1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ef006d550 0x7f7ef006d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.850+0000 7f7ef5fd1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7ef006d550 0x7f7ef006d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42604/0 (socket says 172.21.15.55:42604) 2023-08-25T05:38:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.850+0000 7f7ef5fd1640 1 -- 172.21.15.55:0/168154552 learned_addr learned my addr 172.21.15.55:0/168154552 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:02.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.850+0000 7f7ef4fcf640 1 --2- 172.21.15.55:0/168154552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef00ccf20 0x7f7ef00cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.850+0000 7f7ef5fd1640 1 -- 172.21.15.55:0/168154552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef00ccf20 msgr2=0x7f7ef00cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:02.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.850+0000 7f7ef5fd1640 1 --2- 172.21.15.55:0/168154552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef00ccf20 0x7f7ef00cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.850+0000 7f7ef5fd1640 1 -- 172.21.15.55:0/168154552 >> v1:172.21.15.110:6789/0 conn(0x7f7ef015a830 legacy=0x7f7ef00cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.850+0000 7f7ef5fd1640 1 -- 172.21.15.55:0/168154552 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef00ce660 con 0x7f7ef006d550 2023-08-25T05:38:02.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.854+0000 7f7ef5fd1640 1 --2- 172.21.15.55:0/168154552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef006d550 0x7f7ef006d9d0 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009e50 tx=0x7f7ee801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4544c49636ac1f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:02.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.854+0000 7f7ee7fff640 1 -- 172.21.15.55:0/168154552 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80a58a0 con 0x7f7ef006d550 2023-08-25T05:38:02.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.854+0000 7f7ee7fff640 1 -- 172.21.15.55:0/168154552 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee80a5a00 con 0x7f7ef006d550 2023-08-25T05:38:02.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.854+0000 7f7ee7fff640 1 -- 172.21.15.55:0/168154552 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80a5d90 con 0x7f7ef006d550 2023-08-25T05:38:02.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.854+0000 7f7ef7a34640 1 -- 172.21.15.55:0/168154552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef006d550 msgr2=0x7f7ef006d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.854+0000 7f7ef7a34640 1 --2- 172.21.15.55:0/168154552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef006d550 0x7f7ef006d9d0 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009e50 tx=0x7f7ee801c9e0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.854+0000 7f7ef7a34640 1 -- 172.21.15.55:0/168154552 shutdown_connections 2023-08-25T05:38:02.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.854+0000 7f7ef7a34640 1 --2- 172.21.15.55:0/168154552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef006d550 0x7f7ef006d9d0 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.854+0000 7f7ef7a34640 1 --2- 172.21.15.55:0/168154552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef00ccf20 0x7f7ef00cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.854+0000 7f7ef7a34640 1 -- 172.21.15.55:0/168154552 >> 172.21.15.55:0/168154552 conn(0x7f7ef00d05a0 msgr2=0x7f7ef00d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:02.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.854+0000 7f7ef7a34640 1 -- 172.21.15.55:0/168154552 shutdown_connections 2023-08-25T05:38:02.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.854+0000 7f7ef7a34640 1 -- 172.21.15.55:0/168154552 wait complete. 2023-08-25T05:38:02.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef7a34640 1 Processor -- start 2023-08-25T05:38:02.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef7a34640 1 -- start start 2023-08-25T05:38:02.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef7a34640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ef006d550 0x7f7ef00aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef7a34640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef00ccf20 0x7f7ef006e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef7a34640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef015a830 0x7f7ef006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef7a34640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef00ad170 con 0x7f7ef015a830 2023-08-25T05:38:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef7a34640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef015ce10 con 0x7f7ef006d550 2023-08-25T05:38:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef7a34640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef015d090 con 0x7f7ef00ccf20 2023-08-25T05:38:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef5fd1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef015a830 0x7f7ef006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef5fd1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef015a830 0x7f7ef006eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42608/0 (socket says 172.21.15.55:42608) 2023-08-25T05:38:02.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef5fd1640 1 -- 172.21.15.55:0/1951825422 learned_addr learned my addr 172.21.15.55:0/1951825422 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:02.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef4fcf640 1 --2- 172.21.15.55:0/1951825422 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef00ccf20 0x7f7ef006e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef57d0640 1 --2- 172.21.15.55:0/1951825422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ef006d550 0x7f7ef00aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef5fd1640 1 -- 172.21.15.55:0/1951825422 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef00ccf20 msgr2=0x7f7ef006e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef5fd1640 1 --2- 172.21.15.55:0/1951825422 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef00ccf20 0x7f7ef006e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef5fd1640 1 -- 172.21.15.55:0/1951825422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ef006d550 msgr2=0x7f7ef00aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:02.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef5fd1640 1 --2- 172.21.15.55:0/1951825422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ef006d550 0x7f7ef00aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:02.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef5fd1640 1 -- 172.21.15.55:0/1951825422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee8009b30 con 0x7f7ef015a830 2023-08-25T05:38:02.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef57d0640 1 --2- 172.21.15.55:0/1951825422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ef006d550 0x7f7ef00aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:38:02.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef5fd1640 1 --2- 172.21.15.55:0/1951825422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef015a830 0x7f7ef006eb00 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f7ee801a610 tx=0x7f7ee8019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:02.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ee5ffb640 1 -- 172.21.15.55:0/1951825422 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80b8670 con 0x7f7ef015a830 2023-08-25T05:38:02.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ee5ffb640 1 -- 172.21.15.55:0/1951825422 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee80b87d0 con 0x7f7ef015a830 2023-08-25T05:38:02.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef7a34640 1 -- 172.21.15.55:0/1951825422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef015d370 con 0x7f7ef015a830 2023-08-25T05:38:02.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ee5ffb640 1 -- 172.21.15.55:0/1951825422 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80b8b80 con 0x7f7ef015a830 2023-08-25T05:38:02.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef7a34640 1 -- 172.21.15.55:0/1951825422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef00af1f0 con 0x7f7ef015a830 2023-08-25T05:38:02.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.858+0000 7f7ef7a34640 1 -- 172.21.15.55:0/1951825422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef00ad320 con 0x7f7ef015a830 2023-08-25T05:38:02.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.862+0000 7f7ee5ffb640 1 -- 172.21.15.55:0/1951825422 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f7ee80b8ce0 con 0x7f7ef015a830 2023-08-25T05:38:02.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.862+0000 7f7ee5ffb640 1 --2- 172.21.15.55:0/1951825422 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f7ed40657a0 0x7f7ed4067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:02.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.862+0000 7f7ee5ffb640 1 -- 172.21.15.55:0/1951825422 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f7ee811e490 con 0x7f7ef015a830 2023-08-25T05:38:02.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.862+0000 7f7ef57d0640 1 --2- 172.21.15.55:0/1951825422 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f7ed40657a0 0x7f7ed4067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:02.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.862+0000 7f7ef57d0640 1 --2- 172.21.15.55:0/1951825422 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f7ed40657a0 0x7f7ed4067c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7eec007fd0 tx=0x7f7eec009040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:02.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:02.866+0000 7f7ee5ffb640 1 -- 172.21.15.55:0/1951825422 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f7ef00ad320 con 0x7f7ef015a830 2023-08-25T05:38:03.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.022+0000 7f7ef7a34640 1 -- 172.21.15.55:0/1951825422 --> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ef015c3e0 con 0x7f7ed40657a0 2023-08-25T05:38:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.022+0000 7f7ee5ffb640 1 -- 172.21.15.55:0/1951825422 <== mgr.9404 v2:172.21.15.110:6832/1527806048 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7ef015c3e0 con 0x7f7ed40657a0 2023-08-25T05:38:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 5 to deep-scrub 2023-08-25T05:38:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.026+0000 7f7ef7a34640 1 -- 172.21.15.55:0/1951825422 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f7ed40657a0 msgr2=0x7f7ed4067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.026+0000 7f7ef7a34640 1 --2- 172.21.15.55:0/1951825422 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f7ed40657a0 0x7f7ed4067c60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7eec007fd0 tx=0x7f7eec009040 comp rx=0 tx=0).stop 2023-08-25T05:38:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.026+0000 7f7ef7a34640 1 -- 172.21.15.55:0/1951825422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef015a830 msgr2=0x7f7ef006eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.026+0000 7f7ef7a34640 1 --2- 172.21.15.55:0/1951825422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef015a830 0x7f7ef006eb00 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f7ee801a610 tx=0x7f7ee8019780 comp rx=0 tx=0).stop 2023-08-25T05:38:03.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.026+0000 7f7ef7a34640 1 -- 172.21.15.55:0/1951825422 shutdown_connections 2023-08-25T05:38:03.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.026+0000 7f7ef7a34640 1 --2- 172.21.15.55:0/1951825422 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f7ed40657a0 0x7f7ed4067c60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.026+0000 7f7ef7a34640 1 --2- 172.21.15.55:0/1951825422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7ef015a830 0x7f7ef006eb00 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.026+0000 7f7ef7a34640 1 --2- 172.21.15.55:0/1951825422 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ef00ccf20 0x7f7ef006e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.026+0000 7f7ef7a34640 1 --2- 172.21.15.55:0/1951825422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ef006d550 0x7f7ef00aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.026+0000 7f7ef7a34640 1 -- 172.21.15.55:0/1951825422 >> 172.21.15.55:0/1951825422 conn(0x7f7ef00d05a0 msgr2=0x7f7ef006c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:03.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.026+0000 7f7ef7a34640 1 -- 172.21.15.55:0/1951825422 shutdown_connections 2023-08-25T05:38:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.026+0000 7f7ef7a34640 1 -- 172.21.15.55:0/1951825422 wait complete. 2023-08-25T05:38:03.047 INFO:tasks.ceph:Scrubbing osd.6 2023-08-25T05:38:03.048 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-08-25T05:38:03.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.194+0000 7f6c9f374640 1 Processor -- start 2023-08-25T05:38:03.196 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.194+0000 7f6c9f374640 1 -- start start 2023-08-25T05:38:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.194+0000 7f6c9f374640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6c980b06a0 0x7f6c98070d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.194+0000 7f6c9f374640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c98161b50 con 0x7f6c980ccc90 2023-08-25T05:38:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.194+0000 7f6c9f374640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c981612e0 con 0x7f6c981575e0 2023-08-25T05:38:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.194+0000 7f6c9f374640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c980702f0 con 0x7f6c980b06a0 2023-08-25T05:38:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.194+0000 7f6c9c90f640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6c980ccc90 0x7f6c980aff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37632/0 (socket says 172.21.15.55:37632) 2023-08-25T05:38:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.194+0000 7f6c9c90f640 1 -- 172.21.15.55:0/108778702 learned_addr learned my addr 172.21.15.55:0/108778702 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:38:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.194+0000 7f6c9d911640 1 --2- 172.21.15.55:0/108778702 >> v2:172.21.15.110:3300/0 conn(0x7f6c980b06a0 0x7f6c98070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.194+0000 7f6c8ffff640 1 -- 172.21.15.55:0/108778702 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188746544 0 0) 0x7f6c98161b50 con 0x7f6c980ccc90 2023-08-25T05:38:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.194+0000 7f6c8ffff640 1 -- 172.21.15.55:0/108778702 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c84003530 con 0x7f6c980ccc90 2023-08-25T05:38:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.194+0000 7f6c9d911640 1 -- 172.21.15.55:0/108778702 >> v1:172.21.15.110:6789/0 conn(0x7f6c981575e0 legacy=0x7f6c98160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.194+0000 7f6c8ffff640 1 -- 172.21.15.55:0/108778702 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392477491 0 0) 0x7f6c981612e0 con 0x7f6c981575e0 2023-08-25T05:38:03.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.194+0000 7f6c9d911640 1 -- 172.21.15.55:0/108778702 >> v1:172.21.15.55:6789/0 conn(0x7f6c980ccc90 legacy=0x7f6c980aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.200 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.194+0000 7f6c9d911640 1 -- 172.21.15.55:0/108778702 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c98161590 con 0x7f6c980b06a0 2023-08-25T05:38:03.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.198+0000 7f6c9d911640 1 --2- 172.21.15.55:0/108778702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c980b06a0 0x7f6c98070d00 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009d90 tx=0x7f6c9001c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=637c33805043114a server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:03.201 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.198+0000 7f6c8ffff640 1 -- 172.21.15.55:0/108778702 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900a57d0 con 0x7f6c980b06a0 2023-08-25T05:38:03.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.198+0000 7f6c8ffff640 1 -- 172.21.15.55:0/108778702 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c900a5930 con 0x7f6c980b06a0 2023-08-25T05:38:03.202 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.198+0000 7f6c8ffff640 1 -- 172.21.15.55:0/108778702 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900a5ca0 con 0x7f6c980b06a0 2023-08-25T05:38:03.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.198+0000 7f6c9f374640 1 -- 172.21.15.55:0/108778702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c980b06a0 msgr2=0x7f6c98070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.198+0000 7f6c9f374640 1 --2- 172.21.15.55:0/108778702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c980b06a0 0x7f6c98070d00 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009d90 tx=0x7f6c9001c800 comp rx=0 tx=0).stop 2023-08-25T05:38:03.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.198+0000 7f6c9f374640 1 -- 172.21.15.55:0/108778702 shutdown_connections 2023-08-25T05:38:03.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.198+0000 7f6c9f374640 1 --2- 172.21.15.55:0/108778702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c980b06a0 0x7f6c98070d00 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.198+0000 7f6c9f374640 1 -- 172.21.15.55:0/108778702 >> 172.21.15.55:0/108778702 conn(0x7f6c980caf90 msgr2=0x7f6c980cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:03.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.198+0000 7f6c9f374640 1 -- 172.21.15.55:0/108778702 shutdown_connections 2023-08-25T05:38:03.203 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.198+0000 7f6c9f374640 1 -- 172.21.15.55:0/108778702 wait complete. 2023-08-25T05:38:03.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9f374640 1 Processor -- start 2023-08-25T05:38:03.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9f374640 1 -- start start 2023-08-25T05:38:03.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9f374640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c980b06a0 0x7f6c980c2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9f374640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c980ccc90 0x7f6c98156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9f374640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c981575e0 0x7f6c9814c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9f374640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980c2620 con 0x7f6c980b06a0 2023-08-25T05:38:03.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9f374640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980c2900 con 0x7f6c980ccc90 2023-08-25T05:38:03.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9f374640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980c2be0 con 0x7f6c981575e0 2023-08-25T05:38:03.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9d110640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c980b06a0 0x7f6c980c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9d110640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c980b06a0 0x7f6c980c2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42614/0 (socket says 172.21.15.55:42614) 2023-08-25T05:38:03.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9d110640 1 -- 172.21.15.55:0/3567951451 learned_addr learned my addr 172.21.15.55:0/3567951451 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:03.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9d911640 1 --2- 172.21.15.55:0/3567951451 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c981575e0 0x7f6c9814c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9c90f640 1 --2- 172.21.15.55:0/3567951451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c980ccc90 0x7f6c98156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9d110640 1 -- 172.21.15.55:0/3567951451 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c981575e0 msgr2=0x7f6c9814c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9d110640 1 --2- 172.21.15.55:0/3567951451 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6c981575e0 0x7f6c9814c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9d110640 1 -- 172.21.15.55:0/3567951451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c980ccc90 msgr2=0x7f6c98156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9d110640 1 --2- 172.21.15.55:0/3567951451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6c980ccc90 0x7f6c98156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9d110640 1 -- 172.21.15.55:0/3567951451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c90009a70 con 0x7f6c980b06a0 2023-08-25T05:38:03.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9d110640 1 --2- 172.21.15.55:0/3567951451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c980b06a0 0x7f6c980c2040 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f6c94001ec0 tx=0x7f6c9400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:03.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c8dffb640 1 -- 172.21.15.55:0/3567951451 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c940054e0 con 0x7f6c980b06a0 2023-08-25T05:38:03.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c8dffb640 1 -- 172.21.15.55:0/3567951451 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c94003600 con 0x7f6c980b06a0 2023-08-25T05:38:03.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c8dffb640 1 -- 172.21.15.55:0/3567951451 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c940039b0 con 0x7f6c980b06a0 2023-08-25T05:38:03.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9f374640 1 -- 172.21.15.55:0/3567951451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c980c2ec0 con 0x7f6c980b06a0 2023-08-25T05:38:03.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.202+0000 7f6c9f374640 1 -- 172.21.15.55:0/3567951451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c98157120 con 0x7f6c980b06a0 2023-08-25T05:38:03.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.206+0000 7f6c9f374640 1 -- 172.21.15.55:0/3567951451 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6c98071650 con 0x7f6c980b06a0 2023-08-25T05:38:03.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.206+0000 7f6c8dffb640 1 -- 172.21.15.55:0/3567951451 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f6c94003b10 con 0x7f6c980b06a0 2023-08-25T05:38:03.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.206+0000 7f6c8dffb640 1 --2- 172.21.15.55:0/3567951451 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f6c7c0657a0 0x7f6c7c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.206+0000 7f6c8dffb640 1 -- 172.21.15.55:0/3567951451 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f6c94082520 con 0x7f6c980b06a0 2023-08-25T05:38:03.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.206+0000 7f6c8dffb640 1 --2- 172.21.15.55:0/3567951451 >> [v2:172.21.15.110:6800/3646933996,v1:172.21.15.110:6801/3646933996] conn(0x7f6c7c06c210 0x7f6c7c06e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.206+0000 7f6c8dffb640 1 -- 172.21.15.55:0/3567951451 --> [v2:172.21.15.110:6800/3646933996,v1:172.21.15.110:6801/3646933996] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c7c06ece0 con 0x7f6c7c06c210 2023-08-25T05:38:03.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.206+0000 7f6c8dffb640 1 -- 172.21.15.55:0/3567951451 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c94084b00 con 0x7f6c980b06a0 2023-08-25T05:38:03.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.206+0000 7f6c9c90f640 1 --2- 172.21.15.55:0/3567951451 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f6c7c0657a0 0x7f6c7c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.206+0000 7f6c9d911640 1 --2- 172.21.15.55:0/3567951451 >> [v2:172.21.15.110:6800/3646933996,v1:172.21.15.110:6801/3646933996] conn(0x7f6c7c06c210 0x7f6c7c06e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.206+0000 7f6c9c90f640 1 --2- 172.21.15.55:0/3567951451 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f6c7c0657a0 0x7f6c7c067c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6c980b0280 tx=0x7f6c88009040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:03.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.206+0000 7f6c9d911640 1 --2- 172.21.15.55:0/3567951451 >> [v2:172.21.15.110:6800/3646933996,v1:172.21.15.110:6801/3646933996] conn(0x7f6c7c06c210 0x7f6c7c06e630 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:03.212 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.210+0000 7f6c8dffb640 1 -- 172.21.15.55:0/3567951451 <== osd.6 v2:172.21.15.110:6800/3646933996 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6c7c06ece0 con 0x7f6c7c06c210 2023-08-25T05:38:03.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.222+0000 7f6c9f374640 1 -- 172.21.15.55:0/3567951451 --> [v2:172.21.15.110:6800/3646933996,v1:172.21.15.110:6801/3646933996] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6c980707e0 con 0x7f6c7c06c210 2023-08-25T05:38:03.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.222+0000 7f6c8dffb640 1 -- 172.21.15.55:0/3567951451 <== osd.6 v2:172.21.15.110:6800/3646933996 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6c90009450 con 0x7f6c7c06c210 2023-08-25T05:38:03.225 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T05:38:03.225 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-25T05:38:03.226 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T05:38:03.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.222+0000 7f6c9f374640 1 -- 172.21.15.55:0/3567951451 >> [v2:172.21.15.110:6800/3646933996,v1:172.21.15.110:6801/3646933996] conn(0x7f6c7c06c210 msgr2=0x7f6c7c06e630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.222+0000 7f6c9f374640 1 --2- 172.21.15.55:0/3567951451 >> [v2:172.21.15.110:6800/3646933996,v1:172.21.15.110:6801/3646933996] conn(0x7f6c7c06c210 0x7f6c7c06e630 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.222+0000 7f6c9f374640 1 -- 172.21.15.55:0/3567951451 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f6c7c0657a0 msgr2=0x7f6c7c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.222+0000 7f6c9f374640 1 --2- 172.21.15.55:0/3567951451 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f6c7c0657a0 0x7f6c7c067c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6c980b0280 tx=0x7f6c88009040 comp rx=0 tx=0).stop 2023-08-25T05:38:03.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.222+0000 7f6c9f374640 1 -- 172.21.15.55:0/3567951451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c980b06a0 msgr2=0x7f6c980c2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.222+0000 7f6c9f374640 1 --2- 172.21.15.55:0/3567951451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c980b06a0 0x7f6c980c2040 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f6c94001ec0 tx=0x7f6c9400c8e0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.222+0000 7f6c9d911640 1 -- 172.21.15.55:0/3567951451 reap_dead start 2023-08-25T05:38:03.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.222+0000 7f6c9f374640 1 -- 172.21.15.55:0/3567951451 shutdown_connections 2023-08-25T05:38:03.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.222+0000 7f6c9f374640 1 -- 172.21.15.55:0/3567951451 >> 172.21.15.55:0/3567951451 conn(0x7f6c980caf90 msgr2=0x7f6c9815d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:03.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.222+0000 7f6c9f374640 1 -- 172.21.15.55:0/3567951451 shutdown_connections 2023-08-25T05:38:03.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.222+0000 7f6c9f374640 1 -- 172.21.15.55:0/3567951451 wait complete. 2023-08-25T05:38:03.244 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-08-25T05:38:03.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.386+0000 7f988b59e640 1 Processor -- start 2023-08-25T05:38:03.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.386+0000 7f988b59e640 1 -- start start 2023-08-25T05:38:03.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.390+0000 7f988b59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f988c15c9f0 0x7f988c0b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.390+0000 7f988b59e640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f988c0d0340 0x7f988c06a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.390+0000 7f988b59e640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f988c06aee0 0x7f988c0cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.390+0000 7f988b59e640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f988c0b4b20 con 0x7f988c06aee0 2023-08-25T05:38:03.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.390+0000 7f988b59e640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f988c0b4e00 con 0x7f988c0d0340 2023-08-25T05:38:03.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.390+0000 7f988b59e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988c0cd530 con 0x7f988c15c9f0 2023-08-25T05:38:03.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.390+0000 7f988ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f988c06aee0 0x7f988c0cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.390+0000 7f988a59c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f988c15c9f0 0x7f988c0b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.390+0000 7f9883fff640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f988c0d0340 0x7f988c06a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.390+0000 7f988ad9d640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f988c06aee0 0x7f988c0cdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42630/0 (socket says 172.21.15.55:42630) 2023-08-25T05:38:03.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.390+0000 7f988ad9d640 1 -- 172.21.15.55:0/2267034444 learned_addr learned my addr 172.21.15.55:0/2267034444 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:03.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.390+0000 7f988ad9d640 1 -- 172.21.15.55:0/2267034444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f988c15c9f0 msgr2=0x7f988c0b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:03.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.390+0000 7f988ad9d640 1 --2- 172.21.15.55:0/2267034444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f988c15c9f0 0x7f988c0b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.390+0000 7f988ad9d640 1 -- 172.21.15.55:0/2267034444 >> v2:172.21.15.110:3300/0 conn(0x7f988c0d0340 msgr2=0x7f988c06a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:03.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.390+0000 7f988ad9d640 1 --2- 172.21.15.55:0/2267034444 >> v2:172.21.15.110:3300/0 conn(0x7f988c0d0340 0x7f988c06a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.390+0000 7f988ad9d640 1 -- 172.21.15.55:0/2267034444 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c0cd810 con 0x7f988c06aee0 2023-08-25T05:38:03.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.390+0000 7f9883fff640 1 --2- 172.21.15.55:0/2267034444 >> v2:172.21.15.110:3300/0 conn(0x7f988c0d0340 0x7f988c06a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:38:03.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.394+0000 7f988ad9d640 1 --2- 172.21.15.55:0/2267034444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f988c06aee0 0x7f988c0cdd30 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7f988c0664a0 tx=0x7f988401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e952dcc5d8f0a30e server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:03.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.394+0000 7f9889d9b640 1 -- 172.21.15.55:0/2267034444 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98840af400 con 0x7f988c06aee0 2023-08-25T05:38:03.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.394+0000 7f9889d9b640 1 -- 172.21.15.55:0/2267034444 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98840ab050 con 0x7f988c06aee0 2023-08-25T05:38:03.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.394+0000 7f9889d9b640 1 -- 172.21.15.55:0/2267034444 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98840af780 con 0x7f988c06aee0 2023-08-25T05:38:03.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.394+0000 7f988b59e640 1 -- 172.21.15.55:0/2267034444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f988c06aee0 msgr2=0x7f988c0cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.394+0000 7f988b59e640 1 --2- 172.21.15.55:0/2267034444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f988c06aee0 0x7f988c0cdd30 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7f988c0664a0 tx=0x7f988401f1c0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.394+0000 7f988b59e640 1 -- 172.21.15.55:0/2267034444 shutdown_connections 2023-08-25T05:38:03.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.394+0000 7f988b59e640 1 --2- 172.21.15.55:0/2267034444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f988c06aee0 0x7f988c0cdd30 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.394+0000 7f988b59e640 1 --2- 172.21.15.55:0/2267034444 >> v2:172.21.15.110:3300/0 conn(0x7f988c0d0340 0x7f988c06a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.394+0000 7f988b59e640 1 --2- 172.21.15.55:0/2267034444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f988c15c9f0 0x7f988c0b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.394+0000 7f988b59e640 1 -- 172.21.15.55:0/2267034444 >> 172.21.15.55:0/2267034444 conn(0x7f988c0d25f0 msgr2=0x7f988c0d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:03.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.394+0000 7f988b59e640 1 -- 172.21.15.55:0/2267034444 shutdown_connections 2023-08-25T05:38:03.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.394+0000 7f988b59e640 1 -- 172.21.15.55:0/2267034444 wait complete. 2023-08-25T05:38:03.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.394+0000 7f988b59e640 1 Processor -- start 2023-08-25T05:38:03.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.394+0000 7f988b59e640 1 -- start start 2023-08-25T05:38:03.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f988b59e640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f988c06aee0 0x7f988c0cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f988b59e640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f988c0d0340 0x7f988c14d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f988b59e640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f988c15c9f0 0x7f988c0b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f988b59e640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c1f1e10 con 0x7f988c0d0340 2023-08-25T05:38:03.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f988b59e640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c1f20f0 con 0x7f988c06aee0 2023-08-25T05:38:03.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f988b59e640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988c1f23d0 con 0x7f988c15c9f0 2023-08-25T05:38:03.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f9883fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f988c0d0340 0x7f988c14d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f9883fff640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f988c0d0340 0x7f988c14d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42642/0 (socket says 172.21.15.55:42642) 2023-08-25T05:38:03.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f9883fff640 1 -- 172.21.15.55:0/3828058350 learned_addr learned my addr 172.21.15.55:0/3828058350 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:03.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f988a59c640 1 --2- 172.21.15.55:0/3828058350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f988c06aee0 0x7f988c0cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f988ad9d640 1 --2- 172.21.15.55:0/3828058350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f988c15c9f0 0x7f988c0b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f9883fff640 1 -- 172.21.15.55:0/3828058350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f988c15c9f0 msgr2=0x7f988c0b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f9883fff640 1 --2- 172.21.15.55:0/3828058350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f988c15c9f0 0x7f988c0b73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f9883fff640 1 -- 172.21.15.55:0/3828058350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f988c06aee0 msgr2=0x7f988c0cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f9883fff640 1 --2- 172.21.15.55:0/3828058350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f988c06aee0 0x7f988c0cbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f9883fff640 1 -- 172.21.15.55:0/3828058350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9874009420 con 0x7f988c0d0340 2023-08-25T05:38:03.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f988a59c640 1 --2- 172.21.15.55:0/3828058350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f988c06aee0 0x7f988c0cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:38:03.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f9883fff640 1 --2- 172.21.15.55:0/3828058350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f988c0d0340 0x7f988c14d900 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f987400e9b0 tx=0x7f987400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:03.402 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f9882ffd640 1 -- 172.21.15.55:0/3828058350 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9874009700 con 0x7f988c0d0340 2023-08-25T05:38:03.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f9882ffd640 1 -- 172.21.15.55:0/3828058350 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987400ca00 con 0x7f988c0d0340 2023-08-25T05:38:03.403 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f9882ffd640 1 -- 172.21.15.55:0/3828058350 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987400cd90 con 0x7f988c0d0340 2023-08-25T05:38:03.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f988b59e640 1 -- 172.21.15.55:0/3828058350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9884009b30 con 0x7f988c0d0340 2023-08-25T05:38:03.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f988b59e640 1 -- 172.21.15.55:0/3828058350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988c1f2990 con 0x7f988c0d0340 2023-08-25T05:38:03.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f988b59e640 1 -- 172.21.15.55:0/3828058350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988c066d20 con 0x7f988c0d0340 2023-08-25T05:38:03.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.398+0000 7f9882ffd640 1 -- 172.21.15.55:0/3828058350 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f9874013470 con 0x7f988c0d0340 2023-08-25T05:38:03.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.402+0000 7f9882ffd640 1 --2- 172.21.15.55:0/3828058350 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f986c0657d0 0x7f986c067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.402+0000 7f9882ffd640 1 -- 172.21.15.55:0/3828058350 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f9874083250 con 0x7f988c0d0340 2023-08-25T05:38:03.404 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.402+0000 7f988a59c640 1 --2- 172.21.15.55:0/3828058350 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f986c0657d0 0x7f986c067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.402+0000 7f988a59c640 1 --2- 172.21.15.55:0/3828058350 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f986c0657d0 0x7f986c067c90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f988c0b8020 tx=0x7f987c008040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:03.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.406+0000 7f9882ffd640 1 -- 172.21.15.55:0/3828058350 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9874050bd0 con 0x7f988c0d0340 2023-08-25T05:38:03.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.558+0000 7f988b59e640 1 -- 172.21.15.55:0/3828058350 --> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f988c1f2260 con 0x7f986c0657d0 2023-08-25T05:38:03.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.562+0000 7f9882ffd640 1 -- 172.21.15.55:0/3828058350 <== mgr.9404 v2:172.21.15.110:6832/1527806048 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f988c1f2260 con 0x7f986c0657d0 2023-08-25T05:38:03.563 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 6 to deep-scrub 2023-08-25T05:38:03.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.562+0000 7f988b59e640 1 -- 172.21.15.55:0/3828058350 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f986c0657d0 msgr2=0x7f986c067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.562+0000 7f988b59e640 1 --2- 172.21.15.55:0/3828058350 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f986c0657d0 0x7f986c067c90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f988c0b8020 tx=0x7f987c008040 comp rx=0 tx=0).stop 2023-08-25T05:38:03.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.562+0000 7f988b59e640 1 -- 172.21.15.55:0/3828058350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f988c0d0340 msgr2=0x7f988c14d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.562+0000 7f988b59e640 1 --2- 172.21.15.55:0/3828058350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f988c0d0340 0x7f988c14d900 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7f987400e9b0 tx=0x7f987400ee70 comp rx=0 tx=0).stop 2023-08-25T05:38:03.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.562+0000 7f988b59e640 1 -- 172.21.15.55:0/3828058350 shutdown_connections 2023-08-25T05:38:03.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.562+0000 7f988b59e640 1 --2- 172.21.15.55:0/3828058350 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f986c0657d0 0x7f986c067c90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.562+0000 7f988b59e640 1 --2- 172.21.15.55:0/3828058350 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f988c15c9f0 0x7f988c0b73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.562+0000 7f988b59e640 1 --2- 172.21.15.55:0/3828058350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f988c0d0340 0x7f988c14d900 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.562+0000 7f988b59e640 1 --2- 172.21.15.55:0/3828058350 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f988c06aee0 0x7f988c0cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.562+0000 7f988b59e640 1 -- 172.21.15.55:0/3828058350 >> 172.21.15.55:0/3828058350 conn(0x7f988c0d25f0 msgr2=0x7f988c0afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:03.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.562+0000 7f988b59e640 1 -- 172.21.15.55:0/3828058350 shutdown_connections 2023-08-25T05:38:03.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.562+0000 7f988b59e640 1 -- 172.21.15.55:0/3828058350 wait complete. 2023-08-25T05:38:03.585 INFO:tasks.ceph:Scrubbing osd.7 2023-08-25T05:38:03.585 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-08-25T05:38:03.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f602872c640 1 Processor -- start 2023-08-25T05:38:03.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f602872c640 1 -- start start 2023-08-25T05:38:03.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f602872c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6020155360 0x7f602015c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f602872c640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f602006fb50 0x7f60200aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f602872c640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602015fa50 con 0x7f6020155740 2023-08-25T05:38:03.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f602872c640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602015f2a0 con 0x7f602006fb50 2023-08-25T05:38:03.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f602872c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602015f490 con 0x7f6020155360 2023-08-25T05:38:03.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f6025cc7640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6020155740 0x7f602015eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37642/0 (socket says 172.21.15.55:37642) 2023-08-25T05:38:03.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f6025cc7640 1 -- 172.21.15.55:0/4050544702 learned_addr learned my addr 172.21.15.55:0/4050544702 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:38:03.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60264c8640 1 --2- 172.21.15.55:0/4050544702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6020155360 0x7f602015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f6026cc9640 1 --2- 172.21.15.55:0/4050544702 >> v2:172.21.15.110:3300/0 conn(0x7f602006fb50 0x7f60200aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60254c6640 1 -- 172.21.15.55:0/4050544702 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092479139 0 0) 0x7f602015fa50 con 0x7f6020155740 2023-08-25T05:38:03.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60254c6640 1 -- 172.21.15.55:0/4050544702 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f600c003530 con 0x7f6020155740 2023-08-25T05:38:03.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60254c6640 1 -- 172.21.15.55:0/4050544702 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3086343203 0 0) 0x7f600c003530 con 0x7f6020155740 2023-08-25T05:38:03.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60254c6640 1 -- 172.21.15.55:0/4050544702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6020155360 msgr2=0x7f602015c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:03.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60254c6640 1 --2- 172.21.15.55:0/4050544702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6020155360 0x7f602015c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60254c6640 1 -- 172.21.15.55:0/4050544702 >> v2:172.21.15.110:3300/0 conn(0x7f602006fb50 msgr2=0x7f60200aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:03.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60254c6640 1 --2- 172.21.15.55:0/4050544702 >> v2:172.21.15.110:3300/0 conn(0x7f602006fb50 0x7f60200aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60254c6640 1 -- 172.21.15.55:0/4050544702 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602015f770 con 0x7f6020155740 2023-08-25T05:38:03.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60254c6640 1 -- 172.21.15.55:0/4050544702 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f6010001680 con 0x7f6020155740 2023-08-25T05:38:03.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60254c6640 1 -- 172.21.15.55:0/4050544702 >> v1:172.21.15.55:6789/0 conn(0x7f6020155740 legacy=0x7f602015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60254c6640 1 --2- 172.21.15.55:0/4050544702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c003980 0x7f600c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60254c6640 1 --2- 172.21.15.55:0/4050544702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f600c0047d0 0x7f600c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60254c6640 1 --2- 172.21.15.55:0/4050544702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f600c005190 0x7f600c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60254c6640 1 -- 172.21.15.55:0/4050544702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602015f490 con 0x7f600c0047d0 2023-08-25T05:38:03.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60254c6640 1 -- 172.21.15.55:0/4050544702 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c00bf30 con 0x7f600c003980 2023-08-25T05:38:03.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60254c6640 1 -- 172.21.15.55:0/4050544702 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600c00c0f0 con 0x7f600c005190 2023-08-25T05:38:03.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60264c8640 1 --2- 172.21.15.55:0/4050544702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6020155360 0x7f602015c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:38:03.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f6025cc7640 1 --2- 172.21.15.55:0/4050544702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f600c0047d0 0x7f600c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f6026cc9640 1 --2- 172.21.15.55:0/4050544702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f600c005190 0x7f600c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f60264c8640 1 --2- 172.21.15.55:0/4050544702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c003980 0x7f600c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f6025cc7640 1 -- 172.21.15.55:0/4050544702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f600c005190 msgr2=0x7f600c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f6025cc7640 1 --2- 172.21.15.55:0/4050544702 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f600c005190 0x7f600c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f6025cc7640 1 -- 172.21.15.55:0/4050544702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c003980 msgr2=0x7f600c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f6025cc7640 1 --2- 172.21.15.55:0/4050544702 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f600c003980 0x7f600c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.730+0000 7f6025cc7640 1 -- 172.21.15.55:0/4050544702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c003530 con 0x7f600c0047d0 2023-08-25T05:38:03.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.734+0000 7f6025cc7640 1 --2- 172.21.15.55:0/4050544702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f600c0047d0 0x7f600c004c50 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f6010007ce0 tx=0x7f6010021050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9cc9d7f49e3e44 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:03.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.734+0000 7f60254c6640 1 -- 172.21.15.55:0/4050544702 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60100a9c40 con 0x7f600c0047d0 2023-08-25T05:38:03.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.734+0000 7f60254c6640 1 -- 172.21.15.55:0/4050544702 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60100a9da0 con 0x7f600c0047d0 2023-08-25T05:38:03.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.734+0000 7f60254c6640 1 -- 172.21.15.55:0/4050544702 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010005b00 con 0x7f600c0047d0 2023-08-25T05:38:03.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.734+0000 7f602872c640 1 -- 172.21.15.55:0/4050544702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f600c0047d0 msgr2=0x7f600c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.734+0000 7f602872c640 1 --2- 172.21.15.55:0/4050544702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f600c0047d0 0x7f600c004c50 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f6010007ce0 tx=0x7f6010021050 comp rx=0 tx=0).stop 2023-08-25T05:38:03.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.734+0000 7f6026cc9640 1 -- 172.21.15.55:0/4050544702 reap_dead start 2023-08-25T05:38:03.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.734+0000 7f602872c640 1 -- 172.21.15.55:0/4050544702 shutdown_connections 2023-08-25T05:38:03.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.734+0000 7f602872c640 1 -- 172.21.15.55:0/4050544702 >> 172.21.15.55:0/4050544702 conn(0x7f60200caf90 msgr2=0x7f60200cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:03.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.734+0000 7f602872c640 1 -- 172.21.15.55:0/4050544702 shutdown_connections 2023-08-25T05:38:03.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.734+0000 7f602872c640 1 -- 172.21.15.55:0/4050544702 wait complete. 2023-08-25T05:38:03.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f602872c640 1 Processor -- start 2023-08-25T05:38:03.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f602872c640 1 -- start start 2023-08-25T05:38:03.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f602872c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f600c0047d0 0x7f60200c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f602872c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6020159100 0x7f602014f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f602872c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f602014fb90 0x7f60200c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f602872c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6020153860 con 0x7f6020159100 2023-08-25T05:38:03.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f602872c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6020152970 con 0x7f602014fb90 2023-08-25T05:38:03.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f602872c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6020152c50 con 0x7f600c0047d0 2023-08-25T05:38:03.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f6025cc7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6020159100 0x7f602014f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f6025cc7640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6020159100 0x7f602014f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42662/0 (socket says 172.21.15.55:42662) 2023-08-25T05:38:03.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f6025cc7640 1 -- 172.21.15.55:0/3382828505 learned_addr learned my addr 172.21.15.55:0/3382828505 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:03.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f60264c8640 1 --2- 172.21.15.55:0/3382828505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f600c0047d0 0x7f60200c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.746 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f6026cc9640 1 --2- 172.21.15.55:0/3382828505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f602014fb90 0x7f60200c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f6025cc7640 1 -- 172.21.15.55:0/3382828505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f600c0047d0 msgr2=0x7f60200c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f6025cc7640 1 --2- 172.21.15.55:0/3382828505 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f600c0047d0 0x7f60200c42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f6025cc7640 1 -- 172.21.15.55:0/3382828505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f602014fb90 msgr2=0x7f60200c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f6025cc7640 1 --2- 172.21.15.55:0/3382828505 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f602014fb90 0x7f60200c5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f6025cc7640 1 -- 172.21.15.55:0/3382828505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6020152f30 con 0x7f6020159100 2023-08-25T05:38:03.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f6025cc7640 1 --2- 172.21.15.55:0/3382828505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6020159100 0x7f602014f650 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f60100af040 tx=0x7f600c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:03.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f6016ffd640 1 -- 172.21.15.55:0/3382828505 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60100049f0 con 0x7f6020159100 2023-08-25T05:38:03.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f6016ffd640 1 -- 172.21.15.55:0/3382828505 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60100b7070 con 0x7f6020159100 2023-08-25T05:38:03.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f6016ffd640 1 -- 172.21.15.55:0/3382828505 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010004d90 con 0x7f6020159100 2023-08-25T05:38:03.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.738+0000 7f602872c640 1 -- 172.21.15.55:0/3382828505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6020153210 con 0x7f6020159100 2023-08-25T05:38:03.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.742+0000 7f602872c640 1 -- 172.21.15.55:0/3382828505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60200c4810 con 0x7f6020159100 2023-08-25T05:38:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.742+0000 7f602872c640 1 -- 172.21.15.55:0/3382828505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60201536c0 con 0x7f6020159100 2023-08-25T05:38:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.742+0000 7f6016ffd640 1 -- 172.21.15.55:0/3382828505 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f60100070d0 con 0x7f6020159100 2023-08-25T05:38:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.742+0000 7f6016ffd640 1 --2- 172.21.15.55:0/3382828505 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f60040657d0 0x7f6004067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.742+0000 7f6016ffd640 1 -- 172.21.15.55:0/3382828505 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f60100b9070 con 0x7f6020159100 2023-08-25T05:38:03.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.742+0000 7f6016ffd640 1 --2- 172.21.15.55:0/3382828505 >> [v2:172.21.15.110:6808/2557570989,v1:172.21.15.110:6809/2557570989] conn(0x7f600406c240 0x7f600406e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.742+0000 7f6016ffd640 1 -- 172.21.15.55:0/3382828505 --> [v2:172.21.15.110:6808/2557570989,v1:172.21.15.110:6809/2557570989] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f600406ed10 con 0x7f600406c240 2023-08-25T05:38:03.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.742+0000 7f6016ffd640 1 -- 172.21.15.55:0/3382828505 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=207) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60101252a0 con 0x7f6020159100 2023-08-25T05:38:03.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.742+0000 7f60264c8640 1 --2- 172.21.15.55:0/3382828505 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f60040657d0 0x7f6004067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.742+0000 7f6026cc9640 1 --2- 172.21.15.55:0/3382828505 >> [v2:172.21.15.110:6808/2557570989,v1:172.21.15.110:6809/2557570989] conn(0x7f600406c240 0x7f600406e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.742+0000 7f60264c8640 1 --2- 172.21.15.55:0/3382828505 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f60040657d0 0x7f6004067c90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f602006eca0 tx=0x7f601c009190 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:03.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.746+0000 7f6026cc9640 1 --2- 172.21.15.55:0/3382828505 >> [v2:172.21.15.110:6808/2557570989,v1:172.21.15.110:6809/2557570989] conn(0x7f600406c240 0x7f600406e660 crc :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:03.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.746+0000 7f6016ffd640 1 -- 172.21.15.55:0/3382828505 <== osd.7 v2:172.21.15.110:6808/2557570989 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f600406ed10 con 0x7f600406c240 2023-08-25T05:38:03.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.758+0000 7f602872c640 1 -- 172.21.15.55:0/3382828505 --> [v2:172.21.15.110:6808/2557570989,v1:172.21.15.110:6809/2557570989] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f60200b04d0 con 0x7f600406c240 2023-08-25T05:38:03.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.758+0000 7f6016ffd640 1 -- 172.21.15.55:0/3382828505 <== osd.7 v2:172.21.15.110:6808/2557570989 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f601800f040 con 0x7f600406c240 2023-08-25T05:38:03.762 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2023-08-25T05:38:03.762 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-25T05:38:03.762 INFO:teuthology.orchestra.run.smithi055.stdout:} 2023-08-25T05:38:03.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.758+0000 7f602872c640 1 -- 172.21.15.55:0/3382828505 >> [v2:172.21.15.110:6808/2557570989,v1:172.21.15.110:6809/2557570989] conn(0x7f600406c240 msgr2=0x7f600406e660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.758+0000 7f602872c640 1 --2- 172.21.15.55:0/3382828505 >> [v2:172.21.15.110:6808/2557570989,v1:172.21.15.110:6809/2557570989] conn(0x7f600406c240 0x7f600406e660 crc :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.758+0000 7f602872c640 1 -- 172.21.15.55:0/3382828505 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f60040657d0 msgr2=0x7f6004067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.758+0000 7f602872c640 1 --2- 172.21.15.55:0/3382828505 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f60040657d0 0x7f6004067c90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f602006eca0 tx=0x7f601c009190 comp rx=0 tx=0).stop 2023-08-25T05:38:03.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.758+0000 7f602872c640 1 -- 172.21.15.55:0/3382828505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6020159100 msgr2=0x7f602014f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.758+0000 7f602872c640 1 --2- 172.21.15.55:0/3382828505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6020159100 0x7f602014f650 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f60100af040 tx=0x7f600c005800 comp rx=0 tx=0).stop 2023-08-25T05:38:03.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.758+0000 7f6026cc9640 1 -- 172.21.15.55:0/3382828505 reap_dead start 2023-08-25T05:38:03.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.758+0000 7f602872c640 1 -- 172.21.15.55:0/3382828505 shutdown_connections 2023-08-25T05:38:03.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.758+0000 7f602872c640 1 -- 172.21.15.55:0/3382828505 >> 172.21.15.55:0/3382828505 conn(0x7f60200caf90 msgr2=0x7f60200c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:03.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.758+0000 7f602872c640 1 -- 172.21.15.55:0/3382828505 shutdown_connections 2023-08-25T05:38:03.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.758+0000 7f602872c640 1 -- 172.21.15.55:0/3382828505 wait complete. 2023-08-25T05:38:03.780 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-08-25T05:38:03.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.922+0000 7fb55f0e5640 1 Processor -- start 2023-08-25T05:38:03.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.922+0000 7fb55f0e5640 1 -- start start 2023-08-25T05:38:03.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.922+0000 7fb55f0e5640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb5580ad950 0x7fb5580cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.922+0000 7fb55f0e5640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb5580c89f0 0x7fb5580ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.922+0000 7fb55f0e5640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5580b2650 con 0x7fb55806c000 2023-08-25T05:38:03.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.922+0000 7fb55f0e5640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5580b11f0 con 0x7fb5580ad950 2023-08-25T05:38:03.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.922+0000 7fb55f0e5640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb558159d50 con 0x7fb5580c89f0 2023-08-25T05:38:03.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.922+0000 7fb55ce81640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb5580ad950 0x7fb5580cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.922+0000 7fb55ce81640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb5580ad950 0x7fb5580cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42668/0 (socket says 172.21.15.55:42668) 2023-08-25T05:38:03.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.922+0000 7fb55ce81640 1 -- 172.21.15.55:0/3420053949 learned_addr learned my addr 172.21.15.55:0/3420053949 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:03.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.922+0000 7fb54ffff640 1 --2- 172.21.15.55:0/3420053949 >> v2:172.21.15.110:3300/0 conn(0x7fb5580c89f0 0x7fb5580ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.922+0000 7fb55ce81640 1 -- 172.21.15.55:0/3420053949 >> v2:172.21.15.110:3300/0 conn(0x7fb5580c89f0 msgr2=0x7fb5580ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:03.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.922+0000 7fb55ce81640 1 --2- 172.21.15.55:0/3420053949 >> v2:172.21.15.110:3300/0 conn(0x7fb5580c89f0 0x7fb5580ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.922+0000 7fb55ce81640 1 -- 172.21.15.55:0/3420053949 >> v1:172.21.15.110:6789/0 conn(0x7fb55806c000 legacy=0x7fb55815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:03.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.922+0000 7fb55ce81640 1 -- 172.21.15.55:0/3420053949 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5580cc880 con 0x7fb5580ad950 2023-08-25T05:38:03.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.926+0000 7fb55ce81640 1 --2- 172.21.15.55:0/3420053949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5580ad950 0x7fb5580cc2a0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7fb55806df00 tx=0x7fb55401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36abaf10a837094b server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:03.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.926+0000 7fb54f7fe640 1 -- 172.21.15.55:0/3420053949 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554004230 con 0x7fb5580ad950 2023-08-25T05:38:03.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.926+0000 7fb54f7fe640 1 -- 172.21.15.55:0/3420053949 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5540a7050 con 0x7fb5580ad950 2023-08-25T05:38:03.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.926+0000 7fb54f7fe640 1 -- 172.21.15.55:0/3420053949 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554003620 con 0x7fb5580ad950 2023-08-25T05:38:03.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.926+0000 7fb55f0e5640 1 -- 172.21.15.55:0/3420053949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5580ad950 msgr2=0x7fb5580cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.926+0000 7fb55f0e5640 1 --2- 172.21.15.55:0/3420053949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5580ad950 0x7fb5580cc2a0 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7fb55806df00 tx=0x7fb55401c440 comp rx=0 tx=0).stop 2023-08-25T05:38:03.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.926+0000 7fb55f0e5640 1 -- 172.21.15.55:0/3420053949 shutdown_connections 2023-08-25T05:38:03.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.926+0000 7fb55f0e5640 1 --2- 172.21.15.55:0/3420053949 >> v2:172.21.15.110:3300/0 conn(0x7fb5580c89f0 0x7fb5580ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.926+0000 7fb55f0e5640 1 --2- 172.21.15.55:0/3420053949 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5580ad950 0x7fb5580cc2a0 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.926+0000 7fb55f0e5640 1 -- 172.21.15.55:0/3420053949 >> 172.21.15.55:0/3420053949 conn(0x7fb558069d00 msgr2=0x7fb55806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:03.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.926+0000 7fb55f0e5640 1 -- 172.21.15.55:0/3420053949 shutdown_connections 2023-08-25T05:38:03.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.926+0000 7fb55f0e5640 1 -- 172.21.15.55:0/3420053949 wait complete. 2023-08-25T05:38:03.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.926+0000 7fb55f0e5640 1 Processor -- start 2023-08-25T05:38:03.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.926+0000 7fb55f0e5640 1 -- start start 2023-08-25T05:38:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55f0e5640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb55806c000 0x7fb5580712e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55f0e5640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5580ad950 0x7fb55815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55f0e5640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5580c89f0 0x7fb5581628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55f0e5640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb558156be0 con 0x7fb5580c89f0 2023-08-25T05:38:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55f0e5640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb558155c80 con 0x7fb5580ad950 2023-08-25T05:38:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55f0e5640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb558155f60 con 0x7fb55806c000 2023-08-25T05:38:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55d682640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5580c89f0 0x7fb5581628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55ce81640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb55806c000 0x7fb5580712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55ce81640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb55806c000 0x7fb5580712e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.55:58170/0 (socket says 172.21.15.55:58170) 2023-08-25T05:38:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55ce81640 1 -- 172.21.15.55:0/2176900226 learned_addr learned my addr 172.21.15.55:0/2176900226 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb54ffff640 1 --2- 172.21.15.55:0/2176900226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5580ad950 0x7fb55815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55d682640 1 -- 172.21.15.55:0/2176900226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb55806c000 msgr2=0x7fb5580712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55d682640 1 --2- 172.21.15.55:0/2176900226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb55806c000 0x7fb5580712e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55d682640 1 -- 172.21.15.55:0/2176900226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5580ad950 msgr2=0x7fb55815c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55d682640 1 --2- 172.21.15.55:0/2176900226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5580ad950 0x7fb55815c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55d682640 1 -- 172.21.15.55:0/2176900226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5540094d0 con 0x7fb5580c89f0 2023-08-25T05:38:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55ce81640 1 --2- 172.21.15.55:0/2176900226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb55806c000 0x7fb5580712e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:38:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55d682640 1 --2- 172.21.15.55:0/2176900226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5580c89f0 0x7fb5581628d0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7fb55000c700 tx=0x7fb55000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb54d7fa640 1 -- 172.21.15.55:0/2176900226 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb550003b80 con 0x7fb5580c89f0 2023-08-25T05:38:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb54d7fa640 1 -- 172.21.15.55:0/2176900226 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb550003ce0 con 0x7fb5580c89f0 2023-08-25T05:38:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55f0e5640 1 -- 172.21.15.55:0/2176900226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb558156240 con 0x7fb5580c89f0 2023-08-25T05:38:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb54d7fa640 1 -- 172.21.15.55:0/2176900226 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb550005310 con 0x7fb5580c89f0 2023-08-25T05:38:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55f0e5640 1 -- 172.21.15.55:0/2176900226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb558156800 con 0x7fb5580c89f0 2023-08-25T05:38:03.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.930+0000 7fb55f0e5640 1 -- 172.21.15.55:0/2176900226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb558156f00 con 0x7fb5580c89f0 2023-08-25T05:38:03.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.934+0000 7fb54d7fa640 1 -- 172.21.15.55:0/2176900226 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fb550005470 con 0x7fb5580c89f0 2023-08-25T05:38:03.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.934+0000 7fb54d7fa640 1 --2- 172.21.15.55:0/2176900226 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fb5440657a0 0x7fb544067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.934+0000 7fb54d7fa640 1 -- 172.21.15.55:0/2176900226 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fb550082b90 con 0x7fb5580c89f0 2023-08-25T05:38:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.934+0000 7fb55ce81640 1 --2- 172.21.15.55:0/2176900226 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fb5440657a0 0x7fb544067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.934+0000 7fb55ce81640 1 --2- 172.21.15.55:0/2176900226 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fb5440657a0 0x7fb544067c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb55401c480 tx=0x7fb5540a6000 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:03.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:03.938+0000 7fb54d7fa640 1 -- 172.21.15.55:0/2176900226 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fb5500505c0 con 0x7fb5580c89f0 2023-08-25T05:38:04.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.090+0000 7fb55f0e5640 1 -- 172.21.15.55:0/2176900226 --> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5580cd120 con 0x7fb5440657a0 2023-08-25T05:38:04.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.094+0000 7fb54d7fa640 1 -- 172.21.15.55:0/2176900226 <== mgr.9404 v2:172.21.15.110:6832/1527806048 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb5540036a0 con 0x7fb5440657a0 2023-08-25T05:38:04.095 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 7 to deep-scrub 2023-08-25T05:38:04.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.094+0000 7fb55f0e5640 1 -- 172.21.15.55:0/2176900226 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fb5440657a0 msgr2=0x7fb544067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:04.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.094+0000 7fb55f0e5640 1 --2- 172.21.15.55:0/2176900226 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fb5440657a0 0x7fb544067c60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb55401c480 tx=0x7fb5540a6000 comp rx=0 tx=0).stop 2023-08-25T05:38:04.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.094+0000 7fb55f0e5640 1 -- 172.21.15.55:0/2176900226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5580c89f0 msgr2=0x7fb5581628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:04.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.094+0000 7fb55f0e5640 1 --2- 172.21.15.55:0/2176900226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5580c89f0 0x7fb5581628d0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7fb55000c700 tx=0x7fb55000cbc0 comp rx=0 tx=0).stop 2023-08-25T05:38:04.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.094+0000 7fb55f0e5640 1 -- 172.21.15.55:0/2176900226 shutdown_connections 2023-08-25T05:38:04.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.094+0000 7fb55f0e5640 1 --2- 172.21.15.55:0/2176900226 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fb5440657a0 0x7fb544067c60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:04.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.094+0000 7fb55f0e5640 1 --2- 172.21.15.55:0/2176900226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5580c89f0 0x7fb5581628d0 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:04.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.094+0000 7fb55f0e5640 1 --2- 172.21.15.55:0/2176900226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb5580ad950 0x7fb55815c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:04.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.094+0000 7fb55f0e5640 1 --2- 172.21.15.55:0/2176900226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb55806c000 0x7fb5580712e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:04.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.094+0000 7fb55f0e5640 1 -- 172.21.15.55:0/2176900226 >> 172.21.15.55:0/2176900226 conn(0x7fb558069d00 msgr2=0x7fb5580c9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:04.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.094+0000 7fb55f0e5640 1 -- 172.21.15.55:0/2176900226 shutdown_connections 2023-08-25T05:38:04.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.094+0000 7fb55f0e5640 1 -- 172.21.15.55:0/2176900226 wait complete. 2023-08-25T05:38:04.116 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:38:04.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.258+0000 7f9ab63e1640 1 Processor -- start 2023-08-25T05:38:04.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.258+0000 7f9ab63e1640 1 -- start start 2023-08-25T05:38:04.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.262+0000 7f9ab63e1640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ab00aeb10 0x7f9ab00ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:04.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.262+0000 7f9ab63e1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ab006a010 0x7f9ab00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:04.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.262+0000 7f9ab63e1640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab00cf2b0 con 0x7f9ab00cee20 2023-08-25T05:38:04.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.262+0000 7f9ab63e1640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab00d0380 con 0x7f9ab00aeb10 2023-08-25T05:38:04.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.262+0000 7f9ab63e1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab006d590 con 0x7f9ab006a010 2023-08-25T05:38:04.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.262+0000 7f9aaffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ab00aeb10 0x7f9ab00ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:04.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.262+0000 7f9aaffff640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ab00aeb10 0x7f9ab00ce8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42682/0 (socket says 172.21.15.55:42682) 2023-08-25T05:38:04.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.262+0000 7f9aaffff640 1 -- 172.21.15.55:0/2473288405 learned_addr learned my addr 172.21.15.55:0/2473288405 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:04.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.262+0000 7f9aaffff640 1 -- 172.21.15.55:0/2473288405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ab006a010 msgr2=0x7f9ab00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:04.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.262+0000 7f9ab497e640 1 --2- 172.21.15.55:0/2473288405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ab006a010 0x7f9ab00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:04.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.262+0000 7f9aaffff640 1 --2- 172.21.15.55:0/2473288405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ab006a010 0x7f9ab00cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:04.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.262+0000 7f9aaffff640 1 -- 172.21.15.55:0/2473288405 >> v1:172.21.15.110:6789/0 conn(0x7f9ab00cee20 legacy=0x7f9ab0069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:04.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.262+0000 7f9aaffff640 1 -- 172.21.15.55:0/2473288405 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab006c4f0 con 0x7f9ab00aeb10 2023-08-25T05:38:04.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.262+0000 7f9ab497e640 1 --2- 172.21.15.55:0/2473288405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ab006a010 0x7f9ab00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-25T05:38:04.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.262+0000 7f9aaffff640 1 --2- 172.21.15.55:0/2473288405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ab00aeb10 0x7f9ab00ce8e0 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009870 tx=0x7f9aa001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205065287b015a01 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:04.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9aaeffd640 1 -- 172.21.15.55:0/2473288405 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa00a7070 con 0x7f9ab00aeb10 2023-08-25T05:38:04.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9aaeffd640 1 -- 172.21.15.55:0/2473288405 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa00ab430 con 0x7f9ab00aeb10 2023-08-25T05:38:04.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9aaeffd640 1 -- 172.21.15.55:0/2473288405 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa00ab7c0 con 0x7f9ab00aeb10 2023-08-25T05:38:04.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9ab63e1640 1 -- 172.21.15.55:0/2473288405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ab00aeb10 msgr2=0x7f9ab00ce8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:04.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9ab63e1640 1 --2- 172.21.15.55:0/2473288405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ab00aeb10 0x7f9ab00ce8e0 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009870 tx=0x7f9aa001c540 comp rx=0 tx=0).stop 2023-08-25T05:38:04.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9ab63e1640 1 -- 172.21.15.55:0/2473288405 shutdown_connections 2023-08-25T05:38:04.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9ab63e1640 1 --2- 172.21.15.55:0/2473288405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ab006a010 0x7f9ab00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:04.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9ab63e1640 1 --2- 172.21.15.55:0/2473288405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ab00aeb10 0x7f9ab00ce8e0 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:04.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9ab63e1640 1 -- 172.21.15.55:0/2473288405 >> 172.21.15.55:0/2473288405 conn(0x7f9ab00cf530 msgr2=0x7f9ab00cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:04.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9ab63e1640 1 -- 172.21.15.55:0/2473288405 shutdown_connections 2023-08-25T05:38:04.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9ab63e1640 1 -- 172.21.15.55:0/2473288405 wait complete. 2023-08-25T05:38:04.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9ab63e1640 1 Processor -- start 2023-08-25T05:38:04.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9ab63e1640 1 -- start start 2023-08-25T05:38:04.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9ab63e1640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ab006a010 0x7f9ab00c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:04.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9ab63e1640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ab00aeb10 0x7f9ab00c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:04.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9ab63e1640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ab00cee20 0x7f9ab015c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:04.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9ab63e1640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab015bc10 con 0x7f9ab00aeb10 2023-08-25T05:38:04.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9ab63e1640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00c4dd0 con 0x7f9ab006a010 2023-08-25T05:38:04.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9ab63e1640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab00c3060 con 0x7f9ab00cee20 2023-08-25T05:38:04.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9aaf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ab00aeb10 0x7f9ab00c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:04.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9aaf7fe640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ab00aeb10 0x7f9ab00c4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42694/0 (socket says 172.21.15.55:42694) 2023-08-25T05:38:04.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9aaf7fe640 1 -- 172.21.15.55:0/1733416582 learned_addr learned my addr 172.21.15.55:0/1733416582 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:04.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9aaffff640 1 --2- 172.21.15.55:0/1733416582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ab006a010 0x7f9ab00c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:04.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.266+0000 7f9ab497e640 1 --2- 172.21.15.55:0/1733416582 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ab00cee20 0x7f9ab015c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:04.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.270+0000 7f9aaf7fe640 1 -- 172.21.15.55:0/1733416582 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ab00cee20 msgr2=0x7f9ab015c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:04.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.270+0000 7f9aaf7fe640 1 --2- 172.21.15.55:0/1733416582 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ab00cee20 0x7f9ab015c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:04.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.270+0000 7f9aaf7fe640 1 -- 172.21.15.55:0/1733416582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ab006a010 msgr2=0x7f9ab00c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:04.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.270+0000 7f9aaf7fe640 1 --2- 172.21.15.55:0/1733416582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ab006a010 0x7f9ab00c5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:04.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.270+0000 7f9aaf7fe640 1 -- 172.21.15.55:0/1733416582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa00094d0 con 0x7f9ab00aeb10 2023-08-25T05:38:04.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.270+0000 7f9aaf7fe640 1 --2- 172.21.15.55:0/1733416582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ab00aeb10 0x7f9ab00c4740 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400c3c0 tx=0x7f9aa400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:04.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.270+0000 7f9aacff9640 1 -- 172.21.15.55:0/1733416582 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40052d0 con 0x7f9ab00aeb10 2023-08-25T05:38:04.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.270+0000 7f9aacff9640 1 -- 172.21.15.55:0/1733416582 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa4005430 con 0x7f9ab00aeb10 2023-08-25T05:38:04.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.270+0000 7f9aacff9640 1 -- 172.21.15.55:0/1733416582 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4003840 con 0x7f9ab00aeb10 2023-08-25T05:38:04.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.270+0000 7f9ab63e1640 1 -- 172.21.15.55:0/1733416582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab00c3340 con 0x7f9ab00aeb10 2023-08-25T05:38:04.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.270+0000 7f9ab63e1640 1 -- 172.21.15.55:0/1733416582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab00c3900 con 0x7f9ab00aeb10 2023-08-25T05:38:04.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.270+0000 7f9ab63e1640 1 -- 172.21.15.55:0/1733416582 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab004dbe0 con 0x7f9ab00aeb10 2023-08-25T05:38:04.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.270+0000 7f9aacff9640 1 -- 172.21.15.55:0/1733416582 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f9aa40039a0 con 0x7f9ab00aeb10 2023-08-25T05:38:04.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.270+0000 7f9aacff9640 1 --2- 172.21.15.55:0/1733416582 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f9a9c0657a0 0x7f9a9c067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:04.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.270+0000 7f9aacff9640 1 -- 172.21.15.55:0/1733416582 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f9aa4082420 con 0x7f9ab00aeb10 2023-08-25T05:38:04.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.274+0000 7f9aaffff640 1 --2- 172.21.15.55:0/1733416582 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f9a9c0657a0 0x7f9a9c067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:04.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.274+0000 7f9aaffff640 1 --2- 172.21.15.55:0/1733416582 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f9a9c0657a0 0x7f9a9c067c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00af000 tx=0x7f9aa0008040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:04.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.274+0000 7f9aacff9640 1 -- 172.21.15.55:0/1733416582 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f9aa404fe50 con 0x7f9ab00aeb10 2023-08-25T05:38:04.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.430+0000 7f9ab63e1640 1 -- 172.21.15.55:0/1733416582 --> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ab006d070 con 0x7f9a9c0657a0 2023-08-25T05:38:04.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.434+0000 7f9aacff9640 1 -- 172.21.15.55:0/1733416582 <== mgr.9404 v2:172.21.15.110:6832/1527806048 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72723 (secure 0 0 0) 0x7f9aa00bc090 con 0x7f9a9c0657a0 2023-08-25T05:38:04.438 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:38:04.439 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:38:04.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.438+0000 7f9ab63e1640 1 -- 172.21.15.55:0/1733416582 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f9a9c0657a0 msgr2=0x7f9a9c067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:04.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.438+0000 7f9ab63e1640 1 --2- 172.21.15.55:0/1733416582 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f9a9c0657a0 0x7f9a9c067c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00af000 tx=0x7f9aa0008040 comp rx=0 tx=0).stop 2023-08-25T05:38:04.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.438+0000 7f9ab63e1640 1 -- 172.21.15.55:0/1733416582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ab00aeb10 msgr2=0x7f9ab00c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:04.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.438+0000 7f9ab63e1640 1 --2- 172.21.15.55:0/1733416582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ab00aeb10 0x7f9ab00c4740 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400c3c0 tx=0x7f9aa400c880 comp rx=0 tx=0).stop 2023-08-25T05:38:04.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.438+0000 7f9ab63e1640 1 -- 172.21.15.55:0/1733416582 shutdown_connections 2023-08-25T05:38:04.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.438+0000 7f9ab63e1640 1 --2- 172.21.15.55:0/1733416582 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f9a9c0657a0 0x7f9a9c067c60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:04.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.438+0000 7f9ab63e1640 1 --2- 172.21.15.55:0/1733416582 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ab00cee20 0x7f9ab015c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:04.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.438+0000 7f9ab63e1640 1 --2- 172.21.15.55:0/1733416582 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ab00aeb10 0x7f9ab00c4740 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.438+0000 7f9ab63e1640 1 --2- 172.21.15.55:0/1733416582 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ab006a010 0x7f9ab00c5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.438+0000 7f9ab63e1640 1 -- 172.21.15.55:0/1733416582 >> 172.21.15.55:0/1733416582 conn(0x7f9ab00cf530 msgr2=0x7f9ab00cacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.438+0000 7f9ab63e1640 1 -- 172.21.15.55:0/1733416582 shutdown_connections 2023-08-25T05:38:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:04.438+0000 7f9ab63e1640 1 -- 172.21.15.55:0/1733416582 wait complete. 2023-08-25T05:38:04.459 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2023-08-25T05:38:04.122581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2288,"num_read_kb":4815,"num_write":605,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":422164,"kb_used_data":21416,"kb_used_omap":13,"kb_used_meta":400626,"kb_avail":754552556,"statfs":{"total":773094113280,"available":772661817344,"internally_reserved":0,"allocated":21929984,"data_stored":11722384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":410241112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":206,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002213"},"pg_stats":[{"pgid":"1.0","version":"204'3675","reported_seq":4735,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-08-25T05:37:54.683615+0000","last_change":"2023-08-25T04:02:48.707715+0000","last_active":"2023-08-25T05:37:54.683615+0000","last_peered":"2023-08-25T05:37:54.683615+0000","last_clean":"2023-08-25T05:37:54.683615+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:37:54.683615+0000","last_undegraded":"2023-08-25T05:37:54.683615+0000","last_fullsized":"2023-08-25T05:37:54.683615+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:47.606455+0000","last_clean_scrub_stamp":"2023-08-25T04:02:47.606455+0000","objects_scrubbed":0,"log_size":3675,"log_dups_size":0,"ondisk_log_size":3675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:04:15.206992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2288,"num_read_kb":4815,"num_write":605,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":370,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-08-25T05:37:54.466219+0000","last_change":"2023-08-25T04:02:55.658896+0000","last_active":"2023-08-25T05:37:54.466219+0000","last_peered":"2023-08-25T05:37:54.466219+0000","last_clean":"2023-08-25T05:37:54.466219+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:37:54.466219+0000","last_undegraded":"2023-08-25T05:37:54.466219+0000","last_fullsized":"2023-08-25T05:37:54.466219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:44:09.739347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":362,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-08-25T05:37:54.683393+0000","last_change":"2023-08-25T04:02:55.660331+0000","last_active":"2023-08-25T05:37:54.683393+0000","last_peered":"2023-08-25T05:37:54.683393+0000","last_clean":"2023-08-25T05:37:54.683393+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:37:54.683393+0000","last_undegraded":"2023-08-25T05:37:54.683393+0000","last_fullsized":"2023-08-25T05:37:54.683393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:22:17.930507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":369,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-08-25T05:37:54.346887+0000","last_change":"2023-08-25T04:02:55.722829+0000","last_active":"2023-08-25T05:37:54.346887+0000","last_peered":"2023-08-25T05:37:54.346887+0000","last_clean":"2023-08-25T05:37:54.346887+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:37:54.346887+0000","last_undegraded":"2023-08-25T05:37:54.346887+0000","last_fullsized":"2023-08-25T05:37:54.346887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":370,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-08-25T05:37:54.466111+0000","last_change":"2023-08-25T04:02:55.660725+0000","last_active":"2023-08-25T05:37:54.466111+0000","last_peered":"2023-08-25T05:37:54.466111+0000","last_clean":"2023-08-25T05:37:54.466111+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:37:54.466111+0000","last_undegraded":"2023-08-25T05:37:54.466111+0000","last_fullsized":"2023-08-25T05:37:54.466111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:17:10.301015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":401,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-08-25T05:37:56.132986+0000","last_change":"2023-08-25T04:02:55.693621+0000","last_active":"2023-08-25T05:37:56.132986+0000","last_peered":"2023-08-25T05:37:56.132986+0000","last_clean":"2023-08-25T05:37:56.132986+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:37:56.132986+0000","last_undegraded":"2023-08-25T05:37:56.132986+0000","last_fullsized":"2023-08-25T05:37:56.132986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":360,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-08-25T05:37:54.683015+0000","last_change":"2023-08-25T04:02:55.693556+0000","last_active":"2023-08-25T05:37:54.683015+0000","last_peered":"2023-08-25T05:37:54.683015+0000","last_clean":"2023-08-25T05:37:54.683015+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:37:54.683015+0000","last_undegraded":"2023-08-25T05:37:54.683015+0000","last_fullsized":"2023-08-25T05:37:54.683015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T15:48:02.686266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":399,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-08-25T05:37:56.132318+0000","last_change":"2023-08-25T04:02:55.659874+0000","last_active":"2023-08-25T05:37:56.132318+0000","last_peered":"2023-08-25T05:37:56.132318+0000","last_clean":"2023-08-25T05:37:56.132318+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:37:56.132318+0000","last_undegraded":"2023-08-25T05:37:56.132318+0000","last_fullsized":"2023-08-25T05:37:56.132318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":422,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-08-25T05:37:54.346120+0000","last_change":"2023-08-25T04:02:55.659205+0000","last_active":"2023-08-25T05:37:54.346120+0000","last_peered":"2023-08-25T05:37:54.346120+0000","last_clean":"2023-08-25T05:37:54.346120+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:37:54.346120+0000","last_undegraded":"2023-08-25T05:37:54.346120+0000","last_fullsized":"2023-08-25T05:37:54.346120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T04:02:54.639224+0000","last_clean_scrub_stamp":"2023-08-25T04:02:54.639224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T08:05:22.839821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2288,"num_read_kb":4815,"num_write":605,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510574,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52344,"kb_used_data":3112,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319496,"statfs":{"total":96636764160,"available":96583163904,"internally_reserved":0,"allocated":3186688,"data_stored":1908074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73499999999999999,"15min":0.74299999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.40999999999999998},"max":{"1min":0.94599999999999995,"5min":0.95499999999999996,"15min":1.0169999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.441},"max":{"1min":0.90700000000000003,"5min":1.016,"15min":1.0189999999999999},"last":0.54300000000000004}]},{"osd":1,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93799999999999994,"5min":0.99199999999999999,"15min":1.054},"last":0.752},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.749,"15min":0.77300000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.73499999999999999}]},{"osd":2,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.753},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77300000000000002,"15min":0.76800000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.53600000000000003},"max":{"1min":1.0129999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.69099999999999995}]},{"osd":3,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.76700000000000002,"15min":0.77000000000000002},"min":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.94499999999999995,"5min":1.006,"15min":1.006},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.78600000000000003,"15min":0.78800000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98299999999999998,"5min":1.0600000000000001,"15min":1.0680000000000001},"last":0.82899999999999996}]},{"osd":4,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0449999999999999,"5min":1.163,"15min":1.163},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.36599999999999999},"max":{"1min":0.97199999999999998,"5min":0.997,"15min":1.1120000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.501,"5min":0.44,"15min":0.42699999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.74399999999999999,"15min":0.73099999999999998},"min":{"1min":0.50900000000000001,"5min":0.499,"15min":0.47999999999999998},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.71499999999999997,"15min":0.69999999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0900000000000001,"5min":1.119,"15min":1.119},"last":0.76300000000000001}]}]},{"osd":6,"up_from":15,"seq":64424510574,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51760,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320080,"statfs":{"total":96636764160,"available":96583761920,"internally_reserved":0,"allocated":2592768,"data_stored":1317706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.71599999999999997,"15min":0.74099999999999999},"min":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89900000000000002,"5min":0.99099999999999999,"15min":1.0449999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.505,"5min":0.40100000000000002,"15min":0.40000000000000002},"max":{"1min":0.92400000000000004,"5min":1.0389999999999999,"15min":1.1699999999999999},"last":0.67800000000000005}]},{"osd":1,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73799999999999999,"15min":0.76200000000000001},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89800000000000002,"5min":0.94999999999999996,"15min":1.1559999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72599999999999998,"15min":0.755},"min":{"1min":0.54400000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.91100000000000003,"5min":1.1180000000000001,"15min":1.1299999999999999},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75800000000000001,"15min":0.78600000000000003},"min":{"1min":0.54000000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.89300000000000002,"5min":1.0760000000000001,"15min":1.0780000000000001},"last":0.504},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80300000000000005,"15min":0.82199999999999995},"min":{"1min":0.56000000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95799999999999996,"5min":1.0669999999999999,"15min":1.1599999999999999},"last":0.64400000000000002}]},{"osd":3,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.75900000000000001,"15min":0.78300000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.87,"5min":1.002,"15min":1.208},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94399999999999995,"5min":1.054,"15min":1.236},"last":0.66100000000000003}]},{"osd":4,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.41899999999999998,"15min":0.33200000000000002},"max":{"1min":0.83099999999999996,"5min":0.93300000000000005,"15min":1.018},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.35499999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.016},"last":0.55700000000000005}]},{"osd":5,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90600000000000003,"5min":0.98999999999999999,"15min":1.1319999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.73299999999999998},"min":{"1min":0.48599999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91900000000000004,"5min":1.071,"15min":1.1659999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64300000000000002,"15min":0.65800000000000003},"min":{"1min":0.46800000000000003,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":0.94199999999999995,"5min":0.97199999999999998,"15min":1.044},"last":0.626},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68799999999999994,"15min":0.69499999999999995},"min":{"1min":0.501,"5min":0.47099999999999997,"15min":0.42899999999999999},"max":{"1min":0.96899999999999997,"5min":1.228,"15min":1.228},"last":0.74099999999999999}]}]},{"osd":5,"up_from":14,"seq":60129543277,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60080,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311760,"statfs":{"total":96636764160,"available":96575242240,"internally_reserved":0,"allocated":2592768,"data_stored":1317706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91600000000000004,"5min":0.97799999999999998,"15min":1.034},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94699999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.57399999999999995}]},{"osd":1,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.73799999999999999,"15min":0.75800000000000001},"min":{"1min":0.48199999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.073},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.75600000000000001,"15min":0.77000000000000002},"min":{"1min":0.52800000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84799999999999998,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.67400000000000004}]},{"osd":2,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72899999999999998,"15min":0.75},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.92100000000000004,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75600000000000001,"15min":0.76900000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93100000000000005,"5min":1.208,"15min":1.208},"last":0.85399999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.76000000000000001,"15min":0.76500000000000001},"min":{"1min":0.56399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98299999999999998,"5min":1.155,"15min":1.155},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94199999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.80600000000000005}]},{"osd":4,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.60999999999999999},"min":{"1min":0.38500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.88900000000000001,"5min":1.681,"15min":1.681},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66000000000000003,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42499999999999999},"max":{"1min":1.0660000000000001,"5min":1.381,"15min":1.381},"last":0.54300000000000004}]},{"osd":6,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68799999999999994,"15min":0.67300000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.42199999999999999},"max":{"1min":0.86099999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69499999999999995,"15min":0.68700000000000006},"min":{"1min":0.53100000000000003,"5min":0.49399999999999999,"15min":0.44900000000000001},"max":{"1min":1.0269999999999999,"5min":1.276,"15min":1.276},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67900000000000005,"15min":0.66700000000000004},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.89800000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76400000000000001,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91300000000000003,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.83699999999999997}]}]},{"osd":4,"up_from":14,"seq":60129543278,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47600,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324240,"statfs":{"total":96636764160,"available":96588021760,"internally_reserved":0,"allocated":2592768,"data_stored":1317706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91500000000000004,"5min":0.97799999999999998,"15min":1.054},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.47299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92500000000000004,"5min":0.96499999999999997,"15min":1.02},"last":0.86199999999999999}]},{"osd":1,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.73399999999999999,"15min":0.76400000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88200000000000001,"5min":1.05,"15min":1.05},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.103},"last":0.81999999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.85999999999999999,"5min":0.995,"15min":1.0780000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.55100000000000005,"5min":0.501,"15min":0.47999999999999998},"max":{"1min":1.0389999999999999,"5min":1.069,"15min":1.069},"last":0.70599999999999996}]},{"osd":3,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.56899999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92300000000000004,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75900000000000001,"15min":0.77700000000000002},"min":{"1min":0.52900000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96399999999999997,"5min":1.101,"15min":1.101},"last":0.89100000000000001}]},{"osd":5,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.55500000000000005},"min":{"1min":0.40300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80100000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.60299999999999998},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83699999999999997,"5min":0.93700000000000006,"15min":0.98299999999999998},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75800000000000001,"15min":0.747},"min":{"1min":0.59899999999999998,"5min":0.49399999999999999,"15min":0.49199999999999999},"max":{"1min":0.93500000000000005,"5min":1.0029999999999999,"15min":1.1240000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.67000000000000004,"15min":0.65500000000000003},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93200000000000005,"5min":1.018,"15min":1.0629999999999999},"last":0.92600000000000005}]},{"osd":7,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.628,"15min":0.623},"min":{"1min":0.42499999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.996,"15min":0.996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73499999999999999,"15min":0.71999999999999997},"min":{"1min":0.53700000000000003,"5min":0.496,"15min":0.47599999999999998},"max":{"1min":0.93000000000000005,"5min":1.018,"15min":1.0860000000000001},"last":0.72199999999999998}]}]},{"osd":3,"up_from":14,"seq":60129543278,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47604,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324236,"statfs":{"total":96636764160,"available":96588017664,"internally_reserved":0,"allocated":2592768,"data_stored":1317706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.32200000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.61099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.37},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.92900000000000005},"last":0.63200000000000001}]},{"osd":1,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.33300000000000002},"max":{"1min":0.74399999999999999,"5min":0.80700000000000005,"15min":1.0780000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61099999999999999,"15min":0.627},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.76400000000000001,"5min":0.88900000000000001,"15min":0.97999999999999998},"last":0.46100000000000002}]},{"osd":2,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96599999999999997,"5min":1.0089999999999999,"15min":1.038},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.95799999999999996},"last":0.55500000000000005}]},{"osd":4,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78700000000000003,"15min":0.79800000000000004},"min":{"1min":0.56999999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.014,"5min":1.26,"15min":1.26},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83099999999999996,"15min":0.82999999999999996},"min":{"1min":0.54200000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.069,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.72399999999999998}]},{"osd":5,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80600000000000005},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99399999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.80700000000000005,"15min":0.82199999999999995},"min":{"1min":0.56599999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97899999999999998,"5min":1.0880000000000001,"15min":1.1419999999999999},"last":0.89100000000000001}]},{"osd":6,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.85299999999999998,"15min":0.86199999999999999},"min":{"1min":0.63200000000000001,"5min":0.59499999999999997,"15min":0.59399999999999997},"max":{"1min":1.0169999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81399999999999995,"15min":0.83599999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.48999999999999999},"max":{"1min":0.98299999999999998,"5min":1.133,"15min":1.194},"last":0.77000000000000002}]},{"osd":7,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.85999999999999999,"15min":0.878},"min":{"1min":0.68100000000000005,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.056,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.82399999999999995,"15min":0.83099999999999996},"min":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.51800000000000002},"max":{"1min":0.999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.86899999999999999}]}]},{"osd":2,"up_from":14,"seq":60129543279,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60080,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311760,"statfs":{"total":96636764160,"available":96575242240,"internally_reserved":0,"allocated":2592768,"data_stored":1317706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.46000000000000002,"15min":0.47699999999999998},"min":{"1min":0.33400000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52200000000000002,"15min":0.52500000000000002},"min":{"1min":0.35499999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.71699999999999997,"5min":0.85099999999999998,"15min":0.86099999999999999},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66200000000000003,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.626,"15min":0.63100000000000001},"min":{"1min":0.46500000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83099999999999996,"5min":0.88800000000000001,"15min":0.89700000000000002},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56399999999999995,"15min":0.56899999999999995},"min":{"1min":0.41099999999999998,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.78000000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88500000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.436}]},{"osd":4,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.63200000000000001,"5min":0.56399999999999995,"15min":0.48699999999999999},"max":{"1min":1.0720000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80400000000000005,"15min":0.81100000000000005},"min":{"1min":0.66200000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.1619999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.622}]},{"osd":5,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.60899999999999999,"5min":0.53200000000000003,"15min":0.51700000000000002},"max":{"1min":1.0089999999999999,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.82799999999999996,"15min":0.84699999999999998},"min":{"1min":0.58899999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.246,"5min":1.266,"15min":1.266},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.103,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.875,"15min":0.88},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.58899999999999997},"max":{"1min":1.204,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.82599999999999996,"15min":0.83799999999999997},"min":{"1min":0.69299999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1040000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.82699999999999996,"15min":0.83199999999999996},"min":{"1min":0.64300000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1870000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.61199999999999999}]}]},{"osd":1,"up_from":14,"seq":60129543279,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42032,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329808,"statfs":{"total":96636764160,"available":96593723392,"internally_reserved":0,"allocated":2592768,"data_stored":1317706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45800000000000002,"15min":0.47299999999999998},"min":{"1min":0.30199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.50700000000000001,"15min":0.52900000000000003},"min":{"1min":0.34799999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.65300000000000002,"5min":0.73799999999999999,"15min":0.879},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Aug 25 05:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.29199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.74399999999999999,"5min":0.79700000000000004,"15min":0.81399999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.372}]},{"osd":3,"last update":"Fri Aug 25 05:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61699999999999999,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85899999999999999,"5min":0.998,"15min":0.998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55600000000000005,"15min":0.57999999999999996},"min":{"1min":0.39000000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.75800000000000001,"5min":0.88700000000000001,"15min":0.98699999999999999},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Aug 25 05:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.754,"15min":0.78500000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83699999999999997,"5min":1.079,"15min":1.2350000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.80000000000000004,"15min":0.82799999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.96199999999999997,"5min":1.147,"15min":1.268},"last":0.81699999999999995}]},{"osd":5,"last update":"Fri Aug 25 05:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.746,"15min":0.79200000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.873,"5min":1.109,"15min":1.1950000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.79500000000000004,"15min":0.81699999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0089999999999999,"5min":1.1890000000000001,"15min":1.214},"last":0.78600000000000003}]},{"osd":6,"last update":"Fri Aug 25 05:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.82599999999999996,"15min":0.86099999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.032,"5min":1.159,"15min":1.244},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78800000000000003,"15min":0.82199999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.95999999999999996,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Aug 25 05:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.78200000000000003,"15min":0.82399999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.98299999999999998,"5min":1.149,"15min":1.2929999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.83699999999999997,"15min":0.875},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.99099999999999999,"5min":1.127,"15min":1.2110000000000001},"last":0.76200000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543278,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60664,"kb_used_data":3112,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311176,"statfs":{"total":96636764160,"available":96574644224,"internally_reserved":0,"allocated":3186688,"data_stored":1908074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48999999999999999,"15min":0.51600000000000001},"min":{"1min":0.32100000000000001,"5min":0.308,"15min":0.30599999999999999},"max":{"1min":0.66700000000000004,"5min":0.70799999999999996,"15min":1.2170000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57299999999999995,"15min":0.58699999999999997},"min":{"1min":0.40899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.68600000000000005,"5min":0.81599999999999995,"15min":0.85999999999999999},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54000000000000004,"15min":0.54700000000000004},"min":{"1min":0.41999999999999998,"5min":0.36399999999999999,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":0.81399999999999995,"15min":0.91000000000000003},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55000000000000004,"15min":0.56100000000000005},"min":{"1min":0.36799999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.71499999999999997,"5min":0.755,"15min":0.86799999999999999},"last":0.44600000000000001}]},{"osd":3,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.52900000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.754,"15min":1.855},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.75900000000000001,"5min":0.90000000000000002,"15min":1.3480000000000001},"last":0.46700000000000003}]},{"osd":4,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.83599999999999997,"15min":0.84199999999999997},"min":{"1min":0.57599999999999996,"5min":0.495,"15min":0.495},"max":{"1min":1.0600000000000001,"5min":1.258,"15min":1.3799999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81699999999999995,"15min":0.83199999999999996},"min":{"1min":0.627,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0529999999999999,"5min":1.2809999999999999,"15min":1.2849999999999999},"last":0.59199999999999997}]},{"osd":5,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.58999999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.004,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.82499999999999996,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0620000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.56699999999999995}]},{"osd":6,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82199999999999995,"15min":0.83599999999999997},"min":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0429999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86499999999999999,"15min":0.85999999999999999},"min":{"1min":0.51600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.0880000000000001,"5min":1.3560000000000001,"15min":1.5129999999999999},"last":0.72699999999999998}]},{"osd":7,"last update":"Fri Aug 25 05:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.85799999999999998,"15min":0.876},"min":{"1min":0.64600000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0760000000000001,"5min":1.4339999999999999,"15min":1.5720000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85099999999999998,"15min":0.85499999999999998},"min":{"1min":0.61699999999999999,"5min":0.60099999999999998,"15min":0.58099999999999996},"max":{"1min":1.0620000000000001,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.63300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:38:04.463 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-25T04:02:47.606455+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=2, tm_sec=47, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=58, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T05:38:04.463 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-08-25T04:02:54.639224+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=2, tm_sec=54, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=58, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T05:38:04.464 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-08-25T04:02:54.639224+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=2, tm_sec=54, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=58, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T05:38:04.464 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-08-25T04:02:54.639224+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=2, tm_sec=54, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=58, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T05:38:04.464 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-08-25T04:02:54.639224+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=2, tm_sec=54, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=58, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T05:38:04.464 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-08-25T04:02:54.639224+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=2, tm_sec=54, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=58, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T05:38:04.465 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-08-25T04:02:54.639224+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=2, tm_sec=54, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=58, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T05:38:04.465 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-08-25T04:02:54.639224+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=2, tm_sec=54, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=58, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T05:38:04.465 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-08-25T04:02:54.639224+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=4, tm_min=2, tm_sec=54, tm_wday=4, tm_yday=237, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=25, tm_hour=5, tm_min=37, tm_sec=58, tm_wday=4, tm_yday=237, tm_isdst=0) 2023-08-25T05:38:04.465 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-25T05:38:18.074 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:38:18.078 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:38:24.466 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-25T05:38:24.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.618+0000 7fd9f389c640 1 Processor -- start 2023-08-25T05:38:24.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.618+0000 7fd9f389c640 1 -- start start 2023-08-25T05:38:24.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.618+0000 7fd9f389c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9ec0d0da0 0x7fd9ec0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:24.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.618+0000 7fd9f389c640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9ec0b3e50 0x7fd9ec0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:24.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.618+0000 7fd9f389c640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9ec0b29b0 con 0x7fd9ec0cdde0 2023-08-25T05:38:24.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.618+0000 7fd9f389c640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9ec0ce760 con 0x7fd9ec0b3e50 2023-08-25T05:38:24.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.618+0000 7fd9f389c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec0d16c0 con 0x7fd9ec0d0da0 2023-08-25T05:38:24.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.618+0000 7fd9f1e39640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9ec0b3e50 0x7fd9ec0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:24.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.618+0000 7fd9f1e39640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9ec0b3e50 0x7fd9ec0ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37034/0 (socket says 172.21.15.55:37034) 2023-08-25T05:38:24.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.618+0000 7fd9f1e39640 1 -- 172.21.15.55:0/1765033218 learned_addr learned my addr 172.21.15.55:0/1765033218 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:24.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.618+0000 7fd9f1638640 1 --2- 172.21.15.55:0/1765033218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9ec0d0da0 0x7fd9ec0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:24.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.618+0000 7fd9f1e39640 1 -- 172.21.15.55:0/1765033218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9ec0d0da0 msgr2=0x7fd9ec0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:24.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.618+0000 7fd9f1e39640 1 --2- 172.21.15.55:0/1765033218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9ec0d0da0 0x7fd9ec0d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:24.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.618+0000 7fd9f1e39640 1 -- 172.21.15.55:0/1765033218 >> v1:172.21.15.110:6789/0 conn(0x7fd9ec0cdde0 legacy=0x7fd9ec0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:24.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.618+0000 7fd9f1e39640 1 -- 172.21.15.55:0/1765033218 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ec0b1dc0 con 0x7fd9ec0b3e50 2023-08-25T05:38:24.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.622+0000 7fd9f1e39640 1 --2- 172.21.15.55:0/1765033218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9ec0b3e50 0x7fd9ec0ce220 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009e50 tx=0x7fd9e401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e070afc28cb512 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:24.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.622+0000 7fd9e3fff640 1 -- 172.21.15.55:0/1765033218 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e40af400 con 0x7fd9ec0b3e50 2023-08-25T05:38:24.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.622+0000 7fd9e3fff640 1 -- 172.21.15.55:0/1765033218 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e40ab050 con 0x7fd9ec0b3e50 2023-08-25T05:38:24.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.622+0000 7fd9e3fff640 1 -- 172.21.15.55:0/1765033218 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e40af780 con 0x7fd9ec0b3e50 2023-08-25T05:38:24.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.622+0000 7fd9f389c640 1 -- 172.21.15.55:0/1765033218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9ec0b3e50 msgr2=0x7fd9ec0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:24.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.622+0000 7fd9f389c640 1 --2- 172.21.15.55:0/1765033218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9ec0b3e50 0x7fd9ec0ce220 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009e50 tx=0x7fd9e401f1c0 comp rx=0 tx=0).stop 2023-08-25T05:38:24.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.622+0000 7fd9f389c640 1 -- 172.21.15.55:0/1765033218 shutdown_connections 2023-08-25T05:38:24.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.622+0000 7fd9f389c640 1 --2- 172.21.15.55:0/1765033218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9ec0b3e50 0x7fd9ec0ce220 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:24.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.622+0000 7fd9f389c640 1 --2- 172.21.15.55:0/1765033218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9ec0d0da0 0x7fd9ec0d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:24.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.622+0000 7fd9f389c640 1 -- 172.21.15.55:0/1765033218 >> 172.21.15.55:0/1765033218 conn(0x7fd9ec09bae0 msgr2=0x7fd9ec0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:24.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.622+0000 7fd9f389c640 1 -- 172.21.15.55:0/1765033218 shutdown_connections 2023-08-25T05:38:24.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.622+0000 7fd9f389c640 1 -- 172.21.15.55:0/1765033218 wait complete. 2023-08-25T05:38:24.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f389c640 1 Processor -- start 2023-08-25T05:38:24.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f389c640 1 -- start start 2023-08-25T05:38:24.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f389c640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9ec0b3e50 0x7fd9ec0c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:24.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f389c640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9ec0cdde0 0x7fd9ec15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:24.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f389c640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9ec0d0da0 0x7fd9ec15f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:24.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f389c640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec0c8a50 con 0x7fd9ec0b3e50 2023-08-25T05:38:24.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f389c640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec15ee50 con 0x7fd9ec0cdde0 2023-08-25T05:38:24.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f389c640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec1f5a10 con 0x7fd9ec0d0da0 2023-08-25T05:38:24.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f1638640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9ec0b3e50 0x7fd9ec0c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:24.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f1638640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9ec0b3e50 0x7fd9ec0c8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37046/0 (socket says 172.21.15.55:37046) 2023-08-25T05:38:24.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f1638640 1 -- 172.21.15.55:0/1751859391 learned_addr learned my addr 172.21.15.55:0/1751859391 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:24.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f0e37640 1 --2- 172.21.15.55:0/1751859391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9ec0cdde0 0x7fd9ec15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:24.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f1e39640 1 --2- 172.21.15.55:0/1751859391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9ec0d0da0 0x7fd9ec15f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:24.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f1638640 1 -- 172.21.15.55:0/1751859391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9ec0d0da0 msgr2=0x7fd9ec15f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:24.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f1638640 1 --2- 172.21.15.55:0/1751859391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9ec0d0da0 0x7fd9ec15f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:24.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f1638640 1 -- 172.21.15.55:0/1751859391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9ec0cdde0 msgr2=0x7fd9ec15ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:24.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f1638640 1 --2- 172.21.15.55:0/1751859391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9ec0cdde0 0x7fd9ec15ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:24.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f1638640 1 -- 172.21.15.55:0/1751859391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e4009b30 con 0x7fd9ec0b3e50 2023-08-25T05:38:24.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f1638640 1 --2- 172.21.15.55:0/1751859391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9ec0b3e50 0x7fd9ec0c8da0 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800d7d0 tx=0x7fd9e800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:24.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9e1ffb640 1 -- 172.21.15.55:0/1751859391 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e800b6c0 con 0x7fd9ec0b3e50 2023-08-25T05:38:24.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9e1ffb640 1 -- 172.21.15.55:0/1751859391 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e800b820 con 0x7fd9ec0b3e50 2023-08-25T05:38:24.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9e1ffb640 1 -- 172.21.15.55:0/1751859391 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e800bbd0 con 0x7fd9ec0b3e50 2023-08-25T05:38:24.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.626+0000 7fd9f389c640 1 -- 172.21.15.55:0/1751859391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ec15e5b0 con 0x7fd9ec0b3e50 2023-08-25T05:38:24.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.630+0000 7fd9f389c640 1 -- 172.21.15.55:0/1751859391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ec15eb70 con 0x7fd9ec0b3e50 2023-08-25T05:38:24.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.630+0000 7fd9f389c640 1 -- 172.21.15.55:0/1751859391 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ec1f57e0 con 0x7fd9ec0b3e50 2023-08-25T05:38:24.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.630+0000 7fd9e1ffb640 1 -- 172.21.15.55:0/1751859391 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7fd9e800bd30 con 0x7fd9ec0b3e50 2023-08-25T05:38:24.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.630+0000 7fd9e1ffb640 1 --2- 172.21.15.55:0/1751859391 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fd9d00657a0 0x7fd9d0067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:24.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.630+0000 7fd9e1ffb640 1 -- 172.21.15.55:0/1751859391 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7fd9e8083480 con 0x7fd9ec0b3e50 2023-08-25T05:38:24.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.630+0000 7fd9f0e37640 1 --2- 172.21.15.55:0/1751859391 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fd9d00657a0 0x7fd9d0067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:24.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.634+0000 7fd9f0e37640 1 --2- 172.21.15.55:0/1751859391 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fd9d00657a0 0x7fd9d0067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0cff90 tx=0x7fd9dc009040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:24.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.634+0000 7fd9e1ffb640 1 -- 172.21.15.55:0/1751859391 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7fd9e8054890 con 0x7fd9ec0b3e50 2023-08-25T05:38:24.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.790+0000 7fd9f389c640 1 -- 172.21.15.55:0/1751859391 --> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9ec0b2360 con 0x7fd9d00657a0 2023-08-25T05:38:24.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.794+0000 7fd9e1ffb640 1 -- 172.21.15.55:0/1751859391 <== mgr.9404 v2:172.21.15.110:6832/1527806048 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72786 (secure 0 0 0) 0x7fd9dc005380 con 0x7fd9d00657a0 2023-08-25T05:38:24.797 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:38:24.797 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-08-25T05:38:24.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.794+0000 7fd9f389c640 1 -- 172.21.15.55:0/1751859391 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fd9d00657a0 msgr2=0x7fd9d0067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:24.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.794+0000 7fd9f389c640 1 --2- 172.21.15.55:0/1751859391 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fd9d00657a0 0x7fd9d0067c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec0cff90 tx=0x7fd9dc009040 comp rx=0 tx=0).stop 2023-08-25T05:38:24.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.794+0000 7fd9f389c640 1 -- 172.21.15.55:0/1751859391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9ec0b3e50 msgr2=0x7fd9ec0c8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:24.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.794+0000 7fd9f389c640 1 --2- 172.21.15.55:0/1751859391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9ec0b3e50 0x7fd9ec0c8da0 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800d7d0 tx=0x7fd9e800dc90 comp rx=0 tx=0).stop 2023-08-25T05:38:24.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.794+0000 7fd9f389c640 1 -- 172.21.15.55:0/1751859391 shutdown_connections 2023-08-25T05:38:24.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.794+0000 7fd9f389c640 1 --2- 172.21.15.55:0/1751859391 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7fd9d00657a0 0x7fd9d0067c60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:24.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.794+0000 7fd9f389c640 1 --2- 172.21.15.55:0/1751859391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9ec0d0da0 0x7fd9ec15f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:24.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.794+0000 7fd9f389c640 1 --2- 172.21.15.55:0/1751859391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9ec0cdde0 0x7fd9ec15ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:24.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.794+0000 7fd9f389c640 1 --2- 172.21.15.55:0/1751859391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9ec0b3e50 0x7fd9ec0c8da0 unknown :-1 s=CLOSED pgs=2246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:24.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.794+0000 7fd9f389c640 1 -- 172.21.15.55:0/1751859391 >> 172.21.15.55:0/1751859391 conn(0x7fd9ec09bae0 msgr2=0x7fd9ec06ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:24.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.794+0000 7fd9f389c640 1 -- 172.21.15.55:0/1751859391 shutdown_connections 2023-08-25T05:38:24.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.794+0000 7fd9f389c640 1 -- 172.21.15.55:0/1751859391 wait complete. 2023-08-25T05:38:24.817 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-25T05:38:24.126648+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2288,"num_read_kb":4815,"num_write":605,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3676,"ondisk_log_size":3676,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":422132,"kb_used_data":21416,"kb_used_omap":13,"kb_used_meta":400626,"kb_avail":754552588,"statfs":{"total":773094113280,"available":772661850112,"internally_reserved":0,"allocated":21929984,"data_stored":11722384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":410241112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002219"},"pg_stats":[{"pgid":"1.0","version":"207'3676","reported_seq":4745,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-08-25T05:38:06.600242+0000","last_change":"2023-08-25T05:38:06.600296+0000","last_active":"2023-08-25T05:38:06.600242+0000","last_peered":"2023-08-25T05:38:06.600242+0000","last_clean":"2023-08-25T05:38:06.600242+0000","last_became_active":"2023-08-25T04:02:48.706601+0000","last_became_peered":"2023-08-25T04:02:48.706601+0000","last_unstale":"2023-08-25T05:38:06.600242+0000","last_undegraded":"2023-08-25T05:38:06.600242+0000","last_fullsized":"2023-08-25T05:38:06.600242+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"207'3676","last_scrub_stamp":"2023-08-25T05:38:06.600156+0000","last_deep_scrub":"207'3676","last_deep_scrub_stamp":"2023-08-25T05:38:06.600156+0000","last_clean_scrub_stamp":"2023-08-25T05:38:06.600156+0000","objects_scrubbed":2,"log_size":3676,"log_dups_size":0,"ondisk_log_size":3676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T12:52:11.783721+0000","scrub_duration":0.010296326999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2288,"num_read_kb":4815,"num_write":605,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":379,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-08-25T05:38:04.234699+0000","last_change":"2023-08-25T05:38:04.234748+0000","last_active":"2023-08-25T05:38:04.234699+0000","last_peered":"2023-08-25T05:38:04.234699+0000","last_clean":"2023-08-25T05:38:04.234699+0000","last_became_active":"2023-08-25T04:02:55.658490+0000","last_became_peered":"2023-08-25T04:02:55.658490+0000","last_unstale":"2023-08-25T05:38:04.234699+0000","last_undegraded":"2023-08-25T05:38:04.234699+0000","last_fullsized":"2023-08-25T05:38:04.234699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:38:04.234589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:38:04.234589+0000","last_clean_scrub_stamp":"2023-08-25T05:38:04.234589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:12:14.022246+0000","scrub_duration":0.0036954739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":371,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-08-25T05:38:07.616002+0000","last_change":"2023-08-25T05:38:07.616072+0000","last_active":"2023-08-25T05:38:07.616002+0000","last_peered":"2023-08-25T05:38:07.616002+0000","last_clean":"2023-08-25T05:38:07.616002+0000","last_became_active":"2023-08-25T04:02:55.659862+0000","last_became_peered":"2023-08-25T04:02:55.659862+0000","last_unstale":"2023-08-25T05:38:07.616002+0000","last_undegraded":"2023-08-25T05:38:07.616002+0000","last_fullsized":"2023-08-25T05:38:07.616002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:38:07.615898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:38:07.615898+0000","last_clean_scrub_stamp":"2023-08-25T05:38:07.615898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:06:35.355298+0000","scrub_duration":0.0042450389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":377,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-08-25T05:38:14.436664+0000","last_change":"2023-08-25T05:38:14.436716+0000","last_active":"2023-08-25T05:38:14.436664+0000","last_peered":"2023-08-25T05:38:14.436664+0000","last_clean":"2023-08-25T05:38:14.436664+0000","last_became_active":"2023-08-25T04:02:55.722428+0000","last_became_peered":"2023-08-25T04:02:55.722428+0000","last_unstale":"2023-08-25T05:38:14.436664+0000","last_undegraded":"2023-08-25T05:38:14.436664+0000","last_fullsized":"2023-08-25T05:38:14.436664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:38:14.436548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:38:14.436548+0000","last_clean_scrub_stamp":"2023-08-25T05:38:14.436548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T06:57:58.561999+0000","scrub_duration":0.0038397420000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":379,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-08-25T05:38:03.232482+0000","last_change":"2023-08-25T05:38:03.232530+0000","last_active":"2023-08-25T05:38:03.232482+0000","last_peered":"2023-08-25T05:38:03.232482+0000","last_clean":"2023-08-25T05:38:03.232482+0000","last_became_active":"2023-08-25T04:02:55.660278+0000","last_became_peered":"2023-08-25T04:02:55.660278+0000","last_unstale":"2023-08-25T05:38:03.232482+0000","last_undegraded":"2023-08-25T05:38:03.232482+0000","last_fullsized":"2023-08-25T05:38:03.232482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:38:03.232388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:38:03.232388+0000","last_clean_scrub_stamp":"2023-08-25T05:38:03.232388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:54:41.438111+0000","scrub_duration":0.0032857950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":409,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-08-25T05:38:04.163008+0000","last_change":"2023-08-25T05:38:04.163066+0000","last_active":"2023-08-25T05:38:04.163008+0000","last_peered":"2023-08-25T05:38:04.163008+0000","last_clean":"2023-08-25T05:38:04.163008+0000","last_became_active":"2023-08-25T04:02:55.693244+0000","last_became_peered":"2023-08-25T04:02:55.693244+0000","last_unstale":"2023-08-25T05:38:04.163008+0000","last_undegraded":"2023-08-25T05:38:04.163008+0000","last_fullsized":"2023-08-25T05:38:04.163008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:38:04.162925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:38:04.162925+0000","last_clean_scrub_stamp":"2023-08-25T05:38:04.162925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T13:48:53.791072+0000","scrub_duration":0.003123986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":369,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-08-25T05:38:09.581932+0000","last_change":"2023-08-25T05:38:09.581984+0000","last_active":"2023-08-25T05:38:09.581932+0000","last_peered":"2023-08-25T05:38:09.581932+0000","last_clean":"2023-08-25T05:38:09.581932+0000","last_became_active":"2023-08-25T04:02:55.693285+0000","last_became_peered":"2023-08-25T04:02:55.693285+0000","last_unstale":"2023-08-25T05:38:09.581932+0000","last_undegraded":"2023-08-25T05:38:09.581932+0000","last_fullsized":"2023-08-25T05:38:09.581932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:38:09.581826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:38:09.581826+0000","last_clean_scrub_stamp":"2023-08-25T05:38:09.581826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T16:07:00.620942+0000","scrub_duration":0.0049710149999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":408,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-08-25T05:38:06.205857+0000","last_change":"2023-08-25T05:38:06.205857+0000","last_active":"2023-08-25T05:38:06.205857+0000","last_peered":"2023-08-25T05:38:06.205857+0000","last_clean":"2023-08-25T05:38:06.205857+0000","last_became_active":"2023-08-25T04:02:55.659522+0000","last_became_peered":"2023-08-25T04:02:55.659522+0000","last_unstale":"2023-08-25T05:38:06.205857+0000","last_undegraded":"2023-08-25T05:38:06.205857+0000","last_fullsized":"2023-08-25T05:38:06.205857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:38:06.205688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:38:06.205688+0000","last_clean_scrub_stamp":"2023-08-25T05:38:06.205688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T05:46:55.863789+0000","scrub_duration":0.0043552399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":432,"reported_epoch":207,"state":"active+clean","last_fresh":"2023-08-25T05:38:06.809863+0000","last_change":"2023-08-25T05:38:06.809863+0000","last_active":"2023-08-25T05:38:06.809863+0000","last_peered":"2023-08-25T05:38:06.809863+0000","last_clean":"2023-08-25T05:38:06.809863+0000","last_became_active":"2023-08-25T04:02:55.658803+0000","last_became_peered":"2023-08-25T04:02:55.658803+0000","last_unstale":"2023-08-25T05:38:06.809863+0000","last_undegraded":"2023-08-25T05:38:06.809863+0000","last_fullsized":"2023-08-25T05:38:06.809863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-25T05:38:06.809718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-25T05:38:06.809718+0000","last_clean_scrub_stamp":"2023-08-25T05:38:06.809718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-26T11:21:58.607013+0000","scrub_duration":0.0035158680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2288,"num_read_kb":4815,"num_write":605,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3676,"ondisk_log_size":3676,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424510579,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52336,"kb_used_data":3112,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319504,"statfs":{"total":96636764160,"available":96583172096,"internally_reserved":0,"allocated":3186688,"data_stored":1908074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.72699999999999998,"15min":0.73799999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":1.0169999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73699999999999999,"15min":0.747},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.64700000000000002}]},{"osd":1,"last update":"Fri Aug 25 05:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73899999999999999,"15min":0.754},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75,"15min":0.77000000000000002},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98599999999999999,"5min":1.036,"15min":1.036},"last":0.70599999999999996}]},{"osd":2,"last update":"Fri Aug 25 05:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.73899999999999999,"15min":0.749},"min":{"1min":0.49199999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0149999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97899999999999998,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Aug 25 05:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.77200000000000002,"15min":0.76900000000000002},"min":{"1min":0.48399999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.45200000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.88100000000000001}]},{"osd":4,"last update":"Fri Aug 25 05:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.623,"15min":0.59499999999999997},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96599999999999997,"5min":1.093,"15min":1.093},"last":0.747},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64800000000000002,"15min":0.625},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.95099999999999996,"5min":1.163,"15min":1.163},"last":0.83299999999999996}]},{"osd":5,"last update":"Fri Aug 25 05:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.437,"5min":0.39400000000000002,"15min":0.36599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68500000000000005,"15min":0.67400000000000004},"min":{"1min":0.47899999999999998,"5min":0.44,"15min":0.42699999999999999},"max":{"1min":0.94199999999999995,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.81200000000000006}]},{"osd":6,"last update":"Fri Aug 25 05:38:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.746,"15min":0.73399999999999999},"min":{"1min":0.56399999999999995,"5min":0.499,"15min":0.47999999999999998},"max":{"1min":0.98999999999999999,"5min":1.966,"15min":1.966},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73299999999999998,"15min":0.70599999999999996},"min":{"1min":0.45900000000000002,"5min":0.374,"15min":0.374},"max":{"1min":1.071,"5min":1.119,"15min":1.119},"last":0.89700000000000002}]}]},{"osd":6,"up_from":15,"seq":64424510579,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51756,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320084,"statfs":{"total":96636764160,"available":96583766016,"internally_reserved":0,"allocated":2592768,"data_stored":1317706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":50395403},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.71599999999999997,"15min":0.74099999999999999},"min":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89900000000000002,"5min":0.99099999999999999,"15min":1.0449999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70299999999999996,"15min":0.73199999999999998},"min":{"1min":0.505,"5min":0.40100000000000002,"15min":0.40000000000000002},"max":{"1min":0.92400000000000004,"5min":1.0389999999999999,"15min":1.1699999999999999},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73799999999999999,"15min":0.76200000000000001},"min":{"1min":0.502,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89800000000000002,"5min":0.94999999999999996,"15min":1.1559999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.72599999999999998,"15min":0.755},"min":{"1min":0.54400000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.91100000000000003,"5min":1.1180000000000001,"15min":1.1299999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75800000000000001,"15min":0.78600000000000003},"min":{"1min":0.54000000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.89300000000000002,"5min":1.0760000000000001,"15min":1.0780000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80300000000000005,"15min":0.82199999999999995},"min":{"1min":0.56000000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95799999999999996,"5min":1.0669999999999999,"15min":1.1599999999999999},"last":0.77200000000000002}]},{"osd":3,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.75900000000000001,"15min":0.78300000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.87,"5min":1.002,"15min":1.208},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94399999999999995,"5min":1.054,"15min":1.236},"last":0.67000000000000004}]},{"osd":4,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59099999999999997,"15min":0.59299999999999997},"min":{"1min":0.42699999999999999,"5min":0.41899999999999998,"15min":0.33200000000000002},"max":{"1min":0.83099999999999996,"5min":0.93300000000000005,"15min":1.018},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59699999999999998,"15min":0.60399999999999998},"min":{"1min":0.42699999999999999,"5min":0.41199999999999998,"15min":0.35499999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.016},"last":0.49199999999999999}]},{"osd":5,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.90600000000000003,"5min":0.98999999999999999,"15min":1.1319999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.71999999999999997,"15min":0.73299999999999998},"min":{"1min":0.48599999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.91900000000000004,"5min":1.071,"15min":1.1659999999999999},"last":0.63800000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64300000000000002,"15min":0.65800000000000003},"min":{"1min":0.46800000000000003,"5min":0.46200000000000002,"15min":0.39700000000000002},"max":{"1min":0.94199999999999995,"5min":0.97199999999999998,"15min":1.044},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68799999999999994,"15min":0.69499999999999995},"min":{"1min":0.501,"5min":0.47099999999999997,"15min":0.42899999999999999},"max":{"1min":0.96899999999999997,"5min":1.228,"15min":1.228},"last":0.58899999999999997}]}]},{"osd":5,"up_from":14,"seq":60129543282,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60076,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311764,"statfs":{"total":96636764160,"available":96575246336,"internally_reserved":0,"allocated":2592768,"data_stored":1317706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.74099999999999999,"15min":0.747},"min":{"1min":0.39100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.91600000000000004,"5min":0.97799999999999998,"15min":1.034},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.74399999999999999,"15min":0.754},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94699999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71599999999999997}]},{"osd":1,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.73799999999999999,"15min":0.75800000000000001},"min":{"1min":0.48199999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.073},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.75600000000000001,"15min":0.77000000000000002},"min":{"1min":0.52800000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84799999999999998,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.86599999999999999}]},{"osd":2,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72899999999999998,"15min":0.75},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.92100000000000004,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.75600000000000001,"15min":0.76900000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93100000000000005,"5min":1.208,"15min":1.208},"last":0.89300000000000002}]},{"osd":3,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.76000000000000001,"15min":0.76500000000000001},"min":{"1min":0.56399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98299999999999998,"5min":1.155,"15min":1.155},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94199999999999995,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.92800000000000005}]},{"osd":4,"last update":"Fri Aug 25 05:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.63700000000000001,"15min":0.60999999999999999},"min":{"1min":0.38500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.88900000000000001,"5min":1.681,"15min":1.681},"last":0.5},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66000000000000003,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.42499999999999999},"max":{"1min":1.0660000000000001,"5min":1.381,"15min":1.381},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68799999999999994,"15min":0.67300000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.42199999999999999},"max":{"1min":0.86099999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69499999999999995,"15min":0.68700000000000006},"min":{"1min":0.53100000000000003,"5min":0.49399999999999999,"15min":0.44900000000000001},"max":{"1min":1.0269999999999999,"5min":1.276,"15min":1.276},"last":0.53500000000000003}]},{"osd":7,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67900000000000005,"15min":0.66700000000000004},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.89800000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76400000000000001,"15min":0.745},"min":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91300000000000003,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.58499999999999996}]}]},{"osd":4,"up_from":14,"seq":60129543282,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47600,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324240,"statfs":{"total":96636764160,"available":96588021760,"internally_reserved":0,"allocated":2592768,"data_stored":1317706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.71699999999999997,"15min":0.72999999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91500000000000004,"5min":0.97799999999999998,"15min":1.054},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70899999999999996,"15min":0.72199999999999998},"min":{"1min":0.47299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92500000000000004,"5min":0.96499999999999997,"15min":1.02},"last":0.80000000000000004}]},{"osd":1,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.73399999999999999,"15min":0.76400000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88200000000000001,"5min":1.05,"15min":1.05},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.75600000000000001,"15min":0.76100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.103},"last":0.872}]},{"osd":2,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.85999999999999999,"5min":0.995,"15min":1.0780000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.749,"15min":0.76600000000000001},"min":{"1min":0.55100000000000005,"5min":0.501,"15min":0.47999999999999998},"max":{"1min":1.0389999999999999,"5min":1.069,"15min":1.069},"last":0.755}]},{"osd":3,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.76600000000000001,"15min":0.78200000000000003},"min":{"1min":0.56899999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.92300000000000004,"5min":1.0029999999999999,"15min":1.1220000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.75900000000000001,"15min":0.77700000000000002},"min":{"1min":0.52900000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.96399999999999997,"5min":1.101,"15min":1.101},"last":0.90500000000000003}]},{"osd":5,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.55500000000000005},"min":{"1min":0.40300000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80100000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.496},{"interface":"front","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.60299999999999998},"min":{"1min":0.44400000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83699999999999997,"5min":0.93700000000000006,"15min":0.98299999999999998},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75800000000000001,"15min":0.747},"min":{"1min":0.59899999999999998,"5min":0.49399999999999999,"15min":0.49199999999999999},"max":{"1min":0.93500000000000005,"5min":1.0029999999999999,"15min":1.1240000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.67000000000000004,"15min":0.65500000000000003},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93200000000000005,"5min":1.018,"15min":1.0629999999999999},"last":0.69399999999999995}]},{"osd":7,"last update":"Fri Aug 25 05:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.628,"15min":0.623},"min":{"1min":0.42499999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90600000000000003,"5min":0.996,"15min":0.996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73499999999999999,"15min":0.71999999999999997},"min":{"1min":0.53700000000000003,"5min":0.496,"15min":0.47599999999999998},"max":{"1min":0.93000000000000005,"5min":1.018,"15min":1.0860000000000001},"last":0.73999999999999999}]}]},{"osd":3,"up_from":14,"seq":60129543282,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47604,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324236,"statfs":{"total":96636764160,"available":96588017664,"internally_reserved":0,"allocated":2592768,"data_stored":1317706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":46135563},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.32200000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.61099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.92900000000000005},"last":0.496}]},{"osd":1,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.39300000000000002,"5min":0.33400000000000002,"15min":0.33300000000000002},"max":{"1min":0.74399999999999999,"5min":0.80700000000000005,"15min":1.0780000000000001},"last":0.439},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.61099999999999999,"15min":0.627},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.76400000000000001,"5min":0.88900000000000001,"15min":0.97999999999999998},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96599999999999997,"5min":1.0089999999999999,"15min":1.038},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.95799999999999996},"last":0.41499999999999998}]},{"osd":4,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78700000000000003,"15min":0.79800000000000004},"min":{"1min":0.56999999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.014,"5min":1.26,"15min":1.26},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83099999999999996,"15min":0.82999999999999996},"min":{"1min":0.54200000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.069,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.89900000000000002}]},{"osd":5,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80600000000000005},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.99399999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.745,"5min":0.80700000000000005,"15min":0.82199999999999995},"min":{"1min":0.56599999999999995,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.97899999999999998,"5min":1.0880000000000001,"15min":1.1419999999999999},"last":0.92100000000000004}]},{"osd":6,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.85299999999999998,"15min":0.86199999999999999},"min":{"1min":0.63200000000000001,"5min":0.59499999999999997,"15min":0.59399999999999997},"max":{"1min":1.0169999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81399999999999995,"15min":0.83599999999999997},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.48999999999999999},"max":{"1min":0.98299999999999998,"5min":1.133,"15min":1.194},"last":0.877}]},{"osd":7,"last update":"Fri Aug 25 05:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.85999999999999999,"15min":0.878},"min":{"1min":0.68100000000000005,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.056,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.82399999999999995,"15min":0.83099999999999996},"min":{"1min":0.54900000000000004,"5min":0.52900000000000003,"15min":0.51800000000000002},"max":{"1min":0.999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.77600000000000002}]}]},{"osd":2,"up_from":14,"seq":60129543283,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60076,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311764,"statfs":{"total":96636764160,"available":96575246336,"internally_reserved":0,"allocated":2592768,"data_stored":1317706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:38:18 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46100000000000002,"15min":0.47499999999999998},"min":{"1min":0.33200000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.65500000000000003,"5min":0.88,"15min":0.88},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.52400000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.45800000000000002}]},{"osd":1,"last update":"Fri Aug 25 05:38:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.503,"15min":0.50600000000000001},"min":{"1min":0.33900000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68999999999999995,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.60699999999999998,"15min":0.625},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.75,"5min":0.88800000000000001,"15min":0.89700000000000002},"last":0.75}]},{"osd":3,"last update":"Fri Aug 25 05:38:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.74099999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.58499999999999996,"15min":0.59399999999999997},"min":{"1min":0.40699999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81100000000000005,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.59599999999999997}]},{"osd":4,"last update":"Fri Aug 25 05:38:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.79300000000000004,"15min":0.81699999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.48699999999999999},"max":{"1min":0.97299999999999998,"5min":1.212,"15min":1.4139999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78800000000000003,"15min":0.80500000000000005},"min":{"1min":0.57499999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.0940000000000001,"5min":1.1619999999999999,"15min":1.2030000000000001},"last":0.54600000000000004}]},{"osd":5,"last update":"Fri Aug 25 05:38:18 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.79300000000000004,"15min":0.81200000000000006},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0349999999999999,"5min":1.1759999999999999,"15min":1.3700000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.80400000000000005,"15min":0.83599999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.014,"5min":1.266,"15min":1.266},"last":0.88900000000000001}]},{"osd":6,"last update":"Fri Aug 25 05:38:18 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.81599999999999995,"15min":0.84199999999999997},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.0169999999999999,"5min":1.1579999999999999,"15min":1.4690000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.85399999999999998,"15min":0.871},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.0920000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.0189999999999999}]},{"osd":7,"last update":"Fri Aug 25 05:38:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.81100000000000005,"15min":0.83199999999999996},"min":{"1min":0.56100000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.002,"5min":1.1040000000000001,"15min":1.3340000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.80400000000000005,"15min":0.82599999999999996},"min":{"1min":0.55400000000000005,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.054,"5min":1.1870000000000001,"15min":1.2470000000000001},"last":0.94599999999999995}]}]},{"osd":1,"up_from":14,"seq":60129543283,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42028,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329812,"statfs":{"total":96636764160,"available":96593727488,"internally_reserved":0,"allocated":2592768,"data_stored":1317706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":40433931},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Aug 25 05:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45800000000000002,"15min":0.47299999999999998},"min":{"1min":0.30199999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.50700000000000001,"15min":0.52900000000000003},"min":{"1min":0.34799999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.65300000000000002,"5min":0.73799999999999999,"15min":0.879},"last":0.40400000000000003}]},{"osd":2,"last update":"Fri Aug 25 05:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.498,"15min":0.50600000000000001},"min":{"1min":0.29199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.74399999999999999,"5min":0.79700000000000004,"15min":0.81399999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.51700000000000002}]},{"osd":3,"last update":"Fri Aug 25 05:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61699999999999999,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85899999999999999,"5min":0.998,"15min":0.998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55600000000000005,"15min":0.57999999999999996},"min":{"1min":0.39000000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.75800000000000001,"5min":0.88700000000000001,"15min":0.98699999999999999},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Aug 25 05:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.754,"15min":0.78500000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83699999999999997,"5min":1.079,"15min":1.2350000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.80000000000000004,"15min":0.82799999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.96199999999999997,"5min":1.147,"15min":1.268},"last":0.84299999999999997}]},{"osd":5,"last update":"Fri Aug 25 05:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.746,"15min":0.79200000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.873,"5min":1.109,"15min":1.1950000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.79500000000000004,"15min":0.81699999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0089999999999999,"5min":1.1890000000000001,"15min":1.214},"last":0.83299999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.82599999999999996,"15min":0.86099999999999999},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.032,"5min":1.159,"15min":1.244},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78800000000000003,"15min":0.82199999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.95999999999999996,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.78100000000000003}]},{"osd":7,"last update":"Fri Aug 25 05:37:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.78200000000000003,"15min":0.82399999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.98299999999999998,"5min":1.149,"15min":1.2929999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.83699999999999997,"15min":0.875},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.99099999999999999,"5min":1.127,"15min":1.2110000000000001},"last":0.76400000000000001}]}]},{"osd":0,"up_from":14,"seq":60129543282,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60656,"kb_used_data":3112,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311184,"statfs":{"total":96636764160,"available":96574652416,"internally_reserved":0,"allocated":3186688,"data_stored":1908074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":58915083},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Aug 25 05:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.46999999999999997,"15min":0.50900000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.66900000000000004,"5min":0.70799999999999996,"15min":1.2170000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55500000000000005,"15min":0.57999999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.624,"5min":0.81599999999999995,"15min":0.85999999999999999},"last":0.66900000000000004}]},{"osd":2,"last update":"Fri Aug 25 05:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.52300000000000002,"15min":0.54000000000000004},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.73499999999999999,"5min":0.73799999999999999,"15min":0.91000000000000003},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54500000000000004,"15min":0.55700000000000005},"min":{"1min":0.38800000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72299999999999998,"5min":0.755,"15min":0.86799999999999999},"last":0.81200000000000006}]},{"osd":3,"last update":"Fri Aug 25 05:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.50700000000000001,"15min":0.52600000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73199999999999998,"5min":0.754,"15min":1.855},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.59599999999999997,"15min":0.621},"min":{"1min":0.42399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86699999999999999,"5min":0.90000000000000002,"15min":1.3480000000000001},"last":0.70099999999999996}]},{"osd":4,"last update":"Fri Aug 25 05:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.81599999999999995,"15min":0.83499999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95799999999999996,"5min":1.258,"15min":1.3799999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.80100000000000005,"15min":0.82499999999999996},"min":{"1min":0.59199999999999997,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.208,"5min":1.2809999999999999,"15min":1.2849999999999999},"last":0.85299999999999998}]},{"osd":5,"last update":"Fri Aug 25 05:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.80100000000000005,"15min":0.81599999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.167,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.80500000000000005,"15min":0.83299999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0660000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.83499999999999996}]},{"osd":6,"last update":"Fri Aug 25 05:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.81499999999999995,"15min":0.82899999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.097,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.84899999999999998,"15min":0.85499999999999998},"min":{"1min":0.53700000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.3460000000000001,"5min":1.3560000000000001,"15min":1.5129999999999999},"last":0.88300000000000001}]},{"osd":7,"last update":"Fri Aug 25 05:38:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.83499999999999996,"15min":0.87},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2609999999999999,"5min":1.4339999999999999,"15min":1.5720000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.84099999999999997,"15min":0.84699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.329,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.96099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-25T05:38:24.819 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-08-25T05:38:24.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.954+0000 7f3ef39df640 1 Processor -- start 2023-08-25T05:38:24.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ef39df640 1 -- start start 2023-08-25T05:38:24.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ef39df640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec06c020 0x7f3eec09bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:24.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ef39df640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec15abd0 con 0x7f3eec0c9830 2023-08-25T05:38:24.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ef39df640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec0c8ab0 con 0x7f3eec15a7f0 2023-08-25T05:38:24.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ef39df640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0c8d50 con 0x7f3eec06c020 2023-08-25T05:38:24.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ef0f7a640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3eec0c9830 0x7f3eec0acff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57306/0 (socket says 172.21.15.55:57306) 2023-08-25T05:38:24.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ef0f7a640 1 -- 172.21.15.55:0/1245749979 learned_addr learned my addr 172.21.15.55:0/1245749979 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-08-25T05:38:24.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ef1f7c640 1 --2- 172.21.15.55:0/1245749979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec06c020 0x7f3eec09bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:24.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ee3fff640 1 -- 172.21.15.55:0/1245749979 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681539287 0 0) 0x7f3eec15abd0 con 0x7f3eec0c9830 2023-08-25T05:38:24.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ee3fff640 1 -- 172.21.15.55:0/1245749979 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed8003530 con 0x7f3eec0c9830 2023-08-25T05:38:24.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ee3fff640 1 -- 172.21.15.55:0/1245749979 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1962380694 0 0) 0x7f3ed8003530 con 0x7f3eec0c9830 2023-08-25T05:38:24.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ee3fff640 1 -- 172.21.15.55:0/1245749979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec06c020 msgr2=0x7f3eec09bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:24.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ee3fff640 1 --2- 172.21.15.55:0/1245749979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec06c020 0x7f3eec09bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:24.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ee3fff640 1 -- 172.21.15.55:0/1245749979 >> v1:172.21.15.110:6789/0 conn(0x7f3eec15a7f0 legacy=0x7f3eec070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:24.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ee3fff640 1 -- 172.21.15.55:0/1245749979 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0c9030 con 0x7f3eec0c9830 2023-08-25T05:38:24.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ee3fff640 1 -- 172.21.15.55:0/1245749979 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1404175774 0 0) 0x7f3edc001680 con 0x7f3eec0c9830 2023-08-25T05:38:24.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ee3fff640 1 -- 172.21.15.55:0/1245749979 >> v1:172.21.15.55:6789/0 conn(0x7f3eec0c9830 legacy=0x7f3eec0acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:24.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ee3fff640 1 --2- 172.21.15.55:0/1245749979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ed80039b0 0x7f3ed8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:24.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ee3fff640 1 --2- 172.21.15.55:0/1245749979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ed8004360 0x7f3ed8004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:24.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ee3fff640 1 --2- 172.21.15.55:0/1245749979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec06c020 0x7f3ed8005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:24.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ee3fff640 1 -- 172.21.15.55:0/1245749979 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0c8d50 con 0x7f3ed80039b0 2023-08-25T05:38:24.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ee3fff640 1 -- 172.21.15.55:0/1245749979 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed800b990 con 0x7f3ed8004360 2023-08-25T05:38:24.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ee3fff640 1 -- 172.21.15.55:0/1245749979 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed800bb50 con 0x7f3eec06c020 2023-08-25T05:38:24.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ef177b640 1 --2- 172.21.15.55:0/1245749979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ed80039b0 0x7f3ed8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:24.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ef1f7c640 1 --2- 172.21.15.55:0/1245749979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec06c020 0x7f3ed8005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:24.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ef0f7a640 1 --2- 172.21.15.55:0/1245749979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ed8004360 0x7f3ed8004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:24.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ef1f7c640 1 -- 172.21.15.55:0/1245749979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ed8004360 msgr2=0x7f3ed8004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:24.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ef1f7c640 1 --2- 172.21.15.55:0/1245749979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ed8004360 0x7f3ed8004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:24.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ef1f7c640 1 -- 172.21.15.55:0/1245749979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ed80039b0 msgr2=0x7f3ed8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:24.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ef1f7c640 1 --2- 172.21.15.55:0/1245749979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ed80039b0 0x7f3ed8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:24.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ef1f7c640 1 -- 172.21.15.55:0/1245749979 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed8003530 con 0x7f3eec06c020 2023-08-25T05:38:24.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.958+0000 7f3ef177b640 1 --2- 172.21.15.55:0/1245749979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3ed80039b0 0x7f3ed8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-25T05:38:24.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.962+0000 7f3ef1f7c640 1 --2- 172.21.15.55:0/1245749979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec06c020 0x7f3ed8005090 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3eec09c320 tx=0x7f3ee401cbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffca77a20bc294fd server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:24.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.962+0000 7f3ee3fff640 1 -- 172.21.15.55:0/1245749979 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee40a5ad0 con 0x7f3eec06c020 2023-08-25T05:38:24.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.962+0000 7f3ee3fff640 1 -- 172.21.15.55:0/1245749979 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee400f040 con 0x7f3eec06c020 2023-08-25T05:38:24.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.962+0000 7f3ee3fff640 1 -- 172.21.15.55:0/1245749979 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee40a5e30 con 0x7f3eec06c020 2023-08-25T05:38:24.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.962+0000 7f3ef39df640 1 -- 172.21.15.55:0/1245749979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec06c020 msgr2=0x7f3ed8005090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.962+0000 7f3ef39df640 1 --2- 172.21.15.55:0/1245749979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec06c020 0x7f3ed8005090 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3eec09c320 tx=0x7f3ee401cbd0 comp rx=0 tx=0).stop 2023-08-25T05:38:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.962+0000 7f3ef1f7c640 1 -- 172.21.15.55:0/1245749979 reap_dead start 2023-08-25T05:38:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.962+0000 7f3ef39df640 1 -- 172.21.15.55:0/1245749979 shutdown_connections 2023-08-25T05:38:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.962+0000 7f3ef39df640 1 -- 172.21.15.55:0/1245749979 >> 172.21.15.55:0/1245749979 conn(0x7f3eec069900 msgr2=0x7f3eec069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.962+0000 7f3ef39df640 1 -- 172.21.15.55:0/1245749979 shutdown_connections 2023-08-25T05:38:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.962+0000 7f3ef39df640 1 -- 172.21.15.55:0/1245749979 wait complete. 2023-08-25T05:38:24.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef39df640 1 Processor -- start 2023-08-25T05:38:24.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef39df640 1 -- start start 2023-08-25T05:38:24.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef39df640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec06c020 0x7f3eec0ac700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:24.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef39df640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3eec1f8910 0x7f3eec15d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:24.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef39df640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3eec1f72f0 0x7f3eec1f8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:24.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef39df640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec1f9c80 con 0x7f3eec1f8910 2023-08-25T05:38:24.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef39df640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0acc40 con 0x7f3eec1f72f0 2023-08-25T05:38:24.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef39df640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec1f8480 con 0x7f3eec06c020 2023-08-25T05:38:24.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef0f7a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3eec1f8910 0x7f3eec15d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:24.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef0f7a640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3eec1f8910 0x7f3eec15d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37066/0 (socket says 172.21.15.55:37066) 2023-08-25T05:38:24.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef0f7a640 1 -- 172.21.15.55:0/2077719682 learned_addr learned my addr 172.21.15.55:0/2077719682 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:24.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef177b640 1 --2- 172.21.15.55:0/2077719682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec06c020 0x7f3eec0ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:24.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef1f7c640 1 --2- 172.21.15.55:0/2077719682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3eec1f72f0 0x7f3eec1f8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:24.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef0f7a640 1 -- 172.21.15.55:0/2077719682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec06c020 msgr2=0x7f3eec0ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:24.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef0f7a640 1 --2- 172.21.15.55:0/2077719682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec06c020 0x7f3eec0ac700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:24.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef0f7a640 1 -- 172.21.15.55:0/2077719682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3eec1f72f0 msgr2=0x7f3eec1f8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef0f7a640 1 --2- 172.21.15.55:0/2077719682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3eec1f72f0 0x7f3eec1f8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef0f7a640 1 -- 172.21.15.55:0/2077719682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec1f7870 con 0x7f3eec1f8910 2023-08-25T05:38:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef1f7c640 1 --2- 172.21.15.55:0/2077719682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3eec1f72f0 0x7f3eec1f8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:38:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef0f7a640 1 --2- 172.21.15.55:0/2077719682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3eec1f8910 0x7f3eec15d640 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0072c0 tx=0x7f3edc007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ee1ffb640 1 -- 172.21.15.55:0/2077719682 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc00f9c0 con 0x7f3eec1f8910 2023-08-25T05:38:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ee1ffb640 1 -- 172.21.15.55:0/2077719682 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc00fb60 con 0x7f3eec1f8910 2023-08-25T05:38:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ee1ffb640 1 -- 172.21.15.55:0/2077719682 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc0133f0 con 0x7f3eec1f8910 2023-08-25T05:38:24.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.966+0000 7f3ef39df640 1 -- 172.21.15.55:0/2077719682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eec1f7b50 con 0x7f3eec1f8910 2023-08-25T05:38:24.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.970+0000 7f3ef39df640 1 -- 172.21.15.55:0/2077719682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eec1f8110 con 0x7f3eec1f8910 2023-08-25T05:38:24.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.970+0000 7f3ef39df640 1 -- 172.21.15.55:0/2077719682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eec1f82d0 con 0x7f3eec1f8910 2023-08-25T05:38:24.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.970+0000 7f3ee1ffb640 1 -- 172.21.15.55:0/2077719682 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7f3edc013550 con 0x7f3eec1f8910 2023-08-25T05:38:24.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.970+0000 7f3ee1ffb640 1 --2- 172.21.15.55:0/2077719682 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f3ed00657d0 0x7f3ed0067c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:24.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.970+0000 7f3ee1ffb640 1 -- 172.21.15.55:0/2077719682 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f3edc083200 con 0x7f3eec1f8910 2023-08-25T05:38:24.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.974+0000 7f3ef177b640 1 --2- 172.21.15.55:0/2077719682 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f3ed00657d0 0x7f3ed0067c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:24.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.974+0000 7f3ef177b640 1 --2- 172.21.15.55:0/2077719682 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f3ed00657d0 0x7f3ed0067c90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8001460 tx=0x7f3ee8009040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:24.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:24.974+0000 7f3ee1ffb640 1 -- 172.21.15.55:0/2077719682 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7f3edc050b80 con 0x7f3eec1f8910 2023-08-25T05:38:25.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.130+0000 7f3ef39df640 1 -- 172.21.15.55:0/2077719682 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f3eec06d5b0 con 0x7f3eec1f8910 2023-08-25T05:38:25.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.138+0000 7f3ee1ffb640 1 -- 172.21.15.55:0/2077719682 <== mon.0 v2:172.21.15.55:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3edc050b80 con 0x7f3eec1f8910 2023-08-25T05:38:25.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.138+0000 7f3ee1ffb640 1 -- 172.21.15.55:0/2077719682 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v76)=0 v76) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3edc0541a0 con 0x7f3eec1f8910 2023-08-25T05:38:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.142+0000 7f3ef39df640 1 -- 172.21.15.55:0/2077719682 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f3ed00657d0 msgr2=0x7f3ed0067c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.142+0000 7f3ef39df640 1 --2- 172.21.15.55:0/2077719682 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f3ed00657d0 0x7f3ed0067c90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8001460 tx=0x7f3ee8009040 comp rx=0 tx=0).stop 2023-08-25T05:38:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.142+0000 7f3ef39df640 1 -- 172.21.15.55:0/2077719682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3eec1f8910 msgr2=0x7f3eec15d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.142+0000 7f3ef39df640 1 --2- 172.21.15.55:0/2077719682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3eec1f8910 0x7f3eec15d640 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0072c0 tx=0x7f3edc007780 comp rx=0 tx=0).stop 2023-08-25T05:38:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.142+0000 7f3ef39df640 1 -- 172.21.15.55:0/2077719682 shutdown_connections 2023-08-25T05:38:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.142+0000 7f3ef39df640 1 --2- 172.21.15.55:0/2077719682 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7f3ed00657d0 0x7f3ed0067c90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.142+0000 7f3ef39df640 1 --2- 172.21.15.55:0/2077719682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3eec1f72f0 0x7f3eec1f8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.142+0000 7f3ef39df640 1 --2- 172.21.15.55:0/2077719682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3eec1f8910 0x7f3eec15d640 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.142+0000 7f3ef39df640 1 --2- 172.21.15.55:0/2077719682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3eec06c020 0x7f3eec0ac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.142+0000 7f3ef39df640 1 -- 172.21.15.55:0/2077719682 >> 172.21.15.55:0/2077719682 conn(0x7f3eec069900 msgr2=0x7f3eec1637c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.142+0000 7f3ef39df640 1 -- 172.21.15.55:0/2077719682 shutdown_connections 2023-08-25T05:38:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.142+0000 7f3ef39df640 1 -- 172.21.15.55:0/2077719682 wait complete. 2023-08-25T05:38:25.163 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-25T05:38:25.163 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-25T05:38:25.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.302+0000 7ff501f82640 1 Processor -- start 2023-08-25T05:38:25.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.302+0000 7ff501f82640 1 -- start start 2023-08-25T05:38:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.302+0000 7ff501f82640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4fc0cce60 0x7ff4fc0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.302+0000 7ff501f82640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff4fc0cece0 0x7ff4fc0b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.302+0000 7ff501f82640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4fc0cf0f0 con 0x7ff4fc15fef0 2023-08-25T05:38:25.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.302+0000 7ff501f82640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4fc0cd2f0 con 0x7ff4fc0cce60 2023-08-25T05:38:25.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.302+0000 7ff501f82640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4fc0b3150 con 0x7ff4fc0cece0 2023-08-25T05:38:25.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.302+0000 7ff4faffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4fc0cce60 0x7ff4fc0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:25.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.306+0000 7ff4faffd640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4fc0cce60 0x7ff4fc0ce7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37080/0 (socket says 172.21.15.55:37080) 2023-08-25T05:38:25.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.306+0000 7ff4faffd640 1 -- 172.21.15.55:0/2665752760 learned_addr learned my addr 172.21.15.55:0/2665752760 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:25.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.306+0000 7ff4fbfff640 1 --2- 172.21.15.55:0/2665752760 >> v2:172.21.15.110:3300/0 conn(0x7ff4fc0cece0 0x7ff4fc0b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:25.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.306+0000 7ff4faffd640 1 -- 172.21.15.55:0/2665752760 >> v2:172.21.15.110:3300/0 conn(0x7ff4fc0cece0 msgr2=0x7ff4fc0b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:25.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.306+0000 7ff4faffd640 1 --2- 172.21.15.55:0/2665752760 >> v2:172.21.15.110:3300/0 conn(0x7ff4fc0cece0 0x7ff4fc0b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:25.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.306+0000 7ff4faffd640 1 -- 172.21.15.55:0/2665752760 >> v1:172.21.15.110:6789/0 conn(0x7ff4fc15fef0 legacy=0x7ff4fc0b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-25T05:38:25.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.306+0000 7ff4faffd640 1 -- 172.21.15.55:0/2665752760 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc160570 con 0x7ff4fc0cce60 2023-08-25T05:38:25.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.306+0000 7ff4faffd640 1 --2- 172.21.15.55:0/2665752760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4fc0cce60 0x7ff4fc0ce7a0 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc06a8c0 tx=0x7ff4f001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f421f871f4b3ec server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:25.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.306+0000 7ff4fa7fc640 1 -- 172.21.15.55:0/2665752760 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00a6040 con 0x7ff4fc0cce60 2023-08-25T05:38:25.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.306+0000 7ff4fa7fc640 1 -- 172.21.15.55:0/2665752760 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff4f00aa600 con 0x7ff4fc0cce60 2023-08-25T05:38:25.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.306+0000 7ff4fa7fc640 1 -- 172.21.15.55:0/2665752760 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00aa9b0 con 0x7ff4fc0cce60 2023-08-25T05:38:25.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff501f82640 1 -- 172.21.15.55:0/2665752760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4fc0cce60 msgr2=0x7ff4fc0ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:25.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff501f82640 1 --2- 172.21.15.55:0/2665752760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4fc0cce60 0x7ff4fc0ce7a0 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc06a8c0 tx=0x7ff4f001c4a0 comp rx=0 tx=0).stop 2023-08-25T05:38:25.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff501f82640 1 -- 172.21.15.55:0/2665752760 shutdown_connections 2023-08-25T05:38:25.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff501f82640 1 --2- 172.21.15.55:0/2665752760 >> v2:172.21.15.110:3300/0 conn(0x7ff4fc0cece0 0x7ff4fc0b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:25.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff501f82640 1 --2- 172.21.15.55:0/2665752760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4fc0cce60 0x7ff4fc0ce7a0 unknown :-1 s=CLOSED pgs=2249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:25.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff501f82640 1 -- 172.21.15.55:0/2665752760 >> 172.21.15.55:0/2665752760 conn(0x7ff4fc069d00 msgr2=0x7ff4fc06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:25.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff501f82640 1 -- 172.21.15.55:0/2665752760 shutdown_connections 2023-08-25T05:38:25.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff501f82640 1 -- 172.21.15.55:0/2665752760 wait complete. 2023-08-25T05:38:25.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff501f82640 1 Processor -- start 2023-08-25T05:38:25.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff501f82640 1 -- start start 2023-08-25T05:38:25.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff501f82640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4fc0cce60 0x7ff4fc09bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:25.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff501f82640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4fc0cece0 0x7ff4fc0c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:25.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff501f82640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4fc15fef0 0x7ff4fc0ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:25.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff501f82640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc0c6730 con 0x7ff4fc0cece0 2023-08-25T05:38:25.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff501f82640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc0c6c50 con 0x7ff4fc0cce60 2023-08-25T05:38:25.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff501f82640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc0ae5b0 con 0x7ff4fc15fef0 2023-08-25T05:38:25.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff4faffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4fc0cece0 0x7ff4fc0c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:25.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff4faffd640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4fc0cece0 0x7ff4fc0c5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37088/0 (socket says 172.21.15.55:37088) 2023-08-25T05:38:25.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff4faffd640 1 -- 172.21.15.55:0/3818267272 learned_addr learned my addr 172.21.15.55:0/3818267272 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-08-25T05:38:25.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff4fbfff640 1 --2- 172.21.15.55:0/3818267272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4fc15fef0 0x7ff4fc0ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:25.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff4fb7fe640 1 --2- 172.21.15.55:0/3818267272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4fc0cce60 0x7ff4fc09bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:25.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff4faffd640 1 -- 172.21.15.55:0/3818267272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4fc15fef0 msgr2=0x7ff4fc0ab2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:25.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff4faffd640 1 --2- 172.21.15.55:0/3818267272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4fc15fef0 0x7ff4fc0ab2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:25.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff4faffd640 1 -- 172.21.15.55:0/3818267272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4fc0cce60 msgr2=0x7ff4fc09bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:25.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff4faffd640 1 --2- 172.21.15.55:0/3818267272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4fc0cce60 0x7ff4fc09bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff4faffd640 1 -- 172.21.15.55:0/3818267272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f00094d0 con 0x7ff4fc0cece0 2023-08-25T05:38:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.310+0000 7ff4fb7fe640 1 --2- 172.21.15.55:0/3818267272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4fc0cce60 0x7ff4fc09bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-25T05:38:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.314+0000 7ff4faffd640 1 --2- 172.21.15.55:0/3818267272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4fc0cece0 0x7ff4fc0c5470 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7ff4f001a0d0 tx=0x7ff4f001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.314+0000 7ff4e3fff640 1 -- 172.21.15.55:0/3818267272 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00b3800 con 0x7ff4fc0cece0 2023-08-25T05:38:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.314+0000 7ff4e3fff640 1 -- 172.21.15.55:0/3818267272 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff4f00b3960 con 0x7ff4fc0cece0 2023-08-25T05:38:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.314+0000 7ff4e3fff640 1 -- 172.21.15.55:0/3818267272 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00b3cd0 con 0x7ff4fc0cece0 2023-08-25T05:38:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.314+0000 7ff501f82640 1 -- 172.21.15.55:0/3818267272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4fc0ae890 con 0x7ff4fc0cece0 2023-08-25T05:38:25.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.314+0000 7ff501f82640 1 -- 172.21.15.55:0/3818267272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4fc0aee50 con 0x7ff4fc0cece0 2023-08-25T05:38:25.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.314+0000 7ff501f82640 1 -- 172.21.15.55:0/3818267272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4fc0c6dc0 con 0x7ff4fc0cece0 2023-08-25T05:38:25.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.314+0000 7ff4e3fff640 1 -- 172.21.15.55:0/3818267272 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 125) v1 ==== 85064+0+0 (secure 0 0 0) 0x7ff4f00b2380 con 0x7ff4fc0cece0 2023-08-25T05:38:25.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.314+0000 7ff4e3fff640 1 --2- 172.21.15.55:0/3818267272 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ff4e80657a0 0x7ff4e8067c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-25T05:38:25.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.314+0000 7ff4e3fff640 1 -- 172.21.15.55:0/3818267272 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(207..207 src has 1..207) v4 ==== 5984+0+0 (secure 0 0 0) 0x7ff4f011d320 con 0x7ff4fc0cece0 2023-08-25T05:38:25.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.318+0000 7ff4fb7fe640 1 --2- 172.21.15.55:0/3818267272 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ff4e80657a0 0x7ff4e8067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-25T05:38:25.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.318+0000 7ff4fb7fe640 1 --2- 172.21.15.55:0/3818267272 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ff4e80657a0 0x7ff4e8067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0098b0 tx=0x7ff4ec008040 comp rx=0 tx=0).ready entity=mgr.9404 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-25T05:38:25.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.318+0000 7ff4e3fff640 1 -- 172.21.15.55:0/3818267272 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171382 (secure 0 0 0) 0x7ff4f00ead60 con 0x7ff4fc0cece0 2023-08-25T05:38:25.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.510+0000 7ff501f82640 1 -- 172.21.15.55:0/3818267272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4fc04dbe0 con 0x7ff4fc0cece0 2023-08-25T05:38:25.512 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.510+0000 7ff4e3fff640 1 -- 172.21.15.55:0/3818267272 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+3709 (secure 0 0 0) 0x7ff4f00c3e90 con 0x7ff4fc0cece0 2023-08-25T05:38:25.512 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-08-25T05:38:25.512 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":102,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9179,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6836/2330461418","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":2330461418},{"type":"v1","addr":"172.21.15.110:6836","nonce":2330461418}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":9182,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6837/3918521245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6835","nonce":3918521245},{"type":"v1","addr":"172.21.15.110:6837","nonce":3918521245}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":11343,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/3205982255","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3205982255},{"type":"v1","addr":"172.21.15.55:6834","nonce":3205982255}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":94},{"gid":11823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3207853911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3207853911},{"type":"v1","addr":"172.21.15.55:6835","nonce":3207853911}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":102}],"filesystems":[]} 2023-08-25T05:38:25.513 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 102 2023-08-25T05:38:25.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.510+0000 7ff501f82640 1 -- 172.21.15.55:0/3818267272 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ff4e80657a0 msgr2=0x7ff4e8067c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:25.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.510+0000 7ff501f82640 1 --2- 172.21.15.55:0/3818267272 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ff4e80657a0 0x7ff4e8067c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0098b0 tx=0x7ff4ec008040 comp rx=0 tx=0).stop 2023-08-25T05:38:25.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.510+0000 7ff501f82640 1 -- 172.21.15.55:0/3818267272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4fc0cece0 msgr2=0x7ff4fc0c5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-25T05:38:25.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.510+0000 7ff501f82640 1 --2- 172.21.15.55:0/3818267272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4fc0cece0 0x7ff4fc0c5470 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7ff4f001a0d0 tx=0x7ff4f001ace0 comp rx=0 tx=0).stop 2023-08-25T05:38:25.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.510+0000 7ff501f82640 1 -- 172.21.15.55:0/3818267272 shutdown_connections 2023-08-25T05:38:25.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.510+0000 7ff501f82640 1 --2- 172.21.15.55:0/3818267272 >> [v2:172.21.15.110:6832/1527806048,v1:172.21.15.110:6833/1527806048] conn(0x7ff4e80657a0 0x7ff4e8067c60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:25.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.510+0000 7ff501f82640 1 --2- 172.21.15.55:0/3818267272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff4fc15fef0 0x7ff4fc0ab2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:25.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.510+0000 7ff501f82640 1 --2- 172.21.15.55:0/3818267272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4fc0cece0 0x7ff4fc0c5470 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:25.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.510+0000 7ff501f82640 1 --2- 172.21.15.55:0/3818267272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff4fc0cce60 0x7ff4fc09bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-25T05:38:25.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.510+0000 7ff501f82640 1 -- 172.21.15.55:0/3818267272 >> 172.21.15.55:0/3818267272 conn(0x7ff4fc069d00 msgr2=0x7ff4fc0c9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-25T05:38:25.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.510+0000 7ff501f82640 1 -- 172.21.15.55:0/3818267272 shutdown_connections 2023-08-25T05:38:25.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-08-25T05:38:25.510+0000 7ff501f82640 1 -- 172.21.15.55:0/3818267272 wait complete. 2023-08-25T05:38:25.533 DEBUG:tasks.cephfs.filesystem:already dead... 2023-08-25T05:38:25.533 INFO:teuthology.misc:Shutting down mds daemons... 2023-08-25T05:38:25.534 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-25T05:38:25.534 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:38:25.546 INFO:tasks.ceph.mds.a:Stopped 2023-08-25T05:38:25.546 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-25T05:38:25.546 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:38:25.598 INFO:tasks.ceph.mds.c:Stopped 2023-08-25T05:38:25.599 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-25T05:38:25.599 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:38:25.613 INFO:tasks.ceph.mds.b:Stopped 2023-08-25T05:38:25.613 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-25T05:38:25.613 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:38:25.667 INFO:tasks.ceph.mds.d:Stopped 2023-08-25T05:38:25.668 INFO:teuthology.misc:Shutting down osd daemons... 2023-08-25T05:38:25.668 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-08-25T05:38:25.668 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:38:25.738 INFO:tasks.ceph.osd.0:Stopped 2023-08-25T05:38:25.738 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-08-25T05:38:25.738 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:38:31.840 INFO:tasks.ceph.osd.1:Stopped 2023-08-25T05:38:31.841 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-08-25T05:38:31.841 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:38:31.908 INFO:tasks.ceph.osd.2:Stopped 2023-08-25T05:38:31.908 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-08-25T05:38:31.909 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:38:38.010 INFO:tasks.ceph.osd.3:Stopped 2023-08-25T05:38:38.011 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-08-25T05:38:38.011 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:38:38.074 INFO:tasks.ceph.osd.4:Stopped 2023-08-25T05:38:38.074 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-08-25T05:38:38.074 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:38:38.834 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-08-25T05:38:44.177 INFO:tasks.ceph.osd.5:Stopped 2023-08-25T05:38:44.177 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-08-25T05:38:44.178 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:38:44.244 INFO:tasks.ceph.osd.6:Stopped 2023-08-25T05:38:44.245 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-08-25T05:38:44.245 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:38:44.539 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-08-25T05:38:44.539 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-08-25T05:38:48.134 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:38:48.138 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:38:50.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-08-25T05:38:50.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-08-25T05:38:50.346 INFO:tasks.ceph.osd.7:Stopped 2023-08-25T05:38:50.347 INFO:teuthology.misc:Shutting down mgr daemons... 2023-08-25T05:38:50.347 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-08-25T05:38:50.347 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:38:50.403 INFO:tasks.ceph.mgr.y:Stopped 2023-08-25T05:38:50.404 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-08-25T05:38:50.404 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:38:50.463 INFO:tasks.ceph.mgr.x:Stopped 2023-08-25T05:38:50.463 INFO:teuthology.misc:Shutting down mon daemons... 2023-08-25T05:38:50.464 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-08-25T05:38:50.464 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:38:50.494 INFO:tasks.ceph.mon.a:Stopped 2023-08-25T05:38:50.494 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-08-25T05:38:50.494 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:38:50.516 INFO:tasks.ceph.mon.b:Stopped 2023-08-25T05:38:50.516 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-08-25T05:38:50.516 INFO:teuthology.orchestra.run:waiting for 300 2023-08-25T05:38:50.580 INFO:tasks.ceph.mon.c:Stopped 2023-08-25T05:38:50.580 INFO:tasks.ceph:Checking cluster log for badness... 2023-08-25T05:38:50.581 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-25T05:38:50.611 INFO:teuthology.orchestra.run.smithi055.stdout:2023-08-25T04:17:22.687915+0000 mon.a (mon.0) 543 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-08-25T05:38:50.612 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-08-25T05:38:50.613 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-25T05:38:50.688 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-25T05:38:50.765 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-25T05:38:50.840 INFO:teuthology.orchestra.run.smithi055.stdout:2023-08-25T04:17:22.687915+0000 mon.a (mon.0) 543 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-08-25T05:38:50.840 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T05:38:50.841 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-08-25T05:38:51.358 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T05:38:51.358 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-08-25T05:38:51.717 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T05:38:51.718 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-08-25T05:38:52.069 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T05:38:52.070 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-08-25T05:38:52.622 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi110.front.sepia.ceph.com 2023-08-25T05:38:52.622 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-08-25T05:38:53.117 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi110.front.sepia.ceph.com 2023-08-25T05:38:53.118 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-08-25T05:38:53.650 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi110.front.sepia.ceph.com 2023-08-25T05:38:53.650 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-08-25T05:38:54.074 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi110.front.sepia.ceph.com 2023-08-25T05:38:54.074 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-08-25T05:38:54.537 INFO:tasks.ceph:Archiving mon data... 2023-08-25T05:38:54.539 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379036/data/mon.a.tgz 2023-08-25T05:38:54.539 DEBUG:teuthology.orchestra.run.smithi055:> mktemp 2023-08-25T05:38:54.549 INFO:teuthology.orchestra.run.smithi055.stdout:/tmp/tmp.lgg3aPCSjc 2023-08-25T05:38:54.549 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.lgg3aPCSjc 2023-08-25T05:38:55.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-08-25T05:38:55.060 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0666 /tmp/tmp.lgg3aPCSjc 2023-08-25T05:38:55.139 DEBUG:teuthology.orchestra.remote:smithi055:/tmp/tmp.lgg3aPCSjc is 3MB 2023-08-25T05:38:55.227 DEBUG:teuthology.orchestra.run.smithi055:> rm -fr /tmp/tmp.lgg3aPCSjc 2023-08-25T05:38:55.236 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379036/data/mon.b.tgz 2023-08-25T05:38:55.237 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2023-08-25T05:38:55.246 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.aEtohCN9tw 2023-08-25T05:38:55.246 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.aEtohCN9tw 2023-08-25T05:38:55.728 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.aEtohCN9tw 2023-08-25T05:38:55.806 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.aEtohCN9tw is 3MB 2023-08-25T05:38:55.894 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.aEtohCN9tw 2023-08-25T05:38:55.904 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379036/data/mon.c.tgz 2023-08-25T05:38:55.905 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2023-08-25T05:38:55.958 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.e2hvvyANo3 2023-08-25T05:38:55.958 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.e2hvvyANo3 2023-08-25T05:38:56.445 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.e2hvvyANo3 2023-08-25T05:38:56.518 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.e2hvvyANo3 is 3MB 2023-08-25T05:38:56.603 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.e2hvvyANo3 2023-08-25T05:38:56.612 INFO:tasks.ceph:Cleaning ceph cluster... 2023-08-25T05:38:56.613 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-25T05:38:56.616 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-25T05:38:56.674 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-08-25T05:38:56.675 DEBUG:teuthology.orchestra.run.smithi055:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-25T05:38:56.682 DEBUG:teuthology.orchestra.run.smithi110:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-25T05:38:56.733 INFO:teuthology.orchestra.run.smithi055.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-25T05:38:56.748 INFO:teuthology.orchestra.run.smithi110.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-25T05:38:56.754 INFO:tasks.ceph:Archiving crash dumps... 2023-08-25T05:38:56.761 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379036/remote/smithi055/crash 2023-08-25T05:38:56.762 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-25T05:38:56.784 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379036/remote/smithi110/crash 2023-08-25T05:38:56.785 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-25T05:38:56.817 INFO:tasks.ceph:Shutting down logrotate 2023-08-25T05:38:56.818 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:38:56.833 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-25T05:38:56.913 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-25T05:38:56.934 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-25T05:38:56.954 INFO:tasks.ceph:Compressing logs... 2023-08-25T05:38:56.954 DEBUG:teuthology.orchestra.run.smithi055:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-25T05:38:56.982 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-25T05:38:57.009 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48900.log 2023-08-25T05:38:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46171.log 2023-08-25T05:38:57.011 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48900.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48900.log.gz 2023-08-25T05:38:57.012 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65554.log 2023-08-25T05:38:57.012 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46171.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46171.log.gz 2023-08-25T05:38:57.013 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57446.log 2023-08-25T05:38:57.013 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65554.log: gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65554.log.gz -5 2023-08-25T05:38:57.014 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48265.log 2023-08-25T05:38:57.015 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57446.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57446.log.gz 2023-08-25T05:38:57.015 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47891.log 2023-08-25T05:38:57.016 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48265.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48265.log.gz 2023-08-25T05:38:57.016 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66655.log 2023-08-25T05:38:57.017 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47891.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47891.log.gz 2023-08-25T05:38:57.017 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56015.log 2023-08-25T05:38:57.018 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66655.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66655.log.gz 2023-08-25T05:38:57.018 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56243.log 2023-08-25T05:38:57.019 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56015.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56015.log.gz 2023-08-25T05:38:57.019 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66759.log 2023-08-25T05:38:57.020 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56439.log 87.6% 2023-08-25T05:38:57.020 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56243.log.gz 2023-08-25T05:38:57.021 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66759.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66759.log.gz 2023-08-25T05:38:57.021 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60333.log 2023-08-25T05:38:57.022 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56439.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56439.log.gz 2023-08-25T05:38:57.022 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58116.log 2023-08-25T05:38:57.023 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60333.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.60333.log.gz 2023-08-25T05:38:57.023 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56648.log 2023-08-25T05:38:57.024 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58116.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58116.log.gz 2023-08-25T05:38:57.024 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47835.log 2023-08-25T05:38:57.025 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56648.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56648.log.gz 2023-08-25T05:38:57.026 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47017.log 2023-08-25T05:38:57.026 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47835.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47835.log.gz 2023-08-25T05:38:57.027 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55362.log 2023-08-25T05:38:57.028 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47017.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47017.log.gz 2023-08-25T05:38:57.028 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59798.log 2023-08-25T05:38:57.029 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55362.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55362.log.gz 2023-08-25T05:38:57.029 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62310.log 2023-08-25T05:38:57.030 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59798.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59798.log.gz 2023-08-25T05:38:57.030 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53125.log 2023-08-25T05:38:57.031 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62310.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62310.log.gz 2023-08-25T05:38:57.031 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52589.log 2023-08-25T05:38:57.032 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53125.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.53125.log.gz 2023-08-25T05:38:57.033 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42990.log 2023-08-25T05:38:57.033 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38198.log 2023-08-25T05:38:57.034 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66381.log 2023-08-25T05:38:57.034 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52589.log.gz 2023-08-25T05:38:57.035 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38054.log 2023-08-25T05:38:57.035 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42990.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42990.log.gz 2023-08-25T05:38:57.035 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64894.log 2023-08-25T05:38:57.036 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66381.log: gzip -5 88.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.66381.log.gz -- 2023-08-25T05:38:57.036 INFO:teuthology.orchestra.run.smithi055.stderr: /var/log/ceph/ceph-client.admin.64328.log 2023-08-25T05:38:57.037 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.38198.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-08-25T05:38:57.037 INFO:teuthology.orchestra.run.smithi110.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38198.log.gz 2023-08-25T05:38:57.037 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.38054.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-08-25T05:38:57.037 INFO:teuthology.orchestra.run.smithi110.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38054.log.gz 2023-08-25T05:38:57.038 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38126.log 2023-08-25T05:38:57.038 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42225.log 2023-08-25T05:38:57.039 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64894.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64894.log.gz 2023-08-25T05:38:57.039 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67791.log 2023-08-25T05:38:57.040 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64328.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64328.log.gz 2023-08-25T05:38:57.040 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57197.log 2023-08-25T05:38:57.040 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67791.log: gzip -5 89.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.67791.log.gz -- 2023-08-25T05:38:57.040 INFO:teuthology.orchestra.run.smithi055.stderr: /var/log/ceph/ceph-client.admin.49506.log 2023-08-25T05:38:57.041 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57197.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57197.log.gz 2023-08-25T05:38:57.042 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70621.log 2023-08-25T05:38:57.042 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58764.log 2023-08-25T05:38:57.042 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49506.log.gz 2023-08-25T05:38:57.043 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.38126.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38126.log.gz 2023-08-25T05:38:57.043 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38030.log 2023-08-25T05:38:57.043 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.1.42225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42225.log.gz 2023-08-25T05:38:57.043 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38174.log 2023-08-25T05:38:57.043 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.38030.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-08-25T05:38:57.043 INFO:teuthology.orchestra.run.smithi110.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38030.log.gz 2023-08-25T05:38:57.044 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.38174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42310.log 2023-08-25T05:38:57.044 INFO:teuthology.orchestra.run.smithi110.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38174.log.gz 2023-08-25T05:38:57.045 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-08-25T05:38:57.045 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.3.42310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42310.log.gz 2023-08-25T05:38:57.045 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-25T05:38:57.046 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70621.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70621.log.gz 2023-08-25T05:38:57.046 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52042.log 2023-08-25T05:38:57.046 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58764.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58764.log.gz 2023-08-25T05:38:57.047 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43397.log 2023-08-25T05:38:57.047 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52042.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52042.log.gz 2023-08-25T05:38:57.047 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58520.log 2023-08-25T05:38:57.047 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43397.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43397.log.gz 2023-08-25T05:38:57.047 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57145.log 2023-08-25T05:38:57.048 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-08-25T05:38:57.049 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38102.log 2023-08-25T05:38:57.049 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58520.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58520.log.gz 2023-08-25T05:38:57.049 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48674.log 2023-08-25T05:38:57.050 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57145.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57145.log.gz 2023-08-25T05:38:57.050 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50165.log 2023-08-25T05:38:57.050 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48674.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48674.log.gz 2023-08-25T05:38:57.050 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55296.log 2023-08-25T05:38:57.051 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50165.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50165.log.gz 2023-08-25T05:38:57.052 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57420.log 2023-08-25T05:38:57.052 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55296.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55296.log.gz 2023-08-25T05:38:57.052 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64678.log 2023-08-25T05:38:57.052 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38078.log 2023-08-25T05:38:57.053 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.38102.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38102.log.gz 2023-08-25T05:38:57.053 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-08-25T05:38:57.053 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.38078.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-08-25T05:38:57.054 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.audit.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38078.log.gz 2023-08-25T05:38:57.055 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57420.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57420.log.gz 2023-08-25T05:38:57.055 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52120.log 2023-08-25T05:38:57.055 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64678.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64678.log.gz 2023-08-25T05:38:57.055 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57855.log 2023-08-25T05:38:57.055 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52120.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52120.log.gz 2023-08-25T05:38:57.055 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53628.log 2023-08-25T05:38:57.056 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-08-25T05:38:57.057 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57855.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57855.log.gz 2023-08-25T05:38:57.057 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64274.log 2023-08-25T05:38:57.057 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53628.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53628.log.gz 2023-08-25T05:38:57.057 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43943.log 2023-08-25T05:38:57.058 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64274.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64274.log.gz 2023-08-25T05:38:57.058 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-08-25T05:38:57.058 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43943.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43943.log.gz 2023-08-25T05:38:57.058 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43954.log 2023-08-25T05:38:57.060 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51247.log 2023-08-25T05:38:57.061 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43954.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43954.log.gz 2023-08-25T05:38:57.061 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54810.log 2023-08-25T05:38:57.061 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mds.d.log: 94.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-08-25T05:38:57.062 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51247.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51247.log.gz 2023-08-25T05:38:57.062 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48618.log 2023-08-25T05:38:57.063 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54810.log: gzip -5 --verbose -- 89.4% /var/log/ceph/ceph-client.admin.58364.log -- replaced with /var/log/ceph/ceph-client.admin.54810.log.gz 2023-08-25T05:38:57.063 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:57.064 INFO:teuthology.orchestra.run.smithi110.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-25T05:38:57.064 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-08-25T05:38:57.064 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50666.log 2023-08-25T05:38:57.065 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48618.log.gz 2023-08-25T05:38:57.065 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-08-25T05:38:57.066 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58364.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58364.log.gz 2023-08-25T05:38:57.066 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64756.log 2023-08-25T05:38:57.066 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50666.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50666.log.gz 2023-08-25T05:38:57.067 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43971.log 2023-08-25T05:38:57.067 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57550.log 2023-08-25T05:38:57.067 INFO:teuthology.orchestra.run.smithi055.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.64756.log.gz 2023-08-25T05:38:57.068 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43971.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43971.log.gz 2023-08-25T05:38:57.068 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50477.log 2023-08-25T05:38:57.069 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57550.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57550.log.gz 2023-08-25T05:38:57.069 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54510.log 2023-08-25T05:38:57.070 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50477.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50477.log.gz 2023-08-25T05:38:57.070 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45318.log 2023-08-25T05:38:57.071 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54510.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54510.log.gz 2023-08-25T05:38:57.071 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54706.log 2023-08-25T05:38:57.072 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45318.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45318.log.gz 2023-08-25T05:38:57.072 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66523.log 2023-08-25T05:38:57.073 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68226.log 2023-08-25T05:38:57.073 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54706.log.gz 2023-08-25T05:38:57.074 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66523.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66523.log.gz 2023-08-25T05:38:57.074 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58442.log 2023-08-25T05:38:57.075 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68226.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68226.log.gz 2023-08-25T05:38:57.076 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67608.log 2023-08-25T05:38:57.076 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58442.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58442.log.gz 2023-08-25T05:38:57.077 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64730.log 2023-08-25T05:38:57.077 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67608.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67608.log.gz 2023-08-25T05:38:57.078 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68174.log 2023-08-25T05:38:57.079 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64730.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64730.log.gz 2023-08-25T05:38:57.079 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58600.log 2023-08-25T05:38:57.080 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57368.log 2023-08-25T05:38:57.080 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68174.log.gz 2023-08-25T05:38:57.080 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38150.log 2023-08-25T05:38:57.081 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58600.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58600.log.gz 2023-08-25T05:38:57.081 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45955.log 2023-08-25T05:38:57.082 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57368.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.57368.log.gz 2023-08-25T05:38:57.082 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68841.log 2023-08-25T05:38:57.083 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45955.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45955.log.gz 2023-08-25T05:38:57.083 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61627.log 2023-08-25T05:38:57.084 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68841.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68841.log.gz 2023-08-25T05:38:57.084 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65789.log 2023-08-25T05:38:57.085 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61627.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61627.log.gz 2023-08-25T05:38:57.085 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48239.log 2023-08-25T05:38:57.086 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65789.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65789.log.gz 2023-08-25T05:38:57.086 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50952.log 2023-08-25T05:38:57.087 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45030.log 2023-08-25T05:38:57.087 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48239.log.gz 2023-08-25T05:38:57.088 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50952.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50952.log.gz 2023-08-25T05:38:57.088 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-08-25T05:38:57.089 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45030.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45030.log.gz 2023-08-25T05:38:57.089 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68261.log 2023-08-25T05:38:57.090 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55218.log 2023-08-25T05:38:57.091 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68261.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68261.log.gz 2023-08-25T05:38:57.091 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70565.log 2023-08-25T05:38:57.092 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45108.log 2023-08-25T05:38:57.093 INFO:teuthology.orchestra.run.smithi055.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55218.log.gz 2023-08-25T05:38:57.093 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70565.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70565.log.gz 2023-08-25T05:38:57.094 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61810.log 2023-08-25T05:38:57.095 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45108.log: gzip -5 --verbose 88.8% -- -- replaced with /var/log/ceph/ceph-client.admin.45108.log.gz /var/log/ceph/ceph-client.admin.59167.log 2023-08-25T05:38:57.095 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:57.096 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61810.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61810.log.gz 2023-08-25T05:38:57.096 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52915.log 2023-08-25T05:38:57.097 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52380.log 2023-08-25T05:38:57.097 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59167.log.gz 2023-08-25T05:38:57.098 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.38150.log: 94.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-08-25T05:38:57.098 INFO:teuthology.orchestra.run.smithi110.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38150.log.gz 2023-08-25T05:38:57.099 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52915.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52915.log.gz 2023-08-25T05:38:57.099 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55000.log 2023-08-25T05:38:57.099 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52380.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52380.log.gzgzip 2023-08-25T05:38:57.099 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.65514.log 2023-08-25T05:38:57.100 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55000.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55000.log.gz 2023-08-25T05:38:57.101 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66841.log 2023-08-25T05:38:57.102 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50900.log 2023-08-25T05:38:57.102 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65514.log.gz 2023-08-25T05:38:57.103 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66841.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66841.log.gz 2023-08-25T05:38:57.103 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65990.log 2023-08-25T05:38:57.104 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64522.log 2023-08-25T05:38:57.104 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50900.log.gz 2023-08-25T05:38:57.105 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65990.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65990.log.gz 2023-08-25T05:38:57.105 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45004.log 2023-08-25T05:38:57.106 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57007.log 2023-08-25T05:38:57.107 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64522.log.gz 2023-08-25T05:38:57.108 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45004.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45004.log.gz 2023-08-25T05:38:57.108 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47371.log 2023-08-25T05:38:57.109 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66575.log 2023-08-25T05:38:57.109 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57007.log.gz 2023-08-25T05:38:57.110 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47371.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47371.log.gz 2023-08-25T05:38:57.110 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58468.log 2023-08-25T05:38:57.111 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47665.log 2023-08-25T05:38:57.111 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66575.log.gz 2023-08-25T05:38:57.112 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58468.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58468.log.gz 2023-08-25T05:38:57.113 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62454.log 2023-08-25T05:38:57.113 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47665.log: gzip -5 89.5% --verbose -- replaced with /var/log/ceph/ceph-client.admin.47665.log.gz -- 2023-08-25T05:38:57.114 INFO:teuthology.orchestra.run.smithi055.stderr: /var/log/ceph/ceph-client.admin.62063.log 2023-08-25T05:38:57.115 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62454.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62454.log.gz 2023-08-25T05:38:57.115 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63654.log 2023-08-25T05:38:57.116 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45292.log 2023-08-25T05:38:57.116 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62063.log.gz 2023-08-25T05:38:57.117 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63654.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.63654.log.gz 2023-08-25T05:38:57.117 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60281.log 2023-08-25T05:38:57.118 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68685.log 2023-08-25T05:38:57.118 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45292.log.gz 2023-08-25T05:38:57.119 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37790.log 2023-08-25T05:38:57.120 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60281.log.gz 2023-08-25T05:38:57.121 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63803.log 2023-08-25T05:38:57.121 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68685.log.gz 2023-08-25T05:38:57.122 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.37790.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37790.log.gz 2023-08-25T05:38:57.122 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64356.log 2023-08-25T05:38:57.123 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44567.log 2023-08-25T05:38:57.123 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63803.log.gz 2023-08-25T05:38:57.124 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64356.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64356.log.gz 2023-08-25T05:38:57.124 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56700.log 2023-08-25T05:38:57.125 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44567.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44567.log.gz 2023-08-25T05:38:57.125 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45690.log 2023-08-25T05:38:57.126 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43265.log 2023-08-25T05:38:57.127 INFO:teuthology.orchestra.run.smithi055.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.56700.log.gz 2023-08-25T05:38:57.128 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45370.log 2023-08-25T05:38:57.128 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45690.log.gz 2023-08-25T05:38:57.129 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43265.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43265.log.gz 2023-08-25T05:38:57.129 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48187.log 2023-08-25T05:38:57.130 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47501.log 2023-08-25T05:38:57.130 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45370.log.gz 2023-08-25T05:38:57.131 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48187.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48187.log.gz 2023-08-25T05:38:57.131 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55519.log 2023-08-25T05:38:57.132 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47501.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47501.log.gz 2023-08-25T05:38:57.133 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62860.log 2023-08-25T05:38:57.133 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55519.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55519.log.gz 2023-08-25T05:38:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67661.log 2023-08-25T05:38:57.135 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64548.log 2023-08-25T05:38:57.135 INFO:teuthology.orchestra.run.smithi055.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.62860.log.gz 2023-08-25T05:38:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67661.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67661.log.gz 2023-08-25T05:38:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70331.log 2023-08-25T05:38:57.137 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68945.log 2023-08-25T05:38:57.138 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64548.log.gz 2023-08-25T05:38:57.138 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70331.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.70331.log.gz 2023-08-25T05:38:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55800.log 2023-08-25T05:38:57.139 INFO:teuthology.orchestra.run.smithi055.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-08-25T05:38:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46913.log 2023-08-25T05:38:57.140 INFO:teuthology.orchestra.run.smithi055.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.68945.log.gz 2023-08-25T05:38:57.141 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55800.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55800.log.gz 2023-08-25T05:38:57.141 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59141.log 2023-08-25T05:38:57.142 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47807.log 2023-08-25T05:38:57.143 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46913.log.gz 2023-08-25T05:38:57.143 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59141.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59141.log.gz 2023-08-25T05:38:57.144 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49937.log 2023-08-25T05:38:57.145 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48514.log 2023-08-25T05:38:57.145 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47807.log.gz 2023-08-25T05:38:57.146 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49937.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49937.log.gz 2023-08-25T05:38:57.146 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66815.log 2023-08-25T05:38:57.147 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51715.log 2023-08-25T05:38:57.147 INFO:teuthology.orchestra.run.smithi055.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48514.log.gz 2023-08-25T05:38:57.148 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63550.log 2023-08-25T05:38:57.148 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66815.log.gz 2023-08-25T05:38:57.149 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51715.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51715.log.gz 2023-08-25T05:38:57.149 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62428.log 2023-08-25T05:38:57.150 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67569.log 88.6% 2023-08-25T05:38:57.150 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63550.log.gz 2023-08-25T05:38:57.151 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62428.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.62428.log.gz -5 2023-08-25T05:38:57.151 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.68995.log 2023-08-25T05:38:57.152 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63985.log 2023-08-25T05:38:57.152 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67569.log.gz 2023-08-25T05:38:57.153 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68995.log: gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68995.log.gz -5 2023-08-25T05:38:57.153 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62402.log 2023-08-25T05:38:57.154 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43963.log 2023-08-25T05:38:57.154 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63985.log.gz 2023-08-25T05:38:57.155 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62402.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62402.log.gz 2023-08-25T05:38:57.155 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62678.log 2023-08-25T05:38:57.156 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43963.log: gzip -5 --verbose -- 89.3% /var/log/ceph/ceph-client.admin.38034.log 2023-08-25T05:38:57.156 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43963.log.gz 2023-08-25T05:38:57.157 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62678.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62678.log.gz 2023-08-25T05:38:57.157 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50217.log 2023-08-25T05:38:57.158 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.38034.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38034.log.gz 2023-08-25T05:38:57.158 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64390.log 2023-08-25T05:38:57.158 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50217.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50217.log.gz 2023-08-25T05:38:57.159 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59493.log 2023-08-25T05:38:57.160 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45474.log 2023-08-25T05:38:57.160 INFO:teuthology.orchestra.run.smithi055.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64390.log.gz 2023-08-25T05:38:57.161 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59493.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59493.log.gz 2023-08-25T05:38:57.161 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50243.log 2023-08-25T05:38:57.161 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60255.log 88.6% 2023-08-25T05:38:57.162 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45474.log.gz 2023-08-25T05:38:57.162 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50243.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50243.log.gz 2023-08-25T05:38:57.163 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49755.log 2023-08-25T05:38:57.163 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64574.log 2023-08-25T05:38:57.164 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60255.log.gz 2023-08-25T05:38:57.164 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49755.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49755.log.gz 2023-08-25T05:38:57.165 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64470.log 2023-08-25T05:38:57.166 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54169.log 2023-08-25T05:38:57.166 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64574.log.gz 2023-08-25T05:38:57.167 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64470.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64470.log.gz 2023-08-25T05:38:57.167 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45903.log 2023-08-25T05:38:57.168 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54169.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54169.log.gz 2023-08-25T05:38:57.168 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45396.log 2023-08-25T05:38:57.169 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64920.log 2023-08-25T05:38:57.169 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45903.log.gz 2023-08-25T05:38:57.170 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45396.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45396.log.gz 2023-08-25T05:38:57.170 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68018.log 2023-08-25T05:38:57.171 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64920.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64920.log.gz 2023-08-25T05:38:57.171 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56191.log 2023-08-25T05:38:57.172 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68018.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.68018.log.gz 2023-08-25T05:38:57.172 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57725.log 2023-08-25T05:38:57.173 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56191.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56191.log.gz 2023-08-25T05:38:57.173 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44229.log 2023-08-25T05:38:57.174 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57725.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57725.log.gz 2023-08-25T05:38:57.174 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55649.log 2023-08-25T05:38:57.175 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52995.log 2023-08-25T05:38:57.175 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44229.log.gz 2023-08-25T05:38:57.176 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55649.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55649.log.gz 2023-08-25T05:38:57.176 INFO:teuthology.orchestra.run.smithi110.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-08-25T05:38:57.177 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53707.log 2023-08-25T05:38:57.177 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52995.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.52995.log.gz 2023-08-25T05:38:57.177 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59389.log 2023-08-25T05:38:57.178 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53707.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53707.log.gz 2023-08-25T05:38:57.178 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48926.log 2023-08-25T05:38:57.179 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54013.log 2023-08-25T05:38:57.179 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59389.log.gz 2023-08-25T05:38:57.180 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48926.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48926.log.gz 2023-08-25T05:38:57.180 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66989.log 2023-08-25T05:38:57.181 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45742.log 2023-08-25T05:38:57.181 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54013.log.gz 2023-08-25T05:38:57.182 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.66989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66989.log.gz 2023-08-25T05:38:57.182 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50822.log 2023-08-25T05:38:57.183 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45742.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45742.log.gz -5 2023-08-25T05:38:57.183 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.66407.log 2023-08-25T05:38:57.184 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50822.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50822.log.gz 2023-08-25T05:38:57.185 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56465.log 2023-08-25T05:38:57.185 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54912.log 2023-08-25T05:38:57.186 INFO:teuthology.orchestra.run.smithi055.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.66407.log.gz 2023-08-25T05:38:57.186 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56465.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56465.log.gz 2023-08-25T05:38:57.186 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47267.log 2023-08-25T05:38:57.187 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54912.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54912.log.gz 2023-08-25T05:38:57.188 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67381.log 2023-08-25T05:38:57.189 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47267.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47267.log.gz 2023-08-25T05:38:57.189 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68893.log 2023-08-25T05:38:57.190 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48488.log 2023-08-25T05:38:57.190 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67381.log.gz 2023-08-25T05:38:57.190 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68893.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.68893.log.gz 2023-08-25T05:38:57.191 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52016.log 2023-08-25T05:38:57.192 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53838.log 2023-08-25T05:38:57.192 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48488.log.gz 2023-08-25T05:38:57.193 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52016.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52016.log.gz 2023-08-25T05:38:57.193 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66681.log 2023-08-25T05:38:57.194 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45716.log 2023-08-25T05:38:57.194 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53838.log.gz 2023-08-25T05:38:57.195 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66681.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66681.log.gz 2023-08-25T05:38:57.196 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69438.log 2023-08-25T05:38:57.196 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45716.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45716.log.gz 2023-08-25T05:38:57.197 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43177.log 2023-08-25T05:38:57.197 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69438.log: gzip -5 87.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.69438.log.gz /var/log/ceph/ceph-client.admin.47293.log 2023-08-25T05:38:57.197 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:57.198 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43177.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43177.log.gz 2023-08-25T05:38:57.198 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69360.log 2023-08-25T05:38:57.199 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52439.log 2023-08-25T05:38:57.199 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47293.log.gz 2023-08-25T05:38:57.200 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69360.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.69360.log.gz 2023-08-25T05:38:57.200 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50692.log 2023-08-25T05:38:57.201 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52439.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.50035.log 2023-08-25T05:38:57.201 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52439.log.gz 2023-08-25T05:38:57.202 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50692.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50692.log.gz 2023-08-25T05:38:57.202 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53864.log 2023-08-25T05:38:57.203 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50035.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50035.log.gz 2023-08-25T05:38:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47319.log 2023-08-25T05:38:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53864.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53864.log.gz 2023-08-25T05:38:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-08-25T05:38:57.206 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62624.log 2023-08-25T05:38:57.206 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47319.log.gz 2023-08-25T05:38:57.206 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56974.log 2023-08-25T05:38:57.208 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62624.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62624.log.gz 2023-08-25T05:38:57.208 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48758.log 2023-08-25T05:38:57.209 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52837.log 2023-08-25T05:38:57.209 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56974.log.gz 2023-08-25T05:38:57.210 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48758.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48758.log.gz 2023-08-25T05:38:57.210 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57576.log 2023-08-25T05:38:57.211 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49885.log 2023-08-25T05:38:57.211 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52837.log.gz 2023-08-25T05:38:57.212 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57576.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57576.log.gz 2023-08-25T05:38:57.212 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60620.log 2023-08-25T05:38:57.213 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49885.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.49885.log.gz 2023-08-25T05:38:57.214 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46036.log 2023-08-25T05:38:57.215 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60620.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60620.log.gz 2023-08-25T05:38:57.215 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53459.log 2023-08-25T05:38:57.216 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46036.log: gzip -5 --verbose 89.5% -- -- replaced with /var/log/ceph/ceph-client.admin.46036.log.gz /var/log/ceph/ceph-client.admin.52783.log 2023-08-25T05:38:57.216 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:57.217 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53459.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53459.log.gz 2023-08-25T05:38:57.217 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45448.log 2023-08-25T05:38:57.218 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65126.log 2023-08-25T05:38:57.218 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52783.log.gz 2023-08-25T05:38:57.219 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45448.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45448.log.gz 2023-08-25T05:38:57.219 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55076.log 2023-08-25T05:38:57.221 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65126.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.65126.log.gz 2023-08-25T05:38:57.221 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57119.log 2023-08-25T05:38:57.222 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55076.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55076.log.gz 2023-08-25T05:38:57.222 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49702.log 2023-08-25T05:38:57.223 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55982.log 2023-08-25T05:38:57.223 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57119.log.gz 2023-08-25T05:38:57.224 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49702.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49702.log.gz 2023-08-25T05:38:57.224 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66893.log 2023-08-25T05:38:57.225 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43555.log 2023-08-25T05:38:57.226 INFO:teuthology.orchestra.run.smithi055.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.55982.log.gz 2023-08-25T05:38:57.226 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55852.log 2023-08-25T05:38:57.227 INFO:teuthology.orchestra.run.smithi055.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.66893.log.gz 2023-08-25T05:38:57.228 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43555.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.43555.log.gz --verbose 2023-08-25T05:38:57.228 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph-client.admin.55878.log 2023-08-25T05:38:57.229 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55852.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55852.log.gz 2023-08-25T05:38:57.229 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45500.log 2023-08-25T05:38:57.230 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70435.log 2023-08-25T05:38:57.230 INFO:teuthology.orchestra.run.smithi055.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55878.log.gz 2023-08-25T05:38:57.231 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47423.log 2023-08-25T05:38:57.232 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45500.log.gz 2023-08-25T05:38:57.232 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70435.log: gzip 89.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.70435.log.gz --verbose 2023-08-25T05:38:57.233 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph-client.admin.64626.log 2023-08-25T05:38:57.234 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47423.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47423.log.gz 2023-08-25T05:38:57.234 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61732.log 2023-08-25T05:38:57.235 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64626.log: gzip 87.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.64626.log.gz --verbose 2023-08-25T05:38:57.236 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph-client.admin.54221.log 2023-08-25T05:38:57.236 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61732.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61732.log.gz 2023-08-25T05:38:57.236 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52943.log 2023-08-25T05:38:57.237 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63680.log 2023-08-25T05:38:57.238 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54221.log.gz 2023-08-25T05:38:57.238 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52943.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52943.log.gz 2023-08-25T05:38:57.239 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54758.log 2023-08-25T05:38:57.240 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63680.log: gzip -5 --verbose 89.2% -- -- replaced with /var/log/ceph/ceph-client.admin.63680.log.gz /var/log/ceph/ceph-client.admin.43239.log 2023-08-25T05:38:57.240 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:57.240 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54758.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54758.log.gz 2023-08-25T05:38:57.241 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47241.log 2023-08-25T05:38:57.242 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43239.log: gzip -5 --verbose 89.6% -- -- replaced with /var/log/ceph/ceph-client.admin.43239.log.gz /var/log/ceph/ceph-client.admin.46301.log 2023-08-25T05:38:57.242 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:57.243 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47241.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47241.log.gz 2023-08-25T05:38:57.243 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62596.log 2023-08-25T05:38:57.244 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46301.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.46301.log.gz 2023-08-25T05:38:57.244 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.65326.log 2023-08-25T05:38:57.245 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62596.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62596.log.gz 2023-08-25T05:38:57.246 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49032.log 2023-08-25T05:38:57.247 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58224.log 2023-08-25T05:38:57.247 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65326.log.gz 2023-08-25T05:38:57.247 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49032.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49032.log.gz 2023-08-25T05:38:57.248 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45578.log 2023-08-25T05:38:57.249 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58224.log: gzip 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58224.log.gz -5 2023-08-25T05:38:57.249 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-mon.a.log 2023-08-25T05:38:57.250 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45578.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45578.log.gz 2023-08-25T05:38:57.250 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54862.log 2023-08-25T05:38:57.251 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45266.log 2023-08-25T05:38:57.253 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68605.log 2023-08-25T05:38:57.253 INFO:teuthology.orchestra.run.smithi055.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54862.log.gz 2023-08-25T05:38:57.254 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45266.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45266.log.gz 2023-08-25T05:38:57.255 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43071.log 2023-08-25T05:38:57.256 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43501.log 2023-08-25T05:38:57.256 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68605.log.gz 2023-08-25T05:38:57.257 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43071.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43071.log.gz 2023-08-25T05:38:57.258 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60111.log 2023-08-25T05:38:57.259 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43501.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43501.log.gz 2023-08-25T05:38:57.259 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46991.log 2023-08-25T05:38:57.260 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62834.log 2023-08-25T05:38:57.261 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60111.log.gz 2023-08-25T05:38:57.261 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46991.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46991.log.gz 2023-08-25T05:38:57.262 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70409.log 2023-08-25T05:38:57.263 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46249.log 2023-08-25T05:38:57.263 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62834.log.gz 2023-08-25T05:38:57.264 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70409.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70409.log.gz 2023-08-25T05:38:57.264 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66120.log 2023-08-25T05:38:57.265 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65685.log 2023-08-25T05:38:57.266 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46249.log.gz 2023-08-25T05:38:57.266 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66120.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.66120.log.gz 2023-08-25T05:38:57.267 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53175.log 2023-08-25T05:38:57.268 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60359.log 2023-08-25T05:38:57.268 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65685.log.gz 2023-08-25T05:38:57.269 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53175.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53175.log.gz 2023-08-25T05:38:57.269 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63777.log 2023-08-25T05:38:57.270 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46010.log 2023-08-25T05:38:57.271 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60359.log.gz 2023-08-25T05:38:57.272 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63777.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63777.log.gz 2023-08-25T05:38:57.272 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67966.log 2023-08-25T05:38:57.273 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51281.log 2023-08-25T05:38:57.274 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46010.log.gz 2023-08-25T05:38:57.274 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67966.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67966.log.gz 2023-08-25T05:38:57.275 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46658.log 2023-08-25T05:38:57.276 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47187.log 2023-08-25T05:38:57.276 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51281.log.gz 2023-08-25T05:38:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46658.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46658.log.gz 2023-08-25T05:38:57.277 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68919.log 2023-08-25T05:38:57.278 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56217.log 2023-08-25T05:38:57.279 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47187.log.gz 2023-08-25T05:38:57.279 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68919.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68919.log.gz 2023-08-25T05:38:57.280 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50640.log 2023-08-25T05:38:57.281 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56864.log 2023-08-25T05:38:57.281 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56217.log.gz 2023-08-25T05:38:57.282 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50640.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50640.log.gz 2023-08-25T05:38:57.282 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51912.log 2023-08-25T05:38:57.284 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46535.log 2023-08-25T05:38:57.284 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56864.log.gz 2023-08-25T05:38:57.285 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51912.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51912.log.gz 2023-08-25T05:38:57.285 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50796.log 2023-08-25T05:38:57.286 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46535.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46535.log.gz 2023-08-25T05:38:57.287 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69187.log 2023-08-25T05:38:57.288 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70149.log 2023-08-25T05:38:57.288 INFO:teuthology.orchestra.run.smithi055.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50796.log.gz 2023-08-25T05:38:57.289 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69187.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69187.log.gz 2023-08-25T05:38:57.290 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57061.log 2023-08-25T05:38:57.291 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70149.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70149.log.gz 2023-08-25T05:38:57.291 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69766.log 2023-08-25T05:38:57.292 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57061.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57061.log.gz 2023-08-25T05:38:57.293 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68763.log 2023-08-25T05:38:57.294 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51886.log 2023-08-25T05:38:57.295 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69766.log.gz 2023-08-25T05:38:57.295 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68763.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68763.log.gz 2023-08-25T05:38:57.296 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47099.log 2023-08-25T05:38:57.297 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51886.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51886.log.gz 2023-08-25T05:38:57.297 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64496.log 2023-08-25T05:38:57.299 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47099.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47099.log.gz 2023-08-25T05:38:57.299 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65659.log 2023-08-25T05:38:57.300 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64496.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64496.log.gz 2023-08-25T05:38:57.301 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54974.log 2023-08-25T05:38:57.302 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65659.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.65659.log.gz 2023-08-25T05:38:57.302 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54652.log 2023-08-25T05:38:57.303 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54974.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54974.log.gz 2023-08-25T05:38:57.304 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54836.log 2023-08-25T05:38:57.305 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54652.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54652.log.gz 2023-08-25T05:38:57.306 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63576.log 2023-08-25T05:38:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56543.log 2023-08-25T05:38:57.307 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54836.log.gz 2023-08-25T05:38:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63576.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63576.log.gz 2023-08-25T05:38:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46835.log 2023-08-25T05:38:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62089.log 2023-08-25T05:38:57.310 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56543.log.gz 2023-08-25T05:38:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46835.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46835.log.gz 2023-08-25T05:38:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43957.log 2023-08-25T05:38:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62089.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62089.log.gz 2023-08-25T05:38:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64169.log 2023-08-25T05:38:57.314 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43957.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43957.log.gz 2023-08-25T05:38:57.315 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55904.log 2023-08-25T05:38:57.316 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64169.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64169.log.gz 2023-08-25T05:38:57.316 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45056.log 2023-08-25T05:38:57.317 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55904.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55904.log.gz 2023-08-25T05:38:57.318 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70279.log 2023-08-25T05:38:57.319 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56838.log 2023-08-25T05:38:57.320 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45056.log.gz 2023-08-25T05:38:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70279.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.70279.log.gz 2023-08-25T05:38:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48161.log 2023-08-25T05:38:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56838.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56838.log.gz 2023-08-25T05:38:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61706.log 2023-08-25T05:38:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48161.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48161.log.gz 2023-08-25T05:38:57.324 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68044.log 2023-08-25T05:38:57.325 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61706.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.61706.log.gz 2023-08-25T05:38:57.326 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67517.log 2023-08-25T05:38:57.327 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52471.log 2023-08-25T05:38:57.327 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68044.log.gz 2023-08-25T05:38:57.328 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67517.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67517.log.gz 2023-08-25T05:38:57.329 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69273.log 2023-08-25T05:38:57.330 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52471.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52471.log.gz 2023-08-25T05:38:57.330 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54247.log 2023-08-25T05:38:57.331 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69273.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69273.log.gz 2023-08-25T05:38:57.332 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57342.log 2023-08-25T05:38:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54247.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54247.log.gz 2023-08-25T05:38:57.334 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66787.log 2023-08-25T05:38:57.335 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57342.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57342.log.gz 2023-08-25T05:38:57.335 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70357.log 2023-08-25T05:38:57.336 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66787.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66787.log.gz 2023-08-25T05:38:57.337 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53485.log 2023-08-25T05:38:57.338 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70357.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70357.log.gz 2023-08-25T05:38:57.339 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49833.log 2023-08-25T05:38:57.340 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53485.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53485.log.gz 2023-08-25T05:38:57.340 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45877.log 2023-08-25T05:38:57.341 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49833.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49833.log.gz 2023-08-25T05:38:57.342 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70020.log 2023-08-25T05:38:57.343 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45877.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45877.log.gz 2023-08-25T05:38:57.343 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70175.log 2023-08-25T05:38:57.345 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70020.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.70020.log.gz 2023-08-25T05:38:57.345 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44926.log 2023-08-25T05:38:57.346 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70175.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70175.log.gz 2023-08-25T05:38:57.347 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47975.log 2023-08-25T05:38:57.348 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44926.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44926.log.gz 2023-08-25T05:38:57.349 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45825.log 2023-08-25T05:38:57.349 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47975.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47975.log.gz 2023-08-25T05:38:57.350 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46062.log 2023-08-25T05:38:57.351 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64221.log 2023-08-25T05:38:57.352 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45825.log.gz 2023-08-25T05:38:57.352 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46062.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46062.log.gz 2023-08-25T05:38:57.353 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64011.log 2023-08-25T05:38:57.354 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64221.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64221.log.gz 2023-08-25T05:38:57.354 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63855.log 2023-08-25T05:38:57.356 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64011.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64011.log.gz 2023-08-25T05:38:57.356 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61758.log 2023-08-25T05:38:57.357 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63855.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63855.log.gz 2023-08-25T05:38:57.358 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44203.log 2023-08-25T05:38:57.359 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61758.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61758.log.gz 2023-08-25T05:38:57.359 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51143.log 2023-08-25T05:38:57.360 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44203.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44203.log.gz 2023-08-25T05:38:57.361 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57940.log 2023-08-25T05:38:57.362 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51143.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51143.log.gz 2023-08-25T05:38:57.363 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43291.log 2023-08-25T05:38:57.364 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57940.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57940.log.gz 2023-08-25T05:38:57.364 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49136.log 2023-08-25T05:38:57.365 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43291.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43291.log.gz 2023-08-25T05:38:57.366 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47623.log 2023-08-25T05:38:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49136.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49136.log.gz 2023-08-25T05:38:57.367 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59089.log 2023-08-25T05:38:57.368 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.47623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47623.log.gz 2023-08-25T05:38:57.369 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61888.log 2023-08-25T05:38:57.370 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59089.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59089.log.gz 2023-08-25T05:38:57.371 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49781.log 2023-08-25T05:38:57.372 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61888.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61888.log.gz 2023-08-25T05:38:57.372 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43149.log 2023-08-25T05:38:57.373 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51741.log 2023-08-25T05:38:57.374 INFO:teuthology.orchestra.run.smithi055.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49781.log.gz 2023-08-25T05:38:57.374 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43149.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43149.log.gz 2023-08-25T05:38:57.375 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55956.log 2023-08-25T05:38:57.376 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51741.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51741.log.gz 2023-08-25T05:38:57.377 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48213.log 2023-08-25T05:38:57.378 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55956.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55956.log.gz 2023-08-25T05:38:57.378 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66603.log 2023-08-25T05:38:57.379 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48213.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48213.log.gz 2023-08-25T05:38:57.380 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70097.log 2023-08-25T05:38:57.381 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66603.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66603.log.gz 2023-08-25T05:38:57.381 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57907.log 2023-08-25T05:38:57.383 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70097.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70097.log.gz 2023-08-25T05:38:57.383 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46509.log 2023-08-25T05:38:57.384 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57907.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57907.log.gz 2023-08-25T05:38:57.385 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62562.log 2023-08-25T05:38:57.386 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46509.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46509.log.gz 2023-08-25T05:38:57.386 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52224.log 2023-08-25T05:38:57.388 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62562.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62562.log.gz 2023-08-25T05:38:57.388 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54432.log 2023-08-25T05:38:57.389 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52224.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52224.log.gz 2023-08-25T05:38:57.390 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55026.log 2023-08-25T05:38:57.391 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54432.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54432.log.gz 2023-08-25T05:38:57.391 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63164.log 2023-08-25T05:38:57.393 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55026.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55026.log.gz 2023-08-25T05:38:57.396 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60437.log 2023-08-25T05:38:57.397 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63164.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63164.log.gz 2023-08-25T05:38:57.397 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58676.log 2023-08-25T05:38:57.397 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60437.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60437.log.gz 2023-08-25T05:38:57.397 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60518.log 2023-08-25T05:38:57.398 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58676.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58676.log.gz 2023-08-25T05:38:57.398 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50926.log 2023-08-25T05:38:57.400 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58063.log 2023-08-25T05:38:57.400 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60518.log.gz 2023-08-25T05:38:57.401 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50926.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50926.log.gz 2023-08-25T05:38:57.402 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44515.log 2023-08-25T05:38:57.403 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58063.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58063.log.gz 2023-08-25T05:38:57.403 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50269.log 2023-08-25T05:38:57.404 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60307.log 2023-08-25T05:38:57.405 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44515.log.gz 2023-08-25T05:38:57.406 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50269.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50269.log.gz 2023-08-25T05:38:57.406 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53596.log 2023-08-25T05:38:57.408 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60307.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60307.log.gz 2023-08-25T05:38:57.408 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69818.log 2023-08-25T05:38:57.409 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53596.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53596.log.gz 2023-08-25T05:38:57.409 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62782.log 2023-08-25T05:38:57.411 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69818.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69818.log.gz 2023-08-25T05:38:57.411 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49448.log 2023-08-25T05:38:57.412 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62782.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62782.log.gz 2023-08-25T05:38:57.413 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65580.log 2023-08-25T05:38:57.414 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49448.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49448.log.gz 2023-08-25T05:38:57.414 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47475.log 2023-08-25T05:38:57.416 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65580.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65580.log.gz 2023-08-25T05:38:57.416 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48083.log 2023-08-25T05:38:57.417 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47475.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47475.log.gz 2023-08-25T05:38:57.418 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54065.log 2023-08-25T05:38:57.419 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48083.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48083.log.gz 2023-08-25T05:38:57.420 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64970.log 2023-08-25T05:38:57.421 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54065.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54065.log.gz 2023-08-25T05:38:57.421 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63472.log 2023-08-25T05:38:57.422 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64970.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64970.log.gz 2023-08-25T05:38:57.423 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57647.log 2023-08-25T05:38:57.424 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63472.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63472.log.gz 2023-08-25T05:38:57.424 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46861.log 2023-08-25T05:38:57.425 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57647.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57647.log.gz 2023-08-25T05:38:57.426 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43319.log 2023-08-25T05:38:57.427 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46861.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46861.log.gz 2023-08-25T05:38:57.428 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62167.log 2023-08-25T05:38:57.429 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43319.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43319.log.gz 2023-08-25T05:38:57.429 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50532.log 2023-08-25T05:38:57.430 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62167.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62167.log.gz 2023-08-25T05:38:57.431 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66146.log 2023-08-25T05:38:57.432 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50532.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50532.log.gz 2023-08-25T05:38:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64102.log 2023-08-25T05:38:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66146.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66146.log.gz 2023-08-25T05:38:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63524.log 2023-08-25T05:38:57.436 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64102.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.32937.log 2023-08-25T05:38:57.436 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64102.log.gz 2023-08-25T05:38:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63524.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63524.log.gz 2023-08-25T05:38:57.437 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52667.log 2023-08-25T05:38:57.438 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph.tmp-client.admin.32937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69844.log 2023-08-25T05:38:57.439 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.32937.log.gz 2023-08-25T05:38:57.440 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52667.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52667.log.gz 2023-08-25T05:38:57.440 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52537.log 2023-08-25T05:38:57.441 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69844.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69844.log.gz 2023-08-25T05:38:57.442 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64868.log 2023-08-25T05:38:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52537.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52537.log.gz 2023-08-25T05:38:57.443 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51807.log 2023-08-25T05:38:57.444 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64868.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64868.log.gz 2023-08-25T05:38:57.445 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45604.log 2023-08-25T05:38:57.446 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51807.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51807.log.gz 2023-08-25T05:38:57.447 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64806.log 2023-08-25T05:38:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45604.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45604.log.gz 2023-08-25T05:38:57.448 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69889.log 2023-08-25T05:38:57.449 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64416.log 2023-08-25T05:38:57.449 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64806.log.gz 2023-08-25T05:38:57.450 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69889.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69889.log.gz 2023-08-25T05:38:57.451 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45768.log 2023-08-25T05:38:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64416.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64416.log.gz 2023-08-25T05:38:57.452 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56137.log 2023-08-25T05:38:57.453 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45768.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45768.log.gz 2023-08-25T05:38:57.454 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-08-25T05:38:57.455 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70461.log 2023-08-25T05:38:57.456 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56137.log.gz 2023-08-25T05:38:57.457 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52354.log 2023-08-25T05:38:57.458 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59772.log 2023-08-25T05:38:57.458 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.70461.log.gz 2023-08-25T05:38:57.460 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52354.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52354.log.gz 2023-08-25T05:38:57.460 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56359.log 2023-08-25T05:38:57.461 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59772.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59772.log.gzgzip 2023-08-25T05:38:57.461 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53942.log 2023-08-25T05:38:57.463 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56359.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56359.log.gz 2023-08-25T05:38:57.463 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65462.log 2023-08-25T05:38:57.464 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69610.log 2023-08-25T05:38:57.464 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53942.log.gz 2023-08-25T05:38:57.465 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65462.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65462.log.gz 2023-08-25T05:38:57.466 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67713.log 2023-08-25T05:38:57.467 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69610.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69610.log.gz 2023-08-25T05:38:57.468 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60201.log 2023-08-25T05:38:57.469 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67713.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67713.log.gz 2023-08-25T05:38:57.469 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52172.log 2023-08-25T05:38:57.470 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60201.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60201.log.gz 2023-08-25T05:38:57.471 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69221.log 2023-08-25T05:38:57.472 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52172.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52172.log.gz 2023-08-25T05:38:57.472 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49344.log 2023-08-25T05:38:57.474 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50978.log 2023-08-25T05:38:57.474 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69221.log.gz 2023-08-25T05:38:57.475 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49344.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49344.log.gz 2023-08-25T05:38:57.475 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67058.log 2023-08-25T05:38:57.477 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50978.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50978.log.gz -5 2023-08-25T05:38:57.477 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47527.log 2023-08-25T05:38:57.478 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67058.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67058.log.gz 2023-08-25T05:38:57.478 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66094.log 2023-08-25T05:38:57.480 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48462.log 2023-08-25T05:38:57.480 INFO:teuthology.orchestra.run.smithi055.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.47527.log.gz 2023-08-25T05:38:57.481 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66094.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66094.log.gz 2023-08-25T05:38:57.482 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55746.log 2023-08-25T05:38:57.483 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66205.log 2023-08-25T05:38:57.483 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48462.log.gz 2023-08-25T05:38:57.484 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55746.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55746.log.gz 2023-08-25T05:38:57.485 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52809.log 2023-08-25T05:38:57.486 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66205.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.66205.log.gz 2023-08-25T05:38:57.486 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54091.log 2023-08-25T05:38:57.488 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52809.log: gzip -5 --verbose 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52809.log.gz 2023-08-25T05:38:57.488 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph-client.admin.62506.log 2023-08-25T05:38:57.489 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54091.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54091.log.gz 2023-08-25T05:38:57.490 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52198.log 2023-08-25T05:38:57.491 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62506.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62506.log.gz 2023-08-25T05:38:57.492 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44255.log 2023-08-25T05:38:57.493 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52198.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52198.log.gz 2023-08-25T05:38:57.493 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68122.log 2023-08-25T05:38:57.495 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44255.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44255.log.gz 2023-08-25T05:38:57.495 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51580.log 2023-08-25T05:38:57.497 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68122.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68122.log.gz 2023-08-25T05:38:57.497 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55102.log 2023-08-25T05:38:57.498 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51580.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51580.log.gz 2023-08-25T05:38:57.499 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57498.log 2023-08-25T05:38:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55102.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55102.log.gz 2023-08-25T05:38:57.501 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46223.log 2023-08-25T05:38:57.502 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57498.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57498.log.gz 2023-08-25T05:38:57.503 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67196.log 2023-08-25T05:38:57.504 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46223.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46223.log.gz 2023-08-25T05:38:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45240.log 2023-08-25T05:38:57.506 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67196.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67196.log.gz 2023-08-25T05:38:57.506 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43550.log 2023-08-25T05:38:57.507 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45240.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45240.log.gz 2023-08-25T05:38:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50848.log 2023-08-25T05:38:57.509 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43550.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43550.log.gz 2023-08-25T05:38:57.510 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63379.log 2023-08-25T05:38:57.511 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50848.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50848.log.gz 2023-08-25T05:38:57.512 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61536.log 2023-08-25T05:38:57.513 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63379.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63379.log.gz 2023-08-25T05:38:57.514 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51004.log 2023-08-25T05:38:57.515 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61536.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61536.log.gz 2023-08-25T05:38:57.516 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48540.log 2023-08-25T05:38:57.517 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51004.log: gzip -5 --verbose 91.3% -- replaced with /var/log/ceph/ceph-client.admin.51004.log.gz 2023-08-25T05:38:57.518 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph-client.admin.69740.log 2023-08-25T05:38:57.518 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48540.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48540.log.gz 2023-08-25T05:38:57.519 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52302.log 2023-08-25T05:38:57.521 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69740.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.69740.log.gz 2023-08-25T05:38:57.522 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55192.log 2023-08-25T05:38:57.523 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52302.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69490.log 2023-08-25T05:38:57.523 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52302.log.gz 2023-08-25T05:38:57.524 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55192.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55192.log.gz 2023-08-25T05:38:57.524 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59720.log 2023-08-25T05:38:57.526 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69490.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69490.log.gz 2023-08-25T05:38:57.526 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42759.log 2023-08-25T05:38:57.527 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59720.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59720.log.gz 2023-08-25T05:38:57.528 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58973.log 2023-08-25T05:38:57.528 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42759.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42759.log.gz 2023-08-25T05:38:57.529 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68070.log 2023-08-25T05:38:57.531 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58973.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58973.log.gz 2023-08-25T05:38:57.531 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58390.log 2023-08-25T05:38:57.533 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68070.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68070.log.gz 2023-08-25T05:38:57.534 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53654.log 2023-08-25T05:38:57.534 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58390.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58390.log.gz 2023-08-25T05:38:57.535 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70201.log 2023-08-25T05:38:57.536 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53654.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53654.log.gz 2023-08-25T05:38:57.537 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67108.log 2023-08-25T05:38:57.538 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70201.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70201.log.gz 2023-08-25T05:38:57.539 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53916.log 2023-08-25T05:38:57.540 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67108.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67108.log.gz 2023-08-25T05:38:57.541 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51774.log 2023-08-25T05:38:57.542 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53916.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53916.log.gz 2023-08-25T05:38:57.542 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69714.log 2023-08-25T05:38:57.544 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51774.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51774.log.gz 2023-08-25T05:38:57.544 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43761.log 2023-08-25T05:38:57.545 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69714.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69714.log.gz 2023-08-25T05:38:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46783.log 2023-08-25T05:38:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43761.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43761.log.gz 2023-08-25T05:38:57.548 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61914.log 2023-08-25T05:38:57.549 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46783.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46783.log.gz 2023-08-25T05:38:57.550 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68410.log 2023-08-25T05:38:57.551 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61914.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61914.log.gz 2023-08-25T05:38:57.552 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68631.log 2023-08-25T05:38:57.553 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68410.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68410.log.gz 2023-08-25T05:38:57.554 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64852.log 2023-08-25T05:38:57.555 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68631.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68631.log.gz 2023-08-25T05:38:57.556 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46145.log 2023-08-25T05:38:57.556 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.64852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64852.log.gz 2023-08-25T05:38:57.557 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45526.log 2023-08-25T05:38:57.559 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46145.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46145.log.gz 2023-08-25T05:38:57.559 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70071.log 2023-08-25T05:38:57.560 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45526.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45526.log.gz 2023-08-25T05:38:57.561 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46114.log 2023-08-25T05:38:57.562 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70071.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70071.log.gz 2023-08-25T05:38:57.563 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57829.log 2023-08-25T05:38:57.564 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46114.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46114.log.gz 2023-08-25T05:38:57.565 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57171.log 2023-08-25T05:38:57.566 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57829.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57829.log.gz 2023-08-25T05:38:57.567 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44767.log 2023-08-25T05:38:57.568 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57171.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57171.log.gz 2023-08-25T05:38:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44151.log 2023-08-25T05:38:57.569 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.44767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44767.log.gz 2023-08-25T05:38:57.570 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45851.log 2023-08-25T05:38:57.571 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44151.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44151.log.gz 2023-08-25T05:38:57.572 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53759.log 2023-08-25T05:38:57.574 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45851.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45851.log.gz 2023-08-25T05:38:57.574 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59363.log 2023-08-25T05:38:57.575 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53759.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49990.log 2023-08-25T05:38:57.576 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53759.log.gz 2023-08-25T05:38:57.577 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59363.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59363.log.gz 2023-08-25T05:38:57.577 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55683.log 2023-08-25T05:38:57.578 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49990.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-08-25T05:38:57.578 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49990.log.gz 2023-08-25T05:38:57.580 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55683.log: gzip 89.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.55683.log.gz --verbose 2023-08-25T05:38:57.580 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph-client.admin.60005.log 2023-08-25T05:38:57.581 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59616.log 2023-08-25T05:38:57.583 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46457.log 2023-08-25T05:38:57.584 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60005.log.gz 2023-08-25T05:38:57.584 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59616.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59616.log.gz 2023-08-25T05:38:57.585 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65488.log 2023-08-25T05:38:57.586 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46457.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53511.log 2023-08-25T05:38:57.587 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46457.log.gz 2023-08-25T05:38:57.588 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61836.log 2023-08-25T05:38:57.588 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65488.log.gz 2023-08-25T05:38:57.589 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53511.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53511.log.gz 2023-08-25T05:38:57.590 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49676.log 2023-08-25T05:38:57.591 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61836.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70253.log 2023-08-25T05:38:57.592 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61836.log.gz 2023-08-25T05:38:57.595 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49676.log: gzip -5 --verbose 88.3% -- /var/log/ceph/ceph-client.admin.50139.log -- replaced with /var/log/ceph/ceph-client.admin.49676.log.gz 2023-08-25T05:38:57.595 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:57.595 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70253.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.70253.log.gz 2023-08-25T05:38:57.595 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44900.log 2023-08-25T05:38:57.596 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50139.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50139.log.gz 2023-08-25T05:38:57.596 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45984.log 2023-08-25T05:38:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44900.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44900.log.gz -5 2023-08-25T05:38:57.598 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48814.log 2023-08-25T05:38:57.599 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68711.log 2023-08-25T05:38:57.600 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45984.log.gz 2023-08-25T05:38:57.600 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48814.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48814.log.gz 2023-08-25T05:38:57.601 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68148.log 2023-08-25T05:38:57.602 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68711.log: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46939.log 2023-08-25T05:38:57.602 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68711.log.gz 2023-08-25T05:38:57.604 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57315.log 2023-08-25T05:38:57.604 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68148.log.gz 2023-08-25T05:38:57.605 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60463.log 2023-08-25T05:38:57.606 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46939.log.gz 2023-08-25T05:38:57.607 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57315.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57315.log.gz 2023-08-25T05:38:57.607 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58284.log 2023-08-25T05:38:57.608 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60463.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60463.log.gz 2023-08-25T05:38:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65633.log 2023-08-25T05:38:57.610 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58284.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55623.log 2023-08-25T05:38:57.611 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58284.log.gz 2023-08-25T05:38:57.612 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65633.log: gzip -5 87.1% -- replaced with /var/log/ceph/ceph-client.admin.65633.log.gz 2023-08-25T05:38:57.612 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.65964.log 2023-08-25T05:38:57.613 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55623.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55623.log.gz 2023-08-25T05:38:57.614 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58494.log 2023-08-25T05:38:57.616 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65964.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65964.log.gz 2023-08-25T05:38:57.616 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54406.log 2023-08-25T05:38:57.617 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58494.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58494.log.gz 2023-08-25T05:38:57.618 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67032.log 2023-08-25T05:38:57.619 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54406.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54406.log.gz 2023-08-25T05:38:57.619 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62193.log 2023-08-25T05:38:57.621 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67032.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60492.log 2023-08-25T05:38:57.621 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67032.log.gz 2023-08-25T05:38:57.622 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62193.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.62193.log.gz 2023-08-25T05:38:57.623 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49859.log 2023-08-25T05:38:57.624 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69994.log 2023-08-25T05:38:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49859.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60492.log.gz 2023-08-25T05:38:57.626 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66867.log 2023-08-25T05:38:57.626 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49859.log.gz 2023-08-25T05:38:57.627 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69994.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59285.log 2023-08-25T05:38:57.627 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69994.log.gz 2023-08-25T05:38:57.628 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66867.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66867.log.gz 2023-08-25T05:38:57.629 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52276.log 2023-08-25T05:38:57.630 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68737.log 2023-08-25T05:38:57.631 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59285.log.gz 2023-08-25T05:38:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54484.log 2023-08-25T05:38:57.632 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52276.log.gz 2023-08-25T05:38:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68737.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.68737.log.gz 2023-08-25T05:38:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67465.log 2023-08-25T05:38:57.635 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59415.log 2023-08-25T05:38:57.636 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67465.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54484.log.gz 2023-08-25T05:38:57.637 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59883.log 2023-08-25T05:38:57.637 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67465.log.gz 2023-08-25T05:38:57.638 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59415.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59415.log.gz 2023-08-25T05:38:57.638 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54117.log 2023-08-25T05:38:57.640 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46809.log 2023-08-25T05:38:57.641 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59883.log: /var/log/ceph/ceph-client.admin.54117.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59883.log.gz 2023-08-25T05:38:57.642 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66707.log 2023-08-25T05:38:57.642 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54117.log.gz 2023-08-25T05:38:57.643 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46809.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62011.log 2023-08-25T05:38:57.643 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46809.log.gz 2023-08-25T05:38:57.644 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66707.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66707.log.gz 2023-08-25T05:38:57.645 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60785.log 2023-08-25T05:38:57.647 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63959.log 2023-08-25T05:38:57.647 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62011.log.gz 2023-08-25T05:38:57.648 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60785.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69386.log 2023-08-25T05:38:57.648 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60785.log.gz 2023-08-25T05:38:57.649 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62650.log 2023-08-25T05:38:57.649 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.63959.log.gz 2023-08-25T05:38:57.651 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51833.log 2023-08-25T05:38:57.652 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62650.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.69386.log.gz 2023-08-25T05:38:57.653 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52695.log 2023-08-25T05:38:57.653 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62650.log.gz 2023-08-25T05:38:57.654 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51833.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47043.log 2023-08-25T05:38:57.654 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51833.log.gz 2023-08-25T05:38:57.656 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70539.log 2023-08-25T05:38:57.656 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52695.log.gz 2023-08-25T05:38:57.657 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47043.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47043.log.gz 2023-08-25T05:38:57.657 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59694.log 2023-08-25T05:38:57.659 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70539.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59642.log 2023-08-25T05:38:57.659 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70539.log.gz 2023-08-25T05:38:57.660 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55597.log 2023-08-25T05:38:57.661 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59694.log.gz 2023-08-25T05:38:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65912.log 2023-08-25T05:38:57.663 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55597.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59642.log.gz 2023-08-25T05:38:57.664 INFO:teuthology.orchestra.run.smithi055.stderr:gzip 87.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.55597.log.gz -- 2023-08-25T05:38:57.664 INFO:teuthology.orchestra.run.smithi055.stderr: /var/log/ceph/ceph-client.admin.48870.log 2023-08-25T05:38:57.665 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65912.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68437.log 2023-08-25T05:38:57.665 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65912.log.gz 2023-08-25T05:38:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48870.log: gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.48870.log.gz --verbose 2023-08-25T05:38:57.667 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph-client.admin.55135.log 2023-08-25T05:38:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68437.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42867.log 2023-08-25T05:38:57.668 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68437.log.gz 2023-08-25T05:38:57.670 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63881.log 2023-08-25T05:38:57.670 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55135.log.gz 2023-08-25T05:38:57.671 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42867.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42867.log.gz 2023-08-25T05:38:57.671 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64600.log 2023-08-25T05:38:57.673 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63881.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50451.log 2023-08-25T05:38:57.673 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63881.log.gz 2023-08-25T05:38:57.674 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64600.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48003.log 2023-08-25T05:38:57.675 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64600.log.gz 2023-08-25T05:38:57.676 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50451.log: gzip -5 --verbose 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50451.log.gz 2023-08-25T05:38:57.676 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph-client.admin.60735.log 2023-08-25T05:38:57.677 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48003.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48003.log.gz 2023-08-25T05:38:57.678 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61401.log 2023-08-25T05:38:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60735.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60735.log.gz 2023-08-25T05:38:57.680 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58168.log 2023-08-25T05:38:57.681 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61401.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61401.log.gz 2023-08-25T05:38:57.682 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56491.log 2023-08-25T05:38:57.683 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58168.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58168.log.gz 2023-08-25T05:38:57.684 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48566.log 2023-08-25T05:38:57.684 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56491.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56491.log.gz 2023-08-25T05:38:57.685 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63498.log 2023-08-25T05:38:57.686 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48566.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48566.log.gz 2023-08-25T05:38:57.687 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52969.log 2023-08-25T05:38:57.689 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63498.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63498.log.gz 2023-08-25T05:38:57.690 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67634.log 2023-08-25T05:38:57.691 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52969.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59467.log 2023-08-25T05:38:57.692 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52969.log.gz 2023-08-25T05:38:57.692 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67634.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67634.log.gz 2023-08-25T05:38:57.693 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44653.log 2023-08-25T05:38:57.695 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66302.log 2023-08-25T05:38:57.695 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44653.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59467.log.gz 2023-08-25T05:38:57.696 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64195.log 2023-08-25T05:38:57.696 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44653.log.gz 2023-08-25T05:38:57.697 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66302.log: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67992.log 2023-08-25T05:38:57.698 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66302.log.gz 2023-08-25T05:38:57.699 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66733.log 88.8% 2023-08-25T05:38:57.699 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64195.log.gz 2023-08-25T05:38:57.700 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67992.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67992.log.gz 2023-08-25T05:38:57.701 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63301.log 2023-08-25T05:38:57.702 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66733.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44385.log 2023-08-25T05:38:57.702 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66733.log.gz 2023-08-25T05:38:57.704 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63301.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63301.log.gz 2023-08-25T05:38:57.704 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56271.log 2023-08-25T05:38:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68545.log 2023-08-25T05:38:57.706 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56271.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44385.log.gz 2023-08-25T05:38:57.707 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63249.log 2023-08-25T05:38:57.707 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56271.log.gz 2023-08-25T05:38:57.708 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68545.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68545.log.gz 2023-08-25T05:38:57.710 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52863.log 2023-08-25T05:38:57.711 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61235.log 2023-08-25T05:38:57.712 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63249.log.gz 2023-08-25T05:38:57.713 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52863.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52863.log.gz 2023-08-25T05:38:57.713 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56940.log 2023-08-25T05:38:57.715 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51100.log 2023-08-25T05:38:57.715 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56940.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61235.log.gz 2023-08-25T05:38:57.716 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49964.log 2023-08-25T05:38:57.716 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56940.log.gz 2023-08-25T05:38:57.717 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.51100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51100.log.gz 2023-08-25T05:38:57.718 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49084.log 2023-08-25T05:38:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49964.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49964.log.gz 2023-08-25T05:38:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42899.log 2023-08-25T05:38:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49084.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49084.log.gz -5 2023-08-25T05:38:57.721 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44489.log 2023-08-25T05:38:57.722 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42899.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42899.log.gz 2023-08-25T05:38:57.722 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67765.log 2023-08-25T05:38:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44489.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44489.log.gz 2023-08-25T05:38:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49610.log 2023-08-25T05:38:57.725 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67765.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46327.log 2023-08-25T05:38:57.726 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67765.log.gz 2023-08-25T05:38:57.727 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49610.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49610.log.gz 2023-08-25T05:38:57.727 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47345.log 2023-08-25T05:38:57.729 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56914.log 2023-08-25T05:38:57.730 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47345.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46327.log.gz 2023-08-25T05:38:57.730 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70645.log 2023-08-25T05:38:57.730 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47345.log.gz 2023-08-25T05:38:57.731 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56914.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56914.log.gz 2023-08-25T05:38:57.732 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68463.log 2023-08-25T05:38:57.734 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70645.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.70645.log.gz -5 2023-08-25T05:38:57.734 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.65867.log 2023-08-25T05:38:57.735 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59115.log 2023-08-25T05:38:57.736 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68463.log.gz 2023-08-25T05:38:57.736 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65867.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65867.log.gz 2023-08-25T05:38:57.737 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47127.log 2023-08-25T05:38:57.739 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62376.log 2023-08-25T05:38:57.739 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59115.log.gz 2023-08-25T05:38:57.740 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47127.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47127.log.gz 2023-08-25T05:38:57.740 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58902.log 2023-08-25T05:38:57.741 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62376.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62376.log.gz 2023-08-25T05:38:57.742 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43542.log 2023-08-25T05:38:57.743 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61985.log 2023-08-25T05:38:57.743 INFO:teuthology.orchestra.run.smithi055.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58902.log.gz 2023-08-25T05:38:57.744 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43542.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43542.log.gz 2023-08-25T05:38:57.745 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63103.log 2023-08-25T05:38:57.746 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61985.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61985.log.gz 2023-08-25T05:38:57.746 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58037.log 2023-08-25T05:38:57.748 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63103.log: gzip -5 --verbose 88.0% -- /var/log/ceph/ceph-client.admin.67491.log -- replaced with /var/log/ceph/ceph-client.admin.63103.log.gz 2023-08-25T05:38:57.748 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:57.749 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58037.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58037.log.gz 2023-08-25T05:38:57.749 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63138.log 2023-08-25T05:38:57.751 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67491.log: gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67491.log.gz -5 2023-08-25T05:38:57.751 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.68489.log 2023-08-25T05:38:57.752 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63138.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63138.log.gz 2023-08-25T05:38:57.753 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57602.log 2023-08-25T05:38:57.754 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68489.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56595.log 2023-08-25T05:38:57.754 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68489.log.gz 2023-08-25T05:38:57.756 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63732.log 2023-08-25T05:38:57.756 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57602.log.gz 2023-08-25T05:38:57.757 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56595.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56595.log.gz 2023-08-25T05:38:57.758 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63933.log 2023-08-25T05:38:57.759 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63732.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63732.log.gz 2023-08-25T05:38:57.759 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56517.log 2023-08-25T05:38:57.761 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63933.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63933.log.gz 2023-08-25T05:38:57.761 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44307.log 2023-08-25T05:38:57.762 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56517.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56517.log.gz 2023-08-25T05:38:57.763 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44359.log 2023-08-25T05:38:57.764 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44307.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44307.log.gz 2023-08-25T05:38:57.765 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43475.log 2023-08-25T05:38:57.767 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44359.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44359.log.gz 2023-08-25T05:38:57.767 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51219.log 2023-08-25T05:38:57.768 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43475.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43475.log.gz 2023-08-25T05:38:57.768 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37902.log 2023-08-25T05:38:57.770 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51219.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51219.log.gz 2023-08-25T05:38:57.770 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-25T05:38:57.771 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.37902.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37902.log.gz 2023-08-25T05:38:57.772 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43205.log 2023-08-25T05:38:57.774 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49188.log 2023-08-25T05:38:57.775 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43205.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43205.log.gz 2023-08-25T05:38:57.776 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47161.log 2023-08-25T05:38:57.777 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57673.log 2023-08-25T05:38:57.778 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47161.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49188.log.gz 2023-08-25T05:38:57.779 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47161.log.gz 2023-08-25T05:38:57.780 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63829.log 2023-08-25T05:38:57.782 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70487.log 2023-08-25T05:38:57.783 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63829.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57673.log.gz 2023-08-25T05:38:57.783 INFO:teuthology.orchestra.run.smithi055.stderr: 89.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-08-25T05:38:57.784 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63829.log.gz 2023-08-25T05:38:57.784 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49729.log 2023-08-25T05:38:57.786 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69555.log 2023-08-25T05:38:57.787 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49729.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.70487.log.gz 2023-08-25T05:38:57.788 INFO:teuthology.orchestra.run.smithi055.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49729.log.gz 2023-08-25T05:38:57.788 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43755.log 2023-08-25T05:38:57.789 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69555.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61940.log 2023-08-25T05:38:57.790 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69555.log.gz 2023-08-25T05:38:57.791 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43755.log: gzip -5 --verbose 89.5% -- -- replaced with /var/log/ceph/ceph-client.admin.43755.log.gz /var/log/ceph/ceph-client.admin.43959.log 2023-08-25T05:38:57.791 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:57.793 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56333.log 2023-08-25T05:38:57.794 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43959.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61940.log.gz 2023-08-25T05:38:57.794 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52094.log 2023-08-25T05:38:57.794 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43959.log.gz 2023-08-25T05:38:57.796 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51860.log 2023-08-25T05:38:57.796 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56333.log.gz 2023-08-25T05:38:57.797 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52094.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52094.log.gz 2023-08-25T05:38:57.797 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51938.log 2023-08-25T05:38:57.799 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66068.log 2023-08-25T05:38:57.800 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51938.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51860.log.gz 2023-08-25T05:38:57.800 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.51938.log.gz 2023-08-25T05:38:57.801 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55388.log 2023-08-25T05:38:57.802 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56569.log 2023-08-25T05:38:57.802 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66068.log.gz 2023-08-25T05:38:57.803 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55388.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55388.log.gz 2023-08-25T05:38:57.804 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65763.log 2023-08-25T05:38:57.805 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56569.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54538.log 2023-08-25T05:38:57.805 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56569.log.gz 2023-08-25T05:38:57.806 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65763.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65763.log.gzgzip 2023-08-25T05:38:57.807 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59979.log 2023-08-25T05:38:57.808 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43449.log 2023-08-25T05:38:57.809 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59979.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54538.log.gz 2023-08-25T05:38:57.810 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62245.log 2023-08-25T05:38:57.810 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59979.log.gz 2023-08-25T05:38:57.811 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43449.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43449.log.gz 2023-08-25T05:38:57.812 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56812.log 2023-08-25T05:38:57.813 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62245.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62245.log.gz 2023-08-25T05:38:57.813 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65815.log 2023-08-25T05:38:57.815 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56812.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50614.log 2023-08-25T05:38:57.815 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56812.log.gz 2023-08-25T05:38:57.816 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65815.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65815.log.gz 2023-08-25T05:38:57.816 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47069.log 2023-08-25T05:38:57.818 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59200.log 2023-08-25T05:38:57.818 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50614.log.gz 2023-08-25T05:38:57.820 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66629.log 2023-08-25T05:38:57.820 INFO:teuthology.orchestra.run.smithi055.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47069.log.gz 2023-08-25T05:38:57.821 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59200.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59200.log.gz 2023-08-25T05:38:57.822 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58548.log 2023-08-25T05:38:57.823 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66629.log: gzip -5 --verbose 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66629.log.gz 2023-08-25T05:38:57.823 INFO:teuthology.orchestra.run.smithi055.stderr: -- /var/log/ceph/ceph-client.admin.53339.log 2023-08-25T05:38:57.824 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58548.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58548.log.gz 2023-08-25T05:38:57.825 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67543.log 2023-08-25T05:38:57.826 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53339.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53987.log 2023-08-25T05:38:57.826 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53339.log.gz 2023-08-25T05:38:57.828 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67543.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61653.log 2023-08-25T05:38:57.828 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67543.log.gz 2023-08-25T05:38:57.829 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53987.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53987.log.gz -5 2023-08-25T05:38:57.830 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46405.log 2023-08-25T05:38:57.831 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61653.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53289.log 2023-08-25T05:38:57.831 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61653.log.gz 2023-08-25T05:38:57.833 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46405.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46405.log.gz 2023-08-25T05:38:57.833 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50061.log 2023-08-25T05:38:57.834 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53289.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53289.log.gz 2023-08-25T05:38:57.835 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53047.log 2023-08-25T05:38:57.836 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50061.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43345.log 2023-08-25T05:38:57.837 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50061.log.gz 2023-08-25T05:38:57.838 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53047.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53047.log.gz 2023-08-25T05:38:57.838 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48842.log 2023-08-25T05:38:57.840 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62037.log 2023-08-25T05:38:57.840 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48842.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43345.log.gz 2023-08-25T05:38:57.841 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66489.log 2023-08-25T05:38:57.841 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48842.log.gz 2023-08-25T05:38:57.842 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62037.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60847.log 2023-08-25T05:38:57.843 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62037.log.gz 2023-08-25T05:38:57.844 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43762.log 2023-08-25T05:38:57.844 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66489.log.gz 2023-08-25T05:38:57.845 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60847.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60847.log.gz 2023-08-25T05:38:57.846 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51169.log 2023-08-25T05:38:57.847 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43762.log: gzip 89.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.43762.log.gz -- 2023-08-25T05:38:57.848 INFO:teuthology.orchestra.run.smithi055.stderr: /var/log/ceph/ceph-client.admin.51637.log 2023-08-25T05:38:57.849 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68517.log 2023-08-25T05:38:57.849 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51169.log.gz 2023-08-25T05:38:57.850 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51637.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51637.log.gz 2023-08-25T05:38:57.851 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54600.log 2023-08-25T05:38:57.852 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68517.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68517.log.gz -5 2023-08-25T05:38:57.852 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.63327.log 2023-08-25T05:38:57.853 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54600.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54600.log.gz 2023-08-25T05:38:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63628.log 2023-08-25T05:38:57.855 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63327.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63327.log.gz 2023-08-25T05:38:57.855 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53221.log 2023-08-25T05:38:57.856 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63628.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63628.log.gz 2023-08-25T05:38:57.857 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50744.log 2023-08-25T05:38:57.858 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.53221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53221.log.gz 2023-08-25T05:38:57.859 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42841.log 2023-08-25T05:38:57.860 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50744.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50744.log.gz 2023-08-25T05:38:57.861 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47397.log 2023-08-25T05:38:57.861 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42841.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42841.log.gz 2023-08-25T05:38:57.862 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60873.log 2023-08-25T05:38:57.863 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47397.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47397.log.gz 2023-08-25T05:38:57.864 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69688.log 2023-08-25T05:38:57.865 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60873.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60873.log.gz 2023-08-25T05:38:57.866 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50770.log 2023-08-25T05:38:57.867 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69688.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.69688.log.gz 2023-08-25T05:38:57.868 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69529.log 2023-08-25T05:38:57.869 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50770.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50770.log.gz 2023-08-25T05:38:57.870 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43743.log 2023-08-25T05:38:57.871 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69529.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69529.log.gz 2023-08-25T05:38:57.872 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58142.log 2023-08-25T05:38:57.873 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43743.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43743.log.gz 2023-08-25T05:38:57.874 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68293.log 2023-08-25T05:38:57.875 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58142.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58142.log.gz 2023-08-25T05:38:57.875 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55244.log 2023-08-25T05:38:57.877 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68293.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68293.log.gz 2023-08-25T05:38:57.877 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59850.log 2023-08-25T05:38:57.878 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55244.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55244.log.gz 2023-08-25T05:38:57.879 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52563.log 2023-08-25T05:38:57.880 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59850.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59850.log.gz 2023-08-25T05:38:57.881 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68384.log 2023-08-25T05:38:57.882 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52563.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.52563.log.gz 2023-08-25T05:38:57.883 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53786.log 2023-08-25T05:38:57.884 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68384.log: 89.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56413.log 2023-08-25T05:38:57.885 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68384.log.gz 2023-08-25T05:38:57.886 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53786.log: gzip -5 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53786.log.gz 2023-08-25T05:38:57.886 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.69057.log 2023-08-25T05:38:57.887 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56413.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56413.log.gz 2023-08-25T05:38:57.888 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64442.log 2023-08-25T05:38:57.889 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69057.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69057.log.gz 2023-08-25T05:38:57.890 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46685.log 2023-08-25T05:38:57.891 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64442.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64442.log.gz 2023-08-25T05:38:57.892 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44541.log 2023-08-25T05:38:57.892 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46685.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46685.log.gz 2023-08-25T05:38:57.893 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67349.log 2023-08-25T05:38:57.895 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44541.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44541.log.gz 2023-08-25T05:38:57.895 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58574.log 2023-08-25T05:38:57.896 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67349.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67349.log.gz 2023-08-25T05:38:57.897 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66016.log 2023-08-25T05:38:57.898 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58574.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58574.log.gz 2023-08-25T05:38:57.899 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55270.log 2023-08-25T05:38:57.900 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66016.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.66016.log.gz 2023-08-25T05:38:57.900 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50558.log 2023-08-25T05:38:57.901 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55270.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55270.log.gz 2023-08-25T05:38:57.902 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67817.log 2023-08-25T05:38:57.903 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50558.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50558.log.gz 2023-08-25T05:38:57.904 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62278.log 2023-08-25T05:38:57.905 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67817.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.67817.log.gz 2023-08-25T05:38:57.906 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63419.log 2023-08-25T05:38:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62278.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62278.log.gz 2023-08-25T05:38:57.908 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57033.log 2023-08-25T05:38:57.909 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63419.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63419.log.gz 2023-08-25T05:38:57.910 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54566.log 2023-08-25T05:38:57.911 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57033.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57033.log.gz 2023-08-25T05:38:57.912 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53237.log 2023-08-25T05:38:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54566.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54566.log.gz 2023-08-25T05:38:57.913 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61458.log 2023-08-25T05:38:57.915 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53237.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56674.log 2023-08-25T05:38:57.915 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53237.log.gz 2023-08-25T05:38:57.917 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61458.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61458.log.gz 2023-08-25T05:38:57.917 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69303.log 2023-08-25T05:38:57.918 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69636.log 2023-08-25T05:38:57.919 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69303.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56674.log.gz 2023-08-25T05:38:57.920 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62480.log 2023-08-25T05:38:57.920 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69303.log.gz 2023-08-25T05:38:57.921 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69636.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.69636.log.gz 2023-08-25T05:38:57.923 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46088.log 2023-08-25T05:38:57.924 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59915.log 2023-08-25T05:38:57.925 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62480.log.gz 2023-08-25T05:38:57.926 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46088.log: gzip -5 89.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.46088.log.gz /var/log/ceph/ceph-client.0.56796.log 2023-08-25T05:38:57.926 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:57.927 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45664.log 2023-08-25T05:38:57.928 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59915.log.gz 2023-08-25T05:38:57.928 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.56796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56796.log.gz 2023-08-25T05:38:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70383.log 2023-08-25T05:38:57.930 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59590.log 2023-08-25T05:38:57.931 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70383.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45664.log.gz 2023-08-25T05:38:57.932 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55329.log 2023-08-25T05:38:57.932 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70383.log.gz 2023-08-25T05:38:57.933 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59590.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48410.log 2023-08-25T05:38:57.934 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59590.log.gz 2023-08-25T05:38:57.935 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55329.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55329.log.gz 2023-08-25T05:38:57.935 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47741.log 2023-08-25T05:38:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48410.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55774.log 2023-08-25T05:38:57.937 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48410.log.gz 2023-08-25T05:38:57.938 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47741.log: gzip -5 --verbose 87.9% -- -- replaced with /var/log/ceph/ceph-client.admin.47741.log.gz /var/log/ceph/ceph-client.admin.69582.log 2023-08-25T05:38:57.939 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42816.log 2023-08-25T05:38:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69582.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55774.log.gz 2023-08-25T05:38:57.942 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56111.log 2023-08-25T05:38:57.942 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69582.log.gz 2023-08-25T05:38:57.943 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42816.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62141.log 2023-08-25T05:38:57.943 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42816.log.gz 2023-08-25T05:38:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56111.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56111.log.gz 2023-08-25T05:38:57.945 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69412.log 2023-08-25T05:38:57.946 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56047.log 2023-08-25T05:38:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69412.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62141.log.gz 2023-08-25T05:38:57.948 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69412.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46275.log 2023-08-25T05:38:57.948 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:57.949 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68200.log 2023-08-25T05:38:57.950 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56047.log.gz 2023-08-25T05:38:57.950 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46275.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46275.log.gz 2023-08-25T05:38:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43554.log 2023-08-25T05:38:57.952 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68200.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59668.log 2023-08-25T05:38:57.953 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68200.log.gz 2023-08-25T05:38:57.954 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57751.log 2023-08-25T05:38:57.954 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43554.log.gz 2023-08-25T05:38:57.956 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69159.log 2023-08-25T05:38:57.956 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59668.log.gz 2023-08-25T05:38:57.957 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57751.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57751.log.gz 2023-08-25T05:38:57.957 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48646.log 2023-08-25T05:38:57.958 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69159.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69159.log.gz 2023-08-25T05:38:57.959 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65208.log 2023-08-25T05:38:57.960 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48646.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48646.log.gz 2023-08-25T05:38:57.960 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46717.log 2023-08-25T05:38:57.961 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65208.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65208.log.gz 2023-08-25T05:38:57.962 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58626.log 2023-08-25T05:38:57.964 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57777.log 2023-08-25T05:38:57.964 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46717.log.gz 2023-08-25T05:38:57.965 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60682.log 2023-08-25T05:38:57.965 INFO:teuthology.orchestra.run.smithi055.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.58626.log.gz 2023-08-25T05:38:57.966 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57777.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57777.log.gz 2023-08-25T05:38:57.967 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49584.log 2023-08-25T05:38:57.968 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69041.log 2023-08-25T05:38:57.969 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49584.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60682.log.gz 2023-08-25T05:38:57.970 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44177.log 2023-08-25T05:38:57.970 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49584.log.gz 2023-08-25T05:38:57.970 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.69041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.69041.log.gz 2023-08-25T05:38:57.972 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61484.log 2023-08-25T05:38:57.974 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62999.log 2023-08-25T05:38:57.974 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44177.log.gz 2023-08-25T05:38:57.975 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61484.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61484.log.gz 2023-08-25T05:38:57.976 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66943.log 2023-08-25T05:38:57.978 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62999.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62999.log.gz -5 2023-08-25T05:38:57.978 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48031.log 2023-08-25T05:38:57.979 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66943.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66943.log.gz 2023-08-25T05:38:57.979 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54312.log 2023-08-25T05:38:57.981 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61588.log 2023-08-25T05:38:57.981 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48031.log.gz 2023-08-25T05:38:57.982 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54312.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63353.log 2023-08-25T05:38:57.983 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54312.log.gz 2023-08-25T05:38:57.984 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61588.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61588.log.gz 2023-08-25T05:38:57.984 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52723.log 2023-08-25T05:38:57.985 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64248.log 2023-08-25T05:38:57.987 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63353.log: /var/log/ceph/ceph-client.admin.52723.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63353.log.gz 2023-08-25T05:38:57.987 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52723.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45552.log 2023-08-25T05:38:57.987 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:57.989 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43423.log 2023-08-25T05:38:57.989 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64248.log.gz 2023-08-25T05:38:57.990 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45552.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47691.log 2023-08-25T05:38:57.990 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45552.log.gz 2023-08-25T05:38:57.992 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55441.log 2023-08-25T05:38:57.992 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43423.log.gz 2023-08-25T05:38:57.993 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47691.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47691.log.gz 2023-08-25T05:38:57.994 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58258.log 2023-08-25T05:38:57.995 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55441.log: 87.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.55441.log.gz 2023-08-25T05:38:57.995 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59824.log 2023-08-25T05:38:57.996 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58258.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58258.log.gz 2023-08-25T05:38:57.997 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52068.log 2023-08-25T05:38:57.998 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52406.log 2023-08-25T05:38:57.998 INFO:teuthology.orchestra.run.smithi055.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.59824.log.gz 2023-08-25T05:38:57.999 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52068.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52068.log.gz 2023-08-25T05:38:58.000 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69792.log 2023-08-25T05:38:58.001 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65737.log 2023-08-25T05:38:58.002 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52406.log.gz 2023-08-25T05:38:58.002 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69792.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69792.log.gz 2023-08-25T05:38:58.003 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53537.log 2023-08-25T05:38:58.004 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65737.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65737.log.gz 2023-08-25T05:38:58.005 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60411.log 2023-08-25T05:38:58.005 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53537.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53537.log.gz 2023-08-25T05:38:58.006 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69916.log 2023-08-25T05:38:58.008 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60411.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60411.log.gz 2023-08-25T05:38:58.008 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54680.log 2023-08-25T05:38:58.009 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69916.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69916.log.gz 2023-08-25T05:38:58.010 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54280.log 2023-08-25T05:38:58.011 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54680.log: gzip -5 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54680.log.gz 2023-08-25T05:38:58.012 INFO:teuthology.orchestra.run.smithi055.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60544.log 2023-08-25T05:38:58.012 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54280.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54280.log.gz 2023-08-25T05:38:58.013 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49911.log 2023-08-25T05:38:58.014 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60544.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60544.log.gz 2023-08-25T05:38:58.015 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70305.log 2023-08-25T05:38:58.016 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49911.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49911.log.gz 2023-08-25T05:38:58.017 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52615.log 2023-08-25T05:38:58.019 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70305.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-08-25T05:38:58.019 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52615.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70305.log.gz 2023-08-25T05:38:58.020 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57472.log 2023-08-25T05:38:58.020 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52615.log.gz 2023-08-25T05:38:58.021 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45188.log 2023-08-25T05:38:58.023 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.57472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43538.log 2023-08-25T05:38:58.023 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57472.log.gz 2023-08-25T05:38:58.025 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45188.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45188.log.gz 2023-08-25T05:38:58.025 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57249.log 2023-08-25T05:38:58.026 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43538.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-08-25T05:38:58.027 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43538.log.gz 2023-08-25T05:38:58.028 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43016.log 2023-08-25T05:38:58.029 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57249.log.gz 2023-08-25T05:38:58.030 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54143.log 2023-08-25T05:38:58.031 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43016.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43016.log.gz 2023-08-25T05:38:58.032 INFO:teuthology.orchestra.run.smithi055.stderr: 90.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-25T05:38:58.033 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51964.log 2023-08-25T05:38:58.035 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54143.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54143.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54380.log 2023-08-25T05:38:58.035 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:58.036 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51964.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-08-25T05:38:58.037 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54380.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51964.log.gz 2023-08-25T05:38:58.038 INFO:teuthology.orchestra.run.smithi055.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54380.log.gz 2023-08-25T05:38:58.039 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63075.log 2023-08-25T05:38:58.041 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69968.log 2023-08-25T05:38:58.043 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63075.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63075.log.gz 2023-08-25T05:38:58.053 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65711.log 2023-08-25T05:38:58.055 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69968.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69968.log.gz 2023-08-25T05:38:58.056 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68659.log 2023-08-25T05:38:58.058 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65711.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65711.log.gz 2023-08-25T05:38:58.060 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49558.log 2023-08-25T05:38:58.062 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68659.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68659.log.gz 2023-08-25T05:38:58.064 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48786.log 2023-08-25T05:38:58.066 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49558.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49558.log.gz 2023-08-25T05:38:58.068 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69083.log 2023-08-25T05:38:58.070 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48786.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48786.log.gz 2023-08-25T05:38:58.072 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63706.log 2023-08-25T05:38:58.073 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69083.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69083.log.gz 2023-08-25T05:38:58.075 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60813.log 2023-08-25T05:38:58.077 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63706.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63706.log.gz 2023-08-25T05:38:58.079 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48384.log 2023-08-25T05:38:58.081 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60813.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60813.log.gz 2023-08-25T05:38:58.083 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43553.log 2023-08-25T05:38:58.085 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48384.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48384.log.gz 2023-08-25T05:38:58.086 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44952.log 2023-08-25T05:38:58.089 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43553.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43553.log.gz 2023-08-25T05:38:58.090 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45082.log 2023-08-25T05:38:58.092 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44952.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44952.log.gz 2023-08-25T05:38:58.094 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65384.log 2023-08-25T05:38:58.096 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45082.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45082.log.gz 2023-08-25T05:38:58.098 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57524.log 2023-08-25T05:38:58.100 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65384.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65384.log.gz 2023-08-25T05:38:58.102 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60708.log 2023-08-25T05:38:58.103 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57524.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57524.log.gz 2023-08-25T05:38:58.105 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55467.log 2023-08-25T05:38:58.107 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60708.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60708.log.gz 2023-08-25T05:38:58.109 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43537.log 2023-08-25T05:38:58.111 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55467.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55467.log.gz 2023-08-25T05:38:58.113 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62730.log 2023-08-25T05:38:58.114 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43537.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43537.log.gz 2023-08-25T05:38:58.116 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57223.log 2023-08-25T05:38:58.118 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62730.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62730.log.gz 2023-08-25T05:38:58.120 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50586.log 2023-08-25T05:38:58.122 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57223.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57223.log.gz 2023-08-25T05:38:58.124 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58310.log 2023-08-25T05:38:58.126 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50586.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50586.log.gz 2023-08-25T05:38:58.128 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49240.log 2023-08-25T05:38:58.130 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58310.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58310.log.gz 2023-08-25T05:38:58.131 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57881.log 2023-08-25T05:38:58.133 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49240.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49240.log.gz 2023-08-25T05:38:58.136 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62704.log 2023-08-25T05:38:58.138 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57881.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57881.log.gz 2023-08-25T05:38:58.139 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56163.log 2023-08-25T05:38:58.141 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62704.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62704.log.gz 2023-08-25T05:38:58.143 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68096.log 2023-08-25T05:38:58.145 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56163.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56163.log.gz 2023-08-25T05:38:58.147 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54458.log 2023-08-25T05:38:58.149 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68096.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68096.log.gz 2023-08-25T05:38:58.150 INFO:teuthology.orchestra.run.smithi055.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-08-25T05:38:58.150 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46613.log 2023-08-25T05:38:58.152 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46965.log 2023-08-25T05:38:58.153 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46613.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54458.log.gz 2023-08-25T05:38:58.153 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46613.log.gz 2023-08-25T05:38:58.154 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54784.log 2023-08-25T05:38:58.156 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47947.log 2023-08-25T05:38:58.157 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46965.log: /var/log/ceph/ceph-client.admin.54784.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46965.log.gz 2023-08-25T05:38:58.158 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54784.log.gz 2023-08-25T05:38:58.158 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58416.log 2023-08-25T05:38:58.160 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66461.log 2023-08-25T05:38:58.161 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47947.log.gz 2023-08-25T05:38:58.163 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58416.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58416.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46197.log 2023-08-25T05:38:58.163 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:58.164 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66461.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66461.log.gz 2023-08-25T05:38:58.165 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43747.log 2023-08-25T05:38:58.167 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46197.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51990.log 2023-08-25T05:38:58.167 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46197.log.gz 2023-08-25T05:38:58.169 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54626.log 2023-08-25T05:38:58.169 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51990.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43747.log.gz 2023-08-25T05:38:58.170 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51990.log.gz 2023-08-25T05:38:58.171 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67843.log 2023-08-25T05:38:58.173 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51546.log 2023-08-25T05:38:58.173 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67843.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54626.log.gz 2023-08-25T05:38:58.174 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67843.log.gz 2023-08-25T05:38:58.175 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50087.log 2023-08-25T05:38:58.177 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49292.log 2023-08-25T05:38:58.177 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50087.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51546.log.gz 2023-08-25T05:38:58.178 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50087.log.gz 2023-08-25T05:38:58.179 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63275.log 2023-08-25T05:38:58.180 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68358.log 2023-08-25T05:38:58.181 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63275.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49292.log.gz 2023-08-25T05:38:58.182 INFO:teuthology.orchestra.run.smithi055.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63275.log.gz 2023-08-25T05:38:58.183 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58840.log 2023-08-25T05:38:58.185 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68789.log 2023-08-25T05:38:58.185 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58840.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68358.log.gz 2023-08-25T05:38:58.186 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58840.log.gz 2023-08-25T05:38:58.187 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61261.log 2023-08-25T05:38:58.189 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62115.log 2023-08-25T05:38:58.189 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61261.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68789.log.gz 2023-08-25T05:38:58.190 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61261.log.gz 2023-08-25T05:38:58.191 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45214.log 2023-08-25T05:38:58.193 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67687.log 2023-08-25T05:38:58.193 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45214.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62115.log.gz 2023-08-25T05:38:58.194 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45214.log.gz 2023-08-25T05:38:58.195 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51117.log 2023-08-25T05:38:58.197 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62956.log 2023-08-25T05:38:58.197 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51117.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67687.log.gz 2023-08-25T05:38:58.198 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51117.log.gz 2023-08-25T05:38:58.199 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69942.log 2023-08-25T05:38:58.201 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.62956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46353.log 2023-08-25T05:38:58.202 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62956.log.gz 2023-08-25T05:38:58.202 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69942.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.69942.log.gz 2023-08-25T05:38:58.203 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62808.log 2023-08-25T05:38:58.205 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44978.log 2023-08-25T05:38:58.205 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62808.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46353.log.gz 2023-08-25T05:38:58.206 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62808.log.gz 2023-08-25T05:38:58.206 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61680.log 2023-08-25T05:38:58.209 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68867.log 2023-08-25T05:38:58.209 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61680.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44978.log.gz 2023-08-25T05:38:58.210 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61680.log.gz 2023-08-25T05:38:58.211 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43045.log 2023-08-25T05:38:58.213 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63907.log 2023-08-25T05:38:58.213 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43045.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68867.log.gz 2023-08-25T05:38:58.214 INFO:teuthology.orchestra.run.smithi055.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43045.log.gz 2023-08-25T05:38:58.215 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66042.log 2023-08-25T05:38:58.217 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48730.log 2023-08-25T05:38:58.217 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66042.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63907.log.gz 2023-08-25T05:38:58.218 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.66042.log.gz 2023-08-25T05:38:58.219 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67869.log 2023-08-25T05:38:58.221 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53073.log 2023-08-25T05:38:58.222 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67869.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48730.log.gz 2023-08-25T05:38:58.222 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67869.log.gz 2023-08-25T05:38:58.223 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53367.log 2023-08-25T05:38:58.225 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65034.log 2023-08-25T05:38:58.226 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53367.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53073.log.gz 2023-08-25T05:38:58.226 INFO:teuthology.orchestra.run.smithi055.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53367.log.gz 2023-08-25T05:38:58.227 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69247.log 2023-08-25T05:38:58.229 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70513.log 2023-08-25T05:38:58.230 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69247.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65034.log.gz 2023-08-25T05:38:58.230 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69247.log.gz 2023-08-25T05:38:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45134.log 2023-08-25T05:38:58.233 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66172.log 2023-08-25T05:38:58.233 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70513.log.gz 2023-08-25T05:38:58.235 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45134.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44411.log 2023-08-25T05:38:58.235 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45134.log.gz 2023-08-25T05:38:58.236 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66172.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66172.log.gz 2023-08-25T05:38:58.238 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60227.log 2023-08-25T05:38:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44411.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44411.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69109.log 2023-08-25T05:38:58.240 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59005.log 2023-08-25T05:38:58.242 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60227.log.gz 2023-08-25T05:38:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46431.log 2023-08-25T05:38:58.244 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69109.log.gz 2023-08-25T05:38:58.245 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51307.log 2023-08-25T05:38:58.246 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46431.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59005.log.gz 2023-08-25T05:38:58.247 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46431.log.gz 2023-08-25T05:38:58.247 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70227.log 2023-08-25T05:38:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67136.log 2023-08-25T05:38:58.250 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51307.log.gz 2023-08-25T05:38:58.251 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70227.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.70227.log.gz 2023-08-25T05:38:58.252 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60085.log 2023-08-25T05:38:58.253 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56622.log 2023-08-25T05:38:58.254 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60085.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67136.log.gz 2023-08-25T05:38:58.254 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60085.log.gz 2023-08-25T05:38:58.256 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54195.log 2023-08-25T05:38:58.257 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63602.log 2023-08-25T05:38:58.258 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56622.log.gz 2023-08-25T05:38:58.259 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54195.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54195.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43097.log 2023-08-25T05:38:58.260 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:58.261 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56299.log 2023-08-25T05:38:58.262 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63602.log.gz 2023-08-25T05:38:58.263 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43097.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43097.log.gz 2023-08-25T05:38:58.263 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49532.log 2023-08-25T05:38:58.265 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60139.log 2023-08-25T05:38:58.266 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56299.log: /var/log/ceph/ceph-client.admin.49532.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56299.log.gz 2023-08-25T05:38:58.267 INFO:teuthology.orchestra.run.smithi055.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49532.log.gz 2023-08-25T05:38:58.267 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62973.log 2023-08-25T05:38:58.269 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43962.log 2023-08-25T05:38:58.270 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60139.log.gz 2023-08-25T05:38:58.271 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62973.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62973.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46379.log 2023-08-25T05:38:58.271 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:58.273 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58722.log 2023-08-25T05:38:58.274 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46379.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43962.log.gz 2023-08-25T05:38:58.274 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46379.log.gz 2023-08-25T05:38:58.276 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56750.log 2023-08-25T05:38:58.277 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.58722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65238.log 2023-08-25T05:38:58.278 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58722.log.gz 2023-08-25T05:38:58.279 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45344.log 2023-08-25T05:38:58.280 INFO:teuthology.orchestra.run.smithi055.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56750.log.gz 2023-08-25T05:38:58.281 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58338.log 2023-08-25T05:38:58.282 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45344.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65238.log.gz 2023-08-25T05:38:58.283 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45344.log.gz 2023-08-25T05:38:58.283 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55415.log 2023-08-25T05:38:58.285 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50113.log 2023-08-25T05:38:58.286 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55415.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58338.log.gz 2023-08-25T05:38:58.287 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55415.log.gz 2023-08-25T05:38:58.287 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53402.log 2023-08-25T05:38:58.289 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70671.log 2023-08-25T05:38:58.290 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53402.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50113.log.gz 2023-08-25T05:38:58.291 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53402.log.gz 2023-08-25T05:38:58.292 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53099.log 2023-08-25T05:38:58.293 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55720.log 2023-08-25T05:38:58.294 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70671.log.gz 2023-08-25T05:38:58.296 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53099.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53099.log.gz 2023-08-25T05:38:58.296 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44333.log 2023-08-25T05:38:58.297 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47213.log 2023-08-25T05:38:58.298 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55720.log: /var/log/ceph/ceph-client.admin.44333.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55720.log.gz 2023-08-25T05:38:58.299 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44333.log.gz 2023-08-25T05:38:58.300 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64652.log 2023-08-25T05:38:58.302 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61862.log 2023-08-25T05:38:58.303 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64652.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47213.log.gz 2023-08-25T05:38:58.303 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64652.log.gz 2023-08-25T05:38:58.304 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59441.log 2023-08-25T05:38:58.306 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60031.log 2023-08-25T05:38:58.307 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59441.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61862.log.gz 2023-08-25T05:38:58.308 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59441.log.gz 2023-08-25T05:38:58.308 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46587.log 2023-08-25T05:38:58.310 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61562.log 2023-08-25T05:38:58.311 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46587.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60031.log.gz 2023-08-25T05:38:58.312 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46587.log.gz 2023-08-25T05:38:58.312 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66549.log 2023-08-25T05:38:58.314 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55545.log 2023-08-25T05:38:58.315 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66549.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61562.log.gz 2023-08-25T05:38:58.316 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66549.log.gz 2023-08-25T05:38:58.316 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64704.log 2023-08-25T05:38:58.318 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59258.log 2023-08-25T05:38:58.319 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64704.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55545.log.gz 2023-08-25T05:38:58.320 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64704.log.gz 2023-08-25T05:38:58.320 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45794.log 2023-08-25T05:38:58.322 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65410.log 2023-08-25T05:38:58.323 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45794.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59258.log.gz 2023-08-25T05:38:58.324 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45794.log.gz 2023-08-25T05:38:58.325 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48109.log 2023-08-25T05:38:58.326 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59337.log 2023-08-25T05:38:58.327 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48109.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65410.log.gz 2023-08-25T05:38:58.328 INFO:teuthology.orchestra.run.smithi055.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48109.log.gz 2023-08-25T05:38:58.329 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59232.log 2023-08-25T05:38:58.331 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55571.log 2023-08-25T05:38:58.332 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59232.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59232.log.gz 2023-08-25T05:38:58.332 INFO:teuthology.orchestra.run.smithi055.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.59337.log.gz 2023-08-25T05:38:58.333 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66237.log 2023-08-25T05:38:58.335 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58196.log 2023-08-25T05:38:58.336 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55571.log.gz 2023-08-25T05:38:58.337 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53681.log 2023-08-25T05:38:58.338 INFO:teuthology.orchestra.run.smithi055.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66237.log.gz 2023-08-25T05:38:58.339 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58196.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58196.log.gz 2023-08-25T05:38:58.339 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55493.log 2023-08-25T05:38:58.341 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66328.log 2023-08-25T05:38:58.342 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55493.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53681.log.gz 2023-08-25T05:38:58.343 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55493.log.gz 2023-08-25T05:38:58.343 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65000.log 2023-08-25T05:38:58.345 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54732.log 2023-08-25T05:38:58.346 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65000.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66328.log.gz 2023-08-25T05:38:58.346 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65000.log.gz 2023-08-25T05:38:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52250.log 2023-08-25T05:38:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54732.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57972.log 2023-08-25T05:38:58.350 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54732.log.gz 2023-08-25T05:38:58.351 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48135.log 2023-08-25T05:38:58.352 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52250.log.gz 2023-08-25T05:38:58.354 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45160.log 2023-08-25T05:38:58.354 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57972.log.gz 2023-08-25T05:38:58.355 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48135.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48135.log.gz 2023-08-25T05:38:58.355 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58868.log 2023-08-25T05:38:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64300.log 2023-08-25T05:38:58.358 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58868.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45160.log.gz 2023-08-25T05:38:58.359 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58868.log.gz 2023-08-25T05:38:58.360 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43970.log 2023-08-25T05:38:58.361 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60570.log 2023-08-25T05:38:58.362 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64300.log.gz 2023-08-25T05:38:58.364 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46887.log 2023-08-25T05:38:58.364 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43970.log.gz 2023-08-25T05:38:58.365 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53263.log 2023-08-25T05:38:58.367 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46887.log: 88.4% 91.3% -- replaced with /var/log/ceph/ceph-client.admin.60570.log.gz 2023-08-25T05:38:58.367 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46887.log.gz 2023-08-25T05:38:58.368 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44463.log 2023-08-25T05:38:58.370 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53263.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53263.log.gz 2023-08-25T05:38:58.371 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58738.log 2023-08-25T05:38:58.372 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57394.log 2023-08-25T05:38:58.373 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44463.log.gz 2023-08-25T05:38:58.374 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52328.log 2023-08-25T05:38:58.375 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57394.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58738.log.gz 2023-08-25T05:38:58.376 INFO:teuthology.orchestra.run.smithi055.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.57394.log.gz 2023-08-25T05:38:58.377 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45630.log 2023-08-25T05:38:58.378 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57699.log 2023-08-25T05:38:58.379 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45630.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52328.log.gz 2023-08-25T05:38:58.380 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45630.log.gz 2023-08-25T05:38:58.381 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66433.log 2023-08-25T05:38:58.383 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67170.log 2023-08-25T05:38:58.384 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66433.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57699.log.gz 2023-08-25T05:38:58.384 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.66433.log.gz 2023-08-25T05:38:58.386 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50328.log 2023-08-25T05:38:58.387 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43123.log 2023-08-25T05:38:58.388 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50328.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67170.log.gz 2023-08-25T05:38:58.388 INFO:teuthology.orchestra.run.smithi055.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50328.log.gz 2023-08-25T05:38:58.390 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61510.log 2023-08-25T05:38:58.391 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43123.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43123.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49807.log 2023-08-25T05:38:58.392 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:58.393 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57803.log 2023-08-25T05:38:58.394 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61510.log.gz 2023-08-25T05:38:58.395 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49807.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49807.log.gz 2023-08-25T05:38:58.396 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44281.log 2023-08-25T05:38:58.397 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53021.log 2023-08-25T05:38:58.398 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57803.log.gz 2023-08-25T05:38:58.399 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44281.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44281.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55826.log 2023-08-25T05:38:58.400 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:58.401 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63191.log 2023-08-25T05:38:58.402 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53021.log.gz 2023-08-25T05:38:58.403 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.55826.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55826.log.gz 2023-08-25T05:38:58.403 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51663.log 2023-08-25T05:38:58.405 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47577.log 2023-08-25T05:38:58.405 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63191.log.gz 2023-08-25T05:38:58.407 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51663.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51663.log.gz 2023-08-25T05:38:58.407 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59746.log 2023-08-25T05:38:58.408 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48592.log 2023-08-25T05:38:58.409 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47577.log.gz 2023-08-25T05:38:58.411 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59746.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48291.log 2023-08-25T05:38:58.411 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59746.log.gz 2023-08-25T05:38:58.412 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48592.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48592.log.gz 2023-08-25T05:38:58.413 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50506.log 2023-08-25T05:38:58.415 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58790.log 2023-08-25T05:38:58.416 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50506.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48291.log.gz 2023-08-25T05:38:58.416 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50506.log.gz 2023-08-25T05:38:58.418 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70591.log 2023-08-25T05:38:58.419 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43763.log 2023-08-25T05:38:58.419 INFO:teuthology.orchestra.run.smithi055.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58790.log.gz 2023-08-25T05:38:58.422 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70591.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60666.log 2023-08-25T05:38:58.422 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70591.log.gz 2023-08-25T05:38:58.423 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43763.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43763.log.gz 2023-08-25T05:38:58.424 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47639.log 2023-08-25T05:38:58.425 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.60666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60666.log.gz 2023-08-25T05:38:58.426 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65938.log 2023-08-25T05:38:58.428 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48057.log 2023-08-25T05:38:58.429 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65938.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47639.log.gz 2023-08-25T05:38:58.429 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65938.log.gz 2023-08-25T05:38:58.430 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50360.log 2023-08-25T05:38:58.432 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70123.log 2023-08-25T05:38:58.432 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48057.log.gz 2023-08-25T05:38:58.434 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43750.log 2023-08-25T05:38:58.435 INFO:teuthology.orchestra.run.smithi055.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50360.log.gz 2023-08-25T05:38:58.435 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.70123.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.70123.log.gz 2023-08-25T05:38:58.437 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50874.log 2023-08-25T05:38:58.438 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43750.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43750.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65152.log 2023-08-25T05:38:58.439 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:58.440 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49396.log 2023-08-25T05:38:58.441 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50874.log: /var/log/ceph/ceph-client.admin.65152.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50874.log.gz 2023-08-25T05:38:58.442 INFO:teuthology.orchestra.run.smithi055.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65152.log.gz 2023-08-25T05:38:58.442 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65436.log 2023-08-25T05:38:58.444 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47863.log 2023-08-25T05:38:58.445 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65436.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49396.log.gz 2023-08-25T05:38:58.446 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65436.log.gz 2023-08-25T05:38:58.447 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69464.log 2023-08-25T05:38:58.448 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68815.log 2023-08-25T05:38:58.449 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47863.log: /var/log/ceph/ceph-client.admin.69464.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47863.log.gz 2023-08-25T05:38:58.450 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.69464.log.gz 2023-08-25T05:38:58.451 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44878.log 2023-08-25T05:38:58.453 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.68815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47919.log 2023-08-25T05:38:58.454 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.2.44878.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68815.log.gz 2023-08-25T05:38:58.454 INFO:teuthology.orchestra.run.smithi055.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44878.log.gz 2023-08-25T05:38:58.455 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48980.log 2023-08-25T05:38:58.457 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53812.log 2023-08-25T05:38:58.457 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47919.log.gz 2023-08-25T05:38:58.459 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48980.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48980.log.gz 2023-08-25T05:38:58.459 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60385.log 2023-08-25T05:38:58.460 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46561.log 2023-08-25T05:38:58.461 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53812.log.gz 2023-08-25T05:38:58.463 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60385.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60385.log.gz 2023-08-25T05:38:58.463 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61784.log 2023-08-25T05:38:58.465 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46561.log: gzip -5 88.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.46561.log.gz /var/log/ceph/ceph-client.admin.62219.log 2023-08-25T05:38:58.465 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:58.466 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.61784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49636.log 2023-08-25T05:38:58.468 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62219.log: 87.7% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61784.log.gz 2023-08-25T05:38:58.468 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62219.log.gz 2023-08-25T05:38:58.469 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51054.log 2023-08-25T05:38:58.471 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.49636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64037.log 2023-08-25T05:38:58.472 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51054.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49636.log.gz 2023-08-25T05:38:58.472 INFO:teuthology.orchestra.run.smithi055.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51054.log.gz 2023-08-25T05:38:58.473 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47771.log 2023-08-25T05:38:58.475 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50425.log 2023-08-25T05:38:58.476 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64037.log: /var/log/ceph/ceph-client.admin.47771.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.64037.log.gz 2023-08-25T05:38:58.476 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47771.log.gz 2023-08-25T05:38:58.477 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62534.log 2023-08-25T05:38:58.479 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43546.log 2023-08-25T05:38:58.480 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50425.log.gz 2023-08-25T05:38:58.481 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50191.log 2023-08-25T05:38:58.482 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43546.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62534.log.gz 2023-08-25T05:38:58.482 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43546.log.gz 2023-08-25T05:38:58.484 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56385.log 2023-08-25T05:38:58.485 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50191.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50191.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52757.log 2023-08-25T05:38:58.486 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:38:58.487 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.56385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45929.log 2023-08-25T05:38:58.488 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52757.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56385.log.gz 2023-08-25T05:38:58.489 INFO:teuthology.orchestra.run.smithi055.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52757.log.gz 2023-08-25T05:38:58.490 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64070.log 2023-08-25T05:38:58.492 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45929.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.45929.log.gz 2023-08-25T05:38:58.492 INFO:teuthology.orchestra.run.smithi055.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.69662.log 2023-08-25T05:38:58.493 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.64070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65607.log 2023-08-25T05:38:58.494 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.69662.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64070.log.gz 2023-08-25T05:38:58.495 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69662.log.gz 2023-08-25T05:38:58.496 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68579.log 2023-08-25T05:38:58.498 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51689.log 2023-08-25T05:38:58.499 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65607.log: /var/log/ceph/ceph-client.admin.68579.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65607.log.gz 2023-08-25T05:38:58.499 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68579.log.gz 2023-08-25T05:38:58.500 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63445.log 2023-08-25T05:38:58.502 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.51689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44796.log 2023-08-25T05:38:58.503 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63445.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51689.log.gz 2023-08-25T05:38:58.504 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63445.log.gz 2023-08-25T05:38:58.504 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59545.log 2023-08-25T05:38:58.506 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60167.log 2023-08-25T05:38:58.507 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59545.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44796.log.gz 2023-08-25T05:38:58.508 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59545.log.gz 2023-08-25T05:38:58.509 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55930.log 2023-08-25T05:38:58.511 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52641.log 2023-08-25T05:38:58.511 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60167.log: /var/log/ceph/ceph-client.admin.55930.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60167.log.gz 2023-08-25T05:38:58.512 INFO:teuthology.orchestra.run.smithi055.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55930.log.gz 2023-08-25T05:38:58.513 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59311.log 2023-08-25T05:38:58.515 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52889.log 2023-08-25T05:38:58.516 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59311.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52641.log.gz 2023-08-25T05:38:58.516 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59311.log.gz 2023-08-25T05:38:58.517 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60059.log 2023-08-25T05:38:58.519 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48702.log 2023-08-25T05:38:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.60059.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52889.log.gz 2023-08-25T05:38:58.520 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60059.log.gz 2023-08-25T05:38:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45422.log 2023-08-25T05:38:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48436.log 2023-08-25T05:38:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.45422.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48702.log.gz 2023-08-25T05:38:58.524 INFO:teuthology.orchestra.run.smithi055.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45422.log.gz 2023-08-25T05:38:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44437.log 2023-08-25T05:38:58.527 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.48436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52146.log 2023-08-25T05:38:58.528 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44437.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48436.log.gz 2023-08-25T05:38:58.529 INFO:teuthology.orchestra.run.smithi055.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44437.log.gz 2023-08-25T05:38:58.529 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62756.log 2023-08-25T05:38:58.531 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.52146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50718.log 2023-08-25T05:38:58.532 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62756.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52146.log.gz 2023-08-25T05:38:58.533 INFO:teuthology.orchestra.run.smithi055.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62756.log.gz 2023-08-25T05:38:58.533 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59063.log 2023-08-25T05:38:58.535 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50295.log 2023-08-25T05:38:58.536 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50718.log: /var/log/ceph/ceph-client.admin.59063.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50718.log.gz 2023-08-25T05:38:58.537 INFO:teuthology.orchestra.run.smithi055.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59063.log.gz 2023-08-25T05:38:58.538 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53563.log 2023-08-25T05:38:58.540 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.50295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54039.log 2023-08-25T05:38:58.541 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53563.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50295.log.gz 2023-08-25T05:38:58.542 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53563.log.gz 2023-08-25T05:38:58.542 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42964.log 2023-08-25T05:38:58.544 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.54039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54958.log 2023-08-25T05:38:58.545 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.42964.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54039.log.gz 2023-08-25T05:38:58.546 INFO:teuthology.orchestra.run.smithi055.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42964.log.gz 2023-08-25T05:38:58.546 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53733.log 2023-08-25T05:38:58.548 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57289.log 2023-08-25T05:38:58.549 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.0.54958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54958.log.gz 2023-08-25T05:38:58.550 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53733.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53733.log.gz 2023-08-25T05:38:58.550 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62910.log 2023-08-25T05:38:58.552 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.57289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67439.log 2023-08-25T05:38:58.553 INFO:teuthology.orchestra.run.smithi055.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57289.log.gz 2023-08-25T05:38:58.554 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.62910.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66354.log 2023-08-25T05:38:58.554 INFO:teuthology.orchestra.run.smithi055.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62910.log.gz 2023-08-25T05:38:58.556 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67439.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67439.log.gz 2023-08-25T05:38:58.556 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44593.log 2023-08-25T05:38:58.558 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.66354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46483.log 2023-08-25T05:38:58.559 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.44593.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66354.log.gz 2023-08-25T05:38:58.560 INFO:teuthology.orchestra.run.smithi055.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.44593.log.gz 2023-08-25T05:38:58.560 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67895.log 2023-08-25T05:38:58.562 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.46483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47449.log 2023-08-25T05:38:58.563 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67895.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46483.log.gz 2023-08-25T05:38:58.563 INFO:teuthology.orchestra.run.smithi055.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67895.log.gz 2023-08-25T05:38:58.564 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43371.log 2023-08-25T05:38:58.566 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.47449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67739.log 2023-08-25T05:38:58.567 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.43371.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47449.log.gz 2023-08-25T05:38:58.568 INFO:teuthology.orchestra.run.smithi055.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43371.log.gz 2023-08-25T05:38:58.569 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53890.log 2023-08-25T05:38:58.570 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65264.log 2023-08-25T05:38:58.571 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.53890.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67739.log.gz 2023-08-25T05:38:58.572 INFO:teuthology.orchestra.run.smithi055.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53890.log.gz 2023-08-25T05:38:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67921.log 2023-08-25T05:38:58.575 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65841.log 2023-08-25T05:38:58.575 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67921.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65264.log.gz 2023-08-25T05:38:58.576 INFO:teuthology.orchestra.run.smithi055.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.67921.log.gz 2023-08-25T05:38:58.577 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63025.log 2023-08-25T05:38:58.579 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.65841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58089.log 2023-08-25T05:38:58.579 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.63025.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65841.log.gz 2023-08-25T05:38:58.580 INFO:teuthology.orchestra.run.smithi055.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63025.log.gz 2023-08-25T05:38:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67005.log 2023-08-25T05:38:58.583 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.58089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59519.log 2023-08-25T05:38:58.583 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.67005.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.58089.log.gz 2023-08-25T05:38:58.584 INFO:teuthology.orchestra.run.smithi055.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67005.log.gz 2023-08-25T05:38:58.585 INFO:teuthology.orchestra.run.smithi055.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43757.log 2023-08-25T05:38:58.587 INFO:teuthology.orchestra.run.smithi055.stderr:/var/log/ceph/ceph-client.admin.59519.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59519.log.gz/var/log/ceph/ceph-client.admin.43757.log: 2023-08-25T05:38:58.588 INFO:teuthology.orchestra.run.smithi055.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43757.log.gz 2023-08-25T05:38:58.836 INFO:teuthology.orchestra.run.smithi110.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-08-25T05:38:59.198 INFO:teuthology.orchestra.run.smithi110.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-08-25T05:38:59.340 INFO:teuthology.orchestra.run.smithi110.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-08-25T05:38:59.504 INFO:teuthology.orchestra.run.smithi110.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-08-25T05:39:00.152 INFO:teuthology.orchestra.run.smithi055.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-08-25T05:39:00.417 INFO:teuthology.orchestra.run.smithi110.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-08-25T05:39:00.651 INFO:teuthology.orchestra.run.smithi110.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-08-25T05:39:00.752 INFO:teuthology.orchestra.run.smithi055.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-08-25T05:39:01.057 INFO:teuthology.orchestra.run.smithi055.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-08-25T05:39:01.137 INFO:teuthology.orchestra.run.smithi055.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-08-25T05:39:01.176 INFO:teuthology.orchestra.run.smithi055.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-08-25T05:39:01.236 INFO:teuthology.orchestra.run.smithi110.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-08-25T05:39:01.238 INFO:teuthology.orchestra.run.smithi110.stderr: 2023-08-25T05:39:01.238 INFO:teuthology.orchestra.run.smithi110.stderr:real 0m4.233s 2023-08-25T05:39:01.238 INFO:teuthology.orchestra.run.smithi110.stderr:user 0m18.454s 2023-08-25T05:39:01.238 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m1.603s 2023-08-25T05:39:01.273 INFO:teuthology.orchestra.run.smithi055.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-08-25T05:39:01.274 INFO:teuthology.orchestra.run.smithi055.stderr: 2023-08-25T05:39:01.275 INFO:teuthology.orchestra.run.smithi055.stderr:real 0m4.289s 2023-08-25T05:39:01.275 INFO:teuthology.orchestra.run.smithi055.stderr:user 0m20.621s 2023-08-25T05:39:01.275 INFO:teuthology.orchestra.run.smithi055.stderr:sys 0m3.484s 2023-08-25T05:39:01.277 INFO:tasks.ceph:Archiving logs... 2023-08-25T05:39:01.277 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379036/remote/smithi055/log 2023-08-25T05:39:01.278 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-25T05:39:03.642 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379036/remote/smithi110/log 2023-08-25T05:39:03.643 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-25T05:39:05.160 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-08-25T05:39:05.169 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-08-25T05:39:05.170 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-25T05:39:05.173 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-25T05:39:05.270 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-08-25T05:39:05.279 INFO:teuthology.task.clock:Checking final clock skew... 2023-08-25T05:39:05.279 DEBUG:teuthology.orchestra.run.smithi055:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-25T05:39:05.283 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-25T05:39:05.302 INFO:teuthology.orchestra.run.smithi055.stdout: remote refid st t when poll reach delay offset jitter 2023-08-25T05:39:05.302 INFO:teuthology.orchestra.run.smithi055.stdout:============================================================================== 2023-08-25T05:39:05.302 INFO:teuthology.orchestra.run.smithi055.stdout:*hv01.front.sepi 44.4.53.2 2 u 7 128 377 0.189 -3.929 0.749 2023-08-25T05:39:05.302 INFO:teuthology.orchestra.run.smithi055.stdout:+hv02.front.sepi 155.248.196.28 3 u 59 128 377 0.166 +0.045 0.495 2023-08-25T05:39:05.303 INFO:teuthology.orchestra.run.smithi055.stdout:+hv03.front.sepi 144.34.193.110 3 u 11 128 377 0.164 -1.325 0.567 2023-08-25T05:39:05.303 INFO:teuthology.orchestra.run.smithi055.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-08-25T05:39:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: remote refid st t when poll reach delay offset jitter 2023-08-25T05:39:05.304 INFO:teuthology.orchestra.run.smithi110.stdout:============================================================================== 2023-08-25T05:39:05.304 INFO:teuthology.orchestra.run.smithi110.stdout:*hv01.front.sepi 44.4.53.2 2 u 15 64 377 0.082 -2.650 0.340 2023-08-25T05:39:05.304 INFO:teuthology.orchestra.run.smithi110.stdout:+hv02.front.sepi 155.248.196.28 3 u 12 64 377 0.102 +1.455 0.342 2023-08-25T05:39:05.304 INFO:teuthology.orchestra.run.smithi110.stdout:+hv03.front.sepi 144.34.193.110 3 u 17 64 377 0.091 -0.241 0.444 2023-08-25T05:39:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-08-25T05:39:05.305 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-08-25T05:39:05.314 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-08-25T05:39:05.315 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-08-25T05:39:05.322 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-08-25T05:39:05.330 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-08-25T05:39:05.428 INFO:teuthology.task.internal:Duration was 6547.302921 seconds 2023-08-25T05:39:05.428 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-08-25T05:39:05.436 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-08-25T05:39:05.437 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-25T05:39:05.440 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-25T05:39:05.521 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-08-25T05:39:05.522 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi055.front.sepia.ceph.com 2023-08-25T05:39:05.522 DEBUG:teuthology.orchestra.run.smithi055:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-25T05:39:05.544 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2023-08-25T05:39:05.545 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-25T05:39:05.566 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-08-25T05:39:05.567 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-25T05:39:05.593 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-25T05:39:05.645 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-08-25T05:39:05.646 DEBUG:teuthology.orchestra.run.smithi055:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-25T05:39:05.681 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-25T05:39:05.774 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-08-25T05:39:05.784 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-08-25T05:39:05.785 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-25T05:39:05.806 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-25T05:39:05.827 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-08-25T05:39:05.837 DEBUG:teuthology.orchestra.run.smithi055:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-25T05:39:05.849 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-25T05:39:05.865 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = core 2023-08-25T05:39:05.888 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2023-08-25T05:39:05.907 DEBUG:teuthology.orchestra.run.smithi055:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-25T05:39:05.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T05:39:05.934 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-25T05:39:05.957 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-25T05:39:05.958 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-08-25T05:39:05.969 INFO:teuthology.task.internal:Transferring archived files... 2023-08-25T05:39:05.970 DEBUG:teuthology.misc:Transferring archived files from smithi055:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379036/remote/smithi055 2023-08-25T05:39:05.971 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-25T05:39:06.000 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379036/remote/smithi110 2023-08-25T05:39:06.000 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-25T05:39:06.025 INFO:teuthology.task.internal:Removing archive directory... 2023-08-25T05:39:06.026 DEBUG:teuthology.orchestra.run.smithi055:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-25T05:39:06.041 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-25T05:39:06.074 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-08-25T05:39:06.085 INFO:teuthology.task.internal:Not uploading archives. 2023-08-25T05:39:06.085 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-08-25T05:39:06.094 INFO:teuthology.task.internal:Tidying up after the test... 2023-08-25T05:39:06.095 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-25T05:39:06.098 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-25T05:39:06.104 INFO:teuthology.orchestra.run.smithi055.stdout: 657855 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 25 05:39 /home/ubuntu/cephtest 2023-08-25T05:39:06.127 INFO:teuthology.orchestra.run.smithi110.stdout: 657853 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 25 05:39 /home/ubuntu/cephtest 2023-08-25T05:39:06.129 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-08-25T05:39:06.138 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-08-25T05:39:06.176 INFO:teuthology.nuke:Checking targets against current locks 2023-08-25T05:39:06.201 DEBUG:teuthology.nuke:shortname: smithi055 2023-08-25T05:39:06.202 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T05:39:06.222 DEBUG:teuthology.nuke:shortname: smithi110 2023-08-25T05:39:06.222 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T05:39:06.225 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379036', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 03:41:17.791604', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCbSExc0/U0hdNt/KP9I42BESUbsI38oGqLfrdMpP88j4nIcB9jNfBW9vGqukDfdZ9bWp4UT/JYpYltO7n++MXY='} 2023-08-25T05:39:06.244 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-25_01:50:32-fs-wip-rishabh-2023aug3-b5-testing-default-smithi/7379036', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 03:41:17.793165', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLy9V2QndWWs7FahLdZ2TMHZaau2Xc5gQJcPaEif4xti/5076p9YL2e6ua5Am6ZYj1ULbJVIOmyP/RzlEsbGmWU='} 2023-08-25T05:39:06.276 INFO:teuthology.orchestra.console.smithi055:Power off 2023-08-25T05:39:06.277 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T05:39:06.296 INFO:teuthology.orchestra.console.smithi110:Power off 2023-08-25T05:39:06.297 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T05:39:06.310 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2023-08-25T05:39:06.311 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T05:39:06.321 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2023-08-25T05:39:06.322 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T05:39:06.335 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2023-08-25T05:39:06.345 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-08-25T05:39:10.336 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T05:39:10.347 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T05:39:10.447 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2023-08-25T05:39:10.457 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-08-25T05:39:14.450 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T05:39:14.459 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T05:39:14.560 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2023-08-25T05:39:14.570 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-08-25T05:39:14.662 INFO:teuthology.orchestra.console.smithi055:Power off completed 2023-08-25T05:39:18.575 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T05:39:18.687 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-08-25T05:39:18.788 INFO:teuthology.orchestra.console.smithi110:Power off completed 2023-08-25T05:39:18.892 INFO:teuthology.run:Summary data: client.0-kernel-sha1: a6a69670761025e039dc5ae86619b0cf04c46dc2 client.1-kernel-sha1: a6a69670761025e039dc5ae86619b0cf04c46dc2 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 6547.302921295166 failure_reason: '"2023-08-25T04:17:22.687915+0000 mon.a (mon.0) 543 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_rishabh@teuthology success: false 2023-08-25T05:39:18.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T05:39:18.971 INFO:teuthology.run:FAIL